[2025-09-17T01:44:05.194347] [INFO ] [MAIN ] Using last completed trading day: 2025-09-16 [2025-09-17T01:44:05.194662] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-17T01:44:05.194781] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-17T01:44:05.194835] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-17T01:44:06.758118] [DEBUG] [SYMBOL ] Found 2421 valid NYSE symbols. [2025-09-17T01:44:06.758406] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-17T01:44:06.758678] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-17T01:44:06.759349] [INFO ] [LOCAL ] Symbols cache updated with 2369 symbols. [2025-09-17T01:44:06.759414] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-17T01:44:06.759453] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-17T01:44:06.759529] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-17T01:44:06.759723] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-17T01:44:06.760105] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-09-17T01:44:06.760158] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-17T01:44:06.760350] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-17T01:44:06.760412] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2369 valid symbols. [2025-09-17T01:44:06.760474] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-17T01:44:06.760535] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-17T01:44:06.786361] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-17T01:44:06.812560] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-17T01:44:06.812942] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-17T01:44:06.813005] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-17T01:44:06.813050] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-17T01:44:06.813497] [WARN ] [STATE ] State set to: RUNNING [2025-09-17T01:44:06.813683] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-17T01:44:06.814099] [DEBUG] [LOCAL ] Found 2369 symbols in cached list. [2025-09-17T01:44:06.814151] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-17T01:44:06.814190] [INFO ] [MAIN ] Starting incremental update for 2369 symbols. [2025-09-17T01:44:06.814226] [INFO ] [MAIN ] Running in parallel mode [2025-09-17T01:44:06.814526] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2369 symbols [2025-09-17T01:44:07.336805] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:07.428274] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:07.565199] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:07.567753] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:07.567987] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-17T01:44:07.568740] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-17T01:44:07.569114] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-17T01:44:07.569195] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-17T01:44:07.570683] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-17T01:44:07.575681] [DEBUG] [LOCAL ] AACT: Loaded 8064 existing records from primary storage. [2025-09-17T01:44:07.575287] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-17T01:44:07.575885] [INFO ] [MAIN ] AACT: Loaded 8064 existing records. [2025-09-17T01:44:07.891936] [DEBUG] [LOCAL ] A: Loaded 37747 existing records from primary storage. [2025-09-17T01:44:07.914896] [INFO ] [MAIN ] A: Loaded 37747 existing records. [2025-09-17T01:44:07.941945] [WARN ] [MAIN ] AACT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:08.004499] [DEBUG] [LOCAL ] AA: Loaded 39972 existing records from primary storage. [2025-09-17T01:44:08.064928] [INFO ] [MAIN ] AA: Loaded 39972 existing records. [2025-09-17T01:44:08.010117] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-17T01:44:08.094191] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-17T01:44:08.152099] [DEBUG] [LOCAL ] AACT: Deleted primary data file. [2025-09-17T01:44:08.211218] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-17T01:44:08.420886] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:08.438971] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-17T01:44:08.546954] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-17T01:44:08.669256] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-17T01:44:08.673101] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-17T01:44:08.667450] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:08.673041] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:08.689999] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-11. [2025-09-17T01:44:08.695708] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-17T01:44:08.758559] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-17T01:44:08.850449] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-17T01:44:08.865416] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-17T01:44:09.440314] [INFO ] [REMOTE ] AACT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:09.469134] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-11. [2025-09-17T01:44:09.576480] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:09.582491] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T01:44:09.593118] [INFO ] [REMOTE ] A: Fetching primary data for 2024-11. [2025-09-17T01:44:09.633408] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-17T01:44:09.662126] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:09.663090] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-11. [2025-09-17T01:44:10.007722] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-17T01:44:10.008873] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-17T01:44:10.107971] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T01:44:10.109688] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-12. [2025-09-17T01:44:10.355864] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-17T01:44:10.356908] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-17T01:44:10.617737] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-17T01:44:10.618771] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-17T01:44:10.708273] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T01:44:10.709356] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-01. [2025-09-17T01:44:10.967759] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T01:44:10.968786] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-17T01:44:10.984700] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-17T01:44:10.985833] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-17T01:44:11.346400] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-17T01:44:11.347441] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-17T01:44:11.434355] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T01:44:11.444530] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-17T01:44:11.508371] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T01:44:11.509450] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-17T01:44:11.558385] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T01:44:11.569101] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-17T01:44:11.646991] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-17T01:44:11.647900] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-17T01:44:11.907227] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-17T01:44:11.908141] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-17T01:44:11.923539] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-17T01:44:11.925036] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-17T01:44:12.155618] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-17T01:44:12.156566] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-17T01:44:12.432478] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-17T01:44:12.433543] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-17T01:44:12.747735] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T01:44:12.750554] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-17T01:44:13.124238] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T01:44:13.125206] [INFO ] [REMOTE ] AAM: Full fetch complete (1044 records). [2025-09-17T01:44:13.125315] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-17T01:44:13.325507] [WARN ] [VALIDATOR ] AAM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-17T01:44:13.325912] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:44:13.325976] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:44:13.326080] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-17T01:44:13.326207] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-17T01:44:13.326276] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-17T01:44:13.326353] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-17T01:44:13.326451] [INFO ] [MAIN ] Update Progress: 1/2369 symbols completed. AAM took 6.4s. Estimated remaining: 4h 17m 1s. Rate: 9.2 symbols/min [2025-09-17T01:44:13.470709] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T01:44:13.531442] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-17T01:44:13.558890] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T01:44:13.557882] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:13.563379] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-17T01:44:13.563514] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-17T01:44:13.564629] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-17T01:44:13.564908] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-17T01:44:13.565080] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-17T01:44:13.565321] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-17T01:44:13.565490] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-17T01:44:13.879079] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-17T01:44:13.927533] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-17T01:44:13.992768] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:13.993179] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-11. [2025-09-17T01:44:14.191619] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T01:44:14.198735] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-17T01:44:14.207279] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:14.207677] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-11 [2025-09-17T01:44:14.208158] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-17T01:44:14.438037] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:14.438383] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-17T01:44:14.438870] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-17T01:44:15.066119] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T01:44:15.069116] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-17T01:44:15.267527] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T01:44:15.278062] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-17T01:44:15.474449] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T01:44:15.478317] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-17T01:44:16.061166] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T01:44:16.072237] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-17T01:44:16.093608] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T01:44:16.096747] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-17T01:44:16.297604] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T01:44:16.303333] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-17T01:44:17.036099] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T01:44:17.036302] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T01:44:17.048776] [INFO ] [REMOTE ] AACT: Full fetch complete (10140 records). [2025-09-17T01:44:17.048878] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-17T01:44:17.080932] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-17T01:44:17.236490] [WARN ] [VALIDATOR ] AACT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T01:44:17.236784] [FATAL] [MAIN ] AACT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:44:17.236861] [WARN ] [MAIN ] AACT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:44:17.236912] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-17T01:44:17.236977] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-17T01:44:17.237019] [INFO ] [LOCAL ] AACT: Starting deletion of derivative data. [2025-09-17T01:44:17.237273] [DEBUG] [LOCAL ] AACT: Deleted derivative data file. [2025-09-17T01:44:17.237403] [INFO ] [MAIN ] Update Progress: 2/2369 symbols completed. AACT took 10.4s. Estimated remaining: 3h 25m 36s. Rate: 11.5 symbols/min [2025-09-17T01:44:17.407297] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:17.421200] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T01:44:17.426413] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-17T01:44:17.465324] [DEBUG] [LOCAL ] AAP: Loaded 38811 existing records from primary storage. [2025-09-17T01:44:17.465485] [INFO ] [MAIN ] AAP: Loaded 38811 existing records. [2025-09-17T01:44:17.643699] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:17.643944] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-17T01:44:17.644005] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-17T01:44:17.645130] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-17T01:44:17.645195] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-17T01:44:18.033687] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:18.034058] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-11. [2025-09-17T01:44:18.065191] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T01:44:18.075502] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-17T01:44:18.567882] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T01:44:18.574227] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-17T01:44:18.688212] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T01:44:18.698774] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-17T01:44:19.689862] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T01:44:19.701724] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-17T01:44:19.739828] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T01:44:19.745679] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-17T01:44:19.906822] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T01:44:19.917278] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-17T01:44:20.159323] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T01:44:20.170223] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-17T01:44:20.650759] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T01:44:20.656145] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-17T01:44:21.309812] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T01:44:21.320731] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-17T01:44:21.479674] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T01:44:21.485834] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-17T01:44:21.689890] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T01:44:21.701991] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-17T01:44:21.930359] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T01:44:21.942887] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-17T01:44:22.621690] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T01:44:22.627223] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-17T01:44:22.767561] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T01:44:22.777907] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-17T01:44:23.010732] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T01:44:23.021711] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-17T01:44:23.754844] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T01:44:23.760749] [INFO ] [REMOTE ] AAMI: Full fetch complete (29371 records). [2025-09-17T01:44:23.761171] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-17T01:44:23.993590] [WARN ] [VALIDATOR ] AAMI: Validation failed - insufficient historical data. Have 176 unique days, need 200 days [2025-09-17T01:44:23.994074] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:44:23.994215] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:44:23.994375] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-17T01:44:23.994528] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-17T01:44:23.994631] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-17T01:44:23.994719] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-17T01:44:23.994856] [INFO ] [MAIN ] Update Progress: 3/2369 symbols completed. AAMI took 10.7s. Estimated remaining: 3h 45m 50s. Rate: 10.5 symbols/min [2025-09-17T01:44:24.204790] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:24.207909] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-17T01:44:24.221534] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-17T01:44:24.250919] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T01:44:24.261732] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-17T01:44:24.279725] [DEBUG] [LOCAL ] AAT: Loaded 22530 existing records from primary storage. [2025-09-17T01:44:24.279985] [INFO ] [MAIN ] AAT: Loaded 22530 existing records. [2025-09-17T01:44:24.460313] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:24.460574] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-17T01:44:24.460848] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-17T01:44:24.461772] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-17T01:44:24.461839] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-17T01:44:24.850378] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:24.850999] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-11. [2025-09-17T01:44:24.852485] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T01:44:24.865569] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-17T01:44:26.076887] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T01:44:26.082107] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-17T01:44:26.125812] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T01:44:26.137490] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-17T01:44:26.195437] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T01:44:26.206823] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-17T01:44:26.407748] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T01:44:26.418623] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-17T01:44:27.029694] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T01:44:27.035607] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-17T01:44:27.970104] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T01:44:27.982153] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-17T01:44:28.056600] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T01:44:28.068247] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-17T01:44:28.139603] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T01:44:28.161696] [INFO ] [REMOTE ] A: Full fetch complete (72976 records). [2025-09-17T01:44:28.162740] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T01:44:28.162817] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-17T01:44:28.212882] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-17T01:44:28.564359] [DEBUG] [VALIDATOR ] A: All expected trading days are present. [2025-09-17T01:44:28.564464] [DEBUG] [VALIDATOR ] A: Primary data validation passed. [2025-09-17T01:44:28.565168] [INFO ] [MAIN ] A: Fetched primary data is valid. [2025-09-17T01:44:28.565251] [DEBUG] [LOCAL ] A: Saving primary data. [2025-09-17T01:44:28.566756] [DEBUG] [LOCAL ] A: Trimmed 72976 records to 50850 (keeping 200 days of data) [2025-09-17T01:44:28.899160] [DEBUG] [LOCAL ] A: Primary data saved (50850 records). [2025-09-17T01:44:28.899352] [INFO ] [MAIN ] A: Full history saved. [2025-09-17T01:44:28.899787] [INFO ] [MAIN ] Update Progress: 4/2369 symbols completed. A took 22.1s. Estimated remaining: 3h 37m 38s. Rate: 10.9 symbols/min [2025-09-17T01:44:29.073755] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:29.073969] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-17T01:44:29.074021] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-17T01:44:29.074136] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-17T01:44:29.074190] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-17T01:44:29.074241] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-17T01:44:29.074316] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-17T01:44:29.447411] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:29.447766] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-11. [2025-09-17T01:44:29.490899] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T01:44:29.496874] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-17T01:44:29.669055] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:29.669364] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-11 [2025-09-17T01:44:29.669822] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-17T01:44:29.737492] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T01:44:29.749548] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-17T01:44:29.817310] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T01:44:29.828364] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-17T01:44:29.875457] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:29.875841] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-17T01:44:29.876338] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-17T01:44:30.107307] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:30.107662] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-17T01:44:30.108084] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-17T01:44:30.336578] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:30.337000] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-17T01:44:30.337483] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-17T01:44:30.549572] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:30.549953] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-17T01:44:30.550398] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-17T01:44:30.779704] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:30.782814] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-17T01:44:30.783850] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T01:44:30.784142] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-17T01:44:30.791802] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-17T01:44:31.016193] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:44:31.016529] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-17T01:44:31.017000] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-17T01:44:31.500674] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T01:44:31.509914] [INFO ] [REMOTE ] AA: Full fetch complete (77366 records). [2025-09-17T01:44:31.510130] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-17T01:44:31.828335] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T01:44:31.831083] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-17T01:44:31.932753] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-17T01:44:31.932978] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-17T01:44:31.933818] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-17T01:44:31.933894] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-17T01:44:31.935835] [DEBUG] [LOCAL ] AA: Trimmed 77366 records to 53585 (keeping 200 days of data) [2025-09-17T01:44:32.107344] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-17T01:44:32.145431] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-17T01:44:32.324239] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T01:44:32.343046] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-17T01:44:32.491234] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T01:44:32.514213] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-17T01:44:32.525379] [DEBUG] [LOCAL ] AA: Primary data saved (53585 records). [2025-09-17T01:44:32.525728] [INFO ] [MAIN ] AA: Full history saved. [2025-09-17T01:44:32.526183] [INFO ] [MAIN ] Update Progress: 5/2369 symbols completed. AA took 25.7s. Estimated remaining: 3h 22m 37s. Rate: 11.7 symbols/min [2025-09-17T01:44:32.793235] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:32.822844] [DEBUG] [LOCAL ] AB: Loaded 17872 existing records from primary storage. [2025-09-17T01:44:32.823116] [INFO ] [MAIN ] AB: Loaded 17872 existing records. [2025-09-17T01:44:33.095410] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:33.095795] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-17T01:44:33.095891] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-17T01:44:33.096481] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-17T01:44:33.096545] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-17T01:44:33.461082] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:33.470892] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-11. [2025-09-17T01:44:33.471834] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T01:44:33.477035] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-17T01:44:34.004883] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T01:44:34.011529] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-17T01:44:34.094752] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T01:44:34.106223] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-17T01:44:34.166836] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T01:44:34.169335] [INFO ] [REMOTE ] AAUC: Full fetch complete (6523 records). [2025-09-17T01:44:34.169419] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-17T01:44:34.361363] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-17T01:44:34.361623] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:44:34.361692] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:44:34.361739] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-17T01:44:34.361801] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-17T01:44:34.361845] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-17T01:44:34.361894] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-17T01:44:34.361958] [INFO ] [MAIN ] Update Progress: 6/2369 symbols completed. AAUC took 5.5s. Estimated remaining: 3h 0m 49s. Rate: 13.1 symbols/min [2025-09-17T01:44:34.531794] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:34.553272] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T01:44:34.560242] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-17T01:44:34.594549] [DEBUG] [LOCAL ] ABBV: Loaded 40044 existing records from primary storage. [2025-09-17T01:44:34.594735] [INFO ] [MAIN ] ABBV: Loaded 40044 existing records. [2025-09-17T01:44:34.769271] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:34.769555] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-17T01:44:34.769614] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-17T01:44:34.770611] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-17T01:44:34.770697] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-17T01:44:35.122755] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:35.123111] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-11. [2025-09-17T01:44:35.285599] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T01:44:35.292014] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-17T01:44:35.869512] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T01:44:35.882097] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-17T01:44:36.021486] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T01:44:36.028872] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-17T01:44:36.338628] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T01:44:36.345967] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-17T01:44:37.217780] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T01:44:37.225834] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-17T01:44:37.342389] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T01:44:37.352634] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-17T01:44:37.431979] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T01:44:37.441415] [INFO ] [REMOTE ] AAP: Full fetch complete (75131 records). [2025-09-17T01:44:37.441576] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-17T01:44:37.835987] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-17T01:44:37.841529] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-17T01:44:37.851812] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-17T01:44:37.852257] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-17T01:44:37.852874] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T01:44:37.859942] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-17T01:44:37.860977] [DEBUG] [LOCAL ] AAP: Trimmed 75131 records to 52202 (keeping 200 days of data) [2025-09-17T01:44:38.181016] [DEBUG] [LOCAL ] AAP: Primary data saved (52202 records). [2025-09-17T01:44:38.181171] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-17T01:44:38.181266] [INFO ] [MAIN ] Update Progress: 7/2369 symbols completed. AAP took 20.9s. Estimated remaining: 2h 56m 24s. Rate: 13.4 symbols/min [2025-09-17T01:44:38.350039] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:38.369765] [DEBUG] [LOCAL ] ABCB: Loaded 21813 existing records from primary storage. [2025-09-17T01:44:38.369907] [INFO ] [MAIN ] ABCB: Loaded 21813 existing records. [2025-09-17T01:44:38.546029] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:38.546274] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-17T01:44:38.546334] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-17T01:44:38.546890] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-17T01:44:38.546950] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-17T01:44:38.902016] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:38.902421] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-11. [2025-09-17T01:44:38.928200] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T01:44:38.937734] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-17T01:44:39.096356] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T01:44:39.100527] [INFO ] [REMOTE ] AAT: Full fetch complete (42467 records). [2025-09-17T01:44:39.100633] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-17T01:44:39.474571] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-17T01:44:39.474798] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-17T01:44:39.475282] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-17T01:44:39.475472] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-17T01:44:39.476688] [DEBUG] [LOCAL ] AAT: Trimmed 42467 records to 30568 (keeping 200 days of data) [2025-09-17T01:44:39.616510] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-17T01:44:39.629932] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-17T01:44:39.713704] [DEBUG] [LOCAL ] AAT: Primary data saved (30568 records). [2025-09-17T01:44:39.713884] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-17T01:44:39.714008] [INFO ] [MAIN ] Update Progress: 8/2369 symbols completed. AAT took 15.7s. Estimated remaining: 2h 41m 50s. Rate: 14.6 symbols/min [2025-09-17T01:44:39.884066] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:39.923262] [DEBUG] [LOCAL ] ABEV: Loaded 39678 existing records from primary storage. [2025-09-17T01:44:39.923428] [INFO ] [MAIN ] ABEV: Loaded 39678 existing records. [2025-09-17T01:44:40.101388] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:40.101710] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-17T01:44:40.101788] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-17T01:44:40.102753] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-17T01:44:40.102833] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-17T01:44:40.470909] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:40.471310] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-11. [2025-09-17T01:44:40.488429] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T01:44:40.494703] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-17T01:44:40.546339] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T01:44:40.556054] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-17T01:44:41.746613] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T01:44:41.755465] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-17T01:44:41.784068] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T01:44:41.795188] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-17T01:44:41.942112] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T01:44:41.951356] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-17T01:44:42.267166] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T01:44:42.277493] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-17T01:44:43.021549] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T01:44:43.027904] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-17T01:44:43.302870] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T01:44:43.310140] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-17T01:44:43.458548] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T01:44:43.468929] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-17T01:44:43.787459] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T01:44:43.792329] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-17T01:44:44.130055] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T01:44:44.141107] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-17T01:44:44.274816] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T01:44:44.281175] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-17T01:44:44.885546] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T01:44:44.891586] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-17T01:44:45.285164] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T01:44:45.295726] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-17T01:44:45.537381] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T01:44:45.548093] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-17T01:44:45.734740] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-17T01:44:45.746030] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-17T01:44:45.790356] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T01:44:45.795541] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-17T01:44:46.628357] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T01:44:46.631904] [INFO ] [REMOTE ] AB: Full fetch complete (46288 records). [2025-09-17T01:44:46.632013] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-17T01:44:47.012167] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-17T01:44:47.012362] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-17T01:44:47.013155] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-17T01:44:47.013404] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-17T01:44:47.035160] [DEBUG] [LOCAL ] AB: Trimmed 46288 records to 29296 (keeping 200 days of data) [2025-09-17T01:44:47.036061] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T01:44:47.044583] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-17T01:44:47.221221] [DEBUG] [LOCAL ] AB: Primary data saved (29296 records). [2025-09-17T01:44:47.221397] [INFO ] [MAIN ] AB: Full history saved. [2025-09-17T01:44:47.221494] [INFO ] [MAIN ] Update Progress: 9/2369 symbols completed. AB took 14.7s. Estimated remaining: 2h 56m 36s. Rate: 13.4 symbols/min [2025-09-17T01:44:47.393237] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:47.420543] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T01:44:47.434554] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-17T01:44:47.440784] [DEBUG] [LOCAL ] ABG: Loaded 12960 existing records from primary storage. [2025-09-17T01:44:47.440895] [INFO ] [MAIN ] ABG: Loaded 12960 existing records. [2025-09-17T01:44:47.621038] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:47.621496] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-17T01:44:47.621626] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-17T01:44:47.622121] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-17T01:44:47.622245] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-17T01:44:48.007995] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:48.012040] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-11. [2025-09-17T01:44:48.015430] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-17T01:44:48.027479] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-17T01:44:48.142603] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T01:44:48.149536] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-17T01:44:49.084914] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T01:44:49.088908] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-17T01:44:49.273163] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T01:44:49.278833] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-17T01:44:49.369760] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T01:44:49.381162] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-17T01:44:49.834624] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T01:44:49.846109] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-17T01:44:49.949706] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T01:44:49.953125] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-17T01:44:50.700116] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T01:44:50.707472] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-17T01:44:51.111441] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T01:44:51.115923] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-17T01:44:51.291332] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T01:44:51.302675] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-17T01:44:51.617111] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T01:44:51.833201] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-17T01:44:51.890098] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-17T01:44:52.136256] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T01:44:52.690153] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-17T01:44:53.122303] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T01:44:53.494136] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-17T01:44:53.497408] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T01:44:54.049802] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-17T01:44:54.290087] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-17T01:44:54.639743] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T01:44:54.643620] [INFO ] [REMOTE ] ABCB: Full fetch complete (43851 records). [2025-09-17T01:44:54.643759] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-17T01:44:55.029062] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-17T01:44:55.029206] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-17T01:44:55.029679] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-17T01:44:55.029737] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-17T01:44:55.030791] [DEBUG] [LOCAL ] ABCB: Trimmed 43851 records to 30681 (keeping 200 days of data) [2025-09-17T01:44:55.094481] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-17T01:44:55.217244] [DEBUG] [LOCAL ] ABCB: Primary data saved (30681 records). [2025-09-17T01:44:55.217406] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-17T01:44:55.217501] [INFO ] [MAIN ] Update Progress: 10/2369 symbols completed. ABCB took 17.0s. Estimated remaining: 3h 10m 18s. Rate: 12.4 symbols/min [2025-09-17T01:44:55.387373] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:44:55.409244] [DEBUG] [LOCAL ] ABM: Loaded 23397 existing records from primary storage. [2025-09-17T01:44:55.409393] [INFO ] [MAIN ] ABM: Loaded 23397 existing records. [2025-09-17T01:44:55.587843] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:44:55.588060] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-17T01:44:55.588110] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-17T01:44:55.588753] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-17T01:44:55.588813] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-17T01:44:55.907859] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-17T01:44:55.946794] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:44:56.347687] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T01:44:56.381620] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-17T01:44:56.690161] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-17T01:44:57.490137] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-11. [2025-09-17T01:44:57.667170] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T01:44:57.747779] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T01:44:58.290104] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-17T01:44:58.653914] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T01:44:59.090191] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-17T01:44:59.890190] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-17T01:44:59.994594] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T01:45:00.158978] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T01:45:00.167395] [INFO ] [REMOTE ] ABBV: Full fetch complete (77603 records). [2025-09-17T01:45:00.167618] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-17T01:45:00.573602] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-17T01:45:00.573732] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-17T01:45:00.574482] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-17T01:45:00.574545] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-17T01:45:00.576174] [DEBUG] [LOCAL ] ABBV: Trimmed 77603 records to 53690 (keeping 200 days of data) [2025-09-17T01:45:00.691254] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-17T01:45:00.965951] [DEBUG] [LOCAL ] ABBV: Primary data saved (53690 records). [2025-09-17T01:45:00.966218] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-17T01:45:00.968002] [INFO ] [MAIN ] Update Progress: 11/2369 symbols completed. ABBV took 26.6s. Estimated remaining: 3h 13m 29s. Rate: 12.2 symbols/min [2025-09-17T01:45:01.145841] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T01:45:01.163814] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:01.220797] [DEBUG] [LOCAL ] ABR: Loaded 38749 existing records from primary storage. [2025-09-17T01:45:01.220993] [INFO ] [MAIN ] ABR: Loaded 38749 existing records. [2025-09-17T01:45:01.406532] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:01.406827] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-17T01:45:01.406884] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-17T01:45:01.407878] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-17T01:45:01.407950] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-17T01:45:01.495308] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-17T01:45:01.805128] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:01.820329] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T01:45:02.290135] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-17T01:45:03.090185] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-11. [2025-09-17T01:45:03.890131] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-17T01:45:04.230083] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (2.73 seconds). [2025-09-17T01:45:04.690197] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-17T01:45:05.302169] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-09-17T01:45:05.490151] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-17T01:45:05.913238] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T01:45:06.154864] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T01:45:06.290167] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-17T01:45:06.334520] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-11 (3.24 seconds). [2025-09-17T01:45:06.940971] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T01:45:06.943270] [INFO ] [REMOTE ] ABG: Full fetch complete (26179 records). [2025-09-17T01:45:06.943377] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-17T01:45:07.097239] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-17T01:45:07.340630] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-17T01:45:07.340795] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-17T01:45:07.341150] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-17T01:45:07.341305] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-17T01:45:07.342308] [DEBUG] [LOCAL ] ABG: Trimmed 26179 records to 18953 (keeping 200 days of data) [2025-09-17T01:45:07.461849] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T01:45:07.502323] [DEBUG] [LOCAL ] ABG: Primary data saved (18953 records). [2025-09-17T01:45:07.502527] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-17T01:45:07.502672] [INFO ] [MAIN ] Update Progress: 12/2369 symbols completed. ABG took 20.3s. Estimated remaining: 3h 18m 40s. Rate: 11.9 symbols/min [2025-09-17T01:45:07.681458] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:07.726920] [DEBUG] [LOCAL ] ABT: Loaded 39983 existing records from primary storage. [2025-09-17T01:45:07.727096] [INFO ] [MAIN ] ABT: Loaded 39983 existing records. [2025-09-17T01:45:07.894040] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-17T01:45:07.917065] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:07.917309] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-17T01:45:07.917373] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-17T01:45:07.918341] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-17T01:45:07.918418] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-17T01:45:08.279917] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:08.495978] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T01:45:08.690141] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-17T01:45:09.490149] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-17T01:45:09.630262] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T01:45:09.636929] [INFO ] [REMOTE ] ABEV: Full fetch complete (77060 records). [2025-09-17T01:45:09.637135] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-17T01:45:10.032160] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-17T01:45:10.032289] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-17T01:45:10.033043] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-17T01:45:10.033108] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-17T01:45:10.034797] [DEBUG] [LOCAL ] ABEV: Trimmed 77060 records to 53272 (keeping 200 days of data) [2025-09-17T01:45:10.292333] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-11. [2025-09-17T01:45:10.284941] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T01:45:10.390444] [DEBUG] [LOCAL ] ABEV: Primary data saved (53272 records). [2025-09-17T01:45:10.390656] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-17T01:45:10.392314] [INFO ] [MAIN ] Update Progress: 13/2369 symbols completed. ABEV took 30.7s. Estimated remaining: 3h 12m 2s. Rate: 12.3 symbols/min [2025-09-17T01:45:10.563226] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:10.583068] [DEBUG] [LOCAL ] ACA: Loaded 16738 existing records from primary storage. [2025-09-17T01:45:10.583244] [INFO ] [MAIN ] ACA: Loaded 16738 existing records. [2025-09-17T01:45:10.765584] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:10.765858] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-17T01:45:10.765910] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-17T01:45:10.766394] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-17T01:45:10.766454] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-17T01:45:11.105929] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-17T01:45:11.139287] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:11.161724] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T01:45:11.890144] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-11. [2025-09-17T01:45:12.227283] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T01:45:12.481807] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T01:45:12.690091] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-17T01:45:13.072604] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T01:45:13.490121] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-17T01:45:13.691468] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T01:45:14.290184] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-17T01:45:15.090162] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-17T01:45:15.890207] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-17T01:45:16.444768] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-17T01:45:16.693921] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-17T01:45:16.696406] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (3.21 seconds). [2025-09-17T01:45:16.962832] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T01:45:17.490149] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-17T01:45:17.579018] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-17T01:45:17.904726] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T01:45:18.290125] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-17T01:45:19.090172] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-17T01:45:19.319451] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T01:45:19.872100] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T01:45:19.890068] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-17T01:45:20.218381] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T01:45:20.690132] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-17T01:45:21.490137] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-17T01:45:21.807324] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T01:45:22.096054] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T01:45:22.290111] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-17T01:45:22.607281] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T01:45:23.090154] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-17T01:45:23.535089] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T01:45:23.540394] [INFO ] [REMOTE ] ABM: Full fetch complete (43959 records). [2025-09-17T01:45:23.540607] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-17T01:45:23.896325] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-17T01:45:23.932981] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-17T01:45:23.933093] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-17T01:45:23.933597] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-17T01:45:23.933677] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-17T01:45:23.935355] [DEBUG] [LOCAL ] ABM: Trimmed 43959 records to 32145 (keeping 200 days of data) [2025-09-17T01:45:24.126786] [DEBUG] [LOCAL ] ABM: Primary data saved (32145 records). [2025-09-17T01:45:24.126957] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-17T01:45:24.127055] [INFO ] [MAIN ] Update Progress: 14/2369 symbols completed. ABM took 28.9s. Estimated remaining: 3h 36m 45s. Rate: 10.9 symbols/min [2025-09-17T01:45:24.330912] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:24.367226] [DEBUG] [LOCAL ] ACCO: Loaded 27598 existing records from primary storage. [2025-09-17T01:45:24.367452] [INFO ] [MAIN ] ACCO: Loaded 27598 existing records. [2025-09-17T01:45:24.607830] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:24.608197] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-17T01:45:24.608273] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-17T01:45:24.608939] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-17T01:45:24.609003] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-17T01:45:24.695359] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-17T01:45:25.103827] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:25.181083] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T01:45:25.426171] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T01:45:25.490182] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-17T01:45:26.290096] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-17T01:45:26.326987] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T01:45:26.640299] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T01:45:27.090191] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-11. [2025-09-17T01:45:27.890173] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-17T01:45:28.258335] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T01:45:28.370867] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T01:45:28.690132] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-17T01:45:29.375908] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T01:45:29.490131] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-17T01:45:30.290116] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-17T01:45:30.597565] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T01:45:30.709611] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T01:45:31.090149] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-17T01:45:31.890127] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-17T01:45:32.193508] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T01:45:32.334037] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T01:45:32.690205] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-17T01:45:33.490193] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-17T01:45:33.840569] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T01:45:33.973450] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T01:45:34.290193] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-17T01:45:35.090109] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-17T01:45:35.267523] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T01:45:35.597557] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T01:45:35.603813] [INFO ] [REMOTE ] ABR: Full fetch complete (75060 records). [2025-09-17T01:45:35.604001] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-17T01:45:35.898708] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-17T01:45:36.006359] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-17T01:45:36.006507] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-17T01:45:36.007338] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-17T01:45:36.007425] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-17T01:45:36.009195] [DEBUG] [LOCAL ] ABR: Trimmed 75060 records to 52177 (keeping 200 days of data) [2025-09-17T01:45:36.240044] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T01:45:36.349921] [DEBUG] [LOCAL ] ABR: Primary data saved (52177 records). [2025-09-17T01:45:36.350085] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-17T01:45:36.351469] [INFO ] [MAIN ] Update Progress: 15/2369 symbols completed. ABR took 35.4s. Estimated remaining: 3h 54m 11s. Rate: 10.1 symbols/min [2025-09-17T01:45:36.518414] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:36.518572] [DEBUG] [LOCAL ] ACEL: No existing data file found in primary storage. [2025-09-17T01:45:36.518616] [WARN ] [MAIN ] ACEL: No existing data found, performing full refresh instead. [2025-09-17T01:45:36.518754] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-17T01:45:36.518818] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-17T01:45:36.518867] [DEBUG] [LOCAL ] ACEL: No primary data file found to delete. [2025-09-17T01:45:36.518980] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-17T01:45:36.695436] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-17T01:45:36.883292] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:37.291928] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T01:45:37.490153] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-11. [2025-09-17T01:45:37.721022] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T01:45:37.723783] [INFO ] [REMOTE ] ACA: Full fetch complete (34094 records). [2025-09-17T01:45:37.723874] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-17T01:45:38.090509] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-17T01:45:38.090605] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-17T01:45:38.090973] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-17T01:45:38.091039] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-17T01:45:38.091889] [DEBUG] [LOCAL ] ACA: Trimmed 34094 records to 24455 (keeping 200 days of data) [2025-09-17T01:45:38.239546] [DEBUG] [LOCAL ] ACA: Primary data saved (24455 records). [2025-09-17T01:45:38.239708] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-17T01:45:38.239803] [INFO ] [MAIN ] Update Progress: 16/2369 symbols completed. ACA took 27.8s. Estimated remaining: 3h 44m 5s. Rate: 10.5 symbols/min [2025-09-17T01:45:38.295305] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-17T01:45:38.418583] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:38.435613] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T01:45:38.478627] [DEBUG] [LOCAL ] ACHR: Loaded 40168 existing records from primary storage. [2025-09-17T01:45:38.478805] [INFO ] [MAIN ] ACHR: Loaded 40168 existing records. [2025-09-17T01:45:38.655318] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:38.655558] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-17T01:45:38.655609] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-17T01:45:38.656453] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-17T01:45:38.656515] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-17T01:45:39.007385] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:39.090079] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-11. [2025-09-17T01:45:39.812730] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T01:45:39.890117] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-17T01:45:40.690162] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-17T01:45:41.283005] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-11 (2.19 seconds). [2025-09-17T01:45:41.312998] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T01:45:41.490167] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-17T01:45:41.856090] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T01:45:42.290164] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-17T01:45:43.057374] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T01:45:43.089066] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T01:45:43.097141] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-17T01:45:43.890140] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-17T01:45:44.690148] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-17T01:45:45.412915] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T01:45:45.490119] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-17T01:45:45.758052] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-17T01:45:46.027790] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T01:45:46.290145] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-17T01:45:46.547126] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T01:45:47.090151] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-17T01:45:47.608101] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T01:45:47.890120] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-17T01:45:48.410157] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T01:45:48.690129] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-17T01:45:49.336186] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T01:45:49.490073] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-17T01:45:50.290134] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-17T01:45:50.474971] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T01:45:50.538637] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T01:45:51.090183] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-17T01:45:51.890196] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-17T01:45:52.545755] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T01:45:52.609126] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T01:45:52.690112] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-17T01:45:52.800570] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-17T01:45:53.490196] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-17T01:45:53.829265] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T01:45:54.290101] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-17T01:45:54.654899] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T01:45:55.090166] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-17T01:45:55.292841] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T01:45:55.297069] [INFO ] [REMOTE ] ACCO: Full fetch complete (54179 records). [2025-09-17T01:45:55.297197] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-17T01:45:55.687315] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-17T01:45:55.687425] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-17T01:45:55.687999] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-17T01:45:55.688078] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-17T01:45:55.689872] [DEBUG] [LOCAL ] ACCO: Trimmed 54179 records to 38109 (keeping 200 days of data) [2025-09-17T01:45:55.893266] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-17T01:45:55.916721] [DEBUG] [LOCAL ] ACCO: Primary data saved (38109 records). [2025-09-17T01:45:55.916888] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-17T01:45:55.916998] [INFO ] [MAIN ] Update Progress: 17/2369 symbols completed. ACCO took 31.8s. Estimated remaining: 4h 11m 35s. Rate: 9.3 symbols/min [2025-09-17T01:45:56.106807] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:56.148162] [DEBUG] [LOCAL ] ACI: Loaded 39673 existing records from primary storage. [2025-09-17T01:45:56.148382] [INFO ] [MAIN ] ACI: Loaded 39673 existing records. [2025-09-17T01:45:56.339354] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:56.339814] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-17T01:45:56.339965] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-17T01:45:56.346032] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-17T01:45:56.355659] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-17T01:45:56.389468] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T01:45:56.701624] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-17T01:45:56.742870] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:57.490089] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-17T01:45:57.725389] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T01:45:57.728741] [INFO ] [REMOTE ] ACEL: Full fetch complete (39081 records). [2025-09-17T01:45:57.728862] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-17T01:45:58.111935] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-17T01:45:58.112132] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-17T01:45:58.112825] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-17T01:45:58.112923] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-17T01:45:58.114297] [DEBUG] [LOCAL ] ACEL: Trimmed 39081 records to 27547 (keeping 200 days of data) [2025-09-17T01:45:58.232333] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-17T01:45:58.293301] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-17T01:45:58.329110] [DEBUG] [LOCAL ] ACEL: Primary data saved (27547 records). [2025-09-17T01:45:58.329347] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-17T01:45:58.329480] [INFO ] [MAIN ] Update Progress: 18/2369 symbols completed. ACEL took 22.0s. Estimated remaining: 4h 2m 45s. Rate: 9.7 symbols/min [2025-09-17T01:45:58.511949] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:45:58.545541] [DEBUG] [LOCAL ] ACM: Loaded 31522 existing records from primary storage. [2025-09-17T01:45:58.545741] [INFO ] [MAIN ] ACM: Loaded 31522 existing records. [2025-09-17T01:45:58.735231] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:45:58.735495] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-17T01:45:58.735547] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-17T01:45:58.736313] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-17T01:45:58.736379] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-17T01:45:59.092246] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:45:59.092382] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-11. [2025-09-17T01:45:59.890115] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-11. [2025-09-17T01:46:00.004230] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-17T01:46:00.258501] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T01:46:00.690131] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-17T01:46:00.878053] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T01:46:01.162985] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T01:46:01.490192] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-17T01:46:02.290181] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-17T01:46:03.090141] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-17T01:46:03.309903] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-17T01:46:03.348065] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T01:46:03.543196] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T01:46:03.549633] [INFO ] [REMOTE ] ABT: Full fetch complete (77429 records). [2025-09-17T01:46:03.549809] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-17T01:46:03.899250] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-17T01:46:03.961508] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-17T01:46:03.961673] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-17T01:46:03.962553] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-17T01:46:03.962656] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-17T01:46:03.964353] [DEBUG] [LOCAL ] ABT: Trimmed 77429 records to 53621 (keeping 200 days of data) [2025-09-17T01:46:04.319152] [DEBUG] [LOCAL ] ABT: Primary data saved (53621 records). [2025-09-17T01:46:04.319348] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-17T01:46:04.319476] [INFO ] [MAIN ] Update Progress: 19/2369 symbols completed. ABT took 56.8s. Estimated remaining: 4h 2m 14s. Rate: 9.7 symbols/min [2025-09-17T01:46:04.490696] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:04.528482] [DEBUG] [LOCAL ] ACN: Loaded 39800 existing records from primary storage. [2025-09-17T01:46:04.528668] [INFO ] [MAIN ] ACN: Loaded 39800 existing records. [2025-09-17T01:46:04.701490] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-17T01:46:04.707089] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:46:04.707472] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-17T01:46:04.707690] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-17T01:46:04.709055] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-17T01:46:04.709123] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-17T01:46:04.981025] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T01:46:05.103603] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:05.490152] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-17T01:46:05.774478] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T01:46:06.290176] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-17T01:46:07.090160] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-11. [2025-09-17T01:46:07.170907] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T01:46:07.397441] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-17T01:46:07.530004] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T01:46:07.890167] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-17T01:46:08.690190] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-17T01:46:08.966815] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T01:46:09.490192] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-17T01:46:09.752501] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T01:46:10.290144] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-17T01:46:10.832942] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T01:46:11.090118] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-17T01:46:11.387633] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-17T01:46:11.836851] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T01:46:11.890098] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-17T01:46:12.690174] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-17T01:46:12.717905] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T01:46:13.490137] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-17T01:46:13.852102] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T01:46:14.290145] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-17T01:46:15.090158] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-17T01:46:15.310318] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T01:46:15.347318] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-17T01:46:15.890155] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-17T01:46:16.141920] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T01:46:16.690158] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-17T01:46:16.946080] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T01:46:17.490172] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-17T01:46:17.538869] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T01:46:18.290153] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-17T01:46:19.090215] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-17T01:46:19.457582] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-17T01:46:19.506267] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T01:46:19.546719] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T01:46:19.890155] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-17T01:46:20.690174] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-17T01:46:20.970991] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T01:46:21.490112] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-17T01:46:21.918365] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T01:46:21.955325] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T01:46:22.290128] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-17T01:46:23.090188] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-17T01:46:23.491468] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T01:46:23.890139] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-17T01:46:24.153749] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-17T01:46:24.690128] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-17T01:46:24.804222] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T01:46:24.987603] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T01:46:24.993503] [INFO ] [REMOTE ] ACM: Full fetch complete (62353 records). [2025-09-17T01:46:24.993676] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-17T01:46:25.375569] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-17T01:46:25.375698] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-17T01:46:25.376337] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-17T01:46:25.376422] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-17T01:46:25.377728] [DEBUG] [LOCAL ] ACM: Trimmed 62353 records to 43150 (keeping 200 days of data) [2025-09-17T01:46:25.490240] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-17T01:46:25.650671] [DEBUG] [LOCAL ] ACM: Primary data saved (43150 records). [2025-09-17T01:46:25.650820] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-17T01:46:25.650916] [INFO ] [MAIN ] Update Progress: 20/2369 symbols completed. ACM took 27.3s. Estimated remaining: 4h 31m 46s. Rate: 8.6 symbols/min [2025-09-17T01:46:25.822783] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:25.823012] [DEBUG] [LOCAL ] ACP: No existing data file found in primary storage. [2025-09-17T01:46:25.823065] [WARN ] [MAIN ] ACP: No existing data found, performing full refresh instead. [2025-09-17T01:46:25.823170] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-17T01:46:25.823225] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-17T01:46:25.823274] [DEBUG] [LOCAL ] ACP: No primary data file found to delete. [2025-09-17T01:46:25.823327] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-17T01:46:26.171812] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:26.290087] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-11. [2025-09-17T01:46:26.746335] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T01:46:27.090177] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-17T01:46:27.682934] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T01:46:27.890158] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-17T01:46:27.927923] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-17T01:46:27.937982] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-17T01:46:27.938187] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-17T01:46:28.331213] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-17T01:46:28.331353] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-17T01:46:28.332112] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-17T01:46:28.332178] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-17T01:46:28.333753] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-09-17T01:46:28.659176] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-09-17T01:46:28.659359] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-17T01:46:28.660540] [INFO ] [MAIN ] Update Progress: 21/2369 symbols completed. ACHR took 50.4s. Estimated remaining: 4h 24m 20s. Rate: 8.9 symbols/min [2025-09-17T01:46:28.692162] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-17T01:46:28.848287] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:28.884671] [DEBUG] [LOCAL ] ACR: Loaded 4172 existing records from primary storage. [2025-09-17T01:46:28.886190] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T01:46:28.886528] [INFO ] [MAIN ] ACR: Loaded 4172 existing records. [2025-09-17T01:46:29.099397] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:46:29.099812] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-17T01:46:29.099886] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-17T01:46:29.100246] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-17T01:46:29.100319] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-17T01:46:29.475865] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:29.490088] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-11. [2025-09-17T01:46:29.699815] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T01:46:30.084755] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T01:46:30.097391] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T01:46:30.290117] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-17T01:46:31.090148] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-17T01:46:31.890127] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-17T01:46:32.433752] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T01:46:32.624962] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T01:46:32.690136] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-17T01:46:33.490123] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-17T01:46:33.847750] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T01:46:33.924938] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T01:46:34.290142] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-17T01:46:35.090189] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-17T01:46:35.187715] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T01:46:35.667870] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T01:46:35.890142] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-17T01:46:36.498043] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T01:46:36.506776] [INFO ] [REMOTE ] ACI: Full fetch complete (76852 records). [2025-09-17T01:46:36.507048] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-17T01:46:36.695429] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-17T01:46:37.058278] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-17T01:46:37.058432] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-17T01:46:37.059327] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-17T01:46:37.059424] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-17T01:46:37.061811] [DEBUG] [LOCAL ] ACI: Trimmed 76852 records to 53268 (keeping 200 days of data) [2025-09-17T01:46:37.350376] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T01:46:37.363921] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T01:46:37.446062] [DEBUG] [LOCAL ] ACI: Primary data saved (53268 records). [2025-09-17T01:46:37.446221] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-17T01:46:37.446331] [INFO ] [MAIN ] Update Progress: 22/2369 symbols completed. ACI took 41.5s. Estimated remaining: 4h 27m 50s. Rate: 8.8 symbols/min [2025-09-17T01:46:37.498508] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-17T01:46:37.616214] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:37.639710] [DEBUG] [LOCAL ] ACRE: Loaded 24288 existing records from primary storage. [2025-09-17T01:46:37.639887] [INFO ] [MAIN ] ACRE: Loaded 24288 existing records. [2025-09-17T01:46:37.815081] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:46:37.815355] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-17T01:46:37.815452] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-17T01:46:37.816193] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-17T01:46:37.816266] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-17T01:46:38.165775] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:38.290110] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-17T01:46:38.903595] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T01:46:38.975572] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T01:46:39.090094] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-17T01:46:39.890131] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-17T01:46:40.385396] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T01:46:40.690145] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-17T01:46:41.342214] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T01:46:41.490134] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-17T01:46:41.589847] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T01:46:41.596893] [INFO ] [REMOTE ] ACN: Full fetch complete (76934 records). [2025-09-17T01:46:41.597090] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-17T01:46:41.987303] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-17T01:46:41.987432] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-17T01:46:41.988218] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-17T01:46:41.988295] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-17T01:46:41.989961] [DEBUG] [LOCAL ] ACN: Trimmed 76934 records to 53419 (keeping 200 days of data) [2025-09-17T01:46:42.292209] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-11. [2025-09-17T01:46:42.333578] [DEBUG] [LOCAL ] ACN: Primary data saved (53419 records). [2025-09-17T01:46:42.333746] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-17T01:46:42.333928] [INFO ] [MAIN ] Update Progress: 23/2369 symbols completed. ACN took 38.0s. Estimated remaining: 4h 24m 23s. Rate: 8.9 symbols/min [2025-09-17T01:46:42.508320] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:42.515868] [DEBUG] [LOCAL ] ACV: Loaded 4619 existing records from primary storage. [2025-09-17T01:46:42.516018] [INFO ] [MAIN ] ACV: Loaded 4619 existing records. [2025-09-17T01:46:42.693830] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:46:42.694154] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-17T01:46:42.694230] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-17T01:46:42.694566] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-17T01:46:42.694669] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-17T01:46:43.059995] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:43.078265] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T01:46:43.090074] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-17T01:46:43.722796] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T01:46:43.890115] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-11. [2025-09-17T01:46:44.179963] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T01:46:44.361680] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T01:46:44.690168] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-17T01:46:45.329974] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T01:46:45.490143] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-17T01:46:46.212663] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T01:46:46.290126] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-17T01:46:47.090094] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-17T01:46:47.452440] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T01:46:47.457328] [INFO ] [REMOTE ] ACP: Full fetch complete (48113 records). [2025-09-17T01:46:47.457500] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-17T01:46:47.852795] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-17T01:46:47.857995] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-17T01:46:47.859053] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-17T01:46:47.859277] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T01:46:47.859417] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-17T01:46:47.862666] [DEBUG] [LOCAL ] ACP: Trimmed 48113 records to 31437 (keeping 200 days of data) [2025-09-17T01:46:47.913243] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-17T01:46:48.046894] [DEBUG] [LOCAL ] ACP: Primary data saved (31437 records). [2025-09-17T01:46:48.047070] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-17T01:46:48.047161] [INFO ] [MAIN ] Update Progress: 24/2369 symbols completed. ACP took 22.4s. Estimated remaining: 4h 22m 34s. Rate: 8.9 symbols/min [2025-09-17T01:46:48.219446] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:48.254237] [DEBUG] [LOCAL ] ACVA: Loaded 36184 existing records from primary storage. [2025-09-17T01:46:48.254442] [INFO ] [MAIN ] ACVA: Loaded 36184 existing records. [2025-09-17T01:46:48.435007] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:46:48.440519] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-17T01:46:48.441023] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-17T01:46:48.441249] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T01:46:48.443216] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-17T01:46:48.443879] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-17T01:46:48.695269] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-17T01:46:48.798920] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:49.469420] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T01:46:49.490153] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-17T01:46:49.871334] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T01:46:50.290130] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-17T01:46:50.904225] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T01:46:51.090176] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-17T01:46:51.704480] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T01:46:51.890234] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-17T01:46:52.473509] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T01:46:52.690137] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-17T01:46:53.490123] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-11. [2025-09-17T01:46:54.166740] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T01:46:54.290154] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-17T01:46:55.023535] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T01:46:55.090089] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-17T01:46:55.149147] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T01:46:55.883748] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T01:46:55.890075] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-17T01:46:56.690151] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-17T01:46:57.242835] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T01:46:57.495192] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-17T01:46:57.506706] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T01:46:58.290155] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-17T01:46:58.980064] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T01:46:58.981070] [INFO ] [REMOTE ] ACR: Full fetch complete (8545 records). [2025-09-17T01:46:58.981157] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-17T01:46:59.094427] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-17T01:46:59.276292] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T01:46:59.380850] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-17T01:46:59.380944] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-17T01:46:59.381130] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-17T01:46:59.381179] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-17T01:46:59.381662] [DEBUG] [LOCAL ] ACR: Trimmed 8545 records to 6495 (keeping 200 days of data) [2025-09-17T01:46:59.419310] [DEBUG] [LOCAL ] ACR: Primary data saved (6495 records). [2025-09-17T01:46:59.419412] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-17T01:46:59.419525] [INFO ] [MAIN ] Update Progress: 25/2369 symbols completed. ACR took 30.8s. Estimated remaining: 4h 29m 43s. Rate: 8.7 symbols/min [2025-09-17T01:46:59.588766] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:46:59.588967] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-17T01:46:59.589022] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-17T01:46:59.589123] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-17T01:46:59.589174] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-17T01:46:59.589221] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-17T01:46:59.589473] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-17T01:46:59.904609] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-17T01:46:59.941843] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:46:59.949610] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T01:47:00.690186] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-11. [2025-09-17T01:47:00.928285] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:00.928525] [WARN ] [REMOTE ] AD: No data returned for month 2024-11 [2025-09-17T01:47:01.356003] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T01:47:01.490148] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-17T01:47:01.708985] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:01.709394] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-17T01:47:02.290172] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-17T01:47:03.090136] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-17T01:47:03.724589] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T01:47:03.890138] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-17T01:47:04.222197] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T01:47:04.690143] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-17T01:47:05.342716] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T01:47:05.376344] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T01:47:05.490090] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-17T01:47:06.290136] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-17T01:47:06.576771] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T01:47:06.930112] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T01:47:07.090136] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-17T01:47:07.725903] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T01:47:07.727637] [INFO ] [REMOTE ] ACV: Full fetch complete (9540 records). [2025-09-17T01:47:07.727764] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-17T01:47:07.901217] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-17T01:47:08.091583] [DEBUG] [VALIDATOR ] ACV: All expected trading days are present. [2025-09-17T01:47:08.091696] [DEBUG] [VALIDATOR ] ACV: Primary data validation passed. [2025-09-17T01:47:08.091898] [INFO ] [MAIN ] ACV: Fetched primary data is valid. [2025-09-17T01:47:08.091995] [DEBUG] [LOCAL ] ACV: Saving primary data. [2025-09-17T01:47:08.092434] [DEBUG] [LOCAL ] ACV: Trimmed 9540 records to 6862 (keeping 200 days of data) [2025-09-17T01:47:08.134578] [DEBUG] [LOCAL ] ACV: Primary data saved (6862 records). [2025-09-17T01:47:08.134721] [INFO ] [MAIN ] ACV: Full history saved. [2025-09-17T01:47:08.134815] [INFO ] [MAIN ] Update Progress: 26/2369 symbols completed. ACV took 25.8s. Estimated remaining: 4h 32m 20s. Rate: 8.6 symbols/min [2025-09-17T01:47:08.303542] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:47:08.337222] [DEBUG] [LOCAL ] ADC: Loaded 34611 existing records from primary storage. [2025-09-17T01:47:08.337381] [INFO ] [MAIN ] ADC: Loaded 34611 existing records. [2025-09-17T01:47:08.517843] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:47:08.518105] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-17T01:47:08.518165] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-17T01:47:08.519013] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-17T01:47:08.519074] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-17T01:47:08.695313] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-17T01:47:08.881672] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:47:09.020206] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:09.020598] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-17T01:47:09.490379] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-17T01:47:09.490263] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T01:47:10.290191] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-17T01:47:10.399368] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T01:47:10.399888] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-17T01:47:10.873206] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T01:47:11.090216] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-17T01:47:11.890191] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-17T01:47:12.105632] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:12.105959] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-17T01:47:12.505028] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T01:47:12.690156] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-17T01:47:12.896171] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:12.896483] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-17T01:47:13.490117] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-17T01:47:13.701626] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:13.701892] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-17T01:47:14.290209] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-11. [2025-09-17T01:47:15.090184] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-17T01:47:15.869920] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T01:47:15.890069] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-17T01:47:16.442618] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T01:47:16.690187] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-17T01:47:17.453921] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T01:47:17.490113] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-17T01:47:18.290138] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-17T01:47:18.356949] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T01:47:19.097781] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-17T01:47:19.113626] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T01:47:19.634173] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T01:47:19.890141] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-17T01:47:20.690167] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-17T01:47:20.774404] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T01:47:20.909299] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:20.909888] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-17T01:47:21.387117] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T01:47:21.490181] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-17T01:47:21.701726] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:47:21.702061] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-17T01:47:22.290208] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-17T01:47:23.090141] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-17T01:47:23.890115] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-17T01:47:23.982205] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T01:47:24.175802] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T01:47:24.690182] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-17T01:47:25.024891] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T01:47:25.028752] [INFO ] [REMOTE ] ACRE: Full fetch complete (50403 records). [2025-09-17T01:47:25.028874] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-17T01:47:25.454224] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-17T01:47:25.454411] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-17T01:47:25.454943] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-17T01:47:25.455003] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-17T01:47:25.456075] [DEBUG] [LOCAL ] ACRE: Trimmed 50403 records to 33740 (keeping 200 days of data) [2025-09-17T01:47:25.505694] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-17T01:47:25.664478] [DEBUG] [LOCAL ] ACRE: Primary data saved (33740 records). [2025-09-17T01:47:25.664677] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-17T01:47:25.664780] [INFO ] [MAIN ] Update Progress: 27/2369 symbols completed. ACRE took 48.2s. Estimated remaining: 4h 47m 28s. Rate: 8.1 symbols/min [2025-09-17T01:47:25.837704] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:47:25.864364] [DEBUG] [LOCAL ] ADCT: Loaded 25885 existing records from primary storage. [2025-09-17T01:47:25.864553] [INFO ] [MAIN ] ADCT: Loaded 25885 existing records. [2025-09-17T01:47:26.049119] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:47:26.049476] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-17T01:47:26.049530] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-17T01:47:26.050212] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-17T01:47:26.050276] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-17T01:47:26.292571] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-17T01:47:26.405819] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:47:26.434441] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T01:47:26.700342] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T01:47:26.703238] [INFO ] [REMOTE ] AD: Full fetch complete (4957 records). [2025-09-17T01:47:26.703325] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-17T01:47:26.882665] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 25 unique days, need 200 days [2025-09-17T01:47:26.882880] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:47:26.882930] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:47:26.882979] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-17T01:47:26.883043] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-17T01:47:26.883093] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-17T01:47:26.883161] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-17T01:47:26.883230] [INFO ] [MAIN ] Update Progress: 28/2369 symbols completed. AD took 27.5s. Estimated remaining: 4h 38m 47s. Rate: 8.4 symbols/min [2025-09-17T01:47:27.057072] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:47:27.097351] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-17T01:47:27.103172] [DEBUG] [LOCAL ] ADM: Loaded 39782 existing records from primary storage. [2025-09-17T01:47:27.103575] [INFO ] [MAIN ] ADM: Loaded 39782 existing records. [2025-09-17T01:47:27.281369] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:47:27.281621] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-17T01:47:27.281699] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-17T01:47:27.282576] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-17T01:47:27.282636] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-17T01:47:27.640598] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:47:27.890140] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-11. [2025-09-17T01:47:28.111431] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T01:47:28.336677] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T01:47:28.690191] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-17T01:47:29.490223] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-17T01:47:29.692538] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T01:47:30.297864] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-17T01:47:30.335918] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T01:47:31.090135] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-17T01:47:31.234030] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T01:47:31.890198] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-17T01:47:31.999420] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T01:47:32.674190] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T01:47:32.680388] [INFO ] [REMOTE ] ACVA: Full fetch complete (69910 records). [2025-09-17T01:47:32.680536] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-17T01:47:32.695233] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-17T01:47:33.079097] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-17T01:47:33.079231] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-17T01:47:33.079971] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-17T01:47:33.080033] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-17T01:47:33.081827] [DEBUG] [LOCAL ] ACVA: Trimmed 69910 records to 49402 (keeping 200 days of data) [2025-09-17T01:47:33.368412] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T01:47:33.409058] [DEBUG] [LOCAL ] ACVA: Primary data saved (49402 records). [2025-09-17T01:47:33.409219] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-17T01:47:33.409314] [INFO ] [MAIN ] Update Progress: 29/2369 symbols completed. ACVA took 45.4s. Estimated remaining: 4h 37m 50s. Rate: 8.4 symbols/min [2025-09-17T01:47:33.495350] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-11. [2025-09-17T01:47:33.585609] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:47:33.619883] [DEBUG] [LOCAL ] ADNT: Loaded 35081 existing records from primary storage. [2025-09-17T01:47:33.620094] [INFO ] [MAIN ] ADNT: Loaded 35081 existing records. [2025-09-17T01:47:33.803293] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:47:33.803565] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-17T01:47:33.803625] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-17T01:47:33.804500] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-17T01:47:33.804569] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-17T01:47:34.162240] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:47:34.290080] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-11. [2025-09-17T01:47:34.600363] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T01:47:34.975024] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T01:47:35.090136] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-17T01:47:35.812245] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T01:47:35.890078] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-17T01:47:36.690201] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-17T01:47:36.808572] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T01:47:37.243506] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T01:47:37.490140] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-17T01:47:38.290120] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-17T01:47:38.571844] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T01:47:39.075665] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T01:47:39.090068] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-17T01:47:39.731874] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T01:47:39.890083] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-17T01:47:40.695215] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-17T01:47:40.710934] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T01:47:40.803813] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T01:47:41.490140] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-17T01:47:42.290162] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-17T01:47:42.331698] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T01:47:42.800938] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T01:47:43.090129] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-17T01:47:43.559613] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T01:47:43.567679] [INFO ] [REMOTE ] ADC: Full fetch complete (65868 records). [2025-09-17T01:47:43.567879] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-17T01:47:43.895199] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-17T01:47:43.967344] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-17T01:47:43.967476] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-17T01:47:43.968240] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-17T01:47:43.968322] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-17T01:47:43.969618] [DEBUG] [LOCAL ] ADC: Trimmed 65868 records to 46698 (keeping 200 days of data) [2025-09-17T01:47:44.257633] [DEBUG] [LOCAL ] ADC: Primary data saved (46698 records). [2025-09-17T01:47:44.257793] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-17T01:47:44.257878] [INFO ] [MAIN ] Update Progress: 30/2369 symbols completed. ADC took 36.1s. Estimated remaining: 4h 42m 33s. Rate: 8.3 symbols/min [2025-09-17T01:47:44.427971] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:47:44.463406] [DEBUG] [LOCAL ] ADT: Loaded 39870 existing records from primary storage. [2025-09-17T01:47:44.463571] [INFO ] [MAIN ] ADT: Loaded 39870 existing records. [2025-09-17T01:47:44.653200] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:47:44.653566] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-17T01:47:44.653663] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-17T01:47:44.654669] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-17T01:47:44.662391] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-17T01:47:44.706003] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-17T01:47:44.720275] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T01:47:45.043951] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:47:45.290827] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T01:47:45.490148] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-11. [2025-09-17T01:47:46.290154] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-17T01:47:46.630679] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T01:47:47.090151] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-17T01:47:47.146787] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T01:47:47.604041] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T01:47:47.890136] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-17T01:47:48.443926] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T01:47:48.690212] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-17T01:47:49.490149] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-17T01:47:49.667130] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T01:47:50.290179] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-17T01:47:50.581355] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T01:47:51.090232] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-17T01:47:51.173432] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T01:47:51.900229] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-17T01:47:51.902712] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T01:47:52.690166] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-17T01:47:53.069511] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T01:47:53.490139] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-17T01:47:53.657557] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T01:47:54.290110] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-17T01:47:54.337140] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T01:47:55.090155] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-17T01:47:55.307752] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T01:47:55.852673] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T01:47:55.890093] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-17T01:47:56.535800] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T01:47:56.690173] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-17T01:47:57.393169] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T01:47:57.490159] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-17T01:47:58.290132] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-17T01:47:58.677487] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T01:47:59.009571] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T01:47:59.090134] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-17T01:47:59.694620] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T01:47:59.890142] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-17T01:48:00.697790] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-17T01:48:00.703129] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T01:48:01.490182] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-17T01:48:02.290176] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-17T01:48:02.515497] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-17T01:48:03.090161] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-17T01:48:03.437350] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-17T01:48:03.441826] [INFO ] [REMOTE ] ADCT: Full fetch complete (51351 records). [2025-09-17T01:48:03.441948] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-17T01:48:03.821662] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (3.12 seconds). [2025-09-17T01:48:03.874550] [DEBUG] [VALIDATOR ] ADCT: All expected trading days are present. [2025-09-17T01:48:03.874680] [DEBUG] [VALIDATOR ] ADCT: Primary data validation passed. [2025-09-17T01:48:03.875223] [INFO ] [MAIN ] ADCT: Fetched primary data is valid. [2025-09-17T01:48:03.875280] [DEBUG] [LOCAL ] ADCT: Saving primary data. [2025-09-17T01:48:03.876822] [DEBUG] [LOCAL ] ADCT: Trimmed 51351 records to 33554 (keeping 200 days of data) [2025-09-17T01:48:03.922479] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-17T01:48:04.065023] [DEBUG] [LOCAL ] ADCT: Primary data saved (33554 records). [2025-09-17T01:48:04.065194] [INFO ] [MAIN ] ADCT: Full history saved. [2025-09-17T01:48:04.065284] [INFO ] [MAIN ] Update Progress: 31/2369 symbols completed. ADCT took 38.4s. Estimated remaining: 4h 58m 13s. Rate: 7.8 symbols/min [2025-09-17T01:48:04.238047] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:04.259465] [DEBUG] [LOCAL ] ADX: Loaded 20576 existing records from primary storage. [2025-09-17T01:48:04.259690] [INFO ] [MAIN ] ADX: Loaded 20576 existing records. [2025-09-17T01:48:04.446377] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:48:04.446755] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-17T01:48:04.446815] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-17T01:48:04.447311] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-17T01:48:04.447371] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-17T01:48:04.801061] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:04.801418] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-11. [2025-09-17T01:48:05.005742] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-17T01:48:05.163266] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-17T01:48:05.169980] [INFO ] [REMOTE ] ADM: Full fetch complete (77055 records). [2025-09-17T01:48:05.170150] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-17T01:48:05.504044] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-17T01:48:05.563206] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-17T01:48:05.563318] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-17T01:48:05.564094] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-17T01:48:05.564157] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-17T01:48:05.565820] [DEBUG] [LOCAL ] ADM: Trimmed 77055 records to 53399 (keeping 200 days of data) [2025-09-17T01:48:05.926634] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T01:48:05.962887] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T01:48:05.982350] [DEBUG] [LOCAL ] ADM: Primary data saved (53399 records). [2025-09-17T01:48:05.982549] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-17T01:48:05.982688] [INFO ] [MAIN ] Update Progress: 32/2369 symbols completed. ADM took 39.1s. Estimated remaining: 4h 51m 7s. Rate: 8.0 symbols/min [2025-09-17T01:48:06.154723] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:06.154915] [DEBUG] [LOCAL ] AEE: No existing data file found in primary storage. [2025-09-17T01:48:06.154993] [WARN ] [MAIN ] AEE: No existing data found, performing full refresh instead. [2025-09-17T01:48:06.155109] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-17T01:48:06.155154] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-17T01:48:06.155208] [DEBUG] [LOCAL ] AEE: No primary data file found to delete. [2025-09-17T01:48:06.155252] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-17T01:48:06.295268] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-17T01:48:06.507136] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:07.091781] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-11. [2025-09-17T01:48:07.096861] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T01:48:07.103864] [INFO ] [REMOTE ] ADNT: Full fetch complete (68022 records). [2025-09-17T01:48:07.104171] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-17T01:48:07.503290] [DEBUG] [VALIDATOR ] ADNT: All expected trading days are present. [2025-09-17T01:48:07.503418] [DEBUG] [VALIDATOR ] ADNT: Primary data validation passed. [2025-09-17T01:48:07.504085] [INFO ] [MAIN ] ADNT: Fetched primary data is valid. [2025-09-17T01:48:07.504147] [DEBUG] [LOCAL ] ADNT: Saving primary data. [2025-09-17T01:48:07.505667] [DEBUG] [LOCAL ] ADNT: Trimmed 68022 records to 47668 (keeping 200 days of data) [2025-09-17T01:48:07.733474] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T01:48:07.808733] [DEBUG] [LOCAL ] ADNT: Primary data saved (47668 records). [2025-09-17T01:48:07.808923] [INFO ] [MAIN ] ADNT: Full history saved. [2025-09-17T01:48:07.809064] [INFO ] [MAIN ] Update Progress: 33/2369 symbols completed. ADNT took 34.4s. Estimated remaining: 4h 44m 20s. Rate: 8.2 symbols/min [2025-09-17T01:48:07.895310] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-17T01:48:07.986032] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:07.993485] [DEBUG] [LOCAL ] AEFC: Loaded 5914 existing records from primary storage. [2025-09-17T01:48:07.993605] [INFO ] [MAIN ] AEFC: Loaded 5914 existing records. [2025-09-17T01:48:08.173071] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:48:08.173327] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-17T01:48:08.173388] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-17T01:48:08.173753] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-17T01:48:08.173814] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-17T01:48:08.553100] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:08.583444] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T01:48:08.690082] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-17T01:48:09.490140] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-11. [2025-09-17T01:48:09.732694] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T01:48:10.210802] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T01:48:10.290076] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-17T01:48:10.396286] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T01:48:11.090196] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-17T01:48:11.090525] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T01:48:11.890159] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-17T01:48:12.498333] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T01:48:12.690195] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-17T01:48:13.490176] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-17T01:48:13.723231] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T01:48:13.751371] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T01:48:14.290174] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-17T01:48:15.090151] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-17T01:48:15.878032] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-17T01:48:15.890069] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-17T01:48:16.473014] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T01:48:16.690161] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-17T01:48:17.082023] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T01:48:17.490118] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-17T01:48:17.789962] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T01:48:17.964158] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T01:48:18.290134] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-17T01:48:18.781248] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T01:48:19.090185] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-17T01:48:19.309892] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T01:48:19.543248] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T01:48:19.890108] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-17T01:48:20.690165] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-17T01:48:21.495679] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-17T01:48:21.500851] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T01:48:21.507700] [INFO ] [REMOTE ] ADT: Full fetch complete (77041 records). [2025-09-17T01:48:21.507838] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-17T01:48:21.934627] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-17T01:48:21.934800] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-17T01:48:21.935723] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-17T01:48:21.935824] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-17T01:48:21.937828] [DEBUG] [LOCAL ] ADT: Trimmed 77041 records to 53455 (keeping 200 days of data) [2025-09-17T01:48:22.292067] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-17T01:48:22.441444] [DEBUG] [LOCAL ] ADT: Primary data saved (53455 records). [2025-09-17T01:48:22.441746] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-17T01:48:22.441940] [INFO ] [MAIN ] Update Progress: 34/2369 symbols completed. ADT took 38.2s. Estimated remaining: 4h 52m 36s. Rate: 8.0 symbols/min [2025-09-17T01:48:22.725858] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:22.790836] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T01:48:22.800422] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-17T01:48:22.841835] [DEBUG] [LOCAL ] AEG: Loaded 37046 existing records from primary storage. [2025-09-17T01:48:22.842721] [INFO ] [MAIN ] AEG: Loaded 37046 existing records. [2025-09-17T01:48:23.021027] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T01:48:23.045244] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:48:23.048212] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-17T01:48:23.048579] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-17T01:48:23.049446] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-17T01:48:23.049533] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-17T01:48:23.095229] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-17T01:48:23.406548] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:23.890143] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-17T01:48:24.172736] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T01:48:24.447553] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T01:48:24.690180] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-17T01:48:25.489053] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T01:48:25.491601] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-11. [2025-09-17T01:48:26.290185] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-17T01:48:26.695088] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T01:48:27.064506] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T01:48:27.090080] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-17T01:48:27.890136] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-17T01:48:28.666992] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T01:48:28.690084] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-17T01:48:28.728157] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T01:48:29.490205] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-17T01:48:30.035989] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T01:48:30.037285] [INFO ] [REMOTE ] AEFC: Full fetch complete (12510 records). [2025-09-17T01:48:30.037385] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-17T01:48:30.310763] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-17T01:48:30.408301] [DEBUG] [VALIDATOR ] AEFC: All expected trading days are present. [2025-09-17T01:48:30.408455] [DEBUG] [VALIDATOR ] AEFC: Primary data validation passed. [2025-09-17T01:48:30.408992] [INFO ] [MAIN ] AEFC: Fetched primary data is valid. [2025-09-17T01:48:30.409148] [DEBUG] [LOCAL ] AEFC: Saving primary data. [2025-09-17T01:48:30.410061] [DEBUG] [LOCAL ] AEFC: Trimmed 12510 records to 8704 (keeping 200 days of data) [2025-09-17T01:48:30.483401] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T01:48:30.507172] [DEBUG] [LOCAL ] AEFC: Primary data saved (8704 records). [2025-09-17T01:48:30.507398] [INFO ] [MAIN ] AEFC: Full history saved. [2025-09-17T01:48:30.507570] [INFO ] [MAIN ] Update Progress: 35/2369 symbols completed. AEFC took 22.7s. Estimated remaining: 4h 53m 5s. Rate: 8.0 symbols/min [2025-09-17T01:48:30.676625] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:30.676896] [DEBUG] [LOCAL ] AEM: No existing data file found in primary storage. [2025-09-17T01:48:30.676960] [WARN ] [MAIN ] AEM: No existing data found, performing full refresh instead. [2025-09-17T01:48:30.677098] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-17T01:48:30.677211] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-17T01:48:30.677296] [DEBUG] [LOCAL ] AEM: No primary data file found to delete. [2025-09-17T01:48:30.677367] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-17T01:48:31.045341] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:31.090139] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-11. [2025-09-17T01:48:31.721098] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T01:48:31.890188] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-17T01:48:32.690172] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-17T01:48:32.937760] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T01:48:33.490189] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-17T01:48:33.640428] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T01:48:33.802031] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T01:48:34.290175] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-17T01:48:34.915476] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T01:48:35.090104] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-17T01:48:35.890111] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-17T01:48:36.040821] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T01:48:36.690101] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-17T01:48:36.980655] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T01:48:37.150722] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T01:48:37.490144] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-17T01:48:38.179148] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T01:48:38.290141] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-17T01:48:38.572161] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T01:48:38.576147] [INFO ] [REMOTE ] ADX: Full fetch complete (42148 records). [2025-09-17T01:48:38.576297] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-17T01:48:38.957970] [DEBUG] [VALIDATOR ] ADX: All expected trading days are present. [2025-09-17T01:48:38.958091] [DEBUG] [VALIDATOR ] ADX: Primary data validation passed. [2025-09-17T01:48:38.958559] [INFO ] [MAIN ] ADX: Fetched primary data is valid. [2025-09-17T01:48:38.958633] [DEBUG] [LOCAL ] ADX: Saving primary data. [2025-09-17T01:48:38.959608] [DEBUG] [LOCAL ] ADX: Trimmed 42148 records to 28110 (keeping 200 days of data) [2025-09-17T01:48:39.090740] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-17T01:48:39.142400] [DEBUG] [LOCAL ] ADX: Primary data saved (28110 records). [2025-09-17T01:48:39.142545] [INFO ] [MAIN ] ADX: Full history saved. [2025-09-17T01:48:39.142728] [INFO ] [MAIN ] Update Progress: 36/2369 symbols completed. ADX took 35.1s. Estimated remaining: 4h 54m 8s. Rate: 7.9 symbols/min [2025-09-17T01:48:39.315727] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:48:39.357956] [DEBUG] [LOCAL ] AEO: Loaded 39921 existing records from primary storage. [2025-09-17T01:48:39.358124] [INFO ] [MAIN ] AEO: Loaded 39921 existing records. [2025-09-17T01:48:39.538663] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:48:39.538895] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-17T01:48:39.538955] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-17T01:48:39.540058] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-17T01:48:39.540124] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-17T01:48:39.894546] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:48:39.890848] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-17T01:48:40.027175] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T01:48:40.690112] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-17T01:48:40.982187] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T01:48:41.490142] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-11. [2025-09-17T01:48:41.598578] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T01:48:42.290176] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-17T01:48:42.405350] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T01:48:43.090134] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-17T01:48:43.282176] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T01:48:43.890120] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-17T01:48:43.943960] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T01:48:44.690088] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-17T01:48:44.820105] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T01:48:45.490140] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-17T01:48:45.550364] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T01:48:46.126049] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T01:48:46.290080] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-17T01:48:47.090101] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-17T01:48:47.199021] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T01:48:47.890120] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-17T01:48:48.068601] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T01:48:48.518381] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T01:48:48.690161] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-17T01:48:49.087509] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T01:48:49.093707] [INFO ] [REMOTE ] AEE: Full fetch complete (72348 records). [2025-09-17T01:48:49.093876] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-17T01:48:49.490883] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-17T01:48:49.537079] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-17T01:48:49.537211] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-17T01:48:49.538095] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-17T01:48:49.538292] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-17T01:48:49.540362] [DEBUG] [LOCAL ] AEE: Trimmed 72348 records to 50355 (keeping 200 days of data) [2025-09-17T01:48:49.862467] [DEBUG] [LOCAL ] AEE: Primary data saved (50355 records). [2025-09-17T01:48:49.862620] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-17T01:48:49.862728] [INFO ] [MAIN ] Update Progress: 37/2369 symbols completed. AEE took 43.9s. Estimated remaining: 4h 57m 20s. Rate: 7.8 symbols/min [2025-09-17T01:48:50.290167] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-17T01:48:50.357241] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T01:48:51.090116] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-17T01:48:51.321410] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T01:48:51.890135] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-17T01:48:52.236623] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T01:48:52.242755] [INFO ] [REMOTE ] AEG: Full fetch complete (69928 records). [2025-09-17T01:48:52.242938] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-17T01:48:52.648787] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-17T01:48:52.648958] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-17T01:48:52.649760] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-17T01:48:52.649842] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-17T01:48:52.651576] [DEBUG] [LOCAL ] AEG: Trimmed 69928 records to 49588 (keeping 200 days of data) [2025-09-17T01:48:52.776218] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-17T01:48:52.789854] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-17T01:48:52.992515] [DEBUG] [LOCAL ] AEG: Primary data saved (49588 records). [2025-09-17T01:48:52.992726] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-17T01:48:52.992877] [INFO ] [MAIN ] Update Progress: 38/2369 symbols completed. AEG took 30.6s. Estimated remaining: 4h 52m 35s. Rate: 8.0 symbols/min [2025-09-17T01:48:53.757471] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T01:48:53.768663] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-17T01:48:54.845668] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T01:48:54.857054] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-17T01:48:55.657441] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T01:48:55.669060] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-17T01:48:56.816979] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T01:48:56.828128] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-17T01:48:57.300434] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T01:48:57.312038] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-17T01:48:58.837892] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T01:48:58.850571] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-17T01:48:59.177895] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T01:48:59.188756] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-17T01:49:00.707129] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T01:49:00.718830] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-17T01:49:01.526487] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-17T01:49:01.538615] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-17T01:49:02.577931] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T01:49:02.584452] [INFO ] [REMOTE ] AEM: Full fetch complete (76944 records). [2025-09-17T01:49:02.584600] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-17T01:49:02.975158] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-17T01:49:02.975262] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-17T01:49:02.976010] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-17T01:49:02.976077] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-17T01:49:02.977684] [DEBUG] [LOCAL ] AEM: Trimmed 76944 records to 53464 (keeping 200 days of data) [2025-09-17T01:49:03.323845] [DEBUG] [LOCAL ] AEM: Primary data saved (53464 records). [2025-09-17T01:49:03.324042] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-17T01:49:03.324156] [INFO ] [MAIN ] Update Progress: 39/2369 symbols completed. AEM took 32.8s. Estimated remaining: 4h 55m 15s. Rate: 7.9 symbols/min [2025-09-17T01:49:03.795787] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-17T01:49:03.807416] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-17T01:49:05.420838] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T01:49:05.427221] [INFO ] [REMOTE ] AEO: Full fetch complete (77287 records). [2025-09-17T01:49:05.427356] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-17T01:49:05.825765] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-17T01:49:05.825868] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-17T01:49:05.826633] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-17T01:49:05.826719] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-17T01:49:05.828283] [DEBUG] [LOCAL ] AEO: Trimmed 77287 records to 53556 (keeping 200 days of data) [2025-09-17T01:49:06.156093] [DEBUG] [LOCAL ] AEO: Primary data saved (53556 records). [2025-09-17T01:49:06.156270] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-17T01:49:06.156384] [INFO ] [MAIN ] Update Progress: 40/2369 symbols completed. AEO took 27.0s. Estimated remaining: 4h 50m 29s. Rate: 8.0 symbols/min [2025-09-17T01:49:06.703986] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:06.792926] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:06.813708] [DEBUG] [LOCAL ] AESI: No existing data file found in primary storage. [2025-09-17T01:49:06.795052] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:06.822483] [WARN ] [MAIN ] AESI: No existing data found, performing full refresh instead. [2025-09-17T01:49:06.844751] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-17T01:49:06.848170] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-17T01:49:06.848024] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:06.848439] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-09-17T01:49:06.848691] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-17T01:49:06.927078] [DEBUG] [LOCAL ] AFB: Loaded 7923 existing records from primary storage. [2025-09-17T01:49:06.954990] [INFO ] [MAIN ] AFB: Loaded 7923 existing records. [2025-09-17T01:49:07.235609] [DEBUG] [LOCAL ] AES: Loaded 40025 existing records from primary storage. [2025-09-17T01:49:07.254496] [DEBUG] [LOCAL ] AER: Loaded 35913 existing records from primary storage. [2025-09-17T01:49:07.285917] [INFO ] [MAIN ] AES: Loaded 40025 existing records. [2025-09-17T01:49:07.280688] [INFO ] [MAIN ] AER: Loaded 35913 existing records. [2025-09-17T01:49:07.471286] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:07.555989] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-17T01:49:07.637832] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-17T01:49:07.616274] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:07.665474] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-11. [2025-09-17T01:49:07.662142] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-17T01:49:07.665724] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-17T01:49:07.857857] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:07.928483] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-17T01:49:07.934183] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-17T01:49:07.928600] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:07.949814] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-17T01:49:07.974202] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-17T01:49:07.979632] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-17T01:49:08.020634] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-17T01:49:08.029850] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-17T01:49:08.064443] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-17T01:49:08.432686] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:08.469616] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-11. [2025-09-17T01:49:08.929211] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:08.932868] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:08.933232] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-11. [2025-09-17T01:49:08.933775] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-11. [2025-09-17T01:49:09.328949] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T01:49:09.337557] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-17T01:49:09.426044] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T01:49:09.428264] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-17T01:49:10.039105] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T01:49:10.041955] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-17T01:49:10.581563] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T01:49:10.591358] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-17T01:49:10.659866] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T01:49:10.669354] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-17T01:49:10.701548] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T01:49:10.712142] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-17T01:49:10.859370] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T01:49:10.862527] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-17T01:49:11.576558] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T01:49:11.579746] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-17T01:49:12.163375] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T01:49:12.172356] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-17T01:49:12.253332] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T01:49:12.262585] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-17T01:49:12.431305] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T01:49:12.551699] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T01:49:12.690175] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-17T01:49:13.246419] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T01:49:13.490190] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-17T01:49:13.796191] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T01:49:13.833110] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T01:49:14.128212] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T01:49:14.290347] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-17T01:49:15.090192] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-17T01:49:15.890153] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-17T01:49:15.952681] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T01:49:16.397018] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T01:49:16.690197] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-17T01:49:17.100490] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T01:49:17.490255] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-17T01:49:18.290160] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-17T01:49:18.408111] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T01:49:18.907368] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T01:49:19.090144] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-17T01:49:19.890187] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-17T01:49:20.250435] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-17T01:49:20.690176] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-17T01:49:20.778411] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T01:49:20.813451] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T01:49:21.490214] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-17T01:49:22.290190] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-17T01:49:22.450845] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T01:49:22.896270] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T01:49:23.090142] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-17T01:49:23.242954] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T01:49:23.597492] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T01:49:23.599269] [INFO ] [REMOTE ] AFB: Full fetch complete (16360 records). [2025-09-17T01:49:23.599363] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-17T01:49:23.890125] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-17T01:49:23.974078] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-17T01:49:23.974199] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-17T01:49:23.974604] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-17T01:49:23.974689] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-17T01:49:23.975375] [DEBUG] [LOCAL ] AFB: Trimmed 16360 records to 11419 (keeping 200 days of data) [2025-09-17T01:49:24.044362] [DEBUG] [LOCAL ] AFB: Primary data saved (11419 records). [2025-09-17T01:49:24.044532] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-17T01:49:24.044628] [INFO ] [MAIN ] Update Progress: 41/2369 symbols completed. AFB took 17.9s. Estimated remaining: 5h 0m 12s. Rate: 7.8 symbols/min [2025-09-17T01:49:24.228614] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:24.253128] [DEBUG] [LOCAL ] AFG: Loaded 23723 existing records from primary storage. [2025-09-17T01:49:24.253294] [INFO ] [MAIN ] AFG: Loaded 23723 existing records. [2025-09-17T01:49:24.445062] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:24.445339] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-17T01:49:24.445405] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-17T01:49:24.446130] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-17T01:49:24.446191] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-17T01:49:24.698842] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-17T01:49:24.803584] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:25.490122] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-11. [2025-09-17T01:49:25.696658] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T01:49:26.290148] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-17T01:49:26.407330] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T01:49:26.857443] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T01:49:27.090133] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-17T01:49:27.890103] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-17T01:49:28.372911] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T01:49:28.480479] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T01:49:28.690134] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-17T01:49:29.295001] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T01:49:29.490117] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-17T01:49:30.290080] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-17T01:49:30.854015] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T01:49:31.049681] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T01:49:31.090097] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-17T01:49:31.890141] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-17T01:49:32.018865] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T01:49:32.640937] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T01:49:32.690123] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-17T01:49:33.490142] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-17T01:49:34.303402] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-17T01:49:34.308961] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-17T01:49:34.356171] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T01:49:35.005320] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T01:49:35.011445] [INFO ] [REMOTE ] AESI: Full fetch complete (70038 records). [2025-09-17T01:49:35.011597] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-17T01:49:35.095302] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-17T01:49:35.410933] [DEBUG] [VALIDATOR ] AESI: All expected trading days are present. [2025-09-17T01:49:35.411053] [DEBUG] [VALIDATOR ] AESI: Primary data validation passed. [2025-09-17T01:49:35.411863] [INFO ] [MAIN ] AESI: Fetched primary data is valid. [2025-09-17T01:49:35.412005] [DEBUG] [LOCAL ] AESI: Saving primary data. [2025-09-17T01:49:35.413521] [DEBUG] [LOCAL ] AESI: Trimmed 70038 records to 49577 (keeping 200 days of data) [2025-09-17T01:49:35.429188] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T01:49:35.739766] [DEBUG] [LOCAL ] AESI: Primary data saved (49577 records). [2025-09-17T01:49:35.740043] [INFO ] [MAIN ] AESI: Full history saved. [2025-09-17T01:49:35.740180] [INFO ] [MAIN ] Update Progress: 42/2369 symbols completed. AESI took 29.6s. Estimated remaining: 5h 3m 44s. Rate: 7.7 symbols/min [2025-09-17T01:49:35.891717] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-17T01:49:35.911825] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:35.912755] [DEBUG] [LOCAL ] AFGB: No existing data file found in primary storage. [2025-09-17T01:49:35.912816] [WARN ] [MAIN ] AFGB: No existing data found, performing full refresh instead. [2025-09-17T01:49:35.912983] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-17T01:49:35.913059] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-17T01:49:35.913154] [DEBUG] [LOCAL ] AFGB: No primary data file found to delete. [2025-09-17T01:49:35.913229] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-17T01:49:36.280339] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:36.690156] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-11. [2025-09-17T01:49:36.967981] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-11 (0.28 seconds). [2025-09-17T01:49:37.290893] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-17T01:49:37.319586] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T01:49:37.490136] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-17T01:49:38.290137] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-17T01:49:39.090172] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-17T01:49:39.459943] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T01:49:39.576820] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T01:49:39.890148] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-17T01:49:40.518780] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T01:49:40.525016] [INFO ] [REMOTE ] AER: Full fetch complete (69330 records). [2025-09-17T01:49:40.525191] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-17T01:49:40.701849] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-17T01:49:40.934258] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-17T01:49:40.934402] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-17T01:49:40.935171] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-17T01:49:40.935229] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-17T01:49:40.936725] [DEBUG] [LOCAL ] AER: Trimmed 69330 records to 48929 (keeping 200 days of data) [2025-09-17T01:49:41.258574] [DEBUG] [LOCAL ] AER: Primary data saved (48929 records). [2025-09-17T01:49:41.258800] [INFO ] [MAIN ] AER: Full history saved. [2025-09-17T01:49:41.259060] [INFO ] [MAIN ] Update Progress: 43/2369 symbols completed. AER took 35.1s. Estimated remaining: 5h 1m 31s. Rate: 7.7 symbols/min [2025-09-17T01:49:41.343498] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T01:49:41.444738] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:41.468844] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T01:49:41.470749] [DEBUG] [LOCAL ] AFGC: Loaded 2047 existing records from primary storage. [2025-09-17T01:49:41.478704] [INFO ] [MAIN ] AFGC: Loaded 2047 existing records. [2025-09-17T01:49:41.500499] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-17T01:49:41.669613] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:41.669881] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-17T01:49:41.669940] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-17T01:49:41.670292] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-17T01:49:41.670368] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-17T01:49:42.037618] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:42.290148] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-17T01:49:43.090154] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-11. [2025-09-17T01:49:43.353937] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T01:49:43.360470] [INFO ] [REMOTE ] AES: Full fetch complete (77586 records). [2025-09-17T01:49:43.360626] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-17T01:49:43.545330] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T01:49:43.772103] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-17T01:49:43.772345] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-17T01:49:43.773285] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-17T01:49:43.773382] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-17T01:49:43.774899] [DEBUG] [LOCAL ] AES: Trimmed 77586 records to 53674 (keeping 200 days of data) [2025-09-17T01:49:43.862269] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T01:49:43.891229] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-17T01:49:44.142668] [DEBUG] [LOCAL ] AES: Primary data saved (53674 records). [2025-09-17T01:49:44.142823] [INFO ] [MAIN ] AES: Full history saved. [2025-09-17T01:49:44.142918] [INFO ] [MAIN ] Update Progress: 44/2369 symbols completed. AES took 38.0s. Estimated remaining: 4h 57m 5s. Rate: 7.8 symbols/min [2025-09-17T01:49:44.303240] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-17T01:49:44.319938] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:49:44.325110] [DEBUG] [LOCAL ] AFGD: Loaded 1344 existing records from primary storage. [2025-09-17T01:49:44.325196] [INFO ] [MAIN ] AFGD: Loaded 1344 existing records. [2025-09-17T01:49:44.503310] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:49:44.503555] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-17T01:49:44.503628] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-17T01:49:44.503892] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-17T01:49:44.503954] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-17T01:49:44.695341] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-17T01:49:44.879186] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:49:45.248840] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T01:49:45.490139] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-17T01:49:45.788587] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-17T01:49:46.290126] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-17T01:49:46.733052] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T01:49:47.090136] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-17T01:49:47.890132] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-17T01:49:48.479157] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T01:49:48.499916] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T01:49:48.690128] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-11. [2025-09-17T01:49:49.143433] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T01:49:49.490123] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-17T01:49:50.290125] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-17T01:49:50.861523] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T01:49:50.861397] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T01:49:51.090168] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-17T01:49:51.713991] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T01:49:51.890129] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-17T01:49:52.329130] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T01:49:52.690143] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-17T01:49:53.074328] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T01:49:53.490149] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-17T01:49:54.049635] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T01:49:54.290143] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-17T01:49:55.090182] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-17T01:49:55.552012] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T01:49:55.711841] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T01:49:55.890127] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-17T01:49:56.690163] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-17T01:49:56.988295] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-17T01:49:57.248777] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T01:49:57.490134] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-17T01:49:58.048938] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T01:49:58.290132] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-17T01:49:58.764232] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T01:49:59.090133] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-17T01:49:59.621752] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T01:49:59.890181] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-17T01:50:00.329693] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T01:50:00.690186] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-17T01:50:01.373797] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T01:50:01.490138] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-17T01:50:02.290135] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-17T01:50:02.647570] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T01:50:02.651920] [INFO ] [REMOTE ] AFG: Full fetch complete (45431 records). [2025-09-17T01:50:02.652039] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-17T01:50:02.843050] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T01:50:03.042636] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-17T01:50:03.042772] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-17T01:50:03.043326] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-17T01:50:03.043387] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-17T01:50:03.044878] [DEBUG] [LOCAL ] AFG: Trimmed 45431 records to 32732 (keeping 200 days of data) [2025-09-17T01:50:03.104668] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-17T01:50:03.255801] [DEBUG] [LOCAL ] AFG: Primary data saved (32732 records). [2025-09-17T01:50:03.255975] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-17T01:50:03.256087] [INFO ] [MAIN ] Update Progress: 45/2369 symbols completed. AFG took 39.2s. Estimated remaining: 5h 6m 48s. Rate: 7.6 symbols/min [2025-09-17T01:50:03.429301] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:03.429521] [DEBUG] [LOCAL ] AFGE: No existing data file found in primary storage. [2025-09-17T01:50:03.429572] [WARN ] [MAIN ] AFGE: No existing data found, performing full refresh instead. [2025-09-17T01:50:03.429733] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-17T01:50:03.429798] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-17T01:50:03.429851] [DEBUG] [LOCAL ] AFGE: No primary data file found to delete. [2025-09-17T01:50:03.429902] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-17T01:50:03.543605] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T01:50:03.805194] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:03.890114] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-11. [2025-09-17T01:50:04.335430] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T01:50:04.690148] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-17T01:50:05.145637] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T01:50:05.490182] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-17T01:50:05.966879] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T01:50:06.290134] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-17T01:50:06.776348] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T01:50:07.090120] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-17T01:50:07.537701] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T01:50:07.890183] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-17T01:50:08.374996] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T01:50:08.690139] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-17T01:50:09.135806] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T01:50:09.490149] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-17T01:50:09.950343] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T01:50:10.290129] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-17T01:50:10.738787] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T01:50:11.090213] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-17T01:50:11.565942] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T01:50:11.890148] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-17T01:50:12.389508] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T01:50:12.690153] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-17T01:50:13.180489] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T01:50:13.490160] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-17T01:50:13.943884] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T01:50:14.290136] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-17T01:50:14.606132] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T01:50:14.607404] [INFO ] [REMOTE ] AFGC: Full fetch complete (3646 records). [2025-09-17T01:50:14.607509] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-17T01:50:14.973989] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-17T01:50:14.974090] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-17T01:50:14.974216] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-17T01:50:14.974262] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-17T01:50:14.974633] [DEBUG] [LOCAL ] AFGC: Trimmed 3646 records to 2528 (keeping 200 days of data) [2025-09-17T01:50:14.990590] [DEBUG] [LOCAL ] AFGC: Primary data saved (2528 records). [2025-09-17T01:50:14.990694] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-17T01:50:14.990788] [INFO ] [MAIN ] Update Progress: 46/2369 symbols completed. AFGC took 33.7s. Estimated remaining: 5h 9m 53s. Rate: 7.5 symbols/min [2025-09-17T01:50:15.095275] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-17T01:50:15.162390] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:15.206112] [DEBUG] [LOCAL ] AFL: Loaded 39605 existing records from primary storage. [2025-09-17T01:50:15.206301] [INFO ] [MAIN ] AFL: Loaded 39605 existing records. [2025-09-17T01:50:15.384310] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:15.384540] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-17T01:50:15.384604] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-17T01:50:15.386038] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-17T01:50:15.386111] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-17T01:50:15.672208] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T01:50:15.750621] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:15.890121] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-11. [2025-09-17T01:50:16.690155] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-17T01:50:17.356448] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T01:50:17.490145] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-17T01:50:17.685735] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T01:50:17.815673] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-17T01:50:17.816693] [INFO ] [REMOTE ] AFGD: Full fetch complete (3194 records). [2025-09-17T01:50:17.816777] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-17T01:50:18.182686] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-17T01:50:18.182819] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-17T01:50:18.182979] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-17T01:50:18.183036] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-17T01:50:18.183407] [DEBUG] [LOCAL ] AFGD: Trimmed 3194 records to 1851 (keeping 200 days of data) [2025-09-17T01:50:18.198484] [DEBUG] [LOCAL ] AFGD: Primary data saved (1851 records). [2025-09-17T01:50:18.198611] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-17T01:50:18.198717] [INFO ] [MAIN ] Update Progress: 47/2369 symbols completed. AFGD took 34.1s. Estimated remaining: 5h 5m 48s. Rate: 7.6 symbols/min [2025-09-17T01:50:18.295203] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-17T01:50:18.384015] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:18.423509] [DEBUG] [LOCAL ] AG: Loaded 39996 existing records from primary storage. [2025-09-17T01:50:18.423739] [INFO ] [MAIN ] AG: Loaded 39996 existing records. [2025-09-17T01:50:18.603260] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:18.603528] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-17T01:50:18.603580] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-17T01:50:18.604539] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-17T01:50:18.604611] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-17T01:50:18.763635] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T01:50:18.851444] [INFO ] [REMOTE ] AFGE: Full fetch complete (3466 records). [2025-09-17T01:50:18.879123] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-17T01:50:19.091285] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-17T01:50:19.116125] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:19.338428] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-17T01:50:19.338558] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-17T01:50:19.338724] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-17T01:50:19.338783] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-17T01:50:19.339157] [DEBUG] [LOCAL ] AFGE: Trimmed 3466 records to 2498 (keeping 200 days of data) [2025-09-17T01:50:19.355631] [DEBUG] [LOCAL ] AFGE: Primary data saved (2498 records). [2025-09-17T01:50:19.355784] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-17T01:50:19.355869] [INFO ] [MAIN ] Update Progress: 48/2369 symbols completed. AFGE took 16.1s. Estimated remaining: 5h 0m 14s. Rate: 7.7 symbols/min [2025-09-17T01:50:19.530930] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:19.568904] [DEBUG] [LOCAL ] AGCO: Loaded 31416 existing records from primary storage. [2025-09-17T01:50:19.569110] [INFO ] [MAIN ] AGCO: Loaded 31416 existing records. [2025-09-17T01:50:19.758341] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:19.758658] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-17T01:50:19.758722] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-17T01:50:19.759839] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-17T01:50:19.759901] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-17T01:50:19.900973] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-11. [2025-09-17T01:50:20.126472] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:20.690128] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-17T01:50:21.063344] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T01:50:21.168952] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T01:50:21.490156] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-11. [2025-09-17T01:50:21.556579] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T01:50:22.290144] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-17T01:50:23.090110] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-17T01:50:23.136517] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T01:50:23.806157] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T01:50:23.890166] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-17T01:50:24.690151] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-17T01:50:25.010691] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T01:50:25.235788] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T01:50:25.490170] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-17T01:50:25.806864] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-17T01:50:26.290209] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-17T01:50:26.419367] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T01:50:27.090186] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-17T01:50:27.481993] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T01:50:27.482879] [INFO ] [REMOTE ] AFGB: Full fetch complete (3603 records). [2025-09-17T01:50:27.482979] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-17T01:50:27.842236] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-17T01:50:27.842336] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-17T01:50:27.842463] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-17T01:50:27.842512] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-17T01:50:27.842953] [DEBUG] [LOCAL ] AFGB: Trimmed 3603 records to 2539 (keeping 200 days of data) [2025-09-17T01:50:27.859157] [DEBUG] [LOCAL ] AFGB: Primary data saved (2539 records). [2025-09-17T01:50:27.859249] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-17T01:50:27.859353] [INFO ] [MAIN ] Update Progress: 49/2369 symbols completed. AFGB took 52.1s. Estimated remaining: 5h 0m 41s. Rate: 7.7 symbols/min [2025-09-17T01:50:27.895251] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-17T01:50:28.040764] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:28.057010] [DEBUG] [LOCAL ] AGD: Loaded 13784 existing records from primary storage. [2025-09-17T01:50:28.057176] [INFO ] [MAIN ] AGD: Loaded 13784 existing records. [2025-09-17T01:50:28.244770] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:28.245370] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-17T01:50:28.245442] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-17T01:50:28.245870] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-17T01:50:28.245948] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-17T01:50:28.453673] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-17T01:50:28.653045] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:28.690103] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-11. [2025-09-17T01:50:29.490156] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-17T01:50:29.527507] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T01:50:29.542836] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T01:50:30.290110] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-17T01:50:31.090128] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-17T01:50:31.160352] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T01:50:31.462264] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T01:50:31.890134] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-17T01:50:32.609516] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T01:50:32.690112] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-17T01:50:33.490125] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-17T01:50:33.904427] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T01:50:34.165741] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T01:50:34.290127] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-17T01:50:35.066351] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T01:50:35.090085] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-17T01:50:35.890101] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-17T01:50:35.971059] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T01:50:36.355932] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T01:50:36.690152] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-17T01:50:37.490144] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-17T01:50:37.832493] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T01:50:38.290112] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-17T01:50:38.431024] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T01:50:38.604002] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T01:50:39.090132] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-17T01:50:39.650773] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T01:50:39.890121] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-17T01:50:40.690146] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-17T01:50:40.721318] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T01:50:40.945616] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T01:50:41.490176] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-17T01:50:42.290093] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-17T01:50:42.315148] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T01:50:42.777484] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T01:50:43.090128] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-17T01:50:43.725115] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T01:50:43.890128] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-17T01:50:44.674483] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T01:50:44.690104] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-17T01:50:44.934042] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T01:50:45.490122] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-17T01:50:45.727983] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T01:50:46.290194] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-17T01:50:46.977154] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T01:50:47.090135] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-17T01:50:47.890151] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-17T01:50:47.992025] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T01:50:47.998592] [INFO ] [REMOTE ] AFL: Full fetch complete (76756 records). [2025-09-17T01:50:47.998789] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-17T01:50:48.385380] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-17T01:50:48.385487] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-17T01:50:48.386228] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-17T01:50:48.386292] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-17T01:50:48.387763] [DEBUG] [LOCAL ] AFL: Trimmed 76756 records to 53150 (keeping 200 days of data) [2025-09-17T01:50:48.655444] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T01:50:48.718168] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-17T01:50:48.766605] [DEBUG] [LOCAL ] AFL: Primary data saved (53150 records). [2025-09-17T01:50:48.766789] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-17T01:50:48.766910] [INFO ] [MAIN ] Update Progress: 50/2369 symbols completed. AFL took 33.8s. Estimated remaining: 5h 10m 43s. Rate: 7.5 symbols/min [2025-09-17T01:50:48.937737] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:48.978779] [DEBUG] [LOCAL ] AGI: Loaded 39794 existing records from primary storage. [2025-09-17T01:50:48.978956] [INFO ] [MAIN ] AGI: Loaded 39794 existing records. [2025-09-17T01:50:49.158030] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:49.158358] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-17T01:50:49.158543] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-17T01:50:49.159505] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-17T01:50:49.159589] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-17T01:50:49.461597] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-17T01:50:49.509958] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-17T01:50:49.572726] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:49.586273] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T01:50:50.290150] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-17T01:50:51.097519] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-17T01:50:51.118225] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T01:50:51.890114] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-17T01:50:52.194903] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T01:50:52.353842] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T01:50:52.690137] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-11. [2025-09-17T01:50:53.286561] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T01:50:53.291906] [INFO ] [REMOTE ] AGCO: Full fetch complete (62086 records). [2025-09-17T01:50:53.292075] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-17T01:50:53.500328] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-17T01:50:53.673890] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-17T01:50:53.673988] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-17T01:50:53.674671] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-17T01:50:53.674740] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-17T01:50:53.676588] [DEBUG] [LOCAL ] AGCO: Trimmed 62086 records to 42801 (keeping 200 days of data) [2025-09-17T01:50:53.943905] [DEBUG] [LOCAL ] AGCO: Primary data saved (42801 records). [2025-09-17T01:50:53.944065] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-17T01:50:53.944167] [INFO ] [MAIN ] Update Progress: 51/2369 symbols completed. AGCO took 34.6s. Estimated remaining: 5h 8m 24s. Rate: 7.5 symbols/min [2025-09-17T01:50:54.121432] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:54.169954] [DEBUG] [LOCAL ] AGL: Loaded 39074 existing records from primary storage. [2025-09-17T01:50:54.170141] [INFO ] [MAIN ] AGL: Loaded 39074 existing records. [2025-09-17T01:50:54.290619] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-17T01:50:54.411467] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:54.411986] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-17T01:50:54.412062] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-17T01:50:54.413137] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-17T01:50:54.413233] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-17T01:50:54.554861] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T01:50:54.820012] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:55.090124] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-11. [2025-09-17T01:50:55.147856] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T01:50:55.150945] [INFO ] [REMOTE ] AGD: Full fetch complete (24995 records). [2025-09-17T01:50:55.151044] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-17T01:50:55.548054] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-17T01:50:55.548170] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-17T01:50:55.548517] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-17T01:50:55.548573] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-17T01:50:55.549305] [DEBUG] [LOCAL ] AGD: Trimmed 24995 records to 17535 (keeping 200 days of data) [2025-09-17T01:50:55.663553] [DEBUG] [LOCAL ] AGD: Primary data saved (17535 records). [2025-09-17T01:50:55.663828] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-17T01:50:55.663950] [INFO ] [MAIN ] Update Progress: 52/2369 symbols completed. AGD took 27.8s. Estimated remaining: 5h 3m 37s. Rate: 7.6 symbols/min [2025-09-17T01:50:55.848363] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:50:55.886795] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-17T01:50:55.898126] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-17T01:50:55.904340] [DEBUG] [LOCAL ] AGM: Loaded 8023 existing records from primary storage. [2025-09-17T01:50:55.904956] [INFO ] [MAIN ] AGM: Loaded 8023 existing records. [2025-09-17T01:50:56.100048] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:50:56.100342] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-17T01:50:56.100408] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-17T01:50:56.100742] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-17T01:50:56.100802] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-17T01:50:56.466095] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:50:56.537541] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T01:50:56.690118] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-17T01:50:57.490132] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-11. [2025-09-17T01:50:57.679990] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T01:50:58.290131] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-17T01:50:58.303140] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T01:50:58.368311] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T01:50:59.090136] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-17T01:50:59.890116] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-17T01:51:00.066370] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T01:51:00.615575] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T01:51:00.690088] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-17T01:51:01.221186] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T01:51:01.489330] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T01:51:01.490852] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-17T01:51:02.290181] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-17T01:51:03.090173] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-17T01:51:03.890198] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-17T01:51:04.710144] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T01:51:04.712008] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-17T01:51:04.947425] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (3.46 seconds). [2025-09-17T01:51:05.467209] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T01:51:05.490140] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-17T01:51:05.570545] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-17T01:51:06.290142] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-17T01:51:06.364866] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T01:51:06.559962] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (4.27 seconds). [2025-09-17T01:51:06.566585] [INFO ] [REMOTE ] AG: Full fetch complete (77427 records). [2025-09-17T01:51:06.566782] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-17T01:51:06.974663] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-17T01:51:06.974800] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-17T01:51:06.975527] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-17T01:51:06.975583] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-17T01:51:06.977045] [DEBUG] [LOCAL ] AG: Trimmed 77427 records to 53641 (keeping 200 days of data) [2025-09-17T01:51:07.090862] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-17T01:51:07.305218] [DEBUG] [LOCAL ] AG: Primary data saved (53641 records). [2025-09-17T01:51:07.305385] [INFO ] [MAIN ] AG: Full history saved. [2025-09-17T01:51:07.305474] [INFO ] [MAIN ] Update Progress: 53/2369 symbols completed. AG took 49.1s. Estimated remaining: 5h 6m 15s. Rate: 7.6 symbols/min [2025-09-17T01:51:07.476227] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:07.496501] [DEBUG] [LOCAL ] AGO: Loaded 20430 existing records from primary storage. [2025-09-17T01:51:07.496670] [INFO ] [MAIN ] AGO: Loaded 20430 existing records. [2025-09-17T01:51:07.679335] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:51:07.679705] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-17T01:51:07.679848] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-17T01:51:07.685763] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-17T01:51:07.686067] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T01:51:07.686216] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-17T01:51:07.898440] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-17T01:51:08.059803] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:08.153954] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T01:51:08.690165] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-17T01:51:09.023989] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T01:51:09.490151] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-11. [2025-09-17T01:51:10.290118] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-17T01:51:10.321443] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T01:51:10.630570] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T01:51:11.090190] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-17T01:51:11.890183] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-17T01:51:12.265076] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T01:51:12.383621] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T01:51:12.690194] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-17T01:51:12.745948] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T01:51:13.490131] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-17T01:51:14.290202] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-17T01:51:14.298987] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T01:51:15.090100] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-17T01:51:15.641867] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (2.95 seconds). [2025-09-17T01:51:15.890141] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-17T01:51:16.440992] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T01:51:16.629082] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T01:51:16.630705] [INFO ] [REMOTE ] AGM: Full fetch complete (12331 records). [2025-09-17T01:51:16.630790] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-17T01:51:16.695877] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-17T01:51:17.001488] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-17T01:51:17.001595] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-17T01:51:17.001927] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-17T01:51:17.002031] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-17T01:51:17.002593] [DEBUG] [LOCAL ] AGM: Trimmed 12331 records to 9795 (keeping 200 days of data) [2025-09-17T01:51:17.071568] [DEBUG] [LOCAL ] AGM: Primary data saved (9795 records). [2025-09-17T01:51:17.071746] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-17T01:51:17.071848] [INFO ] [MAIN ] Update Progress: 54/2369 symbols completed. AGM took 21.4s. Estimated remaining: 5h 7m 25s. Rate: 7.5 symbols/min [2025-09-17T01:51:17.239069] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:17.261375] [DEBUG] [LOCAL ] AGRO: Loaded 24149 existing records from primary storage. [2025-09-17T01:51:17.261541] [INFO ] [MAIN ] AGRO: Loaded 24149 existing records. [2025-09-17T01:51:17.439885] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:51:17.440128] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-17T01:51:17.440183] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-17T01:51:17.440821] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-17T01:51:17.440878] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-17T01:51:17.504056] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-17T01:51:17.799229] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:17.815123] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T01:51:17.853763] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T01:51:18.290200] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-11. [2025-09-17T01:51:19.090179] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-17T01:51:19.245670] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T01:51:19.311631] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T01:51:19.890089] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-17T01:51:20.350255] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T01:51:20.690164] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-17T01:51:21.313214] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T01:51:21.490136] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-17T01:51:22.135932] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T01:51:22.290156] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-17T01:51:23.090184] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-17T01:51:23.218490] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T01:51:23.487074] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T01:51:23.890177] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-17T01:51:24.629014] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T01:51:24.690088] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-17T01:51:25.490143] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-17T01:51:25.669948] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T01:51:26.290181] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-17T01:51:26.545088] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T01:51:26.889001] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T01:51:27.090111] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-17T01:51:27.407544] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T01:51:27.890162] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-17T01:51:28.690161] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-17T01:51:28.730953] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T01:51:28.737733] [INFO ] [REMOTE ] AGI: Full fetch complete (76497 records). [2025-09-17T01:51:28.737907] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-17T01:51:29.139101] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-17T01:51:29.139215] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-17T01:51:29.140013] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-17T01:51:29.140082] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-17T01:51:29.143436] [DEBUG] [LOCAL ] AGI: Trimmed 76497 records to 53412 (keeping 200 days of data) [2025-09-17T01:51:29.277848] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T01:51:29.492201] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-17T01:51:29.506393] [DEBUG] [LOCAL ] AGI: Primary data saved (53412 records). [2025-09-17T01:51:29.506707] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-17T01:51:29.506806] [INFO ] [MAIN ] Update Progress: 55/2369 symbols completed. AGI took 40.7s. Estimated remaining: 5h 10m 25s. Rate: 7.5 symbols/min [2025-09-17T01:51:29.676970] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:29.700991] [DEBUG] [LOCAL ] AGX: Loaded 24652 existing records from primary storage. [2025-09-17T01:51:29.701138] [INFO ] [MAIN ] AGX: Loaded 24652 existing records. [2025-09-17T01:51:29.884857] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:51:29.885262] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-17T01:51:29.885378] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-17T01:51:29.891790] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-17T01:51:29.902786] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-17T01:51:29.903912] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T01:51:30.268815] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:30.290078] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-11. [2025-09-17T01:51:30.847752] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T01:51:31.090188] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-17T01:51:31.451677] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T01:51:31.890162] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-17T01:51:32.341290] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T01:51:32.690145] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-17T01:51:33.007953] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T01:51:33.490157] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-17T01:51:34.125371] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T01:51:34.157928] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T01:51:34.161899] [INFO ] [REMOTE ] AGO: Full fetch complete (39110 records). [2025-09-17T01:51:34.162071] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-17T01:51:34.295314] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-17T01:51:34.563888] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-17T01:51:34.564003] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-17T01:51:34.564628] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-17T01:51:34.564728] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-17T01:51:34.565915] [DEBUG] [LOCAL ] AGO: Trimmed 39110 records to 28268 (keeping 200 days of data) [2025-09-17T01:51:34.747772] [DEBUG] [LOCAL ] AGO: Primary data saved (28268 records). [2025-09-17T01:51:34.748059] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-17T01:51:34.748153] [INFO ] [MAIN ] Update Progress: 56/2369 symbols completed. AGO took 27.4s. Estimated remaining: 5h 8m 21s. Rate: 7.5 symbols/min [2025-09-17T01:51:34.933720] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:34.965027] [DEBUG] [LOCAL ] AHH: Loaded 29751 existing records from primary storage. [2025-09-17T01:51:34.965219] [INFO ] [MAIN ] AHH: Loaded 29751 existing records. [2025-09-17T01:51:35.105252] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-17T01:51:35.145081] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:51:35.145350] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-17T01:51:35.145409] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-17T01:51:35.146202] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-17T01:51:35.146264] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-17T01:51:35.504946] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:35.890147] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-17T01:51:36.144223] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T01:51:36.593851] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T01:51:36.690139] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-17T01:51:37.175094] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T01:51:37.490136] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-17T01:51:38.259395] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T01:51:38.290088] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-17T01:51:39.090114] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-17T01:51:39.475203] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T01:51:39.505892] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T01:51:39.890152] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-17T01:51:40.143666] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T01:51:40.690137] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-11. [2025-09-17T01:51:41.497378] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-17T01:51:41.501238] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T01:51:41.507927] [INFO ] [REMOTE ] AGL: Full fetch complete (75240 records). [2025-09-17T01:51:41.508059] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-17T01:51:41.905746] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-17T01:51:41.905851] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-17T01:51:41.906558] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-17T01:51:41.906613] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-17T01:51:41.908309] [DEBUG] [LOCAL ] AGL: Trimmed 75240 records to 52404 (keeping 200 days of data) [2025-09-17T01:51:42.223970] [DEBUG] [LOCAL ] AGL: Primary data saved (52404 records). [2025-09-17T01:51:42.224795] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T01:51:42.233167] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-17T01:51:42.233286] [INFO ] [MAIN ] Update Progress: 57/2369 symbols completed. AGL took 48.3s. Estimated remaining: 5h 7m 52s. Rate: 7.5 symbols/min [2025-09-17T01:51:42.296123] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-17T01:51:42.403772] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:42.403954] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-17T01:51:42.404001] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-17T01:51:42.404104] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-17T01:51:42.404154] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-17T01:51:42.404200] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-17T01:51:42.404242] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-17T01:51:42.770035] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:42.791260] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T01:51:43.090177] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-11. [2025-09-17T01:51:43.297636] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:43.298032] [WARN ] [REMOTE ] AHL: No data returned for month 2024-11 [2025-09-17T01:51:43.890261] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-17T01:51:43.893162] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T01:51:44.690135] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-17T01:51:44.898469] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:44.898826] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-17T01:51:45.006581] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T01:51:45.490163] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-17T01:51:46.290096] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-17T01:51:46.755386] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T01:51:47.090198] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-17T01:51:47.347907] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:47.349312] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T01:51:47.356126] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-17T01:51:47.890122] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-17T01:51:48.690141] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-17T01:51:48.900541] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:48.900914] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-17T01:51:49.481483] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T01:51:49.490074] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-17T01:51:50.290146] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-17T01:51:50.928174] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T01:51:51.090138] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-17T01:51:51.150544] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T01:51:51.890124] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-17T01:51:52.506087] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T01:51:52.690151] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-17T01:51:53.097150] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T01:51:53.101074] [INFO ] [REMOTE ] AGRO: Full fetch complete (50030 records). [2025-09-17T01:51:53.101185] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-17T01:51:53.487687] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-17T01:51:53.487791] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-17T01:51:53.488314] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-17T01:51:53.488366] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-17T01:51:53.489510] [DEBUG] [LOCAL ] AGRO: Trimmed 50030 records to 34178 (keeping 200 days of data) [2025-09-17T01:51:53.490092] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-17T01:51:53.688809] [DEBUG] [LOCAL ] AGRO: Primary data saved (34178 records). [2025-09-17T01:51:53.688976] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-17T01:51:53.689084] [INFO ] [MAIN ] Update Progress: 58/2369 symbols completed. AGRO took 36.6s. Estimated remaining: 5h 10m 3s. Rate: 7.5 symbols/min [2025-09-17T01:51:53.857561] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:51:53.895490] [DEBUG] [LOCAL ] AHR: Loaded 36730 existing records from primary storage. [2025-09-17T01:51:53.895690] [INFO ] [MAIN ] AHR: Loaded 36730 existing records. [2025-09-17T01:51:54.079774] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:51:54.080043] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-17T01:51:54.080105] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-17T01:51:54.081020] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-17T01:51:54.081086] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-17T01:51:54.203521] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:54.260388] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-17T01:51:54.300340] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-17T01:51:54.447802] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:51:54.469956] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T01:51:54.605079] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:51:54.605394] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-17T01:51:55.090200] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-11. [2025-09-17T01:51:55.890158] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-17T01:51:56.399734] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T01:51:56.690132] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-17T01:51:57.361053] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T01:51:57.490129] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-17T01:51:58.290145] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-17T01:51:58.375602] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T01:51:58.990018] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T01:51:59.090135] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-17T01:51:59.630927] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T01:51:59.635700] [INFO ] [REMOTE ] AGX: Full fetch complete (48810 records). [2025-09-17T01:51:59.635841] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-17T01:51:59.895709] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-17T01:52:00.035900] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-17T01:52:00.036035] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-17T01:52:00.036689] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-17T01:52:00.036774] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-17T01:52:00.038376] [DEBUG] [LOCAL ] AGX: Trimmed 48810 records to 33599 (keeping 200 days of data) [2025-09-17T01:52:00.252225] [DEBUG] [LOCAL ] AGX: Primary data saved (33599 records). [2025-09-17T01:52:00.252381] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-17T01:52:00.252498] [INFO ] [MAIN ] Update Progress: 59/2369 symbols completed. AGX took 30.7s. Estimated remaining: 5h 8m 56s. Rate: 7.5 symbols/min [2025-09-17T01:52:00.424004] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:00.430554] [DEBUG] [LOCAL ] AHT: Loaded 4639 existing records from primary storage. [2025-09-17T01:52:00.430700] [INFO ] [MAIN ] AHT: Loaded 4639 existing records. [2025-09-17T01:52:00.610270] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:00.610517] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-17T01:52:00.610589] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-17T01:52:00.610909] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-17T01:52:00.610984] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-17T01:52:00.695262] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-17T01:52:00.990704] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:01.016192] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T01:52:01.313365] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T01:52:01.490089] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-17T01:52:01.903610] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T01:52:02.290192] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-17T01:52:03.071282] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T01:52:03.090132] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-17T01:52:03.383474] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T01:52:03.890161] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-11. [2025-09-17T01:52:04.546183] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T01:52:04.690088] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-17T01:52:04.772148] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T01:52:05.490175] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-17T01:52:05.612169] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T01:52:06.123343] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T01:52:06.290150] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-17T01:52:07.090147] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-17T01:52:07.805798] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T01:52:07.890146] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-17T01:52:08.460889] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T01:52:08.690145] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-17T01:52:09.497159] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-17T01:52:09.515422] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T01:52:09.801280] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T01:52:09.806994] [INFO ] [REMOTE ] AHL: Full fetch complete (15974 records). [2025-09-17T01:52:09.807124] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-17T01:52:09.988059] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 90 unique days, need 200 days [2025-09-17T01:52:09.988362] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:52:09.988418] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:52:09.988470] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-17T01:52:09.988574] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-17T01:52:09.988627] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-17T01:52:09.988708] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-17T01:52:09.988780] [INFO ] [MAIN ] Update Progress: 60/2369 symbols completed. AHL took 27.8s. Estimated remaining: 5h 9m 54s. Rate: 7.5 symbols/min [2025-09-17T01:52:10.161133] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:10.202365] [DEBUG] [LOCAL ] AI: Loaded 40117 existing records from primary storage. [2025-09-17T01:52:10.202566] [INFO ] [MAIN ] AI: Loaded 40117 existing records. [2025-09-17T01:52:10.298936] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-17T01:52:10.409531] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:10.409797] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-17T01:52:10.409856] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-17T01:52:10.410771] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-17T01:52:10.410835] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-17T01:52:10.810885] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:11.044260] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T01:52:11.090228] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-17T01:52:11.656151] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T01:52:11.890186] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-17T01:52:12.566740] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T01:52:12.630356] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T01:52:12.690152] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-11. [2025-09-17T01:52:13.490157] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-17T01:52:14.290163] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-17T01:52:14.650163] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T01:52:14.938416] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-11 (2.25 seconds). [2025-09-17T01:52:15.031595] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T01:52:15.090157] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-17T01:52:15.890187] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-17T01:52:16.690188] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-17T01:52:17.200283] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T01:52:17.204635] [INFO ] [REMOTE ] AHH: Full fetch complete (60468 records). [2025-09-17T01:52:17.204795] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-17T01:52:17.495340] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-17T01:52:17.601924] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-17T01:52:17.602026] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-17T01:52:17.602627] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-17T01:52:17.602698] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-17T01:52:17.603896] [DEBUG] [LOCAL ] AHH: Trimmed 60468 records to 41687 (keeping 200 days of data) [2025-09-17T01:52:17.850208] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-17T01:52:17.894695] [DEBUG] [LOCAL ] AHH: Primary data saved (41687 records). [2025-09-17T01:52:17.894870] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-17T01:52:17.894982] [INFO ] [MAIN ] Update Progress: 61/2369 symbols completed. AHH took 43.1s. Estimated remaining: 5h 9m 41s. Rate: 7.5 symbols/min [2025-09-17T01:52:18.071914] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:18.116618] [DEBUG] [LOCAL ] AIG: Loaded 39844 existing records from primary storage. [2025-09-17T01:52:18.116800] [INFO ] [MAIN ] AIG: Loaded 39844 existing records. [2025-09-17T01:52:18.294009] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-17T01:52:18.294235] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:18.295632] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-17T01:52:18.295874] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-17T01:52:18.297357] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-17T01:52:18.297446] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-17T01:52:18.494017] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T01:52:18.635375] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T01:52:18.719174] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:19.090133] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-17T01:52:19.890144] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-11. [2025-09-17T01:52:20.342023] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T01:52:20.690156] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-17T01:52:20.894929] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-17T01:52:21.490193] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-17T01:52:21.562231] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T01:52:22.290175] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-17T01:52:22.411464] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T01:52:23.090239] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-17T01:52:23.563861] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T01:52:23.693363] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T01:52:23.890154] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-17T01:52:24.537112] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T01:52:24.543248] [INFO ] [REMOTE ] AHR: Full fetch complete (70934 records). [2025-09-17T01:52:24.543444] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-17T01:52:24.695261] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-17T01:52:24.943845] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-17T01:52:24.943972] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-17T01:52:24.944763] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-17T01:52:24.944846] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-17T01:52:24.946353] [DEBUG] [LOCAL ] AHR: Trimmed 70934 records to 49406 (keeping 200 days of data) [2025-09-17T01:52:25.251678] [DEBUG] [LOCAL ] AHR: Primary data saved (49406 records). [2025-09-17T01:52:25.251851] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-17T01:52:25.251950] [INFO ] [MAIN ] Update Progress: 62/2369 symbols completed. AHR took 31.6s. Estimated remaining: 5h 9m 7s. Rate: 7.5 symbols/min [2025-09-17T01:52:25.430708] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:25.430940] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-17T01:52:25.430985] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-17T01:52:25.431130] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-17T01:52:25.431175] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-17T01:52:25.431221] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-17T01:52:25.431257] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-17T01:52:25.499012] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-17T01:52:25.788406] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:25.861584] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T01:52:26.268697] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T01:52:26.290153] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-17T01:52:26.536983] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T01:52:27.090146] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-17T01:52:27.890179] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-17T01:52:28.414227] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T01:52:28.497781] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T01:52:28.690120] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-11. [2025-09-17T01:52:28.719418] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T01:52:28.937741] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:28.938169] [WARN ] [REMOTE ] AII: No data returned for month 2024-11 [2025-09-17T01:52:29.490136] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-17T01:52:29.711068] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:29.711381] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-17T01:52:30.290148] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-17T01:52:30.507152] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:30.507489] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-17T01:52:31.090159] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-17T01:52:31.890169] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-17T01:52:32.111190] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:32.111520] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-17T01:52:32.690167] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-17T01:52:32.969319] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T01:52:33.467455] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T01:52:33.490090] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-17T01:52:34.212831] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T01:52:34.290177] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-17T01:52:35.019178] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T01:52:35.090101] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-17T01:52:35.890149] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-17T01:52:36.549718] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T01:52:36.551120] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T01:52:36.563306] [INFO ] [REMOTE ] AHT: Full fetch complete (9486 records). [2025-09-17T01:52:36.563714] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-17T01:52:36.703816] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-17T01:52:36.926257] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-17T01:52:36.926380] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-17T01:52:36.926679] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-17T01:52:36.926734] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-17T01:52:36.927208] [DEBUG] [LOCAL ] AHT: Trimmed 9486 records to 5923 (keeping 200 days of data) [2025-09-17T01:52:36.966357] [DEBUG] [LOCAL ] AHT: Primary data saved (5923 records). [2025-09-17T01:52:36.966545] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-17T01:52:36.966681] [INFO ] [MAIN ] Update Progress: 63/2369 symbols completed. AHT took 36.7s. Estimated remaining: 5h 11m 13s. Rate: 7.4 symbols/min [2025-09-17T01:52:37.142831] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:37.160408] [DEBUG] [LOCAL ] AIN: Loaded 18026 existing records from primary storage. [2025-09-17T01:52:37.160549] [INFO ] [MAIN ] AIN: Loaded 18026 existing records. [2025-09-17T01:52:37.346539] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:37.346859] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-17T01:52:37.346917] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-17T01:52:37.347533] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-17T01:52:37.347596] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-17T01:52:37.501314] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-17T01:52:37.726843] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:38.290197] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-17T01:52:38.497378] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:38.497782] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-17T01:52:39.090143] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-17T01:52:39.285002] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-17T01:52:39.296833] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:52:39.297941] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-17T01:52:39.460823] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T01:52:39.890191] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-17T01:52:40.483302] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T01:52:40.690122] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-17T01:52:41.490155] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-17T01:52:41.736530] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T01:52:42.290141] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-11. [2025-09-17T01:52:43.090152] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-17T01:52:43.544781] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T01:52:43.893937] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-17T01:52:43.898070] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T01:52:43.978046] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-17T01:52:44.690135] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-17T01:52:44.794346] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T01:52:45.191766] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T01:52:45.490174] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-17T01:52:46.290128] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-17T01:52:46.353456] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T01:52:46.355942] [INFO ] [REMOTE ] AII: Full fetch complete (9600 records). [2025-09-17T01:52:46.356025] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-17T01:52:46.535614] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 90 unique days, need 200 days [2025-09-17T01:52:46.535897] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:52:46.535946] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:52:46.536000] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-17T01:52:46.536064] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-17T01:52:46.536133] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-17T01:52:46.536191] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-17T01:52:46.536263] [INFO ] [MAIN ] Update Progress: 64/2369 symbols completed. AII took 21.3s. Estimated remaining: 5h 11m 58s. Rate: 7.4 symbols/min [2025-09-17T01:52:46.710595] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:46.721060] [DEBUG] [LOCAL ] AIO: Loaded 9228 existing records from primary storage. [2025-09-17T01:52:46.721213] [INFO ] [MAIN ] AIO: Loaded 9228 existing records. [2025-09-17T01:52:46.902600] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:46.902872] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-17T01:52:46.902932] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-17T01:52:46.903329] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-17T01:52:46.903394] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-17T01:52:47.095281] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-17T01:52:47.261567] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:47.890195] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-17T01:52:48.033385] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T01:52:48.690157] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-17T01:52:48.990413] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T01:52:49.490172] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-17T01:52:49.835664] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-17T01:52:50.290136] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-17T01:52:50.591024] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T01:52:50.612915] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T01:52:51.090124] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-17T01:52:51.890173] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-11. [2025-09-17T01:52:51.966772] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T01:52:52.690221] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-17T01:52:52.720759] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T01:52:52.896985] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-17T01:52:53.490135] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-17T01:52:53.768050] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T01:52:54.251563] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T01:52:54.290137] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-17T01:52:55.090208] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-17T01:52:55.890175] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-17T01:52:56.223390] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T01:52:56.690201] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-17T01:52:56.990013] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T01:52:57.362894] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-17T01:52:57.369669] [INFO ] [REMOTE ] AI: Full fetch complete (77884 records). [2025-09-17T01:52:57.369816] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-17T01:52:57.495225] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-17T01:52:57.775141] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-17T01:52:57.775249] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-17T01:52:57.776024] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-17T01:52:57.776108] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-17T01:52:57.777705] [DEBUG] [LOCAL ] AI: Trimmed 77884 records to 53749 (keeping 200 days of data) [2025-09-17T01:52:58.101266] [DEBUG] [LOCAL ] AI: Primary data saved (53749 records). [2025-09-17T01:52:58.101427] [INFO ] [MAIN ] AI: Full history saved. [2025-09-17T01:52:58.101540] [INFO ] [MAIN ] Update Progress: 65/2369 symbols completed. AI took 48.1s. Estimated remaining: 5h 13m 52s. Rate: 7.3 symbols/min [2025-09-17T01:52:58.275826] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:58.290095] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-17T01:52:58.297736] [DEBUG] [LOCAL ] AIR: Loaded 19453 existing records from primary storage. [2025-09-17T01:52:58.297829] [INFO ] [MAIN ] AIR: Loaded 19453 existing records. [2025-09-17T01:52:58.459035] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T01:52:58.504592] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:52:58.504860] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-17T01:52:58.504932] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-17T01:52:58.505500] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-17T01:52:58.505579] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-17T01:52:58.548583] [INFO ] [REMOTE ] AIG: Full fetch complete (77210 records). [2025-09-17T01:52:58.580760] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-17T01:52:59.178350] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:52:59.194375] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-11. [2025-09-17T01:52:59.265166] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T01:52:59.322720] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-17T01:52:59.325601] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-17T01:52:59.325525] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T01:52:59.330169] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-17T01:52:59.334237] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-17T01:52:59.336014] [DEBUG] [LOCAL ] AIG: Trimmed 77210 records to 53477 (keeping 200 days of data) [2025-09-17T01:52:59.671350] [DEBUG] [LOCAL ] AIG: Primary data saved (53477 records). [2025-09-17T01:52:59.671515] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-17T01:52:59.671662] [INFO ] [MAIN ] Update Progress: 66/2369 symbols completed. AIG took 41.8s. Estimated remaining: 5h 9m 53s. Rate: 7.4 symbols/min [2025-09-17T01:52:59.842485] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:52:59.863309] [DEBUG] [LOCAL ] AIT: Loaded 20432 existing records from primary storage. [2025-09-17T01:52:59.863451] [INFO ] [MAIN ] AIT: Loaded 20432 existing records. [2025-09-17T01:52:59.895239] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-17T01:53:00.049398] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:53:00.049890] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-17T01:53:00.050010] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-17T01:53:00.055948] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-17T01:53:00.062288] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-17T01:53:00.063188] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T01:53:00.419111] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:00.515866] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T01:53:00.690109] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-11. [2025-09-17T01:53:01.490132] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-17T01:53:01.958892] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T01:53:02.290173] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-17T01:53:02.714758] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T01:53:03.090178] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-17T01:53:03.260161] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T01:53:03.890189] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-17T01:53:04.077220] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T01:53:04.690152] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-17T01:53:04.755597] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T01:53:05.490157] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-17T01:53:05.691746] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T01:53:05.694754] [INFO ] [REMOTE ] AIN: Full fetch complete (33143 records). [2025-09-17T01:53:05.694865] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-17T01:53:06.078099] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-17T01:53:06.078237] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-17T01:53:06.078656] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-17T01:53:06.078706] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-17T01:53:06.080042] [DEBUG] [LOCAL ] AIN: Trimmed 33143 records to 24660 (keeping 200 days of data) [2025-09-17T01:53:06.237342] [DEBUG] [LOCAL ] AIN: Primary data saved (24660 records). [2025-09-17T01:53:06.237518] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-17T01:53:06.237669] [INFO ] [MAIN ] Update Progress: 67/2369 symbols completed. AIN took 29.3s. Estimated remaining: 5h 8m 54s. Rate: 7.5 symbols/min [2025-09-17T01:53:06.300469] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-17T01:53:06.410960] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:06.438927] [DEBUG] [LOCAL ] AIV: Loaded 29849 existing records from primary storage. [2025-09-17T01:53:06.439092] [INFO ] [MAIN ] AIV: Loaded 29849 existing records. [2025-09-17T01:53:06.617013] [WARN ] [MAIN ] AIV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:53:06.617310] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-17T01:53:06.617379] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-17T01:53:06.618146] [DEBUG] [LOCAL ] AIV: Deleted primary data file. [2025-09-17T01:53:06.618217] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-17T01:53:07.020285] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:07.035770] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T01:53:07.090079] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-17T01:53:07.444384] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T01:53:07.890136] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-17T01:53:08.181560] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T01:53:08.690163] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-17T01:53:09.199058] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T01:53:09.490178] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-11. [2025-09-17T01:53:09.830622] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T01:53:10.290151] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-17T01:53:10.980445] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T01:53:11.090115] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-17T01:53:11.635492] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T01:53:11.890126] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-17T01:53:12.559590] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T01:53:12.690086] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-17T01:53:12.793870] [DEBUG] [REMOTE ] AIV: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T01:53:12.794081] [WARN ] [REMOTE ] AIV: No data returned for month 2025-01 [2025-09-17T01:53:12.855277] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T01:53:13.490198] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-17T01:53:14.290156] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-17T01:53:14.889455] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T01:53:14.906120] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T01:53:15.090154] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-17T01:53:15.890152] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-17T01:53:16.042272] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T01:53:16.690177] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-17T01:53:17.404419] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T01:53:17.490098] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-17T01:53:17.863125] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T01:53:18.290160] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-17T01:53:18.745089] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T01:53:18.896301] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T01:53:19.090130] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-17T01:53:19.890105] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-17T01:53:20.160804] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T01:53:20.690185] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-17T01:53:20.823864] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T01:53:21.490161] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-17T01:53:21.542433] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T01:53:22.290137] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-17T01:53:22.869442] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T01:53:23.090102] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-17T01:53:23.766155] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T01:53:23.784192] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T01:53:23.786103] [INFO ] [REMOTE ] AIO: Full fetch complete (20236 records). [2025-09-17T01:53:23.786203] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-17T01:53:23.892481] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-17T01:53:24.170195] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-17T01:53:24.170294] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-17T01:53:24.170631] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-17T01:53:24.170723] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-17T01:53:24.171359] [DEBUG] [LOCAL ] AIO: Trimmed 20236 records to 13435 (keeping 200 days of data) [2025-09-17T01:53:24.259279] [DEBUG] [LOCAL ] AIO: Primary data saved (13435 records). [2025-09-17T01:53:24.259452] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-17T01:53:24.259572] [INFO ] [MAIN ] Update Progress: 68/2369 symbols completed. AIO took 37.7s. Estimated remaining: 5h 14m 23s. Rate: 7.3 symbols/min [2025-09-17T01:53:24.439851] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:24.440064] [DEBUG] [LOCAL ] AIZ: No existing data file found in primary storage. [2025-09-17T01:53:24.440114] [WARN ] [MAIN ] AIZ: No existing data found, performing full refresh instead. [2025-09-17T01:53:24.440219] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-17T01:53:24.440261] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-17T01:53:24.440318] [DEBUG] [LOCAL ] AIZ: No primary data file found to delete. [2025-09-17T01:53:24.440383] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-17T01:53:24.695181] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-17T01:53:24.813469] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:25.246115] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T01:53:25.490128] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-11. [2025-09-17T01:53:26.214868] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T01:53:26.290084] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-17T01:53:26.807026] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T01:53:27.090175] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-17T01:53:27.433497] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T01:53:27.890169] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-17T01:53:28.643279] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T01:53:28.690140] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-17T01:53:29.215791] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T01:53:29.490179] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-17T01:53:29.740443] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T01:53:30.290199] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-17T01:53:30.910580] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T01:53:31.090143] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-17T01:53:31.171256] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T01:53:31.890160] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-17T01:53:32.184000] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T01:53:32.690191] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-17T01:53:33.208633] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T01:53:33.490207] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-17T01:53:34.044926] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T01:53:34.290174] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-17T01:53:34.666193] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T01:53:34.669684] [INFO ] [REMOTE ] AIR: Full fetch complete (36942 records). [2025-09-17T01:53:34.669811] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-17T01:53:35.056316] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-17T01:53:35.056448] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-17T01:53:35.056976] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-17T01:53:35.057058] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-17T01:53:35.058170] [DEBUG] [LOCAL ] AIR: Trimmed 36942 records to 26867 (keeping 200 days of data) [2025-09-17T01:53:35.110576] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-17T01:53:35.221153] [DEBUG] [LOCAL ] AIR: Primary data saved (26867 records). [2025-09-17T01:53:35.221322] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-17T01:53:35.221418] [INFO ] [MAIN ] Update Progress: 69/2369 symbols completed. AIR took 37.1s. Estimated remaining: 5h 15m 47s. Rate: 7.3 symbols/min [2025-09-17T01:53:35.388835] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:35.393114] [DEBUG] [LOCAL ] AIZN: Loaded 2643 existing records from primary storage. [2025-09-17T01:53:35.393230] [INFO ] [MAIN ] AIZN: Loaded 2643 existing records. [2025-09-17T01:53:35.572402] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:53:35.572605] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-17T01:53:35.572680] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-17T01:53:35.572926] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-17T01:53:35.572984] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-17T01:53:35.894497] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-17T01:53:35.936778] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:35.956935] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T01:53:36.690128] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-17T01:53:36.816762] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T01:53:37.230003] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T01:53:37.490118] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-11. [2025-09-17T01:53:37.799097] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-17T01:53:38.109354] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T01:53:38.290167] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-17T01:53:39.090123] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-17T01:53:39.450069] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T01:53:39.455744] [INFO ] [REMOTE ] AIV: Full fetch complete (51925 records). [2025-09-17T01:53:39.455905] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-17T01:53:39.645800] [WARN ] [VALIDATOR ] AIV: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T01:53:39.646382] [FATAL] [MAIN ] AIV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:53:39.646451] [WARN ] [MAIN ] AIV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:53:39.646500] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-17T01:53:39.646573] [DEBUG] [LOCAL ] AIV: No primary data file found to delete. [2025-09-17T01:53:39.646614] [INFO ] [LOCAL ] AIV: Starting deletion of derivative data. [2025-09-17T01:53:39.647066] [DEBUG] [LOCAL ] AIV: Deleted derivative data file. [2025-09-17T01:53:39.647168] [INFO ] [MAIN ] Update Progress: 70/2369 symbols completed. AIV took 33.4s. Estimated remaining: 5h 13m 33s. Rate: 7.3 symbols/min [2025-09-17T01:53:39.815515] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:39.852435] [DEBUG] [LOCAL ] AJG: Loaded 34554 existing records from primary storage. [2025-09-17T01:53:39.852596] [INFO ] [MAIN ] AJG: Loaded 34554 existing records. [2025-09-17T01:53:39.895187] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-17T01:53:40.035206] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:53:40.035440] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-17T01:53:40.035499] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-17T01:53:40.036480] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-17T01:53:40.036553] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-17T01:53:40.397505] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:40.418432] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T01:53:40.541394] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T01:53:40.690096] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-11. [2025-09-17T01:53:41.490156] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-17T01:53:42.081736] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T01:53:42.168783] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T01:53:42.290120] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-17T01:53:43.090123] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-17T01:53:43.253318] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T01:53:43.256350] [INFO ] [REMOTE ] AIT: Full fetch complete (39649 records). [2025-09-17T01:53:43.256480] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-17T01:53:43.643513] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-17T01:53:43.643659] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-17T01:53:43.644153] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-17T01:53:43.644216] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-17T01:53:43.645319] [DEBUG] [LOCAL ] AIT: Trimmed 39649 records to 28542 (keeping 200 days of data) [2025-09-17T01:53:43.827521] [DEBUG] [LOCAL ] AIT: Primary data saved (28542 records). [2025-09-17T01:53:43.827698] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-17T01:53:43.827789] [INFO ] [MAIN ] Update Progress: 71/2369 symbols completed. AIT took 44.2s. Estimated remaining: 5h 11m 16s. Rate: 7.4 symbols/min [2025-09-17T01:53:43.895221] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-17T01:53:44.013500] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:44.013788] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-17T01:53:44.013855] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-17T01:53:44.013985] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-17T01:53:44.014044] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-17T01:53:44.014101] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-17T01:53:44.014148] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-17T01:53:44.381971] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:44.403019] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T01:53:44.690136] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-17T01:53:45.010747] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-17T01:53:45.490149] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-17T01:53:45.794615] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T01:53:46.100373] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T01:53:46.290129] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-11. [2025-09-17T01:53:46.783689] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T01:53:47.090135] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-17T01:53:47.890145] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-17T01:53:48.690137] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-17T01:53:48.946557] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T01:53:49.140033] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T01:53:49.261065] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T01:53:49.490124] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-17T01:53:50.290137] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-17T01:53:51.090120] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-17T01:53:51.287127] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T01:53:51.316475] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T01:53:51.679428] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T01:53:51.890117] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-17T01:53:52.690095] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-17T01:53:52.799043] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T01:53:52.802630] [INFO ] [REMOTE ] AIZ: Full fetch complete (42961 records). [2025-09-17T01:53:52.802775] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-17T01:53:53.182656] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-17T01:53:53.182756] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-17T01:53:53.183226] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-17T01:53:53.183278] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-17T01:53:53.184268] [DEBUG] [LOCAL ] AIZ: Trimmed 42961 records to 30481 (keeping 200 days of data) [2025-09-17T01:53:53.285473] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T01:53:53.391378] [DEBUG] [LOCAL ] AIZ: Primary data saved (30481 records). [2025-09-17T01:53:53.391553] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-17T01:53:53.391655] [INFO ] [MAIN ] Update Progress: 72/2369 symbols completed. AIZ took 29.1s. Estimated remaining: 5h 11m 53s. Rate: 7.4 symbols/min [2025-09-17T01:53:53.491322] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-17T01:53:53.564203] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:53:53.598984] [DEBUG] [LOCAL ] AKR: Loaded 34176 existing records from primary storage. [2025-09-17T01:53:53.599172] [INFO ] [MAIN ] AKR: Loaded 34176 existing records. [2025-09-17T01:53:53.775776] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:53:53.776018] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-17T01:53:53.776075] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-17T01:53:53.776936] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-17T01:53:53.777001] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-17T01:53:54.128269] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:53:54.131563] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T01:53:54.290139] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-17T01:53:55.090137] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-17T01:53:55.564217] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T01:53:55.814301] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T01:53:55.890118] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-17T01:53:56.690129] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-17T01:53:57.162388] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T01:53:57.490119] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-11. [2025-09-17T01:53:57.805632] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T01:53:58.290134] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-17T01:53:58.601510] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-17T01:53:59.074055] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T01:53:59.090072] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-17T01:53:59.890141] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-17T01:54:00.242984] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T01:54:00.468730] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T01:54:00.690186] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-17T01:54:01.490181] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-17T01:54:02.290180] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-17T01:54:03.074490] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-17T01:54:03.090072] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-17T01:54:03.890133] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-17T01:54:04.299119] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T01:54:04.690243] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-17T01:54:05.121295] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T01:54:05.195880] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T01:54:05.466967] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (3.98 seconds). [2025-09-17T01:54:05.491695] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-17T01:54:05.503913] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-17T01:54:05.854892] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-17T01:54:06.290191] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-17T01:54:07.090178] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-17T01:54:07.652058] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T01:54:07.898039] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-17T01:54:07.917006] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T01:54:08.259563] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T01:54:08.260636] [INFO ] [REMOTE ] AIZN: Full fetch complete (5705 records). [2025-09-17T01:54:08.260748] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-17T01:54:08.631352] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-17T01:54:08.631552] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-17T01:54:08.631743] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-17T01:54:08.631794] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-17T01:54:08.632211] [DEBUG] [LOCAL ] AIZN: Trimmed 5705 records to 3961 (keeping 200 days of data) [2025-09-17T01:54:08.656815] [DEBUG] [LOCAL ] AIZN: Primary data saved (3961 records). [2025-09-17T01:54:08.656985] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-17T01:54:08.657085] [INFO ] [MAIN ] Update Progress: 73/2369 symbols completed. AIZN took 33.4s. Estimated remaining: 5h 15m 29s. Rate: 7.3 symbols/min [2025-09-17T01:54:08.695213] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-17T01:54:08.833672] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:08.867089] [DEBUG] [LOCAL ] AL: Loaded 32517 existing records from primary storage. [2025-09-17T01:54:08.867272] [INFO ] [MAIN ] AL: Loaded 32517 existing records. [2025-09-17T01:54:09.044886] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:09.045164] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-17T01:54:09.045225] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-17T01:54:09.046152] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-17T01:54:09.046215] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-17T01:54:09.408043] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:09.490133] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-17T01:54:10.290160] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-17T01:54:10.359199] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T01:54:10.663233] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-17T01:54:11.090204] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-11. [2025-09-17T01:54:11.266349] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T01:54:11.890218] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-17T01:54:12.355901] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T01:54:12.690200] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-17T01:54:13.038895] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T01:54:13.039746] [INFO ] [REMOTE ] AKA: Full fetch complete (2476 records). [2025-09-17T01:54:13.039856] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-17T01:54:13.220574] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T01:54:13.220813] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:54:13.220882] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:54:13.220945] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-17T01:54:13.221044] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-17T01:54:13.221108] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-17T01:54:13.221183] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-17T01:54:13.221278] [INFO ] [MAIN ] Update Progress: 74/2369 symbols completed. AKA took 29.4s. Estimated remaining: 5h 13m 27s. Rate: 7.3 symbols/min [2025-09-17T01:54:13.388007] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:13.428725] [DEBUG] [LOCAL ] ALB: Loaded 39803 existing records from primary storage. [2025-09-17T01:54:13.428916] [INFO ] [MAIN ] ALB: Loaded 39803 existing records. [2025-09-17T01:54:13.495243] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-17T01:54:13.615330] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:13.615775] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-17T01:54:13.615854] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-17T01:54:13.616925] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-17T01:54:13.616994] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-17T01:54:14.034959] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:14.028309] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T01:54:14.290182] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-17T01:54:15.090195] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-17T01:54:15.789332] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-17T01:54:15.890128] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-17T01:54:16.690137] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-11. [2025-09-17T01:54:16.753784] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-17T01:54:17.405833] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T01:54:17.490117] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-17T01:54:17.538339] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-17T01:54:18.290193] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-17T01:54:18.871995] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-11 (2.18 seconds). [2025-09-17T01:54:18.963854] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T01:54:19.090152] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-17T01:54:19.790189] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T01:54:19.796159] [INFO ] [REMOTE ] AJG: Full fetch complete (69527 records). [2025-09-17T01:54:19.796337] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-17T01:54:19.895226] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-17T01:54:20.196257] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-17T01:54:20.196381] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-17T01:54:20.197096] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-17T01:54:20.197200] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-17T01:54:20.198867] [DEBUG] [LOCAL ] AJG: Trimmed 69527 records to 47178 (keeping 200 days of data) [2025-09-17T01:54:20.456611] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T01:54:20.536931] [DEBUG] [LOCAL ] AJG: Primary data saved (47178 records). [2025-09-17T01:54:20.537090] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-17T01:54:20.537180] [INFO ] [MAIN ] Update Progress: 75/2369 symbols completed. AJG took 40.9s. Estimated remaining: 5h 12m 52s. Rate: 7.3 symbols/min [2025-09-17T01:54:20.703515] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-17T01:54:20.706428] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:20.747880] [DEBUG] [LOCAL ] ALC: Loaded 37854 existing records from primary storage. [2025-09-17T01:54:20.748092] [INFO ] [MAIN ] ALC: Loaded 37854 existing records. [2025-09-17T01:54:20.929694] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:20.929960] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-17T01:54:20.930023] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-17T01:54:20.930911] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-17T01:54:20.930974] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-17T01:54:21.293493] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:21.497988] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-17T01:54:21.515558] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T01:54:22.176426] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T01:54:22.290179] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-17T01:54:23.090113] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-11. [2025-09-17T01:54:23.460895] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T01:54:23.890135] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-17T01:54:23.995710] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T01:54:24.690151] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-17T01:54:24.746225] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T01:54:25.490162] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-17T01:54:25.952532] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T01:54:26.054399] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T01:54:26.290133] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-17T01:54:27.090142] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-17T01:54:27.195481] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T01:54:27.890171] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-17T01:54:28.132702] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T01:54:28.698819] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-17T01:54:28.704072] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T01:54:29.240980] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T01:54:29.490136] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-17T01:54:29.920880] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T01:54:29.926461] [INFO ] [REMOTE ] AKR: Full fetch complete (65075 records). [2025-09-17T01:54:29.926689] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-17T01:54:30.292225] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-17T01:54:30.322093] [DEBUG] [VALIDATOR ] AKR: All expected trading days are present. [2025-09-17T01:54:30.322190] [DEBUG] [VALIDATOR ] AKR: Primary data validation passed. [2025-09-17T01:54:30.322868] [INFO ] [MAIN ] AKR: Fetched primary data is valid. [2025-09-17T01:54:30.322938] [DEBUG] [LOCAL ] AKR: Saving primary data. [2025-09-17T01:54:30.324458] [DEBUG] [LOCAL ] AKR: Trimmed 65075 records to 45615 (keeping 200 days of data) [2025-09-17T01:54:30.596697] [DEBUG] [LOCAL ] AKR: Primary data saved (45615 records). [2025-09-17T01:54:30.596867] [INFO ] [MAIN ] AKR: Full history saved. [2025-09-17T01:54:30.596978] [INFO ] [MAIN ] Update Progress: 76/2369 symbols completed. AKR took 37.2s. Estimated remaining: 5h 13m 40s. Rate: 7.3 symbols/min [2025-09-17T01:54:30.770029] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:30.791950] [DEBUG] [LOCAL ] ALE: Loaded 22661 existing records from primary storage. [2025-09-17T01:54:30.792107] [INFO ] [MAIN ] ALE: Loaded 22661 existing records. [2025-09-17T01:54:30.970342] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:30.970922] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-17T01:54:30.971049] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-17T01:54:30.971803] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-17T01:54:30.971870] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-17T01:54:31.093216] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-17T01:54:31.276230] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T01:54:31.368427] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:31.890110] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-11. [2025-09-17T01:54:32.380445] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T01:54:32.690168] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-17T01:54:32.880590] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T01:54:32.992467] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T01:54:33.490214] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-17T01:54:34.290201] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-17T01:54:34.541435] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T01:54:35.073028] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T01:54:35.090082] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-17T01:54:35.514721] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T01:54:35.890154] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-17T01:54:36.603798] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T01:54:36.690113] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-17T01:54:37.490184] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-17T01:54:38.023567] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T01:54:38.290184] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-17T01:54:38.504683] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T01:54:38.651996] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T01:54:38.658216] [INFO ] [REMOTE ] AL: Full fetch complete (61520 records). [2025-09-17T01:54:38.658364] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-17T01:54:39.049023] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-17T01:54:39.049153] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-17T01:54:39.049877] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-17T01:54:39.049971] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-17T01:54:39.051340] [DEBUG] [LOCAL ] AL: Trimmed 61520 records to 43858 (keeping 200 days of data) [2025-09-17T01:54:39.107637] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-17T01:54:39.318241] [DEBUG] [LOCAL ] AL: Primary data saved (43858 records). [2025-09-17T01:54:39.318406] [INFO ] [MAIN ] AL: Full history saved. [2025-09-17T01:54:39.318529] [INFO ] [MAIN ] Update Progress: 77/2369 symbols completed. AL took 30.7s. Estimated remaining: 5h 13m 47s. Rate: 7.3 symbols/min [2025-09-17T01:54:39.586929] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T01:54:39.890196] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-17T01:54:40.690231] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-17T01:54:40.830983] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T01:54:41.490117] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-17T01:54:41.778919] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T01:54:41.868508] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T01:54:42.290127] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-17T01:54:43.061936] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T01:54:43.090072] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-17T01:54:43.452472] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T01:54:43.890142] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-17T01:54:44.523410] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T01:54:44.690140] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-17T01:54:45.281880] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T01:54:45.490141] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-17T01:54:46.290164] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-17T01:54:46.452498] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T01:54:46.752882] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T01:54:47.090186] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-17T01:54:47.890149] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-17T01:54:48.402339] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T01:54:48.428563] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T01:54:48.690140] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-17T01:54:49.490186] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-17T01:54:49.712459] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T01:54:50.290149] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-17T01:54:50.886681] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T01:54:51.049799] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T01:54:51.090074] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-17T01:54:51.890113] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-17T01:54:51.969865] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T01:54:51.976141] [INFO ] [REMOTE ] ALC: Full fetch complete (72294 records). [2025-09-17T01:54:51.976274] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-17T01:54:52.364635] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-17T01:54:52.364786] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-17T01:54:52.365555] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-17T01:54:52.365635] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-17T01:54:52.367271] [DEBUG] [LOCAL ] ALC: Trimmed 72294 records to 50818 (keeping 200 days of data) [2025-09-17T01:54:52.669405] [DEBUG] [LOCAL ] ALC: Primary data saved (50818 records). [2025-09-17T01:54:52.669567] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-17T01:54:52.669706] [INFO ] [MAIN ] Update Progress: 78/2369 symbols completed. ALC took 32.1s. Estimated remaining: 5h 16m 10s. Rate: 7.2 symbols/min [2025-09-17T01:54:52.873989] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T01:54:52.882068] [INFO ] [REMOTE ] ALB: Full fetch complete (76627 records). [2025-09-17T01:54:52.882243] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-17T01:54:53.269387] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-17T01:54:53.269496] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-17T01:54:53.270264] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-17T01:54:53.270329] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-17T01:54:53.271819] [DEBUG] [LOCAL ] ALB: Trimmed 76627 records to 53258 (keeping 200 days of data) [2025-09-17T01:54:53.396668] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T01:54:53.406693] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-17T01:54:53.636252] [DEBUG] [LOCAL ] ALB: Primary data saved (53258 records). [2025-09-17T01:54:53.636418] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-17T01:54:53.636518] [INFO ] [MAIN ] Update Progress: 79/2369 symbols completed. ALB took 40.4s. Estimated remaining: 5h 12m 30s. Rate: 7.3 symbols/min [2025-09-17T01:54:54.740606] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T01:54:54.745058] [INFO ] [REMOTE ] ALE: Full fetch complete (41520 records). [2025-09-17T01:54:54.745223] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-17T01:54:55.118049] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-17T01:54:55.118173] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-17T01:54:55.118744] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-17T01:54:55.118813] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-17T01:54:55.119813] [DEBUG] [LOCAL ] ALE: Trimmed 41520 records to 29897 (keeping 200 days of data) [2025-09-17T01:54:55.303540] [DEBUG] [LOCAL ] ALE: Primary data saved (29897 records). [2025-09-17T01:54:55.303728] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-17T01:54:55.303827] [INFO ] [MAIN ] Update Progress: 80/2369 symbols completed. ALE took 24.7s. Estimated remaining: 5h 9m 15s. Rate: 7.4 symbols/min [2025-09-17T01:54:55.895797] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:55.936103] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:56.015991] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:56.014116] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:54:56.016391] [DEBUG] [LOCAL ] ALK: No existing data file found in primary storage. [2025-09-17T01:54:56.016820] [WARN ] [MAIN ] ALK: No existing data found, performing full refresh instead. [2025-09-17T01:54:56.017120] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-17T01:54:56.017228] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-17T01:54:56.017392] [DEBUG] [LOCAL ] ALK: No primary data file found to delete. [2025-09-17T01:54:56.017455] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-17T01:54:56.167145] [DEBUG] [LOCAL ] ALEX: Loaded 22072 existing records from primary storage. [2025-09-17T01:54:56.161369] [DEBUG] [LOCAL ] ALG: Loaded 7360 existing records from primary storage. [2025-09-17T01:54:56.211767] [INFO ] [MAIN ] ALEX: Loaded 22072 existing records. [2025-09-17T01:54:56.233094] [INFO ] [MAIN ] ALG: Loaded 7360 existing records. [2025-09-17T01:54:56.435209] [DEBUG] [LOCAL ] ALIT: Loaded 39226 existing records from primary storage. [2025-09-17T01:54:56.508168] [INFO ] [MAIN ] ALIT: Loaded 39226 existing records. [2025-09-17T01:54:56.833041] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:56.827810] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:56.874673] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-11. [2025-09-17T01:54:56.903120] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-17T01:54:56.921249] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:56.939191] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-17T01:54:56.926746] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-17T01:54:56.961394] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-17T01:54:56.972079] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-17T01:54:57.002174] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:54:57.002678] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-17T01:54:57.002240] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-17T01:54:57.002744] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-17T01:54:57.002983] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-17T01:54:57.002913] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-17T01:54:57.087427] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-17T01:54:57.127432] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-17T01:54:57.981290] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:58.013200] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:58.024744] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-11. [2025-09-17T01:54:58.024963] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-11. [2025-09-17T01:54:58.104418] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:54:58.104770] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-11. [2025-09-17T01:54:58.780167] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T01:54:58.790230] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-17T01:54:58.960702] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T01:54:58.963542] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-17T01:54:59.297978] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T01:54:59.303870] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-17T01:54:59.499000] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T01:54:59.509403] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-17T01:55:00.049899] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T01:55:00.053395] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-17T01:55:00.441667] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T01:55:00.576465] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T01:55:00.690085] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-17T01:55:00.797765] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T01:55:01.459810] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T01:55:01.490185] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-17T01:55:02.290147] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-17T01:55:02.606587] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T01:55:03.090150] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-17T01:55:03.273828] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T01:55:03.318696] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T01:55:03.890171] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-17T01:55:04.690130] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-17T01:55:04.861782] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T01:55:05.490095] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-17T01:55:05.590154] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T01:55:05.615800] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T01:55:06.290149] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-17T01:55:07.090228] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-17T01:55:07.405638] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T01:55:07.890191] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-17T01:55:08.075212] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T01:55:08.101461] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T01:55:08.690131] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-17T01:55:09.490193] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-17T01:55:09.893307] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T01:55:10.128083] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T01:55:10.290150] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-17T01:55:10.493314] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T01:55:11.090148] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-17T01:55:11.890149] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-17T01:55:11.953355] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T01:55:12.162722] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T01:55:12.690192] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-17T01:55:13.360694] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T01:55:13.490097] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-17T01:55:13.573507] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T01:55:14.290189] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-17T01:55:14.824022] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T01:55:15.090158] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-17T01:55:15.890128] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-17T01:55:16.009339] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T01:55:16.434476] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T01:55:16.690132] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-17T01:55:17.296677] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T01:55:17.324152] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T01:55:17.490163] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-17T01:55:18.290136] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-17T01:55:19.090222] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-17T01:55:19.115041] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T01:55:19.212147] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T01:55:19.890190] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-17T01:55:20.670019] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T01:55:20.690078] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-17T01:55:21.086139] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T01:55:21.197773] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T01:55:21.200209] [INFO ] [REMOTE ] ALG: Full fetch complete (15835 records). [2025-09-17T01:55:21.200319] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-17T01:55:21.497781] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-17T01:55:21.589673] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-17T01:55:21.589784] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-17T01:55:21.590293] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-17T01:55:21.590383] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-17T01:55:21.591093] [DEBUG] [LOCAL ] ALG: Trimmed 15835 records to 10846 (keeping 200 days of data) [2025-09-17T01:55:21.663602] [DEBUG] [LOCAL ] ALG: Primary data saved (10846 records). [2025-09-17T01:55:21.663781] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-17T01:55:21.663885] [INFO ] [MAIN ] Update Progress: 81/2369 symbols completed. ALG took 26.4s. Estimated remaining: 5h 17m 42s. Rate: 7.2 symbols/min [2025-09-17T01:55:21.841168] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:55:21.884789] [DEBUG] [LOCAL ] ALL: Loaded 37086 existing records from primary storage. [2025-09-17T01:55:21.884978] [INFO ] [MAIN ] ALL: Loaded 37086 existing records. [2025-09-17T01:55:22.070201] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:55:22.070467] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-17T01:55:22.070528] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-17T01:55:22.071805] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-17T01:55:22.071883] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-17T01:55:22.298387] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-17T01:55:22.482041] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:55:22.899325] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T01:55:23.090146] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-11. [2025-09-17T01:55:23.729197] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T01:55:23.890128] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-17T01:55:24.690124] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-17T01:55:24.800421] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T01:55:25.293504] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T01:55:25.490293] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-17T01:55:26.290284] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-17T01:55:26.482764] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T01:55:26.730321] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T01:55:27.090167] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-17T01:55:27.890135] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-17T01:55:28.005673] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T01:55:28.620396] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T01:55:28.690089] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-17T01:55:29.007984] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T01:55:29.011900] [INFO ] [REMOTE ] ALEX: Full fetch complete (44192 records). [2025-09-17T01:55:29.012002] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-17T01:55:29.381629] [DEBUG] [VALIDATOR ] ALEX: All expected trading days are present. [2025-09-17T01:55:29.381747] [DEBUG] [VALIDATOR ] ALEX: Primary data validation passed. [2025-09-17T01:55:29.382223] [INFO ] [MAIN ] ALEX: Fetched primary data is valid. [2025-09-17T01:55:29.382277] [DEBUG] [LOCAL ] ALEX: Saving primary data. [2025-09-17T01:55:29.384345] [DEBUG] [LOCAL ] ALEX: Trimmed 44192 records to 31541 (keeping 200 days of data) [2025-09-17T01:55:29.490388] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-17T01:55:29.582058] [DEBUG] [LOCAL ] ALEX: Primary data saved (31541 records). [2025-09-17T01:55:29.582245] [INFO ] [MAIN ] ALEX: Full history saved. [2025-09-17T01:55:29.582352] [INFO ] [MAIN ] Update Progress: 82/2369 symbols completed. ALEX took 34.3s. Estimated remaining: 5h 17m 23s. Rate: 7.2 symbols/min [2025-09-17T01:55:29.750457] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:55:29.787820] [DEBUG] [LOCAL ] ALLE: Loaded 33163 existing records from primary storage. [2025-09-17T01:55:29.787982] [INFO ] [MAIN ] ALLE: Loaded 33163 existing records. [2025-09-17T01:55:29.965755] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:55:29.965966] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-17T01:55:29.966022] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-17T01:55:29.967128] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-17T01:55:29.967192] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-17T01:55:30.296371] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-17T01:55:30.323562] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:55:30.425166] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T01:55:30.431527] [INFO ] [REMOTE ] ALK: Full fetch complete (76545 records). [2025-09-17T01:55:30.431680] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-17T01:55:30.822746] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-17T01:55:30.822847] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-17T01:55:30.823589] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-17T01:55:30.823664] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-17T01:55:30.825255] [DEBUG] [LOCAL ] ALK: Trimmed 76545 records to 53061 (keeping 200 days of data) [2025-09-17T01:55:31.096444] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-11. [2025-09-17T01:55:31.141133] [DEBUG] [LOCAL ] ALK: Primary data saved (53061 records). [2025-09-17T01:55:31.141281] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-17T01:55:31.141395] [INFO ] [MAIN ] Update Progress: 83/2369 symbols completed. ALK took 35.8s. Estimated remaining: 5h 14m 8s. Rate: 7.3 symbols/min [2025-09-17T01:55:31.311066] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:55:31.348742] [DEBUG] [LOCAL ] ALLY: Loaded 39603 existing records from primary storage. [2025-09-17T01:55:31.348902] [INFO ] [MAIN ] ALLY: Loaded 39603 existing records. [2025-09-17T01:55:31.531973] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:55:31.532298] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-17T01:55:31.532454] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-17T01:55:31.542342] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-17T01:55:31.558614] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-17T01:55:31.640407] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T01:55:31.906349] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-17T01:55:31.946946] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:55:31.965866] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T01:55:31.973636] [INFO ] [REMOTE ] ALIT: Full fetch complete (76240 records). [2025-09-17T01:55:31.973840] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-17T01:55:32.384186] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-17T01:55:32.384348] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-17T01:55:32.385212] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-17T01:55:32.385286] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-17T01:55:32.386858] [DEBUG] [LOCAL ] ALIT: Trimmed 76240 records to 52733 (keeping 200 days of data) [2025-09-17T01:55:32.518518] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T01:55:32.703059] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-17T01:55:32.748576] [DEBUG] [LOCAL ] ALIT: Primary data saved (52733 records). [2025-09-17T01:55:32.748740] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-17T01:55:32.748844] [INFO ] [MAIN ] Update Progress: 84/2369 symbols completed. ALIT took 37.4s. Estimated remaining: 5h 10m 59s. Rate: 7.3 symbols/min [2025-09-17T01:55:32.924368] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:55:32.957294] [DEBUG] [LOCAL ] ALSN: Loaded 31728 existing records from primary storage. [2025-09-17T01:55:32.957468] [INFO ] [MAIN ] ALSN: Loaded 31728 existing records. [2025-09-17T01:55:33.133521] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:55:33.133825] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-17T01:55:33.133886] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-17T01:55:33.134833] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-17T01:55:33.134901] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-17T01:55:33.498386] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-11. [2025-09-17T01:55:33.502756] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:55:33.936508] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-17T01:55:34.062237] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T01:55:34.290172] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-11. [2025-09-17T01:55:35.041710] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T01:55:35.090157] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-17T01:55:35.853175] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T01:55:35.890117] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-17T01:55:36.656695] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T01:55:36.690109] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-17T01:55:37.423116] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T01:55:37.490131] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-17T01:55:38.290127] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-17T01:55:38.559856] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T01:55:38.881501] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T01:55:39.090130] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-17T01:55:39.859447] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T01:55:39.890086] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-17T01:55:40.413312] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T01:55:40.690155] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-17T01:55:41.495553] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-17T01:55:41.497902] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T01:55:42.040437] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T01:55:42.290212] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-17T01:55:42.854602] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T01:55:43.090118] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-17T01:55:43.890205] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-17T01:55:44.116325] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T01:55:44.690112] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-17T01:55:44.771515] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T01:55:45.490120] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-17T01:55:45.550188] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T01:55:46.290140] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-17T01:55:46.686593] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T01:55:46.991245] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T01:55:47.090105] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-17T01:55:47.797957] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T01:55:47.890116] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-17T01:55:48.552893] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T01:55:48.690088] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-17T01:55:49.490148] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-17T01:55:49.654679] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T01:55:50.290124] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-17T01:55:50.389892] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T01:55:50.912955] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T01:55:51.090126] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-17T01:55:51.824545] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T01:55:51.890099] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-17T01:55:52.315161] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T01:55:52.690121] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-17T01:55:53.490167] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-17T01:55:53.704812] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T01:55:54.290146] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-17T01:55:54.589778] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T01:55:55.090158] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-17T01:55:55.202449] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T01:55:55.667335] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T01:55:55.673302] [INFO ] [REMOTE ] ALLE: Full fetch complete (64926 records). [2025-09-17T01:55:55.673457] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-17T01:55:55.897259] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-17T01:55:56.076661] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-17T01:55:56.076782] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-17T01:55:56.077428] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-17T01:55:56.077484] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-17T01:55:56.079091] [DEBUG] [LOCAL ] ALLE: Trimmed 64926 records to 45257 (keeping 200 days of data) [2025-09-17T01:55:56.372818] [DEBUG] [LOCAL ] ALLE: Primary data saved (45257 records). [2025-09-17T01:55:56.372998] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-17T01:55:56.373096] [INFO ] [MAIN ] Update Progress: 85/2369 symbols completed. ALLE took 26.8s. Estimated remaining: 5h 17m 46s. Rate: 7.2 symbols/min [2025-09-17T01:55:56.542587] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:55:56.559552] [DEBUG] [LOCAL ] ALTG: Loaded 17512 existing records from primary storage. [2025-09-17T01:55:56.559725] [INFO ] [MAIN ] ALTG: Loaded 17512 existing records. [2025-09-17T01:55:56.698136] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-17T01:55:56.738320] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:55:56.738513] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-17T01:55:56.738596] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-17T01:55:56.739087] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-17T01:55:56.739146] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-17T01:55:57.114040] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:55:57.151113] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T01:55:57.303987] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T01:55:57.490126] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-17T01:55:58.290177] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-17T01:55:58.401395] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T01:55:59.057744] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T01:55:59.090226] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-17T01:55:59.890238] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-11. [2025-09-17T01:55:59.997193] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T01:56:00.004479] [INFO ] [REMOTE ] ALLY: Full fetch complete (76711 records). [2025-09-17T01:56:00.004757] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-17T01:56:00.416801] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-17T01:56:00.416982] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-17T01:56:00.418020] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-17T01:56:00.418107] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-17T01:56:00.420437] [DEBUG] [LOCAL ] ALLY: Trimmed 76711 records to 53217 (keeping 200 days of data) [2025-09-17T01:56:00.583906] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T01:56:00.692221] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-17T01:56:00.806798] [DEBUG] [LOCAL ] ALLY: Primary data saved (53217 records). [2025-09-17T01:56:00.806981] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-17T01:56:00.807087] [INFO ] [MAIN ] Update Progress: 86/2369 symbols completed. ALLY took 29.7s. Estimated remaining: 5h 15m 54s. Rate: 7.2 symbols/min [2025-09-17T01:56:00.979342] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:00.989296] [DEBUG] [LOCAL ] ALUR: Loaded 7366 existing records from primary storage. [2025-09-17T01:56:00.989443] [INFO ] [MAIN ] ALUR: Loaded 7366 existing records. [2025-09-17T01:56:01.128582] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T01:56:01.199194] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:56:01.199490] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-17T01:56:01.199586] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-17T01:56:01.200045] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-17T01:56:01.200121] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-17T01:56:01.495214] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-17T01:56:01.564048] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:02.290133] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-17T01:56:02.404853] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T01:56:02.410930] [INFO ] [REMOTE ] ALL: Full fetch complete (72307 records). [2025-09-17T01:56:02.411107] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-17T01:56:02.799652] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-17T01:56:02.799763] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-17T01:56:02.800474] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-17T01:56:02.800533] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-17T01:56:02.803775] [DEBUG] [LOCAL ] ALL: Trimmed 72307 records to 50196 (keeping 200 days of data) [2025-09-17T01:56:03.094689] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-11. [2025-09-17T01:56:03.127812] [DEBUG] [LOCAL ] ALL: Primary data saved (50196 records). [2025-09-17T01:56:03.127924] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-17T01:56:03.128009] [INFO ] [MAIN ] Update Progress: 87/2369 symbols completed. ALL took 41.5s. Estimated remaining: 5h 13m 9s. Rate: 7.3 symbols/min [2025-09-17T01:56:03.297314] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:03.333774] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T01:56:03.335442] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T01:56:03.379459] [DEBUG] [LOCAL ] ALV: Loaded 31077 existing records from primary storage. [2025-09-17T01:56:03.379629] [INFO ] [MAIN ] ALV: Loaded 31077 existing records. [2025-09-17T01:56:03.568262] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:56:03.568494] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-17T01:56:03.568553] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-17T01:56:03.569693] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-17T01:56:03.569774] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-17T01:56:03.894751] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-17T01:56:03.923438] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:03.936815] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T01:56:04.690149] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-11. [2025-09-17T01:56:05.490116] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-17T01:56:05.574686] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T01:56:06.290816] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-17T01:56:06.296859] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T01:56:06.878422] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T01:56:07.090129] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-17T01:56:07.876051] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T01:56:07.890084] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-17T01:56:08.266393] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T01:56:08.690134] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-17T01:56:09.290380] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T01:56:09.296150] [INFO ] [REMOTE ] ALSN: Full fetch complete (61646 records). [2025-09-17T01:56:09.296297] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-17T01:56:09.506756] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-17T01:56:09.548991] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T01:56:09.722105] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-17T01:56:09.722235] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-17T01:56:09.722918] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-17T01:56:09.722979] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-17T01:56:09.724353] [DEBUG] [LOCAL ] ALSN: Trimmed 61646 records to 43400 (keeping 200 days of data) [2025-09-17T01:56:09.997835] [DEBUG] [LOCAL ] ALSN: Primary data saved (43400 records). [2025-09-17T01:56:09.998130] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-17T01:56:09.998226] [INFO ] [MAIN ] Update Progress: 88/2369 symbols completed. ALSN took 37.2s. Estimated remaining: 5h 12m 25s. Rate: 7.3 symbols/min [2025-09-17T01:56:10.166500] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:10.173228] [DEBUG] [LOCAL ] ALX: Loaded 5247 existing records from primary storage. [2025-09-17T01:56:10.173341] [INFO ] [MAIN ] ALX: Loaded 5247 existing records. [2025-09-17T01:56:10.295301] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-17T01:56:10.351588] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:56:10.351906] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-17T01:56:10.351964] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-17T01:56:10.352423] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-17T01:56:10.352481] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-17T01:56:10.712403] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:11.045446] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T01:56:11.090141] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-17T01:56:11.491908] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T01:56:11.890182] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-17T01:56:12.655216] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T01:56:12.690093] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-17T01:56:13.228140] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T01:56:13.490164] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-11. [2025-09-17T01:56:13.850108] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T01:56:14.290149] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-17T01:56:14.465991] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T01:56:15.090126] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-17T01:56:15.597977] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T01:56:15.890120] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-17T01:56:16.517374] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T01:56:16.646971] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T01:56:16.690110] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-17T01:56:17.490168] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-17T01:56:17.727061] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T01:56:18.290129] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-17T01:56:19.081039] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T01:56:19.090069] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-17T01:56:19.348849] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T01:56:19.890140] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-17T01:56:20.669614] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T01:56:20.690073] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-17T01:56:20.728014] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T01:56:21.490157] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-17T01:56:22.290209] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-17T01:56:22.421239] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T01:56:22.477045] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T01:56:23.090166] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-17T01:56:23.152009] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T01:56:23.890161] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-17T01:56:24.575728] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T01:56:24.690122] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-17T01:56:25.162040] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T01:56:25.490148] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-17T01:56:25.854184] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T01:56:25.905849] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T01:56:26.290159] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-17T01:56:27.090140] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-17T01:56:27.130097] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T01:56:27.890089] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-17T01:56:27.989280] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T01:56:28.690121] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-17T01:56:28.876378] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T01:56:29.490141] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-17T01:56:30.083959] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T01:56:30.089173] [INFO ] [REMOTE ] ALV: Full fetch complete (61879 records). [2025-09-17T01:56:30.089335] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-17T01:56:30.298123] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-17T01:56:30.502754] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-17T01:56:30.502893] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-17T01:56:30.503557] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-17T01:56:30.503618] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-17T01:56:30.505114] [DEBUG] [LOCAL ] ALV: Trimmed 61879 records to 42973 (keeping 200 days of data) [2025-09-17T01:56:30.612128] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T01:56:30.617238] [INFO ] [REMOTE ] ALTG: Full fetch complete (33529 records). [2025-09-17T01:56:30.620387] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-17T01:56:30.832871] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T01:56:31.111783] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-17T01:56:31.166820] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-17T01:56:31.169034] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-17T01:56:31.173485] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-17T01:56:31.175917] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-17T01:56:31.196752] [DEBUG] [LOCAL ] ALTG: Trimmed 33529 records to 24291 (keeping 200 days of data) [2025-09-17T01:56:31.200765] [DEBUG] [LOCAL ] ALV: Primary data saved (42973 records). [2025-09-17T01:56:31.201135] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-17T01:56:31.201235] [INFO ] [MAIN ] Update Progress: 89/2369 symbols completed. ALV took 28.1s. Estimated remaining: 5h 17m 50s. Rate: 7.2 symbols/min [2025-09-17T01:56:31.466525] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:31.516162] [DEBUG] [LOCAL ] ALTG: Primary data saved (24291 records). [2025-09-17T01:56:31.516340] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-17T01:56:31.516445] [INFO ] [MAIN ] Update Progress: 90/2369 symbols completed. ALTG took 35.1s. Estimated remaining: 5h 14m 18s. Rate: 7.3 symbols/min [2025-09-17T01:56:31.642775] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T01:56:31.714569] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:31.715414] [DEBUG] [LOCAL ] AM: Loaded 38636 existing records from primary storage. [2025-09-17T01:56:31.715554] [INFO ] [MAIN ] AM: Loaded 38636 existing records. [2025-09-17T01:56:31.715593] [DEBUG] [LOCAL ] AMBC: No existing data file found in primary storage. [2025-09-17T01:56:31.757458] [WARN ] [MAIN ] AMBC: No existing data found, performing full refresh instead. [2025-09-17T01:56:31.804409] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-17T01:56:31.814926] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-17T01:56:31.815019] [DEBUG] [LOCAL ] AMBC: No primary data file found to delete. [2025-09-17T01:56:31.815309] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-17T01:56:31.896325] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-17T01:56:31.977092] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:56:31.994407] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-17T01:56:31.994586] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-17T01:56:32.000754] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-17T01:56:32.021568] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-17T01:56:32.512963] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:32.535396] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T01:56:32.638691] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:32.690120] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-11. [2025-09-17T01:56:33.490137] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-17T01:56:34.268901] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T01:56:34.290138] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-17T01:56:34.505790] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T01:56:34.848142] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T01:56:34.849360] [INFO ] [REMOTE ] ALUR: Full fetch complete (21853 records). [2025-09-17T01:56:34.849446] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-17T01:56:35.095309] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-17T01:56:35.220224] [DEBUG] [VALIDATOR ] ALUR: All expected trading days are present. [2025-09-17T01:56:35.220326] [DEBUG] [VALIDATOR ] ALUR: Primary data validation passed. [2025-09-17T01:56:35.220745] [INFO ] [MAIN ] ALUR: Fetched primary data is valid. [2025-09-17T01:56:35.220826] [DEBUG] [LOCAL ] ALUR: Saving primary data. [2025-09-17T01:56:35.221421] [DEBUG] [LOCAL ] ALUR: Trimmed 21853 records to 11175 (keeping 200 days of data) [2025-09-17T01:56:35.284544] [DEBUG] [LOCAL ] ALUR: Primary data saved (11175 records). [2025-09-17T01:56:35.284694] [INFO ] [MAIN ] ALUR: Full history saved. [2025-09-17T01:56:35.284789] [INFO ] [MAIN ] Update Progress: 91/2369 symbols completed. ALUR took 34.5s. Estimated remaining: 5h 12m 16s. Rate: 7.3 symbols/min [2025-09-17T01:56:35.458760] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:35.490337] [DEBUG] [LOCAL ] AMBP: Loaded 33802 existing records from primary storage. [2025-09-17T01:56:35.490509] [INFO ] [MAIN ] AMBP: Loaded 33802 existing records. [2025-09-17T01:56:35.671786] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:56:35.672071] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-17T01:56:35.672147] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-17T01:56:35.672971] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-17T01:56:35.673039] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-17T01:56:35.782147] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T01:56:35.895290] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-11. [2025-09-17T01:56:36.051110] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:36.690169] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-11. [2025-09-17T01:56:37.320387] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T01:56:37.490166] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-17T01:56:38.265048] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T01:56:38.290090] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-17T01:56:38.344827] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T01:56:39.090168] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-17T01:56:39.890151] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-17T01:56:40.119796] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T01:56:40.318569] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T01:56:40.690146] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-17T01:56:41.490172] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-17T01:56:41.559102] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T01:56:42.290092] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-17T01:56:42.330853] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T01:56:42.430239] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T01:56:43.090142] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-17T01:56:43.653599] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T01:56:43.890163] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-17T01:56:44.638454] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T01:56:44.690090] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-17T01:56:45.340258] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T01:56:45.490080] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-17T01:56:46.108447] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T01:56:46.290140] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-17T01:56:47.090133] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-17T01:56:47.198181] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T01:56:47.348118] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T01:56:47.550338] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T01:56:47.890125] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-17T01:56:48.690190] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-17T01:56:48.893694] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T01:56:49.490156] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-17T01:56:49.548443] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T01:56:50.290152] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-17T01:56:51.090157] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-17T01:56:51.413478] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T01:56:51.802223] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T01:56:51.890325] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-17T01:56:52.647478] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T01:56:52.690088] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-17T01:56:53.455187] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T01:56:53.490113] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-17T01:56:53.659989] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T01:56:54.023992] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T01:56:54.290146] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-17T01:56:55.090146] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-17T01:56:55.350690] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T01:56:55.354703] [INFO ] [REMOTE ] AMBC: Full fetch complete (50978 records). [2025-09-17T01:56:55.354812] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-17T01:56:55.737355] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-17T01:56:55.737459] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-17T01:56:55.738005] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-17T01:56:55.738073] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-17T01:56:55.739226] [DEBUG] [LOCAL ] AMBC: Trimmed 50978 records to 37826 (keeping 200 days of data) [2025-09-17T01:56:55.893143] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-17T01:56:55.954991] [DEBUG] [LOCAL ] AMBC: Primary data saved (37826 records). [2025-09-17T01:56:55.955186] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-17T01:56:55.955283] [INFO ] [MAIN ] Update Progress: 92/2369 symbols completed. AMBC took 24.4s. Estimated remaining: 5h 17m 16s. Rate: 7.2 symbols/min [2025-09-17T01:56:56.125955] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:56:56.126187] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-17T01:56:56.126241] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-17T01:56:56.126356] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-17T01:56:56.126429] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-17T01:56:56.126478] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-17T01:56:56.126518] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-17T01:56:56.493111] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:56:56.702928] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-17T01:56:56.705787] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T01:56:57.266304] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T01:56:57.490159] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-17T01:56:57.623290] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T01:56:58.290181] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-17T01:56:59.090193] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-17T01:56:59.225416] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T01:56:59.737082] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T01:56:59.738535] [INFO ] [REMOTE ] ALX: Full fetch complete (6564 records). [2025-09-17T01:56:59.738618] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-17T01:56:59.894591] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-11. [2025-09-17T01:57:00.105838] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-17T01:57:00.105992] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-17T01:57:00.106235] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-17T01:57:00.106301] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-17T01:57:00.107031] [DEBUG] [LOCAL ] ALX: Trimmed 6564 records to 5730 (keeping 200 days of data) [2025-09-17T01:57:00.166487] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T01:57:00.183799] [DEBUG] [LOCAL ] ALX: Primary data saved (5730 records). [2025-09-17T01:57:00.183940] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-17T01:57:00.184055] [INFO ] [MAIN ] Update Progress: 93/2369 symbols completed. ALX took 50.2s. Estimated remaining: 5h 15m 27s. Rate: 7.2 symbols/min [2025-09-17T01:57:00.249054] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:00.266115] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-11 [2025-09-17T01:57:00.357810] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:00.398502] [DEBUG] [LOCAL ] AMC: Loaded 40123 existing records from primary storage. [2025-09-17T01:57:00.398708] [INFO ] [MAIN ] AMC: Loaded 40123 existing records. [2025-09-17T01:57:00.581393] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:00.581677] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-17T01:57:00.581740] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-17T01:57:00.582743] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-17T01:57:00.582809] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-17T01:57:00.695206] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-17T01:57:00.963184] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:01.490165] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-11. [2025-09-17T01:57:02.290154] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-17T01:57:02.735515] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T01:57:03.090163] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-17T01:57:03.393032] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:03.393403] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-17T01:57:03.890145] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-17T01:57:04.258787] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:04.270912] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-17T01:57:04.272335] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-11 (2.78 seconds). [2025-09-17T01:57:04.690169] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-17T01:57:05.500977] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-17T01:57:05.506896] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-17T01:57:05.734793] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:05.735120] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-17T01:57:06.290184] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-17T01:57:07.090130] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-17T01:57:07.280479] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-17T01:57:07.890133] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-17T01:57:08.001781] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T01:57:08.425267] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T01:57:08.690134] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-17T01:57:09.490148] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-17T01:57:09.723237] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:09.723586] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-17T01:57:09.917180] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T01:57:10.295927] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-17T01:57:10.321658] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T01:57:10.541346] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:10.541708] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-17T01:57:11.090133] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-17T01:57:11.302426] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:11.302803] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-17T01:57:11.890158] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-17T01:57:12.690160] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-17T01:57:13.311572] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T01:57:13.317053] [INFO ] [REMOTE ] AMBP: Full fetch complete (65862 records). [2025-09-17T01:57:13.317245] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-17T01:57:13.498034] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-17T01:57:13.717625] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-17T01:57:13.717764] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-17T01:57:13.718417] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-17T01:57:13.718473] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-17T01:57:13.719755] [DEBUG] [LOCAL ] AMBP: Trimmed 65862 records to 45373 (keeping 200 days of data) [2025-09-17T01:57:13.813365] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:57:13.814718] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-17T01:57:13.981761] [DEBUG] [LOCAL ] AMBP: Primary data saved (45373 records). [2025-09-17T01:57:13.981923] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-17T01:57:13.982016] [INFO ] [MAIN ] Update Progress: 94/2369 symbols completed. AMBP took 38.7s. Estimated remaining: 5h 17m 31s. Rate: 7.2 symbols/min [2025-09-17T01:57:14.154772] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:14.191568] [DEBUG] [LOCAL ] AMCR: Loaded 40022 existing records from primary storage. [2025-09-17T01:57:14.191764] [INFO ] [MAIN ] AMCR: Loaded 40022 existing records. [2025-09-17T01:57:14.296221] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-17T01:57:14.382309] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:14.382607] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-17T01:57:14.382693] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-17T01:57:14.383717] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-17T01:57:14.383780] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-17T01:57:14.746160] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:14.774482] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T01:57:14.944457] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T01:57:15.090145] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-17T01:57:15.890147] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-17T01:57:16.088970] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T01:57:16.690131] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-17T01:57:17.395040] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T01:57:17.401541] [INFO ] [REMOTE ] AM: Full fetch complete (75445 records). [2025-09-17T01:57:17.401741] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-17T01:57:17.495197] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-17T01:57:17.810109] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-17T01:57:17.810245] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-17T01:57:17.810994] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-17T01:57:17.811053] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-17T01:57:17.812613] [DEBUG] [LOCAL ] AM: Trimmed 75445 records to 52184 (keeping 200 days of data) [2025-09-17T01:57:18.130452] [DEBUG] [LOCAL ] AM: Primary data saved (52184 records). [2025-09-17T01:57:18.130662] [INFO ] [MAIN ] AM: Full history saved. [2025-09-17T01:57:18.131738] [INFO ] [MAIN ] Update Progress: 95/2369 symbols completed. AM took 46.9s. Estimated remaining: 5h 15m 42s. Rate: 7.2 symbols/min [2025-09-17T01:57:18.301771] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-11. [2025-09-17T01:57:18.304347] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:18.346443] [DEBUG] [LOCAL ] AME: Loaded 36016 existing records from primary storage. [2025-09-17T01:57:18.346594] [INFO ] [MAIN ] AME: Loaded 36016 existing records. [2025-09-17T01:57:18.526902] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:18.527313] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-17T01:57:18.527460] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-17T01:57:18.535570] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-17T01:57:18.536125] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-17T01:57:18.536425] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T01:57:18.614087] [INFO ] [REMOTE ] AMBQ: Full fetch complete (6990 records). [2025-09-17T01:57:18.637947] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-17T01:57:18.999052] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 34 unique days, need 200 days [2025-09-17T01:57:18.999562] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:57:19.010152] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:57:19.020489] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-17T01:57:19.051601] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-17T01:57:19.079444] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:19.079527] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-17T01:57:19.079955] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-17T01:57:19.080052] [INFO ] [MAIN ] Update Progress: 96/2369 symbols completed. AMBQ took 23.1s. Estimated remaining: 5h 12m 39s. Rate: 7.3 symbols/min [2025-09-17T01:57:19.111819] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-11. [2025-09-17T01:57:19.255063] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:19.270851] [DEBUG] [LOCAL ] AMG: Loaded 14556 existing records from primary storage. [2025-09-17T01:57:19.270991] [INFO ] [MAIN ] AMG: Loaded 14556 existing records. [2025-09-17T01:57:19.453065] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:19.453352] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-17T01:57:19.453440] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-17T01:57:19.454003] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-17T01:57:19.454073] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-17T01:57:19.828060] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:19.858780] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (3.17 seconds). [2025-09-17T01:57:19.890099] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-17T01:57:20.351257] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T01:57:20.569423] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T01:57:20.690105] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-17T01:57:21.490110] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-17T01:57:22.290121] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-11. [2025-09-17T01:57:22.382631] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T01:57:22.423419] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-17T01:57:22.865624] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T01:57:23.090164] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-17T01:57:23.138102] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T01:57:23.890152] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-17T01:57:24.279948] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T01:57:24.690123] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-17T01:57:25.490160] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-17T01:57:25.566458] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T01:57:26.290101] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-17T01:57:26.591077] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T01:57:26.888905] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-17T01:57:27.090171] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-17T01:57:27.804223] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T01:57:27.836742] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T01:57:27.890131] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-17T01:57:28.690142] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-17T01:57:29.490138] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-17T01:57:29.695593] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T01:57:30.290119] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-17T01:57:30.554221] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T01:57:30.997737] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-17T01:57:31.090144] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-17T01:57:31.890136] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-17T01:57:32.165094] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T01:57:32.690083] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-17T01:57:33.101474] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T01:57:33.490198] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-17T01:57:33.541354] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-17T01:57:34.290184] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-17T01:57:34.324074] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T01:57:34.723939] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T01:57:35.090139] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-17T01:57:35.890220] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-17T01:57:36.239234] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T01:57:36.690208] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-17T01:57:36.982386] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T01:57:37.460209] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T01:57:37.490082] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-17T01:57:38.290180] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-17T01:57:38.872455] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-17T01:57:38.879065] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-17T01:57:38.879226] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-17T01:57:39.106765] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-17T01:57:39.273917] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-17T01:57:39.274115] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-17T01:57:39.274969] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-17T01:57:39.275067] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-17T01:57:39.276726] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53757 (keeping 200 days of data) [2025-09-17T01:57:39.406307] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T01:57:39.629884] [DEBUG] [LOCAL ] AMC: Primary data saved (53757 records). [2025-09-17T01:57:39.630081] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-17T01:57:39.630892] [INFO ] [MAIN ] Update Progress: 97/2369 symbols completed. AMC took 39.4s. Estimated remaining: 5h 17m 18s. Rate: 7.2 symbols/min [2025-09-17T01:57:39.802036] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:39.846051] [DEBUG] [LOCAL ] AMH: Loaded 38458 existing records from primary storage. [2025-09-17T01:57:39.846221] [INFO ] [MAIN ] AMH: Loaded 38458 existing records. [2025-09-17T01:57:39.910093] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-17T01:57:40.069183] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:40.069424] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-17T01:57:40.069481] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-17T01:57:40.071116] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-17T01:57:40.071180] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-17T01:57:40.436146] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:40.481567] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-17T01:57:40.482611] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T01:57:40.690187] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-17T01:57:41.365413] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T01:57:41.490132] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-17T01:57:42.290115] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-17T01:57:42.619442] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T01:57:42.920685] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T01:57:43.083598] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T01:57:43.092844] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-17T01:57:43.890126] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-17T01:57:44.690159] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-11. [2025-09-17T01:57:45.129869] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T01:57:45.490179] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-17T01:57:45.709955] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T01:57:46.295940] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-17T01:57:46.314011] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T01:57:47.090131] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-17T01:57:47.316612] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T01:57:47.323001] [INFO ] [REMOTE ] AMCR: Full fetch complete (77513 records). [2025-09-17T01:57:47.323145] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-17T01:57:47.722967] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-17T01:57:47.723072] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-17T01:57:47.723831] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-17T01:57:47.723888] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-17T01:57:47.725503] [DEBUG] [LOCAL ] AMCR: Trimmed 77513 records to 53669 (keeping 200 days of data) [2025-09-17T01:57:47.908518] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-17T01:57:48.060734] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-09-17T01:57:48.061016] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-17T01:57:48.061196] [INFO ] [MAIN ] Update Progress: 98/2369 symbols completed. AMCR took 34.1s. Estimated remaining: 5h 17m 11s. Rate: 7.2 symbols/min [2025-09-17T01:57:48.231932] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:48.262749] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T01:57:48.300670] [DEBUG] [LOCAL ] AMN: Loaded 31354 existing records from primary storage. [2025-09-17T01:57:48.300841] [INFO ] [MAIN ] AMN: Loaded 31354 existing records. [2025-09-17T01:57:48.484971] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:48.485266] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-17T01:57:48.485354] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-17T01:57:48.486184] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-17T01:57:48.486261] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-17T01:57:48.699241] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-17T01:57:48.856047] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:48.895206] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T01:57:48.901507] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T01:57:49.490134] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-17T01:57:50.290179] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-17T01:57:50.392930] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T01:57:50.401886] [INFO ] [REMOTE ] AME: Full fetch complete (69438 records). [2025-09-17T01:57:50.402244] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-17T01:57:50.746541] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T01:57:50.848344] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-17T01:57:50.848514] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-17T01:57:50.849481] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-17T01:57:50.849547] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-17T01:57:50.851746] [DEBUG] [LOCAL ] AME: Trimmed 69438 records to 48589 (keeping 200 days of data) [2025-09-17T01:57:51.090187] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-17T01:57:51.184496] [DEBUG] [LOCAL ] AME: Primary data saved (48589 records). [2025-09-17T01:57:51.184700] [INFO ] [MAIN ] AME: Full history saved. [2025-09-17T01:57:51.184815] [INFO ] [MAIN ] Update Progress: 99/2369 symbols completed. AME took 33.1s. Estimated remaining: 5h 15m 2s. Rate: 7.2 symbols/min [2025-09-17T01:57:51.358155] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:51.383358] [DEBUG] [LOCAL ] AMP: Loaded 23302 existing records from primary storage. [2025-09-17T01:57:51.383524] [INFO ] [MAIN ] AMP: Loaded 23302 existing records. [2025-09-17T01:57:51.559029] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:51.559320] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-17T01:57:51.559401] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-17T01:57:51.560253] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-17T01:57:51.560328] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-17T01:57:51.926184] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T01:57:51.928215] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:51.897416] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-11. [2025-09-17T01:57:51.932601] [INFO ] [REMOTE ] AMG: Full fetch complete (29469 records). [2025-09-17T01:57:51.932793] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-17T01:57:52.262785] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T01:57:52.365874] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-17T01:57:52.366013] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-17T01:57:52.366428] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-17T01:57:52.366496] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-17T01:57:52.367778] [DEBUG] [LOCAL ] AMG: Trimmed 29469 records to 20806 (keeping 200 days of data) [2025-09-17T01:57:52.507596] [DEBUG] [LOCAL ] AMG: Primary data saved (20806 records). [2025-09-17T01:57:52.507761] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-17T01:57:52.507855] [INFO ] [MAIN ] Update Progress: 100/2369 symbols completed. AMG took 33.4s. Estimated remaining: 5h 12m 15s. Rate: 7.3 symbols/min [2025-09-17T01:57:52.677988] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:57:52.690154] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-11. [2025-09-17T01:57:52.722849] [DEBUG] [LOCAL ] AMPX: Loaded 39038 existing records from primary storage. [2025-09-17T01:57:52.723051] [INFO ] [MAIN ] AMPX: Loaded 39038 existing records. [2025-09-17T01:57:52.903997] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:57:52.904287] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-17T01:57:52.904364] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-17T01:57:52.905343] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-17T01:57:52.905406] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-17T01:57:53.257805] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:57:53.495234] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-11. [2025-09-17T01:57:53.510072] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T01:57:54.135801] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T01:57:54.290126] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-17T01:57:54.787256] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T01:57:55.090193] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-17T01:57:55.551505] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T01:57:55.890150] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-17T01:57:56.579276] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T01:57:56.690084] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-17T01:57:57.490164] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-17T01:57:57.556741] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T01:57:58.190111] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T01:57:58.290154] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-17T01:57:59.090196] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-17T01:57:59.213980] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T01:57:59.376731] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T01:57:59.890162] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-17T01:58:00.690200] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-17T01:58:01.010246] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T01:58:01.050434] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T01:58:01.490168] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-17T01:58:01.836148] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T01:58:02.290146] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-17T01:58:02.922327] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T01:58:03.090165] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-17T01:58:03.890177] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-17T01:58:04.042091] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T01:58:04.691127] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-17T01:58:04.695834] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T01:58:05.405841] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T01:58:05.490132] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-17T01:58:05.953066] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T01:58:06.290137] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-17T01:58:06.681082] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T01:58:07.090148] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-17T01:58:07.895916] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-17T01:58:07.910581] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T01:58:08.690164] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-17T01:58:08.775667] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T01:58:09.302131] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T01:58:09.490152] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-17T01:58:09.763759] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T01:58:10.290143] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-17T01:58:11.090109] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-17T01:58:11.142751] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T01:58:11.757279] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T01:58:11.890139] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-17T01:58:12.452994] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T01:58:12.690134] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-17T01:58:13.490120] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-17T01:58:13.690175] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T01:58:14.250709] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T01:58:14.256983] [INFO ] [REMOTE ] AMH: Full fetch complete (74475 records). [2025-09-17T01:58:14.257129] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-17T01:58:14.299840] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-17T01:58:14.656312] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-17T01:58:14.656427] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-17T01:58:14.657169] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-17T01:58:14.657229] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-17T01:58:14.658673] [DEBUG] [LOCAL ] AMH: Trimmed 74475 records to 51703 (keeping 200 days of data) [2025-09-17T01:58:14.934990] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T01:58:15.014397] [DEBUG] [LOCAL ] AMH: Primary data saved (51703 records). [2025-09-17T01:58:15.014564] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-17T01:58:15.014679] [INFO ] [MAIN ] Update Progress: 101/2369 symbols completed. AMH took 35.4s. Estimated remaining: 5h 17m 27s. Rate: 7.1 symbols/min [2025-09-17T01:58:15.095339] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-17T01:58:15.188307] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:15.214978] [DEBUG] [LOCAL ] AMPY: Loaded 27915 existing records from primary storage. [2025-09-17T01:58:15.215139] [INFO ] [MAIN ] AMPY: Loaded 27915 existing records. [2025-09-17T01:58:15.397617] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:58:15.397887] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-17T01:58:15.397945] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-17T01:58:15.398731] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-17T01:58:15.398797] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-17T01:58:15.751737] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:15.890118] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-11. [2025-09-17T01:58:16.049245] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T01:58:16.302100] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T01:58:16.690117] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-17T01:58:17.114588] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T01:58:17.490130] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-17T01:58:18.186911] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T01:58:18.290120] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-17T01:58:18.777135] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T01:58:19.090139] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-17T01:58:19.890202] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-17T01:58:20.279336] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T01:58:20.320009] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T01:58:20.690144] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-17T01:58:20.879608] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T01:58:21.490171] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-17T01:58:21.536028] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T01:58:22.290205] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-17T01:58:23.090146] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-17T01:58:23.708959] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-17T01:58:23.874697] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T01:58:23.890074] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-17T01:58:24.540487] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T01:58:24.690133] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-17T01:58:25.177976] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T01:58:25.490127] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-17T01:58:26.060866] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T01:58:26.290144] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-17T01:58:27.044604] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T01:58:27.051270] [INFO ] [REMOTE ] AMPX: Full fetch complete (74284 records). [2025-09-17T01:58:27.051435] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-17T01:58:27.095704] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-17T01:58:27.479697] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-17T01:58:27.479919] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-17T01:58:27.480852] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-17T01:58:27.481048] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-17T01:58:27.491403] [DEBUG] [LOCAL ] AMPX: Trimmed 74284 records to 52052 (keeping 200 days of data) [2025-09-17T01:58:27.507635] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T01:58:27.813039] [DEBUG] [LOCAL ] AMPX: Primary data saved (52052 records). [2025-09-17T01:58:27.813215] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-17T01:58:27.813317] [INFO ] [MAIN ] Update Progress: 102/2369 symbols completed. AMPX took 35.3s. Estimated remaining: 5h 18m 56s. Rate: 7.1 symbols/min [2025-09-17T01:58:27.895256] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-17T01:58:27.992349] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:28.014430] [DEBUG] [LOCAL ] AMR: Loaded 21471 existing records from primary storage. [2025-09-17T01:58:28.014578] [INFO ] [MAIN ] AMR: Loaded 21471 existing records. [2025-09-17T01:58:28.192485] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:58:28.192766] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-17T01:58:28.192829] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-17T01:58:28.193499] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-17T01:58:28.193570] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-17T01:58:28.549410] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:28.568824] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T01:58:28.690134] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-11. [2025-09-17T01:58:29.414070] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T01:58:29.490158] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-17T01:58:29.704847] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T01:58:30.290137] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-17T01:58:30.803412] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T01:58:30.808922] [INFO ] [REMOTE ] AMN: Full fetch complete (60476 records). [2025-09-17T01:58:30.809062] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-17T01:58:31.097979] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-17T01:58:31.202922] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-17T01:58:31.203029] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-17T01:58:31.203677] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-17T01:58:31.203734] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-17T01:58:31.205017] [DEBUG] [LOCAL ] AMN: Trimmed 60476 records to 42235 (keeping 200 days of data) [2025-09-17T01:58:31.430843] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T01:58:31.467450] [DEBUG] [LOCAL ] AMN: Primary data saved (42235 records). [2025-09-17T01:58:31.467607] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-17T01:58:31.467711] [INFO ] [MAIN ] Update Progress: 103/2369 symbols completed. AMN took 43.4s. Estimated remaining: 5h 17m 2s. Rate: 7.1 symbols/min [2025-09-17T01:58:31.638192] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:31.666504] [DEBUG] [LOCAL ] AMRC: Loaded 27742 existing records from primary storage. [2025-09-17T01:58:31.666677] [INFO ] [MAIN ] AMRC: Loaded 27742 existing records. [2025-09-17T01:58:31.844696] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:58:31.844934] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-17T01:58:31.844995] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-17T01:58:31.845734] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-17T01:58:31.845797] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-17T01:58:31.900623] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-17T01:58:32.234464] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:32.283949] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T01:58:32.288163] [INFO ] [REMOTE ] AMP: Full fetch complete (47407 records). [2025-09-17T01:58:32.288294] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-17T01:58:32.691527] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-11. [2025-09-17T01:58:32.692148] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-17T01:58:32.692945] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-17T01:58:32.693486] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-17T01:58:32.693544] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-17T01:58:32.694761] [DEBUG] [LOCAL ] AMP: Trimmed 47407 records to 32856 (keeping 200 days of data) [2025-09-17T01:58:32.904594] [DEBUG] [LOCAL ] AMP: Primary data saved (32856 records). [2025-09-17T01:58:32.904773] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-17T01:58:32.904876] [INFO ] [MAIN ] Update Progress: 104/2369 symbols completed. AMP took 41.7s. Estimated remaining: 5h 14m 22s. Rate: 7.2 symbols/min [2025-09-17T01:58:33.073318] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:33.073525] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-17T01:58:33.073575] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-17T01:58:33.073699] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-17T01:58:33.073745] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-17T01:58:33.073796] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-17T01:58:33.073834] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-17T01:58:33.430957] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:33.490084] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-11. [2025-09-17T01:58:33.544522] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T01:58:33.699541] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:33.699894] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-11 [2025-09-17T01:58:34.031467] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T01:58:34.290132] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-17T01:58:35.090145] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-17T01:58:35.303876] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:35.304197] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-17T01:58:35.622361] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T01:58:35.890141] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-17T01:58:36.104160] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:36.104515] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-17T01:58:36.690127] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-17T01:58:37.490163] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-17T01:58:37.659141] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T01:58:38.290164] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-17T01:58:38.512196] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:38.512511] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-17T01:58:38.935619] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T01:58:39.090136] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-17T01:58:39.890136] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-17T01:58:40.443755] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T01:58:40.690423] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-17T01:58:41.082842] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T01:58:41.086785] [INFO ] [REMOTE ] AMPY: Full fetch complete (49631 records). [2025-09-17T01:58:41.086918] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-17T01:58:41.468604] [DEBUG] [VALIDATOR ] AMPY: All expected trading days are present. [2025-09-17T01:58:41.468720] [DEBUG] [VALIDATOR ] AMPY: Primary data validation passed. [2025-09-17T01:58:41.469419] [INFO ] [MAIN ] AMPY: Fetched primary data is valid. [2025-09-17T01:58:41.469473] [DEBUG] [LOCAL ] AMPY: Saving primary data. [2025-09-17T01:58:41.470599] [DEBUG] [LOCAL ] AMPY: Trimmed 49631 records to 37324 (keeping 200 days of data) [2025-09-17T01:58:41.518539] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-17T01:58:41.682526] [DEBUG] [LOCAL ] AMPY: Primary data saved (37324 records). [2025-09-17T01:58:41.682706] [INFO ] [MAIN ] AMPY: Full history saved. [2025-09-17T01:58:41.682795] [INFO ] [MAIN ] Update Progress: 105/2369 symbols completed. AMPY took 26.7s. Estimated remaining: 5h 14m 24s. Rate: 7.2 symbols/min [2025-09-17T01:58:41.863543] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:41.879246] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T01:58:41.919707] [DEBUG] [LOCAL ] AMT: Loaded 38959 existing records from primary storage. [2025-09-17T01:58:41.919882] [INFO ] [MAIN ] AMT: Loaded 38959 existing records. [2025-09-17T01:58:42.098019] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:58:42.098386] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-17T01:58:42.098463] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-17T01:58:42.100543] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-17T01:58:42.100659] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-17T01:58:42.294099] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-17T01:58:42.518254] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:42.579917] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:42.580742] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-17T01:58:42.581408] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T01:58:43.090141] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-17T01:58:43.890149] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-17T01:58:44.099149] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:44.099526] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-17T01:58:44.246672] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T01:58:44.690137] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-17T01:58:45.490138] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-17T01:58:45.863270] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T01:58:46.290132] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-17T01:58:46.492635] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T01:58:46.492989] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-17T01:58:46.966100] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T01:58:47.090141] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-17T01:58:47.890133] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-17T01:58:48.075455] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T01:58:48.690180] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-11. [2025-09-17T01:58:49.104137] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T01:58:49.490129] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-17T01:58:50.290118] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-17T01:58:50.533421] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T01:58:51.090127] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-17T01:58:51.323383] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T01:58:51.829230] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T01:58:51.890089] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-17T01:58:52.670947] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T01:58:52.690082] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-17T01:58:52.870400] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T01:58:53.490141] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-17T01:58:54.290183] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-17T01:58:54.665597] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T01:58:55.083591] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T01:58:55.093996] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-17T01:58:55.890152] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-17T01:58:56.010518] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T01:58:56.429952] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T01:58:56.690146] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-17T01:58:57.013337] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T01:58:57.490214] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-17T01:58:57.906611] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T01:58:57.912947] [INFO ] [REMOTE ] AMRZ: Full fetch complete (22645 records). [2025-09-17T01:58:57.913049] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-17T01:58:58.100089] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 60 unique days, need 200 days [2025-09-17T01:58:58.100504] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T01:58:58.100598] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T01:58:58.100698] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-17T01:58:58.100801] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-17T01:58:58.100914] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-17T01:58:58.101039] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-17T01:58:58.101126] [INFO ] [MAIN ] Update Progress: 106/2369 symbols completed. AMRZ took 25.2s. Estimated remaining: 5h 17m 8s. Rate: 7.1 symbols/min [2025-09-17T01:58:58.272353] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:58:58.288189] [DEBUG] [LOCAL ] AMTB: Loaded 15340 existing records from primary storage. [2025-09-17T01:58:58.288342] [INFO ] [MAIN ] AMTB: Loaded 15340 existing records. [2025-09-17T01:58:58.299427] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-17T01:58:58.466141] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:58:58.466363] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-17T01:58:58.466420] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-17T01:58:58.467152] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-17T01:58:58.467216] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-17T01:58:58.803077] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T01:58:58.849731] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:58:59.090134] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-17T01:58:59.768393] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T01:58:59.773441] [INFO ] [REMOTE ] AMRC: Full fetch complete (51974 records). [2025-09-17T01:58:59.773570] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-17T01:58:59.895218] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-17T01:59:00.156390] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-17T01:59:00.156495] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-17T01:59:00.157056] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-17T01:59:00.157121] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-17T01:59:00.158254] [DEBUG] [LOCAL ] AMRC: Trimmed 51974 records to 38785 (keeping 200 days of data) [2025-09-17T01:59:00.382912] [DEBUG] [LOCAL ] AMRC: Primary data saved (38785 records). [2025-09-17T01:59:00.383071] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-17T01:59:00.383168] [INFO ] [MAIN ] Update Progress: 107/2369 symbols completed. AMRC took 28.9s. Estimated remaining: 5h 14m 50s. Rate: 7.2 symbols/min [2025-09-17T01:59:00.557153] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:00.561921] [DEBUG] [LOCAL ] AMTD: Loaded 2906 existing records from primary storage. [2025-09-17T01:59:00.562025] [INFO ] [MAIN ] AMTD: Loaded 2906 existing records. [2025-09-17T01:59:00.690200] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-11. [2025-09-17T01:59:00.744941] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:59:00.746060] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-17T01:59:00.746148] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-17T01:59:00.746482] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-17T01:59:00.746552] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-17T01:59:01.113890] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T01:59:01.142209] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:01.264055] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T01:59:01.490172] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-11. [2025-09-17T01:59:02.091714] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T01:59:02.173362] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T01:59:02.290138] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-17T01:59:03.090176] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-17T01:59:03.890156] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-17T01:59:04.205352] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T01:59:04.306406] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T01:59:04.690153] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-17T01:59:04.969045] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T01:59:05.490131] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-17T01:59:05.839852] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T01:59:06.290209] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-17T01:59:06.573001] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T01:59:07.090136] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-17T01:59:07.890157] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-17T01:59:08.188396] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T01:59:08.203473] [INFO ] [REMOTE ] AMR: Full fetch complete (39138 records). [2025-09-17T01:59:08.222321] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-17T01:59:08.224101] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T01:59:08.618412] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-17T01:59:08.618532] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-17T01:59:08.619011] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-17T01:59:08.619074] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-17T01:59:08.620091] [DEBUG] [LOCAL ] AMR: Trimmed 39138 records to 29397 (keeping 200 days of data) [2025-09-17T01:59:08.708427] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-17T01:59:08.802411] [DEBUG] [LOCAL ] AMR: Primary data saved (29397 records). [2025-09-17T01:59:08.802595] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-17T01:59:08.802715] [INFO ] [MAIN ] Update Progress: 108/2369 symbols completed. AMR took 41.0s. Estimated remaining: 5h 14m 43s. Rate: 7.2 symbols/min [2025-09-17T01:59:08.970252] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:08.982581] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T01:59:09.020341] [DEBUG] [LOCAL ] AMTM: Loaded 37550 existing records from primary storage. [2025-09-17T01:59:09.020507] [INFO ] [MAIN ] AMTM: Loaded 37550 existing records. [2025-09-17T01:59:09.200518] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:59:09.200810] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-17T01:59:09.200881] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-17T01:59:09.202014] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-17T01:59:09.202077] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-17T01:59:09.495262] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-17T01:59:09.555496] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:10.106744] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T01:59:10.199552] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T01:59:10.290112] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-17T01:59:10.966203] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T01:59:11.090129] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-11. [2025-09-17T01:59:11.890136] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-17T01:59:12.693303] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-17T01:59:12.695250] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T01:59:12.942996] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T01:59:13.305859] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T01:59:13.490131] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-17T01:59:13.936902] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T01:59:14.290141] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-17T01:59:15.090161] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-17T01:59:15.208129] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T01:59:15.563472] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T01:59:15.890142] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-17T01:59:16.434872] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T01:59:16.690143] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-17T01:59:17.490171] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-17T01:59:18.249704] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T01:59:18.290109] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-17T01:59:18.463929] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T01:59:19.090145] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-17T01:59:19.718146] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T01:59:19.890107] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-17T01:59:20.003266] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T01:59:20.248183] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-17T01:59:20.690167] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-17T01:59:21.358628] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T01:59:21.359939] [INFO ] [REMOTE ] AMTD: Full fetch complete (5508 records). [2025-09-17T01:59:21.360023] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-17T01:59:21.499210] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-17T01:59:21.725683] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-17T01:59:21.725796] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-17T01:59:21.725977] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-17T01:59:21.726029] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-17T01:59:21.726439] [DEBUG] [LOCAL ] AMTD: Trimmed 5508 records to 3497 (keeping 200 days of data) [2025-09-17T01:59:21.747037] [DEBUG] [LOCAL ] AMTD: Primary data saved (3497 records). [2025-09-17T01:59:21.747135] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-17T01:59:21.747220] [INFO ] [MAIN ] Update Progress: 109/2369 symbols completed. AMTD took 21.4s. Estimated remaining: 5h 16m 10s. Rate: 7.1 symbols/min [2025-09-17T01:59:21.914264] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:21.914492] [DEBUG] [LOCAL ] AMWL: No existing data file found in primary storage. [2025-09-17T01:59:21.914533] [WARN ] [MAIN ] AMWL: No existing data found, performing full refresh instead. [2025-09-17T01:59:21.917815] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-17T01:59:21.917925] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-17T01:59:21.917980] [DEBUG] [LOCAL ] AMWL: No primary data file found to delete. [2025-09-17T01:59:21.918025] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-17T01:59:22.273923] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:22.290085] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-11. [2025-09-17T01:59:23.067252] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T01:59:23.090083] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-17T01:59:23.330442] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T01:59:23.689108] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T01:59:23.890186] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-17T01:59:24.690172] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-17T01:59:24.954026] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T01:59:25.490187] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-17T01:59:26.290195] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-17T01:59:26.374237] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T01:59:26.634729] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T01:59:26.933849] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T01:59:27.090146] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-17T01:59:27.890155] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-17T01:59:28.209043] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T01:59:28.690127] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-17T01:59:28.735758] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T01:59:29.490148] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-17T01:59:30.290171] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-17T01:59:30.608807] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T01:59:30.658925] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T01:59:31.090198] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-17T01:59:31.890173] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-17T01:59:31.979116] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T01:59:32.342343] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T01:59:32.442015] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T01:59:32.448485] [INFO ] [REMOTE ] AMT: Full fetch complete (75850 records). [2025-09-17T01:59:32.448668] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-17T01:59:32.696029] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-17T01:59:32.840554] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-17T01:59:32.840679] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-17T01:59:32.841398] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-17T01:59:32.841453] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-17T01:59:32.844705] [DEBUG] [LOCAL ] AMT: Trimmed 75850 records to 52460 (keeping 200 days of data) [2025-09-17T01:59:33.178459] [DEBUG] [LOCAL ] AMT: Primary data saved (52460 records). [2025-09-17T01:59:33.178689] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-17T01:59:33.178829] [INFO ] [MAIN ] Update Progress: 110/2369 symbols completed. AMT took 51.5s. Estimated remaining: 5h 17m 4s. Rate: 7.1 symbols/min [2025-09-17T01:59:33.350281] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:33.389429] [DEBUG] [LOCAL ] AMX: Loaded 36405 existing records from primary storage. [2025-09-17T01:59:33.389605] [INFO ] [MAIN ] AMX: Loaded 36405 existing records. [2025-09-17T01:59:33.491242] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-17T01:59:33.516704] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T01:59:33.584546] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:59:33.584826] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-17T01:59:33.584888] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-17T01:59:33.585962] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-17T01:59:33.586038] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-17T01:59:33.949027] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:34.290153] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-11. [2025-09-17T01:59:34.426909] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T01:59:34.429244] [INFO ] [REMOTE ] AMTB: Full fetch complete (30353 records). [2025-09-17T01:59:34.429333] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-17T01:59:34.797029] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-17T01:59:34.797135] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-17T01:59:34.797498] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-17T01:59:34.797550] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-17T01:59:34.798575] [DEBUG] [LOCAL ] AMTB: Trimmed 30353 records to 20592 (keeping 200 days of data) [2025-09-17T01:59:34.929380] [DEBUG] [LOCAL ] AMTB: Primary data saved (20592 records). [2025-09-17T01:59:34.929538] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-17T01:59:34.929635] [INFO ] [MAIN ] Update Progress: 111/2369 symbols completed. AMTB took 36.8s. Estimated remaining: 5h 14m 40s. Rate: 7.2 symbols/min [2025-09-17T01:59:35.096914] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-17T01:59:35.100660] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:35.125781] [DEBUG] [LOCAL ] AN: Loaded 23233 existing records from primary storage. [2025-09-17T01:59:35.125939] [INFO ] [MAIN ] AN: Loaded 23233 existing records. [2025-09-17T01:59:35.306817] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:59:35.307094] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-17T01:59:35.307176] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-17T01:59:35.308209] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-17T01:59:35.308313] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-17T01:59:35.668343] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:35.890094] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-17T01:59:35.921905] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T01:59:35.954711] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T01:59:36.690128] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-11. [2025-09-17T01:59:37.490132] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-17T01:59:37.682805] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T01:59:37.751216] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T01:59:38.019960] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T01:59:38.290149] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-17T01:59:39.090203] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-17T01:59:39.691797] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T01:59:39.890136] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-17T01:59:39.903549] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T01:59:40.690131] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-17T01:59:41.162684] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T01:59:41.490137] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-17T01:59:42.290110] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-17T01:59:42.402703] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T01:59:43.091528] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-17T01:59:43.092339] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T01:59:43.196058] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T01:59:43.890205] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-17T01:59:44.450885] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T01:59:44.477954] [INFO ] [REMOTE ] AMWL: Full fetch complete (13945 records). [2025-09-17T01:59:44.478718] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-17T01:59:44.479694] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T01:59:44.697549] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-17T01:59:44.863109] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-17T01:59:44.863208] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-17T01:59:44.863476] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-17T01:59:44.863525] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-17T01:59:44.864118] [DEBUG] [LOCAL ] AMWL: Trimmed 13945 records to 8606 (keeping 200 days of data) [2025-09-17T01:59:44.912317] [DEBUG] [LOCAL ] AMWL: Primary data saved (8606 records). [2025-09-17T01:59:44.912457] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-17T01:59:44.912555] [INFO ] [MAIN ] Update Progress: 112/2369 symbols completed. AMWL took 23.2s. Estimated remaining: 5h 15m 4s. Rate: 7.2 symbols/min [2025-09-17T01:59:45.079418] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T01:59:45.118075] [DEBUG] [LOCAL ] ANET: Loaded 40116 existing records from primary storage. [2025-09-17T01:59:45.118257] [INFO ] [MAIN ] ANET: Loaded 40116 existing records. [2025-09-17T01:59:45.295028] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T01:59:45.295269] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-17T01:59:45.295320] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-17T01:59:45.296518] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-17T01:59:45.296583] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-17T01:59:45.497734] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-17T01:59:45.655869] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T01:59:46.290137] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-17T01:59:46.330728] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T01:59:47.096503] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-17T01:59:47.097985] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T01:59:47.890162] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-17T01:59:48.028385] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T01:59:48.690177] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-11. [2025-09-17T01:59:48.780686] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T01:59:49.312036] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T01:59:49.490137] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-17T01:59:50.290136] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-17T01:59:50.501378] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T01:59:51.090199] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-17T01:59:51.195114] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T01:59:51.824079] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T01:59:51.890084] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-17T01:59:52.678909] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T01:59:52.690100] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-17T01:59:53.267814] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T01:59:53.490190] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-17T01:59:54.290099] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-17T01:59:54.526345] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T01:59:54.645242] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T01:59:55.090151] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-17T01:59:55.890192] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-17T01:59:56.032625] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T01:59:56.476519] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T01:59:56.690146] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-17T01:59:57.490158] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-17T01:59:57.937430] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T01:59:58.287959] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-17T01:59:58.297769] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-17T01:59:58.453237] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T01:59:59.090171] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-17T01:59:59.785480] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T01:59:59.890108] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-17T02:00:00.690144] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-17T02:00:01.173092] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T02:00:01.490185] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-17T02:00:01.618070] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-17T02:00:02.290158] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-17T02:00:02.923789] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-17T02:00:03.090189] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-17T02:00:03.890214] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-17T02:00:05.244799] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (3.75 seconds). [2025-09-17T02:00:05.249066] [INFO ] [REMOTE ] AN: Full fetch complete (47849 records). [2025-09-17T02:00:05.249216] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-17T02:00:05.627588] [DEBUG] [VALIDATOR ] AN: All expected trading days are present. [2025-09-17T02:00:05.627738] [DEBUG] [VALIDATOR ] AN: Primary data validation passed. [2025-09-17T02:00:05.628331] [INFO ] [MAIN ] AN: Fetched primary data is valid. [2025-09-17T02:00:05.628432] [DEBUG] [LOCAL ] AN: Saving primary data. [2025-09-17T02:00:05.629685] [DEBUG] [LOCAL ] AN: Trimmed 47849 records to 32970 (keeping 200 days of data) [2025-09-17T02:00:05.842249] [DEBUG] [LOCAL ] AN: Primary data saved (32970 records). [2025-09-17T02:00:05.842542] [INFO ] [MAIN ] AN: Full history saved. [2025-09-17T02:00:05.842764] [INFO ] [MAIN ] Update Progress: 113/2369 symbols completed. AN took 30.9s. Estimated remaining: 5h 19m 7s. Rate: 7.1 symbols/min [2025-09-17T02:00:06.012785] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:06.055450] [DEBUG] [LOCAL ] ANF: Loaded 38799 existing records from primary storage. [2025-09-17T02:00:06.055670] [INFO ] [MAIN ] ANF: Loaded 38799 existing records. [2025-09-17T02:00:06.237690] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:06.237989] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-17T02:00:06.238058] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-17T02:00:06.239175] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-17T02:00:06.239252] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-17T02:00:06.611418] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:06.611877] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-11. [2025-09-17T02:00:06.629903] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-17T02:00:06.637147] [INFO ] [REMOTE ] AMTM: Full fetch complete (73734 records). [2025-09-17T02:00:06.637838] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-17T02:00:07.053138] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-17T02:00:07.053320] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-17T02:00:07.054097] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-17T02:00:07.054187] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-17T02:00:07.056546] [DEBUG] [LOCAL ] AMTM: Trimmed 73734 records to 50733 (keeping 200 days of data) [2025-09-17T02:00:07.174907] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (4.88 seconds). [2025-09-17T02:00:07.197077] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-17T02:00:07.413020] [DEBUG] [LOCAL ] AMTM: Primary data saved (50733 records). [2025-09-17T02:00:07.413226] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-17T02:00:07.413361] [INFO ] [MAIN ] Update Progress: 114/2369 symbols completed. AMTM took 58.6s. Estimated remaining: 5h 16m 41s. Rate: 7.1 symbols/min [2025-09-17T02:00:07.604390] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:07.604709] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-17T02:00:07.605172] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-17T02:00:07.605542] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-17T02:00:07.605680] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-17T02:00:07.605784] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-17T02:00:07.605871] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-17T02:00:07.837598] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (4.75 seconds). [2025-09-17T02:00:07.961910] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-17T02:00:08.029301] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:08.029612] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-11. [2025-09-17T02:00:08.250754] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:08.251087] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-11 [2025-09-17T02:00:08.251533] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-17T02:00:08.477987] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:08.478970] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-17T02:00:08.690299] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-17T02:00:08.871187] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-11 (2.26 seconds). [2025-09-17T02:00:08.925944] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:08.926303] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-17T02:00:09.339772] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T02:00:09.490157] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-17T02:00:09.600798] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T02:00:09.608702] [INFO ] [REMOTE ] AMX: Full fetch complete (70662 records). [2025-09-17T02:00:09.608866] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-17T02:00:10.018868] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-17T02:00:10.019025] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-17T02:00:10.020057] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-17T02:00:10.020125] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-17T02:00:10.021850] [DEBUG] [LOCAL ] AMX: Trimmed 70662 records to 49004 (keeping 200 days of data) [2025-09-17T02:00:10.298506] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-17T02:00:10.340252] [DEBUG] [LOCAL ] AMX: Primary data saved (49004 records). [2025-09-17T02:00:10.340419] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-17T02:00:10.340611] [INFO ] [MAIN ] Update Progress: 115/2369 symbols completed. AMX took 37.2s. Estimated remaining: 5h 14m 45s. Rate: 7.2 symbols/min [2025-09-17T02:00:10.517421] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:10.533890] [DEBUG] [LOCAL ] ANRO: Loaded 13497 existing records from primary storage. [2025-09-17T02:00:10.534043] [INFO ] [MAIN ] ANRO: Loaded 13497 existing records. [2025-09-17T02:00:10.716454] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:10.716796] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-17T02:00:10.716938] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-17T02:00:10.717369] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-17T02:00:10.717447] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-17T02:00:11.074504] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:11.090079] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-11. [2025-09-17T02:00:11.155950] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T02:00:11.890133] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-17T02:00:12.045751] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T02:00:12.690133] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-17T02:00:12.746810] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-17T02:00:13.490208] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-17T02:00:13.831543] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T02:00:13.862075] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T02:00:14.290160] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-17T02:00:15.090167] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-17T02:00:15.498564] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:15.498926] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-17T02:00:15.890134] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-17T02:00:16.054955] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-17T02:00:16.308657] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T02:00:16.690151] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-17T02:00:17.079330] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:17.079675] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-17T02:00:17.490135] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-17T02:00:17.695400] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:17.695751] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-17T02:00:18.290139] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-17T02:00:19.090143] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-17T02:00:19.304261] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:19.304622] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-17T02:00:19.409496] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-17T02:00:19.890142] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-17T02:00:20.224942] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T02:00:20.690130] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-17T02:00:20.847749] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T02:00:21.490175] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-17T02:00:22.295615] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-17T02:00:22.303785] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T02:00:22.538385] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:00:23.090154] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-17T02:00:23.890136] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-17T02:00:24.108254] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:24.108588] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-17T02:00:24.251533] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T02:00:24.690156] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-17T02:00:25.010177] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T02:00:25.490203] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-17T02:00:26.290210] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-17T02:00:26.606604] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:26.607041] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-17T02:00:26.630416] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T02:00:26.638227] [INFO ] [REMOTE ] ANET: Full fetch complete (77681 records). [2025-09-17T02:00:26.638487] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-17T02:00:27.119443] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-17T02:00:27.156094] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-17T02:00:27.174637] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-17T02:00:27.176839] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T02:00:27.178047] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-17T02:00:27.184574] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-17T02:00:27.187840] [DEBUG] [LOCAL ] ANET: Trimmed 77681 records to 53766 (keeping 200 days of data) [2025-09-17T02:00:27.389116] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:27.417358] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-17T02:00:27.554826] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-09-17T02:00:27.555048] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-17T02:00:27.555164] [INFO ] [MAIN ] Update Progress: 116/2369 symbols completed. ANET took 42.6s. Estimated remaining: 5h 17m 28s. Rate: 7.1 symbols/min [2025-09-17T02:00:27.734611] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:27.753910] [DEBUG] [LOCAL ] ANVS: Loaded 17667 existing records from primary storage. [2025-09-17T02:00:27.754131] [INFO ] [MAIN ] ANVS: Loaded 17667 existing records. [2025-09-17T02:00:27.895670] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-17T02:00:27.936243] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:27.936556] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-17T02:00:27.936618] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-17T02:00:27.937314] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-17T02:00:27.937390] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-17T02:00:28.292231] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:28.690137] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-11. [2025-09-17T02:00:28.852035] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T02:00:28.854998] [INFO ] [REMOTE ] ANGX: Full fetch complete (1325 records). [2025-09-17T02:00:28.855181] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-17T02:00:29.042480] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 4 unique days, need 200 days [2025-09-17T02:00:29.042711] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:00:29.042760] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:00:29.042803] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-17T02:00:29.042872] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-17T02:00:29.042915] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-17T02:00:29.042977] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-17T02:00:29.043050] [INFO ] [MAIN ] Update Progress: 117/2369 symbols completed. ANGX took 21.6s. Estimated remaining: 5h 15m 6s. Rate: 7.1 symbols/min [2025-09-17T02:00:29.490132] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-17T02:00:29.777602] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T02:00:30.290162] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-17T02:00:31.090191] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-17T02:00:31.306831] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T02:00:31.443760] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T02:00:31.890111] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-17T02:00:32.290112] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T02:00:32.690187] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-17T02:00:33.490156] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-17T02:00:33.769735] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T02:00:33.901456] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T02:00:34.290141] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-17T02:00:34.405805] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T02:00:35.090185] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-17T02:00:35.155165] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T02:00:35.890203] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-17T02:00:36.536680] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T02:00:36.690128] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-17T02:00:37.490169] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-17T02:00:37.820615] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:00:37.846238] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T02:00:38.290134] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-17T02:00:38.542743] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T02:00:39.090122] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-17T02:00:39.438969] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T02:00:39.890155] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-17T02:00:40.006776] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T02:00:40.691576] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-17T02:00:41.490130] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-17T02:00:41.657868] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T02:00:41.676138] [INFO ] [REMOTE ] ANF: Full fetch complete (75544 records). [2025-09-17T02:00:41.678301] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-17T02:00:41.679360] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T02:00:42.075979] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-17T02:00:42.076093] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-17T02:00:42.076832] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-17T02:00:42.076899] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-17T02:00:42.078387] [DEBUG] [LOCAL ] ANF: Trimmed 75544 records to 52297 (keeping 200 days of data) [2025-09-17T02:00:42.292777] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-17T02:00:42.295117] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T02:00:42.297864] [INFO ] [REMOTE ] ANRO: Full fetch complete (31113 records). [2025-09-17T02:00:42.298697] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-17T02:00:42.701225] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-17T02:00:42.702098] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-17T02:00:42.703310] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-17T02:00:42.704115] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-17T02:00:42.707785] [DEBUG] [LOCAL ] ANRO: Trimmed 31113 records to 20465 (keeping 200 days of data) [2025-09-17T02:00:42.884121] [DEBUG] [LOCAL ] ANF: Primary data saved (52297 records). [2025-09-17T02:00:42.885830] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-17T02:00:42.890099] [INFO ] [MAIN ] Update Progress: 118/2369 symbols completed. ANF took 37.0s. Estimated remaining: 5h 16m 41s. Rate: 7.1 symbols/min [2025-09-17T02:00:42.901783] [DEBUG] [LOCAL ] ANRO: Primary data saved (20465 records). [2025-09-17T02:00:42.901930] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-17T02:00:42.902014] [INFO ] [MAIN ] Update Progress: 119/2369 symbols completed. ANRO took 32.6s. Estimated remaining: 5h 13m 54s. Rate: 7.2 symbols/min [2025-09-17T02:00:43.775725] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T02:00:43.782460] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-17T02:00:44.655253] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T02:00:44.661033] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-17T02:00:45.776003] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T02:00:45.780895] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-17T02:00:46.686325] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T02:00:46.688913] [INFO ] [REMOTE ] ANVS: Full fetch complete (37184 records). [2025-09-17T02:00:46.689019] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-17T02:00:47.056255] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-17T02:00:47.056364] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-17T02:00:47.057004] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-17T02:00:47.057060] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-17T02:00:47.057926] [DEBUG] [LOCAL ] ANVS: Trimmed 37184 records to 23544 (keeping 200 days of data) [2025-09-17T02:00:47.186560] [DEBUG] [LOCAL ] ANVS: Primary data saved (23544 records). [2025-09-17T02:00:47.186732] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-17T02:00:47.186821] [INFO ] [MAIN ] Update Progress: 120/2369 symbols completed. ANVS took 19.6s. Estimated remaining: 5h 12m 29s. Rate: 7.2 symbols/min [2025-09-17T02:00:47.727666] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:47.901488] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:47.904252] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:47.854573] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:00:47.905161] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-17T02:00:47.905416] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-17T02:00:47.905828] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-17T02:00:47.905930] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-17T02:00:47.907060] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-17T02:00:47.907150] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-17T02:00:48.023064] [DEBUG] [LOCAL ] AOMR: Loaded 12747 existing records from primary storage. [2025-09-17T02:00:48.051270] [DEBUG] [LOCAL ] AOD: Loaded 22340 existing records from primary storage. [2025-09-17T02:00:48.087743] [INFO ] [MAIN ] AOMR: Loaded 12747 existing records. [2025-09-17T02:00:48.098799] [INFO ] [MAIN ] AOD: Loaded 22340 existing records. [2025-09-17T02:00:48.358871] [DEBUG] [LOCAL ] AON: Loaded 33740 existing records from primary storage. [2025-09-17T02:00:48.400024] [INFO ] [MAIN ] AON: Loaded 33740 existing records. [2025-09-17T02:00:48.745284] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:48.761465] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:48.781295] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-17T02:00:48.787012] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-17T02:00:48.770682] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:48.799590] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-17T02:00:48.800424] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-17T02:00:48.800224] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-11. [2025-09-17T02:00:48.821677] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-17T02:00:48.858027] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-17T02:00:48.864176] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-17T02:00:48.866054] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-17T02:00:48.886232] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:00:48.934459] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-17T02:00:49.007583] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-17T02:00:49.075661] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-17T02:00:49.124755] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-17T02:00:49.146914] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:49.275429] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-11 [2025-09-17T02:00:49.359265] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-17T02:00:49.819302] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:49.830047] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:49.876994] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-17T02:00:49.943033] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-11. [2025-09-17T02:00:49.943288] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-17T02:00:49.954308] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:49.960820] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-11. [2025-09-17T02:00:50.101127] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:00:50.101459] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-11. [2025-09-17T02:00:50.234201] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:50.234625] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-17T02:00:50.290106] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-17T02:00:50.504738] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:50.505082] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-17T02:00:50.775625] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T02:00:51.028024] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T02:00:51.090120] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-17T02:00:51.372467] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T02:00:51.890145] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-17T02:00:51.987715] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T02:00:52.690130] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-17T02:00:53.184521] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:00:53.490134] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-17T02:00:53.569870] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T02:00:54.290152] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-17T02:00:54.844333] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T02:00:55.090164] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-17T02:00:55.304112] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:55.304691] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-17T02:00:55.890137] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-17T02:00:56.061018] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T02:00:56.690144] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-17T02:00:56.821714] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T02:00:56.911905] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:00:56.912272] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-17T02:00:57.490145] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-17T02:00:57.913488] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T02:00:58.290154] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-17T02:00:58.853908] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T02:00:59.090178] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-17T02:00:59.890189] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-17T02:01:00.306121] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T02:01:00.360421] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T02:01:00.690136] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-17T02:01:01.490185] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-17T02:01:01.717552] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T02:01:02.290148] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-17T02:01:03.090159] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-17T02:01:03.198475] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T02:01:03.265215] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T02:01:03.890144] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-17T02:01:04.082780] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T02:01:04.690150] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-17T02:01:05.452507] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T02:01:05.490131] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-17T02:01:06.063059] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:01:06.290137] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-17T02:01:06.744313] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T02:01:07.090147] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-17T02:01:07.321360] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T02:01:07.458309] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T02:01:07.459376] [INFO ] [REMOTE ] AOMD: Full fetch complete (1684 records). [2025-09-17T02:01:07.459467] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-17T02:01:07.688365] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 78 unique days, need 200 days [2025-09-17T02:01:07.688691] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:01:07.689277] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:01:07.689361] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-17T02:01:07.689457] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-17T02:01:07.689514] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-17T02:01:07.689606] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-17T02:01:07.689787] [INFO ] [MAIN ] Update Progress: 121/2369 symbols completed. AOMD took 20.5s. Estimated remaining: 5h 16m 6s. Rate: 7.1 symbols/min [2025-09-17T02:01:07.878677] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:07.895059] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-17T02:01:07.907189] [DEBUG] [LOCAL ] AORT: Loaded 21726 existing records from primary storage. [2025-09-17T02:01:07.907397] [INFO ] [MAIN ] AORT: Loaded 21726 existing records. [2025-09-17T02:01:08.084231] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:01:08.084511] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-17T02:01:08.084575] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-17T02:01:08.085539] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-17T02:01:08.085607] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-17T02:01:08.434236] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:08.690172] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-17T02:01:08.976713] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T02:01:09.490149] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-17T02:01:09.954723] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T02:01:10.290154] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-11. [2025-09-17T02:01:10.542807] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T02:01:11.090129] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-17T02:01:11.383083] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T02:01:11.890158] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-17T02:01:12.690108] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-17T02:01:12.945817] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T02:01:13.062299] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T02:01:13.490183] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-17T02:01:13.766163] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T02:01:14.290147] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-17T02:01:15.090177] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-17T02:01:15.120360] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T02:01:15.176720] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T02:01:15.890162] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-17T02:01:16.427133] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T02:01:16.690132] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-17T02:01:17.490148] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-17T02:01:17.644656] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:01:17.721858] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T02:01:18.290144] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-17T02:01:18.937997] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T02:01:19.090157] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-17T02:01:19.890169] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-17T02:01:20.060755] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T02:01:20.096981] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T02:01:20.101305] [INFO ] [REMOTE ] AOD: Full fetch complete (44047 records). [2025-09-17T02:01:20.101432] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-17T02:01:20.477211] [DEBUG] [VALIDATOR ] AOD: All expected trading days are present. [2025-09-17T02:01:20.477321] [DEBUG] [VALIDATOR ] AOD: Primary data validation passed. [2025-09-17T02:01:20.477832] [INFO ] [MAIN ] AOD: Fetched primary data is valid. [2025-09-17T02:01:20.477888] [DEBUG] [LOCAL ] AOD: Saving primary data. [2025-09-17T02:01:20.479567] [DEBUG] [LOCAL ] AOD: Trimmed 44047 records to 30403 (keeping 200 days of data) [2025-09-17T02:01:20.659447] [DEBUG] [LOCAL ] AOD: Primary data saved (30403 records). [2025-09-17T02:01:20.659616] [INFO ] [MAIN ] AOD: Full history saved. [2025-09-17T02:01:20.659739] [INFO ] [MAIN ] Update Progress: 122/2369 symbols completed. AOD took 33.5s. Estimated remaining: 5h 17m 21s. Rate: 7.1 symbols/min [2025-09-17T02:01:20.695247] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-17T02:01:20.836578] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:20.873029] [DEBUG] [LOCAL ] AOS: Loaded 36605 existing records from primary storage. [2025-09-17T02:01:20.873221] [INFO ] [MAIN ] AOS: Loaded 36605 existing records. [2025-09-17T02:01:21.057435] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:01:21.057728] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-17T02:01:21.057785] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-17T02:01:21.059348] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-17T02:01:21.059417] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-17T02:01:21.413739] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:21.439578] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T02:01:21.490082] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-11. [2025-09-17T02:01:22.290156] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-17T02:01:22.446216] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T02:01:22.841739] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T02:01:23.095208] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-17T02:01:23.111204] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T02:01:23.890089] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-17T02:01:24.208110] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T02:01:24.690125] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-17T02:01:25.310615] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T02:01:25.490173] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-17T02:01:25.918046] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T02:01:26.290201] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-17T02:01:26.456553] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T02:01:26.459410] [INFO ] [REMOTE ] AOMR: Full fetch complete (22997 records). [2025-09-17T02:01:26.459548] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-17T02:01:26.899628] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-17T02:01:26.899767] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-17T02:01:26.900150] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-17T02:01:26.900207] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-17T02:01:26.901034] [DEBUG] [LOCAL ] AOMR: Trimmed 22997 records to 17073 (keeping 200 days of data) [2025-09-17T02:01:27.005158] [DEBUG] [LOCAL ] AOMR: Primary data saved (17073 records). [2025-09-17T02:01:27.005341] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-17T02:01:27.005443] [INFO ] [MAIN ] Update Progress: 123/2369 symbols completed. AOMR took 39.8s. Estimated remaining: 5h 16m 34s. Rate: 7.1 symbols/min [2025-09-17T02:01:27.095339] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-17T02:01:27.184769] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:27.191944] [DEBUG] [LOCAL ] AP: Loaded 5815 existing records from primary storage. [2025-09-17T02:01:27.192075] [INFO ] [MAIN ] AP: Loaded 5815 existing records. [2025-09-17T02:01:27.370087] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:01:27.370359] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-17T02:01:27.370418] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-17T02:01:27.371125] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-17T02:01:27.371188] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-17T02:01:27.727481] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:27.746222] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T02:01:27.890139] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-17T02:01:28.604701] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T02:01:28.610155] [INFO ] [REMOTE ] AON: Full fetch complete (64683 records). [2025-09-17T02:01:28.610310] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-17T02:01:28.695322] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-17T02:01:29.000783] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-17T02:01:29.000890] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-17T02:01:29.001606] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-17T02:01:29.001686] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-17T02:01:29.003072] [DEBUG] [LOCAL ] AON: Trimmed 64683 records to 45693 (keeping 200 days of data) [2025-09-17T02:01:29.146930] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T02:01:29.324011] [DEBUG] [LOCAL ] AON: Primary data saved (45693 records). [2025-09-17T02:01:29.324200] [INFO ] [MAIN ] AON: Full history saved. [2025-09-17T02:01:29.324335] [INFO ] [MAIN ] Update Progress: 124/2369 symbols completed. AON took 42.1s. Estimated remaining: 5h 14m 34s. Rate: 7.1 symbols/min [2025-09-17T02:01:29.494567] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-11. [2025-09-17T02:01:29.496056] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:29.496246] [DEBUG] [LOCAL ] APAM: No existing data file found in primary storage. [2025-09-17T02:01:29.497072] [WARN ] [MAIN ] APAM: No existing data found, performing full refresh instead. [2025-09-17T02:01:29.497232] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-17T02:01:29.497306] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-17T02:01:29.497382] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-17T02:01:29.497441] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-17T02:01:29.857958] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:30.161002] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T02:01:30.222011] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:01:30.290146] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-11. [2025-09-17T02:01:31.090138] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-17T02:01:31.722812] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:01:31.890139] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-17T02:01:32.657696] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T02:01:32.690165] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-17T02:01:33.100124] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T02:01:33.490187] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-17T02:01:33.790730] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T02:01:34.290181] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-17T02:01:34.574040] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T02:01:35.090148] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-17T02:01:35.469027] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-17T02:01:35.634508] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T02:01:35.890127] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-17T02:01:36.542065] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T02:01:36.690154] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-17T02:01:37.348734] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T02:01:37.490137] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-17T02:01:37.902995] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-17T02:01:38.290150] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-17T02:01:38.908520] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T02:01:39.090153] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-17T02:01:39.890085] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-17T02:01:40.283993] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:01:40.288133] [INFO ] [REMOTE ] AORT: Full fetch complete (41306 records). [2025-09-17T02:01:40.288289] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-17T02:01:40.665058] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-17T02:01:40.665176] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-17T02:01:40.665683] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-17T02:01:40.665752] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-17T02:01:40.667127] [DEBUG] [LOCAL ] AORT: Trimmed 41306 records to 29976 (keeping 200 days of data) [2025-09-17T02:01:40.721909] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-17T02:01:40.848139] [DEBUG] [LOCAL ] AORT: Primary data saved (29976 records). [2025-09-17T02:01:40.848318] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-17T02:01:40.848457] [INFO ] [MAIN ] Update Progress: 125/2369 symbols completed. AORT took 33.2s. Estimated remaining: 5h 15m 22s. Rate: 7.1 symbols/min [2025-09-17T02:01:40.995183] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T02:01:41.027491] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:41.064500] [DEBUG] [LOCAL ] APD: Loaded 33341 existing records from primary storage. [2025-09-17T02:01:41.064716] [INFO ] [MAIN ] APD: Loaded 33341 existing records. [2025-09-17T02:01:41.244681] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:01:41.244945] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-17T02:01:41.245007] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-17T02:01:41.246359] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-17T02:01:41.246441] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-17T02:01:41.497849] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-17T02:01:41.610350] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:42.290150] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-11. [2025-09-17T02:01:42.366491] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T02:01:42.623972] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T02:01:43.090145] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-17T02:01:43.718775] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:01:43.890123] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-17T02:01:44.512231] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:01:44.690130] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-17T02:01:45.490118] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-17T02:01:45.669322] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T02:01:46.290097] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:01:46.290312] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-17T02:01:46.498546] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T02:01:47.090132] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-17T02:01:47.697905] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:01:47.890126] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-17T02:01:48.690134] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-17T02:01:48.750530] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T02:01:48.955428] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T02:01:49.490126] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-17T02:01:50.072121] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T02:01:50.290082] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-17T02:01:50.855949] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:01:51.090093] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-17T02:01:51.457121] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:01:51.890118] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-17T02:01:52.566746] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T02:01:52.690148] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-17T02:01:53.490853] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-17T02:01:53.502010] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T02:01:54.176329] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T02:01:54.290188] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-17T02:01:54.554830] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T02:01:54.689352] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T02:01:54.690756] [INFO ] [REMOTE ] AP: Full fetch complete (8594 records). [2025-09-17T02:01:54.690850] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-17T02:01:55.067240] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-17T02:01:55.067350] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-17T02:01:55.067584] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-17T02:01:55.067636] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-17T02:01:55.068108] [DEBUG] [LOCAL ] AP: Trimmed 8594 records to 6759 (keeping 200 days of data) [2025-09-17T02:01:55.095623] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-17T02:01:55.110343] [DEBUG] [LOCAL ] AP: Primary data saved (6759 records). [2025-09-17T02:01:55.110631] [INFO ] [MAIN ] AP: Full history saved. [2025-09-17T02:01:55.110763] [INFO ] [MAIN ] Update Progress: 126/2369 symbols completed. AP took 28.1s. Estimated remaining: 5h 16m 57s. Rate: 7.1 symbols/min [2025-09-17T02:01:55.280175] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:01:55.317701] [DEBUG] [LOCAL ] APG: Loaded 37860 existing records from primary storage. [2025-09-17T02:01:55.317886] [INFO ] [MAIN ] APG: Loaded 37860 existing records. [2025-09-17T02:01:55.496042] [WARN ] [MAIN ] APG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:01:55.496312] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-17T02:01:55.496372] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-17T02:01:55.497727] [DEBUG] [LOCAL ] APG: Deleted primary data file. [2025-09-17T02:01:55.497792] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-17T02:01:55.851260] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:01:55.890111] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-11. [2025-09-17T02:01:56.690162] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-17T02:01:56.915739] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T02:01:57.084417] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:01:57.490160] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-17T02:01:58.141181] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T02:01:58.290141] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-17T02:01:59.095251] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-17T02:01:59.109359] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T02:01:59.891073] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-17T02:01:59.893622] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T02:02:00.686824] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T02:02:00.695958] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-17T02:02:01.450998] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T02:02:01.490127] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-17T02:02:02.064905] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:02:02.290173] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-17T02:02:02.903948] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T02:02:03.090166] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-17T02:02:03.502316] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T02:02:03.890143] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-17T02:02:04.695426] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-17T02:02:04.724515] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T02:02:04.999862] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T02:02:05.005983] [INFO ] [REMOTE ] AOS: Full fetch complete (70557 records). [2025-09-17T02:02:05.006164] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-17T02:02:05.397620] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-17T02:02:05.397761] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-17T02:02:05.398542] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-17T02:02:05.398620] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-17T02:02:05.400187] [DEBUG] [LOCAL ] AOS: Trimmed 70557 records to 49470 (keeping 200 days of data) [2025-09-17T02:02:05.492453] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-17T02:02:05.710134] [DEBUG] [LOCAL ] AOS: Primary data saved (49470 records). [2025-09-17T02:02:05.710305] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-17T02:02:05.710407] [INFO ] [MAIN ] Update Progress: 127/2369 symbols completed. AOS took 45.1s. Estimated remaining: 5h 17m 26s. Rate: 7.1 symbols/min [2025-09-17T02:02:05.885812] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:05.925119] [DEBUG] [LOCAL ] APH: Loaded 40041 existing records from primary storage. [2025-09-17T02:02:05.925286] [INFO ] [MAIN ] APH: Loaded 40041 existing records. [2025-09-17T02:02:06.129127] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:06.130327] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T02:02:06.130750] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-17T02:02:06.135176] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-17T02:02:06.135406] [INFO ] [REMOTE ] APAM: Full fetch complete (51566 records). [2025-09-17T02:02:06.135594] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-17T02:02:06.167989] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-17T02:02:06.201408] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-17T02:02:06.297815] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-17T02:02:06.917449] [DEBUG] [VALIDATOR ] APAM: All expected trading days are present. [2025-09-17T02:02:06.949021] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:06.949468] [DEBUG] [VALIDATOR ] APAM: Primary data validation passed. [2025-09-17T02:02:06.950306] [INFO ] [MAIN ] APAM: Fetched primary data is valid. [2025-09-17T02:02:06.950428] [DEBUG] [LOCAL ] APAM: Saving primary data. [2025-09-17T02:02:06.951842] [DEBUG] [LOCAL ] APAM: Trimmed 51566 records to 36872 (keeping 200 days of data) [2025-09-17T02:02:07.075991] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T02:02:07.092775] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-11. [2025-09-17T02:02:07.228960] [DEBUG] [LOCAL ] APAM: Primary data saved (36872 records). [2025-09-17T02:02:07.229164] [INFO ] [MAIN ] APAM: Full history saved. [2025-09-17T02:02:07.229256] [INFO ] [MAIN ] Update Progress: 128/2369 symbols completed. APAM took 37.9s. Estimated remaining: 5h 15m 16s. Rate: 7.1 symbols/min [2025-09-17T02:02:07.398112] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:07.439750] [DEBUG] [LOCAL ] APLE: Loaded 38699 existing records from primary storage. [2025-09-17T02:02:07.439937] [INFO ] [MAIN ] APLE: Loaded 38699 existing records. [2025-09-17T02:02:07.625953] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:07.626223] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-17T02:02:07.626281] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-17T02:02:07.627906] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-17T02:02:07.627993] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-17T02:02:07.897416] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-17T02:02:07.991785] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:08.022276] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T02:02:08.656339] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T02:02:08.690170] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-17T02:02:09.490163] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-11. [2025-09-17T02:02:09.618678] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T02:02:10.290153] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-17T02:02:10.518255] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T02:02:10.820796] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T02:02:11.090133] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-17T02:02:11.579402] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T02:02:11.890138] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-17T02:02:12.690102] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-17T02:02:12.793146] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T02:02:13.233731] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T02:02:13.239065] [INFO ] [REMOTE ] APD: Full fetch complete (66394 records). [2025-09-17T02:02:13.239224] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-17T02:02:13.502017] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-17T02:02:13.641899] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-17T02:02:13.642022] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-17T02:02:13.642820] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-17T02:02:13.642897] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-17T02:02:13.644772] [DEBUG] [LOCAL ] APD: Trimmed 66394 records to 45559 (keeping 200 days of data) [2025-09-17T02:02:13.939803] [DEBUG] [LOCAL ] APD: Primary data saved (45559 records). [2025-09-17T02:02:13.939973] [INFO ] [MAIN ] APD: Full history saved. [2025-09-17T02:02:13.940091] [INFO ] [MAIN ] Update Progress: 129/2369 symbols completed. APD took 33.1s. Estimated remaining: 5h 14m 37s. Rate: 7.1 symbols/min [2025-09-17T02:02:14.109810] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:14.151512] [DEBUG] [LOCAL ] APO: Loaded 39757 existing records from primary storage. [2025-09-17T02:02:14.151706] [INFO ] [MAIN ] APO: Loaded 39757 existing records. [2025-09-17T02:02:14.291590] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-17T02:02:14.331226] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:14.332373] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-17T02:02:14.332495] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-17T02:02:14.334471] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-17T02:02:14.334685] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-17T02:02:14.654790] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T02:02:14.736878] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:15.090138] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-17T02:02:15.290572] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T02:02:15.890135] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-17T02:02:16.075189] [DEBUG] [REMOTE ] APG: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-17T02:02:16.075559] [WARN ] [REMOTE ] APG: No data returned for month 2025-06 [2025-09-17T02:02:16.113424] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:02:16.622786] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T02:02:16.690103] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-17T02:02:17.490128] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-17T02:02:18.290152] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-17T02:02:18.661281] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T02:02:18.988441] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T02:02:19.090163] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-17T02:02:19.890100] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-11. [2025-09-17T02:02:19.963512] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T02:02:20.690136] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-17T02:02:20.801484] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T02:02:21.490146] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-17T02:02:21.693203] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T02:02:22.290139] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-17T02:02:22.520373] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T02:02:22.940607] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T02:02:22.947014] [INFO ] [REMOTE ] APG: Full fetch complete (63798 records). [2025-09-17T02:02:22.947154] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-17T02:02:23.097113] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-17T02:02:23.140418] [WARN ] [VALIDATOR ] APG: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T02:02:23.141719] [FATAL] [MAIN ] APG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:02:23.141773] [WARN ] [MAIN ] APG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:02:23.141822] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-17T02:02:23.141884] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-17T02:02:23.141989] [INFO ] [LOCAL ] APG: Starting deletion of derivative data. [2025-09-17T02:02:23.142377] [DEBUG] [LOCAL ] APG: Deleted derivative data file. [2025-09-17T02:02:23.142503] [INFO ] [MAIN ] Update Progress: 130/2369 symbols completed. APG took 28.0s. Estimated remaining: 5h 14m 42s. Rate: 7.1 symbols/min [2025-09-17T02:02:23.328994] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:23.336495] [DEBUG] [LOCAL ] APOS: Loaded 5235 existing records from primary storage. [2025-09-17T02:02:23.336664] [INFO ] [MAIN ] APOS: Loaded 5235 existing records. [2025-09-17T02:02:23.512472] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:23.512758] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-17T02:02:23.512818] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-17T02:02:23.513125] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-17T02:02:23.513180] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-17T02:02:23.900082] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-17T02:02:23.905448] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:24.328680] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T02:02:24.690168] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-11. [2025-09-17T02:02:24.736786] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T02:02:25.446329] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T02:02:25.490092] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-17T02:02:25.863639] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T02:02:26.290138] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-17T02:02:26.993172] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T02:02:27.090129] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-17T02:02:27.890138] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-17T02:02:28.187031] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T02:02:28.654790] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T02:02:28.690155] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-17T02:02:29.046272] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T02:02:29.490170] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-17T02:02:30.110252] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T02:02:30.290425] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-17T02:02:30.293510] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T02:02:31.090151] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-17T02:02:31.890154] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-17T02:02:32.022281] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:02:32.690130] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-17T02:02:33.137022] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T02:02:33.294433] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T02:02:33.490097] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-17T02:02:34.290135] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-17T02:02:34.573017] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T02:02:34.990543] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T02:02:35.090149] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-17T02:02:35.434616] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T02:02:35.890136] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-17T02:02:36.551952] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T02:02:36.690142] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-17T02:02:37.018757] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:02:37.470347] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T02:02:37.490131] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-17T02:02:38.038750] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T02:02:38.290126] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-17T02:02:39.078707] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T02:02:39.090234] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-17T02:02:39.890171] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-17T02:02:40.690195] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-17T02:02:41.227467] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T02:02:41.490173] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-17T02:02:41.986677] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-17T02:02:42.015254] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T02:02:42.023822] [INFO ] [REMOTE ] APLE: Full fetch complete (74032 records). [2025-09-17T02:02:42.024011] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-17T02:02:42.297208] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-17T02:02:42.419272] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-17T02:02:42.419380] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-17T02:02:42.420148] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-17T02:02:42.420215] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-17T02:02:42.421679] [DEBUG] [LOCAL ] APLE: Trimmed 74032 records to 52087 (keeping 200 days of data) [2025-09-17T02:02:42.743259] [DEBUG] [LOCAL ] APLE: Primary data saved (52087 records). [2025-09-17T02:02:42.743451] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-17T02:02:42.743607] [INFO ] [MAIN ] Update Progress: 131/2369 symbols completed. APLE took 35.5s. Estimated remaining: 5h 17m 45s. Rate: 7.0 symbols/min [2025-09-17T02:02:42.872196] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T02:02:42.924400] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:42.963524] [DEBUG] [LOCAL ] APTV: Loaded 38716 existing records from primary storage. [2025-09-17T02:02:42.963705] [INFO ] [MAIN ] APTV: Loaded 38716 existing records. [2025-09-17T02:02:43.103011] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-17T02:02:43.143451] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:43.143675] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-17T02:02:43.143739] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-17T02:02:43.145373] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-17T02:02:43.145451] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-17T02:02:43.512787] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:43.548124] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T02:02:43.821829] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T02:02:43.890145] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-17T02:02:44.690138] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-11. [2025-09-17T02:02:45.490142] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-17T02:02:45.759563] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T02:02:46.118577] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T02:02:46.121042] [INFO ] [REMOTE ] APOS: Full fetch complete (10425 records). [2025-09-17T02:02:46.121204] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-17T02:02:46.298509] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-17T02:02:46.601075] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T02:02:46.727601] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-17T02:02:46.727795] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-17T02:02:46.728348] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-17T02:02:46.728441] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-17T02:02:46.729535] [DEBUG] [LOCAL ] APOS: Trimmed 10425 records to 7511 (keeping 200 days of data) [2025-09-17T02:02:46.807320] [DEBUG] [LOCAL ] APOS: Primary data saved (7511 records). [2025-09-17T02:02:46.810629] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-17T02:02:46.812925] [INFO ] [MAIN ] Update Progress: 132/2369 symbols completed. APOS took 23.7s. Estimated remaining: 5h 16m 21s. Rate: 7.1 symbols/min [2025-09-17T02:02:47.089439] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:47.090155] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-17T02:02:47.145890] [DEBUG] [LOCAL ] AQN: Loaded 38517 existing records from primary storage. [2025-09-17T02:02:47.146095] [INFO ] [MAIN ] AQN: Loaded 38517 existing records. [2025-09-17T02:02:47.337154] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:47.337441] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-17T02:02:47.337521] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-17T02:02:47.338985] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-17T02:02:47.339080] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-17T02:02:47.720499] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:47.890146] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-17T02:02:48.406156] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T02:02:48.690131] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-17T02:02:48.860313] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T02:02:49.490112] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-11. [2025-09-17T02:02:49.824293] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T02:02:49.833690] [INFO ] [REMOTE ] APH: Full fetch complete (77519 records). [2025-09-17T02:02:49.833901] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-17T02:02:50.238324] [DEBUG] [VALIDATOR ] APH: All expected trading days are present. [2025-09-17T02:02:50.238527] [DEBUG] [VALIDATOR ] APH: Primary data validation passed. [2025-09-17T02:02:50.239409] [INFO ] [MAIN ] APH: Fetched primary data is valid. [2025-09-17T02:02:50.239589] [DEBUG] [LOCAL ] APH: Saving primary data. [2025-09-17T02:02:50.241444] [DEBUG] [LOCAL ] APH: Trimmed 77519 records to 53691 (keeping 200 days of data) [2025-09-17T02:02:50.316322] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-17T02:02:50.373253] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T02:02:50.638614] [DEBUG] [LOCAL ] APH: Primary data saved (53691 records). [2025-09-17T02:02:50.638812] [INFO ] [MAIN ] APH: Full history saved. [2025-09-17T02:02:50.638932] [INFO ] [MAIN ] Update Progress: 133/2369 symbols completed. APH took 44.9s. Estimated remaining: 5h 14m 54s. Rate: 7.1 symbols/min [2025-09-17T02:02:50.809920] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:50.815834] [DEBUG] [LOCAL ] AQNB: Loaded 2917 existing records from primary storage. [2025-09-17T02:02:50.815989] [INFO ] [MAIN ] AQNB: Loaded 2917 existing records. [2025-09-17T02:02:50.994251] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:50.994526] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-17T02:02:50.994620] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-17T02:02:50.995052] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-17T02:02:50.995124] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-17T02:02:51.095252] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-17T02:02:51.360133] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:51.389673] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T02:02:51.890137] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-11. [2025-09-17T02:02:52.003227] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T02:02:52.230913] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-17T02:02:52.381777] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T02:02:52.391692] [INFO ] [REMOTE ] APO: Full fetch complete (77122 records). [2025-09-17T02:02:52.391912] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-17T02:02:52.695257] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-17T02:02:52.831608] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-17T02:02:52.831754] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-17T02:02:52.832592] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-17T02:02:52.832697] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-17T02:02:52.834416] [DEBUG] [LOCAL ] APO: Trimmed 77122 records to 53385 (keeping 200 days of data) [2025-09-17T02:02:53.192365] [DEBUG] [LOCAL ] APO: Primary data saved (53385 records). [2025-09-17T02:02:53.192544] [INFO ] [MAIN ] APO: Full history saved. [2025-09-17T02:02:53.197776] [INFO ] [MAIN ] Update Progress: 134/2369 symbols completed. APO took 39.3s. Estimated remaining: 5h 13m 7s. Rate: 7.1 symbols/min [2025-09-17T02:02:53.366406] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:02:53.411407] [DEBUG] [LOCAL ] AR: Loaded 39952 existing records from primary storage. [2025-09-17T02:02:53.411632] [INFO ] [MAIN ] AR: Loaded 39952 existing records. [2025-09-17T02:02:53.495233] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-17T02:02:53.604962] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:02:53.605253] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-17T02:02:53.605312] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-17T02:02:53.606932] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-17T02:02:53.607005] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-17T02:02:53.976551] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:02:54.264203] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T02:02:54.290092] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-17T02:02:54.424134] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T02:02:54.618290] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T02:02:55.090157] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-17T02:02:55.890139] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-17T02:02:56.352422] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T02:02:56.495890] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T02:02:56.690132] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-11. [2025-09-17T02:02:57.490133] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-17T02:02:57.835424] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T02:02:58.290143] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-17T02:02:58.418241] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T02:02:59.090165] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-17T02:02:59.890141] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-17T02:03:00.078821] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:03:00.349316] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T02:03:00.690162] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-17T02:03:01.490121] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-17T02:03:01.638364] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T02:03:02.290176] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-17T02:03:02.880469] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T02:03:03.090142] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-17T02:03:03.890132] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-17T02:03:04.655407] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (3.17 seconds). [2025-09-17T02:03:04.678384] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T02:03:04.690072] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-17T02:03:05.490178] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-17T02:03:05.591908] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T02:03:06.290117] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-17T02:03:06.425851] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-17T02:03:06.644443] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (3.55 seconds). [2025-09-17T02:03:06.778375] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T02:03:06.910005] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T02:03:07.090179] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-17T02:03:07.890140] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-17T02:03:08.690159] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-17T02:03:08.776893] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:03:09.281433] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T02:03:09.342583] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T02:03:09.490131] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-17T02:03:10.290131] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-17T02:03:11.042171] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T02:03:11.090120] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-17T02:03:11.769809] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T02:03:11.890133] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-17T02:03:12.421107] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T02:03:12.690125] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-17T02:03:12.756673] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T02:03:13.030665] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T02:03:13.031933] [INFO ] [REMOTE ] AQNB: Full fetch complete (5972 records). [2025-09-17T02:03:13.032034] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-17T02:03:13.410949] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-17T02:03:13.411122] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-17T02:03:13.411454] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-17T02:03:13.411530] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-17T02:03:13.412100] [DEBUG] [LOCAL ] AQNB: Trimmed 5972 records to 4213 (keeping 200 days of data) [2025-09-17T02:03:13.441923] [DEBUG] [LOCAL ] AQNB: Primary data saved (4213 records). [2025-09-17T02:03:13.442174] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-17T02:03:13.442302] [INFO ] [MAIN ] Update Progress: 135/2369 symbols completed. AQNB took 22.8s. Estimated remaining: 5h 16m 15s. Rate: 7.1 symbols/min [2025-09-17T02:03:13.499691] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-17T02:03:13.620570] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:13.652289] [DEBUG] [LOCAL ] ARCO: Loaded 33170 existing records from primary storage. [2025-09-17T02:03:13.652483] [INFO ] [MAIN ] ARCO: Loaded 33170 existing records. [2025-09-17T02:03:13.827847] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:13.828127] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-17T02:03:13.828194] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-17T02:03:13.829163] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-17T02:03:13.829232] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-17T02:03:14.179225] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:14.290145] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-17T02:03:15.090179] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-17T02:03:15.492129] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T02:03:15.890152] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-11. [2025-09-17T02:03:16.139529] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T02:03:16.690153] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-17T02:03:16.736912] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:03:16.744189] [INFO ] [REMOTE ] APTV: Full fetch complete (75954 records). [2025-09-17T02:03:16.744337] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-17T02:03:17.151789] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-17T02:03:17.151893] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-17T02:03:17.152631] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-17T02:03:17.152708] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-17T02:03:17.154167] [DEBUG] [LOCAL ] APTV: Trimmed 75954 records to 52269 (keeping 200 days of data) [2025-09-17T02:03:17.406317] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T02:03:17.492716] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-17T02:03:17.501905] [DEBUG] [LOCAL ] APTV: Primary data saved (52269 records). [2025-09-17T02:03:17.502087] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-17T02:03:17.502197] [INFO ] [MAIN ] Update Progress: 136/2369 symbols completed. APTV took 34.8s. Estimated remaining: 5h 14m 53s. Rate: 7.1 symbols/min [2025-09-17T02:03:17.670326] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:17.682131] [DEBUG] [LOCAL ] ARDC: Loaded 10395 existing records from primary storage. [2025-09-17T02:03:17.682278] [INFO ] [MAIN ] ARDC: Loaded 10395 existing records. [2025-09-17T02:03:17.859665] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:17.859927] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-17T02:03:17.859992] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-17T02:03:17.860628] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-17T02:03:17.860712] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-17T02:03:18.219967] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:18.249768] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:03:18.290086] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-11. [2025-09-17T02:03:18.873553] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T02:03:19.090174] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-17T02:03:19.152714] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T02:03:19.890131] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-17T02:03:20.690169] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-17T02:03:21.464575] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-17T02:03:21.490086] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-17T02:03:21.559826] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T02:03:21.780520] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T02:03:22.290130] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-17T02:03:22.790035] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T02:03:23.090115] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-17T02:03:23.890136] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-17T02:03:24.067529] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T02:03:24.690126] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-17T02:03:24.856902] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T02:03:25.412446] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T02:03:25.490304] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T02:03:25.490470] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-17T02:03:26.290129] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-17T02:03:26.921443] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T02:03:26.928387] [INFO ] [REMOTE ] AQN: Full fetch complete (75081 records). [2025-09-17T02:03:26.928568] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-17T02:03:27.090928] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-17T02:03:27.265891] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T02:03:27.356230] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-17T02:03:27.356348] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-17T02:03:27.357183] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-17T02:03:27.357257] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-17T02:03:27.359138] [DEBUG] [LOCAL ] AQN: Trimmed 75081 records to 51986 (keeping 200 days of data) [2025-09-17T02:03:27.665692] [DEBUG] [LOCAL ] AQN: Primary data saved (51986 records). [2025-09-17T02:03:27.665854] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-17T02:03:27.665949] [INFO ] [MAIN ] Update Progress: 137/2369 symbols completed. AQN took 40.9s. Estimated remaining: 5h 15m 13s. Rate: 7.1 symbols/min [2025-09-17T02:03:27.837992] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:27.857788] [DEBUG] [LOCAL ] ARDT: Loaded 20016 existing records from primary storage. [2025-09-17T02:03:27.857930] [INFO ] [MAIN ] ARDT: Loaded 20016 existing records. [2025-09-17T02:03:27.900037] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-17T02:03:28.037488] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:28.037739] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-17T02:03:28.037798] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-17T02:03:28.038538] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-17T02:03:28.038598] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-17T02:03:28.396184] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:28.690187] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-17T02:03:28.735844] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T02:03:29.490143] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-17T02:03:29.763353] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T02:03:29.789506] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T02:03:30.290131] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-11. [2025-09-17T02:03:31.059337] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:03:31.090106] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-17T02:03:31.246916] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T02:03:31.890139] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-17T02:03:32.653668] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:03:32.690086] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-17T02:03:33.490096] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-17T02:03:33.609962] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T02:03:33.862702] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:03:34.290100] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-17T02:03:34.314705] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T02:03:35.090125] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-17T02:03:35.111077] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T02:03:35.890133] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-17T02:03:36.351032] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T02:03:36.690154] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-17T02:03:36.916135] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T02:03:37.490125] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-17T02:03:37.960805] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T02:03:38.295497] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-17T02:03:38.298156] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T02:03:39.090203] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-17T02:03:39.890278] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-17T02:03:40.271770] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T02:03:40.619012] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T02:03:40.690097] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-17T02:03:40.773267] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T02:03:41.490152] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-17T02:03:42.147502] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T02:03:42.290125] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-17T02:03:42.367917] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T02:03:42.370231] [INFO ] [REMOTE ] ARDC: Full fetch complete (20227 records). [2025-09-17T02:03:42.370353] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-17T02:03:42.740273] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-17T02:03:42.740379] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-17T02:03:42.740718] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-17T02:03:42.740773] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-17T02:03:42.741381] [DEBUG] [LOCAL ] ARDC: Trimmed 20227 records to 14850 (keeping 200 days of data) [2025-09-17T02:03:42.833526] [DEBUG] [LOCAL ] ARDC: Primary data saved (14850 records). [2025-09-17T02:03:42.833717] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-17T02:03:42.833809] [INFO ] [MAIN ] Update Progress: 138/2369 symbols completed. ARDC took 25.3s. Estimated remaining: 5h 16m 52s. Rate: 7.0 symbols/min [2025-09-17T02:03:43.008471] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:43.047125] [DEBUG] [LOCAL ] ARE: Loaded 37881 existing records from primary storage. [2025-09-17T02:03:43.047298] [INFO ] [MAIN ] ARE: Loaded 37881 existing records. [2025-09-17T02:03:43.095258] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-17T02:03:43.238098] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:43.238386] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-17T02:03:43.238460] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-17T02:03:43.240016] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-17T02:03:43.240091] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-17T02:03:43.615880] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:43.890137] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-11. [2025-09-17T02:03:43.989116] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T02:03:43.997139] [INFO ] [REMOTE ] AR: Full fetch complete (77353 records). [2025-09-17T02:03:43.997320] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-17T02:03:44.397351] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-17T02:03:44.397473] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-17T02:03:44.398287] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-17T02:03:44.398348] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-17T02:03:44.399943] [DEBUG] [LOCAL ] AR: Trimmed 77353 records to 53586 (keeping 200 days of data) [2025-09-17T02:03:44.693700] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-17T02:03:44.723119] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T02:03:44.749729] [DEBUG] [LOCAL ] AR: Primary data saved (53586 records). [2025-09-17T02:03:44.750520] [INFO ] [MAIN ] AR: Full history saved. [2025-09-17T02:03:44.751872] [INFO ] [MAIN ] Update Progress: 139/2369 symbols completed. AR took 51.6s. Estimated remaining: 5h 14m 58s. Rate: 7.1 symbols/min [2025-09-17T02:03:44.921406] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:44.961111] [DEBUG] [LOCAL ] ARES: Loaded 36531 existing records from primary storage. [2025-09-17T02:03:44.961281] [INFO ] [MAIN ] ARES: Loaded 36531 existing records. [2025-09-17T02:03:45.145072] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:45.145406] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-17T02:03:45.145469] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-17T02:03:45.147013] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-17T02:03:45.147078] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-17T02:03:45.495058] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-17T02:03:45.499718] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:45.594004] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:03:46.290128] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-17T02:03:46.356078] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T02:03:46.431942] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T02:03:47.090132] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-17T02:03:47.890097] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-11. [2025-09-17T02:03:48.065847] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T02:03:48.268145] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:03:48.690155] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-17T02:03:49.490140] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-17T02:03:49.559576] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T02:03:49.632675] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T02:03:50.290134] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-17T02:03:50.644902] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T02:03:50.650258] [INFO ] [REMOTE ] ARCO: Full fetch complete (65819 records). [2025-09-17T02:03:50.650404] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-17T02:03:51.029944] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-17T02:03:51.030055] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-17T02:03:51.030780] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-17T02:03:51.030864] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-17T02:03:51.032202] [DEBUG] [LOCAL ] ARCO: Trimmed 65819 records to 44788 (keeping 200 days of data) [2025-09-17T02:03:51.091842] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-17T02:03:51.293491] [DEBUG] [LOCAL ] ARCO: Primary data saved (44788 records). [2025-09-17T02:03:51.293680] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-17T02:03:51.293832] [INFO ] [MAIN ] Update Progress: 140/2369 symbols completed. ARCO took 37.9s. Estimated remaining: 5h 14m 19s. Rate: 7.1 symbols/min [2025-09-17T02:03:51.464563] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:51.496236] [DEBUG] [LOCAL ] ARI: Loaded 32069 existing records from primary storage. [2025-09-17T02:03:51.496415] [INFO ] [MAIN ] ARI: Loaded 32069 existing records. [2025-09-17T02:03:51.674722] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:03:51.675001] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-17T02:03:51.675074] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-17T02:03:51.676286] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-17T02:03:51.676368] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-17T02:03:51.912266] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-17T02:03:52.043802] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:03:52.062559] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:52.690131] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-11. [2025-09-17T02:03:52.750223] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T02:03:53.490105] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-17T02:03:53.780581] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T02:03:54.061985] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T02:03:54.290184] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-17T02:03:55.090097] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-17T02:03:55.180493] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T02:03:55.879716] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T02:03:55.890064] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-17T02:03:55.988445] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T02:03:56.690131] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-17T02:03:57.150141] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T02:03:57.490096] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-17T02:03:57.811511] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T02:03:57.815365] [INFO ] [REMOTE ] ARDT: Full fetch complete (40949 records). [2025-09-17T02:03:57.815612] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-17T02:03:58.205200] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-17T02:03:58.205327] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-17T02:03:58.205957] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-17T02:03:58.206042] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-17T02:03:58.207440] [DEBUG] [LOCAL ] ARDT: Trimmed 40949 records to 28796 (keeping 200 days of data) [2025-09-17T02:03:58.291928] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-17T02:03:58.381256] [DEBUG] [LOCAL ] ARDT: Primary data saved (28796 records). [2025-09-17T02:03:58.381437] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-17T02:03:58.381559] [INFO ] [MAIN ] Update Progress: 141/2369 symbols completed. ARDT took 30.7s. Estimated remaining: 5h 13m 48s. Rate: 7.1 symbols/min [2025-09-17T02:03:58.557054] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:03:58.557283] [DEBUG] [LOCAL ] ARIS: No existing data file found in primary storage. [2025-09-17T02:03:58.557333] [WARN ] [MAIN ] ARIS: No existing data found, performing full refresh instead. [2025-09-17T02:03:58.557449] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-17T02:03:58.557503] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-17T02:03:58.557570] [DEBUG] [LOCAL ] ARIS: No primary data file found to delete. [2025-09-17T02:03:58.557616] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-17T02:03:58.962821] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:03:58.990397] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T02:03:59.090101] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-11. [2025-09-17T02:03:59.890170] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-17T02:04:00.078527] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T02:04:00.542677] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T02:04:00.690149] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-17T02:04:01.490124] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-17T02:04:01.597107] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T02:04:02.036213] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T02:04:02.290144] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-17T02:04:03.090117] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-17T02:04:03.265952] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:04:03.890153] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-17T02:04:04.211555] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T02:04:04.412205] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T02:04:04.690158] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-17T02:04:05.490144] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-17T02:04:05.708453] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T02:04:05.863051] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T02:04:06.290128] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-17T02:04:07.090137] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-17T02:04:07.126367] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T02:04:07.881204] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T02:04:07.890264] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-17T02:04:08.690152] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-17T02:04:08.846152] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T02:04:09.142883] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T02:04:09.490153] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-17T02:04:10.290159] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-17T02:04:10.509047] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T02:04:11.090273] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-17T02:04:11.093699] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T02:04:11.564360] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T02:04:11.890136] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-17T02:04:12.690126] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-17T02:04:12.760591] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T02:04:13.213385] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T02:04:13.490130] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-17T02:04:14.268820] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T02:04:14.290081] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-17T02:04:15.090134] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-17T02:04:15.328550] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T02:04:15.629962] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T02:04:15.890156] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-17T02:04:16.503740] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:04:16.690133] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-17T02:04:17.341441] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T02:04:17.490159] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-17T02:04:17.950202] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T02:04:18.290156] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-17T02:04:18.738085] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T02:04:19.090139] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-17T02:04:19.876206] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T02:04:19.883099] [INFO ] [REMOTE ] ARES: Full fetch complete (70335 records). [2025-09-17T02:04:19.883285] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-17T02:04:19.895923] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-17T02:04:20.297755] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-17T02:04:20.297874] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-17T02:04:20.298583] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-17T02:04:20.298664] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-17T02:04:20.300361] [DEBUG] [LOCAL ] ARES: Trimmed 70335 records to 49727 (keeping 200 days of data) [2025-09-17T02:04:20.620558] [DEBUG] [LOCAL ] ARES: Primary data saved (49727 records). [2025-09-17T02:04:20.620753] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-17T02:04:20.621891] [INFO ] [MAIN ] Update Progress: 142/2369 symbols completed. ARES took 35.9s. Estimated remaining: 5h 17m 16s. Rate: 7.0 symbols/min [2025-09-17T02:04:20.700572] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-17T02:04:20.812065] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:20.850305] [DEBUG] [LOCAL ] ARLO: Loaded 32647 existing records from primary storage. [2025-09-17T02:04:20.850493] [INFO ] [MAIN ] ARLO: Loaded 32647 existing records. [2025-09-17T02:04:21.038139] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:04:21.038526] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-17T02:04:21.038606] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-17T02:04:21.049214] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-17T02:04:21.067060] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-17T02:04:21.148898] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T02:04:21.442777] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:21.490169] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-11. [2025-09-17T02:04:21.560616] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T02:04:21.685780] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T02:04:21.690773] [INFO ] [REMOTE ] ARI: Full fetch complete (62475 records). [2025-09-17T02:04:21.690900] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-17T02:04:22.088109] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-17T02:04:22.088236] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-17T02:04:22.089057] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-17T02:04:22.089127] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-17T02:04:22.090499] [DEBUG] [LOCAL ] ARI: Trimmed 62475 records to 43268 (keeping 200 days of data) [2025-09-17T02:04:22.300052] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-17T02:04:22.353511] [DEBUG] [LOCAL ] ARI: Primary data saved (43268 records). [2025-09-17T02:04:22.353691] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-17T02:04:22.353808] [INFO ] [MAIN ] Update Progress: 143/2369 symbols completed. ARI took 31.1s. Estimated remaining: 5h 15m 22s. Rate: 7.1 symbols/min [2025-09-17T02:04:22.524346] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:22.560424] [DEBUG] [LOCAL ] ARMK: Loaded 37405 existing records from primary storage. [2025-09-17T02:04:22.560607] [INFO ] [MAIN ] ARMK: Loaded 37405 existing records. [2025-09-17T02:04:22.744879] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:04:22.745217] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-17T02:04:22.745296] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-17T02:04:22.746890] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-17T02:04:22.746971] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-17T02:04:23.109662] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:23.109857] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-17T02:04:23.139602] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T02:04:23.890151] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-11. [2025-09-17T02:04:24.039485] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T02:04:24.483355] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T02:04:24.690170] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-17T02:04:25.281164] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T02:04:25.490146] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-17T02:04:26.064295] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T02:04:26.290165] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-17T02:04:27.052888] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T02:04:27.058865] [INFO ] [REMOTE ] ARE: Full fetch complete (72548 records). [2025-09-17T02:04:27.059044] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-17T02:04:27.095186] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-17T02:04:27.463287] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-17T02:04:27.463403] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-17T02:04:27.464137] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-17T02:04:27.464194] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-17T02:04:27.465655] [DEBUG] [LOCAL ] ARE: Trimmed 72548 records to 50602 (keeping 200 days of data) [2025-09-17T02:04:27.803012] [DEBUG] [LOCAL ] ARE: Primary data saved (50602 records). [2025-09-17T02:04:27.804365] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T02:04:27.812721] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-17T02:04:27.813303] [INFO ] [MAIN ] Update Progress: 144/2369 symbols completed. ARE took 45.0s. Estimated remaining: 5h 14m 26s. Rate: 7.1 symbols/min [2025-09-17T02:04:27.895218] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-17T02:04:27.991996] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:28.026939] [DEBUG] [LOCAL ] AROC: Loaded 36147 existing records from primary storage. [2025-09-17T02:04:28.027118] [INFO ] [MAIN ] AROC: Loaded 36147 existing records. [2025-09-17T02:04:28.208097] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:04:28.208368] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-17T02:04:28.208426] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-17T02:04:28.209717] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-17T02:04:28.209784] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-17T02:04:28.574099] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:28.690106] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-11. [2025-09-17T02:04:28.785468] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T02:04:29.150561] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T02:04:29.490167] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-17T02:04:30.302359] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-17T02:04:30.308398] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T02:04:30.918012] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T02:04:31.090188] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-17T02:04:31.675302] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T02:04:31.687826] [INFO ] [REMOTE ] ARIS: Full fetch complete (59258 records). [2025-09-17T02:04:31.688104] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-17T02:04:31.909158] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-17T02:04:32.253092] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-17T02:04:32.253267] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-17T02:04:32.254054] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-17T02:04:32.254128] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-17T02:04:32.255953] [DEBUG] [LOCAL ] ARIS: Trimmed 59258 records to 42003 (keeping 200 days of data) [2025-09-17T02:04:32.545089] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T02:04:32.597301] [DEBUG] [LOCAL ] ARIS: Primary data saved (42003 records). [2025-09-17T02:04:32.597497] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-17T02:04:32.597619] [INFO ] [MAIN ] Update Progress: 145/2369 symbols completed. ARIS took 34.2s. Estimated remaining: 5h 13m 21s. Rate: 7.1 symbols/min [2025-09-17T02:04:32.695388] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-17T02:04:32.779519] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:32.821007] [DEBUG] [LOCAL ] ARR: Loaded 38691 existing records from primary storage. [2025-09-17T02:04:32.821209] [INFO ] [MAIN ] ARR: Loaded 38691 existing records. [2025-09-17T02:04:33.001832] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:04:33.002126] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-17T02:04:33.002186] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-17T02:04:33.003926] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-17T02:04:33.003997] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-17T02:04:33.369285] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:33.490128] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-11. [2025-09-17T02:04:33.597322] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T02:04:34.101430] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T02:04:34.290150] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-17T02:04:35.090202] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-17T02:04:35.156484] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T02:04:35.838781] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T02:04:35.890099] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-17T02:04:36.690163] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-17T02:04:36.725713] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T02:04:37.183527] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T02:04:37.490127] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-17T02:04:38.290183] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-17T02:04:38.343285] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T02:04:38.958849] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T02:04:39.090148] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-17T02:04:39.892622] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-17T02:04:39.898002] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T02:04:40.437478] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T02:04:40.690129] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-17T02:04:41.490128] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-17T02:04:41.593454] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T02:04:42.290198] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-17T02:04:42.602373] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T02:04:42.824606] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T02:04:43.090136] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-17T02:04:43.890203] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-17T02:04:43.973044] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T02:04:44.690139] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-17T02:04:44.786270] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T02:04:45.490167] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-17T02:04:45.831179] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T02:04:46.131312] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T02:04:46.290168] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-17T02:04:46.893753] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T02:04:47.090156] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-17T02:04:47.349007] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:04:47.354620] [INFO ] [REMOTE ] ARLO: Full fetch complete (62356 records). [2025-09-17T02:04:47.354757] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-17T02:04:47.738420] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-17T02:04:47.738539] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-17T02:04:47.739167] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-17T02:04:47.739253] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-17T02:04:47.741889] [DEBUG] [LOCAL ] ARLO: Trimmed 62356 records to 44220 (keeping 200 days of data) [2025-09-17T02:04:47.909054] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-17T02:04:47.999307] [DEBUG] [LOCAL ] ARLO: Primary data saved (44220 records). [2025-09-17T02:04:47.999447] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-17T02:04:47.999558] [INFO ] [MAIN ] Update Progress: 146/2369 symbols completed. ARLO took 27.4s. Estimated remaining: 5h 14m 58s. Rate: 7.1 symbols/min [2025-09-17T02:04:48.166746] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:48.190203] [DEBUG] [LOCAL ] ARW: Loaded 23944 existing records from primary storage. [2025-09-17T02:04:48.190348] [INFO ] [MAIN ] ARW: Loaded 23944 existing records. [2025-09-17T02:04:48.370856] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:04:48.371070] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-17T02:04:48.371120] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-17T02:04:48.372006] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-17T02:04:48.372074] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-17T02:04:48.697936] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-17T02:04:48.725706] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:48.759107] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T02:04:49.490342] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-11. [2025-09-17T02:04:49.542119] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T02:04:50.290183] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-17T02:04:50.456946] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T02:04:50.893407] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T02:04:51.090142] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-17T02:04:51.706962] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T02:04:51.890095] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-17T02:04:52.572215] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T02:04:52.690126] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-17T02:04:53.490093] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-17T02:04:53.908215] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T02:04:53.982352] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T02:04:54.290133] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-17T02:04:55.090117] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-17T02:04:55.126552] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T02:04:55.451959] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T02:04:55.459379] [INFO ] [REMOTE ] ARMK: Full fetch complete (72361 records). [2025-09-17T02:04:55.459591] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-17T02:04:55.857029] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-17T02:04:55.857158] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-17T02:04:55.857894] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-17T02:04:55.857978] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-17T02:04:55.859430] [DEBUG] [LOCAL ] ARMK: Trimmed 72361 records to 50341 (keeping 200 days of data) [2025-09-17T02:04:55.923030] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-17T02:04:56.178313] [DEBUG] [LOCAL ] ARMK: Primary data saved (50341 records). [2025-09-17T02:04:56.178483] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-17T02:04:56.178586] [INFO ] [MAIN ] Update Progress: 147/2369 symbols completed. ARMK took 33.8s. Estimated remaining: 5h 14m 45s. Rate: 7.1 symbols/min [2025-09-17T02:04:56.354973] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:04:56.355228] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-17T02:04:56.355275] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-17T02:04:56.355393] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-17T02:04:56.355457] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-17T02:04:56.355511] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-17T02:04:56.355568] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-17T02:04:56.695175] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-17T02:04:56.759426] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:04:57.091808] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T02:04:57.490138] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-11. [2025-09-17T02:04:57.668030] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:04:57.712997] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:04:57.714261] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T02:04:57.714495] [WARN ] [REMOTE ] ARX: No data returned for month 2024-11 [2025-09-17T02:04:58.290144] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-17T02:04:59.090182] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-17T02:04:59.890163] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-17T02:04:59.943531] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T02:05:00.097326] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:00.097711] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-17T02:05:00.690143] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-17T02:05:00.792748] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T02:05:01.490175] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-17T02:05:02.290175] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-17T02:05:02.779288] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T02:05:02.943761] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T02:05:03.090152] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-17T02:05:03.487037] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T02:05:03.493023] [INFO ] [REMOTE ] AROC: Full fetch complete (70303 records). [2025-09-17T02:05:03.493171] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-17T02:05:03.881682] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-17T02:05:03.881790] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-17T02:05:03.882456] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-17T02:05:03.882512] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-17T02:05:03.883866] [DEBUG] [LOCAL ] AROC: Trimmed 70303 records to 49022 (keeping 200 days of data) [2025-09-17T02:05:03.943807] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-17T02:05:04.188405] [DEBUG] [LOCAL ] AROC: Primary data saved (49022 records). [2025-09-17T02:05:04.188567] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-17T02:05:04.188675] [INFO ] [MAIN ] Update Progress: 148/2369 symbols completed. AROC took 36.4s. Estimated remaining: 5h 14m 29s. Rate: 7.1 symbols/min [2025-09-17T02:05:04.233334] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:04.282172] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-17T02:05:04.370123] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:04.370279] [DEBUG] [LOCAL ] AS: No existing data file found in primary storage. [2025-09-17T02:05:04.370326] [WARN ] [MAIN ] AS: No existing data found, performing full refresh instead. [2025-09-17T02:05:04.370433] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-17T02:05:04.370484] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-17T02:05:04.370527] [DEBUG] [LOCAL ] AS: No primary data file found to delete. [2025-09-17T02:05:04.370563] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-17T02:05:04.698144] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-17T02:05:04.738437] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:05.028510] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:05:05.490129] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-17T02:05:06.117595] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T02:05:06.290147] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-17T02:05:06.961202] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T02:05:06.967671] [INFO ] [REMOTE ] ARR: Full fetch complete (74853 records). [2025-09-17T02:05:06.967823] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-17T02:05:07.098187] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-11. [2025-09-17T02:05:07.380659] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-17T02:05:07.380781] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-17T02:05:07.381581] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-17T02:05:07.381667] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-17T02:05:07.384926] [DEBUG] [LOCAL ] ARR: Trimmed 74853 records to 52034 (keeping 200 days of data) [2025-09-17T02:05:07.736504] [DEBUG] [LOCAL ] ARR: Primary data saved (52034 records). [2025-09-17T02:05:07.737880] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T02:05:07.737984] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-17T02:05:07.738284] [INFO ] [MAIN ] Update Progress: 149/2369 symbols completed. ARR took 35.1s. Estimated remaining: 5h 13m 7s. Rate: 7.1 symbols/min [2025-09-17T02:05:07.895490] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-17T02:05:07.925274] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:07.937946] [DEBUG] [LOCAL ] ASA: Loaded 10444 existing records from primary storage. [2025-09-17T02:05:07.938100] [INFO ] [MAIN ] ASA: Loaded 10444 existing records. [2025-09-17T02:05:08.113343] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:05:08.113629] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-17T02:05:08.113713] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-17T02:05:08.114322] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-17T02:05:08.114404] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-17T02:05:08.145756] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:08.194743] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-17T02:05:08.481240] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:08.690145] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-17T02:05:08.937703] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T02:05:09.490180] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-11. [2025-09-17T02:05:09.926498] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T02:05:10.287668] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T02:05:10.290709] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-17T02:05:10.893217] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T02:05:11.090145] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-17T02:05:11.302416] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:11.302882] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-17T02:05:11.890186] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-17T02:05:12.690180] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-17T02:05:12.756248] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T02:05:13.490141] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-17T02:05:13.722173] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:13.722535] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-17T02:05:14.290106] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-17T02:05:14.409248] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T02:05:14.498914] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:14.499260] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-17T02:05:15.090135] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-17T02:05:15.890136] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-17T02:05:16.109083] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:05:16.109433] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-17T02:05:16.690136] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-17T02:05:16.920252] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T02:05:17.490174] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-17T02:05:18.035350] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T02:05:18.290137] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-17T02:05:19.090103] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-17T02:05:19.264601] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T02:05:19.331678] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T02:05:19.890195] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-17T02:05:19.990421] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T02:05:20.690184] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-17T02:05:20.957357] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T02:05:21.225697] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T02:05:21.490204] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-17T02:05:22.290199] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-17T02:05:22.484326] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T02:05:23.090173] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-17T02:05:23.221968] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T02:05:23.890192] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-17T02:05:24.440601] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T02:05:24.459805] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T02:05:24.690151] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-17T02:05:25.490174] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-17T02:05:26.209225] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T02:05:26.290075] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-17T02:05:26.667025] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T02:05:26.672055] [INFO ] [REMOTE ] ARW: Full fetch complete (47376 records). [2025-09-17T02:05:26.672213] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-17T02:05:27.047250] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-17T02:05:27.047354] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-17T02:05:27.047892] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-17T02:05:27.047950] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-17T02:05:27.048968] [DEBUG] [LOCAL ] ARW: Trimmed 47376 records to 33077 (keeping 200 days of data) [2025-09-17T02:05:27.107624] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-17T02:05:27.262476] [DEBUG] [LOCAL ] ARW: Primary data saved (33077 records). [2025-09-17T02:05:27.262704] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-17T02:05:27.262824] [INFO ] [MAIN ] Update Progress: 150/2369 symbols completed. ARW took 39.3s. Estimated remaining: 5h 15m 42s. Rate: 7.0 symbols/min [2025-09-17T02:05:27.434664] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:27.434912] [DEBUG] [LOCAL ] ASAN: No existing data file found in primary storage. [2025-09-17T02:05:27.434961] [WARN ] [MAIN ] ASAN: No existing data found, performing full refresh instead. [2025-09-17T02:05:27.435067] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-17T02:05:27.435117] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-17T02:05:27.435168] [DEBUG] [LOCAL ] ASAN: No primary data file found to delete. [2025-09-17T02:05:27.435208] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-17T02:05:27.813181] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T02:05:27.812456] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:27.836132] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T02:05:27.841326] [INFO ] [REMOTE ] ARX: Full fetch complete (12016 records). [2025-09-17T02:05:27.841419] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-17T02:05:27.895231] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-17T02:05:28.024363] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 38 unique days, need 200 days [2025-09-17T02:05:28.024662] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:05:28.024716] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:05:28.024762] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-17T02:05:28.024832] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-17T02:05:28.024878] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-17T02:05:28.024945] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-17T02:05:28.025010] [INFO ] [MAIN ] Update Progress: 151/2369 symbols completed. ARX took 31.8s. Estimated remaining: 5h 13m 39s. Rate: 7.1 symbols/min [2025-09-17T02:05:28.190693] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:28.228536] [DEBUG] [LOCAL ] ASB: Loaded 36535 existing records from primary storage. [2025-09-17T02:05:28.228725] [INFO ] [MAIN ] ASB: Loaded 36535 existing records. [2025-09-17T02:05:28.403496] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:05:28.403832] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-17T02:05:28.403894] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-17T02:05:28.405413] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-17T02:05:28.405477] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-17T02:05:28.695238] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-11. [2025-09-17T02:05:28.765176] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:29.490128] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-17T02:05:29.761613] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T02:05:29.982191] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T02:05:30.290141] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-11. [2025-09-17T02:05:30.446111] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T02:05:31.090194] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-17T02:05:31.890113] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-17T02:05:31.991827] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:05:32.690133] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-17T02:05:33.067116] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T02:05:33.345677] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T02:05:33.490087] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-17T02:05:33.993757] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T02:05:34.290137] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-17T02:05:35.090182] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-17T02:05:35.283227] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T02:05:35.870598] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T02:05:35.890081] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-17T02:05:36.690144] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-17T02:05:36.744919] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T02:05:37.490134] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-17T02:05:37.610939] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T02:05:37.732285] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T02:05:38.290145] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-17T02:05:38.937166] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T02:05:38.954225] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T02:05:38.957864] [INFO ] [REMOTE ] ASA: Full fetch complete (18146 records). [2025-09-17T02:05:38.957973] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-17T02:05:39.095205] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-17T02:05:39.330771] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-17T02:05:39.330872] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-17T02:05:39.331158] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-17T02:05:39.331207] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-17T02:05:39.331803] [DEBUG] [LOCAL ] ASA: Trimmed 18146 records to 13358 (keeping 200 days of data) [2025-09-17T02:05:39.410560] [DEBUG] [LOCAL ] ASA: Primary data saved (13358 records). [2025-09-17T02:05:39.410745] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-17T02:05:39.410837] [INFO ] [MAIN ] Update Progress: 152/2369 symbols completed. ASA took 31.7s. Estimated remaining: 5h 14m 13s. Rate: 7.1 symbols/min [2025-09-17T02:05:39.579441] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:39.583888] [DEBUG] [LOCAL ] ASBA: Loaded 2522 existing records from primary storage. [2025-09-17T02:05:39.583986] [INFO ] [MAIN ] ASBA: Loaded 2522 existing records. [2025-09-17T02:05:39.765076] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:05:39.765402] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-17T02:05:39.765486] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-17T02:05:39.765838] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-17T02:05:39.765924] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-17T02:05:39.895251] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-17T02:05:40.128019] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:40.690140] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-11. [2025-09-17T02:05:40.767017] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T02:05:41.261473] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T02:05:41.490182] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-17T02:05:41.815729] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T02:05:42.290194] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-17T02:05:43.090215] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-17T02:05:43.317598] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T02:05:43.890155] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-17T02:05:44.044183] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T02:05:44.690143] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-17T02:05:44.903491] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T02:05:45.261885] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T02:05:45.490097] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-17T02:05:46.107015] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T02:05:46.290136] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-17T02:05:47.090173] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-17T02:05:47.154252] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T02:05:47.450596] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T02:05:47.890129] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-17T02:05:48.081863] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T02:05:48.690141] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-17T02:05:49.490151] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-17T02:05:49.748962] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T02:05:50.232142] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T02:05:50.264294] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T02:05:50.290098] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-17T02:05:51.090133] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-17T02:05:51.890145] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-17T02:05:52.302304] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T02:05:52.690184] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-17T02:05:52.862208] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T02:05:52.868737] [INFO ] [REMOTE ] AS: Full fetch complete (76303 records). [2025-09-17T02:05:52.868910] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-17T02:05:53.265478] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-17T02:05:53.265589] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-17T02:05:53.266377] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-17T02:05:53.266443] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-17T02:05:53.271010] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T02:05:53.272935] [DEBUG] [LOCAL ] AS: Trimmed 76303 records to 53067 (keeping 200 days of data) [2025-09-17T02:05:53.490821] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-17T02:05:53.603457] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T02:05:53.634287] [DEBUG] [LOCAL ] AS: Primary data saved (53067 records). [2025-09-17T02:05:53.634482] [INFO ] [MAIN ] AS: Full history saved. [2025-09-17T02:05:53.634572] [INFO ] [MAIN ] Update Progress: 153/2369 symbols completed. AS took 49.4s. Estimated remaining: 5h 15m 28s. Rate: 7.0 symbols/min [2025-09-17T02:05:53.806867] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:53.835568] [DEBUG] [LOCAL ] ASC: Loaded 27759 existing records from primary storage. [2025-09-17T02:05:53.835785] [INFO ] [MAIN ] ASC: Loaded 27759 existing records. [2025-09-17T02:05:54.015300] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:05:54.015562] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-17T02:05:54.015624] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-17T02:05:54.016901] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-17T02:05:54.016971] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-17T02:05:54.126892] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T02:05:54.301186] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-17T02:05:54.402700] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:55.090129] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-17T02:05:55.692900] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T02:05:55.890127] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-17T02:05:56.690137] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-17T02:05:56.964789] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:05:57.064234] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T02:05:57.334307] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T02:05:57.340553] [INFO ] [REMOTE ] ASB: Full fetch complete (71434 records). [2025-09-17T02:05:57.340752] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-17T02:05:57.495107] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-17T02:05:57.729844] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-17T02:05:57.730017] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-17T02:05:57.730731] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-17T02:05:57.730792] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-17T02:05:57.732214] [DEBUG] [LOCAL ] ASB: Trimmed 71434 records to 49653 (keeping 200 days of data) [2025-09-17T02:05:58.041106] [DEBUG] [LOCAL ] ASB: Primary data saved (49653 records). [2025-09-17T02:05:58.041271] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-17T02:05:58.041365] [INFO ] [MAIN ] Update Progress: 154/2369 symbols completed. ASB took 30.0s. Estimated remaining: 5h 14m 20s. Rate: 7.0 symbols/min [2025-09-17T02:05:58.145301] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T02:05:58.214687] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:05:58.229495] [DEBUG] [LOCAL ] ASG: Loaded 14378 existing records from primary storage. [2025-09-17T02:05:58.229664] [INFO ] [MAIN ] ASG: Loaded 14378 existing records. [2025-09-17T02:05:58.295203] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-17T02:05:58.406113] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:05:58.406355] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-17T02:05:58.406414] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-17T02:05:58.407294] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-17T02:05:58.407357] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-17T02:05:58.759050] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:05:59.090101] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-11. [2025-09-17T02:05:59.890140] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-17T02:06:00.061270] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T02:06:00.067850] [INFO ] [REMOTE ] ASAN: Full fetch complete (76368 records). [2025-09-17T02:06:00.068036] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-17T02:06:00.426236] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T02:06:00.465672] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-17T02:06:00.465782] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-17T02:06:00.466707] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-17T02:06:00.466802] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-17T02:06:00.468422] [DEBUG] [LOCAL ] ASAN: Trimmed 76368 records to 52754 (keeping 200 days of data) [2025-09-17T02:06:00.690232] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-17T02:06:00.796146] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T02:06:00.820875] [DEBUG] [LOCAL ] ASAN: Primary data saved (52754 records). [2025-09-17T02:06:00.821021] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-17T02:06:00.821102] [INFO ] [MAIN ] Update Progress: 155/2369 symbols completed. ASAN took 33.6s. Estimated remaining: 5h 12m 49s. Rate: 7.1 symbols/min [2025-09-17T02:06:00.988929] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:01.006076] [DEBUG] [LOCAL ] ASGI: Loaded 16802 existing records from primary storage. [2025-09-17T02:06:01.006249] [INFO ] [MAIN ] ASGI: Loaded 16802 existing records. [2025-09-17T02:06:01.183884] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:06:01.184122] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-17T02:06:01.184201] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-17T02:06:01.185382] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-17T02:06:01.185466] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-17T02:06:01.464349] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T02:06:01.492483] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-17T02:06:01.588401] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:02.290138] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-11. [2025-09-17T02:06:03.090145] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-17T02:06:03.890135] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-11. [2025-09-17T02:06:04.360633] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T02:06:04.690115] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-17T02:06:04.759516] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (3.27 seconds). [2025-09-17T02:06:05.057880] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T02:06:05.216244] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T02:06:05.217254] [INFO ] [REMOTE ] ASBA: Full fetch complete (5306 records). [2025-09-17T02:06:05.217338] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-17T02:06:05.495718] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-17T02:06:05.530591] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-11 (3.24 seconds). [2025-09-17T02:06:05.614027] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-17T02:06:05.614139] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-17T02:06:05.614301] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-17T02:06:05.614350] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-17T02:06:05.615098] [DEBUG] [LOCAL ] ASBA: Trimmed 5306 records to 3437 (keeping 200 days of data) [2025-09-17T02:06:05.636268] [DEBUG] [LOCAL ] ASBA: Primary data saved (3437 records). [2025-09-17T02:06:05.636354] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-17T02:06:05.636462] [INFO ] [MAIN ] Update Progress: 156/2369 symbols completed. ASBA took 26.2s. Estimated remaining: 5h 11m 49s. Rate: 7.1 symbols/min [2025-09-17T02:06:05.803284] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:05.803494] [DEBUG] [LOCAL ] ASGN: No existing data file found in primary storage. [2025-09-17T02:06:05.803561] [WARN ] [MAIN ] ASGN: No existing data found, performing full refresh instead. [2025-09-17T02:06:05.803735] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-17T02:06:05.803797] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-17T02:06:05.803848] [DEBUG] [LOCAL ] ASGN: No primary data file found to delete. [2025-09-17T02:06:05.803889] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-17T02:06:06.156138] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:06.290124] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-17T02:06:07.090168] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-17T02:06:07.155372] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T02:06:07.455336] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T02:06:07.890155] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-17T02:06:08.204214] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:06:08.690132] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-11. [2025-09-17T02:06:09.040078] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:06:09.490167] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-17T02:06:10.060505] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T02:06:10.290137] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-17T02:06:10.636490] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:06:11.090150] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-17T02:06:11.335629] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:06:11.890190] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-17T02:06:12.359192] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T02:06:12.690162] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-17T02:06:13.207147] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T02:06:13.490127] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-17T02:06:13.757504] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T02:06:14.290196] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-17T02:06:14.594374] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T02:06:15.090156] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-17T02:06:15.890195] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-17T02:06:15.944516] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T02:06:16.690173] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-17T02:06:16.821812] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T02:06:17.490131] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-17T02:06:17.748867] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T02:06:18.290216] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-17T02:06:18.623371] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T02:06:18.693445] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T02:06:19.090145] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-17T02:06:19.763837] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T02:06:19.890209] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-17T02:06:20.700007] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-17T02:06:20.722572] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T02:06:20.951198] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T02:06:21.490124] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-17T02:06:22.258591] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T02:06:22.290142] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-17T02:06:22.602280] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:06:23.090143] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-17T02:06:23.853954] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T02:06:23.890093] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-17T02:06:24.028336] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T02:06:24.690147] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-17T02:06:25.134070] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T02:06:25.490139] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-17T02:06:26.228940] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T02:06:26.290118] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-17T02:06:26.500685] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T02:06:27.090156] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-17T02:06:27.742970] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T02:06:27.888101] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T02:06:27.893179] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-17T02:06:28.690127] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-17T02:06:28.795508] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T02:06:29.490164] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-17T02:06:29.592859] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T02:06:29.597831] [INFO ] [REMOTE ] ASC: Full fetch complete (57547 records). [2025-09-17T02:06:29.598023] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-17T02:06:30.000278] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-17T02:06:30.000400] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-17T02:06:30.001085] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-17T02:06:30.001175] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-17T02:06:30.002489] [DEBUG] [LOCAL ] ASC: Trimmed 57547 records to 38179 (keeping 200 days of data) [2025-09-17T02:06:30.237521] [DEBUG] [LOCAL ] ASC: Primary data saved (38179 records). [2025-09-17T02:06:30.237710] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-17T02:06:30.237822] [INFO ] [MAIN ] Update Progress: 157/2369 symbols completed. ASC took 36.6s. Estimated remaining: 5h 15m 28s. Rate: 7.0 symbols/min [2025-09-17T02:06:30.290148] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-17T02:06:30.428060] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T02:06:31.090230] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-17T02:06:31.417943] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T02:06:31.890135] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-17T02:06:32.667669] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T02:06:32.690151] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-17T02:06:32.890995] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T02:06:32.894534] [INFO ] [REMOTE ] ASGI: Full fetch complete (33069 records). [2025-09-17T02:06:32.894663] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-17T02:06:33.267117] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-17T02:06:33.267223] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-17T02:06:33.267706] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-17T02:06:33.267791] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-17T02:06:33.268907] [DEBUG] [LOCAL ] ASGI: Trimmed 33069 records to 22154 (keeping 200 days of data) [2025-09-17T02:06:33.405311] [DEBUG] [LOCAL ] ASGI: Primary data saved (22154 records). [2025-09-17T02:06:33.405466] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-17T02:06:33.405570] [INFO ] [MAIN ] Update Progress: 158/2369 symbols completed. ASGI took 32.6s. Estimated remaining: 5h 14m 4s. Rate: 7.0 symbols/min [2025-09-17T02:06:33.490124] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-17T02:06:34.007224] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T02:06:34.290146] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-17T02:06:34.577453] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T02:06:35.090136] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-17T02:06:35.567930] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T02:06:35.572765] [INFO ] [REMOTE ] ASGN: Full fetch complete (51219 records). [2025-09-17T02:06:35.572969] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-17T02:06:36.188028] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-17T02:06:36.188211] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-17T02:06:36.189461] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-17T02:06:36.189583] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-17T02:06:36.191519] [DEBUG] [LOCAL ] ASGN: Trimmed 51219 records to 36021 (keeping 200 days of data) [2025-09-17T02:06:36.347774] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T02:06:36.359401] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-17T02:06:36.540204] [DEBUG] [LOCAL ] ASGN: Primary data saved (36021 records). [2025-09-17T02:06:36.540427] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-17T02:06:36.540533] [INFO ] [MAIN ] Update Progress: 159/2369 symbols completed. ASGN took 30.9s. Estimated remaining: 5h 12m 40s. Rate: 7.1 symbols/min [2025-09-17T02:06:37.154891] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T02:06:37.159512] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-17T02:06:38.129363] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T02:06:38.132326] [INFO ] [REMOTE ] ASG: Full fetch complete (31626 records). [2025-09-17T02:06:38.132441] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-17T02:06:38.531624] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-17T02:06:38.531748] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-17T02:06:38.532182] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-17T02:06:38.532240] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-17T02:06:38.533038] [DEBUG] [LOCAL ] ASG: Trimmed 31626 records to 21145 (keeping 200 days of data) [2025-09-17T02:06:38.659738] [DEBUG] [LOCAL ] ASG: Primary data saved (21145 records). [2025-09-17T02:06:38.659886] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-17T02:06:38.659976] [INFO ] [MAIN ] Update Progress: 160/2369 symbols completed. ASG took 40.6s. Estimated remaining: 5h 11m 4s. Rate: 7.1 symbols/min [2025-09-17T02:06:39.207540] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:39.308869] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:39.310967] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:39.353898] [DEBUG] [LOCAL ] ASH: No existing data file found in primary storage. [2025-09-17T02:06:39.354683] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:06:39.355106] [WARN ] [MAIN ] ASH: No existing data found, performing full refresh instead. [2025-09-17T02:06:39.355842] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-17T02:06:39.355998] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-17T02:06:39.356067] [DEBUG] [LOCAL ] ASH: No primary data file found to delete. [2025-09-17T02:06:39.356141] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-17T02:06:39.475213] [DEBUG] [LOCAL ] ASR: Loaded 7108 existing records from primary storage. [2025-09-17T02:06:39.499329] [INFO ] [MAIN ] ASR: Loaded 7108 existing records. [2025-09-17T02:06:39.634132] [DEBUG] [LOCAL ] ASIX: Loaded 17000 existing records from primary storage. [2025-09-17T02:06:39.698623] [INFO ] [MAIN ] ASIX: Loaded 17000 existing records. [2025-09-17T02:06:39.735230] [DEBUG] [LOCAL ] ASPN: Loaded 36948 existing records from primary storage. [2025-09-17T02:06:39.748048] [INFO ] [MAIN ] ASPN: Loaded 36948 existing records. [2025-09-17T02:06:40.022232] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:06:40.150991] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:40.167533] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-11. [2025-09-17T02:06:40.151108] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-17T02:06:40.195396] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-17T02:06:40.277664] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-17T02:06:40.284144] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:06:40.309038] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-17T02:06:40.315360] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:06:40.351293] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-17T02:06:40.373836] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-17T02:06:40.393567] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-17T02:06:40.403871] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-17T02:06:40.421078] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-17T02:06:40.421624] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-17T02:06:40.427039] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-17T02:06:40.443588] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-17T02:06:41.252884] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:41.350745] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-11. [2025-09-17T02:06:41.373876] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:41.414804] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-11. [2025-09-17T02:06:41.417762] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:06:41.419486] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-11. [2025-09-17T02:06:41.706103] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T02:06:41.714013] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-17T02:06:42.133297] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T02:06:42.135200] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-17T02:06:42.405898] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T02:06:42.409618] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-17T02:06:42.729453] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T02:06:42.929936] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T02:06:43.036942] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T02:06:43.090075] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-17T02:06:43.183319] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T02:06:43.890132] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-17T02:06:44.097789] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T02:06:44.690137] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-17T02:06:45.464870] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T02:06:45.469742] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T02:06:45.490081] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-17T02:06:46.290132] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-17T02:06:47.090127] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-17T02:06:47.267429] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T02:06:47.305482] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:06:47.890179] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-17T02:06:48.569242] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T02:06:48.581728] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T02:06:48.690130] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-17T02:06:49.490159] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-17T02:06:50.113128] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T02:06:50.290135] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-17T02:06:51.090149] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-17T02:06:51.269382] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T02:06:51.634100] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T02:06:51.890128] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-17T02:06:51.955244] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T02:06:52.690136] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-17T02:06:53.490126] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-17T02:06:53.603250] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T02:06:54.290181] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-17T02:06:54.349129] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T02:06:54.405786] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T02:06:55.090134] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-17T02:06:55.890103] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-17T02:06:55.952455] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T02:06:56.078079] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:06:56.690128] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-17T02:06:57.419033] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T02:06:57.490094] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-17T02:06:57.809409] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T02:06:58.290125] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-17T02:06:58.995113] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T02:06:59.090129] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-17T02:06:59.419718] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T02:06:59.890126] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-17T02:07:00.084974] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T02:07:00.690131] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-17T02:07:01.396285] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T02:07:01.490172] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-17T02:07:01.576623] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T02:07:02.290182] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-17T02:07:03.043521] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T02:07:03.090130] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-17T02:07:03.890244] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-17T02:07:04.179188] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T02:07:04.278441] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T02:07:04.690173] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-17T02:07:05.076510] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T02:07:05.490127] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-17T02:07:06.181272] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T02:07:06.290117] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-17T02:07:06.519158] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T02:07:06.522200] [INFO ] [REMOTE ] ASIX: Full fetch complete (29510 records). [2025-09-17T02:07:06.522327] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-17T02:07:06.922563] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-17T02:07:06.922695] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-17T02:07:06.923149] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-17T02:07:06.923229] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-17T02:07:06.924425] [DEBUG] [LOCAL ] ASIX: Trimmed 29510 records to 22344 (keeping 200 days of data) [2025-09-17T02:07:07.060029] [DEBUG] [LOCAL ] ASIX: Primary data saved (22344 records). [2025-09-17T02:07:07.060207] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-17T02:07:07.060330] [INFO ] [MAIN ] Update Progress: 161/2369 symbols completed. ASIX took 28.4s. Estimated remaining: 5h 15m 29s. Rate: 7.0 symbols/min [2025-09-17T02:07:07.095259] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-17T02:07:07.230080] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:07.269228] [DEBUG] [LOCAL ] ASX: Loaded 39389 existing records from primary storage. [2025-09-17T02:07:07.269437] [INFO ] [MAIN ] ASX: Loaded 39389 existing records. [2025-09-17T02:07:07.447936] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:07:07.448234] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-17T02:07:07.448312] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-17T02:07:07.449930] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-17T02:07:07.450014] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-17T02:07:07.793526] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T02:07:07.813840] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:07.890085] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-17T02:07:08.177148] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T02:07:08.690185] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-17T02:07:08.756261] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T02:07:09.490131] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-17T02:07:10.089258] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T02:07:10.095397] [INFO ] [REMOTE ] ASPN: Full fetch complete (72266 records). [2025-09-17T02:07:10.095545] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-17T02:07:10.300716] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-17T02:07:10.487884] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-17T02:07:10.488016] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-17T02:07:10.488830] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-17T02:07:10.488908] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-17T02:07:10.490446] [DEBUG] [LOCAL ] ASPN: Trimmed 72266 records to 49681 (keeping 200 days of data) [2025-09-17T02:07:10.773476] [DEBUG] [LOCAL ] ASPN: Primary data saved (49681 records). [2025-09-17T02:07:10.773689] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-17T02:07:10.773788] [INFO ] [MAIN ] Update Progress: 162/2369 symbols completed. ASPN took 32.1s. Estimated remaining: 5h 14m 14s. Rate: 7.0 symbols/min [2025-09-17T02:07:10.944073] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:10.955250] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T02:07:10.959916] [INFO ] [REMOTE ] ASH: Full fetch complete (54176 records). [2025-09-17T02:07:10.960063] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-17T02:07:11.099328] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-11. [2025-09-17T02:07:11.206638] [DEBUG] [LOCAL ] ATEN: Loaded 28678 existing records from primary storage. [2025-09-17T02:07:11.239310] [INFO ] [MAIN ] ATEN: Loaded 28678 existing records. [2025-09-17T02:07:11.504302] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T02:07:11.521103] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-17T02:07:11.544488] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-17T02:07:11.566053] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-17T02:07:11.588782] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-17T02:07:11.610055] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:07:11.610537] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-17T02:07:11.610603] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-17T02:07:11.610772] [DEBUG] [LOCAL ] ASH: Trimmed 54176 records to 38086 (keeping 200 days of data) [2025-09-17T02:07:11.612076] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-17T02:07:11.612159] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-17T02:07:11.894558] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-17T02:07:12.097771] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:12.217614] [DEBUG] [LOCAL ] ASH: Primary data saved (38086 records). [2025-09-17T02:07:12.217812] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-17T02:07:12.217943] [INFO ] [MAIN ] Update Progress: 163/2369 symbols completed. ASH took 33.6s. Estimated remaining: 5h 12m 30s. Rate: 7.1 symbols/min [2025-09-17T02:07:12.390717] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:12.390951] [DEBUG] [LOCAL ] ATGE: No existing data file found in primary storage. [2025-09-17T02:07:12.391001] [WARN ] [MAIN ] ATGE: No existing data found, performing full refresh instead. [2025-09-17T02:07:12.391105] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-17T02:07:12.391155] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-17T02:07:12.391204] [DEBUG] [LOCAL ] ATGE: No primary data file found to delete. [2025-09-17T02:07:12.391245] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-17T02:07:12.695348] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-11. [2025-09-17T02:07:12.756106] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:12.824707] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T02:07:12.972966] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T02:07:13.490136] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-17T02:07:14.134858] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T02:07:14.290174] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-11. [2025-09-17T02:07:15.090176] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-17T02:07:15.224856] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T02:07:15.438273] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:07:15.890201] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-17T02:07:16.649857] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T02:07:16.690094] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-17T02:07:16.704622] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T02:07:16.706505] [INFO ] [REMOTE ] ASR: Full fetch complete (12181 records). [2025-09-17T02:07:16.706668] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-17T02:07:17.083295] [DEBUG] [VALIDATOR ] ASR: All expected trading days are present. [2025-09-17T02:07:17.083444] [DEBUG] [VALIDATOR ] ASR: Primary data validation passed. [2025-09-17T02:07:17.083749] [INFO ] [MAIN ] ASR: Fetched primary data is valid. [2025-09-17T02:07:17.083805] [DEBUG] [LOCAL ] ASR: Saving primary data. [2025-09-17T02:07:17.084289] [DEBUG] [LOCAL ] ASR: Trimmed 12181 records to 9147 (keeping 200 days of data) [2025-09-17T02:07:17.143026] [DEBUG] [LOCAL ] ASR: Primary data saved (9147 records). [2025-09-17T02:07:17.143193] [INFO ] [MAIN ] ASR: Full history saved. [2025-09-17T02:07:17.143303] [INFO ] [MAIN ] Update Progress: 164/2369 symbols completed. ASR took 38.5s. Estimated remaining: 5h 11m 33s. Rate: 7.1 symbols/min [2025-09-17T02:07:17.338226] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:17.338480] [DEBUG] [LOCAL ] ATHM: No existing data file found in primary storage. [2025-09-17T02:07:17.338553] [WARN ] [MAIN ] ATHM: No existing data found, performing full refresh instead. [2025-09-17T02:07:17.338764] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-17T02:07:17.338824] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-17T02:07:17.338880] [DEBUG] [LOCAL ] ATHM: No primary data file found to delete. [2025-09-17T02:07:17.338925] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-17T02:07:17.498224] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-17T02:07:17.708167] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:18.106362] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:07:18.290128] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-17T02:07:18.892200] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T02:07:19.090145] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-11. [2025-09-17T02:07:19.890128] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-17T02:07:20.119559] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T02:07:20.263772] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T02:07:20.690153] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-17T02:07:21.321683] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T02:07:21.490128] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-17T02:07:22.290180] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-17T02:07:22.362841] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T02:07:22.806213] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T02:07:23.090159] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-17T02:07:23.297242] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T02:07:23.890149] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-17T02:07:24.690522] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-17T02:07:24.695404] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T02:07:24.996185] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T02:07:25.490177] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-17T02:07:26.269003] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:07:26.290103] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-17T02:07:27.090137] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-17T02:07:27.372865] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T02:07:27.890192] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-17T02:07:28.401404] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T02:07:28.676010] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T02:07:28.690116] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-17T02:07:29.440383] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:07:29.490109] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-17T02:07:30.130784] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T02:07:30.290161] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-17T02:07:31.045592] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T02:07:31.090105] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-17T02:07:31.526437] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T02:07:31.890140] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-17T02:07:32.690135] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-17T02:07:32.859655] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T02:07:33.216724] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T02:07:33.490180] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-17T02:07:34.176330] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T02:07:34.290152] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-17T02:07:34.687228] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T02:07:35.090164] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-17T02:07:35.748396] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T02:07:35.890142] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-17T02:07:36.384097] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T02:07:36.690148] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-17T02:07:37.490135] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-17T02:07:37.677337] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T02:07:37.796046] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T02:07:37.799685] [INFO ] [REMOTE ] ATGE: Full fetch complete (46187 records). [2025-09-17T02:07:37.799856] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-17T02:07:38.181567] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-17T02:07:38.181684] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-17T02:07:38.182214] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-17T02:07:38.182274] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-17T02:07:38.183246] [DEBUG] [LOCAL ] ATGE: Trimmed 46187 records to 32297 (keeping 200 days of data) [2025-09-17T02:07:38.293098] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-17T02:07:38.379779] [DEBUG] [LOCAL ] ATGE: Primary data saved (32297 records). [2025-09-17T02:07:38.379955] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-17T02:07:38.380060] [INFO ] [MAIN ] Update Progress: 165/2369 symbols completed. ATGE took 26.2s. Estimated remaining: 5h 14m 15s. Rate: 7.0 symbols/min [2025-09-17T02:07:38.559320] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:38.567789] [DEBUG] [LOCAL ] ATHS: Loaded 4952 existing records from primary storage. [2025-09-17T02:07:38.567917] [INFO ] [MAIN ] ATHS: Loaded 4952 existing records. [2025-09-17T02:07:38.750057] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:07:38.750532] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-17T02:07:38.750725] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-17T02:07:38.751273] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-17T02:07:38.751348] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-17T02:07:38.921356] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T02:07:39.095190] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-17T02:07:39.161808] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:39.890096] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-11. [2025-09-17T02:07:40.389241] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T02:07:40.428151] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-17T02:07:40.512232] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T02:07:40.690183] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-17T02:07:41.490130] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-17T02:07:41.982235] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T02:07:42.290157] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-17T02:07:42.977182] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T02:07:43.090091] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-17T02:07:43.559741] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T02:07:43.890153] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-17T02:07:44.645734] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T02:07:44.690082] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-17T02:07:45.490130] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-17T02:07:45.651592] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T02:07:45.698453] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T02:07:45.703241] [INFO ] [REMOTE ] ATEN: Full fetch complete (57489 records). [2025-09-17T02:07:45.703395] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-17T02:07:46.088344] [DEBUG] [VALIDATOR ] ATEN: All expected trading days are present. [2025-09-17T02:07:46.088464] [DEBUG] [VALIDATOR ] ATEN: Primary data validation passed. [2025-09-17T02:07:46.089132] [INFO ] [MAIN ] ATEN: Fetched primary data is valid. [2025-09-17T02:07:46.089238] [DEBUG] [LOCAL ] ATEN: Saving primary data. [2025-09-17T02:07:46.091924] [DEBUG] [LOCAL ] ATEN: Trimmed 57489 records to 40190 (keeping 200 days of data) [2025-09-17T02:07:46.311564] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-17T02:07:46.346912] [DEBUG] [LOCAL ] ATEN: Primary data saved (40190 records). [2025-09-17T02:07:46.347058] [INFO ] [MAIN ] ATEN: Full history saved. [2025-09-17T02:07:46.347167] [INFO ] [MAIN ] Update Progress: 166/2369 symbols completed. ATEN took 35.6s. Estimated remaining: 5h 13m 59s. Rate: 7.0 symbols/min [2025-09-17T02:07:46.515092] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:46.554920] [DEBUG] [LOCAL ] ATI: Loaded 38648 existing records from primary storage. [2025-09-17T02:07:46.555083] [INFO ] [MAIN ] ATI: Loaded 38648 existing records. [2025-09-17T02:07:46.739785] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:07:46.740048] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-17T02:07:46.740206] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-17T02:07:46.752005] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-17T02:07:46.753906] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-17T02:07:46.786609] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T02:07:47.109328] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-17T02:07:47.117078] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:47.797350] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T02:07:47.804525] [INFO ] [REMOTE ] ASX: Full fetch complete (76481 records). [2025-09-17T02:07:47.804760] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-17T02:07:47.898538] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-17T02:07:48.237026] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-17T02:07:48.238549] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:07:48.238658] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-17T02:07:48.246317] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-17T02:07:48.246551] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-17T02:07:48.248257] [DEBUG] [LOCAL ] ASX: Trimmed 76481 records to 52931 (keeping 200 days of data) [2025-09-17T02:07:48.576432] [DEBUG] [LOCAL ] ASX: Primary data saved (52931 records). [2025-09-17T02:07:48.576601] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-17T02:07:48.578924] [INFO ] [MAIN ] Update Progress: 167/2369 symbols completed. ASX took 41.5s. Estimated remaining: 5h 12m 27s. Rate: 7.0 symbols/min [2025-09-17T02:07:48.695263] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-11. [2025-09-17T02:07:48.752386] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:48.758658] [DEBUG] [LOCAL ] ATKR: No existing data file found in primary storage. [2025-09-17T02:07:48.759373] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T02:07:48.759445] [WARN ] [MAIN ] ATKR: No existing data found, performing full refresh instead. [2025-09-17T02:07:48.762207] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-17T02:07:48.762276] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-17T02:07:48.762337] [DEBUG] [LOCAL ] ATKR: No primary data file found to delete. [2025-09-17T02:07:48.762376] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-17T02:07:49.115043] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:49.490131] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-17T02:07:50.094621] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T02:07:50.290095] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-17T02:07:50.401982] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T02:07:51.090109] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-17T02:07:51.353061] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:07:51.358170] [INFO ] [REMOTE ] ATHM: Full fetch complete (52496 records). [2025-09-17T02:07:51.358394] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-17T02:07:51.493550] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T02:07:51.772673] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-17T02:07:51.772773] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-17T02:07:51.773331] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-17T02:07:51.773386] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-17T02:07:51.776565] [DEBUG] [LOCAL ] ATHM: Trimmed 52496 records to 33265 (keeping 200 days of data) [2025-09-17T02:07:51.890355] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-17T02:07:51.977785] [DEBUG] [LOCAL ] ATHM: Primary data saved (33265 records). [2025-09-17T02:07:51.977935] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-17T02:07:51.978030] [INFO ] [MAIN ] Update Progress: 168/2369 symbols completed. ATHM took 34.8s. Estimated remaining: 5h 11m 11s. Rate: 7.1 symbols/min [2025-09-17T02:07:52.144621] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:07:52.175380] [DEBUG] [LOCAL ] ATMU: Loaded 28708 existing records from primary storage. [2025-09-17T02:07:52.175534] [INFO ] [MAIN ] ATMU: Loaded 28708 existing records. [2025-09-17T02:07:52.355776] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:07:52.356145] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-17T02:07:52.356285] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-17T02:07:52.357457] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-17T02:07:52.357528] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-17T02:07:52.691605] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-11. [2025-09-17T02:07:52.715014] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:07:52.722123] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T02:07:53.490117] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-11. [2025-09-17T02:07:54.290121] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-17T02:07:54.325805] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:07:54.999006] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T02:07:55.090131] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-17T02:07:55.112348] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T02:07:55.890133] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-17T02:07:56.339363] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T02:07:56.690181] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-17T02:07:57.320453] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T02:07:57.490132] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-17T02:07:58.156808] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T02:07:58.216404] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T02:07:58.290138] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-17T02:07:59.090155] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-17T02:07:59.123203] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T02:07:59.890135] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-17T02:08:00.583153] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T02:08:00.612122] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T02:08:00.690119] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-17T02:08:01.490137] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-17T02:08:02.202435] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T02:08:02.290133] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-17T02:08:02.799392] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T02:08:03.090195] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-17T02:08:03.750711] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T02:08:03.890132] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-17T02:08:04.288071] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-17T02:08:04.690143] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-17T02:08:04.746487] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T02:08:05.490139] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-17T02:08:06.021254] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T02:08:06.022675] [INFO ] [REMOTE ] ATHS: Full fetch complete (10028 records). [2025-09-17T02:08:06.022763] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-17T02:08:06.299744] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-17T02:08:06.401870] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-17T02:08:06.402013] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-17T02:08:06.402409] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-17T02:08:06.402495] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-17T02:08:06.403138] [DEBUG] [LOCAL ] ATHS: Trimmed 10028 records to 7197 (keeping 200 days of data) [2025-09-17T02:08:06.467013] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:08:06.486972] [DEBUG] [LOCAL ] ATHS: Primary data saved (7197 records). [2025-09-17T02:08:06.487098] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-17T02:08:06.487188] [INFO ] [MAIN ] Update Progress: 169/2369 symbols completed. ATHS took 28.1s. Estimated remaining: 5h 12m 21s. Rate: 7.0 symbols/min [2025-09-17T02:08:06.656838] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:06.657071] [DEBUG] [LOCAL ] ATO: No existing data file found in primary storage. [2025-09-17T02:08:06.657123] [WARN ] [MAIN ] ATO: No existing data found, performing full refresh instead. [2025-09-17T02:08:06.657235] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-17T02:08:06.657284] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-17T02:08:06.657336] [DEBUG] [LOCAL ] ATO: No primary data file found to delete. [2025-09-17T02:08:06.657392] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-17T02:08:07.021460] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:07.090099] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-11. [2025-09-17T02:08:07.758676] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T02:08:07.890141] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-17T02:08:08.656079] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T02:08:08.690128] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-17T02:08:09.490147] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-17T02:08:09.613885] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T02:08:09.801827] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T02:08:10.290176] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-17T02:08:11.059240] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:08:11.090125] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-17T02:08:11.453276] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T02:08:11.890167] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-17T02:08:12.569835] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T02:08:12.690155] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-17T02:08:13.490131] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-17T02:08:13.746666] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T02:08:14.215268] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:08:14.290153] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-17T02:08:15.045219] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T02:08:15.090090] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-17T02:08:15.890105] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-17T02:08:16.037953] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:08:16.584216] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T02:08:16.690175] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-17T02:08:17.043820] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T02:08:17.490163] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-17T02:08:17.980321] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T02:08:18.290173] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-17T02:08:18.901834] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:08:19.090203] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-17T02:08:19.890169] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-17T02:08:20.118852] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T02:08:20.299785] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T02:08:20.690321] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-17T02:08:21.408828] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T02:08:21.490139] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-17T02:08:22.147929] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T02:08:22.290124] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-17T02:08:22.988581] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T02:08:23.090150] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-17T02:08:23.770118] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T02:08:23.890210] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-17T02:08:24.304741] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T02:08:24.690171] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-17T02:08:25.288094] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T02:08:25.295226] [INFO ] [REMOTE ] ATI: Full fetch complete (73504 records). [2025-09-17T02:08:25.295433] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-17T02:08:25.495020] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-17T02:08:25.725067] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-17T02:08:25.725179] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-17T02:08:25.725940] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-17T02:08:25.726003] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-17T02:08:25.727466] [DEBUG] [LOCAL ] ATI: Trimmed 73504 records to 51702 (keeping 200 days of data) [2025-09-17T02:08:26.044247] [DEBUG] [LOCAL ] ATI: Primary data saved (51702 records). [2025-09-17T02:08:26.044604] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-17T02:08:26.044736] [INFO ] [MAIN ] Update Progress: 170/2369 symbols completed. ATI took 39.7s. Estimated remaining: 5h 14m 36s. Rate: 7.0 symbols/min [2025-09-17T02:08:26.220475] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:26.243674] [DEBUG] [LOCAL ] ATR: Loaded 23182 existing records from primary storage. [2025-09-17T02:08:26.243851] [INFO ] [MAIN ] ATR: Loaded 23182 existing records. [2025-09-17T02:08:26.297848] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-17T02:08:26.427842] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:08:26.428391] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-17T02:08:26.428565] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-17T02:08:26.429863] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-17T02:08:26.429939] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-17T02:08:26.752122] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T02:08:26.842982] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:26.913006] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T02:08:26.918383] [INFO ] [REMOTE ] ATKR: Full fetch complete (53643 records). [2025-09-17T02:08:26.918608] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-17T02:08:27.090211] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-11. [2025-09-17T02:08:27.325747] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-17T02:08:27.325876] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-17T02:08:27.326477] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-17T02:08:27.326535] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-17T02:08:27.327838] [DEBUG] [LOCAL ] ATKR: Trimmed 53643 records to 35889 (keeping 200 days of data) [2025-09-17T02:08:27.558653] [DEBUG] [LOCAL ] ATKR: Primary data saved (35889 records). [2025-09-17T02:08:27.558866] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-17T02:08:27.558978] [INFO ] [MAIN ] Update Progress: 171/2369 symbols completed. ATKR took 39.0s. Estimated remaining: 5h 12m 56s. Rate: 7.0 symbols/min [2025-09-17T02:08:27.733278] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:27.747718] [DEBUG] [LOCAL ] ATS: Loaded 13086 existing records from primary storage. [2025-09-17T02:08:27.747916] [INFO ] [MAIN ] ATS: Loaded 13086 existing records. [2025-09-17T02:08:27.928074] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:08:27.899823] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-17T02:08:27.928567] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-17T02:08:27.929744] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-17T02:08:27.930870] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-17T02:08:27.931126] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-17T02:08:28.184256] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T02:08:28.338072] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:28.367888] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T02:08:28.690182] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-17T02:08:29.406653] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T02:08:29.490153] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-17T02:08:30.071382] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T02:08:30.290203] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-17T02:08:31.023135] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T02:08:31.090120] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-17T02:08:31.193453] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T02:08:31.890149] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-17T02:08:32.695600] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-17T02:08:32.710672] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T02:08:32.799140] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T02:08:33.490147] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-17T02:08:33.758770] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:08:33.764221] [INFO ] [REMOTE ] ATMU: Full fetch complete (56650 records). [2025-09-17T02:08:33.764352] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-17T02:08:34.152852] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-17T02:08:34.152964] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-17T02:08:34.153595] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-17T02:08:34.153668] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-17T02:08:34.154886] [DEBUG] [LOCAL ] ATMU: Trimmed 56650 records to 39756 (keeping 200 days of data) [2025-09-17T02:08:34.331419] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-11. [2025-09-17T02:08:34.401378] [DEBUG] [LOCAL ] ATMU: Primary data saved (39756 records). [2025-09-17T02:08:34.401560] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-17T02:08:34.401675] [INFO ] [MAIN ] Update Progress: 172/2369 symbols completed. ATMU took 42.4s. Estimated remaining: 5h 12m 26s. Rate: 7.0 symbols/min [2025-09-17T02:08:34.571250] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:34.571444] [DEBUG] [LOCAL ] ATUS: No existing data file found in primary storage. [2025-09-17T02:08:34.571496] [WARN ] [MAIN ] ATUS: No existing data found, performing full refresh instead. [2025-09-17T02:08:34.571611] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-17T02:08:34.571687] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-17T02:08:34.571745] [DEBUG] [LOCAL ] ATUS: No primary data file found to delete. [2025-09-17T02:08:34.571792] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-17T02:08:34.973816] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:35.004045] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T02:08:35.090153] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-11. [2025-09-17T02:08:35.435721] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T02:08:35.890132] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-17T02:08:36.363982] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T02:08:36.690122] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-17T02:08:36.791759] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T02:08:37.490140] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-17T02:08:38.046150] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T02:08:38.290135] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-17T02:08:38.826181] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T02:08:38.834196] [INFO ] [REMOTE ] ATO: Full fetch complete (60132 records). [2025-09-17T02:08:38.834547] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-17T02:08:39.117876] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-17T02:08:39.146867] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T02:08:39.250385] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-17T02:08:39.250531] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-17T02:08:39.251297] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-17T02:08:39.251418] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-17T02:08:39.252944] [DEBUG] [LOCAL ] ATO: Trimmed 60132 records to 42075 (keeping 200 days of data) [2025-09-17T02:08:39.520892] [DEBUG] [LOCAL ] ATO: Primary data saved (42075 records). [2025-09-17T02:08:39.521062] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-17T02:08:39.521157] [INFO ] [MAIN ] Update Progress: 173/2369 symbols completed. ATO took 33.0s. Estimated remaining: 5h 11m 34s. Rate: 7.0 symbols/min [2025-09-17T02:08:39.693387] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:39.732142] [DEBUG] [LOCAL ] AU: Loaded 39477 existing records from primary storage. [2025-09-17T02:08:39.732336] [INFO ] [MAIN ] AU: Loaded 39477 existing records. [2025-09-17T02:08:39.898118] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-17T02:08:39.912189] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:08:39.912471] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-17T02:08:39.912535] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-17T02:08:39.914326] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-17T02:08:39.914444] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-17T02:08:40.275831] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:40.538225] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T02:08:40.690151] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-17T02:08:41.291778] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T02:08:41.490143] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-17T02:08:41.965166] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T02:08:42.290155] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-11. [2025-09-17T02:08:42.835101] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T02:08:43.090154] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-17T02:08:43.890102] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-17T02:08:43.994963] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:08:44.139315] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:08:44.690156] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-17T02:08:45.012449] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T02:08:45.490192] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-17T02:08:45.774512] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T02:08:46.290159] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-17T02:08:47.090141] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-17T02:08:47.137987] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T02:08:47.890138] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-17T02:08:48.230543] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T02:08:48.303585] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T02:08:48.690131] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-17T02:08:48.795692] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T02:08:49.490143] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-17T02:08:50.196396] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T02:08:50.290129] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-17T02:08:50.596152] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T02:08:51.090136] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-17T02:08:51.890122] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-17T02:08:52.118541] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T02:08:52.275766] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:08:52.279922] [INFO ] [REMOTE ] ATR: Full fetch complete (42993 records). [2025-09-17T02:08:52.280026] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-17T02:08:52.658792] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-17T02:08:52.658896] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-17T02:08:52.659380] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-17T02:08:52.659432] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-17T02:08:52.660383] [DEBUG] [LOCAL ] ATR: Trimmed 42993 records to 30540 (keeping 200 days of data) [2025-09-17T02:08:52.718059] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-17T02:08:52.851378] [DEBUG] [LOCAL ] ATR: Primary data saved (30540 records). [2025-09-17T02:08:52.851534] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-17T02:08:52.851624] [INFO ] [MAIN ] Update Progress: 174/2369 symbols completed. ATR took 26.8s. Estimated remaining: 5h 12m 26s. Rate: 7.0 symbols/min [2025-09-17T02:08:53.021809] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:08:53.033334] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T02:08:53.071858] [DEBUG] [LOCAL ] AUB: Loaded 33888 existing records from primary storage. [2025-09-17T02:08:53.072018] [INFO ] [MAIN ] AUB: Loaded 33888 existing records. [2025-09-17T02:08:53.253877] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:08:53.254714] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-17T02:08:53.254775] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-17T02:08:53.256542] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-17T02:08:53.256608] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-17T02:08:53.495263] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-17T02:08:53.609779] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:08:54.290183] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-17T02:08:54.409779] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T02:08:55.090156] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-17T02:08:55.135725] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T02:08:55.224859] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:08:55.890125] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-17T02:08:56.353105] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T02:08:56.690128] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-11. [2025-09-17T02:08:57.406809] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T02:08:57.490119] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-17T02:08:58.195113] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T02:08:58.290127] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-17T02:08:59.056272] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T02:08:59.090078] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-17T02:08:59.537976] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T02:08:59.890138] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-17T02:09:00.136237] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T02:09:00.690172] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-17T02:09:01.467602] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T02:09:01.490089] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-17T02:09:02.290185] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-17T02:09:03.090141] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-17T02:09:04.043493] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (3.35 seconds). [2025-09-17T02:09:04.056347] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-17T02:09:04.273817] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-17T02:09:04.690128] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-17T02:09:06.146929] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (3.86 seconds). [2025-09-17T02:09:06.149416] [INFO ] [REMOTE ] ATS: Full fetch complete (25974 records). [2025-09-17T02:09:06.149507] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-17T02:09:06.535047] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-17T02:09:06.536117] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T02:09:06.536305] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-17T02:09:06.542418] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-17T02:09:06.542562] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-17T02:09:06.543332] [INFO ] [REMOTE ] ATUS: Full fetch complete (70644 records). [2025-09-17T02:09:06.543599] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-17T02:09:06.544377] [DEBUG] [LOCAL ] ATS: Trimmed 25974 records to 18304 (keeping 200 days of data) [2025-09-17T02:09:06.735796] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (3.65 seconds). [2025-09-17T02:09:06.798087] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-17T02:09:07.091138] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-17T02:09:07.097573] [DEBUG] [LOCAL ] ATS: Primary data saved (18304 records). [2025-09-17T02:09:07.097996] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-17T02:09:07.097882] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-17T02:09:07.098190] [INFO ] [MAIN ] Update Progress: 175/2369 symbols completed. ATS took 39.5s. Estimated remaining: 5h 13m 29s. Rate: 7.0 symbols/min [2025-09-17T02:09:07.099104] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-17T02:09:07.099244] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-17T02:09:07.206384] [DEBUG] [LOCAL ] ATUS: Trimmed 70644 records to 49193 (keeping 200 days of data) [2025-09-17T02:09:07.329497] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:07.371973] [DEBUG] [LOCAL ] AUNA: Loaded 3645 existing records from primary storage. [2025-09-17T02:09:07.372663] [INFO ] [MAIN ] AUNA: Loaded 3645 existing records. [2025-09-17T02:09:07.564297] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:09:07.566568] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-17T02:09:07.567151] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-17T02:09:07.569374] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-17T02:09:07.570289] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-17T02:09:07.875469] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (3.82 seconds). [2025-09-17T02:09:07.981188] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-17T02:09:08.099487] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:08.102796] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-11. [2025-09-17T02:09:08.163824] [DEBUG] [LOCAL ] ATUS: Primary data saved (49193 records). [2025-09-17T02:09:08.164019] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-17T02:09:08.164108] [INFO ] [MAIN ] Update Progress: 176/2369 symbols completed. ATUS took 33.8s. Estimated remaining: 5h 11m 47s. Rate: 7.0 symbols/min [2025-09-17T02:09:08.336726] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:08.336980] [DEBUG] [LOCAL ] AVA: No existing data file found in primary storage. [2025-09-17T02:09:08.337031] [WARN ] [MAIN ] AVA: No existing data found, performing full refresh instead. [2025-09-17T02:09:08.337140] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-17T02:09:08.337192] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-17T02:09:08.337240] [DEBUG] [LOCAL ] AVA: No primary data file found to delete. [2025-09-17T02:09:08.337283] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-17T02:09:08.694239] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:08.694747] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-11. [2025-09-17T02:09:08.721534] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T02:09:08.731112] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-17T02:09:08.778727] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T02:09:09.490099] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-17T02:09:09.924281] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T02:09:09.972158] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-17T02:09:10.115930] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T02:09:10.294787] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-17T02:09:10.299669] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T02:09:11.090226] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-17T02:09:11.890115] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-17T02:09:12.285529] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T02:09:12.690155] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-17T02:09:12.863021] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T02:09:13.343960] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T02:09:13.490132] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-17T02:09:14.290199] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-17T02:09:14.497094] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T02:09:14.639897] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:09:15.090200] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-17T02:09:15.890254] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-17T02:09:16.046156] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T02:09:16.472349] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T02:09:16.528522] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T02:09:16.690136] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-17T02:09:17.121912] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T02:09:17.490173] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-17T02:09:18.290142] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-17T02:09:19.064856] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T02:09:19.090096] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-17T02:09:19.860228] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T02:09:19.890095] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-17T02:09:20.690178] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-17T02:09:21.490113] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-17T02:09:21.870669] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (2.78 seconds). [2025-09-17T02:09:22.077448] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T02:09:22.290149] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-17T02:09:22.339967] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-17T02:09:22.571790] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T02:09:22.578296] [INFO ] [REMOTE ] AU: Full fetch complete (76063 records). [2025-09-17T02:09:22.578449] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-17T02:09:22.978099] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-17T02:09:22.978202] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-17T02:09:22.979057] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-17T02:09:22.979154] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-17T02:09:22.980672] [DEBUG] [LOCAL ] AU: Trimmed 76063 records to 52895 (keeping 200 days of data) [2025-09-17T02:09:23.090202] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-17T02:09:23.308345] [DEBUG] [LOCAL ] AU: Primary data saved (52895 records). [2025-09-17T02:09:23.308522] [INFO ] [MAIN ] AU: Full history saved. [2025-09-17T02:09:23.308667] [INFO ] [MAIN ] Update Progress: 177/2369 symbols completed. AU took 43.8s. Estimated remaining: 5h 13m 1s. Rate: 7.0 symbols/min [2025-09-17T02:09:23.493857] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:23.494167] [DEBUG] [LOCAL ] AVAL: No existing data file found in primary storage. [2025-09-17T02:09:23.494241] [WARN ] [MAIN ] AVAL: No existing data found, performing full refresh instead. [2025-09-17T02:09:23.494416] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-17T02:09:23.494488] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-17T02:09:23.494571] [DEBUG] [LOCAL ] AVAL: No primary data file found to delete. [2025-09-17T02:09:23.494626] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-17T02:09:23.728037] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T02:09:23.891995] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-17T02:09:23.923436] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:23.970484] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T02:09:24.505702] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T02:09:24.690166] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-17T02:09:25.490214] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-17T02:09:26.290108] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-11. [2025-09-17T02:09:26.340212] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:09:26.759618] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T02:09:26.898281] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T02:09:27.090178] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-17T02:09:27.836347] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T02:09:27.890159] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-17T02:09:28.446023] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T02:09:28.690150] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-17T02:09:29.490158] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-17T02:09:29.589624] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T02:09:30.290138] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-17T02:09:30.920061] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T02:09:30.936629] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T02:09:31.090109] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-17T02:09:31.732479] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T02:09:31.890178] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-17T02:09:32.626774] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T02:09:32.690211] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-17T02:09:33.153427] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T02:09:33.490141] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-17T02:09:34.290150] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-17T02:09:34.880376] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T02:09:34.886116] [INFO ] [REMOTE ] AUB: Full fetch complete (65180 records). [2025-09-17T02:09:34.886294] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-17T02:09:35.095380] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-17T02:09:35.290326] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-17T02:09:35.290451] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-17T02:09:35.291173] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-17T02:09:35.291237] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-17T02:09:35.292773] [DEBUG] [LOCAL ] AUB: Trimmed 65180 records to 46562 (keeping 200 days of data) [2025-09-17T02:09:35.581131] [DEBUG] [LOCAL ] AUB: Primary data saved (46562 records). [2025-09-17T02:09:35.581308] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-17T02:09:35.581423] [INFO ] [MAIN ] Update Progress: 178/2369 symbols completed. AUB took 42.7s. Estimated remaining: 5h 13m 38s. Rate: 7.0 symbols/min [2025-09-17T02:09:35.756573] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:35.790603] [DEBUG] [LOCAL ] AVB: Loaded 31165 existing records from primary storage. [2025-09-17T02:09:35.790830] [INFO ] [MAIN ] AVB: Loaded 31165 existing records. [2025-09-17T02:09:35.862793] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T02:09:35.900896] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-17T02:09:36.007447] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:09:36.008991] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T02:09:36.009204] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-17T02:09:36.017716] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-17T02:09:36.019043] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-17T02:09:36.019107] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-17T02:09:36.376214] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:36.690364] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-17T02:09:36.693264] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T02:09:37.490199] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-17T02:09:38.117180] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T02:09:38.290169] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-17T02:09:38.375267] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T02:09:38.883098] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T02:09:39.090142] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-11. [2025-09-17T02:09:39.890140] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-17T02:09:40.419504] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T02:09:40.420796] [INFO ] [REMOTE ] AUNA: Full fetch complete (7406 records). [2025-09-17T02:09:40.420885] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-17T02:09:40.695440] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-17T02:09:40.792173] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-17T02:09:40.792399] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-17T02:09:40.792685] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-17T02:09:40.792857] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-17T02:09:40.793435] [DEBUG] [LOCAL ] AUNA: Trimmed 7406 records to 4611 (keeping 200 days of data) [2025-09-17T02:09:40.836407] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T02:09:40.849594] [DEBUG] [LOCAL ] AUNA: Primary data saved (4611 records). [2025-09-17T02:09:40.849702] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-17T02:09:40.849786] [INFO ] [MAIN ] Update Progress: 179/2369 symbols completed. AUNA took 33.8s. Estimated remaining: 5h 12m 48s. Rate: 7.0 symbols/min [2025-09-17T02:09:41.035933] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:41.036151] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-17T02:09:41.036207] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-17T02:09:41.036353] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-17T02:09:41.036399] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-17T02:09:41.036453] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-17T02:09:41.036492] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-17T02:09:41.390584] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:41.490148] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-17T02:09:41.546801] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T02:09:42.290147] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-17T02:09:42.749455] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T02:09:42.754228] [INFO ] [REMOTE ] AVA: Full fetch complete (55240 records). [2025-09-17T02:09:42.754347] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-17T02:09:42.997141] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T02:09:43.052002] [INFO ] [REMOTE ] AVAL: Full fetch complete (14624 records). [2025-09-17T02:09:43.062722] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-17T02:09:43.092141] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-11. [2025-09-17T02:09:43.198835] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-17T02:09:43.234948] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-17T02:09:43.247598] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-17T02:09:43.258843] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-17T02:09:43.388800] [DEBUG] [LOCAL ] AVA: Trimmed 55240 records to 39688 (keeping 200 days of data) [2025-09-17T02:09:43.514221] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:09:43.551830] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-11 [2025-09-17T02:09:43.626477] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-17T02:09:43.627529] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-17T02:09:43.629840] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-17T02:09:43.630404] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-17T02:09:43.632950] [DEBUG] [LOCAL ] AVAL: Trimmed 14624 records to 9704 (keeping 200 days of data) [2025-09-17T02:09:43.717193] [DEBUG] [LOCAL ] AVAL: Primary data saved (9704 records). [2025-09-17T02:09:43.776187] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-17T02:09:43.776433] [INFO ] [MAIN ] Update Progress: 180/2369 symbols completed. AVAL took 20.5s. Estimated remaining: 5h 11m 31s. Rate: 7.0 symbols/min [2025-09-17T02:09:43.890921] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-17T02:09:43.990887] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:43.992074] [DEBUG] [LOCAL ] AVD: No existing data file found in primary storage. [2025-09-17T02:09:43.992446] [WARN ] [MAIN ] AVD: No existing data found, performing full refresh instead. [2025-09-17T02:09:43.993857] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-17T02:09:43.995427] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-17T02:09:43.996829] [DEBUG] [LOCAL ] AVD: No primary data file found to delete. [2025-09-17T02:09:43.998058] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-17T02:09:44.380524] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:44.391717] [DEBUG] [LOCAL ] AVA: Primary data saved (39688 records). [2025-09-17T02:09:44.391916] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-17T02:09:44.392017] [INFO ] [MAIN ] Update Progress: 181/2369 symbols completed. AVA took 36.2s. Estimated remaining: 5h 9m 47s. Rate: 7.1 symbols/min [2025-09-17T02:09:44.559597] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:09:44.574232] [DEBUG] [LOCAL ] AVK: Loaded 13450 existing records from primary storage. [2025-09-17T02:09:44.574394] [INFO ] [MAIN ] AVK: Loaded 13450 existing records. [2025-09-17T02:09:44.695241] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-11. [2025-09-17T02:09:44.755949] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:09:44.756195] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-17T02:09:44.756265] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-17T02:09:44.757162] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-17T02:09:44.757237] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-17T02:09:45.139990] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:09:45.389363] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T02:09:45.490100] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-17T02:09:46.129126] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:09:46.290132] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-11. [2025-09-17T02:09:47.015740] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:09:47.090143] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-17T02:09:47.105987] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T02:09:47.890163] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-17T02:09:48.219527] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T02:09:48.576700] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T02:09:48.690158] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-17T02:09:49.490147] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-17T02:09:50.032140] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:09:50.032485] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-17T02:09:50.290122] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-17T02:09:50.367110] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T02:09:51.090160] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-17T02:09:51.514181] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T02:09:51.774209] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T02:09:51.890145] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-17T02:09:52.690126] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-17T02:09:52.914600] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:09:52.915099] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-17T02:09:53.376216] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T02:09:53.490130] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-17T02:09:54.290150] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-17T02:09:54.508360] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:09:54.508687] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-17T02:09:55.052886] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:09:55.090083] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-17T02:09:55.890130] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-17T02:09:56.635110] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T02:09:56.690102] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-17T02:09:56.862675] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T02:09:56.923870] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:09:56.924203] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-17T02:09:57.490132] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-17T02:09:58.290148] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-17T02:09:58.428612] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T02:09:59.090120] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-17T02:09:59.221421] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T02:09:59.890105] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-17T02:10:00.109161] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:10:00.109746] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-17T02:10:00.120449] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T02:10:00.690127] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-17T02:10:01.490183] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-17T02:10:02.290184] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-17T02:10:02.330332] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T02:10:02.508555] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:10:02.508962] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-17T02:10:02.568774] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T02:10:03.090136] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-17T02:10:03.890151] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-17T02:10:04.102744] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T02:10:04.108634] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:10:04.108867] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-17T02:10:04.690159] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-17T02:10:04.905782] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:10:04.906095] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-17T02:10:05.490160] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-17T02:10:06.290184] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-17T02:10:06.907047] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T02:10:06.924102] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T02:10:07.090163] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-17T02:10:07.890173] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-17T02:10:08.262563] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:10:08.690145] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-17T02:10:09.274714] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T02:10:09.490102] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-17T02:10:09.846039] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T02:10:10.290142] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-17T02:10:11.090168] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-17T02:10:11.110052] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:10:11.115509] [INFO ] [REMOTE ] AVB: Full fetch complete (57749 records). [2025-09-17T02:10:11.115626] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-17T02:10:11.257063] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T02:10:11.310446] [INFO ] [REMOTE ] AVBC: Full fetch complete (4047 records). [2025-09-17T02:10:11.332607] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-17T02:10:11.697151] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-17T02:10:11.704143] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-17T02:10:11.719536] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-17T02:10:11.725242] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-17T02:10:11.725132] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 32 unique days, need 200 days [2025-09-17T02:10:11.725636] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:10:11.725719] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:10:11.725765] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-17T02:10:11.725829] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-17T02:10:11.725875] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-17T02:10:11.726393] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-17T02:10:11.726530] [INFO ] [MAIN ] Update Progress: 182/2369 symbols completed. AVBC took 30.9s. Estimated remaining: 5h 13m 25s. Rate: 7.0 symbols/min [2025-09-17T02:10:11.757803] [DEBUG] [LOCAL ] AVB: Trimmed 57749 records to 41477 (keeping 200 days of data) [2025-09-17T02:10:11.898028] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-17T02:10:11.997049] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:12.032065] [DEBUG] [LOCAL ] AVNS: Loaded 25002 existing records from primary storage. [2025-09-17T02:10:12.036244] [INFO ] [MAIN ] AVNS: Loaded 25002 existing records. [2025-09-17T02:10:12.298583] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:12.330829] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-17T02:10:12.337868] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-17T02:10:12.338841] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-17T02:10:12.339206] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-17T02:10:12.452585] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T02:10:12.691216] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-17T02:10:12.769183] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:12.784598] [DEBUG] [LOCAL ] AVB: Primary data saved (41477 records). [2025-09-17T02:10:12.784817] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-17T02:10:12.784949] [INFO ] [MAIN ] Update Progress: 183/2369 symbols completed. AVB took 37.2s. Estimated remaining: 5h 11m 46s. Rate: 7.0 symbols/min [2025-09-17T02:10:12.954717] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:12.988659] [DEBUG] [LOCAL ] AVNT: Loaded 28832 existing records from primary storage. [2025-09-17T02:10:12.988828] [INFO ] [MAIN ] AVNT: Loaded 28832 existing records. [2025-09-17T02:10:13.173703] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:13.174138] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-17T02:10:13.187668] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-17T02:10:13.188862] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T02:10:13.193492] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-17T02:10:13.194004] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-17T02:10:13.495441] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-17T02:10:13.558014] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:13.623839] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:10:14.290203] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-11. [2025-09-17T02:10:14.675667] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T02:10:15.090181] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-11. [2025-09-17T02:10:15.746916] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T02:10:15.890171] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-17T02:10:16.412708] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T02:10:16.690162] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-17T02:10:16.847047] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T02:10:16.850336] [INFO ] [REMOTE ] AVK: Full fetch complete (26766 records). [2025-09-17T02:10:16.850470] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-17T02:10:17.236564] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-17T02:10:17.236701] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-17T02:10:17.237634] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-17T02:10:17.237723] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-17T02:10:17.238424] [DEBUG] [LOCAL ] AVK: Trimmed 26766 records to 18256 (keeping 200 days of data) [2025-09-17T02:10:17.351563] [DEBUG] [LOCAL ] AVK: Primary data saved (18256 records). [2025-09-17T02:10:17.351781] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-17T02:10:17.351892] [INFO ] [MAIN ] Update Progress: 184/2369 symbols completed. AVK took 33.0s. Estimated remaining: 5h 10m 50s. Rate: 7.0 symbols/min [2025-09-17T02:10:17.500131] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-17T02:10:17.527570] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:17.569125] [DEBUG] [LOCAL ] AVTR: Loaded 39944 existing records from primary storage. [2025-09-17T02:10:17.569332] [INFO ] [MAIN ] AVTR: Loaded 39944 existing records. [2025-09-17T02:10:17.753779] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:17.754144] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-17T02:10:17.754279] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-17T02:10:17.761139] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-17T02:10:17.767599] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-17T02:10:17.839870] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T02:10:18.157470] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:18.290118] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-11. [2025-09-17T02:10:18.953838] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T02:10:19.090153] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-17T02:10:19.890185] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-17T02:10:20.036327] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T02:10:20.080050] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T02:10:20.690109] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-17T02:10:21.015365] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:10:21.490173] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-17T02:10:22.217634] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:10:22.290092] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-17T02:10:22.918804] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T02:10:23.090139] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-17T02:10:23.663308] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:10:23.890182] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-17T02:10:24.602751] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T02:10:24.690410] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-17T02:10:24.728070] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T02:10:24.733123] [INFO ] [REMOTE ] AVD: Full fetch complete (33989 records). [2025-09-17T02:10:24.733409] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-17T02:10:25.329381] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-17T02:10:25.329560] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-17T02:10:25.330360] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-17T02:10:25.330443] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-17T02:10:25.331869] [DEBUG] [LOCAL ] AVD: Trimmed 33989 records to 23298 (keeping 200 days of data) [2025-09-17T02:10:25.491539] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-17T02:10:25.517918] [DEBUG] [LOCAL ] AVD: Primary data saved (23298 records). [2025-09-17T02:10:25.518157] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-17T02:10:25.519460] [INFO ] [MAIN ] Update Progress: 185/2369 symbols completed. AVD took 41.7s. Estimated remaining: 5h 10m 37s. Rate: 7.0 symbols/min [2025-09-17T02:10:25.777730] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:25.805635] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T02:10:25.843896] [DEBUG] [LOCAL ] AVY: Loaded 27220 existing records from primary storage. [2025-09-17T02:10:25.844116] [INFO ] [MAIN ] AVY: Loaded 27220 existing records. [2025-09-17T02:10:26.037736] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:26.038030] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-17T02:10:26.038105] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-17T02:10:26.039379] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-17T02:10:26.039452] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-17T02:10:26.297105] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-17T02:10:26.406967] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:27.057669] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T02:10:27.090134] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-17T02:10:27.596181] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T02:10:27.890159] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-17T02:10:28.680464] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T02:10:28.690678] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-17T02:10:29.300965] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T02:10:29.490205] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-17T02:10:30.263534] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:10:30.290121] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-17T02:10:30.755015] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T02:10:31.090136] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-11. [2025-09-17T02:10:31.756636] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T02:10:31.890172] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-17T02:10:32.526744] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T02:10:32.690184] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-17T02:10:33.422002] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T02:10:33.490180] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-17T02:10:33.799001] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:10:34.290173] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-17T02:10:35.090167] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-17T02:10:35.327288] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T02:10:35.777341] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T02:10:35.890117] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-17T02:10:36.111317] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T02:10:36.690135] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-17T02:10:37.108506] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T02:10:37.490189] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-17T02:10:38.136079] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T02:10:38.290127] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-17T02:10:39.090163] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-17T02:10:39.284775] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:10:39.837783] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:10:39.890087] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-17T02:10:40.219975] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:10:40.690158] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-17T02:10:41.088964] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T02:10:41.490134] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-17T02:10:42.146012] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T02:10:42.290135] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-17T02:10:42.709703] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T02:10:42.714318] [INFO ] [REMOTE ] AVNT: Full fetch complete (55754 records). [2025-09-17T02:10:42.714499] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-17T02:10:43.097408] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-17T02:10:43.100342] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-17T02:10:43.101222] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-17T02:10:43.101865] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-17T02:10:43.101947] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-17T02:10:43.103206] [DEBUG] [LOCAL ] AVNT: Trimmed 55754 records to 39625 (keeping 200 days of data) [2025-09-17T02:10:43.360867] [DEBUG] [LOCAL ] AVNT: Primary data saved (39625 records). [2025-09-17T02:10:43.361052] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-17T02:10:43.361197] [INFO ] [MAIN ] Update Progress: 186/2369 symbols completed. AVNT took 30.6s. Estimated remaining: 5h 12m 18s. Rate: 7.0 symbols/min [2025-09-17T02:10:43.539383] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:43.557868] [DEBUG] [LOCAL ] AWF: Loaded 17033 existing records from primary storage. [2025-09-17T02:10:43.558020] [INFO ] [MAIN ] AWF: Loaded 17033 existing records. [2025-09-17T02:10:43.744981] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:43.745253] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-17T02:10:43.745323] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-17T02:10:43.746164] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-17T02:10:43.746238] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-17T02:10:43.895216] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-17T02:10:44.106806] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:44.130588] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T02:10:44.626105] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T02:10:44.690120] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-11. [2025-09-17T02:10:45.490116] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-17T02:10:45.713108] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T02:10:45.803139] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T02:10:46.290137] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-17T02:10:46.323919] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T02:10:46.328900] [INFO ] [REMOTE ] AVNS: Full fetch complete (47518 records). [2025-09-17T02:10:46.329028] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-17T02:10:46.729767] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-17T02:10:46.729931] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-17T02:10:46.730663] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-17T02:10:46.730732] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-17T02:10:46.732356] [DEBUG] [LOCAL ] AVNS: Trimmed 47518 records to 33740 (keeping 200 days of data) [2025-09-17T02:10:46.940391] [DEBUG] [LOCAL ] AVNS: Primary data saved (33740 records). [2025-09-17T02:10:46.940558] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-17T02:10:46.940717] [INFO ] [MAIN ] Update Progress: 187/2369 symbols completed. AVNS took 35.2s. Estimated remaining: 5h 11m 11s. Rate: 7.0 symbols/min [2025-09-17T02:10:47.095349] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-17T02:10:47.120512] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:47.143583] [DEBUG] [LOCAL ] AWI: Loaded 19097 existing records from primary storage. [2025-09-17T02:10:47.143787] [INFO ] [MAIN ] AWI: Loaded 19097 existing records. [2025-09-17T02:10:47.369171] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:47.369569] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-17T02:10:47.369718] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-17T02:10:47.376421] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-17T02:10:47.385702] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-17T02:10:47.455980] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T02:10:47.770274] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:47.890139] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-11. [2025-09-17T02:10:48.690113] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-17T02:10:48.848561] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:10:49.076081] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:10:49.490137] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-17T02:10:50.290149] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-17T02:10:50.458498] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T02:10:50.536919] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T02:10:51.090156] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-17T02:10:51.890130] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-17T02:10:52.209399] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T02:10:52.235345] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:10:52.690130] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-17T02:10:53.046800] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T02:10:53.490093] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-17T02:10:53.569261] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T02:10:54.290131] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-17T02:10:54.690562] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T02:10:54.697023] [INFO ] [REMOTE ] AVTR: Full fetch complete (77266 records). [2025-09-17T02:10:54.697206] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-17T02:10:55.088460] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-17T02:10:55.088571] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-17T02:10:55.089336] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-17T02:10:55.089396] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-17T02:10:55.090120] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-17T02:10:55.092380] [DEBUG] [LOCAL ] AVTR: Trimmed 77266 records to 53571 (keeping 200 days of data) [2025-09-17T02:10:55.417753] [DEBUG] [LOCAL ] AVTR: Primary data saved (53571 records). [2025-09-17T02:10:55.417919] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-17T02:10:55.418016] [INFO ] [MAIN ] Update Progress: 188/2369 symbols completed. AVTR took 38.1s. Estimated remaining: 5h 11m 2s. Rate: 7.0 symbols/min [2025-09-17T02:10:55.599839] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:10:55.643398] [DEBUG] [LOCAL ] AWK: Loaded 35976 existing records from primary storage. [2025-09-17T02:10:55.643697] [INFO ] [MAIN ] AWK: Loaded 35976 existing records. [2025-09-17T02:10:55.831395] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:10:55.831733] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-17T02:10:55.837669] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-17T02:10:55.848386] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T02:10:55.854317] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-17T02:10:55.854829] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-17T02:10:55.897364] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-17T02:10:56.220587] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:10:56.303220] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T02:10:56.690140] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-17T02:10:57.353837] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:10:57.490155] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-17T02:10:57.992019] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T02:10:58.290152] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-17T02:10:58.982334] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T02:10:59.090095] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-17T02:10:59.476401] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T02:10:59.890134] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-17T02:11:00.002685] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T02:11:00.690130] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-11. [2025-09-17T02:11:01.388831] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T02:11:01.490170] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-17T02:11:02.290117] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-17T02:11:02.412304] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T02:11:02.884964] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T02:11:02.889825] [INFO ] [REMOTE ] AVY: Full fetch complete (55760 records). [2025-09-17T02:11:02.889950] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-17T02:11:03.095399] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-17T02:11:03.278135] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-17T02:11:03.278250] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-17T02:11:03.278932] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-17T02:11:03.278991] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-17T02:11:03.280393] [DEBUG] [LOCAL ] AVY: Trimmed 55760 records to 37751 (keeping 200 days of data) [2025-09-17T02:11:03.521740] [DEBUG] [LOCAL ] AVY: Primary data saved (37751 records). [2025-09-17T02:11:03.521929] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-17T02:11:03.522022] [INFO ] [MAIN ] Update Progress: 189/2369 symbols completed. AVY took 38.0s. Estimated remaining: 5h 10m 48s. Rate: 7.0 symbols/min [2025-09-17T02:11:03.695453] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:03.723885] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T02:11:03.746434] [DEBUG] [LOCAL ] AWP: Loaded 16751 existing records from primary storage. [2025-09-17T02:11:03.746617] [INFO ] [MAIN ] AWP: Loaded 16751 existing records. [2025-09-17T02:11:03.898751] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-17T02:11:03.929840] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:03.931056] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-17T02:11:03.931123] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-17T02:11:03.932026] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-17T02:11:03.932096] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-17T02:11:04.305036] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:04.690179] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-11. [2025-09-17T02:11:04.803493] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T02:11:04.934839] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T02:11:05.374904] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T02:11:05.490137] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-17T02:11:06.290176] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-17T02:11:06.712369] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T02:11:07.090121] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-17T02:11:07.436407] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T02:11:07.890158] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-17T02:11:08.570449] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T02:11:08.690158] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-17T02:11:08.875271] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T02:11:09.490145] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-17T02:11:10.287259] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T02:11:10.296428] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-17T02:11:10.446220] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T02:11:11.090151] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-17T02:11:11.480631] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:11:11.890224] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-17T02:11:12.506067] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T02:11:12.690147] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-17T02:11:13.047194] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T02:11:13.365046] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T02:11:13.490165] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-17T02:11:14.290109] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-17T02:11:14.743357] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T02:11:15.090147] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-17T02:11:15.187236] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T02:11:15.190588] [INFO ] [REMOTE ] AWF: Full fetch complete (35755 records). [2025-09-17T02:11:15.190703] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-17T02:11:15.560524] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-17T02:11:15.560670] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-17T02:11:15.561172] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-17T02:11:15.561229] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-17T02:11:15.562357] [DEBUG] [LOCAL ] AWF: Trimmed 35755 records to 24095 (keeping 200 days of data) [2025-09-17T02:11:15.711065] [DEBUG] [LOCAL ] AWF: Primary data saved (24095 records). [2025-09-17T02:11:15.711241] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-17T02:11:15.711367] [INFO ] [MAIN ] Update Progress: 190/2369 symbols completed. AWF took 32.4s. Estimated remaining: 5h 11m 21s. Rate: 7.0 symbols/min [2025-09-17T02:11:15.888093] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:15.890084] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-17T02:11:15.906087] [DEBUG] [LOCAL ] AWR: Loaded 16266 existing records from primary storage. [2025-09-17T02:11:15.906242] [INFO ] [MAIN ] AWR: Loaded 16266 existing records. [2025-09-17T02:11:16.083981] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:16.084229] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-17T02:11:16.084287] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-17T02:11:16.085139] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-17T02:11:16.085206] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-17T02:11:16.452633] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:16.466399] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T02:11:16.690153] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-11. [2025-09-17T02:11:17.490172] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-17T02:11:17.584777] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T02:11:17.677126] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T02:11:18.290215] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-17T02:11:18.658923] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:11:19.090206] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-17T02:11:19.890125] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-17T02:11:19.930673] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T02:11:20.337343] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T02:11:20.690144] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-17T02:11:20.745503] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T02:11:21.456942] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T02:11:21.490156] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-17T02:11:22.290152] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-17T02:11:22.591866] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T02:11:23.030536] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T02:11:23.034015] [INFO ] [REMOTE ] AWI: Full fetch complete (35381 records). [2025-09-17T02:11:23.034151] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-17T02:11:23.096542] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-17T02:11:23.410426] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-17T02:11:23.410527] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-17T02:11:23.410973] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-17T02:11:23.411028] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-17T02:11:23.411929] [DEBUG] [LOCAL ] AWI: Trimmed 35381 records to 26291 (keeping 200 days of data) [2025-09-17T02:11:23.578982] [DEBUG] [LOCAL ] AWI: Primary data saved (26291 records). [2025-09-17T02:11:23.579140] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-17T02:11:23.579230] [INFO ] [MAIN ] Update Progress: 191/2369 symbols completed. AWI took 36.6s. Estimated remaining: 5h 11m 4s. Rate: 7.0 symbols/min [2025-09-17T02:11:23.751098] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:23.770465] [DEBUG] [LOCAL ] AX: Loaded 20338 existing records from primary storage. [2025-09-17T02:11:23.770615] [INFO ] [MAIN ] AX: Loaded 20338 existing records. [2025-09-17T02:11:23.895253] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-17T02:11:23.951023] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:23.951242] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-17T02:11:23.951302] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-17T02:11:23.952063] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-17T02:11:23.952126] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-17T02:11:24.311770] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:24.659593] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:11:24.690106] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-17T02:11:25.111755] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T02:11:25.490197] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-11. [2025-09-17T02:11:25.748588] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T02:11:26.290238] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-17T02:11:26.860738] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T02:11:27.090216] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-17T02:11:27.890121] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-17T02:11:27.922191] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T02:11:28.163859] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T02:11:28.690141] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-17T02:11:29.155788] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T02:11:29.490183] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-17T02:11:30.082151] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T02:11:30.290212] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-17T02:11:30.606049] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T02:11:31.090174] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-17T02:11:31.285918] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T02:11:31.288810] [INFO ] [REMOTE ] AWP: Full fetch complete (32579 records). [2025-09-17T02:11:31.288923] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-17T02:11:31.658915] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-17T02:11:31.659023] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-17T02:11:31.659478] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-17T02:11:31.659536] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-17T02:11:31.660426] [DEBUG] [LOCAL ] AWP: Trimmed 32579 records to 22238 (keeping 200 days of data) [2025-09-17T02:11:31.800572] [DEBUG] [LOCAL ] AWP: Primary data saved (22238 records). [2025-09-17T02:11:31.801005] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-17T02:11:31.801220] [INFO ] [MAIN ] Update Progress: 192/2369 symbols completed. AWP took 28.3s. Estimated remaining: 5h 10m 52s. Rate: 7.0 symbols/min [2025-09-17T02:11:31.898473] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-17T02:11:31.982402] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:32.019454] [DEBUG] [LOCAL ] AXL: Loaded 37509 existing records from primary storage. [2025-09-17T02:11:32.019623] [INFO ] [MAIN ] AXL: Loaded 37509 existing records. [2025-09-17T02:11:32.210979] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:32.211249] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-17T02:11:32.211309] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-17T02:11:32.212779] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-17T02:11:32.212844] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-17T02:11:32.565978] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T02:11:32.600829] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:32.690085] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-17T02:11:33.301452] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T02:11:33.490123] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-17T02:11:34.290153] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-11. [2025-09-17T02:11:34.480607] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T02:11:34.507244] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T02:11:35.090123] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-17T02:11:35.869874] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T02:11:35.890086] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-17T02:11:36.224216] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T02:11:36.230166] [INFO ] [REMOTE ] AWK: Full fetch complete (70331 records). [2025-09-17T02:11:36.230338] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-17T02:11:36.615818] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-17T02:11:36.615919] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-17T02:11:36.616665] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-17T02:11:36.616721] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-17T02:11:36.618064] [DEBUG] [LOCAL ] AWK: Trimmed 70331 records to 48881 (keeping 200 days of data) [2025-09-17T02:11:36.711443] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-17T02:11:36.874314] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T02:11:36.970600] [DEBUG] [LOCAL ] AWK: Primary data saved (48881 records). [2025-09-17T02:11:36.970825] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-17T02:11:36.970954] [INFO ] [MAIN ] Update Progress: 193/2369 symbols completed. AWK took 41.6s. Estimated remaining: 5h 10m 5s. Rate: 7.0 symbols/min [2025-09-17T02:11:37.147874] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:37.191098] [DEBUG] [LOCAL ] AXP: Loaded 39661 existing records from primary storage. [2025-09-17T02:11:37.191287] [INFO ] [MAIN ] AXP: Loaded 39661 existing records. [2025-09-17T02:11:37.377030] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:37.377333] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-17T02:11:37.377414] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-17T02:11:37.379397] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-17T02:11:37.379475] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-17T02:11:37.490118] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-17T02:11:37.773106] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:38.290148] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-17T02:11:38.409136] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T02:11:38.883537] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T02:11:39.090166] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-17T02:11:39.224014] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T02:11:39.890133] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-17T02:11:40.330745] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T02:11:40.690135] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-17T02:11:40.978103] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T02:11:41.490136] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-17T02:11:42.063632] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:11:42.290101] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-11. [2025-09-17T02:11:42.758413] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T02:11:43.090128] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-17T02:11:43.890113] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-17T02:11:44.052900] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T02:11:44.090143] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T02:11:44.690149] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-17T02:11:44.814269] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T02:11:45.490130] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-17T02:11:45.682293] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T02:11:46.290128] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-17T02:11:46.828703] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T02:11:47.090146] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-17T02:11:47.386454] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T02:11:47.890154] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-17T02:11:48.690111] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-17T02:11:48.875391] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T02:11:48.894265] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T02:11:48.897738] [INFO ] [REMOTE ] AWR: Full fetch complete (31475 records). [2025-09-17T02:11:48.897835] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-17T02:11:49.272298] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-17T02:11:49.272423] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-17T02:11:49.272923] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-17T02:11:49.272986] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-17T02:11:49.273981] [DEBUG] [LOCAL ] AWR: Trimmed 31475 records to 22408 (keeping 200 days of data) [2025-09-17T02:11:49.425451] [DEBUG] [LOCAL ] AWR: Primary data saved (22408 records). [2025-09-17T02:11:49.425612] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-17T02:11:49.425723] [INFO ] [MAIN ] Update Progress: 194/2369 symbols completed. AWR took 33.7s. Estimated remaining: 5h 10m 40s. Rate: 7.0 symbols/min [2025-09-17T02:11:49.499374] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-17T02:11:49.598673] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:49.602698] [DEBUG] [LOCAL ] AXR: Loaded 2150 existing records from primary storage. [2025-09-17T02:11:49.602795] [INFO ] [MAIN ] AXR: Loaded 2150 existing records. [2025-09-17T02:11:49.777832] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:11:49.778096] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-17T02:11:49.778155] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-17T02:11:49.778539] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-17T02:11:49.778604] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-17T02:11:50.129580] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:50.290134] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-11. [2025-09-17T02:11:50.742676] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-17T02:11:50.822726] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T02:11:51.090183] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-17T02:11:51.290125] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:11:51.890108] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-17T02:11:52.297177] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T02:11:52.690148] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-17T02:11:53.352397] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T02:11:53.490136] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-17T02:11:54.290131] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-17T02:11:54.835494] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T02:11:54.930805] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T02:11:55.090091] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-17T02:11:55.483558] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:11:55.487576] [INFO ] [REMOTE ] AX: Full fetch complete (42532 records). [2025-09-17T02:11:55.487714] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-17T02:11:55.865377] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-17T02:11:55.865504] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-17T02:11:55.866008] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-17T02:11:55.866077] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-17T02:11:55.867040] [DEBUG] [LOCAL ] AX: Trimmed 42532 records to 28693 (keeping 200 days of data) [2025-09-17T02:11:55.922257] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-17T02:11:56.045128] [DEBUG] [LOCAL ] AX: Primary data saved (28693 records). [2025-09-17T02:11:56.045293] [INFO ] [MAIN ] AX: Full history saved. [2025-09-17T02:11:56.045405] [INFO ] [MAIN ] Update Progress: 195/2369 symbols completed. AX took 32.5s. Estimated remaining: 5h 10m 10s. Rate: 7.0 symbols/min [2025-09-17T02:11:56.228482] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:11:56.228733] [DEBUG] [LOCAL ] AXS: No existing data file found in primary storage. [2025-09-17T02:11:56.228804] [WARN ] [MAIN ] AXS: No existing data found, performing full refresh instead. [2025-09-17T02:11:56.228965] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-17T02:11:56.229042] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-17T02:11:56.229114] [DEBUG] [LOCAL ] AXS: No primary data file found to delete. [2025-09-17T02:11:56.229174] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-17T02:11:56.612804] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:11:56.690094] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-11. [2025-09-17T02:11:56.735791] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T02:11:56.960197] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T02:11:57.490145] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-17T02:11:57.927626] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T02:11:58.119597] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:11:58.290176] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-17T02:11:59.090126] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-17T02:11:59.757506] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T02:11:59.890130] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-17T02:12:00.690123] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-17T02:12:01.005721] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T02:12:01.103518] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T02:12:01.384028] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T02:12:01.490066] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-17T02:12:02.290179] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-17T02:12:02.341294] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T02:12:03.090261] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-17T02:12:03.890189] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-17T02:12:04.505479] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T02:12:04.649705] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T02:12:04.690108] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-17T02:12:05.247127] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.96 seconds). [2025-09-17T02:12:05.263228] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T02:12:05.490138] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-17T02:12:06.290149] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-17T02:12:07.090137] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-17T02:12:07.812533] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T02:12:07.856059] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-17T02:12:07.890088] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-17T02:12:08.690173] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-17T02:12:08.873609] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T02:12:09.041501] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T02:12:09.490122] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-17T02:12:09.932237] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T02:12:10.070851] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-17T02:12:10.290113] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-17T02:12:11.090205] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-17T02:12:11.890181] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-17T02:12:12.211490] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T02:12:12.642526] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T02:12:12.690091] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-17T02:12:13.465068] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:12:13.471628] [INFO ] [REMOTE ] AXL: Full fetch complete (72105 records). [2025-09-17T02:12:13.471803] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-17T02:12:13.495230] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-17T02:12:13.884685] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-17T02:12:13.884816] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-17T02:12:13.885606] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-17T02:12:13.885704] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-17T02:12:13.887180] [DEBUG] [LOCAL ] AXL: Trimmed 72105 records to 50534 (keeping 200 days of data) [2025-09-17T02:12:14.164604] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T02:12:14.194520] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T02:12:14.211904] [DEBUG] [LOCAL ] AXL: Primary data saved (50534 records). [2025-09-17T02:12:14.212082] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-17T02:12:14.212179] [INFO ] [MAIN ] Update Progress: 196/2369 symbols completed. AXL took 42.4s. Estimated remaining: 5h 11m 48s. Rate: 7.0 symbols/min [2025-09-17T02:12:14.295220] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-17T02:12:14.387441] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:14.387722] [DEBUG] [LOCAL ] AXTA: No existing data file found in primary storage. [2025-09-17T02:12:14.387804] [WARN ] [MAIN ] AXTA: No existing data found, performing full refresh instead. [2025-09-17T02:12:14.387943] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-17T02:12:14.387999] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-17T02:12:14.388063] [DEBUG] [LOCAL ] AXTA: No primary data file found to delete. [2025-09-17T02:12:14.388108] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-17T02:12:14.750949] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:15.090135] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-17T02:12:15.890153] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-17T02:12:16.690899] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-11. [2025-09-17T02:12:16.693135] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-17T02:12:17.192829] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T02:12:17.193890] [INFO ] [REMOTE ] AXR: Full fetch complete (4938 records). [2025-09-17T02:12:17.193973] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-17T02:12:17.495232] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-17T02:12:17.552245] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-17T02:12:17.552341] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-17T02:12:17.552498] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-17T02:12:17.552546] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-17T02:12:17.552938] [DEBUG] [LOCAL ] AXR: Trimmed 4938 records to 3125 (keeping 200 days of data) [2025-09-17T02:12:17.571762] [DEBUG] [LOCAL ] AXR: Primary data saved (3125 records). [2025-09-17T02:12:17.571862] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-17T02:12:17.571945] [INFO ] [MAIN ] Update Progress: 197/2369 symbols completed. AXR took 28.1s. Estimated remaining: 5h 10m 41s. Rate: 7.0 symbols/min [2025-09-17T02:12:17.868559] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-17T02:12:18.290179] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-17T02:12:18.473998] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T02:12:19.078823] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T02:12:19.090065] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-17T02:12:19.890146] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-17T02:12:20.063625] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T02:12:20.546227] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T02:12:20.690128] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-17T02:12:21.485776] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:12:21.495537] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-17T02:12:21.746319] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:12:21.751133] [INFO ] [REMOTE ] AXS: Full fetch complete (55143 records). [2025-09-17T02:12:21.751262] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-17T02:12:22.141662] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-17T02:12:22.141773] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-17T02:12:22.142398] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-17T02:12:22.142458] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-17T02:12:22.143604] [DEBUG] [LOCAL ] AXS: Trimmed 55143 records to 38288 (keeping 200 days of data) [2025-09-17T02:12:22.324366] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-17T02:12:22.392936] [DEBUG] [LOCAL ] AXS: Primary data saved (38288 records). [2025-09-17T02:12:22.393120] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-17T02:12:22.393205] [INFO ] [MAIN ] Update Progress: 198/2369 symbols completed. AXS took 26.3s. Estimated remaining: 5h 9m 51s. Rate: 7.0 symbols/min [2025-09-17T02:12:22.958386] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T02:12:22.964974] [INFO ] [REMOTE ] AXP: Full fetch complete (76792 records). [2025-09-17T02:12:22.965124] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-17T02:12:23.368503] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-17T02:12:23.368624] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-17T02:12:23.369412] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-17T02:12:23.369476] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-17T02:12:23.371117] [DEBUG] [LOCAL ] AXP: Trimmed 76792 records to 53258 (keeping 200 days of data) [2025-09-17T02:12:23.730424] [DEBUG] [LOCAL ] AXP: Primary data saved (53258 records). [2025-09-17T02:12:23.730608] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-17T02:12:23.730723] [INFO ] [MAIN ] Update Progress: 199/2369 symbols completed. AXP took 46.8s. Estimated remaining: 5h 8m 24s. Rate: 7.0 symbols/min [2025-09-17T02:12:24.033921] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T02:12:24.044749] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-17T02:12:25.286915] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T02:12:25.297368] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-17T02:12:26.970279] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T02:12:26.981471] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-17T02:12:29.119405] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T02:12:29.130549] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-17T02:12:30.796860] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T02:12:30.808705] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-17T02:12:32.044232] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T02:12:32.055275] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-17T02:12:34.005098] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T02:12:34.017150] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-17T02:12:35.718782] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T02:12:35.729966] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-17T02:12:37.361546] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T02:12:37.367931] [INFO ] [REMOTE ] AXTA: Full fetch complete (74458 records). [2025-09-17T02:12:37.368088] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-17T02:12:37.755518] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-17T02:12:37.755664] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-17T02:12:37.756476] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-17T02:12:37.756565] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-17T02:12:37.758129] [DEBUG] [LOCAL ] AXTA: Trimmed 74458 records to 52032 (keeping 200 days of data) [2025-09-17T02:12:38.058674] [DEBUG] [LOCAL ] AXTA: Primary data saved (52032 records). [2025-09-17T02:12:38.058842] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-17T02:12:38.058978] [INFO ] [MAIN ] Update Progress: 200/2369 symbols completed. AXTA took 23.8s. Estimated remaining: 5h 9m 18s. Rate: 7.0 symbols/min [2025-09-17T02:12:38.675631] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:38.704718] [DEBUG] [LOCAL ] AZO: No existing data file found in primary storage. [2025-09-17T02:12:38.704581] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:38.728733] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:38.753272] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:38.751463] [WARN ] [MAIN ] AZO: No existing data found, performing full refresh instead. [2025-09-17T02:12:38.753672] [DEBUG] [LOCAL ] AZZ: No existing data file found in primary storage. [2025-09-17T02:12:38.753943] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-17T02:12:38.754026] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-17T02:12:38.753747] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-17T02:12:38.754108] [WARN ] [MAIN ] AZZ: No existing data found, performing full refresh instead. [2025-09-17T02:12:38.754187] [DEBUG] [LOCAL ] AZO: No primary data file found to delete. [2025-09-17T02:12:38.754254] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-17T02:12:38.754473] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-17T02:12:38.754435] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-17T02:12:38.796206] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-17T02:12:38.766855] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-17T02:12:38.833776] [DEBUG] [LOCAL ] AZZ: No primary data file found to delete. [2025-09-17T02:12:38.844234] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-17T02:12:38.863703] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-17T02:12:38.869490] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-17T02:12:38.965959] [DEBUG] [LOCAL ] AYI: Loaded 17656 existing records from primary storage. [2025-09-17T02:12:38.966013] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-17T02:12:39.051140] [INFO ] [MAIN ] AYI: Loaded 17656 existing records. [2025-09-17T02:12:39.784981] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:12:39.831177] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:39.908435] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-17T02:12:39.919090] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-11. [2025-09-17T02:12:39.971865] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:39.982211] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-17T02:12:40.046582] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-11. [2025-09-17T02:12:40.046083] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:40.047773] [INFO ] [REMOTE ] B: Fetching primary data for 2024-11. [2025-09-17T02:12:40.047822] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-17T02:12:40.048527] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-17T02:12:40.415094] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:40.415469] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-11. [2025-09-17T02:12:41.037068] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T02:12:41.040316] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-17T02:12:41.165439] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T02:12:41.172921] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-17T02:12:41.186013] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T02:12:41.190773] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-17T02:12:41.629242] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T02:12:41.634333] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-17T02:12:42.012062] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T02:12:42.016384] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-17T02:12:42.097867] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T02:12:42.101297] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-17T02:12:42.388582] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T02:12:42.397179] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-17T02:12:42.850961] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T02:12:42.856211] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-17T02:12:42.870368] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T02:12:42.872970] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-17T02:12:42.959589] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T02:12:42.964290] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-17T02:12:43.328899] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T02:12:43.335113] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-17T02:12:43.545114] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:12:43.545432] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-17T02:12:43.545891] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-17T02:12:43.579290] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T02:12:43.581517] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-17T02:12:43.766215] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:12:43.766527] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-17T02:12:43.766968] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-17T02:12:43.954132] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T02:12:43.960834] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-17T02:12:43.978512] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T02:12:43.983072] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:12:43.983909] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-17T02:12:44.633255] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T02:12:44.690098] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-17T02:12:44.859911] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T02:12:45.490151] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-17T02:12:46.290096] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-17T02:12:46.562912] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T02:12:46.618005] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T02:12:47.074826] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T02:12:47.090072] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-17T02:12:47.890140] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-17T02:12:47.997041] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T02:12:48.690136] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-17T02:12:49.490169] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-17T02:12:49.950439] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T02:12:50.037308] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T02:12:50.290156] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-17T02:12:50.362318] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T02:12:51.090165] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-17T02:12:51.890095] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-17T02:12:52.277196] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T02:12:52.327374] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T02:12:52.690174] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-17T02:12:52.981890] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T02:12:53.490121] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-17T02:12:53.769310] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T02:12:54.290136] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-17T02:12:55.090129] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-17T02:12:55.253578] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T02:12:55.645532] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T02:12:55.890100] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-17T02:12:56.206720] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T02:12:56.690127] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-17T02:12:57.490136] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-17T02:12:57.842269] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T02:12:57.954566] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-17T02:12:57.960996] [INFO ] [REMOTE ] B: Full fetch complete (43996 records). [2025-09-17T02:12:57.961117] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-17T02:12:58.156211] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-17T02:12:58.156747] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:12:58.156808] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:12:58.156864] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-17T02:12:58.156934] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-17T02:12:58.156984] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-17T02:12:58.157060] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-17T02:12:58.157140] [INFO ] [MAIN ] Update Progress: 201/2369 symbols completed. B took 20.1s. Estimated remaining: 5h 11m 14s. Rate: 7.0 symbols/min [2025-09-17T02:12:58.304330] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-17T02:12:58.340923] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:58.382418] [DEBUG] [LOCAL ] BA: Loaded 40141 existing records from primary storage. [2025-09-17T02:12:58.382683] [INFO ] [MAIN ] BA: Loaded 40141 existing records. [2025-09-17T02:12:58.580497] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:12:58.580881] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-17T02:12:58.580955] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-17T02:12:58.582863] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-17T02:12:58.582944] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-17T02:12:58.945512] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:12:58.962888] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:12:59.023833] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T02:12:59.027820] [INFO ] [REMOTE ] AZZ: Full fetch complete (30630 records). [2025-09-17T02:12:59.027924] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-17T02:12:59.095183] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-17T02:12:59.419133] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-17T02:12:59.419274] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-17T02:12:59.420016] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-17T02:12:59.420130] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-17T02:12:59.421876] [DEBUG] [LOCAL ] AZZ: Trimmed 30630 records to 22142 (keeping 200 days of data) [2025-09-17T02:12:59.563929] [DEBUG] [LOCAL ] AZZ: Primary data saved (22142 records). [2025-09-17T02:12:59.564084] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-17T02:12:59.564207] [INFO ] [MAIN ] Update Progress: 202/2369 symbols completed. AZZ took 21.5s. Estimated remaining: 5h 9m 48s. Rate: 7.0 symbols/min [2025-09-17T02:12:59.740704] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:12:59.784952] [DEBUG] [LOCAL ] BABA: Loaded 40170 existing records from primary storage. [2025-09-17T02:12:59.785122] [INFO ] [MAIN ] BABA: Loaded 40170 existing records. [2025-09-17T02:12:59.895215] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-11. [2025-09-17T02:12:59.967811] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:12:59.968062] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-17T02:12:59.968123] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-17T02:12:59.969756] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-17T02:12:59.969820] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-17T02:13:00.330694] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:00.340695] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T02:13:00.690162] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-17T02:13:01.490146] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-11. [2025-09-17T02:13:01.597015] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T02:13:02.290142] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-17T02:13:02.414903] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-11 (2.52 seconds). [2025-09-17T02:13:03.090192] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-17T02:13:03.138379] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T02:13:03.890208] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-17T02:13:04.187032] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-11 (2.70 seconds). [2025-09-17T02:13:04.643329] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T02:13:04.645043] [INFO ] [REMOTE ] AZO: Full fetch complete (16539 records). [2025-09-17T02:13:04.645141] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-17T02:13:04.699318] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-17T02:13:05.022386] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-17T02:13:05.022504] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-17T02:13:05.022868] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-17T02:13:05.022971] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-17T02:13:05.023550] [DEBUG] [LOCAL ] AZO: Trimmed 16539 records to 11621 (keeping 200 days of data) [2025-09-17T02:13:05.101192] [DEBUG] [LOCAL ] AZO: Primary data saved (11621 records). [2025-09-17T02:13:05.101373] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-17T02:13:05.101491] [INFO ] [MAIN ] Update Progress: 203/2369 symbols completed. AZO took 27.0s. Estimated remaining: 5h 9m 7s. Rate: 7.0 symbols/min [2025-09-17T02:13:05.276823] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:05.317463] [DEBUG] [LOCAL ] BAC: Loaded 40158 existing records from primary storage. [2025-09-17T02:13:05.317654] [INFO ] [MAIN ] BAC: Loaded 40158 existing records. [2025-09-17T02:13:05.492028] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-17T02:13:05.514613] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:13:05.516052] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-17T02:13:05.516198] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-17T02:13:05.517979] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-17T02:13:05.518061] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-17T02:13:05.879694] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:05.924832] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T02:13:05.932409] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-09-17T02:13:06.290149] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-17T02:13:07.090147] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-17T02:13:07.525081] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T02:13:07.867097] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-17T02:13:07.890102] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-17T02:13:08.690199] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-11. [2025-09-17T02:13:09.245770] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-17T02:13:09.490184] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-17T02:13:10.290211] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-17T02:13:10.398526] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-17T02:13:10.813070] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-17T02:13:11.090173] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-17T02:13:11.268610] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T02:13:11.271484] [INFO ] [REMOTE ] AYI: Full fetch complete (36903 records). [2025-09-17T02:13:11.271590] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-17T02:13:11.663502] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-17T02:13:11.663736] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-17T02:13:11.664591] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-17T02:13:11.664799] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-17T02:13:11.666814] [DEBUG] [LOCAL ] AYI: Trimmed 36903 records to 25758 (keeping 200 days of data) [2025-09-17T02:13:11.843192] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-17T02:13:11.894828] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-17T02:13:11.916636] [DEBUG] [LOCAL ] AYI: Primary data saved (25758 records). [2025-09-17T02:13:11.916895] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-17T02:13:11.917047] [INFO ] [MAIN ] Update Progress: 204/2369 symbols completed. AYI took 33.9s. Estimated remaining: 5h 8m 40s. Rate: 7.0 symbols/min [2025-09-17T02:13:12.095506] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:12.095766] [DEBUG] [LOCAL ] BAH: No existing data file found in primary storage. [2025-09-17T02:13:12.095820] [WARN ] [MAIN ] BAH: No existing data found, performing full refresh instead. [2025-09-17T02:13:12.095934] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-17T02:13:12.095985] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-17T02:13:12.096033] [DEBUG] [LOCAL ] BAH: No primary data file found to delete. [2025-09-17T02:13:12.096088] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-17T02:13:12.452313] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:12.690158] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-11. [2025-09-17T02:13:13.373282] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-17T02:13:13.490107] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-17T02:13:14.290151] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-17T02:13:14.414814] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-17T02:13:14.531160] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T02:13:15.090204] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-17T02:13:15.890236] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-17T02:13:16.225811] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-17T02:13:16.690158] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-17T02:13:16.750554] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-17T02:13:17.162560] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-17T02:13:17.490171] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-17T02:13:17.773067] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T02:13:18.290176] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-17T02:13:19.090211] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-17T02:13:19.346614] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-17T02:13:19.890169] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-17T02:13:20.075839] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-17T02:13:20.305381] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T02:13:20.690171] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-17T02:13:20.888026] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T02:13:21.490173] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-17T02:13:22.290205] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-17T02:13:22.586422] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-17T02:13:23.096269] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-17T02:13:23.122628] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-17T02:13:23.181377] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:13:23.890189] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-17T02:13:24.530835] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-17T02:13:24.690149] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-17T02:13:25.490125] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-17T02:13:25.648500] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-17T02:13:25.732087] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T02:13:26.290135] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-17T02:13:27.090164] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-17T02:13:27.269369] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-17T02:13:27.890109] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-17T02:13:27.970699] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-17T02:13:28.690121] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-17T02:13:28.754074] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T02:13:29.175417] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-17T02:13:29.490129] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-17T02:13:30.007491] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T02:13:30.290178] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-17T02:13:30.915518] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T02:13:31.090176] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-17T02:13:31.890168] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-17T02:13:32.188989] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-17T02:13:32.290406] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T02:13:32.690174] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-17T02:13:33.376218] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T02:13:33.490152] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-17T02:13:34.021918] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T02:13:34.298534] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-17T02:13:34.318667] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-17T02:13:35.090135] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-17T02:13:35.890172] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-17T02:13:36.094871] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-17T02:13:36.101417] [INFO ] [REMOTE ] BABA: Full fetch complete (77980 records). [2025-09-17T02:13:36.101573] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-17T02:13:36.531186] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-17T02:13:36.531836] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-17T02:13:36.533290] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T02:13:36.534297] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-17T02:13:36.534482] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-17T02:13:36.546560] [DEBUG] [LOCAL ] BABA: Trimmed 77980 records to 53820 (keeping 200 days of data) [2025-09-17T02:13:36.690229] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-17T02:13:36.926917] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-09-17T02:13:36.927092] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-17T02:13:36.927199] [INFO ] [MAIN ] Update Progress: 205/2369 symbols completed. BABA took 37.4s. Estimated remaining: 5h 11m 25s. Rate: 6.9 symbols/min [2025-09-17T02:13:37.099939] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:37.128791] [DEBUG] [LOCAL ] BAK: Loaded 29020 existing records from primary storage. [2025-09-17T02:13:37.128958] [INFO ] [MAIN ] BAK: Loaded 29020 existing records. [2025-09-17T02:13:37.307135] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:13:37.307421] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-17T02:13:37.307490] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-17T02:13:37.308393] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-17T02:13:37.308460] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-17T02:13:37.660536] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:37.660992] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-11. [2025-09-17T02:13:37.698060] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-17T02:13:38.140573] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-17T02:13:38.147365] [INFO ] [REMOTE ] BA: Full fetch complete (77904 records). [2025-09-17T02:13:38.147628] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-17T02:13:38.297784] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-17T02:13:38.549190] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T02:13:38.592377] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-17T02:13:38.592696] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-17T02:13:38.593669] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-17T02:13:38.593761] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-17T02:13:38.595742] [DEBUG] [LOCAL ] BA: Trimmed 77904 records to 53791 (keeping 200 days of data) [2025-09-17T02:13:38.934703] [DEBUG] [LOCAL ] BA: Primary data saved (53791 records). [2025-09-17T02:13:38.934868] [INFO ] [MAIN ] BA: Full history saved. [2025-09-17T02:13:38.934966] [INFO ] [MAIN ] Update Progress: 206/2369 symbols completed. BA took 40.8s. Estimated remaining: 5h 10m 7s. Rate: 7.0 symbols/min [2025-09-17T02:13:39.103593] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-17T02:13:39.105990] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:39.144397] [DEBUG] [LOCAL ] BALL: Loaded 38534 existing records from primary storage. [2025-09-17T02:13:39.144708] [INFO ] [MAIN ] BALL: Loaded 38534 existing records. [2025-09-17T02:13:39.363514] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:13:39.363974] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-17T02:13:39.364099] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-17T02:13:39.371740] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-17T02:13:39.384263] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-17T02:13:39.463386] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T02:13:39.763477] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:39.890195] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-11. [2025-09-17T02:13:40.696565] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-17T02:13:40.735765] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-17T02:13:40.748630] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:13:40.756456] [INFO ] [REMOTE ] BAH: Full fetch complete (74630 records). [2025-09-17T02:13:40.756719] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-17T02:13:41.160077] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-17T02:13:41.160197] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-17T02:13:41.161017] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-17T02:13:41.161080] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-17T02:13:41.162566] [DEBUG] [LOCAL ] BAH: Trimmed 74630 records to 51820 (keeping 200 days of data) [2025-09-17T02:13:41.490149] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-17T02:13:41.520359] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:13:41.544374] [DEBUG] [LOCAL ] BAH: Primary data saved (51820 records). [2025-09-17T02:13:41.544534] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-17T02:13:41.544626] [INFO ] [MAIN ] Update Progress: 207/2369 symbols completed. BAH took 29.6s. Estimated remaining: 5h 8m 56s. Rate: 7.0 symbols/min [2025-09-17T02:13:41.714283] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:41.723284] [DEBUG] [LOCAL ] BALY: Loaded 7203 existing records from primary storage. [2025-09-17T02:13:41.723455] [INFO ] [MAIN ] BALY: Loaded 7203 existing records. [2025-09-17T02:13:41.910920] [WARN ] [MAIN ] BALY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:13:41.911239] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-17T02:13:41.911303] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-17T02:13:41.911739] [DEBUG] [LOCAL ] BALY: Deleted primary data file. [2025-09-17T02:13:41.911817] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-17T02:13:42.283112] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:42.295209] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-17T02:13:42.310969] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T02:13:43.090139] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-17T02:13:43.438760] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-17T02:13:43.445252] [INFO ] [REMOTE ] BAC: Full fetch complete (77933 records). [2025-09-17T02:13:43.445410] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-17T02:13:43.833232] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-17T02:13:43.833335] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-17T02:13:43.834100] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-17T02:13:43.834160] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-17T02:13:43.835662] [DEBUG] [LOCAL ] BAC: Trimmed 77933 records to 53808 (keeping 200 days of data) [2025-09-17T02:13:43.899166] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-11. [2025-09-17T02:13:44.116086] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T02:13:44.216895] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-09-17T02:13:44.217073] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-17T02:13:44.219667] [INFO ] [MAIN ] Update Progress: 208/2369 symbols completed. BAC took 39.1s. Estimated remaining: 5h 7m 46s. Rate: 7.0 symbols/min [2025-09-17T02:13:44.387350] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:13:44.428712] [DEBUG] [LOCAL ] BAM: Loaded 38634 existing records from primary storage. [2025-09-17T02:13:44.428899] [INFO ] [MAIN ] BAM: Loaded 38634 existing records. [2025-09-17T02:13:44.605078] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:13:44.605338] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-17T02:13:44.605391] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-17T02:13:44.606484] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-17T02:13:44.606546] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-17T02:13:44.707853] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-17T02:13:44.971795] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:13:44.993360] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T02:13:45.319983] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T02:13:45.490190] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-11. [2025-09-17T02:13:46.290137] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-17T02:13:46.510993] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T02:13:46.677462] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:13:47.090126] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-17T02:13:47.351860] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:13:47.890122] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-17T02:13:48.292148] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T02:13:48.690116] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-17T02:13:49.490150] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-17T02:13:49.673318] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T02:13:50.138368] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T02:13:50.290120] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-17T02:13:51.090145] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-17T02:13:51.135038] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T02:13:51.789869] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T02:13:51.848109] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T02:13:51.890170] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-17T02:13:52.690160] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-17T02:13:53.204051] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T02:13:53.490198] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-17T02:13:54.290150] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-17T02:13:54.585017] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T02:13:54.942712] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T02:13:55.090154] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-17T02:13:55.655950] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T02:13:55.890137] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-17T02:13:56.600536] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T02:13:56.660843] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T02:13:56.690126] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-17T02:13:57.173395] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T02:13:57.490141] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-17T02:13:58.290123] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-17T02:13:59.090092] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-17T02:13:59.201189] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T02:13:59.808886] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T02:13:59.890117] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-17T02:14:00.635983] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T02:14:00.690145] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-17T02:14:01.490141] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-17T02:14:01.830990] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T02:14:01.855160] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T02:14:01.860173] [INFO ] [REMOTE ] BAK: Full fetch complete (56982 records). [2025-09-17T02:14:01.860306] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-17T02:14:02.159542] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T02:14:02.254505] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-17T02:14:02.254631] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-17T02:14:02.255319] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-17T02:14:02.255380] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-17T02:14:02.256726] [DEBUG] [LOCAL ] BAK: Trimmed 56982 records to 38907 (keeping 200 days of data) [2025-09-17T02:14:02.304255] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-17T02:14:02.485832] [DEBUG] [LOCAL ] BAK: Primary data saved (38907 records). [2025-09-17T02:14:02.486019] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-17T02:14:02.486134] [INFO ] [MAIN ] Update Progress: 209/2369 symbols completed. BAK took 25.6s. Estimated remaining: 5h 9m 18s. Rate: 7.0 symbols/min [2025-09-17T02:14:02.660346] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:02.698098] [DEBUG] [LOCAL ] BANC: Loaded 37899 existing records from primary storage. [2025-09-17T02:14:02.698269] [INFO ] [MAIN ] BANC: Loaded 37899 existing records. [2025-09-17T02:14:02.875488] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:02.875784] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-17T02:14:02.875850] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-17T02:14:02.877095] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-17T02:14:02.877157] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-17T02:14:03.097363] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-17T02:14:03.245034] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T02:14:03.265054] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:03.890150] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-11. [2025-09-17T02:14:04.690712] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-17T02:14:04.693257] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T02:14:05.490169] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-17T02:14:05.514543] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T02:14:05.573804] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T02:14:06.290192] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-17T02:14:07.090190] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-17T02:14:07.332823] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T02:14:07.575969] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:14:07.890196] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-17T02:14:07.978431] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T02:14:08.690156] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-17T02:14:09.371973] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T02:14:09.490136] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-17T02:14:09.776321] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T02:14:10.290168] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-17T02:14:10.969363] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T02:14:10.970993] [INFO ] [REMOTE ] BALY: Full fetch complete (17749 records). [2025-09-17T02:14:10.971097] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-17T02:14:11.093367] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-17T02:14:11.158635] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T02:14:11.159004] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:14:11.159151] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:14:11.159250] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-17T02:14:11.159411] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-17T02:14:11.159468] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-17T02:14:11.159865] [DEBUG] [LOCAL ] BALY: Deleted derivative data file. [2025-09-17T02:14:11.160017] [INFO ] [MAIN ] Update Progress: 210/2369 symbols completed. BALY took 29.6s. Estimated remaining: 5h 9m 10s. Rate: 7.0 symbols/min [2025-09-17T02:14:11.356715] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:11.358670] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T02:14:11.387372] [DEBUG] [LOCAL ] BAP: Loaded 19126 existing records from primary storage. [2025-09-17T02:14:11.387530] [INFO ] [MAIN ] BAP: Loaded 19126 existing records. [2025-09-17T02:14:11.570347] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:11.570615] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-17T02:14:11.570696] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-17T02:14:11.571484] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-17T02:14:11.571554] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-17T02:14:11.906130] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-17T02:14:11.946262] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:12.296895] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T02:14:12.690167] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-17T02:14:13.490155] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-11. [2025-09-17T02:14:13.735524] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T02:14:14.290114] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-17T02:14:14.644896] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:14:14.677979] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T02:14:15.090173] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-17T02:14:15.730398] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T02:14:15.890217] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-17T02:14:16.690158] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-17T02:14:16.766614] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T02:14:17.490136] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-17T02:14:17.783123] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:14:17.940797] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T02:14:18.290183] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-17T02:14:19.098134] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-17T02:14:19.103584] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T02:14:19.648956] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T02:14:19.658631] [INFO ] [REMOTE ] BALL: Full fetch complete (75123 records). [2025-09-17T02:14:19.658885] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-17T02:14:19.895373] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-17T02:14:20.065584] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-17T02:14:20.065739] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-17T02:14:20.066586] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-17T02:14:20.066692] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-17T02:14:20.068297] [DEBUG] [LOCAL ] BALL: Trimmed 75123 records to 51856 (keeping 200 days of data) [2025-09-17T02:14:20.191884] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T02:14:20.403907] [DEBUG] [LOCAL ] BALL: Primary data saved (51856 records). [2025-09-17T02:14:20.404075] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-17T02:14:20.404171] [INFO ] [MAIN ] Update Progress: 211/2369 symbols completed. BALL took 41.5s. Estimated remaining: 5h 9m 8s. Rate: 7.0 symbols/min [2025-09-17T02:14:20.582284] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:20.610793] [DEBUG] [LOCAL ] BARK: Loaded 28629 existing records from primary storage. [2025-09-17T02:14:20.610962] [INFO ] [MAIN ] BARK: Loaded 28629 existing records. [2025-09-17T02:14:20.695245] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-17T02:14:20.800883] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:20.801122] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-17T02:14:20.801180] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-17T02:14:20.802177] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-17T02:14:20.802241] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-17T02:14:21.159524] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:21.490133] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-17T02:14:21.618524] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T02:14:21.650033] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T02:14:22.290147] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-17T02:14:23.090103] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-17T02:14:23.153592] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T02:14:23.890218] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-11. [2025-09-17T02:14:24.273931] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T02:14:24.352965] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T02:14:24.690147] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-17T02:14:25.032374] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T02:14:25.490162] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-17T02:14:26.193536] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T02:14:26.200106] [INFO ] [REMOTE ] BAM: Full fetch complete (73673 records). [2025-09-17T02:14:26.200282] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-17T02:14:26.296529] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-17T02:14:26.627435] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-17T02:14:26.627562] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-17T02:14:26.628343] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-17T02:14:26.628408] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-17T02:14:26.630134] [DEBUG] [LOCAL ] BAM: Trimmed 73673 records to 52019 (keeping 200 days of data) [2025-09-17T02:14:26.962554] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T02:14:26.987105] [DEBUG] [LOCAL ] BAM: Primary data saved (52019 records). [2025-09-17T02:14:26.987384] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-17T02:14:26.988799] [INFO ] [MAIN ] Update Progress: 212/2369 symbols completed. BAM took 42.8s. Estimated remaining: 5h 8m 39s. Rate: 7.0 symbols/min [2025-09-17T02:14:27.096402] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-17T02:14:27.169483] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:27.217134] [DEBUG] [LOCAL ] BAX: Loaded 39905 existing records from primary storage. [2025-09-17T02:14:27.217317] [INFO ] [MAIN ] BAX: Loaded 39905 existing records. [2025-09-17T02:14:27.417171] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:27.417445] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-17T02:14:27.417504] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-17T02:14:27.418820] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-17T02:14:27.418883] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-17T02:14:27.771583] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:27.890111] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-11. [2025-09-17T02:14:28.107844] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T02:14:28.391733] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T02:14:28.690136] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-17T02:14:29.490138] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-17T02:14:29.675668] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T02:14:29.838295] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T02:14:30.290119] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-17T02:14:31.090132] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-17T02:14:31.265920] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T02:14:31.446492] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T02:14:31.890131] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-17T02:14:32.395558] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T02:14:32.690102] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-17T02:14:33.042617] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T02:14:33.490137] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-17T02:14:34.238623] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:14:34.290111] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-17T02:14:35.017353] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T02:14:35.090098] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-17T02:14:35.495498] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T02:14:35.499520] [INFO ] [REMOTE ] BAP: Full fetch complete (37935 records). [2025-09-17T02:14:35.499656] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-17T02:14:35.885603] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-17T02:14:35.885745] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-17T02:14:35.886335] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-17T02:14:35.886407] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-17T02:14:35.887454] [DEBUG] [LOCAL ] BAP: Trimmed 37935 records to 26418 (keeping 200 days of data) [2025-09-17T02:14:35.942138] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-17T02:14:36.051914] [DEBUG] [LOCAL ] BAP: Primary data saved (26418 records). [2025-09-17T02:14:36.052075] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-17T02:14:36.052167] [INFO ] [MAIN ] Update Progress: 213/2369 symbols completed. BAP took 24.9s. Estimated remaining: 5h 8m 36s. Rate: 7.0 symbols/min [2025-09-17T02:14:36.226100] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:36.267251] [DEBUG] [LOCAL ] BB: Loaded 39362 existing records from primary storage. [2025-09-17T02:14:36.267421] [INFO ] [MAIN ] BB: Loaded 39362 existing records. [2025-09-17T02:14:36.451176] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:36.451460] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-17T02:14:36.451522] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-17T02:14:36.452777] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-17T02:14:36.452842] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-17T02:14:36.698792] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-17T02:14:36.830826] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:36.860831] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T02:14:37.401547] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T02:14:37.490128] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-11. [2025-09-17T02:14:38.290115] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-17T02:14:38.414581] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T02:14:39.090123] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-17T02:14:39.404878] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T02:14:39.786685] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T02:14:39.890142] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-17T02:14:40.690164] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-17T02:14:40.819608] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T02:14:41.333135] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:14:41.490156] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-17T02:14:42.290153] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-17T02:14:42.323766] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T02:14:42.332908] [INFO ] [REMOTE ] BANC: Full fetch complete (73868 records). [2025-09-17T02:14:42.333157] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-17T02:14:42.749710] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-17T02:14:42.749857] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-17T02:14:42.750743] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-17T02:14:42.750814] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-17T02:14:42.752514] [DEBUG] [LOCAL ] BANC: Trimmed 73868 records to 51263 (keeping 200 days of data) [2025-09-17T02:14:43.074374] [DEBUG] [LOCAL ] BANC: Primary data saved (51263 records). [2025-09-17T02:14:43.074596] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-17T02:14:43.074733] [INFO ] [MAIN ] Update Progress: 214/2369 symbols completed. BANC took 40.6s. Estimated remaining: 5h 8m 11s. Rate: 7.0 symbols/min [2025-09-17T02:14:43.095859] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-17T02:14:43.272246] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:43.345108] [DEBUG] [LOCAL ] BBAI: Loaded 40170 existing records from primary storage. [2025-09-17T02:14:43.347298] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T02:14:43.347598] [INFO ] [MAIN ] BBAI: Loaded 40170 existing records. [2025-09-17T02:14:43.544254] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:43.555671] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-17T02:14:43.573142] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-17T02:14:43.575163] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T02:14:43.575249] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-17T02:14:43.585974] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-17T02:14:43.903960] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-17T02:14:43.942777] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:44.690128] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-11. [2025-09-17T02:14:45.267373] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-17T02:14:45.490177] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-17T02:14:45.846284] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T02:14:46.290187] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-17T02:14:46.420052] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T02:14:47.063196] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:14:47.090101] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-17T02:14:47.756398] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T02:14:47.890141] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-17T02:14:48.690131] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-17T02:14:48.947155] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T02:14:49.495209] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-17T02:14:49.513398] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T02:14:50.290216] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-17T02:14:50.434283] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T02:14:51.090142] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-17T02:14:51.890129] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-17T02:14:52.088000] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-17T02:14:52.340415] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T02:14:52.690134] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-17T02:14:53.044566] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T02:14:53.092262] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T02:14:53.490132] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-17T02:14:54.290131] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-17T02:14:54.669172] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T02:14:55.090134] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-17T02:14:55.370477] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T02:14:55.890126] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-17T02:14:56.096089] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-09-17T02:14:56.690144] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-17T02:14:57.097906] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T02:14:57.121617] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:14:57.126047] [INFO ] [REMOTE ] BARK: Full fetch complete (57380 records). [2025-09-17T02:14:57.126171] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-17T02:14:57.492489] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-17T02:14:57.509999] [DEBUG] [VALIDATOR ] BARK: All expected trading days are present. [2025-09-17T02:14:57.510090] [DEBUG] [VALIDATOR ] BARK: Primary data validation passed. [2025-09-17T02:14:57.510729] [INFO ] [MAIN ] BARK: Fetched primary data is valid. [2025-09-17T02:14:57.510868] [DEBUG] [LOCAL ] BARK: Saving primary data. [2025-09-17T02:14:57.512130] [DEBUG] [LOCAL ] BARK: Trimmed 57380 records to 38682 (keeping 200 days of data) [2025-09-17T02:14:57.733928] [DEBUG] [LOCAL ] BARK: Primary data saved (38682 records). [2025-09-17T02:14:57.734104] [INFO ] [MAIN ] BARK: Full history saved. [2025-09-17T02:14:57.734252] [INFO ] [MAIN ] Update Progress: 215/2369 symbols completed. BARK took 37.3s. Estimated remaining: 5h 9m 4s. Rate: 7.0 symbols/min [2025-09-17T02:14:57.901435] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:14:57.931688] [DEBUG] [LOCAL ] BBAR: Loaded 30859 existing records from primary storage. [2025-09-17T02:14:57.931850] [INFO ] [MAIN ] BBAR: Loaded 30859 existing records. [2025-09-17T02:14:58.112862] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:14:58.113229] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-17T02:14:58.113314] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-17T02:14:58.114388] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-17T02:14:58.114483] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-17T02:14:58.297008] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-17T02:14:58.472341] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:14:58.774277] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T02:14:59.051551] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:14:59.090146] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-11. [2025-09-17T02:14:59.890145] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-17T02:15:00.061639] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T02:15:00.070576] [INFO ] [REMOTE ] BAX: Full fetch complete (77275 records). [2025-09-17T02:15:00.070907] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-17T02:15:00.523432] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-17T02:15:00.523561] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-17T02:15:00.524680] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-17T02:15:00.524760] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-17T02:15:00.526350] [DEBUG] [LOCAL ] BAX: Trimmed 77275 records to 53491 (keeping 200 days of data) [2025-09-17T02:15:00.733082] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-17T02:15:00.789099] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:15:00.912946] [DEBUG] [LOCAL ] BAX: Primary data saved (53491 records). [2025-09-17T02:15:00.913131] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-17T02:15:00.913911] [INFO ] [MAIN ] Update Progress: 216/2369 symbols completed. BAX took 33.9s. Estimated remaining: 5h 8m 1s. Rate: 7.0 symbols/min [2025-09-17T02:15:01.084690] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:01.126892] [DEBUG] [LOCAL ] BBD: Loaded 39702 existing records from primary storage. [2025-09-17T02:15:01.127063] [INFO ] [MAIN ] BBD: Loaded 39702 existing records. [2025-09-17T02:15:01.304892] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:01.305161] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-17T02:15:01.305221] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-17T02:15:01.306400] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-17T02:15:01.306464] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-17T02:15:01.494918] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-17T02:15:01.732368] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:02.290119] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-11. [2025-09-17T02:15:02.335497] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-17T02:15:03.090190] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-17T02:15:04.205609] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (3.47 seconds). [2025-09-17T02:15:04.218092] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-17T02:15:04.241948] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-17T02:15:04.690238] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-17T02:15:05.429449] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-11 (3.14 seconds). [2025-09-17T02:15:05.490149] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-17T02:15:05.559663] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-17T02:15:06.290133] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-17T02:15:06.568701] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T02:15:07.074264] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:15:07.090456] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-17T02:15:07.473484] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (3.26 seconds). [2025-09-17T02:15:07.890180] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-17T02:15:08.226992] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:15:08.592741] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T02:15:08.690225] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-17T02:15:09.490134] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-17T02:15:09.761334] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T02:15:10.290185] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-17T02:15:10.529056] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T02:15:10.535561] [INFO ] [REMOTE ] BB: Full fetch complete (76853 records). [2025-09-17T02:15:10.535759] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-17T02:15:10.932063] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-17T02:15:10.932180] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-17T02:15:10.933176] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-17T02:15:10.933305] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-17T02:15:10.934835] [DEBUG] [LOCAL ] BB: Trimmed 76853 records to 52930 (keeping 200 days of data) [2025-09-17T02:15:11.042114] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T02:15:11.130202] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-17T02:15:11.279912] [DEBUG] [LOCAL ] BB: Primary data saved (52930 records). [2025-09-17T02:15:11.280082] [INFO ] [MAIN ] BB: Full history saved. [2025-09-17T02:15:11.280810] [INFO ] [MAIN ] Update Progress: 217/2369 symbols completed. BB took 35.2s. Estimated remaining: 5h 8m 10s. Rate: 7.0 symbols/min [2025-09-17T02:15:11.457949] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:11.483880] [DEBUG] [LOCAL ] BBDC: Loaded 23506 existing records from primary storage. [2025-09-17T02:15:11.484060] [INFO ] [MAIN ] BBDC: Loaded 23506 existing records. [2025-09-17T02:15:11.670757] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:11.671039] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-17T02:15:11.671105] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-17T02:15:11.671884] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-17T02:15:11.671963] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-17T02:15:11.896770] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-17T02:15:12.050406] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:12.082421] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T02:15:12.690185] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-17T02:15:12.823746] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T02:15:13.490138] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-17T02:15:14.290148] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-11. [2025-09-17T02:15:14.438507] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T02:15:14.686906] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-17T02:15:14.724059] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T02:15:15.090147] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-17T02:15:15.581096] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T02:15:15.890158] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-17T02:15:16.360031] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T02:15:16.690144] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-17T02:15:17.340338] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T02:15:17.490154] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-17T02:15:18.290245] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-17T02:15:19.090138] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-17T02:15:20.089799] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (3.40 seconds). [2025-09-17T02:15:20.101519] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-17T02:15:20.600192] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (3.11 seconds). [2025-09-17T02:15:20.647185] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-17T02:15:20.690125] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-17T02:15:20.970360] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T02:15:21.490154] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-17T02:15:22.290155] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-17T02:15:22.543665] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T02:15:22.602693] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-17T02:15:22.742042] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T02:15:23.090140] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-17T02:15:23.343179] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T02:15:23.890155] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-17T02:15:24.690123] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-17T02:15:24.781540] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T02:15:25.441530] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T02:15:25.490146] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-17T02:15:25.789266] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T02:15:25.795122] [INFO ] [REMOTE ] BBAR: Full fetch complete (60190 records). [2025-09-17T02:15:25.795298] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-17T02:15:26.185589] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-17T02:15:26.185720] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-17T02:15:26.186352] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-17T02:15:26.186433] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-17T02:15:26.187713] [DEBUG] [LOCAL ] BBAR: Trimmed 60190 records to 40983 (keeping 200 days of data) [2025-09-17T02:15:26.290204] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-17T02:15:26.455805] [DEBUG] [LOCAL ] BBAR: Primary data saved (40983 records). [2025-09-17T02:15:26.455969] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-17T02:15:26.456111] [INFO ] [MAIN ] Update Progress: 218/2369 symbols completed. BBAR took 28.7s. Estimated remaining: 5h 9m 6s. Rate: 7.0 symbols/min [2025-09-17T02:15:26.637280] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:26.642625] [DEBUG] [LOCAL ] BBDO: Loaded 3607 existing records from primary storage. [2025-09-17T02:15:26.642753] [INFO ] [MAIN ] BBDO: Loaded 3607 existing records. [2025-09-17T02:15:26.826818] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:26.827098] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-17T02:15:26.827172] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-17T02:15:26.827463] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-17T02:15:26.827536] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-17T02:15:27.101237] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-17T02:15:27.186323] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:27.836325] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-17T02:15:27.890097] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-17T02:15:28.206288] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T02:15:28.665761] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T02:15:28.690094] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-17T02:15:29.490131] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-17T02:15:29.812110] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T02:15:29.970891] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-17T02:15:29.977401] [INFO ] [REMOTE ] BBAI: Full fetch complete (77974 records). [2025-09-17T02:15:29.977609] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-17T02:15:30.295211] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-11. [2025-09-17T02:15:30.371678] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-17T02:15:30.371793] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-17T02:15:30.372635] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-17T02:15:30.372723] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-17T02:15:30.374318] [DEBUG] [LOCAL ] BBAI: Trimmed 77974 records to 53820 (keeping 200 days of data) [2025-09-17T02:15:30.699599] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-09-17T02:15:30.699787] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-17T02:15:30.699897] [INFO ] [MAIN ] Update Progress: 219/2369 symbols completed. BBAI took 47.6s. Estimated remaining: 5h 8m 15s. Rate: 7.0 symbols/min [2025-09-17T02:15:30.805882] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T02:15:30.878412] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:30.896236] [DEBUG] [LOCAL ] BBN: Loaded 13520 existing records from primary storage. [2025-09-17T02:15:30.896400] [INFO ] [MAIN ] BBN: Loaded 13520 existing records. [2025-09-17T02:15:31.075574] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:31.075876] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-17T02:15:31.075946] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-17T02:15:31.076615] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-17T02:15:31.076715] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-17T02:15:31.097126] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-17T02:15:31.442395] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:31.477128] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T02:15:31.890147] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-11. [2025-09-17T02:15:31.922195] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T02:15:32.690123] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-17T02:15:32.980488] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T02:15:33.490139] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-17T02:15:34.261576] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T02:15:34.290106] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-17T02:15:34.754828] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T02:15:35.090148] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-17T02:15:35.867204] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T02:15:35.873759] [INFO ] [REMOTE ] BBD: Full fetch complete (77001 records). [2025-09-17T02:15:35.873924] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-17T02:15:35.895782] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-17T02:15:36.286361] [DEBUG] [VALIDATOR ] BBD: All expected trading days are present. [2025-09-17T02:15:36.286531] [DEBUG] [VALIDATOR ] BBD: Primary data validation passed. [2025-09-17T02:15:36.287789] [INFO ] [MAIN ] BBD: Fetched primary data is valid. [2025-09-17T02:15:36.287896] [DEBUG] [LOCAL ] BBD: Saving primary data. [2025-09-17T02:15:36.289601] [DEBUG] [LOCAL ] BBD: Trimmed 77001 records to 53176 (keeping 200 days of data) [2025-09-17T02:15:36.418259] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T02:15:36.657352] [DEBUG] [LOCAL ] BBD: Primary data saved (53176 records). [2025-09-17T02:15:36.657528] [INFO ] [MAIN ] BBD: Full history saved. [2025-09-17T02:15:36.659422] [INFO ] [MAIN ] Update Progress: 220/2369 symbols completed. BBD took 35.7s. Estimated remaining: 5h 7m 40s. Rate: 7.0 symbols/min [2025-09-17T02:15:36.695245] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-17T02:15:36.829808] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:36.829983] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-17T02:15:36.830024] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-17T02:15:36.830126] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-17T02:15:36.830176] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-17T02:15:36.830226] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-17T02:15:36.830286] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-17T02:15:37.134803] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T02:15:37.210827] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:37.490131] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-17T02:15:38.059997] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T02:15:38.060564] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T02:15:38.290182] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-17T02:15:39.092017] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-17T02:15:39.094579] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T02:15:39.890148] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-17T02:15:40.324533] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:15:40.331802] [INFO ] [REMOTE ] BBDC: Full fetch complete (48989 records). [2025-09-17T02:15:40.331949] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-17T02:15:40.693799] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-11. [2025-09-17T02:15:40.695083] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T02:15:40.733857] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-17T02:15:40.733966] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-17T02:15:40.734576] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-17T02:15:40.734637] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-17T02:15:40.735753] [DEBUG] [LOCAL ] BBDC: Trimmed 48989 records to 33544 (keeping 200 days of data) [2025-09-17T02:15:40.937808] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:40.940812] [DEBUG] [LOCAL ] BBDC: Primary data saved (33544 records). [2025-09-17T02:15:40.940750] [WARN ] [REMOTE ] BBT: No data returned for month 2024-11 [2025-09-17T02:15:40.941341] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-17T02:15:40.941435] [INFO ] [MAIN ] Update Progress: 221/2369 symbols completed. BBDC took 29.7s. Estimated remaining: 5h 6m 50s. Rate: 7.0 symbols/min [2025-09-17T02:15:41.111367] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:41.116181] [DEBUG] [LOCAL ] BBU: Loaded 3205 existing records from primary storage. [2025-09-17T02:15:41.116277] [INFO ] [MAIN ] BBU: Loaded 3205 existing records. [2025-09-17T02:15:41.293466] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:41.293746] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-17T02:15:41.293808] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-17T02:15:41.294130] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-17T02:15:41.294190] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-17T02:15:41.495199] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-17T02:15:41.649231] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:42.290115] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-17T02:15:42.505783] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:42.506201] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-17T02:15:42.636835] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T02:15:43.090155] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-17T02:15:43.300500] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:43.300930] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-17T02:15:43.890152] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-17T02:15:44.690183] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-11. [2025-09-17T02:15:44.967542] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T02:15:45.286510] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T02:15:45.490135] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-17T02:15:46.290109] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-17T02:15:46.512565] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:46.512952] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-17T02:15:46.589806] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T02:15:47.090148] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-17T02:15:47.751608] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T02:15:47.890132] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-17T02:15:48.560801] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T02:15:48.690130] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-17T02:15:48.899140] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:48.899476] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-17T02:15:49.490185] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-17T02:15:49.699974] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:49.700361] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-17T02:15:50.290143] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-17T02:15:51.090163] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-17T02:15:51.297346] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:51.297724] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-17T02:15:51.333419] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T02:15:51.890137] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-17T02:15:52.500581] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T02:15:52.690194] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-17T02:15:52.914474] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:52.914849] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-17T02:15:53.490150] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-17T02:15:53.718965] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:53.719353] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-17T02:15:54.290163] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-17T02:15:54.494910] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:15:54.495242] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-17T02:15:55.090132] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-17T02:15:55.890129] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-17T02:15:56.129377] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T02:15:56.134542] [INFO ] [REMOTE ] BBT: Full fetch complete (3381 records). [2025-09-17T02:15:56.134634] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-17T02:15:56.318943] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 11 unique days, need 200 days [2025-09-17T02:15:56.319167] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:15:56.319246] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:15:56.319298] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-17T02:15:56.319386] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-17T02:15:56.319449] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-17T02:15:56.319514] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-17T02:15:56.319589] [INFO ] [MAIN ] Update Progress: 222/2369 symbols completed. BBT took 19.7s. Estimated remaining: 5h 7m 47s. Rate: 7.0 symbols/min [2025-09-17T02:15:56.489194] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:15:56.503873] [DEBUG] [LOCAL ] BBUC: Loaded 9313 existing records from primary storage. [2025-09-17T02:15:56.504028] [INFO ] [MAIN ] BBUC: Loaded 9313 existing records. [2025-09-17T02:15:56.656787] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T02:15:56.695191] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-17T02:15:56.701935] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:15:56.702106] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-17T02:15:56.702969] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-17T02:15:56.703582] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-17T02:15:56.703662] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-17T02:15:57.058911] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:15:57.490146] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-17T02:15:57.506134] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T02:15:58.290133] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-17T02:15:58.564376] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T02:15:58.914204] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T02:15:59.090154] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-17T02:15:59.890130] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-11. [2025-09-17T02:15:59.960682] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T02:15:59.963447] [INFO ] [REMOTE ] BBN: Full fetch complete (27000 records). [2025-09-17T02:15:59.963551] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-17T02:16:00.356532] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-17T02:16:00.356670] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-17T02:16:00.357101] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-17T02:16:00.357159] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-17T02:16:00.358294] [DEBUG] [LOCAL ] BBN: Trimmed 27000 records to 18010 (keeping 200 days of data) [2025-09-17T02:16:00.472654] [DEBUG] [LOCAL ] BBN: Primary data saved (18010 records). [2025-09-17T02:16:00.472841] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-17T02:16:00.472938] [INFO ] [MAIN ] Update Progress: 223/2369 symbols completed. BBN took 29.8s. Estimated remaining: 5h 6m 56s. Rate: 7.0 symbols/min [2025-09-17T02:16:00.651575] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:00.684297] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T02:16:00.690113] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-17T02:16:00.714323] [DEBUG] [LOCAL ] BBVA: Loaded 36371 existing records from primary storage. [2025-09-17T02:16:00.714755] [INFO ] [MAIN ] BBVA: Loaded 36371 existing records. [2025-09-17T02:16:01.030134] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:01.030675] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-17T02:16:01.030772] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-17T02:16:01.033747] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-17T02:16:01.034044] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-17T02:16:01.206388] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T02:16:01.495767] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-17T02:16:01.697613] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:02.029634] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T02:16:02.290128] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-17T02:16:02.925818] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T02:16:03.090146] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-17T02:16:03.764856] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T02:16:03.890145] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-11. [2025-09-17T02:16:04.690184] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-17T02:16:05.240909] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T02:16:05.368712] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T02:16:05.490167] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-17T02:16:06.288089] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T02:16:06.290290] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-17T02:16:06.906947] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T02:16:07.090135] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-17T02:16:07.425712] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T02:16:07.890208] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-17T02:16:08.364365] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T02:16:08.690177] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-17T02:16:09.428181] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T02:16:09.490136] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-17T02:16:10.120820] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T02:16:10.290175] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-17T02:16:11.090169] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-17T02:16:11.647437] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T02:16:11.890180] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-17T02:16:11.957700] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T02:16:12.461922] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T02:16:12.690187] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-17T02:16:13.490141] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-17T02:16:14.043730] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T02:16:14.045117] [INFO ] [REMOTE ] BBU: Full fetch complete (5984 records). [2025-09-17T02:16:14.045205] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-17T02:16:14.301382] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-17T02:16:14.428979] [DEBUG] [VALIDATOR ] BBU: All expected trading days are present. [2025-09-17T02:16:14.429225] [DEBUG] [VALIDATOR ] BBU: Primary data validation passed. [2025-09-17T02:16:14.429556] [INFO ] [MAIN ] BBU: Fetched primary data is valid. [2025-09-17T02:16:14.429627] [DEBUG] [LOCAL ] BBU: Saving primary data. [2025-09-17T02:16:14.430302] [DEBUG] [LOCAL ] BBU: Trimmed 5984 records to 4015 (keeping 200 days of data) [2025-09-17T02:16:14.459100] [DEBUG] [LOCAL ] BBU: Primary data saved (4015 records). [2025-09-17T02:16:14.459279] [INFO ] [MAIN ] BBU: Full history saved. [2025-09-17T02:16:14.492037] [INFO ] [MAIN ] Update Progress: 224/2369 symbols completed. BBU took 33.6s. Estimated remaining: 5h 7m 39s. Rate: 7.0 symbols/min [2025-09-17T02:16:14.503379] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T02:16:14.686347] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:14.705870] [DEBUG] [LOCAL ] BBW: Loaded 18907 existing records from primary storage. [2025-09-17T02:16:14.706030] [INFO ] [MAIN ] BBW: Loaded 18907 existing records. [2025-09-17T02:16:14.884568] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:14.887937] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T02:16:14.888106] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-17T02:16:14.889571] [INFO ] [REMOTE ] BBDO: Full fetch complete (7924 records). [2025-09-17T02:16:14.889710] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-17T02:16:14.889977] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-17T02:16:14.896611] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-17T02:16:14.960542] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-17T02:16:15.101010] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-17T02:16:15.630716] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-17T02:16:15.634857] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:15.634943] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-17T02:16:15.635542] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-17T02:16:15.635609] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-17T02:16:15.636213] [DEBUG] [LOCAL ] BBDO: Trimmed 7924 records to 5109 (keeping 200 days of data) [2025-09-17T02:16:15.667170] [DEBUG] [LOCAL ] BBDO: Primary data saved (5109 records). [2025-09-17T02:16:15.667315] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-17T02:16:15.667416] [INFO ] [MAIN ] Update Progress: 225/2369 symbols completed. BBDO took 49.2s. Estimated remaining: 5h 6m 20s. Rate: 7.0 symbols/min [2025-09-17T02:16:15.842922] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:15.882850] [DEBUG] [LOCAL ] BBWI: Loaded 39941 existing records from primary storage. [2025-09-17T02:16:15.883068] [INFO ] [MAIN ] BBWI: Loaded 39941 existing records. [2025-09-17T02:16:15.895826] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-17T02:16:16.062241] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:16.062537] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-17T02:16:16.062606] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-17T02:16:16.065749] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-17T02:16:16.065817] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-17T02:16:16.416011] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:16.690172] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-11. [2025-09-17T02:16:16.941082] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T02:16:16.998433] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T02:16:17.490165] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-17T02:16:18.290169] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-11. [2025-09-17T02:16:18.636107] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-17T02:16:18.909955] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T02:16:19.090145] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-17T02:16:19.501112] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T02:16:19.890166] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-17T02:16:20.690159] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-17T02:16:20.898661] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T02:16:21.007293] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T02:16:21.490149] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-17T02:16:22.201432] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T02:16:22.290131] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-17T02:16:23.090145] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-17T02:16:23.201033] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T02:16:23.255300] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T02:16:23.890182] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-17T02:16:24.486655] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T02:16:24.690153] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-17T02:16:25.091170] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T02:16:25.490136] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-17T02:16:26.290150] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-17T02:16:26.460837] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T02:16:26.753429] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T02:16:27.090192] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-17T02:16:27.778568] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T02:16:27.890152] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-17T02:16:28.526024] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:16:28.690137] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-17T02:16:29.490129] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-17T02:16:29.679688] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T02:16:29.797218] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T02:16:30.290137] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-17T02:16:31.090157] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-17T02:16:31.684135] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-17T02:16:31.879290] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T02:16:31.890505] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-17T02:16:32.268283] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:16:32.690133] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-17T02:16:33.363885] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T02:16:33.490127] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-17T02:16:33.562261] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T02:16:33.568146] [INFO ] [REMOTE ] BBVA: Full fetch complete (71469 records). [2025-09-17T02:16:33.568314] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-17T02:16:33.960301] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-17T02:16:33.960417] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-17T02:16:33.961198] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-17T02:16:33.961286] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-17T02:16:33.962827] [DEBUG] [LOCAL ] BBVA: Trimmed 71469 records to 49642 (keeping 200 days of data) [2025-09-17T02:16:34.267808] [DEBUG] [LOCAL ] BBVA: Primary data saved (49642 records). [2025-09-17T02:16:34.268003] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-17T02:16:34.268118] [INFO ] [MAIN ] Update Progress: 226/2369 symbols completed. BBVA took 33.8s. Estimated remaining: 5h 7m 46s. Rate: 7.0 symbols/min [2025-09-17T02:16:34.300065] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-17T02:16:34.457238] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T02:16:34.458709] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:34.499747] [DEBUG] [LOCAL ] BBY: Loaded 39860 existing records from primary storage. [2025-09-17T02:16:34.499938] [INFO ] [MAIN ] BBY: Loaded 39860 existing records. [2025-09-17T02:16:34.679380] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:34.679621] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-17T02:16:34.679701] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-17T02:16:34.681862] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-17T02:16:34.681953] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-17T02:16:35.038825] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:35.090090] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-11. [2025-09-17T02:16:35.890130] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-17T02:16:36.193163] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T02:16:36.690118] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-17T02:16:36.890751] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:16:37.064413] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T02:16:37.490129] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-17T02:16:38.084608] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T02:16:38.290122] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-17T02:16:39.090166] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-17T02:16:39.143981] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T02:16:39.431523] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T02:16:39.890127] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-17T02:16:40.690089] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-17T02:16:40.732852] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T02:16:41.022169] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T02:16:41.482070] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T02:16:41.483953] [INFO ] [REMOTE ] BBUC: Full fetch complete (17075 records). [2025-09-17T02:16:41.484037] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-17T02:16:41.495338] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-17T02:16:41.847121] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-17T02:16:41.847229] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-17T02:16:41.847526] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-17T02:16:41.847578] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-17T02:16:41.848240] [DEBUG] [LOCAL ] BBUC: Trimmed 17075 records to 13185 (keeping 200 days of data) [2025-09-17T02:16:41.934248] [DEBUG] [LOCAL ] BBUC: Primary data saved (13185 records). [2025-09-17T02:16:41.934494] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-17T02:16:41.934680] [INFO ] [MAIN ] Update Progress: 227/2369 symbols completed. BBUC took 45.6s. Estimated remaining: 5h 7m 29s. Rate: 7.0 symbols/min [2025-09-17T02:16:42.104150] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:42.142431] [DEBUG] [LOCAL ] BC: Loaded 32937 existing records from primary storage. [2025-09-17T02:16:42.142634] [INFO ] [MAIN ] BC: Loaded 32937 existing records. [2025-09-17T02:16:42.296881] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-17T02:16:42.328203] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:42.328442] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-17T02:16:42.328532] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-17T02:16:42.330316] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-17T02:16:42.330388] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-17T02:16:42.702403] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:42.715382] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T02:16:43.090148] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-17T02:16:43.901705] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-17T02:16:43.907857] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T02:16:44.690172] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-11. [2025-09-17T02:16:44.909074] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:16:45.172012] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T02:16:45.490127] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-17T02:16:45.698319] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T02:16:46.290163] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-17T02:16:47.090143] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-17T02:16:47.290302] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T02:16:47.399707] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:16:47.890139] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-17T02:16:48.690144] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-17T02:16:48.973632] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T02:16:49.496261] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-17T02:16:49.501028] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T02:16:49.605364] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:16:49.609784] [INFO ] [REMOTE ] BBW: Full fetch complete (38867 records). [2025-09-17T02:16:49.609907] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-17T02:16:49.980871] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-17T02:16:49.980970] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-17T02:16:49.981432] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-17T02:16:49.981486] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-17T02:16:49.982335] [DEBUG] [LOCAL ] BBW: Trimmed 38867 records to 26342 (keeping 200 days of data) [2025-09-17T02:16:50.146200] [DEBUG] [LOCAL ] BBW: Primary data saved (26342 records). [2025-09-17T02:16:50.146393] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-17T02:16:50.146497] [INFO ] [MAIN ] Update Progress: 228/2369 symbols completed. BBW took 35.7s. Estimated remaining: 5h 7m 16s. Rate: 7.0 symbols/min [2025-09-17T02:16:50.298420] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-17T02:16:50.318792] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:50.346029] [DEBUG] [LOCAL ] BCAT: Loaded 25335 existing records from primary storage. [2025-09-17T02:16:50.346204] [INFO ] [MAIN ] BCAT: Loaded 25335 existing records. [2025-09-17T02:16:50.529507] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:16:50.529805] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-17T02:16:50.529866] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-17T02:16:50.530999] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-17T02:16:50.531058] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-17T02:16:50.891223] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:51.090128] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-17T02:16:51.142556] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:16:51.151885] [INFO ] [REMOTE ] BBWI: Full fetch complete (77249 records). [2025-09-17T02:16:51.152102] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-17T02:16:51.548376] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-17T02:16:51.548495] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-17T02:16:51.549364] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-17T02:16:51.549443] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-17T02:16:51.551093] [DEBUG] [LOCAL ] BBWI: Trimmed 77249 records to 53573 (keeping 200 days of data) [2025-09-17T02:16:51.886973] [DEBUG] [LOCAL ] BBWI: Primary data saved (53573 records). [2025-09-17T02:16:51.887162] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-17T02:16:51.887272] [INFO ] [MAIN ] Update Progress: 229/2369 symbols completed. BBWI took 36.2s. Estimated remaining: 5h 6m 4s. Rate: 7.0 symbols/min [2025-09-17T02:16:51.898907] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-11. [2025-09-17T02:16:52.061423] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:16:52.061823] [DEBUG] [LOCAL ] BCC: No existing data file found in primary storage. [2025-09-17T02:16:52.061906] [WARN ] [MAIN ] BCC: No existing data found, performing full refresh instead. [2025-09-17T02:16:52.069763] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-17T02:16:52.082945] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-17T02:16:52.083579] [DEBUG] [LOCAL ] BCC: No primary data file found to delete. [2025-09-17T02:16:52.084390] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T02:16:52.084558] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-17T02:16:52.448028] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:16:52.596731] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T02:16:52.690136] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-17T02:16:53.221204] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T02:16:53.490129] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-17T02:16:54.294484] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-17T02:16:54.301063] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T02:16:54.642166] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T02:16:55.090161] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-17T02:16:55.890141] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-11. [2025-09-17T02:16:56.247315] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T02:16:56.277735] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T02:16:56.690150] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-17T02:16:57.150549] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T02:16:57.490146] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-17T02:16:58.290171] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-17T02:16:58.708515] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T02:16:59.090129] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-17T02:16:59.274065] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T02:16:59.344027] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:16:59.890125] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-17T02:17:00.690132] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-17T02:17:00.968578] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T02:17:01.138697] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T02:17:01.490167] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-17T02:17:01.979830] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:17:02.290138] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-17T02:17:03.090111] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-17T02:17:03.131047] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T02:17:03.890119] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-17T02:17:04.043532] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T02:17:04.200885] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T02:17:04.690157] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-17T02:17:05.297553] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T02:17:05.490140] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-17T02:17:06.290136] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-17T02:17:06.629106] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:17:07.098081] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-17T02:17:07.115979] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T02:17:07.574673] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T02:17:07.890151] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-17T02:17:08.196386] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T02:17:08.690141] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-17T02:17:09.490161] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-17T02:17:09.587413] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T02:17:09.594015] [INFO ] [REMOTE ] BBY: Full fetch complete (77120 records). [2025-09-17T02:17:09.594170] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-17T02:17:09.920028] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:17:09.977324] [INFO ] [REMOTE ] BC: Full fetch complete (63418 records). [2025-09-17T02:17:09.984112] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-17T02:17:10.085706] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-17T02:17:10.102089] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-17T02:17:10.123359] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-17T02:17:10.123531] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-17T02:17:10.214846] [DEBUG] [LOCAL ] BBY: Trimmed 77120 records to 53485 (keeping 200 days of data) [2025-09-17T02:17:10.295596] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-17T02:17:10.508036] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-17T02:17:10.509818] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-17T02:17:10.512372] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-17T02:17:10.513377] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-17T02:17:10.519902] [DEBUG] [LOCAL ] BC: Trimmed 63418 records to 44798 (keeping 200 days of data) [2025-09-17T02:17:10.985809] [DEBUG] [LOCAL ] BBY: Primary data saved (53485 records). [2025-09-17T02:17:11.003493] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-17T02:17:11.004520] [INFO ] [MAIN ] Update Progress: 230/2369 symbols completed. BBY took 36.7s. Estimated remaining: 5h 7m 33s. Rate: 7.0 symbols/min [2025-09-17T02:17:11.005511] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T02:17:11.099903] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-17T02:17:11.173525] [DEBUG] [LOCAL ] BC: Primary data saved (44798 records). [2025-09-17T02:17:11.220217] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:11.217102] [INFO ] [MAIN ] BC: Full history saved. [2025-09-17T02:17:11.220505] [DEBUG] [LOCAL ] BCE: No existing data file found in primary storage. [2025-09-17T02:17:11.220412] [INFO ] [MAIN ] Update Progress: 231/2369 symbols completed. BC took 29.3s. Estimated remaining: 5h 6m 6s. Rate: 7.0 symbols/min [2025-09-17T02:17:11.220611] [WARN ] [MAIN ] BCE: No existing data found, performing full refresh instead. [2025-09-17T02:17:11.252794] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-17T02:17:11.301084] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-17T02:17:11.321892] [DEBUG] [LOCAL ] BCE: No primary data file found to delete. [2025-09-17T02:17:11.322313] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-17T02:17:11.509133] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:11.775067] [DEBUG] [LOCAL ] BCH: Loaded 21687 existing records from primary storage. [2025-09-17T02:17:11.773879] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:11.775387] [INFO ] [MAIN ] BCH: Loaded 21687 existing records. [2025-09-17T02:17:11.863019] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:17:11.891125] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-11. [2025-09-17T02:17:11.997268] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:17:11.997956] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-17T02:17:11.998222] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-17T02:17:11.999296] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-17T02:17:11.999412] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-17T02:17:12.375708] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:12.559310] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T02:17:12.690133] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-17T02:17:13.490281] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-17T02:17:13.820763] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T02:17:14.171766] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T02:17:14.290191] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-11. [2025-09-17T02:17:14.716866] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T02:17:15.090133] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-17T02:17:15.484806] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:17:15.890138] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-17T02:17:16.385812] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T02:17:16.690117] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-17T02:17:17.147050] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T02:17:17.490160] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-17T02:17:17.905138] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T02:17:18.290178] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-17T02:17:18.730022] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T02:17:19.090126] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-17T02:17:19.601715] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T02:17:19.890131] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-17T02:17:20.376706] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T02:17:20.690125] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-17T02:17:20.980584] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T02:17:21.490150] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-17T02:17:21.768827] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T02:17:21.773259] [INFO ] [REMOTE ] BCAT: Full fetch complete (49627 records). [2025-09-17T02:17:21.773383] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-17T02:17:22.161405] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-17T02:17:22.161536] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-17T02:17:22.162172] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-17T02:17:22.162253] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-17T02:17:22.163482] [DEBUG] [LOCAL ] BCAT: Trimmed 49627 records to 34598 (keeping 200 days of data) [2025-09-17T02:17:22.290176] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-17T02:17:22.388069] [DEBUG] [LOCAL ] BCAT: Primary data saved (34598 records). [2025-09-17T02:17:22.388259] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-17T02:17:22.388408] [INFO ] [MAIN ] Update Progress: 232/2369 symbols completed. BCAT took 32.2s. Estimated remaining: 5h 6m 22s. Rate: 7.0 symbols/min [2025-09-17T02:17:22.559456] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:22.578706] [DEBUG] [LOCAL ] BCO: Loaded 19242 existing records from primary storage. [2025-09-17T02:17:22.578878] [INFO ] [MAIN ] BCO: Loaded 19242 existing records. [2025-09-17T02:17:22.770294] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:17:22.770615] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-17T02:17:22.770707] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-17T02:17:22.771952] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-17T02:17:22.772025] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-17T02:17:23.095366] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-17T02:17:23.205157] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:23.312775] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:17:23.736177] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T02:17:23.890132] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-17T02:17:23.964100] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T02:17:24.690136] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-17T02:17:25.490187] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-11. [2025-09-17T02:17:25.581909] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:17:26.051987] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T02:17:26.290093] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-17T02:17:26.683506] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:17:27.090152] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-17T02:17:27.890153] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-17T02:17:28.289902] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T02:17:28.353489] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T02:17:28.690200] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-17T02:17:29.022550] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T02:17:29.026379] [INFO ] [REMOTE ] BCC: Full fetch complete (39675 records). [2025-09-17T02:17:29.026524] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-17T02:17:29.414800] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-17T02:17:29.414949] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-17T02:17:29.416006] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-17T02:17:29.416069] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-17T02:17:29.418629] [DEBUG] [LOCAL ] BCC: Trimmed 39675 records to 28404 (keeping 200 days of data) [2025-09-17T02:17:29.513313] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-17T02:17:29.601747] [DEBUG] [LOCAL ] BCC: Primary data saved (28404 records). [2025-09-17T02:17:29.601894] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-17T02:17:29.601990] [INFO ] [MAIN ] Update Progress: 233/2369 symbols completed. BCC took 37.7s. Estimated remaining: 5h 6m 0s. Rate: 7.0 symbols/min [2025-09-17T02:17:29.770502] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:29.770728] [DEBUG] [LOCAL ] BCS: No existing data file found in primary storage. [2025-09-17T02:17:29.770795] [WARN ] [MAIN ] BCS: No existing data found, performing full refresh instead. [2025-09-17T02:17:29.770901] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-17T02:17:29.770950] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-17T02:17:29.770996] [DEBUG] [LOCAL ] BCS: No primary data file found to delete. [2025-09-17T02:17:29.771047] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-17T02:17:30.139171] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:30.290832] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T02:17:30.290895] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-11. [2025-09-17T02:17:30.933398] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T02:17:31.090153] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-17T02:17:31.890132] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-17T02:17:32.060178] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T02:17:32.690127] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-17T02:17:32.799111] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T02:17:32.894495] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T02:17:33.490137] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-17T02:17:34.125923] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:17:34.290114] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-17T02:17:35.090275] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-17T02:17:35.235908] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:17:35.577017] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T02:17:35.890140] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-17T02:17:36.642443] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T02:17:36.690086] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-17T02:17:37.490133] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-17T02:17:37.641495] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:17:38.290136] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-17T02:17:38.532869] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T02:17:38.639906] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T02:17:39.090146] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-17T02:17:39.889137] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T02:17:39.899677] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-17T02:17:40.433502] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T02:17:40.690153] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-17T02:17:41.099375] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T02:17:41.490154] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-17T02:17:42.290141] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-17T02:17:42.469962] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T02:17:42.538610] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T02:17:43.090220] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-17T02:17:43.894745] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-17T02:17:43.896051] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T02:17:43.903404] [INFO ] [REMOTE ] BCE: Full fetch complete (76073 records). [2025-09-17T02:17:43.903578] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-17T02:17:44.306968] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-17T02:17:44.307117] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-17T02:17:44.308279] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-17T02:17:44.308474] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-17T02:17:44.326574] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T02:17:44.332812] [DEBUG] [LOCAL ] BCE: Trimmed 76073 records to 52381 (keeping 200 days of data) [2025-09-17T02:17:44.668627] [DEBUG] [LOCAL ] BCE: Primary data saved (52381 records). [2025-09-17T02:17:44.668803] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-17T02:17:44.668902] [INFO ] [MAIN ] Update Progress: 234/2369 symbols completed. BCE took 33.7s. Estimated remaining: 5h 6m 51s. Rate: 7.0 symbols/min [2025-09-17T02:17:44.700681] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-17T02:17:44.845073] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:44.865340] [DEBUG] [LOCAL ] BCSF: Loaded 19518 existing records from primary storage. [2025-09-17T02:17:44.865507] [INFO ] [MAIN ] BCSF: Loaded 19518 existing records. [2025-09-17T02:17:45.048073] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:17:45.048396] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-17T02:17:45.048472] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-17T02:17:45.049109] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-17T02:17:45.049179] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-17T02:17:45.406115] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:45.426145] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T02:17:45.490106] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-17T02:17:45.756159] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:17:45.760208] [INFO ] [REMOTE ] BCH: Full fetch complete (40494 records). [2025-09-17T02:17:45.760330] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-17T02:17:46.136441] [DEBUG] [VALIDATOR ] BCH: All expected trading days are present. [2025-09-17T02:17:46.136560] [DEBUG] [VALIDATOR ] BCH: Primary data validation passed. [2025-09-17T02:17:46.137073] [INFO ] [MAIN ] BCH: Fetched primary data is valid. [2025-09-17T02:17:46.137129] [DEBUG] [LOCAL ] BCH: Saving primary data. [2025-09-17T02:17:46.138496] [DEBUG] [LOCAL ] BCH: Trimmed 40494 records to 29507 (keeping 200 days of data) [2025-09-17T02:17:46.292723] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-17T02:17:46.324275] [DEBUG] [LOCAL ] BCH: Primary data saved (29507 records). [2025-09-17T02:17:46.324417] [INFO ] [MAIN ] BCH: Full history saved. [2025-09-17T02:17:46.324553] [INFO ] [MAIN ] Update Progress: 235/2369 symbols completed. BCH took 35.1s. Estimated remaining: 5h 5m 39s. Rate: 7.0 symbols/min [2025-09-17T02:17:46.499915] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:17:46.518462] [DEBUG] [LOCAL ] BCX: Loaded 15406 existing records from primary storage. [2025-09-17T02:17:46.518665] [INFO ] [MAIN ] BCX: Loaded 15406 existing records. [2025-09-17T02:17:46.698496] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:17:46.698853] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-17T02:17:46.699076] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-17T02:17:46.699833] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-17T02:17:46.699907] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-17T02:17:46.860495] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:17:47.079703] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:17:47.090081] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-11. [2025-09-17T02:17:47.890124] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-11. [2025-09-17T02:17:48.204654] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T02:17:48.292234] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T02:17:48.690146] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-17T02:17:49.047596] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T02:17:49.490134] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-17T02:17:50.290145] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-17T02:17:50.675357] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T02:17:50.740406] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T02:17:51.093954] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-17T02:17:51.099086] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T02:17:51.890153] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-17T02:17:52.014097] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T02:17:52.690144] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-17T02:17:53.079320] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T02:17:53.380861] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T02:17:53.490101] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-17T02:17:54.290167] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-17T02:17:54.549305] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:17:55.090124] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-17T02:17:55.388774] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T02:17:55.890154] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-17T02:17:56.690132] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-17T02:17:57.094882] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T02:17:57.157487] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T02:17:57.439961] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T02:17:57.490116] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-17T02:17:58.290131] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-17T02:17:58.778123] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T02:17:59.090155] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-17T02:17:59.266532] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T02:17:59.766610] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T02:17:59.769936] [INFO ] [REMOTE ] BCO: Full fetch complete (36733 records). [2025-09-17T02:17:59.770054] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-17T02:17:59.895209] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-17T02:18:00.162753] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-17T02:18:00.162864] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-17T02:18:00.163381] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-17T02:18:00.163465] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-17T02:18:00.164829] [DEBUG] [LOCAL ] BCO: Trimmed 36733 records to 26552 (keeping 200 days of data) [2025-09-17T02:18:00.342062] [DEBUG] [LOCAL ] BCO: Primary data saved (26552 records). [2025-09-17T02:18:00.342235] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-17T02:18:00.342354] [INFO ] [MAIN ] Update Progress: 236/2369 symbols completed. BCO took 38.0s. Estimated remaining: 5h 6m 19s. Rate: 7.0 symbols/min [2025-09-17T02:18:00.519556] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:00.539837] [DEBUG] [LOCAL ] BDC: Loaded 17786 existing records from primary storage. [2025-09-17T02:18:00.540003] [INFO ] [MAIN ] BDC: Loaded 17786 existing records. [2025-09-17T02:18:00.696949] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-17T02:18:00.727789] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:18:00.728750] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-17T02:18:00.728831] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-17T02:18:00.729591] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-17T02:18:00.729700] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-17T02:18:01.102502] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:01.355322] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T02:18:01.490136] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-17T02:18:02.290196] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-17T02:18:03.090139] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-11. [2025-09-17T02:18:03.357723] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-17T02:18:03.613092] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T02:18:03.865150] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T02:18:03.890082] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-17T02:18:04.348635] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T02:18:04.690131] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-17T02:18:05.162050] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T02:18:05.490132] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-17T02:18:05.595287] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T02:18:06.290200] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-17T02:18:07.090283] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-17T02:18:07.281750] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T02:18:07.310116] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T02:18:07.857979] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T02:18:07.890096] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-17T02:18:08.690097] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-17T02:18:09.095969] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T02:18:09.490180] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-17T02:18:10.290175] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-17T02:18:10.575458] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T02:18:10.742550] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T02:18:11.090175] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-17T02:18:11.607004] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T02:18:11.890183] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-17T02:18:12.690196] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-17T02:18:12.939518] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T02:18:12.946199] [INFO ] [REMOTE ] BCS: Full fetch complete (77080 records). [2025-09-17T02:18:12.946401] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-17T02:18:13.352288] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-17T02:18:13.352461] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-17T02:18:13.353279] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-17T02:18:13.353349] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-17T02:18:13.369984] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T02:18:13.375742] [DEBUG] [LOCAL ] BCS: Trimmed 77080 records to 53480 (keeping 200 days of data) [2025-09-17T02:18:13.490346] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-17T02:18:13.713206] [DEBUG] [LOCAL ] BCS: Primary data saved (53480 records). [2025-09-17T02:18:13.713385] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-17T02:18:13.713470] [INFO ] [MAIN ] Update Progress: 237/2369 symbols completed. BCS took 44.1s. Estimated remaining: 5h 6m 53s. Rate: 6.9 symbols/min [2025-09-17T02:18:13.875835] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T02:18:14.290174] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-17T02:18:15.090182] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-17T02:18:15.778212] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-17T02:18:15.890155] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-17T02:18:16.427597] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T02:18:16.690132] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-17T02:18:16.853729] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T02:18:17.423961] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T02:18:17.490257] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-17T02:18:17.787816] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T02:18:17.792875] [INFO ] [REMOTE ] BCSF: Full fetch complete (37426 records). [2025-09-17T02:18:17.793094] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-17T02:18:18.198214] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-17T02:18:18.198363] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-17T02:18:18.199186] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-17T02:18:18.199264] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-17T02:18:18.200806] [DEBUG] [LOCAL ] BCSF: Trimmed 37426 records to 27938 (keeping 200 days of data) [2025-09-17T02:18:18.295299] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-17T02:18:18.382084] [DEBUG] [LOCAL ] BCSF: Primary data saved (27938 records). [2025-09-17T02:18:18.382255] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-17T02:18:18.382352] [INFO ] [MAIN ] Update Progress: 238/2369 symbols completed. BCSF took 33.7s. Estimated remaining: 5h 6m 9s. Rate: 7.0 symbols/min [2025-09-17T02:18:18.521720] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T02:18:18.919609] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T02:18:18.922238] [INFO ] [REMOTE ] BCX: Full fetch complete (34242 records). [2025-09-17T02:18:18.922337] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-17T02:18:19.097479] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-17T02:18:19.303434] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-17T02:18:19.303541] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-17T02:18:19.304011] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-17T02:18:19.304067] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-17T02:18:19.308101] [DEBUG] [LOCAL ] BCX: Trimmed 34242 records to 22031 (keeping 200 days of data) [2025-09-17T02:18:19.443345] [DEBUG] [LOCAL ] BCX: Primary data saved (22031 records). [2025-09-17T02:18:19.443499] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-17T02:18:19.443594] [INFO ] [MAIN ] Update Progress: 239/2369 symbols completed. BCX took 33.1s. Estimated remaining: 5h 4m 53s. Rate: 7.0 symbols/min [2025-09-17T02:18:20.210512] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T02:18:20.216736] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-17T02:18:21.454768] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T02:18:21.460578] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-17T02:18:22.480547] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T02:18:22.483700] [INFO ] [REMOTE ] BDC: Full fetch complete (35495 records). [2025-09-17T02:18:22.483803] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-17T02:18:22.863471] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-17T02:18:22.863585] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-17T02:18:22.864044] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-17T02:18:22.864100] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-17T02:18:22.865121] [DEBUG] [LOCAL ] BDC: Trimmed 35495 records to 25094 (keeping 200 days of data) [2025-09-17T02:18:23.034516] [DEBUG] [LOCAL ] BDC: Primary data saved (25094 records). [2025-09-17T02:18:23.034719] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-17T02:18:23.034847] [INFO ] [MAIN ] Update Progress: 240/2369 symbols completed. BDC took 22.7s. Estimated remaining: 5h 4m 0s. Rate: 7.0 symbols/min [2025-09-17T02:18:23.560354] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:23.654160] [DEBUG] [LOCAL ] BE: No existing data file found in primary storage. [2025-09-17T02:18:23.750655] [WARN ] [MAIN ] BE: No existing data found, performing full refresh instead. [2025-09-17T02:18:23.752956] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:23.754223] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:23.754760] [DEBUG] [LOCAL ] BDN: No existing data file found in primary storage. [2025-09-17T02:18:23.734098] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:23.755254] [DEBUG] [LOCAL ] BDX: No existing data file found in primary storage. [2025-09-17T02:18:23.755087] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-17T02:18:23.755129] [WARN ] [MAIN ] BDN: No existing data found, performing full refresh instead. [2025-09-17T02:18:23.755349] [WARN ] [MAIN ] BDX: No existing data found, performing full refresh instead. [2025-09-17T02:18:23.755843] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-17T02:18:23.755730] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-17T02:18:23.756188] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-17T02:18:23.756777] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-09-17T02:18:23.756254] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-17T02:18:23.756877] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-17T02:18:23.768189] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-17T02:18:23.768138] [DEBUG] [LOCAL ] BDN: No primary data file found to delete. [2025-09-17T02:18:23.817636] [DEBUG] [LOCAL ] BDX: No primary data file found to delete. [2025-09-17T02:18:23.828720] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-17T02:18:23.834174] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-17T02:18:24.066623] [DEBUG] [LOCAL ] BDJ: Loaded 21383 existing records from primary storage. [2025-09-17T02:18:24.143721] [INFO ] [MAIN ] BDJ: Loaded 21383 existing records. [2025-09-17T02:18:24.972715] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:18:25.076244] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-17T02:18:24.981261] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:25.111879] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-17T02:18:25.111816] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-11. [2025-09-17T02:18:25.084424] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:25.113625] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-17T02:18:25.116668] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:25.116983] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-17T02:18:25.117411] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-11. [2025-09-17T02:18:25.117787] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-11. [2025-09-17T02:18:25.490718] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:25.491087] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-11. [2025-09-17T02:18:26.674540] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T02:18:26.681560] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-17T02:18:26.943453] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T02:18:26.955192] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-17T02:18:27.138797] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T02:18:27.154496] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-17T02:18:27.188258] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T02:18:27.198616] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-17T02:18:28.092731] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T02:18:28.099363] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-17T02:18:28.613413] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T02:18:28.690095] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-17T02:18:28.823535] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T02:18:28.937251] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T02:18:29.435692] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T02:18:29.490082] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-17T02:18:30.290209] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-17T02:18:30.389313] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T02:18:31.090110] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-17T02:18:31.193496] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T02:18:31.539868] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T02:18:31.890151] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-17T02:18:32.617042] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T02:18:32.690112] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-17T02:18:33.098513] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T02:18:33.490173] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-17T02:18:34.290165] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-17T02:18:34.555622] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T02:18:35.090156] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-17T02:18:35.141090] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T02:18:35.890193] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-17T02:18:36.288043] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T02:18:36.690121] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-17T02:18:36.779651] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:18:37.268317] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T02:18:37.490139] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-17T02:18:38.290135] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-17T02:18:38.862616] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T02:18:38.905612] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-17T02:18:39.090127] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-17T02:18:39.890091] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-17T02:18:39.944262] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T02:18:40.371703] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T02:18:40.690165] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-17T02:18:41.490144] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-17T02:18:41.614696] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T02:18:42.185853] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T02:18:42.290136] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-17T02:18:43.090204] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-17T02:18:43.375724] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T02:18:43.890175] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-17T02:18:44.116725] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T02:18:44.699237] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-17T02:18:44.723194] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T02:18:45.383461] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T02:18:45.490088] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-17T02:18:46.290153] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-17T02:18:46.308217] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T02:18:46.421553] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T02:18:47.090134] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-17T02:18:47.886459] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T02:18:47.896793] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-17T02:18:48.420889] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T02:18:48.690211] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-17T02:18:49.431750] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T02:18:49.437482] [INFO ] [REMOTE ] BDN: Full fetch complete (69192 records). [2025-09-17T02:18:49.437610] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-17T02:18:49.497758] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-17T02:18:49.836754] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-17T02:18:49.836880] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-17T02:18:49.837697] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-17T02:18:49.837850] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-17T02:18:49.839296] [DEBUG] [LOCAL ] BDN: Trimmed 69192 records to 47698 (keeping 200 days of data) [2025-09-17T02:18:50.120577] [DEBUG] [LOCAL ] BDN: Primary data saved (47698 records). [2025-09-17T02:18:50.120789] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-17T02:18:50.120882] [INFO ] [MAIN ] Update Progress: 241/2369 symbols completed. BDN took 27.1s. Estimated remaining: 5h 6m 35s. Rate: 6.9 symbols/min [2025-09-17T02:18:50.290992] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-17T02:18:50.292606] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:50.293989] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-17T02:18:50.294050] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-17T02:18:50.294180] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-17T02:18:50.294234] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-17T02:18:50.294281] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-17T02:18:50.294325] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-17T02:18:50.655816] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:50.673975] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T02:18:50.714050] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T02:18:51.090172] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-17T02:18:51.890158] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-17T02:18:51.968051] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T02:18:52.690185] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-17T02:18:52.779665] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T02:18:52.784661] [INFO ] [REMOTE ] BDJ: Full fetch complete (42829 records). [2025-09-17T02:18:52.784814] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-17T02:18:53.173440] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-17T02:18:53.173552] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-17T02:18:53.174171] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-17T02:18:53.174308] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-17T02:18:53.175586] [DEBUG] [LOCAL ] BDJ: Trimmed 42829 records to 29272 (keeping 200 days of data) [2025-09-17T02:18:53.305940] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-17T02:18:53.397405] [DEBUG] [LOCAL ] BDJ: Primary data saved (29272 records). [2025-09-17T02:18:53.397563] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-17T02:18:53.397686] [INFO ] [MAIN ] Update Progress: 242/2369 symbols completed. BDJ took 30.4s. Estimated remaining: 5h 5m 40s. Rate: 7.0 symbols/min [2025-09-17T02:18:53.500277] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-11. [2025-09-17T02:18:53.582820] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:18:53.622860] [DEBUG] [LOCAL ] BEKE: Loaded 39625 existing records from primary storage. [2025-09-17T02:18:53.623045] [INFO ] [MAIN ] BEKE: Loaded 39625 existing records. [2025-09-17T02:18:53.805065] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:18:53.805338] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-17T02:18:53.805413] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-17T02:18:53.806669] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-17T02:18:53.806752] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-17T02:18:53.926419] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T02:18:54.181872] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:18:54.290183] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-11. [2025-09-17T02:18:54.628398] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T02:18:55.090142] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-17T02:18:55.890127] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-17T02:18:56.169760] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T02:18:56.690147] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-17T02:18:56.958830] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:18:57.490129] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-17T02:18:58.259626] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-17T02:18:58.288101] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:18:58.292421] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-17T02:18:58.594042] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-17T02:18:59.095338] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-17T02:18:59.108096] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:18:59.115043] [INFO ] [REMOTE ] BDX: Full fetch complete (75792 records). [2025-09-17T02:18:59.115230] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-17T02:18:59.641043] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-17T02:18:59.641375] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-17T02:18:59.643030] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-17T02:18:59.643587] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-17T02:18:59.655448] [DEBUG] [LOCAL ] BDX: Trimmed 75792 records to 52531 (keeping 200 days of data) [2025-09-17T02:18:59.813692] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T02:18:59.849779] [INFO ] [REMOTE ] BE: Full fetch complete (77544 records). [2025-09-17T02:18:59.860584] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-17T02:18:59.892512] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-17T02:19:00.566390] [DEBUG] [VALIDATOR ] BE: All expected trading days are present. [2025-09-17T02:19:00.567849] [DEBUG] [VALIDATOR ] BE: Primary data validation passed. [2025-09-17T02:19:00.569888] [INFO ] [MAIN ] BE: Fetched primary data is valid. [2025-09-17T02:19:00.570672] [DEBUG] [LOCAL ] BE: Saving primary data. [2025-09-17T02:19:00.576712] [DEBUG] [LOCAL ] BE: Trimmed 77544 records to 53653 (keeping 200 days of data) [2025-09-17T02:19:00.722389] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-17T02:19:00.973145] [DEBUG] [LOCAL ] BDX: Primary data saved (52531 records). [2025-09-17T02:19:00.973904] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-17T02:19:00.974582] [INFO ] [MAIN ] Update Progress: 243/2369 symbols completed. BDX took 37.9s. Estimated remaining: 5h 5m 22s. Rate: 7.0 symbols/min [2025-09-17T02:19:01.163575] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:01.138043] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T02:19:01.180854] [DEBUG] [LOCAL ] BE: Primary data saved (53653 records). [2025-09-17T02:19:01.181040] [INFO ] [MAIN ] BE: Full history saved. [2025-09-17T02:19:01.181216] [INFO ] [MAIN ] Update Progress: 244/2369 symbols completed. BE took 38.1s. Estimated remaining: 5h 3m 60s. Rate: 7.0 symbols/min [2025-09-17T02:19:01.316970] [DEBUG] [LOCAL ] BEN: Loaded 39572 existing records from primary storage. [2025-09-17T02:19:01.346684] [INFO ] [MAIN ] BEN: Loaded 39572 existing records. [2025-09-17T02:19:01.439761] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:01.493069] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-17T02:19:01.563617] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:01.563894] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-17T02:19:01.564105] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-17T02:19:01.565314] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-17T02:19:01.565437] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-17T02:19:01.749334] [DEBUG] [LOCAL ] BEP: Loaded 27781 existing records from primary storage. [2025-09-17T02:19:01.767764] [INFO ] [MAIN ] BEP: Loaded 27781 existing records. [2025-09-17T02:19:01.922198] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T02:19:02.131100] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:02.135251] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:02.135753] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-17T02:19:02.135817] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-17T02:19:02.136721] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-17T02:19:02.136788] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-17T02:19:02.305700] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-11. [2025-09-17T02:19:02.395614] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-17T02:19:02.542496] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:03.090136] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-17T02:19:03.596333] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T02:19:03.890183] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-17T02:19:04.180835] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-17T02:19:04.215416] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T02:19:04.690168] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-11. [2025-09-17T02:19:05.490162] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-17T02:19:06.229759] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T02:19:06.290093] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-17T02:19:07.090144] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-17T02:19:07.701900] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-17T02:19:07.890128] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-17T02:19:08.690169] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-17T02:19:08.806157] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-17T02:19:08.837873] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T02:19:09.064828] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-17T02:19:09.490175] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-17T02:19:09.711209] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T02:19:09.825278] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T02:19:10.290141] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-17T02:19:11.090152] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-17T02:19:11.890142] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-17T02:19:12.124584] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-17T02:19:12.246822] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T02:19:12.690207] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-17T02:19:12.811701] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T02:19:13.490148] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-17T02:19:13.724767] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-17T02:19:14.136420] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T02:19:14.290213] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-17T02:19:15.090182] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-17T02:19:15.554225] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T02:19:15.890163] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-17T02:19:16.404184] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T02:19:16.690149] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-17T02:19:17.490179] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-17T02:19:17.525515] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T02:19:17.795354] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-17T02:19:17.796102] [INFO ] [REMOTE ] BEDU: Full fetch complete (1375 records). [2025-09-17T02:19:17.796186] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-17T02:19:17.973036] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-17T02:19:17.973218] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:19:17.973268] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:19:17.973314] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-17T02:19:17.973390] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-17T02:19:17.973439] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-17T02:19:17.973499] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-17T02:19:17.973571] [INFO ] [MAIN ] Update Progress: 245/2369 symbols completed. BEDU took 27.9s. Estimated remaining: 5h 5m 2s. Rate: 7.0 symbols/min [2025-09-17T02:19:18.141014] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:18.175505] [DEBUG] [LOCAL ] BEPC: Loaded 34009 existing records from primary storage. [2025-09-17T02:19:18.175696] [INFO ] [MAIN ] BEPC: Loaded 34009 existing records. [2025-09-17T02:19:18.295364] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-17T02:19:18.361984] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:18.362273] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-17T02:19:18.362333] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-17T02:19:18.363409] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-17T02:19:18.363472] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-17T02:19:18.727510] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:18.763273] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T02:19:19.090227] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-17T02:19:19.890140] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-17T02:19:20.185707] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T02:19:20.690136] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-11. [2025-09-17T02:19:20.926103] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T02:19:20.965733] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T02:19:21.490141] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-17T02:19:22.235803] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T02:19:22.290142] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-17T02:19:22.660448] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T02:19:23.090143] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-17T02:19:23.849561] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T02:19:23.890127] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-17T02:19:24.690193] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-17T02:19:25.053407] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T02:19:25.490106] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-17T02:19:25.521961] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T02:19:26.162888] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T02:19:26.290216] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-17T02:19:26.924329] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T02:19:27.090163] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-17T02:19:27.783966] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T02:19:27.890159] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-17T02:19:28.690177] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-17T02:19:28.923472] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T02:19:29.490142] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-17T02:19:29.834317] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:19:30.071360] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T02:19:30.290137] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-17T02:19:30.961925] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:19:31.090094] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-17T02:19:31.366516] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T02:19:31.890154] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-17T02:19:32.690155] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-17T02:19:32.931175] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T02:19:33.490180] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-17T02:19:33.565807] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T02:19:33.572332] [INFO ] [REMOTE ] BEKE: Full fetch complete (77050 records). [2025-09-17T02:19:33.572498] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-17T02:19:33.967233] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-17T02:19:33.967424] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-17T02:19:33.968482] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-17T02:19:33.968564] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-17T02:19:33.970220] [DEBUG] [LOCAL ] BEKE: Trimmed 77050 records to 53268 (keeping 200 days of data) [2025-09-17T02:19:34.090063] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:19:34.305405] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-17T02:19:34.328063] [DEBUG] [LOCAL ] BEKE: Primary data saved (53268 records). [2025-09-17T02:19:34.328236] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-17T02:19:34.328345] [INFO ] [MAIN ] Update Progress: 246/2369 symbols completed. BEKE took 40.9s. Estimated remaining: 5h 6m 1s. Rate: 6.9 symbols/min [2025-09-17T02:19:34.498223] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:34.503423] [DEBUG] [LOCAL ] BEPH: Loaded 3492 existing records from primary storage. [2025-09-17T02:19:34.503535] [INFO ] [MAIN ] BEPH: Loaded 3492 existing records. [2025-09-17T02:19:34.683558] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:34.683839] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-17T02:19:34.683895] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-17T02:19:34.684194] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-17T02:19:34.684249] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-17T02:19:35.048245] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:35.090133] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-17T02:19:35.300350] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T02:19:35.856284] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T02:19:35.890144] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-17T02:19:36.690185] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-17T02:19:36.805687] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T02:19:37.140247] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T02:19:37.144918] [INFO ] [REMOTE ] BEP: Full fetch complete (58413 records). [2025-09-17T02:19:37.145091] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-17T02:19:37.495352] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-17T02:19:37.549782] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-17T02:19:37.549908] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-17T02:19:37.550696] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-17T02:19:37.550769] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-17T02:19:37.552274] [DEBUG] [LOCAL ] BEP: Trimmed 58413 records to 38899 (keeping 200 days of data) [2025-09-17T02:19:37.790014] [DEBUG] [LOCAL ] BEP: Primary data saved (38899 records). [2025-09-17T02:19:37.790184] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-17T02:19:37.790290] [INFO ] [MAIN ] Update Progress: 247/2369 symbols completed. BEP took 36.6s. Estimated remaining: 5h 5m 7s. Rate: 7.0 symbols/min [2025-09-17T02:19:37.959737] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:37.963954] [DEBUG] [LOCAL ] BEPI: Loaded 2679 existing records from primary storage. [2025-09-17T02:19:37.964045] [INFO ] [MAIN ] BEPI: Loaded 2679 existing records. [2025-09-17T02:19:38.139201] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:38.139436] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-17T02:19:38.139493] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-17T02:19:38.139744] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-17T02:19:38.139800] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-17T02:19:38.293958] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-11. [2025-09-17T02:19:38.503867] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:38.523755] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T02:19:38.531345] [INFO ] [REMOTE ] BEN: Full fetch complete (76741 records). [2025-09-17T02:19:38.531573] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-17T02:19:38.721623] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T02:19:38.950004] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-17T02:19:38.950135] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-17T02:19:38.950963] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-17T02:19:38.951038] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-17T02:19:38.952865] [DEBUG] [LOCAL ] BEN: Trimmed 76741 records to 53087 (keeping 200 days of data) [2025-09-17T02:19:39.133141] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-17T02:19:39.226230] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:19:39.325032] [DEBUG] [LOCAL ] BEN: Primary data saved (53087 records). [2025-09-17T02:19:39.325229] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-17T02:19:39.327673] [INFO ] [MAIN ] Update Progress: 248/2369 symbols completed. BEN took 38.4s. Estimated remaining: 5h 3m 58s. Rate: 7.0 symbols/min [2025-09-17T02:19:39.503587] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:39.503833] [DEBUG] [LOCAL ] BEPJ: No existing data file found in primary storage. [2025-09-17T02:19:39.503886] [WARN ] [MAIN ] BEPJ: No existing data found, performing full refresh instead. [2025-09-17T02:19:39.503999] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-17T02:19:39.504046] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-17T02:19:39.504090] [DEBUG] [LOCAL ] BEPJ: No primary data file found to delete. [2025-09-17T02:19:39.504126] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-17T02:19:39.869908] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:39.877075] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T02:19:39.890091] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-11. [2025-09-17T02:19:40.414850] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T02:19:40.690186] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-17T02:19:41.202175] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T02:19:41.490140] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-17T02:19:42.050581] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T02:19:42.290144] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-17T02:19:42.601211] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-17T02:19:43.090173] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-11. [2025-09-17T02:19:43.549749] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T02:19:43.890137] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-17T02:19:44.349160] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T02:19:44.690125] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-17T02:19:45.143125] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T02:19:45.490166] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-17T02:19:46.041103] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T02:19:46.290164] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-17T02:19:46.954993] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T02:19:47.090133] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-17T02:19:47.534402] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T02:19:47.890143] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-17T02:19:48.690144] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-17T02:19:49.074576] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T02:19:49.490199] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-17T02:19:49.699818] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T02:19:50.097274] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T02:19:50.290142] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-17T02:19:50.982833] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T02:19:51.090159] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-17T02:19:51.807025] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T02:19:51.890199] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-17T02:19:52.509233] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T02:19:52.690204] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-17T02:19:53.291301] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T02:19:53.490167] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-17T02:19:53.951571] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T02:19:54.290143] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-17T02:19:54.751144] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T02:19:55.090152] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-17T02:19:55.890133] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-17T02:19:56.387119] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T02:19:56.388198] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4553 records). [2025-09-17T02:19:56.388441] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-17T02:19:56.693997] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-17T02:19:56.724260] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T02:19:56.803899] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-17T02:19:56.804003] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-17T02:19:56.804199] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-17T02:19:56.804294] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-17T02:19:56.804745] [DEBUG] [LOCAL ] BEPJ: Trimmed 4553 records to 3356 (keeping 200 days of data) [2025-09-17T02:19:56.827119] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3356 records). [2025-09-17T02:19:56.827205] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-17T02:19:56.827285] [INFO ] [MAIN ] Update Progress: 249/2369 symbols completed. BEPJ took 17.5s. Estimated remaining: 5h 5m 5s. Rate: 6.9 symbols/min [2025-09-17T02:19:56.994683] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:19:57.026252] [DEBUG] [LOCAL ] BFAM: Loaded 24751 existing records from primary storage. [2025-09-17T02:19:57.026423] [INFO ] [MAIN ] BFAM: Loaded 24751 existing records. [2025-09-17T02:19:57.202915] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:19:57.203179] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-17T02:19:57.203240] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-17T02:19:57.203957] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-17T02:19:57.204052] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-17T02:19:57.330186] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T02:19:57.493452] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-17T02:19:57.571545] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:19:57.977746] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T02:19:58.290150] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-17T02:19:59.090185] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-11. [2025-09-17T02:19:59.319024] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T02:19:59.325249] [INFO ] [REMOTE ] BEPC: Full fetch complete (68353 records). [2025-09-17T02:19:59.325469] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-17T02:19:59.728531] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-17T02:19:59.728660] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-17T02:19:59.729371] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-17T02:19:59.729428] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-17T02:19:59.731131] [DEBUG] [LOCAL ] BEPC: Trimmed 68353 records to 46706 (keeping 200 days of data) [2025-09-17T02:19:59.921031] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-17T02:20:00.038272] [DEBUG] [LOCAL ] BEPC: Primary data saved (46706 records). [2025-09-17T02:20:00.038483] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-17T02:20:00.038627] [INFO ] [MAIN ] Update Progress: 250/2369 symbols completed. BEPC took 42.1s. Estimated remaining: 5h 4m 11s. Rate: 7.0 symbols/min [2025-09-17T02:20:00.214266] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:00.214488] [DEBUG] [LOCAL ] BFH: No existing data file found in primary storage. [2025-09-17T02:20:00.214533] [WARN ] [MAIN ] BFH: No existing data found, performing full refresh instead. [2025-09-17T02:20:00.214658] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-17T02:20:00.214706] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-17T02:20:00.214752] [DEBUG] [LOCAL ] BFH: No primary data file found to delete. [2025-09-17T02:20:00.214837] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-17T02:20:00.583143] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:00.588841] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T02:20:00.618191] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T02:20:00.690080] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-17T02:20:01.490146] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-17T02:20:02.172809] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T02:20:02.290140] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-17T02:20:02.297121] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T02:20:03.090135] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-17T02:20:03.212379] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T02:20:03.714188] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T02:20:03.890158] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-17T02:20:04.504984] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T02:20:04.690146] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-17T02:20:05.246287] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T02:20:05.490181] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-17T02:20:06.290196] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-17T02:20:06.687883] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T02:20:06.779664] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T02:20:07.090187] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-17T02:20:07.553776] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T02:20:07.554957] [INFO ] [REMOTE ] BEPI: Full fetch complete (4998 records). [2025-09-17T02:20:07.555074] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-17T02:20:07.900247] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-11. [2025-09-17T02:20:07.932153] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-17T02:20:07.932256] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-17T02:20:07.932422] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-17T02:20:07.932474] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-17T02:20:07.932929] [DEBUG] [LOCAL ] BEPI: Trimmed 4998 records to 3428 (keeping 200 days of data) [2025-09-17T02:20:07.954954] [DEBUG] [LOCAL ] BEPI: Primary data saved (3428 records). [2025-09-17T02:20:07.955114] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-17T02:20:07.955225] [INFO ] [MAIN ] Update Progress: 251/2369 symbols completed. BEPI took 30.2s. Estimated remaining: 5h 3m 56s. Rate: 7.0 symbols/min [2025-09-17T02:20:08.127813] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:08.139529] [DEBUG] [LOCAL ] BFK: Loaded 9721 existing records from primary storage. [2025-09-17T02:20:08.139719] [INFO ] [MAIN ] BFK: Loaded 9721 existing records. [2025-09-17T02:20:08.336244] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:20:08.336535] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-17T02:20:08.336605] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-17T02:20:08.337064] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-17T02:20:08.337130] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-17T02:20:08.703971] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-17T02:20:08.710415] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:09.284810] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T02:20:09.442436] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T02:20:09.490159] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-17T02:20:10.063710] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T02:20:10.290173] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-17T02:20:11.090178] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-17T02:20:11.592466] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T02:20:11.593953] [INFO ] [REMOTE ] BEPH: Full fetch complete (7558 records). [2025-09-17T02:20:11.594042] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-17T02:20:11.894146] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-17T02:20:11.970755] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-17T02:20:11.970905] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-17T02:20:11.971342] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-17T02:20:11.971409] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-17T02:20:11.972212] [DEBUG] [LOCAL ] BEPH: Trimmed 7558 records to 5228 (keeping 200 days of data) [2025-09-17T02:20:12.027371] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T02:20:12.043893] [DEBUG] [LOCAL ] BEPH: Primary data saved (5228 records). [2025-09-17T02:20:12.044018] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-17T02:20:12.044147] [INFO ] [MAIN ] Update Progress: 252/2369 symbols completed. BEPH took 37.7s. Estimated remaining: 5h 3m 10s. Rate: 7.0 symbols/min [2025-09-17T02:20:12.216444] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:12.216742] [DEBUG] [LOCAL ] BFLY: No existing data file found in primary storage. [2025-09-17T02:20:12.216816] [WARN ] [MAIN ] BFLY: No existing data found, performing full refresh instead. [2025-09-17T02:20:12.216951] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-17T02:20:12.217003] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-17T02:20:12.217050] [DEBUG] [LOCAL ] BFLY: No primary data file found to delete. [2025-09-17T02:20:12.217089] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-17T02:20:12.580961] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:12.690081] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-11. [2025-09-17T02:20:13.071707] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T02:20:13.490140] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-11. [2025-09-17T02:20:14.287205] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T02:20:14.290189] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-17T02:20:14.548845] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T02:20:15.090131] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-17T02:20:15.159564] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T02:20:15.890143] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-17T02:20:16.603148] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T02:20:16.630298] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T02:20:16.690166] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-17T02:20:17.439915] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T02:20:17.490155] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-17T02:20:18.290147] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-17T02:20:18.515205] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T02:20:19.090182] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-17T02:20:19.596095] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T02:20:19.890154] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-17T02:20:20.543731] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T02:20:20.690170] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-17T02:20:21.490165] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-17T02:20:21.679506] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T02:20:22.041001] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T02:20:22.290148] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-17T02:20:22.965786] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T02:20:23.090127] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-17T02:20:23.615656] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T02:20:23.890208] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-17T02:20:24.690173] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-17T02:20:24.937353] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T02:20:25.004416] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:20:25.490149] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-17T02:20:25.884959] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T02:20:26.290247] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-17T02:20:26.911563] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T02:20:27.090178] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-17T02:20:27.890145] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-17T02:20:28.003753] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T02:20:28.134971] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T02:20:28.690129] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-17T02:20:29.415515] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T02:20:29.490171] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-17T02:20:30.078713] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T02:20:30.115753] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T02:20:30.290150] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-17T02:20:30.904105] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T02:20:31.090157] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-17T02:20:31.890140] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-17T02:20:32.690125] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-17T02:20:32.921660] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T02:20:33.158613] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T02:20:33.162705] [INFO ] [REMOTE ] BFAM: Full fetch complete (46827 records). [2025-09-17T02:20:33.162886] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-17T02:20:33.497355] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-17T02:20:33.564492] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-17T02:20:33.564672] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-17T02:20:33.565474] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-17T02:20:33.565568] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-17T02:20:33.567221] [DEBUG] [LOCAL ] BFAM: Trimmed 46827 records to 32885 (keeping 200 days of data) [2025-09-17T02:20:33.688586] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:20:33.798485] [DEBUG] [LOCAL ] BFAM: Primary data saved (32885 records). [2025-09-17T02:20:33.798662] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-17T02:20:33.798761] [INFO ] [MAIN ] Update Progress: 253/2369 symbols completed. BFAM took 37.0s. Estimated remaining: 5h 4m 51s. Rate: 6.9 symbols/min [2025-09-17T02:20:34.000504] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:34.008270] [DEBUG] [LOCAL ] BFS: Loaded 6786 existing records from primary storage. [2025-09-17T02:20:34.008374] [INFO ] [MAIN ] BFS: Loaded 6786 existing records. [2025-09-17T02:20:34.185026] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:20:34.185300] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-17T02:20:34.185360] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-17T02:20:34.185713] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-17T02:20:34.185774] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-17T02:20:34.295343] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-17T02:20:34.561088] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:34.936094] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T02:20:35.090133] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-17T02:20:35.890141] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-17T02:20:36.068148] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T02:20:36.238381] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T02:20:36.690119] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-17T02:20:37.125227] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T02:20:37.490152] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-17T02:20:38.144586] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T02:20:38.290171] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-11. [2025-09-17T02:20:38.790701] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T02:20:38.795463] [INFO ] [REMOTE ] BFH: Full fetch complete (59495 records). [2025-09-17T02:20:38.795623] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-17T02:20:39.090537] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-17T02:20:39.155245] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T02:20:39.210976] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-17T02:20:39.211083] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-17T02:20:39.211726] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-17T02:20:39.211783] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-17T02:20:39.213055] [DEBUG] [LOCAL ] BFH: Trimmed 59495 records to 42060 (keeping 200 days of data) [2025-09-17T02:20:39.468960] [DEBUG] [LOCAL ] BFH: Primary data saved (42060 records). [2025-09-17T02:20:39.469124] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-17T02:20:39.469212] [INFO ] [MAIN ] Update Progress: 254/2369 symbols completed. BFH took 39.4s. Estimated remaining: 5h 4m 18s. Rate: 7.0 symbols/min [2025-09-17T02:20:39.660771] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:39.671382] [DEBUG] [LOCAL ] BFZ: Loaded 8443 existing records from primary storage. [2025-09-17T02:20:39.671543] [INFO ] [MAIN ] BFZ: Loaded 8443 existing records. [2025-09-17T02:20:39.848138] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:20:39.848396] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-17T02:20:39.848453] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-17T02:20:39.848864] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-17T02:20:39.848925] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-17T02:20:39.895280] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-17T02:20:40.145922] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:20:40.166865] [INFO ] [REMOTE ] BFK: Full fetch complete (19006 records). [2025-09-17T02:20:40.201842] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-17T02:20:40.298222] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:40.599920] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-17T02:20:40.600037] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-17T02:20:40.600376] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-17T02:20:40.600436] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-17T02:20:40.601105] [DEBUG] [LOCAL ] BFK: Trimmed 19006 records to 13903 (keeping 200 days of data) [2025-09-17T02:20:40.679619] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T02:20:40.690160] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-17T02:20:40.699389] [DEBUG] [LOCAL ] BFK: Primary data saved (13903 records). [2025-09-17T02:20:40.699549] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-17T02:20:40.699662] [INFO ] [MAIN ] Update Progress: 255/2369 symbols completed. BFK took 32.7s. Estimated remaining: 5h 3m 8s. Rate: 7.0 symbols/min [2025-09-17T02:20:40.873413] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:40.914557] [DEBUG] [LOCAL ] BG: Loaded 37699 existing records from primary storage. [2025-09-17T02:20:40.914763] [INFO ] [MAIN ] BG: Loaded 37699 existing records. [2025-09-17T02:20:41.097881] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:20:41.098153] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-17T02:20:41.098216] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-17T02:20:41.099361] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-17T02:20:41.099425] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-17T02:20:41.465880] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:41.490114] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-11. [2025-09-17T02:20:41.633387] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T02:20:42.290177] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-17T02:20:42.830779] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T02:20:43.090140] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-11. [2025-09-17T02:20:43.890156] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-17T02:20:44.076442] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T02:20:44.127549] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T02:20:44.690184] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-17T02:20:45.490135] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-17T02:20:45.619559] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T02:20:45.709716] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T02:20:46.290134] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-17T02:20:46.951821] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T02:20:47.090143] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-17T02:20:47.360797] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T02:20:47.658359] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T02:20:47.890140] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-17T02:20:48.690142] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-17T02:20:49.298058] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T02:20:49.490205] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-17T02:20:50.219727] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T02:20:50.290103] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-17T02:20:50.620247] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:20:51.090107] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-17T02:20:51.274796] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T02:20:51.890142] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-17T02:20:52.251446] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T02:20:52.260871] [INFO ] [REMOTE ] BFLY: Full fetch complete (75062 records). [2025-09-17T02:20:52.261107] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-17T02:20:52.652396] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-17T02:20:52.652511] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-17T02:20:52.653338] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-17T02:20:52.653404] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-17T02:20:52.655035] [DEBUG] [LOCAL ] BFLY: Trimmed 75062 records to 51856 (keeping 200 days of data) [2025-09-17T02:20:52.710969] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-17T02:20:52.960087] [DEBUG] [LOCAL ] BFLY: Primary data saved (51856 records). [2025-09-17T02:20:52.960266] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-17T02:20:52.960361] [INFO ] [MAIN ] Update Progress: 256/2369 symbols completed. BFLY took 40.9s. Estimated remaining: 5h 3m 29s. Rate: 7.0 symbols/min [2025-09-17T02:20:53.128727] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:20:53.142507] [DEBUG] [LOCAL ] BGB: Loaded 12351 existing records from primary storage. [2025-09-17T02:20:53.142663] [INFO ] [MAIN ] BGB: Loaded 12351 existing records. [2025-09-17T02:20:53.328576] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:20:53.328871] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-17T02:20:53.328940] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-17T02:20:53.329362] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-17T02:20:53.329421] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-17T02:20:53.490554] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-17T02:20:53.638686] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T02:20:53.711694] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:20:53.739433] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T02:20:54.196454] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T02:20:54.290115] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-17T02:20:55.090131] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-17T02:20:55.862117] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T02:20:55.890139] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-17T02:20:56.149841] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T02:20:56.459529] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T02:20:56.690127] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-17T02:20:57.427171] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T02:20:57.490093] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-11. [2025-09-17T02:20:58.290169] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-17T02:20:58.550476] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T02:20:59.090146] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-17T02:20:59.098332] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T02:20:59.890144] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-17T02:21:00.690200] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-17T02:21:00.983062] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:21:01.037570] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T02:21:01.490142] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-17T02:21:01.710861] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T02:21:02.290131] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-17T02:21:03.090121] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-17T02:21:03.340433] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T02:21:03.890132] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-17T02:21:04.683275] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-17T02:21:04.690079] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-17T02:21:05.009767] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T02:21:05.472996] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T02:21:05.474886] [INFO ] [REMOTE ] BFS: Full fetch complete (12313 records). [2025-09-17T02:21:05.474993] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-17T02:21:05.495674] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-17T02:21:05.899241] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (2.81 seconds). [2025-09-17T02:21:05.935799] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-17T02:21:05.936604] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-17T02:21:05.937177] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-17T02:21:05.937819] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-17T02:21:05.938703] [DEBUG] [LOCAL ] BFS: Trimmed 12313 records to 8999 (keeping 200 days of data) [2025-09-17T02:21:06.012702] [DEBUG] [LOCAL ] BFS: Primary data saved (8999 records). [2025-09-17T02:21:06.012928] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-17T02:21:06.013064] [INFO ] [MAIN ] Update Progress: 257/2369 symbols completed. BFS took 32.2s. Estimated remaining: 5h 3m 57s. Rate: 6.9 symbols/min [2025-09-17T02:21:06.288233] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:06.290289] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-17T02:21:06.308615] [DEBUG] [LOCAL ] BGH: Loaded 12163 existing records from primary storage. [2025-09-17T02:21:06.311199] [INFO ] [MAIN ] BGH: Loaded 12163 existing records. [2025-09-17T02:21:06.636716] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T02:21:06.634022] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:06.644572] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-17T02:21:06.645173] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-17T02:21:06.645933] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-17T02:21:06.646028] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-17T02:21:07.024523] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T02:21:07.095280] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-17T02:21:07.135055] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:07.890164] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-17T02:21:08.690146] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-11. [2025-09-17T02:21:08.806168] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T02:21:08.899244] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T02:21:09.254545] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T02:21:09.490210] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-17T02:21:10.211894] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T02:21:10.290159] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-17T02:21:10.864705] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T02:21:11.090168] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-17T02:21:11.890197] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-17T02:21:12.569742] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T02:21:12.684912] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T02:21:12.690075] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-17T02:21:13.490161] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-17T02:21:13.535889] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T02:21:14.290159] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-17T02:21:15.090135] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-17T02:21:15.796883] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T02:21:15.890094] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-17T02:21:16.044934] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-17T02:21:16.690180] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-17T02:21:16.697748] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T02:21:16.700202] [INFO ] [REMOTE ] BFZ: Full fetch complete (17889 records). [2025-09-17T02:21:16.700372] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-17T02:21:17.107811] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-17T02:21:17.108444] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-17T02:21:17.108810] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-17T02:21:17.109340] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T02:21:17.109502] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-17T02:21:17.115437] [DEBUG] [LOCAL ] BFZ: Trimmed 17889 records to 11334 (keeping 200 days of data) [2025-09-17T02:21:17.185738] [DEBUG] [LOCAL ] BFZ: Primary data saved (11334 records). [2025-09-17T02:21:17.185904] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-17T02:21:17.185999] [INFO ] [MAIN ] Update Progress: 258/2369 symbols completed. BFZ took 37.7s. Estimated remaining: 5h 4m 9s. Rate: 6.9 symbols/min [2025-09-17T02:21:17.357847] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:17.369137] [DEBUG] [LOCAL ] BGR: Loaded 9713 existing records from primary storage. [2025-09-17T02:21:17.369306] [INFO ] [MAIN ] BGR: Loaded 9713 existing records. [2025-09-17T02:21:17.499274] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-17T02:21:17.564120] [WARN ] [MAIN ] BGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:17.564379] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-17T02:21:17.564445] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-17T02:21:17.565002] [DEBUG] [LOCAL ] BGR: Deleted primary data file. [2025-09-17T02:21:17.565086] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-17T02:21:17.934209] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:17.950276] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T02:21:18.290159] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-11. [2025-09-17T02:21:18.552439] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T02:21:19.022598] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T02:21:19.090097] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-17T02:21:19.890166] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-17T02:21:20.080750] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T02:21:20.690153] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-17T02:21:20.938857] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T02:21:21.367217] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T02:21:21.490154] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-17T02:21:22.290199] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-17T02:21:22.415810] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T02:21:23.090242] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-17T02:21:23.283871] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T02:21:23.883105] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T02:21:23.890069] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-17T02:21:24.690188] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-17T02:21:24.891027] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:21:25.490166] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-17T02:21:25.658378] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T02:21:26.190455] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T02:21:26.290202] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-17T02:21:26.389082] [DEBUG] [REMOTE ] BGR: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-17T02:21:26.389382] [WARN ] [REMOTE ] BGR: No data returned for month 2025-03 [2025-09-17T02:21:27.090164] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-17T02:21:27.890123] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-17T02:21:28.440503] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T02:21:28.446813] [INFO ] [REMOTE ] BG: Full fetch complete (72544 records). [2025-09-17T02:21:28.446971] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-17T02:21:28.695262] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-17T02:21:28.850398] [DEBUG] [VALIDATOR ] BG: All expected trading days are present. [2025-09-17T02:21:28.850499] [DEBUG] [VALIDATOR ] BG: Primary data validation passed. [2025-09-17T02:21:28.851234] [INFO ] [MAIN ] BG: Fetched primary data is valid. [2025-09-17T02:21:28.851292] [DEBUG] [LOCAL ] BG: Saving primary data. [2025-09-17T02:21:28.852890] [DEBUG] [LOCAL ] BG: Trimmed 72544 records to 50385 (keeping 200 days of data) [2025-09-17T02:21:28.932193] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T02:21:29.223036] [DEBUG] [LOCAL ] BG: Primary data saved (50385 records). [2025-09-17T02:21:29.223224] [INFO ] [MAIN ] BG: Full history saved. [2025-09-17T02:21:29.223332] [INFO ] [MAIN ] Update Progress: 259/2369 symbols completed. BG took 48.5s. Estimated remaining: 5h 4m 28s. Rate: 6.9 symbols/min [2025-09-17T02:21:29.411834] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:29.419761] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T02:21:29.422870] [INFO ] [REMOTE ] BGH: Full fetch complete (21638 records). [2025-09-17T02:21:29.422970] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-17T02:21:29.491010] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-17T02:21:29.742850] [DEBUG] [LOCAL ] BGS: Loaded 37704 existing records from primary storage. [2025-09-17T02:21:29.766552] [INFO ] [MAIN ] BGS: Loaded 37704 existing records. [2025-09-17T02:21:29.907616] [DEBUG] [VALIDATOR ] BGH: All expected trading days are present. [2025-09-17T02:21:29.909998] [DEBUG] [VALIDATOR ] BGH: Primary data validation passed. [2025-09-17T02:21:29.915999] [INFO ] [MAIN ] BGH: Fetched primary data is valid. [2025-09-17T02:21:29.926425] [DEBUG] [LOCAL ] BGH: Saving primary data. [2025-09-17T02:21:29.988838] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:29.988977] [DEBUG] [LOCAL ] BGH: Trimmed 21638 records to 16427 (keeping 200 days of data) [2025-09-17T02:21:29.989506] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-17T02:21:29.989573] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-17T02:21:29.990706] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-17T02:21:29.990783] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-17T02:21:30.302095] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-17T02:21:30.383058] [DEBUG] [LOCAL ] BGH: Primary data saved (16427 records). [2025-09-17T02:21:30.403839] [INFO ] [MAIN ] BGH: Full history saved. [2025-09-17T02:21:30.441440] [INFO ] [MAIN ] Update Progress: 260/2369 symbols completed. BGH took 24.4s. Estimated remaining: 5h 3m 19s. Rate: 7.0 symbols/min [2025-09-17T02:21:30.462220] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:30.629834] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:30.636328] [DEBUG] [LOCAL ] BGSF: Loaded 4813 existing records from primary storage. [2025-09-17T02:21:30.636432] [INFO ] [MAIN ] BGSF: Loaded 4813 existing records. [2025-09-17T02:21:30.819260] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:30.853474] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T02:21:30.853096] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-17T02:21:30.857809] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-17T02:21:30.858069] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-17T02:21:30.858125] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-17T02:21:31.100635] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-17T02:21:31.220919] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:31.226374] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:21:31.228476] [INFO ] [REMOTE ] BGB: Full fetch complete (27006 records). [2025-09-17T02:21:31.228565] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-17T02:21:31.594872] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-17T02:21:31.594970] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-17T02:21:31.595320] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-17T02:21:31.595398] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-17T02:21:31.596133] [DEBUG] [LOCAL ] BGB: Trimmed 27006 records to 17666 (keeping 200 days of data) [2025-09-17T02:21:31.703556] [DEBUG] [LOCAL ] BGB: Primary data saved (17666 records). [2025-09-17T02:21:31.703715] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-17T02:21:31.703807] [INFO ] [MAIN ] Update Progress: 261/2369 symbols completed. BGB took 38.7s. Estimated remaining: 5h 2m 11s. Rate: 7.0 symbols/min [2025-09-17T02:21:31.887940] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:31.890096] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-11. [2025-09-17T02:21:31.901730] [DEBUG] [LOCAL ] BGT: Loaded 12384 existing records from primary storage. [2025-09-17T02:21:31.901849] [INFO ] [MAIN ] BGT: Loaded 12384 existing records. [2025-09-17T02:21:32.083397] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:32.083711] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-17T02:21:32.083960] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-17T02:21:32.092961] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T02:21:32.092590] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-17T02:21:32.096294] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-17T02:21:32.466544] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:32.690122] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-11. [2025-09-17T02:21:33.490219] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-11. [2025-09-17T02:21:33.676208] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T02:21:33.695166] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T02:21:34.077703] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T02:21:34.290169] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-17T02:21:35.090165] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-17T02:21:35.301600] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T02:21:35.890159] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-17T02:21:36.065171] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T02:21:36.690155] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-17T02:21:37.490204] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-17T02:21:37.508628] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T02:21:37.691606] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T02:21:38.097401] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T02:21:38.290165] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-17T02:21:38.631264] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T02:21:39.090164] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-17T02:21:39.539358] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T02:21:39.890187] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-17T02:21:40.690158] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-17T02:21:41.047958] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:21:41.301438] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T02:21:41.490145] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-17T02:21:42.290157] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-17T02:21:42.474252] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T02:21:42.780346] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-17T02:21:43.090155] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-17T02:21:43.575298] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T02:21:43.890156] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-17T02:21:44.690135] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-17T02:21:45.490405] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-17T02:21:45.491599] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T02:21:45.624500] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T02:21:46.290130] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-17T02:21:46.341396] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T02:21:47.090134] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-17T02:21:47.890140] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-17T02:21:47.974852] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T02:21:48.055395] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T02:21:48.057545] [INFO ] [REMOTE ] BGR: Full fetch complete (18344 records). [2025-09-17T02:21:48.057726] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-17T02:21:48.242947] [WARN ] [VALIDATOR ] BGR: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T02:21:48.243314] [FATAL] [MAIN ] BGR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:21:48.243377] [WARN ] [MAIN ] BGR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:21:48.243468] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-17T02:21:48.243558] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-09-17T02:21:48.243606] [INFO ] [LOCAL ] BGR: Starting deletion of derivative data. [2025-09-17T02:21:48.244053] [DEBUG] [LOCAL ] BGR: Deleted derivative data file. [2025-09-17T02:21:48.244165] [INFO ] [MAIN ] Update Progress: 262/2369 symbols completed. BGR took 31.1s. Estimated remaining: 5h 3m 6s. Rate: 7.0 symbols/min [2025-09-17T02:21:48.412127] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:21:48.422073] [DEBUG] [LOCAL ] BGX: Loaded 7749 existing records from primary storage. [2025-09-17T02:21:48.422220] [INFO ] [MAIN ] BGX: Loaded 7749 existing records. [2025-09-17T02:21:48.616410] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:21:48.617342] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T02:21:48.617563] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-17T02:21:48.621384] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-17T02:21:48.622098] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-17T02:21:48.622171] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-17T02:21:48.695185] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-17T02:21:48.991075] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:21:49.490189] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-11. [2025-09-17T02:21:49.757392] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T02:21:50.242916] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T02:21:50.290141] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-17T02:21:51.078541] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T02:21:51.090108] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-17T02:21:51.880205] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T02:21:51.890089] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-17T02:21:52.457268] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T02:21:52.690139] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-17T02:21:53.490136] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-17T02:21:54.290196] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-17T02:21:54.408040] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T02:21:54.474945] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:21:55.090246] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-17T02:21:55.155203] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T02:21:55.890148] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-17T02:21:56.689345] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T02:21:56.691802] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-17T02:21:56.827504] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:21:57.490156] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-17T02:21:57.743779] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:21:57.984355] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-17T02:21:58.290179] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-17T02:21:59.091909] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T02:21:59.090903] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-17T02:21:59.890154] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-17T02:22:00.676974] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T02:22:00.690070] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-17T02:22:00.791976] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T02:22:01.490147] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-17T02:22:01.499111] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T02:22:02.290087] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-17T02:22:02.691404] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T02:22:03.090144] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-17T02:22:03.857117] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T02:22:03.890122] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-17T02:22:04.040154] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:22:04.472176] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T02:22:04.475790] [INFO ] [REMOTE ] BGT: Full fetch complete (24486 records). [2025-09-17T02:22:04.475964] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-17T02:22:04.700038] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-17T02:22:04.864107] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-17T02:22:04.864237] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-17T02:22:04.864778] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-17T02:22:04.864866] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-17T02:22:04.865836] [DEBUG] [LOCAL ] BGT: Trimmed 24486 records to 16701 (keeping 200 days of data) [2025-09-17T02:22:04.971326] [DEBUG] [LOCAL ] BGT: Primary data saved (16701 records). [2025-09-17T02:22:04.971498] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-17T02:22:04.971594] [INFO ] [MAIN ] Update Progress: 263/2369 symbols completed. BGT took 33.3s. Estimated remaining: 5h 4m 3s. Rate: 6.9 symbols/min [2025-09-17T02:22:05.139517] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:05.155584] [DEBUG] [LOCAL ] BGY: Loaded 16395 existing records from primary storage. [2025-09-17T02:22:05.155746] [INFO ] [MAIN ] BGY: Loaded 16395 existing records. [2025-09-17T02:22:05.342422] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:05.352916] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-17T02:22:05.353667] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-17T02:22:05.354121] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T02:22:05.357780] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-17T02:22:05.358288] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-17T02:22:05.499837] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-17T02:22:05.722701] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:06.218854] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T02:22:06.290175] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-17T02:22:07.090157] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-17T02:22:07.210879] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:22:07.212939] [INFO ] [REMOTE ] BGSF: Full fetch complete (7233 records). [2025-09-17T02:22:07.213042] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-17T02:22:07.582610] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-17T02:22:07.582737] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-17T02:22:07.582943] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-17T02:22:07.582995] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-17T02:22:07.583444] [DEBUG] [LOCAL ] BGSF: Trimmed 7233 records to 5765 (keeping 200 days of data) [2025-09-17T02:22:07.619307] [DEBUG] [LOCAL ] BGSF: Primary data saved (5765 records). [2025-09-17T02:22:07.619508] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-17T02:22:07.619664] [INFO ] [MAIN ] Update Progress: 264/2369 symbols completed. BGSF took 37.2s. Estimated remaining: 5h 3m 6s. Rate: 6.9 symbols/min [2025-09-17T02:22:07.791246] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:07.809595] [DEBUG] [LOCAL ] BH: Loaded 13261 existing records from primary storage. [2025-09-17T02:22:07.809809] [INFO ] [MAIN ] BH: Loaded 13261 existing records. [2025-09-17T02:22:07.895259] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-17T02:22:07.966722] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T02:22:08.001851] [INFO ] [REMOTE ] BGX: Full fetch complete (15710 records). [2025-09-17T02:22:08.006949] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:08.007084] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-17T02:22:08.007316] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-17T02:22:08.007392] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-17T02:22:08.039329] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-17T02:22:08.083611] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-17T02:22:08.714589] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-11. [2025-09-17T02:22:08.740500] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-17T02:22:08.740619] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-17T02:22:08.744261] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-17T02:22:08.747682] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:08.748188] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-17T02:22:08.748874] [DEBUG] [LOCAL ] BGX: Trimmed 15710 records to 10884 (keeping 200 days of data) [2025-09-17T02:22:08.815764] [DEBUG] [LOCAL ] BGX: Primary data saved (10884 records). [2025-09-17T02:22:08.815903] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-17T02:22:08.815996] [INFO ] [MAIN ] Update Progress: 265/2369 symbols completed. BGX took 20.6s. Estimated remaining: 5h 1m 58s. Rate: 7.0 symbols/min [2025-09-17T02:22:08.981957] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:09.015613] [DEBUG] [LOCAL ] BHC: Loaded 34553 existing records from primary storage. [2025-09-17T02:22:09.015825] [INFO ] [MAIN ] BHC: Loaded 34553 existing records. [2025-09-17T02:22:09.195263] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:09.195540] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-17T02:22:09.195600] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-17T02:22:09.196395] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-17T02:22:09.196456] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-17T02:22:09.494690] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-11. [2025-09-17T02:22:09.554331] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:09.588542] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T02:22:09.830984] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T02:22:09.997134] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T02:22:10.290181] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-11. [2025-09-17T02:22:11.090154] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-17T02:22:11.827604] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T02:22:11.890122] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-17T02:22:12.690182] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-17T02:22:12.858831] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T02:22:12.928900] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T02:22:13.490137] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-17T02:22:13.778056] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:22:14.290176] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-17T02:22:15.006858] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T02:22:15.013450] [INFO ] [REMOTE ] BGS: Full fetch complete (72247 records). [2025-09-17T02:22:15.013612] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-17T02:22:15.095320] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-17T02:22:15.411059] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-17T02:22:15.411321] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-17T02:22:15.412101] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-17T02:22:15.412193] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-17T02:22:15.426418] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T02:22:15.431965] [DEBUG] [LOCAL ] BGS: Trimmed 72247 records to 50432 (keeping 200 days of data) [2025-09-17T02:22:15.721284] [DEBUG] [LOCAL ] BGS: Primary data saved (50432 records). [2025-09-17T02:22:15.721446] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-17T02:22:15.722226] [INFO ] [MAIN ] Update Progress: 266/2369 symbols completed. BGS took 46.5s. Estimated remaining: 5h 1m 36s. Rate: 7.0 symbols/min [2025-09-17T02:22:15.895053] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:15.895184] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-17T02:22:15.917475] [DEBUG] [LOCAL ] BHE: Loaded 17617 existing records from primary storage. [2025-09-17T02:22:15.917635] [INFO ] [MAIN ] BHE: Loaded 17617 existing records. [2025-09-17T02:22:16.092497] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:16.092758] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-17T02:22:16.092840] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-17T02:22:16.093500] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-17T02:22:16.093562] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-17T02:22:16.443010] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:16.690139] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-17T02:22:16.754774] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T02:22:16.797090] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T02:22:17.490231] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-17T02:22:17.504837] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T02:22:18.290140] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-17T02:22:18.418379] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T02:22:19.090133] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-17T02:22:19.770037] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T02:22:19.890137] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-17T02:22:20.319707] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T02:22:20.501410] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T02:22:20.690165] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-11. [2025-09-17T02:22:21.490102] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-17T02:22:21.875229] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:22:22.290134] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-17T02:22:22.703677] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T02:22:23.090199] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-17T02:22:23.105308] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T02:22:23.890165] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-17T02:22:24.695231] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-17T02:22:24.710568] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T02:22:25.158636] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T02:22:25.455250] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T02:22:25.490120] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-17T02:22:26.290132] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-17T02:22:26.490529] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T02:22:27.090104] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-17T02:22:27.482835] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T02:22:27.890138] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-17T02:22:28.690133] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-17T02:22:28.890625] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T02:22:28.913669] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T02:22:29.490143] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-17T02:22:29.526055] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T02:22:30.290136] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-17T02:22:30.548925] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T02:22:31.090101] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-17T02:22:31.419232] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T02:22:31.890167] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-17T02:22:32.449819] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T02:22:32.690129] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-17T02:22:33.127028] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T02:22:33.490160] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-17T02:22:34.160335] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:22:34.290114] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-17T02:22:34.726540] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T02:22:35.090155] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-17T02:22:35.621447] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T02:22:35.880792] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T02:22:35.890083] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-17T02:22:36.690185] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-17T02:22:36.700445] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T02:22:36.703202] [INFO ] [REMOTE ] BH: Full fetch complete (19012 records). [2025-09-17T02:22:36.703292] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-17T02:22:37.068438] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-17T02:22:37.068566] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-17T02:22:37.068936] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-17T02:22:37.069012] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-17T02:22:37.069973] [DEBUG] [LOCAL ] BH: Trimmed 19012 records to 15192 (keeping 200 days of data) [2025-09-17T02:22:37.160208] [DEBUG] [LOCAL ] BH: Primary data saved (15192 records). [2025-09-17T02:22:37.160375] [INFO ] [MAIN ] BH: Full history saved. [2025-09-17T02:22:37.160471] [INFO ] [MAIN ] Update Progress: 267/2369 symbols completed. BH took 29.5s. Estimated remaining: 5h 3m 9s. Rate: 6.9 symbols/min [2025-09-17T02:22:37.333843] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:37.351553] [DEBUG] [LOCAL ] BHK: Loaded 18457 existing records from primary storage. [2025-09-17T02:22:37.351719] [INFO ] [MAIN ] BHK: Loaded 18457 existing records. [2025-09-17T02:22:37.499813] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-17T02:22:37.529435] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:37.529719] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-17T02:22:37.529779] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-17T02:22:37.530405] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-17T02:22:37.530465] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-17T02:22:37.884540] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:38.059268] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T02:22:38.290136] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-17T02:22:39.090160] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-11. [2025-09-17T02:22:39.245515] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:22:39.474431] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:22:39.683516] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T02:22:39.890133] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-17T02:22:40.690169] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-17T02:22:40.962980] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T02:22:41.490188] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-17T02:22:41.798016] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:22:42.290195] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-17T02:22:42.369536] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T02:22:42.372237] [INFO ] [REMOTE ] BGY: Full fetch complete (33960 records). [2025-09-17T02:22:42.372338] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-17T02:22:42.759923] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-17T02:22:42.760032] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-17T02:22:42.760461] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-17T02:22:42.760513] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-17T02:22:42.761305] [DEBUG] [LOCAL ] BGY: Trimmed 33960 records to 23194 (keeping 200 days of data) [2025-09-17T02:22:42.895355] [DEBUG] [LOCAL ] BGY: Primary data saved (23194 records). [2025-09-17T02:22:42.895518] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-17T02:22:42.895629] [INFO ] [MAIN ] Update Progress: 268/2369 symbols completed. BGY took 37.9s. Estimated remaining: 5h 2m 37s. Rate: 6.9 symbols/min [2025-09-17T02:22:43.074369] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:43.097347] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-17T02:22:43.114324] [DEBUG] [LOCAL ] BHP: Loaded 39761 existing records from primary storage. [2025-09-17T02:22:43.114519] [INFO ] [MAIN ] BHP: Loaded 39761 existing records. [2025-09-17T02:22:43.296295] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:43.296608] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-17T02:22:43.296811] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-17T02:22:43.302982] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-17T02:22:43.309832] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-17T02:22:43.342539] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:22:43.684741] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:43.890144] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-17T02:22:44.690159] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-11. [2025-09-17T02:22:44.829223] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T02:22:44.932587] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T02:22:45.490156] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-17T02:22:46.290122] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-17T02:22:46.520168] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T02:22:46.553851] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T02:22:47.090187] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-17T02:22:47.219685] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T02:22:47.890150] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-17T02:22:48.100928] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T02:22:48.690113] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-17T02:22:49.490197] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-17T02:22:49.692972] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T02:22:49.696059] [INFO ] [REMOTE ] BHE: Full fetch complete (36338 records). [2025-09-17T02:22:49.696182] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-17T02:22:50.117976] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-17T02:22:50.120238] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-17T02:22:50.120167] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-17T02:22:50.121066] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-17T02:22:50.131432] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-17T02:22:50.133175] [DEBUG] [LOCAL ] BHE: Trimmed 36338 records to 25454 (keeping 200 days of data) [2025-09-17T02:22:50.290399] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-17T02:22:50.290494] [DEBUG] [LOCAL ] BHE: Primary data saved (25454 records). [2025-09-17T02:22:50.291585] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-17T02:22:50.291704] [INFO ] [MAIN ] Update Progress: 269/2369 symbols completed. BHE took 34.6s. Estimated remaining: 5h 2m 19s. Rate: 6.9 symbols/min [2025-09-17T02:22:50.468638] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:50.484457] [DEBUG] [LOCAL ] BHR: Loaded 15316 existing records from primary storage. [2025-09-17T02:22:50.484616] [INFO ] [MAIN ] BHR: Loaded 15316 existing records. [2025-09-17T02:22:50.667879] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:22:50.668126] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-17T02:22:50.668197] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-17T02:22:50.668749] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-17T02:22:50.668824] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-17T02:22:51.040387] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:51.055942] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:22:51.061976] [INFO ] [REMOTE ] BHC: Full fetch complete (66532 records). [2025-09-17T02:22:51.062106] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-17T02:22:51.095216] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-17T02:22:51.539837] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-17T02:22:51.540011] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-17T02:22:51.541260] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-17T02:22:51.541375] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-17T02:22:51.543946] [DEBUG] [LOCAL ] BHC: Trimmed 66532 records to 46774 (keeping 200 days of data) [2025-09-17T02:22:51.891791] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-11. [2025-09-17T02:22:52.001746] [DEBUG] [LOCAL ] BHC: Primary data saved (46774 records). [2025-09-17T02:22:52.002011] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-17T02:22:52.002189] [INFO ] [MAIN ] Update Progress: 270/2369 symbols completed. BHC took 43.2s. Estimated remaining: 5h 1m 16s. Rate: 7.0 symbols/min [2025-09-17T02:22:52.319880] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:22:52.326176] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-17T02:22:52.337706] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T02:22:52.336623] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-17T02:22:52.344547] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-17T02:22:52.345989] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-17T02:22:52.346191] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-17T02:22:52.346624] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-17T02:22:52.551026] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-17T02:22:52.698759] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-17T02:22:52.840925] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:22:52.855934] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T02:22:53.490141] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-17T02:22:53.728715] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T02:22:54.290119] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-17T02:22:54.575117] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T02:22:55.090132] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-17T02:22:55.863104] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T02:22:55.890083] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-17T02:22:56.299399] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T02:22:56.690119] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-17T02:22:57.490159] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-17T02:22:57.783239] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T02:22:57.995943] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-17T02:22:58.125853] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T02:22:58.290167] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-17T02:22:59.090138] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-11. [2025-09-17T02:22:59.215554] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:22:59.443712] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T02:22:59.890137] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-17T02:23:00.318757] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T02:23:00.690130] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-17T02:23:01.490158] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-17T02:23:01.749213] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T02:23:02.290129] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-17T02:23:03.090130] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-17T02:23:03.890152] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-17T02:23:04.888007] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (3.40 seconds). [2025-09-17T02:23:04.889015] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-17T02:23:05.034611] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T02:23:05.247773] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-17T02:23:05.260859] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-17T02:23:05.490119] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-17T02:23:05.895560] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (3.61 seconds). [2025-09-17T02:23:06.290151] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-17T02:23:06.576420] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T02:23:07.090123] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-17T02:23:07.483265] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T02:23:07.890200] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-17T02:23:08.164964] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T02:23:08.250588] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-17T02:23:08.690138] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-17T02:23:09.089353] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-17T02:23:09.490168] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-17T02:23:10.290104] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-17T02:23:10.700825] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T02:23:11.090178] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-17T02:23:11.890105] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-17T02:23:12.237153] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T02:23:12.287968] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T02:23:12.690235] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-17T02:23:13.014019] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T02:23:13.018031] [INFO ] [REMOTE ] BHK: Full fetch complete (29517 records). [2025-09-17T02:23:13.018160] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-17T02:23:13.402885] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-17T02:23:13.403034] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-17T02:23:13.403471] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-17T02:23:13.403540] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-17T02:23:13.404945] [DEBUG] [LOCAL ] BHK: Trimmed 29517 records to 22400 (keeping 200 days of data) [2025-09-17T02:23:13.501579] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-17T02:23:13.550047] [DEBUG] [LOCAL ] BHK: Primary data saved (22400 records). [2025-09-17T02:23:13.550209] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-17T02:23:13.550328] [INFO ] [MAIN ] Update Progress: 271/2369 symbols completed. BHK took 36.4s. Estimated remaining: 5h 2m 48s. Rate: 6.9 symbols/min [2025-09-17T02:23:13.719467] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:13.761085] [DEBUG] [LOCAL ] BHVN: Loaded 37493 existing records from primary storage. [2025-09-17T02:23:13.761298] [INFO ] [MAIN ] BHVN: Loaded 37493 existing records. [2025-09-17T02:23:13.893513] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-17T02:23:13.947543] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:13.947811] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-17T02:23:13.947881] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-17T02:23:13.948835] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-17T02:23:13.948900] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-17T02:23:14.290942] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-17T02:23:14.312264] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:14.687505] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T02:23:14.804367] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T02:23:15.090153] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-11. [2025-09-17T02:23:15.890172] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-17T02:23:16.297917] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T02:23:16.690115] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-17T02:23:16.949783] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T02:23:17.490164] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-17T02:23:18.243481] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T02:23:18.290090] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-17T02:23:19.070455] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:23:19.090088] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-17T02:23:19.536943] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T02:23:19.724269] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T02:23:19.732216] [INFO ] [REMOTE ] BHP: Full fetch complete (77085 records). [2025-09-17T02:23:19.732433] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-17T02:23:19.894171] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-17T02:23:20.131700] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-17T02:23:20.131825] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-17T02:23:20.132706] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-17T02:23:20.132784] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-17T02:23:20.134377] [DEBUG] [LOCAL ] BHP: Trimmed 77085 records to 53394 (keeping 200 days of data) [2025-09-17T02:23:20.469555] [DEBUG] [LOCAL ] BHP: Primary data saved (53394 records). [2025-09-17T02:23:20.469734] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-17T02:23:20.469830] [INFO ] [MAIN ] Update Progress: 272/2369 symbols completed. BHP took 37.6s. Estimated remaining: 5h 2m 26s. Rate: 6.9 symbols/min [2025-09-17T02:23:20.636147] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:20.672242] [DEBUG] [LOCAL ] BILL: Loaded 39007 existing records from primary storage. [2025-09-17T02:23:20.672413] [INFO ] [MAIN ] BILL: Loaded 39007 existing records. [2025-09-17T02:23:20.695207] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-17T02:23:20.855250] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:20.855594] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-17T02:23:20.855700] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-17T02:23:20.856694] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-17T02:23:20.856761] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-17T02:23:21.162993] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T02:23:21.186539] [INFO ] [REMOTE ] BHV: Full fetch complete (1387 records). [2025-09-17T02:23:21.220377] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:21.220501] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-17T02:23:21.418596] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T02:23:21.418971] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:23:21.419145] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:23:21.419224] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-17T02:23:21.419320] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-17T02:23:21.419378] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-17T02:23:21.419486] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-17T02:23:21.419580] [INFO ] [MAIN ] Update Progress: 273/2369 symbols completed. BHV took 29.4s. Estimated remaining: 5h 1m 18s. Rate: 7.0 symbols/min [2025-09-17T02:23:21.495330] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-11. [2025-09-17T02:23:21.616045] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:21.620551] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T02:23:21.646729] [DEBUG] [LOCAL ] BIO: Loaded 18405 existing records from primary storage. [2025-09-17T02:23:21.646911] [INFO ] [MAIN ] BIO: Loaded 18405 existing records. [2025-09-17T02:23:21.825928] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:21.826249] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-17T02:23:21.826340] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-17T02:23:21.826958] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-17T02:23:21.827034] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-17T02:23:22.181670] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:22.290121] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-11. [2025-09-17T02:23:23.090140] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-17T02:23:23.316703] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T02:23:23.424490] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T02:23:23.890146] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-17T02:23:24.539854] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T02:23:24.690138] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-17T02:23:24.934302] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T02:23:25.490137] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-17T02:23:26.290185] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-17T02:23:26.492544] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T02:23:26.523894] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T02:23:27.090157] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-17T02:23:27.346106] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T02:23:27.890136] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-17T02:23:28.690137] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-17T02:23:28.913453] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:23:29.476383] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T02:23:29.482188] [INFO ] [REMOTE ] BHR: Full fetch complete (30265 records). [2025-09-17T02:23:29.482482] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-17T02:23:29.495470] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-17T02:23:29.811109] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T02:23:29.901073] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-17T02:23:29.901196] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-17T02:23:29.901666] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-17T02:23:29.901740] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-17T02:23:29.902817] [DEBUG] [LOCAL ] BHR: Trimmed 30265 records to 21378 (keeping 200 days of data) [2025-09-17T02:23:30.028377] [DEBUG] [LOCAL ] BHR: Primary data saved (21378 records). [2025-09-17T02:23:30.028552] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-17T02:23:30.028691] [INFO ] [MAIN ] Update Progress: 274/2369 symbols completed. BHR took 39.7s. Estimated remaining: 5h 1m 9s. Rate: 7.0 symbols/min [2025-09-17T02:23:30.198463] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:30.231434] [DEBUG] [LOCAL ] BIP: Loaded 28099 existing records from primary storage. [2025-09-17T02:23:30.231617] [INFO ] [MAIN ] BIP: Loaded 28099 existing records. [2025-09-17T02:23:30.296842] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-17T02:23:30.418668] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:30.418942] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-17T02:23:30.419008] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-17T02:23:30.419796] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-17T02:23:30.419866] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-17T02:23:30.784721] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:30.798399] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T02:23:31.090158] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-17T02:23:31.890189] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-17T02:23:31.937466] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T02:23:32.690191] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-17T02:23:32.764636] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T02:23:33.229935] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T02:23:33.490144] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-17T02:23:34.290182] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-17T02:23:34.348221] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T02:23:35.090112] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-17T02:23:35.240441] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:23:35.577839] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T02:23:35.890145] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-17T02:23:36.690118] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-17T02:23:36.831542] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:23:37.135165] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T02:23:37.490168] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-17T02:23:38.054295] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T02:23:38.290196] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-17T02:23:38.692607] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T02:23:39.090133] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-17T02:23:39.890175] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-17T02:23:40.173771] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T02:23:40.201745] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T02:23:40.690122] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-17T02:23:41.490149] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-17T02:23:41.695396] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T02:23:42.290148] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-11. [2025-09-17T02:23:42.518337] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T02:23:42.625461] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T02:23:43.090133] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-17T02:23:43.431052] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T02:23:43.890175] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-17T02:23:44.276610] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:23:44.286394] [INFO ] [REMOTE ] BHVN: Full fetch complete (68827 records). [2025-09-17T02:23:44.286693] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-17T02:23:44.698497] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-17T02:23:44.887764] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-17T02:23:44.887945] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-17T02:23:44.889314] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-17T02:23:44.889419] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-17T02:23:44.891417] [DEBUG] [LOCAL ] BHVN: Trimmed 68827 records to 49499 (keeping 200 days of data) [2025-09-17T02:23:45.219798] [DEBUG] [LOCAL ] BHVN: Primary data saved (49499 records). [2025-09-17T02:23:45.219984] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-17T02:23:45.220083] [INFO ] [MAIN ] Update Progress: 275/2369 symbols completed. BHVN took 31.7s. Estimated remaining: 5h 1m 50s. Rate: 6.9 symbols/min [2025-09-17T02:23:45.407964] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:45.430167] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T02:23:45.464943] [DEBUG] [LOCAL ] BIPC: Loaded 30211 existing records from primary storage. [2025-09-17T02:23:45.465124] [INFO ] [MAIN ] BIPC: Loaded 30211 existing records. [2025-09-17T02:23:45.497624] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-17T02:23:45.653767] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:45.654030] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-17T02:23:45.654091] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-17T02:23:45.655146] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-17T02:23:45.655219] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-17T02:23:46.033965] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:46.169100] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:23:46.290136] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-17T02:23:47.024501] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:23:47.090098] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-17T02:23:47.890243] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-17T02:23:48.183203] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T02:23:48.221154] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T02:23:48.690176] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-17T02:23:48.738688] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T02:23:48.741816] [INFO ] [REMOTE ] BIO: Full fetch complete (34106 records). [2025-09-17T02:23:48.742004] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-17T02:23:49.118468] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-17T02:23:49.118567] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-17T02:23:49.119041] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-17T02:23:49.119098] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-17T02:23:49.119983] [DEBUG] [LOCAL ] BIO: Trimmed 34106 records to 25844 (keeping 200 days of data) [2025-09-17T02:23:49.277820] [DEBUG] [LOCAL ] BIO: Primary data saved (25844 records). [2025-09-17T02:23:49.277978] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-17T02:23:49.278071] [INFO ] [MAIN ] Update Progress: 276/2369 symbols completed. BIO took 27.9s. Estimated remaining: 5h 1m 7s. Rate: 7.0 symbols/min [2025-09-17T02:23:49.448738] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:23:49.452012] [DEBUG] [LOCAL ] BIPH: Loaded 1585 existing records from primary storage. [2025-09-17T02:23:49.452098] [INFO ] [MAIN ] BIPH: Loaded 1585 existing records. [2025-09-17T02:23:49.495386] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-11. [2025-09-17T02:23:49.637185] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:23:49.637461] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-17T02:23:49.637522] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-17T02:23:49.637728] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-17T02:23:49.637792] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-17T02:23:50.034978] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:23:50.290129] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-17T02:23:50.355054] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T02:23:51.016234] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T02:23:51.090141] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-17T02:23:51.890139] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-17T02:23:52.224287] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:23:52.489470] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T02:23:52.690131] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-11. [2025-09-17T02:23:53.162873] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T02:23:53.470819] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T02:23:53.490078] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-17T02:23:54.290129] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-17T02:23:54.510394] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T02:23:55.090134] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-17T02:23:55.890185] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-17T02:23:56.161700] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T02:23:56.168239] [INFO ] [REMOTE ] BILL: Full fetch complete (75333 records). [2025-09-17T02:23:56.168413] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-17T02:23:56.497072] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T02:23:56.598019] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-17T02:23:56.598146] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-17T02:23:56.599058] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-17T02:23:56.599130] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-17T02:23:56.600744] [DEBUG] [LOCAL ] BILL: Trimmed 75333 records to 52322 (keeping 200 days of data) [2025-09-17T02:23:56.704940] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-17T02:23:56.907138] [DEBUG] [LOCAL ] BILL: Primary data saved (52322 records). [2025-09-17T02:23:56.907309] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-17T02:23:56.907405] [INFO ] [MAIN ] Update Progress: 277/2369 symbols completed. BILL took 36.4s. Estimated remaining: 5h 0m 51s. Rate: 7.0 symbols/min [2025-09-17T02:23:57.312219] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T02:23:57.490135] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-17T02:23:58.290134] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-17T02:23:58.326571] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T02:23:58.635688] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T02:23:58.887920] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T02:23:59.090117] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-17T02:23:59.890175] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-17T02:24:00.541387] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T02:24:00.661037] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T02:24:00.690087] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-17T02:24:01.490135] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-17T02:24:02.180952] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T02:24:02.290140] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-17T02:24:02.426995] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T02:24:02.432541] [INFO ] [REMOTE ] BIP: Full fetch complete (56039 records). [2025-09-17T02:24:02.432730] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-17T02:24:02.830771] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-17T02:24:02.830886] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-17T02:24:02.831509] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-17T02:24:02.831565] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-17T02:24:02.832876] [DEBUG] [LOCAL ] BIP: Trimmed 56039 records to 39768 (keeping 200 days of data) [2025-09-17T02:24:03.077918] [DEBUG] [LOCAL ] BIP: Primary data saved (39768 records). [2025-09-17T02:24:03.078089] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-17T02:24:03.078182] [INFO ] [MAIN ] Update Progress: 278/2369 symbols completed. BIP took 33.0s. Estimated remaining: 5h 0m 24s. Rate: 7.0 symbols/min [2025-09-17T02:24:03.090093] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-17T02:24:03.940097] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T02:24:03.942058] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-17T02:24:04.416494] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T02:24:04.690137] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-17T02:24:05.080678] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-17T02:24:05.118221] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (2.83 seconds). [2025-09-17T02:24:05.490139] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-17T02:24:06.290196] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-17T02:24:06.815773] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T02:24:07.062672] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:24:07.090081] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-17T02:24:07.890138] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-17T02:24:08.351459] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T02:24:08.607793] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T02:24:08.690205] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-17T02:24:09.164779] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T02:24:09.490138] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-17T02:24:09.808352] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T02:24:09.809271] [INFO ] [REMOTE ] BIPH: Full fetch complete (4384 records). [2025-09-17T02:24:09.809354] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-17T02:24:10.169425] [DEBUG] [VALIDATOR ] BIPH: All expected trading days are present. [2025-09-17T02:24:10.169605] [DEBUG] [VALIDATOR ] BIPH: Primary data validation passed. [2025-09-17T02:24:10.170544] [INFO ] [MAIN ] BIPH: Fetched primary data is valid. [2025-09-17T02:24:10.170613] [DEBUG] [LOCAL ] BIPH: Saving primary data. [2025-09-17T02:24:10.171079] [DEBUG] [LOCAL ] BIPH: Trimmed 4384 records to 2628 (keeping 200 days of data) [2025-09-17T02:24:10.187808] [DEBUG] [LOCAL ] BIPH: Primary data saved (2628 records). [2025-09-17T02:24:10.187926] [INFO ] [MAIN ] BIPH: Full history saved. [2025-09-17T02:24:10.188032] [INFO ] [MAIN ] Update Progress: 279/2369 symbols completed. BIPH took 20.9s. Estimated remaining: 5h 0m 4s. Rate: 7.0 symbols/min [2025-09-17T02:24:10.290142] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-17T02:24:11.818437] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T02:24:11.827351] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-17T02:24:13.421904] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T02:24:13.431582] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-17T02:24:16.232135] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (2.80 seconds). [2025-09-17T02:24:16.241531] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-17T02:24:17.136935] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T02:24:17.142455] [INFO ] [REMOTE ] BIPC: Full fetch complete (59342 records). [2025-09-17T02:24:17.142724] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-17T02:24:17.533030] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-17T02:24:17.533141] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-17T02:24:17.533777] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-17T02:24:17.533865] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-17T02:24:17.535108] [DEBUG] [LOCAL ] BIPC: Trimmed 59342 records to 41793 (keeping 200 days of data) [2025-09-17T02:24:17.806506] [DEBUG] [LOCAL ] BIPC: Primary data saved (41793 records). [2025-09-17T02:24:17.806951] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-17T02:24:17.807061] [INFO ] [MAIN ] Update Progress: 280/2369 symbols completed. BIPC took 32.6s. Estimated remaining: 4h 59m 48s. Rate: 7.0 symbols/min [2025-09-17T02:24:18.459320] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:18.467831] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:18.506150] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:18.507700] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:18.513784] [DEBUG] [LOCAL ] BIPJ: Loaded 2171 existing records from primary storage. [2025-09-17T02:24:18.515769] [DEBUG] [LOCAL ] BIPI: Loaded 2076 existing records from primary storage. [2025-09-17T02:24:18.516177] [INFO ] [MAIN ] BIPI: Loaded 2076 existing records. [2025-09-17T02:24:18.516065] [INFO ] [MAIN ] BIPJ: Loaded 2171 existing records. [2025-09-17T02:24:18.907229] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:18.876111] [DEBUG] [LOCAL ] BIT: Loaded 16575 existing records from primary storage. [2025-09-17T02:24:18.938781] [INFO ] [MAIN ] BIT: Loaded 16575 existing records. [2025-09-17T02:24:18.937698] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:18.979597] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-17T02:24:18.986487] [DEBUG] [LOCAL ] BIRK: Loaded 37975 existing records from primary storage. [2025-09-17T02:24:19.004154] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-17T02:24:19.019980] [INFO ] [MAIN ] BIRK: Loaded 37975 existing records. [2025-09-17T02:24:19.009625] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-17T02:24:19.046572] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-17T02:24:19.078996] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-17T02:24:19.079369] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-17T02:24:19.151198] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-17T02:24:19.239518] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-17T02:24:19.414711] [WARN ] [MAIN ] BIT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:19.499267] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:19.469846] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-17T02:24:19.540619] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-17T02:24:19.596477] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-17T02:24:19.602135] [DEBUG] [LOCAL ] BIT: Deleted primary data file. [2025-09-17T02:24:19.640483] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-17T02:24:19.680734] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-17T02:24:19.706101] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-17T02:24:19.767093] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-17T02:24:20.205369] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:20.250049] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-11. [2025-09-17T02:24:20.539024] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:20.586630] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-11. [2025-09-17T02:24:20.797946] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:20.816918] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:20.817211] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-11. [2025-09-17T02:24:20.817633] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-11. [2025-09-17T02:24:21.151775] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T02:24:21.153101] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-17T02:24:21.189169] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T02:24:21.190685] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-17T02:24:21.736957] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T02:24:21.739252] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-17T02:24:21.760237] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T02:24:21.761867] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-17T02:24:21.925311] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T02:24:21.929744] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-17T02:24:22.241945] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T02:24:22.243239] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-17T02:24:22.342285] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T02:24:22.351808] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-17T02:24:22.356837] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T02:24:22.358458] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-17T02:24:22.567346] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-17T02:24:22.751243] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-17T02:24:22.765778] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T02:24:23.090167] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-17T02:24:23.890179] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-17T02:24:24.092198] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T02:24:24.158471] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T02:24:24.255595] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T02:24:24.690238] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-17T02:24:25.490218] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-17T02:24:26.198368] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T02:24:26.298723] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-17T02:24:26.316812] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T02:24:26.998949] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T02:24:27.090119] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-17T02:24:27.605005] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T02:24:27.890149] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-17T02:24:27.996031] [DEBUG] [REMOTE ] BIT: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T02:24:27.996383] [WARN ] [REMOTE ] BIT: No data returned for month 2025-02 [2025-09-17T02:24:28.690178] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-17T02:24:29.490149] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-17T02:24:29.728844] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T02:24:30.009489] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-17T02:24:30.290148] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-17T02:24:30.841074] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T02:24:31.090164] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-17T02:24:31.890133] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-17T02:24:32.648168] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T02:24:32.674127] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T02:24:32.690091] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-17T02:24:33.249584] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T02:24:33.250722] [INFO ] [REMOTE ] BIPI: Full fetch complete (5345 records). [2025-09-17T02:24:33.250804] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-17T02:24:33.495355] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-17T02:24:33.607294] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-17T02:24:33.607413] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-17T02:24:33.607625] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-17T02:24:33.607707] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-17T02:24:33.608113] [DEBUG] [LOCAL ] BIPI: Trimmed 5345 records to 3447 (keeping 200 days of data) [2025-09-17T02:24:33.630447] [DEBUG] [LOCAL ] BIPI: Primary data saved (3447 records). [2025-09-17T02:24:33.630569] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-17T02:24:33.630688] [INFO ] [MAIN ] Update Progress: 281/2369 symbols completed. BIPI took 15.8s. Estimated remaining: 5h 0m 33s. Rate: 6.9 symbols/min [2025-09-17T02:24:33.805809] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:33.844139] [DEBUG] [LOCAL ] BJ: Loaded 38269 existing records from primary storage. [2025-09-17T02:24:33.844346] [INFO ] [MAIN ] BJ: Loaded 38269 existing records. [2025-09-17T02:24:34.024848] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:34.025112] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-17T02:24:34.025173] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-17T02:24:34.026240] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-17T02:24:34.026319] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-17T02:24:34.146942] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-17T02:24:34.295258] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-17T02:24:34.394407] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:35.090094] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-17T02:24:35.461807] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:24:35.890138] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-17T02:24:36.667893] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T02:24:36.690074] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-17T02:24:36.900820] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T02:24:37.490158] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-11. [2025-09-17T02:24:37.739747] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:24:38.290200] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-17T02:24:39.090203] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-17T02:24:39.139579] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T02:24:39.407096] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T02:24:39.542764] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T02:24:39.890190] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-17T02:24:40.690128] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-17T02:24:41.178093] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T02:24:41.490172] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-17T02:24:42.001298] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T02:24:42.290179] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-17T02:24:42.864714] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T02:24:43.090150] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-17T02:24:43.162134] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T02:24:43.890152] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-17T02:24:44.690169] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-17T02:24:44.836505] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:24:45.249110] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T02:24:45.253574] [INFO ] [REMOTE ] BIT: Full fetch complete (27792 records). [2025-09-17T02:24:45.253713] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-17T02:24:45.360062] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T02:24:45.445155] [WARN ] [VALIDATOR ] BIT: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T02:24:45.445533] [FATAL] [MAIN ] BIT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:24:45.445587] [WARN ] [MAIN ] BIT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:24:45.445632] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-17T02:24:45.445731] [DEBUG] [LOCAL ] BIT: No primary data file found to delete. [2025-09-17T02:24:45.445776] [INFO ] [LOCAL ] BIT: Starting deletion of derivative data. [2025-09-17T02:24:45.446180] [DEBUG] [LOCAL ] BIT: Deleted derivative data file. [2025-09-17T02:24:45.446279] [INFO ] [MAIN ] Update Progress: 282/2369 symbols completed. BIT took 27.6s. Estimated remaining: 5h 0m 48s. Rate: 6.9 symbols/min [2025-09-17T02:24:45.499625] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-17T02:24:45.618660] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:45.618898] [DEBUG] [LOCAL ] BK: No existing data file found in primary storage. [2025-09-17T02:24:45.618950] [WARN ] [MAIN ] BK: No existing data found, performing full refresh instead. [2025-09-17T02:24:45.619055] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-17T02:24:45.619136] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-17T02:24:45.619193] [DEBUG] [LOCAL ] BK: No primary data file found to delete. [2025-09-17T02:24:45.619234] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-17T02:24:45.977279] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:46.290159] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-17T02:24:46.738429] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T02:24:47.090143] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-17T02:24:47.545100] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T02:24:47.890110] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-11. [2025-09-17T02:24:47.952540] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T02:24:48.690128] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-17T02:24:49.490113] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-17T02:24:49.604163] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T02:24:50.266095] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T02:24:50.290075] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-17T02:24:50.930542] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T02:24:51.090138] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-17T02:24:51.895254] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-17T02:24:51.916203] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T02:24:52.690095] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-17T02:24:52.970337] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T02:24:53.065985] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T02:24:53.067018] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4258 records). [2025-09-17T02:24:53.067101] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-17T02:24:53.418349] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-17T02:24:53.418446] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-17T02:24:53.418560] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-17T02:24:53.418615] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-17T02:24:53.418996] [DEBUG] [LOCAL ] BIPJ: Trimmed 4258 records to 2907 (keeping 200 days of data) [2025-09-17T02:24:53.437402] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2907 records). [2025-09-17T02:24:53.437480] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-17T02:24:53.437561] [INFO ] [MAIN ] Update Progress: 283/2369 symbols completed. BIPJ took 35.6s. Estimated remaining: 5h 0m 34s. Rate: 6.9 symbols/min [2025-09-17T02:24:53.495213] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-17T02:24:53.629237] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:53.670834] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T02:24:53.709106] [DEBUG] [LOCAL ] BKD: Loaded 37399 existing records from primary storage. [2025-09-17T02:24:53.709304] [INFO ] [MAIN ] BKD: Loaded 37399 existing records. [2025-09-17T02:24:53.884414] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:24:53.884706] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-17T02:24:53.884763] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-17T02:24:53.885617] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-17T02:24:53.885707] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-17T02:24:54.257298] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:24:54.290146] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-17T02:24:55.090202] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-11. [2025-09-17T02:24:55.227627] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T02:24:55.709910] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:24:55.890134] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-17T02:24:56.695382] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-17T02:24:56.715383] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:24:57.490176] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-17T02:24:57.727933] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T02:24:58.290174] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-17T02:24:58.561127] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T02:24:59.062600] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:24:59.068822] [INFO ] [REMOTE ] BIRK: Full fetch complete (72438 records). [2025-09-17T02:24:59.068961] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-17T02:24:59.100606] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-17T02:24:59.474335] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-17T02:24:59.474436] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-17T02:24:59.475306] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-17T02:24:59.475373] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-17T02:24:59.476812] [DEBUG] [LOCAL ] BIRK: Trimmed 72438 records to 50829 (keeping 200 days of data) [2025-09-17T02:24:59.771714] [DEBUG] [LOCAL ] BIRK: Primary data saved (50829 records). [2025-09-17T02:24:59.771951] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-17T02:24:59.772155] [INFO ] [MAIN ] Update Progress: 284/2369 symbols completed. BIRK took 42.0s. Estimated remaining: 5h 0m 9s. Rate: 6.9 symbols/min [2025-09-17T02:24:59.891080] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-17T02:24:59.945923] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:24:59.982732] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T02:25:00.014475] [DEBUG] [LOCAL ] BKE: Loaded 25000 existing records from primary storage. [2025-09-17T02:25:00.014680] [INFO ] [MAIN ] BKE: Loaded 25000 existing records. [2025-09-17T02:25:00.191361] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:00.191600] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-17T02:25:00.191677] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-17T02:25:00.192427] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-17T02:25:00.192487] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-17T02:25:00.549982] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:00.587965] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T02:25:00.690101] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-11. [2025-09-17T02:25:01.490164] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-17T02:25:01.577535] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T02:25:02.175266] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T02:25:02.290161] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-17T02:25:03.090147] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-17T02:25:03.466166] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T02:25:03.646511] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T02:25:03.890130] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-17T02:25:04.283274] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T02:25:04.690156] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-17T02:25:05.381197] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T02:25:05.490115] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-17T02:25:06.290095] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-17T02:25:06.291788] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T02:25:06.892052] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T02:25:07.090139] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-17T02:25:07.800280] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T02:25:07.890134] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-17T02:25:08.690180] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-17T02:25:08.718076] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T02:25:09.490184] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-17T02:25:09.798845] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T02:25:10.232274] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T02:25:10.290171] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-17T02:25:10.548633] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T02:25:11.090230] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-17T02:25:11.890149] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-17T02:25:12.339044] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T02:25:12.690179] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-17T02:25:12.745503] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T02:25:13.324619] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T02:25:13.490157] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-17T02:25:14.290151] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-17T02:25:14.443164] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T02:25:14.748600] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T02:25:15.090101] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-17T02:25:15.130041] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T02:25:15.890179] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-17T02:25:16.690146] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-17T02:25:16.813247] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T02:25:16.819754] [INFO ] [REMOTE ] BJ: Full fetch complete (73547 records). [2025-09-17T02:25:16.819927] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-17T02:25:17.233217] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-17T02:25:17.233428] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-17T02:25:17.234242] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-17T02:25:17.234413] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-17T02:25:17.253206] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T02:25:17.259352] [DEBUG] [LOCAL ] BJ: Trimmed 73547 records to 51453 (keeping 200 days of data) [2025-09-17T02:25:17.260448] [INFO ] [REMOTE ] BK: Full fetch complete (77330 records). [2025-09-17T02:25:17.260887] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-17T02:25:17.502491] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-17T02:25:17.778863] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-17T02:25:17.779700] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-17T02:25:17.780870] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-17T02:25:17.781792] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-17T02:25:17.788774] [DEBUG] [LOCAL ] BK: Trimmed 77330 records to 53569 (keeping 200 days of data) [2025-09-17T02:25:18.006909] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T02:25:18.251709] [DEBUG] [LOCAL ] BJ: Primary data saved (51453 records). [2025-09-17T02:25:18.253972] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-17T02:25:18.255051] [INFO ] [MAIN ] Update Progress: 285/2369 symbols completed. BJ took 44.6s. Estimated remaining: 5h 1m 12s. Rate: 6.9 symbols/min [2025-09-17T02:25:18.295936] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-17T02:25:18.442772] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:18.537100] [DEBUG] [LOCAL ] BKH: Loaded 27582 existing records from primary storage. [2025-09-17T02:25:18.538580] [INFO ] [MAIN ] BKH: Loaded 27582 existing records. [2025-09-17T02:25:18.734687] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:18.737784] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-17T02:25:18.739979] [DEBUG] [LOCAL ] BK: Primary data saved (53569 records). [2025-09-17T02:25:18.740080] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-17T02:25:18.740254] [INFO ] [MAIN ] BK: Full history saved. [2025-09-17T02:25:18.740406] [INFO ] [MAIN ] Update Progress: 286/2369 symbols completed. BK took 33.3s. Estimated remaining: 5h 0m 4s. Rate: 6.9 symbols/min [2025-09-17T02:25:18.784336] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-17T02:25:18.816440] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-17T02:25:19.070045] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:19.296184] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:19.308748] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-11. [2025-09-17T02:25:19.310397] [DEBUG] [LOCAL ] BKKT: Loaded 26158 existing records from primary storage. [2025-09-17T02:25:19.310853] [INFO ] [MAIN ] BKKT: Loaded 26158 existing records. [2025-09-17T02:25:19.493988] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:19.494389] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-17T02:25:19.494513] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-17T02:25:19.504461] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-17T02:25:19.521566] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-17T02:25:19.556770] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T02:25:19.908536] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-17T02:25:19.908456] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:19.931587] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T02:25:20.466942] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T02:25:20.690166] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-11. [2025-09-17T02:25:21.490143] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-17T02:25:21.640284] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T02:25:22.126452] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T02:25:22.290133] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-17T02:25:22.816851] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T02:25:22.821364] [INFO ] [REMOTE ] BKE: Full fetch complete (50292 records). [2025-09-17T02:25:22.821483] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-17T02:25:23.095305] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-17T02:25:23.209800] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-17T02:25:23.209904] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-17T02:25:23.210515] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-17T02:25:23.210571] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-17T02:25:23.213098] [DEBUG] [LOCAL ] BKE: Trimmed 50292 records to 35017 (keeping 200 days of data) [2025-09-17T02:25:23.423835] [DEBUG] [LOCAL ] BKE: Primary data saved (35017 records). [2025-09-17T02:25:23.424029] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-17T02:25:23.424128] [INFO ] [MAIN ] Update Progress: 287/2369 symbols completed. BKE took 23.7s. Estimated remaining: 4h 59m 26s. Rate: 7.0 symbols/min [2025-09-17T02:25:23.595469] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:23.595697] [DEBUG] [LOCAL ] BKN: No existing data file found in primary storage. [2025-09-17T02:25:23.595928] [WARN ] [MAIN ] BKN: No existing data found, performing full refresh instead. [2025-09-17T02:25:23.596121] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-17T02:25:23.596266] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-17T02:25:23.596472] [DEBUG] [LOCAL ] BKN: No primary data file found to delete. [2025-09-17T02:25:23.596535] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-17T02:25:23.785388] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T02:25:23.899460] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-17T02:25:23.991833] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:24.690113] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-11. [2025-09-17T02:25:25.101190] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T02:25:25.376714] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T02:25:25.441167] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T02:25:25.490120] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-17T02:25:26.290220] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-17T02:25:27.090100] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-17T02:25:27.157845] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T02:25:27.599982] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T02:25:27.857156] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:25:27.890175] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-17T02:25:28.690143] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-17T02:25:28.818760] [DEBUG] [REMOTE ] BKN: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T02:25:28.819183] [WARN ] [REMOTE ] BKN: No data returned for month 2025-01 [2025-09-17T02:25:28.928895] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T02:25:29.490333] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-17T02:25:30.283999] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T02:25:30.290094] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-17T02:25:31.090179] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-17T02:25:31.890111] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-17T02:25:31.949307] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T02:25:32.471528] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T02:25:32.496098] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:25:32.690130] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-17T02:25:33.490145] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-17T02:25:33.870121] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T02:25:34.290139] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-17T02:25:35.090140] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-17T02:25:35.141725] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T02:25:35.217976] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T02:25:35.890116] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-17T02:25:36.137181] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T02:25:36.648120] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T02:25:36.690100] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-17T02:25:37.490129] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-17T02:25:38.129842] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T02:25:38.240166] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T02:25:38.290144] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-17T02:25:39.017516] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T02:25:39.090097] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-17T02:25:39.890120] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-17T02:25:40.515585] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:25:40.690110] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-17T02:25:41.302273] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:25:41.490156] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-17T02:25:42.242399] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T02:25:42.290103] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-17T02:25:42.505881] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T02:25:43.090153] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-17T02:25:43.785380] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T02:25:43.890117] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-17T02:25:44.658631] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:25:44.665033] [INFO ] [REMOTE ] BKD: Full fetch complete (71093 records). [2025-09-17T02:25:44.665213] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-17T02:25:44.698576] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-17T02:25:45.070191] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-17T02:25:45.070309] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-17T02:25:45.071056] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-17T02:25:45.071141] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-17T02:25:45.072601] [DEBUG] [LOCAL ] BKD: Trimmed 71093 records to 50081 (keeping 200 days of data) [2025-09-17T02:25:45.375550] [DEBUG] [LOCAL ] BKD: Primary data saved (50081 records). [2025-09-17T02:25:45.375764] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-17T02:25:45.375881] [INFO ] [MAIN ] Update Progress: 288/2369 symbols completed. BKD took 51.9s. Estimated remaining: 5h 0m 54s. Rate: 6.9 symbols/min [2025-09-17T02:25:45.495205] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-17T02:25:45.549006] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:45.592916] [DEBUG] [LOCAL ] BKSY: Loaded 36256 existing records from primary storage. [2025-09-17T02:25:45.593080] [INFO ] [MAIN ] BKSY: Loaded 36256 existing records. [2025-09-17T02:25:45.771856] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:45.772104] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-17T02:25:45.772181] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-17T02:25:45.773126] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-17T02:25:45.773198] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-17T02:25:46.065078] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T02:25:46.092699] [INFO ] [REMOTE ] BKN: Full fetch complete (10385 records). [2025-09-17T02:25:46.114526] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-17T02:25:46.150432] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:46.297982] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-11. [2025-09-17T02:25:46.335099] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-17T02:25:46.369238] [WARN ] [VALIDATOR ] BKN: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T02:25:46.378275] [FATAL] [MAIN ] BKN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:25:46.378795] [WARN ] [MAIN ] BKN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:25:46.378966] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-17T02:25:46.379241] [DEBUG] [LOCAL ] BKN: No primary data file found to delete. [2025-09-17T02:25:46.379328] [INFO ] [LOCAL ] BKN: Starting deletion of derivative data. [2025-09-17T02:25:46.379433] [DEBUG] [LOCAL ] BKN: No derivative data file found to delete. [2025-09-17T02:25:46.379549] [INFO ] [MAIN ] Update Progress: 289/2369 symbols completed. BKN took 23.0s. Estimated remaining: 4h 59m 50s. Rate: 6.9 symbols/min [2025-09-17T02:25:46.474414] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T02:25:46.598115] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:46.609445] [DEBUG] [LOCAL ] BKT: Loaded 8064 existing records from primary storage. [2025-09-17T02:25:46.609613] [INFO ] [MAIN ] BKT: Loaded 8064 existing records. [2025-09-17T02:25:46.796249] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:46.796506] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-17T02:25:46.796567] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-17T02:25:46.797021] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-17T02:25:46.797105] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-17T02:25:47.095280] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-17T02:25:47.168482] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:47.890138] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-17T02:25:48.114950] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T02:25:48.690133] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-11. [2025-09-17T02:25:48.754670] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T02:25:49.430064] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T02:25:49.490086] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-17T02:25:49.736521] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T02:25:50.168447] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T02:25:50.290116] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-17T02:25:51.033973] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T02:25:51.090101] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-17T02:25:51.885851] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T02:25:51.890396] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-17T02:25:52.649938] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T02:25:52.690195] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-17T02:25:53.490234] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-17T02:25:54.259605] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:25:54.266163] [INFO ] [REMOTE ] BKKT: Full fetch complete (49363 records). [2025-09-17T02:25:54.266341] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-17T02:25:54.299338] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-17T02:25:54.428294] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T02:25:54.688332] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-17T02:25:54.688439] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-17T02:25:54.689018] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-17T02:25:54.689077] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-17T02:25:54.690153] [DEBUG] [LOCAL ] BKKT: Trimmed 49363 records to 33804 (keeping 200 days of data) [2025-09-17T02:25:54.899977] [DEBUG] [LOCAL ] BKKT: Primary data saved (33804 records). [2025-09-17T02:25:54.900165] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-17T02:25:54.900313] [INFO ] [MAIN ] Update Progress: 290/2369 symbols completed. BKKT took 36.2s. Estimated remaining: 4h 59m 40s. Rate: 6.9 symbols/min [2025-09-17T02:25:55.078600] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:55.090124] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-17T02:25:55.116166] [DEBUG] [LOCAL ] BKU: Loaded 30997 existing records from primary storage. [2025-09-17T02:25:55.116353] [INFO ] [MAIN ] BKU: Loaded 30997 existing records. [2025-09-17T02:25:55.303224] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:55.303509] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-17T02:25:55.303577] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-17T02:25:55.304423] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-17T02:25:55.304519] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-17T02:25:55.724193] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:55.890141] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-11. [2025-09-17T02:25:55.964064] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T02:25:56.690120] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-17T02:25:56.802975] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T02:25:57.017546] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T02:25:57.490139] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-17T02:25:58.041828] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T02:25:58.046505] [INFO ] [REMOTE ] BKH: Full fetch complete (51764 records). [2025-09-17T02:25:58.046620] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-17T02:25:58.300083] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-17T02:25:58.442311] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T02:25:58.442588] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-17T02:25:58.442864] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-17T02:25:58.447278] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-17T02:25:58.447546] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-17T02:25:58.449551] [DEBUG] [LOCAL ] BKH: Trimmed 51764 records to 36686 (keeping 200 days of data) [2025-09-17T02:25:58.676147] [DEBUG] [LOCAL ] BKH: Primary data saved (36686 records). [2025-09-17T02:25:58.676328] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-17T02:25:58.676456] [INFO ] [MAIN ] Update Progress: 291/2369 symbols completed. BKH took 40.4s. Estimated remaining: 4h 58m 57s. Rate: 7.0 symbols/min [2025-09-17T02:25:58.865352] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:25:58.889382] [DEBUG] [LOCAL ] BKV: Loaded 21066 existing records from primary storage. [2025-09-17T02:25:58.889567] [INFO ] [MAIN ] BKV: Loaded 21066 existing records. [2025-09-17T02:25:59.086066] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:25:59.086371] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-17T02:25:59.086430] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-17T02:25:59.087087] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-17T02:25:59.087169] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-17T02:25:59.099040] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-17T02:25:59.472798] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:25:59.826733] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T02:25:59.890107] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-11. [2025-09-17T02:26:00.079039] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T02:26:00.690094] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-17T02:26:00.768890] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T02:26:01.490153] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-17T02:26:01.792429] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T02:26:02.290128] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-17T02:26:03.090140] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-17T02:26:03.503328] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T02:26:03.610611] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T02:26:03.893379] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-17T02:26:03.897190] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T02:26:04.690130] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-17T02:26:05.490134] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-17T02:26:05.884672] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T02:26:05.919014] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T02:26:06.290132] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-17T02:26:06.390325] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T02:26:07.090135] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-17T02:26:07.698194] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T02:26:07.890119] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-17T02:26:08.416795] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T02:26:08.690111] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-17T02:26:09.490158] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-17T02:26:09.608160] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T02:26:10.028020] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T02:26:10.290153] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-17T02:26:10.886558] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:26:11.090154] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-17T02:26:11.890180] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-17T02:26:11.982712] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T02:26:11.985659] [INFO ] [REMOTE ] BKT: Full fetch complete (14533 records). [2025-09-17T02:26:11.985749] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-17T02:26:12.357796] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-17T02:26:12.358044] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-17T02:26:12.358408] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-17T02:26:12.372422] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-17T02:26:12.382724] [DEBUG] [LOCAL ] BKT: Trimmed 14533 records to 10412 (keeping 200 days of data) [2025-09-17T02:26:12.383999] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T02:26:12.460316] [DEBUG] [LOCAL ] BKT: Primary data saved (10412 records). [2025-09-17T02:26:12.460484] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-17T02:26:12.460576] [INFO ] [MAIN ] Update Progress: 292/2369 symbols completed. BKT took 26.1s. Estimated remaining: 4h 59m 25s. Rate: 6.9 symbols/min [2025-09-17T02:26:12.631751] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:12.658101] [DEBUG] [LOCAL ] BLCO: Loaded 26549 existing records from primary storage. [2025-09-17T02:26:12.658276] [INFO ] [MAIN ] BLCO: Loaded 26549 existing records. [2025-09-17T02:26:12.700081] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-17T02:26:12.837538] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:26:12.837802] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-17T02:26:12.837854] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-17T02:26:12.838627] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-17T02:26:12.838719] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-17T02:26:13.194543] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:13.213585] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T02:26:13.490186] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-17T02:26:14.105547] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T02:26:14.290196] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-17T02:26:14.817509] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T02:26:15.090154] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-11. [2025-09-17T02:26:15.818462] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T02:26:15.890133] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-17T02:26:16.351273] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T02:26:16.690111] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-17T02:26:17.439615] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T02:26:17.490077] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-17T02:26:17.846164] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T02:26:18.290217] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-17T02:26:18.679262] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T02:26:19.090143] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-17T02:26:19.614920] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T02:26:19.890159] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-17T02:26:20.484127] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T02:26:20.491073] [INFO ] [REMOTE ] BKU: Full fetch complete (59413 records). [2025-09-17T02:26:20.491267] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-17T02:26:20.700426] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-17T02:26:20.885909] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-17T02:26:20.886035] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-17T02:26:20.886752] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-17T02:26:20.886828] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-17T02:26:20.888275] [DEBUG] [LOCAL ] BKU: Trimmed 59413 records to 42061 (keeping 200 days of data) [2025-09-17T02:26:21.143482] [DEBUG] [LOCAL ] BKU: Primary data saved (42061 records). [2025-09-17T02:26:21.143653] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-17T02:26:21.143752] [INFO ] [MAIN ] Update Progress: 293/2369 symbols completed. BKU took 26.2s. Estimated remaining: 4h 59m 17s. Rate: 6.9 symbols/min [2025-09-17T02:26:21.318594] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:21.338951] [DEBUG] [LOCAL ] BLD: Loaded 20558 existing records from primary storage. [2025-09-17T02:26:21.339115] [INFO ] [MAIN ] BLD: Loaded 20558 existing records. [2025-09-17T02:26:21.495242] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-17T02:26:21.525298] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:26:21.526432] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-17T02:26:21.526529] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-17T02:26:21.527284] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-17T02:26:21.527366] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-17T02:26:21.892107] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:21.922627] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T02:26:22.100431] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T02:26:22.290171] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-11. [2025-09-17T02:26:22.988522] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T02:26:23.090183] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-17T02:26:23.698922] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T02:26:23.890165] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-17T02:26:24.133506] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T02:26:24.690176] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-17T02:26:25.180725] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:26:25.490171] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-17T02:26:26.200602] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T02:26:26.290143] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-17T02:26:26.365710] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T02:26:27.090175] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-17T02:26:27.766503] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T02:26:27.890093] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-17T02:26:28.690162] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-17T02:26:29.119169] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T02:26:29.421247] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T02:26:29.483143] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T02:26:29.490082] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-17T02:26:30.290190] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-17T02:26:31.017388] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T02:26:31.033385] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T02:26:31.037559] [INFO ] [REMOTE ] BKV: Full fetch complete (45006 records). [2025-09-17T02:26:31.037688] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-17T02:26:31.095212] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-17T02:26:31.443618] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-17T02:26:31.443781] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-17T02:26:31.444355] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-17T02:26:31.444425] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-17T02:26:31.445433] [DEBUG] [LOCAL ] BKV: Trimmed 45006 records to 30298 (keeping 200 days of data) [2025-09-17T02:26:31.617359] [DEBUG] [LOCAL ] BKV: Primary data saved (30298 records). [2025-09-17T02:26:31.617517] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-17T02:26:31.617608] [INFO ] [MAIN ] Update Progress: 294/2369 symbols completed. BKV took 32.9s. Estimated remaining: 4h 59m 21s. Rate: 6.9 symbols/min [2025-09-17T02:26:31.790176] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:31.833139] [DEBUG] [LOCAL ] BLDR: Loaded 38691 existing records from primary storage. [2025-09-17T02:26:31.833337] [INFO ] [MAIN ] BLDR: Loaded 38691 existing records. [2025-09-17T02:26:31.899490] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-17T02:26:32.028486] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:26:32.028753] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-17T02:26:32.028837] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-17T02:26:32.029959] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-17T02:26:32.030030] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-17T02:26:32.397256] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:32.690102] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-17T02:26:33.194752] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-17T02:26:33.310812] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:26:33.490174] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-17T02:26:33.733107] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T02:26:34.290134] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-17T02:26:35.090108] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-17T02:26:35.150009] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T02:26:35.156072] [INFO ] [REMOTE ] BKSY: Full fetch complete (69039 records). [2025-09-17T02:26:35.156223] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-17T02:26:35.540552] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-17T02:26:35.540681] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-17T02:26:35.541406] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-17T02:26:35.541473] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-17T02:26:35.542937] [DEBUG] [LOCAL ] BKSY: Trimmed 69039 records to 48305 (keeping 200 days of data) [2025-09-17T02:26:35.680871] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T02:26:35.851617] [DEBUG] [LOCAL ] BKSY: Primary data saved (48305 records). [2025-09-17T02:26:35.851789] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-17T02:26:35.851912] [INFO ] [MAIN ] Update Progress: 295/2369 symbols completed. BKSY took 50.5s. Estimated remaining: 4h 58m 41s. Rate: 6.9 symbols/min [2025-09-17T02:26:35.895279] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-17T02:26:36.022639] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:36.033223] [DEBUG] [LOCAL ] BLE: Loaded 10217 existing records from primary storage. [2025-09-17T02:26:36.033360] [INFO ] [MAIN ] BLE: Loaded 10217 existing records. [2025-09-17T02:26:36.210232] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:26:36.210707] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-17T02:26:36.210817] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-17T02:26:36.211274] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-17T02:26:36.211416] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-17T02:26:36.518305] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T02:26:36.607114] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:36.690093] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-11. [2025-09-17T02:26:36.944370] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T02:26:37.490174] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-17T02:26:38.290109] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-11. [2025-09-17T02:26:38.382919] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T02:26:38.865017] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:26:38.907835] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T02:26:39.090114] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-17T02:26:39.890115] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-17T02:26:40.690145] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-17T02:26:40.896454] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T02:26:41.217139] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T02:26:41.490168] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-17T02:26:41.738512] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T02:26:42.290226] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-17T02:26:43.090162] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-17T02:26:43.126410] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T02:26:43.191211] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T02:26:43.195391] [INFO ] [REMOTE ] BLCO: Full fetch complete (52540 records). [2025-09-17T02:26:43.195502] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-17T02:26:43.570284] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-17T02:26:43.570391] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-17T02:26:43.571007] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-17T02:26:43.571065] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-17T02:26:43.572166] [DEBUG] [LOCAL ] BLCO: Trimmed 52540 records to 36497 (keeping 200 days of data) [2025-09-17T02:26:43.793165] [DEBUG] [LOCAL ] BLCO: Primary data saved (36497 records). [2025-09-17T02:26:43.793334] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-17T02:26:43.793429] [INFO ] [MAIN ] Update Progress: 296/2369 symbols completed. BLCO took 31.3s. Estimated remaining: 4h 58m 27s. Rate: 6.9 symbols/min [2025-09-17T02:26:43.892758] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-17T02:26:43.965305] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:43.973304] [DEBUG] [LOCAL ] BLK: No existing data file found in primary storage. [2025-09-17T02:26:43.973898] [WARN ] [MAIN ] BLK: No existing data found, performing full refresh instead. [2025-09-17T02:26:43.974198] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T02:26:43.977536] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-17T02:26:43.977949] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-17T02:26:43.978013] [DEBUG] [LOCAL ] BLK: No primary data file found to delete. [2025-09-17T02:26:43.978063] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-17T02:26:44.361850] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:44.690791] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-17T02:26:45.174927] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T02:26:45.466907] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T02:26:45.490109] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-17T02:26:46.290206] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-17T02:26:46.522016] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T02:26:47.090165] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-11. [2025-09-17T02:26:47.636062] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T02:26:47.890217] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-17T02:26:48.690213] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-17T02:26:48.874568] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T02:26:49.490230] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-17T02:26:49.646406] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T02:26:50.090045] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T02:26:50.290132] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-17T02:26:50.410356] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T02:26:51.090198] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-17T02:26:51.471580] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T02:26:51.890209] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-17T02:26:52.690201] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-17T02:26:52.738453] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T02:26:52.931719] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T02:26:53.490164] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-17T02:26:53.563824] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T02:26:53.568556] [INFO ] [REMOTE ] BLD: Full fetch complete (40268 records). [2025-09-17T02:26:53.569008] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-17T02:26:53.978270] [DEBUG] [VALIDATOR ] BLD: All expected trading days are present. [2025-09-17T02:26:53.978437] [DEBUG] [VALIDATOR ] BLD: Primary data validation passed. [2025-09-17T02:26:53.979029] [INFO ] [MAIN ] BLD: Fetched primary data is valid. [2025-09-17T02:26:53.979093] [DEBUG] [LOCAL ] BLD: Saving primary data. [2025-09-17T02:26:53.980135] [DEBUG] [LOCAL ] BLD: Trimmed 40268 records to 28206 (keeping 200 days of data) [2025-09-17T02:26:54.156356] [DEBUG] [LOCAL ] BLD: Primary data saved (28206 records). [2025-09-17T02:26:54.156532] [INFO ] [MAIN ] BLD: Full history saved. [2025-09-17T02:26:54.156672] [INFO ] [MAIN ] Update Progress: 297/2369 symbols completed. BLD took 33.0s. Estimated remaining: 4h 58m 31s. Rate: 6.9 symbols/min [2025-09-17T02:26:54.298571] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-17T02:26:54.330366] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:26:54.377359] [DEBUG] [LOCAL ] BLND: Loaded 36409 existing records from primary storage. [2025-09-17T02:26:54.377552] [INFO ] [MAIN ] BLND: Loaded 36409 existing records. [2025-09-17T02:26:54.567254] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:26:54.567760] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-17T02:26:54.567853] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-17T02:26:54.573870] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-17T02:26:54.579357] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-17T02:26:54.644029] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T02:26:54.941557] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:26:55.090097] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-11. [2025-09-17T02:26:55.890152] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-17T02:26:56.122288] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T02:26:56.690148] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-17T02:26:56.785753] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T02:26:56.863287] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T02:26:57.490136] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-17T02:26:58.293738] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-17T02:26:58.294787] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T02:26:58.502025] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T02:26:59.090149] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-17T02:26:59.890177] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-17T02:26:59.920525] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T02:26:59.930257] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T02:26:59.932737] [INFO ] [REMOTE ] BLE: Full fetch complete (20440 records). [2025-09-17T02:26:59.932829] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-17T02:27:00.296706] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-17T02:27:00.296993] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-17T02:27:00.297343] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-17T02:27:00.297393] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-17T02:27:00.298065] [DEBUG] [LOCAL ] BLE: Trimmed 20440 records to 14696 (keeping 200 days of data) [2025-09-17T02:27:00.387069] [DEBUG] [LOCAL ] BLE: Primary data saved (14696 records). [2025-09-17T02:27:00.387226] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-17T02:27:00.387324] [INFO ] [MAIN ] Update Progress: 298/2369 symbols completed. BLE took 24.5s. Estimated remaining: 4h 58m 5s. Rate: 6.9 symbols/min [2025-09-17T02:27:00.556943] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:00.557149] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-17T02:27:00.557199] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-17T02:27:00.557308] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-17T02:27:00.557358] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-17T02:27:00.557408] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-17T02:27:00.557542] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-17T02:27:00.700181] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-17T02:27:00.915875] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:01.490190] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-11. [2025-09-17T02:27:01.851624] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T02:27:02.290195] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-17T02:27:02.631157] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:02.631498] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-11 [2025-09-17T02:27:03.090146] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-17T02:27:03.456936] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (2.76 seconds). [2025-09-17T02:27:03.595956] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:03.596311] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-17T02:27:03.890133] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-17T02:27:04.351505] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:04.351927] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-17T02:27:04.690099] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-17T02:27:05.105749] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-17T02:27:05.490151] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-17T02:27:05.710211] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:05.710538] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-17T02:27:05.983090] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:27:06.290139] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-17T02:27:06.510940] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:06.511254] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-17T02:27:07.090142] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-17T02:27:07.890113] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-17T02:27:08.089254] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:08.089499] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-17T02:27:08.690112] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-17T02:27:08.994381] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T02:27:09.490142] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-17T02:27:10.290170] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-17T02:27:10.516391] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:10.516770] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-17T02:27:10.614364] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T02:27:11.090161] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-17T02:27:11.174454] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T02:27:11.302291] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:11.302658] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-17T02:27:11.890131] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-17T02:27:12.100788] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:27:12.101158] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-17T02:27:12.690193] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-17T02:27:13.490154] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-17T02:27:14.290216] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-17T02:27:14.496971] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T02:27:15.090227] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-17T02:27:15.890223] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-17T02:27:15.993529] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-17T02:27:16.680329] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-17T02:27:16.690070] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-17T02:27:17.394270] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T02:27:17.401015] [INFO ] [REMOTE ] BLDR: Full fetch complete (73824 records). [2025-09-17T02:27:17.401210] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-17T02:27:17.499528] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-17T02:27:17.815962] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-17T02:27:17.816151] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-17T02:27:17.817015] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-17T02:27:17.817090] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-17T02:27:17.840978] [DEBUG] [LOCAL ] BLDR: Trimmed 73824 records to 51613 (keeping 200 days of data) [2025-09-17T02:27:17.842168] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (2.75 seconds). [2025-09-17T02:27:18.168819] [DEBUG] [LOCAL ] BLDR: Primary data saved (51613 records). [2025-09-17T02:27:18.169008] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-17T02:27:18.169122] [INFO ] [MAIN ] Update Progress: 299/2369 symbols completed. BLDR took 46.6s. Estimated remaining: 4h 59m 0s. Rate: 6.9 symbols/min [2025-09-17T02:27:18.295340] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-17T02:27:18.344513] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:18.382165] [DEBUG] [LOCAL ] BLW: Loaded 9090 existing records from primary storage. [2025-09-17T02:27:18.382564] [INFO ] [MAIN ] BLW: Loaded 9090 existing records. [2025-09-17T02:27:18.415664] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T02:27:18.572175] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:27:18.572440] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-17T02:27:18.572529] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-17T02:27:18.572973] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-17T02:27:18.573035] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-17T02:27:18.932673] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:19.090181] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-17T02:27:19.890172] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-11. [2025-09-17T02:27:19.928437] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-17T02:27:19.937791] [INFO ] [REMOTE ] BLSH: Full fetch complete (9102 records). [2025-09-17T02:27:19.938020] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-17T02:27:20.146773] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 24 unique days, need 200 days [2025-09-17T02:27:20.147159] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:27:20.147593] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:27:20.148542] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T02:27:20.148681] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-17T02:27:20.155742] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-17T02:27:20.156028] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-17T02:27:20.156100] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-17T02:27:20.156174] [INFO ] [MAIN ] Update Progress: 300/2369 symbols completed. BLSH took 19.8s. Estimated remaining: 4h 58m 5s. Rate: 6.9 symbols/min [2025-09-17T02:27:20.327095] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:20.327275] [DEBUG] [LOCAL ] BLX: No existing data file found in primary storage. [2025-09-17T02:27:20.327337] [WARN ] [MAIN ] BLX: No existing data found, performing full refresh instead. [2025-09-17T02:27:20.327463] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-17T02:27:20.327529] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-17T02:27:20.327583] [DEBUG] [LOCAL ] BLX: No primary data file found to delete. [2025-09-17T02:27:20.327620] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-17T02:27:20.657956] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T02:27:20.696853] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-17T02:27:20.716195] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:20.746132] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T02:27:21.490136] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-11. [2025-09-17T02:27:22.290108] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-17T02:27:22.372156] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T02:27:22.451775] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T02:27:23.090198] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-17T02:27:23.890140] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-17T02:27:24.050629] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T02:27:24.690165] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-17T02:27:24.748354] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T02:27:24.930537] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T02:27:25.474755] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T02:27:25.490111] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-17T02:27:26.290142] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-17T02:27:26.498378] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T02:27:27.090132] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-17T02:27:27.218728] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T02:27:27.890185] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-17T02:27:28.443958] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T02:27:28.690218] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-17T02:27:28.723371] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T02:27:29.490134] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-17T02:27:30.263193] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T02:27:30.290083] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-17T02:27:30.956392] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T02:27:30.960511] [INFO ] [REMOTE ] BLK: Full fetch complete (53279 records). [2025-09-17T02:27:30.960662] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-17T02:27:31.101950] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-17T02:27:31.349186] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-17T02:27:31.349312] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-17T02:27:31.349984] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-17T02:27:31.350045] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-17T02:27:31.351219] [DEBUG] [LOCAL ] BLK: Trimmed 53279 records to 35450 (keeping 200 days of data) [2025-09-17T02:27:31.596465] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T02:27:31.618690] [DEBUG] [LOCAL ] BLK: Primary data saved (35450 records). [2025-09-17T02:27:31.618841] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-17T02:27:31.618924] [INFO ] [MAIN ] Update Progress: 301/2369 symbols completed. BLK took 47.8s. Estimated remaining: 4h 58m 16s. Rate: 6.9 symbols/min [2025-09-17T02:27:31.790171] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:31.815453] [DEBUG] [LOCAL ] BMA: Loaded 25533 existing records from primary storage. [2025-09-17T02:27:31.815610] [INFO ] [MAIN ] BMA: Loaded 25533 existing records. [2025-09-17T02:27:31.895250] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-17T02:27:32.031003] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:27:32.031421] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-17T02:27:32.031498] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-17T02:27:32.038563] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-17T02:27:32.040251] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-17T02:27:32.047101] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T02:27:32.406682] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:32.690168] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-17T02:27:32.817605] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T02:27:33.490150] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-17T02:27:33.811945] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T02:27:34.290153] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-17T02:27:34.313891] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T02:27:35.090210] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-11. [2025-09-17T02:27:35.127439] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T02:27:35.890166] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-17T02:27:36.105260] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T02:27:36.690151] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-17T02:27:37.490219] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-17T02:27:37.625956] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T02:27:37.891281] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T02:27:38.085825] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T02:27:38.290177] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-17T02:27:39.090135] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-17T02:27:39.706977] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T02:27:39.721266] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T02:27:39.890146] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-17T02:27:40.690130] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-17T02:27:41.384015] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T02:27:41.390197] [INFO ] [REMOTE ] BLND: Full fetch complete (72167 records). [2025-09-17T02:27:41.390335] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-17T02:27:41.495963] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-17T02:27:41.787296] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-17T02:27:41.787399] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-17T02:27:41.788146] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-17T02:27:41.788203] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-17T02:27:41.789688] [DEBUG] [LOCAL ] BLND: Trimmed 72167 records to 49537 (keeping 200 days of data) [2025-09-17T02:27:42.100095] [DEBUG] [LOCAL ] BLND: Primary data saved (49537 records). [2025-09-17T02:27:42.100253] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-17T02:27:42.100346] [INFO ] [MAIN ] Update Progress: 302/2369 symbols completed. BLND took 47.9s. Estimated remaining: 4h 58m 20s. Rate: 6.9 symbols/min [2025-09-17T02:27:42.273616] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:42.296570] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T02:27:42.295153] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-17T02:27:42.310732] [DEBUG] [LOCAL ] BME: Loaded 8162 existing records from primary storage. [2025-09-17T02:27:42.310826] [INFO ] [MAIN ] BME: Loaded 8162 existing records. [2025-09-17T02:27:42.488116] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:27:42.488365] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-17T02:27:42.488416] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-17T02:27:42.488862] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-17T02:27:42.488927] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-17T02:27:42.822157] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T02:27:42.863408] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:43.090103] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-11. [2025-09-17T02:27:43.232396] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T02:27:43.667457] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T02:27:43.890175] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-17T02:27:44.690140] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-17T02:27:44.896261] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T02:27:45.490140] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-17T02:27:46.123359] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T02:27:46.290143] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-17T02:27:46.386023] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T02:27:47.090139] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-17T02:27:47.348374] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T02:27:47.890163] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-17T02:27:48.031090] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T02:27:48.033795] [INFO ] [REMOTE ] BLW: Full fetch complete (18914 records). [2025-09-17T02:27:48.033918] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-17T02:27:48.409963] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-17T02:27:48.410126] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-17T02:27:48.410536] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-17T02:27:48.410594] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-17T02:27:48.411454] [DEBUG] [LOCAL ] BLW: Trimmed 18914 records to 12961 (keeping 200 days of data) [2025-09-17T02:27:48.492387] [DEBUG] [LOCAL ] BLW: Primary data saved (12961 records). [2025-09-17T02:27:48.492568] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-17T02:27:48.492699] [INFO ] [MAIN ] Update Progress: 303/2369 symbols completed. BLW took 30.3s. Estimated remaining: 4h 57m 56s. Rate: 6.9 symbols/min [2025-09-17T02:27:48.663740] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:27:48.682561] [DEBUG] [LOCAL ] BMEZ: Loaded 17832 existing records from primary storage. [2025-09-17T02:27:48.682753] [INFO ] [MAIN ] BMEZ: Loaded 17832 existing records. [2025-09-17T02:27:48.695516] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-17T02:27:48.865714] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:27:48.866009] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-17T02:27:48.866079] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-17T02:27:48.866719] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-17T02:27:48.866788] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-17T02:27:49.236937] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:27:49.390054] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T02:27:49.466597] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T02:27:49.490152] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-11. [2025-09-17T02:27:50.290148] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-17T02:27:50.634558] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T02:27:51.090140] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-17T02:27:51.637366] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T02:27:51.890187] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-17T02:27:52.322595] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T02:27:52.520580] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T02:27:52.690116] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-17T02:27:53.490204] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-17T02:27:53.514151] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T02:27:54.290184] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-17T02:27:54.953721] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:27:55.090129] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-17T02:27:55.219171] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:27:55.890183] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-17T02:27:56.463979] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T02:27:56.479713] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T02:27:56.690203] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-17T02:27:57.490137] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-17T02:27:57.551961] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T02:27:58.290136] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-17T02:27:58.531893] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T02:27:59.090153] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-17T02:27:59.474619] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T02:27:59.662316] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T02:27:59.890134] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-17T02:28:00.690185] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-17T02:28:00.834120] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T02:28:01.490171] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-17T02:28:02.059977] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T02:28:02.290209] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-17T02:28:02.463377] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T02:28:03.049692] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T02:28:03.051760] [INFO ] [REMOTE ] BME: Full fetch complete (16176 records). [2025-09-17T02:28:03.051847] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-17T02:28:03.095230] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-17T02:28:03.431310] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-17T02:28:03.431415] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-17T02:28:03.431734] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-17T02:28:03.431789] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-17T02:28:03.432520] [DEBUG] [LOCAL ] BME: Trimmed 16176 records to 10803 (keeping 200 days of data) [2025-09-17T02:28:03.508523] [DEBUG] [LOCAL ] BME: Primary data saved (10803 records). [2025-09-17T02:28:03.508781] [INFO ] [MAIN ] BME: Full history saved. [2025-09-17T02:28:03.508933] [INFO ] [MAIN ] Update Progress: 304/2369 symbols completed. BME took 21.4s. Estimated remaining: 4h 58m 30s. Rate: 6.9 symbols/min [2025-09-17T02:28:03.679112] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:03.679331] [DEBUG] [LOCAL ] BMI: No existing data file found in primary storage. [2025-09-17T02:28:03.679382] [WARN ] [MAIN ] BMI: No existing data found, performing full refresh instead. [2025-09-17T02:28:03.679488] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-17T02:28:03.679538] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-17T02:28:03.679586] [DEBUG] [LOCAL ] BMI: No primary data file found to delete. [2025-09-17T02:28:03.679632] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-17T02:28:03.897593] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-17T02:28:04.036027] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:04.048088] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T02:28:04.690149] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-11. [2025-09-17T02:28:05.338330] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:28:05.490133] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-17T02:28:05.854339] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T02:28:06.290108] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-17T02:28:06.597453] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T02:28:07.090129] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-17T02:28:07.357827] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T02:28:07.890115] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-17T02:28:07.920598] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T02:28:08.690145] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-17T02:28:08.991459] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T02:28:09.490166] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-17T02:28:09.599603] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T02:28:10.279393] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T02:28:10.290088] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-17T02:28:11.090082] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-17T02:28:11.524813] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T02:28:11.707814] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T02:28:11.890155] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-17T02:28:12.690197] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-17T02:28:13.058163] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:28:13.490150] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-17T02:28:14.036566] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T02:28:14.290157] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-17T02:28:14.557866] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T02:28:14.561245] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40917 records). [2025-09-17T02:28:14.561417] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-17T02:28:14.939768] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-17T02:28:14.939893] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-17T02:28:14.940480] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-17T02:28:14.940563] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-17T02:28:14.941705] [DEBUG] [LOCAL ] BMEZ: Trimmed 40917 records to 26034 (keeping 200 days of data) [2025-09-17T02:28:15.091062] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-17T02:28:15.115798] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26034 records). [2025-09-17T02:28:15.115962] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-17T02:28:15.116104] [INFO ] [MAIN ] Update Progress: 305/2369 symbols completed. BMEZ took 26.6s. Estimated remaining: 4h 58m 42s. Rate: 6.9 symbols/min [2025-09-17T02:28:15.293256] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:15.293494] [DEBUG] [LOCAL ] BMN: No existing data file found in primary storage. [2025-09-17T02:28:15.293544] [WARN ] [MAIN ] BMN: No existing data found, performing full refresh instead. [2025-09-17T02:28:15.293674] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-17T02:28:15.293727] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-17T02:28:15.293773] [DEBUG] [LOCAL ] BMN: No primary data file found to delete. [2025-09-17T02:28:15.293816] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-17T02:28:15.646440] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:15.734106] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T02:28:15.744771] [INFO ] [REMOTE ] BMA: Full fetch complete (50596 records). [2025-09-17T02:28:15.744937] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-17T02:28:15.898331] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-11. [2025-09-17T02:28:16.137209] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T02:28:16.155211] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-17T02:28:16.155438] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-17T02:28:16.156129] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-17T02:28:16.156204] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-17T02:28:16.156297] [INFO ] [REMOTE ] BLX: Full fetch complete (22634 records). [2025-09-17T02:28:16.156598] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-17T02:28:16.232763] [DEBUG] [LOCAL ] BMA: Trimmed 50596 records to 34448 (keeping 200 days of data) [2025-09-17T02:28:16.461485] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T02:28:16.663250] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-17T02:28:16.664127] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-17T02:28:16.665120] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-17T02:28:16.666721] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-17T02:28:16.671103] [DEBUG] [LOCAL ] BLX: Trimmed 22634 records to 16056 (keeping 200 days of data) [2025-09-17T02:28:16.721023] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-17T02:28:16.856013] [DEBUG] [LOCAL ] BMA: Primary data saved (34448 records). [2025-09-17T02:28:16.856523] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-17T02:28:16.856694] [INFO ] [MAIN ] Update Progress: 306/2369 symbols completed. BMA took 45.2s. Estimated remaining: 4h 57m 46s. Rate: 6.9 symbols/min [2025-09-17T02:28:17.034913] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:17.036298] [DEBUG] [LOCAL ] BMO: No existing data file found in primary storage. [2025-09-17T02:28:17.037318] [WARN ] [MAIN ] BMO: No existing data found, performing full refresh instead. [2025-09-17T02:28:17.038663] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-17T02:28:17.039433] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-17T02:28:17.039784] [DEBUG] [LOCAL ] BMO: No primary data file found to delete. [2025-09-17T02:28:17.040065] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-17T02:28:17.327341] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T02:28:17.376228] [DEBUG] [LOCAL ] BLX: Primary data saved (16056 records). [2025-09-17T02:28:17.411240] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-17T02:28:17.420480] [INFO ] [MAIN ] Update Progress: 307/2369 symbols completed. BLX took 57.3s. Estimated remaining: 4h 56m 43s. Rate: 6.9 symbols/min [2025-09-17T02:28:17.440669] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:17.495478] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-17T02:28:17.615732] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:17.673376] [DEBUG] [LOCAL ] BMY: Loaded 40107 existing records from primary storage. [2025-09-17T02:28:17.673564] [INFO ] [MAIN ] BMY: Loaded 40107 existing records. [2025-09-17T02:28:17.852356] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:28:17.852637] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-17T02:28:17.852712] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-17T02:28:17.853756] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-17T02:28:17.853819] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-17T02:28:18.208795] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:18.290110] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-11. [2025-09-17T02:28:18.714418] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T02:28:19.090186] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-11. [2025-09-17T02:28:19.890149] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-17T02:28:20.220525] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T02:28:20.387068] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-11 (2.10 seconds). [2025-09-17T02:28:20.610690] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T02:28:20.690110] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-17T02:28:21.490206] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-17T02:28:22.290220] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-17T02:28:22.541575] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:28:22.773280] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T02:28:23.090184] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-17T02:28:23.381759] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-17T02:28:23.890158] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-17T02:28:24.024854] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T02:28:24.690133] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-17T02:28:24.988752] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.30 seconds). [2025-09-17T02:28:25.253939] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T02:28:25.490126] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-17T02:28:26.290107] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-17T02:28:26.655245] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:28:26.701194] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-17T02:28:27.090135] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-17T02:28:27.489350] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-17T02:28:27.890150] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-17T02:28:28.690141] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-17T02:28:29.194277] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-17T02:28:29.490183] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-17T02:28:29.866110] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T02:28:30.290163] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-17T02:28:30.622800] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T02:28:30.626686] [INFO ] [REMOTE ] BMI: Full fetch complete (32053 records). [2025-09-17T02:28:30.626816] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-17T02:28:30.997606] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-17T02:28:30.997738] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-17T02:28:30.998203] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-17T02:28:30.998259] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-17T02:28:30.999324] [DEBUG] [LOCAL ] BMI: Trimmed 32053 records to 23761 (keeping 200 days of data) [2025-09-17T02:28:31.096715] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-17T02:28:31.157703] [DEBUG] [LOCAL ] BMI: Primary data saved (23761 records). [2025-09-17T02:28:31.157884] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-17T02:28:31.157992] [INFO ] [MAIN ] Update Progress: 308/2369 symbols completed. BMI took 27.6s. Estimated remaining: 4h 57m 9s. Rate: 6.9 symbols/min [2025-09-17T02:28:31.337002] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:31.383307] [DEBUG] [LOCAL ] BN: Loaded 39392 existing records from primary storage. [2025-09-17T02:28:31.383505] [INFO ] [MAIN ] BN: Loaded 39392 existing records. [2025-09-17T02:28:31.561940] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:28:31.562213] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-17T02:28:31.562283] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-17T02:28:31.563266] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-17T02:28:31.563336] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-17T02:28:31.898745] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-17T02:28:31.928996] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:32.162187] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T02:28:32.417343] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T02:28:32.640592] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T02:28:32.690076] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-17T02:28:33.490143] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-11. [2025-09-17T02:28:33.940217] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T02:28:34.290144] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-17T02:28:35.090188] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-17T02:28:35.382330] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T02:28:35.661210] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T02:28:35.890103] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-17T02:28:36.000357] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T02:28:36.690156] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-17T02:28:37.495792] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-17T02:28:37.500940] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T02:28:37.991864] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T02:28:37.992930] [INFO ] [REMOTE ] BMN: Full fetch complete (3751 records). [2025-09-17T02:28:37.993018] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-17T02:28:38.295269] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-17T02:28:38.355558] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-17T02:28:38.355695] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-17T02:28:38.355884] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-17T02:28:38.355934] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-17T02:28:38.356386] [DEBUG] [LOCAL ] BMN: Trimmed 3751 records to 2573 (keeping 200 days of data) [2025-09-17T02:28:38.375351] [DEBUG] [LOCAL ] BMN: Primary data saved (2573 records). [2025-09-17T02:28:38.375479] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-17T02:28:38.375563] [INFO ] [MAIN ] Update Progress: 309/2369 symbols completed. BMN took 23.3s. Estimated remaining: 4h 56m 50s. Rate: 6.9 symbols/min [2025-09-17T02:28:38.557659] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:38.557927] [DEBUG] [LOCAL ] BNED: No existing data file found in primary storage. [2025-09-17T02:28:38.557990] [WARN ] [MAIN ] BNED: No existing data found, performing full refresh instead. [2025-09-17T02:28:38.558162] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-17T02:28:38.558230] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-17T02:28:38.558302] [DEBUG] [LOCAL ] BNED: No primary data file found to delete. [2025-09-17T02:28:38.558364] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-17T02:28:38.936844] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:38.972187] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-17T02:28:39.090149] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-17T02:28:39.890166] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-17T02:28:40.264685] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T02:28:40.690188] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-11. [2025-09-17T02:28:40.854677] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T02:28:41.495493] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-17T02:28:41.498076] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T02:28:41.600975] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T02:28:42.290127] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-17T02:28:42.939688] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T02:28:43.090112] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-17T02:28:43.719932] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T02:28:43.890136] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-17T02:28:44.503587] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:28:44.690132] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-17T02:28:45.284226] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T02:28:45.490142] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-17T02:28:46.290190] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-17T02:28:46.427441] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T02:28:46.589970] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T02:28:47.090164] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-17T02:28:47.431019] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T02:28:47.890133] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-17T02:28:48.599454] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T02:28:48.690207] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-17T02:28:49.053241] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T02:28:49.490144] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-17T02:28:50.274025] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T02:28:50.290081] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-17T02:28:51.090117] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-17T02:28:51.145591] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T02:28:51.841864] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T02:28:51.890099] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-17T02:28:52.453238] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T02:28:52.690135] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-17T02:28:53.293024] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T02:28:53.298413] [INFO ] [REMOTE ] BMO: Full fetch complete (59890 records). [2025-09-17T02:28:53.298540] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-17T02:28:53.495210] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-17T02:28:53.725699] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-17T02:28:53.725814] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-17T02:28:53.726468] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-17T02:28:53.726524] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-17T02:28:53.727817] [DEBUG] [LOCAL ] BMO: Trimmed 59890 records to 41443 (keeping 200 days of data) [2025-09-17T02:28:53.988614] [DEBUG] [LOCAL ] BMO: Primary data saved (41443 records). [2025-09-17T02:28:53.988787] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-17T02:28:53.988877] [INFO ] [MAIN ] Update Progress: 310/2369 symbols completed. BMO took 37.1s. Estimated remaining: 4h 57m 28s. Rate: 6.9 symbols/min [2025-09-17T02:28:54.158860] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:28:54.163537] [DEBUG] [LOCAL ] BNH: Loaded 3128 existing records from primary storage. [2025-09-17T02:28:54.163672] [INFO ] [MAIN ] BNH: Loaded 3128 existing records. [2025-09-17T02:28:54.302384] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-17T02:28:54.341458] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:28:54.341878] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-17T02:28:54.341944] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-17T02:28:54.342211] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-17T02:28:54.342267] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-17T02:28:54.700271] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:28:54.971872] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T02:28:55.090138] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-11. [2025-09-17T02:28:55.520617] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T02:28:55.671947] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T02:28:55.672849] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:28:55.890167] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-17T02:28:56.690210] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-17T02:28:57.490093] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-17T02:28:57.836769] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T02:28:57.879941] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T02:28:58.290129] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-17T02:28:59.090139] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-17T02:28:59.520355] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T02:28:59.744249] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T02:28:59.765565] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T02:28:59.890092] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-17T02:29:00.690142] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-17T02:29:01.339398] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T02:29:01.490168] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-17T02:29:02.290131] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-17T02:29:02.546707] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T02:29:02.553204] [INFO ] [REMOTE ] BMY: Full fetch complete (77647 records). [2025-09-17T02:29:02.553373] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-17T02:29:02.927181] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T02:29:02.960417] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-17T02:29:02.961015] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-17T02:29:02.961933] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-17T02:29:02.961994] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-17T02:29:02.963561] [DEBUG] [LOCAL ] BMY: Trimmed 77647 records to 53757 (keeping 200 days of data) [2025-09-17T02:29:03.090423] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-17T02:29:03.318112] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T02:29:03.342011] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-09-17T02:29:03.342179] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-17T02:29:03.343027] [INFO ] [MAIN ] Update Progress: 311/2369 symbols completed. BMY took 45.9s. Estimated remaining: 4h 57m 24s. Rate: 6.9 symbols/min [2025-09-17T02:29:03.511082] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:03.514502] [DEBUG] [LOCAL ] BNJ: Loaded 1747 existing records from primary storage. [2025-09-17T02:29:03.514638] [INFO ] [MAIN ] BNJ: Loaded 1747 existing records. [2025-09-17T02:29:03.695412] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:03.695675] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-17T02:29:03.695734] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-17T02:29:03.695994] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-17T02:29:03.696052] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-17T02:29:03.895284] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-17T02:29:04.056146] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:04.066885] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T02:29:04.071196] [INFO ] [REMOTE ] BNED: Full fetch complete (44345 records). [2025-09-17T02:29:04.071344] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-17T02:29:04.385543] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T02:29:04.478096] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-17T02:29:04.478211] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-17T02:29:04.478787] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-17T02:29:04.478850] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-17T02:29:04.480020] [DEBUG] [LOCAL ] BNED: Trimmed 44345 records to 30086 (keeping 200 days of data) [2025-09-17T02:29:04.665254] [DEBUG] [LOCAL ] BNED: Primary data saved (30086 records). [2025-09-17T02:29:04.665430] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-17T02:29:04.665520] [INFO ] [MAIN ] Update Progress: 312/2369 symbols completed. BNED took 26.3s. Estimated remaining: 4h 56m 27s. Rate: 6.9 symbols/min [2025-09-17T02:29:04.697742] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-17T02:29:04.847895] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:04.886544] [DEBUG] [LOCAL ] BNL: Loaded 34783 existing records from primary storage. [2025-09-17T02:29:04.886769] [INFO ] [MAIN ] BNL: Loaded 34783 existing records. [2025-09-17T02:29:05.073017] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:05.073277] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-17T02:29:05.073336] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-17T02:29:05.074280] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-17T02:29:05.074343] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-17T02:29:05.432869] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:05.437300] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T02:29:05.490111] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-11. [2025-09-17T02:29:06.290134] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-17T02:29:07.091697] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-11. [2025-09-17T02:29:07.097528] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T02:29:07.676879] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T02:29:07.890115] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-17T02:29:08.233595] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T02:29:08.277791] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-17T02:29:08.690147] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-17T02:29:09.175720] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T02:29:09.490203] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-17T02:29:10.290160] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-17T02:29:11.090175] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-17T02:29:11.432549] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:29:11.605344] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T02:29:11.842437] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T02:29:11.890151] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-17T02:29:12.489043] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T02:29:12.690142] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-17T02:29:13.490156] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-17T02:29:14.050261] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T02:29:14.295246] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-17T02:29:14.312497] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T02:29:14.876992] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T02:29:15.090154] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-17T02:29:15.890138] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-17T02:29:16.508012] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T02:29:16.690102] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-17T02:29:16.771318] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T02:29:16.778345] [INFO ] [REMOTE ] BN: Full fetch complete (76479 records). [2025-09-17T02:29:16.778508] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-17T02:29:17.178967] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-17T02:29:17.179085] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-17T02:29:17.179875] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-17T02:29:17.179933] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-17T02:29:17.181484] [DEBUG] [LOCAL ] BN: Trimmed 76479 records to 53015 (keeping 200 days of data) [2025-09-17T02:29:17.285392] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T02:29:17.503317] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-17T02:29:17.529621] [DEBUG] [LOCAL ] BN: Primary data saved (53015 records). [2025-09-17T02:29:17.529774] [INFO ] [MAIN ] BN: Full history saved. [2025-09-17T02:29:17.529894] [INFO ] [MAIN ] Update Progress: 313/2369 symbols completed. BN took 46.4s. Estimated remaining: 4h 56m 46s. Rate: 6.9 symbols/min [2025-09-17T02:29:17.702550] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:17.739801] [DEBUG] [LOCAL ] BNS: Loaded 38179 existing records from primary storage. [2025-09-17T02:29:17.739962] [INFO ] [MAIN ] BNS: Loaded 38179 existing records. [2025-09-17T02:29:17.916250] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:17.916504] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-17T02:29:17.916563] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-17T02:29:17.917508] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-17T02:29:17.917571] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-17T02:29:18.219628] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T02:29:18.282787] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:18.290089] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-17T02:29:18.801868] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T02:29:19.090142] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-17T02:29:19.416187] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-17T02:29:19.890151] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-17T02:29:20.411891] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T02:29:20.690186] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-17T02:29:21.490162] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-17T02:29:21.925481] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T02:29:21.942274] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T02:29:22.290174] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-17T02:29:22.889225] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T02:29:23.090198] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-17T02:29:23.890135] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-11. [2025-09-17T02:29:24.702008] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-17T02:29:24.708479] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T02:29:25.209398] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T02:29:25.210458] [INFO ] [REMOTE ] BNH: Full fetch complete (6775 records). [2025-09-17T02:29:25.210546] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-17T02:29:25.495281] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-17T02:29:25.582280] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-17T02:29:25.582388] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-17T02:29:25.582912] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-17T02:29:25.582976] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-17T02:29:25.583506] [DEBUG] [LOCAL ] BNH: Trimmed 6775 records to 4836 (keeping 200 days of data) [2025-09-17T02:29:25.614062] [DEBUG] [LOCAL ] BNH: Primary data saved (4836 records). [2025-09-17T02:29:25.614208] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-17T02:29:25.614605] [INFO ] [MAIN ] Update Progress: 314/2369 symbols completed. BNH took 31.6s. Estimated remaining: 4h 56m 33s. Rate: 6.9 symbols/min [2025-09-17T02:29:25.723216] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T02:29:25.824386] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:25.828266] [DEBUG] [LOCAL ] BNT: Loaded 2089 existing records from primary storage. [2025-09-17T02:29:25.828365] [INFO ] [MAIN ] BNT: Loaded 2089 existing records. [2025-09-17T02:29:26.008210] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:26.010733] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T02:29:26.011873] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-17T02:29:26.011947] [INFO ] [REMOTE ] BNJ: Full fetch complete (4445 records). [2025-09-17T02:29:26.012053] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-17T02:29:26.012097] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-17T02:29:26.012590] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-17T02:29:26.056222] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-17T02:29:26.292013] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-17T02:29:26.757866] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-17T02:29:26.761584] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-17T02:29:26.761419] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:26.762113] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-17T02:29:26.762182] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-17T02:29:26.762688] [DEBUG] [LOCAL ] BNJ: Trimmed 4445 records to 2609 (keeping 200 days of data) [2025-09-17T02:29:26.786941] [DEBUG] [LOCAL ] BNJ: Primary data saved (2609 records). [2025-09-17T02:29:26.787035] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-17T02:29:26.787122] [INFO ] [MAIN ] Update Progress: 315/2369 symbols completed. BNJ took 23.4s. Estimated remaining: 4h 55m 36s. Rate: 6.9 symbols/min [2025-09-17T02:29:26.962283] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:26.970595] [DEBUG] [LOCAL ] BNY: Loaded 5332 existing records from primary storage. [2025-09-17T02:29:26.970767] [INFO ] [MAIN ] BNY: Loaded 5332 existing records. [2025-09-17T02:29:27.095299] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-17T02:29:27.170698] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:27.171153] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-17T02:29:27.171216] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-17T02:29:27.171503] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-17T02:29:27.171559] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-17T02:29:27.523724] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:27.890162] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-11. [2025-09-17T02:29:28.326096] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T02:29:28.391046] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-17T02:29:28.690166] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-17T02:29:28.929416] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T02:29:29.175038] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T02:29:29.490167] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-17T02:29:30.290152] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-17T02:29:30.935983] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T02:29:31.000483] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T02:29:31.090092] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-17T02:29:31.890152] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-17T02:29:32.629078] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T02:29:32.690141] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-11. [2025-09-17T02:29:33.315894] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T02:29:33.490181] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-17T02:29:33.749290] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T02:29:34.052784] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T02:29:34.290139] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-17T02:29:35.090208] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-17T02:29:35.849421] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T02:29:35.890080] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-17T02:29:36.024067] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T02:29:36.678853] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T02:29:36.690073] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-17T02:29:37.385070] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T02:29:37.490159] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-17T02:29:38.131066] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T02:29:38.290116] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-17T02:29:39.090180] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-17T02:29:39.126118] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T02:29:39.505048] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-17T02:29:39.890138] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-17T02:29:40.384934] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T02:29:40.690196] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-17T02:29:41.436035] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T02:29:41.490219] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-17T02:29:42.290139] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-17T02:29:43.061284] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T02:29:43.090101] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-17T02:29:43.895303] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-17T02:29:43.920353] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T02:29:44.148025] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:29:44.153889] [INFO ] [REMOTE ] BNL: Full fetch complete (66473 records). [2025-09-17T02:29:44.154044] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-17T02:29:44.565278] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-17T02:29:44.565405] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-17T02:29:44.566137] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-17T02:29:44.566216] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-17T02:29:44.567672] [DEBUG] [LOCAL ] BNL: Trimmed 66473 records to 46995 (keeping 200 days of data) [2025-09-17T02:29:44.669294] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T02:29:44.696464] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-17T02:29:44.698954] [INFO ] [REMOTE ] BNY: Full fetch complete (10577 records). [2025-09-17T02:29:44.701447] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-17T02:29:45.205551] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-17T02:29:45.205673] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-17T02:29:45.205963] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-17T02:29:45.206539] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-17T02:29:45.207802] [DEBUG] [LOCAL ] BNY: Trimmed 10577 records to 7359 (keeping 200 days of data) [2025-09-17T02:29:45.310135] [DEBUG] [LOCAL ] BNL: Primary data saved (46995 records). [2025-09-17T02:29:45.311246] [DEBUG] [LOCAL ] BNY: Primary data saved (7359 records). [2025-09-17T02:29:45.311377] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-17T02:29:45.311597] [INFO ] [MAIN ] Update Progress: 316/2369 symbols completed. BNL took 40.6s. Estimated remaining: 4h 56m 32s. Rate: 6.9 symbols/min [2025-09-17T02:29:45.311471] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-17T02:29:45.312065] [INFO ] [MAIN ] Update Progress: 317/2369 symbols completed. BNY took 18.5s. Estimated remaining: 4h 55m 27s. Rate: 6.9 symbols/min [2025-09-17T02:29:45.484232] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:29:45.492157] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-17T02:29:45.499928] [DEBUG] [LOCAL ] BOC: Loaded 13393 existing records from primary storage. [2025-09-17T02:29:45.500052] [INFO ] [MAIN ] BOC: Loaded 13393 existing records. [2025-09-17T02:29:45.679801] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:29:45.680073] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-17T02:29:45.680126] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-17T02:29:45.680588] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-17T02:29:45.680680] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-17T02:29:45.965637] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T02:29:46.049218] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:29:46.151724] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T02:29:46.290089] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-17T02:29:47.090165] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-11. [2025-09-17T02:29:47.890186] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-17T02:29:48.083469] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:29:48.146958] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T02:29:48.511461] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T02:29:48.690177] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-17T02:29:49.490138] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-17T02:29:49.795717] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:29:50.290158] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-17T02:29:51.090185] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-17T02:29:51.109137] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T02:29:51.392451] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T02:29:51.508737] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T02:29:51.890138] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-17T02:29:52.690177] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-17T02:29:53.265283] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T02:29:53.490140] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-17T02:29:53.684449] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T02:29:54.290377] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-17T02:29:54.336419] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T02:29:55.090139] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-17T02:29:55.890116] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-17T02:29:56.077895] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T02:29:56.124209] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T02:29:56.194372] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-17T02:29:56.690161] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-17T02:29:57.460878] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T02:29:57.490104] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-17T02:29:58.080446] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T02:29:58.290139] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-17T02:29:58.595307] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-17T02:29:59.090131] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-17T02:29:59.428466] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T02:29:59.429684] [INFO ] [REMOTE ] BNT: Full fetch complete (4495 records). [2025-09-17T02:29:59.429766] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-17T02:29:59.797086] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-17T02:29:59.797212] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-17T02:29:59.797363] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-17T02:29:59.797410] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-17T02:29:59.797821] [DEBUG] [LOCAL ] BNT: Trimmed 4495 records to 3333 (keeping 200 days of data) [2025-09-17T02:29:59.821114] [DEBUG] [LOCAL ] BNT: Primary data saved (3333 records). [2025-09-17T02:29:59.821198] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-17T02:29:59.821276] [INFO ] [MAIN ] Update Progress: 318/2369 symbols completed. BNT took 34.2s. Estimated remaining: 4h 55m 56s. Rate: 6.9 symbols/min [2025-09-17T02:29:59.890151] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-17T02:30:00.690174] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-17T02:30:00.859349] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T02:30:01.490194] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-17T02:30:02.894982] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-17T02:30:02.907439] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-17T02:30:03.268979] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T02:30:03.273341] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-17T02:30:05.910848] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-17T02:30:05.915881] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-17T02:30:06.101069] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (3.19 seconds). [2025-09-17T02:30:06.107974] [INFO ] [REMOTE ] BNS: Full fetch complete (74072 records). [2025-09-17T02:30:06.108175] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-17T02:30:06.548155] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-17T02:30:06.548294] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-17T02:30:06.549325] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-17T02:30:06.549403] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-17T02:30:06.551447] [DEBUG] [LOCAL ] BNS: Trimmed 74072 records to 51521 (keeping 200 days of data) [2025-09-17T02:30:06.876252] [DEBUG] [LOCAL ] BNS: Primary data saved (51521 records). [2025-09-17T02:30:06.876587] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-17T02:30:06.876763] [INFO ] [MAIN ] Update Progress: 319/2369 symbols completed. BNS took 49.3s. Estimated remaining: 4h 55m 37s. Rate: 6.9 symbols/min [2025-09-17T02:30:06.894830] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T02:30:06.902108] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-17T02:30:07.885135] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T02:30:07.889572] [INFO ] [REMOTE ] BOC: Full fetch complete (25721 records). [2025-09-17T02:30:07.889922] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-17T02:30:08.267033] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-17T02:30:08.267138] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-17T02:30:08.267555] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-17T02:30:08.267617] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-17T02:30:08.268267] [DEBUG] [LOCAL ] BOC: Trimmed 25721 records to 18393 (keeping 200 days of data) [2025-09-17T02:30:08.375895] [DEBUG] [LOCAL ] BOC: Primary data saved (18393 records). [2025-09-17T02:30:08.376061] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-17T02:30:08.376154] [INFO ] [MAIN ] Update Progress: 320/2369 symbols completed. BOC took 23.1s. Estimated remaining: 4h 54m 43s. Rate: 7.0 symbols/min [2025-09-17T02:30:09.096386] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:09.112780] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:09.106241] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:09.171689] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:09.187610] [DEBUG] [LOCAL ] BOE: Loaded 11979 existing records from primary storage. [2025-09-17T02:30:09.187891] [INFO ] [MAIN ] BOE: Loaded 11979 existing records. [2025-09-17T02:30:09.349077] [DEBUG] [LOCAL ] BOOT: Loaded 29529 existing records from primary storage. [2025-09-17T02:30:09.349437] [DEBUG] [LOCAL ] BOND: Loaded 23774 existing records from primary storage. [2025-09-17T02:30:09.370314] [INFO ] [MAIN ] BOOT: Loaded 29529 existing records. [2025-09-17T02:30:09.370707] [DEBUG] [LOCAL ] BOH: Loaded 22048 existing records from primary storage. [2025-09-17T02:30:09.400240] [INFO ] [MAIN ] BOND: Loaded 23774 existing records. [2025-09-17T02:30:09.414469] [INFO ] [MAIN ] BOH: Loaded 22048 existing records. [2025-09-17T02:30:09.733553] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:09.802092] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-17T02:30:09.877601] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-17T02:30:09.882719] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:09.924245] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-17T02:30:09.924377] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-17T02:30:09.977162] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-17T02:30:09.996839] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-17T02:30:10.054428] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:10.054309] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-17T02:30:10.089606] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:10.105143] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-17T02:30:10.111489] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-17T02:30:10.134075] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-17T02:30:10.116993] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-17T02:30:10.147144] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-17T02:30:10.175998] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-17T02:30:10.243335] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-17T02:30:10.232027] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-17T02:30:10.264219] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-17T02:30:11.165312] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:11.268451] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-11. [2025-09-17T02:30:11.393704] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:11.417254] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:11.417761] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-11. [2025-09-17T02:30:11.418272] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-11. [2025-09-17T02:30:11.498287] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:11.498578] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-11. [2025-09-17T02:30:12.535090] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T02:30:12.542447] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-17T02:30:12.844938] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:30:12.851578] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-17T02:30:12.929194] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:30:12.938550] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-17T02:30:13.150818] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T02:30:13.159748] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-17T02:30:13.641912] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T02:30:13.647359] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-17T02:30:13.820633] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T02:30:13.827464] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-17T02:30:13.876319] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T02:30:13.882428] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-17T02:30:15.067163] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T02:30:15.075515] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-17T02:30:15.089616] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T02:30:15.095019] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-17T02:30:15.753507] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T02:30:15.890144] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-17T02:30:16.017349] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T02:30:16.501424] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:30:16.690205] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-17T02:30:16.949154] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:30:17.490197] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-17T02:30:17.557713] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T02:30:17.679509] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-17T02:30:18.290142] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-17T02:30:18.928147] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T02:30:19.095225] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-17T02:30:19.098434] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T02:30:19.890169] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-17T02:30:20.598387] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T02:30:20.690101] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-17T02:30:21.000552] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T02:30:21.490187] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-17T02:30:22.295263] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-17T02:30:22.311286] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T02:30:22.960268] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T02:30:23.090117] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-17T02:30:23.667518] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:30:23.890173] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-17T02:30:24.428804] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T02:30:24.690185] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-17T02:30:25.490192] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-17T02:30:25.604741] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T02:30:25.652227] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T02:30:26.290083] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-17T02:30:26.682541] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T02:30:27.090135] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-17T02:30:27.890169] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-17T02:30:28.393746] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T02:30:28.517135] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T02:30:28.690164] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-17T02:30:28.859100] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T02:30:29.490155] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-17T02:30:30.173972] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T02:30:30.222073] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T02:30:30.290152] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-17T02:30:31.090198] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-17T02:30:31.738111] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T02:30:31.890174] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-17T02:30:32.518899] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T02:30:32.690169] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-17T02:30:33.317518] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T02:30:33.490212] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-17T02:30:33.978927] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T02:30:34.290207] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-17T02:30:34.526504] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T02:30:35.090191] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-17T02:30:35.816866] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T02:30:35.890096] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-17T02:30:36.464145] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:30:36.690159] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-17T02:30:37.214445] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T02:30:37.219004] [INFO ] [REMOTE ] BOOT: Full fetch complete (60556 records). [2025-09-17T02:30:37.219183] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-17T02:30:37.499022] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-17T02:30:37.624323] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-17T02:30:37.624458] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-17T02:30:37.625285] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-17T02:30:37.625355] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-17T02:30:37.626818] [DEBUG] [LOCAL ] BOOT: Trimmed 60556 records to 41539 (keeping 200 days of data) [2025-09-17T02:30:37.864939] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:30:37.910357] [DEBUG] [LOCAL ] BOOT: Primary data saved (41539 records). [2025-09-17T02:30:37.910539] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-17T02:30:37.910713] [INFO ] [MAIN ] Update Progress: 321/2369 symbols completed. BOOT took 29.5s. Estimated remaining: 4h 56m 47s. Rate: 6.9 symbols/min [2025-09-17T02:30:38.083590] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:38.120986] [DEBUG] [LOCAL ] BORR: Loaded 38074 existing records from primary storage. [2025-09-17T02:30:38.121169] [INFO ] [MAIN ] BORR: Loaded 38074 existing records. [2025-09-17T02:30:38.295355] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-17T02:30:38.300610] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:38.301624] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-17T02:30:38.301717] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-17T02:30:38.302670] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-17T02:30:38.302744] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-17T02:30:38.630795] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:30:38.688180] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:39.090129] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-17T02:30:39.269187] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T02:30:39.274188] [INFO ] [REMOTE ] BOH: Full fetch complete (44446 records). [2025-09-17T02:30:39.274311] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-17T02:30:39.664071] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-17T02:30:39.664182] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-17T02:30:39.664891] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-17T02:30:39.664982] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-17T02:30:39.666039] [DEBUG] [LOCAL ] BOH: Trimmed 44446 records to 31453 (keeping 200 days of data) [2025-09-17T02:30:39.863283] [DEBUG] [LOCAL ] BOH: Primary data saved (31453 records). [2025-09-17T02:30:39.864183] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-17T02:30:39.864301] [INFO ] [MAIN ] Update Progress: 322/2369 symbols completed. BOH took 31.5s. Estimated remaining: 4h 55m 56s. Rate: 6.9 symbols/min [2025-09-17T02:30:39.895321] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-11. [2025-09-17T02:30:40.042024] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:40.058774] [DEBUG] [LOCAL ] BOW: Loaded 16305 existing records from primary storage. [2025-09-17T02:30:40.058921] [INFO ] [MAIN ] BOW: Loaded 16305 existing records. [2025-09-17T02:30:40.252389] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:40.252815] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-17T02:30:40.252975] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-17T02:30:40.258688] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-17T02:30:40.264862] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-17T02:30:40.270959] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T02:30:40.358469] [INFO ] [REMOTE ] BOND: Full fetch complete (46011 records). [2025-09-17T02:30:40.377820] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-17T02:30:40.708465] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-17T02:30:40.936263] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:41.018515] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-17T02:30:41.018620] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-17T02:30:41.019183] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-17T02:30:41.019238] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-17T02:30:41.020363] [DEBUG] [LOCAL ] BOND: Trimmed 46011 records to 32137 (keeping 200 days of data) [2025-09-17T02:30:41.231966] [DEBUG] [LOCAL ] BOND: Primary data saved (32137 records). [2025-09-17T02:30:41.232168] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-17T02:30:41.232355] [INFO ] [MAIN ] Update Progress: 323/2369 symbols completed. BOND took 32.9s. Estimated remaining: 4h 55m 1s. Rate: 6.9 symbols/min [2025-09-17T02:30:41.410877] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:41.459861] [DEBUG] [LOCAL ] BOX: Loaded 37385 existing records from primary storage. [2025-09-17T02:30:41.460040] [INFO ] [MAIN ] BOX: Loaded 37385 existing records. [2025-09-17T02:30:41.502627] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-11. [2025-09-17T02:30:41.638940] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:41.639228] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-17T02:30:41.639289] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-17T02:30:41.640136] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-17T02:30:41.640197] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-17T02:30:41.822679] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T02:30:41.928705] [INFO ] [REMOTE ] BOE: Full fetch complete (26687 records). [2025-09-17T02:30:41.934342] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-17T02:30:42.060794] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:42.218689] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-11 (2.32 seconds). [2025-09-17T02:30:42.297850] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-17T02:30:42.426498] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-17T02:30:42.426604] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-17T02:30:42.427136] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-17T02:30:42.427210] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-17T02:30:42.428528] [DEBUG] [LOCAL ] BOE: Trimmed 26687 records to 17559 (keeping 200 days of data) [2025-09-17T02:30:42.542629] [DEBUG] [LOCAL ] BOE: Primary data saved (17559 records). [2025-09-17T02:30:42.542854] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-17T02:30:42.543010] [INFO ] [MAIN ] Update Progress: 324/2369 symbols completed. BOE took 34.2s. Estimated remaining: 4h 54m 6s. Rate: 7.0 symbols/min [2025-09-17T02:30:42.715825] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:30:42.763926] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T02:30:42.782213] [DEBUG] [LOCAL ] BP: Loaded 40061 existing records from primary storage. [2025-09-17T02:30:42.782396] [INFO ] [MAIN ] BP: Loaded 40061 existing records. [2025-09-17T02:30:42.956956] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:30:42.957210] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-17T02:30:42.957300] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-17T02:30:42.958317] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-17T02:30:42.958394] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-17T02:30:43.096059] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-11. [2025-09-17T02:30:43.313245] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:30:43.890189] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-11. [2025-09-17T02:30:44.382750] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T02:30:44.698988] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-17T02:30:44.702531] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T02:30:45.490179] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-17T02:30:46.087617] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-17T02:30:46.290254] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-17T02:30:46.522767] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:30:46.891731] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T02:30:47.090139] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-17T02:30:47.363400] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T02:30:47.890129] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-17T02:30:48.659251] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:30:48.690091] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-17T02:30:49.490146] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-17T02:30:50.096136] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-17T02:30:50.300580] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-17T02:30:50.305672] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T02:30:51.090146] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-17T02:30:51.261913] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T02:30:51.890144] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-17T02:30:52.108402] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T02:30:52.690188] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-17T02:30:52.827495] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T02:30:52.846987] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T02:30:53.490135] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-17T02:30:54.290125] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-17T02:30:54.661879] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T02:30:55.090142] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-17T02:30:55.238979] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T02:30:55.311694] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T02:30:55.890133] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-17T02:30:56.690140] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-17T02:30:56.825550] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:30:57.291022] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T02:30:57.490164] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-17T02:30:58.291110] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-17T02:30:58.297757] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T02:30:58.822815] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T02:30:59.090130] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-17T02:30:59.890150] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-17T02:31:00.404630] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-17T02:31:00.591388] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T02:31:00.690131] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-17T02:31:01.331977] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T02:31:01.490134] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-17T02:31:02.290144] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-17T02:31:03.079213] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T02:31:03.090495] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-17T02:31:03.286886] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T02:31:03.733204] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T02:31:03.890103] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-17T02:31:04.264596] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T02:31:04.690121] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-17T02:31:05.490109] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-17T02:31:05.781215] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T02:31:05.810168] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T02:31:06.290120] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-17T02:31:07.090142] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-17T02:31:07.662536] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T02:31:07.890120] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-17T02:31:08.156476] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:31:08.502724] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T02:31:08.690117] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-17T02:31:09.490142] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-17T02:31:10.124405] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-17T02:31:10.290133] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-17T02:31:10.444980] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T02:31:10.451434] [INFO ] [REMOTE ] BORR: Full fetch complete (74674 records). [2025-09-17T02:31:10.451622] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-17T02:31:10.854328] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-17T02:31:10.854435] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-17T02:31:10.855250] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-17T02:31:10.855317] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-17T02:31:10.856804] [DEBUG] [LOCAL ] BORR: Trimmed 74674 records to 51200 (keeping 200 days of data) [2025-09-17T02:31:11.095786] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-17T02:31:11.163550] [DEBUG] [LOCAL ] BORR: Primary data saved (51200 records). [2025-09-17T02:31:11.163744] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-17T02:31:11.163858] [INFO ] [MAIN ] Update Progress: 325/2369 symbols completed. BORR took 33.3s. Estimated remaining: 4h 56m 3s. Rate: 6.9 symbols/min [2025-09-17T02:31:11.339370] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:11.372910] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T02:31:11.402577] [DEBUG] [LOCAL ] BR: Loaded 25280 existing records from primary storage. [2025-09-17T02:31:11.402777] [INFO ] [MAIN ] BR: Loaded 25280 existing records. [2025-09-17T02:31:11.581091] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:11.581380] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-17T02:31:11.581440] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-17T02:31:11.582213] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-17T02:31:11.582277] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-17T02:31:11.900229] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-17T02:31:11.941608] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:11.954886] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T02:31:12.141158] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T02:31:12.690157] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-11. [2025-09-17T02:31:13.490170] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-17T02:31:13.587280] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T02:31:13.596332] [INFO ] [REMOTE ] BOX: Full fetch complete (71987 records). [2025-09-17T02:31:13.596614] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-17T02:31:14.006423] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-17T02:31:14.006530] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-17T02:31:14.007304] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-17T02:31:14.007359] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-17T02:31:14.008872] [DEBUG] [LOCAL ] BOX: Trimmed 71987 records to 50349 (keeping 200 days of data) [2025-09-17T02:31:14.243716] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T02:31:14.302730] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-17T02:31:14.338795] [DEBUG] [LOCAL ] BOX: Primary data saved (50349 records). [2025-09-17T02:31:14.338939] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-17T02:31:14.339042] [INFO ] [MAIN ] Update Progress: 326/2369 symbols completed. BOX took 33.1s. Estimated remaining: 4h 55m 20s. Rate: 6.9 symbols/min [2025-09-17T02:31:14.543492] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:14.580188] [DEBUG] [LOCAL ] BRBR: Loaded 38872 existing records from primary storage. [2025-09-17T02:31:14.580380] [INFO ] [MAIN ] BRBR: Loaded 38872 existing records. [2025-09-17T02:31:14.759213] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:14.759451] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-17T02:31:14.759501] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-17T02:31:14.760356] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-17T02:31:14.760418] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-17T02:31:15.091827] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-17T02:31:15.113115] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:15.179615] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T02:31:15.570078] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T02:31:15.890133] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-11. [2025-09-17T02:31:16.279125] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T02:31:16.690150] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-17T02:31:17.109300] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T02:31:17.490162] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-17T02:31:18.290178] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-17T02:31:18.345375] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T02:31:18.351952] [INFO ] [REMOTE ] BP: Full fetch complete (77650 records). [2025-09-17T02:31:18.352136] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-17T02:31:18.752760] [DEBUG] [VALIDATOR ] BP: All expected trading days are present. [2025-09-17T02:31:18.752885] [DEBUG] [VALIDATOR ] BP: Primary data validation passed. [2025-09-17T02:31:18.753827] [INFO ] [MAIN ] BP: Fetched primary data is valid. [2025-09-17T02:31:18.753900] [DEBUG] [LOCAL ] BP: Saving primary data. [2025-09-17T02:31:18.755522] [DEBUG] [LOCAL ] BP: Trimmed 77650 records to 53711 (keeping 200 days of data) [2025-09-17T02:31:18.991923] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T02:31:19.013091] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T02:31:19.013850] [INFO ] [REMOTE ] BOW: Full fetch complete (31040 records). [2025-09-17T02:31:19.020776] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-17T02:31:19.093371] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-17T02:31:19.425561] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-17T02:31:19.428076] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-17T02:31:19.428889] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-17T02:31:19.465045] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-17T02:31:19.496451] [DEBUG] [LOCAL ] BOW: Trimmed 31040 records to 23758 (keeping 200 days of data) [2025-09-17T02:31:19.606404] [DEBUG] [LOCAL ] BP: Primary data saved (53711 records). [2025-09-17T02:31:19.608246] [INFO ] [MAIN ] BP: Full history saved. [2025-09-17T02:31:19.610617] [INFO ] [MAIN ] Update Progress: 327/2369 symbols completed. BP took 37.1s. Estimated remaining: 4h 54m 50s. Rate: 6.9 symbols/min [2025-09-17T02:31:19.806517] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:19.842904] [DEBUG] [LOCAL ] BRC: Loaded 13406 existing records from primary storage. [2025-09-17T02:31:19.842616] [DEBUG] [LOCAL ] BOW: Primary data saved (23758 records). [2025-09-17T02:31:19.843053] [INFO ] [MAIN ] BRC: Loaded 13406 existing records. [2025-09-17T02:31:19.843095] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-17T02:31:19.897364] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-17T02:31:19.911191] [INFO ] [MAIN ] Update Progress: 328/2369 symbols completed. BOW took 40.0s. Estimated remaining: 4h 53m 49s. Rate: 6.9 symbols/min [2025-09-17T02:31:20.142892] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:20.177870] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-17T02:31:20.195752] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:20.195843] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-17T02:31:20.195951] [DEBUG] [LOCAL ] BRCC: No existing data file found in primary storage. [2025-09-17T02:31:20.196097] [WARN ] [MAIN ] BRCC: No existing data found, performing full refresh instead. [2025-09-17T02:31:20.196211] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-17T02:31:20.196258] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-17T02:31:20.196307] [DEBUG] [LOCAL ] BRCC: No primary data file found to delete. [2025-09-17T02:31:20.196346] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-17T02:31:20.227317] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-17T02:31:20.270630] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-17T02:31:20.810585] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:20.831320] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-11. [2025-09-17T02:31:20.912113] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:20.938336] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T02:31:21.159263] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T02:31:21.490181] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-11. [2025-09-17T02:31:22.290113] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-17T02:31:22.552340] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T02:31:22.613353] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T02:31:23.090193] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-17T02:31:23.792011] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T02:31:23.890200] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-17T02:31:24.243380] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:31:24.690191] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-17T02:31:25.425056] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T02:31:25.490309] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-17T02:31:25.898837] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T02:31:26.290185] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-17T02:31:26.972073] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T02:31:27.090209] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-17T02:31:27.836325] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T02:31:27.890189] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-17T02:31:28.132102] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T02:31:28.690237] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-17T02:31:29.241246] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T02:31:29.490149] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-17T02:31:30.290142] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-17T02:31:30.476408] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T02:31:30.821471] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T02:31:31.090201] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-17T02:31:31.465301] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T02:31:31.890212] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-17T02:31:32.193901] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T02:31:32.690191] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-17T02:31:33.490164] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-17T02:31:34.290159] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-17T02:31:38.171039] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (5.48 seconds). [2025-09-17T02:31:38.177084] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-17T02:31:38.352681] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (4.06 seconds). [2025-09-17T02:31:38.361732] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-17T02:31:38.538098] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (5.05 seconds). [2025-09-17T02:31:38.548793] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-17T02:31:38.979915] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (7.09 seconds). [2025-09-17T02:31:38.990272] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-17T02:31:39.032427] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T02:31:39.037663] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-17T02:31:39.873049] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T02:31:39.880952] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-17T02:31:39.926028] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T02:31:39.930841] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-17T02:31:40.090625] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T02:31:40.359327] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:31:40.690192] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-17T02:31:41.137148] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T02:31:41.349493] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T02:31:41.490140] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-17T02:31:42.076942] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T02:31:42.290161] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-17T02:31:43.087741] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T02:31:43.095764] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-17T02:31:43.856173] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T02:31:43.890076] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-17T02:31:44.115722] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T02:31:44.690167] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-17T02:31:44.854043] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T02:31:45.490140] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-17T02:31:46.276503] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T02:31:46.290079] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-17T02:31:46.367351] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T02:31:46.370038] [INFO ] [REMOTE ] BRC: Full fetch complete (29239 records). [2025-09-17T02:31:46.370127] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-17T02:31:46.752404] [DEBUG] [VALIDATOR ] BRC: All expected trading days are present. [2025-09-17T02:31:46.752506] [DEBUG] [VALIDATOR ] BRC: Primary data validation passed. [2025-09-17T02:31:46.752931] [INFO ] [MAIN ] BRC: Fetched primary data is valid. [2025-09-17T02:31:46.752987] [DEBUG] [LOCAL ] BRC: Saving primary data. [2025-09-17T02:31:46.753795] [DEBUG] [LOCAL ] BRC: Trimmed 29239 records to 19870 (keeping 200 days of data) [2025-09-17T02:31:46.876859] [DEBUG] [LOCAL ] BRC: Primary data saved (19870 records). [2025-09-17T02:31:46.877041] [INFO ] [MAIN ] BRC: Full history saved. [2025-09-17T02:31:46.877140] [INFO ] [MAIN ] Update Progress: 329/2369 symbols completed. BRC took 27.3s. Estimated remaining: 4h 55m 34s. Rate: 6.9 symbols/min [2025-09-17T02:31:47.056968] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:47.087014] [DEBUG] [LOCAL ] BRFS: Loaded 30222 existing records from primary storage. [2025-09-17T02:31:47.087183] [INFO ] [MAIN ] BRFS: Loaded 30222 existing records. [2025-09-17T02:31:47.098361] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-17T02:31:47.273850] [WARN ] [MAIN ] BRFS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:47.274135] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-17T02:31:47.274207] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-17T02:31:47.275036] [DEBUG] [LOCAL ] BRFS: Deleted primary data file. [2025-09-17T02:31:47.275113] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-17T02:31:47.635065] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:47.890182] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2024-11. [2025-09-17T02:31:47.941789] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T02:31:48.690128] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-17T02:31:49.102255] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T02:31:49.490140] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-17T02:31:49.602657] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T02:31:50.249462] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T02:31:50.290142] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2024-12. [2025-09-17T02:31:50.722689] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:31:50.729439] [INFO ] [REMOTE ] BR: Full fetch complete (48512 records). [2025-09-17T02:31:50.729635] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-17T02:31:51.095273] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-17T02:31:51.146430] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-17T02:31:51.146531] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-17T02:31:51.147152] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-17T02:31:51.147215] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-17T02:31:51.148555] [DEBUG] [LOCAL ] BR: Trimmed 48512 records to 34763 (keeping 200 days of data) [2025-09-17T02:31:51.375375] [DEBUG] [LOCAL ] BR: Primary data saved (34763 records). [2025-09-17T02:31:51.375557] [INFO ] [MAIN ] BR: Full history saved. [2025-09-17T02:31:51.375668] [INFO ] [MAIN ] Update Progress: 330/2369 symbols completed. BR took 40.2s. Estimated remaining: 4h 54m 60s. Rate: 6.9 symbols/min [2025-09-17T02:31:51.558172] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:51.589775] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T02:31:51.633106] [DEBUG] [LOCAL ] BRO: Loaded 38727 existing records from primary storage. [2025-09-17T02:31:51.633287] [INFO ] [MAIN ] BRO: Loaded 38727 existing records. [2025-09-17T02:31:51.810036] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:51.810326] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-17T02:31:51.810387] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-17T02:31:51.811479] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-17T02:31:51.811545] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-17T02:31:51.895293] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-17T02:31:52.173346] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:52.357947] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T02:31:52.363550] [INFO ] [REMOTE ] BRCC: Full fetch complete (57738 records). [2025-09-17T02:31:52.363712] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-17T02:31:52.698154] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-11. [2025-09-17T02:31:52.751477] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-17T02:31:52.751585] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-17T02:31:52.752247] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-17T02:31:52.752306] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-17T02:31:52.753774] [DEBUG] [LOCAL ] BRCC: Trimmed 57738 records to 40368 (keeping 200 days of data) [2025-09-17T02:31:52.995500] [DEBUG] [LOCAL ] BRCC: Primary data saved (40368 records). [2025-09-17T02:31:52.995694] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-17T02:31:52.995792] [INFO ] [MAIN ] Update Progress: 331/2369 symbols completed. BRCC took 33.1s. Estimated remaining: 4h 54m 7s. Rate: 6.9 symbols/min [2025-09-17T02:31:53.173917] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:53.221126] [DEBUG] [LOCAL ] BROS: Loaded 39721 existing records from primary storage. [2025-09-17T02:31:53.221309] [INFO ] [MAIN ] BROS: Loaded 39721 existing records. [2025-09-17T02:31:53.403544] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:31:53.403805] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-17T02:31:53.403864] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-17T02:31:53.404921] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-17T02:31:53.404992] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-17T02:31:53.500327] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-01. [2025-09-17T02:31:53.790094] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:53.806908] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T02:31:53.813600] [INFO ] [REMOTE ] BRBR: Full fetch complete (71365 records). [2025-09-17T02:31:53.813793] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-17T02:31:54.211955] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-17T02:31:54.212199] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-17T02:31:54.213038] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-17T02:31:54.213192] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-17T02:31:54.214988] [DEBUG] [LOCAL ] BRBR: Trimmed 71365 records to 51173 (keeping 200 days of data) [2025-09-17T02:31:54.299844] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-11. [2025-09-17T02:31:54.331695] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:31:54.562569] [DEBUG] [LOCAL ] BRBR: Primary data saved (51173 records). [2025-09-17T02:31:54.562816] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-17T02:31:54.562972] [INFO ] [MAIN ] Update Progress: 332/2369 symbols completed. BRBR took 40.2s. Estimated remaining: 4h 53m 15s. Rate: 6.9 symbols/min [2025-09-17T02:31:54.734768] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:31:54.734998] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-17T02:31:54.735061] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-17T02:31:54.735193] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-17T02:31:54.735252] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-17T02:31:54.735318] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-17T02:31:54.735372] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-17T02:31:55.094071] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:31:55.094208] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-17T02:31:55.123465] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T02:31:55.895221] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-11. [2025-09-17T02:31:55.912249] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T02:31:56.166817] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:31:56.167181] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-11 [2025-09-17T02:31:56.690201] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-17T02:31:56.807203] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T02:31:56.908041] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:31:56.908375] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-17T02:31:57.490142] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-17T02:31:57.724824] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:31:57.725168] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-17T02:31:58.290140] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-17T02:31:59.090231] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-17T02:31:59.890182] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-17T02:32:00.275616] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T02:32:00.459132] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T02:32:00.690190] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-17T02:32:01.152668] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T02:32:01.490136] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-17T02:32:02.290141] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-17T02:32:02.455530] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T02:32:03.090126] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-17T02:32:03.442980] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T02:32:03.598712] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T02:32:03.890185] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-17T02:32:04.114007] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:32:04.114339] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-17T02:32:04.582097] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T02:32:04.690090] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-17T02:32:05.490130] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-17T02:32:05.718496] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:32:05.718847] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-17T02:32:06.290125] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-17T02:32:06.620715] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T02:32:07.090126] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-17T02:32:07.313171] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:32:07.313799] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-17T02:32:07.901034] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-17T02:32:07.906051] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T02:32:08.690170] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-17T02:32:09.490180] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-17T02:32:09.719018] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:32:09.719618] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-17T02:32:09.820352] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T02:32:10.290179] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-17T02:32:10.500401] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T02:32:11.090193] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-17T02:32:11.890249] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-17T02:32:11.967242] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T02:32:12.114555] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:32:12.114929] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-17T02:32:12.690137] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-17T02:32:12.767411] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T02:32:13.490181] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-17T02:32:14.290201] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-17T02:32:14.590423] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T02:32:15.090143] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-17T02:32:15.568188] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T02:32:15.603407] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T02:32:15.890130] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-17T02:32:16.690123] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-17T02:32:16.868718] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T02:32:17.490141] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-17T02:32:18.033564] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T02:32:18.213917] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T02:32:18.290149] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-17T02:32:18.987614] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T02:32:18.994371] [INFO ] [REMOTE ] BRSL: Full fetch complete (19399 records). [2025-09-17T02:32:18.994546] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-17T02:32:19.097301] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-17T02:32:19.198466] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 53 unique days, need 200 days [2025-09-17T02:32:19.198784] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:32:19.198850] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:32:19.198895] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-17T02:32:19.198993] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-17T02:32:19.199039] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-17T02:32:19.199094] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-17T02:32:19.199164] [INFO ] [MAIN ] Update Progress: 333/2369 symbols completed. BRSL took 24.6s. Estimated remaining: 4h 54m 44s. Rate: 6.9 symbols/min [2025-09-17T02:32:19.367364] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:19.392378] [DEBUG] [LOCAL ] BRSP: Loaded 26482 existing records from primary storage. [2025-09-17T02:32:19.392546] [INFO ] [MAIN ] BRSP: Loaded 26482 existing records. [2025-09-17T02:32:19.585316] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:32:19.585756] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-17T02:32:19.585938] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-17T02:32:19.594883] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-17T02:32:19.610689] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-17T02:32:19.661350] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:32:19.895225] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-17T02:32:19.983620] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:20.690104] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-11. [2025-09-17T02:32:20.780109] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T02:32:21.166041] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T02:32:21.170563] [INFO ] [REMOTE ] BRFS: Full fetch complete (60825 records). [2025-09-17T02:32:21.170722] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-17T02:32:21.495211] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-17T02:32:21.580358] [DEBUG] [VALIDATOR ] BRFS: All expected trading days are present. [2025-09-17T02:32:21.580458] [DEBUG] [VALIDATOR ] BRFS: Primary data validation passed. [2025-09-17T02:32:21.581181] [INFO ] [MAIN ] BRFS: Fetched primary data is valid. [2025-09-17T02:32:21.581257] [DEBUG] [LOCAL ] BRFS: Saving primary data. [2025-09-17T02:32:21.582704] [DEBUG] [LOCAL ] BRFS: Trimmed 60825 records to 41078 (keeping 200 days of data) [2025-09-17T02:32:21.821371] [DEBUG] [LOCAL ] BRFS: Primary data saved (41078 records). [2025-09-17T02:32:21.821565] [INFO ] [MAIN ] BRFS: Full history saved. [2025-09-17T02:32:21.821699] [INFO ] [MAIN ] Update Progress: 334/2369 symbols completed. BRFS took 34.9s. Estimated remaining: 4h 53m 59s. Rate: 6.9 symbols/min [2025-09-17T02:32:21.994177] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:21.999526] [DEBUG] [LOCAL ] BRT: Loaded 3507 existing records from primary storage. [2025-09-17T02:32:21.999628] [INFO ] [MAIN ] BRT: Loaded 3507 existing records. [2025-09-17T02:32:22.183241] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:32:22.183604] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-17T02:32:22.183712] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-17T02:32:22.184231] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-17T02:32:22.200056] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-17T02:32:22.248812] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T02:32:22.295176] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-17T02:32:22.578703] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:23.090136] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-11. [2025-09-17T02:32:23.711146] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-17T02:32:23.832633] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T02:32:23.890098] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-17T02:32:23.939547] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T02:32:24.690177] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-17T02:32:25.312090] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T02:32:25.490139] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-17T02:32:25.848894] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T02:32:26.290144] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-17T02:32:27.090190] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-17T02:32:27.621942] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T02:32:27.732734] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T02:32:27.890131] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-17T02:32:28.171946] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T02:32:28.236164] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T02:32:28.690175] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-17T02:32:29.490166] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-17T02:32:30.098990] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T02:32:30.290132] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-17T02:32:30.607307] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T02:32:30.614258] [INFO ] [REMOTE ] BROS: Full fetch complete (76795 records). [2025-09-17T02:32:30.614451] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-17T02:32:31.029909] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-17T02:32:31.030591] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T02:32:31.030672] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-17T02:32:31.033550] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-17T02:32:31.033664] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-17T02:32:31.035177] [DEBUG] [LOCAL ] BROS: Trimmed 76795 records to 53282 (keeping 200 days of data) [2025-09-17T02:32:31.096820] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-17T02:32:31.391898] [DEBUG] [LOCAL ] BROS: Primary data saved (53282 records). [2025-09-17T02:32:31.392098] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-17T02:32:31.392204] [INFO ] [MAIN ] Update Progress: 335/2369 symbols completed. BROS took 38.4s. Estimated remaining: 4h 53m 56s. Rate: 6.9 symbols/min [2025-09-17T02:32:31.561053] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:31.575618] [DEBUG] [LOCAL ] BRW: Loaded 14443 existing records from primary storage. [2025-09-17T02:32:31.575801] [INFO ] [MAIN ] BRW: Loaded 14443 existing records. [2025-09-17T02:32:31.750952] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:32:31.751213] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-17T02:32:31.751289] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-17T02:32:31.751909] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-17T02:32:31.751984] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-17T02:32:31.895215] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-17T02:32:32.137975] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:32.670342] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:32:32.677022] [INFO ] [REMOTE ] BRO: Full fetch complete (73771 records). [2025-09-17T02:32:32.677178] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-17T02:32:32.695292] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-17T02:32:33.082225] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-17T02:32:33.082338] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-17T02:32:33.083121] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-17T02:32:33.083185] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-17T02:32:33.084740] [DEBUG] [LOCAL ] BRO: Trimmed 73771 records to 51909 (keeping 200 days of data) [2025-09-17T02:32:33.413438] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T02:32:33.441951] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T02:32:33.455735] [DEBUG] [LOCAL ] BRO: Primary data saved (51909 records). [2025-09-17T02:32:33.455890] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-17T02:32:33.455990] [INFO ] [MAIN ] Update Progress: 336/2369 symbols completed. BRO took 42.1s. Estimated remaining: 4h 53m 7s. Rate: 6.9 symbols/min [2025-09-17T02:32:33.499446] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-11. [2025-09-17T02:32:33.636245] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:33.636478] [DEBUG] [LOCAL ] BRX: No existing data file found in primary storage. [2025-09-17T02:32:33.636533] [WARN ] [MAIN ] BRX: No existing data found, performing full refresh instead. [2025-09-17T02:32:33.636728] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-17T02:32:33.636792] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-17T02:32:33.636846] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-09-17T02:32:33.636895] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-17T02:32:34.008987] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:34.223940] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T02:32:34.290081] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-17T02:32:34.743192] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T02:32:35.090177] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-17T02:32:35.589052] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T02:32:35.890121] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-11. [2025-09-17T02:32:36.690171] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-17T02:32:37.402099] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T02:32:37.490152] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-17T02:32:37.621833] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T02:32:37.908792] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T02:32:37.909973] [INFO ] [REMOTE ] BRT: Full fetch complete (6736 records). [2025-09-17T02:32:37.910070] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-17T02:32:38.293145] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-17T02:32:38.321210] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-17T02:32:38.322622] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-17T02:32:38.323121] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-17T02:32:38.323246] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-17T02:32:38.324409] [DEBUG] [LOCAL ] BRT: Trimmed 6736 records to 4783 (keeping 200 days of data) [2025-09-17T02:32:38.375741] [DEBUG] [LOCAL ] BRT: Primary data saved (4783 records). [2025-09-17T02:32:38.375995] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-17T02:32:38.376190] [INFO ] [MAIN ] Update Progress: 337/2369 symbols completed. BRT took 16.6s. Estimated remaining: 4h 52m 36s. Rate: 6.9 symbols/min [2025-09-17T02:32:38.665530] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:38.707593] [DEBUG] [LOCAL ] BSAC: Loaded 24383 existing records from primary storage. [2025-09-17T02:32:38.707889] [INFO ] [MAIN ] BSAC: Loaded 24383 existing records. [2025-09-17T02:32:39.000071] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:32:39.000410] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-17T02:32:39.000492] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-17T02:32:39.001328] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-17T02:32:39.002816] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-17T02:32:39.095862] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-17T02:32:39.480596] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:39.500433] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T02:32:39.890143] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-11. [2025-09-17T02:32:40.594002] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T02:32:40.690131] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-17T02:32:40.715058] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T02:32:41.490161] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-17T02:32:42.290115] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-17T02:32:42.382441] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T02:32:42.691809] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T02:32:43.090152] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-17T02:32:43.445250] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T02:32:43.890109] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-17T02:32:44.175339] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:32:44.690191] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-17T02:32:45.181792] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T02:32:45.490253] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-17T02:32:46.290157] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-17T02:32:46.338960] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T02:32:46.483922] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T02:32:47.040005] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T02:32:47.090154] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-17T02:32:47.890143] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-17T02:32:48.690143] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-17T02:32:48.734780] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T02:32:49.490119] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-17T02:32:49.549660] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T02:32:49.822672] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T02:32:50.290165] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-17T02:32:50.523265] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T02:32:51.090157] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-17T02:32:51.143404] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T02:32:51.890145] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-17T02:32:52.612225] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T02:32:52.690093] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-17T02:32:53.302441] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:32:53.490160] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-17T02:32:54.225256] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T02:32:54.290086] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-17T02:32:54.810218] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T02:32:55.090188] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-17T02:32:55.867738] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T02:32:55.890071] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-17T02:32:56.531326] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T02:32:56.690156] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-17T02:32:57.490133] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-17T02:32:57.607879] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T02:32:57.952496] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T02:32:57.957935] [INFO ] [REMOTE ] BRSP: Full fetch complete (53799 records). [2025-09-17T02:32:57.958115] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-17T02:32:58.207335] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T02:32:58.295215] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-17T02:32:58.377528] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-17T02:32:58.377634] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-17T02:32:58.378244] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-17T02:32:58.378323] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-17T02:32:58.379578] [DEBUG] [LOCAL ] BRSP: Trimmed 53799 records to 36992 (keeping 200 days of data) [2025-09-17T02:32:58.614375] [DEBUG] [LOCAL ] BRSP: Primary data saved (36992 records). [2025-09-17T02:32:58.614671] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-17T02:32:58.614846] [INFO ] [MAIN ] Update Progress: 338/2369 symbols completed. BRSP took 39.4s. Estimated remaining: 4h 53m 37s. Rate: 6.9 symbols/min [2025-09-17T02:32:58.788624] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:32:58.813870] [DEBUG] [LOCAL ] BSBR: Loaded 26737 existing records from primary storage. [2025-09-17T02:32:58.814025] [INFO ] [MAIN ] BSBR: Loaded 26737 existing records. [2025-09-17T02:32:58.989029] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:32:58.989276] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-17T02:32:58.989361] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-17T02:32:58.989988] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-17T02:32:58.990056] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-17T02:32:59.095245] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-17T02:32:59.348053] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:32:59.890180] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-11. [2025-09-17T02:33:00.065615] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T02:33:00.673476] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T02:33:00.690099] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-17T02:33:00.788474] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T02:33:01.490127] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-17T02:33:02.290139] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-17T02:33:02.711639] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T02:33:02.897696] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:33:03.090137] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-17T02:33:03.890128] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-17T02:33:04.690110] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-17T02:33:05.018332] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-17T02:33:05.044300] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T02:33:05.490085] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-17T02:33:05.610507] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T02:33:05.905726] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T02:33:06.290166] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-17T02:33:06.952376] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:33:07.090122] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-17T02:33:07.890124] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-17T02:33:08.019315] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T02:33:08.472084] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T02:33:08.690110] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-17T02:33:09.043590] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T02:33:09.490135] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-17T02:33:09.828781] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T02:33:09.836628] [INFO ] [REMOTE ] BRX: Full fetch complete (74825 records). [2025-09-17T02:33:09.836827] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-17T02:33:10.232867] [DEBUG] [VALIDATOR ] BRX: All expected trading days are present. [2025-09-17T02:33:10.232999] [DEBUG] [VALIDATOR ] BRX: Primary data validation passed. [2025-09-17T02:33:10.233790] [INFO ] [MAIN ] BRX: Fetched primary data is valid. [2025-09-17T02:33:10.233849] [DEBUG] [LOCAL ] BRX: Saving primary data. [2025-09-17T02:33:10.235367] [DEBUG] [LOCAL ] BRX: Trimmed 74825 records to 51877 (keeping 200 days of data) [2025-09-17T02:33:10.295703] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-17T02:33:10.564733] [DEBUG] [LOCAL ] BRX: Primary data saved (51877 records). [2025-09-17T02:33:10.564911] [INFO ] [MAIN ] BRX: Full history saved. [2025-09-17T02:33:10.565025] [INFO ] [MAIN ] Update Progress: 339/2369 symbols completed. BRX took 37.1s. Estimated remaining: 4h 53m 48s. Rate: 6.9 symbols/min [2025-09-17T02:33:10.734859] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:10.742960] [DEBUG] [LOCAL ] BSL: Loaded 5178 existing records from primary storage. [2025-09-17T02:33:10.743090] [INFO ] [MAIN ] BSL: Loaded 5178 existing records. [2025-09-17T02:33:10.922711] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:33:10.923121] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-17T02:33:10.923217] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-17T02:33:10.923627] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-17T02:33:10.923790] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-17T02:33:11.054029] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T02:33:11.095659] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-17T02:33:11.314830] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:11.751979] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T02:33:11.890100] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-17T02:33:12.167900] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T02:33:12.171725] [INFO ] [REMOTE ] BRW: Full fetch complete (29165 records). [2025-09-17T02:33:12.171870] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-17T02:33:12.552462] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-17T02:33:12.552573] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-17T02:33:12.553032] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-17T02:33:12.553089] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-17T02:33:12.553928] [DEBUG] [LOCAL ] BRW: Trimmed 29165 records to 18882 (keeping 200 days of data) [2025-09-17T02:33:12.671137] [DEBUG] [LOCAL ] BRW: Primary data saved (18882 records). [2025-09-17T02:33:12.671308] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-17T02:33:12.671411] [INFO ] [MAIN ] Update Progress: 340/2369 symbols completed. BRW took 41.3s. Estimated remaining: 4h 52m 60s. Rate: 6.9 symbols/min [2025-09-17T02:33:12.700184] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-17T02:33:12.846956] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:12.865390] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T02:33:12.892118] [DEBUG] [LOCAL ] BSM: Loaded 24221 existing records from primary storage. [2025-09-17T02:33:12.892284] [INFO ] [MAIN ] BSM: Loaded 24221 existing records. [2025-09-17T02:33:13.068079] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:33:13.068318] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-17T02:33:13.068369] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-17T02:33:13.069071] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-17T02:33:13.069134] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-17T02:33:13.423305] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:13.490114] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-11. [2025-09-17T02:33:14.112336] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T02:33:14.290164] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-17T02:33:14.877618] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T02:33:15.090142] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-17T02:33:15.848502] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T02:33:15.890083] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-17T02:33:16.690181] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-17T02:33:17.491805] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-11. [2025-09-17T02:33:17.494077] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-17T02:33:18.290180] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-17T02:33:18.463523] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-17T02:33:18.478893] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T02:33:18.510431] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T02:33:18.514793] [INFO ] [REMOTE ] BSAC: Full fetch complete (43434 records). [2025-09-17T02:33:18.514894] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-17T02:33:18.896505] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-17T02:33:18.896607] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-17T02:33:18.897149] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-17T02:33:18.897204] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-17T02:33:18.898249] [DEBUG] [LOCAL ] BSAC: Trimmed 43434 records to 33089 (keeping 200 days of data) [2025-09-17T02:33:19.090189] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-17T02:33:19.115217] [DEBUG] [LOCAL ] BSAC: Primary data saved (33089 records). [2025-09-17T02:33:19.115378] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-17T02:33:19.115472] [INFO ] [MAIN ] Update Progress: 341/2369 symbols completed. BSAC took 40.7s. Estimated remaining: 4h 52m 38s. Rate: 6.9 symbols/min [2025-09-17T02:33:19.300324] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:19.314471] [DEBUG] [LOCAL ] BST: Loaded 13342 existing records from primary storage. [2025-09-17T02:33:19.314609] [INFO ] [MAIN ] BST: Loaded 13342 existing records. [2025-09-17T02:33:19.493793] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:33:19.494135] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-17T02:33:19.494283] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-17T02:33:19.494922] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-17T02:33:19.495050] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-17T02:33:19.602806] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T02:33:19.874026] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:19.890099] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-17T02:33:20.505183] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T02:33:20.690101] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-17T02:33:21.382444] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T02:33:21.395847] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T02:33:21.490208] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-17T02:33:22.290186] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-17T02:33:22.817259] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T02:33:22.839105] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T02:33:23.090198] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-17T02:33:23.890131] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-11. [2025-09-17T02:33:24.048453] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T02:33:24.690169] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-17T02:33:24.989756] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T02:33:25.490147] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-17T02:33:26.089444] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:33:26.290193] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-17T02:33:26.312152] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T02:33:27.090204] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-17T02:33:27.660688] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T02:33:27.787955] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T02:33:27.890123] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-17T02:33:28.690152] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-17T02:33:29.348402] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T02:33:29.490137] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-17T02:33:29.538376] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T02:33:30.290164] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-17T02:33:30.627496] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T02:33:31.071686] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T02:33:31.090321] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-17T02:33:31.890184] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-17T02:33:32.410280] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T02:33:32.415503] [INFO ] [REMOTE ] BSBR: Full fetch complete (50498 records). [2025-09-17T02:33:32.415748] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-17T02:33:32.701787] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-17T02:33:32.833830] [DEBUG] [VALIDATOR ] BSBR: All expected trading days are present. [2025-09-17T02:33:32.833940] [DEBUG] [VALIDATOR ] BSBR: Primary data validation passed. [2025-09-17T02:33:32.834517] [INFO ] [MAIN ] BSBR: Fetched primary data is valid. [2025-09-17T02:33:32.834587] [DEBUG] [LOCAL ] BSBR: Saving primary data. [2025-09-17T02:33:32.835717] [DEBUG] [LOCAL ] BSBR: Trimmed 50498 records to 35023 (keeping 200 days of data) [2025-09-17T02:33:33.044821] [DEBUG] [LOCAL ] BSBR: Primary data saved (35023 records). [2025-09-17T02:33:33.044996] [INFO ] [MAIN ] BSBR: Full history saved. [2025-09-17T02:33:33.045103] [INFO ] [MAIN ] Update Progress: 342/2369 symbols completed. BSBR took 34.4s. Estimated remaining: 4h 53m 1s. Rate: 6.9 symbols/min [2025-09-17T02:33:33.220702] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:33.220981] [DEBUG] [LOCAL ] BSTZ: No existing data file found in primary storage. [2025-09-17T02:33:33.221086] [WARN ] [MAIN ] BSTZ: No existing data found, performing full refresh instead. [2025-09-17T02:33:33.221288] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-17T02:33:33.221378] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-17T02:33:33.221503] [DEBUG] [LOCAL ] BSTZ: No primary data file found to delete. [2025-09-17T02:33:33.221619] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-17T02:33:33.345662] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:33:33.495312] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-17T02:33:33.567071] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T02:33:33.624363] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:34.290174] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-11. [2025-09-17T02:33:35.014402] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T02:33:35.082197] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T02:33:35.090069] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-17T02:33:35.890174] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-17T02:33:36.337907] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T02:33:36.481742] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T02:33:36.690163] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-17T02:33:37.148857] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T02:33:37.490162] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-17T02:33:38.290148] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-17T02:33:38.877348] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T02:33:38.916144] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T02:33:38.917580] [INFO ] [REMOTE ] BSL: Full fetch complete (12527 records). [2025-09-17T02:33:38.917690] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-17T02:33:39.096524] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-17T02:33:39.290529] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-17T02:33:39.290632] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-17T02:33:39.290958] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-17T02:33:39.291013] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-17T02:33:39.291495] [DEBUG] [LOCAL ] BSL: Trimmed 12527 records to 8201 (keeping 200 days of data) [2025-09-17T02:33:39.342500] [DEBUG] [LOCAL ] BSL: Primary data saved (8201 records). [2025-09-17T02:33:39.342666] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-17T02:33:39.342765] [INFO ] [MAIN ] Update Progress: 343/2369 symbols completed. BSL took 28.8s. Estimated remaining: 4h 52m 38s. Rate: 6.9 symbols/min [2025-09-17T02:33:39.515872] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:39.554934] [DEBUG] [LOCAL ] BSX: Loaded 40038 existing records from primary storage. [2025-09-17T02:33:39.555123] [INFO ] [MAIN ] BSX: Loaded 40038 existing records. [2025-09-17T02:33:39.740003] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:33:39.740265] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-17T02:33:39.740327] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-17T02:33:39.741367] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-17T02:33:39.741439] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-17T02:33:39.895637] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-17T02:33:40.108485] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:40.632731] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T02:33:40.690093] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-17T02:33:41.143162] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T02:33:41.490131] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-11. [2025-09-17T02:33:41.779811] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T02:33:41.784486] [INFO ] [REMOTE ] BSM: Full fetch complete (47649 records). [2025-09-17T02:33:41.784668] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-17T02:33:42.172091] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-17T02:33:42.172203] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-17T02:33:42.172817] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-17T02:33:42.172875] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-17T02:33:42.174015] [DEBUG] [LOCAL ] BSM: Trimmed 47649 records to 32621 (keeping 200 days of data) [2025-09-17T02:33:42.290403] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-17T02:33:42.376327] [DEBUG] [LOCAL ] BSM: Primary data saved (32621 records). [2025-09-17T02:33:42.376491] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-17T02:33:42.376583] [INFO ] [MAIN ] Update Progress: 344/2369 symbols completed. BSM took 29.7s. Estimated remaining: 4h 51m 56s. Rate: 6.9 symbols/min [2025-09-17T02:33:42.547948] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:33:42.548157] [DEBUG] [LOCAL ] BTA: No existing data file found in primary storage. [2025-09-17T02:33:42.548211] [WARN ] [MAIN ] BTA: No existing data found, performing full refresh instead. [2025-09-17T02:33:42.548314] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-17T02:33:42.548366] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-17T02:33:42.548436] [DEBUG] [LOCAL ] BTA: No primary data file found to delete. [2025-09-17T02:33:42.548483] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-17T02:33:42.899476] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:33:43.090161] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-11. [2025-09-17T02:33:43.291132] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T02:33:43.583692] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T02:33:43.836067] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T02:33:43.890187] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-17T02:33:44.684147] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T02:33:44.690068] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-17T02:33:45.204299] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T02:33:45.490180] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-17T02:33:46.290121] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-17T02:33:46.844033] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T02:33:46.988025] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T02:33:47.090163] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-17T02:33:47.890123] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-17T02:33:48.659015] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T02:33:48.690137] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-17T02:33:48.916762] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T02:33:49.490131] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-17T02:33:49.796588] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T02:33:49.838236] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T02:33:50.290149] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-17T02:33:51.090185] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-17T02:33:51.890178] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-17T02:33:52.005064] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T02:33:52.327055] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T02:33:52.690139] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-17T02:33:52.992923] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T02:33:53.490148] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-17T02:33:54.290126] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-17T02:33:54.418933] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:33:54.551726] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T02:33:55.008797] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T02:33:55.090114] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-17T02:33:55.890158] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-17T02:33:56.341119] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T02:33:56.488881] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T02:33:56.690124] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-17T02:33:57.299931] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T02:33:57.490183] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-17T02:33:58.137819] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T02:33:58.290145] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-17T02:33:59.090131] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-17T02:33:59.462697] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:33:59.690697] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T02:33:59.890132] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-17T02:34:00.690130] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-17T02:34:00.951217] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T02:34:01.490139] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-17T02:34:02.290094] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-17T02:34:02.611498] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T02:34:02.712371] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T02:34:02.883775] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T02:34:02.885636] [INFO ] [REMOTE ] BTA: Full fetch complete (9462 records). [2025-09-17T02:34:02.885774] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-17T02:34:03.097031] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-17T02:34:03.266881] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-17T02:34:03.266990] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-17T02:34:03.267293] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-17T02:34:03.267346] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-17T02:34:03.267833] [DEBUG] [LOCAL ] BTA: Trimmed 9462 records to 5233 (keeping 200 days of data) [2025-09-17T02:34:03.298926] [DEBUG] [LOCAL ] BTA: Primary data saved (5233 records). [2025-09-17T02:34:03.299032] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-17T02:34:03.299114] [INFO ] [MAIN ] Update Progress: 345/2369 symbols completed. BTA took 20.9s. Estimated remaining: 4h 52m 59s. Rate: 6.9 symbols/min [2025-09-17T02:34:03.466000] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:03.479124] [DEBUG] [LOCAL ] BTCM: Loaded 12997 existing records from primary storage. [2025-09-17T02:34:03.479251] [INFO ] [MAIN ] BTCM: Loaded 12997 existing records. [2025-09-17T02:34:03.660462] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:34:03.660873] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-17T02:34:03.660952] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-17T02:34:03.661450] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-17T02:34:03.661519] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-17T02:34:03.897190] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-17T02:34:04.018725] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:04.030400] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T02:34:04.690178] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-11. [2025-09-17T02:34:05.490099] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-17T02:34:05.877765] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:34:05.954673] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T02:34:06.161104] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T02:34:06.290123] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-17T02:34:07.090123] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-17T02:34:07.570877] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T02:34:07.890152] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-17T02:34:08.210132] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T02:34:08.690197] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-17T02:34:08.714285] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T02:34:08.717199] [INFO ] [REMOTE ] BST: Full fetch complete (28741 records). [2025-09-17T02:34:08.717296] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-17T02:34:09.089835] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-17T02:34:09.089938] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-17T02:34:09.090340] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-17T02:34:09.090397] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-17T02:34:09.091158] [DEBUG] [LOCAL ] BST: Trimmed 28741 records to 19513 (keeping 200 days of data) [2025-09-17T02:34:09.208084] [DEBUG] [LOCAL ] BST: Primary data saved (19513 records). [2025-09-17T02:34:09.208248] [INFO ] [MAIN ] BST: Full history saved. [2025-09-17T02:34:09.208345] [INFO ] [MAIN ] Update Progress: 346/2369 symbols completed. BST took 50.1s. Estimated remaining: 4h 52m 34s. Rate: 6.9 symbols/min [2025-09-17T02:34:09.376899] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:09.377135] [DEBUG] [LOCAL ] BTE: No existing data file found in primary storage. [2025-09-17T02:34:09.377182] [WARN ] [MAIN ] BTE: No existing data found, performing full refresh instead. [2025-09-17T02:34:09.377290] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-17T02:34:09.377342] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-17T02:34:09.377408] [DEBUG] [LOCAL ] BTE: No primary data file found to delete. [2025-09-17T02:34:09.377459] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-17T02:34:09.495238] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-17T02:34:09.744168] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:09.745139] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T02:34:09.748579] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36719 records). [2025-09-17T02:34:09.748686] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-17T02:34:10.121617] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-17T02:34:10.121910] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-17T02:34:10.122398] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-17T02:34:10.122453] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-17T02:34:10.123471] [DEBUG] [LOCAL ] BSTZ: Trimmed 36719 records to 25114 (keeping 200 days of data) [2025-09-17T02:34:10.274959] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25114 records). [2025-09-17T02:34:10.275107] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-17T02:34:10.275189] [INFO ] [MAIN ] Update Progress: 347/2369 symbols completed. BSTZ took 37.2s. Estimated remaining: 4h 51m 41s. Rate: 6.9 symbols/min [2025-09-17T02:34:10.295900] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-11. [2025-09-17T02:34:10.446340] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:10.489707] [DEBUG] [LOCAL ] BTI: Loaded 39958 existing records from primary storage. [2025-09-17T02:34:10.489871] [INFO ] [MAIN ] BTI: Loaded 39958 existing records. [2025-09-17T02:34:10.666408] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:34:10.666724] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-17T02:34:10.667495] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-17T02:34:10.668492] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-17T02:34:10.668555] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-17T02:34:11.025260] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:11.090099] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-11. [2025-09-17T02:34:11.610287] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T02:34:11.890132] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-17T02:34:12.041350] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T02:34:12.690140] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-17T02:34:12.831519] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T02:34:13.490155] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-17T02:34:13.812150] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T02:34:14.290116] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-17T02:34:14.343180] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T02:34:15.090148] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-17T02:34:15.143541] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T02:34:15.181167] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T02:34:15.890137] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-17T02:34:16.612569] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T02:34:16.690141] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-17T02:34:17.490140] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-17T02:34:17.848821] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T02:34:17.945114] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T02:34:17.973763] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T02:34:18.290199] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-17T02:34:19.090194] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-17T02:34:19.540589] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T02:34:19.890139] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-17T02:34:20.055083] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T02:34:20.690186] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-17T02:34:21.490126] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-17T02:34:21.597516] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T02:34:22.176831] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T02:34:22.290180] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-17T02:34:22.592224] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T02:34:23.029816] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T02:34:23.090098] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-17T02:34:23.708067] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T02:34:23.890319] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-17T02:34:24.690134] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-17T02:34:25.490132] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-17T02:34:25.639839] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:34:26.290149] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-17T02:34:26.675353] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T02:34:27.090187] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-17T02:34:27.387136] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T02:34:27.890128] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-17T02:34:28.074426] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T02:34:28.690187] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-17T02:34:29.235727] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-17T02:34:29.490140] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-17T02:34:29.678139] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T02:34:29.685005] [INFO ] [REMOTE ] BSX: Full fetch complete (77524 records). [2025-09-17T02:34:29.685189] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-17T02:34:30.085377] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-17T02:34:30.085541] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-17T02:34:30.086409] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-17T02:34:30.086486] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-17T02:34:30.088184] [DEBUG] [LOCAL ] BSX: Trimmed 77524 records to 53688 (keeping 200 days of data) [2025-09-17T02:34:30.216570] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T02:34:30.293371] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-17T02:34:30.447153] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-09-17T02:34:30.447317] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-17T02:34:30.447408] [INFO ] [MAIN ] Update Progress: 348/2369 symbols completed. BSX took 51.1s. Estimated remaining: 4h 52m 40s. Rate: 6.9 symbols/min [2025-09-17T02:34:30.622845] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:30.630600] [DEBUG] [LOCAL ] BTO: Loaded 6236 existing records from primary storage. [2025-09-17T02:34:30.630770] [INFO ] [MAIN ] BTO: Loaded 6236 existing records. [2025-09-17T02:34:30.813971] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:34:30.814233] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-17T02:34:30.814294] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-17T02:34:30.814702] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-17T02:34:30.814767] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-17T02:34:31.099615] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-17T02:34:31.182411] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:31.360571] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T02:34:31.424931] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:34:31.890139] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-17T02:34:32.690187] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-17T02:34:33.331842] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T02:34:33.490160] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-11. [2025-09-17T02:34:33.716819] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T02:34:33.717763] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T02:34:33.735952] [INFO ] [REMOTE ] BTCM: Full fetch complete (19229 records). [2025-09-17T02:34:33.736070] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-17T02:34:34.107265] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-17T02:34:34.107399] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-17T02:34:34.107815] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-17T02:34:34.107987] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-17T02:34:34.108712] [DEBUG] [LOCAL ] BTCM: Trimmed 19229 records to 14034 (keeping 200 days of data) [2025-09-17T02:34:34.191304] [DEBUG] [LOCAL ] BTCM: Primary data saved (14034 records). [2025-09-17T02:34:34.191480] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-17T02:34:34.191585] [INFO ] [MAIN ] Update Progress: 349/2369 symbols completed. BTCM took 30.9s. Estimated remaining: 4h 52m 2s. Rate: 6.9 symbols/min [2025-09-17T02:34:34.294184] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-17T02:34:34.368333] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:34.376900] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T02:34:34.390273] [DEBUG] [LOCAL ] BTT: Loaded 11485 existing records from primary storage. [2025-09-17T02:34:34.390412] [INFO ] [MAIN ] BTT: Loaded 11485 existing records. [2025-09-17T02:34:34.572299] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:34:34.572582] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-17T02:34:34.572670] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-17T02:34:34.573176] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-17T02:34:34.573242] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-17T02:34:34.935576] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:35.090130] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-17T02:34:35.516767] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T02:34:35.523727] [INFO ] [REMOTE ] BTE: Full fetch complete (75805 records). [2025-09-17T02:34:35.523902] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-17T02:34:35.720627] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T02:34:35.898151] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-11. [2025-09-17T02:34:35.957293] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-17T02:34:35.957406] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-17T02:34:35.958261] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-17T02:34:35.958330] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-17T02:34:35.960284] [DEBUG] [LOCAL ] BTE: Trimmed 75805 records to 52758 (keeping 200 days of data) [2025-09-17T02:34:36.296996] [DEBUG] [LOCAL ] BTE: Primary data saved (52758 records). [2025-09-17T02:34:36.297164] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-17T02:34:36.297255] [INFO ] [MAIN ] Update Progress: 350/2369 symbols completed. BTE took 27.1s. Estimated remaining: 4h 51m 16s. Rate: 6.9 symbols/min [2025-09-17T02:34:36.473689] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:36.514491] [DEBUG] [LOCAL ] BTU: Loaded 39703 existing records from primary storage. [2025-09-17T02:34:36.514717] [INFO ] [MAIN ] BTU: Loaded 39703 existing records. [2025-09-17T02:34:36.698101] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-17T02:34:36.702704] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:34:36.703746] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-17T02:34:36.703812] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-17T02:34:36.704813] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-17T02:34:36.704879] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-17T02:34:36.884141] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T02:34:37.078348] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:37.490139] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-17T02:34:37.513473] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T02:34:38.290158] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-17T02:34:38.793783] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T02:34:39.076140] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T02:34:39.090098] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-17T02:34:39.890187] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-17T02:34:39.913047] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T02:34:40.690133] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-17T02:34:40.853949] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T02:34:41.490147] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-17T02:34:41.533244] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T02:34:42.290171] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-11. [2025-09-17T02:34:43.090141] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-17T02:34:43.578689] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T02:34:43.695191] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T02:34:43.881433] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T02:34:43.890082] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-17T02:34:44.690136] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-17T02:34:44.847183] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T02:34:45.490704] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-17T02:34:45.495270] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T02:34:46.290103] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-17T02:34:46.603166] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T02:34:47.090140] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-17T02:34:47.116336] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T02:34:47.890137] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-17T02:34:48.659582] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T02:34:48.690091] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-17T02:34:48.785878] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T02:34:49.490207] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-17T02:34:49.512821] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T02:34:50.290175] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-17T02:34:50.947128] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T02:34:50.948618] [INFO ] [REMOTE ] BTO: Full fetch complete (13315 records). [2025-09-17T02:34:50.948729] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-17T02:34:51.095229] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-17T02:34:51.330818] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-17T02:34:51.331151] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-17T02:34:51.331597] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-17T02:34:51.331855] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-17T02:34:51.332840] [DEBUG] [LOCAL ] BTO: Trimmed 13315 records to 9032 (keeping 200 days of data) [2025-09-17T02:34:51.412769] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T02:34:51.436565] [DEBUG] [LOCAL ] BTO: Primary data saved (9032 records). [2025-09-17T02:34:51.436793] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-17T02:34:51.436919] [INFO ] [MAIN ] Update Progress: 351/2369 symbols completed. BTO took 21.0s. Estimated remaining: 4h 51m 44s. Rate: 6.9 symbols/min [2025-09-17T02:34:51.612740] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:34:51.613003] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-17T02:34:51.613056] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-17T02:34:51.613167] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-17T02:34:51.613221] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-17T02:34:51.613272] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-17T02:34:51.613314] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-17T02:34:51.893301] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-17T02:34:51.998555] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:34:51.999248] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T02:34:52.690173] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-11. [2025-09-17T02:34:52.902420] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:34:52.902780] [WARN ] [REMOTE ] BTX: No data returned for month 2024-11 [2025-09-17T02:34:53.490134] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-17T02:34:53.783313] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:34:53.783900] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-17T02:34:53.831955] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T02:34:54.290140] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-17T02:34:55.090168] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-17T02:34:55.296426] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:34:55.296822] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-17T02:34:55.890137] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-17T02:34:56.194914] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T02:34:56.678535] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T02:34:56.690075] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-17T02:34:57.490178] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-17T02:34:58.027529] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T02:34:58.290149] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-17T02:34:59.090117] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-17T02:34:59.608227] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T02:34:59.724476] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:34:59.890079] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-17T02:35:00.690165] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-17T02:35:00.843521] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:35:00.909953] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T02:35:01.490172] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-17T02:35:02.290100] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-17T02:35:02.712179] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T02:35:03.090134] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-17T02:35:03.193956] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T02:35:03.231799] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T02:35:03.750492] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T02:35:03.890126] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-17T02:35:04.690130] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-17T02:35:05.323892] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T02:35:05.490201] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-17T02:35:06.290224] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-17T02:35:06.510363] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T02:35:06.684308] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T02:35:07.090250] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-17T02:35:07.890136] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-17T02:35:08.069763] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T02:35:08.094200] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:35:08.690163] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-17T02:35:09.089298] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T02:35:09.093028] [INFO ] [REMOTE ] BTX: Full fetch complete (34419 records). [2025-09-17T02:35:09.093266] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-17T02:35:09.312397] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-09-17T02:35:09.312904] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:35:09.312964] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:35:09.313016] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-17T02:35:09.313086] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-17T02:35:09.313137] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-17T02:35:09.313201] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-17T02:35:09.313295] [INFO ] [MAIN ] Update Progress: 352/2369 symbols completed. BTX took 17.9s. Estimated remaining: 4h 52m 28s. Rate: 6.9 symbols/min [2025-09-17T02:35:09.485484] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:35:09.485760] [DEBUG] [LOCAL ] BTZ: No existing data file found in primary storage. [2025-09-17T02:35:09.485814] [WARN ] [MAIN ] BTZ: No existing data found, performing full refresh instead. [2025-09-17T02:35:09.485921] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-17T02:35:09.485976] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-17T02:35:09.486028] [DEBUG] [LOCAL ] BTZ: No primary data file found to delete. [2025-09-17T02:35:09.486069] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-17T02:35:09.497226] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-17T02:35:09.807258] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T02:35:09.889895] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:35:10.290154] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-11. [2025-09-17T02:35:11.090172] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-17T02:35:11.434403] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T02:35:11.627402] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T02:35:11.890127] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-17T02:35:12.690146] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-17T02:35:12.990910] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T02:35:12.997550] [INFO ] [REMOTE ] BTI: Full fetch complete (77261 records). [2025-09-17T02:35:12.997721] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-17T02:35:13.397709] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-17T02:35:13.397827] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-17T02:35:13.398739] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-17T02:35:13.398801] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-17T02:35:13.400380] [DEBUG] [LOCAL ] BTI: Trimmed 77261 records to 53552 (keeping 200 days of data) [2025-09-17T02:35:13.493594] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-17T02:35:13.735106] [DEBUG] [LOCAL ] BTI: Primary data saved (53552 records). [2025-09-17T02:35:13.735366] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-17T02:35:13.735707] [INFO ] [MAIN ] Update Progress: 353/2369 symbols completed. BTI took 1m 3s. Estimated remaining: 4h 51m 55s. Rate: 6.9 symbols/min [2025-09-17T02:35:13.880902] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T02:35:13.957221] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:35:13.957921] [DEBUG] [LOCAL ] BUD: No existing data file found in primary storage. [2025-09-17T02:35:13.958112] [WARN ] [MAIN ] BUD: No existing data found, performing full refresh instead. [2025-09-17T02:35:13.958324] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-17T02:35:13.958404] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-17T02:35:13.972418] [DEBUG] [LOCAL ] BUD: No primary data file found to delete. [2025-09-17T02:35:13.973082] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-17T02:35:13.973675] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T02:35:14.177578] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T02:35:14.265528] [INFO ] [REMOTE ] BTT: Full fetch complete (24388 records). [2025-09-17T02:35:14.286943] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-17T02:35:14.293091] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-17T02:35:14.427994] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:35:14.782397] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-17T02:35:14.782513] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-17T02:35:14.782929] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-17T02:35:14.782985] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-17T02:35:14.784581] [DEBUG] [LOCAL ] BTT: Trimmed 24388 records to 16117 (keeping 200 days of data) [2025-09-17T02:35:14.891309] [DEBUG] [LOCAL ] BTT: Primary data saved (16117 records). [2025-09-17T02:35:14.891490] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-17T02:35:14.891589] [INFO ] [MAIN ] Update Progress: 354/2369 symbols completed. BTT took 40.7s. Estimated remaining: 4h 51m 4s. Rate: 6.9 symbols/min [2025-09-17T02:35:15.060920] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:35:15.070755] [DEBUG] [LOCAL ] BUI: Loaded 8640 existing records from primary storage. [2025-09-17T02:35:15.070889] [INFO ] [MAIN ] BUI: Loaded 8640 existing records. [2025-09-17T02:35:15.100814] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-11. [2025-09-17T02:35:15.251061] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:35:15.251353] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-17T02:35:15.251427] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-17T02:35:15.251854] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-17T02:35:15.251929] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-17T02:35:15.605423] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:35:15.618797] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T02:35:15.890127] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-17T02:35:16.690146] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-17T02:35:17.121471] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T02:35:17.495371] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-11. [2025-09-17T02:35:17.514652] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:35:17.527169] [INFO ] [REMOTE ] BTU: Full fetch complete (76666 records). [2025-09-17T02:35:17.527442] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-17T02:35:18.043673] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T02:35:18.063392] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-17T02:35:18.068915] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-17T02:35:18.070297] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-17T02:35:18.070384] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-17T02:35:18.073051] [DEBUG] [LOCAL ] BTU: Trimmed 76666 records to 53303 (keeping 200 days of data) [2025-09-17T02:35:18.302606] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-17T02:35:18.358938] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T02:35:18.479401] [DEBUG] [LOCAL ] BTU: Primary data saved (53303 records). [2025-09-17T02:35:18.479602] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-17T02:35:18.480403] [INFO ] [MAIN ] Update Progress: 355/2369 symbols completed. BTU took 42.2s. Estimated remaining: 4h 50m 26s. Rate: 6.9 symbols/min [2025-09-17T02:35:18.660492] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:35:18.660741] [DEBUG] [LOCAL ] BUR: No existing data file found in primary storage. [2025-09-17T02:35:18.660794] [WARN ] [MAIN ] BUR: No existing data found, performing full refresh instead. [2025-09-17T02:35:18.660905] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-17T02:35:18.660968] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-17T02:35:18.661019] [DEBUG] [LOCAL ] BUR: No primary data file found to delete. [2025-09-17T02:35:18.661071] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-17T02:35:19.028140] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:35:19.090143] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-17T02:35:19.830131] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T02:35:19.890182] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-17T02:35:20.299210] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T02:35:20.483910] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T02:35:20.690171] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-11. [2025-09-17T02:35:21.490142] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-17T02:35:22.195332] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T02:35:22.290192] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-17T02:35:22.733998] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T02:35:23.089035] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T02:35:23.091458] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-17T02:35:23.890164] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-17T02:35:24.318905] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T02:35:24.690208] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-17T02:35:24.753599] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T02:35:25.490190] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-17T02:35:26.148131] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T02:35:26.290179] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-17T02:35:26.691070] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T02:35:27.090162] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-17T02:35:27.890181] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-17T02:35:28.137414] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:35:28.267436] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T02:35:28.624334] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T02:35:28.690144] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-17T02:35:29.351616] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T02:35:29.490173] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-17T02:35:30.290144] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-17T02:35:31.090169] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-17T02:35:31.415465] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-17T02:35:31.678993] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T02:35:31.857810] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:35:31.890100] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-17T02:35:32.690137] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-17T02:35:33.387770] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T02:35:33.490158] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-17T02:35:33.648243] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T02:35:34.290424] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-17T02:35:34.341107] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T02:35:35.090160] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-17T02:35:35.890194] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-17T02:35:36.333938] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T02:35:36.373433] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T02:35:36.578199] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T02:35:36.690157] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-17T02:35:37.490189] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-17T02:35:38.290190] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-17T02:35:38.320037] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T02:35:38.390892] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T02:35:38.394506] [INFO ] [REMOTE ] BTZ: Full fetch complete (34119 records). [2025-09-17T02:35:38.394725] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-17T02:35:38.779524] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-17T02:35:38.779636] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-17T02:35:38.780184] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-17T02:35:38.780250] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-17T02:35:38.781196] [DEBUG] [LOCAL ] BTZ: Trimmed 34119 records to 23121 (keeping 200 days of data) [2025-09-17T02:35:38.938407] [DEBUG] [LOCAL ] BTZ: Primary data saved (23121 records). [2025-09-17T02:35:38.938607] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-17T02:35:38.938719] [INFO ] [MAIN ] Update Progress: 356/2369 symbols completed. BTZ took 29.6s. Estimated remaining: 4h 51m 24s. Rate: 6.9 symbols/min [2025-09-17T02:35:39.090524] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-17T02:35:39.113046] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:35:39.151856] [DEBUG] [LOCAL ] BURL: Loaded 33959 existing records from primary storage. [2025-09-17T02:35:39.152020] [INFO ] [MAIN ] BURL: Loaded 33959 existing records. [2025-09-17T02:35:39.338465] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:35:39.338748] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-17T02:35:39.338808] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-17T02:35:39.339576] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-17T02:35:39.339633] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-17T02:35:39.706807] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:35:39.890138] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-11. [2025-09-17T02:35:39.936596] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T02:35:40.185165] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T02:35:40.690143] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-17T02:35:41.490199] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-17T02:35:41.502778] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T02:35:41.505119] [INFO ] [REMOTE ] BUI: Full fetch complete (16030 records). [2025-09-17T02:35:41.505227] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-17T02:35:41.908974] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T02:35:41.918556] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-17T02:35:41.918691] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-17T02:35:41.919029] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-17T02:35:41.919082] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-17T02:35:41.919678] [DEBUG] [LOCAL ] BUI: Trimmed 16030 records to 11424 (keeping 200 days of data) [2025-09-17T02:35:41.991514] [DEBUG] [LOCAL ] BUI: Primary data saved (11424 records). [2025-09-17T02:35:41.991689] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-17T02:35:41.991784] [INFO ] [MAIN ] Update Progress: 357/2369 symbols completed. BUI took 27.1s. Estimated remaining: 4h 50m 44s. Rate: 6.9 symbols/min [2025-09-17T02:35:42.290155] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-17T02:35:43.090134] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-17T02:35:43.158143] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T02:35:43.670519] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T02:35:43.890143] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-17T02:35:44.690175] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-17T02:35:44.985831] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T02:35:45.047491] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T02:35:45.490158] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-17T02:35:46.290187] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-17T02:35:46.420117] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:35:46.614881] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T02:35:47.090148] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-17T02:35:47.890133] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-17T02:35:48.089209] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T02:35:48.690143] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-17T02:35:48.913419] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T02:35:49.416907] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T02:35:49.490122] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-17T02:35:50.290128] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-17T02:35:50.635532] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T02:35:51.090147] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-17T02:35:51.203925] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T02:35:51.857712] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:35:51.890078] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-17T02:35:52.690158] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-17T02:35:52.950582] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T02:35:53.490154] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-17T02:35:53.664343] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T02:35:53.769118] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T02:35:53.774756] [INFO ] [REMOTE ] BUR: Full fetch complete (63034 records). [2025-09-17T02:35:53.774904] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-17T02:35:54.165407] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-17T02:35:54.165519] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-17T02:35:54.166249] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-17T02:35:54.166314] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-17T02:35:54.167900] [DEBUG] [LOCAL ] BUR: Trimmed 63034 records to 45181 (keeping 200 days of data) [2025-09-17T02:35:54.290625] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-17T02:35:54.447534] [DEBUG] [LOCAL ] BUR: Primary data saved (45181 records). [2025-09-17T02:35:54.447719] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-17T02:35:54.447817] [INFO ] [MAIN ] Update Progress: 358/2369 symbols completed. BUR took 36.0s. Estimated remaining: 4h 50m 57s. Rate: 6.9 symbols/min [2025-09-17T02:35:55.209596] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T02:35:55.216338] [INFO ] [REMOTE ] BUD: Full fetch complete (76344 records). [2025-09-17T02:35:55.216555] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-17T02:35:55.635294] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-17T02:35:55.635419] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-17T02:35:55.636229] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-17T02:35:55.636291] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-17T02:35:55.637870] [DEBUG] [LOCAL ] BUD: Trimmed 76344 records to 52767 (keeping 200 days of data) [2025-09-17T02:35:55.983058] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T02:35:55.996019] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-17T02:35:56.005223] [DEBUG] [LOCAL ] BUD: Primary data saved (52767 records). [2025-09-17T02:35:56.005417] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-17T02:35:56.005517] [INFO ] [MAIN ] Update Progress: 359/2369 symbols completed. BUD took 42.3s. Estimated remaining: 4h 50m 8s. Rate: 6.9 symbols/min [2025-09-17T02:35:57.271604] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T02:35:57.282166] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-17T02:35:58.952886] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T02:35:58.963062] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-17T02:36:00.416664] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T02:36:00.422537] [INFO ] [REMOTE ] BURL: Full fetch complete (65687 records). [2025-09-17T02:36:00.422712] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-17T02:36:00.811890] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-17T02:36:00.812018] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-17T02:36:00.812822] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-17T02:36:00.812905] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-17T02:36:00.814284] [DEBUG] [LOCAL ] BURL: Trimmed 65687 records to 46558 (keeping 200 days of data) [2025-09-17T02:36:01.099406] [DEBUG] [LOCAL ] BURL: Primary data saved (46558 records). [2025-09-17T02:36:01.099584] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-17T02:36:01.099697] [INFO ] [MAIN ] Update Progress: 360/2369 symbols completed. BURL took 22.2s. Estimated remaining: 4h 49m 39s. Rate: 6.9 symbols/min [2025-09-17T02:36:01.624570] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:01.763765] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:01.801285] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:01.822058] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:01.834039] [DEBUG] [LOCAL ] BUXX: Loaded 11499 existing records from primary storage. [2025-09-17T02:36:01.834399] [INFO ] [MAIN ] BUXX: Loaded 11499 existing records. [2025-09-17T02:36:02.049399] [DEBUG] [LOCAL ] BV: Loaded 28578 existing records from primary storage. [2025-09-17T02:36:02.079866] [INFO ] [MAIN ] BV: Loaded 28578 existing records. [2025-09-17T02:36:02.080704] [DEBUG] [LOCAL ] BW: Loaded 28462 existing records from primary storage. [2025-09-17T02:36:02.076485] [DEBUG] [LOCAL ] BVN: Loaded 32229 existing records from primary storage. [2025-09-17T02:36:02.079660] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:02.080989] [INFO ] [MAIN ] BVN: Loaded 32229 existing records. [2025-09-17T02:36:02.081167] [INFO ] [MAIN ] BW: Loaded 28462 existing records. [2025-09-17T02:36:02.086616] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-17T02:36:02.204048] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-17T02:36:02.341063] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-17T02:36:02.433835] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-17T02:36:02.690606] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:02.765587] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:02.801519] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-17T02:36:02.804837] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:02.801660] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-17T02:36:02.805214] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-17T02:36:02.816009] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-17T02:36:02.821136] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-17T02:36:02.821219] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-17T02:36:02.855880] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-17T02:36:02.850431] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-17T02:36:02.855839] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-17T02:36:02.900563] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-17T02:36:03.077886] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-17T02:36:03.146776] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-17T02:36:03.750449] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:03.786311] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-11. [2025-09-17T02:36:03.956697] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:03.994697] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-11. [2025-09-17T02:36:04.153281] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:04.192078] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-11. [2025-09-17T02:36:04.191754] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:04.192413] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-11. [2025-09-17T02:36:04.835338] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T02:36:04.838373] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-17T02:36:05.067281] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T02:36:05.074362] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-17T02:36:05.679863] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T02:36:05.683002] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-17T02:36:05.841557] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T02:36:05.850183] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-17T02:36:05.897113] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:36:05.905960] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-17T02:36:06.028423] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T02:36:06.035307] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-17T02:36:06.163699] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T02:36:06.166673] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-17T02:36:07.044382] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T02:36:07.047247] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-17T02:36:07.334871] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T02:36:07.342111] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-17T02:36:07.448328] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:36:07.491391] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T02:36:07.598626] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T02:36:07.890158] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-17T02:36:08.690183] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-17T02:36:08.726860] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T02:36:09.039555] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T02:36:09.490170] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-17T02:36:10.208828] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T02:36:10.290136] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-17T02:36:10.520433] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T02:36:11.090190] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-17T02:36:11.524716] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T02:36:11.890172] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-17T02:36:12.170791] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T02:36:12.690170] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-17T02:36:12.969347] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T02:36:13.490139] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-17T02:36:13.883015] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T02:36:14.290149] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-17T02:36:15.073909] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T02:36:15.090075] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-17T02:36:15.890201] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-17T02:36:16.656446] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-17T02:36:16.690160] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-17T02:36:17.492384] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-17T02:36:17.495519] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-17T02:36:17.610259] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T02:36:17.876405] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T02:36:18.129681] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T02:36:18.290192] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-17T02:36:19.090136] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-17T02:36:19.620489] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T02:36:19.890182] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-17T02:36:20.699625] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-17T02:36:20.704942] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T02:36:20.921863] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T02:36:21.490248] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-17T02:36:21.938453] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T02:36:22.290154] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-17T02:36:22.407989] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T02:36:23.090187] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-17T02:36:23.788479] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T02:36:23.890139] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-17T02:36:24.520420] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T02:36:24.690157] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-17T02:36:25.360209] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:36:25.490148] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-17T02:36:26.282046] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T02:36:26.290772] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-17T02:36:26.388730] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T02:36:27.090166] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-17T02:36:27.680030] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T02:36:27.685159] [INFO ] [REMOTE ] BV: Full fetch complete (53452 records). [2025-09-17T02:36:27.685309] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-17T02:36:27.895940] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-17T02:36:28.098063] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-17T02:36:28.098190] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-17T02:36:28.099465] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-17T02:36:28.099557] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-17T02:36:28.101284] [DEBUG] [LOCAL ] BV: Trimmed 53452 records to 38711 (keeping 200 days of data) [2025-09-17T02:36:28.452242] [DEBUG] [LOCAL ] BV: Primary data saved (38711 records). [2025-09-17T02:36:28.452488] [INFO ] [MAIN ] BV: Full history saved. [2025-09-17T02:36:28.452662] [INFO ] [MAIN ] Update Progress: 361/2369 symbols completed. BV took 27.4s. Estimated remaining: 4h 51m 15s. Rate: 6.9 symbols/min [2025-09-17T02:36:28.700350] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-17T02:36:28.811192] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:28.874725] [DEBUG] [LOCAL ] BWA: Loaded 38799 existing records from primary storage. [2025-09-17T02:36:28.874967] [INFO ] [MAIN ] BWA: Loaded 38799 existing records. [2025-09-17T02:36:29.102220] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:29.103173] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-17T02:36:29.116059] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-17T02:36:29.117574] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T02:36:29.122668] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-17T02:36:29.123345] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-17T02:36:29.278550] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-17T02:36:29.494558] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-17T02:36:29.528846] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:30.025255] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T02:36:30.290140] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-17T02:36:31.044783] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T02:36:31.090114] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-17T02:36:31.876673] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T02:36:31.882623] [INFO ] [REMOTE ] BW: Full fetch complete (58426 records). [2025-09-17T02:36:31.882776] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-17T02:36:31.896330] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-11. [2025-09-17T02:36:32.279419] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-17T02:36:32.279533] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-17T02:36:32.280261] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-17T02:36:32.280319] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-17T02:36:32.281731] [DEBUG] [LOCAL ] BW: Trimmed 58426 records to 39416 (keeping 200 days of data) [2025-09-17T02:36:32.512186] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T02:36:32.520689] [INFO ] [REMOTE ] BVN: Full fetch complete (62213 records). [2025-09-17T02:36:32.522298] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-17T02:36:32.716711] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-17T02:36:32.850405] [DEBUG] [LOCAL ] BW: Primary data saved (39416 records). [2025-09-17T02:36:32.852780] [INFO ] [MAIN ] BW: Full history saved. [2025-09-17T02:36:32.853115] [INFO ] [MAIN ] Update Progress: 362/2369 symbols completed. BW took 31.8s. Estimated remaining: 4h 50m 42s. Rate: 6.9 symbols/min [2025-09-17T02:36:33.073988] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-17T02:36:33.089793] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-17T02:36:33.124837] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-17T02:36:33.148308] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:33.148358] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-17T02:36:33.150536] [DEBUG] [LOCAL ] BVN: Trimmed 62213 records to 43450 (keeping 200 days of data) [2025-09-17T02:36:33.249913] [DEBUG] [LOCAL ] BWG: Loaded 9776 existing records from primary storage. [2025-09-17T02:36:33.254702] [INFO ] [MAIN ] BWG: Loaded 9776 existing records. [2025-09-17T02:36:33.451350] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:36:33.458423] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T02:36:33.458226] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-17T02:36:33.460443] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-17T02:36:33.461928] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-17T02:36:33.462766] [INFO ] [REMOTE ] BUXX: Full fetch complete (20231 records). [2025-09-17T02:36:33.463633] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-17T02:36:33.464023] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-17T02:36:34.331400] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:34.360978] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-11. [2025-09-17T02:36:34.373524] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-17T02:36:34.386737] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-17T02:36:34.427895] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-17T02:36:34.429054] [DEBUG] [LOCAL ] BVN: Primary data saved (43450 records). [2025-09-17T02:36:34.428927] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-17T02:36:34.432480] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-17T02:36:34.432965] [INFO ] [MAIN ] Update Progress: 363/2369 symbols completed. BVN took 33.3s. Estimated remaining: 4h 49m 54s. Rate: 6.9 symbols/min [2025-09-17T02:36:34.472869] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-11 (2.58 seconds). [2025-09-17T02:36:34.480293] [DEBUG] [LOCAL ] BUXX: Trimmed 20231 records to 15255 (keeping 200 days of data) [2025-09-17T02:36:34.518033] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-17T02:36:34.697537] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:34.698200] [DEBUG] [LOCAL ] BWLP: No existing data file found in primary storage. [2025-09-17T02:36:34.698259] [WARN ] [MAIN ] BWLP: No existing data found, performing full refresh instead. [2025-09-17T02:36:34.698915] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-17T02:36:34.698980] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-17T02:36:34.699538] [DEBUG] [LOCAL ] BWLP: No primary data file found to delete. [2025-09-17T02:36:34.699590] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-17T02:36:35.071622] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:35.081598] [DEBUG] [LOCAL ] BUXX: Primary data saved (15255 records). [2025-09-17T02:36:35.081724] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-17T02:36:35.081811] [INFO ] [MAIN ] Update Progress: 364/2369 symbols completed. BUXX took 34.0s. Estimated remaining: 4h 49m 1s. Rate: 6.9 symbols/min [2025-09-17T02:36:35.115221] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-11. [2025-09-17T02:36:35.256837] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T02:36:35.277104] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:36:35.277221] [DEBUG] [LOCAL ] BWMX: No existing data file found in primary storage. [2025-09-17T02:36:35.277281] [WARN ] [MAIN ] BWMX: No existing data found, performing full refresh instead. [2025-09-17T02:36:35.277420] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-17T02:36:35.277482] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-17T02:36:35.277538] [DEBUG] [LOCAL ] BWMX: No primary data file found to delete. [2025-09-17T02:36:35.277587] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-17T02:36:35.653494] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:36:35.890103] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-11. [2025-09-17T02:36:36.145968] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T02:36:36.390895] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T02:36:36.455440] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T02:36:36.690187] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-17T02:36:37.490191] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-17T02:36:38.291082] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-17T02:36:38.293307] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:36:38.309509] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T02:36:39.090135] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-17T02:36:39.592550] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T02:36:39.890114] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-17T02:36:40.012301] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T02:36:40.323717] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T02:36:40.690160] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-17T02:36:41.490165] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-17T02:36:41.900459] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T02:36:42.271853] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T02:36:42.290128] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-17T02:36:43.090239] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-17T02:36:43.261306] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T02:36:43.890143] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-17T02:36:44.666587] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T02:36:44.690079] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-17T02:36:44.847949] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T02:36:45.203674] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T02:36:45.490144] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-17T02:36:46.290179] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-17T02:36:46.831152] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T02:36:46.882826] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T02:36:47.090162] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-17T02:36:47.520066] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T02:36:47.890136] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-17T02:36:48.690154] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-17T02:36:48.707173] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T02:36:49.490155] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-17T02:36:50.290502] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-17T02:36:50.291193] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T02:36:50.512653] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T02:36:51.090196] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-17T02:36:51.779546] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T02:36:51.890147] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-17T02:36:52.012577] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T02:36:52.690138] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-17T02:36:53.408798] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T02:36:53.490145] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-17T02:36:53.796073] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T02:36:54.290150] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-17T02:36:54.573795] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T02:36:55.090147] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-17T02:36:55.890121] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-17T02:36:56.123076] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T02:36:56.322870] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T02:36:56.525577] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T02:36:56.690141] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-17T02:36:57.215795] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T02:36:57.490158] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-17T02:36:58.290181] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-17T02:36:58.928865] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T02:36:59.090194] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-17T02:36:59.607675] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T02:36:59.890178] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-17T02:37:00.526964] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T02:37:00.690123] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-17T02:37:01.418870] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T02:37:01.490078] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-17T02:37:01.792971] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T02:37:02.069006] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T02:37:02.290120] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-17T02:37:02.833726] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T02:37:03.090133] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-17T02:37:03.565169] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T02:37:03.566602] [INFO ] [REMOTE ] BWMX: Full fetch complete (9993 records). [2025-09-17T02:37:03.566710] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-17T02:37:03.903379] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-17T02:37:03.947264] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-17T02:37:03.947355] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-17T02:37:03.947669] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-17T02:37:03.947724] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-17T02:37:03.948205] [DEBUG] [LOCAL ] BWMX: Trimmed 9993 records to 7551 (keeping 200 days of data) [2025-09-17T02:37:03.996782] [DEBUG] [LOCAL ] BWMX: Primary data saved (7551 records). [2025-09-17T02:37:03.996944] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-17T02:37:03.997021] [INFO ] [MAIN ] Update Progress: 365/2369 symbols completed. BWMX took 28.9s. Estimated remaining: 4h 50m 44s. Rate: 6.9 symbols/min [2025-09-17T02:37:04.169244] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:04.175246] [DEBUG] [LOCAL ] BWNB: Loaded 3471 existing records from primary storage. [2025-09-17T02:37:04.175382] [INFO ] [MAIN ] BWNB: Loaded 3471 existing records. [2025-09-17T02:37:04.358327] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:04.358611] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-17T02:37:04.358727] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-17T02:37:04.359106] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-17T02:37:04.359164] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-17T02:37:04.695157] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-17T02:37:04.732433] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:05.357545] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T02:37:05.360454] [INFO ] [REMOTE ] BWG: Full fetch complete (17447 records). [2025-09-17T02:37:05.360662] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-17T02:37:05.508113] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-11. [2025-09-17T02:37:05.635247] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T02:37:05.761546] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-17T02:37:05.761672] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-17T02:37:05.762108] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-17T02:37:05.762163] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-17T02:37:05.762743] [DEBUG] [LOCAL ] BWG: Trimmed 17447 records to 12291 (keeping 200 days of data) [2025-09-17T02:37:05.834050] [DEBUG] [LOCAL ] BWG: Primary data saved (12291 records). [2025-09-17T02:37:05.834202] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-17T02:37:05.834314] [INFO ] [MAIN ] Update Progress: 366/2369 symbols completed. BWG took 33.0s. Estimated remaining: 4h 49m 58s. Rate: 6.9 symbols/min [2025-09-17T02:37:05.938039] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T02:37:06.007659] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:06.013882] [DEBUG] [LOCAL ] BWSN: Loaded 4093 existing records from primary storage. [2025-09-17T02:37:06.014020] [INFO ] [MAIN ] BWSN: Loaded 4093 existing records. [2025-09-17T02:37:06.189125] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:06.189373] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-17T02:37:06.189433] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-17T02:37:06.189786] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-17T02:37:06.189846] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-17T02:37:06.295228] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-17T02:37:06.545508] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:07.090201] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-17T02:37:07.630264] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T02:37:07.890130] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-17T02:37:08.236930] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:37:08.356519] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T02:37:08.690133] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-11. [2025-09-17T02:37:09.177183] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T02:37:09.490163] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-17T02:37:10.290145] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-17T02:37:10.836881] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T02:37:10.843342] [INFO ] [REMOTE ] BWA: Full fetch complete (75568 records). [2025-09-17T02:37:10.843544] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-17T02:37:11.100169] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-17T02:37:11.234305] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-17T02:37:11.234409] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-17T02:37:11.235206] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-17T02:37:11.235276] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-17T02:37:11.236759] [DEBUG] [LOCAL ] BWA: Trimmed 75568 records to 52277 (keeping 200 days of data) [2025-09-17T02:37:11.564619] [DEBUG] [LOCAL ] BWA: Primary data saved (52277 records). [2025-09-17T02:37:11.564787] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-17T02:37:11.565783] [INFO ] [MAIN ] Update Progress: 367/2369 symbols completed. BWA took 43.1s. Estimated remaining: 4h 49m 33s. Rate: 6.9 symbols/min [2025-09-17T02:37:11.749763] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:11.752805] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T02:37:11.758009] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T02:37:11.762392] [INFO ] [REMOTE ] BWLP: Full fetch complete (48800 records). [2025-09-17T02:37:11.762507] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-17T02:37:11.892265] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-17T02:37:12.068441] [DEBUG] [LOCAL ] BWXT: Loaded 34954 existing records from primary storage. [2025-09-17T02:37:12.089049] [INFO ] [MAIN ] BWXT: Loaded 34954 existing records. [2025-09-17T02:37:12.353897] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-17T02:37:12.354024] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:12.354269] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-17T02:37:12.354325] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-17T02:37:12.355179] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-17T02:37:12.354486] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-17T02:37:12.355332] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-17T02:37:12.356248] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-17T02:37:12.356335] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-17T02:37:12.387057] [DEBUG] [LOCAL ] BWLP: Trimmed 48800 records to 33066 (keeping 200 days of data) [2025-09-17T02:37:12.428307] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T02:37:12.700355] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-17T02:37:12.836997] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:12.932815] [DEBUG] [LOCAL ] BWLP: Primary data saved (33066 records). [2025-09-17T02:37:12.932975] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-17T02:37:12.933062] [INFO ] [MAIN ] Update Progress: 368/2369 symbols completed. BWLP took 38.5s. Estimated remaining: 4h 48m 45s. Rate: 6.9 symbols/min [2025-09-17T02:37:13.104801] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:13.146818] [DEBUG] [LOCAL ] BX: Loaded 39866 existing records from primary storage. [2025-09-17T02:37:13.146979] [INFO ] [MAIN ] BX: Loaded 39866 existing records. [2025-09-17T02:37:13.248799] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T02:37:13.329250] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:13.329529] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-17T02:37:13.329589] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-17T02:37:13.330541] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-17T02:37:13.330601] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-17T02:37:13.502008] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-11. [2025-09-17T02:37:13.688070] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:14.290157] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-17T02:37:14.753501] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T02:37:15.090107] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-17T02:37:15.307682] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T02:37:15.740508] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T02:37:15.890137] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-17T02:37:16.690148] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-17T02:37:17.132005] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T02:37:17.490095] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-11. [2025-09-17T02:37:17.604191] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T02:37:18.290140] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-17T02:37:18.988201] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T02:37:19.060317] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T02:37:19.090091] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-17T02:37:19.794420] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T02:37:19.890174] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-17T02:37:20.690192] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-17T02:37:21.490168] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-17T02:37:21.691424] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T02:37:21.976422] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T02:37:22.290139] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-17T02:37:22.596780] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T02:37:22.769527] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T02:37:23.090188] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-17T02:37:23.450241] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T02:37:23.451315] [INFO ] [REMOTE ] BWSN: Full fetch complete (6219 records). [2025-09-17T02:37:23.451401] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-17T02:37:23.850430] [DEBUG] [VALIDATOR ] BWSN: All expected trading days are present. [2025-09-17T02:37:23.850565] [DEBUG] [VALIDATOR ] BWSN: Primary data validation passed. [2025-09-17T02:37:23.850776] [INFO ] [MAIN ] BWSN: Fetched primary data is valid. [2025-09-17T02:37:23.850832] [DEBUG] [LOCAL ] BWSN: Saving primary data. [2025-09-17T02:37:23.851322] [DEBUG] [LOCAL ] BWSN: Trimmed 6219 records to 5150 (keeping 200 days of data) [2025-09-17T02:37:23.883748] [DEBUG] [LOCAL ] BWSN: Primary data saved (5150 records). [2025-09-17T02:37:23.883892] [INFO ] [MAIN ] BWSN: Full history saved. [2025-09-17T02:37:23.883987] [INFO ] [MAIN ] Update Progress: 369/2369 symbols completed. BWSN took 18.0s. Estimated remaining: 4h 48m 48s. Rate: 6.9 symbols/min [2025-09-17T02:37:23.890092] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-17T02:37:24.056539] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:24.068402] [DEBUG] [LOCAL ] BXC: Loaded 10137 existing records from primary storage. [2025-09-17T02:37:24.068565] [INFO ] [MAIN ] BXC: Loaded 10137 existing records. [2025-09-17T02:37:24.294376] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:24.294744] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-17T02:37:24.294825] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-17T02:37:24.295332] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-17T02:37:24.295415] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-17T02:37:24.661835] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:24.690135] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-17T02:37:24.742789] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T02:37:25.490150] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-11. [2025-09-17T02:37:26.290195] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-17T02:37:26.339397] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T02:37:26.655671] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T02:37:26.869000] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T02:37:27.090136] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-17T02:37:27.890185] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-17T02:37:27.957894] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T02:37:28.690214] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-17T02:37:29.490167] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-17T02:37:29.757582] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T02:37:30.290140] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-17T02:37:30.350190] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T02:37:30.379199] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:37:31.090126] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-17T02:37:31.852467] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T02:37:31.890098] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-17T02:37:32.285573] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T02:37:32.690149] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-17T02:37:33.490138] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-17T02:37:33.508008] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T02:37:33.536581] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T02:37:34.290184] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-17T02:37:35.090148] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-17T02:37:35.694877] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T02:37:35.890114] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-17T02:37:35.984930] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T02:37:36.002980] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T02:37:36.690139] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-17T02:37:37.490091] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-17T02:37:37.601121] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T02:37:37.623748] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T02:37:37.881886] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-17T02:37:38.290193] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-17T02:37:39.090183] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-17T02:37:39.150228] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T02:37:39.560752] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T02:37:39.890228] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-17T02:37:40.690163] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-17T02:37:40.814766] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T02:37:41.490155] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-17T02:37:42.290190] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-17T02:37:42.457894] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T02:37:42.569789] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T02:37:42.641146] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-17T02:37:43.090154] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-17T02:37:43.661083] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T02:37:43.662238] [INFO ] [REMOTE ] BWNB: Full fetch complete (5687 records). [2025-09-17T02:37:43.662324] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-17T02:37:43.895288] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-17T02:37:44.035224] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-17T02:37:44.035325] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-17T02:37:44.035508] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-17T02:37:44.035565] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-17T02:37:44.036020] [DEBUG] [LOCAL ] BWNB: Trimmed 5687 records to 4520 (keeping 200 days of data) [2025-09-17T02:37:44.064128] [DEBUG] [LOCAL ] BWNB: Primary data saved (4520 records). [2025-09-17T02:37:44.064247] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-17T02:37:44.064333] [INFO ] [MAIN ] Update Progress: 370/2369 symbols completed. BWNB took 40.1s. Estimated remaining: 4h 49m 42s. Rate: 6.9 symbols/min [2025-09-17T02:37:44.233128] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:44.269729] [DEBUG] [LOCAL ] BXMT: Loaded 34285 existing records from primary storage. [2025-09-17T02:37:44.269929] [INFO ] [MAIN ] BXMT: Loaded 34285 existing records. [2025-09-17T02:37:44.446770] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:44.447021] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-17T02:37:44.447079] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-17T02:37:44.447886] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-17T02:37:44.447947] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-17T02:37:44.699258] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-17T02:37:44.807914] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:44.949930] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T02:37:45.490146] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-17T02:37:46.290160] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-17T02:37:46.309290] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T02:37:46.311108] [INFO ] [REMOTE ] BXC: Full fetch complete (17376 records). [2025-09-17T02:37:46.311193] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-17T02:37:46.688514] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-17T02:37:46.688698] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-17T02:37:46.689075] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-17T02:37:46.689196] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-17T02:37:46.689927] [DEBUG] [LOCAL ] BXC: Trimmed 17376 records to 13555 (keeping 200 days of data) [2025-09-17T02:37:46.795685] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T02:37:46.816551] [DEBUG] [LOCAL ] BXC: Primary data saved (13555 records). [2025-09-17T02:37:46.816704] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-17T02:37:46.816792] [INFO ] [MAIN ] Update Progress: 371/2369 symbols completed. BXC took 22.9s. Estimated remaining: 4h 49m 1s. Rate: 6.9 symbols/min [2025-09-17T02:37:46.985245] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:46.999708] [DEBUG] [LOCAL ] BXMX: Loaded 13505 existing records from primary storage. [2025-09-17T02:37:46.999845] [INFO ] [MAIN ] BXMX: Loaded 13505 existing records. [2025-09-17T02:37:47.097682] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-11. [2025-09-17T02:37:47.179431] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:47.179707] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-17T02:37:47.179768] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-17T02:37:47.180294] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-17T02:37:47.180354] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-17T02:37:47.568929] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:47.890148] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-11. [2025-09-17T02:37:48.071852] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T02:37:48.690108] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-17T02:37:48.745012] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T02:37:48.937359] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T02:37:49.490167] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-17T02:37:50.290183] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-17T02:37:50.557888] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:37:50.580868] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:37:51.090143] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-17T02:37:51.890129] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-17T02:37:51.972562] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T02:37:52.598093] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T02:37:52.690145] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-17T02:37:52.973200] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T02:37:53.490151] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-17T02:37:53.748755] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:37:54.290146] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-17T02:37:55.090199] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-17T02:37:55.243372] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T02:37:55.250437] [INFO ] [REMOTE ] BX: Full fetch complete (77261 records). [2025-09-17T02:37:55.250693] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-17T02:37:55.664222] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-17T02:37:55.667049] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T02:37:55.667113] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-17T02:37:55.673142] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-17T02:37:55.673559] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-17T02:37:55.676798] [DEBUG] [LOCAL ] BX: Trimmed 77261 records to 53502 (keeping 200 days of data) [2025-09-17T02:37:55.897954] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-17T02:37:56.017752] [DEBUG] [LOCAL ] BX: Primary data saved (53502 records). [2025-09-17T02:37:56.017909] [INFO ] [MAIN ] BX: Full history saved. [2025-09-17T02:37:56.018008] [INFO ] [MAIN ] Update Progress: 372/2369 symbols completed. BX took 43.1s. Estimated remaining: 4h 48m 55s. Rate: 6.9 symbols/min [2025-09-17T02:37:56.194048] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:37:56.233750] [DEBUG] [LOCAL ] BXP: Loaded 36936 existing records from primary storage. [2025-09-17T02:37:56.233952] [INFO ] [MAIN ] BXP: Loaded 36936 existing records. [2025-09-17T02:37:56.411796] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:37:56.412050] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-17T02:37:56.412108] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-17T02:37:56.412975] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-17T02:37:56.413040] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-17T02:37:56.695200] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-17T02:37:56.813314] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:37:56.933473] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T02:37:57.385559] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T02:37:57.490094] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-17T02:37:57.881677] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T02:37:58.290136] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-17T02:37:59.017049] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T02:37:59.090160] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-17T02:37:59.890156] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-17T02:38:00.288056] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T02:38:00.690110] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-17T02:38:00.815683] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T02:38:00.950775] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T02:38:01.490135] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-17T02:38:02.186570] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T02:38:02.193352] [INFO ] [REMOTE ] BWXT: Full fetch complete (66713 records). [2025-09-17T02:38:02.193540] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-17T02:38:02.290173] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-17T02:38:02.606424] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-17T02:38:02.606538] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-17T02:38:02.607266] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-17T02:38:02.607327] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-17T02:38:02.608750] [DEBUG] [LOCAL ] BWXT: Trimmed 66713 records to 46628 (keeping 200 days of data) [2025-09-17T02:38:02.928022] [DEBUG] [LOCAL ] BWXT: Primary data saved (46628 records). [2025-09-17T02:38:02.928311] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-17T02:38:02.929072] [INFO ] [MAIN ] Update Progress: 373/2369 symbols completed. BWXT took 51.4s. Estimated remaining: 4h 48m 37s. Rate: 6.9 symbols/min [2025-09-17T02:38:03.109600] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-11. [2025-09-17T02:38:03.112995] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:03.157675] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T02:38:03.185791] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T02:38:03.231771] [DEBUG] [LOCAL ] BXSL: Loaded 34756 existing records from primary storage. [2025-09-17T02:38:03.232023] [INFO ] [MAIN ] BXSL: Loaded 34756 existing records. [2025-09-17T02:38:03.425761] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:38:03.426144] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-17T02:38:03.426221] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-17T02:38:03.427226] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-17T02:38:03.427302] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-17T02:38:03.807184] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:03.890141] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-17T02:38:04.638091] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T02:38:04.690117] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-11. [2025-09-17T02:38:04.816434] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T02:38:05.490130] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-17T02:38:06.290119] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-17T02:38:06.366520] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T02:38:06.834939] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T02:38:07.090143] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-17T02:38:07.624570] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T02:38:07.686589] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T02:38:07.890116] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-17T02:38:08.690152] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-17T02:38:09.141098] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T02:38:09.490204] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-17T02:38:10.290183] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-17T02:38:10.337539] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T02:38:11.090116] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-17T02:38:11.121580] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T02:38:11.701503] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T02:38:11.703982] [INFO ] [REMOTE ] BXMX: Full fetch complete (28484 records). [2025-09-17T02:38:11.704144] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-17T02:38:11.893341] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-17T02:38:12.087309] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-17T02:38:12.087429] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-17T02:38:12.088091] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-17T02:38:12.088189] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-17T02:38:12.089272] [DEBUG] [LOCAL ] BXMX: Trimmed 28484 records to 19672 (keeping 200 days of data) [2025-09-17T02:38:12.117073] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T02:38:12.246038] [DEBUG] [LOCAL ] BXMX: Primary data saved (19672 records). [2025-09-17T02:38:12.246201] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-17T02:38:12.246311] [INFO ] [MAIN ] Update Progress: 374/2369 symbols completed. BXMX took 25.4s. Estimated remaining: 4h 48m 32s. Rate: 6.9 symbols/min [2025-09-17T02:38:12.413972] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:12.414159] [DEBUG] [LOCAL ] BY: No existing data file found in primary storage. [2025-09-17T02:38:12.414208] [WARN ] [MAIN ] BY: No existing data found, performing full refresh instead. [2025-09-17T02:38:12.414312] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-17T02:38:12.414364] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-17T02:38:12.414415] [DEBUG] [LOCAL ] BY: No primary data file found to delete. [2025-09-17T02:38:12.414457] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-17T02:38:12.695321] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-17T02:38:12.772198] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:13.490201] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-11. [2025-09-17T02:38:13.712294] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T02:38:14.065478] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:38:14.163415] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T02:38:14.290167] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-17T02:38:14.956813] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T02:38:15.090145] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-17T02:38:15.890148] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-17T02:38:16.690184] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-17T02:38:16.894493] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T02:38:17.109038] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T02:38:17.490170] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-17T02:38:17.716299] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T02:38:18.290150] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-17T02:38:18.664343] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:38:19.090211] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-17T02:38:19.890169] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-17T02:38:19.975819] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T02:38:20.690143] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-17T02:38:20.740808] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T02:38:20.801098] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T02:38:21.490163] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-17T02:38:22.290271] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-17T02:38:22.313156] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:38:22.318987] [INFO ] [REMOTE ] BXMT: Full fetch complete (69179 records). [2025-09-17T02:38:22.319200] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-17T02:38:22.723509] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-17T02:38:22.723628] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-17T02:38:22.724618] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-17T02:38:22.724711] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-17T02:38:22.726187] [DEBUG] [LOCAL ] BXMT: Trimmed 69179 records to 47249 (keeping 200 days of data) [2025-09-17T02:38:23.027027] [DEBUG] [LOCAL ] BXMT: Primary data saved (47249 records). [2025-09-17T02:38:23.027287] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-17T02:38:23.027420] [INFO ] [MAIN ] Update Progress: 375/2369 symbols completed. BXMT took 39.0s. Estimated remaining: 4h 48m 34s. Rate: 6.9 symbols/min [2025-09-17T02:38:23.091030] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-17T02:38:23.204498] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:23.218943] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T02:38:23.253172] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T02:38:23.290839] [DEBUG] [LOCAL ] BYD: Loaded 33670 existing records from primary storage. [2025-09-17T02:38:23.291028] [INFO ] [MAIN ] BYD: Loaded 33670 existing records. [2025-09-17T02:38:23.475593] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:38:23.475901] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-17T02:38:23.475973] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-17T02:38:23.476911] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-17T02:38:23.476977] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-17T02:38:23.832243] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:23.890156] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-17T02:38:24.690120] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-11. [2025-09-17T02:38:24.792695] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T02:38:25.071956] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T02:38:25.490122] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-17T02:38:26.291176] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-17T02:38:26.296999] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T02:38:27.091463] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-17T02:38:27.100530] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T02:38:27.890124] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-17T02:38:28.008263] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T02:38:28.361790] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T02:38:28.690143] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-17T02:38:29.126462] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T02:38:29.490190] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-17T02:38:30.243818] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:38:30.290104] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-17T02:38:30.462763] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T02:38:31.090179] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-17T02:38:31.511462] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T02:38:31.890155] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-17T02:38:31.891926] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T02:38:32.690172] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-17T02:38:33.269774] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T02:38:33.490133] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-17T02:38:34.290176] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-17T02:38:34.465556] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:38:34.822856] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T02:38:34.829397] [INFO ] [REMOTE ] BXSL: Full fetch complete (68866 records). [2025-09-17T02:38:34.829629] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-17T02:38:35.095421] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-17T02:38:35.234832] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-17T02:38:35.234946] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-17T02:38:35.235765] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-17T02:38:35.235831] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-17T02:38:35.237252] [DEBUG] [LOCAL ] BXSL: Trimmed 68866 records to 47311 (keeping 200 days of data) [2025-09-17T02:38:35.531724] [DEBUG] [LOCAL ] BXSL: Primary data saved (47311 records). [2025-09-17T02:38:35.531910] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-17T02:38:35.533255] [INFO ] [MAIN ] Update Progress: 376/2369 symbols completed. BXSL took 32.6s. Estimated remaining: 4h 48m 46s. Rate: 6.9 symbols/min [2025-09-17T02:38:35.709988] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:35.722031] [DEBUG] [LOCAL ] BYM: Loaded 8475 existing records from primary storage. [2025-09-17T02:38:35.722196] [INFO ] [MAIN ] BYM: Loaded 8475 existing records. [2025-09-17T02:38:35.910292] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-17T02:38:35.944926] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:38:35.947464] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T02:38:35.958419] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-17T02:38:35.958539] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-17T02:38:35.959012] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-17T02:38:35.959098] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-17T02:38:36.328009] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:36.690135] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-17T02:38:36.887069] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:38:37.104278] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T02:38:37.490137] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-17T02:38:38.019743] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T02:38:38.290147] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-17T02:38:39.090172] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-17T02:38:39.153417] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T02:38:39.310378] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T02:38:39.890177] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-11. [2025-09-17T02:38:40.678295] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T02:38:40.694698] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-17T02:38:40.695905] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T02:38:41.490157] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-17T02:38:42.095867] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T02:38:42.118489] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T02:38:42.123564] [INFO ] [REMOTE ] BY: Full fetch complete (28658 records). [2025-09-17T02:38:42.123869] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-17T02:38:42.290285] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-17T02:38:42.531374] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-17T02:38:42.531479] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-17T02:38:42.531926] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-17T02:38:42.531980] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-17T02:38:42.532706] [DEBUG] [LOCAL ] BY: Trimmed 28658 records to 21379 (keeping 200 days of data) [2025-09-17T02:38:42.664385] [DEBUG] [LOCAL ] BY: Primary data saved (21379 records). [2025-09-17T02:38:42.664537] [INFO ] [MAIN ] BY: Full history saved. [2025-09-17T02:38:42.664656] [INFO ] [MAIN ] Update Progress: 377/2369 symbols completed. BY took 30.4s. Estimated remaining: 4h 48m 29s. Rate: 6.9 symbols/min [2025-09-17T02:38:42.870794] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:42.895231] [DEBUG] [LOCAL ] BZH: Loaded 24301 existing records from primary storage. [2025-09-17T02:38:42.895387] [INFO ] [MAIN ] BZH: Loaded 24301 existing records. [2025-09-17T02:38:43.075192] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:38:43.075459] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-17T02:38:43.075519] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-17T02:38:43.076203] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-17T02:38:43.076264] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-17T02:38:43.096284] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-17T02:38:43.431675] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:43.873349] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T02:38:43.879734] [INFO ] [REMOTE ] BXP: Full fetch complete (70975 records). [2025-09-17T02:38:43.879903] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-17T02:38:43.895309] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-11. [2025-09-17T02:38:44.277259] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T02:38:44.277393] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-17T02:38:44.281320] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-17T02:38:44.282224] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-17T02:38:44.282286] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-17T02:38:44.283795] [DEBUG] [LOCAL ] BXP: Trimmed 70975 records to 49916 (keeping 200 days of data) [2025-09-17T02:38:44.598837] [DEBUG] [LOCAL ] BXP: Primary data saved (49916 records). [2025-09-17T02:38:44.599005] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-17T02:38:44.599101] [INFO ] [MAIN ] Update Progress: 378/2369 symbols completed. BXP took 48.6s. Estimated remaining: 4h 47m 45s. Rate: 6.9 symbols/min [2025-09-17T02:38:44.695365] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-17T02:38:44.769210] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:44.769392] [DEBUG] [LOCAL ] C: No existing data file found in primary storage. [2025-09-17T02:38:44.769440] [WARN ] [MAIN ] C: No existing data found, performing full refresh instead. [2025-09-17T02:38:44.769551] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-17T02:38:44.769595] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-17T02:38:44.769662] [DEBUG] [LOCAL ] C: No primary data file found to delete. [2025-09-17T02:38:44.769707] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-17T02:38:45.121470] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:45.140124] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T02:38:45.490141] [INFO ] [REMOTE ] C: Fetching primary data for 2024-11. [2025-09-17T02:38:46.290142] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-17T02:38:46.430518] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T02:38:46.953237] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T02:38:47.090124] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-17T02:38:47.240553] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T02:38:47.850942] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T02:38:47.890190] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-17T02:38:48.690262] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-17T02:38:49.375289] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T02:38:49.473127] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T02:38:49.490076] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-17T02:38:50.290132] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-17T02:38:50.861735] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T02:38:50.867323] [INFO ] [REMOTE ] BYD: Full fetch complete (64811 records). [2025-09-17T02:38:50.867511] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-17T02:38:51.095236] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-17T02:38:51.259190] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-17T02:38:51.259297] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-17T02:38:51.260065] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-17T02:38:51.260167] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-17T02:38:51.261550] [DEBUG] [LOCAL ] BYD: Trimmed 64811 records to 45406 (keeping 200 days of data) [2025-09-17T02:38:51.552686] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T02:38:51.565782] [DEBUG] [LOCAL ] BYD: Primary data saved (45406 records). [2025-09-17T02:38:51.565890] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-17T02:38:51.565999] [INFO ] [MAIN ] Update Progress: 379/2369 symbols completed. BYD took 28.5s. Estimated remaining: 4h 47m 27s. Rate: 6.9 symbols/min [2025-09-17T02:38:51.740124] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:38:51.753919] [DEBUG] [LOCAL ] CAAP: Loaded 13352 existing records from primary storage. [2025-09-17T02:38:51.754101] [INFO ] [MAIN ] CAAP: Loaded 13352 existing records. [2025-09-17T02:38:51.895406] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-17T02:38:51.935186] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:38:51.935366] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-17T02:38:51.935449] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-17T02:38:51.936000] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-17T02:38:51.936078] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-17T02:38:52.301041] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:38:52.301966] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T02:38:52.690085] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-17T02:38:53.039854] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T02:38:53.490115] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-17T02:38:53.593214] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T02:38:54.290169] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-17T02:38:54.474954] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T02:38:55.096124] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-11. [2025-09-17T02:38:55.097891] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T02:38:55.890120] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-17T02:38:56.187767] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T02:38:56.690151] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-17T02:38:57.338012] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T02:38:57.490128] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-17T02:38:58.290103] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-17T02:38:58.391057] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T02:38:58.743353] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-17T02:38:59.090127] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-17T02:38:59.331697] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T02:38:59.849844] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T02:38:59.890083] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-17T02:39:00.690140] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-17T02:39:00.736571] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T02:39:00.738757] [INFO ] [REMOTE ] BYM: Full fetch complete (17968 records). [2025-09-17T02:39:00.738843] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-17T02:39:01.103999] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-17T02:39:01.104102] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-17T02:39:01.104423] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-17T02:39:01.104476] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-17T02:39:01.105119] [DEBUG] [LOCAL ] BYM: Trimmed 17968 records to 12284 (keeping 200 days of data) [2025-09-17T02:39:01.194892] [DEBUG] [LOCAL ] BYM: Primary data saved (12284 records). [2025-09-17T02:39:01.195074] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-17T02:39:01.195168] [INFO ] [MAIN ] Update Progress: 380/2369 symbols completed. BYM took 25.7s. Estimated remaining: 4h 47m 23s. Rate: 6.9 symbols/min [2025-09-17T02:39:01.373279] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:01.373499] [DEBUG] [LOCAL ] CABO: No existing data file found in primary storage. [2025-09-17T02:39:01.373549] [WARN ] [MAIN ] CABO: No existing data found, performing full refresh instead. [2025-09-17T02:39:01.373672] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-17T02:39:01.373722] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-17T02:39:01.373771] [DEBUG] [LOCAL ] CABO: No primary data file found to delete. [2025-09-17T02:39:01.373811] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-17T02:39:01.495243] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-17T02:39:01.732319] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:02.290143] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-11. [2025-09-17T02:39:02.441596] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:39:03.090128] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-17T02:39:03.890120] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-17T02:39:04.175835] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-09-17T02:39:04.690131] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-17T02:39:04.704791] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-11 (2.41 seconds). [2025-09-17T02:39:05.457320] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T02:39:05.493429] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-17T02:39:05.498319] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T02:39:05.685120] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.59 seconds). [2025-09-17T02:39:06.290208] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-17T02:39:06.702753] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T02:39:07.090182] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-17T02:39:07.192932] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T02:39:07.890197] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-17T02:39:08.448948] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T02:39:08.690181] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-17T02:39:09.490099] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-17T02:39:09.691065] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T02:39:09.992507] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T02:39:10.290147] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-17T02:39:10.680937] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:39:10.685345] [INFO ] [REMOTE ] BZH: Full fetch complete (46846 records). [2025-09-17T02:39:10.685456] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-17T02:39:11.013323] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T02:39:11.093525] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-17T02:39:11.094904] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-17T02:39:11.094993] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-17T02:39:11.095844] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-17T02:39:11.095926] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-17T02:39:11.098012] [DEBUG] [LOCAL ] BZH: Trimmed 46846 records to 32935 (keeping 200 days of data) [2025-09-17T02:39:11.296636] [DEBUG] [LOCAL ] BZH: Primary data saved (32935 records). [2025-09-17T02:39:11.296845] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-17T02:39:11.296951] [INFO ] [MAIN ] Update Progress: 381/2369 symbols completed. BZH took 28.6s. Estimated remaining: 4h 47m 22s. Rate: 6.9 symbols/min [2025-09-17T02:39:11.465888] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:11.466080] [DEBUG] [LOCAL ] CACI: No existing data file found in primary storage. [2025-09-17T02:39:11.466122] [WARN ] [MAIN ] CACI: No existing data found, performing full refresh instead. [2025-09-17T02:39:11.466228] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-17T02:39:11.466279] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-17T02:39:11.466329] [DEBUG] [LOCAL ] CACI: No primary data file found to delete. [2025-09-17T02:39:11.466372] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-17T02:39:11.823653] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:11.890135] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-17T02:39:12.690215] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-17T02:39:13.058997] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T02:39:13.272278] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T02:39:13.329978] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T02:39:13.490130] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-17T02:39:14.290115] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-17T02:39:14.608240] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T02:39:15.090176] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-17T02:39:15.890173] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-17T02:39:16.522601] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T02:39:16.649013] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-17T02:39:16.690088] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-17T02:39:17.288844] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T02:39:17.490136] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-17T02:39:18.290203] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-17T02:39:18.461233] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T02:39:18.724860] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T02:39:18.954341] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T02:39:19.090182] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-17T02:39:19.890223] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-17T02:39:20.690147] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-11. [2025-09-17T02:39:21.069082] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:39:21.153977] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T02:39:21.490199] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-17T02:39:21.907181] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T02:39:22.102506] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T02:39:22.290147] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-17T02:39:22.972469] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T02:39:23.090144] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-17T02:39:23.890177] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-17T02:39:24.690279] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-17T02:39:25.065455] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T02:39:25.439744] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-17T02:39:25.478871] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T02:39:25.490089] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-17T02:39:26.181375] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T02:39:26.184742] [INFO ] [REMOTE ] CAAP: Full fetch complete (27241 records). [2025-09-17T02:39:26.184862] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-17T02:39:26.293429] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-17T02:39:26.580988] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-17T02:39:26.581091] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-17T02:39:26.581494] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-17T02:39:26.581572] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-17T02:39:26.582371] [DEBUG] [LOCAL ] CAAP: Trimmed 27241 records to 18993 (keeping 200 days of data) [2025-09-17T02:39:26.703449] [DEBUG] [LOCAL ] CAAP: Primary data saved (18993 records). [2025-09-17T02:39:26.703614] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-17T02:39:26.703774] [INFO ] [MAIN ] Update Progress: 382/2369 symbols completed. CAAP took 35.1s. Estimated remaining: 4h 47m 49s. Rate: 6.9 symbols/min [2025-09-17T02:39:26.875483] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:26.910473] [DEBUG] [LOCAL ] CADE: Loaded 36711 existing records from primary storage. [2025-09-17T02:39:26.910684] [INFO ] [MAIN ] CADE: Loaded 36711 existing records. [2025-09-17T02:39:27.094482] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:39:27.090633] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-17T02:39:27.095510] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-17T02:39:27.095588] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-17T02:39:27.096773] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-17T02:39:27.096852] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-17T02:39:27.473383] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:27.890100] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-17T02:39:28.432766] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T02:39:28.618178] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T02:39:28.690138] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-17T02:39:28.888186] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:39:29.490170] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-17T02:39:30.160814] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T02:39:30.290133] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-11. [2025-09-17T02:39:31.090192] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-17T02:39:31.412744] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T02:39:31.419326] [INFO ] [REMOTE ] C: Full fetch complete (77676 records). [2025-09-17T02:39:31.419468] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-17T02:39:31.822620] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-17T02:39:31.822832] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-17T02:39:31.824036] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-17T02:39:31.824259] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-17T02:39:31.826112] [DEBUG] [LOCAL ] C: Trimmed 77676 records to 53741 (keeping 200 days of data) [2025-09-17T02:39:31.894483] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-17T02:39:31.949801] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T02:39:32.219934] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-09-17T02:39:32.220103] [INFO ] [MAIN ] C: Full history saved. [2025-09-17T02:39:32.220191] [INFO ] [MAIN ] Update Progress: 383/2369 symbols completed. C took 47.6s. Estimated remaining: 4h 47m 23s. Rate: 6.9 symbols/min [2025-09-17T02:39:32.393324] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:32.420822] [DEBUG] [LOCAL ] CAE: Loaded 28505 existing records from primary storage. [2025-09-17T02:39:32.420997] [INFO ] [MAIN ] CAE: Loaded 28505 existing records. [2025-09-17T02:39:32.616184] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:39:32.616599] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-17T02:39:32.616715] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-17T02:39:32.617519] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-17T02:39:32.617595] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-17T02:39:32.694191] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-17T02:39:32.822015] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T02:39:33.061543] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:33.072289] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T02:39:33.490188] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-11. [2025-09-17T02:39:34.290167] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-17T02:39:34.422455] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T02:39:35.032118] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T02:39:35.090084] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-17T02:39:35.822393] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T02:39:35.890155] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-17T02:39:36.302954] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T02:39:36.690173] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-17T02:39:36.800628] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T02:39:37.490160] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-17T02:39:38.290112] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-17T02:39:38.329225] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T02:39:38.331410] [INFO ] [REMOTE ] CABO: Full fetch complete (22870 records). [2025-09-17T02:39:38.331513] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-17T02:39:38.693277] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T02:39:38.791928] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-17T02:39:38.792041] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-17T02:39:38.792451] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-17T02:39:38.792505] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-17T02:39:38.793218] [DEBUG] [LOCAL ] CABO: Trimmed 22870 records to 17848 (keeping 200 days of data) [2025-09-17T02:39:38.913937] [DEBUG] [LOCAL ] CABO: Primary data saved (17848 records). [2025-09-17T02:39:38.914125] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-17T02:39:38.914216] [INFO ] [MAIN ] Update Progress: 384/2369 symbols completed. CABO took 37.7s. Estimated remaining: 4h 47m 5s. Rate: 6.9 symbols/min [2025-09-17T02:39:39.087037] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:39.091319] [DEBUG] [LOCAL ] CAF: Loaded 2322 existing records from primary storage. [2025-09-17T02:39:39.091417] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-17T02:39:39.091774] [INFO ] [MAIN ] CAF: Loaded 2322 existing records. [2025-09-17T02:39:39.271189] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:39:39.271459] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-17T02:39:39.271524] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-17T02:39:39.271753] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-17T02:39:39.271810] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-17T02:39:39.630820] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:39.652422] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T02:39:39.890152] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-11. [2025-09-17T02:39:40.240546] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T02:39:40.526261] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T02:39:40.690150] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-17T02:39:41.490165] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-17T02:39:42.168801] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T02:39:42.290126] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-17T02:39:42.720021] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T02:39:43.090102] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-17T02:39:43.658816] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T02:39:43.739318] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T02:39:43.890088] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-17T02:39:44.337274] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T02:39:44.690132] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-17T02:39:45.490167] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-17T02:39:46.257919] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T02:39:46.290131] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-17T02:39:46.972948] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T02:39:47.090120] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-17T02:39:47.466231] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-17T02:39:47.890161] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-17T02:39:47.933372] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T02:39:48.690182] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-17T02:39:49.111853] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T02:39:49.490116] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-17T02:39:50.290216] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-17T02:39:50.431162] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:39:50.954931] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:39:51.077989] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T02:39:51.090089] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-17T02:39:51.890141] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-17T02:39:52.005446] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:39:52.008176] [INFO ] [REMOTE ] CACI: Full fetch complete (39251 records). [2025-09-17T02:39:52.008289] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-17T02:39:52.344455] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T02:39:52.449280] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-17T02:39:52.449381] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-17T02:39:52.449890] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-17T02:39:52.449947] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-17T02:39:52.450856] [DEBUG] [LOCAL ] CACI: Trimmed 39251 records to 26198 (keeping 200 days of data) [2025-09-17T02:39:52.609749] [DEBUG] [LOCAL ] CACI: Primary data saved (26198 records). [2025-09-17T02:39:52.609908] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-17T02:39:52.609999] [INFO ] [MAIN ] Update Progress: 385/2369 symbols completed. CACI took 41.3s. Estimated remaining: 4h 47m 22s. Rate: 6.9 symbols/min [2025-09-17T02:39:52.695260] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-17T02:39:52.788580] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:39:52.828205] [DEBUG] [LOCAL ] CAG: Loaded 40018 existing records from primary storage. [2025-09-17T02:39:52.828392] [INFO ] [MAIN ] CAG: Loaded 40018 existing records. [2025-09-17T02:39:53.015343] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:39:53.015618] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-17T02:39:53.015701] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-17T02:39:53.016728] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-17T02:39:53.016786] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-17T02:39:53.391699] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:39:53.490147] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-17T02:39:54.068325] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T02:39:54.290314] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-11. [2025-09-17T02:39:54.293506] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T02:39:55.090129] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-17T02:39:55.890164] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-17T02:39:56.083661] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T02:39:56.496748] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T02:39:56.690134] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-17T02:39:56.763490] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T02:39:57.490128] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-17T02:39:58.290116] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-17T02:39:58.331490] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T02:39:58.698802] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T02:39:59.090144] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-17T02:39:59.856449] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T02:39:59.890092] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-17T02:40:00.642034] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:40:00.690123] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-17T02:40:00.807332] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:40:00.811927] [INFO ] [REMOTE ] CAE: Full fetch complete (55498 records). [2025-09-17T02:40:00.812068] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-17T02:40:01.227123] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-17T02:40:01.227261] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-17T02:40:01.228007] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-17T02:40:01.228078] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-17T02:40:01.229710] [DEBUG] [LOCAL ] CAE: Trimmed 55498 records to 38936 (keeping 200 days of data) [2025-09-17T02:40:01.466041] [DEBUG] [LOCAL ] CAE: Primary data saved (38936 records). [2025-09-17T02:40:01.466216] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-17T02:40:01.466314] [INFO ] [MAIN ] Update Progress: 386/2369 symbols completed. CAE took 29.2s. Estimated remaining: 4h 47m 14s. Rate: 6.9 symbols/min [2025-09-17T02:40:01.490706] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-17T02:40:01.650758] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:01.689819] [DEBUG] [LOCAL ] CAH: Loaded 38301 existing records from primary storage. [2025-09-17T02:40:01.690001] [INFO ] [MAIN ] CAH: Loaded 38301 existing records. [2025-09-17T02:40:01.876948] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:01.877262] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-17T02:40:01.877353] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-17T02:40:01.878441] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-17T02:40:01.878516] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-17T02:40:02.160794] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T02:40:02.277880] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:02.290089] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-11. [2025-09-17T02:40:02.514852] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T02:40:03.090136] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-17T02:40:03.591983] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T02:40:03.890131] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-17T02:40:04.133736] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T02:40:04.690147] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-17T02:40:05.201155] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T02:40:05.490124] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-17T02:40:05.605501] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T02:40:05.858848] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T02:40:05.859913] [INFO ] [REMOTE ] CAF: Full fetch complete (5904 records). [2025-09-17T02:40:05.859994] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-17T02:40:06.288772] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-17T02:40:06.288899] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-17T02:40:06.289136] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-17T02:40:06.289191] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-17T02:40:06.289845] [DEBUG] [LOCAL ] CAF: Trimmed 5904 records to 3394 (keeping 200 days of data) [2025-09-17T02:40:06.290257] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-17T02:40:06.317151] [DEBUG] [LOCAL ] CAF: Primary data saved (3394 records). [2025-09-17T02:40:06.317357] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-17T02:40:06.317478] [INFO ] [MAIN ] Update Progress: 387/2369 symbols completed. CAF took 27.4s. Estimated remaining: 4h 46m 46s. Rate: 6.9 symbols/min [2025-09-17T02:40:06.489434] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:06.524267] [DEBUG] [LOCAL ] CAL: Loaded 31697 existing records from primary storage. [2025-09-17T02:40:06.524446] [INFO ] [MAIN ] CAL: Loaded 31697 existing records. [2025-09-17T02:40:06.703591] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:06.703865] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-17T02:40:06.703917] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-17T02:40:06.704800] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-17T02:40:06.704868] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-17T02:40:07.069600] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:07.090119] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-17T02:40:07.890113] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-11. [2025-09-17T02:40:08.065297] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T02:40:08.690171] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-17T02:40:08.811282] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T02:40:09.206090] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T02:40:09.490173] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-17T02:40:10.290159] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-17T02:40:10.497802] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T02:40:11.066109] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:40:11.090092] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-17T02:40:11.595436] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T02:40:11.601780] [INFO ] [REMOTE ] CADE: Full fetch complete (69399 records). [2025-09-17T02:40:11.601976] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-17T02:40:11.898766] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-17T02:40:12.006352] [DEBUG] [VALIDATOR ] CADE: All expected trading days are present. [2025-09-17T02:40:12.006476] [DEBUG] [VALIDATOR ] CADE: Primary data validation passed. [2025-09-17T02:40:12.007260] [INFO ] [MAIN ] CADE: Fetched primary data is valid. [2025-09-17T02:40:12.007324] [DEBUG] [LOCAL ] CADE: Saving primary data. [2025-09-17T02:40:12.008906] [DEBUG] [LOCAL ] CADE: Trimmed 69399 records to 48730 (keeping 200 days of data) [2025-09-17T02:40:12.265037] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T02:40:12.351611] [DEBUG] [LOCAL ] CADE: Primary data saved (48730 records). [2025-09-17T02:40:12.351804] [INFO ] [MAIN ] CADE: Full history saved. [2025-09-17T02:40:12.351933] [INFO ] [MAIN ] Update Progress: 388/2369 symbols completed. CADE took 45.6s. Estimated remaining: 4h 46m 23s. Rate: 6.9 symbols/min [2025-09-17T02:40:12.522697] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:12.551850] [DEBUG] [LOCAL ] CALX: Loaded 28624 existing records from primary storage. [2025-09-17T02:40:12.552024] [INFO ] [MAIN ] CALX: Loaded 28624 existing records. [2025-09-17T02:40:12.695283] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-17T02:40:12.731873] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:12.732099] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-17T02:40:12.732158] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-17T02:40:12.732880] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-17T02:40:12.732940] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-17T02:40:13.102409] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:13.490160] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-11. [2025-09-17T02:40:13.741605] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T02:40:14.290281] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-17T02:40:14.346318] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T02:40:15.005858] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T02:40:15.090104] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-17T02:40:15.890132] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-17T02:40:15.986965] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T02:40:16.494254] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T02:40:16.690189] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-17T02:40:17.490163] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-17T02:40:17.584677] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T02:40:18.290140] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-17T02:40:18.605532] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T02:40:18.905561] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:40:19.090231] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-17T02:40:19.895278] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-17T02:40:19.909026] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T02:40:20.690161] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-17T02:40:20.967988] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T02:40:21.445802] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T02:40:21.490095] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-17T02:40:22.125016] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T02:40:22.290135] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-17T02:40:23.090171] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-17T02:40:23.218404] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:40:23.890129] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-17T02:40:24.213392] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T02:40:24.282974] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T02:40:24.690150] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-17T02:40:25.490177] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-17T02:40:25.635241] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:40:26.290150] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-17T02:40:26.551065] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T02:40:26.629711] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T02:40:27.090143] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-17T02:40:27.877364] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T02:40:27.890078] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-17T02:40:28.407010] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T02:40:28.690113] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-17T02:40:29.357936] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T02:40:29.490106] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-17T02:40:30.257405] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:40:30.290101] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-17T02:40:31.025407] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T02:40:31.090099] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-17T02:40:31.802349] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T02:40:31.890148] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-17T02:40:32.690744] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T02:40:32.690818] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-17T02:40:32.823566] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:40:33.490196] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-17T02:40:34.296597] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-17T02:40:34.325576] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T02:40:35.090167] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-17T02:40:35.314445] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T02:40:35.818051] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T02:40:35.823937] [INFO ] [REMOTE ] CAL: Full fetch complete (61608 records). [2025-09-17T02:40:35.824093] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-17T02:40:35.895269] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-17T02:40:36.241150] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-17T02:40:36.241277] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-17T02:40:36.241979] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-17T02:40:36.242069] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-17T02:40:36.243521] [DEBUG] [LOCAL ] CAL: Trimmed 61608 records to 43386 (keeping 200 days of data) [2025-09-17T02:40:36.393051] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T02:40:36.401140] [INFO ] [REMOTE ] CAG: Full fetch complete (77491 records). [2025-09-17T02:40:36.402340] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-17T02:40:36.696166] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-17T02:40:36.917886] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-17T02:40:36.917995] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-17T02:40:36.918853] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-17T02:40:36.919290] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-17T02:40:36.922835] [DEBUG] [LOCAL ] CAG: Trimmed 77491 records to 53658 (keeping 200 days of data) [2025-09-17T02:40:37.290862] [DEBUG] [LOCAL ] CAL: Primary data saved (43386 records). [2025-09-17T02:40:37.295420] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-17T02:40:37.297118] [INFO ] [MAIN ] Update Progress: 389/2369 symbols completed. CAL took 31.0s. Estimated remaining: 4h 47m 37s. Rate: 6.9 symbols/min [2025-09-17T02:40:37.483007] [DEBUG] [LOCAL ] CAG: Primary data saved (53658 records). [2025-09-17T02:40:37.484439] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:37.484615] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-17T02:40:37.485120] [INFO ] [MAIN ] Update Progress: 390/2369 symbols completed. CAG took 44.9s. Estimated remaining: 4h 46m 45s. Rate: 6.9 symbols/min [2025-09-17T02:40:37.661506] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:37.669161] [DEBUG] [LOCAL ] CANG: Loaded 20458 existing records from primary storage. [2025-09-17T02:40:37.669708] [INFO ] [MAIN ] CANG: Loaded 20458 existing records. [2025-09-17T02:40:37.774713] [DEBUG] [LOCAL ] CAPL: Loaded 3928 existing records from primary storage. [2025-09-17T02:40:37.868693] [INFO ] [MAIN ] CAPL: Loaded 3928 existing records. [2025-09-17T02:40:37.873968] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-17T02:40:37.874170] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:37.917199] [INFO ] [REMOTE ] CAH: Full fetch complete (74434 records). [2025-09-17T02:40:37.911919] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-17T02:40:37.961750] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-17T02:40:37.961828] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-17T02:40:37.988897] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-17T02:40:38.034671] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-17T02:40:38.130526] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:38.224216] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-17T02:40:38.281605] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-17T02:40:38.339003] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-17T02:40:38.339290] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-17T02:40:39.160323] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:39.170354] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-17T02:40:39.222601] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-17T02:40:39.225465] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:39.226882] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-17T02:40:39.225765] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-11. [2025-09-17T02:40:39.227591] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-11. [2025-09-17T02:40:39.229019] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-17T02:40:39.239142] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-17T02:40:39.240507] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-17T02:40:39.243794] [DEBUG] [LOCAL ] CAH: Trimmed 74434 records to 51555 (keeping 200 days of data) [2025-09-17T02:40:39.575737] [DEBUG] [LOCAL ] CAH: Primary data saved (51555 records). [2025-09-17T02:40:39.575895] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-17T02:40:39.575990] [INFO ] [MAIN ] Update Progress: 391/2369 symbols completed. CAH took 38.1s. Estimated remaining: 4h 46m 3s. Rate: 6.9 symbols/min [2025-09-17T02:40:39.752320] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:39.803508] [DEBUG] [LOCAL ] CARR: Loaded 39965 existing records from primary storage. [2025-09-17T02:40:39.803697] [INFO ] [MAIN ] CARR: Loaded 39965 existing records. [2025-09-17T02:40:39.991201] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:39.996006] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T02:40:39.995804] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-17T02:40:39.996177] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-17T02:40:39.997978] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-17T02:40:39.999777] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-17T02:40:39.999844] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-17T02:40:40.366171] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:40.448832] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T02:40:40.606001] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:40:40.690084] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-17T02:40:40.785129] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T02:40:41.490139] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-17T02:40:41.963679] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T02:40:41.968634] [INFO ] [REMOTE ] CALX: Full fetch complete (54164 records). [2025-09-17T02:40:41.968783] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-17T02:40:42.295223] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-17T02:40:42.360139] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-17T02:40:42.360259] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-17T02:40:42.360905] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-17T02:40:42.360970] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-17T02:40:42.362365] [DEBUG] [LOCAL ] CALX: Trimmed 54164 records to 38851 (keeping 200 days of data) [2025-09-17T02:40:42.608025] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T02:40:42.628130] [DEBUG] [LOCAL ] CALX: Primary data saved (38851 records). [2025-09-17T02:40:42.628298] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-17T02:40:42.628408] [INFO ] [MAIN ] Update Progress: 392/2369 symbols completed. CALX took 30.3s. Estimated remaining: 4h 45m 26s. Rate: 6.9 symbols/min [2025-09-17T02:40:42.800289] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:42.828582] [DEBUG] [LOCAL ] CARS: Loaded 29216 existing records from primary storage. [2025-09-17T02:40:42.828804] [INFO ] [MAIN ] CARS: Loaded 29216 existing records. [2025-09-17T02:40:43.008549] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:43.008811] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-17T02:40:43.008871] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-17T02:40:43.009610] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-17T02:40:43.009696] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-17T02:40:43.099431] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-11. [2025-09-17T02:40:43.227337] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T02:40:43.380219] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:43.890136] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-11. [2025-09-17T02:40:44.690143] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-17T02:40:44.884714] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T02:40:44.921923] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T02:40:45.307700] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T02:40:45.490131] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-17T02:40:46.290139] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-17T02:40:46.844252] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T02:40:47.056436] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T02:40:47.090083] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-17T02:40:47.890126] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-17T02:40:47.908959] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T02:40:48.690094] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-17T02:40:49.164847] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T02:40:49.490137] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-17T02:40:50.067898] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T02:40:50.290184] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-17T02:40:50.699687] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T02:40:50.713574] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T02:40:51.090124] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-17T02:40:51.658209] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T02:40:51.890125] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-17T02:40:52.690139] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-17T02:40:53.490225] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-17T02:40:53.533481] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T02:40:53.817750] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T02:40:54.098420] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T02:40:54.290192] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-17T02:40:55.090161] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-17T02:40:55.890153] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-17T02:40:56.085020] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T02:40:56.533062] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T02:40:56.698090] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-17T02:40:56.721125] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T02:40:57.065897] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T02:40:57.067146] [INFO ] [REMOTE ] CAPL: Full fetch complete (8944 records). [2025-09-17T02:40:57.067234] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-17T02:40:57.439366] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-17T02:40:57.439471] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-17T02:40:57.439733] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-17T02:40:57.439792] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-17T02:40:57.440435] [DEBUG] [LOCAL ] CAPL: Trimmed 8944 records to 5967 (keeping 200 days of data) [2025-09-17T02:40:57.476894] [DEBUG] [LOCAL ] CAPL: Primary data saved (5967 records). [2025-09-17T02:40:57.477025] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-17T02:40:57.477128] [INFO ] [MAIN ] Update Progress: 393/2369 symbols completed. CAPL took 20.0s. Estimated remaining: 4h 45m 49s. Rate: 6.9 symbols/min [2025-09-17T02:40:57.498784] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-17T02:40:57.654160] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:40:57.693472] [DEBUG] [LOCAL ] CAT: Loaded 39407 existing records from primary storage. [2025-09-17T02:40:57.693673] [INFO ] [MAIN ] CAT: Loaded 39407 existing records. [2025-09-17T02:40:57.870938] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:40:57.871214] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-17T02:40:57.871288] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-17T02:40:57.872376] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-17T02:40:57.872466] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-17T02:40:58.227071] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:40:58.290124] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-11. [2025-09-17T02:40:58.797497] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T02:40:59.090179] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-17T02:40:59.890121] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-17T02:41:00.155589] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T02:41:00.337101] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T02:41:00.690134] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-17T02:41:01.490186] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-17T02:41:01.683544] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T02:41:02.290188] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-17T02:41:02.324228] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T02:41:02.761258] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T02:41:03.090135] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-17T02:41:03.890139] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-17T02:41:03.947402] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T02:41:04.288732] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T02:41:04.690146] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-17T02:41:05.490153] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-17T02:41:05.926554] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T02:41:06.290140] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-17T02:41:06.661234] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T02:41:06.916751] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T02:41:07.090103] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-17T02:41:07.890130] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-17T02:41:08.374795] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-17T02:41:08.575034] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T02:41:08.690149] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-17T02:41:09.365074] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T02:41:09.490168] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-17T02:41:10.290140] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-17T02:41:10.741661] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-17T02:41:11.090151] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-17T02:41:11.369133] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T02:41:11.470575] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T02:41:11.890202] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-17T02:41:12.578850] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T02:41:12.690181] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-17T02:41:13.490126] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-17T02:41:13.717920] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T02:41:14.290187] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-17T02:41:14.742859] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T02:41:14.771662] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T02:41:14.775836] [INFO ] [REMOTE ] CANG: Full fetch complete (40389 records). [2025-09-17T02:41:14.775966] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-17T02:41:15.100898] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-17T02:41:15.148966] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-17T02:41:15.149071] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-17T02:41:15.149576] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-17T02:41:15.149629] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-17T02:41:15.150568] [DEBUG] [LOCAL ] CANG: Trimmed 40389 records to 26623 (keeping 200 days of data) [2025-09-17T02:41:15.302713] [DEBUG] [LOCAL ] CANG: Primary data saved (26623 records). [2025-09-17T02:41:15.302991] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-17T02:41:15.303188] [INFO ] [MAIN ] Update Progress: 394/2369 symbols completed. CANG took 38.0s. Estimated remaining: 4h 46m 26s. Rate: 6.9 symbols/min [2025-09-17T02:41:15.511215] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:15.544202] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T02:41:15.560690] [DEBUG] [LOCAL ] CATO: Loaded 5079 existing records from primary storage. [2025-09-17T02:41:15.560817] [INFO ] [MAIN ] CATO: Loaded 5079 existing records. [2025-09-17T02:41:15.738459] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:41:15.738739] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-17T02:41:15.738804] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-17T02:41:15.739068] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-17T02:41:15.739121] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-17T02:41:15.898490] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-17T02:41:16.106970] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:16.690164] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-11. [2025-09-17T02:41:17.268434] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T02:41:17.273219] [INFO ] [REMOTE ] CARS: Full fetch complete (55181 records). [2025-09-17T02:41:17.273352] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-17T02:41:17.498171] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-17T02:41:17.684364] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-17T02:41:17.684612] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-17T02:41:17.685677] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-17T02:41:17.685802] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-17T02:41:17.694679] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T02:41:17.698854] [DEBUG] [LOCAL ] CARS: Trimmed 55181 records to 40574 (keeping 200 days of data) [2025-09-17T02:41:17.729696] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-17T02:41:17.982439] [DEBUG] [LOCAL ] CARS: Primary data saved (40574 records). [2025-09-17T02:41:17.982592] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-17T02:41:17.982702] [INFO ] [MAIN ] Update Progress: 395/2369 symbols completed. CARS took 35.4s. Estimated remaining: 4h 45m 47s. Rate: 6.9 symbols/min [2025-09-17T02:41:18.149264] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:18.149451] [DEBUG] [LOCAL ] CAVA: No existing data file found in primary storage. [2025-09-17T02:41:18.149500] [WARN ] [MAIN ] CAVA: No existing data found, performing full refresh instead. [2025-09-17T02:41:18.149608] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-17T02:41:18.149696] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-17T02:41:18.149837] [DEBUG] [LOCAL ] CAVA: No primary data file found to delete. [2025-09-17T02:41:18.149941] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-17T02:41:18.292605] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-17T02:41:18.510042] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:19.090109] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-11. [2025-09-17T02:41:19.398460] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:41:19.610755] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T02:41:19.890135] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-17T02:41:20.690139] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-17T02:41:21.143274] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T02:41:21.490168] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-17T02:41:22.060726] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T02:41:22.217221] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T02:41:22.290126] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-17T02:41:23.090103] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-17T02:41:23.597200] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-17T02:41:23.890139] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-17T02:41:24.238737] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T02:41:24.690168] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-17T02:41:24.841077] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T02:41:24.847607] [INFO ] [REMOTE ] CARR: Full fetch complete (77432 records). [2025-09-17T02:41:24.847776] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-17T02:41:25.253776] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-17T02:41:25.253931] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-17T02:41:25.254835] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-17T02:41:25.254920] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-17T02:41:25.256539] [DEBUG] [LOCAL ] CARR: Trimmed 77432 records to 53598 (keeping 200 days of data) [2025-09-17T02:41:25.492663] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-17T02:41:25.493967] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T02:41:25.612827] [DEBUG] [LOCAL ] CARR: Primary data saved (53598 records). [2025-09-17T02:41:25.612985] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-17T02:41:25.613081] [INFO ] [MAIN ] Update Progress: 396/2369 symbols completed. CARR took 46.0s. Estimated remaining: 4h 45m 33s. Rate: 6.9 symbols/min [2025-09-17T02:41:25.794638] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:25.824500] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T02:41:25.867589] [DEBUG] [LOCAL ] CB: Loaded 37022 existing records from primary storage. [2025-09-17T02:41:25.867783] [INFO ] [MAIN ] CB: Loaded 37022 existing records. [2025-09-17T02:41:26.046435] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:41:26.046695] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-17T02:41:26.046756] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-17T02:41:26.047737] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-17T02:41:26.047813] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-17T02:41:26.295366] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-17T02:41:26.414724] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:27.090460] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-11. [2025-09-17T02:41:27.128825] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T02:41:27.661873] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T02:41:27.890149] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-17T02:41:28.690144] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-17T02:41:28.869696] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T02:41:29.246183] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T02:41:29.490215] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-17T02:41:30.091224] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-17T02:41:30.290124] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-17T02:41:31.049191] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T02:41:31.090156] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-17T02:41:31.304334] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T02:41:31.890143] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-17T02:41:32.690196] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-17T02:41:33.002772] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T02:41:33.490137] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-17T02:41:34.090847] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-17T02:41:34.128112] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T02:41:34.243841] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T02:41:34.250257] [INFO ] [REMOTE ] CAT: Full fetch complete (76382 records). [2025-09-17T02:41:34.250409] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-17T02:41:34.295284] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-17T02:41:34.661695] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-17T02:41:34.661811] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-17T02:41:34.662672] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-17T02:41:34.662739] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-17T02:41:34.664275] [DEBUG] [LOCAL ] CAT: Trimmed 76382 records to 52929 (keeping 200 days of data) [2025-09-17T02:41:35.005388] [DEBUG] [LOCAL ] CAT: Primary data saved (52929 records). [2025-09-17T02:41:35.005585] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-17T02:41:35.005701] [INFO ] [MAIN ] Update Progress: 397/2369 symbols completed. CAT took 37.5s. Estimated remaining: 4h 45m 28s. Rate: 6.9 symbols/min [2025-09-17T02:41:35.090244] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-17T02:41:35.890155] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-17T02:41:36.175959] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T02:41:36.566923] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T02:41:36.690109] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-17T02:41:36.752539] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T02:41:37.341957] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T02:41:37.490143] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-17T02:41:38.001994] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T02:41:38.290203] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-17T02:41:39.090151] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-17T02:41:39.890189] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-17T02:41:40.018678] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T02:41:40.676794] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T02:41:40.678609] [INFO ] [REMOTE ] CATO: Full fetch complete (12676 records). [2025-09-17T02:41:40.678713] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-17T02:41:40.711124] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-17T02:41:41.051358] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-17T02:41:41.051462] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-17T02:41:41.051788] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-17T02:41:41.051843] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-17T02:41:41.052310] [DEBUG] [LOCAL ] CATO: Trimmed 12676 records to 7469 (keeping 200 days of data) [2025-09-17T02:41:41.094808] [DEBUG] [LOCAL ] CATO: Primary data saved (7469 records). [2025-09-17T02:41:41.094975] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-17T02:41:41.095074] [INFO ] [MAIN ] Update Progress: 398/2369 symbols completed. CATO took 25.8s. Estimated remaining: 4h 45m 7s. Rate: 6.9 symbols/min [2025-09-17T02:41:41.215032] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T02:41:41.490112] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-17T02:41:42.597011] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T02:41:42.607841] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-17T02:41:43.571363] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-17T02:41:43.582416] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-17T02:41:44.142661] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T02:41:44.153876] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-17T02:41:45.705993] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-17T02:41:45.718029] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-17T02:41:45.886337] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T02:41:45.899710] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-17T02:41:47.607640] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T02:41:47.618560] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-17T02:41:47.894677] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T02:41:47.906304] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-17T02:41:49.517908] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T02:41:49.529473] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-17T02:41:49.764369] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T02:41:49.770883] [INFO ] [REMOTE ] CAVA: Full fetch complete (77166 records). [2025-09-17T02:41:49.771047] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-17T02:41:50.173498] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-17T02:41:50.173626] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-17T02:41:50.174554] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-17T02:41:50.174692] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-17T02:41:50.176299] [DEBUG] [LOCAL ] CAVA: Trimmed 77166 records to 53553 (keeping 200 days of data) [2025-09-17T02:41:50.517410] [DEBUG] [LOCAL ] CAVA: Primary data saved (53553 records). [2025-09-17T02:41:50.517610] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-17T02:41:50.517732] [INFO ] [MAIN ] Update Progress: 399/2369 symbols completed. CAVA took 32.5s. Estimated remaining: 4h 45m 1s. Rate: 6.9 symbols/min [2025-09-17T02:41:51.302706] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T02:41:51.313595] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-17T02:41:52.879872] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:41:52.886019] [INFO ] [REMOTE ] CB: Full fetch complete (72446 records). [2025-09-17T02:41:52.886165] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-17T02:41:53.304191] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-17T02:41:53.304368] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-17T02:41:53.305406] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-17T02:41:53.305481] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-17T02:41:53.307882] [DEBUG] [LOCAL ] CB: Trimmed 72446 records to 50110 (keeping 200 days of data) [2025-09-17T02:41:53.743864] [DEBUG] [LOCAL ] CB: Primary data saved (50110 records). [2025-09-17T02:41:53.744167] [INFO ] [MAIN ] CB: Full history saved. [2025-09-17T02:41:53.744307] [INFO ] [MAIN ] Update Progress: 400/2369 symbols completed. CB took 28.1s. Estimated remaining: 4h 44m 26s. Rate: 6.9 symbols/min [2025-09-17T02:41:54.431147] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:54.500915] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:54.501025] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-17T02:41:54.502252] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:54.506016] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:41:54.507711] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-17T02:41:54.509604] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-17T02:41:54.509835] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-17T02:41:54.509953] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-17T02:41:54.509996] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-17T02:41:54.584161] [DEBUG] [LOCAL ] CBNA: Loaded 2286 existing records from primary storage. [2025-09-17T02:41:54.611529] [INFO ] [MAIN ] CBNA: Loaded 2286 existing records. [2025-09-17T02:41:54.636322] [DEBUG] [LOCAL ] CBAN: Loaded 7457 existing records from primary storage. [2025-09-17T02:41:54.654263] [DEBUG] [LOCAL ] CBL: Loaded 11971 existing records from primary storage. [2025-09-17T02:41:54.716338] [INFO ] [MAIN ] CBL: Loaded 11971 existing records. [2025-09-17T02:41:54.716448] [INFO ] [MAIN ] CBAN: Loaded 7457 existing records. [2025-09-17T02:41:55.159423] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:41:55.240026] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-17T02:41:55.290696] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-17T02:41:55.418400] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:55.445139] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-17T02:41:55.475313] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-11. [2025-09-17T02:41:55.502440] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:41:55.491231] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-17T02:41:55.522491] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:41:55.522911] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-17T02:41:55.528340] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-17T02:41:55.544248] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-17T02:41:55.589535] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-17T02:41:55.595314] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-17T02:41:55.595375] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-17T02:41:55.643688] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-17T02:41:55.679628] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-17T02:41:55.835223] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T02:41:55.909661] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-17T02:41:56.345903] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:41:56.435241] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:56.435373] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-17T02:41:56.452739] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-17T02:41:56.463433] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-11. [2025-09-17T02:41:56.663028] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:56.665705] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:41:56.666628] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-11. [2025-09-17T02:41:56.666974] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-11. [2025-09-17T02:41:56.999371] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:41:56.999752] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-17T02:41:57.000265] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-17T02:41:57.090023] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T02:41:57.091702] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-17T02:41:57.206748] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:41:57.207118] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-17T02:41:57.207619] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-17T02:41:57.224156] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T02:41:57.226708] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-17T02:41:57.430825] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-17T02:41:57.490088] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-17T02:41:57.684729] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T02:41:57.712720] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-17T02:41:57.751892] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T02:41:57.982885] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T02:41:58.290129] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-17T02:41:59.090140] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-17T02:41:59.129063] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T02:41:59.683120] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T02:41:59.890114] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-17T02:42:00.690108] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-17T02:42:00.715797] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T02:42:01.490137] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-17T02:42:01.955085] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T02:42:02.290138] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-17T02:42:03.090127] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-17T02:42:03.279985] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T02:42:03.562275] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T02:42:03.890237] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-17T02:42:04.171604] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-17T02:42:04.690188] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-17T02:42:04.725257] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T02:42:05.193160] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T02:42:05.490167] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-17T02:42:06.290166] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-17T02:42:06.401618] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T02:42:06.774012] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-17T02:42:07.090159] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-17T02:42:07.890155] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-17T02:42:07.984622] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T02:42:08.690170] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-17T02:42:08.948098] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T02:42:09.177301] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T02:42:09.490138] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-17T02:42:09.714435] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:09.714895] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-17T02:42:10.290160] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-17T02:42:10.887688] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T02:42:11.090175] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-17T02:42:11.551046] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T02:42:11.890129] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-17T02:42:12.690182] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-17T02:42:12.976166] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T02:42:13.246209] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T02:42:13.490183] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-17T02:42:14.290176] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-17T02:42:14.507229] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:14.507560] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-17T02:42:14.507662] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-17T02:42:14.507741] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-17T02:42:14.508346] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T02:42:14.508418] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:42:14.508457] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:42:14.508504] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-17T02:42:14.508584] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-17T02:42:14.508629] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-17T02:42:14.508714] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-17T02:42:14.508796] [INFO ] [MAIN ] Update Progress: 401/2369 symbols completed. CBO took 20.8s. Estimated remaining: 4h 45m 17s. Rate: 6.9 symbols/min [2025-09-17T02:42:14.684673] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:14.694392] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T02:42:14.735045] [DEBUG] [LOCAL ] CBRE: Loaded 37405 existing records from primary storage. [2025-09-17T02:42:14.735206] [INFO ] [MAIN ] CBRE: Loaded 37405 existing records. [2025-09-17T02:42:14.913888] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:42:14.914113] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-17T02:42:14.914169] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-17T02:42:14.915130] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-17T02:42:14.915199] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-17T02:42:15.090762] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-17T02:42:15.278169] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:15.890182] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-17T02:42:16.579470] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T02:42:16.580492] [INFO ] [REMOTE ] CBNA: Full fetch complete (4849 records). [2025-09-17T02:42:16.580581] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-17T02:42:16.700508] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-11. [2025-09-17T02:42:16.999026] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-17T02:42:16.999186] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-17T02:42:16.999383] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-17T02:42:16.999439] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-17T02:42:17.000008] [DEBUG] [LOCAL ] CBNA: Trimmed 4849 records to 2964 (keeping 200 days of data) [2025-09-17T02:42:17.018445] [DEBUG] [LOCAL ] CBNA: Primary data saved (2964 records). [2025-09-17T02:42:17.018587] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-17T02:42:17.018702] [INFO ] [MAIN ] Update Progress: 402/2369 symbols completed. CBNA took 23.3s. Estimated remaining: 4h 44m 38s. Rate: 6.9 symbols/min [2025-09-17T02:42:17.199032] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:17.208392] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T02:42:17.233366] [DEBUG] [LOCAL ] CBT: Loaded 22881 existing records from primary storage. [2025-09-17T02:42:17.233527] [INFO ] [MAIN ] CBT: Loaded 22881 existing records. [2025-09-17T02:42:17.422142] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:42:17.422391] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-17T02:42:17.422454] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-17T02:42:17.423200] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-17T02:42:17.423268] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-17T02:42:17.495327] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-17T02:42:17.833676] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:18.290124] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-11. [2025-09-17T02:42:18.475997] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T02:42:18.581244] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T02:42:19.090151] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-17T02:42:19.496479] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T02:42:19.890187] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-17T02:42:20.690193] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-17T02:42:20.891984] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T02:42:21.121462] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T02:42:21.490149] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-17T02:42:21.578167] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T02:42:22.290171] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-17T02:42:22.669152] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T02:42:23.090123] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-17T02:42:23.890112] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-17T02:42:24.003843] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T02:42:24.109988] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T02:42:24.519256] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T02:42:24.690143] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-17T02:42:25.490151] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-17T02:42:26.062395] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:42:26.290183] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-17T02:42:26.785615] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T02:42:26.930038] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T02:42:27.090182] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-17T02:42:27.890126] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-17T02:42:28.580208] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T02:42:28.646478] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T02:42:28.690082] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-17T02:42:29.490190] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-17T02:42:29.611251] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T02:42:29.613405] [INFO ] [REMOTE ] CBL: Full fetch complete (25946 records). [2025-09-17T02:42:29.613507] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-17T02:42:29.979983] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-17T02:42:29.980085] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-17T02:42:29.980518] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-17T02:42:29.980581] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-17T02:42:29.981302] [DEBUG] [LOCAL ] CBL: Trimmed 25946 records to 16900 (keeping 200 days of data) [2025-09-17T02:42:30.083694] [DEBUG] [LOCAL ] CBL: Primary data saved (16900 records). [2025-09-17T02:42:30.083856] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-17T02:42:30.083991] [INFO ] [MAIN ] Update Progress: 403/2369 symbols completed. CBL took 36.3s. Estimated remaining: 4h 44m 50s. Rate: 6.9 symbols/min [2025-09-17T02:42:30.261048] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:30.277209] [DEBUG] [LOCAL ] CBU: Loaded 16385 existing records from primary storage. [2025-09-17T02:42:30.277371] [INFO ] [MAIN ] CBU: Loaded 16385 existing records. [2025-09-17T02:42:30.297628] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-17T02:42:30.428990] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T02:42:30.471440] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:42:30.471706] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-17T02:42:30.471769] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-17T02:42:30.472348] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-17T02:42:30.472410] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-17T02:42:30.838974] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:31.090178] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-17T02:42:31.887159] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T02:42:31.897086] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-11. [2025-09-17T02:42:31.919495] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T02:42:32.690162] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-17T02:42:33.042969] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:42:33.490128] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-17T02:42:34.093424] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:42:34.290181] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-17T02:42:35.089222] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T02:42:35.093523] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-17T02:42:35.332051] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T02:42:35.770289] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T02:42:35.771825] [INFO ] [REMOTE ] CBAN: Full fetch complete (15832 records). [2025-09-17T02:42:35.771915] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-17T02:42:35.895328] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-17T02:42:36.146090] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-17T02:42:36.146200] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-17T02:42:36.146535] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-17T02:42:36.146591] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-17T02:42:36.147124] [DEBUG] [LOCAL ] CBAN: Trimmed 15832 records to 11184 (keeping 200 days of data) [2025-09-17T02:42:36.214099] [DEBUG] [LOCAL ] CBAN: Primary data saved (11184 records). [2025-09-17T02:42:36.214262] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-17T02:42:36.214357] [INFO ] [MAIN ] Update Progress: 404/2369 symbols completed. CBAN took 42.5s. Estimated remaining: 4h 44m 29s. Rate: 6.9 symbols/min [2025-09-17T02:42:36.387849] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:36.388046] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-17T02:42:36.388099] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-17T02:42:36.388208] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-17T02:42:36.388261] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-17T02:42:36.388310] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-17T02:42:36.388360] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-17T02:42:36.695321] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-17T02:42:36.768951] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:37.360508] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T02:42:37.490176] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-11. [2025-09-17T02:42:37.710556] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:37.710982] [WARN ] [REMOTE ] CBX: No data returned for month 2024-11 [2025-09-17T02:42:38.290154] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-17T02:42:38.514910] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T02:42:38.515503] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:38.526625] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-17T02:42:39.090148] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-17T02:42:39.890093] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-17T02:42:40.356435] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T02:42:40.690236] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-17T02:42:40.725699] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T02:42:40.909103] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:40.909487] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-17T02:42:41.490190] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-17T02:42:42.290172] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-17T02:42:42.535535] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:42:43.090122] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-17T02:42:43.365611] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T02:42:43.890123] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-17T02:42:44.111806] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:44.112135] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-17T02:42:44.682905] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T02:42:44.692380] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-17T02:42:45.490169] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-17T02:42:46.069260] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T02:42:46.290145] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-17T02:42:47.090107] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-17T02:42:47.188798] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T02:42:47.308159] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:47.308478] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-17T02:42:47.539363] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T02:42:47.890168] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-17T02:42:48.106404] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:48.107008] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-17T02:42:48.690176] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-17T02:42:49.490214] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-17T02:42:49.501757] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T02:42:50.290160] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-17T02:42:50.551053] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-17T02:42:50.661690] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T02:42:51.090131] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-17T02:42:51.327687] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-17T02:42:51.890144] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-17T02:42:52.103234] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:52.103578] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-17T02:42:52.690138] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-17T02:42:53.490130] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-17T02:42:53.815174] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:42:53.815744] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-17T02:42:53.815962] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-17T02:42:53.816112] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-17T02:42:53.816933] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T02:42:53.817067] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:42:53.817226] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:42:53.817550] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-17T02:42:53.826092] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-17T02:42:53.829419] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-17T02:42:53.832131] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-17T02:42:53.832600] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T02:42:53.832775] [INFO ] [MAIN ] Update Progress: 405/2369 symbols completed. CBX took 17.6s. Estimated remaining: 4h 45m 4s. Rate: 6.9 symbols/min [2025-09-17T02:42:53.928746] [INFO ] [REMOTE ] CBT: Full fetch complete (45825 records). [2025-09-17T02:42:53.938965] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-17T02:42:54.109451] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:54.295293] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-17T02:42:54.371198] [DEBUG] [LOCAL ] CBZ: Loaded 24900 existing records from primary storage. [2025-09-17T02:42:54.404024] [INFO ] [MAIN ] CBZ: Loaded 24900 existing records. [2025-09-17T02:42:54.530756] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-17T02:42:54.541167] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-17T02:42:54.541879] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-17T02:42:54.547578] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-17T02:42:54.601747] [DEBUG] [LOCAL ] CBT: Trimmed 45825 records to 31500 (keeping 200 days of data) [2025-09-17T02:42:54.622032] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:42:54.622519] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-17T02:42:54.622590] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-17T02:42:54.623274] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-17T02:42:54.623353] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-17T02:42:55.116532] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:55.111802] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-17T02:42:55.215538] [DEBUG] [LOCAL ] CBT: Primary data saved (31500 records). [2025-09-17T02:42:55.215757] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-17T02:42:55.215867] [INFO ] [MAIN ] Update Progress: 406/2369 symbols completed. CBT took 38.2s. Estimated remaining: 4h 44m 20s. Rate: 6.9 symbols/min [2025-09-17T02:42:55.385585] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:42:55.425704] [DEBUG] [LOCAL ] CC: Loaded 39560 existing records from primary storage. [2025-09-17T02:42:55.425873] [INFO ] [MAIN ] CC: Loaded 39560 existing records. [2025-09-17T02:42:55.603101] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:42:55.603459] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-17T02:42:55.603946] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-17T02:42:55.615770] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T02:42:55.615837] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-17T02:42:55.616063] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-17T02:42:55.895273] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-17T02:42:55.978192] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:42:56.690145] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-11. [2025-09-17T02:42:56.764504] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:42:57.005449] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:42:57.490215] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-11. [2025-09-17T02:42:58.290129] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-17T02:42:58.322037] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:42:58.769558] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T02:42:59.090135] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-17T02:42:59.835515] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T02:42:59.841438] [INFO ] [REMOTE ] CBRE: Full fetch complete (73883 records). [2025-09-17T02:42:59.841578] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-17T02:42:59.899593] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-17T02:43:00.245451] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-17T02:43:00.245609] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-17T02:43:00.246746] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-17T02:43:00.246846] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-17T02:43:00.262156] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T02:43:00.268224] [DEBUG] [LOCAL ] CBRE: Trimmed 73883 records to 50758 (keeping 200 days of data) [2025-09-17T02:43:00.575161] [DEBUG] [LOCAL ] CBRE: Primary data saved (50758 records). [2025-09-17T02:43:00.575332] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-17T02:43:00.575449] [INFO ] [MAIN ] Update Progress: 407/2369 symbols completed. CBRE took 46.1s. Estimated remaining: 4h 43m 55s. Rate: 6.9 symbols/min [2025-09-17T02:43:00.695263] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-17T02:43:00.744624] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:00.783854] [DEBUG] [LOCAL ] CCI: Loaded 39559 existing records from primary storage. [2025-09-17T02:43:00.784016] [INFO ] [MAIN ] CCI: Loaded 39559 existing records. [2025-09-17T02:43:00.959858] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:00.960097] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-17T02:43:00.960156] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-17T02:43:00.961104] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-17T02:43:00.961166] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-17T02:43:01.333263] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:01.433550] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T02:43:01.490134] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-11. [2025-09-17T02:43:01.934060] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T02:43:02.290126] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-17T02:43:03.090135] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-17T02:43:03.277594] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T02:43:03.337221] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T02:43:03.890108] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-17T02:43:03.917125] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T02:43:04.690132] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-17T02:43:05.296683] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T02:43:05.490094] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-17T02:43:05.853599] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T02:43:06.290195] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-17T02:43:07.090138] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-17T02:43:07.471540] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T02:43:07.754237] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T02:43:07.890136] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-17T02:43:08.585387] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T02:43:08.690163] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-17T02:43:09.375367] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T02:43:09.490168] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-17T02:43:10.290178] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-17T02:43:10.550446] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T02:43:11.090177] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-17T02:43:11.217478] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T02:43:11.233904] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T02:43:11.238285] [INFO ] [REMOTE ] CBU: Full fetch complete (31611 records). [2025-09-17T02:43:11.238447] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-17T02:43:11.613054] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-17T02:43:11.613210] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-17T02:43:11.613734] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-17T02:43:11.613808] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-17T02:43:11.614763] [DEBUG] [LOCAL ] CBU: Trimmed 31611 records to 22732 (keeping 200 days of data) [2025-09-17T02:43:11.762749] [DEBUG] [LOCAL ] CBU: Primary data saved (22732 records). [2025-09-17T02:43:11.762916] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-17T02:43:11.763053] [INFO ] [MAIN ] Update Progress: 408/2369 symbols completed. CBU took 41.7s. Estimated remaining: 4h 43m 58s. Rate: 6.9 symbols/min [2025-09-17T02:43:11.902238] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-17T02:43:11.931992] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:11.932902] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-17T02:43:11.932968] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-17T02:43:11.933136] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-17T02:43:11.933218] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-17T02:43:11.933309] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-17T02:43:11.933377] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-17T02:43:12.295918] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:12.526965] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:43:12.690170] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-17T02:43:13.490143] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-11. [2025-09-17T02:43:13.779129] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-11 (0.29 seconds). [2025-09-17T02:43:13.836683] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T02:43:14.290169] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-17T02:43:14.639963] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-17T02:43:14.766683] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T02:43:15.090130] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-17T02:43:15.890130] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-17T02:43:16.338175] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T02:43:16.463194] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:43:16.690147] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-17T02:43:17.490141] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-17T02:43:17.758568] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T02:43:18.290162] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-17T02:43:19.090157] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-17T02:43:19.346469] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T02:43:19.755559] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T02:43:19.890146] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-17T02:43:20.690219] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-17T02:43:20.894044] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T02:43:21.168541] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T02:43:21.266183] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T02:43:21.490155] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-17T02:43:22.290185] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-17T02:43:22.661882] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T02:43:22.666912] [INFO ] [REMOTE ] CBZ: Full fetch complete (44092 records). [2025-09-17T02:43:22.667081] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-17T02:43:23.057429] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-17T02:43:23.057538] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-17T02:43:23.058126] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-17T02:43:23.058192] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-17T02:43:23.059747] [DEBUG] [LOCAL ] CBZ: Trimmed 44092 records to 33222 (keeping 200 days of data) [2025-09-17T02:43:23.117031] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-17T02:43:23.263728] [DEBUG] [LOCAL ] CBZ: Primary data saved (33222 records). [2025-09-17T02:43:23.263913] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-17T02:43:23.264009] [INFO ] [MAIN ] Update Progress: 409/2369 symbols completed. CBZ took 29.4s. Estimated remaining: 4h 44m 3s. Rate: 6.9 symbols/min [2025-09-17T02:43:23.489410] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:23.503720] [DEBUG] [LOCAL ] CCIF: Loaded 11293 existing records from primary storage. [2025-09-17T02:43:23.503933] [INFO ] [MAIN ] CCIF: Loaded 11293 existing records. [2025-09-17T02:43:23.689989] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:23.690301] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-17T02:43:23.690354] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-17T02:43:23.690777] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-17T02:43:23.690839] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-17T02:43:23.900097] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-17T02:43:24.049951] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:24.106540] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T02:43:24.352988] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T02:43:24.690245] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-17T02:43:25.097660] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T02:43:25.130976] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T02:43:25.490144] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-17T02:43:25.822100] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T02:43:26.290175] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-17T02:43:26.742072] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T02:43:27.090214] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-17T02:43:27.890186] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-17T02:43:28.690137] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-17T02:43:28.989928] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-17T02:43:28.991920] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T02:43:29.500102] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-17T02:43:29.521847] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T02:43:29.966725] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T02:43:30.290134] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-17T02:43:31.090137] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-17T02:43:31.890130] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-17T02:43:32.179709] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T02:43:32.305897] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T02:43:32.306686] [INFO ] [REMOTE ] CCIA: Full fetch complete (2019 records). [2025-09-17T02:43:32.306768] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-17T02:43:32.486202] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T02:43:32.486377] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:43:32.486427] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:43:32.486472] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-17T02:43:32.486568] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-17T02:43:32.486632] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-17T02:43:32.486713] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-17T02:43:32.486781] [INFO ] [MAIN ] Update Progress: 410/2369 symbols completed. CCIA took 20.7s. Estimated remaining: 4h 43m 57s. Rate: 6.9 symbols/min [2025-09-17T02:43:32.654505] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:32.696685] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-11. [2025-09-17T02:43:32.699518] [DEBUG] [LOCAL ] CCJ: Loaded 40053 existing records from primary storage. [2025-09-17T02:43:32.699632] [INFO ] [MAIN ] CCJ: Loaded 40053 existing records. [2025-09-17T02:43:32.882442] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:32.882732] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-17T02:43:32.882886] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-17T02:43:32.883854] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-17T02:43:32.883921] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-17T02:43:33.259809] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:33.297722] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T02:43:33.490125] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-11. [2025-09-17T02:43:33.600285] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T02:43:34.290175] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-17T02:43:35.090159] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-17T02:43:35.654790] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-17T02:43:35.890124] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-17T02:43:36.075284] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T02:43:36.690135] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-17T02:43:36.748353] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T02:43:36.755066] [INFO ] [REMOTE ] CC: Full fetch complete (75165 records). [2025-09-17T02:43:36.755208] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-17T02:43:37.157704] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-17T02:43:37.157804] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-17T02:43:37.158577] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-17T02:43:37.158658] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-17T02:43:37.160121] [DEBUG] [LOCAL ] CC: Trimmed 75165 records to 53027 (keeping 200 days of data) [2025-09-17T02:43:37.489951] [DEBUG] [LOCAL ] CC: Primary data saved (53027 records). [2025-09-17T02:43:37.490146] [INFO ] [MAIN ] CC: Full history saved. [2025-09-17T02:43:37.490347] [INFO ] [MAIN ] Update Progress: 411/2369 symbols completed. CC took 42.3s. Estimated remaining: 4h 43m 31s. Rate: 6.9 symbols/min [2025-09-17T02:43:37.490210] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-17T02:43:37.663919] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:37.700672] [DEBUG] [LOCAL ] CCK: Loaded 34509 existing records from primary storage. [2025-09-17T02:43:37.700863] [INFO ] [MAIN ] CCK: Loaded 34509 existing records. [2025-09-17T02:43:37.912287] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:37.914052] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T02:43:37.924425] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-17T02:43:37.924961] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-17T02:43:37.926180] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-17T02:43:37.926259] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-17T02:43:38.288058] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:38.290082] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-11. [2025-09-17T02:43:38.343665] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:43:38.350028] [INFO ] [REMOTE ] CCI: Full fetch complete (76830 records). [2025-09-17T02:43:38.350171] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-17T02:43:38.639539] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T02:43:38.798103] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-17T02:43:38.798230] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-17T02:43:38.799225] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-17T02:43:38.799331] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-17T02:43:38.800922] [DEBUG] [LOCAL ] CCI: Trimmed 76830 records to 53166 (keeping 200 days of data) [2025-09-17T02:43:39.097731] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-17T02:43:39.151413] [DEBUG] [LOCAL ] CCI: Primary data saved (53166 records). [2025-09-17T02:43:39.151566] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-17T02:43:39.151681] [INFO ] [MAIN ] Update Progress: 412/2369 symbols completed. CCI took 38.6s. Estimated remaining: 4h 42m 49s. Rate: 6.9 symbols/min [2025-09-17T02:43:39.338100] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:39.381544] [DEBUG] [LOCAL ] CCL: Loaded 40150 existing records from primary storage. [2025-09-17T02:43:39.381765] [INFO ] [MAIN ] CCL: Loaded 40150 existing records. [2025-09-17T02:43:39.574316] [WARN ] [MAIN ] CCL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:39.574555] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-17T02:43:39.574666] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-17T02:43:39.575706] [DEBUG] [LOCAL ] CCL: Deleted primary data file. [2025-09-17T02:43:39.575776] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-17T02:43:39.892768] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-17T02:43:39.956705] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:39.985722] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T02:43:40.131621] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T02:43:40.690130] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-17T02:43:41.490115] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-11. [2025-09-17T02:43:41.592246] [DEBUG] [REMOTE ] CCL: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-17T02:43:41.592541] [WARN ] [REMOTE ] CCL: No data returned for month 2024-11 [2025-09-17T02:43:41.895700] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T02:43:42.291985] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-17T02:43:42.293732] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T02:43:43.090128] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-17T02:43:43.195118] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T02:43:43.890122] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-17T02:43:44.690137] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-17T02:43:45.490204] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-17T02:43:45.559004] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-17T02:43:45.584895] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T02:43:45.616139] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T02:43:46.290127] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-17T02:43:47.096308] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-17T02:43:47.099340] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T02:43:47.350032] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T02:43:47.890104] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-17T02:43:48.441822] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T02:43:48.690133] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-17T02:43:49.490180] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-17T02:43:49.675231] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T02:43:49.880003] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T02:43:50.290162] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-17T02:43:51.090151] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-17T02:43:51.266740] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T02:43:51.820864] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-17T02:43:51.890172] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-17T02:43:52.690148] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-17T02:43:52.832876] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T02:43:53.482284] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T02:43:53.490079] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-17T02:43:54.051394] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-17T02:43:54.290139] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-17T02:43:55.009908] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T02:43:55.090140] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-17T02:43:55.553253] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T02:43:55.721870] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T02:43:55.724267] [INFO ] [REMOTE ] CCIF: Full fetch complete (21543 records). [2025-09-17T02:43:55.724377] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-17T02:43:55.895302] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-17T02:43:56.115136] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-17T02:43:56.115243] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-17T02:43:56.115608] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-17T02:43:56.115680] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-17T02:43:56.116288] [DEBUG] [LOCAL ] CCIF: Trimmed 21543 records to 15299 (keeping 200 days of data) [2025-09-17T02:43:56.204169] [DEBUG] [LOCAL ] CCIF: Primary data saved (15299 records). [2025-09-17T02:43:56.204334] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-17T02:43:56.204431] [INFO ] [MAIN ] Update Progress: 413/2369 symbols completed. CCIF took 32.9s. Estimated remaining: 4h 43m 20s. Rate: 6.9 symbols/min [2025-09-17T02:43:56.373720] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:43:56.408675] [DEBUG] [LOCAL ] CCO: Loaded 36204 existing records from primary storage. [2025-09-17T02:43:56.408863] [INFO ] [MAIN ] CCO: Loaded 36204 existing records. [2025-09-17T02:43:56.592399] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:43:56.592804] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-17T02:43:56.592859] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-17T02:43:56.593736] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-17T02:43:56.593798] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-17T02:43:56.693631] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-17T02:43:56.951010] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:43:57.490128] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-11. [2025-09-17T02:43:58.057059] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T02:43:58.290147] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-17T02:43:58.968817] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T02:43:59.096659] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-17T02:43:59.117551] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.42 seconds). [2025-09-17T02:43:59.890118] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-17T02:44:00.297943] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T02:44:00.599811] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T02:44:00.690094] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-17T02:44:01.490169] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-17T02:44:02.250020] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T02:44:02.290137] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-17T02:44:02.413620] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-17T02:44:03.090144] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-17T02:44:03.795174] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-17T02:44:03.890112] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-17T02:44:04.029523] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:44:04.690135] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-17T02:44:05.481891] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-17T02:44:05.493073] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-17T02:44:05.968460] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T02:44:06.051342] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T02:44:06.290128] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-17T02:44:07.090105] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-17T02:44:07.188887] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T02:44:07.719725] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T02:44:07.890128] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-17T02:44:08.690244] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-17T02:44:09.123608] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-17T02:44:09.133903] [INFO ] [REMOTE ] CCJ: Full fetch complete (77575 records). [2025-09-17T02:44:09.134189] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-17T02:44:09.495484] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-17T02:44:09.596817] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-17T02:44:09.596993] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-17T02:44:09.597968] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-17T02:44:09.598042] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-17T02:44:09.599852] [DEBUG] [LOCAL ] CCJ: Trimmed 77575 records to 53675 (keeping 200 days of data) [2025-09-17T02:44:09.716750] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T02:44:09.953283] [DEBUG] [LOCAL ] CCJ: Primary data saved (53675 records). [2025-09-17T02:44:09.953446] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-17T02:44:09.954357] [INFO ] [MAIN ] Update Progress: 414/2369 symbols completed. CCJ took 37.5s. Estimated remaining: 4h 43m 35s. Rate: 6.9 symbols/min [2025-09-17T02:44:10.125220] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:10.136014] [DEBUG] [LOCAL ] CCRD: Loaded 7777 existing records from primary storage. [2025-09-17T02:44:10.136170] [INFO ] [MAIN ] CCRD: Loaded 7777 existing records. [2025-09-17T02:44:10.296821] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-17T02:44:10.319782] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:44:10.320256] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-17T02:44:10.320453] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-17T02:44:10.320884] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-17T02:44:10.321024] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-17T02:44:10.666312] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T02:44:10.756514] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:11.090210] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-17T02:44:11.890369] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-11. [2025-09-17T02:44:11.896546] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-17T02:44:12.088930] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T02:44:12.388038] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T02:44:12.690173] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-17T02:44:12.887436] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T02:44:13.490185] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-17T02:44:13.555264] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T02:44:14.290367] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-17T02:44:15.077614] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T02:44:15.090084] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-17T02:44:15.890169] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-17T02:44:16.690155] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-17T02:44:16.741823] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T02:44:16.860806] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-17T02:44:17.234295] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T02:44:17.365728] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T02:44:17.490139] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-17T02:44:18.109828] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T02:44:18.290157] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-17T02:44:18.899562] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T02:44:19.090130] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-17T02:44:19.890151] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-17T02:44:20.320363] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T02:44:20.690132] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-17T02:44:21.331775] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T02:44:21.490142] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-17T02:44:22.260316] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-17T02:44:22.290105] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-17T02:44:22.340416] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T02:44:23.090182] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-17T02:44:23.820720] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T02:44:23.826821] [INFO ] [REMOTE ] CCK: Full fetch complete (67612 records). [2025-09-17T02:44:23.826952] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-17T02:44:23.895435] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-17T02:44:24.226853] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-17T02:44:24.226970] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-17T02:44:24.227716] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-17T02:44:24.227786] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-17T02:44:24.229221] [DEBUG] [LOCAL ] CCK: Trimmed 67612 records to 46625 (keeping 200 days of data) [2025-09-17T02:44:24.521665] [DEBUG] [LOCAL ] CCK: Primary data saved (46625 records). [2025-09-17T02:44:24.521828] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-17T02:44:24.521924] [INFO ] [MAIN ] Update Progress: 415/2369 symbols completed. CCK took 47.0s. Estimated remaining: 4h 43m 54s. Rate: 6.9 symbols/min [2025-09-17T02:44:24.695322] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-17T02:44:24.697507] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:24.699310] [DEBUG] [LOCAL ] CCS: No existing data file found in primary storage. [2025-09-17T02:44:24.699405] [WARN ] [MAIN ] CCS: No existing data found, performing full refresh instead. [2025-09-17T02:44:24.699560] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-17T02:44:24.699633] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-17T02:44:24.699713] [DEBUG] [LOCAL ] CCS: No primary data file found to delete. [2025-09-17T02:44:24.699761] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-17T02:44:25.062126] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:25.279700] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-17T02:44:25.286223] [INFO ] [REMOTE ] CCL: Full fetch complete (76750 records). [2025-09-17T02:44:25.286395] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-17T02:44:25.485079] [WARN ] [VALIDATOR ] CCL: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T02:44:25.491556] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-11. [2025-09-17T02:44:25.492459] [FATAL] [MAIN ] CCL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:44:25.495845] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T02:44:25.495492] [WARN ] [MAIN ] CCL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:44:25.501267] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-17T02:44:25.513014] [DEBUG] [LOCAL ] CCL: No primary data file found to delete. [2025-09-17T02:44:25.513677] [INFO ] [LOCAL ] CCL: Starting deletion of derivative data. [2025-09-17T02:44:25.514628] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:44:25.520388] [DEBUG] [LOCAL ] CCL: Deleted derivative data file. [2025-09-17T02:44:25.520731] [INFO ] [MAIN ] Update Progress: 416/2369 symbols completed. CCL took 46.4s. Estimated remaining: 4h 43m 9s. Rate: 6.9 symbols/min [2025-09-17T02:44:25.521072] [INFO ] [REMOTE ] CCO: Full fetch complete (65654 records). [2025-09-17T02:44:25.597454] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-17T02:44:25.821387] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:26.034898] [DEBUG] [LOCAL ] CCU: Loaded 16433 existing records from primary storage. [2025-09-17T02:44:26.035103] [INFO ] [MAIN ] CCU: Loaded 16433 existing records. [2025-09-17T02:44:26.232374] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-17T02:44:26.248062] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-17T02:44:26.259069] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-17T02:44:26.309780] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-17T02:44:26.313205] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-17T02:44:26.313599] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:44:26.314946] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-17T02:44:26.315027] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-17T02:44:26.315772] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-17T02:44:26.315983] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-17T02:44:26.337168] [DEBUG] [LOCAL ] CCO: Trimmed 65654 records to 47470 (keeping 200 days of data) [2025-09-17T02:44:26.793517] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:26.889758] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T02:44:27.005387] [DEBUG] [LOCAL ] CCO: Primary data saved (47470 records). [2025-09-17T02:44:27.005667] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-17T02:44:27.005805] [INFO ] [MAIN ] Update Progress: 417/2369 symbols completed. CCO took 30.8s. Estimated remaining: 4h 42m 26s. Rate: 6.9 symbols/min [2025-09-17T02:44:27.095364] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-17T02:44:27.187137] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:27.187531] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-17T02:44:27.187591] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-17T02:44:27.187744] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-17T02:44:27.187801] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-17T02:44:27.187868] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-17T02:44:27.187926] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-17T02:44:27.515912] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T02:44:27.601457] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:27.890149] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-11. [2025-09-17T02:44:28.038116] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T02:44:28.690134] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-17T02:44:28.886588] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T02:44:29.245976] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T02:44:29.490138] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-17T02:44:30.226909] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T02:44:30.228601] [INFO ] [REMOTE ] CCRD: Full fetch complete (12010 records). [2025-09-17T02:44:30.228705] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-17T02:44:30.297970] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-17T02:44:30.590546] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-17T02:44:30.590663] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-17T02:44:30.590924] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-17T02:44:30.590984] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-17T02:44:30.591464] [DEBUG] [LOCAL ] CCRD: Trimmed 12010 records to 8902 (keeping 200 days of data) [2025-09-17T02:44:30.644440] [DEBUG] [LOCAL ] CCRD: Primary data saved (8902 records). [2025-09-17T02:44:30.644603] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-17T02:44:30.644718] [INFO ] [MAIN ] Update Progress: 418/2369 symbols completed. CCRD took 20.7s. Estimated remaining: 4h 41m 54s. Rate: 6.9 symbols/min [2025-09-17T02:44:30.812833] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:30.855058] [DEBUG] [LOCAL ] CDE: Loaded 39994 existing records from primary storage. [2025-09-17T02:44:30.855228] [INFO ] [MAIN ] CDE: Loaded 39994 existing records. [2025-09-17T02:44:31.037709] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:44:31.038015] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-17T02:44:31.038077] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-17T02:44:31.038980] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-17T02:44:31.039042] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-17T02:44:31.097980] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-11. [2025-09-17T02:44:31.428451] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:31.540665] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T02:44:31.602726] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T02:44:31.890134] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-17T02:44:32.690145] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-17T02:44:33.384992] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T02:44:33.490133] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-17T02:44:33.700767] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T02:44:34.290183] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-17T02:44:34.452174] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T02:44:35.090124] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-17T02:44:35.263391] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T02:44:35.406323] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-17T02:44:35.890145] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-17T02:44:36.690134] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-17T02:44:37.241103] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T02:44:37.260834] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T02:44:37.490126] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-17T02:44:37.724991] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-17T02:44:38.290135] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-11. [2025-09-17T02:44:39.090174] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-17T02:44:39.890116] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-17T02:44:40.118415] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-17T02:44:40.223892] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T02:44:40.409101] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T02:44:40.690126] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-17T02:44:41.051935] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-17T02:44:41.490176] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-17T02:44:42.290142] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-17T02:44:43.090174] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-17T02:44:43.330516] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T02:44:43.672255] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T02:44:43.890142] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-17T02:44:44.492097] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:44:44.690163] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-17T02:44:45.143236] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T02:44:45.490143] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-17T02:44:45.557947] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T02:44:46.290175] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-17T02:44:46.544215] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-17T02:44:47.090137] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-17T02:44:47.342312] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:44:47.342695] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-17T02:44:47.403666] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T02:44:47.890132] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-17T02:44:48.215384] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-17T02:44:48.690126] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-17T02:44:49.490109] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-17T02:44:49.811090] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T02:44:50.290128] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-17T02:44:51.022189] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T02:44:51.090094] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-17T02:44:51.346511] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T02:44:51.890103] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-17T02:44:52.202426] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T02:44:52.690134] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-17T02:44:53.490218] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-17T02:44:53.805994] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T02:44:53.893169] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T02:44:54.290179] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-17T02:44:54.378264] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T02:44:54.381074] [INFO ] [REMOTE ] CCU: Full fetch complete (33323 records). [2025-09-17T02:44:54.381169] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-17T02:44:54.750734] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-17T02:44:54.750868] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-17T02:44:54.751320] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-17T02:44:54.751381] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-17T02:44:54.752302] [DEBUG] [LOCAL ] CCU: Trimmed 33323 records to 24179 (keeping 200 days of data) [2025-09-17T02:44:54.896494] [DEBUG] [LOCAL ] CCU: Primary data saved (24179 records). [2025-09-17T02:44:54.896664] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-17T02:44:54.896761] [INFO ] [MAIN ] Update Progress: 419/2369 symbols completed. CCU took 29.4s. Estimated remaining: 4h 42m 58s. Rate: 6.9 symbols/min [2025-09-17T02:44:55.065342] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:55.073868] [DEBUG] [LOCAL ] CDLR: Loaded 7019 existing records from primary storage. [2025-09-17T02:44:55.074002] [INFO ] [MAIN ] CDLR: Loaded 7019 existing records. [2025-09-17T02:44:55.095292] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-17T02:44:55.259347] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:44:55.259792] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-17T02:44:55.259885] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-17T02:44:55.260200] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-17T02:44:55.260338] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-17T02:44:55.471965] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T02:44:55.563158] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T02:44:55.648926] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:55.890170] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-11. [2025-09-17T02:44:56.690129] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-17T02:44:56.703775] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T02:44:56.942048] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-17T02:44:56.942768] [INFO ] [REMOTE ] CCZ: Full fetch complete (149 records). [2025-09-17T02:44:56.942850] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-17T02:44:56.943205] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T02:44:56.943309] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:44:56.943357] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:44:56.943415] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-17T02:44:56.943503] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-17T02:44:56.943567] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-17T02:44:56.943661] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-17T02:44:56.943738] [INFO ] [MAIN ] Update Progress: 420/2369 symbols completed. CCZ took 29.9s. Estimated remaining: 4h 42m 18s. Rate: 6.9 symbols/min [2025-09-17T02:44:57.118935] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:44:57.148526] [DEBUG] [LOCAL ] CDP: Loaded 31306 existing records from primary storage. [2025-09-17T02:44:57.148707] [INFO ] [MAIN ] CDP: Loaded 31306 existing records. [2025-09-17T02:44:57.327268] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:44:57.327537] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-17T02:44:57.327600] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-17T02:44:57.328363] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-17T02:44:57.328427] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-17T02:44:57.495826] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-17T02:44:57.686151] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:44:58.290125] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-17T02:44:58.411436] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T02:44:59.090160] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-17T02:44:59.658296] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:44:59.890145] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-17T02:45:00.317972] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-17T02:45:00.690128] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-17T02:45:01.134530] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T02:45:01.219236] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T02:45:01.490574] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-17T02:45:02.290152] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-11. [2025-09-17T02:45:03.090152] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-17T02:45:03.890206] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-17T02:45:04.098067] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-17T02:45:04.102085] [INFO ] [REMOTE ] CCS: Full fetch complete (44238 records). [2025-09-17T02:45:04.102260] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-17T02:45:04.492145] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-17T02:45:04.492285] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-17T02:45:04.492965] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-17T02:45:04.493049] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-17T02:45:04.495911] [DEBUG] [LOCAL ] CCS: Trimmed 44238 records to 30631 (keeping 200 days of data) [2025-09-17T02:45:04.698464] [DEBUG] [LOCAL ] CCS: Primary data saved (30631 records). [2025-09-17T02:45:04.698671] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-17T02:45:04.698811] [INFO ] [MAIN ] Update Progress: 421/2369 symbols completed. CCS took 40.2s. Estimated remaining: 4h 42m 5s. Rate: 6.9 symbols/min [2025-09-17T02:45:04.869009] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:04.887954] [DEBUG] [LOCAL ] CDRE: Loaded 18653 existing records from primary storage. [2025-09-17T02:45:04.888134] [INFO ] [MAIN ] CDRE: Loaded 18653 existing records. [2025-09-17T02:45:05.067459] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:05.067739] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-17T02:45:05.067801] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-17T02:45:05.068302] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-17T02:45:05.068361] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-17T02:45:05.444218] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-17T02:45:05.510081] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:05.510784] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-17T02:45:05.511330] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-11. [2025-09-17T02:45:05.566116] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-11 (3.28 seconds). [2025-09-17T02:45:06.011672] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T02:45:06.047088] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T02:45:06.290136] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-17T02:45:06.389856] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T02:45:07.090138] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-17T02:45:07.828101] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T02:45:07.890106] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-17T02:45:08.690192] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-17T02:45:09.010215] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T02:45:09.087773] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T02:45:09.490163] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-17T02:45:09.747308] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T02:45:10.290143] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-17T02:45:11.090135] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-17T02:45:11.407403] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T02:45:11.454452] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:45:11.890155] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-17T02:45:12.596006] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T02:45:12.690174] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-17T02:45:12.716042] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T02:45:13.490173] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-17T02:45:14.290177] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-17T02:45:14.721406] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T02:45:14.932784] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T02:45:15.090123] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-17T02:45:15.142689] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T02:45:15.890138] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-17T02:45:15.938262] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T02:45:16.690173] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-17T02:45:17.490190] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-17T02:45:17.543473] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T02:45:18.290193] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-17T02:45:18.678918] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T02:45:19.090183] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-17T02:45:19.675963] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T02:45:19.776368] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T02:45:19.778297] [INFO ] [REMOTE ] CDLR: Full fetch complete (13292 records). [2025-09-17T02:45:19.778400] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-17T02:45:19.899229] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-17T02:45:20.120578] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-17T02:45:20.190799] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-17T02:45:20.191178] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-17T02:45:20.191608] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-17T02:45:20.191690] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-17T02:45:20.192247] [DEBUG] [LOCAL ] CDLR: Trimmed 13292 records to 10291 (keeping 200 days of data) [2025-09-17T02:45:20.253910] [DEBUG] [LOCAL ] CDLR: Primary data saved (10291 records). [2025-09-17T02:45:20.254080] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-17T02:45:20.254198] [INFO ] [MAIN ] Update Progress: 422/2369 symbols completed. CDLR took 25.4s. Estimated remaining: 4h 42m 28s. Rate: 6.9 symbols/min [2025-09-17T02:45:20.424713] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:20.469205] [DEBUG] [LOCAL ] CE: Loaded 38140 existing records from primary storage. [2025-09-17T02:45:20.469381] [INFO ] [MAIN ] CE: Loaded 38140 existing records. [2025-09-17T02:45:20.649931] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:20.650198] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-17T02:45:20.650257] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-17T02:45:20.651172] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-17T02:45:20.651251] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-17T02:45:20.698332] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-17T02:45:21.018622] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:21.490137] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-17T02:45:21.947516] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-17T02:45:21.956604] [INFO ] [REMOTE ] CDE: Full fetch complete (77420 records). [2025-09-17T02:45:21.956835] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-17T02:45:22.291334] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-11. [2025-09-17T02:45:22.367980] [DEBUG] [VALIDATOR ] CDE: All expected trading days are present. [2025-09-17T02:45:22.368173] [DEBUG] [VALIDATOR ] CDE: Primary data validation passed. [2025-09-17T02:45:22.369409] [INFO ] [MAIN ] CDE: Fetched primary data is valid. [2025-09-17T02:45:22.369542] [DEBUG] [LOCAL ] CDE: Saving primary data. [2025-09-17T02:45:22.397281] [DEBUG] [LOCAL ] CDE: Trimmed 77420 records to 53641 (keeping 200 days of data) [2025-09-17T02:45:22.399595] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T02:45:22.739738] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T02:45:22.769373] [DEBUG] [LOCAL ] CDE: Primary data saved (53641 records). [2025-09-17T02:45:22.769567] [INFO ] [MAIN ] CDE: Full history saved. [2025-09-17T02:45:22.769706] [INFO ] [MAIN ] Update Progress: 423/2369 symbols completed. CDE took 52.1s. Estimated remaining: 4h 41m 51s. Rate: 6.9 symbols/min [2025-09-17T02:45:22.937116] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:22.943405] [DEBUG] [LOCAL ] CEE: Loaded 4013 existing records from primary storage. [2025-09-17T02:45:22.943518] [INFO ] [MAIN ] CEE: Loaded 4013 existing records. [2025-09-17T02:45:23.098625] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-17T02:45:23.123791] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:23.124115] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-17T02:45:23.124191] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-17T02:45:23.124513] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-17T02:45:23.124618] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-17T02:45:23.487849] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:23.890189] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-11. [2025-09-17T02:45:24.147135] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T02:45:24.479337] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T02:45:24.573248] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T02:45:24.690141] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-17T02:45:25.490188] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-17T02:45:26.144775] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T02:45:26.204847] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T02:45:26.290160] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-17T02:45:27.090142] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-17T02:45:27.870507] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T02:45:27.890114] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-17T02:45:28.078825] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T02:45:28.690166] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-17T02:45:29.182479] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T02:45:29.346019] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T02:45:29.490184] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-17T02:45:30.290111] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-17T02:45:30.527242] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T02:45:30.530352] [INFO ] [REMOTE ] CDRE: Full fetch complete (35561 records). [2025-09-17T02:45:30.530483] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-17T02:45:30.920810] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-17T02:45:30.921299] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-17T02:45:30.921873] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-17T02:45:30.921930] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-17T02:45:30.922846] [DEBUG] [LOCAL ] CDRE: Trimmed 35561 records to 25093 (keeping 200 days of data) [2025-09-17T02:45:31.083885] [DEBUG] [LOCAL ] CDRE: Primary data saved (25093 records). [2025-09-17T02:45:31.084048] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-17T02:45:31.084159] [INFO ] [MAIN ] Update Progress: 424/2369 symbols completed. CDRE took 26.4s. Estimated remaining: 4h 41m 41s. Rate: 6.9 symbols/min [2025-09-17T02:45:31.095758] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-17T02:45:31.267227] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:31.276765] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T02:45:31.296500] [DEBUG] [LOCAL ] CEPU: Loaded 18809 existing records from primary storage. [2025-09-17T02:45:31.296702] [INFO ] [MAIN ] CEPU: Loaded 18809 existing records. [2025-09-17T02:45:31.503044] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:31.503327] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-17T02:45:31.503431] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-17T02:45:31.504029] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-17T02:45:31.504107] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-17T02:45:31.883927] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:31.890084] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-11. [2025-09-17T02:45:32.677022] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T02:45:32.690078] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-17T02:45:33.217308] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T02:45:33.490135] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-17T02:45:33.863887] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T02:45:34.290201] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-17T02:45:34.818072] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T02:45:35.090144] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-17T02:45:35.890163] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-17T02:45:36.060388] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T02:45:36.097810] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T02:45:36.690144] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-17T02:45:37.212424] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T02:45:37.287582] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T02:45:37.490154] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-17T02:45:38.290174] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-17T02:45:39.034181] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T02:45:39.090118] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-17T02:45:39.406230] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T02:45:39.890135] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-17T02:45:40.600162] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T02:45:40.690122] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-17T02:45:40.888567] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T02:45:41.303574] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T02:45:41.490166] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-17T02:45:42.118366] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T02:45:42.290128] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-17T02:45:43.090148] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-17T02:45:43.738730] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T02:45:43.745515] [INFO ] [REMOTE ] CDP: Full fetch complete (61709 records). [2025-09-17T02:45:43.745716] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-17T02:45:43.891681] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-17T02:45:43.929333] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T02:45:44.148969] [DEBUG] [VALIDATOR ] CDP: All expected trading days are present. [2025-09-17T02:45:44.149111] [DEBUG] [VALIDATOR ] CDP: Primary data validation passed. [2025-09-17T02:45:44.149929] [INFO ] [MAIN ] CDP: Fetched primary data is valid. [2025-09-17T02:45:44.149991] [DEBUG] [LOCAL ] CDP: Saving primary data. [2025-09-17T02:45:44.151418] [DEBUG] [LOCAL ] CDP: Trimmed 61709 records to 42807 (keeping 200 days of data) [2025-09-17T02:45:44.445722] [DEBUG] [LOCAL ] CDP: Primary data saved (42807 records). [2025-09-17T02:45:44.445930] [INFO ] [MAIN ] CDP: Full history saved. [2025-09-17T02:45:44.446084] [INFO ] [MAIN ] Update Progress: 425/2369 symbols completed. CDP took 47.5s. Estimated remaining: 4h 41m 53s. Rate: 6.9 symbols/min [2025-09-17T02:45:44.619800] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:44.657524] [DEBUG] [LOCAL ] CF: Loaded 38963 existing records from primary storage. [2025-09-17T02:45:44.657752] [INFO ] [MAIN ] CF: Loaded 38963 existing records. [2025-09-17T02:45:44.695309] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-17T02:45:44.849427] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:44.849760] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-17T02:45:44.849834] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-17T02:45:44.850884] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-17T02:45:44.850971] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-17T02:45:45.223981] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:45.490141] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-11. [2025-09-17T02:45:45.720975] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T02:45:45.977918] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T02:45:46.290144] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-17T02:45:46.742406] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T02:45:47.090162] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-17T02:45:47.890149] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-17T02:45:48.113857] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T02:45:48.690221] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-17T02:45:48.737169] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T02:45:49.129690] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T02:45:49.490127] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-17T02:45:50.290146] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-17T02:45:50.541617] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T02:45:50.688322] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T02:45:50.793994] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T02:45:50.795158] [INFO ] [REMOTE ] CEE: Full fetch complete (10175 records). [2025-09-17T02:45:50.795246] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-17T02:45:51.091617] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-17T02:45:51.176071] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-17T02:45:51.176174] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-17T02:45:51.176449] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-17T02:45:51.176503] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-17T02:45:51.177001] [DEBUG] [LOCAL ] CEE: Trimmed 10175 records to 7167 (keeping 200 days of data) [2025-09-17T02:45:51.220405] [DEBUG] [LOCAL ] CEE: Primary data saved (7167 records). [2025-09-17T02:45:51.220561] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-17T02:45:51.220670] [INFO ] [MAIN ] Update Progress: 426/2369 symbols completed. CEE took 28.5s. Estimated remaining: 4h 41m 36s. Rate: 6.9 symbols/min [2025-09-17T02:45:51.398380] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:45:51.441382] [DEBUG] [LOCAL ] CFG: Loaded 39975 existing records from primary storage. [2025-09-17T02:45:51.441553] [INFO ] [MAIN ] CFG: Loaded 39975 existing records. [2025-09-17T02:45:51.630898] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:45:51.631175] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-17T02:45:51.631236] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-17T02:45:51.632325] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-17T02:45:51.632399] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-17T02:45:51.895257] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-17T02:45:52.003523] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:45:52.690154] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-17T02:45:52.768991] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T02:45:53.293495] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T02:45:53.490136] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-17T02:45:53.879398] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T02:45:54.290229] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-11. [2025-09-17T02:45:54.855132] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T02:45:55.090190] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-17T02:45:55.890159] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-17T02:45:56.054765] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T02:45:56.690216] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-17T02:45:56.811671] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T02:45:57.138571] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T02:45:57.490156] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-17T02:45:58.290132] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-17T02:45:58.563882] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:45:59.009883] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T02:45:59.047346] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T02:45:59.090113] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-17T02:45:59.890133] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-17T02:46:00.224363] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T02:46:00.228433] [INFO ] [REMOTE ] CEPU: Full fetch complete (39318 records). [2025-09-17T02:46:00.228539] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-17T02:46:00.619930] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-17T02:46:00.620053] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-17T02:46:00.620598] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-17T02:46:00.621033] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-17T02:46:00.622094] [DEBUG] [LOCAL ] CEPU: Trimmed 39318 records to 25572 (keeping 200 days of data) [2025-09-17T02:46:00.704070] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-17T02:46:00.768797] [DEBUG] [LOCAL ] CEPU: Primary data saved (25572 records). [2025-09-17T02:46:00.768950] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-17T02:46:00.769044] [INFO ] [MAIN ] Update Progress: 427/2369 symbols completed. CEPU took 29.7s. Estimated remaining: 4h 41m 31s. Rate: 6.9 symbols/min [2025-09-17T02:46:00.939954] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:00.940169] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-17T02:46:00.940226] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-17T02:46:00.940332] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-17T02:46:00.940377] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-17T02:46:00.940430] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-17T02:46:00.940476] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-17T02:46:01.355968] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:01.465524] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:46:01.490141] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-17T02:46:01.912071] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T02:46:01.918388] [INFO ] [REMOTE ] CE: Full fetch complete (74760 records). [2025-09-17T02:46:01.918571] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-17T02:46:02.290531] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-17T02:46:02.332147] [DEBUG] [VALIDATOR ] CE: All expected trading days are present. [2025-09-17T02:46:02.332248] [DEBUG] [VALIDATOR ] CE: Primary data validation passed. [2025-09-17T02:46:02.333143] [INFO ] [MAIN ] CE: Fetched primary data is valid. [2025-09-17T02:46:02.333230] [DEBUG] [LOCAL ] CE: Saving primary data. [2025-09-17T02:46:02.335020] [DEBUG] [LOCAL ] CE: Trimmed 74760 records to 51604 (keeping 200 days of data) [2025-09-17T02:46:02.676389] [DEBUG] [LOCAL ] CE: Primary data saved (51604 records). [2025-09-17T02:46:02.676563] [INFO ] [MAIN ] CE: Full history saved. [2025-09-17T02:46:02.676688] [INFO ] [MAIN ] Update Progress: 428/2369 symbols completed. CE took 42.4s. Estimated remaining: 4h 40m 52s. Rate: 6.9 symbols/min [2025-09-17T02:46:02.850604] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:02.875938] [DEBUG] [LOCAL ] CFR: Loaded 24180 existing records from primary storage. [2025-09-17T02:46:02.876107] [INFO ] [MAIN ] CFR: Loaded 24180 existing records. [2025-09-17T02:46:03.063849] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:03.064122] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-17T02:46:03.064185] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-17T02:46:03.064913] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-17T02:46:03.064977] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-17T02:46:03.098247] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-11. [2025-09-17T02:46:03.406517] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:03.444421] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:03.445724] [WARN ] [REMOTE ] CFND: No data returned for month 2024-11 [2025-09-17T02:46:03.477823] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T02:46:03.720657] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:46:03.890133] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-17T02:46:04.690176] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-17T02:46:04.921855] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:04.922169] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-17T02:46:05.490143] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-17T02:46:05.551088] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T02:46:06.290141] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-11. [2025-09-17T02:46:07.090139] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-17T02:46:07.286362] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T02:46:07.348554] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T02:46:07.890126] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-17T02:46:08.098972] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:08.099346] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-17T02:46:08.690148] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-17T02:46:08.832998] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T02:46:08.899498] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:08.899810] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-17T02:46:09.490167] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-17T02:46:10.290148] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-17T02:46:11.090188] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-17T02:46:11.330338] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:11.352886] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-17T02:46:11.355618] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T02:46:11.584104] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:46:11.890138] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-17T02:46:12.107128] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:12.107490] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-17T02:46:12.690171] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-17T02:46:13.490133] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-17T02:46:14.290201] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-17T02:46:14.534761] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T02:46:15.010324] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T02:46:15.090142] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-17T02:46:15.839183] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T02:46:15.890076] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-17T02:46:16.543048] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T02:46:16.690114] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-17T02:46:17.490111] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-17T02:46:17.640715] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T02:46:18.106021] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T02:46:18.290142] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-17T02:46:19.090192] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-17T02:46:19.265303] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T02:46:19.316847] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:19.317165] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-17T02:46:19.803336] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T02:46:19.890113] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-17T02:46:20.690128] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-17T02:46:20.924941] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:20.925274] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-17T02:46:21.490136] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-17T02:46:21.854956] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T02:46:22.290154] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-17T02:46:22.972843] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T02:46:23.090083] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-17T02:46:23.531913] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T02:46:23.538192] [INFO ] [REMOTE ] CF: Full fetch complete (74922 records). [2025-09-17T02:46:23.538381] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-17T02:46:23.894619] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-17T02:46:23.934498] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-17T02:46:23.934629] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-17T02:46:23.935438] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-17T02:46:23.935496] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-17T02:46:23.937050] [DEBUG] [LOCAL ] CF: Trimmed 74922 records to 52272 (keeping 200 days of data) [2025-09-17T02:46:24.192575] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:46:24.193448] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-17T02:46:24.280708] [DEBUG] [LOCAL ] CF: Primary data saved (52272 records). [2025-09-17T02:46:24.280879] [INFO ] [MAIN ] CF: Full history saved. [2025-09-17T02:46:24.280999] [INFO ] [MAIN ] Update Progress: 429/2369 symbols completed. CF took 39.8s. Estimated remaining: 4h 41m 41s. Rate: 6.9 symbols/min [2025-09-17T02:46:24.474050] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:24.504757] [DEBUG] [LOCAL ] CGAU: Loaded 31389 existing records from primary storage. [2025-09-17T02:46:24.504945] [INFO ] [MAIN ] CGAU: Loaded 31389 existing records. [2025-09-17T02:46:24.690308] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-17T02:46:24.717351] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:24.719775] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T02:46:24.718949] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-17T02:46:24.720065] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-17T02:46:24.728205] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-17T02:46:24.728309] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-17T02:46:25.081504] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:25.490219] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-17T02:46:26.290173] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-11. [2025-09-17T02:46:26.582434] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T02:46:26.772235] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T02:46:27.090151] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-17T02:46:27.793314] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T02:46:27.890093] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-17T02:46:28.387312] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T02:46:28.393729] [INFO ] [REMOTE ] CFG: Full fetch complete (77397 records). [2025-09-17T02:46:28.393871] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-17T02:46:28.695524] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-17T02:46:28.794678] [DEBUG] [VALIDATOR ] CFG: All expected trading days are present. [2025-09-17T02:46:28.794789] [DEBUG] [VALIDATOR ] CFG: Primary data validation passed. [2025-09-17T02:46:28.795576] [INFO ] [MAIN ] CFG: Fetched primary data is valid. [2025-09-17T02:46:28.795632] [DEBUG] [LOCAL ] CFG: Saving primary data. [2025-09-17T02:46:28.797277] [DEBUG] [LOCAL ] CFG: Trimmed 77397 records to 53621 (keeping 200 days of data) [2025-09-17T02:46:29.126709] [DEBUG] [LOCAL ] CFG: Primary data saved (53621 records). [2025-09-17T02:46:29.126874] [INFO ] [MAIN ] CFG: Full history saved. [2025-09-17T02:46:29.126987] [INFO ] [MAIN ] Update Progress: 430/2369 symbols completed. CFG took 37.9s. Estimated remaining: 4h 41m 15s. Rate: 6.9 symbols/min [2025-09-17T02:46:29.305576] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:29.313865] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T02:46:29.319132] [DEBUG] [LOCAL ] CGV: Loaded 954 existing records from primary storage. [2025-09-17T02:46:29.319282] [INFO ] [MAIN ] CGV: Loaded 954 existing records. [2025-09-17T02:46:29.490397] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-17T02:46:29.520229] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:29.522293] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T02:46:29.522709] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-17T02:46:29.522799] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-17T02:46:29.529987] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-17T02:46:29.530069] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-17T02:46:29.888390] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:30.290226] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-11. [2025-09-17T02:46:30.683164] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T02:46:30.826475] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T02:46:31.090164] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-17T02:46:31.890128] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-17T02:46:32.539469] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T02:46:32.540986] [INFO ] [REMOTE ] CFND: Full fetch complete (2261 records). [2025-09-17T02:46:32.541208] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-17T02:46:32.693099] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-17T02:46:32.748497] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 28 unique days, need 200 days [2025-09-17T02:46:32.749561] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:46:32.750234] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:46:32.751495] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T02:46:32.751634] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-17T02:46:32.759125] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-17T02:46:32.759442] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-17T02:46:32.760271] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-17T02:46:32.760397] [INFO ] [MAIN ] Update Progress: 431/2369 symbols completed. CFND took 32.0s. Estimated remaining: 4h 40m 44s. Rate: 6.9 symbols/min [2025-09-17T02:46:32.929697] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:32.952822] [DEBUG] [LOCAL ] CHCT: Loaded 17905 existing records from primary storage. [2025-09-17T02:46:32.953011] [INFO ] [MAIN ] CHCT: Loaded 17905 existing records. [2025-09-17T02:46:33.136835] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:33.137107] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-17T02:46:33.137167] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-17T02:46:33.137834] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-17T02:46:33.137895] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-17T02:46:33.487751] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:33.490082] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-11. [2025-09-17T02:46:34.290146] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-17T02:46:34.342962] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:46:34.644066] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:46:35.090126] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-17T02:46:35.522184] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T02:46:35.895208] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-17T02:46:35.907047] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T02:46:36.366305] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T02:46:36.690190] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-17T02:46:37.490180] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-17T02:46:37.998988] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T02:46:38.003683] [INFO ] [REMOTE ] CFR: Full fetch complete (48226 records). [2025-09-17T02:46:38.003841] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-17T02:46:38.299381] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-17T02:46:38.397355] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-17T02:46:38.397492] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-17T02:46:38.398178] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-17T02:46:38.398282] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-17T02:46:38.399668] [DEBUG] [LOCAL ] CFR: Trimmed 48226 records to 33633 (keeping 200 days of data) [2025-09-17T02:46:38.625851] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T02:46:38.657039] [DEBUG] [LOCAL ] CFR: Primary data saved (33633 records). [2025-09-17T02:46:38.657229] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-17T02:46:38.657333] [INFO ] [MAIN ] Update Progress: 432/2369 symbols completed. CFR took 36.0s. Estimated remaining: 4h 40m 22s. Rate: 6.9 symbols/min [2025-09-17T02:46:38.829322] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:38.829547] [DEBUG] [LOCAL ] CHD: No existing data file found in primary storage. [2025-09-17T02:46:38.829598] [WARN ] [MAIN ] CHD: No existing data found, performing full refresh instead. [2025-09-17T02:46:38.829736] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-17T02:46:38.829784] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-17T02:46:38.829832] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-09-17T02:46:38.829876] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-17T02:46:39.095341] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-17T02:46:39.196567] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:39.570778] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T02:46:39.587262] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T02:46:39.890150] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-11. [2025-09-17T02:46:40.690189] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-17T02:46:41.158570] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T02:46:41.490143] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-17T02:46:41.690931] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T02:46:42.290206] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-17T02:46:43.075759] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T02:46:43.090079] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-17T02:46:43.890171] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-17T02:46:44.078956] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T02:46:44.189984] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-17T02:46:44.585544] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T02:46:44.690119] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-17T02:46:45.490187] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-17T02:46:46.044560] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T02:46:46.290176] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-17T02:46:47.090210] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-17T02:46:47.257445] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T02:46:47.373582] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-17T02:46:47.794186] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T02:46:47.890165] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-17T02:46:48.370146] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T02:46:48.690199] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-17T02:46:49.490158] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-17T02:46:49.884115] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T02:46:50.290193] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-17T02:46:50.358604] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T02:46:51.090146] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-17T02:46:51.611272] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T02:46:51.890177] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-17T02:46:52.389445] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T02:46:52.502020] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T02:46:52.508158] [INFO ] [REMOTE ] CGAU: Full fetch complete (59922 records). [2025-09-17T02:46:52.508374] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-17T02:46:52.695070] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-17T02:46:52.910602] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-17T02:46:52.910730] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-17T02:46:52.911393] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-17T02:46:52.911450] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-17T02:46:52.912739] [DEBUG] [LOCAL ] CGAU: Trimmed 59922 records to 42404 (keeping 200 days of data) [2025-09-17T02:46:53.186172] [DEBUG] [LOCAL ] CGAU: Primary data saved (42404 records). [2025-09-17T02:46:53.186369] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-17T02:46:53.186470] [INFO ] [MAIN ] Update Progress: 433/2369 symbols completed. CGAU took 28.9s. Estimated remaining: 4h 40m 40s. Rate: 6.9 symbols/min [2025-09-17T02:46:53.360772] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:53.373008] [DEBUG] [LOCAL ] CHE: Loaded 11229 existing records from primary storage. [2025-09-17T02:46:53.373164] [INFO ] [MAIN ] CHE: Loaded 11229 existing records. [2025-09-17T02:46:53.495292] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-17T02:46:53.554822] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:53.555120] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-17T02:46:53.555182] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-17T02:46:53.555552] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-17T02:46:53.555610] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-17T02:46:53.943904] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:54.031737] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T02:46:54.290131] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-17T02:46:54.611728] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T02:46:54.668206] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T02:46:54.669006] [INFO ] [REMOTE ] CGV: Full fetch complete (2278 records). [2025-09-17T02:46:54.669101] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-17T02:46:55.021791] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-17T02:46:55.021915] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-17T02:46:55.022051] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-17T02:46:55.022113] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-17T02:46:55.022484] [DEBUG] [LOCAL ] CGV: Trimmed 2278 records to 1441 (keeping 200 days of data) [2025-09-17T02:46:55.031872] [DEBUG] [LOCAL ] CGV: Primary data saved (1441 records). [2025-09-17T02:46:55.031968] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-17T02:46:55.032059] [INFO ] [MAIN ] Update Progress: 434/2369 symbols completed. CGV took 25.9s. Estimated remaining: 4h 40m 1s. Rate: 6.9 symbols/min [2025-09-17T02:46:55.095320] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-17T02:46:55.202677] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:46:55.237393] [DEBUG] [LOCAL ] CHGG: Loaded 35600 existing records from primary storage. [2025-09-17T02:46:55.237559] [INFO ] [MAIN ] CHGG: Loaded 35600 existing records. [2025-09-17T02:46:55.418126] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:46:55.418409] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-17T02:46:55.418476] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-17T02:46:55.419274] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-17T02:46:55.419349] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-17T02:46:55.778019] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:46:55.890120] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-11. [2025-09-17T02:46:56.243824] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T02:46:56.690126] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-17T02:46:57.266770] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T02:46:57.490102] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-17T02:46:57.844614] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T02:46:58.290127] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-17T02:46:59.090142] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-17T02:46:59.407610] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T02:46:59.449524] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T02:46:59.890154] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-17T02:47:00.690186] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-17T02:47:01.004771] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T02:47:01.194582] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T02:47:01.490146] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-17T02:47:02.241274] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T02:47:02.290124] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-17T02:47:03.090144] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-17T02:47:03.342609] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T02:47:03.401557] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:47:03.890144] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-11. [2025-09-17T02:47:04.695296] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-17T02:47:04.722944] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T02:47:04.746812] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T02:47:05.490148] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-17T02:47:06.290134] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-17T02:47:06.437702] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T02:47:06.497734] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T02:47:07.090147] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-17T02:47:07.698068] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T02:47:07.890121] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-17T02:47:08.440732] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T02:47:08.690149] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-17T02:47:09.489291] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T02:47:09.494703] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-17T02:47:09.528975] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T02:47:10.130677] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T02:47:10.290144] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-17T02:47:11.090136] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-17T02:47:11.325280] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T02:47:11.328329] [INFO ] [REMOTE ] CHCT: Full fetch complete (35078 records). [2025-09-17T02:47:11.328427] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-17T02:47:11.769327] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-17T02:47:11.769444] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-17T02:47:11.769943] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-17T02:47:11.770006] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-17T02:47:11.771072] [DEBUG] [LOCAL ] CHCT: Trimmed 35078 records to 24153 (keeping 200 days of data) [2025-09-17T02:47:11.892160] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-17T02:47:11.928061] [DEBUG] [LOCAL ] CHCT: Primary data saved (24153 records). [2025-09-17T02:47:11.928215] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-17T02:47:11.928322] [INFO ] [MAIN ] Update Progress: 435/2369 symbols completed. CHCT took 39.2s. Estimated remaining: 4h 40m 29s. Rate: 6.9 symbols/min [2025-09-17T02:47:12.101131] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:12.123679] [DEBUG] [LOCAL ] CHH: Loaded 23518 existing records from primary storage. [2025-09-17T02:47:12.123850] [INFO ] [MAIN ] CHH: Loaded 23518 existing records. [2025-09-17T02:47:12.308901] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:12.309164] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-17T02:47:12.309225] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-17T02:47:12.310046] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-17T02:47:12.310114] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-17T02:47:12.690502] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-17T02:47:12.695228] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:12.729281] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T02:47:12.784488] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T02:47:13.490166] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-17T02:47:14.290154] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-17T02:47:14.447486] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T02:47:14.627574] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T02:47:15.090138] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-17T02:47:15.890117] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-11. [2025-09-17T02:47:16.118617] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T02:47:16.690135] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-17T02:47:16.885899] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T02:47:17.216400] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T02:47:17.490163] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-17T02:47:18.290160] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-17T02:47:18.640069] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T02:47:19.058809] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T02:47:19.065136] [INFO ] [REMOTE ] CHD: Full fetch complete (74136 records). [2025-09-17T02:47:19.065340] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-17T02:47:19.096745] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-17T02:47:19.490065] [DEBUG] [VALIDATOR ] CHD: All expected trading days are present. [2025-09-17T02:47:19.490513] [DEBUG] [VALIDATOR ] CHD: Primary data validation passed. [2025-09-17T02:47:19.491083] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T02:47:19.491996] [INFO ] [MAIN ] CHD: Fetched primary data is valid. [2025-09-17T02:47:19.497968] [DEBUG] [LOCAL ] CHD: Saving primary data. [2025-09-17T02:47:19.502266] [DEBUG] [LOCAL ] CHD: Trimmed 74136 records to 51984 (keeping 200 days of data) [2025-09-17T02:47:19.830858] [DEBUG] [LOCAL ] CHD: Primary data saved (51984 records). [2025-09-17T02:47:19.831032] [INFO ] [MAIN ] CHD: Full history saved. [2025-09-17T02:47:19.831131] [INFO ] [MAIN ] Update Progress: 436/2369 symbols completed. CHD took 41.2s. Estimated remaining: 4h 40m 16s. Rate: 6.9 symbols/min [2025-09-17T02:47:19.895445] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-17T02:47:20.009811] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:20.020356] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T02:47:20.038442] [DEBUG] [LOCAL ] CHMI: Loaded 15316 existing records from primary storage. [2025-09-17T02:47:20.038584] [INFO ] [MAIN ] CHMI: Loaded 15316 existing records. [2025-09-17T02:47:20.214787] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:20.215029] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-17T02:47:20.215087] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-17T02:47:20.215535] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-17T02:47:20.215593] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-17T02:47:20.569710] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:20.690193] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-17T02:47:21.490202] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-17T02:47:21.640448] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T02:47:21.674587] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T02:47:22.290184] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-11. [2025-09-17T02:47:22.860789] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T02:47:23.090132] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-17T02:47:23.369715] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T02:47:23.890195] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-17T02:47:24.236373] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T02:47:24.690171] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-17T02:47:24.850594] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T02:47:25.490137] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-17T02:47:25.993523] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T02:47:26.279214] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T02:47:26.290069] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-17T02:47:27.090138] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-17T02:47:27.288716] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T02:47:27.890146] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-17T02:47:28.181878] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:47:28.690170] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-17T02:47:29.147966] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T02:47:29.418987] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T02:47:29.490078] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-17T02:47:30.290185] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-17T02:47:30.545236] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:47:31.090138] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-17T02:47:31.890117] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-17T02:47:31.907840] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T02:47:31.913800] [INFO ] [REMOTE ] CHGG: Full fetch complete (70700 records). [2025-09-17T02:47:31.913982] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-17T02:47:32.278923] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T02:47:32.335055] [DEBUG] [VALIDATOR ] CHGG: All expected trading days are present. [2025-09-17T02:47:32.335163] [DEBUG] [VALIDATOR ] CHGG: Primary data validation passed. [2025-09-17T02:47:32.336071] [INFO ] [MAIN ] CHGG: Fetched primary data is valid. [2025-09-17T02:47:32.336176] [DEBUG] [LOCAL ] CHGG: Saving primary data. [2025-09-17T02:47:32.339285] [DEBUG] [LOCAL ] CHGG: Trimmed 70700 records to 47838 (keeping 200 days of data) [2025-09-17T02:47:32.613733] [DEBUG] [LOCAL ] CHGG: Primary data saved (47838 records). [2025-09-17T02:47:32.613885] [INFO ] [MAIN ] CHGG: Full history saved. [2025-09-17T02:47:32.614031] [INFO ] [MAIN ] Update Progress: 437/2369 symbols completed. CHGG took 37.6s. Estimated remaining: 4h 40m 26s. Rate: 6.9 symbols/min [2025-09-17T02:47:32.690147] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-17T02:47:32.896262] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T02:47:32.898778] [INFO ] [REMOTE ] CHE: Full fetch complete (19162 records). [2025-09-17T02:47:32.898863] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-17T02:47:33.258218] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-17T02:47:33.258318] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-17T02:47:33.258637] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-17T02:47:33.258699] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-17T02:47:33.259303] [DEBUG] [LOCAL ] CHE: Trimmed 19162 records to 14516 (keeping 200 days of data) [2025-09-17T02:47:33.357320] [DEBUG] [LOCAL ] CHE: Primary data saved (14516 records). [2025-09-17T02:47:33.357588] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-17T02:47:33.357788] [INFO ] [MAIN ] Update Progress: 438/2369 symbols completed. CHE took 40.2s. Estimated remaining: 4h 39m 42s. Rate: 6.9 symbols/min [2025-09-17T02:47:33.490176] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-17T02:47:33.742111] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T02:47:34.290183] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-17T02:47:34.717985] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T02:47:35.090128] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-17T02:47:35.632458] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T02:47:35.890153] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-17T02:47:36.194833] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T02:47:36.690180] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-17T02:47:37.012382] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T02:47:37.490150] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-17T02:47:37.768336] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T02:47:38.290188] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-17T02:47:38.472316] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T02:47:39.090108] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-17T02:47:39.464867] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T02:47:39.877547] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T02:47:39.881486] [INFO ] [REMOTE ] CHH: Full fetch complete (45960 records). [2025-09-17T02:47:39.881635] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-17T02:47:39.914711] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-17T02:47:40.263976] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-17T02:47:40.264089] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-17T02:47:40.264717] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-17T02:47:40.264823] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-17T02:47:40.265931] [DEBUG] [LOCAL ] CHH: Trimmed 45960 records to 32484 (keeping 200 days of data) [2025-09-17T02:47:40.474994] [DEBUG] [LOCAL ] CHH: Primary data saved (32484 records). [2025-09-17T02:47:40.475159] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-17T02:47:40.475278] [INFO ] [MAIN ] Update Progress: 439/2369 symbols completed. CHH took 28.5s. Estimated remaining: 4h 39m 26s. Rate: 6.9 symbols/min [2025-09-17T02:47:41.035260] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T02:47:41.039772] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-17T02:47:42.065197] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T02:47:42.068293] [INFO ] [REMOTE ] CHMI: Full fetch complete (31516 records). [2025-09-17T02:47:42.068410] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-17T02:47:42.435952] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-17T02:47:42.436061] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-17T02:47:42.436534] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-17T02:47:42.436615] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-17T02:47:42.438152] [DEBUG] [LOCAL ] CHMI: Trimmed 31516 records to 22006 (keeping 200 days of data) [2025-09-17T02:47:42.571860] [DEBUG] [LOCAL ] CHMI: Primary data saved (22006 records). [2025-09-17T02:47:42.572034] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-17T02:47:42.572162] [INFO ] [MAIN ] Update Progress: 440/2369 symbols completed. CHMI took 22.7s. Estimated remaining: 4h 38m 49s. Rate: 6.9 symbols/min [2025-09-17T02:47:43.120054] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:43.183815] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:43.271399] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:43.250020] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:43.279289] [DEBUG] [LOCAL ] CHN: Loaded 3643 existing records from primary storage. [2025-09-17T02:47:43.279438] [INFO ] [MAIN ] CHN: Loaded 3643 existing records. [2025-09-17T02:47:43.410354] [DEBUG] [LOCAL ] CHT: Loaded 14367 existing records from primary storage. [2025-09-17T02:47:43.410719] [INFO ] [MAIN ] CHT: Loaded 14367 existing records. [2025-09-17T02:47:43.617988] [DEBUG] [LOCAL ] CHPT: Loaded 36364 existing records from primary storage. [2025-09-17T02:47:43.617030] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:43.644106] [INFO ] [MAIN ] CHPT: Loaded 36364 existing records. [2025-09-17T02:47:43.689549] [DEBUG] [LOCAL ] CHWY: Loaded 40012 existing records from primary storage. [2025-09-17T02:47:43.689623] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-17T02:47:43.749998] [INFO ] [MAIN ] CHWY: Loaded 40012 existing records. [2025-09-17T02:47:43.744756] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:43.764313] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-17T02:47:43.788890] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-17T02:47:43.783709] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-17T02:47:43.818545] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-17T02:47:43.828873] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-17T02:47:43.854697] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-17T02:47:43.897423] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-17T02:47:44.261001] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:44.299506] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:44.329520] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-17T02:47:44.342669] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-17T02:47:44.407825] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-17T02:47:44.407875] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-17T02:47:44.546493] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-17T02:47:44.579458] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-17T02:47:44.579375] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-17T02:47:44.634957] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-17T02:47:44.999634] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:44.996815] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:45.060424] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-11. [2025-09-17T02:47:45.070784] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-11. [2025-09-17T02:47:45.526155] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:45.546077] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-11. [2025-09-17T02:47:45.566808] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:45.567158] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-11. [2025-09-17T02:47:45.655562] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T02:47:45.657472] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-17T02:47:46.253304] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T02:47:46.257597] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-17T02:47:46.289397] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T02:47:46.291244] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-17T02:47:46.950702] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T02:47:47.090094] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-17T02:47:47.304143] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T02:47:47.497250] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T02:47:47.794201] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T02:47:47.793497] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-11 (2.25 seconds). [2025-09-17T02:47:47.890085] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-17T02:47:48.690175] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-17T02:47:49.150057] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T02:47:49.490175] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-17T02:47:50.041044] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-17T02:47:50.290150] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-17T02:47:50.739075] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T02:47:51.090114] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-17T02:47:51.705590] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-17T02:47:51.890159] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-17T02:47:52.095395] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T02:47:52.690127] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-17T02:47:53.490154] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-17T02:47:53.865780] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T02:47:54.108211] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-17T02:47:54.290167] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-17T02:47:54.762397] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-17T02:47:54.892377] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T02:47:55.090140] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-17T02:47:55.890135] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-17T02:47:56.504013] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T02:47:56.690139] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-17T02:47:57.174298] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T02:47:57.211564] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-17T02:47:57.490162] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-17T02:47:58.171251] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T02:47:58.172898] [INFO ] [REMOTE ] CHN: Full fetch complete (7604 records). [2025-09-17T02:47:58.173031] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-17T02:47:58.295352] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-17T02:47:58.620419] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-17T02:47:58.620561] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-17T02:47:58.620853] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-17T02:47:58.620913] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-17T02:47:58.621525] [DEBUG] [LOCAL ] CHN: Trimmed 7604 records to 4839 (keeping 200 days of data) [2025-09-17T02:47:58.653632] [DEBUG] [LOCAL ] CHN: Primary data saved (4839 records). [2025-09-17T02:47:58.653829] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-17T02:47:58.653947] [INFO ] [MAIN ] Update Progress: 441/2369 symbols completed. CHN took 16.1s. Estimated remaining: 4h 39m 12s. Rate: 6.9 symbols/min [2025-09-17T02:47:58.830823] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:47:58.874051] [DEBUG] [LOCAL ] CI: Loaded 37304 existing records from primary storage. [2025-09-17T02:47:58.874234] [INFO ] [MAIN ] CI: Loaded 37304 existing records. [2025-09-17T02:47:59.057943] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:47:59.058260] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-17T02:47:59.058331] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-17T02:47:59.059269] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-17T02:47:59.059334] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-17T02:47:59.095449] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-17T02:47:59.428623] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:47:59.890130] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-11. [2025-09-17T02:47:59.959126] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T02:48:00.213759] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T02:48:00.690125] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-17T02:48:01.451374] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T02:48:01.490097] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-17T02:48:02.080734] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T02:48:02.290132] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-17T02:48:03.090164] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-17T02:48:03.890133] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-17T02:48:04.274454] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-09-17T02:48:04.690119] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-17T02:48:05.218698] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-17T02:48:05.243801] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T02:48:05.399502] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-09-17T02:48:05.490102] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-17T02:48:06.290137] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-17T02:48:06.548977] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T02:48:07.090106] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-17T02:48:07.408159] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T02:48:07.592556] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T02:48:07.890133] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-17T02:48:08.690087] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-17T02:48:08.789386] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T02:48:08.926040] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T02:48:09.490134] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-17T02:48:10.290280] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-17T02:48:10.658200] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T02:48:11.090167] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-17T02:48:11.235031] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:48:11.804869] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T02:48:11.890104] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-17T02:48:12.690164] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-17T02:48:12.834299] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T02:48:13.490178] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-17T02:48:13.721581] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T02:48:13.950005] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T02:48:14.290133] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-17T02:48:15.090177] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-17T02:48:15.590049] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T02:48:15.890119] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-17T02:48:16.164719] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T02:48:16.228980] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T02:48:16.690140] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-17T02:48:17.490145] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-17T02:48:18.290097] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-17T02:48:18.477464] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-17T02:48:18.706367] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T02:48:19.090105] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-17T02:48:19.180414] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T02:48:19.183185] [INFO ] [REMOTE ] CHT: Full fetch complete (27498 records). [2025-09-17T02:48:19.183279] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-17T02:48:19.577151] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-17T02:48:19.577266] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-17T02:48:19.577771] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-17T02:48:19.577838] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-17T02:48:19.578676] [DEBUG] [LOCAL ] CHT: Trimmed 27498 records to 19821 (keeping 200 days of data) [2025-09-17T02:48:19.708274] [DEBUG] [LOCAL ] CHT: Primary data saved (19821 records). [2025-09-17T02:48:19.708489] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-17T02:48:19.708614] [INFO ] [MAIN ] Update Progress: 442/2369 symbols completed. CHT took 37.1s. Estimated remaining: 4h 39m 58s. Rate: 6.9 symbols/min [2025-09-17T02:48:19.923696] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-17T02:48:19.926207] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:19.940676] [DEBUG] [LOCAL ] CIA: Loaded 12780 existing records from primary storage. [2025-09-17T02:48:19.940823] [INFO ] [MAIN ] CIA: Loaded 12780 existing records. [2025-09-17T02:48:20.125706] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:20.125955] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-17T02:48:20.126018] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-17T02:48:20.126406] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-17T02:48:20.126463] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-17T02:48:20.490147] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:20.521601] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-17T02:48:20.619981] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T02:48:20.690093] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-17T02:48:21.490108] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-17T02:48:21.794452] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T02:48:22.290102] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-17T02:48:22.736280] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-17T02:48:22.743183] [INFO ] [REMOTE ] CHWY: Full fetch complete (77505 records). [2025-09-17T02:48:22.743348] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-17T02:48:23.092484] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-11. [2025-09-17T02:48:23.146370] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-17T02:48:23.146499] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-17T02:48:23.147475] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-17T02:48:23.147549] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-17T02:48:23.149231] [DEBUG] [LOCAL ] CHWY: Trimmed 77505 records to 53626 (keeping 200 days of data) [2025-09-17T02:48:23.477590] [DEBUG] [LOCAL ] CHWY: Primary data saved (53626 records). [2025-09-17T02:48:23.477818] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-17T02:48:23.477937] [INFO ] [MAIN ] Update Progress: 443/2369 symbols completed. CHWY took 40.9s. Estimated remaining: 4h 39m 27s. Rate: 6.9 symbols/min [2025-09-17T02:48:23.650367] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:23.672910] [DEBUG] [LOCAL ] CIB: Loaded 21993 existing records from primary storage. [2025-09-17T02:48:23.673103] [INFO ] [MAIN ] CIB: Loaded 21993 existing records. [2025-09-17T02:48:23.854405] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:23.854844] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-17T02:48:23.855006] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-17T02:48:23.866467] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-17T02:48:23.884127] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-17T02:48:23.965752] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-17T02:48:24.028945] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-17T02:48:24.064716] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T02:48:24.308220] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:24.338346] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T02:48:24.690121] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-17T02:48:25.490182] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-17T02:48:25.686396] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T02:48:26.290139] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-11. [2025-09-17T02:48:26.359283] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T02:48:26.366053] [INFO ] [REMOTE ] CI: Full fetch complete (72403 records). [2025-09-17T02:48:26.373757] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-17T02:48:26.375087] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T02:48:26.776333] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-17T02:48:26.776445] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-17T02:48:26.777226] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-17T02:48:26.777286] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-17T02:48:26.778743] [DEBUG] [LOCAL ] CI: Trimmed 72403 records to 49995 (keeping 200 days of data) [2025-09-17T02:48:27.090136] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-17T02:48:27.108402] [DEBUG] [LOCAL ] CI: Primary data saved (49995 records). [2025-09-17T02:48:27.108547] [INFO ] [MAIN ] CI: Full history saved. [2025-09-17T02:48:27.108659] [INFO ] [MAIN ] Update Progress: 444/2369 symbols completed. CI took 28.5s. Estimated remaining: 4h 38m 57s. Rate: 6.9 symbols/min [2025-09-17T02:48:27.277958] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:27.278163] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-17T02:48:27.278211] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-17T02:48:27.278316] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-17T02:48:27.278378] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-17T02:48:27.278445] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-17T02:48:27.278488] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-17T02:48:27.636807] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:27.654223] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T02:48:27.890155] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-17T02:48:28.567778] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T02:48:28.572602] [INFO ] [REMOTE ] CHPT: Full fetch complete (73998 records). [2025-09-17T02:48:28.572753] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-17T02:48:28.695300] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-17T02:48:28.977600] [DEBUG] [VALIDATOR ] CHPT: All expected trading days are present. [2025-09-17T02:48:28.977762] [DEBUG] [VALIDATOR ] CHPT: Primary data validation passed. [2025-09-17T02:48:28.991381] [INFO ] [MAIN ] CHPT: Fetched primary data is valid. [2025-09-17T02:48:28.997028] [DEBUG] [LOCAL ] CHPT: Saving primary data. [2025-09-17T02:48:28.996934] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T02:48:29.003500] [DEBUG] [LOCAL ] CHPT: Trimmed 73998 records to 49915 (keeping 200 days of data) [2025-09-17T02:48:29.297062] [DEBUG] [LOCAL ] CHPT: Primary data saved (49915 records). [2025-09-17T02:48:29.297223] [INFO ] [MAIN ] CHPT: Full history saved. [2025-09-17T02:48:29.297319] [INFO ] [MAIN ] Update Progress: 445/2369 symbols completed. CHPT took 46.7s. Estimated remaining: 4h 38m 20s. Rate: 6.9 symbols/min [2025-09-17T02:48:29.467288] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:29.492750] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-17T02:48:29.510449] [DEBUG] [LOCAL ] CIEN: Loaded 38661 existing records from primary storage. [2025-09-17T02:48:29.510654] [INFO ] [MAIN ] CIEN: Loaded 38661 existing records. [2025-09-17T02:48:29.698113] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:29.698711] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-17T02:48:29.698776] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-17T02:48:29.699754] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-17T02:48:29.699815] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-17T02:48:29.859935] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:48:30.072164] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:30.290161] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-11. [2025-09-17T02:48:30.763495] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T02:48:30.795906] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T02:48:31.090144] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-11. [2025-09-17T02:48:31.890419] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-17T02:48:32.695190] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-17T02:48:32.721729] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T02:48:32.723605] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T02:48:33.490129] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-17T02:48:33.939988] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T02:48:34.124925] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T02:48:34.290141] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-17T02:48:34.580226] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-17T02:48:35.090149] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-17T02:48:35.890168] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-17T02:48:36.340952] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T02:48:36.690147] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-17T02:48:36.870258] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T02:48:37.490190] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-17T02:48:37.684530] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T02:48:37.793078] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.30 seconds). [2025-09-17T02:48:38.290164] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-17T02:48:39.044070] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T02:48:39.090130] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-17T02:48:39.350692] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-17T02:48:39.890162] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-17T02:48:40.690153] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-17T02:48:40.907109] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T02:48:41.490139] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-17T02:48:41.979878] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T02:48:42.290146] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-17T02:48:42.468889] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T02:48:43.090135] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-17T02:48:43.208380] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T02:48:43.660175] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T02:48:43.890132] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-17T02:48:44.690111] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-17T02:48:45.029440] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T02:48:45.490190] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-17T02:48:46.043310] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T02:48:46.290229] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-17T02:48:47.090099] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-17T02:48:47.205357] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T02:48:47.414509] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T02:48:47.428048] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T02:48:47.890137] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-17T02:48:48.690130] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-17T02:48:48.940587] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T02:48:49.490156] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-17T02:48:49.928493] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T02:48:49.990430] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T02:48:49.992984] [INFO ] [REMOTE ] CIA: Full fetch complete (22924 records). [2025-09-17T02:48:49.993107] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-17T02:48:50.295253] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-17T02:48:50.463297] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-17T02:48:50.463452] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-17T02:48:50.464185] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-17T02:48:50.464262] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-17T02:48:50.465636] [DEBUG] [LOCAL ] CIA: Trimmed 22924 records to 16768 (keeping 200 days of data) [2025-09-17T02:48:50.617232] [DEBUG] [LOCAL ] CIA: Primary data saved (16768 records). [2025-09-17T02:48:50.617762] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-17T02:48:50.617909] [INFO ] [MAIN ] Update Progress: 446/2369 symbols completed. CIA took 30.9s. Estimated remaining: 4h 39m 6s. Rate: 6.9 symbols/min [2025-09-17T02:48:50.868274] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:50.875550] [DEBUG] [LOCAL ] CIF: Loaded 2981 existing records from primary storage. [2025-09-17T02:48:50.875761] [INFO ] [MAIN ] CIF: Loaded 2981 existing records. [2025-09-17T02:48:51.095441] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-17T02:48:51.134687] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:51.134981] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-17T02:48:51.135054] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-17T02:48:51.135438] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-17T02:48:51.135509] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-17T02:48:51.529397] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:51.796982] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T02:48:51.890082] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-17T02:48:52.450061] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T02:48:52.690143] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-17T02:48:53.490106] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-17T02:48:53.495096] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T02:48:53.500319] [INFO ] [REMOTE ] CIB: Full fetch complete (44011 records). [2025-09-17T02:48:53.500459] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-17T02:48:53.884525] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-17T02:48:53.884730] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-17T02:48:53.885318] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-17T02:48:53.885393] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-17T02:48:53.886757] [DEBUG] [LOCAL ] CIB: Trimmed 44011 records to 31191 (keeping 200 days of data) [2025-09-17T02:48:54.012278] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T02:48:54.018146] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-17T02:48:54.126510] [DEBUG] [LOCAL ] CIB: Primary data saved (31191 records). [2025-09-17T02:48:54.126707] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-17T02:48:54.126804] [INFO ] [MAIN ] Update Progress: 447/2369 symbols completed. CIB took 30.6s. Estimated remaining: 4h 38m 35s. Rate: 6.9 symbols/min [2025-09-17T02:48:54.291226] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-17T02:48:54.316110] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:54.353522] [DEBUG] [LOCAL ] CIG: Loaded 32909 existing records from primary storage. [2025-09-17T02:48:54.353726] [INFO ] [MAIN ] CIG: Loaded 32909 existing records. [2025-09-17T02:48:54.546713] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:54.546957] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-17T02:48:54.547016] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-17T02:48:54.547877] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-17T02:48:54.547942] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-17T02:48:54.705631] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T02:48:54.930207] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:55.090154] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-11. [2025-09-17T02:48:55.767071] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T02:48:55.890104] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-11. [2025-09-17T02:48:56.690142] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-17T02:48:57.360488] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T02:48:57.490137] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-17T02:48:57.831585] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T02:48:57.832361] [INFO ] [REMOTE ] CICB: Full fetch complete (2169 records). [2025-09-17T02:48:57.832442] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-17T02:48:58.014745] [WARN ] [VALIDATOR ] CICB: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T02:48:58.014961] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:48:58.015031] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:48:58.015095] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-17T02:48:58.015185] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-17T02:48:58.015255] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-17T02:48:58.015343] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-17T02:48:58.015436] [INFO ] [MAIN ] Update Progress: 448/2369 symbols completed. CICB took 30.9s. Estimated remaining: 4h 38m 5s. Rate: 6.9 symbols/min [2025-09-17T02:48:58.190110] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:48:58.202039] [DEBUG] [LOCAL ] CII: Loaded 10219 existing records from primary storage. [2025-09-17T02:48:58.202256] [INFO ] [MAIN ] CII: Loaded 10219 existing records. [2025-09-17T02:48:58.295193] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-17T02:48:58.394717] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:48:58.395331] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-17T02:48:58.395508] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-17T02:48:58.396004] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-17T02:48:58.396143] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-17T02:48:58.737801] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T02:48:58.831320] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:48:59.090131] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-17T02:48:59.761892] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T02:48:59.876790] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T02:48:59.890087] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-17T02:49:00.690129] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-17T02:49:01.308744] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T02:49:01.371176] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T02:49:01.490134] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-11. [2025-09-17T02:49:02.290137] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-17T02:49:02.462502] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T02:49:02.790127] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T02:49:03.090140] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-17T02:49:03.890135] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-17T02:49:04.690150] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-17T02:49:04.907271] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T02:49:04.937002] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T02:49:05.490135] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-17T02:49:05.534856] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T02:49:06.290139] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-17T02:49:07.090136] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-17T02:49:07.402999] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T02:49:07.749196] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T02:49:07.798620] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T02:49:07.890137] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-17T02:49:08.541715] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T02:49:08.690122] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-17T02:49:09.494465] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-17T02:49:09.495630] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T02:49:10.176480] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T02:49:10.290118] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-17T02:49:11.090118] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-17T02:49:11.700123] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T02:49:11.890141] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-17T02:49:12.191243] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T02:49:12.690184] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-17T02:49:13.490139] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-17T02:49:13.738514] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T02:49:13.761171] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T02:49:14.290172] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-17T02:49:15.002617] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T02:49:15.090140] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-17T02:49:15.132994] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T02:49:15.890133] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-17T02:49:16.206420] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T02:49:16.690145] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-17T02:49:16.892534] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:49:17.490177] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-17T02:49:18.129253] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T02:49:18.290128] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-17T02:49:18.443534] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T02:49:18.450026] [INFO ] [REMOTE ] CIEN: Full fetch complete (75322 records). [2025-09-17T02:49:18.450176] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-17T02:49:18.853896] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-17T02:49:18.854053] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-17T02:49:18.855012] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-17T02:49:18.855090] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-17T02:49:18.856882] [DEBUG] [LOCAL ] CIEN: Trimmed 75322 records to 52112 (keeping 200 days of data) [2025-09-17T02:49:19.090688] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-17T02:49:19.179491] [DEBUG] [LOCAL ] CIEN: Primary data saved (52112 records). [2025-09-17T02:49:19.179705] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-17T02:49:19.179836] [INFO ] [MAIN ] Update Progress: 449/2369 symbols completed. CIEN took 49.9s. Estimated remaining: 4h 38m 50s. Rate: 6.9 symbols/min [2025-09-17T02:49:19.381371] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:19.389787] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T02:49:19.417947] [DEBUG] [LOCAL ] CIM: Loaded 26648 existing records from primary storage. [2025-09-17T02:49:19.418141] [INFO ] [MAIN ] CIM: Loaded 26648 existing records. [2025-09-17T02:49:19.595604] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:19.595938] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-17T02:49:19.596016] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-17T02:49:19.596782] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-17T02:49:19.596858] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-17T02:49:19.895249] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-17T02:49:19.950914] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:20.516979] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T02:49:20.518177] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T02:49:20.690104] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-11. [2025-09-17T02:49:21.490145] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-17T02:49:21.840085] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:49:22.194926] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T02:49:22.290090] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-17T02:49:23.090153] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-17T02:49:23.678702] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T02:49:23.823459] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T02:49:23.890111] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-17T02:49:24.690131] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-17T02:49:24.713525] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T02:49:24.715978] [INFO ] [REMOTE ] CII: Full fetch complete (23079 records). [2025-09-17T02:49:24.716080] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-17T02:49:25.086002] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T02:49:25.086081] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-17T02:49:25.087147] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-17T02:49:25.087213] [INFO ] [REMOTE ] CIF: Full fetch complete (6673 records). [2025-09-17T02:49:25.087859] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-17T02:49:25.087411] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-17T02:49:25.087976] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-17T02:49:25.188816] [DEBUG] [LOCAL ] CII: Trimmed 23079 records to 15733 (keeping 200 days of data) [2025-09-17T02:49:25.497807] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-17T02:49:25.532564] [DEBUG] [VALIDATOR ] CIF: All expected trading days are present. [2025-09-17T02:49:25.534697] [DEBUG] [VALIDATOR ] CIF: Primary data validation passed. [2025-09-17T02:49:25.537419] [INFO ] [MAIN ] CIF: Fetched primary data is valid. [2025-09-17T02:49:25.541390] [DEBUG] [LOCAL ] CIF: Saving primary data. [2025-09-17T02:49:25.544972] [DEBUG] [LOCAL ] CIF: Trimmed 6673 records to 4548 (keeping 200 days of data) [2025-09-17T02:49:25.575601] [DEBUG] [LOCAL ] CII: Primary data saved (15733 records). [2025-09-17T02:49:25.576730] [INFO ] [MAIN ] CII: Full history saved. [2025-09-17T02:49:25.577804] [INFO ] [MAIN ] Update Progress: 450/2369 symbols completed. CII took 27.6s. Estimated remaining: 4h 38m 31s. Rate: 6.9 symbols/min [2025-09-17T02:49:25.670382] [DEBUG] [LOCAL ] CIF: Primary data saved (4548 records). [2025-09-17T02:49:25.680601] [INFO ] [MAIN ] CIF: Full history saved. [2025-09-17T02:49:25.686344] [INFO ] [MAIN ] Update Progress: 451/2369 symbols completed. CIF took 35.1s. Estimated remaining: 4h 37m 46s. Rate: 6.9 symbols/min [2025-09-17T02:49:25.836815] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:25.930610] [DEBUG] [LOCAL ] CIMN: Loaded 1937 existing records from primary storage. [2025-09-17T02:49:25.932214] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:25.932725] [INFO ] [MAIN ] CIMN: Loaded 1937 existing records. [2025-09-17T02:49:26.036104] [DEBUG] [LOCAL ] CIMO: Loaded 2059 existing records from primary storage. [2025-09-17T02:49:26.057087] [INFO ] [MAIN ] CIMO: Loaded 2059 existing records. [2025-09-17T02:49:26.194029] [WARN ] [MAIN ] CIMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:26.232058] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-17T02:49:26.237672] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-17T02:49:26.253181] [DEBUG] [LOCAL ] CIMN: Deleted primary data file. [2025-09-17T02:49:26.282774] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-17T02:49:26.305893] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-17T02:49:26.311364] [WARN ] [MAIN ] CIMO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:26.333793] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-17T02:49:26.369069] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-17T02:49:26.394697] [DEBUG] [LOCAL ] CIMO: Deleted primary data file. [2025-09-17T02:49:26.415471] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-17T02:49:26.983527] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:27.045726] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:27.067107] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:49:27.090080] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-17T02:49:27.890133] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-11. [2025-09-17T02:49:27.935044] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T02:49:28.356656] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T02:49:28.642605] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T02:49:28.690089] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-17T02:49:29.165994] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T02:49:29.490170] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-11. [2025-09-17T02:49:30.033582] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T02:49:30.290164] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-17T02:49:30.842820] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T02:49:31.090169] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-17T02:49:31.609273] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T02:49:31.890143] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-17T02:49:32.360009] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T02:49:32.690196] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-17T02:49:33.490182] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-17T02:49:34.295311] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-17T02:49:34.313416] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T02:49:34.986179] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T02:49:35.010969] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T02:49:35.090089] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-17T02:49:35.890149] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-17T02:49:36.517348] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:49:36.690123] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-17T02:49:37.023162] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T02:49:37.490143] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-17T02:49:37.576341] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T02:49:38.015538] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T02:49:38.290147] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-17T02:49:38.885455] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T02:49:39.090141] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-17T02:49:39.890152] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-17T02:49:40.482162] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T02:49:40.487523] [INFO ] [REMOTE ] CIG: Full fetch complete (60579 records). [2025-09-17T02:49:40.487717] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-17T02:49:40.695370] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-17T02:49:40.875351] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-17T02:49:40.875462] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-17T02:49:40.876210] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-17T02:49:40.876269] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-17T02:49:40.877552] [DEBUG] [LOCAL ] CIG: Trimmed 60579 records to 43581 (keeping 200 days of data) [2025-09-17T02:49:41.126569] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T02:49:41.163390] [DEBUG] [LOCAL ] CIG: Primary data saved (43581 records). [2025-09-17T02:49:41.163581] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-17T02:49:41.163707] [INFO ] [MAIN ] Update Progress: 452/2369 symbols completed. CIG took 47.0s. Estimated remaining: 4h 38m 6s. Rate: 6.9 symbols/min [2025-09-17T02:49:41.274737] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T02:49:41.348692] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:41.363471] [DEBUG] [LOCAL ] CINT: Loaded 13656 existing records from primary storage. [2025-09-17T02:49:41.363665] [INFO ] [MAIN ] CINT: Loaded 13656 existing records. [2025-09-17T02:49:41.495327] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-17T02:49:41.552086] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:41.552429] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-17T02:49:41.552495] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-17T02:49:41.552913] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-17T02:49:41.552984] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-17T02:49:41.913109] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:41.917280] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T02:49:42.290157] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-11. [2025-09-17T02:49:42.823491] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T02:49:43.090166] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-17T02:49:43.564020] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T02:49:43.890402] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-17T02:49:44.690164] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-17T02:49:45.264091] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T02:49:45.490129] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-17T02:49:45.555863] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T02:49:45.593758] [DEBUG] [REMOTE ] CIMN: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-17T02:49:45.594067] [WARN ] [REMOTE ] CIMN: No data returned for month 2025-07 [2025-09-17T02:49:46.290144] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-17T02:49:46.726424] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T02:49:47.090148] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-17T02:49:47.442307] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T02:49:47.443157] [INFO ] [REMOTE ] CIMN: Full fetch complete (3603 records). [2025-09-17T02:49:47.443240] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-17T02:49:47.628590] [WARN ] [VALIDATOR ] CIMN: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-17T02:49:47.628840] [FATAL] [MAIN ] CIMN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:49:47.628898] [WARN ] [MAIN ] CIMN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:49:47.628940] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-17T02:49:47.629000] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-09-17T02:49:47.629048] [INFO ] [LOCAL ] CIMN: Starting deletion of derivative data. [2025-09-17T02:49:47.629392] [DEBUG] [LOCAL ] CIMN: Deleted derivative data file. [2025-09-17T02:49:47.629489] [INFO ] [MAIN ] Update Progress: 453/2369 symbols completed. CIMN took 22.1s. Estimated remaining: 4h 37m 48s. Rate: 6.9 symbols/min [2025-09-17T02:49:47.808489] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:47.824288] [DEBUG] [LOCAL ] CIO: Loaded 14659 existing records from primary storage. [2025-09-17T02:49:47.824480] [INFO ] [MAIN ] CIO: Loaded 14659 existing records. [2025-09-17T02:49:47.895251] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-17T02:49:48.017748] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:48.018020] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-17T02:49:48.018079] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-17T02:49:48.018680] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-17T02:49:48.018745] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-17T02:49:48.396796] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:48.690187] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-11. [2025-09-17T02:49:49.127699] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T02:49:49.490219] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-17T02:49:49.578679] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T02:49:50.290152] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-17T02:49:50.455989] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T02:49:51.090130] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-17T02:49:51.696795] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T02:49:51.890134] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-17T02:49:52.140513] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:49:52.690131] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-17T02:49:53.099070] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T02:49:53.490150] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-17T02:49:53.755853] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T02:49:54.290371] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-17T02:49:54.843149] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T02:49:54.847766] [INFO ] [REMOTE ] CIM: Full fetch complete (54260 records). [2025-09-17T02:49:54.847937] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-17T02:49:55.096237] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-17T02:49:55.233902] [DEBUG] [VALIDATOR ] CIM: All expected trading days are present. [2025-09-17T02:49:55.234010] [DEBUG] [VALIDATOR ] CIM: Primary data validation passed. [2025-09-17T02:49:55.234716] [INFO ] [MAIN ] CIM: Fetched primary data is valid. [2025-09-17T02:49:55.234778] [DEBUG] [LOCAL ] CIM: Saving primary data. [2025-09-17T02:49:55.235990] [DEBUG] [LOCAL ] CIM: Trimmed 54260 records to 37164 (keeping 200 days of data) [2025-09-17T02:49:55.451892] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:49:55.479970] [DEBUG] [LOCAL ] CIM: Primary data saved (37164 records). [2025-09-17T02:49:55.480138] [INFO ] [MAIN ] CIM: Full history saved. [2025-09-17T02:49:55.480271] [INFO ] [MAIN ] Update Progress: 454/2369 symbols completed. CIM took 36.3s. Estimated remaining: 4h 37m 36s. Rate: 6.9 symbols/min [2025-09-17T02:49:55.657408] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:49:55.677429] [DEBUG] [LOCAL ] CION: Loaded 20480 existing records from primary storage. [2025-09-17T02:49:55.677633] [INFO ] [MAIN ] CION: Loaded 20480 existing records. [2025-09-17T02:49:55.859973] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:49:55.860238] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-17T02:49:55.860321] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-17T02:49:55.860947] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-17T02:49:55.861022] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-17T02:49:55.895260] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-17T02:49:56.218317] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:49:56.235408] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T02:49:56.646109] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T02:49:56.690099] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-11. [2025-09-17T02:49:57.490184] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-17T02:49:57.925109] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T02:49:57.940016] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T02:49:58.290125] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-17T02:49:59.090127] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-17T02:49:59.356721] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-17T02:49:59.659169] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T02:49:59.890136] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-17T02:50:00.410934] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T02:50:00.690130] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-17T02:50:01.490150] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-17T02:50:01.833174] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T02:50:02.290116] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-17T02:50:02.607852] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T02:50:03.090211] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-17T02:50:03.473283] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T02:50:03.730363] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T02:50:03.890167] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-17T02:50:04.490148] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T02:50:04.491540] [INFO ] [REMOTE ] CIMO: Full fetch complete (5418 records). [2025-09-17T02:50:04.491691] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-17T02:50:04.689317] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T02:50:04.689571] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:50:04.689630] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:50:04.689700] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-17T02:50:04.689774] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-17T02:50:04.689826] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-17T02:50:04.690116] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-17T02:50:04.690210] [DEBUG] [LOCAL ] CIMO: Deleted derivative data file. [2025-09-17T02:50:04.691440] [INFO ] [MAIN ] Update Progress: 455/2369 symbols completed. CIMO took 39.0s. Estimated remaining: 4h 37m 29s. Rate: 6.9 symbols/min [2025-09-17T02:50:04.869871] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:04.870107] [DEBUG] [LOCAL ] CIVI: No existing data file found in primary storage. [2025-09-17T02:50:04.870165] [WARN ] [MAIN ] CIVI: No existing data found, performing full refresh instead. [2025-09-17T02:50:04.870283] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-17T02:50:04.870339] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-17T02:50:04.870396] [DEBUG] [LOCAL ] CIVI: No primary data file found to delete. [2025-09-17T02:50:04.870451] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-17T02:50:05.225221] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:05.490147] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-17T02:50:06.137416] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T02:50:06.290134] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-17T02:50:06.536090] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T02:50:07.090119] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-11. [2025-09-17T02:50:07.288325] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T02:50:07.890172] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-17T02:50:08.690165] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-17T02:50:08.750057] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T02:50:09.304266] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T02:50:09.323041] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T02:50:09.490127] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-17T02:50:10.290093] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-17T02:50:10.521489] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T02:50:11.090147] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-17T02:50:11.357764] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T02:50:11.890124] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-17T02:50:12.495899] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T02:50:12.690113] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-17T02:50:13.029908] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T02:50:13.490127] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-17T02:50:14.290174] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-17T02:50:14.519527] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T02:50:14.827095] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T02:50:15.090142] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-17T02:50:15.218754] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T02:50:15.221762] [INFO ] [REMOTE ] CINT: Full fetch complete (25410 records). [2025-09-17T02:50:15.221883] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-17T02:50:15.591018] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-17T02:50:15.591128] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-17T02:50:15.591556] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-17T02:50:15.591610] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-17T02:50:15.592375] [DEBUG] [LOCAL ] CINT: Trimmed 25410 records to 17895 (keeping 200 days of data) [2025-09-17T02:50:15.694856] [DEBUG] [LOCAL ] CINT: Primary data saved (17895 records). [2025-09-17T02:50:15.695027] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-17T02:50:15.695144] [INFO ] [MAIN ] Update Progress: 456/2369 symbols completed. CINT took 34.5s. Estimated remaining: 4h 37m 30s. Rate: 6.9 symbols/min [2025-09-17T02:50:15.866609] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:15.894467] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-17T02:50:15.911705] [DEBUG] [LOCAL ] CL: Loaded 39999 existing records from primary storage. [2025-09-17T02:50:15.911857] [INFO ] [MAIN ] CL: Loaded 39999 existing records. [2025-09-17T02:50:16.088811] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:16.089056] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-17T02:50:16.089114] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-17T02:50:16.090071] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-17T02:50:16.090142] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-17T02:50:16.453670] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:16.473370] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T02:50:16.690168] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-11. [2025-09-17T02:50:17.490169] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-17T02:50:17.616879] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T02:50:18.191583] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T02:50:18.243706] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T02:50:18.290116] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-17T02:50:19.090146] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-17T02:50:19.655806] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T02:50:19.890155] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-17T02:50:20.044076] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T02:50:20.690166] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-17T02:50:21.490173] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-17T02:50:21.799084] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T02:50:22.290157] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-17T02:50:22.569359] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T02:50:22.642047] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T02:50:23.090143] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-17T02:50:23.890169] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-17T02:50:24.078505] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T02:50:24.274723] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T02:50:24.690193] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-17T02:50:25.490100] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-17T02:50:25.729166] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T02:50:25.860844] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T02:50:26.290142] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-17T02:50:27.090116] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-17T02:50:27.121239] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T02:50:27.124443] [INFO ] [REMOTE ] CIO: Full fetch complete (29132 records). [2025-09-17T02:50:27.124536] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-17T02:50:27.523785] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-17T02:50:27.524477] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-17T02:50:27.526060] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T02:50:27.526597] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-17T02:50:27.537346] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-17T02:50:27.538906] [DEBUG] [LOCAL ] CIO: Trimmed 29132 records to 19855 (keeping 200 days of data) [2025-09-17T02:50:27.659077] [DEBUG] [LOCAL ] CIO: Primary data saved (19855 records). [2025-09-17T02:50:27.659243] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-17T02:50:27.659345] [INFO ] [MAIN ] Update Progress: 457/2369 symbols completed. CIO took 40.0s. Estimated remaining: 4h 37m 35s. Rate: 6.9 symbols/min [2025-09-17T02:50:27.831446] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:27.856670] [DEBUG] [LOCAL ] CLB: Loaded 24336 existing records from primary storage. [2025-09-17T02:50:27.856898] [INFO ] [MAIN ] CLB: Loaded 24336 existing records. [2025-09-17T02:50:27.900218] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-17T02:50:28.039832] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:28.040159] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-17T02:50:28.040220] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-17T02:50:28.040901] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-17T02:50:28.040960] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-17T02:50:28.394955] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:28.462073] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T02:50:28.690137] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-17T02:50:29.490170] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-11. [2025-09-17T02:50:29.599130] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T02:50:29.779636] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T02:50:29.783611] [INFO ] [REMOTE ] CION: Full fetch complete (41205 records). [2025-09-17T02:50:29.783743] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-17T02:50:30.181468] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-17T02:50:30.181576] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-17T02:50:30.182102] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-17T02:50:30.182155] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-17T02:50:30.183024] [DEBUG] [LOCAL ] CION: Trimmed 41205 records to 29384 (keeping 200 days of data) [2025-09-17T02:50:30.300179] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-17T02:50:30.368905] [DEBUG] [LOCAL ] CION: Primary data saved (29384 records). [2025-09-17T02:50:30.369063] [INFO ] [MAIN ] CION: Full history saved. [2025-09-17T02:50:30.369157] [INFO ] [MAIN ] Update Progress: 458/2369 symbols completed. CION took 34.9s. Estimated remaining: 4h 37m 1s. Rate: 6.9 symbols/min [2025-09-17T02:50:30.539601] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:30.549117] [DEBUG] [LOCAL ] CLCO: Loaded 7998 existing records from primary storage. [2025-09-17T02:50:30.549299] [INFO ] [MAIN ] CLCO: Loaded 7998 existing records. [2025-09-17T02:50:30.738062] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:30.738471] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-17T02:50:30.738616] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-17T02:50:30.738966] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-17T02:50:30.739043] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-17T02:50:30.863193] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T02:50:31.100422] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-17T02:50:31.128132] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:31.890135] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-17T02:50:32.187006] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T02:50:32.429945] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T02:50:32.690164] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-17T02:50:33.490136] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-11. [2025-09-17T02:50:33.875664] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T02:50:33.990070] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T02:50:34.290194] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-17T02:50:34.470102] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T02:50:35.090182] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-17T02:50:35.291242] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T02:50:35.890158] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-17T02:50:36.690211] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-17T02:50:36.857275] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T02:50:37.134889] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T02:50:37.490166] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-17T02:50:37.708381] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T02:50:38.290160] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-17T02:50:39.090172] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-17T02:50:39.275110] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T02:50:39.345909] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T02:50:39.890139] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-17T02:50:40.628251] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T02:50:40.690158] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-17T02:50:41.490155] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-17T02:50:41.543911] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T02:50:41.896709] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T02:50:42.290153] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-17T02:50:43.090118] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-17T02:50:43.314854] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T02:50:43.388549] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T02:50:43.890121] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-17T02:50:44.511378] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T02:50:44.518426] [INFO ] [REMOTE ] CL: Full fetch complete (77454 records). [2025-09-17T02:50:44.518599] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-17T02:50:44.698738] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-17T02:50:44.930432] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-17T02:50:44.930542] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-17T02:50:44.931352] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-17T02:50:44.931411] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-17T02:50:44.932927] [DEBUG] [LOCAL ] CL: Trimmed 77454 records to 53644 (keeping 200 days of data) [2025-09-17T02:50:45.284059] [DEBUG] [LOCAL ] CL: Primary data saved (53644 records). [2025-09-17T02:50:45.284224] [INFO ] [MAIN ] CL: Full history saved. [2025-09-17T02:50:45.284325] [INFO ] [MAIN ] Update Progress: 459/2369 symbols completed. CL took 29.6s. Estimated remaining: 4h 37m 19s. Rate: 6.9 symbols/min [2025-09-17T02:50:45.470603] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:45.488591] [DEBUG] [LOCAL ] CLDT: Loaded 17684 existing records from primary storage. [2025-09-17T02:50:45.488802] [INFO ] [MAIN ] CLDT: Loaded 17684 existing records. [2025-09-17T02:50:45.521710] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-17T02:50:45.682276] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:45.682723] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-17T02:50:45.682861] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-17T02:50:45.683579] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-17T02:50:45.683678] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-17T02:50:46.094822] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:46.097772] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T02:50:46.123106] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T02:50:46.290113] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-11. [2025-09-17T02:50:46.535220] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T02:50:47.090114] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-17T02:50:47.533304] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T02:50:47.890124] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-17T02:50:48.690111] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-17T02:50:49.027779] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T02:50:49.342870] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T02:50:49.468839] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T02:50:49.490099] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-17T02:50:50.290160] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-17T02:50:50.568376] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T02:50:51.090168] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-17T02:50:51.880065] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T02:50:51.886962] [INFO ] [REMOTE ] CIVI: Full fetch complete (75131 records). [2025-09-17T02:50:51.887142] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-17T02:50:51.899083] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-17T02:50:52.291374] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-17T02:50:52.291484] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-17T02:50:52.292316] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-17T02:50:52.292377] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-17T02:50:52.293898] [DEBUG] [LOCAL ] CIVI: Trimmed 75131 records to 52586 (keeping 200 days of data) [2025-09-17T02:50:52.550401] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T02:50:52.660547] [DEBUG] [LOCAL ] CIVI: Primary data saved (52586 records). [2025-09-17T02:50:52.660732] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-17T02:50:52.660815] [INFO ] [MAIN ] Update Progress: 460/2369 symbols completed. CIVI took 48.0s. Estimated remaining: 4h 37m 4s. Rate: 6.9 symbols/min [2025-09-17T02:50:52.695224] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-17T02:50:52.841023] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:52.882146] [DEBUG] [LOCAL ] CLF: Loaded 40092 existing records from primary storage. [2025-09-17T02:50:52.882418] [INFO ] [MAIN ] CLF: Loaded 40092 existing records. [2025-09-17T02:50:53.078684] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:53.079794] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T02:50:53.085522] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-17T02:50:53.086211] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-17T02:50:53.087143] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-17T02:50:53.087208] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-17T02:50:53.450116] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:53.490156] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-17T02:50:53.775973] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T02:50:54.290128] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-17T02:50:54.839243] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T02:50:55.090150] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-11. [2025-09-17T02:50:55.508620] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T02:50:55.513430] [INFO ] [REMOTE ] CLB: Full fetch complete (45920 records). [2025-09-17T02:50:55.513562] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-17T02:50:55.895741] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-17T02:50:55.912740] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-17T02:50:55.912855] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-17T02:50:55.913481] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-17T02:50:55.913670] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-17T02:50:55.914765] [DEBUG] [LOCAL ] CLB: Trimmed 45920 records to 33316 (keeping 200 days of data) [2025-09-17T02:50:56.121023] [DEBUG] [LOCAL ] CLB: Primary data saved (33316 records). [2025-09-17T02:50:56.121193] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-17T02:50:56.121298] [INFO ] [MAIN ] Update Progress: 461/2369 symbols completed. CLB took 28.5s. Estimated remaining: 4h 36m 34s. Rate: 6.9 symbols/min [2025-09-17T02:50:56.294493] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:50:56.314677] [DEBUG] [LOCAL ] CLH: Loaded 19781 existing records from primary storage. [2025-09-17T02:50:56.314864] [INFO ] [MAIN ] CLH: Loaded 19781 existing records. [2025-09-17T02:50:56.491129] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:50:56.491391] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-17T02:50:56.491443] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-17T02:50:56.492050] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-17T02:50:56.492114] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-17T02:50:56.704789] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-17T02:50:56.855034] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:50:56.865978] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T02:50:57.097870] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-17T02:50:57.490147] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-17T02:50:58.140367] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T02:50:58.290156] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-11. [2025-09-17T02:50:58.421388] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T02:50:59.090132] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-17T02:50:59.619365] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T02:50:59.890144] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-17T02:51:00.690137] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-17T02:51:01.143871] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T02:51:01.433445] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-17T02:51:01.490149] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-17T02:51:01.557900] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T02:51:02.290192] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-17T02:51:03.090131] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-17T02:51:03.356328] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T02:51:03.890143] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-17T02:51:04.690129] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-17T02:51:04.711151] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T02:51:04.848554] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-17T02:51:05.490128] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-17T02:51:05.640150] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T02:51:05.734167] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-17T02:51:06.290144] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-17T02:51:06.638427] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T02:51:07.090121] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-17T02:51:07.118724] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T02:51:07.120276] [INFO ] [REMOTE ] CLCO: Full fetch complete (24043 records). [2025-09-17T02:51:07.120371] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-17T02:51:07.506606] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-17T02:51:07.506723] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-17T02:51:07.507135] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-17T02:51:07.507212] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-17T02:51:07.507875] [DEBUG] [LOCAL ] CLCO: Trimmed 24043 records to 13763 (keeping 200 days of data) [2025-09-17T02:51:07.583130] [DEBUG] [LOCAL ] CLCO: Primary data saved (13763 records). [2025-09-17T02:51:07.583304] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-17T02:51:07.583426] [INFO ] [MAIN ] Update Progress: 462/2369 symbols completed. CLCO took 37.2s. Estimated remaining: 4h 36m 37s. Rate: 6.9 symbols/min [2025-09-17T02:51:07.758289] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:07.758737] [DEBUG] [LOCAL ] CLPR: No existing data file found in primary storage. [2025-09-17T02:51:07.758790] [WARN ] [MAIN ] CLPR: No existing data found, performing full refresh instead. [2025-09-17T02:51:07.758907] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-17T02:51:07.758994] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-17T02:51:07.759100] [DEBUG] [LOCAL ] CLPR: No primary data file found to delete. [2025-09-17T02:51:07.759165] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-17T02:51:07.900194] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-17T02:51:08.117935] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:08.159485] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T02:51:08.690138] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-17T02:51:08.981461] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T02:51:09.490126] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-17T02:51:10.290127] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-11. [2025-09-17T02:51:10.812377] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-17T02:51:10.929017] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T02:51:11.090124] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-17T02:51:11.101934] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T02:51:11.890136] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-17T02:51:12.598581] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T02:51:12.617961] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T02:51:12.690127] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-17T02:51:13.490123] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-17T02:51:13.865680] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:51:14.290162] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-17T02:51:14.348270] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T02:51:15.090170] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-17T02:51:15.757847] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:51:15.890139] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-17T02:51:16.690249] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-17T02:51:17.490231] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-17T02:51:17.751373] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.66 seconds). [2025-09-17T02:51:17.763971] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T02:51:17.768191] [INFO ] [REMOTE ] CLDT: Full fetch complete (36976 records). [2025-09-17T02:51:17.768332] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-17T02:51:18.118816] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T02:51:18.185516] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-17T02:51:18.185772] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-17T02:51:18.186306] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-17T02:51:18.186375] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-17T02:51:18.205315] [DEBUG] [LOCAL ] CLDT: Trimmed 36976 records to 26196 (keeping 200 days of data) [2025-09-17T02:51:18.206922] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T02:51:18.299057] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-17T02:51:18.367196] [DEBUG] [LOCAL ] CLDT: Primary data saved (26196 records). [2025-09-17T02:51:18.367351] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-17T02:51:18.367446] [INFO ] [MAIN ] Update Progress: 463/2369 symbols completed. CLDT took 33.1s. Estimated remaining: 4h 36m 36s. Rate: 6.9 symbols/min [2025-09-17T02:51:18.535454] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:18.575185] [DEBUG] [LOCAL ] CLS: Loaded 40005 existing records from primary storage. [2025-09-17T02:51:18.575354] [INFO ] [MAIN ] CLS: Loaded 40005 existing records. [2025-09-17T02:51:18.754520] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:18.754906] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-17T02:51:18.754967] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-17T02:51:18.755893] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-17T02:51:18.755954] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-17T02:51:19.096344] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-17T02:51:19.114580] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:19.561987] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T02:51:19.890126] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-17T02:51:20.070458] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T02:51:20.690144] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-11. [2025-09-17T02:51:20.700819] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T02:51:20.704572] [INFO ] [REMOTE ] CLH: Full fetch complete (41647 records). [2025-09-17T02:51:20.704731] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-17T02:51:21.096330] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-17T02:51:21.096434] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-17T02:51:21.096993] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-17T02:51:21.097052] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-17T02:51:21.098038] [DEBUG] [LOCAL ] CLH: Trimmed 41647 records to 28607 (keeping 200 days of data) [2025-09-17T02:51:21.273586] [DEBUG] [LOCAL ] CLH: Primary data saved (28607 records). [2025-09-17T02:51:21.274000] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-17T02:51:21.274127] [INFO ] [MAIN ] Update Progress: 464/2369 symbols completed. CLH took 25.2s. Estimated remaining: 4h 36m 4s. Rate: 6.9 symbols/min [2025-09-17T02:51:21.449604] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:21.488738] [DEBUG] [LOCAL ] CLVT: Loaded 38762 existing records from primary storage. [2025-09-17T02:51:21.488921] [INFO ] [MAIN ] CLVT: Loaded 38762 existing records. [2025-09-17T02:51:21.501026] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-17T02:51:21.679414] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:21.679713] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-17T02:51:21.679778] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-17T02:51:21.680857] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-17T02:51:21.680934] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-17T02:51:22.045289] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:22.290116] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-17T02:51:22.527165] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T02:51:22.675484] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T02:51:23.090139] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-17T02:51:23.890148] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-11. [2025-09-17T02:51:24.530870] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-17T02:51:24.690147] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-17T02:51:25.098058] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T02:51:25.490142] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-17T02:51:25.585083] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T02:51:26.289795] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T02:51:26.292236] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-17T02:51:26.863560] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T02:51:27.090173] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-17T02:51:27.890156] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-17T02:51:27.962324] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T02:51:28.690197] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-17T02:51:28.722697] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T02:51:28.894497] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T02:51:29.490169] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-17T02:51:30.290140] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-17T02:51:30.433440] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T02:51:31.090196] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-17T02:51:31.368488] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T02:51:31.890150] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-17T02:51:32.644974] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-17T02:51:32.695299] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-17T02:51:32.710525] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T02:51:33.490161] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-17T02:51:34.197791] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-17T02:51:34.290169] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-17T02:51:34.917287] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T02:51:35.090123] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-17T02:51:35.147287] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-17T02:51:35.165452] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T02:51:35.890125] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-17T02:51:36.690152] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-17T02:51:36.750404] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T02:51:37.490159] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-17T02:51:38.296183] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-17T02:51:38.310629] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-17T02:51:38.433974] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T02:51:39.090149] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-17T02:51:39.184695] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T02:51:39.432619] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T02:51:39.439412] [INFO ] [REMOTE ] CLF: Full fetch complete (77691 records). [2025-09-17T02:51:39.439606] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-17T02:51:39.834853] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-17T02:51:39.834974] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-17T02:51:39.835827] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-17T02:51:39.835904] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-17T02:51:39.837514] [DEBUG] [LOCAL ] CLF: Trimmed 77691 records to 53742 (keeping 200 days of data) [2025-09-17T02:51:39.890224] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-17T02:51:40.161657] [DEBUG] [LOCAL ] CLF: Primary data saved (53742 records). [2025-09-17T02:51:40.161844] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-17T02:51:40.161936] [INFO ] [MAIN ] Update Progress: 465/2369 symbols completed. CLF took 47.5s. Estimated remaining: 4h 36m 37s. Rate: 6.9 symbols/min [2025-09-17T02:51:40.333662] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:40.350256] [DEBUG] [LOCAL ] CLW: Loaded 15781 existing records from primary storage. [2025-09-17T02:51:40.350433] [INFO ] [MAIN ] CLW: Loaded 15781 existing records. [2025-09-17T02:51:40.469315] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T02:51:40.511984] [INFO ] [REMOTE ] CLPR: Full fetch complete (17931 records). [2025-09-17T02:51:40.523711] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-17T02:51:40.541674] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:40.573659] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-17T02:51:40.585024] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-17T02:51:40.622110] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-17T02:51:40.642868] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-17T02:51:40.699483] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-17T02:51:41.231388] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-17T02:51:41.231635] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-17T02:51:41.232119] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-17T02:51:41.232236] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-17T02:51:41.284575] [DEBUG] [LOCAL ] CLPR: Trimmed 17931 records to 11659 (keeping 200 days of data) [2025-09-17T02:51:41.313150] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:41.391446] [DEBUG] [LOCAL ] CLPR: Primary data saved (11659 records). [2025-09-17T02:51:41.391784] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-17T02:51:41.391951] [INFO ] [MAIN ] Update Progress: 466/2369 symbols completed. CLPR took 33.8s. Estimated remaining: 4h 35m 58s. Rate: 6.9 symbols/min [2025-09-17T02:51:41.498767] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-11. [2025-09-17T02:51:41.549335] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-17T02:51:41.628996] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:41.667119] [DEBUG] [LOCAL ] CLX: Loaded 38771 existing records from primary storage. [2025-09-17T02:51:41.667288] [INFO ] [MAIN ] CLX: Loaded 38771 existing records. [2025-09-17T02:51:41.846884] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:41.847180] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-17T02:51:41.847243] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-17T02:51:41.848153] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-17T02:51:41.848227] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-17T02:51:42.215833] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:42.290110] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-17T02:51:42.530148] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T02:51:42.898565] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T02:51:43.090159] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-17T02:51:43.890130] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-17T02:51:44.038096] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:51:44.695272] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-11. [2025-09-17T02:51:44.711730] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T02:51:45.208550] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T02:51:45.490132] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-17T02:51:46.068189] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T02:51:46.290138] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-17T02:51:46.393058] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T02:51:47.090132] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-17T02:51:47.891873] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-17T02:51:47.897353] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T02:51:48.140951] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T02:51:48.690233] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-17T02:51:49.490139] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-17T02:51:49.675070] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T02:51:50.290163] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-17T02:51:50.486127] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T02:51:51.090097] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-17T02:51:51.486482] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T02:51:51.847656] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-17T02:51:51.890098] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-17T02:51:52.690156] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-17T02:51:52.724949] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T02:51:52.731521] [INFO ] [REMOTE ] CLVT: Full fetch complete (75130 records). [2025-09-17T02:51:52.731917] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-17T02:51:53.131229] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-17T02:51:53.131336] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-17T02:51:53.132134] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-17T02:51:53.132193] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-17T02:51:53.133772] [DEBUG] [LOCAL ] CLVT: Trimmed 75130 records to 52056 (keeping 200 days of data) [2025-09-17T02:51:53.434964] [DEBUG] [LOCAL ] CLVT: Primary data saved (52056 records). [2025-09-17T02:51:53.435129] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-17T02:51:53.435233] [INFO ] [MAIN ] Update Progress: 467/2369 symbols completed. CLVT took 32.2s. Estimated remaining: 4h 36m 3s. Rate: 6.9 symbols/min [2025-09-17T02:51:53.499807] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-17T02:51:53.612330] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:53.646942] [DEBUG] [LOCAL ] CM: Loaded 36130 existing records from primary storage. [2025-09-17T02:51:53.647174] [INFO ] [MAIN ] CM: Loaded 36130 existing records. [2025-09-17T02:51:53.824720] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:53.824975] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-17T02:51:53.825036] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-17T02:51:53.825981] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-17T02:51:53.826050] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-17T02:51:54.195102] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:54.211810] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T02:51:54.255330] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-17T02:51:54.290167] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-11. [2025-09-17T02:51:55.090192] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-17T02:51:55.207844] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T02:51:55.898372] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-17T02:51:55.909043] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T02:51:55.965463] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T02:51:56.690153] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-17T02:51:56.984075] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-17T02:51:56.991577] [INFO ] [REMOTE ] CLS: Full fetch complete (77317 records). [2025-09-17T02:51:56.991778] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-17T02:51:57.397823] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-17T02:51:57.398201] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-17T02:51:57.399680] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-17T02:51:57.399855] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-17T02:51:57.402043] [DEBUG] [LOCAL ] CLS: Trimmed 77317 records to 53648 (keeping 200 days of data) [2025-09-17T02:51:57.495757] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-17T02:51:57.498466] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T02:51:57.801740] [DEBUG] [LOCAL ] CLS: Primary data saved (53648 records). [2025-09-17T02:51:57.801998] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-17T02:51:57.802122] [INFO ] [MAIN ] Update Progress: 468/2369 symbols completed. CLS took 39.4s. Estimated remaining: 4h 35m 36s. Rate: 6.9 symbols/min [2025-09-17T02:51:57.975856] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:51:58.018493] [DEBUG] [LOCAL ] CMA: Loaded 37171 existing records from primary storage. [2025-09-17T02:51:58.018786] [INFO ] [MAIN ] CMA: Loaded 37171 existing records. [2025-09-17T02:51:58.202257] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:51:58.202591] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-17T02:51:58.202677] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-17T02:51:58.203581] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-17T02:51:58.203673] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-17T02:51:58.295272] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-17T02:51:58.564520] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:51:59.090111] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-11. [2025-09-17T02:51:59.129281] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T02:51:59.401382] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:51:59.890139] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-17T02:52:00.690115] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-17T02:52:00.770190] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T02:52:01.490172] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-17T02:52:01.537530] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T02:52:01.596433] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T02:52:02.290133] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-17T02:52:03.090175] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-17T02:52:03.148244] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T02:52:03.890116] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-17T02:52:03.954515] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T02:52:04.690137] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-17T02:52:04.877574] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T02:52:05.317629] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:52:05.490173] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-17T02:52:06.290144] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-17T02:52:06.389740] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T02:52:07.090120] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-17T02:52:07.162046] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T02:52:07.424067] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T02:52:07.890121] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-17T02:52:08.690150] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-17T02:52:08.877122] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T02:52:09.490136] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-17T02:52:09.767050] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T02:52:10.111547] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:52:10.290137] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-17T02:52:10.444099] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T02:52:10.447284] [INFO ] [REMOTE ] CLW: Full fetch complete (35159 records). [2025-09-17T02:52:10.447412] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-17T02:52:10.828793] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-17T02:52:10.828898] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-17T02:52:10.829359] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-17T02:52:10.829413] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-17T02:52:10.830253] [DEBUG] [LOCAL ] CLW: Trimmed 35159 records to 22083 (keeping 200 days of data) [2025-09-17T02:52:10.975823] [DEBUG] [LOCAL ] CLW: Primary data saved (22083 records). [2025-09-17T02:52:10.975991] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-17T02:52:10.976107] [INFO ] [MAIN ] Update Progress: 469/2369 symbols completed. CLW took 30.8s. Estimated remaining: 4h 35m 46s. Rate: 6.9 symbols/min [2025-09-17T02:52:11.095203] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-17T02:52:11.155450] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:11.173111] [DEBUG] [LOCAL ] CMBT: Loaded 17313 existing records from primary storage. [2025-09-17T02:52:11.173271] [INFO ] [MAIN ] CMBT: Loaded 17313 existing records. [2025-09-17T02:52:11.347413] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:11.347694] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-17T02:52:11.347755] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-17T02:52:11.348206] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-17T02:52:11.348272] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-17T02:52:11.698442] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:11.890133] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-17T02:52:11.966420] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T02:52:12.385746] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T02:52:12.690144] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-17T02:52:13.490135] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-11. [2025-09-17T02:52:13.731163] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T02:52:14.158740] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T02:52:14.290120] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-17T02:52:14.591780] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T02:52:15.090128] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-17T02:52:15.118904] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T02:52:15.890128] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-17T02:52:16.690126] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-17T02:52:16.912794] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T02:52:16.958402] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T02:52:17.490144] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-17T02:52:18.290136] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-17T02:52:18.622962] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:52:18.834471] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T02:52:19.090182] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-17T02:52:19.534816] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T02:52:19.890184] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-17T02:52:20.324508] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:52:20.330821] [INFO ] [REMOTE ] CLX: Full fetch complete (72493 records). [2025-09-17T02:52:20.330952] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-17T02:52:20.690680] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-17T02:52:20.734419] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-17T02:52:20.734498] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-17T02:52:20.735353] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-17T02:52:20.735493] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-17T02:52:20.737043] [DEBUG] [LOCAL ] CLX: Trimmed 72493 records to 51381 (keeping 200 days of data) [2025-09-17T02:52:21.060182] [DEBUG] [LOCAL ] CLX: Primary data saved (51381 records). [2025-09-17T02:52:21.060372] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-17T02:52:21.060490] [INFO ] [MAIN ] Update Progress: 470/2369 symbols completed. CLX took 39.7s. Estimated remaining: 4h 35m 42s. Rate: 6.9 symbols/min [2025-09-17T02:52:21.237273] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:21.267807] [DEBUG] [LOCAL ] CMC: Loaded 33219 existing records from primary storage. [2025-09-17T02:52:21.267977] [INFO ] [MAIN ] CMC: Loaded 33219 existing records. [2025-09-17T02:52:21.446368] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:21.446616] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-17T02:52:21.446694] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-17T02:52:21.447334] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-17T02:52:21.447394] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-17T02:52:21.493894] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-17T02:52:21.823392] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:21.833448] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T02:52:21.867313] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T02:52:22.290150] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-17T02:52:23.090174] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-17T02:52:23.243818] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:52:23.384369] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T02:52:23.890199] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-17T02:52:24.519276] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T02:52:24.690178] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-17T02:52:25.490135] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-11. [2025-09-17T02:52:25.782852] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T02:52:25.805513] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T02:52:26.290148] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-17T02:52:26.796622] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T02:52:27.090172] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-17T02:52:27.890099] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-17T02:52:27.944447] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:52:28.294546] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T02:52:28.690111] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-17T02:52:28.985021] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T02:52:29.490181] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-17T02:52:29.911037] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T02:52:29.917067] [INFO ] [REMOTE ] CMA: Full fetch complete (73247 records). [2025-09-17T02:52:29.917210] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-17T02:52:30.297309] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-17T02:52:30.321860] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-17T02:52:30.323018] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-17T02:52:30.324229] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-17T02:52:30.324432] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-17T02:52:30.326156] [DEBUG] [LOCAL ] CMA: Trimmed 73247 records to 50291 (keeping 200 days of data) [2025-09-17T02:52:30.644304] [DEBUG] [LOCAL ] CMA: Primary data saved (50291 records). [2025-09-17T02:52:30.644480] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-17T02:52:30.644603] [INFO ] [MAIN ] Update Progress: 471/2369 symbols completed. CMA took 32.8s. Estimated remaining: 4h 35m 37s. Rate: 6.9 symbols/min [2025-09-17T02:52:30.816510] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:30.822029] [DEBUG] [LOCAL ] CMCM: Loaded 3467 existing records from primary storage. [2025-09-17T02:52:30.822152] [INFO ] [MAIN ] CMCM: Loaded 3467 existing records. [2025-09-17T02:52:31.000322] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:31.000907] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-17T02:52:31.001141] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-17T02:52:31.001572] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-17T02:52:31.001845] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-17T02:52:31.105767] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-17T02:52:31.139093] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:52:31.244314] [INFO ] [REMOTE ] CM: Full fetch complete (69249 records). [2025-09-17T02:52:31.281535] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-17T02:52:31.508512] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:31.791431] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-17T02:52:31.791546] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-17T02:52:31.792335] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-17T02:52:31.792413] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-17T02:52:31.794685] [DEBUG] [LOCAL ] CM: Trimmed 69249 records to 48670 (keeping 200 days of data) [2025-09-17T02:52:31.891504] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-11. [2025-09-17T02:52:32.059555] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T02:52:32.091216] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T02:52:32.152719] [DEBUG] [LOCAL ] CM: Primary data saved (48670 records). [2025-09-17T02:52:32.152897] [INFO ] [MAIN ] CM: Full history saved. [2025-09-17T02:52:32.153003] [INFO ] [MAIN ] Update Progress: 472/2369 symbols completed. CM took 38.7s. Estimated remaining: 4h 34m 60s. Rate: 6.9 symbols/min [2025-09-17T02:52:32.322464] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:32.322689] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-17T02:52:32.325865] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T02:52:32.327220] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-17T02:52:32.327396] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-17T02:52:32.327468] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-17T02:52:32.327539] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-17T02:52:32.327593] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-17T02:52:32.686429] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:32.690082] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-11. [2025-09-17T02:52:32.899380] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:32.899762] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-11 [2025-09-17T02:52:33.490130] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-17T02:52:33.697413] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:33.697768] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-17T02:52:34.290174] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-17T02:52:35.090154] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-17T02:52:35.306177] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:35.306516] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-17T02:52:35.838453] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T02:52:35.890118] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-17T02:52:36.690140] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-17T02:52:37.490171] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-17T02:52:37.565097] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T02:52:37.691800] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T02:52:37.702789] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:37.703579] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-17T02:52:38.290134] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-17T02:52:39.090131] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-17T02:52:39.820713] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T02:52:39.832439] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T02:52:39.890120] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-17T02:52:40.449665] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T02:52:40.690188] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-17T02:52:41.128502] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T02:52:41.490196] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-17T02:52:42.109845] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T02:52:42.290192] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-17T02:52:42.517296] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:42.517627] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-17T02:52:43.090193] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-17T02:52:43.890196] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-17T02:52:44.690208] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-17T02:52:44.807144] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T02:52:44.813005] [INFO ] [REMOTE ] CMBT: Full fetch complete (27961 records). [2025-09-17T02:52:44.813121] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-17T02:52:45.243850] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T02:52:45.258061] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-17T02:52:45.258512] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-17T02:52:45.259223] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-17T02:52:45.259317] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-17T02:52:45.260509] [DEBUG] [LOCAL ] CMBT: Trimmed 27961 records to 20842 (keeping 200 days of data) [2025-09-17T02:52:45.392474] [DEBUG] [LOCAL ] CMBT: Primary data saved (20842 records). [2025-09-17T02:52:45.392629] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-17T02:52:45.392748] [INFO ] [MAIN ] Update Progress: 473/2369 symbols completed. CMBT took 34.4s. Estimated remaining: 4h 35m 9s. Rate: 6.9 symbols/min [2025-09-17T02:52:45.491557] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-17T02:52:45.572881] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:45.608748] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T02:52:45.650720] [DEBUG] [LOCAL ] CMG: Loaded 40077 existing records from primary storage. [2025-09-17T02:52:45.650924] [INFO ] [MAIN ] CMG: Loaded 40077 existing records. [2025-09-17T02:52:45.752800] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:52:45.753174] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-17T02:52:45.831321] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:45.831573] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-17T02:52:45.831692] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-17T02:52:45.832594] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-17T02:52:45.832699] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-17T02:52:46.209064] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:46.290126] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-11. [2025-09-17T02:52:47.090142] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-17T02:52:47.193282] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-17T02:52:47.193635] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-05 [2025-09-17T02:52:47.890110] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-17T02:52:48.389089] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-11 (2.10 seconds). [2025-09-17T02:52:48.690130] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-17T02:52:49.417080] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T02:52:49.490136] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-17T02:52:49.595898] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T02:52:50.277852] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T02:52:50.290091] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-17T02:52:51.090151] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-17T02:52:51.115583] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T02:52:51.890165] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-17T02:52:52.561864] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T02:52:52.690198] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-17T02:52:53.490135] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-17T02:52:53.808803] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T02:52:54.048835] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T02:52:54.172284] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-17T02:52:54.290182] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-17T02:52:55.090135] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-17T02:52:55.899553] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-17T02:52:55.905305] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T02:52:55.922139] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T02:52:55.924737] [INFO ] [REMOTE ] CMDB: Full fetch complete (7785 records). [2025-09-17T02:52:55.924823] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-17T02:52:56.103528] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-17T02:52:56.103817] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:52:56.103872] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:52:56.103918] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-17T02:52:56.103983] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-17T02:52:56.104027] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-17T02:52:56.104132] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-17T02:52:56.104205] [INFO ] [MAIN ] Update Progress: 474/2369 symbols completed. CMDB took 24.0s. Estimated remaining: 4h 35m 8s. Rate: 6.9 symbols/min [2025-09-17T02:52:56.272788] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:56.306364] [DEBUG] [LOCAL ] CMI: Loaded 30499 existing records from primary storage. [2025-09-17T02:52:56.306532] [INFO ] [MAIN ] CMI: Loaded 30499 existing records. [2025-09-17T02:52:56.490898] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:56.491200] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-17T02:52:56.491261] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-17T02:52:56.492024] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-17T02:52:56.492086] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-17T02:52:56.695299] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-17T02:52:56.870854] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:52:57.411567] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T02:52:57.490184] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-17T02:52:58.168021] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-17T02:52:58.290147] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-17T02:52:58.532479] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T02:52:58.538919] [INFO ] [REMOTE ] CMC: Full fetch complete (66547 records). [2025-09-17T02:52:58.539092] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-17T02:52:58.939230] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-17T02:52:58.939349] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-17T02:52:58.940103] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-17T02:52:58.940180] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-17T02:52:58.941581] [DEBUG] [LOCAL ] CMC: Trimmed 66547 records to 45782 (keeping 200 days of data) [2025-09-17T02:52:59.122712] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-17T02:52:59.226996] [DEBUG] [LOCAL ] CMC: Primary data saved (45782 records). [2025-09-17T02:52:59.227175] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-17T02:52:59.227280] [INFO ] [MAIN ] Update Progress: 475/2369 symbols completed. CMC took 38.2s. Estimated remaining: 4h 34m 37s. Rate: 6.9 symbols/min [2025-09-17T02:52:59.398296] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:52:59.428344] [DEBUG] [LOCAL ] CMP: Loaded 27600 existing records from primary storage. [2025-09-17T02:52:59.428537] [INFO ] [MAIN ] CMP: Loaded 27600 existing records. [2025-09-17T02:52:59.614030] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:52:59.614322] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-17T02:52:59.614384] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-17T02:52:59.615097] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-17T02:52:59.615167] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-17T02:52:59.762969] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T02:52:59.898322] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-17T02:52:59.991506] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:00.440044] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-17T02:53:00.575975] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T02:53:00.690124] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-11. [2025-09-17T02:53:01.490151] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-17T02:53:02.295974] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-17T02:53:02.313157] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T02:53:02.329592] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T02:53:02.331625] [INFO ] [REMOTE ] CMCM: Full fetch complete (7065 records). [2025-09-17T02:53:02.331741] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-17T02:53:02.687125] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-17T02:53:02.687226] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-17T02:53:02.687421] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-17T02:53:02.687487] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-17T02:53:02.688081] [DEBUG] [LOCAL ] CMCM: Trimmed 7065 records to 4621 (keeping 200 days of data) [2025-09-17T02:53:02.713493] [DEBUG] [LOCAL ] CMCM: Primary data saved (4621 records). [2025-09-17T02:53:02.713581] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-17T02:53:02.713718] [INFO ] [MAIN ] Update Progress: 476/2369 symbols completed. CMCM took 32.1s. Estimated remaining: 4h 34m 8s. Rate: 6.9 symbols/min [2025-09-17T02:53:02.884713] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:02.912297] [DEBUG] [LOCAL ] CMRE: Loaded 26276 existing records from primary storage. [2025-09-17T02:53:02.912471] [INFO ] [MAIN ] CMRE: Loaded 26276 existing records. [2025-09-17T02:53:03.088947] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:03.089168] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-17T02:53:03.089224] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-17T02:53:03.089874] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-17T02:53:03.089947] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-17T02:53:03.095270] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-11. [2025-09-17T02:53:03.460854] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:03.890132] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-11. [2025-09-17T02:53:04.165813] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T02:53:04.611976] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T02:53:04.684666] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T02:53:04.692143] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-17T02:53:05.490137] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-17T02:53:06.290143] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-17T02:53:07.026829] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T02:53:07.066149] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-17T02:53:07.090090] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-17T02:53:07.847809] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T02:53:07.890136] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-17T02:53:08.660464] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T02:53:08.690091] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-17T02:53:08.950550] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T02:53:09.490124] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-17T02:53:10.094820] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T02:53:10.290108] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-17T02:53:10.333377] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T02:53:11.090126] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-17T02:53:11.890108] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-17T02:53:12.465300] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-17T02:53:12.509459] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T02:53:12.690166] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-17T02:53:13.490164] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-17T02:53:13.653821] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T02:53:13.808917] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T02:53:14.290164] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-17T02:53:15.090118] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-17T02:53:15.302215] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T02:53:15.722125] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T02:53:15.890115] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-17T02:53:16.690121] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-17T02:53:16.923182] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T02:53:17.490161] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-17T02:53:18.056327] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:53:18.297305] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-17T02:53:18.303420] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-17T02:53:18.790812] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T02:53:19.090135] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-17T02:53:19.835598] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T02:53:19.890083] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-17T02:53:20.591989] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T02:53:20.690107] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-17T02:53:21.490188] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-17T02:53:22.298859] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-17T02:53:22.307485] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-17T02:53:22.397139] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T02:53:23.009605] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T02:53:23.090124] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-17T02:53:23.655759] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T02:53:23.890172] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-17T02:53:24.611859] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T02:53:24.690147] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-17T02:53:25.490167] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-17T02:53:25.646548] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T02:53:26.070726] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T02:53:26.290169] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-17T02:53:26.588748] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T02:53:27.090164] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-17T02:53:27.703949] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T02:53:27.709534] [INFO ] [REMOTE ] CMI: Full fetch complete (59486 records). [2025-09-17T02:53:27.709753] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-17T02:53:27.895451] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-17T02:53:28.114353] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-17T02:53:28.114520] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-17T02:53:28.115231] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-17T02:53:28.115417] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-17T02:53:28.138420] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T02:53:28.146703] [DEBUG] [LOCAL ] CMI: Trimmed 59486 records to 41940 (keeping 200 days of data) [2025-09-17T02:53:28.415820] [DEBUG] [LOCAL ] CMI: Primary data saved (41940 records). [2025-09-17T02:53:28.415975] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-17T02:53:28.416074] [INFO ] [MAIN ] Update Progress: 477/2369 symbols completed. CMI took 32.3s. Estimated remaining: 4h 35m 7s. Rate: 6.9 symbols/min [2025-09-17T02:53:28.690190] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-17T02:53:29.401394] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T02:53:29.490148] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-17T02:53:29.854248] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T02:53:29.857998] [INFO ] [REMOTE ] CMP: Full fetch complete (53281 records). [2025-09-17T02:53:29.858116] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-17T02:53:30.236055] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-17T02:53:30.236166] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-17T02:53:30.236798] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-17T02:53:30.236855] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-17T02:53:30.237964] [DEBUG] [LOCAL ] CMP: Trimmed 53281 records to 36718 (keeping 200 days of data) [2025-09-17T02:53:30.296300] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-17T02:53:30.452945] [DEBUG] [LOCAL ] CMP: Primary data saved (36718 records). [2025-09-17T02:53:30.453120] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-17T02:53:30.453214] [INFO ] [MAIN ] Update Progress: 478/2369 symbols completed. CMP took 31.2s. Estimated remaining: 4h 34m 32s. Rate: 6.9 symbols/min [2025-09-17T02:53:30.953557] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T02:53:31.090129] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-17T02:53:32.502816] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T02:53:32.510738] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-17T02:53:32.539564] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-17T02:53:32.546297] [INFO ] [REMOTE ] CMG: Full fetch complete (77722 records). [2025-09-17T02:53:32.546493] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-17T02:53:32.968817] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-17T02:53:32.968992] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-17T02:53:32.970492] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-17T02:53:32.970616] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-17T02:53:32.973564] [DEBUG] [LOCAL ] CMG: Trimmed 77722 records to 53720 (keeping 200 days of data) [2025-09-17T02:53:33.453438] [DEBUG] [LOCAL ] CMG: Primary data saved (53720 records). [2025-09-17T02:53:33.453846] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-17T02:53:33.453988] [INFO ] [MAIN ] Update Progress: 479/2369 symbols completed. CMG took 48.1s. Estimated remaining: 4h 34m 0s. Rate: 6.9 symbols/min [2025-09-17T02:53:33.938474] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T02:53:33.947579] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-17T02:53:35.197765] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T02:53:35.202012] [INFO ] [REMOTE ] CMRE: Full fetch complete (49261 records). [2025-09-17T02:53:35.202135] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-17T02:53:35.607166] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-17T02:53:35.607276] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-17T02:53:35.607887] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-17T02:53:35.607960] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-17T02:53:35.609142] [DEBUG] [LOCAL ] CMRE: Trimmed 49261 records to 35823 (keeping 200 days of data) [2025-09-17T02:53:35.824285] [DEBUG] [LOCAL ] CMRE: Primary data saved (35823 records). [2025-09-17T02:53:35.824473] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-17T02:53:35.824572] [INFO ] [MAIN ] Update Progress: 480/2369 symbols completed. CMRE took 33.1s. Estimated remaining: 4h 33m 27s. Rate: 6.9 symbols/min [2025-09-17T02:53:36.434771] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:36.472323] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:36.491500] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:36.525009] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:36.532783] [DEBUG] [LOCAL ] CMSA: Loaded 2523 existing records from primary storage. [2025-09-17T02:53:36.532972] [INFO ] [MAIN ] CMSA: Loaded 2523 existing records. [2025-09-17T02:53:36.558422] [DEBUG] [LOCAL ] CMSC: Loaded 3464 existing records from primary storage. [2025-09-17T02:53:36.583671] [INFO ] [MAIN ] CMSC: Loaded 3464 existing records. [2025-09-17T02:53:36.558655] [DEBUG] [LOCAL ] CMSD: Loaded 5674 existing records from primary storage. [2025-09-17T02:53:36.612296] [INFO ] [MAIN ] CMSD: Loaded 5674 existing records. [2025-09-17T02:53:36.970842] [DEBUG] [LOCAL ] CMS: Loaded 39283 existing records from primary storage. [2025-09-17T02:53:37.111181] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:37.113900] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:37.119390] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:37.119506] [INFO ] [MAIN ] CMS: Loaded 39283 existing records. [2025-09-17T02:53:37.120156] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-17T02:53:37.125486] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-17T02:53:37.125539] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-17T02:53:37.140554] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-17T02:53:37.125590] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-17T02:53:37.160369] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-17T02:53:37.165560] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-17T02:53:37.165784] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-17T02:53:37.165813] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-17T02:53:37.177052] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-17T02:53:37.196020] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-17T02:53:37.206337] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-17T02:53:37.615187] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:37.686435] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-17T02:53:37.731958] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-17T02:53:37.831659] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-17T02:53:37.931259] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-17T02:53:38.363889] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:38.410368] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-11. [2025-09-17T02:53:38.540892] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:38.596591] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-11. [2025-09-17T02:53:38.679741] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:38.713964] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-11. [2025-09-17T02:53:38.821395] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:38.821766] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-11. [2025-09-17T02:53:39.239659] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T02:53:39.240976] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-17T02:53:39.289113] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T02:53:39.290350] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-17T02:53:39.309134] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T02:53:39.311511] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-17T02:53:39.852041] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T02:53:39.853792] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-17T02:53:39.968778] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T02:53:39.970633] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-17T02:53:40.126769] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T02:53:40.439811] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T02:53:40.478305] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T02:53:40.511931] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T02:53:40.690129] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-17T02:53:41.144405] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T02:53:41.490142] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-17T02:53:41.820262] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T02:53:42.290140] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-17T02:53:42.883164] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T02:53:43.090122] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-17T02:53:43.890134] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-17T02:53:44.466689] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T02:53:44.690135] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-17T02:53:44.937020] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T02:53:45.197487] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T02:53:45.490143] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-17T02:53:45.840471] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T02:53:46.290134] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-17T02:53:46.919078] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T02:53:47.090121] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-17T02:53:47.890161] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-17T02:53:48.690168] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-17T02:53:48.752574] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T02:53:48.889570] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T02:53:49.126174] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T02:53:49.490189] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-17T02:53:50.099433] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T02:53:50.290147] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-17T02:53:51.090119] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-17T02:53:51.890146] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-17T02:53:51.934284] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T02:53:51.959333] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T02:53:52.489939] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T02:53:52.690195] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-17T02:53:53.281632] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T02:53:53.490135] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-17T02:53:54.186171] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T02:53:54.290100] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-17T02:53:54.868609] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T02:53:55.090131] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-17T02:53:55.442748] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T02:53:55.444107] [INFO ] [REMOTE ] CMSC: Full fetch complete (7121 records). [2025-09-17T02:53:55.444211] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-17T02:53:55.819771] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-17T02:53:55.819886] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-17T02:53:55.820127] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-17T02:53:55.820184] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-17T02:53:55.820715] [DEBUG] [LOCAL ] CMSC: Trimmed 7121 records to 5117 (keeping 200 days of data) [2025-09-17T02:53:55.852710] [DEBUG] [LOCAL ] CMSC: Primary data saved (5117 records). [2025-09-17T02:53:55.852855] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-17T02:53:55.852952] [INFO ] [MAIN ] Update Progress: 481/2369 symbols completed. CMSC took 20.0s. Estimated remaining: 4h 34m 3s. Rate: 6.9 symbols/min [2025-09-17T02:53:55.895367] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-17T02:53:56.029971] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:53:56.055943] [DEBUG] [LOCAL ] CMTG: Loaded 26595 existing records from primary storage. [2025-09-17T02:53:56.056137] [INFO ] [MAIN ] CMTG: Loaded 26595 existing records. [2025-09-17T02:53:56.235209] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:53:56.235493] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-17T02:53:56.235557] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-17T02:53:56.236379] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-17T02:53:56.236453] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-17T02:53:56.598494] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:53:56.690139] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-17T02:53:57.490164] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-11. [2025-09-17T02:53:57.520694] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T02:53:57.677202] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:53:58.290176] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-17T02:53:58.424068] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T02:53:59.090201] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-17T02:53:59.648394] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T02:53:59.890175] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-17T02:54:00.073601] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T02:54:00.358637] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T02:54:00.359890] [INFO ] [REMOTE ] CMSA: Full fetch complete (4982 records). [2025-09-17T02:54:00.359993] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-17T02:54:00.692174] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-17T02:54:00.727896] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-17T02:54:00.728019] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-17T02:54:00.728187] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-17T02:54:00.728239] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-17T02:54:00.728605] [DEBUG] [LOCAL ] CMSA: Trimmed 4982 records to 3350 (keeping 200 days of data) [2025-09-17T02:54:00.750296] [DEBUG] [LOCAL ] CMSA: Primary data saved (3350 records). [2025-09-17T02:54:00.750374] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-17T02:54:00.750476] [INFO ] [MAIN ] Update Progress: 482/2369 symbols completed. CMSA took 24.9s. Estimated remaining: 4h 33m 39s. Rate: 6.9 symbols/min [2025-09-17T02:54:00.922185] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:00.928869] [DEBUG] [LOCAL ] CMU: Loaded 4419 existing records from primary storage. [2025-09-17T02:54:00.929014] [INFO ] [MAIN ] CMU: Loaded 4419 existing records. [2025-09-17T02:54:01.102697] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:01.102897] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-17T02:54:01.102951] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-17T02:54:01.103260] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-17T02:54:01.103322] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-17T02:54:01.452705] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:01.490089] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-11. [2025-09-17T02:54:01.587315] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T02:54:02.290192] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-17T02:54:02.566363] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T02:54:03.090152] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-17T02:54:03.890127] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-17T02:54:04.045944] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T02:54:04.690142] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-17T02:54:05.380266] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T02:54:05.490137] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-17T02:54:05.530330] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (3.24 seconds). [2025-09-17T02:54:05.560380] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T02:54:06.290133] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-17T02:54:06.859687] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T02:54:07.090140] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-17T02:54:07.786898] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T02:54:07.890138] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-17T02:54:08.038502] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T02:54:08.564055] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T02:54:08.690158] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-17T02:54:09.490147] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-17T02:54:09.981833] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T02:54:10.290148] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-17T02:54:10.880445] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T02:54:11.090121] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-17T02:54:11.215977] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T02:54:11.890134] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-17T02:54:12.690139] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-17T02:54:12.731765] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T02:54:13.281603] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T02:54:13.474073] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T02:54:13.490125] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-17T02:54:14.290157] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-17T02:54:14.316011] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T02:54:15.090172] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-17T02:54:15.197972] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T02:54:15.890137] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-17T02:54:16.690089] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-17T02:54:17.173274] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-17T02:54:17.179981] [INFO ] [REMOTE ] CMS: Full fetch complete (75863 records). [2025-09-17T02:54:17.180142] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-17T02:54:17.346949] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T02:54:17.495302] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-17T02:54:17.604846] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-17T02:54:17.604969] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-17T02:54:17.605947] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-17T02:54:17.606048] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-17T02:54:17.607766] [DEBUG] [LOCAL ] CMS: Trimmed 75863 records to 52662 (keeping 200 days of data) [2025-09-17T02:54:17.943305] [DEBUG] [LOCAL ] CMS: Primary data saved (52662 records). [2025-09-17T02:54:17.943480] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-17T02:54:17.943614] [INFO ] [MAIN ] Update Progress: 483/2369 symbols completed. CMS took 42.1s. Estimated remaining: 4h 34m 3s. Rate: 6.9 symbols/min [2025-09-17T02:54:18.119693] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:18.143159] [DEBUG] [LOCAL ] CNA: Loaded 24774 existing records from primary storage. [2025-09-17T02:54:18.143323] [INFO ] [MAIN ] CNA: Loaded 24774 existing records. [2025-09-17T02:54:18.248035] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T02:54:18.253676] [INFO ] [REMOTE ] CMSD: Full fetch complete (12642 records). [2025-09-17T02:54:18.274382] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-17T02:54:18.329218] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-17T02:54:18.385333] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:18.454320] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-17T02:54:18.519035] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-17T02:54:18.607587] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T02:54:18.616414] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-17T02:54:18.664079] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-17T02:54:18.872390] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-17T02:54:18.888176] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-17T02:54:18.927025] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-17T02:54:18.948029] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-17T02:54:18.948367] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T02:54:18.990997] [DEBUG] [LOCAL ] CMSD: Trimmed 12642 records to 8150 (keeping 200 days of data) [2025-09-17T02:54:19.098784] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-17T02:54:19.184921] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:19.198578] [DEBUG] [LOCAL ] CMSD: Primary data saved (8150 records). [2025-09-17T02:54:19.198757] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-17T02:54:19.198907] [INFO ] [MAIN ] Update Progress: 484/2369 symbols completed. CMSD took 43.4s. Estimated remaining: 4h 33m 26s. Rate: 6.9 symbols/min [2025-09-17T02:54:19.366739] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:19.409830] [DEBUG] [LOCAL ] CNC: Loaded 40138 existing records from primary storage. [2025-09-17T02:54:19.410029] [INFO ] [MAIN ] CNC: Loaded 40138 existing records. [2025-09-17T02:54:19.586782] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:19.587043] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-17T02:54:19.587111] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-17T02:54:19.588174] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-17T02:54:19.588239] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-17T02:54:19.895251] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-17T02:54:19.947217] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:20.690199] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-11. [2025-09-17T02:54:20.750081] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T02:54:20.775180] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T02:54:21.490157] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-11. [2025-09-17T02:54:22.290097] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-17T02:54:22.456711] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T02:54:22.694797] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T02:54:23.091879] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-17T02:54:23.093693] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T02:54:23.890180] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-17T02:54:24.190880] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T02:54:24.690135] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-17T02:54:25.110105] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T02:54:25.490158] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-17T02:54:26.131794] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T02:54:26.290178] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-17T02:54:26.597227] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T02:54:26.836410] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T02:54:26.839947] [INFO ] [REMOTE ] CMU: Full fetch complete (9589 records). [2025-09-17T02:54:26.840070] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-17T02:54:27.094277] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-17T02:54:27.402510] [DEBUG] [VALIDATOR ] CMU: All expected trading days are present. [2025-09-17T02:54:27.402628] [DEBUG] [VALIDATOR ] CMU: Primary data validation passed. [2025-09-17T02:54:27.402934] [INFO ] [MAIN ] CMU: Fetched primary data is valid. [2025-09-17T02:54:27.403018] [DEBUG] [LOCAL ] CMU: Saving primary data. [2025-09-17T02:54:27.403622] [DEBUG] [LOCAL ] CMU: Trimmed 9589 records to 7307 (keeping 200 days of data) [2025-09-17T02:54:27.451226] [DEBUG] [LOCAL ] CMU: Primary data saved (7307 records). [2025-09-17T02:54:27.451439] [INFO ] [MAIN ] CMU: Full history saved. [2025-09-17T02:54:27.451580] [INFO ] [MAIN ] Update Progress: 485/2369 symbols completed. CMU took 26.7s. Estimated remaining: 4h 33m 15s. Rate: 6.9 symbols/min [2025-09-17T02:54:27.624958] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:27.634678] [DEBUG] [LOCAL ] CNF: Loaded 8738 existing records from primary storage. [2025-09-17T02:54:27.634831] [INFO ] [MAIN ] CNF: Loaded 8738 existing records. [2025-09-17T02:54:27.814399] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:27.814718] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-17T02:54:27.814798] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-17T02:54:27.815186] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-17T02:54:27.815265] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-17T02:54:27.895223] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-17T02:54:28.169464] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:28.690141] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-11. [2025-09-17T02:54:28.912557] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T02:54:29.126119] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T02:54:29.420005] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T02:54:29.490136] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-17T02:54:30.290142] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-17T02:54:30.550788] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T02:54:31.090183] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-17T02:54:31.635976] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T02:54:31.890094] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-17T02:54:32.312187] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T02:54:32.690151] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-17T02:54:33.329938] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T02:54:33.490143] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-17T02:54:33.797301] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T02:54:33.913613] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T02:54:34.290151] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-17T02:54:35.090190] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-17T02:54:35.890119] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-17T02:54:36.176032] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T02:54:36.198634] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T02:54:36.203189] [INFO ] [REMOTE ] CMTG: Full fetch complete (52837 records). [2025-09-17T02:54:36.203324] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-17T02:54:36.584909] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-17T02:54:36.585020] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-17T02:54:36.585713] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-17T02:54:36.585772] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-17T02:54:36.586995] [DEBUG] [LOCAL ] CMTG: Trimmed 52837 records to 37899 (keeping 200 days of data) [2025-09-17T02:54:36.690267] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-17T02:54:36.805784] [DEBUG] [LOCAL ] CMTG: Primary data saved (37899 records). [2025-09-17T02:54:36.805964] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-17T02:54:36.806067] [INFO ] [MAIN ] Update Progress: 486/2369 symbols completed. CMTG took 41.0s. Estimated remaining: 4h 33m 9s. Rate: 6.9 symbols/min [2025-09-17T02:54:36.973756] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:37.012442] [DEBUG] [LOCAL ] CNH: Loaded 39916 existing records from primary storage. [2025-09-17T02:54:37.012612] [INFO ] [MAIN ] CNH: Loaded 39916 existing records. [2025-09-17T02:54:37.191114] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:37.191476] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-17T02:54:37.191547] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-17T02:54:37.198478] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-17T02:54:37.209309] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-17T02:54:37.280568] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T02:54:37.496126] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-17T02:54:37.573170] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:38.290157] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-17T02:54:38.506711] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T02:54:38.561864] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T02:54:38.748532] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T02:54:39.090182] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-11. [2025-09-17T02:54:39.890148] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-17T02:54:40.516692] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T02:54:40.690109] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-17T02:54:41.463778] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T02:54:41.490082] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-17T02:54:42.085592] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T02:54:42.290131] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-17T02:54:43.090119] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-17T02:54:43.115180] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T02:54:43.769915] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T02:54:43.890119] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-17T02:54:44.260613] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T02:54:44.690149] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-17T02:54:44.953921] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T02:54:45.490150] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-17T02:54:46.290137] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-17T02:54:46.322069] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T02:54:46.978733] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T02:54:47.090135] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-17T02:54:47.890116] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-17T02:54:48.188469] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T02:54:48.690188] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-17T02:54:48.865109] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T02:54:49.263213] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-17T02:54:49.275405] [INFO ] [REMOTE ] CNC: Full fetch complete (77508 records). [2025-09-17T02:54:49.275597] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-17T02:54:49.496426] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-17T02:54:49.686058] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-17T02:54:49.686207] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-17T02:54:49.687572] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-17T02:54:49.687727] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-17T02:54:49.689547] [DEBUG] [LOCAL ] CNC: Trimmed 77508 records to 53728 (keeping 200 days of data) [2025-09-17T02:54:50.033392] [DEBUG] [LOCAL ] CNC: Primary data saved (53728 records). [2025-09-17T02:54:50.033633] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-17T02:54:50.033809] [INFO ] [MAIN ] Update Progress: 487/2369 symbols completed. CNC took 30.8s. Estimated remaining: 4h 33m 18s. Rate: 6.9 symbols/min [2025-09-17T02:54:50.244366] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:54:50.288798] [DEBUG] [LOCAL ] CNI: Loaded 38509 existing records from primary storage. [2025-09-17T02:54:50.289284] [INFO ] [MAIN ] CNI: Loaded 38509 existing records. [2025-09-17T02:54:50.310767] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-17T02:54:50.494359] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T02:54:50.523676] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:54:50.524382] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-17T02:54:50.524572] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-17T02:54:50.525607] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-17T02:54:50.525704] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-17T02:54:50.889334] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:54:50.908341] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T02:54:51.090119] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-11. [2025-09-17T02:54:51.149706] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T02:54:51.890171] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-17T02:54:52.690122] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-17T02:54:52.778476] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T02:54:52.952481] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T02:54:53.490125] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-17T02:54:54.290130] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-17T02:54:54.488473] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T02:54:54.748261] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T02:54:55.090119] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-17T02:54:55.890140] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-17T02:54:55.986178] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T02:54:56.690147] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-17T02:54:56.944244] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T02:54:57.490205] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-17T02:54:58.290197] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-17T02:55:01.278869] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (4.59 seconds). [2025-09-17T02:55:01.281706] [INFO ] [REMOTE ] CNF: Full fetch complete (12551 records). [2025-09-17T02:55:01.281807] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-17T02:55:01.659247] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-17T02:55:01.659374] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-17T02:55:01.659809] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-17T02:55:01.659891] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-17T02:55:01.660629] [DEBUG] [LOCAL ] CNF: Trimmed 12551 records to 10664 (keeping 200 days of data) [2025-09-17T02:55:01.724346] [DEBUG] [LOCAL ] CNF: Primary data saved (10664 records). [2025-09-17T02:55:01.724525] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-17T02:55:01.724680] [INFO ] [MAIN ] Update Progress: 488/2369 symbols completed. CNF took 34.3s. Estimated remaining: 4h 33m 21s. Rate: 6.9 symbols/min [2025-09-17T02:55:01.896583] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:01.936844] [DEBUG] [LOCAL ] CNK: Loaded 39385 existing records from primary storage. [2025-09-17T02:55:01.937012] [INFO ] [MAIN ] CNK: Loaded 39385 existing records. [2025-09-17T02:55:02.124504] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (4.63 seconds). [2025-09-17T02:55:02.162669] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:02.163436] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-17T02:55:02.163830] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-17T02:55:02.163885] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-17T02:55:02.165895] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-17T02:55:02.166016] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-17T02:55:02.291860] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (6.40 seconds). [2025-09-17T02:55:02.399505] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-17T02:55:02.564808] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:02.565229] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-11. [2025-09-17T02:55:02.593846] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (4.30 seconds). [2025-09-17T02:55:02.604674] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-17T02:55:03.935330] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T02:55:03.943090] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-17T02:55:03.971876] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T02:55:03.983370] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-17T02:55:04.015919] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:55:04.025822] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-17T02:55:04.283923] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T02:55:04.690126] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-17T02:55:04.997567] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T02:55:05.002522] [INFO ] [REMOTE ] CNA: Full fetch complete (45184 records). [2025-09-17T02:55:05.002668] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-17T02:55:05.380746] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-17T02:55:05.380847] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-17T02:55:05.381397] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-17T02:55:05.381449] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-17T02:55:05.383461] [DEBUG] [LOCAL ] CNA: Trimmed 45184 records to 32891 (keeping 200 days of data) [2025-09-17T02:55:05.615571] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T02:55:05.630448] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-17T02:55:05.667684] [DEBUG] [LOCAL ] CNA: Primary data saved (32891 records). [2025-09-17T02:55:05.671103] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-17T02:55:05.671449] [INFO ] [MAIN ] Update Progress: 489/2369 symbols completed. CNA took 47.7s. Estimated remaining: 4h 32m 54s. Rate: 6.9 symbols/min [2025-09-17T02:55:05.707407] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T02:55:05.867952] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:05.907911] [DEBUG] [LOCAL ] CNM: Loaded 37677 existing records from primary storage. [2025-09-17T02:55:05.908089] [INFO ] [MAIN ] CNM: Loaded 37677 existing records. [2025-09-17T02:55:06.095281] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:06.095568] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-17T02:55:06.095773] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-17T02:55:06.096718] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-17T02:55:06.096788] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-17T02:55:06.232533] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T02:55:06.312554] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-17T02:55:06.499413] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:07.090119] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-11. [2025-09-17T02:55:07.374299] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T02:55:07.898316] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-17T02:55:07.920563] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T02:55:08.499623] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T02:55:08.690190] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-17T02:55:09.127209] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T02:55:09.134220] [INFO ] [REMOTE ] CNH: Full fetch complete (77373 records). [2025-09-17T02:55:09.134361] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-17T02:55:09.490139] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-17T02:55:09.534756] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-17T02:55:09.534876] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-17T02:55:09.535757] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-17T02:55:09.535830] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-17T02:55:09.539371] [DEBUG] [LOCAL ] CNH: Trimmed 77373 records to 53563 (keeping 200 days of data) [2025-09-17T02:55:09.896280] [DEBUG] [LOCAL ] CNH: Primary data saved (53563 records). [2025-09-17T02:55:09.896438] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-17T02:55:09.896544] [INFO ] [MAIN ] Update Progress: 490/2369 symbols completed. CNH took 33.1s. Estimated remaining: 4h 32m 28s. Rate: 6.9 symbols/min [2025-09-17T02:55:10.075731] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:10.098553] [DEBUG] [LOCAL ] CNMD: Loaded 23618 existing records from primary storage. [2025-09-17T02:55:10.098749] [INFO ] [MAIN ] CNMD: Loaded 23618 existing records. [2025-09-17T02:55:10.288601] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:10.289123] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-17T02:55:10.289191] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-17T02:55:10.289934] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-17T02:55:10.289996] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-17T02:55:10.301078] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-17T02:55:10.512062] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T02:55:10.712007] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:11.090147] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-17T02:55:11.271227] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T02:55:11.890137] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-17T02:55:12.144054] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T02:55:12.463069] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:55:12.690149] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-17T02:55:13.490127] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-11. [2025-09-17T02:55:13.667281] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T02:55:14.290171] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-17T02:55:14.395263] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T02:55:14.595977] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T02:55:15.090124] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-17T02:55:15.857863] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T02:55:15.890077] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-17T02:55:16.690123] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-17T02:55:17.013599] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T02:55:17.453386] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T02:55:17.490118] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-17T02:55:18.290123] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-17T02:55:18.338307] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T02:55:18.734704] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T02:55:19.090202] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-17T02:55:19.731512] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T02:55:19.890123] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-17T02:55:20.649242] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T02:55:20.690093] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-17T02:55:21.490193] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-17T02:55:21.761772] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T02:55:22.290135] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-17T02:55:22.406229] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T02:55:23.090171] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-17T02:55:23.294413] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T02:55:23.424721] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T02:55:23.890193] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-17T02:55:24.690122] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-17T02:55:24.835567] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T02:55:25.490123] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-17T02:55:25.691840] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T02:55:26.290250] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-17T02:55:26.370978] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T02:55:26.377360] [INFO ] [REMOTE ] CNI: Full fetch complete (74545 records). [2025-09-17T02:55:26.377507] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-17T02:55:26.762066] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-17T02:55:26.762171] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-17T02:55:26.763007] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-17T02:55:26.763086] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-17T02:55:26.764526] [DEBUG] [LOCAL ] CNI: Trimmed 74545 records to 51669 (keeping 200 days of data) [2025-09-17T02:55:27.103928] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-17T02:55:27.130159] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T02:55:27.138454] [INFO ] [REMOTE ] CNK: Full fetch complete (75436 records). [2025-09-17T02:55:27.139348] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-17T02:55:27.330075] [DEBUG] [LOCAL ] CNI: Primary data saved (51669 records). [2025-09-17T02:55:27.416329] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-17T02:55:27.448274] [INFO ] [MAIN ] Update Progress: 491/2369 symbols completed. CNI took 37.4s. Estimated remaining: 4h 32m 53s. Rate: 6.9 symbols/min [2025-09-17T02:55:27.684594] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-17T02:55:27.711086] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-17T02:55:27.713411] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:27.714343] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-17T02:55:27.714738] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-17T02:55:27.716541] [DEBUG] [LOCAL ] CNK: Trimmed 75436 records to 52898 (keeping 200 days of data) [2025-09-17T02:55:27.831774] [DEBUG] [LOCAL ] CNNE: Loaded 26562 existing records from primary storage. [2025-09-17T02:55:27.832869] [INFO ] [MAIN ] CNNE: Loaded 26562 existing records. [2025-09-17T02:55:28.026376] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:28.027839] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-17T02:55:28.028238] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-17T02:55:28.029506] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-17T02:55:28.029582] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-17T02:55:28.298200] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T02:55:28.360244] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-17T02:55:28.441889] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:28.466264] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T02:55:28.676330] [DEBUG] [LOCAL ] CNK: Primary data saved (52898 records). [2025-09-17T02:55:28.676500] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-17T02:55:28.676599] [INFO ] [MAIN ] Update Progress: 492/2369 symbols completed. CNK took 27.0s. Estimated remaining: 4h 32m 15s. Rate: 6.9 symbols/min [2025-09-17T02:55:28.697198] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-11. [2025-09-17T02:55:28.849732] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:28.878265] [DEBUG] [LOCAL ] CNO: Loaded 29999 existing records from primary storage. [2025-09-17T02:55:28.878440] [INFO ] [MAIN ] CNO: Loaded 29999 existing records. [2025-09-17T02:55:29.055090] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:29.055350] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-17T02:55:29.055411] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-17T02:55:29.056242] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-17T02:55:29.056306] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-17T02:55:29.408188] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:29.490086] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-11. [2025-09-17T02:55:29.897857] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T02:55:30.095156] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:55:30.290151] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-17T02:55:30.644509] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T02:55:31.090236] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-17T02:55:31.255154] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T02:55:31.890214] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-17T02:55:32.690190] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-17T02:55:32.816709] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T02:55:33.344297] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T02:55:33.490151] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-17T02:55:34.290139] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-17T02:55:34.323181] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T02:55:34.609549] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T02:55:35.090137] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-17T02:55:35.900907] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-17T02:55:35.904205] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T02:55:36.504003] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:55:36.650082] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T02:55:36.690121] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-17T02:55:37.490186] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-17T02:55:37.853898] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:55:38.290171] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-17T02:55:39.034170] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T02:55:39.040536] [INFO ] [REMOTE ] CNM: Full fetch complete (73451 records). [2025-09-17T02:55:39.040715] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-17T02:55:39.099398] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-17T02:55:39.435066] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-17T02:55:39.435170] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-17T02:55:39.435991] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-17T02:55:39.436050] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-17T02:55:39.437485] [DEBUG] [LOCAL ] CNM: Trimmed 73451 records to 50935 (keeping 200 days of data) [2025-09-17T02:55:39.664364] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T02:55:39.776655] [DEBUG] [LOCAL ] CNM: Primary data saved (50935 records). [2025-09-17T02:55:39.776821] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-17T02:55:39.776919] [INFO ] [MAIN ] Update Progress: 493/2369 symbols completed. CNM took 34.1s. Estimated remaining: 4h 32m 16s. Rate: 6.9 symbols/min [2025-09-17T02:55:39.895316] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-17T02:55:39.949523] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:39.985712] [DEBUG] [LOCAL ] CNP: Loaded 39844 existing records from primary storage. [2025-09-17T02:55:39.985887] [INFO ] [MAIN ] CNP: Loaded 39844 existing records. [2025-09-17T02:55:40.166945] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:40.167266] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-17T02:55:40.167343] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-17T02:55:40.168400] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-17T02:55:40.168481] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-17T02:55:40.530349] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:40.690087] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-11. [2025-09-17T02:55:40.773473] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T02:55:41.206755] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T02:55:41.490164] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-17T02:55:42.290185] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-17T02:55:42.442526] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T02:55:43.054988] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T02:55:43.090111] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-17T02:55:43.764349] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T02:55:43.890134] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-17T02:55:44.690187] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-17T02:55:44.911309] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T02:55:44.938220] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T02:55:45.490120] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-17T02:55:46.094569] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T02:55:46.290130] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-17T02:55:47.081060] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T02:55:47.090018] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-17T02:55:47.420632] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T02:55:47.890153] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-17T02:55:48.499372] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T02:55:48.690160] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-17T02:55:48.882233] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T02:55:48.886118] [INFO ] [REMOTE ] CNMD: Full fetch complete (46780 records). [2025-09-17T02:55:48.886240] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-17T02:55:49.257814] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-17T02:55:49.257914] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-17T02:55:49.258423] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-17T02:55:49.258476] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-17T02:55:49.259514] [DEBUG] [LOCAL ] CNMD: Trimmed 46780 records to 32711 (keeping 200 days of data) [2025-09-17T02:55:49.457705] [DEBUG] [LOCAL ] CNMD: Primary data saved (32711 records). [2025-09-17T02:55:49.457859] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-17T02:55:49.457952] [INFO ] [MAIN ] Update Progress: 494/2369 symbols completed. CNMD took 39.6s. Estimated remaining: 4h 32m 11s. Rate: 6.9 symbols/min [2025-09-17T02:55:49.495296] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-17T02:55:49.632191] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:49.669092] [DEBUG] [LOCAL ] CNQ: Loaded 39941 existing records from primary storage. [2025-09-17T02:55:49.669405] [INFO ] [MAIN ] CNQ: Loaded 39941 existing records. [2025-09-17T02:55:49.849935] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:49.850248] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-17T02:55:49.850308] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-17T02:55:49.851723] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-17T02:55:49.851798] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-17T02:55:49.988728] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T02:55:50.267304] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:50.290110] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-17T02:55:50.842228] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T02:55:51.090177] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-11. [2025-09-17T02:55:51.890163] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-17T02:55:52.070086] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T02:55:52.690149] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-17T02:55:52.884063] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T02:55:53.209520] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T02:55:53.490175] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-17T02:55:53.794820] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T02:55:54.290145] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-17T02:55:54.976740] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T02:55:55.090133] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-17T02:55:55.839506] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T02:55:55.890100] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-17T02:55:56.690135] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-17T02:55:56.930726] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T02:55:57.490149] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-17T02:55:57.643866] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T02:55:58.067070] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T02:55:58.072313] [INFO ] [REMOTE ] CNO: Full fetch complete (60233 records). [2025-09-17T02:55:58.072453] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-17T02:55:58.295245] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-17T02:55:58.475121] [DEBUG] [VALIDATOR ] CNO: All expected trading days are present. [2025-09-17T02:55:58.475221] [DEBUG] [VALIDATOR ] CNO: Primary data validation passed. [2025-09-17T02:55:58.475933] [INFO ] [MAIN ] CNO: Fetched primary data is valid. [2025-09-17T02:55:58.475993] [DEBUG] [LOCAL ] CNO: Saving primary data. [2025-09-17T02:55:58.477151] [DEBUG] [LOCAL ] CNO: Trimmed 60233 records to 41625 (keeping 200 days of data) [2025-09-17T02:55:58.752633] [DEBUG] [LOCAL ] CNO: Primary data saved (41625 records). [2025-09-17T02:55:58.752810] [INFO ] [MAIN ] CNO: Full history saved. [2025-09-17T02:55:58.752906] [INFO ] [MAIN ] Update Progress: 495/2369 symbols completed. CNO took 30.1s. Estimated remaining: 4h 32m 4s. Rate: 6.9 symbols/min [2025-09-17T02:55:58.936394] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:55:58.962173] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T02:55:58.996503] [DEBUG] [LOCAL ] CNR: Loaded 32395 existing records from primary storage. [2025-09-17T02:55:58.996690] [INFO ] [MAIN ] CNR: Loaded 32395 existing records. [2025-09-17T02:55:59.099622] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-17T02:55:59.181468] [WARN ] [MAIN ] CNR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:55:59.181729] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-17T02:55:59.181795] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-17T02:55:59.182704] [DEBUG] [LOCAL ] CNR: Deleted primary data file. [2025-09-17T02:55:59.182773] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-17T02:55:59.531307] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:55:59.890111] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-17T02:55:59.987630] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T02:56:00.690136] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-17T02:56:01.100582] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T02:56:01.221552] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T02:56:01.226879] [INFO ] [REMOTE ] CNNE: Full fetch complete (48683 records). [2025-09-17T02:56:01.226999] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-17T02:56:01.495276] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-17T02:56:01.616044] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-17T02:56:01.616151] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-17T02:56:01.616767] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-17T02:56:01.616821] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-17T02:56:01.617875] [DEBUG] [LOCAL ] CNNE: Trimmed 48683 records to 36921 (keeping 200 days of data) [2025-09-17T02:56:01.843834] [DEBUG] [LOCAL ] CNNE: Primary data saved (36921 records). [2025-09-17T02:56:01.844006] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-17T02:56:01.844102] [INFO ] [MAIN ] Update Progress: 496/2369 symbols completed. CNNE took 34.4s. Estimated remaining: 4h 31m 34s. Rate: 6.9 symbols/min [2025-09-17T02:56:02.012591] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:02.027953] [DEBUG] [LOCAL ] CNS: Loaded 14689 existing records from primary storage. [2025-09-17T02:56:02.028103] [INFO ] [MAIN ] CNS: Loaded 14689 existing records. [2025-09-17T02:56:02.204687] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:02.205051] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-17T02:56:02.205128] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-17T02:56:02.205624] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-17T02:56:02.205745] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-17T02:56:02.292340] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-11. [2025-09-17T02:56:02.593483] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:56:02.623127] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:02.623483] [WARN ] [REMOTE ] CNR: No data returned for month 2024-11 [2025-09-17T02:56:02.625991] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T02:56:03.090116] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-11. [2025-09-17T02:56:03.147566] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T02:56:03.885207] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T02:56:03.890075] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-17T02:56:04.690145] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-17T02:56:05.498956] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-17T02:56:05.525220] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T02:56:05.698587] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T02:56:06.290129] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-17T02:56:07.090139] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-17T02:56:07.297691] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:56:07.298040] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-17T02:56:07.327446] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T02:56:07.530928] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T02:56:07.890133] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-17T02:56:08.690154] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-17T02:56:09.490146] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-17T02:56:09.779468] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T02:56:09.917472] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T02:56:10.290123] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-17T02:56:10.554549] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T02:56:11.090132] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-17T02:56:11.831612] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T02:56:11.890124] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-17T02:56:12.218535] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T02:56:12.690197] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-17T02:56:13.490169] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-17T02:56:13.582251] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T02:56:14.290119] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-17T02:56:14.606768] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T02:56:14.751432] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T02:56:15.090139] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-17T02:56:15.898828] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-17T02:56:15.900896] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T02:56:15.931105] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T02:56:16.690122] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-17T02:56:17.490126] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-17T02:56:17.746120] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T02:56:17.768070] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T02:56:18.290134] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-17T02:56:19.090118] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-17T02:56:19.198318] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T02:56:19.344824] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T02:56:19.890139] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-17T02:56:20.690186] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-17T02:56:20.844908] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T02:56:21.490143] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-17T02:56:21.798781] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T02:56:21.829353] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T02:56:22.290150] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-17T02:56:23.090141] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-17T02:56:23.321853] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T02:56:23.890105] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-17T02:56:23.942168] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T02:56:24.690129] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-17T02:56:24.880086] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T02:56:25.490155] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-17T02:56:25.538960] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:56:26.202113] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T02:56:26.205059] [INFO ] [REMOTE ] CNS: Full fetch complete (29526 records). [2025-09-17T02:56:26.205150] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-17T02:56:26.295330] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-17T02:56:26.615221] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-17T02:56:26.616706] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T02:56:26.616878] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-17T02:56:26.627032] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-17T02:56:26.627544] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-17T02:56:26.628808] [DEBUG] [LOCAL ] CNS: Trimmed 29526 records to 21168 (keeping 200 days of data) [2025-09-17T02:56:26.758498] [DEBUG] [LOCAL ] CNS: Primary data saved (21168 records). [2025-09-17T02:56:26.758674] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-17T02:56:26.758773] [INFO ] [MAIN ] Update Progress: 497/2369 symbols completed. CNS took 24.9s. Estimated remaining: 4h 32m 27s. Rate: 6.9 symbols/min [2025-09-17T02:56:26.927560] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:26.968426] [DEBUG] [LOCAL ] CNX: Loaded 38164 existing records from primary storage. [2025-09-17T02:56:26.968614] [INFO ] [MAIN ] CNX: Loaded 38164 existing records. [2025-09-17T02:56:27.095278] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-17T02:56:27.149149] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:27.149364] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-17T02:56:27.149429] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-17T02:56:27.150302] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-17T02:56:27.150368] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-17T02:56:27.502498] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:27.898248] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-17T02:56:27.908003] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T02:56:27.914802] [INFO ] [REMOTE ] CNP: Full fetch complete (77189 records). [2025-09-17T02:56:27.914946] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-17T02:56:28.310836] [DEBUG] [VALIDATOR ] CNP: All expected trading days are present. [2025-09-17T02:56:28.310979] [DEBUG] [VALIDATOR ] CNP: Primary data validation passed. [2025-09-17T02:56:28.311838] [INFO ] [MAIN ] CNP: Fetched primary data is valid. [2025-09-17T02:56:28.311922] [DEBUG] [LOCAL ] CNP: Saving primary data. [2025-09-17T02:56:28.313701] [DEBUG] [LOCAL ] CNP: Trimmed 77189 records to 53469 (keeping 200 days of data) [2025-09-17T02:56:28.429392] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T02:56:28.681662] [DEBUG] [LOCAL ] CNP: Primary data saved (53469 records). [2025-09-17T02:56:28.681902] [INFO ] [MAIN ] CNP: Full history saved. [2025-09-17T02:56:28.682042] [INFO ] [MAIN ] Update Progress: 498/2369 symbols completed. CNP took 48.9s. Estimated remaining: 4h 31m 53s. Rate: 6.9 symbols/min [2025-09-17T02:56:28.695581] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-17T02:56:28.856061] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:28.884822] [DEBUG] [LOCAL ] CODI: Loaded 31403 existing records from primary storage. [2025-09-17T02:56:28.885004] [INFO ] [MAIN ] CODI: Loaded 31403 existing records. [2025-09-17T02:56:29.061854] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:29.062118] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-17T02:56:29.062168] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-17T02:56:29.062841] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-17T02:56:29.062900] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-17T02:56:29.419425] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:29.435967] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T02:56:29.442497] [INFO ] [REMOTE ] CNQ: Full fetch complete (77380 records). [2025-09-17T02:56:29.442695] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-17T02:56:29.497000] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-11. [2025-09-17T02:56:29.919735] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-17T02:56:29.919916] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-17T02:56:29.921537] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-17T02:56:29.921678] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-17T02:56:29.923924] [DEBUG] [LOCAL ] CNQ: Trimmed 77380 records to 53584 (keeping 200 days of data) [2025-09-17T02:56:30.311033] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-11. [2025-09-17T02:56:30.339368] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T02:56:30.349573] [INFO ] [REMOTE ] CNR: Full fetch complete (54383 records). [2025-09-17T02:56:30.351790] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-17T02:56:30.663725] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-17T02:56:30.665034] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:56:30.669929] [DEBUG] [LOCAL ] CNQ: Primary data saved (53584 records). [2025-09-17T02:56:30.670245] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-17T02:56:30.670434] [INFO ] [MAIN ] Update Progress: 499/2369 symbols completed. CNQ took 41.2s. Estimated remaining: 4h 31m 19s. Rate: 6.9 symbols/min [2025-09-17T02:56:30.670132] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:56:30.676529] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-17T02:56:30.710588] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-17T02:56:30.764593] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-17T02:56:30.812169] [DEBUG] [LOCAL ] CNR: Deleted derivative data file. [2025-09-17T02:56:30.823024] [INFO ] [MAIN ] Update Progress: 500/2369 symbols completed. CNR took 32.1s. Estimated remaining: 4h 30m 38s. Rate: 6.9 symbols/min [2025-09-17T02:56:31.016545] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:31.102310] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:31.152568] [DEBUG] [LOCAL ] COF: Loaded 39987 existing records from primary storage. [2025-09-17T02:56:31.163438] [INFO ] [MAIN ] COF: Loaded 39987 existing records. [2025-09-17T02:56:31.187794] [DEBUG] [LOCAL ] COHR: Loaded 39783 existing records from primary storage. [2025-09-17T02:56:31.213069] [INFO ] [MAIN ] COHR: Loaded 39783 existing records. [2025-09-17T02:56:31.510422] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:31.530856] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-17T02:56:31.534686] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:31.534561] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-17T02:56:31.535041] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-17T02:56:31.549163] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T02:56:31.549269] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-17T02:56:31.554599] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-17T02:56:31.554908] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-17T02:56:31.555162] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-17T02:56:31.579972] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-17T02:56:31.626226] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-17T02:56:31.671817] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-17T02:56:31.899976] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-17T02:56:32.255826] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:32.340151] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:32.690150] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-11. [2025-09-17T02:56:32.759499] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T02:56:33.385779] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T02:56:33.490142] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-17T02:56:34.290145] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-11. [2025-09-17T02:56:34.552820] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T02:56:35.095245] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-17T02:56:35.121678] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T02:56:35.189701] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T02:56:35.890137] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-17T02:56:36.640044] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T02:56:36.690093] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-17T02:56:36.999865] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T02:56:37.490145] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-17T02:56:38.290152] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-17T02:56:38.380751] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T02:56:39.095230] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-17T02:56:39.121172] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T02:56:39.389532] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T02:56:39.895224] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-17T02:56:39.902944] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T02:56:40.348092] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T02:56:40.690147] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-17T02:56:41.490140] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-17T02:56:42.005456] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T02:56:42.290137] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-17T02:56:43.087991] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T02:56:43.097381] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-17T02:56:43.290909] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T02:56:43.890152] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-17T02:56:44.450105] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T02:56:44.690130] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-17T02:56:45.490171] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-17T02:56:45.661440] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T02:56:46.226872] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T02:56:46.290125] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-17T02:56:47.090132] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-17T02:56:47.155423] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T02:56:47.890135] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-17T02:56:47.993154] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T02:56:48.690164] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-17T02:56:48.757214] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T02:56:49.192856] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T02:56:49.490166] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-17T02:56:49.530845] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T02:56:50.290183] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-17T02:56:51.090127] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-17T02:56:51.129022] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T02:56:51.467002] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T02:56:51.890129] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-17T02:56:52.420039] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T02:56:52.690182] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-17T02:56:52.751995] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T02:56:53.490117] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-17T02:56:54.244323] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T02:56:54.290096] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-17T02:56:54.967632] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T02:56:55.090135] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-17T02:56:55.894560] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-17T02:56:55.902350] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T02:56:56.693984] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T02:56:56.690169] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-17T02:56:57.063090] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T02:56:57.490131] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-17T02:56:57.866566] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-17T02:56:58.000393] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T02:56:58.004902] [INFO ] [REMOTE ] CODI: Full fetch complete (49695 records). [2025-09-17T02:56:58.005042] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-17T02:56:58.295254] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-17T02:56:58.412676] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-17T02:56:58.412782] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-17T02:56:58.413403] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-17T02:56:58.413458] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-17T02:56:58.414557] [DEBUG] [LOCAL ] CODI: Trimmed 49695 records to 39540 (keeping 200 days of data) [2025-09-17T02:56:58.638876] [DEBUG] [LOCAL ] CODI: Primary data saved (39540 records). [2025-09-17T02:56:58.639048] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-17T02:56:58.639144] [INFO ] [MAIN ] Update Progress: 501/2369 symbols completed. CODI took 30.0s. Estimated remaining: 4h 31m 41s. Rate: 6.9 symbols/min [2025-09-17T02:56:58.805098] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:56:58.841847] [DEBUG] [LOCAL ] COLD: Loaded 39001 existing records from primary storage. [2025-09-17T02:56:58.842019] [INFO ] [MAIN ] COLD: Loaded 39001 existing records. [2025-09-17T02:56:59.019990] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:56:59.020286] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-17T02:56:59.020348] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-17T02:56:59.021108] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-17T02:56:59.021166] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-17T02:56:59.095199] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-17T02:56:59.383717] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:56:59.890132] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-17T02:57:00.095366] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T02:57:00.690180] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-17T02:57:01.418843] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-17T02:57:01.490096] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-17T02:57:02.143205] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-17T02:57:02.290128] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-17T02:57:02.882264] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T02:57:03.090129] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-11. [2025-09-17T02:57:03.573096] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-17T02:57:03.579536] [INFO ] [REMOTE ] COHR: Full fetch complete (76932 records). [2025-09-17T02:57:03.579698] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-17T02:57:03.895208] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-17T02:57:03.976155] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-17T02:57:03.976257] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-17T02:57:03.977079] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-17T02:57:03.977163] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-17T02:57:03.978612] [DEBUG] [LOCAL ] COHR: Trimmed 76932 records to 53372 (keeping 200 days of data) [2025-09-17T02:57:04.316603] [DEBUG] [LOCAL ] COHR: Primary data saved (53372 records). [2025-09-17T02:57:04.316799] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-17T02:57:04.316929] [INFO ] [MAIN ] Update Progress: 502/2369 symbols completed. COHR took 33.5s. Estimated remaining: 4h 31m 20s. Rate: 6.9 symbols/min [2025-09-17T02:57:04.490602] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:04.530787] [DEBUG] [LOCAL ] COMP: Loaded 39767 existing records from primary storage. [2025-09-17T02:57:04.530963] [INFO ] [MAIN ] COMP: Loaded 39767 existing records. [2025-09-17T02:57:04.709919] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:04.710194] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-17T02:57:04.710255] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-17T02:57:04.711055] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-17T02:57:04.711116] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-17T02:57:05.069173] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:05.069511] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-11. [2025-09-17T02:57:05.434334] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (3.14 seconds). [2025-09-17T02:57:05.490133] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-17T02:57:05.541242] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-11 (2.45 seconds). [2025-09-17T02:57:05.602791] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T02:57:05.612125] [INFO ] [REMOTE ] CNX: Full fetch complete (74550 records). [2025-09-17T02:57:05.612287] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-17T02:57:06.003230] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-17T02:57:06.003397] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-17T02:57:06.004302] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-17T02:57:06.004386] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-17T02:57:06.007055] [DEBUG] [LOCAL ] CNX: Trimmed 74550 records to 51387 (keeping 200 days of data) [2025-09-17T02:57:06.301450] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-17T02:57:06.325283] [DEBUG] [LOCAL ] CNX: Primary data saved (51387 records). [2025-09-17T02:57:06.325472] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-17T02:57:06.325609] [INFO ] [MAIN ] Update Progress: 503/2369 symbols completed. CNX took 39.6s. Estimated remaining: 4h 30m 47s. Rate: 6.9 symbols/min [2025-09-17T02:57:06.497723] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:06.497934] [DEBUG] [LOCAL ] CON: No existing data file found in primary storage. [2025-09-17T02:57:06.497984] [WARN ] [MAIN ] CON: No existing data found, performing full refresh instead. [2025-09-17T02:57:06.498102] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-17T02:57:06.498153] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-17T02:57:06.498204] [DEBUG] [LOCAL ] CON: No primary data file found to delete. [2025-09-17T02:57:06.498247] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-17T02:57:06.861615] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:06.894961] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T02:57:07.079354] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T02:57:07.087340] [INFO ] [REMOTE ] COF: Full fetch complete (77213 records). [2025-09-17T02:57:07.087509] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-17T02:57:07.100621] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-11. [2025-09-17T02:57:07.487146] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-17T02:57:07.487262] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-17T02:57:07.488287] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-17T02:57:07.488370] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-17T02:57:07.490886] [DEBUG] [LOCAL ] COF: Trimmed 77213 records to 53612 (keeping 200 days of data) [2025-09-17T02:57:07.837828] [DEBUG] [LOCAL ] COF: Primary data saved (53612 records). [2025-09-17T02:57:07.837997] [INFO ] [MAIN ] COF: Full history saved. [2025-09-17T02:57:07.839733] [INFO ] [MAIN ] Update Progress: 504/2369 symbols completed. COF took 37.2s. Estimated remaining: 4h 30m 12s. Rate: 6.9 symbols/min [2025-09-17T02:57:07.895419] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-17T02:57:08.016748] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:08.051994] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T02:57:08.078444] [DEBUG] [LOCAL ] COOK: Loaded 18606 existing records from primary storage. [2025-09-17T02:57:08.078601] [INFO ] [MAIN ] COOK: Loaded 18606 existing records. [2025-09-17T02:57:08.258958] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:08.259216] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-17T02:57:08.259295] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-17T02:57:08.259812] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-17T02:57:08.259919] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-17T02:57:08.634985] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:08.658809] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T02:57:08.690095] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-17T02:57:09.490133] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-11. [2025-09-17T02:57:09.611266] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T02:57:10.220767] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T02:57:10.285142] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T02:57:10.290070] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-17T02:57:11.090146] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-17T02:57:11.410919] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T02:57:11.890145] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-17T02:57:12.690163] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-17T02:57:12.838587] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T02:57:13.123616] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T02:57:13.490149] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-17T02:57:13.974187] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T02:57:14.290201] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-17T02:57:14.862452] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T02:57:15.090175] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-17T02:57:15.890114] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-17T02:57:15.956284] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T02:57:16.011068] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T02:57:16.690202] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-17T02:57:17.428981] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T02:57:17.490088] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-17T02:57:18.290155] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-17T02:57:18.406410] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T02:57:19.090180] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-17T02:57:19.890128] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-17T02:57:20.043937] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-17T02:57:20.654203] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-17T02:57:20.690119] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-17T02:57:20.756731] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T02:57:21.336005] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-17T02:57:21.490119] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-17T02:57:22.290190] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-17T02:57:22.445797] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T02:57:22.564707] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T02:57:23.090207] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-17T02:57:23.869076] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T02:57:23.890093] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-17T02:57:24.690156] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-17T02:57:24.910403] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T02:57:25.405134] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T02:57:25.495249] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-17T02:57:25.504097] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T02:57:26.290197] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-17T02:57:27.090182] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-17T02:57:27.287567] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T02:57:27.578853] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T02:57:27.890151] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-17T02:57:28.690169] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-17T02:57:28.913437] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T02:57:29.490178] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-17T02:57:29.623396] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T02:57:29.687929] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T02:57:30.290145] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-17T02:57:31.090199] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-17T02:57:31.214191] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T02:57:31.240121] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T02:57:31.890164] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-17T02:57:32.452946] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T02:57:32.690123] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-17T02:57:33.141599] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T02:57:33.490159] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-17T02:57:34.290192] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-17T02:57:34.342026] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T02:57:34.350609] [INFO ] [REMOTE ] COLD: Full fetch complete (73794 records). [2025-09-17T02:57:34.350836] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-17T02:57:34.762345] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-17T02:57:34.762459] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-17T02:57:34.763270] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-17T02:57:34.763330] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-17T02:57:34.764867] [DEBUG] [LOCAL ] COLD: Trimmed 73794 records to 51879 (keeping 200 days of data) [2025-09-17T02:57:34.891321] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T02:57:35.104150] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-17T02:57:35.125854] [DEBUG] [LOCAL ] COLD: Primary data saved (51879 records). [2025-09-17T02:57:35.125989] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-17T02:57:35.126091] [INFO ] [MAIN ] Update Progress: 505/2369 symbols completed. COLD took 36.5s. Estimated remaining: 4h 31m 11s. Rate: 6.9 symbols/min [2025-09-17T02:57:35.308517] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:35.354542] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T02:57:35.355320] [DEBUG] [LOCAL ] COP: Loaded 40077 existing records from primary storage. [2025-09-17T02:57:35.358884] [INFO ] [MAIN ] COP: Loaded 40077 existing records. [2025-09-17T02:57:35.403913] [INFO ] [REMOTE ] COOK: Full fetch complete (32706 records). [2025-09-17T02:57:35.436853] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-17T02:57:35.644739] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:35.655810] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-17T02:57:35.671187] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-17T02:57:35.701118] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-17T02:57:35.701236] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-17T02:57:35.901484] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-17T02:57:36.239225] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-17T02:57:36.239382] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-17T02:57:36.250860] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-17T02:57:36.261312] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-17T02:57:36.322456] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:36.323289] [DEBUG] [LOCAL ] COOK: Trimmed 32706 records to 24123 (keeping 200 days of data) [2025-09-17T02:57:36.460737] [DEBUG] [LOCAL ] COOK: Primary data saved (24123 records). [2025-09-17T02:57:36.460911] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-17T02:57:36.461009] [INFO ] [MAIN ] Update Progress: 506/2369 symbols completed. COOK took 28.6s. Estimated remaining: 4h 30m 36s. Rate: 6.9 symbols/min [2025-09-17T02:57:36.630266] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:36.654184] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T02:57:36.696302] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-11. [2025-09-17T02:57:36.699995] [DEBUG] [LOCAL ] COR: Loaded 34601 existing records from primary storage. [2025-09-17T02:57:36.700175] [INFO ] [MAIN ] COR: Loaded 34601 existing records. [2025-09-17T02:57:36.879853] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:36.880129] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-17T02:57:36.880186] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-17T02:57:36.881074] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-17T02:57:36.881133] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-17T02:57:37.232580] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:37.391221] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T02:57:37.490162] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-11. [2025-09-17T02:57:38.290170] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-17T02:57:38.359483] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T02:57:39.090138] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-17T02:57:39.164533] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T02:57:39.890153] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-17T02:57:40.158686] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T02:57:40.690108] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-17T02:57:41.066928] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T02:57:41.340918] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T02:57:41.490147] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-17T02:57:42.293863] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-17T02:57:42.295147] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T02:57:42.303186] [INFO ] [REMOTE ] COMP: Full fetch complete (76867 records). [2025-09-17T02:57:42.303339] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-17T02:57:42.705394] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-17T02:57:42.705516] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-17T02:57:42.706419] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-17T02:57:42.706483] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-17T02:57:42.708073] [DEBUG] [LOCAL ] COMP: Trimmed 76867 records to 53386 (keeping 200 days of data) [2025-09-17T02:57:43.025136] [DEBUG] [LOCAL ] COMP: Primary data saved (53386 records). [2025-09-17T02:57:43.025306] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-17T02:57:43.025420] [INFO ] [MAIN ] Update Progress: 507/2369 symbols completed. COMP took 38.7s. Estimated remaining: 4h 30m 19s. Rate: 6.9 symbols/min [2025-09-17T02:57:43.098742] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-17T02:57:43.196738] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:43.226771] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T02:57:43.267742] [DEBUG] [LOCAL ] COTY: Loaded 39719 existing records from primary storage. [2025-09-17T02:57:43.267914] [INFO ] [MAIN ] COTY: Loaded 39719 existing records. [2025-09-17T02:57:43.451226] [WARN ] [MAIN ] COTY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:43.451474] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-17T02:57:43.451533] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-17T02:57:43.452339] [DEBUG] [LOCAL ] COTY: Deleted primary data file. [2025-09-17T02:57:43.452402] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-17T02:57:43.806764] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:43.890164] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-11. [2025-09-17T02:57:44.096374] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T02:57:44.545550] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T02:57:44.551832] [INFO ] [REMOTE ] CON: Full fetch complete (57393 records). [2025-09-17T02:57:44.551955] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-17T02:57:44.695355] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-17T02:57:44.936254] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-17T02:57:44.936361] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-17T02:57:44.937127] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-17T02:57:44.937185] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-17T02:57:44.938344] [DEBUG] [LOCAL ] CON: Trimmed 57393 records to 38860 (keeping 200 days of data) [2025-09-17T02:57:45.177126] [DEBUG] [LOCAL ] CON: Primary data saved (38860 records). [2025-09-17T02:57:45.177315] [INFO ] [MAIN ] CON: Full history saved. [2025-09-17T02:57:45.177408] [INFO ] [MAIN ] Update Progress: 508/2369 symbols completed. CON took 38.9s. Estimated remaining: 4h 29m 46s. Rate: 6.9 symbols/min [2025-09-17T02:57:45.346913] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:57:45.388565] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T02:57:45.428373] [DEBUG] [LOCAL ] COUR: Loaded 36689 existing records from primary storage. [2025-09-17T02:57:45.428557] [INFO ] [MAIN ] COUR: Loaded 36689 existing records. [2025-09-17T02:57:45.495341] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-17T02:57:45.608544] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:57:45.608833] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-17T02:57:45.608905] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-17T02:57:45.609748] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-17T02:57:45.609811] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-17T02:57:45.959280] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:57:46.290112] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-17T02:57:46.790480] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-17T02:57:46.890039] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T02:57:47.090201] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-17T02:57:47.890174] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-17T02:57:48.187611] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T02:57:48.515849] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T02:57:48.690178] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-17T02:57:49.490143] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-11. [2025-09-17T02:57:49.647306] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T02:57:50.290151] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-17T02:57:50.386304] [DEBUG] [REMOTE ] COTY: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T02:57:50.386687] [WARN ] [REMOTE ] COTY: No data returned for month 2025-02 [2025-09-17T02:57:50.540354] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T02:57:50.989290] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T02:57:51.090097] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-17T02:57:51.890139] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-17T02:57:52.690201] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-17T02:57:52.792875] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T02:57:53.490158] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-17T02:57:53.744110] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T02:57:54.290177] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-17T02:57:54.575569] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T02:57:55.090127] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-17T02:57:55.121404] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T02:57:55.890171] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-17T02:57:56.312446] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T02:57:56.507238] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T02:57:56.690164] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-17T02:57:57.302338] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T02:57:57.490107] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-17T02:57:58.290143] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-17T02:57:58.554014] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T02:57:59.090262] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-17T02:57:59.328270] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T02:57:59.877053] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T02:57:59.890080] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-17T02:58:00.690152] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-17T02:58:01.113105] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T02:58:01.348239] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T02:58:01.490090] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-17T02:58:02.290186] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-17T02:58:02.410001] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T02:58:03.090160] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-17T02:58:03.274074] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T02:58:03.890166] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-17T02:58:04.118098] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T02:58:04.690181] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-17T02:58:05.182864] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-17T02:58:05.490135] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-17T02:58:05.629252] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T02:58:05.915507] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T02:58:06.290141] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-17T02:58:07.090158] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-17T02:58:07.413268] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T02:58:07.890115] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-17T02:58:07.952862] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T02:58:08.690151] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-17T02:58:08.890098] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T02:58:09.464808] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T02:58:09.490116] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-17T02:58:10.243514] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T02:58:10.290091] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-17T02:58:11.090136] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-17T02:58:11.498354] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T02:58:11.817483] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T02:58:11.890103] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-17T02:58:12.610230] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T02:58:12.616151] [INFO ] [REMOTE ] COR: Full fetch complete (68678 records). [2025-09-17T02:58:12.616333] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-17T02:58:12.695193] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-17T02:58:13.015542] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-17T02:58:13.015681] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-17T02:58:13.016442] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-17T02:58:13.016538] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-17T02:58:13.017947] [DEBUG] [LOCAL ] COR: Trimmed 68678 records to 47345 (keeping 200 days of data) [2025-09-17T02:58:13.325048] [DEBUG] [LOCAL ] COR: Primary data saved (47345 records). [2025-09-17T02:58:13.325216] [INFO ] [MAIN ] COR: Full history saved. [2025-09-17T02:58:13.325312] [INFO ] [MAIN ] Update Progress: 509/2369 symbols completed. COR took 36.9s. Estimated remaining: 4h 30m 49s. Rate: 6.9 symbols/min [2025-09-17T02:58:13.499698] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:13.494150] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-17T02:58:13.535256] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T02:58:13.582756] [DEBUG] [LOCAL ] CP: Loaded 39666 existing records from primary storage. [2025-09-17T02:58:13.582941] [INFO ] [MAIN ] CP: Loaded 39666 existing records. [2025-09-17T02:58:13.758212] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:13.758495] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-17T02:58:13.758553] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-17T02:58:13.759350] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-17T02:58:13.759415] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-17T02:58:14.150555] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:14.290142] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-11. [2025-09-17T02:58:14.675176] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-17T02:58:14.681793] [INFO ] [REMOTE ] COP: Full fetch complete (77626 records). [2025-09-17T02:58:14.681966] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-17T02:58:15.096537] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-17T02:58:15.100981] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-17T02:58:15.102064] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-17T02:58:15.103098] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-17T02:58:15.103433] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-17T02:58:15.106058] [DEBUG] [LOCAL ] COP: Trimmed 77626 records to 53727 (keeping 200 days of data) [2025-09-17T02:58:15.431175] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T02:58:15.489750] [INFO ] [REMOTE ] COTY: Full fetch complete (69547 records). [2025-09-17T02:58:15.490023] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-17T02:58:15.984063] [WARN ] [VALIDATOR ] COTY: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T02:58:15.986232] [FATAL] [MAIN ] COTY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:58:15.995279] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-09-17T02:58:15.986833] [WARN ] [MAIN ] COTY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:58:15.995543] [INFO ] [MAIN ] COP: Full history saved. [2025-09-17T02:58:15.995922] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-17T02:58:15.996246] [INFO ] [MAIN ] Update Progress: 510/2369 symbols completed. COP took 40.9s. Estimated remaining: 4h 30m 18s. Rate: 6.9 symbols/min [2025-09-17T02:58:15.996874] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-09-17T02:58:16.018412] [INFO ] [LOCAL ] COTY: Starting deletion of derivative data. [2025-09-17T02:58:16.068802] [DEBUG] [LOCAL ] COTY: Deleted derivative data file. [2025-09-17T02:58:16.138188] [INFO ] [MAIN ] Update Progress: 511/2369 symbols completed. COTY took 33.1s. Estimated remaining: 4h 29m 38s. Rate: 6.9 symbols/min [2025-09-17T02:58:16.200797] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T02:58:16.292573] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-17T02:58:16.367132] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:16.452047] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:16.452246] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-17T02:58:16.452296] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-17T02:58:16.452406] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-17T02:58:16.452459] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-17T02:58:16.452509] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-17T02:58:16.452551] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-17T02:58:16.565988] [DEBUG] [LOCAL ] CPA: Loaded 21298 existing records from primary storage. [2025-09-17T02:58:16.587427] [INFO ] [MAIN ] CPA: Loaded 21298 existing records. [2025-09-17T02:58:17.008101] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:17.017854] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T02:58:17.043093] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-17T02:58:17.042468] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:17.043334] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-17T02:58:17.043857] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-11. [2025-09-17T02:58:17.043973] [INFO ] [REMOTE ] COUR: Full fetch complete (70797 records). [2025-09-17T02:58:17.044148] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-17T02:58:17.045071] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-17T02:58:17.045276] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-17T02:58:17.768312] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:17.787573] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T02:58:17.803039] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-11. [2025-09-17T02:58:17.864454] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-17T02:58:17.864621] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-17T02:58:17.865485] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-17T02:58:17.865550] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-17T02:58:17.867432] [DEBUG] [LOCAL ] COUR: Trimmed 70797 records to 48849 (keeping 200 days of data) [2025-09-17T02:58:18.163941] [DEBUG] [LOCAL ] COUR: Primary data saved (48849 records). [2025-09-17T02:58:18.164119] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-17T02:58:18.164225] [INFO ] [MAIN ] Update Progress: 512/2369 symbols completed. COUR took 33.0s. Estimated remaining: 4h 29m 5s. Rate: 6.9 symbols/min [2025-09-17T02:58:18.315844] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-17T02:58:18.378878] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:18.381486] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (2.09 seconds). [2025-09-17T02:58:18.415942] [DEBUG] [LOCAL ] CPAY: Loaded 22534 existing records from primary storage. [2025-09-17T02:58:18.416136] [INFO ] [MAIN ] CPAY: Loaded 22534 existing records. [2025-09-17T02:58:18.604142] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:18.604392] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-17T02:58:18.604443] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-17T02:58:18.605079] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-17T02:58:18.605143] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-17T02:58:18.976992] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:18.980615] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T02:58:19.000885] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T02:58:19.090122] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-17T02:58:19.379259] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-17T02:58:19.890125] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-17T02:58:20.279376] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-17T02:58:20.690126] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-11. [2025-09-17T02:58:21.490130] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-17T02:58:22.172951] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T02:58:22.290099] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-17T02:58:22.905032] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T02:58:23.090130] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-17T02:58:23.684537] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T02:58:23.890180] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-17T02:58:24.543972] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T02:58:24.690136] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-17T02:58:25.366387] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T02:58:25.490125] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-17T02:58:25.568029] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T02:58:26.290137] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-17T02:58:26.650889] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T02:58:27.090124] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-17T02:58:27.509189] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T02:58:27.702416] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T02:58:27.890116] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-17T02:58:28.690160] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-17T02:58:28.999330] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-17T02:58:29.490137] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-17T02:58:29.846911] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T02:58:30.290184] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-17T02:58:30.867631] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T02:58:30.885042] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T02:58:31.090130] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-17T02:58:31.890140] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-17T02:58:32.164156] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T02:58:32.690135] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-17T02:58:33.490151] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-17T02:58:33.735133] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T02:58:34.119344] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T02:58:34.290156] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-17T02:58:34.452039] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T02:58:35.090119] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-17T02:58:35.890137] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-17T02:58:36.178421] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T02:58:36.272073] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T02:58:36.690245] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-17T02:58:37.293199] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T02:58:37.310575] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T02:58:37.490103] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-17T02:58:37.789601] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.30 seconds). [2025-09-17T02:58:38.290137] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-17T02:58:38.654169] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-17T02:58:39.090171] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-17T02:58:39.890130] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-17T02:58:40.260822] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T02:58:40.261636] [INFO ] [REMOTE ] CPAC: Full fetch complete (1889 records). [2025-09-17T02:58:40.261740] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-17T02:58:40.439851] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T02:58:40.440042] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T02:58:40.440093] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T02:58:40.440136] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-17T02:58:40.440205] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-17T02:58:40.440253] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-17T02:58:40.440305] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-17T02:58:40.440377] [INFO ] [MAIN ] Update Progress: 513/2369 symbols completed. CPAC took 24.3s. Estimated remaining: 4h 29m 45s. Rate: 6.9 symbols/min [2025-09-17T02:58:40.606549] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:40.618068] [DEBUG] [LOCAL ] CPF: Loaded 10949 existing records from primary storage. [2025-09-17T02:58:40.618210] [INFO ] [MAIN ] CPF: Loaded 10949 existing records. [2025-09-17T02:58:40.696177] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-17T02:58:40.801945] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:40.802319] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-17T02:58:40.802497] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-17T02:58:40.803122] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-17T02:58:40.803230] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-17T02:58:41.200922] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T02:58:41.204756] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:41.490143] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-17T02:58:42.287129] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T02:58:42.294202] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-11. [2025-09-17T02:58:42.841199] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T02:58:43.090099] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-17T02:58:43.344254] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T02:58:43.890131] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-17T02:58:44.315953] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T02:58:44.690150] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-17T02:58:44.984392] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T02:58:45.490182] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-17T02:58:45.627822] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T02:58:46.290195] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-17T02:58:46.838502] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T02:58:47.090111] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-17T02:58:47.890146] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-17T02:58:48.063437] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T02:58:48.503954] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T02:58:48.690140] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-17T02:58:49.196142] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T02:58:49.466611] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T02:58:49.471886] [INFO ] [REMOTE ] CPA: Full fetch complete (42536 records). [2025-09-17T02:58:49.472031] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-17T02:58:49.497952] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-17T02:58:49.872514] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-17T02:58:49.872616] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-17T02:58:49.873174] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-17T02:58:49.873228] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-17T02:58:49.874143] [DEBUG] [LOCAL ] CPA: Trimmed 42536 records to 29179 (keeping 200 days of data) [2025-09-17T02:58:50.056128] [DEBUG] [LOCAL ] CPA: Primary data saved (29179 records). [2025-09-17T02:58:50.056302] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-17T02:58:50.056391] [INFO ] [MAIN ] Update Progress: 514/2369 symbols completed. CPA took 34.1s. Estimated remaining: 4h 29m 40s. Rate: 6.9 symbols/min [2025-09-17T02:58:50.225163] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:50.235942] [DEBUG] [LOCAL ] CPK: Loaded 9239 existing records from primary storage. [2025-09-17T02:58:50.236071] [INFO ] [MAIN ] CPK: Loaded 9239 existing records. [2025-09-17T02:58:50.298757] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-17T02:58:50.419899] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:50.420815] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-17T02:58:50.420878] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-17T02:58:50.421488] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-17T02:58:50.421546] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-17T02:58:50.788807] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:51.090156] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-17T02:58:51.335551] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T02:58:51.492920] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T02:58:51.496633] [INFO ] [REMOTE ] CPAY: Full fetch complete (45250 records). [2025-09-17T02:58:51.496751] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-17T02:58:51.869344] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-17T02:58:51.869444] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-17T02:58:51.870013] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-17T02:58:51.870069] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-17T02:58:51.871155] [DEBUG] [LOCAL ] CPAY: Trimmed 45250 records to 31348 (keeping 200 days of data) [2025-09-17T02:58:51.924764] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-17T02:58:52.063010] [DEBUG] [LOCAL ] CPAY: Primary data saved (31348 records). [2025-09-17T02:58:52.063164] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-17T02:58:52.063255] [INFO ] [MAIN ] Update Progress: 515/2369 symbols completed. CPAY took 33.9s. Estimated remaining: 4h 29m 7s. Rate: 6.9 symbols/min [2025-09-17T02:58:52.238311] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:52.251495] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:58:52.303294] [DEBUG] [LOCAL ] CPNG: Loaded 40038 existing records from primary storage. [2025-09-17T02:58:52.303458] [INFO ] [MAIN ] CPNG: Loaded 40038 existing records. [2025-09-17T02:58:52.479257] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:52.479527] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-17T02:58:52.479578] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-17T02:58:52.480319] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-17T02:58:52.480379] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-17T02:58:52.697203] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-17T02:58:52.838870] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:53.323220] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T02:58:53.329614] [INFO ] [REMOTE ] CP: Full fetch complete (77011 records). [2025-09-17T02:58:53.329797] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-17T02:58:53.496064] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-11. [2025-09-17T02:58:53.721304] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-17T02:58:53.721417] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-17T02:58:53.722530] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-17T02:58:53.722614] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-17T02:58:53.724383] [DEBUG] [LOCAL ] CP: Trimmed 77011 records to 53294 (keeping 200 days of data) [2025-09-17T02:58:53.855108] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T02:58:54.069769] [DEBUG] [LOCAL ] CP: Primary data saved (53294 records). [2025-09-17T02:58:54.069947] [INFO ] [MAIN ] CP: Full history saved. [2025-09-17T02:58:54.070047] [INFO ] [MAIN ] Update Progress: 516/2369 symbols completed. CP took 40.7s. Estimated remaining: 4h 28m 34s. Rate: 6.9 symbols/min [2025-09-17T02:58:54.245483] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:58:54.255821] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T02:58:54.295108] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-17T02:58:54.297135] [DEBUG] [LOCAL ] CPRI: Loaded 39119 existing records from primary storage. [2025-09-17T02:58:54.297323] [INFO ] [MAIN ] CPRI: Loaded 39119 existing records. [2025-09-17T02:58:54.476033] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:58:54.476287] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-17T02:58:54.476350] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-17T02:58:54.477208] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-17T02:58:54.477283] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-17T02:58:54.824823] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:58:55.090101] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-17T02:58:55.423467] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T02:58:55.890133] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-11. [2025-09-17T02:58:55.909275] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T02:58:56.690131] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-17T02:58:57.471494] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T02:58:57.490075] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-17T02:58:57.735331] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T02:58:58.290116] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-11. [2025-09-17T02:58:58.431309] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T02:58:59.090123] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-17T02:58:59.890144] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-17T02:59:00.513875] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T02:59:00.687910] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T02:59:00.692024] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-17T02:59:00.853693] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T02:59:01.490190] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-17T02:59:02.290160] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-17T02:59:02.300678] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T02:59:02.969358] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-17T02:59:02.989335] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T02:59:03.090135] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-17T02:59:03.890134] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-17T02:59:04.063612] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T02:59:04.690144] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-17T02:59:05.490110] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-17T02:59:05.997729] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-17T02:59:06.157247] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T02:59:06.290146] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-17T02:59:06.455329] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T02:59:07.090154] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-17T02:59:07.240298] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T02:59:07.890146] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-17T02:59:08.690177] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-17T02:59:08.730628] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T02:59:08.733236] [INFO ] [REMOTE ] CPF: Full fetch complete (24262 records). [2025-09-17T02:59:08.733358] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-17T02:59:09.135182] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-17T02:59:09.135297] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-17T02:59:09.135742] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-17T02:59:09.135814] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-17T02:59:09.136474] [DEBUG] [LOCAL ] CPF: Trimmed 24262 records to 15552 (keeping 200 days of data) [2025-09-17T02:59:09.232768] [DEBUG] [LOCAL ] CPF: Primary data saved (15552 records). [2025-09-17T02:59:09.233028] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-17T02:59:09.233367] [INFO ] [MAIN ] Update Progress: 517/2369 symbols completed. CPF took 28.8s. Estimated remaining: 4h 28m 49s. Rate: 6.9 symbols/min [2025-09-17T02:59:09.354858] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-17T02:59:09.490174] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-17T02:59:10.290144] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-17T02:59:10.437436] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T02:59:11.090146] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-17T02:59:11.470256] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T02:59:11.700844] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-17T02:59:11.890117] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-17T02:59:12.690136] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-17T02:59:12.906099] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T02:59:13.366856] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T02:59:13.490184] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-17T02:59:14.084200] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-17T02:59:14.151089] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T02:59:14.290172] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-17T02:59:15.090140] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-17T02:59:15.294473] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T02:59:15.890156] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-17T02:59:16.567684] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T02:59:16.690197] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-17T02:59:17.490146] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-17T02:59:17.505838] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T02:59:18.237686] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-17T02:59:18.290093] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-17T02:59:19.090172] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-17T02:59:19.140887] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T02:59:19.885434] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T02:59:19.887959] [INFO ] [REMOTE ] CPK: Full fetch complete (17356 records). [2025-09-17T02:59:19.888411] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-17T02:59:19.922604] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-17T02:59:20.309794] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-17T02:59:20.309935] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-17T02:59:20.310471] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-17T02:59:20.310528] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-17T02:59:20.311313] [DEBUG] [LOCAL ] CPK: Trimmed 17356 records to 13129 (keeping 200 days of data) [2025-09-17T02:59:20.404240] [DEBUG] [LOCAL ] CPK: Primary data saved (13129 records). [2025-09-17T02:59:20.404507] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-17T02:59:20.404674] [INFO ] [MAIN ] Update Progress: 518/2369 symbols completed. CPK took 30.3s. Estimated remaining: 4h 28m 49s. Rate: 6.9 symbols/min [2025-09-17T02:59:20.495030] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-17T02:59:20.690136] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-17T02:59:21.765628] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T02:59:21.777356] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-17T02:59:22.826207] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T02:59:22.837985] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-17T02:59:23.593750] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T02:59:23.612156] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-17T02:59:25.168523] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-17T02:59:25.180006] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-17T02:59:25.597404] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T02:59:25.608800] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-17T02:59:27.194861] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T02:59:27.201444] [INFO ] [REMOTE ] CPRI: Full fetch complete (76043 records). [2025-09-17T02:59:27.201608] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-17T02:59:27.617141] [DEBUG] [VALIDATOR ] CPRI: All expected trading days are present. [2025-09-17T02:59:27.618942] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-17T02:59:27.619231] [DEBUG] [VALIDATOR ] CPRI: Primary data validation passed. [2025-09-17T02:59:27.627149] [INFO ] [MAIN ] CPRI: Fetched primary data is valid. [2025-09-17T02:59:27.627331] [INFO ] [REMOTE ] CPNG: Full fetch complete (77554 records). [2025-09-17T02:59:27.627557] [DEBUG] [LOCAL ] CPRI: Saving primary data. [2025-09-17T02:59:27.627491] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-17T02:59:27.730471] [DEBUG] [LOCAL ] CPRI: Trimmed 76043 records to 52592 (keeping 200 days of data) [2025-09-17T02:59:28.297555] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-17T02:59:28.299239] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-17T02:59:28.303786] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-17T02:59:28.305320] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-17T02:59:28.319604] [DEBUG] [LOCAL ] CPNG: Trimmed 77554 records to 53671 (keeping 200 days of data) [2025-09-17T02:59:28.910302] [DEBUG] [LOCAL ] CPRI: Primary data saved (52592 records). [2025-09-17T02:59:28.913249] [INFO ] [MAIN ] CPRI: Full history saved. [2025-09-17T02:59:28.919621] [INFO ] [MAIN ] Update Progress: 519/2369 symbols completed. CPRI took 34.8s. Estimated remaining: 4h 28m 39s. Rate: 6.9 symbols/min [2025-09-17T02:59:29.008674] [DEBUG] [LOCAL ] CPNG: Primary data saved (53671 records). [2025-09-17T02:59:29.008871] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-17T02:59:29.008973] [INFO ] [MAIN ] Update Progress: 520/2369 symbols completed. CPNG took 36.9s. Estimated remaining: 4h 27m 60s. Rate: 6.9 symbols/min [2025-09-17T02:59:29.641627] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:29.759544] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:29.744624] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:29.783516] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:29.810129] [DEBUG] [LOCAL ] CPS: Loaded 18635 existing records from primary storage. [2025-09-17T02:59:29.815478] [INFO ] [MAIN ] CPS: Loaded 18635 existing records. [2025-09-17T02:59:29.815907] [DEBUG] [LOCAL ] CQP: Loaded 15075 existing records from primary storage. [2025-09-17T02:59:29.838229] [INFO ] [MAIN ] CQP: Loaded 15075 existing records. [2025-09-17T02:59:30.021893] [DEBUG] [LOCAL ] CR: Loaded 17929 existing records from primary storage. [2025-09-17T02:59:30.059404] [DEBUG] [LOCAL ] CPT: Loaded 32824 existing records from primary storage. [2025-09-17T02:59:30.064760] [INFO ] [MAIN ] CR: Loaded 17929 existing records. [2025-09-17T02:59:30.086706] [INFO ] [MAIN ] CPT: Loaded 32824 existing records. [2025-09-17T02:59:30.383135] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:30.388404] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:30.452358] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-17T02:59:30.447084] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-17T02:59:30.505592] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-17T02:59:30.528077] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-17T02:59:30.547027] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-17T02:59:30.561132] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-17T02:59:30.561065] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:30.576301] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-17T02:59:30.601489] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-17T02:59:30.588861] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-17T02:59:30.645779] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-17T02:59:30.645903] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:30.646361] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-17T02:59:30.646426] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-17T02:59:30.647015] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-17T02:59:30.647056] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-17T02:59:30.673305] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-17T02:59:30.777708] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-17T02:59:31.970154] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:31.973608] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:32.003581] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-11. [2025-09-17T02:59:32.040385] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-11. [2025-09-17T02:59:32.124495] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:32.149800] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:32.150468] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-11. [2025-09-17T02:59:32.150189] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-11. [2025-09-17T02:59:33.161816] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T02:59:33.166681] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-17T02:59:33.215194] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T02:59:33.219968] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-17T02:59:33.294236] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T02:59:33.298838] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-17T02:59:33.770285] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T02:59:33.779591] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-17T02:59:33.901359] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T02:59:33.906332] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-17T02:59:34.124810] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T02:59:34.129290] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-17T02:59:34.355835] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T02:59:34.361086] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-17T02:59:34.886270] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T02:59:34.891058] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-17T02:59:35.069855] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T02:59:35.095180] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-17T02:59:35.107663] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T02:59:35.214373] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T02:59:35.890118] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-17T02:59:36.102810] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T02:59:36.255080] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T02:59:36.624744] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T02:59:36.690089] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-17T02:59:37.490133] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-17T02:59:37.625099] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T02:59:38.290139] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-17T02:59:38.577847] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T02:59:39.090132] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-17T02:59:39.758000] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T02:59:39.890169] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-17T02:59:40.359145] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T02:59:40.512065] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T02:59:40.690139] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-17T02:59:41.490193] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-17T02:59:42.111524] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T02:59:42.290162] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-17T02:59:42.659411] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T02:59:43.090143] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-17T02:59:43.890162] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-17T02:59:43.955531] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T02:59:44.121500] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T02:59:44.690111] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-17T02:59:45.069955] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T02:59:45.490132] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-17T02:59:45.825066] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T02:59:46.290154] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-17T02:59:47.069670] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T02:59:47.090090] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-17T02:59:47.695739] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T02:59:47.890133] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-17T02:59:47.964370] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T02:59:48.690164] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-17T02:59:49.131984] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T02:59:49.490158] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-17T02:59:50.290122] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-17T02:59:50.347299] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T02:59:50.393667] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T02:59:51.090159] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-17T02:59:51.398582] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T02:59:51.720503] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T02:59:51.722849] [INFO ] [REMOTE ] CQP: Full fetch complete (31030 records). [2025-09-17T02:59:51.722978] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-17T02:59:51.899518] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-17T02:59:52.100787] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-17T02:59:52.100894] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-17T02:59:52.101373] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-17T02:59:52.101436] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-17T02:59:52.102240] [DEBUG] [LOCAL ] CQP: Trimmed 31030 records to 20155 (keeping 200 days of data) [2025-09-17T02:59:52.229018] [DEBUG] [LOCAL ] CQP: Primary data saved (20155 records). [2025-09-17T02:59:52.229170] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-17T02:59:52.229275] [INFO ] [MAIN ] Update Progress: 521/2369 symbols completed. CQP took 23.2s. Estimated remaining: 4h 28m 43s. Rate: 6.9 symbols/min [2025-09-17T02:59:52.406087] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:52.415200] [DEBUG] [LOCAL ] CRBD: Loaded 6926 existing records from primary storage. [2025-09-17T02:59:52.415317] [INFO ] [MAIN ] CRBD: Loaded 6926 existing records. [2025-09-17T02:59:52.592595] [WARN ] [MAIN ] CRBD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:52.593032] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-17T02:59:52.593106] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-17T02:59:52.593464] [DEBUG] [LOCAL ] CRBD: Deleted primary data file. [2025-09-17T02:59:52.593534] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-17T02:59:52.693750] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-17T02:59:52.948477] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:53.136151] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T02:59:53.490116] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-17T02:59:53.882745] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T02:59:54.296719] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-11. [2025-09-17T02:59:54.301220] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T02:59:54.305679] [INFO ] [REMOTE ] CR: Full fetch complete (34767 records). [2025-09-17T02:59:54.305816] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-17T02:59:54.542809] [DEBUG] [REMOTE ] CRBD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T02:59:54.591940] [WARN ] [REMOTE ] CRBD: No data returned for month 2024-11 [2025-09-17T02:59:54.698447] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-17T02:59:54.698591] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-17T02:59:54.699208] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-17T02:59:54.699312] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-17T02:59:54.701012] [DEBUG] [LOCAL ] CR: Trimmed 34767 records to 24734 (keeping 200 days of data) [2025-09-17T02:59:54.862902] [DEBUG] [LOCAL ] CR: Primary data saved (24734 records). [2025-09-17T02:59:54.863069] [INFO ] [MAIN ] CR: Full history saved. [2025-09-17T02:59:54.863205] [INFO ] [MAIN ] Update Progress: 522/2369 symbols completed. CR took 25.9s. Estimated remaining: 4h 28m 12s. Rate: 6.9 symbols/min [2025-09-17T02:59:55.030683] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T02:59:55.071286] [DEBUG] [LOCAL ] CRBG: Loaded 39103 existing records from primary storage. [2025-09-17T02:59:55.071481] [INFO ] [MAIN ] CRBG: Loaded 39103 existing records. [2025-09-17T02:59:55.100485] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-17T02:59:55.249889] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T02:59:55.250127] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-17T02:59:55.250202] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-17T02:59:55.251126] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-17T02:59:55.251197] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-17T02:59:55.605756] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T02:59:55.890121] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-17T02:59:56.690091] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-17T02:59:57.005290] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T02:59:57.098233] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T02:59:57.457634] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T02:59:57.490083] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-17T02:59:58.035413] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T02:59:58.290125] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-17T02:59:59.090135] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-17T02:59:59.808510] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T02:59:59.873916] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T02:59:59.890074] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-17T03:00:00.690146] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-11. [2025-09-17T03:00:01.495234] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-17T03:00:01.510264] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T03:00:02.290204] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-17T03:00:03.046018] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T03:00:03.049214] [INFO ] [REMOTE ] CPS: Full fetch complete (36031 records). [2025-09-17T03:00:03.049343] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-17T03:00:03.099628] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-17T03:00:03.462786] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-17T03:00:03.463021] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-17T03:00:03.463748] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-17T03:00:03.463829] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-17T03:00:03.464979] [DEBUG] [LOCAL ] CPS: Trimmed 36031 records to 26379 (keeping 200 days of data) [2025-09-17T03:00:03.596021] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-11 (2.91 seconds). [2025-09-17T03:00:03.673218] [DEBUG] [LOCAL ] CPS: Primary data saved (26379 records). [2025-09-17T03:00:03.673382] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-17T03:00:03.673544] [INFO ] [MAIN ] Update Progress: 523/2369 symbols completed. CPS took 34.7s. Estimated remaining: 4h 28m 4s. Rate: 6.9 symbols/min [2025-09-17T03:00:03.889266] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:03.890093] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-17T03:00:03.926832] [DEBUG] [LOCAL ] CRC: Loaded 32855 existing records from primary storage. [2025-09-17T03:00:03.927016] [INFO ] [MAIN ] CRC: Loaded 32855 existing records. [2025-09-17T03:00:04.111024] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:00:04.111310] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-17T03:00:04.111386] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-17T03:00:04.112191] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-17T03:00:04.112279] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-17T03:00:04.411031] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T03:00:04.495638] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:04.690325] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-11. [2025-09-17T03:00:05.490119] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-17T03:00:05.883824] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-17T03:00:06.043728] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T03:00:06.093992] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T03:00:06.134853] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-17T03:00:06.290135] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-17T03:00:07.090162] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-17T03:00:07.890164] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-17T03:00:08.473602] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T03:00:08.690122] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-17T03:00:09.490185] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-17T03:00:09.835512] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (2.75 seconds). [2025-09-17T03:00:10.290177] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-17T03:00:13.151146] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (5.26 seconds). [2025-09-17T03:00:13.161555] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-17T03:00:13.857268] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (3.57 seconds). [2025-09-17T03:00:13.870701] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-17T03:00:13.871423] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (4.38 seconds). [2025-09-17T03:00:13.874933] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-17T03:00:14.090626] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (5.40 seconds). [2025-09-17T03:00:14.097477] [INFO ] [REMOTE ] CPT: Full fetch complete (63255 records). [2025-09-17T03:00:14.097725] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-17T03:00:14.526949] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-17T03:00:14.535975] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-17T03:00:14.536357] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T03:00:14.537722] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-17T03:00:14.540574] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-17T03:00:14.541619] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-17T03:00:14.543614] [DEBUG] [LOCAL ] CPT: Trimmed 63255 records to 44332 (keeping 200 days of data) [2025-09-17T03:00:14.864210] [DEBUG] [LOCAL ] CPT: Primary data saved (44332 records). [2025-09-17T03:00:14.864462] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-17T03:00:14.865565] [INFO ] [MAIN ] Update Progress: 524/2369 symbols completed. CPT took 45.9s. Estimated remaining: 4h 28m 4s. Rate: 6.9 symbols/min [2025-09-17T03:00:14.902190] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T03:00:14.999155] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-17T03:00:15.065996] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:15.074348] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-17T03:00:15.076080] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-17T03:00:15.076385] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-17T03:00:15.075926] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T03:00:15.078080] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-17T03:00:15.080036] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-17T03:00:15.081098] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-17T03:00:15.105527] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-17T03:00:15.417437] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T03:00:15.505420] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:15.734083] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T03:00:15.890159] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-11. [2025-09-17T03:00:16.208838] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:16.209175] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-11 [2025-09-17T03:00:16.690127] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-17T03:00:17.490108] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-17T03:00:17.580634] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-17T03:00:17.726324] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:17.726724] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-17T03:00:18.290127] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-17T03:00:18.736669] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T03:00:18.738224] [INFO ] [REMOTE ] CRBD: Full fetch complete (15225 records). [2025-09-17T03:00:18.738313] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-17T03:00:18.922622] [WARN ] [VALIDATOR ] CRBD: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-17T03:00:18.923070] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:00:18.923256] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:00:18.923563] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-17T03:00:18.923770] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-17T03:00:18.923853] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-09-17T03:00:18.924327] [DEBUG] [LOCAL ] CRBD: Deleted derivative data file. [2025-09-17T03:00:18.924458] [INFO ] [MAIN ] Update Progress: 525/2369 symbols completed. CRBD took 26.7s. Estimated remaining: 4h 27m 39s. Rate: 6.9 symbols/min [2025-09-17T03:00:19.098295] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-17T03:00:19.099998] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:19.132999] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T03:00:19.181421] [DEBUG] [LOCAL ] CRGY: Loaded 38979 existing records from primary storage. [2025-09-17T03:00:19.181615] [INFO ] [MAIN ] CRGY: Loaded 38979 existing records. [2025-09-17T03:00:19.360783] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:00:19.361052] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-17T03:00:19.361183] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-17T03:00:19.362082] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-17T03:00:19.362161] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-17T03:00:19.709297] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:19.890134] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-17T03:00:20.494390] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T03:00:20.690160] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-17T03:00:21.183904] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T03:00:21.490147] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-17T03:00:21.776031] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:21.776382] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-17T03:00:22.298694] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-17T03:00:22.322213] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T03:00:22.549750] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:22.550160] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-17T03:00:23.090152] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-17T03:00:23.890146] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-17T03:00:24.105945] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:24.106270] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-17T03:00:24.690099] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-17T03:00:24.818608] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T03:00:25.490157] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-17T03:00:26.140618] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T03:00:26.290140] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-17T03:00:26.995199] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T03:00:27.090105] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-17T03:00:27.567209] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:00:27.890208] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-17T03:00:28.523839] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T03:00:28.690213] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-17T03:00:28.916601] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:28.917250] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-17T03:00:29.145825] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T03:00:29.490162] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-17T03:00:30.290197] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-11. [2025-09-17T03:00:30.760313] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T03:00:30.766854] [INFO ] [REMOTE ] CRBG: Full fetch complete (75528 records). [2025-09-17T03:00:30.767003] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-17T03:00:31.107530] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-17T03:00:31.167476] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-17T03:00:31.167580] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-17T03:00:31.168401] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-17T03:00:31.168462] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-17T03:00:31.170118] [DEBUG] [LOCAL ] CRBG: Trimmed 75528 records to 52342 (keeping 200 days of data) [2025-09-17T03:00:31.526796] [DEBUG] [LOCAL ] CRBG: Primary data saved (52342 records). [2025-09-17T03:00:31.526986] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-17T03:00:31.527089] [INFO ] [MAIN ] Update Progress: 526/2369 symbols completed. CRBG took 36.7s. Estimated remaining: 4h 27m 44s. Rate: 6.9 symbols/min [2025-09-17T03:00:31.718215] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:31.798302] [DEBUG] [LOCAL ] CRH: Loaded 39829 existing records from primary storage. [2025-09-17T03:00:31.801504] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T03:00:31.801990] [INFO ] [MAIN ] CRH: Loaded 39829 existing records. [2025-09-17T03:00:31.895359] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-17T03:00:31.996825] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:00:31.997114] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-17T03:00:31.997182] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-17T03:00:31.998129] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-17T03:00:31.998194] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-17T03:00:32.350551] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:32.690191] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-11. [2025-09-17T03:00:32.871925] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:00:33.490200] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-17T03:00:33.691791] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T03:00:34.113843] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:00:34.290169] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-17T03:00:34.545023] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T03:00:34.550702] [INFO ] [REMOTE ] CRC: Full fetch complete (61784 records). [2025-09-17T03:00:34.550823] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-17T03:00:34.940537] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-17T03:00:34.940655] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-17T03:00:34.941345] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-17T03:00:34.941399] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-17T03:00:34.942602] [DEBUG] [LOCAL ] CRC: Trimmed 61784 records to 44456 (keeping 200 days of data) [2025-09-17T03:00:35.121948] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-17T03:00:35.218045] [DEBUG] [LOCAL ] CRC: Primary data saved (44456 records). [2025-09-17T03:00:35.218219] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-17T03:00:35.218316] [INFO ] [MAIN ] Update Progress: 527/2369 symbols completed. CRC took 31.5s. Estimated remaining: 4h 27m 18s. Rate: 6.9 symbols/min [2025-09-17T03:00:35.386465] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:35.386727] [DEBUG] [LOCAL ] CRI: No existing data file found in primary storage. [2025-09-17T03:00:35.386779] [WARN ] [MAIN ] CRI: No existing data found, performing full refresh instead. [2025-09-17T03:00:35.386890] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-17T03:00:35.386940] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-17T03:00:35.386986] [DEBUG] [LOCAL ] CRI: No primary data file found to delete. [2025-09-17T03:00:35.387030] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-17T03:00:35.743516] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:35.890108] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-11. [2025-09-17T03:00:36.074135] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T03:00:36.595161] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T03:00:36.690140] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-17T03:00:37.239965] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T03:00:37.490153] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-17T03:00:38.045345] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T03:00:38.146416] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:00:38.146799] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-17T03:00:38.290164] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-17T03:00:39.090183] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-17T03:00:39.888516] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T03:00:39.897582] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-17T03:00:40.690131] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-17T03:00:41.339368] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T03:00:41.490139] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-17T03:00:41.610805] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T03:00:42.147846] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T03:00:42.290200] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-17T03:00:42.732346] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T03:00:43.090154] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-17T03:00:43.890179] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-17T03:00:44.049256] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T03:00:44.348506] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T03:00:44.690151] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-17T03:00:45.490241] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-17T03:00:45.549819] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T03:00:46.290152] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-17T03:00:47.083520] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T03:00:47.094189] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-17T03:00:47.526741] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-17T03:00:47.619411] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T03:00:47.890114] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-17T03:00:48.608217] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T03:00:48.690151] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-17T03:00:49.490207] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-17T03:00:50.201366] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T03:00:50.290102] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-17T03:00:50.332300] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-17T03:00:50.898509] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:00:51.090124] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-17T03:00:51.890134] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-17T03:00:52.150393] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:00:52.690125] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-17T03:00:52.819456] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T03:00:53.490211] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-17T03:00:53.827330] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:00:54.290165] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-17T03:00:54.435068] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T03:00:54.816437] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T03:00:55.090185] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-17T03:00:55.903600] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-17T03:00:55.906607] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T03:00:56.690163] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-17T03:00:56.725595] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T03:00:56.732180] [INFO ] [REMOTE ] CRGY: Full fetch complete (75708 records). [2025-09-17T03:00:56.732344] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-17T03:00:57.128807] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-17T03:00:57.128918] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-17T03:00:57.129765] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-17T03:00:57.129831] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-17T03:00:57.131302] [DEBUG] [LOCAL ] CRGY: Trimmed 75708 records to 52518 (keeping 200 days of data) [2025-09-17T03:00:57.460869] [DEBUG] [LOCAL ] CRGY: Primary data saved (52518 records). [2025-09-17T03:00:57.461038] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-17T03:00:57.461136] [INFO ] [MAIN ] Update Progress: 528/2369 symbols completed. CRGY took 38.5s. Estimated remaining: 4h 27m 56s. Rate: 6.9 symbols/min [2025-09-17T03:00:57.497517] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-17T03:00:57.655906] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:57.691785] [DEBUG] [LOCAL ] CRK: Loaded 38747 existing records from primary storage. [2025-09-17T03:00:57.691985] [INFO ] [MAIN ] CRK: Loaded 38747 existing records. [2025-09-17T03:00:57.877243] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:00:57.877768] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-17T03:00:57.877832] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-17T03:00:57.878813] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-17T03:00:57.878878] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-17T03:00:58.245288] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:58.290083] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-11. [2025-09-17T03:00:58.529018] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T03:00:58.627305] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-09-17T03:00:58.635975] [INFO ] [REMOTE ] CRCL: Full fetch complete (27489 records). [2025-09-17T03:00:58.636105] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-17T03:00:58.820283] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 71 unique days, need 200 days [2025-09-17T03:00:58.820691] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:00:58.820746] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:00:58.820786] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-17T03:00:58.820869] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-17T03:00:58.820930] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-17T03:00:58.820998] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-17T03:00:58.821065] [INFO ] [MAIN ] Update Progress: 529/2369 symbols completed. CRCL took 44.0s. Estimated remaining: 4h 27m 22s. Rate: 6.9 symbols/min [2025-09-17T03:00:58.987521] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:00:59.020910] [DEBUG] [LOCAL ] CRL: Loaded 31389 existing records from primary storage. [2025-09-17T03:00:59.021085] [INFO ] [MAIN ] CRL: Loaded 31389 existing records. [2025-09-17T03:00:59.095807] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-17T03:00:59.201331] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:00:59.201555] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-17T03:00:59.201613] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-17T03:00:59.202485] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-17T03:00:59.202547] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-17T03:00:59.556477] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:00:59.587292] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T03:00:59.792428] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T03:00:59.890087] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-17T03:01:00.690187] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-17T03:01:00.957417] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:01:01.490185] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-11. [2025-09-17T03:01:01.742455] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:01:02.290133] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-17T03:01:02.485785] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T03:01:02.762687] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T03:01:03.090145] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-17T03:01:03.858119] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T03:01:03.890092] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-17T03:01:04.690142] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-17T03:01:04.756594] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T03:01:05.490139] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-17T03:01:05.627413] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T03:01:06.133433] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T03:01:06.139547] [INFO ] [REMOTE ] CRI: Full fetch complete (70615 records). [2025-09-17T03:01:06.139704] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-17T03:01:06.295193] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-17T03:01:06.533414] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-17T03:01:06.533520] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-17T03:01:06.534343] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-17T03:01:06.534416] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-17T03:01:06.535869] [DEBUG] [LOCAL ] CRI: Trimmed 70615 records to 50019 (keeping 200 days of data) [2025-09-17T03:01:06.846341] [DEBUG] [LOCAL ] CRI: Primary data saved (50019 records). [2025-09-17T03:01:06.846522] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-17T03:01:06.846626] [INFO ] [MAIN ] Update Progress: 530/2369 symbols completed. CRI took 31.6s. Estimated remaining: 4h 27m 11s. Rate: 6.9 symbols/min [2025-09-17T03:01:07.014038] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:07.014244] [DEBUG] [LOCAL ] CRM: No existing data file found in primary storage. [2025-09-17T03:01:07.014293] [WARN ] [MAIN ] CRM: No existing data found, performing full refresh instead. [2025-09-17T03:01:07.014413] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-17T03:01:07.014476] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-17T03:01:07.014582] [DEBUG] [LOCAL ] CRM: No primary data file found to delete. [2025-09-17T03:01:07.014626] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-17T03:01:07.093563] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-17T03:01:07.376342] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:07.402218] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T03:01:07.635090] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T03:01:07.890133] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-11. [2025-09-17T03:01:08.671781] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T03:01:08.690103] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-17T03:01:09.490189] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-17T03:01:09.969111] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T03:01:10.045797] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T03:01:10.052422] [INFO ] [REMOTE ] CRH: Full fetch complete (77136 records). [2025-09-17T03:01:10.052596] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-17T03:01:10.295241] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-17T03:01:10.462465] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-17T03:01:10.462568] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-17T03:01:10.463501] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-17T03:01:10.463564] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-17T03:01:10.465320] [DEBUG] [LOCAL ] CRH: Trimmed 77136 records to 53476 (keeping 200 days of data) [2025-09-17T03:01:10.822437] [DEBUG] [LOCAL ] CRH: Primary data saved (53476 records). [2025-09-17T03:01:10.825192] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-17T03:01:10.825329] [INFO ] [MAIN ] Update Progress: 531/2369 symbols completed. CRH took 39.3s. Estimated remaining: 4h 26m 46s. Rate: 6.9 symbols/min [2025-09-17T03:01:10.873701] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T03:01:11.002802] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:11.039256] [DEBUG] [LOCAL ] CRS: Loaded 32329 existing records from primary storage. [2025-09-17T03:01:11.039443] [INFO ] [MAIN ] CRS: Loaded 32329 existing records. [2025-09-17T03:01:11.097024] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-17T03:01:11.221823] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:01:11.222058] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-17T03:01:11.222115] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-17T03:01:11.222998] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-17T03:01:11.223063] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-17T03:01:11.572867] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:11.694950] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T03:01:11.890144] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-11. [2025-09-17T03:01:12.690177] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-17T03:01:13.304745] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.21 seconds). [2025-09-17T03:01:13.422565] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T03:01:13.490192] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-17T03:01:14.174877] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T03:01:14.290214] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-17T03:01:15.090129] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-17T03:01:15.725473] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-17T03:01:15.890179] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-17T03:01:15.920396] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T03:01:16.690138] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-17T03:01:16.801212] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T03:01:17.490174] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-17T03:01:17.972512] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T03:01:18.102280] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:01:18.290100] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-17T03:01:18.811802] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T03:01:19.090176] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-17T03:01:19.890128] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-17T03:01:20.392375] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T03:01:20.660154] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-17T03:01:20.690141] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-17T03:01:21.254553] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T03:01:21.490118] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-17T03:01:22.280199] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T03:01:22.290315] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-17T03:01:23.090112] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-17T03:01:23.757806] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-17T03:01:23.855036] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:01:23.890083] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-17T03:01:24.690161] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-17T03:01:24.834152] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T03:01:25.490200] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-17T03:01:26.129450] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-17T03:01:26.144020] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:01:26.290191] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-17T03:01:26.965616] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T03:01:27.090128] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-17T03:01:27.719374] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T03:01:27.890152] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-17T03:01:28.461138] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T03:01:28.690135] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-17T03:01:29.490092] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-17T03:01:29.573519] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T03:01:29.977541] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T03:01:30.290142] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-17T03:01:31.090143] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-17T03:01:31.499375] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T03:01:31.893065] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-17T03:01:31.896287] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T03:01:31.906139] [INFO ] [REMOTE ] CRK: Full fetch complete (75274 records). [2025-09-17T03:01:31.906383] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-17T03:01:32.323540] [DEBUG] [VALIDATOR ] CRK: All expected trading days are present. [2025-09-17T03:01:32.323702] [DEBUG] [VALIDATOR ] CRK: Primary data validation passed. [2025-09-17T03:01:32.324635] [INFO ] [MAIN ] CRK: Fetched primary data is valid. [2025-09-17T03:01:32.324788] [DEBUG] [LOCAL ] CRK: Saving primary data. [2025-09-17T03:01:32.326355] [DEBUG] [LOCAL ] CRK: Trimmed 75274 records to 52103 (keeping 200 days of data) [2025-09-17T03:01:32.574419] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T03:01:32.689316] [DEBUG] [LOCAL ] CRK: Primary data saved (52103 records). [2025-09-17T03:01:32.689514] [INFO ] [MAIN ] CRK: Full history saved. [2025-09-17T03:01:32.689620] [INFO ] [MAIN ] Update Progress: 532/2369 symbols completed. CRK took 35.2s. Estimated remaining: 4h 27m 22s. Rate: 6.9 symbols/min [2025-09-17T03:01:32.701471] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-17T03:01:32.865249] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:32.870673] [DEBUG] [LOCAL ] CRT: Loaded 3500 existing records from primary storage. [2025-09-17T03:01:32.870828] [INFO ] [MAIN ] CRT: Loaded 3500 existing records. [2025-09-17T03:01:33.050269] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:01:33.050535] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-17T03:01:33.050589] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-17T03:01:33.050901] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-17T03:01:33.050986] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-17T03:01:33.409374] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:33.490109] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-11. [2025-09-17T03:01:33.902700] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-11 (0.41 seconds). [2025-09-17T03:01:34.119013] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T03:01:34.271027] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:01:34.290092] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-17T03:01:35.090137] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-17T03:01:35.617907] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T03:01:35.823813] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T03:01:35.890099] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-17T03:01:36.690210] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-17T03:01:37.196163] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T03:01:37.366579] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T03:01:37.372550] [INFO ] [REMOTE ] CRS: Full fetch complete (62261 records). [2025-09-17T03:01:37.372838] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-17T03:01:37.495313] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-17T03:01:37.758497] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-17T03:01:37.758609] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-17T03:01:37.759371] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-17T03:01:37.759428] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-17T03:01:37.760781] [DEBUG] [LOCAL ] CRS: Trimmed 62261 records to 43571 (keeping 200 days of data) [2025-09-17T03:01:38.046561] [DEBUG] [LOCAL ] CRS: Primary data saved (43571 records). [2025-09-17T03:01:38.046801] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-17T03:01:38.046952] [INFO ] [MAIN ] Update Progress: 533/2369 symbols completed. CRS took 27.2s. Estimated remaining: 4h 27m 2s. Rate: 6.9 symbols/min [2025-09-17T03:01:38.222106] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:38.255018] [DEBUG] [LOCAL ] CSAN: Loaded 31504 existing records from primary storage. [2025-09-17T03:01:38.255210] [INFO ] [MAIN ] CSAN: Loaded 31504 existing records. [2025-09-17T03:01:38.298191] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-17T03:01:38.436772] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:01:38.437007] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-17T03:01:38.437071] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-17T03:01:38.437750] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-17T03:01:38.437814] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-17T03:01:38.831192] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:39.031087] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T03:01:39.090084] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-17T03:01:39.890156] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-17T03:01:40.087252] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-17T03:01:40.113258] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T03:01:40.118789] [INFO ] [REMOTE ] CRL: Full fetch complete (62619 records). [2025-09-17T03:01:40.118958] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-17T03:01:40.434300] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T03:01:40.526669] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-17T03:01:40.526805] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-17T03:01:40.527631] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-17T03:01:40.527737] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-17T03:01:40.529282] [DEBUG] [LOCAL ] CRL: Trimmed 62619 records to 43871 (keeping 200 days of data) [2025-09-17T03:01:40.708703] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-11. [2025-09-17T03:01:40.804472] [DEBUG] [LOCAL ] CRL: Primary data saved (43871 records). [2025-09-17T03:01:40.804676] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-17T03:01:40.804800] [INFO ] [MAIN ] Update Progress: 534/2369 symbols completed. CRL took 42.0s. Estimated remaining: 4h 26m 33s. Rate: 6.9 symbols/min [2025-09-17T03:01:40.976024] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:40.997452] [DEBUG] [LOCAL ] CSL: Loaded 22516 existing records from primary storage. [2025-09-17T03:01:40.997609] [INFO ] [MAIN ] CSL: Loaded 22516 existing records. [2025-09-17T03:01:41.176453] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:01:41.176714] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-17T03:01:41.176772] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-17T03:01:41.177378] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-17T03:01:41.177437] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-17T03:01:41.495552] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-17T03:01:41.534316] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:42.206471] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T03:01:42.290084] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-17T03:01:43.090126] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-11. [2025-09-17T03:01:43.890156] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-17T03:01:43.913939] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T03:01:44.657292] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-17T03:01:44.663904] [INFO ] [REMOTE ] CRM: Full fetch complete (77773 records). [2025-09-17T03:01:44.664057] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-17T03:01:44.698160] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-17T03:01:45.080323] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-17T03:01:45.080434] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-17T03:01:45.081309] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-17T03:01:45.081389] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-17T03:01:45.082921] [DEBUG] [LOCAL ] CRM: Trimmed 77773 records to 53770 (keeping 200 days of data) [2025-09-17T03:01:45.207386] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T03:01:45.463569] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-09-17T03:01:45.463794] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-17T03:01:45.463905] [INFO ] [MAIN ] Update Progress: 535/2369 symbols completed. CRM took 38.6s. Estimated remaining: 4h 26m 10s. Rate: 6.9 symbols/min [2025-09-17T03:01:45.497295] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-17T03:01:45.643770] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:01:45.655200] [DEBUG] [LOCAL ] CSR: Loaded 9535 existing records from primary storage. [2025-09-17T03:01:45.655370] [INFO ] [MAIN ] CSR: Loaded 9535 existing records. [2025-09-17T03:01:45.839749] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:01:45.840125] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-17T03:01:45.840197] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-17T03:01:45.844854] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-17T03:01:45.844983] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-17T03:01:45.879413] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (4.38 seconds). [2025-09-17T03:01:46.231754] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:01:46.256044] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T03:01:46.290091] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-11. [2025-09-17T03:01:46.675935] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T03:01:47.090131] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-17T03:01:47.169507] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T03:01:47.890182] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-17T03:01:48.379245] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T03:01:48.583159] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T03:01:48.690164] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-17T03:01:49.123496] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T03:01:49.490134] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-17T03:01:50.104984] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T03:01:50.290137] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-17T03:01:51.090136] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-17T03:01:51.307324] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T03:01:51.890171] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-17T03:01:52.197731] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T03:01:52.690157] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-17T03:01:52.711982] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T03:01:53.081053] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-17T03:01:53.490161] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-17T03:01:54.111334] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T03:01:54.290150] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-17T03:01:54.839414] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T03:01:55.090128] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-17T03:01:55.890145] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-17T03:01:56.666976] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:01:56.690077] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-17T03:01:56.794230] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T03:01:57.490148] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-17T03:01:57.928380] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T03:01:58.290195] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-17T03:01:58.937758] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:01:59.090136] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-17T03:01:59.783217] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T03:01:59.890117] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-17T03:02:00.113110] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T03:02:00.690167] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-17T03:02:01.461561] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:02:01.490100] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-17T03:02:02.140955] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T03:02:02.290164] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-17T03:02:02.952346] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T03:02:03.064588] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T03:02:03.090087] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-17T03:02:03.890133] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-17T03:02:03.942736] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T03:02:04.690139] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-17T03:02:05.490121] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-17T03:02:05.520087] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T03:02:05.530685] [INFO ] [REMOTE ] CRT: Full fetch complete (7578 records). [2025-09-17T03:02:05.544198] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-17T03:02:05.578237] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:02:06.000079] [DEBUG] [VALIDATOR ] CRT: All expected trading days are present. [2025-09-17T03:02:06.000275] [DEBUG] [VALIDATOR ] CRT: Primary data validation passed. [2025-09-17T03:02:06.000840] [INFO ] [MAIN ] CRT: Fetched primary data is valid. [2025-09-17T03:02:06.000960] [DEBUG] [LOCAL ] CRT: Saving primary data. [2025-09-17T03:02:06.001933] [DEBUG] [LOCAL ] CRT: Trimmed 7578 records to 4909 (keeping 200 days of data) [2025-09-17T03:02:06.041596] [DEBUG] [LOCAL ] CRT: Primary data saved (4909 records). [2025-09-17T03:02:06.041842] [INFO ] [MAIN ] CRT: Full history saved. [2025-09-17T03:02:06.041990] [INFO ] [MAIN ] Update Progress: 536/2369 symbols completed. CRT took 33.4s. Estimated remaining: 4h 26m 42s. Rate: 6.9 symbols/min [2025-09-17T03:02:06.292052] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-17T03:02:06.327716] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:06.391266] [DEBUG] [LOCAL ] CSTM: Loaded 35217 existing records from primary storage. [2025-09-17T03:02:06.391555] [INFO ] [MAIN ] CSTM: Loaded 35217 existing records. [2025-09-17T03:02:06.674002] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:02:06.674361] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-17T03:02:06.674425] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-17T03:02:06.675484] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-17T03:02:06.675566] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-17T03:02:07.097117] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T03:02:07.095296] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-17T03:02:07.141889] [INFO ] [REMOTE ] CSAN: Full fetch complete (60635 records). [2025-09-17T03:02:07.189036] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-17T03:02:07.212465] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:07.604488] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-17T03:02:07.604704] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-17T03:02:07.605855] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-17T03:02:07.606225] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-17T03:02:07.608078] [DEBUG] [LOCAL ] CSAN: Trimmed 60635 records to 42022 (keeping 200 days of data) [2025-09-17T03:02:07.729060] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T03:02:07.890178] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-11. [2025-09-17T03:02:07.894307] [DEBUG] [LOCAL ] CSAN: Primary data saved (42022 records). [2025-09-17T03:02:07.894406] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-17T03:02:07.894532] [INFO ] [MAIN ] Update Progress: 537/2369 symbols completed. CSAN took 29.8s. Estimated remaining: 4h 26m 10s. Rate: 6.9 symbols/min [2025-09-17T03:02:08.071839] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:08.086909] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:02:08.099856] [DEBUG] [LOCAL ] CSV: Loaded 8953 existing records from primary storage. [2025-09-17T03:02:08.100026] [INFO ] [MAIN ] CSV: Loaded 8953 existing records. [2025-09-17T03:02:08.281614] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:02:08.281917] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-17T03:02:08.282002] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-17T03:02:08.282441] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-17T03:02:08.282523] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-17T03:02:08.662437] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:08.690097] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-11. [2025-09-17T03:02:09.078785] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T03:02:09.432280] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T03:02:09.490146] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-17T03:02:10.290129] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-17T03:02:10.355176] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T03:02:11.090141] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-17T03:02:11.774447] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T03:02:11.890122] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-17T03:02:12.070171] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T03:02:12.690135] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-17T03:02:12.862088] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T03:02:13.316939] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T03:02:13.490134] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-17T03:02:14.290155] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-17T03:02:15.090186] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-17T03:02:15.167704] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:02:15.358317] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T03:02:15.680494] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:02:15.890159] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-17T03:02:16.391354] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T03:02:16.394089] [INFO ] [REMOTE ] CSR: Full fetch complete (17414 records). [2025-09-17T03:02:16.394250] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-17T03:02:16.695204] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-17T03:02:16.809877] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-17T03:02:16.810000] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-17T03:02:16.810373] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-17T03:02:16.810458] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-17T03:02:16.811274] [DEBUG] [LOCAL ] CSR: Trimmed 17414 records to 12356 (keeping 200 days of data) [2025-09-17T03:02:16.896109] [DEBUG] [LOCAL ] CSR: Primary data saved (12356 records). [2025-09-17T03:02:16.896288] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-17T03:02:16.896402] [INFO ] [MAIN ] Update Progress: 538/2369 symbols completed. CSR took 31.4s. Estimated remaining: 4h 26m 2s. Rate: 6.9 symbols/min [2025-09-17T03:02:17.078143] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:17.078377] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-17T03:02:17.078429] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-17T03:02:17.078539] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-17T03:02:17.078590] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-17T03:02:17.078658] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-17T03:02:17.078705] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-17T03:02:17.434980] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:17.490149] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-11. [2025-09-17T03:02:17.701026] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:17.701399] [WARN ] [REMOTE ] CSW: No data returned for month 2024-11 [2025-09-17T03:02:18.290139] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-17T03:02:18.462948] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T03:02:18.511491] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:18.511998] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-17T03:02:19.090123] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-17T03:02:19.890121] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-17T03:02:20.690136] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-17T03:02:20.901138] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T03:02:20.995303] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T03:02:21.490141] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-17T03:02:21.858959] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T03:02:21.942508] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:21.942909] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-17T03:02:22.290136] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-17T03:02:23.090119] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-17T03:02:23.159444] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T03:02:23.164094] [INFO ] [REMOTE ] CSL: Full fetch complete (44374 records). [2025-09-17T03:02:23.164285] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-17T03:02:23.560112] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-17T03:02:23.560280] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-17T03:02:23.560964] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-17T03:02:23.561044] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-17T03:02:23.562661] [DEBUG] [LOCAL ] CSL: Trimmed 44374 records to 31340 (keeping 200 days of data) [2025-09-17T03:02:23.780167] [DEBUG] [LOCAL ] CSL: Primary data saved (31340 records). [2025-09-17T03:02:23.780364] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-17T03:02:23.780497] [INFO ] [MAIN ] Update Progress: 539/2369 symbols completed. CSL took 43.0s. Estimated remaining: 4h 25m 47s. Rate: 6.9 symbols/min [2025-09-17T03:02:23.895197] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-17T03:02:23.959350] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:23.967047] [DEBUG] [LOCAL ] CTBB: Loaded 4822 existing records from primary storage. [2025-09-17T03:02:23.967196] [INFO ] [MAIN ] CTBB: Loaded 4822 existing records. [2025-09-17T03:02:24.144938] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:02:24.145920] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-17T03:02:24.146114] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-17T03:02:24.151862] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-17T03:02:24.156386] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-17T03:02:24.156730] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T03:02:24.207034] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:24.257740] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-17T03:02:24.538628] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:24.690135] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-17T03:02:25.332503] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T03:02:25.490146] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-17T03:02:26.290140] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-17T03:02:26.323059] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T03:02:26.508390] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:26.508750] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-17T03:02:27.090200] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-17T03:02:27.761575] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T03:02:27.890198] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-17T03:02:28.690181] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-11. [2025-09-17T03:02:29.346692] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T03:02:29.490160] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-17T03:02:29.555607] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T03:02:30.290152] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-17T03:02:30.470182] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T03:02:31.090146] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-17T03:02:31.193943] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T03:02:31.890187] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-17T03:02:31.907483] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T03:02:31.910517] [INFO ] [REMOTE ] CSV: Full fetch complete (19252 records). [2025-09-17T03:02:31.910681] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-17T03:02:32.351072] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-17T03:02:32.351183] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-17T03:02:32.351628] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-17T03:02:32.351703] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-17T03:02:32.352379] [DEBUG] [LOCAL ] CSV: Trimmed 19252 records to 13134 (keeping 200 days of data) [2025-09-17T03:02:32.437886] [DEBUG] [LOCAL ] CSV: Primary data saved (13134 records). [2025-09-17T03:02:32.438051] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-17T03:02:32.438151] [INFO ] [MAIN ] Update Progress: 540/2369 symbols completed. CSV took 24.5s. Estimated remaining: 4h 25m 38s. Rate: 6.9 symbols/min [2025-09-17T03:02:32.611904] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:32.618949] [DEBUG] [LOCAL ] CTDD: Loaded 3822 existing records from primary storage. [2025-09-17T03:02:32.619116] [INFO ] [MAIN ] CTDD: Loaded 3822 existing records. [2025-09-17T03:02:32.695464] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-17T03:02:32.814462] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:02:32.814763] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-17T03:02:32.814834] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-17T03:02:32.815115] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-17T03:02:32.815179] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-17T03:02:33.191287] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:33.219199] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T03:02:33.459513] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T03:02:33.490081] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-17T03:02:33.889413] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T03:02:34.290174] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-17T03:02:35.090155] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-11. [2025-09-17T03:02:35.503671] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T03:02:35.833299] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T03:02:35.890197] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-17T03:02:36.364218] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T03:02:36.690148] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-17T03:02:37.490234] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-17T03:02:37.947731] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T03:02:37.965543] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T03:02:38.290216] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-17T03:02:39.090183] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-17T03:02:39.312719] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:39.313311] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-17T03:02:39.826413] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T03:02:39.890147] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-17T03:02:40.488207] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T03:02:40.690132] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-17T03:02:41.277707] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:02:41.490134] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-17T03:02:42.290188] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-17T03:02:42.505559] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:42.505980] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-17T03:02:42.941475] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:02:42.947573] [INFO ] [REMOTE ] CSTM: Full fetch complete (68703 records). [2025-09-17T03:02:42.947773] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-17T03:02:43.095246] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-17T03:02:43.345674] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-17T03:02:43.345798] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-17T03:02:43.346588] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-17T03:02:43.346690] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-17T03:02:43.348492] [DEBUG] [LOCAL ] CSTM: Trimmed 68703 records to 47878 (keeping 200 days of data) [2025-09-17T03:02:43.644200] [DEBUG] [LOCAL ] CSTM: Primary data saved (47878 records). [2025-09-17T03:02:43.644388] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-17T03:02:43.644521] [INFO ] [MAIN ] Update Progress: 541/2369 symbols completed. CSTM took 37.6s. Estimated remaining: 4h 25m 38s. Rate: 6.9 symbols/min [2025-09-17T03:02:43.816035] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:43.816255] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-17T03:02:43.816307] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-17T03:02:43.816422] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-17T03:02:43.816474] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-17T03:02:43.816525] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-17T03:02:43.816567] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-17T03:02:43.895208] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-17T03:02:44.219708] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:44.220901] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T03:02:44.577401] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T03:02:44.690126] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-17T03:02:45.490167] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-17T03:02:45.592509] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T03:02:45.990053] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T03:02:46.290150] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-17T03:02:47.090151] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-17T03:02:47.351870] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T03:02:47.522440] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T03:02:47.890139] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-17T03:02:48.335259] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T03:02:48.690205] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-17T03:02:49.399906] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T03:02:49.490151] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-17T03:02:50.122254] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T03:02:50.290128] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-11. [2025-09-17T03:02:50.525534] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2024-11 (0.24 seconds). [2025-09-17T03:02:51.090169] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-17T03:02:51.318947] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:51.319282] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-17T03:02:51.890140] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-17T03:02:52.393169] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-17T03:02:52.690132] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-17T03:02:53.366523] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T03:02:53.490133] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-17T03:02:53.712861] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:53.713188] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-17T03:02:54.290192] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-17T03:02:55.090138] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-17T03:02:55.311927] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T03:02:55.314348] [INFO ] [REMOTE ] CSW: Full fetch complete (7329 records). [2025-09-17T03:02:55.314432] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-17T03:02:55.495543] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 69 unique days, need 200 days [2025-09-17T03:02:55.495810] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:02:55.495887] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:02:55.495945] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-17T03:02:55.496031] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-17T03:02:55.496129] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-17T03:02:55.496203] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-17T03:02:55.496282] [INFO ] [MAIN ] Update Progress: 542/2369 symbols completed. CSW took 38.6s. Estimated remaining: 4h 25m 40s. Rate: 6.9 symbols/min [2025-09-17T03:02:55.616103] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T03:02:55.679186] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:55.679379] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-17T03:02:55.679425] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-17T03:02:55.679540] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-17T03:02:55.679586] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-17T03:02:55.679633] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-17T03:02:55.679708] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-17T03:02:55.896744] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-17T03:02:56.070658] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:02:56.212344] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:56.212685] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-17T03:02:56.690140] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-17T03:02:57.421613] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T03:02:57.490130] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-11. [2025-09-17T03:02:57.706195] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:02:57.706560] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-11 [2025-09-17T03:02:58.290139] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-17T03:02:58.922824] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T03:02:58.924392] [INFO ] [REMOTE ] CTBB: Full fetch complete (11250 records). [2025-09-17T03:02:58.924486] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-17T03:02:59.091896] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-17T03:02:59.303831] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-17T03:02:59.303933] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-17T03:02:59.304205] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-17T03:02:59.304306] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-17T03:02:59.304830] [DEBUG] [LOCAL ] CTBB: Trimmed 11250 records to 7339 (keeping 200 days of data) [2025-09-17T03:02:59.349865] [DEBUG] [LOCAL ] CTBB: Primary data saved (7339 records). [2025-09-17T03:02:59.349976] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-17T03:02:59.350060] [INFO ] [MAIN ] Update Progress: 543/2369 symbols completed. CTBB took 35.6s. Estimated remaining: 4h 25m 15s. Rate: 6.9 symbols/min [2025-09-17T03:02:59.516924] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:02:59.536372] [DEBUG] [LOCAL ] CTO: Loaded 19613 existing records from primary storage. [2025-09-17T03:02:59.536517] [INFO ] [MAIN ] CTO: Loaded 19613 existing records. [2025-09-17T03:02:59.716199] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:02:59.716460] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-17T03:02:59.716522] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-17T03:02:59.717146] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-17T03:02:59.717215] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-17T03:02:59.896046] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-17T03:02:59.949683] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T03:03:00.093629] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:00.200727] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:00.201094] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-17T03:03:00.690148] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-17T03:03:01.329350] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:03:01.331088] [INFO ] [REMOTE ] CTDD: Full fetch complete (8635 records). [2025-09-17T03:03:01.331429] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-17T03:03:01.495314] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-17T03:03:01.757098] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-17T03:03:01.757242] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-17T03:03:01.757791] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-17T03:03:01.757859] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-17T03:03:01.758426] [DEBUG] [LOCAL ] CTDD: Trimmed 8635 records to 5902 (keeping 200 days of data) [2025-09-17T03:03:01.801457] [DEBUG] [LOCAL ] CTDD: Primary data saved (5902 records). [2025-09-17T03:03:01.801745] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-17T03:03:01.801884] [INFO ] [MAIN ] Update Progress: 544/2369 symbols completed. CTDD took 29.4s. Estimated remaining: 4h 24m 45s. Rate: 6.9 symbols/min [2025-09-17T03:03:01.994099] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:02.026621] [DEBUG] [LOCAL ] CTOS: Loaded 26856 existing records from primary storage. [2025-09-17T03:03:02.026878] [INFO ] [MAIN ] CTOS: Loaded 26856 existing records. [2025-09-17T03:03:02.222939] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:02.223311] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-17T03:03:02.223378] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-17T03:03:02.224149] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-17T03:03:02.224250] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-17T03:03:02.295434] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-17T03:03:02.369031] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:02.394864] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-17T03:03:02.632415] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:03.090146] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-17T03:03:03.890154] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-11. [2025-09-17T03:03:04.032138] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:04.032505] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-17T03:03:04.100155] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:04.100745] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-17T03:03:04.690147] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-17T03:03:05.008473] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-17T03:03:05.100166] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T03:03:05.490134] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-17T03:03:06.290145] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-17T03:03:06.325626] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T03:03:07.090142] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-11. [2025-09-17T03:03:07.232377] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T03:03:07.890194] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-17T03:03:08.098492] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T03:03:08.690150] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-17T03:03:09.029288] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:03:09.197624] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T03:03:09.490144] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-17T03:03:10.290142] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-17T03:03:10.410377] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T03:03:11.090195] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-17T03:03:11.749387] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T03:03:11.898313] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-17T03:03:11.902145] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T03:03:12.170834] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-17T03:03:12.690129] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-17T03:03:13.442934] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T03:03:13.490095] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-17T03:03:14.290167] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-17T03:03:14.348556] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T03:03:14.912535] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T03:03:15.090124] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-17T03:03:15.890158] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-17T03:03:16.690141] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-17T03:03:17.074824] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T03:03:17.301108] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-17T03:03:17.490336] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-17T03:03:17.933417] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T03:03:18.290183] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-17T03:03:18.676313] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T03:03:19.090146] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-17T03:03:19.394352] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T03:03:19.890142] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-17T03:03:20.091162] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T03:03:20.145689] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:20.146100] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-17T03:03:20.690133] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-17T03:03:21.490194] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-17T03:03:21.502146] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T03:03:21.505255] [INFO ] [REMOTE ] CTEV: Full fetch complete (13025 records). [2025-09-17T03:03:21.505388] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-17T03:03:21.699973] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 138 unique days, need 200 days [2025-09-17T03:03:21.700422] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:03:21.700478] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:03:21.700528] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-17T03:03:21.700604] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-17T03:03:21.700679] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-17T03:03:21.700734] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-17T03:03:21.700837] [INFO ] [MAIN ] Update Progress: 545/2369 symbols completed. CTEV took 26.2s. Estimated remaining: 4h 25m 14s. Rate: 6.9 symbols/min [2025-09-17T03:03:21.871200] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:21.910880] [DEBUG] [LOCAL ] CTRA: Loaded 40002 existing records from primary storage. [2025-09-17T03:03:21.911051] [INFO ] [MAIN ] CTRA: Loaded 40002 existing records. [2025-09-17T03:03:22.092433] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:22.092702] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-17T03:03:22.092755] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-17T03:03:22.093900] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-17T03:03:22.093963] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-17T03:03:22.299295] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-17T03:03:22.459905] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:22.639683] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:03:22.640118] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-17T03:03:22.640206] [INFO ] [REMOTE ] CTEST: Full fetch complete (1021 records). [2025-09-17T03:03:22.640283] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-17T03:03:22.640940] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T03:03:22.641015] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:03:22.641063] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:03:22.641110] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-17T03:03:22.641175] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-17T03:03:22.641222] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-17T03:03:22.641280] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-17T03:03:22.641352] [INFO ] [MAIN ] Update Progress: 546/2369 symbols completed. CTEST took 39.0s. Estimated remaining: 4h 24m 39s. Rate: 6.9 symbols/min [2025-09-17T03:03:22.813616] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:22.849004] [DEBUG] [LOCAL ] CTRE: Loaded 36634 existing records from primary storage. [2025-09-17T03:03:22.849181] [INFO ] [MAIN ] CTRE: Loaded 36634 existing records. [2025-09-17T03:03:23.025912] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:23.026185] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-17T03:03:23.026243] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-17T03:03:23.027244] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-17T03:03:23.027306] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-17T03:03:23.095320] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-17T03:03:23.398940] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T03:03:23.431882] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:23.890115] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-11. [2025-09-17T03:03:24.294610] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T03:03:24.690194] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-17T03:03:25.320870] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T03:03:25.490140] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-17T03:03:25.596887] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T03:03:26.290137] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-17T03:03:27.090155] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-11. [2025-09-17T03:03:27.495302] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T03:03:27.892018] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-17T03:03:27.894967] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T03:03:28.690105] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-17T03:03:28.791892] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T03:03:29.490175] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-17T03:03:29.817772] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T03:03:29.855464] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T03:03:30.290196] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-17T03:03:30.907125] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T03:03:31.090145] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-17T03:03:31.822909] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T03:03:31.890090] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-17T03:03:32.361579] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:03:32.690193] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-17T03:03:33.490129] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-17T03:03:33.999436] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-17T03:03:34.036054] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T03:03:34.290144] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-17T03:03:35.090110] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-17T03:03:35.126465] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:03:35.873629] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:03:35.890079] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-17T03:03:36.262410] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T03:03:36.690146] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-17T03:03:37.490185] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-17T03:03:37.953308] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T03:03:38.031283] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T03:03:38.290166] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-17T03:03:38.803918] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T03:03:39.090132] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-17T03:03:39.671169] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T03:03:39.890156] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-17T03:03:40.543263] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:03:40.690116] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-17T03:03:41.489658] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T03:03:41.499851] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-17T03:03:41.910843] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:03:42.290118] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-17T03:03:42.611473] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T03:03:42.617727] [INFO ] [REMOTE ] CTO: Full fetch complete (41944 records). [2025-09-17T03:03:42.618057] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-17T03:03:43.000706] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-17T03:03:43.000815] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-17T03:03:43.001361] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-17T03:03:43.001416] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-17T03:03:43.002525] [DEBUG] [LOCAL ] CTO: Trimmed 41944 records to 28582 (keeping 200 days of data) [2025-09-17T03:03:43.094596] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-17T03:03:43.187161] [DEBUG] [LOCAL ] CTO: Primary data saved (28582 records). [2025-09-17T03:03:43.187360] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-17T03:03:43.187461] [INFO ] [MAIN ] Update Progress: 547/2369 symbols completed. CTO took 43.8s. Estimated remaining: 4h 25m 10s. Rate: 6.9 symbols/min [2025-09-17T03:03:43.360827] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:43.394916] [DEBUG] [LOCAL ] CTRI: Loaded 29346 existing records from primary storage. [2025-09-17T03:03:43.395111] [INFO ] [MAIN ] CTRI: Loaded 29346 existing records. [2025-09-17T03:03:43.578331] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:43.578599] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-17T03:03:43.578679] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-17T03:03:43.579523] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-17T03:03:43.579588] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-17T03:03:43.909227] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-17T03:03:43.951133] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:44.025902] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T03:03:44.244482] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:03:44.248952] [INFO ] [REMOTE ] CTOS: Full fetch complete (53403 records). [2025-09-17T03:03:44.249069] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-17T03:03:44.645134] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-17T03:03:44.645254] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-17T03:03:44.646004] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-17T03:03:44.646080] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-17T03:03:44.647416] [DEBUG] [LOCAL ] CTOS: Trimmed 53403 records to 37086 (keeping 200 days of data) [2025-09-17T03:03:44.695055] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-11. [2025-09-17T03:03:44.859914] [DEBUG] [LOCAL ] CTOS: Primary data saved (37086 records). [2025-09-17T03:03:44.860098] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-17T03:03:44.860207] [INFO ] [MAIN ] Update Progress: 548/2369 symbols completed. CTOS took 43.1s. Estimated remaining: 4h 24m 37s. Rate: 6.9 symbols/min [2025-09-17T03:03:45.038949] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:45.053720] [DEBUG] [LOCAL ] CTS: Loaded 13918 existing records from primary storage. [2025-09-17T03:03:45.053875] [INFO ] [MAIN ] CTS: Loaded 13918 existing records. [2025-09-17T03:03:45.236551] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:45.236951] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-17T03:03:45.237409] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-17T03:03:45.238066] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-17T03:03:45.238197] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-17T03:03:45.509497] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-17T03:03:45.563780] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T03:03:45.655279] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:46.094334] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T03:03:46.290143] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-17T03:03:47.090148] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-17T03:03:47.220897] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T03:03:47.887148] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T03:03:47.896125] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-17T03:03:48.376007] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T03:03:48.690137] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-11. [2025-09-17T03:03:49.499465] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-17T03:03:49.500808] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T03:03:49.602111] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T03:03:49.608709] [INFO ] [REMOTE ] CTRA: Full fetch complete (77510 records). [2025-09-17T03:03:49.608877] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-17T03:03:49.999123] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-17T03:03:49.999259] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-17T03:03:50.000349] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-17T03:03:50.000417] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-17T03:03:50.001998] [DEBUG] [LOCAL ] CTRA: Trimmed 77510 records to 53650 (keeping 200 days of data) [2025-09-17T03:03:50.294221] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-17T03:03:50.335389] [DEBUG] [LOCAL ] CTRA: Primary data saved (53650 records). [2025-09-17T03:03:50.335515] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-17T03:03:50.335601] [INFO ] [MAIN ] Update Progress: 549/2369 symbols completed. CTRA took 28.6s. Estimated remaining: 4h 24m 18s. Rate: 6.9 symbols/min [2025-09-17T03:03:50.502623] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:03:50.538710] [DEBUG] [LOCAL ] CTVA: Loaded 39714 existing records from primary storage. [2025-09-17T03:03:50.538896] [INFO ] [MAIN ] CTVA: Loaded 39714 existing records. [2025-09-17T03:03:50.723581] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:03:50.723858] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-17T03:03:50.723916] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-17T03:03:50.724783] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-17T03:03:50.724847] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-17T03:03:51.075515] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:03:51.090087] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-11. [2025-09-17T03:03:51.154071] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T03:03:51.283272] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T03:03:51.890135] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-17T03:03:52.690161] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-17T03:03:52.771569] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T03:03:52.962228] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T03:03:53.490193] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-17T03:03:53.767811] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T03:03:54.290191] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-17T03:03:54.926543] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T03:03:55.090148] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-17T03:03:55.873801] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T03:03:55.890077] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-17T03:03:56.041734] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T03:03:56.690081] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-17T03:03:56.726145] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T03:03:57.490134] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-17T03:03:58.290145] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-17T03:03:58.495768] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T03:03:58.688097] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T03:03:59.090162] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-17T03:03:59.742784] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:03:59.749731] [INFO ] [REMOTE ] CTRE: Full fetch complete (70885 records). [2025-09-17T03:03:59.749937] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-17T03:03:59.895351] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-17T03:04:00.174908] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-17T03:04:00.175328] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-17T03:04:00.176762] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-17T03:04:00.176870] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-17T03:04:00.188094] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T03:04:00.194144] [DEBUG] [LOCAL ] CTRE: Trimmed 70885 records to 49196 (keeping 200 days of data) [2025-09-17T03:04:00.515742] [DEBUG] [LOCAL ] CTRE: Primary data saved (49196 records). [2025-09-17T03:04:00.516000] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-17T03:04:00.516123] [INFO ] [MAIN ] Update Progress: 550/2369 symbols completed. CTRE took 37.9s. Estimated remaining: 4h 24m 14s. Rate: 6.9 symbols/min [2025-09-17T03:04:00.699207] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-17T03:04:00.703244] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:00.705096] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-17T03:04:00.705175] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-17T03:04:00.705323] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-17T03:04:00.705383] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-17T03:04:00.705432] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-17T03:04:00.705473] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-17T03:04:01.092781] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:01.374754] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T03:04:01.490101] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-17T03:04:01.886092] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T03:04:02.290139] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-17T03:04:02.980208] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T03:04:03.090138] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-17T03:04:03.699049] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:04:03.890178] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-11. [2025-09-17T03:04:04.242238] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T03:04:04.650236] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T03:04:04.690101] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-17T03:04:05.490133] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-17T03:04:06.290191] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-17T03:04:06.408142] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T03:04:06.848751] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T03:04:06.971290] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T03:04:07.090174] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-17T03:04:07.890133] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-17T03:04:08.472275] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:04:08.690164] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-17T03:04:09.049554] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T03:04:09.055595] [INFO ] [REMOTE ] CTRI: Full fetch complete (50169 records). [2025-09-17T03:04:09.055737] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-17T03:04:09.444321] [DEBUG] [VALIDATOR ] CTRI: All expected trading days are present. [2025-09-17T03:04:09.444478] [DEBUG] [VALIDATOR ] CTRI: Primary data validation passed. [2025-09-17T03:04:09.445263] [INFO ] [MAIN ] CTRI: Fetched primary data is valid. [2025-09-17T03:04:09.445347] [DEBUG] [LOCAL ] CTRI: Saving primary data. [2025-09-17T03:04:09.446622] [DEBUG] [LOCAL ] CTRI: Trimmed 50169 records to 37167 (keeping 200 days of data) [2025-09-17T03:04:09.515975] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-17T03:04:09.725342] [DEBUG] [LOCAL ] CTRI: Primary data saved (37167 records). [2025-09-17T03:04:09.725551] [INFO ] [MAIN ] CTRI: Full history saved. [2025-09-17T03:04:09.725678] [INFO ] [MAIN ] Update Progress: 551/2369 symbols completed. CTRI took 26.5s. Estimated remaining: 4h 24m 7s. Rate: 6.9 symbols/min [2025-09-17T03:04:09.981361] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:10.038586] [DEBUG] [LOCAL ] CUBE: Loaded 37936 existing records from primary storage. [2025-09-17T03:04:10.039174] [INFO ] [MAIN ] CUBE: Loaded 37936 existing records. [2025-09-17T03:04:10.284735] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T03:04:10.309222] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-17T03:04:10.416050] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:10.416614] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-17T03:04:10.431425] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-17T03:04:10.432879] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T03:04:10.438148] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-17T03:04:10.438687] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-17T03:04:10.711948] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-17T03:04:10.803436] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:11.090145] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-17T03:04:11.335817] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-17T03:04:11.890141] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-11. [2025-09-17T03:04:12.690132] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-17T03:04:12.950101] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.26 seconds). [2025-09-17T03:04:13.220334] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T03:04:13.490335] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-17T03:04:14.265285] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T03:04:14.290069] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-17T03:04:15.093091] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-17T03:04:15.094880] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T03:04:15.444843] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T03:04:15.890135] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-17T03:04:16.690133] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-17T03:04:17.490130] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-17T03:04:17.527523] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T03:04:17.530411] [INFO ] [REMOTE ] CTS: Full fetch complete (26349 records). [2025-09-17T03:04:17.530527] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-17T03:04:17.877213] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-17T03:04:17.909425] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-17T03:04:17.909527] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-17T03:04:17.910008] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-17T03:04:17.910185] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-17T03:04:17.911127] [DEBUG] [LOCAL ] CTS: Trimmed 26349 records to 19337 (keeping 200 days of data) [2025-09-17T03:04:18.029977] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T03:04:18.072478] [DEBUG] [LOCAL ] CTS: Primary data saved (19337 records). [2025-09-17T03:04:18.072670] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-17T03:04:18.072773] [INFO ] [MAIN ] Update Progress: 552/2369 symbols completed. CTS took 33.2s. Estimated remaining: 4h 23m 57s. Rate: 6.9 symbols/min [2025-09-17T03:04:18.249568] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:18.268906] [DEBUG] [LOCAL ] CUBI: Loaded 19849 existing records from primary storage. [2025-09-17T03:04:18.269070] [INFO ] [MAIN ] CUBI: Loaded 19849 existing records. [2025-09-17T03:04:18.298681] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-17T03:04:18.454790] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:18.455056] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-17T03:04:18.455126] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-17T03:04:18.455557] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-17T03:04:18.455615] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-17T03:04:18.815048] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:19.090132] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-17T03:04:19.747891] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T03:04:19.890127] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-17T03:04:20.315589] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T03:04:20.690132] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-17T03:04:20.977630] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-17T03:04:21.495233] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-11. [2025-09-17T03:04:21.516508] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T03:04:22.290121] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-17T03:04:22.873415] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T03:04:23.090138] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-17T03:04:23.890180] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-17T03:04:24.047842] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:04:24.133157] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-17T03:04:24.476954] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T03:04:24.690155] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-17T03:04:25.036370] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T03:04:25.490128] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-17T03:04:26.290107] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-17T03:04:26.308335] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T03:04:27.090183] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-17T03:04:27.628058] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T03:04:27.890130] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-17T03:04:28.041689] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:04:28.048441] [INFO ] [REMOTE ] CTVA: Full fetch complete (76750 records). [2025-09-17T03:04:28.048593] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-17T03:04:28.448048] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-17T03:04:28.448167] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-17T03:04:28.449009] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-17T03:04:28.449067] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-17T03:04:28.450506] [DEBUG] [LOCAL ] CTVA: Trimmed 76750 records to 53231 (keeping 200 days of data) [2025-09-17T03:04:28.699947] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-17T03:04:28.783397] [DEBUG] [LOCAL ] CTVA: Primary data saved (53231 records). [2025-09-17T03:04:28.783569] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-17T03:04:28.783683] [INFO ] [MAIN ] Update Progress: 553/2369 symbols completed. CTVA took 38.4s. Estimated remaining: 4h 23m 55s. Rate: 6.9 symbols/min [2025-09-17T03:04:28.959917] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:28.996053] [DEBUG] [LOCAL ] CUK: Loaded 37737 existing records from primary storage. [2025-09-17T03:04:28.996219] [INFO ] [MAIN ] CUK: Loaded 37737 existing records. [2025-09-17T03:04:29.174246] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:29.174542] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-17T03:04:29.174810] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-17T03:04:29.175618] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-17T03:04:29.175714] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-17T03:04:29.311472] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T03:04:29.495321] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-17T03:04:29.572046] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:30.169099] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T03:04:30.290108] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-11. [2025-09-17T03:04:30.351476] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T03:04:31.090143] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-17T03:04:31.890189] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-17T03:04:32.071395] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T03:04:32.690112] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-17T03:04:32.718391] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T03:04:32.881522] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T03:04:33.490160] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-17T03:04:33.833844] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T03:04:33.834574] [INFO ] [REMOTE ] CUBB: Full fetch complete (922 records). [2025-09-17T03:04:33.834709] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-17T03:04:34.048027] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T03:04:34.048208] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:04:34.048253] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:04:34.048303] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-17T03:04:34.048369] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-17T03:04:34.048410] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-17T03:04:34.048474] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-17T03:04:34.048548] [INFO ] [MAIN ] Update Progress: 554/2369 symbols completed. CUBB took 33.5s. Estimated remaining: 4h 23m 35s. Rate: 6.9 symbols/min [2025-09-17T03:04:34.225164] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:34.229367] [DEBUG] [LOCAL ] CULP: Loaded 2000 existing records from primary storage. [2025-09-17T03:04:34.229798] [INFO ] [MAIN ] CULP: Loaded 2000 existing records. [2025-09-17T03:04:34.296736] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-17T03:04:34.460245] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:34.461026] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-17T03:04:34.462475] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T03:04:34.462589] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-17T03:04:34.472795] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-17T03:04:34.472889] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-17T03:04:34.845239] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:35.090134] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-17T03:04:35.788789] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T03:04:35.890096] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-17T03:04:36.445007] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T03:04:36.690174] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-11. [2025-09-17T03:04:37.004372] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-17T03:04:37.176532] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T03:04:37.490192] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-17T03:04:38.290178] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-17T03:04:38.935456] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T03:04:39.090153] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-17T03:04:39.245572] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T03:04:39.890195] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-17T03:04:40.469589] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T03:04:40.690160] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-17T03:04:40.740676] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T03:04:41.225145] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T03:04:41.490152] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-17T03:04:42.290130] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-17T03:04:42.823075] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T03:04:43.090103] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-17T03:04:43.456049] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T03:04:43.890196] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-17T03:04:44.415942] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T03:04:44.690155] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-17T03:04:45.279587] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T03:04:45.354773] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T03:04:45.490134] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-17T03:04:46.082961] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T03:04:46.290137] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-17T03:04:46.612288] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T03:04:47.090138] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-17T03:04:47.579320] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T03:04:47.890167] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-17T03:04:48.487421] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:04:48.690164] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-17T03:04:49.490154] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-17T03:04:50.290195] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-17T03:04:50.397732] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T03:04:50.429203] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T03:04:51.090125] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-17T03:04:51.466940] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T03:04:51.473897] [INFO ] [REMOTE ] CUBE: Full fetch complete (72735 records). [2025-09-17T03:04:51.474046] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-17T03:04:51.861053] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-17T03:04:51.861161] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-17T03:04:51.861981] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-17T03:04:51.862048] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-17T03:04:51.863465] [DEBUG] [LOCAL ] CUBE: Trimmed 72735 records to 50775 (keeping 200 days of data) [2025-09-17T03:04:51.923730] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-17T03:04:52.198013] [DEBUG] [LOCAL ] CUBE: Primary data saved (50775 records). [2025-09-17T03:04:52.198353] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-17T03:04:52.198576] [INFO ] [MAIN ] Update Progress: 555/2369 symbols completed. CUBE took 42.5s. Estimated remaining: 4h 23m 57s. Rate: 6.9 symbols/min [2025-09-17T03:04:52.374541] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:52.404008] [DEBUG] [LOCAL ] CURB: Loaded 23660 existing records from primary storage. [2025-09-17T03:04:52.404239] [INFO ] [MAIN ] CURB: Loaded 23660 existing records. [2025-09-17T03:04:52.509829] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T03:04:52.595931] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:52.596274] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-17T03:04:52.596341] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-17T03:04:52.597059] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-17T03:04:52.597135] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-17T03:04:52.690434] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-17T03:04:52.991961] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:53.030809] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:04:53.227369] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:04:53.228476] [INFO ] [REMOTE ] CULP: Full fetch complete (4729 records). [2025-09-17T03:04:53.228591] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-17T03:04:53.495301] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-17T03:04:53.606026] [DEBUG] [VALIDATOR ] CULP: All expected trading days are present. [2025-09-17T03:04:53.606146] [DEBUG] [VALIDATOR ] CULP: Primary data validation passed. [2025-09-17T03:04:53.606337] [INFO ] [MAIN ] CULP: Fetched primary data is valid. [2025-09-17T03:04:53.606413] [DEBUG] [LOCAL ] CULP: Saving primary data. [2025-09-17T03:04:53.606883] [DEBUG] [LOCAL ] CULP: Trimmed 4729 records to 3102 (keeping 200 days of data) [2025-09-17T03:04:53.626276] [DEBUG] [LOCAL ] CULP: Primary data saved (3102 records). [2025-09-17T03:04:53.626392] [INFO ] [MAIN ] CULP: Full history saved. [2025-09-17T03:04:53.626518] [INFO ] [MAIN ] Update Progress: 556/2369 symbols completed. CULP took 19.6s. Estimated remaining: 4h 23m 24s. Rate: 6.9 symbols/min [2025-09-17T03:04:53.803159] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:04:53.824890] [DEBUG] [LOCAL ] CURV: Loaded 20011 existing records from primary storage. [2025-09-17T03:04:53.825067] [INFO ] [MAIN ] CURV: Loaded 20011 existing records. [2025-09-17T03:04:54.001957] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:04:54.002211] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-17T03:04:54.002283] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-17T03:04:54.002752] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-17T03:04:54.002819] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-17T03:04:54.295289] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-11. [2025-09-17T03:04:54.364145] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:04:54.482414] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:04:55.090185] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-11. [2025-09-17T03:04:55.388360] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T03:04:55.890184] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-17T03:04:56.389473] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T03:04:56.690133] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-17T03:04:56.907036] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T03:04:57.490137] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-17T03:04:57.829004] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:04:58.290145] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-17T03:04:59.101683] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-17T03:04:59.104547] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T03:04:59.598319] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T03:04:59.868006] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T03:04:59.890105] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-17T03:05:00.690182] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-17T03:05:01.125575] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T03:05:01.129659] [INFO ] [REMOTE ] CUBI: Full fetch complete (38912 records). [2025-09-17T03:05:01.129808] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-17T03:05:01.497587] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-17T03:05:01.522538] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-17T03:05:01.522702] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-17T03:05:01.523305] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-17T03:05:01.523484] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-17T03:05:01.524767] [DEBUG] [LOCAL ] CUBI: Trimmed 38912 records to 27203 (keeping 200 days of data) [2025-09-17T03:05:01.702588] [DEBUG] [LOCAL ] CUBI: Primary data saved (27203 records). [2025-09-17T03:05:01.702800] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-17T03:05:01.702935] [INFO ] [MAIN ] Update Progress: 557/2369 symbols completed. CUBI took 43.6s. Estimated remaining: 4h 23m 14s. Rate: 6.9 symbols/min [2025-09-17T03:05:02.290202] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-17T03:05:02.681166] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-17T03:05:02.825001] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T03:05:03.090185] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-17T03:05:03.181573] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T03:05:03.890259] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-17T03:05:04.690205] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-17T03:05:04.958937] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T03:05:05.002458] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T03:05:05.490186] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-17T03:05:06.211219] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T03:05:06.290158] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-17T03:05:07.090134] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-17T03:05:07.295526] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T03:05:07.819060] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T03:05:07.890132] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-17T03:05:08.028559] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T03:05:08.690184] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-17T03:05:08.857304] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T03:05:09.490155] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-17T03:05:10.056403] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T03:05:10.063861] [INFO ] [REMOTE ] CUK: Full fetch complete (73409 records). [2025-09-17T03:05:10.064103] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-17T03:05:10.308252] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-17T03:05:10.475596] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-17T03:05:10.475757] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-17T03:05:10.476720] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-17T03:05:10.476785] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-17T03:05:10.478729] [DEBUG] [LOCAL ] CUK: Trimmed 73409 records to 51034 (keeping 200 days of data) [2025-09-17T03:05:10.783626] [DEBUG] [LOCAL ] CUK: Primary data saved (51034 records). [2025-09-17T03:05:10.783814] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-17T03:05:10.783958] [INFO ] [MAIN ] Update Progress: 558/2369 symbols completed. CUK took 42.0s. Estimated remaining: 4h 23m 6s. Rate: 6.9 symbols/min [2025-09-17T03:05:10.872574] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T03:05:11.089095] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T03:05:11.093825] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-17T03:05:11.890139] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-17T03:05:12.294847] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T03:05:12.690120] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-17T03:05:12.920839] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T03:05:13.490190] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-17T03:05:13.858286] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T03:05:14.290149] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-17T03:05:14.383912] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T03:05:15.090169] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-17T03:05:15.441972] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:05:15.447715] [INFO ] [REMOTE ] CURB: Full fetch complete (47065 records). [2025-09-17T03:05:15.447838] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-17T03:05:15.840960] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-17T03:05:15.841084] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-17T03:05:15.841724] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-17T03:05:15.841804] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-17T03:05:15.842881] [DEBUG] [LOCAL ] CURB: Trimmed 47065 records to 33001 (keeping 200 days of data) [2025-09-17T03:05:16.047038] [DEBUG] [LOCAL ] CURB: Primary data saved (33001 records). [2025-09-17T03:05:16.047205] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-17T03:05:16.047315] [INFO ] [MAIN ] Update Progress: 559/2369 symbols completed. CURB took 23.8s. Estimated remaining: 4h 22m 46s. Rate: 6.9 symbols/min [2025-09-17T03:05:16.552717] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:05:16.560677] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-17T03:05:17.927772] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T03:05:17.934582] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-17T03:05:19.158229] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T03:05:19.163315] [INFO ] [REMOTE ] CURV: Full fetch complete (39828 records). [2025-09-17T03:05:19.163434] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-17T03:05:19.539154] [DEBUG] [VALIDATOR ] CURV: All expected trading days are present. [2025-09-17T03:05:19.539266] [DEBUG] [VALIDATOR ] CURV: Primary data validation passed. [2025-09-17T03:05:19.539814] [INFO ] [MAIN ] CURV: Fetched primary data is valid. [2025-09-17T03:05:19.539874] [DEBUG] [LOCAL ] CURV: Saving primary data. [2025-09-17T03:05:19.541160] [DEBUG] [LOCAL ] CURV: Trimmed 39828 records to 26461 (keeping 200 days of data) [2025-09-17T03:05:19.698535] [DEBUG] [LOCAL ] CURV: Primary data saved (26461 records). [2025-09-17T03:05:19.698714] [INFO ] [MAIN ] CURV: Full history saved. [2025-09-17T03:05:19.698814] [INFO ] [MAIN ] Update Progress: 560/2369 symbols completed. CURV took 26.1s. Estimated remaining: 4h 22m 21s. Rate: 6.9 symbols/min [2025-09-17T03:05:20.318792] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:20.298770] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:20.316802] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:20.395259] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:20.395786] [DEBUG] [LOCAL ] CVI: No existing data file found in primary storage. [2025-09-17T03:05:20.395847] [WARN ] [MAIN ] CVI: No existing data found, performing full refresh instead. [2025-09-17T03:05:20.395954] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-17T03:05:20.396004] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-17T03:05:20.396112] [DEBUG] [LOCAL ] CVI: No primary data file found to delete. [2025-09-17T03:05:20.396183] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-17T03:05:20.437064] [DEBUG] [LOCAL ] CVEO: Loaded 11755 existing records from primary storage. [2025-09-17T03:05:20.480736] [INFO ] [MAIN ] CVEO: Loaded 11755 existing records. [2025-09-17T03:05:20.825514] [DEBUG] [LOCAL ] CUZ: Loaded 36954 existing records from primary storage. [2025-09-17T03:05:20.847575] [DEBUG] [LOCAL ] CVE: Loaded 39924 existing records from primary storage. [2025-09-17T03:05:20.857928] [INFO ] [MAIN ] CUZ: Loaded 36954 existing records. [2025-09-17T03:05:20.878161] [INFO ] [MAIN ] CVE: Loaded 39924 existing records. [2025-09-17T03:05:21.138964] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:21.248775] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-17T03:05:21.297550] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-17T03:05:21.289011] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:21.355905] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-11. [2025-09-17T03:05:21.360114] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:21.395913] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:21.390575] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-17T03:05:21.396295] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-17T03:05:21.396558] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-17T03:05:21.396265] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-17T03:05:21.396730] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-17T03:05:21.396835] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-17T03:05:21.426689] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-17T03:05:21.432894] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-17T03:05:21.453423] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-17T03:05:21.453310] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-17T03:05:22.398345] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:22.419948] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-11. [2025-09-17T03:05:22.530222] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:22.551471] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-11. [2025-09-17T03:05:22.551036] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:22.552614] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-11. [2025-09-17T03:05:22.782981] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T03:05:22.793040] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-17T03:05:23.353525] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T03:05:23.356735] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-17T03:05:23.865501] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T03:05:23.875139] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-17T03:05:24.021518] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T03:05:24.031842] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-17T03:05:24.073838] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T03:05:24.084003] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-17T03:05:24.160288] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T03:05:24.690190] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-17T03:05:25.289388] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:05:25.358601] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:05:25.490087] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-17T03:05:25.530343] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T03:05:25.641984] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T03:05:26.290200] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-17T03:05:26.882765] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T03:05:27.090179] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-17T03:05:27.699096] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T03:05:27.890129] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-17T03:05:28.690193] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-17T03:05:28.932530] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T03:05:29.190158] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T03:05:29.245487] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T03:05:29.490175] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-17T03:05:30.290172] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-17T03:05:31.090124] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-17T03:05:31.285744] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:05:31.401117] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T03:05:31.890140] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-17T03:05:32.690129] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-17T03:05:32.762920] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T03:05:33.465925] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T03:05:33.490074] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-17T03:05:34.290165] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-17T03:05:34.563365] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T03:05:34.913033] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T03:05:35.090166] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-17T03:05:35.281460] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T03:05:35.890176] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-17T03:05:36.142905] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T03:05:36.690192] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-17T03:05:37.490187] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-17T03:05:37.734724] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T03:05:38.290158] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-17T03:05:38.321710] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T03:05:38.448309] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:05:39.090156] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-17T03:05:39.890140] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-17T03:05:40.015657] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T03:05:40.690137] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-17T03:05:40.720697] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:05:41.020418] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T03:05:41.490136] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-17T03:05:42.186773] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T03:05:42.290145] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-17T03:05:43.090140] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-17T03:05:43.278021] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:05:43.647815] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T03:05:43.865679] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T03:05:43.890085] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-17T03:05:44.498802] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T03:05:44.690172] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-17T03:05:45.490174] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-17T03:05:45.988732] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T03:05:46.290126] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-17T03:05:46.608340] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T03:05:47.090134] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-17T03:05:47.890111] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-17T03:05:47.891159] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T03:05:47.898869] [INFO ] [REMOTE ] CUZ: Full fetch complete (70507 records). [2025-09-17T03:05:47.899066] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-17T03:05:48.299187] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-17T03:05:48.299334] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-17T03:05:48.300278] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-17T03:05:48.300366] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-17T03:05:48.301892] [DEBUG] [LOCAL ] CUZ: Trimmed 70507 records to 49328 (keeping 200 days of data) [2025-09-17T03:05:48.619145] [DEBUG] [LOCAL ] CUZ: Primary data saved (49328 records). [2025-09-17T03:05:48.619366] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-17T03:05:48.619492] [INFO ] [MAIN ] Update Progress: 561/2369 symbols completed. CUZ took 28.9s. Estimated remaining: 4h 23m 18s. Rate: 6.9 symbols/min [2025-09-17T03:05:48.708598] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-17T03:05:48.818189] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:48.825157] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T03:05:48.827721] [INFO ] [REMOTE ] CVEO: Full fetch complete (20169 records). [2025-09-17T03:05:48.827823] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-17T03:05:48.944745] [DEBUG] [LOCAL ] CVLG: Loaded 11374 existing records from primary storage. [2025-09-17T03:05:48.950492] [INFO ] [MAIN ] CVLG: Loaded 11374 existing records. [2025-09-17T03:05:49.374393] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:49.409797] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-17T03:05:49.410045] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-17T03:05:49.409920] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-17T03:05:49.410460] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-17T03:05:49.410519] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-17T03:05:49.411043] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-17T03:05:49.411161] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-17T03:05:49.411210] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-17T03:05:49.480339] [DEBUG] [LOCAL ] CVEO: Trimmed 20169 records to 15752 (keeping 200 days of data) [2025-09-17T03:05:49.801889] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-17T03:05:49.872696] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-17T03:05:49.902120] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:49.915392] [DEBUG] [LOCAL ] CVEO: Primary data saved (15752 records). [2025-09-17T03:05:49.915515] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-17T03:05:49.915610] [INFO ] [MAIN ] Update Progress: 562/2369 symbols completed. CVEO took 30.2s. Estimated remaining: 4h 22m 45s. Rate: 6.9 symbols/min [2025-09-17T03:05:50.092792] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:50.132270] [DEBUG] [LOCAL ] CVNA: Loaded 39474 existing records from primary storage. [2025-09-17T03:05:50.132457] [INFO ] [MAIN ] CVNA: Loaded 39474 existing records. [2025-09-17T03:05:50.295039] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-11. [2025-09-17T03:05:50.318677] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:50.318860] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-17T03:05:50.318936] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-17T03:05:50.319941] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-17T03:05:50.320011] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-17T03:05:50.692783] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:50.721005] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T03:05:50.917574] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T03:05:51.090151] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-17T03:05:51.431933] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T03:05:51.890152] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-11. [2025-09-17T03:05:52.315685] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T03:05:52.361376] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T03:05:52.690155] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-17T03:05:53.490150] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-17T03:05:54.124815] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T03:05:54.130777] [INFO ] [REMOTE ] CVI: Full fetch complete (67039 records). [2025-09-17T03:05:54.130952] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-17T03:05:54.296493] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-17T03:05:54.521511] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-17T03:05:54.521633] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-17T03:05:54.522447] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-17T03:05:54.522509] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-17T03:05:54.524000] [DEBUG] [LOCAL ] CVI: Trimmed 67039 records to 46411 (keeping 200 days of data) [2025-09-17T03:05:54.850298] [DEBUG] [LOCAL ] CVI: Primary data saved (46411 records). [2025-09-17T03:05:54.850507] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-17T03:05:54.850611] [INFO ] [MAIN ] Update Progress: 563/2369 symbols completed. CVI took 35.2s. Estimated remaining: 4h 22m 24s. Rate: 6.9 symbols/min [2025-09-17T03:05:55.091150] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-17T03:05:55.177595] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:55.181985] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T03:05:55.193298] [INFO ] [REMOTE ] CVE: Full fetch complete (77391 records). [2025-09-17T03:05:55.193552] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-17T03:05:55.357280] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T03:05:55.441440] [DEBUG] [LOCAL ] CVS: Loaded 40048 existing records from primary storage. [2025-09-17T03:05:55.480281] [INFO ] [MAIN ] CVS: Loaded 40048 existing records. [2025-09-17T03:05:55.922977] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-17T03:05:55.985500] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:56.002128] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-17T03:05:56.070479] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-17T03:05:56.090813] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-17T03:05:56.090966] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-17T03:05:56.092258] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-17T03:05:56.092533] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-17T03:05:56.092701] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-17T03:05:56.092970] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-17T03:05:56.160904] [DEBUG] [LOCAL ] CVE: Trimmed 77391 records to 53560 (keeping 200 days of data) [2025-09-17T03:05:56.516347] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T03:05:56.708967] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-17T03:05:56.714452] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:56.837699] [DEBUG] [LOCAL ] CVE: Primary data saved (53560 records). [2025-09-17T03:05:56.837874] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-17T03:05:56.837973] [INFO ] [MAIN ] Update Progress: 564/2369 symbols completed. CVE took 37.1s. Estimated remaining: 4h 21m 54s. Rate: 6.9 symbols/min [2025-09-17T03:05:57.007199] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:05:57.018751] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:05:57.061544] [DEBUG] [LOCAL ] CVX: Loaded 40110 existing records from primary storage. [2025-09-17T03:05:57.061736] [INFO ] [MAIN ] CVX: Loaded 40110 existing records. [2025-09-17T03:05:57.238876] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:05:57.239128] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-17T03:05:57.239192] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-17T03:05:57.240082] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-17T03:05:57.240145] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-17T03:05:57.493257] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-17T03:05:57.600926] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:05:57.645618] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T03:05:58.290142] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-11. [2025-09-17T03:05:58.345491] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T03:05:59.090141] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-17T03:05:59.890167] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-17T03:06:00.035388] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T03:06:00.264607] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T03:06:00.643289] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T03:06:00.690135] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-17T03:06:01.490132] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-11. [2025-09-17T03:06:02.290134] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-17T03:06:03.090201] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-17T03:06:04.119152] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (3.43 seconds). [2025-09-17T03:06:04.132064] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-17T03:06:04.545875] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-17T03:06:04.690265] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-17T03:06:04.792945] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-11 (3.30 seconds). [2025-09-17T03:06:04.866559] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T03:06:05.490168] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-17T03:06:05.729078] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T03:06:06.144212] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T03:06:06.196964] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T03:06:06.290149] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-17T03:06:07.090172] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-17T03:06:07.462088] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T03:06:07.890127] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-17T03:06:08.538880] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T03:06:08.690158] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-17T03:06:08.778943] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T03:06:09.490117] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-17T03:06:09.527252] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T03:06:10.290178] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-17T03:06:10.854438] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T03:06:10.857327] [INFO ] [REMOTE ] CVLG: Full fetch complete (20182 records). [2025-09-17T03:06:10.857495] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-17T03:06:11.095362] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-17T03:06:11.244432] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-17T03:06:11.244537] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-17T03:06:11.244989] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-17T03:06:11.245052] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-17T03:06:11.245699] [DEBUG] [LOCAL ] CVLG: Trimmed 20182 records to 15371 (keeping 200 days of data) [2025-09-17T03:06:11.343524] [DEBUG] [LOCAL ] CVLG: Primary data saved (15371 records). [2025-09-17T03:06:11.343703] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-17T03:06:11.343824] [INFO ] [MAIN ] Update Progress: 565/2369 symbols completed. CVLG took 22.7s. Estimated remaining: 4h 22m 4s. Rate: 6.9 symbols/min [2025-09-17T03:06:11.517456] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:06:11.535543] [DEBUG] [LOCAL ] CW: Loaded 16921 existing records from primary storage. [2025-09-17T03:06:11.535736] [INFO ] [MAIN ] CW: Loaded 16921 existing records. [2025-09-17T03:06:11.712474] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:06:11.712801] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-17T03:06:11.712875] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-17T03:06:11.713504] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-17T03:06:11.713588] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-17T03:06:11.913086] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-17T03:06:11.998453] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-17T03:06:12.119131] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:06:12.637893] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T03:06:12.690075] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-17T03:06:13.119617] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T03:06:13.167762] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-17T03:06:13.490143] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-17T03:06:14.290166] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-11. [2025-09-17T03:06:15.090138] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-17T03:06:15.692137] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T03:06:15.890088] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-17T03:06:16.438522] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (2.95 seconds). [2025-09-17T03:06:16.526029] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T03:06:16.690084] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-17T03:06:17.490133] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-17T03:06:18.277383] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-17T03:06:18.290071] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-17T03:06:19.090124] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-17T03:06:19.643268] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T03:06:19.751689] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (3.06 seconds). [2025-09-17T03:06:19.890114] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-17T03:06:20.199279] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-17T03:06:20.690164] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-17T03:06:20.727577] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:06:20.944497] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T03:06:21.490147] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-17T03:06:22.290195] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-17T03:06:22.599784] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T03:06:22.606213] [INFO ] [REMOTE ] CVNA: Full fetch complete (76599 records). [2025-09-17T03:06:22.606392] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-17T03:06:23.014590] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-17T03:06:23.014823] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-17T03:06:23.015789] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-17T03:06:23.015857] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-17T03:06:23.017464] [DEBUG] [LOCAL ] CVNA: Trimmed 76599 records to 53080 (keeping 200 days of data) [2025-09-17T03:06:23.106996] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-17T03:06:23.342772] [DEBUG] [LOCAL ] CVNA: Primary data saved (53080 records). [2025-09-17T03:06:23.342939] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-17T03:06:23.343036] [INFO ] [MAIN ] Update Progress: 566/2369 symbols completed. CVNA took 33.4s. Estimated remaining: 4h 22m 5s. Rate: 6.9 symbols/min [2025-09-17T03:06:23.520556] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:06:23.520865] [DEBUG] [LOCAL ] CWAN: No existing data file found in primary storage. [2025-09-17T03:06:23.521003] [WARN ] [MAIN ] CWAN: No existing data found, performing full refresh instead. [2025-09-17T03:06:23.521142] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-17T03:06:23.521208] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-17T03:06:23.521306] [DEBUG] [LOCAL ] CWAN: No primary data file found to delete. [2025-09-17T03:06:23.521358] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-17T03:06:23.747465] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-17T03:06:23.895279] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-17T03:06:23.950320] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:06:24.344056] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T03:06:24.513578] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-17T03:06:24.690139] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-17T03:06:25.490131] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-17T03:06:25.698418] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T03:06:25.779072] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T03:06:26.290181] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-17T03:06:27.090172] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-11. [2025-09-17T03:06:27.895197] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-17T03:06:27.914918] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-17T03:06:28.400678] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T03:06:28.441745] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T03:06:28.690152] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-17T03:06:29.490143] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-17T03:06:29.536939] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T03:06:30.290144] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-17T03:06:30.952444] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T03:06:31.090148] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-17T03:06:31.142764] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T03:06:31.349431] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T03:06:31.890112] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-17T03:06:32.379296] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T03:06:32.690173] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-17T03:06:33.490129] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-17T03:06:34.085589] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-17T03:06:34.251493] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T03:06:34.290131] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-17T03:06:34.641837] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T03:06:35.090139] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-17T03:06:35.161970] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T03:06:35.890130] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-17T03:06:36.690130] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-17T03:06:37.201364] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-17T03:06:37.208035] [INFO ] [REMOTE ] CVX: Full fetch complete (77768 records). [2025-09-17T03:06:37.208274] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-17T03:06:37.492107] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-17T03:06:37.577106] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T03:06:37.614682] [INFO ] [REMOTE ] CW: Full fetch complete (33461 records). [2025-09-17T03:06:37.637483] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-17T03:06:37.637683] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-17T03:06:37.637795] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-17T03:06:37.638906] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-17T03:06:37.639054] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-17T03:06:37.742089] [DEBUG] [LOCAL ] CVX: Trimmed 77768 records to 53760 (keeping 200 days of data) [2025-09-17T03:06:38.306863] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-17T03:06:38.307918] [DEBUG] [VALIDATOR ] CW: All expected trading days are present. [2025-09-17T03:06:38.321404] [DEBUG] [VALIDATOR ] CW: Primary data validation passed. [2025-09-17T03:06:38.323738] [INFO ] [MAIN ] CW: Fetched primary data is valid. [2025-09-17T03:06:38.324384] [DEBUG] [LOCAL ] CW: Saving primary data. [2025-09-17T03:06:38.326750] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-17T03:06:38.330204] [DEBUG] [LOCAL ] CW: Trimmed 33461 records to 22793 (keeping 200 days of data) [2025-09-17T03:06:38.558340] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-09-17T03:06:38.560056] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-17T03:06:38.561920] [INFO ] [MAIN ] Update Progress: 567/2369 symbols completed. CVX took 41.7s. Estimated remaining: 4h 22m 17s. Rate: 6.9 symbols/min [2025-09-17T03:06:38.752992] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:06:38.777129] [DEBUG] [LOCAL ] CW: Primary data saved (22793 records). [2025-09-17T03:06:38.777308] [INFO ] [MAIN ] CW: Full history saved. [2025-09-17T03:06:38.777412] [INFO ] [MAIN ] Update Progress: 568/2369 symbols completed. CW took 27.4s. Estimated remaining: 4h 21m 42s. Rate: 6.9 symbols/min [2025-09-17T03:06:38.975331] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:06:38.976662] [DEBUG] [LOCAL ] CWH: No existing data file found in primary storage. [2025-09-17T03:06:38.976809] [WARN ] [MAIN ] CWH: No existing data found, performing full refresh instead. [2025-09-17T03:06:38.976729] [DEBUG] [LOCAL ] CWEN: Loaded 33122 existing records from primary storage. [2025-09-17T03:06:38.977057] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-17T03:06:38.976983] [INFO ] [MAIN ] CWEN: Loaded 33122 existing records. [2025-09-17T03:06:38.977127] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-17T03:06:39.044548] [DEBUG] [LOCAL ] CWH: No primary data file found to delete. [2025-09-17T03:06:39.065598] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-17T03:06:39.249158] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:06:39.286027] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-17T03:06:39.295005] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-17T03:06:39.374050] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-17T03:06:39.413091] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-17T03:06:39.661565] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:06:39.678090] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-11. [2025-09-17T03:06:39.860463] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-17T03:06:39.905156] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-17T03:06:39.977815] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:06:40.330005] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-17T03:06:40.337815] [INFO ] [REMOTE ] CVS: Full fetch complete (77701 records). [2025-09-17T03:06:40.338084] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-17T03:06:40.694218] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-11. [2025-09-17T03:06:40.736475] [DEBUG] [VALIDATOR ] CVS: All expected trading days are present. [2025-09-17T03:06:40.736582] [DEBUG] [VALIDATOR ] CVS: Primary data validation passed. [2025-09-17T03:06:40.737457] [INFO ] [MAIN ] CVS: Fetched primary data is valid. [2025-09-17T03:06:40.737516] [DEBUG] [LOCAL ] CVS: Saving primary data. [2025-09-17T03:06:40.739015] [DEBUG] [LOCAL ] CVS: Trimmed 77701 records to 53698 (keeping 200 days of data) [2025-09-17T03:06:41.094595] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:06:41.125575] [DEBUG] [LOCAL ] CVS: Primary data saved (53698 records). [2025-09-17T03:06:41.125770] [INFO ] [MAIN ] CVS: Full history saved. [2025-09-17T03:06:41.125890] [INFO ] [MAIN ] Update Progress: 569/2369 symbols completed. CVS took 46.3s. Estimated remaining: 4h 21m 13s. Rate: 6.9 symbols/min [2025-09-17T03:06:41.299683] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:06:41.332568] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T03:06:41.371411] [DEBUG] [LOCAL ] CWK: Loaded 36655 existing records from primary storage. [2025-09-17T03:06:41.371597] [INFO ] [MAIN ] CWK: Loaded 36655 existing records. [2025-09-17T03:06:41.495244] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-17T03:06:41.551793] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:06:41.552594] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-17T03:06:41.552680] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-17T03:06:41.553579] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-17T03:06:41.553668] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-17T03:06:41.916729] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:06:42.300454] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-17T03:06:42.303231] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T03:06:42.906638] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:06:43.090145] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-17T03:06:43.890112] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-17T03:06:43.926113] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:06:44.383741] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T03:06:44.690139] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-17T03:06:45.321384] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:06:45.490122] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-11. [2025-09-17T03:06:46.290135] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-17T03:06:46.687682] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T03:06:46.786890] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T03:06:47.090153] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-17T03:06:47.890150] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-17T03:06:48.060206] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T03:06:48.587105] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T03:06:48.690110] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-17T03:06:49.101928] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T03:06:49.490174] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-17T03:06:50.188663] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T03:06:50.290113] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-17T03:06:51.090130] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-17T03:06:51.295294] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T03:06:51.465943] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T03:06:51.890167] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-17T03:06:52.343586] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T03:06:52.690146] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-17T03:06:53.497053] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-17T03:06:53.516997] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:06:54.295206] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-17T03:06:54.314195] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T03:06:55.090165] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-17T03:06:55.141319] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T03:06:55.897496] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-17T03:06:55.920617] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T03:06:56.514124] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T03:06:56.690131] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-17T03:06:57.493022] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T03:06:57.490153] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-17T03:06:57.990632] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T03:06:58.290158] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-17T03:06:59.090158] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-17T03:06:59.127810] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:06:59.791189] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T03:06:59.890090] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-17T03:07:00.690203] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-17T03:07:00.962264] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T03:07:01.325920] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T03:07:01.490149] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-17T03:07:02.290219] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-17T03:07:02.320794] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:07:03.077293] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:07:03.083289] [INFO ] [REMOTE ] CWH: Full fetch complete (72436 records). [2025-09-17T03:07:03.083448] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-17T03:07:03.096148] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-17T03:07:03.474001] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-17T03:07:03.474114] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-17T03:07:03.475038] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-17T03:07:03.475111] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-17T03:07:03.476515] [DEBUG] [LOCAL ] CWH: Trimmed 72436 records to 51418 (keeping 200 days of data) [2025-09-17T03:07:03.792803] [DEBUG] [LOCAL ] CWH: Primary data saved (51418 records). [2025-09-17T03:07:03.792977] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-17T03:07:03.793093] [INFO ] [MAIN ] Update Progress: 570/2369 symbols completed. CWH took 25.0s. Estimated remaining: 4h 21m 48s. Rate: 6.9 symbols/min [2025-09-17T03:07:03.893376] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-17T03:07:03.965274] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:03.984973] [DEBUG] [LOCAL ] CWT: Loaded 20240 existing records from primary storage. [2025-09-17T03:07:03.985122] [INFO ] [MAIN ] CWT: Loaded 20240 existing records. [2025-09-17T03:07:04.169767] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:04.170135] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-17T03:07:04.170274] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-17T03:07:04.180786] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-17T03:07:04.195010] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-17T03:07:04.300887] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T03:07:04.563689] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:04.690092] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-11. [2025-09-17T03:07:04.995466] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:07:05.191560] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:07:05.490114] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-17T03:07:06.025305] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T03:07:06.290155] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-17T03:07:06.808163] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T03:07:07.090211] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-17T03:07:07.562709] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T03:07:07.890184] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-17T03:07:08.299864] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:07:08.305331] [INFO ] [REMOTE ] CWEN: Full fetch complete (64105 records). [2025-09-17T03:07:08.305466] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-17T03:07:08.697382] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-17T03:07:08.698245] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-17T03:07:08.699672] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-17T03:07:08.700579] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-17T03:07:08.700668] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-17T03:07:08.702118] [DEBUG] [LOCAL ] CWEN: Trimmed 64105 records to 45036 (keeping 200 days of data) [2025-09-17T03:07:08.828582] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T03:07:09.009742] [DEBUG] [LOCAL ] CWEN: Primary data saved (45036 records). [2025-09-17T03:07:09.009969] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-17T03:07:09.010131] [INFO ] [MAIN ] Update Progress: 571/2369 symbols completed. CWEN took 30.4s. Estimated remaining: 4h 21m 28s. Rate: 6.9 symbols/min [2025-09-17T03:07:09.180768] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:09.216933] [DEBUG] [LOCAL ] CX: Loaded 39346 existing records from primary storage. [2025-09-17T03:07:09.217100] [INFO ] [MAIN ] CX: Loaded 39346 existing records. [2025-09-17T03:07:09.393824] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:09.394063] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-17T03:07:09.394113] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-17T03:07:09.394890] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-17T03:07:09.394958] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-17T03:07:09.495044] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-17T03:07:09.760081] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:09.911028] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T03:07:10.290189] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-17T03:07:11.095561] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-17T03:07:11.108239] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T03:07:11.119938] [INFO ] [REMOTE ] CWAN: Full fetch complete (74881 records). [2025-09-17T03:07:11.120197] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-17T03:07:11.520068] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-17T03:07:11.520184] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-17T03:07:11.521296] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-17T03:07:11.521383] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-17T03:07:11.522957] [DEBUG] [LOCAL ] CWAN: Trimmed 74881 records to 52389 (keeping 200 days of data) [2025-09-17T03:07:11.787817] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T03:07:11.886115] [DEBUG] [LOCAL ] CWAN: Primary data saved (52389 records). [2025-09-17T03:07:11.886292] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-17T03:07:11.886383] [INFO ] [MAIN ] Update Progress: 572/2369 symbols completed. CWAN took 48.5s. Estimated remaining: 4h 21m 1s. Rate: 6.9 symbols/min [2025-09-17T03:07:11.897918] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-17T03:07:12.065023] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:12.071250] [DEBUG] [LOCAL ] CXE: Loaded 4683 existing records from primary storage. [2025-09-17T03:07:12.071397] [INFO ] [MAIN ] CXE: Loaded 4683 existing records. [2025-09-17T03:07:12.263961] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:12.264265] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-17T03:07:12.264333] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-17T03:07:12.264614] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-17T03:07:12.264768] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-17T03:07:12.635448] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T03:07:12.639085] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:12.690116] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-11. [2025-09-17T03:07:13.350585] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:07:13.490128] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-17T03:07:14.290167] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-11. [2025-09-17T03:07:14.517821] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T03:07:14.582854] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T03:07:14.847818] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T03:07:15.090143] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-17T03:07:15.890142] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-17T03:07:16.690201] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-17T03:07:16.891538] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T03:07:17.449753] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T03:07:17.490099] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-17T03:07:17.647668] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:07:18.290139] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-17T03:07:19.035072] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T03:07:19.090090] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-17T03:07:19.243654] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T03:07:19.613494] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T03:07:19.890124] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-17T03:07:20.690153] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-17T03:07:20.986703] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T03:07:21.490194] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-17T03:07:21.934037] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T03:07:22.290143] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-17T03:07:22.736292] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T03:07:22.743031] [INFO ] [REMOTE ] CWK: Full fetch complete (70633 records). [2025-09-17T03:07:22.743235] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-17T03:07:23.095222] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-17T03:07:23.144041] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-17T03:07:23.144143] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-17T03:07:23.144993] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-17T03:07:23.145051] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-17T03:07:23.146885] [DEBUG] [LOCAL ] CWK: Trimmed 70633 records to 49395 (keeping 200 days of data) [2025-09-17T03:07:23.443088] [DEBUG] [LOCAL ] CWK: Primary data saved (49395 records). [2025-09-17T03:07:23.443248] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-17T03:07:23.443360] [INFO ] [MAIN ] Update Progress: 573/2369 symbols completed. CWK took 42.3s. Estimated remaining: 4h 21m 1s. Rate: 6.9 symbols/min [2025-09-17T03:07:23.613386] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:23.620629] [DEBUG] [LOCAL ] CXH: Loaded 3921 existing records from primary storage. [2025-09-17T03:07:23.620807] [INFO ] [MAIN ] CXH: Loaded 3921 existing records. [2025-09-17T03:07:23.805543] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:23.805827] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-17T03:07:23.805898] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-17T03:07:23.806168] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-17T03:07:23.806228] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-17T03:07:23.898118] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-17T03:07:24.177591] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:24.207200] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T03:07:24.591322] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:07:24.612893] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T03:07:24.690140] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-11. [2025-09-17T03:07:25.195058] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T03:07:25.490118] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-17T03:07:25.938453] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T03:07:26.290142] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-17T03:07:26.785780] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T03:07:27.090138] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-17T03:07:27.890159] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-17T03:07:28.468047] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:07:28.594491] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T03:07:28.690144] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-17T03:07:29.490147] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-17T03:07:29.875505] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-17T03:07:29.899864] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T03:07:30.290154] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-17T03:07:30.620232] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T03:07:31.090198] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-17T03:07:31.890216] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-17T03:07:32.360996] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T03:07:32.403659] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T03:07:32.690145] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-17T03:07:33.490152] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-17T03:07:34.206228] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T03:07:34.290140] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-17T03:07:34.332892] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T03:07:34.794827] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T03:07:35.090149] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-17T03:07:35.890137] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-17T03:07:36.290582] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-17T03:07:36.690197] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-17T03:07:37.343345] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T03:07:37.345860] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-17T03:07:37.347865] [INFO ] [REMOTE ] CXE: Full fetch complete (11859 records). [2025-09-17T03:07:37.358829] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-17T03:07:37.506234] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-17T03:07:37.730956] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-17T03:07:37.731066] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-17T03:07:37.731390] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-17T03:07:37.731476] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-17T03:07:37.731980] [DEBUG] [LOCAL ] CXE: Trimmed 11859 records to 7151 (keeping 200 days of data) [2025-09-17T03:07:37.776048] [DEBUG] [LOCAL ] CXE: Primary data saved (7151 records). [2025-09-17T03:07:37.776227] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-17T03:07:37.776338] [INFO ] [MAIN ] Update Progress: 574/2369 symbols completed. CXE took 25.9s. Estimated remaining: 4h 21m 10s. Rate: 6.9 symbols/min [2025-09-17T03:07:37.949123] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:37.986664] [DEBUG] [LOCAL ] CXM: Loaded 35428 existing records from primary storage. [2025-09-17T03:07:37.986877] [INFO ] [MAIN ] CXM: Loaded 35428 existing records. [2025-09-17T03:07:38.177826] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T03:07:38.184147] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:38.185121] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-17T03:07:38.185187] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-17T03:07:38.186103] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-17T03:07:38.186167] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-17T03:07:38.295325] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-17T03:07:38.544408] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:39.090202] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-17T03:07:39.225875] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T03:07:39.890132] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-17T03:07:40.447666] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T03:07:40.690134] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-17T03:07:40.896452] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T03:07:41.281053] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T03:07:41.490136] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-11. [2025-09-17T03:07:42.290138] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-17T03:07:42.791788] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T03:07:43.004999] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T03:07:43.008941] [INFO ] [REMOTE ] CWT: Full fetch complete (40126 records). [2025-09-17T03:07:43.009065] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-17T03:07:43.090115] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-17T03:07:43.383654] [DEBUG] [VALIDATOR ] CWT: All expected trading days are present. [2025-09-17T03:07:43.383755] [DEBUG] [VALIDATOR ] CWT: Primary data validation passed. [2025-09-17T03:07:43.384296] [INFO ] [MAIN ] CWT: Fetched primary data is valid. [2025-09-17T03:07:43.384349] [DEBUG] [LOCAL ] CWT: Saving primary data. [2025-09-17T03:07:43.385335] [DEBUG] [LOCAL ] CWT: Trimmed 40126 records to 27984 (keeping 200 days of data) [2025-09-17T03:07:43.557202] [DEBUG] [LOCAL ] CWT: Primary data saved (27984 records). [2025-09-17T03:07:43.557365] [INFO ] [MAIN ] CWT: Full history saved. [2025-09-17T03:07:43.557463] [INFO ] [MAIN ] Update Progress: 575/2369 symbols completed. CWT took 39.8s. Estimated remaining: 4h 20m 52s. Rate: 6.9 symbols/min [2025-09-17T03:07:43.727864] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:43.749666] [DEBUG] [LOCAL ] CXT: Loaded 22307 existing records from primary storage. [2025-09-17T03:07:43.749835] [INFO ] [MAIN ] CXT: Loaded 22307 existing records. [2025-09-17T03:07:43.899953] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-17T03:07:43.928800] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:43.928965] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-17T03:07:43.929023] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-17T03:07:43.929691] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-17T03:07:43.929753] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-17T03:07:44.287498] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:44.690136] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-17T03:07:44.737837] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T03:07:45.256307] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T03:07:45.490149] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-17T03:07:45.871355] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T03:07:46.290156] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-17T03:07:46.889892] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T03:07:47.090195] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-11. [2025-09-17T03:07:47.890114] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-17T03:07:47.920234] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T03:07:48.690139] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-17T03:07:49.205119] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (3.71 seconds). [2025-09-17T03:07:49.261495] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T03:07:49.262981] [INFO ] [REMOTE ] CXH: Full fetch complete (5536 records). [2025-09-17T03:07:49.263067] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-17T03:07:49.490212] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-17T03:07:49.621503] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-17T03:07:49.621614] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-17T03:07:49.621831] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-17T03:07:49.621901] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-17T03:07:49.622313] [DEBUG] [LOCAL ] CXH: Trimmed 5536 records to 4413 (keeping 200 days of data) [2025-09-17T03:07:49.648674] [DEBUG] [LOCAL ] CXH: Primary data saved (4413 records). [2025-09-17T03:07:49.648908] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-17T03:07:49.649036] [INFO ] [MAIN ] Update Progress: 576/2369 symbols completed. CXH took 26.2s. Estimated remaining: 4h 20m 35s. Rate: 6.9 symbols/min [2025-09-17T03:07:49.820143] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:49.820440] [DEBUG] [LOCAL ] CXW: No existing data file found in primary storage. [2025-09-17T03:07:49.820500] [WARN ] [MAIN ] CXW: No existing data found, performing full refresh instead. [2025-09-17T03:07:49.820676] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-17T03:07:49.820727] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-17T03:07:49.820771] [DEBUG] [LOCAL ] CXW: No primary data file found to delete. [2025-09-17T03:07:49.820812] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-17T03:07:49.962054] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T03:07:50.218148] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:50.290159] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-11. [2025-09-17T03:07:50.635262] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T03:07:51.090186] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-17T03:07:51.890177] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-17T03:07:52.156049] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T03:07:52.450959] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T03:07:52.457851] [INFO ] [REMOTE ] CX: Full fetch complete (76208 records). [2025-09-17T03:07:52.458085] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-17T03:07:52.695279] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-17T03:07:52.881003] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-17T03:07:52.881131] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-17T03:07:52.882003] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-17T03:07:52.882069] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-17T03:07:52.883684] [DEBUG] [LOCAL ] CX: Trimmed 76208 records to 52846 (keeping 200 days of data) [2025-09-17T03:07:53.208815] [DEBUG] [LOCAL ] CX: Primary data saved (52846 records). [2025-09-17T03:07:53.209004] [INFO ] [MAIN ] CX: Full history saved. [2025-09-17T03:07:53.209112] [INFO ] [MAIN ] Update Progress: 577/2369 symbols completed. CX took 44.2s. Estimated remaining: 4h 20m 11s. Rate: 6.9 symbols/min [2025-09-17T03:07:53.399464] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:07:53.436910] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T03:07:53.456087] [DEBUG] [LOCAL ] CYD: Loaded 19154 existing records from primary storage. [2025-09-17T03:07:53.456728] [INFO ] [MAIN ] CYD: Loaded 19154 existing records. [2025-09-17T03:07:53.497093] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-17T03:07:53.685268] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:07:53.685540] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-17T03:07:53.685604] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-17T03:07:53.686233] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-17T03:07:53.686297] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-17T03:07:54.042920] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:07:54.070377] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T03:07:54.290170] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-11. [2025-09-17T03:07:54.523970] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T03:07:54.962205] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T03:07:55.090116] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-17T03:07:55.890185] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-17T03:07:55.962182] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T03:07:56.565592] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T03:07:56.690129] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-17T03:07:57.490142] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-17T03:07:58.176078] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T03:07:58.290114] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-17T03:07:58.957739] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T03:07:59.090179] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-17T03:07:59.665582] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T03:07:59.773918] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T03:07:59.890207] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-17T03:08:00.690156] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-17T03:08:01.490135] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-17T03:08:01.557958] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T03:08:02.290180] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-17T03:08:02.499878] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T03:08:03.070176] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T03:08:03.090104] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-17T03:08:03.387129] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T03:08:03.890134] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-17T03:08:04.690218] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-17T03:08:05.490214] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-17T03:08:06.094545] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T03:08:06.290151] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-17T03:08:06.334501] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T03:08:07.090225] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-17T03:08:07.185153] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (4.10 seconds). [2025-09-17T03:08:07.862371] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T03:08:07.890095] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-17T03:08:08.471561] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T03:08:08.690122] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-17T03:08:09.013157] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (5.12 seconds). [2025-09-17T03:08:09.490133] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-17T03:08:09.618162] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T03:08:09.970875] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T03:08:10.290117] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-17T03:08:11.007118] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T03:08:11.090092] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-17T03:08:11.890137] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-17T03:08:12.436226] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T03:08:12.690140] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-17T03:08:13.065036] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T03:08:13.490166] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-17T03:08:13.749253] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T03:08:14.290149] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-17T03:08:14.765420] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:08:15.090134] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-17T03:08:15.172061] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T03:08:15.890130] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-17T03:08:16.690140] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-17T03:08:16.746294] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T03:08:16.801063] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T03:08:17.490155] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-17T03:08:17.595732] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (7.31 seconds). [2025-09-17T03:08:18.127721] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T03:08:18.133614] [INFO ] [REMOTE ] CXM: Full fetch complete (68954 records). [2025-09-17T03:08:18.133776] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-17T03:08:18.292497] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-17T03:08:18.529163] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-17T03:08:18.529306] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-17T03:08:18.530112] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-17T03:08:18.530193] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-17T03:08:18.531692] [DEBUG] [LOCAL ] CXM: Trimmed 68954 records to 47979 (keeping 200 days of data) [2025-09-17T03:08:18.817148] [DEBUG] [LOCAL ] CXM: Primary data saved (47979 records). [2025-09-17T03:08:18.817320] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-17T03:08:18.817430] [INFO ] [MAIN ] Update Progress: 578/2369 symbols completed. CXM took 41.0s. Estimated remaining: 4h 20m 54s. Rate: 6.9 symbols/min [2025-09-17T03:08:18.990473] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:19.023906] [DEBUG] [LOCAL ] CYH: Loaded 35832 existing records from primary storage. [2025-09-17T03:08:19.024073] [INFO ] [MAIN ] CYH: Loaded 35832 existing records. [2025-09-17T03:08:19.093595] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-17T03:08:19.232383] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:19.235225] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-17T03:08:19.235479] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-17T03:08:19.237045] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T03:08:19.245966] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-17T03:08:19.246400] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-17T03:08:19.624264] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:19.688859] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T03:08:19.890131] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-11. [2025-09-17T03:08:20.370327] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:08:20.374370] [INFO ] [REMOTE ] CXT: Full fetch complete (44653 records). [2025-09-17T03:08:20.374502] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-17T03:08:20.699286] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-17T03:08:20.752542] [DEBUG] [VALIDATOR ] CXT: All expected trading days are present. [2025-09-17T03:08:20.752657] [DEBUG] [VALIDATOR ] CXT: Primary data validation passed. [2025-09-17T03:08:20.753232] [INFO ] [MAIN ] CXT: Fetched primary data is valid. [2025-09-17T03:08:20.753287] [DEBUG] [LOCAL ] CXT: Saving primary data. [2025-09-17T03:08:20.754351] [DEBUG] [LOCAL ] CXT: Trimmed 44653 records to 30981 (keeping 200 days of data) [2025-09-17T03:08:20.943186] [DEBUG] [LOCAL ] CXT: Primary data saved (30981 records). [2025-09-17T03:08:20.943335] [INFO ] [MAIN ] CXT: Full history saved. [2025-09-17T03:08:20.943430] [INFO ] [MAIN ] Update Progress: 579/2369 symbols completed. CXT took 37.4s. Estimated remaining: 4h 20m 25s. Rate: 6.9 symbols/min [2025-09-17T03:08:21.115288] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:21.152504] [DEBUG] [LOCAL ] D: Loaded 40007 existing records from primary storage. [2025-09-17T03:08:21.152708] [INFO ] [MAIN ] D: Loaded 40007 existing records. [2025-09-17T03:08:21.330557] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:21.330828] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-17T03:08:21.330887] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-17T03:08:21.331741] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-17T03:08:21.331803] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-17T03:08:21.496330] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-17T03:08:21.709840] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:21.737024] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T03:08:22.125825] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T03:08:22.290135] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-17T03:08:22.670550] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T03:08:22.675893] [INFO ] [REMOTE ] CXW: Full fetch complete (65089 records). [2025-09-17T03:08:22.676091] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-17T03:08:23.082467] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-17T03:08:23.082591] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-17T03:08:23.083341] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-17T03:08:23.083407] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-17T03:08:23.084833] [DEBUG] [LOCAL ] CXW: Trimmed 65089 records to 44708 (keeping 200 days of data) [2025-09-17T03:08:23.137412] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-17T03:08:23.357879] [DEBUG] [LOCAL ] CXW: Primary data saved (44708 records). [2025-09-17T03:08:23.358174] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-17T03:08:23.358266] [INFO ] [MAIN ] Update Progress: 580/2369 symbols completed. CXW took 33.7s. Estimated remaining: 4h 19m 57s. Rate: 6.9 symbols/min [2025-09-17T03:08:23.527958] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:23.537440] [DEBUG] [LOCAL ] DAC: Loaded 9052 existing records from primary storage. [2025-09-17T03:08:23.537580] [INFO ] [MAIN ] DAC: Loaded 9052 existing records. [2025-09-17T03:08:23.715458] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:23.715827] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-17T03:08:23.716115] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-17T03:08:23.716722] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-17T03:08:23.716800] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-17T03:08:23.893728] [INFO ] [REMOTE ] D: Fetching primary data for 2024-11. [2025-09-17T03:08:23.964385] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T03:08:24.140067] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:24.141165] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T03:08:24.145167] [INFO ] [REMOTE ] CYD: Full fetch complete (30948 records). [2025-09-17T03:08:24.145258] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-17T03:08:24.528878] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-17T03:08:24.529041] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-17T03:08:24.529538] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-17T03:08:24.529613] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-17T03:08:24.530525] [DEBUG] [LOCAL ] CYD: Trimmed 30948 records to 26833 (keeping 200 days of data) [2025-09-17T03:08:24.694149] [DEBUG] [LOCAL ] CYD: Primary data saved (26833 records). [2025-09-17T03:08:24.690950] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-11. [2025-09-17T03:08:24.694609] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-17T03:08:24.695666] [INFO ] [MAIN ] Update Progress: 581/2369 symbols completed. CYD took 31.5s. Estimated remaining: 4h 19m 25s. Rate: 6.9 symbols/min [2025-09-17T03:08:24.874175] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:24.911808] [DEBUG] [LOCAL ] DAL: Loaded 40103 existing records from primary storage. [2025-09-17T03:08:24.911977] [INFO ] [MAIN ] DAL: Loaded 40103 existing records. [2025-09-17T03:08:25.095942] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:25.096206] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-17T03:08:25.096267] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-17T03:08:25.097154] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-17T03:08:25.097245] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-17T03:08:25.471110] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:25.490087] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-17T03:08:25.558075] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T03:08:25.753159] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T03:08:26.290145] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-17T03:08:27.090174] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-17T03:08:27.182311] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T03:08:27.890235] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-17T03:08:27.892185] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T03:08:28.690176] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-17T03:08:29.490166] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-11. [2025-09-17T03:08:31.513624] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T03:08:31.524158] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-17T03:08:32.145554] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (5.06 seconds). [2025-09-17T03:08:32.150041] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-17T03:08:33.279589] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T03:08:33.284350] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-17T03:08:33.418656] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T03:08:33.430578] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-17T03:08:34.029699] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (6.14 seconds). [2025-09-17T03:08:34.039906] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-17T03:08:34.306989] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T03:08:34.310674] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-17T03:08:35.187165] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T03:08:35.190731] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-17T03:08:35.263113] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T03:08:35.732104] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (7.04 seconds). [2025-09-17T03:08:35.890146] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-17T03:08:36.690134] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-17T03:08:37.154715] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (3.72 seconds). [2025-09-17T03:08:37.490169] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-17T03:08:37.503870] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-17T03:08:38.084024] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T03:08:38.290139] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-17T03:08:38.614755] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (2.72 seconds). [2025-09-17T03:08:38.935121] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T03:08:39.090139] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-17T03:08:39.890142] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-17T03:08:40.487575] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T03:08:40.695481] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-17T03:08:40.701219] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T03:08:41.490148] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-17T03:08:41.623710] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T03:08:42.290124] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-17T03:08:42.743148] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (5.25 seconds). [2025-09-17T03:08:43.090165] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-17T03:08:43.133714] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T03:08:43.868963] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:08:43.890117] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-17T03:08:44.001208] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T03:08:44.690137] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-17T03:08:45.167504] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:08:45.490128] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-17T03:08:46.290174] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-17T03:08:46.745194] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T03:08:47.099509] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-17T03:08:47.107254] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T03:08:47.130140] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T03:08:47.131949] [INFO ] [REMOTE ] DAC: Full fetch complete (20164 records). [2025-09-17T03:08:47.132141] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-17T03:08:47.493931] [DEBUG] [VALIDATOR ] DAC: All expected trading days are present. [2025-09-17T03:08:47.494038] [DEBUG] [VALIDATOR ] DAC: Primary data validation passed. [2025-09-17T03:08:47.494409] [INFO ] [MAIN ] DAC: Fetched primary data is valid. [2025-09-17T03:08:47.494460] [DEBUG] [LOCAL ] DAC: Saving primary data. [2025-09-17T03:08:47.495075] [DEBUG] [LOCAL ] DAC: Trimmed 20164 records to 12820 (keeping 200 days of data) [2025-09-17T03:08:47.574077] [DEBUG] [LOCAL ] DAC: Primary data saved (12820 records). [2025-09-17T03:08:47.574232] [INFO ] [MAIN ] DAC: Full history saved. [2025-09-17T03:08:47.574326] [INFO ] [MAIN ] Update Progress: 582/2369 symbols completed. DAC took 24.2s. Estimated remaining: 4h 20m 0s. Rate: 6.9 symbols/min [2025-09-17T03:08:47.741109] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:47.776605] [DEBUG] [LOCAL ] DAN: Loaded 36555 existing records from primary storage. [2025-09-17T03:08:47.776935] [INFO ] [MAIN ] DAN: Loaded 36555 existing records. [2025-09-17T03:08:47.895271] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-17T03:08:47.959758] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:47.959977] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-17T03:08:47.960037] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-17T03:08:47.961031] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-17T03:08:47.961097] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-17T03:08:48.314978] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:48.690188] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-11. [2025-09-17T03:08:49.490186] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-17T03:08:49.562159] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.46 seconds). [2025-09-17T03:08:49.646984] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T03:08:49.869796] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T03:08:50.290160] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-17T03:08:51.090146] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-17T03:08:51.140008] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:08:51.890169] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-17T03:08:52.690185] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-17T03:08:53.322023] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T03:08:53.331174] [INFO ] [REMOTE ] CYH: Full fetch complete (70420 records). [2025-09-17T03:08:53.331438] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-17T03:08:53.451881] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-17T03:08:53.556919] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-17T03:08:54.019265] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-17T03:08:54.019483] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-17T03:08:54.020427] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-17T03:08:54.020705] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-17T03:08:54.059446] [DEBUG] [LOCAL ] CYH: Trimmed 70420 records to 48064 (keeping 200 days of data) [2025-09-17T03:08:54.061422] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (3.77 seconds). [2025-09-17T03:08:54.292878] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-17T03:08:54.321734] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:08:54.406060] [DEBUG] [LOCAL ] CYH: Primary data saved (48064 records). [2025-09-17T03:08:54.406242] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-17T03:08:54.406347] [INFO ] [MAIN ] Update Progress: 583/2369 symbols completed. CYH took 35.6s. Estimated remaining: 4h 19m 46s. Rate: 6.9 symbols/min [2025-09-17T03:08:54.576925] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:08:54.590710] [DEBUG] [LOCAL ] DAO: Loaded 13384 existing records from primary storage. [2025-09-17T03:08:54.590851] [INFO ] [MAIN ] DAO: Loaded 13384 existing records. [2025-09-17T03:08:54.765549] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:08:54.765803] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-17T03:08:54.765862] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-17T03:08:54.766425] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-17T03:08:54.766488] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-17T03:08:55.094885] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-17T03:08:55.119760] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:08:55.724578] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-17T03:08:55.890150] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-17T03:08:55.946055] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T03:08:56.554823] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:08:56.690182] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-17T03:08:57.490221] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-17T03:08:58.100551] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:08:58.295196] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-17T03:08:58.311910] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-17T03:08:59.090204] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-11. [2025-09-17T03:08:59.455579] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T03:08:59.737934] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T03:08:59.890123] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-17T03:09:00.100802] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T03:09:00.690141] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-17T03:09:01.443189] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T03:09:01.490148] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-17T03:09:02.140999] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:09:02.147599] [INFO ] [REMOTE ] D: Full fetch complete (77503 records). [2025-09-17T03:09:02.147811] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-17T03:09:02.295290] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-17T03:09:02.564305] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-17T03:09:02.564442] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-17T03:09:02.565465] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-17T03:09:02.565543] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-17T03:09:02.567226] [DEBUG] [LOCAL ] D: Trimmed 77503 records to 53647 (keeping 200 days of data) [2025-09-17T03:09:02.921841] [DEBUG] [LOCAL ] D: Primary data saved (53647 records). [2025-09-17T03:09:02.922029] [INFO ] [MAIN ] D: Full history saved. [2025-09-17T03:09:02.922154] [INFO ] [MAIN ] Update Progress: 584/2369 symbols completed. D took 42.0s. Estimated remaining: 4h 19m 36s. Rate: 6.9 symbols/min [2025-09-17T03:09:03.093941] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-17T03:09:03.095567] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:03.096823] [DEBUG] [LOCAL ] DAR: No existing data file found in primary storage. [2025-09-17T03:09:03.096892] [WARN ] [MAIN ] DAR: No existing data found, performing full refresh instead. [2025-09-17T03:09:03.097018] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-17T03:09:03.097072] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-17T03:09:03.097126] [DEBUG] [LOCAL ] DAR: No primary data file found to delete. [2025-09-17T03:09:03.097165] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-17T03:09:03.469269] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:03.890142] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-11. [2025-09-17T03:09:04.185387] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-17T03:09:04.473392] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-17T03:09:04.500071] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:09:04.690135] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-17T03:09:05.490182] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-17T03:09:05.539020] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T03:09:05.735975] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T03:09:06.290128] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-17T03:09:07.090100] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-17T03:09:07.191066] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T03:09:07.366487] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T03:09:07.890145] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-17T03:09:08.637229] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T03:09:08.643827] [INFO ] [REMOTE ] DAL: Full fetch complete (77714 records). [2025-09-17T03:09:08.644008] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-17T03:09:08.695371] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-17T03:09:09.058219] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-17T03:09:09.058485] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-17T03:09:09.059397] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-17T03:09:09.059597] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-17T03:09:09.081165] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T03:09:09.088701] [DEBUG] [LOCAL ] DAL: Trimmed 77714 records to 53753 (keeping 200 days of data) [2025-09-17T03:09:09.427559] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-09-17T03:09:09.427762] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-17T03:09:09.427867] [INFO ] [MAIN ] Update Progress: 585/2369 symbols completed. DAL took 44.7s. Estimated remaining: 4h 19m 21s. Rate: 6.9 symbols/min [2025-09-17T03:09:09.495311] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-17T03:09:09.600355] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:09.631065] [DEBUG] [LOCAL ] DAVA: Loaded 30657 existing records from primary storage. [2025-09-17T03:09:09.631232] [INFO ] [MAIN ] DAVA: Loaded 30657 existing records. [2025-09-17T03:09:09.810141] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:09:09.810394] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-17T03:09:09.810451] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-17T03:09:09.811254] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-17T03:09:09.811320] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-17T03:09:10.198276] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:10.228746] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T03:09:10.290076] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-17T03:09:10.846062] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T03:09:11.090145] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-17T03:09:11.563401] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:09:11.863961] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T03:09:11.890089] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-17T03:09:12.690142] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-11. [2025-09-17T03:09:13.154811] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T03:09:13.490136] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-17T03:09:14.132986] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:09:14.290159] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-17T03:09:14.982514] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T03:09:15.090154] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-17T03:09:15.890151] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-17T03:09:16.690186] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-17T03:09:18.035575] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-17T03:09:18.043335] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-17T03:09:18.401604] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T03:09:18.412879] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-17T03:09:18.704064] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (3.61 seconds). [2025-09-17T03:09:18.980595] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T03:09:19.090139] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-17T03:09:19.584767] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (5.29 seconds). [2025-09-17T03:09:19.858919] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T03:09:19.890082] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-17T03:09:20.409141] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:09:20.690126] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-17T03:09:21.490133] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-17T03:09:21.551955] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T03:09:22.172131] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T03:09:22.290114] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-17T03:09:22.744078] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T03:09:23.090132] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-17T03:09:23.561618] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T03:09:23.890128] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-17T03:09:24.538006] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:09:24.690096] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-17T03:09:25.122338] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T03:09:25.490185] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-17T03:09:25.976822] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T03:09:26.290143] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-17T03:09:26.543159] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T03:09:26.942495] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T03:09:27.090128] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-17T03:09:27.776234] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T03:09:27.890136] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-17T03:09:28.690182] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-17T03:09:29.073307] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T03:09:29.490169] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-17T03:09:29.962502] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T03:09:29.971852] [INFO ] [REMOTE ] DAR: Full fetch complete (74333 records). [2025-09-17T03:09:29.972087] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-17T03:09:30.295275] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-17T03:09:30.368736] [DEBUG] [VALIDATOR ] DAR: All expected trading days are present. [2025-09-17T03:09:30.368858] [DEBUG] [VALIDATOR ] DAR: Primary data validation passed. [2025-09-17T03:09:30.369691] [INFO ] [MAIN ] DAR: Fetched primary data is valid. [2025-09-17T03:09:30.369751] [DEBUG] [LOCAL ] DAR: Saving primary data. [2025-09-17T03:09:30.371288] [DEBUG] [LOCAL ] DAR: Trimmed 74333 records to 51810 (keeping 200 days of data) [2025-09-17T03:09:30.466745] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T03:09:30.470721] [INFO ] [REMOTE ] DAO: Full fetch complete (32466 records). [2025-09-17T03:09:30.471576] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-17T03:09:31.074206] [DEBUG] [VALIDATOR ] DAO: All expected trading days are present. [2025-09-17T03:09:31.074311] [DEBUG] [LOCAL ] DAR: Primary data saved (51810 records). [2025-09-17T03:09:31.074578] [INFO ] [MAIN ] DAR: Full history saved. [2025-09-17T03:09:31.074749] [INFO ] [MAIN ] Update Progress: 586/2369 symbols completed. DAR took 28.2s. Estimated remaining: 4h 19m 51s. Rate: 6.9 symbols/min [2025-09-17T03:09:31.074783] [DEBUG] [VALIDATOR ] DAO: Primary data validation passed. [2025-09-17T03:09:31.096343] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-17T03:09:31.120190] [INFO ] [MAIN ] DAO: Fetched primary data is valid. [2025-09-17T03:09:31.160881] [DEBUG] [LOCAL ] DAO: Saving primary data. [2025-09-17T03:09:31.253408] [DEBUG] [LOCAL ] DAO: Trimmed 32466 records to 21549 (keeping 200 days of data) [2025-09-17T03:09:31.256716] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:31.257183] [DEBUG] [LOCAL ] DAY: No existing data file found in primary storage. [2025-09-17T03:09:31.257244] [WARN ] [MAIN ] DAY: No existing data found, performing full refresh instead. [2025-09-17T03:09:31.257374] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-17T03:09:31.257605] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-17T03:09:31.257691] [DEBUG] [LOCAL ] DAY: No primary data file found to delete. [2025-09-17T03:09:31.257739] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-17T03:09:31.629005] [DEBUG] [LOCAL ] DAO: Primary data saved (21549 records). [2025-09-17T03:09:31.666548] [INFO ] [MAIN ] DAO: Full history saved. [2025-09-17T03:09:31.677515] [INFO ] [MAIN ] Update Progress: 587/2369 symbols completed. DAO took 37.3s. Estimated remaining: 4h 19m 18s. Rate: 6.9 symbols/min [2025-09-17T03:09:31.829294] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:31.894396] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-11. [2025-09-17T03:09:31.941422] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:31.968215] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T03:09:32.008536] [DEBUG] [LOCAL ] DB: Loaded 39078 existing records from primary storage. [2025-09-17T03:09:32.008719] [INFO ] [MAIN ] DB: Loaded 39078 existing records. [2025-09-17T03:09:32.190377] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:09:32.190696] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-17T03:09:32.190750] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-17T03:09:32.191675] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-17T03:09:32.191738] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-17T03:09:32.549865] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:32.565938] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T03:09:32.572560] [INFO ] [REMOTE ] DAN: Full fetch complete (70855 records). [2025-09-17T03:09:32.572714] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-17T03:09:32.695276] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-17T03:09:32.962689] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-17T03:09:32.962799] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-17T03:09:32.963607] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-17T03:09:32.963681] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-17T03:09:32.965314] [DEBUG] [LOCAL ] DAN: Trimmed 70855 records to 49040 (keeping 200 days of data) [2025-09-17T03:09:33.272604] [DEBUG] [LOCAL ] DAN: Primary data saved (49040 records). [2025-09-17T03:09:33.272872] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-17T03:09:33.273049] [INFO ] [MAIN ] Update Progress: 588/2369 symbols completed. DAN took 45.7s. Estimated remaining: 4h 18m 48s. Rate: 6.9 symbols/min [2025-09-17T03:09:33.442526] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:33.442760] [DEBUG] [LOCAL ] DBD: No existing data file found in primary storage. [2025-09-17T03:09:33.442814] [WARN ] [MAIN ] DBD: No existing data found, performing full refresh instead. [2025-09-17T03:09:33.442926] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-17T03:09:33.442969] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-17T03:09:33.443015] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-17T03:09:33.443064] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-17T03:09:33.504828] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-11. [2025-09-17T03:09:33.797513] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:33.831660] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T03:09:34.074343] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T03:09:34.080403] [INFO ] [REMOTE ] DAVA: Full fetch complete (54745 records). [2025-09-17T03:09:34.080558] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-17T03:09:34.295390] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-17T03:09:34.468142] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-17T03:09:34.468242] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-17T03:09:34.469210] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-17T03:09:34.469271] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-17T03:09:34.470529] [DEBUG] [LOCAL ] DAVA: Trimmed 54745 records to 40301 (keeping 200 days of data) [2025-09-17T03:09:34.708730] [DEBUG] [LOCAL ] DAVA: Primary data saved (40301 records). [2025-09-17T03:09:34.708887] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-17T03:09:34.709005] [INFO ] [MAIN ] Update Progress: 589/2369 symbols completed. DAVA took 25.3s. Estimated remaining: 4h 18m 17s. Rate: 6.9 symbols/min [2025-09-17T03:09:34.885574] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:34.917074] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T03:09:34.952636] [DEBUG] [LOCAL ] DBI: Loaded 33046 existing records from primary storage. [2025-09-17T03:09:34.952822] [INFO ] [MAIN ] DBI: Loaded 33046 existing records. [2025-09-17T03:09:35.095247] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-17T03:09:35.141324] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:09:35.141697] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-17T03:09:35.141790] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-17T03:09:35.142715] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-17T03:09:35.142802] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-17T03:09:35.505353] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:35.890215] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-11. [2025-09-17T03:09:35.958910] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:09:36.690164] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-17T03:09:36.723036] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T03:09:36.752012] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T03:09:37.490133] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-17T03:09:38.270167] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T03:09:38.290079] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-17T03:09:38.999600] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:09:39.090106] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-17T03:09:39.533779] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T03:09:39.890131] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-17T03:09:40.690150] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-11. [2025-09-17T03:09:40.833393] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T03:09:41.467247] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T03:09:41.490090] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-17T03:09:41.871081] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T03:09:42.290147] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-17T03:09:43.090142] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-17T03:09:43.260093] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:09:43.603425] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T03:09:43.890141] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-17T03:09:44.345657] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T03:09:44.690166] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-17T03:09:45.212842] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T03:09:45.490174] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-17T03:09:45.598139] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T03:09:46.290220] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-17T03:09:46.906494] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T03:09:47.090095] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-17T03:09:47.890131] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-17T03:09:48.026813] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T03:09:48.368945] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:09:48.690140] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-17T03:09:48.772612] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T03:09:49.490213] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-17T03:09:50.297927] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-17T03:09:50.303363] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T03:09:51.085337] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T03:09:51.095725] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-17T03:09:51.808989] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T03:09:51.838035] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T03:09:51.890119] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-17T03:09:52.690144] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-17T03:09:53.421989] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T03:09:53.490170] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-17T03:09:54.284003] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:09:54.294401] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-17T03:09:54.958801] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T03:09:54.981563] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T03:09:55.090127] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-17T03:09:55.890140] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-17T03:09:56.693811] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-17T03:09:56.701225] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T03:09:57.403726] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T03:09:57.411817] [INFO ] [REMOTE ] DAY: Full fetch complete (71679 records). [2025-09-17T03:09:57.412007] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-17T03:09:57.495238] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-17T03:09:57.810604] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-17T03:09:57.810740] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-17T03:09:57.811595] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-17T03:09:57.811671] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-17T03:09:57.813416] [DEBUG] [LOCAL ] DAY: Trimmed 71679 records to 50078 (keeping 200 days of data) [2025-09-17T03:09:57.933733] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T03:09:58.135583] [DEBUG] [LOCAL ] DAY: Primary data saved (50078 records). [2025-09-17T03:09:58.135772] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-17T03:09:58.135872] [INFO ] [MAIN ] Update Progress: 590/2369 symbols completed. DAY took 27.1s. Estimated remaining: 4h 18m 53s. Rate: 6.9 symbols/min [2025-09-17T03:09:58.290939] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-17T03:09:58.310265] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:09:58.310490] [DEBUG] [LOCAL ] DBL: No existing data file found in primary storage. [2025-09-17T03:09:58.310542] [WARN ] [MAIN ] DBL: No existing data found, performing full refresh instead. [2025-09-17T03:09:58.310684] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-17T03:09:58.310758] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-17T03:09:58.310813] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-09-17T03:09:58.310857] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-17T03:09:58.671138] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:09:59.095371] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-11. [2025-09-17T03:09:59.110271] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T03:09:59.172319] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T03:09:59.862115] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T03:09:59.890101] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-17T03:10:00.690149] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-17T03:10:01.490142] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-17T03:10:01.571866] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T03:10:02.290099] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-17T03:10:02.687733] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T03:10:02.733877] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T03:10:03.090186] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-17T03:10:03.840381] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T03:10:03.890131] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-17T03:10:03.928104] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T03:10:04.690211] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-17T03:10:05.437616] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T03:10:05.490130] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-17T03:10:05.732303] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T03:10:06.233166] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T03:10:06.290140] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-17T03:10:07.090192] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-17T03:10:07.669330] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T03:10:07.675218] [INFO ] [REMOTE ] DBI: Full fetch complete (66648 records). [2025-09-17T03:10:07.675381] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-17T03:10:07.899769] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-17T03:10:07.900574] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T03:10:08.098197] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-17T03:10:08.098302] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-17T03:10:08.099092] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-17T03:10:08.099153] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-17T03:10:08.100420] [DEBUG] [LOCAL ] DBI: Trimmed 66648 records to 45312 (keeping 200 days of data) [2025-09-17T03:10:08.364301] [DEBUG] [LOCAL ] DBI: Primary data saved (45312 records). [2025-09-17T03:10:08.364451] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-17T03:10:08.364557] [INFO ] [MAIN ] Update Progress: 591/2369 symbols completed. DBI took 33.7s. Estimated remaining: 4h 18m 48s. Rate: 6.9 symbols/min [2025-09-17T03:10:08.546262] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:08.581811] [DEBUG] [LOCAL ] DBRG: Loaded 36985 existing records from primary storage. [2025-09-17T03:10:08.582009] [INFO ] [MAIN ] DBRG: Loaded 36985 existing records. [2025-09-17T03:10:08.695271] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-17T03:10:08.763298] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:10:08.763544] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-17T03:10:08.763681] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-17T03:10:08.764590] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-17T03:10:08.764689] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-17T03:10:09.121331] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:09.139339] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T03:10:09.262177] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T03:10:09.490145] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-17T03:10:10.254040] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T03:10:10.290106] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-17T03:10:11.005415] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T03:10:11.090121] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-17T03:10:11.682208] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:10:11.890131] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-17T03:10:12.690138] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-17T03:10:12.948297] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T03:10:13.490178] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-11. [2025-09-17T03:10:14.290129] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-17T03:10:14.685382] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T03:10:14.991711] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T03:10:15.090124] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-17T03:10:15.265400] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T03:10:15.268763] [INFO ] [REMOTE ] DBD: Full fetch complete (30218 records). [2025-09-17T03:10:15.268882] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-17T03:10:15.646982] [DEBUG] [VALIDATOR ] DBD: All expected trading days are present. [2025-09-17T03:10:15.647094] [DEBUG] [VALIDATOR ] DBD: Primary data validation passed. [2025-09-17T03:10:15.647629] [INFO ] [MAIN ] DBD: Fetched primary data is valid. [2025-09-17T03:10:15.647711] [DEBUG] [LOCAL ] DBD: Saving primary data. [2025-09-17T03:10:15.648522] [DEBUG] [LOCAL ] DBD: Trimmed 30218 records to 23783 (keeping 200 days of data) [2025-09-17T03:10:15.789228] [DEBUG] [LOCAL ] DBD: Primary data saved (23783 records). [2025-09-17T03:10:15.789380] [INFO ] [MAIN ] DBD: Full history saved. [2025-09-17T03:10:15.789468] [INFO ] [MAIN ] Update Progress: 592/2369 symbols completed. DBD took 42.5s. Estimated remaining: 4h 18m 36s. Rate: 6.9 symbols/min [2025-09-17T03:10:15.890152] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-17T03:10:15.962163] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:15.988516] [DEBUG] [LOCAL ] DCI: Loaded 27450 existing records from primary storage. [2025-09-17T03:10:15.988701] [INFO ] [MAIN ] DCI: Loaded 27450 existing records. [2025-09-17T03:10:16.167634] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:10:16.167909] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-17T03:10:16.167967] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-17T03:10:16.168742] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-17T03:10:16.168804] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-17T03:10:16.527940] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:16.594728] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T03:10:16.690109] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-11. [2025-09-17T03:10:16.817463] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T03:10:17.490145] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-17T03:10:18.158788] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T03:10:18.290128] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-17T03:10:19.090123] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-17T03:10:19.214560] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T03:10:19.222493] [INFO ] [REMOTE ] DB: Full fetch complete (73743 records). [2025-09-17T03:10:19.222695] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-17T03:10:19.648333] [DEBUG] [VALIDATOR ] DB: All expected trading days are present. [2025-09-17T03:10:19.648455] [DEBUG] [VALIDATOR ] DB: Primary data validation passed. [2025-09-17T03:10:19.649280] [INFO ] [MAIN ] DB: Fetched primary data is valid. [2025-09-17T03:10:19.649342] [DEBUG] [LOCAL ] DB: Saving primary data. [2025-09-17T03:10:19.650910] [DEBUG] [LOCAL ] DB: Trimmed 73743 records to 52651 (keeping 200 days of data) [2025-09-17T03:10:19.892668] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-17T03:10:19.987314] [DEBUG] [LOCAL ] DB: Primary data saved (52651 records). [2025-09-17T03:10:19.987495] [INFO ] [MAIN ] DB: Full history saved. [2025-09-17T03:10:19.987605] [INFO ] [MAIN ] Update Progress: 593/2369 symbols completed. DB took 48.3s. Estimated remaining: 4h 18m 13s. Rate: 6.9 symbols/min [2025-09-17T03:10:20.163047] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:20.163288] [DEBUG] [LOCAL ] DCO: No existing data file found in primary storage. [2025-09-17T03:10:20.163535] [WARN ] [MAIN ] DCO: No existing data found, performing full refresh instead. [2025-09-17T03:10:20.163815] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-17T03:10:20.163959] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-17T03:10:20.164104] [DEBUG] [LOCAL ] DCO: No primary data file found to delete. [2025-09-17T03:10:20.164218] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-17T03:10:20.385702] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-17T03:10:20.487083] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T03:10:20.511438] [INFO ] [REMOTE ] DBL: Full fetch complete (12482 records). [2025-09-17T03:10:20.522296] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-17T03:10:20.657148] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:20.696414] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-17T03:10:20.878941] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T03:10:21.001442] [DEBUG] [VALIDATOR ] DBL: All expected trading days are present. [2025-09-17T03:10:21.001550] [DEBUG] [VALIDATOR ] DBL: Primary data validation passed. [2025-09-17T03:10:21.001883] [INFO ] [MAIN ] DBL: Fetched primary data is valid. [2025-09-17T03:10:21.001938] [DEBUG] [LOCAL ] DBL: Saving primary data. [2025-09-17T03:10:21.002476] [DEBUG] [LOCAL ] DBL: Trimmed 12482 records to 9038 (keeping 200 days of data) [2025-09-17T03:10:21.065151] [DEBUG] [LOCAL ] DBL: Primary data saved (9038 records). [2025-09-17T03:10:21.065314] [INFO ] [MAIN ] DBL: Full history saved. [2025-09-17T03:10:21.065425] [INFO ] [MAIN ] Update Progress: 594/2369 symbols completed. DBL took 22.9s. Estimated remaining: 4h 17m 42s. Rate: 6.9 symbols/min [2025-09-17T03:10:21.238759] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:21.283582] [DEBUG] [LOCAL ] DD: Loaded 39373 existing records from primary storage. [2025-09-17T03:10:21.283792] [INFO ] [MAIN ] DD: Loaded 39373 existing records. [2025-09-17T03:10:21.464145] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:10:21.464378] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-17T03:10:21.464436] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-17T03:10:21.465273] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-17T03:10:21.465338] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-17T03:10:21.496570] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-11. [2025-09-17T03:10:21.822982] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:22.112068] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T03:10:22.290138] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-11. [2025-09-17T03:10:22.480813] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T03:10:23.090138] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-17T03:10:23.560049] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T03:10:23.766434] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T03:10:23.890118] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-17T03:10:24.690179] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-17T03:10:25.370484] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T03:10:25.490095] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-17T03:10:25.937024] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T03:10:26.290138] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-17T03:10:26.312912] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T03:10:27.090091] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-17T03:10:27.740916] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T03:10:27.890179] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-17T03:10:28.600312] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:10:28.617918] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T03:10:28.690110] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-17T03:10:29.398425] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T03:10:29.490114] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-17T03:10:30.240411] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T03:10:30.290088] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-17T03:10:30.875611] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:10:31.090135] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-17T03:10:31.890131] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-17T03:10:32.690172] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-17T03:10:32.833577] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T03:10:33.490177] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-17T03:10:33.632568] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T03:10:33.697271] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T03:10:34.171141] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T03:10:34.290149] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-17T03:10:35.050148] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T03:10:35.090141] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-17T03:10:35.890135] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-17T03:10:36.511052] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T03:10:36.690170] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-17T03:10:36.882013] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T03:10:37.353885] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T03:10:37.359248] [INFO ] [REMOTE ] DCO: Full fetch complete (19537 records). [2025-09-17T03:10:37.359354] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-17T03:10:37.498089] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-17T03:10:37.725793] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-17T03:10:37.725898] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-17T03:10:37.726283] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-17T03:10:37.726333] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-17T03:10:37.726921] [DEBUG] [LOCAL ] DCO: Trimmed 19537 records to 13446 (keeping 200 days of data) [2025-09-17T03:10:37.808210] [DEBUG] [LOCAL ] DCO: Primary data saved (13446 records). [2025-09-17T03:10:37.808383] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-17T03:10:37.808484] [INFO ] [MAIN ] Update Progress: 595/2369 symbols completed. DCO took 17.8s. Estimated remaining: 4h 17m 57s. Rate: 6.9 symbols/min [2025-09-17T03:10:37.980563] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:38.015790] [DEBUG] [LOCAL ] DDD: Loaded 37715 existing records from primary storage. [2025-09-17T03:10:38.015983] [INFO ] [MAIN ] DDD: Loaded 37715 existing records. [2025-09-17T03:10:38.195927] [WARN ] [MAIN ] DDD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:10:38.196185] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-17T03:10:38.196243] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-17T03:10:38.197070] [DEBUG] [LOCAL ] DDD: Deleted primary data file. [2025-09-17T03:10:38.197136] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-17T03:10:38.296282] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-17T03:10:38.557041] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:39.090090] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-11. [2025-09-17T03:10:39.591471] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T03:10:39.675369] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T03:10:39.890128] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-17T03:10:40.690122] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-17T03:10:40.894872] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T03:10:41.286969] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:10:41.490097] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-17T03:10:42.290107] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-17T03:10:42.359696] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T03:10:42.668950] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T03:10:43.090141] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-17T03:10:43.890155] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-17T03:10:44.084324] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T03:10:44.350504] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T03:10:44.690213] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-17T03:10:45.457211] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T03:10:45.490083] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-17T03:10:46.290197] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-17T03:10:46.679668] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T03:10:46.946064] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T03:10:47.090166] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-17T03:10:47.832450] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T03:10:47.890103] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-17T03:10:48.617576] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T03:10:48.623552] [INFO ] [REMOTE ] DBRG: Full fetch complete (72099 records). [2025-09-17T03:10:48.623713] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-17T03:10:48.698322] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-17T03:10:49.019591] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-17T03:10:49.019719] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-17T03:10:49.020518] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-17T03:10:49.020574] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-17T03:10:49.021967] [DEBUG] [LOCAL ] DBRG: Trimmed 72099 records to 49842 (keeping 200 days of data) [2025-09-17T03:10:49.316508] [DEBUG] [LOCAL ] DBRG: Primary data saved (49842 records). [2025-09-17T03:10:49.316689] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-17T03:10:49.316780] [INFO ] [MAIN ] Update Progress: 596/2369 symbols completed. DBRG took 41.0s. Estimated remaining: 4h 17m 57s. Rate: 6.9 symbols/min [2025-09-17T03:10:49.485250] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:10:49.485430] [DEBUG] [LOCAL ] DDL: No existing data file found in primary storage. [2025-09-17T03:10:49.485471] [WARN ] [MAIN ] DDL: No existing data found, performing full refresh instead. [2025-09-17T03:10:49.485583] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-17T03:10:49.485634] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-17T03:10:49.485703] [DEBUG] [LOCAL ] DDL: No primary data file found to delete. [2025-09-17T03:10:49.485743] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-17T03:10:49.517034] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-17T03:10:49.855013] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:10:49.885891] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T03:10:50.295292] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-17T03:10:50.309405] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:10:51.090201] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-11. [2025-09-17T03:10:51.350958] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T03:10:51.890209] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-17T03:10:52.008455] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:10:52.631154] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T03:10:52.690149] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-17T03:10:52.929371] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T03:10:53.490258] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-17T03:10:54.290131] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-17T03:10:54.676076] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T03:10:54.715143] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T03:10:55.090151] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-17T03:10:55.890190] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-17T03:10:56.020302] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T03:10:56.413267] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T03:10:56.419943] [INFO ] [REMOTE ] DD: Full fetch complete (76037 records). [2025-09-17T03:10:56.420132] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-17T03:10:56.695177] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-17T03:10:56.818327] [DEBUG] [VALIDATOR ] DD: All expected trading days are present. [2025-09-17T03:10:56.818438] [DEBUG] [VALIDATOR ] DD: Primary data validation passed. [2025-09-17T03:10:56.819303] [INFO ] [MAIN ] DD: Fetched primary data is valid. [2025-09-17T03:10:56.819363] [DEBUG] [LOCAL ] DD: Saving primary data. [2025-09-17T03:10:56.820834] [DEBUG] [LOCAL ] DD: Trimmed 76037 records to 52790 (keeping 200 days of data) [2025-09-17T03:10:57.280489] [DEBUG] [LOCAL ] DD: Primary data saved (52790 records). [2025-09-17T03:10:57.280778] [INFO ] [MAIN ] DD: Full history saved. [2025-09-17T03:10:57.280977] [INFO ] [MAIN ] Update Progress: 597/2369 symbols completed. DD took 36.2s. Estimated remaining: 4h 17m 46s. Rate: 6.9 symbols/min [2025-09-17T03:10:57.503978] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-17T03:10:57.530221] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T03:10:57.645534] [DEBUG] [REMOTE ] DDD: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-17T03:10:57.646081] [WARN ] [REMOTE ] DDD: No data returned for month 2025-04 [2025-09-17T03:10:58.264868] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T03:10:58.290184] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-17T03:10:59.090165] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-17T03:10:59.680885] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T03:10:59.685819] [INFO ] [REMOTE ] DCI: Full fetch complete (54330 records). [2025-09-17T03:10:59.686008] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-17T03:10:59.909555] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-17T03:11:00.072299] [DEBUG] [VALIDATOR ] DCI: All expected trading days are present. [2025-09-17T03:11:00.072408] [DEBUG] [VALIDATOR ] DCI: Primary data validation passed. [2025-09-17T03:11:00.073145] [INFO ] [MAIN ] DCI: Fetched primary data is valid. [2025-09-17T03:11:00.073206] [DEBUG] [LOCAL ] DCI: Saving primary data. [2025-09-17T03:11:00.074397] [DEBUG] [LOCAL ] DCI: Trimmed 54330 records to 37761 (keeping 200 days of data) [2025-09-17T03:11:00.315462] [DEBUG] [LOCAL ] DCI: Primary data saved (37761 records). [2025-09-17T03:11:00.315879] [INFO ] [MAIN ] DCI: Full history saved. [2025-09-17T03:11:00.316029] [INFO ] [MAIN ] Update Progress: 598/2369 symbols completed. DCI took 44.5s. Estimated remaining: 4h 17m 20s. Rate: 6.9 symbols/min [2025-09-17T03:11:00.482815] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T03:11:00.690175] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-17T03:11:01.936406] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T03:11:01.948608] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-17T03:11:02.115536] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T03:11:02.290137] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-17T03:11:03.797943] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T03:11:03.811006] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-17T03:11:04.591433] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-17T03:11:04.602291] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-17T03:11:05.667829] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:11:05.679076] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-17T03:11:06.094087] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T03:11:06.104197] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-17T03:11:07.381983] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:11:07.391729] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-17T03:11:07.604960] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T03:11:07.616042] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-17T03:11:08.464388] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T03:11:08.471605] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-17T03:11:09.133690] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T03:11:09.139867] [INFO ] [REMOTE ] DDD: Full fetch complete (65820 records). [2025-09-17T03:11:09.140017] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-17T03:11:09.359454] [WARN ] [VALIDATOR ] DDD: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T03:11:09.360210] [FATAL] [MAIN ] DDD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:11:09.360287] [WARN ] [MAIN ] DDD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:11:09.360360] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-17T03:11:09.360466] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-09-17T03:11:09.360532] [INFO ] [LOCAL ] DDD: Starting deletion of derivative data. [2025-09-17T03:11:09.361011] [DEBUG] [LOCAL ] DDD: Deleted derivative data file. [2025-09-17T03:11:09.361141] [INFO ] [MAIN ] Update Progress: 599/2369 symbols completed. DDD took 31.6s. Estimated remaining: 4h 17m 12s. Rate: 6.9 symbols/min [2025-09-17T03:11:09.784770] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T03:11:09.791584] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-17T03:11:10.799310] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T03:11:10.804492] [INFO ] [REMOTE ] DDL: Full fetch complete (53207 records). [2025-09-17T03:11:10.804654] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-17T03:11:11.191472] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-17T03:11:11.191603] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-17T03:11:11.192341] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-17T03:11:11.192398] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-17T03:11:11.193536] [DEBUG] [LOCAL ] DDL: Trimmed 53207 records to 36243 (keeping 200 days of data) [2025-09-17T03:11:11.394977] [DEBUG] [LOCAL ] DDL: Primary data saved (36243 records). [2025-09-17T03:11:11.395148] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-17T03:11:11.395237] [INFO ] [MAIN ] Update Progress: 600/2369 symbols completed. DDL took 22.1s. Estimated remaining: 4h 16m 44s. Rate: 6.9 symbols/min [2025-09-17T03:11:12.033804] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:12.088945] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:12.089817] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:12.107483] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:12.106179] [DEBUG] [LOCAL ] DDS: No existing data file found in primary storage. [2025-09-17T03:11:12.109168] [WARN ] [MAIN ] DDS: No existing data found, performing full refresh instead. [2025-09-17T03:11:12.109541] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-17T03:11:12.110314] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-17T03:11:12.111195] [DEBUG] [LOCAL ] DDS: No primary data file found to delete. [2025-09-17T03:11:12.113388] [DEBUG] [LOCAL ] DDT: Loaded 1367 existing records from primary storage. [2025-09-17T03:11:12.113545] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-17T03:11:12.113675] [INFO ] [MAIN ] DDT: Loaded 1367 existing records. [2025-09-17T03:11:12.536583] [DEBUG] [LOCAL ] DE: Loaded 35191 existing records from primary storage. [2025-09-17T03:11:12.523856] [DEBUG] [LOCAL ] DEA: Loaded 29272 existing records from primary storage. [2025-09-17T03:11:12.554405] [INFO ] [MAIN ] DE: Loaded 35191 existing records. [2025-09-17T03:11:12.582586] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:11:12.579557] [INFO ] [MAIN ] DEA: Loaded 29272 existing records. [2025-09-17T03:11:12.659714] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-17T03:11:12.728333] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-17T03:11:12.802374] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-17T03:11:12.848684] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-17T03:11:13.146666] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:13.157178] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:11:13.184155] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-11. [2025-09-17T03:11:13.186461] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-17T03:11:13.228770] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-17T03:11:13.239518] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:11:13.260414] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-17T03:11:13.260676] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-17T03:11:13.288745] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-17T03:11:13.288594] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-17T03:11:13.360409] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-17T03:11:13.430535] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-17T03:11:13.977319] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:14.016481] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-11. [2025-09-17T03:11:14.189068] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:14.200760] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-11. [2025-09-17T03:11:14.253043] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T03:11:14.280753] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:14.284969] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-17T03:11:14.285479] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-11. [2025-09-17T03:11:14.563338] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T03:11:14.564457] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-17T03:11:14.971029] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T03:11:14.974603] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-17T03:11:15.030385] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T03:11:15.090116] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-17T03:11:15.436353] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-17T03:11:15.611089] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T03:11:15.637072] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T03:11:15.887338] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T03:11:15.896727] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-17T03:11:16.690109] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-17T03:11:16.850970] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T03:11:17.490125] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-17T03:11:18.161847] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:11:18.290129] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-17T03:11:19.090147] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-17T03:11:19.552833] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T03:11:19.554261] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T03:11:19.622755] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-17T03:11:19.890130] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-17T03:11:20.690128] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-17T03:11:21.474745] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T03:11:21.490090] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-17T03:11:21.797228] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T03:11:22.290127] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-17T03:11:22.657114] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T03:11:22.870012] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:11:23.090131] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-17T03:11:23.865009] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T03:11:23.890079] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-17T03:11:24.690130] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-17T03:11:25.153191] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T03:11:25.313992] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T03:11:25.490125] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-17T03:11:25.951397] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T03:11:26.290125] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-17T03:11:27.090085] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-17T03:11:27.557527] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T03:11:27.650079] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T03:11:27.890145] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-17T03:11:28.690140] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-17T03:11:29.287899] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:11:29.299411] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T03:11:29.490159] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-17T03:11:29.859975] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T03:11:29.860792] [INFO ] [REMOTE ] DDT: Full fetch complete (2891 records). [2025-09-17T03:11:29.860873] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-17T03:11:30.228659] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-17T03:11:30.228802] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-17T03:11:30.228979] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-17T03:11:30.229058] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-17T03:11:30.229622] [DEBUG] [LOCAL ] DDT: Trimmed 2891 records to 2071 (keeping 200 days of data) [2025-09-17T03:11:30.242861] [DEBUG] [LOCAL ] DDT: Primary data saved (2071 records). [2025-09-17T03:11:30.242957] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-17T03:11:30.243084] [INFO ] [MAIN ] Update Progress: 601/2369 symbols completed. DDT took 18.8s. Estimated remaining: 4h 17m 5s. Rate: 6.9 symbols/min [2025-09-17T03:11:30.297935] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-17T03:11:30.423063] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:30.443656] [DEBUG] [LOCAL ] DEC: Loaded 21218 existing records from primary storage. [2025-09-17T03:11:30.443790] [INFO ] [MAIN ] DEC: Loaded 21218 existing records. [2025-09-17T03:11:30.620322] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:11:30.620589] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-17T03:11:30.620687] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-17T03:11:30.621348] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-17T03:11:30.621418] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-17T03:11:30.982138] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:31.090139] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-11. [2025-09-17T03:11:31.887200] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:11:31.896389] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-17T03:11:31.963614] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T03:11:32.690179] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-17T03:11:33.360839] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T03:11:33.490170] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-17T03:11:33.749124] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T03:11:34.290167] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-17T03:11:34.941009] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:11:35.090186] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-17T03:11:35.834331] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T03:11:35.890126] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-17T03:11:36.591118] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T03:11:36.690135] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-17T03:11:37.490140] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-17T03:11:37.576076] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:11:37.684671] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T03:11:38.290222] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-17T03:11:38.890101] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T03:11:38.895083] [INFO ] [REMOTE ] DEA: Full fetch complete (63176 records). [2025-09-17T03:11:38.895259] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-17T03:11:39.090311] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-17T03:11:39.316278] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-17T03:11:39.316397] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-17T03:11:39.317204] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-17T03:11:39.317265] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-17T03:11:39.318579] [DEBUG] [LOCAL ] DEA: Trimmed 63176 records to 41800 (keeping 200 days of data) [2025-09-17T03:11:39.580884] [DEBUG] [LOCAL ] DEA: Primary data saved (41800 records). [2025-09-17T03:11:39.581045] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-17T03:11:39.581142] [INFO ] [MAIN ] Update Progress: 602/2369 symbols completed. DEA took 28.2s. Estimated remaining: 4h 16m 58s. Rate: 6.9 symbols/min [2025-09-17T03:11:39.766013] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:39.801997] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T03:11:39.823415] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T03:11:39.859105] [DEBUG] [LOCAL ] DECK: Loaded 39727 existing records from primary storage. [2025-09-17T03:11:39.859307] [INFO ] [MAIN ] DECK: Loaded 39727 existing records. [2025-09-17T03:11:39.895238] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-17T03:11:40.043778] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:11:40.044034] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-17T03:11:40.044087] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-17T03:11:40.045160] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-17T03:11:40.045227] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-17T03:11:40.398036] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:40.690206] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-17T03:11:41.165985] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T03:11:41.315899] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T03:11:41.490169] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-17T03:11:42.290130] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-17T03:11:42.976289] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T03:11:43.090128] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-11. [2025-09-17T03:11:43.284173] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T03:11:43.890175] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-17T03:11:44.690112] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-17T03:11:44.900446] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T03:11:44.968548] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T03:11:45.490129] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-17T03:11:46.088355] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T03:11:46.090355] [INFO ] [REMOTE ] DDS: Full fetch complete (19372 records). [2025-09-17T03:11:46.090444] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-17T03:11:46.296599] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-17T03:11:46.463362] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-17T03:11:46.463477] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-17T03:11:46.464043] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-17T03:11:46.464109] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-17T03:11:46.464791] [DEBUG] [LOCAL ] DDS: Trimmed 19372 records to 13640 (keeping 200 days of data) [2025-09-17T03:11:46.551418] [DEBUG] [LOCAL ] DDS: Primary data saved (13640 records). [2025-09-17T03:11:46.551590] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-17T03:11:46.551709] [INFO ] [MAIN ] Update Progress: 603/2369 symbols completed. DDS took 35.2s. Estimated remaining: 4h 16m 44s. Rate: 6.9 symbols/min [2025-09-17T03:11:46.722098] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:46.722378] [DEBUG] [LOCAL ] DEI: No existing data file found in primary storage. [2025-09-17T03:11:46.722437] [WARN ] [MAIN ] DEI: No existing data found, performing full refresh instead. [2025-09-17T03:11:46.722735] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-17T03:11:46.722989] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-17T03:11:46.723109] [DEBUG] [LOCAL ] DEI: No primary data file found to delete. [2025-09-17T03:11:46.723189] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-17T03:11:47.108737] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:11:47.108819] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-17T03:11:47.136904] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-17T03:11:47.428576] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T03:11:47.890137] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-17T03:11:48.690233] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-11. [2025-09-17T03:11:49.030783] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T03:11:49.309664] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T03:11:49.490178] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-17T03:11:50.257980] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T03:11:50.290284] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-17T03:11:51.001288] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T03:11:51.090213] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-17T03:11:51.890139] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-17T03:11:51.924684] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T03:11:52.108903] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T03:11:52.690132] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-17T03:11:53.501361] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-17T03:11:53.507372] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:11:54.082047] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T03:11:54.290197] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-17T03:11:55.090150] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-17T03:11:55.179428] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:11:55.890168] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-17T03:11:56.146698] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T03:11:56.212527] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T03:11:56.690141] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-17T03:11:57.170904] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T03:11:57.490144] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-17T03:11:58.290143] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-17T03:11:58.783804] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T03:11:58.789979] [INFO ] [REMOTE ] DE: Full fetch complete (69528 records). [2025-09-17T03:11:58.790178] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-17T03:11:58.939515] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-17T03:11:59.095233] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-17T03:11:59.228604] [DEBUG] [VALIDATOR ] DE: All expected trading days are present. [2025-09-17T03:11:59.228755] [DEBUG] [VALIDATOR ] DE: Primary data validation passed. [2025-09-17T03:11:59.229687] [INFO ] [MAIN ] DE: Fetched primary data is valid. [2025-09-17T03:11:59.229769] [DEBUG] [LOCAL ] DE: Saving primary data. [2025-09-17T03:11:59.231361] [DEBUG] [LOCAL ] DE: Trimmed 69528 records to 47823 (keeping 200 days of data) [2025-09-17T03:11:59.533474] [DEBUG] [LOCAL ] DE: Primary data saved (47823 records). [2025-09-17T03:11:59.533677] [INFO ] [MAIN ] DE: Full history saved. [2025-09-17T03:11:59.533823] [INFO ] [MAIN ] Update Progress: 604/2369 symbols completed. DE took 48.1s. Estimated remaining: 4h 16m 48s. Rate: 6.9 symbols/min [2025-09-17T03:11:59.704365] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:11:59.704626] [DEBUG] [LOCAL ] DELL: No existing data file found in primary storage. [2025-09-17T03:11:59.704699] [WARN ] [MAIN ] DELL: No existing data found, performing full refresh instead. [2025-09-17T03:11:59.704814] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-17T03:11:59.704862] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-17T03:11:59.704910] [DEBUG] [LOCAL ] DELL: No primary data file found to delete. [2025-09-17T03:11:59.704951] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-17T03:11:59.895626] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-17T03:12:00.068028] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:00.097152] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T03:12:00.690185] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-17T03:12:01.127998] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T03:12:01.490154] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-17T03:12:01.492685] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-17T03:12:02.290178] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-11. [2025-09-17T03:12:02.943689] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-17T03:12:02.983578] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T03:12:02.988519] [INFO ] [REMOTE ] DEC: Full fetch complete (42427 records). [2025-09-17T03:12:02.988799] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-17T03:12:03.095398] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-17T03:12:03.414964] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-17T03:12:03.415119] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-17T03:12:03.416064] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-17T03:12:03.416138] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-17T03:12:03.417748] [DEBUG] [LOCAL ] DEC: Trimmed 42427 records to 30937 (keeping 200 days of data) [2025-09-17T03:12:03.635207] [DEBUG] [LOCAL ] DEC: Primary data saved (30937 records). [2025-09-17T03:12:03.635492] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-17T03:12:03.635685] [INFO ] [MAIN ] Update Progress: 605/2369 symbols completed. DEC took 33.4s. Estimated remaining: 4h 16m 26s. Rate: 6.9 symbols/min [2025-09-17T03:12:03.829783] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:03.875992] [DEBUG] [LOCAL ] DEO: Loaded 36147 existing records from primary storage. [2025-09-17T03:12:03.876256] [INFO ] [MAIN ] DEO: Loaded 36147 existing records. [2025-09-17T03:12:03.910348] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-17T03:12:04.070906] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:12:04.071295] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-17T03:12:04.071367] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-17T03:12:04.072384] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-17T03:12:04.072456] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-17T03:12:04.465311] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:04.690219] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-11. [2025-09-17T03:12:05.824976] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-09-17T03:12:05.835738] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-17T03:12:05.896727] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-11 (3.61 seconds). [2025-09-17T03:12:06.290215] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-17T03:12:06.610560] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T03:12:07.090129] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-17T03:12:07.200590] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (3.29 seconds). [2025-09-17T03:12:07.448910] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:12:07.890147] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-17T03:12:08.690217] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-17T03:12:08.867895] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.58 seconds). [2025-09-17T03:12:08.972592] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T03:12:09.163395] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T03:12:09.490143] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-17T03:12:10.290133] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-17T03:12:10.804146] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-17T03:12:11.090124] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-17T03:12:11.596842] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-17T03:12:11.765072] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T03:12:11.890117] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-17T03:12:12.690125] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-17T03:12:12.734678] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T03:12:13.490134] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-17T03:12:13.610170] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T03:12:14.290134] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-17T03:12:14.502972] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T03:12:15.090152] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-17T03:12:15.410249] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T03:12:15.417076] [INFO ] [REMOTE ] DEI: Full fetch complete (69246 records). [2025-09-17T03:12:15.417257] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-17T03:12:15.868381] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-17T03:12:15.903464] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-17T03:12:15.899197] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-17T03:12:15.904222] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-17T03:12:15.906107] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-17T03:12:15.906740] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-17T03:12:15.908411] [DEBUG] [LOCAL ] DEI: Trimmed 69246 records to 48518 (keeping 200 days of data) [2025-09-17T03:12:16.217494] [DEBUG] [LOCAL ] DEI: Primary data saved (48518 records). [2025-09-17T03:12:16.217816] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-17T03:12:16.218048] [INFO ] [MAIN ] Update Progress: 606/2369 symbols completed. DEI took 29.7s. Estimated remaining: 4h 16m 28s. Rate: 6.9 symbols/min [2025-09-17T03:12:16.394004] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:16.394249] [DEBUG] [LOCAL ] DFH: No existing data file found in primary storage. [2025-09-17T03:12:16.394328] [WARN ] [MAIN ] DFH: No existing data found, performing full refresh instead. [2025-09-17T03:12:16.394480] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-17T03:12:16.394535] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-17T03:12:16.394593] [DEBUG] [LOCAL ] DFH: No primary data file found to delete. [2025-09-17T03:12:16.394685] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-17T03:12:16.695343] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-17T03:12:16.761810] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:17.463532] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-17T03:12:17.490149] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-17T03:12:18.189773] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-17T03:12:18.290147] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-17T03:12:19.090190] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-11. [2025-09-17T03:12:19.250477] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-17T03:12:19.557916] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T03:12:19.890130] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-17T03:12:20.301327] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T03:12:20.507169] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:12:20.690183] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-17T03:12:21.490173] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-17T03:12:21.545082] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T03:12:22.156122] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:12:22.290108] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-17T03:12:23.090131] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-17T03:12:23.345759] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T03:12:23.352456] [INFO ] [REMOTE ] DECK: Full fetch complete (76393 records). [2025-09-17T03:12:23.352600] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-17T03:12:23.789105] [DEBUG] [VALIDATOR ] DECK: All expected trading days are present. [2025-09-17T03:12:23.789289] [DEBUG] [VALIDATOR ] DECK: Primary data validation passed. [2025-09-17T03:12:23.790305] [INFO ] [MAIN ] DECK: Fetched primary data is valid. [2025-09-17T03:12:23.790420] [DEBUG] [LOCAL ] DECK: Saving primary data. [2025-09-17T03:12:23.811979] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T03:12:23.819298] [DEBUG] [LOCAL ] DECK: Trimmed 76393 records to 53324 (keeping 200 days of data) [2025-09-17T03:12:23.913068] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-17T03:12:24.148227] [DEBUG] [LOCAL ] DECK: Primary data saved (53324 records). [2025-09-17T03:12:24.148394] [INFO ] [MAIN ] DECK: Full history saved. [2025-09-17T03:12:24.148502] [INFO ] [MAIN ] Update Progress: 607/2369 symbols completed. DECK took 44.6s. Estimated remaining: 4h 16m 17s. Rate: 6.9 symbols/min [2025-09-17T03:12:24.321477] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:24.321681] [DEBUG] [LOCAL ] DFIN: No existing data file found in primary storage. [2025-09-17T03:12:24.321747] [WARN ] [MAIN ] DFIN: No existing data found, performing full refresh instead. [2025-09-17T03:12:24.321901] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-17T03:12:24.321977] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-17T03:12:24.322045] [DEBUG] [LOCAL ] DFIN: No primary data file found to delete. [2025-09-17T03:12:24.322129] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-17T03:12:24.691409] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-17T03:12:24.696534] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:24.725381] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T03:12:25.490188] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-11. [2025-09-17T03:12:25.709847] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T03:12:26.230075] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T03:12:26.290118] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-17T03:12:26.360136] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-17T03:12:27.090126] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-17T03:12:27.292579] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T03:12:27.885210] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T03:12:27.890067] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-17T03:12:28.690136] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-17T03:12:28.957292] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T03:12:29.490131] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-17T03:12:30.239365] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T03:12:30.290075] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-17T03:12:30.479429] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:12:31.090216] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-17T03:12:31.454149] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T03:12:31.890190] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-17T03:12:32.081985] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:12:32.690216] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-17T03:12:33.490161] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-17T03:12:34.012562] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T03:12:34.290137] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-17T03:12:34.343603] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-17T03:12:34.999085] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T03:12:35.090177] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-17T03:12:35.302076] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T03:12:35.890177] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-17T03:12:36.372841] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T03:12:36.690156] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-17T03:12:36.942832] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T03:12:37.490205] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-17T03:12:37.726459] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T03:12:38.290198] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-17T03:12:39.090152] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-17T03:12:39.651992] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-17T03:12:39.768362] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T03:12:39.890138] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-17T03:12:40.118734] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T03:12:40.690199] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-17T03:12:40.998353] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T03:12:41.490222] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-17T03:12:42.290166] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-17T03:12:42.864904] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T03:12:42.982447] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T03:12:43.090199] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-17T03:12:43.143662] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T03:12:43.154246] [INFO ] [REMOTE ] DEO: Full fetch complete (71284 records). [2025-09-17T03:12:43.154508] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-17T03:12:43.561392] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-17T03:12:43.561501] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-17T03:12:43.562286] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-17T03:12:43.562345] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-17T03:12:43.563750] [DEBUG] [LOCAL ] DEO: Trimmed 71284 records to 48913 (keeping 200 days of data) [2025-09-17T03:12:43.876055] [DEBUG] [LOCAL ] DEO: Primary data saved (48913 records). [2025-09-17T03:12:43.876234] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-17T03:12:43.876349] [INFO ] [MAIN ] Update Progress: 608/2369 symbols completed. DEO took 40.2s. Estimated remaining: 4h 16m 40s. Rate: 6.9 symbols/min [2025-09-17T03:12:43.897032] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-17T03:12:44.059677] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T03:12:44.058883] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:44.062949] [INFO ] [REMOTE ] DFIN: Full fetch complete (33035 records). [2025-09-17T03:12:44.063043] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-17T03:12:44.173632] [DEBUG] [LOCAL ] DFP: Loaded 8662 existing records from primary storage. [2025-09-17T03:12:44.199545] [INFO ] [MAIN ] DFP: Loaded 8662 existing records. [2025-09-17T03:12:44.610042] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:12:44.657100] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-17T03:12:44.655152] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-17T03:12:44.657300] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-17T03:12:44.657332] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-17T03:12:44.658009] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-17T03:12:44.657966] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-17T03:12:44.658114] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-17T03:12:44.658181] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-17T03:12:44.695247] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-17T03:12:44.752018] [DEBUG] [LOCAL ] DFIN: Trimmed 33035 records to 23614 (keeping 200 days of data) [2025-09-17T03:12:45.137255] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:45.184816] [DEBUG] [LOCAL ] DFIN: Primary data saved (23614 records). [2025-09-17T03:12:45.185018] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-17T03:12:45.185130] [INFO ] [MAIN ] Update Progress: 609/2369 symbols completed. DFIN took 21.0s. Estimated remaining: 4h 16m 10s. Rate: 6.9 symbols/min [2025-09-17T03:12:45.361946] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:45.405394] [DEBUG] [LOCAL ] DG: Loaded 39688 existing records from primary storage. [2025-09-17T03:12:45.405634] [INFO ] [MAIN ] DG: Loaded 39688 existing records. [2025-09-17T03:12:45.499262] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-11. [2025-09-17T03:12:45.593490] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:12:45.593921] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-17T03:12:45.594240] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-17T03:12:45.602731] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-17T03:12:45.602857] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-17T03:12:45.670325] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T03:12:45.713440] [INFO ] [REMOTE ] DFH: Full fetch complete (49261 records). [2025-09-17T03:12:45.739386] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-17T03:12:46.135225] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:46.302267] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-11. [2025-09-17T03:12:46.382813] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-17T03:12:46.383480] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-17T03:12:46.383182] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T03:12:46.384200] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-17T03:12:46.384426] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-17T03:12:46.388932] [DEBUG] [LOCAL ] DFH: Trimmed 49261 records to 33205 (keeping 200 days of data) [2025-09-17T03:12:46.509523] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-17T03:12:46.630811] [DEBUG] [LOCAL ] DFH: Primary data saved (33205 records). [2025-09-17T03:12:46.630993] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-17T03:12:46.631085] [INFO ] [MAIN ] Update Progress: 610/2369 symbols completed. DFH took 30.4s. Estimated remaining: 4h 15m 40s. Rate: 6.9 symbols/min [2025-09-17T03:12:46.808145] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:46.808361] [DEBUG] [LOCAL ] DGX: No existing data file found in primary storage. [2025-09-17T03:12:46.808414] [WARN ] [MAIN ] DGX: No existing data found, performing full refresh instead. [2025-09-17T03:12:46.808528] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-17T03:12:46.808580] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-17T03:12:46.808633] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-09-17T03:12:46.808693] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-17T03:12:47.099753] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-17T03:12:47.185228] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:47.890145] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-17T03:12:48.321867] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T03:12:48.697013] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-17T03:12:48.698778] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:12:48.959349] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T03:12:48.966116] [INFO ] [REMOTE ] DELL: Full fetch complete (77812 records). [2025-09-17T03:12:48.966249] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-17T03:12:49.362089] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-17T03:12:49.362197] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-17T03:12:49.363085] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-17T03:12:49.363147] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-17T03:12:49.364729] [DEBUG] [LOCAL ] DELL: Trimmed 77812 records to 53736 (keeping 200 days of data) [2025-09-17T03:12:49.490214] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-17T03:12:49.713248] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-09-17T03:12:49.713420] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-17T03:12:49.713509] [INFO ] [MAIN ] Update Progress: 611/2369 symbols completed. DELL took 50.2s. Estimated remaining: 4h 15m 15s. Rate: 6.9 symbols/min [2025-09-17T03:12:49.882608] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:12:49.898352] [DEBUG] [LOCAL ] DHF: Loaded 15920 existing records from primary storage. [2025-09-17T03:12:49.898512] [INFO ] [MAIN ] DHF: Loaded 15920 existing records. [2025-09-17T03:12:50.078732] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:12:50.078982] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-17T03:12:50.079042] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-17T03:12:50.079552] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-17T03:12:50.079613] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-17T03:12:50.272598] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T03:12:50.296772] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-11. [2025-09-17T03:12:50.460051] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:12:50.743797] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-17T03:12:51.090172] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-11. [2025-09-17T03:12:51.525297] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T03:12:51.890175] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-17T03:12:52.116694] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:12:52.672775] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T03:12:52.690100] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-17T03:12:53.293561] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T03:12:53.490191] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-17T03:12:54.290177] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-17T03:12:54.390012] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T03:12:54.974427] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T03:12:55.090131] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-17T03:12:55.890130] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-17T03:12:56.021135] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T03:12:56.690144] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-17T03:12:57.441006] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T03:12:57.490108] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-17T03:12:57.703790] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T03:12:58.290133] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-17T03:12:58.875470] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T03:12:59.090112] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-17T03:12:59.370181] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T03:12:59.890175] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-17T03:12:59.900442] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T03:13:00.690138] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-17T03:13:01.490148] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-17T03:13:01.503717] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T03:13:01.920841] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T03:13:02.290156] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-17T03:13:02.624198] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T03:13:03.090128] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-17T03:13:03.113629] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T03:13:03.890111] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-17T03:13:04.690220] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-17T03:13:04.874161] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T03:13:05.490183] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-17T03:13:05.552302] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T03:13:05.590943] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T03:13:06.290166] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-17T03:13:07.090129] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-17T03:13:07.553544] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T03:13:07.890180] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-17T03:13:08.057250] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:13:08.101548] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T03:13:08.462704] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T03:13:08.465303] [INFO ] [REMOTE ] DFP: Full fetch complete (16253 records). [2025-09-17T03:13:08.465434] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-17T03:13:08.695295] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-17T03:13:08.833709] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-17T03:13:08.833819] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-17T03:13:08.834179] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-17T03:13:08.834237] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-17T03:13:08.834907] [DEBUG] [LOCAL ] DFP: Trimmed 16253 records to 11859 (keeping 200 days of data) [2025-09-17T03:13:08.910763] [DEBUG] [LOCAL ] DFP: Primary data saved (11859 records). [2025-09-17T03:13:08.910944] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-17T03:13:08.911048] [INFO ] [MAIN ] Update Progress: 612/2369 symbols completed. DFP took 25.0s. Estimated remaining: 4h 15m 37s. Rate: 6.9 symbols/min [2025-09-17T03:13:09.081579] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:09.125503] [DEBUG] [LOCAL ] DHI: Loaded 39803 existing records from primary storage. [2025-09-17T03:13:09.125735] [INFO ] [MAIN ] DHI: Loaded 39803 existing records. [2025-09-17T03:13:09.304631] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:13:09.304895] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-17T03:13:09.304976] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-17T03:13:09.305979] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-17T03:13:09.306039] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-17T03:13:09.498115] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-17T03:13:09.673881] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:10.290424] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-11. [2025-09-17T03:13:10.498957] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T03:13:11.090154] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-17T03:13:11.145065] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T03:13:11.730360] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:13:11.890165] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-17T03:13:12.690188] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-17T03:13:13.299760] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-17T03:13:13.369471] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T03:13:13.490100] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-17T03:13:14.290153] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-17T03:13:14.499885] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T03:13:14.892222] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T03:13:15.090098] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-17T03:13:15.890096] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-17T03:13:15.923721] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:13:16.690137] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-17T03:13:16.785802] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T03:13:17.495386] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-17T03:13:17.513977] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:13:18.223072] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T03:13:18.270058] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T03:13:18.290085] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-17T03:13:19.090194] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-17T03:13:19.714252] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T03:13:19.890195] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-17T03:13:20.609473] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T03:13:20.690129] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-17T03:13:21.490183] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-17T03:13:21.539074] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:13:21.611448] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T03:13:22.290181] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-17T03:13:22.802388] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T03:13:22.809083] [INFO ] [REMOTE ] DG: Full fetch complete (77122 records). [2025-09-17T03:13:22.809282] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-17T03:13:23.100039] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-17T03:13:23.211434] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-17T03:13:23.211622] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-17T03:13:23.212602] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-17T03:13:23.212704] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-17T03:13:23.214271] [DEBUG] [LOCAL ] DG: Trimmed 77122 records to 53312 (keeping 200 days of data) [2025-09-17T03:13:23.549976] [DEBUG] [LOCAL ] DG: Primary data saved (53312 records). [2025-09-17T03:13:23.550139] [INFO ] [MAIN ] DG: Full history saved. [2025-09-17T03:13:23.550232] [INFO ] [MAIN ] Update Progress: 613/2369 symbols completed. DG took 38.4s. Estimated remaining: 4h 15m 45s. Rate: 6.9 symbols/min [2025-09-17T03:13:23.724032] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:23.724257] [DEBUG] [LOCAL ] DHR: No existing data file found in primary storage. [2025-09-17T03:13:23.724309] [WARN ] [MAIN ] DHR: No existing data found, performing full refresh instead. [2025-09-17T03:13:23.724426] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-17T03:13:23.724481] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-17T03:13:23.724534] [DEBUG] [LOCAL ] DHR: No primary data file found to delete. [2025-09-17T03:13:23.724579] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-17T03:13:23.892273] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-17T03:13:24.040744] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:13:24.114938] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:24.115942] [INFO ] [REMOTE ] DGX: Full fetch complete (65130 records). [2025-09-17T03:13:24.116087] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-17T03:13:24.201255] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T03:13:24.521962] [DEBUG] [VALIDATOR ] DGX: All expected trading days are present. [2025-09-17T03:13:24.522074] [DEBUG] [VALIDATOR ] DGX: Primary data validation passed. [2025-09-17T03:13:24.522802] [INFO ] [MAIN ] DGX: Fetched primary data is valid. [2025-09-17T03:13:24.522869] [DEBUG] [LOCAL ] DGX: Saving primary data. [2025-09-17T03:13:24.524136] [DEBUG] [LOCAL ] DGX: Trimmed 65130 records to 45571 (keeping 200 days of data) [2025-09-17T03:13:24.704568] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-11. [2025-09-17T03:13:24.808383] [DEBUG] [LOCAL ] DGX: Primary data saved (45571 records). [2025-09-17T03:13:24.808526] [INFO ] [MAIN ] DGX: Full history saved. [2025-09-17T03:13:24.808610] [INFO ] [MAIN ] Update Progress: 614/2369 symbols completed. DGX took 38.2s. Estimated remaining: 4h 15m 15s. Rate: 6.9 symbols/min [2025-09-17T03:13:24.980192] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:24.980348] [DEBUG] [LOCAL ] DHT: No existing data file found in primary storage. [2025-09-17T03:13:24.980396] [WARN ] [MAIN ] DHT: No existing data found, performing full refresh instead. [2025-09-17T03:13:24.980529] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-17T03:13:24.980597] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-17T03:13:24.980688] [DEBUG] [LOCAL ] DHT: No primary data file found to delete. [2025-09-17T03:13:24.980755] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-17T03:13:25.330333] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:25.490085] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-11. [2025-09-17T03:13:26.044582] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-17T03:13:26.151979] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T03:13:26.290114] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-17T03:13:26.868135] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T03:13:27.090165] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-17T03:13:27.890167] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-17T03:13:28.327717] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T03:13:28.675967] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T03:13:28.678617] [INFO ] [REMOTE ] DHF: Full fetch complete (29618 records). [2025-09-17T03:13:28.678741] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-17T03:13:28.699779] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-17T03:13:29.065018] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-17T03:13:29.065156] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-17T03:13:29.065945] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-17T03:13:29.066120] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-17T03:13:29.077848] [DEBUG] [LOCAL ] DHF: Trimmed 29618 records to 21188 (keeping 200 days of data) [2025-09-17T03:13:29.098602] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T03:13:29.238223] [DEBUG] [LOCAL ] DHF: Primary data saved (21188 records). [2025-09-17T03:13:29.238381] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-17T03:13:29.238472] [INFO ] [MAIN ] Update Progress: 615/2369 symbols completed. DHF took 39.5s. Estimated remaining: 4h 14m 54s. Rate: 6.9 symbols/min [2025-09-17T03:13:29.405881] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:29.406089] [DEBUG] [LOCAL ] DHX: No existing data file found in primary storage. [2025-09-17T03:13:29.406137] [WARN ] [MAIN ] DHX: No existing data found, performing full refresh instead. [2025-09-17T03:13:29.406243] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-17T03:13:29.406292] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-17T03:13:29.406338] [DEBUG] [LOCAL ] DHX: No primary data file found to delete. [2025-09-17T03:13:29.406377] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-17T03:13:29.497201] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-17T03:13:29.771371] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:30.290148] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-17T03:13:30.627046] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T03:13:31.090157] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-17T03:13:31.404886] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T03:13:31.890122] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-11. [2025-09-17T03:13:32.014152] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:13:32.485354] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T03:13:32.690107] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-17T03:13:32.747412] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T03:13:33.490174] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-17T03:13:34.079562] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T03:13:34.290129] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-17T03:13:34.490405] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T03:13:35.090303] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-17T03:13:35.777615] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T03:13:35.890334] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-17T03:13:36.681269] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:13:36.690579] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-17T03:13:37.490166] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-17T03:13:37.553280] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T03:13:38.278949] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T03:13:38.290185] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-17T03:13:38.875250] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T03:13:39.090193] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-17T03:13:39.890090] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-17T03:13:40.463013] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-17T03:13:40.626678] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T03:13:40.690158] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-17T03:13:40.843298] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T03:13:41.490148] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-17T03:13:42.290132] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-17T03:13:42.712690] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-17T03:13:42.719478] [INFO ] [REMOTE ] DHI: Full fetch complete (77041 records). [2025-09-17T03:13:42.719668] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-17T03:13:43.097284] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-17T03:13:43.150031] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-17T03:13:43.150156] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-17T03:13:43.151081] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-17T03:13:43.151144] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-17T03:13:43.152793] [DEBUG] [LOCAL ] DHI: Trimmed 77041 records to 53376 (keeping 200 days of data) [2025-09-17T03:13:43.530600] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T03:13:43.568595] [DEBUG] [LOCAL ] DHI: Primary data saved (53376 records). [2025-09-17T03:13:43.568809] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-17T03:13:43.570414] [INFO ] [MAIN ] Update Progress: 616/2369 symbols completed. DHI took 34.7s. Estimated remaining: 4h 15m 1s. Rate: 6.9 symbols/min [2025-09-17T03:13:43.780539] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:43.780772] [DEBUG] [LOCAL ] DIAX: No existing data file found in primary storage. [2025-09-17T03:13:43.780828] [WARN ] [MAIN ] DIAX: No existing data found, performing full refresh instead. [2025-09-17T03:13:43.780940] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-17T03:13:43.780997] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-17T03:13:43.781050] [DEBUG] [LOCAL ] DIAX: No primary data file found to delete. [2025-09-17T03:13:43.781165] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-17T03:13:43.895309] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-17T03:13:44.152703] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:44.183195] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T03:13:44.310262] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T03:13:44.690129] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-17T03:13:45.490134] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-11. [2025-09-17T03:13:45.957030] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T03:13:46.011462] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T03:13:46.043282] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T03:13:46.290136] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-17T03:13:47.090132] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-17T03:13:47.700406] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T03:13:47.890146] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-17T03:13:48.181405] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T03:13:48.454381] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T03:13:48.690160] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-17T03:13:49.478548] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T03:13:49.490070] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-17T03:13:49.951489] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T03:13:50.290190] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-17T03:13:51.090206] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-17T03:13:51.622108] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T03:13:51.890213] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-17T03:13:52.669076] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T03:13:52.690092] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-17T03:13:52.941389] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T03:13:53.490139] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-17T03:13:54.290180] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-17T03:13:54.464014] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T03:13:54.514711] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T03:13:55.090101] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-17T03:13:55.091698] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T03:13:55.890207] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-17T03:13:56.275492] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T03:13:56.281746] [INFO ] [REMOTE ] DHT: Full fetch complete (70042 records). [2025-09-17T03:13:56.281906] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-17T03:13:56.672680] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-17T03:13:56.672791] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-17T03:13:56.673569] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-17T03:13:56.673624] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-17T03:13:56.675164] [DEBUG] [LOCAL ] DHT: Trimmed 70042 records to 48005 (keeping 200 days of data) [2025-09-17T03:13:56.730846] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-17T03:13:56.790350] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T03:13:56.988054] [DEBUG] [LOCAL ] DHT: Primary data saved (48005 records). [2025-09-17T03:13:56.988237] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-17T03:13:56.988334] [INFO ] [MAIN ] Update Progress: 617/2369 symbols completed. DHT took 32.2s. Estimated remaining: 4h 15m 6s. Rate: 6.9 symbols/min [2025-09-17T03:13:57.158953] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:13:57.159146] [DEBUG] [LOCAL ] DIN: No existing data file found in primary storage. [2025-09-17T03:13:57.159202] [WARN ] [MAIN ] DIN: No existing data found, performing full refresh instead. [2025-09-17T03:13:57.159306] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-17T03:13:57.159359] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-17T03:13:57.159415] [DEBUG] [LOCAL ] DIN: No primary data file found to delete. [2025-09-17T03:13:57.159459] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-17T03:13:57.511258] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-17T03:13:57.516108] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:13:57.811366] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T03:13:58.290171] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-17T03:13:58.908384] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T03:13:59.030540] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T03:13:59.090174] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-17T03:13:59.890138] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-17T03:14:00.517566] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T03:14:00.524331] [INFO ] [REMOTE ] DHR: Full fetch complete (77113 records). [2025-09-17T03:14:00.524554] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-17T03:14:00.692351] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-11. [2025-09-17T03:14:00.900078] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T03:14:00.948633] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-17T03:14:00.949093] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-17T03:14:00.950019] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-17T03:14:00.950081] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-17T03:14:00.951523] [DEBUG] [LOCAL ] DHR: Trimmed 77113 records to 53370 (keeping 200 days of data) [2025-09-17T03:14:01.294590] [DEBUG] [LOCAL ] DHR: Primary data saved (53370 records). [2025-09-17T03:14:01.294828] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-17T03:14:01.294930] [INFO ] [MAIN ] Update Progress: 618/2369 symbols completed. DHR took 37.7s. Estimated remaining: 4h 14m 44s. Rate: 6.9 symbols/min [2025-09-17T03:14:01.469628] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:01.493157] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-17T03:14:01.514449] [DEBUG] [LOCAL ] DINO: Loaded 39480 existing records from primary storage. [2025-09-17T03:14:01.514876] [INFO ] [MAIN ] DINO: Loaded 39480 existing records. [2025-09-17T03:14:01.694263] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:01.694552] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-17T03:14:01.694676] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-17T03:14:01.695891] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-17T03:14:01.695962] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-17T03:14:02.061290] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:02.151057] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T03:14:02.240767] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T03:14:02.290098] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-17T03:14:03.090147] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-17T03:14:03.744245] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T03:14:03.890128] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-11. [2025-09-17T03:14:03.984036] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T03:14:04.690144] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-17T03:14:05.490146] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-17T03:14:05.612951] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T03:14:06.247675] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T03:14:06.275776] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T03:14:06.290106] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-17T03:14:07.090135] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-17T03:14:07.161678] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T03:14:07.164505] [INFO ] [REMOTE ] DHX: Full fetch complete (20976 records). [2025-09-17T03:14:07.164637] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-17T03:14:07.534293] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-17T03:14:07.534413] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-17T03:14:07.534876] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-17T03:14:07.534981] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-17T03:14:07.535704] [DEBUG] [LOCAL ] DHX: Trimmed 20976 records to 13256 (keeping 200 days of data) [2025-09-17T03:14:07.608681] [DEBUG] [LOCAL ] DHX: Primary data saved (13256 records). [2025-09-17T03:14:07.608840] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-17T03:14:07.608927] [INFO ] [MAIN ] Update Progress: 619/2369 symbols completed. DHX took 38.4s. Estimated remaining: 4h 14m 29s. Rate: 6.9 symbols/min [2025-09-17T03:14:07.777220] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:07.817991] [DEBUG] [LOCAL ] DIS: Loaded 40138 existing records from primary storage. [2025-09-17T03:14:07.818156] [INFO ] [MAIN ] DIS: Loaded 40138 existing records. [2025-09-17T03:14:07.895814] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-17T03:14:08.005864] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:08.006196] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-17T03:14:08.006269] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-17T03:14:08.007749] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-17T03:14:08.007830] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-17T03:14:08.373545] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:08.569945] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T03:14:08.690199] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-17T03:14:09.490160] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-17T03:14:09.847430] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T03:14:10.116905] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T03:14:10.290131] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-11. [2025-09-17T03:14:10.300918] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T03:14:11.090138] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-17T03:14:11.807327] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T03:14:11.810100] [INFO ] [REMOTE ] DIAX: Full fetch complete (16897 records). [2025-09-17T03:14:11.810255] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-17T03:14:11.895348] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-17T03:14:12.180638] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-17T03:14:12.180755] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-17T03:14:12.181143] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-17T03:14:12.181201] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-17T03:14:12.181780] [DEBUG] [LOCAL ] DIAX: Trimmed 16897 records to 12242 (keeping 200 days of data) [2025-09-17T03:14:12.259338] [DEBUG] [LOCAL ] DIAX: Primary data saved (12242 records). [2025-09-17T03:14:12.259532] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-17T03:14:12.259673] [INFO ] [MAIN ] Update Progress: 620/2369 symbols completed. DIAX took 28.7s. Estimated remaining: 4h 14m 9s. Rate: 6.9 symbols/min [2025-09-17T03:14:12.427314] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:12.427488] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-17T03:14:12.427552] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-17T03:14:12.427685] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-17T03:14:12.427735] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-17T03:14:12.427784] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-17T03:14:12.427821] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-17T03:14:12.697156] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-17T03:14:12.787839] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:12.883057] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-11 (2.59 seconds). [2025-09-17T03:14:13.490135] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-17T03:14:13.636776] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T03:14:14.295310] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-17T03:14:14.311359] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T03:14:15.090137] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-11. [2025-09-17T03:14:15.461825] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T03:14:15.890117] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-17T03:14:15.952166] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-17T03:14:16.004855] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:14:16.179191] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-17T03:14:16.690200] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-17T03:14:16.975803] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-17T03:14:17.490147] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-17T03:14:18.290143] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-17T03:14:19.090143] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-17T03:14:19.265200] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T03:14:19.465914] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-17T03:14:19.890190] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-17T03:14:20.610330] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-17T03:14:20.690128] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-17T03:14:21.346289] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T03:14:21.490130] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-17T03:14:22.290135] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-17T03:14:22.635448] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T03:14:22.749034] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T03:14:22.969161] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T03:14:23.090119] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-17T03:14:23.890130] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-17T03:14:24.268036] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T03:14:24.690133] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-17T03:14:25.490116] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-17T03:14:25.797200] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T03:14:25.927424] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T03:14:26.290129] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-17T03:14:27.050239] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-17T03:14:27.090079] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-17T03:14:27.890216] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-17T03:14:28.232665] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T03:14:28.690122] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-17T03:14:29.070862] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T03:14:29.207736] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T03:14:29.395751] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T03:14:29.490128] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-17T03:14:30.290135] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-17T03:14:30.636796] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:14:30.893295] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T03:14:30.899864] [INFO ] [REMOTE ] DIN: Full fetch complete (54745 records). [2025-09-17T03:14:30.900053] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-17T03:14:31.095290] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-17T03:14:31.282456] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-17T03:14:31.282554] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-17T03:14:31.283208] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-17T03:14:31.283265] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-17T03:14:31.284377] [DEBUG] [LOCAL ] DIN: Trimmed 54745 records to 37412 (keeping 200 days of data) [2025-09-17T03:14:31.510160] [DEBUG] [LOCAL ] DIN: Primary data saved (37412 records). [2025-09-17T03:14:31.510364] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-17T03:14:31.510511] [INFO ] [MAIN ] Update Progress: 621/2369 symbols completed. DIN took 34.5s. Estimated remaining: 4h 14m 30s. Rate: 6.9 symbols/min [2025-09-17T03:14:31.685523] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:31.729064] [DEBUG] [LOCAL ] DK: Loaded 36998 existing records from primary storage. [2025-09-17T03:14:31.729263] [INFO ] [MAIN ] DK: Loaded 36998 existing records. [2025-09-17T03:14:31.890786] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-17T03:14:31.913821] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:31.914019] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-17T03:14:31.914094] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-17T03:14:31.915102] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-17T03:14:31.915180] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-17T03:14:32.274380] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:32.343229] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T03:14:32.690126] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-17T03:14:33.490154] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-17T03:14:33.661378] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.57 seconds). [2025-09-17T03:14:33.852478] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-17T03:14:34.121729] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T03:14:34.290189] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-17T03:14:34.656990] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T03:14:34.657789] [INFO ] [REMOTE ] DIVY: Full fetch complete (1724 records). [2025-09-17T03:14:34.657873] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-17T03:14:34.833014] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T03:14:34.833224] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:14:34.833276] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:14:34.833316] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-17T03:14:34.833383] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-17T03:14:34.833429] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-17T03:14:34.833489] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-17T03:14:34.833562] [INFO ] [MAIN ] Update Progress: 622/2369 symbols completed. DIVY took 22.6s. Estimated remaining: 4h 14m 6s. Rate: 6.9 symbols/min [2025-09-17T03:14:35.001682] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:35.015938] [DEBUG] [LOCAL ] DKL: Loaded 12673 existing records from primary storage. [2025-09-17T03:14:35.016087] [INFO ] [MAIN ] DKL: Loaded 12673 existing records. [2025-09-17T03:14:35.095264] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-17T03:14:35.201695] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:35.201970] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-17T03:14:35.202030] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-17T03:14:35.202437] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-17T03:14:35.202520] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-17T03:14:35.557121] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:35.890179] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-17T03:14:36.690150] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-11. [2025-09-17T03:14:37.437569] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-17T03:14:37.490100] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-17T03:14:37.777553] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T03:14:37.929045] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T03:14:38.290133] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-17T03:14:39.090137] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-11. [2025-09-17T03:14:39.674178] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T03:14:39.890099] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-17T03:14:40.065062] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T03:14:40.244103] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T03:14:40.690189] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-17T03:14:41.490161] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-17T03:14:42.248303] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T03:14:42.255411] [INFO ] [REMOTE ] DINO: Full fetch complete (76461 records). [2025-09-17T03:14:42.255738] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-17T03:14:42.299579] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-17T03:14:42.547632] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.66 seconds). [2025-09-17T03:14:42.720737] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-17T03:14:42.720879] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-17T03:14:42.721830] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-17T03:14:42.721925] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-17T03:14:42.723491] [DEBUG] [LOCAL ] DINO: Trimmed 76461 records to 52976 (keeping 200 days of data) [2025-09-17T03:14:43.055211] [DEBUG] [LOCAL ] DINO: Primary data saved (52976 records). [2025-09-17T03:14:43.055437] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-17T03:14:43.055559] [INFO ] [MAIN ] Update Progress: 623/2369 symbols completed. DINO took 41.8s. Estimated remaining: 4h 13m 55s. Rate: 6.9 symbols/min [2025-09-17T03:14:43.100146] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-17T03:14:43.260484] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:43.265582] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T03:14:43.312312] [DEBUG] [LOCAL ] DKS: Loaded 37152 existing records from primary storage. [2025-09-17T03:14:43.312519] [INFO ] [MAIN ] DKS: Loaded 37152 existing records. [2025-09-17T03:14:43.492319] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:43.492829] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-17T03:14:43.506352] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-17T03:14:43.506864] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T03:14:43.511934] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-17T03:14:43.512694] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-17T03:14:43.900303] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-17T03:14:43.905144] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:44.690136] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-11. [2025-09-17T03:14:45.161273] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-17T03:14:45.167913] [INFO ] [REMOTE ] DIS: Full fetch complete (77937 records). [2025-09-17T03:14:45.168075] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-17T03:14:45.492632] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-17T03:14:45.598007] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-17T03:14:45.598210] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-17T03:14:45.599416] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-17T03:14:45.599597] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-17T03:14:45.612744] [DEBUG] [LOCAL ] DIS: Trimmed 77937 records to 53788 (keeping 200 days of data) [2025-09-17T03:14:45.629845] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T03:14:45.998720] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-09-17T03:14:45.998987] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-17T03:14:45.999142] [INFO ] [MAIN ] Update Progress: 624/2369 symbols completed. DIS took 38.4s. Estimated remaining: 4h 13m 31s. Rate: 6.9 symbols/min [2025-09-17T03:14:46.178718] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:14:46.206154] [DEBUG] [LOCAL ] DLB: Loaded 23929 existing records from primary storage. [2025-09-17T03:14:46.206376] [INFO ] [MAIN ] DLB: Loaded 23929 existing records. [2025-09-17T03:14:46.295373] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-17T03:14:46.430443] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:14:46.430822] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-17T03:14:46.430889] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-17T03:14:46.431756] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-17T03:14:46.431827] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-17T03:14:46.839200] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:14:46.857216] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T03:14:46.910785] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T03:14:47.090182] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-11. [2025-09-17T03:14:47.904853] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-17T03:14:47.936027] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:14:48.509744] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:14:48.690199] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-17T03:14:49.051427] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:14:49.490154] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-17T03:14:50.074676] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T03:14:50.290145] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-17T03:14:50.480507] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:14:51.090242] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-17T03:14:51.873886] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T03:14:51.890089] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-17T03:14:52.526833] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T03:14:52.690180] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-17T03:14:53.490206] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-17T03:14:53.544126] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T03:14:53.653941] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T03:14:54.290228] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-17T03:14:55.090191] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-17T03:14:55.342174] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:14:55.410746] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T03:14:55.890146] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-17T03:14:56.690140] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-17T03:14:56.860766] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T03:14:57.490142] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-17T03:14:57.543948] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T03:14:57.608566] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T03:14:58.290223] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-17T03:14:58.606632] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:14:59.090149] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-17T03:14:59.890098] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-17T03:14:59.959245] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T03:15:00.011261] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T03:15:00.690179] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-17T03:15:01.490163] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-17T03:15:01.644135] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T03:15:01.849224] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T03:15:02.290180] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-17T03:15:03.090164] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-17T03:15:03.890197] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-17T03:15:04.781808] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (2.49 seconds). [2025-09-17T03:15:04.788239] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-17T03:15:05.383450] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-17T03:15:05.490169] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-17T03:15:05.651701] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T03:15:05.654696] [INFO ] [REMOTE ] DKL: Full fetch complete (29861 records). [2025-09-17T03:15:05.654925] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-17T03:15:05.843433] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T03:15:06.133171] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-17T03:15:06.133630] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-17T03:15:06.135019] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-17T03:15:06.135260] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-17T03:15:06.137165] [DEBUG] [LOCAL ] DKL: Trimmed 29861 records to 19633 (keeping 200 days of data) [2025-09-17T03:15:06.282578] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (4.79 seconds). [2025-09-17T03:15:06.296183] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-17T03:15:06.331067] [DEBUG] [LOCAL ] DKL: Primary data saved (19633 records). [2025-09-17T03:15:06.331276] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-17T03:15:06.331414] [INFO ] [MAIN ] Update Progress: 625/2369 symbols completed. DKL took 31.5s. Estimated remaining: 4h 13m 54s. Rate: 6.9 symbols/min [2025-09-17T03:15:06.520774] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:06.527269] [DEBUG] [LOCAL ] DLNG: Loaded 4310 existing records from primary storage. [2025-09-17T03:15:06.527419] [INFO ] [MAIN ] DLNG: Loaded 4310 existing records. [2025-09-17T03:15:06.717159] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:06.717428] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-17T03:15:06.717516] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-17T03:15:06.717808] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-17T03:15:06.717894] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-17T03:15:07.091260] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-17T03:15:07.095019] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:07.124318] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T03:15:07.890131] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-17T03:15:08.035489] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T03:15:08.690220] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-11. [2025-09-17T03:15:08.943352] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T03:15:09.168347] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T03:15:09.183206] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T03:15:09.490146] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-17T03:15:10.290139] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-17T03:15:10.906311] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T03:15:11.090071] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-17T03:15:11.890120] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-17T03:15:12.036075] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T03:15:12.529318] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T03:15:12.690176] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-17T03:15:13.490144] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-17T03:15:13.520045] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T03:15:13.529099] [INFO ] [REMOTE ] DK: Full fetch complete (70360 records). [2025-09-17T03:15:13.529314] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-17T03:15:13.936448] [DEBUG] [VALIDATOR ] DK: All expected trading days are present. [2025-09-17T03:15:13.936661] [DEBUG] [VALIDATOR ] DK: Primary data validation passed. [2025-09-17T03:15:13.938019] [INFO ] [MAIN ] DK: Fetched primary data is valid. [2025-09-17T03:15:13.938119] [DEBUG] [LOCAL ] DK: Saving primary data. [2025-09-17T03:15:13.942526] [DEBUG] [LOCAL ] DK: Trimmed 70360 records to 49528 (keeping 200 days of data) [2025-09-17T03:15:14.293018] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-17T03:15:14.297057] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:15:14.315349] [DEBUG] [LOCAL ] DK: Primary data saved (49528 records). [2025-09-17T03:15:14.315615] [INFO ] [MAIN ] DK: Full history saved. [2025-09-17T03:15:14.315833] [INFO ] [MAIN ] Update Progress: 626/2369 symbols completed. DK took 42.8s. Estimated remaining: 4h 13m 43s. Rate: 6.9 symbols/min [2025-09-17T03:15:14.501013] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:14.534694] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T03:15:14.583520] [DEBUG] [LOCAL ] DLR: Loaded 37822 existing records from primary storage. [2025-09-17T03:15:14.583803] [INFO ] [MAIN ] DLR: Loaded 37822 existing records. [2025-09-17T03:15:14.783037] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:14.783509] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-17T03:15:14.783624] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-17T03:15:14.784880] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-17T03:15:14.784958] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-17T03:15:15.095358] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-17T03:15:15.163130] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:15.890153] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-11. [2025-09-17T03:15:15.967576] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T03:15:15.973331] [INFO ] [REMOTE ] DLB: Full fetch complete (46967 records). [2025-09-17T03:15:15.973478] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-17T03:15:16.367381] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-17T03:15:16.367527] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-17T03:15:16.368226] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-17T03:15:16.368294] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-17T03:15:16.369591] [DEBUG] [LOCAL ] DLB: Trimmed 46967 records to 32255 (keeping 200 days of data) [2025-09-17T03:15:16.578372] [DEBUG] [LOCAL ] DLB: Primary data saved (32255 records). [2025-09-17T03:15:16.578550] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-17T03:15:16.578681] [INFO ] [MAIN ] Update Progress: 627/2369 symbols completed. DLB took 30.6s. Estimated remaining: 4h 13m 17s. Rate: 6.9 symbols/min [2025-09-17T03:15:16.695208] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-17T03:15:16.752008] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:16.774222] [DEBUG] [LOCAL ] DLX: Loaded 21590 existing records from primary storage. [2025-09-17T03:15:16.774381] [INFO ] [MAIN ] DLX: Loaded 21590 existing records. [2025-09-17T03:15:16.972261] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:16.972504] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-17T03:15:16.972563] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-17T03:15:16.973185] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-17T03:15:16.973255] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-17T03:15:17.326460] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:17.490123] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-11. [2025-09-17T03:15:17.848915] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-17T03:15:18.097626] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T03:15:18.290140] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-17T03:15:18.308265] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T03:15:18.405478] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-11 (2.52 seconds). [2025-09-17T03:15:19.090133] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-17T03:15:19.115943] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T03:15:19.890134] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-17T03:15:20.618937] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T03:15:20.690139] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-17T03:15:20.940660] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:15:21.490153] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-17T03:15:21.831533] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:15:22.033189] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-17T03:15:22.290136] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-17T03:15:23.047921] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T03:15:23.090089] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-17T03:15:23.776635] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T03:15:23.890133] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-17T03:15:24.690103] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-17T03:15:25.091537] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T03:15:25.318860] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T03:15:25.490138] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-17T03:15:26.290174] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-17T03:15:27.090176] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-17T03:15:27.218092] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T03:15:27.890197] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-17T03:15:28.690128] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-17T03:15:28.821372] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T03:15:28.895964] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-17T03:15:29.357545] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T03:15:29.490160] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-17T03:15:29.746988] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T03:15:30.290178] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-17T03:15:30.781047] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T03:15:31.090148] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-17T03:15:31.691398] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T03:15:31.692670] [INFO ] [REMOTE ] DLNG: Full fetch complete (12175 records). [2025-09-17T03:15:31.692766] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-17T03:15:31.896629] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-17T03:15:32.083707] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-17T03:15:32.083913] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-17T03:15:32.084223] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-17T03:15:32.084307] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-17T03:15:32.085101] [DEBUG] [LOCAL ] DLNG: Trimmed 12175 records to 6341 (keeping 200 days of data) [2025-09-17T03:15:32.130092] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T03:15:32.142809] [INFO ] [REMOTE ] DKS: Full fetch complete (71570 records). [2025-09-17T03:15:32.143781] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-17T03:15:32.147194] [DEBUG] [LOCAL ] DLNG: Primary data saved (6341 records). [2025-09-17T03:15:32.147346] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-17T03:15:32.147663] [INFO ] [MAIN ] Update Progress: 628/2369 symbols completed. DLNG took 25.8s. Estimated remaining: 4h 13m 27s. Rate: 6.9 symbols/min [2025-09-17T03:15:32.500439] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:32.696740] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-17T03:15:32.722208] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-17T03:15:32.727834] [DEBUG] [LOCAL ] DLY: Loaded 13860 existing records from primary storage. [2025-09-17T03:15:32.727892] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-17T03:15:32.728009] [INFO ] [MAIN ] DLY: Loaded 13860 existing records. [2025-09-17T03:15:32.729398] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-17T03:15:32.742692] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-17T03:15:32.830879] [DEBUG] [LOCAL ] DKS: Trimmed 71570 records to 50024 (keeping 200 days of data) [2025-09-17T03:15:32.976387] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:33.002777] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-17T03:15:33.003215] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-17T03:15:33.005926] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-17T03:15:33.006777] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-17T03:15:33.381705] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:33.491380] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-11. [2025-09-17T03:15:33.595915] [DEBUG] [LOCAL ] DKS: Primary data saved (50024 records). [2025-09-17T03:15:33.596103] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-17T03:15:33.596215] [INFO ] [MAIN ] Update Progress: 629/2369 symbols completed. DKS took 50.5s. Estimated remaining: 4h 12m 58s. Rate: 6.9 symbols/min [2025-09-17T03:15:33.766514] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:33.771922] [DEBUG] [LOCAL ] DMA: Loaded 3636 existing records from primary storage. [2025-09-17T03:15:33.772047] [INFO ] [MAIN ] DMA: Loaded 3636 existing records. [2025-09-17T03:15:33.955375] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:33.955810] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-17T03:15:33.955903] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-17T03:15:33.956219] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-17T03:15:33.956295] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-17T03:15:34.271894] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-17T03:15:34.359896] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-17T03:15:34.364329] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:34.384155] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:15:34.578842] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T03:15:35.090212] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-11. [2025-09-17T03:15:35.550622] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T03:15:35.890184] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-17T03:15:36.124854] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T03:15:36.690185] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-17T03:15:36.850865] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T03:15:37.281168] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T03:15:37.490133] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-17T03:15:38.290101] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-17T03:15:38.639715] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T03:15:39.090153] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-17T03:15:39.649822] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T03:15:39.712561] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T03:15:39.890207] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-17T03:15:40.690138] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-17T03:15:41.490161] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-17T03:15:41.710432] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:15:41.814630] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T03:15:42.083895] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:15:42.290189] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-17T03:15:43.090179] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-17T03:15:43.506924] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T03:15:43.890208] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-17T03:15:44.079374] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T03:15:44.474982] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T03:15:44.690180] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-17T03:15:45.490157] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-17T03:15:45.757245] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T03:15:46.290144] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-17T03:15:47.090150] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-17T03:15:47.282117] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T03:15:47.597737] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T03:15:47.890111] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-17T03:15:48.167624] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T03:15:48.403504] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T03:15:48.690341] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-17T03:15:49.401678] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T03:15:49.490114] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-17T03:15:50.290200] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-17T03:15:50.501539] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T03:15:51.090152] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-17T03:15:51.890133] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-17T03:15:52.106954] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T03:15:52.153938] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:15:52.359273] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T03:15:52.690229] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-17T03:15:53.283811] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:15:53.490157] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-17T03:15:54.290157] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-17T03:15:54.641840] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:15:54.645415] [INFO ] [REMOTE ] DLX: Full fetch complete (41016 records). [2025-09-17T03:15:54.645548] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-17T03:15:55.028378] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-17T03:15:55.028505] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-17T03:15:55.029292] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-17T03:15:55.029382] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-17T03:15:55.030571] [DEBUG] [LOCAL ] DLX: Trimmed 41016 records to 29367 (keeping 200 days of data) [2025-09-17T03:15:55.093525] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-17T03:15:55.217597] [DEBUG] [LOCAL ] DLX: Primary data saved (29367 records). [2025-09-17T03:15:55.217836] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-17T03:15:55.217975] [INFO ] [MAIN ] Update Progress: 630/2369 symbols completed. DLX took 38.6s. Estimated remaining: 4h 13m 25s. Rate: 6.9 symbols/min [2025-09-17T03:15:55.398026] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:55.407626] [DEBUG] [LOCAL ] DMB: Loaded 7953 existing records from primary storage. [2025-09-17T03:15:55.407786] [INFO ] [MAIN ] DMB: Loaded 7953 existing records. [2025-09-17T03:15:55.586222] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:55.586460] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-17T03:15:55.586520] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-17T03:15:55.586943] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-17T03:15:55.587014] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-17T03:15:55.891121] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-17T03:15:55.892309] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T03:15:55.979416] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:56.605168] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T03:15:56.690145] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-17T03:15:56.945205] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T03:15:57.490146] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-17T03:15:57.617614] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T03:15:57.901704] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T03:15:57.903048] [INFO ] [REMOTE ] DMA: Full fetch complete (6433 records). [2025-09-17T03:15:57.903135] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-17T03:15:58.260089] [DEBUG] [VALIDATOR ] DMA: All expected trading days are present. [2025-09-17T03:15:58.260186] [DEBUG] [VALIDATOR ] DMA: Primary data validation passed. [2025-09-17T03:15:58.260360] [INFO ] [MAIN ] DMA: Fetched primary data is valid. [2025-09-17T03:15:58.260405] [DEBUG] [LOCAL ] DMA: Saving primary data. [2025-09-17T03:15:58.260811] [DEBUG] [LOCAL ] DMA: Trimmed 6433 records to 4541 (keeping 200 days of data) [2025-09-17T03:15:58.287431] [DEBUG] [LOCAL ] DMA: Primary data saved (4541 records). [2025-09-17T03:15:58.287510] [INFO ] [MAIN ] DMA: Full history saved. [2025-09-17T03:15:58.287595] [INFO ] [MAIN ] Update Progress: 631/2369 symbols completed. DMA took 24.7s. Estimated remaining: 4h 13m 1s. Rate: 6.9 symbols/min [2025-09-17T03:15:58.297850] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-17T03:15:58.457864] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:15:58.466580] [DEBUG] [LOCAL ] DMO: Loaded 6948 existing records from primary storage. [2025-09-17T03:15:58.466722] [INFO ] [MAIN ] DMO: Loaded 6948 existing records. [2025-09-17T03:15:58.673289] [WARN ] [MAIN ] DMO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:15:58.673794] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-17T03:15:58.673850] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-17T03:15:58.674263] [DEBUG] [LOCAL ] DMO: Deleted primary data file. [2025-09-17T03:15:58.674327] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-17T03:15:59.041282] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:15:59.090118] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-11. [2025-09-17T03:15:59.195554] [DEBUG] [REMOTE ] DMO: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-17T03:15:59.195967] [WARN ] [REMOTE ] DMO: No data returned for month 2024-11 [2025-09-17T03:15:59.890158] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-17T03:16:00.119558] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T03:16:00.126131] [INFO ] [REMOTE ] DLR: Full fetch complete (74123 records). [2025-09-17T03:16:00.126299] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-17T03:16:00.511229] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-17T03:16:00.511338] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-17T03:16:00.512251] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-17T03:16:00.512314] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-17T03:16:00.513845] [DEBUG] [LOCAL ] DLR: Trimmed 74123 records to 51267 (keeping 200 days of data) [2025-09-17T03:16:00.707790] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-17T03:16:00.845117] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T03:16:00.851315] [INFO ] [REMOTE ] DLY: Full fetch complete (27800 records). [2025-09-17T03:16:00.852811] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-17T03:16:00.964417] [DEBUG] [LOCAL ] DLR: Primary data saved (51267 records). [2025-09-17T03:16:00.964590] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-17T03:16:00.964705] [INFO ] [MAIN ] Update Progress: 632/2369 symbols completed. DLR took 46.6s. Estimated remaining: 4h 12m 35s. Rate: 6.9 symbols/min [2025-09-17T03:16:01.297903] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:16:01.418260] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-17T03:16:01.418406] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-17T03:16:01.419040] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-17T03:16:01.419116] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-17T03:16:01.420272] [DEBUG] [LOCAL ] DLY: Trimmed 27800 records to 19079 (keeping 200 days of data) [2025-09-17T03:16:01.525787] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-11. [2025-09-17T03:16:01.550870] [DEBUG] [LOCAL ] DNA: Loaded 35867 existing records from primary storage. [2025-09-17T03:16:01.552343] [INFO ] [MAIN ] DNA: Loaded 35867 existing records. [2025-09-17T03:16:01.744174] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:16:01.796665] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:16:01.796513] [DEBUG] [LOCAL ] DLY: Primary data saved (19079 records). [2025-09-17T03:16:01.797029] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-17T03:16:01.797291] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-17T03:16:01.797674] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-17T03:16:01.797958] [INFO ] [MAIN ] Update Progress: 633/2369 symbols completed. DLY took 29.7s. Estimated remaining: 4h 12m 5s. Rate: 6.9 symbols/min [2025-09-17T03:16:01.803763] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-17T03:16:01.849076] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-17T03:16:02.187584] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:16:02.290675] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-17T03:16:02.401930] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:16:02.409314] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T03:16:02.425711] [DEBUG] [LOCAL ] DNOW: Loaded 31921 existing records from primary storage. [2025-09-17T03:16:02.425907] [INFO ] [MAIN ] DNOW: Loaded 31921 existing records. [2025-09-17T03:16:02.605273] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:16:02.605558] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-17T03:16:02.605620] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-17T03:16:02.606426] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-17T03:16:02.606489] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-17T03:16:02.973197] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:16:03.090135] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-17T03:16:03.245758] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T03:16:03.734591] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T03:16:03.890127] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-17T03:16:04.690131] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-11. [2025-09-17T03:16:04.761096] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T03:16:05.490131] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-11. [2025-09-17T03:16:06.290147] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-17T03:16:06.323377] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T03:16:06.930143] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:16:07.063787] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T03:16:07.090086] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-17T03:16:07.811924] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T03:16:07.890134] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-17T03:16:08.645594] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T03:16:08.690164] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-17T03:16:09.490158] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-17T03:16:09.536027] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T03:16:10.286178] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T03:16:10.290075] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-17T03:16:11.090136] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-17T03:16:11.184878] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T03:16:11.890127] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-17T03:16:12.690137] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-17T03:16:12.854472] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T03:16:13.423058] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T03:16:13.468566] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T03:16:13.490090] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-17T03:16:14.290179] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-17T03:16:14.364982] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T03:16:15.090142] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-17T03:16:15.828827] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T03:16:15.890134] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-17T03:16:16.690152] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-17T03:16:16.848372] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T03:16:17.017348] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T03:16:17.490163] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-17T03:16:17.592408] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T03:16:18.290153] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-17T03:16:19.090121] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-17T03:16:19.513464] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T03:16:19.890760] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-17T03:16:19.923208] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T03:16:19.922722] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:16:20.690123] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-17T03:16:21.490137] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-17T03:16:21.532540] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T03:16:21.828165] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T03:16:22.290130] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-17T03:16:23.078408] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T03:16:23.090076] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-17T03:16:23.135499] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T03:16:23.890158] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-17T03:16:24.594849] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T03:16:24.653155] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T03:16:24.690137] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-17T03:16:25.490135] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-17T03:16:25.563469] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T03:16:26.290155] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-17T03:16:26.322788] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T03:16:26.324990] [INFO ] [REMOTE ] DMB: Full fetch complete (14879 records). [2025-09-17T03:16:26.325082] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-17T03:16:26.687363] [DEBUG] [VALIDATOR ] DMB: All expected trading days are present. [2025-09-17T03:16:26.687480] [DEBUG] [VALIDATOR ] DMB: Primary data validation passed. [2025-09-17T03:16:26.687856] [INFO ] [MAIN ] DMB: Fetched primary data is valid. [2025-09-17T03:16:26.687913] [DEBUG] [LOCAL ] DMB: Saving primary data. [2025-09-17T03:16:26.688476] [DEBUG] [LOCAL ] DMB: Trimmed 14879 records to 10037 (keeping 200 days of data) [2025-09-17T03:16:26.750406] [DEBUG] [LOCAL ] DMB: Primary data saved (10037 records). [2025-09-17T03:16:26.750584] [INFO ] [MAIN ] DMB: Full history saved. [2025-09-17T03:16:26.750701] [INFO ] [MAIN ] Update Progress: 634/2369 symbols completed. DMB took 31.5s. Estimated remaining: 4h 12m 41s. Rate: 6.9 symbols/min [2025-09-17T03:16:26.919997] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:16:26.942683] [DEBUG] [LOCAL ] DNP: Loaded 24576 existing records from primary storage. [2025-09-17T03:16:26.942862] [INFO ] [MAIN ] DNP: Loaded 24576 existing records. [2025-09-17T03:16:27.096976] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-17T03:16:27.127131] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:16:27.127338] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-17T03:16:27.127401] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-17T03:16:27.128175] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-17T03:16:27.128238] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-17T03:16:27.520513] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:16:27.707073] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T03:16:27.890378] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T03:16:27.890143] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-11. [2025-09-17T03:16:27.892867] [INFO ] [REMOTE ] DMO: Full fetch complete (14246 records). [2025-09-17T03:16:27.892958] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-17T03:16:28.080725] [WARN ] [VALIDATOR ] DMO: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T03:16:28.081037] [FATAL] [MAIN ] DMO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:16:28.081095] [WARN ] [MAIN ] DMO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:16:28.081155] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-17T03:16:28.081219] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-17T03:16:28.081284] [INFO ] [LOCAL ] DMO: Starting deletion of derivative data. [2025-09-17T03:16:28.081694] [DEBUG] [LOCAL ] DMO: Deleted derivative data file. [2025-09-17T03:16:28.081807] [INFO ] [MAIN ] Update Progress: 635/2369 symbols completed. DMO took 29.8s. Estimated remaining: 4h 12m 12s. Rate: 6.9 symbols/min [2025-09-17T03:16:28.254450] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:16:28.292634] [DEBUG] [LOCAL ] DOC: Loaded 39924 existing records from primary storage. [2025-09-17T03:16:28.292834] [INFO ] [MAIN ] DOC: Loaded 39924 existing records. [2025-09-17T03:16:28.479587] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:16:28.479886] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-17T03:16:28.479948] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-17T03:16:28.480769] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-17T03:16:28.480831] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-17T03:16:28.695345] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-17T03:16:28.841598] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:16:29.367347] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T03:16:29.490134] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-11. [2025-09-17T03:16:30.290185] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-17T03:16:30.399702] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T03:16:31.090196] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-17T03:16:31.240557] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:16:31.301496] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T03:16:31.890210] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-17T03:16:32.690206] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-17T03:16:33.014348] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T03:16:33.490156] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-17T03:16:33.705470] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T03:16:34.218558] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T03:16:34.290200] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-17T03:16:35.090190] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-17T03:16:35.280183] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T03:16:35.637390] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T03:16:35.890135] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-17T03:16:36.690143] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-17T03:16:36.879553] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T03:16:37.408357] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T03:16:37.490164] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-17T03:16:38.101365] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T03:16:38.290130] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-17T03:16:39.090196] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-17T03:16:39.255517] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T03:16:39.890145] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-17T03:16:40.043373] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T03:16:40.506070] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T03:16:40.511293] [INFO ] [REMOTE ] DNOW: Full fetch complete (61964 records). [2025-09-17T03:16:40.511486] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-17T03:16:40.695133] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-17T03:16:40.923462] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-17T03:16:40.923568] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-17T03:16:40.924285] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-17T03:16:40.924351] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-17T03:16:40.925622] [DEBUG] [LOCAL ] DNOW: Trimmed 61964 records to 43432 (keeping 200 days of data) [2025-09-17T03:16:41.178089] [DEBUG] [LOCAL ] DNOW: Primary data saved (43432 records). [2025-09-17T03:16:41.178243] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-17T03:16:41.178340] [INFO ] [MAIN ] Update Progress: 636/2369 symbols completed. DNOW took 39.4s. Estimated remaining: 4h 12m 15s. Rate: 6.9 symbols/min [2025-09-17T03:16:41.352013] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:16:41.389860] [DEBUG] [LOCAL ] DOCN: Loaded 37915 existing records from primary storage. [2025-09-17T03:16:41.390046] [INFO ] [MAIN ] DOCN: Loaded 37915 existing records. [2025-09-17T03:16:41.493050] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-17T03:16:41.573416] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:16:41.573722] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-17T03:16:41.573931] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-17T03:16:41.574680] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-17T03:16:41.574745] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-17T03:16:41.962197] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-17T03:16:41.965521] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:16:42.290115] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-17T03:16:42.743534] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T03:16:43.071900] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:16:43.090071] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-17T03:16:43.865242] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:16:43.890102] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-17T03:16:44.574466] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T03:16:44.690172] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-17T03:16:45.490197] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-17T03:16:45.828953] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T03:16:46.290114] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-17T03:16:46.654736] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T03:16:46.688022] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T03:16:47.090176] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-17T03:16:47.890150] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-17T03:16:47.976063] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T03:16:47.982553] [INFO ] [REMOTE ] DNA: Full fetch complete (70800 records). [2025-09-17T03:16:47.982726] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-17T03:16:48.378916] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-17T03:16:48.379087] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-17T03:16:48.379915] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-17T03:16:48.380004] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-17T03:16:48.381588] [DEBUG] [LOCAL ] DNA: Trimmed 70800 records to 48560 (keeping 200 days of data) [2025-09-17T03:16:48.487065] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T03:16:48.692726] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-17T03:16:48.698450] [DEBUG] [LOCAL ] DNA: Primary data saved (48560 records). [2025-09-17T03:16:48.698633] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-17T03:16:48.698778] [INFO ] [MAIN ] Update Progress: 637/2369 symbols completed. DNA took 47.7s. Estimated remaining: 4h 12m 3s. Rate: 6.9 symbols/min [2025-09-17T03:16:49.490192] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-11. [2025-09-17T03:16:49.791142] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T03:16:50.045983] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T03:16:50.290139] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-17T03:16:51.090147] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-17T03:16:51.241302] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:16:51.533413] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T03:16:51.539873] [INFO ] [REMOTE ] DNP: Full fetch complete (49470 records). [2025-09-17T03:16:51.540093] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-17T03:16:51.895203] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-17T03:16:51.971969] [DEBUG] [VALIDATOR ] DNP: All expected trading days are present. [2025-09-17T03:16:51.972087] [DEBUG] [VALIDATOR ] DNP: Primary data validation passed. [2025-09-17T03:16:51.972785] [INFO ] [MAIN ] DNP: Fetched primary data is valid. [2025-09-17T03:16:51.972845] [DEBUG] [LOCAL ] DNP: Saving primary data. [2025-09-17T03:16:51.974080] [DEBUG] [LOCAL ] DNP: Trimmed 49470 records to 33548 (keeping 200 days of data) [2025-09-17T03:16:52.180807] [DEBUG] [LOCAL ] DNP: Primary data saved (33548 records). [2025-09-17T03:16:52.180990] [INFO ] [MAIN ] DNP: Full history saved. [2025-09-17T03:16:52.181099] [INFO ] [MAIN ] Update Progress: 638/2369 symbols completed. DNP took 25.4s. Estimated remaining: 4h 11m 40s. Rate: 6.9 symbols/min [2025-09-17T03:16:53.148657] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T03:16:53.160750] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-17T03:16:53.236809] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T03:16:53.490197] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-17T03:16:54.997983] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:16:55.007462] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-17T03:16:55.122145] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T03:16:55.133850] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-17T03:16:56.716324] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:16:56.728227] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-17T03:16:56.884131] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:16:56.892085] [INFO ] [REMOTE ] DOC: Full fetch complete (77206 records). [2025-09-17T03:16:56.892322] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-17T03:16:57.286292] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-17T03:16:57.286422] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-17T03:16:57.287363] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-17T03:16:57.287429] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-17T03:16:57.289059] [DEBUG] [LOCAL ] DOC: Trimmed 77206 records to 53537 (keeping 200 days of data) [2025-09-17T03:16:57.635499] [DEBUG] [LOCAL ] DOC: Primary data saved (53537 records). [2025-09-17T03:16:57.635701] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-17T03:16:57.635809] [INFO ] [MAIN ] Update Progress: 639/2369 symbols completed. DOC took 29.6s. Estimated remaining: 4h 11m 22s. Rate: 6.9 symbols/min [2025-09-17T03:16:58.518770] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T03:16:58.529041] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-17T03:17:00.256618] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T03:17:00.267259] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-17T03:17:02.076483] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T03:17:02.087706] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-17T03:17:03.911458] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T03:17:03.922545] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-17T03:17:05.806834] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T03:17:05.818622] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-17T03:17:07.842527] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T03:17:07.853729] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-17T03:17:09.607325] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:17:09.613600] [INFO ] [REMOTE ] DOCN: Full fetch complete (70661 records). [2025-09-17T03:17:09.613763] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-17T03:17:10.011123] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-17T03:17:10.011253] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-17T03:17:10.012053] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-17T03:17:10.012111] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-17T03:17:10.013455] [DEBUG] [LOCAL ] DOCN: Trimmed 70661 records to 50377 (keeping 200 days of data) [2025-09-17T03:17:10.316284] [DEBUG] [LOCAL ] DOCN: Primary data saved (50377 records). [2025-09-17T03:17:10.316482] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-17T03:17:10.316612] [INFO ] [MAIN ] Update Progress: 640/2369 symbols completed. DOCN took 29.1s. Estimated remaining: 4h 11m 24s. Rate: 6.9 symbols/min [2025-09-17T03:17:10.842929] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:10.892952] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:11.021413] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:11.022741] [DEBUG] [LOCAL ] DOUG: No existing data file found in primary storage. [2025-09-17T03:17:11.022801] [WARN ] [MAIN ] DOUG: No existing data found, performing full refresh instead. [2025-09-17T03:17:11.022392] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:11.023345] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-17T03:17:11.023551] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-17T03:17:11.023666] [DEBUG] [LOCAL ] DOUG: No primary data file found to delete. [2025-09-17T03:17:11.023714] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-17T03:17:11.228360] [DEBUG] [LOCAL ] DOLE: Loaded 28584 existing records from primary storage. [2025-09-17T03:17:11.263603] [INFO ] [MAIN ] DOLE: Loaded 28584 existing records. [2025-09-17T03:17:11.435143] [DEBUG] [LOCAL ] DOCS: Loaded 37942 existing records from primary storage. [2025-09-17T03:17:11.456536] [INFO ] [MAIN ] DOCS: Loaded 37942 existing records. [2025-09-17T03:17:11.435273] [DEBUG] [LOCAL ] DOV: Loaded 33591 existing records from primary storage. [2025-09-17T03:17:11.501877] [INFO ] [MAIN ] DOV: Loaded 33591 existing records. [2025-09-17T03:17:11.896099] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:12.014897] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-11. [2025-09-17T03:17:11.991449] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:12.038553] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:12.041783] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:12.041992] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-17T03:17:12.042262] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-17T03:17:12.042292] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-17T03:17:12.042441] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-17T03:17:12.042686] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-17T03:17:12.042481] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-17T03:17:12.043576] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-17T03:17:12.043611] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-17T03:17:12.043655] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-17T03:17:12.043984] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-17T03:17:12.044157] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-17T03:17:12.043853] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-17T03:17:13.029837] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:13.065457] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:13.061362] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-11. [2025-09-17T03:17:13.070924] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-11. [2025-09-17T03:17:13.131498] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:13.132135] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-11. [2025-09-17T03:17:13.490208] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T03:17:13.498353] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-17T03:17:14.623352] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T03:17:14.631740] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-17T03:17:14.653689] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T03:17:14.661387] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-17T03:17:14.936282] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T03:17:14.946732] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-17T03:17:14.977609] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T03:17:14.986927] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-17T03:17:15.802665] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:17:15.809780] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-17T03:17:15.951500] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T03:17:15.959608] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-17T03:17:16.371472] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T03:17:16.381951] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-17T03:17:16.413966] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:17:16.421384] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-17T03:17:17.221628] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T03:17:17.235206] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-17T03:17:17.388422] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:17:17.397824] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-17T03:17:17.428325] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T03:17:17.436091] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-17T03:17:18.068990] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T03:17:18.079770] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-17T03:17:18.133046] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T03:17:18.140136] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-17T03:17:18.835737] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T03:17:18.846678] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-17T03:17:18.869031] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T03:17:18.877458] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-17T03:17:19.540156] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T03:17:19.547754] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-17T03:17:19.596422] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T03:17:19.607031] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-17T03:17:20.167102] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T03:17:20.177127] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-17T03:17:20.306290] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T03:17:20.314510] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-17T03:17:20.883197] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T03:17:20.891472] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-17T03:17:21.501500] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T03:17:21.513852] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-17T03:17:21.849750] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T03:17:22.067616] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T03:17:22.113254] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:17:22.290142] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-17T03:17:23.090120] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-17T03:17:23.287731] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:17:23.890136] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-17T03:17:23.942396] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T03:17:24.537341] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T03:17:24.690226] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-17T03:17:25.490189] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-17T03:17:25.571357] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T03:17:26.126299] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T03:17:26.290099] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-17T03:17:26.971629] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T03:17:27.090170] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-17T03:17:27.702382] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T03:17:27.890184] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-17T03:17:28.236679] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T03:17:28.690185] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-17T03:17:29.248611] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T03:17:29.490159] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-17T03:17:30.120271] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T03:17:30.290147] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-17T03:17:30.733853] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T03:17:30.738330] [INFO ] [REMOTE ] DOUG: Full fetch complete (51914 records). [2025-09-17T03:17:30.738506] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-17T03:17:31.100047] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-17T03:17:31.127402] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-17T03:17:31.127545] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-17T03:17:31.128478] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-17T03:17:31.128591] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-17T03:17:31.130689] [DEBUG] [LOCAL ] DOUG: Trimmed 51914 records to 34879 (keeping 200 days of data) [2025-09-17T03:17:31.341441] [DEBUG] [LOCAL ] DOUG: Primary data saved (34879 records). [2025-09-17T03:17:31.341699] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-17T03:17:31.341845] [INFO ] [MAIN ] Update Progress: 641/2369 symbols completed. DOUG took 21.0s. Estimated remaining: 4h 11m 49s. Rate: 6.9 symbols/min [2025-09-17T03:17:31.516983] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:31.556946] [DEBUG] [LOCAL ] DOW: Loaded 40083 existing records from primary storage. [2025-09-17T03:17:31.557125] [INFO ] [MAIN ] DOW: Loaded 40083 existing records. [2025-09-17T03:17:31.739150] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:31.739395] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-17T03:17:31.739461] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-17T03:17:31.740307] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-17T03:17:31.740376] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-17T03:17:31.895338] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-17T03:17:32.103047] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:32.136235] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T03:17:32.690141] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-17T03:17:32.956151] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T03:17:33.470309] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T03:17:33.477744] [INFO ] [REMOTE ] DOLE: Full fetch complete (52821 records). [2025-09-17T03:17:33.477918] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-17T03:17:33.495367] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-17T03:17:33.898277] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-17T03:17:33.898391] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-17T03:17:33.899061] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-17T03:17:33.899122] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-17T03:17:33.900401] [DEBUG] [LOCAL ] DOLE: Trimmed 52821 records to 37771 (keeping 200 days of data) [2025-09-17T03:17:34.141350] [DEBUG] [LOCAL ] DOLE: Primary data saved (37771 records). [2025-09-17T03:17:34.141532] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-17T03:17:34.141672] [INFO ] [MAIN ] Update Progress: 642/2369 symbols completed. DOLE took 23.8s. Estimated remaining: 4h 11m 24s. Rate: 6.9 symbols/min [2025-09-17T03:17:34.299141] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-11. [2025-09-17T03:17:34.333169] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:34.348005] [DEBUG] [LOCAL ] DPG: Loaded 9792 existing records from primary storage. [2025-09-17T03:17:34.349238] [INFO ] [MAIN ] DPG: Loaded 9792 existing records. [2025-09-17T03:17:34.549975] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:34.560254] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-17T03:17:34.561057] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-17T03:17:34.562316] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T03:17:34.572081] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-17T03:17:34.572309] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-17T03:17:34.936400] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:35.090164] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-11. [2025-09-17T03:17:35.355364] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:17:35.890209] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-17T03:17:35.930087] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T03:17:36.039805] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T03:17:36.690137] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-17T03:17:37.490197] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-17T03:17:37.547597] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T03:17:37.705942] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T03:17:38.290137] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-17T03:17:38.971519] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T03:17:38.977102] [INFO ] [REMOTE ] DOV: Full fetch complete (64525 records). [2025-09-17T03:17:38.977241] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-17T03:17:39.095209] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-17T03:17:39.366592] [DEBUG] [VALIDATOR ] DOV: All expected trading days are present. [2025-09-17T03:17:39.366718] [DEBUG] [VALIDATOR ] DOV: Primary data validation passed. [2025-09-17T03:17:39.367438] [INFO ] [MAIN ] DOV: Fetched primary data is valid. [2025-09-17T03:17:39.367493] [DEBUG] [LOCAL ] DOV: Saving primary data. [2025-09-17T03:17:39.369011] [DEBUG] [LOCAL ] DOV: Trimmed 64525 records to 45883 (keeping 200 days of data) [2025-09-17T03:17:39.684100] [DEBUG] [LOCAL ] DOV: Primary data saved (45883 records). [2025-09-17T03:17:39.684366] [INFO ] [MAIN ] DOV: Full history saved. [2025-09-17T03:17:39.684511] [INFO ] [MAIN ] Update Progress: 643/2369 symbols completed. DOV took 29.4s. Estimated remaining: 4h 11m 7s. Rate: 6.9 symbols/min [2025-09-17T03:17:39.859976] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:39.883005] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:17:39.890578] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-17T03:17:39.891855] [INFO ] [REMOTE ] DOCS: Full fetch complete (74225 records). [2025-09-17T03:17:39.891951] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-17T03:17:40.136130] [DEBUG] [LOCAL ] DQ: Loaded 31641 existing records from primary storage. [2025-09-17T03:17:40.161436] [INFO ] [MAIN ] DQ: Loaded 31641 existing records. [2025-09-17T03:17:40.333690] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T03:17:40.478736] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-17T03:17:40.512480] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-17T03:17:40.517873] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:17:40.517767] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-17T03:17:40.518114] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-17T03:17:40.518180] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-17T03:17:40.518385] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-17T03:17:40.519288] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-17T03:17:40.519374] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-17T03:17:40.600630] [DEBUG] [LOCAL ] DOCS: Trimmed 74225 records to 51441 (keeping 200 days of data) [2025-09-17T03:17:40.703555] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-17T03:17:40.979174] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:41.186977] [DEBUG] [LOCAL ] DOCS: Primary data saved (51441 records). [2025-09-17T03:17:41.187153] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-17T03:17:41.187252] [INFO ] [MAIN ] Update Progress: 644/2369 symbols completed. DOCS took 30.9s. Estimated remaining: 4h 10m 38s. Rate: 6.9 symbols/min [2025-09-17T03:17:41.363299] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:17:41.363493] [DEBUG] [LOCAL ] DRD: No existing data file found in primary storage. [2025-09-17T03:17:41.363546] [WARN ] [MAIN ] DRD: No existing data found, performing full refresh instead. [2025-09-17T03:17:41.363669] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-17T03:17:41.363718] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-17T03:17:41.363798] [DEBUG] [LOCAL ] DRD: No primary data file found to delete. [2025-09-17T03:17:41.363855] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-17T03:17:41.495272] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-11. [2025-09-17T03:17:41.730552] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T03:17:41.760305] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:17:41.914892] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T03:17:42.290178] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-11. [2025-09-17T03:17:43.090152] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-17T03:17:43.260456] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T03:17:43.565353] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T03:17:43.890147] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-17T03:17:43.949482] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T03:17:44.690160] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-17T03:17:45.047208] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T03:17:45.490140] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-17T03:17:46.290196] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-17T03:17:46.438817] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T03:17:46.624913] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T03:17:47.090159] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-17T03:17:47.895888] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-17T03:17:47.913086] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T03:17:47.960320] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T03:17:48.690085] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-17T03:17:48.785326] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T03:17:49.490189] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-17T03:17:50.290123] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-17T03:17:50.576072] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T03:17:51.012102] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T03:17:51.090166] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-17T03:17:51.574113] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T03:17:51.890160] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-17T03:17:52.665512] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T03:17:52.690083] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-17T03:17:52.786489] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T03:17:53.490193] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-17T03:17:54.213122] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T03:17:54.290230] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-17T03:17:54.562229] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T03:17:55.090151] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-17T03:17:55.793982] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T03:17:55.890085] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-17T03:17:56.659467] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T03:17:56.690172] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-17T03:17:57.328121] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T03:17:57.490153] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-17T03:17:58.290142] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-17T03:17:58.426303] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T03:17:58.663920] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T03:17:59.090131] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-17T03:17:59.499979] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T03:17:59.857810] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T03:17:59.859772] [INFO ] [REMOTE ] DPG: Full fetch complete (18809 records). [2025-09-17T03:17:59.859857] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-17T03:17:59.895298] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-17T03:18:00.226402] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-17T03:18:00.226502] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-17T03:18:00.226904] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-17T03:18:00.226958] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-17T03:18:00.227528] [DEBUG] [LOCAL ] DPG: Trimmed 18809 records to 13284 (keeping 200 days of data) [2025-09-17T03:18:00.316751] [DEBUG] [LOCAL ] DPG: Primary data saved (13284 records). [2025-09-17T03:18:00.317036] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-17T03:18:00.317187] [INFO ] [MAIN ] Update Progress: 645/2369 symbols completed. DPG took 26.2s. Estimated remaining: 4h 10m 58s. Rate: 6.9 symbols/min [2025-09-17T03:18:00.501301] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:00.545869] [DEBUG] [LOCAL ] DRH: Loaded 37403 existing records from primary storage. [2025-09-17T03:18:00.546088] [INFO ] [MAIN ] DRH: Loaded 37403 existing records. [2025-09-17T03:18:00.697699] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-17T03:18:00.742150] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:00.742487] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-17T03:18:00.742554] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-17T03:18:00.743724] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-17T03:18:00.743799] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-17T03:18:01.106101] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:01.434678] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T03:18:01.490093] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-17T03:18:02.290140] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-11. [2025-09-17T03:18:03.090171] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-17T03:18:03.858099] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (3.16 seconds). [2025-09-17T03:18:03.890077] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-17T03:18:03.984541] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-17T03:18:04.690158] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-17T03:18:04.943496] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-11 (2.65 seconds). [2025-09-17T03:18:05.166900] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-17T03:18:05.490147] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-17T03:18:06.099009] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T03:18:06.290167] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-17T03:18:06.539328] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.65 seconds). [2025-09-17T03:18:07.031434] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T03:18:07.090126] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-17T03:18:07.890175] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-17T03:18:07.982041] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T03:18:08.224757] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T03:18:08.690197] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-17T03:18:09.490124] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-17T03:18:09.664971] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T03:18:10.232108] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T03:18:10.290085] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-17T03:18:10.957559] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T03:18:10.963533] [INFO ] [REMOTE ] DQ: Full fetch complete (62598 records). [2025-09-17T03:18:10.963684] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-17T03:18:11.104277] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-17T03:18:11.362133] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-17T03:18:11.362248] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-17T03:18:11.363016] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-17T03:18:11.363094] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-17T03:18:11.364355] [DEBUG] [LOCAL ] DQ: Trimmed 62598 records to 43010 (keeping 200 days of data) [2025-09-17T03:18:11.613190] [DEBUG] [LOCAL ] DQ: Primary data saved (43010 records). [2025-09-17T03:18:11.613369] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-17T03:18:11.613488] [INFO ] [MAIN ] Update Progress: 646/2369 symbols completed. DQ took 31.9s. Estimated remaining: 4h 10m 56s. Rate: 6.9 symbols/min [2025-09-17T03:18:11.786165] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:11.824026] [DEBUG] [LOCAL ] DRI: Loaded 35099 existing records from primary storage. [2025-09-17T03:18:11.824215] [INFO ] [MAIN ] DRI: Loaded 35099 existing records. [2025-09-17T03:18:11.897811] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-17T03:18:12.007363] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:12.007582] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-17T03:18:12.007686] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-17T03:18:12.008563] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-17T03:18:12.008629] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-17T03:18:12.362954] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:12.574955] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T03:18:12.610054] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T03:18:12.690097] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-17T03:18:13.490112] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-11. [2025-09-17T03:18:13.551870] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:18:14.290161] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-17T03:18:14.445705] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T03:18:14.685823] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T03:18:15.090122] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-17T03:18:15.890134] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-17T03:18:16.291753] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T03:18:16.690166] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-17T03:18:17.001174] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T03:18:17.490142] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-17T03:18:17.656982] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T03:18:17.662704] [INFO ] [REMOTE ] DRD: Full fetch complete (47719 records). [2025-09-17T03:18:17.662834] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-17T03:18:18.047528] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-17T03:18:18.047636] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-17T03:18:18.048242] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-17T03:18:18.048297] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-17T03:18:18.049427] [DEBUG] [LOCAL ] DRD: Trimmed 47719 records to 36102 (keeping 200 days of data) [2025-09-17T03:18:18.269537] [DEBUG] [LOCAL ] DRD: Primary data saved (36102 records). [2025-09-17T03:18:18.269711] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-17T03:18:18.269827] [INFO ] [MAIN ] Update Progress: 647/2369 symbols completed. DRD took 37.1s. Estimated remaining: 4h 10m 41s. Rate: 6.9 symbols/min [2025-09-17T03:18:18.301609] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-17T03:18:18.442739] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:18.451514] [DEBUG] [LOCAL ] DRLL: Loaded 6504 existing records from primary storage. [2025-09-17T03:18:18.451710] [INFO ] [MAIN ] DRLL: Loaded 6504 existing records. [2025-09-17T03:18:18.683294] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:18.683564] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-17T03:18:18.683623] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-17T03:18:18.683963] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-17T03:18:18.684021] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-17T03:18:19.042093] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:19.060454] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-17T03:18:19.067517] [INFO ] [REMOTE ] DOW: Full fetch complete (77661 records). [2025-09-17T03:18:19.067771] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-17T03:18:19.101596] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-11. [2025-09-17T03:18:19.472825] [DEBUG] [VALIDATOR ] DOW: All expected trading days are present. [2025-09-17T03:18:19.472956] [DEBUG] [VALIDATOR ] DOW: Primary data validation passed. [2025-09-17T03:18:19.473838] [INFO ] [MAIN ] DOW: Fetched primary data is valid. [2025-09-17T03:18:19.473900] [DEBUG] [LOCAL ] DOW: Saving primary data. [2025-09-17T03:18:19.475581] [DEBUG] [LOCAL ] DOW: Trimmed 77661 records to 53733 (keeping 200 days of data) [2025-09-17T03:18:19.831614] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-17T03:18:19.854892] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T03:18:19.867844] [DEBUG] [LOCAL ] DOW: Primary data saved (53733 records). [2025-09-17T03:18:19.868045] [INFO ] [MAIN ] DOW: Full history saved. [2025-09-17T03:18:19.868154] [INFO ] [MAIN ] Update Progress: 648/2369 symbols completed. DOW took 48.5s. Estimated remaining: 4h 10m 14s. Rate: 6.9 symbols/min [2025-09-17T03:18:19.898692] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-17T03:18:20.044413] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:20.064234] [DEBUG] [LOCAL ] DSL: Loaded 20214 existing records from primary storage. [2025-09-17T03:18:20.064389] [INFO ] [MAIN ] DSL: Loaded 20214 existing records. [2025-09-17T03:18:20.241823] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:20.242072] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-17T03:18:20.242131] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-17T03:18:20.242686] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-17T03:18:20.242743] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-17T03:18:20.603153] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:20.636478] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-17T03:18:20.690084] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-17T03:18:21.259725] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T03:18:21.490123] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-11. [2025-09-17T03:18:21.731997] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:18:22.290147] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-17T03:18:22.904367] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T03:18:23.090122] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-17T03:18:23.707508] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T03:18:23.890132] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-17T03:18:24.108377] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T03:18:24.690138] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-17T03:18:25.495668] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-17T03:18:25.516634] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T03:18:25.528103] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T03:18:26.290123] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-17T03:18:27.090167] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-17T03:18:27.276265] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T03:18:27.702359] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:18:27.890160] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-17T03:18:28.700980] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-17T03:18:28.703888] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:18:29.490196] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-17T03:18:29.604466] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T03:18:29.730299] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T03:18:30.109887] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T03:18:30.290162] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-17T03:18:31.090161] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-17T03:18:31.164465] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T03:18:31.890140] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-17T03:18:32.690141] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-17T03:18:32.720078] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T03:18:32.907775] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T03:18:33.490163] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-17T03:18:34.011253] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:18:34.290145] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-17T03:18:34.352175] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T03:18:35.090177] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-17T03:18:35.650142] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T03:18:35.794843] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T03:18:35.890136] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-17T03:18:36.690165] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-17T03:18:37.490272] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-17T03:18:37.632308] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T03:18:38.290291] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-17T03:18:38.294726] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T03:18:38.556784] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T03:18:39.090157] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-17T03:18:39.283194] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T03:18:39.890179] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-17T03:18:40.577602] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T03:18:40.579293] [INFO ] [REMOTE ] DRLL: Full fetch complete (16485 records). [2025-09-17T03:18:40.579380] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-17T03:18:40.693676] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-17T03:18:40.918920] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T03:18:41.017061] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-17T03:18:41.017180] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-17T03:18:41.017565] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-17T03:18:41.017621] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-17T03:18:41.018379] [DEBUG] [LOCAL ] DRLL: Trimmed 16485 records to 10058 (keeping 200 days of data) [2025-09-17T03:18:41.083924] [DEBUG] [LOCAL ] DRLL: Primary data saved (10058 records). [2025-09-17T03:18:41.084110] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-17T03:18:41.084216] [INFO ] [MAIN ] Update Progress: 649/2369 symbols completed. DRLL took 22.8s. Estimated remaining: 4h 10m 38s. Rate: 6.9 symbols/min [2025-09-17T03:18:41.268168] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:41.279901] [DEBUG] [LOCAL ] DSM: Loaded 10175 existing records from primary storage. [2025-09-17T03:18:41.280092] [INFO ] [MAIN ] DSM: Loaded 10175 existing records. [2025-09-17T03:18:41.467505] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:41.467768] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-17T03:18:41.467821] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-17T03:18:41.468211] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-17T03:18:41.468273] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-17T03:18:41.499439] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-17T03:18:41.845387] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:41.898355] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T03:18:42.290164] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-17T03:18:43.090201] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-11. [2025-09-17T03:18:43.258943] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:18:43.451845] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T03:18:43.890159] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-17T03:18:44.048563] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T03:18:44.690139] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-17T03:18:45.346524] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:18:45.490164] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-17T03:18:46.127079] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T03:18:46.132750] [INFO ] [REMOTE ] DRI: Full fetch complete (69223 records). [2025-09-17T03:18:46.132883] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-17T03:18:46.310742] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-17T03:18:46.528602] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-17T03:18:46.528742] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-17T03:18:46.529513] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-17T03:18:46.529575] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-17T03:18:46.530996] [DEBUG] [LOCAL ] DRI: Trimmed 69223 records to 47769 (keeping 200 days of data) [2025-09-17T03:18:46.643974] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T03:18:46.846002] [DEBUG] [LOCAL ] DRI: Primary data saved (47769 records). [2025-09-17T03:18:46.846166] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-17T03:18:46.846266] [INFO ] [MAIN ] Update Progress: 650/2369 symbols completed. DRI took 35.2s. Estimated remaining: 4h 10m 21s. Rate: 6.9 symbols/min [2025-09-17T03:18:47.013946] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:47.014168] [DEBUG] [LOCAL ] DSMC: No existing data file found in primary storage. [2025-09-17T03:18:47.014219] [WARN ] [MAIN ] DSMC: No existing data found, performing full refresh instead. [2025-09-17T03:18:47.014328] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-17T03:18:47.014378] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-17T03:18:47.014425] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-09-17T03:18:47.014470] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-17T03:18:47.095286] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-17T03:18:47.369751] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:47.729445] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T03:18:47.890155] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-11. [2025-09-17T03:18:48.108395] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T03:18:48.183720] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-11 (0.29 seconds). [2025-09-17T03:18:48.690156] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-17T03:18:49.490137] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-17T03:18:49.881993] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T03:18:49.885599] [INFO ] [REMOTE ] DSL: Full fetch complete (41308 records). [2025-09-17T03:18:49.885716] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-17T03:18:50.277170] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-17T03:18:50.277316] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-17T03:18:50.278026] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-17T03:18:50.278106] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-17T03:18:50.279275] [DEBUG] [LOCAL ] DSL: Trimmed 41308 records to 28139 (keeping 200 days of data) [2025-09-17T03:18:50.334031] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-17T03:18:50.458558] [DEBUG] [LOCAL ] DSL: Primary data saved (28139 records). [2025-09-17T03:18:50.458752] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-17T03:18:50.458862] [INFO ] [MAIN ] Update Progress: 651/2369 symbols completed. DSL took 30.6s. Estimated remaining: 4h 9m 59s. Rate: 6.9 symbols/min [2025-09-17T03:18:50.631376] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:50.648212] [DEBUG] [LOCAL ] DSU: Loaded 15673 existing records from primary storage. [2025-09-17T03:18:50.648368] [INFO ] [MAIN ] DSU: Loaded 15673 existing records. [2025-09-17T03:18:50.827369] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:50.827613] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-17T03:18:50.827691] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-17T03:18:50.828310] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-17T03:18:50.828374] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-17T03:18:51.098607] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-17T03:18:51.189834] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:51.205448] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T03:18:51.212232] [INFO ] [REMOTE ] DRH: Full fetch complete (71663 records). [2025-09-17T03:18:51.212388] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-17T03:18:51.557670] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T03:18:51.613299] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-17T03:18:51.614863] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-17T03:18:51.615807] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-17T03:18:51.615884] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-17T03:18:51.630092] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T03:18:51.635978] [DEBUG] [LOCAL ] DRH: Trimmed 71663 records to 50464 (keeping 200 days of data) [2025-09-17T03:18:51.898155] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-17T03:18:51.936931] [DEBUG] [LOCAL ] DRH: Primary data saved (50464 records). [2025-09-17T03:18:51.937085] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-17T03:18:51.937218] [INFO ] [MAIN ] Update Progress: 652/2369 symbols completed. DRH took 51.6s. Estimated remaining: 4h 9m 31s. Rate: 6.9 symbols/min [2025-09-17T03:18:52.108670] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:18:52.126499] [DEBUG] [LOCAL ] DSX: Loaded 17834 existing records from primary storage. [2025-09-17T03:18:52.126717] [INFO ] [MAIN ] DSX: Loaded 17834 existing records. [2025-09-17T03:18:52.236987] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T03:18:52.315082] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:18:52.315330] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-17T03:18:52.315390] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-17T03:18:52.315949] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-17T03:18:52.316012] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-17T03:18:52.666832] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:18:52.690082] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-11. [2025-09-17T03:18:53.490131] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-17T03:18:54.165606] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T03:18:54.290129] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-17T03:18:54.668686] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T03:18:55.090135] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-17T03:18:55.544675] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T03:18:55.798046] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T03:18:55.890101] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-11. [2025-09-17T03:18:56.690122] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-17T03:18:56.922628] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:18:57.490159] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-17T03:18:57.742447] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T03:18:58.059918] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T03:18:58.290135] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-17T03:18:59.090187] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-17T03:18:59.145419] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T03:18:59.663727] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T03:18:59.890151] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-17T03:19:00.280877] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-17T03:19:00.690136] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-17T03:19:01.056376] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T03:19:01.490175] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-17T03:19:02.290181] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-17T03:19:02.655071] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-17T03:19:02.706398] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T03:19:03.090133] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-17T03:19:03.890118] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-17T03:19:04.162080] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T03:19:04.690288] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-17T03:19:05.102618] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T03:19:05.490139] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-17T03:19:05.924901] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T03:19:05.955525] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:19:06.290178] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-17T03:19:07.090128] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-17T03:19:07.118939] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T03:19:07.890199] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-17T03:19:08.113737] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T03:19:08.268566] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T03:19:08.269476] [INFO ] [REMOTE ] DSMC: Full fetch complete (2837 records). [2025-09-17T03:19:08.269561] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-17T03:19:08.630259] [DEBUG] [VALIDATOR ] DSMC: All expected trading days are present. [2025-09-17T03:19:08.630361] [DEBUG] [VALIDATOR ] DSMC: Primary data validation passed. [2025-09-17T03:19:08.630481] [INFO ] [MAIN ] DSMC: Fetched primary data is valid. [2025-09-17T03:19:08.630539] [DEBUG] [LOCAL ] DSMC: Saving primary data. [2025-09-17T03:19:08.630937] [DEBUG] [LOCAL ] DSMC: Trimmed 2837 records to 1993 (keeping 200 days of data) [2025-09-17T03:19:08.643654] [DEBUG] [LOCAL ] DSMC: Primary data saved (1993 records). [2025-09-17T03:19:08.643729] [INFO ] [MAIN ] DSMC: Full history saved. [2025-09-17T03:19:08.643804] [INFO ] [MAIN ] Update Progress: 653/2369 symbols completed. DSMC took 21.8s. Estimated remaining: 4h 9m 44s. Rate: 6.9 symbols/min [2025-09-17T03:19:08.696543] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-17T03:19:08.815203] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:08.854789] [DEBUG] [LOCAL ] DT: Loaded 39430 existing records from primary storage. [2025-09-17T03:19:08.854952] [INFO ] [MAIN ] DT: Loaded 39430 existing records. [2025-09-17T03:19:09.035972] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:19:09.036256] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-17T03:19:09.036314] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-17T03:19:09.037212] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-17T03:19:09.037274] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-17T03:19:09.391598] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:09.490101] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-11. [2025-09-17T03:19:09.930439] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T03:19:10.290122] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-17T03:19:11.090159] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-17T03:19:11.251556] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T03:19:11.309574] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T03:19:11.890124] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-17T03:19:12.213992] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:19:12.690138] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-17T03:19:13.494262] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-17T03:19:13.497093] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T03:19:13.633837] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T03:19:14.290163] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-17T03:19:14.662441] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T03:19:15.090201] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-17T03:19:15.099680] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T03:19:15.102507] [INFO ] [REMOTE ] DSM: Full fetch complete (24725 records). [2025-09-17T03:19:15.102600] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-17T03:19:15.468992] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-17T03:19:15.469121] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-17T03:19:15.469731] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-17T03:19:15.469799] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-17T03:19:15.470606] [DEBUG] [LOCAL ] DSM: Trimmed 24725 records to 15831 (keeping 200 days of data) [2025-09-17T03:19:15.562866] [DEBUG] [LOCAL ] DSM: Primary data saved (15831 records). [2025-09-17T03:19:15.563029] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-17T03:19:15.563128] [INFO ] [MAIN ] Update Progress: 654/2369 symbols completed. DSM took 34.5s. Estimated remaining: 4h 9m 30s. Rate: 6.9 symbols/min [2025-09-17T03:19:15.730998] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:15.736632] [DEBUG] [LOCAL ] DTB: Loaded 3766 existing records from primary storage. [2025-09-17T03:19:15.736916] [INFO ] [MAIN ] DTB: Loaded 3766 existing records. [2025-09-17T03:19:15.894378] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-17T03:19:15.916147] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:19:15.916623] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-17T03:19:15.916705] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-17T03:19:15.917119] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-17T03:19:15.917185] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-17T03:19:16.274657] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:16.690131] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-17T03:19:16.878306] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T03:19:16.981054] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T03:19:17.490103] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-17T03:19:17.908173] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T03:19:18.290110] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-17T03:19:18.576378] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T03:19:19.090185] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-17T03:19:19.890128] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-17T03:19:20.084765] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T03:19:20.314346] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T03:19:20.690141] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-17T03:19:20.762391] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T03:19:21.490095] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-17T03:19:21.771131] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T03:19:22.290144] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-17T03:19:23.090100] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-11. [2025-09-17T03:19:23.125975] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T03:19:23.151691] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T03:19:23.698992] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T03:19:23.890170] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-17T03:19:24.690141] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-17T03:19:25.160912] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T03:19:25.490153] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-17T03:19:25.686843] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T03:19:25.689891] [INFO ] [REMOTE ] DSU: Full fetch complete (31766 records). [2025-09-17T03:19:25.690020] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-17T03:19:26.065051] [DEBUG] [VALIDATOR ] DSU: All expected trading days are present. [2025-09-17T03:19:26.065156] [DEBUG] [VALIDATOR ] DSU: Primary data validation passed. [2025-09-17T03:19:26.065632] [INFO ] [MAIN ] DSU: Fetched primary data is valid. [2025-09-17T03:19:26.065703] [DEBUG] [LOCAL ] DSU: Saving primary data. [2025-09-17T03:19:26.066446] [DEBUG] [LOCAL ] DSU: Trimmed 31766 records to 21420 (keeping 200 days of data) [2025-09-17T03:19:26.201085] [DEBUG] [LOCAL ] DSU: Primary data saved (21420 records). [2025-09-17T03:19:26.201253] [INFO ] [MAIN ] DSU: Full history saved. [2025-09-17T03:19:26.201361] [INFO ] [MAIN ] Update Progress: 655/2369 symbols completed. DSU took 35.7s. Estimated remaining: 4h 9m 26s. Rate: 6.9 symbols/min [2025-09-17T03:19:26.298753] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-17T03:19:26.372050] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:26.407159] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T03:19:26.423916] [DEBUG] [LOCAL ] DTE: Loaded 35490 existing records from primary storage. [2025-09-17T03:19:26.424082] [INFO ] [MAIN ] DTE: Loaded 35490 existing records. [2025-09-17T03:19:26.601225] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:19:26.601467] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-17T03:19:26.601532] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-17T03:19:26.602561] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-17T03:19:26.602626] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-17T03:19:26.966374] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:27.052792] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T03:19:27.090095] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-17T03:19:27.667508] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T03:19:27.890141] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-17T03:19:28.690193] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-17T03:19:29.315277] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T03:19:29.490133] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-17T03:19:29.617230] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T03:19:30.079298] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T03:19:30.290191] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-11. [2025-09-17T03:19:31.090215] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-17T03:19:31.890163] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-17T03:19:32.059943] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T03:19:32.690096] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-17T03:19:32.869974] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T03:19:33.015276] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T03:19:33.018675] [INFO ] [REMOTE ] DSX: Full fetch complete (37941 records). [2025-09-17T03:19:33.018771] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-17T03:19:33.391560] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-17T03:19:33.391689] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-17T03:19:33.392235] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-17T03:19:33.392291] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-17T03:19:33.393283] [DEBUG] [LOCAL ] DSX: Trimmed 37941 records to 24732 (keeping 200 days of data) [2025-09-17T03:19:33.490367] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-17T03:19:33.540061] [DEBUG] [LOCAL ] DSX: Primary data saved (24732 records). [2025-09-17T03:19:33.540213] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-17T03:19:33.540312] [INFO ] [MAIN ] Update Progress: 656/2369 symbols completed. DSX took 41.6s. Estimated remaining: 4h 9m 14s. Rate: 6.9 symbols/min [2025-09-17T03:19:33.743616] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:33.743875] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-17T03:19:33.743925] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-17T03:19:33.744025] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-17T03:19:33.744084] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-17T03:19:33.744133] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-17T03:19:33.744174] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-17T03:19:34.105568] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:34.290096] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-11. [2025-09-17T03:19:34.327313] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T03:19:34.680362] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T03:19:35.096967] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-17T03:19:35.116448] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:19:35.697776] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T03:19:35.890157] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-17T03:19:36.498943] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T03:19:36.690165] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-17T03:19:37.317889] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T03:19:37.490150] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-17T03:19:38.290122] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-17T03:19:39.090149] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-17T03:19:39.278927] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:19:39.678841] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T03:19:39.890149] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-17T03:19:40.029549] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T03:19:40.531179] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T03:19:40.690131] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-17T03:19:41.382030] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T03:19:41.490155] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-17T03:19:42.129387] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:19:42.130829] [INFO ] [REMOTE ] DTB: Full fetch complete (6728 records). [2025-09-17T03:19:42.130926] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-17T03:19:42.290392] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-17T03:19:42.506901] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-17T03:19:42.507016] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-17T03:19:42.507221] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-17T03:19:42.507285] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-17T03:19:42.508011] [DEBUG] [LOCAL ] DTB: Trimmed 6728 records to 4660 (keeping 200 days of data) [2025-09-17T03:19:42.543772] [DEBUG] [LOCAL ] DTB: Primary data saved (4660 records). [2025-09-17T03:19:42.543932] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-17T03:19:42.544100] [INFO ] [MAIN ] Update Progress: 657/2369 symbols completed. DTB took 27.0s. Estimated remaining: 4h 9m 6s. Rate: 6.9 symbols/min [2025-09-17T03:19:42.714022] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:42.714267] [DEBUG] [LOCAL ] DTG: No existing data file found in primary storage. [2025-09-17T03:19:42.714319] [WARN ] [MAIN ] DTG: No existing data found, performing full refresh instead. [2025-09-17T03:19:42.714428] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-17T03:19:42.714498] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-17T03:19:42.714551] [DEBUG] [LOCAL ] DTG: No primary data file found to delete. [2025-09-17T03:19:42.714622] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-17T03:19:43.085757] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:43.090072] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-11. [2025-09-17T03:19:43.697807] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T03:19:43.890113] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-17T03:19:44.144017] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T03:19:44.183737] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-17T03:19:44.690194] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-17T03:19:45.490132] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-17T03:19:45.534838] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T03:19:46.290130] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-17T03:19:46.922901] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T03:19:47.090165] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-17T03:19:47.354960] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T03:19:47.890235] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-17T03:19:48.246207] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-17T03:19:48.690138] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-17T03:19:48.988621] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T03:19:49.318934] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T03:19:49.490192] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-17T03:19:50.225102] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T03:19:50.290121] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-17T03:19:50.909990] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T03:19:51.090157] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-17T03:19:51.702842] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T03:19:51.890139] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-17T03:19:52.500291] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T03:19:52.690151] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-17T03:19:53.298731] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T03:19:53.490115] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-17T03:19:53.953515] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T03:19:54.290136] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-17T03:19:54.804371] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T03:19:55.090143] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-17T03:19:55.890195] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-17T03:19:56.690177] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-17T03:19:56.869446] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T03:19:57.353878] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T03:19:57.490193] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-17T03:19:57.648542] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T03:19:57.655613] [INFO ] [REMOTE ] DT: Full fetch complete (76461 records). [2025-09-17T03:19:57.655848] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-17T03:19:58.078782] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-17T03:19:58.078898] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-17T03:19:58.079757] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-17T03:19:58.079838] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-17T03:19:58.081667] [DEBUG] [LOCAL ] DT: Trimmed 76461 records to 52955 (keeping 200 days of data) [2025-09-17T03:19:58.301416] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-17T03:19:58.426038] [DEBUG] [LOCAL ] DT: Primary data saved (52955 records). [2025-09-17T03:19:58.426225] [INFO ] [MAIN ] DT: Full history saved. [2025-09-17T03:19:58.426345] [INFO ] [MAIN ] Update Progress: 658/2369 symbols completed. DT took 49.8s. Estimated remaining: 4h 9m 16s. Rate: 6.9 symbols/min [2025-09-17T03:19:58.597933] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:58.634948] [DEBUG] [LOCAL ] DTM: Loaded 32101 existing records from primary storage. [2025-09-17T03:19:58.635126] [INFO ] [MAIN ] DTM: Loaded 32101 existing records. [2025-09-17T03:19:58.741331] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T03:19:58.751712] [INFO ] [REMOTE ] DTG: Full fetch complete (9006 records). [2025-09-17T03:19:58.786894] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-17T03:19:58.925367] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:19:58.936213] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-17T03:19:58.947289] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-17T03:19:59.013403] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-17T03:19:59.064165] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-17T03:19:59.091204] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-17T03:19:59.362781] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-17T03:19:59.398210] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-17T03:19:59.481536] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-17T03:19:59.510762] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-17T03:19:59.554102] [DEBUG] [LOCAL ] DTG: Trimmed 9006 records to 5874 (keeping 200 days of data) [2025-09-17T03:19:59.602274] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:19:59.673476] [DEBUG] [LOCAL ] DTG: Primary data saved (5874 records). [2025-09-17T03:19:59.662913] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T03:19:59.674276] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-17T03:19:59.677349] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T03:19:59.677513] [INFO ] [MAIN ] Update Progress: 659/2369 symbols completed. DTG took 17.1s. Estimated remaining: 4h 8m 48s. Rate: 6.9 symbols/min [2025-09-17T03:19:59.860549] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:19:59.869225] [DEBUG] [LOCAL ] DTW: Loaded 3569 existing records from primary storage. [2025-09-17T03:19:59.869365] [INFO ] [MAIN ] DTW: Loaded 3569 existing records. [2025-09-17T03:19:59.898346] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-17T03:20:00.050002] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:00.050242] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-17T03:20:00.050302] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-17T03:20:00.050561] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-17T03:20:00.050619] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-17T03:20:00.374502] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T03:20:00.412837] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:00.690142] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-11. [2025-09-17T03:20:01.339539] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T03:20:01.490149] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-17T03:20:02.290169] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-17T03:20:02.334076] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T03:20:02.692931] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T03:20:03.090187] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-17T03:20:03.890184] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-17T03:20:04.270116] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T03:20:04.690118] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-17T03:20:04.798250] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T03:20:05.354413] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T03:20:05.490184] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-17T03:20:05.888381] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T03:20:05.889246] [INFO ] [REMOTE ] DTF: Full fetch complete (2212 records). [2025-09-17T03:20:05.889332] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-17T03:20:05.889732] [FATAL] [VALIDATOR ] DTF: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T03:20:05.889804] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:20:05.889859] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:20:05.889907] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-17T03:20:05.889974] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-17T03:20:05.890028] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-17T03:20:05.890102] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-17T03:20:05.890196] [INFO ] [MAIN ] Update Progress: 660/2369 symbols completed. DTF took 32.3s. Estimated remaining: 4h 8m 33s. Rate: 6.9 symbols/min [2025-09-17T03:20:06.061713] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:06.113995] [DEBUG] [LOCAL ] DUK: Loaded 39839 existing records from primary storage. [2025-09-17T03:20:06.114185] [INFO ] [MAIN ] DUK: Loaded 39839 existing records. [2025-09-17T03:20:06.293935] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-11. [2025-09-17T03:20:06.302284] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:06.303770] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-17T03:20:06.303921] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-17T03:20:06.305163] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-17T03:20:06.305248] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-17T03:20:06.681110] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:07.090169] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-17T03:20:07.754280] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T03:20:07.890136] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-17T03:20:07.984856] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T03:20:08.690167] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-11. [2025-09-17T03:20:09.490126] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-17T03:20:09.728484] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T03:20:10.290123] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-17T03:20:10.505373] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T03:20:10.962042] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T03:20:11.058247] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T03:20:11.090092] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-17T03:20:11.890135] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-17T03:20:12.524423] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T03:20:12.690152] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-17T03:20:12.736778] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T03:20:13.490173] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-17T03:20:14.117064] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T03:20:14.290123] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-17T03:20:14.407390] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T03:20:15.090159] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-17T03:20:15.890171] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-17T03:20:15.924427] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T03:20:16.486570] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T03:20:16.690151] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-17T03:20:16.941483] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:20:17.313934] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T03:20:17.490136] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-17T03:20:18.290121] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-17T03:20:18.864175] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T03:20:18.870249] [INFO ] [REMOTE ] DTE: Full fetch complete (69191 records). [2025-09-17T03:20:18.870392] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-17T03:20:18.974298] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T03:20:19.098676] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-17T03:20:19.264953] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-17T03:20:19.265087] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-17T03:20:19.265895] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-17T03:20:19.265975] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-17T03:20:19.267794] [DEBUG] [LOCAL ] DTE: Trimmed 69191 records to 48037 (keeping 200 days of data) [2025-09-17T03:20:19.577440] [DEBUG] [LOCAL ] DTE: Primary data saved (48037 records). [2025-09-17T03:20:19.577599] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-17T03:20:19.577718] [INFO ] [MAIN ] Update Progress: 661/2369 symbols completed. DTE took 53.4s. Estimated remaining: 4h 8m 37s. Rate: 6.9 symbols/min [2025-09-17T03:20:19.746028] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:19.753089] [DEBUG] [LOCAL ] DUKB: Loaded 4679 existing records from primary storage. [2025-09-17T03:20:19.753221] [INFO ] [MAIN ] DUKB: Loaded 4679 existing records. [2025-09-17T03:20:19.895204] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-17T03:20:19.930049] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:19.930264] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-17T03:20:19.930317] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-17T03:20:19.930631] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-17T03:20:19.930739] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-17T03:20:20.285208] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:20.690133] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-17T03:20:21.044202] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T03:20:21.088421] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T03:20:21.089913] [INFO ] [REMOTE ] DTW: Full fetch complete (7906 records). [2025-09-17T03:20:21.090007] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-17T03:20:21.469720] [DEBUG] [VALIDATOR ] DTW: All expected trading days are present. [2025-09-17T03:20:21.469852] [DEBUG] [VALIDATOR ] DTW: Primary data validation passed. [2025-09-17T03:20:21.470103] [INFO ] [MAIN ] DTW: Fetched primary data is valid. [2025-09-17T03:20:21.470160] [DEBUG] [LOCAL ] DTW: Saving primary data. [2025-09-17T03:20:21.471001] [DEBUG] [LOCAL ] DTW: Trimmed 7906 records to 4921 (keeping 200 days of data) [2025-09-17T03:20:21.494320] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-17T03:20:21.504118] [DEBUG] [LOCAL ] DTW: Primary data saved (4921 records). [2025-09-17T03:20:21.504297] [INFO ] [MAIN ] DTW: Full history saved. [2025-09-17T03:20:21.504401] [INFO ] [MAIN ] Update Progress: 662/2369 symbols completed. DTW took 21.8s. Estimated remaining: 4h 8m 10s. Rate: 6.9 symbols/min [2025-09-17T03:20:21.675944] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:21.722504] [DEBUG] [LOCAL ] DV: Loaded 37966 existing records from primary storage. [2025-09-17T03:20:21.722696] [INFO ] [MAIN ] DV: Loaded 37966 existing records. [2025-09-17T03:20:21.903179] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:21.903527] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-17T03:20:21.903634] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-17T03:20:21.904546] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-17T03:20:21.904635] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-17T03:20:22.114107] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-17T03:20:22.309570] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-11. [2025-09-17T03:20:22.316130] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:22.705544] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-17T03:20:23.090202] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-17T03:20:23.283307] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T03:20:23.890214] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-17T03:20:24.690130] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-11. [2025-09-17T03:20:24.932833] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T03:20:25.490168] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-17T03:20:25.837275] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T03:20:26.290184] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-17T03:20:26.366222] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T03:20:27.081249] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T03:20:27.090091] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-17T03:20:27.890150] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-17T03:20:28.362344] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T03:20:28.663894] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T03:20:28.690076] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-17T03:20:29.097104] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T03:20:29.490144] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-17T03:20:29.957070] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:20:30.290165] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-17T03:20:31.067598] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T03:20:31.090087] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-17T03:20:31.326877] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T03:20:31.832465] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T03:20:31.890180] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-17T03:20:32.690188] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-17T03:20:33.461385] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:20:33.490083] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-17T03:20:34.299478] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-17T03:20:34.317984] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T03:20:34.934489] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T03:20:35.077917] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:20:35.090065] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-17T03:20:35.890137] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-17T03:20:36.537944] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:20:36.543216] [INFO ] [REMOTE ] DTM: Full fetch complete (64714 records). [2025-09-17T03:20:36.543360] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-17T03:20:36.695565] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-17T03:20:36.942432] [DEBUG] [VALIDATOR ] DTM: All expected trading days are present. [2025-09-17T03:20:36.942564] [DEBUG] [VALIDATOR ] DTM: Primary data validation passed. [2025-09-17T03:20:36.943396] [INFO ] [MAIN ] DTM: Fetched primary data is valid. [2025-09-17T03:20:36.943472] [DEBUG] [LOCAL ] DTM: Saving primary data. [2025-09-17T03:20:36.946089] [DEBUG] [LOCAL ] DTM: Trimmed 64714 records to 44706 (keeping 200 days of data) [2025-09-17T03:20:37.234271] [DEBUG] [LOCAL ] DTM: Primary data saved (44706 records). [2025-09-17T03:20:37.234436] [INFO ] [MAIN ] DTM: Full history saved. [2025-09-17T03:20:37.234528] [INFO ] [MAIN ] Update Progress: 663/2369 symbols completed. DTM took 38.8s. Estimated remaining: 4h 8m 20s. Rate: 6.9 symbols/min [2025-09-17T03:20:37.400490] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:37.431806] [DEBUG] [LOCAL ] DVA: Loaded 30522 existing records from primary storage. [2025-09-17T03:20:37.431973] [INFO ] [MAIN ] DVA: Loaded 30522 existing records. [2025-09-17T03:20:37.499759] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-17T03:20:37.609966] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:37.610239] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-17T03:20:37.610315] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-17T03:20:37.611111] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-17T03:20:37.611182] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-17T03:20:37.962756] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:37.995351] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T03:20:38.231632] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T03:20:38.290096] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-17T03:20:38.565186] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T03:20:38.717406] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T03:20:39.090142] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-17T03:20:39.713897] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T03:20:39.890141] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-11. [2025-09-17T03:20:40.690139] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-17T03:20:41.423500] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T03:20:41.451552] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T03:20:41.490178] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-17T03:20:42.166670] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T03:20:42.290173] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-17T03:20:42.899994] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T03:20:43.090180] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-17T03:20:43.890207] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-17T03:20:44.433590] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:20:44.434852] [INFO ] [REMOTE ] DUKB: Full fetch complete (9642 records). [2025-09-17T03:20:44.434935] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-17T03:20:44.695331] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-17T03:20:44.795572] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-17T03:20:44.795696] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-17T03:20:44.796007] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-17T03:20:44.796079] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-17T03:20:44.796579] [DEBUG] [LOCAL ] DUKB: Trimmed 9642 records to 6446 (keeping 200 days of data) [2025-09-17T03:20:44.836737] [DEBUG] [LOCAL ] DUKB: Primary data saved (6446 records). [2025-09-17T03:20:44.837074] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-17T03:20:44.837259] [INFO ] [MAIN ] Update Progress: 664/2369 symbols completed. DUKB took 25.3s. Estimated remaining: 4h 8m 8s. Rate: 6.9 symbols/min [2025-09-17T03:20:45.009381] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:45.050861] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T03:20:45.094215] [DEBUG] [LOCAL ] DVN: Loaded 40049 existing records from primary storage. [2025-09-17T03:20:45.094432] [INFO ] [MAIN ] DVN: Loaded 40049 existing records. [2025-09-17T03:20:45.271673] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:45.271943] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-17T03:20:45.272015] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-17T03:20:45.273043] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-17T03:20:45.273107] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-17T03:20:45.495336] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-17T03:20:45.629880] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:46.290151] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-11. [2025-09-17T03:20:46.781154] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T03:20:47.090147] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-17T03:20:47.132117] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T03:20:47.890129] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-17T03:20:47.940459] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T03:20:48.690180] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-17T03:20:48.965211] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T03:20:49.490198] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-17T03:20:49.621670] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T03:20:50.145380] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T03:20:50.290194] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-17T03:20:51.090148] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-17T03:20:51.293403] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T03:20:51.300111] [INFO ] [REMOTE ] DUK: Full fetch complete (77264 records). [2025-09-17T03:20:51.300317] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-17T03:20:51.740816] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-17T03:20:51.741006] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-17T03:20:51.741968] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-17T03:20:51.742055] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-17T03:20:51.743911] [DEBUG] [LOCAL ] DUK: Trimmed 77264 records to 53479 (keeping 200 days of data) [2025-09-17T03:20:51.877959] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:20:51.890536] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-17T03:20:52.121361] [DEBUG] [LOCAL ] DUK: Primary data saved (53479 records). [2025-09-17T03:20:52.121525] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-17T03:20:52.121622] [INFO ] [MAIN ] Update Progress: 665/2369 symbols completed. DUK took 46.2s. Estimated remaining: 4h 7m 56s. Rate: 6.9 symbols/min [2025-09-17T03:20:52.293094] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:20:52.331506] [DEBUG] [LOCAL ] DX: Loaded 39065 existing records from primary storage. [2025-09-17T03:20:52.331695] [INFO ] [MAIN ] DX: Loaded 39065 existing records. [2025-09-17T03:20:52.512889] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:20:52.513142] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-17T03:20:52.513202] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-17T03:20:52.514063] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-17T03:20:52.514127] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-17T03:20:52.697659] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-17T03:20:52.874089] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:20:53.490359] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-17T03:20:53.490423] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-11. [2025-09-17T03:20:53.597021] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T03:20:54.290185] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-17T03:20:54.469078] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:20:55.090163] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-17T03:20:55.266185] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T03:20:55.890175] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-17T03:20:56.059762] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T03:20:56.695730] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-17T03:20:56.708197] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T03:20:57.490182] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-17T03:20:57.950973] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T03:20:58.290196] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-17T03:20:58.515800] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T03:20:58.705568] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T03:20:59.090173] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-17T03:20:59.890159] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-17T03:21:00.052521] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:21:00.690178] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-17T03:21:00.844809] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T03:21:01.490128] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-17T03:21:02.130300] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-17T03:21:02.290153] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-17T03:21:02.430884] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T03:21:02.437427] [INFO ] [REMOTE ] DV: Full fetch complete (72929 records). [2025-09-17T03:21:02.437580] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-17T03:21:02.855273] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-17T03:21:02.855508] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-17T03:21:02.856523] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-17T03:21:02.856615] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-17T03:21:02.858398] [DEBUG] [LOCAL ] DV: Trimmed 72929 records to 51294 (keeping 200 days of data) [2025-09-17T03:21:03.091250] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-17T03:21:03.181982] [DEBUG] [LOCAL ] DV: Primary data saved (51294 records). [2025-09-17T03:21:03.182149] [INFO ] [MAIN ] DV: Full history saved. [2025-09-17T03:21:03.182244] [INFO ] [MAIN ] Update Progress: 666/2369 symbols completed. DV took 41.7s. Estimated remaining: 4h 7m 53s. Rate: 6.9 symbols/min [2025-09-17T03:21:03.357417] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:03.400395] [DEBUG] [LOCAL ] DXC: Loaded 37119 existing records from primary storage. [2025-09-17T03:21:03.400581] [INFO ] [MAIN ] DXC: Loaded 37119 existing records. [2025-09-17T03:21:03.588405] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:21:03.588704] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-17T03:21:03.588767] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-17T03:21:03.589526] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-17T03:21:03.589587] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-17T03:21:03.942615] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:03.942998] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-11. [2025-09-17T03:21:04.244841] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (2.75 seconds). [2025-09-17T03:21:04.399332] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T03:21:04.690181] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-17T03:21:05.459349] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-17T03:21:05.490118] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-17T03:21:05.940468] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T03:21:06.271905] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T03:21:06.290085] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-17T03:21:07.090185] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-17T03:21:07.698991] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-17T03:21:07.890190] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-17T03:21:08.020957] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T03:21:08.156542] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T03:21:08.690158] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-17T03:21:09.490140] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-17T03:21:10.051480] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T03:21:10.275500] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T03:21:10.290078] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-17T03:21:11.090193] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-17T03:21:11.398209] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T03:21:11.894911] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-17T03:21:11.900340] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T03:21:12.690147] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-17T03:21:13.130713] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T03:21:13.476083] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:21:13.490081] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-17T03:21:14.290156] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-17T03:21:14.346618] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T03:21:15.090112] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-17T03:21:15.488757] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T03:21:15.890196] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-17T03:21:16.456531] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T03:21:16.504220] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T03:21:16.690132] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-17T03:21:17.250755] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T03:21:17.256152] [INFO ] [REMOTE ] DVA: Full fetch complete (59556 records). [2025-09-17T03:21:17.256355] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-17T03:21:17.496670] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-17T03:21:17.649399] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-17T03:21:17.649552] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-17T03:21:17.650364] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-17T03:21:17.650452] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-17T03:21:17.651860] [DEBUG] [LOCAL ] DVA: Trimmed 59556 records to 41816 (keeping 200 days of data) [2025-09-17T03:21:17.908704] [DEBUG] [LOCAL ] DVA: Primary data saved (41816 records). [2025-09-17T03:21:17.908871] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-17T03:21:17.908966] [INFO ] [MAIN ] Update Progress: 667/2369 symbols completed. DVA took 40.7s. Estimated remaining: 4h 7m 59s. Rate: 6.9 symbols/min [2025-09-17T03:21:18.077558] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:18.104510] [DEBUG] [LOCAL ] DXYZ: Loaded 26694 existing records from primary storage. [2025-09-17T03:21:18.104713] [INFO ] [MAIN ] DXYZ: Loaded 26694 existing records. [2025-09-17T03:21:18.280134] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:21:18.280368] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-17T03:21:18.280426] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-17T03:21:18.281145] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-17T03:21:18.281208] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-17T03:21:18.297971] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-17T03:21:18.641110] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:18.669213] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T03:21:19.090121] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-17T03:21:19.890136] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-11. [2025-09-17T03:21:20.122095] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-17T03:21:20.382014] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T03:21:20.690136] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-17T03:21:20.767707] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T03:21:21.490140] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-17T03:21:22.262423] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-11 (2.37 seconds). [2025-09-17T03:21:22.290112] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-17T03:21:22.679287] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T03:21:23.090128] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-17T03:21:23.281301] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:21:23.890144] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-17T03:21:24.690136] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-17T03:21:24.788040] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-17T03:21:25.070286] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T03:21:25.442474] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T03:21:25.449215] [INFO ] [REMOTE ] DVN: Full fetch complete (77673 records). [2025-09-17T03:21:25.449409] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-17T03:21:25.495252] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-17T03:21:25.864479] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-17T03:21:25.864633] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-17T03:21:25.865863] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-17T03:21:25.865972] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-17T03:21:25.867784] [DEBUG] [LOCAL ] DVN: Trimmed 77673 records to 53699 (keeping 200 days of data) [2025-09-17T03:21:26.227579] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-09-17T03:21:26.227773] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-17T03:21:26.227872] [INFO ] [MAIN ] Update Progress: 668/2369 symbols completed. DVN took 41.4s. Estimated remaining: 4h 7m 50s. Rate: 6.9 symbols/min [2025-09-17T03:21:26.293460] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-17T03:21:26.404564] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:26.438967] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T03:21:26.466267] [DEBUG] [LOCAL ] DY: Loaded 21107 existing records from primary storage. [2025-09-17T03:21:26.466464] [INFO ] [MAIN ] DY: Loaded 21107 existing records. [2025-09-17T03:21:26.653510] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:21:26.653804] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-17T03:21:26.653866] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-17T03:21:26.654418] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-17T03:21:26.654480] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-17T03:21:27.018943] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:27.090129] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-17T03:21:27.869934] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-17T03:21:27.890079] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-17T03:21:28.062155] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T03:21:28.068758] [INFO ] [REMOTE ] DX: Full fetch complete (75034 records). [2025-09-17T03:21:28.068931] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-17T03:21:28.462603] [DEBUG] [VALIDATOR ] DX: All expected trading days are present. [2025-09-17T03:21:28.462845] [DEBUG] [VALIDATOR ] DX: Primary data validation passed. [2025-09-17T03:21:28.463701] [INFO ] [MAIN ] DX: Fetched primary data is valid. [2025-09-17T03:21:28.463768] [DEBUG] [LOCAL ] DX: Saving primary data. [2025-09-17T03:21:28.481755] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T03:21:28.487746] [DEBUG] [LOCAL ] DX: Trimmed 75034 records to 52464 (keeping 200 days of data) [2025-09-17T03:21:28.488901] [INFO ] [REMOTE ] DXC: Full fetch complete (68029 records). [2025-09-17T03:21:28.489377] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-17T03:21:28.692871] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-11. [2025-09-17T03:21:29.149781] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-17T03:21:29.153619] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-17T03:21:29.154630] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-17T03:21:29.159623] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-17T03:21:29.207776] [DEBUG] [LOCAL ] DXC: Trimmed 68029 records to 49444 (keeping 200 days of data) [2025-09-17T03:21:29.344994] [DEBUG] [LOCAL ] DX: Primary data saved (52464 records). [2025-09-17T03:21:29.346150] [INFO ] [MAIN ] DX: Full history saved. [2025-09-17T03:21:29.346805] [INFO ] [MAIN ] Update Progress: 669/2369 symbols completed. DX took 37.2s. Estimated remaining: 4h 7m 26s. Rate: 6.9 symbols/min [2025-09-17T03:21:29.538047] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:29.541754] [DEBUG] [LOCAL ] E: No existing data file found in primary storage. [2025-09-17T03:21:29.543041] [WARN ] [MAIN ] E: No existing data found, performing full refresh instead. [2025-09-17T03:21:29.545001] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-17T03:21:29.546025] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-17T03:21:29.547794] [DEBUG] [LOCAL ] E: No primary data file found to delete. [2025-09-17T03:21:29.548847] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-17T03:21:30.004483] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:30.006578] [INFO ] [REMOTE ] E: Fetching primary data for 2024-11. [2025-09-17T03:21:30.075460] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-17T03:21:30.116792] [DEBUG] [LOCAL ] DXC: Primary data saved (49444 records). [2025-09-17T03:21:30.116929] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-17T03:21:30.117010] [INFO ] [MAIN ] Update Progress: 670/2369 symbols completed. DXC took 26.9s. Estimated remaining: 4h 6m 58s. Rate: 6.9 symbols/min [2025-09-17T03:21:30.290450] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:30.290604] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-17T03:21:30.291259] [DEBUG] [LOCAL ] EAF: No existing data file found in primary storage. [2025-09-17T03:21:30.292431] [WARN ] [MAIN ] EAF: No existing data found, performing full refresh instead. [2025-09-17T03:21:30.292578] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-17T03:21:30.292765] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-17T03:21:30.292897] [DEBUG] [LOCAL ] EAF: No primary data file found to delete. [2025-09-17T03:21:30.293151] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-17T03:21:30.467369] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T03:21:30.685177] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:31.090108] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-17T03:21:31.450707] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:21:31.890167] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-17T03:21:32.267550] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T03:21:32.348029] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T03:21:32.690146] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-11. [2025-09-17T03:21:33.378183] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T03:21:33.490089] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-17T03:21:34.290138] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-17T03:21:34.393544] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T03:21:34.915492] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:21:35.090179] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-17T03:21:35.890168] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-17T03:21:36.189763] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T03:21:36.344013] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T03:21:36.690132] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-17T03:21:37.321040] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:21:37.490204] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-17T03:21:38.290192] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-17T03:21:38.643257] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T03:21:39.090241] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-17T03:21:39.139495] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T03:21:39.752944] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T03:21:39.890132] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-17T03:21:40.690115] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-17T03:21:41.036521] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T03:21:41.129870] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T03:21:41.490147] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-17T03:21:42.124974] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T03:21:42.290113] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-17T03:21:43.090132] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-17T03:21:43.541565] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T03:21:43.785505] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T03:21:43.890120] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-17T03:21:44.637335] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T03:21:44.690146] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-17T03:21:45.285333] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:21:45.490135] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-17T03:21:46.290122] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-17T03:21:46.660312] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T03:21:46.743061] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T03:21:47.090168] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-17T03:21:47.895274] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-17T03:21:47.915795] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T03:21:48.522682] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T03:21:48.690203] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-17T03:21:49.380726] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T03:21:49.490184] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-17T03:21:49.948051] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T03:21:50.290135] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-17T03:21:50.823322] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T03:21:51.090153] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-17T03:21:51.361942] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T03:21:51.890111] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-17T03:21:52.315990] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T03:21:52.690133] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-17T03:21:53.370547] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T03:21:53.378072] [INFO ] [REMOTE ] DXYZ: Full fetch complete (58530 records). [2025-09-17T03:21:53.378270] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-17T03:21:53.495226] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-17T03:21:53.759531] [DEBUG] [VALIDATOR ] DXYZ: All expected trading days are present. [2025-09-17T03:21:53.759690] [DEBUG] [VALIDATOR ] DXYZ: Primary data validation passed. [2025-09-17T03:21:53.760457] [INFO ] [MAIN ] DXYZ: Fetched primary data is valid. [2025-09-17T03:21:53.760535] [DEBUG] [LOCAL ] DXYZ: Saving primary data. [2025-09-17T03:21:53.761871] [DEBUG] [LOCAL ] DXYZ: Trimmed 58530 records to 36774 (keeping 200 days of data) [2025-09-17T03:21:53.977130] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T03:21:53.982144] [INFO ] [REMOTE ] E: Full fetch complete (48595 records). [2025-09-17T03:21:53.983120] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-17T03:21:54.112396] [DEBUG] [LOCAL ] DXYZ: Primary data saved (36774 records). [2025-09-17T03:21:54.153002] [INFO ] [MAIN ] DXYZ: Full history saved. [2025-09-17T03:21:54.194893] [INFO ] [MAIN ] Update Progress: 671/2369 symbols completed. DXYZ took 36.3s. Estimated remaining: 4h 7m 28s. Rate: 6.9 symbols/min [2025-09-17T03:21:54.293839] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-17T03:21:54.565983] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:54.566118] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-17T03:21:54.566702] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-17T03:21:54.567358] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-17T03:21:54.567480] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-17T03:21:54.569421] [DEBUG] [LOCAL ] E: Trimmed 48595 records to 33761 (keeping 200 days of data) [2025-09-17T03:21:54.571669] [DEBUG] [LOCAL ] EAI: Loaded 2911 existing records from primary storage. [2025-09-17T03:21:54.572052] [INFO ] [MAIN ] EAI: Loaded 2911 existing records. [2025-09-17T03:21:54.847337] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:21:54.853980] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-17T03:21:54.855865] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-17T03:21:54.857490] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-17T03:21:54.857583] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-17T03:21:54.951114] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:21:55.099516] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-17T03:21:55.289895] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:55.335172] [DEBUG] [LOCAL ] E: Primary data saved (33761 records). [2025-09-17T03:21:55.335291] [INFO ] [MAIN ] E: Full history saved. [2025-09-17T03:21:55.335370] [INFO ] [MAIN ] Update Progress: 672/2369 symbols completed. E took 26.0s. Estimated remaining: 4h 6m 60s. Rate: 6.9 symbols/min [2025-09-17T03:21:55.502691] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:55.502843] [DEBUG] [LOCAL ] EARN: No existing data file found in primary storage. [2025-09-17T03:21:55.502896] [WARN ] [MAIN ] EARN: No existing data found, performing full refresh instead. [2025-09-17T03:21:55.502998] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-17T03:21:55.503047] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-17T03:21:55.503099] [DEBUG] [LOCAL ] EARN: No primary data file found to delete. [2025-09-17T03:21:55.503142] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-17T03:21:55.852055] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:55.890070] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-11. [2025-09-17T03:21:56.109811] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T03:21:56.516614] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T03:21:56.690092] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-17T03:21:57.360575] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T03:21:57.490141] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-17T03:21:57.829697] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T03:21:57.833360] [INFO ] [REMOTE ] DY: Full fetch complete (44807 records). [2025-09-17T03:21:57.833457] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-17T03:21:58.204325] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-17T03:21:58.204422] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-17T03:21:58.204982] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-17T03:21:58.205040] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-17T03:21:58.206013] [DEBUG] [LOCAL ] DY: Trimmed 44807 records to 30199 (keeping 200 days of data) [2025-09-17T03:21:58.295274] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-17T03:21:58.396742] [DEBUG] [LOCAL ] DY: Primary data saved (30199 records). [2025-09-17T03:21:58.396946] [INFO ] [MAIN ] DY: Full history saved. [2025-09-17T03:21:58.397065] [INFO ] [MAIN ] Update Progress: 673/2369 symbols completed. DY took 32.2s. Estimated remaining: 4h 6m 37s. Rate: 6.9 symbols/min [2025-09-17T03:21:58.568037] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:21:58.568194] [DEBUG] [LOCAL ] EAT: No existing data file found in primary storage. [2025-09-17T03:21:58.568242] [WARN ] [MAIN ] EAT: No existing data found, performing full refresh instead. [2025-09-17T03:21:58.568347] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-17T03:21:58.568394] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-17T03:21:58.568441] [DEBUG] [LOCAL ] EAT: No primary data file found to delete. [2025-09-17T03:21:58.568478] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-17T03:21:58.950884] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:21:58.972129] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T03:21:59.090134] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-11. [2025-09-17T03:21:59.890135] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-17T03:22:00.054402] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T03:22:00.690147] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-17T03:22:00.788730] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T03:22:01.398350] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:22:01.490122] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-17T03:22:02.290183] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-11. [2025-09-17T03:22:02.403091] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T03:22:02.873344] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T03:22:02.994462] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T03:22:03.090144] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-17T03:22:03.644020] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T03:22:03.890137] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-17T03:22:04.690198] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-17T03:22:05.490158] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-17T03:22:05.573634] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T03:22:06.096695] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T03:22:06.290116] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-17T03:22:06.397260] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T03:22:07.090160] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-17T03:22:07.687727] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T03:22:07.890139] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-17T03:22:08.080707] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:22:08.528282] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T03:22:08.690164] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-17T03:22:09.490149] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-17T03:22:10.273880] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T03:22:10.290101] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-17T03:22:11.090162] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-17T03:22:11.158236] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T03:22:11.776139] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:22:11.890102] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-17T03:22:12.105433] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:22:12.492965] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T03:22:12.690112] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-17T03:22:13.490134] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-17T03:22:14.290139] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-17T03:22:14.564889] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T03:22:14.709569] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T03:22:14.713881] [INFO ] [REMOTE ] EAF: Full fetch complete (65455 records). [2025-09-17T03:22:14.714018] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-17T03:22:15.099468] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-17T03:22:15.096128] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-17T03:22:15.099604] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-17T03:22:15.101347] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-17T03:22:15.101577] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-17T03:22:15.103356] [DEBUG] [LOCAL ] EAF: Trimmed 65455 records to 44408 (keeping 200 days of data) [2025-09-17T03:22:15.358509] [DEBUG] [LOCAL ] EAF: Primary data saved (44408 records). [2025-09-17T03:22:15.358673] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-17T03:22:15.358770] [INFO ] [MAIN ] Update Progress: 674/2369 symbols completed. EAF took 45.2s. Estimated remaining: 4h 6m 49s. Rate: 6.9 symbols/min [2025-09-17T03:22:15.535085] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:15.566325] [DEBUG] [LOCAL ] EB: Loaded 27190 existing records from primary storage. [2025-09-17T03:22:15.566516] [INFO ] [MAIN ] EB: Loaded 27190 existing records. [2025-09-17T03:22:15.747480] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:15.748463] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-17T03:22:15.748616] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-17T03:22:15.749424] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-17T03:22:15.768375] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-17T03:22:15.815301] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T03:22:15.894844] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-17T03:22:16.139366] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:16.323245] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T03:22:16.690134] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-17T03:22:16.937060] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T03:22:17.292141] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:22:17.490084] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-17T03:22:18.087130] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T03:22:18.290148] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-11. [2025-09-17T03:22:19.090128] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-17T03:22:19.839748] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T03:22:19.890153] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-17T03:22:20.231182] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T03:22:20.690129] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-17T03:22:21.475241] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T03:22:21.490089] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-17T03:22:21.872341] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T03:22:22.290143] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-17T03:22:22.783862] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T03:22:22.785127] [INFO ] [REMOTE ] EAI: Full fetch complete (6219 records). [2025-09-17T03:22:22.785213] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-17T03:22:23.093767] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-17T03:22:23.158552] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-17T03:22:23.158728] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-17T03:22:23.159058] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-17T03:22:23.159190] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-17T03:22:23.159815] [DEBUG] [LOCAL ] EAI: Trimmed 6219 records to 4019 (keeping 200 days of data) [2025-09-17T03:22:23.187080] [DEBUG] [LOCAL ] EAI: Primary data saved (4019 records). [2025-09-17T03:22:23.187240] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-17T03:22:23.187487] [INFO ] [MAIN ] Update Progress: 675/2369 symbols completed. EAI took 28.9s. Estimated remaining: 4h 6m 38s. Rate: 6.9 symbols/min [2025-09-17T03:22:23.313846] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T03:22:23.404079] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:23.421698] [DEBUG] [LOCAL ] EBF: Loaded 13951 existing records from primary storage. [2025-09-17T03:22:23.421863] [INFO ] [MAIN ] EBF: Loaded 13951 existing records. [2025-09-17T03:22:23.599770] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:23.600051] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-17T03:22:23.600121] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-17T03:22:23.600530] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-17T03:22:23.600587] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-17T03:22:23.895254] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-17T03:22:23.968599] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:24.362396] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T03:22:24.690126] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-11. [2025-09-17T03:22:25.404781] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:22:25.490124] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-17T03:22:25.768528] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T03:22:26.290188] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-17T03:22:26.677311] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T03:22:27.090161] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-17T03:22:27.332716] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:22:27.890219] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-17T03:22:28.607182] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T03:22:28.690093] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-17T03:22:29.490147] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-17T03:22:29.813879] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T03:22:30.275846] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T03:22:30.290076] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-17T03:22:30.491369] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T03:22:31.090164] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-17T03:22:31.693918] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:22:31.890114] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-17T03:22:32.690155] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-17T03:22:32.839835] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T03:22:32.896503] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T03:22:33.481799] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T03:22:33.485568] [INFO ] [REMOTE ] EARN: Full fetch complete (47111 records). [2025-09-17T03:22:33.485733] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-17T03:22:33.497466] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-17T03:22:33.868275] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-17T03:22:33.868406] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-17T03:22:33.869121] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-17T03:22:33.869215] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-17T03:22:33.870392] [DEBUG] [LOCAL ] EARN: Trimmed 47111 records to 30932 (keeping 200 days of data) [2025-09-17T03:22:34.059496] [DEBUG] [LOCAL ] EARN: Primary data saved (30932 records). [2025-09-17T03:22:34.059740] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-17T03:22:34.059873] [INFO ] [MAIN ] Update Progress: 676/2369 symbols completed. EARN took 38.7s. Estimated remaining: 4h 6m 34s. Rate: 6.9 symbols/min [2025-09-17T03:22:34.230788] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:34.268880] [DEBUG] [LOCAL ] EBR: Loaded 31640 existing records from primary storage. [2025-09-17T03:22:34.269134] [INFO ] [MAIN ] EBR: Loaded 31640 existing records. [2025-09-17T03:22:34.303478] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-17T03:22:34.473261] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:34.473609] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-17T03:22:34.473724] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-17T03:22:34.474608] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-17T03:22:34.474760] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-17T03:22:34.885223] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:35.090146] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-11. [2025-09-17T03:22:35.392138] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T03:22:35.895800] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-17T03:22:35.906061] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T03:22:36.337597] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T03:22:36.690131] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-17T03:22:37.490111] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-17T03:22:37.642535] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T03:22:37.778297] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T03:22:38.290167] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-17T03:22:38.935398] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T03:22:39.090163] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-17T03:22:39.890533] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T03:22:39.890614] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-17T03:22:40.648094] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T03:22:40.656257] [INFO ] [REMOTE ] EAT: Full fetch complete (71417 records). [2025-09-17T03:22:40.656427] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-17T03:22:40.700128] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-17T03:22:41.045372] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-17T03:22:41.045488] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-17T03:22:41.046310] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-17T03:22:41.046379] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-17T03:22:41.047931] [DEBUG] [LOCAL ] EAT: Trimmed 71417 records to 49816 (keeping 200 days of data) [2025-09-17T03:22:41.289604] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T03:22:41.301010] [INFO ] [REMOTE ] EB: Full fetch complete (57222 records). [2025-09-17T03:22:41.304786] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-17T03:22:41.514247] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-17T03:22:41.795058] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-17T03:22:41.795146] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-17T03:22:41.795922] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-17T03:22:41.780835] [DEBUG] [LOCAL ] EAT: Primary data saved (49816 records). [2025-09-17T03:22:41.796127] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-17T03:22:41.796025] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-17T03:22:41.796325] [INFO ] [MAIN ] Update Progress: 677/2369 symbols completed. EAT took 43.4s. Estimated remaining: 4h 6m 23s. Rate: 6.9 symbols/min [2025-09-17T03:22:41.798269] [DEBUG] [LOCAL ] EB: Trimmed 57222 records to 38243 (keeping 200 days of data) [2025-09-17T03:22:41.896118] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T03:22:42.041190] [DEBUG] [LOCAL ] EB: Primary data saved (38243 records). [2025-09-17T03:22:42.041376] [INFO ] [MAIN ] EB: Full history saved. [2025-09-17T03:22:42.041475] [INFO ] [MAIN ] Update Progress: 678/2369 symbols completed. EB took 26.7s. Estimated remaining: 4h 5m 53s. Rate: 6.9 symbols/min [2025-09-17T03:22:42.290142] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-17T03:22:43.198852] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:22:43.209079] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-17T03:22:43.418486] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T03:22:43.890188] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-17T03:22:44.744121] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T03:22:44.751884] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-17T03:22:45.001356] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T03:22:45.490138] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-17T03:22:46.379737] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:22:46.389515] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-17T03:22:46.636849] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T03:22:47.090137] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-17T03:22:47.997129] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T03:22:48.007069] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-17T03:22:48.249088] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T03:22:48.690187] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-17T03:22:49.488129] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T03:22:49.492889] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-17T03:22:49.519329] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T03:22:50.154405] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T03:22:50.159444] [INFO ] [REMOTE ] EBF: Full fetch complete (27222 records). [2025-09-17T03:22:50.159635] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-17T03:22:50.295229] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-17T03:22:50.546551] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-17T03:22:50.546678] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-17T03:22:50.547200] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-17T03:22:50.547270] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-17T03:22:50.548022] [DEBUG] [LOCAL ] EBF: Trimmed 27222 records to 19671 (keeping 200 days of data) [2025-09-17T03:22:50.675680] [DEBUG] [LOCAL ] EBF: Primary data saved (19671 records). [2025-09-17T03:22:50.675867] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-17T03:22:50.675992] [INFO ] [MAIN ] Update Progress: 679/2369 symbols completed. EBF took 27.5s. Estimated remaining: 4h 5m 44s. Rate: 6.9 symbols/min [2025-09-17T03:22:51.896525] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T03:22:51.905182] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-17T03:22:53.483344] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T03:22:53.492943] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-17T03:22:54.796773] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T03:22:54.806490] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-17T03:22:56.252613] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:22:56.258008] [INFO ] [REMOTE ] EBR: Full fetch complete (62675 records). [2025-09-17T03:22:56.258138] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-17T03:22:56.655069] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-17T03:22:56.655184] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-17T03:22:56.655999] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-17T03:22:56.656074] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-17T03:22:56.657440] [DEBUG] [LOCAL ] EBR: Trimmed 62675 records to 43127 (keeping 200 days of data) [2025-09-17T03:22:56.921436] [DEBUG] [LOCAL ] EBR: Primary data saved (43127 records). [2025-09-17T03:22:56.921599] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-17T03:22:56.921725] [INFO ] [MAIN ] Update Progress: 680/2369 symbols completed. EBR took 22.9s. Estimated remaining: 4h 5m 29s. Rate: 6.9 symbols/min [2025-09-17T03:22:57.602820] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:57.605747] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:57.626559] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:57.628909] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:22:57.685158] [DEBUG] [LOCAL ] ECAT: Loaded 21933 existing records from primary storage. [2025-09-17T03:22:57.685532] [INFO ] [MAIN ] ECAT: Loaded 21933 existing records. [2025-09-17T03:22:57.756847] [DEBUG] [LOCAL ] ECC: Loaded 31843 existing records from primary storage. [2025-09-17T03:22:57.782240] [INFO ] [MAIN ] ECC: Loaded 31843 existing records. [2025-09-17T03:22:57.805631] [DEBUG] [LOCAL ] EBS: Loaded 35107 existing records from primary storage. [2025-09-17T03:22:57.854898] [INFO ] [MAIN ] EBS: Loaded 35107 existing records. [2025-09-17T03:22:57.820721] [DEBUG] [LOCAL ] EC: Loaded 36426 existing records from primary storage. [2025-09-17T03:22:57.903781] [INFO ] [MAIN ] EC: Loaded 36426 existing records. [2025-09-17T03:22:58.296924] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:58.305375] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:58.439418] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-17T03:22:58.460577] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-17T03:22:58.461329] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:58.420325] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-17T03:22:58.464753] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-17T03:22:58.464840] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-17T03:22:58.464396] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-17T03:22:58.464527] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:22:58.465134] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-17T03:22:58.465194] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-17T03:22:58.465569] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-17T03:22:58.465675] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-17T03:22:58.477198] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-17T03:22:58.465710] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-17T03:22:58.477453] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-17T03:22:58.477396] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-17T03:22:58.470945] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-17T03:22:58.507627] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-17T03:22:59.856389] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:59.925453] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-11. [2025-09-17T03:22:59.925159] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:59.914765] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:59.946687] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-11. [2025-09-17T03:22:59.947159] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-11. [2025-09-17T03:22:59.984556] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:22:59.984960] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-11. [2025-09-17T03:23:01.073686] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T03:23:01.078581] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-17T03:23:01.550954] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T03:23:01.559321] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-17T03:23:02.336212] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T03:23:02.341899] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-17T03:23:03.128187] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T03:23:03.137520] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-17T03:23:07.051588] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-11 (7.10 seconds). [2025-09-17T03:23:07.080886] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-17T03:23:07.083156] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (3.95 seconds). [2025-09-17T03:23:07.091126] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-17T03:23:07.747130] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (5.41 seconds). [2025-09-17T03:23:07.754012] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-17T03:23:08.006904] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-11 (8.02 seconds). [2025-09-17T03:23:08.016956] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-17T03:23:08.160764] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T03:23:08.168361] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-17T03:23:08.759928] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T03:23:08.770237] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-17T03:23:08.985416] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T03:23:08.991657] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-17T03:23:09.615142] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T03:23:09.624843] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-17T03:23:09.869497] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:23:09.879824] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-17T03:23:10.369271] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:23:10.376349] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-17T03:23:10.402409] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T03:23:10.412054] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-17T03:23:11.419994] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T03:23:11.430169] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-17T03:23:11.723967] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T03:23:11.734520] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-17T03:23:11.752684] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T03:23:11.759608] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-17T03:23:11.824945] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:23:11.835890] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-17T03:23:12.994464] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T03:23:13.001181] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-17T03:23:13.208079] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T03:23:13.217166] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-17T03:23:13.448600] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:23:13.490081] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-17T03:23:13.568172] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T03:23:14.115847] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T03:23:14.290156] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-17T03:23:14.644435] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T03:23:15.090160] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-17T03:23:15.136317] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T03:23:15.305841] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T03:23:15.890180] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-17T03:23:16.533170] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T03:23:16.690128] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-17T03:23:17.471346] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T03:23:17.490087] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-17T03:23:17.722701] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T03:23:18.290157] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-17T03:23:19.090094] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-17T03:23:19.176144] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T03:23:19.890195] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-17T03:23:20.237211] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T03:23:20.474263] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T03:23:20.690208] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-17T03:23:21.125186] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:23:21.131561] [INFO ] [REMOTE ] ECAT: Full fetch complete (42090 records). [2025-09-17T03:23:21.131765] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-17T03:23:21.495287] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-17T03:23:21.510749] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-17T03:23:21.510833] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-17T03:23:21.511455] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-17T03:23:21.511510] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-17T03:23:21.512550] [DEBUG] [LOCAL ] ECAT: Trimmed 42090 records to 29887 (keeping 200 days of data) [2025-09-17T03:23:21.699142] [DEBUG] [LOCAL ] ECAT: Primary data saved (29887 records). [2025-09-17T03:23:21.699330] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-17T03:23:21.699427] [INFO ] [MAIN ] Update Progress: 681/2369 symbols completed. ECAT took 24.8s. Estimated remaining: 4h 6m 0s. Rate: 6.9 symbols/min [2025-09-17T03:23:21.869247] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:21.869444] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-17T03:23:21.869493] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-17T03:23:21.869604] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-17T03:23:21.869673] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-17T03:23:21.869726] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-17T03:23:21.869764] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-17T03:23:22.226895] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:22.290153] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-11. [2025-09-17T03:23:22.557140] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T03:23:22.651082] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T03:23:23.052380] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T03:23:23.058750] [INFO ] [REMOTE ] ECC: Full fetch complete (60971 records). [2025-09-17T03:23:23.058992] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-17T03:23:23.095228] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-17T03:23:23.480782] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-17T03:23:23.480955] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-17T03:23:23.482075] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-17T03:23:23.482142] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-17T03:23:23.484103] [DEBUG] [LOCAL ] ECC: Trimmed 60971 records to 43407 (keeping 200 days of data) [2025-09-17T03:23:23.769445] [DEBUG] [LOCAL ] ECC: Primary data saved (43407 records). [2025-09-17T03:23:23.769725] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-17T03:23:23.769894] [INFO ] [MAIN ] Update Progress: 682/2369 symbols completed. ECC took 26.8s. Estimated remaining: 4h 5m 35s. Rate: 6.9 symbols/min [2025-09-17T03:23:23.895281] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-17T03:23:23.978768] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:23.982413] [DEBUG] [LOCAL ] ECCU: Loaded 1691 existing records from primary storage. [2025-09-17T03:23:23.982586] [INFO ] [MAIN ] ECCU: Loaded 1691 existing records. [2025-09-17T03:23:24.181606] [WARN ] [MAIN ] ECCU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:23:24.181958] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-17T03:23:24.182051] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-17T03:23:24.182320] [DEBUG] [LOCAL ] ECCU: Deleted primary data file. [2025-09-17T03:23:24.182394] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-17T03:23:24.412578] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T03:23:24.576186] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:24.690183] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-17T03:23:24.934082] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T03:23:24.977592] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-17T03:23:25.490159] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-17T03:23:26.290202] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-17T03:23:26.643608] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T03:23:27.098091] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-17T03:23:27.101214] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:23:27.466560] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T03:23:27.890201] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-17T03:23:28.262030] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T03:23:28.690170] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-17T03:23:29.191891] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T03:23:29.490207] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-17T03:23:29.841749] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:23:30.290163] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-17T03:23:31.090167] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-17T03:23:31.434028] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-17T03:23:31.890113] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-17T03:23:32.019387] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T03:23:32.690235] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-11. [2025-09-17T03:23:32.903873] [DEBUG] [REMOTE ] ECCU: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:23:32.904218] [WARN ] [REMOTE ] ECCU: No data returned for month 2024-11 [2025-09-17T03:23:33.490184] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-17T03:23:33.767015] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T03:23:33.779982] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-17T03:23:34.290152] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-17T03:23:35.090190] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-17T03:23:35.518581] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T03:23:35.890178] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-17T03:23:36.002512] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T03:23:36.690170] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-17T03:23:37.277617] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T03:23:37.490143] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-17T03:23:37.665077] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T03:23:37.838565] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T03:23:37.839414] [INFO ] [REMOTE ] ECCC: Full fetch complete (1286 records). [2025-09-17T03:23:37.839502] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-17T03:23:38.044792] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T03:23:38.044996] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:23:38.045049] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:23:38.045094] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-17T03:23:38.045170] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-17T03:23:38.045220] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-17T03:23:38.045292] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-17T03:23:38.045372] [INFO ] [MAIN ] Update Progress: 683/2369 symbols completed. ECCC took 16.3s. Estimated remaining: 4h 5m 40s. Rate: 6.9 symbols/min [2025-09-17T03:23:38.222138] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:38.222372] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-17T03:23:38.222424] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-17T03:23:38.222547] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-17T03:23:38.222602] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-17T03:23:38.222674] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-17T03:23:38.222726] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-17T03:23:38.295334] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-17T03:23:38.602352] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:38.897237] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T03:23:39.090162] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-17T03:23:39.758221] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T03:23:39.890179] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-17T03:23:40.690138] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-17T03:23:41.254041] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T03:23:41.420859] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T03:23:41.427628] [INFO ] [REMOTE ] EC: Full fetch complete (71867 records). [2025-09-17T03:23:41.427891] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-17T03:23:41.495235] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-11. [2025-09-17T03:23:41.846324] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-17T03:23:41.846491] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-17T03:23:41.847295] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-17T03:23:41.847355] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-17T03:23:41.848787] [DEBUG] [LOCAL ] EC: Trimmed 71867 records to 49499 (keeping 200 days of data) [2025-09-17T03:23:41.917300] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T03:23:42.145543] [DEBUG] [LOCAL ] EC: Primary data saved (49499 records). [2025-09-17T03:23:42.145719] [INFO ] [MAIN ] EC: Full history saved. [2025-09-17T03:23:42.145818] [INFO ] [MAIN ] Update Progress: 684/2369 symbols completed. EC took 45.2s. Estimated remaining: 4h 5m 20s. Rate: 6.9 symbols/min [2025-09-17T03:23:42.297808] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-17T03:23:42.317412] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:42.318289] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-17T03:23:42.318345] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-17T03:23:42.318456] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-17T03:23:42.318506] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-17T03:23:42.318557] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-17T03:23:42.318595] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-17T03:23:42.692155] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:42.737425] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-17T03:23:43.090227] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-11. [2025-09-17T03:23:43.445087] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T03:23:43.890188] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-17T03:23:44.349769] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T03:23:44.690198] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-17T03:23:45.156739] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T03:23:45.490233] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-17T03:23:45.886477] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-17T03:23:46.290173] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-17T03:23:46.642457] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-17T03:23:47.090159] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-17T03:23:47.497448] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T03:23:47.890139] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-17T03:23:48.393701] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T03:23:48.690195] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-17T03:23:49.042134] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-17T03:23:49.490146] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-17T03:23:49.931811] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T03:23:50.290132] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-17T03:23:51.090155] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-17T03:23:51.545992] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T03:23:51.785222] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T03:23:51.790994] [INFO ] [REMOTE ] EBS: Full fetch complete (67266 records). [2025-09-17T03:23:51.791143] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-17T03:23:51.895391] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-17T03:23:52.207093] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-17T03:23:52.207280] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-17T03:23:52.208267] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-17T03:23:52.208363] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-17T03:23:52.210244] [DEBUG] [LOCAL ] EBS: Trimmed 67266 records to 47015 (keeping 200 days of data) [2025-09-17T03:23:52.310058] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T03:23:52.323745] [INFO ] [REMOTE ] ECCU: Full fetch complete (4370 records). [2025-09-17T03:23:52.330419] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-17T03:23:52.573211] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-17T03:23:52.582173] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:23:52.608958] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:23:52.609937] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-17T03:23:52.610631] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-17T03:23:52.611582] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-17T03:23:52.612948] [DEBUG] [LOCAL ] ECCU: Deleted derivative data file. [2025-09-17T03:23:52.613401] [INFO ] [MAIN ] Update Progress: 685/2369 symbols completed. ECCU took 28.8s. Estimated remaining: 4h 5m 15s. Rate: 6.9 symbols/min [2025-09-17T03:23:52.691303] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-17T03:23:52.819964] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:52.851792] [DEBUG] [LOCAL ] ECG: Loaded 24286 existing records from primary storage. [2025-09-17T03:23:52.852768] [INFO ] [MAIN ] ECG: Loaded 24286 existing records. [2025-09-17T03:23:53.081541] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:23:53.084368] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-17T03:23:53.084757] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-17T03:23:53.086911] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-17T03:23:53.087330] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-17T03:23:53.088565] [DEBUG] [LOCAL ] EBS: Primary data saved (47015 records). [2025-09-17T03:23:53.146146] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-17T03:23:53.181211] [INFO ] [MAIN ] Update Progress: 686/2369 symbols completed. EBS took 56.3s. Estimated remaining: 4h 4m 47s. Rate: 6.9 symbols/min [2025-09-17T03:23:53.170750] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-17T03:23:53.492173] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-17T03:23:53.556356] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:23:53.648636] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:53.673793] [DEBUG] [LOCAL ] ECL: Loaded 34316 existing records from primary storage. [2025-09-17T03:23:53.673962] [INFO ] [MAIN ] ECL: Loaded 34316 existing records. [2025-09-17T03:23:53.852056] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:23:53.852299] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-17T03:23:53.852357] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-17T03:23:53.853255] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-17T03:23:53.853319] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-17T03:23:53.953708] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T03:23:54.213735] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:23:54.290124] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-11. [2025-09-17T03:23:55.090133] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-17T03:23:55.437883] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:23:55.890139] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-17T03:23:55.958832] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T03:23:56.322714] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T03:23:56.690183] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-11. [2025-09-17T03:23:57.490133] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-17T03:23:58.245708] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T03:23:58.290133] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-17T03:23:58.752125] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T03:23:59.090161] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-17T03:23:59.435759] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-17T03:23:59.759940] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:23:59.890097] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-17T03:24:00.690145] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-17T03:24:01.030341] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T03:24:01.283077] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T03:24:01.490127] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-17T03:24:01.873145] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-17T03:24:02.290140] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-17T03:24:03.090161] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-17T03:24:03.890132] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-17T03:24:04.545135] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T03:24:04.690093] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-17T03:24:05.067247] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T03:24:05.116160] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (2.83 seconds). [2025-09-17T03:24:05.176418] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T03:24:05.490147] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-17T03:24:06.290142] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-17T03:24:06.632064] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T03:24:07.090172] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-17T03:24:07.208582] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T03:24:07.443494] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T03:24:07.890138] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-17T03:24:08.690145] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-17T03:24:09.078578] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T03:24:09.079498] [INFO ] [REMOTE ] ECCX: Full fetch complete (1499 records). [2025-09-17T03:24:09.079628] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-17T03:24:09.270521] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T03:24:09.270919] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:24:09.270972] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:24:09.271017] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-17T03:24:09.271097] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-17T03:24:09.271169] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-17T03:24:09.271258] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-17T03:24:09.271344] [INFO ] [MAIN ] Update Progress: 687/2369 symbols completed. ECCX took 27.1s. Estimated remaining: 4h 4m 56s. Rate: 6.9 symbols/min [2025-09-17T03:24:09.471359] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:09.494968] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-17T03:24:09.504897] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T03:24:09.519702] [DEBUG] [LOCAL ] ECO: Loaded 13314 existing records from primary storage. [2025-09-17T03:24:09.519879] [INFO ] [MAIN ] ECO: Loaded 13314 existing records. [2025-09-17T03:24:09.721232] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:09.721497] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-17T03:24:09.721565] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-17T03:24:09.722203] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-17T03:24:09.722268] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-17T03:24:10.178043] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:10.290148] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-17T03:24:11.090167] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-11. [2025-09-17T03:24:11.419546] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T03:24:11.457359] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T03:24:11.890157] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-17T03:24:12.339065] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T03:24:12.690213] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-17T03:24:13.490214] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-17T03:24:13.761314] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T03:24:13.925161] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T03:24:14.084335] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T03:24:14.290174] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-17T03:24:15.090162] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-17T03:24:15.890147] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-17T03:24:16.094172] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T03:24:16.240665] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T03:24:16.241460] [INFO ] [REMOTE ] ECCW: Full fetch complete (1408 records). [2025-09-17T03:24:16.241544] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-17T03:24:16.429957] [WARN ] [VALIDATOR ] ECCW: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-17T03:24:16.430242] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:24:16.430312] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:24:16.430361] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-17T03:24:16.430432] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-17T03:24:16.430480] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-17T03:24:16.430534] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-17T03:24:16.430615] [INFO ] [MAIN ] Update Progress: 688/2369 symbols completed. ECCW took 38.4s. Estimated remaining: 4h 4m 43s. Rate: 6.9 symbols/min [2025-09-17T03:24:16.615560] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:16.642448] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T03:24:16.681333] [DEBUG] [LOCAL ] ECVT: Loaded 32031 existing records from primary storage. [2025-09-17T03:24:16.681507] [INFO ] [MAIN ] ECVT: Loaded 32031 existing records. [2025-09-17T03:24:16.695215] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-17T03:24:16.892067] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:16.892344] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-17T03:24:16.892407] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-17T03:24:16.893186] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-17T03:24:16.893261] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-17T03:24:17.272225] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:17.490133] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-17T03:24:18.043599] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T03:24:18.290137] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-17T03:24:18.762322] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T03:24:19.055880] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T03:24:19.090140] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-17T03:24:19.890124] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-11. [2025-09-17T03:24:20.447354] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T03:24:20.690136] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-17T03:24:21.490150] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-17T03:24:22.216697] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-11 (2.33 seconds). [2025-09-17T03:24:22.290151] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-17T03:24:22.546784] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T03:24:23.090134] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-17T03:24:23.333075] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T03:24:23.382931] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T03:24:23.890137] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-17T03:24:24.225505] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:24:24.690127] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-17T03:24:25.490143] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-17T03:24:25.529914] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T03:24:26.023949] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T03:24:26.290121] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-17T03:24:26.928788] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T03:24:27.090175] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-17T03:24:27.661898] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T03:24:27.890176] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-17T03:24:28.237500] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:24:28.241599] [INFO ] [REMOTE ] ECG: Full fetch complete (51764 records). [2025-09-17T03:24:28.241809] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-17T03:24:28.658667] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-17T03:24:28.658803] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-17T03:24:28.659850] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-17T03:24:28.659941] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-17T03:24:28.661174] [DEBUG] [LOCAL ] ECG: Trimmed 51764 records to 34791 (keeping 200 days of data) [2025-09-17T03:24:28.712165] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-17T03:24:28.869183] [DEBUG] [LOCAL ] ECG: Primary data saved (34791 records). [2025-09-17T03:24:28.869358] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-17T03:24:28.869472] [INFO ] [MAIN ] Update Progress: 689/2369 symbols completed. ECG took 36.3s. Estimated remaining: 4h 4m 44s. Rate: 6.9 symbols/min [2025-09-17T03:24:29.039542] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:29.081218] [DEBUG] [LOCAL ] ED: Loaded 39343 existing records from primary storage. [2025-09-17T03:24:29.081460] [INFO ] [MAIN ] ED: Loaded 39343 existing records. [2025-09-17T03:24:29.272060] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:29.272350] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-17T03:24:29.272409] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-17T03:24:29.273415] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-17T03:24:29.273478] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-17T03:24:29.500464] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-17T03:24:29.660929] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:29.686683] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T03:24:29.803625] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T03:24:30.290151] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-11. [2025-09-17T03:24:31.090352] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-17T03:24:31.145396] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T03:24:31.152356] [INFO ] [REMOTE ] ECL: Full fetch complete (67252 records). [2025-09-17T03:24:31.152533] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-17T03:24:31.549838] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-17T03:24:31.549954] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-17T03:24:31.550740] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-17T03:24:31.550800] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-17T03:24:31.552126] [DEBUG] [LOCAL ] ECL: Trimmed 67252 records to 46722 (keeping 200 days of data) [2025-09-17T03:24:31.865732] [DEBUG] [LOCAL ] ECL: Primary data saved (46722 records). [2025-09-17T03:24:31.865923] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-17T03:24:31.866041] [INFO ] [MAIN ] Update Progress: 690/2369 symbols completed. ECL took 38.7s. Estimated remaining: 4h 4m 21s. Rate: 6.9 symbols/min [2025-09-17T03:24:31.899149] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-17T03:24:32.061783] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:32.116279] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T03:24:32.137959] [DEBUG] [LOCAL ] EDD: Loaded 20209 existing records from primary storage. [2025-09-17T03:24:32.138130] [INFO ] [MAIN ] EDD: Loaded 20209 existing records. [2025-09-17T03:24:32.317278] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:32.326983] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-17T03:24:32.327818] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T03:24:32.327864] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-17T03:24:32.332367] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-17T03:24:32.332437] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-17T03:24:32.705797] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-17T03:24:32.712634] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:33.490139] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-11. [2025-09-17T03:24:33.557342] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T03:24:33.855402] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T03:24:34.290167] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-17T03:24:34.624871] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T03:24:35.090156] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-17T03:24:35.890178] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-17T03:24:36.114807] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T03:24:36.397381] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T03:24:36.575601] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T03:24:36.690130] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-17T03:24:37.490175] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-17T03:24:37.874108] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T03:24:38.290143] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-17T03:24:38.978501] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T03:24:39.090136] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-17T03:24:39.417011] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T03:24:39.890112] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-17T03:24:40.189845] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T03:24:40.690165] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-17T03:24:41.490158] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-17T03:24:41.712461] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:24:41.875965] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T03:24:42.290129] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-17T03:24:42.430093] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T03:24:42.432717] [INFO ] [REMOTE ] ECO: Full fetch complete (29635 records). [2025-09-17T03:24:42.432844] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-17T03:24:42.803936] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-17T03:24:42.804041] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-17T03:24:42.804555] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-17T03:24:42.804624] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-17T03:24:42.805494] [DEBUG] [LOCAL ] ECO: Trimmed 29635 records to 18701 (keeping 200 days of data) [2025-09-17T03:24:42.920577] [DEBUG] [LOCAL ] ECO: Primary data saved (18701 records). [2025-09-17T03:24:42.920903] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-17T03:24:42.921020] [INFO ] [MAIN ] Update Progress: 691/2369 symbols completed. ECO took 33.6s. Estimated remaining: 4h 4m 18s. Rate: 6.9 symbols/min [2025-09-17T03:24:43.099104] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-17T03:24:43.101867] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:43.113665] [DEBUG] [LOCAL ] EDF: Loaded 9544 existing records from primary storage. [2025-09-17T03:24:43.113824] [INFO ] [MAIN ] EDF: Loaded 9544 existing records. [2025-09-17T03:24:43.291687] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:43.291950] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-17T03:24:43.292025] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-17T03:24:43.292413] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-17T03:24:43.292483] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-17T03:24:43.648106] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:43.662363] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T03:24:43.890114] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-17T03:24:44.690104] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-11. [2025-09-17T03:24:44.796777] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T03:24:45.087223] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T03:24:45.490159] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-17T03:24:45.525356] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T03:24:46.290166] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-17T03:24:47.051263] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:24:47.090172] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-17T03:24:47.359264] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T03:24:47.890146] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-17T03:24:48.690141] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-17T03:24:49.020319] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T03:24:49.442340] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T03:24:49.492863] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-17T03:24:49.496333] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:24:50.290140] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-17T03:24:50.891529] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T03:24:51.090152] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-17T03:24:51.890132] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-17T03:24:52.191943] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T03:24:52.314219] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:24:52.480837] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T03:24:52.690129] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-17T03:24:53.490160] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-17T03:24:54.290199] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-17T03:24:54.567372] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T03:24:54.591397] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T03:24:54.595365] [INFO ] [REMOTE ] EDD: Full fetch complete (38935 records). [2025-09-17T03:24:54.595459] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-17T03:24:54.988901] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-17T03:24:54.989095] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-17T03:24:54.989706] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-17T03:24:54.989810] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-17T03:24:55.001810] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T03:24:55.001928] [DEBUG] [LOCAL ] EDD: Trimmed 38935 records to 27136 (keeping 200 days of data) [2025-09-17T03:24:55.096188] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-17T03:24:55.174198] [DEBUG] [LOCAL ] EDD: Primary data saved (27136 records). [2025-09-17T03:24:55.174363] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-17T03:24:55.174497] [INFO ] [MAIN ] Update Progress: 692/2369 symbols completed. EDD took 23.3s. Estimated remaining: 4h 4m 18s. Rate: 6.9 symbols/min [2025-09-17T03:24:55.344503] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:24:55.358682] [DEBUG] [LOCAL ] EDN: Loaded 13047 existing records from primary storage. [2025-09-17T03:24:55.358835] [INFO ] [MAIN ] EDN: Loaded 13047 existing records. [2025-09-17T03:24:55.536345] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:24:55.536618] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-17T03:24:55.536701] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-17T03:24:55.537145] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-17T03:24:55.537205] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-17T03:24:55.892260] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-17T03:24:55.896354] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:24:56.690191] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-17T03:24:56.744549] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T03:24:56.933713] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T03:24:57.490207] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-17T03:24:58.224531] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T03:24:58.290154] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-17T03:24:58.488540] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T03:24:59.090161] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-17T03:24:59.754330] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T03:24:59.760981] [INFO ] [REMOTE ] ECVT: Full fetch complete (59685 records). [2025-09-17T03:24:59.761280] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-17T03:24:59.895348] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-11. [2025-09-17T03:25:00.140492] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T03:25:00.178884] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-17T03:25:00.179321] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-17T03:25:00.180268] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-17T03:25:00.180340] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-17T03:25:00.181602] [DEBUG] [LOCAL ] ECVT: Trimmed 59685 records to 43110 (keeping 200 days of data) [2025-09-17T03:25:00.442336] [DEBUG] [LOCAL ] ECVT: Primary data saved (43110 records). [2025-09-17T03:25:00.442540] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-17T03:25:00.442698] [INFO ] [MAIN ] Update Progress: 693/2369 symbols completed. ECVT took 44.0s. Estimated remaining: 4h 4m 1s. Rate: 6.9 symbols/min [2025-09-17T03:25:00.615240] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:00.648560] [DEBUG] [LOCAL ] EDU: Loaded 32909 existing records from primary storage. [2025-09-17T03:25:00.648745] [INFO ] [MAIN ] EDU: Loaded 32909 existing records. [2025-09-17T03:25:00.702439] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-17T03:25:00.827168] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:00.827399] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-17T03:25:00.827465] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-17T03:25:00.828203] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-17T03:25:00.828273] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-17T03:25:01.178977] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:01.251231] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T03:25:01.343605] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T03:25:01.490112] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-11. [2025-09-17T03:25:02.290149] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-17T03:25:03.090144] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-17T03:25:03.169751] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T03:25:03.250419] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T03:25:03.890187] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-17T03:25:04.455994] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T03:25:04.690275] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-17T03:25:05.490199] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-17T03:25:05.800515] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T03:25:06.255574] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T03:25:06.290192] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-17T03:25:06.382299] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T03:25:07.090130] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-17T03:25:07.857711] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T03:25:07.859825] [INFO ] [REMOTE ] EDF: Full fetch complete (20899 records). [2025-09-17T03:25:07.859947] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-17T03:25:07.895235] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-17T03:25:08.250743] [DEBUG] [VALIDATOR ] EDF: All expected trading days are present. [2025-09-17T03:25:08.250931] [DEBUG] [VALIDATOR ] EDF: Primary data validation passed. [2025-09-17T03:25:08.251383] [INFO ] [MAIN ] EDF: Fetched primary data is valid. [2025-09-17T03:25:08.251516] [DEBUG] [LOCAL ] EDF: Saving primary data. [2025-09-17T03:25:08.252270] [DEBUG] [LOCAL ] EDF: Trimmed 20899 records to 13446 (keeping 200 days of data) [2025-09-17T03:25:08.352402] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T03:25:08.385484] [DEBUG] [LOCAL ] EDF: Primary data saved (13446 records). [2025-09-17T03:25:08.385679] [INFO ] [MAIN ] EDF: Full history saved. [2025-09-17T03:25:08.385817] [INFO ] [MAIN ] Update Progress: 694/2369 symbols completed. EDF took 25.5s. Estimated remaining: 4h 3m 50s. Rate: 6.9 symbols/min [2025-09-17T03:25:08.558268] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:08.582410] [DEBUG] [LOCAL ] EE: Loaded 24150 existing records from primary storage. [2025-09-17T03:25:08.582610] [INFO ] [MAIN ] EE: Loaded 24150 existing records. [2025-09-17T03:25:08.695256] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-17T03:25:08.764388] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:08.764684] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-17T03:25:08.764760] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-17T03:25:08.765361] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-17T03:25:08.765426] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-17T03:25:09.177343] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:09.490162] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-17T03:25:09.618960] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T03:25:10.290176] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-17T03:25:10.563696] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T03:25:10.571043] [INFO ] [REMOTE ] ED: Full fetch complete (76198 records). [2025-09-17T03:25:10.571216] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-17T03:25:10.970134] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-17T03:25:10.970359] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-17T03:25:10.971319] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-17T03:25:10.971533] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-17T03:25:10.973350] [DEBUG] [LOCAL ] ED: Trimmed 76198 records to 52817 (keeping 200 days of data) [2025-09-17T03:25:11.059519] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T03:25:11.092865] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-11. [2025-09-17T03:25:11.344416] [DEBUG] [LOCAL ] ED: Primary data saved (52817 records). [2025-09-17T03:25:11.344628] [INFO ] [MAIN ] ED: Full history saved. [2025-09-17T03:25:11.344753] [INFO ] [MAIN ] Update Progress: 695/2369 symbols completed. ED took 42.5s. Estimated remaining: 4h 3m 27s. Rate: 6.9 symbols/min [2025-09-17T03:25:11.519320] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:11.523413] [DEBUG] [LOCAL ] EEA: Loaded 1988 existing records from primary storage. [2025-09-17T03:25:11.523542] [INFO ] [MAIN ] EEA: Loaded 1988 existing records. [2025-09-17T03:25:11.713367] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:11.713725] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-17T03:25:11.713792] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-17T03:25:11.714075] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-17T03:25:11.714140] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-17T03:25:11.896216] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-17T03:25:12.074589] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:12.102869] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T03:25:12.365010] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T03:25:12.690140] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-11. [2025-09-17T03:25:12.793454] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T03:25:13.136566] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T03:25:13.490140] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-17T03:25:14.290123] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-17T03:25:14.573216] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T03:25:15.090145] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-17T03:25:15.611474] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T03:25:15.630000] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T03:25:15.890140] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-17T03:25:16.690155] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-17T03:25:17.004737] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T03:25:17.190775] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T03:25:17.490151] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-17T03:25:17.865764] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-17T03:25:18.290127] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-17T03:25:19.090120] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-17T03:25:19.468582] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T03:25:19.890138] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-17T03:25:20.484937] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T03:25:20.690165] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-17T03:25:20.814681] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T03:25:21.024274] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-17T03:25:21.490138] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-17T03:25:21.977371] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T03:25:22.290138] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-17T03:25:23.090087] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-17T03:25:23.438305] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:25:23.438736] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:25:23.890180] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-17T03:25:24.690148] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-17T03:25:25.490099] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-17T03:25:25.593574] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T03:25:25.899596] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-17T03:25:26.051373] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T03:25:26.290131] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-17T03:25:27.090134] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-17T03:25:27.310943] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T03:25:27.890188] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-17T03:25:28.339663] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T03:25:28.400033] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T03:25:28.690128] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-17T03:25:29.490220] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-17T03:25:30.290200] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-17T03:25:30.365706] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T03:25:30.495244] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T03:25:30.595312] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-17T03:25:30.596190] [INFO ] [REMOTE ] EEA: Full fetch complete (3985 records). [2025-09-17T03:25:30.596320] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-17T03:25:30.963444] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-17T03:25:30.963564] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-17T03:25:30.963770] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-17T03:25:30.963844] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-17T03:25:30.964281] [DEBUG] [LOCAL ] EEA: Trimmed 3985 records to 2847 (keeping 200 days of data) [2025-09-17T03:25:30.981569] [DEBUG] [LOCAL ] EEA: Primary data saved (2847 records). [2025-09-17T03:25:30.981695] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-17T03:25:30.981808] [INFO ] [MAIN ] Update Progress: 696/2369 symbols completed. EEA took 19.6s. Estimated remaining: 4h 3m 45s. Rate: 6.9 symbols/min [2025-09-17T03:25:31.095213] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-17T03:25:31.153196] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:31.162608] [DEBUG] [LOCAL ] EEX: Loaded 7285 existing records from primary storage. [2025-09-17T03:25:31.162868] [INFO ] [MAIN ] EEX: Loaded 7285 existing records. [2025-09-17T03:25:31.347942] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:31.348229] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-17T03:25:31.348305] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-17T03:25:31.348672] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-17T03:25:31.348745] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-17T03:25:31.717026] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:31.890137] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-11. [2025-09-17T03:25:32.125415] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T03:25:32.501575] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T03:25:32.690168] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-17T03:25:33.490164] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-17T03:25:33.741961] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T03:25:34.290151] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-17T03:25:34.914507] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T03:25:35.090109] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-17T03:25:35.282540] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T03:25:35.890134] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-17T03:25:36.284165] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T03:25:36.690151] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-17T03:25:37.490197] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-17T03:25:37.628087] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T03:25:37.703297] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T03:25:38.087419] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T03:25:38.290137] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-17T03:25:39.090142] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-17T03:25:39.370207] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T03:25:39.890162] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-17T03:25:40.566252] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T03:25:40.690102] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-17T03:25:41.393505] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T03:25:41.490175] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-17T03:25:41.834186] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T03:25:42.290118] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-17T03:25:42.878860] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T03:25:42.884353] [INFO ] [REMOTE ] EDU: Full fetch complete (66507 records). [2025-09-17T03:25:42.884494] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-17T03:25:43.111725] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-17T03:25:43.216138] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T03:25:43.273095] [INFO ] [REMOTE ] EE: Full fetch complete (43349 records). [2025-09-17T03:25:43.293010] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-17T03:25:43.292899] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-17T03:25:43.293203] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-17T03:25:43.294069] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-17T03:25:43.337411] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-17T03:25:43.401289] [DEBUG] [LOCAL ] EDU: Trimmed 66507 records to 45350 (keeping 200 days of data) [2025-09-17T03:25:43.764245] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-17T03:25:43.766333] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-17T03:25:43.767528] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-17T03:25:43.768444] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-17T03:25:43.772352] [DEBUG] [LOCAL ] EE: Trimmed 43349 records to 32616 (keeping 200 days of data) [2025-09-17T03:25:43.890944] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-17T03:25:44.135958] [DEBUG] [LOCAL ] EDU: Primary data saved (45350 records). [2025-09-17T03:25:44.137104] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-17T03:25:44.137948] [INFO ] [MAIN ] Update Progress: 697/2369 symbols completed. EDU took 43.7s. Estimated remaining: 4h 3m 47s. Rate: 6.9 symbols/min [2025-09-17T03:25:44.241341] [DEBUG] [LOCAL ] EE: Primary data saved (32616 records). [2025-09-17T03:25:44.247009] [INFO ] [MAIN ] EE: Full history saved. [2025-09-17T03:25:44.257396] [INFO ] [MAIN ] Update Progress: 698/2369 symbols completed. EE took 35.9s. Estimated remaining: 4h 3m 17s. Rate: 6.9 symbols/min [2025-09-17T03:25:44.359164] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:44.465010] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T03:25:44.499145] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:44.519390] [DEBUG] [LOCAL ] EFR: Loaded 10364 existing records from primary storage. [2025-09-17T03:25:44.519541] [INFO ] [MAIN ] EFR: Loaded 10364 existing records. [2025-09-17T03:25:44.629828] [DEBUG] [LOCAL ] EFC: Loaded 34040 existing records from primary storage. [2025-09-17T03:25:44.645703] [INFO ] [MAIN ] EFC: Loaded 34040 existing records. [2025-09-17T03:25:44.700696] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-17T03:25:44.789585] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:44.811754] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-17T03:25:44.811870] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-17T03:25:44.817503] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-17T03:25:44.838412] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-17T03:25:44.957693] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:44.989221] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-17T03:25:44.989329] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-17T03:25:44.995215] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-17T03:25:45.010756] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-17T03:25:45.266996] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T03:25:45.321854] [INFO ] [REMOTE ] EDN: Full fetch complete (30377 records). [2025-09-17T03:25:45.454998] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:45.411117] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-17T03:25:45.497441] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-11. [2025-09-17T03:25:45.699254] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:45.743093] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T03:25:45.999532] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-17T03:25:45.999660] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-17T03:25:46.000197] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-17T03:25:46.000251] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-17T03:25:46.001005] [DEBUG] [LOCAL ] EDN: Trimmed 30377 records to 17603 (keeping 200 days of data) [2025-09-17T03:25:46.104870] [DEBUG] [LOCAL ] EDN: Primary data saved (17603 records). [2025-09-17T03:25:46.105020] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-17T03:25:46.105112] [INFO ] [MAIN ] Update Progress: 699/2369 symbols completed. EDN took 50.9s. Estimated remaining: 4h 2m 52s. Rate: 6.9 symbols/min [2025-09-17T03:25:46.272522] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:46.285020] [DEBUG] [LOCAL ] EFT: Loaded 9155 existing records from primary storage. [2025-09-17T03:25:46.285166] [INFO ] [MAIN ] EFT: Loaded 9155 existing records. [2025-09-17T03:25:46.296231] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-17T03:25:46.465106] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:46.471065] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-17T03:25:46.471513] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-17T03:25:46.471741] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T03:25:46.474317] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-17T03:25:46.474383] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-17T03:25:46.824440] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:47.090142] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-11. [2025-09-17T03:25:47.239780] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T03:25:47.890188] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-17T03:25:47.932405] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T03:25:48.690140] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-17T03:25:48.713436] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T03:25:49.490166] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-17T03:25:49.503736] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:25:50.290161] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-11. [2025-09-17T03:25:50.400635] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T03:25:51.090151] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-17T03:25:51.890198] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-17T03:25:51.957069] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T03:25:52.007775] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T03:25:52.665018] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T03:25:52.690071] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-17T03:25:53.490160] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-17T03:25:53.497755] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T03:25:54.290136] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-17T03:25:55.090127] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-17T03:25:55.149402] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:25:55.268813] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T03:25:55.734370] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:25:55.735948] [INFO ] [REMOTE ] EEX: Full fetch complete (20157 records). [2025-09-17T03:25:55.736040] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-17T03:25:55.890951] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-17T03:25:56.096429] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-17T03:25:56.096539] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-17T03:25:56.096969] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-17T03:25:56.097070] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-17T03:25:56.097689] [DEBUG] [LOCAL ] EEX: Trimmed 20157 records to 12348 (keeping 200 days of data) [2025-09-17T03:25:56.170708] [DEBUG] [LOCAL ] EEX: Primary data saved (12348 records). [2025-09-17T03:25:56.170874] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-17T03:25:56.170967] [INFO ] [MAIN ] Update Progress: 700/2369 symbols completed. EEX took 25.2s. Estimated remaining: 4h 2m 46s. Rate: 6.9 symbols/min [2025-09-17T03:25:56.344442] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:25:56.375823] [DEBUG] [LOCAL ] EFX: Loaded 32959 existing records from primary storage. [2025-09-17T03:25:56.375994] [INFO ] [MAIN ] EFX: Loaded 32959 existing records. [2025-09-17T03:25:56.554437] [WARN ] [MAIN ] EFX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:25:56.554728] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-17T03:25:56.554791] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-17T03:25:56.555623] [DEBUG] [LOCAL ] EFX: Deleted primary data file. [2025-09-17T03:25:56.555712] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-17T03:25:56.665489] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T03:25:56.702202] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-17T03:25:56.914806] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:25:57.490116] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-11. [2025-09-17T03:25:57.613919] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T03:25:58.290149] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-17T03:25:59.090115] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-17T03:25:59.222111] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T03:25:59.314448] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T03:25:59.830592] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T03:25:59.890156] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-17T03:26:00.695486] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-17T03:26:00.699441] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T03:26:01.490184] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-17T03:26:02.290145] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-17T03:26:02.361736] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T03:26:03.090150] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-17T03:26:03.110672] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T03:26:03.162450] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T03:26:03.890179] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-17T03:26:03.993171] [DEBUG] [REMOTE ] EFX: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T03:26:03.993543] [WARN ] [REMOTE ] EFX: No data returned for month 2025-01 [2025-09-17T03:26:04.598290] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T03:26:04.690144] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-17T03:26:05.490150] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-17T03:26:06.290144] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-17T03:26:06.386773] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T03:26:06.410936] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T03:26:07.090205] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-17T03:26:07.890201] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-17T03:26:07.920819] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:26:08.038103] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T03:26:08.690174] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-17T03:26:08.849721] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T03:26:09.429357] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T03:26:09.490141] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-17T03:26:10.290169] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-17T03:26:10.447615] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T03:26:11.090179] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-17T03:26:11.140237] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T03:26:11.142540] [INFO ] [REMOTE ] EFR: Full fetch complete (18378 records). [2025-09-17T03:26:11.142629] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-17T03:26:11.515385] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-17T03:26:11.515481] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-17T03:26:11.515888] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-17T03:26:11.515938] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-17T03:26:11.516544] [DEBUG] [LOCAL ] EFR: Trimmed 18378 records to 14030 (keeping 200 days of data) [2025-09-17T03:26:11.601628] [DEBUG] [LOCAL ] EFR: Primary data saved (14030 records). [2025-09-17T03:26:11.601801] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-17T03:26:11.601899] [INFO ] [MAIN ] Update Progress: 701/2369 symbols completed. EFR took 27.3s. Estimated remaining: 4h 2m 54s. Rate: 6.9 symbols/min [2025-09-17T03:26:11.770976] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:11.790813] [DEBUG] [LOCAL ] EFXT: Loaded 21228 existing records from primary storage. [2025-09-17T03:26:11.790966] [INFO ] [MAIN ] EFXT: Loaded 21228 existing records. [2025-09-17T03:26:11.893396] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-17T03:26:11.975552] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:11.975829] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-17T03:26:11.975906] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-17T03:26:11.976493] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-17T03:26:11.976564] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-17T03:26:12.333045] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:12.690093] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-11. [2025-09-17T03:26:12.793538] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T03:26:12.969804] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T03:26:13.490130] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-17T03:26:13.947977] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T03:26:14.290171] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-17T03:26:15.090177] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-17T03:26:15.257529] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:26:15.275542] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:26:15.890202] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-17T03:26:16.051014] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T03:26:16.698072] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-17T03:26:16.700538] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T03:26:17.490199] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-17T03:26:17.905355] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T03:26:18.290139] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-17T03:26:19.090151] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-17T03:26:19.414692] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T03:26:19.890130] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-17T03:26:20.018173] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T03:26:20.080885] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T03:26:20.690129] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-17T03:26:21.465025] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T03:26:21.467063] [INFO ] [REMOTE ] EFT: Full fetch complete (17407 records). [2025-09-17T03:26:21.467159] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-17T03:26:21.497904] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-17T03:26:21.868819] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T03:26:21.898949] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-17T03:26:21.899340] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-17T03:26:21.900206] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-17T03:26:21.900469] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-17T03:26:21.901686] [DEBUG] [LOCAL ] EFT: Trimmed 17407 records to 12466 (keeping 200 days of data) [2025-09-17T03:26:21.981515] [DEBUG] [LOCAL ] EFT: Primary data saved (12466 records). [2025-09-17T03:26:21.981699] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-17T03:26:21.981802] [INFO ] [MAIN ] Update Progress: 702/2369 symbols completed. EFT took 35.9s. Estimated remaining: 4h 2m 49s. Rate: 6.9 symbols/min [2025-09-17T03:26:22.152895] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:22.173565] [DEBUG] [LOCAL ] EG: Loaded 21087 existing records from primary storage. [2025-09-17T03:26:22.173743] [INFO ] [MAIN ] EG: Loaded 21087 existing records. [2025-09-17T03:26:22.295268] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-17T03:26:22.362599] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:22.362892] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-17T03:26:22.362957] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-17T03:26:22.363600] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-17T03:26:22.363685] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-17T03:26:22.754085] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:22.881220] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:26:23.090131] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-17T03:26:23.890135] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-17T03:26:24.038330] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T03:26:24.518289] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T03:26:24.690141] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-17T03:26:25.495813] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-11. [2025-09-17T03:26:25.504334] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:26:25.557004] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T03:26:26.290130] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-17T03:26:26.940466] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:26:27.090120] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-17T03:26:27.497133] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T03:26:27.890174] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-17T03:26:28.521156] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T03:26:28.690127] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-17T03:26:29.490131] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-17T03:26:29.677122] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:26:30.290198] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-17T03:26:30.399143] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T03:26:30.996734] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T03:26:31.090103] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-17T03:26:31.813388] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T03:26:31.890099] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-17T03:26:32.679413] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:26:32.690083] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-17T03:26:33.490114] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-17T03:26:33.522478] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T03:26:33.528501] [INFO ] [REMOTE ] EFC: Full fetch complete (65879 records). [2025-09-17T03:26:33.528680] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-17T03:26:33.922727] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-17T03:26:33.922960] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-17T03:26:33.924066] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-17T03:26:33.924203] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-17T03:26:33.940458] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T03:26:33.946548] [DEBUG] [LOCAL ] EFC: Trimmed 65879 records to 46276 (keeping 200 days of data) [2025-09-17T03:26:34.231046] [DEBUG] [LOCAL ] EFC: Primary data saved (46276 records). [2025-09-17T03:26:34.231261] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-17T03:26:34.231391] [INFO ] [MAIN ] Update Progress: 703/2369 symbols completed. EFC took 50.1s. Estimated remaining: 4h 2m 48s. Rate: 6.9 symbols/min [2025-09-17T03:26:34.295429] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-17T03:26:34.401999] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:34.438102] [DEBUG] [LOCAL ] EGO: Loaded 38230 existing records from primary storage. [2025-09-17T03:26:34.438284] [INFO ] [MAIN ] EGO: Loaded 38230 existing records. [2025-09-17T03:26:34.613484] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:34.613778] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-17T03:26:34.613850] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-17T03:26:34.614789] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-17T03:26:34.614863] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-17T03:26:34.971712] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:34.994942] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T03:26:35.000473] [INFO ] [REMOTE ] EFX: Full fetch complete (58204 records). [2025-09-17T03:26:35.000595] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-17T03:26:35.098790] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-17T03:26:35.193741] [WARN ] [VALIDATOR ] EFX: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T03:26:35.194330] [FATAL] [MAIN ] EFX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:26:35.194382] [WARN ] [MAIN ] EFX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:26:35.194432] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-17T03:26:35.194494] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-09-17T03:26:35.194538] [INFO ] [LOCAL ] EFX: Starting deletion of derivative data. [2025-09-17T03:26:35.194892] [DEBUG] [LOCAL ] EFX: Deleted derivative data file. [2025-09-17T03:26:35.194994] [INFO ] [MAIN ] Update Progress: 704/2369 symbols completed. EFX took 39.0s. Estimated remaining: 4h 2m 21s. Rate: 6.9 symbols/min [2025-09-17T03:26:35.365373] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:35.387284] [DEBUG] [LOCAL ] EGP: Loaded 22312 existing records from primary storage. [2025-09-17T03:26:35.387429] [INFO ] [MAIN ] EGP: Loaded 22312 existing records. [2025-09-17T03:26:35.570761] [WARN ] [MAIN ] EGP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:35.571005] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-17T03:26:35.571064] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-17T03:26:35.571586] [DEBUG] [LOCAL ] EGP: Deleted primary data file. [2025-09-17T03:26:35.571668] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-17T03:26:35.890220] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-11. [2025-09-17T03:26:35.929859] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:35.950546] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T03:26:36.458905] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T03:26:36.690153] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-17T03:26:37.490138] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-11. [2025-09-17T03:26:37.620152] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T03:26:37.844258] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:26:37.848402] [INFO ] [REMOTE ] EFXT: Full fetch complete (44090 records). [2025-09-17T03:26:37.848507] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-17T03:26:38.232468] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-17T03:26:38.232615] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-17T03:26:38.233474] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-17T03:26:38.233583] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-17T03:26:38.234884] [DEBUG] [LOCAL ] EFXT: Trimmed 44090 records to 29735 (keeping 200 days of data) [2025-09-17T03:26:38.293550] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-17T03:26:38.417823] [DEBUG] [LOCAL ] EFXT: Primary data saved (29735 records). [2025-09-17T03:26:38.418001] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-17T03:26:38.418109] [INFO ] [MAIN ] Update Progress: 705/2369 symbols completed. EFXT took 26.8s. Estimated remaining: 4h 1m 60s. Rate: 6.9 symbols/min [2025-09-17T03:26:38.594345] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:38.630759] [DEBUG] [LOCAL ] EGY: Loaded 30724 existing records from primary storage. [2025-09-17T03:26:38.630929] [INFO ] [MAIN ] EGY: Loaded 30724 existing records. [2025-09-17T03:26:38.810741] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:38.811038] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-17T03:26:38.811253] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-17T03:26:38.812007] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-17T03:26:38.812075] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-17T03:26:38.932686] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:26:39.095236] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-17T03:26:39.194387] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:39.890146] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-11. [2025-09-17T03:26:40.028203] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T03:26:40.362278] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T03:26:40.690148] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-17T03:26:41.246856] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T03:26:41.490165] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-17T03:26:42.302372] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-17T03:26:42.305224] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:26:42.886136] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T03:26:43.090158] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-17T03:26:43.744866] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T03:26:43.890158] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-17T03:26:44.690152] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-17T03:26:44.768080] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T03:26:45.490212] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-17T03:26:45.563773] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T03:26:46.100857] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:26:46.290153] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-17T03:26:47.065723] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T03:26:47.090090] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-17T03:26:47.803329] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T03:26:47.890177] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-17T03:26:48.690243] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-17T03:26:48.891662] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T03:26:48.942358] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T03:26:49.490147] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-17T03:26:50.251567] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T03:26:50.290108] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-17T03:26:50.908446] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T03:26:51.090141] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-17T03:26:51.890128] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-17T03:26:52.094859] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T03:26:52.570408] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T03:26:52.690191] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-17T03:26:53.234762] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T03:26:53.490170] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-17T03:26:54.290131] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-17T03:26:54.481029] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T03:26:54.710923] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:26:55.090129] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-17T03:26:55.716767] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T03:26:55.890096] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-17T03:26:56.206687] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T03:26:56.210305] [INFO ] [REMOTE ] EG: Full fetch complete (44010 records). [2025-09-17T03:26:56.210452] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-17T03:26:56.603746] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-17T03:26:56.603896] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-17T03:26:56.605060] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-17T03:26:56.605153] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-17T03:26:56.606447] [DEBUG] [LOCAL ] EG: Trimmed 44010 records to 29036 (keeping 200 days of data) [2025-09-17T03:26:56.699496] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-17T03:26:56.797281] [DEBUG] [LOCAL ] EG: Primary data saved (29036 records). [2025-09-17T03:26:56.797464] [INFO ] [MAIN ] EG: Full history saved. [2025-09-17T03:26:56.797565] [INFO ] [MAIN ] Update Progress: 706/2369 symbols completed. EG took 34.8s. Estimated remaining: 4h 2m 14s. Rate: 6.9 symbols/min [2025-09-17T03:26:56.967174] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:26:56.988174] [DEBUG] [LOCAL ] EHAB: Loaded 22697 existing records from primary storage. [2025-09-17T03:26:56.988331] [INFO ] [MAIN ] EHAB: Loaded 22697 existing records. [2025-09-17T03:26:57.166464] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:26:57.166749] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-17T03:26:57.166810] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-17T03:26:57.167275] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-17T03:26:57.167333] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-17T03:26:57.502985] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-17T03:26:57.544322] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:26:57.580100] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:26:58.290141] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-11. [2025-09-17T03:26:58.361325] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T03:26:59.090214] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-17T03:26:59.254620] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T03:26:59.703783] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T03:26:59.890083] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-17T03:27:00.697496] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-17T03:27:00.714196] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T03:27:01.179572] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T03:27:01.490134] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-17T03:27:02.097193] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:27:02.290150] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-17T03:27:03.090149] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-17T03:27:03.890100] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-17T03:27:04.309062] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-17T03:27:04.678830] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (2.39 seconds). [2025-09-17T03:27:04.690068] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-17T03:27:04.803163] [DEBUG] [REMOTE ] EGP: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-17T03:27:04.803481] [WARN ] [REMOTE ] EGP: No data returned for month 2025-07 [2025-09-17T03:27:05.193224] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T03:27:05.372797] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-17T03:27:05.490091] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-17T03:27:06.290143] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-17T03:27:07.008073] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T03:27:07.090143] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-17T03:27:07.187884] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T03:27:07.890163] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-17T03:27:08.653428] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T03:27:08.660030] [INFO ] [REMOTE ] EGO: Full fetch complete (72973 records). [2025-09-17T03:27:08.660211] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-17T03:27:08.695265] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-17T03:27:08.881287] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T03:27:08.998695] [INFO ] [REMOTE ] EGP: Full fetch complete (39781 records). [2025-09-17T03:27:09.009397] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-17T03:27:09.243619] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-17T03:27:09.270485] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-17T03:27:09.280713] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-17T03:27:09.282473] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-17T03:27:09.311967] [WARN ] [VALIDATOR ] EGP: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-17T03:27:09.312667] [FATAL] [MAIN ] EGP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:27:09.312900] [WARN ] [MAIN ] EGP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:27:09.312970] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-17T03:27:09.313237] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-09-17T03:27:09.313142] [DEBUG] [LOCAL ] EGO: Trimmed 72973 records to 51384 (keeping 200 days of data) [2025-09-17T03:27:09.313475] [INFO ] [LOCAL ] EGP: Starting deletion of derivative data. [2025-09-17T03:27:09.314174] [DEBUG] [LOCAL ] EGP: Deleted derivative data file. [2025-09-17T03:27:09.314368] [INFO ] [MAIN ] Update Progress: 707/2369 symbols completed. EGP took 34.1s. Estimated remaining: 4h 2m 14s. Rate: 6.9 symbols/min [2025-09-17T03:27:09.494753] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-17T03:27:09.654683] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:09.704195] [DEBUG] [LOCAL ] EHC: Loaded 30997 existing records from primary storage. [2025-09-17T03:27:09.706167] [INFO ] [MAIN ] EHC: Loaded 30997 existing records. [2025-09-17T03:27:10.017233] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:27:10.132915] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:27:10.155218] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-17T03:27:10.155410] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-17T03:27:10.156512] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-17T03:27:10.156622] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-17T03:27:10.290517] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-17T03:27:10.752432] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:10.760056] [DEBUG] [LOCAL ] EGO: Primary data saved (51384 records). [2025-09-17T03:27:10.760205] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-17T03:27:10.760304] [INFO ] [MAIN ] Update Progress: 708/2369 symbols completed. EGO took 36.5s. Estimated remaining: 4h 1m 48s. Rate: 6.9 symbols/min [2025-09-17T03:27:10.932532] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:10.941385] [DEBUG] [LOCAL ] EHI: Loaded 7902 existing records from primary storage. [2025-09-17T03:27:10.941497] [INFO ] [MAIN ] EHI: Loaded 7902 existing records. [2025-09-17T03:27:11.095144] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-11. [2025-09-17T03:27:11.123549] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:27:11.124120] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-17T03:27:11.124231] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-17T03:27:11.124624] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-17T03:27:11.124718] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-17T03:27:11.523742] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:11.525267] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T03:27:11.652939] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T03:27:11.890178] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-17T03:27:12.414802] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T03:27:12.690153] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-11. [2025-09-17T03:27:13.149238] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T03:27:13.490214] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-17T03:27:13.620549] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T03:27:14.290308] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-17T03:27:14.718617] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T03:27:15.090162] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-17T03:27:15.890189] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-17T03:27:15.940319] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:27:16.690163] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-17T03:27:17.490131] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-17T03:27:17.670592] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T03:27:17.960141] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-09-17T03:27:18.290127] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-17T03:27:18.344527] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T03:27:18.503710] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T03:27:18.509012] [INFO ] [REMOTE ] EGY: Full fetch complete (61751 records). [2025-09-17T03:27:18.509159] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-17T03:27:18.914099] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-17T03:27:18.914236] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-17T03:27:18.925058] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-17T03:27:18.925851] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T03:27:18.926073] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-17T03:27:18.932713] [DEBUG] [LOCAL ] EGY: Trimmed 61751 records to 42423 (keeping 200 days of data) [2025-09-17T03:27:19.104781] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-17T03:27:19.188391] [DEBUG] [LOCAL ] EGY: Primary data saved (42423 records). [2025-09-17T03:27:19.188546] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-17T03:27:19.188667] [INFO ] [MAIN ] Update Progress: 709/2369 symbols completed. EGY took 40.8s. Estimated remaining: 4h 1m 38s. Rate: 6.9 symbols/min [2025-09-17T03:27:19.368148] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:19.386455] [DEBUG] [LOCAL ] EIC: Loaded 17796 existing records from primary storage. [2025-09-17T03:27:19.386611] [INFO ] [MAIN ] EIC: Loaded 17796 existing records. [2025-09-17T03:27:19.575818] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:27:19.576073] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-17T03:27:19.576131] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-17T03:27:19.576598] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-17T03:27:19.576681] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-17T03:27:19.905057] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-17T03:27:19.948069] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:20.059234] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T03:27:20.690187] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-11. [2025-09-17T03:27:21.178844] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T03:27:21.490110] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-17T03:27:21.685168] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T03:27:22.290142] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-17T03:27:22.879767] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T03:27:23.090149] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-17T03:27:23.744822] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:27:23.890124] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-17T03:27:23.956613] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T03:27:24.690128] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-17T03:27:25.452630] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T03:27:25.490129] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-17T03:27:25.520594] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T03:27:26.290134] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-17T03:27:27.090199] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-17T03:27:27.207069] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T03:27:27.459201] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T03:27:27.890156] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-17T03:27:27.924990] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T03:27:28.690185] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-17T03:27:29.215920] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T03:27:29.490181] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-17T03:27:29.804728] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T03:27:30.290152] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-17T03:27:30.847799] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T03:27:31.090196] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-17T03:27:31.888433] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T03:27:31.896262] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-17T03:27:32.065918] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T03:27:32.690188] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-17T03:27:33.121035] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T03:27:33.490149] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-17T03:27:33.917232] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T03:27:34.290331] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-17T03:27:34.293537] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T03:27:35.090232] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-17T03:27:35.594123] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T03:27:35.890131] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-17T03:27:36.694872] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-17T03:27:36.700436] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T03:27:36.724387] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T03:27:37.490111] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-17T03:27:37.865081] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T03:27:38.290146] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-17T03:27:38.987549] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T03:27:39.090213] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-17T03:27:39.680670] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T03:27:39.891106] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-17T03:27:39.894006] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T03:27:40.690125] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-17T03:27:40.814444] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T03:27:40.819179] [INFO ] [REMOTE ] EHAB: Full fetch complete (41734 records). [2025-09-17T03:27:40.819291] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-17T03:27:41.200710] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-17T03:27:41.200827] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-17T03:27:41.201467] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-17T03:27:41.201530] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-17T03:27:41.202518] [DEBUG] [LOCAL ] EHAB: Trimmed 41734 records to 30206 (keeping 200 days of data) [2025-09-17T03:27:41.380844] [DEBUG] [LOCAL ] EHAB: Primary data saved (30206 records). [2025-09-17T03:27:41.380997] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-17T03:27:41.381117] [INFO ] [MAIN ] Update Progress: 710/2369 symbols completed. EHAB took 44.6s. Estimated remaining: 4h 2m 1s. Rate: 6.9 symbols/min [2025-09-17T03:27:41.495357] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-17T03:27:41.561744] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:41.561962] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-17T03:27:41.562011] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-17T03:27:41.562127] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-17T03:27:41.562185] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-17T03:27:41.562236] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-17T03:27:41.562288] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-17T03:27:41.946764] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:41.961210] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T03:27:42.290145] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-11. [2025-09-17T03:27:42.681736] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T03:27:42.934587] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T03:27:42.939439] [INFO ] [REMOTE ] EHC: Full fetch complete (58899 records). [2025-09-17T03:27:42.939566] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-17T03:27:43.095344] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-17T03:27:43.346559] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-17T03:27:43.346688] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-17T03:27:43.347709] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-17T03:27:43.347769] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-17T03:27:43.349098] [DEBUG] [LOCAL ] EHC: Trimmed 58899 records to 41727 (keeping 200 days of data) [2025-09-17T03:27:43.625254] [DEBUG] [LOCAL ] EHC: Primary data saved (41727 records). [2025-09-17T03:27:43.625416] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-17T03:27:43.625509] [INFO ] [MAIN ] Update Progress: 711/2369 symbols completed. EHC took 34.3s. Estimated remaining: 4h 1m 37s. Rate: 6.9 symbols/min [2025-09-17T03:27:43.800180] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:43.800405] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-17T03:27:43.800459] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-17T03:27:43.800575] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-17T03:27:43.800678] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-17T03:27:43.800732] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-17T03:27:43.800778] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-17T03:27:43.899185] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-17T03:27:44.161586] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:44.169433] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T03:27:44.172248] [INFO ] [REMOTE ] EIC: Full fetch complete (35881 records). [2025-09-17T03:27:44.172353] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-17T03:27:44.279102] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-17T03:27:44.560372] [DEBUG] [VALIDATOR ] EIC: All expected trading days are present. [2025-09-17T03:27:44.560485] [DEBUG] [VALIDATOR ] EIC: Primary data validation passed. [2025-09-17T03:27:44.561111] [INFO ] [MAIN ] EIC: Fetched primary data is valid. [2025-09-17T03:27:44.561177] [DEBUG] [LOCAL ] EIC: Saving primary data. [2025-09-17T03:27:44.562444] [DEBUG] [LOCAL ] EIC: Trimmed 35881 records to 24807 (keeping 200 days of data) [2025-09-17T03:27:44.690161] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-17T03:27:44.727061] [DEBUG] [LOCAL ] EIC: Primary data saved (24807 records). [2025-09-17T03:27:44.727202] [INFO ] [MAIN ] EIC: Full history saved. [2025-09-17T03:27:44.727300] [INFO ] [MAIN ] Update Progress: 712/2369 symbols completed. EIC took 25.5s. Estimated remaining: 4h 1m 11s. Rate: 6.9 symbols/min [2025-09-17T03:27:44.903588] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:44.903864] [DEBUG] [LOCAL ] EICC: No existing data file found in primary storage. [2025-09-17T03:27:44.903916] [WARN ] [MAIN ] EICC: No existing data found, performing full refresh instead. [2025-09-17T03:27:44.904031] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-17T03:27:44.904082] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-17T03:27:44.904127] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-17T03:27:44.904164] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-17T03:27:45.281981] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:45.366482] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T03:27:45.368380] [INFO ] [REMOTE ] EHI: Full fetch complete (16487 records). [2025-09-17T03:27:45.368485] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-17T03:27:45.495219] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-11. [2025-09-17T03:27:45.752410] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-17T03:27:45.752524] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-17T03:27:45.753108] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-17T03:27:45.753176] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-17T03:27:45.753766] [DEBUG] [LOCAL ] EHI: Trimmed 16487 records to 10156 (keeping 200 days of data) [2025-09-17T03:27:45.818952] [DEBUG] [LOCAL ] EHI: Primary data saved (10156 records). [2025-09-17T03:27:45.819124] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-17T03:27:45.819236] [INFO ] [MAIN ] Update Progress: 713/2369 symbols completed. EHI took 35.1s. Estimated remaining: 4h 0m 44s. Rate: 6.9 symbols/min [2025-09-17T03:27:46.001802] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:27:46.020375] [DEBUG] [LOCAL ] EIG: Loaded 15610 existing records from primary storage. [2025-09-17T03:27:46.020527] [INFO ] [MAIN ] EIG: Loaded 15610 existing records. [2025-09-17T03:27:46.123041] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T03:27:46.204997] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:27:46.205308] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-17T03:27:46.205389] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-17T03:27:46.205939] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-17T03:27:46.206012] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-17T03:27:46.295323] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-17T03:27:46.567572] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:27:46.789134] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-17T03:27:47.090147] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-11. [2025-09-17T03:27:47.565766] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T03:27:47.890144] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-11. [2025-09-17T03:27:48.690135] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-17T03:27:48.707789] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T03:27:49.316330] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T03:27:49.490130] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-17T03:27:49.932047] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T03:27:50.290149] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-17T03:27:50.927859] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T03:27:51.090144] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-17T03:27:51.550202] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T03:27:51.890130] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-17T03:27:52.690206] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-17T03:27:52.859750] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T03:27:53.135420] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T03:27:53.490180] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-17T03:27:53.955961] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T03:27:54.290137] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-17T03:27:54.779698] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-17T03:27:55.090168] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-17T03:27:55.435066] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T03:27:55.890181] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-17T03:27:56.324148] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T03:27:56.690096] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-17T03:27:57.315768] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T03:27:57.490136] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-17T03:27:58.102894] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T03:27:58.290171] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-17T03:27:58.643520] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T03:27:59.090162] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-17T03:27:59.857294] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T03:27:59.890079] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-17T03:28:00.549604] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T03:28:00.690200] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-17T03:28:01.132373] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T03:28:01.490190] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-17T03:28:02.066632] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T03:28:02.290382] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-17T03:28:02.961544] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T03:28:03.090238] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-17T03:28:03.601395] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T03:28:03.890147] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-17T03:28:04.609321] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T03:28:04.690186] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-17T03:28:05.490197] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-17T03:28:05.707294] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T03:28:05.861551] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T03:28:05.862449] [INFO ] [REMOTE ] EICB: Full fetch complete (2644 records). [2025-09-17T03:28:05.862532] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-17T03:28:06.048637] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T03:28:06.048872] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:28:06.048918] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:28:06.048967] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-17T03:28:06.049037] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-17T03:28:06.049089] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-17T03:28:06.049154] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-17T03:28:06.049225] [INFO ] [MAIN ] Update Progress: 714/2369 symbols completed. EICB took 22.4s. Estimated remaining: 4h 1m 2s. Rate: 6.9 symbols/min [2025-09-17T03:28:06.226723] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:06.268116] [DEBUG] [LOCAL ] EIX: Loaded 39795 existing records from primary storage. [2025-09-17T03:28:06.268297] [INFO ] [MAIN ] EIX: Loaded 39795 existing records. [2025-09-17T03:28:06.299194] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-17T03:28:06.451298] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:06.451611] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-17T03:28:06.451689] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-17T03:28:06.452630] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-17T03:28:06.452721] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-17T03:28:06.783699] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-17T03:28:06.810827] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:07.090129] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-17T03:28:07.467019] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T03:28:07.890126] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-17T03:28:08.690163] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-17T03:28:08.992951] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T03:28:09.033190] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T03:28:09.490144] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-17T03:28:10.290118] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-17T03:28:10.510404] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T03:28:10.655506] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-17T03:28:11.090147] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-17T03:28:11.864002] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T03:28:11.890127] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-17T03:28:12.516409] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T03:28:12.518110] [INFO ] [REMOTE ] EICC: Full fetch complete (7705 records). [2025-09-17T03:28:12.518203] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-17T03:28:12.701821] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-17T03:28:12.879579] [DEBUG] [VALIDATOR ] EICC: All expected trading days are present. [2025-09-17T03:28:12.879695] [DEBUG] [VALIDATOR ] EICC: Primary data validation passed. [2025-09-17T03:28:12.879906] [INFO ] [MAIN ] EICC: Fetched primary data is valid. [2025-09-17T03:28:12.879956] [DEBUG] [LOCAL ] EICC: Saving primary data. [2025-09-17T03:28:12.880379] [DEBUG] [LOCAL ] EICC: Trimmed 7705 records to 5979 (keeping 200 days of data) [2025-09-17T03:28:12.921287] [DEBUG] [LOCAL ] EICC: Primary data saved (5979 records). [2025-09-17T03:28:12.921453] [INFO ] [MAIN ] EICC: Full history saved. [2025-09-17T03:28:12.921546] [INFO ] [MAIN ] Update Progress: 715/2369 symbols completed. EICC took 28.2s. Estimated remaining: 4h 0m 49s. Rate: 6.9 symbols/min [2025-09-17T03:28:13.091734] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:13.140931] [DEBUG] [LOCAL ] EL: Loaded 39892 existing records from primary storage. [2025-09-17T03:28:13.141097] [INFO ] [MAIN ] EL: Loaded 39892 existing records. [2025-09-17T03:28:13.244237] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T03:28:13.326513] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:13.326837] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-17T03:28:13.326922] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-17T03:28:13.327864] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-17T03:28:13.327931] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-17T03:28:13.490536] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-17T03:28:13.693801] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:13.876614] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T03:28:13.877395] [INFO ] [REMOTE ] EICA: Full fetch complete (1294 records). [2025-09-17T03:28:13.877481] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-17T03:28:13.877867] [FATAL] [VALIDATOR ] EICA: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T03:28:13.877941] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:28:13.877987] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:28:13.878028] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-17T03:28:13.878091] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-17T03:28:13.878139] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-17T03:28:13.878201] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-17T03:28:13.878267] [INFO ] [MAIN ] Update Progress: 716/2369 symbols completed. EICA took 32.5s. Estimated remaining: 4h 0m 22s. Rate: 6.9 symbols/min [2025-09-17T03:28:14.046735] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:14.090845] [DEBUG] [LOCAL ] ELAN: Loaded 39704 existing records from primary storage. [2025-09-17T03:28:14.091018] [INFO ] [MAIN ] ELAN: Loaded 39704 existing records. [2025-09-17T03:28:14.266739] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:14.266978] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-17T03:28:14.267037] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-17T03:28:14.267869] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-17T03:28:14.267932] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-17T03:28:14.296896] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-11. [2025-09-17T03:28:14.648080] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:15.090196] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-11. [2025-09-17T03:28:15.890177] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-11. [2025-09-17T03:28:16.634039] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-17T03:28:16.690078] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-17T03:28:16.747399] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T03:28:17.490103] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-17T03:28:17.640991] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:28:18.290140] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-17T03:28:18.793934] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-17T03:28:19.024521] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T03:28:19.049080] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T03:28:19.090081] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-17T03:28:19.890106] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-17T03:28:20.270565] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T03:28:20.690131] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-17T03:28:21.490180] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-17T03:28:21.716109] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T03:28:21.813297] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T03:28:22.290142] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-17T03:28:23.090132] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-17T03:28:23.288441] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T03:28:23.523349] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T03:28:23.890183] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-17T03:28:24.494404] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T03:28:24.690131] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-17T03:28:25.490127] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-17T03:28:25.942427] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-17T03:28:26.026382] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T03:28:26.290124] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-17T03:28:27.090185] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-17T03:28:27.556822] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T03:28:27.716222] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T03:28:27.890157] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-17T03:28:28.534346] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T03:28:28.690149] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-17T03:28:29.435750] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T03:28:29.490079] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-17T03:28:29.912201] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:28:30.290177] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-17T03:28:31.090095] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-17T03:28:31.685842] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T03:28:31.774328] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T03:28:31.890145] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-17T03:28:32.690200] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-17T03:28:32.985977] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:28:33.490185] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-17T03:28:33.552676] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T03:28:34.290143] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-17T03:28:34.928911] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-17T03:28:35.010075] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T03:28:35.090152] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-17T03:28:35.642246] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T03:28:35.890200] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-17T03:28:36.690134] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-17T03:28:36.959181] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T03:28:37.380004] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T03:28:37.382913] [INFO ] [REMOTE ] EIG: Full fetch complete (26614 records). [2025-09-17T03:28:37.383009] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-17T03:28:37.495233] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-17T03:28:37.759972] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-17T03:28:37.760210] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-17T03:28:37.760804] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-17T03:28:37.760887] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-17T03:28:37.762162] [DEBUG] [LOCAL ] EIG: Trimmed 26614 records to 20226 (keeping 200 days of data) [2025-09-17T03:28:37.891287] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T03:28:37.933687] [DEBUG] [LOCAL ] EIG: Primary data saved (20226 records). [2025-09-17T03:28:37.933846] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-17T03:28:37.933952] [INFO ] [MAIN ] Update Progress: 717/2369 symbols completed. EIG took 52.1s. Estimated remaining: 4h 0m 49s. Rate: 6.9 symbols/min [2025-09-17T03:28:38.290171] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-17T03:28:39.090150] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-17T03:28:39.672589] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-17T03:28:39.767154] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T03:28:39.890102] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-17T03:28:40.690203] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-17T03:28:40.877052] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T03:28:41.490196] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-17T03:28:41.951911] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T03:28:42.290134] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-17T03:28:42.771320] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T03:28:43.090170] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-17T03:28:43.108747] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T03:28:43.115624] [INFO ] [REMOTE ] ELAN: Full fetch complete (76679 records). [2025-09-17T03:28:43.115825] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-17T03:28:43.538433] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-17T03:28:43.538564] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-17T03:28:43.539429] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-17T03:28:43.539507] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-17T03:28:43.541024] [DEBUG] [LOCAL ] ELAN: Trimmed 76679 records to 53179 (keeping 200 days of data) [2025-09-17T03:28:43.859518] [DEBUG] [LOCAL ] ELAN: Primary data saved (53179 records). [2025-09-17T03:28:43.859760] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-17T03:28:43.859887] [INFO ] [MAIN ] Update Progress: 718/2369 symbols completed. ELAN took 30.0s. Estimated remaining: 4h 0m 34s. Rate: 6.9 symbols/min [2025-09-17T03:28:43.921913] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T03:28:43.933321] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-17T03:28:44.851730] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:28:44.863520] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-17T03:28:45.191388] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T03:28:45.198041] [INFO ] [REMOTE ] EIX: Full fetch complete (76738 records). [2025-09-17T03:28:45.198205] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-17T03:28:45.587998] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-17T03:28:45.588115] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-17T03:28:45.589035] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-17T03:28:45.589113] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-17T03:28:45.590601] [DEBUG] [LOCAL ] EIX: Trimmed 76738 records to 53361 (keeping 200 days of data) [2025-09-17T03:28:45.913965] [DEBUG] [LOCAL ] EIX: Primary data saved (53361 records). [2025-09-17T03:28:45.914145] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-17T03:28:45.914266] [INFO ] [MAIN ] Update Progress: 719/2369 symbols completed. EIX took 39.9s. Estimated remaining: 4h 0m 10s. Rate: 6.9 symbols/min [2025-09-17T03:28:46.794338] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T03:28:46.800823] [INFO ] [REMOTE ] EL: Full fetch complete (77329 records). [2025-09-17T03:28:46.800991] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-17T03:28:47.192846] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-17T03:28:47.192963] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-17T03:28:47.193858] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-17T03:28:47.193937] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-17T03:28:47.195498] [DEBUG] [LOCAL ] EL: Trimmed 77329 records to 53472 (keeping 200 days of data) [2025-09-17T03:28:47.533397] [DEBUG] [LOCAL ] EL: Primary data saved (53472 records). [2025-09-17T03:28:47.533668] [INFO ] [MAIN ] EL: Full history saved. [2025-09-17T03:28:47.533775] [INFO ] [MAIN ] Update Progress: 720/2369 symbols completed. EL took 34.6s. Estimated remaining: 3h 59m 45s. Rate: 6.9 symbols/min [2025-09-17T03:28:48.054451] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:48.136938] [DEBUG] [LOCAL ] ELP: No existing data file found in primary storage. [2025-09-17T03:28:48.173900] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:48.190813] [WARN ] [MAIN ] ELP: No existing data found, performing full refresh instead. [2025-09-17T03:28:48.199821] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-17T03:28:48.225673] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:48.246254] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-17T03:28:48.249145] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:28:48.250030] [DEBUG] [LOCAL ] ELP: No primary data file found to delete. [2025-09-17T03:28:48.250184] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-17T03:28:48.329298] [DEBUG] [LOCAL ] ELC: Loaded 2672 existing records from primary storage. [2025-09-17T03:28:48.362313] [INFO ] [MAIN ] ELC: Loaded 2672 existing records. [2025-09-17T03:28:48.618001] [DEBUG] [LOCAL ] ELME: Loaded 29238 existing records from primary storage. [2025-09-17T03:28:48.688273] [INFO ] [MAIN ] ELME: Loaded 29238 existing records. [2025-09-17T03:28:48.740505] [DEBUG] [LOCAL ] ELF: Loaded 38878 existing records from primary storage. [2025-09-17T03:28:48.813629] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:48.810719] [INFO ] [MAIN ] ELF: Loaded 38878 existing records. [2025-09-17T03:28:48.913248] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-17T03:28:49.020910] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:49.018043] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-17T03:28:49.063687] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-11. [2025-09-17T03:28:49.087090] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-17T03:28:49.145500] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-17T03:28:49.201275] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:49.310148] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:28:49.333775] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-17T03:28:49.337786] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-17T03:28:49.337991] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-17T03:28:49.338141] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-17T03:28:49.354030] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-17T03:28:49.389379] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-17T03:28:49.359162] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-17T03:28:49.439940] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-17T03:28:50.038989] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:50.095993] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-11. [2025-09-17T03:28:50.294539] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:50.341016] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-11. [2025-09-17T03:28:50.346334] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:28:50.346718] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-11. [2025-09-17T03:28:50.534898] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T03:28:50.540573] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-17T03:28:50.738488] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T03:28:50.739916] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-17T03:28:51.333958] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T03:28:51.335755] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-17T03:28:51.748588] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T03:28:51.756151] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-17T03:28:51.809007] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T03:28:51.809454] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T03:28:51.890078] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-17T03:28:52.359019] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-17T03:28:52.690093] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-17T03:28:52.854158] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T03:28:53.090946] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T03:28:53.285840] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T03:28:53.490124] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-17T03:28:54.290226] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-17T03:28:54.623503] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T03:28:55.090198] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-17T03:28:55.890223] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-17T03:28:56.226131] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T03:28:56.285867] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T03:28:56.468202] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T03:28:56.690103] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-17T03:28:57.490131] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-17T03:28:58.196021] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T03:28:58.198229] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T03:28:58.290126] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-17T03:28:59.090159] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-17T03:28:59.660733] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T03:28:59.872630] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T03:28:59.890084] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-17T03:29:00.460672] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T03:29:00.690126] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-17T03:29:01.141834] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T03:29:01.490140] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-17T03:29:02.290125] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-17T03:29:03.090094] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-17T03:29:03.517745] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T03:29:03.569850] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T03:29:03.659151] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T03:29:03.890137] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-17T03:29:04.238540] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T03:29:04.239781] [INFO ] [REMOTE ] ELC: Full fetch complete (5217 records). [2025-09-17T03:29:04.239886] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-17T03:29:04.613633] [DEBUG] [VALIDATOR ] ELC: All expected trading days are present. [2025-09-17T03:29:04.613774] [DEBUG] [VALIDATOR ] ELC: Primary data validation passed. [2025-09-17T03:29:04.614042] [INFO ] [MAIN ] ELC: Fetched primary data is valid. [2025-09-17T03:29:04.614127] [DEBUG] [LOCAL ] ELC: Saving primary data. [2025-09-17T03:29:04.614609] [DEBUG] [LOCAL ] ELC: Trimmed 5217 records to 3552 (keeping 200 days of data) [2025-09-17T03:29:04.638548] [DEBUG] [LOCAL ] ELC: Primary data saved (3552 records). [2025-09-17T03:29:04.638695] [INFO ] [MAIN ] ELC: Full history saved. [2025-09-17T03:29:04.638814] [INFO ] [MAIN ] Update Progress: 721/2369 symbols completed. ELC took 17.1s. Estimated remaining: 3h 59m 55s. Rate: 6.9 symbols/min [2025-09-17T03:29:04.700484] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-17T03:29:04.811021] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:04.811229] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-17T03:29:04.811281] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-17T03:29:04.811461] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-17T03:29:04.811516] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-17T03:29:04.811560] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-17T03:29:04.811605] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-17T03:29:05.166704] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:05.490169] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-11. [2025-09-17T03:29:05.597627] [DEBUG] [REMOTE ] ELPC: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-17T03:29:05.598006] [WARN ] [REMOTE ] ELPC: No data returned for month 2024-11 [2025-09-17T03:29:06.295894] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-17T03:29:06.312360] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T03:29:07.090160] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-17T03:29:07.890178] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-17T03:29:08.395392] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T03:29:08.638738] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-17T03:29:08.690144] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-17T03:29:09.027257] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T03:29:09.490166] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-17T03:29:10.290130] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-17T03:29:10.755883] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T03:29:10.870594] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T03:29:11.090187] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-17T03:29:11.683948] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T03:29:11.890136] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-17T03:29:12.307118] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T03:29:12.690148] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-17T03:29:13.490188] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-17T03:29:14.032288] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T03:29:14.090138] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T03:29:14.290163] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-17T03:29:14.975622] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T03:29:15.090149] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-17T03:29:15.556622] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T03:29:15.890156] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-17T03:29:16.346093] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T03:29:16.690149] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-17T03:29:16.996897] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T03:29:17.490136] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-17T03:29:17.911221] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:29:18.290144] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-17T03:29:18.431786] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T03:29:18.434747] [INFO ] [REMOTE ] ELP: Full fetch complete (37834 records). [2025-09-17T03:29:18.434839] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-17T03:29:18.808693] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-17T03:29:18.808803] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-17T03:29:18.809323] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-17T03:29:18.809391] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-17T03:29:18.810354] [DEBUG] [LOCAL ] ELP: Trimmed 37834 records to 26074 (keeping 200 days of data) [2025-09-17T03:29:18.965216] [DEBUG] [LOCAL ] ELP: Primary data saved (26074 records). [2025-09-17T03:29:18.965385] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-17T03:29:18.965471] [INFO ] [MAIN ] Update Progress: 722/2369 symbols completed. ELP took 31.4s. Estimated remaining: 3h 59m 59s. Rate: 6.9 symbols/min [2025-09-17T03:29:19.105634] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-17T03:29:19.137469] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:19.177850] [DEBUG] [LOCAL ] ELS: Loaded 36880 existing records from primary storage. [2025-09-17T03:29:19.178043] [INFO ] [MAIN ] ELS: Loaded 36880 existing records. [2025-09-17T03:29:19.357507] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:29:19.357809] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-17T03:29:19.357886] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-17T03:29:19.358749] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-17T03:29:19.358824] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-17T03:29:19.652299] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T03:29:19.732593] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:19.890136] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-11. [2025-09-17T03:29:20.296532] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T03:29:20.690141] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-17T03:29:21.495603] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-17T03:29:21.501373] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T03:29:22.075248] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T03:29:22.080912] [INFO ] [REMOTE ] ELME: Full fetch complete (55505 records). [2025-09-17T03:29:22.081078] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-17T03:29:22.295306] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-17T03:29:22.479377] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-17T03:29:22.479500] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-17T03:29:22.480391] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-17T03:29:22.480481] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-17T03:29:22.481920] [DEBUG] [LOCAL ] ELME: Trimmed 55505 records to 39208 (keeping 200 days of data) [2025-09-17T03:29:22.741983] [DEBUG] [LOCAL ] ELME: Primary data saved (39208 records). [2025-09-17T03:29:22.742164] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-17T03:29:22.742258] [INFO ] [MAIN ] Update Progress: 723/2369 symbols completed. ELME took 35.2s. Estimated remaining: 3h 59m 39s. Rate: 6.9 symbols/min [2025-09-17T03:29:22.835886] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T03:29:22.922233] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:22.958836] [DEBUG] [LOCAL ] ELV: Loaded 37831 existing records from primary storage. [2025-09-17T03:29:22.959006] [INFO ] [MAIN ] ELV: Loaded 37831 existing records. [2025-09-17T03:29:23.099607] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-17T03:29:23.140503] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:29:23.141122] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-17T03:29:23.141316] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-17T03:29:23.142228] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-17T03:29:23.142296] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-17T03:29:23.520293] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:23.562874] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T03:29:23.890195] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-17T03:29:24.690185] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-17T03:29:24.858596] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T03:29:25.038521] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T03:29:25.490149] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-11. [2025-09-17T03:29:26.063911] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-17T03:29:26.290151] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-17T03:29:26.660892] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T03:29:27.090238] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-17T03:29:27.147964] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T03:29:27.464804] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-17T03:29:27.890150] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-17T03:29:28.690144] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-17T03:29:29.490206] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-17T03:29:29.747863] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T03:29:29.839277] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:29:30.290211] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-17T03:29:30.341182] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T03:29:31.090171] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-17T03:29:31.890177] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-17T03:29:32.122760] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T03:29:32.130532] [INFO ] [REMOTE ] ELF: Full fetch complete (75261 records). [2025-09-17T03:29:32.130886] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-17T03:29:32.289778] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T03:29:32.544856] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-17T03:29:32.545067] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-17T03:29:32.546042] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-17T03:29:32.546196] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-17T03:29:32.585714] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T03:29:32.585998] [DEBUG] [LOCAL ] ELF: Trimmed 75261 records to 52338 (keeping 200 days of data) [2025-09-17T03:29:32.715819] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-17T03:29:32.934499] [DEBUG] [LOCAL ] ELF: Primary data saved (52338 records). [2025-09-17T03:29:32.934723] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-17T03:29:32.934828] [INFO ] [MAIN ] Update Progress: 724/2369 symbols completed. ELF took 45.4s. Estimated remaining: 3h 59m 34s. Rate: 6.9 symbols/min [2025-09-17T03:29:33.110741] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:33.110978] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-17T03:29:33.111034] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-17T03:29:33.111149] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-17T03:29:33.111196] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-17T03:29:33.111249] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-17T03:29:33.111291] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-17T03:29:33.476727] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:33.490107] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-11. [2025-09-17T03:29:33.708683] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:33.709045] [WARN ] [REMOTE ] EMA: No data returned for month 2024-11 [2025-09-17T03:29:34.290179] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-17T03:29:34.568104] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-17T03:29:34.574581] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T03:29:35.090182] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-17T03:29:35.890158] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-17T03:29:36.154196] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-17T03:29:36.155074] [INFO ] [REMOTE ] ELPC: Full fetch complete (1490 records). [2025-09-17T03:29:36.155170] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-17T03:29:36.155614] [FATAL] [VALIDATOR ] ELPC: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T03:29:36.155731] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:29:36.155804] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:29:36.155870] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-17T03:29:36.155968] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-17T03:29:36.156035] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-17T03:29:36.156136] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-17T03:29:36.156227] [INFO ] [MAIN ] Update Progress: 725/2369 symbols completed. ELPC took 31.5s. Estimated remaining: 3h 59m 12s. Rate: 6.9 symbols/min [2025-09-17T03:29:36.332186] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:36.349039] [DEBUG] [LOCAL ] EMD: Loaded 15174 existing records from primary storage. [2025-09-17T03:29:36.349228] [INFO ] [MAIN ] EMD: Loaded 15174 existing records. [2025-09-17T03:29:36.544608] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:29:36.544900] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-17T03:29:36.544958] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-17T03:29:36.545446] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-17T03:29:36.545524] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-17T03:29:36.695348] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-17T03:29:36.918198] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:36.997937] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T03:29:37.010766] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:37.012515] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-17T03:29:37.490193] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-11. [2025-09-17T03:29:38.290139] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-17T03:29:38.705811] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T03:29:39.090151] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-17T03:29:39.890148] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-17T03:29:40.154717] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T03:29:40.216664] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T03:29:40.690136] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-17T03:29:40.913452] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:40.913822] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-17T03:29:41.290452] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T03:29:41.490189] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-17T03:29:41.698574] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:41.698984] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-17T03:29:42.290201] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-17T03:29:42.502630] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:42.503002] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-17T03:29:43.090157] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-17T03:29:43.890110] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-17T03:29:44.099065] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:29:44.099399] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-17T03:29:44.188743] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:29:44.690135] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-17T03:29:45.490137] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-17T03:29:46.290141] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-17T03:29:46.548420] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T03:29:46.776945] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T03:29:47.090155] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-17T03:29:47.890161] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-17T03:29:48.087248] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T03:29:48.690171] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-17T03:29:49.028315] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T03:29:49.029737] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:29:49.060876] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T03:29:49.490175] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-17T03:29:50.290120] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-17T03:29:50.617468] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T03:29:51.090131] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-17T03:29:51.252110] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:29:51.890169] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-17T03:29:52.690182] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-17T03:29:52.942510] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T03:29:53.490370] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-17T03:29:53.495938] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:29:53.838571] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T03:29:54.290142] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-17T03:29:54.325099] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T03:29:55.090155] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-17T03:29:55.890235] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-17T03:29:56.029034] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T03:29:56.050468] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T03:29:56.690185] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-17T03:29:57.490179] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-17T03:29:57.539276] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T03:29:57.541747] [INFO ] [REMOTE ] EMA: Full fetch complete (7287 records). [2025-09-17T03:29:57.541868] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-17T03:29:57.737613] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 77 unique days, need 200 days [2025-09-17T03:29:57.738030] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:29:57.738115] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:29:57.738346] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-17T03:29:57.738687] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-17T03:29:57.738867] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-17T03:29:57.738963] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-17T03:29:57.739162] [INFO ] [MAIN ] Update Progress: 726/2369 symbols completed. EMA took 24.8s. Estimated remaining: 3h 59m 33s. Rate: 6.9 symbols/min [2025-09-17T03:29:57.871160] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T03:29:57.952286] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:29:57.974289] [DEBUG] [LOCAL ] EME: Loaded 22441 existing records from primary storage. [2025-09-17T03:29:57.974478] [INFO ] [MAIN ] EME: Loaded 22441 existing records. [2025-09-17T03:29:58.164355] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:29:58.164661] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-17T03:29:58.164726] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-17T03:29:58.165430] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-17T03:29:58.165490] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-17T03:29:58.306401] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-17T03:29:58.533908] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:29:58.899034] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T03:29:59.090153] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-17T03:29:59.497934] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T03:29:59.890210] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-11. [2025-09-17T03:30:00.684175] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:30:00.690146] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-17T03:30:00.691461] [INFO ] [REMOTE ] ELS: Full fetch complete (70075 records). [2025-09-17T03:30:00.691572] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-17T03:30:01.093809] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-17T03:30:01.093985] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-17T03:30:01.095601] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-17T03:30:01.095769] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-17T03:30:01.098051] [DEBUG] [LOCAL ] ELS: Trimmed 70075 records to 49335 (keeping 200 days of data) [2025-09-17T03:30:01.441913] [DEBUG] [LOCAL ] ELS: Primary data saved (49335 records). [2025-09-17T03:30:01.442126] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-17T03:30:01.442236] [INFO ] [MAIN ] Update Progress: 727/2369 symbols completed. ELS took 42.5s. Estimated remaining: 3h 59m 13s. Rate: 6.9 symbols/min [2025-09-17T03:30:01.502983] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-17T03:30:01.624815] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:01.625191] [DEBUG] [LOCAL ] EMF: No existing data file found in primary storage. [2025-09-17T03:30:01.640387] [WARN ] [MAIN ] EMF: No existing data found, performing full refresh instead. [2025-09-17T03:30:01.642740] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-17T03:30:01.643709] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:30:01.643769] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-17T03:30:01.651504] [DEBUG] [LOCAL ] EMF: No primary data file found to delete. [2025-09-17T03:30:01.651662] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-17T03:30:02.054040] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:02.071371] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T03:30:02.290173] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-17T03:30:03.090182] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-17T03:30:03.890183] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-11. [2025-09-17T03:30:05.548449] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (3.26 seconds). [2025-09-17T03:30:05.553785] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-17T03:30:05.752108] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T03:30:05.755502] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-17T03:30:06.549883] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (5.05 seconds). [2025-09-17T03:30:06.563669] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-17T03:30:06.597540] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (3.51 seconds). [2025-09-17T03:30:07.090203] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-17T03:30:07.122241] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T03:30:07.393973] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T03:30:07.397314] [INFO ] [REMOTE ] EMD: Full fetch complete (32175 records). [2025-09-17T03:30:07.397501] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-17T03:30:07.892395] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-17T03:30:07.915797] [DEBUG] [VALIDATOR ] EMD: All expected trading days are present. [2025-09-17T03:30:07.916079] [DEBUG] [VALIDATOR ] EMD: Primary data validation passed. [2025-09-17T03:30:07.916954] [INFO ] [MAIN ] EMD: Fetched primary data is valid. [2025-09-17T03:30:07.917037] [DEBUG] [LOCAL ] EMD: Saving primary data. [2025-09-17T03:30:07.918515] [DEBUG] [LOCAL ] EMD: Trimmed 32175 records to 21538 (keeping 200 days of data) [2025-09-17T03:30:08.056481] [DEBUG] [LOCAL ] EMD: Primary data saved (21538 records). [2025-09-17T03:30:08.056631] [INFO ] [MAIN ] EMD: Full history saved. [2025-09-17T03:30:08.056768] [INFO ] [MAIN ] Update Progress: 728/2369 symbols completed. EMD took 31.9s. Estimated remaining: 3h 58m 59s. Rate: 6.9 symbols/min [2025-09-17T03:30:08.224454] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:08.262338] [DEBUG] [LOCAL ] EMN: Loaded 37814 existing records from primary storage. [2025-09-17T03:30:08.262509] [INFO ] [MAIN ] EMN: Loaded 37814 existing records. [2025-09-17T03:30:08.443082] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:30:08.443418] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-17T03:30:08.443516] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-17T03:30:08.444909] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-17T03:30:08.445213] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-17T03:30:08.787294] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T03:30:08.838687] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-17T03:30:08.869190] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-17T03:30:08.873623] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:08.910160] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:30:09.430578] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:30:09.490139] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-17T03:30:09.999602] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T03:30:10.290163] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-17T03:30:10.981321] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:30:11.090141] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-17T03:30:11.890163] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-17T03:30:12.372221] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T03:30:12.690180] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-11. [2025-09-17T03:30:12.947615] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T03:30:12.954890] [INFO ] [REMOTE ] ELV: Full fetch complete (73052 records). [2025-09-17T03:30:12.955094] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-17T03:30:13.357597] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-17T03:30:13.357736] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-17T03:30:13.358533] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-17T03:30:13.358620] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-17T03:30:13.360436] [DEBUG] [LOCAL ] ELV: Trimmed 73052 records to 50445 (keeping 200 days of data) [2025-09-17T03:30:13.492741] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-17T03:30:13.700118] [DEBUG] [LOCAL ] ELV: Primary data saved (50445 records). [2025-09-17T03:30:13.700291] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-17T03:30:13.700408] [INFO ] [MAIN ] Update Progress: 729/2369 symbols completed. ELV took 51.0s. Estimated remaining: 3h 58m 43s. Rate: 6.9 symbols/min [2025-09-17T03:30:13.869431] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:13.882164] [DEBUG] [LOCAL ] EMO: Loaded 9509 existing records from primary storage. [2025-09-17T03:30:13.882338] [INFO ] [MAIN ] EMO: Loaded 9509 existing records. [2025-09-17T03:30:14.068826] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:30:14.069089] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-17T03:30:14.069159] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-17T03:30:14.069589] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-17T03:30:14.069686] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-17T03:30:14.180402] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T03:30:14.295266] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-17T03:30:14.449764] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:14.479910] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T03:30:15.040776] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T03:30:15.090117] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-17T03:30:15.629442] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T03:30:15.890153] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-17T03:30:16.360696] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T03:30:16.361677] [INFO ] [REMOTE ] EMF: Full fetch complete (7394 records). [2025-09-17T03:30:16.361762] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-17T03:30:16.693311] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-11. [2025-09-17T03:30:16.730224] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-17T03:30:16.730319] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-17T03:30:16.730669] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-17T03:30:16.730767] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-17T03:30:16.731262] [DEBUG] [LOCAL ] EMF: Trimmed 7394 records to 3675 (keeping 200 days of data) [2025-09-17T03:30:16.755168] [DEBUG] [LOCAL ] EMF: Primary data saved (3675 records). [2025-09-17T03:30:16.755278] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-17T03:30:16.755356] [INFO ] [MAIN ] Update Progress: 730/2369 symbols completed. EMF took 15.3s. Estimated remaining: 3h 58m 22s. Rate: 6.9 symbols/min [2025-09-17T03:30:16.928568] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:16.933359] [DEBUG] [LOCAL ] EMP: Loaded 2224 existing records from primary storage. [2025-09-17T03:30:16.933464] [INFO ] [MAIN ] EMP: Loaded 2224 existing records. [2025-09-17T03:30:17.112015] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:30:17.112290] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-17T03:30:17.112350] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-17T03:30:17.112526] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-17T03:30:17.112584] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-17T03:30:17.487262] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:17.490075] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-11. [2025-09-17T03:30:18.031949] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T03:30:18.290148] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-17T03:30:18.603896] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T03:30:19.090153] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-17T03:30:19.844060] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T03:30:19.843765] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T03:30:19.890119] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-17T03:30:20.690134] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-17T03:30:20.701717] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T03:30:21.287557] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T03:30:21.490131] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-17T03:30:21.986258] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T03:30:22.290133] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-17T03:30:23.090142] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-17T03:30:23.097753] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T03:30:23.890129] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-17T03:30:24.441340] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T03:30:24.690104] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-17T03:30:24.751573] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:30:25.490144] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-17T03:30:26.290123] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-17T03:30:26.324959] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:30:27.018292] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T03:30:27.090106] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-17T03:30:27.227368] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T03:30:27.890134] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-17T03:30:27.986447] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T03:30:28.690133] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-17T03:30:29.490132] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-17T03:30:29.513220] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T03:30:29.554279] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T03:30:30.290145] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-17T03:30:31.090143] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-17T03:30:31.339320] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T03:30:31.890172] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-17T03:30:31.914722] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T03:30:32.010203] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T03:30:32.690186] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-17T03:30:33.243764] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T03:30:33.419352] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T03:30:33.490096] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-17T03:30:34.290142] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-17T03:30:35.090117] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-17T03:30:35.390798] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T03:30:35.750196] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T03:30:35.750338] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T03:30:35.890109] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-17T03:30:36.484321] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:30:36.690190] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-17T03:30:37.490137] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-17T03:30:38.055536] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T03:30:38.290139] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-17T03:30:38.514238] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:30:38.890033] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:30:39.090178] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-17T03:30:39.890201] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-17T03:30:40.581228] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T03:30:40.690166] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-17T03:30:40.938013] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T03:30:41.490150] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-17T03:30:42.290107] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-17T03:30:42.364331] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T03:30:42.741232] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T03:30:42.752959] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T03:30:43.090168] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-17T03:30:43.890192] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-17T03:30:44.303535] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:30:44.309083] [INFO ] [REMOTE ] EME: Full fetch complete (46557 records). [2025-09-17T03:30:44.309278] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-17T03:30:44.694280] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-17T03:30:44.709239] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-17T03:30:44.710139] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-17T03:30:44.710966] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-17T03:30:44.711145] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-17T03:30:44.712498] [DEBUG] [LOCAL ] EME: Trimmed 46557 records to 31886 (keeping 200 days of data) [2025-09-17T03:30:44.823081] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T03:30:44.933704] [DEBUG] [LOCAL ] EME: Primary data saved (31886 records). [2025-09-17T03:30:44.933876] [INFO ] [MAIN ] EME: Full history saved. [2025-09-17T03:30:44.934000] [INFO ] [MAIN ] Update Progress: 731/2369 symbols completed. EME took 47.2s. Estimated remaining: 3h 58m 57s. Rate: 6.9 symbols/min [2025-09-17T03:30:45.105034] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:45.105231] [DEBUG] [LOCAL ] EMR: No existing data file found in primary storage. [2025-09-17T03:30:45.105276] [WARN ] [MAIN ] EMR: No existing data found, performing full refresh instead. [2025-09-17T03:30:45.105382] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-17T03:30:45.105443] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-17T03:30:45.105491] [DEBUG] [LOCAL ] EMR: No primary data file found to delete. [2025-09-17T03:30:45.105531] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-17T03:30:45.462838] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:45.490095] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-11. [2025-09-17T03:30:46.290119] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-17T03:30:46.710214] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T03:30:46.785792] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T03:30:46.786872] [INFO ] [REMOTE ] EMP: Full fetch complete (4277 records). [2025-09-17T03:30:46.786961] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-17T03:30:47.095202] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-17T03:30:47.164849] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-17T03:30:47.165130] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-17T03:30:47.165290] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-17T03:30:47.165465] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-17T03:30:47.165974] [DEBUG] [LOCAL ] EMP: Trimmed 4277 records to 2984 (keeping 200 days of data) [2025-09-17T03:30:47.185976] [DEBUG] [LOCAL ] EMP: Primary data saved (2984 records). [2025-09-17T03:30:47.186097] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-17T03:30:47.186209] [INFO ] [MAIN ] Update Progress: 732/2369 symbols completed. EMP took 30.4s. Estimated remaining: 3h 58m 33s. Rate: 6.9 symbols/min [2025-09-17T03:30:47.364930] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:47.396895] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T03:30:47.451162] [DEBUG] [LOCAL ] ENB: Loaded 39899 existing records from primary storage. [2025-09-17T03:30:47.451336] [INFO ] [MAIN ] ENB: Loaded 39899 existing records. [2025-09-17T03:30:47.644176] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:30:47.644452] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-17T03:30:47.644510] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-17T03:30:47.645504] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-17T03:30:47.645565] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-17T03:30:47.895269] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-17T03:30:48.012024] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:48.019272] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T03:30:48.022212] [INFO ] [REMOTE ] EMO: Full fetch complete (17163 records). [2025-09-17T03:30:48.022299] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-17T03:30:48.398702] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-17T03:30:48.398811] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-17T03:30:48.399268] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-17T03:30:48.399324] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-17T03:30:48.399977] [DEBUG] [LOCAL ] EMO: Trimmed 17163 records to 12202 (keeping 200 days of data) [2025-09-17T03:30:48.477008] [DEBUG] [LOCAL ] EMO: Primary data saved (12202 records). [2025-09-17T03:30:48.477160] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-17T03:30:48.477252] [INFO ] [MAIN ] Update Progress: 733/2369 symbols completed. EMO took 34.8s. Estimated remaining: 3h 58m 8s. Rate: 6.9 symbols/min [2025-09-17T03:30:48.648854] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:48.649041] [DEBUG] [LOCAL ] ENFY: No existing data file found in primary storage. [2025-09-17T03:30:48.649082] [WARN ] [MAIN ] ENFY: No existing data found, performing full refresh instead. [2025-09-17T03:30:48.649187] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-17T03:30:48.649240] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-17T03:30:48.649285] [DEBUG] [LOCAL ] ENFY: No primary data file found to delete. [2025-09-17T03:30:48.649328] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-17T03:30:48.695198] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-17T03:30:49.014274] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:49.490119] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-11. [2025-09-17T03:30:49.746405] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T03:30:50.290136] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-11. [2025-09-17T03:30:50.579503] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-11 (0.29 seconds). [2025-09-17T03:30:50.609556] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T03:30:51.090130] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-17T03:30:51.475317] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T03:30:51.782064] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T03:30:51.890194] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-17T03:30:52.691736] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-17T03:30:52.693610] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T03:30:53.490131] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-17T03:30:54.290197] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-17T03:30:54.589022] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T03:30:55.090159] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-17T03:30:55.433813] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T03:30:55.895190] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-17T03:30:55.905993] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T03:30:55.912840] [INFO ] [REMOTE ] EMN: Full fetch complete (71662 records). [2025-09-17T03:30:55.913039] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-17T03:30:56.301791] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-17T03:30:56.301922] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-17T03:30:56.302770] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-17T03:30:56.302846] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-17T03:30:56.304812] [DEBUG] [LOCAL ] EMN: Trimmed 71662 records to 50214 (keeping 200 days of data) [2025-09-17T03:30:56.623097] [DEBUG] [LOCAL ] EMN: Primary data saved (50214 records). [2025-09-17T03:30:56.623265] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-17T03:30:56.623364] [INFO ] [MAIN ] Update Progress: 734/2369 symbols completed. EMN took 48.6s. Estimated remaining: 3h 57m 58s. Rate: 6.9 symbols/min [2025-09-17T03:30:56.698068] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-17T03:30:56.807861] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:30:56.808133] [DEBUG] [LOCAL ] ENIC: No existing data file found in primary storage. [2025-09-17T03:30:56.808275] [WARN ] [MAIN ] ENIC: No existing data found, performing full refresh instead. [2025-09-17T03:30:56.808513] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-17T03:30:56.808860] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-17T03:30:56.809031] [DEBUG] [LOCAL ] ENIC: No primary data file found to delete. [2025-09-17T03:30:56.809165] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-17T03:30:57.220751] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:30:57.223125] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T03:30:57.344986] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T03:30:57.490145] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-17T03:30:57.661951] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T03:30:58.290173] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-17T03:30:59.090215] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-11. [2025-09-17T03:30:59.413943] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T03:30:59.839881] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T03:30:59.890175] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-17T03:31:00.223144] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T03:31:00.690142] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-17T03:31:01.296249] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:31:01.490183] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-17T03:31:02.290200] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-17T03:31:02.582512] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T03:31:02.753977] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T03:31:02.974570] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T03:31:03.090143] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-17T03:31:03.890105] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-17T03:31:04.284627] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T03:31:04.690206] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-17T03:31:05.490136] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-17T03:31:05.816303] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T03:31:06.290165] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-17T03:31:06.657120] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T03:31:07.003752] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T03:31:07.090114] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-17T03:31:07.890173] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-17T03:31:08.147328] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T03:31:08.177137] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-17T03:31:08.690178] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-17T03:31:09.000993] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T03:31:09.033464] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T03:31:09.490193] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-17T03:31:10.290159] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-17T03:31:11.090133] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-17T03:31:11.361394] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T03:31:11.685731] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T03:31:11.805929] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T03:31:11.890087] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-17T03:31:12.451051] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T03:31:12.690181] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-17T03:31:13.490180] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-17T03:31:14.092334] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:31:14.290165] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-17T03:31:14.841009] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T03:31:15.090148] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-17T03:31:15.426715] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T03:31:15.890160] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-17T03:31:16.404482] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T03:31:16.405952] [INFO ] [REMOTE ] ENFY: Full fetch complete (5734 records). [2025-09-17T03:31:16.406076] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-17T03:31:16.700238] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-17T03:31:16.788877] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-17T03:31:16.788993] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-17T03:31:16.789325] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-17T03:31:16.789448] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-17T03:31:16.790085] [DEBUG] [LOCAL ] ENFY: Trimmed 5734 records to 3056 (keeping 200 days of data) [2025-09-17T03:31:16.808302] [DEBUG] [LOCAL ] ENFY: Primary data saved (3056 records). [2025-09-17T03:31:16.808500] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-17T03:31:16.808599] [INFO ] [MAIN ] Update Progress: 735/2369 symbols completed. ENFY took 28.3s. Estimated remaining: 3h 58m 15s. Rate: 6.9 symbols/min [2025-09-17T03:31:16.985551] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:16.985992] [DEBUG] [LOCAL ] ENO: No existing data file found in primary storage. [2025-09-17T03:31:16.986100] [WARN ] [MAIN ] ENO: No existing data found, performing full refresh instead. [2025-09-17T03:31:16.986303] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-17T03:31:16.986374] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-17T03:31:16.986500] [DEBUG] [LOCAL ] ENO: No primary data file found to delete. [2025-09-17T03:31:16.986792] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-17T03:31:17.085603] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T03:31:17.390098] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:17.490128] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-17T03:31:18.290133] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-17T03:31:18.589241] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T03:31:19.067463] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T03:31:19.075609] [INFO ] [REMOTE ] EMR: Full fetch complete (76936 records). [2025-09-17T03:31:19.075805] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-17T03:31:19.097279] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-17T03:31:19.472939] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-17T03:31:19.473042] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-17T03:31:19.473894] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-17T03:31:19.473950] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-17T03:31:19.475453] [DEBUG] [LOCAL ] EMR: Trimmed 76936 records to 53256 (keeping 200 days of data) [2025-09-17T03:31:19.825259] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T03:31:19.845312] [DEBUG] [LOCAL ] EMR: Primary data saved (53256 records). [2025-09-17T03:31:19.845449] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-17T03:31:19.845524] [INFO ] [MAIN ] Update Progress: 736/2369 symbols completed. EMR took 34.9s. Estimated remaining: 3h 57m 53s. Rate: 6.9 symbols/min [2025-09-17T03:31:19.900247] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-11. [2025-09-17T03:31:20.020755] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:20.020961] [DEBUG] [LOCAL ] ENOV: No existing data file found in primary storage. [2025-09-17T03:31:20.021006] [WARN ] [MAIN ] ENOV: No existing data found, performing full refresh instead. [2025-09-17T03:31:20.021126] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-17T03:31:20.021177] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-17T03:31:20.021228] [DEBUG] [LOCAL ] ENOV: No primary data file found to delete. [2025-09-17T03:31:20.021275] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-17T03:31:20.384692] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:20.417161] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T03:31:20.690109] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-17T03:31:20.743473] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T03:31:21.490126] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-17T03:31:22.029868] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T03:31:22.171948] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T03:31:22.290132] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-11. [2025-09-17T03:31:23.090130] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-17T03:31:23.688202] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T03:31:23.890137] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-17T03:31:24.461987] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T03:31:24.587813] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T03:31:24.690142] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-17T03:31:25.490121] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-17T03:31:25.938203] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T03:31:25.942559] [INFO ] [REMOTE ] ENIC: Full fetch complete (51132 records). [2025-09-17T03:31:25.942693] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-17T03:31:26.047571] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T03:31:26.292723] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-17T03:31:26.328396] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-17T03:31:26.328494] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-17T03:31:26.329184] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-17T03:31:26.329267] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-17T03:31:26.330371] [DEBUG] [LOCAL ] ENIC: Trimmed 51132 records to 36932 (keeping 200 days of data) [2025-09-17T03:31:26.538522] [DEBUG] [LOCAL ] ENIC: Primary data saved (36932 records). [2025-09-17T03:31:26.538704] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-17T03:31:26.538796] [INFO ] [MAIN ] Update Progress: 737/2369 symbols completed. ENIC took 29.9s. Estimated remaining: 3h 57m 40s. Rate: 6.9 symbols/min [2025-09-17T03:31:26.732853] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:26.733074] [DEBUG] [LOCAL ] ENR: No existing data file found in primary storage. [2025-09-17T03:31:26.733119] [WARN ] [MAIN ] ENR: No existing data found, performing full refresh instead. [2025-09-17T03:31:26.733233] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-17T03:31:26.733309] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-17T03:31:26.733362] [DEBUG] [LOCAL ] ENR: No primary data file found to delete. [2025-09-17T03:31:26.733403] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-17T03:31:26.841440] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T03:31:27.095230] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-17T03:31:27.100144] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:27.672694] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T03:31:27.890127] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-17T03:31:28.690201] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-17T03:31:29.145156] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T03:31:29.319763] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T03:31:29.490123] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-17T03:31:30.290131] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-11. [2025-09-17T03:31:31.074299] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T03:31:31.090074] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-17T03:31:31.726454] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:31:31.890100] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-17T03:31:32.615577] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T03:31:32.690140] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-17T03:31:33.490148] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-17T03:31:33.791602] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T03:31:34.019037] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T03:31:34.290202] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-17T03:31:34.746999] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T03:31:35.090146] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-17T03:31:35.627448] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T03:31:35.890145] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-17T03:31:36.690152] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-17T03:31:36.736137] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T03:31:37.142826] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T03:31:37.490140] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-17T03:31:37.673283] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T03:31:37.679955] [INFO ] [REMOTE ] ENB: Full fetch complete (77356 records). [2025-09-17T03:31:37.680109] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-17T03:31:37.982662] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T03:31:38.082323] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-17T03:31:38.082438] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-17T03:31:38.083370] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-17T03:31:38.083445] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-17T03:31:38.085061] [DEBUG] [LOCAL ] ENB: Trimmed 77356 records to 53528 (keeping 200 days of data) [2025-09-17T03:31:38.290223] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-17T03:31:38.438527] [DEBUG] [LOCAL ] ENB: Primary data saved (53528 records). [2025-09-17T03:31:38.438710] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-17T03:31:38.438810] [INFO ] [MAIN ] Update Progress: 738/2369 symbols completed. ENB took 51.3s. Estimated remaining: 3h 57m 38s. Rate: 6.9 symbols/min [2025-09-17T03:31:38.614156] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:38.614364] [DEBUG] [LOCAL ] ENS: No existing data file found in primary storage. [2025-09-17T03:31:38.614416] [WARN ] [MAIN ] ENS: No existing data found, performing full refresh instead. [2025-09-17T03:31:38.614531] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-17T03:31:38.614608] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-17T03:31:38.614689] [DEBUG] [LOCAL ] ENS: No primary data file found to delete. [2025-09-17T03:31:38.614734] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-17T03:31:39.019627] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:39.090098] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-17T03:31:39.600146] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T03:31:39.890142] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-17T03:31:40.012366] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T03:31:40.319485] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T03:31:40.320410] [INFO ] [REMOTE ] ENO: Full fetch complete (3248 records). [2025-09-17T03:31:40.320498] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-17T03:31:40.680152] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-17T03:31:40.680258] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-17T03:31:40.680383] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-17T03:31:40.680432] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-17T03:31:40.680837] [DEBUG] [LOCAL ] ENO: Trimmed 3248 records to 2001 (keeping 200 days of data) [2025-09-17T03:31:40.690331] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-11. [2025-09-17T03:31:40.698719] [DEBUG] [LOCAL ] ENO: Primary data saved (2001 records). [2025-09-17T03:31:40.698875] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-17T03:31:40.699006] [INFO ] [MAIN ] Update Progress: 739/2369 symbols completed. ENO took 23.9s. Estimated remaining: 3h 57m 15s. Rate: 6.9 symbols/min [2025-09-17T03:31:40.870244] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:40.870452] [DEBUG] [LOCAL ] ENVA: No existing data file found in primary storage. [2025-09-17T03:31:40.870523] [WARN ] [MAIN ] ENVA: No existing data found, performing full refresh instead. [2025-09-17T03:31:40.870696] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-17T03:31:40.870765] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-17T03:31:40.870842] [DEBUG] [LOCAL ] ENVA: No primary data file found to delete. [2025-09-17T03:31:40.870911] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-17T03:31:41.223842] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:41.490105] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-17T03:31:41.963897] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T03:31:42.290176] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-11. [2025-09-17T03:31:43.034950] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T03:31:43.090113] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-17T03:31:43.383085] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T03:31:43.890142] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-17T03:31:44.617972] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T03:31:44.690170] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-17T03:31:45.435526] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T03:31:45.490090] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-17T03:31:46.094417] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T03:31:46.290158] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-17T03:31:46.983859] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T03:31:47.090164] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-17T03:31:47.167884] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T03:31:47.890153] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-17T03:31:48.690146] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-17T03:31:48.752958] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T03:31:49.490121] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-17T03:31:49.524178] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:31:50.126983] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T03:31:50.290112] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-17T03:31:50.595945] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T03:31:51.090148] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-17T03:31:51.873936] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T03:31:51.890122] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-17T03:31:52.415042] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T03:31:52.690135] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-17T03:31:53.478410] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:31:53.490073] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-17T03:31:54.041464] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T03:31:54.290154] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-17T03:31:54.970772] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T03:31:54.976465] [INFO ] [REMOTE ] ENOV: Full fetch complete (62748 records). [2025-09-17T03:31:54.976613] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-17T03:31:55.095182] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-17T03:31:55.381276] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-17T03:31:55.381395] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-17T03:31:55.382201] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-17T03:31:55.382267] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-17T03:31:55.383665] [DEBUG] [LOCAL ] ENOV: Trimmed 62748 records to 45347 (keeping 200 days of data) [2025-09-17T03:31:55.492837] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T03:31:55.675634] [DEBUG] [LOCAL ] ENOV: Primary data saved (45347 records). [2025-09-17T03:31:55.675821] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-17T03:31:55.675911] [INFO ] [MAIN ] Update Progress: 740/2369 symbols completed. ENOV took 35.8s. Estimated remaining: 3h 57m 20s. Rate: 6.9 symbols/min [2025-09-17T03:31:55.845729] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:31:55.857486] [DEBUG] [LOCAL ] EOD: Loaded 10922 existing records from primary storage. [2025-09-17T03:31:55.857661] [INFO ] [MAIN ] EOD: Loaded 10922 existing records. [2025-09-17T03:31:55.900129] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-17T03:31:56.041343] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:31:56.041609] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-17T03:31:56.041690] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-17T03:31:56.042199] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-17T03:31:56.042262] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-17T03:31:56.402829] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:31:56.690151] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-11. [2025-09-17T03:31:56.974028] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T03:31:57.001000] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T03:31:57.490121] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-17T03:31:57.491031] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T03:31:58.290124] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-17T03:31:58.815456] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T03:31:58.994053] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T03:31:59.090137] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-17T03:31:59.890158] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-17T03:32:00.358520] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T03:32:00.690147] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-17T03:32:01.314024] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T03:32:01.490178] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-17T03:32:01.759366] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T03:32:02.290192] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-17T03:32:02.956008] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T03:32:02.961265] [INFO ] [REMOTE ] ENR: Full fetch complete (57740 records). [2025-09-17T03:32:02.961413] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-17T03:32:03.102123] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-17T03:32:03.355221] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-17T03:32:03.355329] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-17T03:32:03.356169] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-17T03:32:03.356235] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-17T03:32:03.357478] [DEBUG] [LOCAL ] ENR: Trimmed 57740 records to 42493 (keeping 200 days of data) [2025-09-17T03:32:03.594951] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T03:32:03.647591] [DEBUG] [LOCAL ] ENR: Primary data saved (42493 records). [2025-09-17T03:32:03.647778] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-17T03:32:03.647868] [INFO ] [MAIN ] Update Progress: 741/2369 symbols completed. ENR took 37.1s. Estimated remaining: 3h 57m 10s. Rate: 6.9 symbols/min [2025-09-17T03:32:03.819950] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:03.830679] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T03:32:03.875674] [DEBUG] [LOCAL ] EOG: Loaded 39747 existing records from primary storage. [2025-09-17T03:32:03.875865] [INFO ] [MAIN ] EOG: Loaded 39747 existing records. [2025-09-17T03:32:03.896444] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-17T03:32:04.060851] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:32:04.061122] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-17T03:32:04.061185] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-17T03:32:04.062179] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-17T03:32:04.062240] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-17T03:32:04.442926] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:04.690174] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-17T03:32:05.390486] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T03:32:05.490108] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-11. [2025-09-17T03:32:05.881095] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T03:32:06.290191] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-17T03:32:07.090147] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-17T03:32:07.119121] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T03:32:07.369145] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T03:32:07.890165] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-17T03:32:08.055764] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T03:32:08.690137] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-17T03:32:08.773005] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T03:32:09.490136] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-17T03:32:09.782778] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T03:32:10.290139] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-17T03:32:10.792294] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:32:11.090137] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-17T03:32:11.249254] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T03:32:11.890166] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-17T03:32:12.315088] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:32:12.690155] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-17T03:32:13.054598] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T03:32:13.058984] [INFO ] [REMOTE ] ENS: Full fetch complete (41437 records). [2025-09-17T03:32:13.059116] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-17T03:32:13.480665] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-17T03:32:13.480788] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-17T03:32:13.481422] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-17T03:32:13.481485] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-17T03:32:13.482577] [DEBUG] [LOCAL ] ENS: Trimmed 41437 records to 29286 (keeping 200 days of data) [2025-09-17T03:32:13.546009] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-17T03:32:13.679960] [DEBUG] [LOCAL ] ENS: Primary data saved (29286 records). [2025-09-17T03:32:13.680137] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-17T03:32:13.680227] [INFO ] [MAIN ] Update Progress: 742/2369 symbols completed. ENS took 35.2s. Estimated remaining: 3h 57m 4s. Rate: 6.9 symbols/min [2025-09-17T03:32:13.860111] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:13.869808] [DEBUG] [LOCAL ] EOI: Loaded 6949 existing records from primary storage. [2025-09-17T03:32:13.869973] [INFO ] [MAIN ] EOI: Loaded 6949 existing records. [2025-09-17T03:32:14.062729] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:32:14.063032] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-17T03:32:14.063094] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-17T03:32:14.063455] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-17T03:32:14.063526] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-17T03:32:14.313390] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-17T03:32:14.432418] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:14.675588] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T03:32:14.695836] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:32:14.699536] [INFO ] [REMOTE ] ENVA: Full fetch complete (36153 records). [2025-09-17T03:32:14.699681] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-17T03:32:15.072742] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-17T03:32:15.072877] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-17T03:32:15.073524] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-17T03:32:15.073595] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-17T03:32:15.074566] [DEBUG] [LOCAL ] ENVA: Trimmed 36153 records to 25610 (keeping 200 days of data) [2025-09-17T03:32:15.125321] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-17T03:32:15.200686] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T03:32:15.240215] [DEBUG] [LOCAL ] ENVA: Primary data saved (25610 records). [2025-09-17T03:32:15.240370] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-17T03:32:15.240469] [INFO ] [MAIN ] Update Progress: 743/2369 symbols completed. ENVA took 34.5s. Estimated remaining: 3h 56m 39s. Rate: 6.9 symbols/min [2025-09-17T03:32:15.409143] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:15.409341] [DEBUG] [LOCAL ] EOS: No existing data file found in primary storage. [2025-09-17T03:32:15.409390] [WARN ] [MAIN ] EOS: No existing data found, performing full refresh instead. [2025-09-17T03:32:15.409519] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-17T03:32:15.409571] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-17T03:32:15.409617] [DEBUG] [LOCAL ] EOS: No primary data file found to delete. [2025-09-17T03:32:15.409677] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-17T03:32:15.759753] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:15.890123] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-17T03:32:16.690116] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-11. [2025-09-17T03:32:16.850702] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:32:17.028881] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T03:32:17.361470] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T03:32:17.490131] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-17T03:32:18.290179] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-17T03:32:19.090180] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-17T03:32:19.195811] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:32:19.481213] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T03:32:19.890095] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-17T03:32:20.233806] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T03:32:20.690149] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-11. [2025-09-17T03:32:20.843980] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T03:32:21.490124] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-17T03:32:21.625668] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T03:32:22.290118] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-17T03:32:22.303537] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T03:32:22.305536] [INFO ] [REMOTE ] EOD: Full fetch complete (19687 records). [2025-09-17T03:32:22.305620] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-17T03:32:22.693272] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-17T03:32:22.693475] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-17T03:32:22.694003] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-17T03:32:22.694081] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-17T03:32:22.694779] [DEBUG] [LOCAL ] EOD: Trimmed 19687 records to 14172 (keeping 200 days of data) [2025-09-17T03:32:22.776150] [DEBUG] [LOCAL ] EOD: Primary data saved (14172 records). [2025-09-17T03:32:22.776319] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-17T03:32:22.776438] [INFO ] [MAIN ] Update Progress: 744/2369 symbols completed. EOD took 27.1s. Estimated remaining: 3h 56m 28s. Rate: 6.9 symbols/min [2025-09-17T03:32:22.944191] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:22.951079] [DEBUG] [LOCAL ] EOT: Loaded 5065 existing records from primary storage. [2025-09-17T03:32:22.951206] [INFO ] [MAIN ] EOT: Loaded 5065 existing records. [2025-09-17T03:32:23.095251] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-17T03:32:23.129498] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:32:23.130632] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-17T03:32:23.130780] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-17T03:32:23.138597] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-17T03:32:23.138937] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T03:32:23.139146] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-17T03:32:23.504027] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:23.890155] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-17T03:32:24.133529] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T03:32:24.690193] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-11. [2025-09-17T03:32:25.455255] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T03:32:25.490080] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-17T03:32:25.789409] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:32:26.290120] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-17T03:32:26.538379] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T03:32:27.090191] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-17T03:32:27.895524] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-17T03:32:27.897144] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:32:28.239031] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T03:32:28.690132] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-17T03:32:28.748012] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T03:32:29.440602] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T03:32:29.490083] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-17T03:32:30.253204] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T03:32:30.290127] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-17T03:32:31.090188] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-17T03:32:31.160884] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T03:32:31.890163] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-17T03:32:32.255694] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T03:32:32.690145] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-17T03:32:33.490109] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-17T03:32:33.798968] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T03:32:33.876267] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T03:32:34.150869] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T03:32:34.290147] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-17T03:32:35.090146] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-17T03:32:35.890175] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-17T03:32:36.082881] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:32:36.204058] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T03:32:36.667417] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T03:32:36.690072] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-17T03:32:37.105799] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T03:32:37.490150] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-17T03:32:38.132190] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T03:32:38.290166] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-17T03:32:39.038663] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T03:32:39.090154] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-17T03:32:39.617965] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T03:32:39.890191] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-17T03:32:40.535849] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T03:32:40.538130] [INFO ] [REMOTE ] EOT: Full fetch complete (10811 records). [2025-09-17T03:32:40.538272] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-17T03:32:40.696888] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-17T03:32:40.920011] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-17T03:32:40.920132] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-17T03:32:40.920546] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-17T03:32:40.920598] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-17T03:32:40.921063] [DEBUG] [LOCAL ] EOT: Trimmed 10811 records to 6764 (keeping 200 days of data) [2025-09-17T03:32:40.962933] [DEBUG] [LOCAL ] EOT: Primary data saved (6764 records). [2025-09-17T03:32:40.963081] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-17T03:32:40.963178] [INFO ] [MAIN ] Update Progress: 745/2369 symbols completed. EOT took 18.2s. Estimated remaining: 3h 56m 40s. Rate: 6.9 symbols/min [2025-09-17T03:32:41.130497] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:41.148636] [DEBUG] [LOCAL ] EPAC: Loaded 19167 existing records from primary storage. [2025-09-17T03:32:41.148809] [INFO ] [MAIN ] EPAC: Loaded 19167 existing records. [2025-09-17T03:32:41.325366] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:32:41.325616] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-17T03:32:41.325697] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-17T03:32:41.326351] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-17T03:32:41.326421] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-17T03:32:41.504524] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-17T03:32:41.708227] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:41.717594] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T03:32:42.290194] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-11. [2025-09-17T03:32:43.090110] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-17T03:32:43.586487] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T03:32:43.587654] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T03:32:43.890157] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-17T03:32:44.196281] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T03:32:44.690206] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-17T03:32:45.490231] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-17T03:32:45.713820] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T03:32:45.747939] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T03:32:46.290254] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-17T03:32:46.457117] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T03:32:47.090172] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-17T03:32:47.337143] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T03:32:47.890175] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-17T03:32:47.948848] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T03:32:48.690176] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-17T03:32:48.987342] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:32:49.490152] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-17T03:32:49.587615] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T03:32:50.029147] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T03:32:50.290131] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-17T03:32:51.084786] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T03:32:51.090082] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-17T03:32:51.890171] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-17T03:32:51.897261] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T03:32:51.899714] [INFO ] [REMOTE ] EOS: Full fetch complete (23051 records). [2025-09-17T03:32:51.899896] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-17T03:32:52.305490] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-17T03:32:52.305636] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-17T03:32:52.306193] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-17T03:32:52.306268] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-17T03:32:52.306992] [DEBUG] [LOCAL ] EOS: Trimmed 23051 records to 15587 (keeping 200 days of data) [2025-09-17T03:32:52.404669] [DEBUG] [LOCAL ] EOS: Primary data saved (15587 records). [2025-09-17T03:32:52.404832] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-17T03:32:52.404920] [INFO ] [MAIN ] Update Progress: 746/2369 symbols completed. EOS took 37.2s. Estimated remaining: 3h 56m 37s. Rate: 6.9 symbols/min [2025-09-17T03:32:52.571566] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:52.571767] [DEBUG] [LOCAL ] EPAM: No existing data file found in primary storage. [2025-09-17T03:32:52.571852] [WARN ] [MAIN ] EPAM: No existing data found, performing full refresh instead. [2025-09-17T03:32:52.571969] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-17T03:32:52.572029] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-17T03:32:52.572078] [DEBUG] [LOCAL ] EPAM: No primary data file found to delete. [2025-09-17T03:32:52.572120] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-17T03:32:52.695237] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-17T03:32:52.943492] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:53.053515] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T03:32:53.490136] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-17T03:32:53.650820] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T03:32:54.290199] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-11. [2025-09-17T03:32:54.904295] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T03:32:55.090169] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-17T03:32:55.841503] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T03:32:55.843258] [INFO ] [REMOTE ] EOI: Full fetch complete (15936 records). [2025-09-17T03:32:55.843360] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-17T03:32:55.897425] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-17T03:32:56.162441] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T03:32:56.250966] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-17T03:32:56.251072] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-17T03:32:56.251457] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-17T03:32:56.251537] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-17T03:32:56.252118] [DEBUG] [LOCAL ] EOI: Trimmed 15936 records to 10634 (keeping 200 days of data) [2025-09-17T03:32:56.319401] [DEBUG] [LOCAL ] EOI: Primary data saved (10634 records). [2025-09-17T03:32:56.319566] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-17T03:32:56.319700] [INFO ] [MAIN ] Update Progress: 747/2369 symbols completed. EOI took 42.6s. Estimated remaining: 3h 56m 18s. Rate: 6.9 symbols/min [2025-09-17T03:32:56.496327] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:56.496559] [DEBUG] [LOCAL ] EPC: No existing data file found in primary storage. [2025-09-17T03:32:56.496619] [WARN ] [MAIN ] EPC: No existing data found, performing full refresh instead. [2025-09-17T03:32:56.496823] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-17T03:32:56.496883] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-17T03:32:56.496957] [DEBUG] [LOCAL ] EPC: No primary data file found to delete. [2025-09-17T03:32:56.497026] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-17T03:32:56.697548] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-17T03:32:56.865126] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:57.490121] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-17T03:32:57.692797] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T03:32:57.700349] [INFO ] [REMOTE ] EOG: Full fetch complete (77110 records). [2025-09-17T03:32:57.700566] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-17T03:32:58.120038] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-17T03:32:58.120245] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-17T03:32:58.121607] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-17T03:32:58.121710] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-17T03:32:58.125031] [DEBUG] [LOCAL ] EOG: Trimmed 77110 records to 53343 (keeping 200 days of data) [2025-09-17T03:32:58.319527] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-11. [2025-09-17T03:32:58.386303] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T03:32:58.505893] [DEBUG] [LOCAL ] EOG: Primary data saved (53343 records). [2025-09-17T03:32:58.506062] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-17T03:32:58.507020] [INFO ] [MAIN ] Update Progress: 748/2369 symbols completed. EOG took 54.9s. Estimated remaining: 3h 55m 55s. Rate: 6.9 symbols/min [2025-09-17T03:32:58.676176] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:32:58.722756] [DEBUG] [LOCAL ] EPD: Loaded 39972 existing records from primary storage. [2025-09-17T03:32:58.722947] [INFO ] [MAIN ] EPD: Loaded 39972 existing records. [2025-09-17T03:32:58.886182] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T03:32:58.925377] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:32:58.925924] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-17T03:32:58.926267] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-17T03:32:58.927233] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-17T03:32:58.927336] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-17T03:32:59.108221] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-17T03:32:59.298378] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:32:59.691778] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T03:32:59.890164] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-17T03:33:00.329789] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T03:33:00.690138] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-17T03:33:01.313307] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T03:33:01.490135] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-17T03:33:02.290150] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-11. [2025-09-17T03:33:02.505596] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:33:03.090147] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-17T03:33:03.890135] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-17T03:33:04.884042] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (3.39 seconds). [2025-09-17T03:33:04.892070] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-17T03:33:05.291445] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-17T03:33:05.380444] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-11 (3.09 seconds). [2025-09-17T03:33:05.412244] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T03:33:05.490198] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-17T03:33:06.030854] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T03:33:06.290143] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-17T03:33:07.090184] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-17T03:33:07.273105] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T03:33:07.854343] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T03:33:07.890089] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-17T03:33:08.690160] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-17T03:33:08.826762] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T03:33:09.323249] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T03:33:09.490233] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-17T03:33:10.290169] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-17T03:33:10.456051] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:33:11.068954] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T03:33:11.090109] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-17T03:33:11.672014] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T03:33:11.890133] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-17T03:33:12.691530] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-17T03:33:12.696633] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:33:13.065711] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T03:33:13.490131] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-17T03:33:14.290171] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-17T03:33:14.410497] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:33:14.630823] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T03:33:14.634508] [INFO ] [REMOTE ] EPAC: Full fetch complete (38801 records). [2025-09-17T03:33:14.638026] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-17T03:33:15.025277] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-17T03:33:15.025400] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-17T03:33:15.026057] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-17T03:33:15.026117] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-17T03:33:15.027122] [DEBUG] [LOCAL ] EPAC: Trimmed 38801 records to 26910 (keeping 200 days of data) [2025-09-17T03:33:15.092511] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-17T03:33:15.194461] [DEBUG] [LOCAL ] EPAC: Primary data saved (26910 records). [2025-09-17T03:33:15.194669] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-17T03:33:15.194778] [INFO ] [MAIN ] Update Progress: 749/2369 symbols completed. EPAC took 34.2s. Estimated remaining: 3h 56m 3s. Rate: 6.9 symbols/min [2025-09-17T03:33:15.363961] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:15.364185] [DEBUG] [LOCAL ] EPR: No existing data file found in primary storage. [2025-09-17T03:33:15.364240] [WARN ] [MAIN ] EPR: No existing data found, performing full refresh instead. [2025-09-17T03:33:15.364349] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-17T03:33:15.364401] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-17T03:33:15.364461] [DEBUG] [LOCAL ] EPR: No primary data file found to delete. [2025-09-17T03:33:15.364506] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-17T03:33:15.727701] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:15.861417] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:33:15.890138] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-17T03:33:16.653591] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:33:16.690098] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-17T03:33:17.432022] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T03:33:17.490130] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-17T03:33:18.268316] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T03:33:18.290096] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-17T03:33:19.079226] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:33:19.084454] [INFO ] [REMOTE ] EPC: Full fetch complete (56460 records). [2025-09-17T03:33:19.084682] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-17T03:33:19.096584] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-11. [2025-09-17T03:33:19.471351] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-17T03:33:19.471456] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-17T03:33:19.472172] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-17T03:33:19.472230] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-17T03:33:19.473469] [DEBUG] [LOCAL ] EPC: Trimmed 56460 records to 39929 (keeping 200 days of data) [2025-09-17T03:33:19.735993] [DEBUG] [LOCAL ] EPC: Primary data saved (39929 records). [2025-09-17T03:33:19.736176] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-17T03:33:19.736279] [INFO ] [MAIN ] Update Progress: 750/2369 symbols completed. EPC took 23.4s. Estimated remaining: 3h 55m 46s. Rate: 6.9 symbols/min [2025-09-17T03:33:19.894991] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-17T03:33:19.912371] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:19.956697] [DEBUG] [LOCAL ] EPRT: Loaded 35910 existing records from primary storage. [2025-09-17T03:33:19.956957] [INFO ] [MAIN ] EPRT: Loaded 35910 existing records. [2025-09-17T03:33:20.136422] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:33:20.136841] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-17T03:33:20.136962] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-17T03:33:20.145256] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-17T03:33:20.158322] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-17T03:33:20.223456] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T03:33:20.527950] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:20.555583] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T03:33:20.690121] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-17T03:33:21.490146] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-11. [2025-09-17T03:33:21.541139] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T03:33:22.221519] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T03:33:22.290093] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-17T03:33:23.080160] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T03:33:23.090081] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-17T03:33:23.815800] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T03:33:23.890099] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-17T03:33:24.667664] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T03:33:24.690081] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-17T03:33:25.487838] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T03:33:25.492911] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-17T03:33:25.493920] [INFO ] [REMOTE ] EPAM: Full fetch complete (55793 records). [2025-09-17T03:33:25.494011] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-17T03:33:25.880942] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-17T03:33:25.881057] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-17T03:33:25.881902] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-17T03:33:25.881997] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-17T03:33:25.883522] [DEBUG] [LOCAL ] EPAM: Trimmed 55793 records to 39770 (keeping 200 days of data) [2025-09-17T03:33:26.013773] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:33:26.159356] [DEBUG] [LOCAL ] EPAM: Primary data saved (39770 records). [2025-09-17T03:33:26.159541] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-17T03:33:26.159668] [INFO ] [MAIN ] Update Progress: 751/2369 symbols completed. EPAM took 33.8s. Estimated remaining: 3h 55m 32s. Rate: 6.9 symbols/min [2025-09-17T03:33:26.298192] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-17T03:33:26.328359] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:26.338217] [DEBUG] [LOCAL ] EQBK: Loaded 8045 existing records from primary storage. [2025-09-17T03:33:26.338353] [INFO ] [MAIN ] EQBK: Loaded 8045 existing records. [2025-09-17T03:33:26.513189] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:33:26.513452] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-17T03:33:26.513529] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-17T03:33:26.514105] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-17T03:33:26.514174] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-17T03:33:26.865784] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:27.090117] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-17T03:33:27.376609] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T03:33:27.890129] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-17T03:33:28.060109] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T03:33:28.578991] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T03:33:28.690156] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-11. [2025-09-17T03:33:29.490113] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-17T03:33:29.504208] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T03:33:29.906700] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T03:33:30.290183] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-17T03:33:31.090099] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-17T03:33:31.201266] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T03:33:31.859805] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T03:33:31.890091] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-17T03:33:32.690139] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-17T03:33:33.152557] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T03:33:33.490159] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-17T03:33:33.602352] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T03:33:33.820714] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T03:33:34.290137] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-17T03:33:35.090113] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-17T03:33:35.139145] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T03:33:35.491897] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T03:33:35.890122] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-17T03:33:36.496609] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T03:33:36.690131] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-17T03:33:37.482188] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T03:33:37.490081] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-17T03:33:37.632653] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T03:33:37.970844] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T03:33:38.290165] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-17T03:33:39.090145] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-17T03:33:39.890131] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-17T03:33:40.224776] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T03:33:40.690173] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-17T03:33:40.783178] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T03:33:40.819771] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T03:33:41.490185] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-17T03:33:42.227125] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T03:33:42.290127] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-17T03:33:42.718701] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T03:33:43.090130] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-17T03:33:43.879326] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T03:33:43.890082] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-17T03:33:43.945087] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T03:33:44.690161] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-17T03:33:45.490144] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-17T03:33:45.516453] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T03:33:46.290176] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-17T03:33:46.517669] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T03:33:46.693074] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T03:33:47.090170] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-17T03:33:47.890171] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-17T03:33:47.972404] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T03:33:48.165677] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T03:33:48.690160] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-17T03:33:49.494578] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-17T03:33:49.499859] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T03:33:49.525938] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T03:33:49.528254] [INFO ] [REMOTE ] EQBK: Full fetch complete (15362 records). [2025-09-17T03:33:49.528380] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-17T03:33:49.903665] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-17T03:33:49.903776] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-17T03:33:49.904149] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-17T03:33:49.904203] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-17T03:33:49.904829] [DEBUG] [LOCAL ] EQBK: Trimmed 15362 records to 10852 (keeping 200 days of data) [2025-09-17T03:33:49.973891] [DEBUG] [LOCAL ] EQBK: Primary data saved (10852 records). [2025-09-17T03:33:49.974076] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-17T03:33:49.974172] [INFO ] [MAIN ] Update Progress: 752/2369 symbols completed. EQBK took 23.8s. Estimated remaining: 3h 55m 56s. Rate: 6.9 symbols/min [2025-09-17T03:33:50.150240] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:50.189569] [DEBUG] [LOCAL ] EQH: Loaded 39156 existing records from primary storage. [2025-09-17T03:33:50.189763] [INFO ] [MAIN ] EQH: Loaded 39156 existing records. [2025-09-17T03:33:50.292579] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-17T03:33:50.371022] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:33:50.371288] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-17T03:33:50.371348] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-17T03:33:50.372347] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-17T03:33:50.372411] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-17T03:33:50.725153] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:51.090176] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-11. [2025-09-17T03:33:51.263224] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T03:33:51.890195] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-17T03:33:52.065373] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T03:33:52.072177] [INFO ] [REMOTE ] EPD: Full fetch complete (77533 records). [2025-09-17T03:33:52.072392] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-17T03:33:52.495738] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-17T03:33:52.495913] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-17T03:33:52.497271] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-17T03:33:52.497506] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-17T03:33:52.509270] [DEBUG] [LOCAL ] EPD: Trimmed 77533 records to 53616 (keeping 200 days of data) [2025-09-17T03:33:52.529855] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:33:52.727591] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-17T03:33:52.879499] [DEBUG] [LOCAL ] EPD: Primary data saved (53616 records). [2025-09-17T03:33:52.879680] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-17T03:33:52.879776] [INFO ] [MAIN ] Update Progress: 753/2369 symbols completed. EPD took 54.4s. Estimated remaining: 3h 55m 34s. Rate: 6.9 symbols/min [2025-09-17T03:33:53.051278] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:53.087686] [DEBUG] [LOCAL ] EQNR: Loaded 39521 existing records from primary storage. [2025-09-17T03:33:53.087849] [INFO ] [MAIN ] EQNR: Loaded 39521 existing records. [2025-09-17T03:33:53.267741] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:33:53.267972] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-17T03:33:53.268032] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-17T03:33:53.269024] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-17T03:33:53.269098] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-17T03:33:53.511105] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-17T03:33:53.626971] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:53.695172] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T03:33:54.290237] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-11. [2025-09-17T03:33:54.447169] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T03:33:55.007276] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T03:33:55.013241] [INFO ] [REMOTE ] EPRT: Full fetch complete (68394 records). [2025-09-17T03:33:55.013368] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-17T03:33:55.095224] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-17T03:33:55.442267] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-17T03:33:55.442407] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-17T03:33:55.443290] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-17T03:33:55.443370] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-17T03:33:55.444939] [DEBUG] [LOCAL ] EPRT: Trimmed 68394 records to 48707 (keeping 200 days of data) [2025-09-17T03:33:55.757491] [DEBUG] [LOCAL ] EPRT: Primary data saved (48707 records). [2025-09-17T03:33:55.757684] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-17T03:33:55.757784] [INFO ] [MAIN ] Update Progress: 754/2369 symbols completed. EPRT took 36.0s. Estimated remaining: 3h 55m 13s. Rate: 6.9 symbols/min [2025-09-17T03:33:55.901751] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-17T03:33:55.936827] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:55.937019] [DEBUG] [LOCAL ] EQR: No existing data file found in primary storage. [2025-09-17T03:33:55.937085] [WARN ] [MAIN ] EQR: No existing data found, performing full refresh instead. [2025-09-17T03:33:55.937252] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-17T03:33:55.937331] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-17T03:33:55.937418] [DEBUG] [LOCAL ] EQR: No primary data file found to delete. [2025-09-17T03:33:55.937474] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-17T03:33:56.302435] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:56.335318] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T03:33:56.522236] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T03:33:56.528825] [INFO ] [REMOTE ] EPR: Full fetch complete (62715 records). [2025-09-17T03:33:56.529042] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-17T03:33:56.714785] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-17T03:33:57.029788] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-17T03:33:57.029956] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-17T03:33:57.031592] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-17T03:33:57.031739] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-17T03:33:57.033873] [DEBUG] [LOCAL ] EPR: Trimmed 62715 records to 44485 (keeping 200 days of data) [2025-09-17T03:33:57.447724] [DEBUG] [LOCAL ] EPR: Primary data saved (44485 records). [2025-09-17T03:33:57.447953] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-17T03:33:57.448070] [INFO ] [MAIN ] Update Progress: 755/2369 symbols completed. EPR took 42.3s. Estimated remaining: 3h 54m 49s. Rate: 6.9 symbols/min [2025-09-17T03:33:57.497112] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-11. [2025-09-17T03:33:57.668992] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:33:57.669360] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-17T03:33:57.669575] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-17T03:33:57.669856] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-17T03:33:57.669975] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-17T03:33:57.670083] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-17T03:33:57.670320] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-17T03:33:58.115016] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:33:58.117442] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-17T03:33:58.290103] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-11. [2025-09-17T03:33:58.620279] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T03:33:58.783777] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-17T03:33:59.090180] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-17T03:33:59.220169] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T03:33:59.890168] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-17T03:34:00.690156] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-17T03:34:00.895096] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:34:01.092110] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T03:34:01.235984] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T03:34:01.490134] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-17T03:34:02.290164] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-17T03:34:03.090153] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-17T03:34:03.166654] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:34:03.890152] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-17T03:34:04.095313] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T03:34:04.690169] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-17T03:34:04.957822] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T03:34:05.490163] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-17T03:34:05.636029] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T03:34:06.290142] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-17T03:34:06.475415] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T03:34:06.652492] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T03:34:07.095218] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-17T03:34:07.112590] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T03:34:07.471658] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-17T03:34:07.890208] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-17T03:34:08.690141] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-17T03:34:09.059178] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T03:34:09.490112] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-17T03:34:09.773392] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T03:34:09.819855] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-17T03:34:10.290149] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-17T03:34:10.645522] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-17T03:34:11.090193] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-17T03:34:11.511264] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T03:34:11.890136] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-17T03:34:12.361483] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T03:34:12.690140] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-17T03:34:13.490127] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-17T03:34:14.201529] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T03:34:14.290094] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-17T03:34:14.679830] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T03:34:14.808405] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T03:34:14.809699] [INFO ] [REMOTE ] EQS: Full fetch complete (2436 records). [2025-09-17T03:34:14.809822] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-17T03:34:14.991808] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-17T03:34:14.992021] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:34:14.992091] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:34:14.992158] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-17T03:34:14.992243] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-17T03:34:14.992300] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-17T03:34:14.992383] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-17T03:34:14.992481] [INFO ] [MAIN ] Update Progress: 756/2369 symbols completed. EQS took 17.5s. Estimated remaining: 3h 54m 59s. Rate: 6.9 symbols/min [2025-09-17T03:34:15.092068] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-17T03:34:15.162254] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:15.199601] [DEBUG] [LOCAL ] EQT: Loaded 40035 existing records from primary storage. [2025-09-17T03:34:15.199784] [INFO ] [MAIN ] EQT: Loaded 40035 existing records. [2025-09-17T03:34:15.376996] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:34:15.377227] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-17T03:34:15.377285] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-17T03:34:15.378394] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-17T03:34:15.378463] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-17T03:34:15.736118] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:15.890122] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-17T03:34:16.690091] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-17T03:34:17.220955] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-17T03:34:17.264094] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T03:34:17.490123] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-17T03:34:18.290132] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-17T03:34:18.530839] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T03:34:19.090139] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-17T03:34:19.474388] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T03:34:19.564112] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T03:34:19.890136] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-17T03:34:20.690140] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-17T03:34:20.809692] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:34:21.493557] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-17T03:34:21.501919] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:34:22.290166] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-17T03:34:22.479865] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:34:23.090135] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-11. [2025-09-17T03:34:23.307348] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T03:34:23.796554] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T03:34:23.890124] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-17T03:34:24.690163] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-17T03:34:24.981207] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T03:34:25.490115] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-17T03:34:25.910908] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T03:34:26.063205] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T03:34:26.290145] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-17T03:34:27.090131] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-17T03:34:27.430839] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T03:34:27.890128] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-17T03:34:27.942503] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:34:28.690167] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-17T03:34:28.820524] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T03:34:28.827028] [INFO ] [REMOTE ] EQNR: Full fetch complete (76582 records). [2025-09-17T03:34:28.827200] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-17T03:34:29.215936] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-17T03:34:29.216056] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-17T03:34:29.217024] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-17T03:34:29.217103] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-17T03:34:29.218587] [DEBUG] [LOCAL ] EQNR: Trimmed 76582 records to 53054 (keeping 200 days of data) [2025-09-17T03:34:29.503325] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-17T03:34:29.551242] [DEBUG] [LOCAL ] EQNR: Primary data saved (53054 records). [2025-09-17T03:34:29.551431] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-17T03:34:29.551563] [INFO ] [MAIN ] Update Progress: 757/2369 symbols completed. EQNR took 36.7s. Estimated remaining: 3h 55m 3s. Rate: 6.9 symbols/min [2025-09-17T03:34:29.757974] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T03:34:30.290139] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-17T03:34:30.509666] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T03:34:31.090165] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-17T03:34:31.217301] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T03:34:31.223804] [INFO ] [REMOTE ] EQH: Full fetch complete (76117 records). [2025-09-17T03:34:31.224004] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-17T03:34:31.623963] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-17T03:34:31.624078] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-17T03:34:31.624983] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-17T03:34:31.625047] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-17T03:34:31.626534] [DEBUG] [LOCAL ] EQH: Trimmed 76117 records to 52657 (keeping 200 days of data) [2025-09-17T03:34:31.963016] [DEBUG] [LOCAL ] EQH: Primary data saved (52657 records). [2025-09-17T03:34:31.963205] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-17T03:34:31.963341] [INFO ] [MAIN ] Update Progress: 758/2369 symbols completed. EQH took 42.0s. Estimated remaining: 3h 54m 41s. Rate: 6.9 symbols/min [2025-09-17T03:34:32.190513] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T03:34:32.200870] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-17T03:34:32.679889] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:34:32.686464] [INFO ] [REMOTE ] EQR: Full fetch complete (73455 records). [2025-09-17T03:34:32.686603] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-17T03:34:33.075880] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-17T03:34:33.075991] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-17T03:34:33.076846] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-17T03:34:33.076906] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-17T03:34:33.078402] [DEBUG] [LOCAL ] EQR: Trimmed 73455 records to 51365 (keeping 200 days of data) [2025-09-17T03:34:33.398466] [DEBUG] [LOCAL ] EQR: Primary data saved (51365 records). [2025-09-17T03:34:33.398676] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-17T03:34:33.398773] [INFO ] [MAIN ] Update Progress: 759/2369 symbols completed. EQR took 37.6s. Estimated remaining: 3h 54m 16s. Rate: 6.9 symbols/min [2025-09-17T03:34:33.973954] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:34:33.985324] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-17T03:34:36.021409] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T03:34:36.033231] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-17T03:34:38.118785] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T03:34:38.130242] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-17T03:34:40.155283] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T03:34:40.166271] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-17T03:34:42.316729] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-17T03:34:42.328707] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-17T03:34:44.334347] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T03:34:44.346168] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-17T03:34:46.191992] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T03:34:46.198849] [INFO ] [REMOTE ] EQT: Full fetch complete (77542 records). [2025-09-17T03:34:46.199029] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-17T03:34:46.620173] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-17T03:34:46.620291] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-17T03:34:46.621232] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-17T03:34:46.621324] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-17T03:34:46.622993] [DEBUG] [LOCAL ] EQT: Trimmed 77542 records to 53682 (keeping 200 days of data) [2025-09-17T03:34:46.964901] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-09-17T03:34:46.965116] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-17T03:34:46.965252] [INFO ] [MAIN ] Update Progress: 760/2369 symbols completed. EQT took 32.0s. Estimated remaining: 3h 54m 18s. Rate: 6.9 symbols/min [2025-09-17T03:34:47.512070] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:47.645356] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:47.668972] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:47.671014] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:47.671811] [DEBUG] [LOCAL ] EQV: No existing data file found in primary storage. [2025-09-17T03:34:47.672503] [WARN ] [MAIN ] EQV: No existing data found, performing full refresh instead. [2025-09-17T03:34:47.672884] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-17T03:34:47.672992] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-17T03:34:47.673095] [DEBUG] [LOCAL ] EQV: No primary data file found to delete. [2025-09-17T03:34:47.673152] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-17T03:34:47.950046] [DEBUG] [LOCAL ] ES: Loaded 39171 existing records from primary storage. [2025-09-17T03:34:47.983894] [INFO ] [MAIN ] ES: Loaded 39171 existing records. [2025-09-17T03:34:47.989723] [DEBUG] [LOCAL ] ERO: Loaded 30125 existing records from primary storage. [2025-09-17T03:34:47.978664] [DEBUG] [LOCAL ] ERJ: Loaded 37655 existing records from primary storage. [2025-09-17T03:34:48.010546] [INFO ] [MAIN ] ERO: Loaded 30125 existing records. [2025-09-17T03:34:48.025149] [INFO ] [MAIN ] ERJ: Loaded 37655 existing records. [2025-09-17T03:34:48.358426] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:48.431034] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-11. [2025-09-17T03:34:48.518401] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:34:48.614911] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-17T03:34:48.646163] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-17T03:34:48.690391] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-17T03:34:48.696192] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-17T03:34:48.690569] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:34:48.696129] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:34:48.729414] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-17T03:34:48.789189] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-17T03:34:48.771527] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-17T03:34:48.804437] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-17T03:34:48.808277] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-17T03:34:48.808417] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-17T03:34:48.846708] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-17T03:34:48.886252] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-17T03:34:48.938291] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T03:34:49.016630] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-17T03:34:50.040144] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T03:34:50.008810] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:50.098429] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:50.114979] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-11. [2025-09-17T03:34:50.115601] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-11. [2025-09-17T03:34:50.124788] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-17T03:34:50.252375] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:50.252834] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-11. [2025-09-17T03:34:50.957491] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T03:34:50.959829] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-17T03:34:51.569849] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T03:34:51.571512] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-17T03:34:51.606142] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T03:34:51.614963] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-17T03:34:51.695237] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T03:34:51.705799] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-17T03:34:51.876694] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T03:34:51.886713] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-17T03:34:52.235598] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T03:34:52.237198] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-17T03:34:52.755396] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T03:34:52.756808] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-17T03:34:53.127325] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T03:34:53.136075] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-17T03:34:53.260218] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T03:34:53.261852] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-17T03:34:53.391120] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T03:34:53.402663] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-17T03:34:53.526233] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T03:34:53.536331] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-17T03:34:53.893302] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T03:34:53.895814] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-17T03:34:54.373559] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T03:34:54.376419] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-17T03:34:54.585139] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T03:34:54.596583] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-17T03:34:54.797783] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-17T03:34:54.799330] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-17T03:34:55.077865] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:34:55.090886] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-17T03:34:55.105392] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-17T03:34:55.106417] [INFO ] [REMOTE ] EQV: Full fetch complete (5700 records). [2025-09-17T03:34:55.106503] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-17T03:34:55.423968] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T03:34:55.471005] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-17T03:34:55.525833] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-17T03:34:55.525946] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-17T03:34:55.526154] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-17T03:34:55.526208] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-17T03:34:55.526617] [DEBUG] [LOCAL ] EQV: Trimmed 5700 records to 2934 (keeping 200 days of data) [2025-09-17T03:34:55.545802] [DEBUG] [LOCAL ] EQV: Primary data saved (2934 records). [2025-09-17T03:34:55.545909] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-17T03:34:55.546001] [INFO ] [MAIN ] Update Progress: 761/2369 symbols completed. EQV took 8.6s. Estimated remaining: 3h 54m 9s. Rate: 6.9 symbols/min [2025-09-17T03:34:55.716127] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:34:55.716467] [DEBUG] [LOCAL ] ESAB: No existing data file found in primary storage. [2025-09-17T03:34:55.716542] [WARN ] [MAIN ] ESAB: No existing data found, performing full refresh instead. [2025-09-17T03:34:55.716764] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-17T03:34:55.716933] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-17T03:34:55.717024] [DEBUG] [LOCAL ] ESAB: No primary data file found to delete. [2025-09-17T03:34:55.717157] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-17T03:34:55.888879] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T03:34:56.008781] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-17T03:34:56.145741] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:34:56.690215] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-11. [2025-09-17T03:34:56.757247] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T03:34:57.290103] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T03:34:57.374311] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T03:34:57.490167] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-17T03:34:57.927874] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T03:34:58.290175] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-17T03:34:59.090148] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-17T03:34:59.244056] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T03:34:59.519394] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T03:34:59.890241] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-17T03:35:00.678191] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T03:35:00.690071] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-17T03:35:01.003454] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T03:35:01.490220] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-17T03:35:02.249492] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T03:35:02.290089] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-17T03:35:03.090121] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-17T03:35:03.370841] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T03:35:03.435019] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:35:03.890149] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-17T03:35:04.626331] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T03:35:04.690129] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-17T03:35:05.287813] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T03:35:05.490138] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-17T03:35:06.290140] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-17T03:35:06.400729] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T03:35:07.090135] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-17T03:35:07.291476] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T03:35:07.345786] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T03:35:07.890147] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-17T03:35:08.557473] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T03:35:08.690154] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-17T03:35:09.490101] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-17T03:35:09.591793] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T03:35:09.856215] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T03:35:10.290166] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-17T03:35:10.672627] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T03:35:10.678395] [INFO ] [REMOTE ] ERO: Full fetch complete (58732 records). [2025-09-17T03:35:10.678539] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-17T03:35:11.077433] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-17T03:35:11.077540] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-17T03:35:11.078272] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-17T03:35:11.078330] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-17T03:35:11.079892] [DEBUG] [LOCAL ] ERO: Trimmed 58732 records to 41171 (keeping 200 days of data) [2025-09-17T03:35:11.130783] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-17T03:35:11.328073] [DEBUG] [LOCAL ] ERO: Primary data saved (41171 records). [2025-09-17T03:35:11.328225] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-17T03:35:11.328318] [INFO ] [MAIN ] Update Progress: 762/2369 symbols completed. ERO took 24.4s. Estimated remaining: 3h 54m 15s. Rate: 6.9 symbols/min [2025-09-17T03:35:11.523875] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:11.541020] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T03:35:11.556104] [DEBUG] [LOCAL ] ESE: Loaded 12263 existing records from primary storage. [2025-09-17T03:35:11.556255] [INFO ] [MAIN ] ESE: Loaded 12263 existing records. [2025-09-17T03:35:11.736111] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:11.736394] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-17T03:35:11.736472] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-17T03:35:11.736952] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-17T03:35:11.737217] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-17T03:35:11.893988] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-17T03:35:12.112970] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:12.690177] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-11. [2025-09-17T03:35:13.116402] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T03:35:13.379588] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T03:35:13.490097] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-17T03:35:13.677783] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T03:35:14.290139] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-17T03:35:15.090155] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-17T03:35:15.171836] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T03:35:15.535703] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T03:35:15.890126] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-17T03:35:16.332006] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T03:35:16.690129] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-17T03:35:16.777976] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T03:35:17.490163] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-17T03:35:18.290139] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-17T03:35:18.546843] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T03:35:19.090129] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-17T03:35:19.342052] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T03:35:19.400049] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T03:35:19.890139] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-17T03:35:20.070881] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T03:35:20.690135] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-17T03:35:21.490137] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-17T03:35:21.520596] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T03:35:21.529237] [INFO ] [REMOTE ] ERJ: Full fetch complete (72136 records). [2025-09-17T03:35:21.529487] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-17T03:35:21.921961] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-17T03:35:21.922072] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-17T03:35:21.922980] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-17T03:35:21.923054] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-17T03:35:21.924790] [DEBUG] [LOCAL ] ERJ: Trimmed 72136 records to 51018 (keeping 200 days of data) [2025-09-17T03:35:22.244185] [DEBUG] [LOCAL ] ERJ: Primary data saved (51018 records). [2025-09-17T03:35:22.244457] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-17T03:35:22.244674] [INFO ] [MAIN ] Update Progress: 763/2369 symbols completed. ERJ took 35.3s. Estimated remaining: 3h 54m 11s. Rate: 6.9 symbols/min [2025-09-17T03:35:22.309434] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-17T03:35:22.425566] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:22.494047] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T03:35:22.507330] [DEBUG] [LOCAL ] ESI: Loaded 37431 existing records from primary storage. [2025-09-17T03:35:22.507741] [INFO ] [MAIN ] ESI: Loaded 37431 existing records. [2025-09-17T03:35:22.701181] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:22.701709] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-17T03:35:22.701879] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-17T03:35:22.707883] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-17T03:35:22.710826] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-17T03:35:22.717013] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:35:22.820473] [INFO ] [REMOTE ] ESAB: Full fetch complete (34689 records). [2025-09-17T03:35:22.820990] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-17T03:35:23.091943] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-17T03:35:23.371420] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:23.480958] [DEBUG] [VALIDATOR ] ESAB: All expected trading days are present. [2025-09-17T03:35:23.481109] [DEBUG] [VALIDATOR ] ESAB: Primary data validation passed. [2025-09-17T03:35:23.481778] [INFO ] [MAIN ] ESAB: Fetched primary data is valid. [2025-09-17T03:35:23.481885] [DEBUG] [LOCAL ] ESAB: Saving primary data. [2025-09-17T03:35:23.493358] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T03:35:23.498247] [DEBUG] [LOCAL ] ESAB: Trimmed 34689 records to 25485 (keeping 200 days of data) [2025-09-17T03:35:23.671767] [DEBUG] [LOCAL ] ESAB: Primary data saved (25485 records). [2025-09-17T03:35:23.671944] [INFO ] [MAIN ] ESAB: Full history saved. [2025-09-17T03:35:23.672046] [INFO ] [MAIN ] Update Progress: 764/2369 symbols completed. ESAB took 28.1s. Estimated remaining: 3h 53m 47s. Rate: 6.9 symbols/min [2025-09-17T03:35:23.843974] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:23.871943] [DEBUG] [LOCAL ] ESNT: Loaded 28016 existing records from primary storage. [2025-09-17T03:35:23.872126] [INFO ] [MAIN ] ESNT: Loaded 28016 existing records. [2025-09-17T03:35:23.902154] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-17T03:35:24.052125] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:24.052371] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-17T03:35:24.052440] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-17T03:35:24.053239] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-17T03:35:24.053311] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-17T03:35:24.419014] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:24.690108] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-11. [2025-09-17T03:35:25.002714] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T03:35:25.059579] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T03:35:25.490118] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-17T03:35:26.070684] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T03:35:26.290126] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-17T03:35:26.586479] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T03:35:27.090119] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-17T03:35:27.890132] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-17T03:35:27.975840] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T03:35:28.153984] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T03:35:28.690169] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-17T03:35:29.490134] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-17T03:35:29.629896] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T03:35:29.677918] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:35:30.290187] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-17T03:35:31.090164] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-11. [2025-09-17T03:35:31.161626] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T03:35:31.339017] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T03:35:31.890134] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-17T03:35:32.690113] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-17T03:35:32.757071] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T03:35:32.840516] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T03:35:32.843490] [INFO ] [REMOTE ] ESE: Full fetch complete (21570 records). [2025-09-17T03:35:32.843672] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-17T03:35:33.214032] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-17T03:35:33.214144] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-17T03:35:33.214629] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-17T03:35:33.214705] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-17T03:35:33.215435] [DEBUG] [LOCAL ] ESE: Trimmed 21570 records to 16547 (keeping 200 days of data) [2025-09-17T03:35:33.326067] [DEBUG] [LOCAL ] ESE: Primary data saved (16547 records). [2025-09-17T03:35:33.326251] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-17T03:35:33.326360] [INFO ] [MAIN ] Update Progress: 765/2369 symbols completed. ESE took 22.0s. Estimated remaining: 3h 53m 40s. Rate: 6.9 symbols/min [2025-09-17T03:35:33.494684] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-17T03:35:33.496242] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:33.540772] [DEBUG] [LOCAL ] ESRT: Loaded 34466 existing records from primary storage. [2025-09-17T03:35:33.540980] [INFO ] [MAIN ] ESRT: Loaded 34466 existing records. [2025-09-17T03:35:33.726021] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:33.726412] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-17T03:35:33.726558] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-17T03:35:33.727769] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-17T03:35:33.727849] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-17T03:35:34.095867] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:34.219443] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T03:35:34.226613] [INFO ] [REMOTE ] ES: Full fetch complete (75924 records). [2025-09-17T03:35:34.226862] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-17T03:35:34.295296] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-17T03:35:34.628722] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-17T03:35:34.628872] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-17T03:35:34.629927] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-17T03:35:34.630020] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-17T03:35:34.631730] [DEBUG] [LOCAL ] ES: Trimmed 75924 records to 52512 (keeping 200 days of data) [2025-09-17T03:35:34.952279] [DEBUG] [LOCAL ] ES: Primary data saved (52512 records). [2025-09-17T03:35:34.952482] [INFO ] [MAIN ] ES: Full history saved. [2025-09-17T03:35:34.952591] [INFO ] [MAIN ] Update Progress: 766/2369 symbols completed. ES took 48.0s. Estimated remaining: 3h 53m 16s. Rate: 6.9 symbols/min [2025-09-17T03:35:35.125763] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:35.094933] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-11. [2025-09-17T03:35:35.150230] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:35:35.174291] [DEBUG] [LOCAL ] ESS: Loaded 22109 existing records from primary storage. [2025-09-17T03:35:35.174443] [INFO ] [MAIN ] ESS: Loaded 22109 existing records. [2025-09-17T03:35:35.352880] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:35.353173] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-17T03:35:35.353232] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-17T03:35:35.354069] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-17T03:35:35.354150] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-17T03:35:35.708002] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:35.890262] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-17T03:35:35.895732] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T03:35:36.641436] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T03:35:36.690099] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-17T03:35:37.443843] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T03:35:37.490083] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-17T03:35:38.290276] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-11. [2025-09-17T03:35:38.296089] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T03:35:39.025554] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T03:35:39.090104] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-17T03:35:39.564946] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T03:35:39.890136] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-17T03:35:40.609045] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T03:35:40.690129] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-17T03:35:41.426677] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T03:35:41.490091] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-17T03:35:42.175871] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T03:35:42.290192] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-17T03:35:43.085373] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T03:35:43.094848] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-17T03:35:43.746258] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T03:35:43.890138] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-17T03:35:44.490635] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T03:35:44.690153] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-17T03:35:45.490175] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-17T03:35:45.604255] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T03:35:46.178908] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T03:35:46.290089] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-17T03:35:46.804878] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T03:35:47.090152] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-17T03:35:47.697414] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T03:35:47.890143] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-17T03:35:48.690158] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-17T03:35:48.859144] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:35:49.498319] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-17T03:35:49.503709] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T03:35:50.259312] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:35:50.290081] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-17T03:35:50.990959] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T03:35:51.090167] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-17T03:35:51.405104] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T03:35:51.890232] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-17T03:35:52.690155] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-17T03:35:52.768340] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T03:35:53.490143] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-17T03:35:53.530620] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T03:35:54.064126] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T03:35:54.290102] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-17T03:35:54.709162] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T03:35:54.715756] [INFO ] [REMOTE ] ESNT: Full fetch complete (57107 records). [2025-09-17T03:35:54.715924] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-17T03:35:55.101956] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-17T03:35:55.121256] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-17T03:35:55.121366] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-17T03:35:55.122109] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-17T03:35:55.122272] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-17T03:35:55.123426] [DEBUG] [LOCAL ] ESNT: Trimmed 57107 records to 38806 (keeping 200 days of data) [2025-09-17T03:35:55.367583] [DEBUG] [LOCAL ] ESNT: Primary data saved (38806 records). [2025-09-17T03:35:55.367773] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-17T03:35:55.367868] [INFO ] [MAIN ] Update Progress: 767/2369 symbols completed. ESNT took 31.7s. Estimated remaining: 3h 53m 32s. Rate: 6.9 symbols/min [2025-09-17T03:35:55.542317] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:35:55.577054] [DEBUG] [LOCAL ] ESTC: Loaded 37574 existing records from primary storage. [2025-09-17T03:35:55.577376] [INFO ] [MAIN ] ESTC: Loaded 37574 existing records. [2025-09-17T03:35:55.759988] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:35:55.760448] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-17T03:35:55.760519] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-17T03:35:55.771331] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-17T03:35:55.786261] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-17T03:35:55.861987] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T03:35:55.893797] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-17T03:35:56.162689] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:35:56.690129] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-17T03:35:56.850473] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T03:35:57.352160] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T03:35:57.490106] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-17T03:35:58.180165] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T03:35:58.290166] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-17T03:35:59.084452] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T03:35:59.091609] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-17T03:35:59.890145] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-11. [2025-09-17T03:36:00.004781] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T03:36:00.690146] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-17T03:36:00.757586] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T03:36:01.490199] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-17T03:36:01.686513] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T03:36:02.089063] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:36:02.290168] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-17T03:36:03.090121] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-17T03:36:03.293467] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T03:36:03.300543] [INFO ] [REMOTE ] ESI: Full fetch complete (71996 records). [2025-09-17T03:36:03.300705] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-17T03:36:03.705142] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-17T03:36:03.705267] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-17T03:36:03.706216] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-17T03:36:03.706310] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-17T03:36:03.707921] [DEBUG] [LOCAL ] ESI: Trimmed 71996 records to 50857 (keeping 200 days of data) [2025-09-17T03:36:03.895670] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-17T03:36:04.045262] [DEBUG] [LOCAL ] ESI: Primary data saved (50857 records). [2025-09-17T03:36:04.045447] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-17T03:36:04.045560] [INFO ] [MAIN ] Update Progress: 768/2369 symbols completed. ESI took 41.8s. Estimated remaining: 3h 53m 23s. Rate: 6.9 symbols/min [2025-09-17T03:36:04.220491] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:04.220765] [DEBUG] [LOCAL ] ET: No existing data file found in primary storage. [2025-09-17T03:36:04.220817] [WARN ] [MAIN ] ET: No existing data found, performing full refresh instead. [2025-09-17T03:36:04.220929] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-17T03:36:04.220984] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-17T03:36:04.221033] [DEBUG] [LOCAL ] ET: No primary data file found to delete. [2025-09-17T03:36:04.221103] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-17T03:36:04.586306] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:04.690135] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-11. [2025-09-17T03:36:05.542097] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (3.25 seconds). [2025-09-17T03:36:05.552479] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-17T03:36:05.591156] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-17T03:36:05.596893] [INFO ] [REMOTE ] ESRT: Full fetch complete (66259 records). [2025-09-17T03:36:05.597040] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-17T03:36:06.022517] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-17T03:36:06.022712] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-17T03:36:06.023549] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-17T03:36:06.023664] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-17T03:36:06.031286] [DEBUG] [LOCAL ] ESRT: Trimmed 66259 records to 46391 (keeping 200 days of data) [2025-09-17T03:36:06.042818] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-17T03:36:06.290244] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-17T03:36:06.347274] [DEBUG] [LOCAL ] ESRT: Primary data saved (46391 records). [2025-09-17T03:36:06.347522] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-17T03:36:06.347667] [INFO ] [MAIN ] Update Progress: 769/2369 symbols completed. ESRT took 33.0s. Estimated remaining: 3h 53m 1s. Rate: 6.9 symbols/min [2025-09-17T03:36:06.526259] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:06.537959] [DEBUG] [LOCAL ] ETB: Loaded 8126 existing records from primary storage. [2025-09-17T03:36:06.538159] [INFO ] [MAIN ] ETB: Loaded 8126 existing records. [2025-09-17T03:36:06.726398] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:36:06.726976] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-17T03:36:06.727076] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-17T03:36:06.727602] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-17T03:36:06.727804] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-17T03:36:07.120753] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-11 (2.43 seconds). [2025-09-17T03:36:07.157319] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:07.158609] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-17T03:36:07.207950] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T03:36:07.397460] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T03:36:07.890170] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-17T03:36:08.690135] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-11. [2025-09-17T03:36:09.313451] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T03:36:09.406238] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-17T03:36:09.452666] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T03:36:09.490092] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-17T03:36:10.290190] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-17T03:36:11.090233] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-17T03:36:11.219532] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T03:36:11.719168] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-17T03:36:11.890141] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-17T03:36:12.318865] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:36:12.322867] [INFO ] [REMOTE ] ESS: Full fetch complete (43147 records). [2025-09-17T03:36:12.322975] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-17T03:36:12.692275] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-17T03:36:12.720762] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-17T03:36:12.721025] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-17T03:36:12.721874] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-17T03:36:12.721963] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-17T03:36:12.731937] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T03:36:12.732356] [DEBUG] [LOCAL ] ESS: Trimmed 43147 records to 30217 (keeping 200 days of data) [2025-09-17T03:36:12.944436] [DEBUG] [LOCAL ] ESS: Primary data saved (30217 records). [2025-09-17T03:36:12.944769] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-17T03:36:12.944904] [INFO ] [MAIN ] Update Progress: 770/2369 symbols completed. ESS took 38.0s. Estimated remaining: 3h 52m 48s. Rate: 6.9 symbols/min [2025-09-17T03:36:13.117498] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:13.143173] [DEBUG] [LOCAL ] ETD: Loaded 20572 existing records from primary storage. [2025-09-17T03:36:13.143451] [INFO ] [MAIN ] ETD: Loaded 20572 existing records. [2025-09-17T03:36:13.334290] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:36:13.334693] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-17T03:36:13.334770] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-17T03:36:13.335472] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-17T03:36:13.335543] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-17T03:36:13.497522] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-17T03:36:13.707482] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:14.290121] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-17T03:36:14.414418] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T03:36:14.647011] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:36:15.090135] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-17T03:36:15.890132] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-17T03:36:16.184351] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T03:36:16.360520] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T03:36:16.690135] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-11. [2025-09-17T03:36:17.490118] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-17T03:36:17.909002] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T03:36:18.047203] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T03:36:18.290162] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-17T03:36:19.090135] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-17T03:36:19.890144] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-17T03:36:19.962041] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-17T03:36:20.072776] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T03:36:20.260100] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T03:36:20.690141] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-17T03:36:20.974889] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T03:36:21.490130] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-17T03:36:21.634600] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T03:36:22.290151] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-17T03:36:23.090127] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-17T03:36:23.306828] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:36:23.890156] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-17T03:36:24.374968] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T03:36:24.676604] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T03:36:24.694332] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-17T03:36:24.695937] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T03:36:25.490122] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-17T03:36:26.290124] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-17T03:36:26.454160] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T03:36:27.090125] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-17T03:36:27.450670] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T03:36:27.754936] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-17T03:36:27.890128] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-17T03:36:27.932875] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T03:36:28.690152] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-17T03:36:29.490141] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-17T03:36:29.691675] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T03:36:29.888065] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T03:36:30.290195] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-17T03:36:31.090201] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-17T03:36:31.693041] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T03:36:31.778688] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T03:36:31.890091] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-17T03:36:32.690185] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-17T03:36:32.944487] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T03:36:33.490141] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-17T03:36:34.086331] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:36:34.302861] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-17T03:36:34.329368] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-17T03:36:35.090163] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-17T03:36:35.266127] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T03:36:35.274542] [INFO ] [REMOTE ] ESTC: Full fetch complete (72131 records). [2025-09-17T03:36:35.274807] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-17T03:36:35.735177] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-17T03:36:35.750015] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-17T03:36:35.751675] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-17T03:36:35.752426] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T03:36:35.752575] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-17T03:36:35.760206] [DEBUG] [LOCAL ] ESTC: Trimmed 72131 records to 50254 (keeping 200 days of data) [2025-09-17T03:36:35.930431] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-17T03:36:36.000099] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T03:36:36.080018] [DEBUG] [LOCAL ] ESTC: Primary data saved (50254 records). [2025-09-17T03:36:36.080201] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-17T03:36:36.080304] [INFO ] [MAIN ] Update Progress: 771/2369 symbols completed. ESTC took 40.7s. Estimated remaining: 3h 53m 9s. Rate: 6.9 symbols/min [2025-09-17T03:36:36.250384] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:36.250629] [DEBUG] [LOCAL ] ETG: No existing data file found in primary storage. [2025-09-17T03:36:36.250698] [WARN ] [MAIN ] ETG: No existing data found, performing full refresh instead. [2025-09-17T03:36:36.250809] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-17T03:36:36.250854] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-17T03:36:36.250903] [DEBUG] [LOCAL ] ETG: No primary data file found to delete. [2025-09-17T03:36:36.250944] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-17T03:36:36.605183] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:36.690128] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-11. [2025-09-17T03:36:37.198409] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T03:36:37.490129] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-17T03:36:37.782937] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T03:36:38.290090] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-17T03:36:38.761752] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T03:36:38.968603] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T03:36:38.970196] [INFO ] [REMOTE ] ETB: Full fetch complete (17773 records). [2025-09-17T03:36:38.970346] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-17T03:36:39.095317] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-17T03:36:39.343333] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-17T03:36:39.343438] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-17T03:36:39.343918] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-17T03:36:39.343994] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-17T03:36:39.344672] [DEBUG] [LOCAL ] ETB: Trimmed 17773 records to 12202 (keeping 200 days of data) [2025-09-17T03:36:39.419545] [DEBUG] [LOCAL ] ETB: Primary data saved (12202 records). [2025-09-17T03:36:39.419747] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-17T03:36:39.419903] [INFO ] [MAIN ] Update Progress: 772/2369 symbols completed. ETB took 33.1s. Estimated remaining: 3h 52m 49s. Rate: 6.9 symbols/min [2025-09-17T03:36:39.587549] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:39.587807] [DEBUG] [LOCAL ] ETJ: No existing data file found in primary storage. [2025-09-17T03:36:39.587878] [WARN ] [MAIN ] ETJ: No existing data found, performing full refresh instead. [2025-09-17T03:36:39.588010] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-17T03:36:39.588102] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-17T03:36:39.588183] [DEBUG] [LOCAL ] ETJ: No primary data file found to delete. [2025-09-17T03:36:39.588244] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-17T03:36:39.902470] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-17T03:36:39.944799] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:40.305533] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:36:40.309365] [INFO ] [REMOTE ] ETD: Full fetch complete (37682 records). [2025-09-17T03:36:40.309483] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-17T03:36:40.692315] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-17T03:36:40.706637] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-17T03:36:40.706773] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-17T03:36:40.707511] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-17T03:36:40.707579] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-17T03:36:40.708813] [DEBUG] [LOCAL ] ETD: Trimmed 37682 records to 27390 (keeping 200 days of data) [2025-09-17T03:36:40.878109] [DEBUG] [LOCAL ] ETD: Primary data saved (27390 records). [2025-09-17T03:36:40.878264] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-17T03:36:40.878364] [INFO ] [MAIN ] Update Progress: 773/2369 symbols completed. ETD took 27.9s. Estimated remaining: 3h 52m 25s. Rate: 6.9 symbols/min [2025-09-17T03:36:41.054454] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:41.071026] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T03:36:41.112492] [DEBUG] [LOCAL ] ETN: Loaded 39261 existing records from primary storage. [2025-09-17T03:36:41.112688] [INFO ] [MAIN ] ETN: Loaded 39261 existing records. [2025-09-17T03:36:41.295777] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:36:41.296040] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-17T03:36:41.296093] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-17T03:36:41.297171] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-17T03:36:41.297232] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-17T03:36:41.498183] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-17T03:36:41.660200] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:42.290151] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-11. [2025-09-17T03:36:42.713445] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T03:36:43.056099] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T03:36:43.090163] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-17T03:36:43.820466] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T03:36:43.890122] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-17T03:36:44.690144] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-11. [2025-09-17T03:36:45.170407] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-17T03:36:45.177080] [INFO ] [REMOTE ] ET: Full fetch complete (77947 records). [2025-09-17T03:36:45.177228] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-17T03:36:45.490563] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-17T03:36:45.590264] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-17T03:36:45.590479] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-17T03:36:45.591428] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-17T03:36:45.591558] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-17T03:36:45.593231] [DEBUG] [LOCAL ] ET: Trimmed 77947 records to 53790 (keeping 200 days of data) [2025-09-17T03:36:45.733185] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T03:36:45.758446] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T03:36:45.994009] [DEBUG] [LOCAL ] ET: Primary data saved (53790 records). [2025-09-17T03:36:45.994187] [INFO ] [MAIN ] ET: Full history saved. [2025-09-17T03:36:45.994275] [INFO ] [MAIN ] Update Progress: 774/2369 symbols completed. ET took 41.9s. Estimated remaining: 3h 52m 9s. Rate: 6.9 symbols/min [2025-09-17T03:36:46.164032] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:36:46.170361] [DEBUG] [LOCAL ] ETO: Loaded 4864 existing records from primary storage. [2025-09-17T03:36:46.170482] [INFO ] [MAIN ] ETO: Loaded 4864 existing records. [2025-09-17T03:36:46.295263] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-17T03:36:46.356289] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:36:46.356699] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-17T03:36:46.356764] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-17T03:36:46.357063] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-17T03:36:46.357119] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-17T03:36:46.709424] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:36:46.718847] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T03:36:47.006972] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T03:36:47.090144] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-17T03:36:47.890173] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-17T03:36:48.083286] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:36:48.690134] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-11. [2025-09-17T03:36:49.313838] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T03:36:49.490166] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-17T03:36:49.948030] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T03:36:50.290131] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-17T03:36:50.500390] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T03:36:50.958757] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T03:36:51.090144] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-17T03:36:51.890136] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-17T03:36:51.987579] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T03:36:52.619514] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T03:36:52.690106] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-17T03:36:53.490132] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-17T03:36:54.290199] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-17T03:36:54.535958] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T03:36:54.659197] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T03:36:54.895948] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T03:36:55.090142] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-17T03:36:55.890176] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-17T03:36:56.690121] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-17T03:36:56.942545] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T03:36:57.182481] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T03:36:57.326659] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T03:36:57.490118] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-17T03:36:58.290141] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-17T03:36:58.539783] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T03:36:59.090130] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-17T03:36:59.849999] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T03:36:59.890086] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-17T03:37:00.362404] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T03:37:00.613561] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T03:37:00.690084] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-17T03:37:01.422289] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T03:37:01.490134] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-17T03:37:02.290108] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-17T03:37:02.584466] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T03:37:03.040901] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T03:37:03.090103] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-17T03:37:03.890146] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-17T03:37:04.259613] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T03:37:04.588948] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T03:37:04.690154] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-17T03:37:05.490123] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-17T03:37:06.290092] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-17T03:37:06.595065] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T03:37:06.760713] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T03:37:06.834871] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:37:06.836107] [INFO ] [REMOTE ] ETO: Full fetch complete (9296 records). [2025-09-17T03:37:06.836198] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-17T03:37:07.095684] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-17T03:37:07.234600] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-17T03:37:07.234757] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-17T03:37:07.235063] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-17T03:37:07.235130] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-17T03:37:07.235873] [DEBUG] [LOCAL ] ETO: Trimmed 9296 records to 6670 (keeping 200 days of data) [2025-09-17T03:37:07.279430] [DEBUG] [LOCAL ] ETO: Primary data saved (6670 records). [2025-09-17T03:37:07.279746] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-17T03:37:07.279874] [INFO ] [MAIN ] Update Progress: 775/2369 symbols completed. ETO took 21.3s. Estimated remaining: 3h 52m 26s. Rate: 6.9 symbols/min [2025-09-17T03:37:07.467313] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:07.513018] [DEBUG] [LOCAL ] ETR: Loaded 39652 existing records from primary storage. [2025-09-17T03:37:07.513278] [INFO ] [MAIN ] ETR: Loaded 39652 existing records. [2025-09-17T03:37:07.723854] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:37:07.724286] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-17T03:37:07.724359] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-17T03:37:07.725706] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-17T03:37:07.725822] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-17T03:37:07.895290] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-17T03:37:08.104970] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:08.690109] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-11. [2025-09-17T03:37:08.902713] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T03:37:09.107790] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T03:37:09.490138] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-17T03:37:10.290143] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-17T03:37:10.416488] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T03:37:11.090127] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-17T03:37:11.135104] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T03:37:11.414024] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T03:37:11.890183] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-17T03:37:12.690167] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-17T03:37:12.928396] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T03:37:12.949325] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T03:37:13.490129] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-17T03:37:13.528014] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T03:37:13.530163] [INFO ] [REMOTE ] ETG: Full fetch complete (25222 records). [2025-09-17T03:37:13.530313] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-17T03:37:13.902661] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-17T03:37:13.902763] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-17T03:37:13.903227] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-17T03:37:13.903279] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-17T03:37:13.903979] [DEBUG] [LOCAL ] ETG: Trimmed 25222 records to 17067 (keeping 200 days of data) [2025-09-17T03:37:14.013724] [DEBUG] [LOCAL ] ETG: Primary data saved (17067 records). [2025-09-17T03:37:14.013909] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-17T03:37:14.014021] [INFO ] [MAIN ] Update Progress: 776/2369 symbols completed. ETG took 37.9s. Estimated remaining: 3h 52m 13s. Rate: 6.9 symbols/min [2025-09-17T03:37:14.184592] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:14.200231] [DEBUG] [LOCAL ] ETV: Loaded 15040 existing records from primary storage. [2025-09-17T03:37:14.200373] [INFO ] [MAIN ] ETV: Loaded 15040 existing records. [2025-09-17T03:37:14.295295] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-17T03:37:14.383547] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:37:14.383799] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-17T03:37:14.383857] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-17T03:37:14.384323] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-17T03:37:14.384383] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-17T03:37:14.752356] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:14.754816] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T03:37:15.090176] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-17T03:37:15.890161] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-11. [2025-09-17T03:37:16.525975] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-17T03:37:16.617620] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T03:37:16.644629] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T03:37:16.690137] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-17T03:37:17.490133] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-17T03:37:18.290212] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-17T03:37:18.359126] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T03:37:19.090189] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-17T03:37:19.316253] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T03:37:19.417318] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T03:37:19.424022] [INFO ] [REMOTE ] ETN: Full fetch complete (76437 records). [2025-09-17T03:37:19.424200] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-17T03:37:19.822096] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-17T03:37:19.822231] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-17T03:37:19.823179] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-17T03:37:19.823260] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-17T03:37:19.828398] [DEBUG] [LOCAL ] ETN: Trimmed 76437 records to 52880 (keeping 200 days of data) [2025-09-17T03:37:19.895484] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-17T03:37:20.178848] [DEBUG] [LOCAL ] ETN: Primary data saved (52880 records). [2025-09-17T03:37:20.179040] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-17T03:37:20.179158] [INFO ] [MAIN ] Update Progress: 777/2369 symbols completed. ETN took 39.3s. Estimated remaining: 3h 51m 59s. Rate: 6.9 symbols/min [2025-09-17T03:37:20.384186] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:20.402170] [DEBUG] [LOCAL ] ETW: Loaded 18084 existing records from primary storage. [2025-09-17T03:37:20.402336] [INFO ] [MAIN ] ETW: Loaded 18084 existing records. [2025-09-17T03:37:20.596171] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:37:20.596897] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-17T03:37:20.596962] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-17T03:37:20.597401] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-17T03:37:20.597458] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-17T03:37:20.696262] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-17T03:37:20.970140] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:20.986043] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T03:37:21.031623] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T03:37:21.490114] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-17T03:37:21.677712] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T03:37:21.680342] [INFO ] [REMOTE ] ETJ: Full fetch complete (24645 records). [2025-09-17T03:37:21.680467] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-17T03:37:22.049424] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-17T03:37:22.049551] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-17T03:37:22.050114] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-17T03:37:22.050202] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-17T03:37:22.051563] [DEBUG] [LOCAL ] ETJ: Trimmed 24645 records to 16905 (keeping 200 days of data) [2025-09-17T03:37:22.152468] [DEBUG] [LOCAL ] ETJ: Primary data saved (16905 records). [2025-09-17T03:37:22.152654] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-17T03:37:22.152745] [INFO ] [MAIN ] Update Progress: 778/2369 symbols completed. ETJ took 42.7s. Estimated remaining: 3h 51m 36s. Rate: 6.9 symbols/min [2025-09-17T03:37:22.299014] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-11. [2025-09-17T03:37:22.326952] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:22.333372] [DEBUG] [LOCAL ] ETX: Loaded 4122 existing records from primary storage. [2025-09-17T03:37:22.333960] [INFO ] [MAIN ] ETX: Loaded 4122 existing records. [2025-09-17T03:37:22.510134] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:37:22.510391] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-17T03:37:22.510450] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-17T03:37:22.510735] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-17T03:37:22.510794] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-17T03:37:22.867542] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:22.883013] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T03:37:23.090108] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-17T03:37:23.491259] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T03:37:23.890160] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-17T03:37:24.145172] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T03:37:24.690144] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-17T03:37:25.490114] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-11. [2025-09-17T03:37:25.768361] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T03:37:25.868753] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T03:37:26.105057] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T03:37:26.290137] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-17T03:37:27.090125] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-17T03:37:27.890194] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-17T03:37:28.066586] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T03:37:28.276162] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T03:37:28.690134] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-17T03:37:29.014696] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:37:29.490173] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-17T03:37:29.583591] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T03:37:30.290201] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-17T03:37:30.930542] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T03:37:31.090219] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-17T03:37:31.285113] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T03:37:31.715598] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T03:37:31.890135] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-17T03:37:32.366148] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T03:37:32.690201] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-17T03:37:33.490131] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-17T03:37:33.794366] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T03:37:34.068874] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T03:37:34.290132] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-17T03:37:34.883407] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:37:35.090142] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-17T03:37:35.890136] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-17T03:37:36.690119] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-17T03:37:37.021408] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T03:37:37.157265] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T03:37:37.490098] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-17T03:37:37.568227] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T03:37:38.235106] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T03:37:38.290131] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-17T03:37:39.090132] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-17T03:37:39.244830] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T03:37:39.472871] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-17T03:37:39.890140] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-17T03:37:40.640049] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T03:37:40.690130] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-17T03:37:41.338588] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T03:37:41.339927] [INFO ] [REMOTE ] ETX: Full fetch complete (6991 records). [2025-09-17T03:37:41.340025] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-17T03:37:41.498463] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-17T03:37:41.721949] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-17T03:37:41.722070] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-17T03:37:41.722306] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-17T03:37:41.722360] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-17T03:37:41.722816] [DEBUG] [LOCAL ] ETX: Trimmed 6991 records to 4939 (keeping 200 days of data) [2025-09-17T03:37:41.758663] [DEBUG] [LOCAL ] ETX: Primary data saved (4939 records). [2025-09-17T03:37:41.758889] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-17T03:37:41.759054] [INFO ] [MAIN ] Update Progress: 779/2369 symbols completed. ETX took 19.6s. Estimated remaining: 3h 51m 50s. Rate: 6.9 symbols/min [2025-09-17T03:37:41.948952] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:41.966458] [DEBUG] [LOCAL ] ETY: Loaded 16334 existing records from primary storage. [2025-09-17T03:37:41.966657] [INFO ] [MAIN ] ETY: Loaded 16334 existing records. [2025-09-17T03:37:42.146733] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:37:42.146983] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-17T03:37:42.147045] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-17T03:37:42.147528] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-17T03:37:42.147594] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-17T03:37:42.292217] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-17T03:37:42.508238] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:43.090144] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-11. [2025-09-17T03:37:43.503867] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T03:37:43.542328] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T03:37:43.890134] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-17T03:37:44.388207] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T03:37:44.690185] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-17T03:37:44.796683] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T03:37:45.490103] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-17T03:37:45.887900] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T03:37:46.290179] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-17T03:37:46.625926] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T03:37:47.090101] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-17T03:37:47.511232] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T03:37:47.890166] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-17T03:37:48.020305] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T03:37:48.690196] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-17T03:37:49.490127] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-17T03:37:49.524310] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T03:37:49.530903] [INFO ] [REMOTE ] ETR: Full fetch complete (76775 records). [2025-09-17T03:37:49.531077] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-17T03:37:49.937894] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-17T03:37:49.950970] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T03:37:49.949914] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-17T03:37:49.956519] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-17T03:37:49.957040] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-17T03:37:49.960422] [DEBUG] [LOCAL ] ETR: Trimmed 76775 records to 53253 (keeping 200 days of data) [2025-09-17T03:37:50.290740] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-17T03:37:50.304066] [DEBUG] [LOCAL ] ETR: Primary data saved (53253 records). [2025-09-17T03:37:50.304247] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-17T03:37:50.304383] [INFO ] [MAIN ] Update Progress: 780/2369 symbols completed. ETR took 43.0s. Estimated remaining: 3h 51m 41s. Rate: 6.9 symbols/min [2025-09-17T03:37:50.479487] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:50.479815] [DEBUG] [LOCAL ] EVC: No existing data file found in primary storage. [2025-09-17T03:37:50.479868] [WARN ] [MAIN ] EVC: No existing data found, performing full refresh instead. [2025-09-17T03:37:50.480019] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-17T03:37:50.480083] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-17T03:37:50.480152] [DEBUG] [LOCAL ] EVC: No primary data file found to delete. [2025-09-17T03:37:50.480217] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-17T03:37:50.851161] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T03:37:50.856475] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:51.090216] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-11. [2025-09-17T03:37:51.476986] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T03:37:51.890207] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-17T03:37:52.189084] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T03:37:52.690126] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-17T03:37:52.890283] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T03:37:52.893694] [INFO ] [REMOTE ] ETW: Full fetch complete (36207 records). [2025-09-17T03:37:52.893830] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-17T03:37:53.284948] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-17T03:37:53.285069] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-17T03:37:53.285780] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-17T03:37:53.285856] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-17T03:37:53.286936] [DEBUG] [LOCAL ] ETW: Trimmed 36207 records to 25369 (keeping 200 days of data) [2025-09-17T03:37:53.452092] [DEBUG] [LOCAL ] ETW: Primary data saved (25369 records). [2025-09-17T03:37:53.452264] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-17T03:37:53.452415] [INFO ] [MAIN ] Update Progress: 781/2369 symbols completed. ETW took 33.3s. Estimated remaining: 3h 51m 21s. Rate: 6.9 symbols/min [2025-09-17T03:37:53.496952] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-17T03:37:53.633200] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:37:53.633595] [DEBUG] [LOCAL ] EVEX: No existing data file found in primary storage. [2025-09-17T03:37:53.633735] [WARN ] [MAIN ] EVEX: No existing data found, performing full refresh instead. [2025-09-17T03:37:53.633886] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-17T03:37:53.633960] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-17T03:37:53.634143] [DEBUG] [LOCAL ] EVEX: No primary data file found to delete. [2025-09-17T03:37:53.634266] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-17T03:37:53.808300] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:37:54.014338] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:37:54.290120] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-11. [2025-09-17T03:37:54.941770] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T03:37:55.090170] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-17T03:37:55.409279] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T03:37:55.890111] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-17T03:37:56.211506] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T03:37:56.690155] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-17T03:37:57.274455] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T03:37:57.490113] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-17T03:37:57.871039] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T03:37:58.290139] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-17T03:37:58.377171] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T03:37:59.090141] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-17T03:37:59.393357] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T03:37:59.890126] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-17T03:38:00.143412] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T03:38:00.690137] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-17T03:38:01.207178] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T03:38:01.490115] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-17T03:38:01.882540] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T03:38:02.290094] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-17T03:38:02.691880] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T03:38:03.090080] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-17T03:38:03.411746] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T03:38:03.890128] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-17T03:38:03.934933] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T03:38:04.690203] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-17T03:38:05.002979] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T03:38:05.490203] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-17T03:38:05.762604] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T03:38:06.290210] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-17T03:38:06.807976] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T03:38:07.090186] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-17T03:38:07.185081] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T03:38:07.187890] [INFO ] [REMOTE ] ETV: Full fetch complete (31568 records). [2025-09-17T03:38:07.188065] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-17T03:38:07.568754] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-17T03:38:07.568872] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-17T03:38:07.569375] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-17T03:38:07.569439] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-17T03:38:07.570197] [DEBUG] [LOCAL ] ETV: Trimmed 31568 records to 21483 (keeping 200 days of data) [2025-09-17T03:38:07.711894] [DEBUG] [LOCAL ] ETV: Primary data saved (21483 records). [2025-09-17T03:38:07.712052] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-17T03:38:07.712213] [INFO ] [MAIN ] Update Progress: 782/2369 symbols completed. ETV took 53.7s. Estimated remaining: 3h 51m 23s. Rate: 6.9 symbols/min [2025-09-17T03:38:07.885087] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:07.890190] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-17T03:38:07.893438] [DEBUG] [LOCAL ] EVF: Loaded 6450 existing records from primary storage. [2025-09-17T03:38:07.894589] [INFO ] [MAIN ] EVF: Loaded 6450 existing records. [2025-09-17T03:38:08.076727] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:38:08.077080] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-17T03:38:08.077255] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-17T03:38:08.077588] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-17T03:38:08.090545] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-17T03:38:08.091910] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T03:38:08.473237] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:08.690176] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-11. [2025-09-17T03:38:09.162467] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T03:38:09.313281] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T03:38:09.490159] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-17T03:38:10.058530] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T03:38:10.290146] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-17T03:38:10.762427] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T03:38:11.090128] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-17T03:38:11.890169] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-17T03:38:12.483880] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:38:12.568997] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T03:38:12.690135] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-17T03:38:13.472815] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T03:38:13.490089] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-17T03:38:14.290130] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-17T03:38:14.365677] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T03:38:15.090149] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-17T03:38:15.368082] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T03:38:15.890138] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-17T03:38:16.695666] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-17T03:38:16.717098] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T03:38:17.019717] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T03:38:17.490133] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-17T03:38:17.820836] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T03:38:18.290126] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-17T03:38:18.557289] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T03:38:19.090168] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-17T03:38:19.349796] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T03:38:19.715741] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T03:38:19.890137] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-17T03:38:20.690166] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-17T03:38:20.862124] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T03:38:20.865089] [INFO ] [REMOTE ] ETY: Full fetch complete (34558 records). [2025-09-17T03:38:20.865257] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-17T03:38:21.284963] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-17T03:38:21.285083] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-17T03:38:21.285696] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-17T03:38:21.285757] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-17T03:38:21.286849] [DEBUG] [LOCAL ] ETY: Trimmed 34558 records to 23207 (keeping 200 days of data) [2025-09-17T03:38:21.394149] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T03:38:21.448804] [DEBUG] [LOCAL ] ETY: Primary data saved (23207 records). [2025-09-17T03:38:21.448980] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-17T03:38:21.449092] [INFO ] [MAIN ] Update Progress: 783/2369 symbols completed. ETY took 39.7s. Estimated remaining: 3h 51m 24s. Rate: 6.9 symbols/min [2025-09-17T03:38:21.495230] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-17T03:38:21.630184] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:21.637608] [DEBUG] [LOCAL ] EVG: Loaded 4332 existing records from primary storage. [2025-09-17T03:38:21.637793] [INFO ] [MAIN ] EVG: Loaded 4332 existing records. [2025-09-17T03:38:21.824048] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:38:21.824299] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-17T03:38:21.824354] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-17T03:38:21.824748] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-17T03:38:21.824813] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-17T03:38:22.177669] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:22.290134] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-17T03:38:23.037734] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T03:38:23.043696] [INFO ] [REMOTE ] EVEX: Full fetch complete (40907 records). [2025-09-17T03:38:23.043834] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-17T03:38:23.095218] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-11. [2025-09-17T03:38:23.439264] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-17T03:38:23.448721] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-17T03:38:23.449440] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-17T03:38:23.450281] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T03:38:23.450363] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-17T03:38:23.455563] [DEBUG] [LOCAL ] EVEX: Trimmed 40907 records to 28901 (keeping 200 days of data) [2025-09-17T03:38:23.624721] [DEBUG] [LOCAL ] EVEX: Primary data saved (28901 records). [2025-09-17T03:38:23.624887] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-17T03:38:23.624967] [INFO ] [MAIN ] Update Progress: 784/2369 symbols completed. EVEX took 30.2s. Estimated remaining: 3h 51m 2s. Rate: 6.9 symbols/min [2025-09-17T03:38:23.793111] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:23.793336] [DEBUG] [LOCAL ] EVH: No existing data file found in primary storage. [2025-09-17T03:38:23.793386] [WARN ] [MAIN ] EVH: No existing data found, performing full refresh instead. [2025-09-17T03:38:23.793550] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-17T03:38:23.793608] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-17T03:38:23.793677] [DEBUG] [LOCAL ] EVH: No primary data file found to delete. [2025-09-17T03:38:23.793722] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-17T03:38:23.891580] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-17T03:38:23.898492] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T03:38:24.174112] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:24.667058] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T03:38:24.669948] [INFO ] [REMOTE ] EVC: Full fetch complete (31266 records). [2025-09-17T03:38:24.670106] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-17T03:38:24.700098] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-11. [2025-09-17T03:38:25.085918] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-17T03:38:25.086038] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-17T03:38:25.086704] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-17T03:38:25.086779] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-17T03:38:25.087612] [DEBUG] [LOCAL ] EVC: Trimmed 31266 records to 20297 (keeping 200 days of data) [2025-09-17T03:38:25.210549] [DEBUG] [LOCAL ] EVC: Primary data saved (20297 records). [2025-09-17T03:38:25.210738] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-17T03:38:25.210859] [INFO ] [MAIN ] Update Progress: 785/2369 symbols completed. EVC took 34.9s. Estimated remaining: 3h 50m 39s. Rate: 6.9 symbols/min [2025-09-17T03:38:25.377673] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:25.387985] [DEBUG] [LOCAL ] EVN: Loaded 7786 existing records from primary storage. [2025-09-17T03:38:25.388143] [INFO ] [MAIN ] EVN: Loaded 7786 existing records. [2025-09-17T03:38:25.495198] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-17T03:38:25.569908] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:38:25.570124] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-17T03:38:25.570223] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-17T03:38:25.570575] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-17T03:38:25.570636] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-17T03:38:25.938496] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:26.171030] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T03:38:26.290124] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-17T03:38:26.468568] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T03:38:27.090142] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-17T03:38:27.244418] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T03:38:27.890177] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-17T03:38:28.668650] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T03:38:28.685976] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T03:38:28.690068] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-17T03:38:29.311104] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T03:38:29.490173] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-11. [2025-09-17T03:38:30.290137] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-17T03:38:30.308433] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T03:38:31.090173] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-17T03:38:31.667502] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T03:38:31.890123] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-17T03:38:31.946250] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T03:38:32.561090] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T03:38:32.562639] [INFO ] [REMOTE ] EVF: Full fetch complete (11588 records). [2025-09-17T03:38:32.562753] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-17T03:38:32.705786] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-17T03:38:32.930665] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-17T03:38:32.930771] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-17T03:38:32.931064] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-17T03:38:32.931123] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-17T03:38:32.931610] [DEBUG] [LOCAL ] EVF: Trimmed 11588 records to 9065 (keeping 200 days of data) [2025-09-17T03:38:32.985424] [DEBUG] [LOCAL ] EVF: Primary data saved (9065 records). [2025-09-17T03:38:32.985590] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-17T03:38:32.985697] [INFO ] [MAIN ] Update Progress: 786/2369 symbols completed. EVF took 25.3s. Estimated remaining: 3h 50m 28s. Rate: 6.9 symbols/min [2025-09-17T03:38:33.159117] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:33.184054] [DEBUG] [LOCAL ] EVR: Loaded 25174 existing records from primary storage. [2025-09-17T03:38:33.184233] [INFO ] [MAIN ] EVR: Loaded 25174 existing records. [2025-09-17T03:38:33.366193] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:38:33.366493] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-17T03:38:33.366555] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-17T03:38:33.367316] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-17T03:38:33.367403] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-17T03:38:33.506477] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-17T03:38:33.723720] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:34.255043] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T03:38:34.286107] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T03:38:34.290072] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-17T03:38:34.713717] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T03:38:35.090146] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-17T03:38:35.890133] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-17T03:38:36.090962] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T03:38:36.690132] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-17T03:38:37.471260] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T03:38:37.501627] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-11. [2025-09-17T03:38:37.507752] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T03:38:38.290143] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-17T03:38:38.820583] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T03:38:38.899865] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T03:38:39.090143] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-17T03:38:39.890187] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-17T03:38:40.450490] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T03:38:40.690180] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-17T03:38:40.862907] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:38:41.490219] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-17T03:38:42.058987] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T03:38:42.290148] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-17T03:38:42.571169] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T03:38:43.090159] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-17T03:38:43.790826] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T03:38:43.812938] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T03:38:43.890107] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-17T03:38:44.519018] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T03:38:44.520361] [INFO ] [REMOTE ] EVG: Full fetch complete (8097 records). [2025-09-17T03:38:44.520448] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-17T03:38:44.695207] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-17T03:38:44.883483] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-17T03:38:44.883594] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-17T03:38:44.883856] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-17T03:38:44.883912] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-17T03:38:44.884409] [DEBUG] [LOCAL ] EVG: Trimmed 8097 records to 5848 (keeping 200 days of data) [2025-09-17T03:38:44.922128] [DEBUG] [LOCAL ] EVG: Primary data saved (5848 records). [2025-09-17T03:38:44.922289] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-17T03:38:44.922421] [INFO ] [MAIN ] Update Progress: 787/2369 symbols completed. EVG took 23.5s. Estimated remaining: 3h 50m 26s. Rate: 6.9 symbols/min [2025-09-17T03:38:45.091287] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:38:45.105018] [DEBUG] [LOCAL ] EVT: Loaded 12703 existing records from primary storage. [2025-09-17T03:38:45.105186] [INFO ] [MAIN ] EVT: Loaded 12703 existing records. [2025-09-17T03:38:45.285854] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:38:45.286136] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-17T03:38:45.286200] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-17T03:38:45.286720] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-17T03:38:45.286796] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-17T03:38:45.501467] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-17T03:38:45.653818] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:38:46.275619] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T03:38:46.290073] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-17T03:38:46.438513] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T03:38:47.090152] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-11. [2025-09-17T03:38:47.890166] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-17T03:38:47.939467] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T03:38:47.991909] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T03:38:48.690297] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-17T03:38:48.827307] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T03:38:49.490154] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-17T03:38:50.290159] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-17T03:38:50.340294] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T03:38:50.493351] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T03:38:50.976986] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:38:51.090111] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-17T03:38:51.890116] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-17T03:38:52.139620] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T03:38:52.690186] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-17T03:38:53.490137] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-17T03:38:53.646253] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T03:38:54.290121] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-17T03:38:54.390894] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T03:38:54.533251] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T03:38:55.090140] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-17T03:38:55.887062] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T03:38:55.894584] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-17T03:38:56.690187] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-17T03:38:56.838077] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T03:38:57.020986] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T03:38:57.491918] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-17T03:38:57.492826] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T03:38:58.290163] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-17T03:38:59.090172] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-17T03:38:59.176724] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T03:38:59.355587] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T03:38:59.592090] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-17T03:38:59.890155] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-17T03:39:00.690133] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-17T03:39:01.094986] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T03:39:01.496565] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-17T03:39:01.498014] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T03:39:02.290172] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-17T03:39:03.090131] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-17T03:39:03.890095] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-17T03:39:04.376765] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (2.88 seconds). [2025-09-17T03:39:04.450124] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T03:39:04.456271] [INFO ] [REMOTE ] EVH: Full fetch complete (71586 records). [2025-09-17T03:39:04.456428] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-17T03:39:04.647930] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T03:39:04.698879] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-17T03:39:04.872197] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-17T03:39:04.872323] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-17T03:39:04.873239] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-17T03:39:04.873308] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-17T03:39:04.874810] [DEBUG] [LOCAL ] EVH: Trimmed 71586 records to 49360 (keeping 200 days of data) [2025-09-17T03:39:04.977838] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T03:39:05.178390] [DEBUG] [LOCAL ] EVH: Primary data saved (49360 records). [2025-09-17T03:39:05.178556] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-17T03:39:05.178665] [INFO ] [MAIN ] Update Progress: 788/2369 symbols completed. EVH took 41.6s. Estimated remaining: 3h 50m 40s. Rate: 6.9 symbols/min [2025-09-17T03:39:05.349229] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:05.368155] [DEBUG] [LOCAL ] EVTC: Loaded 19478 existing records from primary storage. [2025-09-17T03:39:05.368316] [INFO ] [MAIN ] EVTC: Loaded 19478 existing records. [2025-09-17T03:39:05.495307] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-17T03:39:05.553208] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:05.553477] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-17T03:39:05.553542] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-17T03:39:05.554165] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-17T03:39:05.554228] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-17T03:39:05.908981] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:06.290189] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-17T03:39:06.328551] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T03:39:06.483861] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:39:06.782159] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T03:39:06.784922] [INFO ] [REMOTE ] EVN: Full fetch complete (17432 records). [2025-09-17T03:39:06.785032] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-17T03:39:07.090888] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-17T03:39:07.176954] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-17T03:39:07.177070] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-17T03:39:07.177475] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-17T03:39:07.177529] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-17T03:39:07.178267] [DEBUG] [LOCAL ] EVN: Trimmed 17432 records to 10894 (keeping 200 days of data) [2025-09-17T03:39:07.247357] [DEBUG] [LOCAL ] EVN: Primary data saved (10894 records). [2025-09-17T03:39:07.247546] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-17T03:39:07.247663] [INFO ] [MAIN ] Update Progress: 789/2369 symbols completed. EVN took 42.0s. Estimated remaining: 3h 50m 18s. Rate: 6.9 symbols/min [2025-09-17T03:39:07.422612] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:07.450532] [DEBUG] [LOCAL ] EVTL: Loaded 30107 existing records from primary storage. [2025-09-17T03:39:07.450726] [INFO ] [MAIN ] EVTL: Loaded 30107 existing records. [2025-09-17T03:39:07.632217] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:07.632474] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-17T03:39:07.632532] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-17T03:39:07.633405] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-17T03:39:07.633469] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-17T03:39:07.895362] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-17T03:39:07.999690] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:08.177123] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T03:39:08.690147] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-11. [2025-09-17T03:39:09.041499] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T03:39:09.416192] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T03:39:09.490114] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-17T03:39:10.290154] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-17T03:39:10.838530] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T03:39:11.090094] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-17T03:39:11.450632] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T03:39:11.454612] [INFO ] [REMOTE ] EVR: Full fetch complete (50411 records). [2025-09-17T03:39:11.454745] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-17T03:39:11.847422] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-17T03:39:11.847567] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-17T03:39:11.848271] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-17T03:39:11.848329] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-17T03:39:11.849411] [DEBUG] [LOCAL ] EVR: Trimmed 50411 records to 35990 (keeping 200 days of data) [2025-09-17T03:39:11.909135] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-17T03:39:11.959414] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T03:39:11.963988] [INFO ] [REMOTE ] EVT: Full fetch complete (25741 records). [2025-09-17T03:39:11.964852] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-17T03:39:12.360378] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-17T03:39:12.362898] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-17T03:39:12.363922] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-17T03:39:12.364379] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-17T03:39:12.367729] [DEBUG] [LOCAL ] EVT: Trimmed 25741 records to 17714 (keeping 200 days of data) [2025-09-17T03:39:12.581221] [DEBUG] [LOCAL ] EVT: Primary data saved (17714 records). [2025-09-17T03:39:12.582150] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-17T03:39:12.582826] [INFO ] [MAIN ] Update Progress: 790/2369 symbols completed. EVT took 27.7s. Estimated remaining: 3h 50m 3s. Rate: 6.9 symbols/min [2025-09-17T03:39:12.704706] [DEBUG] [LOCAL ] EVR: Primary data saved (35990 records). [2025-09-17T03:39:12.691913] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-11. [2025-09-17T03:39:12.756172] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-17T03:39:12.759404] [INFO ] [MAIN ] Update Progress: 791/2369 symbols completed. EVR took 39.8s. Estimated remaining: 3h 49m 37s. Rate: 6.9 symbols/min [2025-09-17T03:39:12.758527] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:12.949059] [DEBUG] [LOCAL ] EVTR: Loaded 17483 existing records from primary storage. [2025-09-17T03:39:12.948269] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:12.949628] [INFO ] [MAIN ] EVTR: Loaded 17483 existing records. [2025-09-17T03:39:13.140561] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:13.140875] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-17T03:39:13.140958] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-17T03:39:13.141495] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-17T03:39:13.141565] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-17T03:39:13.298636] [DEBUG] [LOCAL ] EW: Loaded 39779 existing records from primary storage. [2025-09-17T03:39:13.317666] [INFO ] [MAIN ] EW: Loaded 39779 existing records. [2025-09-17T03:39:13.647201] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:13.667480] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-11. [2025-09-17T03:39:13.708864] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:13.709689] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-17T03:39:13.709847] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-17T03:39:13.711360] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-17T03:39:13.711428] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-17T03:39:13.832536] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T03:39:14.097181] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:14.112887] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:39:14.290088] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-17T03:39:14.679763] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T03:39:15.090147] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-17T03:39:15.523440] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T03:39:15.890149] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-17T03:39:16.690106] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-11. [2025-09-17T03:39:17.179750] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-17T03:39:17.490132] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-17T03:39:17.573062] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T03:39:18.290135] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-17T03:39:18.590673] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T03:39:18.671536] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T03:39:18.969382] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T03:39:19.090126] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-17T03:39:19.890129] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-17T03:39:20.077257] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:39:20.690128] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-17T03:39:21.490102] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-17T03:39:21.673604] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T03:39:21.836880] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T03:39:22.290125] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-17T03:39:22.524417] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T03:39:23.029007] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T03:39:23.090112] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-17T03:39:23.890089] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-17T03:39:24.364107] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T03:39:24.690130] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-17T03:39:25.490153] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-17T03:39:25.704169] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T03:39:25.737605] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T03:39:26.290124] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-17T03:39:26.935618] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T03:39:27.090139] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-17T03:39:27.890186] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-17T03:39:28.087365] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:39:28.258761] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T03:39:28.690157] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-17T03:39:28.811609] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T03:39:29.490159] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-17T03:39:30.290158] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-17T03:39:30.675860] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T03:39:30.947389] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T03:39:31.090179] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-17T03:39:31.563767] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T03:39:31.890151] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-17T03:39:32.286724] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T03:39:32.690191] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-17T03:39:33.490819] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-17T03:39:33.668192] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T03:39:34.290189] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-17T03:39:34.496273] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T03:39:34.553308] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T03:39:35.090130] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-17T03:39:35.890124] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-17T03:39:36.241464] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T03:39:36.396402] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T03:39:36.690147] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-17T03:39:37.022970] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T03:39:37.490238] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-17T03:39:37.544295] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T03:39:38.290143] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-17T03:39:39.090189] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-17T03:39:39.295672] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T03:39:39.857980] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T03:39:39.863438] [INFO ] [REMOTE ] EVTL: Full fetch complete (49580 records). [2025-09-17T03:39:39.863563] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-17T03:39:39.895260] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-17T03:39:40.281616] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-17T03:39:40.281881] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-17T03:39:40.294104] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-17T03:39:40.295193] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:39:40.295269] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-17T03:39:40.300619] [INFO ] [REMOTE ] EVTC: Full fetch complete (37664 records). [2025-09-17T03:39:40.300877] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-17T03:39:40.301118] [DEBUG] [LOCAL ] EVTL: Trimmed 49580 records to 36188 (keeping 200 days of data) [2025-09-17T03:39:40.695273] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-17T03:39:40.776923] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-17T03:39:40.777327] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-17T03:39:40.778735] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-17T03:39:40.778911] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-17T03:39:40.782678] [DEBUG] [LOCAL ] EVTC: Trimmed 37664 records to 26661 (keeping 200 days of data) [2025-09-17T03:39:41.012476] [DEBUG] [LOCAL ] EVTL: Primary data saved (36188 records). [2025-09-17T03:39:41.014278] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-17T03:39:41.014422] [INFO ] [MAIN ] Update Progress: 792/2369 symbols completed. EVTL took 33.8s. Estimated remaining: 3h 50m 7s. Rate: 6.9 symbols/min [2025-09-17T03:39:41.220694] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:41.226057] [DEBUG] [LOCAL ] EVTC: Primary data saved (26661 records). [2025-09-17T03:39:41.226151] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-17T03:39:41.226251] [INFO ] [MAIN ] Update Progress: 793/2369 symbols completed. EVTC took 36.0s. Estimated remaining: 3h 49m 41s. Rate: 6.9 symbols/min [2025-09-17T03:39:41.403859] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:41.404074] [DEBUG] [LOCAL ] EXK: No existing data file found in primary storage. [2025-09-17T03:39:41.404117] [WARN ] [MAIN ] EXK: No existing data found, performing full refresh instead. [2025-09-17T03:39:41.404226] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-17T03:39:41.404278] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-17T03:39:41.404326] [DEBUG] [LOCAL ] EXK: No primary data file found to delete. [2025-09-17T03:39:41.404376] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-17T03:39:41.514576] [DEBUG] [LOCAL ] EXG: Loaded 25052 existing records from primary storage. [2025-09-17T03:39:41.540580] [INFO ] [MAIN ] EXG: Loaded 25052 existing records. [2025-09-17T03:39:41.883625] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:41.910353] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-17T03:39:41.967273] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-17T03:39:41.967024] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:41.967940] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-11. [2025-09-17T03:39:41.982351] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-17T03:39:41.983633] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T03:39:41.985877] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-17T03:39:42.187010] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T03:39:42.295189] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-17T03:39:42.404262] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:43.090157] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-11. [2025-09-17T03:39:43.590423] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T03:39:43.835748] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T03:39:43.890087] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-17T03:39:44.441472] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T03:39:44.690129] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-17T03:39:45.490142] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-17T03:39:45.597055] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T03:39:46.290257] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-17T03:39:46.390553] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T03:39:46.685545] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T03:39:47.090144] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-17T03:39:47.890158] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-17T03:39:47.991896] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T03:39:48.690191] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-17T03:39:48.883917] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T03:39:49.092154] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T03:39:49.096729] [INFO ] [REMOTE ] EVTR: Full fetch complete (30897 records). [2025-09-17T03:39:49.096823] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-17T03:39:49.470834] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-17T03:39:49.470955] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-17T03:39:49.471494] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-17T03:39:49.471574] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-17T03:39:49.472473] [DEBUG] [LOCAL ] EVTR: Trimmed 30897 records to 22682 (keeping 200 days of data) [2025-09-17T03:39:49.527555] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-17T03:39:49.619184] [DEBUG] [LOCAL ] EVTR: Primary data saved (22682 records). [2025-09-17T03:39:49.619385] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-17T03:39:49.619498] [INFO ] [MAIN ] Update Progress: 794/2369 symbols completed. EVTR took 37.0s. Estimated remaining: 3h 49m 32s. Rate: 6.9 symbols/min [2025-09-17T03:39:49.791264] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:49.791510] [DEBUG] [LOCAL ] EXP: No existing data file found in primary storage. [2025-09-17T03:39:49.791559] [WARN ] [MAIN ] EXP: No existing data found, performing full refresh instead. [2025-09-17T03:39:49.791710] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-17T03:39:49.791763] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-17T03:39:49.791809] [DEBUG] [LOCAL ] EXP: No primary data file found to delete. [2025-09-17T03:39:49.791866] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-17T03:39:50.149479] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:50.290104] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-17T03:39:50.333718] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:39:51.090175] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-11. [2025-09-17T03:39:51.281077] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:39:51.287839] [INFO ] [REMOTE ] EW: Full fetch complete (77185 records). [2025-09-17T03:39:51.288041] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-17T03:39:51.702506] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-17T03:39:51.702707] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-17T03:39:51.703741] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-17T03:39:51.703814] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-17T03:39:51.712804] [DEBUG] [LOCAL ] EW: Trimmed 77185 records to 53396 (keeping 200 days of data) [2025-09-17T03:39:51.727054] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T03:39:51.909065] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-17T03:39:52.065733] [DEBUG] [LOCAL ] EW: Primary data saved (53396 records). [2025-09-17T03:39:52.065920] [INFO ] [MAIN ] EW: Full history saved. [2025-09-17T03:39:52.066032] [INFO ] [MAIN ] Update Progress: 795/2369 symbols completed. EW took 39.3s. Estimated remaining: 3h 49m 11s. Rate: 6.9 symbols/min [2025-09-17T03:39:52.264761] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:39:52.281257] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T03:39:52.320078] [DEBUG] [LOCAL ] EXPD: Loaded 35628 existing records from primary storage. [2025-09-17T03:39:52.320269] [INFO ] [MAIN ] EXPD: Loaded 35628 existing records. [2025-09-17T03:39:52.498718] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:39:52.498965] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-17T03:39:52.499026] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-17T03:39:52.499783] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-17T03:39:52.499845] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-17T03:39:52.697100] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-17T03:39:52.858852] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:39:53.490146] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-17T03:39:53.764077] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T03:39:54.091167] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T03:39:54.290144] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-17T03:39:54.856013] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T03:39:55.090176] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-11. [2025-09-17T03:39:55.691032] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T03:39:55.890150] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-17T03:39:56.441730] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T03:39:56.690143] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-17T03:39:57.490132] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-17T03:39:57.878551] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T03:39:58.145287] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T03:39:58.290130] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-17T03:39:58.994519] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T03:39:59.090142] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-17T03:39:59.636033] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T03:39:59.890124] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-17T03:40:00.690116] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-17T03:40:00.771422] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T03:40:01.431420] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T03:40:01.490169] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-17T03:40:02.290193] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-17T03:40:02.652342] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T03:40:02.999983] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T03:40:03.090160] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-17T03:40:03.746410] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T03:40:03.890115] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-17T03:40:04.690140] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-17T03:40:04.931547] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T03:40:05.106260] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T03:40:05.490141] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-17T03:40:05.704359] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T03:40:06.290172] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-17T03:40:06.767757] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T03:40:07.090143] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-17T03:40:07.890140] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-17T03:40:08.294147] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T03:40:08.379416] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T03:40:08.690131] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-17T03:40:09.223204] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T03:40:09.490184] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-17T03:40:10.290144] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-17T03:40:10.518536] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T03:40:10.890082] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T03:40:11.090154] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-17T03:40:11.442507] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:40:11.446586] [INFO ] [REMOTE ] EXG: Full fetch complete (50136 records). [2025-09-17T03:40:11.446719] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-17T03:40:11.872717] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-17T03:40:11.872854] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-17T03:40:11.873597] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-17T03:40:11.873673] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-17T03:40:11.874796] [DEBUG] [LOCAL ] EXG: Trimmed 50136 records to 34986 (keeping 200 days of data) [2025-09-17T03:40:11.926338] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-17T03:40:12.090484] [DEBUG] [LOCAL ] EXG: Primary data saved (34986 records). [2025-09-17T03:40:12.090721] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-17T03:40:12.090874] [INFO ] [MAIN ] Update Progress: 796/2369 symbols completed. EXG took 31.1s. Estimated remaining: 3h 49m 24s. Rate: 6.9 symbols/min [2025-09-17T03:40:12.265062] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:12.299279] [DEBUG] [LOCAL ] EXR: Loaded 33814 existing records from primary storage. [2025-09-17T03:40:12.299445] [INFO ] [MAIN ] EXR: Loaded 33814 existing records. [2025-09-17T03:40:12.482225] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:40:12.482486] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-17T03:40:12.482544] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-17T03:40:12.483309] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-17T03:40:12.483371] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-17T03:40:12.695283] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-17T03:40:12.854099] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:12.889958] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:40:13.490160] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-11. [2025-09-17T03:40:13.732024] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T03:40:13.739150] [INFO ] [REMOTE ] EXK: Full fetch complete (76236 records). [2025-09-17T03:40:13.739390] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-17T03:40:14.145045] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-17T03:40:14.145256] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-17T03:40:14.146348] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-17T03:40:14.146520] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-17T03:40:14.167538] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T03:40:14.166208] [DEBUG] [LOCAL ] EXK: Trimmed 76236 records to 53059 (keeping 200 days of data) [2025-09-17T03:40:14.290223] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-17T03:40:14.477028] [DEBUG] [LOCAL ] EXK: Primary data saved (53059 records). [2025-09-17T03:40:14.477193] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-17T03:40:14.477277] [INFO ] [MAIN ] Update Progress: 797/2369 symbols completed. EXK took 33.3s. Estimated remaining: 3h 49m 3s. Rate: 6.9 symbols/min [2025-09-17T03:40:15.106073] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-17T03:40:15.109012] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T03:40:15.601462] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T03:40:15.890175] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-17T03:40:16.670440] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T03:40:16.690069] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-17T03:40:17.080244] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T03:40:17.083912] [INFO ] [REMOTE ] EXP: Full fetch complete (42889 records). [2025-09-17T03:40:17.084012] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-17T03:40:17.462281] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-17T03:40:17.462408] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-17T03:40:17.463062] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-17T03:40:17.463135] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-17T03:40:17.464306] [DEBUG] [LOCAL ] EXP: Trimmed 42889 records to 30245 (keeping 200 days of data) [2025-09-17T03:40:17.522635] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-17T03:40:17.656913] [DEBUG] [LOCAL ] EXP: Primary data saved (30245 records). [2025-09-17T03:40:17.657076] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-17T03:40:17.657182] [INFO ] [MAIN ] Update Progress: 798/2369 symbols completed. EXP took 28.0s. Estimated remaining: 3h 48m 43s. Rate: 6.9 symbols/min [2025-09-17T03:40:18.471265] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T03:40:18.482115] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-17T03:40:19.155847] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T03:40:19.164802] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-17T03:40:20.241123] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T03:40:20.251822] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-17T03:40:20.770087] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T03:40:20.779617] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-17T03:40:21.914717] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T03:40:21.924341] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-17T03:40:22.392665] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T03:40:22.401918] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-17T03:40:23.686804] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T03:40:23.698575] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-17T03:40:24.128158] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T03:40:24.138180] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-17T03:40:25.765976] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T03:40:25.777429] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-17T03:40:25.971068] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T03:40:25.981718] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-17T03:40:26.990959] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:40:26.997161] [INFO ] [REMOTE ] EXPD: Full fetch complete (68908 records). [2025-09-17T03:40:26.997350] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-17T03:40:27.419747] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-17T03:40:27.419923] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-17T03:40:27.420877] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-17T03:40:27.420940] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-17T03:40:27.422765] [DEBUG] [LOCAL ] EXPD: Trimmed 68908 records to 48243 (keeping 200 days of data) [2025-09-17T03:40:27.700680] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:40:27.714049] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-17T03:40:27.787552] [DEBUG] [LOCAL ] EXPD: Primary data saved (48243 records). [2025-09-17T03:40:27.787791] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-17T03:40:27.787973] [INFO ] [MAIN ] Update Progress: 799/2369 symbols completed. EXPD took 35.7s. Estimated remaining: 3h 48m 37s. Rate: 6.9 symbols/min [2025-09-17T03:40:29.440639] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T03:40:29.450683] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-17T03:40:31.243725] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T03:40:31.254791] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-17T03:40:32.934361] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T03:40:32.944991] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-17T03:40:34.513857] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T03:40:34.521503] [INFO ] [REMOTE ] EXR: Full fetch complete (65551 records). [2025-09-17T03:40:34.521789] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-17T03:40:34.915974] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-17T03:40:34.916095] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-17T03:40:34.916892] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-17T03:40:34.916976] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-17T03:40:34.918905] [DEBUG] [LOCAL ] EXR: Trimmed 65551 records to 45648 (keeping 200 days of data) [2025-09-17T03:40:35.215286] [DEBUG] [LOCAL ] EXR: Primary data saved (45648 records). [2025-09-17T03:40:35.215460] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-17T03:40:35.215575] [INFO ] [MAIN ] Update Progress: 800/2369 symbols completed. EXR took 23.1s. Estimated remaining: 3h 48m 26s. Rate: 6.9 symbols/min [2025-09-17T03:40:35.959684] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:35.891518] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:35.927867] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:35.986269] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:35.984961] [DEBUG] [LOCAL ] FAF: No existing data file found in primary storage. [2025-09-17T03:40:35.987167] [WARN ] [MAIN ] FAF: No existing data found, performing full refresh instead. [2025-09-17T03:40:35.988005] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-17T03:40:35.988074] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-17T03:40:35.988234] [DEBUG] [LOCAL ] FAF: No primary data file found to delete. [2025-09-17T03:40:35.988277] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-17T03:40:36.198979] [DEBUG] [LOCAL ] FBK: Loaded 19358 existing records from primary storage. [2025-09-17T03:40:36.280507] [INFO ] [MAIN ] FBK: Loaded 19358 existing records. [2025-09-17T03:40:36.316953] [DEBUG] [LOCAL ] F: Loaded 40170 existing records from primary storage. [2025-09-17T03:40:36.343690] [INFO ] [MAIN ] F: Loaded 40170 existing records. [2025-09-17T03:40:36.553638] [DEBUG] [LOCAL ] FBIN: Loaded 37713 existing records from primary storage. [2025-09-17T03:40:36.622930] [INFO ] [MAIN ] FBIN: Loaded 37713 existing records. [2025-09-17T03:40:36.650746] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:36.717611] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-11. [2025-09-17T03:40:36.849415] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:40:36.859560] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:40:36.879933] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-17T03:40:36.900463] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-17T03:40:36.879984] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-17T03:40:36.923307] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-17T03:40:36.920024] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-17T03:40:36.923443] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-17T03:40:36.934909] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-17T03:40:36.956544] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-17T03:40:37.247820] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:40:37.300861] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-17T03:40:37.383188] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-17T03:40:37.564850] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-17T03:40:37.599306] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-17T03:40:37.890185] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:37.890668] [INFO ] [REMOTE ] F: Fetching primary data for 2024-11. [2025-09-17T03:40:37.898515] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:37.939424] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-11. [2025-09-17T03:40:38.158321] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:38.158700] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-11. [2025-09-17T03:40:38.297283] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T03:40:38.305588] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-17T03:40:38.652048] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T03:40:38.656803] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-17T03:40:39.383343] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T03:40:39.387191] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-17T03:40:39.658778] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T03:40:39.666521] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-17T03:40:39.767938] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T03:40:39.778015] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-17T03:40:40.288847] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-11 (2.40 seconds). [2025-09-17T03:40:40.299816] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-17T03:40:40.486788] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:40:40.491262] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-17T03:40:40.932785] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:40:40.940533] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-17T03:40:41.159843] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T03:40:41.169747] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-17T03:40:41.376167] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T03:40:41.379882] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-17T03:40:41.932180] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T03:40:41.939374] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-17T03:40:42.547783] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T03:40:42.552368] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-17T03:40:42.732947] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-17T03:40:42.744733] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-17T03:40:42.851813] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:40:43.090200] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-17T03:40:43.430158] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T03:40:43.874194] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T03:40:43.890094] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-17T03:40:44.429886] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T03:40:44.690153] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-17T03:40:45.028284] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T03:40:45.251590] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-17T03:40:45.490199] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-17T03:40:46.290127] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-17T03:40:46.561453] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T03:40:46.743402] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T03:40:47.090168] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-17T03:40:47.890239] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-17T03:40:48.539543] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T03:40:48.695305] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-17T03:40:48.719055] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-17T03:40:49.490152] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-17T03:40:49.684035] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T03:40:50.290186] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-17T03:40:50.389991] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:40:51.090136] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-17T03:40:51.890113] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-17T03:40:52.000943] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-17T03:40:52.089838] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T03:40:52.385031] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T03:40:52.690182] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-17T03:40:53.424553] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T03:40:53.444210] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T03:40:53.448474] [INFO ] [REMOTE ] FBK: Full fetch complete (32271 records). [2025-09-17T03:40:53.448679] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-17T03:40:53.495335] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-17T03:40:53.852024] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-17T03:40:53.852157] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-17T03:40:53.852793] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-17T03:40:53.852852] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-17T03:40:53.853935] [DEBUG] [LOCAL ] FBK: Trimmed 32271 records to 25177 (keeping 200 days of data) [2025-09-17T03:40:54.008340] [DEBUG] [LOCAL ] FBK: Primary data saved (25177 records). [2025-09-17T03:40:54.008523] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-17T03:40:54.008636] [INFO ] [MAIN ] Update Progress: 801/2369 symbols completed. FBK took 18.8s. Estimated remaining: 3h 48m 37s. Rate: 6.9 symbols/min [2025-09-17T03:40:54.180901] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:40:54.181149] [DEBUG] [LOCAL ] FBP: No existing data file found in primary storage. [2025-09-17T03:40:54.181194] [WARN ] [MAIN ] FBP: No existing data found, performing full refresh instead. [2025-09-17T03:40:54.181300] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-17T03:40:54.181366] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-17T03:40:54.181423] [DEBUG] [LOCAL ] FBP: No primary data file found to delete. [2025-09-17T03:40:54.181469] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-17T03:40:54.295295] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-17T03:40:54.544303] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:40:55.090126] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-11. [2025-09-17T03:40:55.890167] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-17T03:40:55.991975] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T03:40:56.072140] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-17T03:40:56.683217] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T03:40:56.691956] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-17T03:40:57.490155] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-17T03:40:57.532023] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T03:40:58.290164] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-17T03:40:59.090180] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-17T03:40:59.152460] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:40:59.329194] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-17T03:40:59.895255] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-17T03:40:59.908473] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T03:41:00.690143] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-17T03:41:00.856956] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T03:41:01.490169] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-17T03:41:02.232569] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T03:41:02.290153] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-17T03:41:02.355743] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-17T03:41:02.593619] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:41:03.090130] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-17T03:41:03.860532] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T03:41:03.890139] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-17T03:41:04.544303] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:41:04.690160] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-17T03:41:05.088538] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T03:41:05.095004] [INFO ] [REMOTE ] FBIN: Full fetch complete (72350 records). [2025-09-17T03:41:05.095214] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-17T03:41:05.495553] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-17T03:41:05.519631] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-17T03:41:05.519766] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-17T03:41:05.520820] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-17T03:41:05.520904] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-17T03:41:05.522598] [DEBUG] [LOCAL ] FBIN: Trimmed 72350 records to 50474 (keeping 200 days of data) [2025-09-17T03:41:05.849459] [DEBUG] [LOCAL ] FBIN: Primary data saved (50474 records). [2025-09-17T03:41:05.849666] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-17T03:41:05.849771] [INFO ] [MAIN ] Update Progress: 802/2369 symbols completed. FBIN took 30.6s. Estimated remaining: 3h 48m 34s. Rate: 6.9 symbols/min [2025-09-17T03:41:06.025304] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:06.050740] [DEBUG] [LOCAL ] FBRT: Loaded 25233 existing records from primary storage. [2025-09-17T03:41:06.050905] [INFO ] [MAIN ] FBRT: Loaded 25233 existing records. [2025-09-17T03:41:06.225798] [WARN ] [MAIN ] FBRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:41:06.226049] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-17T03:41:06.226110] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-17T03:41:06.226838] [DEBUG] [LOCAL ] FBRT: Deleted primary data file. [2025-09-17T03:41:06.226903] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-17T03:41:06.295669] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-17T03:41:06.587943] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:06.620043] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T03:41:07.090178] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-17T03:41:07.715037] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T03:41:07.719955] [INFO ] [REMOTE ] FAF: Full fetch complete (57299 records). [2025-09-17T03:41:07.720095] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-17T03:41:07.901374] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-11. [2025-09-17T03:41:08.113465] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-17T03:41:08.113573] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-17T03:41:08.114780] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-17T03:41:08.115082] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-17T03:41:08.116875] [DEBUG] [LOCAL ] FAF: Trimmed 57299 records to 42029 (keeping 200 days of data) [2025-09-17T03:41:08.261098] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-17T03:41:08.409047] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T03:41:08.462360] [DEBUG] [LOCAL ] FAF: Primary data saved (42029 records). [2025-09-17T03:41:08.462521] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-17T03:41:08.462604] [INFO ] [MAIN ] Update Progress: 803/2369 symbols completed. FAF took 33.2s. Estimated remaining: 3h 48m 14s. Rate: 6.9 symbols/min [2025-09-17T03:41:08.633532] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:08.633773] [DEBUG] [LOCAL ] FC: No existing data file found in primary storage. [2025-09-17T03:41:08.633843] [WARN ] [MAIN ] FC: No existing data found, performing full refresh instead. [2025-09-17T03:41:08.633986] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-17T03:41:08.634053] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-17T03:41:08.634196] [DEBUG] [LOCAL ] FC: No primary data file found to delete. [2025-09-17T03:41:08.634265] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-17T03:41:08.695834] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-17T03:41:08.993905] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:09.215498] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T03:41:09.490147] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-11. [2025-09-17T03:41:10.286859] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T03:41:10.290074] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-17T03:41:10.938676] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-17T03:41:11.090180] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-17T03:41:11.168237] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T03:41:11.189316] [DEBUG] [REMOTE ] FBRT: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-17T03:41:11.189744] [WARN ] [REMOTE ] FBRT: No data returned for month 2024-12 [2025-09-17T03:41:11.890146] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-17T03:41:12.690092] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-17T03:41:13.152259] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T03:41:13.490201] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-17T03:41:14.290137] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-17T03:41:14.998200] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T03:41:15.025845] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-17T03:41:15.034100] [INFO ] [REMOTE ] F: Full fetch complete (77998 records). [2025-09-17T03:41:15.034319] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-17T03:41:15.095259] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-17T03:41:15.452230] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-17T03:41:15.452872] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-17T03:41:15.453219] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T03:41:15.454320] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-17T03:41:15.458262] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-17T03:41:15.459862] [DEBUG] [LOCAL ] F: Trimmed 77998 records to 53820 (keeping 200 days of data) [2025-09-17T03:41:15.807475] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-09-17T03:41:15.807660] [INFO ] [MAIN ] F: Full history saved. [2025-09-17T03:41:15.807757] [INFO ] [MAIN ] Update Progress: 804/2369 symbols completed. F took 40.6s. Estimated remaining: 3h 48m 2s. Rate: 6.9 symbols/min [2025-09-17T03:41:15.896737] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-17T03:41:15.977549] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:16.005704] [DEBUG] [LOCAL ] FCF: Loaded 28310 existing records from primary storage. [2025-09-17T03:41:16.005873] [INFO ] [MAIN ] FCF: Loaded 28310 existing records. [2025-09-17T03:41:16.180985] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:41:16.181223] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-17T03:41:16.181274] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-17T03:41:16.182082] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-17T03:41:16.182145] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-17T03:41:16.557612] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:16.690132] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-11. [2025-09-17T03:41:16.830136] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T03:41:17.301960] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:41:17.490158] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-17T03:41:17.792387] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T03:41:18.290152] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-17T03:41:18.859213] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T03:41:19.090141] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-17T03:41:19.890148] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-17T03:41:20.026029] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T03:41:20.224063] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T03:41:20.690126] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-17T03:41:21.393132] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T03:41:21.490112] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-17T03:41:21.583244] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T03:41:22.290188] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-17T03:41:22.817756] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T03:41:23.090119] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-17T03:41:23.896073] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-17T03:41:23.917271] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T03:41:24.472234] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T03:41:24.690170] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-17T03:41:25.481665] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T03:41:25.490904] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-17T03:41:25.961860] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T03:41:25.967235] [INFO ] [REMOTE ] FBP: Full fetch complete (66183 records). [2025-09-17T03:41:25.967388] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-17T03:41:26.295198] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-17T03:41:26.379523] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-17T03:41:26.379690] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-17T03:41:26.380625] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-17T03:41:26.380731] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-17T03:41:26.382328] [DEBUG] [LOCAL ] FBP: Trimmed 66183 records to 46372 (keeping 200 days of data) [2025-09-17T03:41:26.633071] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T03:41:26.709443] [DEBUG] [LOCAL ] FBP: Primary data saved (46372 records). [2025-09-17T03:41:26.709624] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-17T03:41:26.709738] [INFO ] [MAIN ] Update Progress: 805/2369 symbols completed. FBP took 32.7s. Estimated remaining: 3h 47m 58s. Rate: 6.9 symbols/min [2025-09-17T03:41:26.879669] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:26.879905] [DEBUG] [LOCAL ] FCN: No existing data file found in primary storage. [2025-09-17T03:41:26.879957] [WARN ] [MAIN ] FCN: No existing data found, performing full refresh instead. [2025-09-17T03:41:26.880061] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-17T03:41:26.880116] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-17T03:41:26.880169] [DEBUG] [LOCAL ] FCN: No primary data file found to delete. [2025-09-17T03:41:26.880216] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-17T03:41:27.095213] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-17T03:41:27.240867] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:27.835232] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T03:41:27.890113] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-17T03:41:28.300607] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T03:41:28.690156] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-17T03:41:29.242755] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T03:41:29.490163] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-11. [2025-09-17T03:41:29.754092] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T03:41:30.290154] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-17T03:41:30.644902] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T03:41:31.090149] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-17T03:41:31.900123] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-17T03:41:31.906158] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T03:41:32.267678] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T03:41:32.271722] [INFO ] [REMOTE ] FBRT: Full fetch complete (43288 records). [2025-09-17T03:41:32.271862] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-17T03:41:32.457862] [WARN ] [VALIDATOR ] FBRT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T03:41:32.458370] [FATAL] [MAIN ] FBRT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:41:32.458423] [WARN ] [MAIN ] FBRT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:41:32.458467] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-17T03:41:32.458529] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-09-17T03:41:32.458579] [INFO ] [LOCAL ] FBRT: Starting deletion of derivative data. [2025-09-17T03:41:32.459085] [DEBUG] [LOCAL ] FBRT: Deleted derivative data file. [2025-09-17T03:41:32.459190] [INFO ] [MAIN ] Update Progress: 806/2369 symbols completed. FBRT took 26.6s. Estimated remaining: 3h 47m 43s. Rate: 6.9 symbols/min [2025-09-17T03:41:32.631461] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:32.631680] [DEBUG] [LOCAL ] FCPT: No existing data file found in primary storage. [2025-09-17T03:41:32.631745] [WARN ] [MAIN ] FCPT: No existing data found, performing full refresh instead. [2025-09-17T03:41:32.631849] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-17T03:41:32.631902] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-17T03:41:32.631951] [DEBUG] [LOCAL ] FCPT: No primary data file found to delete. [2025-09-17T03:41:32.631997] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-17T03:41:32.695334] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-17T03:41:32.967694] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T03:41:33.004638] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:33.490141] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-17T03:41:34.290131] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-11. [2025-09-17T03:41:34.384529] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T03:41:34.487143] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T03:41:35.090239] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-17T03:41:35.728351] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T03:41:35.890168] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-17T03:41:36.166632] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T03:41:36.690138] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-17T03:41:37.405631] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T03:41:37.490773] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-17T03:41:37.698443] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T03:41:38.290146] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-17T03:41:38.654103] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T03:41:39.090193] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-17T03:41:39.721351] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T03:41:39.890196] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-17T03:41:39.934426] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T03:41:39.937051] [INFO ] [REMOTE ] FC: Full fetch complete (21376 records). [2025-09-17T03:41:39.937188] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-17T03:41:40.303140] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-17T03:41:40.303259] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-17T03:41:40.303875] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-17T03:41:40.303969] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-17T03:41:40.304713] [DEBUG] [LOCAL ] FC: Trimmed 21376 records to 15411 (keeping 200 days of data) [2025-09-17T03:41:40.396227] [DEBUG] [LOCAL ] FC: Primary data saved (15411 records). [2025-09-17T03:41:40.396399] [INFO ] [MAIN ] FC: Full history saved. [2025-09-17T03:41:40.396491] [INFO ] [MAIN ] Update Progress: 807/2369 symbols completed. FC took 31.9s. Estimated remaining: 3h 47m 33s. Rate: 6.9 symbols/min [2025-09-17T03:41:40.566725] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:40.566954] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-17T03:41:40.567009] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-17T03:41:40.567112] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-17T03:41:40.567167] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-17T03:41:40.567220] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-17T03:41:40.567266] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-17T03:41:40.709836] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-17T03:41:40.964332] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:41.092619] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T03:41:41.490138] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-17T03:41:42.290165] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-11. [2025-09-17T03:41:42.431787] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T03:41:42.485622] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T03:41:42.621913] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T03:41:43.090255] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-17T03:41:43.890195] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-17T03:41:44.225182] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-17T03:41:44.242042] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:41:44.690219] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-17T03:41:45.490152] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-17T03:41:46.120886] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:41:46.290144] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-17T03:41:46.807087] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T03:41:46.867282] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T03:41:47.090165] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-17T03:41:47.890149] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-17T03:41:48.371753] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T03:41:48.435619] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T03:41:48.690184] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-17T03:41:49.490213] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-17T03:41:50.011330] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T03:41:50.017612] [INFO ] [REMOTE ] FCF: Full fetch complete (57773 records). [2025-09-17T03:41:50.017840] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-17T03:41:50.295306] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-17T03:41:50.414345] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-17T03:41:50.414480] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-17T03:41:50.415284] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-17T03:41:50.415351] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-17T03:41:50.416624] [DEBUG] [LOCAL ] FCF: Trimmed 57773 records to 39936 (keeping 200 days of data) [2025-09-17T03:41:50.669112] [DEBUG] [LOCAL ] FCF: Primary data saved (39936 records). [2025-09-17T03:41:50.669307] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-17T03:41:50.669421] [INFO ] [MAIN ] Update Progress: 808/2369 symbols completed. FCF took 34.9s. Estimated remaining: 3h 47m 27s. Rate: 6.9 symbols/min [2025-09-17T03:41:50.699825] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T03:41:50.852219] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:41:50.863924] [DEBUG] [LOCAL ] FCT: Loaded 10467 existing records from primary storage. [2025-09-17T03:41:50.864074] [INFO ] [MAIN ] FCT: Loaded 10467 existing records. [2025-09-17T03:41:51.047993] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:41:51.048340] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-17T03:41:51.048776] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-17T03:41:51.049537] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-17T03:41:51.049726] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-17T03:41:51.111292] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-17T03:41:51.182254] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T03:41:51.455099] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:41:51.890125] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-11. [2025-09-17T03:41:52.423814] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T03:41:52.690176] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-17T03:41:52.831860] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T03:41:53.490141] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-17T03:41:54.226269] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T03:41:54.290133] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-17T03:41:54.516513] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T03:41:55.090185] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-17T03:41:55.723479] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T03:41:55.741320] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T03:41:55.890135] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-17T03:41:56.333447] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T03:41:56.690130] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-17T03:41:57.490146] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-17T03:41:57.819085] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T03:41:58.044832] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T03:41:58.290162] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-17T03:41:59.090171] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-17T03:41:59.753591] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:41:59.890168] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-17T03:42:00.500179] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:42:00.690188] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-17T03:42:01.118773] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T03:42:01.415058] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T03:42:01.490138] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-17T03:42:02.290125] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-17T03:42:03.090198] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-17T03:42:03.267250] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T03:42:03.890175] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-17T03:42:04.604847] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-17T03:42:04.617552] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T03:42:04.628848] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T03:42:04.690131] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-17T03:42:05.490147] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-17T03:42:05.851580] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T03:42:05.852526] [INFO ] [REMOTE ] FCRX: Full fetch complete (1649 records). [2025-09-17T03:42:05.852611] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-17T03:42:06.038967] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-17T03:42:06.039260] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:42:06.039405] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:42:06.039541] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-17T03:42:06.039700] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-17T03:42:06.053669] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-17T03:42:06.054255] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-17T03:42:06.054797] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T03:42:06.054998] [INFO ] [MAIN ] Update Progress: 809/2369 symbols completed. FCRX took 25.7s. Estimated remaining: 3h 47m 31s. Rate: 6.9 symbols/min [2025-09-17T03:42:06.236161] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:06.279539] [DEBUG] [LOCAL ] FCX: Loaded 40052 existing records from primary storage. [2025-09-17T03:42:06.279755] [INFO ] [MAIN ] FCX: Loaded 40052 existing records. [2025-09-17T03:42:06.295197] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-17T03:42:06.468885] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:06.469120] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-17T03:42:06.469207] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-17T03:42:06.470148] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-17T03:42:06.470226] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-17T03:42:06.839958] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:07.078591] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T03:42:07.090075] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-17T03:42:07.890160] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-11. [2025-09-17T03:42:08.159824] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T03:42:08.690135] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-17T03:42:09.490149] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-17T03:42:09.863700] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T03:42:09.990841] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:42:10.010188] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T03:42:10.290147] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-17T03:42:11.090196] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-17T03:42:11.157330] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T03:42:11.890136] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-17T03:42:12.046374] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:42:12.690142] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-17T03:42:12.840367] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T03:42:12.843499] [INFO ] [REMOTE ] FCN: Full fetch complete (35310 records). [2025-09-17T03:42:12.843599] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-17T03:42:13.218691] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-17T03:42:13.218798] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-17T03:42:13.219359] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-17T03:42:13.219420] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-17T03:42:13.220293] [DEBUG] [LOCAL ] FCN: Trimmed 35310 records to 26388 (keeping 200 days of data) [2025-09-17T03:42:13.388619] [DEBUG] [LOCAL ] FCN: Primary data saved (26388 records). [2025-09-17T03:42:13.388839] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-17T03:42:13.388938] [INFO ] [MAIN ] Update Progress: 810/2369 symbols completed. FCN took 46.7s. Estimated remaining: 3h 47m 19s. Rate: 6.9 symbols/min [2025-09-17T03:42:13.495204] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-17T03:42:13.560294] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:13.581986] [DEBUG] [LOCAL ] FDP: Loaded 22537 existing records from primary storage. [2025-09-17T03:42:13.582173] [INFO ] [MAIN ] FDP: Loaded 22537 existing records. [2025-09-17T03:42:13.763216] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:13.763702] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-17T03:42:13.763832] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-17T03:42:13.775493] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T03:42:13.775555] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-17T03:42:13.779307] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-17T03:42:14.144180] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:14.290166] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-11. [2025-09-17T03:42:15.090172] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-17T03:42:15.474755] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T03:42:15.512363] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T03:42:15.890138] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-17T03:42:15.938680] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T03:42:16.690180] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-17T03:42:17.023350] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T03:42:17.490143] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-17T03:42:17.604213] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T03:42:17.606912] [INFO ] [REMOTE ] FCT: Full fetch complete (21272 records). [2025-09-17T03:42:17.607015] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-17T03:42:17.981738] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-17T03:42:17.981857] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-17T03:42:17.982372] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-17T03:42:17.982442] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-17T03:42:17.983125] [DEBUG] [LOCAL ] FCT: Trimmed 21272 records to 14388 (keeping 200 days of data) [2025-09-17T03:42:18.071386] [DEBUG] [LOCAL ] FCT: Primary data saved (14388 records). [2025-09-17T03:42:18.071585] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-17T03:42:18.071752] [INFO ] [MAIN ] Update Progress: 811/2369 symbols completed. FCT took 27.4s. Estimated remaining: 3h 47m 3s. Rate: 6.9 symbols/min [2025-09-17T03:42:18.242898] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:18.261251] [DEBUG] [LOCAL ] FDS: Loaded 18492 existing records from primary storage. [2025-09-17T03:42:18.261429] [INFO ] [MAIN ] FDS: Loaded 18492 existing records. [2025-09-17T03:42:18.295248] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-17T03:42:18.442775] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:18.443069] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-17T03:42:18.443148] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-17T03:42:18.443801] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-17T03:42:18.443872] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-17T03:42:18.801134] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:19.090101] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-17T03:42:19.548973] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T03:42:19.609327] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T03:42:19.890128] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-17T03:42:20.373325] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:42:20.378285] [INFO ] [REMOTE ] FCPT: Full fetch complete (53094 records). [2025-09-17T03:42:20.378419] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-17T03:42:20.695363] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-11. [2025-09-17T03:42:20.774787] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-17T03:42:20.774965] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-17T03:42:20.775804] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-17T03:42:20.775893] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-17T03:42:20.777342] [DEBUG] [LOCAL ] FCPT: Trimmed 53094 records to 37569 (keeping 200 days of data) [2025-09-17T03:42:21.010371] [DEBUG] [LOCAL ] FCPT: Primary data saved (37569 records). [2025-09-17T03:42:21.010559] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-17T03:42:21.010661] [INFO ] [MAIN ] Update Progress: 812/2369 symbols completed. FCPT took 48.6s. Estimated remaining: 3h 46m 43s. Rate: 6.9 symbols/min [2025-09-17T03:42:21.198078] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:21.240165] [DEBUG] [LOCAL ] FDX: Loaded 38297 existing records from primary storage. [2025-09-17T03:42:21.240346] [INFO ] [MAIN ] FDX: Loaded 38297 existing records. [2025-09-17T03:42:21.423232] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:21.423510] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-17T03:42:21.423571] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-17T03:42:21.424746] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-17T03:42:21.424821] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-17T03:42:21.495521] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-17T03:42:21.795694] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:22.290135] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-11. [2025-09-17T03:42:22.851749] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.96 seconds). [2025-09-17T03:42:23.095167] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-17T03:42:23.103062] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-11 (2.41 seconds). [2025-09-17T03:42:23.783617] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-17T03:42:23.890087] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-17T03:42:24.408448] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-17T03:42:24.686427] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T03:42:24.691345] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-17T03:42:25.217276] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T03:42:25.490137] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-17T03:42:26.068631] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T03:42:26.290147] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-17T03:42:27.090091] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-17T03:42:27.434826] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T03:42:27.459778] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T03:42:27.890171] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-17T03:42:28.690258] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-17T03:42:29.276135] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-17T03:42:29.490186] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-17T03:42:29.705248] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:42:29.758722] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T03:42:30.290220] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-17T03:42:31.090175] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-17T03:42:31.505142] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T03:42:31.643042] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T03:42:31.890165] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-17T03:42:32.608096] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T03:42:32.690153] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-17T03:42:33.490135] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-17T03:42:33.704538] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T03:42:33.772186] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T03:42:34.290148] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-17T03:42:35.090553] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-17T03:42:35.331303] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T03:42:35.503159] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T03:42:35.890169] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-17T03:42:36.454373] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T03:42:36.690156] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-17T03:42:37.490807] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-17T03:42:37.490722] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T03:42:37.525235] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T03:42:38.290145] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-17T03:42:39.090162] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-17T03:42:39.771131] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T03:42:39.890147] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-17T03:42:40.352623] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T03:42:40.492720] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T03:42:40.690142] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-17T03:42:41.490199] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-17T03:42:42.008850] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-17T03:42:42.290120] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-17T03:42:42.666124] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T03:42:42.849613] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T03:42:43.090155] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-17T03:42:43.890141] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-17T03:42:44.156117] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T03:42:44.162676] [INFO ] [REMOTE ] FCX: Full fetch complete (77652 records). [2025-09-17T03:42:44.162843] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-17T03:42:44.562975] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-17T03:42:44.563093] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-17T03:42:44.564085] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-17T03:42:44.564150] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-17T03:42:44.565825] [DEBUG] [LOCAL ] FCX: Trimmed 77652 records to 53699 (keeping 200 days of data) [2025-09-17T03:42:44.693509] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-17T03:42:44.898383] [DEBUG] [LOCAL ] FCX: Primary data saved (53699 records). [2025-09-17T03:42:44.898562] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-17T03:42:44.898678] [INFO ] [MAIN ] Update Progress: 813/2369 symbols completed. FCX took 38.8s. Estimated remaining: 3h 47m 3s. Rate: 6.9 symbols/min [2025-09-17T03:42:45.075444] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:45.091720] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T03:42:45.127411] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T03:42:45.164676] [DEBUG] [LOCAL ] FE: Loaded 39837 existing records from primary storage. [2025-09-17T03:42:45.164848] [INFO ] [MAIN ] FE: Loaded 39837 existing records. [2025-09-17T03:42:45.345686] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:45.345937] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-17T03:42:45.346000] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-17T03:42:45.346921] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-17T03:42:45.346985] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-17T03:42:45.495259] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-17T03:42:45.717021] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:46.058705] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T03:42:46.290174] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-17T03:42:46.925353] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T03:42:47.090134] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-17T03:42:47.890111] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-17T03:42:48.366908] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T03:42:48.388691] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T03:42:48.392394] [INFO ] [REMOTE ] FDP: Full fetch complete (42570 records). [2025-09-17T03:42:48.392518] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-17T03:42:48.695267] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-11. [2025-09-17T03:42:48.774880] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-17T03:42:48.774995] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-17T03:42:48.775691] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-17T03:42:48.775765] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-17T03:42:48.776862] [DEBUG] [LOCAL ] FDP: Trimmed 42570 records to 30448 (keeping 200 days of data) [2025-09-17T03:42:48.973937] [DEBUG] [LOCAL ] FDP: Primary data saved (30448 records). [2025-09-17T03:42:48.974173] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-17T03:42:48.974342] [INFO ] [MAIN ] Update Progress: 814/2369 symbols completed. FDP took 35.6s. Estimated remaining: 3h 46m 46s. Rate: 6.9 symbols/min [2025-09-17T03:42:49.152396] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:49.152670] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-17T03:42:49.152751] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-17T03:42:49.152896] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-17T03:42:49.152954] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-17T03:42:49.153013] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-17T03:42:49.153099] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-17T03:42:49.507317] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-17T03:42:49.511682] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:49.523832] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T03:42:49.527959] [INFO ] [REMOTE ] FDS: Full fetch complete (35640 records). [2025-09-17T03:42:49.528088] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-17T03:42:49.897688] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-17T03:42:49.897795] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-17T03:42:49.898366] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-17T03:42:49.898433] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-17T03:42:49.899301] [DEBUG] [LOCAL ] FDS: Trimmed 35640 records to 25360 (keeping 200 days of data) [2025-09-17T03:42:50.079070] [DEBUG] [LOCAL ] FDS: Primary data saved (25360 records). [2025-09-17T03:42:50.079406] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-17T03:42:50.079605] [INFO ] [MAIN ] Update Progress: 815/2369 symbols completed. FDS took 32.0s. Estimated remaining: 3h 46m 22s. Rate: 6.9 symbols/min [2025-09-17T03:42:50.253180] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:50.253413] [DEBUG] [LOCAL ] FERG: No existing data file found in primary storage. [2025-09-17T03:42:50.253464] [WARN ] [MAIN ] FERG: No existing data found, performing full refresh instead. [2025-09-17T03:42:50.253590] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-17T03:42:50.253671] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-17T03:42:50.253721] [DEBUG] [LOCAL ] FERG: No primary data file found to delete. [2025-09-17T03:42:50.253767] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-17T03:42:50.296285] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-11. [2025-09-17T03:42:50.629810] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:50.660836] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T03:42:50.675591] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-11 (0.38 seconds). [2025-09-17T03:42:51.090182] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-17T03:42:51.472620] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T03:42:51.890192] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-11. [2025-09-17T03:42:52.690144] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-17T03:42:52.776844] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T03:42:53.490181] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-17T03:42:53.663567] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T03:42:54.290132] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-17T03:42:54.512846] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T03:42:54.519258] [INFO ] [REMOTE ] FDX: Full fetch complete (74190 records). [2025-09-17T03:42:54.519440] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-17T03:42:54.914405] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-17T03:42:54.914517] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-17T03:42:54.915412] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-17T03:42:54.915495] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-17T03:42:54.916987] [DEBUG] [LOCAL ] FDX: Trimmed 74190 records to 51550 (keeping 200 days of data) [2025-09-17T03:42:55.110869] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-17T03:42:55.263632] [DEBUG] [LOCAL ] FDX: Primary data saved (51550 records). [2025-09-17T03:42:55.264127] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-17T03:42:55.264296] [INFO ] [MAIN ] Update Progress: 816/2369 symbols completed. FDX took 34.3s. Estimated remaining: 3h 46m 7s. Rate: 6.9 symbols/min [2025-09-17T03:42:55.444935] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:42:55.482095] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T03:42:55.499755] [DEBUG] [LOCAL ] FET: Loaded 9003 existing records from primary storage. [2025-09-17T03:42:55.499985] [INFO ] [MAIN ] FET: Loaded 9003 existing records. [2025-09-17T03:42:55.606152] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T03:42:55.690367] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:42:55.690762] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-17T03:42:55.690843] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-17T03:42:55.691299] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-17T03:42:55.691368] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-17T03:42:55.895569] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-17T03:42:56.068076] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:42:56.098269] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T03:42:56.429780] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T03:42:56.690137] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-11. [2025-09-17T03:42:57.490167] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-17T03:42:57.503748] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T03:42:57.929184] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T03:42:58.290162] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-17T03:42:59.090151] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-17T03:42:59.549899] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T03:42:59.890116] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-17T03:42:59.973971] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T03:43:00.231612] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T03:43:00.690188] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-17T03:43:01.490146] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-17T03:43:02.290133] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-17T03:43:02.525147] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T03:43:02.772503] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T03:43:03.090184] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-17T03:43:03.386536] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:43:03.437280] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T03:43:03.890241] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-17T03:43:04.690146] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-17T03:43:05.060497] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-17T03:43:05.490135] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-17T03:43:05.729236] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T03:43:05.865044] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-17T03:43:06.290140] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-17T03:43:07.090139] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-17T03:43:07.890146] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-17T03:43:07.955321] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T03:43:08.690209] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-17T03:43:08.913875] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:43:08.914319] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T03:43:09.490126] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-17T03:43:10.290128] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-17T03:43:10.593788] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:43:11.090213] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-17T03:43:11.208856] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T03:43:11.304103] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T03:43:11.890143] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-17T03:43:12.690156] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-17T03:43:12.813408] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T03:43:13.016841] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T03:43:13.490140] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-17T03:43:14.300681] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-17T03:43:14.327169] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T03:43:14.435322] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T03:43:14.685383] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T03:43:14.686530] [INFO ] [REMOTE ] FENG: Full fetch complete (2143 records). [2025-09-17T03:43:14.686630] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-17T03:43:14.935370] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T03:43:14.935661] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:43:14.935716] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:43:14.935763] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-17T03:43:14.935857] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-17T03:43:14.935905] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-17T03:43:14.935956] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-17T03:43:14.936036] [INFO ] [MAIN ] Update Progress: 817/2369 symbols completed. FENG took 26.0s. Estimated remaining: 3h 46m 19s. Rate: 6.9 symbols/min [2025-09-17T03:43:15.093907] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-17T03:43:15.113264] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:15.113482] [DEBUG] [LOCAL ] FF: No existing data file found in primary storage. [2025-09-17T03:43:15.113533] [WARN ] [MAIN ] FF: No existing data found, performing full refresh instead. [2025-09-17T03:43:15.113876] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-17T03:43:15.113925] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-17T03:43:15.113969] [DEBUG] [LOCAL ] FF: No primary data file found to delete. [2025-09-17T03:43:15.114007] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-17T03:43:15.473808] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:15.890153] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-11. [2025-09-17T03:43:16.690132] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-17T03:43:16.997274] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T03:43:17.311532] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:43:17.490136] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-17T03:43:18.290104] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-17T03:43:18.334749] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T03:43:18.695858] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T03:43:19.090124] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-17T03:43:19.890119] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-17T03:43:20.079830] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T03:43:20.323920] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T03:43:20.527335] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T03:43:20.690104] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-17T03:43:21.490136] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-17T03:43:21.538666] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T03:43:22.290196] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-17T03:43:22.643518] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:43:23.090159] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-17T03:43:23.890152] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-17T03:43:24.008508] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T03:43:24.018452] [INFO ] [REMOTE ] FE: Full fetch complete (77020 records). [2025-09-17T03:43:24.018709] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-17T03:43:24.464437] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-17T03:43:24.464590] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-17T03:43:24.465608] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-17T03:43:24.465696] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-17T03:43:24.467253] [DEBUG] [LOCAL ] FE: Trimmed 77020 records to 53453 (keeping 200 days of data) [2025-09-17T03:43:24.691682] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-17T03:43:24.724442] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T03:43:24.824365] [DEBUG] [LOCAL ] FE: Primary data saved (53453 records). [2025-09-17T03:43:24.824674] [INFO ] [MAIN ] FE: Full history saved. [2025-09-17T03:43:24.824806] [INFO ] [MAIN ] Update Progress: 818/2369 symbols completed. FE took 39.9s. Estimated remaining: 3h 46m 12s. Rate: 6.9 symbols/min [2025-09-17T03:43:25.033820] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:25.034635] [DEBUG] [LOCAL ] FFA: No existing data file found in primary storage. [2025-09-17T03:43:25.035628] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T03:43:25.035817] [WARN ] [MAIN ] FFA: No existing data found, performing full refresh instead. [2025-09-17T03:43:25.046035] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-17T03:43:25.046340] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-17T03:43:25.046515] [DEBUG] [LOCAL ] FFA: No primary data file found to delete. [2025-09-17T03:43:25.046573] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-17T03:43:25.433603] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:25.490106] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-17T03:43:25.661032] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T03:43:26.290181] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-17T03:43:26.507191] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T03:43:27.090153] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-11. [2025-09-17T03:43:27.658257] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T03:43:27.682024] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T03:43:27.890130] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-17T03:43:28.690139] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-17T03:43:29.207386] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T03:43:29.484287] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:43:29.493973] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-17T03:43:30.290148] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-17T03:43:30.774536] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T03:43:31.030945] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T03:43:31.090163] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-17T03:43:31.748739] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T03:43:31.890126] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-17T03:43:32.690149] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-17T03:43:33.472468] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T03:43:33.480057] [INFO ] [REMOTE ] FERG: Full fetch complete (70809 records). [2025-09-17T03:43:33.480215] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-17T03:43:33.495408] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-17T03:43:33.842461] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T03:43:33.898110] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-17T03:43:33.898520] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-17T03:43:33.899478] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-17T03:43:33.899552] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-17T03:43:33.900954] [DEBUG] [LOCAL ] FERG: Trimmed 70809 records to 49021 (keeping 200 days of data) [2025-09-17T03:43:34.215453] [DEBUG] [LOCAL ] FERG: Primary data saved (49021 records). [2025-09-17T03:43:34.215625] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-17T03:43:34.215742] [INFO ] [MAIN ] Update Progress: 819/2369 symbols completed. FERG took 44.1s. Estimated remaining: 3h 46m 5s. Rate: 6.9 symbols/min [2025-09-17T03:43:34.293075] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-17T03:43:34.336815] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T03:43:34.402453] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:34.402734] [DEBUG] [LOCAL ] FFC: No existing data file found in primary storage. [2025-09-17T03:43:34.402790] [WARN ] [MAIN ] FFC: No existing data found, performing full refresh instead. [2025-09-17T03:43:34.402919] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-17T03:43:34.402975] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-17T03:43:34.403025] [DEBUG] [LOCAL ] FFC: No primary data file found to delete. [2025-09-17T03:43:34.403069] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-17T03:43:34.759993] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:35.090139] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-11. [2025-09-17T03:43:35.228176] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T03:43:35.232093] [INFO ] [REMOTE ] FET: Full fetch complete (17843 records). [2025-09-17T03:43:35.232282] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-17T03:43:35.607523] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-17T03:43:35.607685] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-17T03:43:35.608229] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-17T03:43:35.608286] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-17T03:43:35.609232] [DEBUG] [LOCAL ] FET: Trimmed 17843 records to 12577 (keeping 200 days of data) [2025-09-17T03:43:35.692017] [DEBUG] [LOCAL ] FET: Primary data saved (12577 records). [2025-09-17T03:43:35.692256] [INFO ] [MAIN ] FET: Full history saved. [2025-09-17T03:43:35.692383] [INFO ] [MAIN ] Update Progress: 820/2369 symbols completed. FET took 40.4s. Estimated remaining: 3h 45m 42s. Rate: 6.9 symbols/min [2025-09-17T03:43:35.865944] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:35.866253] [DEBUG] [LOCAL ] FFWM: No existing data file found in primary storage. [2025-09-17T03:43:35.866309] [WARN ] [MAIN ] FFWM: No existing data found, performing full refresh instead. [2025-09-17T03:43:35.866478] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-17T03:43:35.866535] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-17T03:43:35.866596] [DEBUG] [LOCAL ] FFWM: No primary data file found to delete. [2025-09-17T03:43:35.866677] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-17T03:43:35.898070] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-17T03:43:36.238576] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:36.249760] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T03:43:36.690106] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-11. [2025-09-17T03:43:36.841510] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T03:43:37.490143] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-17T03:43:38.027683] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T03:43:38.290117] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-17T03:43:38.531802] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:43:38.950527] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T03:43:39.090117] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-17T03:43:39.692747] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T03:43:39.890140] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-17T03:43:40.485213] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:43:40.690155] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-17T03:43:41.490147] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-17T03:43:42.025583] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T03:43:42.126151] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T03:43:42.290170] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-17T03:43:42.879954] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T03:43:42.881176] [INFO ] [REMOTE ] FFA: Full fetch complete (8118 records). [2025-09-17T03:43:42.881262] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-17T03:43:43.095203] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-17T03:43:43.264371] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-17T03:43:43.264503] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-17T03:43:43.264763] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-17T03:43:43.264839] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-17T03:43:43.265310] [DEBUG] [LOCAL ] FFA: Trimmed 8118 records to 5581 (keeping 200 days of data) [2025-09-17T03:43:43.301796] [DEBUG] [LOCAL ] FFA: Primary data saved (5581 records). [2025-09-17T03:43:43.301945] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-17T03:43:43.302040] [INFO ] [MAIN ] Update Progress: 821/2369 symbols completed. FFA took 18.5s. Estimated remaining: 3h 45m 31s. Rate: 6.9 symbols/min [2025-09-17T03:43:43.485108] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:43.501704] [DEBUG] [LOCAL ] FG: Loaded 15335 existing records from primary storage. [2025-09-17T03:43:43.501859] [INFO ] [MAIN ] FG: Loaded 15335 existing records. [2025-09-17T03:43:43.686911] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:43:43.687157] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-17T03:43:43.687223] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-17T03:43:43.687773] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-17T03:43:43.687841] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-17T03:43:43.901274] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-17T03:43:44.058744] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:44.554384] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T03:43:44.690095] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-17T03:43:45.040579] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T03:43:45.490140] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-17T03:43:45.701773] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T03:43:46.290097] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-17T03:43:46.691064] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T03:43:47.090141] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-17T03:43:47.347953] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T03:43:47.890139] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-17T03:43:48.406055] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:43:48.690154] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-11. [2025-09-17T03:43:48.844878] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T03:43:49.473784] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T03:43:49.490094] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-17T03:43:50.290151] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-17T03:43:50.342243] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T03:43:51.090177] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-17T03:43:51.724964] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T03:43:51.783168] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:43:51.890211] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-17T03:43:52.690102] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-17T03:43:53.036737] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T03:43:53.490124] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-17T03:43:53.726734] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T03:43:54.290183] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-17T03:43:54.487880] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T03:43:54.491580] [INFO ] [REMOTE ] FF: Full fetch complete (37384 records). [2025-09-17T03:43:54.491704] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-17T03:43:54.863479] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-17T03:43:54.863581] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-17T03:43:54.864240] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-17T03:43:54.864320] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-17T03:43:54.865237] [DEBUG] [LOCAL ] FF: Trimmed 37384 records to 25945 (keeping 200 days of data) [2025-09-17T03:43:55.019318] [DEBUG] [LOCAL ] FF: Primary data saved (25945 records). [2025-09-17T03:43:55.019481] [INFO ] [MAIN ] FF: Full history saved. [2025-09-17T03:43:55.019567] [INFO ] [MAIN ] Update Progress: 822/2369 symbols completed. FF took 40.1s. Estimated remaining: 3h 45m 28s. Rate: 6.9 symbols/min [2025-09-17T03:43:55.095262] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-17T03:43:55.194494] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:43:55.199072] [DEBUG] [LOCAL ] FGN: Loaded 2748 existing records from primary storage. [2025-09-17T03:43:55.199168] [INFO ] [MAIN ] FGN: Loaded 2748 existing records. [2025-09-17T03:43:55.379933] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:43:55.380216] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-17T03:43:55.380281] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-17T03:43:55.380562] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-17T03:43:55.380635] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-17T03:43:55.734381] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:43:55.890302] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-17T03:43:55.890239] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T03:43:56.212526] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T03:43:56.426179] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T03:43:56.690147] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-17T03:43:57.490137] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-11. [2025-09-17T03:43:57.724955] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T03:43:57.822306] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T03:43:58.290138] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-17T03:43:58.949154] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T03:43:59.090131] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-17T03:43:59.890147] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-17T03:43:59.908409] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T03:44:00.690135] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-17T03:44:01.300518] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T03:44:01.490112] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-17T03:44:01.868609] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T03:44:02.080089] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T03:44:02.290146] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-17T03:44:03.090160] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-17T03:44:03.278073] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T03:44:03.890141] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-17T03:44:04.545752] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T03:44:04.690133] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-17T03:44:05.255346] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T03:44:05.490134] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-17T03:44:05.932900] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T03:44:06.058481] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T03:44:06.290141] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-17T03:44:06.892981] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T03:44:07.090146] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-17T03:44:07.890107] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-17T03:44:08.141860] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T03:44:08.690132] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-17T03:44:08.859238] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T03:44:08.861665] [INFO ] [REMOTE ] FFC: Full fetch complete (24709 records). [2025-09-17T03:44:08.861770] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-17T03:44:09.228290] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-17T03:44:09.228396] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-17T03:44:09.228937] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-17T03:44:09.229014] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-17T03:44:09.229800] [DEBUG] [LOCAL ] FFC: Trimmed 24709 records to 16522 (keeping 200 days of data) [2025-09-17T03:44:09.330454] [DEBUG] [LOCAL ] FFC: Primary data saved (16522 records). [2025-09-17T03:44:09.330656] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-17T03:44:09.330778] [INFO ] [MAIN ] Update Progress: 823/2369 symbols completed. FFC took 35.1s. Estimated remaining: 3h 45m 30s. Rate: 6.9 symbols/min [2025-09-17T03:44:09.498838] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:09.496311] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-17T03:44:09.504533] [DEBUG] [LOCAL ] FGSN: Loaded 3526 existing records from primary storage. [2025-09-17T03:44:09.504698] [INFO ] [MAIN ] FGSN: Loaded 3526 existing records. [2025-09-17T03:44:09.683743] [WARN ] [MAIN ] FGSN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:09.683986] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-17T03:44:09.684052] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-17T03:44:09.684334] [DEBUG] [LOCAL ] FGSN: Deleted primary data file. [2025-09-17T03:44:09.684394] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-17T03:44:10.049964] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:10.271556] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T03:44:10.290078] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-17T03:44:10.597842] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T03:44:11.090179] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-17T03:44:11.682356] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T03:44:11.699944] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T03:44:11.890164] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-17T03:44:12.458074] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T03:44:12.690179] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-17T03:44:13.490153] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-17T03:44:13.850887] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T03:44:14.123666] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T03:44:14.290183] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-11. [2025-09-17T03:44:14.507424] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:44:14.507818] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-11 [2025-09-17T03:44:15.090230] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-17T03:44:15.684943] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:44:15.890207] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-17T03:44:16.690157] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-17T03:44:16.809250] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T03:44:16.812073] [INFO ] [REMOTE ] FG: Full fetch complete (26644 records). [2025-09-17T03:44:16.812182] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-17T03:44:17.180856] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-17T03:44:17.180957] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-17T03:44:17.181376] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-17T03:44:17.181429] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-17T03:44:17.182260] [DEBUG] [LOCAL ] FG: Trimmed 26644 records to 22162 (keeping 200 days of data) [2025-09-17T03:44:17.323792] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T03:44:17.327505] [DEBUG] [LOCAL ] FG: Primary data saved (22162 records). [2025-09-17T03:44:17.327677] [INFO ] [MAIN ] FG: Full history saved. [2025-09-17T03:44:17.327781] [INFO ] [MAIN ] Update Progress: 824/2369 symbols completed. FG took 34.0s. Estimated remaining: 3h 45m 20s. Rate: 6.9 symbols/min [2025-09-17T03:44:17.495100] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-17T03:44:17.496879] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:17.535152] [DEBUG] [LOCAL ] FHI: Loaded 30062 existing records from primary storage. [2025-09-17T03:44:17.535325] [INFO ] [MAIN ] FHI: Loaded 30062 existing records. [2025-09-17T03:44:17.718096] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:44:17.718236] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:17.718756] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-17T03:44:17.718843] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-17T03:44:17.719412] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-17T03:44:17.720620] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-17T03:44:17.720704] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-17T03:44:18.070680] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:18.290134] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-17T03:44:18.771972] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T03:44:18.772947] [INFO ] [REMOTE ] FGN: Full fetch complete (5803 records). [2025-09-17T03:44:18.773030] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-17T03:44:19.095309] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-17T03:44:19.191878] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-17T03:44:19.192005] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-17T03:44:19.192235] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-17T03:44:19.192308] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-17T03:44:19.192897] [DEBUG] [LOCAL ] FGN: Trimmed 5803 records to 4076 (keeping 200 days of data) [2025-09-17T03:44:19.220335] [DEBUG] [LOCAL ] FGN: Primary data saved (4076 records). [2025-09-17T03:44:19.220536] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-17T03:44:19.220700] [INFO ] [MAIN ] Update Progress: 825/2369 symbols completed. FGN took 24.2s. Estimated remaining: 3h 44m 58s. Rate: 6.9 symbols/min [2025-09-17T03:44:19.390426] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:19.431256] [DEBUG] [LOCAL ] FHN: Loaded 39754 existing records from primary storage. [2025-09-17T03:44:19.431431] [INFO ] [MAIN ] FHN: Loaded 39754 existing records. [2025-09-17T03:44:19.609738] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:19.609981] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-17T03:44:19.610034] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-17T03:44:19.611084] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-17T03:44:19.611150] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-17T03:44:19.900247] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-17T03:44:19.984924] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:19.993295] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T03:44:20.690134] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-17T03:44:20.832951] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T03:44:20.837760] [INFO ] [REMOTE ] FFWM: Full fetch complete (51432 records). [2025-09-17T03:44:20.837903] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-17T03:44:21.228793] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-17T03:44:21.228915] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-17T03:44:21.229697] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-17T03:44:21.229766] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-17T03:44:21.230990] [DEBUG] [LOCAL ] FFWM: Trimmed 51432 records to 36298 (keeping 200 days of data) [2025-09-17T03:44:21.419532] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T03:44:21.449450] [DEBUG] [LOCAL ] FFWM: Primary data saved (36298 records). [2025-09-17T03:44:21.449620] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-17T03:44:21.449736] [INFO ] [MAIN ] Update Progress: 826/2369 symbols completed. FFWM took 45.8s. Estimated remaining: 3h 44m 37s. Rate: 6.9 symbols/min [2025-09-17T03:44:21.498144] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-11. [2025-09-17T03:44:21.633847] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:21.674200] [DEBUG] [LOCAL ] FI: Loaded 39987 existing records from primary storage. [2025-09-17T03:44:21.674382] [INFO ] [MAIN ] FI: Loaded 39987 existing records. [2025-09-17T03:44:21.860029] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:21.860301] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-17T03:44:21.860364] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-17T03:44:21.861319] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-17T03:44:21.861384] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-17T03:44:22.227112] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:22.290139] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-11. [2025-09-17T03:44:22.913956] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T03:44:23.090135] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-17T03:44:23.694398] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T03:44:23.890126] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-17T03:44:24.042209] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:44:24.690155] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-17T03:44:25.337704] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-17T03:44:25.360170] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:44:25.490192] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-17T03:44:26.290174] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-17T03:44:26.840923] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T03:44:27.090176] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-17T03:44:27.253214] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T03:44:27.890157] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-11. [2025-09-17T03:44:28.291414] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T03:44:28.690224] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-17T03:44:29.309325] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T03:44:29.490383] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-17T03:44:29.780202] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T03:44:30.290150] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-17T03:44:31.090190] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-17T03:44:31.367901] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T03:44:31.743427] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:44:31.890143] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-17T03:44:32.690166] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-17T03:44:32.897530] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T03:44:33.288705] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:44:33.490142] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-17T03:44:33.589443] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T03:44:34.080227] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T03:44:34.290199] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-17T03:44:35.090149] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-17T03:44:35.494897] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T03:44:35.496566] [INFO ] [REMOTE ] FGSN: Full fetch complete (7409 records). [2025-09-17T03:44:35.496715] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-17T03:44:35.683225] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-17T03:44:35.683465] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:44:35.683518] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:44:35.683560] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-17T03:44:35.683633] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-17T03:44:35.683698] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-17T03:44:35.684109] [DEBUG] [LOCAL ] FGSN: Deleted derivative data file. [2025-09-17T03:44:35.684208] [INFO ] [MAIN ] Update Progress: 827/2369 symbols completed. FGSN took 26.4s. Estimated remaining: 3h 44m 39s. Rate: 6.9 symbols/min [2025-09-17T03:44:35.850731] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:35.867834] [DEBUG] [LOCAL ] FICO: Loaded 16209 existing records from primary storage. [2025-09-17T03:44:35.867985] [INFO ] [MAIN ] FICO: Loaded 16209 existing records. [2025-09-17T03:44:35.898225] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-17T03:44:36.074168] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:36.074575] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-17T03:44:36.074721] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-17T03:44:36.075382] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-17T03:44:36.075528] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-17T03:44:36.395130] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T03:44:36.494545] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:36.690130] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-11. [2025-09-17T03:44:37.490152] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-17T03:44:37.614520] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T03:44:37.632026] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T03:44:38.290166] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-17T03:44:39.090142] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-17T03:44:39.217064] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T03:44:39.344691] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T03:44:39.890145] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-17T03:44:40.399604] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T03:44:40.690144] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-17T03:44:41.026676] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T03:44:41.490177] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-17T03:44:42.290175] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-17T03:44:42.530571] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T03:44:43.050153] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T03:44:43.090127] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-17T03:44:43.432373] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T03:44:43.890139] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-17T03:44:44.690158] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-17T03:44:44.831568] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T03:44:45.056271] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T03:44:45.490202] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-17T03:44:46.290191] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-17T03:44:46.622779] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T03:44:46.697115] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T03:44:47.090158] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-17T03:44:47.890152] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-17T03:44:48.302966] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T03:44:48.611158] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T03:44:48.690141] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-17T03:44:49.118394] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T03:44:49.490206] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-17T03:44:50.011075] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T03:44:50.227747] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T03:44:50.290144] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-17T03:44:51.090127] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-17T03:44:51.812343] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T03:44:51.890150] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-17T03:44:52.690134] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-17T03:44:53.101119] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T03:44:53.490174] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-17T03:44:53.666107] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T03:44:54.057408] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T03:44:54.290218] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-17T03:44:55.090112] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-17T03:44:55.330267] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T03:44:55.332944] [INFO ] [REMOTE ] FICO: Full fetch complete (27944 records). [2025-09-17T03:44:55.333045] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-17T03:44:55.763287] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-17T03:44:55.761700] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-17T03:44:55.763446] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-17T03:44:55.774230] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-17T03:44:55.774583] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-17T03:44:55.775855] [DEBUG] [LOCAL ] FICO: Trimmed 27944 records to 20354 (keeping 200 days of data) [2025-09-17T03:44:55.891437] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-17T03:44:55.907403] [DEBUG] [LOCAL ] FICO: Primary data saved (20354 records). [2025-09-17T03:44:55.907523] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-17T03:44:55.907612] [INFO ] [MAIN ] Update Progress: 828/2369 symbols completed. FICO took 20.2s. Estimated remaining: 3h 44m 51s. Rate: 6.9 symbols/min [2025-09-17T03:44:56.078115] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:56.078311] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-17T03:44:56.078362] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-17T03:44:56.078468] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-17T03:44:56.078513] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-17T03:44:56.078559] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-17T03:44:56.078604] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-17T03:44:56.439905] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:56.620537] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T03:44:56.690078] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-17T03:44:57.490157] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-17T03:44:57.656872] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T03:44:57.817974] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T03:44:57.822534] [INFO ] [REMOTE ] FHI: Full fetch complete (57483 records). [2025-09-17T03:44:57.822694] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-17T03:44:58.206744] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-17T03:44:58.206856] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-17T03:44:58.207620] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-17T03:44:58.207713] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-17T03:44:58.209284] [DEBUG] [LOCAL ] FHI: Trimmed 57483 records to 40817 (keeping 200 days of data) [2025-09-17T03:44:58.306263] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-11. [2025-09-17T03:44:58.465676] [DEBUG] [LOCAL ] FHI: Primary data saved (40817 records). [2025-09-17T03:44:58.465827] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-17T03:44:58.465938] [INFO ] [MAIN ] Update Progress: 829/2369 symbols completed. FHI took 41.1s. Estimated remaining: 3h 44m 31s. Rate: 6.9 symbols/min [2025-09-17T03:44:58.634678] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:44:58.674544] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T03:44:58.675346] [DEBUG] [LOCAL ] FIGS: Loaded 36336 existing records from primary storage. [2025-09-17T03:44:58.676768] [INFO ] [MAIN ] FIGS: Loaded 36336 existing records. [2025-09-17T03:44:58.853779] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:44:58.854046] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-17T03:44:58.854111] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-17T03:44:58.854936] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-17T03:44:58.855006] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-17T03:44:59.098546] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-17T03:44:59.222337] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:44:59.696928] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T03:44:59.890090] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-17T03:45:00.690181] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-17T03:45:00.895882] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T03:45:01.052408] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T03:45:01.490157] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-11. [2025-09-17T03:45:02.182825] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T03:45:02.290172] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-17T03:45:03.090150] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-17T03:45:03.890131] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-17T03:45:04.930142] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-17T03:45:04.931025] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-17T03:45:05.552872] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-11 (4.06 seconds). [2025-09-17T03:45:05.563065] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-17T03:45:05.622133] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T03:45:06.290186] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-17T03:45:06.335655] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (3.25 seconds). [2025-09-17T03:45:06.369699] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-17T03:45:06.376403] [INFO ] [REMOTE ] FI: Full fetch complete (76974 records). [2025-09-17T03:45:06.376621] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-17T03:45:06.647704] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T03:45:06.776178] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-17T03:45:06.776281] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-17T03:45:06.777168] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-17T03:45:06.777228] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-17T03:45:06.778698] [DEBUG] [LOCAL ] FI: Trimmed 76974 records to 53496 (keeping 200 days of data) [2025-09-17T03:45:07.095574] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-17T03:45:07.111816] [DEBUG] [LOCAL ] FI: Primary data saved (53496 records). [2025-09-17T03:45:07.111981] [INFO ] [MAIN ] FI: Full history saved. [2025-09-17T03:45:07.112092] [INFO ] [MAIN ] Update Progress: 830/2369 symbols completed. FI took 45.7s. Estimated remaining: 3h 44m 22s. Rate: 6.9 symbols/min [2025-09-17T03:45:07.282981] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:07.311882] [DEBUG] [LOCAL ] FIHL: Loaded 28860 existing records from primary storage. [2025-09-17T03:45:07.312052] [INFO ] [MAIN ] FIHL: Loaded 28860 existing records. [2025-09-17T03:45:07.492093] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:07.495371] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-17T03:45:07.495892] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-17T03:45:07.496045] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-17T03:45:07.497749] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-17T03:45:07.497870] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-17T03:45:07.795351] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-17T03:45:07.906084] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:07.901607] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-17T03:45:08.268029] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-17T03:45:08.690163] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-11. [2025-09-17T03:45:09.490148] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-17T03:45:10.064768] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T03:45:10.290185] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-17T03:45:10.523903] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:10.524247] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-17T03:45:11.090194] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-17T03:45:11.218467] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T03:45:11.436040] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T03:45:11.890188] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-17T03:45:12.690150] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-17T03:45:13.490136] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-17T03:45:14.132459] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T03:45:14.290102] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-17T03:45:14.566455] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-17T03:45:14.765276] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:45:14.771896] [INFO ] [REMOTE ] FHN: Full fetch complete (77098 records). [2025-09-17T03:45:14.772078] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-17T03:45:15.105962] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-17T03:45:15.166600] [DEBUG] [VALIDATOR ] FHN: All expected trading days are present. [2025-09-17T03:45:15.166804] [DEBUG] [VALIDATOR ] FHN: Primary data validation passed. [2025-09-17T03:45:15.168305] [INFO ] [MAIN ] FHN: Fetched primary data is valid. [2025-09-17T03:45:15.168431] [DEBUG] [LOCAL ] FHN: Saving primary data. [2025-09-17T03:45:15.170787] [DEBUG] [LOCAL ] FHN: Trimmed 77098 records to 53367 (keeping 200 days of data) [2025-09-17T03:45:15.524275] [DEBUG] [LOCAL ] FHN: Primary data saved (53367 records). [2025-09-17T03:45:15.524534] [INFO ] [MAIN ] FHN: Full history saved. [2025-09-17T03:45:15.524690] [INFO ] [MAIN ] Update Progress: 831/2369 symbols completed. FHN took 56.3s. Estimated remaining: 3h 44m 13s. Rate: 6.9 symbols/min [2025-09-17T03:45:15.700716] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:15.721345] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T03:45:15.732293] [DEBUG] [LOCAL ] FINS: Loaded 6435 existing records from primary storage. [2025-09-17T03:45:15.732489] [INFO ] [MAIN ] FINS: Loaded 6435 existing records. [2025-09-17T03:45:15.895267] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-17T03:45:15.925750] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:15.926084] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-17T03:45:15.926164] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-17T03:45:15.926506] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-17T03:45:15.926568] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-17T03:45:16.289762] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:16.696213] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-17T03:45:16.701427] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T03:45:17.490137] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-11. [2025-09-17T03:45:18.066439] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T03:45:18.290129] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-17T03:45:18.377019] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T03:45:18.579407] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.68 seconds). [2025-09-17T03:45:18.585748] [INFO ] [REMOTE ] FIG: Full fetch complete (13090 records). [2025-09-17T03:45:18.585844] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-17T03:45:18.767252] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-17T03:45:18.767556] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:45:18.767611] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:45:18.767676] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-17T03:45:18.767742] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-17T03:45:18.767788] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-17T03:45:18.767853] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-17T03:45:18.767926] [INFO ] [MAIN ] Update Progress: 832/2369 symbols completed. FIG took 22.9s. Estimated remaining: 3h 43m 54s. Rate: 6.9 symbols/min [2025-09-17T03:45:18.936743] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:18.967810] [DEBUG] [LOCAL ] FINV: Loaded 33313 existing records from primary storage. [2025-09-17T03:45:18.967998] [INFO ] [MAIN ] FINV: Loaded 33313 existing records. [2025-09-17T03:45:19.099367] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-17T03:45:19.177196] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:19.177463] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-17T03:45:19.177537] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-17T03:45:19.178227] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-17T03:45:19.178293] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-17T03:45:19.532072] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:19.726982] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T03:45:19.890126] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-17T03:45:20.690132] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-17T03:45:20.900503] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T03:45:21.350245] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T03:45:21.438178] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T03:45:21.490142] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-17T03:45:22.290132] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-17T03:45:23.090138] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-11. [2025-09-17T03:45:23.852381] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-17T03:45:23.890099] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-17T03:45:23.962165] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T03:45:24.690142] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-17T03:45:24.877447] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T03:45:25.415131] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T03:45:25.490129] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-17T03:45:25.547010] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T03:45:26.108287] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T03:45:26.290193] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-17T03:45:27.090283] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-17T03:45:27.873042] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T03:45:27.890149] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-17T03:45:27.930943] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T03:45:28.690176] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-17T03:45:29.362394] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T03:45:29.490160] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-17T03:45:30.170978] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T03:45:30.290123] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-17T03:45:31.029937] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T03:45:31.090089] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-17T03:45:31.146622] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T03:45:31.890168] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-17T03:45:32.547122] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:45:32.690166] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-17T03:45:32.710416] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T03:45:33.490168] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-17T03:45:34.184038] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T03:45:34.290183] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-17T03:45:34.297627] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T03:45:35.090153] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-17T03:45:35.881152] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:45:35.890468] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-17T03:45:36.613528] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T03:45:36.690209] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-17T03:45:36.795387] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T03:45:37.490187] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-17T03:45:38.294318] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-17T03:45:38.299123] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T03:45:39.090161] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-17T03:45:39.208579] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T03:45:39.890189] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-17T03:45:39.921833] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T03:45:40.439293] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T03:45:40.444925] [INFO ] [REMOTE ] FIHL: Full fetch complete (55402 records). [2025-09-17T03:45:40.445107] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-17T03:45:40.695173] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-17T03:45:40.860253] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-17T03:45:40.860372] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-17T03:45:40.861200] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-17T03:45:40.861263] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-17T03:45:40.862517] [DEBUG] [LOCAL ] FIHL: Trimmed 55402 records to 40510 (keeping 200 days of data) [2025-09-17T03:45:41.123578] [DEBUG] [LOCAL ] FIHL: Primary data saved (40510 records). [2025-09-17T03:45:41.123759] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-17T03:45:41.123872] [INFO ] [MAIN ] Update Progress: 833/2369 symbols completed. FIHL took 34.0s. Estimated remaining: 3h 44m 10s. Rate: 6.9 symbols/min [2025-09-17T03:45:41.308691] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:41.349235] [DEBUG] [LOCAL ] FIS: Loaded 39736 existing records from primary storage. [2025-09-17T03:45:41.349446] [INFO ] [MAIN ] FIS: Loaded 39736 existing records. [2025-09-17T03:45:41.485667] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T03:45:41.490943] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-17T03:45:41.537796] [INFO ] [REMOTE ] FINS: Full fetch complete (12903 records). [2025-09-17T03:45:41.560725] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-17T03:45:41.560615] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:41.589496] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-17T03:45:41.615365] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-17T03:45:41.627061] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-17T03:45:41.651190] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-17T03:45:41.738543] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T03:45:41.871719] [INFO ] [REMOTE ] FIGS: Full fetch complete (71051 records). [2025-09-17T03:45:42.000763] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-17T03:45:42.490477] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-17T03:45:42.546637] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:42.560515] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-17T03:45:42.631412] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-17T03:45:42.636966] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-11. [2025-09-17T03:45:42.661363] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-17T03:45:42.675301] [DEBUG] [LOCAL ] FINS: Trimmed 12903 records to 8211 (keeping 200 days of data) [2025-09-17T03:45:42.818287] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-17T03:45:42.823421] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-17T03:45:42.826986] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-17T03:45:42.830494] [DEBUG] [LOCAL ] FINS: Primary data saved (8211 records). [2025-09-17T03:45:42.830656] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-17T03:45:42.830711] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-17T03:45:42.831040] [INFO ] [MAIN ] Update Progress: 834/2369 symbols completed. FINS took 27.3s. Estimated remaining: 3h 43m 49s. Rate: 6.9 symbols/min [2025-09-17T03:45:42.938873] [DEBUG] [LOCAL ] FIGS: Trimmed 71051 records to 49138 (keeping 200 days of data) [2025-09-17T03:45:43.096211] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:43.128514] [DEBUG] [LOCAL ] FIX: Loaded 21252 existing records from primary storage. [2025-09-17T03:45:43.130534] [INFO ] [MAIN ] FIX: Loaded 21252 existing records. [2025-09-17T03:45:43.336207] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:43.338981] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-17T03:45:43.339075] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-17T03:45:43.341933] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-17T03:45:43.345708] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-17T03:45:43.848626] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:43.856489] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-11. [2025-09-17T03:45:43.875716] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-17T03:45:43.913925] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-17T03:45:43.949170] [DEBUG] [LOCAL ] FIGS: Primary data saved (49138 records). [2025-09-17T03:45:43.949329] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-17T03:45:43.949479] [INFO ] [MAIN ] Update Progress: 835/2369 symbols completed. FIGS took 45.5s. Estimated remaining: 3h 43m 26s. Rate: 6.9 symbols/min [2025-09-17T03:45:44.125544] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:44.125823] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-17T03:45:44.125876] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-17T03:45:44.125985] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-17T03:45:44.126036] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-17T03:45:44.126083] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-17T03:45:44.126124] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-17T03:45:44.507877] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:44.540321] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T03:45:44.690126] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-17T03:45:45.369156] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T03:45:45.456967] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T03:45:45.490152] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-17T03:45:46.290173] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-17T03:45:46.619162] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T03:45:47.052140] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:45:47.090069] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-17T03:45:47.324576] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T03:45:47.890131] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-11. [2025-09-17T03:45:48.103610] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:48.104029] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-11 [2025-09-17T03:45:48.690131] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-17T03:45:48.824665] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T03:45:49.490153] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-17T03:45:49.710360] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:49.710715] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-17T03:45:50.290138] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-17T03:45:50.412437] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T03:45:50.508113] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:50.508434] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-17T03:45:51.090146] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-17T03:45:51.890193] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-17T03:45:52.096093] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:52.096451] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-17T03:45:52.690155] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-17T03:45:52.892942] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:45:53.490189] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-17T03:45:54.290194] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-17T03:45:54.518317] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T03:45:55.090173] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-17T03:45:55.438921] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T03:45:55.865091] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T03:45:55.890105] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-17T03:45:56.107079] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:56.107321] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-17T03:45:56.367902] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:45:56.374787] [INFO ] [REMOTE ] FINV: Full fetch complete (63345 records). [2025-09-17T03:45:56.374932] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-17T03:45:56.695375] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-17T03:45:56.764124] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-17T03:45:56.764235] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-17T03:45:56.765190] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-17T03:45:56.765321] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-17T03:45:56.766931] [DEBUG] [LOCAL ] FINV: Trimmed 63345 records to 44869 (keeping 200 days of data) [2025-09-17T03:45:57.032766] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:57.034146] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-17T03:45:57.038516] [DEBUG] [LOCAL ] FINV: Primary data saved (44869 records). [2025-09-17T03:45:57.038596] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-17T03:45:57.038725] [INFO ] [MAIN ] Update Progress: 836/2369 symbols completed. FINV took 38.3s. Estimated remaining: 3h 43m 25s. Rate: 6.9 symbols/min [2025-09-17T03:45:57.216481] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:45:57.224136] [DEBUG] [LOCAL ] FLC: Loaded 3942 existing records from primary storage. [2025-09-17T03:45:57.224292] [INFO ] [MAIN ] FLC: Loaded 3942 existing records. [2025-09-17T03:45:57.406011] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:45:57.406261] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-17T03:45:57.406322] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-17T03:45:57.406559] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-17T03:45:57.406627] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-17T03:45:57.495292] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-17T03:45:57.771148] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:45:58.290146] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-17T03:45:58.512116] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:45:58.512466] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-17T03:45:59.090181] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-11. [2025-09-17T03:45:59.457285] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T03:45:59.814282] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T03:45:59.890151] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-17T03:46:00.690170] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-17T03:46:01.490132] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-17T03:46:01.767899] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T03:46:02.057419] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T03:46:02.295532] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-17T03:46:02.310713] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T03:46:03.031937] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T03:46:03.090168] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-17T03:46:03.694500] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T03:46:03.890124] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-17T03:46:04.350354] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T03:46:04.690162] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-17T03:46:05.173671] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T03:46:05.174921] [INFO ] [REMOTE ] FIXT: Full fetch complete (1654 records). [2025-09-17T03:46:05.175020] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-17T03:46:05.372225] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 64 unique days, need 200 days [2025-09-17T03:46:05.372467] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:46:05.372531] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:46:05.372598] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-17T03:46:05.372698] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-17T03:46:05.372755] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-17T03:46:05.372811] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-17T03:46:05.372900] [INFO ] [MAIN ] Update Progress: 837/2369 symbols completed. FIXT took 21.4s. Estimated remaining: 3h 43m 15s. Rate: 6.9 symbols/min [2025-09-17T03:46:05.490167] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-17T03:46:06.118134] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T03:46:06.290147] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-17T03:46:07.090136] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-17T03:46:07.890160] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-17T03:46:08.034549] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T03:46:08.505261] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T03:46:08.690173] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-17T03:46:08.784616] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T03:46:09.490201] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-17T03:46:10.146735] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T03:46:10.290170] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-17T03:46:10.648038] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T03:46:11.090132] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-17T03:46:11.835813] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T03:46:11.890115] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-17T03:46:11.942699] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T03:46:12.547842] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T03:46:12.690178] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-17T03:46:13.324504] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T03:46:13.490132] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-17T03:46:14.290202] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-17T03:46:14.982317] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T03:46:15.090164] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-17T03:46:15.271870] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T03:46:15.890179] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-17T03:46:16.558759] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T03:46:16.570249] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T03:46:16.690125] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-17T03:46:17.490117] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-17T03:46:17.950892] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T03:46:18.290159] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-17T03:46:19.090182] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-17T03:46:19.166842] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T03:46:19.181995] [INFO ] [REMOTE ] FIS: Full fetch complete (76998 records). [2025-09-17T03:46:19.183068] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-17T03:46:19.634302] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T03:46:19.714134] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T03:46:19.718310] [INFO ] [REMOTE ] FLC: Full fetch complete (8178 records). [2025-09-17T03:46:19.738106] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-17T03:46:19.898221] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-17T03:46:19.994427] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-17T03:46:19.994635] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-17T03:46:19.996026] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-17T03:46:20.017303] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-17T03:46:20.113202] [DEBUG] [LOCAL ] FIS: Trimmed 76998 records to 53373 (keeping 200 days of data) [2025-09-17T03:46:20.413392] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-17T03:46:20.414728] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-17T03:46:20.416043] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-17T03:46:20.416551] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-17T03:46:20.418840] [DEBUG] [LOCAL ] FLC: Trimmed 8178 records to 5733 (keeping 200 days of data) [2025-09-17T03:46:20.466816] [DEBUG] [LOCAL ] FLC: Primary data saved (5733 records). [2025-09-17T03:46:20.468162] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-17T03:46:20.468750] [INFO ] [MAIN ] Update Progress: 838/2369 symbols completed. FLC took 23.4s. Estimated remaining: 3h 43m 18s. Rate: 6.9 symbols/min [2025-09-17T03:46:20.693801] [DEBUG] [LOCAL ] FIS: Primary data saved (53373 records). [2025-09-17T03:46:20.693989] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-17T03:46:20.694142] [INFO ] [MAIN ] Update Progress: 839/2369 symbols completed. FIS took 39.6s. Estimated remaining: 3h 42m 54s. Rate: 6.9 symbols/min [2025-09-17T03:46:21.303115] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T03:46:21.309737] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-17T03:46:22.591505] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:46:22.596580] [INFO ] [REMOTE ] FIX: Full fetch complete (45740 records). [2025-09-17T03:46:22.596713] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-17T03:46:22.981363] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-17T03:46:22.981505] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-17T03:46:22.982267] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-17T03:46:22.982334] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-17T03:46:22.983795] [DEBUG] [LOCAL ] FIX: Trimmed 45740 records to 31072 (keeping 200 days of data) [2025-09-17T03:46:23.194125] [DEBUG] [LOCAL ] FIX: Primary data saved (31072 records). [2025-09-17T03:46:23.194301] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-17T03:46:23.194421] [INFO ] [MAIN ] Update Progress: 840/2369 symbols completed. FIX took 40.4s. Estimated remaining: 3h 42m 34s. Rate: 6.9 symbols/min [2025-09-17T03:46:23.740441] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:23.799623] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:23.875521] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:23.897349] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:23.935623] [DEBUG] [LOCAL ] FLNG: Loaded 25121 existing records from primary storage. [2025-09-17T03:46:23.944518] [INFO ] [MAIN ] FLNG: Loaded 25121 existing records. [2025-09-17T03:46:23.945451] [DEBUG] [LOCAL ] FLOC: Loaded 20716 existing records from primary storage. [2025-09-17T03:46:23.967863] [INFO ] [MAIN ] FLOC: Loaded 20716 existing records. [2025-09-17T03:46:24.014909] [DEBUG] [LOCAL ] FLO: Loaded 38799 existing records from primary storage. [2025-09-17T03:46:24.058658] [INFO ] [MAIN ] FLO: Loaded 38799 existing records. [2025-09-17T03:46:24.319253] [DEBUG] [LOCAL ] FLG: Loaded 39734 existing records from primary storage. [2025-09-17T03:46:24.428265] [WARN ] [MAIN ] FLOC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:24.457400] [INFO ] [MAIN ] FLG: Loaded 39734 existing records. [2025-09-17T03:46:24.457449] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-17T03:46:24.460272] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:24.465600] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-17T03:46:24.525198] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-17T03:46:24.563729] [DEBUG] [LOCAL ] FLOC: Deleted primary data file. [2025-09-17T03:46:24.570940] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-17T03:46:24.600843] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:24.600888] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-17T03:46:24.627723] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-17T03:46:24.606790] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-17T03:46:24.654122] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-17T03:46:24.653995] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-17T03:46:24.741838] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-17T03:46:24.788876] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-17T03:46:24.955597] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:25.086342] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-17T03:46:25.086467] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-17T03:46:25.140458] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-17T03:46:25.211592] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-17T03:46:25.704088] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:25.768769] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-11. [2025-09-17T03:46:26.102128] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:26.143668] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:46:26.180001] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-11. [2025-09-17T03:46:26.179683] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-11 [2025-09-17T03:46:26.179054] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:26.196840] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-11. [2025-09-17T03:46:26.232239] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-17T03:46:26.266074] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:26.267827] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-11. [2025-09-17T03:46:26.501259] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T03:46:26.501604] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-17T03:46:26.502045] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-17T03:46:27.644986] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T03:46:27.649757] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-17T03:46:27.689912] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T03:46:27.697354] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-17T03:46:27.816562] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T03:46:27.890131] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-17T03:46:28.157309] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T03:46:28.573935] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T03:46:28.690102] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-17T03:46:28.851139] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T03:46:29.339787] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T03:46:29.490096] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-17T03:46:30.080908] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T03:46:30.290159] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-17T03:46:31.090174] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-17T03:46:31.468377] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T03:46:31.496490] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T03:46:31.890153] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-17T03:46:32.562596] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T03:46:32.690127] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-17T03:46:33.229912] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T03:46:33.490112] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-17T03:46:34.290269] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-17T03:46:34.526810] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T03:46:35.090150] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-17T03:46:35.274596] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T03:46:35.830064] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T03:46:35.890133] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-17T03:46:36.010068] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T03:46:36.690179] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-17T03:46:37.490142] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-17T03:46:37.647842] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T03:46:38.242402] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T03:46:38.290089] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-17T03:46:39.090176] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-17T03:46:39.359005] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T03:46:39.705388] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T03:46:39.890134] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-17T03:46:40.538607] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T03:46:40.690149] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-17T03:46:41.490133] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-17T03:46:41.856445] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T03:46:41.884485] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T03:46:42.290159] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-17T03:46:42.807334] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T03:46:43.090138] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-17T03:46:43.890171] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-17T03:46:44.226211] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:46:44.500386] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T03:46:44.690201] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-17T03:46:45.270774] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T03:46:45.490176] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-17T03:46:45.889775] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T03:46:46.290190] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-17T03:46:47.090112] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-17T03:46:47.132324] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T03:46:47.890134] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-17T03:46:48.016553] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T03:46:48.566994] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T03:46:48.690111] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-17T03:46:48.940391] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T03:46:48.943939] [INFO ] [REMOTE ] FLOC: Full fetch complete (36154 records). [2025-09-17T03:46:48.944066] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-17T03:46:49.141520] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-17T03:46:49.143755] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:46:49.143972] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:46:49.144030] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-17T03:46:49.144132] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-17T03:46:49.144183] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-17T03:46:49.144514] [DEBUG] [LOCAL ] FLOC: Deleted derivative data file. [2025-09-17T03:46:49.144678] [INFO ] [MAIN ] Update Progress: 841/2369 symbols completed. FLOC took 25.9s. Estimated remaining: 3h 42m 57s. Rate: 6.9 symbols/min [2025-09-17T03:46:49.317939] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:49.358069] [DEBUG] [LOCAL ] FLR: Loaded 39691 existing records from primary storage. [2025-09-17T03:46:49.358257] [INFO ] [MAIN ] FLR: Loaded 39691 existing records. [2025-09-17T03:46:49.502782] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-17T03:46:49.543244] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:49.544037] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-17T03:46:49.544100] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-17T03:46:49.544998] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-17T03:46:49.545064] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-17T03:46:49.902721] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:50.104237] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T03:46:50.109701] [INFO ] [REMOTE ] FLNG: Full fetch complete (50843 records). [2025-09-17T03:46:50.109831] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-17T03:46:50.294607] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-17T03:46:50.497725] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-17T03:46:50.497843] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-17T03:46:50.498567] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-17T03:46:50.498658] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-17T03:46:50.499820] [DEBUG] [LOCAL ] FLNG: Trimmed 50843 records to 34281 (keeping 200 days of data) [2025-09-17T03:46:50.711809] [DEBUG] [LOCAL ] FLNG: Primary data saved (34281 records). [2025-09-17T03:46:50.712000] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-17T03:46:50.712130] [INFO ] [MAIN ] Update Progress: 842/2369 symbols completed. FLNG took 27.5s. Estimated remaining: 3h 42m 35s. Rate: 6.9 symbols/min [2025-09-17T03:46:50.882026] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:46:50.916540] [DEBUG] [LOCAL ] FLS: Loaded 37213 existing records from primary storage. [2025-09-17T03:46:50.916742] [INFO ] [MAIN ] FLS: Loaded 37213 existing records. [2025-09-17T03:46:51.097719] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-11. [2025-09-17T03:46:51.128752] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:46:51.128918] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-17T03:46:51.128978] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-17T03:46:51.129888] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-17T03:46:51.129954] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-17T03:46:51.510692] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:46:51.545942] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T03:46:51.890122] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-11. [2025-09-17T03:46:52.245722] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T03:46:52.674106] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T03:46:52.690073] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-17T03:46:53.490138] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-17T03:46:53.651173] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T03:46:54.099820] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T03:46:54.290150] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-17T03:46:54.999262] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T03:46:55.090134] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-17T03:46:55.890112] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-17T03:46:55.974946] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T03:46:56.690138] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-17T03:46:56.852944] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:46:57.262565] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T03:46:57.490147] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-17T03:46:58.290132] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-17T03:46:58.380668] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T03:46:59.090155] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-17T03:46:59.224578] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T03:46:59.233013] [INFO ] [REMOTE ] FLG: Full fetch complete (77150 records). [2025-09-17T03:46:59.233292] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-17T03:46:59.657141] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-17T03:46:59.657306] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-17T03:46:59.658613] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-17T03:46:59.658715] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-17T03:46:59.660891] [DEBUG] [LOCAL ] FLG: Trimmed 77150 records to 53342 (keeping 200 days of data) [2025-09-17T03:46:59.900674] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-17T03:47:00.040535] [DEBUG] [LOCAL ] FLG: Primary data saved (53342 records). [2025-09-17T03:47:00.041104] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-17T03:47:00.041336] [INFO ] [MAIN ] Update Progress: 843/2369 symbols completed. FLG took 36.8s. Estimated remaining: 3h 42m 27s. Rate: 6.9 symbols/min [2025-09-17T03:47:00.228728] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:00.264363] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T03:47:00.318926] [DEBUG] [LOCAL ] FLUT: Loaded 37703 existing records from primary storage. [2025-09-17T03:47:00.319350] [INFO ] [MAIN ] FLUT: Loaded 37703 existing records. [2025-09-17T03:47:00.502026] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:47:00.502413] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-17T03:47:00.502481] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-17T03:47:00.503580] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-17T03:47:00.503728] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-17T03:47:00.721466] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-17T03:47:00.881629] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:01.016502] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T03:47:01.490165] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-11. [2025-09-17T03:47:01.576362] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:47:02.290193] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-17T03:47:02.659704] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T03:47:03.097510] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-17T03:47:03.123389] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T03:47:03.890127] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-17T03:47:04.163930] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T03:47:04.690165] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-17T03:47:04.958586] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T03:47:05.490147] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-17T03:47:05.694168] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T03:47:06.290145] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-17T03:47:06.436779] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:47:06.443723] [INFO ] [REMOTE ] FLO: Full fetch complete (74552 records). [2025-09-17T03:47:06.443919] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-17T03:47:06.855987] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-17T03:47:06.856146] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-17T03:47:06.857236] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-17T03:47:06.857356] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-17T03:47:06.859069] [DEBUG] [LOCAL ] FLO: Trimmed 74552 records to 51831 (keeping 200 days of data) [2025-09-17T03:47:07.090404] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-17T03:47:07.199819] [DEBUG] [LOCAL ] FLO: Primary data saved (51831 records). [2025-09-17T03:47:07.200000] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-17T03:47:07.200122] [INFO ] [MAIN ] Update Progress: 844/2369 symbols completed. FLO took 44.0s. Estimated remaining: 3h 42m 15s. Rate: 6.9 symbols/min [2025-09-17T03:47:07.372089] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:07.388073] [DEBUG] [LOCAL ] FLXR: Loaded 15343 existing records from primary storage. [2025-09-17T03:47:07.388219] [INFO ] [MAIN ] FLXR: Loaded 15343 existing records. [2025-09-17T03:47:07.571997] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:47:07.572326] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-17T03:47:07.572468] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-17T03:47:07.583765] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-17T03:47:07.606473] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-17T03:47:07.692063] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-17T03:47:07.895231] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-17T03:47:07.984848] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:08.106755] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:47:08.683496] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:47:08.692359] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-11. [2025-09-17T03:47:09.416834] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T03:47:09.490180] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-17T03:47:09.558302] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T03:47:10.290184] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-17T03:47:11.063481] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T03:47:11.090213] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-17T03:47:11.319568] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T03:47:11.596457] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T03:47:11.890210] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-17T03:47:12.690188] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-17T03:47:13.490142] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-17T03:47:13.723582] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T03:47:14.290157] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-17T03:47:14.800115] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T03:47:15.090137] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-17T03:47:15.132540] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:47:15.890170] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-17T03:47:16.016322] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T03:47:16.690154] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-17T03:47:16.714601] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T03:47:17.157545] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T03:47:17.490136] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-17T03:47:18.290176] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-17T03:47:18.496554] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T03:47:18.517593] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T03:47:19.090135] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-17T03:47:19.890138] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-17T03:47:20.292698] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T03:47:20.434633] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T03:47:20.690105] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-17T03:47:20.911570] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T03:47:21.490190] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-17T03:47:22.290105] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-17T03:47:22.561218] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T03:47:22.625129] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:47:23.090153] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-17T03:47:23.890135] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-17T03:47:24.052436] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T03:47:24.662679] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T03:47:24.669408] [INFO ] [REMOTE ] FLR: Full fetch complete (76027 records). [2025-09-17T03:47:24.669577] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-17T03:47:24.695204] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-17T03:47:25.110717] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-17T03:47:25.121912] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-17T03:47:25.123955] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T03:47:25.123386] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-17T03:47:25.128336] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-17T03:47:25.129876] [DEBUG] [LOCAL ] FLR: Trimmed 76027 records to 53122 (keeping 200 days of data) [2025-09-17T03:47:25.467096] [DEBUG] [LOCAL ] FLR: Primary data saved (53122 records). [2025-09-17T03:47:25.467322] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-17T03:47:25.467455] [INFO ] [MAIN ] Update Progress: 845/2369 symbols completed. FLR took 36.3s. Estimated remaining: 3h 42m 24s. Rate: 6.9 symbols/min [2025-09-17T03:47:25.499159] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-17T03:47:25.643056] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:25.643295] [DEBUG] [LOCAL ] FMC: No existing data file found in primary storage. [2025-09-17T03:47:25.643361] [WARN ] [MAIN ] FMC: No existing data found, performing full refresh instead. [2025-09-17T03:47:25.643523] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-17T03:47:25.643592] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-17T03:47:25.643684] [DEBUG] [LOCAL ] FMC: No primary data file found to delete. [2025-09-17T03:47:25.643733] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-17T03:47:26.001205] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:26.290155] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-17T03:47:26.570752] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T03:47:26.752218] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T03:47:27.090154] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-11. [2025-09-17T03:47:27.859354] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T03:47:27.865795] [INFO ] [REMOTE ] FLS: Full fetch complete (70917 records). [2025-09-17T03:47:27.865966] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-17T03:47:27.897590] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-17T03:47:28.287542] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-17T03:47:28.287690] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-17T03:47:28.288691] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-17T03:47:28.288767] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-17T03:47:28.290410] [DEBUG] [LOCAL ] FLS: Trimmed 70917 records to 50083 (keeping 200 days of data) [2025-09-17T03:47:28.605364] [DEBUG] [LOCAL ] FLS: Primary data saved (50083 records). [2025-09-17T03:47:28.605536] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-17T03:47:28.605671] [INFO ] [MAIN ] Update Progress: 846/2369 symbols completed. FLS took 37.9s. Estimated remaining: 3h 42m 5s. Rate: 6.9 symbols/min [2025-09-17T03:47:28.702298] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-17T03:47:28.791250] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:28.797715] [DEBUG] [LOCAL ] FMN: Loaded 3836 existing records from primary storage. [2025-09-17T03:47:28.797850] [INFO ] [MAIN ] FMN: Loaded 3836 existing records. [2025-09-17T03:47:28.993237] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:47:28.993707] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-17T03:47:28.993821] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-17T03:47:28.994141] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-17T03:47:28.994277] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-17T03:47:29.138985] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T03:47:29.420012] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:29.490076] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-11. [2025-09-17T03:47:29.817861] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T03:47:29.930932] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T03:47:30.278396] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T03:47:30.290071] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-17T03:47:31.022140] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T03:47:31.090106] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-17T03:47:31.890179] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-17T03:47:31.912723] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T03:47:32.690145] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-17T03:47:33.490114] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-17T03:47:33.944040] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T03:47:33.965829] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T03:47:33.974597] [INFO ] [REMOTE ] FLXR: Full fetch complete (24040 records). [2025-09-17T03:47:33.975290] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T03:47:33.975385] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-17T03:47:34.300403] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-17T03:47:34.344130] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-17T03:47:34.344216] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-17T03:47:34.344760] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-17T03:47:34.344829] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-17T03:47:34.345492] [DEBUG] [LOCAL ] FLXR: Trimmed 24040 records to 19502 (keeping 200 days of data) [2025-09-17T03:47:34.470479] [DEBUG] [LOCAL ] FLXR: Primary data saved (19502 records). [2025-09-17T03:47:34.470687] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-17T03:47:34.470811] [INFO ] [MAIN ] Update Progress: 847/2369 symbols completed. FLXR took 27.3s. Estimated remaining: 3h 41m 51s. Rate: 6.9 symbols/min [2025-09-17T03:47:34.645441] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:34.666928] [DEBUG] [LOCAL ] FMS: Loaded 22350 existing records from primary storage. [2025-09-17T03:47:34.667111] [INFO ] [MAIN ] FMS: Loaded 22350 existing records. [2025-09-17T03:47:34.853300] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:47:34.853634] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-17T03:47:34.853772] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-17T03:47:34.854324] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-17T03:47:34.854412] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-17T03:47:35.100406] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-17T03:47:35.229973] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:35.890129] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-17T03:47:36.008466] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T03:47:36.340373] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T03:47:36.690157] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-17T03:47:37.444907] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T03:47:37.490079] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-17T03:47:37.677463] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T03:47:38.130317] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T03:47:38.290134] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-11. [2025-09-17T03:47:39.090133] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-17T03:47:39.447071] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T03:47:39.890127] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-17T03:47:40.690151] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-17T03:47:40.913431] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:47:41.490088] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-17T03:47:41.563444] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T03:47:41.570010] [INFO ] [REMOTE ] FLUT: Full fetch complete (72587 records). [2025-09-17T03:47:41.570178] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-17T03:47:41.972102] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-17T03:47:41.972337] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-17T03:47:41.973699] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-17T03:47:41.973830] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-17T03:47:41.990775] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T03:47:41.993200] [DEBUG] [LOCAL ] FLUT: Trimmed 72587 records to 51062 (keeping 200 days of data) [2025-09-17T03:47:42.295355] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-17T03:47:42.335414] [DEBUG] [LOCAL ] FLUT: Primary data saved (51062 records). [2025-09-17T03:47:42.335601] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-17T03:47:42.335723] [INFO ] [MAIN ] Update Progress: 848/2369 symbols completed. FLUT took 42.3s. Estimated remaining: 3h 41m 41s. Rate: 6.9 symbols/min [2025-09-17T03:47:42.505071] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:42.505287] [DEBUG] [LOCAL ] FMX: No existing data file found in primary storage. [2025-09-17T03:47:42.505341] [WARN ] [MAIN ] FMX: No existing data found, performing full refresh instead. [2025-09-17T03:47:42.505454] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-17T03:47:42.505512] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-17T03:47:42.505558] [DEBUG] [LOCAL ] FMX: No primary data file found to delete. [2025-09-17T03:47:42.505603] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-17T03:47:42.856286] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:42.923508] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T03:47:43.090144] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-11. [2025-09-17T03:47:43.253703] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T03:47:43.890214] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-17T03:47:44.412007] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T03:47:44.690177] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-17T03:47:45.424229] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T03:47:45.490125] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-17T03:47:45.771218] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T03:47:46.220213] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T03:47:46.290102] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-17T03:47:47.090203] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-17T03:47:47.658823] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T03:47:47.890198] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-17T03:47:48.246802] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T03:47:48.529083] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:47:48.530354] [INFO ] [REMOTE ] FMN: Full fetch complete (10257 records). [2025-09-17T03:47:48.530447] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-17T03:47:48.694668] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-17T03:47:48.892837] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-17T03:47:48.892941] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-17T03:47:48.893191] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-17T03:47:48.893245] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-17T03:47:48.893721] [DEBUG] [LOCAL ] FMN: Trimmed 10257 records to 6157 (keeping 200 days of data) [2025-09-17T03:47:48.934089] [DEBUG] [LOCAL ] FMN: Primary data saved (6157 records). [2025-09-17T03:47:48.934258] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-17T03:47:48.934356] [INFO ] [MAIN ] Update Progress: 849/2369 symbols completed. FMN took 20.3s. Estimated remaining: 3h 41m 28s. Rate: 6.9 symbols/min [2025-09-17T03:47:49.105860] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:47:49.108777] [DEBUG] [LOCAL ] FMY: Loaded 1027 existing records from primary storage. [2025-09-17T03:47:49.108864] [INFO ] [MAIN ] FMY: Loaded 1027 existing records. [2025-09-17T03:47:49.291598] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:47:49.291926] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-17T03:47:49.291985] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-17T03:47:49.292177] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-17T03:47:49.292234] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-17T03:47:49.495504] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-17T03:47:49.657229] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:47:50.290129] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-11. [2025-09-17T03:47:50.714311] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T03:47:50.781726] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T03:47:51.090143] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-17T03:47:51.133805] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T03:47:51.890141] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-17T03:47:52.690152] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-17T03:47:52.914925] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:47:53.056185] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T03:47:53.073353] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-17T03:47:53.490136] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-17T03:47:53.918781] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-17T03:47:54.290180] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-17T03:47:55.090145] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-17T03:47:55.708512] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T03:47:55.890141] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-17T03:47:56.690174] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-17T03:47:56.906386] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T03:47:56.938033] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T03:47:57.141610] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T03:47:57.490155] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-17T03:47:58.290140] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-17T03:47:59.090138] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-17T03:47:59.329894] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T03:47:59.385030] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T03:47:59.744924] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T03:47:59.890139] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-17T03:48:00.690132] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-17T03:48:01.416412] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T03:48:01.490137] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-17T03:48:02.290202] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-17T03:48:02.945466] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T03:48:02.984687] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T03:48:03.090148] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-17T03:48:03.638612] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T03:48:03.890156] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-17T03:48:04.690400] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-17T03:48:05.175385] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T03:48:05.490180] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-17T03:48:05.596461] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T03:48:05.603673] [INFO ] [REMOTE ] FMC: Full fetch complete (74616 records). [2025-09-17T03:48:05.603887] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-17T03:48:05.948847] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (3.66 seconds). [2025-09-17T03:48:05.952213] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T03:48:06.059945] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-17T03:48:06.060063] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-17T03:48:06.060994] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-17T03:48:06.061056] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-17T03:48:06.062680] [DEBUG] [LOCAL ] FMC: Trimmed 74616 records to 51840 (keeping 200 days of data) [2025-09-17T03:48:06.290171] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-17T03:48:06.388779] [DEBUG] [LOCAL ] FMC: Primary data saved (51840 records). [2025-09-17T03:48:06.389026] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-17T03:48:06.389139] [INFO ] [MAIN ] Update Progress: 850/2369 symbols completed. FMC took 40.9s. Estimated remaining: 3h 41m 35s. Rate: 6.9 symbols/min [2025-09-17T03:48:06.571256] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:06.604001] [DEBUG] [LOCAL ] FN: Loaded 28485 existing records from primary storage. [2025-09-17T03:48:06.604248] [INFO ] [MAIN ] FN: Loaded 28485 existing records. [2025-09-17T03:48:06.803451] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:48:06.803842] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-17T03:48:06.803913] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-17T03:48:06.804834] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-17T03:48:06.804902] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-17T03:48:07.095369] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-17T03:48:07.201296] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:07.594601] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T03:48:07.616202] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T03:48:07.890215] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-11. [2025-09-17T03:48:08.690359] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-17T03:48:09.081697] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T03:48:09.082479] [INFO ] [REMOTE ] FMY: Full fetch complete (1905 records). [2025-09-17T03:48:09.082562] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-17T03:48:09.463141] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-17T03:48:09.463459] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-17T03:48:09.463900] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-17T03:48:09.464070] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-17T03:48:09.464959] [DEBUG] [LOCAL ] FMY: Trimmed 1905 records to 1347 (keeping 200 days of data) [2025-09-17T03:48:09.474532] [DEBUG] [LOCAL ] FMY: Primary data saved (1347 records). [2025-09-17T03:48:09.474736] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-17T03:48:09.474850] [INFO ] [MAIN ] Update Progress: 851/2369 symbols completed. FMY took 20.5s. Estimated remaining: 3h 41m 16s. Rate: 6.9 symbols/min [2025-09-17T03:48:09.495330] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-17T03:48:09.586064] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T03:48:09.706694] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:09.744702] [DEBUG] [LOCAL ] FNB: Loaded 38986 existing records from primary storage. [2025-09-17T03:48:09.744906] [INFO ] [MAIN ] FNB: Loaded 38986 existing records. [2025-09-17T03:48:09.934216] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:48:09.934540] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-17T03:48:09.934604] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-17T03:48:09.935670] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-17T03:48:09.935749] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-17T03:48:10.305582] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-17T03:48:10.311362] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:10.866688] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T03:48:11.090124] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-17T03:48:11.749407] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T03:48:11.890160] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-17T03:48:12.311741] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T03:48:12.690152] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-17T03:48:13.490108] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-11. [2025-09-17T03:48:13.577923] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:48:14.290954] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-17T03:48:14.295454] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T03:48:15.090145] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-17T03:48:15.244683] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:48:15.890096] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-17T03:48:16.058177] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T03:48:16.690132] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-17T03:48:16.984410] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T03:48:17.490146] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-17T03:48:18.291041] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-17T03:48:18.296788] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-17T03:48:18.624139] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T03:48:18.782955] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T03:48:18.787217] [INFO ] [REMOTE ] FMS: Full fetch complete (42336 records). [2025-09-17T03:48:18.787326] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-17T03:48:19.095239] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-17T03:48:19.166283] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-17T03:48:19.166390] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-17T03:48:19.167175] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-17T03:48:19.167257] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-17T03:48:19.168311] [DEBUG] [LOCAL ] FMS: Trimmed 42336 records to 30564 (keeping 200 days of data) [2025-09-17T03:48:19.355060] [DEBUG] [LOCAL ] FMS: Primary data saved (30564 records). [2025-09-17T03:48:19.355228] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-17T03:48:19.355333] [INFO ] [MAIN ] Update Progress: 852/2369 symbols completed. FMS took 44.9s. Estimated remaining: 3h 41m 9s. Rate: 6.9 symbols/min [2025-09-17T03:48:19.526141] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:19.565324] [DEBUG] [LOCAL ] FND: Loaded 38807 existing records from primary storage. [2025-09-17T03:48:19.565496] [INFO ] [MAIN ] FND: Loaded 38807 existing records. [2025-09-17T03:48:19.752092] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:48:19.752418] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-17T03:48:19.752601] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-17T03:48:19.753552] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-17T03:48:19.753618] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-17T03:48:19.908234] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-17T03:48:20.144859] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T03:48:20.149372] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:20.698286] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-11. [2025-09-17T03:48:20.704178] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T03:48:21.495219] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-17T03:48:21.514325] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T03:48:22.290155] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-17T03:48:22.457927] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T03:48:22.575720] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T03:48:23.090148] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-17T03:48:23.890145] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-17T03:48:24.012441] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T03:48:24.522129] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T03:48:24.528352] [INFO ] [REMOTE ] FMX: Full fetch complete (57482 records). [2025-09-17T03:48:24.528496] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-17T03:48:24.704140] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-17T03:48:24.932168] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-17T03:48:24.932332] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-17T03:48:24.933485] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-17T03:48:24.933560] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-17T03:48:24.937160] [DEBUG] [LOCAL ] FMX: Trimmed 57482 records to 40671 (keeping 200 days of data) [2025-09-17T03:48:25.195831] [DEBUG] [LOCAL ] FMX: Primary data saved (40671 records). [2025-09-17T03:48:25.195984] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-17T03:48:25.196070] [INFO ] [MAIN ] Update Progress: 853/2369 symbols completed. FMX took 42.9s. Estimated remaining: 3h 40m 55s. Rate: 6.9 symbols/min [2025-09-17T03:48:25.366747] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:25.406872] [DEBUG] [LOCAL ] FNF: Loaded 36510 existing records from primary storage. [2025-09-17T03:48:25.407045] [INFO ] [MAIN ] FNF: Loaded 36510 existing records. [2025-09-17T03:48:25.500062] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-17T03:48:25.596283] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:48:25.596593] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-17T03:48:25.596744] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-17T03:48:25.598020] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-17T03:48:25.598205] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-17T03:48:25.836456] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T03:48:25.997953] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:26.290167] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-17T03:48:26.445676] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T03:48:27.090146] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-17T03:48:27.128221] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T03:48:27.890108] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-11. [2025-09-17T03:48:27.965250] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T03:48:28.690176] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-17T03:48:28.863420] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T03:48:29.490191] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-17T03:48:29.639630] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T03:48:30.097890] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:48:30.290127] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-17T03:48:31.090148] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-17T03:48:31.275998] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T03:48:31.890153] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-17T03:48:32.188698] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:48:32.524886] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T03:48:32.690175] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-17T03:48:33.490164] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-17T03:48:33.602083] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T03:48:34.290202] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-17T03:48:34.530954] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T03:48:35.073251] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T03:48:35.090079] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-17T03:48:35.751189] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T03:48:35.890126] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-17T03:48:36.588297] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T03:48:36.690160] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-17T03:48:37.490229] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-17T03:48:37.667545] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T03:48:38.290196] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-17T03:48:38.541455] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T03:48:39.056824] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T03:48:39.090188] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-17T03:48:39.807222] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T03:48:39.890144] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-17T03:48:40.690106] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-17T03:48:40.793164] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T03:48:41.490193] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-17T03:48:41.773795] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T03:48:42.290202] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-17T03:48:42.424537] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T03:48:43.041666] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T03:48:43.090103] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-17T03:48:43.890189] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-17T03:48:44.139692] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T03:48:44.690138] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-17T03:48:44.903690] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T03:48:45.357076] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T03:48:45.490132] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-17T03:48:46.297265] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-17T03:48:46.299452] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T03:48:46.306258] [INFO ] [REMOTE ] FNB: Full fetch complete (75347 records). [2025-09-17T03:48:46.306433] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-17T03:48:46.706075] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-17T03:48:46.706220] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-17T03:48:46.707218] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-17T03:48:46.707330] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-17T03:48:46.708902] [DEBUG] [LOCAL ] FNB: Trimmed 75347 records to 52451 (keeping 200 days of data) [2025-09-17T03:48:46.828348] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T03:48:46.843103] [INFO ] [REMOTE ] FN: Full fetch complete (56545 records). [2025-09-17T03:48:46.844433] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-17T03:48:47.097879] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-17T03:48:47.363560] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-17T03:48:47.363999] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-17T03:48:47.365403] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-17T03:48:47.365481] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-17T03:48:47.371107] [DEBUG] [LOCAL ] FN: Trimmed 56545 records to 39796 (keeping 200 days of data) [2025-09-17T03:48:47.653625] [DEBUG] [LOCAL ] FNB: Primary data saved (52451 records). [2025-09-17T03:48:47.662689] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-17T03:48:47.688257] [INFO ] [MAIN ] Update Progress: 854/2369 symbols completed. FNB took 38.2s. Estimated remaining: 3h 41m 11s. Rate: 6.8 symbols/min [2025-09-17T03:48:47.877758] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:47.879021] [DEBUG] [LOCAL ] FNV: No existing data file found in primary storage. [2025-09-17T03:48:47.879946] [WARN ] [MAIN ] FNV: No existing data found, performing full refresh instead. [2025-09-17T03:48:47.881718] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-17T03:48:47.882828] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-17T03:48:47.883934] [DEBUG] [LOCAL ] FNV: No primary data file found to delete. [2025-09-17T03:48:47.885085] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-17T03:48:48.315952] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:48.318595] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-11. [2025-09-17T03:48:48.323227] [DEBUG] [LOCAL ] FN: Primary data saved (39796 records). [2025-09-17T03:48:48.323424] [INFO ] [MAIN ] FN: Full history saved. [2025-09-17T03:48:48.323567] [INFO ] [MAIN ] Update Progress: 855/2369 symbols completed. FN took 41.9s. Estimated remaining: 3h 40m 48s. Rate: 6.9 symbols/min [2025-09-17T03:48:48.490176] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T03:48:48.556394] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:48.557025] [DEBUG] [LOCAL ] FOA: No existing data file found in primary storage. [2025-09-17T03:48:48.557079] [WARN ] [MAIN ] FOA: No existing data found, performing full refresh instead. [2025-09-17T03:48:48.557192] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-17T03:48:48.557245] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-17T03:48:48.557312] [DEBUG] [LOCAL ] FOA: No primary data file found to delete. [2025-09-17T03:48:48.557392] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-17T03:48:48.701996] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-17T03:48:48.921811] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:48.937888] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T03:48:48.944109] [INFO ] [REMOTE ] FND: Full fetch complete (74126 records). [2025-09-17T03:48:48.944255] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-17T03:48:49.365273] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-17T03:48:49.365495] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-17T03:48:49.366987] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-17T03:48:49.367066] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-17T03:48:49.369839] [DEBUG] [LOCAL ] FND: Trimmed 74126 records to 52178 (keeping 200 days of data) [2025-09-17T03:48:49.492366] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-11. [2025-09-17T03:48:49.721934] [DEBUG] [LOCAL ] FND: Primary data saved (52178 records). [2025-09-17T03:48:49.722200] [INFO ] [MAIN ] FND: Full history saved. [2025-09-17T03:48:49.722355] [INFO ] [MAIN ] Update Progress: 856/2369 symbols completed. FND took 30.4s. Estimated remaining: 3h 40m 26s. Rate: 6.9 symbols/min [2025-09-17T03:48:49.919620] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:48:49.928127] [DEBUG] [LOCAL ] FOF: Loaded 5797 existing records from primary storage. [2025-09-17T03:48:49.928237] [INFO ] [MAIN ] FOF: Loaded 5797 existing records. [2025-09-17T03:48:50.120155] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:48:50.120854] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-17T03:48:50.121063] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-17T03:48:50.130251] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-17T03:48:50.145119] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-17T03:48:50.168575] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T03:48:50.298570] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-17T03:48:50.485727] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T03:48:50.560114] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:48:50.573572] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T03:48:51.090171] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-11. [2025-09-17T03:48:51.830045] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T03:48:51.896217] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-17T03:48:51.911093] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T03:48:52.690133] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-17T03:48:52.762316] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T03:48:53.490189] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-17T03:48:53.703960] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T03:48:54.290160] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-17T03:48:55.102501] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-17T03:48:55.105817] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:48:55.527203] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T03:48:55.890156] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-17T03:48:56.658228] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T03:48:56.690078] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-17T03:48:56.937912] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T03:48:57.490155] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-17T03:48:57.789444] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T03:48:58.290159] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-17T03:48:59.090163] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-17T03:48:59.188536] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T03:48:59.233515] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T03:48:59.890179] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-17T03:49:00.690184] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-17T03:49:00.791067] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T03:49:01.418627] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T03:49:01.425926] [INFO ] [REMOTE ] FNF: Full fetch complete (69244 records). [2025-09-17T03:49:01.426113] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-17T03:49:01.495270] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-17T03:49:01.862153] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T03:49:01.865772] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-17T03:49:01.870266] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-17T03:49:01.871464] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-17T03:49:01.871995] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-17T03:49:01.873505] [DEBUG] [LOCAL ] FNF: Trimmed 69244 records to 49340 (keeping 200 days of data) [2025-09-17T03:49:02.107968] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T03:49:02.203113] [DEBUG] [LOCAL ] FNF: Primary data saved (49340 records). [2025-09-17T03:49:02.203308] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-17T03:49:02.203413] [INFO ] [MAIN ] Update Progress: 857/2369 symbols completed. FNF took 37.0s. Estimated remaining: 3h 40m 24s. Rate: 6.9 symbols/min [2025-09-17T03:49:02.295308] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-17T03:49:02.388085] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:02.404082] [DEBUG] [LOCAL ] FOR: Loaded 14590 existing records from primary storage. [2025-09-17T03:49:02.404255] [INFO ] [MAIN ] FOR: Loaded 14590 existing records. [2025-09-17T03:49:02.586743] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:02.587028] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-17T03:49:02.587082] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-17T03:49:02.587812] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-17T03:49:02.587881] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-17T03:49:02.946214] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:03.090082] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-11. [2025-09-17T03:49:03.104531] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T03:49:03.890202] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-17T03:49:04.064510] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T03:49:04.690229] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-17T03:49:05.491437] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T03:49:05.490382] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-17T03:49:05.788094] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T03:49:06.290147] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-17T03:49:06.333102] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T03:49:07.090149] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-17T03:49:07.890139] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-17T03:49:07.909072] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T03:49:07.959095] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T03:49:08.690126] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-17T03:49:08.739202] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T03:49:09.284705] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:49:09.490160] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-17T03:49:10.290164] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-17T03:49:10.551017] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T03:49:11.090165] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-17T03:49:11.097527] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T03:49:11.890146] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-17T03:49:11.967190] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T03:49:12.690134] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-17T03:49:13.490110] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-17T03:49:13.573214] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T03:49:13.641476] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T03:49:13.644317] [INFO ] [REMOTE ] FOA: Full fetch complete (22478 records). [2025-09-17T03:49:13.644453] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-17T03:49:14.037836] [DEBUG] [VALIDATOR ] FOA: All expected trading days are present. [2025-09-17T03:49:14.037996] [DEBUG] [VALIDATOR ] FOA: Primary data validation passed. [2025-09-17T03:49:14.038680] [INFO ] [MAIN ] FOA: Fetched primary data is valid. [2025-09-17T03:49:14.038744] [DEBUG] [LOCAL ] FOA: Saving primary data. [2025-09-17T03:49:14.039794] [DEBUG] [LOCAL ] FOA: Trimmed 22478 records to 13204 (keeping 200 days of data) [2025-09-17T03:49:14.118932] [DEBUG] [LOCAL ] FOA: Primary data saved (13204 records). [2025-09-17T03:49:14.119104] [INFO ] [MAIN ] FOA: Full history saved. [2025-09-17T03:49:14.119196] [INFO ] [MAIN ] Update Progress: 858/2369 symbols completed. FOA took 25.8s. Estimated remaining: 3h 40m 21s. Rate: 6.9 symbols/min [2025-09-17T03:49:14.292419] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:14.292491] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-17T03:49:14.332536] [DEBUG] [LOCAL ] FOUR: Loaded 36659 existing records from primary storage. [2025-09-17T03:49:14.332732] [INFO ] [MAIN ] FOUR: Loaded 36659 existing records. [2025-09-17T03:49:14.512531] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:14.512831] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-17T03:49:14.512892] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-17T03:49:14.513778] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-17T03:49:14.513839] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-17T03:49:14.870248] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:14.885562] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T03:49:15.090134] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-11. [2025-09-17T03:49:15.114180] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T03:49:15.890207] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-17T03:49:16.690176] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-17T03:49:16.919702] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T03:49:17.044036] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:49:17.455868] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T03:49:17.490155] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-17T03:49:18.290182] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-17T03:49:18.586457] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T03:49:19.090126] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-17T03:49:19.871709] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T03:49:19.890104] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-17T03:49:20.690129] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-17T03:49:20.979142] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T03:49:21.261489] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T03:49:21.490129] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-17T03:49:22.087742] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T03:49:22.126050] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:49:22.127689] [INFO ] [REMOTE ] FOF: Full fetch complete (11532 records). [2025-09-17T03:49:22.127777] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-17T03:49:22.304321] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-17T03:49:22.504976] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-17T03:49:22.505147] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-17T03:49:22.505481] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-17T03:49:22.505540] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-17T03:49:22.506078] [DEBUG] [LOCAL ] FOF: Trimmed 11532 records to 8073 (keeping 200 days of data) [2025-09-17T03:49:22.557838] [DEBUG] [LOCAL ] FOF: Primary data saved (8073 records). [2025-09-17T03:49:22.558008] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-17T03:49:22.558106] [INFO ] [MAIN ] Update Progress: 859/2369 symbols completed. FOF took 32.8s. Estimated remaining: 3h 40m 12s. Rate: 6.9 symbols/min [2025-09-17T03:49:22.729304] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:22.744271] [DEBUG] [LOCAL ] FPF: Loaded 12881 existing records from primary storage. [2025-09-17T03:49:22.744463] [INFO ] [MAIN ] FPF: Loaded 12881 existing records. [2025-09-17T03:49:22.920489] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:22.920774] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-17T03:49:22.920835] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-17T03:49:22.921291] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-17T03:49:22.921350] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-17T03:49:23.093088] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-17T03:49:23.280718] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:23.890131] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-17T03:49:24.077929] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T03:49:24.241859] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T03:49:24.690115] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-17T03:49:25.490200] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-17T03:49:25.670936] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T03:49:26.139510] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T03:49:26.206782] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T03:49:26.212421] [INFO ] [REMOTE ] FNV: Full fetch complete (65727 records). [2025-09-17T03:49:26.212596] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-17T03:49:26.295254] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-17T03:49:26.624806] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-17T03:49:26.624938] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-17T03:49:26.625867] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-17T03:49:26.625951] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-17T03:49:26.627454] [DEBUG] [LOCAL ] FNV: Trimmed 65727 records to 46551 (keeping 200 days of data) [2025-09-17T03:49:26.930319] [DEBUG] [LOCAL ] FNV: Primary data saved (46551 records). [2025-09-17T03:49:26.930498] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-17T03:49:26.930588] [INFO ] [MAIN ] Update Progress: 860/2369 symbols completed. FNV took 39.2s. Estimated remaining: 3h 39m 55s. Rate: 6.9 symbols/min [2025-09-17T03:49:27.090283] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-17T03:49:27.112799] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:27.128889] [DEBUG] [LOCAL ] FPH: Loaded 14629 existing records from primary storage. [2025-09-17T03:49:27.129032] [INFO ] [MAIN ] FPH: Loaded 14629 existing records. [2025-09-17T03:49:27.304846] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:27.305075] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-17T03:49:27.305132] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-17T03:49:27.305546] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-17T03:49:27.305604] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-17T03:49:27.661982] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:27.890209] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-11. [2025-09-17T03:49:28.085001] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T03:49:28.150074] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T03:49:28.545803] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T03:49:28.690103] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-17T03:49:29.490182] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-11. [2025-09-17T03:49:29.692964] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T03:49:30.290255] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-17T03:49:30.526875] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T03:49:31.090195] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-17T03:49:31.550747] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T03:49:31.758700] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T03:49:31.890130] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-17T03:49:32.690197] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-17T03:49:32.792828] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T03:49:32.795600] [INFO ] [REMOTE ] FOR: Full fetch complete (29547 records). [2025-09-17T03:49:32.795744] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-17T03:49:33.197916] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-17T03:49:33.198063] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-17T03:49:33.199156] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-17T03:49:33.199230] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-17T03:49:33.200303] [DEBUG] [LOCAL ] FOR: Trimmed 29547 records to 20318 (keeping 200 days of data) [2025-09-17T03:49:33.332280] [DEBUG] [LOCAL ] FOR: Primary data saved (20318 records). [2025-09-17T03:49:33.332515] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-17T03:49:33.332660] [INFO ] [MAIN ] Update Progress: 861/2369 symbols completed. FOR took 31.1s. Estimated remaining: 3h 39m 42s. Rate: 6.9 symbols/min [2025-09-17T03:49:33.495552] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-17T03:49:33.526941] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:33.556346] [DEBUG] [LOCAL ] FPI: Loaded 23420 existing records from primary storage. [2025-09-17T03:49:33.556568] [INFO ] [MAIN ] FPI: Loaded 23420 existing records. [2025-09-17T03:49:33.759858] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:33.760279] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-17T03:49:33.760344] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-17T03:49:33.761321] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-17T03:49:33.761438] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-17T03:49:34.125192] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:34.141631] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:49:34.290153] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-17T03:49:34.703047] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T03:49:35.090215] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-17T03:49:35.414143] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:49:35.890173] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-17T03:49:36.113117] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T03:49:36.675955] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T03:49:36.690084] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-17T03:49:37.490148] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-17T03:49:37.662542] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T03:49:38.216731] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T03:49:38.290167] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-11. [2025-09-17T03:49:39.090183] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-17T03:49:39.612660] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T03:49:39.890191] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-17T03:49:40.690164] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-17T03:49:40.847341] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:49:40.977137] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T03:49:41.490139] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-17T03:49:41.680401] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:49:42.290145] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-17T03:49:42.925440] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T03:49:43.090201] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-17T03:49:43.890123] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-17T03:49:44.147475] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T03:49:44.342453] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T03:49:44.690133] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-17T03:49:45.027855] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T03:49:45.490112] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-17T03:49:45.794320] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T03:49:46.290130] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-17T03:49:46.643240] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:49:47.090140] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-17T03:49:47.294144] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T03:49:47.890221] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-17T03:49:48.486394] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T03:49:48.690131] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-17T03:49:48.853759] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T03:49:49.490212] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-17T03:49:50.109355] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T03:49:50.290144] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-17T03:49:50.611881] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T03:49:51.090155] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-17T03:49:51.196302] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T03:49:51.199401] [INFO ] [REMOTE ] FPH: Full fetch complete (31625 records). [2025-09-17T03:49:51.199501] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-17T03:49:51.584193] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-17T03:49:51.584307] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-17T03:49:51.584896] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-17T03:49:51.584952] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-17T03:49:51.585842] [DEBUG] [LOCAL ] FPH: Trimmed 31625 records to 19790 (keeping 200 days of data) [2025-09-17T03:49:51.697085] [DEBUG] [LOCAL ] FPH: Primary data saved (19790 records). [2025-09-17T03:49:51.697271] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-17T03:49:51.697370] [INFO ] [MAIN ] Update Progress: 862/2369 symbols completed. FPH took 24.8s. Estimated remaining: 3h 39m 50s. Rate: 6.9 symbols/min [2025-09-17T03:49:51.877186] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:51.896480] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-17T03:49:51.909320] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T03:49:51.927419] [DEBUG] [LOCAL ] FR: Loaded 34514 existing records from primary storage. [2025-09-17T03:49:51.927613] [INFO ] [MAIN ] FR: Loaded 34514 existing records. [2025-09-17T03:49:52.117190] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:49:52.117486] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-17T03:49:52.117541] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-17T03:49:52.118440] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-17T03:49:52.118515] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-17T03:49:52.494815] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:49:52.690144] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-11. [2025-09-17T03:49:53.293767] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T03:49:53.490205] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-17T03:49:54.290104] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-17T03:49:54.325829] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T03:49:54.838080] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T03:49:55.090141] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-17T03:49:55.890108] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-17T03:49:56.066232] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T03:49:56.501219] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T03:49:56.640034] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T03:49:56.690182] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-17T03:49:57.490188] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-17T03:49:58.281586] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T03:49:58.290348] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-17T03:49:59.090161] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-17T03:49:59.177274] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T03:49:59.179760] [INFO ] [REMOTE ] FPF: Full fetch complete (26344 records). [2025-09-17T03:49:59.179851] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-17T03:49:59.562786] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-17T03:49:59.562930] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-17T03:49:59.564277] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-17T03:49:59.578924] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-17T03:49:59.591952] [DEBUG] [LOCAL ] FPF: Trimmed 26344 records to 17657 (keeping 200 days of data) [2025-09-17T03:49:59.595221] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T03:49:59.715746] [DEBUG] [LOCAL ] FPF: Primary data saved (17657 records). [2025-09-17T03:49:59.715945] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-17T03:49:59.716049] [INFO ] [MAIN ] Update Progress: 863/2369 symbols completed. FPF took 37.2s. Estimated remaining: 3h 39m 40s. Rate: 6.9 symbols/min [2025-09-17T03:49:59.889097] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:49:59.890123] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-17T03:49:59.900675] [DEBUG] [LOCAL ] FRA: Loaded 10140 existing records from primary storage. [2025-09-17T03:49:59.900805] [INFO ] [MAIN ] FRA: Loaded 10140 existing records. [2025-09-17T03:50:00.079213] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:00.079471] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-17T03:50:00.079539] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-17T03:50:00.079997] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-17T03:50:00.080063] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-17T03:50:00.435340] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:00.454007] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T03:50:00.690142] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-17T03:50:01.490200] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-17T03:50:01.722862] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T03:50:01.852362] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T03:50:01.857252] [INFO ] [REMOTE ] FPI: Full fetch complete (43910 records). [2025-09-17T03:50:01.857445] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-17T03:50:02.295855] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-17T03:50:02.307020] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-17T03:50:02.307166] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-17T03:50:02.309241] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-17T03:50:02.309441] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-17T03:50:02.310724] [DEBUG] [LOCAL ] FPI: Trimmed 43910 records to 31234 (keeping 200 days of data) [2025-09-17T03:50:02.511480] [DEBUG] [LOCAL ] FPI: Primary data saved (31234 records). [2025-09-17T03:50:02.511744] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-17T03:50:02.511902] [INFO ] [MAIN ] Update Progress: 864/2369 symbols completed. FPI took 29.2s. Estimated remaining: 3h 39m 21s. Rate: 6.9 symbols/min [2025-09-17T03:50:02.701527] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:02.714264] [DEBUG] [LOCAL ] FRGE: Loaded 11551 existing records from primary storage. [2025-09-17T03:50:02.714459] [INFO ] [MAIN ] FRGE: Loaded 11551 existing records. [2025-09-17T03:50:02.925262] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:02.925629] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-17T03:50:02.925718] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-17T03:50:02.926390] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-17T03:50:02.926461] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-17T03:50:03.102146] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-11. [2025-09-17T03:50:03.202066] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T03:50:03.375860] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:03.890127] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-17T03:50:04.196972] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T03:50:04.433128] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T03:50:04.690129] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-17T03:50:05.042031] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T03:50:05.490113] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-17T03:50:05.725562] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:50:06.290144] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-17T03:50:07.090168] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-11. [2025-09-17T03:50:07.129003] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T03:50:07.890157] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-17T03:50:07.949950] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T03:50:07.956284] [INFO ] [REMOTE ] FOUR: Full fetch complete (71731 records). [2025-09-17T03:50:07.956481] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-17T03:50:08.484323] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-17T03:50:08.484541] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-17T03:50:08.486152] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-17T03:50:08.486301] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-17T03:50:08.488562] [DEBUG] [LOCAL ] FOUR: Trimmed 71731 records to 49544 (keeping 200 days of data) [2025-09-17T03:50:08.668246] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T03:50:08.690164] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-17T03:50:09.010186] [DEBUG] [LOCAL ] FOUR: Primary data saved (49544 records). [2025-09-17T03:50:09.010430] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-17T03:50:09.010558] [INFO ] [MAIN ] Update Progress: 865/2369 symbols completed. FOUR took 54.9s. Estimated remaining: 3h 39m 9s. Rate: 6.9 symbols/min [2025-09-17T03:50:09.258246] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:09.315364] [DEBUG] [LOCAL ] FRO: Loaded 38509 existing records from primary storage. [2025-09-17T03:50:09.315611] [INFO ] [MAIN ] FRO: Loaded 38509 existing records. [2025-09-17T03:50:09.495344] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-17T03:50:09.569674] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:09.570137] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-17T03:50:09.570228] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-17T03:50:09.571232] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-17T03:50:09.571318] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-17T03:50:09.956485] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:10.018576] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T03:50:10.020761] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-17T03:50:10.290150] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-17T03:50:10.745149] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T03:50:11.090146] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-17T03:50:11.742278] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T03:50:11.804670] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T03:50:11.890151] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-17T03:50:12.690180] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-17T03:50:13.244084] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T03:50:13.490137] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-17T03:50:14.290264] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-17T03:50:14.424442] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T03:50:14.482696] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T03:50:15.090168] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-11. [2025-09-17T03:50:15.782255] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T03:50:15.890141] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-17T03:50:16.690172] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-17T03:50:17.027977] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T03:50:17.113558] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T03:50:17.315137] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T03:50:17.490210] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-17T03:50:18.290204] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-17T03:50:19.090170] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-17T03:50:19.138765] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T03:50:19.675707] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T03:50:19.890165] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-17T03:50:20.690151] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-17T03:50:21.130154] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T03:50:21.490151] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-17T03:50:21.536253] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T03:50:21.605668] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T03:50:22.135261] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T03:50:22.290149] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-17T03:50:23.090139] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-17T03:50:23.152619] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T03:50:23.890150] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-17T03:50:24.503029] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T03:50:24.508715] [INFO ] [REMOTE ] FR: Full fetch complete (66426 records). [2025-09-17T03:50:24.508868] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-17T03:50:24.691033] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-17T03:50:24.719593] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T03:50:24.965589] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-17T03:50:24.965744] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-17T03:50:24.966555] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-17T03:50:24.966617] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-17T03:50:24.968140] [DEBUG] [LOCAL ] FR: Trimmed 66426 records to 46885 (keeping 200 days of data) [2025-09-17T03:50:25.263053] [DEBUG] [LOCAL ] FR: Primary data saved (46885 records). [2025-09-17T03:50:25.263292] [INFO ] [MAIN ] FR: Full history saved. [2025-09-17T03:50:25.263451] [INFO ] [MAIN ] Update Progress: 866/2369 symbols completed. FR took 33.6s. Estimated remaining: 3h 39m 13s. Rate: 6.9 symbols/min [2025-09-17T03:50:25.435358] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:25.466237] [DEBUG] [LOCAL ] FRT: Loaded 31128 existing records from primary storage. [2025-09-17T03:50:25.466445] [INFO ] [MAIN ] FRT: Loaded 31128 existing records. [2025-09-17T03:50:25.497410] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-17T03:50:25.648806] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:25.649060] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-17T03:50:25.649122] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-17T03:50:25.649989] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-17T03:50:25.650056] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-17T03:50:26.008955] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:26.290139] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-11. [2025-09-17T03:50:26.590543] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T03:50:26.776739] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-17T03:50:27.090196] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-17T03:50:27.851412] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T03:50:27.890099] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-17T03:50:27.920131] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T03:50:28.690141] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-17T03:50:29.356478] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:50:29.490218] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-17T03:50:29.646302] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T03:50:30.290218] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-17T03:50:30.943263] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T03:50:31.090187] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-17T03:50:31.112558] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T03:50:31.115096] [INFO ] [REMOTE ] FRA: Full fetch complete (24480 records). [2025-09-17T03:50:31.115215] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-17T03:50:31.502207] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-17T03:50:31.502342] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-17T03:50:31.503171] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-17T03:50:31.503256] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-17T03:50:31.505223] [DEBUG] [LOCAL ] FRA: Trimmed 24480 records to 14810 (keeping 200 days of data) [2025-09-17T03:50:31.600577] [DEBUG] [LOCAL ] FRA: Primary data saved (14810 records). [2025-09-17T03:50:31.600816] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-17T03:50:31.600948] [INFO ] [MAIN ] Update Progress: 867/2369 symbols completed. FRA took 31.9s. Estimated remaining: 3h 38m 60s. Rate: 6.9 symbols/min [2025-09-17T03:50:31.773620] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:31.801737] [DEBUG] [LOCAL ] FSCO: Loaded 27172 existing records from primary storage. [2025-09-17T03:50:31.801951] [INFO ] [MAIN ] FSCO: Loaded 27172 existing records. [2025-09-17T03:50:31.897058] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-17T03:50:31.991758] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:31.992044] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-17T03:50:31.992129] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-17T03:50:31.992784] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-17T03:50:31.992863] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-17T03:50:32.368739] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:32.394415] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T03:50:32.690157] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-17T03:50:33.490235] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-17T03:50:33.695026] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T03:50:33.834043] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T03:50:34.290177] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-11. [2025-09-17T03:50:35.090158] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-17T03:50:35.196007] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T03:50:35.735354] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T03:50:35.808747] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T03:50:35.811185] [INFO ] [REMOTE ] FRGE: Full fetch complete (34845 records). [2025-09-17T03:50:35.811334] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-17T03:50:35.895262] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-17T03:50:36.201478] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-17T03:50:36.201707] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-17T03:50:36.202807] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-17T03:50:36.202892] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-17T03:50:36.205530] [DEBUG] [LOCAL ] FRGE: Trimmed 34845 records to 19255 (keeping 200 days of data) [2025-09-17T03:50:36.327391] [DEBUG] [LOCAL ] FRGE: Primary data saved (19255 records). [2025-09-17T03:50:36.327618] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-17T03:50:36.327836] [INFO ] [MAIN ] Update Progress: 868/2369 symbols completed. FRGE took 33.8s. Estimated remaining: 3h 38m 44s. Rate: 6.9 symbols/min [2025-09-17T03:50:36.504131] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:36.543268] [DEBUG] [LOCAL ] FSK: Loaded 36028 existing records from primary storage. [2025-09-17T03:50:36.543464] [INFO ] [MAIN ] FSK: Loaded 36028 existing records. [2025-09-17T03:50:36.697723] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-17T03:50:36.727551] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:36.728719] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-17T03:50:36.728783] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-17T03:50:36.729590] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-17T03:50:36.729694] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-17T03:50:37.108220] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:37.490179] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-17T03:50:37.668884] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:50:38.239803] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T03:50:38.290119] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-17T03:50:39.090169] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-11. [2025-09-17T03:50:39.557402] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-17T03:50:39.839988] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T03:50:39.890165] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-17T03:50:40.445621] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T03:50:40.690187] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-17T03:50:41.490161] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-17T03:50:41.910421] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T03:50:42.032393] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T03:50:42.290151] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-17T03:50:43.095262] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-17T03:50:43.116318] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T03:50:43.770288] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T03:50:43.890163] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-17T03:50:44.690139] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-17T03:50:44.811625] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T03:50:45.486949] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T03:50:45.495551] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-17T03:50:45.948870] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T03:50:46.290142] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-17T03:50:46.959709] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T03:50:47.090159] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-17T03:50:47.807669] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T03:50:47.890135] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-17T03:50:48.690182] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-17T03:50:48.730227] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:50:49.490152] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-17T03:50:49.519304] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T03:50:50.070331] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T03:50:50.290151] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-17T03:50:51.090152] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-17T03:50:51.461665] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T03:50:51.543852] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T03:50:51.890133] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-17T03:50:52.695226] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-17T03:50:52.712551] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T03:50:53.490176] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-17T03:50:53.679961] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T03:50:54.274296] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T03:50:54.290074] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-17T03:50:54.457005] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T03:50:55.090130] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-17T03:50:55.881462] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T03:50:55.892138] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-17T03:50:56.458876] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T03:50:56.465486] [INFO ] [REMOTE ] FRT: Full fetch complete (60139 records). [2025-09-17T03:50:56.465688] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-17T03:50:56.695307] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-17T03:50:56.882961] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-17T03:50:56.883080] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-17T03:50:56.883993] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-17T03:50:56.884089] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-17T03:50:56.885542] [DEBUG] [LOCAL ] FRT: Trimmed 60139 records to 42398 (keeping 200 days of data) [2025-09-17T03:50:57.152785] [DEBUG] [LOCAL ] FRT: Primary data saved (42398 records). [2025-09-17T03:50:57.152946] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-17T03:50:57.153060] [INFO ] [MAIN ] Update Progress: 869/2369 symbols completed. FRT took 31.9s. Estimated remaining: 3h 38m 56s. Rate: 6.9 symbols/min [2025-09-17T03:50:57.326620] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:57.339786] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T03:50:57.348166] [INFO ] [REMOTE ] FSCO: Full fetch complete (53842 records). [2025-09-17T03:50:57.348393] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-17T03:50:57.506166] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-17T03:50:57.616856] [DEBUG] [LOCAL ] FSLY: Loaded 38013 existing records from primary storage. [2025-09-17T03:50:57.649929] [INFO ] [MAIN ] FSLY: Loaded 38013 existing records. [2025-09-17T03:50:57.931999] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-17T03:50:57.953382] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:57.953284] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-17T03:50:57.954389] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-17T03:50:57.954213] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-17T03:50:57.954490] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-17T03:50:57.954541] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-17T03:50:57.955401] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-17T03:50:57.955584] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-17T03:50:57.989080] [DEBUG] [LOCAL ] FSCO: Trimmed 53842 records to 36874 (keeping 200 days of data) [2025-09-17T03:50:58.423881] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:58.426071] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-11. [2025-09-17T03:50:58.543147] [DEBUG] [LOCAL ] FSCO: Primary data saved (36874 records). [2025-09-17T03:50:58.543317] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-17T03:50:58.543413] [INFO ] [MAIN ] Update Progress: 870/2369 symbols completed. FSCO took 26.9s. Estimated remaining: 3h 38m 35s. Rate: 6.9 symbols/min [2025-09-17T03:50:58.713493] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:50:58.744918] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T03:50:58.788448] [DEBUG] [LOCAL ] FSM: Loaded 39669 existing records from primary storage. [2025-09-17T03:50:58.788617] [INFO ] [MAIN ] FSM: Loaded 39669 existing records. [2025-09-17T03:50:58.969149] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:50:58.969416] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-17T03:50:58.969474] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-17T03:50:58.970170] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-17T03:50:58.970229] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-17T03:50:59.095226] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-17T03:50:59.325325] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:50:59.415961] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T03:50:59.890189] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-17T03:51:00.249523] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T03:51:00.690117] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-17T03:51:01.025076] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T03:51:01.033591] [INFO ] [REMOTE ] FRO: Full fetch complete (75403 records). [2025-09-17T03:51:01.033892] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-17T03:51:01.507958] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-11. [2025-09-17T03:51:01.677830] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-17T03:51:01.694790] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-17T03:51:01.696912] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-17T03:51:01.697051] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-17T03:51:01.693057] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T03:51:01.719107] [DEBUG] [LOCAL ] FRO: Trimmed 75403 records to 51942 (keeping 200 days of data) [2025-09-17T03:51:02.192530] [DEBUG] [LOCAL ] FRO: Primary data saved (51942 records). [2025-09-17T03:51:02.192776] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-17T03:51:02.192907] [INFO ] [MAIN ] Update Progress: 871/2369 symbols completed. FRO took 53.2s. Estimated remaining: 3h 38m 17s. Rate: 6.9 symbols/min [2025-09-17T03:51:02.295371] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-17T03:51:02.384529] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:02.384851] [DEBUG] [LOCAL ] FSS: No existing data file found in primary storage. [2025-09-17T03:51:02.384928] [WARN ] [MAIN ] FSS: No existing data found, performing full refresh instead. [2025-09-17T03:51:02.385087] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-17T03:51:02.385164] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-17T03:51:02.385246] [DEBUG] [LOCAL ] FSS: No primary data file found to delete. [2025-09-17T03:51:02.385314] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-17T03:51:02.812872] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:03.090208] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-11. [2025-09-17T03:51:03.137588] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-17T03:51:03.890153] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-17T03:51:04.011909] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-11 (2.50 seconds). [2025-09-17T03:51:04.690189] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-17T03:51:05.432236] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-17T03:51:05.494217] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-17T03:51:05.499311] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (3.20 seconds). [2025-09-17T03:51:05.711007] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T03:51:06.290137] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-17T03:51:06.435344] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T03:51:06.532676] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T03:51:07.090154] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-17T03:51:07.890147] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-17T03:51:08.003937] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T03:51:08.690176] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-17T03:51:08.975400] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T03:51:09.490103] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-17T03:51:09.561604] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T03:51:09.963776] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T03:51:10.290151] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-17T03:51:10.986983] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T03:51:11.090171] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-17T03:51:11.704393] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:51:11.890143] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-17T03:51:12.690187] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-17T03:51:12.850319] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T03:51:13.490176] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-17T03:51:13.781833] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T03:51:14.290187] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-17T03:51:14.614598] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T03:51:15.090138] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-17T03:51:15.307588] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T03:51:15.890143] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-17T03:51:16.068494] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T03:51:16.690158] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-17T03:51:16.747781] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T03:51:17.490164] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-17T03:51:18.290180] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-17T03:51:18.440022] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-17T03:51:19.090163] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-17T03:51:19.513941] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T03:51:19.688310] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (3.00 seconds). [2025-09-17T03:51:19.694665] [INFO ] [REMOTE ] FSK: Full fetch complete (71106 records). [2025-09-17T03:51:19.694814] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-17T03:51:19.895253] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-17T03:51:20.099393] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-17T03:51:20.099603] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-17T03:51:20.100565] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-17T03:51:20.100656] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-17T03:51:20.102272] [DEBUG] [LOCAL ] FSK: Trimmed 71106 records to 49332 (keeping 200 days of data) [2025-09-17T03:51:20.237918] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T03:51:20.469243] [DEBUG] [LOCAL ] FSK: Primary data saved (49332 records). [2025-09-17T03:51:20.469444] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-17T03:51:20.469579] [INFO ] [MAIN ] Update Progress: 872/2369 symbols completed. FSK took 44.1s. Estimated remaining: 3h 38m 25s. Rate: 6.9 symbols/min [2025-09-17T03:51:20.641159] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:20.647757] [DEBUG] [LOCAL ] FT: Loaded 4736 existing records from primary storage. [2025-09-17T03:51:20.647915] [INFO ] [MAIN ] FT: Loaded 4736 existing records. [2025-09-17T03:51:20.710268] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-17T03:51:20.827678] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:51:20.827972] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-17T03:51:20.828038] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-17T03:51:20.828346] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-17T03:51:20.828420] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-17T03:51:21.190093] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:21.224230] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T03:51:21.490154] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-17T03:51:21.536837] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T03:51:22.290141] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-17T03:51:22.587573] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T03:51:23.030300] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T03:51:23.090147] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-17T03:51:23.716200] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T03:51:23.890138] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-17T03:51:24.295515] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T03:51:24.301891] [INFO ] [REMOTE ] FSLY: Full fetch complete (74839 records). [2025-09-17T03:51:24.302070] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-17T03:51:24.694960] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-11. [2025-09-17T03:51:24.695463] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-17T03:51:24.696511] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-17T03:51:24.697534] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-17T03:51:24.697927] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-17T03:51:24.700020] [DEBUG] [LOCAL ] FSLY: Trimmed 74839 records to 51270 (keeping 200 days of data) [2025-09-17T03:51:25.007753] [DEBUG] [LOCAL ] FSLY: Primary data saved (51270 records). [2025-09-17T03:51:25.007938] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-17T03:51:25.008042] [INFO ] [MAIN ] Update Progress: 873/2369 symbols completed. FSLY took 27.9s. Estimated remaining: 3h 38m 9s. Rate: 6.9 symbols/min [2025-09-17T03:51:25.188161] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:25.198341] [DEBUG] [LOCAL ] FTHY: Loaded 8557 existing records from primary storage. [2025-09-17T03:51:25.198491] [INFO ] [MAIN ] FTHY: Loaded 8557 existing records. [2025-09-17T03:51:25.320179] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T03:51:25.388718] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:51:25.389182] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-17T03:51:25.389299] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-17T03:51:25.389773] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-17T03:51:25.389877] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-17T03:51:25.506715] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T03:51:25.492200] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-17T03:51:25.785128] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:26.106965] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T03:51:26.290178] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-17T03:51:26.704921] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-17T03:51:27.090161] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-17T03:51:27.602272] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T03:51:27.890147] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-17T03:51:28.690140] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-11. [2025-09-17T03:51:29.449877] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T03:51:29.458010] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T03:51:29.490101] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-17T03:51:30.290205] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-17T03:51:31.032778] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T03:51:31.090140] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-17T03:51:31.850904] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T03:51:31.890181] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-17T03:51:32.257199] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T03:51:32.261058] [INFO ] [REMOTE ] FSS: Full fetch complete (47887 records). [2025-09-17T03:51:32.261261] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-17T03:51:32.660433] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-17T03:51:32.660538] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-17T03:51:32.661208] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-17T03:51:32.661263] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-17T03:51:32.662305] [DEBUG] [LOCAL ] FSS: Trimmed 47887 records to 35076 (keeping 200 days of data) [2025-09-17T03:51:32.720039] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-17T03:51:32.890277] [DEBUG] [LOCAL ] FSS: Primary data saved (35076 records). [2025-09-17T03:51:32.890483] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-17T03:51:32.890601] [INFO ] [MAIN ] Update Progress: 874/2369 symbols completed. FSS took 30.7s. Estimated remaining: 3h 37m 59s. Rate: 6.9 symbols/min [2025-09-17T03:51:33.063322] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:33.099910] [DEBUG] [LOCAL ] FTI: Loaded 39696 existing records from primary storage. [2025-09-17T03:51:33.100111] [INFO ] [MAIN ] FTI: Loaded 39696 existing records. [2025-09-17T03:51:33.285895] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:51:33.286129] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-17T03:51:33.286198] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-17T03:51:33.287255] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-17T03:51:33.287324] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-17T03:51:33.496456] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-17T03:51:33.554557] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T03:51:33.698941] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:33.795686] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T03:51:34.197372] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T03:51:34.290182] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-17T03:51:35.090176] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-17T03:51:35.293731] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T03:51:35.673994] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T03:51:35.890209] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-11. [2025-09-17T03:51:36.690178] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-17T03:51:37.490138] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-17T03:51:37.541207] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T03:51:37.567750] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T03:51:38.290191] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-17T03:51:38.332941] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T03:51:39.090195] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-17T03:51:39.678196] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T03:51:39.890277] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-17T03:51:39.891701] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T03:51:39.899177] [INFO ] [REMOTE ] FSM: Full fetch complete (76466 records). [2025-09-17T03:51:39.899342] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-17T03:51:40.297901] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-17T03:51:40.298052] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-17T03:51:40.298997] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-17T03:51:40.299061] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-17T03:51:40.300680] [DEBUG] [LOCAL ] FSM: Trimmed 76466 records to 53267 (keeping 200 days of data) [2025-09-17T03:51:40.636153] [DEBUG] [LOCAL ] FSM: Primary data saved (53267 records). [2025-09-17T03:51:40.636420] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-17T03:51:40.636541] [INFO ] [MAIN ] Update Progress: 875/2369 symbols completed. FSM took 42.1s. Estimated remaining: 3h 37m 48s. Rate: 6.9 symbols/min [2025-09-17T03:51:40.702193] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-17T03:51:40.817797] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:40.818109] [DEBUG] [LOCAL ] FTK: No existing data file found in primary storage. [2025-09-17T03:51:40.818165] [WARN ] [MAIN ] FTK: No existing data found, performing full refresh instead. [2025-09-17T03:51:40.818276] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-17T03:51:40.818330] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-17T03:51:40.818382] [DEBUG] [LOCAL ] FTK: No primary data file found to delete. [2025-09-17T03:51:40.818425] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-17T03:51:41.193501] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:41.490161] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-17T03:51:41.716715] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T03:51:41.717341] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T03:51:42.282135] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T03:51:42.290071] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-17T03:51:43.032601] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T03:51:43.090157] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-17T03:51:43.890166] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-17T03:51:44.096442] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T03:51:44.690151] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-17T03:51:45.334371] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:51:45.335794] [INFO ] [REMOTE ] FT: Full fetch complete (9009 records). [2025-09-17T03:51:45.335878] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-17T03:51:45.490721] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-17T03:51:45.707973] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-17T03:51:45.708165] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-17T03:51:45.708448] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-17T03:51:45.708507] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-17T03:51:45.709879] [DEBUG] [LOCAL ] FT: Trimmed 9009 records to 6306 (keeping 200 days of data) [2025-09-17T03:51:45.771667] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T03:51:45.794470] [DEBUG] [LOCAL ] FT: Primary data saved (6306 records). [2025-09-17T03:51:45.794752] [INFO ] [MAIN ] FT: Full history saved. [2025-09-17T03:51:45.794918] [INFO ] [MAIN ] Update Progress: 876/2369 symbols completed. FT took 25.3s. Estimated remaining: 3h 37m 33s. Rate: 6.9 symbols/min [2025-09-17T03:51:46.009143] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:51:46.048621] [DEBUG] [LOCAL ] FTS: Loaded 31471 existing records from primary storage. [2025-09-17T03:51:46.048920] [INFO ] [MAIN ] FTS: Loaded 31471 existing records. [2025-09-17T03:51:46.229870] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:51:46.230219] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-17T03:51:46.230290] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-17T03:51:46.231220] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-17T03:51:46.231301] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-17T03:51:46.297979] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-11. [2025-09-17T03:51:46.557957] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T03:51:46.627418] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:51:47.090185] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-17T03:51:47.543792] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T03:51:47.890191] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-17T03:51:48.690182] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-17T03:51:48.838539] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T03:51:48.973368] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T03:51:49.490176] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-17T03:51:49.500945] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T03:51:50.290219] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-17T03:51:51.090193] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-11. [2025-09-17T03:51:51.125763] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T03:51:51.375278] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T03:51:51.890155] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-17T03:51:52.327926] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T03:51:52.690203] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-17T03:51:53.490218] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-17T03:51:53.747837] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T03:51:53.851052] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T03:51:54.290163] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-17T03:51:54.571385] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T03:51:55.090229] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-17T03:51:55.130601] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T03:51:55.890186] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-17T03:51:56.136188] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T03:51:56.690178] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-17T03:51:57.470049] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T03:51:57.493192] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-17T03:51:57.487278] [INFO ] [REMOTE ] FTHY: Full fetch complete (17618 records). [2025-09-17T03:51:57.499119] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-17T03:51:57.508739] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:51:57.919660] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-17T03:51:57.919804] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-17T03:51:57.920455] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-17T03:51:57.920514] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-17T03:51:57.921476] [DEBUG] [LOCAL ] FTHY: Trimmed 17618 records to 11685 (keeping 200 days of data) [2025-09-17T03:51:58.004193] [DEBUG] [LOCAL ] FTHY: Primary data saved (11685 records). [2025-09-17T03:51:58.004484] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-17T03:51:58.004613] [INFO ] [MAIN ] Update Progress: 877/2369 symbols completed. FTHY took 33.0s. Estimated remaining: 3h 37m 31s. Rate: 6.9 symbols/min [2025-09-17T03:51:58.290176] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-17T03:51:58.512479] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T03:51:59.090181] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-17T03:51:59.890184] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-17T03:52:00.215124] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T03:52:00.255336] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T03:52:00.690239] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-17T03:52:01.485800] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T03:52:01.493855] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-17T03:52:02.004105] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T03:52:02.290236] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-17T03:52:03.090193] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-17T03:52:03.277473] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T03:52:03.821210] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T03:52:03.890183] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-17T03:52:04.582035] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T03:52:04.690096] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-17T03:52:05.207577] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T03:52:05.490219] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-17T03:52:06.224675] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T03:52:06.290125] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-17T03:52:06.830833] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T03:52:07.090139] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-17T03:52:07.746539] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T03:52:07.890153] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-17T03:52:08.690171] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-17T03:52:09.010366] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T03:52:09.452921] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:52:09.490082] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-17T03:52:09.512871] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T03:52:09.517171] [INFO ] [REMOTE ] FTK: Full fetch complete (41907 records). [2025-09-17T03:52:09.517308] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-17T03:52:09.929017] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-17T03:52:09.929190] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-17T03:52:09.930113] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-17T03:52:09.930221] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-17T03:52:09.931961] [DEBUG] [LOCAL ] FTK: Trimmed 41907 records to 31793 (keeping 200 days of data) [2025-09-17T03:52:10.124650] [DEBUG] [LOCAL ] FTK: Primary data saved (31793 records). [2025-09-17T03:52:10.124873] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-17T03:52:10.124985] [INFO ] [MAIN ] Update Progress: 878/2369 symbols completed. FTK took 29.5s. Estimated remaining: 3h 37m 28s. Rate: 6.9 symbols/min [2025-09-17T03:52:10.290193] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-17T03:52:11.099537] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T03:52:11.110343] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-17T03:52:11.890057] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T03:52:11.901600] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-17T03:52:12.659933] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T03:52:12.690082] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-17T03:52:13.597738] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T03:52:13.604316] [INFO ] [REMOTE ] FTI: Full fetch complete (76951 records). [2025-09-17T03:52:13.604543] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-17T03:52:14.014262] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-17T03:52:14.014456] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-17T03:52:14.015714] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-17T03:52:14.015847] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-17T03:52:14.028903] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T03:52:14.035401] [DEBUG] [LOCAL ] FTI: Trimmed 76951 records to 53311 (keeping 200 days of data) [2025-09-17T03:52:14.036549] [INFO ] [REMOTE ] FTS: Full fetch complete (60043 records). [2025-09-17T03:52:14.036957] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-17T03:52:14.595857] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-17T03:52:14.596035] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-17T03:52:14.597027] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-17T03:52:14.650371] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-17T03:52:14.689917] [DEBUG] [LOCAL ] FTS: Trimmed 60043 records to 42229 (keeping 200 days of data) [2025-09-17T03:52:14.921917] [DEBUG] [LOCAL ] FTI: Primary data saved (53311 records). [2025-09-17T03:52:14.923244] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-17T03:52:14.923874] [INFO ] [MAIN ] Update Progress: 879/2369 symbols completed. FTI took 42.0s. Estimated remaining: 3h 37m 12s. Rate: 6.9 symbols/min [2025-09-17T03:52:15.064438] [DEBUG] [LOCAL ] FTS: Primary data saved (42229 records). [2025-09-17T03:52:15.064617] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-17T03:52:15.064888] [INFO ] [MAIN ] Update Progress: 880/2369 symbols completed. FTS took 29.3s. Estimated remaining: 3h 36m 49s. Rate: 6.9 symbols/min [2025-09-17T03:52:15.559226] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:15.706313] [DEBUG] [LOCAL ] FTWO: No existing data file found in primary storage. [2025-09-17T03:52:15.726287] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:15.774848] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:15.777116] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:15.777915] [WARN ] [MAIN ] FTWO: No existing data found, performing full refresh instead. [2025-09-17T03:52:15.778986] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-17T03:52:15.779212] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-17T03:52:15.779339] [DEBUG] [LOCAL ] FTWO: No primary data file found to delete. [2025-09-17T03:52:15.779405] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-17T03:52:15.990153] [DEBUG] [LOCAL ] FUL: Loaded 22955 existing records from primary storage. [2025-09-17T03:52:16.029444] [INFO ] [MAIN ] FUL: Loaded 22955 existing records. [2025-09-17T03:52:16.126835] [DEBUG] [LOCAL ] FUBO: Loaded 40078 existing records from primary storage. [2025-09-17T03:52:16.184148] [INFO ] [MAIN ] FUBO: Loaded 40078 existing records. [2025-09-17T03:52:16.167121] [DEBUG] [LOCAL ] FTV: Loaded 39565 existing records from primary storage. [2025-09-17T03:52:16.225585] [INFO ] [MAIN ] FTV: Loaded 39565 existing records. [2025-09-17T03:52:16.523139] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:16.545479] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:52:16.554190] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-11. [2025-09-17T03:52:16.565167] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-17T03:52:16.644155] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-17T03:52:16.724885] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-17T03:52:16.699058] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:52:16.734429] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-17T03:52:16.755219] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:52:16.775935] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-17T03:52:16.786195] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-17T03:52:16.786356] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-17T03:52:16.798397] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-17T03:52:16.810818] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-17T03:52:16.831336] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-17T03:52:16.836534] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-17T03:52:16.836663] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-17T03:52:17.607102] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T03:52:17.674523] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-17T03:52:17.733305] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:17.836920] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-11. [2025-09-17T03:52:17.876582] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:17.906792] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-11. [2025-09-17T03:52:17.906157] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:17.907928] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-11. [2025-09-17T03:52:18.397878] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T03:52:18.399576] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-17T03:52:19.007975] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T03:52:19.010033] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-17T03:52:19.026463] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T03:52:19.090144] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-17T03:52:19.600263] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:52:19.639848] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T03:52:19.846793] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T03:52:19.890128] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-17T03:52:20.367895] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T03:52:20.690127] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-17T03:52:21.490280] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-17T03:52:21.707064] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T03:52:22.093345] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T03:52:22.114735] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T03:52:22.290135] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-17T03:52:23.090206] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-17T03:52:23.781657] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T03:52:23.890113] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-17T03:52:24.569069] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T03:52:24.690151] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-17T03:52:25.490137] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-17T03:52:25.602692] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T03:52:25.800407] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-17T03:52:26.290183] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-17T03:52:26.359302] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T03:52:26.648502] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-17T03:52:27.090148] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-17T03:52:27.556026] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T03:52:27.890139] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-17T03:52:28.690215] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-17T03:52:29.490161] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-17T03:52:29.726607] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T03:52:29.954143] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T03:52:30.287445] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T03:52:30.295196] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-17T03:52:30.763772] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T03:52:31.090145] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-17T03:52:31.458537] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T03:52:31.459717] [INFO ] [REMOTE ] FTWO: Full fetch complete (3524 records). [2025-09-17T03:52:31.459824] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-17T03:52:31.846048] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-17T03:52:31.846167] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-17T03:52:31.846312] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-17T03:52:31.846365] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-17T03:52:31.846846] [DEBUG] [LOCAL ] FTWO: Trimmed 3524 records to 1789 (keeping 200 days of data) [2025-09-17T03:52:31.858278] [DEBUG] [LOCAL ] FTWO: Primary data saved (1789 records). [2025-09-17T03:52:31.858398] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-17T03:52:31.858486] [INFO ] [MAIN ] Update Progress: 881/2369 symbols completed. FTWO took 16.8s. Estimated remaining: 3h 36m 54s. Rate: 6.9 symbols/min [2025-09-17T03:52:31.895242] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-17T03:52:32.049141] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:32.087377] [DEBUG] [LOCAL ] FUN: Loaded 38812 existing records from primary storage. [2025-09-17T03:52:32.087565] [INFO ] [MAIN ] FUN: Loaded 38812 existing records. [2025-09-17T03:52:32.274265] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:52:32.274601] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-17T03:52:32.274684] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-17T03:52:32.275582] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-17T03:52:32.275688] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-17T03:52:32.653877] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:32.690158] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-17T03:52:33.490200] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-17T03:52:33.837630] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T03:52:34.236383] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T03:52:34.290174] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-17T03:52:35.090216] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-17T03:52:35.497863] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T03:52:35.842271] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-17T03:52:35.890176] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-17T03:52:36.690253] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-17T03:52:36.884590] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T03:52:37.490265] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-17T03:52:37.957073] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T03:52:38.189235] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-17T03:52:38.290173] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-11. [2025-09-17T03:52:39.090239] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-17T03:52:39.260252] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T03:52:39.890163] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-17T03:52:40.017346] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T03:52:40.660927] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:52:40.690170] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-17T03:52:41.490176] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-17T03:52:41.737333] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T03:52:42.005847] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T03:52:42.290190] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-17T03:52:43.096616] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-17T03:52:43.103096] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T03:52:43.890106] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-17T03:52:43.965804] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T03:52:43.970872] [INFO ] [REMOTE ] FUL: Full fetch complete (46209 records). [2025-09-17T03:52:43.971060] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-17T03:52:44.393137] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-17T03:52:44.393365] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-17T03:52:44.394580] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-17T03:52:44.394839] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-17T03:52:44.430058] [DEBUG] [LOCAL ] FUL: Trimmed 46209 records to 32927 (keeping 200 days of data) [2025-09-17T03:52:44.432236] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T03:52:44.659701] [DEBUG] [LOCAL ] FUL: Primary data saved (32927 records). [2025-09-17T03:52:44.659902] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-17T03:52:44.660044] [INFO ] [MAIN ] Update Progress: 882/2369 symbols completed. FUL took 29.6s. Estimated remaining: 3h 36m 52s. Rate: 6.9 symbols/min [2025-09-17T03:52:44.695268] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-17T03:52:44.838529] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:44.838768] [DEBUG] [LOCAL ] FVR: No existing data file found in primary storage. [2025-09-17T03:52:44.838828] [WARN ] [MAIN ] FVR: No existing data found, performing full refresh instead. [2025-09-17T03:52:44.838976] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-17T03:52:44.839045] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-17T03:52:44.839118] [DEBUG] [LOCAL ] FVR: No primary data file found to delete. [2025-09-17T03:52:44.839178] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-17T03:52:45.197742] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:45.490102] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-11. [2025-09-17T03:52:45.553556] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T03:52:46.181418] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T03:52:46.290113] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-17T03:52:46.837142] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T03:52:47.090167] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-17T03:52:47.842007] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T03:52:47.890111] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-17T03:52:48.680881] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T03:52:48.688144] [INFO ] [REMOTE ] FTV: Full fetch complete (76043 records). [2025-09-17T03:52:48.688354] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-17T03:52:48.701387] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-17T03:52:49.121351] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-17T03:52:49.121467] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-17T03:52:49.122353] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-17T03:52:49.122414] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-17T03:52:49.123940] [DEBUG] [LOCAL ] FTV: Trimmed 76043 records to 52888 (keeping 200 days of data) [2025-09-17T03:52:49.454462] [DEBUG] [LOCAL ] FTV: Primary data saved (52888 records). [2025-09-17T03:52:49.454858] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-17T03:52:49.455026] [INFO ] [MAIN ] Update Progress: 883/2369 symbols completed. FTV took 34.4s. Estimated remaining: 3h 36m 36s. Rate: 6.9 symbols/min [2025-09-17T03:52:49.497820] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-17T03:52:49.617057] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T03:52:49.678045] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:52:49.711515] [DEBUG] [LOCAL ] FVRR: Loaded 29987 existing records from primary storage. [2025-09-17T03:52:49.711779] [INFO ] [MAIN ] FVRR: Loaded 29987 existing records. [2025-09-17T03:52:49.896171] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:52:49.896528] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-17T03:52:49.896593] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-17T03:52:49.897504] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-17T03:52:49.897581] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-17T03:52:50.265428] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:52:50.290200] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-11. [2025-09-17T03:52:50.965735] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T03:52:51.090056] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T03:52:51.090148] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-17T03:52:51.890162] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-17T03:52:52.034354] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T03:52:52.143582] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T03:52:52.690229] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-17T03:52:53.490170] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-17T03:52:54.081727] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T03:52:54.276317] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T03:52:54.290094] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-17T03:52:54.464284] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T03:52:55.090221] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-17T03:52:55.890125] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-17T03:52:55.963807] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T03:52:56.690165] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-17T03:52:56.991730] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T03:52:57.288520] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-17T03:52:57.490173] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-17T03:52:58.290206] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-17T03:52:58.540520] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T03:52:59.090191] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-17T03:52:59.195937] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T03:52:59.239746] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T03:52:59.890210] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-17T03:53:00.690222] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-17T03:53:01.201595] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T03:53:01.489196] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-17T03:53:01.500419] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-17T03:53:02.290208] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-17T03:53:02.375145] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T03:53:02.428243] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T03:53:03.090233] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-17T03:53:03.890185] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-17T03:53:04.602236] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-17T03:53:04.652843] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T03:53:04.690208] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-17T03:53:04.956515] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T03:53:05.490186] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-17T03:53:06.290244] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-17T03:53:06.658749] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-17T03:53:06.680136] [INFO ] [REMOTE ] FUBO: Full fetch complete (77691 records). [2025-09-17T03:53:06.680670] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-17T03:53:07.092104] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-17T03:53:07.173666] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-17T03:53:07.173932] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-17T03:53:07.175835] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-17T03:53:07.176105] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-17T03:53:07.178794] [DEBUG] [LOCAL ] FUBO: Trimmed 77691 records to 53700 (keeping 200 days of data) [2025-09-17T03:53:07.271164] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T03:53:07.567343] [DEBUG] [LOCAL ] FUBO: Primary data saved (53700 records). [2025-09-17T03:53:07.567606] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-17T03:53:07.567765] [INFO ] [MAIN ] Update Progress: 884/2369 symbols completed. FUBO took 52.5s. Estimated remaining: 3h 36m 43s. Rate: 6.9 symbols/min [2025-09-17T03:53:07.750880] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:07.751286] [DEBUG] [LOCAL ] FXED: No existing data file found in primary storage. [2025-09-17T03:53:07.751619] [WARN ] [MAIN ] FXED: No existing data found, performing full refresh instead. [2025-09-17T03:53:07.751933] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-17T03:53:07.751995] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-17T03:53:07.752055] [DEBUG] [LOCAL ] FXED: No primary data file found to delete. [2025-09-17T03:53:07.752111] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-17T03:53:07.895357] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-17T03:53:08.157710] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:08.198102] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T03:53:08.291733] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T03:53:08.690176] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-17T03:53:09.335032] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T03:53:09.337982] [INFO ] [REMOTE ] FVR: Full fetch complete (30686 records). [2025-09-17T03:53:09.338121] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-17T03:53:09.497251] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-11. [2025-09-17T03:53:09.760022] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-17T03:53:09.760320] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-17T03:53:09.761113] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-17T03:53:09.777130] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-17T03:53:09.790405] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T03:53:09.800885] [DEBUG] [LOCAL ] FVR: Trimmed 30686 records to 21906 (keeping 200 days of data) [2025-09-17T03:53:09.946900] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T03:53:09.956374] [DEBUG] [LOCAL ] FVR: Primary data saved (21906 records). [2025-09-17T03:53:09.956679] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-17T03:53:09.956839] [INFO ] [MAIN ] Update Progress: 885/2369 symbols completed. FVR took 25.3s. Estimated remaining: 3h 36m 24s. Rate: 6.9 symbols/min [2025-09-17T03:53:10.140690] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:10.185925] [DEBUG] [LOCAL ] G: Loaded 37121 existing records from primary storage. [2025-09-17T03:53:10.186169] [INFO ] [MAIN ] G: Loaded 37121 existing records. [2025-09-17T03:53:10.295309] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-17T03:53:10.388821] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:10.389194] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-17T03:53:10.389285] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-17T03:53:10.390754] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-17T03:53:10.390843] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-17T03:53:10.776290] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:11.090172] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-17T03:53:11.449074] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T03:53:11.890572] [INFO ] [REMOTE ] G: Fetching primary data for 2024-11. [2025-09-17T03:53:11.895999] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T03:53:12.690184] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-17T03:53:13.490951] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-17T03:53:13.500200] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T03:53:14.007451] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T03:53:14.290158] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-17T03:53:14.513560] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T03:53:14.640882] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T03:53:15.090152] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-17T03:53:15.399062] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-17T03:53:15.890232] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-17T03:53:16.335872] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T03:53:16.690227] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-17T03:53:17.490157] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-17T03:53:18.290108] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-17T03:53:18.381478] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T03:53:18.390449] [INFO ] [REMOTE ] FUN: Full fetch complete (71867 records). [2025-09-17T03:53:18.390744] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-17T03:53:18.708126] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T03:53:18.810105] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-17T03:53:18.810263] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-17T03:53:18.811520] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-17T03:53:18.811595] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-17T03:53:18.814144] [DEBUG] [LOCAL ] FUN: Trimmed 71867 records to 51532 (keeping 200 days of data) [2025-09-17T03:53:19.059049] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T03:53:19.091047] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-17T03:53:19.182313] [DEBUG] [LOCAL ] FUN: Primary data saved (51532 records). [2025-09-17T03:53:19.182560] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-17T03:53:19.182730] [INFO ] [MAIN ] Update Progress: 886/2369 symbols completed. FUN took 47.3s. Estimated remaining: 3h 36m 16s. Rate: 6.9 symbols/min [2025-09-17T03:53:19.363352] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:19.386489] [DEBUG] [LOCAL ] GAB: Loaded 19527 existing records from primary storage. [2025-09-17T03:53:19.386720] [INFO ] [MAIN ] GAB: Loaded 19527 existing records. [2025-09-17T03:53:19.570200] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:19.570580] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-17T03:53:19.570672] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-17T03:53:19.571318] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-17T03:53:19.571395] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-17T03:53:19.898478] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-17T03:53:19.946872] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:20.325373] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T03:53:20.690224] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-17T03:53:20.752823] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T03:53:21.490267] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-17T03:53:22.006315] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T03:53:22.126223] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T03:53:22.290179] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-17T03:53:23.090181] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-17T03:53:23.904177] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-17T03:53:23.913986] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T03:53:24.374973] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T03:53:24.690165] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-17T03:53:24.743075] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T03:53:25.032807] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T03:53:25.033918] [INFO ] [REMOTE ] FXED: Full fetch complete (1741 records). [2025-09-17T03:53:25.034016] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-17T03:53:25.425479] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-17T03:53:25.425625] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-17T03:53:25.425784] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-17T03:53:25.425835] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-17T03:53:25.426263] [DEBUG] [LOCAL ] FXED: Trimmed 1741 records to 1193 (keeping 200 days of data) [2025-09-17T03:53:25.435604] [DEBUG] [LOCAL ] FXED: Primary data saved (1193 records). [2025-09-17T03:53:25.435777] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-17T03:53:25.435881] [INFO ] [MAIN ] Update Progress: 887/2369 symbols completed. FXED took 17.9s. Estimated remaining: 3h 36m 3s. Rate: 6.9 symbols/min [2025-09-17T03:53:25.495375] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-11. [2025-09-17T03:53:25.624018] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:25.631657] [DEBUG] [LOCAL ] GAM: Loaded 2806 existing records from primary storage. [2025-09-17T03:53:25.631844] [INFO ] [MAIN ] GAM: Loaded 2806 existing records. [2025-09-17T03:53:25.832765] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:25.833156] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-17T03:53:25.833238] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-17T03:53:25.833523] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-17T03:53:25.833595] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-17T03:53:26.229915] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:26.290156] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-11. [2025-09-17T03:53:26.564581] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T03:53:27.039352] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T03:53:27.090184] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-17T03:53:27.890206] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-17T03:53:28.690115] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-17T03:53:28.727760] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:53:29.193088] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T03:53:29.490248] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-17T03:53:30.160080] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T03:53:30.167655] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T03:53:30.170694] [INFO ] [REMOTE ] FVRR: Full fetch complete (58722 records). [2025-09-17T03:53:30.170881] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-17T03:53:30.295287] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-17T03:53:30.597960] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-17T03:53:30.598123] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-17T03:53:30.599447] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-17T03:53:30.599528] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-17T03:53:30.601268] [DEBUG] [LOCAL ] FVRR: Trimmed 58722 records to 40162 (keeping 200 days of data) [2025-09-17T03:53:30.875501] [DEBUG] [LOCAL ] FVRR: Primary data saved (40162 records). [2025-09-17T03:53:30.875739] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-17T03:53:30.875859] [INFO ] [MAIN ] Update Progress: 888/2369 symbols completed. FVRR took 41.4s. Estimated remaining: 3h 35m 49s. Rate: 6.9 symbols/min [2025-09-17T03:53:31.053957] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:31.101004] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-17T03:53:31.105511] [DEBUG] [LOCAL ] GAP: Loaded 40007 existing records from primary storage. [2025-09-17T03:53:31.105699] [INFO ] [MAIN ] GAP: Loaded 40007 existing records. [2025-09-17T03:53:31.282222] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:31.282518] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-17T03:53:31.282572] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-17T03:53:31.283485] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-17T03:53:31.283546] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-17T03:53:31.635756] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:31.890128] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-11. [2025-09-17T03:53:31.895828] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T03:53:32.032291] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T03:53:32.690178] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-17T03:53:33.330945] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T03:53:33.490139] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-17T03:53:33.847228] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T03:53:34.290163] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-17T03:53:34.871401] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T03:53:34.903481] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T03:53:35.090140] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-17T03:53:35.890193] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-17T03:53:36.244778] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T03:53:36.534800] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T03:53:36.690103] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-17T03:53:37.490127] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-17T03:53:37.865999] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T03:53:38.290127] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-17T03:53:39.090184] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-17T03:53:39.234537] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T03:53:39.597402] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T03:53:39.890162] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-17T03:53:40.478307] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:53:40.690133] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-17T03:53:40.734031] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T03:53:41.490198] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-17T03:53:42.290096] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-17T03:53:42.420046] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T03:53:42.882486] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T03:53:43.090195] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-17T03:53:43.321056] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T03:53:43.890160] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-17T03:53:44.690120] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-17T03:53:44.788111] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T03:53:45.490179] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-17T03:53:45.696671] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T03:53:46.074373] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T03:53:46.290131] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-17T03:53:46.745000] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T03:53:47.096941] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-17T03:53:47.101202] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T03:53:47.744101] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T03:53:47.890140] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-17T03:53:48.480062] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T03:53:48.690116] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-17T03:53:49.251970] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T03:53:49.253084] [INFO ] [REMOTE ] GAM: Full fetch complete (7010 records). [2025-09-17T03:53:49.253170] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-17T03:53:49.497590] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-17T03:53:49.617968] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-17T03:53:49.618092] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-17T03:53:49.618318] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-17T03:53:49.618411] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-17T03:53:49.619104] [DEBUG] [LOCAL ] GAM: Trimmed 7010 records to 4400 (keeping 200 days of data) [2025-09-17T03:53:49.647678] [DEBUG] [LOCAL ] GAM: Primary data saved (4400 records). [2025-09-17T03:53:49.647869] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-17T03:53:49.648005] [INFO ] [MAIN ] Update Progress: 889/2369 symbols completed. GAM took 24.2s. Estimated remaining: 3h 35m 57s. Rate: 6.9 symbols/min [2025-09-17T03:53:49.817543] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:49.835867] [DEBUG] [LOCAL ] GATX: Loaded 13206 existing records from primary storage. [2025-09-17T03:53:49.836058] [INFO ] [MAIN ] GATX: Loaded 13206 existing records. [2025-09-17T03:53:50.012916] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:50.013207] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-17T03:53:50.013267] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-17T03:53:50.013772] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-17T03:53:50.013832] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-17T03:53:50.295360] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-17T03:53:50.383490] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:51.090109] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-17T03:53:51.639831] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T03:53:51.714506] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T03:53:51.890146] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-17T03:53:52.599909] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T03:53:52.606671] [INFO ] [REMOTE ] G: Full fetch complete (71349 records). [2025-09-17T03:53:52.606838] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-17T03:53:52.695271] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-11. [2025-09-17T03:53:53.021472] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-17T03:53:53.021673] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-17T03:53:53.023109] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-17T03:53:53.023214] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-17T03:53:53.025471] [DEBUG] [LOCAL ] G: Trimmed 71349 records to 49760 (keeping 200 days of data) [2025-09-17T03:53:53.190932] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:53:53.410980] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T03:53:53.426049] [DEBUG] [LOCAL ] G: Primary data saved (49760 records). [2025-09-17T03:53:53.426301] [INFO ] [MAIN ] G: Full history saved. [2025-09-17T03:53:53.426444] [INFO ] [MAIN ] Update Progress: 890/2369 symbols completed. G took 43.5s. Estimated remaining: 3h 35m 40s. Rate: 6.9 symbols/min [2025-09-17T03:53:53.495271] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-17T03:53:53.609484] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:53:53.623833] [DEBUG] [LOCAL ] GBAB: Loaded 9666 existing records from primary storage. [2025-09-17T03:53:53.624079] [INFO ] [MAIN ] GBAB: Loaded 9666 existing records. [2025-09-17T03:53:53.822795] [WARN ] [MAIN ] GBAB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:53:53.823168] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-17T03:53:53.823226] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-17T03:53:53.823783] [DEBUG] [LOCAL ] GBAB: Deleted primary data file. [2025-09-17T03:53:53.823857] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-17T03:53:54.204929] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:53:54.290177] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-11. [2025-09-17T03:53:55.090228] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-17T03:53:55.323469] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:53:55.516940] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T03:53:55.777984] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T03:53:55.890156] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-17T03:53:56.690112] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-17T03:53:56.743215] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T03:53:57.490102] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-17T03:53:57.805491] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T03:53:58.290171] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-17T03:53:59.090200] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-17T03:53:59.409251] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T03:53:59.415026] [INFO ] [REMOTE ] GAB: Full fetch complete (38989 records). [2025-09-17T03:53:59.415249] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-17T03:53:59.810279] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-17T03:53:59.901234] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-17T03:53:59.926071] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T03:53:59.979608] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-17T03:53:59.979741] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-17T03:53:59.980363] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-17T03:53:59.980420] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-17T03:53:59.981492] [DEBUG] [LOCAL ] GAB: Trimmed 38989 records to 27670 (keeping 200 days of data) [2025-09-17T03:54:00.147603] [DEBUG] [LOCAL ] GAB: Primary data saved (27670 records). [2025-09-17T03:54:00.147789] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-17T03:54:00.147888] [INFO ] [MAIN ] Update Progress: 891/2369 symbols completed. GAB took 41.0s. Estimated remaining: 3h 35m 28s. Rate: 6.9 symbols/min [2025-09-17T03:54:00.325370] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:00.356757] [DEBUG] [LOCAL ] GBCI: Loaded 29687 existing records from primary storage. [2025-09-17T03:54:00.356968] [INFO ] [MAIN ] GBCI: Loaded 29687 existing records. [2025-09-17T03:54:00.535923] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:00.536175] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-17T03:54:00.536248] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-17T03:54:00.537046] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-17T03:54:00.537126] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-17T03:54:00.699477] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-17T03:54:00.914462] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:01.174999] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T03:54:01.490143] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-17T03:54:01.916336] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T03:54:02.290203] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-17T03:54:02.548807] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T03:54:03.090133] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-17T03:54:03.890177] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-11. [2025-09-17T03:54:03.982693] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T03:54:04.690148] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-17T03:54:05.124355] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-17T03:54:05.495612] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-17T03:54:05.500147] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T03:54:06.290127] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-17T03:54:06.586581] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T03:54:06.633295] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T03:54:07.090136] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-17T03:54:07.712543] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T03:54:07.736784] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T03:54:07.890152] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-17T03:54:08.690200] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-17T03:54:09.055595] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T03:54:09.490150] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-17T03:54:10.188674] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T03:54:10.290093] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-17T03:54:10.575396] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T03:54:11.090128] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-17T03:54:11.803421] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T03:54:11.890140] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-17T03:54:12.690142] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-17T03:54:12.994412] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T03:54:13.105209] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T03:54:13.490191] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-17T03:54:14.192064] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T03:54:14.290168] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-17T03:54:15.090213] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-17T03:54:15.489947] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T03:54:15.890177] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-17T03:54:15.992190] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T03:54:16.067500] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T03:54:16.690180] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-17T03:54:16.791604] [DEBUG] [REMOTE ] GBAB: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-17T03:54:16.792040] [WARN ] [REMOTE ] GBAB: No data returned for month 2025-05 [2025-09-17T03:54:17.379004] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T03:54:17.385706] [INFO ] [REMOTE ] GAP: Full fetch complete (77493 records). [2025-09-17T03:54:17.385869] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-17T03:54:17.495206] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-17T03:54:17.781362] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-17T03:54:17.781496] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-17T03:54:17.782615] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-17T03:54:17.782752] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-17T03:54:17.784550] [DEBUG] [LOCAL ] GAP: Trimmed 77493 records to 53655 (keeping 200 days of data) [2025-09-17T03:54:18.121532] [DEBUG] [LOCAL ] GAP: Primary data saved (53655 records). [2025-09-17T03:54:18.121761] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-17T03:54:18.121896] [INFO ] [MAIN ] Update Progress: 892/2369 symbols completed. GAP took 47.2s. Estimated remaining: 3h 35m 34s. Rate: 6.9 symbols/min [2025-09-17T03:54:18.290686] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-17T03:54:18.292039] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:18.292980] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-17T03:54:18.293053] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-17T03:54:18.293205] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-17T03:54:18.293282] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-17T03:54:18.293355] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-17T03:54:18.293421] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-17T03:54:18.654728] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:19.063881] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T03:54:19.080675] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T03:54:19.090063] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-17T03:54:19.890149] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-17T03:54:20.120425] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T03:54:20.690144] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-11. [2025-09-17T03:54:20.964093] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-11 (0.27 seconds). [2025-09-17T03:54:21.330004] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T03:54:21.490175] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-17T03:54:22.290202] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-17T03:54:23.090139] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-17T03:54:23.376608] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T03:54:23.379581] [INFO ] [REMOTE ] GATX: Full fetch complete (25159 records). [2025-09-17T03:54:23.379718] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-17T03:54:23.774600] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-17T03:54:23.790716] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-17T03:54:23.791349] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-17T03:54:23.791611] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-17T03:54:23.793972] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-17T03:54:23.804508] [DEBUG] [LOCAL ] GATX: Trimmed 25159 records to 17895 (keeping 200 days of data) [2025-09-17T03:54:23.891694] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-17T03:54:23.924736] [DEBUG] [LOCAL ] GATX: Primary data saved (17895 records). [2025-09-17T03:54:23.924914] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-17T03:54:23.925018] [INFO ] [MAIN ] Update Progress: 893/2369 symbols completed. GATX took 34.3s. Estimated remaining: 3h 35m 21s. Rate: 6.9 symbols/min [2025-09-17T03:54:24.027480] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T03:54:24.100605] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:24.129005] [DEBUG] [LOCAL ] GBTG: Loaded 30025 existing records from primary storage. [2025-09-17T03:54:24.129186] [INFO ] [MAIN ] GBTG: Loaded 30025 existing records. [2025-09-17T03:54:24.315696] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:24.316001] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-17T03:54:24.316070] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-17T03:54:24.316833] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-17T03:54:24.316904] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-17T03:54:24.674775] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:24.690121] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-17T03:54:25.052472] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T03:54:25.420613] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T03:54:25.490077] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-17T03:54:26.290180] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-17T03:54:26.792752] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T03:54:26.798114] [INFO ] [REMOTE ] GBCI: Full fetch complete (57280 records). [2025-09-17T03:54:26.798271] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-17T03:54:27.096757] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-11. [2025-09-17T03:54:27.225721] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-17T03:54:27.234174] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-17T03:54:27.235676] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-17T03:54:27.235800] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-17T03:54:27.237201] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T03:54:27.242587] [DEBUG] [LOCAL ] GBCI: Trimmed 57280 records to 40052 (keeping 200 days of data) [2025-09-17T03:54:27.519765] [DEBUG] [LOCAL ] GBCI: Primary data saved (40052 records). [2025-09-17T03:54:27.519991] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-17T03:54:27.520114] [INFO ] [MAIN ] Update Progress: 894/2369 symbols completed. GBCI took 27.4s. Estimated remaining: 3h 35m 3s. Rate: 6.9 symbols/min [2025-09-17T03:54:27.713543] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:27.735289] [DEBUG] [LOCAL ] GBX: Loaded 20479 existing records from primary storage. [2025-09-17T03:54:27.735621] [INFO ] [MAIN ] GBX: Loaded 20479 existing records. [2025-09-17T03:54:27.895340] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-17T03:54:27.929532] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:27.929911] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-17T03:54:27.929981] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-17T03:54:27.930873] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-17T03:54:27.930944] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-17T03:54:28.309983] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:28.686172] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T03:54:28.688833] [INFO ] [REMOTE ] GBAB: Full fetch complete (19144 records). [2025-09-17T03:54:28.689023] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-17T03:54:28.700751] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-17T03:54:28.895722] [WARN ] [VALIDATOR ] GBAB: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T03:54:28.896509] [FATAL] [MAIN ] GBAB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:54:28.896579] [WARN ] [MAIN ] GBAB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:54:28.896634] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-17T03:54:28.896730] [DEBUG] [LOCAL ] GBAB: No primary data file found to delete. [2025-09-17T03:54:28.896773] [INFO ] [LOCAL ] GBAB: Starting deletion of derivative data. [2025-09-17T03:54:28.897194] [DEBUG] [LOCAL ] GBAB: Deleted derivative data file. [2025-09-17T03:54:28.897312] [INFO ] [MAIN ] Update Progress: 895/2369 symbols completed. GBAB took 35.5s. Estimated remaining: 3h 34m 42s. Rate: 6.9 symbols/min [2025-09-17T03:54:29.008439] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T03:54:29.037070] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T03:54:29.111455] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:29.146221] [DEBUG] [LOCAL ] GCI: Loaded 32576 existing records from primary storage. [2025-09-17T03:54:29.146419] [INFO ] [MAIN ] GCI: Loaded 32576 existing records. [2025-09-17T03:54:29.323378] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:29.323662] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-17T03:54:29.323725] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-17T03:54:29.324350] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-17T03:54:29.324408] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-17T03:54:29.495388] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-17T03:54:29.709226] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:29.987610] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-17T03:54:30.290149] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-11. [2025-09-17T03:54:31.090148] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-17T03:54:31.455219] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T03:54:31.763124] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T03:54:31.890170] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-17T03:54:32.347449] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T03:54:32.690123] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-11. [2025-09-17T03:54:33.490223] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-17T03:54:33.969564] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T03:54:34.290168] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-17T03:54:34.986396] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T03:54:35.090135] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-17T03:54:35.269186] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T03:54:35.890112] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-17T03:54:36.256223] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T03:54:36.273890] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T03:54:36.690182] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-17T03:54:37.490171] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-17T03:54:38.274712] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T03:54:38.290076] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-17T03:54:38.906113] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T03:54:39.090172] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-17T03:54:39.770224] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T03:54:39.890163] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-17T03:54:40.467675] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T03:54:40.690134] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-17T03:54:41.186373] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T03:54:41.206179] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T03:54:41.490150] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-17T03:54:42.290152] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-17T03:54:43.019511] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T03:54:43.090112] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-17T03:54:43.669526] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T03:54:43.890148] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-17T03:54:44.361158] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T03:54:44.549751] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T03:54:44.690128] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-17T03:54:45.490158] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-17T03:54:46.019229] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T03:54:46.290145] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-17T03:54:46.568749] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-17T03:54:46.569536] [INFO ] [REMOTE ] GBLI: Full fetch complete (1451 records). [2025-09-17T03:54:46.569631] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-17T03:54:46.757458] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-17T03:54:46.757722] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:54:46.757797] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:54:46.757867] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-17T03:54:46.757961] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-17T03:54:46.758028] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-17T03:54:46.758102] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-17T03:54:46.758194] [INFO ] [MAIN ] Update Progress: 896/2369 symbols completed. GBLI took 28.6s. Estimated remaining: 3h 34m 49s. Rate: 6.9 symbols/min [2025-09-17T03:54:46.939386] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:46.979991] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T03:54:47.006872] [DEBUG] [LOCAL ] GCO: Loaded 17442 existing records from primary storage. [2025-09-17T03:54:47.007044] [INFO ] [MAIN ] GCO: Loaded 17442 existing records. [2025-09-17T03:54:47.095298] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-17T03:54:47.192419] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:47.192701] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-17T03:54:47.192779] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-17T03:54:47.193270] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-17T03:54:47.193343] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-17T03:54:47.549034] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:47.890147] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-11. [2025-09-17T03:54:48.484759] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T03:54:48.690139] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-17T03:54:48.918933] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:54:49.490129] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-17T03:54:50.291471] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-17T03:54:50.300061] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T03:54:51.090199] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-17T03:54:51.248982] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T03:54:51.380751] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T03:54:51.890206] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-17T03:54:52.690159] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-17T03:54:52.863514] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T03:54:53.013596] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T03:54:53.490145] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-17T03:54:53.540514] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T03:54:54.290171] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-17T03:54:54.586248] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T03:54:55.090190] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-17T03:54:55.790929] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T03:54:55.890142] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-17T03:54:56.170263] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T03:54:56.690141] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-17T03:54:57.285607] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T03:54:57.291197] [INFO ] [REMOTE ] GCI: Full fetch complete (62857 records). [2025-09-17T03:54:57.291396] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-17T03:54:57.504835] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-17T03:54:57.734835] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-17T03:54:57.735422] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T03:54:57.735612] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-17T03:54:57.741159] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-17T03:54:57.741388] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-17T03:54:57.742715] [DEBUG] [LOCAL ] GCI: Trimmed 62857 records to 44240 (keeping 200 days of data) [2025-09-17T03:54:57.991893] [DEBUG] [LOCAL ] GCI: Primary data saved (44240 records). [2025-09-17T03:54:57.992107] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-17T03:54:57.992214] [INFO ] [MAIN ] Update Progress: 897/2369 symbols completed. GCI took 29.1s. Estimated remaining: 3h 34m 44s. Rate: 6.9 symbols/min [2025-09-17T03:54:58.174900] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:54:58.192800] [DEBUG] [LOCAL ] GCTS: Loaded 15587 existing records from primary storage. [2025-09-17T03:54:58.192989] [INFO ] [MAIN ] GCTS: Loaded 15587 existing records. [2025-09-17T03:54:58.295310] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-17T03:54:58.397295] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:54:58.397604] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-17T03:54:58.397683] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-17T03:54:58.398174] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-17T03:54:58.398236] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-17T03:54:58.762896] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:54:59.000894] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T03:54:59.090147] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-11. [2025-09-17T03:54:59.873947] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T03:54:59.890750] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-17T03:54:59.894811] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T03:55:00.690122] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-17T03:55:01.320770] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T03:55:01.490192] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-17T03:55:02.220578] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T03:55:02.290132] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-17T03:55:02.792829] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T03:55:03.090147] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-17T03:55:03.533837] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T03:55:03.890134] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-17T03:55:04.605728] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T03:55:04.672722] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T03:55:04.690095] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-17T03:55:05.490134] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-17T03:55:05.704121] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T03:55:06.290144] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-17T03:55:06.723987] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T03:55:07.090136] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-17T03:55:07.441410] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T03:55:07.890158] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-17T03:55:08.144141] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T03:55:08.690107] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-17T03:55:08.931842] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T03:55:08.935513] [INFO ] [REMOTE ] GBX: Full fetch complete (42535 records). [2025-09-17T03:55:08.935719] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-17T03:55:09.341478] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-17T03:55:09.341623] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-17T03:55:09.342375] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-17T03:55:09.342461] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-17T03:55:09.343690] [DEBUG] [LOCAL ] GBX: Trimmed 42535 records to 29493 (keeping 200 days of data) [2025-09-17T03:55:09.498000] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-17T03:55:09.530664] [DEBUG] [LOCAL ] GBX: Primary data saved (29493 records). [2025-09-17T03:55:09.530783] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-17T03:55:09.530880] [INFO ] [MAIN ] Update Progress: 898/2369 symbols completed. GBX took 42.0s. Estimated remaining: 3h 34m 40s. Rate: 6.9 symbols/min [2025-09-17T03:55:09.702403] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:09.702591] [DEBUG] [LOCAL ] GCV: No existing data file found in primary storage. [2025-09-17T03:55:09.702639] [WARN ] [MAIN ] GCV: No existing data found, performing full refresh instead. [2025-09-17T03:55:09.702768] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-17T03:55:09.702817] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-17T03:55:09.702876] [DEBUG] [LOCAL ] GCV: No primary data file found to delete. [2025-09-17T03:55:09.702918] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-17T03:55:10.060379] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:10.072587] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T03:55:10.290122] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-17T03:55:10.506258] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T03:55:11.090151] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-11. [2025-09-17T03:55:11.358669] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T03:55:11.362171] [INFO ] [REMOTE ] GCO: Full fetch complete (36079 records). [2025-09-17T03:55:11.362306] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-17T03:55:11.738829] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-17T03:55:11.738934] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-17T03:55:11.739507] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-17T03:55:11.739566] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-17T03:55:11.740401] [DEBUG] [LOCAL ] GCO: Trimmed 36079 records to 25949 (keeping 200 days of data) [2025-09-17T03:55:11.848938] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T03:55:11.892974] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-17T03:55:11.903276] [DEBUG] [LOCAL ] GCO: Primary data saved (25949 records). [2025-09-17T03:55:11.903377] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-17T03:55:11.903468] [INFO ] [MAIN ] Update Progress: 899/2369 symbols completed. GCO took 25.1s. Estimated remaining: 3h 34m 21s. Rate: 6.9 symbols/min [2025-09-17T03:55:12.075053] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:12.109609] [DEBUG] [LOCAL ] GD: Loaded 34593 existing records from primary storage. [2025-09-17T03:55:12.109811] [INFO ] [MAIN ] GD: Loaded 34593 existing records. [2025-09-17T03:55:12.290049] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:55:12.290365] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-17T03:55:12.290425] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-17T03:55:12.291236] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-17T03:55:12.291299] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-17T03:55:12.653307] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:12.690107] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-11. [2025-09-17T03:55:13.320167] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T03:55:13.490166] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-17T03:55:14.160688] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T03:55:14.290135] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-17T03:55:14.468587] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T03:55:15.090194] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-17T03:55:15.176528] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T03:55:15.890153] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-17T03:55:16.239878] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T03:55:16.245062] [INFO ] [REMOTE ] GBTG: Full fetch complete (56594 records). [2025-09-17T03:55:16.245197] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-17T03:55:16.626662] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-17T03:55:16.626771] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-17T03:55:16.627542] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-17T03:55:16.627611] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-17T03:55:16.629079] [DEBUG] [LOCAL ] GBTG: Trimmed 56594 records to 40681 (keeping 200 days of data) [2025-09-17T03:55:16.713176] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-17T03:55:16.867054] [DEBUG] [LOCAL ] GBTG: Primary data saved (40681 records). [2025-09-17T03:55:16.867259] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-17T03:55:16.867392] [INFO ] [MAIN ] Update Progress: 900/2369 symbols completed. GBTG took 52.9s. Estimated remaining: 3h 34m 6s. Rate: 6.9 symbols/min [2025-09-17T03:55:17.038403] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:17.053716] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T03:55:17.095897] [DEBUG] [LOCAL ] GDDY: Loaded 36908 existing records from primary storage. [2025-09-17T03:55:17.096093] [INFO ] [MAIN ] GDDY: Loaded 36908 existing records. [2025-09-17T03:55:17.272974] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:55:17.273258] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-17T03:55:17.273335] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-17T03:55:17.274241] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-17T03:55:17.274347] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-17T03:55:17.496219] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-17T03:55:17.642099] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:18.143939] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T03:55:18.290207] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-17T03:55:18.595218] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T03:55:18.885993] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T03:55:19.090176] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-17T03:55:19.890149] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-17T03:55:20.322114] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T03:55:20.690124] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-17T03:55:21.490168] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-11. [2025-09-17T03:55:21.759295] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T03:55:22.178921] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T03:55:22.290135] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-17T03:55:23.090101] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-17T03:55:23.173049] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T03:55:23.194030] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T03:55:23.890138] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-17T03:55:24.690202] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-17T03:55:24.892492] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T03:55:25.160804] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T03:55:25.490170] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-17T03:55:25.777510] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T03:55:26.169485] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T03:55:26.290148] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-17T03:55:27.090166] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-17T03:55:27.890151] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-17T03:55:28.123888] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T03:55:28.156078] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T03:55:28.158953] [INFO ] [REMOTE ] GCTS: Full fetch complete (26486 records). [2025-09-17T03:55:28.159095] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-17T03:55:28.540705] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-17T03:55:28.540811] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-17T03:55:28.541315] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-17T03:55:28.541368] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-17T03:55:28.542255] [DEBUG] [LOCAL ] GCTS: Trimmed 26486 records to 19249 (keeping 200 days of data) [2025-09-17T03:55:28.650764] [DEBUG] [LOCAL ] GCTS: Primary data saved (19249 records). [2025-09-17T03:55:28.650954] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-17T03:55:28.651054] [INFO ] [MAIN ] Update Progress: 901/2369 symbols completed. GCTS took 30.7s. Estimated remaining: 3h 34m 2s. Rate: 6.9 symbols/min [2025-09-17T03:55:28.695257] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-17T03:55:28.790808] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T03:55:28.868903] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:28.873662] [DEBUG] [LOCAL ] GDIV: Loaded 2606 existing records from primary storage. [2025-09-17T03:55:28.873771] [INFO ] [MAIN ] GDIV: Loaded 2606 existing records. [2025-09-17T03:55:29.059711] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:55:29.060026] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-17T03:55:29.060088] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-17T03:55:29.060346] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-17T03:55:29.060404] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-17T03:55:29.414748] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:29.490132] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-11. [2025-09-17T03:55:30.002538] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T03:55:30.290120] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-17T03:55:30.354173] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T03:55:30.869272] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T03:55:31.090186] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-17T03:55:31.890176] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-17T03:55:32.462923] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T03:55:32.690220] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-17T03:55:32.865789] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T03:55:33.490186] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-17T03:55:34.290202] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-17T03:55:34.647967] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T03:55:34.948914] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T03:55:35.090168] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-17T03:55:35.224498] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T03:55:35.890173] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-17T03:55:35.908043] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T03:55:36.480214] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T03:55:36.690181] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-17T03:55:37.490211] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-17T03:55:38.105018] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T03:55:38.290173] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-17T03:55:38.460013] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:55:38.979090] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:55:39.090160] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-17T03:55:39.673595] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T03:55:39.890128] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-17T03:55:40.690224] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-17T03:55:41.490104] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-17T03:55:41.604159] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T03:55:42.073617] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T03:55:42.290118] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-17T03:55:42.349156] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T03:55:42.819218] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T03:55:43.090159] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-17T03:55:43.840059] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T03:55:43.890188] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-17T03:55:44.690252] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-17T03:55:45.490149] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-17T03:55:45.616318] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T03:55:45.875695] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-17T03:55:46.290201] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-17T03:55:46.378677] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T03:55:47.090154] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-17T03:55:47.105500] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T03:55:47.107341] [INFO ] [REMOTE ] GCV: Full fetch complete (9271 records). [2025-09-17T03:55:47.107458] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-17T03:55:47.478276] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-17T03:55:47.478437] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-17T03:55:47.478805] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-17T03:55:47.478871] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-17T03:55:47.479792] [DEBUG] [LOCAL ] GCV: Trimmed 9271 records to 7027 (keeping 200 days of data) [2025-09-17T03:55:47.523425] [DEBUG] [LOCAL ] GCV: Primary data saved (7027 records). [2025-09-17T03:55:47.523593] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-17T03:55:47.523741] [INFO ] [MAIN ] Update Progress: 902/2369 symbols completed. GCV took 38.0s. Estimated remaining: 3h 34m 10s. Rate: 6.9 symbols/min [2025-09-17T03:55:47.693725] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:47.693956] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-09-17T03:55:47.694001] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-09-17T03:55:47.694111] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-17T03:55:47.694168] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-17T03:55:47.694219] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-17T03:55:47.694268] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-17T03:55:47.901449] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-17T03:55:48.060131] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:48.479382] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T03:55:48.690107] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-17T03:55:48.853483] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T03:55:49.158452] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T03:55:49.159473] [INFO ] [REMOTE ] GDIV: Full fetch complete (5445 records). [2025-09-17T03:55:49.159584] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-17T03:55:49.495360] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-17T03:55:49.534678] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-17T03:55:49.534785] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-17T03:55:49.534999] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-17T03:55:49.535075] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-17T03:55:49.535562] [DEBUG] [LOCAL ] GDIV: Trimmed 5445 records to 3794 (keeping 200 days of data) [2025-09-17T03:55:49.560890] [DEBUG] [LOCAL ] GDIV: Primary data saved (3794 records). [2025-09-17T03:55:49.561086] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-17T03:55:49.561218] [INFO ] [MAIN ] Update Progress: 903/2369 symbols completed. GDIV took 20.9s. Estimated remaining: 3h 33m 50s. Rate: 6.9 symbols/min [2025-09-17T03:55:49.729965] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:55:49.738658] [DEBUG] [LOCAL ] GDO: Loaded 4393 existing records from primary storage. [2025-09-17T03:55:49.738790] [INFO ] [MAIN ] GDO: Loaded 4393 existing records. [2025-09-17T03:55:49.918500] [WARN ] [MAIN ] GDO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:55:49.918808] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-17T03:55:49.918882] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-17T03:55:49.919223] [DEBUG] [LOCAL ] GDO: Deleted primary data file. [2025-09-17T03:55:49.919297] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-17T03:55:50.274396] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:55:50.290135] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-11. [2025-09-17T03:55:51.090151] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-11. [2025-09-17T03:55:51.145005] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T03:55:51.409558] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-17T03:55:51.417554] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T03:55:51.890137] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-17T03:55:52.447096] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T03:55:52.690155] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-17T03:55:53.185444] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T03:55:53.490155] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-17T03:55:53.947036] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T03:55:54.290194] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-17T03:55:54.802086] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T03:55:55.090160] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-17T03:55:55.586406] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T03:55:55.890175] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-17T03:55:56.690182] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-17T03:55:57.213730] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T03:55:57.490133] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-17T03:55:57.734468] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T03:55:57.962217] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T03:55:58.290143] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-17T03:55:59.092686] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-17T03:55:59.095247] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T03:55:59.890148] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-17T03:56:00.476564] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:56:00.690183] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-17T03:56:00.751956] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T03:56:01.490317] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-17T03:56:01.539440] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T03:56:02.047554] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T03:56:02.290189] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-17T03:56:02.746035] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T03:56:02.747122] [INFO ] [REMOTE ] GDL: Full fetch complete (3530 records). [2025-09-17T03:56:02.747210] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-17T03:56:02.931078] [WARN ] [VALIDATOR ] GDL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T03:56:02.931329] [FATAL] [MAIN ] GDL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:56:02.931418] [WARN ] [MAIN ] GDL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:56:02.931489] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-17T03:56:02.931626] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-17T03:56:02.931737] [INFO ] [LOCAL ] GDL: Starting deletion of derivative data. [2025-09-17T03:56:02.931813] [DEBUG] [LOCAL ] GDL: No derivative data file found to delete. [2025-09-17T03:56:02.931926] [INFO ] [MAIN ] Update Progress: 904/2369 symbols completed. GDL took 15.4s. Estimated remaining: 3h 33m 49s. Rate: 6.9 symbols/min [2025-09-17T03:56:03.095962] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-17T03:56:03.109609] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:03.110821] [DEBUG] [LOCAL ] GDOT: No existing data file found in primary storage. [2025-09-17T03:56:03.110917] [WARN ] [MAIN ] GDOT: No existing data found, performing full refresh instead. [2025-09-17T03:56:03.111050] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-17T03:56:03.111113] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-17T03:56:03.111165] [DEBUG] [LOCAL ] GDOT: No primary data file found to delete. [2025-09-17T03:56:03.111208] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-17T03:56:03.482512] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:03.890156] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-17T03:56:04.491750] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T03:56:04.690108] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-17T03:56:04.735210] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T03:56:04.742967] [INFO ] [REMOTE ] GD: Full fetch complete (70526 records). [2025-09-17T03:56:04.743175] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-17T03:56:05.144455] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-17T03:56:05.144624] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-17T03:56:05.145687] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-17T03:56:05.145773] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-17T03:56:05.147416] [DEBUG] [LOCAL ] GD: Trimmed 70526 records to 47545 (keeping 200 days of data) [2025-09-17T03:56:05.452847] [DEBUG] [LOCAL ] GD: Primary data saved (47545 records). [2025-09-17T03:56:05.453033] [INFO ] [MAIN ] GD: Full history saved. [2025-09-17T03:56:05.453148] [INFO ] [MAIN ] Update Progress: 905/2369 symbols completed. GD took 53.5s. Estimated remaining: 3h 33m 30s. Rate: 6.9 symbols/min [2025-09-17T03:56:05.496978] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-17T03:56:05.630070] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:05.645594] [DEBUG] [LOCAL ] GDV: Loaded 14371 existing records from primary storage. [2025-09-17T03:56:05.645791] [INFO ] [MAIN ] GDV: Loaded 14371 existing records. [2025-09-17T03:56:05.829499] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:05.829903] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-17T03:56:05.829988] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-17T03:56:05.830516] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-17T03:56:05.830577] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-17T03:56:06.249899] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:06.256841] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T03:56:06.290111] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-11. [2025-09-17T03:56:06.345838] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T03:56:06.353059] [INFO ] [REMOTE ] GDDY: Full fetch complete (71087 records). [2025-09-17T03:56:06.353228] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-17T03:56:06.780397] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-17T03:56:06.780540] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-17T03:56:06.781507] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-17T03:56:06.781588] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-17T03:56:06.783190] [DEBUG] [LOCAL ] GDDY: Trimmed 71087 records to 49859 (keeping 200 days of data) [2025-09-17T03:56:07.090388] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-11. [2025-09-17T03:56:07.106773] [DEBUG] [LOCAL ] GDDY: Primary data saved (49859 records). [2025-09-17T03:56:07.106949] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-17T03:56:07.107069] [INFO ] [MAIN ] Update Progress: 906/2369 symbols completed. GDDY took 50.2s. Estimated remaining: 3h 33m 10s. Rate: 6.9 symbols/min [2025-09-17T03:56:07.291209] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:07.291517] [DEBUG] [LOCAL ] GE: No existing data file found in primary storage. [2025-09-17T03:56:07.291620] [WARN ] [MAIN ] GE: No existing data found, performing full refresh instead. [2025-09-17T03:56:07.298483] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-17T03:56:07.309753] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-17T03:56:07.309941] [DEBUG] [LOCAL ] GE: No primary data file found to delete. [2025-09-17T03:56:07.310281] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-17T03:56:07.317060] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:56:07.695170] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:07.890138] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-11. [2025-09-17T03:56:08.537529] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T03:56:08.690133] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-17T03:56:09.490154] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-17T03:56:10.002697] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-17T03:56:10.033191] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T03:56:10.290180] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-17T03:56:10.563788] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T03:56:11.090137] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-17T03:56:11.890123] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-17T03:56:12.070755] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T03:56:12.508387] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-17T03:56:12.690125] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-17T03:56:12.921296] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T03:56:13.401370] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T03:56:13.490148] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-17T03:56:14.136198] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T03:56:14.290183] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-17T03:56:14.940318] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T03:56:15.090130] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-17T03:56:15.683187] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:56:15.890154] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-17T03:56:16.690149] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-17T03:56:16.886190] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T03:56:17.490180] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-17T03:56:18.290182] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-17T03:56:18.395377] [DEBUG] [REMOTE ] GDO: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-17T03:56:18.395838] [WARN ] [REMOTE ] GDO: No data returned for month 2025-08 [2025-09-17T03:56:18.708123] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T03:56:18.822871] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T03:56:19.090135] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-17T03:56:19.890137] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-17T03:56:20.553242] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T03:56:20.554771] [INFO ] [REMOTE ] GDO: Full fetch complete (8596 records). [2025-09-17T03:56:20.554866] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-17T03:56:20.694968] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-17T03:56:20.755287] [WARN ] [VALIDATOR ] GDO: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T03:56:20.756106] [FATAL] [MAIN ] GDO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:56:20.756242] [WARN ] [MAIN ] GDO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:56:20.756306] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-17T03:56:20.756404] [DEBUG] [LOCAL ] GDO: No primary data file found to delete. [2025-09-17T03:56:20.756586] [INFO ] [LOCAL ] GDO: Starting deletion of derivative data. [2025-09-17T03:56:20.757006] [DEBUG] [LOCAL ] GDO: Deleted derivative data file. [2025-09-17T03:56:20.757127] [INFO ] [MAIN ] Update Progress: 907/2369 symbols completed. GDO took 31.2s. Estimated remaining: 3h 33m 9s. Rate: 6.9 symbols/min [2025-09-17T03:56:20.959261] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T03:56:20.961634] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:20.989678] [DEBUG] [LOCAL ] GEF: Loaded 15462 existing records from primary storage. [2025-09-17T03:56:20.989925] [INFO ] [MAIN ] GEF: Loaded 15462 existing records. [2025-09-17T03:56:21.170910] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:21.171182] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-17T03:56:21.171241] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-17T03:56:21.171758] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-17T03:56:21.171818] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-17T03:56:21.496159] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-17T03:56:21.537890] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:22.290152] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-17T03:56:22.614892] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T03:56:22.773200] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T03:56:23.090197] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-11. [2025-09-17T03:56:23.407278] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T03:56:23.839056] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T03:56:23.890135] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-17T03:56:24.690121] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-17T03:56:25.012757] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T03:56:25.490172] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-17T03:56:26.065615] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T03:56:26.290209] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-17T03:56:27.090118] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-17T03:56:27.401451] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T03:56:27.451806] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T03:56:27.890156] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-17T03:56:28.185760] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T03:56:28.690154] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-17T03:56:28.950169] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T03:56:29.490146] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-17T03:56:29.561665] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T03:56:30.290133] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-17T03:56:31.090156] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-17T03:56:31.401130] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T03:56:31.536587] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T03:56:31.890154] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-17T03:56:32.166635] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T03:56:32.690182] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-17T03:56:33.490188] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-17T03:56:33.815211] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T03:56:34.119521] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-17T03:56:34.290162] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-17T03:56:34.899716] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T03:56:35.090135] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-17T03:56:35.396848] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T03:56:35.890140] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-17T03:56:36.602911] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T03:56:36.690144] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-17T03:56:37.490141] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-17T03:56:38.138636] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T03:56:38.178578] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T03:56:38.290121] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-17T03:56:38.515544] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T03:56:39.090127] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-17T03:56:39.466877] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T03:56:39.471792] [INFO ] [REMOTE ] GDOT: Full fetch complete (51958 records). [2025-09-17T03:56:39.471935] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-17T03:56:39.856698] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-17T03:56:39.856813] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-17T03:56:39.857523] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-17T03:56:39.857581] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-17T03:56:39.859360] [DEBUG] [LOCAL ] GDOT: Trimmed 51958 records to 38629 (keeping 200 days of data) [2025-09-17T03:56:39.913811] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-17T03:56:40.095021] [DEBUG] [LOCAL ] GDOT: Primary data saved (38629 records). [2025-09-17T03:56:40.095219] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-17T03:56:40.095313] [INFO ] [MAIN ] Update Progress: 908/2369 symbols completed. GDOT took 37.2s. Estimated remaining: 3h 33m 17s. Rate: 6.9 symbols/min [2025-09-17T03:56:40.265073] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:40.289106] [DEBUG] [LOCAL ] GEL: Loaded 24970 existing records from primary storage. [2025-09-17T03:56:40.289282] [INFO ] [MAIN ] GEL: Loaded 24970 existing records. [2025-09-17T03:56:40.469125] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:40.469484] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-17T03:56:40.469727] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-17T03:56:40.476277] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-17T03:56:40.485503] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-17T03:56:40.532528] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T03:56:40.695265] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-17T03:56:40.812222] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T03:56:40.885491] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:41.490190] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-17T03:56:42.290224] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-17T03:56:42.418176] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T03:56:42.421594] [INFO ] [REMOTE ] GDV: Full fetch complete (28932 records). [2025-09-17T03:56:42.421833] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-17T03:56:42.814751] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-17T03:56:42.814860] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-17T03:56:42.815527] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-17T03:56:42.815582] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-17T03:56:42.816317] [DEBUG] [LOCAL ] GDV: Trimmed 28932 records to 20043 (keeping 200 days of data) [2025-09-17T03:56:42.937208] [DEBUG] [LOCAL ] GDV: Primary data saved (20043 records). [2025-09-17T03:56:42.937373] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-17T03:56:42.937473] [INFO ] [MAIN ] Update Progress: 909/2369 symbols completed. GDV took 37.5s. Estimated remaining: 3h 32m 59s. Rate: 6.9 symbols/min [2025-09-17T03:56:43.099729] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-11. [2025-09-17T03:56:43.112054] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:43.154738] [DEBUG] [LOCAL ] GENI: Loaded 39386 existing records from primary storage. [2025-09-17T03:56:43.154929] [INFO ] [MAIN ] GENI: Loaded 39386 existing records. [2025-09-17T03:56:43.350401] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-17T03:56:43.392225] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:43.392476] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-17T03:56:43.392535] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-17T03:56:43.393492] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-17T03:56:43.393555] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-17T03:56:43.777617] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:43.778869] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T03:56:43.890114] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-17T03:56:44.557379] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T03:56:44.690119] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-11. [2025-09-17T03:56:44.935797] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T03:56:45.490146] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-17T03:56:46.290101] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-17T03:56:46.349232] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T03:56:46.649966] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T03:56:47.090141] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-17T03:56:47.890134] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-17T03:56:48.430824] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T03:56:48.690181] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-17T03:56:48.754899] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T03:56:48.805146] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T03:56:48.808921] [INFO ] [REMOTE ] GEF: Full fetch complete (29203 records). [2025-09-17T03:56:48.809082] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-17T03:56:49.194866] [DEBUG] [VALIDATOR ] GEF: All expected trading days are present. [2025-09-17T03:56:49.195004] [DEBUG] [VALIDATOR ] GEF: Primary data validation passed. [2025-09-17T03:56:49.195671] [INFO ] [MAIN ] GEF: Fetched primary data is valid. [2025-09-17T03:56:49.195835] [DEBUG] [LOCAL ] GEF: Saving primary data. [2025-09-17T03:56:49.196733] [DEBUG] [LOCAL ] GEF: Trimmed 29203 records to 20730 (keeping 200 days of data) [2025-09-17T03:56:49.330105] [DEBUG] [LOCAL ] GEF: Primary data saved (20730 records). [2025-09-17T03:56:49.330275] [INFO ] [MAIN ] GEF: Full history saved. [2025-09-17T03:56:49.330381] [INFO ] [MAIN ] Update Progress: 910/2369 symbols completed. GEF took 28.6s. Estimated remaining: 3h 32m 46s. Rate: 6.9 symbols/min [2025-09-17T03:56:49.502473] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-17T03:56:49.511086] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:49.554483] [DEBUG] [LOCAL ] GEO: Loaded 38814 existing records from primary storage. [2025-09-17T03:56:49.554719] [INFO ] [MAIN ] GEO: Loaded 38814 existing records. [2025-09-17T03:56:49.735737] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:49.736003] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-17T03:56:49.736069] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-17T03:56:49.736927] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-17T03:56:49.736989] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-17T03:56:50.108470] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:50.131812] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T03:56:50.290144] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-11. [2025-09-17T03:56:51.090145] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-17T03:56:51.277962] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T03:56:51.890198] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-17T03:56:52.470436] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-11 (2.18 seconds). [2025-09-17T03:56:52.500623] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T03:56:52.690136] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-17T03:56:53.490183] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-17T03:56:53.991207] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-17T03:56:53.997905] [INFO ] [REMOTE ] GE: Full fetch complete (77671 records). [2025-09-17T03:56:53.998071] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-17T03:56:54.293790] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-17T03:56:54.423540] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-17T03:56:54.423732] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-17T03:56:54.424808] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-17T03:56:54.424896] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-17T03:56:54.452313] [DEBUG] [LOCAL ] GE: Trimmed 77671 records to 53715 (keeping 200 days of data) [2025-09-17T03:56:54.453840] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T03:56:54.816084] [DEBUG] [LOCAL ] GE: Primary data saved (53715 records). [2025-09-17T03:56:54.816287] [INFO ] [MAIN ] GE: Full history saved. [2025-09-17T03:56:54.816412] [INFO ] [MAIN ] Update Progress: 911/2369 symbols completed. GE took 47.7s. Estimated remaining: 3h 32m 32s. Rate: 6.9 symbols/min [2025-09-17T03:56:55.011586] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:56:55.054901] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T03:56:55.093897] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-17T03:56:55.095452] [DEBUG] [LOCAL ] GES: Loaded 28333 existing records from primary storage. [2025-09-17T03:56:55.096755] [INFO ] [MAIN ] GES: Loaded 28333 existing records. [2025-09-17T03:56:55.301602] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:56:55.301917] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-17T03:56:55.301980] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-17T03:56:55.302814] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-17T03:56:55.302882] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-17T03:56:55.660283] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:56:55.890165] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-17T03:56:56.196357] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T03:56:56.236824] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T03:56:56.690189] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-17T03:56:57.490225] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-11. [2025-09-17T03:56:57.692444] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T03:56:58.290118] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-17T03:56:58.399170] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T03:56:58.605887] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T03:56:59.090193] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-17T03:56:59.890159] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-17T03:57:00.300223] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T03:57:00.596776] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T03:57:00.690106] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-17T03:57:01.356157] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T03:57:01.490132] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-17T03:57:02.290139] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-17T03:57:02.697812] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T03:57:03.090137] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-17T03:57:03.890164] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-17T03:57:04.315054] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (2.82 seconds). [2025-09-17T03:57:04.690130] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-17T03:57:05.121333] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (2.83 seconds). [2025-09-17T03:57:05.490285] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-17T03:57:05.490218] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-17T03:57:05.980038] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T03:57:06.117675] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-17T03:57:06.290135] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-17T03:57:07.090149] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-17T03:57:07.353867] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T03:57:07.740442] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T03:57:07.890151] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-17T03:57:08.690142] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-17T03:57:08.890750] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T03:57:09.490164] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-17T03:57:09.859084] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T03:57:10.268764] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T03:57:10.290073] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-17T03:57:11.090158] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-17T03:57:11.384568] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T03:57:11.890203] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-17T03:57:12.030813] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T03:57:12.324553] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:57:12.328354] [INFO ] [REMOTE ] GEL: Full fetch complete (48705 records). [2025-09-17T03:57:12.328460] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-17T03:57:12.720079] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-17T03:57:12.739112] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-17T03:57:12.739233] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-17T03:57:12.739968] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-17T03:57:12.740029] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-17T03:57:12.741431] [DEBUG] [LOCAL ] GEL: Trimmed 48705 records to 34694 (keeping 200 days of data) [2025-09-17T03:57:12.956567] [DEBUG] [LOCAL ] GEL: Primary data saved (34694 records). [2025-09-17T03:57:12.956786] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-17T03:57:12.956899] [INFO ] [MAIN ] Update Progress: 912/2369 symbols completed. GEL took 32.9s. Estimated remaining: 3h 32m 39s. Rate: 6.9 symbols/min [2025-09-17T03:57:13.138062] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:57:13.164732] [DEBUG] [LOCAL ] GETY: Loaded 25881 existing records from primary storage. [2025-09-17T03:57:13.164952] [INFO ] [MAIN ] GETY: Loaded 25881 existing records. [2025-09-17T03:57:13.351620] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:57:13.351883] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-17T03:57:13.351945] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-17T03:57:13.352682] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-17T03:57:13.352752] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-17T03:57:13.498750] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-17T03:57:13.732889] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:57:13.767766] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T03:57:14.212246] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T03:57:14.290171] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-11. [2025-09-17T03:57:15.090169] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-17T03:57:15.423527] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T03:57:15.484322] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T03:57:15.890148] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-17T03:57:16.690181] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-17T03:57:17.035622] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T03:57:17.490199] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-17T03:57:17.635967] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T03:57:17.642309] [INFO ] [REMOTE ] GENI: Full fetch complete (75246 records). [2025-09-17T03:57:17.642445] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-17T03:57:18.038019] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-17T03:57:18.038131] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-17T03:57:18.039168] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-17T03:57:18.039236] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-17T03:57:18.040793] [DEBUG] [LOCAL ] GENI: Trimmed 75246 records to 52869 (keeping 200 days of data) [2025-09-17T03:57:18.267714] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T03:57:18.290245] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-17T03:57:18.382521] [DEBUG] [LOCAL ] GENI: Primary data saved (52869 records). [2025-09-17T03:57:18.382732] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-17T03:57:18.382864] [INFO ] [MAIN ] Update Progress: 913/2369 symbols completed. GENI took 35.4s. Estimated remaining: 3h 32m 24s. Rate: 6.9 symbols/min [2025-09-17T03:57:18.561404] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:57:18.561666] [DEBUG] [LOCAL ] GEV: No existing data file found in primary storage. [2025-09-17T03:57:18.561761] [WARN ] [MAIN ] GEV: No existing data found, performing full refresh instead. [2025-09-17T03:57:18.561902] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-17T03:57:18.561968] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-17T03:57:18.562054] [DEBUG] [LOCAL ] GEV: No primary data file found to delete. [2025-09-17T03:57:18.562115] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-17T03:57:18.945416] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:57:19.090138] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-17T03:57:19.857080] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-17T03:57:19.890208] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-17T03:57:20.656399] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-17T03:57:20.690081] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-17T03:57:21.310803] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-17T03:57:21.344063] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T03:57:21.490117] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-17T03:57:22.290204] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-11. [2025-09-17T03:57:22.331859] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T03:57:22.493549] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T03:57:23.090231] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-17T03:57:23.890187] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-17T03:57:24.496008] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-17T03:57:24.690163] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-17T03:57:24.780183] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T03:57:25.490154] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-17T03:57:25.536795] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T03:57:25.543226] [INFO ] [REMOTE ] GEO: Full fetch complete (75579 records). [2025-09-17T03:57:25.543368] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-17T03:57:25.941045] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-17T03:57:25.941181] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-17T03:57:25.942149] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-17T03:57:25.942222] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-17T03:57:25.943855] [DEBUG] [LOCAL ] GEO: Trimmed 75579 records to 52262 (keeping 200 days of data) [2025-09-17T03:57:26.290258] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-17T03:57:26.294821] [DEBUG] [LOCAL ] GEO: Primary data saved (52262 records). [2025-09-17T03:57:26.296634] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-17T03:57:26.296818] [INFO ] [MAIN ] Update Progress: 914/2369 symbols completed. GEO took 37.0s. Estimated remaining: 3h 32m 14s. Rate: 6.9 symbols/min [2025-09-17T03:57:26.481430] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:57:26.486720] [DEBUG] [LOCAL ] GF: Loaded 2114 existing records from primary storage. [2025-09-17T03:57:26.486883] [INFO ] [MAIN ] GF: Loaded 2114 existing records. [2025-09-17T03:57:26.679690] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:57:26.680083] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-17T03:57:26.680160] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-17T03:57:26.680493] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-17T03:57:26.680558] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-17T03:57:27.065430] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:57:27.092742] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T03:57:27.090431] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-11. [2025-09-17T03:57:27.135840] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-17T03:57:27.720595] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T03:57:27.726571] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T03:57:27.890108] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-17T03:57:28.690156] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-17T03:57:29.278211] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T03:57:29.490174] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-17T03:57:30.095805] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T03:57:30.290192] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-17T03:57:30.955808] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-17T03:57:31.090137] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-17T03:57:31.851240] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T03:57:31.890104] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-17T03:57:32.690156] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-17T03:57:33.189254] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:57:33.277040] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-17T03:57:33.490132] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-17T03:57:34.094852] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T03:57:34.099568] [INFO ] [REMOTE ] GES: Full fetch complete (60565 records). [2025-09-17T03:57:34.099731] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-17T03:57:34.298413] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-17T03:57:34.520225] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-17T03:57:34.520368] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-17T03:57:34.521312] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-17T03:57:34.521374] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-17T03:57:34.522866] [DEBUG] [LOCAL ] GES: Trimmed 60565 records to 40748 (keeping 200 days of data) [2025-09-17T03:57:34.772105] [DEBUG] [LOCAL ] GES: Primary data saved (40748 records). [2025-09-17T03:57:34.772272] [INFO ] [MAIN ] GES: Full history saved. [2025-09-17T03:57:34.772365] [INFO ] [MAIN ] Update Progress: 915/2369 symbols completed. GES took 40.0s. Estimated remaining: 3h 32m 5s. Rate: 6.9 symbols/min [2025-09-17T03:57:34.885922] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T03:57:34.955250] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:57:34.955896] [DEBUG] [LOCAL ] GFF: No existing data file found in primary storage. [2025-09-17T03:57:34.956012] [WARN ] [MAIN ] GFF: No existing data found, performing full refresh instead. [2025-09-17T03:57:34.956279] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-17T03:57:34.956438] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-17T03:57:34.956558] [DEBUG] [LOCAL ] GFF: No primary data file found to delete. [2025-09-17T03:57:34.956626] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-17T03:57:35.078814] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T03:57:35.094612] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-17T03:57:35.373904] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:57:35.652350] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T03:57:35.890226] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-11. [2025-09-17T03:57:36.690223] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-17T03:57:37.379702] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T03:57:37.490166] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-17T03:57:37.916882] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:57:37.921589] [INFO ] [REMOTE ] GETY: Full fetch complete (55839 records). [2025-09-17T03:57:37.921802] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-17T03:57:38.295585] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-17T03:57:38.317383] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-17T03:57:38.317511] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-17T03:57:38.318426] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-17T03:57:38.318596] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-17T03:57:38.319996] [DEBUG] [LOCAL ] GETY: Trimmed 55839 records to 36507 (keeping 200 days of data) [2025-09-17T03:57:38.531484] [DEBUG] [LOCAL ] GETY: Primary data saved (36507 records). [2025-09-17T03:57:38.531707] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-17T03:57:38.531814] [INFO ] [MAIN ] Update Progress: 916/2369 symbols completed. GETY took 25.6s. Estimated remaining: 3h 31m 49s. Rate: 6.9 symbols/min [2025-09-17T03:57:38.704160] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:57:38.745155] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T03:57:38.764049] [DEBUG] [LOCAL ] GFI: Loaded 39500 existing records from primary storage. [2025-09-17T03:57:38.764196] [INFO ] [MAIN ] GFI: Loaded 39500 existing records. [2025-09-17T03:57:38.948232] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:57:38.948487] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-17T03:57:38.948550] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-17T03:57:38.949410] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-17T03:57:38.949473] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-17T03:57:39.097582] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-17T03:57:39.308401] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:57:39.890150] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-11. [2025-09-17T03:57:39.931127] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T03:57:40.382307] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T03:57:40.690231] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-17T03:57:41.490210] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-17T03:57:41.882696] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T03:57:42.290152] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-17T03:57:42.857350] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T03:57:43.079546] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T03:57:43.090455] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-17T03:57:43.747720] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T03:57:43.890179] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-17T03:57:44.025421] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T03:57:44.459767] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T03:57:44.690175] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-17T03:57:45.490170] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-17T03:57:46.076915] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T03:57:46.245571] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T03:57:46.290166] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-17T03:57:47.090152] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-17T03:57:47.558445] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T03:57:47.890207] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-17T03:57:48.690148] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-17T03:57:48.729468] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-17T03:57:49.255792] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T03:57:49.266202] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T03:57:49.490204] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-17T03:57:50.290153] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-17T03:57:51.090157] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-17T03:57:51.508185] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T03:57:51.522378] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T03:57:51.523245] [INFO ] [REMOTE ] GF: Full fetch complete (5440 records). [2025-09-17T03:57:51.523350] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-17T03:57:51.893799] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-17T03:57:51.894314] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-17T03:57:51.895566] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-17T03:57:51.895995] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-17T03:57:51.896063] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-17T03:57:51.896965] [DEBUG] [LOCAL ] GF: Trimmed 5440 records to 3531 (keeping 200 days of data) [2025-09-17T03:57:51.921319] [DEBUG] [LOCAL ] GF: Primary data saved (3531 records). [2025-09-17T03:57:51.921485] [INFO ] [MAIN ] GF: Full history saved. [2025-09-17T03:57:51.921594] [INFO ] [MAIN ] Update Progress: 917/2369 symbols completed. GF took 25.6s. Estimated remaining: 3h 31m 47s. Rate: 6.9 symbols/min [2025-09-17T03:57:51.951143] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T03:57:52.690191] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-17T03:57:53.490152] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-17T03:57:54.398418] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-17T03:57:54.410426] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-17T03:57:54.806414] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T03:57:54.858595] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T03:57:55.090157] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-17T03:57:55.890165] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-17T03:57:56.726030] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-17T03:57:56.737711] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-17T03:57:57.243994] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-17T03:57:57.274243] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:57:57.280723] [INFO ] [REMOTE ] GEV: Full fetch complete (76899 records). [2025-09-17T03:57:57.280901] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-17T03:57:57.491866] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-17T03:57:57.695663] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-17T03:57:57.695785] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-17T03:57:57.696758] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-17T03:57:57.696849] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-17T03:57:57.719278] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T03:57:57.727114] [DEBUG] [LOCAL ] GEV: Trimmed 76899 records to 53182 (keeping 200 days of data) [2025-09-17T03:57:58.074698] [DEBUG] [LOCAL ] GEV: Primary data saved (53182 records). [2025-09-17T03:57:58.075029] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-17T03:57:58.075236] [INFO ] [MAIN ] Update Progress: 918/2369 symbols completed. GEV took 39.7s. Estimated remaining: 3h 31m 34s. Rate: 6.9 symbols/min [2025-09-17T03:57:58.290166] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-17T03:57:59.449166] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T03:57:59.461260] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-17T03:57:59.506798] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T03:57:59.890165] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-17T03:58:01.075807] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T03:58:01.082042] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-17T03:58:01.620949] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-17T03:58:01.632147] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-17T03:58:02.379932] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T03:58:02.386350] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-17T03:58:03.728090] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T03:58:03.739919] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-17T03:58:03.760502] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T03:58:03.890175] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-17T03:58:05.079533] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T03:58:05.084482] [INFO ] [REMOTE ] GFF: Full fetch complete (44322 records). [2025-09-17T03:58:05.084671] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-17T03:58:05.497631] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-17T03:58:05.497932] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-17T03:58:05.498901] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-17T03:58:05.499001] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-17T03:58:05.500551] [DEBUG] [LOCAL ] GFF: Trimmed 44322 records to 31300 (keeping 200 days of data) [2025-09-17T03:58:05.649752] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T03:58:05.667461] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-17T03:58:05.765372] [DEBUG] [LOCAL ] GFF: Primary data saved (31300 records). [2025-09-17T03:58:05.765607] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-17T03:58:05.765730] [INFO ] [MAIN ] Update Progress: 919/2369 symbols completed. GFF took 31.0s. Estimated remaining: 3h 31m 24s. Rate: 6.9 symbols/min [2025-09-17T03:58:07.658401] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-17T03:58:07.665563] [INFO ] [REMOTE ] GFI: Full fetch complete (76034 records). [2025-09-17T03:58:07.665760] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-17T03:58:08.059754] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-17T03:58:08.059912] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-17T03:58:08.060922] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-17T03:58:08.060994] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-17T03:58:08.062564] [DEBUG] [LOCAL ] GFI: Trimmed 76034 records to 53093 (keeping 200 days of data) [2025-09-17T03:58:08.405310] [DEBUG] [LOCAL ] GFI: Primary data saved (53093 records). [2025-09-17T03:58:08.405552] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-17T03:58:08.405730] [INFO ] [MAIN ] Update Progress: 920/2369 symbols completed. GFI took 29.9s. Estimated remaining: 3h 31m 6s. Rate: 6.9 symbols/min [2025-09-17T03:58:08.906260] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:09.027787] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:09.181590] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:09.215878] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:09.220422] [DEBUG] [LOCAL ] GFR: Loaded 5148 existing records from primary storage. [2025-09-17T03:58:09.220997] [INFO ] [MAIN ] GFR: Loaded 5148 existing records. [2025-09-17T03:58:09.330048] [DEBUG] [LOCAL ] GGG: Loaded 29913 existing records from primary storage. [2025-09-17T03:58:09.341559] [INFO ] [MAIN ] GGG: Loaded 29913 existing records. [2025-09-17T03:58:09.479944] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:09.517570] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-17T03:58:09.549563] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-17T03:58:09.574328] [DEBUG] [LOCAL ] GFL: Loaded 35126 existing records from primary storage. [2025-09-17T03:58:09.574572] [INFO ] [MAIN ] GFL: Loaded 35126 existing records. [2025-09-17T03:58:09.577118] [DEBUG] [LOCAL ] GGB: Loaded 38267 existing records from primary storage. [2025-09-17T03:58:09.577165] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-17T03:58:09.588537] [INFO ] [MAIN ] GGB: Loaded 38267 existing records. [2025-09-17T03:58:09.793987] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:09.688694] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-17T03:58:09.905697] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-17T03:58:10.013067] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-17T03:58:10.115550] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:10.139439] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-17T03:58:10.139537] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:10.145235] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-17T03:58:10.161111] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-17T03:58:10.145316] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-17T03:58:10.166622] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-17T03:58:10.186282] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-17T03:58:10.194739] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-17T03:58:10.272749] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-17T03:58:10.302638] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-17T03:58:10.434327] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-17T03:58:10.850031] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:10.974111] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-11. [2025-09-17T03:58:11.361274] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:11.403004] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-11. [2025-09-17T03:58:11.468485] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:11.515714] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-11. [2025-09-17T03:58:11.543235] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:11.544472] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-11. [2025-09-17T03:58:12.117027] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T03:58:12.120999] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-17T03:58:13.021881] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T03:58:13.030904] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-17T03:58:13.041304] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T03:58:13.045139] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-17T03:58:13.082570] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T03:58:13.092249] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-17T03:58:13.125838] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T03:58:13.135965] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-17T03:58:13.543546] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T03:58:13.546241] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-17T03:58:14.177716] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T03:58:14.180009] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-17T03:58:14.230275] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T03:58:14.298622] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-17T03:58:14.316938] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T03:58:14.928009] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T03:58:15.090103] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-17T03:58:15.135119] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T03:58:15.890163] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-17T03:58:15.919489] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T03:58:16.486709] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T03:58:16.690179] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-17T03:58:16.759991] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T03:58:17.490181] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-17T03:58:18.139808] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T03:58:18.290154] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-17T03:58:19.075439] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T03:58:19.090081] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-17T03:58:19.890183] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-17T03:58:20.124061] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T03:58:20.690136] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-17T03:58:20.903513] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T03:58:21.490112] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-17T03:58:21.529067] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T03:58:22.228192] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T03:58:22.290146] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-17T03:58:23.090159] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-17T03:58:23.162278] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T03:58:23.890140] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-17T03:58:24.038497] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T03:58:24.593742] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T03:58:24.690108] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-17T03:58:25.490134] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-17T03:58:25.610919] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:58:26.295170] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-17T03:58:26.311052] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T03:58:27.090166] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-17T03:58:27.133112] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T03:58:27.258973] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T03:58:27.890200] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-17T03:58:28.523587] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T03:58:28.690145] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-17T03:58:29.490183] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-17T03:58:29.605850] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T03:58:30.272218] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T03:58:30.286749] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T03:58:30.290256] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-17T03:58:31.090185] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-17T03:58:31.865263] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T03:58:31.890075] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-17T03:58:32.690210] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-17T03:58:32.749718] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T03:58:33.341827] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T03:58:33.364619] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T03:58:33.490152] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-17T03:58:34.290193] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-17T03:58:34.759592] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T03:58:34.764401] [INFO ] [REMOTE ] GGG: Full fetch complete (59213 records). [2025-09-17T03:58:34.764564] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-17T03:58:35.103954] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-17T03:58:35.161120] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-17T03:58:35.161276] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-17T03:58:35.162190] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-17T03:58:35.162273] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-17T03:58:35.163751] [DEBUG] [LOCAL ] GGG: Trimmed 59213 records to 41189 (keeping 200 days of data) [2025-09-17T03:58:35.423168] [DEBUG] [LOCAL ] GGG: Primary data saved (41189 records). [2025-09-17T03:58:35.423363] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-17T03:58:35.423474] [INFO ] [MAIN ] Update Progress: 921/2369 symbols completed. GGG took 27.0s. Estimated remaining: 3h 31m 26s. Rate: 6.8 symbols/min [2025-09-17T03:58:35.593428] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:35.605274] [DEBUG] [LOCAL ] GGT: Loaded 11129 existing records from primary storage. [2025-09-17T03:58:35.606305] [INFO ] [MAIN ] GGT: Loaded 11129 existing records. [2025-09-17T03:58:35.783139] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:35.783443] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-17T03:58:35.783536] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-17T03:58:35.783946] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-17T03:58:35.784006] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-17T03:58:35.895002] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-17T03:58:35.912601] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T03:58:36.158324] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:36.191117] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T03:58:36.690142] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-11. [2025-09-17T03:58:37.494955] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-17T03:58:37.496090] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T03:58:37.526811] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T03:58:38.290152] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-17T03:58:38.832271] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:58:38.833686] [INFO ] [REMOTE ] GFR: Full fetch complete (13055 records). [2025-09-17T03:58:38.833779] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-17T03:58:39.095341] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-17T03:58:39.202262] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-17T03:58:39.202377] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-17T03:58:39.202712] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-17T03:58:39.202892] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-17T03:58:39.203675] [DEBUG] [LOCAL ] GFR: Trimmed 13055 records to 8419 (keeping 200 days of data) [2025-09-17T03:58:39.276442] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T03:58:39.295003] [DEBUG] [LOCAL ] GFR: Primary data saved (8419 records). [2025-09-17T03:58:39.295144] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-17T03:58:39.295229] [INFO ] [MAIN ] Update Progress: 922/2369 symbols completed. GFR took 30.9s. Estimated remaining: 3h 31m 9s. Rate: 6.9 symbols/min [2025-09-17T03:58:39.463097] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:39.467048] [DEBUG] [LOCAL ] GGZ: Loaded 1704 existing records from primary storage. [2025-09-17T03:58:39.467184] [INFO ] [MAIN ] GGZ: Loaded 1704 existing records. [2025-09-17T03:58:39.648192] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:39.648487] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-17T03:58:39.648545] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-17T03:58:39.648798] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-17T03:58:39.648857] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-17T03:58:39.896953] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-17T03:58:40.001546] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:40.324258] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T03:58:40.330763] [INFO ] [REMOTE ] GFL: Full fetch complete (68529 records). [2025-09-17T03:58:40.330907] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-17T03:58:40.691245] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-17T03:58:40.727747] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-17T03:58:40.727880] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-17T03:58:40.728714] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-17T03:58:40.728808] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-17T03:58:40.730480] [DEBUG] [LOCAL ] GFL: Trimmed 68529 records to 48262 (keeping 200 days of data) [2025-09-17T03:58:41.029070] [DEBUG] [LOCAL ] GFL: Primary data saved (48262 records). [2025-09-17T03:58:41.029238] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-17T03:58:41.029329] [INFO ] [MAIN ] Update Progress: 923/2369 symbols completed. GFL took 32.6s. Estimated remaining: 3h 30m 49s. Rate: 6.9 symbols/min [2025-09-17T03:58:41.202921] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:41.207182] [DEBUG] [LOCAL ] GHC: Loaded 2082 existing records from primary storage. [2025-09-17T03:58:41.207286] [INFO ] [MAIN ] GHC: Loaded 2082 existing records. [2025-09-17T03:58:41.388927] [WARN ] [MAIN ] GHC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:58:41.389162] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-17T03:58:41.389224] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-17T03:58:41.389460] [DEBUG] [LOCAL ] GHC: Deleted primary data file. [2025-09-17T03:58:41.389518] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-17T03:58:41.492016] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-11. [2025-09-17T03:58:41.774682] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:41.775617] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T03:58:41.809895] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T03:58:41.865863] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T03:58:42.290160] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-17T03:58:43.090222] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-17T03:58:43.777871] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T03:58:43.784049] [INFO ] [REMOTE ] GGB: Full fetch complete (73776 records). [2025-09-17T03:58:43.784188] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-17T03:58:43.890875] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-11. [2025-09-17T03:58:43.914192] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T03:58:44.211498] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-17T03:58:44.211632] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-17T03:58:44.212555] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-17T03:58:44.212611] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-17T03:58:44.214175] [DEBUG] [LOCAL ] GGB: Trimmed 73776 records to 50999 (keeping 200 days of data) [2025-09-17T03:58:44.430140] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T03:58:44.530365] [DEBUG] [LOCAL ] GGB: Primary data saved (50999 records). [2025-09-17T03:58:44.530548] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-17T03:58:44.530671] [INFO ] [MAIN ] Update Progress: 924/2369 symbols completed. GGB took 36.1s. Estimated remaining: 3h 30m 32s. Rate: 6.9 symbols/min [2025-09-17T03:58:44.696954] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-17T03:58:44.717182] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:58:44.719245] [DEBUG] [LOCAL ] GHG: No existing data file found in primary storage. [2025-09-17T03:58:44.719391] [WARN ] [MAIN ] GHG: No existing data found, performing full refresh instead. [2025-09-17T03:58:44.719580] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-17T03:58:44.719713] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-17T03:58:44.719787] [DEBUG] [LOCAL ] GHG: No primary data file found to delete. [2025-09-17T03:58:44.719843] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-17T03:58:45.120176] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:58:45.173874] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T03:58:45.490188] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-11. [2025-09-17T03:58:45.880379] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T03:58:46.290180] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-17T03:58:46.874688] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T03:58:47.090180] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-17T03:58:47.623150] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T03:58:47.890188] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-17T03:58:48.428061] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T03:58:48.690165] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-17T03:58:49.489109] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T03:58:49.491491] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-17T03:58:49.984929] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T03:58:50.290165] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-17T03:58:51.090133] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-17T03:58:51.231565] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T03:58:51.646021] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T03:58:51.890133] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-17T03:58:52.389102] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T03:58:52.690134] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-17T03:58:53.490135] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-17T03:58:53.594735] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T03:58:54.107041] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T03:58:54.290159] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-17T03:58:54.722002] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T03:58:55.090141] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-17T03:58:55.564853] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T03:58:55.890165] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-17T03:58:56.400626] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T03:58:56.690140] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-17T03:58:57.159465] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T03:58:57.490188] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-17T03:58:57.971241] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T03:58:58.290132] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-17T03:58:58.825454] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T03:58:59.090148] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-17T03:58:59.477272] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T03:58:59.478200] [INFO ] [REMOTE ] GGZ: Full fetch complete (4120 records). [2025-09-17T03:58:59.478286] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-17T03:58:59.851489] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-17T03:58:59.851598] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-17T03:58:59.851764] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-17T03:58:59.851816] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-17T03:58:59.852206] [DEBUG] [LOCAL ] GGZ: Trimmed 4120 records to 2481 (keeping 200 days of data) [2025-09-17T03:58:59.868062] [DEBUG] [LOCAL ] GGZ: Primary data saved (2481 records). [2025-09-17T03:58:59.868158] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-17T03:58:59.868248] [INFO ] [MAIN ] Update Progress: 925/2369 symbols completed. GGZ took 20.6s. Estimated remaining: 3h 30m 34s. Rate: 6.9 symbols/min [2025-09-17T03:58:59.897799] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-17T03:59:00.057583] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:00.066729] [DEBUG] [LOCAL ] GHI: Loaded 5260 existing records from primary storage. [2025-09-17T03:59:00.066887] [INFO ] [MAIN ] GHI: Loaded 5260 existing records. [2025-09-17T03:59:00.264421] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:00.264783] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-17T03:59:00.264854] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-17T03:59:00.265307] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-17T03:59:00.265380] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-17T03:59:00.377132] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T03:59:00.648985] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:00.690187] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-11. [2025-09-17T03:59:01.490134] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-17T03:59:01.623805] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T03:59:02.066476] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T03:59:02.290134] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-17T03:59:02.817321] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T03:59:03.090137] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-17T03:59:03.549980] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T03:59:03.890145] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-17T03:59:04.690119] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-17T03:59:04.993134] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T03:59:05.490128] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-17T03:59:05.705130] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T03:59:05.963919] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T03:59:06.290158] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-17T03:59:07.090113] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-17T03:59:07.324678] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T03:59:07.890133] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-17T03:59:07.923532] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T03:59:08.640850] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T03:59:08.690129] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-17T03:59:09.291568] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T03:59:09.490144] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-17T03:59:10.077968] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T03:59:10.290151] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-17T03:59:10.775488] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T03:59:11.090157] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-17T03:59:11.718428] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T03:59:11.890232] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-17T03:59:12.690213] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-17T03:59:12.827259] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T03:59:13.277277] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T03:59:13.490160] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-17T03:59:14.015322] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T03:59:14.290243] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-17T03:59:15.090230] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-17T03:59:15.151802] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T03:59:15.154223] [INFO ] [REMOTE ] GGT: Full fetch complete (18602 records). [2025-09-17T03:59:15.154328] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-17T03:59:15.538999] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-17T03:59:15.539145] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-17T03:59:15.539733] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-17T03:59:15.539793] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-17T03:59:15.540584] [DEBUG] [LOCAL ] GGT: Trimmed 18602 records to 14137 (keeping 200 days of data) [2025-09-17T03:59:15.633431] [DEBUG] [LOCAL ] GGT: Primary data saved (14137 records). [2025-09-17T03:59:15.638263] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-17T03:59:15.638445] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T03:59:15.638716] [INFO ] [MAIN ] Update Progress: 926/2369 symbols completed. GGT took 40.2s. Estimated remaining: 3h 30m 36s. Rate: 6.9 symbols/min [2025-09-17T03:59:15.820766] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:15.828027] [DEBUG] [LOCAL ] GHLD: Loaded 3340 existing records from primary storage. [2025-09-17T03:59:15.828231] [INFO ] [MAIN ] GHLD: Loaded 3340 existing records. [2025-09-17T03:59:15.895309] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-17T03:59:16.013574] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:16.013884] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-17T03:59:16.013957] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-17T03:59:16.014326] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-17T03:59:16.014391] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-17T03:59:16.397944] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:16.568260] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T03:59:16.569404] [INFO ] [REMOTE ] GHG: Full fetch complete (3903 records). [2025-09-17T03:59:16.569493] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-17T03:59:16.695218] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-17T03:59:16.948929] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-17T03:59:16.949065] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-17T03:59:16.949265] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-17T03:59:16.949321] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-17T03:59:16.949805] [DEBUG] [LOCAL ] GHG: Trimmed 3903 records to 3131 (keeping 200 days of data) [2025-09-17T03:59:16.969091] [DEBUG] [LOCAL ] GHG: Primary data saved (3131 records). [2025-09-17T03:59:16.969298] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-17T03:59:16.969406] [INFO ] [MAIN ] Update Progress: 927/2369 symbols completed. GHG took 32.4s. Estimated remaining: 3h 30m 16s. Rate: 6.9 symbols/min [2025-09-17T03:59:17.171038] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:17.185979] [DEBUG] [LOCAL ] GHM: Loaded 10550 existing records from primary storage. [2025-09-17T03:59:17.186241] [INFO ] [MAIN ] GHM: Loaded 10550 existing records. [2025-09-17T03:59:17.299430] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T03:59:17.390768] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:17.391545] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-17T03:59:17.391621] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-17T03:59:17.392403] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-17T03:59:17.392478] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-17T03:59:17.495411] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-17T03:59:17.813337] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:18.231677] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T03:59:18.290117] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-17T03:59:19.066085] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T03:59:19.090193] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-11. [2025-09-17T03:59:19.890195] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-17T03:59:19.943556] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T03:59:20.005408] [DEBUG] [REMOTE ] GHC: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-17T03:59:20.005840] [WARN ] [REMOTE ] GHC: No data returned for month 2025-09 [2025-09-17T03:59:20.005950] [INFO ] [REMOTE ] GHC: Full fetch complete (2955 records). [2025-09-17T03:59:20.006050] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-17T03:59:20.006751] [FATAL] [VALIDATOR ] GHC: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T03:59:20.006837] [FATAL] [MAIN ] GHC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T03:59:20.006901] [WARN ] [MAIN ] GHC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T03:59:20.006967] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-17T03:59:20.007056] [DEBUG] [LOCAL ] GHC: No primary data file found to delete. [2025-09-17T03:59:20.007155] [INFO ] [LOCAL ] GHC: Starting deletion of derivative data. [2025-09-17T03:59:20.007525] [DEBUG] [LOCAL ] GHC: Deleted derivative data file. [2025-09-17T03:59:20.007673] [INFO ] [MAIN ] Update Progress: 928/2369 symbols completed. GHC took 39.0s. Estimated remaining: 3h 29m 58s. Rate: 6.9 symbols/min [2025-09-17T03:59:20.205208] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:20.222357] [DEBUG] [LOCAL ] GHY: Loaded 14955 existing records from primary storage. [2025-09-17T03:59:20.222526] [INFO ] [MAIN ] GHY: Loaded 14955 existing records. [2025-09-17T03:59:20.400425] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:20.400724] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-17T03:59:20.400785] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-17T03:59:20.401537] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-17T03:59:20.401601] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-17T03:59:20.695260] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-17T03:59:20.758296] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:21.383673] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T03:59:21.490161] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-17T03:59:22.189435] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T03:59:22.290102] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-17T03:59:22.951140] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T03:59:23.090177] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-11. [2025-09-17T03:59:23.431852] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-17T03:59:23.890136] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-17T03:59:24.678066] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T03:59:24.690103] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-17T03:59:25.460373] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T03:59:25.490093] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-17T03:59:26.145857] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T03:59:26.147198] [INFO ] [REMOTE ] GHI: Full fetch complete (11870 records). [2025-09-17T03:59:26.147282] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-17T03:59:26.296833] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-17T03:59:26.516705] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-17T03:59:26.516852] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-17T03:59:26.517415] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-17T03:59:26.517476] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-17T03:59:26.518066] [DEBUG] [LOCAL ] GHI: Trimmed 11870 records to 6996 (keeping 200 days of data) [2025-09-17T03:59:26.568571] [DEBUG] [LOCAL ] GHI: Primary data saved (6996 records). [2025-09-17T03:59:26.569094] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-17T03:59:26.569312] [INFO ] [MAIN ] Update Progress: 929/2369 symbols completed. GHI took 26.7s. Estimated remaining: 3h 29m 46s. Rate: 6.9 symbols/min [2025-09-17T03:59:26.752618] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:26.775913] [DEBUG] [LOCAL ] GIB: Loaded 22835 existing records from primary storage. [2025-09-17T03:59:26.776122] [INFO ] [MAIN ] GIB: Loaded 22835 existing records. [2025-09-17T03:59:26.968025] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:26.968300] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-17T03:59:26.968360] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-17T03:59:26.969085] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-17T03:59:26.969151] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-17T03:59:27.095252] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-17T03:59:27.338318] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:27.347545] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T03:59:27.648405] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T03:59:27.890171] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-17T03:59:28.342243] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T03:59:28.690158] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-11. [2025-09-17T03:59:29.490165] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-17T03:59:29.723858] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T03:59:30.200609] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T03:59:30.290197] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-17T03:59:31.090182] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-17T03:59:31.226877] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T03:59:31.382727] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-17T03:59:31.890163] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-11. [2025-09-17T03:59:32.690168] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-17T03:59:33.124931] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T03:59:33.490144] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-17T03:59:33.519322] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T03:59:33.821260] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T03:59:34.290372] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-17T03:59:34.725584] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T03:59:35.090214] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-17T03:59:35.890179] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-17T03:59:36.315941] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T03:59:36.690181] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-17T03:59:36.887606] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T03:59:37.490149] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-17T03:59:37.798590] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-17T03:59:38.125424] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T03:59:38.290153] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-17T03:59:38.927021] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T03:59:39.090132] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-17T03:59:39.890226] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-17T03:59:40.443135] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T03:59:40.690196] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-17T03:59:40.726097] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T03:59:41.392985] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T03:59:41.490277] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-17T03:59:42.290181] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-17T03:59:42.815424] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T03:59:43.090152] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-17T03:59:43.153595] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T03:59:43.890157] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-17T03:59:44.107910] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T03:59:44.690148] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-17T03:59:44.866186] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T03:59:45.422485] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T03:59:45.490162] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-17T03:59:46.290147] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-17T03:59:46.380392] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T03:59:47.090162] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-17T03:59:47.548008] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T03:59:47.628857] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T03:59:47.630097] [INFO ] [REMOTE ] GHLD: Full fetch complete (4612 records). [2025-09-17T03:59:47.630182] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-17T03:59:47.895397] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-17T03:59:48.014205] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-17T03:59:48.014384] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-17T03:59:48.014677] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-17T03:59:48.014778] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-17T03:59:48.015274] [DEBUG] [LOCAL ] GHLD: Trimmed 4612 records to 3990 (keeping 200 days of data) [2025-09-17T03:59:48.040982] [DEBUG] [LOCAL ] GHLD: Primary data saved (3990 records). [2025-09-17T03:59:48.041083] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-17T03:59:48.041183] [INFO ] [MAIN ] Update Progress: 930/2369 symbols completed. GHLD took 32.4s. Estimated remaining: 3h 29m 57s. Rate: 6.9 symbols/min [2025-09-17T03:59:48.210928] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T03:59:48.222529] [DEBUG] [LOCAL ] GIC: Loaded 9935 existing records from primary storage. [2025-09-17T03:59:48.222704] [INFO ] [MAIN ] GIC: Loaded 9935 existing records. [2025-09-17T03:59:48.398837] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T03:59:48.399114] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-17T03:59:48.399174] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-17T03:59:48.399711] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-17T03:59:48.399776] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-17T03:59:48.695392] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-17T03:59:48.765277] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T03:59:49.051104] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T03:59:49.490134] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-11. [2025-09-17T03:59:49.561190] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T03:59:50.290134] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-17T03:59:50.328668] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T03:59:51.090179] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-17T03:59:51.883998] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T03:59:51.892254] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-17T03:59:52.224336] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T03:59:52.690202] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-17T03:59:52.878181] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T03:59:53.490208] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-17T03:59:54.169305] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T03:59:54.290210] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-17T03:59:54.451699] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T03:59:55.090177] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-17T03:59:55.299675] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T03:59:55.890163] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-17T03:59:56.055604] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T03:59:56.690150] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-17T03:59:57.168497] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T03:59:57.490124] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-17T03:59:57.535766] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T03:59:58.290129] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-17T03:59:58.534071] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T03:59:59.090161] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-17T03:59:59.592010] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T03:59:59.890126] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-17T03:59:59.975482] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T03:59:59.978156] [INFO ] [REMOTE ] GHY: Full fetch complete (32048 records). [2025-09-17T03:59:59.978253] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-17T04:00:00.380969] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-17T04:00:00.381076] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-17T04:00:00.381668] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-17T04:00:00.381734] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-17T04:00:00.382753] [DEBUG] [LOCAL ] GHY: Trimmed 32048 records to 21321 (keeping 200 days of data) [2025-09-17T04:00:00.515541] [DEBUG] [LOCAL ] GHY: Primary data saved (21321 records). [2025-09-17T04:00:00.515727] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-17T04:00:00.515824] [INFO ] [MAIN ] Update Progress: 931/2369 symbols completed. GHY took 40.5s. Estimated remaining: 3h 29m 54s. Rate: 6.9 symbols/min [2025-09-17T04:00:00.686443] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:00.690132] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-17T04:00:00.720761] [DEBUG] [LOCAL ] GIL: Loaded 31974 existing records from primary storage. [2025-09-17T04:00:00.720962] [INFO ] [MAIN ] GIL: Loaded 31974 existing records. [2025-09-17T04:00:00.909287] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:00.909624] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-17T04:00:00.909717] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-17T04:00:00.910862] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-17T04:00:00.910944] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-17T04:00:01.315794] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:01.347184] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:00:01.490175] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-11. [2025-09-17T04:00:02.290175] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-17T04:00:03.090149] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-17T04:00:04.394490] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-11 (2.90 seconds). [2025-09-17T04:00:04.403487] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-17T04:00:05.352548] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (3.06 seconds). [2025-09-17T04:00:05.356218] [INFO ] [REMOTE ] GHM: Full fetch complete (21394 records). [2025-09-17T04:00:05.356418] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-17T04:00:05.573198] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (4.88 seconds). [2025-09-17T04:00:05.701320] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-17T04:00:05.805850] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-17T04:00:05.806148] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-17T04:00:05.806778] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-17T04:00:05.806850] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-17T04:00:05.808179] [DEBUG] [LOCAL ] GHM: Trimmed 21394 records to 14297 (keeping 200 days of data) [2025-09-17T04:00:05.899174] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-17T04:00:05.929994] [DEBUG] [LOCAL ] GHM: Primary data saved (14297 records). [2025-09-17T04:00:05.930469] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-17T04:00:05.930598] [INFO ] [MAIN ] Update Progress: 932/2369 symbols completed. GHM took 49.0s. Estimated remaining: 3h 29m 40s. Rate: 6.9 symbols/min [2025-09-17T04:00:05.966203] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-17T04:00:06.118935] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:06.157563] [DEBUG] [LOCAL ] GIS: Loaded 40031 existing records from primary storage. [2025-09-17T04:00:06.157786] [INFO ] [MAIN ] GIS: Loaded 40031 existing records. [2025-09-17T04:00:06.337262] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:06.338069] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-17T04:00:06.338149] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-17T04:00:06.339204] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-17T04:00:06.339275] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-17T04:00:06.655376] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-17T04:00:06.705121] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-17T04:00:06.747568] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:06.807065] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T04:00:07.040467] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T04:00:07.045964] [INFO ] [REMOTE ] GIB: Full fetch complete (44731 records). [2025-09-17T04:00:07.046268] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-17T04:00:07.095343] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-11. [2025-09-17T04:00:07.496933] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-17T04:00:07.497110] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-17T04:00:07.498146] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-17T04:00:07.498213] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-17T04:00:07.499973] [DEBUG] [LOCAL ] GIB: Trimmed 44731 records to 32607 (keeping 200 days of data) [2025-09-17T04:00:07.753783] [DEBUG] [LOCAL ] GIB: Primary data saved (32607 records). [2025-09-17T04:00:07.754038] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-17T04:00:07.754164] [INFO ] [MAIN ] Update Progress: 933/2369 symbols completed. GIB took 41.2s. Estimated remaining: 3h 29m 21s. Rate: 6.9 symbols/min [2025-09-17T04:00:07.895303] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-17T04:00:07.958313] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:07.991108] [DEBUG] [LOCAL ] GKOS: Loaded 31616 existing records from primary storage. [2025-09-17T04:00:07.991521] [INFO ] [MAIN ] GKOS: Loaded 31616 existing records. [2025-09-17T04:00:08.187086] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:08.187741] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-17T04:00:08.187822] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-17T04:00:08.188693] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-17T04:00:08.188762] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-17T04:00:08.376517] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T04:00:08.623566] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:08.690102] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-17T04:00:08.864533] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T04:00:08.883921] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T04:00:09.490149] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-11. [2025-09-17T04:00:10.268443] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T04:00:10.290085] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-17T04:00:10.573499] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T04:00:11.090150] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-17T04:00:11.514753] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T04:00:11.742476] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T04:00:11.890143] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-17T04:00:12.690168] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-17T04:00:13.490212] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-17T04:00:13.571709] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T04:00:13.760353] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T04:00:14.290376] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-17T04:00:14.806419] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:00:15.090186] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-17T04:00:15.890185] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-17T04:00:16.208415] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T04:00:16.230733] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T04:00:16.690191] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-17T04:00:17.490190] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-17T04:00:17.904414] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T04:00:17.927159] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T04:00:17.930010] [INFO ] [REMOTE ] GIC: Full fetch complete (20245 records). [2025-09-17T04:00:17.930112] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-17T04:00:18.295406] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-17T04:00:18.339835] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-17T04:00:18.339976] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-17T04:00:18.340730] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-17T04:00:18.340795] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-17T04:00:18.341575] [DEBUG] [LOCAL ] GIC: Trimmed 20245 records to 13894 (keeping 200 days of data) [2025-09-17T04:00:18.437703] [DEBUG] [LOCAL ] GIC: Primary data saved (13894 records). [2025-09-17T04:00:18.437951] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-17T04:00:18.438077] [INFO ] [MAIN ] Update Progress: 934/2369 symbols completed. GIC took 30.4s. Estimated remaining: 3h 29m 15s. Rate: 6.9 symbols/min [2025-09-17T04:00:18.674139] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:18.711560] [DEBUG] [LOCAL ] GL: Loaded 27947 existing records from primary storage. [2025-09-17T04:00:18.711863] [INFO ] [MAIN ] GL: Loaded 27947 existing records. [2025-09-17T04:00:18.908151] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:18.908480] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-17T04:00:18.908547] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-17T04:00:18.909519] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-17T04:00:18.909593] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-17T04:00:19.100985] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-17T04:00:19.289453] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:19.699423] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-17T04:00:19.890157] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-17T04:00:20.206461] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T04:00:20.381463] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:00:20.690147] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-17T04:00:21.490193] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-11. [2025-09-17T04:00:21.787824] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:00:22.205583] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T04:00:22.290193] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-17T04:00:22.996626] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T04:00:23.090163] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-17T04:00:23.477811] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T04:00:23.890189] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-17T04:00:24.693995] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-17T04:00:24.699513] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T04:00:25.376231] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T04:00:25.490154] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-17T04:00:25.983917] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T04:00:26.290225] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-17T04:00:26.926334] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T04:00:27.090193] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-17T04:00:27.890122] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-17T04:00:27.936545] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T04:00:28.268546] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T04:00:28.690134] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-17T04:00:29.124492] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T04:00:29.490211] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-17T04:00:30.290659] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T04:00:30.290759] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-17T04:00:30.979558] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T04:00:31.090197] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-17T04:00:31.521031] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T04:00:31.890200] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-17T04:00:32.453940] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T04:00:32.690189] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-17T04:00:33.490189] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-17T04:00:33.868676] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T04:00:34.284103] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:00:34.292900] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-17T04:00:34.980927] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T04:00:35.090177] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-17T04:00:35.791311] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T04:00:35.890151] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-17T04:00:36.690177] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-17T04:00:37.089409] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T04:00:37.182060] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T04:00:37.189758] [INFO ] [REMOTE ] GKOS: Full fetch complete (59392 records). [2025-09-17T04:00:37.189962] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-17T04:00:37.492058] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-17T04:00:37.596038] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-17T04:00:37.596219] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-17T04:00:37.597284] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-17T04:00:37.597391] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-17T04:00:37.598921] [DEBUG] [LOCAL ] GKOS: Trimmed 59392 records to 43083 (keeping 200 days of data) [2025-09-17T04:00:37.867029] [DEBUG] [LOCAL ] GKOS: Primary data saved (43083 records). [2025-09-17T04:00:37.867258] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-17T04:00:37.867397] [INFO ] [MAIN ] Update Progress: 935/2369 symbols completed. GKOS took 30.1s. Estimated remaining: 3h 29m 23s. Rate: 6.8 symbols/min [2025-09-17T04:00:38.054381] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:38.077666] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T04:00:38.119845] [DEBUG] [LOCAL ] GLOB: Loaded 35748 existing records from primary storage. [2025-09-17T04:00:38.120103] [INFO ] [MAIN ] GLOB: Loaded 35748 existing records. [2025-09-17T04:00:38.298012] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-17T04:00:38.308657] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:38.309801] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-17T04:00:38.309888] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-17T04:00:38.310846] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-17T04:00:38.310935] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-17T04:00:38.679635] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:39.090113] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-11. [2025-09-17T04:00:39.671500] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T04:00:39.875385] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T04:00:39.890067] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-17T04:00:40.575203] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T04:00:40.690201] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-17T04:00:41.072385] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T04:00:41.080374] [INFO ] [REMOTE ] GIL: Full fetch complete (60878 records). [2025-09-17T04:00:41.080778] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-17T04:00:41.496354] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-17T04:00:41.529527] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-17T04:00:41.529673] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-17T04:00:41.530564] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-17T04:00:41.530664] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-17T04:00:41.532848] [DEBUG] [LOCAL ] GIL: Trimmed 60878 records to 43031 (keeping 200 days of data) [2025-09-17T04:00:41.827924] [DEBUG] [LOCAL ] GIL: Primary data saved (43031 records). [2025-09-17T04:00:41.829345] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-17T04:00:41.829192] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T04:00:41.829589] [INFO ] [MAIN ] Update Progress: 936/2369 symbols completed. GIL took 41.3s. Estimated remaining: 3h 29m 6s. Rate: 6.9 symbols/min [2025-09-17T04:00:42.002917] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:42.003146] [DEBUG] [LOCAL ] GLP: No existing data file found in primary storage. [2025-09-17T04:00:42.003233] [WARN ] [MAIN ] GLP: No existing data found, performing full refresh instead. [2025-09-17T04:00:42.003346] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-17T04:00:42.003413] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-17T04:00:42.003466] [DEBUG] [LOCAL ] GLP: No primary data file found to delete. [2025-09-17T04:00:42.003516] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-17T04:00:42.295210] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-17T04:00:42.361681] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:43.090152] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-17T04:00:43.134371] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T04:00:43.737229] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T04:00:43.890155] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-17T04:00:44.690121] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-17T04:00:45.116983] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T04:00:45.152191] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T04:00:45.490198] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-17T04:00:46.138488] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:00:46.290223] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-11. [2025-09-17T04:00:46.832846] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T04:00:47.095244] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-17T04:00:47.119353] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T04:00:47.890176] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-17T04:00:48.513793] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T04:00:48.521571] [INFO ] [REMOTE ] GL: Full fetch complete (55572 records). [2025-09-17T04:00:48.521832] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-17T04:00:48.704406] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-17T04:00:48.925808] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-17T04:00:48.925917] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-17T04:00:48.926693] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-17T04:00:48.926751] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-17T04:00:48.927921] [DEBUG] [LOCAL ] GL: Trimmed 55572 records to 38346 (keeping 200 days of data) [2025-09-17T04:00:49.172891] [DEBUG] [LOCAL ] GL: Primary data saved (38346 records). [2025-09-17T04:00:49.173068] [INFO ] [MAIN ] GL: Full history saved. [2025-09-17T04:00:49.173179] [INFO ] [MAIN ] Update Progress: 937/2369 symbols completed. GL took 30.7s. Estimated remaining: 3h 28m 56s. Rate: 6.9 symbols/min [2025-09-17T04:00:49.344251] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:49.381076] [DEBUG] [LOCAL ] GLW: Loaded 39988 existing records from primary storage. [2025-09-17T04:00:49.381246] [INFO ] [MAIN ] GLW: Loaded 39988 existing records. [2025-09-17T04:00:49.494034] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-17T04:00:49.565891] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:49.566296] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-17T04:00:49.566421] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-17T04:00:49.575835] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-17T04:00:49.589341] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-17T04:00:49.639984] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T04:00:49.965140] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:50.290154] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-11. [2025-09-17T04:00:50.316628] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T04:00:50.772833] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-17T04:00:50.780101] [INFO ] [REMOTE ] GIS: Full fetch complete (77494 records). [2025-09-17T04:00:50.780296] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-17T04:00:51.095190] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-17T04:00:51.188144] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-17T04:00:51.188266] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-17T04:00:51.189224] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-17T04:00:51.189288] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-17T04:00:51.191003] [DEBUG] [LOCAL ] GIS: Trimmed 77494 records to 53674 (keeping 200 days of data) [2025-09-17T04:00:51.553384] [DEBUG] [LOCAL ] GIS: Primary data saved (53674 records). [2025-09-17T04:00:51.553674] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-17T04:00:51.553811] [INFO ] [MAIN ] Update Progress: 938/2369 symbols completed. GIS took 45.6s. Estimated remaining: 3h 28m 37s. Rate: 6.9 symbols/min [2025-09-17T04:00:51.730154] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:00:51.770986] [DEBUG] [LOCAL ] GM: Loaded 40079 existing records from primary storage. [2025-09-17T04:00:51.771151] [INFO ] [MAIN ] GM: Loaded 40079 existing records. [2025-09-17T04:00:51.894103] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-17T04:00:51.955970] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:00:51.956473] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-17T04:00:51.957025] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-17T04:00:51.965025] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-17T04:00:51.965201] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-17T04:00:52.003438] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T04:00:52.297308] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-17T04:00:52.385718] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:00:52.690152] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-17T04:00:53.490200] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-17T04:00:53.660622] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T04:00:54.280887] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T04:00:54.290116] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-17T04:00:54.542960] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T04:00:55.090140] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-11. [2025-09-17T04:00:55.152029] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T04:00:55.890139] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-17T04:00:56.690135] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-17T04:00:56.703853] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T04:00:57.417308] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-11 (2.33 seconds). [2025-09-17T04:00:57.490161] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-17T04:00:58.272472] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:00:58.290115] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-17T04:00:58.637546] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T04:00:59.051749] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T04:00:59.090145] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-17T04:00:59.793771] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T04:00:59.890140] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-17T04:01:00.690135] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-17T04:01:01.490203] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-17T04:01:01.745388] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T04:01:02.257956] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T04:01:02.290146] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-17T04:01:02.811282] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-17T04:01:03.090142] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-17T04:01:03.890193] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-17T04:01:03.960734] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T04:01:04.051682] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T04:01:04.054480] [INFO ] [REMOTE ] GLP: Full fetch complete (14303 records). [2025-09-17T04:01:04.054582] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-17T04:01:04.441798] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-17T04:01:04.441942] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-17T04:01:04.442439] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-17T04:01:04.442498] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-17T04:01:04.443130] [DEBUG] [LOCAL ] GLP: Trimmed 14303 records to 9587 (keeping 200 days of data) [2025-09-17T04:01:04.509407] [DEBUG] [LOCAL ] GLP: Primary data saved (9587 records). [2025-09-17T04:01:04.509697] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-17T04:01:04.509836] [INFO ] [MAIN ] Update Progress: 939/2369 symbols completed. GLP took 22.7s. Estimated remaining: 3h 28m 35s. Rate: 6.9 symbols/min [2025-09-17T04:01:04.685996] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:04.690194] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-17T04:01:04.737723] [DEBUG] [LOCAL ] GME: Loaded 40137 existing records from primary storage. [2025-09-17T04:01:04.737975] [INFO ] [MAIN ] GME: Loaded 40137 existing records. [2025-09-17T04:01:04.923468] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:04.923866] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-17T04:01:04.923935] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-17T04:01:04.926001] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-17T04:01:04.926083] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-17T04:01:05.301999] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:05.490165] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-17T04:01:05.787195] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:01:06.290220] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-11. [2025-09-17T04:01:06.927919] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-17T04:01:07.090203] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-17T04:01:07.185047] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T04:01:07.890197] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-17T04:01:08.690120] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-17T04:01:08.731819] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-11 (2.44 seconds). [2025-09-17T04:01:08.963759] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T04:01:09.490186] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-17T04:01:09.749656] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T04:01:10.290188] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-17T04:01:10.562996] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T04:01:11.090196] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-17T04:01:11.801981] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:01:11.810037] [INFO ] [REMOTE ] GLOB: Full fetch complete (62411 records). [2025-09-17T04:01:11.810277] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-17T04:01:11.895449] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-17T04:01:12.251929] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-17T04:01:12.252245] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-17T04:01:12.253334] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-17T04:01:12.253515] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-17T04:01:12.255578] [DEBUG] [LOCAL ] GLOB: Trimmed 62411 records to 47124 (keeping 200 days of data) [2025-09-17T04:01:12.385592] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.90 seconds). [2025-09-17T04:01:12.604778] [DEBUG] [LOCAL ] GLOB: Primary data saved (47124 records). [2025-09-17T04:01:12.605192] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-17T04:01:12.605374] [INFO ] [MAIN ] Update Progress: 940/2369 symbols completed. GLOB took 34.7s. Estimated remaining: 3h 28m 25s. Rate: 6.9 symbols/min [2025-09-17T04:01:12.695223] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-17T04:01:12.822925] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T04:01:12.841362] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:12.893836] [DEBUG] [LOCAL ] GMED: Loaded 35875 existing records from primary storage. [2025-09-17T04:01:12.894023] [INFO ] [MAIN ] GMED: Loaded 35875 existing records. [2025-09-17T04:01:13.073946] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:13.074234] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-17T04:01:13.074322] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-17T04:01:13.075102] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-17T04:01:13.075175] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-17T04:01:13.474471] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:13.490101] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-11. [2025-09-17T04:01:14.191095] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-17T04:01:14.290132] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-17T04:01:14.649901] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T04:01:15.090137] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-17T04:01:15.317544] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-17T04:01:15.890152] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-17T04:01:16.297117] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T04:01:16.690134] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-17T04:01:16.925374] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T04:01:17.490196] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-17T04:01:18.290116] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-17T04:01:18.331059] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-17T04:01:18.426519] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:01:18.614727] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T04:01:19.090155] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-17T04:01:19.890176] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-17T04:01:19.896048] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T04:01:20.690185] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-17T04:01:21.490217] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-17T04:01:21.537331] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.45 seconds). [2025-09-17T04:01:21.830610] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T04:01:22.290115] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-17T04:01:22.505028] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T04:01:23.066882] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T04:01:23.090090] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-17T04:01:23.890156] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-17T04:01:24.311250] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T04:01:24.697188] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-17T04:01:24.704975] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T04:01:25.490154] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-17T04:01:26.207117] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-17T04:01:26.290187] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-17T04:01:26.828444] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-17T04:01:26.837109] [INFO ] [REMOTE ] GLW: Full fetch complete (77479 records). [2025-09-17T04:01:26.837368] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-17T04:01:27.095288] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-17T04:01:27.244747] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-17T04:01:27.244864] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-17T04:01:27.246002] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-17T04:01:27.246068] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-17T04:01:27.247732] [DEBUG] [LOCAL ] GLW: Trimmed 77479 records to 53635 (keeping 200 days of data) [2025-09-17T04:01:27.392748] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T04:01:27.638121] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-09-17T04:01:27.638308] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-17T04:01:27.638414] [INFO ] [MAIN ] Update Progress: 941/2369 symbols completed. GLW took 38.5s. Estimated remaining: 3h 28m 26s. Rate: 6.9 symbols/min [2025-09-17T04:01:27.825803] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:27.852942] [DEBUG] [LOCAL ] GMRE: Loaded 28154 existing records from primary storage. [2025-09-17T04:01:27.853124] [INFO ] [MAIN ] GMRE: Loaded 28154 existing records. [2025-09-17T04:01:27.895873] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-17T04:01:28.037773] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:28.038208] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-17T04:01:28.038441] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-17T04:01:28.039185] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-17T04:01:28.039263] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-17T04:01:28.245185] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T04:01:28.439710] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:28.690202] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-17T04:01:29.430783] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-17T04:01:29.461617] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T04:01:29.468762] [INFO ] [REMOTE ] GM: Full fetch complete (77793 records). [2025-09-17T04:01:29.468958] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-17T04:01:29.502520] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-17T04:01:29.876596] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-17T04:01:29.876737] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-17T04:01:29.877722] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-17T04:01:29.877784] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-17T04:01:29.880034] [DEBUG] [LOCAL ] GM: Trimmed 77793 records to 53728 (keeping 200 days of data) [2025-09-17T04:01:30.215849] [DEBUG] [LOCAL ] GM: Primary data saved (53728 records). [2025-09-17T04:01:30.216040] [INFO ] [MAIN ] GM: Full history saved. [2025-09-17T04:01:30.216141] [INFO ] [MAIN ] Update Progress: 942/2369 symbols completed. GM took 38.7s. Estimated remaining: 3h 28m 8s. Rate: 6.9 symbols/min [2025-09-17T04:01:30.292514] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-11. [2025-09-17T04:01:30.401327] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:30.435700] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T04:01:30.451551] [DEBUG] [LOCAL ] GNE: Loaded 14670 existing records from primary storage. [2025-09-17T04:01:30.451713] [INFO ] [MAIN ] GNE: Loaded 14670 existing records. [2025-09-17T04:01:30.628312] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:30.628560] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-17T04:01:30.628618] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-17T04:01:30.629204] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-17T04:01:30.629267] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-17T04:01:30.983467] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:31.090103] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-11. [2025-09-17T04:01:31.703676] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T04:01:31.777575] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-17T04:01:31.847261] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T04:01:31.890111] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-17T04:01:32.690154] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-17T04:01:32.702901] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T04:01:33.490196] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-17T04:01:33.993193] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T04:01:34.290151] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-17T04:01:35.090190] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-17T04:01:35.622532] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T04:01:35.871239] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T04:01:35.890110] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-17T04:01:36.201077] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-17T04:01:36.664322] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T04:01:36.690189] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-17T04:01:37.490163] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-17T04:01:37.774573] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:01:38.285020] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T04:01:38.290079] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-17T04:01:39.090202] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-17T04:01:39.790963] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T04:01:39.890166] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-17T04:01:40.477209] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T04:01:40.670697] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T04:01:40.690099] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-17T04:01:41.490132] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-17T04:01:41.633353] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T04:01:42.290161] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-17T04:01:42.860558] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T04:01:43.090114] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-17T04:01:43.445835] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T04:01:43.890140] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-17T04:01:44.531543] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T04:01:44.690197] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-17T04:01:45.490156] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-17T04:01:45.706384] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T04:01:45.926175] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T04:01:46.290114] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-17T04:01:46.612701] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T04:01:47.090204] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-17T04:01:47.890198] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-17T04:01:47.949742] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T04:01:48.158153] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T04:01:48.690153] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-17T04:01:49.338016] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T04:01:49.490191] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-17T04:01:50.290157] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-17T04:01:50.778461] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T04:01:51.090147] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-17T04:01:51.186542] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-17T04:01:51.724613] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T04:01:51.730372] [INFO ] [REMOTE ] GMED: Full fetch complete (68722 records). [2025-09-17T04:01:51.730537] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-17T04:01:51.902260] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-17T04:01:52.146781] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-17T04:01:52.146931] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-17T04:01:52.148071] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-17T04:01:52.148152] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-17T04:01:52.149776] [DEBUG] [LOCAL ] GMED: Trimmed 68722 records to 48301 (keeping 200 days of data) [2025-09-17T04:01:52.440896] [DEBUG] [LOCAL ] GMED: Primary data saved (48301 records). [2025-09-17T04:01:52.441072] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-17T04:01:52.441170] [INFO ] [MAIN ] Update Progress: 943/2369 symbols completed. GMED took 39.8s. Estimated remaining: 3h 28m 19s. Rate: 6.8 symbols/min [2025-09-17T04:01:52.619363] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:52.645205] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T04:01:52.677343] [DEBUG] [LOCAL ] GNK: Loaded 29717 existing records from primary storage. [2025-09-17T04:01:52.677504] [INFO ] [MAIN ] GNK: Loaded 29717 existing records. [2025-09-17T04:01:52.698184] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-17T04:01:52.871115] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:52.872228] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-17T04:01:52.872299] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-17T04:01:52.873347] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-17T04:01:52.873417] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-17T04:01:53.246002] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:53.490179] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-11. [2025-09-17T04:01:54.226829] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T04:01:54.231617] [INFO ] [REMOTE ] GMRE: Full fetch complete (53128 records). [2025-09-17T04:01:54.231771] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-17T04:01:54.295350] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-17T04:01:54.624237] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-17T04:01:54.624397] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-17T04:01:54.625405] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-17T04:01:54.625606] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-17T04:01:54.627020] [DEBUG] [LOCAL ] GMRE: Trimmed 53128 records to 37664 (keeping 200 days of data) [2025-09-17T04:01:54.645607] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-17T04:01:54.740899] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-09-17T04:01:54.742863] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-17T04:01:55.275813] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-17T04:01:55.277117] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-17T04:01:55.280129] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-17T04:01:55.281031] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-17T04:01:55.306742] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53759 (keeping 200 days of data) [2025-09-17T04:01:55.308724] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T04:01:55.319242] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-17T04:01:55.329073] [DEBUG] [LOCAL ] GMRE: Primary data saved (37664 records). [2025-09-17T04:01:55.379441] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-17T04:01:55.379754] [INFO ] [MAIN ] Update Progress: 944/2369 symbols completed. GMRE took 27.7s. Estimated remaining: 3h 28m 2s. Rate: 6.9 symbols/min [2025-09-17T04:01:55.502625] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T04:01:55.535418] [INFO ] [REMOTE ] GNE: Full fetch complete (21950 records). [2025-09-17T04:01:55.547103] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-17T04:01:55.690549] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:55.943394] [DEBUG] [LOCAL ] GNL: Loaded 34634 existing records from primary storage. [2025-09-17T04:01:55.956151] [INFO ] [MAIN ] GNL: Loaded 34634 existing records. [2025-09-17T04:01:56.305926] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-17T04:01:56.350612] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:56.349714] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-17T04:01:56.353834] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-17T04:01:56.352374] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-17T04:01:56.356103] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-17T04:01:56.357093] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-17T04:01:56.357915] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-17T04:01:56.358508] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-17T04:01:56.405444] [DEBUG] [LOCAL ] GNE: Trimmed 21950 records to 17366 (keeping 200 days of data) [2025-09-17T04:01:56.854607] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:56.857447] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-11. [2025-09-17T04:01:56.895881] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T04:01:56.906084] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-17T04:01:56.999854] [DEBUG] [LOCAL ] GNE: Primary data saved (17366 records). [2025-09-17T04:01:57.000800] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-17T04:01:57.001950] [INFO ] [MAIN ] Update Progress: 945/2369 symbols completed. GNE took 26.8s. Estimated remaining: 3h 27m 42s. Rate: 6.9 symbols/min [2025-09-17T04:01:57.187955] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:57.197814] [DEBUG] [LOCAL ] GME: Primary data saved (53759 records). [2025-09-17T04:01:57.197991] [INFO ] [MAIN ] GME: Full history saved. [2025-09-17T04:01:57.198179] [INFO ] [MAIN ] Update Progress: 946/2369 symbols completed. GME took 52.7s. Estimated remaining: 3h 27m 21s. Rate: 6.9 symbols/min [2025-09-17T04:01:57.422264] [DEBUG] [LOCAL ] GNRC: Loaded 33506 existing records from primary storage. [2025-09-17T04:01:57.426509] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:01:57.426708] [INFO ] [MAIN ] GNRC: Loaded 33506 existing records. [2025-09-17T04:01:57.560443] [DEBUG] [LOCAL ] GNT: Loaded 5867 existing records from primary storage. [2025-09-17T04:01:57.584966] [INFO ] [MAIN ] GNT: Loaded 5867 existing records. [2025-09-17T04:01:57.701714] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:57.722869] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-17T04:01:57.722983] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-17T04:01:57.728888] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-17T04:01:57.744248] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-17T04:01:57.872807] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:01:57.909002] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-17T04:01:57.909174] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-17T04:01:57.925323] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-17T04:01:57.936167] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-17T04:01:58.378042] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:58.423081] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-11. [2025-09-17T04:01:58.544786] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:01:58.545334] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-11. [2025-09-17T04:01:58.565329] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:01:58.600698] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T04:01:59.090141] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-17T04:01:59.135054] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T04:01:59.890152] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-17T04:02:00.188124] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T04:02:00.461306] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T04:02:00.508993] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T04:02:00.690106] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-17T04:02:01.490135] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-17T04:02:02.210483] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T04:02:02.290125] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-17T04:02:03.090144] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-17T04:02:03.128830] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T04:02:03.685410] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T04:02:03.890134] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-17T04:02:03.964810] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T04:02:04.486697] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T04:02:04.690176] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-17T04:02:05.490193] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-17T04:02:06.301482] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-17T04:02:06.303753] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T04:02:07.090221] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-17T04:02:07.129799] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T04:02:07.803747] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T04:02:07.850285] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T04:02:07.890200] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-17T04:02:08.657690] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T04:02:08.690246] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-17T04:02:09.490221] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-17T04:02:10.290295] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-17T04:02:10.413400] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T04:02:11.090197] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-17T04:02:11.289861] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T04:02:11.791332] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T04:02:11.892000] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-17T04:02:11.899864] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T04:02:12.690187] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-17T04:02:13.443302] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T04:02:13.457381] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T04:02:13.490131] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-17T04:02:14.210456] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T04:02:14.290155] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-17T04:02:15.090187] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-17T04:02:15.813785] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T04:02:15.839913] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T04:02:15.890088] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-17T04:02:16.690174] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-17T04:02:16.867810] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T04:02:16.869778] [INFO ] [REMOTE ] GNT: Full fetch complete (10210 records). [2025-09-17T04:02:16.869868] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-17T04:02:17.242864] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-17T04:02:17.242995] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-17T04:02:17.243318] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-17T04:02:17.243376] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-17T04:02:17.243884] [DEBUG] [LOCAL ] GNT: Trimmed 10210 records to 7773 (keeping 200 days of data) [2025-09-17T04:02:17.289682] [DEBUG] [LOCAL ] GNT: Primary data saved (7773 records). [2025-09-17T04:02:17.289826] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-17T04:02:17.289929] [INFO ] [MAIN ] Update Progress: 947/2369 symbols completed. GNT took 20.1s. Estimated remaining: 3h 27m 29s. Rate: 6.9 symbols/min [2025-09-17T04:02:17.457698] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:02:17.464891] [DEBUG] [LOCAL ] GNTY: Loaded 5679 existing records from primary storage. [2025-09-17T04:02:17.465019] [INFO ] [MAIN ] GNTY: Loaded 5679 existing records. [2025-09-17T04:02:17.495394] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-17T04:02:17.642993] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:02:17.643219] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-17T04:02:17.643271] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-17T04:02:17.643504] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-17T04:02:17.643562] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-17T04:02:17.998591] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:02:18.198103] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T04:02:18.290155] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-11. [2025-09-17T04:02:18.743574] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T04:02:19.084739] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T04:02:19.092813] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-17T04:02:19.890143] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-17T04:02:20.700164] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-17T04:02:20.702106] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T04:02:21.500591] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-17T04:02:21.506543] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T04:02:21.910618] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T04:02:21.915662] [INFO ] [REMOTE ] GNK: Full fetch complete (57034 records). [2025-09-17T04:02:21.915807] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-17T04:02:22.301024] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-17T04:02:22.304118] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-17T04:02:22.304954] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-17T04:02:22.305858] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-17T04:02:22.305984] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-17T04:02:22.307560] [DEBUG] [LOCAL ] GNK: Trimmed 57034 records to 40999 (keeping 200 days of data) [2025-09-17T04:02:22.572788] [DEBUG] [LOCAL ] GNK: Primary data saved (40999 records). [2025-09-17T04:02:22.572948] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-17T04:02:22.573046] [INFO ] [MAIN ] Update Progress: 948/2369 symbols completed. GNK took 30.1s. Estimated remaining: 3h 27m 15s. Rate: 6.9 symbols/min [2025-09-17T04:02:22.782841] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:02:22.783269] [DEBUG] [LOCAL ] GNW: No existing data file found in primary storage. [2025-09-17T04:02:22.783322] [WARN ] [MAIN ] GNW: No existing data found, performing full refresh instead. [2025-09-17T04:02:22.783435] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-17T04:02:22.783487] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-17T04:02:22.783596] [DEBUG] [LOCAL ] GNW: No primary data file found to delete. [2025-09-17T04:02:22.783673] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-17T04:02:23.094937] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-17T04:02:23.156132] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:02:23.209231] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T04:02:23.604441] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T04:02:23.878737] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T04:02:23.890080] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-17T04:02:24.646171] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T04:02:24.690095] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-17T04:02:25.280792] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T04:02:25.490144] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-17T04:02:26.082852] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T04:02:26.290180] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-17T04:02:27.090186] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-17T04:02:27.890137] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-11. [2025-09-17T04:02:28.010830] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T04:02:28.697969] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-17T04:02:28.720853] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T04:02:29.095748] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T04:02:29.373444] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T04:02:29.490184] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-17T04:02:29.934969] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T04:02:30.290143] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-17T04:02:30.874546] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T04:02:31.090187] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-17T04:02:31.862455] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T04:02:31.890219] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-17T04:02:32.690183] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-17T04:02:33.495249] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-17T04:02:33.513881] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T04:02:34.007600] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:02:34.288523] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T04:02:34.291398] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-17T04:02:35.090149] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-17T04:02:35.724326] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T04:02:35.730422] [INFO ] [REMOTE ] GNL: Full fetch complete (68524 records). [2025-09-17T04:02:35.730609] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-17T04:02:35.899059] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-17T04:02:36.145112] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-17T04:02:36.145299] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-17T04:02:36.146260] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-17T04:02:36.146326] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-17T04:02:36.147806] [DEBUG] [LOCAL ] GNL: Trimmed 68524 records to 47603 (keeping 200 days of data) [2025-09-17T04:02:36.430327] [DEBUG] [LOCAL ] GNL: Primary data saved (47603 records). [2025-09-17T04:02:36.430507] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-17T04:02:36.430611] [INFO ] [MAIN ] Update Progress: 949/2369 symbols completed. GNL took 41.0s. Estimated remaining: 3h 27m 14s. Rate: 6.9 symbols/min [2025-09-17T04:02:36.602120] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:02:36.633933] [DEBUG] [LOCAL ] GOF: Loaded 31297 existing records from primary storage. [2025-09-17T04:02:36.634103] [INFO ] [MAIN ] GOF: Loaded 31297 existing records. [2025-09-17T04:02:36.697065] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-17T04:02:36.821248] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:02:36.822930] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T04:02:36.823234] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-17T04:02:36.825057] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-17T04:02:36.825445] [INFO ] [REMOTE ] GNTY: Full fetch complete (9983 records). [2025-09-17T04:02:36.840205] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-17T04:02:36.852160] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-17T04:02:36.852331] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-17T04:02:36.875618] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T04:02:37.494115] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-17T04:02:37.576413] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:02:37.639047] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-17T04:02:37.639167] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-17T04:02:37.639479] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-17T04:02:37.639540] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-17T04:02:37.640128] [DEBUG] [LOCAL ] GNTY: Trimmed 9983 records to 6938 (keeping 200 days of data) [2025-09-17T04:02:37.685979] [DEBUG] [LOCAL ] GNTY: Primary data saved (6938 records). [2025-09-17T04:02:37.686187] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-17T04:02:37.686326] [INFO ] [MAIN ] Update Progress: 950/2369 symbols completed. GNTY took 20.4s. Estimated remaining: 3h 26m 54s. Rate: 6.9 symbols/min [2025-09-17T04:02:37.876294] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:02:37.876547] [DEBUG] [LOCAL ] GOLF: No existing data file found in primary storage. [2025-09-17T04:02:37.876600] [WARN ] [MAIN ] GOLF: No existing data found, performing full refresh instead. [2025-09-17T04:02:37.876741] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-17T04:02:37.876810] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-17T04:02:37.876871] [DEBUG] [LOCAL ] GOLF: No primary data file found to delete. [2025-09-17T04:02:37.876912] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-17T04:02:38.243708] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:02:38.290087] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-11. [2025-09-17T04:02:38.368149] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T04:02:39.090154] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-11. [2025-09-17T04:02:39.249489] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T04:02:39.280138] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T04:02:39.890197] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-17T04:02:40.690204] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-17T04:02:40.740457] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T04:02:41.476207] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:02:41.490263] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-17T04:02:42.250971] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T04:02:42.290087] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-17T04:02:43.090137] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-17T04:02:43.116784] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T04:02:43.890130] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-17T04:02:44.025636] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T04:02:44.690143] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-17T04:02:44.814791] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T04:02:45.335571] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T04:02:45.490131] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-17T04:02:46.290151] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-17T04:02:46.456610] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T04:02:46.661393] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T04:02:46.667270] [INFO ] [REMOTE ] GNRC: Full fetch complete (64743 records). [2025-09-17T04:02:46.667444] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-17T04:02:47.067827] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-17T04:02:47.067958] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-17T04:02:47.068841] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-17T04:02:47.068903] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-17T04:02:47.070538] [DEBUG] [LOCAL ] GNRC: Trimmed 64743 records to 45192 (keeping 200 days of data) [2025-09-17T04:02:47.123706] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-17T04:02:47.353954] [DEBUG] [LOCAL ] GNRC: Primary data saved (45192 records). [2025-09-17T04:02:47.354157] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-17T04:02:47.354297] [INFO ] [MAIN ] Update Progress: 951/2369 symbols completed. GNRC took 50.4s. Estimated remaining: 3h 26m 46s. Rate: 6.9 symbols/min [2025-09-17T04:02:47.542432] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:02:47.542877] [DEBUG] [LOCAL ] GOOS: No existing data file found in primary storage. [2025-09-17T04:02:47.543027] [WARN ] [MAIN ] GOOS: No existing data found, performing full refresh instead. [2025-09-17T04:02:47.560368] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-17T04:02:47.563260] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-17T04:02:47.564871] [DEBUG] [LOCAL ] GOOS: No primary data file found to delete. [2025-09-17T04:02:47.564782] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T04:02:47.565077] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-17T04:02:47.895237] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-17T04:02:47.936982] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:02:48.690134] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-11. [2025-09-17T04:02:48.980694] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T04:02:49.030706] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T04:02:49.490161] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-17T04:02:50.205840] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T04:02:50.290170] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-17T04:02:50.947843] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T04:02:51.090170] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-17T04:02:51.398894] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T04:02:51.890178] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-17T04:02:52.690200] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-17T04:02:52.749580] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T04:02:53.490125] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-17T04:02:53.696376] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T04:02:54.290139] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-17T04:02:54.473386] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T04:02:54.559754] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T04:02:55.090198] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-17T04:02:55.310448] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T04:02:55.890167] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-17T04:02:56.556454] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T04:02:56.690136] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-17T04:02:57.417114] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T04:02:57.490121] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-17T04:02:57.817039] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T04:02:58.290136] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-17T04:02:58.956956] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T04:02:59.090082] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-17T04:02:59.885713] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T04:02:59.894850] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-17T04:03:00.645090] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T04:03:00.690093] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-17T04:03:01.398805] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T04:03:01.490122] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-17T04:03:02.290123] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-17T04:03:02.452286] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T04:03:03.090241] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-17T04:03:03.890169] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-17T04:03:05.238779] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (3.75 seconds). [2025-09-17T04:03:05.248443] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-17T04:03:05.331382] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T04:03:05.490099] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-17T04:03:05.539261] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (3.25 seconds). [2025-09-17T04:03:05.594581] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-17T04:03:06.290140] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-17T04:03:06.920178] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T04:03:07.090198] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-17T04:03:07.319713] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T04:03:07.890169] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-17T04:03:08.044595] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T04:03:08.051150] [INFO ] [REMOTE ] GNW: Full fetch complete (73166 records). [2025-09-17T04:03:08.051349] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-17T04:03:08.474464] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-17T04:03:08.474844] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-17T04:03:08.476189] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-17T04:03:08.476346] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-17T04:03:08.502609] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T04:03:08.506628] [DEBUG] [LOCAL ] GNW: Trimmed 73166 records to 51318 (keeping 200 days of data) [2025-09-17T04:03:08.692265] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-17T04:03:08.837598] [DEBUG] [LOCAL ] GNW: Primary data saved (51318 records). [2025-09-17T04:03:08.837838] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-17T04:03:08.837983] [INFO ] [MAIN ] Update Progress: 952/2369 symbols completed. GNW took 46.3s. Estimated remaining: 3h 26m 57s. Rate: 6.8 symbols/min [2025-09-17T04:03:09.011758] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:03:09.041492] [DEBUG] [LOCAL ] GOTU: Loaded 27891 existing records from primary storage. [2025-09-17T04:03:09.041712] [INFO ] [MAIN ] GOTU: Loaded 27891 existing records. [2025-09-17T04:03:09.241842] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:03:09.242431] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-17T04:03:09.242520] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-17T04:03:09.243689] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-17T04:03:09.243799] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-17T04:03:09.461651] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:03:09.498883] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-17T04:03:09.703856] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:03:09.974517] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T04:03:10.290180] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-17T04:03:10.930536] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:03:11.090245] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-11. [2025-09-17T04:03:11.791285] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:03:11.803435] [INFO ] [REMOTE ] GOOS: Full fetch complete (66209 records). [2025-09-17T04:03:11.803699] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-17T04:03:11.895294] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-17T04:03:12.253362] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-17T04:03:12.253545] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-17T04:03:12.255123] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-17T04:03:12.255213] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-17T04:03:12.258266] [DEBUG] [LOCAL ] GOOS: Trimmed 66209 records to 45921 (keeping 200 days of data) [2025-09-17T04:03:12.557314] [DEBUG] [LOCAL ] GOOS: Primary data saved (45921 records). [2025-09-17T04:03:12.557632] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-17T04:03:12.557967] [INFO ] [MAIN ] Update Progress: 953/2369 symbols completed. GOOS took 25.2s. Estimated remaining: 3h 26m 40s. Rate: 6.9 symbols/min [2025-09-17T04:03:12.709375] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-17T04:03:12.736566] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:03:12.738064] [DEBUG] [LOCAL ] GPC: No existing data file found in primary storage. [2025-09-17T04:03:12.753332] [WARN ] [MAIN ] GPC: No existing data found, performing full refresh instead. [2025-09-17T04:03:12.769961] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-17T04:03:12.770118] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-17T04:03:12.770488] [DEBUG] [LOCAL ] GPC: No primary data file found to delete. [2025-09-17T04:03:12.773475] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T04:03:12.773627] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-17T04:03:13.169116] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:03:13.216905] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T04:03:13.490178] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-17T04:03:14.290240] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-17T04:03:14.336295] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T04:03:14.343406] [INFO ] [REMOTE ] GOF: Full fetch complete (62103 records). [2025-09-17T04:03:14.343678] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-17T04:03:14.757092] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-17T04:03:14.762548] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-17T04:03:14.767896] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-17T04:03:14.769157] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T04:03:14.769283] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-17T04:03:14.774087] [DEBUG] [LOCAL ] GOF: Trimmed 62103 records to 43094 (keeping 200 days of data) [2025-09-17T04:03:14.774345] [INFO ] [REMOTE ] GOLF: Full fetch complete (44694 records). [2025-09-17T04:03:14.774504] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-17T04:03:15.095666] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-11. [2025-09-17T04:03:15.291221] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-17T04:03:15.293135] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-17T04:03:15.295228] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-17T04:03:15.295907] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-17T04:03:15.301421] [DEBUG] [LOCAL ] GOLF: Trimmed 44694 records to 32174 (keeping 200 days of data) [2025-09-17T04:03:15.612756] [DEBUG] [LOCAL ] GOF: Primary data saved (43094 records). [2025-09-17T04:03:15.615665] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-17T04:03:15.616912] [INFO ] [MAIN ] Update Progress: 954/2369 symbols completed. GOF took 39.2s. Estimated remaining: 3h 26m 23s. Rate: 6.9 symbols/min [2025-09-17T04:03:15.862574] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:03:15.911468] [DEBUG] [LOCAL ] GPI: Loaded 10230 existing records from primary storage. [2025-09-17T04:03:15.912999] [INFO ] [MAIN ] GPI: Loaded 10230 existing records. [2025-09-17T04:03:15.961380] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T04:03:16.028151] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-17T04:03:16.134964] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:03:16.138442] [DEBUG] [LOCAL ] GOLF: Primary data saved (32174 records). [2025-09-17T04:03:16.138948] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-17T04:03:16.139039] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-17T04:03:16.139224] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-17T04:03:16.139464] [INFO ] [MAIN ] Update Progress: 955/2369 symbols completed. GOLF took 38.5s. Estimated remaining: 3h 26m 2s. Rate: 6.9 symbols/min [2025-09-17T04:03:16.144998] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-17T04:03:16.172339] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-17T04:03:16.445561] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:03:16.510984] [DEBUG] [LOCAL ] GPJA: Loaded 3120 existing records from primary storage. [2025-09-17T04:03:16.561212] [INFO ] [MAIN ] GPJA: Loaded 3120 existing records. [2025-09-17T04:03:16.899826] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:03:16.929758] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-11. [2025-09-17T04:03:16.935571] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:03:16.936921] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-17T04:03:16.937007] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-17T04:03:16.937419] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-17T04:03:16.937507] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-17T04:03:17.313677] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:03:17.490198] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-11. [2025-09-17T04:03:17.731355] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-11 (2.64 seconds). [2025-09-17T04:03:18.057104] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T04:03:18.116788] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T04:03:18.283842] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-17T04:03:18.293145] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-17T04:03:18.764323] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T04:03:19.090199] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-17T04:03:19.890168] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-17T04:03:19.986952] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T04:03:20.545676] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T04:03:20.690207] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-17T04:03:21.490229] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-17T04:03:21.787882] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T04:03:22.290200] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-17T04:03:23.090202] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-17T04:03:23.201721] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T04:03:23.721915] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T04:03:23.891619] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T04:03:23.891831] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-17T04:03:24.690279] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-17T04:03:24.796014] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T04:03:25.490178] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-17T04:03:26.138812] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T04:03:26.290160] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-17T04:03:27.090122] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-17T04:03:27.173113] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T04:03:27.556528] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T04:03:27.812056] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T04:03:27.890157] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-17T04:03:28.690202] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-17T04:03:29.332681] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T04:03:29.490184] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-17T04:03:30.290170] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-17T04:03:30.414524] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T04:03:30.517681] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T04:03:30.851000] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T04:03:31.090174] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-17T04:03:31.487848] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-17T04:03:31.890205] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-17T04:03:32.690210] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-17T04:03:33.075963] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T04:03:33.295422] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T04:03:33.490167] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-17T04:03:34.290177] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-17T04:03:34.644909] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T04:03:34.862568] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T04:03:35.090186] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-17T04:03:35.890135] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-17T04:03:36.208536] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T04:03:36.690187] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-17T04:03:37.263514] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T04:03:37.414096] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:03:37.490152] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-17T04:03:38.052618] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T04:03:38.053872] [INFO ] [REMOTE ] GPJA: Full fetch complete (7292 records). [2025-09-17T04:03:38.053958] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-17T04:03:38.300233] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-17T04:03:38.463031] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-17T04:03:38.463175] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-17T04:03:38.463537] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-17T04:03:38.463590] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-17T04:03:38.464103] [DEBUG] [LOCAL ] GPJA: Trimmed 7292 records to 4018 (keeping 200 days of data) [2025-09-17T04:03:38.490485] [DEBUG] [LOCAL ] GPJA: Primary data saved (4018 records). [2025-09-17T04:03:38.490711] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-17T04:03:38.490839] [INFO ] [MAIN ] Update Progress: 956/2369 symbols completed. GPJA took 22.4s. Estimated remaining: 3h 26m 14s. Rate: 6.9 symbols/min [2025-09-17T04:03:38.673271] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:03:38.716881] [DEBUG] [LOCAL ] GPK: Loaded 39401 existing records from primary storage. [2025-09-17T04:03:38.717079] [INFO ] [MAIN ] GPK: Loaded 39401 existing records. [2025-09-17T04:03:38.900466] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:03:38.900848] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-17T04:03:38.900914] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-17T04:03:38.901935] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-17T04:03:38.901999] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-17T04:03:39.095392] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-17T04:03:39.269923] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:03:39.890210] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-17T04:03:40.126050] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T04:03:40.586571] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T04:03:40.599847] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T04:03:40.690113] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-17T04:03:41.490221] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-11. [2025-09-17T04:03:42.106585] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T04:03:42.112106] [INFO ] [REMOTE ] GOTU: Full fetch complete (60025 records). [2025-09-17T04:03:42.112268] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-17T04:03:42.296536] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-17T04:03:42.538170] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-17T04:03:42.538300] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-17T04:03:42.539285] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-17T04:03:42.539355] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-17T04:03:42.540838] [DEBUG] [LOCAL ] GOTU: Trimmed 60025 records to 39634 (keeping 200 days of data) [2025-09-17T04:03:42.780619] [DEBUG] [LOCAL ] GOTU: Primary data saved (39634 records). [2025-09-17T04:03:42.780838] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-17T04:03:42.780987] [INFO ] [MAIN ] Update Progress: 957/2369 symbols completed. GOTU took 33.9s. Estimated remaining: 3h 25m 58s. Rate: 6.9 symbols/min [2025-09-17T04:03:43.053115] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T04:03:43.090161] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-17T04:03:43.341023] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T04:03:43.890197] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-17T04:03:44.690265] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-17T04:03:44.778347] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T04:03:44.817392] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T04:03:45.490211] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-17T04:03:46.290143] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-17T04:03:46.400688] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T04:03:46.420541] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T04:03:47.090201] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-17T04:03:47.751879] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T04:03:47.782260] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T04:03:47.785132] [INFO ] [REMOTE ] GPI: Full fetch complete (20816 records). [2025-09-17T04:03:47.785276] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-17T04:03:47.895284] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-17T04:03:48.192097] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-17T04:03:48.192252] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-17T04:03:48.193389] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-17T04:03:48.193460] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-17T04:03:48.194475] [DEBUG] [LOCAL ] GPI: Trimmed 20816 records to 15155 (keeping 200 days of data) [2025-09-17T04:03:48.298397] [DEBUG] [LOCAL ] GPI: Primary data saved (15155 records). [2025-09-17T04:03:48.298660] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-17T04:03:48.298785] [INFO ] [MAIN ] Update Progress: 958/2369 symbols completed. GPI took 32.7s. Estimated remaining: 3h 25m 45s. Rate: 6.9 symbols/min [2025-09-17T04:03:48.690177] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-17T04:03:49.484984] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T04:03:49.496681] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-17T04:03:50.255792] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T04:03:50.290189] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-17T04:03:51.223946] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T04:03:51.235708] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-17T04:03:51.523259] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T04:03:51.890168] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-17T04:03:52.786144] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T04:03:52.796448] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-17T04:03:53.746633] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T04:03:53.758819] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-17T04:03:54.443369] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T04:03:54.449801] [INFO ] [REMOTE ] GPC: Full fetch complete (69061 records). [2025-09-17T04:03:54.450201] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-17T04:03:54.859816] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-17T04:03:54.859957] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-17T04:03:54.861073] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-17T04:03:54.861138] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-17T04:03:54.862856] [DEBUG] [LOCAL ] GPC: Trimmed 69061 records to 46858 (keeping 200 days of data) [2025-09-17T04:03:55.186164] [DEBUG] [LOCAL ] GPC: Primary data saved (46858 records). [2025-09-17T04:03:55.186424] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-17T04:03:55.186540] [INFO ] [MAIN ] Update Progress: 959/2369 symbols completed. GPC took 42.6s. Estimated remaining: 3h 25m 33s. Rate: 6.9 symbols/min [2025-09-17T04:03:55.512768] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T04:03:55.525134] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-17T04:03:57.161885] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T04:03:57.173873] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-17T04:03:58.876632] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T04:03:58.889280] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-17T04:04:00.740520] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T04:04:00.753189] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-17T04:04:02.532200] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T04:04:02.542828] [INFO ] [REMOTE ] GPK: Full fetch complete (75188 records). [2025-09-17T04:04:02.543132] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-17T04:04:02.959209] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-17T04:04:02.959449] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-17T04:04:02.960606] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-17T04:04:02.960709] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-17T04:04:02.962759] [DEBUG] [LOCAL ] GPK: Trimmed 75188 records to 52679 (keeping 200 days of data) [2025-09-17T04:04:03.329400] [DEBUG] [LOCAL ] GPK: Primary data saved (52679 records). [2025-09-17T04:04:03.329677] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-17T04:04:03.329805] [INFO ] [MAIN ] Update Progress: 960/2369 symbols completed. GPK took 24.8s. Estimated remaining: 3h 25m 24s. Rate: 6.9 symbols/min [2025-09-17T04:04:03.931554] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:04.061447] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:04.112848] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:04.117590] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:04.118218] [DEBUG] [LOCAL ] GPN: No existing data file found in primary storage. [2025-09-17T04:04:04.125836] [WARN ] [MAIN ] GPN: No existing data found, performing full refresh instead. [2025-09-17T04:04:04.126603] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-17T04:04:04.126857] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-17T04:04:04.127076] [DEBUG] [LOCAL ] GPN: No primary data file found to delete. [2025-09-17T04:04:04.127125] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-17T04:04:04.209803] [DEBUG] [LOCAL ] GPMT: Loaded 20304 existing records from primary storage. [2025-09-17T04:04:04.259707] [INFO ] [MAIN ] GPMT: Loaded 20304 existing records. [2025-09-17T04:04:04.408205] [DEBUG] [LOCAL ] GPOR: Loaded 16532 existing records from primary storage. [2025-09-17T04:04:04.477159] [DEBUG] [LOCAL ] GPRK: Loaded 28709 existing records from primary storage. [2025-09-17T04:04:04.464110] [INFO ] [MAIN ] GPOR: Loaded 16532 existing records. [2025-09-17T04:04:04.558529] [INFO ] [MAIN ] GPRK: Loaded 28709 existing records. [2025-09-17T04:04:04.844453] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:04.948779] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-17T04:04:05.009637] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:05.045235] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-11. [2025-09-17T04:04:05.043709] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-17T04:04:05.093854] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:05.093736] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-17T04:04:05.144602] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-17T04:04:05.144706] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-17T04:04:05.149838] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-17T04:04:05.155295] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:05.172148] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-17T04:04:05.189479] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-17T04:04:05.217132] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-17T04:04:05.217247] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-17T04:04:05.355502] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-17T04:04:05.379840] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-17T04:04:06.190266] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:06.183448] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:06.237128] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-11. [2025-09-17T04:04:06.268369] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-11. [2025-09-17T04:04:06.376973] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:06.377405] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-11. [2025-09-17T04:04:06.795199] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:04:06.805533] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-17T04:04:07.536875] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T04:04:07.543350] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-17T04:04:07.629788] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T04:04:07.647487] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-17T04:04:07.649532] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T04:04:07.655872] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-17T04:04:08.545740] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T04:04:08.556458] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-17T04:04:08.629761] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T04:04:08.639313] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-17T04:04:08.878421] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T04:04:08.884715] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-17T04:04:09.033670] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:04:09.041871] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-17T04:04:09.335855] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T04:04:09.341144] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-17T04:04:09.799225] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T04:04:09.805491] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-17T04:04:10.039589] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T04:04:10.049965] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-17T04:04:10.407832] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T04:04:10.413446] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-17T04:04:10.580364] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T04:04:10.589818] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-17T04:04:10.728395] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T04:04:11.090141] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-17T04:04:11.302989] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T04:04:11.756487] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T04:04:11.792432] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T04:04:11.891801] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-17T04:04:11.898598] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T04:04:12.690151] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-17T04:04:13.490218] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-17T04:04:13.596266] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T04:04:13.852545] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T04:04:14.290195] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-17T04:04:14.887313] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T04:04:15.090188] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-17T04:04:15.890151] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-17T04:04:16.134537] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T04:04:16.690110] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-17T04:04:16.745450] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T04:04:17.150890] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T04:04:17.490188] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-17T04:04:18.226453] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T04:04:18.250689] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T04:04:18.290077] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-17T04:04:19.090146] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-17T04:04:19.890143] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-17T04:04:19.995631] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T04:04:20.659157] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T04:04:20.690105] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-17T04:04:20.925581] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T04:04:21.490170] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-17T04:04:22.290137] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-17T04:04:22.348827] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T04:04:22.425947] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T04:04:23.038089] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T04:04:23.090094] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-17T04:04:23.890173] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-17T04:04:23.940295] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T04:04:24.690143] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-17T04:04:25.490101] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-17T04:04:25.680911] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T04:04:25.681815] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T04:04:26.290161] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-17T04:04:27.080778] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T04:04:27.090291] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-17T04:04:27.195690] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T04:04:27.199550] [INFO ] [REMOTE ] GPOR: Full fetch complete (34640 records). [2025-09-17T04:04:27.199714] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-17T04:04:27.584702] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-17T04:04:27.584825] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-17T04:04:27.585476] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-17T04:04:27.585549] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-17T04:04:27.586617] [DEBUG] [LOCAL ] GPOR: Trimmed 34640 records to 22934 (keeping 200 days of data) [2025-09-17T04:04:27.729304] [DEBUG] [LOCAL ] GPOR: Primary data saved (22934 records). [2025-09-17T04:04:27.729474] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-17T04:04:27.729590] [INFO ] [MAIN ] Update Progress: 961/2369 symbols completed. GPOR took 24.4s. Estimated remaining: 3h 25m 38s. Rate: 6.8 symbols/min [2025-09-17T04:04:27.897986] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-17T04:04:27.901942] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:27.923008] [DEBUG] [LOCAL ] GRBK: Loaded 19673 existing records from primary storage. [2025-09-17T04:04:27.923167] [INFO ] [MAIN ] GRBK: Loaded 19673 existing records. [2025-09-17T04:04:28.107684] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:28.108205] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-17T04:04:28.120602] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-17T04:04:28.121055] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T04:04:28.125449] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-17T04:04:28.125991] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-17T04:04:28.490539] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:28.690161] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-17T04:04:29.331748] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T04:04:29.490165] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-17T04:04:29.631807] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T04:04:29.635357] [INFO ] [REMOTE ] GPMT: Full fetch complete (37999 records). [2025-09-17T04:04:29.635501] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-17T04:04:30.022062] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-17T04:04:30.022168] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-17T04:04:30.022828] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-17T04:04:30.022913] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-17T04:04:30.023863] [DEBUG] [LOCAL ] GPMT: Trimmed 37999 records to 26872 (keeping 200 days of data) [2025-09-17T04:04:30.180707] [DEBUG] [LOCAL ] GPMT: Primary data saved (26872 records). [2025-09-17T04:04:30.180880] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-17T04:04:30.181015] [INFO ] [MAIN ] Update Progress: 962/2369 symbols completed. GPMT took 26.9s. Estimated remaining: 3h 25m 20s. Rate: 6.9 symbols/min [2025-09-17T04:04:30.295234] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-17T04:04:30.353172] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:30.361620] [DEBUG] [LOCAL ] GRC: Loaded 6338 existing records from primary storage. [2025-09-17T04:04:30.361778] [INFO ] [MAIN ] GRC: Loaded 6338 existing records. [2025-09-17T04:04:30.542999] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:30.543311] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-17T04:04:30.543370] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-17T04:04:30.543806] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-17T04:04:30.543877] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-17T04:04:30.930977] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:30.990201] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T04:04:31.090099] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-11. [2025-09-17T04:04:31.890169] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-17T04:04:32.195984] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T04:04:32.202334] [INFO ] [REMOTE ] GPN: Full fetch complete (74647 records). [2025-09-17T04:04:32.202490] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-17T04:04:32.594064] [DEBUG] [VALIDATOR ] GPN: All expected trading days are present. [2025-09-17T04:04:32.594282] [DEBUG] [VALIDATOR ] GPN: Primary data validation passed. [2025-09-17T04:04:32.595255] [INFO ] [MAIN ] GPN: Fetched primary data is valid. [2025-09-17T04:04:32.595367] [DEBUG] [LOCAL ] GPN: Saving primary data. [2025-09-17T04:04:32.614035] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T04:04:32.621757] [DEBUG] [LOCAL ] GPN: Trimmed 74647 records to 52089 (keeping 200 days of data) [2025-09-17T04:04:32.695217] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-11. [2025-09-17T04:04:33.008793] [DEBUG] [LOCAL ] GPN: Primary data saved (52089 records). [2025-09-17T04:04:33.009095] [INFO ] [MAIN ] GPN: Full history saved. [2025-09-17T04:04:33.009216] [INFO ] [MAIN ] Update Progress: 963/2369 symbols completed. GPN took 29.7s. Estimated remaining: 3h 25m 2s. Rate: 6.9 symbols/min [2025-09-17T04:04:33.196243] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:33.221405] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T04:04:33.244334] [DEBUG] [LOCAL ] GRDN: Loaded 15220 existing records from primary storage. [2025-09-17T04:04:33.244596] [INFO ] [MAIN ] GRDN: Loaded 15220 existing records. [2025-09-17T04:04:33.442458] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:33.442904] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-17T04:04:33.442981] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-17T04:04:33.443725] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-17T04:04:33.443793] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-17T04:04:33.500351] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-17T04:04:33.588477] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T04:04:33.824590] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:34.290168] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-11. [2025-09-17T04:04:34.691444] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T04:04:34.698098] [INFO ] [REMOTE ] GPRK: Full fetch complete (56926 records). [2025-09-17T04:04:34.698239] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-17T04:04:35.092997] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-17T04:04:35.125344] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-17T04:04:35.125550] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-17T04:04:35.126752] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-17T04:04:35.126975] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-17T04:04:35.129934] [DEBUG] [LOCAL ] GPRK: Trimmed 56926 records to 39088 (keeping 200 days of data) [2025-09-17T04:04:35.393735] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:04:35.430622] [DEBUG] [LOCAL ] GPRK: Primary data saved (39088 records). [2025-09-17T04:04:35.430967] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-17T04:04:35.431156] [INFO ] [MAIN ] Update Progress: 964/2369 symbols completed. GPRK took 32.1s. Estimated remaining: 3h 24m 44s. Rate: 6.9 symbols/min [2025-09-17T04:04:35.690582] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:04:35.743633] [DEBUG] [LOCAL ] GRMN: Loaded 30105 existing records from primary storage. [2025-09-17T04:04:35.744864] [INFO ] [MAIN ] GRMN: Loaded 30105 existing records. [2025-09-17T04:04:35.895437] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-17T04:04:36.021305] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:04:36.021793] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-17T04:04:36.021897] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-17T04:04:36.023936] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-17T04:04:36.024046] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-17T04:04:36.464660] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:04:36.525266] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T04:04:36.690153] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-17T04:04:36.801745] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T04:04:37.490121] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-17T04:04:37.574905] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T04:04:38.263213] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T04:04:38.290091] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-17T04:04:39.090132] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-11. [2025-09-17T04:04:39.145736] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T04:04:39.890158] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-17T04:04:40.392073] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T04:04:40.690137] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-17T04:04:41.215924] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T04:04:41.490140] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-17T04:04:42.078695] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T04:04:42.290128] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-17T04:04:42.323135] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T04:04:42.968052] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T04:04:43.090152] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-17T04:04:43.890169] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-17T04:04:44.039066] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T04:04:44.690146] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-17T04:04:45.495210] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-17T04:04:45.517538] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T04:04:45.816083] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T04:04:46.155230] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T04:04:46.290140] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-17T04:04:47.090147] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-17T04:04:47.283174] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T04:04:47.890170] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-17T04:04:48.503140] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T04:04:48.663065] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T04:04:48.690152] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-17T04:04:49.490201] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-17T04:04:49.505095] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T04:04:50.290162] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-17T04:04:50.363142] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T04:04:51.090158] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-17T04:04:51.151928] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T04:04:51.890158] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-17T04:04:52.402351] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T04:04:52.690149] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-17T04:04:53.282148] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T04:04:53.490144] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-17T04:04:53.697991] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T04:04:54.290138] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-17T04:04:55.090093] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-17T04:04:55.128331] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T04:04:55.569698] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T04:04:55.890255] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-17T04:04:56.137309] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T04:04:56.599682] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T04:04:56.690229] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-17T04:04:57.490202] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-17T04:04:57.905001] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T04:04:58.290191] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-17T04:04:58.343365] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T04:04:59.090151] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-17T04:04:59.455391] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T04:04:59.890160] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-17T04:05:00.659811] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T04:05:00.690168] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-17T04:05:01.303050] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T04:05:01.490139] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-17T04:05:01.581300] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T04:05:02.290179] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-17T04:05:02.627028] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T04:05:02.821423] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T04:05:02.823557] [INFO ] [REMOTE ] GRC: Full fetch complete (12802 records). [2025-09-17T04:05:02.823704] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-17T04:05:03.095299] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-17T04:05:03.190798] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-17T04:05:03.190911] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-17T04:05:03.191397] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-17T04:05:03.191456] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-17T04:05:03.192013] [DEBUG] [LOCAL ] GRC: Trimmed 12802 records to 8755 (keeping 200 days of data) [2025-09-17T04:05:03.248136] [DEBUG] [LOCAL ] GRC: Primary data saved (8755 records). [2025-09-17T04:05:03.248329] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-17T04:05:03.248432] [INFO ] [MAIN ] Update Progress: 965/2369 symbols completed. GRC took 33.1s. Estimated remaining: 3h 25m 3s. Rate: 6.8 symbols/min [2025-09-17T04:05:03.422932] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:03.459245] [DEBUG] [LOCAL ] GRND: Loaded 37247 existing records from primary storage. [2025-09-17T04:05:03.459453] [INFO ] [MAIN ] GRND: Loaded 37247 existing records. [2025-09-17T04:05:03.638251] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:03.638550] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-17T04:05:03.638610] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-17T04:05:03.639730] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-17T04:05:03.639793] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-17T04:05:03.895369] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-17T04:05:04.001352] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:04.275506] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T04:05:04.279054] [INFO ] [REMOTE ] GRBK: Full fetch complete (40710 records). [2025-09-17T04:05:04.279190] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-17T04:05:04.685225] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-17T04:05:04.685376] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-17T04:05:04.686147] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-17T04:05:04.686211] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-17T04:05:04.687474] [DEBUG] [LOCAL ] GRBK: Trimmed 40710 records to 27437 (keeping 200 days of data) [2025-09-17T04:05:04.738918] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-17T04:05:04.858459] [DEBUG] [LOCAL ] GRBK: Primary data saved (27437 records). [2025-09-17T04:05:04.858660] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-17T04:05:04.858780] [INFO ] [MAIN ] Update Progress: 966/2369 symbols completed. GRBK took 37.1s. Estimated remaining: 3h 24m 44s. Rate: 6.9 symbols/min [2025-09-17T04:05:05.032356] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:05.055878] [DEBUG] [LOCAL ] GRNT: Loaded 24876 existing records from primary storage. [2025-09-17T04:05:05.056051] [INFO ] [MAIN ] GRNT: Loaded 24876 existing records. [2025-09-17T04:05:05.240269] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:05.240555] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-17T04:05:05.240636] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-17T04:05:05.241506] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-17T04:05:05.241585] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-17T04:05:05.490607] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-11. [2025-09-17T04:05:05.613068] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:05.640695] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T04:05:05.840596] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T04:05:05.847095] [INFO ] [REMOTE ] GRDN: Full fetch complete (25340 records). [2025-09-17T04:05:05.847450] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-17T04:05:06.257806] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-17T04:05:06.257955] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-17T04:05:06.258695] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-17T04:05:06.258757] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-17T04:05:06.259684] [DEBUG] [LOCAL ] GRDN: Trimmed 25340 records to 18874 (keeping 200 days of data) [2025-09-17T04:05:06.308491] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-17T04:05:06.377280] [DEBUG] [LOCAL ] GRDN: Primary data saved (18874 records). [2025-09-17T04:05:06.377504] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-17T04:05:06.377659] [INFO ] [MAIN ] Update Progress: 967/2369 symbols completed. GRDN took 33.4s. Estimated remaining: 3h 24m 25s. Rate: 6.9 symbols/min [2025-09-17T04:05:06.552902] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:06.561949] [DEBUG] [LOCAL ] GROV: Loaded 6863 existing records from primary storage. [2025-09-17T04:05:06.562096] [INFO ] [MAIN ] GROV: Loaded 6863 existing records. [2025-09-17T04:05:06.750678] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:06.751178] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-17T04:05:06.751334] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-17T04:05:06.751821] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-17T04:05:06.751995] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-17T04:05:06.875394] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T04:05:07.106034] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-17T04:05:07.147983] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:07.676380] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T04:05:07.890224] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-11. [2025-09-17T04:05:08.221818] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T04:05:08.690188] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-17T04:05:09.305485] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T04:05:09.490156] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-11. [2025-09-17T04:05:10.230744] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T04:05:10.282897] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T04:05:10.291986] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-17T04:05:11.090172] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-17T04:05:11.636503] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T04:05:11.890137] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-17T04:05:12.372293] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T04:05:12.690199] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-17T04:05:13.388259] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:05:13.394202] [INFO ] [REMOTE ] GRMN: Full fetch complete (60245 records). [2025-09-17T04:05:13.394627] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-17T04:05:13.495372] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-17T04:05:13.783905] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-17T04:05:13.784047] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-17T04:05:13.785021] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-17T04:05:13.785087] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-17T04:05:13.786704] [DEBUG] [LOCAL ] GRMN: Trimmed 60245 records to 41810 (keeping 200 days of data) [2025-09-17T04:05:13.924693] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T04:05:14.112196] [DEBUG] [LOCAL ] GRMN: Primary data saved (41810 records). [2025-09-17T04:05:14.112386] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-17T04:05:14.112555] [INFO ] [MAIN ] Update Progress: 968/2369 symbols completed. GRMN took 38.7s. Estimated remaining: 3h 24m 15s. Rate: 6.9 symbols/min [2025-09-17T04:05:14.296123] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-17T04:05:14.302532] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:14.312167] [DEBUG] [LOCAL ] GRX: Loaded 3340 existing records from primary storage. [2025-09-17T04:05:14.312369] [INFO ] [MAIN ] GRX: Loaded 3340 existing records. [2025-09-17T04:05:14.579228] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:14.579577] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-17T04:05:14.579668] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-17T04:05:14.580179] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-17T04:05:14.580255] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-17T04:05:14.965173] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:15.032009] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T04:05:15.090196] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-11. [2025-09-17T04:05:15.591547] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T04:05:15.614497] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T04:05:15.890195] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-17T04:05:16.690138] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-17T04:05:17.172784] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T04:05:17.490205] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-17T04:05:17.602561] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T04:05:18.290219] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-17T04:05:18.849537] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T04:05:19.090205] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-17T04:05:19.890166] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-17T04:05:19.970075] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T04:05:20.417573] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T04:05:20.514969] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T04:05:20.690153] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-17T04:05:21.490172] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-17T04:05:22.019072] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T04:05:22.290141] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-17T04:05:23.059333] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T04:05:23.090090] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-17T04:05:23.213922] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T04:05:23.548919] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T04:05:23.890138] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-17T04:05:24.690349] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-17T04:05:25.226239] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T04:05:25.447191] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T04:05:25.490148] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-17T04:05:26.290201] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-17T04:05:26.601539] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T04:05:26.908710] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T04:05:27.090152] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-17T04:05:27.890495] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-17T04:05:27.900007] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T04:05:28.498364] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T04:05:28.690207] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-17T04:05:29.490215] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-17T04:05:29.980080] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T04:05:30.065721] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T04:05:30.290206] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-17T04:05:30.889244] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T04:05:31.090158] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-17T04:05:31.890205] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-17T04:05:32.690156] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-17T04:05:32.766270] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T04:05:33.221774] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T04:05:33.233856] [INFO ] [REMOTE ] GRNT: Full fetch complete (48293 records). [2025-09-17T04:05:33.234214] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-17T04:05:33.499394] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-17T04:05:33.542349] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T04:05:33.674845] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-17T04:05:33.674981] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-17T04:05:33.675785] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-17T04:05:33.675903] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-17T04:05:33.678418] [DEBUG] [LOCAL ] GRNT: Trimmed 48293 records to 33961 (keeping 200 days of data) [2025-09-17T04:05:33.889540] [DEBUG] [LOCAL ] GRNT: Primary data saved (33961 records). [2025-09-17T04:05:33.889748] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-17T04:05:33.889859] [INFO ] [MAIN ] Update Progress: 969/2369 symbols completed. GRNT took 29.0s. Estimated remaining: 3h 24m 22s. Rate: 6.9 symbols/min [2025-09-17T04:05:34.067349] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:34.111600] [DEBUG] [LOCAL ] GS: Loaded 38615 existing records from primary storage. [2025-09-17T04:05:34.111798] [INFO ] [MAIN ] GS: Loaded 38615 existing records. [2025-09-17T04:05:34.293074] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-17T04:05:34.297748] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:34.298993] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-17T04:05:34.299090] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-17T04:05:34.300439] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-17T04:05:34.300738] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-17T04:05:34.667122] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:34.922463] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T04:05:35.090141] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-11. [2025-09-17T04:05:35.259505] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T04:05:35.890139] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-17T04:05:36.690160] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-17T04:05:36.862908] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T04:05:37.117447] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-17T04:05:37.214160] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T04:05:37.490134] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-17T04:05:38.294389] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-17T04:05:38.296387] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T04:05:38.854892] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T04:05:39.090205] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-17T04:05:39.890133] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-17T04:05:40.690138] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-17T04:05:41.209446] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-17T04:05:41.251790] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T04:05:41.291306] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T04:05:41.490145] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-17T04:05:42.290154] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-17T04:05:42.745607] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T04:05:42.747030] [INFO ] [REMOTE ] GROV: Full fetch complete (15125 records). [2025-09-17T04:05:42.747126] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-17T04:05:43.098306] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-17T04:05:43.135675] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-17T04:05:43.135831] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-17T04:05:43.136375] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-17T04:05:43.136456] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-17T04:05:43.137130] [DEBUG] [LOCAL ] GROV: Trimmed 15125 records to 9293 (keeping 200 days of data) [2025-09-17T04:05:43.199562] [DEBUG] [LOCAL ] GROV: Primary data saved (9293 records). [2025-09-17T04:05:43.199857] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-17T04:05:43.199984] [INFO ] [MAIN ] Update Progress: 970/2369 symbols completed. GROV took 36.8s. Estimated remaining: 3h 24m 14s. Rate: 6.8 symbols/min [2025-09-17T04:05:43.376808] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:43.412863] [DEBUG] [LOCAL ] GSBD: Loaded 28138 existing records from primary storage. [2025-09-17T04:05:43.413076] [INFO ] [MAIN ] GSBD: Loaded 28138 existing records. [2025-09-17T04:05:43.602380] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:43.602828] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-17T04:05:43.602904] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-17T04:05:43.603850] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-17T04:05:43.603922] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-17T04:05:43.895438] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-17T04:05:44.006603] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-17T04:05:44.009618] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:44.522333] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T04:05:44.662251] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T04:05:44.668748] [INFO ] [REMOTE ] GRND: Full fetch complete (69782 records). [2025-09-17T04:05:44.668880] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-17T04:05:44.698583] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-11. [2025-09-17T04:05:45.066771] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-17T04:05:45.066893] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-17T04:05:45.067775] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-17T04:05:45.067836] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-17T04:05:45.069364] [DEBUG] [LOCAL ] GRND: Trimmed 69782 records to 50159 (keeping 200 days of data) [2025-09-17T04:05:45.381280] [DEBUG] [LOCAL ] GRND: Primary data saved (50159 records). [2025-09-17T04:05:45.381460] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-17T04:05:45.381564] [INFO ] [MAIN ] Update Progress: 971/2369 symbols completed. GRND took 42.1s. Estimated remaining: 3h 23m 56s. Rate: 6.9 symbols/min [2025-09-17T04:05:45.495274] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-17T04:05:45.559171] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:45.597278] [DEBUG] [LOCAL ] GSK: Loaded 39887 existing records from primary storage. [2025-09-17T04:05:45.597504] [INFO ] [MAIN ] GSK: Loaded 39887 existing records. [2025-09-17T04:05:45.778900] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:45.779244] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-17T04:05:45.779334] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-17T04:05:45.780520] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-17T04:05:45.780622] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-17T04:05:46.143449] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:46.295196] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-11. [2025-09-17T04:05:46.309967] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T04:05:47.090153] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-17T04:05:47.506039] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T04:05:47.824847] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T04:05:47.890144] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-17T04:05:48.609825] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T04:05:48.611799] [INFO ] [REMOTE ] GRX: Full fetch complete (6340 records). [2025-09-17T04:05:48.611921] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-17T04:05:48.695268] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-17T04:05:49.028307] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-17T04:05:49.030030] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T04:05:49.030267] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-17T04:05:49.040854] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-17T04:05:49.041462] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-17T04:05:49.042074] [DEBUG] [LOCAL ] GRX: Trimmed 6340 records to 4268 (keeping 200 days of data) [2025-09-17T04:05:49.067773] [DEBUG] [LOCAL ] GRX: Primary data saved (4268 records). [2025-09-17T04:05:49.067872] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-17T04:05:49.067981] [INFO ] [MAIN ] Update Progress: 972/2369 symbols completed. GRX took 35.0s. Estimated remaining: 3h 23m 40s. Rate: 6.9 symbols/min [2025-09-17T04:05:49.240959] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:05:49.267472] [DEBUG] [LOCAL ] GSL: Loaded 24570 existing records from primary storage. [2025-09-17T04:05:49.267690] [INFO ] [MAIN ] GSL: Loaded 24570 existing records. [2025-09-17T04:05:49.448735] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:05:49.449046] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-17T04:05:49.449109] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-17T04:05:49.449741] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-17T04:05:49.449805] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-17T04:05:49.495328] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-17T04:05:49.833783] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:05:50.290113] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-17T04:05:50.769158] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-17T04:05:51.090124] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-17T04:05:51.618194] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T04:05:51.663066] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-17T04:05:51.890136] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-17T04:05:52.690136] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-17T04:05:52.926558] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T04:05:53.490162] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-17T04:05:53.748592] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T04:05:54.115521] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T04:05:54.290128] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-17T04:05:55.090157] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-17T04:05:55.270676] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T04:05:55.890263] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-17T04:05:56.450000] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T04:05:56.587165] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T04:05:56.690184] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-17T04:05:57.490194] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-11. [2025-09-17T04:05:57.904418] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T04:05:58.290141] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-17T04:05:58.744761] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-17T04:05:58.907783] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T04:05:59.090140] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-17T04:05:59.890166] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-17T04:06:00.295425] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T04:06:00.327375] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T04:06:00.690143] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-17T04:06:01.490139] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-17T04:06:01.599264] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T04:06:02.290162] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-17T04:06:03.090200] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-17T04:06:03.674591] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-17T04:06:03.890182] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-17T04:06:04.190193] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-17T04:06:04.690139] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-17T04:06:04.732601] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-17T04:06:05.299055] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-17T04:06:05.490180] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-17T04:06:05.961994] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T04:06:06.067495] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T04:06:06.290152] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-17T04:06:07.090172] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-17T04:06:07.277286] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T04:06:07.826020] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T04:06:07.890217] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-17T04:06:08.690120] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-17T04:06:08.958876] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T04:06:08.965358] [INFO ] [REMOTE ] GS: Full fetch complete (75834 records). [2025-09-17T04:06:08.965581] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-17T04:06:09.358665] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-17T04:06:09.358781] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-17T04:06:09.359716] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-17T04:06:09.359795] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-17T04:06:09.361445] [DEBUG] [LOCAL ] GS: Trimmed 75834 records to 52208 (keeping 200 days of data) [2025-09-17T04:06:09.493541] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-17T04:06:09.517035] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T04:06:09.734264] [DEBUG] [LOCAL ] GS: Primary data saved (52208 records). [2025-09-17T04:06:09.734433] [INFO ] [MAIN ] GS: Full history saved. [2025-09-17T04:06:09.734525] [INFO ] [MAIN ] Update Progress: 973/2369 symbols completed. GS took 35.8s. Estimated remaining: 3h 23m 48s. Rate: 6.8 symbols/min [2025-09-17T04:06:09.905351] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:09.941826] [DEBUG] [LOCAL ] GTES: Loaded 37387 existing records from primary storage. [2025-09-17T04:06:09.942021] [INFO ] [MAIN ] GTES: Loaded 37387 existing records. [2025-09-17T04:06:10.126664] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:10.127078] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-17T04:06:10.127325] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-17T04:06:10.134729] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-17T04:06:10.146628] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-17T04:06:10.196588] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T04:06:10.298957] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-17T04:06:10.520013] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:11.090118] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-17T04:06:11.197574] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T04:06:11.824205] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T04:06:11.890077] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-17T04:06:12.525606] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T04:06:12.690152] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-17T04:06:13.320816] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T04:06:13.490159] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-11. [2025-09-17T04:06:14.290193] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-17T04:06:14.629297] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T04:06:15.053776] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T04:06:15.090080] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-17T04:06:15.890167] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-17T04:06:16.492761] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-17T04:06:16.690150] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-17T04:06:17.490170] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-17T04:06:17.639021] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-17T04:06:17.730376] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T04:06:17.735222] [INFO ] [REMOTE ] GSBD: Full fetch complete (58278 records). [2025-09-17T04:06:17.735361] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-17T04:06:18.119182] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-17T04:06:18.119301] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-17T04:06:18.120199] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-17T04:06:18.120333] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-17T04:06:18.121628] [DEBUG] [LOCAL ] GSBD: Trimmed 58278 records to 39330 (keeping 200 days of data) [2025-09-17T04:06:18.231857] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:06:18.328378] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-17T04:06:18.402864] [DEBUG] [LOCAL ] GSBD: Primary data saved (39330 records). [2025-09-17T04:06:18.403130] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-17T04:06:18.403258] [INFO ] [MAIN ] Update Progress: 974/2369 symbols completed. GSBD took 35.2s. Estimated remaining: 3h 23m 39s. Rate: 6.8 symbols/min [2025-09-17T04:06:18.578842] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:18.613949] [DEBUG] [LOCAL ] GTLS: Loaded 32299 existing records from primary storage. [2025-09-17T04:06:18.614144] [INFO ] [MAIN ] GTLS: Loaded 32299 existing records. [2025-09-17T04:06:18.791236] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:18.791484] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-17T04:06:18.791547] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-17T04:06:18.792244] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-17T04:06:18.792307] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-17T04:06:19.095249] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-17T04:06:19.147234] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:19.394107] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T04:06:19.400777] [INFO ] [REMOTE ] GSK: Full fetch complete (77328 records). [2025-09-17T04:06:19.400959] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-17T04:06:19.814713] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-17T04:06:19.814827] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-17T04:06:19.815788] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-17T04:06:19.815849] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-17T04:06:19.817438] [DEBUG] [LOCAL ] GSK: Trimmed 77328 records to 53504 (keeping 200 days of data) [2025-09-17T04:06:19.909069] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-11. [2025-09-17T04:06:20.076831] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T04:06:20.213757] [DEBUG] [LOCAL ] GSK: Primary data saved (53504 records). [2025-09-17T04:06:20.214089] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-17T04:06:20.214273] [INFO ] [MAIN ] Update Progress: 975/2369 symbols completed. GSK took 34.8s. Estimated remaining: 3h 23m 21s. Rate: 6.9 symbols/min [2025-09-17T04:06:20.431436] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:20.481081] [DEBUG] [LOCAL ] GTN: Loaded 33708 existing records from primary storage. [2025-09-17T04:06:20.481332] [INFO ] [MAIN ] GTN: Loaded 33708 existing records. [2025-09-17T04:06:20.703567] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-17T04:06:20.817528] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:20.821315] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T04:06:20.821568] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-17T04:06:20.821765] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-17T04:06:20.836212] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-17T04:06:20.836363] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-17T04:06:21.417046] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:21.490211] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-17T04:06:21.626850] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T04:06:22.290155] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-11. [2025-09-17T04:06:22.361565] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T04:06:22.779279] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T04:06:22.783554] [INFO ] [REMOTE ] GSL: Full fetch complete (48409 records). [2025-09-17T04:06:22.783706] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-17T04:06:23.095388] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-17T04:06:23.168065] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-17T04:06:23.168187] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-17T04:06:23.169103] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-17T04:06:23.169169] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-17T04:06:23.170874] [DEBUG] [LOCAL ] GSL: Trimmed 48409 records to 33934 (keeping 200 days of data) [2025-09-17T04:06:23.388941] [DEBUG] [LOCAL ] GSL: Primary data saved (33934 records). [2025-09-17T04:06:23.389139] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-17T04:06:23.389241] [INFO ] [MAIN ] Update Progress: 976/2369 symbols completed. GSL took 34.3s. Estimated remaining: 3h 23m 4s. Rate: 6.9 symbols/min [2025-09-17T04:06:23.576232] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:23.599914] [DEBUG] [LOCAL ] GTY: Loaded 21887 existing records from primary storage. [2025-09-17T04:06:23.600100] [INFO ] [MAIN ] GTY: Loaded 21887 existing records. [2025-09-17T04:06:23.794458] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:23.794881] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-17T04:06:23.795064] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-17T04:06:23.795984] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-17T04:06:23.796057] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-17T04:06:23.892758] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-17T04:06:24.037215] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:06:24.224454] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:24.383119] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T04:06:24.690174] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-11. [2025-09-17T04:06:25.490226] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-17T04:06:25.758878] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T04:06:25.788848] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:06:26.290197] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-17T04:06:26.750529] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T04:06:27.090196] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-17T04:06:27.890098] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-17T04:06:28.398352] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T04:06:28.675114] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T04:06:28.690075] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-17T04:06:28.906515] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T04:06:29.490166] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-17T04:06:30.238786] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T04:06:30.290190] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-17T04:06:31.095244] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-17T04:06:31.123869] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T04:06:31.893265] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-17T04:06:31.899511] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T04:06:32.690228] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-17T04:06:32.801991] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T04:06:33.202436] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T04:06:33.490184] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-17T04:06:34.209604] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T04:06:34.290191] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-17T04:06:35.020662] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T04:06:35.090153] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-17T04:06:35.595360] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T04:06:35.890173] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-17T04:06:36.306020] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T04:06:36.690145] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-17T04:06:36.825419] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T04:06:37.490163] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-17T04:06:38.290204] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-17T04:06:38.427277] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T04:06:39.086742] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T04:06:39.091172] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-17T04:06:39.901531] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-17T04:06:39.910338] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T04:06:40.690139] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-17T04:06:40.813617] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T04:06:41.292112] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T04:06:41.490136] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-17T04:06:42.117858] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T04:06:42.290095] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-17T04:06:43.095259] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-17T04:06:43.112150] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T04:06:43.893049] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-17T04:06:43.897513] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T04:06:43.904552] [INFO ] [REMOTE ] GTES: Full fetch complete (73810 records). [2025-09-17T04:06:43.904756] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-17T04:06:44.337936] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-17T04:06:44.338137] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-17T04:06:44.339922] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-17T04:06:44.340010] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-17T04:06:44.342540] [DEBUG] [LOCAL ] GTES: Trimmed 73810 records to 50740 (keeping 200 days of data) [2025-09-17T04:06:44.690961] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-17T04:06:44.703967] [DEBUG] [LOCAL ] GTES: Primary data saved (50740 records). [2025-09-17T04:06:44.704942] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-17T04:06:44.705443] [INFO ] [MAIN ] Update Progress: 977/2369 symbols completed. GTES took 35.0s. Estimated remaining: 3h 23m 13s. Rate: 6.8 symbols/min [2025-09-17T04:06:44.885237] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:44.926771] [DEBUG] [LOCAL ] GUG: Loaded 8867 existing records from primary storage. [2025-09-17T04:06:44.927568] [INFO ] [MAIN ] GUG: Loaded 8867 existing records. [2025-09-17T04:06:44.929574] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T04:06:45.128978] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:45.129429] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-17T04:06:45.129728] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-17T04:06:45.130306] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-17T04:06:45.130444] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-17T04:06:45.344731] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T04:06:45.497458] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-17T04:06:45.536881] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:45.831743] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T04:06:45.838240] [INFO ] [REMOTE ] GTLS: Full fetch complete (61289 records). [2025-09-17T04:06:45.838457] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-17T04:06:46.248420] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-17T04:06:46.248561] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-17T04:06:46.249509] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-17T04:06:46.249585] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-17T04:06:46.251128] [DEBUG] [LOCAL ] GTLS: Trimmed 61289 records to 43162 (keeping 200 days of data) [2025-09-17T04:06:46.305236] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-17T04:06:46.539496] [DEBUG] [LOCAL ] GTLS: Primary data saved (43162 records). [2025-09-17T04:06:46.539751] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-17T04:06:46.539876] [INFO ] [MAIN ] Update Progress: 978/2369 symbols completed. GTLS took 28.1s. Estimated remaining: 3h 22m 54s. Rate: 6.9 symbols/min [2025-09-17T04:06:46.724834] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:06:46.740269] [DEBUG] [LOCAL ] GUT: Loaded 11583 existing records from primary storage. [2025-09-17T04:06:46.740561] [INFO ] [MAIN ] GUT: Loaded 11583 existing records. [2025-09-17T04:06:46.933425] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T04:06:46.976910] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:06:46.978350] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-17T04:06:46.978998] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-17T04:06:46.979518] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-17T04:06:46.979596] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-17T04:06:47.096795] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-17T04:06:47.392430] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:06:47.900398] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-11. [2025-09-17T04:06:47.907976] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T04:06:48.039293] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T04:06:48.634034] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T04:06:48.690121] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-17T04:06:49.490192] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-17T04:06:49.696583] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T04:06:50.290160] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-17T04:06:51.095321] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-11. [2025-09-17T04:06:51.113718] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T04:06:51.254959] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T04:06:51.890175] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-17T04:06:51.997043] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T04:06:52.690184] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-17T04:06:53.490207] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-17T04:06:53.653535] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T04:06:53.701145] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T04:06:54.290129] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-17T04:06:54.510385] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T04:06:55.028825] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T04:06:55.090256] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-17T04:06:55.878706] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T04:06:55.890095] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-17T04:06:56.690164] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-17T04:06:56.785950] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T04:06:57.490277] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-17T04:06:58.280950] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T04:06:58.291016] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-17T04:06:58.961845] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T04:06:58.988597] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T04:06:59.090239] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-17T04:06:59.890217] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-17T04:07:00.637511] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T04:07:00.643887] [INFO ] [REMOTE ] GTN: Full fetch complete (66308 records). [2025-09-17T04:07:00.644145] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-17T04:07:00.695383] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-17T04:07:01.063170] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-17T04:07:01.065512] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-17T04:07:01.067585] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-17T04:07:01.069716] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T04:07:01.069792] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-17T04:07:01.076280] [DEBUG] [LOCAL ] GTN: Trimmed 66308 records to 45912 (keeping 200 days of data) [2025-09-17T04:07:01.364338] [DEBUG] [LOCAL ] GTN: Primary data saved (45912 records). [2025-09-17T04:07:01.364567] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-17T04:07:01.364729] [INFO ] [MAIN ] Update Progress: 979/2369 symbols completed. GTN took 41.2s. Estimated remaining: 3h 22m 54s. Rate: 6.9 symbols/min [2025-09-17T04:07:01.495424] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-17T04:07:01.550322] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:01.575481] [DEBUG] [LOCAL ] GVA: Loaded 24076 existing records from primary storage. [2025-09-17T04:07:01.575759] [INFO ] [MAIN ] GVA: Loaded 24076 existing records. [2025-09-17T04:07:01.762845] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:01.763162] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-17T04:07:01.763239] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-17T04:07:01.763937] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-17T04:07:01.764010] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-17T04:07:02.147741] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:02.167991] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T04:07:02.290181] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-17T04:07:02.703015] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T04:07:03.090180] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-17T04:07:03.101631] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T04:07:03.890217] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-11. [2025-09-17T04:07:04.163760] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T04:07:04.690197] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-17T04:07:05.134582] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T04:07:05.490222] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-17T04:07:05.696812] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T04:07:05.699932] [INFO ] [REMOTE ] GUT: Full fetch complete (23253 records). [2025-09-17T04:07:05.700106] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-17T04:07:06.127569] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-17T04:07:06.137498] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-17T04:07:06.139619] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-17T04:07:06.140348] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T04:07:06.140733] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-17T04:07:06.146240] [DEBUG] [LOCAL ] GUT: Trimmed 23253 records to 15668 (keeping 200 days of data) [2025-09-17T04:07:06.247419] [DEBUG] [LOCAL ] GUT: Primary data saved (15668 records). [2025-09-17T04:07:06.247682] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-17T04:07:06.247813] [INFO ] [MAIN ] Update Progress: 980/2369 symbols completed. GUT took 19.7s. Estimated remaining: 3h 22m 40s. Rate: 6.9 symbols/min [2025-09-17T04:07:06.295183] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-17T04:07:06.432803] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:06.447939] [DEBUG] [LOCAL ] GWH: Loaded 12976 existing records from primary storage. [2025-09-17T04:07:06.448147] [INFO ] [MAIN ] GWH: Loaded 12976 existing records. [2025-09-17T04:07:06.639500] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:06.639814] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-17T04:07:06.639876] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-17T04:07:06.640300] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-17T04:07:06.640359] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-17T04:07:07.011998] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:07.090157] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-11. [2025-09-17T04:07:07.254525] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T04:07:07.890140] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-17T04:07:08.069838] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T04:07:08.690139] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-17T04:07:09.293028] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T04:07:09.439371] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T04:07:09.490099] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-17T04:07:10.290141] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-17T04:07:10.438096] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T04:07:11.090208] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-17T04:07:11.627984] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T04:07:11.890178] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-17T04:07:12.016050] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T04:07:12.690204] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-17T04:07:13.163845] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T04:07:13.169607] [INFO ] [REMOTE ] GTY: Full fetch complete (42785 records). [2025-09-17T04:07:13.169849] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-17T04:07:13.495007] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-17T04:07:13.736230] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-17T04:07:13.736426] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-17T04:07:13.737759] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-17T04:07:13.737887] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-17T04:07:13.739441] [DEBUG] [LOCAL ] GTY: Trimmed 42785 records to 30319 (keeping 200 days of data) [2025-09-17T04:07:13.966859] [DEBUG] [LOCAL ] GTY: Primary data saved (30319 records). [2025-09-17T04:07:13.967061] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-17T04:07:13.967209] [INFO ] [MAIN ] Update Progress: 981/2369 symbols completed. GTY took 50.6s. Estimated remaining: 3h 22m 30s. Rate: 6.9 symbols/min [2025-09-17T04:07:14.198726] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T04:07:14.197032] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:14.216788] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T04:07:14.257019] [DEBUG] [LOCAL ] GWRE: Loaded 30089 existing records from primary storage. [2025-09-17T04:07:14.257215] [INFO ] [MAIN ] GWRE: Loaded 30089 existing records. [2025-09-17T04:07:14.295285] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-17T04:07:14.445144] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:14.445423] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-17T04:07:14.445494] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-17T04:07:14.446316] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-17T04:07:14.446383] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-17T04:07:14.817713] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:15.090173] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-17T04:07:15.192335] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T04:07:15.890138] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-17T04:07:16.607204] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:07:16.657523] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T04:07:16.690089] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-17T04:07:17.490176] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-11. [2025-09-17T04:07:18.146554] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T04:07:18.290127] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-17T04:07:18.947623] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T04:07:18.949776] [INFO ] [REMOTE ] GUG: Full fetch complete (19981 records). [2025-09-17T04:07:18.949876] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-17T04:07:19.098482] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-17T04:07:19.329790] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-17T04:07:19.329907] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-17T04:07:19.330518] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-17T04:07:19.330671] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-17T04:07:19.362598] [DEBUG] [LOCAL ] GUG: Trimmed 19981 records to 12308 (keeping 200 days of data) [2025-09-17T04:07:19.365289] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T04:07:19.450527] [DEBUG] [LOCAL ] GUG: Primary data saved (12308 records). [2025-09-17T04:07:19.450753] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-17T04:07:19.450867] [INFO ] [MAIN ] Update Progress: 982/2369 symbols completed. GUG took 34.7s. Estimated remaining: 3h 22m 16s. Rate: 6.9 symbols/min [2025-09-17T04:07:19.623872] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:19.639599] [DEBUG] [LOCAL ] GWW: Loaded 14090 existing records from primary storage. [2025-09-17T04:07:19.639782] [INFO ] [MAIN ] GWW: Loaded 14090 existing records. [2025-09-17T04:07:19.819065] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:19.819331] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-17T04:07:19.819392] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-17T04:07:19.819948] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-17T04:07:19.820009] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-17T04:07:19.896054] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-17T04:07:20.196904] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:20.573951] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T04:07:20.690147] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-11. [2025-09-17T04:07:20.741458] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T04:07:21.490153] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-17T04:07:21.798859] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T04:07:22.260194] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T04:07:22.290160] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-17T04:07:23.090111] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-17T04:07:23.331043] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:07:23.890132] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-17T04:07:24.186816] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T04:07:24.681865] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T04:07:24.690076] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-17T04:07:25.490131] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-17T04:07:25.539186] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:07:26.290144] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-17T04:07:26.813315] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:07:27.090129] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-17T04:07:27.182775] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T04:07:27.890188] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-17T04:07:28.676835] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T04:07:28.690073] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-17T04:07:29.081479] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T04:07:29.490136] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-17T04:07:30.290145] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-17T04:07:30.453630] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T04:07:30.732803] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T04:07:31.090163] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-17T04:07:31.493578] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T04:07:31.890151] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-17T04:07:32.509972] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T04:07:32.690158] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-17T04:07:32.783726] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T04:07:33.490156] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-17T04:07:34.045452] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T04:07:34.290202] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-17T04:07:34.722972] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T04:07:34.726839] [INFO ] [REMOTE ] GVA: Full fetch complete (48825 records). [2025-09-17T04:07:34.726972] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-17T04:07:35.091273] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-17T04:07:35.106538] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-17T04:07:35.107449] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-17T04:07:35.108306] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-17T04:07:35.108480] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-17T04:07:35.110114] [DEBUG] [LOCAL ] GVA: Trimmed 48825 records to 34117 (keeping 200 days of data) [2025-09-17T04:07:35.234979] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T04:07:35.355626] [DEBUG] [LOCAL ] GVA: Primary data saved (34117 records). [2025-09-17T04:07:35.355826] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-17T04:07:35.355960] [INFO ] [MAIN ] Update Progress: 983/2369 symbols completed. GVA took 34.0s. Estimated remaining: 3h 22m 18s. Rate: 6.9 symbols/min [2025-09-17T04:07:35.529330] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:35.562851] [DEBUG] [LOCAL ] GXO: Loaded 34488 existing records from primary storage. [2025-09-17T04:07:35.563006] [INFO ] [MAIN ] GXO: Loaded 34488 existing records. [2025-09-17T04:07:35.751187] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:35.751500] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-17T04:07:35.751578] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-17T04:07:35.752461] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-17T04:07:35.752571] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-17T04:07:35.899323] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-17T04:07:36.124177] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:36.411935] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T04:07:36.690126] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-17T04:07:37.485297] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T04:07:37.493046] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-11. [2025-09-17T04:07:37.686454] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T04:07:38.290138] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-17T04:07:38.961675] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T04:07:39.056722] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T04:07:39.059368] [INFO ] [REMOTE ] GWH: Full fetch complete (20288 records). [2025-09-17T04:07:39.059471] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-17T04:07:39.095256] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-17T04:07:39.447153] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-17T04:07:39.447326] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-17T04:07:39.448467] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-17T04:07:39.448566] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-17T04:07:39.450859] [DEBUG] [LOCAL ] GWH: Trimmed 20288 records to 15026 (keeping 200 days of data) [2025-09-17T04:07:39.547292] [DEBUG] [LOCAL ] GWH: Primary data saved (15026 records). [2025-09-17T04:07:39.547530] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-17T04:07:39.547682] [INFO ] [MAIN ] Update Progress: 984/2369 symbols completed. GWH took 33.3s. Estimated remaining: 3h 22m 3s. Rate: 6.9 symbols/min [2025-09-17T04:07:39.733910] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:39.737478] [DEBUG] [LOCAL ] GYLD: Loaded 1117 existing records from primary storage. [2025-09-17T04:07:39.737619] [INFO ] [MAIN ] GYLD: Loaded 1117 existing records. [2025-09-17T04:07:39.895273] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-17T04:07:39.930695] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:39.931028] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-17T04:07:39.931117] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-17T04:07:39.931316] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-17T04:07:39.931395] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-17T04:07:40.332030] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:40.351751] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T04:07:40.690150] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-11. [2025-09-17T04:07:41.024763] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T04:07:41.247581] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T04:07:41.490136] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-17T04:07:42.290135] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-17T04:07:43.090134] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-17T04:07:43.291616] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T04:07:43.312838] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T04:07:43.890134] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-17T04:07:44.293098] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T04:07:44.690141] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-17T04:07:44.862446] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T04:07:45.490138] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-17T04:07:45.857892] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T04:07:46.290167] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-17T04:07:46.655964] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T04:07:47.090145] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-17T04:07:47.873495] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T04:07:47.890073] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-17T04:07:48.556462] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T04:07:48.561960] [INFO ] [REMOTE ] GWRE: Full fetch complete (61728 records). [2025-09-17T04:07:48.562130] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-17T04:07:48.695252] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-17T04:07:48.968953] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-17T04:07:48.969067] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-17T04:07:48.969922] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-17T04:07:48.969984] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-17T04:07:48.971386] [DEBUG] [LOCAL ] GWRE: Trimmed 61728 records to 41517 (keeping 200 days of data) [2025-09-17T04:07:49.169009] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T04:07:49.241249] [DEBUG] [LOCAL ] GWRE: Primary data saved (41517 records). [2025-09-17T04:07:49.241428] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-17T04:07:49.241558] [INFO ] [MAIN ] Update Progress: 985/2369 symbols completed. GWRE took 35.3s. Estimated remaining: 3h 21m 55s. Rate: 6.9 symbols/min [2025-09-17T04:07:49.425356] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:07:49.457429] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T04:07:49.496045] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-17T04:07:49.498721] [DEBUG] [LOCAL ] H: Loaded 33240 existing records from primary storage. [2025-09-17T04:07:49.498907] [INFO ] [MAIN ] H: Loaded 33240 existing records. [2025-09-17T04:07:49.684189] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:07:49.684529] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-17T04:07:49.684619] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-17T04:07:49.685570] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-17T04:07:49.685673] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-17T04:07:50.055727] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:07:50.290158] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-17T04:07:50.618017] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T04:07:51.090204] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-17T04:07:51.290625] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T04:07:51.441337] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T04:07:51.890158] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-17T04:07:52.690169] [INFO ] [REMOTE ] H: Fetching primary data for 2024-11. [2025-09-17T04:07:53.003592] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T04:07:53.490183] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-17T04:07:54.163029] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T04:07:54.290196] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-17T04:07:54.711230] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T04:07:55.090172] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-17T04:07:55.162408] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:07:55.890192] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-17T04:07:56.535484] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T04:07:56.690147] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-17T04:07:57.135201] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T04:07:57.496425] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-17T04:07:57.515232] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T04:07:57.931590] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T04:07:58.290148] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-17T04:07:59.090142] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-17T04:07:59.636241] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T04:07:59.890110] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-17T04:08:00.160001] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T04:08:00.163946] [INFO ] [REMOTE ] GWW: Full fetch complete (29014 records). [2025-09-17T04:08:00.164064] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-17T04:08:00.355933] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T04:08:00.543157] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-17T04:08:00.543267] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-17T04:08:00.543864] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-17T04:08:00.543924] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-17T04:08:00.544767] [DEBUG] [LOCAL ] GWW: Trimmed 29014 records to 20108 (keeping 200 days of data) [2025-09-17T04:08:00.688097] [DEBUG] [LOCAL ] GWW: Primary data saved (20108 records). [2025-09-17T04:08:00.688262] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-17T04:08:00.688377] [INFO ] [MAIN ] Update Progress: 986/2369 symbols completed. GWW took 41.2s. Estimated remaining: 3h 21m 50s. Rate: 6.9 symbols/min [2025-09-17T04:08:00.695311] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-17T04:08:00.865715] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:00.896412] [DEBUG] [LOCAL ] HAE: Loaded 28192 existing records from primary storage. [2025-09-17T04:08:00.896638] [INFO ] [MAIN ] HAE: Loaded 28192 existing records. [2025-09-17T04:08:01.074053] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:08:01.074351] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-17T04:08:01.074429] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-17T04:08:01.075308] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-17T04:08:01.075375] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-17T04:08:01.366351] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T04:08:01.454397] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:01.490165] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-11. [2025-09-17T04:08:02.290130] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-17T04:08:02.932363] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T04:08:03.090128] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-17T04:08:03.773355] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T04:08:03.810550] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T04:08:03.890159] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-17T04:08:04.690151] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-17T04:08:05.269361] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:08:05.490187] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-17T04:08:06.290165] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-17T04:08:06.334375] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T04:08:06.778163] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T04:08:06.780263] [INFO ] [REMOTE ] GYLD: Full fetch complete (1990 records). [2025-09-17T04:08:06.780432] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-17T04:08:07.098594] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-17T04:08:07.175707] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-17T04:08:07.193979] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-17T04:08:07.196700] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-17T04:08:07.198425] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T04:08:07.198531] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-17T04:08:07.206754] [DEBUG] [LOCAL ] GYLD: Trimmed 1990 records to 1521 (keeping 200 days of data) [2025-09-17T04:08:07.219372] [DEBUG] [LOCAL ] GYLD: Primary data saved (1521 records). [2025-09-17T04:08:07.219478] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-17T04:08:07.219587] [INFO ] [MAIN ] Update Progress: 987/2369 symbols completed. GYLD took 27.7s. Estimated remaining: 3h 21m 38s. Rate: 6.9 symbols/min [2025-09-17T04:08:07.446774] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:07.486177] [DEBUG] [LOCAL ] HAFN: Loaded 31774 existing records from primary storage. [2025-09-17T04:08:07.486365] [INFO ] [MAIN ] HAFN: Loaded 31774 existing records. [2025-09-17T04:08:07.680175] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:08:07.680508] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-17T04:08:07.680575] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-17T04:08:07.681396] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-17T04:08:07.681472] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-17T04:08:07.901228] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-17T04:08:08.062777] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:08.690163] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-17T04:08:08.771393] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T04:08:09.490316] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-17T04:08:09.614625] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T04:08:10.201998] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T04:08:10.290166] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-11. [2025-09-17T04:08:10.946531] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T04:08:10.952091] [INFO ] [REMOTE ] GXO: Full fetch complete (69705 records). [2025-09-17T04:08:10.952248] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-17T04:08:11.095330] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-17T04:08:11.347656] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-17T04:08:11.347784] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-17T04:08:11.348669] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-17T04:08:11.348726] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-17T04:08:11.350329] [DEBUG] [LOCAL ] GXO: Trimmed 69705 records to 47925 (keeping 200 days of data) [2025-09-17T04:08:11.612305] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T04:08:11.676331] [DEBUG] [LOCAL ] GXO: Primary data saved (47925 records). [2025-09-17T04:08:11.676496] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-17T04:08:11.676597] [INFO ] [MAIN ] Update Progress: 988/2369 symbols completed. GXO took 36.3s. Estimated remaining: 3h 21m 24s. Rate: 6.9 symbols/min [2025-09-17T04:08:11.857145] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:11.896842] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-17T04:08:11.901136] [DEBUG] [LOCAL ] HAL: Loaded 40068 existing records from primary storage. [2025-09-17T04:08:11.901377] [INFO ] [MAIN ] HAL: Loaded 40068 existing records. [2025-09-17T04:08:12.091027] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:08:12.091374] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-17T04:08:12.091456] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-17T04:08:12.092696] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-17T04:08:12.092785] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-17T04:08:12.476490] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:12.690143] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-11. [2025-09-17T04:08:12.807052] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T04:08:13.490191] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-17T04:08:13.552501] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T04:08:14.290162] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-17T04:08:14.454594] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T04:08:14.963721] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T04:08:15.090135] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-17T04:08:15.890167] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-17T04:08:16.047293] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T04:08:16.690167] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-17T04:08:16.992680] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T04:08:17.490141] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-17T04:08:17.863172] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T04:08:18.291208] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-17T04:08:18.296632] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T04:08:19.090151] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-17T04:08:19.177505] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T04:08:19.890132] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-17T04:08:20.090664] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T04:08:20.266791] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T04:08:20.690184] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-17T04:08:21.427516] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T04:08:21.490162] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-17T04:08:22.290191] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-17T04:08:22.426733] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T04:08:22.920087] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:08:23.090181] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-17T04:08:23.610475] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T04:08:23.890148] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-17T04:08:24.690211] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-17T04:08:24.988783] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:08:25.490157] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-17T04:08:25.548135] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T04:08:26.207789] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T04:08:26.290108] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-17T04:08:27.090117] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-17T04:08:27.222897] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T04:08:27.875417] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T04:08:27.890115] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-17T04:08:28.542958] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T04:08:28.548348] [INFO ] [REMOTE ] H: Full fetch complete (61374 records). [2025-09-17T04:08:28.548508] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-17T04:08:28.695284] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-17T04:08:28.943276] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-17T04:08:28.943403] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-17T04:08:28.944426] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-17T04:08:28.944508] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-17T04:08:28.946035] [DEBUG] [LOCAL ] H: Trimmed 61374 records to 45105 (keeping 200 days of data) [2025-09-17T04:08:29.235820] [DEBUG] [LOCAL ] H: Primary data saved (45105 records). [2025-09-17T04:08:29.235985] [INFO ] [MAIN ] H: Full history saved. [2025-09-17T04:08:29.236099] [INFO ] [MAIN ] Update Progress: 989/2369 symbols completed. H took 40.0s. Estimated remaining: 3h 21m 27s. Rate: 6.9 symbols/min [2025-09-17T04:08:29.411131] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:29.411341] [DEBUG] [LOCAL ] HASI: No existing data file found in primary storage. [2025-09-17T04:08:29.411391] [WARN ] [MAIN ] HASI: No existing data found, performing full refresh instead. [2025-09-17T04:08:29.411720] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-17T04:08:29.411780] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-17T04:08:29.411832] [DEBUG] [LOCAL ] HASI: No primary data file found to delete. [2025-09-17T04:08:29.411874] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-17T04:08:29.503378] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-17T04:08:29.776904] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:29.809824] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T04:08:30.221055] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T04:08:30.226794] [INFO ] [REMOTE ] HAE: Full fetch complete (57089 records). [2025-09-17T04:08:30.226942] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-17T04:08:30.295348] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-17T04:08:30.633969] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-17T04:08:30.634156] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-17T04:08:30.635310] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-17T04:08:30.635387] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-17T04:08:30.638593] [DEBUG] [LOCAL ] HAE: Trimmed 57089 records to 39478 (keeping 200 days of data) [2025-09-17T04:08:30.881480] [DEBUG] [LOCAL ] HAE: Primary data saved (39478 records). [2025-09-17T04:08:30.881692] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-17T04:08:30.881801] [INFO ] [MAIN ] Update Progress: 990/2369 symbols completed. HAE took 30.2s. Estimated remaining: 3h 21m 8s. Rate: 6.9 symbols/min [2025-09-17T04:08:31.054078] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:31.054460] [DEBUG] [LOCAL ] HAYW: No existing data file found in primary storage. [2025-09-17T04:08:31.054615] [WARN ] [MAIN ] HAYW: No existing data found, performing full refresh instead. [2025-09-17T04:08:31.054845] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-17T04:08:31.055013] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-17T04:08:31.055081] [DEBUG] [LOCAL ] HAYW: No primary data file found to delete. [2025-09-17T04:08:31.055129] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-17T04:08:31.092710] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-11. [2025-09-17T04:08:31.246308] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T04:08:31.470408] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:31.890151] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-17T04:08:32.245288] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T04:08:32.320967] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T04:08:32.690160] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-11. [2025-09-17T04:08:33.490150] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-17T04:08:33.615365] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T04:08:34.261223] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T04:08:34.290137] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-17T04:08:35.090136] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-17T04:08:35.574112] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-17T04:08:35.893801] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-17T04:08:35.898094] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T04:08:36.243867] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T04:08:36.690155] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-17T04:08:37.490124] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-17T04:08:37.904040] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T04:08:38.279572] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:08:38.290080] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-17T04:08:39.060663] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T04:08:39.090069] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-17T04:08:39.896964] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-17T04:08:39.902762] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T04:08:40.646474] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T04:08:40.690167] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-17T04:08:41.490243] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-17T04:08:41.901970] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T04:08:42.256101] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T04:08:42.290110] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-17T04:08:43.063858] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T04:08:43.090085] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-17T04:08:43.787863] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:08:43.794576] [INFO ] [REMOTE ] HAFN: Full fetch complete (66227 records). [2025-09-17T04:08:43.794759] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-17T04:08:43.895247] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-17T04:08:44.200509] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-17T04:08:44.200689] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-17T04:08:44.202042] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-17T04:08:44.202111] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-17T04:08:44.204251] [DEBUG] [LOCAL ] HAFN: Trimmed 66227 records to 43988 (keeping 200 days of data) [2025-09-17T04:08:44.496634] [DEBUG] [LOCAL ] HAFN: Primary data saved (43988 records). [2025-09-17T04:08:44.497144] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-17T04:08:44.497286] [INFO ] [MAIN ] Update Progress: 991/2369 symbols completed. HAFN took 37.3s. Estimated remaining: 3h 21m 6s. Rate: 6.9 symbols/min [2025-09-17T04:08:44.674452] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:44.682635] [DEBUG] [LOCAL ] HBB: Loaded 4754 existing records from primary storage. [2025-09-17T04:08:44.682839] [INFO ] [MAIN ] HBB: Loaded 4754 existing records. [2025-09-17T04:08:44.715975] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-17T04:08:44.868109] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:08:44.868438] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-17T04:08:44.868497] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-17T04:08:44.869219] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-17T04:08:44.869288] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-17T04:08:45.290394] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:45.327662] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-17T04:08:45.376336] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T04:08:45.490165] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-11. [2025-09-17T04:08:45.920225] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T04:08:46.114137] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T04:08:46.290177] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-17T04:08:47.090208] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-17T04:08:47.890219] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-17T04:08:47.965917] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T04:08:48.698612] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-17T04:08:48.737446] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T04:08:49.490398] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-17T04:08:49.986791] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-17T04:08:49.994191] [INFO ] [REMOTE ] HAL: Full fetch complete (77631 records). [2025-09-17T04:08:49.994490] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-17T04:08:50.295266] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-17T04:08:50.427264] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-17T04:08:50.427448] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-17T04:08:50.429396] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-17T04:08:50.429560] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-17T04:08:50.432337] [DEBUG] [LOCAL ] HAL: Trimmed 77631 records to 53718 (keeping 200 days of data) [2025-09-17T04:08:50.467713] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T04:08:50.866117] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T04:08:50.895743] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-09-17T04:08:50.895995] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-17T04:08:50.896319] [INFO ] [MAIN ] Update Progress: 992/2369 symbols completed. HAL took 39.2s. Estimated remaining: 3h 20m 54s. Rate: 6.9 symbols/min [2025-09-17T04:08:51.083917] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:08:51.090160] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-17T04:08:51.130299] [DEBUG] [LOCAL ] HBI: Loaded 39471 existing records from primary storage. [2025-09-17T04:08:51.139128] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T04:08:51.138870] [INFO ] [MAIN ] HBI: Loaded 39471 existing records. [2025-09-17T04:08:51.345950] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:08:51.346321] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-17T04:08:51.346388] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-17T04:08:51.347495] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-17T04:08:51.347572] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-17T04:08:51.738375] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:08:51.890182] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-17T04:08:52.534510] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T04:08:52.663433] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T04:08:52.690188] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-17T04:08:53.490225] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-17T04:08:54.161741] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T04:08:54.261101] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T04:08:54.290220] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-17T04:08:55.019733] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T04:08:55.090202] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-17T04:08:55.890172] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-11. [2025-09-17T04:08:56.658397] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T04:08:56.690109] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-17T04:08:57.490222] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-17T04:08:57.552605] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T04:08:58.271355] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T04:08:58.290166] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-17T04:08:58.895976] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T04:08:59.061587] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T04:08:59.090210] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-17T04:08:59.810716] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T04:08:59.890181] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-17T04:09:00.690156] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-17T04:09:01.490200] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-17T04:09:01.655895] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:09:02.290196] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-17T04:09:02.643573] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T04:09:03.090173] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-17T04:09:03.890482] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-17T04:09:04.658187] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T04:09:04.690190] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-17T04:09:04.922497] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (3.43 seconds). [2025-09-17T04:09:04.929695] [INFO ] [REMOTE ] HASI: Full fetch complete (67834 records). [2025-09-17T04:09:04.929980] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-17T04:09:05.243277] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T04:09:05.378552] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-17T04:09:05.378829] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-17T04:09:05.380135] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-17T04:09:05.380276] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-17T04:09:05.416533] [DEBUG] [LOCAL ] HASI: Trimmed 67834 records to 47259 (keeping 200 days of data) [2025-09-17T04:09:05.418922] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (3.13 seconds). [2025-09-17T04:09:05.497007] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-17T04:09:05.615865] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (2.53 seconds). [2025-09-17T04:09:05.801713] [DEBUG] [LOCAL ] HASI: Primary data saved (47259 records). [2025-09-17T04:09:05.801899] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-17T04:09:05.801994] [INFO ] [MAIN ] Update Progress: 993/2369 symbols completed. HASI took 36.6s. Estimated remaining: 3h 20m 54s. Rate: 6.8 symbols/min [2025-09-17T04:09:05.986488] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:06.036370] [DEBUG] [LOCAL ] HBM: Loaded 39386 existing records from primary storage. [2025-09-17T04:09:06.036820] [INFO ] [MAIN ] HBM: Loaded 39386 existing records. [2025-09-17T04:09:06.225765] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:06.226174] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-17T04:09:06.226240] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-17T04:09:06.227349] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-17T04:09:06.227422] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-17T04:09:06.295384] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-17T04:09:06.627422] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:06.973265] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T04:09:07.090097] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-17T04:09:07.177129] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T04:09:07.561064] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T04:09:07.562360] [INFO ] [REMOTE ] HBB: Full fetch complete (10111 records). [2025-09-17T04:09:07.562465] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-17T04:09:07.895247] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-11. [2025-09-17T04:09:07.937841] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-17T04:09:07.938001] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-17T04:09:07.938407] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-17T04:09:07.938469] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-17T04:09:07.939980] [DEBUG] [LOCAL ] HBB: Trimmed 10111 records to 6983 (keeping 200 days of data) [2025-09-17T04:09:07.988537] [DEBUG] [LOCAL ] HBB: Primary data saved (6983 records). [2025-09-17T04:09:07.988789] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-17T04:09:07.988919] [INFO ] [MAIN ] Update Progress: 994/2369 symbols completed. HBB took 23.5s. Estimated remaining: 3h 20m 36s. Rate: 6.9 symbols/min [2025-09-17T04:09:08.166427] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:08.208555] [DEBUG] [LOCAL ] HCA: Loaded 35145 existing records from primary storage. [2025-09-17T04:09:08.208863] [INFO ] [MAIN ] HCA: Loaded 35145 existing records. [2025-09-17T04:09:08.405080] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:08.405479] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-17T04:09:08.405549] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-17T04:09:08.406467] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-17T04:09:08.406544] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-17T04:09:08.695441] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-17T04:09:08.815003] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:09.490192] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-11. [2025-09-17T04:09:09.582929] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T04:09:10.290136] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-17T04:09:10.330302] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T04:09:10.336880] [INFO ] [REMOTE ] HAYW: Full fetch complete (70886 records). [2025-09-17T04:09:10.337057] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-17T04:09:10.744493] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-17T04:09:10.744668] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-17T04:09:10.745899] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-17T04:09:10.745983] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-17T04:09:10.748341] [DEBUG] [LOCAL ] HAYW: Trimmed 70886 records to 48746 (keeping 200 days of data) [2025-09-17T04:09:11.051656] [DEBUG] [LOCAL ] HAYW: Primary data saved (48746 records). [2025-09-17T04:09:11.051833] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-17T04:09:11.051941] [INFO ] [MAIN ] Update Progress: 995/2369 symbols completed. HAYW took 40.2s. Estimated remaining: 3h 20m 20s. Rate: 6.9 symbols/min [2025-09-17T04:09:11.095225] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-17T04:09:11.232926] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:11.268066] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T04:09:11.304521] [DEBUG] [LOCAL ] HCC: Loaded 33661 existing records from primary storage. [2025-09-17T04:09:11.304767] [INFO ] [MAIN ] HCC: Loaded 33661 existing records. [2025-09-17T04:09:11.495774] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:11.496041] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-17T04:09:11.496284] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-17T04:09:11.497287] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-17T04:09:11.497376] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-17T04:09:11.758413] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T04:09:11.892693] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-17T04:09:11.916596] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:12.690187] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-17T04:09:13.001889] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T04:09:13.129451] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T04:09:13.490182] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-17T04:09:14.290163] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-17T04:09:15.090193] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-11. [2025-09-17T04:09:15.293525] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-17T04:09:15.890174] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-17T04:09:15.998578] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-17T04:09:16.453613] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-17T04:09:16.690119] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-17T04:09:16.767481] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T04:09:17.490204] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-17T04:09:17.679310] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T04:09:18.296778] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-17T04:09:18.335419] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T04:09:18.899093] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T04:09:19.090160] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-17T04:09:19.735865] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T04:09:19.890133] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-17T04:09:20.691173] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-17T04:09:20.694449] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T04:09:21.488668] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T04:09:21.498277] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-17T04:09:22.290138] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-17T04:09:22.421704] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T04:09:22.995788] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T04:09:23.090108] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-17T04:09:23.890147] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-17T04:09:24.060043] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T04:09:24.696200] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-17T04:09:24.702326] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T04:09:25.289903] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T04:09:25.490146] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-17T04:09:26.098300] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T04:09:26.290135] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-17T04:09:27.090133] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-17T04:09:27.490841] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T04:09:27.896609] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-17T04:09:27.923735] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T04:09:28.529746] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T04:09:28.690183] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-17T04:09:29.401589] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T04:09:29.490130] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-17T04:09:30.293436] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-17T04:09:30.304243] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T04:09:31.090154] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-17T04:09:31.139634] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T04:09:31.743748] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T04:09:31.750388] [INFO ] [REMOTE ] HBI: Full fetch complete (76769 records). [2025-09-17T04:09:31.750589] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-17T04:09:31.897791] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-17T04:09:32.175088] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-17T04:09:32.175255] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-17T04:09:32.176843] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-17T04:09:32.176920] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-17T04:09:32.179027] [DEBUG] [LOCAL ] HBI: Trimmed 76769 records to 53046 (keeping 200 days of data) [2025-09-17T04:09:32.524974] [DEBUG] [LOCAL ] HBI: Primary data saved (53046 records). [2025-09-17T04:09:32.525245] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-17T04:09:32.525409] [INFO ] [MAIN ] Update Progress: 996/2369 symbols completed. HBI took 41.6s. Estimated remaining: 3h 20m 29s. Rate: 6.8 symbols/min [2025-09-17T04:09:32.695513] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-17T04:09:32.724126] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:32.725843] [DEBUG] [LOCAL ] HCI: No existing data file found in primary storage. [2025-09-17T04:09:32.726102] [WARN ] [MAIN ] HCI: No existing data found, performing full refresh instead. [2025-09-17T04:09:32.726237] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-17T04:09:32.726291] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-17T04:09:32.726340] [DEBUG] [LOCAL ] HCI: No primary data file found to delete. [2025-09-17T04:09:32.726405] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-17T04:09:33.205999] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-17T04:09:33.239280] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:33.490161] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-17T04:09:33.541250] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T04:09:34.095124] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T04:09:34.290186] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-17T04:09:35.090131] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-11. [2025-09-17T04:09:35.404588] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T04:09:35.890134] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-17T04:09:35.986368] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T04:09:36.072208] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T04:09:36.690194] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-17T04:09:37.448544] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T04:09:37.490086] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-17T04:09:38.231451] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T04:09:38.290087] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-17T04:09:39.090147] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-17T04:09:39.134848] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T04:09:39.692474] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T04:09:39.699007] [INFO ] [REMOTE ] HCC: Full fetch complete (63922 records). [2025-09-17T04:09:39.699218] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-17T04:09:39.902127] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-17T04:09:40.111386] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-17T04:09:40.111520] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-17T04:09:40.112416] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-17T04:09:40.112512] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-17T04:09:40.114051] [DEBUG] [LOCAL ] HCC: Trimmed 63922 records to 45429 (keeping 200 days of data) [2025-09-17T04:09:40.415048] [DEBUG] [LOCAL ] HCC: Primary data saved (45429 records). [2025-09-17T04:09:40.415276] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-17T04:09:40.415396] [INFO ] [MAIN ] Update Progress: 997/2369 symbols completed. HCC took 29.4s. Estimated remaining: 3h 20m 19s. Rate: 6.8 symbols/min [2025-09-17T04:09:40.695240] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-17T04:09:40.714287] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T04:09:41.182465] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T04:09:41.188863] [INFO ] [REMOTE ] HCA: Full fetch complete (69178 records). [2025-09-17T04:09:41.189045] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-17T04:09:41.495243] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-17T04:09:41.596763] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-17T04:09:41.596907] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-17T04:09:41.598432] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-17T04:09:41.598497] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-17T04:09:41.600632] [DEBUG] [LOCAL ] HCA: Trimmed 69178 records to 47465 (keeping 200 days of data) [2025-09-17T04:09:41.732169] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:09:41.933406] [DEBUG] [LOCAL ] HCA: Primary data saved (47465 records). [2025-09-17T04:09:41.933589] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-17T04:09:41.933747] [INFO ] [MAIN ] Update Progress: 998/2369 symbols completed. HCA took 33.9s. Estimated remaining: 3h 19m 60s. Rate: 6.9 symbols/min [2025-09-17T04:09:42.290130] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-17T04:09:43.156965] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T04:09:43.160768] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-17T04:09:43.260412] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T04:09:43.269436] [INFO ] [REMOTE ] HBM: Full fetch complete (75854 records). [2025-09-17T04:09:43.269614] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-17T04:09:43.671318] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-17T04:09:43.671445] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-17T04:09:43.672507] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-17T04:09:43.672568] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-17T04:09:43.674252] [DEBUG] [LOCAL ] HBM: Trimmed 75854 records to 52925 (keeping 200 days of data) [2025-09-17T04:09:44.017849] [DEBUG] [LOCAL ] HBM: Primary data saved (52925 records). [2025-09-17T04:09:44.018032] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-17T04:09:44.018182] [INFO ] [MAIN ] Update Progress: 999/2369 symbols completed. HBM took 38.2s. Estimated remaining: 3h 19m 42s. Rate: 6.9 symbols/min [2025-09-17T04:09:44.063964] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T04:09:44.068568] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-17T04:09:44.816708] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T04:09:44.820536] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-17T04:09:45.803769] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T04:09:45.807409] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-17T04:09:46.719071] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T04:09:46.722545] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-17T04:09:47.724129] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T04:09:47.729536] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-17T04:09:48.815013] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T04:09:48.819308] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-17T04:09:49.757101] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T04:09:49.760925] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-17T04:09:50.782886] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T04:09:50.785761] [INFO ] [REMOTE ] HCI: Full fetch complete (19533 records). [2025-09-17T04:09:50.786296] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-17T04:09:51.162743] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-17T04:09:51.162913] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-17T04:09:51.163425] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-17T04:09:51.163487] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-17T04:09:51.164598] [DEBUG] [LOCAL ] HCI: Trimmed 19533 records to 14074 (keeping 200 days of data) [2025-09-17T04:09:51.260683] [DEBUG] [LOCAL ] HCI: Primary data saved (14074 records). [2025-09-17T04:09:51.260887] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-17T04:09:51.260984] [INFO ] [MAIN ] Update Progress: 1000/2369 symbols completed. HCI took 18.7s. Estimated remaining: 3h 19m 31s. Rate: 6.9 symbols/min [2025-09-17T04:09:51.897921] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:51.918157] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:51.993186] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:52.014160] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-17T04:09:52.013629] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:09:52.014699] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-17T04:09:52.015850] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-17T04:09:52.016090] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-17T04:09:52.016353] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-17T04:09:52.016514] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-17T04:09:52.314347] [DEBUG] [LOCAL ] HE: Loaded 36245 existing records from primary storage. [2025-09-17T04:09:52.361592] [INFO ] [MAIN ] HE: Loaded 36245 existing records. [2025-09-17T04:09:52.400816] [DEBUG] [LOCAL ] HD: Loaded 39898 existing records from primary storage. [2025-09-17T04:09:52.412140] [DEBUG] [LOCAL ] HDB: Loaded 38408 existing records from primary storage. [2025-09-17T04:09:52.432609] [INFO ] [MAIN ] HDB: Loaded 38408 existing records. [2025-09-17T04:09:52.432514] [INFO ] [MAIN ] HD: Loaded 39898 existing records. [2025-09-17T04:09:52.758598] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:52.789294] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-11. [2025-09-17T04:09:52.977488] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:52.977169] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:52.988937] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-17T04:09:52.999786] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-17T04:09:52.999916] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-17T04:09:53.042852] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-17T04:09:53.065717] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-17T04:09:53.044708] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-17T04:09:53.066100] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-17T04:09:53.066167] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-17T04:09:53.065957] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:09:53.169003] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-17T04:09:53.211495] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-17T04:09:53.280725] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T04:09:53.296198] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-17T04:09:53.296309] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-17T04:09:53.297913] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-17T04:09:53.837661] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T04:09:53.874995] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-17T04:09:54.179895] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:54.236863] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-11. [2025-09-17T04:09:54.231378] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:54.276861] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-11. [2025-09-17T04:09:54.301352] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:09:54.302045] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-11. [2025-09-17T04:09:54.344327] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T04:09:54.345769] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-17T04:09:54.647437] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-17T04:09:55.090211] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-17T04:09:55.314656] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-17T04:09:55.881945] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T04:09:55.892360] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-17T04:09:55.984917] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T04:09:56.122422] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.23 seconds). [2025-09-17T04:09:56.453952] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-17T04:09:56.690142] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-17T04:09:57.490222] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-17T04:09:58.290195] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-17T04:09:58.345685] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T04:09:59.090210] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-17T04:09:59.334771] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T04:09:59.890102] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-17T04:10:00.374798] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T04:10:00.459018] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T04:10:00.690166] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-17T04:10:01.490203] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-17T04:10:01.749409] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T04:10:01.966334] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T04:10:02.290139] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-17T04:10:03.090123] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-17T04:10:03.296397] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T04:10:03.890114] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-17T04:10:04.190220] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:10:04.484984] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T04:10:04.690109] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-17T04:10:05.490166] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-17T04:10:05.977475] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-17T04:10:06.290156] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-17T04:10:06.508557] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T04:10:06.523102] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-17T04:10:07.090199] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-17T04:10:07.237785] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T04:10:07.890142] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-17T04:10:08.690186] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-17T04:10:08.899067] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:10:09.027298] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T04:10:09.490174] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-17T04:10:09.720159] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-17T04:10:10.127495] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-17T04:10:10.290206] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-17T04:10:11.090202] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-17T04:10:11.890127] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-17T04:10:12.120050] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T04:10:12.690141] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-17T04:10:13.296197] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-17T04:10:13.490139] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-17T04:10:13.816391] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-17T04:10:13.860367] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T04:10:14.249043] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T04:10:14.290126] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-17T04:10:15.090153] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-17T04:10:15.890099] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-17T04:10:15.932509] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T04:10:16.690250] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-17T04:10:16.786562] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T04:10:16.989515] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-17T04:10:16.990435] [INFO ] [REMOTE ] HCXY: Full fetch complete (598 records). [2025-09-17T04:10:16.990517] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-17T04:10:17.175470] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-09-17T04:10:17.175709] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:10:17.175769] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:10:17.175816] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-17T04:10:17.175894] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-17T04:10:17.175955] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-17T04:10:17.176018] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-17T04:10:17.176087] [INFO ] [MAIN ] Update Progress: 1001/2369 symbols completed. HCXY took 25.9s. Estimated remaining: 3h 19m 46s. Rate: 6.8 symbols/min [2025-09-17T04:10:17.347457] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:17.370536] [DEBUG] [LOCAL ] HEI: Loaded 23607 existing records from primary storage. [2025-09-17T04:10:17.370705] [INFO ] [MAIN ] HEI: Loaded 23607 existing records. [2025-09-17T04:10:17.495320] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-17T04:10:17.554348] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:10:17.554804] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-17T04:10:17.554881] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-17T04:10:17.555727] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-17T04:10:17.555839] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-17T04:10:17.952424] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:17.975255] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T04:10:18.290151] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-11. [2025-09-17T04:10:19.090291] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-17T04:10:19.325676] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T04:10:19.563556] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T04:10:19.890153] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-17T04:10:20.690178] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-17T04:10:20.837906] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T04:10:21.490203] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-17T04:10:21.720895] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T04:10:22.121426] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T04:10:22.128077] [INFO ] [REMOTE ] HE: Full fetch complete (72375 records). [2025-09-17T04:10:22.128289] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-17T04:10:22.307151] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-17T04:10:22.544376] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-17T04:10:22.544534] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-17T04:10:22.545784] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-17T04:10:22.545901] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-17T04:10:22.547793] [DEBUG] [LOCAL ] HE: Trimmed 72375 records to 49341 (keeping 200 days of data) [2025-09-17T04:10:22.881159] [DEBUG] [LOCAL ] HE: Primary data saved (49341 records). [2025-09-17T04:10:22.881352] [INFO ] [MAIN ] HE: Full history saved. [2025-09-17T04:10:22.881453] [INFO ] [MAIN ] Update Progress: 1002/2369 symbols completed. HE took 31.6s. Estimated remaining: 3h 19m 33s. Rate: 6.9 symbols/min [2025-09-17T04:10:23.069080] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:23.076163] [DEBUG] [LOCAL ] HEQ: Loaded 4338 existing records from primary storage. [2025-09-17T04:10:23.076306] [INFO ] [MAIN ] HEQ: Loaded 4338 existing records. [2025-09-17T04:10:23.108170] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-17T04:10:23.264322] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:10:23.264768] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-17T04:10:23.264854] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-17T04:10:23.275510] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-17T04:10:23.293862] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-17T04:10:23.329344] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T04:10:23.685955] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:23.721728] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T04:10:23.890123] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-17T04:10:24.690151] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-17T04:10:25.386669] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T04:10:25.490206] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-17T04:10:25.584980] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T04:10:25.591774] [INFO ] [REMOTE ] HDB: Full fetch complete (75057 records). [2025-09-17T04:10:25.591958] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-17T04:10:25.989062] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-17T04:10:25.989198] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-17T04:10:25.990221] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-17T04:10:25.990303] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-17T04:10:25.992004] [DEBUG] [LOCAL ] HDB: Trimmed 75057 records to 51918 (keeping 200 days of data) [2025-09-17T04:10:26.254707] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T04:10:26.290185] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-17T04:10:26.372958] [DEBUG] [LOCAL ] HDB: Primary data saved (51918 records). [2025-09-17T04:10:26.373171] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-17T04:10:26.373291] [INFO ] [MAIN ] Update Progress: 1003/2369 symbols completed. HDB took 35.1s. Estimated remaining: 3h 19m 17s. Rate: 6.9 symbols/min [2025-09-17T04:10:26.545025] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:26.584263] [DEBUG] [LOCAL ] HESM: Loaded 35958 existing records from primary storage. [2025-09-17T04:10:26.584461] [INFO ] [MAIN ] HESM: Loaded 35958 existing records. [2025-09-17T04:10:26.773488] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:10:26.773821] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-17T04:10:26.773897] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-17T04:10:26.774789] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-17T04:10:26.774870] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-17T04:10:27.095375] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-11. [2025-09-17T04:10:27.173212] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:27.357981] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T04:10:27.590586] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T04:10:27.715458] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T04:10:27.890194] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-17T04:10:28.690196] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-11. [2025-09-17T04:10:29.411383] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:10:29.490146] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-17T04:10:30.153031] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T04:10:30.290136] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-17T04:10:31.051268] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T04:10:31.090075] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-17T04:10:31.890153] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-17T04:10:32.304708] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-17T04:10:32.311439] [INFO ] [REMOTE ] HD: Full fetch complete (77339 records). [2025-09-17T04:10:32.311624] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-17T04:10:32.636365] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T04:10:32.709877] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-17T04:10:32.737829] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-17T04:10:32.738898] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-17T04:10:32.740064] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-17T04:10:32.740278] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-17T04:10:32.751248] [DEBUG] [LOCAL ] HD: Trimmed 77339 records to 53522 (keeping 200 days of data) [2025-09-17T04:10:32.770729] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T04:10:33.127713] [DEBUG] [LOCAL ] HD: Primary data saved (53522 records). [2025-09-17T04:10:33.127895] [INFO ] [MAIN ] HD: Full history saved. [2025-09-17T04:10:33.127989] [INFO ] [MAIN ] Update Progress: 1004/2369 symbols completed. HD took 41.9s. Estimated remaining: 3h 19m 6s. Rate: 6.9 symbols/min [2025-09-17T04:10:33.239110] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T04:10:33.313739] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:33.313978] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-17T04:10:33.314056] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-17T04:10:33.314172] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-17T04:10:33.314247] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-17T04:10:33.314313] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-17T04:10:33.314362] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-17T04:10:33.498830] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-17T04:10:33.730383] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:34.290174] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-17T04:10:34.889975] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T04:10:35.090169] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-17T04:10:35.138350] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T04:10:35.890126] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-17T04:10:36.113310] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T04:10:36.538388] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T04:10:36.690143] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-17T04:10:37.211602] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T04:10:37.490178] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-11. [2025-09-17T04:10:37.724073] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-11 (0.23 seconds). [2025-09-17T04:10:38.290152] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-17T04:10:38.936636] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T04:10:39.090146] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-17T04:10:39.890140] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-17T04:10:40.629692] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T04:10:40.655720] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T04:10:40.690099] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-17T04:10:41.382118] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T04:10:41.490151] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-17T04:10:41.809165] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-17T04:10:42.290155] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-17T04:10:42.522615] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-09-17T04:10:43.090130] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-17T04:10:43.890142] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-17T04:10:44.437339] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T04:10:44.690132] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-17T04:10:45.261090] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T04:10:45.490171] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-17T04:10:45.527929] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T04:10:46.290143] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-17T04:10:46.595063] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-17T04:10:46.941535] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:10:47.090138] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-17T04:10:47.808675] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T04:10:47.810385] [INFO ] [REMOTE ] HEQ: Full fetch complete (8816 records). [2025-09-17T04:10:47.810478] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-17T04:10:47.895230] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-17T04:10:48.178374] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-17T04:10:48.178513] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-17T04:10:48.178828] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-17T04:10:48.178903] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-17T04:10:48.179427] [DEBUG] [LOCAL ] HEQ: Trimmed 8816 records to 6098 (keeping 200 days of data) [2025-09-17T04:10:48.217281] [DEBUG] [LOCAL ] HEQ: Primary data saved (6098 records). [2025-09-17T04:10:48.217449] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-17T04:10:48.217578] [INFO ] [MAIN ] Update Progress: 1005/2369 symbols completed. HEQ took 25.3s. Estimated remaining: 3h 19m 5s. Rate: 6.9 symbols/min [2025-09-17T04:10:48.400407] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:48.401466] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-17T04:10:48.401551] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-17T04:10:48.401751] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-17T04:10:48.401826] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-17T04:10:48.401896] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-17T04:10:48.401959] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-17T04:10:48.695224] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-17T04:10:48.763536] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:48.986546] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T04:10:49.388229] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T04:10:49.392128] [INFO ] [REMOTE ] HEI: Full fetch complete (49301 records). [2025-09-17T04:10:49.392247] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-17T04:10:49.495926] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-11. [2025-09-17T04:10:49.788422] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-17T04:10:49.788531] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-17T04:10:49.789500] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-17T04:10:49.789574] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-17T04:10:49.790894] [DEBUG] [LOCAL ] HEI: Trimmed 49301 records to 33129 (keeping 200 days of data) [2025-09-17T04:10:49.887678] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T04:10:50.011170] [DEBUG] [LOCAL ] HEI: Primary data saved (33129 records). [2025-09-17T04:10:50.011353] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-17T04:10:50.011459] [INFO ] [MAIN ] Update Progress: 1006/2369 symbols completed. HEI took 32.8s. Estimated remaining: 3h 18m 47s. Rate: 6.9 symbols/min [2025-09-17T04:10:50.192073] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:10:50.205021] [DEBUG] [LOCAL ] HFRO: Loaded 11949 existing records from primary storage. [2025-09-17T04:10:50.205200] [INFO ] [MAIN ] HFRO: Loaded 11949 existing records. [2025-09-17T04:10:50.295266] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-17T04:10:50.411448] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:10:50.411783] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-17T04:10:50.411870] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-17T04:10:50.412431] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-17T04:10:50.412492] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-17T04:10:50.796262] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:10:51.090182] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-17T04:10:51.524735] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T04:10:51.890128] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-11. [2025-09-17T04:10:51.977681] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T04:10:52.649009] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T04:10:52.690183] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-17T04:10:53.490151] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-17T04:10:53.548681] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T04:10:53.734730] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-09-17T04:10:54.290153] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-17T04:10:54.534434] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-17T04:10:55.090147] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-17T04:10:55.477758] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-17T04:10:55.890193] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-17T04:10:56.690138] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-17T04:10:57.490152] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-17T04:10:57.598522] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T04:10:57.738565] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-17T04:10:57.852754] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T04:10:58.290157] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-17T04:10:59.090214] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-17T04:10:59.333708] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-17T04:10:59.890157] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-17T04:10:59.944669] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T04:11:00.690130] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-17T04:11:00.931578] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T04:11:01.105919] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T04:11:01.490181] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-17T04:11:01.779942] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T04:11:02.290146] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-17T04:11:02.524638] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.23 seconds). [2025-09-17T04:11:03.090280] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-17T04:11:03.890181] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-17T04:11:04.201173] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T04:11:04.297416] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-17T04:11:04.690160] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-17T04:11:05.015913] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T04:11:05.490169] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-17T04:11:05.852397] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T04:11:05.853130] [INFO ] [REMOTE ] HF: Full fetch complete (510 records). [2025-09-17T04:11:05.853214] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-17T04:11:06.039920] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-17T04:11:06.040167] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:11:06.040241] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:11:06.040367] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-17T04:11:06.040444] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-17T04:11:06.040492] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-17T04:11:06.040560] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-17T04:11:06.040631] [INFO ] [MAIN ] Update Progress: 1007/2369 symbols completed. HF took 32.9s. Estimated remaining: 3h 18m 48s. Rate: 6.9 symbols/min [2025-09-17T04:11:06.215854] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:06.227954] [DEBUG] [LOCAL ] HGER: Loaded 9995 existing records from primary storage. [2025-09-17T04:11:06.228161] [INFO ] [MAIN ] HGER: Loaded 9995 existing records. [2025-09-17T04:11:06.297722] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-17T04:11:06.428996] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:06.429286] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-17T04:11:06.429347] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-17T04:11:06.429845] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-17T04:11:06.429912] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-17T04:11:06.816139] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:07.090156] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-17T04:11:07.895274] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-17T04:11:07.911557] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T04:11:08.147940] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T04:11:08.246345] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T04:11:08.690137] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-17T04:11:09.490154] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-17T04:11:09.561745] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T04:11:09.893167] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T04:11:10.290130] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-17T04:11:11.090121] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-11. [2025-09-17T04:11:11.217690] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T04:11:11.687265] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T04:11:11.890130] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-17T04:11:12.181153] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-17T04:11:12.690189] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-17T04:11:13.490138] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-17T04:11:13.695986] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T04:11:14.187242] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T04:11:14.290158] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-17T04:11:15.090143] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-17T04:11:15.390176] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T04:11:15.561045] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T04:11:15.561904] [INFO ] [REMOTE ] HFND: Full fetch complete (1791 records). [2025-09-17T04:11:15.561986] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-17T04:11:15.742368] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-17T04:11:15.742552] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:11:15.742600] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:11:15.742663] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-17T04:11:15.742736] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-17T04:11:15.742782] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-17T04:11:15.742849] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-17T04:11:15.742918] [INFO ] [MAIN ] Update Progress: 1008/2369 symbols completed. HFND took 27.5s. Estimated remaining: 3h 18m 41s. Rate: 6.9 symbols/min [2025-09-17T04:11:15.897242] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-17T04:11:15.918769] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:15.928387] [DEBUG] [LOCAL ] HGLB: Loaded 6562 existing records from primary storage. [2025-09-17T04:11:15.928819] [INFO ] [MAIN ] HGLB: Loaded 6562 existing records. [2025-09-17T04:11:16.104701] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:16.104968] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-17T04:11:16.105028] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-17T04:11:16.105342] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-17T04:11:16.105399] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-17T04:11:16.470769] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:16.690166] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-17T04:11:16.853292] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T04:11:16.856193] [INFO ] [REMOTE ] HFRO: Full fetch complete (28964 records). [2025-09-17T04:11:16.856299] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-17T04:11:17.257537] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-17T04:11:17.257701] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-17T04:11:17.258440] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-17T04:11:17.258513] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-17T04:11:17.259474] [DEBUG] [LOCAL ] HFRO: Trimmed 28964 records to 17567 (keeping 200 days of data) [2025-09-17T04:11:17.371925] [DEBUG] [LOCAL ] HFRO: Primary data saved (17567 records). [2025-09-17T04:11:17.372260] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-17T04:11:17.372422] [INFO ] [MAIN ] Update Progress: 1009/2369 symbols completed. HFRO took 27.4s. Estimated remaining: 3h 18m 22s. Rate: 6.9 symbols/min [2025-09-17T04:11:17.498336] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-11. [2025-09-17T04:11:17.584604] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:17.598308] [DEBUG] [LOCAL ] HGTY: Loaded 10001 existing records from primary storage. [2025-09-17T04:11:17.598556] [INFO ] [MAIN ] HGTY: Loaded 10001 existing records. [2025-09-17T04:11:17.795962] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:17.796400] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-17T04:11:17.796467] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-17T04:11:17.796933] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-17T04:11:17.797002] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-17T04:11:18.187632] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:18.230572] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T04:11:18.290160] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-17T04:11:18.456756] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T04:11:18.747361] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T04:11:19.090189] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-17T04:11:19.890147] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-17T04:11:20.690167] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-11. [2025-09-17T04:11:20.707671] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T04:11:20.797118] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T04:11:21.490168] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-17T04:11:21.599862] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T04:11:22.024134] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T04:11:22.290142] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-17T04:11:23.090222] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-17T04:11:23.825093] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T04:11:23.833923] [INFO ] [REMOTE ] HESM: Full fetch complete (68259 records). [2025-09-17T04:11:23.834135] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-17T04:11:23.895265] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-17T04:11:24.004291] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T04:11:24.279906] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-17T04:11:24.280023] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-17T04:11:24.280992] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-17T04:11:24.281064] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-17T04:11:24.282725] [DEBUG] [LOCAL ] HESM: Trimmed 68259 records to 48174 (keeping 200 days of data) [2025-09-17T04:11:24.595325] [DEBUG] [LOCAL ] HESM: Primary data saved (48174 records). [2025-09-17T04:11:24.595497] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-17T04:11:24.595618] [INFO ] [MAIN ] Update Progress: 1010/2369 symbols completed. HESM took 58.2s. Estimated remaining: 3h 18m 12s. Rate: 6.9 symbols/min [2025-09-17T04:11:24.696820] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-17T04:11:24.809923] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:24.818293] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T04:11:24.855022] [DEBUG] [LOCAL ] HGV: Loaded 35072 existing records from primary storage. [2025-09-17T04:11:24.855223] [INFO ] [MAIN ] HGV: Loaded 35072 existing records. [2025-09-17T04:11:25.039011] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:25.039270] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-17T04:11:25.039329] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-17T04:11:25.040177] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-17T04:11:25.040241] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-17T04:11:25.400931] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:25.405894] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T04:11:25.490133] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-17T04:11:26.228755] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T04:11:26.290101] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-17T04:11:26.889828] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T04:11:27.090152] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-17T04:11:27.897063] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-17T04:11:27.897969] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T04:11:28.690175] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-17T04:11:28.738959] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T04:11:29.274585] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T04:11:29.490159] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-17T04:11:30.238845] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T04:11:30.290096] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-17T04:11:30.963712] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T04:11:31.090129] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-17T04:11:31.890658] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-17T04:11:31.892300] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T04:11:32.675389] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T04:11:32.690093] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-17T04:11:33.475693] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T04:11:33.490129] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-11. [2025-09-17T04:11:34.290192] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-17T04:11:34.950072] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T04:11:35.090144] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-17T04:11:35.323698] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T04:11:35.890179] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-17T04:11:36.564420] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T04:11:36.622822] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T04:11:36.690117] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-17T04:11:37.432497] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T04:11:37.435329] [INFO ] [REMOTE ] HGER: Full fetch complete (15483 records). [2025-09-17T04:11:37.435447] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-17T04:11:37.495278] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-17T04:11:37.858878] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-17T04:11:37.859050] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-17T04:11:37.859599] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-17T04:11:37.859685] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-17T04:11:37.860440] [DEBUG] [LOCAL ] HGER: Trimmed 15483 records to 12497 (keeping 200 days of data) [2025-09-17T04:11:37.942455] [DEBUG] [LOCAL ] HGER: Primary data saved (12497 records). [2025-09-17T04:11:37.942746] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-17T04:11:37.942894] [INFO ] [MAIN ] Update Progress: 1011/2369 symbols completed. HGER took 31.9s. Estimated remaining: 3h 18m 9s. Rate: 6.9 symbols/min [2025-09-17T04:11:38.122188] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:38.149679] [DEBUG] [LOCAL ] HHH: Loaded 25732 existing records from primary storage. [2025-09-17T04:11:38.149901] [INFO ] [MAIN ] HHH: Loaded 25732 existing records. [2025-09-17T04:11:38.294675] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-17T04:11:38.341278] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:38.349140] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:11:38.349242] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-17T04:11:38.352060] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-17T04:11:38.353305] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-17T04:11:38.353381] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-17T04:11:38.739905] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:39.090152] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-17T04:11:39.810501] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T04:11:39.867365] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T04:11:39.890080] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-17T04:11:40.645271] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T04:11:40.690089] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-17T04:11:41.450308] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T04:11:41.490115] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-17T04:11:42.290174] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-17T04:11:42.317948] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T04:11:42.320038] [INFO ] [REMOTE ] HGLB: Full fetch complete (14237 records). [2025-09-17T04:11:42.320135] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-17T04:11:42.702134] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-17T04:11:42.702285] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-17T04:11:42.702798] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-17T04:11:42.702861] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-17T04:11:42.703736] [DEBUG] [LOCAL ] HGLB: Trimmed 14237 records to 9787 (keeping 200 days of data) [2025-09-17T04:11:42.768563] [DEBUG] [LOCAL ] HGLB: Primary data saved (9787 records). [2025-09-17T04:11:42.768819] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-17T04:11:42.768947] [INFO ] [MAIN ] Update Progress: 1012/2369 symbols completed. HGLB took 27.0s. Estimated remaining: 3h 17m 55s. Rate: 6.9 symbols/min [2025-09-17T04:11:42.954120] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:42.983681] [DEBUG] [LOCAL ] HI: Loaded 25850 existing records from primary storage. [2025-09-17T04:11:42.983915] [INFO ] [MAIN ] HI: Loaded 25850 existing records. [2025-09-17T04:11:43.090448] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-11. [2025-09-17T04:11:43.170101] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T04:11:43.190861] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:43.195109] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-17T04:11:43.195205] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-17T04:11:43.196116] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-17T04:11:43.196184] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-17T04:11:43.569007] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:43.890123] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-17T04:11:44.213790] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T04:11:44.642823] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T04:11:44.690130] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-17T04:11:45.323686] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T04:11:45.490202] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-17T04:11:46.290224] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-17T04:11:46.946833] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T04:11:47.090156] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-17T04:11:47.327270] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T04:11:47.890138] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-17T04:11:48.634637] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T04:11:48.690169] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-17T04:11:48.885603] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T04:11:48.888861] [INFO ] [REMOTE ] HGTY: Full fetch complete (16804 records). [2025-09-17T04:11:48.888968] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-17T04:11:49.252512] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-17T04:11:49.252632] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-17T04:11:49.253095] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-17T04:11:49.253167] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-17T04:11:49.253775] [DEBUG] [LOCAL ] HGTY: Trimmed 16804 records to 12626 (keeping 200 days of data) [2025-09-17T04:11:49.337165] [DEBUG] [LOCAL ] HGTY: Primary data saved (12626 records). [2025-09-17T04:11:49.337382] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-17T04:11:49.337496] [INFO ] [MAIN ] Update Progress: 1013/2369 symbols completed. HGTY took 32.0s. Estimated remaining: 3h 17m 43s. Rate: 6.9 symbols/min [2025-09-17T04:11:49.490285] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-11. [2025-09-17T04:11:49.509290] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:11:49.549546] [DEBUG] [LOCAL ] HIG: Loaded 38323 existing records from primary storage. [2025-09-17T04:11:49.549736] [INFO ] [MAIN ] HIG: Loaded 38323 existing records. [2025-09-17T04:11:49.724260] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:11:49.724513] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-17T04:11:49.724570] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-17T04:11:49.725539] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-17T04:11:49.725603] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-17T04:11:50.078328] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:11:50.290180] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-11. [2025-09-17T04:11:50.362861] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:11:50.825936] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T04:11:51.090156] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-17T04:11:51.845893] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T04:11:51.890082] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-17T04:11:52.403579] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T04:11:52.690126] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-17T04:11:53.269473] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:11:53.490143] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-17T04:11:54.300213] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-17T04:11:54.306097] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T04:11:54.787975] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T04:11:55.090152] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-17T04:11:55.890143] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-17T04:11:56.047614] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T04:11:56.147675] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T04:11:56.690203] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-17T04:11:57.175727] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T04:11:57.490201] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-17T04:11:57.960953] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T04:11:58.290246] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-17T04:11:58.432788] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T04:11:59.090104] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-17T04:11:59.466715] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T04:11:59.890193] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-17T04:12:00.690153] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-17T04:12:00.889091] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T04:12:01.154943] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T04:12:01.490198] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-17T04:12:02.290159] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-17T04:12:02.830979] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T04:12:03.090196] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-17T04:12:03.890219] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-17T04:12:04.315843] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-09-17T04:12:04.551948] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-17T04:12:04.690190] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-17T04:12:05.490238] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-17T04:12:05.685542] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T04:12:05.925669] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-09-17T04:12:06.105695] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T04:12:06.290128] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-17T04:12:06.794891] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T04:12:07.090131] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-17T04:12:07.605089] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T04:12:07.890138] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-17T04:12:08.408913] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T04:12:08.690168] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-17T04:12:09.445194] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T04:12:09.451489] [INFO ] [REMOTE ] HGV: Full fetch complete (65731 records). [2025-09-17T04:12:09.451695] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-17T04:12:09.495865] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-17T04:12:09.858911] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-17T04:12:09.859051] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-17T04:12:09.860053] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-17T04:12:09.860125] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-17T04:12:09.861799] [DEBUG] [LOCAL ] HGV: Trimmed 65731 records to 47137 (keeping 200 days of data) [2025-09-17T04:12:10.148018] [DEBUG] [LOCAL ] HGV: Primary data saved (47137 records). [2025-09-17T04:12:10.148202] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-17T04:12:10.148324] [INFO ] [MAIN ] Update Progress: 1014/2369 symbols completed. HGV took 45.6s. Estimated remaining: 3h 17m 51s. Rate: 6.8 symbols/min [2025-09-17T04:12:10.298789] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-17T04:12:10.326167] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:10.357795] [DEBUG] [LOCAL ] HII: Loaded 24405 existing records from primary storage. [2025-09-17T04:12:10.358168] [INFO ] [MAIN ] HII: Loaded 24405 existing records. [2025-09-17T04:12:10.543556] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:10.544066] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-17T04:12:10.544173] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-17T04:12:10.544950] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-17T04:12:10.545121] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-17T04:12:10.742423] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T04:12:10.957931] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:11.090105] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-17T04:12:11.187386] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T04:12:11.701137] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T04:12:11.890151] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-17T04:12:12.690150] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-11. [2025-09-17T04:12:12.759475] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T04:12:13.365866] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T04:12:13.490175] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-17T04:12:14.183077] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T04:12:14.290150] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-17T04:12:15.090222] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-17T04:12:15.336744] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T04:12:15.890151] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-17T04:12:16.690147] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-17T04:12:16.967008] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T04:12:16.971110] [INFO ] [REMOTE ] HI: Full fetch complete (49592 records). [2025-09-17T04:12:16.971244] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-17T04:12:17.296489] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (3.01 seconds). [2025-09-17T04:12:17.392947] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-17T04:12:17.393064] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-17T04:12:17.393822] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-17T04:12:17.393881] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-17T04:12:17.395119] [DEBUG] [LOCAL ] HI: Trimmed 49592 records to 35100 (keeping 200 days of data) [2025-09-17T04:12:17.498079] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-17T04:12:17.633160] [DEBUG] [LOCAL ] HI: Primary data saved (35100 records). [2025-09-17T04:12:17.633358] [INFO ] [MAIN ] HI: Full history saved. [2025-09-17T04:12:17.633494] [INFO ] [MAIN ] Update Progress: 1015/2369 symbols completed. HI took 34.9s. Estimated remaining: 3h 17m 40s. Rate: 6.8 symbols/min [2025-09-17T04:12:17.801989] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:17.843690] [DEBUG] [LOCAL ] HIMS: Loaded 40167 existing records from primary storage. [2025-09-17T04:12:17.843860] [INFO ] [MAIN ] HIMS: Loaded 40167 existing records. [2025-09-17T04:12:18.020065] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:18.020328] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-17T04:12:18.020378] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-17T04:12:18.021275] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-17T04:12:18.021335] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-17T04:12:18.382452] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:18.382803] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-11. [2025-09-17T04:12:18.615539] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (2.73 seconds). [2025-09-17T04:12:18.653110] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T04:12:18.723961] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T04:12:19.090173] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-17T04:12:19.890197] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-17T04:12:20.690209] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-17T04:12:20.831279] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T04:12:20.839935] [INFO ] [REMOTE ] HIG: Full fetch complete (73063 records). [2025-09-17T04:12:20.840255] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-17T04:12:21.282059] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-11 (2.90 seconds). [2025-09-17T04:12:21.337168] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-17T04:12:21.337350] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-17T04:12:21.339093] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-17T04:12:21.339182] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-17T04:12:21.341517] [DEBUG] [LOCAL ] HIG: Trimmed 73063 records to 51311 (keeping 200 days of data) [2025-09-17T04:12:21.490211] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-17T04:12:21.643954] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T04:12:21.766717] [DEBUG] [LOCAL ] HIG: Primary data saved (51311 records). [2025-09-17T04:12:21.767103] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-17T04:12:21.767306] [INFO ] [MAIN ] Update Progress: 1016/2369 symbols completed. HIG took 32.4s. Estimated remaining: 3h 17m 25s. Rate: 6.9 symbols/min [2025-09-17T04:12:21.952777] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:21.980005] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T04:12:22.003394] [DEBUG] [LOCAL ] HIO: Loaded 16041 existing records from primary storage. [2025-09-17T04:12:22.003660] [INFO ] [MAIN ] HIO: Loaded 16041 existing records. [2025-09-17T04:12:22.194319] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:22.194798] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-17T04:12:22.194884] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-17T04:12:22.195463] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-17T04:12:22.195530] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-17T04:12:22.297556] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-17T04:12:22.592129] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:23.090139] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-17T04:12:23.901358] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-11. [2025-09-17T04:12:23.926788] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T04:12:24.001583] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-17T04:12:24.648500] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T04:12:24.690129] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-17T04:12:24.716175] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T04:12:25.490137] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-17T04:12:26.290127] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-17T04:12:26.505067] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:12:27.090117] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-17T04:12:27.596257] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T04:12:27.600747] [INFO ] [REMOTE ] HHH: Full fetch complete (44700 records). [2025-09-17T04:12:27.600904] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-17T04:12:27.891606] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-17T04:12:27.987807] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-17T04:12:27.987988] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-17T04:12:27.988892] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-17T04:12:27.988968] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-17T04:12:27.990449] [DEBUG] [LOCAL ] HHH: Trimmed 44700 records to 32988 (keeping 200 days of data) [2025-09-17T04:12:28.111802] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-17T04:12:28.238149] [DEBUG] [LOCAL ] HHH: Primary data saved (32988 records). [2025-09-17T04:12:28.238328] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-17T04:12:28.238449] [INFO ] [MAIN ] Update Progress: 1017/2369 symbols completed. HHH took 50.3s. Estimated remaining: 3h 17m 14s. Rate: 6.9 symbols/min [2025-09-17T04:12:28.410132] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:28.427806] [DEBUG] [LOCAL ] HIPO: Loaded 16781 existing records from primary storage. [2025-09-17T04:12:28.427979] [INFO ] [MAIN ] HIPO: Loaded 16781 existing records. [2025-09-17T04:12:28.612994] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:28.613446] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-17T04:12:28.613597] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-17T04:12:28.614189] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-17T04:12:28.614280] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-17T04:12:28.692986] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-17T04:12:28.870727] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T04:12:29.037956] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:29.118078] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T04:12:29.490231] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-17T04:12:30.290199] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-17T04:12:30.716632] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T04:12:31.090154] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-17T04:12:31.260521] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-17T04:12:31.314315] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T04:12:31.890148] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-11. [2025-09-17T04:12:32.626268] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:12:32.690218] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-17T04:12:33.217704] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T04:12:33.490155] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-17T04:12:34.290192] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-17T04:12:34.706567] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T04:12:35.090193] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-17T04:12:35.251614] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-17T04:12:35.756588] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T04:12:35.890188] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-17T04:12:36.541003] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T04:12:36.690158] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-17T04:12:37.006344] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T04:12:37.490176] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-17T04:12:37.623214] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T04:12:38.290155] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-17T04:12:38.713425] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T04:12:38.717831] [INFO ] [REMOTE ] HII: Full fetch complete (53502 records). [2025-09-17T04:12:38.717994] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-17T04:12:39.095316] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-17T04:12:39.144491] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-17T04:12:39.144827] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-17T04:12:39.145864] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-17T04:12:39.145932] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-17T04:12:39.147585] [DEBUG] [LOCAL ] HII: Trimmed 53502 records to 35819 (keeping 200 days of data) [2025-09-17T04:12:39.362449] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T04:12:39.425272] [DEBUG] [LOCAL ] HII: Primary data saved (35819 records). [2025-09-17T04:12:39.425559] [INFO ] [MAIN ] HII: Full history saved. [2025-09-17T04:12:39.425724] [INFO ] [MAIN ] Update Progress: 1018/2369 symbols completed. HII took 29.3s. Estimated remaining: 3h 17m 8s. Rate: 6.9 symbols/min [2025-09-17T04:12:39.605998] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:39.646822] [DEBUG] [LOCAL ] HIW: Loaded 33209 existing records from primary storage. [2025-09-17T04:12:39.647096] [INFO ] [MAIN ] HIW: Loaded 33209 existing records. [2025-09-17T04:12:39.833316] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:39.833676] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-17T04:12:39.833741] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-17T04:12:39.836048] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-17T04:12:39.836122] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-17T04:12:39.897058] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-17T04:12:40.275571] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:40.291729] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T04:12:40.690240] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-17T04:12:41.055741] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T04:12:41.443168] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T04:12:41.490225] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-17T04:12:42.290243] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-17T04:12:43.090218] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-11. [2025-09-17T04:12:43.325441] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T04:12:43.890120] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-17T04:12:44.017166] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-17T04:12:44.695979] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-17T04:12:44.731620] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T04:12:45.141342] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T04:12:45.490097] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-17T04:12:45.526820] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T04:12:46.290192] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-17T04:12:46.618969] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T04:12:47.090235] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-17T04:12:47.890211] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-17T04:12:48.369078] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:12:48.623425] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-17T04:12:48.654625] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T04:12:48.690126] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-17T04:12:49.490241] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-17T04:12:49.797272] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T04:12:50.290211] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-17T04:12:51.090195] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-17T04:12:51.441347] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T04:12:51.828551] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-17T04:12:51.890099] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-17T04:12:52.275941] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T04:12:52.280919] [INFO ] [REMOTE ] HIO: Full fetch complete (36783 records). [2025-09-17T04:12:52.281097] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-17T04:12:52.692888] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-17T04:12:52.694667] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-17T04:12:52.694816] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-17T04:12:52.695750] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-17T04:12:52.695902] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-17T04:12:52.697327] [DEBUG] [LOCAL ] HIO: Trimmed 36783 records to 24130 (keeping 200 days of data) [2025-09-17T04:12:52.842109] [DEBUG] [LOCAL ] HIO: Primary data saved (24130 records). [2025-09-17T04:12:52.842277] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-17T04:12:52.842376] [INFO ] [MAIN ] Update Progress: 1019/2369 symbols completed. HIO took 31.1s. Estimated remaining: 3h 17m 5s. Rate: 6.8 symbols/min [2025-09-17T04:12:53.027724] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:12:53.046286] [DEBUG] [LOCAL ] HIX: Loaded 15027 existing records from primary storage. [2025-09-17T04:12:53.046556] [INFO ] [MAIN ] HIX: Loaded 15027 existing records. [2025-09-17T04:12:53.236792] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:12:53.237182] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-17T04:12:53.237263] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-17T04:12:53.237848] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-17T04:12:53.237917] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-17T04:12:53.496844] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-17T04:12:53.624811] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:12:54.207663] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T04:12:54.268573] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T04:12:54.290146] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-17T04:12:54.778076] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-17T04:12:55.090204] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-17T04:12:55.788718] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T04:12:55.878542] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T04:12:55.890090] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-11. [2025-09-17T04:12:56.690192] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-17T04:12:57.164582] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T04:12:57.490168] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-17T04:12:58.290188] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-17T04:12:59.090210] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-17T04:12:59.675387] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (2.99 seconds). [2025-09-17T04:12:59.890228] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-17T04:13:00.130169] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-17T04:13:00.459245] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-17T04:13:00.462445] [INFO ] [REMOTE ] HIPO: Full fetch complete (31806 records). [2025-09-17T04:13:00.462544] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-17T04:13:00.712476] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-17T04:13:00.836549] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-17T04:13:00.836677] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-17T04:13:00.837310] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-17T04:13:00.837366] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-17T04:13:00.838190] [DEBUG] [LOCAL ] HIPO: Trimmed 31806 records to 22908 (keeping 200 days of data) [2025-09-17T04:13:00.989121] [DEBUG] [LOCAL ] HIPO: Primary data saved (22908 records). [2025-09-17T04:13:00.989388] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-17T04:13:00.989539] [INFO ] [MAIN ] Update Progress: 1020/2369 symbols completed. HIPO took 32.8s. Estimated remaining: 3h 16m 56s. Rate: 6.9 symbols/min [2025-09-17T04:13:01.180359] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:01.200259] [DEBUG] [LOCAL ] HKD: Loaded 13531 existing records from primary storage. [2025-09-17T04:13:01.200517] [INFO ] [MAIN ] HKD: Loaded 13531 existing records. [2025-09-17T04:13:01.396744] [WARN ] [MAIN ] HKD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:01.397144] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-17T04:13:01.397219] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-17T04:13:01.397797] [DEBUG] [LOCAL ] HKD: Deleted primary data file. [2025-09-17T04:13:01.397874] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-17T04:13:01.605192] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T04:13:01.715175] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-17T04:13:01.842772] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:02.001488] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (2.91 seconds). [2025-09-17T04:13:02.290194] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-17T04:13:03.090198] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-11. [2025-09-17T04:13:03.151267] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-17T04:13:03.159224] [INFO ] [REMOTE ] HIMS: Full fetch complete (77909 records). [2025-09-17T04:13:03.159577] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-17T04:13:03.598824] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-17T04:13:03.624298] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T04:13:03.624393] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-17T04:13:03.636297] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-17T04:13:03.638014] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-17T04:13:03.639634] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T04:13:03.648220] [DEBUG] [LOCAL ] HIMS: Trimmed 77909 records to 53817 (keeping 200 days of data) [2025-09-17T04:13:03.890144] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-17T04:13:04.014699] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-09-17T04:13:04.015073] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-17T04:13:04.015252] [INFO ] [MAIN ] Update Progress: 1021/2369 symbols completed. HIMS took 46.4s. Estimated remaining: 3h 16m 40s. Rate: 6.9 symbols/min [2025-09-17T04:13:04.198678] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:04.243396] [DEBUG] [LOCAL ] HL: Loaded 40027 existing records from primary storage. [2025-09-17T04:13:04.243714] [INFO ] [MAIN ] HL: Loaded 40027 existing records. [2025-09-17T04:13:04.443363] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:04.458448] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-17T04:13:04.458837] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-17T04:13:04.460128] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T04:13:04.463668] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-17T04:13:04.465975] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-17T04:13:04.701158] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-17T04:13:04.863639] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:05.336687] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T04:13:05.490223] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-17T04:13:05.783753] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:13:06.290210] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-17T04:13:07.090333] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-17T04:13:07.195988] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T04:13:07.567558] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T04:13:07.890272] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-17T04:13:08.012485] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T04:13:08.690199] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-17T04:13:09.098856] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T04:13:09.490135] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-11. [2025-09-17T04:13:09.803076] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T04:13:10.290220] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-17T04:13:11.090194] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-17T04:13:11.393992] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T04:13:11.796242] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:13:11.802900] [INFO ] [REMOTE ] HIW: Full fetch complete (64483 records). [2025-09-17T04:13:11.803125] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-17T04:13:11.897796] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-17T04:13:12.215137] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-17T04:13:12.215281] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-17T04:13:12.216399] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-17T04:13:12.216464] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-17T04:13:12.218193] [DEBUG] [LOCAL ] HIW: Trimmed 64483 records to 44891 (keeping 200 days of data) [2025-09-17T04:13:12.348027] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T04:13:12.546049] [DEBUG] [LOCAL ] HIW: Primary data saved (44891 records). [2025-09-17T04:13:12.546526] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-17T04:13:12.546683] [INFO ] [MAIN ] Update Progress: 1022/2369 symbols completed. HIW took 33.1s. Estimated remaining: 3h 16m 31s. Rate: 6.9 symbols/min [2025-09-17T04:13:12.692988] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-17T04:13:12.726026] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:12.768465] [DEBUG] [LOCAL ] HLF: Loaded 36426 existing records from primary storage. [2025-09-17T04:13:12.768744] [INFO ] [MAIN ] HLF: Loaded 36426 existing records. [2025-09-17T04:13:12.948698] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:12.949061] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-17T04:13:12.949122] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-17T04:13:12.950153] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-17T04:13:12.950217] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-17T04:13:13.144678] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T04:13:13.345338] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:13.490174] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-11. [2025-09-17T04:13:14.290211] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-17T04:13:14.872182] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T04:13:14.897349] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T04:13:15.090139] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-17T04:13:15.890194] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-17T04:13:16.690191] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-17T04:13:16.913884] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (4.22 seconds). [2025-09-17T04:13:17.490219] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-17T04:13:17.766142] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-17T04:13:17.957454] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T04:13:18.290135] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-17T04:13:18.411624] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-17T04:13:19.090146] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-17T04:13:19.884613] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T04:13:19.899454] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-17T04:13:19.921218] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T04:13:20.540180] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (3.05 seconds). [2025-09-17T04:13:20.588669] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T04:13:20.690155] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-17T04:13:21.490152] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-17T04:13:22.290133] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-17T04:13:22.612694] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T04:13:22.632931] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T04:13:22.635856] [INFO ] [REMOTE ] HIX: Full fetch complete (30914 records). [2025-09-17T04:13:22.636009] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-17T04:13:23.044235] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-17T04:13:23.044383] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-17T04:13:23.045223] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-17T04:13:23.045290] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-17T04:13:23.046391] [DEBUG] [LOCAL ] HIX: Trimmed 30914 records to 20301 (keeping 200 days of data) [2025-09-17T04:13:23.098206] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-17T04:13:23.177250] [DEBUG] [LOCAL ] HIX: Primary data saved (20301 records). [2025-09-17T04:13:23.177433] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-17T04:13:23.177536] [INFO ] [MAIN ] Update Progress: 1023/2369 symbols completed. HIX took 30.3s. Estimated remaining: 3h 16m 24s. Rate: 6.9 symbols/min [2025-09-17T04:13:23.351036] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:23.374433] [DEBUG] [LOCAL ] HLI: Loaded 22663 existing records from primary storage. [2025-09-17T04:13:23.374618] [INFO ] [MAIN ] HLI: Loaded 22663 existing records. [2025-09-17T04:13:23.555105] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:23.555433] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-17T04:13:23.555512] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-17T04:13:23.556287] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-17T04:13:23.556363] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-17T04:13:23.898095] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-17T04:13:23.927452] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:23.963238] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T04:13:24.276316] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T04:13:24.690219] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-17T04:13:25.490221] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-11. [2025-09-17T04:13:25.954237] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T04:13:26.290177] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-17T04:13:26.776281] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:13:26.801717] [DEBUG] [REMOTE ] HKD: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-17T04:13:26.802305] [WARN ] [REMOTE ] HKD: No data returned for month 2025-07 [2025-09-17T04:13:26.841444] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (2.94 seconds). [2025-09-17T04:13:27.090205] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-17T04:13:27.890171] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-17T04:13:28.690168] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-17T04:13:29.459243] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T04:13:29.490220] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-17T04:13:29.827901] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-17T04:13:30.127376] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T04:13:30.290252] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-17T04:13:31.090234] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-17T04:13:31.644241] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T04:13:31.890275] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-17T04:13:32.033203] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-17T04:13:32.690262] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-17T04:13:33.099832] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T04:13:33.103987] [INFO ] [REMOTE ] HKD: Full fetch complete (25370 records). [2025-09-17T04:13:33.104340] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-17T04:13:33.349412] [WARN ] [VALIDATOR ] HKD: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-17T04:13:33.353006] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-17T04:13:33.353599] [FATAL] [MAIN ] HKD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:13:33.364629] [WARN ] [MAIN ] HKD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:13:33.364907] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-17T04:13:33.365808] [DEBUG] [LOCAL ] HKD: No primary data file found to delete. [2025-09-17T04:13:33.365934] [INFO ] [LOCAL ] HKD: Starting deletion of derivative data. [2025-09-17T04:13:33.366905] [DEBUG] [LOCAL ] HKD: Deleted derivative data file. [2025-09-17T04:13:33.367102] [INFO ] [MAIN ] Update Progress: 1024/2369 symbols completed. HKD took 32.4s. Estimated remaining: 3h 16m 17s. Rate: 6.9 symbols/min [2025-09-17T04:13:33.495354] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-17T04:13:33.567116] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:33.591612] [DEBUG] [LOCAL ] HLIO: Loaded 21798 existing records from primary storage. [2025-09-17T04:13:33.591874] [INFO ] [MAIN ] HLIO: Loaded 21798 existing records. [2025-09-17T04:13:33.783741] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:33.784126] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-17T04:13:33.784190] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-17T04:13:33.785139] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-17T04:13:33.785215] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-17T04:13:34.201411] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:34.290213] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-17T04:13:34.399014] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T04:13:35.090247] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-11. [2025-09-17T04:13:35.537180] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T04:13:35.712465] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T04:13:35.890174] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-17T04:13:36.086088] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T04:13:36.690227] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-17T04:13:37.490246] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-17T04:13:37.927706] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T04:13:38.290190] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-17T04:13:38.408460] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-17T04:13:38.808304] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:13:39.090229] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-17T04:13:39.702635] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T04:13:39.890203] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-17T04:13:40.690113] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-17T04:13:41.030069] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T04:13:41.231563] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T04:13:41.490204] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-17T04:13:41.765086] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T04:13:42.290152] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-17T04:13:42.611390] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T04:13:43.090181] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-17T04:13:43.890164] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-17T04:13:44.430285] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T04:13:44.690166] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-17T04:13:44.854128] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T04:13:45.490281] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-17T04:13:45.783269] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (2.69 seconds). [2025-09-17T04:13:46.290306] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-17T04:13:46.626211] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T04:13:46.633358] [INFO ] [REMOTE ] HL: Full fetch complete (77520 records). [2025-09-17T04:13:46.633628] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-17T04:13:47.031671] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T04:13:47.081987] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-17T04:13:47.082130] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-17T04:13:47.083224] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-17T04:13:47.083295] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-17T04:13:47.085191] [DEBUG] [LOCAL ] HL: Trimmed 77520 records to 53670 (keeping 200 days of data) [2025-09-17T04:13:47.138162] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-17T04:13:47.424967] [DEBUG] [LOCAL ] HL: Primary data saved (53670 records). [2025-09-17T04:13:47.425189] [INFO ] [MAIN ] HL: Full history saved. [2025-09-17T04:13:47.425316] [INFO ] [MAIN ] Update Progress: 1025/2369 symbols completed. HL took 43.4s. Estimated remaining: 3h 16m 16s. Rate: 6.8 symbols/min [2025-09-17T04:13:47.596526] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:47.619191] [DEBUG] [LOCAL ] HLLY: Loaded 24752 existing records from primary storage. [2025-09-17T04:13:47.619374] [INFO ] [MAIN ] HLLY: Loaded 24752 existing records. [2025-09-17T04:13:47.799128] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:47.799374] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-17T04:13:47.799437] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-17T04:13:47.800082] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-17T04:13:47.800149] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-17T04:13:47.891509] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-17T04:13:48.175530] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:48.215616] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T04:13:48.488602] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T04:13:48.690167] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-17T04:13:48.759737] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T04:13:49.490228] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-11. [2025-09-17T04:13:50.122764] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:13:50.290227] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-17T04:13:50.680282] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T04:13:51.090289] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-17T04:13:51.890220] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-17T04:13:52.090478] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T04:13:52.351515] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T04:13:52.690244] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-17T04:13:53.490451] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-17T04:13:53.540012] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T04:13:54.228524] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T04:13:54.236224] [INFO ] [REMOTE ] HLF: Full fetch complete (71471 records). [2025-09-17T04:13:54.236507] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-17T04:13:54.298885] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-17T04:13:54.673320] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-17T04:13:54.673492] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-17T04:13:54.674743] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-17T04:13:54.674818] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-17T04:13:54.676868] [DEBUG] [LOCAL ] HLF: Trimmed 71471 records to 48961 (keeping 200 days of data) [2025-09-17T04:13:54.785353] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T04:13:54.804785] [INFO ] [REMOTE ] HLI: Full fetch complete (45011 records). [2025-09-17T04:13:54.815574] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-17T04:13:55.107263] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-17T04:13:55.367792] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-17T04:13:55.369244] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-17T04:13:55.373159] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-17T04:13:55.373574] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-17T04:13:55.383474] [DEBUG] [LOCAL ] HLI: Trimmed 45011 records to 31508 (keeping 200 days of data) [2025-09-17T04:13:55.548720] [DEBUG] [LOCAL ] HLF: Primary data saved (48961 records). [2025-09-17T04:13:55.551380] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-17T04:13:55.553846] [INFO ] [MAIN ] Update Progress: 1026/2369 symbols completed. HLF took 43.0s. Estimated remaining: 3h 16m 6s. Rate: 6.8 symbols/min [2025-09-17T04:13:55.760052] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:55.793951] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T04:13:55.898292] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-17T04:13:55.923979] [DEBUG] [LOCAL ] HLN: Loaded 39568 existing records from primary storage. [2025-09-17T04:13:55.925032] [INFO ] [MAIN ] HLN: Loaded 39568 existing records. [2025-09-17T04:13:56.151621] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:56.151408] [DEBUG] [LOCAL ] HLI: Primary data saved (31508 records). [2025-09-17T04:13:56.152404] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-17T04:13:56.152587] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-17T04:13:56.152797] [INFO ] [MAIN ] Update Progress: 1027/2369 symbols completed. HLI took 33.0s. Estimated remaining: 3h 15m 47s. Rate: 6.9 symbols/min [2025-09-17T04:13:56.153054] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-17T04:13:56.186090] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-17T04:13:56.223486] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-17T04:13:56.498627] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:13:56.716402] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:56.742029] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-11. [2025-09-17T04:13:56.747291] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T04:13:56.771496] [DEBUG] [LOCAL ] HLT: Loaded 37473 existing records from primary storage. [2025-09-17T04:13:56.771809] [INFO ] [MAIN ] HLT: Loaded 37473 existing records. [2025-09-17T04:13:56.962516] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:13:56.963087] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-17T04:13:56.963170] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-17T04:13:56.964339] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-17T04:13:56.964416] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-17T04:13:57.339957] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:13:57.490214] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-17T04:13:57.680876] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T04:13:58.290194] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-17T04:13:58.423354] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T04:13:58.568482] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:13:59.090210] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-11. [2025-09-17T04:13:59.181097] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T04:13:59.890284] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-17T04:14:00.690260] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-17T04:14:00.914607] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T04:14:01.453126] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T04:14:01.490250] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-17T04:14:02.219938] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T04:14:02.290215] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-17T04:14:02.761382] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T04:14:02.765066] [INFO ] [REMOTE ] HLIO: Full fetch complete (35886 records). [2025-09-17T04:14:02.765195] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-17T04:14:03.095319] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-17T04:14:03.182575] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-17T04:14:03.182734] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-17T04:14:03.183491] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-17T04:14:03.183554] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-17T04:14:03.185068] [DEBUG] [LOCAL ] HLIO: Trimmed 35886 records to 28192 (keeping 200 days of data) [2025-09-17T04:14:03.374122] [DEBUG] [LOCAL ] HLIO: Primary data saved (28192 records). [2025-09-17T04:14:03.374403] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-17T04:14:03.374551] [INFO ] [MAIN ] Update Progress: 1028/2369 symbols completed. HLIO took 30.0s. Estimated remaining: 3h 15m 36s. Rate: 6.9 symbols/min [2025-09-17T04:14:03.550294] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:03.591383] [DEBUG] [LOCAL ] HLX: Loaded 35463 existing records from primary storage. [2025-09-17T04:14:03.591666] [INFO ] [MAIN ] HLX: Loaded 35463 existing records. [2025-09-17T04:14:03.778415] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:14:03.778971] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-17T04:14:03.779057] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-17T04:14:03.788210] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-17T04:14:03.801745] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-17T04:14:03.810751] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T04:14:03.895159] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-17T04:14:04.196806] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:04.690174] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-11. [2025-09-17T04:14:04.981355] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T04:14:05.490213] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-17T04:14:05.763062] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T04:14:05.887490] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T04:14:06.290196] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-17T04:14:07.090192] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-17T04:14:07.405917] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T04:14:07.890117] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-17T04:14:07.933562] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T04:14:08.474605] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T04:14:08.690180] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-17T04:14:09.490191] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-17T04:14:09.574679] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T04:14:09.871000] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T04:14:10.290201] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-17T04:14:11.090188] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-17T04:14:11.158391] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T04:14:11.751893] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:14:11.890166] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-17T04:14:12.690176] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-17T04:14:13.012017] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T04:14:13.091387] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T04:14:13.490185] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-17T04:14:14.290158] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-17T04:14:14.704264] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T04:14:14.709205] [INFO ] [REMOTE ] HLLY: Full fetch complete (45885 records). [2025-09-17T04:14:14.709353] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-17T04:14:15.097437] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-17T04:14:15.117193] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-17T04:14:15.117368] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-17T04:14:15.118440] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-17T04:14:15.118542] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-17T04:14:15.120317] [DEBUG] [LOCAL ] HLLY: Trimmed 45885 records to 32988 (keeping 200 days of data) [2025-09-17T04:14:15.339123] [DEBUG] [LOCAL ] HLLY: Primary data saved (32988 records). [2025-09-17T04:14:15.339877] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-17T04:14:15.340171] [INFO ] [MAIN ] Update Progress: 1029/2369 symbols completed. HLLY took 27.9s. Estimated remaining: 3h 15m 31s. Rate: 6.9 symbols/min [2025-09-17T04:14:15.545413] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-17T04:14:15.612016] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:15.656105] [DEBUG] [LOCAL ] HMC: Loaded 34329 existing records from primary storage. [2025-09-17T04:14:15.656382] [INFO ] [MAIN ] HMC: Loaded 34329 existing records. [2025-09-17T04:14:15.849270] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:14:15.849671] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-17T04:14:15.849770] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-17T04:14:15.850630] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-17T04:14:15.850751] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-17T04:14:15.896580] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-17T04:14:16.243600] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:16.690230] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-11. [2025-09-17T04:14:16.808319] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T04:14:16.929823] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-17T04:14:17.490178] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-17T04:14:17.927984] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T04:14:18.290190] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-17T04:14:18.526590] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T04:14:19.090201] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-17T04:14:19.411886] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T04:14:19.890140] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-17T04:14:20.077334] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T04:14:20.647359] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T04:14:20.690135] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-17T04:14:21.490222] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-17T04:14:21.588497] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T04:14:22.152487] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T04:14:22.290226] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-17T04:14:23.090153] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-17T04:14:23.328231] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T04:14:23.890247] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-17T04:14:24.216246] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T04:14:24.663214] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T04:14:24.690144] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-17T04:14:25.490275] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-17T04:14:25.628788] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T04:14:26.290239] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-17T04:14:26.498884] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T04:14:26.994404] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T04:14:27.090242] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-17T04:14:27.890183] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-17T04:14:27.930374] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T04:14:28.690132] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-17T04:14:28.728521] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T04:14:29.278142] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T04:14:29.286635] [INFO ] [REMOTE ] HLT: Full fetch complete (73269 records). [2025-09-17T04:14:29.287035] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-17T04:14:29.491075] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-17T04:14:29.770730] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-17T04:14:29.770896] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-17T04:14:29.772351] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-17T04:14:29.772437] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-17T04:14:29.774712] [DEBUG] [LOCAL ] HLT: Trimmed 73269 records to 50770 (keeping 200 days of data) [2025-09-17T04:14:30.154752] [DEBUG] [LOCAL ] HLT: Primary data saved (50770 records). [2025-09-17T04:14:30.154993] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-17T04:14:30.155162] [INFO ] [MAIN ] Update Progress: 1030/2369 symbols completed. HLT took 34.0s. Estimated remaining: 3h 15m 30s. Rate: 6.8 symbols/min [2025-09-17T04:14:30.292811] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-17T04:14:30.341914] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:30.375810] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T04:14:30.400538] [DEBUG] [LOCAL ] HMN: Loaded 17941 existing records from primary storage. [2025-09-17T04:14:30.400796] [INFO ] [MAIN ] HMN: Loaded 17941 existing records. [2025-09-17T04:14:30.608762] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:14:30.609440] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-17T04:14:30.609532] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-17T04:14:30.610298] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-17T04:14:30.610375] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-17T04:14:31.018024] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:31.090253] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-17T04:14:31.350691] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T04:14:31.890207] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-17T04:14:32.046976] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T04:14:32.054339] [INFO ] [REMOTE ] HLN: Full fetch complete (76566 records). [2025-09-17T04:14:32.054631] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-17T04:14:32.475535] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-17T04:14:32.475745] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-17T04:14:32.476955] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-17T04:14:32.477033] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-17T04:14:32.479015] [DEBUG] [LOCAL ] HLN: Trimmed 76566 records to 53082 (keeping 200 days of data) [2025-09-17T04:14:32.691148] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-11. [2025-09-17T04:14:32.858210] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T04:14:32.895801] [DEBUG] [LOCAL ] HLN: Primary data saved (53082 records). [2025-09-17T04:14:32.896248] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-17T04:14:32.896404] [INFO ] [MAIN ] Update Progress: 1031/2369 symbols completed. HLN took 37.3s. Estimated remaining: 3h 15m 14s. Rate: 6.9 symbols/min [2025-09-17T04:14:33.086921] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:33.144806] [DEBUG] [LOCAL ] HMY: Loaded 39534 existing records from primary storage. [2025-09-17T04:14:33.145058] [INFO ] [MAIN ] HMY: Loaded 39534 existing records. [2025-09-17T04:14:33.356915] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:14:33.357289] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-17T04:14:33.357373] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-17T04:14:33.358471] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-17T04:14:33.358584] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-17T04:14:33.495331] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-17T04:14:33.760841] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:33.792493] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T04:14:33.839527] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T04:14:34.290192] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-17T04:14:35.090155] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-17T04:14:35.144248] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T04:14:35.461607] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T04:14:35.890138] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-11. [2025-09-17T04:14:36.690189] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-17T04:14:36.871627] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T04:14:37.490206] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-17T04:14:37.799039] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T04:14:38.199738] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:14:38.205405] [INFO ] [REMOTE ] HLX: Full fetch complete (68942 records). [2025-09-17T04:14:38.205616] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-17T04:14:38.296314] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-17T04:14:38.600206] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-17T04:14:38.600349] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-17T04:14:38.601403] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-17T04:14:38.601533] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-17T04:14:38.603437] [DEBUG] [LOCAL ] HLX: Trimmed 68942 records to 48229 (keeping 200 days of data) [2025-09-17T04:14:38.890564] [DEBUG] [LOCAL ] HLX: Primary data saved (48229 records). [2025-09-17T04:14:38.890783] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-17T04:14:38.890949] [INFO ] [MAIN ] Update Progress: 1032/2369 symbols completed. HLX took 35.5s. Estimated remaining: 3h 15m 1s. Rate: 6.9 symbols/min [2025-09-17T04:14:39.064834] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:39.065087] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-17T04:14:39.065134] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-17T04:14:39.065255] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-17T04:14:39.065312] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-17T04:14:39.065367] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-17T04:14:39.065432] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-17T04:14:39.096272] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-17T04:14:39.466709] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:39.478906] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T04:14:39.515377] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T04:14:39.890167] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-11. [2025-09-17T04:14:40.091750] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:40.092589] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-11 [2025-09-17T04:14:40.690376] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-17T04:14:40.882294] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:40.882811] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-17T04:14:40.943914] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T04:14:41.490206] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-17T04:14:41.686733] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:41.687258] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-17T04:14:42.290186] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-17T04:14:43.090202] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-17T04:14:43.890192] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-17T04:14:44.036950] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T04:14:44.080549] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:44.080992] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-17T04:14:44.226588] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T04:14:44.690199] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-17T04:14:45.490155] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-17T04:14:46.290182] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-17T04:14:46.508115] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:46.508510] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-17T04:14:46.556629] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T04:14:46.678049] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T04:14:47.090227] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-17T04:14:47.890191] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-17T04:14:48.690165] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-17T04:14:48.881962] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:14:48.882347] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-17T04:14:48.947521] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T04:14:48.996381] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T04:14:49.490200] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-17T04:14:50.290163] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-17T04:14:50.692601] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T04:14:51.090164] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-17T04:14:51.890221] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-17T04:14:51.950883] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T04:14:52.067687] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T04:14:52.690164] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-17T04:14:53.139889] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T04:14:53.490165] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-17T04:14:54.021402] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T04:14:54.290180] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-17T04:14:54.903747] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T04:14:55.006373] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T04:14:55.090094] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-17T04:14:55.890194] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-17T04:14:56.310175] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T04:14:56.690161] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-17T04:14:57.441397] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T04:14:57.447212] [INFO ] [REMOTE ] HMC: Full fetch complete (69700 records). [2025-09-17T04:14:57.447420] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-17T04:14:57.495251] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-17T04:14:57.854585] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-17T04:14:57.854947] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-17T04:14:57.856154] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-17T04:14:57.856341] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-17T04:14:57.869610] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T04:14:57.875739] [DEBUG] [LOCAL ] HMC: Trimmed 69700 records to 47068 (keeping 200 days of data) [2025-09-17T04:14:58.167036] [DEBUG] [LOCAL ] HMC: Primary data saved (47068 records). [2025-09-17T04:14:58.167230] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-17T04:14:58.167398] [INFO ] [MAIN ] Update Progress: 1033/2369 symbols completed. HMC took 42.8s. Estimated remaining: 3h 15m 6s. Rate: 6.8 symbols/min [2025-09-17T04:14:58.295238] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-17T04:14:58.346546] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:14:58.372683] [DEBUG] [LOCAL ] HNI: Loaded 21452 existing records from primary storage. [2025-09-17T04:14:58.372889] [INFO ] [MAIN ] HNI: Loaded 21452 existing records. [2025-09-17T04:14:58.568377] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:14:58.568679] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-17T04:14:58.568758] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-17T04:14:58.569462] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-17T04:14:58.569553] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-17T04:14:58.940023] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:14:59.090109] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-11. [2025-09-17T04:14:59.321866] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T04:14:59.324995] [INFO ] [REMOTE ] HMN: Full fetch complete (31394 records). [2025-09-17T04:14:59.325124] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-17T04:14:59.713289] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-17T04:14:59.713489] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-17T04:14:59.714562] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-17T04:14:59.715171] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-17T04:14:59.717868] [DEBUG] [LOCAL ] HMN: Trimmed 31394 records to 23184 (keeping 200 days of data) [2025-09-17T04:14:59.857511] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-17T04:14:59.899710] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-17T04:14:59.932680] [DEBUG] [LOCAL ] HMN: Primary data saved (23184 records). [2025-09-17T04:14:59.932891] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-17T04:14:59.933231] [INFO ] [MAIN ] Update Progress: 1034/2369 symbols completed. HMN took 29.8s. Estimated remaining: 3h 14m 49s. Rate: 6.9 symbols/min [2025-09-17T04:15:00.129420] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:00.181366] [DEBUG] [LOCAL ] HOG: Loaded 37825 existing records from primary storage. [2025-09-17T04:15:00.181693] [INFO ] [MAIN ] HOG: Loaded 37825 existing records. [2025-09-17T04:15:00.381286] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:00.381750] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-17T04:15:00.381829] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-17T04:15:00.383241] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-17T04:15:00.383328] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-17T04:15:00.524079] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:15:00.695216] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-17T04:15:00.792901] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:01.490247] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-17T04:15:02.290235] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-11. [2025-09-17T04:15:02.502414] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T04:15:02.681936] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (2.78 seconds). [2025-09-17T04:15:03.090143] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-17T04:15:03.890219] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-17T04:15:05.117204] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T04:15:05.123000] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-17T04:15:05.151149] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (3.66 seconds). [2025-09-17T04:15:05.490134] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-17T04:15:05.800242] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-11 (3.51 seconds). [2025-09-17T04:15:06.290165] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-17T04:15:06.329006] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-17T04:15:06.361591] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T04:15:07.073195] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T04:15:07.090085] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-17T04:15:07.890131] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-17T04:15:08.208494] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T04:15:08.665546] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T04:15:08.671228] [INFO ] [REMOTE ] HNGE: Full fetch complete (24280 records). [2025-09-17T04:15:08.671431] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-17T04:15:08.695233] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-17T04:15:08.865498] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 80 unique days, need 200 days [2025-09-17T04:15:08.865915] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:15:08.865982] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:15:08.866033] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-17T04:15:08.866107] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-17T04:15:08.866164] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-17T04:15:08.866220] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-17T04:15:08.866294] [INFO ] [MAIN ] Update Progress: 1035/2369 symbols completed. HNGE took 30.0s. Estimated remaining: 3h 14m 40s. Rate: 6.9 symbols/min [2025-09-17T04:15:09.038852] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:09.072581] [DEBUG] [LOCAL ] HOMB: Loaded 31713 existing records from primary storage. [2025-09-17T04:15:09.072821] [INFO ] [MAIN ] HOMB: Loaded 31713 existing records. [2025-09-17T04:15:09.265762] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:09.266598] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-17T04:15:09.266699] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-17T04:15:09.267935] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-17T04:15:09.268016] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-17T04:15:09.492885] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-17T04:15:09.663738] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:09.697046] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T04:15:10.055381] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T04:15:10.290139] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-17T04:15:11.090188] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-17T04:15:11.230195] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T04:15:11.890133] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-17T04:15:12.317161] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T04:15:12.504796] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T04:15:12.690146] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-17T04:15:13.490130] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-17T04:15:13.576179] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T04:15:13.664109] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T04:15:14.290164] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-17T04:15:15.090182] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-11. [2025-09-17T04:15:15.890211] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-17T04:15:16.032514] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T04:15:16.477606] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.99 seconds). [2025-09-17T04:15:16.690159] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-17T04:15:17.352800] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-11 (2.26 seconds). [2025-09-17T04:15:17.490210] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-17T04:15:17.795049] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:15:17.825301] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T04:15:18.290160] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-17T04:15:18.991701] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T04:15:19.090135] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-17T04:15:19.890248] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-17T04:15:20.002292] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T04:15:20.009030] [INFO ] [REMOTE ] HMY: Full fetch complete (76408 records). [2025-09-17T04:15:20.009209] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-17T04:15:20.422734] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-17T04:15:20.422878] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-17T04:15:20.424002] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-17T04:15:20.424069] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-17T04:15:20.426196] [DEBUG] [LOCAL ] HMY: Trimmed 76408 records to 53124 (keeping 200 days of data) [2025-09-17T04:15:20.690254] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-17T04:15:20.809279] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T04:15:20.838798] [DEBUG] [LOCAL ] HMY: Primary data saved (53124 records). [2025-09-17T04:15:20.839022] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-17T04:15:20.839146] [INFO ] [MAIN ] Update Progress: 1036/2369 symbols completed. HMY took 47.9s. Estimated remaining: 3h 14m 35s. Rate: 6.9 symbols/min [2025-09-17T04:15:21.015311] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:21.057970] [DEBUG] [LOCAL ] HOUS: Loaded 32881 existing records from primary storage. [2025-09-17T04:15:21.058498] [INFO ] [MAIN ] HOUS: Loaded 32881 existing records. [2025-09-17T04:15:21.253232] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:21.254357] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-17T04:15:21.254439] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-17T04:15:21.267276] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-17T04:15:21.290004] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-17T04:15:21.370052] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T04:15:21.499390] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-17T04:15:21.679152] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:22.290214] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-17T04:15:22.536345] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T04:15:23.084433] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T04:15:23.092547] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-17T04:15:23.333956] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T04:15:23.338972] [INFO ] [REMOTE ] HNI: Full fetch complete (40487 records). [2025-09-17T04:15:23.339085] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-17T04:15:23.712380] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-17T04:15:23.712520] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-17T04:15:23.713453] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-17T04:15:23.713601] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-17T04:15:23.714700] [DEBUG] [LOCAL ] HNI: Trimmed 40487 records to 28780 (keeping 200 days of data) [2025-09-17T04:15:23.891527] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-11. [2025-09-17T04:15:23.895204] [DEBUG] [LOCAL ] HNI: Primary data saved (28780 records). [2025-09-17T04:15:23.896153] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-17T04:15:23.896276] [INFO ] [MAIN ] Update Progress: 1037/2369 symbols completed. HNI took 25.7s. Estimated remaining: 3h 14m 19s. Rate: 6.9 symbols/min [2025-09-17T04:15:24.690171] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-17T04:15:24.797397] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T04:15:25.350932] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T04:15:25.490207] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-17T04:15:26.290240] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-17T04:15:26.345203] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T04:15:26.908510] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T04:15:27.090159] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-17T04:15:27.781519] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T04:15:27.890198] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-17T04:15:28.690168] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-17T04:15:28.986395] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T04:15:29.490160] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-17T04:15:29.777181] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T04:15:30.186932] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T04:15:30.290144] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-17T04:15:30.749020] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T04:15:31.090149] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-17T04:15:31.458951] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T04:15:31.890195] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-17T04:15:32.234783] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T04:15:32.690199] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-17T04:15:33.495930] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-17T04:15:33.512374] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T04:15:34.187169] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T04:15:34.290160] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-17T04:15:35.155633] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-17T04:15:35.179126] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T04:15:35.386866] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T04:15:35.890148] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-17T04:15:36.690215] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-17T04:15:36.791050] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T04:15:36.797934] [INFO ] [REMOTE ] HOG: Full fetch complete (74080 records). [2025-09-17T04:15:36.798120] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-17T04:15:37.216607] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-17T04:15:37.216814] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-17T04:15:37.218020] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-17T04:15:37.218101] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-17T04:15:37.219981] [DEBUG] [LOCAL ] HOG: Trimmed 74080 records to 51307 (keeping 200 days of data) [2025-09-17T04:15:37.576765] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T04:15:37.597058] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-17T04:15:37.607378] [DEBUG] [LOCAL ] HOG: Primary data saved (51307 records). [2025-09-17T04:15:37.607590] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-17T04:15:37.607726] [INFO ] [MAIN ] Update Progress: 1038/2369 symbols completed. HOG took 37.7s. Estimated remaining: 3h 14m 17s. Rate: 6.9 symbols/min [2025-09-17T04:15:38.223816] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T04:15:38.290210] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-17T04:15:39.096975] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:15:39.103160] [INFO ] [REMOTE ] HOMB: Full fetch complete (63425 records). [2025-09-17T04:15:39.103400] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-17T04:15:39.516981] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-17T04:15:39.517148] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-17T04:15:39.518525] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-17T04:15:39.518628] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-17T04:15:39.550216] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T04:15:39.548527] [DEBUG] [LOCAL ] HOMB: Trimmed 63425 records to 43713 (keeping 200 days of data) [2025-09-17T04:15:39.560881] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-17T04:15:39.838621] [DEBUG] [LOCAL ] HOMB: Primary data saved (43713 records). [2025-09-17T04:15:39.838841] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-17T04:15:39.838984] [INFO ] [MAIN ] Update Progress: 1039/2369 symbols completed. HOMB took 31.0s. Estimated remaining: 3h 13m 60s. Rate: 6.9 symbols/min [2025-09-17T04:15:41.142330] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T04:15:41.152872] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-17T04:15:42.660393] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T04:15:42.671027] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-17T04:15:44.286546] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T04:15:44.292563] [INFO ] [REMOTE ] HOUS: Full fetch complete (62133 records). [2025-09-17T04:15:44.292783] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-17T04:15:44.678955] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-17T04:15:44.679074] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-17T04:15:44.680011] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-17T04:15:44.680089] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-17T04:15:44.681897] [DEBUG] [LOCAL ] HOUS: Trimmed 62133 records to 43953 (keeping 200 days of data) [2025-09-17T04:15:44.935911] [DEBUG] [LOCAL ] HOUS: Primary data saved (43953 records). [2025-09-17T04:15:44.936126] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-17T04:15:44.936266] [INFO ] [MAIN ] Update Progress: 1040/2369 symbols completed. HOUS took 24.1s. Estimated remaining: 3h 13m 46s. Rate: 6.9 symbols/min [2025-09-17T04:15:45.469199] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:45.572550] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:45.692266] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:45.694675] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:15:45.700055] [DEBUG] [LOCAL ] HOV: Loaded 10592 existing records from primary storage. [2025-09-17T04:15:45.700299] [INFO ] [MAIN ] HOV: Loaded 10592 existing records. [2025-09-17T04:15:45.854058] [DEBUG] [LOCAL ] HPF: Loaded 5625 existing records from primary storage. [2025-09-17T04:15:45.918825] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:45.896285] [INFO ] [MAIN ] HPF: Loaded 5625 existing records. [2025-09-17T04:15:45.932151] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-17T04:15:45.980754] [DEBUG] [LOCAL ] HPE: Loaded 40047 existing records from primary storage. [2025-09-17T04:15:45.980872] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-17T04:15:46.068249] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-17T04:15:46.043927] [DEBUG] [LOCAL ] HP: Loaded 38678 existing records from primary storage. [2025-09-17T04:15:46.007382] [INFO ] [MAIN ] HPE: Loaded 40047 existing records. [2025-09-17T04:15:46.073931] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-17T04:15:46.073805] [INFO ] [MAIN ] HP: Loaded 38678 existing records. [2025-09-17T04:15:46.677844] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:46.837292] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:46.807033] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-17T04:15:46.868178] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-17T04:15:46.868448] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:15:46.873838] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-17T04:15:46.892462] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-17T04:15:46.903184] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-17T04:15:46.902962] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-17T04:15:46.908593] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-17T04:15:46.934952] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-17T04:15:46.940283] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-17T04:15:46.977955] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:47.015935] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-17T04:15:46.998827] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-17T04:15:46.999181] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-11. [2025-09-17T04:15:47.052762] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-17T04:15:48.001190] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:48.072175] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-11. [2025-09-17T04:15:48.133843] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:48.139127] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:15:48.140343] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-11. [2025-09-17T04:15:48.140659] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-11. [2025-09-17T04:15:48.151369] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T04:15:48.154291] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-17T04:15:48.802094] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T04:15:48.803811] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-17T04:15:49.191867] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:15:49.195801] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-17T04:15:49.551674] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T04:15:49.554431] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-17T04:15:49.736994] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T04:15:49.749157] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-17T04:15:49.776457] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T04:15:49.779580] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-17T04:15:50.038170] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T04:15:50.049749] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-17T04:15:50.309080] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T04:15:50.312123] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-17T04:15:50.390513] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T04:15:50.699598] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-17T04:15:51.089000] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T04:15:51.099237] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-17T04:15:51.708264] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T04:15:51.890165] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-17T04:15:52.019150] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T04:15:52.442787] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T04:15:52.690213] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-17T04:15:53.490227] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-17T04:15:53.556515] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T04:15:54.230716] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T04:15:54.290215] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-17T04:15:54.976869] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T04:15:55.090171] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-17T04:15:55.890168] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-17T04:15:56.652362] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T04:15:56.690165] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-17T04:15:56.787839] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T04:15:57.462037] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T04:15:57.490174] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-17T04:15:58.290164] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-17T04:15:59.019567] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T04:15:59.090138] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-17T04:15:59.168928] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T04:15:59.845984] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T04:15:59.848117] [INFO ] [REMOTE ] HPF: Full fetch complete (10696 records). [2025-09-17T04:15:59.848216] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-17T04:15:59.895231] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-17T04:16:00.232244] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-17T04:16:00.232397] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-17T04:16:00.232783] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-17T04:16:00.232841] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-17T04:16:00.233453] [DEBUG] [LOCAL ] HPF: Trimmed 10696 records to 7213 (keeping 200 days of data) [2025-09-17T04:16:00.280558] [DEBUG] [LOCAL ] HPF: Primary data saved (7213 records). [2025-09-17T04:16:00.280933] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-17T04:16:00.281051] [INFO ] [MAIN ] Update Progress: 1041/2369 symbols completed. HPF took 15.3s. Estimated remaining: 3h 13m 46s. Rate: 6.9 symbols/min [2025-09-17T04:16:00.454053] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:00.464417] [DEBUG] [LOCAL ] HPI: Loaded 7756 existing records from primary storage. [2025-09-17T04:16:00.464611] [INFO ] [MAIN ] HPI: Loaded 7756 existing records. [2025-09-17T04:16:00.647308] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:00.647600] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-17T04:16:00.647685] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-17T04:16:00.648078] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-17T04:16:00.648146] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-17T04:16:00.702752] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-17T04:16:00.928423] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T04:16:01.033388] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:01.490132] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-17T04:16:02.290143] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-17T04:16:02.486953] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T04:16:02.782428] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-17T04:16:03.090161] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-17T04:16:03.890178] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-11. [2025-09-17T04:16:03.979751] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T04:16:04.016886] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T04:16:04.631664] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T04:16:04.690146] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-17T04:16:05.276075] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T04:16:05.490153] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-17T04:16:06.290227] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-17T04:16:07.090225] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-17T04:16:07.253468] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T04:16:07.292430] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T04:16:07.826066] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T04:16:07.890147] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-17T04:16:08.690182] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-17T04:16:09.291107] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T04:16:09.490213] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-17T04:16:09.688740] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T04:16:10.238042] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T04:16:10.290183] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-17T04:16:11.090192] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-17T04:16:11.183078] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T04:16:11.185276] [INFO ] [REMOTE ] HOV: Full fetch complete (19278 records). [2025-09-17T04:16:11.185384] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-17T04:16:11.566710] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-17T04:16:11.566829] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-17T04:16:11.567337] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-17T04:16:11.567403] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-17T04:16:11.568085] [DEBUG] [LOCAL ] HOV: Trimmed 19278 records to 13734 (keeping 200 days of data) [2025-09-17T04:16:11.655568] [DEBUG] [LOCAL ] HOV: Primary data saved (13734 records). [2025-09-17T04:16:11.655772] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-17T04:16:11.655883] [INFO ] [MAIN ] Update Progress: 1042/2369 symbols completed. HOV took 26.7s. Estimated remaining: 3h 13m 41s. Rate: 6.9 symbols/min [2025-09-17T04:16:11.836037] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:11.875980] [DEBUG] [LOCAL ] HPP: Loaded 38143 existing records from primary storage. [2025-09-17T04:16:11.876322] [INFO ] [MAIN ] HPP: Loaded 38143 existing records. [2025-09-17T04:16:11.897624] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-17T04:16:11.933299] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T04:16:12.076228] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:12.076491] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-17T04:16:12.076548] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-17T04:16:12.077366] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-17T04:16:12.077428] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-17T04:16:12.450709] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:12.690168] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-11. [2025-09-17T04:16:13.490185] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-17T04:16:13.735500] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T04:16:14.273155] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:16:14.290114] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-17T04:16:14.386046] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T04:16:15.090218] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-17T04:16:15.890104] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-17T04:16:16.429937] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T04:16:16.690147] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-17T04:16:16.789739] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T04:16:17.209440] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T04:16:17.490160] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-17T04:16:18.290169] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-17T04:16:18.776819] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T04:16:19.090146] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-17T04:16:19.339324] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T04:16:19.444917] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T04:16:19.890164] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-17T04:16:20.690150] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-17T04:16:21.043419] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T04:16:21.425142] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T04:16:21.459724] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:16:21.490101] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-17T04:16:22.290166] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-17T04:16:23.005087] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:16:23.011593] [INFO ] [REMOTE ] HP: Full fetch complete (73775 records). [2025-09-17T04:16:23.011811] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-17T04:16:23.095345] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-17T04:16:23.427814] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-17T04:16:23.427979] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-17T04:16:23.429260] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-17T04:16:23.429330] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-17T04:16:23.432707] [DEBUG] [LOCAL ] HP: Trimmed 73775 records to 51688 (keeping 200 days of data) [2025-09-17T04:16:23.771494] [DEBUG] [LOCAL ] HP: Primary data saved (51688 records). [2025-09-17T04:16:23.771731] [INFO ] [MAIN ] HP: Full history saved. [2025-09-17T04:16:23.771939] [INFO ] [MAIN ] Update Progress: 1043/2369 symbols completed. HP took 38.8s. Estimated remaining: 3h 13m 36s. Rate: 6.8 symbols/min [2025-09-17T04:16:23.896600] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-17T04:16:23.919149] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T04:16:23.991351] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:24.031629] [DEBUG] [LOCAL ] HPQ: Loaded 40021 existing records from primary storage. [2025-09-17T04:16:24.031831] [INFO ] [MAIN ] HPQ: Loaded 40021 existing records. [2025-09-17T04:16:24.207783] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:24.208048] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-17T04:16:24.208105] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-17T04:16:24.209771] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-17T04:16:24.209848] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-17T04:16:24.615283] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:24.680569] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T04:16:24.690140] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-11. [2025-09-17T04:16:25.051673] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T04:16:25.490162] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-17T04:16:26.290147] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-17T04:16:26.321483] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T04:16:26.609511] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T04:16:27.090157] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-17T04:16:27.890108] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-17T04:16:28.158610] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T04:16:28.162362] [INFO ] [REMOTE ] HPI: Full fetch complete (13113 records). [2025-09-17T04:16:28.162500] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-17T04:16:28.572184] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-17T04:16:28.572438] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-17T04:16:28.572998] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-17T04:16:28.573187] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-17T04:16:28.573988] [DEBUG] [LOCAL ] HPI: Trimmed 13113 records to 9802 (keeping 200 days of data) [2025-09-17T04:16:28.659590] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-17T04:16:28.690446] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-17T04:16:28.690599] [DEBUG] [LOCAL ] HPI: Primary data saved (9802 records). [2025-09-17T04:16:28.691737] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-17T04:16:28.691892] [INFO ] [MAIN ] Update Progress: 1044/2369 symbols completed. HPI took 28.4s. Estimated remaining: 3h 13m 22s. Rate: 6.9 symbols/min [2025-09-17T04:16:28.869497] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:28.880803] [DEBUG] [LOCAL ] HPS: Loaded 7704 existing records from primary storage. [2025-09-17T04:16:28.880984] [INFO ] [MAIN ] HPS: Loaded 7704 existing records. [2025-09-17T04:16:29.066353] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:29.066693] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-17T04:16:29.066796] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-17T04:16:29.067161] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-17T04:16:29.067242] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-17T04:16:29.510419] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-17T04:16:29.517036] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:29.558692] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T04:16:30.290182] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-11. [2025-09-17T04:16:30.802090] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-17T04:16:31.011771] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T04:16:31.090201] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-17T04:16:31.186626] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T04:16:31.787697] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T04:16:31.890197] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-17T04:16:32.690179] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-17T04:16:33.490219] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-17T04:16:33.930688] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-17T04:16:33.937772] [INFO ] [REMOTE ] HPE: Full fetch complete (77587 records). [2025-09-17T04:16:33.938033] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-17T04:16:34.300519] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-17T04:16:34.394919] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-17T04:16:34.395299] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-17T04:16:34.396766] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-17T04:16:34.397020] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-17T04:16:34.432434] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T04:16:34.432674] [DEBUG] [LOCAL ] HPE: Trimmed 77587 records to 53697 (keeping 200 days of data) [2025-09-17T04:16:34.798553] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-09-17T04:16:34.798797] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-17T04:16:34.798935] [INFO ] [MAIN ] Update Progress: 1045/2369 symbols completed. HPE took 49.9s. Estimated remaining: 3h 13m 10s. Rate: 6.9 symbols/min [2025-09-17T04:16:34.987441] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:35.044450] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T04:16:35.062878] [DEBUG] [LOCAL ] HQH: Loaded 18896 existing records from primary storage. [2025-09-17T04:16:35.063074] [INFO ] [MAIN ] HQH: Loaded 18896 existing records. [2025-09-17T04:16:35.100114] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-17T04:16:35.281964] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T04:16:35.288194] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:35.294936] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-17T04:16:35.295096] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-17T04:16:35.295783] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-17T04:16:35.295850] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-17T04:16:35.687483] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:35.890222] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-17T04:16:36.690190] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-17T04:16:36.733720] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T04:16:36.873152] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T04:16:37.490218] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-11. [2025-09-17T04:16:38.290177] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-17T04:16:38.459793] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T04:16:38.518462] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T04:16:39.090179] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-17T04:16:39.872331] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T04:16:39.890098] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-17T04:16:40.690153] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-17T04:16:40.985821] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T04:16:41.490184] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-17T04:16:41.685837] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T04:16:41.694392] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T04:16:42.290210] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-17T04:16:42.648734] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T04:16:43.090165] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-17T04:16:43.890209] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-17T04:16:44.054505] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T04:16:44.108022] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T04:16:44.690166] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-17T04:16:45.490155] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-17T04:16:45.548771] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T04:16:45.722670] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T04:16:46.290193] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-17T04:16:46.846963] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T04:16:46.854452] [INFO ] [REMOTE ] HPP: Full fetch complete (73177 records). [2025-09-17T04:16:46.854667] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-17T04:16:47.095468] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-17T04:16:47.284919] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-17T04:16:47.285074] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-17T04:16:47.286356] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-17T04:16:47.286438] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-17T04:16:47.288422] [DEBUG] [LOCAL ] HPP: Trimmed 73177 records to 50711 (keeping 200 days of data) [2025-09-17T04:16:47.426035] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T04:16:47.678047] [DEBUG] [LOCAL ] HPP: Primary data saved (50711 records). [2025-09-17T04:16:47.678291] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-17T04:16:47.678420] [INFO ] [MAIN ] Update Progress: 1046/2369 symbols completed. HPP took 36.0s. Estimated remaining: 3h 13m 7s. Rate: 6.9 symbols/min [2025-09-17T04:16:47.870686] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:47.886797] [DEBUG] [LOCAL ] HQL: Loaded 11773 existing records from primary storage. [2025-09-17T04:16:47.887076] [INFO ] [MAIN ] HQL: Loaded 11773 existing records. [2025-09-17T04:16:47.899564] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-17T04:16:48.088768] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:16:48.089164] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-17T04:16:48.089253] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-17T04:16:48.089863] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-17T04:16:48.089937] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-17T04:16:48.490588] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:48.690227] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-11. [2025-09-17T04:16:48.783958] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T04:16:49.059701] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T04:16:49.490154] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-17T04:16:49.597599] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T04:16:50.237452] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T04:16:50.290154] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-17T04:16:51.090147] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-17T04:16:51.230924] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T04:16:51.890144] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-17T04:16:52.263074] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T04:16:52.690165] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-17T04:16:53.490133] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-17T04:16:53.593749] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T04:16:53.720049] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T04:16:54.290151] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-17T04:16:54.795958] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T04:16:55.090157] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-17T04:16:55.890147] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-17T04:16:56.036815] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T04:16:56.321275] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T04:16:56.690197] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-17T04:16:56.944841] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T04:16:57.486511] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T04:16:57.490069] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-17T04:16:58.290158] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-17T04:16:58.341249] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T04:16:58.343792] [INFO ] [REMOTE ] HPS: Full fetch complete (15096 records). [2025-09-17T04:16:58.343919] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-17T04:16:58.793305] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-17T04:16:58.793499] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-17T04:16:58.794706] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-17T04:16:58.794814] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-17T04:16:58.796172] [DEBUG] [LOCAL ] HPS: Trimmed 15096 records to 10289 (keeping 200 days of data) [2025-09-17T04:16:58.900048] [DEBUG] [LOCAL ] HPS: Primary data saved (10289 records). [2025-09-17T04:16:58.900341] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-17T04:16:58.900520] [INFO ] [MAIN ] Update Progress: 1047/2369 symbols completed. HPS took 30.2s. Estimated remaining: 3h 13m 1s. Rate: 6.8 symbols/min [2025-09-17T04:16:59.107172] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-17T04:16:59.177142] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:16:59.177502] [DEBUG] [LOCAL ] HR: No existing data file found in primary storage. [2025-09-17T04:16:59.177598] [WARN ] [MAIN ] HR: No existing data found, performing full refresh instead. [2025-09-17T04:16:59.177910] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-17T04:16:59.179727] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-17T04:16:59.180782] [DEBUG] [LOCAL ] HR: No primary data file found to delete. [2025-09-17T04:16:59.180882] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-17T04:16:59.730021] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:16:59.752058] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:16:59.890147] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-17T04:17:00.244820] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T04:17:00.690117] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-17T04:17:01.228610] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T04:17:01.490185] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-17T04:17:01.734448] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T04:17:02.290176] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-17T04:17:03.090145] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-17T04:17:03.337000] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T04:17:03.506993] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T04:17:03.890122] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-17T04:17:04.192854] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T04:17:04.196741] [INFO ] [REMOTE ] HQH: Full fetch complete (37531 records). [2025-09-17T04:17:04.197091] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-17T04:17:04.596141] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-17T04:17:04.596322] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-17T04:17:04.597413] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-17T04:17:04.597494] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-17T04:17:04.598972] [DEBUG] [LOCAL ] HQH: Trimmed 37531 records to 24949 (keeping 200 days of data) [2025-09-17T04:17:04.693241] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-11. [2025-09-17T04:17:04.760867] [DEBUG] [LOCAL ] HQH: Primary data saved (24949 records). [2025-09-17T04:17:04.761063] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-17T04:17:04.761172] [INFO ] [MAIN ] Update Progress: 1048/2369 symbols completed. HQH took 30.0s. Estimated remaining: 3h 12m 49s. Rate: 6.9 symbols/min [2025-09-17T04:17:04.932701] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:04.944181] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T04:17:04.981017] [DEBUG] [LOCAL ] HRB: Loaded 36056 existing records from primary storage. [2025-09-17T04:17:04.981224] [INFO ] [MAIN ] HRB: Loaded 36056 existing records. [2025-09-17T04:17:05.159782] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:05.160087] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-17T04:17:05.160152] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-17T04:17:05.161032] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-17T04:17:05.161095] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-17T04:17:05.495395] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-17T04:17:05.525037] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:06.290154] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-11. [2025-09-17T04:17:06.359452] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T04:17:06.545930] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T04:17:07.090202] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-17T04:17:07.824872] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T04:17:07.890137] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-17T04:17:08.690212] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-17T04:17:08.750132] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T04:17:09.445308] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T04:17:09.467566] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T04:17:09.490106] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-17T04:17:10.290165] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-17T04:17:10.875275] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T04:17:11.090214] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-17T04:17:11.890162] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-17T04:17:11.947494] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:17:12.690172] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-17T04:17:12.753882] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T04:17:12.835563] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T04:17:13.490163] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-17T04:17:14.254463] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T04:17:14.290151] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-17T04:17:15.005775] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T04:17:15.012812] [INFO ] [REMOTE ] HPQ: Full fetch complete (77540 records). [2025-09-17T04:17:15.013040] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-17T04:17:15.095260] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-17T04:17:15.379635] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T04:17:15.462746] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-17T04:17:15.462897] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-17T04:17:15.464363] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-17T04:17:15.464463] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-17T04:17:15.466547] [DEBUG] [LOCAL ] HPQ: Trimmed 77540 records to 53669 (keeping 200 days of data) [2025-09-17T04:17:15.837466] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-09-17T04:17:15.837712] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-17T04:17:15.837845] [INFO ] [MAIN ] Update Progress: 1049/2369 symbols completed. HPQ took 52.1s. Estimated remaining: 3h 12m 43s. Rate: 6.8 symbols/min [2025-09-17T04:17:15.895502] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-17T04:17:16.030296] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:16.060959] [DEBUG] [LOCAL ] HRI: Loaded 24045 existing records from primary storage. [2025-09-17T04:17:16.061193] [INFO ] [MAIN ] HRI: Loaded 24045 existing records. [2025-09-17T04:17:16.246895] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:16.247209] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-17T04:17:16.247267] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-17T04:17:16.248359] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-17T04:17:16.248436] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-17T04:17:16.607766] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:16.690087] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-11. [2025-09-17T04:17:16.923234] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T04:17:16.922879] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T04:17:16.939013] [INFO ] [REMOTE ] HQL: Full fetch complete (24086 records). [2025-09-17T04:17:16.940085] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-17T04:17:17.360225] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-17T04:17:17.360415] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-17T04:17:17.361161] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-17T04:17:17.361225] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-17T04:17:17.362402] [DEBUG] [LOCAL ] HQL: Trimmed 24086 records to 16177 (keeping 200 days of data) [2025-09-17T04:17:17.470812] [DEBUG] [LOCAL ] HQL: Primary data saved (16177 records). [2025-09-17T04:17:17.471040] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-17T04:17:17.471182] [INFO ] [MAIN ] Update Progress: 1050/2369 symbols completed. HQL took 29.8s. Estimated remaining: 3h 12m 25s. Rate: 6.9 symbols/min [2025-09-17T04:17:17.495338] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-17T04:17:17.660791] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:17.702187] [DEBUG] [LOCAL ] HRL: Loaded 39585 existing records from primary storage. [2025-09-17T04:17:17.702416] [INFO ] [MAIN ] HRL: Loaded 39585 existing records. [2025-09-17T04:17:17.896552] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:17.896870] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-17T04:17:17.896936] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-17T04:17:17.898043] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-17T04:17:17.898110] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-17T04:17:18.292821] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-17T04:17:18.299872] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:18.302493] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T04:17:19.034047] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T04:17:19.090232] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-17T04:17:19.890200] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-17T04:17:20.250194] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T04:17:20.338961] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T04:17:20.690214] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-11. [2025-09-17T04:17:21.490216] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-17T04:17:21.649607] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T04:17:22.257612] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T04:17:22.290181] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-17T04:17:23.090210] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-17T04:17:23.156429] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:17:23.215365] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T04:17:23.890194] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-17T04:17:24.690193] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-17T04:17:24.750029] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T04:17:25.490237] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-17T04:17:25.701451] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T04:17:26.056168] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T04:17:26.290195] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-17T04:17:27.090173] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-17T04:17:27.161513] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T04:17:27.761600] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T04:17:27.890189] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-17T04:17:28.695308] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-17T04:17:28.713952] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T04:17:29.237987] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T04:17:29.490268] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-17T04:17:30.290729] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-17T04:17:30.296574] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T04:17:31.039662] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T04:17:31.090186] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-17T04:17:31.890141] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-17T04:17:31.999004] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T04:17:32.684108] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:17:32.694476] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-17T04:17:33.357338] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T04:17:33.490203] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-17T04:17:34.264855] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T04:17:34.272008] [INFO ] [REMOTE ] HR: Full fetch complete (74660 records). [2025-09-17T04:17:34.272256] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-17T04:17:34.295336] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-17T04:17:34.722753] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-17T04:17:34.722920] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-17T04:17:34.724352] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-17T04:17:34.724462] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-17T04:17:34.726548] [DEBUG] [LOCAL ] HR: Trimmed 74660 records to 51981 (keeping 200 days of data) [2025-09-17T04:17:35.084984] [DEBUG] [LOCAL ] HR: Primary data saved (51981 records). [2025-09-17T04:17:35.085267] [INFO ] [MAIN ] HR: Full history saved. [2025-09-17T04:17:35.085421] [INFO ] [MAIN ] Update Progress: 1051/2369 symbols completed. HR took 36.2s. Estimated remaining: 3h 12m 28s. Rate: 6.8 symbols/min [2025-09-17T04:17:35.114074] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-17T04:17:35.331600] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:35.368165] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T04:17:35.397136] [DEBUG] [LOCAL ] HRTG: Loaded 25347 existing records from primary storage. [2025-09-17T04:17:35.397533] [INFO ] [MAIN ] HRTG: Loaded 25347 existing records. [2025-09-17T04:17:35.590633] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:35.590972] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-17T04:17:35.591039] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-17T04:17:35.591913] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-17T04:17:35.591986] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-17T04:17:35.895349] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-17T04:17:35.996310] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:36.264987] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T04:17:36.656791] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T04:17:36.690213] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-17T04:17:37.490167] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-11. [2025-09-17T04:17:37.540619] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T04:17:37.547262] [INFO ] [REMOTE ] HRB: Full fetch complete (69680 records). [2025-09-17T04:17:37.547458] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-17T04:17:37.995571] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-17T04:17:37.995735] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-17T04:17:37.996936] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-17T04:17:37.997007] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-17T04:17:37.998832] [DEBUG] [LOCAL ] HRB: Trimmed 69680 records to 48619 (keeping 200 days of data) [2025-09-17T04:17:38.301783] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-17T04:17:38.329369] [DEBUG] [LOCAL ] HRB: Primary data saved (48619 records). [2025-09-17T04:17:38.329621] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-17T04:17:38.329774] [INFO ] [MAIN ] Update Progress: 1052/2369 symbols completed. HRB took 33.6s. Estimated remaining: 3h 12m 12s. Rate: 6.9 symbols/min [2025-09-17T04:17:38.546518] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:38.592604] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T04:17:38.637501] [DEBUG] [LOCAL ] HSBC: Loaded 37817 existing records from primary storage. [2025-09-17T04:17:38.637746] [INFO ] [MAIN ] HSBC: Loaded 37817 existing records. [2025-09-17T04:17:38.830538] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:38.831681] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-17T04:17:38.831837] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-17T04:17:38.839437] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-17T04:17:38.852313] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-17T04:17:38.932611] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T04:17:39.095494] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-17T04:17:39.278559] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:39.303720] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T04:17:39.890368] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-17T04:17:40.292856] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T04:17:40.690234] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-17T04:17:41.490221] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-17T04:17:41.642407] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T04:17:42.233455] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:17:42.290175] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-17T04:17:42.518479] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T04:17:43.090236] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-17T04:17:43.368288] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T04:17:43.890183] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-17T04:17:44.166274] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:17:44.690220] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-17T04:17:45.480275] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T04:17:45.490708] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-11. [2025-09-17T04:17:46.002079] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T04:17:46.006876] [INFO ] [REMOTE ] HRI: Full fetch complete (45388 records). [2025-09-17T04:17:46.007166] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-17T04:17:46.295378] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-17T04:17:46.475158] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-17T04:17:46.475326] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-17T04:17:46.476287] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-17T04:17:46.476360] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-17T04:17:46.477885] [DEBUG] [LOCAL ] HRI: Trimmed 45388 records to 33312 (keeping 200 days of data) [2025-09-17T04:17:46.713077] [DEBUG] [LOCAL ] HRI: Primary data saved (33312 records). [2025-09-17T04:17:46.713317] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-17T04:17:46.713448] [INFO ] [MAIN ] Update Progress: 1053/2369 symbols completed. HRI took 30.9s. Estimated remaining: 3h 12m 3s. Rate: 6.9 symbols/min [2025-09-17T04:17:46.903904] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:46.917208] [DEBUG] [LOCAL ] HSHP: Loaded 10229 existing records from primary storage. [2025-09-17T04:17:46.917427] [INFO ] [MAIN ] HSHP: Loaded 10229 existing records. [2025-09-17T04:17:47.095545] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-17T04:17:47.121311] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:47.121717] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-17T04:17:47.121785] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-17T04:17:47.122269] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-17T04:17:47.122334] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-17T04:17:47.515763] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:47.545710] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T04:17:47.890163] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-11. [2025-09-17T04:17:48.260841] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T04:17:48.328495] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T04:17:48.690169] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-17T04:17:48.791209] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T04:17:49.490176] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-17T04:17:50.290192] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-17T04:17:50.605795] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T04:17:50.924590] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T04:17:51.090217] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-17T04:17:51.796824] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T04:17:51.890263] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-17T04:17:52.538878] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T04:17:52.690184] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-17T04:17:52.877512] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T04:17:53.490158] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-17T04:17:54.290204] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-17T04:17:54.457885] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T04:17:54.917205] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T04:17:55.090196] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-17T04:17:55.890206] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-17T04:17:56.078079] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T04:17:56.085167] [INFO ] [REMOTE ] HRL: Full fetch complete (76517 records). [2025-09-17T04:17:56.085397] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-17T04:17:56.510884] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-17T04:17:56.511044] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-17T04:17:56.512356] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-17T04:17:56.512443] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-17T04:17:56.514907] [DEBUG] [LOCAL ] HRL: Trimmed 76517 records to 53088 (keeping 200 days of data) [2025-09-17T04:17:56.635176] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T04:17:56.691245] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-17T04:17:56.925914] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T04:17:56.954589] [DEBUG] [LOCAL ] HRL: Primary data saved (53088 records). [2025-09-17T04:17:56.954863] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-17T04:17:56.955015] [INFO ] [MAIN ] Update Progress: 1054/2369 symbols completed. HRL took 39.5s. Estimated remaining: 3h 11m 56s. Rate: 6.9 symbols/min [2025-09-17T04:17:57.143491] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:17:57.186383] [DEBUG] [LOCAL ] HSY: Loaded 37663 existing records from primary storage. [2025-09-17T04:17:57.186618] [INFO ] [MAIN ] HSY: Loaded 37663 existing records. [2025-09-17T04:17:57.374428] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:17:57.374797] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-17T04:17:57.374865] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-17T04:17:57.376025] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-17T04:17:57.376103] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-17T04:17:57.505398] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-17T04:17:57.757116] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:17:57.831061] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T04:17:58.290177] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-11. [2025-09-17T04:17:58.862709] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T04:17:59.090225] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-17T04:17:59.890162] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-17T04:18:00.182359] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T04:18:00.690139] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-17T04:18:01.261800] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-17T04:18:01.296528] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T04:18:01.490266] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-17T04:18:02.002239] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T04:18:02.290225] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-17T04:18:03.090180] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-17T04:18:03.890236] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-17T04:18:03.957989] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (2.47 seconds). [2025-09-17T04:18:03.962465] [INFO ] [REMOTE ] HRTG: Full fetch complete (41306 records). [2025-09-17T04:18:03.962717] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-17T04:18:04.439318] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-17T04:18:04.439462] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-17T04:18:04.440320] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-17T04:18:04.440395] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-17T04:18:04.441806] [DEBUG] [LOCAL ] HRTG: Trimmed 41306 records to 32087 (keeping 200 days of data) [2025-09-17T04:18:04.647593] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-17T04:18:04.670296] [DEBUG] [LOCAL ] HRTG: Primary data saved (32087 records). [2025-09-17T04:18:04.670553] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-17T04:18:04.670723] [INFO ] [MAIN ] Update Progress: 1055/2369 symbols completed. HRTG took 29.6s. Estimated remaining: 3h 11m 46s. Rate: 6.9 symbols/min [2025-09-17T04:18:04.704921] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-17T04:18:04.852246] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:04.852553] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-17T04:18:04.852629] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-17T04:18:04.852793] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-17T04:18:04.852872] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-17T04:18:04.852928] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-17T04:18:04.852969] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-17T04:18:05.211607] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:05.490168] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-11. [2025-09-17T04:18:05.591769] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T04:18:05.881875] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T04:18:05.972985] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:18:05.973619] [WARN ] [REMOTE ] HTB: No data returned for month 2024-11 [2025-09-17T04:18:06.023828] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-17T04:18:06.290185] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-17T04:18:07.090161] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-17T04:18:07.890196] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-17T04:18:08.191818] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T04:18:08.690160] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-17T04:18:08.852540] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T04:18:08.959799] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:18:08.960370] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-17T04:18:08.997956] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T04:18:09.490134] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-17T04:18:09.684500] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:18:09.684972] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-17T04:18:10.290145] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-17T04:18:11.090282] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-17T04:18:11.226748] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T04:18:11.890199] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-17T04:18:12.100352] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.21 seconds). [2025-09-17T04:18:12.690142] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-17T04:18:13.038394] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T04:18:13.203152] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T04:18:13.490157] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-17T04:18:14.290415] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-17T04:18:14.398731] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T04:18:14.403366] [INFO ] [REMOTE ] HSHP: Full fetch complete (23273 records). [2025-09-17T04:18:14.403490] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-17T04:18:14.785038] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-17T04:18:14.785174] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-17T04:18:14.785825] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-17T04:18:14.785893] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-17T04:18:14.786694] [DEBUG] [LOCAL ] HSHP: Trimmed 23273 records to 15645 (keeping 200 days of data) [2025-09-17T04:18:14.887483] [DEBUG] [LOCAL ] HSHP: Primary data saved (15645 records). [2025-09-17T04:18:14.887708] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-17T04:18:14.887834] [INFO ] [MAIN ] Update Progress: 1056/2369 symbols completed. HSHP took 28.2s. Estimated remaining: 3h 11m 39s. Rate: 6.9 symbols/min [2025-09-17T04:18:15.072855] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:15.086627] [DEBUG] [LOCAL ] HTD: Loaded 10000 existing records from primary storage. [2025-09-17T04:18:15.086826] [INFO ] [MAIN ] HTD: Loaded 10000 existing records. [2025-09-17T04:18:15.098372] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-17T04:18:15.280483] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:18:15.280854] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-17T04:18:15.280944] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-17T04:18:15.281393] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-17T04:18:15.281489] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-17T04:18:15.649618] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:15.890448] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-11. [2025-09-17T04:18:16.214664] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T04:18:16.690220] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-17T04:18:17.490178] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-17T04:18:17.644020] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (3.35 seconds). [2025-09-17T04:18:17.793793] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T04:18:18.053340] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T04:18:18.290169] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-17T04:18:19.069521] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:18:19.090136] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-17T04:18:19.346208] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T04:18:19.787365] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T04:18:19.890131] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-17T04:18:20.650616] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T04:18:20.690142] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-17T04:18:21.490155] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-17T04:18:21.599085] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T04:18:22.290172] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-17T04:18:23.090138] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-17T04:18:23.128623] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T04:18:23.428238] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T04:18:23.779889] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T04:18:23.890199] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-17T04:18:24.610836] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T04:18:24.612762] [INFO ] [REMOTE ] HTB: Full fetch complete (7011 records). [2025-09-17T04:18:24.612864] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-17T04:18:24.695309] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-17T04:18:24.804378] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 138 unique days, need 200 days [2025-09-17T04:18:24.804706] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:18:24.804826] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:18:24.804879] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-17T04:18:24.805037] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-17T04:18:24.805136] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-17T04:18:24.805262] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-17T04:18:24.805372] [INFO ] [MAIN ] Update Progress: 1057/2369 symbols completed. HTB took 20.1s. Estimated remaining: 3h 11m 31s. Rate: 6.9 symbols/min [2025-09-17T04:18:24.986741] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:24.987055] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-17T04:18:24.987109] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-17T04:18:24.987230] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-17T04:18:24.987310] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-17T04:18:24.987362] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-17T04:18:24.987414] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-17T04:18:25.359026] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:25.490198] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-11. [2025-09-17T04:18:25.815725] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T04:18:26.290223] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-17T04:18:26.578846] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T04:18:27.090155] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-17T04:18:27.890158] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-17T04:18:28.064412] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T04:18:28.644156] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T04:18:28.690131] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-17T04:18:28.944974] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T04:18:28.951924] [INFO ] [REMOTE ] HSBC: Full fetch complete (73343 records). [2025-09-17T04:18:28.952187] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-17T04:18:29.360264] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-17T04:18:29.360424] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-17T04:18:29.361552] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-17T04:18:29.361622] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-17T04:18:29.363537] [DEBUG] [LOCAL ] HSBC: Trimmed 73343 records to 51293 (keeping 200 days of data) [2025-09-17T04:18:29.491235] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-17T04:18:29.636402] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T04:18:29.739276] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-17T04:18:29.760801] [DEBUG] [LOCAL ] HSBC: Primary data saved (51293 records). [2025-09-17T04:18:29.761051] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-17T04:18:29.761211] [INFO ] [MAIN ] Update Progress: 1058/2369 symbols completed. HSBC took 51.4s. Estimated remaining: 3h 11m 18s. Rate: 6.9 symbols/min [2025-09-17T04:18:29.952530] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:29.996945] [DEBUG] [LOCAL ] HTGC: Loaded 35199 existing records from primary storage. [2025-09-17T04:18:29.997194] [INFO ] [MAIN ] HTGC: Loaded 35199 existing records. [2025-09-17T04:18:30.271002] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:18:30.271317] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-17T04:18:30.271373] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-17T04:18:30.272563] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-17T04:18:30.272680] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-17T04:18:30.295404] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-17T04:18:30.656721] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:31.090180] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-11. [2025-09-17T04:18:31.890174] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-17T04:18:32.328903] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T04:18:32.348436] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T04:18:32.690171] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-17T04:18:32.750484] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T04:18:33.015393] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T04:18:33.490197] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-17T04:18:34.290204] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-17T04:18:34.384032] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T04:18:35.090147] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-17T04:18:35.895220] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-17T04:18:35.906831] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T04:18:35.960506] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T04:18:36.259430] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T04:18:36.690156] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-17T04:18:37.090410] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-17T04:18:37.490207] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-17T04:18:38.290158] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-17T04:18:39.090119] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-17T04:18:39.151165] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:18:39.431045] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T04:18:39.890160] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-17T04:18:40.057205] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T04:18:40.690138] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-17T04:18:41.479712] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T04:18:41.491354] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-17T04:18:41.720812] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-17T04:18:42.225572] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:18:42.290143] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-17T04:18:43.090148] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-17T04:18:43.376358] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.29 seconds). [2025-09-17T04:18:43.890160] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-17T04:18:44.000067] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T04:18:44.690229] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-17T04:18:44.787825] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T04:18:45.490165] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-17T04:18:45.725268] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-17T04:18:46.158618] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T04:18:46.290137] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-17T04:18:47.090156] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-17T04:18:47.890197] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-17T04:18:47.995633] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T04:18:48.690193] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-17T04:18:48.913969] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T04:18:48.929894] [INFO ] [REMOTE ] HSY: Full fetch complete (73782 records). [2025-09-17T04:18:48.930547] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-17T04:18:48.931069] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T04:18:49.328978] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-17T04:18:49.329096] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-17T04:18:49.330267] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-17T04:18:49.330336] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-17T04:18:49.331980] [DEBUG] [LOCAL ] HSY: Trimmed 73782 records to 50531 (keeping 200 days of data) [2025-09-17T04:18:49.526922] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-17T04:18:49.671404] [DEBUG] [LOCAL ] HSY: Primary data saved (50531 records). [2025-09-17T04:18:49.671605] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-17T04:18:49.671748] [INFO ] [MAIN ] Update Progress: 1059/2369 symbols completed. HSY took 52.7s. Estimated remaining: 3h 11m 23s. Rate: 6.8 symbols/min [2025-09-17T04:18:49.843758] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:49.868007] [DEBUG] [LOCAL ] HTH: Loaded 25177 existing records from primary storage. [2025-09-17T04:18:49.868188] [INFO ] [MAIN ] HTH: Loaded 25177 existing records. [2025-09-17T04:18:50.050247] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:18:50.050515] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-17T04:18:50.050576] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-17T04:18:50.051359] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-17T04:18:50.051430] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-17T04:18:50.293790] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-17T04:18:50.422243] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:50.434287] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T04:18:50.475015] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T04:18:50.710276] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T04:18:50.711291] [INFO ] [REMOTE ] HTFC: Full fetch complete (839 records). [2025-09-17T04:18:50.711386] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-17T04:18:50.903156] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-17T04:18:50.903400] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:18:50.903458] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:18:50.903510] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-17T04:18:50.903665] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-17T04:18:50.903729] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-17T04:18:50.903802] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-17T04:18:50.903891] [INFO ] [MAIN ] Update Progress: 1060/2369 symbols completed. HTFC took 26.1s. Estimated remaining: 3h 11m 5s. Rate: 6.9 symbols/min [2025-09-17T04:18:51.085184] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:51.090119] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-11. [2025-09-17T04:18:51.124239] [DEBUG] [LOCAL ] HUBB: Loaded 26937 existing records from primary storage. [2025-09-17T04:18:51.124536] [INFO ] [MAIN ] HUBB: Loaded 26937 existing records. [2025-09-17T04:18:51.309342] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:18:51.309690] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-17T04:18:51.309761] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-17T04:18:51.310781] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-17T04:18:51.310849] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-17T04:18:51.700578] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:51.890173] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-11. [2025-09-17T04:18:52.173171] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T04:18:52.690261] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-17T04:18:53.320008] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:18:53.490247] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-17T04:18:54.274109] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T04:18:54.290096] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-17T04:18:54.849444] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T04:18:55.090236] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-17T04:18:55.890201] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-17T04:18:55.978917] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T04:18:56.178162] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T04:18:56.690245] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-17T04:18:56.824105] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T04:18:56.826406] [INFO ] [REMOTE ] HTD: Full fetch complete (18795 records). [2025-09-17T04:18:56.826498] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-17T04:18:57.263222] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-17T04:18:57.263401] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-17T04:18:57.264341] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-17T04:18:57.264449] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-17T04:18:57.265810] [DEBUG] [LOCAL ] HTD: Trimmed 18795 records to 13409 (keeping 200 days of data) [2025-09-17T04:18:57.374444] [DEBUG] [LOCAL ] HTD: Primary data saved (13409 records). [2025-09-17T04:18:57.374858] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-17T04:18:57.375005] [INFO ] [MAIN ] Update Progress: 1061/2369 symbols completed. HTD took 42.5s. Estimated remaining: 3h 10m 53s. Rate: 6.9 symbols/min [2025-09-17T04:18:57.494457] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-17T04:18:57.575374] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:18:57.617793] [DEBUG] [LOCAL ] HUBS: Loaded 29255 existing records from primary storage. [2025-09-17T04:18:57.618032] [INFO ] [MAIN ] HUBS: Loaded 29255 existing records. [2025-09-17T04:18:57.807020] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:18:57.807514] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-17T04:18:57.807614] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-17T04:18:57.813578] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-17T04:18:57.823981] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-17T04:18:57.824802] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T04:18:58.212623] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:18:58.290242] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-11. [2025-09-17T04:18:59.039324] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T04:18:59.090191] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-17T04:18:59.838462] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T04:18:59.890150] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-17T04:19:00.476539] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T04:19:00.690176] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-17T04:19:01.435438] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T04:19:01.490216] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-17T04:19:02.245376] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T04:19:02.290192] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-17T04:19:02.652996] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T04:19:03.090230] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-17T04:19:03.831253] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T04:19:03.890174] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-17T04:19:04.702732] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-17T04:19:04.709518] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T04:19:05.217774] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T04:19:05.490244] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-17T04:19:06.243847] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T04:19:06.290201] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-17T04:19:06.861976] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T04:19:07.090198] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-17T04:19:07.769445] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T04:19:07.890173] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-17T04:19:08.690192] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-17T04:19:08.745463] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T04:19:08.984746] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T04:19:09.490232] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-17T04:19:10.074396] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T04:19:10.290221] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-17T04:19:10.835208] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T04:19:11.090158] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-17T04:19:11.468019] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T04:19:11.474807] [INFO ] [REMOTE ] HTGC: Full fetch complete (68013 records). [2025-09-17T04:19:11.475045] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-17T04:19:11.896443] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-17T04:19:11.897503] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-17T04:19:11.898775] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-17T04:19:11.900092] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-17T04:19:11.900183] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-17T04:19:11.902499] [DEBUG] [LOCAL ] HTGC: Trimmed 68013 records to 47771 (keeping 200 days of data) [2025-09-17T04:19:12.221315] [DEBUG] [LOCAL ] HTGC: Primary data saved (47771 records). [2025-09-17T04:19:12.221539] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-17T04:19:12.221673] [INFO ] [MAIN ] Update Progress: 1062/2369 symbols completed. HTGC took 42.5s. Estimated remaining: 3h 10m 52s. Rate: 6.8 symbols/min [2025-09-17T04:19:12.400207] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:12.472507] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T04:19:12.484099] [DEBUG] [LOCAL ] HUM: Loaded 36539 existing records from primary storage. [2025-09-17T04:19:12.485129] [INFO ] [MAIN ] HUM: Loaded 36539 existing records. [2025-09-17T04:19:12.694156] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-17T04:19:12.699532] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:12.700679] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-17T04:19:12.700759] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-17T04:19:12.701766] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-17T04:19:12.701834] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-17T04:19:13.083444] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:13.490180] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-11. [2025-09-17T04:19:13.520875] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T04:19:13.733818] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T04:19:14.290207] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-17T04:19:15.090184] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-17T04:19:15.264814] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T04:19:15.344032] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T04:19:15.890168] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-17T04:19:16.259921] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T04:19:16.690167] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-17T04:19:17.179265] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T04:19:17.490196] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-17T04:19:18.135340] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T04:19:18.290179] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-17T04:19:19.090235] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-17T04:19:19.176007] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T04:19:19.249836] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T04:19:19.890223] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-17T04:19:20.690180] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-17T04:19:20.898694] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T04:19:21.260912] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T04:19:21.269268] [INFO ] [REMOTE ] HUBB: Full fetch complete (53277 records). [2025-09-17T04:19:21.269451] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-17T04:19:21.499104] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-17T04:19:21.680297] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-17T04:19:21.680442] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-17T04:19:21.681438] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-17T04:19:21.681530] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-17T04:19:21.683100] [DEBUG] [LOCAL ] HUBB: Trimmed 53277 records to 37695 (keeping 200 days of data) [2025-09-17T04:19:21.977325] [DEBUG] [LOCAL ] HUBB: Primary data saved (37695 records). [2025-09-17T04:19:21.977578] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-17T04:19:21.977736] [INFO ] [MAIN ] Update Progress: 1063/2369 symbols completed. HUBB took 31.1s. Estimated remaining: 3h 10m 45s. Rate: 6.8 symbols/min [2025-09-17T04:19:22.165901] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:22.222908] [DEBUG] [LOCAL ] HUN: Loaded 39628 existing records from primary storage. [2025-09-17T04:19:22.223180] [INFO ] [MAIN ] HUN: Loaded 39628 existing records. [2025-09-17T04:19:22.290781] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-17T04:19:22.450889] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:22.454018] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T04:19:22.451877] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-17T04:19:22.463250] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-17T04:19:22.464758] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-17T04:19:22.464838] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-17T04:19:22.826255] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:23.089911] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T04:19:23.090105] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-11. [2025-09-17T04:19:23.890167] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-17T04:19:23.937278] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T04:19:23.942597] [INFO ] [REMOTE ] HUBS: Full fetch complete (55167 records). [2025-09-17T04:19:23.942796] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-17T04:19:24.347227] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-17T04:19:24.347360] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-17T04:19:24.348264] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-17T04:19:24.348339] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-17T04:19:24.349887] [DEBUG] [LOCAL ] HUBS: Trimmed 55167 records to 39811 (keeping 200 days of data) [2025-09-17T04:19:24.615615] [DEBUG] [LOCAL ] HUBS: Primary data saved (39811 records). [2025-09-17T04:19:24.616014] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-17T04:19:24.616175] [INFO ] [MAIN ] Update Progress: 1064/2369 symbols completed. HUBS took 27.2s. Estimated remaining: 3h 10m 28s. Rate: 6.9 symbols/min [2025-09-17T04:19:24.701729] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-17T04:19:24.802396] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:24.839681] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:19:24.878592] [DEBUG] [LOCAL ] HUYA: Loaded 32344 existing records from primary storage. [2025-09-17T04:19:24.878837] [INFO ] [MAIN ] HUYA: Loaded 32344 existing records. [2025-09-17T04:19:25.126306] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:25.126671] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-17T04:19:25.126740] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-17T04:19:25.127862] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-17T04:19:25.127932] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-17T04:19:25.449854] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T04:19:25.485189] [INFO ] [REMOTE ] HTH: Full fetch complete (46219 records). [2025-09-17T04:19:25.505712] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-17T04:19:25.545715] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:25.545815] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-17T04:19:25.991635] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-17T04:19:25.991804] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-17T04:19:25.992969] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-17T04:19:25.993058] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-17T04:19:25.994729] [DEBUG] [LOCAL ] HTH: Trimmed 46219 records to 32999 (keeping 200 days of data) [2025-09-17T04:19:26.212978] [DEBUG] [LOCAL ] HTH: Primary data saved (32999 records). [2025-09-17T04:19:26.213199] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-17T04:19:26.213372] [INFO ] [MAIN ] Update Progress: 1065/2369 symbols completed. HTH took 36.5s. Estimated remaining: 3h 10m 11s. Rate: 6.9 symbols/min [2025-09-17T04:19:26.295292] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-11. [2025-09-17T04:19:26.407924] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:26.424576] [DEBUG] [LOCAL ] HVT: Loaded 11049 existing records from primary storage. [2025-09-17T04:19:26.424890] [INFO ] [MAIN ] HVT: Loaded 11049 existing records. [2025-09-17T04:19:26.635914] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:26.636320] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-17T04:19:26.636407] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-17T04:19:26.637062] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-17T04:19:26.637145] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-17T04:19:26.793251] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-17T04:19:27.070421] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:27.090089] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-11. [2025-09-17T04:19:27.250983] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T04:19:27.890207] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-17T04:19:27.995351] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T04:19:28.186551] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:19:28.690222] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-17T04:19:29.177160] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T04:19:29.490161] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-17T04:19:30.295296] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-17T04:19:30.314156] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T04:19:30.755600] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T04:19:31.090184] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-17T04:19:31.795246] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T04:19:31.890164] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-17T04:19:32.690182] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-17T04:19:32.833499] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T04:19:33.491755] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-17T04:19:33.495532] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T04:19:34.290181] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-17T04:19:34.547042] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T04:19:35.055444] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T04:19:35.080188] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T04:19:35.090076] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-17T04:19:35.861371] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T04:19:35.890164] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-17T04:19:36.690157] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-17T04:19:37.358325] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T04:19:37.490178] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-17T04:19:38.290163] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-17T04:19:38.337316] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T04:19:39.100946] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-17T04:19:39.107800] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T04:19:39.890145] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-17T04:19:39.964610] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T04:19:40.008613] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T04:19:40.690148] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-17T04:19:41.490123] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-17T04:19:41.609513] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T04:19:42.290165] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-17T04:19:42.398491] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T04:19:43.090192] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-17T04:19:43.139659] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T04:19:43.197461] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T04:19:43.890187] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-17T04:19:44.690186] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-17T04:19:44.967768] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T04:19:45.053537] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T04:19:45.490196] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-17T04:19:45.973687] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T04:19:46.290262] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-17T04:19:46.358043] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T04:19:47.090175] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-17T04:19:47.890170] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-17T04:19:48.057698] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T04:19:48.093284] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T04:19:48.690178] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-17T04:19:49.299999] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T04:19:49.490207] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-17T04:19:49.619210] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T04:19:50.290211] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-17T04:19:50.980313] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T04:19:51.090182] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-17T04:19:51.240266] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T04:19:51.890193] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-17T04:19:52.695264] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-17T04:19:52.709337] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T04:19:52.716960] [INFO ] [REMOTE ] HUN: Full fetch complete (76310 records). [2025-09-17T04:19:52.717165] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-17T04:19:53.152413] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-17T04:19:53.152554] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-17T04:19:53.154096] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-17T04:19:53.154189] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-17T04:19:53.156345] [DEBUG] [LOCAL ] HUN: Trimmed 76310 records to 53188 (keeping 200 days of data) [2025-09-17T04:19:53.502100] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-17T04:19:53.534264] [DEBUG] [LOCAL ] HUN: Primary data saved (53188 records). [2025-09-17T04:19:53.534725] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-17T04:19:53.535070] [INFO ] [MAIN ] Update Progress: 1066/2369 symbols completed. HUN took 31.6s. Estimated remaining: 3h 10m 25s. Rate: 6.8 symbols/min [2025-09-17T04:19:53.603444] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T04:19:53.681968] [INFO ] [REMOTE ] HUM: Full fetch complete (70750 records). [2025-09-17T04:19:53.682283] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-17T04:19:53.767634] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:53.821992] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T04:19:53.863707] [INFO ] [REMOTE ] HVT: Full fetch complete (23875 records). [2025-09-17T04:19:53.888679] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-17T04:19:54.271168] [DEBUG] [LOCAL ] HWM: Loaded 39509 existing records from primary storage. [2025-09-17T04:19:54.302380] [INFO ] [MAIN ] HWM: Loaded 39509 existing records. [2025-09-17T04:19:54.685240] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-17T04:19:54.711596] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-17T04:19:54.718252] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-17T04:19:54.753857] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-17T04:19:54.832778] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:54.861565] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-17T04:19:54.861671] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-17T04:19:54.862149] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-17T04:19:54.862327] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-17T04:19:54.862860] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-17T04:19:54.865138] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-17T04:19:54.865503] [DEBUG] [LOCAL ] HUM: Trimmed 70750 records to 48832 (keeping 200 days of data) [2025-09-17T04:19:54.866377] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-17T04:19:54.866942] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-17T04:19:54.872690] [DEBUG] [LOCAL ] HVT: Trimmed 23875 records to 16336 (keeping 200 days of data) [2025-09-17T04:19:55.421662] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T04:19:55.489296] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-17T04:19:55.531214] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:55.532957] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-11. [2025-09-17T04:19:55.562588] [DEBUG] [LOCAL ] HVT: Primary data saved (16336 records). [2025-09-17T04:19:55.563558] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-17T04:19:55.564269] [INFO ] [MAIN ] Update Progress: 1067/2369 symbols completed. HVT took 29.4s. Estimated remaining: 3h 10m 8s. Rate: 6.8 symbols/min [2025-09-17T04:19:55.904016] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:55.953829] [DEBUG] [LOCAL ] HXL: Loaded 34210 existing records from primary storage. [2025-09-17T04:19:55.960503] [INFO ] [MAIN ] HXL: Loaded 34210 existing records. [2025-09-17T04:19:56.222927] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:56.225215] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-17T04:19:56.243352] [DEBUG] [LOCAL ] HUM: Primary data saved (48832 records). [2025-09-17T04:19:56.243224] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-17T04:19:56.243943] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-17T04:19:56.244394] [INFO ] [MAIN ] Update Progress: 1068/2369 symbols completed. HUM took 44.0s. Estimated remaining: 3h 9m 49s. Rate: 6.9 symbols/min [2025-09-17T04:19:56.250407] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-17T04:19:56.303133] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-17T04:19:56.744922] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:19:56.926953] [DEBUG] [LOCAL ] HY: Loaded 7194 existing records from primary storage. [2025-09-17T04:19:56.963785] [INFO ] [MAIN ] HY: Loaded 7194 existing records. [2025-09-17T04:19:57.265767] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:57.327203] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-11. [2025-09-17T04:19:57.335733] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:19:57.337235] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-17T04:19:57.337355] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-17T04:19:57.338102] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-17T04:19:57.338521] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-17T04:19:57.660628] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T04:19:57.734541] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-17T04:19:57.762192] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:19:57.763364] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-11. [2025-09-17T04:19:57.799516] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-11 (2.27 seconds). [2025-09-17T04:19:58.290121] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-17T04:19:58.601477] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T04:19:58.934332] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T04:19:59.020691] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T04:19:59.090163] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-17T04:19:59.890119] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-17T04:19:59.992166] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T04:20:00.690220] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-17T04:20:00.713635] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T04:20:00.719850] [INFO ] [REMOTE ] HUYA: Full fetch complete (63678 records). [2025-09-17T04:20:00.720036] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-17T04:20:00.926734] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:20:01.150889] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-17T04:20:01.151055] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-17T04:20:01.152132] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-17T04:20:01.152230] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-17T04:20:01.154070] [DEBUG] [LOCAL ] HUYA: Trimmed 63678 records to 44349 (keeping 200 days of data) [2025-09-17T04:20:01.442129] [DEBUG] [LOCAL ] HUYA: Primary data saved (44349 records). [2025-09-17T04:20:01.442333] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-17T04:20:01.442453] [INFO ] [MAIN ] Update Progress: 1069/2369 symbols completed. HUYA took 36.8s. Estimated remaining: 3h 9m 36s. Rate: 6.9 symbols/min [2025-09-17T04:20:01.495294] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-17T04:20:01.640362] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:01.640658] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-17T04:20:01.640714] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-17T04:20:01.640841] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-17T04:20:01.640898] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-17T04:20:01.640954] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-17T04:20:01.641000] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-17T04:20:02.047752] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:02.290245] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-11. [2025-09-17T04:20:02.447576] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T04:20:02.609810] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-17T04:20:02.699764] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T04:20:03.090157] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-17T04:20:03.890215] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-17T04:20:03.925768] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T04:20:04.690244] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-17T04:20:05.490181] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-17T04:20:05.602280] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T04:20:05.850260] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-17T04:20:06.290215] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-17T04:20:06.930410] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T04:20:06.934348] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T04:20:07.090211] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-17T04:20:07.890202] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-17T04:20:08.050207] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T04:20:08.207920] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-17T04:20:08.690214] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-17T04:20:09.490196] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-17T04:20:09.818607] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T04:20:10.290178] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-17T04:20:10.509713] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.22 seconds). [2025-09-17T04:20:10.720859] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T04:20:11.090162] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-17T04:20:11.890261] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-17T04:20:12.244356] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-17T04:20:12.690173] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-17T04:20:13.027452] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T04:20:13.171914] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T04:20:13.490154] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-17T04:20:14.292774] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-17T04:20:14.293882] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T04:20:15.090171] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-17T04:20:15.658226] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T04:20:15.827691] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T04:20:15.890174] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-17T04:20:16.690184] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-17T04:20:17.363050] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T04:20:17.490146] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-17T04:20:17.794583] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-17T04:20:18.290200] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-17T04:20:18.749861] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T04:20:18.768488] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-17T04:20:19.090195] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-17T04:20:19.890202] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-17T04:20:20.690211] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-17T04:20:20.951022] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-17T04:20:20.954664] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T04:20:21.495284] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-17T04:20:21.521541] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T04:20:22.290204] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-17T04:20:23.090211] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-17T04:20:23.394120] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-17T04:20:23.395522] [INFO ] [REMOTE ] HYAC: Full fetch complete (875 records). [2025-09-17T04:20:23.395630] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-17T04:20:23.396351] [FATAL] [VALIDATOR ] HYAC: Data is stale - most recent date (2025-09-11) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T04:20:23.396436] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:20:23.396484] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:20:23.396530] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-17T04:20:23.396618] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-17T04:20:23.396715] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-17T04:20:23.396780] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-17T04:20:23.396859] [INFO ] [MAIN ] Update Progress: 1070/2369 symbols completed. HYAC took 22.0s. Estimated remaining: 3h 9m 43s. Rate: 6.8 symbols/min [2025-09-17T04:20:23.582971] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:23.583532] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-17T04:20:23.583776] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-17T04:20:23.584028] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-17T04:20:23.584121] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-17T04:20:23.584378] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-17T04:20:23.584447] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-17T04:20:23.752584] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T04:20:23.895763] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-17T04:20:24.061280] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:24.094460] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T04:20:24.690153] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-17T04:20:24.741877] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T04:20:25.490156] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-17T04:20:26.290093] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-17T04:20:26.330253] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T04:20:26.371767] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T04:20:27.090178] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-17T04:20:27.890153] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-11. [2025-09-17T04:20:27.984531] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T04:20:27.986827] [INFO ] [REMOTE ] HY: Full fetch complete (15150 records). [2025-09-17T04:20:27.986947] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-17T04:20:28.164024] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-11 (0.27 seconds). [2025-09-17T04:20:28.355932] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-17T04:20:28.356077] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-17T04:20:28.356678] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-17T04:20:28.356794] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-17T04:20:28.357513] [DEBUG] [LOCAL ] HY: Trimmed 15150 records to 10442 (keeping 200 days of data) [2025-09-17T04:20:28.450780] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-17T04:20:28.468917] [DEBUG] [LOCAL ] HY: Primary data saved (10442 records). [2025-09-17T04:20:28.469109] [INFO ] [MAIN ] HY: Full history saved. [2025-09-17T04:20:28.469252] [INFO ] [MAIN ] Update Progress: 1071/2369 symbols completed. HY took 32.2s. Estimated remaining: 3h 9m 30s. Rate: 6.8 symbols/min [2025-09-17T04:20:28.644732] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:28.654431] [DEBUG] [LOCAL ] HYI: Loaded 6467 existing records from primary storage. [2025-09-17T04:20:28.654677] [INFO ] [MAIN ] HYI: Loaded 6467 existing records. [2025-09-17T04:20:28.695343] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-17T04:20:28.851908] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:20:28.852332] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-17T04:20:28.852428] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-17T04:20:28.852970] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-17T04:20:28.853062] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-17T04:20:29.232414] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:29.490184] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-11. [2025-09-17T04:20:30.138241] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T04:20:30.276301] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T04:20:30.290171] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-17T04:20:31.083437] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T04:20:31.090075] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-17T04:20:31.883118] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T04:20:31.890079] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-17T04:20:32.615734] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T04:20:32.690205] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-17T04:20:33.490156] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-17T04:20:33.508516] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T04:20:34.290174] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-17T04:20:34.622045] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-17T04:20:35.090154] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-17T04:20:35.144843] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T04:20:35.890152] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-17T04:20:35.922570] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T04:20:36.222736] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T04:20:36.690156] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-17T04:20:36.913766] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-17T04:20:37.490199] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-17T04:20:37.725089] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-17T04:20:38.290149] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-17T04:20:39.090196] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-17T04:20:39.403783] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-17T04:20:39.890199] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-17T04:20:40.090137] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T04:20:40.100396] [INFO ] [REMOTE ] HWM: Full fetch complete (76528 records). [2025-09-17T04:20:40.100887] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-17T04:20:40.520239] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-17T04:20:40.520419] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-17T04:20:40.521737] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-17T04:20:40.521851] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-17T04:20:40.523924] [DEBUG] [LOCAL ] HWM: Trimmed 76528 records to 53037 (keeping 200 days of data) [2025-09-17T04:20:40.724662] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-17T04:20:40.885157] [DEBUG] [LOCAL ] HWM: Primary data saved (53037 records). [2025-09-17T04:20:40.885381] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-17T04:20:40.885525] [INFO ] [MAIN ] Update Progress: 1072/2369 symbols completed. HWM took 47.4s. Estimated remaining: 3h 9m 26s. Rate: 6.8 symbols/min [2025-09-17T04:20:41.041188] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T04:20:41.068687] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:41.094343] [DEBUG] [LOCAL ] HYT: Loaded 24402 existing records from primary storage. [2025-09-17T04:20:41.094545] [INFO ] [MAIN ] HYT: Loaded 24402 existing records. [2025-09-17T04:20:41.277592] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:20:41.278013] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-17T04:20:41.278083] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-17T04:20:41.278968] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-17T04:20:41.279036] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-17T04:20:41.496462] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-17T04:20:41.629210] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T04:20:41.676329] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:41.904625] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-17T04:20:42.290164] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-17T04:20:43.015438] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T04:20:43.090100] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-17T04:20:43.584522] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T04:20:43.890197] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-17T04:20:44.494008] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T04:20:44.690154] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-17T04:20:45.458367] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T04:20:45.490102] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-17T04:20:46.141241] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T04:20:46.142564] [INFO ] [REMOTE ] HYI: Full fetch complete (13103 records). [2025-09-17T04:20:46.142681] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-17T04:20:46.295256] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-11. [2025-09-17T04:20:46.532564] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-17T04:20:46.532766] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-17T04:20:46.533387] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-17T04:20:46.533444] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-17T04:20:46.534574] [DEBUG] [LOCAL ] HYI: Trimmed 13103 records to 8940 (keeping 200 days of data) [2025-09-17T04:20:46.593977] [DEBUG] [LOCAL ] HYI: Primary data saved (8940 records). [2025-09-17T04:20:46.594181] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-17T04:20:46.594362] [INFO ] [MAIN ] Update Progress: 1073/2369 symbols completed. HYI took 18.1s. Estimated remaining: 3h 9m 13s. Rate: 6.8 symbols/min [2025-09-17T04:20:46.763483] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:46.768942] [DEBUG] [LOCAL ] HYTR: Loaded 2235 existing records from primary storage. [2025-09-17T04:20:46.769074] [INFO ] [MAIN ] HYTR: Loaded 2235 existing records. [2025-09-17T04:20:46.944803] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:20:46.945102] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-17T04:20:46.945170] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-17T04:20:46.945469] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-17T04:20:46.945535] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-17T04:20:47.095396] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-17T04:20:47.307468] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:47.478247] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-17T04:20:47.586618] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:20:47.890204] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-17T04:20:48.690279] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-17T04:20:49.211371] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T04:20:49.219837] [INFO ] [REMOTE ] HXL: Full fetch complete (66095 records). [2025-09-17T04:20:49.220094] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-17T04:20:49.499511] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-17T04:20:49.627781] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-17T04:20:49.627924] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-17T04:20:49.629026] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-17T04:20:49.629104] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-17T04:20:49.630884] [DEBUG] [LOCAL ] HXL: Trimmed 66095 records to 46295 (keeping 200 days of data) [2025-09-17T04:20:49.913614] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T04:20:49.940550] [DEBUG] [LOCAL ] HXL: Primary data saved (46295 records). [2025-09-17T04:20:49.940869] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-17T04:20:49.941123] [INFO ] [MAIN ] Update Progress: 1074/2369 symbols completed. HXL took 54.4s. Estimated remaining: 3h 8m 58s. Rate: 6.9 symbols/min [2025-09-17T04:20:50.144972] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:50.149562] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T04:20:50.178042] [DEBUG] [LOCAL ] HZO: Loaded 20719 existing records from primary storage. [2025-09-17T04:20:50.178277] [INFO ] [MAIN ] HZO: Loaded 20719 existing records. [2025-09-17T04:20:50.290478] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-11. [2025-09-17T04:20:50.410263] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:20:50.410637] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-17T04:20:50.410765] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-17T04:20:50.411498] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-17T04:20:50.411595] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-17T04:20:50.784361] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T04:20:51.007822] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:51.090244] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-17T04:20:51.890215] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-17T04:20:52.307725] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-17T04:20:52.434107] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T04:20:52.690190] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-11. [2025-09-17T04:20:53.490195] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-17T04:20:53.772396] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T04:20:53.804416] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-17T04:20:53.805317] [INFO ] [REMOTE ] HYBX: Full fetch complete (833 records). [2025-09-17T04:20:53.805426] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-17T04:20:54.005377] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-17T04:20:54.005622] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:20:54.005718] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:20:54.005768] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-17T04:20:54.005847] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-17T04:20:54.005906] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-17T04:20:54.005994] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-17T04:20:54.006093] [INFO ] [MAIN ] Update Progress: 1075/2369 symbols completed. HYBX took 30.6s. Estimated remaining: 3h 8m 44s. Rate: 6.9 symbols/min [2025-09-17T04:20:54.189600] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:20:54.198112] [DEBUG] [LOCAL ] IAE: Loaded 4267 existing records from primary storage. [2025-09-17T04:20:54.198280] [INFO ] [MAIN ] IAE: Loaded 4267 existing records. [2025-09-17T04:20:54.295221] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-17T04:20:54.390393] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:20:54.390780] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-17T04:20:54.390861] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-17T04:20:54.391223] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-17T04:20:54.391295] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-17T04:20:54.762713] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:20:54.852152] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T04:20:55.090158] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-17T04:20:55.621188] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T04:20:55.890160] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-11. [2025-09-17T04:20:56.578838] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T04:20:56.690155] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-17T04:20:57.251194] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T04:20:57.490167] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-17T04:20:58.114460] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T04:20:58.290196] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-17T04:20:58.702582] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-17T04:20:59.090154] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-17T04:20:59.890213] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-17T04:21:00.136753] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T04:21:00.690204] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-17T04:21:01.269083] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T04:21:01.387997] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T04:21:01.490133] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-17T04:21:02.290176] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-17T04:21:03.090177] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-17T04:21:03.890196] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-17T04:21:04.091802] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-17T04:21:04.655008] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T04:21:04.690166] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-17T04:21:04.906712] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-17T04:21:05.135137] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T04:21:05.490161] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-17T04:21:05.790853] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T04:21:06.112184] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T04:21:06.290215] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-17T04:21:07.090137] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-17T04:21:07.628465] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T04:21:07.890181] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-17T04:21:08.351116] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T04:21:08.626350] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T04:21:08.690179] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-17T04:21:09.490164] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-17T04:21:10.178775] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T04:21:10.290154] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-17T04:21:10.890486] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T04:21:11.090143] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-17T04:21:11.576759] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T04:21:11.890163] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-17T04:21:12.003185] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T04:21:12.353815] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T04:21:12.690148] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-17T04:21:13.490270] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-17T04:21:13.975024] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T04:21:13.977783] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T04:21:13.977934] [INFO ] [REMOTE ] HYTR: Full fetch complete (4329 records). [2025-09-17T04:21:13.978262] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-17T04:21:14.295302] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-17T04:21:14.371620] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-17T04:21:14.372085] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-17T04:21:14.372350] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-17T04:21:14.372428] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-17T04:21:14.372913] [DEBUG] [LOCAL ] HYTR: Trimmed 4329 records to 3222 (keeping 200 days of data) [2025-09-17T04:21:14.399126] [DEBUG] [LOCAL ] HYTR: Primary data saved (3222 records). [2025-09-17T04:21:14.399442] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-17T04:21:14.399634] [INFO ] [MAIN ] Update Progress: 1076/2369 symbols completed. HYTR took 27.8s. Estimated remaining: 3h 8m 49s. Rate: 6.8 symbols/min [2025-09-17T04:21:14.574794] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:21:14.618597] [DEBUG] [LOCAL ] IAG: Loaded 39848 existing records from primary storage. [2025-09-17T04:21:14.618849] [INFO ] [MAIN ] IAG: Loaded 39848 existing records. [2025-09-17T04:21:14.808506] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:21:14.808795] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-17T04:21:14.808866] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-17T04:21:14.809744] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-17T04:21:14.809808] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-17T04:21:15.095184] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-17T04:21:15.103580] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T04:21:15.234869] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:21:15.890141] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-17T04:21:16.690108] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-17T04:21:17.093065] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T04:21:17.121765] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T04:21:17.490153] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-17T04:21:18.121923] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:21:18.290135] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-17T04:21:18.829152] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T04:21:19.090142] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-11. [2025-09-17T04:21:19.710471] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T04:21:19.890152] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-17T04:21:20.497010] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T04:21:20.690149] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-17T04:21:20.772347] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T04:21:21.490103] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-17T04:21:21.506944] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T04:21:21.510455] [INFO ] [REMOTE ] HZO: Full fetch complete (40204 records). [2025-09-17T04:21:21.510628] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-17T04:21:21.900798] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-17T04:21:21.900934] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-17T04:21:21.901767] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-17T04:21:21.901841] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-17T04:21:21.902970] [DEBUG] [LOCAL ] HZO: Trimmed 40204 records to 29369 (keeping 200 days of data) [2025-09-17T04:21:22.083243] [DEBUG] [LOCAL ] HZO: Primary data saved (29369 records). [2025-09-17T04:21:22.083430] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-17T04:21:22.083536] [INFO ] [MAIN ] Update Progress: 1077/2369 symbols completed. HZO took 32.1s. Estimated remaining: 3h 8m 39s. Rate: 6.8 symbols/min [2025-09-17T04:21:22.290139] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-17T04:21:23.090154] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-17T04:21:23.260294] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:21:23.701910] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T04:21:23.712913] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T04:21:23.714038] [INFO ] [REMOTE ] HYT: Full fetch complete (46782 records). [2025-09-17T04:21:23.716697] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-17T04:21:23.892684] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-17T04:21:24.134497] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-17T04:21:24.134633] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-17T04:21:24.135798] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-17T04:21:24.135881] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-17T04:21:24.137319] [DEBUG] [LOCAL ] HYT: Trimmed 46782 records to 33193 (keeping 200 days of data) [2025-09-17T04:21:24.360249] [DEBUG] [LOCAL ] HYT: Primary data saved (33193 records). [2025-09-17T04:21:24.360453] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-17T04:21:24.360571] [INFO ] [MAIN ] Update Progress: 1078/2369 symbols completed. HYT took 43.5s. Estimated remaining: 3h 8m 22s. Rate: 6.9 symbols/min [2025-09-17T04:21:24.690182] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-17T04:21:24.726587] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T04:21:25.490165] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-17T04:21:26.086510] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T04:21:26.290145] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-17T04:21:26.446986] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T04:21:26.964958] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T04:21:26.966664] [INFO ] [REMOTE ] IAE: Full fetch complete (8333 records). [2025-09-17T04:21:26.966755] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-17T04:21:27.095266] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-17T04:21:27.332300] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-17T04:21:27.332415] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-17T04:21:27.332687] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-17T04:21:27.332738] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-17T04:21:27.333353] [DEBUG] [LOCAL ] IAE: Trimmed 8333 records to 5736 (keeping 200 days of data) [2025-09-17T04:21:27.369258] [DEBUG] [LOCAL ] IAE: Primary data saved (5736 records). [2025-09-17T04:21:27.369388] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-17T04:21:27.369492] [INFO ] [MAIN ] Update Progress: 1079/2369 symbols completed. IAE took 33.4s. Estimated remaining: 3h 8m 7s. Rate: 6.9 symbols/min [2025-09-17T04:21:29.086112] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T04:21:29.098499] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-17T04:21:30.959468] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T04:21:30.974218] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-17T04:21:33.001032] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T04:21:33.013027] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-17T04:21:34.851140] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T04:21:34.862577] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-17T04:21:36.451057] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T04:21:36.462706] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-17T04:21:38.306837] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T04:21:38.318937] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-17T04:21:40.177075] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T04:21:40.190275] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-17T04:21:42.111698] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T04:21:42.118468] [INFO ] [REMOTE ] IAG: Full fetch complete (77021 records). [2025-09-17T04:21:42.118670] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-17T04:21:42.513716] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-17T04:21:42.513838] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-17T04:21:42.514904] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-17T04:21:42.514972] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-17T04:21:42.516611] [DEBUG] [LOCAL ] IAG: Trimmed 77021 records to 53432 (keeping 200 days of data) [2025-09-17T04:21:42.840123] [DEBUG] [LOCAL ] IAG: Primary data saved (53432 records). [2025-09-17T04:21:42.840352] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-17T04:21:42.840506] [INFO ] [MAIN ] Update Progress: 1080/2369 symbols completed. IAG took 28.4s. Estimated remaining: 3h 8m 6s. Rate: 6.9 symbols/min [2025-09-17T04:21:43.521162] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:21:43.636868] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:21:43.633201] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:21:43.639749] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:21:43.718630] [DEBUG] [LOCAL ] IBTA: Loaded 26290 existing records from primary storage. [2025-09-17T04:21:43.727934] [INFO ] [MAIN ] IBTA: Loaded 26290 existing records. [2025-09-17T04:21:43.767579] [DEBUG] [LOCAL ] IBP: Loaded 21669 existing records from primary storage. [2025-09-17T04:21:43.795865] [INFO ] [MAIN ] IBP: Loaded 21669 existing records. [2025-09-17T04:21:43.898869] [DEBUG] [LOCAL ] IBN: Loaded 39380 existing records from primary storage. [2025-09-17T04:21:43.970943] [DEBUG] [LOCAL ] IBM: Loaded 40001 existing records from primary storage. [2025-09-17T04:21:43.971140] [INFO ] [MAIN ] IBN: Loaded 39380 existing records. [2025-09-17T04:21:44.009673] [INFO ] [MAIN ] IBM: Loaded 40001 existing records. [2025-09-17T04:21:44.630809] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:21:44.741193] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-17T04:21:44.780831] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:21:44.817063] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-17T04:21:44.827629] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:21:44.868756] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-17T04:21:44.895150] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-17T04:21:44.895381] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-17T04:21:44.895226] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-17T04:21:44.895597] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-17T04:21:44.895881] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-17T04:21:44.895341] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:21:44.916141] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-17T04:21:44.925154] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-17T04:21:44.935658] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-17T04:21:44.906699] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-17T04:21:44.935596] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-17T04:21:44.983944] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-17T04:21:45.047654] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-17T04:21:45.143721] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-17T04:21:46.207078] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:21:46.283438] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:21:46.305057] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-11. [2025-09-17T04:21:46.356750] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:21:46.347836] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-11. [2025-09-17T04:21:46.367681] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-11. [2025-09-17T04:21:46.451822] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:21:46.452225] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-11. [2025-09-17T04:21:47.618138] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T04:21:47.624890] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-17T04:21:47.642335] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T04:21:47.648215] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-17T04:21:48.060960] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T04:21:48.071490] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-17T04:21:48.467836] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T04:21:48.478511] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-17T04:21:48.531688] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T04:21:48.538256] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-17T04:21:48.574241] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T04:21:48.581694] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-17T04:21:49.616455] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T04:21:49.622560] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-17T04:21:49.689726] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T04:21:49.696185] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-17T04:21:49.854490] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T04:21:49.865515] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-17T04:21:50.349741] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T04:21:50.361060] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-17T04:21:50.505287] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T04:21:50.510879] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-17T04:21:51.024524] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T04:21:51.032026] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-17T04:21:51.633280] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T04:21:51.645759] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-17T04:21:51.842486] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T04:21:51.853434] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-17T04:21:52.151196] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T04:21:52.162576] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-17T04:21:52.369474] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T04:21:52.377036] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-17T04:21:53.099968] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T04:21:53.111854] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-17T04:21:53.178466] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T04:21:53.189157] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-17T04:21:53.289523] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T04:21:53.296737] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-17T04:21:54.059065] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T04:21:54.070973] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-17T04:21:54.106692] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T04:21:54.114994] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-17T04:21:54.611293] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T04:21:54.619441] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-17T04:21:54.928101] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T04:21:54.939954] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-17T04:21:55.332629] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T04:21:55.339942] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-17T04:21:55.820510] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T04:21:55.890152] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-17T04:21:56.146255] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T04:21:56.289290] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T04:21:56.420159] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T04:21:56.690193] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-17T04:21:56.807023] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T04:21:57.490199] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-17T04:21:58.290210] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-17T04:21:59.024581] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-17T04:21:59.090152] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-17T04:21:59.423127] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T04:21:59.890140] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-17T04:21:59.937210] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T04:22:00.690203] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-17T04:22:01.227865] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T04:22:01.308520] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T04:22:01.490212] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-17T04:22:02.042989] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T04:22:02.049037] [INFO ] [REMOTE ] IBTA: Full fetch complete (50133 records). [2025-09-17T04:22:02.049294] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-17T04:22:02.295357] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-17T04:22:02.453178] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-17T04:22:02.453433] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-17T04:22:02.454498] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-17T04:22:02.454662] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-17T04:22:02.467996] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T04:22:02.472280] [DEBUG] [LOCAL ] IBTA: Trimmed 50133 records to 38340 (keeping 200 days of data) [2025-09-17T04:22:02.473705] [INFO ] [REMOTE ] IBP: Full fetch complete (40778 records). [2025-09-17T04:22:02.474309] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-17T04:22:03.099257] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-17T04:22:03.136845] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-17T04:22:03.138197] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-17T04:22:03.140248] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-17T04:22:03.141317] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-17T04:22:03.148335] [DEBUG] [LOCAL ] IBTA: Primary data saved (38340 records). [2025-09-17T04:22:03.148834] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-17T04:22:03.148948] [INFO ] [MAIN ] Update Progress: 1081/2369 symbols completed. IBTA took 20.3s. Estimated remaining: 3h 8m 11s. Rate: 6.8 symbols/min [2025-09-17T04:22:03.260327] [DEBUG] [LOCAL ] IBP: Trimmed 40778 records to 29528 (keeping 200 days of data) [2025-09-17T04:22:03.337152] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:03.497813] [DEBUG] [LOCAL ] ICE: Loaded 39416 existing records from primary storage. [2025-09-17T04:22:03.531240] [INFO ] [MAIN ] ICE: Loaded 39416 existing records. [2025-09-17T04:22:03.753279] [DEBUG] [LOCAL ] IBP: Primary data saved (29528 records). [2025-09-17T04:22:03.753572] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-17T04:22:03.753730] [INFO ] [MAIN ] Update Progress: 1082/2369 symbols completed. IBP took 20.9s. Estimated remaining: 3h 7m 52s. Rate: 6.9 symbols/min [2025-09-17T04:22:03.750189] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:03.798935] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-17T04:22:03.847775] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-17T04:22:03.864857] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-17T04:22:03.880347] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-17T04:22:03.980138] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:04.316275] [DEBUG] [LOCAL ] ICL: Loaded 28534 existing records from primary storage. [2025-09-17T04:22:04.397718] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:04.398011] [INFO ] [MAIN ] ICL: Loaded 28534 existing records. [2025-09-17T04:22:04.403803] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-11. [2025-09-17T04:22:04.425463] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-17T04:22:04.628716] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:04.629039] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-17T04:22:04.629127] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-17T04:22:04.630039] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-17T04:22:04.630111] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-17T04:22:04.702421] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-17T04:22:05.006983] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:05.353051] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T04:22:05.490160] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-11. [2025-09-17T04:22:06.264037] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T04:22:06.290176] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-17T04:22:06.698744] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T04:22:06.973801] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T04:22:07.090160] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-17T04:22:07.890179] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-17T04:22:08.690135] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-17T04:22:08.795812] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-17T04:22:08.866623] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T04:22:09.337312] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T04:22:09.490170] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-17T04:22:10.290169] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-17T04:22:10.450882] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T04:22:11.090150] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-17T04:22:11.883041] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-17T04:22:11.898523] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-17T04:22:12.580995] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T04:22:12.690158] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-17T04:22:13.219409] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T04:22:13.227255] [INFO ] [REMOTE ] IBN: Full fetch complete (76125 records). [2025-09-17T04:22:13.227455] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-17T04:22:13.498376] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-17T04:22:13.667748] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-17T04:22:13.667895] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-17T04:22:13.668945] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-17T04:22:13.669012] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-17T04:22:13.670752] [DEBUG] [LOCAL ] IBN: Trimmed 76125 records to 52924 (keeping 200 days of data) [2025-09-17T04:22:13.941084] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:22:14.073168] [DEBUG] [LOCAL ] IBN: Primary data saved (52924 records). [2025-09-17T04:22:14.073382] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-17T04:22:14.073504] [INFO ] [MAIN ] Update Progress: 1083/2369 symbols completed. IBN took 31.2s. Estimated remaining: 3h 7m 46s. Rate: 6.8 symbols/min [2025-09-17T04:22:14.258207] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:14.287713] [DEBUG] [LOCAL ] IDA: Loaded 24824 existing records from primary storage. [2025-09-17T04:22:14.287940] [INFO ] [MAIN ] IDA: Loaded 24824 existing records. [2025-09-17T04:22:14.323968] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-17T04:22:14.492405] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:14.492752] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-17T04:22:14.492830] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-17T04:22:14.493575] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-17T04:22:14.493685] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-17T04:22:14.860942] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:15.090151] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-11. [2025-09-17T04:22:15.583774] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (5.29 seconds). [2025-09-17T04:22:15.890126] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-17T04:22:15.929218] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T04:22:16.155977] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-17T04:22:16.163419] [INFO ] [REMOTE ] IBM: Full fetch complete (77489 records). [2025-09-17T04:22:16.163735] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-17T04:22:16.498969] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T04:22:16.618616] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-17T04:22:16.618796] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-17T04:22:16.619890] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-17T04:22:16.619960] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-17T04:22:16.622141] [DEBUG] [LOCAL ] IBM: Trimmed 77489 records to 53609 (keeping 200 days of data) [2025-09-17T04:22:16.697300] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-17T04:22:16.989160] [DEBUG] [LOCAL ] IBM: Primary data saved (53609 records). [2025-09-17T04:22:16.989433] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-17T04:22:16.989592] [INFO ] [MAIN ] Update Progress: 1084/2369 symbols completed. IBM took 34.1s. Estimated remaining: 3h 7m 30s. Rate: 6.9 symbols/min [2025-09-17T04:22:17.175971] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:17.185658] [DEBUG] [LOCAL ] IDE: Loaded 6599 existing records from primary storage. [2025-09-17T04:22:17.185856] [INFO ] [MAIN ] IDE: Loaded 6599 existing records. [2025-09-17T04:22:17.369056] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:17.369404] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-17T04:22:17.369484] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-17T04:22:17.369984] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-17T04:22:17.370054] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-17T04:22:17.495246] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-17T04:22:17.789416] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:17.825044] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-17T04:22:18.288527] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T04:22:18.297542] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-11. [2025-09-17T04:22:18.814173] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:22:19.090167] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-17T04:22:19.163974] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T04:22:19.890174] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-17T04:22:20.690175] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-17T04:22:20.901074] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T04:22:21.442414] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T04:22:21.490181] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-17T04:22:22.161129] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T04:22:22.290168] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-17T04:22:22.939926] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T04:22:23.090155] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-17T04:22:23.537265] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:22:23.890180] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-17T04:22:24.437183] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T04:22:24.574491] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T04:22:24.690209] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-17T04:22:25.490158] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-17T04:22:26.101138] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T04:22:26.290160] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-17T04:22:26.760554] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T04:22:27.090170] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-17T04:22:27.658045] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T04:22:27.663025] [INFO ] [REMOTE ] ICL: Full fetch complete (56296 records). [2025-09-17T04:22:27.663159] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-17T04:22:27.899116] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-17T04:22:28.056538] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-17T04:22:28.056680] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-17T04:22:28.057611] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-17T04:22:28.057695] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-17T04:22:28.059065] [DEBUG] [LOCAL ] ICL: Trimmed 56296 records to 39049 (keeping 200 days of data) [2025-09-17T04:22:28.292510] [DEBUG] [LOCAL ] ICL: Primary data saved (39049 records). [2025-09-17T04:22:28.292749] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-17T04:22:28.292858] [INFO ] [MAIN ] Update Progress: 1085/2369 symbols completed. ICL took 24.5s. Estimated remaining: 3h 7m 24s. Rate: 6.9 symbols/min [2025-09-17T04:22:28.491579] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:28.499731] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T04:22:28.528179] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T04:22:28.540676] [DEBUG] [LOCAL ] IDT: Loaded 13221 existing records from primary storage. [2025-09-17T04:22:28.540867] [INFO ] [MAIN ] IDT: Loaded 13221 existing records. [2025-09-17T04:22:28.693413] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-17T04:22:28.721227] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:28.722669] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-17T04:22:28.722736] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-17T04:22:28.723153] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-17T04:22:28.723211] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-17T04:22:29.079757] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:29.490156] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-17T04:22:30.199692] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T04:22:30.225092] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T04:22:30.290139] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-17T04:22:31.023304] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T04:22:31.090202] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-11. [2025-09-17T04:22:31.820451] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T04:22:31.890176] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-17T04:22:32.690177] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-17T04:22:32.803736] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T04:22:33.490200] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-17T04:22:34.172315] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T04:22:34.290251] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-17T04:22:34.572141] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T04:22:34.818187] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T04:22:35.090186] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-17T04:22:35.890287] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-17T04:22:36.561356] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T04:22:36.690232] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-17T04:22:36.907392] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T04:22:37.490119] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-17T04:22:37.754948] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T04:22:38.290357] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-17T04:22:39.090137] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-17T04:22:39.237391] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T04:22:39.275223] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T04:22:39.843498] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T04:22:39.890185] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-17T04:22:40.690194] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-17T04:22:41.418861] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T04:22:41.490171] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-17T04:22:41.733952] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T04:22:42.290173] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-17T04:22:42.328146] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T04:22:43.090201] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-17T04:22:43.890226] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-17T04:22:44.069442] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T04:22:44.092595] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T04:22:44.370115] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T04:22:44.690210] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-17T04:22:45.490220] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-17T04:22:46.290224] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-17T04:22:46.490450] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T04:22:46.497714] [INFO ] [REMOTE ] ICE: Full fetch complete (76584 records). [2025-09-17T04:22:46.497987] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-17T04:22:46.863957] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T04:22:46.907967] [INFO ] [REMOTE ] IDE: Full fetch complete (12722 records). [2025-09-17T04:22:46.945330] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-17T04:22:46.949910] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-17T04:22:46.956109] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-17T04:22:46.972765] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-17T04:22:46.983853] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-17T04:22:47.054161] [DEBUG] [LOCAL ] ICE: Trimmed 76584 records to 53026 (keeping 200 days of data) [2025-09-17T04:22:47.093427] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-17T04:22:47.432359] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T04:22:47.566157] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-17T04:22:47.566377] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-17T04:22:47.567079] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-17T04:22:47.567183] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-17T04:22:47.639934] [DEBUG] [LOCAL ] IDE: Trimmed 12722 records to 8366 (keeping 200 days of data) [2025-09-17T04:22:47.732343] [DEBUG] [LOCAL ] IDE: Primary data saved (8366 records). [2025-09-17T04:22:47.735121] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-17T04:22:47.736902] [INFO ] [MAIN ] Update Progress: 1086/2369 symbols completed. IDE took 30.7s. Estimated remaining: 3h 7m 28s. Rate: 6.8 symbols/min [2025-09-17T04:22:47.894871] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-17T04:22:47.962495] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:48.072858] [DEBUG] [LOCAL ] IEX: Loaded 28751 existing records from primary storage. [2025-09-17T04:22:48.074787] [INFO ] [MAIN ] IEX: Loaded 28751 existing records. [2025-09-17T04:22:48.290095] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:48.292877] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-17T04:22:48.293994] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-17T04:22:48.297598] [DEBUG] [LOCAL ] ICE: Primary data saved (53026 records). [2025-09-17T04:22:48.297634] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-17T04:22:48.298099] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-17T04:22:48.298239] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-17T04:22:48.298421] [INFO ] [MAIN ] Update Progress: 1087/2369 symbols completed. ICE took 45.1s. Estimated remaining: 3h 7m 10s. Rate: 6.8 symbols/min [2025-09-17T04:22:48.622900] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:48.780425] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T04:22:48.814719] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-17T04:22:48.911989] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:48.925946] [DEBUG] [LOCAL ] IFF: Loaded 37927 existing records from primary storage. [2025-09-17T04:22:48.926131] [INFO ] [MAIN ] IFF: Loaded 37927 existing records. [2025-09-17T04:22:49.110086] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:49.110468] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-17T04:22:49.110544] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-17T04:22:49.111438] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-17T04:22:49.111523] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-17T04:22:49.502794] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-11. [2025-09-17T04:22:49.514394] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:49.526369] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T04:22:49.918506] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T04:22:50.290199] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-17T04:22:50.928722] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:22:51.088720] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T04:22:51.092302] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-11. [2025-09-17T04:22:51.094459] [INFO ] [REMOTE ] IDA: Full fetch complete (44617 records). [2025-09-17T04:22:51.094584] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-17T04:22:51.501380] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-17T04:22:51.501534] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-17T04:22:51.502381] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-17T04:22:51.502441] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-17T04:22:51.503575] [DEBUG] [LOCAL ] IDA: Trimmed 44617 records to 32109 (keeping 200 days of data) [2025-09-17T04:22:51.728471] [DEBUG] [LOCAL ] IDA: Primary data saved (32109 records). [2025-09-17T04:22:51.728744] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-17T04:22:51.728861] [INFO ] [MAIN ] Update Progress: 1088/2369 symbols completed. IDA took 37.7s. Estimated remaining: 3h 6m 55s. Rate: 6.9 symbols/min [2025-09-17T04:22:51.890283] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-17T04:22:51.909907] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:22:51.929925] [DEBUG] [LOCAL ] IFN: Loaded 13709 existing records from primary storage. [2025-09-17T04:22:51.930142] [INFO ] [MAIN ] IFN: Loaded 13709 existing records. [2025-09-17T04:22:52.131278] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:22:52.131662] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-17T04:22:52.131733] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-17T04:22:52.132230] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-17T04:22:52.132293] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-17T04:22:52.503865] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:22:52.690252] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-11. [2025-09-17T04:22:53.214279] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:22:53.452544] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T04:22:53.490189] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-17T04:22:54.290171] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-17T04:22:54.627186] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T04:22:55.090215] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-17T04:22:55.368446] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T04:22:55.890201] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-17T04:22:56.490274] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T04:22:56.690167] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-17T04:22:56.833378] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-11 (5.74 seconds). [2025-09-17T04:22:57.159970] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T04:22:57.490231] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-17T04:22:58.259899] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:22:58.290140] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-17T04:22:58.916269] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T04:22:59.090193] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-17T04:22:59.670775] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T04:22:59.890191] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-17T04:23:00.690250] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-17T04:23:01.490240] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-17T04:23:04.234360] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (4.34 seconds). [2025-09-17T04:23:04.237494] [INFO ] [REMOTE ] IDT: Full fetch complete (22144 records). [2025-09-17T04:23:04.237624] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-17T04:23:04.548992] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (5.46 seconds). [2025-09-17T04:23:04.615686] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-17T04:23:04.643579] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-17T04:23:04.643738] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-17T04:23:04.645611] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-17T04:23:04.646111] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-17T04:23:04.672947] [DEBUG] [LOCAL ] IDT: Trimmed 22144 records to 17424 (keeping 200 days of data) [2025-09-17T04:23:04.675313] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (3.19 seconds). [2025-09-17T04:23:04.685705] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-17T04:23:04.795394] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (4.11 seconds). [2025-09-17T04:23:04.821163] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-17T04:23:04.837719] [DEBUG] [LOCAL ] IDT: Primary data saved (17424 records). [2025-09-17T04:23:04.837891] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-17T04:23:04.838011] [INFO ] [MAIN ] Update Progress: 1089/2369 symbols completed. IDT took 36.5s. Estimated remaining: 3h 6m 51s. Rate: 6.9 symbols/min [2025-09-17T04:23:05.010304] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:05.028483] [DEBUG] [LOCAL ] IFS: Loaded 16478 existing records from primary storage. [2025-09-17T04:23:05.028707] [INFO ] [MAIN ] IFS: Loaded 16478 existing records. [2025-09-17T04:23:05.202828] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:05.203152] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-17T04:23:05.203212] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-17T04:23:05.203735] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-17T04:23:05.203793] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-17T04:23:05.552528] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:05.552921] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-11. [2025-09-17T04:23:05.695239] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T04:23:05.700152] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-17T04:23:06.325037] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T04:23:06.335383] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-17T04:23:06.568196] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T04:23:06.659275] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T04:23:07.090174] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-17T04:23:07.867933] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (3.18 seconds). [2025-09-17T04:23:07.895206] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-17T04:23:07.911501] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T04:23:08.076677] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T04:23:08.671911] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:23:08.690117] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-17T04:23:09.490163] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-17T04:23:09.789891] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T04:23:10.290153] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-17T04:23:11.015721] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T04:23:11.085458] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T04:23:11.092418] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-17T04:23:11.890198] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-17T04:23:12.690194] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-17T04:23:12.903082] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T04:23:13.490219] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-17T04:23:14.225297] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (3.13 seconds). [2025-09-17T04:23:14.290425] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-17T04:23:14.498577] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T04:23:15.090170] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-17T04:23:15.183222] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-17T04:23:15.297490] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T04:23:15.300129] [INFO ] [REMOTE ] IFN: Full fetch complete (28893 records). [2025-09-17T04:23:15.300236] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-17T04:23:15.667282] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-17T04:23:15.667406] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-17T04:23:15.668077] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-17T04:23:15.668134] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-17T04:23:15.669416] [DEBUG] [LOCAL ] IFN: Trimmed 28893 records to 18414 (keeping 200 days of data) [2025-09-17T04:23:15.785921] [DEBUG] [LOCAL ] IFN: Primary data saved (18414 records). [2025-09-17T04:23:15.786131] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-17T04:23:15.786237] [INFO ] [MAIN ] Update Progress: 1090/2369 symbols completed. IFN took 24.1s. Estimated remaining: 3h 6m 45s. Rate: 6.8 symbols/min [2025-09-17T04:23:15.895355] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-17T04:23:15.961858] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:15.972186] [DEBUG] [LOCAL ] IGA: Loaded 7019 existing records from primary storage. [2025-09-17T04:23:15.972422] [INFO ] [MAIN ] IGA: Loaded 7019 existing records. [2025-09-17T04:23:16.165812] [WARN ] [MAIN ] IGA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:16.166154] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-17T04:23:16.166215] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-17T04:23:16.166588] [DEBUG] [LOCAL ] IGA: Deleted primary data file. [2025-09-17T04:23:16.166678] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-17T04:23:16.553904] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T04:23:16.557555] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:16.690095] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-11. [2025-09-17T04:23:17.332669] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T04:23:17.490158] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-17T04:23:17.981436] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T04:23:18.290206] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-17T04:23:18.599978] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T04:23:19.090203] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-17T04:23:19.738519] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T04:23:19.764937] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T04:23:19.890157] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-17T04:23:20.690104] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-17T04:23:21.048499] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T04:23:21.490171] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-17T04:23:22.155014] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T04:23:22.183632] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T04:23:22.290148] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-17T04:23:23.090176] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-17T04:23:23.637450] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T04:23:23.643380] [INFO ] [REMOTE ] IEX: Full fetch complete (52961 records). [2025-09-17T04:23:23.643587] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-17T04:23:23.897070] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-17T04:23:24.043758] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-17T04:23:24.043893] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-17T04:23:24.045139] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-17T04:23:24.045237] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-17T04:23:24.047054] [DEBUG] [LOCAL ] IEX: Trimmed 52961 records to 38334 (keeping 200 days of data) [2025-09-17T04:23:24.302149] [DEBUG] [LOCAL ] IEX: Primary data saved (38334 records). [2025-09-17T04:23:24.302373] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-17T04:23:24.302520] [INFO ] [MAIN ] Update Progress: 1091/2369 symbols completed. IEX took 36.6s. Estimated remaining: 3h 6m 36s. Rate: 6.8 symbols/min [2025-09-17T04:23:24.487022] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:24.518280] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T04:23:24.537762] [DEBUG] [LOCAL ] IGD: Loaded 13912 existing records from primary storage. [2025-09-17T04:23:24.537951] [INFO ] [MAIN ] IGD: Loaded 13912 existing records. [2025-09-17T04:23:24.695220] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-17T04:23:24.728241] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:24.729577] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-17T04:23:24.729678] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-17T04:23:24.730121] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-17T04:23:24.730198] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-17T04:23:25.106206] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:25.122457] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T04:23:25.490147] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-11. [2025-09-17T04:23:25.497949] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T04:23:26.290117] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-17T04:23:26.371557] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T04:23:27.067387] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T04:23:27.090072] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-17T04:23:27.890184] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-17T04:23:27.983520] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T04:23:28.690172] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-17T04:23:28.854762] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T04:23:29.490185] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-17T04:23:29.616190] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T04:23:30.290164] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-17T04:23:30.767594] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:23:31.005099] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T04:23:31.090156] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-17T04:23:31.890193] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-17T04:23:32.082106] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T04:23:32.690156] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-17T04:23:33.003174] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T04:23:33.406527] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T04:23:33.490164] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-17T04:23:33.593275] [DEBUG] [REMOTE ] IGA: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-17T04:23:33.593740] [WARN ] [REMOTE ] IGA: No data returned for month 2025-07 [2025-09-17T04:23:34.290199] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-17T04:23:35.063069] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T04:23:35.090162] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-17T04:23:35.890188] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-17T04:23:36.189028] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T04:23:36.690227] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-17T04:23:37.482303] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T04:23:37.484457] [INFO ] [REMOTE ] IGA: Full fetch complete (11531 records). [2025-09-17T04:23:37.484633] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-17T04:23:37.496175] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-17T04:23:37.681246] [WARN ] [VALIDATOR ] IGA: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-17T04:23:37.681708] [FATAL] [MAIN ] IGA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:23:37.682147] [WARN ] [MAIN ] IGA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:23:37.682261] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-17T04:23:37.682532] [DEBUG] [LOCAL ] IGA: No primary data file found to delete. [2025-09-17T04:23:37.682603] [INFO ] [LOCAL ] IGA: Starting deletion of derivative data. [2025-09-17T04:23:37.701576] [DEBUG] [LOCAL ] IGA: Deleted derivative data file. [2025-09-17T04:23:37.717226] [INFO ] [MAIN ] Update Progress: 1092/2369 symbols completed. IGA took 21.9s. Estimated remaining: 3h 6m 32s. Rate: 6.8 symbols/min [2025-09-17T04:23:37.789074] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T04:23:37.910674] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:37.916518] [DEBUG] [LOCAL ] IGI: Loaded 2729 existing records from primary storage. [2025-09-17T04:23:37.916671] [INFO ] [MAIN ] IGI: Loaded 2729 existing records. [2025-09-17T04:23:38.098437] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:38.098778] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-17T04:23:38.098847] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-17T04:23:38.099214] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-17T04:23:38.099282] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-17T04:23:38.295331] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-17T04:23:38.477752] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:38.642431] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T04:23:39.090200] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-11. [2025-09-17T04:23:39.574265] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T04:23:39.890161] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-17T04:23:40.279462] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T04:23:40.466992] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T04:23:40.690168] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-17T04:23:41.490166] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-17T04:23:41.946224] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T04:23:42.234055] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T04:23:42.240604] [INFO ] [REMOTE ] IFF: Full fetch complete (72452 records). [2025-09-17T04:23:42.240845] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-17T04:23:42.295926] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-17T04:23:42.651442] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-17T04:23:42.651612] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-17T04:23:42.653125] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-17T04:23:42.653190] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-17T04:23:42.655114] [DEBUG] [LOCAL ] IFF: Trimmed 72452 records to 50928 (keeping 200 days of data) [2025-09-17T04:23:42.763266] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T04:23:42.985334] [DEBUG] [LOCAL ] IFF: Primary data saved (50928 records). [2025-09-17T04:23:42.985530] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-17T04:23:42.985704] [INFO ] [MAIN ] Update Progress: 1093/2369 symbols completed. IFF took 54.7s. Estimated remaining: 3h 6m 20s. Rate: 6.8 symbols/min [2025-09-17T04:23:43.095179] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-17T04:23:43.156581] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:43.179482] [DEBUG] [LOCAL ] IGR: Loaded 22600 existing records from primary storage. [2025-09-17T04:23:43.179682] [INFO ] [MAIN ] IGR: Loaded 22600 existing records. [2025-09-17T04:23:43.354607] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:43.354896] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-17T04:23:43.355015] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-17T04:23:43.355719] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-17T04:23:43.355781] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-17T04:23:43.721605] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:43.726199] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T04:23:43.890145] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-17T04:23:44.690166] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-17T04:23:44.914399] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T04:23:45.002173] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.31 seconds). [2025-09-17T04:23:45.490169] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-17T04:23:46.290151] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-11. [2025-09-17T04:23:46.466767] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T04:23:46.470091] [INFO ] [REMOTE ] IFS: Full fetch complete (31063 records). [2025-09-17T04:23:46.470202] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-17T04:23:46.835241] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-17T04:23:46.835359] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-17T04:23:46.836002] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-17T04:23:46.836070] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-17T04:23:46.836946] [DEBUG] [LOCAL ] IFS: Trimmed 31063 records to 22964 (keeping 200 days of data) [2025-09-17T04:23:46.997240] [DEBUG] [LOCAL ] IFS: Primary data saved (22964 records). [2025-09-17T04:23:46.997594] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-17T04:23:46.997776] [INFO ] [MAIN ] Update Progress: 1094/2369 symbols completed. IFS took 42.2s. Estimated remaining: 3h 6m 5s. Rate: 6.9 symbols/min [2025-09-17T04:23:47.100489] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-17T04:23:47.175284] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:47.181148] [DEBUG] [LOCAL ] IH: Loaded 2033 existing records from primary storage. [2025-09-17T04:23:47.181248] [INFO ] [MAIN ] IH: Loaded 2033 existing records. [2025-09-17T04:23:47.355535] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:47.355854] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-17T04:23:47.355914] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-17T04:23:47.356151] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-17T04:23:47.356252] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-17T04:23:47.697135] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T04:23:47.770468] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:47.793012] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T04:23:47.890097] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-11. [2025-09-17T04:23:48.410109] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T04:23:48.690417] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-17T04:23:49.490230] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-17T04:23:50.045477] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T04:23:50.113211] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T04:23:50.290224] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-17T04:23:51.090203] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-17T04:23:51.659291] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T04:23:51.890166] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-17T04:23:51.986812] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T04:23:52.690201] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-17T04:23:53.217181] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T04:23:53.263223] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T04:23:53.490189] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-17T04:23:54.290196] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-17T04:23:54.787992] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T04:23:54.861436] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T04:23:55.090175] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-17T04:23:55.890241] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-17T04:23:56.123339] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T04:23:56.397787] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T04:23:56.399166] [INFO ] [REMOTE ] IGI: Full fetch complete (5199 records). [2025-09-17T04:23:56.399272] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-17T04:23:56.697838] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-17T04:23:56.790061] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-17T04:23:56.790228] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-17T04:23:56.790561] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-17T04:23:56.790665] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-17T04:23:56.791311] [DEBUG] [LOCAL ] IGI: Trimmed 5199 records to 3770 (keeping 200 days of data) [2025-09-17T04:23:56.816652] [DEBUG] [LOCAL ] IGI: Primary data saved (3770 records). [2025-09-17T04:23:56.816865] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-17T04:23:56.817023] [INFO ] [MAIN ] Update Progress: 1095/2369 symbols completed. IGI took 19.1s. Estimated remaining: 3h 5m 58s. Rate: 6.9 symbols/min [2025-09-17T04:23:56.999013] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:23:57.011473] [DEBUG] [LOCAL ] IHD: Loaded 5213 existing records from primary storage. [2025-09-17T04:23:57.011714] [INFO ] [MAIN ] IHD: Loaded 5213 existing records. [2025-09-17T04:23:57.207779] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:23:57.208538] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T04:23:57.210222] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-17T04:23:57.210306] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-17T04:23:57.210775] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-17T04:23:57.210868] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-17T04:23:57.495272] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-17T04:23:57.606818] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:23:57.993681] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T04:23:58.290162] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-17T04:23:59.090150] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-17T04:23:59.352599] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T04:23:59.774812] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T04:23:59.890159] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-11. [2025-09-17T04:24:00.635439] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T04:24:00.690216] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-17T04:24:01.490206] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-17T04:24:02.172113] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T04:24:02.290145] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-17T04:24:02.774893] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T04:24:03.090143] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-17T04:24:03.890228] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-17T04:24:04.511380] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-17T04:24:04.555441] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T04:24:04.558853] [INFO ] [REMOTE ] IGD: Full fetch complete (29461 records). [2025-09-17T04:24:04.559012] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-17T04:24:04.698962] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-17T04:24:04.938788] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-17T04:24:04.946139] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-17T04:24:04.947744] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-17T04:24:04.948082] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T04:24:04.951497] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-17T04:24:04.952303] [DEBUG] [LOCAL ] IGD: Trimmed 29461 records to 19381 (keeping 200 days of data) [2025-09-17T04:24:05.070452] [DEBUG] [LOCAL ] IGD: Primary data saved (19381 records). [2025-09-17T04:24:05.070700] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-17T04:24:05.070850] [INFO ] [MAIN ] Update Progress: 1096/2369 symbols completed. IGD took 40.8s. Estimated remaining: 3h 5m 48s. Rate: 6.9 symbols/min [2025-09-17T04:24:05.241325] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:05.260883] [DEBUG] [LOCAL ] IHG: Loaded 17709 existing records from primary storage. [2025-09-17T04:24:05.261097] [INFO ] [MAIN ] IHG: Loaded 17709 existing records. [2025-09-17T04:24:05.454997] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:05.455386] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-17T04:24:05.455456] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-17T04:24:05.456188] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-17T04:24:05.456280] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-17T04:24:05.498339] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-17T04:24:05.819150] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:05.836095] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T04:24:06.290163] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-11. [2025-09-17T04:24:06.331035] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T04:24:07.090142] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-17T04:24:07.387684] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:24:07.831224] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T04:24:07.890176] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-17T04:24:08.690224] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-17T04:24:08.931982] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T04:24:09.490136] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-17T04:24:09.661803] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T04:24:10.290187] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-17T04:24:10.901779] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T04:24:11.090172] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-17T04:24:11.441896] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T04:24:11.890169] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-17T04:24:12.390233] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T04:24:12.618240] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T04:24:12.690163] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-17T04:24:13.118866] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T04:24:13.490158] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-17T04:24:14.080463] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T04:24:14.290202] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-17T04:24:15.090117] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-17T04:24:15.439300] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T04:24:15.853678] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T04:24:15.890116] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-17T04:24:16.690184] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-17T04:24:17.004304] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T04:24:17.490154] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-17T04:24:18.031278] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T04:24:18.290153] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-17T04:24:18.654862] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T04:24:19.014421] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T04:24:19.090143] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-17T04:24:19.472812] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T04:24:19.890154] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-17T04:24:20.690170] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-17T04:24:21.034536] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T04:24:21.039158] [INFO ] [REMOTE ] IGR: Full fetch complete (45891 records). [2025-09-17T04:24:21.039352] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-17T04:24:21.436887] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T04:24:21.456390] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-17T04:24:21.456160] [INFO ] [REMOTE ] IHD: Full fetch complete (11998 records). [2025-09-17T04:24:21.456935] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-17T04:24:21.456812] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-17T04:24:21.458123] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-17T04:24:21.458384] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-17T04:24:21.490458] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-17T04:24:21.563164] [DEBUG] [LOCAL ] IGR: Trimmed 45891 records to 30578 (keeping 200 days of data) [2025-09-17T04:24:21.927148] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-17T04:24:21.928465] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-17T04:24:21.930283] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-17T04:24:21.931030] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-17T04:24:21.933457] [DEBUG] [LOCAL ] IHD: Trimmed 11998 records to 7200 (keeping 200 days of data) [2025-09-17T04:24:21.972864] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T04:24:21.996386] [DEBUG] [LOCAL ] IHD: Primary data saved (7200 records). [2025-09-17T04:24:21.997937] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-17T04:24:21.998831] [INFO ] [MAIN ] Update Progress: 1097/2369 symbols completed. IHD took 25.2s. Estimated remaining: 3h 5m 49s. Rate: 6.8 symbols/min [2025-09-17T04:24:22.230446] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:22.274975] [DEBUG] [LOCAL ] IGR: Primary data saved (30578 records). [2025-09-17T04:24:22.272902] [DEBUG] [LOCAL ] IHS: Loaded 29352 existing records from primary storage. [2025-09-17T04:24:22.275314] [INFO ] [MAIN ] IHS: Loaded 29352 existing records. [2025-09-17T04:24:22.295904] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-17T04:24:22.275190] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-17T04:24:22.320162] [INFO ] [MAIN ] Update Progress: 1098/2369 symbols completed. IGR took 39.3s. Estimated remaining: 3h 5m 31s. Rate: 6.9 symbols/min [2025-09-17T04:24:22.581078] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:22.596815] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-17T04:24:22.642467] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:22.639984] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-17T04:24:22.643458] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-17T04:24:22.643568] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-17T04:24:22.751135] [DEBUG] [LOCAL ] IIF: Loaded 4047 existing records from primary storage. [2025-09-17T04:24:22.753994] [INFO ] [MAIN ] IIF: Loaded 4047 existing records. [2025-09-17T04:24:23.093814] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-17T04:24:23.140318] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:23.168194] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-17T04:24:23.168057] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T04:24:23.212791] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-17T04:24:23.244684] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:23.245212] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-17T04:24:23.245325] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-17T04:24:23.618426] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:23.890146] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-17T04:24:24.496456] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T04:24:24.524521] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T04:24:24.690147] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-17T04:24:25.490166] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-11. [2025-09-17T04:24:25.975276] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T04:24:26.290216] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-17T04:24:26.783813] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:24:26.906683] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T04:24:26.907766] [INFO ] [REMOTE ] IH: Full fetch complete (4901 records). [2025-09-17T04:24:26.907867] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-17T04:24:27.100063] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-17T04:24:27.284487] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-17T04:24:27.284675] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-17T04:24:27.284924] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-17T04:24:27.284979] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-17T04:24:27.285418] [DEBUG] [LOCAL ] IH: Trimmed 4901 records to 3612 (keeping 200 days of data) [2025-09-17T04:24:27.306913] [DEBUG] [LOCAL ] IH: Primary data saved (3612 records). [2025-09-17T04:24:27.307038] [INFO ] [MAIN ] IH: Full history saved. [2025-09-17T04:24:27.307142] [INFO ] [MAIN ] Update Progress: 1099/2369 symbols completed. IH took 40.3s. Estimated remaining: 3h 5m 17s. Rate: 6.9 symbols/min [2025-09-17T04:24:27.484415] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:27.498706] [DEBUG] [LOCAL ] IIIN: Loaded 11751 existing records from primary storage. [2025-09-17T04:24:27.498887] [INFO ] [MAIN ] IIIN: Loaded 11751 existing records. [2025-09-17T04:24:27.691111] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:27.691470] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-17T04:24:27.691542] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-17T04:24:27.692145] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-17T04:24:27.692214] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-17T04:24:27.895392] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-17T04:24:28.076295] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:28.489167] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T04:24:28.690232] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-17T04:24:29.218806] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T04:24:29.490157] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-17T04:24:29.838179] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T04:24:30.290168] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-11. [2025-09-17T04:24:30.452779] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T04:24:31.020675] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T04:24:31.090159] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-17T04:24:31.890220] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-17T04:24:32.198310] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T04:24:32.690155] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-11. [2025-09-17T04:24:32.878505] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T04:24:33.164848] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T04:24:33.490151] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-17T04:24:34.212157] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T04:24:34.290239] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-17T04:24:35.078397] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T04:24:35.090093] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-17T04:24:35.801203] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T04:24:35.890095] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-17T04:24:36.535090] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T04:24:36.690188] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-17T04:24:37.490105] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-17T04:24:37.834877] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T04:24:38.290158] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-17T04:24:38.571181] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T04:24:39.090196] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-17T04:24:39.715384] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T04:24:39.752842] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T04:24:39.890213] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-17T04:24:40.690150] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-17T04:24:40.938505] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T04:24:40.942090] [INFO ] [REMOTE ] IHG: Full fetch complete (33374 records). [2025-09-17T04:24:40.942250] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-17T04:24:41.483382] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-17T04:24:41.483791] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T04:24:41.484024] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-17T04:24:41.490851] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-17T04:24:41.490597] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-17T04:24:41.492451] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-17T04:24:41.494942] [DEBUG] [LOCAL ] IHG: Trimmed 33374 records to 24896 (keeping 200 days of data) [2025-09-17T04:24:41.750072] [DEBUG] [LOCAL ] IHG: Primary data saved (24896 records). [2025-09-17T04:24:41.751858] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-17T04:24:41.752016] [INFO ] [MAIN ] Update Progress: 1100/2369 symbols completed. IHG took 36.7s. Estimated remaining: 3h 5m 15s. Rate: 6.9 symbols/min [2025-09-17T04:24:42.007914] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:42.026190] [DEBUG] [LOCAL ] IIM: Loaded 11438 existing records from primary storage. [2025-09-17T04:24:42.026448] [INFO ] [MAIN ] IIM: Loaded 11438 existing records. [2025-09-17T04:24:42.290477] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-17T04:24:42.322770] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:42.323068] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-17T04:24:42.323156] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-17T04:24:42.323733] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-17T04:24:42.323829] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-17T04:24:42.649760] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T04:24:42.742525] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:42.934484] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T04:24:43.090178] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-17T04:24:43.799854] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T04:24:43.890145] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-17T04:24:44.535482] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T04:24:44.690216] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-17T04:24:45.175209] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T04:24:45.176307] [INFO ] [REMOTE ] IIF: Full fetch complete (9702 records). [2025-09-17T04:24:45.176394] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-17T04:24:45.500530] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-17T04:24:45.543523] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-17T04:24:45.543637] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-17T04:24:45.543959] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-17T04:24:45.544009] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-17T04:24:45.544536] [DEBUG] [LOCAL ] IIF: Trimmed 9702 records to 5891 (keeping 200 days of data) [2025-09-17T04:24:45.583371] [DEBUG] [LOCAL ] IIF: Primary data saved (5891 records). [2025-09-17T04:24:45.583598] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-17T04:24:45.583732] [INFO ] [MAIN ] Update Progress: 1101/2369 symbols completed. IIF took 23.2s. Estimated remaining: 3h 5m 1s. Rate: 6.9 symbols/min [2025-09-17T04:24:45.761601] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:24:45.785741] [DEBUG] [LOCAL ] IIPR: Loaded 20792 existing records from primary storage. [2025-09-17T04:24:45.785995] [INFO ] [MAIN ] IIPR: Loaded 20792 existing records. [2025-09-17T04:24:45.973822] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:24:45.974209] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-17T04:24:45.974276] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-17T04:24:45.975166] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-17T04:24:45.975270] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-17T04:24:46.295301] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-11. [2025-09-17T04:24:46.353119] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:24:46.620279] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T04:24:47.082206] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T04:24:47.090006] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-17T04:24:47.890166] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-17T04:24:48.098086] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T04:24:48.667023] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T04:24:48.690099] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-17T04:24:49.490189] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-17T04:24:49.739093] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T04:24:50.290145] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-11. [2025-09-17T04:24:50.402201] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T04:24:51.090211] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-17T04:24:51.637178] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T04:24:51.890164] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-17T04:24:52.017950] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T04:24:52.690212] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-17T04:24:53.366995] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T04:24:53.490151] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-17T04:24:54.091607] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T04:24:54.290168] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-17T04:24:54.970735] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T04:24:55.090155] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-17T04:24:55.895215] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-17T04:24:55.914720] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T04:24:56.348482] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T04:24:56.690089] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-17T04:24:56.971223] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T04:24:57.490128] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-17T04:24:58.206844] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T04:24:58.290188] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-17T04:24:58.472767] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T04:24:59.090172] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-17T04:24:59.501051] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T04:24:59.890204] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-17T04:25:00.285706] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T04:25:00.690163] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-17T04:25:01.064943] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T04:25:01.490175] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-17T04:25:01.705579] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T04:25:02.290179] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-17T04:25:02.567786] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T04:25:03.090248] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-17T04:25:03.147726] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T04:25:03.149917] [INFO ] [REMOTE ] IIIN: Full fetch complete (25247 records). [2025-09-17T04:25:03.150063] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-17T04:25:03.532634] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-17T04:25:03.532805] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-17T04:25:03.533524] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-17T04:25:03.533614] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-17T04:25:03.534600] [DEBUG] [LOCAL ] IIIN: Trimmed 25247 records to 16995 (keeping 200 days of data) [2025-09-17T04:25:03.645354] [DEBUG] [LOCAL ] IIIN: Primary data saved (16995 records). [2025-09-17T04:25:03.645571] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-17T04:25:03.645709] [INFO ] [MAIN ] Update Progress: 1102/2369 symbols completed. IIIN took 36.3s. Estimated remaining: 3h 5m 3s. Rate: 6.8 symbols/min [2025-09-17T04:25:03.822761] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:03.857626] [DEBUG] [LOCAL ] IMAX: Loaded 31866 existing records from primary storage. [2025-09-17T04:25:03.857902] [INFO ] [MAIN ] IMAX: Loaded 31866 existing records. [2025-09-17T04:25:03.895554] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-17T04:25:04.066290] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:04.066661] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-17T04:25:04.066725] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-17T04:25:04.067596] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-17T04:25:04.067688] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-17T04:25:04.372457] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T04:25:04.451449] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:04.690146] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-11. [2025-09-17T04:25:05.245255] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T04:25:05.490189] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-17T04:25:06.112483] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T04:25:06.290176] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-17T04:25:06.378348] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T04:25:07.090216] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-17T04:25:07.738553] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:25:07.890194] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-17T04:25:08.555465] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T04:25:08.690143] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-17T04:25:08.908898] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T04:25:09.490199] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-17T04:25:09.853722] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T04:25:10.290154] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-17T04:25:10.428636] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T04:25:11.090211] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-17T04:25:11.677782] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T04:25:11.683169] [INFO ] [REMOTE ] IHS: Full fetch complete (52576 records). [2025-09-17T04:25:11.683358] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-17T04:25:11.897588] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-17T04:25:11.948259] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T04:25:12.107746] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-17T04:25:12.107888] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-17T04:25:12.108751] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-17T04:25:12.108813] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-17T04:25:12.110235] [DEBUG] [LOCAL ] IHS: Trimmed 52576 records to 39153 (keeping 200 days of data) [2025-09-17T04:25:12.348030] [DEBUG] [LOCAL ] IHS: Primary data saved (39153 records). [2025-09-17T04:25:12.348258] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-17T04:25:12.348408] [INFO ] [MAIN ] Update Progress: 1103/2369 symbols completed. IHS took 50.3s. Estimated remaining: 3h 4m 54s. Rate: 6.8 symbols/min [2025-09-17T04:25:12.524572] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:12.570707] [DEBUG] [LOCAL ] INFA: Loaded 37288 existing records from primary storage. [2025-09-17T04:25:12.570943] [INFO ] [MAIN ] INFA: Loaded 37288 existing records. [2025-09-17T04:25:12.695347] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-17T04:25:12.764168] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:12.764479] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-17T04:25:12.764542] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-17T04:25:12.766021] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-17T04:25:12.766094] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-17T04:25:13.140772] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:13.250964] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T04:25:13.490167] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-11. [2025-09-17T04:25:13.735357] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T04:25:14.290135] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-17T04:25:15.058805] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T04:25:15.090124] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-17T04:25:15.272085] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T04:25:15.275127] [INFO ] [REMOTE ] IIM: Full fetch complete (25434 records). [2025-09-17T04:25:15.275262] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-17T04:25:15.653155] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-17T04:25:15.653305] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-17T04:25:15.653946] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-17T04:25:15.654006] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-17T04:25:15.655262] [DEBUG] [LOCAL ] IIM: Trimmed 25434 records to 15974 (keeping 200 days of data) [2025-09-17T04:25:15.755991] [DEBUG] [LOCAL ] IIM: Primary data saved (15974 records). [2025-09-17T04:25:15.756175] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-17T04:25:15.756274] [INFO ] [MAIN ] Update Progress: 1104/2369 symbols completed. IIM took 34.0s. Estimated remaining: 3h 4m 39s. Rate: 6.9 symbols/min [2025-09-17T04:25:15.895243] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-17T04:25:15.947608] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:15.991496] [DEBUG] [LOCAL ] INFY: Loaded 39957 existing records from primary storage. [2025-09-17T04:25:15.991759] [INFO ] [MAIN ] INFY: Loaded 39957 existing records. [2025-09-17T04:25:16.187099] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:16.187421] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-17T04:25:16.187483] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-17T04:25:16.188545] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-17T04:25:16.188621] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-17T04:25:16.559045] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:16.582362] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T04:25:16.690094] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-17T04:25:17.490135] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-11. [2025-09-17T04:25:17.604220] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T04:25:18.290147] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-17T04:25:18.321595] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T04:25:19.090143] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-17T04:25:19.223760] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T04:25:19.287998] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T04:25:19.890196] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-17T04:25:20.369577] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:25:20.690241] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-17T04:25:21.490171] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-17T04:25:21.734787] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T04:25:21.770506] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T04:25:22.290173] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-17T04:25:22.957074] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T04:25:23.090158] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-17T04:25:23.890225] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-17T04:25:24.038993] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T04:25:24.393431] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T04:25:24.397412] [INFO ] [REMOTE ] IIPR: Full fetch complete (43778 records). [2025-09-17T04:25:24.397601] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-17T04:25:24.698794] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-17T04:25:24.839167] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-17T04:25:24.839302] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-17T04:25:24.840228] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-17T04:25:24.840300] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-17T04:25:24.841416] [DEBUG] [LOCAL ] IIPR: Trimmed 43778 records to 29629 (keeping 200 days of data) [2025-09-17T04:25:25.036329] [DEBUG] [LOCAL ] IIPR: Primary data saved (29629 records). [2025-09-17T04:25:25.036508] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-17T04:25:25.036609] [INFO ] [MAIN ] Update Progress: 1105/2369 symbols completed. IIPR took 39.5s. Estimated remaining: 3h 4m 31s. Rate: 6.9 symbols/min [2025-09-17T04:25:25.213779] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:25.256215] [DEBUG] [LOCAL ] ING: Loaded 37640 existing records from primary storage. [2025-09-17T04:25:25.256424] [INFO ] [MAIN ] ING: Loaded 37640 existing records. [2025-09-17T04:25:25.439857] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:25.440152] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-17T04:25:25.440213] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-17T04:25:25.441266] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-17T04:25:25.441337] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-17T04:25:25.508025] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-17T04:25:25.816454] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:25.845932] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-17T04:25:26.290165] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-17T04:25:26.436971] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T04:25:26.999069] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T04:25:27.090124] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-17T04:25:27.890174] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-11. [2025-09-17T04:25:28.014490] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T04:25:28.646374] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T04:25:28.690161] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-17T04:25:29.490151] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-17T04:25:29.610094] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T04:25:29.829578] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T04:25:30.290172] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-17T04:25:31.090186] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-17T04:25:31.354326] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T04:25:31.895216] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-17T04:25:31.914483] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T04:25:32.574842] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T04:25:32.580332] [INFO ] [REMOTE ] IMAX: Full fetch complete (59277 records). [2025-09-17T04:25:32.580500] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-17T04:25:32.695300] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-17T04:25:32.980170] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-17T04:25:32.980297] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-17T04:25:32.981434] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-17T04:25:32.981562] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-17T04:25:32.983089] [DEBUG] [LOCAL ] IMAX: Trimmed 59277 records to 42625 (keeping 200 days of data) [2025-09-17T04:25:33.253576] [DEBUG] [LOCAL ] IMAX: Primary data saved (42625 records). [2025-09-17T04:25:33.253785] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-17T04:25:33.253900] [INFO ] [MAIN ] Update Progress: 1106/2369 symbols completed. IMAX took 29.6s. Estimated remaining: 3h 4m 21s. Rate: 6.9 symbols/min [2025-09-17T04:25:33.424259] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:33.444549] [DEBUG] [LOCAL ] INGM: Loaded 20171 existing records from primary storage. [2025-09-17T04:25:33.444760] [INFO ] [MAIN ] INGM: Loaded 20171 existing records. [2025-09-17T04:25:33.499269] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-17T04:25:33.654016] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:33.654553] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-17T04:25:33.654627] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-17T04:25:33.655428] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-17T04:25:33.655507] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-17T04:25:34.071276] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:34.074448] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-17T04:25:34.120303] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T04:25:34.290156] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-17T04:25:35.090175] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-11. [2025-09-17T04:25:35.331664] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T04:25:35.902701] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-17T04:25:35.931921] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T04:25:36.392721] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T04:25:36.690205] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-17T04:25:37.466371] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T04:25:37.490081] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-17T04:25:38.290173] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-17T04:25:38.414015] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T04:25:39.044351] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T04:25:39.090110] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-17T04:25:39.248701] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T04:25:39.890223] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-17T04:25:40.690162] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-17T04:25:40.799144] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T04:25:40.920177] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T04:25:41.490224] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-17T04:25:42.290198] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-17T04:25:42.622394] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T04:25:43.030875] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T04:25:43.038144] [INFO ] [REMOTE ] INFA: Full fetch complete (71855 records). [2025-09-17T04:25:43.038329] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-17T04:25:43.102975] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-17T04:25:43.367207] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:25:43.471911] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-17T04:25:43.472066] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-17T04:25:43.473180] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-17T04:25:43.473280] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-17T04:25:43.479123] [DEBUG] [LOCAL ] INFA: Trimmed 71855 records to 50208 (keeping 200 days of data) [2025-09-17T04:25:43.800760] [DEBUG] [LOCAL ] INFA: Primary data saved (50208 records). [2025-09-17T04:25:43.800964] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-17T04:25:43.801062] [INFO ] [MAIN ] Update Progress: 1107/2369 symbols completed. INFA took 31.5s. Estimated remaining: 3h 4m 15s. Rate: 6.8 symbols/min [2025-09-17T04:25:43.895787] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-17T04:25:43.983036] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:44.007473] [DEBUG] [LOCAL ] INGR: Loaded 24186 existing records from primary storage. [2025-09-17T04:25:44.007714] [INFO ] [MAIN ] INGR: Loaded 24186 existing records. [2025-09-17T04:25:44.184660] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:44.184943] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-17T04:25:44.185007] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-17T04:25:44.185781] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-17T04:25:44.185854] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-17T04:25:44.553062] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:44.690160] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-11. [2025-09-17T04:25:44.891709] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T04:25:45.309615] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T04:25:45.490197] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-17T04:25:46.014117] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T04:25:46.290100] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-17T04:25:46.403137] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T04:25:47.090128] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-17T04:25:47.890212] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-17T04:25:48.216398] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T04:25:48.450954] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T04:25:48.690107] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-17T04:25:49.138938] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T04:25:49.490222] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-17T04:25:50.290157] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-17T04:25:50.383119] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T04:25:50.392885] [INFO ] [REMOTE ] INFY: Full fetch complete (77373 records). [2025-09-17T04:25:50.393096] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-17T04:25:50.796944] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-17T04:25:50.797072] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-17T04:25:50.798132] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-17T04:25:50.798212] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-17T04:25:50.799828] [DEBUG] [LOCAL ] INFY: Trimmed 77373 records to 53598 (keeping 200 days of data) [2025-09-17T04:25:51.091681] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T04:25:51.090714] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-17T04:25:51.204741] [DEBUG] [LOCAL ] INFY: Primary data saved (53598 records). [2025-09-17T04:25:51.204978] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-17T04:25:51.205108] [INFO ] [MAIN ] Update Progress: 1108/2369 symbols completed. INFY took 35.4s. Estimated remaining: 3h 4m 4s. Rate: 6.9 symbols/min [2025-09-17T04:25:51.386085] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:51.419895] [DEBUG] [LOCAL ] INN: Loaded 31561 existing records from primary storage. [2025-09-17T04:25:51.420110] [INFO ] [MAIN ] INN: Loaded 31561 existing records. [2025-09-17T04:25:51.611098] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:51.611506] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-17T04:25:51.611590] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-17T04:25:51.617633] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-17T04:25:51.622885] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-17T04:25:51.679591] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T04:25:51.900377] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-17T04:25:52.020240] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:25:52.515019] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T04:25:52.690149] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-17T04:25:52.879038] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T04:25:53.490214] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-11. [2025-09-17T04:25:53.857370] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T04:25:54.290169] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-17T04:25:54.878821] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T04:25:55.090184] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-17T04:25:55.756700] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T04:25:55.890127] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-17T04:25:55.983425] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T04:25:56.690173] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-17T04:25:57.311041] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T04:25:57.490133] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-17T04:25:58.290159] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-17T04:25:58.527906] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T04:25:58.547726] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T04:25:58.551429] [INFO ] [REMOTE ] INGM: Full fetch complete (42326 records). [2025-09-17T04:25:58.551565] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-17T04:25:58.936989] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-17T04:25:58.937123] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-17T04:25:58.938198] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-17T04:25:58.938281] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-17T04:25:58.939605] [DEBUG] [LOCAL ] INGM: Trimmed 42326 records to 29364 (keeping 200 days of data) [2025-09-17T04:25:59.096475] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-17T04:25:59.134357] [DEBUG] [LOCAL ] INGM: Primary data saved (29364 records). [2025-09-17T04:25:59.134498] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-17T04:25:59.134627] [INFO ] [MAIN ] Update Progress: 1109/2369 symbols completed. INGM took 25.9s. Estimated remaining: 3h 3m 55s. Rate: 6.9 symbols/min [2025-09-17T04:25:59.320206] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:25:59.341200] [DEBUG] [LOCAL ] INR: Loaded 19261 existing records from primary storage. [2025-09-17T04:25:59.341397] [INFO ] [MAIN ] INR: Loaded 19261 existing records. [2025-09-17T04:25:59.525084] [WARN ] [MAIN ] INR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:25:59.525632] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-17T04:25:59.525749] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-17T04:25:59.526600] [DEBUG] [LOCAL ] INR: Deleted primary data file. [2025-09-17T04:25:59.526928] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-17T04:25:59.848158] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T04:25:59.895300] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-17T04:25:59.939788] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:00.690189] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-11. [2025-09-17T04:26:00.908441] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:26:00.908915] [WARN ] [REMOTE ] INR: No data returned for month 2024-11 [2025-09-17T04:26:00.973411] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T04:26:01.430606] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T04:26:01.490205] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-17T04:26:01.695820] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:26:01.696310] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-17T04:26:02.290171] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-17T04:26:03.090131] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-17T04:26:03.657058] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T04:26:03.890199] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-17T04:26:04.690161] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-17T04:26:04.962041] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T04:26:05.094451] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-17T04:26:05.244021] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T04:26:05.490179] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-17T04:26:06.290156] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-17T04:26:06.983051] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T04:26:07.090111] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-17T04:26:07.621622] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T04:26:07.890143] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-17T04:26:08.680008] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:26:08.690987] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-17T04:26:09.202508] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T04:26:09.490120] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-17T04:26:09.584156] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T04:26:10.290164] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-17T04:26:10.925975] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T04:26:10.931527] [INFO ] [REMOTE ] INGR: Full fetch complete (49296 records). [2025-09-17T04:26:10.931685] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-17T04:26:11.093829] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-17T04:26:11.317312] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-17T04:26:11.317431] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-17T04:26:11.318149] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-17T04:26:11.318210] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-17T04:26:11.319294] [DEBUG] [LOCAL ] INGR: Trimmed 49296 records to 33338 (keeping 200 days of data) [2025-09-17T04:26:11.537720] [DEBUG] [LOCAL ] INGR: Primary data saved (33338 records). [2025-09-17T04:26:11.537912] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-17T04:26:11.538030] [INFO ] [MAIN ] Update Progress: 1110/2369 symbols completed. INGR took 27.7s. Estimated remaining: 3h 3m 50s. Rate: 6.8 symbols/min [2025-09-17T04:26:11.712169] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T04:26:11.749177] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:11.788781] [DEBUG] [LOCAL ] INSP: Loaded 28015 existing records from primary storage. [2025-09-17T04:26:11.789066] [INFO ] [MAIN ] INSP: Loaded 28015 existing records. [2025-09-17T04:26:11.897239] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-17T04:26:11.983546] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:11.983915] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-17T04:26:11.983991] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-17T04:26:11.984901] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-17T04:26:11.984968] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-17T04:26:12.356870] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:12.507145] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T04:26:12.690148] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-17T04:26:13.490139] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-11. [2025-09-17T04:26:13.525310] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T04:26:13.672504] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T04:26:14.290198] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-17T04:26:14.964026] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T04:26:15.090109] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-17T04:26:15.243898] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T04:26:15.890208] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-17T04:26:16.686197] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T04:26:16.695362] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-17T04:26:16.748381] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T04:26:17.490144] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-17T04:26:18.290219] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-17T04:26:18.435522] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T04:26:18.442792] [INFO ] [REMOTE ] ING: Full fetch complete (73489 records). [2025-09-17T04:26:18.442983] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-17T04:26:18.841310] [DEBUG] [VALIDATOR ] ING: All expected trading days are present. [2025-09-17T04:26:18.841428] [DEBUG] [VALIDATOR ] ING: Primary data validation passed. [2025-09-17T04:26:18.842409] [INFO ] [MAIN ] ING: Fetched primary data is valid. [2025-09-17T04:26:18.842468] [DEBUG] [LOCAL ] ING: Saving primary data. [2025-09-17T04:26:18.844539] [DEBUG] [LOCAL ] ING: Trimmed 73489 records to 50913 (keeping 200 days of data) [2025-09-17T04:26:19.102928] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-17T04:26:19.107913] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T04:26:19.141450] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T04:26:19.231726] [DEBUG] [LOCAL ] ING: Primary data saved (50913 records). [2025-09-17T04:26:19.231946] [INFO ] [MAIN ] ING: Full history saved. [2025-09-17T04:26:19.232079] [INFO ] [MAIN ] Update Progress: 1111/2369 symbols completed. ING took 54.2s. Estimated remaining: 3h 3m 40s. Rate: 6.8 symbols/min [2025-09-17T04:26:19.411476] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:19.441738] [DEBUG] [LOCAL ] INSW: Loaded 29451 existing records from primary storage. [2025-09-17T04:26:19.441936] [INFO ] [MAIN ] INSW: Loaded 29451 existing records. [2025-09-17T04:26:19.622523] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:19.622869] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-17T04:26:19.622932] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-17T04:26:19.624477] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-17T04:26:19.624550] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-17T04:26:19.895278] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-17T04:26:19.999632] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:20.517953] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T04:26:20.690208] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-11. [2025-09-17T04:26:21.263515] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T04:26:21.490215] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-17T04:26:22.116051] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:26:22.290169] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-17T04:26:23.047317] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T04:26:23.090072] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-17T04:26:23.475155] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T04:26:23.890142] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-17T04:26:24.575448] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T04:26:24.690172] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-17T04:26:25.490117] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-17T04:26:25.589551] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T04:26:26.104607] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T04:26:26.290204] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-17T04:26:26.905528] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T04:26:27.090119] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-17T04:26:27.817606] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T04:26:27.890139] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-17T04:26:28.544319] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T04:26:28.552328] [INFO ] [REMOTE ] INN: Full fetch complete (57683 records). [2025-09-17T04:26:28.552637] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-17T04:26:28.699045] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-17T04:26:29.205547] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-17T04:26:29.205790] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-17T04:26:29.207632] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-17T04:26:29.207775] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-17T04:26:29.209827] [DEBUG] [LOCAL ] INN: Trimmed 57683 records to 41964 (keeping 200 days of data) [2025-09-17T04:26:29.490207] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-17T04:26:29.540832] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T04:26:29.553531] [DEBUG] [LOCAL ] INN: Primary data saved (41964 records). [2025-09-17T04:26:29.553763] [INFO ] [MAIN ] INN: Full history saved. [2025-09-17T04:26:29.553883] [INFO ] [MAIN ] Update Progress: 1112/2369 symbols completed. INN took 38.3s. Estimated remaining: 3h 3m 33s. Rate: 6.8 symbols/min [2025-09-17T04:26:29.750449] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:29.790947] [DEBUG] [LOCAL ] INVH: Loaded 39610 existing records from primary storage. [2025-09-17T04:26:29.791180] [INFO ] [MAIN ] INVH: Loaded 39610 existing records. [2025-09-17T04:26:29.978307] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:29.978716] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-17T04:26:29.978868] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-17T04:26:29.979753] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-17T04:26:29.979816] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-17T04:26:30.125919] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T04:26:30.291100] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-17T04:26:30.369819] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:30.691420] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T04:26:31.090362] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-11. [2025-09-17T04:26:31.682759] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T04:26:31.890257] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-17T04:26:32.375979] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:26:32.690198] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-17T04:26:33.490206] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-17T04:26:33.556074] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:26:34.290191] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-17T04:26:34.418688] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T04:26:34.829093] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T04:26:34.833798] [INFO ] [REMOTE ] INR: Full fetch complete (31852 records). [2025-09-17T04:26:34.833981] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-17T04:26:35.032170] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 157 unique days, need 200 days [2025-09-17T04:26:35.032715] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:26:35.032821] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:26:35.033073] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-17T04:26:35.033167] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-17T04:26:35.033224] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-17T04:26:35.033733] [DEBUG] [LOCAL ] INR: Deleted derivative data file. [2025-09-17T04:26:35.033863] [INFO ] [MAIN ] Update Progress: 1113/2369 symbols completed. INR took 35.9s. Estimated remaining: 3h 3m 21s. Rate: 6.9 symbols/min [2025-09-17T04:26:35.101804] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-17T04:26:35.280717] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:35.304451] [DEBUG] [LOCAL ] INVX: Loaded 21435 existing records from primary storage. [2025-09-17T04:26:35.305031] [INFO ] [MAIN ] INVX: Loaded 21435 existing records. [2025-09-17T04:26:35.492776] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:35.493105] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-17T04:26:35.493181] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-17T04:26:35.494045] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-17T04:26:35.494125] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-17T04:26:35.880272] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:35.898991] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-11. [2025-09-17T04:26:35.904696] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T04:26:36.559895] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T04:26:36.690124] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-17T04:26:37.186388] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:26:37.490188] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-17T04:26:38.159595] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T04:26:38.290131] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-17T04:26:38.849458] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T04:26:39.090139] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-17T04:26:39.853243] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T04:26:39.890092] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-17T04:26:40.690102] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-17T04:26:40.831773] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T04:26:41.428530] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T04:26:41.490157] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-17T04:26:42.030962] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T04:26:42.290174] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-17T04:26:42.809546] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T04:26:42.814575] [INFO ] [REMOTE ] INSW: Full fetch complete (60945 records). [2025-09-17T04:26:42.814761] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-17T04:26:43.095319] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-17T04:26:43.216547] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-17T04:26:43.216700] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-17T04:26:43.217814] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-17T04:26:43.217876] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-17T04:26:43.219294] [DEBUG] [LOCAL ] INSW: Trimmed 60945 records to 40774 (keeping 200 days of data) [2025-09-17T04:26:43.488403] [DEBUG] [LOCAL ] INSW: Primary data saved (40774 records). [2025-09-17T04:26:43.488595] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-17T04:26:43.488742] [INFO ] [MAIN ] Update Progress: 1114/2369 symbols completed. INSW took 24.3s. Estimated remaining: 3h 3m 12s. Rate: 6.9 symbols/min [2025-09-17T04:26:43.665953] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:43.708707] [DEBUG] [LOCAL ] IONQ: Loaded 40138 existing records from primary storage. [2025-09-17T04:26:43.708942] [INFO ] [MAIN ] IONQ: Loaded 40138 existing records. [2025-09-17T04:26:43.904123] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:43.893579] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-17T04:26:43.905497] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-17T04:26:43.905708] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-17T04:26:43.906929] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-17T04:26:43.907007] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-17T04:26:44.131160] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T04:26:44.329468] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:44.500072] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T04:26:44.690150] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-11. [2025-09-17T04:26:44.831706] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T04:26:45.490224] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-17T04:26:46.290205] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-17T04:26:47.090136] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-17T04:26:47.249176] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-11 (2.56 seconds). [2025-09-17T04:26:47.337280] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T04:26:47.759288] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T04:26:47.890117] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-17T04:26:48.338806] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:26:48.690162] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-17T04:26:49.490135] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-17T04:26:49.538461] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T04:26:49.735147] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T04:26:50.290170] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-17T04:26:51.090189] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-17T04:26:51.890221] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-17T04:26:52.097332] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:26:52.144710] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-17T04:26:52.537189] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T04:26:52.690152] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-17T04:26:53.177334] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T04:26:53.183584] [INFO ] [REMOTE ] INSP: Full fetch complete (51914 records). [2025-09-17T04:26:53.183819] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-17T04:26:53.495214] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-17T04:26:53.596464] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-17T04:26:53.596598] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-17T04:26:53.597781] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-17T04:26:53.597854] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-17T04:26:53.599244] [DEBUG] [LOCAL ] INSP: Trimmed 51914 records to 36440 (keeping 200 days of data) [2025-09-17T04:26:53.826910] [DEBUG] [LOCAL ] INSP: Primary data saved (36440 records). [2025-09-17T04:26:53.827106] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-17T04:26:53.827214] [INFO ] [MAIN ] Update Progress: 1115/2369 symbols completed. INSP took 42.3s. Estimated remaining: 3h 3m 5s. Rate: 6.8 symbols/min [2025-09-17T04:26:53.999958] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:26:54.020293] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T04:26:54.066969] [DEBUG] [LOCAL ] IOT: Loaded 39868 existing records from primary storage. [2025-09-17T04:26:54.067160] [INFO ] [MAIN ] IOT: Loaded 39868 existing records. [2025-09-17T04:26:54.249158] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:26:54.249678] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-17T04:26:54.249745] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-17T04:26:54.250971] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-17T04:26:54.251037] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-17T04:26:54.295273] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-17T04:26:54.604960] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:26:55.090152] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-11. [2025-09-17T04:26:55.584946] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T04:26:55.890160] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-17T04:26:56.150914] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-09-17T04:26:56.690186] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-17T04:26:56.929347] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T04:26:57.490140] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-17T04:26:57.627263] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:26:58.290205] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-17T04:26:58.785915] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T04:26:58.922220] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-17T04:26:59.090091] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-17T04:26:59.878427] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T04:26:59.890073] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-17T04:27:00.690191] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-17T04:27:01.490269] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-17T04:27:01.608574] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T04:27:02.232547] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (3.14 seconds). [2025-09-17T04:27:02.290099] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-17T04:27:03.090165] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-17T04:27:03.267234] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T04:27:03.664128] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (2.97 seconds). [2025-09-17T04:27:03.890213] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-17T04:27:04.690169] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-17T04:27:05.601090] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-17T04:27:05.611535] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-17T04:27:05.934425] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T04:27:05.953446] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:27:05.958387] [INFO ] [REMOTE ] INVX: Full fetch complete (44568 records). [2025-09-17T04:27:05.958527] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-17T04:27:06.297698] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-17T04:27:06.347682] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-17T04:27:06.347798] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-17T04:27:06.348661] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-17T04:27:06.348720] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-17T04:27:06.349844] [DEBUG] [LOCAL ] INVX: Trimmed 44568 records to 29384 (keeping 200 days of data) [2025-09-17T04:27:06.527710] [DEBUG] [LOCAL ] INVX: Primary data saved (29384 records). [2025-09-17T04:27:06.527896] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-17T04:27:06.527996] [INFO ] [MAIN ] Update Progress: 1116/2369 symbols completed. INVX took 31.5s. Estimated remaining: 3h 3m 0s. Rate: 6.8 symbols/min [2025-09-17T04:27:06.703707] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:06.748226] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (4.46 seconds). [2025-09-17T04:27:06.788874] [DEBUG] [LOCAL ] IP: Loaded 39704 existing records from primary storage. [2025-09-17T04:27:06.789094] [INFO ] [MAIN ] IP: Loaded 39704 existing records. [2025-09-17T04:27:06.968832] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:27:06.969149] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-17T04:27:06.969213] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-17T04:27:06.970343] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-17T04:27:06.970632] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-17T04:27:07.091054] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-17T04:27:07.348956] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:07.381836] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T04:27:07.890147] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-17T04:27:08.093851] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T04:27:08.690145] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-17T04:27:09.490129] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-11. [2025-09-17T04:27:09.611726] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-17T04:27:09.743057] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T04:27:09.946287] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:27:09.952868] [INFO ] [REMOTE ] INVH: Full fetch complete (76488 records). [2025-09-17T04:27:09.953027] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-17T04:27:10.302290] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-17T04:27:10.360695] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-17T04:27:10.360824] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-17T04:27:10.362069] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-17T04:27:10.362153] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-17T04:27:10.363881] [DEBUG] [LOCAL ] INVH: Trimmed 76488 records to 53145 (keeping 200 days of data) [2025-09-17T04:27:10.700806] [DEBUG] [LOCAL ] INVH: Primary data saved (53145 records). [2025-09-17T04:27:10.700975] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-17T04:27:10.701079] [INFO ] [MAIN ] Update Progress: 1117/2369 symbols completed. INVH took 41.1s. Estimated remaining: 3h 2m 46s. Rate: 6.9 symbols/min [2025-09-17T04:27:11.090124] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-17T04:27:11.198904] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T04:27:11.890146] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-17T04:27:12.291812] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T04:27:12.690131] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-17T04:27:13.645375] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T04:27:13.656442] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-17T04:27:13.693053] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-17T04:27:14.290246] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-17T04:27:14.297964] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T04:27:15.099998] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-17T04:27:15.119977] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T04:27:15.890211] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-17T04:27:17.977656] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-17T04:27:17.990922] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-17T04:27:18.051158] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (3.76 seconds). [2025-09-17T04:27:18.064056] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-17T04:27:18.987898] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (3.10 seconds). [2025-09-17T04:27:18.998274] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-17T04:27:19.919165] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T04:27:19.931942] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-17T04:27:20.326046] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-17T04:27:20.338322] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-17T04:27:20.912039] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T04:27:20.923556] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-17T04:27:21.535791] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T04:27:21.542498] [INFO ] [REMOTE ] IOT: Full fetch complete (77211 records). [2025-09-17T04:27:21.542689] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-17T04:27:21.962761] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-17T04:27:21.962918] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-17T04:27:21.964136] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-17T04:27:21.964235] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-17T04:27:21.965934] [DEBUG] [LOCAL ] IOT: Trimmed 77211 records to 53473 (keeping 200 days of data) [2025-09-17T04:27:22.303069] [DEBUG] [LOCAL ] IOT: Primary data saved (53473 records). [2025-09-17T04:27:22.303311] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-17T04:27:22.303451] [INFO ] [MAIN ] Update Progress: 1118/2369 symbols completed. IOT took 28.5s. Estimated remaining: 3h 2m 41s. Rate: 6.8 symbols/min [2025-09-17T04:27:22.857861] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T04:27:22.869338] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-17T04:27:22.971207] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-17T04:27:22.977688] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-17T04:27:22.977837] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-17T04:27:23.371918] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-17T04:27:23.372053] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-17T04:27:23.373078] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-17T04:27:23.373142] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-17T04:27:23.374887] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-09-17T04:27:23.708832] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-09-17T04:27:23.709039] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-17T04:27:23.709157] [INFO ] [MAIN ] Update Progress: 1119/2369 symbols completed. IONQ took 40.2s. Estimated remaining: 3h 2m 24s. Rate: 6.9 symbols/min [2025-09-17T04:27:24.754482] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T04:27:24.766240] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-17T04:27:26.472505] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T04:27:26.483943] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-17T04:27:28.388324] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T04:27:28.400348] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-17T04:27:30.148067] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T04:27:30.160463] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-17T04:27:31.942471] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T04:27:31.949474] [INFO ] [REMOTE ] IP: Full fetch complete (76851 records). [2025-09-17T04:27:31.949684] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-17T04:27:32.345046] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-17T04:27:32.345193] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-17T04:27:32.346266] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-17T04:27:32.346347] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-17T04:27:32.348064] [DEBUG] [LOCAL ] IP: Trimmed 76851 records to 53330 (keeping 200 days of data) [2025-09-17T04:27:32.700417] [DEBUG] [LOCAL ] IP: Primary data saved (53330 records). [2025-09-17T04:27:32.700661] [INFO ] [MAIN ] IP: Full history saved. [2025-09-17T04:27:32.700855] [INFO ] [MAIN ] Update Progress: 1120/2369 symbols completed. IP took 26.2s. Estimated remaining: 3h 2m 15s. Rate: 6.9 symbols/min [2025-09-17T04:27:33.258088] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:33.344013] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:33.423099] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:33.440362] [DEBUG] [LOCAL ] IQV: No existing data file found in primary storage. [2025-09-17T04:27:33.445963] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:33.446331] [WARN ] [MAIN ] IQV: No existing data found, performing full refresh instead. [2025-09-17T04:27:33.447509] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-17T04:27:33.447820] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-17T04:27:33.448013] [DEBUG] [LOCAL ] IQV: No primary data file found to delete. [2025-09-17T04:27:33.448316] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-17T04:27:33.591749] [DEBUG] [LOCAL ] IQI: Loaded 13543 existing records from primary storage. [2025-09-17T04:27:33.597447] [DEBUG] [LOCAL ] IPI: Loaded 15552 existing records from primary storage. [2025-09-17T04:27:33.647338] [INFO ] [MAIN ] IQI: Loaded 13543 existing records. [2025-09-17T04:27:33.647438] [INFO ] [MAIN ] IPI: Loaded 15552 existing records. [2025-09-17T04:27:33.675704] [DEBUG] [LOCAL ] IPG: Loaded 39697 existing records from primary storage. [2025-09-17T04:27:33.776160] [INFO ] [MAIN ] IPG: Loaded 39697 existing records. [2025-09-17T04:27:34.275686] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:27:34.332386] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:34.371881] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-17T04:27:34.366308] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-11. [2025-09-17T04:27:34.382075] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:27:34.401663] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-17T04:27:34.414072] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-17T04:27:34.414008] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-17T04:27:34.449193] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:27:34.449492] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-17T04:27:34.449568] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-17T04:27:34.449782] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-17T04:27:34.449932] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-17T04:27:34.449864] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-17T04:27:34.450117] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-17T04:27:34.455286] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-17T04:27:34.549375] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-17T04:27:35.380222] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:35.434892] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-11. [2025-09-17T04:27:35.608738] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:35.635731] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-11. [2025-09-17T04:27:35.635449] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:35.636999] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-11. [2025-09-17T04:27:36.025497] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T04:27:36.036197] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-17T04:27:36.482187] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T04:27:36.488314] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-17T04:27:36.513369] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T04:27:36.517260] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-17T04:27:36.941236] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T04:27:36.951896] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-17T04:27:37.158421] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T04:27:37.162390] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-17T04:27:37.335948] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T04:27:37.341140] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-17T04:27:37.500722] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T04:27:37.511214] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-17T04:27:37.804410] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T04:27:37.808751] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-17T04:27:37.991264] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T04:27:37.996465] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-17T04:27:38.745371] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T04:27:38.757138] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-17T04:27:38.800503] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T04:27:38.804882] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-17T04:27:38.976972] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T04:27:38.988594] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-17T04:27:39.020592] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T04:27:39.025899] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-17T04:27:39.670148] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T04:27:39.674235] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-17T04:27:39.844439] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T04:27:39.890168] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-17T04:27:40.194423] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T04:27:40.424969] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T04:27:40.690157] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-17T04:27:40.756572] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T04:27:41.487034] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T04:27:41.492243] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-17T04:27:42.163975] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T04:27:42.290237] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-17T04:27:42.419499] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T04:27:43.090146] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-17T04:27:43.863564] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T04:27:43.890119] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-17T04:27:44.055583] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T04:27:44.690208] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-17T04:27:45.279169] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T04:27:45.490197] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-17T04:27:46.290227] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-17T04:27:46.461143] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T04:27:46.517496] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T04:27:47.090172] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-17T04:27:47.561146] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T04:27:47.890166] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-17T04:27:48.123442] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T04:27:48.690135] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-17T04:27:49.490163] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-17T04:27:49.615564] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T04:27:50.049247] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T04:27:50.290097] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-17T04:27:50.478087] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T04:27:51.090135] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-17T04:27:51.853980] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T04:27:51.890205] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-17T04:27:52.690111] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-17T04:27:52.896312] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T04:27:53.004919] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T04:27:53.490128] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-17T04:27:53.721819] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T04:27:53.724635] [INFO ] [REMOTE ] IQI: Full fetch complete (27448 records). [2025-09-17T04:27:53.724775] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-17T04:27:54.103531] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-17T04:27:54.103697] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-17T04:27:54.105090] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-17T04:27:54.105197] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-17T04:27:54.106368] [DEBUG] [LOCAL ] IQI: Trimmed 27448 records to 18105 (keeping 200 days of data) [2025-09-17T04:27:54.232151] [DEBUG] [LOCAL ] IQI: Primary data saved (18105 records). [2025-09-17T04:27:54.232461] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-17T04:27:54.232625] [INFO ] [MAIN ] Update Progress: 1121/2369 symbols completed. IQI took 21.5s. Estimated remaining: 3h 2m 21s. Rate: 6.8 symbols/min [2025-09-17T04:27:54.297735] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-17T04:27:54.421143] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:27:54.458344] [DEBUG] [LOCAL ] IR: Loaded 39275 existing records from primary storage. [2025-09-17T04:27:54.458551] [INFO ] [MAIN ] IR: Loaded 39275 existing records. [2025-09-17T04:27:54.698320] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:27:54.698627] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-17T04:27:54.698716] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-17T04:27:54.704967] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-17T04:27:54.711253] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-17T04:27:54.776845] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T04:27:55.075658] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:27:55.090093] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-11. [2025-09-17T04:27:55.890215] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-17T04:27:56.234465] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T04:27:56.690172] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-17T04:27:56.750296] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T04:27:57.316354] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T04:27:57.490154] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-17T04:27:58.290157] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-17T04:27:58.414000] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T04:27:59.090126] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-17T04:27:59.284695] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T04:27:59.316233] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T04:27:59.320578] [INFO ] [REMOTE ] IPI: Full fetch complete (28784 records). [2025-09-17T04:27:59.320733] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-17T04:27:59.701184] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-17T04:27:59.701308] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-17T04:27:59.701999] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-17T04:27:59.702056] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-17T04:27:59.702962] [DEBUG] [LOCAL ] IPI: Trimmed 28784 records to 21385 (keeping 200 days of data) [2025-09-17T04:27:59.831254] [DEBUG] [LOCAL ] IPI: Primary data saved (21385 records). [2025-09-17T04:27:59.831427] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-17T04:27:59.831530] [INFO ] [MAIN ] Update Progress: 1122/2369 symbols completed. IPI took 27.1s. Estimated remaining: 3h 2m 8s. Rate: 6.8 symbols/min [2025-09-17T04:27:59.895365] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-17T04:28:00.011425] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:00.056668] [DEBUG] [LOCAL ] IRM: Loaded 36386 existing records from primary storage. [2025-09-17T04:28:00.056910] [INFO ] [MAIN ] IRM: Loaded 36386 existing records. [2025-09-17T04:28:00.235085] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:00.235394] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-17T04:28:00.235448] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-17T04:28:00.236787] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-17T04:28:00.236858] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-17T04:28:00.613871] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:00.649746] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T04:28:00.690085] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-17T04:28:01.490165] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-11. [2025-09-17T04:28:01.680618] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T04:28:02.290153] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-17T04:28:02.503957] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T04:28:02.919759] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:28:03.090158] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-17T04:28:03.893880] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-17T04:28:03.896271] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T04:28:03.904587] [INFO ] [REMOTE ] IQV: Full fetch complete (72491 records). [2025-09-17T04:28:03.904828] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-17T04:28:04.311161] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-17T04:28:04.311284] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-17T04:28:04.312804] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-17T04:28:04.313084] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-17T04:28:04.315066] [DEBUG] [LOCAL ] IQV: Trimmed 72491 records to 50594 (keeping 200 days of data) [2025-09-17T04:28:04.643230] [DEBUG] [LOCAL ] IQV: Primary data saved (50594 records). [2025-09-17T04:28:04.643487] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-17T04:28:04.643602] [INFO ] [MAIN ] Update Progress: 1123/2369 symbols completed. IQV took 31.9s. Estimated remaining: 3h 1m 55s. Rate: 6.8 symbols/min [2025-09-17T04:28:04.690873] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-17T04:28:04.827819] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:04.866672] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T04:28:04.882949] [DEBUG] [LOCAL ] IRS: Loaded 16397 existing records from primary storage. [2025-09-17T04:28:04.883364] [INFO ] [MAIN ] IRS: Loaded 16397 existing records. [2025-09-17T04:28:05.059725] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:05.060028] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-17T04:28:05.060093] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-17T04:28:05.060605] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-17T04:28:05.060710] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-17T04:28:05.411366] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:05.490090] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-11. [2025-09-17T04:28:05.591128] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T04:28:05.600831] [INFO ] [REMOTE ] IPG: Full fetch complete (77081 records). [2025-09-17T04:28:05.601052] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-17T04:28:06.012226] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-17T04:28:06.012392] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-17T04:28:06.013903] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-17T04:28:06.014000] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-17T04:28:06.019363] [DEBUG] [LOCAL ] IPG: Trimmed 77081 records to 53335 (keeping 200 days of data) [2025-09-17T04:28:06.282084] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T04:28:06.293847] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-17T04:28:06.409668] [DEBUG] [LOCAL ] IPG: Primary data saved (53335 records). [2025-09-17T04:28:06.409894] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-17T04:28:06.410066] [INFO ] [MAIN ] Update Progress: 1124/2369 symbols completed. IPG took 33.7s. Estimated remaining: 3h 1m 39s. Rate: 6.9 symbols/min [2025-09-17T04:28:06.588075] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:06.631066] [DEBUG] [LOCAL ] IRT: Loaded 37574 existing records from primary storage. [2025-09-17T04:28:06.631305] [INFO ] [MAIN ] IRT: Loaded 37574 existing records. [2025-09-17T04:28:06.822150] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:06.822543] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-17T04:28:06.822747] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-17T04:28:06.829218] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-17T04:28:06.838444] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-17T04:28:06.845037] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T04:28:07.095266] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-17T04:28:07.241400] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:07.890150] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-11. [2025-09-17T04:28:08.090495] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T04:28:08.400506] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T04:28:08.690147] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-17T04:28:09.232576] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T04:28:09.490145] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-17T04:28:09.799457] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T04:28:10.290146] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-17T04:28:11.090106] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-17T04:28:11.223068] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T04:28:11.890113] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-17T04:28:11.946187] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T04:28:12.690218] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-17T04:28:12.906010] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T04:28:13.490152] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-17T04:28:13.692219] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T04:28:13.718125] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T04:28:14.290182] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-17T04:28:14.856466] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T04:28:15.090167] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-17T04:28:15.890117] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-17T04:28:16.037542] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T04:28:16.506625] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T04:28:16.690164] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-17T04:28:16.722872] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T04:28:17.490202] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-17T04:28:18.290181] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-17T04:28:18.501561] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:28:18.655950] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T04:28:19.090102] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-17T04:28:19.411627] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T04:28:19.890190] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-17T04:28:20.690173] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-17T04:28:20.843474] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T04:28:21.490215] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-17T04:28:21.688503] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T04:28:21.719896] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T04:28:22.290155] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-17T04:28:23.066096] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T04:28:23.090097] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-17T04:28:23.365451] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T04:28:23.890152] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-17T04:28:24.589795] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T04:28:24.690165] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-17T04:28:24.925514] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T04:28:25.490220] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-17T04:28:26.290137] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-17T04:28:26.397425] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T04:28:26.556850] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T04:28:27.090158] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-17T04:28:27.788288] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T04:28:27.890111] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-17T04:28:28.272708] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T04:28:28.277222] [INFO ] [REMOTE ] IRS: Full fetch complete (31913 records). [2025-09-17T04:28:28.277383] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-17T04:28:28.694380] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-17T04:28:28.694691] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-17T04:28:28.695785] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-17T04:28:28.696571] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-17T04:28:28.696669] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-17T04:28:28.697841] [DEBUG] [LOCAL ] IRS: Trimmed 31913 records to 21041 (keeping 200 days of data) [2025-09-17T04:28:28.831594] [DEBUG] [LOCAL ] IRS: Primary data saved (21041 records). [2025-09-17T04:28:28.831781] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-17T04:28:28.831895] [INFO ] [MAIN ] Update Progress: 1125/2369 symbols completed. IRS took 24.2s. Estimated remaining: 3h 1m 45s. Rate: 6.8 symbols/min [2025-09-17T04:28:29.008231] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:29.023080] [DEBUG] [LOCAL ] ISD: Loaded 11160 existing records from primary storage. [2025-09-17T04:28:29.023304] [INFO ] [MAIN ] ISD: Loaded 11160 existing records. [2025-09-17T04:28:29.211228] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:29.211539] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-17T04:28:29.211627] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-17T04:28:29.212209] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-17T04:28:29.212286] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-17T04:28:29.494304] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-17T04:28:29.589942] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:29.623976] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T04:28:30.290207] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-11. [2025-09-17T04:28:30.443473] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T04:28:30.868242] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T04:28:31.090227] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-17T04:28:31.268206] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T04:28:31.890248] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-17T04:28:32.690176] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-17T04:28:32.811879] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T04:28:33.490186] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-17T04:28:33.561036] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T04:28:34.290333] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-17T04:28:34.394055] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T04:28:34.405272] [INFO ] [REMOTE ] IR: Full fetch complete (75847 records). [2025-09-17T04:28:34.407049] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-17T04:28:34.417130] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T04:28:35.051497] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-17T04:28:35.051675] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-17T04:28:35.052927] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-17T04:28:35.053013] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-17T04:28:35.055407] [DEBUG] [LOCAL ] IR: Trimmed 75847 records to 52700 (keeping 200 days of data) [2025-09-17T04:28:35.137268] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-17T04:28:35.437173] [DEBUG] [LOCAL ] IR: Primary data saved (52700 records). [2025-09-17T04:28:35.437391] [INFO ] [MAIN ] IR: Full history saved. [2025-09-17T04:28:35.437553] [INFO ] [MAIN ] Update Progress: 1126/2369 symbols completed. IR took 41.2s. Estimated remaining: 3h 1m 34s. Rate: 6.8 symbols/min [2025-09-17T04:28:35.611358] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:35.644340] [DEBUG] [LOCAL ] IT: Loaded 31073 existing records from primary storage. [2025-09-17T04:28:35.644531] [INFO ] [MAIN ] IT: Loaded 31073 existing records. [2025-09-17T04:28:35.826358] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:35.826722] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-17T04:28:35.826786] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-17T04:28:35.827756] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-17T04:28:35.827821] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-17T04:28:35.909672] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-17T04:28:36.217316] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T04:28:36.239729] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:36.247167] [INFO ] [REMOTE ] IRM: Full fetch complete (72122 records). [2025-09-17T04:28:36.247355] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-17T04:28:36.655479] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-17T04:28:36.656147] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-17T04:28:36.657331] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-17T04:28:36.657543] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-17T04:28:36.675765] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T04:28:36.693546] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-11. [2025-09-17T04:28:36.693445] [DEBUG] [LOCAL ] IRM: Trimmed 72122 records to 49594 (keeping 200 days of data) [2025-09-17T04:28:36.717795] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T04:28:37.066284] [DEBUG] [LOCAL ] IRM: Primary data saved (49594 records). [2025-09-17T04:28:37.066500] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-17T04:28:37.066625] [INFO ] [MAIN ] Update Progress: 1127/2369 symbols completed. IRM took 37.2s. Estimated remaining: 3h 1m 17s. Rate: 6.9 symbols/min [2025-09-17T04:28:37.241795] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:37.265711] [DEBUG] [LOCAL ] ITGR: Loaded 22250 existing records from primary storage. [2025-09-17T04:28:37.265922] [INFO ] [MAIN ] ITGR: Loaded 22250 existing records. [2025-09-17T04:28:37.457009] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:37.457342] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-17T04:28:37.457403] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-17T04:28:37.458310] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-17T04:28:37.458637] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-17T04:28:37.495368] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-17T04:28:37.840797] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:37.861735] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T04:28:38.290177] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-17T04:28:38.501728] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T04:28:39.090207] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-11. [2025-09-17T04:28:39.890133] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-17T04:28:39.946344] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T04:28:40.144510] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T04:28:40.690146] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-17T04:28:40.876968] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T04:28:41.490103] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-17T04:28:41.731288] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:28:42.290188] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-17T04:28:42.789370] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T04:28:43.090165] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-17T04:28:43.329378] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T04:28:43.890168] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-17T04:28:44.477754] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T04:28:44.485304] [INFO ] [REMOTE ] IRT: Full fetch complete (72169 records). [2025-09-17T04:28:44.485567] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-17T04:28:44.698199] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-17T04:28:44.895683] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-17T04:28:44.895803] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-17T04:28:44.896818] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-17T04:28:44.896902] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-17T04:28:44.898504] [DEBUG] [LOCAL ] IRT: Trimmed 72169 records to 50449 (keeping 200 days of data) [2025-09-17T04:28:45.228131] [DEBUG] [LOCAL ] IRT: Primary data saved (50449 records). [2025-09-17T04:28:45.228345] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-17T04:28:45.228504] [INFO ] [MAIN ] Update Progress: 1128/2369 symbols completed. IRT took 38.8s. Estimated remaining: 3h 1m 8s. Rate: 6.9 symbols/min [2025-09-17T04:28:45.399290] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:28:45.418285] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T04:28:45.444433] [DEBUG] [LOCAL ] ITT: Loaded 23458 existing records from primary storage. [2025-09-17T04:28:45.444761] [INFO ] [MAIN ] ITT: Loaded 23458 existing records. [2025-09-17T04:28:45.497623] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-17T04:28:45.567272] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T04:28:45.646132] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:28:45.646406] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-17T04:28:45.646469] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-17T04:28:45.647217] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-17T04:28:45.647280] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-17T04:28:46.006991] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:28:46.290137] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-11. [2025-09-17T04:28:46.690767] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T04:28:47.090152] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-17T04:28:47.175983] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T04:28:47.890171] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-17T04:28:48.501268] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T04:28:48.690135] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-17T04:28:48.708006] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T04:28:49.490189] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-17T04:28:50.187061] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T04:28:50.290106] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-17T04:28:50.868187] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T04:28:51.090146] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-17T04:28:51.705121] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T04:28:51.890159] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-17T04:28:52.491714] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T04:28:52.690163] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-17T04:28:52.923384] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T04:28:53.493201] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-17T04:28:53.496629] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T04:28:54.290157] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-17T04:28:54.980794] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T04:28:55.090149] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-17T04:28:55.873595] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T04:28:55.890104] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-17T04:28:56.066785] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T04:28:56.690156] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-17T04:28:57.239432] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T04:28:57.490155] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-17T04:28:58.084202] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T04:28:58.290146] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-17T04:28:58.709675] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T04:28:59.090142] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-17T04:28:59.679474] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T04:28:59.890150] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-17T04:29:00.528436] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T04:29:00.690194] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-17T04:29:01.491052] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-17T04:29:01.509334] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T04:29:01.679514] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T04:29:02.290135] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-17T04:29:02.717728] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T04:29:03.090180] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-17T04:29:03.890165] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-17T04:29:04.154252] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T04:29:04.310956] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T04:29:04.314999] [INFO ] [REMOTE ] ITGR: Full fetch complete (40806 records). [2025-09-17T04:29:04.315152] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-17T04:29:04.704480] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-17T04:29:04.755706] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-17T04:29:04.755825] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-17T04:29:04.756559] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-17T04:29:04.756617] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-17T04:29:04.757610] [DEBUG] [LOCAL ] ITGR: Trimmed 40806 records to 31609 (keeping 200 days of data) [2025-09-17T04:29:04.864258] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T04:29:04.979660] [DEBUG] [LOCAL ] ITGR: Primary data saved (31609 records). [2025-09-17T04:29:04.979865] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-17T04:29:04.979976] [INFO ] [MAIN ] Update Progress: 1129/2369 symbols completed. ITGR took 27.9s. Estimated remaining: 3h 1m 11s. Rate: 6.8 symbols/min [2025-09-17T04:29:05.153185] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:05.194487] [DEBUG] [LOCAL ] ITUB: Loaded 39769 existing records from primary storage. [2025-09-17T04:29:05.194713] [INFO ] [MAIN ] ITUB: Loaded 39769 existing records. [2025-09-17T04:29:05.377741] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:05.378035] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-17T04:29:05.378095] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-17T04:29:05.379151] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-17T04:29:05.379216] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-17T04:29:05.495296] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-17T04:29:05.741707] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:06.290155] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-11. [2025-09-17T04:29:06.479206] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T04:29:06.485120] [INFO ] [REMOTE ] IT: Full fetch complete (54435 records). [2025-09-17T04:29:06.485287] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-17T04:29:06.872618] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-17T04:29:06.872750] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-17T04:29:06.873655] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-17T04:29:06.873733] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-17T04:29:06.875022] [DEBUG] [LOCAL ] IT: Trimmed 54435 records to 40982 (keeping 200 days of data) [2025-09-17T04:29:07.092807] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-17T04:29:07.142676] [DEBUG] [LOCAL ] IT: Primary data saved (40982 records). [2025-09-17T04:29:07.142989] [INFO ] [MAIN ] IT: Full history saved. [2025-09-17T04:29:07.143141] [INFO ] [MAIN ] Update Progress: 1130/2369 symbols completed. IT took 31.7s. Estimated remaining: 3h 0m 55s. Rate: 6.8 symbols/min [2025-09-17T04:29:07.275737] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T04:29:07.354843] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:07.388859] [DEBUG] [LOCAL ] ITW: Loaded 34070 existing records from primary storage. [2025-09-17T04:29:07.389049] [INFO ] [MAIN ] ITW: Loaded 34070 existing records. [2025-09-17T04:29:07.565738] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:07.565987] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-17T04:29:07.566040] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-17T04:29:07.566984] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-17T04:29:07.567048] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-17T04:29:07.898637] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-17T04:29:07.926050] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:08.008740] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T04:29:08.010942] [INFO ] [REMOTE ] ISD: Full fetch complete (23914 records). [2025-09-17T04:29:08.011036] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-17T04:29:08.383390] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-17T04:29:08.383565] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-17T04:29:08.384248] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-17T04:29:08.384375] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-17T04:29:08.385584] [DEBUG] [LOCAL ] ISD: Trimmed 23914 records to 15843 (keeping 200 days of data) [2025-09-17T04:29:08.486287] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-17T04:29:08.519706] [DEBUG] [LOCAL ] ISD: Primary data saved (15843 records). [2025-09-17T04:29:08.519825] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-17T04:29:08.519911] [INFO ] [MAIN ] Update Progress: 1131/2369 symbols completed. ISD took 39.7s. Estimated remaining: 3h 0m 38s. Rate: 6.9 symbols/min [2025-09-17T04:29:08.689584] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:08.690102] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-11. [2025-09-17T04:29:08.723751] [DEBUG] [LOCAL ] IVR: Loaded 35217 existing records from primary storage. [2025-09-17T04:29:08.723918] [INFO ] [MAIN ] IVR: Loaded 35217 existing records. [2025-09-17T04:29:08.906764] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:08.907244] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-17T04:29:08.907354] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-17T04:29:08.908289] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-17T04:29:08.908357] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-17T04:29:09.266426] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:09.406899] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T04:29:09.490090] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-17T04:29:10.269515] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T04:29:10.290079] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-17T04:29:10.643350] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T04:29:11.090181] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-17T04:29:11.894536] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-11. [2025-09-17T04:29:11.896121] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T04:29:12.255400] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T04:29:12.690205] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-17T04:29:13.490144] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-17T04:29:13.728622] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T04:29:14.290154] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-17T04:29:14.328452] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T04:29:14.715086] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T04:29:15.090149] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-17T04:29:15.890133] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-17T04:29:16.115477] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T04:29:16.690096] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-17T04:29:16.759870] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T04:29:16.895749] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T04:29:16.899463] [INFO ] [REMOTE ] ITT: Full fetch complete (46625 records). [2025-09-17T04:29:16.899613] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-17T04:29:17.333606] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-17T04:29:17.333734] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-17T04:29:17.334586] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-17T04:29:17.334671] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-17T04:29:17.335794] [DEBUG] [LOCAL ] ITT: Trimmed 46625 records to 33531 (keeping 200 days of data) [2025-09-17T04:29:17.501985] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-17T04:29:17.553378] [DEBUG] [LOCAL ] ITT: Primary data saved (33531 records). [2025-09-17T04:29:17.553541] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-17T04:29:17.553686] [INFO ] [MAIN ] Update Progress: 1132/2369 symbols completed. ITT took 32.3s. Estimated remaining: 3h 0m 30s. Rate: 6.9 symbols/min [2025-09-17T04:29:17.724123] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:17.745156] [DEBUG] [LOCAL ] IVT: Loaded 22503 existing records from primary storage. [2025-09-17T04:29:17.745308] [INFO ] [MAIN ] IVT: Loaded 22503 existing records. [2025-09-17T04:29:17.927345] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:17.927635] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-17T04:29:17.927707] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-17T04:29:17.928424] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-17T04:29:17.928495] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-17T04:29:18.299938] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:18.293639] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-17T04:29:18.335181] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T04:29:19.090220] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-11. [2025-09-17T04:29:19.221195] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T04:29:19.890097] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-17T04:29:19.984476] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T04:29:20.369292] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T04:29:20.690190] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-17T04:29:21.274669] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T04:29:21.490199] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-17T04:29:21.959482] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T04:29:22.290169] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-17T04:29:23.089341] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T04:29:23.097798] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-17T04:29:23.890150] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-17T04:29:24.101807] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:29:24.690183] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-17T04:29:24.880866] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T04:29:24.931423] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:29:25.490161] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-17T04:29:26.290154] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-17T04:29:26.341612] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T04:29:26.829677] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T04:29:27.090241] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-17T04:29:27.890137] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-17T04:29:28.005812] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T04:29:28.075380] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T04:29:28.690192] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-17T04:29:29.398135] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T04:29:29.490158] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-17T04:29:29.895984] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T04:29:30.290139] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-17T04:29:31.090145] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-17T04:29:31.285173] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T04:29:31.890168] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-17T04:29:32.037234] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T04:29:32.160613] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T04:29:32.690148] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-17T04:29:33.165088] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T04:29:33.490178] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-17T04:29:34.290173] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-17T04:29:34.461773] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T04:29:35.090153] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-17T04:29:35.211122] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T04:29:35.239860] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T04:29:35.890140] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-17T04:29:36.695211] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-17T04:29:36.709839] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T04:29:37.490095] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-17T04:29:37.773025] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T04:29:37.961125] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T04:29:38.290147] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-17T04:29:39.039345] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T04:29:39.090088] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-17T04:29:39.525570] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T04:29:39.533771] [INFO ] [REMOTE ] ITW: Full fetch complete (66571 records). [2025-09-17T04:29:39.533984] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-17T04:29:39.890178] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-17T04:29:39.929145] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-17T04:29:39.929251] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-17T04:29:39.930292] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-17T04:29:39.930371] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-17T04:29:39.931957] [DEBUG] [LOCAL ] ITW: Trimmed 66571 records to 46545 (keeping 200 days of data) [2025-09-17T04:29:40.229391] [DEBUG] [LOCAL ] ITW: Primary data saved (46545 records). [2025-09-17T04:29:40.229568] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-17T04:29:40.229679] [INFO ] [MAIN ] Update Progress: 1133/2369 symbols completed. ITW took 33.1s. Estimated remaining: 3h 0m 36s. Rate: 6.8 symbols/min [2025-09-17T04:29:40.398461] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:40.455140] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T04:29:40.462938] [DEBUG] [LOCAL ] IVZ: Loaded 39555 existing records from primary storage. [2025-09-17T04:29:40.463473] [INFO ] [MAIN ] IVZ: Loaded 39555 existing records. [2025-09-17T04:29:40.647616] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:40.648022] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-17T04:29:40.648090] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-17T04:29:40.649296] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-17T04:29:40.649365] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-17T04:29:40.695344] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-17T04:29:41.021291] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:41.490208] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-17T04:29:41.729728] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T04:29:41.958149] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T04:29:42.290201] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-17T04:29:42.832709] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T04:29:43.090191] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-11. [2025-09-17T04:29:43.792268] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:29:43.798403] [INFO ] [REMOTE ] IVR: Full fetch complete (68664 records). [2025-09-17T04:29:43.798660] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-17T04:29:43.895247] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-17T04:29:44.204637] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-17T04:29:44.204786] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-17T04:29:44.205765] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-17T04:29:44.205838] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-17T04:29:44.207475] [DEBUG] [LOCAL ] IVR: Trimmed 68664 records to 47725 (keeping 200 days of data) [2025-09-17T04:29:44.505382] [DEBUG] [LOCAL ] IVR: Primary data saved (47725 records). [2025-09-17T04:29:44.505580] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-17T04:29:44.505701] [INFO ] [MAIN ] Update Progress: 1134/2369 symbols completed. IVR took 36.0s. Estimated remaining: 3h 0m 23s. Rate: 6.8 symbols/min [2025-09-17T04:29:44.684587] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:44.690130] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-17T04:29:44.705519] [DEBUG] [LOCAL ] IX: Loaded 16330 existing records from primary storage. [2025-09-17T04:29:44.705685] [INFO ] [MAIN ] IX: Loaded 16330 existing records. [2025-09-17T04:29:44.888190] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:44.888574] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-17T04:29:44.888683] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-17T04:29:44.916410] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-17T04:29:44.917671] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T04:29:44.921482] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-17T04:29:45.292429] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:45.490133] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-11. [2025-09-17T04:29:45.824535] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T04:29:45.872459] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T04:29:45.876272] [INFO ] [REMOTE ] IVT: Full fetch complete (45511 records). [2025-09-17T04:29:45.876380] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-17T04:29:46.178845] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T04:29:46.263928] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-17T04:29:46.264037] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-17T04:29:46.264862] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-17T04:29:46.264922] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-17T04:29:46.266053] [DEBUG] [LOCAL ] IVT: Trimmed 45511 records to 31028 (keeping 200 days of data) [2025-09-17T04:29:46.322290] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-17T04:29:46.457354] [DEBUG] [LOCAL ] IVT: Primary data saved (31028 records). [2025-09-17T04:29:46.457528] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-17T04:29:46.457683] [INFO ] [MAIN ] Update Progress: 1135/2369 symbols completed. IVT took 28.9s. Estimated remaining: 3h 0m 7s. Rate: 6.9 symbols/min [2025-09-17T04:29:46.627694] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:46.656889] [DEBUG] [LOCAL ] J: Loaded 29574 existing records from primary storage. [2025-09-17T04:29:46.657095] [INFO ] [MAIN ] J: Loaded 29574 existing records. [2025-09-17T04:29:46.834472] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:46.834830] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-17T04:29:46.834901] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-17T04:29:46.835770] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-17T04:29:46.835841] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-17T04:29:47.095256] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-17T04:29:47.195558] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:47.890169] [INFO ] [REMOTE ] J: Fetching primary data for 2024-11. [2025-09-17T04:29:48.151927] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T04:29:48.690236] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-17T04:29:48.823750] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T04:29:48.993062] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:29:49.490147] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-17T04:29:50.290175] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-17T04:29:50.481000] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T04:29:50.489409] [INFO ] [REMOTE ] ITUB: Full fetch complete (77026 records). [2025-09-17T04:29:50.489609] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-17T04:29:50.887872] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-17T04:29:50.888000] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-17T04:29:50.889173] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-17T04:29:50.889242] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-17T04:29:50.890943] [DEBUG] [LOCAL ] ITUB: Trimmed 77026 records to 53304 (keeping 200 days of data) [2025-09-17T04:29:51.006100] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T04:29:51.093374] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-17T04:29:51.171742] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T04:29:51.291222] [DEBUG] [LOCAL ] ITUB: Primary data saved (53304 records). [2025-09-17T04:29:51.291423] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-17T04:29:51.291540] [INFO ] [MAIN ] Update Progress: 1136/2369 symbols completed. ITUB took 46.3s. Estimated remaining: 2h 59m 54s. Rate: 6.9 symbols/min [2025-09-17T04:29:51.461276] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:29:51.500043] [DEBUG] [LOCAL ] JBGS: Loaded 31570 existing records from primary storage. [2025-09-17T04:29:51.500245] [INFO ] [MAIN ] JBGS: Loaded 31570 existing records. [2025-09-17T04:29:51.689552] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T04:29:51.697638] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:29:51.697946] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-17T04:29:51.698010] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-17T04:29:51.698855] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-17T04:29:51.698927] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-17T04:29:51.895229] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-17T04:29:52.059863] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:29:52.690156] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-17T04:29:53.428425] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T04:29:53.490184] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-11. [2025-09-17T04:29:54.290210] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-17T04:29:54.406095] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T04:29:54.888406] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T04:29:55.090195] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-17T04:29:55.721909] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T04:29:55.890134] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-17T04:29:56.444380] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T04:29:56.690212] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-17T04:29:57.490142] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-17T04:29:57.776159] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T04:29:58.065843] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T04:29:58.290144] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-17T04:29:58.970189] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T04:29:59.090139] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-17T04:29:59.167092] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T04:29:59.890163] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-17T04:30:00.690148] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-17T04:30:01.005717] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T04:30:01.490195] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-17T04:30:01.533624] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T04:30:01.581609] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T04:30:02.290149] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-17T04:30:03.090150] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-17T04:30:03.890154] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-17T04:30:05.357518] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (3.87 seconds). [2025-09-17T04:30:05.371249] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-17T04:30:05.499696] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T04:30:05.505003] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-17T04:30:05.671475] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (3.38 seconds). [2025-09-17T04:30:06.290132] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-17T04:30:06.416709] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (3.33 seconds). [2025-09-17T04:30:06.526165] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T04:30:06.900738] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T04:30:07.090166] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-17T04:30:07.890132] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-17T04:30:07.955141] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T04:30:08.472297] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T04:30:08.690180] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-17T04:30:09.490136] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-17T04:30:09.682624] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T04:30:10.014175] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T04:30:10.290167] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-17T04:30:10.389229] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T04:30:11.090141] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-17T04:30:11.745915] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:30:11.890190] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-17T04:30:12.173580] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T04:30:12.690193] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-17T04:30:13.420818] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T04:30:13.490101] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-17T04:30:14.186351] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T04:30:14.290181] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-17T04:30:14.652587] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T04:30:14.657952] [INFO ] [REMOTE ] J: Full fetch complete (59153 records). [2025-09-17T04:30:14.658119] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-17T04:30:15.055918] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-17T04:30:15.056043] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-17T04:30:15.056904] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-17T04:30:15.056962] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-17T04:30:15.058218] [DEBUG] [LOCAL ] J: Trimmed 59153 records to 40591 (keeping 200 days of data) [2025-09-17T04:30:15.117287] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-17T04:30:15.338943] [DEBUG] [LOCAL ] J: Primary data saved (40591 records). [2025-09-17T04:30:15.339177] [INFO ] [MAIN ] J: Full history saved. [2025-09-17T04:30:15.339319] [INFO ] [MAIN ] Update Progress: 1137/2369 symbols completed. J took 28.9s. Estimated remaining: 3h 0m 1s. Rate: 6.8 symbols/min [2025-09-17T04:30:15.523509] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:15.564280] [DEBUG] [LOCAL ] JBI: Loaded 31900 existing records from primary storage. [2025-09-17T04:30:15.564570] [INFO ] [MAIN ] JBI: Loaded 31900 existing records. [2025-09-17T04:30:15.755667] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:15.756145] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-17T04:30:15.756379] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-17T04:30:15.757359] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-17T04:30:15.757437] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-17T04:30:15.905670] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-17T04:30:15.957963] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T04:30:16.181620] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:16.548373] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:30:16.690218] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-11. [2025-09-17T04:30:17.490149] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-17T04:30:18.290131] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-17T04:30:18.717060] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (2.81 seconds). [2025-09-17T04:30:18.949546] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T04:30:19.090173] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-17T04:30:19.289746] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T04:30:19.410114] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-11 (2.72 seconds). [2025-09-17T04:30:19.890204] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-17T04:30:20.687936] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T04:30:20.703258] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-17T04:30:21.490127] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-17T04:30:21.558338] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T04:30:21.642220] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T04:30:21.645138] [INFO ] [REMOTE ] IX: Full fetch complete (26394 records). [2025-09-17T04:30:21.645241] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-17T04:30:22.018475] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-17T04:30:22.018599] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-17T04:30:22.019240] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-17T04:30:22.019306] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-17T04:30:22.021005] [DEBUG] [LOCAL ] IX: Trimmed 26394 records to 22934 (keeping 200 days of data) [2025-09-17T04:30:22.165292] [DEBUG] [LOCAL ] IX: Primary data saved (22934 records). [2025-09-17T04:30:22.165487] [INFO ] [MAIN ] IX: Full history saved. [2025-09-17T04:30:22.165606] [INFO ] [MAIN ] Update Progress: 1138/2369 symbols completed. IX took 37.7s. Estimated remaining: 2h 59m 51s. Rate: 6.8 symbols/min [2025-09-17T04:30:22.295251] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-17T04:30:22.349577] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:22.396716] [DEBUG] [LOCAL ] JBL: Loaded 35457 existing records from primary storage. [2025-09-17T04:30:22.396976] [INFO ] [MAIN ] JBL: Loaded 35457 existing records. [2025-09-17T04:30:22.581905] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:22.582404] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-17T04:30:22.582485] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-17T04:30:22.583349] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-17T04:30:22.583415] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-17T04:30:22.946866] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:22.960556] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T04:30:22.967661] [INFO ] [REMOTE ] JBGS: Full fetch complete (58599 records). [2025-09-17T04:30:22.967785] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-17T04:30:23.095204] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-17T04:30:23.397329] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-17T04:30:23.397438] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-17T04:30:23.398371] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-17T04:30:23.398449] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-17T04:30:23.400194] [DEBUG] [LOCAL ] JBGS: Trimmed 58599 records to 42383 (keeping 200 days of data) [2025-09-17T04:30:23.667230] [DEBUG] [LOCAL ] JBGS: Primary data saved (42383 records). [2025-09-17T04:30:23.667398] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-17T04:30:23.667516] [INFO ] [MAIN ] Update Progress: 1139/2369 symbols completed. JBGS took 32.4s. Estimated remaining: 2h 59m 34s. Rate: 6.8 symbols/min [2025-09-17T04:30:23.846866] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:23.868630] [DEBUG] [LOCAL ] JBND: Loaded 19070 existing records from primary storage. [2025-09-17T04:30:23.868832] [INFO ] [MAIN ] JBND: Loaded 19070 existing records. [2025-09-17T04:30:23.900796] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-11. [2025-09-17T04:30:24.053744] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:24.054167] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-17T04:30:24.054263] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-17T04:30:24.055110] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-17T04:30:24.055188] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-17T04:30:24.178392] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T04:30:24.267754] [INFO ] [REMOTE ] IVZ: Full fetch complete (76518 records). [2025-09-17T04:30:24.335078] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-17T04:30:24.559954] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:24.696735] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-11. [2025-09-17T04:30:24.854888] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-17T04:30:24.855054] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-17T04:30:24.856268] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-17T04:30:24.856405] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-17T04:30:24.858850] [DEBUG] [LOCAL ] IVZ: Trimmed 76518 records to 53141 (keeping 200 days of data) [2025-09-17T04:30:24.983326] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T04:30:25.241551] [DEBUG] [LOCAL ] IVZ: Primary data saved (53141 records). [2025-09-17T04:30:25.241780] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-17T04:30:25.241942] [INFO ] [MAIN ] Update Progress: 1140/2369 symbols completed. IVZ took 45.0s. Estimated remaining: 2h 59m 17s. Rate: 6.9 symbols/min [2025-09-17T04:30:25.419761] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:25.419970] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-17T04:30:25.420021] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-17T04:30:25.420131] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-17T04:30:25.420184] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-17T04:30:25.420236] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-17T04:30:25.420281] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-17T04:30:25.495275] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-17T04:30:25.760620] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T04:30:25.804033] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:25.833994] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T04:30:26.290150] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-17T04:30:26.842833] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T04:30:27.090140] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-17T04:30:27.601784] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T04:30:27.890197] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-17T04:30:28.533054] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T04:30:28.690166] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-17T04:30:28.785148] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T04:30:29.490158] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-17T04:30:30.272546] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T04:30:30.290088] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-11. [2025-09-17T04:30:30.447251] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T04:30:30.495528] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:30.495936] [WARN ] [REMOTE ] JBS: No data returned for month 2024-11 [2025-09-17T04:30:31.090140] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-17T04:30:31.360396] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:31.360771] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-17T04:30:31.890155] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-17T04:30:32.690177] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-17T04:30:33.446289] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T04:30:33.493249] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-17T04:30:33.497942] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T04:30:34.290228] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-17T04:30:35.087750] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T04:30:35.091094] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-17T04:30:35.356149] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T04:30:35.890178] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-17T04:30:36.672145] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T04:30:36.690093] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-17T04:30:37.490142] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-17T04:30:37.658784] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T04:30:37.676533] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:37.677084] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-17T04:30:38.093069] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T04:30:38.290179] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-17T04:30:39.090142] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-17T04:30:39.890174] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-17T04:30:40.087327] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:40.087714] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-17T04:30:40.141196] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T04:30:40.640602] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T04:30:40.690112] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-17T04:30:41.490165] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-17T04:30:41.684877] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:41.685300] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-17T04:30:42.168594] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T04:30:42.290142] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-17T04:30:42.475495] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:42.476030] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-17T04:30:43.090165] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-17T04:30:43.271332] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:43.271622] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-17T04:30:43.890216] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-17T04:30:44.690192] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-17T04:30:45.113182] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T04:30:45.490191] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-17T04:30:46.162985] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T04:30:46.290156] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-17T04:30:46.629408] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T04:30:47.090211] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-17T04:30:47.890138] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-17T04:30:47.924823] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T04:30:48.165270] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T04:30:48.690153] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-17T04:30:49.285885] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T04:30:49.294843] [INFO ] [REMOTE ] JBI: Full fetch complete (64644 records). [2025-09-17T04:30:49.295176] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-17T04:30:49.492304] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-17T04:30:49.702357] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-17T04:30:49.702473] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-17T04:30:49.703428] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-17T04:30:49.703496] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-17T04:30:49.705243] [DEBUG] [LOCAL ] JBI: Trimmed 64644 records to 44256 (keeping 200 days of data) [2025-09-17T04:30:49.982093] [DEBUG] [LOCAL ] JBI: Primary data saved (44256 records). [2025-09-17T04:30:49.982280] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-17T04:30:49.982437] [INFO ] [MAIN ] Update Progress: 1141/2369 symbols completed. JBI took 34.6s. Estimated remaining: 2h 59m 26s. Rate: 6.8 symbols/min [2025-09-17T04:30:50.161351] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:50.188403] [DEBUG] [LOCAL ] JBTM: Loaded 24015 existing records from primary storage. [2025-09-17T04:30:50.188699] [INFO ] [MAIN ] JBTM: Loaded 24015 existing records. [2025-09-17T04:30:50.291136] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-17T04:30:50.372250] [WARN ] [MAIN ] JBTM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:50.372507] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-17T04:30:50.372583] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-17T04:30:50.373537] [DEBUG] [LOCAL ] JBTM: Deleted primary data file. [2025-09-17T04:30:50.373602] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-17T04:30:50.736991] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:50.771066] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T04:30:50.979907] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T04:30:51.090127] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-17T04:30:51.479425] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T04:30:51.890171] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-17T04:30:52.690193] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-17T04:30:52.889597] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T04:30:53.490149] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-17T04:30:53.713683] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T04:30:53.861252] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T04:30:54.290192] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-11. [2025-09-17T04:30:54.512051] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:54.512437] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-11 [2025-09-17T04:30:55.090152] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-17T04:30:55.143614] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T04:30:55.151544] [INFO ] [REMOTE ] JBL: Full fetch complete (69615 records). [2025-09-17T04:30:55.151749] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-17T04:30:55.549131] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-17T04:30:55.549247] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-17T04:30:55.550191] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-17T04:30:55.550252] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-17T04:30:55.551772] [DEBUG] [LOCAL ] JBL: Trimmed 69615 records to 48381 (keeping 200 days of data) [2025-09-17T04:30:55.862556] [DEBUG] [LOCAL ] JBL: Primary data saved (48381 records). [2025-09-17T04:30:55.862751] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-17T04:30:55.862861] [INFO ] [MAIN ] Update Progress: 1142/2369 symbols completed. JBL took 33.7s. Estimated remaining: 2h 59m 14s. Rate: 6.8 symbols/min [2025-09-17T04:30:55.895184] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-17T04:30:56.034341] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:56.041491] [DEBUG] [LOCAL ] JCE: Loaded 4761 existing records from primary storage. [2025-09-17T04:30:56.041629] [INFO ] [MAIN ] JCE: Loaded 4761 existing records. [2025-09-17T04:30:56.220087] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:56.220389] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-17T04:30:56.220479] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-17T04:30:56.220806] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-17T04:30:56.220867] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-17T04:30:56.588411] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:56.690133] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-11. [2025-09-17T04:30:56.867178] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T04:30:56.873480] [INFO ] [REMOTE ] JBS: Full fetch complete (24448 records). [2025-09-17T04:30:56.873622] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-17T04:30:57.066693] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 64 unique days, need 200 days [2025-09-17T04:30:57.067126] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:30:57.067215] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:30:57.067293] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-17T04:30:57.067395] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-17T04:30:57.067466] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-17T04:30:57.067552] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-17T04:30:57.067680] [INFO ] [MAIN ] Update Progress: 1143/2369 symbols completed. JBS took 31.8s. Estimated remaining: 2h 58m 57s. Rate: 6.9 symbols/min [2025-09-17T04:30:57.251748] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:30:57.248028] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T04:30:57.275722] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T04:30:57.322551] [DEBUG] [LOCAL ] JCI: Loaded 39917 existing records from primary storage. [2025-09-17T04:30:57.322772] [INFO ] [MAIN ] JCI: Loaded 39917 existing records. [2025-09-17T04:30:57.499012] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-17T04:30:57.507162] [WARN ] [MAIN ] JCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:30:57.508129] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-17T04:30:57.508211] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-17T04:30:57.509194] [DEBUG] [LOCAL ] JCI: Deleted primary data file. [2025-09-17T04:30:57.509272] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-17T04:30:57.757298] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:30:57.789284] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-17T04:30:57.866936] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:30:58.290151] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-17T04:30:59.019421] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T04:30:59.090145] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-17T04:30:59.890089] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-11. [2025-09-17T04:31:00.365578] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:31:00.690132] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-17T04:31:01.344823] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T04:31:01.490119] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-17T04:31:01.637882] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:31:02.091101] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T04:31:02.290140] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-17T04:31:03.090132] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-17T04:31:03.570408] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T04:31:03.574816] [INFO ] [REMOTE ] JBND: Full fetch complete (32501 records). [2025-09-17T04:31:03.574928] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-17T04:31:03.779010] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T04:31:03.895178] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-17T04:31:03.973711] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-17T04:31:03.973869] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-17T04:31:03.974718] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-17T04:31:03.974781] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-17T04:31:03.975790] [DEBUG] [LOCAL ] JBND: Trimmed 32501 records to 24961 (keeping 200 days of data) [2025-09-17T04:31:04.140051] [DEBUG] [LOCAL ] JBND: Primary data saved (24961 records). [2025-09-17T04:31:04.140222] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-17T04:31:04.140325] [INFO ] [MAIN ] Update Progress: 1144/2369 symbols completed. JBND took 40.5s. Estimated remaining: 2h 58m 47s. Rate: 6.9 symbols/min [2025-09-17T04:31:04.312091] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:04.355835] [DEBUG] [LOCAL ] JEF: Loaded 36773 existing records from primary storage. [2025-09-17T04:31:04.356073] [INFO ] [MAIN ] JEF: Loaded 36773 existing records. [2025-09-17T04:31:04.533578] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:04.533897] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-17T04:31:04.533972] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-17T04:31:04.534939] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-17T04:31:04.535011] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-17T04:31:04.691421] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-17T04:31:04.917182] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:05.213886] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T04:31:05.490165] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-11. [2025-09-17T04:31:06.290164] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-17T04:31:06.573591] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T04:31:07.028188] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T04:31:07.090140] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-17T04:31:07.175565] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T04:31:07.890175] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-17T04:31:08.471512] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T04:31:08.642526] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T04:31:08.690089] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-17T04:31:09.369205] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T04:31:09.490141] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-17T04:31:10.289973] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T04:31:10.290160] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-17T04:31:11.090183] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-17T04:31:11.775473] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T04:31:11.890135] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-17T04:31:11.983695] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T04:31:12.686367] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T04:31:12.688180] [INFO ] [REMOTE ] JCE: Full fetch complete (8788 records). [2025-09-17T04:31:12.688271] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-17T04:31:12.699689] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-17T04:31:13.060907] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-17T04:31:13.061026] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-17T04:31:13.061394] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-17T04:31:13.061456] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-17T04:31:13.061985] [DEBUG] [LOCAL ] JCE: Trimmed 8788 records to 6270 (keeping 200 days of data) [2025-09-17T04:31:13.103573] [DEBUG] [LOCAL ] JCE: Primary data saved (6270 records). [2025-09-17T04:31:13.103786] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-17T04:31:13.103898] [INFO ] [MAIN ] Update Progress: 1145/2369 symbols completed. JCE took 17.2s. Estimated remaining: 2h 58m 38s. Rate: 6.9 symbols/min [2025-09-17T04:31:13.277074] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:13.312276] [DEBUG] [LOCAL ] JELD: Loaded 34406 existing records from primary storage. [2025-09-17T04:31:13.312499] [INFO ] [MAIN ] JELD: Loaded 34406 existing records. [2025-09-17T04:31:13.500926] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-17T04:31:13.506992] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:13.508240] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-17T04:31:13.508307] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-17T04:31:13.509106] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-17T04:31:13.509184] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-17T04:31:13.867220] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:14.290194] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-17T04:31:14.591600] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T04:31:15.090159] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-11. [2025-09-17T04:31:15.208418] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T04:31:15.276592] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T04:31:15.890148] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-17T04:31:16.605772] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T04:31:16.690181] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-17T04:31:17.490196] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-17T04:31:17.710449] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T04:31:18.111733] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T04:31:18.290171] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-17T04:31:19.090127] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-17T04:31:19.148892] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:31:19.468940] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T04:31:19.890202] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-17T04:31:20.555377] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T04:31:20.690123] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-17T04:31:21.490217] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-17T04:31:21.710470] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T04:31:22.006004] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T04:31:22.290221] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-17T04:31:23.090097] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-17T04:31:23.136757] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T04:31:23.568960] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T04:31:23.890197] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-17T04:31:24.474774] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T04:31:24.690187] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-17T04:31:25.330790] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T04:31:25.490193] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-17T04:31:26.290170] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-17T04:31:26.421312] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T04:31:26.503095] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T04:31:27.090195] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-17T04:31:27.890126] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-17T04:31:27.934796] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T04:31:28.442441] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T04:31:28.690152] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-17T04:31:29.362105] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T04:31:29.490531] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-17T04:31:29.998700] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T04:31:30.290225] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-17T04:31:31.090119] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-17T04:31:31.233749] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:31:31.890156] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-17T04:31:32.174453] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T04:31:32.690229] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-17T04:31:32.792895] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T04:31:33.214230] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T04:31:33.490187] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-17T04:31:34.037896] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T04:31:34.042345] [INFO ] [REMOTE ] JBTM: Full fetch complete (40552 records). [2025-09-17T04:31:34.042498] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-17T04:31:34.232606] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 175 unique days, need 200 days [2025-09-17T04:31:34.233105] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:31:34.233156] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:31:34.233201] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-17T04:31:34.233264] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-17T04:31:34.233315] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-17T04:31:34.233677] [DEBUG] [LOCAL ] JBTM: Deleted derivative data file. [2025-09-17T04:31:34.233775] [INFO ] [MAIN ] Update Progress: 1146/2369 symbols completed. JBTM took 44.3s. Estimated remaining: 2h 58m 43s. Rate: 6.8 symbols/min [2025-09-17T04:31:34.296989] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-17T04:31:34.410085] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:34.418469] [DEBUG] [LOCAL ] JEQ: Loaded 5934 existing records from primary storage. [2025-09-17T04:31:34.418636] [INFO ] [MAIN ] JEQ: Loaded 5934 existing records. [2025-09-17T04:31:34.604317] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:34.604628] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-17T04:31:34.604709] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-17T04:31:34.604985] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-17T04:31:34.605043] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-17T04:31:34.976546] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:35.005680] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T04:31:35.090182] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-11. [2025-09-17T04:31:35.637210] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T04:31:35.890154] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-17T04:31:36.108351] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T04:31:36.548105] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T04:31:36.690123] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-17T04:31:37.319620] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T04:31:37.490218] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-17T04:31:37.588340] [DEBUG] [REMOTE ] JCI: Error fetching primary data for 2025-09: 'API call returned an empty response.' [2025-09-17T04:31:37.588749] [WARN ] [REMOTE ] JCI: No data returned for month 2025-09 [2025-09-17T04:31:37.588842] [INFO ] [REMOTE ] JCI: Full fetch complete (72964 records). [2025-09-17T04:31:37.588937] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-17T04:31:37.590507] [FATAL] [VALIDATOR ] JCI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T04:31:37.590623] [FATAL] [MAIN ] JCI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:31:37.590695] [WARN ] [MAIN ] JCI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:31:37.590743] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-17T04:31:37.590823] [DEBUG] [LOCAL ] JCI: No primary data file found to delete. [2025-09-17T04:31:37.590941] [INFO ] [LOCAL ] JCI: Starting deletion of derivative data. [2025-09-17T04:31:37.591340] [DEBUG] [LOCAL ] JCI: Deleted derivative data file. [2025-09-17T04:31:37.591483] [INFO ] [MAIN ] Update Progress: 1147/2369 symbols completed. JCI took 40.5s. Estimated remaining: 2h 58m 28s. Rate: 6.8 symbols/min [2025-09-17T04:31:37.774126] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:37.796170] [DEBUG] [LOCAL ] JFR: Loaded 21662 existing records from primary storage. [2025-09-17T04:31:37.796362] [INFO ] [MAIN ] JFR: Loaded 21662 existing records. [2025-09-17T04:31:37.976722] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:37.976971] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-17T04:31:37.977032] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-17T04:31:37.977815] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-17T04:31:37.977881] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-17T04:31:38.295323] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-17T04:31:38.362473] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:38.973376] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T04:31:39.090220] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-17T04:31:39.890158] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-17T04:31:40.015912] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T04:31:40.690208] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-17T04:31:41.416020] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T04:31:41.490101] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-17T04:31:41.633879] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T04:31:42.199962] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T04:31:42.290175] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-11. [2025-09-17T04:31:43.090108] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-17T04:31:43.550412] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T04:31:43.554306] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T04:31:43.890142] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-17T04:31:44.690165] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-17T04:31:45.213512] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:31:45.390264] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T04:31:45.490204] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-17T04:31:46.290175] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-17T04:31:46.702362] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T04:31:47.090144] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-17T04:31:47.848592] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T04:31:47.890127] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-17T04:31:48.582957] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T04:31:48.690170] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-17T04:31:49.141739] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T04:31:49.490388] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-17T04:31:50.085695] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T04:31:50.290151] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-17T04:31:51.051390] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T04:31:51.090191] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-17T04:31:51.461848] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T04:31:51.890161] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-17T04:31:51.955989] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T04:31:52.690196] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-17T04:31:53.490222] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-17T04:31:53.522409] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T04:31:53.528434] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T04:31:53.530278] [INFO ] [REMOTE ] JEQ: Full fetch complete (11228 records). [2025-09-17T04:31:53.530410] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-17T04:31:53.530494] [INFO ] [REMOTE ] JEF: Full fetch complete (72601 records). [2025-09-17T04:31:53.536214] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-17T04:31:54.272373] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-17T04:31:54.278618] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-17T04:31:54.294154] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-17T04:31:54.295560] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-17T04:31:54.312824] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-17T04:31:54.392518] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-17T04:31:54.392897] [DEBUG] [LOCAL ] JEQ: Trimmed 11228 records to 8973 (keeping 200 days of data) [2025-09-17T04:31:54.393405] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-17T04:31:54.395765] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-17T04:31:54.396196] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-17T04:31:54.449088] [DEBUG] [LOCAL ] JEF: Trimmed 72601 records to 49988 (keeping 200 days of data) [2025-09-17T04:31:54.523798] [DEBUG] [LOCAL ] JEQ: Primary data saved (8973 records). [2025-09-17T04:31:54.537840] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-17T04:31:54.567226] [INFO ] [MAIN ] Update Progress: 1148/2369 symbols completed. JEQ took 20.3s. Estimated remaining: 2h 58m 28s. Rate: 6.8 symbols/min [2025-09-17T04:31:54.760821] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:54.791030] [DEBUG] [LOCAL ] JGH: Loaded 8121 existing records from primary storage. [2025-09-17T04:31:54.856890] [INFO ] [MAIN ] JGH: Loaded 8121 existing records. [2025-09-17T04:31:54.977998] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T04:31:55.031442] [INFO ] [REMOTE ] JELD: Full fetch complete (63014 records). [2025-09-17T04:31:55.064871] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-17T04:31:55.108210] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:55.164444] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-17T04:31:55.185889] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-17T04:31:55.191909] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-17T04:31:55.197334] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-17T04:31:55.848946] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-17T04:31:55.876242] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-17T04:31:55.880740] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-17T04:31:55.881148] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-17T04:31:55.975014] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:55.977314] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T04:31:55.978717] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-11. [2025-09-17T04:31:55.989021] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-17T04:31:55.994660] [DEBUG] [LOCAL ] JELD: Trimmed 63014 records to 46260 (keeping 200 days of data) [2025-09-17T04:31:56.054160] [DEBUG] [LOCAL ] JEF: Primary data saved (49988 records). [2025-09-17T04:31:56.080532] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-17T04:31:56.084821] [INFO ] [MAIN ] Update Progress: 1149/2369 symbols completed. JEF took 51.9s. Estimated remaining: 2h 58m 11s. Rate: 6.8 symbols/min [2025-09-17T04:31:56.279226] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:56.414249] [DEBUG] [LOCAL ] JHG: Loaded 35502 existing records from primary storage. [2025-09-17T04:31:56.415401] [INFO ] [MAIN ] JHG: Loaded 35502 existing records. [2025-09-17T04:31:56.630802] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:56.632395] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-17T04:31:56.633289] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-17T04:31:56.634254] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-17T04:31:56.635146] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-17T04:31:56.753230] [DEBUG] [LOCAL ] JELD: Primary data saved (46260 records). [2025-09-17T04:31:56.763700] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-17T04:31:56.820986] [INFO ] [MAIN ] Update Progress: 1150/2369 symbols completed. JELD took 43.7s. Estimated remaining: 2h 57m 54s. Rate: 6.9 symbols/min [2025-09-17T04:31:56.989122] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T04:31:57.015379] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-17T04:31:57.143178] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:57.190809] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:31:57.197126] [DEBUG] [LOCAL ] JHI: Loaded 2505 existing records from primary storage. [2025-09-17T04:31:57.197260] [INFO ] [MAIN ] JHI: Loaded 2505 existing records. [2025-09-17T04:31:57.377512] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:31:57.383490] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-17T04:31:57.392896] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-17T04:31:57.393870] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T04:31:57.393907] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-17T04:31:57.394061] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-17T04:31:57.498255] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-17T04:31:57.759262] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:31:57.889078] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T04:31:58.290142] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-17T04:31:58.957567] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:31:58.971560] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T04:31:59.090125] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-17T04:31:59.508361] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T04:31:59.890130] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-11. [2025-09-17T04:32:00.690147] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-17T04:32:01.490138] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-11. [2025-09-17T04:32:01.554506] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T04:32:01.917965] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T04:32:02.010697] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T04:32:02.290146] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-17T04:32:03.090166] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-17T04:32:03.546691] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:32:03.550743] [INFO ] [REMOTE ] JFR: Full fetch complete (47868 records). [2025-09-17T04:32:03.550862] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-17T04:32:03.681681] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T04:32:03.895334] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-17T04:32:03.971541] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-17T04:32:03.971693] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-17T04:32:03.972803] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-17T04:32:03.972934] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-17T04:32:03.974358] [DEBUG] [LOCAL ] JFR: Trimmed 47868 records to 30705 (keeping 200 days of data) [2025-09-17T04:32:04.182594] [DEBUG] [LOCAL ] JFR: Primary data saved (30705 records). [2025-09-17T04:32:04.182894] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-17T04:32:04.183051] [INFO ] [MAIN ] Update Progress: 1151/2369 symbols completed. JFR took 26.6s. Estimated remaining: 2h 57m 44s. Rate: 6.9 symbols/min [2025-09-17T04:32:04.361932] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:04.366242] [DEBUG] [LOCAL ] JHS: Loaded 2298 existing records from primary storage. [2025-09-17T04:32:04.366344] [INFO ] [MAIN ] JHS: Loaded 2298 existing records. [2025-09-17T04:32:04.546487] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:04.546823] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-17T04:32:04.546886] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-17T04:32:04.547137] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-17T04:32:04.547194] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-17T04:32:04.651746] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T04:32:04.695277] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-17T04:32:04.911309] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:05.490226] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-17T04:32:06.269133] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T04:32:06.290098] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-17T04:32:06.457683] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T04:32:07.090220] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-17T04:32:07.166472] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T04:32:07.585556] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T04:32:07.890213] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-11. [2025-09-17T04:32:08.245611] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T04:32:08.690210] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-17T04:32:09.490202] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-17T04:32:10.267230] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:32:10.296009] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-17T04:32:10.315683] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T04:32:10.675190] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-17T04:32:11.090137] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-17T04:32:11.890153] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-17T04:32:12.644116] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T04:32:12.690152] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-17T04:32:12.702568] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T04:32:13.490152] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-17T04:32:14.119001] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T04:32:14.290161] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-17T04:32:14.510088] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T04:32:14.938865] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T04:32:15.090136] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-17T04:32:15.635803] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T04:32:15.890145] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-17T04:32:16.381685] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-17T04:32:16.690171] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-17T04:32:17.490153] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-17T04:32:17.504389] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T04:32:18.290156] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-17T04:32:19.090115] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-17T04:32:19.145693] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T04:32:19.215939] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T04:32:19.218837] [INFO ] [REMOTE ] JGH: Full fetch complete (14595 records). [2025-09-17T04:32:19.218956] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-17T04:32:19.588372] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-17T04:32:19.588521] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-17T04:32:19.589065] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-17T04:32:19.589130] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-17T04:32:19.589873] [DEBUG] [LOCAL ] JGH: Trimmed 14595 records to 10937 (keeping 200 days of data) [2025-09-17T04:32:19.662523] [DEBUG] [LOCAL ] JGH: Primary data saved (10937 records). [2025-09-17T04:32:19.662730] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-17T04:32:19.662844] [INFO ] [MAIN ] Update Progress: 1152/2369 symbols completed. JGH took 25.1s. Estimated remaining: 2h 57m 42s. Rate: 6.8 symbols/min [2025-09-17T04:32:19.770908] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T04:32:19.845840] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:19.882867] [DEBUG] [LOCAL ] JHX: Loaded 39604 existing records from primary storage. [2025-09-17T04:32:19.883043] [INFO ] [MAIN ] JHX: Loaded 39604 existing records. [2025-09-17T04:32:19.895237] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-17T04:32:20.077948] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:20.078570] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-17T04:32:20.078707] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-17T04:32:20.079533] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-17T04:32:20.079598] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-17T04:32:20.465827] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:20.471903] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T04:32:20.690183] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-11. [2025-09-17T04:32:21.490190] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-17T04:32:21.555577] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T04:32:21.842690] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T04:32:22.290199] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-17T04:32:23.090149] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-17T04:32:23.291894] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T04:32:23.890157] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-17T04:32:24.690236] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-17T04:32:24.749471] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T04:32:24.801819] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T04:32:25.184155] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T04:32:25.490237] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-17T04:32:25.807560] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-17T04:32:26.290222] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-17T04:32:26.853453] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T04:32:27.090174] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-17T04:32:27.564790] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T04:32:27.890155] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-17T04:32:28.359737] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T04:32:28.690161] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-17T04:32:29.491268] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-17T04:32:29.494819] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T04:32:30.191747] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T04:32:30.193203] [INFO ] [REMOTE ] JHI: Full fetch complete (5285 records). [2025-09-17T04:32:30.193306] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-17T04:32:30.295331] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-17T04:32:30.569571] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-17T04:32:30.569700] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-17T04:32:30.569926] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-17T04:32:30.569986] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-17T04:32:30.570393] [DEBUG] [LOCAL ] JHI: Trimmed 5285 records to 3757 (keeping 200 days of data) [2025-09-17T04:32:30.594536] [DEBUG] [LOCAL ] JHI: Primary data saved (3757 records). [2025-09-17T04:32:30.594706] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-17T04:32:30.594832] [INFO ] [MAIN ] Update Progress: 1153/2369 symbols completed. JHI took 33.7s. Estimated remaining: 2h 57m 36s. Rate: 6.8 symbols/min [2025-09-17T04:32:30.768298] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:30.782140] [DEBUG] [LOCAL ] JILL: Loaded 11627 existing records from primary storage. [2025-09-17T04:32:30.782294] [INFO ] [MAIN ] JILL: Loaded 11627 existing records. [2025-09-17T04:32:30.966789] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:30.967097] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-17T04:32:30.967169] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-17T04:32:30.967607] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-17T04:32:30.967693] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-17T04:32:31.095304] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-17T04:32:31.349873] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:31.518271] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T04:32:31.890145] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-11. [2025-09-17T04:32:32.654712] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T04:32:32.690125] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-17T04:32:32.805560] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T04:32:33.490139] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-17T04:32:34.042094] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T04:32:34.206719] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T04:32:34.290173] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-17T04:32:35.090181] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-17T04:32:35.553745] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T04:32:35.890439] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T04:32:35.890550] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-17T04:32:36.690197] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-17T04:32:37.475774] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T04:32:37.490075] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-17T04:32:37.681947] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T04:32:38.290209] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-17T04:32:39.090211] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-17T04:32:39.172221] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T04:32:39.303216] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T04:32:39.890152] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-17T04:32:40.573033] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T04:32:40.678832] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T04:32:40.690079] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-17T04:32:41.490202] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-17T04:32:41.702468] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T04:32:42.290139] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-17T04:32:42.753987] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T04:32:42.982829] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T04:32:42.988835] [INFO ] [REMOTE ] JHG: Full fetch complete (68575 records). [2025-09-17T04:32:42.988994] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-17T04:32:43.090632] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-17T04:32:43.377787] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-17T04:32:43.377896] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-17T04:32:43.378897] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-17T04:32:43.378972] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-17T04:32:43.380474] [DEBUG] [LOCAL ] JHG: Trimmed 68575 records to 48272 (keeping 200 days of data) [2025-09-17T04:32:43.685952] [DEBUG] [LOCAL ] JHG: Primary data saved (48272 records). [2025-09-17T04:32:43.686159] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-17T04:32:43.686287] [INFO ] [MAIN ] Update Progress: 1154/2369 symbols completed. JHG took 47.6s. Estimated remaining: 2h 57m 32s. Rate: 6.8 symbols/min [2025-09-17T04:32:43.857554] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:43.870751] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T04:32:43.893326] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-17T04:32:43.909216] [DEBUG] [LOCAL ] JKS: Loaded 28572 existing records from primary storage. [2025-09-17T04:32:43.909397] [INFO ] [MAIN ] JKS: Loaded 28572 existing records. [2025-09-17T04:32:44.088332] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:44.088599] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-17T04:32:44.088800] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-17T04:32:44.089505] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-17T04:32:44.089567] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-17T04:32:44.455538] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:44.690150] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-17T04:32:44.767384] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T04:32:45.490219] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-11. [2025-09-17T04:32:46.290202] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-17T04:32:46.488694] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T04:32:46.861682] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T04:32:46.946025] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T04:32:46.947488] [INFO ] [REMOTE ] JHS: Full fetch complete (4477 records). [2025-09-17T04:32:46.947618] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-17T04:32:47.095925] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-17T04:32:47.321121] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-17T04:32:47.321230] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-17T04:32:47.321396] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-17T04:32:47.321447] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-17T04:32:47.321847] [DEBUG] [LOCAL ] JHS: Trimmed 4477 records to 2951 (keeping 200 days of data) [2025-09-17T04:32:47.340451] [DEBUG] [LOCAL ] JHS: Primary data saved (2951 records). [2025-09-17T04:32:47.340527] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-17T04:32:47.340625] [INFO ] [MAIN ] Update Progress: 1155/2369 symbols completed. JHS took 43.2s. Estimated remaining: 2h 57m 18s. Rate: 6.8 symbols/min [2025-09-17T04:32:47.515014] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:47.546096] [DEBUG] [LOCAL ] JLL: Loaded 24106 existing records from primary storage. [2025-09-17T04:32:47.546307] [INFO ] [MAIN ] JLL: Loaded 24106 existing records. [2025-09-17T04:32:47.750297] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:47.750573] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-17T04:32:47.750635] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-17T04:32:47.751230] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-17T04:32:47.751293] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-17T04:32:47.895356] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-17T04:32:48.127088] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:48.690169] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-11. [2025-09-17T04:32:48.981681] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T04:32:49.005047] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T04:32:49.490124] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-17T04:32:49.965840] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T04:32:50.290138] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-17T04:32:51.090180] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-17T04:32:51.417940] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T04:32:51.424551] [INFO ] [REMOTE ] JHX: Full fetch complete (55162 records). [2025-09-17T04:32:51.424763] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-17T04:32:51.839726] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-17T04:32:51.839845] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-17T04:32:51.840716] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-17T04:32:51.840776] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-17T04:32:51.842024] [DEBUG] [LOCAL ] JHX: Trimmed 55162 records to 48640 (keeping 200 days of data) [2025-09-17T04:32:51.900077] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-17T04:32:52.133123] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T04:32:52.206360] [DEBUG] [LOCAL ] JHX: Primary data saved (48640 records). [2025-09-17T04:32:52.206567] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-17T04:32:52.206717] [INFO ] [MAIN ] Update Progress: 1156/2369 symbols completed. JHX took 32.5s. Estimated remaining: 2h 57m 5s. Rate: 6.9 symbols/min [2025-09-17T04:32:52.380731] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:32:52.398822] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T04:32:52.407697] [DEBUG] [LOCAL ] JLS: Loaded 2896 existing records from primary storage. [2025-09-17T04:32:52.408840] [INFO ] [MAIN ] JLS: Loaded 2896 existing records. [2025-09-17T04:32:52.590978] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:32:52.591271] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-17T04:32:52.591332] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-17T04:32:52.591613] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-17T04:32:52.591698] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-17T04:32:52.692965] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-17T04:32:52.964159] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T04:32:52.970037] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:32:53.490152] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-17T04:32:53.983360] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T04:32:54.046637] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T04:32:54.290139] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-17T04:32:55.090175] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-17T04:32:55.895320] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-11. [2025-09-17T04:32:55.910453] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T04:32:56.266623] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T04:32:56.460419] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T04:32:56.690145] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-17T04:32:57.490142] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-17T04:32:58.195056] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T04:32:58.232184] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T04:32:58.290161] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-17T04:32:59.090152] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-17T04:32:59.221613] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T04:32:59.225530] [INFO ] [REMOTE ] JILL: Full fetch complete (23040 records). [2025-09-17T04:32:59.225694] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-17T04:32:59.625610] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-17T04:32:59.625788] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-17T04:32:59.626375] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-17T04:32:59.626432] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-17T04:32:59.628496] [DEBUG] [LOCAL ] JILL: Trimmed 23040 records to 16699 (keeping 200 days of data) [2025-09-17T04:32:59.736729] [DEBUG] [LOCAL ] JILL: Primary data saved (16699 records). [2025-09-17T04:32:59.736919] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-17T04:32:59.737079] [INFO ] [MAIN ] Update Progress: 1157/2369 symbols completed. JILL took 29.1s. Estimated remaining: 2h 56m 55s. Rate: 6.9 symbols/min [2025-09-17T04:32:59.890167] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-17T04:33:00.451834] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T04:33:00.614127] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:33:00.690133] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-17T04:33:01.085810] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T04:33:01.490173] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-17T04:33:02.290236] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-17T04:33:03.090228] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-17T04:33:04.532223] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (3.04 seconds). [2025-09-17T04:33:04.539731] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-17T04:33:04.622507] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T04:33:04.690077] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-17T04:33:05.503660] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T04:33:05.505676] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-17T04:33:05.782241] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (3.49 seconds). [2025-09-17T04:33:06.098282] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T04:33:06.231938] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T04:33:06.290153] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-17T04:33:07.090153] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-17T04:33:07.867437] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T04:33:07.890155] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-17T04:33:08.215873] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-17T04:33:08.654820] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T04:33:08.690099] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-17T04:33:09.490165] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-17T04:33:09.928095] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T04:33:10.142323] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T04:33:10.290164] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-17T04:33:11.090191] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-17T04:33:11.814669] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T04:33:11.890141] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-17T04:33:12.388692] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T04:33:12.469316] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T04:33:12.690182] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-17T04:33:13.490149] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-17T04:33:14.024498] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T04:33:14.054704] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T04:33:14.055877] [INFO ] [REMOTE ] JLS: Full fetch complete (5724 records). [2025-09-17T04:33:14.055965] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-17T04:33:14.298929] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-17T04:33:14.428348] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-17T04:33:14.428466] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-17T04:33:14.428675] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-17T04:33:14.428762] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-17T04:33:14.429186] [DEBUG] [LOCAL ] JLS: Trimmed 5724 records to 4101 (keeping 200 days of data) [2025-09-17T04:33:14.454393] [DEBUG] [LOCAL ] JLS: Primary data saved (4101 records). [2025-09-17T04:33:14.454532] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-17T04:33:14.454719] [INFO ] [MAIN ] Update Progress: 1158/2369 symbols completed. JLS took 22.2s. Estimated remaining: 2h 56m 52s. Rate: 6.8 symbols/min [2025-09-17T04:33:15.090238] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-17T04:33:15.968340] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T04:33:15.976139] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-17T04:33:17.057381] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-17T04:33:17.062557] [INFO ] [REMOTE ] JKS: Full fetch complete (59675 records). [2025-09-17T04:33:17.062720] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-17T04:33:17.445424] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-17T04:33:17.445555] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-17T04:33:17.446488] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-17T04:33:17.446552] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-17T04:33:17.448091] [DEBUG] [LOCAL ] JKS: Trimmed 59675 records to 40291 (keeping 200 days of data) [2025-09-17T04:33:17.722451] [DEBUG] [LOCAL ] JKS: Primary data saved (40291 records). [2025-09-17T04:33:17.722676] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-17T04:33:17.722832] [INFO ] [MAIN ] Update Progress: 1159/2369 symbols completed. JKS took 34.0s. Estimated remaining: 2h 56m 38s. Rate: 6.9 symbols/min [2025-09-17T04:33:17.887226] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T04:33:17.896967] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-17T04:33:19.239986] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T04:33:19.245910] [INFO ] [REMOTE ] JLL: Full fetch complete (44605 records). [2025-09-17T04:33:19.246219] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-17T04:33:19.667878] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-17T04:33:19.668005] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-17T04:33:19.668817] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-17T04:33:19.668880] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-17T04:33:19.670783] [DEBUG] [LOCAL ] JLL: Trimmed 44605 records to 32308 (keeping 200 days of data) [2025-09-17T04:33:19.889488] [DEBUG] [LOCAL ] JLL: Primary data saved (32308 records). [2025-09-17T04:33:19.889764] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-17T04:33:19.889900] [INFO ] [MAIN ] Update Progress: 1160/2369 symbols completed. JLL took 32.5s. Estimated remaining: 2h 56m 22s. Rate: 6.9 symbols/min [2025-09-17T04:33:20.534744] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:20.662058] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:20.670829] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-17T04:33:20.674393] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:20.699571] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:20.700554] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-17T04:33:20.704592] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-17T04:33:20.704843] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-17T04:33:20.704906] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-17T04:33:20.704963] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-17T04:33:21.053241] [DEBUG] [LOCAL ] JMIA: Loaded 37976 existing records from primary storage. [2025-09-17T04:33:21.081047] [DEBUG] [LOCAL ] JNJ: Loaded 40103 existing records from primary storage. [2025-09-17T04:33:21.081171] [INFO ] [MAIN ] JMIA: Loaded 37976 existing records. [2025-09-17T04:33:21.118708] [INFO ] [MAIN ] JNJ: Loaded 40103 existing records. [2025-09-17T04:33:21.075054] [DEBUG] [LOCAL ] JOBY: Loaded 40161 existing records from primary storage. [2025-09-17T04:33:21.125056] [INFO ] [MAIN ] JOBY: Loaded 40161 existing records. [2025-09-17T04:33:21.337195] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:21.414358] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-11. [2025-09-17T04:33:21.805178] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:21.805848] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:21.815030] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:21.815554] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-17T04:33:21.816310] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-17T04:33:21.816705] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-17T04:33:21.816867] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-17T04:33:21.817031] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-17T04:33:21.817341] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-17T04:33:21.818357] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-17T04:33:21.818389] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-17T04:33:21.818631] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-17T04:33:21.831441] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-17T04:33:21.823877] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-17T04:33:21.870033] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-17T04:33:22.044206] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T04:33:22.074258] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-17T04:33:22.553907] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T04:33:22.616366] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-17T04:33:22.884063] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:22.889469] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:22.906418] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-11. [2025-09-17T04:33:22.900964] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-11. [2025-09-17T04:33:22.980501] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:22.980976] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-11. [2025-09-17T04:33:23.003363] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-17T04:33:23.004312] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-17T04:33:23.424089] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T04:33:23.425232] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-17T04:33:23.717444] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T04:33:23.890154] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-17T04:33:24.333528] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T04:33:24.693761] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-17T04:33:24.708043] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T04:33:25.143170] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-17T04:33:25.484787] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T04:33:25.496312] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-17T04:33:25.515627] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-11 (2.61 seconds). [2025-09-17T04:33:25.978179] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T04:33:26.290198] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-17T04:33:26.767442] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T04:33:27.090201] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-17T04:33:27.890143] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-17T04:33:28.690164] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-17T04:33:28.874668] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T04:33:29.490149] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-17T04:33:30.290248] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-17T04:33:30.504951] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.61 seconds). [2025-09-17T04:33:30.733184] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T04:33:31.090124] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-17T04:33:31.166862] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T04:33:31.280029] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.59 seconds). [2025-09-17T04:33:31.553284] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T04:33:31.554135] [INFO ] [REMOTE ] JMM: Full fetch complete (2265 records). [2025-09-17T04:33:31.554247] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-17T04:33:31.742773] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-17T04:33:31.742995] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:33:31.743082] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:33:31.743153] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-17T04:33:31.743242] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-17T04:33:31.743322] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-17T04:33:31.743410] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-17T04:33:31.743514] [INFO ] [MAIN ] Update Progress: 1161/2369 symbols completed. JMM took 11.9s. Estimated remaining: 2h 56m 16s. Rate: 6.9 symbols/min [2025-09-17T04:33:31.913628] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-17T04:33:31.917144] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:31.939725] [DEBUG] [LOCAL ] JOE: Loaded 17782 existing records from primary storage. [2025-09-17T04:33:31.939880] [INFO ] [MAIN ] JOE: Loaded 17782 existing records. [2025-09-17T04:33:32.118442] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:32.118726] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-17T04:33:32.118808] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-17T04:33:32.119335] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-17T04:33:32.119411] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-17T04:33:32.497296] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:32.690148] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-17T04:33:33.490202] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-17T04:33:34.222772] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-17T04:33:34.290116] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-17T04:33:34.552514] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T04:33:35.090261] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-17T04:33:35.890167] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-11. [2025-09-17T04:33:35.950826] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-17T04:33:36.428654] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-17T04:33:36.690135] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-17T04:33:36.745465] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T04:33:36.846183] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T04:33:37.490145] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-17T04:33:38.290148] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-17T04:33:38.991266] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-17T04:33:39.090143] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-17T04:33:39.250363] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T04:33:39.890200] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-17T04:33:40.062785] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T04:33:40.690191] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-17T04:33:41.369989] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T04:33:41.490077] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-17T04:33:41.603329] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-17T04:33:42.290214] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-17T04:33:42.673320] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T04:33:43.090112] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-17T04:33:43.222625] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T04:33:43.410558] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T04:33:43.890206] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-17T04:33:44.690162] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-17T04:33:45.387877] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.30 seconds). [2025-09-17T04:33:45.490099] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-17T04:33:45.643535] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T04:33:45.982179] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T04:33:46.290147] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-17T04:33:47.090095] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-17T04:33:47.376804] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T04:33:47.890183] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-17T04:33:48.673188] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-17T04:33:48.690089] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-17T04:33:48.933461] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T04:33:49.490290] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-17T04:33:50.248547] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-17T04:33:50.290077] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-17T04:33:51.098229] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-17T04:33:51.100996] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-17T04:33:51.164199] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T04:33:51.171166] [INFO ] [REMOTE ] JMIA: Full fetch complete (73048 records). [2025-09-17T04:33:51.171374] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-17T04:33:51.600860] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-17T04:33:51.601029] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-17T04:33:51.602356] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-17T04:33:51.602459] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-17T04:33:51.604689] [DEBUG] [LOCAL ] JMIA: Trimmed 73048 records to 50420 (keeping 200 days of data) [2025-09-17T04:33:51.894780] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-17T04:33:51.970072] [DEBUG] [LOCAL ] JMIA: Primary data saved (50420 records). [2025-09-17T04:33:51.970326] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-17T04:33:51.970455] [INFO ] [MAIN ] Update Progress: 1162/2369 symbols completed. JMIA took 32.1s. Estimated remaining: 2h 56m 20s. Rate: 6.8 symbols/min [2025-09-17T04:33:52.182415] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:52.200332] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T04:33:52.209097] [DEBUG] [LOCAL ] JOF: Loaded 5071 existing records from primary storage. [2025-09-17T04:33:52.209256] [INFO ] [MAIN ] JOF: Loaded 5071 existing records. [2025-09-17T04:33:52.429455] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:52.430037] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-17T04:33:52.430176] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-17T04:33:52.430796] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-17T04:33:52.430895] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-17T04:33:52.695231] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-17T04:33:52.790894] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-17T04:33:52.894575] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:53.490137] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-17T04:33:53.869605] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T04:33:54.147777] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T04:33:54.290166] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-17T04:33:55.090096] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-17T04:33:55.193057] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T04:33:55.608527] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-17T04:33:55.615557] [INFO ] [REMOTE ] JNJ: Full fetch complete (77782 records). [2025-09-17T04:33:55.615788] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-17T04:33:55.895341] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-17T04:33:56.022603] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-17T04:33:56.022763] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-17T04:33:56.023924] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-17T04:33:56.023997] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-17T04:33:56.025694] [DEBUG] [LOCAL ] JNJ: Trimmed 77782 records to 53753 (keeping 200 days of data) [2025-09-17T04:33:56.380851] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-09-17T04:33:56.381029] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-17T04:33:56.381145] [INFO ] [MAIN ] Update Progress: 1163/2369 symbols completed. JNJ took 36.5s. Estimated remaining: 2h 56m 6s. Rate: 6.8 symbols/min [2025-09-17T04:33:56.560004] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:33:56.586371] [DEBUG] [LOCAL ] JPC: Loaded 27000 existing records from primary storage. [2025-09-17T04:33:56.586559] [INFO ] [MAIN ] JPC: Loaded 27000 existing records. [2025-09-17T04:33:56.707593] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-11. [2025-09-17T04:33:56.792857] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:33:56.793126] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-17T04:33:56.793188] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-17T04:33:56.793891] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-17T04:33:56.793962] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-17T04:33:57.161995] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:33:57.179827] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T04:33:57.324768] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T04:33:57.495963] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-17T04:33:57.502164] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-17T04:33:58.290164] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-17T04:33:58.631137] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T04:33:59.090136] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-17T04:33:59.890156] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-11. [2025-09-17T04:33:59.953822] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T04:34:00.690193] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-17T04:34:00.995228] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.71 seconds). [2025-09-17T04:34:01.119679] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T04:34:01.464583] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T04:34:01.490119] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-17T04:34:02.077689] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T04:34:02.290145] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-17T04:34:03.090154] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-17T04:34:03.692026] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T04:34:03.890212] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-17T04:34:04.690140] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-17T04:34:04.861805] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (2.57 seconds). [2025-09-17T04:34:04.868432] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-17T04:34:04.868619] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-17T04:34:05.259478] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T04:34:05.285865] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-17T04:34:05.286068] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-17T04:34:05.287276] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-17T04:34:05.287843] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-17T04:34:05.289385] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53798 (keeping 200 days of data) [2025-09-17T04:34:05.504859] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-17T04:34:05.627880] [DEBUG] [LOCAL ] JOBY: Primary data saved (53798 records). [2025-09-17T04:34:05.628101] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-17T04:34:05.628239] [INFO ] [MAIN ] Update Progress: 1164/2369 symbols completed. JOBY took 45.7s. Estimated remaining: 2h 55m 58s. Rate: 6.8 symbols/min [2025-09-17T04:34:05.797405] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:05.803382] [DEBUG] [LOCAL ] JPI: Loaded 3856 existing records from primary storage. [2025-09-17T04:34:05.803538] [INFO ] [MAIN ] JPI: Loaded 3856 existing records. [2025-09-17T04:34:05.979027] [WARN ] [MAIN ] JPI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:05.979864] [INFO ] [MAIN ] JPI: Wiping existing primary data before full refresh. [2025-09-17T04:34:05.979983] [INFO ] [LOCAL ] JPI: Starting deletion of primary data. [2025-09-17T04:34:05.980365] [DEBUG] [LOCAL ] JPI: Deleted primary data file. [2025-09-17T04:34:05.980420] [INFO ] [MAIN ] JPI: Starting full primary refresh. [2025-09-17T04:34:06.309574] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-17T04:34:06.340582] [INFO ] [REMOTE ] JPI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:06.347126] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T04:34:06.375763] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T04:34:07.090138] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-17T04:34:07.425153] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T04:34:07.429048] [INFO ] [REMOTE ] JOE: Full fetch complete (36397 records). [2025-09-17T04:34:07.429154] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-17T04:34:07.839073] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-17T04:34:07.839279] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-17T04:34:07.840096] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-17T04:34:07.840163] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-17T04:34:07.841451] [DEBUG] [LOCAL ] JOE: Trimmed 36397 records to 24912 (keeping 200 days of data) [2025-09-17T04:34:07.907522] [INFO ] [REMOTE ] JPI: Fetching primary data for 2024-11. [2025-09-17T04:34:08.025438] [DEBUG] [LOCAL ] JOE: Primary data saved (24912 records). [2025-09-17T04:34:08.025694] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-17T04:34:08.025867] [INFO ] [MAIN ] Update Progress: 1165/2369 symbols completed. JOE took 36.3s. Estimated remaining: 2h 55m 43s. Rate: 6.9 symbols/min [2025-09-17T04:34:08.212304] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:08.259548] [DEBUG] [LOCAL ] JPM: Loaded 40144 existing records from primary storage. [2025-09-17T04:34:08.259799] [INFO ] [MAIN ] JPM: Loaded 40144 existing records. [2025-09-17T04:34:08.454564] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:08.455061] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-17T04:34:08.460809] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-17T04:34:08.461020] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T04:34:08.464635] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-17T04:34:08.464740] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-17T04:34:08.695277] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-17T04:34:08.841728] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:08.865443] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T04:34:09.493181] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-11. [2025-09-17T04:34:09.494138] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T04:34:10.290221] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-17T04:34:11.090219] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-17T04:34:11.669632] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T04:34:11.732851] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T04:34:11.734782] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-17T04:34:11.890140] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-17T04:34:12.477452] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T04:34:12.690143] [INFO ] [REMOTE ] JPI: Fetching primary data for 2024-12. [2025-09-17T04:34:13.303130] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T04:34:13.490239] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-17T04:34:14.290173] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-17T04:34:14.921680] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T04:34:15.090192] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-17T04:34:15.795994] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-17T04:34:15.840271] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T04:34:15.890134] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-17T04:34:16.415484] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T04:34:16.417491] [INFO ] [REMOTE ] JOF: Full fetch complete (9416 records). [2025-09-17T04:34:16.417587] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-17T04:34:16.695355] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-17T04:34:16.810102] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-17T04:34:16.810241] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-17T04:34:16.810754] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-17T04:34:16.810856] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-17T04:34:16.811417] [DEBUG] [LOCAL ] JOF: Trimmed 9416 records to 7173 (keeping 200 days of data) [2025-09-17T04:34:16.858434] [DEBUG] [LOCAL ] JOF: Primary data saved (7173 records). [2025-09-17T04:34:16.858615] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-17T04:34:16.858752] [INFO ] [MAIN ] Update Progress: 1166/2369 symbols completed. JOF took 24.9s. Estimated remaining: 2h 55m 34s. Rate: 6.9 symbols/min [2025-09-17T04:34:17.030985] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:17.055590] [DEBUG] [LOCAL ] JQC: Loaded 24293 existing records from primary storage. [2025-09-17T04:34:17.055832] [INFO ] [MAIN ] JQC: Loaded 24293 existing records. [2025-09-17T04:34:17.242629] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:17.242996] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-17T04:34:17.243073] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-17T04:34:17.243962] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-17T04:34:17.244040] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-17T04:34:17.499470] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-17T04:34:17.604389] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:18.249549] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T04:34:18.290097] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-17T04:34:19.090162] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-11. [2025-09-17T04:34:19.524313] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-17T04:34:19.850903] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T04:34:19.890105] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-01. [2025-09-17T04:34:20.274954] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T04:34:20.545564] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T04:34:20.690133] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-02. [2025-09-17T04:34:21.119806] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T04:34:21.490186] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-17T04:34:22.290164] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-03. [2025-09-17T04:34:22.899425] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T04:34:22.968177] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T04:34:23.090203] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-17T04:34:23.890204] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-17T04:34:24.690214] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-04. [2025-09-17T04:34:25.172402] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T04:34:25.326150] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-17T04:34:25.405265] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T04:34:25.490136] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-05. [2025-09-17T04:34:25.968271] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T04:34:26.290139] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-17T04:34:27.090196] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-17T04:34:27.668423] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T04:34:27.890178] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-17T04:34:28.458124] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T04:34:28.690233] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-17T04:34:29.373626] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T04:34:29.490187] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-17T04:34:30.290177] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-06. [2025-09-17T04:34:30.890595] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T04:34:31.070196] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T04:34:31.090111] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-17T04:34:31.156873] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-17T04:34:31.890204] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-17T04:34:32.457029] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T04:34:32.461942] [INFO ] [REMOTE ] JPC: Full fetch complete (55847 records). [2025-09-17T04:34:32.462085] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-17T04:34:32.695302] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-07. [2025-09-17T04:34:32.870682] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-17T04:34:32.870821] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-17T04:34:32.872560] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-17T04:34:32.872680] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-17T04:34:32.874254] [DEBUG] [LOCAL ] JPC: Trimmed 55847 records to 37342 (keeping 200 days of data) [2025-09-17T04:34:33.100858] [DEBUG] [LOCAL ] JPC: Primary data saved (37342 records). [2025-09-17T04:34:33.101072] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-17T04:34:33.101175] [INFO ] [MAIN ] Update Progress: 1167/2369 symbols completed. JPC took 36.7s. Estimated remaining: 2h 55m 33s. Rate: 6.8 symbols/min [2025-09-17T04:34:33.280590] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:33.294216] [DEBUG] [LOCAL ] JRI: Loaded 11215 existing records from primary storage. [2025-09-17T04:34:33.294411] [INFO ] [MAIN ] JRI: Loaded 11215 existing records. [2025-09-17T04:34:33.405314] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T04:34:33.481144] [WARN ] [MAIN ] JRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:33.481436] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-17T04:34:33.481498] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-17T04:34:33.481968] [DEBUG] [LOCAL ] JRI: Deleted primary data file. [2025-09-17T04:34:33.482032] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-17T04:34:33.495276] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-08. [2025-09-17T04:34:33.842635] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:34.151544] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T04:34:34.242157] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-17T04:34:34.290150] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-17T04:34:35.090195] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-11. [2025-09-17T04:34:35.890171] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-17T04:34:36.023439] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T04:34:36.617356] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T04:34:36.618671] [INFO ] [REMOTE ] JPI: Full fetch complete (7845 records). [2025-09-17T04:34:36.618756] [DEBUG] [VALIDATOR ] JPI: Validating primary data. [2025-09-17T04:34:36.693770] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-17T04:34:37.014276] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.72 seconds). [2025-09-17T04:34:37.019719] [DEBUG] [VALIDATOR ] JPI: All expected trading days are present. [2025-09-17T04:34:37.030177] [DEBUG] [VALIDATOR ] JPI: Primary data validation passed. [2025-09-17T04:34:37.030807] [INFO ] [MAIN ] JPI: Fetched primary data is valid. [2025-09-17T04:34:37.031189] [DEBUG] [LOCAL ] JPI: Saving primary data. [2025-09-17T04:34:37.031674] [DEBUG] [LOCAL ] JPI: Trimmed 7845 records to 5442 (keeping 200 days of data) [2025-09-17T04:34:37.067321] [DEBUG] [LOCAL ] JPI: Primary data saved (5442 records). [2025-09-17T04:34:37.067463] [INFO ] [MAIN ] JPI: Full history saved. [2025-09-17T04:34:37.067554] [INFO ] [MAIN ] Update Progress: 1168/2369 symbols completed. JPI took 31.4s. Estimated remaining: 2h 55m 19s. Rate: 6.9 symbols/min [2025-09-17T04:34:37.235725] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:37.245319] [DEBUG] [LOCAL ] JRS: Loaded 8343 existing records from primary storage. [2025-09-17T04:34:37.245460] [INFO ] [MAIN ] JRS: Loaded 8343 existing records. [2025-09-17T04:34:37.429756] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:37.430020] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-17T04:34:37.430079] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-17T04:34:37.430437] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-17T04:34:37.430494] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-17T04:34:37.497554] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-17T04:34:37.820499] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:37.831169] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T04:34:38.290172] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-17T04:34:39.090186] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-17T04:34:39.638161] [DEBUG] [REMOTE ] JRI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T04:34:39.638844] [WARN ] [REMOTE ] JRI: No data returned for month 2025-01 [2025-09-17T04:34:39.657119] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T04:34:39.855247] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-17T04:34:39.890089] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-17T04:34:40.690141] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-11. [2025-09-17T04:34:41.407312] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T04:34:41.490157] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-17T04:34:42.218199] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T04:34:42.260026] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-17T04:34:42.290085] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-17T04:34:43.090194] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-17T04:34:43.890142] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-17T04:34:44.498335] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-17T04:34:44.547269] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T04:34:44.566334] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T04:34:44.690132] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-17T04:34:45.490157] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-17T04:34:46.132436] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T04:34:46.290157] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-17T04:34:47.070353] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T04:34:47.090080] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-17T04:34:47.543044] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T04:34:47.745374] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-17T04:34:47.752296] [INFO ] [REMOTE ] JPM: Full fetch complete (77826 records). [2025-09-17T04:34:47.752490] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-17T04:34:47.896361] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-17T04:34:48.154386] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-17T04:34:48.154495] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-17T04:34:48.155562] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-17T04:34:48.155622] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-17T04:34:48.157186] [DEBUG] [LOCAL ] JPM: Trimmed 77826 records to 53794 (keeping 200 days of data) [2025-09-17T04:34:48.501615] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-09-17T04:34:48.501813] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-17T04:34:48.501923] [INFO ] [MAIN ] Update Progress: 1169/2369 symbols completed. JPM took 40.5s. Estimated remaining: 2h 55m 13s. Rate: 6.8 symbols/min [2025-09-17T04:34:48.671859] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:48.690234] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-17T04:34:48.704868] [DEBUG] [LOCAL ] JXN: Loaded 33286 existing records from primary storage. [2025-09-17T04:34:48.705042] [INFO ] [MAIN ] JXN: Loaded 33286 existing records. [2025-09-17T04:34:48.884344] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:34:48.884762] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-17T04:34:48.891223] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-17T04:34:48.891954] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T04:34:48.893671] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-17T04:34:48.895121] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-17T04:34:49.260459] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:34:49.490139] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-17T04:34:50.013927] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T04:34:50.272897] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T04:34:50.290139] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-17T04:34:51.090085] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-11. [2025-09-17T04:34:51.584945] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T04:34:51.890176] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-17T04:34:52.638540] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T04:34:52.690083] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-17T04:34:52.745473] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T04:34:53.490166] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-17T04:34:54.144152] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T04:34:54.164613] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T04:34:54.290181] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-17T04:34:55.090176] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-17T04:34:55.696973] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T04:34:55.890161] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-17T04:34:55.949314] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T04:34:56.690166] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-17T04:34:57.281990] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T04:34:57.490178] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-17T04:34:57.629677] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T04:34:58.290173] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-17T04:34:59.018347] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T04:34:59.020350] [INFO ] [REMOTE ] JRS: Full fetch complete (15814 records). [2025-09-17T04:34:59.020738] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-17T04:34:59.093404] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-17T04:34:59.474315] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-17T04:34:59.474595] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-17T04:34:59.475974] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-17T04:34:59.476096] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-17T04:34:59.477893] [DEBUG] [LOCAL ] JRS: Trimmed 15814 records to 10999 (keeping 200 days of data) [2025-09-17T04:34:59.580053] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T04:34:59.592273] [DEBUG] [LOCAL ] JRS: Primary data saved (10999 records). [2025-09-17T04:34:59.604537] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-17T04:34:59.605260] [INFO ] [MAIN ] Update Progress: 1170/2369 symbols completed. JRS took 22.5s. Estimated remaining: 2h 55m 7s. Rate: 6.8 symbols/min [2025-09-17T04:34:59.801097] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:34:59.851566] [DEBUG] [LOCAL ] K: Loaded 37359 existing records from primary storage. [2025-09-17T04:34:59.851839] [INFO ] [MAIN ] K: Loaded 37359 existing records. [2025-09-17T04:34:59.895336] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-17T04:35:00.069404] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:00.069823] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-17T04:35:00.069896] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-17T04:35:00.070957] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-17T04:35:00.071033] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-17T04:35:00.283192] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T04:35:00.486873] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:00.690266] [INFO ] [REMOTE ] K: Fetching primary data for 2024-11. [2025-09-17T04:35:01.490304] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-17T04:35:01.677838] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T04:35:02.290215] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-17T04:35:02.364862] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T04:35:02.578212] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T04:35:03.090232] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-17T04:35:03.246251] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T04:35:03.890170] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-17T04:35:04.690222] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-17T04:35:04.824488] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T04:35:04.899360] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T04:35:05.490240] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-17T04:35:06.043926] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T04:35:06.231814] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T04:35:06.290206] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-17T04:35:07.090148] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-17T04:35:07.890101] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-17T04:35:07.962972] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T04:35:08.690147] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-17T04:35:08.745298] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:35:09.139425] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T04:35:09.145230] [INFO ] [REMOTE ] JQC: Full fetch complete (48414 records). [2025-09-17T04:35:09.145427] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-17T04:35:09.502044] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-17T04:35:09.561851] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-17T04:35:09.561964] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-17T04:35:09.563145] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-17T04:35:09.563227] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-17T04:35:09.564917] [DEBUG] [LOCAL ] JQC: Trimmed 48414 records to 33855 (keeping 200 days of data) [2025-09-17T04:35:09.773007] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T04:35:09.790795] [DEBUG] [LOCAL ] JQC: Primary data saved (33855 records). [2025-09-17T04:35:09.790939] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-17T04:35:09.791046] [INFO ] [MAIN ] Update Progress: 1171/2369 symbols completed. JQC took 52.9s. Estimated remaining: 2h 54m 60s. Rate: 6.8 symbols/min [2025-09-17T04:35:09.961800] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:09.973480] [DEBUG] [LOCAL ] KAI: Loaded 9846 existing records from primary storage. [2025-09-17T04:35:09.973658] [INFO ] [MAIN ] KAI: Loaded 9846 existing records. [2025-09-17T04:35:10.151744] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:10.151992] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-17T04:35:10.152041] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-17T04:35:10.152382] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-17T04:35:10.152444] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-17T04:35:10.295240] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-17T04:35:10.514341] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:11.090155] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-11. [2025-09-17T04:35:11.155070] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T04:35:11.204916] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T04:35:11.890157] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-17T04:35:11.909059] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T04:35:12.690141] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-17T04:35:12.750519] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T04:35:12.753483] [INFO ] [REMOTE ] JRI: Full fetch complete (20134 records). [2025-09-17T04:35:12.753606] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-17T04:35:12.943490] [WARN ] [VALIDATOR ] JRI: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T04:35:12.943906] [FATAL] [MAIN ] JRI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:35:12.944039] [WARN ] [MAIN ] JRI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:35:12.944148] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-17T04:35:12.944263] [DEBUG] [LOCAL ] JRI: No primary data file found to delete. [2025-09-17T04:35:12.944359] [INFO ] [LOCAL ] JRI: Starting deletion of derivative data. [2025-09-17T04:35:12.944785] [DEBUG] [LOCAL ] JRI: Deleted derivative data file. [2025-09-17T04:35:12.944930] [INFO ] [MAIN ] Update Progress: 1172/2369 symbols completed. JRI took 39.8s. Estimated remaining: 2h 54m 45s. Rate: 6.8 symbols/min [2025-09-17T04:35:13.112261] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:13.142705] [DEBUG] [LOCAL ] KAR: Loaded 29727 existing records from primary storage. [2025-09-17T04:35:13.142899] [INFO ] [MAIN ] KAR: Loaded 29727 existing records. [2025-09-17T04:35:13.320169] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:13.320441] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-17T04:35:13.320498] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-17T04:35:13.321203] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-17T04:35:13.321278] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-17T04:35:13.498371] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-17T04:35:13.682868] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:14.290176] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-11. [2025-09-17T04:35:14.400409] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T04:35:15.090116] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-17T04:35:15.174245] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T04:35:15.686748] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T04:35:15.890128] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-17T04:35:16.690200] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-17T04:35:16.976668] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T04:35:17.382985] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T04:35:17.410329] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T04:35:17.490110] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-17T04:35:18.290134] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-17T04:35:18.858314] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T04:35:19.090137] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-17T04:35:19.890151] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-17T04:35:20.029712] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:35:20.525668] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T04:35:20.532965] [INFO ] [REMOTE ] JXN: Full fetch complete (64931 records). [2025-09-17T04:35:20.533163] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-17T04:35:20.691698] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-17T04:35:20.703403] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T04:35:20.936923] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-17T04:35:20.937042] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-17T04:35:20.938100] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-17T04:35:20.938195] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-17T04:35:20.939713] [DEBUG] [LOCAL ] JXN: Trimmed 64931 records to 46086 (keeping 200 days of data) [2025-09-17T04:35:21.243540] [DEBUG] [LOCAL ] JXN: Primary data saved (46086 records). [2025-09-17T04:35:21.243721] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-17T04:35:21.243831] [INFO ] [MAIN ] Update Progress: 1173/2369 symbols completed. JXN took 32.7s. Estimated remaining: 2h 54m 36s. Rate: 6.9 symbols/min [2025-09-17T04:35:21.413405] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:21.432122] [DEBUG] [LOCAL ] KB: Loaded 17934 existing records from primary storage. [2025-09-17T04:35:21.432286] [INFO ] [MAIN ] KB: Loaded 17934 existing records. [2025-09-17T04:35:21.495294] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-17T04:35:21.615175] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:21.615446] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-17T04:35:21.615510] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-17T04:35:21.616040] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-17T04:35:21.616100] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-17T04:35:21.976603] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:22.213002] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T04:35:22.290204] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-11. [2025-09-17T04:35:22.523406] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T04:35:23.090164] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-17T04:35:23.324992] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T04:35:23.890305] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-17T04:35:24.053521] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T04:35:24.690197] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-17T04:35:25.490154] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-17T04:35:25.569422] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T04:35:25.973584] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T04:35:26.290163] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-17T04:35:26.340935] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T04:35:27.090172] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-17T04:35:27.627766] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T04:35:27.704283] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T04:35:27.890211] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-17T04:35:28.690143] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-17T04:35:29.490200] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-17T04:35:29.640973] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T04:35:29.717537] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T04:35:30.290127] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-17T04:35:30.554759] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T04:35:31.090175] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-17T04:35:31.403429] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T04:35:31.890161] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-17T04:35:32.228470] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T04:35:32.690137] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-17T04:35:32.783053] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T04:35:33.490139] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-17T04:35:34.207939] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T04:35:34.290161] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-17T04:35:34.763879] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T04:35:34.800106] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T04:35:35.090133] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-17T04:35:35.890204] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-17T04:35:36.690203] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-17T04:35:36.747107] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T04:35:36.753682] [INFO ] [REMOTE ] K: Full fetch complete (71594 records). [2025-09-17T04:35:36.753891] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-17T04:35:37.178764] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-17T04:35:37.178984] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-17T04:35:37.180123] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-17T04:35:37.180292] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-17T04:35:37.198481] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T04:35:37.204659] [DEBUG] [LOCAL ] K: Trimmed 71594 records to 49749 (keeping 200 days of data) [2025-09-17T04:35:37.496180] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-17T04:35:37.532004] [DEBUG] [LOCAL ] K: Primary data saved (49749 records). [2025-09-17T04:35:37.532127] [INFO ] [MAIN ] K: Full history saved. [2025-09-17T04:35:37.532239] [INFO ] [MAIN ] Update Progress: 1174/2369 symbols completed. K took 37.9s. Estimated remaining: 2h 54m 35s. Rate: 6.8 symbols/min [2025-09-17T04:35:37.700693] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:37.717815] [DEBUG] [LOCAL ] KBDC: Loaded 14804 existing records from primary storage. [2025-09-17T04:35:37.717967] [INFO ] [MAIN ] KBDC: Loaded 14804 existing records. [2025-09-17T04:35:37.901600] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:37.901943] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-17T04:35:37.902057] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-17T04:35:37.902520] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-17T04:35:37.902587] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-17T04:35:38.291245] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-17T04:35:38.291047] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:38.319559] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T04:35:38.369899] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T04:35:38.371810] [INFO ] [REMOTE ] KAI: Full fetch complete (18674 records). [2025-09-17T04:35:38.371894] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-17T04:35:38.736440] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-17T04:35:38.736543] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-17T04:35:38.736956] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-17T04:35:38.737009] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-17T04:35:38.737635] [DEBUG] [LOCAL ] KAI: Trimmed 18674 records to 13670 (keeping 200 days of data) [2025-09-17T04:35:38.832575] [DEBUG] [LOCAL ] KAI: Primary data saved (13670 records). [2025-09-17T04:35:38.832781] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-17T04:35:38.832912] [INFO ] [MAIN ] Update Progress: 1175/2369 symbols completed. KAI took 29.0s. Estimated remaining: 2h 54m 18s. Rate: 6.8 symbols/min [2025-09-17T04:35:39.004284] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:39.043382] [DEBUG] [LOCAL ] KBH: Loaded 36047 existing records from primary storage. [2025-09-17T04:35:39.043553] [INFO ] [MAIN ] KBH: Loaded 36047 existing records. [2025-09-17T04:35:39.100288] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-11. [2025-09-17T04:35:39.227484] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:39.227762] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-17T04:35:39.227815] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-17T04:35:39.229021] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-17T04:35:39.229083] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-17T04:35:39.582195] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:39.598226] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T04:35:39.887231] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T04:35:39.890074] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-11. [2025-09-17T04:35:40.690210] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-17T04:35:41.453300] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T04:35:41.486856] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T04:35:41.490222] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-17T04:35:42.290120] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-17T04:35:42.777329] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T04:35:43.090238] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-17T04:35:43.830075] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T04:35:43.890238] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-17T04:35:44.048030] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T04:35:44.690153] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-17T04:35:45.225901] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T04:35:45.490142] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-17T04:35:46.113749] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T04:35:46.290155] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-17T04:35:46.404486] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T04:35:47.090160] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-17T04:35:47.158054] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T04:35:47.888398] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T04:35:47.892922] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-17T04:35:48.690113] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-17T04:35:48.912346] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T04:35:48.915072] [INFO ] [REMOTE ] KB: Full fetch complete (34852 records). [2025-09-17T04:35:48.915176] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-17T04:35:49.300026] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-17T04:35:49.300158] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-17T04:35:49.301020] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-17T04:35:49.301081] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-17T04:35:49.302059] [DEBUG] [LOCAL ] KB: Trimmed 34852 records to 24566 (keeping 200 days of data) [2025-09-17T04:35:49.465962] [DEBUG] [LOCAL ] KB: Primary data saved (24566 records). [2025-09-17T04:35:49.466150] [INFO ] [MAIN ] KB: Full history saved. [2025-09-17T04:35:49.466280] [INFO ] [MAIN ] Update Progress: 1176/2369 symbols completed. KB took 28.2s. Estimated remaining: 2h 54m 12s. Rate: 6.8 symbols/min [2025-09-17T04:35:49.499246] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-17T04:35:49.652556] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:49.687913] [DEBUG] [LOCAL ] KBR: Loaded 35949 existing records from primary storage. [2025-09-17T04:35:49.688100] [INFO ] [MAIN ] KBR: Loaded 35949 existing records. [2025-09-17T04:35:49.882106] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:49.882389] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-17T04:35:49.882447] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-17T04:35:49.883524] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-17T04:35:49.883593] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-17T04:35:50.276575] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:50.295194] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-11. [2025-09-17T04:35:50.306325] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T04:35:50.905756] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T04:35:51.090127] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-17T04:35:51.588515] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T04:35:51.890130] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-17T04:35:52.690091] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-17T04:35:52.690971] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T04:35:53.220594] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T04:35:53.490135] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-17T04:35:54.282138] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T04:35:54.292032] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-17T04:35:55.046043] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T04:35:55.090129] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-17T04:35:55.890112] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-17T04:35:55.934602] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T04:35:55.961165] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T04:35:56.690132] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-17T04:35:57.153961] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:35:57.159488] [INFO ] [REMOTE ] KAR: Full fetch complete (56578 records). [2025-09-17T04:35:57.159720] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-17T04:35:57.502744] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-17T04:35:57.557919] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-17T04:35:57.558052] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-17T04:35:57.558914] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-17T04:35:57.558978] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-17T04:35:57.560372] [DEBUG] [LOCAL ] KAR: Trimmed 56578 records to 40152 (keeping 200 days of data) [2025-09-17T04:35:57.811071] [DEBUG] [LOCAL ] KAR: Primary data saved (40152 records). [2025-09-17T04:35:57.811232] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-17T04:35:57.811334] [INFO ] [MAIN ] Update Progress: 1177/2369 symbols completed. KAR took 44.9s. Estimated remaining: 2h 54m 2s. Rate: 6.8 symbols/min [2025-09-17T04:35:57.992050] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:35:58.046113] [DEBUG] [LOCAL ] KD: Loaded 38888 existing records from primary storage. [2025-09-17T04:35:58.046492] [INFO ] [MAIN ] KD: Loaded 38888 existing records. [2025-09-17T04:35:58.235900] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:35:58.236384] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-17T04:35:58.236466] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-17T04:35:58.237696] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-17T04:35:58.237774] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-17T04:35:58.325800] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-17T04:35:58.510658] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T04:35:58.679888] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:35:58.693084] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T04:35:59.090155] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-17T04:35:59.784822] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T04:35:59.890138] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-11. [2025-09-17T04:36:00.416284] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T04:36:00.690190] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-17T04:36:01.431524] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T04:36:01.490151] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-17T04:36:01.677736] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T04:36:02.290179] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-17T04:36:03.090220] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-17T04:36:03.890169] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-17T04:36:04.598194] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (3.11 seconds). [2025-09-17T04:36:04.667709] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-17T04:36:04.690105] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-17T04:36:05.246312] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T04:36:05.430849] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-17T04:36:05.490112] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-17T04:36:06.295203] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-17T04:36:06.316277] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T04:36:07.090179] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-17T04:36:07.186619] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T04:36:07.425372] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T04:36:07.429148] [INFO ] [REMOTE ] KBDC: Full fetch complete (27098 records). [2025-09-17T04:36:07.429241] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-17T04:36:07.811155] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-17T04:36:07.811260] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-17T04:36:07.811843] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-17T04:36:07.811897] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-17T04:36:07.812604] [DEBUG] [LOCAL ] KBDC: Trimmed 27098 records to 20428 (keeping 200 days of data) [2025-09-17T04:36:07.904660] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-17T04:36:07.954702] [DEBUG] [LOCAL ] KBDC: Primary data saved (20428 records). [2025-09-17T04:36:07.954939] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-17T04:36:07.955061] [INFO ] [MAIN ] Update Progress: 1178/2369 symbols completed. KBDC took 30.4s. Estimated remaining: 2h 53m 55s. Rate: 6.8 symbols/min [2025-09-17T04:36:08.135138] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:08.141110] [DEBUG] [LOCAL ] KEN: Loaded 3309 existing records from primary storage. [2025-09-17T04:36:08.141259] [INFO ] [MAIN ] KEN: Loaded 3309 existing records. [2025-09-17T04:36:08.323466] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:36:08.323872] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-17T04:36:08.323942] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-17T04:36:08.324323] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-17T04:36:08.324389] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-17T04:36:08.691725] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:08.691878] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-17T04:36:08.870767] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T04:36:09.490157] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-17T04:36:09.573083] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T04:36:10.149302] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T04:36:10.290086] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-17T04:36:11.090204] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-17T04:36:11.242008] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T04:36:11.890153] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-17T04:36:12.079365] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T04:36:12.690163] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-11. [2025-09-17T04:36:12.909369] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T04:36:13.152295] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T04:36:13.400586] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T04:36:13.490201] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-17T04:36:14.290214] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-17T04:36:15.090161] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-17T04:36:15.358924] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T04:36:15.890175] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-17T04:36:16.520338] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-17T04:36:16.690221] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-17T04:36:17.490135] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-17T04:36:17.517272] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T04:36:17.595972] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-17T04:36:18.165971] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-17T04:36:18.290130] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-17T04:36:19.090181] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-17T04:36:19.149234] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T04:36:19.155759] [INFO ] [REMOTE ] KBH: Full fetch complete (70153 records). [2025-09-17T04:36:19.155923] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-17T04:36:19.547230] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-17T04:36:19.547333] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-17T04:36:19.548234] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-17T04:36:19.548293] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-17T04:36:19.549759] [DEBUG] [LOCAL ] KBH: Trimmed 70153 records to 48821 (keeping 200 days of data) [2025-09-17T04:36:19.653165] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T04:36:19.859483] [DEBUG] [LOCAL ] KBH: Primary data saved (48821 records). [2025-09-17T04:36:19.859656] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-17T04:36:19.859754] [INFO ] [MAIN ] Update Progress: 1179/2369 symbols completed. KBH took 41.0s. Estimated remaining: 2h 53m 49s. Rate: 6.8 symbols/min [2025-09-17T04:36:19.895253] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-17T04:36:20.035559] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:20.064274] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T04:36:20.092731] [DEBUG] [LOCAL ] KEP: Loaded 24401 existing records from primary storage. [2025-09-17T04:36:20.092903] [INFO ] [MAIN ] KEP: Loaded 24401 existing records. [2025-09-17T04:36:20.269473] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:36:20.269784] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-17T04:36:20.269865] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-17T04:36:20.270791] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-17T04:36:20.270872] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-17T04:36:20.621077] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:20.690073] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-11. [2025-09-17T04:36:21.443322] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T04:36:21.461270] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T04:36:21.490069] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-17T04:36:22.290168] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-17T04:36:22.812051] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:36:23.090207] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-17T04:36:23.890175] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-17T04:36:23.964758] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T04:36:24.278964] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T04:36:24.295241] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T04:36:24.690208] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-17T04:36:25.490180] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-17T04:36:26.278101] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T04:36:26.284218] [INFO ] [REMOTE ] KBR: Full fetch complete (69739 records). [2025-09-17T04:36:26.284396] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-17T04:36:26.297027] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-17T04:36:26.729881] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T04:36:26.733944] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-17T04:36:26.739248] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-17T04:36:26.741119] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-17T04:36:26.741206] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-17T04:36:26.743322] [DEBUG] [LOCAL ] KBR: Trimmed 69739 records to 48401 (keeping 200 days of data) [2025-09-17T04:36:26.980276] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T04:36:27.077211] [DEBUG] [LOCAL ] KBR: Primary data saved (48401 records). [2025-09-17T04:36:27.077423] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-17T04:36:27.077550] [INFO ] [MAIN ] Update Progress: 1180/2369 symbols completed. KBR took 37.6s. Estimated remaining: 2h 53m 39s. Rate: 6.8 symbols/min [2025-09-17T04:36:27.098689] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-17T04:36:27.256677] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:27.256915] [DEBUG] [LOCAL ] KEX: No existing data file found in primary storage. [2025-09-17T04:36:27.256966] [WARN ] [MAIN ] KEX: No existing data found, performing full refresh instead. [2025-09-17T04:36:27.257074] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-17T04:36:27.257128] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-17T04:36:27.257179] [DEBUG] [LOCAL ] KEX: No primary data file found to delete. [2025-09-17T04:36:27.257222] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-17T04:36:27.643005] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:27.890172] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-17T04:36:28.248014] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T04:36:28.690185] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-17T04:36:29.490119] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-11. [2025-09-17T04:36:29.871119] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T04:36:29.935767] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T04:36:30.290121] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-17T04:36:30.551228] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T04:36:31.090129] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-17T04:36:31.293376] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T04:36:31.890134] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-17T04:36:32.353787] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T04:36:32.554189] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T04:36:32.690138] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-17T04:36:33.490147] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-17T04:36:33.985294] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T04:36:34.290142] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-17T04:36:35.090147] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-17T04:36:35.447619] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T04:36:35.812690] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T04:36:35.890164] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-17T04:36:36.603977] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T04:36:36.690099] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-17T04:36:37.490173] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-17T04:36:37.722533] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T04:36:37.729069] [INFO ] [REMOTE ] KD: Full fetch complete (75437 records). [2025-09-17T04:36:37.729216] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-17T04:36:38.156973] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T04:36:38.161161] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-17T04:36:38.163346] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-17T04:36:38.184666] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-17T04:36:38.185605] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T04:36:38.185908] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-17T04:36:38.195368] [DEBUG] [LOCAL ] KD: Trimmed 75437 records to 52317 (keeping 200 days of data) [2025-09-17T04:36:38.290752] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-17T04:36:38.520087] [DEBUG] [LOCAL ] KD: Primary data saved (52317 records). [2025-09-17T04:36:38.520288] [INFO ] [MAIN ] KD: Full history saved. [2025-09-17T04:36:38.520391] [INFO ] [MAIN ] Update Progress: 1181/2369 symbols completed. KD took 40.7s. Estimated remaining: 2h 53m 33s. Rate: 6.8 symbols/min [2025-09-17T04:36:38.693089] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:38.693338] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-17T04:36:38.693430] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-17T04:36:38.693544] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-17T04:36:38.693594] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-17T04:36:38.693663] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-17T04:36:38.693707] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-17T04:36:39.058180] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:39.090102] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-11. [2025-09-17T04:36:39.606566] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T04:36:39.890201] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-17T04:36:40.512072] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T04:36:40.526956] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T04:36:40.690178] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-17T04:36:41.490158] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-17T04:36:41.993559] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T04:36:42.290137] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-17T04:36:42.949215] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T04:36:43.090136] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-17T04:36:43.257337] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:36:43.649317] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T04:36:43.890137] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-17T04:36:44.690163] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-17T04:36:45.490191] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-17T04:36:45.607066] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T04:36:46.038920] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T04:36:46.040015] [INFO ] [REMOTE ] KEN: Full fetch complete (5899 records). [2025-09-17T04:36:46.040102] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-17T04:36:46.231489] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T04:36:46.295204] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-17T04:36:46.296331] [INFO ] [REMOTE ] KEP: Full fetch complete (41298 records). [2025-09-17T04:36:46.318685] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-17T04:36:46.552177] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-17T04:36:46.588830] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-17T04:36:46.623589] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-17T04:36:46.685254] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-17T04:36:46.724859] [DEBUG] [LOCAL ] KEN: Trimmed 5899 records to 4689 (keeping 200 days of data) [2025-09-17T04:36:46.836447] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-17T04:36:46.837887] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-17T04:36:46.838488] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-17T04:36:46.839153] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-17T04:36:46.842833] [DEBUG] [LOCAL ] KEP: Trimmed 41298 records to 30335 (keeping 200 days of data) [2025-09-17T04:36:46.845128] [DEBUG] [LOCAL ] KEN: Primary data saved (4689 records). [2025-09-17T04:36:46.845404] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-17T04:36:46.845530] [INFO ] [MAIN ] Update Progress: 1182/2369 symbols completed. KEN took 38.9s. Estimated remaining: 2h 53m 24s. Rate: 6.8 symbols/min [2025-09-17T04:36:47.095474] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-17T04:36:47.129892] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:47.226740] [DEBUG] [LOCAL ] KEYS: Loaded 31718 existing records from primary storage. [2025-09-17T04:36:47.228033] [INFO ] [MAIN ] KEYS: Loaded 31718 existing records. [2025-09-17T04:36:47.420474] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:36:47.423019] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-17T04:36:47.423910] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-17T04:36:47.426111] [DEBUG] [LOCAL ] KEP: Primary data saved (30335 records). [2025-09-17T04:36:47.426235] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-17T04:36:47.426338] [INFO ] [MAIN ] Update Progress: 1183/2369 symbols completed. KEP took 27.6s. Estimated remaining: 2h 53m 7s. Rate: 6.9 symbols/min [2025-09-17T04:36:47.458789] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-17T04:36:47.496759] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-17T04:36:47.722325] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:36:47.866428] [DEBUG] [LOCAL ] KF: Loaded 1755 existing records from primary storage. [2025-09-17T04:36:47.890345] [INFO ] [MAIN ] KF: Loaded 1755 existing records. [2025-09-17T04:36:48.091533] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:48.107442] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-11. [2025-09-17T04:36:48.195172] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:36:48.195583] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-17T04:36:48.195673] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-17T04:36:48.196027] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-17T04:36:48.196097] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-17T04:36:48.319630] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T04:36:48.605940] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:36:48.690135] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-11. [2025-09-17T04:36:48.870069] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T04:36:49.114070] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T04:36:49.490124] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-17T04:36:49.958756] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T04:36:50.290136] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-17T04:36:50.977033] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T04:36:51.090142] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-17T04:36:51.897886] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-17T04:36:51.902881] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T04:36:52.349241] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T04:36:52.454700] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T04:36:52.690336] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-17T04:36:53.490139] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-17T04:36:53.876059] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-17T04:36:54.290138] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-17T04:36:54.623101] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T04:36:55.090138] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-17T04:36:55.641359] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T04:36:55.890140] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-17T04:36:56.690161] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-17T04:36:56.764590] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:36:57.129884] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T04:36:57.465410] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T04:36:57.490096] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-17T04:36:58.290139] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-17T04:36:58.691288] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T04:36:59.090140] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-17T04:36:59.376271] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T04:36:59.890210] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-17T04:37:00.633855] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T04:37:00.690113] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-17T04:37:01.490183] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-17T04:37:01.697525] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T04:37:02.248483] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T04:37:02.258006] [INFO ] [REMOTE ] KEX: Full fetch complete (54938 records). [2025-09-17T04:37:02.258315] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-17T04:37:02.295414] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-17T04:37:02.671172] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-17T04:37:02.671284] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-17T04:37:02.672087] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-17T04:37:02.672144] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-17T04:37:02.673274] [DEBUG] [LOCAL ] KEX: Trimmed 54938 records to 37680 (keeping 200 days of data) [2025-09-17T04:37:02.904909] [DEBUG] [LOCAL ] KEX: Primary data saved (37680 records). [2025-09-17T04:37:02.905112] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-17T04:37:02.905226] [INFO ] [MAIN ] Update Progress: 1184/2369 symbols completed. KEX took 35.8s. Estimated remaining: 2h 53m 5s. Rate: 6.8 symbols/min [2025-09-17T04:37:03.011315] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T04:37:03.086115] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:03.090106] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-17T04:37:03.102968] [DEBUG] [LOCAL ] KFRC: Loaded 14991 existing records from primary storage. [2025-09-17T04:37:03.103133] [INFO ] [MAIN ] KFRC: Loaded 14991 existing records. [2025-09-17T04:37:03.286255] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:03.300029] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-17T04:37:03.309044] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-17T04:37:03.311004] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-17T04:37:03.310933] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T04:37:03.311233] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-17T04:37:03.635302] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T04:37:03.708603] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:03.890150] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-17T04:37:04.690135] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-17T04:37:05.255461] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T04:37:05.490174] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-17T04:37:05.839718] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T04:37:06.290131] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-17T04:37:06.722188] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T04:37:07.090119] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-11. [2025-09-17T04:37:07.145974] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T04:37:07.890175] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-17T04:37:08.068526] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T04:37:08.690198] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-17T04:37:09.508811] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-17T04:37:09.541215] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T04:37:09.708338] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T04:37:09.968561] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T04:37:10.290240] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-17T04:37:11.090253] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-17T04:37:11.894364] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-17T04:37:11.899993] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T04:37:11.922598] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T04:37:11.929220] [INFO ] [REMOTE ] KEY: Full fetch complete (77096 records). [2025-09-17T04:37:11.929421] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-17T04:37:12.140289] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T04:37:12.141233] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:37:12.141314] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:37:12.141398] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-17T04:37:12.141497] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-17T04:37:12.141553] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-17T04:37:12.141617] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-17T04:37:12.141753] [INFO ] [MAIN ] Update Progress: 1185/2369 symbols completed. KEY took 33.6s. Estimated remaining: 2h 52m 57s. Rate: 6.8 symbols/min [2025-09-17T04:37:12.329072] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:12.339409] [DEBUG] [LOCAL ] KFS: Loaded 6350 existing records from primary storage. [2025-09-17T04:37:12.339772] [INFO ] [MAIN ] KFS: Loaded 6350 existing records. [2025-09-17T04:37:12.423158] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T04:37:12.454782] [INFO ] [REMOTE ] KF: Full fetch complete (3957 records). [2025-09-17T04:37:12.455081] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-17T04:37:12.658372] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:12.685718] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-17T04:37:12.700175] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-17T04:37:12.754111] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-17T04:37:12.799491] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-17T04:37:12.847934] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-17T04:37:13.071380] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-17T04:37:13.081806] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-17T04:37:13.099939] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-17T04:37:13.106173] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-17T04:37:13.124192] [DEBUG] [LOCAL ] KF: Trimmed 3957 records to 2521 (keeping 200 days of data) [2025-09-17T04:37:13.244001] [DEBUG] [LOCAL ] KF: Primary data saved (2521 records). [2025-09-17T04:37:13.272817] [INFO ] [MAIN ] KF: Full history saved. [2025-09-17T04:37:13.273248] [INFO ] [MAIN ] Update Progress: 1186/2369 symbols completed. KF took 25.8s. Estimated remaining: 2h 52m 40s. Rate: 6.9 symbols/min [2025-09-17T04:37:13.480875] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:13.501027] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-17T04:37:13.533761] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:13.556114] [DEBUG] [LOCAL ] KFY: Loaded 21739 existing records from primary storage. [2025-09-17T04:37:13.556288] [INFO ] [MAIN ] KFY: Loaded 21739 existing records. [2025-09-17T04:37:13.738635] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:13.739086] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-17T04:37:13.739219] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-17T04:37:13.747078] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-17T04:37:13.748596] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-17T04:37:13.749482] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T04:37:14.147773] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:14.290133] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-11. [2025-09-17T04:37:14.925735] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T04:37:15.090129] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-17T04:37:15.185603] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T04:37:15.735477] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T04:37:15.890147] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-17T04:37:16.690197] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-17T04:37:16.860497] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T04:37:17.120320] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T04:37:17.490203] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-17T04:37:18.290203] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-17T04:37:19.090114] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-11. [2025-09-17T04:37:19.196396] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T04:37:19.331390] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T04:37:19.890145] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-17T04:37:19.968081] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T04:37:20.690182] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-17T04:37:21.160479] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T04:37:21.363142] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T04:37:21.490166] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-17T04:37:22.290209] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-17T04:37:22.410804] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T04:37:22.701136] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T04:37:23.090145] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-17T04:37:23.890102] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-17T04:37:24.180886] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T04:37:24.277370] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-17T04:37:24.690234] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-17T04:37:25.490141] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-17T04:37:26.171176] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T04:37:26.290139] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-17T04:37:26.681022] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T04:37:27.090191] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-17T04:37:27.582277] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T04:37:27.890131] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-17T04:37:28.338165] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T04:37:28.690247] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-17T04:37:29.251526] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T04:37:29.490178] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-17T04:37:29.514079] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T04:37:29.519635] [INFO ] [REMOTE ] KEYS: Full fetch complete (62912 records). [2025-09-17T04:37:29.519780] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-17T04:37:29.909609] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-17T04:37:29.909734] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-17T04:37:29.910612] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-17T04:37:29.910693] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-17T04:37:29.911977] [DEBUG] [LOCAL ] KEYS: Trimmed 62912 records to 43478 (keeping 200 days of data) [2025-09-17T04:37:30.017680] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T04:37:30.187837] [DEBUG] [LOCAL ] KEYS: Primary data saved (43478 records). [2025-09-17T04:37:30.188005] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-17T04:37:30.188100] [INFO ] [MAIN ] Update Progress: 1187/2369 symbols completed. KEYS took 43.3s. Estimated remaining: 2h 52m 40s. Rate: 6.8 symbols/min [2025-09-17T04:37:30.292896] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-17T04:37:30.370373] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:30.412266] [DEBUG] [LOCAL ] KGC: Loaded 40050 existing records from primary storage. [2025-09-17T04:37:30.412435] [INFO ] [MAIN ] KGC: Loaded 40050 existing records. [2025-09-17T04:37:30.594620] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:30.594954] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-17T04:37:30.595021] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-17T04:37:30.596171] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-17T04:37:30.596242] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-17T04:37:30.953405] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:31.086334] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T04:37:31.090080] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-17T04:37:31.890105] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-11. [2025-09-17T04:37:32.184959] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T04:37:32.690214] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-17T04:37:33.264263] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T04:37:33.490113] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-17T04:37:33.806626] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T04:37:34.290187] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-17T04:37:34.627440] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T04:37:35.090153] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-17T04:37:35.363524] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T04:37:35.366895] [INFO ] [REMOTE ] KFRC: Full fetch complete (24734 records). [2025-09-17T04:37:35.366995] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-17T04:37:35.742444] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-17T04:37:35.751714] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-17T04:37:35.753300] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-17T04:37:35.753467] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-17T04:37:35.752215] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T04:37:35.758203] [DEBUG] [LOCAL ] KFRC: Trimmed 24734 records to 19076 (keeping 200 days of data) [2025-09-17T04:37:35.888713] [DEBUG] [LOCAL ] KFRC: Primary data saved (19076 records). [2025-09-17T04:37:35.888990] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-17T04:37:35.889148] [INFO ] [MAIN ] Update Progress: 1188/2369 symbols completed. KFRC took 33.0s. Estimated remaining: 2h 52m 28s. Rate: 6.8 symbols/min [2025-09-17T04:37:35.895275] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-17T04:37:36.106372] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:36.150811] [DEBUG] [LOCAL ] KGS: Loaded 33944 existing records from primary storage. [2025-09-17T04:37:36.151050] [INFO ] [MAIN ] KGS: Loaded 33944 existing records. [2025-09-17T04:37:36.360330] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:36.360853] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-17T04:37:36.360952] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-17T04:37:36.361944] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-17T04:37:36.362032] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-17T04:37:36.706964] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-17T04:37:36.752818] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:37.314289] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T04:37:37.490194] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-11. [2025-09-17T04:37:37.537564] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T04:37:37.539736] [INFO ] [REMOTE ] KFS: Full fetch complete (10198 records). [2025-09-17T04:37:37.539906] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-17T04:37:37.940463] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-17T04:37:37.940606] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-17T04:37:37.941028] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-17T04:37:37.941095] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-17T04:37:37.941752] [DEBUG] [LOCAL ] KFS: Trimmed 10198 records to 8004 (keeping 200 days of data) [2025-09-17T04:37:37.994882] [DEBUG] [LOCAL ] KFS: Primary data saved (8004 records). [2025-09-17T04:37:37.995104] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-17T04:37:37.995267] [INFO ] [MAIN ] Update Progress: 1189/2369 symbols completed. KFS took 25.9s. Estimated remaining: 2h 52m 12s. Rate: 6.9 symbols/min [2025-09-17T04:37:38.175094] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:38.233963] [DEBUG] [LOCAL ] KIM: Loaded 39507 existing records from primary storage. [2025-09-17T04:37:38.234247] [INFO ] [MAIN ] KIM: Loaded 39507 existing records. [2025-09-17T04:37:38.302162] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-17T04:37:38.445325] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:37:38.445763] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-17T04:37:38.445850] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-17T04:37:38.446955] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-17T04:37:38.447044] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-17T04:37:38.864888] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:37:38.942935] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T04:37:39.090207] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-17T04:37:39.253491] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T04:37:39.890151] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-17T04:37:40.566882] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T04:37:40.690167] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-17T04:37:41.490145] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-17T04:37:41.809618] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T04:37:42.201842] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T04:37:42.290083] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-17T04:37:42.342039] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:37:43.090229] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-17T04:37:43.462885] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T04:37:43.890161] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-11. [2025-09-17T04:37:44.465312] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T04:37:44.690134] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-17T04:37:45.490153] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-17T04:37:45.636009] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:37:46.217777] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T04:37:46.290096] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-17T04:37:47.090129] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-17T04:37:47.139915] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T04:37:47.890136] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-17T04:37:48.093627] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T04:37:48.160587] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T04:37:48.690208] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-17T04:37:49.377329] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T04:37:49.490146] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-17T04:37:50.287692] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T04:37:50.297027] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-17T04:37:51.095233] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-17T04:37:51.119805] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T04:37:51.832113] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T04:37:51.890121] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-17T04:37:52.690125] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-17T04:37:53.147806] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T04:37:53.495348] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-17T04:37:53.505417] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T04:37:53.949602] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T04:37:54.290241] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-17T04:37:55.090147] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-17T04:37:55.533542] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T04:37:55.763858] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T04:37:55.890129] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-17T04:37:56.539930] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T04:37:56.690151] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-17T04:37:57.490140] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-17T04:37:57.628114] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:37:58.119318] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T04:37:58.290106] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-17T04:37:59.031863] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:37:59.090105] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-17T04:37:59.188003] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T04:37:59.194851] [INFO ] [REMOTE ] KFY: Full fetch complete (43601 records). [2025-09-17T04:37:59.195000] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-17T04:37:59.575928] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-17T04:37:59.576066] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-17T04:37:59.576886] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-17T04:37:59.576951] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-17T04:37:59.578229] [DEBUG] [LOCAL ] KFY: Trimmed 43601 records to 30758 (keeping 200 days of data) [2025-09-17T04:37:59.785395] [DEBUG] [LOCAL ] KFY: Primary data saved (30758 records). [2025-09-17T04:37:59.785603] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-17T04:37:59.785745] [INFO ] [MAIN ] Update Progress: 1190/2369 symbols completed. KFY took 46.5s. Estimated remaining: 2h 52m 17s. Rate: 6.8 symbols/min [2025-09-17T04:37:59.895368] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-17T04:37:59.958752] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:37:59.975916] [DEBUG] [LOCAL ] KIO: Loaded 15558 existing records from primary storage. [2025-09-17T04:37:59.976062] [INFO ] [MAIN ] KIO: Loaded 15558 existing records. [2025-09-17T04:38:00.154388] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:38:00.154711] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-17T04:38:00.154784] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-17T04:38:00.155381] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-17T04:38:00.155445] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-17T04:38:00.510815] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:00.690114] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-11. [2025-09-17T04:38:00.896615] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T04:38:01.490239] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-17T04:38:01.763399] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T04:38:02.164766] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-17T04:38:02.290225] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-17T04:38:03.090167] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-17T04:38:03.245826] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T04:38:03.639402] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T04:38:03.890170] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-17T04:38:04.114909] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T04:38:04.690217] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-17T04:38:05.490199] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-17T04:38:05.640902] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T04:38:06.290238] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-17T04:38:06.539016] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T04:38:06.757815] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T04:38:07.090155] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-17T04:38:07.890149] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-17T04:38:08.029068] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T04:38:08.690114] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-17T04:38:08.823776] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T04:38:08.937627] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T04:38:09.490143] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-17T04:38:10.243435] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T04:38:10.249570] [INFO ] [REMOTE ] KGS: Full fetch complete (65509 records). [2025-09-17T04:38:10.249761] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-17T04:38:10.295322] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-17T04:38:10.655615] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-17T04:38:10.655794] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-17T04:38:10.656949] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-17T04:38:10.657036] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-17T04:38:10.658855] [DEBUG] [LOCAL ] KGS: Trimmed 65509 records to 45743 (keeping 200 days of data) [2025-09-17T04:38:10.958978] [DEBUG] [LOCAL ] KGS: Primary data saved (45743 records). [2025-09-17T04:38:10.959149] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-17T04:38:10.959252] [INFO ] [MAIN ] Update Progress: 1191/2369 symbols completed. KGS took 35.1s. Estimated remaining: 2h 52m 10s. Rate: 6.8 symbols/min [2025-09-17T04:38:11.104191] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-17T04:38:11.138605] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:11.182666] [DEBUG] [LOCAL ] KKR: Loaded 39871 existing records from primary storage. [2025-09-17T04:38:11.182907] [INFO ] [MAIN ] KKR: Loaded 39871 existing records. [2025-09-17T04:38:11.371817] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:38:11.372133] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-17T04:38:11.372187] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-17T04:38:11.373167] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-17T04:38:11.373230] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-17T04:38:11.690279] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T04:38:11.778951] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-17T04:38:11.809578] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:11.816513] [INFO ] [REMOTE ] KGC: Full fetch complete (77599 records). [2025-09-17T04:38:11.816739] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-17T04:38:11.895224] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-11. [2025-09-17T04:38:12.265240] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-17T04:38:12.265353] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-17T04:38:12.266353] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-17T04:38:12.266433] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-17T04:38:12.268013] [DEBUG] [LOCAL ] KGC: Trimmed 77599 records to 53699 (keeping 200 days of data) [2025-09-17T04:38:12.601299] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T04:38:12.611612] [INFO ] [REMOTE ] KIM: Full fetch complete (76651 records). [2025-09-17T04:38:12.612305] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-17T04:38:12.691518] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-17T04:38:13.036898] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-17T04:38:13.037275] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-17T04:38:13.039309] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-17T04:38:13.039674] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-17T04:38:13.042268] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-09-17T04:38:13.042601] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-17T04:38:13.042752] [INFO ] [MAIN ] Update Progress: 1192/2369 symbols completed. KGC took 42.9s. Estimated remaining: 2h 51m 55s. Rate: 6.8 symbols/min [2025-09-17T04:38:13.148073] [DEBUG] [LOCAL ] KIM: Trimmed 76651 records to 53076 (keeping 200 days of data) [2025-09-17T04:38:13.312318] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:13.322275] [DEBUG] [LOCAL ] KKRS: Loaded 4505 existing records from primary storage. [2025-09-17T04:38:13.323362] [INFO ] [MAIN ] KKRS: Loaded 4505 existing records. [2025-09-17T04:38:13.514233] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:38:13.516730] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-17T04:38:13.517594] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-17T04:38:13.518854] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-17T04:38:13.519433] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-17T04:38:13.904610] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:13.905916] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-11. [2025-09-17T04:38:13.931171] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T04:38:14.068438] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-17T04:38:14.191574] [DEBUG] [LOCAL ] KIM: Primary data saved (53076 records). [2025-09-17T04:38:14.191817] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-17T04:38:14.191956] [INFO ] [MAIN ] Update Progress: 1193/2369 symbols completed. KIM took 36.2s. Estimated remaining: 2h 51m 39s. Rate: 6.9 symbols/min [2025-09-17T04:38:14.294601] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-17T04:38:14.367394] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:14.370716] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-17T04:38:14.371303] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T04:38:14.371176] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-17T04:38:14.372935] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-17T04:38:14.372997] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-17T04:38:14.373051] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-17T04:38:14.373088] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-17T04:38:14.738396] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:15.090159] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-17T04:38:15.358543] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T04:38:15.890153] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-17T04:38:16.529999] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T04:38:16.690133] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-17T04:38:16.985567] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T04:38:17.353210] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T04:38:17.490157] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-17T04:38:18.290181] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-11. [2025-09-17T04:38:18.486236] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:18.486670] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-11 [2025-09-17T04:38:19.090105] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-17T04:38:19.121990] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T04:38:19.424280] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T04:38:19.890130] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-17T04:38:20.090282] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:20.090672] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-17T04:38:20.690219] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-17T04:38:21.269503] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T04:38:21.490159] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-17T04:38:21.696979] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:21.697381] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-17T04:38:22.290183] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-17T04:38:22.488144] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:22.488488] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-17T04:38:23.090138] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-17T04:38:23.890106] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-17T04:38:24.350753] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T04:38:24.690153] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-17T04:38:25.240761] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T04:38:25.490136] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-17T04:38:25.686043] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:25.686400] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-17T04:38:25.734690] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T04:38:26.290134] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-17T04:38:27.090140] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-17T04:38:27.467778] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T04:38:27.890180] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-17T04:38:28.689929] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T04:38:28.690284] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-17T04:38:29.083755] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T04:38:29.490100] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-17T04:38:29.791755] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T04:38:29.794747] [INFO ] [REMOTE ] KIO: Full fetch complete (30901 records). [2025-09-17T04:38:29.794869] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-17T04:38:30.181072] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-17T04:38:30.181188] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-17T04:38:30.181810] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-17T04:38:30.181866] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-17T04:38:30.182756] [DEBUG] [LOCAL ] KIO: Trimmed 30901 records to 21439 (keeping 200 days of data) [2025-09-17T04:38:30.290795] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-17T04:38:30.319833] [DEBUG] [LOCAL ] KIO: Primary data saved (21439 records). [2025-09-17T04:38:30.319992] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-17T04:38:30.320081] [INFO ] [MAIN ] Update Progress: 1194/2369 symbols completed. KIO took 30.5s. Estimated remaining: 2h 51m 37s. Rate: 6.8 symbols/min [2025-09-17T04:38:30.489524] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:30.489774] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-17T04:38:30.489827] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-17T04:38:30.489941] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-17T04:38:30.489991] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-17T04:38:30.490038] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-17T04:38:30.490082] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-17T04:38:30.534745] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:30.583006] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-17T04:38:30.852151] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:31.090148] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-11. [2025-09-17T04:38:31.287873] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:31.288241] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-11 [2025-09-17T04:38:31.405190] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T04:38:31.890162] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-17T04:38:32.271746] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T04:38:32.690147] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-17T04:38:33.490145] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-17T04:38:34.245035] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T04:38:34.290182] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-17T04:38:34.584620] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T04:38:35.045267] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T04:38:35.090137] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-17T04:38:35.276452] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:35.276885] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-17T04:38:35.890179] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-17T04:38:36.690145] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-17T04:38:37.018773] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T04:38:37.490143] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-17T04:38:37.679202] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:37.679555] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-17T04:38:38.290128] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-17T04:38:38.467714] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T04:38:39.059147] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T04:38:39.090145] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-17T04:38:39.890143] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-17T04:38:40.690171] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-17T04:38:40.771547] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T04:38:40.881551] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:40.882203] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-17T04:38:41.117216] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T04:38:41.490158] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-17T04:38:42.290143] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-17T04:38:42.300981] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T04:38:43.075089] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T04:38:43.076751] [INFO ] [REMOTE ] KKRT: Full fetch complete (7991 records). [2025-09-17T04:38:43.076846] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-17T04:38:43.097281] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-17T04:38:43.265516] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 75 unique days, need 200 days [2025-09-17T04:38:43.265963] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:38:43.266019] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:38:43.266068] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-17T04:38:43.266147] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-17T04:38:43.266193] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-17T04:38:43.266253] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-17T04:38:43.266323] [INFO ] [MAIN ] Update Progress: 1195/2369 symbols completed. KKRT took 29.1s. Estimated remaining: 2h 51m 32s. Rate: 6.8 symbols/min [2025-09-17T04:38:43.389597] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:43.437601] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-17T04:38:43.439415] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:43.471848] [DEBUG] [LOCAL ] KLC: Loaded 26417 existing records from primary storage. [2025-09-17T04:38:43.472173] [INFO ] [MAIN ] KLC: Loaded 26417 existing records. [2025-09-17T04:38:43.663527] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:38:43.663856] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-17T04:38:43.663919] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-17T04:38:43.664617] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-17T04:38:43.664715] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-17T04:38:43.898236] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-17T04:38:44.027210] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:44.690166] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-17T04:38:45.265707] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T04:38:45.490178] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-17T04:38:46.062050] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T04:38:46.063228] [INFO ] [REMOTE ] KKRS: Full fetch complete (8069 records). [2025-09-17T04:38:46.063313] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-17T04:38:46.295247] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-11. [2025-09-17T04:38:46.421376] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-17T04:38:46.421489] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-17T04:38:46.421775] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-17T04:38:46.421832] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-17T04:38:46.422277] [DEBUG] [LOCAL ] KKRS: Trimmed 8069 records to 5780 (keeping 200 days of data) [2025-09-17T04:38:46.457912] [DEBUG] [LOCAL ] KKRS: Primary data saved (5780 records). [2025-09-17T04:38:46.458039] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-17T04:38:46.458136] [INFO ] [MAIN ] Update Progress: 1196/2369 symbols completed. KKRS took 33.4s. Estimated remaining: 2h 51m 18s. Rate: 6.8 symbols/min [2025-09-17T04:38:46.627359] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:38:46.667118] [DEBUG] [LOCAL ] KLG: Loaded 31005 existing records from primary storage. [2025-09-17T04:38:46.667404] [INFO ] [MAIN ] KLG: Loaded 31005 existing records. [2025-09-17T04:38:46.847425] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:38:46.847704] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-17T04:38:46.847760] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-17T04:38:46.848419] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-17T04:38:46.848483] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-17T04:38:47.100761] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-17T04:38:47.223123] [INFO ] [REMOTE ] KLG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:38:47.253769] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (3.36 seconds). [2025-09-17T04:38:47.329381] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:47.329831] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-17T04:38:47.713146] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T04:38:47.890143] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-17T04:38:48.690211] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-17T04:38:48.881800] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:48.882208] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-17T04:38:49.490136] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-17T04:38:49.683121] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:49.686442] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-17T04:38:49.688163] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T04:38:49.698594] [INFO ] [REMOTE ] KKR: Full fetch complete (77307 records). [2025-09-17T04:38:49.698838] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-17T04:38:50.112347] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-17T04:38:50.112487] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-17T04:38:50.113712] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-17T04:38:50.113776] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-17T04:38:50.115863] [DEBUG] [LOCAL ] KKR: Trimmed 77307 records to 53517 (keeping 200 days of data) [2025-09-17T04:38:50.317297] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-17T04:38:50.479563] [DEBUG] [LOCAL ] KKR: Primary data saved (53517 records). [2025-09-17T04:38:50.479779] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-17T04:38:50.479884] [INFO ] [MAIN ] Update Progress: 1197/2369 symbols completed. KKR took 39.5s. Estimated remaining: 2h 51m 5s. Rate: 6.9 symbols/min [2025-09-17T04:38:51.090213] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-17T04:38:51.286133] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:51.286531] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-17T04:38:51.776360] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T04:38:51.890142] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-17T04:38:52.073821] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:38:52.074201] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-17T04:38:52.690137] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-17T04:38:53.490104] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-17T04:38:53.635528] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T04:38:53.638433] [INFO ] [REMOTE ] KLAR: Full fetch complete (1733 records). [2025-09-17T04:38:53.638524] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-17T04:38:53.827573] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 5 unique days, need 200 days [2025-09-17T04:38:53.828825] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:38:53.828896] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:38:53.828942] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-17T04:38:53.829020] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-17T04:38:53.829066] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-17T04:38:53.829127] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-17T04:38:53.829329] [INFO ] [MAIN ] Update Progress: 1198/2369 symbols completed. KLAR took 23.5s. Estimated remaining: 2h 50m 51s. Rate: 6.9 symbols/min [2025-09-17T04:38:54.290193] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-11. [2025-09-17T04:38:54.830317] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T04:38:55.090138] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-17T04:38:55.979493] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T04:38:55.989147] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-12. [2025-09-17T04:38:56.167809] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T04:38:56.690156] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-17T04:38:57.558868] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T04:38:57.569325] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-17T04:38:58.032493] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T04:38:58.290188] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-17T04:38:58.849809] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T04:38:59.090140] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-17T04:38:59.784263] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T04:38:59.890216] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-17T04:39:00.321028] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T04:39:00.690152] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-17T04:39:01.316068] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T04:39:01.490153] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-17T04:39:03.072167] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-17T04:39:03.082142] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-17T04:39:04.155991] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-17T04:39:04.163563] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-17T04:39:04.895511] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T04:39:04.905017] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-17T04:39:05.549223] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T04:39:05.557133] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-17T04:39:06.464127] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T04:39:06.473036] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-17T04:39:06.937479] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T04:39:06.946121] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-17T04:39:07.912836] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T04:39:07.922600] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-17T04:39:07.938329] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T04:39:07.943596] [INFO ] [REMOTE ] KLC: Full fetch complete (50606 records). [2025-09-17T04:39:07.943753] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-17T04:39:08.327459] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-17T04:39:08.327575] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-17T04:39:08.328471] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-17T04:39:08.328534] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-17T04:39:08.329904] [DEBUG] [LOCAL ] KLC: Trimmed 50606 records to 36073 (keeping 200 days of data) [2025-09-17T04:39:08.547717] [DEBUG] [LOCAL ] KLC: Primary data saved (36073 records). [2025-09-17T04:39:08.547922] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-17T04:39:08.548030] [INFO ] [MAIN ] Update Progress: 1199/2369 symbols completed. KLC took 25.3s. Estimated remaining: 2h 50m 48s. Rate: 6.9 symbols/min [2025-09-17T04:39:09.720113] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T04:39:09.730829] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-17T04:39:11.217371] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T04:39:11.225745] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-17T04:39:12.696023] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T04:39:12.701109] [INFO ] [REMOTE ] KLG: Full fetch complete (61873 records). [2025-09-17T04:39:12.701258] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-17T04:39:13.110359] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-17T04:39:13.110497] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-17T04:39:13.111612] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-17T04:39:13.111726] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-17T04:39:13.113212] [DEBUG] [LOCAL ] KLG: Trimmed 61873 records to 41934 (keeping 200 days of data) [2025-09-17T04:39:13.515537] [DEBUG] [LOCAL ] KLG: Primary data saved (41934 records). [2025-09-17T04:39:13.515897] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-17T04:39:13.516063] [INFO ] [MAIN ] Update Progress: 1200/2369 symbols completed. KLG took 27.1s. Estimated remaining: 2h 50m 35s. Rate: 6.9 symbols/min [2025-09-17T04:39:14.446631] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:14.500307] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:14.510164] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:14.511408] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:14.520615] [DEBUG] [LOCAL ] KMPB: Loaded 2577 existing records from primary storage. [2025-09-17T04:39:14.523800] [INFO ] [MAIN ] KMPB: Loaded 2577 existing records. [2025-09-17T04:39:14.681118] [DEBUG] [LOCAL ] KMT: Loaded 32017 existing records from primary storage. [2025-09-17T04:39:14.675386] [DEBUG] [LOCAL ] KMPR: Loaded 29360 existing records from primary storage. [2025-09-17T04:39:14.717884] [INFO ] [MAIN ] KMT: Loaded 32017 existing records. [2025-09-17T04:39:14.759804] [INFO ] [MAIN ] KMPR: Loaded 29360 existing records. [2025-09-17T04:39:14.805463] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:14.948614] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-17T04:39:14.959814] [DEBUG] [LOCAL ] KMI: Loaded 40043 existing records from primary storage. [2025-09-17T04:39:14.981384] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-17T04:39:14.997450] [INFO ] [MAIN ] KMI: Loaded 40043 existing records. [2025-09-17T04:39:15.038115] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-17T04:39:15.152302] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:15.184058] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-17T04:39:15.257617] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-17T04:39:15.245525] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:15.282487] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-17T04:39:15.317542] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-17T04:39:15.372258] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-17T04:39:15.338226] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-17T04:39:15.386189] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-17T04:39:15.386117] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-17T04:39:15.446935] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-17T04:39:15.519000] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:15.592970] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-17T04:39:15.594495] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-17T04:39:15.687467] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-17T04:39:15.804713] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-17T04:39:16.219787] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:16.408014] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-11. [2025-09-17T04:39:16.763029] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:16.780929] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-11. [2025-09-17T04:39:16.800181] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:16.805883] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-11. [2025-09-17T04:39:16.866569] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:16.868431] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-11. [2025-09-17T04:39:17.099384] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T04:39:17.100737] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-17T04:39:17.640490] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T04:39:17.642047] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-17T04:39:17.856201] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T04:39:17.865503] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-17T04:39:17.884793] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:39:17.891177] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-17T04:39:18.074269] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-17T04:39:18.075511] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-17T04:39:18.424431] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T04:39:18.425892] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-17T04:39:18.622456] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:39:18.633033] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-17T04:39:18.707385] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T04:39:18.713112] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-17T04:39:18.756508] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T04:39:19.090150] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-17T04:39:19.266760] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T04:39:19.620916] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-17T04:39:19.868786] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T04:39:19.890073] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-17T04:39:20.670628] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T04:39:20.690081] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-17T04:39:21.120547] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T04:39:21.490155] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-17T04:39:22.008482] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T04:39:22.290164] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-17T04:39:22.814682] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T04:39:23.090145] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-17T04:39:23.267958] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T04:39:23.710435] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T04:39:23.890148] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-17T04:39:24.690162] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-17T04:39:25.308819] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T04:39:25.490193] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-17T04:39:26.290198] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-17T04:39:26.706168] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T04:39:26.794929] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T04:39:27.090235] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-17T04:39:27.224260] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-17T04:39:27.890135] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-17T04:39:28.690148] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-17T04:39:28.838221] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T04:39:29.490222] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-17T04:39:29.904329] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T04:39:30.161449] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T04:39:30.290111] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-17T04:39:31.009967] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:39:31.090090] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-17T04:39:31.832178] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:39:31.890087] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-17T04:39:32.538193] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T04:39:32.690132] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-17T04:39:33.148231] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T04:39:33.490143] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-17T04:39:33.540085] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T04:39:34.290270] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-17T04:39:35.090157] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-17T04:39:35.511846] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-17T04:39:35.543038] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T04:39:35.805342] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T04:39:35.811106] [INFO ] [REMOTE ] KMPR: Full fetch complete (49673 records). [2025-09-17T04:39:35.811296] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-17T04:39:35.895275] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-17T04:39:36.212329] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-17T04:39:36.212512] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-17T04:39:36.213980] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-17T04:39:36.214067] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-17T04:39:36.216172] [DEBUG] [LOCAL ] KMPR: Trimmed 49673 records to 37685 (keeping 200 days of data) [2025-09-17T04:39:36.486354] [DEBUG] [LOCAL ] KMPR: Primary data saved (37685 records). [2025-09-17T04:39:36.486632] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-17T04:39:36.486821] [INFO ] [MAIN ] Update Progress: 1201/2369 symbols completed. KMPR took 22.9s. Estimated remaining: 2h 50m 40s. Rate: 6.8 symbols/min [2025-09-17T04:39:36.669985] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:36.695994] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-17T04:39:36.715740] [DEBUG] [LOCAL ] KMX: Loaded 39668 existing records from primary storage. [2025-09-17T04:39:36.715983] [INFO ] [MAIN ] KMX: Loaded 39668 existing records. [2025-09-17T04:39:36.903410] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:36.903870] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-17T04:39:36.903955] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-17T04:39:36.905567] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-17T04:39:36.905733] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-17T04:39:37.285832] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T04:39:37.310217] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:37.310522] [INFO ] [REMOTE ] KMPB: Full fetch complete (4834 records). [2025-09-17T04:39:37.311887] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-17T04:39:37.505762] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-17T04:39:37.527452] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T04:39:37.731767] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-17T04:39:37.731892] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-17T04:39:37.732097] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-17T04:39:37.732149] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-17T04:39:37.732539] [DEBUG] [LOCAL ] KMPB: Trimmed 4834 records to 3647 (keeping 200 days of data) [2025-09-17T04:39:37.757094] [DEBUG] [LOCAL ] KMPB: Primary data saved (3647 records). [2025-09-17T04:39:37.757283] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-17T04:39:37.757389] [INFO ] [MAIN ] Update Progress: 1202/2369 symbols completed. KMPB took 24.2s. Estimated remaining: 2h 50m 24s. Rate: 6.8 symbols/min [2025-09-17T04:39:37.925964] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:37.953926] [DEBUG] [LOCAL ] KN: Loaded 28017 existing records from primary storage. [2025-09-17T04:39:37.954168] [INFO ] [MAIN ] KN: Loaded 28017 existing records. [2025-09-17T04:39:38.138164] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:38.138523] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-17T04:39:38.138594] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-17T04:39:38.139320] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-17T04:39:38.139388] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-17T04:39:38.297063] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-17T04:39:38.508623] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:39.090154] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-11. [2025-09-17T04:39:39.478526] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T04:39:39.880301] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T04:39:39.890075] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-17T04:39:40.690144] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-17T04:39:40.813824] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T04:39:41.490198] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-17T04:39:41.532034] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T04:39:42.290165] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-17T04:39:42.543287] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T04:39:43.090153] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-11. [2025-09-17T04:39:43.261898] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:39:43.413021] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T04:39:43.890187] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-17T04:39:44.114189] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T04:39:44.690150] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-17T04:39:45.324424] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T04:39:45.329689] [INFO ] [REMOTE ] KMT: Full fetch complete (61694 records). [2025-09-17T04:39:45.329811] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-17T04:39:45.495006] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-17T04:39:45.725406] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-17T04:39:45.725516] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-17T04:39:45.726398] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-17T04:39:45.726463] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-17T04:39:45.727753] [DEBUG] [LOCAL ] KMT: Trimmed 61694 records to 43199 (keeping 200 days of data) [2025-09-17T04:39:46.007552] [DEBUG] [LOCAL ] KMT: Primary data saved (43199 records). [2025-09-17T04:39:46.007756] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-17T04:39:46.007869] [INFO ] [MAIN ] Update Progress: 1203/2369 symbols completed. KMT took 32.5s. Estimated remaining: 2h 50m 15s. Rate: 6.8 symbols/min [2025-09-17T04:39:46.184381] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:46.213036] [DEBUG] [LOCAL ] KNF: Loaded 26715 existing records from primary storage. [2025-09-17T04:39:46.213236] [INFO ] [MAIN ] KNF: Loaded 26715 existing records. [2025-09-17T04:39:46.292704] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-17T04:39:46.397535] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:46.397976] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-17T04:39:46.398131] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-17T04:39:46.408019] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-17T04:39:46.423959] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-17T04:39:46.502550] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T04:39:46.793168] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:47.003772] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T04:39:47.090127] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-17T04:39:47.890169] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-17T04:39:48.383086] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T04:39:48.523393] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T04:39:48.690144] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-17T04:39:48.913494] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T04:39:49.490131] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-17T04:39:50.290137] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-11. [2025-09-17T04:39:50.427268] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T04:39:50.930472] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T04:39:51.090174] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-17T04:39:51.652202] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T04:39:51.890129] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-17T04:39:52.539025] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T04:39:52.690133] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-17T04:39:52.998074] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T04:39:53.490130] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-17T04:39:54.290132] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-17T04:39:54.465869] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T04:39:55.090167] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-17T04:39:55.345715] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T04:39:55.352894] [INFO ] [REMOTE ] KMI: Full fetch complete (77658 records). [2025-09-17T04:39:55.353151] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-17T04:39:55.792260] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-17T04:39:55.792487] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-17T04:39:55.793704] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-17T04:39:55.793859] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-17T04:39:55.797429] [DEBUG] [LOCAL ] KMI: Trimmed 77658 records to 53693 (keeping 200 days of data) [2025-09-17T04:39:55.825610] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T04:39:55.890358] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-17T04:39:56.178566] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-09-17T04:39:56.178869] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-17T04:39:56.179073] [INFO ] [MAIN ] Update Progress: 1204/2369 symbols completed. KMI took 42.7s. Estimated remaining: 2h 50m 8s. Rate: 6.8 symbols/min [2025-09-17T04:39:56.370142] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:39:56.382420] [DEBUG] [LOCAL ] KNOP: Loaded 6647 existing records from primary storage. [2025-09-17T04:39:56.382696] [INFO ] [MAIN ] KNOP: Loaded 6647 existing records. [2025-09-17T04:39:56.575542] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:39:56.575933] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-17T04:39:56.576026] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-17T04:39:56.576570] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-17T04:39:56.576719] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-17T04:39:56.695379] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-17T04:39:56.981042] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:39:57.086358] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T04:39:57.118317] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T04:39:57.490175] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-17T04:39:58.132089] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T04:39:58.290141] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-17T04:39:58.921186] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T04:39:59.090153] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-17T04:39:59.150879] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T04:39:59.890164] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-11. [2025-09-17T04:40:00.396230] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T04:40:00.690158] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-17T04:40:00.736878] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T04:40:01.490173] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-17T04:40:02.209415] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T04:40:02.290201] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-17T04:40:02.614893] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T04:40:03.090147] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-17T04:40:03.265790] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T04:40:03.890166] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-17T04:40:04.564185] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T04:40:04.678404] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T04:40:04.690137] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-17T04:40:05.490219] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-17T04:40:06.290235] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-17T04:40:06.537969] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T04:40:06.804657] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T04:40:07.003120] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T04:40:07.090227] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-17T04:40:07.890259] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-17T04:40:08.349024] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T04:40:08.690208] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-17T04:40:08.779877] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T04:40:09.490148] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-17T04:40:10.290163] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-17T04:40:10.667813] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T04:40:10.929239] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T04:40:10.950194] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T04:40:11.090198] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-17T04:40:11.890216] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-17T04:40:12.202183] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T04:40:12.209520] [INFO ] [REMOTE ] KN: Full fetch complete (56116 records). [2025-09-17T04:40:12.209741] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-17T04:40:12.610454] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-17T04:40:12.610603] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-17T04:40:12.611663] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-17T04:40:12.611732] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-17T04:40:12.613194] [DEBUG] [LOCAL ] KN: Trimmed 56116 records to 39122 (keeping 200 days of data) [2025-09-17T04:40:12.708847] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-17T04:40:12.736924] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:40:12.866989] [DEBUG] [LOCAL ] KN: Primary data saved (39122 records). [2025-09-17T04:40:12.867158] [INFO ] [MAIN ] KN: Full history saved. [2025-09-17T04:40:12.867292] [INFO ] [MAIN ] Update Progress: 1205/2369 symbols completed. KN took 35.1s. Estimated remaining: 2h 50m 7s. Rate: 6.8 symbols/min [2025-09-17T04:40:13.039126] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:13.054580] [DEBUG] [LOCAL ] KNSL: Loaded 13618 existing records from primary storage. [2025-09-17T04:40:13.054780] [INFO ] [MAIN ] KNSL: Loaded 13618 existing records. [2025-09-17T04:40:13.236104] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:13.236355] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-17T04:40:13.236438] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-17T04:40:13.236943] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-17T04:40:13.237009] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-17T04:40:13.495222] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-17T04:40:13.598147] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:14.136983] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T04:40:14.290150] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-17T04:40:14.358127] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T04:40:15.090203] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-11. [2025-09-17T04:40:15.890135] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-17T04:40:16.040259] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T04:40:16.117589] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T04:40:16.690145] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-17T04:40:17.336611] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:40:17.490132] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-17T04:40:18.290144] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-17T04:40:18.478091] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T04:40:18.484784] [INFO ] [REMOTE ] KMX: Full fetch complete (75722 records). [2025-09-17T04:40:18.484964] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-17T04:40:18.883988] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-17T04:40:18.884197] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-17T04:40:18.885318] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-17T04:40:18.885393] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-17T04:40:18.898580] [DEBUG] [LOCAL ] KMX: Trimmed 75722 records to 53084 (keeping 200 days of data) [2025-09-17T04:40:18.898471] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T04:40:18.904226] [INFO ] [REMOTE ] KNF: Full fetch complete (49793 records). [2025-09-17T04:40:18.904343] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-17T04:40:19.091666] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-17T04:40:19.342505] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T04:40:19.417293] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-17T04:40:19.418175] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-17T04:40:19.419735] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-17T04:40:19.420813] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-17T04:40:19.425300] [DEBUG] [LOCAL ] KNF: Trimmed 49793 records to 35622 (keeping 200 days of data) [2025-09-17T04:40:19.833680] [DEBUG] [LOCAL ] KNF: Primary data saved (35622 records). [2025-09-17T04:40:19.835801] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-17T04:40:19.836512] [INFO ] [MAIN ] Update Progress: 1206/2369 symbols completed. KNF took 33.8s. Estimated remaining: 2h 49m 56s. Rate: 6.8 symbols/min [2025-09-17T04:40:19.897405] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-17T04:40:20.021295] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:20.040823] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T04:40:20.047067] [DEBUG] [LOCAL ] KMX: Primary data saved (53084 records). [2025-09-17T04:40:20.047658] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-17T04:40:20.047773] [INFO ] [MAIN ] Update Progress: 1207/2369 symbols completed. KMX took 43.6s. Estimated remaining: 2h 49m 39s. Rate: 6.8 symbols/min [2025-09-17T04:40:20.248950] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:20.249925] [DEBUG] [LOCAL ] KNTK: Loaded 35014 existing records from primary storage. [2025-09-17T04:40:20.250556] [INFO ] [MAIN ] KNTK: Loaded 35014 existing records. [2025-09-17T04:40:20.442898] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:20.443157] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-17T04:40:20.443220] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-17T04:40:20.444234] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-17T04:40:20.444329] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-17T04:40:20.579763] [DEBUG] [LOCAL ] KNX: Loaded 39070 existing records from primary storage. [2025-09-17T04:40:20.608892] [INFO ] [MAIN ] KNX: Loaded 39070 existing records. [2025-09-17T04:40:20.697060] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-17T04:40:20.928533] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:20.987943] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-17T04:40:21.007152] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-17T04:40:21.011473] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:21.018308] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-17T04:40:21.024750] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-17T04:40:21.031276] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T04:40:21.391744] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:21.490102] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-11. [2025-09-17T04:40:21.512565] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T04:40:22.290162] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-11. [2025-09-17T04:40:23.090196] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-17T04:40:23.213263] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T04:40:23.678449] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T04:40:23.836465] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T04:40:23.838319] [INFO ] [REMOTE ] KNOP: Full fetch complete (14732 records). [2025-09-17T04:40:23.838424] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-17T04:40:23.900429] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-17T04:40:24.206468] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-17T04:40:24.206570] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-17T04:40:24.206963] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-17T04:40:24.207017] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-17T04:40:24.207609] [DEBUG] [LOCAL ] KNOP: Trimmed 14732 records to 9947 (keeping 200 days of data) [2025-09-17T04:40:24.268377] [DEBUG] [LOCAL ] KNOP: Primary data saved (9947 records). [2025-09-17T04:40:24.268518] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-17T04:40:24.268668] [INFO ] [MAIN ] Update Progress: 1208/2369 symbols completed. KNOP took 28.1s. Estimated remaining: 2h 49m 26s. Rate: 6.9 symbols/min [2025-09-17T04:40:24.489815] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:24.527243] [DEBUG] [LOCAL ] KO: Loaded 40168 existing records from primary storage. [2025-09-17T04:40:24.527417] [INFO ] [MAIN ] KO: Loaded 40168 existing records. [2025-09-17T04:40:24.702261] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-17T04:40:24.706610] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:24.707564] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-17T04:40:24.707697] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-17T04:40:24.709119] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-17T04:40:24.709205] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-17T04:40:25.066549] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:25.373298] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T04:40:25.490316] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-17T04:40:25.528393] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T04:40:26.290152] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-11. [2025-09-17T04:40:27.090162] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-17T04:40:27.172671] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T04:40:27.890143] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-17T04:40:28.147690] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T04:40:28.690181] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-17T04:40:28.842801] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-11 (2.55 seconds). [2025-09-17T04:40:29.490158] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-17T04:40:29.660360] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T04:40:30.116465] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T04:40:30.290164] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-17T04:40:30.564900] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T04:40:31.090211] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-17T04:40:31.894594] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-17T04:40:31.898259] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T04:40:31.922690] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T04:40:32.690205] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-17T04:40:33.490119] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-17T04:40:33.569457] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T04:40:33.817168] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T04:40:34.290164] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-17T04:40:34.499957] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T04:40:35.090139] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-17T04:40:35.836932] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T04:40:35.890130] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-17T04:40:36.690093] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-17T04:40:36.878157] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T04:40:37.021621] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T04:40:37.490093] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-17T04:40:37.889115] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T04:40:38.290214] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-17T04:40:39.090224] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-17T04:40:39.362351] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T04:40:39.887672] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T04:40:39.897094] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-17T04:40:40.690209] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-17T04:40:41.490172] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-17T04:40:41.657084] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T04:40:41.742271] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-17T04:40:41.834993] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T04:40:42.290178] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-17T04:40:42.450066] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T04:40:43.090187] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-17T04:40:43.890104] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-17T04:40:43.953207] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T04:40:44.027093] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T04:40:44.029503] [INFO ] [REMOTE ] KNSL: Full fetch complete (26500 records). [2025-09-17T04:40:44.029593] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-17T04:40:44.393015] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-17T04:40:44.393112] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-17T04:40:44.393659] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-17T04:40:44.393712] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-17T04:40:44.394390] [DEBUG] [LOCAL ] KNSL: Trimmed 26500 records to 18049 (keeping 200 days of data) [2025-09-17T04:40:44.508085] [DEBUG] [LOCAL ] KNSL: Primary data saved (18049 records). [2025-09-17T04:40:44.508251] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-17T04:40:44.508344] [INFO ] [MAIN ] Update Progress: 1209/2369 symbols completed. KNSL took 31.6s. Estimated remaining: 2h 49m 28s. Rate: 6.8 symbols/min [2025-09-17T04:40:44.676701] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:44.693984] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-17T04:40:44.708306] [DEBUG] [LOCAL ] KODK: Loaded 32256 existing records from primary storage. [2025-09-17T04:40:44.708533] [INFO ] [MAIN ] KODK: Loaded 32256 existing records. [2025-09-17T04:40:44.890083] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:44.890356] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-17T04:40:44.890412] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-17T04:40:44.891132] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-17T04:40:44.891205] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-17T04:40:45.264867] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:45.490161] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-17T04:40:45.574434] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T04:40:46.290205] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-17T04:40:46.430284] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T04:40:47.090195] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-17T04:40:47.844365] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T04:40:47.850726] [INFO ] [REMOTE ] KNTK: Full fetch complete (63443 records). [2025-09-17T04:40:47.851057] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-17T04:40:47.895754] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-11. [2025-09-17T04:40:48.295619] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-17T04:40:48.298351] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-09-17T04:40:48.308589] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-17T04:40:48.310056] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-17T04:40:48.310812] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-17T04:40:48.312849] [DEBUG] [LOCAL ] KNTK: Trimmed 63443 records to 46120 (keeping 200 days of data) [2025-09-17T04:40:48.448841] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T04:40:48.653303] [DEBUG] [LOCAL ] KNTK: Primary data saved (46120 records). [2025-09-17T04:40:48.653492] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-17T04:40:48.653591] [INFO ] [MAIN ] Update Progress: 1210/2369 symbols completed. KNTK took 28.8s. Estimated remaining: 2h 49m 15s. Rate: 6.8 symbols/min [2025-09-17T04:40:48.696384] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-17T04:40:48.825363] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:48.844433] [DEBUG] [LOCAL ] KOF: Loaded 19629 existing records from primary storage. [2025-09-17T04:40:48.844590] [INFO ] [MAIN ] KOF: Loaded 19629 existing records. [2025-09-17T04:40:49.021261] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:49.021502] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-17T04:40:49.021554] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-17T04:40:49.022120] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-17T04:40:49.022183] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-17T04:40:49.377638] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:49.490148] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-11. [2025-09-17T04:40:49.622388] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T04:40:50.290122] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-17T04:40:50.681255] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T04:40:50.795624] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T04:40:51.090136] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-17T04:40:51.882456] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T04:40:51.892099] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-17T04:40:52.690208] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-17T04:40:52.794834] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T04:40:52.803833] [INFO ] [REMOTE ] KNX: Full fetch complete (75402 records). [2025-09-17T04:40:52.804026] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-17T04:40:53.204030] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-17T04:40:53.204167] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-17T04:40:53.205293] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-17T04:40:53.205421] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-17T04:40:53.217460] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T04:40:53.222809] [DEBUG] [LOCAL ] KNX: Trimmed 75402 records to 52592 (keeping 200 days of data) [2025-09-17T04:40:53.490818] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-17T04:40:53.579145] [DEBUG] [LOCAL ] KNX: Primary data saved (52592 records). [2025-09-17T04:40:53.579352] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-17T04:40:53.579493] [INFO ] [MAIN ] Update Progress: 1211/2369 symbols completed. KNX took 33.5s. Estimated remaining: 2h 49m 3s. Rate: 6.9 symbols/min [2025-09-17T04:40:53.751573] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:40:53.765962] [DEBUG] [LOCAL ] KOP: Loaded 12808 existing records from primary storage. [2025-09-17T04:40:53.766173] [INFO ] [MAIN ] KOP: Loaded 12808 existing records. [2025-09-17T04:40:53.947098] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:40:53.947364] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-17T04:40:53.947435] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-17T04:40:53.947962] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-17T04:40:53.948030] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-17T04:40:54.298217] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-17T04:40:54.303005] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:40:54.869037] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T04:40:55.090118] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-11. [2025-09-17T04:40:55.232397] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-17T04:40:55.400935] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T04:40:55.890202] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-17T04:40:56.018914] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T04:40:56.690153] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-17T04:40:57.490161] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-17T04:40:58.285276] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T04:40:58.296522] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-17T04:40:58.458880] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-17T04:40:58.482517] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T04:40:59.090298] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-17T04:40:59.446611] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T04:40:59.890196] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-17T04:41:00.690220] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-17T04:41:01.109774] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T04:41:01.490203] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-17T04:41:01.698713] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-17T04:41:01.725202] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T04:41:02.290179] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-17T04:41:02.752761] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T04:41:03.090206] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-17T04:41:03.294347] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T04:41:03.890226] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-17T04:41:04.077777] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T04:41:04.650123] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T04:41:04.690201] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-17T04:41:05.490177] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-17T04:41:05.769953] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T04:41:06.290136] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-17T04:41:06.726243] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T04:41:07.090172] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-17T04:41:07.890174] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-17T04:41:08.103308] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T04:41:08.690142] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-17T04:41:08.770991] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-17T04:41:09.498200] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-17T04:41:09.514935] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T04:41:09.602973] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T04:41:10.290188] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-17T04:41:11.090190] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-17T04:41:11.880318] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T04:41:11.890003] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-17T04:41:11.937730] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T04:41:12.313677] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-17T04:41:12.690204] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-17T04:41:13.184420] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T04:41:13.490140] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-17T04:41:13.885145] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T04:41:14.290187] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-17T04:41:15.090240] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-17T04:41:15.708464] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T04:41:15.890140] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-17T04:41:16.078585] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T04:41:16.186608] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.70 seconds). [2025-09-17T04:41:16.690133] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-17T04:41:17.402104] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T04:41:17.406016] [INFO ] [REMOTE ] KOP: Full fetch complete (25074 records). [2025-09-17T04:41:17.406228] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-17T04:41:17.493576] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-17T04:41:17.799955] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-17T04:41:17.800229] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-17T04:41:17.801204] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-17T04:41:17.816473] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-17T04:41:17.831294] [DEBUG] [LOCAL ] KOP: Trimmed 25074 records to 18072 (keeping 200 days of data) [2025-09-17T04:41:17.832576] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T04:41:17.958189] [DEBUG] [LOCAL ] KOP: Primary data saved (18072 records). [2025-09-17T04:41:17.958375] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-17T04:41:17.958503] [INFO ] [MAIN ] Update Progress: 1212/2369 symbols completed. KOP took 24.4s. Estimated remaining: 2h 49m 9s. Rate: 6.8 symbols/min [2025-09-17T04:41:18.128600] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:18.131815] [DEBUG] [LOCAL ] KORE: Loaded 1535 existing records from primary storage. [2025-09-17T04:41:18.131907] [INFO ] [MAIN ] KORE: Loaded 1535 existing records. [2025-09-17T04:41:18.295300] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-17T04:41:18.323775] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:18.324062] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-17T04:41:18.324123] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-17T04:41:18.324508] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-17T04:41:18.324570] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-17T04:41:18.694400] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:19.090201] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-17T04:41:19.890146] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-11. [2025-09-17T04:41:20.095575] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T04:41:20.204893] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-17T04:41:20.234493] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (2.74 seconds). [2025-09-17T04:41:20.241245] [INFO ] [REMOTE ] KO: Full fetch complete (77993 records). [2025-09-17T04:41:20.241461] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-17T04:41:20.647837] [DEBUG] [VALIDATOR ] KO: All expected trading days are present. [2025-09-17T04:41:20.656512] [DEBUG] [VALIDATOR ] KO: Primary data validation passed. [2025-09-17T04:41:20.658162] [INFO ] [MAIN ] KO: Fetched primary data is valid. [2025-09-17T04:41:20.659116] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:41:20.659285] [DEBUG] [LOCAL ] KO: Saving primary data. [2025-09-17T04:41:20.666988] [DEBUG] [LOCAL ] KO: Trimmed 77993 records to 53818 (keeping 200 days of data) [2025-09-17T04:41:20.727432] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-17T04:41:21.033384] [DEBUG] [LOCAL ] KO: Primary data saved (53818 records). [2025-09-17T04:41:21.033599] [INFO ] [MAIN ] KO: Full history saved. [2025-09-17T04:41:21.033735] [INFO ] [MAIN ] Update Progress: 1213/2369 symbols completed. KO took 56.8s. Estimated remaining: 2h 48m 55s. Rate: 6.8 symbols/min [2025-09-17T04:41:21.216455] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:21.271064] [DEBUG] [LOCAL ] KOS: Loaded 39572 existing records from primary storage. [2025-09-17T04:41:21.271335] [INFO ] [MAIN ] KOS: Loaded 39572 existing records. [2025-09-17T04:41:21.469058] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:21.469346] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-17T04:41:21.469412] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-17T04:41:21.470369] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-17T04:41:21.470437] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-17T04:41:21.495387] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-17T04:41:21.854944] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:22.204392] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T04:41:22.209718] [INFO ] [REMOTE ] KODK: Full fetch complete (63796 records). [2025-09-17T04:41:22.209947] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-17T04:41:22.295303] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-11. [2025-09-17T04:41:22.641968] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-17T04:41:22.642490] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-17T04:41:22.643996] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-17T04:41:22.644080] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-17T04:41:22.646180] [DEBUG] [LOCAL ] KODK: Trimmed 63796 records to 43444 (keeping 200 days of data) [2025-09-17T04:41:22.927317] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T04:41:22.933402] [DEBUG] [LOCAL ] KODK: Primary data saved (43444 records). [2025-09-17T04:41:22.937634] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-17T04:41:22.937809] [INFO ] [MAIN ] Update Progress: 1214/2369 symbols completed. KODK took 38.4s. Estimated remaining: 2h 48m 39s. Rate: 6.8 symbols/min [2025-09-17T04:41:22.937925] [INFO ] [REMOTE ] KOF: Full fetch complete (36958 records). [2025-09-17T04:41:22.938433] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-17T04:41:23.095000] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-17T04:41:23.256529] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:23.536865] [DEBUG] [LOCAL ] KR: Loaded 40033 existing records from primary storage. [2025-09-17T04:41:23.602046] [INFO ] [MAIN ] KR: Loaded 40033 existing records. [2025-09-17T04:41:23.611714] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-17T04:41:23.656620] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-17T04:41:23.703321] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-17T04:41:23.730632] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-17T04:41:23.783746] [DEBUG] [LOCAL ] KOF: Trimmed 36958 records to 26043 (keeping 200 days of data) [2025-09-17T04:41:23.813215] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:23.813743] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-17T04:41:23.814043] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-17T04:41:23.815388] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-17T04:41:23.815515] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-17T04:41:24.237017] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T04:41:24.264122] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-17T04:41:24.363818] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:24.382337] [DEBUG] [LOCAL ] KOF: Primary data saved (26043 records). [2025-09-17T04:41:24.383062] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-17T04:41:24.383189] [INFO ] [MAIN ] Update Progress: 1215/2369 symbols completed. KOF took 35.7s. Estimated remaining: 2h 48m 24s. Rate: 6.9 symbols/min [2025-09-17T04:41:24.516151] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T04:41:24.628590] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:24.664762] [DEBUG] [LOCAL ] KRC: Loaded 35713 existing records from primary storage. [2025-09-17T04:41:24.664940] [INFO ] [MAIN ] KRC: Loaded 35713 existing records. [2025-09-17T04:41:24.690172] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-11. [2025-09-17T04:41:24.846593] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:24.846898] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-17T04:41:24.846960] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-17T04:41:24.847838] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-17T04:41:24.847919] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-17T04:41:25.202886] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:25.219847] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T04:41:25.490161] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-17T04:41:26.031998] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T04:41:26.290118] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-11. [2025-09-17T04:41:26.363785] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T04:41:27.090130] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-17T04:41:27.869461] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T04:41:27.890096] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-17T04:41:28.690177] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-17T04:41:29.044953] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T04:41:29.113591] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T04:41:29.490168] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-17T04:41:29.909926] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T04:41:30.290154] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-17T04:41:30.544397] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T04:41:31.090167] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-17T04:41:31.857406] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T04:41:31.890079] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-17T04:41:32.690115] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-17T04:41:32.975987] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T04:41:33.100732] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T04:41:33.490168] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-17T04:41:33.929958] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T04:41:34.290112] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-17T04:41:34.403289] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T04:41:35.090182] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-17T04:41:35.891765] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-17T04:41:35.897756] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T04:41:36.690157] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-17T04:41:36.769298] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T04:41:37.490138] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-17T04:41:37.685198] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T04:41:38.290123] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-17T04:41:38.440950] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T04:41:39.090178] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-17T04:41:39.139298] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T04:41:39.890141] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-17T04:41:40.124981] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T04:41:40.174366] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-17T04:41:40.690166] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-17T04:41:40.973666] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T04:41:41.490133] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-17T04:41:42.290184] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-17T04:41:42.660265] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T04:41:42.705198] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T04:41:43.090137] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-17T04:41:43.890194] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-17T04:41:44.240332] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T04:41:44.323574] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T04:41:44.520379] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T04:41:44.690199] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-17T04:41:45.490195] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-17T04:41:45.927872] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T04:41:46.290190] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-17T04:41:46.786625] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T04:41:47.090200] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-17T04:41:47.896502] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-17T04:41:47.919851] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T04:41:48.667304] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T04:41:48.690102] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-17T04:41:49.231873] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-17T04:41:49.490170] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-17T04:41:49.859320] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T04:41:50.290138] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-17T04:41:51.090137] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-17T04:41:51.397477] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T04:41:51.500728] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T04:41:51.838859] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T04:41:51.848615] [INFO ] [REMOTE ] KRC: Full fetch complete (69351 records). [2025-09-17T04:41:51.848944] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-17T04:41:51.896517] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-17T04:41:52.417710] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-17T04:41:52.417861] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-17T04:41:52.419440] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-17T04:41:52.419555] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-17T04:41:52.421313] [DEBUG] [LOCAL ] KRC: Trimmed 69351 records to 48450 (keeping 200 days of data) [2025-09-17T04:41:52.690973] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-17T04:41:52.765127] [DEBUG] [LOCAL ] KRC: Primary data saved (48450 records). [2025-09-17T04:41:52.765344] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-17T04:41:52.765471] [INFO ] [MAIN ] Update Progress: 1216/2369 symbols completed. KRC took 28.4s. Estimated remaining: 2h 48m 33s. Rate: 6.8 symbols/min [2025-09-17T04:41:52.993857] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:53.021326] [DEBUG] [LOCAL ] KREF: Loaded 27305 existing records from primary storage. [2025-09-17T04:41:53.021514] [INFO ] [MAIN ] KREF: Loaded 27305 existing records. [2025-09-17T04:41:53.199488] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:53.199773] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-17T04:41:53.199834] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-17T04:41:53.200430] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-17T04:41:53.200493] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-17T04:41:53.495234] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-17T04:41:53.571377] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:53.820194] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T04:41:53.990350] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T04:41:53.991279] [INFO ] [REMOTE ] KORE: Full fetch complete (6125 records). [2025-09-17T04:41:53.991367] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-17T04:41:54.290596] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-17T04:41:54.357043] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-17T04:41:54.357189] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-17T04:41:54.357404] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-17T04:41:54.357623] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-17T04:41:54.359258] [DEBUG] [LOCAL ] KORE: Trimmed 6125 records to 1956 (keeping 200 days of data) [2025-09-17T04:41:54.373228] [DEBUG] [LOCAL ] KORE: Primary data saved (1956 records). [2025-09-17T04:41:54.373478] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-17T04:41:54.373701] [INFO ] [MAIN ] Update Progress: 1217/2369 symbols completed. KORE took 36.4s. Estimated remaining: 2h 48m 18s. Rate: 6.8 symbols/min [2025-09-17T04:41:54.539630] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T04:41:54.602681] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:54.642532] [DEBUG] [LOCAL ] KRG: Loaded 36453 existing records from primary storage. [2025-09-17T04:41:54.642728] [INFO ] [MAIN ] KRG: Loaded 36453 existing records. [2025-09-17T04:41:54.821867] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:41:54.822114] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-17T04:41:54.822180] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-17T04:41:54.823031] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-17T04:41:54.823106] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-17T04:41:55.095517] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-17T04:41:55.193781] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:55.890161] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-11. [2025-09-17T04:41:56.085837] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T04:41:56.092501] [INFO ] [REMOTE ] KOS: Full fetch complete (76683 records). [2025-09-17T04:41:56.092688] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-17T04:41:56.496440] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-17T04:41:56.496790] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-17T04:41:56.498271] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-17T04:41:56.498379] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-17T04:41:56.500083] [DEBUG] [LOCAL ] KOS: Trimmed 76683 records to 53081 (keeping 200 days of data) [2025-09-17T04:41:56.701732] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-11. [2025-09-17T04:41:56.814967] [DEBUG] [LOCAL ] KOS: Primary data saved (53081 records). [2025-09-17T04:41:56.815167] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-17T04:41:56.815267] [INFO ] [MAIN ] Update Progress: 1218/2369 symbols completed. KOS took 35.8s. Estimated remaining: 2h 48m 3s. Rate: 6.8 symbols/min [2025-09-17T04:41:56.994246] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:41:56.994842] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-17T04:41:56.995107] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-17T04:41:56.995907] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-17T04:41:57.014811] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-17T04:41:57.015160] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-17T04:41:57.015943] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-17T04:41:57.016872] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T04:41:57.226251] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T04:41:57.442601] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:41:57.490154] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-11. [2025-09-17T04:41:57.683545] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:41:57.683949] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-11 [2025-09-17T04:41:58.268736] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T04:41:58.290090] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-17T04:41:59.090169] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-17T04:41:59.821463] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T04:41:59.890159] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-17T04:42:00.690187] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-17T04:42:00.905951] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:42:00.906329] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-17T04:42:00.965882] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T04:42:00.972413] [INFO ] [REMOTE ] KR: Full fetch complete (77522 records). [2025-09-17T04:42:00.972555] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-17T04:42:01.380321] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-17T04:42:01.380483] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-17T04:42:01.381850] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-17T04:42:01.381934] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-17T04:42:01.383664] [DEBUG] [LOCAL ] KR: Trimmed 77522 records to 53682 (keeping 200 days of data) [2025-09-17T04:42:01.490785] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-17T04:42:01.545791] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:42:01.787866] [DEBUG] [LOCAL ] KR: Primary data saved (53682 records). [2025-09-17T04:42:01.788092] [INFO ] [MAIN ] KR: Full history saved. [2025-09-17T04:42:01.788248] [INFO ] [MAIN ] Update Progress: 1219/2369 symbols completed. KR took 38.9s. Estimated remaining: 2h 47m 51s. Rate: 6.9 symbols/min [2025-09-17T04:42:01.961911] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:01.981824] [DEBUG] [LOCAL ] KRO: Loaded 19557 existing records from primary storage. [2025-09-17T04:42:01.982000] [INFO ] [MAIN ] KRO: Loaded 19557 existing records. [2025-09-17T04:42:02.165871] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:02.166165] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-17T04:42:02.166243] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-17T04:42:02.166817] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-17T04:42:02.166895] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-17T04:42:02.295276] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-17T04:42:02.550936] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:03.090183] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-11. [2025-09-17T04:42:03.890209] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-17T04:42:04.146211] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:42:04.146580] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-17T04:42:04.565072] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T04:42:04.614626] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (3.12 seconds). [2025-09-17T04:42:04.690123] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-17T04:42:05.501100] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-17T04:42:05.507890] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T04:42:05.665408] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T04:42:06.290149] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-17T04:42:06.340632] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T04:42:07.090155] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-17T04:42:07.888365] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T04:42:07.897786] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-17T04:42:08.607547] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:42:08.674929] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T04:42:08.690136] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-17T04:42:09.490196] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-17T04:42:10.290126] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-17T04:42:10.452724] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T04:42:11.060511] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T04:42:11.090149] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-17T04:42:11.288504] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T04:42:11.890197] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-17T04:42:12.557312] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T04:42:12.690159] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-17T04:42:12.856986] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T04:42:13.490169] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-17T04:42:13.942703] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:42:14.290183] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-17T04:42:14.605055] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T04:42:15.090131] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-17T04:42:15.890084] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-17T04:42:16.416800] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-17T04:42:16.690174] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-17T04:42:17.232962] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T04:42:17.490153] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-17T04:42:18.079787] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T04:42:18.284066] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:42:18.294328] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-17T04:42:18.461482] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T04:42:19.090165] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-17T04:42:19.530444] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T04:42:19.890215] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-17T04:42:20.214313] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T04:42:20.690187] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-17T04:42:21.336413] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:42:21.490156] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-17T04:42:22.297974] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-17T04:42:22.328425] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T04:42:22.999673] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:42:23.005761] [INFO ] [REMOTE ] KRMN: Full fetch complete (47758 records). [2025-09-17T04:42:23.005938] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-17T04:42:23.095380] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-17T04:42:23.212491] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 148 unique days, need 200 days [2025-09-17T04:42:23.213145] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:42:23.213204] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:42:23.213261] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-17T04:42:23.213344] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-17T04:42:23.213397] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-17T04:42:23.213462] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-17T04:42:23.213562] [INFO ] [MAIN ] Update Progress: 1220/2369 symbols completed. KRMN took 26.4s. Estimated remaining: 2h 47m 54s. Rate: 6.8 symbols/min [2025-09-17T04:42:23.396786] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:23.426523] [DEBUG] [LOCAL ] KRP: Loaded 26905 existing records from primary storage. [2025-09-17T04:42:23.426816] [INFO ] [MAIN ] KRP: Loaded 26905 existing records. [2025-09-17T04:42:23.615202] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:23.616007] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-17T04:42:23.616124] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-17T04:42:23.617117] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-17T04:42:23.617268] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-17T04:42:23.799773] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T04:42:23.895851] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-17T04:42:24.045952] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:24.690149] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-11. [2025-09-17T04:42:24.844197] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T04:42:25.061164] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T04:42:25.490148] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-17T04:42:26.030320] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T04:42:26.290172] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-17T04:42:27.090222] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-17T04:42:27.109236] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T04:42:27.116554] [INFO ] [REMOTE ] KRG: Full fetch complete (70680 records). [2025-09-17T04:42:27.116774] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-17T04:42:27.484181] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T04:42:27.540026] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-17T04:42:27.540614] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-17T04:42:27.541624] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-17T04:42:27.541732] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-17T04:42:27.544796] [DEBUG] [LOCAL ] KRG: Trimmed 70680 records to 49190 (keeping 200 days of data) [2025-09-17T04:42:27.852780] [DEBUG] [LOCAL ] KRG: Primary data saved (49190 records). [2025-09-17T04:42:27.852950] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-17T04:42:27.853068] [INFO ] [MAIN ] Update Progress: 1221/2369 symbols completed. KRG took 33.5s. Estimated remaining: 2h 47m 41s. Rate: 6.8 symbols/min [2025-09-17T04:42:27.895549] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-17T04:42:28.025075] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:28.072464] [DEBUG] [LOCAL ] KSS: Loaded 39965 existing records from primary storage. [2025-09-17T04:42:28.072679] [INFO ] [MAIN ] KSS: Loaded 39965 existing records. [2025-09-17T04:42:28.251544] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:28.251827] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-17T04:42:28.251897] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-17T04:42:28.252894] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-17T04:42:28.252986] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-17T04:42:28.614986] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:28.634408] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T04:42:28.690077] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-17T04:42:29.451851] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T04:42:29.490089] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-17T04:42:29.812411] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T04:42:30.290126] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-11. [2025-09-17T04:42:30.507123] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T04:42:31.090159] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-17T04:42:31.890109] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-17T04:42:32.310252] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T04:42:32.413575] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T04:42:32.690167] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-17T04:42:33.276168] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T04:42:33.490147] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-17T04:42:33.931881] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T04:42:33.935470] [INFO ] [REMOTE ] KRO: Full fetch complete (34478 records). [2025-09-17T04:42:33.935583] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-17T04:42:34.293568] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-17T04:42:34.331415] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-17T04:42:34.331531] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-17T04:42:34.332413] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-17T04:42:34.332475] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-17T04:42:34.333379] [DEBUG] [LOCAL ] KRO: Trimmed 34478 records to 25645 (keeping 200 days of data) [2025-09-17T04:42:34.494108] [DEBUG] [LOCAL ] KRO: Primary data saved (25645 records). [2025-09-17T04:42:34.497917] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-17T04:42:34.498043] [INFO ] [MAIN ] Update Progress: 1222/2369 symbols completed. KRO took 32.7s. Estimated remaining: 2h 47m 31s. Rate: 6.8 symbols/min [2025-09-17T04:42:34.666260] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:34.700461] [DEBUG] [LOCAL ] KT: Loaded 33570 existing records from primary storage. [2025-09-17T04:42:34.700691] [INFO ] [MAIN ] KT: Loaded 33570 existing records. [2025-09-17T04:42:34.877714] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:34.877997] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-17T04:42:34.878056] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-17T04:42:34.878880] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-17T04:42:34.878961] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-17T04:42:35.095261] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-17T04:42:35.252407] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:35.386308] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T04:42:35.743172] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T04:42:35.890182] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-11. [2025-09-17T04:42:36.690151] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-17T04:42:36.792816] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T04:42:37.137008] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T04:42:37.490161] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-17T04:42:38.290143] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-17T04:42:38.535845] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T04:42:39.090145] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-17T04:42:39.189566] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T04:42:39.811573] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T04:42:39.890079] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-17T04:42:40.371607] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T04:42:40.690158] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-17T04:42:41.136890] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T04:42:41.490154] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-17T04:42:42.182069] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T04:42:42.290093] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-17T04:42:42.989101] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T04:42:43.090121] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-17T04:42:43.849578] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T04:42:43.890080] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-17T04:42:44.690084] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-17T04:42:45.185835] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T04:42:45.490135] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-17T04:42:45.569146] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T04:42:45.952954] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:42:45.957578] [INFO ] [REMOTE ] KREF: Full fetch complete (51358 records). [2025-09-17T04:42:45.957780] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-17T04:42:46.301598] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-17T04:42:46.355632] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-17T04:42:46.355791] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-17T04:42:46.356727] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-17T04:42:46.356810] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-17T04:42:46.358662] [DEBUG] [LOCAL ] KREF: Trimmed 51358 records to 36939 (keeping 200 days of data) [2025-09-17T04:42:46.585985] [DEBUG] [LOCAL ] KREF: Primary data saved (36939 records). [2025-09-17T04:42:46.586191] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-17T04:42:46.586328] [INFO ] [MAIN ] Update Progress: 1223/2369 symbols completed. KREF took 53.8s. Estimated remaining: 2h 47m 25s. Rate: 6.8 symbols/min [2025-09-17T04:42:46.756700] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:46.786096] [DEBUG] [LOCAL ] KTB: Loaded 30470 existing records from primary storage. [2025-09-17T04:42:46.786260] [INFO ] [MAIN ] KTB: Loaded 30470 existing records. [2025-09-17T04:42:46.966941] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:46.967708] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-17T04:42:46.967805] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-17T04:42:46.968862] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-17T04:42:46.968940] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-17T04:42:47.095003] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-17T04:42:47.147709] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T04:42:47.376398] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:47.766187] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T04:42:47.890164] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-17T04:42:48.690151] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-17T04:42:49.321180] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T04:42:49.448531] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T04:42:49.490128] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-17T04:42:49.614197] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T04:42:50.290132] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-11. [2025-09-17T04:42:51.063862] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T04:42:51.090082] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-17T04:42:51.618508] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T04:42:51.890163] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-17T04:42:52.406947] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T04:42:52.690212] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-17T04:42:53.490198] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-17T04:42:53.895338] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T04:42:54.258742] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:42:54.290095] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-17T04:42:54.519420] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T04:42:55.090156] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-17T04:42:55.619607] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T04:42:55.627041] [INFO ] [REMOTE ] KT: Full fetch complete (66863 records). [2025-09-17T04:42:55.627258] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-17T04:42:55.897143] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-17T04:42:56.040140] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-17T04:42:56.040249] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-17T04:42:56.041205] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-17T04:42:56.041265] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-17T04:42:56.042697] [DEBUG] [LOCAL ] KT: Trimmed 66863 records to 45727 (keeping 200 days of data) [2025-09-17T04:42:56.327100] [DEBUG] [LOCAL ] KT: Primary data saved (45727 records). [2025-09-17T04:42:56.327275] [INFO ] [MAIN ] KT: Full history saved. [2025-09-17T04:42:56.327381] [INFO ] [MAIN ] Update Progress: 1224/2369 symbols completed. KT took 21.8s. Estimated remaining: 2h 47m 17s. Rate: 6.8 symbols/min [2025-09-17T04:42:56.497255] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:56.507593] [DEBUG] [LOCAL ] KTF: Loaded 8672 existing records from primary storage. [2025-09-17T04:42:56.507767] [INFO ] [MAIN ] KTF: Loaded 8672 existing records. [2025-09-17T04:42:56.688206] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:42:56.688524] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-17T04:42:56.688590] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-17T04:42:56.689044] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-17T04:42:56.689133] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-17T04:42:56.721110] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-17T04:42:57.073171] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:57.111015] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T04:42:57.313021] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T04:42:57.490204] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-17T04:42:58.099458] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T04:42:58.104505] [INFO ] [REMOTE ] KRP: Full fetch complete (54749 records). [2025-09-17T04:42:58.104782] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-17T04:42:58.295482] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-17T04:42:58.516146] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-17T04:42:58.516287] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-17T04:42:58.517505] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-17T04:42:58.517570] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-17T04:42:58.519142] [DEBUG] [LOCAL ] KRP: Trimmed 54749 records to 38147 (keeping 200 days of data) [2025-09-17T04:42:58.774540] [DEBUG] [LOCAL ] KRP: Primary data saved (38147 records). [2025-09-17T04:42:58.774798] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-17T04:42:58.774929] [INFO ] [MAIN ] Update Progress: 1225/2369 symbols completed. KRP took 35.6s. Estimated remaining: 2h 47m 2s. Rate: 6.8 symbols/min [2025-09-17T04:42:58.972271] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:42:58.973832] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T04:42:58.974009] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-17T04:42:58.981105] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-17T04:42:58.981591] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-17T04:42:58.981678] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-17T04:42:58.981734] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-17T04:42:58.981779] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-17T04:42:59.148989] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-11. [2025-09-17T04:42:59.416780] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:42:59.890248] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-17T04:43:00.101336] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T04:43:00.512507] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-17T04:43:00.690104] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-17T04:43:01.465371] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T04:43:01.490168] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-17T04:43:01.607379] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T04:43:02.290225] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-17T04:43:03.090284] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-11. [2025-09-17T04:43:03.582842] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-17T04:43:03.833959] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T04:43:03.890229] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-17T04:43:04.131618] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T04:43:04.690146] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-17T04:43:05.349075] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T04:43:05.490179] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-17T04:43:06.290192] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-17T04:43:06.316388] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T04:43:06.722616] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-17T04:43:06.730819] [INFO ] [REMOTE ] KSS: Full fetch complete (77580 records). [2025-09-17T04:43:06.731061] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-17T04:43:07.097982] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-17T04:43:07.149391] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-17T04:43:07.149766] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-17T04:43:07.151766] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-17T04:43:07.151853] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-17T04:43:07.154958] [DEBUG] [LOCAL ] KSS: Trimmed 77580 records to 53612 (keeping 200 days of data) [2025-09-17T04:43:07.525500] [DEBUG] [LOCAL ] KSS: Primary data saved (53612 records). [2025-09-17T04:43:07.525718] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-17T04:43:07.525839] [INFO ] [MAIN ] Update Progress: 1226/2369 symbols completed. KSS took 39.7s. Estimated remaining: 2h 46m 54s. Rate: 6.8 symbols/min [2025-09-17T04:43:07.698215] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:07.744761] [DEBUG] [LOCAL ] KVUE: Loaded 40017 existing records from primary storage. [2025-09-17T04:43:07.745214] [INFO ] [MAIN ] KVUE: Loaded 40017 existing records. [2025-09-17T04:43:07.912793] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-17T04:43:07.977904] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T04:43:07.985968] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:07.995743] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-17T04:43:08.001088] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-17T04:43:08.004730] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T04:43:08.004896] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-17T04:43:08.008548] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-17T04:43:08.380726] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:08.599938] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T04:43:08.690181] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-17T04:43:09.490212] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-17T04:43:09.587456] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T04:43:10.290150] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-11. [2025-09-17T04:43:10.882176] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T04:43:11.090183] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-17T04:43:11.890250] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-17T04:43:12.017634] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T04:43:12.157126] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T04:43:12.690178] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-17T04:43:12.880839] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T04:43:13.397274] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T04:43:13.490209] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-17T04:43:14.290168] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-17T04:43:15.086764] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T04:43:15.095630] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-17T04:43:15.890186] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-17T04:43:16.064803] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:43:16.085964] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T04:43:16.690251] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-17T04:43:16.743188] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:43:17.029311] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T04:43:17.490236] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-17T04:43:18.290165] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-17T04:43:18.729241] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T04:43:18.777499] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T04:43:19.090184] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-17T04:43:19.446674] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-17T04:43:19.890245] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-17T04:43:20.690226] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-17T04:43:21.490206] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-17T04:43:21.702777] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T04:43:21.917887] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T04:43:22.065749] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T04:43:22.071616] [INFO ] [REMOTE ] KTB: Full fetch complete (57069 records). [2025-09-17T04:43:22.071872] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-17T04:43:22.299039] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-17T04:43:22.484905] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-17T04:43:22.485083] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-17T04:43:22.486219] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-17T04:43:22.486288] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-17T04:43:22.488091] [DEBUG] [LOCAL ] KTB: Trimmed 57069 records to 41355 (keeping 200 days of data) [2025-09-17T04:43:22.765156] [DEBUG] [LOCAL ] KTB: Primary data saved (41355 records). [2025-09-17T04:43:22.765371] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-17T04:43:22.765482] [INFO ] [MAIN ] Update Progress: 1227/2369 symbols completed. KTB took 36.2s. Estimated remaining: 2h 46m 51s. Rate: 6.8 symbols/min [2025-09-17T04:43:22.945529] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:22.987457] [DEBUG] [LOCAL ] KVYO: Loaded 37611 existing records from primary storage. [2025-09-17T04:43:22.987713] [INFO ] [MAIN ] KVYO: Loaded 37611 existing records. [2025-09-17T04:43:23.098628] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-17T04:43:23.196913] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:23.197303] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-17T04:43:23.197373] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-17T04:43:23.198508] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-17T04:43:23.198587] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-17T04:43:23.613772] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:23.890211] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-11. [2025-09-17T04:43:23.980351] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T04:43:24.148882] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T04:43:24.690227] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-17T04:43:25.446208] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T04:43:25.490118] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-17T04:43:25.542395] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T04:43:26.290184] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-17T04:43:26.920476] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T04:43:27.078579] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T04:43:27.090176] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-17T04:43:27.765429] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T04:43:27.766828] [INFO ] [REMOTE ] KUKE: Full fetch complete (8000 records). [2025-09-17T04:43:27.766936] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-17T04:43:27.895244] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-17T04:43:27.957366] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T04:43:27.957703] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:43:27.957762] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:43:27.957812] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-17T04:43:27.957886] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-17T04:43:27.957937] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-17T04:43:27.958010] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-17T04:43:27.958095] [INFO ] [MAIN ] Update Progress: 1228/2369 symbols completed. KUKE took 29.2s. Estimated remaining: 2h 46m 39s. Rate: 6.8 symbols/min [2025-09-17T04:43:28.134100] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:28.163963] [DEBUG] [LOCAL ] KW: Loaded 30155 existing records from primary storage. [2025-09-17T04:43:28.164175] [INFO ] [MAIN ] KW: Loaded 30155 existing records. [2025-09-17T04:43:28.350951] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:28.351235] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-17T04:43:28.351301] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-17T04:43:28.352214] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-17T04:43:28.352282] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-17T04:43:28.712589] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-17T04:43:28.720979] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:28.846612] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T04:43:29.490167] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-17T04:43:30.290209] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-11. [2025-09-17T04:43:30.369258] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T04:43:30.387313] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T04:43:30.389758] [INFO ] [REMOTE ] KTF: Full fetch complete (18455 records). [2025-09-17T04:43:30.389853] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-17T04:43:30.778796] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-17T04:43:30.778962] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-17T04:43:30.780008] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-17T04:43:30.780096] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-17T04:43:30.780886] [DEBUG] [LOCAL ] KTF: Trimmed 18455 records to 13188 (keeping 200 days of data) [2025-09-17T04:43:30.872208] [DEBUG] [LOCAL ] KTF: Primary data saved (13188 records). [2025-09-17T04:43:30.872443] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-17T04:43:30.872565] [INFO ] [MAIN ] Update Progress: 1229/2369 symbols completed. KTF took 34.5s. Estimated remaining: 2h 46m 25s. Rate: 6.9 symbols/min [2025-09-17T04:43:31.061596] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:31.078346] [DEBUG] [LOCAL ] KWR: Loaded 12353 existing records from primary storage. [2025-09-17T04:43:31.078532] [INFO ] [MAIN ] KWR: Loaded 12353 existing records. [2025-09-17T04:43:31.099615] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-17T04:43:31.278969] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:31.279404] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-17T04:43:31.279510] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-17T04:43:31.280597] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-17T04:43:31.280697] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-17T04:43:31.671052] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:31.699829] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T04:43:31.890177] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-11. [2025-09-17T04:43:32.690233] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-17T04:43:32.779008] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T04:43:32.799387] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T04:43:33.490184] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-17T04:43:34.010119] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:43:34.290184] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-17T04:43:35.090126] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-17T04:43:35.125219] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T04:43:35.890196] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-17T04:43:36.131217] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T04:43:36.612235] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T04:43:36.690116] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-17T04:43:37.182436] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T04:43:37.490138] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-17T04:43:37.672100] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T04:43:38.290144] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-17T04:43:39.090208] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-17T04:43:39.197471] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T04:43:39.890153] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-17T04:43:40.200268] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T04:43:40.391689] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T04:43:40.690173] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-17T04:43:41.490204] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-17T04:43:41.627527] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:43:42.024354] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T04:43:42.290164] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-17T04:43:42.482400] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T04:43:43.090183] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-17T04:43:43.890117] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-17T04:43:43.949108] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T04:43:44.631399] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T04:43:44.690167] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-17T04:43:45.425254] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:43:45.490084] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-17T04:43:46.179099] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T04:43:46.290140] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-17T04:43:47.090157] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-17T04:43:47.327309] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T04:43:47.398900] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T04:43:47.890205] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-17T04:43:47.981831] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T04:43:48.690203] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-17T04:43:49.293586] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T04:43:49.490152] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-17T04:43:50.295423] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-17T04:43:50.319478] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T04:43:51.090236] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-17T04:43:51.339679] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T04:43:51.417427] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T04:43:51.424138] [INFO ] [REMOTE ] KVUE: Full fetch complete (77507 records). [2025-09-17T04:43:51.424425] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-17T04:43:51.819691] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-17T04:43:51.819843] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-17T04:43:51.821275] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-17T04:43:51.821342] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-17T04:43:51.823215] [DEBUG] [LOCAL ] KVUE: Trimmed 77507 records to 53667 (keeping 200 days of data) [2025-09-17T04:43:51.891781] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-17T04:43:52.175931] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-09-17T04:43:52.176123] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-17T04:43:52.176226] [INFO ] [MAIN ] Update Progress: 1230/2369 symbols completed. KVUE took 44.7s. Estimated remaining: 2h 46m 27s. Rate: 6.8 symbols/min [2025-09-17T04:43:52.349447] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:52.371506] [DEBUG] [LOCAL ] KYN: Loaded 22074 existing records from primary storage. [2025-09-17T04:43:52.371728] [INFO ] [MAIN ] KYN: Loaded 22074 existing records. [2025-09-17T04:43:52.550130] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:52.550579] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-17T04:43:52.550765] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-17T04:43:52.551456] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-17T04:43:52.566761] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-17T04:43:52.655267] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:43:52.690533] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-17T04:43:52.958475] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:53.490167] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-11. [2025-09-17T04:43:53.619749] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T04:43:53.779040] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T04:43:54.290192] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-17T04:43:54.890787] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T04:43:55.090179] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-17T04:43:55.369912] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T04:43:55.890245] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-17T04:43:56.481299] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T04:43:56.488779] [INFO ] [REMOTE ] KW: Full fetch complete (56571 records). [2025-09-17T04:43:56.489083] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-17T04:43:56.695718] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-17T04:43:57.034601] [DEBUG] [VALIDATOR ] KW: All expected trading days are present. [2025-09-17T04:43:57.034774] [DEBUG] [VALIDATOR ] KW: Primary data validation passed. [2025-09-17T04:43:57.035869] [INFO ] [MAIN ] KW: Fetched primary data is valid. [2025-09-17T04:43:57.035964] [DEBUG] [LOCAL ] KW: Saving primary data. [2025-09-17T04:43:57.037940] [DEBUG] [LOCAL ] KW: Trimmed 56571 records to 40623 (keeping 200 days of data) [2025-09-17T04:43:57.289354] [DEBUG] [LOCAL ] KW: Primary data saved (40623 records). [2025-09-17T04:43:57.289542] [INFO ] [MAIN ] KW: Full history saved. [2025-09-17T04:43:57.289662] [INFO ] [MAIN ] Update Progress: 1231/2369 symbols completed. KW took 29.3s. Estimated remaining: 2h 46m 15s. Rate: 6.8 symbols/min [2025-09-17T04:43:57.482321] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:57.490164] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-17T04:43:57.514820] [DEBUG] [LOCAL ] L: Loaded 30321 existing records from primary storage. [2025-09-17T04:43:57.515040] [INFO ] [MAIN ] L: Loaded 30321 existing records. [2025-09-17T04:43:57.695488] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:57.696153] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-17T04:43:57.696250] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-17T04:43:57.703692] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-17T04:43:57.716057] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-17T04:43:57.716808] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T04:43:57.805110] [INFO ] [REMOTE ] KVYO: Full fetch complete (70976 records). [2025-09-17T04:43:57.836955] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T04:43:57.840404] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-17T04:43:58.314482] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-17T04:43:58.383776] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:58.504628] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-17T04:43:58.504762] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-17T04:43:58.505744] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-17T04:43:58.505802] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-17T04:43:58.507242] [DEBUG] [LOCAL ] KVYO: Trimmed 70976 records to 49770 (keeping 200 days of data) [2025-09-17T04:43:58.804994] [DEBUG] [LOCAL ] KVYO: Primary data saved (49770 records). [2025-09-17T04:43:58.805182] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-17T04:43:58.805285] [INFO ] [MAIN ] Update Progress: 1232/2369 symbols completed. KVYO took 36.0s. Estimated remaining: 2h 45m 60s. Rate: 6.8 symbols/min [2025-09-17T04:43:58.980103] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:43:59.001243] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T04:43:59.043073] [DEBUG] [LOCAL ] LAC: Loaded 39040 existing records from primary storage. [2025-09-17T04:43:59.043308] [INFO ] [MAIN ] LAC: Loaded 39040 existing records. [2025-09-17T04:43:59.097232] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-17T04:43:59.223358] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:43:59.223665] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-17T04:43:59.223729] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-17T04:43:59.224553] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-17T04:43:59.224617] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-17T04:43:59.579655] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:43:59.592444] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T04:43:59.890154] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-11. [2025-09-17T04:44:00.300851] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T04:44:00.690168] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-17T04:44:01.490176] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-17T04:44:01.936518] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:44:01.988364] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-11 (2.10 seconds). [2025-09-17T04:44:02.180501] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T04:44:02.290116] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-17T04:44:03.090148] [INFO ] [REMOTE ] L: Fetching primary data for 2024-11. [2025-09-17T04:44:03.890215] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-17T04:44:04.465922] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-17T04:44:04.616828] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T04:44:04.690163] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-17T04:44:04.837296] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T04:44:05.490169] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-17T04:44:05.992461] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T04:44:06.290176] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-17T04:44:06.577266] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T04:44:07.090177] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-17T04:44:07.199020] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T04:44:07.201213] [INFO ] [REMOTE ] KWR: Full fetch complete (23996 records). [2025-09-17T04:44:07.201307] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-17T04:44:07.567603] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-17T04:44:07.567738] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-17T04:44:07.568407] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-17T04:44:07.568472] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-17T04:44:07.569268] [DEBUG] [LOCAL ] KWR: Trimmed 23996 records to 16974 (keeping 200 days of data) [2025-09-17T04:44:07.676931] [DEBUG] [LOCAL ] KWR: Primary data saved (16974 records). [2025-09-17T04:44:07.677134] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-17T04:44:07.677236] [INFO ] [MAIN ] Update Progress: 1233/2369 symbols completed. KWR took 36.8s. Estimated remaining: 2h 45m 51s. Rate: 6.8 symbols/min [2025-09-17T04:44:07.846499] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:44:07.864056] [DEBUG] [LOCAL ] LAD: Loaded 16994 existing records from primary storage. [2025-09-17T04:44:07.864257] [INFO ] [MAIN ] LAD: Loaded 16994 existing records. [2025-09-17T04:44:07.898394] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-17T04:44:08.050673] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:44:08.050971] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-17T04:44:08.051041] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-17T04:44:08.051602] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-17T04:44:08.051690] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-17T04:44:08.403506] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:44:08.535216] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T04:44:08.690155] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-17T04:44:09.082803] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T04:44:09.490180] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-17T04:44:10.070759] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T04:44:10.290205] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-17T04:44:10.953987] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T04:44:11.090168] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-17T04:44:11.489468] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T04:44:11.890152] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-17T04:44:12.690184] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-11. [2025-09-17T04:44:12.852611] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T04:44:12.903931] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T04:44:13.490114] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-17T04:44:13.878943] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T04:44:14.290168] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-17T04:44:15.037943] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T04:44:15.090097] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-17T04:44:15.473040] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T04:44:15.890143] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-17T04:44:16.445097] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T04:44:16.690173] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-17T04:44:17.108158] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T04:44:17.490187] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-17T04:44:17.613168] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T04:44:18.290197] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-17T04:44:18.746719] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T04:44:18.750380] [INFO ] [REMOTE ] KYN: Full fetch complete (45296 records). [2025-09-17T04:44:18.750500] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-17T04:44:19.096963] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-17T04:44:19.132046] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-17T04:44:19.132176] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-17T04:44:19.133294] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-17T04:44:19.133378] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-17T04:44:19.134714] [DEBUG] [LOCAL ] KYN: Trimmed 45296 records to 30513 (keeping 200 days of data) [2025-09-17T04:44:19.340835] [DEBUG] [LOCAL ] KYN: Primary data saved (30513 records). [2025-09-17T04:44:19.341041] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-17T04:44:19.341145] [INFO ] [MAIN ] Update Progress: 1234/2369 symbols completed. KYN took 27.2s. Estimated remaining: 2h 45m 45s. Rate: 6.8 symbols/min [2025-09-17T04:44:19.536582] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:44:19.570215] [DEBUG] [LOCAL ] LADR: Loaded 28533 existing records from primary storage. [2025-09-17T04:44:19.570417] [INFO ] [MAIN ] LADR: Loaded 28533 existing records. [2025-09-17T04:44:19.761055] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:44:19.761467] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-17T04:44:19.761630] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-17T04:44:19.762365] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-17T04:44:19.762428] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-17T04:44:19.892031] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-17T04:44:19.999897] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T04:44:20.198404] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:44:20.348132] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:44:20.690141] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-17T04:44:21.245237] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T04:44:21.490109] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-17T04:44:22.290186] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-11. [2025-09-17T04:44:22.651930] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T04:44:22.699547] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T04:44:23.090166] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-17T04:44:23.384395] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T04:44:23.890146] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-17T04:44:24.354608] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T04:44:24.690164] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-17T04:44:24.851397] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T04:44:25.490165] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-17T04:44:26.124481] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T04:44:26.290141] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-17T04:44:27.090158] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-17T04:44:27.546823] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T04:44:27.585712] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T04:44:27.890154] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-17T04:44:28.414999] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T04:44:28.690180] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-17T04:44:29.490247] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-17T04:44:29.631051] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:44:29.701050] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T04:44:30.290161] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-17T04:44:30.790258] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T04:44:31.090200] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-17T04:44:31.363919] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T04:44:31.890184] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-17T04:44:32.534811] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T04:44:32.690249] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-17T04:44:33.411566] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T04:44:33.490167] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-17T04:44:34.290116] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-17T04:44:34.521781] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T04:44:35.090207] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-17T04:44:35.147444] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T04:44:35.412835] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T04:44:35.417974] [INFO ] [REMOTE ] L: Full fetch complete (59289 records). [2025-09-17T04:44:35.418132] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-17T04:44:35.813211] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-17T04:44:35.813325] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-17T04:44:35.814223] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-17T04:44:35.814281] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-17T04:44:35.815490] [DEBUG] [LOCAL ] L: Trimmed 59289 records to 40939 (keeping 200 days of data) [2025-09-17T04:44:35.907698] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-17T04:44:36.077832] [DEBUG] [LOCAL ] L: Primary data saved (40939 records). [2025-09-17T04:44:36.078051] [INFO ] [MAIN ] L: Full history saved. [2025-09-17T04:44:36.078184] [INFO ] [MAIN ] Update Progress: 1235/2369 symbols completed. L took 38.8s. Estimated remaining: 2h 45m 44s. Rate: 6.8 symbols/min [2025-09-17T04:44:36.253449] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:44:36.257084] [DEBUG] [LOCAL ] LANV: Loaded 1929 existing records from primary storage. [2025-09-17T04:44:36.257182] [INFO ] [MAIN ] LANV: Loaded 1929 existing records. [2025-09-17T04:44:36.446861] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:44:36.447184] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-17T04:44:36.447263] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-17T04:44:36.447500] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-17T04:44:36.447567] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-17T04:44:36.703269] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-17T04:44:36.820066] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:44:37.145616] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T04:44:37.341386] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T04:44:37.490084] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-11. [2025-09-17T04:44:37.532858] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T04:44:37.823682] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T04:44:38.290139] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-17T04:44:38.720954] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T04:44:39.090129] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-17T04:44:39.890139] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-17T04:44:40.221319] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T04:44:40.690158] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-17T04:44:41.262875] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T04:44:41.490113] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-17T04:44:41.661485] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T04:44:41.665166] [INFO ] [REMOTE ] LAD: Full fetch complete (35322 records). [2025-09-17T04:44:41.665343] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-17T04:44:42.057188] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-17T04:44:42.057310] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-17T04:44:42.058174] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-17T04:44:42.058292] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-17T04:44:42.059284] [DEBUG] [LOCAL ] LAD: Trimmed 35322 records to 24197 (keeping 200 days of data) [2025-09-17T04:44:42.222810] [DEBUG] [LOCAL ] LAD: Primary data saved (24197 records). [2025-09-17T04:44:42.223013] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-17T04:44:42.223163] [INFO ] [MAIN ] Update Progress: 1236/2369 symbols completed. LAD took 34.5s. Estimated remaining: 2h 45m 32s. Rate: 6.8 symbols/min [2025-09-17T04:44:42.296694] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-17T04:44:42.403890] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:44:42.441787] [DEBUG] [LOCAL ] LAR: Loaded 33661 existing records from primary storage. [2025-09-17T04:44:42.442635] [INFO ] [MAIN ] LAR: Loaded 33661 existing records. [2025-09-17T04:44:42.620203] [WARN ] [MAIN ] LAR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:44:42.620456] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-17T04:44:42.620525] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-17T04:44:42.621192] [DEBUG] [LOCAL ] LAR: Deleted primary data file. [2025-09-17T04:44:42.621288] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-17T04:44:42.982533] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:44:43.011809] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T04:44:43.090153] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-11. [2025-09-17T04:44:43.278467] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:44:43.278892] [WARN ] [REMOTE ] LAR: No data returned for month 2024-11 [2025-09-17T04:44:43.890119] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-17T04:44:44.080006] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:44:44.080348] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-17T04:44:44.329114] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T04:44:44.690159] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-17T04:44:45.238109] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T04:44:45.490147] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-17T04:44:46.290200] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-17T04:44:46.742603] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T04:44:47.090187] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-17T04:44:47.342762] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T04:44:47.349738] [INFO ] [REMOTE ] LAC: Full fetch complete (75851 records). [2025-09-17T04:44:47.349893] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-17T04:44:47.736031] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-17T04:44:47.736146] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-17T04:44:47.737164] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-17T04:44:47.737226] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-17T04:44:47.738699] [DEBUG] [LOCAL ] LAC: Trimmed 75851 records to 52277 (keeping 200 days of data) [2025-09-17T04:44:47.903458] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-17T04:44:48.064380] [DEBUG] [LOCAL ] LAC: Primary data saved (52277 records). [2025-09-17T04:44:48.064625] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-17T04:44:48.064811] [INFO ] [MAIN ] Update Progress: 1237/2369 symbols completed. LAC took 49.3s. Estimated remaining: 2h 45m 21s. Rate: 6.8 symbols/min [2025-09-17T04:44:48.471360] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T04:44:48.506665] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T04:44:48.690183] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-17T04:44:49.490216] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-17T04:44:50.028283] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T04:44:50.035620] [INFO ] [REMOTE ] LADR: Full fetch complete (54614 records). [2025-09-17T04:44:50.035945] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-17T04:44:50.312055] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-17T04:44:50.417259] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T04:44:50.456123] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-17T04:44:50.456269] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-17T04:44:50.457298] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-17T04:44:50.457379] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-17T04:44:50.459121] [DEBUG] [LOCAL ] LADR: Trimmed 54614 records to 38529 (keeping 200 days of data) [2025-09-17T04:44:50.705422] [DEBUG] [LOCAL ] LADR: Primary data saved (38529 records). [2025-09-17T04:44:50.705661] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-17T04:44:50.705775] [INFO ] [MAIN ] Update Progress: 1238/2369 symbols completed. LADR took 31.4s. Estimated remaining: 2h 45m 7s. Rate: 6.8 symbols/min [2025-09-17T04:44:50.827482] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T04:44:51.090155] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-17T04:44:51.890200] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-17T04:44:52.317175] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T04:44:52.693526] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-17T04:44:52.696942] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T04:44:53.153316] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T04:44:53.490201] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-17T04:44:53.970756] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T04:44:54.290190] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-17T04:44:54.686199] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-17T04:44:55.090154] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-17T04:44:55.788760] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T04:44:55.790090] [INFO ] [REMOTE ] LANV: Full fetch complete (4252 records). [2025-09-17T04:44:55.790196] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-17T04:44:55.894460] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-17T04:44:56.165290] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-17T04:44:56.165414] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-17T04:44:56.165705] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-17T04:44:56.165779] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-17T04:44:56.166177] [DEBUG] [LOCAL ] LANV: Trimmed 4252 records to 2616 (keeping 200 days of data) [2025-09-17T04:44:56.181220] [DEBUG] [LOCAL ] LANV: Primary data saved (2616 records). [2025-09-17T04:44:56.181299] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-17T04:44:56.181396] [INFO ] [MAIN ] Update Progress: 1239/2369 symbols completed. LANV took 20.1s. Estimated remaining: 2h 44m 55s. Rate: 6.9 symbols/min [2025-09-17T04:44:57.607861] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T04:44:57.617221] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-17T04:44:59.287987] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:44:59.297679] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-17T04:45:00.997881] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T04:45:01.009125] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-17T04:45:02.848604] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T04:45:02.857840] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-17T04:45:05.385709] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-17T04:45:05.396254] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-17T04:45:07.167936] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T04:45:07.178440] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-17T04:45:08.775620] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T04:45:08.781289] [INFO ] [REMOTE ] LAR: Full fetch complete (52601 records). [2025-09-17T04:45:08.781433] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-17T04:45:08.972857] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 161 unique days, need 200 days [2025-09-17T04:45:08.973446] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:45:08.973521] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:45:08.973580] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-17T04:45:08.973666] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-17T04:45:08.973727] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-17T04:45:08.974196] [DEBUG] [LOCAL ] LAR: Deleted derivative data file. [2025-09-17T04:45:08.974302] [INFO ] [MAIN ] Update Progress: 1240/2369 symbols completed. LAR took 26.8s. Estimated remaining: 2h 44m 50s. Rate: 6.8 symbols/min [2025-09-17T04:45:09.596538] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:09.655165] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:09.682184] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:09.703446] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:09.719371] [DEBUG] [LOCAL ] LAW: Loaded 10628 existing records from primary storage. [2025-09-17T04:45:09.719603] [INFO ] [MAIN ] LAW: Loaded 10628 existing records. [2025-09-17T04:45:09.884417] [DEBUG] [LOCAL ] LAZ: Loaded 33463 existing records from primary storage. [2025-09-17T04:45:09.962267] [INFO ] [MAIN ] LAZ: Loaded 33463 existing records. [2025-09-17T04:45:09.954538] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:09.963007] [DEBUG] [LOCAL ] LBRT: Loaded 39400 existing records from primary storage. [2025-09-17T04:45:09.984540] [DEBUG] [LOCAL ] LB: Loaded 27672 existing records from primary storage. [2025-09-17T04:45:09.998872] [INFO ] [MAIN ] LB: Loaded 27672 existing records. [2025-09-17T04:45:09.998997] [INFO ] [MAIN ] LBRT: Loaded 39400 existing records. [2025-09-17T04:45:09.993565] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-17T04:45:10.009410] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-17T04:45:10.125329] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-17T04:45:10.182950] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-17T04:45:10.556799] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:10.552536] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:10.600240] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-17T04:45:10.609868] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-17T04:45:10.615285] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-17T04:45:10.615586] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:10.615657] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-17T04:45:10.636400] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-17T04:45:10.669391] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-17T04:45:10.669443] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-17T04:45:10.692592] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-17T04:45:10.734823] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-17T04:45:10.763167] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-17T04:45:10.808927] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-17T04:45:10.898410] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-17T04:45:11.304792] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:11.382451] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-11. [2025-09-17T04:45:11.856423] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:11.935327] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:11.900506] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-11. [2025-09-17T04:45:11.939695] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-11. [2025-09-17T04:45:12.022241] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:12.022616] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-11. [2025-09-17T04:45:12.516922] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T04:45:12.520924] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-17T04:45:13.409556] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T04:45:13.418628] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-17T04:45:13.458369] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T04:45:13.462547] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-17T04:45:13.495126] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T04:45:13.503389] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-17T04:45:13.751324] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T04:45:13.762049] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-17T04:45:14.406639] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T04:45:14.410200] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-17T04:45:14.636965] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T04:45:14.646344] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-17T04:45:14.977415] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T04:45:14.985995] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-17T04:45:15.094521] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T04:45:15.098199] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-17T04:45:15.408811] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T04:45:15.419857] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-17T04:45:16.783679] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T04:45:16.788525] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-17T04:45:17.178055] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-17T04:45:17.187998] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-17T04:45:17.260014] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-17T04:45:17.268952] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-17T04:45:17.589324] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-17T04:45:17.600033] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-17T04:45:17.777675] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T04:45:17.780897] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-17T04:45:18.302466] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T04:45:18.312776] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-17T04:45:18.338141] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T04:45:18.347029] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-17T04:45:18.662075] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T04:45:18.665900] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-17T04:45:19.241912] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T04:45:19.252167] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-17T04:45:19.567954] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T04:45:19.890142] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-17T04:45:19.947205] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T04:45:20.046282] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T04:45:20.690163] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-17T04:45:20.740354] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T04:45:20.780538] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T04:45:21.490137] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-17T04:45:22.187030] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T04:45:22.290154] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-17T04:45:22.363275] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:45:23.090152] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-17T04:45:23.261528] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T04:45:23.263856] [INFO ] [REMOTE ] LAW: Full fetch complete (20432 records). [2025-09-17T04:45:23.263954] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-17T04:45:23.632154] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-17T04:45:23.632282] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-17T04:45:23.632841] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-17T04:45:23.632900] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-17T04:45:23.633684] [DEBUG] [LOCAL ] LAW: Trimmed 20432 records to 13798 (keeping 200 days of data) [2025-09-17T04:45:23.711270] [DEBUG] [LOCAL ] LAW: Primary data saved (13798 records). [2025-09-17T04:45:23.711463] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-17T04:45:23.711568] [INFO ] [MAIN ] Update Progress: 1241/2369 symbols completed. LAW took 14.7s. Estimated remaining: 2h 44m 46s. Rate: 6.8 symbols/min [2025-09-17T04:45:23.881206] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:23.890166] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-17T04:45:23.918335] [DEBUG] [LOCAL ] LC: Loaded 35580 existing records from primary storage. [2025-09-17T04:45:23.918522] [INFO ] [MAIN ] LC: Loaded 35580 existing records. [2025-09-17T04:45:24.099176] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:24.099452] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-17T04:45:24.099512] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-17T04:45:24.100401] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-17T04:45:24.100472] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-17T04:45:24.460721] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:24.483246] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T04:45:24.690148] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-17T04:45:25.490201] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-11. [2025-09-17T04:45:25.692460] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T04:45:26.190128] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T04:45:26.290137] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-17T04:45:27.090148] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-17T04:45:27.155375] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T04:45:27.895247] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-17T04:45:27.907585] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T04:45:28.690186] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-17T04:45:28.862710] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T04:45:29.490203] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-17T04:45:29.542151] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T04:45:30.244396] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T04:45:30.290095] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-17T04:45:31.090206] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-17T04:45:31.143579] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T04:45:31.665081] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T04:45:31.669528] [INFO ] [REMOTE ] LB: Full fetch complete (56291 records). [2025-09-17T04:45:31.669772] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-17T04:45:31.902520] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-17T04:45:32.077787] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-17T04:45:32.077935] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-17T04:45:32.078954] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-17T04:45:32.079052] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-17T04:45:32.080508] [DEBUG] [LOCAL ] LB: Trimmed 56291 records to 37949 (keeping 200 days of data) [2025-09-17T04:45:32.330382] [DEBUG] [LOCAL ] LB: Primary data saved (37949 records). [2025-09-17T04:45:32.330585] [INFO ] [MAIN ] LB: Full history saved. [2025-09-17T04:45:32.330736] [INFO ] [MAIN ] Update Progress: 1242/2369 symbols completed. LB took 23.4s. Estimated remaining: 2h 44m 38s. Rate: 6.8 symbols/min [2025-09-17T04:45:32.511161] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:32.532901] [DEBUG] [LOCAL ] LCII: Loaded 20266 existing records from primary storage. [2025-09-17T04:45:32.533122] [INFO ] [MAIN ] LCII: Loaded 20266 existing records. [2025-09-17T04:45:32.690723] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-17T04:45:32.727886] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:32.728215] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-17T04:45:32.728280] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-17T04:45:32.751314] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-17T04:45:32.754183] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-17T04:45:32.831970] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T04:45:33.121658] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:33.490183] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-11. [2025-09-17T04:45:33.752292] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T04:45:34.241082] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T04:45:34.290130] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-17T04:45:34.487184] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T04:45:35.073837] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T04:45:35.090081] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-17T04:45:35.890175] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-17T04:45:36.187410] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T04:45:36.690134] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-17T04:45:37.387384] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T04:45:37.490110] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-17T04:45:37.853835] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T04:45:38.290133] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-17T04:45:39.068195] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T04:45:39.090073] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-17T04:45:39.890128] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-17T04:45:40.245028] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T04:45:40.312077] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T04:45:40.690114] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-17T04:45:41.490372] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-17T04:45:41.556713] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T04:45:41.743220] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T04:45:42.290199] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-17T04:45:42.967986] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T04:45:42.973963] [INFO ] [REMOTE ] LAZ: Full fetch complete (65524 records). [2025-09-17T04:45:42.974216] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-17T04:45:43.095375] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-17T04:45:43.403007] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-17T04:45:43.403140] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-17T04:45:43.404082] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-17T04:45:43.404184] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-17T04:45:43.405667] [DEBUG] [LOCAL ] LAZ: Trimmed 65524 records to 45488 (keeping 200 days of data) [2025-09-17T04:45:43.689163] [DEBUG] [LOCAL ] LAZ: Primary data saved (45488 records). [2025-09-17T04:45:43.689423] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-17T04:45:43.689562] [INFO ] [MAIN ] Update Progress: 1243/2369 symbols completed. LAZ took 34.7s. Estimated remaining: 2h 44m 31s. Rate: 6.8 symbols/min [2025-09-17T04:45:43.858936] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:43.882274] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T04:45:43.890724] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-17T04:45:43.932326] [DEBUG] [LOCAL ] LDI: Loaded 32271 existing records from primary storage. [2025-09-17T04:45:43.932550] [INFO ] [MAIN ] LDI: Loaded 32271 existing records. [2025-09-17T04:45:44.122010] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:44.122301] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-17T04:45:44.122365] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-17T04:45:44.123149] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-17T04:45:44.123216] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-17T04:45:44.499069] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:44.541626] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T04:45:44.690225] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-17T04:45:45.490207] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-11. [2025-09-17T04:45:45.657040] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T04:45:45.687455] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T04:45:46.290157] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-17T04:45:46.968942] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T04:45:47.092622] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-17T04:45:47.096821] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T04:45:47.890142] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-17T04:45:48.690160] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-17T04:45:48.764595] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:45:49.490112] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-17T04:45:49.570021] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T04:45:49.610781] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T04:45:49.618723] [INFO ] [REMOTE ] LBRT: Full fetch complete (76310 records). [2025-09-17T04:45:49.618996] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-17T04:45:50.012418] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-17T04:45:50.012542] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-17T04:45:50.013563] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-17T04:45:50.013628] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-17T04:45:50.015243] [DEBUG] [LOCAL ] LBRT: Trimmed 76310 records to 52928 (keeping 200 days of data) [2025-09-17T04:45:50.303541] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-17T04:45:50.351714] [DEBUG] [LOCAL ] LBRT: Primary data saved (52928 records). [2025-09-17T04:45:50.351873] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-17T04:45:50.352006] [INFO ] [MAIN ] Update Progress: 1244/2369 symbols completed. LBRT took 41.4s. Estimated remaining: 2h 44m 21s. Rate: 6.8 symbols/min [2025-09-17T04:45:50.525826] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:50.561612] [DEBUG] [LOCAL ] LDOS: Loaded 33529 existing records from primary storage. [2025-09-17T04:45:50.561867] [INFO ] [MAIN ] LDOS: Loaded 33529 existing records. [2025-09-17T04:45:50.746946] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:50.747219] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-17T04:45:50.747279] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-17T04:45:50.748213] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-17T04:45:50.748278] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-17T04:45:51.093096] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-17T04:45:51.125111] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:51.159436] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T04:45:51.532137] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T04:45:51.890192] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-17T04:45:52.570909] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T04:45:52.690187] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-17T04:45:53.311132] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T04:45:53.490145] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-17T04:45:53.945838] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T04:45:54.290176] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-17T04:45:54.910071] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T04:45:55.053143] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T04:45:55.056418] [INFO ] [REMOTE ] LCII: Full fetch complete (38742 records). [2025-09-17T04:45:55.056573] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-17T04:45:55.095295] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-17T04:45:55.447572] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-17T04:45:55.447706] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-17T04:45:55.448421] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-17T04:45:55.448474] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-17T04:45:55.449391] [DEBUG] [LOCAL ] LCII: Trimmed 38742 records to 28819 (keeping 200 days of data) [2025-09-17T04:45:55.634793] [DEBUG] [LOCAL ] LCII: Primary data saved (28819 records). [2025-09-17T04:45:55.635077] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-17T04:45:55.635198] [INFO ] [MAIN ] Update Progress: 1245/2369 symbols completed. LCII took 23.3s. Estimated remaining: 2h 44m 9s. Rate: 6.8 symbols/min [2025-09-17T04:45:55.810811] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:45:55.822075] [DEBUG] [LOCAL ] LDP: Loaded 9457 existing records from primary storage. [2025-09-17T04:45:55.822235] [INFO ] [MAIN ] LDP: Loaded 9457 existing records. [2025-09-17T04:45:55.899631] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-11. [2025-09-17T04:45:56.007498] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:45:56.007782] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-17T04:45:56.007842] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-17T04:45:56.008293] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-17T04:45:56.008350] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-17T04:45:56.376119] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:45:56.515707] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T04:45:56.690177] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-17T04:45:57.490204] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-17T04:45:57.760436] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T04:45:57.948878] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T04:45:58.290183] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-17T04:45:58.669857] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T04:45:59.090202] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-17T04:45:59.672418] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:45:59.890179] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-11. [2025-09-17T04:46:00.672491] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T04:46:00.690089] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-17T04:46:00.746889] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T04:46:01.490213] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-17T04:46:02.082389] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T04:46:02.290203] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-17T04:46:03.090190] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-17T04:46:03.224568] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T04:46:03.633472] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T04:46:03.639496] [INFO ] [REMOTE ] LC: Full fetch complete (70080 records). [2025-09-17T04:46:03.639758] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-17T04:46:03.900188] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-17T04:46:04.049005] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-17T04:46:04.049140] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-17T04:46:04.050221] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-17T04:46:04.050295] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-17T04:46:04.051875] [DEBUG] [LOCAL ] LC: Trimmed 70080 records to 48048 (keeping 200 days of data) [2025-09-17T04:46:04.355721] [DEBUG] [LOCAL ] LC: Primary data saved (48048 records). [2025-09-17T04:46:04.355917] [INFO ] [MAIN ] LC: Full history saved. [2025-09-17T04:46:04.356016] [INFO ] [MAIN ] Update Progress: 1246/2369 symbols completed. LC took 40.6s. Estimated remaining: 2h 43m 60s. Rate: 6.8 symbols/min [2025-09-17T04:46:04.537614] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:46:04.568739] [DEBUG] [LOCAL ] LEA: Loaded 30603 existing records from primary storage. [2025-09-17T04:46:04.568957] [INFO ] [MAIN ] LEA: Loaded 30603 existing records. [2025-09-17T04:46:04.691416] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-17T04:46:04.762416] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:46:04.762781] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-17T04:46:04.763020] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-17T04:46:04.777001] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-17T04:46:04.800514] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-17T04:46:04.885787] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T04:46:05.206431] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:46:05.490181] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-11. [2025-09-17T04:46:05.695427] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T04:46:05.729530] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T04:46:06.290165] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-17T04:46:06.947499] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T04:46:06.993029] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T04:46:07.090152] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-17T04:46:07.870379] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T04:46:07.890096] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-17T04:46:08.690218] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-17T04:46:09.490121] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-17T04:46:09.565700] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T04:46:10.008830] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-17T04:46:10.290941] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-17T04:46:10.296185] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T04:46:11.090163] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-17T04:46:11.301172] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T04:46:11.890137] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-17T04:46:12.690148] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-17T04:46:12.832562] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T04:46:12.936128] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T04:46:13.490137] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-17T04:46:14.214560] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T04:46:14.290218] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-17T04:46:14.353785] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T04:46:15.090155] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-17T04:46:15.878032] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T04:46:15.890086] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-17T04:46:15.982735] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T04:46:16.690167] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-17T04:46:17.469736] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T04:46:17.490091] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-17T04:46:18.231429] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:46:18.290111] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-17T04:46:18.382367] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T04:46:19.090142] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-17T04:46:19.658860] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T04:46:19.890147] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-17T04:46:20.259818] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T04:46:20.690147] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-17T04:46:21.390458] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T04:46:21.490181] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-17T04:46:22.290163] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-17T04:46:22.403090] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T04:46:22.409750] [INFO ] [REMOTE ] LDP: Full fetch complete (19554 records). [2025-09-17T04:46:22.409969] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-17T04:46:22.797161] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-17T04:46:22.797338] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-17T04:46:22.797898] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-17T04:46:22.797971] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-17T04:46:22.826017] [DEBUG] [LOCAL ] LDP: Trimmed 19554 records to 13181 (keeping 200 days of data) [2025-09-17T04:46:22.825878] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-17T04:46:22.836457] [INFO ] [REMOTE ] LDI: Full fetch complete (59466 records). [2025-09-17T04:46:22.896273] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-17T04:46:22.922748] [DEBUG] [LOCAL ] LDP: Primary data saved (13181 records). [2025-09-17T04:46:22.923410] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-17T04:46:22.923532] [INFO ] [MAIN ] Update Progress: 1247/2369 symbols completed. LDP took 27.3s. Estimated remaining: 2h 43m 60s. Rate: 6.8 symbols/min [2025-09-17T04:46:23.091632] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-17T04:46:23.287946] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:46:23.579166] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-17T04:46:23.590201] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-17T04:46:23.591250] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-17T04:46:23.591895] [DEBUG] [LOCAL ] LEG: Loaded 37283 existing records from primary storage. [2025-09-17T04:46:23.592096] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-17T04:46:23.592173] [INFO ] [MAIN ] LEG: Loaded 37283 existing records. [2025-09-17T04:46:23.695568] [DEBUG] [LOCAL ] LDI: Trimmed 59466 records to 43208 (keeping 200 days of data) [2025-09-17T04:46:23.830847] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:46:23.872470] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-17T04:46:23.873661] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-17T04:46:23.882095] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-17T04:46:23.884373] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-17T04:46:24.319988] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T04:46:24.413807] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-17T04:46:24.422112] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:46:24.475667] [DEBUG] [LOCAL ] LDI: Primary data saved (43208 records). [2025-09-17T04:46:24.475880] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-17T04:46:24.476015] [INFO ] [MAIN ] Update Progress: 1248/2369 symbols completed. LDI took 40.8s. Estimated remaining: 2h 43m 45s. Rate: 6.8 symbols/min [2025-09-17T04:46:24.651825] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:46:24.691440] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-11. [2025-09-17T04:46:24.693569] [DEBUG] [LOCAL ] LEN: Loaded 39613 existing records from primary storage. [2025-09-17T04:46:24.693788] [INFO ] [MAIN ] LEN: Loaded 39613 existing records. [2025-09-17T04:46:24.882007] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:46:24.882477] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-17T04:46:24.882873] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-17T04:46:24.884022] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-17T04:46:24.884091] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-17T04:46:25.276942] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:46:25.279429] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T04:46:25.490137] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-17T04:46:25.955846] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T04:46:26.221808] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T04:46:26.290073] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-17T04:46:26.771152] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T04:46:27.090142] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-17T04:46:27.890140] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-17T04:46:28.009407] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T04:46:28.690128] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-11. [2025-09-17T04:46:28.746955] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T04:46:29.349759] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T04:46:29.490160] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-17T04:46:30.290155] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-17T04:46:30.324838] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T04:46:30.822262] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T04:46:30.827793] [INFO ] [REMOTE ] LEA: Full fetch complete (60791 records). [2025-09-17T04:46:30.827991] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-17T04:46:31.101987] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-17T04:46:31.242393] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-17T04:46:31.242524] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-17T04:46:31.243625] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-17T04:46:31.243736] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-17T04:46:31.245208] [DEBUG] [LOCAL ] LEA: Trimmed 60791 records to 41857 (keeping 200 days of data) [2025-09-17T04:46:31.528172] [DEBUG] [LOCAL ] LEA: Primary data saved (41857 records). [2025-09-17T04:46:31.528388] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-17T04:46:31.528487] [INFO ] [MAIN ] Update Progress: 1249/2369 symbols completed. LEA took 27.2s. Estimated remaining: 2h 43m 34s. Rate: 6.8 symbols/min [2025-09-17T04:46:31.708974] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:46:31.722036] [DEBUG] [LOCAL ] LEO: Loaded 12057 existing records from primary storage. [2025-09-17T04:46:31.722219] [INFO ] [MAIN ] LEO: Loaded 12057 existing records. [2025-09-17T04:46:31.905498] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-17T04:46:31.910487] [WARN ] [MAIN ] LEO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:46:31.911915] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-17T04:46:31.912044] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-17T04:46:31.912453] [DEBUG] [LOCAL ] LEO: Deleted primary data file. [2025-09-17T04:46:31.912718] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-17T04:46:32.213893] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T04:46:32.358743] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:46:32.690163] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-17T04:46:32.746961] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T04:46:33.429162] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T04:46:33.490108] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-17T04:46:33.783841] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T04:46:33.789761] [INFO ] [REMOTE ] LDOS: Full fetch complete (67850 records). [2025-09-17T04:46:33.789977] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-17T04:46:34.184031] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-17T04:46:34.184217] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-17T04:46:34.185445] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-17T04:46:34.185564] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-17T04:46:34.187218] [DEBUG] [LOCAL ] LDOS: Trimmed 67850 records to 46101 (keeping 200 days of data) [2025-09-17T04:46:34.290357] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-11. [2025-09-17T04:46:34.501667] [DEBUG] [LOCAL ] LDOS: Primary data saved (46101 records). [2025-09-17T04:46:34.501902] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-17T04:46:34.502020] [INFO ] [MAIN ] Update Progress: 1250/2369 symbols completed. LDOS took 44.1s. Estimated remaining: 2h 43m 20s. Rate: 6.9 symbols/min [2025-09-17T04:46:34.678941] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:46:34.717540] [DEBUG] [LOCAL ] LEVI: Loaded 38348 existing records from primary storage. [2025-09-17T04:46:34.717784] [INFO ] [MAIN ] LEVI: Loaded 38348 existing records. [2025-09-17T04:46:34.904426] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:46:34.904756] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-17T04:46:34.904828] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-17T04:46:34.905850] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-17T04:46:34.905917] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-17T04:46:35.097040] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-17T04:46:35.287063] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:46:35.302085] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T04:46:35.339982] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T04:46:35.890216] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-17T04:46:36.690165] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-17T04:46:36.861385] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T04:46:36.939018] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T04:46:37.490132] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-11. [2025-09-17T04:46:38.090194] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T04:46:38.290131] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-17T04:46:39.090143] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-17T04:46:39.276982] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T04:46:39.575143] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T04:46:39.890164] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-17T04:46:40.690161] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-17T04:46:40.893060] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T04:46:41.490215] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-17T04:46:41.597965] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T04:46:41.665610] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T04:46:42.290202] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-17T04:46:43.090189] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-17T04:46:43.311468] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T04:46:43.890127] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-17T04:46:43.971913] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T04:46:44.690198] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-17T04:46:44.828848] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T04:46:45.423191] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T04:46:45.490107] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-17T04:46:46.063421] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T04:46:46.290132] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-17T04:46:46.388721] [DEBUG] [REMOTE ] LEO: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T04:46:46.389083] [WARN ] [REMOTE ] LEO: No data returned for month 2025-02 [2025-09-17T04:46:47.090103] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-17T04:46:47.174355] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T04:46:47.890176] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-17T04:46:48.690197] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-17T04:46:48.908458] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T04:46:49.490206] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-17T04:46:49.857930] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T04:46:49.916122] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T04:46:50.290156] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-17T04:46:51.058608] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T04:46:51.090165] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-17T04:46:51.890166] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-17T04:46:52.010194] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T04:46:52.328530] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T04:46:52.690241] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-17T04:46:52.983336] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T04:46:53.490218] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-17T04:46:54.063301] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T04:46:54.289927] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T04:46:54.295318] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-17T04:46:55.090181] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-17T04:46:55.890163] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-17T04:46:55.999473] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T04:46:56.425230] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T04:46:56.690163] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-17T04:46:57.490168] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-17T04:46:57.760358] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T04:46:58.290157] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-17T04:46:58.826595] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-17T04:46:58.833186] [INFO ] [REMOTE ] LEN: Full fetch complete (76765 records). [2025-09-17T04:46:58.833404] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-17T04:46:59.100986] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-17T04:46:59.240674] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-17T04:46:59.240848] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-17T04:46:59.241877] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-17T04:46:59.241955] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-17T04:46:59.243693] [DEBUG] [LOCAL ] LEN: Trimmed 76765 records to 53179 (keeping 200 days of data) [2025-09-17T04:46:59.387995] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T04:46:59.415089] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T04:46:59.679546] [DEBUG] [LOCAL ] LEN: Primary data saved (53179 records). [2025-09-17T04:46:59.679906] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-17T04:46:59.680083] [INFO ] [MAIN ] Update Progress: 1251/2369 symbols completed. LEN took 35.2s. Estimated remaining: 2h 43m 26s. Rate: 6.8 symbols/min [2025-09-17T04:46:59.858789] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:46:59.874445] [DEBUG] [LOCAL ] LFT: Loaded 14075 existing records from primary storage. [2025-09-17T04:46:59.874657] [INFO ] [MAIN ] LFT: Loaded 14075 existing records. [2025-09-17T04:46:59.895343] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-17T04:47:00.068424] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:47:00.068728] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-17T04:47:00.068819] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-17T04:47:00.069305] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-17T04:47:00.069389] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-17T04:47:00.447853] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:47:00.690151] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-17T04:47:00.785816] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T04:47:00.934203] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T04:47:01.490160] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-11. [2025-09-17T04:47:02.290214] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-17T04:47:02.311786] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T04:47:02.392063] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T04:47:03.046781] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T04:47:03.090096] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-17T04:47:03.890179] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-17T04:47:04.034065] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T04:47:04.036580] [INFO ] [REMOTE ] LEO: Full fetch complete (23821 records). [2025-09-17T04:47:04.036718] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-17T04:47:04.224596] [WARN ] [VALIDATOR ] LEO: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T04:47:04.225003] [FATAL] [MAIN ] LEO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:47:04.225081] [WARN ] [MAIN ] LEO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:47:04.225128] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-17T04:47:04.225211] [DEBUG] [LOCAL ] LEO: No primary data file found to delete. [2025-09-17T04:47:04.225296] [INFO ] [LOCAL ] LEO: Starting deletion of derivative data. [2025-09-17T04:47:04.225801] [DEBUG] [LOCAL ] LEO: Deleted derivative data file. [2025-09-17T04:47:04.225922] [INFO ] [MAIN ] Update Progress: 1252/2369 symbols completed. LEO took 32.7s. Estimated remaining: 2h 43m 14s. Rate: 6.8 symbols/min [2025-09-17T04:47:04.395090] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:47:04.404286] [DEBUG] [LOCAL ] LGI: Loaded 7314 existing records from primary storage. [2025-09-17T04:47:04.404442] [INFO ] [MAIN ] LGI: Loaded 7314 existing records. [2025-09-17T04:47:04.581216] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:47:04.581556] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-17T04:47:04.581632] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-17T04:47:04.582062] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-17T04:47:04.582138] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-17T04:47:04.695221] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-17T04:47:04.950196] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:47:05.419044] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T04:47:05.425867] [INFO ] [REMOTE ] LEG: Full fetch complete (73044 records). [2025-09-17T04:47:05.426058] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-17T04:47:05.495227] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-17T04:47:05.813457] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-17T04:47:05.813590] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-17T04:47:05.814688] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-17T04:47:05.814771] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-17T04:47:05.816264] [DEBUG] [LOCAL ] LEG: Trimmed 73044 records to 50399 (keeping 200 days of data) [2025-09-17T04:47:06.126493] [DEBUG] [LOCAL ] LEG: Primary data saved (50399 records). [2025-09-17T04:47:06.126707] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-17T04:47:06.126860] [INFO ] [MAIN ] Update Progress: 1253/2369 symbols completed. LEG took 43.2s. Estimated remaining: 2h 42m 59s. Rate: 6.8 symbols/min [2025-09-17T04:47:06.303349] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:47:06.298394] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-11. [2025-09-17T04:47:06.351102] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T04:47:06.350025] [DEBUG] [LOCAL ] LH: Loaded 28126 existing records from primary storage. [2025-09-17T04:47:06.356868] [INFO ] [MAIN ] LH: Loaded 28126 existing records. [2025-09-17T04:47:06.426837] [INFO ] [REMOTE ] LEVI: Full fetch complete (74274 records). [2025-09-17T04:47:06.459541] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-17T04:47:06.647055] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:47:06.688100] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-17T04:47:06.748205] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-17T04:47:06.814766] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T04:47:06.838603] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-17T04:47:06.855576] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-17T04:47:07.117131] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-17T04:47:07.168862] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-17T04:47:07.212761] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-17T04:47:07.242683] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-17T04:47:07.218851] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T04:47:07.272339] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-17T04:47:07.343825] [DEBUG] [LOCAL ] LEVI: Trimmed 74274 records to 51477 (keeping 200 days of data) [2025-09-17T04:47:07.363385] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:47:07.687697] [DEBUG] [LOCAL ] LEVI: Primary data saved (51477 records). [2025-09-17T04:47:07.687919] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-17T04:47:07.688024] [INFO ] [MAIN ] Update Progress: 1254/2369 symbols completed. LEVI took 33.2s. Estimated remaining: 2h 42m 44s. Rate: 6.9 symbols/min [2025-09-17T04:47:07.858679] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:47:07.893239] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-11. [2025-09-17T04:47:07.895377] [DEBUG] [LOCAL ] LHX: Loaded 36532 existing records from primary storage. [2025-09-17T04:47:07.895682] [INFO ] [MAIN ] LHX: Loaded 36532 existing records. [2025-09-17T04:47:08.074805] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:47:08.075262] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-17T04:47:08.075416] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-17T04:47:08.084082] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-17T04:47:08.084247] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-17T04:47:08.090497] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T04:47:08.447617] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:47:08.690140] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-11. [2025-09-17T04:47:09.382283] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T04:47:09.490183] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-17T04:47:09.861889] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T04:47:10.233088] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T04:47:10.290123] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-17T04:47:11.090146] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-17T04:47:11.682851] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T04:47:11.890153] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-17T04:47:12.690104] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-17T04:47:12.812851] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T04:47:12.917495] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T04:47:13.154505] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T04:47:13.490146] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-17T04:47:14.235182] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T04:47:14.290178] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-17T04:47:15.090191] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-17T04:47:15.848783] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T04:47:15.890171] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-17T04:47:15.982912] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T04:47:16.690202] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-17T04:47:17.463727] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T04:47:17.490073] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-17T04:47:18.290129] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-17T04:47:18.394987] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T04:47:19.055492] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T04:47:19.090133] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-17T04:47:19.146106] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T04:47:19.652621] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T04:47:19.890139] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-17T04:47:20.690182] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-17T04:47:21.456514] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T04:47:21.490084] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-17T04:47:21.504302] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T04:47:22.290162] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-17T04:47:22.989587] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T04:47:23.090119] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-17T04:47:23.746734] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T04:47:23.890162] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-17T04:47:23.990991] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T04:47:24.690164] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-17T04:47:25.490112] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-17T04:47:25.569578] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T04:47:25.859061] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T04:47:26.290133] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-17T04:47:26.600008] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T04:47:27.090148] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-17T04:47:27.678255] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T04:47:27.871449] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T04:47:27.890074] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-17T04:47:28.690150] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-17T04:47:28.703246] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T04:47:29.490280] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-17T04:47:29.636265] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T04:47:30.290141] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-17T04:47:31.090142] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-17T04:47:31.800685] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:47:31.804999] [INFO ] [REMOTE ] LH: Full fetch complete (54940 records). [2025-09-17T04:47:31.805356] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-17T04:47:31.896689] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-17T04:47:32.193446] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T04:47:32.214715] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-17T04:47:32.214990] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-17T04:47:32.215963] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-17T04:47:32.216849] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-17T04:47:32.218457] [DEBUG] [LOCAL ] LH: Trimmed 54940 records to 38865 (keeping 200 days of data) [2025-09-17T04:47:32.345932] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (2.86 seconds). [2025-09-17T04:47:32.509343] [DEBUG] [LOCAL ] LH: Primary data saved (38865 records). [2025-09-17T04:47:32.509586] [INFO ] [MAIN ] LH: Full history saved. [2025-09-17T04:47:32.509738] [INFO ] [MAIN ] Update Progress: 1255/2369 symbols completed. LH took 26.4s. Estimated remaining: 2h 42m 49s. Rate: 6.8 symbols/min [2025-09-17T04:47:32.677661] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:47:32.690097] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-17T04:47:32.699558] [DEBUG] [LOCAL ] LII: Loaded 20348 existing records from primary storage. [2025-09-17T04:47:32.699733] [INFO ] [MAIN ] LII: Loaded 20348 existing records. [2025-09-17T04:47:32.876265] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:47:32.876618] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-17T04:47:32.876848] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-17T04:47:32.882582] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-17T04:47:32.890183] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-17T04:47:32.922815] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T04:47:33.251415] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:47:33.490124] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-17T04:47:34.290126] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-11. [2025-09-17T04:47:34.376667] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T04:47:34.604949] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T04:47:35.090129] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-17T04:47:35.421072] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T04:47:35.890122] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-17T04:47:36.007171] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T04:47:36.690177] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-17T04:47:37.129207] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T04:47:37.490174] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-17T04:47:38.290126] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-17T04:47:38.489326] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T04:47:38.880682] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T04:47:39.081758] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T04:47:39.083316] [INFO ] [REMOTE ] LGI: Full fetch complete (14274 records). [2025-09-17T04:47:39.083406] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-17T04:47:39.095199] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-17T04:47:39.453387] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-17T04:47:39.453504] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-17T04:47:39.453875] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-17T04:47:39.453931] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-17T04:47:39.454486] [DEBUG] [LOCAL ] LGI: Trimmed 14274 records to 10277 (keeping 200 days of data) [2025-09-17T04:47:39.519727] [DEBUG] [LOCAL ] LGI: Primary data saved (10277 records). [2025-09-17T04:47:39.519903] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-17T04:47:39.519999] [INFO ] [MAIN ] Update Progress: 1256/2369 symbols completed. LGI took 35.3s. Estimated remaining: 2h 42m 39s. Rate: 6.8 symbols/min [2025-09-17T04:47:39.689800] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:47:39.724021] [DEBUG] [LOCAL ] LION: Loaded 35711 existing records from primary storage. [2025-09-17T04:47:39.724233] [INFO ] [MAIN ] LION: Loaded 35711 existing records. [2025-09-17T04:47:39.897749] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-17T04:47:39.902372] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:47:39.903568] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-17T04:47:39.903632] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-17T04:47:39.904548] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-17T04:47:39.904621] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-17T04:47:40.265600] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:47:40.690175] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-17T04:47:41.186331] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T04:47:41.289744] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T04:47:41.490156] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-17T04:47:41.616104] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T04:47:41.618741] [INFO ] [REMOTE ] LFT: Full fetch complete (23767 records). [2025-09-17T04:47:41.618873] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-17T04:47:41.998235] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-17T04:47:41.998359] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-17T04:47:41.998982] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-17T04:47:41.999038] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-17T04:47:42.000527] [DEBUG] [LOCAL ] LFT: Trimmed 23767 records to 17802 (keeping 200 days of data) [2025-09-17T04:47:42.107119] [DEBUG] [LOCAL ] LFT: Primary data saved (17802 records). [2025-09-17T04:47:42.107321] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-17T04:47:42.107525] [INFO ] [MAIN ] Update Progress: 1257/2369 symbols completed. LFT took 42.4s. Estimated remaining: 2h 42m 25s. Rate: 6.8 symbols/min [2025-09-17T04:47:42.286515] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:47:42.292720] [DEBUG] [LOCAL ] LITB: Loaded 2344 existing records from primary storage. [2025-09-17T04:47:42.292837] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-11. [2025-09-17T04:47:42.293322] [INFO ] [MAIN ] LITB: Loaded 2344 existing records. [2025-09-17T04:47:42.495266] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:47:42.495556] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-17T04:47:42.495620] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-17T04:47:42.495941] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-17T04:47:42.496001] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-17T04:47:42.852682] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:47:42.893379] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T04:47:43.090159] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-11. [2025-09-17T04:47:43.239965] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T04:47:43.520992] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T04:47:43.890134] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-17T04:47:44.690187] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-17T04:47:44.894083] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T04:47:45.490143] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-17T04:47:46.169223] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T04:47:46.290149] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-17T04:47:46.649353] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T04:47:46.847263] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T04:47:47.090212] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-17T04:47:47.890153] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-17T04:47:48.439227] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T04:47:48.690167] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-17T04:47:48.908286] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T04:47:49.490184] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-17T04:47:49.535480] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T04:47:50.027319] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T04:47:50.290144] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-17T04:47:51.090159] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-17T04:47:51.321491] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T04:47:51.890155] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-17T04:47:52.690207] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-17T04:47:52.809739] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T04:47:53.245897] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T04:47:53.490134] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-17T04:47:53.547507] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T04:47:54.290147] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-17T04:47:54.893919] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T04:47:54.899937] [INFO ] [REMOTE ] LHX: Full fetch complete (70783 records). [2025-09-17T04:47:54.900153] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-17T04:47:55.097592] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-17T04:47:55.299773] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-17T04:47:55.299912] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-17T04:47:55.300924] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-17T04:47:55.300987] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-17T04:47:55.302512] [DEBUG] [LOCAL ] LHX: Trimmed 70783 records to 49100 (keeping 200 days of data) [2025-09-17T04:47:55.645258] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T04:47:55.673263] [DEBUG] [LOCAL ] LHX: Primary data saved (49100 records). [2025-09-17T04:47:55.673426] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-17T04:47:55.673513] [INFO ] [MAIN ] Update Progress: 1258/2369 symbols completed. LHX took 48.0s. Estimated remaining: 2h 42m 20s. Rate: 6.8 symbols/min [2025-09-17T04:47:55.848089] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:47:55.887077] [DEBUG] [LOCAL ] LLY: Loaded 39727 existing records from primary storage. [2025-09-17T04:47:55.887329] [INFO ] [MAIN ] LLY: Loaded 39727 existing records. [2025-09-17T04:47:55.898521] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-17T04:47:56.071316] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:47:56.071798] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-17T04:47:56.071859] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-17T04:47:56.072962] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-17T04:47:56.073024] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-17T04:47:56.426386] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:47:56.441054] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T04:47:56.454585] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T04:47:56.690138] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-11. [2025-09-17T04:47:57.490177] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-17T04:47:58.121562] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T04:47:58.290190] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-17T04:47:59.090112] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-17T04:47:59.247339] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-11 (2.56 seconds). [2025-09-17T04:47:59.890210] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-17T04:48:00.000851] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T04:48:00.096277] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T04:48:00.100033] [INFO ] [REMOTE ] LII: Full fetch complete (40918 records). [2025-09-17T04:48:00.100140] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-17T04:48:00.485827] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-17T04:48:00.486007] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-17T04:48:00.486844] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-17T04:48:00.486906] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-17T04:48:00.487876] [DEBUG] [LOCAL ] LII: Trimmed 40918 records to 28709 (keeping 200 days of data) [2025-09-17T04:48:00.672345] [DEBUG] [LOCAL ] LII: Primary data saved (28709 records). [2025-09-17T04:48:00.672531] [INFO ] [MAIN ] LII: Full history saved. [2025-09-17T04:48:00.672680] [INFO ] [MAIN ] Update Progress: 1259/2369 symbols completed. LII took 28.2s. Estimated remaining: 2h 42m 8s. Rate: 6.8 symbols/min [2025-09-17T04:48:00.695225] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-17T04:48:00.853927] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:48:00.892381] [DEBUG] [LOCAL ] LMND: Loaded 38824 existing records from primary storage. [2025-09-17T04:48:00.892600] [INFO ] [MAIN ] LMND: Loaded 38824 existing records. [2025-09-17T04:48:01.082002] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:48:01.082315] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-17T04:48:01.082377] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-17T04:48:01.083261] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-17T04:48:01.083333] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-17T04:48:01.443864] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:48:01.490099] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-11. [2025-09-17T04:48:01.681242] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T04:48:02.290202] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-17T04:48:03.090112] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-17T04:48:03.164373] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (3.27 seconds). [2025-09-17T04:48:03.890143] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-17T04:48:03.964002] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T04:48:04.597483] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-11 (3.11 seconds). [2025-09-17T04:48:04.690113] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-17T04:48:04.985461] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T04:48:05.490126] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-17T04:48:06.137790] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-17T04:48:06.290107] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-17T04:48:06.661583] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T04:48:07.090138] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-17T04:48:07.261326] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T04:48:07.533260] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T04:48:07.890149] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-17T04:48:08.332989] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T04:48:08.474167] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-17T04:48:08.690184] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-17T04:48:09.130478] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T04:48:09.490152] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-17T04:48:10.290155] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-17T04:48:11.001190] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T04:48:11.002585] [INFO ] [REMOTE ] LITB: Full fetch complete (5510 records). [2025-09-17T04:48:11.002696] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-17T04:48:11.095452] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-17T04:48:11.373023] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-17T04:48:11.373199] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-17T04:48:11.373414] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-17T04:48:11.373474] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-17T04:48:11.374071] [DEBUG] [LOCAL ] LITB: Trimmed 5510 records to 4237 (keeping 200 days of data) [2025-09-17T04:48:11.423546] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T04:48:11.440602] [DEBUG] [LOCAL ] LITB: Primary data saved (4237 records). [2025-09-17T04:48:11.440826] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-17T04:48:11.440939] [INFO ] [MAIN ] Update Progress: 1260/2369 symbols completed. LITB took 29.3s. Estimated remaining: 2h 42m 1s. Rate: 6.8 symbols/min [2025-09-17T04:48:11.618794] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:48:11.661105] [DEBUG] [LOCAL ] LMT: Loaded 37058 existing records from primary storage. [2025-09-17T04:48:11.661341] [INFO ] [MAIN ] LMT: Loaded 37058 existing records. [2025-09-17T04:48:11.839759] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:48:11.840087] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-17T04:48:11.840148] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-17T04:48:11.841387] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-17T04:48:11.841453] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-17T04:48:11.895380] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-17T04:48:12.203578] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:48:12.690169] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-17T04:48:13.492987] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-11. [2025-09-17T04:48:13.507583] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-17T04:48:13.535121] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T04:48:13.541034] [INFO ] [REMOTE ] LION: Full fetch complete (52634 records). [2025-09-17T04:48:13.541158] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-17T04:48:13.932369] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-17T04:48:13.932482] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-17T04:48:13.933369] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-17T04:48:13.933428] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-17T04:48:13.934692] [DEBUG] [LOCAL ] LION: Trimmed 52634 records to 42056 (keeping 200 days of data) [2025-09-17T04:48:14.185635] [DEBUG] [LOCAL ] LION: Primary data saved (42056 records). [2025-09-17T04:48:14.185898] [INFO ] [MAIN ] LION: Full history saved. [2025-09-17T04:48:14.186037] [INFO ] [MAIN ] Update Progress: 1261/2369 symbols completed. LION took 34.7s. Estimated remaining: 2h 41m 47s. Rate: 6.8 symbols/min [2025-09-17T04:48:14.293547] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-17T04:48:14.360099] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:48:14.392211] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T04:48:14.432659] [DEBUG] [LOCAL ] LNC: Loaded 38332 existing records from primary storage. [2025-09-17T04:48:14.432856] [INFO ] [MAIN ] LNC: Loaded 38332 existing records. [2025-09-17T04:48:14.610016] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:48:14.610288] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-17T04:48:14.610339] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-17T04:48:14.611166] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-17T04:48:14.611245] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-17T04:48:14.994794] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:48:15.090082] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-11. [2025-09-17T04:48:15.890200] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-17T04:48:16.590890] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-11 (3.10 seconds). [2025-09-17T04:48:16.690134] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-17T04:48:17.542858] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-11 (2.45 seconds). [2025-09-17T04:48:17.553357] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-17T04:48:17.663575] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (3.37 seconds). [2025-09-17T04:48:18.270863] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-17T04:48:18.290084] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-17T04:48:18.699349] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T04:48:19.090157] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-17T04:48:19.197211] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-17T04:48:19.664267] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T04:48:19.890131] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-17T04:48:20.221510] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T04:48:20.690141] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-17T04:48:21.490134] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-17T04:48:21.752764] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T04:48:22.290151] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-17T04:48:22.948394] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T04:48:23.090139] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-17T04:48:23.400718] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-17T04:48:23.890113] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-17T04:48:24.397017] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-17T04:48:24.690152] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-17T04:48:24.951719] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T04:48:25.490126] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-17T04:48:25.913484] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T04:48:26.290123] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-17T04:48:27.090201] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-17T04:48:27.205411] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-17T04:48:27.284324] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T04:48:27.890099] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-17T04:48:28.269304] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T04:48:28.690211] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-17T04:48:29.467159] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-17T04:48:29.490098] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-17T04:48:30.048424] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T04:48:30.290182] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-17T04:48:30.463434] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.57 seconds). [2025-09-17T04:48:31.090182] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-17T04:48:31.633503] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T04:48:31.717576] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-17T04:48:31.890138] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-17T04:48:32.690133] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-17T04:48:33.490148] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-17T04:48:33.666851] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T04:48:33.783236] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.69 seconds). [2025-09-17T04:48:34.290106] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-17T04:48:34.390790] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T04:48:34.400486] [INFO ] [REMOTE ] LMND: Full fetch complete (75176 records). [2025-09-17T04:48:34.400790] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-17T04:48:34.811453] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-17T04:48:34.811603] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-17T04:48:34.812840] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-17T04:48:34.812929] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-17T04:48:34.814560] [DEBUG] [LOCAL ] LMND: Trimmed 75176 records to 51882 (keeping 200 days of data) [2025-09-17T04:48:35.100010] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-17T04:48:35.122003] [DEBUG] [LOCAL ] LMND: Primary data saved (51882 records). [2025-09-17T04:48:35.122134] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-17T04:48:35.122259] [INFO ] [MAIN ] Update Progress: 1262/2369 symbols completed. LMND took 34.4s. Estimated remaining: 2h 41m 49s. Rate: 6.8 symbols/min [2025-09-17T04:48:35.298123] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:48:35.303984] [DEBUG] [LOCAL ] LND: Loaded 3632 existing records from primary storage. [2025-09-17T04:48:35.304146] [INFO ] [MAIN ] LND: Loaded 3632 existing records. [2025-09-17T04:48:35.494353] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:48:35.494706] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-17T04:48:35.494786] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-17T04:48:35.495095] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-17T04:48:35.495173] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-17T04:48:35.858884] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:48:35.890103] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-11. [2025-09-17T04:48:35.893230] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-17T04:48:35.984318] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T04:48:36.637056] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T04:48:36.690091] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-17T04:48:37.490176] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-17T04:48:37.504513] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T04:48:37.687479] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-17T04:48:37.694071] [INFO ] [REMOTE ] LLY: Full fetch complete (77225 records). [2025-09-17T04:48:37.694255] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-17T04:48:38.089350] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-17T04:48:38.089470] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-17T04:48:38.090466] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-17T04:48:38.090525] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-17T04:48:38.092080] [DEBUG] [LOCAL ] LLY: Trimmed 77225 records to 53301 (keeping 200 days of data) [2025-09-17T04:48:38.313127] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-17T04:48:38.434541] [DEBUG] [LOCAL ] LLY: Primary data saved (53301 records). [2025-09-17T04:48:38.434736] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-17T04:48:38.434852] [INFO ] [MAIN ] Update Progress: 1263/2369 symbols completed. LLY took 42.8s. Estimated remaining: 2h 41m 35s. Rate: 6.8 symbols/min [2025-09-17T04:48:38.615134] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:48:38.615425] [DEBUG] [LOCAL ] LNG: No existing data file found in primary storage. [2025-09-17T04:48:38.615494] [WARN ] [MAIN ] LNG: No existing data found, performing full refresh instead. [2025-09-17T04:48:38.615637] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-17T04:48:38.615718] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-17T04:48:38.615787] [DEBUG] [LOCAL ] LNG: No primary data file found to delete. [2025-09-17T04:48:38.615853] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-17T04:48:39.104383] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-17T04:48:39.158732] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:48:39.564537] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T04:48:39.879115] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T04:48:39.890158] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-17T04:48:40.028217] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T04:48:40.034485] [INFO ] [REMOTE ] LNC: Full fetch complete (73585 records). [2025-09-17T04:48:40.034668] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-17T04:48:40.373527] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T04:48:40.459149] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-17T04:48:40.459292] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-17T04:48:40.460438] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-17T04:48:40.460505] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-17T04:48:40.462196] [DEBUG] [LOCAL ] LNC: Trimmed 73585 records to 51622 (keeping 200 days of data) [2025-09-17T04:48:40.690805] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-17T04:48:40.792524] [DEBUG] [LOCAL ] LNC: Primary data saved (51622 records). [2025-09-17T04:48:40.792748] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-17T04:48:40.792869] [INFO ] [MAIN ] Update Progress: 1264/2369 symbols completed. LNC took 26.6s. Estimated remaining: 2h 41m 21s. Rate: 6.8 symbols/min [2025-09-17T04:48:40.967952] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:48:40.978971] [DEBUG] [LOCAL ] LNN: Loaded 8163 existing records from primary storage. [2025-09-17T04:48:40.979154] [INFO ] [MAIN ] LNN: Loaded 8163 existing records. [2025-09-17T04:48:41.165535] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:48:41.165842] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-17T04:48:41.165906] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-17T04:48:41.166251] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-17T04:48:41.166310] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-17T04:48:41.499917] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-17T04:48:41.528339] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:48:42.162971] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T04:48:42.290102] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-11. [2025-09-17T04:48:42.820786] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T04:48:43.090165] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-17T04:48:43.798490] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T04:48:43.890102] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-17T04:48:44.014743] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T04:48:44.690141] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-17T04:48:45.490146] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-17T04:48:45.964885] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T04:48:46.007617] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-17T04:48:46.290134] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-17T04:48:46.554864] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T04:48:46.917972] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T04:48:47.090214] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-17T04:48:47.890152] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-11. [2025-09-17T04:48:48.516523] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T04:48:48.690146] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-17T04:48:49.010263] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T04:48:49.286308] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T04:48:49.490198] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-17T04:48:50.290202] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-17T04:48:51.090176] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-17T04:48:51.400470] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-17T04:48:51.654608] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T04:48:51.890144] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-17T04:48:52.476823] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-17T04:48:52.591147] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T04:48:52.592353] [INFO ] [REMOTE ] LND: Full fetch complete (9047 records). [2025-09-17T04:48:52.592441] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-17T04:48:52.695287] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-17T04:48:52.959307] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-17T04:48:52.959431] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-17T04:48:52.959742] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-17T04:48:52.959800] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-17T04:48:52.960259] [DEBUG] [LOCAL ] LND: Trimmed 9047 records to 5274 (keeping 200 days of data) [2025-09-17T04:48:52.990740] [DEBUG] [LOCAL ] LND: Primary data saved (5274 records). [2025-09-17T04:48:52.990927] [INFO ] [MAIN ] LND: Full history saved. [2025-09-17T04:48:52.991045] [INFO ] [MAIN ] Update Progress: 1265/2369 symbols completed. LND took 17.9s. Estimated remaining: 2h 41m 15s. Rate: 6.8 symbols/min [2025-09-17T04:48:53.162362] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:48:53.194551] [DEBUG] [LOCAL ] LOAR: Loaded 32474 existing records from primary storage. [2025-09-17T04:48:53.194765] [INFO ] [MAIN ] LOAR: Loaded 32474 existing records. [2025-09-17T04:48:53.372573] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:48:53.372854] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-17T04:48:53.372917] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-17T04:48:53.373706] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-17T04:48:53.373770] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-17T04:48:53.497766] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-17T04:48:53.757045] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:48:54.290147] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-11. [2025-09-17T04:48:54.443854] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T04:48:55.090109] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-17T04:48:55.522890] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T04:48:55.763628] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-17T04:48:55.862416] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T04:48:55.890125] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-17T04:48:56.690165] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-17T04:48:56.765087] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T04:48:57.490154] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-17T04:48:58.290154] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-17T04:48:58.806242] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-17T04:48:58.813206] [INFO ] [REMOTE ] LMT: Full fetch complete (72490 records). [2025-09-17T04:48:58.813451] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-17T04:48:59.097959] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-17T04:48:59.237228] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T04:48:59.269800] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-17T04:48:59.269944] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-17T04:48:59.271805] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-17T04:48:59.272086] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-17T04:48:59.274467] [DEBUG] [LOCAL ] LMT: Trimmed 72490 records to 50019 (keeping 200 days of data) [2025-09-17T04:48:59.426624] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T04:48:59.660527] [DEBUG] [LOCAL ] LMT: Primary data saved (50019 records). [2025-09-17T04:48:59.660748] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-17T04:48:59.660862] [INFO ] [MAIN ] Update Progress: 1266/2369 symbols completed. LMT took 48.2s. Estimated remaining: 2h 41m 5s. Rate: 6.8 symbols/min [2025-09-17T04:48:59.838195] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:48:59.857329] [DEBUG] [LOCAL ] LOB: Loaded 19344 existing records from primary storage. [2025-09-17T04:48:59.857501] [INFO ] [MAIN ] LOB: Loaded 19344 existing records. [2025-09-17T04:48:59.895248] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-17T04:49:00.050540] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:49:00.050848] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-17T04:49:00.050912] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-17T04:49:00.051443] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-17T04:49:00.051515] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-17T04:49:00.416612] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:49:00.459312] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T04:49:00.690129] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-11. [2025-09-17T04:49:01.490107] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-17T04:49:01.857870] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T04:49:01.954128] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T04:49:02.290198] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-17T04:49:02.329829] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T04:49:03.090156] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-17T04:49:03.890196] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-17T04:49:04.192826] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T04:49:04.224857] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T04:49:04.690210] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-17T04:49:04.754161] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T04:49:05.490223] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-17T04:49:06.290227] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-17T04:49:06.638783] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T04:49:06.732115] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T04:49:06.964785] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T04:49:07.090198] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-17T04:49:07.890194] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-17T04:49:08.652785] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T04:49:08.690419] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-17T04:49:08.906933] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T04:49:09.480482] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T04:49:09.490155] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-17T04:49:10.290117] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-17T04:49:10.556952] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T04:49:10.815054] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-17T04:49:11.090179] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-17T04:49:11.890211] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-17T04:49:12.088736] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T04:49:12.690166] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-17T04:49:13.419541] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T04:49:13.490127] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-17T04:49:14.210831] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T04:49:14.290219] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-17T04:49:14.960445] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T04:49:15.069706] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T04:49:15.090127] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-17T04:49:15.890158] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-17T04:49:15.988380] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T04:49:15.990508] [INFO ] [REMOTE ] LNN: Full fetch complete (15448 records). [2025-09-17T04:49:15.990632] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-17T04:49:16.385589] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-17T04:49:16.385799] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-17T04:49:16.386412] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-17T04:49:16.386474] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-17T04:49:16.387473] [DEBUG] [LOCAL ] LNN: Trimmed 15448 records to 11221 (keeping 200 days of data) [2025-09-17T04:49:16.468380] [DEBUG] [LOCAL ] LNN: Primary data saved (11221 records). [2025-09-17T04:49:16.468611] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-17T04:49:16.468770] [INFO ] [MAIN ] Update Progress: 1267/2369 symbols completed. LNN took 35.7s. Estimated remaining: 2h 41m 3s. Rate: 6.8 symbols/min [2025-09-17T04:49:16.648792] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:49:16.652972] [DEBUG] [LOCAL ] LOCL: Loaded 1993 existing records from primary storage. [2025-09-17T04:49:16.653093] [INFO ] [MAIN ] LOCL: Loaded 1993 existing records. [2025-09-17T04:49:16.697119] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-17T04:49:16.844404] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:49:16.844740] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-17T04:49:16.844809] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-17T04:49:16.845064] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-17T04:49:16.845131] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-17T04:49:17.228224] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:49:17.353564] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:49:17.490075] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-17T04:49:17.893740] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T04:49:18.290199] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-17T04:49:19.040579] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T04:49:19.090160] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-11. [2025-09-17T04:49:19.514516] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T04:49:19.890137] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-17T04:49:19.932666] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T04:49:19.942426] [INFO ] [REMOTE ] LNG: Full fetch complete (74555 records). [2025-09-17T04:49:19.942747] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-17T04:49:20.362656] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-17T04:49:20.362814] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-17T04:49:20.364614] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-17T04:49:20.364760] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-17T04:49:20.366929] [DEBUG] [LOCAL ] LNG: Trimmed 74555 records to 51629 (keeping 200 days of data) [2025-09-17T04:49:20.693806] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-17T04:49:20.734945] [DEBUG] [LOCAL ] LNG: Primary data saved (51629 records). [2025-09-17T04:49:20.735170] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-17T04:49:20.735264] [INFO ] [MAIN ] Update Progress: 1268/2369 symbols completed. LNG took 42.3s. Estimated remaining: 2h 40m 50s. Rate: 6.8 symbols/min [2025-09-17T04:49:20.926536] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:49:20.950204] [DEBUG] [LOCAL ] LOMA: Loaded 23279 existing records from primary storage. [2025-09-17T04:49:20.950424] [INFO ] [MAIN ] LOMA: Loaded 23279 existing records. [2025-09-17T04:49:21.137959] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:49:21.138562] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-17T04:49:21.138835] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-17T04:49:21.139581] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-17T04:49:21.139685] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-17T04:49:21.281429] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T04:49:21.504141] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-17T04:49:21.547029] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:49:22.206203] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T04:49:22.212271] [INFO ] [REMOTE ] LOAR: Full fetch complete (55926 records). [2025-09-17T04:49:22.212440] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-17T04:49:22.295363] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-17T04:49:22.630321] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-17T04:49:22.630683] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-17T04:49:22.632150] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-17T04:49:22.632236] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-17T04:49:22.634800] [DEBUG] [LOCAL ] LOAR: Trimmed 55926 records to 41564 (keeping 200 days of data) [2025-09-17T04:49:22.746559] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T04:49:22.920762] [DEBUG] [LOCAL ] LOAR: Primary data saved (41564 records). [2025-09-17T04:49:22.920979] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-17T04:49:22.921151] [INFO ] [MAIN ] Update Progress: 1269/2369 symbols completed. LOAR took 29.9s. Estimated remaining: 2h 40m 36s. Rate: 6.8 symbols/min [2025-09-17T04:49:22.925587] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T04:49:23.096502] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-11. [2025-09-17T04:49:23.096440] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:49:23.138858] [DEBUG] [LOCAL ] LOW: Loaded 39480 existing records from primary storage. [2025-09-17T04:49:23.139063] [INFO ] [MAIN ] LOW: Loaded 39480 existing records. [2025-09-17T04:49:23.389387] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:49:23.389718] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-17T04:49:23.389791] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-17T04:49:23.391069] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-17T04:49:23.391140] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-17T04:49:23.792427] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:49:23.890141] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-17T04:49:24.424455] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T04:49:24.690155] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-17T04:49:24.973182] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-17T04:49:24.974608] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T04:49:25.490140] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-11. [2025-09-17T04:49:26.290140] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-17T04:49:27.090139] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-17T04:49:27.312367] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T04:49:27.431776] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T04:49:27.800563] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T04:49:27.890101] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-17T04:49:28.690108] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-17T04:49:28.988018] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T04:49:29.170003] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T04:49:29.490130] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-17T04:49:30.290157] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-17T04:49:30.914059] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T04:49:31.090144] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-17T04:49:31.890165] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-17T04:49:32.153660] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T04:49:32.312720] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T04:49:32.655385] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T04:49:32.690177] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-17T04:49:33.490168] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-17T04:49:33.789013] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T04:49:33.901418] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-17T04:49:34.290210] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-17T04:49:35.090103] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-17T04:49:35.499207] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T04:49:35.508255] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T04:49:35.890147] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-17T04:49:36.450981] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T04:49:36.690179] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-17T04:49:37.133915] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T04:49:37.490146] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-17T04:49:38.290160] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-17T04:49:38.813059] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T04:49:39.090110] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-17T04:49:39.355617] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T04:49:39.359171] [INFO ] [REMOTE ] LOB: Full fetch complete (37111 records). [2025-09-17T04:49:39.359282] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-17T04:49:39.665095] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T04:49:39.716817] [INFO ] [REMOTE ] LOCL: Full fetch complete (4502 records). [2025-09-17T04:49:39.741661] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-17T04:49:39.801911] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-17T04:49:39.839413] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-17T04:49:39.860702] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-17T04:49:39.860812] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-17T04:49:39.911796] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-17T04:49:39.953032] [DEBUG] [LOCAL ] LOB: Trimmed 37111 records to 27355 (keeping 200 days of data) [2025-09-17T04:49:40.224978] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-17T04:49:40.227419] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-17T04:49:40.234109] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-17T04:49:40.234786] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-17T04:49:40.241895] [DEBUG] [LOCAL ] LOCL: Trimmed 4502 records to 3235 (keeping 200 days of data) [2025-09-17T04:49:40.272953] [DEBUG] [LOCAL ] LOCL: Primary data saved (3235 records). [2025-09-17T04:49:40.274557] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-17T04:49:40.275337] [INFO ] [MAIN ] Update Progress: 1270/2369 symbols completed. LOCL took 23.8s. Estimated remaining: 2h 40m 34s. Rate: 6.8 symbols/min [2025-09-17T04:49:40.495771] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:49:40.508899] [DEBUG] [LOCAL ] LOB: Primary data saved (27355 records). [2025-09-17T04:49:40.509103] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-17T04:49:40.509216] [INFO ] [MAIN ] Update Progress: 1271/2369 symbols completed. LOB took 40.8s. Estimated remaining: 2h 40m 18s. Rate: 6.8 symbols/min [2025-09-17T04:49:40.703494] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-17T04:49:40.688303] [DEBUG] [LOCAL ] LPG: Loaded 29760 existing records from primary storage. [2025-09-17T04:49:40.707203] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:49:40.708308] [INFO ] [MAIN ] LPG: Loaded 29760 existing records. [2025-09-17T04:49:40.884507] [DEBUG] [LOCAL ] LPL: Loaded 19329 existing records from primary storage. [2025-09-17T04:49:40.907077] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:49:40.906932] [INFO ] [MAIN ] LPL: Loaded 19329 existing records. [2025-09-17T04:49:40.907489] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-17T04:49:40.971679] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-17T04:49:40.998473] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-17T04:49:41.009302] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-17T04:49:41.220149] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:49:41.271302] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-17T04:49:41.343437] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-17T04:49:41.376256] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-17T04:49:41.376378] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-17T04:49:41.560096] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:49:41.600251] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-11. [2025-09-17T04:49:41.824198] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:49:41.945020] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T04:49:41.983255] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T04:49:42.290134] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-17T04:49:43.090151] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-17T04:49:43.258590] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T04:49:43.334242] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T04:49:43.890155] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-17T04:49:44.690117] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-11. [2025-09-17T04:49:44.914220] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T04:49:45.127120] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T04:49:45.490151] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-17T04:49:45.683135] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T04:49:46.290186] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-17T04:49:46.752605] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T04:49:47.090182] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-17T04:49:47.890159] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-17T04:49:48.213557] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T04:49:48.620139] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T04:49:48.690109] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-17T04:49:48.891373] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T04:49:49.490188] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-17T04:49:50.295301] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-17T04:49:50.306696] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T04:49:50.836918] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T04:49:50.843498] [INFO ] [REMOTE ] LOMA: Full fetch complete (47978 records). [2025-09-17T04:49:50.843804] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-17T04:49:51.090183] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-17T04:49:51.232675] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T04:49:51.328075] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-17T04:49:51.328247] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-17T04:49:51.329422] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-17T04:49:51.329541] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-17T04:49:51.331474] [DEBUG] [LOCAL ] LOMA: Trimmed 47978 records to 31278 (keeping 200 days of data) [2025-09-17T04:49:51.536426] [DEBUG] [LOCAL ] LOMA: Primary data saved (31278 records). [2025-09-17T04:49:51.536748] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-17T04:49:51.536995] [INFO ] [MAIN ] Update Progress: 1272/2369 symbols completed. LOMA took 30.8s. Estimated remaining: 2h 40m 11s. Rate: 6.8 symbols/min [2025-09-17T04:49:51.732228] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:49:51.769337] [DEBUG] [LOCAL ] LPX: Loaded 29644 existing records from primary storage. [2025-09-17T04:49:51.769565] [INFO ] [MAIN ] LPX: Loaded 29644 existing records. [2025-09-17T04:49:51.895279] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-17T04:49:51.967090] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:49:51.967350] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-17T04:49:51.967458] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-17T04:49:51.968360] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-17T04:49:51.968428] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-17T04:49:52.364848] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:49:52.690118] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-11. [2025-09-17T04:49:52.973746] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T04:49:53.017074] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T04:49:53.490151] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-17T04:49:54.212745] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T04:49:54.290179] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-17T04:49:55.090174] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-17T04:49:55.450889] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T04:49:55.690216] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T04:49:55.890200] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-17T04:49:56.130731] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T04:49:56.690182] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-17T04:49:57.454168] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T04:49:57.490089] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-17T04:49:58.290163] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-17T04:49:58.546557] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T04:49:58.989030] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T04:49:59.090134] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-17T04:49:59.791267] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T04:49:59.890132] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-17T04:50:00.319097] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T04:50:00.690161] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-17T04:50:01.490164] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-17T04:50:01.563950] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T04:50:01.794839] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T04:50:02.290190] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-17T04:50:03.090140] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-17T04:50:03.500176] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T04:50:03.529073] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T04:50:03.890159] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-17T04:50:04.526636] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T04:50:04.690183] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-17T04:50:04.779634] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T04:50:05.490188] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-17T04:50:06.177776] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T04:50:06.290109] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-17T04:50:06.570418] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T04:50:07.090180] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-17T04:50:07.806264] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:50:07.890161] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-17T04:50:08.571264] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T04:50:08.690126] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-17T04:50:09.382554] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T04:50:09.490094] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-17T04:50:09.862862] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T04:50:10.290148] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-17T04:50:11.013470] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T04:50:11.090142] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-17T04:50:11.890116] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-17T04:50:12.254589] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T04:50:12.607915] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T04:50:12.690094] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-17T04:50:13.027389] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T04:50:13.032522] [INFO ] [REMOTE ] LPG: Full fetch complete (60181 records). [2025-09-17T04:50:13.032772] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-17T04:50:13.445053] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-17T04:50:13.445183] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-17T04:50:13.446136] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-17T04:50:13.446202] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-17T04:50:13.447752] [DEBUG] [LOCAL ] LPG: Trimmed 60181 records to 40564 (keeping 200 days of data) [2025-09-17T04:50:13.506702] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-17T04:50:13.717564] [DEBUG] [LOCAL ] LPG: Primary data saved (40564 records). [2025-09-17T04:50:13.717778] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-17T04:50:13.717883] [INFO ] [MAIN ] Update Progress: 1273/2369 symbols completed. LPG took 33.4s. Estimated remaining: 2h 40m 14s. Rate: 6.8 symbols/min [2025-09-17T04:50:13.909886] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:50:13.910127] [DEBUG] [LOCAL ] LRN: No existing data file found in primary storage. [2025-09-17T04:50:13.910180] [WARN ] [MAIN ] LRN: No existing data found, performing full refresh instead. [2025-09-17T04:50:13.910292] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-17T04:50:13.910343] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-17T04:50:13.910395] [DEBUG] [LOCAL ] LRN: No primary data file found to delete. [2025-09-17T04:50:13.910439] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-17T04:50:14.266245] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:50:14.280748] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T04:50:14.285940] [INFO ] [REMOTE ] LPL: Full fetch complete (33777 records). [2025-09-17T04:50:14.286099] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-17T04:50:14.297822] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-17T04:50:14.705351] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-17T04:50:14.705506] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-17T04:50:14.706508] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-17T04:50:14.706624] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-17T04:50:14.707830] [DEBUG] [LOCAL ] LPL: Trimmed 33777 records to 24859 (keeping 200 days of data) [2025-09-17T04:50:14.853208] [DEBUG] [LOCAL ] LPL: Primary data saved (24859 records). [2025-09-17T04:50:14.853395] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-17T04:50:14.853501] [INFO ] [MAIN ] Update Progress: 1274/2369 symbols completed. LPL took 34.3s. Estimated remaining: 2h 39m 59s. Rate: 6.8 symbols/min [2025-09-17T04:50:15.038408] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:50:15.079989] [DEBUG] [LOCAL ] LSPD: Loaded 31234 existing records from primary storage. [2025-09-17T04:50:15.080181] [INFO ] [MAIN ] LSPD: Loaded 31234 existing records. [2025-09-17T04:50:15.111614] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-11. [2025-09-17T04:50:15.261152] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:50:15.261430] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-17T04:50:15.261489] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-17T04:50:15.262099] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-17T04:50:15.262159] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-17T04:50:15.627410] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:50:15.645468] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-17T04:50:15.652076] [INFO ] [REMOTE ] LOW: Full fetch complete (76316 records). [2025-09-17T04:50:15.652279] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-17T04:50:15.901172] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-11. [2025-09-17T04:50:16.065588] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-17T04:50:16.065771] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-17T04:50:16.067002] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-17T04:50:16.067171] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-17T04:50:16.069096] [DEBUG] [LOCAL ] LOW: Trimmed 76316 records to 52968 (keeping 200 days of data) [2025-09-17T04:50:16.187812] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T04:50:16.465807] [DEBUG] [LOCAL ] LOW: Primary data saved (52968 records). [2025-09-17T04:50:16.466091] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-17T04:50:16.466276] [INFO ] [MAIN ] Update Progress: 1275/2369 symbols completed. LOW took 53.5s. Estimated remaining: 2h 39m 44s. Rate: 6.8 symbols/min [2025-09-17T04:50:16.645335] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:50:16.673379] [DEBUG] [LOCAL ] LTC: Loaded 22342 existing records from primary storage. [2025-09-17T04:50:16.673633] [INFO ] [MAIN ] LTC: Loaded 22342 existing records. [2025-09-17T04:50:16.706053] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-17T04:50:16.913264] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:50:16.915822] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T04:50:16.916077] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-17T04:50:16.924795] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-17T04:50:16.925809] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-17T04:50:16.925885] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-17T04:50:17.286751] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:50:17.490095] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-17T04:50:17.572975] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T04:50:18.199820] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T04:50:18.290181] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-11. [2025-09-17T04:50:18.488121] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T04:50:19.090114] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-17T04:50:19.404082] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T04:50:19.890147] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-17T04:50:20.466840] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:50:20.690162] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-17T04:50:21.498945] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-17T04:50:21.517317] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T04:50:22.226559] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T04:50:22.290123] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-17T04:50:22.865317] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T04:50:23.090208] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-17T04:50:23.613012] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T04:50:23.890142] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-17T04:50:24.535003] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T04:50:24.690288] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-17T04:50:25.460041] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T04:50:25.490081] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-17T04:50:26.279629] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T04:50:26.290081] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-17T04:50:26.854899] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T04:50:26.859767] [INFO ] [REMOTE ] LPX: Full fetch complete (58005 records). [2025-09-17T04:50:26.859974] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-17T04:50:27.095360] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-17T04:50:27.259681] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-17T04:50:27.259805] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-17T04:50:27.260709] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-17T04:50:27.260780] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-17T04:50:27.262094] [DEBUG] [LOCAL ] LPX: Trimmed 58005 records to 39706 (keeping 200 days of data) [2025-09-17T04:50:27.529462] [DEBUG] [LOCAL ] LPX: Primary data saved (39706 records). [2025-09-17T04:50:27.529686] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-17T04:50:27.529822] [INFO ] [MAIN ] Update Progress: 1276/2369 symbols completed. LPX took 36.0s. Estimated remaining: 2h 39m 37s. Rate: 6.8 symbols/min [2025-09-17T04:50:27.705904] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:50:27.742576] [DEBUG] [LOCAL ] LTH: Loaded 38610 existing records from primary storage. [2025-09-17T04:50:27.742811] [INFO ] [MAIN ] LTH: Loaded 38610 existing records. [2025-09-17T04:50:27.897969] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-17T04:50:27.931023] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:50:27.931467] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-17T04:50:27.931589] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-17T04:50:27.932423] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-17T04:50:27.932671] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-17T04:50:28.084120] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T04:50:28.327777] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:50:28.690103] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-17T04:50:28.725607] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T04:50:29.283686] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T04:50:29.490139] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-17T04:50:30.020010] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T04:50:30.290128] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-17T04:50:30.453871] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T04:50:31.090145] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-17T04:50:31.890136] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-11. [2025-09-17T04:50:31.960562] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T04:50:32.354879] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T04:50:32.690134] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-17T04:50:33.428181] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T04:50:33.490109] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-17T04:50:34.302083] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-17T04:50:34.305500] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T04:50:34.564004] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T04:50:35.090147] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-17T04:50:35.676696] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T04:50:35.890160] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-17T04:50:36.586120] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T04:50:36.690164] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-17T04:50:37.490161] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-17T04:50:37.612752] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T04:50:38.204553] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T04:50:38.290096] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-17T04:50:38.864804] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T04:50:39.090137] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-17T04:50:39.890129] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-17T04:50:39.942051] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T04:50:40.541627] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T04:50:40.690125] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-17T04:50:41.452243] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T04:50:41.490095] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-17T04:50:42.149468] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T04:50:42.290175] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-17T04:50:42.943085] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T04:50:42.948215] [INFO ] [REMOTE ] LRN: Full fetch complete (58135 records). [2025-09-17T04:50:42.948384] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-17T04:50:43.099206] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-17T04:50:43.370100] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-17T04:50:43.370273] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-17T04:50:43.371697] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-17T04:50:43.371805] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-17T04:50:43.373389] [DEBUG] [LOCAL ] LRN: Trimmed 58135 records to 40057 (keeping 200 days of data) [2025-09-17T04:50:43.673465] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T04:50:43.728869] [DEBUG] [LOCAL ] LRN: Primary data saved (40057 records). [2025-09-17T04:50:43.729098] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-17T04:50:43.729223] [INFO ] [MAIN ] Update Progress: 1277/2369 symbols completed. LRN took 30.0s. Estimated remaining: 2h 39m 35s. Rate: 6.8 symbols/min [2025-09-17T04:50:43.891601] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-17T04:50:44.661555] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T04:50:44.690098] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-17T04:50:45.097982] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T04:50:45.490176] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-17T04:50:46.079737] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T04:50:46.290165] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-17T04:50:46.932780] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T04:50:47.090193] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-17T04:50:47.194546] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T04:50:47.890231] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-17T04:50:48.690215] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-17T04:50:48.862120] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T04:50:49.161149] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T04:50:49.165284] [INFO ] [REMOTE ] LTC: Full fetch complete (42581 records). [2025-09-17T04:50:49.165468] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-17T04:50:49.495235] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-17T04:50:49.583901] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-17T04:50:49.584089] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-17T04:50:49.585144] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-17T04:50:49.585224] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-17T04:50:49.586662] [DEBUG] [LOCAL ] LTC: Trimmed 42581 records to 30020 (keeping 200 days of data) [2025-09-17T04:50:49.785061] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T04:50:49.795120] [INFO ] [REMOTE ] LSPD: Full fetch complete (61794 records). [2025-09-17T04:50:49.799120] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-17T04:50:49.945022] [DEBUG] [LOCAL ] LTC: Primary data saved (30020 records). [2025-09-17T04:50:49.974798] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-17T04:50:49.990748] [INFO ] [MAIN ] Update Progress: 1278/2369 symbols completed. LTC took 33.5s. Estimated remaining: 2h 39m 24s. Rate: 6.8 symbols/min [2025-09-17T04:50:50.261447] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-17T04:50:50.261786] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-17T04:50:50.262760] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-17T04:50:50.262823] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-17T04:50:50.264269] [DEBUG] [LOCAL ] LSPD: Trimmed 61794 records to 43757 (keeping 200 days of data) [2025-09-17T04:50:50.532618] [DEBUG] [LOCAL ] LSPD: Primary data saved (43757 records). [2025-09-17T04:50:50.532841] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-17T04:50:50.532954] [INFO ] [MAIN ] Update Progress: 1279/2369 symbols completed. LSPD took 35.7s. Estimated remaining: 2h 39m 8s. Rate: 6.8 symbols/min [2025-09-17T04:50:51.331979] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T04:50:51.343782] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-17T04:50:52.782733] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T04:50:52.793872] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-17T04:50:54.277342] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T04:50:54.291195] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-17T04:50:56.026298] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T04:50:56.037387] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-17T04:50:57.729165] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T04:50:57.738428] [INFO ] [REMOTE ] LTH: Full fetch complete (73550 records). [2025-09-17T04:50:57.738711] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-17T04:50:58.159835] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-17T04:50:58.159963] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-17T04:50:58.161210] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-17T04:50:58.161295] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-17T04:50:58.162795] [DEBUG] [LOCAL ] LTH: Trimmed 73550 records to 51948 (keeping 200 days of data) [2025-09-17T04:50:58.470345] [DEBUG] [LOCAL ] LTH: Primary data saved (51948 records). [2025-09-17T04:50:58.470546] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-17T04:50:58.470669] [INFO ] [MAIN ] Update Progress: 1280/2369 symbols completed. LTH took 30.9s. Estimated remaining: 2h 38m 59s. Rate: 6.9 symbols/min [2025-09-17T04:50:59.163550] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:50:59.169558] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:50:59.166305] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:50:59.190815] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:50:59.242088] [DEBUG] [LOCAL ] LTM: Loaded 28294 existing records from primary storage. [2025-09-17T04:50:59.240816] [DEBUG] [LOCAL ] LUCK: Loaded 17666 existing records from primary storage. [2025-09-17T04:50:59.242258] [INFO ] [MAIN ] LTM: Loaded 28294 existing records. [2025-09-17T04:50:59.242343] [INFO ] [MAIN ] LUCK: Loaded 17666 existing records. [2025-09-17T04:50:59.483547] [DEBUG] [LOCAL ] LU: Loaded 36575 existing records from primary storage. [2025-09-17T04:50:59.484732] [DEBUG] [LOCAL ] LUMN: Loaded 40009 existing records from primary storage. [2025-09-17T04:50:59.499067] [INFO ] [MAIN ] LU: Loaded 36575 existing records. [2025-09-17T04:50:59.518427] [INFO ] [MAIN ] LUMN: Loaded 40009 existing records. [2025-09-17T04:50:59.708076] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:50:59.834239] [WARN ] [MAIN ] LUCK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:50:59.863573] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-17T04:50:59.887886] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-17T04:50:59.882622] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-17T04:50:59.948566] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-17T04:50:59.989766] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-17T04:51:00.026460] [DEBUG] [LOCAL ] LUCK: Deleted primary data file. [2025-09-17T04:51:00.068590] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:51:00.064082] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-17T04:51:00.068269] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:51:00.080372] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-17T04:51:00.113127] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-17T04:51:00.135999] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-17T04:51:00.153286] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-17T04:51:00.163727] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-17T04:51:00.233848] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-17T04:51:00.291362] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-17T04:51:00.291249] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-17T04:51:00.342885] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-17T04:51:01.259685] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:51:01.286233] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-11. [2025-09-17T04:51:01.445159] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:51:01.569193] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:51:01.510055] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-11. [2025-09-17T04:51:01.609664] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-11. [2025-09-17T04:51:01.609412] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:51:01.611449] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-11. [2025-09-17T04:51:02.346290] [DEBUG] [REMOTE ] LUCK: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:51:02.346714] [WARN ] [REMOTE ] LUCK: No data returned for month 2024-11 [2025-09-17T04:51:02.347215] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-17T04:51:03.636925] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-11 (2.35 seconds). [2025-09-17T04:51:03.642852] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-17T04:51:03.807233] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-17T04:51:03.817071] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-17T04:51:03.896237] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-11 (2.28 seconds). [2025-09-17T04:51:03.907228] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-17T04:51:04.203088] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T04:51:04.208118] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-17T04:51:04.988923] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T04:51:04.994357] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-17T04:51:05.473719] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T04:51:05.487378] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-17T04:51:05.784097] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T04:51:05.792129] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-17T04:51:06.085612] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T04:51:06.091324] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-17T04:51:06.279809] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-17T04:51:06.291168] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-17T04:51:07.117208] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T04:51:07.126963] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-17T04:51:07.191869] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T04:51:07.199316] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-17T04:51:07.320225] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T04:51:07.326068] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-17T04:51:08.117005] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T04:51:08.127095] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-17T04:51:08.244599] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T04:51:08.255741] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-17T04:51:08.465924] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T04:51:08.578220] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T04:51:08.690174] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-17T04:51:09.490189] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-17T04:51:09.943462] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T04:51:10.290202] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-17T04:51:10.422374] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T04:51:10.495455] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-17T04:51:10.800576] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T04:51:11.090151] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-17T04:51:11.890160] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-17T04:51:12.289407] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T04:51:12.331798] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T04:51:12.690413] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-17T04:51:13.253197] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T04:51:13.490224] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-17T04:51:13.792221] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T04:51:14.290089] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-17T04:51:14.772999] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T04:51:15.090131] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-17T04:51:15.890138] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-17T04:51:16.225401] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T04:51:16.658193] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T04:51:16.690081] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-17T04:51:17.490162] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-17T04:51:17.593942] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T04:51:18.290110] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-17T04:51:18.702330] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T04:51:19.090098] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-17T04:51:19.251795] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T04:51:19.478290] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T04:51:19.890144] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-17T04:51:20.621209] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T04:51:20.690080] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-17T04:51:21.490111] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-17T04:51:21.596262] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T04:51:22.292212] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-17T04:51:22.296348] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T04:51:22.302581] [INFO ] [REMOTE ] LTM: Full fetch complete (45938 records). [2025-09-17T04:51:22.302755] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-17T04:51:22.688145] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-17T04:51:22.688270] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-17T04:51:22.689037] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-17T04:51:22.689096] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-17T04:51:22.690195] [DEBUG] [LOCAL ] LTM: Trimmed 45938 records to 35408 (keeping 200 days of data) [2025-09-17T04:51:22.902705] [DEBUG] [LOCAL ] LTM: Primary data saved (35408 records). [2025-09-17T04:51:22.902946] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-17T04:51:22.903072] [INFO ] [MAIN ] Update Progress: 1281/2369 symbols completed. LTM took 24.4s. Estimated remaining: 2h 39m 3s. Rate: 6.8 symbols/min [2025-09-17T04:51:23.074477] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:51:23.093556] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-17T04:51:23.111214] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T04:51:23.152915] [DEBUG] [LOCAL ] LUV: Loaded 40039 existing records from primary storage. [2025-09-17T04:51:23.153115] [INFO ] [MAIN ] LUV: Loaded 40039 existing records. [2025-09-17T04:51:23.341276] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:51:23.341538] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-17T04:51:23.341602] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-17T04:51:23.342722] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-17T04:51:23.342797] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-17T04:51:23.702110] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:51:23.889464] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T04:51:23.893512] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-11. [2025-09-17T04:51:24.053331] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T04:51:24.056761] [INFO ] [REMOTE ] LUCK: Full fetch complete (39285 records). [2025-09-17T04:51:24.056910] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-17T04:51:24.257344] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-17T04:51:24.257944] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:51:24.258021] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:51:24.258094] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-17T04:51:24.258189] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-17T04:51:24.258257] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-17T04:51:24.258709] [DEBUG] [LOCAL ] LUCK: Deleted derivative data file. [2025-09-17T04:51:24.258845] [INFO ] [MAIN ] Update Progress: 1282/2369 symbols completed. LUCK took 25.8s. Estimated remaining: 2h 38m 48s. Rate: 6.8 symbols/min [2025-09-17T04:51:24.431760] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:51:24.432039] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-17T04:51:24.432112] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-17T04:51:24.432265] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-17T04:51:24.432336] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-17T04:51:24.432409] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-17T04:51:24.432471] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-17T04:51:24.699921] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-17T04:51:24.794403] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:51:25.490136] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-17T04:51:25.690785] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T04:51:26.290175] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-17T04:51:26.682326] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T04:51:27.090175] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-11. [2025-09-17T04:51:27.193457] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T04:51:27.292045] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:51:27.292452] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-11 [2025-09-17T04:51:27.890133] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-17T04:51:28.085555] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:51:28.086035] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-17T04:51:28.200569] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T04:51:28.690155] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-17T04:51:29.490137] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-17T04:51:30.290139] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-17T04:51:31.090139] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-17T04:51:31.257003] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-17T04:51:31.282937] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:51:31.283269] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-17T04:51:31.811524] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-17T04:51:31.890075] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-17T04:51:31.989196] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T04:51:32.690128] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-17T04:51:32.892396] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:51:32.892792] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-17T04:51:33.490090] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-17T04:51:33.949210] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-17T04:51:33.955833] [INFO ] [REMOTE ] LUMN: Full fetch complete (77513 records). [2025-09-17T04:51:33.956000] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-17T04:51:34.302675] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-17T04:51:34.361822] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-17T04:51:34.361947] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-17T04:51:34.363109] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-17T04:51:34.363182] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-17T04:51:34.365256] [DEBUG] [LOCAL ] LUMN: Trimmed 77513 records to 53633 (keeping 200 days of data) [2025-09-17T04:51:34.676936] [DEBUG] [LOCAL ] LUMN: Primary data saved (53633 records). [2025-09-17T04:51:34.677141] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-17T04:51:34.677250] [INFO ] [MAIN ] Update Progress: 1283/2369 symbols completed. LUMN took 36.2s. Estimated remaining: 2h 38m 41s. Rate: 6.8 symbols/min [2025-09-17T04:51:34.854391] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:51:34.891050] [DEBUG] [LOCAL ] LVS: Loaded 39929 existing records from primary storage. [2025-09-17T04:51:34.891238] [INFO ] [MAIN ] LVS: Loaded 39929 existing records. [2025-09-17T04:51:35.071100] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:51:35.071414] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-17T04:51:35.071593] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-17T04:51:35.072689] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-17T04:51:35.072757] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-17T04:51:35.095208] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-17T04:51:35.380242] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:51:35.388574] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T04:51:35.449780] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-17T04:51:35.480557] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:51:35.890207] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-17T04:51:35.975076] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T04:51:35.982835] [INFO ] [REMOTE ] LU: Full fetch complete (70228 records). [2025-09-17T04:51:35.983140] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-17T04:51:36.107915] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:51:36.145231] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-17T04:51:36.601633] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-17T04:51:36.601859] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-17T04:51:36.603776] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-17T04:51:36.603893] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-17T04:51:36.606350] [DEBUG] [LOCAL ] LU: Trimmed 70228 records to 48945 (keeping 200 days of data) [2025-09-17T04:51:36.700362] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-17T04:51:36.916656] [DEBUG] [LOCAL ] LU: Primary data saved (48945 records). [2025-09-17T04:51:36.916898] [INFO ] [MAIN ] LU: Full history saved. [2025-09-17T04:51:36.917043] [INFO ] [MAIN ] Update Progress: 1284/2369 symbols completed. LU took 38.4s. Estimated remaining: 2h 38m 27s. Rate: 6.8 symbols/min [2025-09-17T04:51:37.101595] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:51:37.101870] [DEBUG] [LOCAL ] LVWR: No existing data file found in primary storage. [2025-09-17T04:51:37.101944] [WARN ] [MAIN ] LVWR: No existing data found, performing full refresh instead. [2025-09-17T04:51:37.102080] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-17T04:51:37.102144] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-17T04:51:37.102220] [DEBUG] [LOCAL ] LVWR: No primary data file found to delete. [2025-09-17T04:51:37.102281] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-17T04:51:37.478236] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:51:37.490103] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-11. [2025-09-17T04:51:37.767028] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T04:51:37.938180] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T04:51:38.290238] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-17T04:51:38.924822] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T04:51:39.090144] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-17T04:51:39.688670] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T04:51:39.890169] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-17T04:51:40.690138] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-17T04:51:41.490173] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-17T04:51:41.609867] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T04:51:41.845735] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T04:51:42.059009] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T04:51:42.290188] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-17T04:51:42.844591] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T04:51:43.090131] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-17T04:51:43.730168] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T04:51:43.890176] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-11. [2025-09-17T04:51:44.690132] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-17T04:51:45.490111] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-17T04:51:45.643551] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T04:51:45.746614] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T04:51:46.290158] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-17T04:51:46.532509] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T04:51:47.090151] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-17T04:51:47.890185] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-17T04:51:48.002060] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T04:51:48.108473] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T04:51:48.690128] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-17T04:51:49.490101] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-17T04:51:49.630298] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T04:51:49.633510] [INFO ] [REMOTE ] LUXE: Full fetch complete (11831 records). [2025-09-17T04:51:49.633630] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-17T04:51:49.818138] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 95 unique days, need 200 days [2025-09-17T04:51:49.818463] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:51:49.818709] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:51:49.818893] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-17T04:51:49.819063] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-17T04:51:49.819263] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-17T04:51:49.819430] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-17T04:51:49.819547] [INFO ] [MAIN ] Update Progress: 1285/2369 symbols completed. LUXE took 25.6s. Estimated remaining: 2h 38m 21s. Rate: 6.8 symbols/min [2025-09-17T04:51:49.996953] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:51:50.038397] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-17T04:51:50.087250] [DEBUG] [LOCAL ] LW: Loaded 37983 existing records from primary storage. [2025-09-17T04:51:50.087446] [INFO ] [MAIN ] LW: Loaded 37983 existing records. [2025-09-17T04:51:50.295485] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-17T04:51:50.301814] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:51:50.302840] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-17T04:51:50.302928] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-17T04:51:50.304002] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-17T04:51:50.304107] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-17T04:51:50.678737] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:51:51.090147] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-17T04:51:51.178148] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T04:51:51.890126] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-17T04:51:52.231011] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T04:51:52.690130] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-17T04:51:52.945972] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T04:51:52.997363] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T04:51:53.490143] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-17T04:51:54.290158] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-11. [2025-09-17T04:51:54.336312] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T04:51:55.090154] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-17T04:51:55.274977] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T04:51:55.890631] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T04:51:55.890738] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-17T04:51:56.690183] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-17T04:51:57.039532] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T04:51:57.255458] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T04:51:57.490205] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-17T04:51:57.928921] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T04:51:58.290152] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-17T04:51:59.090181] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-17T04:51:59.452072] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T04:51:59.472682] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T04:51:59.477731] [INFO ] [REMOTE ] LVWR: Full fetch complete (19129 records). [2025-09-17T04:51:59.477983] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-17T04:51:59.846213] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-17T04:51:59.846326] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-17T04:51:59.846812] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-17T04:51:59.846896] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-17T04:51:59.847501] [DEBUG] [LOCAL ] LVWR: Trimmed 19129 records to 16907 (keeping 200 days of data) [2025-09-17T04:51:59.890499] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-17T04:51:59.955504] [DEBUG] [LOCAL ] LVWR: Primary data saved (16907 records). [2025-09-17T04:51:59.955753] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-17T04:51:59.955860] [INFO ] [MAIN ] Update Progress: 1286/2369 symbols completed. LVWR took 23.0s. Estimated remaining: 2h 38m 14s. Rate: 6.8 symbols/min [2025-09-17T04:52:00.131783] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:52:00.148401] [DEBUG] [LOCAL ] LXFR: Loaded 12410 existing records from primary storage. [2025-09-17T04:52:00.148629] [INFO ] [MAIN ] LXFR: Loaded 12410 existing records. [2025-09-17T04:52:00.324808] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:52:00.325108] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-17T04:52:00.325176] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-17T04:52:00.325575] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-17T04:52:00.325690] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-17T04:52:00.679716] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:52:00.690084] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-11. [2025-09-17T04:52:01.010572] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T04:52:01.490178] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-17T04:52:01.744847] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T04:52:01.861019] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T04:52:02.290174] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-17T04:52:03.090111] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-17T04:52:03.175262] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T04:52:03.890096] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-17T04:52:04.009142] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T04:52:04.112595] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T04:52:04.690207] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-17T04:52:05.490123] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-17T04:52:05.551888] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T04:52:05.559988] [INFO ] [REMOTE ] LUV: Full fetch complete (77593 records). [2025-09-17T04:52:05.560295] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-17T04:52:05.960359] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-17T04:52:05.960482] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-17T04:52:05.961572] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-17T04:52:05.961631] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-17T04:52:05.963202] [DEBUG] [LOCAL ] LUV: Trimmed 77593 records to 53688 (keeping 200 days of data) [2025-09-17T04:52:06.290919] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-17T04:52:06.314820] [DEBUG] [LOCAL ] LUV: Primary data saved (53688 records). [2025-09-17T04:52:06.315018] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-17T04:52:06.315136] [INFO ] [MAIN ] Update Progress: 1287/2369 symbols completed. LUV took 43.4s. Estimated remaining: 2h 38m 3s. Rate: 6.8 symbols/min [2025-09-17T04:52:06.490675] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:52:06.527670] [DEBUG] [LOCAL ] LXP: Loaded 37755 existing records from primary storage. [2025-09-17T04:52:06.527864] [INFO ] [MAIN ] LXP: Loaded 37755 existing records. [2025-09-17T04:52:06.749291] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T04:52:06.749510] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:52:06.761139] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-17T04:52:06.761706] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-17T04:52:06.762963] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-17T04:52:06.763046] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-17T04:52:07.100396] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-17T04:52:07.167834] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:52:07.174334] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T04:52:07.344454] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T04:52:07.890146] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-11. [2025-09-17T04:52:08.690151] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-17T04:52:09.005375] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T04:52:09.463556] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T04:52:09.490098] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-17T04:52:10.290176] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-17T04:52:10.471596] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T04:52:11.095892] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-17T04:52:11.101451] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T04:52:11.325832] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T04:52:11.890183] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-17T04:52:12.690147] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-17T04:52:13.011771] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T04:52:13.034898] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T04:52:13.490127] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-17T04:52:14.267120] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T04:52:14.290130] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-17T04:52:15.090163] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-17T04:52:15.223929] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T04:52:15.231634] [INFO ] [REMOTE ] LVS: Full fetch complete (77355 records). [2025-09-17T04:52:15.231890] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-17T04:52:15.629444] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-17T04:52:15.629592] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-17T04:52:15.630748] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-17T04:52:15.630818] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-17T04:52:15.632481] [DEBUG] [LOCAL ] LVS: Trimmed 77355 records to 53565 (keeping 200 days of data) [2025-09-17T04:52:15.892419] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-17T04:52:15.897418] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T04:52:16.002302] [DEBUG] [LOCAL ] LVS: Primary data saved (53565 records). [2025-09-17T04:52:16.002484] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-17T04:52:16.002587] [INFO ] [MAIN ] Update Progress: 1288/2369 symbols completed. LVS took 41.3s. Estimated remaining: 2h 37m 55s. Rate: 6.8 symbols/min [2025-09-17T04:52:16.170740] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:52:16.193497] [DEBUG] [LOCAL ] LXU: Loaded 23663 existing records from primary storage. [2025-09-17T04:52:16.193719] [INFO ] [MAIN ] LXU: Loaded 23663 existing records. [2025-09-17T04:52:16.373511] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:52:16.373841] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-17T04:52:16.373901] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-17T04:52:16.374593] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-17T04:52:16.374680] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-17T04:52:16.695184] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-17T04:52:16.732274] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:52:16.877502] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T04:52:16.951499] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T04:52:17.490181] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-17T04:52:18.216305] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T04:52:18.290150] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-17T04:52:19.090189] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-11. [2025-09-17T04:52:19.259020] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T04:52:19.898023] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-17T04:52:19.921392] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T04:52:20.234935] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T04:52:20.690213] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-17T04:52:20.889340] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T04:52:21.490185] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-17T04:52:22.276357] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T04:52:22.290073] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-17T04:52:22.605497] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T04:52:23.090184] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-17T04:52:23.770344] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T04:52:23.890201] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-17T04:52:24.037522] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T04:52:24.690123] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-17T04:52:24.940184] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T04:52:25.490200] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-17T04:52:25.682175] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T04:52:26.290165] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-17T04:52:26.633247] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T04:52:27.090128] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-17T04:52:27.895894] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-17T04:52:27.910430] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T04:52:28.690162] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-17T04:52:28.872311] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T04:52:29.296669] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T04:52:29.490180] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-17T04:52:29.677124] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T04:52:30.290134] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-17T04:52:30.973722] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T04:52:31.090126] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-17T04:52:31.842053] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T04:52:31.890090] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-17T04:52:31.997602] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T04:52:31.999836] [INFO ] [REMOTE ] LXFR: Full fetch complete (24993 records). [2025-09-17T04:52:31.999933] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-17T04:52:32.369746] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-17T04:52:32.369875] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-17T04:52:32.370573] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-17T04:52:32.370684] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-17T04:52:32.371622] [DEBUG] [LOCAL ] LXFR: Trimmed 24993 records to 17200 (keeping 200 days of data) [2025-09-17T04:52:32.481270] [DEBUG] [LOCAL ] LXFR: Primary data saved (17200 records). [2025-09-17T04:52:32.481511] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-17T04:52:32.481693] [INFO ] [MAIN ] Update Progress: 1289/2369 symbols completed. LXFR took 32.5s. Estimated remaining: 2h 37m 53s. Rate: 6.8 symbols/min [2025-09-17T04:52:32.657933] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:52:32.696613] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-17T04:52:32.699166] [DEBUG] [LOCAL ] LYB: Loaded 39975 existing records from primary storage. [2025-09-17T04:52:32.699346] [INFO ] [MAIN ] LYB: Loaded 39975 existing records. [2025-09-17T04:52:32.884362] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:52:32.884689] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-17T04:52:32.884769] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-17T04:52:32.885861] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-17T04:52:32.885941] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-17T04:52:33.248140] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:52:33.490141] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-11. [2025-09-17T04:52:33.522035] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T04:52:33.531005] [INFO ] [REMOTE ] LXP: Full fetch complete (72084 records). [2025-09-17T04:52:33.531308] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-17T04:52:33.932131] [DEBUG] [VALIDATOR ] LXP: All expected trading days are present. [2025-09-17T04:52:33.932269] [DEBUG] [VALIDATOR ] LXP: Primary data validation passed. [2025-09-17T04:52:33.933330] [INFO ] [MAIN ] LXP: Fetched primary data is valid. [2025-09-17T04:52:33.933415] [DEBUG] [LOCAL ] LXP: Saving primary data. [2025-09-17T04:52:33.938275] [DEBUG] [LOCAL ] LXP: Trimmed 72084 records to 50599 (keeping 200 days of data) [2025-09-17T04:52:34.248073] [DEBUG] [LOCAL ] LXP: Primary data saved (50599 records). [2025-09-17T04:52:34.248283] [INFO ] [MAIN ] LXP: Full history saved. [2025-09-17T04:52:34.248397] [INFO ] [MAIN ] Update Progress: 1290/2369 symbols completed. LXP took 27.9s. Estimated remaining: 2h 37m 38s. Rate: 6.8 symbols/min [2025-09-17T04:52:34.292897] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-17T04:52:34.433611] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:52:34.468141] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T04:52:34.512002] [DEBUG] [LOCAL ] LYG: Loaded 39363 existing records from primary storage. [2025-09-17T04:52:34.512202] [INFO ] [MAIN ] LYG: Loaded 39363 existing records. [2025-09-17T04:52:34.697368] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:52:34.697656] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-17T04:52:34.697786] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-17T04:52:34.698723] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-17T04:52:34.698788] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-17T04:52:35.070431] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:52:35.090085] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-11. [2025-09-17T04:52:35.204610] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T04:52:35.766191] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T04:52:35.890162] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-17T04:52:36.690170] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-17T04:52:36.739693] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T04:52:37.409058] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T04:52:37.490139] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-17T04:52:38.290186] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-17T04:52:38.423005] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T04:52:39.090277] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-17T04:52:39.255988] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:52:39.625528] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T04:52:39.890129] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-17T04:52:40.690140] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-17T04:52:40.791549] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T04:52:40.798023] [INFO ] [REMOTE ] LW: Full fetch complete (74523 records). [2025-09-17T04:52:40.798242] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-17T04:52:41.199659] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-17T04:52:41.199794] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-17T04:52:41.200856] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-17T04:52:41.200951] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-17T04:52:41.202559] [DEBUG] [LOCAL ] LW: Trimmed 74523 records to 51336 (keeping 200 days of data) [2025-09-17T04:52:41.491228] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-17T04:52:41.533217] [DEBUG] [LOCAL ] LW: Primary data saved (51336 records). [2025-09-17T04:52:41.533367] [INFO ] [MAIN ] LW: Full history saved. [2025-09-17T04:52:41.533487] [INFO ] [MAIN ] Update Progress: 1291/2369 symbols completed. LW took 51.7s. Estimated remaining: 2h 37m 28s. Rate: 6.8 symbols/min [2025-09-17T04:52:41.709265] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:52:41.743262] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T04:52:41.786497] [DEBUG] [LOCAL ] LYV: Loaded 37955 existing records from primary storage. [2025-09-17T04:52:41.786713] [INFO ] [MAIN ] LYV: Loaded 37955 existing records. [2025-09-17T04:52:41.999579] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:52:41.999982] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-17T04:52:42.000083] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-17T04:52:42.007379] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-17T04:52:42.018355] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-17T04:52:42.019417] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T04:52:42.295257] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-17T04:52:42.383847] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:52:43.090175] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-11. [2025-09-17T04:52:43.132957] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T04:52:43.646546] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T04:52:43.890206] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-17T04:52:44.413827] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T04:52:44.690184] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-17T04:52:45.259237] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T04:52:45.490145] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-17T04:52:46.070842] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:52:46.290211] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-17T04:52:47.090166] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-17T04:52:47.193516] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T04:52:47.739271] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T04:52:47.890120] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-17T04:52:48.690208] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-17T04:52:49.007077] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T04:52:49.490175] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-17T04:52:50.049811] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-17T04:52:50.290202] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-17T04:52:50.827515] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T04:52:51.090166] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-17T04:52:51.452481] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T04:52:51.890216] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-17T04:52:52.111327] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T04:52:52.248004] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T04:52:52.251793] [INFO ] [REMOTE ] LXU: Full fetch complete (44625 records). [2025-09-17T04:52:52.251946] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-17T04:52:52.662158] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-17T04:52:52.662281] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-17T04:52:52.663044] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-17T04:52:52.663103] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-17T04:52:52.664147] [DEBUG] [LOCAL ] LXU: Trimmed 44625 records to 32310 (keeping 200 days of data) [2025-09-17T04:52:52.709921] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-17T04:52:52.851203] [DEBUG] [LOCAL ] LXU: Primary data saved (32310 records). [2025-09-17T04:52:52.851384] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-17T04:52:52.851491] [INFO ] [MAIN ] Update Progress: 1292/2369 symbols completed. LXU took 36.8s. Estimated remaining: 2h 37m 21s. Rate: 6.8 symbols/min [2025-09-17T04:52:53.020632] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:52:53.046124] [DEBUG] [LOCAL ] LZB: Loaded 26279 existing records from primary storage. [2025-09-17T04:52:53.046362] [INFO ] [MAIN ] LZB: Loaded 26279 existing records. [2025-09-17T04:52:53.221775] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:52:53.222033] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-17T04:52:53.222090] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-17T04:52:53.222779] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-17T04:52:53.222839] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-17T04:52:53.501076] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-17T04:52:53.583399] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:52:53.851217] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T04:52:54.290149] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-11. [2025-09-17T04:52:54.617997] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T04:52:55.090199] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-17T04:52:55.241398] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T04:52:55.286467] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T04:52:55.890134] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-17T04:52:56.690090] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-17T04:52:56.843609] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T04:52:57.162291] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T04:52:57.490147] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-17T04:52:58.290102] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-17T04:52:58.460918] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T04:52:59.090149] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-17T04:52:59.615013] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-17T04:52:59.890185] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-17T04:53:00.074498] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T04:53:00.690157] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-17T04:53:01.473594] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-17T04:53:01.490081] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-17T04:53:01.608057] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T04:53:02.080761] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T04:53:02.290240] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-17T04:53:03.090170] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-17T04:53:03.531374] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T04:53:03.890182] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-17T04:53:03.927393] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-17T04:53:04.542946] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:53:04.690154] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-17T04:53:05.495264] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-17T04:53:05.512966] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T04:53:06.290150] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-17T04:53:06.376497] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T04:53:06.382984] [INFO ] [REMOTE ] LYV: Full fetch complete (73584 records). [2025-09-17T04:53:06.383219] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-17T04:53:06.786714] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-17T04:53:06.786892] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-17T04:53:06.787906] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-17T04:53:06.787965] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-17T04:53:06.789534] [DEBUG] [LOCAL ] LYV: Trimmed 73584 records to 51308 (keeping 200 days of data) [2025-09-17T04:53:06.918616] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T04:53:07.090479] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-17T04:53:07.167831] [DEBUG] [LOCAL ] LYV: Primary data saved (51308 records). [2025-09-17T04:53:07.168027] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-17T04:53:07.168127] [INFO ] [MAIN ] Update Progress: 1293/2369 symbols completed. LYV took 25.6s. Estimated remaining: 2h 37m 17s. Rate: 6.8 symbols/min [2025-09-17T04:53:07.337292] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:53:07.347077] [DEBUG] [LOCAL ] LZM: Loaded 8881 existing records from primary storage. [2025-09-17T04:53:07.347223] [INFO ] [MAIN ] LZM: Loaded 8881 existing records. [2025-09-17T04:53:07.526657] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:53:07.526914] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-17T04:53:07.526975] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-17T04:53:07.527338] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-17T04:53:07.527397] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-17T04:53:07.891281] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-17T04:53:07.891167] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:53:08.471063] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T04:53:08.540517] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T04:53:08.690139] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-17T04:53:09.490178] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-11. [2025-09-17T04:53:09.765116] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T04:53:09.771693] [INFO ] [REMOTE ] LYB: Full fetch complete (77282 records). [2025-09-17T04:53:09.771883] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-17T04:53:10.106138] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T04:53:10.192261] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-17T04:53:10.192389] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-17T04:53:10.193481] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-17T04:53:10.193542] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-17T04:53:10.195206] [DEBUG] [LOCAL ] LYB: Trimmed 77282 records to 53600 (keeping 200 days of data) [2025-09-17T04:53:10.290332] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-17T04:53:10.541772] [DEBUG] [LOCAL ] LYB: Primary data saved (53600 records). [2025-09-17T04:53:10.541972] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-17T04:53:10.542078] [INFO ] [MAIN ] Update Progress: 1294/2369 symbols completed. LYB took 38.1s. Estimated remaining: 2h 37m 4s. Rate: 6.8 symbols/min [2025-09-17T04:53:10.724639] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:53:10.764516] [DEBUG] [LOCAL ] M: Loaded 39907 existing records from primary storage. [2025-09-17T04:53:10.764783] [INFO ] [MAIN ] M: Loaded 39907 existing records. [2025-09-17T04:53:10.977604] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:53:10.978179] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-17T04:53:10.978723] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-17T04:53:10.980004] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T04:53:10.990525] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-17T04:53:10.991207] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-17T04:53:11.092127] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-17T04:53:11.348374] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:53:11.590432] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T04:53:11.890188] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-17T04:53:12.690137] [INFO ] [REMOTE ] M: Fetching primary data for 2024-11. [2025-09-17T04:53:12.894718] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T04:53:12.901512] [INFO ] [REMOTE ] LYG: Full fetch complete (75928 records). [2025-09-17T04:53:12.901762] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-17T04:53:13.302490] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-17T04:53:13.302714] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-17T04:53:13.304444] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-17T04:53:13.304549] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-17T04:53:13.306335] [DEBUG] [LOCAL ] LYG: Trimmed 75928 records to 52953 (keeping 200 days of data) [2025-09-17T04:53:13.423417] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T04:53:13.514798] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-17T04:53:13.661597] [DEBUG] [LOCAL ] LYG: Primary data saved (52953 records). [2025-09-17T04:53:13.661817] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-17T04:53:13.661929] [INFO ] [MAIN ] Update Progress: 1295/2369 symbols completed. LYG took 39.4s. Estimated remaining: 2h 36m 50s. Rate: 6.8 symbols/min [2025-09-17T04:53:13.836114] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:53:13.888149] [DEBUG] [LOCAL ] MA: Loaded 39040 existing records from primary storage. [2025-09-17T04:53:13.888428] [INFO ] [MAIN ] MA: Loaded 39040 existing records. [2025-09-17T04:53:14.107708] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:53:14.108078] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-17T04:53:14.108147] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-17T04:53:14.109129] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-17T04:53:14.109198] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-17T04:53:14.295583] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-17T04:53:14.499997] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:53:14.661098] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T04:53:15.098724] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-17T04:53:15.120256] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T04:53:15.134695] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T04:53:15.890153] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-17T04:53:16.673319] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T04:53:16.690083] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-17T04:53:17.319470] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-17T04:53:17.415613] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T04:53:17.490140] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-17T04:53:18.290183] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-17T04:53:19.090179] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-11. [2025-09-17T04:53:19.126916] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T04:53:19.542241] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-17T04:53:19.890184] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-17T04:53:20.690178] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-17T04:53:20.880446] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T04:53:21.485330] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T04:53:21.490213] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-17T04:53:21.609438] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T04:53:22.290223] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-17T04:53:22.434557] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T04:53:23.090191] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-17T04:53:23.890162] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-17T04:53:24.230725] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T04:53:24.659460] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T04:53:24.690185] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-17T04:53:25.127621] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T04:53:25.490128] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-17T04:53:25.966213] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T04:53:26.290132] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-17T04:53:27.090128] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-17T04:53:27.443466] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T04:53:27.890103] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-17T04:53:28.202682] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T04:53:28.207328] [INFO ] [REMOTE ] LZB: Full fetch complete (50003 records). [2025-09-17T04:53:28.207447] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-17T04:53:28.519060] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T04:53:28.663445] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-17T04:53:28.665414] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-17T04:53:28.665596] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-17T04:53:28.676908] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-17T04:53:28.677163] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-17T04:53:28.678448] [DEBUG] [LOCAL ] LZB: Trimmed 50003 records to 35468 (keeping 200 days of data) [2025-09-17T04:53:28.734612] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-17T04:53:28.902598] [DEBUG] [LOCAL ] LZB: Primary data saved (35468 records). [2025-09-17T04:53:28.902818] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-17T04:53:28.902919] [INFO ] [MAIN ] Update Progress: 1296/2369 symbols completed. LZB took 36.1s. Estimated remaining: 2h 36m 47s. Rate: 6.8 symbols/min [2025-09-17T04:53:29.074212] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:53:29.108734] [DEBUG] [LOCAL ] MAA: Loaded 31954 existing records from primary storage. [2025-09-17T04:53:29.108934] [INFO ] [MAIN ] MAA: Loaded 31954 existing records. [2025-09-17T04:53:29.289063] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:53:29.289371] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-17T04:53:29.289433] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-17T04:53:29.290195] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-17T04:53:29.290263] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-17T04:53:29.495307] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-17T04:53:29.673067] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:53:30.290203] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-17T04:53:30.385607] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T04:53:30.650250] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T04:53:31.090188] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-11. [2025-09-17T04:53:31.872863] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T04:53:31.890130] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-17T04:53:32.520359] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:53:32.690220] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-17T04:53:33.490160] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-17T04:53:33.598513] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T04:53:33.601153] [INFO ] [REMOTE ] LZM: Full fetch complete (17418 records). [2025-09-17T04:53:33.601257] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-17T04:53:33.973317] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-17T04:53:33.973469] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-17T04:53:33.974011] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-17T04:53:33.974122] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-17T04:53:33.974789] [DEBUG] [LOCAL ] LZM: Trimmed 17418 records to 13293 (keeping 200 days of data) [2025-09-17T04:53:34.058766] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-17T04:53:34.088071] [DEBUG] [LOCAL ] LZM: Primary data saved (13293 records). [2025-09-17T04:53:34.088233] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-17T04:53:34.088339] [INFO ] [MAIN ] Update Progress: 1297/2369 symbols completed. LZM took 26.9s. Estimated remaining: 2h 36m 35s. Rate: 6.8 symbols/min [2025-09-17T04:53:34.264104] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:53:34.290183] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-17T04:53:34.303505] [DEBUG] [LOCAL ] MAC: Loaded 36799 existing records from primary storage. [2025-09-17T04:53:34.303674] [INFO ] [MAIN ] MAC: Loaded 36799 existing records. [2025-09-17T04:53:34.484691] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:53:34.485042] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-17T04:53:34.485115] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-17T04:53:34.486044] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-17T04:53:34.486109] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-17T04:53:34.851273] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:53:34.872967] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:53:35.090098] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-11. [2025-09-17T04:53:35.890187] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-17T04:53:36.448011] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-17T04:53:36.634027] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T04:53:36.690134] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-17T04:53:37.106681] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T04:53:37.490137] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-17T04:53:38.290153] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-17T04:53:38.462508] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T04:53:39.090415] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-17T04:53:39.133715] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T04:53:39.895268] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-17T04:53:39.919045] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T04:53:40.690232] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-17T04:53:41.005776] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T04:53:41.085716] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T04:53:41.490210] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-17T04:53:42.290208] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-17T04:53:42.660401] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T04:53:43.090228] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-17T04:53:43.338289] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T04:53:43.345215] [INFO ] [REMOTE ] M: Full fetch complete (77369 records). [2025-09-17T04:53:43.345441] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-17T04:53:43.752159] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-17T04:53:43.752372] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-17T04:53:43.753609] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-17T04:53:43.753771] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-17T04:53:43.764197] [DEBUG] [LOCAL ] M: Trimmed 77369 records to 53536 (keeping 200 days of data) [2025-09-17T04:53:43.780559] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T04:53:43.890173] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-17T04:53:44.132593] [DEBUG] [LOCAL ] M: Primary data saved (53536 records). [2025-09-17T04:53:44.132770] [INFO ] [MAIN ] M: Full history saved. [2025-09-17T04:53:44.132863] [INFO ] [MAIN ] Update Progress: 1298/2369 symbols completed. M took 33.6s. Estimated remaining: 2h 36m 28s. Rate: 6.8 symbols/min [2025-09-17T04:53:44.312586] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:53:44.338532] [DEBUG] [LOCAL ] MAGN: Loaded 26255 existing records from primary storage. [2025-09-17T04:53:44.338732] [INFO ] [MAIN ] MAGN: Loaded 26255 existing records. [2025-09-17T04:53:44.540117] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:53:44.540611] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-17T04:53:44.540704] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-17T04:53:44.541408] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-17T04:53:44.541520] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-17T04:53:44.696864] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-17T04:53:44.875775] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T04:53:44.964606] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:53:45.490130] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-17T04:53:45.856459] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T04:53:46.290144] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-11. [2025-09-17T04:53:46.452135] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T04:53:46.677255] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T04:53:47.090164] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-17T04:53:47.717931] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T04:53:47.890145] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-17T04:53:48.690154] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-17T04:53:48.845666] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T04:53:49.252309] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T04:53:49.490123] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-17T04:53:50.290122] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-17T04:53:50.339731] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T04:53:50.778349] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T04:53:51.090182] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-17T04:53:51.890145] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-17T04:53:51.991133] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T04:53:52.275566] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T04:53:52.690152] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-17T04:53:53.200392] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T04:53:53.490172] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-17T04:53:54.011017] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T04:53:54.290229] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-17T04:53:55.090177] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-17T04:53:55.531080] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T04:53:55.815579] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T04:53:55.890081] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-17T04:53:56.476033] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T04:53:56.690182] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-17T04:53:57.137790] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T04:53:57.490208] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-17T04:53:58.201713] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T04:53:58.290096] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-17T04:53:58.705994] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T04:53:59.090161] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-17T04:53:59.751856] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:53:59.890169] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-17T04:54:00.303333] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T04:54:00.690137] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-17T04:54:01.387808] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T04:54:01.490152] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-17T04:54:02.142097] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T04:54:02.290117] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-17T04:54:03.090135] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-17T04:54:03.895469] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-17T04:54:03.900969] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (2.41 seconds). [2025-09-17T04:54:03.906856] [INFO ] [REMOTE ] MAA: Full fetch complete (61003 records). [2025-09-17T04:54:03.906994] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-17T04:54:04.295369] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-17T04:54:04.295504] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-17T04:54:04.296657] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-17T04:54:04.296716] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-17T04:54:04.298488] [DEBUG] [LOCAL ] MAA: Trimmed 61003 records to 43055 (keeping 200 days of data) [2025-09-17T04:54:04.437143] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-17T04:54:04.634836] [DEBUG] [LOCAL ] MAA: Primary data saved (43055 records). [2025-09-17T04:54:04.635080] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-17T04:54:04.635204] [INFO ] [MAIN ] Update Progress: 1299/2369 symbols completed. MAA took 35.7s. Estimated remaining: 2h 36m 29s. Rate: 6.8 symbols/min [2025-09-17T04:54:04.701064] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-17T04:54:04.809799] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:54:04.841964] [DEBUG] [LOCAL ] MAIN: Loaded 30668 existing records from primary storage. [2025-09-17T04:54:04.842171] [INFO ] [MAIN ] MAIN: Loaded 30668 existing records. [2025-09-17T04:54:05.019204] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:54:05.019469] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-17T04:54:05.019528] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-17T04:54:05.020359] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-17T04:54:05.020429] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-17T04:54:05.379065] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:54:05.497421] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-11. [2025-09-17T04:54:05.516298] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-17T04:54:05.599584] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T04:54:05.604375] [INFO ] [REMOTE ] MAGN: Full fetch complete (51286 records). [2025-09-17T04:54:05.604507] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-17T04:54:05.986448] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-17T04:54:05.986849] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-17T04:54:05.987719] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-17T04:54:05.987797] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-17T04:54:05.989108] [DEBUG] [LOCAL ] MAGN: Trimmed 51286 records to 35005 (keeping 200 days of data) [2025-09-17T04:54:06.116434] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-17T04:54:06.237658] [DEBUG] [LOCAL ] MAGN: Primary data saved (35005 records). [2025-09-17T04:54:06.237827] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-17T04:54:06.237939] [INFO ] [MAIN ] Update Progress: 1300/2369 symbols completed. MAGN took 22.1s. Estimated remaining: 2h 36m 14s. Rate: 6.8 symbols/min [2025-09-17T04:54:06.300487] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-17T04:54:06.409337] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:54:06.440169] [DEBUG] [LOCAL ] MAN: Loaded 32640 existing records from primary storage. [2025-09-17T04:54:06.440356] [INFO ] [MAIN ] MAN: Loaded 32640 existing records. [2025-09-17T04:54:06.623718] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:54:06.624004] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-17T04:54:06.624100] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-17T04:54:06.624820] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-17T04:54:06.624892] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-17T04:54:06.978336] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:54:07.001817] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T04:54:07.090070] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-17T04:54:07.890140] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-17T04:54:08.290512] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-17T04:54:08.299468] [INFO ] [REMOTE ] MA: Full fetch complete (76136 records). [2025-09-17T04:54:08.299713] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-17T04:54:08.691825] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-11. [2025-09-17T04:54:08.716921] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-17T04:54:08.717097] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-17T04:54:08.718182] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-17T04:54:08.718476] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-17T04:54:08.720580] [DEBUG] [LOCAL ] MA: Trimmed 76136 records to 52594 (keeping 200 days of data) [2025-09-17T04:54:08.843268] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T04:54:09.099537] [DEBUG] [LOCAL ] MA: Primary data saved (52594 records). [2025-09-17T04:54:09.099745] [INFO ] [MAIN ] MA: Full history saved. [2025-09-17T04:54:09.099885] [INFO ] [MAIN ] Update Progress: 1301/2369 symbols completed. MA took 55.4s. Estimated remaining: 2h 36m 0s. Rate: 6.8 symbols/min [2025-09-17T04:54:09.295018] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:54:09.312357] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T04:54:09.320170] [INFO ] [REMOTE ] MAC: Full fetch complete (71442 records). [2025-09-17T04:54:09.320355] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-17T04:54:09.488785] [DEBUG] [LOCAL ] MANU: Loaded 19379 existing records from primary storage. [2025-09-17T04:54:09.491462] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-17T04:54:09.517219] [INFO ] [MAIN ] MANU: Loaded 19379 existing records. [2025-09-17T04:54:09.926521] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-17T04:54:09.926708] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:54:09.926931] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-17T04:54:09.928128] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-17T04:54:09.928314] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-17T04:54:09.928472] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-17T04:54:09.928531] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-17T04:54:09.929384] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-17T04:54:09.929525] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-17T04:54:10.021936] [DEBUG] [LOCAL ] MAC: Trimmed 71442 records to 49787 (keeping 200 days of data) [2025-09-17T04:54:10.397588] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:54:10.399489] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-11. [2025-09-17T04:54:10.431909] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T04:54:10.650784] [DEBUG] [LOCAL ] MAC: Primary data saved (49787 records). [2025-09-17T04:54:10.650987] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-17T04:54:10.651111] [INFO ] [MAIN ] Update Progress: 1302/2369 symbols completed. MAC took 36.6s. Estimated remaining: 2h 35m 46s. Rate: 6.9 symbols/min [2025-09-17T04:54:10.823851] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:54:10.862049] [DEBUG] [LOCAL ] MAS: Loaded 39000 existing records from primary storage. [2025-09-17T04:54:10.862238] [INFO ] [MAIN ] MAS: Loaded 39000 existing records. [2025-09-17T04:54:11.047795] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:54:11.048071] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-17T04:54:11.048128] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-17T04:54:11.049272] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-17T04:54:11.049336] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-17T04:54:11.112211] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-17T04:54:11.407590] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:54:11.431223] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T04:54:11.663386] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T04:54:11.890130] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-17T04:54:12.695250] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-17T04:54:12.707457] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T04:54:13.133707] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T04:54:13.490138] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-17T04:54:14.296603] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-17T04:54:14.317037] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T04:54:14.635172] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T04:54:15.090134] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-11. [2025-09-17T04:54:15.890155] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-17T04:54:16.690139] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-17T04:54:16.851476] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-17T04:54:17.490129] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-17T04:54:17.606722] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-11 (2.52 seconds). [2025-09-17T04:54:17.749550] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T04:54:18.290140] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-17T04:54:18.486460] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-09-17T04:54:18.917404] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T04:54:19.090116] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-17T04:54:19.776254] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T04:54:19.890189] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-17T04:54:20.266018] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T04:54:20.690162] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-17T04:54:21.326867] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T04:54:21.490141] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-17T04:54:22.199256] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T04:54:22.290117] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-17T04:54:22.809402] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T04:54:23.090138] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-17T04:54:23.837862] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T04:54:23.890087] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-17T04:54:24.692541] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-17T04:54:24.697813] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T04:54:25.375398] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T04:54:25.490115] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-17T04:54:26.290130] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-17T04:54:26.495362] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T04:54:27.090149] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-17T04:54:27.143805] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T04:54:27.859898] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T04:54:27.890087] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-17T04:54:27.918932] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T04:54:28.690131] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-17T04:54:29.490137] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-17T04:54:29.674824] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T04:54:30.296736] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-17T04:54:30.299211] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T04:54:30.671576] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T04:54:31.090151] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-17T04:54:31.890140] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-17T04:54:32.054257] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T04:54:32.203260] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T04:54:32.690165] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-17T04:54:33.490152] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-17T04:54:33.649689] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T04:54:33.725030] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T04:54:34.290187] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-17T04:54:35.090283] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-17T04:54:35.154479] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T04:54:35.165228] [INFO ] [REMOTE ] MAN: Full fetch complete (61345 records). [2025-09-17T04:54:35.165547] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-17T04:54:35.700913] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-17T04:54:35.701081] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-17T04:54:35.702503] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-17T04:54:35.702602] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-17T04:54:35.704170] [DEBUG] [LOCAL ] MAN: Trimmed 61345 records to 43736 (keeping 200 days of data) [2025-09-17T04:54:35.926848] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-17T04:54:36.061063] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T04:54:36.062612] [DEBUG] [LOCAL ] MAN: Primary data saved (43736 records). [2025-09-17T04:54:36.073802] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-17T04:54:36.074178] [INFO ] [MAIN ] Update Progress: 1303/2369 symbols completed. MAN took 29.8s. Estimated remaining: 2h 35m 50s. Rate: 6.8 symbols/min [2025-09-17T04:54:36.255524] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:54:36.289076] [DEBUG] [LOCAL ] MATV: Loaded 26810 existing records from primary storage. [2025-09-17T04:54:36.289304] [INFO ] [MAIN ] MATV: Loaded 26810 existing records. [2025-09-17T04:54:36.481171] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:54:36.481571] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-17T04:54:36.481722] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-17T04:54:36.491321] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-17T04:54:36.505980] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-17T04:54:36.584750] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T04:54:36.695185] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-17T04:54:36.889240] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:54:37.240526] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T04:54:37.490164] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-17T04:54:38.266566] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T04:54:38.271881] [INFO ] [REMOTE ] MAIN: Full fetch complete (59219 records). [2025-09-17T04:54:38.272116] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-17T04:54:38.295374] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-17T04:54:38.692551] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-17T04:54:38.693041] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T04:54:38.697441] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-17T04:54:38.699122] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-17T04:54:38.699304] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-17T04:54:38.701293] [DEBUG] [LOCAL ] MAIN: Trimmed 59219 records to 41397 (keeping 200 days of data) [2025-09-17T04:54:38.964575] [DEBUG] [LOCAL ] MAIN: Primary data saved (41397 records). [2025-09-17T04:54:38.964786] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-17T04:54:38.964904] [INFO ] [MAIN ] Update Progress: 1304/2369 symbols completed. MAIN took 34.3s. Estimated remaining: 2h 35m 37s. Rate: 6.8 symbols/min [2025-09-17T04:54:39.095200] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-17T04:54:39.138598] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:54:39.163010] [DEBUG] [LOCAL ] MATX: Loaded 23742 existing records from primary storage. [2025-09-17T04:54:39.163199] [INFO ] [MAIN ] MATX: Loaded 23742 existing records. [2025-09-17T04:54:39.350543] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:54:39.350880] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-17T04:54:39.350947] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-17T04:54:39.351919] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-17T04:54:39.352221] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-17T04:54:39.718869] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:54:39.890144] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-11. [2025-09-17T04:54:40.075948] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T04:54:40.311265] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T04:54:40.315332] [INFO ] [REMOTE ] MANU: Full fetch complete (37900 records). [2025-09-17T04:54:40.315448] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-17T04:54:40.687129] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-17T04:54:40.687249] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-17T04:54:40.688087] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-17T04:54:40.688168] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-17T04:54:40.689151] [DEBUG] [LOCAL ] MANU: Trimmed 37900 records to 26936 (keeping 200 days of data) [2025-09-17T04:54:40.690108] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-17T04:54:40.852612] [DEBUG] [LOCAL ] MANU: Primary data saved (26936 records). [2025-09-17T04:54:40.852803] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-17T04:54:40.852902] [INFO ] [MAIN ] Update Progress: 1305/2369 symbols completed. MANU took 31.8s. Estimated remaining: 2h 35m 22s. Rate: 6.8 symbols/min [2025-09-17T04:54:41.024909] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:54:41.048019] [DEBUG] [LOCAL ] MAX: Loaded 22245 existing records from primary storage. [2025-09-17T04:54:41.048213] [INFO ] [MAIN ] MAX: Loaded 22245 existing records. [2025-09-17T04:54:41.234810] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:54:41.235252] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-17T04:54:41.235378] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-17T04:54:41.241127] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-17T04:54:41.250350] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-17T04:54:41.283180] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T04:54:41.499262] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-17T04:54:41.618523] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:54:42.290144] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-11. [2025-09-17T04:54:42.510857] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T04:54:42.809240] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T04:54:43.090159] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-17T04:54:43.640813] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T04:54:43.890216] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-11. [2025-09-17T04:54:44.690189] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-17T04:54:44.778171] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T04:54:45.046419] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T04:54:45.490198] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-17T04:54:45.996258] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T04:54:46.290169] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-17T04:54:46.953894] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T04:54:46.960377] [INFO ] [REMOTE ] MAS: Full fetch complete (74463 records). [2025-09-17T04:54:46.960532] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-17T04:54:47.103173] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-17T04:54:47.367123] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-17T04:54:47.367319] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-17T04:54:47.368360] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-17T04:54:47.368493] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-17T04:54:47.380838] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T04:54:47.387127] [DEBUG] [LOCAL ] MAS: Trimmed 74463 records to 52368 (keeping 200 days of data) [2025-09-17T04:54:47.718177] [DEBUG] [LOCAL ] MAS: Primary data saved (52368 records). [2025-09-17T04:54:47.718349] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-17T04:54:47.718454] [INFO ] [MAIN ] Update Progress: 1306/2369 symbols completed. MAS took 37.1s. Estimated remaining: 2h 35m 12s. Rate: 6.8 symbols/min [2025-09-17T04:54:47.887550] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:54:47.890181] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-17T04:54:47.928022] [DEBUG] [LOCAL ] MBC: Loaded 31783 existing records from primary storage. [2025-09-17T04:54:47.928369] [INFO ] [MAIN ] MBC: Loaded 31783 existing records. [2025-09-17T04:54:48.110127] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:54:48.110386] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-17T04:54:48.110450] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-17T04:54:48.111329] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-17T04:54:48.111419] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-17T04:54:48.481284] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:54:48.500437] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T04:54:48.690091] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-17T04:54:49.105473] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T04:54:49.490176] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-11. [2025-09-17T04:54:50.087753] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T04:54:50.290165] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-17T04:54:51.036401] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T04:54:51.090113] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-17T04:54:51.106758] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T04:54:51.890111] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-17T04:54:52.330309] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T04:54:52.690113] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-17T04:54:53.145392] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T04:54:53.490173] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-17T04:54:54.069983] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:54:54.290152] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-17T04:54:55.064874] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T04:54:55.090089] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-17T04:54:55.498942] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T04:54:55.890158] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-17T04:54:56.590122] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T04:54:56.690154] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-17T04:54:57.116167] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T04:54:57.490119] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-17T04:54:58.034043] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T04:54:58.290171] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-17T04:54:58.800339] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T04:54:59.090144] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-17T04:54:59.795906] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T04:54:59.890144] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-17T04:55:00.542079] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T04:55:00.690146] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-17T04:55:01.174927] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T04:55:01.490190] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-17T04:55:02.119424] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T04:55:02.290175] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-17T04:55:02.786340] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T04:55:03.090151] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-17T04:55:03.701561] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T04:55:03.890113] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-17T04:55:04.306306] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T04:55:04.690179] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-17T04:55:05.430777] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T04:55:05.490142] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-17T04:55:06.150289] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T04:55:06.290170] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-17T04:55:07.034711] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T04:55:07.090145] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-17T04:55:07.358097] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T04:55:07.890141] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-17T04:55:08.590773] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T04:55:08.690118] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-17T04:55:09.408769] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T04:55:09.490164] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-17T04:55:10.187623] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T04:55:10.290155] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-17T04:55:10.587405] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T04:55:10.595080] [INFO ] [REMOTE ] MAX: Full fetch complete (45342 records). [2025-09-17T04:55:10.595253] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-17T04:55:10.985558] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-17T04:55:10.985692] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-17T04:55:10.986728] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-17T04:55:10.986786] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-17T04:55:10.987871] [DEBUG] [LOCAL ] MAX: Trimmed 45342 records to 31047 (keeping 200 days of data) [2025-09-17T04:55:11.090518] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-17T04:55:11.177523] [DEBUG] [LOCAL ] MAX: Primary data saved (31047 records). [2025-09-17T04:55:11.177717] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-17T04:55:11.177817] [INFO ] [MAIN ] Update Progress: 1307/2369 symbols completed. MAX took 30.3s. Estimated remaining: 2h 35m 15s. Rate: 6.8 symbols/min [2025-09-17T04:55:11.349292] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:55:11.367055] [DEBUG] [LOCAL ] MBI: Loaded 17717 existing records from primary storage. [2025-09-17T04:55:11.367213] [INFO ] [MAIN ] MBI: Loaded 17717 existing records. [2025-09-17T04:55:11.544845] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:55:11.545119] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-17T04:55:11.545176] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-17T04:55:11.545925] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-17T04:55:11.545989] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-17T04:55:11.904159] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-17T04:55:11.909016] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:55:11.932860] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T04:55:12.442274] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T04:55:12.690232] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-17T04:55:13.347469] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T04:55:13.351491] [INFO ] [REMOTE ] MATV: Full fetch complete (52171 records). [2025-09-17T04:55:13.351617] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-17T04:55:13.495759] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-17T04:55:13.749897] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-17T04:55:13.750009] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-17T04:55:13.750842] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-17T04:55:13.750917] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-17T04:55:13.752073] [DEBUG] [LOCAL ] MATV: Trimmed 52171 records to 38024 (keeping 200 days of data) [2025-09-17T04:55:13.979966] [DEBUG] [LOCAL ] MATV: Primary data saved (38024 records). [2025-09-17T04:55:13.980155] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-17T04:55:13.980315] [INFO ] [MAIN ] Update Progress: 1308/2369 symbols completed. MATV took 37.9s. Estimated remaining: 2h 35m 2s. Rate: 6.8 symbols/min [2025-09-17T04:55:14.155692] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:55:14.186353] [DEBUG] [LOCAL ] MC: Loaded 32527 existing records from primary storage. [2025-09-17T04:55:14.186665] [INFO ] [MAIN ] MC: Loaded 32527 existing records. [2025-09-17T04:55:14.291903] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-11. [2025-09-17T04:55:14.376058] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:55:14.376448] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-17T04:55:14.376667] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-17T04:55:14.386196] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-17T04:55:14.402818] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-17T04:55:14.404218] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T04:55:14.752612] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T04:55:14.824311] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:55:15.090198] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-17T04:55:15.385467] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T04:55:15.890158] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-17T04:55:16.469199] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T04:55:16.690125] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-11. [2025-09-17T04:55:17.078540] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T04:55:17.490148] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-17T04:55:18.209614] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T04:55:18.290135] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-17T04:55:18.722099] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T04:55:18.725826] [INFO ] [REMOTE ] MATX: Full fetch complete (42213 records). [2025-09-17T04:55:18.725927] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-17T04:55:19.103440] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-17T04:55:19.092553] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-17T04:55:19.103600] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-17T04:55:19.104618] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-17T04:55:19.105427] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-17T04:55:19.106535] [DEBUG] [LOCAL ] MATX: Trimmed 42213 records to 31574 (keeping 200 days of data) [2025-09-17T04:55:19.306321] [DEBUG] [LOCAL ] MATX: Primary data saved (31574 records). [2025-09-17T04:55:19.306498] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-17T04:55:19.306596] [INFO ] [MAIN ] Update Progress: 1309/2369 symbols completed. MATX took 40.3s. Estimated remaining: 2h 34m 50s. Rate: 6.8 symbols/min [2025-09-17T04:55:19.477386] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:55:19.487010] [DEBUG] [LOCAL ] MCB: Loaded 8210 existing records from primary storage. [2025-09-17T04:55:19.487171] [INFO ] [MAIN ] MCB: Loaded 8210 existing records. [2025-09-17T04:55:19.666800] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:55:19.667107] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-17T04:55:19.667260] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-17T04:55:19.667754] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-17T04:55:19.667870] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-17T04:55:19.897432] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-17T04:55:19.985902] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T04:55:20.071741] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:55:20.281335] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T04:55:20.690143] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-17T04:55:21.211916] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T04:55:21.494619] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-17T04:55:21.497036] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T04:55:22.290193] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-11. [2025-09-17T04:55:22.912266] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T04:55:22.925520] [INFO ] [REMOTE ] MBC: Full fetch complete (62058 records). [2025-09-17T04:55:22.925853] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T04:55:22.928905] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-17T04:55:23.092154] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-17T04:55:23.325078] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-17T04:55:23.325201] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-17T04:55:23.326138] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-17T04:55:23.326199] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-17T04:55:23.327619] [DEBUG] [LOCAL ] MBC: Trimmed 62058 records to 43064 (keeping 200 days of data) [2025-09-17T04:55:23.590374] [DEBUG] [LOCAL ] MBC: Primary data saved (43064 records). [2025-09-17T04:55:23.590588] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-17T04:55:23.590725] [INFO ] [MAIN ] Update Progress: 1310/2369 symbols completed. MBC took 35.9s. Estimated remaining: 2h 34m 38s. Rate: 6.8 symbols/min [2025-09-17T04:55:23.761810] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:55:23.805340] [DEBUG] [LOCAL ] MCD: Loaded 39855 existing records from primary storage. [2025-09-17T04:55:23.805562] [INFO ] [MAIN ] MCD: Loaded 39855 existing records. [2025-09-17T04:55:23.895754] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-17T04:55:23.989411] [WARN ] [MAIN ] MCD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:55:23.989719] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-17T04:55:23.989780] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-17T04:55:23.990799] [DEBUG] [LOCAL ] MCD: Deleted primary data file. [2025-09-17T04:55:23.990864] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-17T04:55:24.362215] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:55:24.548089] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T04:55:24.690197] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-17T04:55:24.716487] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T04:55:25.490140] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-17T04:55:26.151807] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T04:55:26.290134] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-17T04:55:26.354930] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T04:55:27.090331] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-17T04:55:27.708612] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T04:55:27.890207] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-17T04:55:28.311338] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T04:55:28.690149] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-17T04:55:29.447737] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T04:55:29.490138] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-17T04:55:29.561186] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T04:55:30.175463] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T04:55:30.290142] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-17T04:55:31.090110] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-17T04:55:31.384916] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T04:55:31.890216] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-17T04:55:32.620620] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T04:55:32.690157] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-11. [2025-09-17T04:55:33.131351] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T04:55:33.490223] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-17T04:55:34.123314] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T04:55:34.290118] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-17T04:55:34.516926] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T04:55:35.090224] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-17T04:55:35.499905] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T04:55:35.890187] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-17T04:55:36.212730] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T04:55:36.331964] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T04:55:36.690180] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-17T04:55:37.490149] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-17T04:55:37.531716] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T04:55:38.290156] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-17T04:55:39.077516] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T04:55:39.090092] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-17T04:55:39.386370] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T04:55:39.890142] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-17T04:55:40.544014] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:55:40.690143] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-17T04:55:40.844385] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T04:55:41.490171] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-17T04:55:42.042292] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T04:55:42.047012] [INFO ] [REMOTE ] MC: Full fetch complete (61781 records). [2025-09-17T04:55:42.047146] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-17T04:55:42.297694] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-17T04:55:42.443440] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-17T04:55:42.443562] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-17T04:55:42.444762] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-17T04:55:42.444851] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-17T04:55:42.446341] [DEBUG] [LOCAL ] MC: Trimmed 61781 records to 44481 (keeping 200 days of data) [2025-09-17T04:55:42.733026] [DEBUG] [LOCAL ] MC: Primary data saved (44481 records). [2025-09-17T04:55:42.733226] [INFO ] [MAIN ] MC: Full history saved. [2025-09-17T04:55:42.733345] [INFO ] [MAIN ] Update Progress: 1311/2369 symbols completed. MC took 28.8s. Estimated remaining: 2h 34m 37s. Rate: 6.8 symbols/min [2025-09-17T04:55:42.913701] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:55:42.935699] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:55:42.945789] [DEBUG] [LOCAL ] MCI: Loaded 4644 existing records from primary storage. [2025-09-17T04:55:42.946351] [INFO ] [MAIN ] MCI: Loaded 4644 existing records. [2025-09-17T04:55:43.100067] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-17T04:55:43.126184] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:55:43.127514] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-17T04:55:43.127586] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-17T04:55:43.127895] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-17T04:55:43.127979] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-17T04:55:43.228837] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T04:55:43.500601] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:55:43.890161] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-11. [2025-09-17T04:55:44.634306] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T04:55:44.690094] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-17T04:55:45.281551] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-17T04:55:45.334494] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T04:55:45.490141] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-17T04:55:46.290133] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-17T04:55:46.311869] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T04:55:46.313763] [INFO ] [REMOTE ] MCB: Full fetch complete (16210 records). [2025-09-17T04:55:46.313863] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-17T04:55:46.680935] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-17T04:55:46.681091] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-17T04:55:46.681567] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-17T04:55:46.681658] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-17T04:55:46.682262] [DEBUG] [LOCAL ] MCB: Trimmed 16210 records to 11776 (keeping 200 days of data) [2025-09-17T04:55:46.755835] [DEBUG] [LOCAL ] MCB: Primary data saved (11776 records). [2025-09-17T04:55:46.756011] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-17T04:55:46.756144] [INFO ] [MAIN ] Update Progress: 1312/2369 symbols completed. MCB took 27.4s. Estimated remaining: 2h 34m 25s. Rate: 6.8 symbols/min [2025-09-17T04:55:46.904546] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T04:55:46.937803] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:55:46.965204] [DEBUG] [LOCAL ] MCK: Loaded 28557 existing records from primary storage. [2025-09-17T04:55:46.965385] [INFO ] [MAIN ] MCK: Loaded 28557 existing records. [2025-09-17T04:55:47.095297] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-17T04:55:47.162931] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:55:47.163201] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-17T04:55:47.163262] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-17T04:55:47.164326] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-17T04:55:47.164403] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-17T04:55:47.529706] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:55:47.890206] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-17T04:55:47.971945] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T04:55:48.690178] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-11. [2025-09-17T04:55:49.021101] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T04:55:49.024331] [INFO ] [REMOTE ] MBI: Full fetch complete (36964 records). [2025-09-17T04:55:49.024437] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-17T04:55:49.440131] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-17T04:55:49.440243] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-17T04:55:49.440951] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-17T04:55:49.441011] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-17T04:55:49.441958] [DEBUG] [LOCAL ] MBI: Trimmed 36964 records to 25156 (keeping 200 days of data) [2025-09-17T04:55:49.496682] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-17T04:55:49.583469] [DEBUG] [LOCAL ] MBI: Primary data saved (25156 records). [2025-09-17T04:55:49.583673] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-17T04:55:49.583802] [INFO ] [MAIN ] Update Progress: 1313/2369 symbols completed. MBI took 38.4s. Estimated remaining: 2h 34m 11s. Rate: 6.8 symbols/min [2025-09-17T04:55:49.755251] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:55:49.762770] [DEBUG] [LOCAL ] MCN: Loaded 5967 existing records from primary storage. [2025-09-17T04:55:49.762919] [INFO ] [MAIN ] MCN: Loaded 5967 existing records. [2025-09-17T04:55:49.953267] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:55:49.953548] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-17T04:55:49.953613] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-17T04:55:49.953942] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-17T04:55:49.954022] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-17T04:55:50.291618] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-17T04:55:50.328523] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T04:55:50.326967] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:55:50.359042] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T04:55:51.090143] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-17T04:55:51.698253] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T04:55:51.890152] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-17T04:55:52.447461] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-17T04:55:52.690176] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-17T04:55:53.395571] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T04:55:53.478382] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T04:55:53.490089] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-17T04:55:54.290150] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-17T04:55:55.090158] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-17T04:55:55.415038] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T04:55:55.801849] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T04:55:55.829330] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T04:55:55.890078] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-17T04:55:56.690184] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-17T04:55:57.425098] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T04:55:57.490118] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-17T04:55:58.290129] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-17T04:55:58.869886] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T04:55:58.870052] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T04:55:59.098310] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-17T04:55:59.103629] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T04:55:59.890139] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-17T04:56:00.690137] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-11. [2025-09-17T04:56:01.137512] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T04:56:01.343109] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T04:56:01.490161] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-17T04:56:01.691338] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T04:56:02.290125] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-17T04:56:03.062539] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T04:56:03.090078] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-17T04:56:03.334472] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T04:56:03.569926] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T04:56:03.890138] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-17T04:56:04.492419] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T04:56:04.690131] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-17T04:56:05.490119] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-17T04:56:06.135056] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T04:56:06.290148] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-17T04:56:06.595981] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T04:56:06.986092] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T04:56:06.987521] [INFO ] [REMOTE ] MCI: Full fetch complete (9810 records). [2025-09-17T04:56:06.987621] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-17T04:56:07.092886] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-17T04:56:07.361945] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-17T04:56:07.362056] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-17T04:56:07.362420] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-17T04:56:07.362473] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-17T04:56:07.362943] [DEBUG] [LOCAL ] MCI: Trimmed 9810 records to 6360 (keeping 200 days of data) [2025-09-17T04:56:07.401863] [DEBUG] [LOCAL ] MCI: Primary data saved (6360 records). [2025-09-17T04:56:07.402036] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-17T04:56:07.402152] [INFO ] [MAIN ] Update Progress: 1314/2369 symbols completed. MCI took 24.7s. Estimated remaining: 2h 34m 10s. Rate: 6.8 symbols/min [2025-09-17T04:56:07.569090] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:56:07.597050] [DEBUG] [LOCAL ] MCO: Loaded 27948 existing records from primary storage. [2025-09-17T04:56:07.597224] [INFO ] [MAIN ] MCO: Loaded 27948 existing records. [2025-09-17T04:56:07.773450] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:56:07.773739] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-17T04:56:07.773794] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-17T04:56:07.774534] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-17T04:56:07.774598] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-17T04:56:07.895278] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-17T04:56:08.132857] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:56:08.653760] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T04:56:08.690082] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-17T04:56:08.765528] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T04:56:09.490192] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-17T04:56:10.290191] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-11. [2025-09-17T04:56:10.920931] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T04:56:10.960035] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-17T04:56:11.090123] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-17T04:56:11.828689] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T04:56:11.890084] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-17T04:56:12.558429] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T04:56:12.690143] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-17T04:56:13.281855] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T04:56:13.490191] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-17T04:56:14.290163] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-17T04:56:14.761782] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T04:56:15.021829] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T04:56:15.067999] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T04:56:15.090138] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-17T04:56:15.890132] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-17T04:56:15.954346] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T04:56:16.690195] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-17T04:56:17.164897] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T04:56:17.490213] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-17T04:56:18.290110] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-17T04:56:18.756608] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-17T04:56:18.765454] [INFO ] [REMOTE ] MCD: Full fetch complete (77309 records). [2025-09-17T04:56:18.765673] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-17T04:56:19.094355] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-17T04:56:19.166573] [DEBUG] [VALIDATOR ] MCD: All expected trading days are present. [2025-09-17T04:56:19.166867] [DEBUG] [VALIDATOR ] MCD: Primary data validation passed. [2025-09-17T04:56:19.177899] [INFO ] [MAIN ] MCD: Fetched primary data is valid. [2025-09-17T04:56:19.180933] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T04:56:19.181039] [DEBUG] [LOCAL ] MCD: Saving primary data. [2025-09-17T04:56:19.193387] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T04:56:19.192351] [INFO ] [REMOTE ] MCK: Full fetch complete (57526 records). [2025-09-17T04:56:19.193704] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-17T04:56:19.197614] [DEBUG] [LOCAL ] MCD: Trimmed 77309 records to 53469 (keeping 200 days of data) [2025-09-17T04:56:19.720293] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-17T04:56:19.721075] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-17T04:56:19.722422] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-17T04:56:19.722789] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-17T04:56:19.738077] [DEBUG] [LOCAL ] MCK: Trimmed 57526 records to 39680 (keeping 200 days of data) [2025-09-17T04:56:19.903382] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-17T04:56:20.222633] [DEBUG] [LOCAL ] MCD: Primary data saved (53469 records). [2025-09-17T04:56:20.223760] [INFO ] [MAIN ] MCD: Full history saved. [2025-09-17T04:56:20.225563] [INFO ] [MAIN ] Update Progress: 1315/2369 symbols completed. MCD took 56.6s. Estimated remaining: 2h 34m 4s. Rate: 6.8 symbols/min [2025-09-17T04:56:20.446036] [DEBUG] [LOCAL ] MCK: Primary data saved (39680 records). [2025-09-17T04:56:20.469524] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:56:20.470068] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-17T04:56:20.470301] [INFO ] [MAIN ] Update Progress: 1316/2369 symbols completed. MCK took 33.7s. Estimated remaining: 2h 33m 49s. Rate: 6.8 symbols/min [2025-09-17T04:56:20.560149] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T04:56:20.595103] [DEBUG] [LOCAL ] MCR: Loaded 6564 existing records from primary storage. [2025-09-17T04:56:20.595323] [INFO ] [MAIN ] MCR: Loaded 6564 existing records. [2025-09-17T04:56:20.692255] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-17T04:56:21.143210] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:56:21.159464] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T04:56:21.155840] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:56:21.172125] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-17T04:56:21.174667] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-17T04:56:21.176226] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-17T04:56:21.176395] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-17T04:56:21.334571] [DEBUG] [LOCAL ] MCS: Loaded 15589 existing records from primary storage. [2025-09-17T04:56:21.359961] [INFO ] [MAIN ] MCS: Loaded 15589 existing records. [2025-09-17T04:56:21.498846] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-17T04:56:21.637924] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T04:56:21.751382] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:56:21.762407] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-17T04:56:21.772908] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-17T04:56:21.778439] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-17T04:56:21.807182] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-17T04:56:21.913077] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:56:22.196030] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:56:22.290101] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-11. [2025-09-17T04:56:23.090148] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-11. [2025-09-17T04:56:23.378808] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T04:56:23.431470] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T04:56:23.890158] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-17T04:56:23.958669] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T04:56:24.690136] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-17T04:56:25.309659] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T04:56:25.311155] [INFO ] [REMOTE ] MCN: Full fetch complete (11390 records). [2025-09-17T04:56:25.311258] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-17T04:56:25.493577] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-17T04:56:25.754598] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T04:56:25.761916] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-17T04:56:25.771395] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-17T04:56:25.772343] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-17T04:56:25.772834] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-17T04:56:25.773797] [DEBUG] [LOCAL ] MCN: Trimmed 11390 records to 8162 (keeping 200 days of data) [2025-09-17T04:56:25.825084] [DEBUG] [LOCAL ] MCN: Primary data saved (8162 records). [2025-09-17T04:56:25.825321] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-17T04:56:25.825462] [INFO ] [MAIN ] Update Progress: 1317/2369 symbols completed. MCN took 36.2s. Estimated remaining: 2h 33m 37s. Rate: 6.8 symbols/min [2025-09-17T04:56:26.290128] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-17T04:56:26.576892] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T04:56:27.090144] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-17T04:56:27.629231] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T04:56:27.890167] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-17T04:56:28.075066] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T04:56:28.690155] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-17T04:56:28.827862] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T04:56:29.490190] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-17T04:56:30.146753] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T04:56:30.290157] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-17T04:56:30.563722] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T04:56:31.090113] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-17T04:56:31.316843] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T04:56:31.890135] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-17T04:56:32.668773] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T04:56:32.690102] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-17T04:56:33.109809] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T04:56:33.490180] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-17T04:56:34.121978] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T04:56:34.290112] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-17T04:56:34.562759] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T04:56:35.090193] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-17T04:56:35.698001] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T04:56:35.702825] [INFO ] [REMOTE ] MCO: Full fetch complete (56116 records). [2025-09-17T04:56:35.702944] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-17T04:56:35.895687] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-17T04:56:36.094735] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-17T04:56:36.094901] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-17T04:56:36.096068] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-17T04:56:36.096155] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-17T04:56:36.097511] [DEBUG] [LOCAL ] MCO: Trimmed 56116 records to 39613 (keeping 200 days of data) [2025-09-17T04:56:36.247567] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T04:56:36.393320] [DEBUG] [LOCAL ] MCO: Primary data saved (39613 records). [2025-09-17T04:56:36.393517] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-17T04:56:36.393632] [INFO ] [MAIN ] Update Progress: 1318/2369 symbols completed. MCO took 29.0s. Estimated remaining: 2h 33m 30s. Rate: 6.8 symbols/min [2025-09-17T04:56:36.677996] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T04:56:36.690082] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-17T04:56:37.490182] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-17T04:56:37.653962] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T04:56:38.253237] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T04:56:38.290216] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-17T04:56:38.782145] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-17T04:56:39.090160] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-17T04:56:39.890206] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-17T04:56:40.185404] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T04:56:40.690200] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-17T04:56:40.736767] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:56:41.490132] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-17T04:56:41.765092] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T04:56:42.270771] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T04:56:42.290141] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-17T04:56:43.055621] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T04:56:43.090135] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-17T04:56:43.890151] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-17T04:56:43.960792] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T04:56:44.690286] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-17T04:56:45.003888] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T04:56:45.008280] [INFO ] [REMOTE ] MCS: Full fetch complete (30187 records). [2025-09-17T04:56:45.008448] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-17T04:56:45.395415] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-17T04:56:45.395550] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-17T04:56:45.396229] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-17T04:56:45.396319] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-17T04:56:45.397350] [DEBUG] [LOCAL ] MCS: Trimmed 30187 records to 21546 (keeping 200 days of data) [2025-09-17T04:56:45.501068] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T04:56:45.503749] [INFO ] [REMOTE ] MCR: Full fetch complete (14294 records). [2025-09-17T04:56:45.504619] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-17T04:56:45.894196] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-17T04:56:45.894842] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-17T04:56:45.895704] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-17T04:56:45.896418] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-17T04:56:45.899758] [DEBUG] [LOCAL ] MCR: Trimmed 14294 records to 9007 (keeping 200 days of data) [2025-09-17T04:56:45.970409] [DEBUG] [LOCAL ] MCS: Primary data saved (21546 records). [2025-09-17T04:56:45.971305] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-17T04:56:45.972402] [INFO ] [MAIN ] Update Progress: 1319/2369 symbols completed. MCS took 25.5s. Estimated remaining: 2h 33m 22s. Rate: 6.8 symbols/min [2025-09-17T04:56:45.974738] [DEBUG] [LOCAL ] MCR: Primary data saved (9007 records). [2025-09-17T04:56:45.974820] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-17T04:56:45.974913] [INFO ] [MAIN ] Update Progress: 1320/2369 symbols completed. MCR took 25.7s. Estimated remaining: 2h 33m 6s. Rate: 6.9 symbols/min [2025-09-17T04:56:46.502221] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:56:46.607535] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:56:46.651799] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:56:46.674534] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:56:46.682554] [DEBUG] [LOCAL ] MDST: Loaded 4121 existing records from primary storage. [2025-09-17T04:56:46.682893] [INFO ] [MAIN ] MDST: Loaded 4121 existing records. [2025-09-17T04:56:46.893848] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:56:46.903396] [DEBUG] [LOCAL ] MCY: Loaded 17638 existing records from primary storage. [2025-09-17T04:56:46.904278] [DEBUG] [LOCAL ] MD: Loaded 29126 existing records from primary storage. [2025-09-17T04:56:46.903617] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-17T04:56:46.904832] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-17T04:56:46.904904] [INFO ] [MAIN ] MD: Loaded 29126 existing records. [2025-09-17T04:56:46.903704] [INFO ] [MAIN ] MCY: Loaded 17638 existing records. [2025-09-17T04:56:46.921564] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-17T04:56:46.996785] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-17T04:56:47.038416] [DEBUG] [LOCAL ] MDT: Loaded 40028 existing records from primary storage. [2025-09-17T04:56:47.085709] [INFO ] [MAIN ] MDT: Loaded 40028 existing records. [2025-09-17T04:56:47.497865] [WARN ] [MAIN ] MCY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:56:47.562757] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:56:47.603192] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-17T04:56:47.656551] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-17T04:56:47.664497] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-17T04:56:47.723817] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:56:47.728987] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-17T04:56:47.746074] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-17T04:56:47.749524] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-17T04:56:47.749784] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-17T04:56:47.749813] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-17T04:56:47.750195] [DEBUG] [LOCAL ] MCY: Deleted primary data file. [2025-09-17T04:56:47.813882] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-17T04:56:47.808689] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-17T04:56:47.877580] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-17T04:56:47.925858] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:56:48.001312] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-11. [2025-09-17T04:56:48.792803] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:56:48.818570] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-11. [2025-09-17T04:56:48.883468] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:56:48.935759] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:56:48.936137] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-11. [2025-09-17T04:56:48.936672] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-11. [2025-09-17T04:56:48.942749] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T04:56:48.944689] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-17T04:56:49.544455] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T04:56:49.546552] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-17T04:56:50.207744] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T04:56:50.244525] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T04:56:50.295188] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-17T04:56:50.308487] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T04:56:50.406939] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T04:56:51.090155] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-17T04:56:51.553536] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T04:56:51.890152] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-17T04:56:51.989799] [DEBUG] [REMOTE ] MCY: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T04:56:51.990140] [WARN ] [REMOTE ] MCY: No data returned for month 2025-01 [2025-09-17T04:56:52.515223] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T04:56:52.690189] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-17T04:56:53.490137] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-17T04:56:54.290151] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-17T04:56:54.561796] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T04:56:54.949180] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T04:56:55.090142] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-17T04:56:55.637194] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T04:56:55.890138] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-17T04:56:56.690139] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-17T04:56:56.966227] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T04:56:57.210728] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T04:56:57.271753] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T04:56:57.490136] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-17T04:56:58.290170] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-17T04:56:58.858127] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T04:56:59.043825] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T04:56:59.090185] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-17T04:56:59.890156] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-17T04:57:00.553626] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T04:57:00.690146] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-17T04:57:01.283836] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T04:57:01.490119] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-17T04:57:01.619257] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T04:57:02.290154] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-17T04:57:03.090191] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-17T04:57:03.890190] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-17T04:57:04.850384] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T04:57:04.852307] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-17T04:57:04.879272] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (3.39 seconds). [2025-09-17T04:57:04.965777] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-17T04:57:05.450940] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T04:57:05.490078] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-17T04:57:06.132195] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (3.04 seconds). [2025-09-17T04:57:06.166419] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T04:57:06.290110] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-17T04:57:07.090173] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-17T04:57:07.758247] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T04:57:07.890134] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-17T04:57:08.017146] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T04:57:08.627945] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T04:57:08.629496] [INFO ] [REMOTE ] MDST: Full fetch complete (8311 records). [2025-09-17T04:57:08.629603] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-17T04:57:08.695294] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-17T04:57:09.003831] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-17T04:57:09.003955] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-17T04:57:09.004239] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-17T04:57:09.004875] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-17T04:57:09.005329] [DEBUG] [LOCAL ] MDST: Trimmed 8311 records to 5396 (keeping 200 days of data) [2025-09-17T04:57:09.040501] [DEBUG] [LOCAL ] MDST: Primary data saved (5396 records). [2025-09-17T04:57:09.040692] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-17T04:57:09.040809] [INFO ] [MAIN ] Update Progress: 1321/2369 symbols completed. MDST took 23.1s. Estimated remaining: 2h 33m 9s. Rate: 6.8 symbols/min [2025-09-17T04:57:09.217485] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:57:09.259045] [DEBUG] [LOCAL ] MDU: Loaded 35119 existing records from primary storage. [2025-09-17T04:57:09.259261] [INFO ] [MAIN ] MDU: Loaded 35119 existing records. [2025-09-17T04:57:09.442176] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:57:09.442465] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-17T04:57:09.442536] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-17T04:57:09.443518] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-17T04:57:09.443585] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-17T04:57:09.497276] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-17T04:57:09.798259] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:57:09.878410] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T04:57:10.290137] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-17T04:57:11.090104] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-17T04:57:11.499550] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T04:57:11.657611] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T04:57:11.890689] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-11. [2025-09-17T04:57:11.892161] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T04:57:12.690136] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-17T04:57:13.498404] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-17T04:57:13.525810] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T04:57:14.290269] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-17T04:57:14.451454] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T04:57:14.599592] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T04:57:15.090239] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-17T04:57:15.890118] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-17T04:57:16.159670] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T04:57:16.541795] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T04:57:16.690157] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-17T04:57:17.490133] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-17T04:57:17.765262] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T04:57:18.134520] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-17T04:57:18.290119] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-17T04:57:18.971267] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T04:57:19.090135] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-17T04:57:19.537986] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T04:57:19.890137] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-17T04:57:20.690149] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-17T04:57:20.868675] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T04:57:20.871679] [INFO ] [REMOTE ] MCY: Full fetch complete (35752 records). [2025-09-17T04:57:20.871796] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-17T04:57:21.071480] [WARN ] [VALIDATOR ] MCY: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T04:57:21.072145] [FATAL] [MAIN ] MCY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:57:21.072259] [WARN ] [MAIN ] MCY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:57:21.072416] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-17T04:57:21.072585] [DEBUG] [LOCAL ] MCY: No primary data file found to delete. [2025-09-17T04:57:21.072664] [INFO ] [LOCAL ] MCY: Starting deletion of derivative data. [2025-09-17T04:57:21.073149] [DEBUG] [LOCAL ] MCY: Deleted derivative data file. [2025-09-17T04:57:21.073393] [INFO ] [MAIN ] Update Progress: 1322/2369 symbols completed. MCY took 35.1s. Estimated remaining: 2h 33m 2s. Rate: 6.8 symbols/min [2025-09-17T04:57:21.271835] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T04:57:21.289353] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:57:21.311285] [DEBUG] [LOCAL ] MDV: Loaded 6546 existing records from primary storage. [2025-09-17T04:57:21.311463] [INFO ] [MAIN ] MDV: Loaded 6546 existing records. [2025-09-17T04:57:21.491326] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-17T04:57:21.491234] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:57:21.491820] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-17T04:57:21.492775] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-17T04:57:21.493177] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-17T04:57:21.493242] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-17T04:57:21.887957] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:57:22.123725] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T04:57:22.128523] [INFO ] [REMOTE ] MD: Full fetch complete (55105 records). [2025-09-17T04:57:22.128677] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-17T04:57:22.303474] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-17T04:57:22.515014] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-17T04:57:22.515134] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-17T04:57:22.516023] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-17T04:57:22.516104] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-17T04:57:22.517283] [DEBUG] [LOCAL ] MD: Trimmed 55105 records to 38818 (keeping 200 days of data) [2025-09-17T04:57:22.747478] [DEBUG] [LOCAL ] MD: Primary data saved (38818 records). [2025-09-17T04:57:22.747703] [INFO ] [MAIN ] MD: Full history saved. [2025-09-17T04:57:22.747848] [INFO ] [MAIN ] Update Progress: 1323/2369 symbols completed. MD took 36.8s. Estimated remaining: 2h 32m 48s. Rate: 6.8 symbols/min [2025-09-17T04:57:22.917884] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:57:22.932173] [DEBUG] [LOCAL ] MEC: Loaded 12359 existing records from primary storage. [2025-09-17T04:57:22.932331] [INFO ] [MAIN ] MEC: Loaded 12359 existing records. [2025-09-17T04:57:23.106268] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-11. [2025-09-17T04:57:23.110941] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:57:23.112401] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-17T04:57:23.112520] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-17T04:57:23.113107] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-17T04:57:23.113222] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-17T04:57:23.421960] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-17T04:57:23.510047] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:57:23.889740] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T04:57:23.892151] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-17T04:57:24.321448] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T04:57:24.354502] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T04:57:24.690123] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-17T04:57:25.490112] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-11. [2025-09-17T04:57:26.290135] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-17T04:57:26.457549] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T04:57:26.557364] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T04:57:26.921117] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T04:57:27.090137] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-17T04:57:27.852578] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T04:57:27.890137] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-17T04:57:28.628240] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T04:57:28.690091] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-17T04:57:29.490186] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-17T04:57:29.635848] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T04:57:30.290173] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-17T04:57:31.090169] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-17T04:57:31.145859] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T04:57:31.200386] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T04:57:31.890207] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-17T04:57:32.659117] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T04:57:32.690084] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-17T04:57:32.848894] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T04:57:32.857360] [INFO ] [REMOTE ] MDT: Full fetch complete (77542 records). [2025-09-17T04:57:32.857535] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-17T04:57:33.256921] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-17T04:57:33.257035] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-17T04:57:33.258055] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-17T04:57:33.258118] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-17T04:57:33.259948] [DEBUG] [LOCAL ] MDT: Trimmed 77542 records to 53678 (keeping 200 days of data) [2025-09-17T04:57:33.497442] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T04:57:33.495677] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-17T04:57:33.615828] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-09-17T04:57:33.616035] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-17T04:57:33.616153] [INFO ] [MAIN ] Update Progress: 1324/2369 symbols completed. MDT took 47.6s. Estimated remaining: 2h 32m 41s. Rate: 6.8 symbols/min [2025-09-17T04:57:33.786148] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:57:33.802897] [DEBUG] [LOCAL ] MED: Loaded 15705 existing records from primary storage. [2025-09-17T04:57:33.803078] [INFO ] [MAIN ] MED: Loaded 15705 existing records. [2025-09-17T04:57:33.979218] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:57:33.979525] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-17T04:57:33.979605] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-17T04:57:33.980146] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-17T04:57:33.980230] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-17T04:57:34.300242] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-17T04:57:34.342203] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:57:34.350089] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T04:57:35.090186] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-11. [2025-09-17T04:57:35.869591] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T04:57:35.890120] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-17T04:57:36.193927] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T04:57:36.690247] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-17T04:57:36.900004] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T04:57:37.490136] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-17T04:57:38.171139] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T04:57:38.258764] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T04:57:38.290107] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-17T04:57:39.090186] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-17T04:57:39.268169] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T04:57:39.890207] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-17T04:57:40.314764] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T04:57:40.690158] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-17T04:57:40.879296] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T04:57:41.490226] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-17T04:57:42.290189] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-17T04:57:42.368333] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T04:57:42.596873] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T04:57:42.742973] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T04:57:43.090180] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-17T04:57:43.890231] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-17T04:57:44.690204] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-17T04:57:44.786678] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T04:57:44.827459] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T04:57:45.446329] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T04:57:45.490086] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-17T04:57:46.286221] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T04:57:46.290089] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-17T04:57:47.090140] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-17T04:57:47.280764] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T04:57:47.890153] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-17T04:57:47.917887] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T04:57:48.528429] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T04:57:48.529838] [INFO ] [REMOTE ] MDV: Full fetch complete (11601 records). [2025-09-17T04:57:48.529939] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-17T04:57:48.699563] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-17T04:57:48.913667] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-17T04:57:48.913796] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-17T04:57:48.914185] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-17T04:57:48.914254] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-17T04:57:48.914762] [DEBUG] [LOCAL ] MDV: Trimmed 11601 records to 8838 (keeping 200 days of data) [2025-09-17T04:57:48.975115] [DEBUG] [LOCAL ] MDV: Primary data saved (8838 records). [2025-09-17T04:57:48.975311] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-17T04:57:48.975411] [INFO ] [MAIN ] Update Progress: 1325/2369 symbols completed. MDV took 27.9s. Estimated remaining: 2h 32m 37s. Rate: 6.8 symbols/min [2025-09-17T04:57:49.160986] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:57:49.186946] [DEBUG] [LOCAL ] MEG: Loaded 22538 existing records from primary storage. [2025-09-17T04:57:49.187140] [INFO ] [MAIN ] MEG: Loaded 22538 existing records. [2025-09-17T04:57:49.372573] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:57:49.372886] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-17T04:57:49.372948] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-17T04:57:49.373796] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-17T04:57:49.373859] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-17T04:57:49.495272] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-17T04:57:49.754182] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:57:50.290236] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-11. [2025-09-17T04:57:50.315788] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T04:57:50.321722] [INFO ] [REMOTE ] MDU: Full fetch complete (70030 records). [2025-09-17T04:57:50.321923] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-17T04:57:50.757191] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-17T04:57:50.770715] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-17T04:57:50.771926] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T04:57:50.773572] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-17T04:57:50.773924] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-17T04:57:50.781567] [DEBUG] [LOCAL ] MDU: Trimmed 70030 records to 47858 (keeping 200 days of data) [2025-09-17T04:57:51.095555] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-17T04:57:51.115528] [DEBUG] [LOCAL ] MDU: Primary data saved (47858 records). [2025-09-17T04:57:51.115768] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-17T04:57:51.115896] [INFO ] [MAIN ] Update Progress: 1326/2369 symbols completed. MDU took 42.1s. Estimated remaining: 2h 32m 23s. Rate: 6.8 symbols/min [2025-09-17T04:57:51.291666] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:57:51.309034] [DEBUG] [LOCAL ] MEGI: Loaded 15098 existing records from primary storage. [2025-09-17T04:57:51.309224] [INFO ] [MAIN ] MEGI: Loaded 15098 existing records. [2025-09-17T04:57:51.487975] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:57:51.488367] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-17T04:57:51.488484] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-17T04:57:51.489834] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-17T04:57:51.490151] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-17T04:57:51.649556] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T04:57:51.837595] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T04:57:51.880590] [INFO ] [REMOTE ] MEC: Full fetch complete (22418 records). [2025-09-17T04:57:51.911010] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:57:51.905609] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-17T04:57:51.911625] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-17T04:57:52.321158] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-17T04:57:52.321299] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-17T04:57:52.322132] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-17T04:57:52.322225] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-17T04:57:52.323313] [DEBUG] [LOCAL ] MEC: Trimmed 22418 records to 16612 (keeping 200 days of data) [2025-09-17T04:57:52.426192] [DEBUG] [LOCAL ] MEC: Primary data saved (16612 records). [2025-09-17T04:57:52.426391] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-17T04:57:52.426507] [INFO ] [MAIN ] Update Progress: 1327/2369 symbols completed. MEC took 29.7s. Estimated remaining: 2h 32m 9s. Rate: 6.8 symbols/min [2025-09-17T04:57:52.603799] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:57:52.628073] [DEBUG] [LOCAL ] MEI: Loaded 23284 existing records from primary storage. [2025-09-17T04:57:52.628308] [INFO ] [MAIN ] MEI: Loaded 23284 existing records. [2025-09-17T04:57:52.695305] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-17T04:57:52.814403] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:57:52.814701] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-17T04:57:52.814762] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-17T04:57:52.815454] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-17T04:57:52.815520] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-17T04:57:53.186454] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:57:53.255712] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T04:57:53.490153] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-17T04:57:54.171533] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T04:57:54.290137] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-17T04:57:54.606463] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T04:57:55.090139] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-17T04:57:55.634845] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T04:57:55.890141] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-11. [2025-09-17T04:57:56.092677] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T04:57:56.690154] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-11. [2025-09-17T04:57:57.185201] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T04:57:57.490128] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-17T04:57:57.686361] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T04:57:58.290160] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-17T04:57:58.865614] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T04:57:59.090124] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-17T04:57:59.425548] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T04:57:59.890117] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-17T04:58:00.344413] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T04:58:00.690195] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-17T04:58:01.207304] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T04:58:01.490213] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-17T04:58:01.568994] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T04:58:02.290165] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-17T04:58:02.585803] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T04:58:03.090160] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-17T04:58:03.412166] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T04:58:03.890173] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-17T04:58:04.104790] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T04:58:04.614930] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T04:58:04.690102] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-17T04:58:05.490116] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-17T04:58:05.679710] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T04:58:05.682392] [INFO ] [REMOTE ] MED: Full fetch complete (33208 records). [2025-09-17T04:58:05.682538] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-17T04:58:06.058083] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-17T04:58:06.058191] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-17T04:58:06.058865] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-17T04:58:06.058927] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-17T04:58:06.059730] [DEBUG] [LOCAL ] MED: Trimmed 33208 records to 21964 (keeping 200 days of data) [2025-09-17T04:58:06.189289] [DEBUG] [LOCAL ] MED: Primary data saved (21964 records). [2025-09-17T04:58:06.189453] [INFO ] [MAIN ] MED: Full history saved. [2025-09-17T04:58:06.189540] [INFO ] [MAIN ] Update Progress: 1328/2369 symbols completed. MED took 32.6s. Estimated remaining: 2h 32m 4s. Rate: 6.8 symbols/min [2025-09-17T04:58:06.295252] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-17T04:58:06.361479] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:58:06.407879] [DEBUG] [LOCAL ] MET: Loaded 39713 existing records from primary storage. [2025-09-17T04:58:06.408089] [INFO ] [MAIN ] MET: Loaded 39713 existing records. [2025-09-17T04:58:06.591425] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:58:06.591782] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-17T04:58:06.591845] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-17T04:58:06.592843] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-17T04:58:06.592905] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-17T04:58:06.956924] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:58:06.981462] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T04:58:07.090142] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-17T04:58:07.771241] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T04:58:07.890146] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-17T04:58:08.152482] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T04:58:08.690147] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-11. [2025-09-17T04:58:08.918739] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T04:58:09.490138] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-17T04:58:10.299562] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-17T04:58:10.318022] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T04:58:10.576120] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T04:58:11.090153] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-17T04:58:11.564760] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T04:58:11.890130] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-17T04:58:12.690136] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-17T04:58:12.897749] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T04:58:12.932056] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T04:58:13.490143] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-17T04:58:13.735957] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T04:58:14.290138] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-17T04:58:15.096240] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-17T04:58:15.098445] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T04:58:15.147306] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T04:58:15.890135] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-17T04:58:16.547892] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T04:58:16.690132] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-17T04:58:17.190515] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T04:58:17.490134] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-17T04:58:18.043626] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T04:58:18.048333] [INFO ] [REMOTE ] MEG: Full fetch complete (48203 records). [2025-09-17T04:58:18.048515] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-17T04:58:18.295297] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-17T04:58:18.443481] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-17T04:58:18.443593] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-17T04:58:18.444412] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-17T04:58:18.444476] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-17T04:58:18.445668] [DEBUG] [LOCAL ] MEG: Trimmed 48203 records to 32157 (keeping 200 days of data) [2025-09-17T04:58:18.651134] [DEBUG] [LOCAL ] MEG: Primary data saved (32157 records). [2025-09-17T04:58:18.651340] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-17T04:58:18.651462] [INFO ] [MAIN ] Update Progress: 1329/2369 symbols completed. MEG took 29.7s. Estimated remaining: 2h 31m 58s. Rate: 6.8 symbols/min [2025-09-17T04:58:18.852180] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:58:18.891141] [DEBUG] [LOCAL ] MFA: Loaded 33246 existing records from primary storage. [2025-09-17T04:58:18.891316] [INFO ] [MAIN ] MFA: Loaded 33246 existing records. [2025-09-17T04:58:19.076201] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:58:19.076583] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-17T04:58:19.076759] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-17T04:58:19.077905] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-17T04:58:19.077977] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-17T04:58:19.098710] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-17T04:58:19.275194] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T04:58:19.494807] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T04:58:19.520598] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:58:19.890137] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-11. [2025-09-17T04:58:20.306838] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T04:58:20.690132] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-17T04:58:21.156335] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T04:58:21.490113] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-17T04:58:21.829558] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T04:58:22.290122] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-17T04:58:23.090120] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-17T04:58:23.350776] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T04:58:23.431055] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T04:58:23.890197] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-17T04:58:24.600694] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T04:58:24.690200] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-17T04:58:25.091935] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T04:58:25.490209] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-17T04:58:26.016525] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T04:58:26.290147] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-17T04:58:27.025290] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T04:58:27.090088] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-17T04:58:27.442426] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T04:58:27.890185] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-17T04:58:28.588889] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T04:58:28.690138] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-17T04:58:29.490137] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-17T04:58:29.756251] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T04:58:30.295558] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-17T04:58:30.301041] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T04:58:30.453707] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T04:58:30.458398] [INFO ] [REMOTE ] MEI: Full fetch complete (45507 records). [2025-09-17T04:58:30.458528] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-17T04:58:30.834024] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-17T04:58:30.834149] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-17T04:58:30.834959] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-17T04:58:30.835090] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-17T04:58:30.836389] [DEBUG] [LOCAL ] MEI: Trimmed 45507 records to 32583 (keeping 200 days of data) [2025-09-17T04:58:31.036265] [DEBUG] [LOCAL ] MEI: Primary data saved (32583 records). [2025-09-17T04:58:31.036437] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-17T04:58:31.036534] [INFO ] [MAIN ] Update Progress: 1330/2369 symbols completed. MEI took 38.6s. Estimated remaining: 2h 31m 52s. Rate: 6.8 symbols/min [2025-09-17T04:58:31.098446] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-17T04:58:31.206784] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:58:31.211318] [DEBUG] [LOCAL ] MFAN: Loaded 3025 existing records from primary storage. [2025-09-17T04:58:31.211444] [INFO ] [MAIN ] MFAN: Loaded 3025 existing records. [2025-09-17T04:58:31.387573] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:58:31.387863] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-17T04:58:31.387922] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-17T04:58:31.388127] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-17T04:58:31.388184] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-17T04:58:31.751070] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:58:31.861789] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T04:58:31.890131] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-11. [2025-09-17T04:58:32.317180] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T04:58:32.690142] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-17T04:58:32.899456] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T04:58:33.107162] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-17T04:58:33.490119] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-17T04:58:34.098019] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T04:58:34.290150] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-17T04:58:35.090169] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-17T04:58:35.531175] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T04:58:35.890107] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-17T04:58:36.148992] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T04:58:36.557743] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T04:58:36.560443] [INFO ] [REMOTE ] MEGI: Full fetch complete (30670 records). [2025-09-17T04:58:36.560554] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-17T04:58:36.701818] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-17T04:58:36.936344] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-17T04:58:36.936449] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-17T04:58:36.937121] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-17T04:58:36.937188] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-17T04:58:36.937958] [DEBUG] [LOCAL ] MEGI: Trimmed 30670 records to 20381 (keeping 200 days of data) [2025-09-17T04:58:37.066276] [DEBUG] [LOCAL ] MEGI: Primary data saved (20381 records). [2025-09-17T04:58:37.066478] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-17T04:58:37.066616] [INFO ] [MAIN ] Update Progress: 1331/2369 symbols completed. MEGI took 46.0s. Estimated remaining: 2h 31m 41s. Rate: 6.8 symbols/min [2025-09-17T04:58:37.235911] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:58:37.240483] [DEBUG] [LOCAL ] MFAO: Loaded 2842 existing records from primary storage. [2025-09-17T04:58:37.240600] [INFO ] [MAIN ] MFAO: Loaded 2842 existing records. [2025-09-17T04:58:37.361634] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T04:58:37.426965] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:58:37.427191] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-17T04:58:37.427269] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-17T04:58:37.427527] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-17T04:58:37.427596] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-17T04:58:37.495205] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-17T04:58:37.782334] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:58:38.290222] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-17T04:58:39.090155] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-17T04:58:39.144047] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T04:58:39.706913] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T04:58:39.767803] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T04:58:39.890228] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-17T04:58:40.472752] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T04:58:40.690151] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-17T04:58:41.254213] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T04:58:41.490126] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-17T04:58:42.048737] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T04:58:42.290156] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-11. [2025-09-17T04:58:42.873079] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T04:58:43.090167] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-09-17T04:58:43.522242] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T04:58:43.890147] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-09-17T04:58:44.448977] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T04:58:44.690146] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-17T04:58:45.246229] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T04:58:45.490151] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-17T04:58:46.054214] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T04:58:46.055724] [INFO ] [REMOTE ] MFAN: Full fetch complete (5488 records). [2025-09-17T04:58:46.055846] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-17T04:58:46.295303] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-17T04:58:46.422706] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-17T04:58:46.422811] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-17T04:58:46.422984] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-17T04:58:46.423037] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-17T04:58:46.423471] [DEBUG] [LOCAL ] MFAN: Trimmed 5488 records to 4293 (keeping 200 days of data) [2025-09-17T04:58:46.449973] [DEBUG] [LOCAL ] MFAN: Primary data saved (4293 records). [2025-09-17T04:58:46.450066] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-17T04:58:46.450159] [INFO ] [MAIN ] Update Progress: 1332/2369 symbols completed. MFAN took 15.4s. Estimated remaining: 2h 31m 33s. Rate: 6.8 symbols/min [2025-09-17T04:58:46.626674] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:58:46.664731] [DEBUG] [LOCAL ] MFC: Loaded 37998 existing records from primary storage. [2025-09-17T04:58:46.664921] [INFO ] [MAIN ] MFC: Loaded 37998 existing records. [2025-09-17T04:58:46.843784] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:58:46.844081] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-17T04:58:46.844141] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-17T04:58:46.845111] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-17T04:58:46.845178] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-17T04:58:47.097266] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-17T04:58:47.207013] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:58:47.696330] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T04:58:47.890114] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-11. [2025-09-17T04:58:47.976507] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T04:58:48.690221] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-17T04:58:49.490136] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-17T04:58:49.659076] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T04:58:49.936666] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T04:58:50.290139] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-17T04:58:50.459720] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T04:58:50.711181] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T04:58:51.090179] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-09-17T04:58:51.890131] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-17T04:58:52.692695] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-17T04:58:52.698232] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T04:58:53.283925] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T04:58:53.490117] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-17T04:58:53.542148] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T04:58:53.548681] [INFO ] [REMOTE ] MET: Full fetch complete (76938 records). [2025-09-17T04:58:53.548857] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-17T04:58:53.957616] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-17T04:58:53.957796] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-17T04:58:53.958824] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-17T04:58:53.958884] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-17T04:58:53.960524] [DEBUG] [LOCAL ] MET: Trimmed 76938 records to 53314 (keeping 200 days of data) [2025-09-17T04:58:54.293743] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-17T04:58:54.304954] [DEBUG] [LOCAL ] MET: Primary data saved (53314 records). [2025-09-17T04:58:54.305227] [INFO ] [MAIN ] MET: Full history saved. [2025-09-17T04:58:54.305439] [INFO ] [MAIN ] Update Progress: 1333/2369 symbols completed. MET took 48.1s. Estimated remaining: 2h 31m 23s. Rate: 6.8 symbols/min [2025-09-17T04:58:54.493278] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:58:54.532976] [DEBUG] [LOCAL ] MFG: Loaded 36915 existing records from primary storage. [2025-09-17T04:58:54.533161] [INFO ] [MAIN ] MFG: Loaded 36915 existing records. [2025-09-17T04:58:54.719356] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:58:54.719609] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-17T04:58:54.719688] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-17T04:58:54.720956] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-17T04:58:54.721025] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-17T04:58:54.835311] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T04:58:55.095341] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-17T04:58:55.099519] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:58:55.197981] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T04:58:55.634591] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-17T04:58:55.890140] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-11. [2025-09-17T04:58:56.690181] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-17T04:58:57.376783] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T04:58:57.490194] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-17T04:58:58.028607] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T04:58:58.290118] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-09-17T04:58:58.425557] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T04:58:59.090174] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-17T04:58:59.687161] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T04:58:59.688238] [INFO ] [REMOTE ] MFAO: Full fetch complete (5332 records). [2025-09-17T04:58:59.688346] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-17T04:58:59.896134] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-17T04:59:00.062982] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-17T04:59:00.063127] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-17T04:59:00.063444] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-17T04:59:00.063679] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-17T04:59:00.064134] [DEBUG] [LOCAL ] MFAO: Trimmed 5332 records to 3844 (keeping 200 days of data) [2025-09-17T04:59:00.112780] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T04:59:00.128069] [DEBUG] [LOCAL ] MFAO: Primary data saved (3844 records). [2025-09-17T04:59:00.128590] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-17T04:59:00.128739] [INFO ] [MAIN ] Update Progress: 1334/2369 symbols completed. MFAO took 23.1s. Estimated remaining: 2h 31m 12s. Rate: 6.8 symbols/min [2025-09-17T04:59:00.300009] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:59:00.314349] [DEBUG] [LOCAL ] MFM: Loaded 9639 existing records from primary storage. [2025-09-17T04:59:00.314514] [INFO ] [MAIN ] MFM: Loaded 9639 existing records. [2025-09-17T04:59:00.496292] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:59:00.496587] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-17T04:59:00.496686] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-17T04:59:00.497110] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-17T04:59:00.497187] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-17T04:59:00.698449] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-09-17T04:59:00.870940] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:59:01.490166] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-11. [2025-09-17T04:59:01.568700] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T04:59:01.574533] [INFO ] [REMOTE ] MFA: Full fetch complete (64341 records). [2025-09-17T04:59:01.574699] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-17T04:59:01.948970] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T04:59:02.035010] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-17T04:59:02.035183] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-17T04:59:02.036431] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-17T04:59:02.036509] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-17T04:59:02.040364] [DEBUG] [LOCAL ] MFA: Trimmed 64341 records to 45125 (keeping 200 days of data) [2025-09-17T04:59:02.290321] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-09-17T04:59:02.348201] [DEBUG] [LOCAL ] MFA: Primary data saved (45125 records). [2025-09-17T04:59:02.348390] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-17T04:59:02.348675] [INFO ] [MAIN ] Update Progress: 1335/2369 symbols completed. MFA took 43.7s. Estimated remaining: 2h 30m 59s. Rate: 6.8 symbols/min [2025-09-17T04:59:02.472798] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T04:59:02.551287] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:59:02.551496] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-17T04:59:02.551546] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-17T04:59:02.551683] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-17T04:59:02.551750] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-17T04:59:02.551803] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-17T04:59:02.551844] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-17T04:59:02.912018] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:59:03.090114] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-11. [2025-09-17T04:59:03.206798] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T04:59:03.290607] [DEBUG] [REMOTE ] MFSB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:59:03.291056] [WARN ] [REMOTE ] MFSB: No data returned for month 2024-11 [2025-09-17T04:59:03.890166] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-17T04:59:04.216308] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-17T04:59:04.690138] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-17T04:59:04.993021] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.30 seconds). [2025-09-17T04:59:05.490134] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-09-17T04:59:06.230061] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T04:59:06.290157] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-17T04:59:07.090202] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-17T04:59:07.795114] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T04:59:07.890092] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-17T04:59:07.931459] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T04:59:08.690131] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-17T04:59:09.238171] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T04:59:09.490108] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-17T04:59:09.737458] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-17T04:59:10.290178] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-17T04:59:10.338835] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T04:59:10.596624] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-17T04:59:11.090135] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-17T04:59:11.890181] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-17T04:59:12.456745] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T04:59:12.690113] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-17T04:59:12.796760] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T04:59:12.927623] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-09-17T04:59:13.490136] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-17T04:59:13.747111] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-17T04:59:14.290153] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-17T04:59:15.090139] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-17T04:59:15.422790] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-17T04:59:15.437164] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T04:59:15.890185] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-17T04:59:16.229424] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-17T04:59:16.690179] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-17T04:59:17.490177] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-17T04:59:17.951873] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T04:59:18.290190] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-17T04:59:18.366028] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T04:59:19.090155] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-17T04:59:19.183394] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T04:59:19.890172] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-17T04:59:20.442013] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T04:59:20.443167] [INFO ] [REMOTE ] MFSB: Full fetch complete (1401 records). [2025-09-17T04:59:20.443263] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-17T04:59:20.630747] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 176 unique days, need 200 days [2025-09-17T04:59:20.631050] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:59:20.631158] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:59:20.631216] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-17T04:59:20.631318] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-17T04:59:20.631373] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-17T04:59:20.631446] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-17T04:59:20.631549] [INFO ] [MAIN ] Update Progress: 1336/2369 symbols completed. MFSB took 18.3s. Estimated remaining: 2h 30m 57s. Rate: 6.8 symbols/min [2025-09-17T04:59:20.695310] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-17T04:59:20.803763] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:59:20.837598] [DEBUG] [LOCAL ] MFSG: Loaded 3995 existing records from primary storage. [2025-09-17T04:59:20.838987] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T04:59:20.849300] [INFO ] [MAIN ] MFSG: Loaded 3995 existing records. [2025-09-17T04:59:21.026969] [WARN ] [MAIN ] MFSG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:59:21.027245] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-17T04:59:21.027306] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-17T04:59:21.027555] [DEBUG] [LOCAL ] MFSG: Deleted primary data file. [2025-09-17T04:59:21.027607] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-17T04:59:21.377834] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:59:21.490100] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-11. [2025-09-17T04:59:21.745507] [DEBUG] [REMOTE ] MFSG: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:59:21.745959] [WARN ] [REMOTE ] MFSG: No data returned for month 2024-11 [2025-09-17T04:59:22.290195] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-09-17T04:59:22.669857] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T04:59:22.704944] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-17T04:59:23.090192] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-09-17T04:59:23.515059] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T04:59:23.890202] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-17T04:59:24.690152] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-17T04:59:24.819217] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T04:59:25.490113] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-17T04:59:25.906708] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T04:59:26.180511] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T04:59:26.290111] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-17T04:59:26.722258] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-17T04:59:27.090172] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-17T04:59:27.890136] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-17T04:59:28.690169] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-17T04:59:28.792594] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T04:59:29.021197] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T04:59:29.490144] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-17T04:59:29.670502] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T04:59:30.290130] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-17T04:59:30.893483] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T04:59:30.986963] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T04:59:31.090106] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-17T04:59:31.890140] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-17T04:59:32.690161] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-17T04:59:32.763106] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T04:59:33.223072] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T04:59:33.490144] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-17T04:59:33.711991] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T04:59:34.290195] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-17T04:59:35.026873] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T04:59:35.090083] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-17T04:59:35.181749] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T04:59:35.709139] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T04:59:35.711464] [INFO ] [REMOTE ] MFM: Full fetch complete (18964 records). [2025-09-17T04:59:35.711572] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-17T04:59:35.902595] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-17T04:59:36.112940] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-17T04:59:36.113117] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-17T04:59:36.113762] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-17T04:59:36.113825] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-17T04:59:36.114948] [DEBUG] [LOCAL ] MFM: Trimmed 18964 records to 14329 (keeping 200 days of data) [2025-09-17T04:59:36.202352] [DEBUG] [LOCAL ] MFM: Primary data saved (14329 records). [2025-09-17T04:59:36.202538] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-17T04:59:36.202663] [INFO ] [MAIN ] Update Progress: 1337/2369 symbols completed. MFM took 36.1s. Estimated remaining: 2h 30m 54s. Rate: 6.8 symbols/min [2025-09-17T04:59:36.372520] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:59:36.383178] [DEBUG] [LOCAL ] MFSI: Loaded 9004 existing records from primary storage. [2025-09-17T04:59:36.383334] [INFO ] [MAIN ] MFSI: Loaded 9004 existing records. [2025-09-17T04:59:36.565855] [WARN ] [MAIN ] MFSI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:59:36.566143] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-17T04:59:36.566218] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-17T04:59:36.566724] [DEBUG] [LOCAL ] MFSI: Deleted primary data file. [2025-09-17T04:59:36.566787] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-17T04:59:36.695353] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-17T04:59:36.933831] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:59:37.490141] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-17T04:59:37.592850] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T04:59:37.599449] [INFO ] [REMOTE ] MFC: Full fetch complete (74201 records). [2025-09-17T04:59:37.599700] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-17T04:59:37.909856] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T04:59:38.003201] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-17T04:59:38.003356] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-17T04:59:38.004476] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-17T04:59:38.004677] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-17T04:59:38.006796] [DEBUG] [LOCAL ] MFC: Trimmed 74201 records to 51421 (keeping 200 days of data) [2025-09-17T04:59:38.139227] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T04:59:38.290299] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-17T04:59:38.383691] [DEBUG] [LOCAL ] MFC: Primary data saved (51421 records). [2025-09-17T04:59:38.383910] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-17T04:59:38.384093] [INFO ] [MAIN ] Update Progress: 1338/2369 symbols completed. MFC took 51.9s. Estimated remaining: 2h 30m 40s. Rate: 6.8 symbols/min [2025-09-17T04:59:38.554137] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:59:38.557737] [DEBUG] [LOCAL ] MFSV: Loaded 1713 existing records from primary storage. [2025-09-17T04:59:38.557828] [INFO ] [MAIN ] MFSV: Loaded 1713 existing records. [2025-09-17T04:59:38.738192] [WARN ] [MAIN ] MFSV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:59:38.738486] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-17T04:59:38.738541] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-17T04:59:38.738803] [DEBUG] [LOCAL ] MFSV: Deleted primary data file. [2025-09-17T04:59:38.738870] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-17T04:59:39.093182] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-11. [2025-09-17T04:59:39.120228] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:59:39.322628] [DEBUG] [REMOTE ] MFSI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:59:39.322983] [WARN ] [REMOTE ] MFSI: No data returned for month 2024-11 [2025-09-17T04:59:39.881601] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T04:59:39.893399] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-11. [2025-09-17T04:59:39.894893] [INFO ] [REMOTE ] MFG: Full fetch complete (68220 records). [2025-09-17T04:59:39.895132] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-17T04:59:40.172431] [DEBUG] [REMOTE ] MFSV: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T04:59:40.208798] [WARN ] [REMOTE ] MFSV: No data returned for month 2024-11 [2025-09-17T04:59:40.309504] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-17T04:59:40.309707] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-17T04:59:40.311328] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-17T04:59:40.311416] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-17T04:59:40.313539] [DEBUG] [LOCAL ] MFG: Trimmed 68220 records to 48915 (keeping 200 days of data) [2025-09-17T04:59:40.624152] [DEBUG] [LOCAL ] MFG: Primary data saved (48915 records). [2025-09-17T04:59:40.624405] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-17T04:59:40.624536] [INFO ] [MAIN ] Update Progress: 1339/2369 symbols completed. MFG took 46.3s. Estimated remaining: 2h 30m 26s. Rate: 6.8 symbols/min [2025-09-17T04:59:40.695411] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-09-17T04:59:40.807100] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:59:40.820676] [DEBUG] [LOCAL ] MG: Loaded 11519 existing records from primary storage. [2025-09-17T04:59:40.820905] [INFO ] [MAIN ] MG: Loaded 11519 existing records. [2025-09-17T04:59:41.013501] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:59:41.013864] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-17T04:59:41.013936] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-17T04:59:41.014554] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-17T04:59:41.014628] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-17T04:59:41.314423] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T04:59:41.391575] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:59:41.490142] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-09-17T04:59:41.889573] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-17T04:59:42.290198] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-11. [2025-09-17T04:59:43.090159] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-17T04:59:43.346461] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T04:59:43.686784] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T04:59:43.890188] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-09-17T04:59:44.219715] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-17T04:59:44.690339] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-17T04:59:45.297795] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T04:59:45.490117] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-17T04:59:46.264728] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T04:59:46.266343] [INFO ] [REMOTE ] MFSG: Full fetch complete (5465 records). [2025-09-17T04:59:46.266438] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-17T04:59:46.296805] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-17T04:59:46.460308] [WARN ] [VALIDATOR ] MFSG: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-17T04:59:46.460594] [FATAL] [MAIN ] MFSG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T04:59:46.460695] [WARN ] [MAIN ] MFSG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T04:59:46.460763] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-17T04:59:46.460883] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-17T04:59:46.460952] [INFO ] [LOCAL ] MFSG: Starting deletion of derivative data. [2025-09-17T04:59:46.461370] [DEBUG] [LOCAL ] MFSG: Deleted derivative data file. [2025-09-17T04:59:46.461496] [INFO ] [MAIN ] Update Progress: 1340/2369 symbols completed. MFSG took 25.8s. Estimated remaining: 2h 30m 15s. Rate: 6.8 symbols/min [2025-09-17T04:59:46.633143] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T04:59:46.667579] [DEBUG] [LOCAL ] MGA: Loaded 37416 existing records from primary storage. [2025-09-17T04:59:46.667780] [INFO ] [MAIN ] MGA: Loaded 37416 existing records. [2025-09-17T04:59:46.772825] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T04:59:46.850917] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T04:59:46.851180] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-17T04:59:46.851265] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-17T04:59:46.852274] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-17T04:59:46.852346] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-17T04:59:47.095281] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-17T04:59:47.220935] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T04:59:47.649053] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T04:59:47.890197] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-09-17T04:59:48.690185] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-11. [2025-09-17T04:59:48.885153] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T04:59:49.490336] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-17T04:59:50.032873] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T04:59:50.187827] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T04:59:50.290116] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-09-17T04:59:51.090137] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-09-17T04:59:51.890104] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-17T04:59:51.997278] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T04:59:52.042428] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T04:59:52.590434] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T04:59:52.690173] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-17T04:59:53.181837] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-17T04:59:53.490115] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-17T04:59:54.296666] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-17T04:59:54.297779] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T04:59:55.090146] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-17T04:59:55.508103] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T04:59:55.890130] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-17T04:59:56.001468] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T04:59:56.690110] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-17T04:59:56.944118] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T04:59:57.490175] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-17T04:59:57.980580] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T04:59:58.295185] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-17T04:59:58.311860] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T04:59:58.723723] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T04:59:59.090149] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-17T04:59:59.890190] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-17T05:00:00.152580] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T05:00:00.616537] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T05:00:00.690231] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-17T05:00:01.497465] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-17T05:00:01.498775] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T05:00:02.252197] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T05:00:02.290236] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-17T05:00:03.090179] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-17T05:00:03.890195] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-17T05:00:04.548447] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-17T05:00:04.690130] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-17T05:00:05.327347] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T05:00:05.490142] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-17T05:00:05.681451] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (2.59 seconds). [2025-09-17T05:00:05.715463] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T05:00:06.137579] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T05:00:06.138856] [INFO ] [REMOTE ] MFSV: Full fetch complete (2759 records). [2025-09-17T05:00:06.138957] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-17T05:00:06.297608] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-17T05:00:06.327400] [WARN ] [VALIDATOR ] MFSV: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-17T05:00:06.327615] [FATAL] [MAIN ] MFSV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:00:06.327708] [WARN ] [MAIN ] MFSV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:00:06.327775] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-17T05:00:06.327858] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-17T05:00:06.327922] [INFO ] [LOCAL ] MFSV: Starting deletion of derivative data. [2025-09-17T05:00:06.328177] [DEBUG] [LOCAL ] MFSV: Deleted derivative data file. [2025-09-17T05:00:06.328297] [INFO ] [MAIN ] Update Progress: 1341/2369 symbols completed. MFSV took 27.9s. Estimated remaining: 2h 30m 15s. Rate: 6.8 symbols/min [2025-09-17T05:00:06.501902] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:00:06.507052] [DEBUG] [LOCAL ] MGF: Loaded 3182 existing records from primary storage. [2025-09-17T05:00:06.507170] [INFO ] [MAIN ] MGF: Loaded 3182 existing records. [2025-09-17T05:00:06.686920] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:00:06.687200] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-17T05:00:06.687275] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-17T05:00:06.687591] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-17T05:00:06.687694] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-17T05:00:07.050169] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:00:07.090088] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-11. [2025-09-17T05:00:07.406169] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T05:00:07.703500] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T05:00:07.890168] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-17T05:00:08.690138] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-09-17T05:00:08.933285] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T05:00:09.064621] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-17T05:00:09.490140] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-09-17T05:00:10.122932] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T05:00:10.290162] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-17T05:00:11.090207] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-17T05:00:11.890187] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-17T05:00:12.018613] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T05:00:12.191434] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T05:00:12.499102] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T05:00:12.690137] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-17T05:00:13.490118] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-17T05:00:13.537442] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T05:00:13.816728] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T05:00:14.290144] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-17T05:00:14.859544] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T05:00:15.090145] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-17T05:00:15.890127] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-17T05:00:16.417454] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T05:00:16.419871] [INFO ] [REMOTE ] MFSI: Full fetch complete (12417 records). [2025-09-17T05:00:16.419970] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-17T05:00:16.600653] [WARN ] [VALIDATOR ] MFSI: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-17T05:00:16.600962] [FATAL] [MAIN ] MFSI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:00:16.601022] [WARN ] [MAIN ] MFSI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:00:16.601079] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-17T05:00:16.601156] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-17T05:00:16.601202] [INFO ] [LOCAL ] MFSI: Starting deletion of derivative data. [2025-09-17T05:00:16.601477] [DEBUG] [LOCAL ] MFSI: Deleted derivative data file. [2025-09-17T05:00:16.601583] [INFO ] [MAIN ] Update Progress: 1342/2369 symbols completed. MFSI took 40.4s. Estimated remaining: 2h 30m 7s. Rate: 6.8 symbols/min [2025-09-17T05:00:16.697849] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-17T05:00:16.772602] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:00:16.814324] [DEBUG] [LOCAL ] MGM: Loaded 39964 existing records from primary storage. [2025-09-17T05:00:16.814507] [INFO ] [MAIN ] MGM: Loaded 39964 existing records. [2025-09-17T05:00:16.992163] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:00:16.992455] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-17T05:00:16.992533] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-17T05:00:16.993558] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-17T05:00:16.993638] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-17T05:00:17.351912] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:00:17.490098] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-17T05:00:17.647696] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T05:00:18.213219] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T05:00:18.215302] [INFO ] [REMOTE ] MG: Full fetch complete (23953 records). [2025-09-17T05:00:18.215392] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-17T05:00:18.295214] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-17T05:00:18.613544] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-17T05:00:18.613770] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-17T05:00:18.614668] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-17T05:00:18.614863] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-17T05:00:18.616056] [DEBUG] [LOCAL ] MG: Trimmed 23953 records to 16874 (keeping 200 days of data) [2025-09-17T05:00:18.739195] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-17T05:00:18.777071] [DEBUG] [LOCAL ] MG: Primary data saved (16874 records). [2025-09-17T05:00:18.777289] [INFO ] [MAIN ] MG: Full history saved. [2025-09-17T05:00:18.777436] [INFO ] [MAIN ] Update Progress: 1343/2369 symbols completed. MG took 38.2s. Estimated remaining: 2h 29m 53s. Rate: 6.8 symbols/min [2025-09-17T05:00:18.951959] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:00:18.958538] [DEBUG] [LOCAL ] MGR: Loaded 4160 existing records from primary storage. [2025-09-17T05:00:18.958711] [INFO ] [MAIN ] MGR: Loaded 4160 existing records. [2025-09-17T05:00:19.096901] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-17T05:00:19.121418] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T05:00:19.146966] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:00:19.147724] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-17T05:00:19.147807] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-17T05:00:19.148164] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-17T05:00:19.148241] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-17T05:00:19.504146] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:00:19.890121] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-11. [2025-09-17T05:00:20.371620] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T05:00:20.690095] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-09-17T05:00:20.785491] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T05:00:21.160866] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T05:00:21.490128] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-09-17T05:00:21.925393] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T05:00:22.290172] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-17T05:00:22.767196] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T05:00:23.090171] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-17T05:00:23.689745] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T05:00:23.890129] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-17T05:00:24.690168] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-17T05:00:25.361153] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T05:00:25.362836] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T05:00:25.490110] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-17T05:00:26.084404] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T05:00:26.290185] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-17T05:00:27.090227] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-11. [2025-09-17T05:00:27.890107] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-17T05:00:27.932948] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T05:00:28.621619] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T05:00:28.690140] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-17T05:00:29.212716] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-17T05:00:29.464019] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T05:00:29.465204] [INFO ] [REMOTE ] MGF: Full fetch complete (6060 records). [2025-09-17T05:00:29.465289] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-17T05:00:29.495270] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-09-17T05:00:29.844998] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-17T05:00:29.845109] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-17T05:00:29.845290] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-17T05:00:29.845342] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-17T05:00:29.845802] [DEBUG] [LOCAL ] MGF: Trimmed 6060 records to 4163 (keeping 200 days of data) [2025-09-17T05:00:29.870437] [DEBUG] [LOCAL ] MGF: Primary data saved (4163 records). [2025-09-17T05:00:29.870580] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-17T05:00:29.870710] [INFO ] [MAIN ] Update Progress: 1344/2369 symbols completed. MGF took 23.5s. Estimated remaining: 2h 29m 46s. Rate: 6.8 symbols/min [2025-09-17T05:00:30.042932] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:00:30.047884] [DEBUG] [LOCAL ] MGRB: Loaded 3049 existing records from primary storage. [2025-09-17T05:00:30.048006] [INFO ] [MAIN ] MGRB: Loaded 3049 existing records. [2025-09-17T05:00:30.235735] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:00:30.236008] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-17T05:00:30.236059] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-17T05:00:30.236400] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-17T05:00:30.236456] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-17T05:00:30.299877] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-17T05:00:30.603388] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:00:31.090269] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-11. [2025-09-17T05:00:31.638766] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T05:00:31.641271] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-17T05:00:31.695265] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T05:00:31.701725] [INFO ] [REMOTE ] MGA: Full fetch complete (73549 records). [2025-09-17T05:00:31.701918] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-17T05:00:31.900216] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-17T05:00:32.101693] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-17T05:00:32.101865] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-17T05:00:32.102885] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-17T05:00:32.102956] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-17T05:00:32.104533] [DEBUG] [LOCAL ] MGA: Trimmed 73549 records to 50680 (keeping 200 days of data) [2025-09-17T05:00:32.415234] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T05:00:32.432503] [DEBUG] [LOCAL ] MGA: Primary data saved (50680 records). [2025-09-17T05:00:32.432689] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-17T05:00:32.432796] [INFO ] [MAIN ] Update Progress: 1345/2369 symbols completed. MGA took 46.0s. Estimated remaining: 2h 29m 33s. Rate: 6.8 symbols/min [2025-09-17T05:00:32.607633] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:00:32.611379] [DEBUG] [LOCAL ] MGRD: Loaded 1647 existing records from primary storage. [2025-09-17T05:00:32.611490] [INFO ] [MAIN ] MGRD: Loaded 1647 existing records. [2025-09-17T05:00:32.695276] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-09-17T05:00:32.794617] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:00:32.794961] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-17T05:00:32.795026] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-17T05:00:32.795254] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-17T05:00:32.795314] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-17T05:00:33.164036] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:00:33.472943] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T05:00:33.490149] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-09-17T05:00:34.119482] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T05:00:34.290227] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-11. [2025-09-17T05:00:34.723624] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T05:00:35.090143] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-09-17T05:00:35.890139] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-09-17T05:00:36.352927] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T05:00:36.690161] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-17T05:00:37.032673] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T05:00:37.247787] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T05:00:37.490213] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-09-17T05:00:38.012320] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T05:00:38.290146] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-17T05:00:39.090157] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-17T05:00:39.694791] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T05:00:39.890117] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-17T05:00:40.007334] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T05:00:40.443048] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T05:00:40.690134] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-17T05:00:41.363182] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T05:00:41.490127] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-17T05:00:42.166958] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T05:00:42.290132] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-17T05:00:42.994529] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T05:00:43.090115] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-17T05:00:43.669480] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T05:00:43.890123] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-17T05:00:44.473201] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T05:00:44.478001] [INFO ] [REMOTE ] MGR: Full fetch complete (8482 records). [2025-09-17T05:00:44.478111] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-17T05:00:44.695215] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-17T05:00:44.840541] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-17T05:00:44.840674] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-17T05:00:44.840964] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-17T05:00:44.841018] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-17T05:00:44.841465] [DEBUG] [LOCAL ] MGR: Trimmed 8482 records to 5661 (keeping 200 days of data) [2025-09-17T05:00:44.876319] [DEBUG] [LOCAL ] MGR: Primary data saved (5661 records). [2025-09-17T05:00:44.876465] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-17T05:00:44.876556] [INFO ] [MAIN ] Update Progress: 1346/2369 symbols completed. MGR took 26.1s. Estimated remaining: 2h 29m 27s. Rate: 6.8 symbols/min [2025-09-17T05:00:45.047266] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:00:45.054433] [DEBUG] [LOCAL ] MGRE: Loaded 4916 existing records from primary storage. [2025-09-17T05:00:45.054585] [INFO ] [MAIN ] MGRE: Loaded 4916 existing records. [2025-09-17T05:00:45.232442] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:00:45.232702] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-17T05:00:45.232764] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-17T05:00:45.233069] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-17T05:00:45.233129] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-17T05:00:45.490398] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-17T05:00:45.523798] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T05:00:45.605327] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:00:46.030850] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T05:00:46.290132] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-17T05:00:46.856696] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T05:00:47.090147] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-17T05:00:47.890199] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-17T05:00:48.436858] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T05:00:48.690136] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-17T05:00:49.034563] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T05:00:49.053111] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T05:00:49.490141] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-17T05:00:50.290139] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-17T05:00:50.852424] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T05:00:51.090144] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-17T05:00:51.347975] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T05:00:51.505510] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T05:00:51.506415] [INFO ] [REMOTE ] MGRB: Full fetch complete (6369 records). [2025-09-17T05:00:51.506503] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-17T05:00:51.878964] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-17T05:00:51.879079] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-17T05:00:51.879271] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-17T05:00:51.879324] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-17T05:00:51.879799] [DEBUG] [LOCAL ] MGRB: Trimmed 6369 records to 4128 (keeping 200 days of data) [2025-09-17T05:00:51.892889] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-17T05:00:51.907428] [DEBUG] [LOCAL ] MGRB: Primary data saved (4128 records). [2025-09-17T05:00:51.907542] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-17T05:00:51.907658] [INFO ] [MAIN ] Update Progress: 1347/2369 symbols completed. MGRB took 22.0s. Estimated remaining: 2h 29m 17s. Rate: 6.8 symbols/min [2025-09-17T05:00:52.077731] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:00:52.113568] [DEBUG] [LOCAL ] MGY: Loaded 39012 existing records from primary storage. [2025-09-17T05:00:52.113762] [INFO ] [MAIN ] MGY: Loaded 39012 existing records. [2025-09-17T05:00:52.298881] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:00:52.299166] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-17T05:00:52.299234] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-17T05:00:52.300535] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-17T05:00:52.300600] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-17T05:00:52.404222] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T05:00:52.657864] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:00:52.690082] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-11. [2025-09-17T05:00:53.490167] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-17T05:00:54.290119] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-11. [2025-09-17T05:00:54.394605] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T05:00:54.848519] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T05:00:55.090182] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-09-17T05:00:55.460020] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T05:00:55.560599] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T05:00:55.890136] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-09-17T05:00:56.576688] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T05:00:56.690129] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-17T05:00:57.306852] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T05:00:57.490159] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-17T05:00:58.077447] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T05:00:58.290134] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-17T05:00:58.749795] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T05:00:59.090142] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-17T05:00:59.890135] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-17T05:01:00.690121] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-09-17T05:01:00.701431] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T05:01:01.060804] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T05:01:01.490182] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-17T05:01:02.290215] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-17T05:01:02.330754] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T05:01:02.901498] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T05:01:03.090159] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-09-17T05:01:03.599949] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T05:01:03.890218] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-17T05:01:04.595173] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T05:01:04.690185] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-17T05:01:04.764892] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T05:01:05.490203] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-17T05:01:06.290168] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-17T05:01:06.376237] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T05:01:06.645802] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T05:01:06.720852] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T05:01:07.090144] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-17T05:01:07.795953] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T05:01:07.890152] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-17T05:01:08.690156] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-17T05:01:09.135697] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T05:01:09.490128] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-17T05:01:09.681137] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T05:01:09.687750] [INFO ] [REMOTE ] MGM: Full fetch complete (77443 records). [2025-09-17T05:01:09.687930] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-17T05:01:09.869170] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T05:01:10.094268] [DEBUG] [VALIDATOR ] MGM: All expected trading days are present. [2025-09-17T05:01:10.094397] [DEBUG] [VALIDATOR ] MGM: Primary data validation passed. [2025-09-17T05:01:10.095525] [INFO ] [MAIN ] MGM: Fetched primary data is valid. [2025-09-17T05:01:10.095592] [DEBUG] [LOCAL ] MGM: Saving primary data. [2025-09-17T05:01:10.097394] [DEBUG] [LOCAL ] MGM: Trimmed 77443 records to 53610 (keeping 200 days of data) [2025-09-17T05:01:10.310375] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-17T05:01:10.438483] [DEBUG] [LOCAL ] MGM: Primary data saved (53610 records). [2025-09-17T05:01:10.438793] [INFO ] [MAIN ] MGM: Full history saved. [2025-09-17T05:01:10.438951] [INFO ] [MAIN ] Update Progress: 1348/2369 symbols completed. MGM took 53.8s. Estimated remaining: 2h 29m 15s. Rate: 6.8 symbols/min [2025-09-17T05:01:10.625392] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:01:10.625791] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-17T05:01:10.625843] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-17T05:01:10.625982] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-17T05:01:10.626041] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-17T05:01:10.626095] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-17T05:01:10.626143] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-17T05:01:11.001575] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:01:11.090190] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-17T05:01:11.526438] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T05:01:11.528194] [INFO ] [REMOTE ] MGRD: Full fetch complete (3542 records). [2025-09-17T05:01:11.528285] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-17T05:01:11.893113] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-17T05:01:11.900295] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-17T05:01:11.900404] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-17T05:01:11.900687] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-17T05:01:11.900807] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-17T05:01:11.901448] [DEBUG] [LOCAL ] MGRD: Trimmed 3542 records to 2313 (keeping 200 days of data) [2025-09-17T05:01:11.916869] [DEBUG] [LOCAL ] MGRD: Primary data saved (2313 records). [2025-09-17T05:01:11.917394] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-17T05:01:11.917493] [INFO ] [MAIN ] Update Progress: 1349/2369 symbols completed. MGRD took 39.5s. Estimated remaining: 2h 29m 1s. Rate: 6.8 symbols/min [2025-09-17T05:01:12.097117] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:01:12.130625] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T05:01:12.146017] [DEBUG] [LOCAL ] MHD: Loaded 8795 existing records from primary storage. [2025-09-17T05:01:12.146169] [INFO ] [MAIN ] MHD: Loaded 8795 existing records. [2025-09-17T05:01:12.325678] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:01:12.325964] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-17T05:01:12.326208] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-17T05:01:12.326556] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-17T05:01:12.326614] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-17T05:01:12.687682] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:01:12.692459] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-11. [2025-09-17T05:01:12.694922] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T05:01:12.905085] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:01:12.905435] [WARN ] [REMOTE ] MH: No data returned for month 2024-11 [2025-09-17T05:01:13.490138] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-17T05:01:14.234401] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T05:01:14.235892] [INFO ] [REMOTE ] MGRE: Full fetch complete (9357 records). [2025-09-17T05:01:14.236033] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-17T05:01:14.295471] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-11. [2025-09-17T05:01:14.624180] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-17T05:01:14.624301] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-17T05:01:14.624636] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-17T05:01:14.624745] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-17T05:01:14.625381] [DEBUG] [LOCAL ] MGRE: Trimmed 9357 records to 6530 (keeping 200 days of data) [2025-09-17T05:01:14.671955] [DEBUG] [LOCAL ] MGRE: Primary data saved (6530 records). [2025-09-17T05:01:14.672168] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-17T05:01:14.672297] [INFO ] [MAIN ] Update Progress: 1350/2369 symbols completed. MGRE took 29.8s. Estimated remaining: 2h 28m 48s. Rate: 6.8 symbols/min [2025-09-17T05:01:14.864500] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:01:14.873701] [DEBUG] [LOCAL ] MHF: Loaded 6905 existing records from primary storage. [2025-09-17T05:01:14.873877] [INFO ] [MAIN ] MHF: Loaded 6905 existing records. [2025-09-17T05:01:15.066158] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:01:15.066423] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-17T05:01:15.066483] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-17T05:01:15.066843] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-17T05:01:15.066906] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-17T05:01:15.098358] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-17T05:01:15.439236] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T05:01:15.443391] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:01:15.890133] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-09-17T05:01:16.690130] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-17T05:01:16.875316] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:01:16.875702] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-17T05:01:16.917357] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T05:01:16.942145] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T05:01:17.490125] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-17T05:01:18.202625] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T05:01:18.290125] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-17T05:01:19.090135] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-17T05:01:19.161459] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T05:01:19.890132] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-09-17T05:01:20.088548] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:01:20.088989] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-09-17T05:01:20.690199] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-11. [2025-09-17T05:01:20.776360] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T05:01:21.057495] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T05:01:21.490158] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-09-17T05:01:22.246904] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T05:01:22.290123] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-17T05:01:22.831317] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T05:01:23.090176] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-17T05:01:23.890144] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-17T05:01:23.911558] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T05:01:24.449816] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T05:01:24.690172] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-17T05:01:25.490199] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-17T05:01:25.686189] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:01:25.686681] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-17T05:01:26.290104] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-17T05:01:26.371805] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T05:01:27.090159] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-17T05:01:27.216824] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T05:01:27.890146] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-17T05:01:28.666925] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T05:01:28.690099] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-17T05:01:29.041116] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T05:01:29.452384] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T05:01:29.490081] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-17T05:01:30.173450] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T05:01:30.290121] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-17T05:01:31.090141] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-17T05:01:31.886124] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T05:01:31.890062] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-17T05:01:32.114953] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T05:01:32.690127] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-17T05:01:32.835168] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T05:01:32.887145] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:01:32.887771] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-17T05:01:33.490155] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-17T05:01:34.290136] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-17T05:01:34.327950] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T05:01:34.930961] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T05:01:35.090150] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-17T05:01:35.890147] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-17T05:01:35.927459] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T05:01:36.690174] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-17T05:01:37.433400] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T05:01:37.490183] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-17T05:01:37.535855] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T05:01:37.542453] [INFO ] [REMOTE ] MGY: Full fetch complete (75312 records). [2025-09-17T05:01:37.542705] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-17T05:01:37.688326] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:01:37.723153] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-17T05:01:37.937259] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-17T05:01:37.937359] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-17T05:01:37.938335] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-17T05:01:37.938394] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-17T05:01:37.939843] [DEBUG] [LOCAL ] MGY: Trimmed 75312 records to 52438 (keeping 200 days of data) [2025-09-17T05:01:38.262928] [DEBUG] [LOCAL ] MGY: Primary data saved (52438 records). [2025-09-17T05:01:38.263114] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-17T05:01:38.263224] [INFO ] [MAIN ] Update Progress: 1351/2369 symbols completed. MGY took 46.4s. Estimated remaining: 2h 28m 50s. Rate: 6.8 symbols/min [2025-09-17T05:01:38.295274] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-17T05:01:38.434248] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:01:38.465127] [DEBUG] [LOCAL ] MHK: Loaded 31599 existing records from primary storage. [2025-09-17T05:01:38.465289] [INFO ] [MAIN ] MHK: Loaded 31599 existing records. [2025-09-17T05:01:38.567835] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:01:38.589461] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-17T05:01:38.650289] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:01:38.650526] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-17T05:01:38.650586] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-17T05:01:38.651339] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-17T05:01:38.651402] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-17T05:01:39.014698] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:01:39.090110] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-11. [2025-09-17T05:01:39.890188] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-17T05:01:40.587585] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T05:01:40.669439] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T05:01:40.690093] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-17T05:01:40.871689] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:01:40.872050] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-17T05:01:41.490192] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-09-17T05:01:42.290226] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-17T05:01:43.043457] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T05:01:43.090169] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-17T05:01:43.211912] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T05:01:43.216135] [INFO ] [REMOTE ] MHD: Full fetch complete (18744 records). [2025-09-17T05:01:43.216282] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-17T05:01:43.593110] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-17T05:01:43.593264] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-17T05:01:43.593867] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-17T05:01:43.593955] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-17T05:01:43.594636] [DEBUG] [LOCAL ] MHD: Trimmed 18744 records to 12270 (keeping 200 days of data) [2025-09-17T05:01:43.673100] [DEBUG] [LOCAL ] MHD: Primary data saved (12270 records). [2025-09-17T05:01:43.673265] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-17T05:01:43.673374] [INFO ] [MAIN ] Update Progress: 1352/2369 symbols completed. MHD took 31.8s. Estimated remaining: 2h 28m 39s. Rate: 6.8 symbols/min [2025-09-17T05:01:43.847965] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:01:43.848186] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-17T05:01:43.848231] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-17T05:01:43.848338] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-17T05:01:43.848392] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-17T05:01:43.848446] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-17T05:01:43.848494] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-17T05:01:43.892016] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-17T05:01:44.019754] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T05:01:44.246623] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:01:44.690187] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-17T05:01:45.447859] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T05:01:45.490175] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-17T05:01:46.259728] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T05:01:46.290129] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-17T05:01:46.998476] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T05:01:47.090100] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-17T05:01:47.533586] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T05:01:47.537806] [INFO ] [REMOTE ] MH: Full fetch complete (10717 records). [2025-09-17T05:01:47.537895] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-17T05:01:47.723699] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 38 unique days, need 200 days [2025-09-17T05:01:47.724005] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:01:47.724069] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:01:47.724142] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-17T05:01:47.724212] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-17T05:01:47.724273] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-17T05:01:47.724324] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-17T05:01:47.724458] [INFO ] [MAIN ] Update Progress: 1353/2369 symbols completed. MH took 37.3s. Estimated remaining: 2h 28m 27s. Rate: 6.8 symbols/min [2025-09-17T05:01:47.893006] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:01:47.893083] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-17T05:01:47.904631] [DEBUG] [LOCAL ] MHN: Loaded 5615 existing records from primary storage. [2025-09-17T05:01:47.904888] [INFO ] [MAIN ] MHN: Loaded 5615 existing records. [2025-09-17T05:01:48.081537] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:01:48.081798] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-17T05:01:48.081848] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-17T05:01:48.082149] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-17T05:01:48.082207] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-17T05:01:48.445211] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:01:48.648771] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T05:01:48.650709] [INFO ] [REMOTE ] MHF: Full fetch complete (12806 records). [2025-09-17T05:01:48.650816] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-17T05:01:48.700396] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-11. [2025-09-17T05:01:48.981740] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T05:01:49.072854] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-17T05:01:49.072965] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-17T05:01:49.073294] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-17T05:01:49.073347] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-17T05:01:49.073921] [DEBUG] [LOCAL ] MHF: Trimmed 12806 records to 8507 (keeping 200 days of data) [2025-09-17T05:01:49.124701] [DEBUG] [LOCAL ] MHF: Primary data saved (8507 records). [2025-09-17T05:01:49.124860] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-17T05:01:49.124957] [INFO ] [MAIN ] Update Progress: 1354/2369 symbols completed. MHF took 34.5s. Estimated remaining: 2h 28m 12s. Rate: 6.8 symbols/min [2025-09-17T05:01:49.297605] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:01:49.320248] [DEBUG] [LOCAL ] MHO: Loaded 17852 existing records from primary storage. [2025-09-17T05:01:49.320434] [INFO ] [MAIN ] MHO: Loaded 17852 existing records. [2025-09-17T05:01:49.498274] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:01:49.493842] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-17T05:01:49.499368] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-17T05:01:49.499432] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-17T05:01:49.504723] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-17T05:01:49.505443] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-17T05:01:49.505692] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T05:01:49.861071] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:01:50.290204] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-11. [2025-09-17T05:01:51.096322] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-09-17T05:01:51.098199] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T05:01:51.550887] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T05:01:51.569316] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T05:01:51.890188] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-09-17T05:01:52.690150] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-11. [2025-09-17T05:01:52.993611] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-11 (0.30 seconds). [2025-09-17T05:01:53.206061] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T05:01:53.490159] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-17T05:01:53.817503] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-17T05:01:54.290134] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-09-17T05:01:55.090168] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-17T05:01:55.429696] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T05:01:55.648041] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T05:01:55.890131] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-17T05:01:56.690155] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-17T05:01:57.454778] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T05:01:57.490147] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-17T05:01:57.969453] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T05:01:58.290175] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-17T05:01:58.937075] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T05:01:59.090104] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-17T05:01:59.319948] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T05:01:59.890189] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-17T05:02:00.695250] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-17T05:02:00.715146] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T05:02:00.731958] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T05:02:01.047729] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T05:02:01.490141] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-17T05:02:01.848431] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T05:02:02.290161] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-17T05:02:02.701109] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-17T05:02:03.090152] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-17T05:02:03.890141] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-17T05:02:04.308236] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T05:02:04.564413] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T05:02:04.690172] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-17T05:02:05.490166] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-17T05:02:05.927758] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T05:02:06.208943] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T05:02:06.290151] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-17T05:02:07.020525] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T05:02:07.090199] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-17T05:02:07.890375] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-17T05:02:08.690131] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-17T05:02:08.725841] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T05:02:08.741371] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T05:02:08.747633] [INFO ] [REMOTE ] MHK: Full fetch complete (60682 records). [2025-09-17T05:02:08.747781] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-17T05:02:09.083142] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-17T05:02:09.214772] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-17T05:02:09.214900] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-17T05:02:09.215829] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-17T05:02:09.215912] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-17T05:02:09.217405] [DEBUG] [LOCAL ] MHK: Trimmed 60682 records to 42482 (keeping 200 days of data) [2025-09-17T05:02:09.490225] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-17T05:02:09.494209] [DEBUG] [LOCAL ] MHK: Primary data saved (42482 records). [2025-09-17T05:02:09.494391] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-17T05:02:09.494541] [INFO ] [MAIN ] Update Progress: 1355/2369 symbols completed. MHK took 31.2s. Estimated remaining: 2h 28m 12s. Rate: 6.8 symbols/min [2025-09-17T05:02:09.673280] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:02:09.673536] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-17T05:02:09.673593] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-17T05:02:09.673732] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-17T05:02:09.673796] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-17T05:02:09.673847] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-17T05:02:09.673887] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-17T05:02:09.825526] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-17T05:02:10.039312] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:02:10.290138] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-11. [2025-09-17T05:02:10.489513] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:02:10.489924] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-11 [2025-09-17T05:02:11.090158] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-17T05:02:11.287173] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:02:11.287556] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-17T05:02:11.890134] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-09-17T05:02:12.086349] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:02:12.086719] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-09-17T05:02:12.690123] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-17T05:02:12.885874] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:02:12.886259] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-17T05:02:13.490138] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-17T05:02:13.812705] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-17T05:02:14.290140] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-17T05:02:15.023223] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T05:02:15.090134] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-17T05:02:15.469893] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T05:02:15.470774] [INFO ] [REMOTE ] MHLA: Full fetch complete (1491 records). [2025-09-17T05:02:15.470888] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-17T05:02:15.775752] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T05:02:15.776150] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:02:15.776259] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:02:15.776353] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-17T05:02:15.776480] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-17T05:02:15.776567] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-17T05:02:15.776724] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-17T05:02:15.776878] [INFO ] [MAIN ] Update Progress: 1356/2369 symbols completed. MHLA took 32.1s. Estimated remaining: 2h 28m 2s. Rate: 6.8 symbols/min [2025-09-17T05:02:15.897039] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-17T05:02:16.049287] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:02:16.069387] [DEBUG] [LOCAL ] MIN: Loaded 10688 existing records from primary storage. [2025-09-17T05:02:16.069622] [INFO ] [MAIN ] MIN: Loaded 10688 existing records. [2025-09-17T05:02:16.131940] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:02:16.142732] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-17T05:02:16.371174] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:02:16.371598] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-17T05:02:16.371717] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-17T05:02:16.372254] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-17T05:02:16.372349] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-17T05:02:16.695259] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-17T05:02:16.833120] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:02:16.939062] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:02:16.939508] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-17T05:02:17.490130] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-17T05:02:18.290107] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-11. [2025-09-17T05:02:18.584969] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T05:02:19.080730] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T05:02:19.090076] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-17T05:02:19.890200] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-17T05:02:20.108939] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:02:20.109314] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-17T05:02:20.127720] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T05:02:20.690191] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-09-17T05:02:21.351150] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T05:02:21.490180] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-17T05:02:21.886809] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-17T05:02:22.290165] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-17T05:02:23.063792] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T05:02:23.090150] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-17T05:02:23.275065] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:02:23.275452] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-17T05:02:23.890182] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-09-17T05:02:24.615903] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T05:02:24.690134] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-17T05:02:24.881823] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:02:24.882238] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-17T05:02:25.490192] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-17T05:02:26.048394] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T05:02:26.290210] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-17T05:02:27.090207] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-17T05:02:27.532630] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T05:02:27.890174] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-17T05:02:28.032811] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T05:02:28.652564] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T05:02:28.690170] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-17T05:02:29.446124] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T05:02:29.447799] [INFO ] [REMOTE ] MHN: Full fetch complete (11960 records). [2025-09-17T05:02:29.447887] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-17T05:02:29.495244] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-17T05:02:29.814364] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-17T05:02:29.814500] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-17T05:02:29.814872] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-17T05:02:29.814964] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-17T05:02:29.815808] [DEBUG] [LOCAL ] MHN: Trimmed 11960 records to 7800 (keeping 200 days of data) [2025-09-17T05:02:29.866245] [DEBUG] [LOCAL ] MHN: Primary data saved (7800 records). [2025-09-17T05:02:29.866443] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-17T05:02:29.866585] [INFO ] [MAIN ] Update Progress: 1357/2369 symbols completed. MHN took 42.1s. Estimated remaining: 2h 27m 57s. Rate: 6.8 symbols/min [2025-09-17T05:02:30.290092] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-17T05:02:30.765539] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T05:02:31.090158] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-17T05:02:31.881298] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T05:02:31.885821] [INFO ] [REMOTE ] MIAX: Full fetch complete (7082 records). [2025-09-17T05:02:31.885913] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-17T05:02:31.917369] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-17T05:02:32.068882] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 23 unique days, need 200 days [2025-09-17T05:02:32.069136] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:02:32.069184] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:02:32.069225] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-17T05:02:32.069319] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-17T05:02:32.069370] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-17T05:02:32.069424] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-17T05:02:32.069493] [INFO ] [MAIN ] Update Progress: 1358/2369 symbols completed. MIAX took 22.6s. Estimated remaining: 2h 27m 43s. Rate: 6.8 symbols/min [2025-09-17T05:02:32.249868] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T05:02:32.253293] [INFO ] [REMOTE ] MHO: Full fetch complete (37326 records). [2025-09-17T05:02:32.253408] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-17T05:02:32.556323] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T05:02:32.638547] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-17T05:02:32.638668] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-17T05:02:32.639324] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-17T05:02:32.639378] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-17T05:02:32.640264] [DEBUG] [LOCAL ] MHO: Trimmed 37326 records to 24434 (keeping 200 days of data) [2025-09-17T05:02:32.697690] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-17T05:02:32.798762] [DEBUG] [LOCAL ] MHO: Primary data saved (24434 records). [2025-09-17T05:02:32.798927] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-17T05:02:32.799059] [INFO ] [MAIN ] Update Progress: 1359/2369 symbols completed. MHO took 43.7s. Estimated remaining: 2h 27m 28s. Rate: 6.8 symbols/min [2025-09-17T05:02:33.593568] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T05:02:33.596593] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-17T05:02:34.416104] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T05:02:34.419245] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-17T05:02:35.304497] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T05:02:35.307967] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-17T05:02:36.460398] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T05:02:36.465960] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-17T05:02:37.385349] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T05:02:37.389344] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-17T05:02:38.182613] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T05:02:38.189000] [INFO ] [REMOTE ] MIN: Full fetch complete (17950 records). [2025-09-17T05:02:38.189344] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-17T05:02:38.607038] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-17T05:02:38.607242] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-17T05:02:38.608671] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-17T05:02:38.608758] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-17T05:02:38.610218] [DEBUG] [LOCAL ] MIN: Trimmed 17950 records to 13186 (keeping 200 days of data) [2025-09-17T05:02:38.708027] [DEBUG] [LOCAL ] MIN: Primary data saved (13186 records). [2025-09-17T05:02:38.708289] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-17T05:02:38.708430] [INFO ] [MAIN ] Update Progress: 1360/2369 symbols completed. MIN took 22.9s. Estimated remaining: 2h 27m 18s. Rate: 6.9 symbols/min [2025-09-17T05:02:39.300062] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:02:39.434841] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:02:39.460043] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:02:39.479856] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-17T05:02:39.482853] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:02:39.483955] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-17T05:02:39.484146] [DEBUG] [LOCAL ] MITT: No existing data file found in primary storage. [2025-09-17T05:02:39.484901] [WARN ] [MAIN ] MITT: No existing data found, performing full refresh instead. [2025-09-17T05:02:39.484599] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-17T05:02:39.485314] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-17T05:02:39.486232] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-17T05:02:39.489438] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-17T05:02:39.486675] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-17T05:02:39.489323] [DEBUG] [LOCAL ] MITP: Loaded 1620 existing records from primary storage. [2025-09-17T05:02:39.489984] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-17T05:02:39.490149] [INFO ] [MAIN ] MITP: Loaded 1620 existing records. [2025-09-17T05:02:39.489791] [DEBUG] [LOCAL ] MITT: No primary data file found to delete. [2025-09-17T05:02:39.519630] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-17T05:02:40.030235] [DEBUG] [LOCAL ] MIR: Loaded 38141 existing records from primary storage. [2025-09-17T05:02:40.070998] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:02:40.172527] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-17T05:02:40.127790] [INFO ] [MAIN ] MIR: Loaded 38141 existing records. [2025-09-17T05:02:40.202000] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-17T05:02:40.387882] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-17T05:02:40.460503] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-17T05:02:40.577620] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:02:40.669139] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-11. [2025-09-17T05:02:40.811705] [WARN ] [MAIN ] MIR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:02:40.842555] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:02:40.843909] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-11. [2025-09-17T05:02:40.843973] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-17T05:02:40.893047] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-17T05:02:40.961936] [DEBUG] [LOCAL ] MIR: Deleted primary data file. [2025-09-17T05:02:40.987029] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-17T05:02:41.268999] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:02:41.281236] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T05:02:41.281485] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-11. [2025-09-17T05:02:41.283283] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-17T05:02:41.487072] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:02:41.487458] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-11. [2025-09-17T05:02:41.652518] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-17T05:02:41.653994] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-17T05:02:41.813494] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T05:02:41.861489] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T05:02:41.972905] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-17T05:02:42.290148] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-17T05:02:42.633300] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T05:02:43.097050] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-17T05:02:43.099815] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T05:02:43.634580] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T05:02:43.890156] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-17T05:02:44.441822] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T05:02:44.690141] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-17T05:02:45.026184] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T05:02:45.490176] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-09-17T05:02:46.290220] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-09-17T05:02:46.835552] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T05:02:47.090158] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-09-17T05:02:47.441124] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-17T05:02:47.604976] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T05:02:47.890172] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-17T05:02:48.690170] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-09-17T05:02:49.080494] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T05:02:49.490164] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-09-17T05:02:50.197712] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T05:02:50.237812] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T05:02:50.290159] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-17T05:02:51.090208] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-17T05:02:51.364631] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T05:02:51.890193] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-17T05:02:52.412853] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T05:02:52.690186] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-17T05:02:53.210135] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T05:02:53.490140] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-17T05:02:53.820104] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-17T05:02:54.266036] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T05:02:54.290091] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-17T05:02:54.391619] [DEBUG] [REMOTE ] MIR: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-17T05:02:54.392043] [WARN ] [REMOTE ] MIR: No data returned for month 2025-04 [2025-09-17T05:02:55.090134] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-17T05:02:55.890134] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-17T05:02:56.215802] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-17T05:02:56.690164] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-17T05:02:56.776281] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T05:02:57.114701] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T05:02:57.490161] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-17T05:02:58.290157] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-17T05:02:58.728944] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T05:02:58.813592] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T05:02:59.090153] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-17T05:02:59.627755] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-17T05:02:59.890146] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-17T05:03:00.690141] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-17T05:03:00.967987] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-17T05:03:01.490147] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-17T05:03:01.577736] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T05:03:02.290189] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-17T05:03:02.613903] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T05:03:03.090200] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-17T05:03:03.868390] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T05:03:03.890148] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-17T05:03:04.417757] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T05:03:04.690142] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-17T05:03:05.284060] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T05:03:05.284857] [INFO ] [REMOTE ] MITN: Full fetch complete (2291 records). [2025-09-17T05:03:05.284945] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-17T05:03:05.464719] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T05:03:05.464926] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:03:05.465059] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:03:05.465210] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-17T05:03:05.465342] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-17T05:03:05.465401] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-17T05:03:05.465455] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-17T05:03:05.465570] [INFO ] [MAIN ] Update Progress: 1361/2369 symbols completed. MITN took 26.8s. Estimated remaining: 2h 27m 22s. Rate: 6.8 symbols/min [2025-09-17T05:03:05.495357] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-17T05:03:05.638752] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:03:05.671920] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (3.38 seconds). [2025-09-17T05:03:05.674690] [DEBUG] [LOCAL ] MIY: Loaded 4430 existing records from primary storage. [2025-09-17T05:03:05.685142] [INFO ] [MAIN ] MIY: Loaded 4430 existing records. [2025-09-17T05:03:05.880919] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:03:05.881222] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-17T05:03:05.881304] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-17T05:03:05.881629] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-17T05:03:05.881731] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-17T05:03:06.241722] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:03:06.292299] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-11. [2025-09-17T05:03:06.298938] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T05:03:07.082912] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T05:03:07.090079] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-09-17T05:03:07.892405] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-17T05:03:07.895323] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T05:03:08.690210] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-17T05:03:08.878331] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T05:03:09.490228] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-17T05:03:10.160006] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T05:03:10.290131] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-17T05:03:10.570099] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T05:03:11.090205] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-17T05:03:11.803585] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T05:03:11.810862] [INFO ] [REMOTE ] MIR: Full fetch complete (65741 records). [2025-09-17T05:03:11.811101] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-17T05:03:11.895553] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-17T05:03:12.028033] [WARN ] [VALIDATOR ] MIR: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T05:03:12.028918] [FATAL] [MAIN ] MIR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:03:12.028982] [WARN ] [MAIN ] MIR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:03:12.029033] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-17T05:03:12.029127] [DEBUG] [LOCAL ] MIR: No primary data file found to delete. [2025-09-17T05:03:12.029240] [INFO ] [LOCAL ] MIR: Starting deletion of derivative data. [2025-09-17T05:03:12.029628] [DEBUG] [LOCAL ] MIR: Deleted derivative data file. [2025-09-17T05:03:12.029804] [INFO ] [MAIN ] Update Progress: 1362/2369 symbols completed. MIR took 33.3s. Estimated remaining: 2h 27m 12s. Rate: 6.8 symbols/min [2025-09-17T05:03:12.215584] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:03:12.231097] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T05:03:12.279236] [DEBUG] [LOCAL ] MKC: Loaded 39110 existing records from primary storage. [2025-09-17T05:03:12.279482] [INFO ] [MAIN ] MKC: Loaded 39110 existing records. [2025-09-17T05:03:12.393305] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T05:03:12.479446] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:03:12.479831] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-17T05:03:12.479900] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-17T05:03:12.481113] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-17T05:03:12.481192] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-17T05:03:12.695498] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-17T05:03:12.869244] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:03:13.128352] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T05:03:13.129439] [INFO ] [REMOTE ] MITP: Full fetch complete (3303 records). [2025-09-17T05:03:13.129546] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-17T05:03:13.502279] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-09-17T05:03:13.508435] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-17T05:03:13.508527] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-17T05:03:13.509798] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-17T05:03:13.509858] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-17T05:03:13.510252] [DEBUG] [LOCAL ] MITP: Trimmed 3303 records to 2369 (keeping 200 days of data) [2025-09-17T05:03:13.524866] [DEBUG] [LOCAL ] MITP: Primary data saved (2369 records). [2025-09-17T05:03:13.525221] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-17T05:03:13.525341] [INFO ] [MAIN ] Update Progress: 1363/2369 symbols completed. MITP took 34.8s. Estimated remaining: 2h 26m 58s. Rate: 6.8 symbols/min [2025-09-17T05:03:13.696078] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:03:13.728687] [DEBUG] [LOCAL ] MKL: Loaded 25288 existing records from primary storage. [2025-09-17T05:03:13.728878] [INFO ] [MAIN ] MKL: Loaded 25288 existing records. [2025-09-17T05:03:13.909765] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:03:13.910033] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-17T05:03:13.910086] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-17T05:03:13.910889] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-17T05:03:13.910951] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-17T05:03:14.218340] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T05:03:14.285307] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:03:14.290126] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-17T05:03:15.090112] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-11. [2025-09-17T05:03:15.311534] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T05:03:15.314299] [INFO ] [REMOTE ] MITT: Full fetch complete (34795 records). [2025-09-17T05:03:15.314412] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-17T05:03:15.689840] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-17T05:03:15.689957] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-17T05:03:15.690674] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-17T05:03:15.690733] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-17T05:03:15.691711] [DEBUG] [LOCAL ] MITT: Trimmed 34795 records to 23075 (keeping 200 days of data) [2025-09-17T05:03:15.832481] [DEBUG] [LOCAL ] MITT: Primary data saved (23075 records). [2025-09-17T05:03:15.832659] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-17T05:03:15.832748] [INFO ] [MAIN ] Update Progress: 1364/2369 symbols completed. MITT took 37.1s. Estimated remaining: 2h 26m 44s. Rate: 6.8 symbols/min [2025-09-17T05:03:15.895745] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-17T05:03:16.007665] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:03:16.041622] [DEBUG] [LOCAL ] MLI: Loaded 32230 existing records from primary storage. [2025-09-17T05:03:16.041823] [INFO ] [MAIN ] MLI: Loaded 32230 existing records. [2025-09-17T05:03:16.217238] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:03:16.217541] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-17T05:03:16.217618] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-17T05:03:16.218775] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-17T05:03:16.218853] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-17T05:03:16.604889] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:03:16.690113] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-11. [2025-09-17T05:03:17.391831] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-11 (2.30 seconds). [2025-09-17T05:03:17.484204] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T05:03:17.490080] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-17T05:03:18.163557] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T05:03:18.290156] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-17T05:03:18.799395] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-17T05:03:19.006066] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T05:03:19.090144] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-17T05:03:19.678347] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T05:03:19.890167] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-09-17T05:03:20.690188] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-11. [2025-09-17T05:03:21.490120] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-09-17T05:03:21.589335] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T05:03:22.290150] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-17T05:03:22.367906] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T05:03:22.841025] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T05:03:23.060591] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T05:03:23.090180] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-09-17T05:03:23.890182] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-17T05:03:24.448391] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T05:03:24.690104] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-17T05:03:25.404152] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T05:03:25.490099] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-17T05:03:25.749289] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T05:03:26.290191] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-17T05:03:27.043282] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T05:03:27.090103] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-09-17T05:03:27.660589] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T05:03:27.890213] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-17T05:03:28.690276] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-17T05:03:28.999491] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T05:03:29.410545] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T05:03:29.495200] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-17T05:03:29.514268] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T05:03:30.113018] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T05:03:30.290182] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-17T05:03:31.078545] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T05:03:31.080001] [INFO ] [REMOTE ] MIY: Full fetch complete (9146 records). [2025-09-17T05:03:31.080089] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-17T05:03:31.095295] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-17T05:03:31.445447] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-17T05:03:31.445545] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-17T05:03:31.445812] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-17T05:03:31.445866] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-17T05:03:31.446326] [DEBUG] [LOCAL ] MIY: Trimmed 9146 records to 6029 (keeping 200 days of data) [2025-09-17T05:03:31.483689] [DEBUG] [LOCAL ] MIY: Primary data saved (6029 records). [2025-09-17T05:03:31.483785] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-17T05:03:31.483887] [INFO ] [MAIN ] Update Progress: 1365/2369 symbols completed. MIY took 26.0s. Estimated remaining: 2h 26m 40s. Rate: 6.8 symbols/min [2025-09-17T05:03:31.650898] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:03:31.671453] [DEBUG] [LOCAL ] MLM: Loaded 21554 existing records from primary storage. [2025-09-17T05:03:31.671626] [INFO ] [MAIN ] MLM: Loaded 21554 existing records. [2025-09-17T05:03:31.846927] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:03:31.847196] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-17T05:03:31.847281] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-17T05:03:31.848012] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-17T05:03:31.848086] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-17T05:03:31.901967] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-17T05:03:32.234535] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:03:32.690160] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-09-17T05:03:32.911543] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T05:03:33.490194] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-11. [2025-09-17T05:03:33.538973] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T05:03:34.105906] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T05:03:34.290173] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-17T05:03:34.887547] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T05:03:35.090193] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-17T05:03:35.895543] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-09-17T05:03:35.906175] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T05:03:36.690183] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-17T05:03:36.732159] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T05:03:37.348973] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T05:03:37.490210] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-17T05:03:37.890462] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T05:03:38.290181] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-17T05:03:38.917955] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T05:03:39.090148] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-17T05:03:39.890192] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-17T05:03:40.019537] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T05:03:40.563016] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T05:03:40.690176] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-17T05:03:41.355338] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T05:03:41.490169] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-17T05:03:42.228033] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T05:03:42.290136] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-17T05:03:43.025033] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T05:03:43.090144] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-17T05:03:43.856618] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T05:03:43.890134] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-17T05:03:44.654616] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T05:03:44.690123] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-17T05:03:45.193396] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T05:03:45.490150] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-17T05:03:46.290239] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-17T05:03:46.467072] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T05:03:46.851587] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T05:03:47.090197] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-17T05:03:47.891559] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T05:03:47.891712] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-17T05:03:48.690109] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-17T05:03:48.827840] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T05:03:49.122927] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T05:03:49.490122] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-17T05:03:50.139230] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T05:03:50.290134] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-17T05:03:50.733254] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T05:03:51.090162] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-17T05:03:51.655723] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T05:03:51.890183] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-17T05:03:52.459863] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T05:03:52.690199] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-17T05:03:53.490171] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-17T05:03:53.781687] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T05:03:54.048990] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T05:03:54.054062] [INFO ] [REMOTE ] MKL: Full fetch complete (49848 records). [2025-09-17T05:03:54.054185] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-17T05:03:54.295274] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-17T05:03:54.443072] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-17T05:03:54.443174] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-17T05:03:54.443967] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-17T05:03:54.444033] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-17T05:03:54.445030] [DEBUG] [LOCAL ] MKL: Trimmed 49848 records to 34375 (keeping 200 days of data) [2025-09-17T05:03:54.668239] [DEBUG] [LOCAL ] MKL: Primary data saved (34375 records). [2025-09-17T05:03:54.668397] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-17T05:03:54.668515] [INFO ] [MAIN ] Update Progress: 1366/2369 symbols completed. MKL took 41.1s. Estimated remaining: 2h 26m 42s. Rate: 6.8 symbols/min [2025-09-17T05:03:54.839838] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:03:54.856369] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T05:03:54.862215] [INFO ] [REMOTE ] MLI: Full fetch complete (63625 records). [2025-09-17T05:03:54.862385] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-17T05:03:54.980541] [DEBUG] [LOCAL ] MLNK: Loaded 19036 existing records from primary storage. [2025-09-17T05:03:55.001944] [INFO ] [MAIN ] MLNK: Loaded 19036 existing records. [2025-09-17T05:03:55.118956] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-17T05:03:55.364049] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:03:55.375019] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-17T05:03:55.404209] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-17T05:03:55.455129] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-17T05:03:55.458494] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-17T05:03:55.458557] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-17T05:03:55.463816] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-17T05:03:55.526389] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-17T05:03:55.545127] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-17T05:03:55.625777] [DEBUG] [LOCAL ] MLI: Trimmed 63625 records to 43923 (keeping 200 days of data) [2025-09-17T05:03:55.965411] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:03:55.977241] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-11. [2025-09-17T05:03:56.124102] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T05:03:56.186034] [DEBUG] [LOCAL ] MLI: Primary data saved (43923 records). [2025-09-17T05:03:56.186233] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-17T05:03:56.186341] [INFO ] [MAIN ] Update Progress: 1367/2369 symbols completed. MLI took 40.4s. Estimated remaining: 2h 26m 28s. Rate: 6.8 symbols/min [2025-09-17T05:03:56.365608] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:03:56.370796] [DEBUG] [LOCAL ] MLP: Loaded 2271 existing records from primary storage. [2025-09-17T05:03:56.371051] [INFO ] [MAIN ] MLP: Loaded 2271 existing records. [2025-09-17T05:03:56.559634] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:03:56.559986] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-17T05:03:56.560067] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-17T05:03:56.560378] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-17T05:03:56.560447] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-17T05:03:56.703815] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-17T05:03:56.937214] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:03:56.948242] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T05:03:56.951988] [INFO ] [REMOTE ] MLM: Full fetch complete (45790 records). [2025-09-17T05:03:56.952094] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-17T05:03:57.334738] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-17T05:03:57.334919] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-17T05:03:57.335781] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-17T05:03:57.335878] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-17T05:03:57.361781] [DEBUG] [LOCAL ] MLM: Trimmed 45790 records to 31606 (keeping 200 days of data) [2025-09-17T05:03:57.361495] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T05:03:57.493733] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-09-17T05:03:57.592099] [DEBUG] [LOCAL ] MLM: Primary data saved (31606 records). [2025-09-17T05:03:57.592392] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-17T05:03:57.592534] [INFO ] [MAIN ] Update Progress: 1368/2369 symbols completed. MLM took 26.1s. Estimated remaining: 2h 26m 14s. Rate: 6.8 symbols/min [2025-09-17T05:03:57.772551] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:03:57.785251] [DEBUG] [LOCAL ] MLR: Loaded 8483 existing records from primary storage. [2025-09-17T05:03:57.785504] [INFO ] [MAIN ] MLR: Loaded 8483 existing records. [2025-09-17T05:03:57.970293] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:03:57.970637] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-17T05:03:57.970723] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-17T05:03:57.971107] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-17T05:03:57.971167] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-17T05:03:58.295420] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-11. [2025-09-17T05:03:58.361109] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:03:58.378502] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T05:03:58.412598] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T05:03:58.419390] [INFO ] [REMOTE ] MKC: Full fetch complete (75326 records). [2025-09-17T05:03:58.419592] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-17T05:03:58.820310] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-17T05:03:58.820431] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-17T05:03:58.821477] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-17T05:03:58.821541] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-17T05:03:58.823093] [DEBUG] [LOCAL ] MKC: Trimmed 75326 records to 52466 (keeping 200 days of data) [2025-09-17T05:03:58.921058] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T05:03:59.119811] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-11. [2025-09-17T05:03:59.175677] [DEBUG] [LOCAL ] MKC: Primary data saved (52466 records). [2025-09-17T05:03:59.175902] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-17T05:03:59.176011] [INFO ] [MAIN ] Update Progress: 1369/2369 symbols completed. MKC took 47.1s. Estimated remaining: 2h 25m 60s. Rate: 6.8 symbols/min [2025-09-17T05:03:59.348570] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:03:59.386387] [DEBUG] [LOCAL ] MMC: Loaded 38574 existing records from primary storage. [2025-09-17T05:03:59.386559] [INFO ] [MAIN ] MMC: Loaded 38574 existing records. [2025-09-17T05:03:59.564157] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:03:59.564472] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-17T05:03:59.564552] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-17T05:03:59.565717] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-17T05:03:59.565787] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-17T05:03:59.892578] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-09-17T05:03:59.919847] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:03:59.939456] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T05:04:00.527462] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T05:04:00.690131] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-11. [2025-09-17T05:04:01.490255] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-09-17T05:04:02.290239] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-09-17T05:04:02.356255] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T05:04:02.378460] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T05:04:03.032682] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T05:04:03.090151] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-17T05:04:03.835772] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T05:04:03.890166] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-17T05:04:04.690142] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-09-17T05:04:05.014199] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T05:04:05.490301] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-17T05:04:05.531026] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T05:04:06.290152] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-09-17T05:04:06.378611] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T05:04:07.090141] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-17T05:04:07.890175] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-17T05:04:07.909583] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T05:04:08.018916] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T05:04:08.690129] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-09-17T05:04:08.967174] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T05:04:09.490123] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-17T05:04:10.290109] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-17T05:04:10.426580] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T05:04:10.586825] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T05:04:10.762543] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T05:04:11.090131] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-17T05:04:11.768547] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T05:04:11.890129] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-17T05:04:12.690145] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-17T05:04:12.943672] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T05:04:13.490131] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-17T05:04:14.290120] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-17T05:04:14.413712] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T05:04:14.596248] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T05:04:15.079366] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T05:04:15.090075] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-17T05:04:15.890134] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-17T05:04:16.096047] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T05:04:16.690155] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-17T05:04:17.229658] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T05:04:17.490144] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-17T05:04:17.755457] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T05:04:18.290163] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-17T05:04:18.755509] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T05:04:18.759846] [INFO ] [REMOTE ] MLNK: Full fetch complete (35362 records). [2025-09-17T05:04:18.759985] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-17T05:04:18.966604] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T05:04:19.105968] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-17T05:04:19.155204] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-17T05:04:19.155309] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-17T05:04:19.156154] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-17T05:04:19.156253] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-17T05:04:19.157398] [DEBUG] [LOCAL ] MLNK: Trimmed 35362 records to 25490 (keeping 200 days of data) [2025-09-17T05:04:19.325471] [DEBUG] [LOCAL ] MLNK: Primary data saved (25490 records). [2025-09-17T05:04:19.325671] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-17T05:04:19.325840] [INFO ] [MAIN ] Update Progress: 1370/2369 symbols completed. MLNK took 24.7s. Estimated remaining: 2h 25m 59s. Rate: 6.8 symbols/min [2025-09-17T05:04:19.502502] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:04:19.512316] [DEBUG] [LOCAL ] MMD: Loaded 7827 existing records from primary storage. [2025-09-17T05:04:19.512495] [INFO ] [MAIN ] MMD: Loaded 7827 existing records. [2025-09-17T05:04:19.690892] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:04:19.691167] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-17T05:04:19.691227] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-17T05:04:19.691598] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-17T05:04:19.691680] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-17T05:04:19.811196] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T05:04:19.898932] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-17T05:04:20.074669] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:04:20.506991] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T05:04:20.690229] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-17T05:04:21.490135] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-17T05:04:22.013028] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T05:04:22.290178] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-17T05:04:22.522430] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T05:04:23.085855] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T05:04:23.090064] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-17T05:04:23.831683] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T05:04:23.890121] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-17T05:04:24.690174] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-17T05:04:25.490169] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-11. [2025-09-17T05:04:25.529281] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T05:04:25.669707] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T05:04:26.290199] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-17T05:04:26.300724] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T05:04:27.090210] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-09-17T05:04:27.254854] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T05:04:27.890199] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-17T05:04:28.115327] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T05:04:28.690162] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-17T05:04:29.146806] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T05:04:29.490145] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-09-17T05:04:29.699719] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T05:04:30.019791] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T05:04:30.290155] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-17T05:04:31.090257] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-17T05:04:31.319085] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T05:04:31.657181] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T05:04:31.658353] [INFO ] [REMOTE ] MLP: Full fetch complete (4717 records). [2025-09-17T05:04:31.658443] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-17T05:04:31.895294] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-17T05:04:32.038757] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-17T05:04:32.038866] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-17T05:04:32.039043] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-17T05:04:32.039094] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-17T05:04:32.039497] [DEBUG] [LOCAL ] MLP: Trimmed 4717 records to 3041 (keeping 200 days of data) [2025-09-17T05:04:32.059733] [DEBUG] [LOCAL ] MLP: Primary data saved (3041 records). [2025-09-17T05:04:32.059833] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-17T05:04:32.059936] [INFO ] [MAIN ] Update Progress: 1371/2369 symbols completed. MLP took 35.9s. Estimated remaining: 2h 25m 54s. Rate: 6.8 symbols/min [2025-09-17T05:04:32.228632] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:04:32.240698] [DEBUG] [LOCAL ] MMI: Loaded 10858 existing records from primary storage. [2025-09-17T05:04:32.240835] [INFO ] [MAIN ] MMI: Loaded 10858 existing records. [2025-09-17T05:04:32.420599] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:04:32.420886] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-17T05:04:32.420953] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-17T05:04:32.421322] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-17T05:04:32.421389] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-17T05:04:32.695329] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-17T05:04:32.820039] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:04:33.490210] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-11. [2025-09-17T05:04:33.943241] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T05:04:33.973509] [INFO ] [REMOTE ] MLR: Full fetch complete (18447 records). [2025-09-17T05:04:33.974081] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-17T05:04:34.043326] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-17T05:04:34.148386] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T05:04:34.295249] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-17T05:04:34.373411] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-17T05:04:34.373511] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-17T05:04:34.373999] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-17T05:04:34.374062] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-17T05:04:34.374635] [DEBUG] [LOCAL ] MLR: Trimmed 18447 records to 13173 (keeping 200 days of data) [2025-09-17T05:04:34.458263] [DEBUG] [LOCAL ] MLR: Primary data saved (13173 records). [2025-09-17T05:04:34.458435] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-17T05:04:34.458580] [INFO ] [MAIN ] Update Progress: 1372/2369 symbols completed. MLR took 36.9s. Estimated remaining: 2h 25m 40s. Rate: 6.8 symbols/min [2025-09-17T05:04:34.629009] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:04:34.629221] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-17T05:04:34.629269] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-17T05:04:34.629374] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-17T05:04:34.629423] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-17T05:04:34.629471] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-17T05:04:34.629512] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-17T05:04:35.008047] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:04:35.090208] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-17T05:04:35.134269] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T05:04:35.890149] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-09-17T05:04:36.688483] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T05:04:36.698704] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-11. [2025-09-17T05:04:36.708499] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T05:04:37.122100] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T05:04:37.490149] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-17T05:04:38.290161] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-17T05:04:38.708295] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-17T05:04:39.090145] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-09-17T05:04:39.134073] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T05:04:39.143315] [INFO ] [REMOTE ] MMC: Full fetch complete (74484 records). [2025-09-17T05:04:39.143721] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-17T05:04:39.573693] [DEBUG] [VALIDATOR ] MMC: All expected trading days are present. [2025-09-17T05:04:39.573882] [DEBUG] [VALIDATOR ] MMC: Primary data validation passed. [2025-09-17T05:04:39.575287] [INFO ] [MAIN ] MMC: Fetched primary data is valid. [2025-09-17T05:04:39.575395] [DEBUG] [LOCAL ] MMC: Saving primary data. [2025-09-17T05:04:39.577744] [DEBUG] [LOCAL ] MMC: Trimmed 74484 records to 51806 (keeping 200 days of data) [2025-09-17T05:04:39.908115] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-17T05:04:39.966798] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T05:04:39.984583] [DEBUG] [LOCAL ] MMC: Primary data saved (51806 records). [2025-09-17T05:04:39.984743] [INFO ] [MAIN ] MMC: Full history saved. [2025-09-17T05:04:39.984882] [INFO ] [MAIN ] Update Progress: 1373/2369 symbols completed. MMC took 40.8s. Estimated remaining: 2h 25m 29s. Rate: 6.8 symbols/min [2025-09-17T05:04:40.154814] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:04:40.197911] [DEBUG] [LOCAL ] MMM: Loaded 39647 existing records from primary storage. [2025-09-17T05:04:40.198187] [INFO ] [MAIN ] MMM: Loaded 39647 existing records. [2025-09-17T05:04:40.381523] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:04:40.381914] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-17T05:04:40.381986] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-17T05:04:40.383289] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-17T05:04:40.383390] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-17T05:04:40.695243] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-17T05:04:40.760967] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:04:40.855542] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T05:04:41.490196] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-17T05:04:41.671362] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T05:04:41.914895] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T05:04:42.290150] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-11. [2025-09-17T05:04:43.090202] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-17T05:04:43.560142] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T05:04:43.890155] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-17T05:04:44.156266] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T05:04:44.604583] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T05:04:44.690235] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-17T05:04:45.437859] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T05:04:45.490154] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-17T05:04:45.919831] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-17T05:04:46.290156] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-17T05:04:46.627031] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T05:04:47.090174] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-17T05:04:47.516027] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T05:04:47.890149] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-09-17T05:04:48.690229] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-17T05:04:49.490117] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-17T05:04:49.500681] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T05:04:49.842586] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T05:04:49.926795] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T05:04:50.290152] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-09-17T05:04:51.090175] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-17T05:04:51.890200] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-17T05:04:52.039048] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T05:04:52.206767] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T05:04:52.219492] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-17T05:04:52.690179] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-17T05:04:53.109121] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-17T05:04:53.490187] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-17T05:04:53.943197] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T05:04:53.944581] [INFO ] [REMOTE ] MMKT: Full fetch complete (2150 records). [2025-09-17T05:04:53.944726] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-17T05:04:54.159000] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T05:04:54.159491] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:04:54.159557] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:04:54.159624] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-17T05:04:54.159742] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-17T05:04:54.159803] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-17T05:04:54.159858] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-17T05:04:54.159946] [INFO ] [MAIN ] Update Progress: 1374/2369 symbols completed. MMKT took 19.7s. Estimated remaining: 2h 25m 24s. Rate: 6.8 symbols/min [2025-09-17T05:04:54.295808] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-17T05:04:54.365836] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:04:54.406938] [DEBUG] [LOCAL ] MMS: Loaded 24619 existing records from primary storage. [2025-09-17T05:04:54.407238] [INFO ] [MAIN ] MMS: Loaded 24619 existing records. [2025-09-17T05:04:54.653525] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:04:54.653992] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-17T05:04:54.654076] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-17T05:04:54.655052] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-17T05:04:54.655330] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-17T05:04:55.100803] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-17T05:04:55.159911] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:04:55.890129] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-17T05:04:55.961507] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T05:04:56.230542] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-17T05:04:56.690111] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-17T05:04:56.987447] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T05:04:57.490193] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-17T05:04:58.290116] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-17T05:04:58.508973] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T05:04:58.623424] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T05:04:58.844314] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T05:04:58.846688] [INFO ] [REMOTE ] MMD: Full fetch complete (17905 records). [2025-09-17T05:04:58.846775] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-17T05:04:59.095351] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-11. [2025-09-17T05:04:59.277956] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-17T05:04:59.278083] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-17T05:04:59.278674] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-17T05:04:59.278727] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-17T05:04:59.279388] [DEBUG] [LOCAL ] MMD: Trimmed 17905 records to 11096 (keeping 200 days of data) [2025-09-17T05:04:59.348765] [DEBUG] [LOCAL ] MMD: Primary data saved (11096 records). [2025-09-17T05:04:59.348920] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-17T05:04:59.349026] [INFO ] [MAIN ] Update Progress: 1375/2369 symbols completed. MMD took 40.0s. Estimated remaining: 2h 25m 13s. Rate: 6.8 symbols/min [2025-09-17T05:04:59.530514] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:04:59.542974] [DEBUG] [LOCAL ] MMT: Loaded 7760 existing records from primary storage. [2025-09-17T05:04:59.543204] [INFO ] [MAIN ] MMT: Loaded 7760 existing records. [2025-09-17T05:04:59.743599] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:04:59.743939] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-17T05:04:59.743998] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-17T05:04:59.744418] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-17T05:04:59.744480] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-17T05:04:59.895331] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-17T05:05:00.103544] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:05:00.584230] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T05:05:00.690143] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-09-17T05:05:01.490141] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-11. [2025-09-17T05:05:02.120860] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T05:05:02.247183] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T05:05:02.290106] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-09-17T05:05:02.311013] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T05:05:03.090165] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-17T05:05:03.795720] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T05:05:03.890130] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-09-17T05:05:04.692105] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-17T05:05:04.697317] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T05:05:04.722823] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T05:05:05.490142] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-17T05:05:05.670744] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T05:05:06.290193] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-09-17T05:05:06.861898] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T05:05:07.073973] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T05:05:07.090085] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-17T05:05:07.890140] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-17T05:05:08.069317] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T05:05:08.690143] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-17T05:05:09.490186] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-17T05:05:09.703171] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T05:05:10.237995] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T05:05:10.290148] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-17T05:05:10.541192] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T05:05:11.090131] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-17T05:05:11.890145] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-17T05:05:12.058717] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T05:05:12.061081] [INFO ] [REMOTE ] MMI: Full fetch complete (20702 records). [2025-09-17T05:05:12.061221] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-17T05:05:12.473499] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-17T05:05:12.473730] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-17T05:05:12.474399] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-17T05:05:12.474533] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-17T05:05:12.475536] [DEBUG] [LOCAL ] MMI: Trimmed 20702 records to 15384 (keeping 200 days of data) [2025-09-17T05:05:12.583090] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-17T05:05:12.623199] [DEBUG] [LOCAL ] MMI: Primary data saved (15384 records). [2025-09-17T05:05:12.623387] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-17T05:05:12.623492] [INFO ] [MAIN ] Update Progress: 1376/2369 symbols completed. MMI took 40.6s. Estimated remaining: 2h 25m 7s. Rate: 6.8 symbols/min [2025-09-17T05:05:12.690542] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-17T05:05:12.764130] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T05:05:12.815584] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:05:12.828762] [DEBUG] [LOCAL ] MMU: Loaded 12224 existing records from primary storage. [2025-09-17T05:05:12.828914] [INFO ] [MAIN ] MMU: Loaded 12224 existing records. [2025-09-17T05:05:13.014470] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:05:13.014768] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-17T05:05:13.014831] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-17T05:05:13.015288] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-17T05:05:13.015349] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-17T05:05:13.381949] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:05:13.490093] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-11. [2025-09-17T05:05:14.111711] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T05:05:14.290185] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-17T05:05:14.395123] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T05:05:15.090195] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-17T05:05:15.301822] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T05:05:15.890146] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-17T05:05:16.491550] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T05:05:16.690171] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-09-17T05:05:17.490169] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-17T05:05:17.728104] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T05:05:17.822719] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T05:05:18.290100] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-17T05:05:18.378029] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T05:05:19.090168] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-17T05:05:19.890194] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-09-17T05:05:19.931706] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T05:05:20.197764] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T05:05:20.204553] [INFO ] [REMOTE ] MMM: Full fetch complete (77044 records). [2025-09-17T05:05:20.204792] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-17T05:05:20.603768] [DEBUG] [VALIDATOR ] MMM: All expected trading days are present. [2025-09-17T05:05:20.603895] [DEBUG] [VALIDATOR ] MMM: Primary data validation passed. [2025-09-17T05:05:20.605009] [INFO ] [MAIN ] MMM: Fetched primary data is valid. [2025-09-17T05:05:20.605089] [DEBUG] [LOCAL ] MMM: Saving primary data. [2025-09-17T05:05:20.606705] [DEBUG] [LOCAL ] MMM: Trimmed 77044 records to 53279 (keeping 200 days of data) [2025-09-17T05:05:20.702744] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-17T05:05:20.852628] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T05:05:20.975450] [DEBUG] [LOCAL ] MMM: Primary data saved (53279 records). [2025-09-17T05:05:20.975680] [INFO ] [MAIN ] MMM: Full history saved. [2025-09-17T05:05:20.975809] [INFO ] [MAIN ] Update Progress: 1377/2369 symbols completed. MMM took 41.0s. Estimated remaining: 2h 24m 58s. Rate: 6.8 symbols/min [2025-09-17T05:05:21.153226] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:05:21.176576] [DEBUG] [LOCAL ] MNR: Loaded 18688 existing records from primary storage. [2025-09-17T05:05:21.176837] [INFO ] [MAIN ] MNR: Loaded 18688 existing records. [2025-09-17T05:05:21.363913] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:05:21.364199] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-17T05:05:21.364275] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-17T05:05:21.364986] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-17T05:05:21.365061] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-17T05:05:21.491958] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-17T05:05:21.532732] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T05:05:21.752739] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:05:22.290184] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-17T05:05:22.677030] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T05:05:23.043919] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T05:05:23.090171] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-17T05:05:23.890153] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-17T05:05:24.038267] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T05:05:24.690131] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-17T05:05:25.322840] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T05:05:25.490137] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-17T05:05:25.682562] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T05:05:26.290173] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-17T05:05:26.641871] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T05:05:26.646777] [INFO ] [REMOTE ] MMS: Full fetch complete (52478 records). [2025-09-17T05:05:26.646962] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-17T05:05:27.032461] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-17T05:05:27.032568] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-17T05:05:27.033412] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-17T05:05:27.033470] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-17T05:05:27.034824] [DEBUG] [LOCAL ] MMS: Trimmed 52478 records to 34185 (keeping 200 days of data) [2025-09-17T05:05:27.102500] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-11. [2025-09-17T05:05:27.153888] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T05:05:27.273366] [DEBUG] [LOCAL ] MMS: Primary data saved (34185 records). [2025-09-17T05:05:27.273551] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-17T05:05:27.273681] [INFO ] [MAIN ] Update Progress: 1378/2369 symbols completed. MMS took 33.1s. Estimated remaining: 2h 24m 48s. Rate: 6.8 symbols/min [2025-09-17T05:05:27.451492] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:05:27.485360] [DEBUG] [LOCAL ] MNSO: Loaded 31998 existing records from primary storage. [2025-09-17T05:05:27.485543] [INFO ] [MAIN ] MNSO: Loaded 31998 existing records. [2025-09-17T05:05:27.673216] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:05:27.673498] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-17T05:05:27.673560] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-17T05:05:27.674480] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-17T05:05:27.674553] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-17T05:05:27.899801] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-17T05:05:28.043259] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:05:28.190173] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T05:05:28.690165] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-17T05:05:28.698363] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T05:05:28.700273] [INFO ] [REMOTE ] MMT: Full fetch complete (16622 records). [2025-09-17T05:05:28.700442] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-17T05:05:29.090304] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-17T05:05:29.090426] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-17T05:05:29.091089] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-17T05:05:29.091146] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-17T05:05:29.092162] [DEBUG] [LOCAL ] MMT: Trimmed 16622 records to 11481 (keeping 200 days of data) [2025-09-17T05:05:29.171241] [DEBUG] [LOCAL ] MMT: Primary data saved (11481 records). [2025-09-17T05:05:29.171451] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-17T05:05:29.171589] [INFO ] [MAIN ] Update Progress: 1379/2369 symbols completed. MMT took 29.8s. Estimated remaining: 2h 24m 34s. Rate: 6.8 symbols/min [2025-09-17T05:05:29.347560] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:05:29.347833] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-17T05:05:29.347903] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-17T05:05:29.348047] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-17T05:05:29.348114] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-17T05:05:29.348182] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-17T05:05:29.348243] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-17T05:05:29.495217] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-09-17T05:05:29.718988] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:05:29.730330] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T05:05:30.290150] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-17T05:05:30.712503] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T05:05:31.098731] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-09-17T05:05:31.100985] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T05:05:31.890151] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-11. [2025-09-17T05:05:32.149561] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T05:05:32.215551] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T05:05:32.690152] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-17T05:05:32.877856] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:05:32.878206] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-17T05:05:33.490173] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-17T05:05:34.290200] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-09-17T05:05:34.373101] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T05:05:34.472342] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:05:34.473051] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-09-17T05:05:35.090207] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-17T05:05:35.294035] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:05:35.294468] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-17T05:05:35.890190] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-17T05:05:36.078343] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:05:36.078808] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-17T05:05:36.690174] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-17T05:05:36.885142] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:05:36.885599] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-17T05:05:37.490154] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-17T05:05:38.290116] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-17T05:05:38.765692] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T05:05:39.090142] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-17T05:05:39.263333] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T05:05:39.890169] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-17T05:05:40.167332] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T05:05:40.408970] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T05:05:40.690170] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-17T05:05:41.497223] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-17T05:05:41.499275] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T05:05:42.290155] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-11. [2025-09-17T05:05:42.545177] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T05:05:43.090172] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-17T05:05:43.890093] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-17T05:05:44.021714] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T05:05:44.303322] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T05:05:44.690172] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-17T05:05:44.983102] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T05:05:45.490097] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-17T05:05:45.962883] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T05:05:46.290157] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-17T05:05:47.075798] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T05:05:47.090219] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-17T05:05:47.370802] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T05:05:47.890189] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-09-17T05:05:48.559196] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T05:05:48.690166] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-17T05:05:49.083428] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T05:05:49.359613] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T05:05:49.362384] [INFO ] [REMOTE ] MMU: Full fetch complete (25571 records). [2025-09-17T05:05:49.362500] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-17T05:05:49.505248] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-17T05:05:49.739628] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-17T05:05:49.739770] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-17T05:05:49.740424] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-17T05:05:49.740497] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-17T05:05:49.741231] [DEBUG] [LOCAL ] MMU: Trimmed 25571 records to 16989 (keeping 200 days of data) [2025-09-17T05:05:49.844289] [DEBUG] [LOCAL ] MMU: Primary data saved (16989 records). [2025-09-17T05:05:49.844474] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-17T05:05:49.844612] [INFO ] [MAIN ] Update Progress: 1380/2369 symbols completed. MMU took 37.2s. Estimated remaining: 2h 24m 34s. Rate: 6.8 symbols/min [2025-09-17T05:05:50.013618] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:05:50.054808] [DEBUG] [LOCAL ] MO: Loaded 40104 existing records from primary storage. [2025-09-17T05:05:50.054990] [INFO ] [MAIN ] MO: Loaded 40104 existing records. [2025-09-17T05:05:50.233524] [WARN ] [MAIN ] MO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:05:50.233860] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-17T05:05:50.233933] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-17T05:05:50.235057] [DEBUG] [LOCAL ] MO: Deleted primary data file. [2025-09-17T05:05:50.235135] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-17T05:05:50.297519] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-09-17T05:05:50.605959] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:05:50.663375] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T05:05:51.090192] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-11. [2025-09-17T05:05:51.890129] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-17T05:05:51.937543] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T05:05:52.690144] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-17T05:05:53.239909] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-17T05:05:53.381224] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T05:05:53.388542] [INFO ] [REMOTE ] MNTN: Full fetch complete (23220 records). [2025-09-17T05:05:53.388746] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-17T05:05:53.491831] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-17T05:05:53.582151] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 82 unique days, need 200 days [2025-09-17T05:05:53.582690] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:05:53.582763] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:05:53.582830] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-17T05:05:53.582924] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-17T05:05:53.582996] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-17T05:05:53.583089] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-17T05:05:53.583209] [INFO ] [MAIN ] Update Progress: 1381/2369 symbols completed. MNTN took 24.4s. Estimated remaining: 2h 24m 21s. Rate: 6.8 symbols/min [2025-09-17T05:05:53.765386] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:05:53.813407] [DEBUG] [LOCAL ] MOD: Loaded 33252 existing records from primary storage. [2025-09-17T05:05:53.813606] [INFO ] [MAIN ] MOD: Loaded 33252 existing records. [2025-09-17T05:05:54.009043] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:05:54.009435] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-17T05:05:54.009505] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-17T05:05:54.010693] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-17T05:05:54.010773] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-17T05:05:54.293319] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-17T05:05:54.391082] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:05:54.420735] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T05:05:55.090139] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-17T05:05:55.431736] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T05:05:55.890199] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-17T05:05:55.938821] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-17T05:05:56.694206] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-17T05:05:56.706692] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T05:05:56.898229] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T05:05:56.901428] [INFO ] [REMOTE ] MNR: Full fetch complete (37090 records). [2025-09-17T05:05:56.901600] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-17T05:05:57.289478] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-17T05:05:57.289607] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-17T05:05:57.290289] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-17T05:05:57.290344] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-17T05:05:57.291161] [DEBUG] [LOCAL ] MNR: Trimmed 37090 records to 24847 (keeping 200 days of data) [2025-09-17T05:05:57.446158] [DEBUG] [LOCAL ] MNR: Primary data saved (24847 records). [2025-09-17T05:05:57.446353] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-17T05:05:57.446464] [INFO ] [MAIN ] Update Progress: 1382/2369 symbols completed. MNR took 36.5s. Estimated remaining: 2h 24m 9s. Rate: 6.8 symbols/min [2025-09-17T05:05:57.501421] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-17T05:05:57.620818] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:05:57.656407] [DEBUG] [LOCAL ] MODG: Loaded 38532 existing records from primary storage. [2025-09-17T05:05:57.656596] [INFO ] [MAIN ] MODG: Loaded 38532 existing records. [2025-09-17T05:05:57.832085] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:05:57.832371] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-17T05:05:57.832424] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-17T05:05:57.833425] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-17T05:05:57.833491] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-17T05:05:58.191007] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:05:58.290170] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-11. [2025-09-17T05:05:58.974649] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-17T05:05:59.090215] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-17T05:05:59.296381] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T05:05:59.897263] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-11. [2025-09-17T05:05:59.902091] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T05:06:00.690188] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-17T05:06:01.287091] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-17T05:06:01.490199] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-17T05:06:01.742352] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T05:06:02.290187] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-09-17T05:06:03.090163] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-09-17T05:06:03.456224] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (2.77 seconds). [2025-09-17T05:06:03.890185] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-17T05:06:04.878182] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (3.39 seconds). [2025-09-17T05:06:04.889977] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-17T05:06:05.239937] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-17T05:06:05.490176] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-09-17T05:06:05.774201] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (3.48 seconds). [2025-09-17T05:06:06.138169] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T05:06:06.290112] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-09-17T05:06:06.855228] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T05:06:07.090218] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-17T05:06:07.169097] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T05:06:07.890169] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-17T05:06:07.972533] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T05:06:08.267043] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T05:06:08.690182] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-17T05:06:09.490146] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-17T05:06:10.116630] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-17T05:06:10.290140] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-17T05:06:10.367698] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T05:06:11.090172] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-17T05:06:11.210517] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T05:06:11.892267] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T05:06:11.892402] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-17T05:06:12.690255] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-17T05:06:12.779404] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T05:06:12.785827] [INFO ] [REMOTE ] MNSO: Full fetch complete (64340 records). [2025-09-17T05:06:12.786052] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-17T05:06:13.200496] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-17T05:06:13.200637] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-17T05:06:13.201742] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-17T05:06:13.201812] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-17T05:06:13.203252] [DEBUG] [LOCAL ] MNSO: Trimmed 64340 records to 44427 (keeping 200 days of data) [2025-09-17T05:06:13.484975] [DEBUG] [LOCAL ] MNSO: Primary data saved (44427 records). [2025-09-17T05:06:13.485147] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-17T05:06:13.485256] [INFO ] [MAIN ] Update Progress: 1383/2369 symbols completed. MNSO took 46.2s. Estimated remaining: 2h 24m 6s. Rate: 6.8 symbols/min [2025-09-17T05:06:13.518667] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-17T05:06:13.667440] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:06:13.710164] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T05:06:13.746692] [DEBUG] [LOCAL ] MOH: Loaded 31868 existing records from primary storage. [2025-09-17T05:06:13.746884] [INFO ] [MAIN ] MOH: Loaded 31868 existing records. [2025-09-17T05:06:13.939056] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:06:13.939378] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-17T05:06:13.939449] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-17T05:06:13.940284] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-17T05:06:13.940351] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-17T05:06:14.300159] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-17T05:06:14.305183] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:06:14.472715] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T05:06:15.090194] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-11. [2025-09-17T05:06:15.890161] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-17T05:06:16.748219] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-17T05:06:16.759867] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-17T05:06:17.021073] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (3.50 seconds). [2025-09-17T05:06:17.414396] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-11 (2.32 seconds). [2025-09-17T05:06:17.490144] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-09-17T05:06:17.998167] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T05:06:18.290384] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-17T05:06:18.442897] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T05:06:18.547278] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T05:06:19.090198] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-17T05:06:19.890181] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-09-17T05:06:20.463529] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T05:06:20.546105] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T05:06:20.690178] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-17T05:06:21.373344] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T05:06:21.490156] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-17T05:06:22.290260] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-17T05:06:22.438461] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T05:06:23.070606] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T05:06:23.090094] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-17T05:06:23.890138] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-17T05:06:24.086177] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T05:06:24.181051] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T05:06:24.690152] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-17T05:06:25.312450] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T05:06:25.490153] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-17T05:06:26.290153] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-17T05:06:26.640532] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T05:06:27.090150] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-17T05:06:27.254818] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T05:06:27.563155] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T05:06:27.571521] [INFO ] [REMOTE ] MOD: Full fetch complete (65927 records). [2025-09-17T05:06:27.571746] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-17T05:06:27.895241] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-17T05:06:27.984746] [DEBUG] [VALIDATOR ] MOD: All expected trading days are present. [2025-09-17T05:06:27.984901] [DEBUG] [VALIDATOR ] MOD: Primary data validation passed. [2025-09-17T05:06:27.986016] [INFO ] [MAIN ] MOD: Fetched primary data is valid. [2025-09-17T05:06:27.986119] [DEBUG] [LOCAL ] MOD: Saving primary data. [2025-09-17T05:06:27.987699] [DEBUG] [LOCAL ] MOD: Trimmed 65927 records to 45838 (keeping 200 days of data) [2025-09-17T05:06:28.282008] [DEBUG] [LOCAL ] MOD: Primary data saved (45838 records). [2025-09-17T05:06:28.282194] [INFO ] [MAIN ] MOD: Full history saved. [2025-09-17T05:06:28.282292] [INFO ] [MAIN ] Update Progress: 1384/2369 symbols completed. MOD took 34.7s. Estimated remaining: 2h 24m 1s. Rate: 6.8 symbols/min [2025-09-17T05:06:28.458230] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:06:28.498380] [DEBUG] [LOCAL ] MOS: Loaded 39894 existing records from primary storage. [2025-09-17T05:06:28.498586] [INFO ] [MAIN ] MOS: Loaded 39894 existing records. [2025-09-17T05:06:28.680297] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:06:28.680734] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-17T05:06:28.680833] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-17T05:06:28.681801] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-17T05:06:28.681868] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-17T05:06:28.695226] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-17T05:06:29.059151] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T05:06:29.098005] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:06:29.490172] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-11. [2025-09-17T05:06:29.720273] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T05:06:30.290234] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-17T05:06:30.833881] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-17T05:06:30.840464] [INFO ] [REMOTE ] MO: Full fetch complete (77824 records). [2025-09-17T05:06:30.840629] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-17T05:06:31.101761] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-17T05:06:31.241334] [DEBUG] [VALIDATOR ] MO: All expected trading days are present. [2025-09-17T05:06:31.241560] [DEBUG] [VALIDATOR ] MO: Primary data validation passed. [2025-09-17T05:06:31.242822] [INFO ] [MAIN ] MO: Fetched primary data is valid. [2025-09-17T05:06:31.242996] [DEBUG] [LOCAL ] MO: Saving primary data. [2025-09-17T05:06:31.245159] [DEBUG] [LOCAL ] MO: Trimmed 77824 records to 53754 (keeping 200 days of data) [2025-09-17T05:06:31.371225] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T05:06:31.635415] [DEBUG] [LOCAL ] MO: Primary data saved (53754 records). [2025-09-17T05:06:31.635629] [INFO ] [MAIN ] MO: Full history saved. [2025-09-17T05:06:31.635786] [INFO ] [MAIN ] Update Progress: 1385/2369 symbols completed. MO took 41.8s. Estimated remaining: 2h 23m 49s. Rate: 6.8 symbols/min [2025-09-17T05:06:31.814058] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:06:31.831237] [DEBUG] [LOCAL ] MOV: Loaded 15530 existing records from primary storage. [2025-09-17T05:06:31.831439] [INFO ] [MAIN ] MOV: Loaded 15530 existing records. [2025-09-17T05:06:31.898897] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-09-17T05:06:32.043040] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:06:32.043442] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-17T05:06:32.043509] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-17T05:06:32.044194] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-17T05:06:32.044265] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-17T05:06:32.489332] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:06:32.533089] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-17T05:06:32.640952] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T05:06:32.690136] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-17T05:06:33.490150] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-17T05:06:33.688062] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T05:06:34.290191] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-17T05:06:34.367129] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T05:06:34.373562] [INFO ] [REMOTE ] MODG: Full fetch complete (74604 records). [2025-09-17T05:06:34.373842] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-17T05:06:34.769121] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-17T05:06:34.769293] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-17T05:06:34.770542] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-17T05:06:34.770717] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-17T05:06:34.772615] [DEBUG] [LOCAL ] MODG: Trimmed 74604 records to 51634 (keeping 200 days of data) [2025-09-17T05:06:34.890082] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T05:06:35.090835] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-11. [2025-09-17T05:06:35.116863] [DEBUG] [LOCAL ] MODG: Primary data saved (51634 records). [2025-09-17T05:06:35.117144] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-17T05:06:35.117396] [INFO ] [MAIN ] Update Progress: 1386/2369 symbols completed. MODG took 37.7s. Estimated remaining: 2h 23m 36s. Rate: 6.8 symbols/min [2025-09-17T05:06:35.294466] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:06:35.336684] [DEBUG] [LOCAL ] MP: Loaded 40094 existing records from primary storage. [2025-09-17T05:06:35.336947] [INFO ] [MAIN ] MP: Loaded 40094 existing records. [2025-09-17T05:06:35.521219] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:06:35.521579] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-17T05:06:35.521659] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-17T05:06:35.522781] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-17T05:06:35.522848] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-17T05:06:35.896877] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-17T05:06:35.918179] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:06:36.071892] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T05:06:36.196096] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T05:06:36.690192] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-17T05:06:37.490180] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-09-17T05:06:37.786393] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T05:06:38.292480] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-17T05:06:38.295836] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T05:06:38.345986] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T05:06:39.090163] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-11. [2025-09-17T05:06:39.890177] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-09-17T05:06:40.048308] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T05:06:40.463842] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T05:06:40.690193] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-17T05:06:40.912865] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T05:06:41.490165] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-09-17T05:06:42.290145] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-17T05:06:42.417706] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T05:06:42.424126] [INFO ] [REMOTE ] MOH: Full fetch complete (57699 records). [2025-09-17T05:06:42.424316] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-17T05:06:42.819798] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-17T05:06:42.819966] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-17T05:06:42.821540] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-17T05:06:42.821634] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-17T05:06:42.823673] [DEBUG] [LOCAL ] MOH: Trimmed 57699 records to 41704 (keeping 200 days of data) [2025-09-17T05:06:43.090431] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-17T05:06:43.123634] [DEBUG] [LOCAL ] MOH: Primary data saved (41704 records). [2025-09-17T05:06:43.123928] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-17T05:06:43.124137] [INFO ] [MAIN ] Update Progress: 1387/2369 symbols completed. MOH took 29.6s. Estimated remaining: 2h 23m 27s. Rate: 6.8 symbols/min [2025-09-17T05:06:43.307629] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:06:43.316289] [DEBUG] [LOCAL ] MPA: Loaded 4016 existing records from primary storage. [2025-09-17T05:06:43.316529] [INFO ] [MAIN ] MPA: Loaded 4016 existing records. [2025-09-17T05:06:43.507873] [WARN ] [MAIN ] MPA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:06:43.508778] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-17T05:06:43.509233] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-17T05:06:43.550172] [DEBUG] [LOCAL ] MPA: Deleted primary data file. [2025-09-17T05:06:43.554328] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-17T05:06:43.555429] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T05:06:43.574930] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T05:06:43.905092] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-17T05:06:43.954312] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:06:44.690169] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-09-17T05:06:44.845511] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T05:06:44.903043] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T05:06:45.490148] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-17T05:06:46.302484] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-11. [2025-09-17T05:06:46.310909] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T05:06:46.862533] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T05:06:46.932476] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T05:06:47.090183] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-09-17T05:06:47.670396] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T05:06:47.890172] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-17T05:06:48.173374] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-17T05:06:48.690245] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-17T05:06:49.330897] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T05:06:49.490221] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-17T05:06:50.040769] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T05:06:50.290139] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-17T05:06:51.090141] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-17T05:06:51.724022] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T05:06:51.890187] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-17T05:06:52.690158] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-17T05:06:52.955987] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T05:06:52.994296] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T05:06:53.490263] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-17T05:06:54.290135] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-17T05:06:54.631815] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T05:06:54.968018] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T05:06:55.036547] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T05:06:55.090208] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-17T05:06:55.890169] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-17T05:06:55.996930] [DEBUG] [REMOTE ] MPA: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-17T05:06:55.997447] [WARN ] [REMOTE ] MPA: No data returned for month 2025-04 [2025-09-17T05:06:56.109724] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T05:06:56.690214] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-17T05:06:57.298873] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T05:06:57.490178] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-17T05:06:58.186261] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T05:06:58.290171] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-17T05:06:58.744509] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T05:06:59.090375] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-17T05:06:59.890304] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-17T05:07:00.098354] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T05:07:00.690357] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-17T05:07:01.490198] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-17T05:07:01.797418] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T05:07:02.086339] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T05:07:02.290176] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-17T05:07:02.456121] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T05:07:03.090170] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-17T05:07:03.344287] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T05:07:03.348303] [INFO ] [REMOTE ] MOV: Full fetch complete (30634 records). [2025-09-17T05:07:03.348712] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-17T05:07:03.561946] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T05:07:03.584521] [INFO ] [REMOTE ] MPA: Full fetch complete (5991 records). [2025-09-17T05:07:03.661457] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-17T05:07:03.900639] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-17T05:07:03.938929] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-17T05:07:03.976090] [WARN ] [VALIDATOR ] MPA: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T05:07:03.976507] [FATAL] [MAIN ] MPA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:07:03.976563] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-17T05:07:03.976662] [WARN ] [MAIN ] MPA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:07:03.977843] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-17T05:07:03.978107] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-17T05:07:03.978162] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-17T05:07:03.978327] [DEBUG] [LOCAL ] MPA: No primary data file found to delete. [2025-09-17T05:07:03.978634] [INFO ] [LOCAL ] MPA: Starting deletion of derivative data. [2025-09-17T05:07:03.979580] [DEBUG] [LOCAL ] MOV: Trimmed 30634 records to 22381 (keeping 200 days of data) [2025-09-17T05:07:03.979616] [DEBUG] [LOCAL ] MPA: Deleted derivative data file. [2025-09-17T05:07:03.979861] [INFO ] [MAIN ] Update Progress: 1388/2369 symbols completed. MPA took 20.9s. Estimated remaining: 2h 23m 26s. Rate: 6.8 symbols/min [2025-09-17T05:07:04.266462] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:07:04.368603] [DEBUG] [LOCAL ] MPC: Loaded 38723 existing records from primary storage. [2025-09-17T05:07:04.370500] [INFO ] [MAIN ] MPC: Loaded 38723 existing records. [2025-09-17T05:07:04.371171] [DEBUG] [LOCAL ] MOV: Primary data saved (22381 records). [2025-09-17T05:07:04.452514] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-17T05:07:04.487714] [INFO ] [MAIN ] Update Progress: 1389/2369 symbols completed. MOV took 32.9s. Estimated remaining: 2h 23m 12s. Rate: 6.8 symbols/min [2025-09-17T05:07:04.693101] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-17T05:07:04.707873] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:07:04.764335] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:07:04.765557] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-17T05:07:04.765697] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-17T05:07:04.767053] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-17T05:07:04.767174] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-17T05:07:05.117735] [DEBUG] [LOCAL ] MPLX: Loaded 37526 existing records from primary storage. [2025-09-17T05:07:05.144121] [INFO ] [MAIN ] MPLX: Loaded 37526 existing records. [2025-09-17T05:07:05.283761] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:07:05.414030] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:07:05.414596] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-17T05:07:05.414702] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-17T05:07:05.415802] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-17T05:07:05.415872] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-17T05:07:05.495306] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-11. [2025-09-17T05:07:05.789393] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:07:05.825889] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T05:07:06.290236] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-11. [2025-09-17T05:07:07.003000] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-17T05:07:07.090236] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-17T05:07:07.229089] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T05:07:07.711376] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T05:07:07.890171] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-09-17T05:07:08.690190] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-17T05:07:09.159098] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T05:07:09.490230] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-17T05:07:09.577477] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T05:07:10.187012] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T05:07:10.194420] [INFO ] [REMOTE ] MOS: Full fetch complete (77312 records). [2025-09-17T05:07:10.194694] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-17T05:07:10.296560] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-09-17T05:07:10.617671] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-17T05:07:10.617877] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-17T05:07:10.619253] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-17T05:07:10.619326] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-17T05:07:10.621560] [DEBUG] [LOCAL ] MOS: Trimmed 77312 records to 53521 (keeping 200 days of data) [2025-09-17T05:07:10.986316] [DEBUG] [LOCAL ] MOS: Primary data saved (53521 records). [2025-09-17T05:07:10.986565] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-17T05:07:10.986707] [INFO ] [MAIN ] Update Progress: 1390/2369 symbols completed. MOS took 42.7s. Estimated remaining: 2h 23m 2s. Rate: 6.8 symbols/min [2025-09-17T05:07:11.093608] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-09-17T05:07:11.167845] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:07:11.168178] [DEBUG] [LOCAL ] MPV: No existing data file found in primary storage. [2025-09-17T05:07:11.168231] [WARN ] [MAIN ] MPV: No existing data found, performing full refresh instead. [2025-09-17T05:07:11.168358] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-17T05:07:11.168413] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-17T05:07:11.168466] [DEBUG] [LOCAL ] MPV: No primary data file found to delete. [2025-09-17T05:07:11.168511] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-17T05:07:11.560271] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:07:11.890227] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-11. [2025-09-17T05:07:11.993392] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-17T05:07:12.229825] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T05:07:12.250790] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T05:07:12.690129] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-17T05:07:12.794133] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T05:07:13.490145] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-17T05:07:14.290219] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-09-17T05:07:14.937521] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T05:07:15.017248] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T05:07:15.090106] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-17T05:07:15.286276] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-17T05:07:15.890154] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-09-17T05:07:16.269203] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T05:07:16.690147] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-17T05:07:16.850509] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T05:07:17.490183] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-17T05:07:18.181696] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T05:07:18.290132] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-17T05:07:19.090142] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-09-17T05:07:19.285668] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-17T05:07:19.314067] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T05:07:19.890149] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-17T05:07:20.500354] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T05:07:20.690130] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-17T05:07:20.835169] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T05:07:21.286295] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T05:07:21.490176] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-17T05:07:22.182609] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T05:07:22.290118] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-17T05:07:22.817539] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T05:07:23.090158] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-17T05:07:23.890141] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-17T05:07:24.690168] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-17T05:07:25.269124] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T05:07:25.490139] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-17T05:07:25.648146] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T05:07:25.757822] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-17T05:07:25.764599] [INFO ] [REMOTE ] MP: Full fetch complete (77118 records). [2025-09-17T05:07:25.764853] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-17T05:07:26.142630] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T05:07:26.186112] [INFO ] [REMOTE ] MPV: Full fetch complete (8066 records). [2025-09-17T05:07:26.186463] [DEBUG] [VALIDATOR ] MP: All expected trading days are present. [2025-09-17T05:07:26.186862] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-17T05:07:26.186938] [DEBUG] [VALIDATOR ] MP: Primary data validation passed. [2025-09-17T05:07:26.188897] [INFO ] [MAIN ] MP: Fetched primary data is valid. [2025-09-17T05:07:26.212282] [DEBUG] [LOCAL ] MP: Saving primary data. [2025-09-17T05:07:26.295458] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-17T05:07:26.317445] [DEBUG] [LOCAL ] MP: Trimmed 77118 records to 53646 (keeping 200 days of data) [2025-09-17T05:07:26.690299] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-17T05:07:26.691684] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-17T05:07:26.692789] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-17T05:07:26.693210] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-17T05:07:26.696556] [DEBUG] [LOCAL ] MPV: Trimmed 8066 records to 5206 (keeping 200 days of data) [2025-09-17T05:07:26.741461] [DEBUG] [LOCAL ] MPV: Primary data saved (5206 records). [2025-09-17T05:07:26.742698] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-17T05:07:26.743326] [INFO ] [MAIN ] Update Progress: 1391/2369 symbols completed. MPV took 15.8s. Estimated remaining: 2h 22m 58s. Rate: 6.8 symbols/min [2025-09-17T05:07:26.983708] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:07:26.984171] [DEBUG] [LOCAL ] MPW: No existing data file found in primary storage. [2025-09-17T05:07:27.012799] [WARN ] [MAIN ] MPW: No existing data found, performing full refresh instead. [2025-09-17T05:07:27.014752] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-17T05:07:27.015583] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-17T05:07:27.016579] [DEBUG] [LOCAL ] MPW: No primary data file found to delete. [2025-09-17T05:07:27.017111] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-17T05:07:27.094824] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-17T05:07:27.428493] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:07:27.540846] [DEBUG] [LOCAL ] MP: Primary data saved (53646 records). [2025-09-17T05:07:27.541121] [INFO ] [MAIN ] MP: Full history saved. [2025-09-17T05:07:27.541327] [INFO ] [MAIN ] Update Progress: 1392/2369 symbols completed. MP took 52.4s. Estimated remaining: 2h 22m 43s. Rate: 6.8 symbols/min [2025-09-17T05:07:27.732234] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:07:27.738614] [DEBUG] [LOCAL ] MPX: Loaded 2879 existing records from primary storage. [2025-09-17T05:07:27.738824] [INFO ] [MAIN ] MPX: Loaded 2879 existing records. [2025-09-17T05:07:27.897892] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-11. [2025-09-17T05:07:27.930330] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:07:27.930728] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-17T05:07:27.930793] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-17T05:07:27.931230] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-17T05:07:27.931294] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-17T05:07:28.311840] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:07:28.348205] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T05:07:28.690132] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-11. [2025-09-17T05:07:28.915291] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T05:07:29.275221] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T05:07:29.490114] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-09-17T05:07:29.990026] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-11 (2.09 seconds). [2025-09-17T05:07:30.165311] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T05:07:30.290240] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-17T05:07:31.090180] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-09-17T05:07:31.890172] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-17T05:07:32.182000] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T05:07:32.690186] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-09-17T05:07:33.072718] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T05:07:33.150908] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-17T05:07:33.271427] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T05:07:33.490178] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-17T05:07:34.290156] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-17T05:07:34.827299] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T05:07:35.097906] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-17T05:07:35.104271] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T05:07:35.890202] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-17T05:07:36.697268] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-17T05:07:36.703296] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T05:07:37.309847] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T05:07:37.490177] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-17T05:07:37.537252] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T05:07:38.290147] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-17T05:07:39.090149] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-17T05:07:39.275094] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T05:07:39.820155] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T05:07:39.890193] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-17T05:07:40.026564] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T05:07:40.690125] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-17T05:07:41.490151] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-17T05:07:41.724952] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T05:07:42.173166] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T05:07:42.290167] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-17T05:07:42.632494] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T05:07:42.861064] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T05:07:43.090140] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-17T05:07:43.730976] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T05:07:43.890238] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-17T05:07:44.690204] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-17T05:07:45.314843] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T05:07:45.490164] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-17T05:07:45.857482] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T05:07:46.290188] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-17T05:07:46.959251] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T05:07:46.960564] [INFO ] [REMOTE ] MPX: Full fetch complete (6848 records). [2025-09-17T05:07:46.960690] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-17T05:07:47.095276] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-17T05:07:47.360014] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-17T05:07:47.360256] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-17T05:07:47.360708] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-17T05:07:47.361201] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-17T05:07:47.362112] [DEBUG] [LOCAL ] MPX: Trimmed 6848 records to 4315 (keeping 200 days of data) [2025-09-17T05:07:47.424074] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T05:07:47.443430] [DEBUG] [LOCAL ] MPX: Primary data saved (4315 records). [2025-09-17T05:07:47.444078] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-17T05:07:47.445269] [INFO ] [MAIN ] Update Progress: 1393/2369 symbols completed. MPX took 19.9s. Estimated remaining: 2h 22m 42s. Rate: 6.8 symbols/min [2025-09-17T05:07:47.638904] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:07:47.647732] [DEBUG] [LOCAL ] MQT: Loaded 5341 existing records from primary storage. [2025-09-17T05:07:47.647977] [INFO ] [MAIN ] MQT: Loaded 5341 existing records. [2025-09-17T05:07:47.847482] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:07:47.847872] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-17T05:07:47.847940] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-17T05:07:47.848373] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-17T05:07:47.848443] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-17T05:07:47.895432] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-17T05:07:48.223781] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:07:48.690194] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-11. [2025-09-17T05:07:48.866603] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T05:07:49.490184] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-17T05:07:49.531110] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T05:07:50.031460] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T05:07:50.290176] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-17T05:07:51.090204] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-17T05:07:51.240792] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T05:07:51.702589] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T05:07:51.890264] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-17T05:07:52.448251] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T05:07:52.458699] [INFO ] [REMOTE ] MPLX: Full fetch complete (73850 records). [2025-09-17T05:07:52.459008] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-17T05:07:52.702733] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-17T05:07:53.106234] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-17T05:07:53.106372] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-17T05:07:53.107710] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-17T05:07:53.107800] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-17T05:07:53.109563] [DEBUG] [LOCAL ] MPLX: Trimmed 73850 records to 50820 (keeping 200 days of data) [2025-09-17T05:07:53.444892] [DEBUG] [LOCAL ] MPLX: Primary data saved (50820 records). [2025-09-17T05:07:53.445073] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-17T05:07:53.445211] [INFO ] [MAIN ] Update Progress: 1394/2369 symbols completed. MPLX took 49.0s. Estimated remaining: 2h 22m 32s. Rate: 6.8 symbols/min [2025-09-17T05:07:53.502765] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-09-17T05:07:53.631939] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:07:53.654394] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T05:07:53.666344] [INFO ] [REMOTE ] MPC: Full fetch complete (75732 records). [2025-09-17T05:07:53.666694] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-17T05:07:53.672461] [DEBUG] [LOCAL ] MQY: Loaded 11779 existing records from primary storage. [2025-09-17T05:07:53.678008] [INFO ] [MAIN ] MQY: Loaded 11779 existing records. [2025-09-17T05:07:54.185197] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:07:54.284905] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-17T05:07:54.308817] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-17T05:07:54.310216] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-17T05:07:54.343871] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-17T05:07:54.359691] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T05:07:54.481833] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-09-17T05:07:54.542085] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-17T05:07:54.554739] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-17T05:07:54.568004] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-17T05:07:54.568507] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-17T05:07:54.658285] [DEBUG] [LOCAL ] MPC: Trimmed 75732 records to 52148 (keeping 200 days of data) [2025-09-17T05:07:54.941346] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:07:54.994480] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-17T05:07:55.094551] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-11. [2025-09-17T05:07:55.231916] [DEBUG] [LOCAL ] MPC: Primary data saved (52148 records). [2025-09-17T05:07:55.232091] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-17T05:07:55.232206] [INFO ] [MAIN ] Update Progress: 1395/2369 symbols completed. MPC took 51.3s. Estimated remaining: 2h 22m 18s. Rate: 6.8 symbols/min [2025-09-17T05:07:55.402474] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:07:55.413907] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T05:07:55.444781] [DEBUG] [LOCAL ] MRC: Loaded 27104 existing records from primary storage. [2025-09-17T05:07:55.445066] [INFO ] [MAIN ] MRC: Loaded 27104 existing records. [2025-09-17T05:07:55.627098] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:07:55.627403] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-17T05:07:55.627467] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-17T05:07:55.628190] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-17T05:07:55.628257] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-17T05:07:55.899573] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-17T05:07:55.991912] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:07:56.133993] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T05:07:56.694834] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-17T05:07:56.695695] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T05:07:57.490131] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-17T05:07:58.270389] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T05:07:58.290094] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-17T05:07:58.678038] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T05:07:59.090162] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-11. [2025-09-17T05:07:59.248713] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T05:07:59.890125] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-17T05:08:00.222585] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T05:08:00.549198] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T05:08:00.690143] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-17T05:08:01.490154] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-17T05:08:02.258918] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T05:08:02.290155] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-17T05:08:02.607425] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T05:08:02.614516] [INFO ] [REMOTE ] MPW: Full fetch complete (77434 records). [2025-09-17T05:08:02.614752] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-17T05:08:03.037589] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T05:08:03.043562] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-17T05:08:03.044677] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-17T05:08:03.046196] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-17T05:08:03.046308] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-17T05:08:03.048520] [DEBUG] [LOCAL ] MPW: Trimmed 77434 records to 53501 (keeping 200 days of data) [2025-09-17T05:08:03.112818] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-17T05:08:03.420620] [DEBUG] [LOCAL ] MPW: Primary data saved (53501 records). [2025-09-17T05:08:03.420908] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-17T05:08:03.421061] [INFO ] [MAIN ] Update Progress: 1396/2369 symbols completed. MPW took 36.7s. Estimated remaining: 2h 22m 9s. Rate: 6.8 symbols/min [2025-09-17T05:08:03.607135] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:08:03.654121] [DEBUG] [LOCAL ] MRK: Loaded 40141 existing records from primary storage. [2025-09-17T05:08:03.654360] [INFO ] [MAIN ] MRK: Loaded 40141 existing records. [2025-09-17T05:08:03.842568] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:08:03.842930] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-17T05:08:03.843021] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-17T05:08:03.844236] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-17T05:08:03.844313] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-17T05:08:03.893508] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-09-17T05:08:03.960794] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T05:08:04.218621] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:08:04.690171] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-11. [2025-09-17T05:08:05.191373] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T05:08:05.490146] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-09-17T05:08:06.290132] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-17T05:08:06.570392] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T05:08:06.944149] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-11 (2.25 seconds). [2025-09-17T05:08:06.986472] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T05:08:06.988516] [INFO ] [REMOTE ] MQT: Full fetch complete (13413 records). [2025-09-17T05:08:06.988627] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-17T05:08:07.094417] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-17T05:08:07.371883] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-17T05:08:07.372014] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-17T05:08:07.372350] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-17T05:08:07.372402] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-17T05:08:07.372932] [DEBUG] [LOCAL ] MQT: Trimmed 13413 records to 8473 (keeping 200 days of data) [2025-09-17T05:08:07.430347] [DEBUG] [LOCAL ] MQT: Primary data saved (8473 records). [2025-09-17T05:08:07.430575] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-17T05:08:07.430731] [INFO ] [MAIN ] Update Progress: 1397/2369 symbols completed. MQT took 20.0s. Estimated remaining: 2h 21m 57s. Rate: 6.8 symbols/min [2025-09-17T05:08:07.890109] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-09-17T05:08:08.203911] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T05:08:08.690167] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-09-17T05:08:09.123419] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T05:08:09.490145] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-17T05:08:10.290270] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-17T05:08:10.488518] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T05:08:10.674383] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T05:08:11.090203] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-17T05:08:11.798306] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T05:08:11.853563] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T05:08:11.890088] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-17T05:08:12.690175] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-17T05:08:12.741175] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T05:08:13.490136] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-17T05:08:14.150559] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T05:08:14.290206] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-17T05:08:15.090278] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-17T05:08:15.267875] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T05:08:15.619505] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T05:08:15.890188] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-17T05:08:16.674759] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T05:08:16.690092] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-17T05:08:16.869999] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T05:08:17.490145] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-17T05:08:17.860020] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T05:08:18.290144] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-17T05:08:18.440847] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T05:08:19.090128] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-17T05:08:19.661304] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T05:08:19.890129] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-17T05:08:20.069204] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T05:08:20.072241] [INFO ] [REMOTE ] MQY: Full fetch complete (27359 records). [2025-09-17T05:08:20.072369] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-17T05:08:20.483515] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-17T05:08:20.483623] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-17T05:08:20.484266] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-17T05:08:20.484326] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-17T05:08:20.485016] [DEBUG] [LOCAL ] MQY: Trimmed 27359 records to 16732 (keeping 200 days of data) [2025-09-17T05:08:20.595819] [DEBUG] [LOCAL ] MQY: Primary data saved (16732 records). [2025-09-17T05:08:20.596222] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-17T05:08:20.596336] [INFO ] [MAIN ] Update Progress: 1398/2369 symbols completed. MQY took 27.2s. Estimated remaining: 2h 21m 51s. Rate: 6.8 symbols/min [2025-09-17T05:08:20.690178] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-17T05:08:22.074176] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-17T05:08:22.085383] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-17T05:08:22.109205] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T05:08:22.290158] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-17T05:08:23.783394] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T05:08:23.793239] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-17T05:08:24.259686] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-17T05:08:24.271090] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-17T05:08:25.098281] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T05:08:25.106206] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-17T05:08:26.323505] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T05:08:26.329258] [INFO ] [REMOTE ] MRC: Full fetch complete (53814 records). [2025-09-17T05:08:26.329514] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-17T05:08:26.717979] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-17T05:08:26.718189] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-17T05:08:26.719211] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-17T05:08:26.719349] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-17T05:08:26.720806] [DEBUG] [LOCAL ] MRC: Trimmed 53814 records to 37489 (keeping 200 days of data) [2025-09-17T05:08:26.845553] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-17T05:08:26.860859] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-17T05:08:26.984795] [DEBUG] [LOCAL ] MRC: Primary data saved (37489 records). [2025-09-17T05:08:26.984977] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-17T05:08:26.985084] [INFO ] [MAIN ] Update Progress: 1399/2369 symbols completed. MRC took 31.8s. Estimated remaining: 2h 21m 41s. Rate: 6.8 symbols/min [2025-09-17T05:08:29.224475] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-17T05:08:29.236367] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-17T05:08:31.686044] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.45 seconds). [2025-09-17T05:08:31.697137] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-17T05:08:34.117372] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-17T05:08:34.129828] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-17T05:08:36.409957] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-17T05:08:36.421478] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-17T05:08:38.658114] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-17T05:08:38.664680] [INFO ] [REMOTE ] MRK: Full fetch complete (77767 records). [2025-09-17T05:08:38.664848] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-17T05:08:39.069757] [DEBUG] [VALIDATOR ] MRK: All expected trading days are present. [2025-09-17T05:08:39.069902] [DEBUG] [VALIDATOR ] MRK: Primary data validation passed. [2025-09-17T05:08:39.071061] [INFO ] [MAIN ] MRK: Fetched primary data is valid. [2025-09-17T05:08:39.071137] [DEBUG] [LOCAL ] MRK: Saving primary data. [2025-09-17T05:08:39.072815] [DEBUG] [LOCAL ] MRK: Trimmed 77767 records to 53789 (keeping 200 days of data) [2025-09-17T05:08:39.423399] [DEBUG] [LOCAL ] MRK: Primary data saved (53789 records). [2025-09-17T05:08:39.423595] [INFO ] [MAIN ] MRK: Full history saved. [2025-09-17T05:08:39.423705] [INFO ] [MAIN ] Update Progress: 1400/2369 symbols completed. MRK took 36.0s. Estimated remaining: 2h 21m 34s. Rate: 6.8 symbols/min [2025-09-17T05:08:39.992474] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:08:40.117241] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:08:40.121849] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:08:40.145132] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:08:40.158786] [DEBUG] [LOCAL ] MSB: Loaded 5977 existing records from primary storage. [2025-09-17T05:08:40.159060] [INFO ] [MAIN ] MSB: Loaded 5977 existing records. [2025-09-17T05:08:40.227390] [DEBUG] [LOCAL ] MSA: Loaded 13942 existing records from primary storage. [2025-09-17T05:08:40.246979] [INFO ] [MAIN ] MSA: Loaded 13942 existing records. [2025-09-17T05:08:40.486547] [DEBUG] [LOCAL ] MS: Loaded 40047 existing records from primary storage. [2025-09-17T05:08:40.499312] [INFO ] [MAIN ] MS: Loaded 40047 existing records. [2025-09-17T05:08:40.499202] [DEBUG] [LOCAL ] MRP: Loaded 34515 existing records from primary storage. [2025-09-17T05:08:40.474955] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:08:40.520506] [INFO ] [MAIN ] MRP: Loaded 34515 existing records. [2025-09-17T05:08:40.643860] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-17T05:08:40.749801] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-17T05:08:40.780596] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:08:40.796684] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-17T05:08:40.801878] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-17T05:08:40.791385] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-17T05:08:40.822453] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-17T05:08:40.856667] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-17T05:08:40.873911] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-17T05:08:41.001787] [WARN ] [MAIN ] MRP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:08:41.020332] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:08:41.085748] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-17T05:08:41.061742] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-17T05:08:41.111445] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-17T05:08:41.130117] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-17T05:08:41.135693] [DEBUG] [LOCAL ] MRP: Deleted primary data file. [2025-09-17T05:08:41.139491] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-17T05:08:41.144880] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-17T05:08:41.175897] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-17T05:08:41.972399] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:08:41.978595] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:08:41.995036] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-11. [2025-09-17T05:08:41.995508] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-11. [2025-09-17T05:08:42.370300] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:08:42.397555] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-11. [2025-09-17T05:08:42.397294] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:08:42.398574] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-11. [2025-09-17T05:08:42.735242] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:08:42.735602] [WARN ] [REMOTE ] MRP: No data returned for month 2024-11 [2025-09-17T05:08:42.736201] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-17T05:08:42.742864] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T05:08:42.745009] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-09-17T05:08:42.936012] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:08:42.936379] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-17T05:08:42.936867] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-09-17T05:08:43.136846] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:08:43.137231] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-09-17T05:08:43.137711] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-17T05:08:43.193837] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T05:08:43.198099] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-09-17T05:08:43.203723] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T05:08:43.205948] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-09-17T05:08:44.221718] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T05:08:44.232784] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-09-17T05:08:44.245795] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T05:08:44.250585] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-09-17T05:08:44.278632] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T05:08:44.287212] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-17T05:08:44.299879] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T05:08:44.304086] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-17T05:08:45.121295] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T05:08:45.133608] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T05:08:45.145597] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-17T05:08:45.138422] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-17T05:08:45.657250] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-17T05:08:45.660586] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-17T05:08:46.021204] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T05:08:46.033156] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-17T05:08:46.069397] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T05:08:46.082548] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-09-17T05:08:46.094584] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T05:08:46.098496] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-17T05:08:46.420760] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T05:08:46.423229] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-17T05:08:46.793175] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T05:08:46.797246] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-17T05:08:46.896425] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T05:08:47.090173] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-17T05:08:47.639858] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T05:08:47.679682] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T05:08:47.767026] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T05:08:47.890145] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-17T05:08:48.077250] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T05:08:48.690148] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-17T05:08:49.439452] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T05:08:49.459718] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T05:08:49.490182] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-17T05:08:50.290155] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-17T05:08:51.090148] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-17T05:08:51.333081] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T05:08:51.383680] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T05:08:51.843247] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T05:08:51.890134] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-17T05:08:52.690205] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-17T05:08:53.490205] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-17T05:08:53.699951] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T05:08:53.904201] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T05:08:54.290129] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-17T05:08:54.906147] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T05:08:55.090147] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-17T05:08:55.799561] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T05:08:55.801100] [INFO ] [REMOTE ] MSB: Full fetch complete (12874 records). [2025-09-17T05:08:55.801190] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-17T05:08:55.895190] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-17T05:08:56.214552] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-17T05:08:56.214710] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-17T05:08:56.215043] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-17T05:08:56.215095] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-17T05:08:56.215823] [DEBUG] [LOCAL ] MSB: Trimmed 12874 records to 7945 (keeping 200 days of data) [2025-09-17T05:08:56.267180] [DEBUG] [LOCAL ] MSB: Primary data saved (7945 records). [2025-09-17T05:08:56.267382] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-17T05:08:56.267554] [INFO ] [MAIN ] Update Progress: 1401/2369 symbols completed. MSB took 16.8s. Estimated remaining: 2h 21m 31s. Rate: 6.8 symbols/min [2025-09-17T05:08:56.446133] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:08:56.446453] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-17T05:08:56.446755] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-17T05:08:56.446964] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-17T05:08:56.447123] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-17T05:08:56.447274] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-17T05:08:56.447399] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-17T05:08:56.694022] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-17T05:08:56.812586] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:08:56.857858] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-17T05:08:56.875784] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T05:08:57.490178] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-17T05:08:58.290175] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-17T05:08:58.416516] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T05:08:59.090189] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-17T05:08:59.353412] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T05:08:59.510175] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T05:08:59.890182] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-17T05:09:00.695732] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-17T05:09:00.723551] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T05:09:00.904888] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T05:09:00.908237] [INFO ] [REMOTE ] MSA: Full fetch complete (25473 records). [2025-09-17T05:09:00.908542] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-17T05:09:01.314626] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-17T05:09:01.314786] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-17T05:09:01.315617] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-17T05:09:01.315699] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-17T05:09:01.316721] [DEBUG] [LOCAL ] MSA: Trimmed 25473 records to 18785 (keeping 200 days of data) [2025-09-17T05:09:01.450179] [DEBUG] [LOCAL ] MSA: Primary data saved (18785 records). [2025-09-17T05:09:01.450428] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-17T05:09:01.450553] [INFO ] [MAIN ] Update Progress: 1402/2369 symbols completed. MSA took 22.0s. Estimated remaining: 2h 21m 20s. Rate: 6.8 symbols/min [2025-09-17T05:09:01.495220] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-17T05:09:01.634959] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:09:01.663228] [DEBUG] [LOCAL ] MSCI: Loaded 25367 existing records from primary storage. [2025-09-17T05:09:01.663469] [INFO ] [MAIN ] MSCI: Loaded 25367 existing records. [2025-09-17T05:09:01.877144] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:09:01.877495] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-17T05:09:01.877577] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-17T05:09:01.878639] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-17T05:09:01.878747] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-17T05:09:02.295808] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-11. [2025-09-17T05:09:02.307490] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:09:03.090128] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-11. [2025-09-17T05:09:03.514299] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.82 seconds). [2025-09-17T05:09:03.890171] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-17T05:09:04.620666] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-11 (2.32 seconds). [2025-09-17T05:09:04.690207] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-17T05:09:05.047080] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T05:09:05.216874] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (3.72 seconds). [2025-09-17T05:09:05.223252] [INFO ] [REMOTE ] MRP: Full fetch complete (52526 records). [2025-09-17T05:09:05.223457] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-17T05:09:05.422446] [WARN ] [VALIDATOR ] MRP: Validation failed - insufficient historical data. Have 152 unique days, need 200 days [2025-09-17T05:09:05.423094] [FATAL] [MAIN ] MRP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:09:05.423153] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:09:05.423207] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-17T05:09:05.423285] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-17T05:09:05.423337] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-17T05:09:05.423864] [DEBUG] [LOCAL ] MRP: Deleted derivative data file. [2025-09-17T05:09:05.423992] [INFO ] [MAIN ] Update Progress: 1403/2369 symbols completed. MRP took 26.0s. Estimated remaining: 2h 21m 8s. Rate: 6.8 symbols/min [2025-09-17T05:09:05.495919] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-17T05:09:05.604985] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:09:05.620935] [DEBUG] [LOCAL ] MSD: Loaded 12137 existing records from primary storage. [2025-09-17T05:09:05.621159] [INFO ] [MAIN ] MSD: Loaded 12137 existing records. [2025-09-17T05:09:05.806325] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:09:05.806620] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-17T05:09:05.806710] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-17T05:09:05.807152] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-17T05:09:05.807212] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-17T05:09:06.122510] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T05:09:06.209338] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:09:06.236685] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-11 (3.15 seconds). [2025-09-17T05:09:06.290135] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-11. [2025-09-17T05:09:06.778768] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-17T05:09:07.009110] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T05:09:07.090199] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-09-17T05:09:07.890200] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-17T05:09:08.433361] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T05:09:08.690205] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-09-17T05:09:09.490196] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-17T05:09:09.688748] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T05:09:09.783655] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T05:09:10.033217] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T05:09:10.290192] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-09-17T05:09:11.090244] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-17T05:09:11.198007] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T05:09:11.890218] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-17T05:09:12.690196] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-17T05:09:12.858602] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T05:09:12.958974] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T05:09:12.966156] [INFO ] [REMOTE ] MS: Full fetch complete (77585 records). [2025-09-17T05:09:12.966400] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-17T05:09:13.140991] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T05:09:13.405111] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-17T05:09:13.405313] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-17T05:09:13.406851] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-17T05:09:13.406976] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-17T05:09:13.408963] [DEBUG] [LOCAL ] MS: Trimmed 77585 records to 53696 (keeping 200 days of data) [2025-09-17T05:09:13.490263] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-17T05:09:13.801521] [DEBUG] [LOCAL ] MS: Primary data saved (53696 records). [2025-09-17T05:09:13.802483] [INFO ] [MAIN ] MS: Full history saved. [2025-09-17T05:09:13.802928] [INFO ] [MAIN ] Update Progress: 1404/2369 symbols completed. MS took 34.4s. Estimated remaining: 2h 20m 59s. Rate: 6.8 symbols/min [2025-09-17T05:09:13.986283] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:09:14.026295] [DEBUG] [LOCAL ] MSDL: Loaded 27398 existing records from primary storage. [2025-09-17T05:09:14.026532] [INFO ] [MAIN ] MSDL: Loaded 27398 existing records. [2025-09-17T05:09:14.227062] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:09:14.227428] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-17T05:09:14.227504] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-17T05:09:14.228473] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-17T05:09:14.228563] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-17T05:09:14.295471] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-17T05:09:14.638866] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:09:14.722160] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T05:09:14.974247] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T05:09:15.090173] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-17T05:09:15.544855] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T05:09:15.890195] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-17T05:09:16.690238] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-17T05:09:17.115609] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T05:09:17.490161] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-17T05:09:17.866554] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T05:09:18.290202] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-11. [2025-09-17T05:09:18.912461] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T05:09:19.090223] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-17T05:09:19.890238] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-17T05:09:20.056380] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T05:09:20.075149] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T05:09:20.300983] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T05:09:20.690247] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-17T05:09:21.490233] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-09-17T05:09:22.189917] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T05:09:22.290122] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-17T05:09:22.760401] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T05:09:23.090194] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-17T05:09:23.172456] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T05:09:23.890237] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-17T05:09:24.695226] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-09-17T05:09:24.711880] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T05:09:24.755011] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T05:09:25.490188] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-17T05:09:26.133959] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T05:09:26.290232] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-17T05:09:26.843380] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T05:09:26.845474] [INFO ] [REMOTE ] MSC: Full fetch complete (2506 records). [2025-09-17T05:09:26.845765] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-17T05:09:26.980570] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T05:09:27.085214] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-17T05:09:27.085562] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:09:27.085672] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:09:27.085790] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-17T05:09:27.085889] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-17T05:09:27.085994] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-17T05:09:27.086074] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-17T05:09:27.086293] [INFO ] [MAIN ] Update Progress: 1405/2369 symbols completed. MSC took 30.8s. Estimated remaining: 2h 20m 53s. Rate: 6.8 symbols/min [2025-09-17T05:09:27.099742] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-17T05:09:27.291930] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:09:27.318744] [DEBUG] [LOCAL ] MSGE: Loaded 19265 existing records from primary storage. [2025-09-17T05:09:27.318960] [INFO ] [MAIN ] MSGE: Loaded 19265 existing records. [2025-09-17T05:09:27.501393] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:09:27.501739] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-17T05:09:27.501801] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-17T05:09:27.502474] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-17T05:09:27.502547] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-17T05:09:27.897739] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-17T05:09:27.897555] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:09:28.536071] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T05:09:28.649168] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T05:09:28.690183] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-17T05:09:29.490273] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-17T05:09:30.290161] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-11. [2025-09-17T05:09:30.361589] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T05:09:31.090256] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-17T05:09:31.123021] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T05:09:31.680906] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T05:09:31.890232] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-09-17T05:09:32.690232] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-17T05:09:33.159687] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T05:09:33.490183] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-17T05:09:34.153913] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T05:09:34.290243] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-17T05:09:34.846370] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T05:09:35.090105] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-17T05:09:35.554574] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (4.46 seconds). [2025-09-17T05:09:35.588368] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T05:09:35.890225] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-17T05:09:36.316940] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T05:09:36.680700] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T05:09:36.690245] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-17T05:09:37.490312] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-17T05:09:37.623886] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T05:09:38.290178] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-17T05:09:38.790739] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T05:09:38.799966] [INFO ] [REMOTE ] MSCI: Full fetch complete (49709 records). [2025-09-17T05:09:38.800226] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-17T05:09:39.095351] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-17T05:09:39.216988] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-17T05:09:39.217142] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-17T05:09:39.218169] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-17T05:09:39.218236] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-17T05:09:39.219754] [DEBUG] [LOCAL ] MSCI: Trimmed 49709 records to 34729 (keeping 200 days of data) [2025-09-17T05:09:39.474050] [DEBUG] [LOCAL ] MSCI: Primary data saved (34729 records). [2025-09-17T05:09:39.474291] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-17T05:09:39.474498] [INFO ] [MAIN ] Update Progress: 1406/2369 symbols completed. MSCI took 38.0s. Estimated remaining: 2h 20m 47s. Rate: 6.8 symbols/min [2025-09-17T05:09:39.682416] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:09:39.703133] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T05:09:39.721274] [DEBUG] [LOCAL ] MSGS: Loaded 12394 existing records from primary storage. [2025-09-17T05:09:39.721501] [INFO ] [MAIN ] MSGS: Loaded 12394 existing records. [2025-09-17T05:09:39.909501] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-17T05:09:39.915679] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:09:39.917199] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-17T05:09:39.917305] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-17T05:09:39.917890] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-17T05:09:39.917965] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-17T05:09:40.309153] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:09:40.312386] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T05:09:40.690194] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-17T05:09:40.981449] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T05:09:41.490226] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-11. [2025-09-17T05:09:41.801734] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T05:09:42.166457] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T05:09:42.290228] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-17T05:09:43.090270] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-09-17T05:09:43.348790] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T05:09:43.352008] [INFO ] [REMOTE ] MSD: Full fetch complete (21834 records). [2025-09-17T05:09:43.352169] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-17T05:09:43.742345] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-17T05:09:43.742522] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-17T05:09:43.743162] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-17T05:09:43.743239] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-17T05:09:43.745047] [DEBUG] [LOCAL ] MSD: Trimmed 21834 records to 15571 (keeping 200 days of data) [2025-09-17T05:09:43.842989] [DEBUG] [LOCAL ] MSD: Primary data saved (15571 records). [2025-09-17T05:09:43.843183] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-17T05:09:43.843317] [INFO ] [MAIN ] Update Progress: 1407/2369 symbols completed. MSD took 38.4s. Estimated remaining: 2h 20m 35s. Rate: 6.8 symbols/min [2025-09-17T05:09:43.898367] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-17T05:09:43.982845] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T05:09:44.041363] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:09:44.094893] [DEBUG] [LOCAL ] MSI: Loaded 29947 existing records from primary storage. [2025-09-17T05:09:44.095106] [INFO ] [MAIN ] MSI: Loaded 29947 existing records. [2025-09-17T05:09:44.290279] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:09:44.290575] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-17T05:09:44.290631] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-17T05:09:44.291675] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-17T05:09:44.291746] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-17T05:09:44.693223] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-17T05:09:44.693138] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:09:45.335872] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T05:09:45.490128] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-17T05:09:45.900180] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T05:09:46.290171] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-11. [2025-09-17T05:09:46.848532] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T05:09:47.090145] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-17T05:09:47.768724] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T05:09:47.890175] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-09-17T05:09:48.282934] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T05:09:48.690188] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-17T05:09:49.148742] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T05:09:49.490146] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-09-17T05:09:50.277125] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T05:09:50.290092] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-09-17T05:09:50.305481] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T05:09:51.090143] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-17T05:09:51.895224] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-17T05:09:51.913368] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T05:09:52.568609] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T05:09:52.576185] [INFO ] [REMOTE ] MSDL: Full fetch complete (53988 records). [2025-09-17T05:09:52.576442] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-17T05:09:52.690127] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-17T05:09:52.994029] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-17T05:09:52.994397] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-17T05:09:52.995455] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-17T05:09:52.995609] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-17T05:09:53.007500] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T05:09:53.011238] [DEBUG] [LOCAL ] MSDL: Trimmed 53988 records to 38189 (keeping 200 days of data) [2025-09-17T05:09:53.275254] [DEBUG] [LOCAL ] MSDL: Primary data saved (38189 records). [2025-09-17T05:09:53.275469] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-17T05:09:53.275584] [INFO ] [MAIN ] Update Progress: 1408/2369 symbols completed. MSDL took 39.5s. Estimated remaining: 2h 20m 27s. Rate: 6.8 symbols/min [2025-09-17T05:09:53.461449] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:09:53.476039] [DEBUG] [LOCAL ] MSIF: Loaded 10694 existing records from primary storage. [2025-09-17T05:09:53.476254] [INFO ] [MAIN ] MSIF: Loaded 10694 existing records. [2025-09-17T05:09:53.498913] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-17T05:09:53.680134] [WARN ] [MAIN ] MSIF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:09:53.680531] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-17T05:09:53.680603] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-17T05:09:53.681256] [DEBUG] [LOCAL ] MSIF: Deleted primary data file. [2025-09-17T05:09:53.681355] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-17T05:09:54.065920] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:09:54.232308] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T05:09:54.290371] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-11. [2025-09-17T05:09:54.430425] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T05:09:54.492212] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:09:54.492663] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-11 [2025-09-17T05:09:55.090162] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-17T05:09:55.890155] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-17T05:09:56.194217] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T05:09:56.200920] [INFO ] [REMOTE ] MSGE: Full fetch complete (40003 records). [2025-09-17T05:09:56.201398] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-17T05:09:56.689993] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-17T05:09:56.690240] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-17T05:09:56.690408] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-17T05:09:56.692586] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-17T05:09:56.692781] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-17T05:09:56.694180] [DEBUG] [LOCAL ] MSGE: Trimmed 40003 records to 26955 (keeping 200 days of data) [2025-09-17T05:09:56.868605] [DEBUG] [LOCAL ] MSGE: Primary data saved (26955 records). [2025-09-17T05:09:56.868865] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-17T05:09:56.868993] [INFO ] [MAIN ] Update Progress: 1409/2369 symbols completed. MSGE took 29.8s. Estimated remaining: 2h 20m 15s. Rate: 6.8 symbols/min [2025-09-17T05:09:57.049844] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:09:57.066978] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T05:09:57.097396] [DEBUG] [LOCAL ] MSM: Loaded 25497 existing records from primary storage. [2025-09-17T05:09:57.097833] [INFO ] [MAIN ] MSM: Loaded 25497 existing records. [2025-09-17T05:09:57.305658] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:09:57.306061] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-17T05:09:57.306144] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-17T05:09:57.307164] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-17T05:09:57.307257] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-17T05:09:57.495452] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-17T05:09:57.826875] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:09:58.290163] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-17T05:09:58.375316] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T05:09:58.501857] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:09:58.502342] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-17T05:09:58.671118] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T05:09:59.090172] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-17T05:09:59.890173] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-17T05:10:00.044897] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T05:10:00.690228] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-11. [2025-09-17T05:10:01.490227] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-09-17T05:10:01.564493] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T05:10:02.041278] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T05:10:02.185569] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T05:10:02.290186] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-09-17T05:10:03.090200] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-17T05:10:03.777050] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T05:10:03.890231] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-17T05:10:04.001610] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T05:10:04.690152] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-17T05:10:05.400928] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T05:10:05.490217] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-17T05:10:05.562099] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T05:10:06.290211] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-17T05:10:06.575990] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T05:10:07.090156] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-17T05:10:07.767846] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T05:10:07.830296] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T05:10:07.890181] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-17T05:10:08.690177] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-17T05:10:09.434280] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T05:10:09.490197] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-17T05:10:09.726024] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T05:10:10.290224] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-17T05:10:10.882041] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T05:10:11.090204] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-09-17T05:10:11.142236] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T05:10:11.890243] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-17T05:10:12.336381] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T05:10:12.690271] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-17T05:10:12.908811] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T05:10:13.490254] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-17T05:10:13.708275] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T05:10:14.290217] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-17T05:10:14.995097] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T05:10:15.000580] [INFO ] [REMOTE ] MSI: Full fetch complete (58322 records). [2025-09-17T05:10:15.000833] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-17T05:10:15.095256] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-17T05:10:15.427979] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-17T05:10:15.428236] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-17T05:10:15.429488] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-17T05:10:15.429591] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-17T05:10:15.440438] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T05:10:15.444365] [INFO ] [REMOTE ] MSGS: Full fetch complete (21734 records). [2025-09-17T05:10:15.444577] [DEBUG] [LOCAL ] MSI: Trimmed 58322 records to 40754 (keeping 200 days of data) [2025-09-17T05:10:15.444847] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-17T05:10:15.900953] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-17T05:10:15.954853] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-17T05:10:15.956082] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-17T05:10:15.957823] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-17T05:10:15.959932] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-17T05:10:15.963372] [DEBUG] [LOCAL ] MSGS: Trimmed 21734 records to 16715 (keeping 200 days of data) [2025-09-17T05:10:16.079239] [DEBUG] [LOCAL ] MSGS: Primary data saved (16715 records). [2025-09-17T05:10:16.081528] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-17T05:10:16.083521] [INFO ] [MAIN ] Update Progress: 1410/2369 symbols completed. MSGS took 36.6s. Estimated remaining: 2h 20m 13s. Rate: 6.8 symbols/min [2025-09-17T05:10:16.398543] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:10:16.450097] [DEBUG] [LOCAL ] MSI: Primary data saved (40754 records). [2025-09-17T05:10:16.462131] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-17T05:10:16.462438] [INFO ] [MAIN ] Update Progress: 1411/2369 symbols completed. MSI took 32.6s. Estimated remaining: 2h 19m 58s. Rate: 6.8 symbols/min [2025-09-17T05:10:16.468901] [DEBUG] [LOCAL ] MT: Loaded 37445 existing records from primary storage. [2025-09-17T05:10:16.512029] [INFO ] [MAIN ] MT: Loaded 37445 existing records. [2025-09-17T05:10:16.820383] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:10:16.843199] [DEBUG] [LOCAL ] MTAL: No existing data file found in primary storage. [2025-09-17T05:10:16.867897] [WARN ] [MAIN ] MTAL: No existing data found, performing full refresh instead. [2025-09-17T05:10:16.867771] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:10:16.869045] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-17T05:10:16.869150] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-17T05:10:16.869361] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-17T05:10:16.869879] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-17T05:10:16.870121] [DEBUG] [LOCAL ] MTAL: No primary data file found to delete. [2025-09-17T05:10:16.876032] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-17T05:10:16.875380] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-17T05:10:16.919119] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-17T05:10:16.920222] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T05:10:16.991185] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-17T05:10:17.107182] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T05:10:17.495290] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-17T05:10:17.755216] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:10:17.795453] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:10:18.290147] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-11. [2025-09-17T05:10:18.316380] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T05:10:18.991867] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T05:10:19.090141] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-17T05:10:19.465569] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T05:10:19.890143] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-09-17T05:10:20.149677] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T05:10:20.153042] [INFO ] [REMOTE ] MSIF: Full fetch complete (15442 records). [2025-09-17T05:10:20.153164] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-17T05:10:20.339410] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 158 unique days, need 200 days [2025-09-17T05:10:20.339763] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:10:20.339826] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:10:20.339880] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-17T05:10:20.339990] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-17T05:10:20.340045] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-17T05:10:20.340441] [DEBUG] [LOCAL ] MSIF: Deleted derivative data file. [2025-09-17T05:10:20.340549] [INFO ] [MAIN ] Update Progress: 1412/2369 symbols completed. MSIF took 27.1s. Estimated remaining: 2h 19m 46s. Rate: 6.8 symbols/min [2025-09-17T05:10:20.514441] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:10:20.557626] [DEBUG] [LOCAL ] MTB: Loaded 34580 existing records from primary storage. [2025-09-17T05:10:20.557847] [INFO ] [MAIN ] MTB: Loaded 34580 existing records. [2025-09-17T05:10:20.700821] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-11. [2025-09-17T05:10:20.750237] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:10:20.750590] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-17T05:10:20.750674] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-17T05:10:20.752023] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-17T05:10:20.752087] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-17T05:10:21.037074] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T05:10:21.143443] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:10:21.490146] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-11. [2025-09-17T05:10:22.290177] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-09-17T05:10:22.432487] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T05:10:23.090275] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-09-17T05:10:23.180956] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T05:10:23.227569] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T05:10:23.890172] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-09-17T05:10:24.690240] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-17T05:10:24.906667] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T05:10:25.490176] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-17T05:10:25.579676] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T05:10:25.625262] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T05:10:26.290238] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-09-17T05:10:26.948352] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T05:10:27.090202] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-17T05:10:27.896517] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-17T05:10:27.928046] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T05:10:28.432253] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T05:10:28.690167] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-17T05:10:29.317636] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T05:10:29.490228] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-09-17T05:10:30.296430] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-17T05:10:30.305192] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T05:10:31.090111] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-17T05:10:31.652554] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-17T05:10:31.711723] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T05:10:31.890242] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-17T05:10:32.690337] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-17T05:10:32.843419] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T05:10:33.258375] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T05:10:33.490220] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-17T05:10:34.290240] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-17T05:10:34.347891] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T05:10:34.851910] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T05:10:35.090181] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-17T05:10:35.890183] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-17T05:10:36.093964] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T05:10:36.389267] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T05:10:36.690231] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-17T05:10:37.289296] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T05:10:37.490130] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-17T05:10:37.944362] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T05:10:38.290605] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-17T05:10:38.919492] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T05:10:39.090194] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-17T05:10:39.890194] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-17T05:10:39.989919] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T05:10:40.355166] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T05:10:40.361133] [INFO ] [REMOTE ] MSM: Full fetch complete (51632 records). [2025-09-17T05:10:40.361442] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-17T05:10:40.695357] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-17T05:10:40.794093] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-17T05:10:40.794264] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-17T05:10:40.795937] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-17T05:10:40.796050] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-17T05:10:40.797742] [DEBUG] [LOCAL ] MSM: Trimmed 51632 records to 35253 (keeping 200 days of data) [2025-09-17T05:10:41.050322] [DEBUG] [LOCAL ] MSM: Primary data saved (35253 records). [2025-09-17T05:10:41.050578] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-17T05:10:41.050722] [INFO ] [MAIN ] Update Progress: 1413/2369 symbols completed. MSM took 44.2s. Estimated remaining: 2h 19m 46s. Rate: 6.8 symbols/min [2025-09-17T05:10:41.231233] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:10:41.246028] [DEBUG] [LOCAL ] MTD: Loaded 11088 existing records from primary storage. [2025-09-17T05:10:41.246217] [INFO ] [MAIN ] MTD: Loaded 11088 existing records. [2025-09-17T05:10:41.448169] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:10:41.449408] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-17T05:10:41.479609] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-17T05:10:41.482958] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T05:10:41.483060] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-17T05:10:41.483638] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-17T05:10:41.499802] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-17T05:10:41.896318] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:10:41.983805] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T05:10:42.290168] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-11. [2025-09-17T05:10:43.090184] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-17T05:10:43.348718] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T05:10:43.625455] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-17T05:10:43.890172] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-17T05:10:44.690174] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-09-17T05:10:44.897479] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T05:10:45.490195] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-17T05:10:45.538045] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T05:10:45.781732] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T05:10:46.290163] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-17T05:10:47.052174] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T05:10:47.090173] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-17T05:10:47.655368] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T05:10:47.890171] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-09-17T05:10:48.393223] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T05:10:48.401877] [INFO ] [REMOTE ] MTB: Full fetch complete (68260 records). [2025-09-17T05:10:48.402173] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-17T05:10:48.698523] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-17T05:10:48.842869] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-17T05:10:48.843032] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-17T05:10:48.844473] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-17T05:10:48.844568] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-17T05:10:48.848729] [DEBUG] [LOCAL ] MTB: Trimmed 68260 records to 47268 (keeping 200 days of data) [2025-09-17T05:10:48.930798] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T05:10:49.191138] [DEBUG] [LOCAL ] MTB: Primary data saved (47268 records). [2025-09-17T05:10:49.191374] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-17T05:10:49.191495] [INFO ] [MAIN ] Update Progress: 1414/2369 symbols completed. MTB took 28.9s. Estimated remaining: 2h 19m 36s. Rate: 6.8 symbols/min [2025-09-17T05:10:49.370990] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:10:49.415468] [DEBUG] [LOCAL ] MTDR: Loaded 38375 existing records from primary storage. [2025-09-17T05:10:49.415746] [INFO ] [MAIN ] MTDR: Loaded 38375 existing records. [2025-09-17T05:10:49.495305] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-17T05:10:49.609743] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:10:49.610108] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-17T05:10:49.610176] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-17T05:10:49.611358] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-17T05:10:49.611426] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-17T05:10:49.996861] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:10:50.162047] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T05:10:50.167161] [INFO ] [REMOTE ] MTAL: Full fetch complete (46090 records). [2025-09-17T05:10:50.167339] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-17T05:10:50.295279] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-17T05:10:50.571240] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-17T05:10:50.571396] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-17T05:10:50.572494] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-17T05:10:50.572599] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-17T05:10:50.574189] [DEBUG] [LOCAL ] MTAL: Trimmed 46090 records to 36102 (keeping 200 days of data) [2025-09-17T05:10:50.802001] [DEBUG] [LOCAL ] MTAL: Primary data saved (36102 records). [2025-09-17T05:10:50.802276] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-17T05:10:50.802396] [INFO ] [MAIN ] Update Progress: 1415/2369 symbols completed. MTAL took 34.3s. Estimated remaining: 2h 19m 23s. Rate: 6.8 symbols/min [2025-09-17T05:10:50.982760] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:10:51.028472] [DEBUG] [LOCAL ] MTG: Loaded 37903 existing records from primary storage. [2025-09-17T05:10:51.028726] [INFO ] [MAIN ] MTG: Loaded 37903 existing records. [2025-09-17T05:10:51.095218] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-11. [2025-09-17T05:10:51.223839] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:10:51.224258] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-17T05:10:51.224337] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-17T05:10:51.225448] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-17T05:10:51.225530] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-17T05:10:51.522115] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T05:10:51.703722] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:10:51.709846] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T05:10:51.890175] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-11. [2025-09-17T05:10:52.500496] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T05:10:52.690442] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-17T05:10:53.490146] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-09-17T05:10:53.568814] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T05:10:53.721764] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T05:10:54.290225] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-17T05:10:55.090181] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-17T05:10:55.172919] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T05:10:55.240668] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T05:10:55.890172] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-09-17T05:10:56.670492] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T05:10:56.690077] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-17T05:10:57.490275] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-17T05:10:57.493918] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T05:10:58.011205] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T05:10:58.290164] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-09-17T05:10:58.722736] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T05:10:59.090159] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-17T05:10:59.890171] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-17T05:10:59.952854] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T05:11:00.030746] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T05:11:00.690155] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-17T05:11:01.490159] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-17T05:11:01.549620] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T05:11:01.556250] [INFO ] [REMOTE ] MT: Full fetch complete (73430 records). [2025-09-17T05:11:01.556474] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-17T05:11:01.929727] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T05:11:01.981725] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-17T05:11:01.981847] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-17T05:11:01.983177] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-17T05:11:01.983254] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-17T05:11:01.985187] [DEBUG] [LOCAL ] MT: Trimmed 73430 records to 50934 (keeping 200 days of data) [2025-09-17T05:11:02.290493] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-17T05:11:02.311811] [DEBUG] [LOCAL ] MT: Primary data saved (50934 records). [2025-09-17T05:11:02.312006] [INFO ] [MAIN ] MT: Full history saved. [2025-09-17T05:11:02.312141] [INFO ] [MAIN ] Update Progress: 1416/2369 symbols completed. MT took 46.2s. Estimated remaining: 2h 19m 16s. Rate: 6.8 symbols/min [2025-09-17T05:11:02.484484] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:11:02.518888] [DEBUG] [LOCAL ] MTH: Loaded 32475 existing records from primary storage. [2025-09-17T05:11:02.519102] [INFO ] [MAIN ] MTH: Loaded 32475 existing records. [2025-09-17T05:11:02.738491] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:11:02.738823] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-17T05:11:02.738885] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-17T05:11:02.739585] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-17T05:11:02.739674] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-17T05:11:03.092447] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-09-17T05:11:03.134116] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:11:03.146540] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T05:11:03.180082] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T05:11:03.890219] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-17T05:11:04.690210] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-11. [2025-09-17T05:11:04.738848] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T05:11:04.741109] [INFO ] [REMOTE ] MTD: Full fetch complete (21126 records). [2025-09-17T05:11:04.741442] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-17T05:11:05.109408] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-17T05:11:05.200429] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-17T05:11:05.200581] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-17T05:11:05.201421] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-17T05:11:05.201500] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-17T05:11:05.202445] [DEBUG] [LOCAL ] MTD: Trimmed 21126 records to 15407 (keeping 200 days of data) [2025-09-17T05:11:05.307677] [DEBUG] [LOCAL ] MTD: Primary data saved (15407 records). [2025-09-17T05:11:05.307879] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-17T05:11:05.307994] [INFO ] [MAIN ] Update Progress: 1417/2369 symbols completed. MTD took 24.3s. Estimated remaining: 2h 19m 3s. Rate: 6.8 symbols/min [2025-09-17T05:11:05.477548] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:11:05.498329] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-17T05:11:05.518983] [DEBUG] [LOCAL ] MTN: Loaded 28880 existing records from primary storage. [2025-09-17T05:11:05.519202] [INFO ] [MAIN ] MTN: Loaded 28880 existing records. [2025-09-17T05:11:05.699513] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:11:05.699889] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-17T05:11:05.700005] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-17T05:11:05.700793] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-17T05:11:05.700856] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-17T05:11:06.023688] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T05:11:06.092512] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:11:06.290151] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-11. [2025-09-17T05:11:07.090143] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-17T05:11:07.159492] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T05:11:07.596331] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T05:11:07.890162] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-09-17T05:11:08.381202] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T05:11:08.690163] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-17T05:11:09.163868] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T05:11:09.490217] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-09-17T05:11:10.290116] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-17T05:11:10.409223] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T05:11:10.847523] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T05:11:11.090196] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-09-17T05:11:11.890111] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-17T05:11:11.996778] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T05:11:12.165427] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T05:11:12.690199] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-17T05:11:13.286931] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T05:11:13.490159] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-17T05:11:14.290143] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-09-17T05:11:14.576671] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T05:11:14.857997] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T05:11:15.090187] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-17T05:11:15.808459] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T05:11:15.890145] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-17T05:11:16.666903] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T05:11:16.690137] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-17T05:11:17.387247] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T05:11:17.490142] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-17T05:11:18.290142] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-17T05:11:18.392327] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T05:11:19.013996] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T05:11:19.090148] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-17T05:11:19.890153] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-17T05:11:19.992583] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T05:11:20.690266] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-17T05:11:20.761233] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T05:11:21.058519] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T05:11:21.490210] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-17T05:11:21.870679] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T05:11:22.290191] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-17T05:11:22.597052] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T05:11:23.090236] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-17T05:11:23.749175] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T05:11:23.890155] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-17T05:11:24.408086] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T05:11:24.690198] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-17T05:11:25.115505] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T05:11:25.490188] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-17T05:11:25.976227] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T05:11:26.290168] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-17T05:11:27.029500] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T05:11:27.090186] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-17T05:11:27.900693] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-17T05:11:27.908488] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T05:11:28.596575] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T05:11:28.602942] [INFO ] [REMOTE ] MTDR: Full fetch complete (73179 records). [2025-09-17T05:11:28.603161] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-17T05:11:28.696398] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-17T05:11:29.027166] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-17T05:11:29.027291] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-17T05:11:29.028462] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-17T05:11:29.028524] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-17T05:11:29.030103] [DEBUG] [LOCAL ] MTDR: Trimmed 73179 records to 51570 (keeping 200 days of data) [2025-09-17T05:11:29.385863] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T05:11:29.385974] [DEBUG] [LOCAL ] MTDR: Primary data saved (51570 records). [2025-09-17T05:11:29.386231] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-17T05:11:29.393462] [INFO ] [MAIN ] Update Progress: 1418/2369 symbols completed. MTDR took 40.2s. Estimated remaining: 2h 19m 5s. Rate: 6.8 symbols/min [2025-09-17T05:11:29.494839] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-17T05:11:29.565871] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:11:29.569258] [DEBUG] [LOCAL ] MTR: Loaded 1590 existing records from primary storage. [2025-09-17T05:11:29.569363] [INFO ] [MAIN ] MTR: Loaded 1590 existing records. [2025-09-17T05:11:29.750263] [WARN ] [MAIN ] MTR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:11:29.750572] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-17T05:11:29.750666] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-17T05:11:29.750942] [DEBUG] [LOCAL ] MTR: Deleted primary data file. [2025-09-17T05:11:29.751011] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-17T05:11:30.118943] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:11:30.290166] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-17T05:11:30.340374] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T05:11:30.970926] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T05:11:30.980467] [INFO ] [REMOTE ] MTN: Full fetch complete (56084 records). [2025-09-17T05:11:30.980753] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-17T05:11:31.095304] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-11. [2025-09-17T05:11:31.396424] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-17T05:11:31.396599] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-17T05:11:31.397707] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-17T05:11:31.397778] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-17T05:11:31.399431] [DEBUG] [LOCAL ] MTN: Trimmed 56084 records to 39017 (keeping 200 days of data) [2025-09-17T05:11:31.630629] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T05:11:31.672742] [DEBUG] [LOCAL ] MTN: Primary data saved (39017 records). [2025-09-17T05:11:31.673209] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-17T05:11:31.673441] [INFO ] [MAIN ] Update Progress: 1419/2369 symbols completed. MTN took 26.4s. Estimated remaining: 2h 18m 52s. Rate: 6.8 symbols/min [2025-09-17T05:11:31.855379] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:11:31.890270] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-17T05:11:31.895011] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T05:11:31.922808] [DEBUG] [LOCAL ] MTRN: Loaded 13726 existing records from primary storage. [2025-09-17T05:11:31.923036] [INFO ] [MAIN ] MTRN: Loaded 13726 existing records. [2025-09-17T05:11:32.108765] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:11:32.109097] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-17T05:11:32.109162] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-17T05:11:32.109722] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-17T05:11:32.109784] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-17T05:11:32.425504] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T05:11:32.487548] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:11:32.690175] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-11. [2025-09-17T05:11:33.490187] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-17T05:11:33.641258] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T05:11:33.934013] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T05:11:34.290208] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-17T05:11:35.090169] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-17T05:11:35.443401] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T05:11:35.890195] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-17T05:11:35.931980] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T05:11:36.690181] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-17T05:11:37.416275] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T05:11:37.422627] [INFO ] [REMOTE ] MTG: Full fetch complete (73674 records). [2025-09-17T05:11:37.422840] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-17T05:11:37.495465] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-17T05:11:37.873937] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-17T05:11:37.874081] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-17T05:11:37.875290] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-17T05:11:37.875363] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-17T05:11:37.878970] [DEBUG] [LOCAL ] MTG: Trimmed 73674 records to 51338 (keeping 200 days of data) [2025-09-17T05:11:37.955381] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T05:11:38.257635] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T05:11:38.287171] [DEBUG] [LOCAL ] MTG: Primary data saved (51338 records). [2025-09-17T05:11:38.287537] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-17T05:11:38.287927] [INFO ] [MAIN ] Update Progress: 1420/2369 symbols completed. MTG took 47.5s. Estimated remaining: 2h 18m 41s. Rate: 6.8 symbols/min [2025-09-17T05:11:38.295224] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-17T05:11:38.475485] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:11:38.500329] [DEBUG] [LOCAL ] MTUS: Loaded 20861 existing records from primary storage. [2025-09-17T05:11:38.500557] [INFO ] [MAIN ] MTUS: Loaded 20861 existing records. [2025-09-17T05:11:38.684542] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:11:38.684841] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-17T05:11:38.684908] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-17T05:11:38.685534] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-17T05:11:38.685634] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-17T05:11:39.052819] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:11:39.090107] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-11. [2025-09-17T05:11:39.890157] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-17T05:11:39.911508] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T05:11:39.917363] [INFO ] [REMOTE ] MTH: Full fetch complete (61874 records). [2025-09-17T05:11:39.917570] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-17T05:11:40.258308] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T05:11:40.368239] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-17T05:11:40.368560] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-17T05:11:40.369685] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-17T05:11:40.369830] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-17T05:11:40.372074] [DEBUG] [LOCAL ] MTH: Trimmed 61874 records to 43964 (keeping 200 days of data) [2025-09-17T05:11:40.498623] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T05:11:40.698855] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-17T05:11:40.718144] [DEBUG] [LOCAL ] MTH: Primary data saved (43964 records). [2025-09-17T05:11:40.718821] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-17T05:11:40.718983] [INFO ] [MAIN ] Update Progress: 1421/2369 symbols completed. MTH took 38.4s. Estimated remaining: 2h 18m 28s. Rate: 6.8 symbols/min [2025-09-17T05:11:40.902034] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:11:40.925692] [DEBUG] [LOCAL ] MTW: Loaded 19869 existing records from primary storage. [2025-09-17T05:11:40.925915] [INFO ] [MAIN ] MTW: Loaded 19869 existing records. [2025-09-17T05:11:41.087034] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-17T05:11:41.117924] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:11:41.119353] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-17T05:11:41.119435] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-17T05:11:41.120148] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-17T05:11:41.120221] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-17T05:11:41.489364] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:11:41.490078] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-11. [2025-09-17T05:11:42.290168] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-17T05:11:42.776435] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T05:11:43.081840] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T05:11:43.090136] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-17T05:11:43.545930] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T05:11:43.890183] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-09-17T05:11:44.690165] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-17T05:11:44.762054] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T05:11:45.031834] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-17T05:11:45.490185] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-09-17T05:11:46.290185] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-17T05:11:46.687861] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T05:11:46.829091] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T05:11:47.090197] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-09-17T05:11:47.890223] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-17T05:11:48.082346] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T05:11:48.314508] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T05:11:48.315363] [INFO ] [REMOTE ] MTR: Full fetch complete (2618 records). [2025-09-17T05:11:48.315461] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-17T05:11:48.501427] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T05:11:48.501714] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:11:48.501779] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:11:48.501828] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-17T05:11:48.501910] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-17T05:11:48.501976] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-17T05:11:48.502377] [DEBUG] [LOCAL ] MTR: Deleted derivative data file. [2025-09-17T05:11:48.502495] [INFO ] [MAIN ] Update Progress: 1422/2369 symbols completed. MTR took 19.1s. Estimated remaining: 2h 18m 19s. Rate: 6.8 symbols/min [2025-09-17T05:11:48.681345] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:11:48.690306] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-17T05:11:48.710917] [DEBUG] [LOCAL ] MTX: Loaded 17516 existing records from primary storage. [2025-09-17T05:11:48.711136] [INFO ] [MAIN ] MTX: Loaded 17516 existing records. [2025-09-17T05:11:48.899867] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:11:48.900212] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-17T05:11:48.900278] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-17T05:11:48.900946] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-17T05:11:48.901021] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-17T05:11:49.281443] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:11:49.432813] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T05:11:49.490204] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-17T05:11:50.290172] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-17T05:11:50.495155] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T05:11:51.090118] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-09-17T05:11:51.420378] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T05:11:51.890205] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-17T05:11:52.418987] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T05:11:52.690218] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-17T05:11:53.098630] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T05:11:53.490201] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-11. [2025-09-17T05:11:53.755012] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T05:11:54.290170] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-17T05:11:54.480801] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T05:11:55.090195] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-17T05:11:55.371834] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T05:11:55.890186] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-17T05:11:56.343852] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T05:11:56.690202] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-17T05:11:57.107955] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T05:11:57.490269] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-09-17T05:11:57.825938] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T05:11:58.290318] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-17T05:11:58.454871] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T05:11:59.090171] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-17T05:11:59.465127] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T05:11:59.890258] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-09-17T05:12:00.429493] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T05:12:00.690183] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-17T05:12:00.933518] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T05:12:01.490226] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-17T05:12:02.267667] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T05:12:02.290103] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-17T05:12:03.090243] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-17T05:12:03.730405] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-17T05:12:03.890153] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-17T05:12:04.690234] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-17T05:12:05.307515] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (3.02 seconds). [2025-09-17T05:12:05.382533] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-17T05:12:05.490171] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-17T05:12:06.088184] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T05:12:06.290273] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-17T05:12:06.569350] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-17T05:12:06.587760] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T05:12:07.090157] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-17T05:12:07.363299] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T05:12:07.890157] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-17T05:12:08.429906] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T05:12:08.509974] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T05:12:08.513288] [INFO ] [REMOTE ] MTRN: Full fetch complete (22819 records). [2025-09-17T05:12:08.513431] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-17T05:12:08.697104] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-17T05:12:08.961844] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-17T05:12:08.961967] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-17T05:12:08.962679] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-17T05:12:08.962736] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-17T05:12:08.963669] [DEBUG] [LOCAL ] MTRN: Trimmed 22819 records to 17790 (keeping 200 days of data) [2025-09-17T05:12:09.079540] [DEBUG] [LOCAL ] MTRN: Primary data saved (17790 records). [2025-09-17T05:12:09.079736] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-17T05:12:09.079850] [INFO ] [MAIN ] Update Progress: 1423/2369 symbols completed. MTRN took 37.4s. Estimated remaining: 2h 18m 18s. Rate: 6.8 symbols/min [2025-09-17T05:12:09.255603] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:12:09.294377] [DEBUG] [LOCAL ] MTZ: Loaded 31729 existing records from primary storage. [2025-09-17T05:12:09.294615] [INFO ] [MAIN ] MTZ: Loaded 31729 existing records. [2025-09-17T05:12:09.476485] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:12:09.476796] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-17T05:12:09.476865] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-17T05:12:09.477549] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-17T05:12:09.477609] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-17T05:12:09.497817] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-17T05:12:09.848410] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:12:10.135065] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T05:12:10.290192] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-17T05:12:10.631747] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T05:12:10.637073] [INFO ] [REMOTE ] MTW: Full fetch complete (38411 records). [2025-09-17T05:12:10.637349] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-17T05:12:11.045418] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-17T05:12:11.045601] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-17T05:12:11.047130] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-17T05:12:11.047201] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-17T05:12:11.048992] [DEBUG] [LOCAL ] MTW: Trimmed 38411 records to 26679 (keeping 200 days of data) [2025-09-17T05:12:11.099521] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-11. [2025-09-17T05:12:11.219576] [DEBUG] [LOCAL ] MTW: Primary data saved (26679 records). [2025-09-17T05:12:11.219797] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-17T05:12:11.219928] [INFO ] [MAIN ] Update Progress: 1424/2369 symbols completed. MTW took 30.5s. Estimated remaining: 2h 18m 5s. Rate: 6.8 symbols/min [2025-09-17T05:12:11.390740] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:12:11.401437] [DEBUG] [LOCAL ] MUA: Loaded 8428 existing records from primary storage. [2025-09-17T05:12:11.401605] [INFO ] [MAIN ] MUA: Loaded 8428 existing records. [2025-09-17T05:12:11.585307] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:12:11.585789] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-17T05:12:11.585952] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-17T05:12:11.586431] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-17T05:12:11.586594] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-17T05:12:11.727081] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T05:12:11.895074] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-17T05:12:11.975603] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:12:12.690135] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-17T05:12:12.749256] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T05:12:13.129894] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T05:12:13.490138] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-09-17T05:12:13.873050] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T05:12:14.290179] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-11. [2025-09-17T05:12:15.068533] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T05:12:15.090077] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-09-17T05:12:15.164035] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T05:12:15.890220] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-17T05:12:16.690176] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-17T05:12:17.490125] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-09-17T05:12:17.510458] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T05:12:17.578849] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-17T05:12:17.775982] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T05:12:18.012796] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T05:12:18.290144] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-17T05:12:19.090107] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-09-17T05:12:19.553815] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T05:12:19.890139] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-17T05:12:20.041420] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T05:12:20.690138] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-17T05:12:21.370066] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T05:12:21.416610] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T05:12:21.490101] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-17T05:12:22.290133] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-17T05:12:22.791852] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T05:12:23.043531] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T05:12:23.090111] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-17T05:12:23.890142] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-17T05:12:24.290603] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T05:12:24.294443] [INFO ] [REMOTE ] MTUS: Full fetch complete (43010 records). [2025-09-17T05:12:24.294553] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-17T05:12:24.683438] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-17T05:12:24.683678] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-17T05:12:24.685208] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-17T05:12:24.685318] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-17T05:12:24.692504] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-17T05:12:24.706337] [DEBUG] [LOCAL ] MTUS: Trimmed 43010 records to 29113 (keeping 200 days of data) [2025-09-17T05:12:24.708961] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T05:12:24.889457] [DEBUG] [LOCAL ] MTUS: Primary data saved (29113 records). [2025-09-17T05:12:24.889663] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-17T05:12:24.889781] [INFO ] [MAIN ] Update Progress: 1425/2369 symbols completed. MTUS took 46.6s. Estimated remaining: 2h 17m 59s. Rate: 6.8 symbols/min [2025-09-17T05:12:25.059076] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:12:25.075756] [DEBUG] [LOCAL ] MUC: Loaded 14448 existing records from primary storage. [2025-09-17T05:12:25.075951] [INFO ] [MAIN ] MUC: Loaded 14448 existing records. [2025-09-17T05:12:25.251945] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:12:25.252261] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-17T05:12:25.252324] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-17T05:12:25.252783] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-17T05:12:25.252842] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-17T05:12:25.495321] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-17T05:12:25.634899] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:12:25.762678] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T05:12:26.290139] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-11. [2025-09-17T05:12:27.097690] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-17T05:12:27.104034] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T05:12:27.308217] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T05:12:27.890189] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-09-17T05:12:28.079308] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T05:12:28.082389] [INFO ] [REMOTE ] MTX: Full fetch complete (30853 records). [2025-09-17T05:12:28.082508] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-17T05:12:28.460397] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-17T05:12:28.460530] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-17T05:12:28.461408] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-17T05:12:28.461499] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-17T05:12:28.462751] [DEBUG] [LOCAL ] MTX: Trimmed 30853 records to 22887 (keeping 200 days of data) [2025-09-17T05:12:28.621576] [DEBUG] [LOCAL ] MTX: Primary data saved (22887 records). [2025-09-17T05:12:28.621813] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-17T05:12:28.621932] [INFO ] [MAIN ] Update Progress: 1426/2369 symbols completed. MTX took 40.1s. Estimated remaining: 2h 17m 47s. Rate: 6.8 symbols/min [2025-09-17T05:12:28.699263] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-17T05:12:28.796749] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:12:28.807385] [DEBUG] [LOCAL ] MUE: Loaded 9379 existing records from primary storage. [2025-09-17T05:12:28.807543] [INFO ] [MAIN ] MUE: Loaded 9379 existing records. [2025-09-17T05:12:28.987817] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:12:28.988477] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-17T05:12:28.988808] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-17T05:12:29.003248] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-17T05:12:29.005842] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-17T05:12:29.012600] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T05:12:29.388289] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:12:29.490106] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-11. [2025-09-17T05:12:29.667433] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T05:12:30.261066] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T05:12:30.290089] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-09-17T05:12:31.090142] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-17T05:12:31.260510] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T05:12:31.852305] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T05:12:31.890087] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-17T05:12:32.690182] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-17T05:12:32.721493] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T05:12:33.490171] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-17T05:12:34.285606] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T05:12:34.295126] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-17T05:12:34.321906] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T05:12:35.090187] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-17T05:12:35.321107] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T05:12:35.890165] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-09-17T05:12:36.579027] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T05:12:36.620973] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T05:12:36.690173] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-17T05:12:37.490261] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-17T05:12:37.652474] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T05:12:38.290197] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-17T05:12:38.833525] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T05:12:39.090156] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-17T05:12:39.128968] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T05:12:39.866720] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T05:12:39.890101] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-17T05:12:40.674045] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T05:12:40.690125] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-17T05:12:41.481065] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T05:12:41.490255] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-17T05:12:42.290216] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-17T05:12:42.492246] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T05:12:43.090181] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-17T05:12:43.814064] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T05:12:43.844116] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T05:12:43.890178] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-17T05:12:44.690242] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-17T05:12:45.377908] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T05:12:45.383581] [INFO ] [REMOTE ] MTZ: Full fetch complete (63246 records). [2025-09-17T05:12:45.383910] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-17T05:12:45.495251] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-17T05:12:45.788032] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-17T05:12:45.788218] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-17T05:12:45.789381] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-17T05:12:45.789508] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-17T05:12:45.804241] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T05:12:45.809021] [DEBUG] [LOCAL ] MTZ: Trimmed 63246 records to 43668 (keeping 200 days of data) [2025-09-17T05:12:46.093855] [DEBUG] [LOCAL ] MTZ: Primary data saved (43668 records). [2025-09-17T05:12:46.094068] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-17T05:12:46.094203] [INFO ] [MAIN ] Update Progress: 1427/2369 symbols completed. MTZ took 37.0s. Estimated remaining: 2h 17m 44s. Rate: 6.8 symbols/min [2025-09-17T05:12:46.268250] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:12:46.276629] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T05:12:46.290111] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-17T05:12:46.326172] [DEBUG] [LOCAL ] MUFG: Loaded 39152 existing records from primary storage. [2025-09-17T05:12:46.326401] [INFO ] [MAIN ] MUFG: Loaded 39152 existing records. [2025-09-17T05:12:46.510956] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:12:46.511246] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-17T05:12:46.511313] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-17T05:12:46.512215] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-17T05:12:46.512281] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-17T05:12:46.869454] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:12:47.090193] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-17T05:12:47.383342] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T05:12:47.627037] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T05:12:47.890146] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-17T05:12:48.690225] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-17T05:12:48.790146] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T05:12:48.792970] [INFO ] [REMOTE ] MUA: Full fetch complete (18699 records). [2025-09-17T05:12:48.793107] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-17T05:12:49.175363] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-17T05:12:49.175477] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-17T05:12:49.176003] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-17T05:12:49.176061] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-17T05:12:49.176617] [DEBUG] [LOCAL ] MUA: Trimmed 18699 records to 12349 (keeping 200 days of data) [2025-09-17T05:12:49.255000] [DEBUG] [LOCAL ] MUA: Primary data saved (12349 records). [2025-09-17T05:12:49.255182] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-17T05:12:49.255314] [INFO ] [MAIN ] Update Progress: 1428/2369 symbols completed. MUA took 38.0s. Estimated remaining: 2h 17m 32s. Rate: 6.8 symbols/min [2025-09-17T05:12:49.426164] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:12:49.438373] [DEBUG] [LOCAL ] MUJ: Loaded 10300 existing records from primary storage. [2025-09-17T05:12:49.438534] [INFO ] [MAIN ] MUJ: Loaded 10300 existing records. [2025-09-17T05:12:49.500240] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-17T05:12:49.629437] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T05:12:49.649165] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:12:49.654591] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-17T05:12:49.654990] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-17T05:12:49.655393] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-17T05:12:49.655452] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-17T05:12:50.019466] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:12:50.290115] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-11. [2025-09-17T05:12:50.553808] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T05:12:50.555996] [INFO ] [REMOTE ] MUE: Full fetch complete (16273 records). [2025-09-17T05:12:50.556090] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-17T05:12:50.924787] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-17T05:12:50.924923] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-17T05:12:50.925432] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-17T05:12:50.925491] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-17T05:12:50.926302] [DEBUG] [LOCAL ] MUE: Trimmed 16273 records to 11893 (keeping 200 days of data) [2025-09-17T05:12:51.002073] [DEBUG] [LOCAL ] MUE: Primary data saved (11893 records). [2025-09-17T05:12:51.002274] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-17T05:12:51.002403] [INFO ] [MAIN ] Update Progress: 1429/2369 symbols completed. MUE took 22.4s. Estimated remaining: 2h 17m 18s. Rate: 6.8 symbols/min [2025-09-17T05:12:51.095277] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-11. [2025-09-17T05:12:51.189622] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:12:51.191188] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T05:12:51.244455] [DEBUG] [LOCAL ] MUR: Loaded 39364 existing records from primary storage. [2025-09-17T05:12:51.244720] [INFO ] [MAIN ] MUR: Loaded 39364 existing records. [2025-09-17T05:12:51.450684] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:12:51.451016] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-17T05:12:51.451071] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-17T05:12:51.452420] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-17T05:12:51.452492] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-17T05:12:51.846577] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:12:51.890247] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-17T05:12:52.690181] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-09-17T05:12:52.844317] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T05:12:52.912196] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T05:12:53.472170] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T05:12:53.490091] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-17T05:12:54.290175] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-17T05:12:54.559268] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T05:12:55.090203] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-11. [2025-09-17T05:12:55.248266] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T05:12:55.890197] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-17T05:12:56.551534] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T05:12:56.662009] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T05:12:56.690089] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-17T05:12:57.490122] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-17T05:12:57.748477] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T05:12:58.251030] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T05:12:58.290115] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-17T05:12:59.090150] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-09-17T05:12:59.185453] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T05:12:59.890204] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-09-17T05:13:00.621137] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T05:13:00.690176] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-17T05:13:01.490159] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-09-17T05:13:01.505129] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T05:13:01.655851] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T05:13:02.290211] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-17T05:13:03.090187] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-17T05:13:03.213189] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T05:13:03.425264] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T05:13:03.890160] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-17T05:13:04.690106] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-17T05:13:04.777047] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T05:13:04.893921] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T05:13:05.490111] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-17T05:13:05.800434] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T05:13:05.803381] [INFO ] [REMOTE ] MUC: Full fetch complete (29919 records). [2025-09-17T05:13:05.803502] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-17T05:13:06.226392] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-17T05:13:06.226522] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-17T05:13:06.227373] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-17T05:13:06.227461] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-17T05:13:06.228388] [DEBUG] [LOCAL ] MUC: Trimmed 29919 records to 20044 (keeping 200 days of data) [2025-09-17T05:13:06.291399] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-17T05:13:06.357750] [DEBUG] [LOCAL ] MUC: Primary data saved (20044 records). [2025-09-17T05:13:06.357946] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-17T05:13:06.358061] [INFO ] [MAIN ] Update Progress: 1430/2369 symbols completed. MUC took 41.5s. Estimated remaining: 2h 17m 14s. Rate: 6.8 symbols/min [2025-09-17T05:13:06.534704] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:13:06.555118] [DEBUG] [LOCAL ] MUSA: Loaded 18704 existing records from primary storage. [2025-09-17T05:13:06.555305] [INFO ] [MAIN ] MUSA: Loaded 18704 existing records. [2025-09-17T05:13:06.736108] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:13:06.736435] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-17T05:13:06.736496] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-17T05:13:06.737420] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-17T05:13:06.737484] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-17T05:13:07.098137] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:13:07.098235] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-17T05:13:07.177745] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T05:13:07.569702] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T05:13:07.890211] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-11. [2025-09-17T05:13:08.033491] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T05:13:08.690201] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-17T05:13:08.943043] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T05:13:09.490147] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-09-17T05:13:09.685984] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T05:13:09.688559] [INFO ] [REMOTE ] MUJ: Full fetch complete (20396 records). [2025-09-17T05:13:09.688669] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-17T05:13:10.059820] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-17T05:13:10.059943] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-17T05:13:10.060520] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-17T05:13:10.060574] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-17T05:13:10.061193] [DEBUG] [LOCAL ] MUJ: Trimmed 20396 records to 13133 (keeping 200 days of data) [2025-09-17T05:13:10.152179] [DEBUG] [LOCAL ] MUJ: Primary data saved (13133 records). [2025-09-17T05:13:10.152413] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-17T05:13:10.152537] [INFO ] [MAIN ] Update Progress: 1431/2369 symbols completed. MUJ took 20.9s. Estimated remaining: 2h 17m 2s. Rate: 6.8 symbols/min [2025-09-17T05:13:10.299824] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-17T05:13:10.334362] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:13:10.335741] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-17T05:13:10.335972] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-17T05:13:10.336205] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-17T05:13:10.336491] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-17T05:13:10.336737] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-17T05:13:10.336826] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-17T05:13:10.482278] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T05:13:10.757083] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:13:11.090163] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-09-17T05:13:11.890147] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-11. [2025-09-17T05:13:12.101290] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-11 (0.21 seconds). [2025-09-17T05:13:12.201084] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T05:13:12.244195] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T05:13:12.690173] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-17T05:13:13.490193] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-17T05:13:13.705981] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.22 seconds). [2025-09-17T05:13:14.290224] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-17T05:13:14.510048] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T05:13:15.090180] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-17T05:13:15.318888] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:13:15.319312] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-17T05:13:15.511313] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T05:13:15.890191] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-17T05:13:16.690155] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-17T05:13:17.490158] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-17T05:13:17.701622] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:13:17.702147] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-17T05:13:17.747481] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T05:13:18.290162] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-17T05:13:18.486725] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T05:13:19.090202] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-17T05:13:19.890153] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-17T05:13:20.116967] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-17T05:13:20.168424] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T05:13:20.690204] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-17T05:13:20.986335] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T05:13:21.490184] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-17T05:13:21.726266] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-09-17T05:13:22.290110] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-17T05:13:22.370731] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T05:13:23.090166] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-17T05:13:23.306538] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.22 seconds). [2025-09-17T05:13:23.890140] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-17T05:13:23.933486] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T05:13:24.690174] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-17T05:13:25.490184] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-17T05:13:25.604890] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T05:13:25.705065] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.21 seconds). [2025-09-17T05:13:26.150228] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T05:13:26.290178] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-17T05:13:27.090142] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-17T05:13:27.890183] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-17T05:13:28.053251] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T05:13:28.103552] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-17T05:13:28.690164] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-17T05:13:28.723942] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T05:13:28.928754] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.24 seconds). [2025-09-17T05:13:29.490163] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-17T05:13:29.806018] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:13:29.806492] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-17T05:13:29.806622] [INFO ] [REMOTE ] MUSE: Full fetch complete (107 records). [2025-09-17T05:13:29.806756] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-17T05:13:29.808286] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-16). Symbol may be delisted or halted. [2025-09-17T05:13:29.808551] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:13:29.808605] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:13:29.808683] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-17T05:13:29.808783] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-17T05:13:29.808841] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-17T05:13:29.808941] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-17T05:13:29.809069] [INFO ] [MAIN ] Update Progress: 1432/2369 symbols completed. MUSE took 19.7s. Estimated remaining: 2h 17m 0s. Rate: 6.8 symbols/min [2025-09-17T05:13:29.997786] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:13:30.031375] [DEBUG] [LOCAL ] MUX: Loaded 31233 existing records from primary storage. [2025-09-17T05:13:30.031601] [INFO ] [MAIN ] MUX: Loaded 31233 existing records. [2025-09-17T05:13:30.225553] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:13:30.225910] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-17T05:13:30.225975] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-17T05:13:30.226795] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-17T05:13:30.226859] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-17T05:13:30.295412] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-17T05:13:30.596228] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:13:31.090194] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-11. [2025-09-17T05:13:31.890209] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-17T05:13:32.100547] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T05:13:32.107041] [INFO ] [REMOTE ] MUFG: Full fetch complete (75216 records). [2025-09-17T05:13:32.107204] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-17T05:13:32.497592] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-17T05:13:32.497870] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-17T05:13:32.499578] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-17T05:13:32.499797] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-17T05:13:32.509516] [DEBUG] [LOCAL ] MUFG: Trimmed 75216 records to 52681 (keeping 200 days of data) [2025-09-17T05:13:32.523934] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T05:13:32.709742] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-09-17T05:13:32.874900] [DEBUG] [LOCAL ] MUFG: Primary data saved (52681 records). [2025-09-17T05:13:32.875166] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-17T05:13:32.875314] [INFO ] [MAIN ] Update Progress: 1433/2369 symbols completed. MUFG took 46.8s. Estimated remaining: 2h 16m 48s. Rate: 6.8 symbols/min [2025-09-17T05:13:33.052044] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:13:33.063674] [DEBUG] [LOCAL ] MVF: Loaded 8944 existing records from primary storage. [2025-09-17T05:13:33.063908] [INFO ] [MAIN ] MVF: Loaded 8944 existing records. [2025-09-17T05:13:33.250025] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T05:13:33.270959] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:13:33.277207] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-17T05:13:33.277310] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-17T05:13:33.278146] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-17T05:13:33.278227] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-17T05:13:33.502420] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-17T05:13:33.667787] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:13:34.125532] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T05:13:34.290160] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-09-17T05:13:35.090203] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-11. [2025-09-17T05:13:35.178387] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T05:13:35.185144] [INFO ] [REMOTE ] MUR: Full fetch complete (76071 records). [2025-09-17T05:13:35.185390] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-17T05:13:35.596349] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T05:13:35.653999] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T05:13:35.654197] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-17T05:13:35.656990] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-17T05:13:35.658617] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-17T05:13:35.658700] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-17T05:13:35.660265] [DEBUG] [LOCAL ] MUR: Trimmed 76071 records to 52946 (keeping 200 days of data) [2025-09-17T05:13:35.893088] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-17T05:13:36.012164] [DEBUG] [LOCAL ] MUR: Primary data saved (52946 records). [2025-09-17T05:13:36.012379] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-17T05:13:36.012502] [INFO ] [MAIN ] Update Progress: 1434/2369 symbols completed. MUR took 45.0s. Estimated remaining: 2h 16m 35s. Rate: 6.8 symbols/min [2025-09-17T05:13:36.181240] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:13:36.190203] [DEBUG] [LOCAL ] MVO: Loaded 6446 existing records from primary storage. [2025-09-17T05:13:36.190359] [INFO ] [MAIN ] MVO: Loaded 6446 existing records. [2025-09-17T05:13:36.369271] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:13:36.369619] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-17T05:13:36.369694] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-17T05:13:36.370003] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-17T05:13:36.370064] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-17T05:13:36.696514] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-17T05:13:36.726180] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:13:37.179546] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T05:13:37.490141] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-17T05:13:38.039180] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T05:13:38.290172] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-17T05:13:38.795828] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T05:13:39.090148] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-17T05:13:39.685140] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T05:13:39.846971] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T05:13:39.890203] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-11. [2025-09-17T05:13:40.308324] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T05:13:40.690174] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-09-17T05:13:41.490163] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-17T05:13:41.661776] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T05:13:42.290167] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-09-17T05:13:42.982775] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T05:13:43.047454] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T05:13:43.090146] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-09-17T05:13:43.890197] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-17T05:13:44.043398] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T05:13:44.690154] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-17T05:13:44.900298] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T05:13:45.495766] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-17T05:13:45.496936] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T05:13:46.290167] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-17T05:13:47.062248] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T05:13:47.083285] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T05:13:47.090074] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-17T05:13:47.880415] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T05:13:47.890082] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-17T05:13:48.379024] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T05:13:48.690154] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-17T05:13:49.490264] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-17T05:13:50.286913] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T05:13:50.288146] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T05:13:50.297847] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-17T05:13:51.095617] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-17T05:13:51.099279] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T05:13:51.890213] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-17T05:13:52.618991] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T05:13:52.690191] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-17T05:13:52.690632] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T05:13:53.490167] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-17T05:13:54.290164] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-17T05:13:54.379693] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T05:13:54.398003] [INFO ] [REMOTE ] MUX: Full fetch complete (58053 records). [2025-09-17T05:13:54.398368] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-17T05:13:54.399345] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T05:13:54.790524] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-17T05:13:54.790702] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-17T05:13:54.791792] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-17T05:13:54.791876] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-17T05:13:54.793491] [DEBUG] [LOCAL ] MUX: Trimmed 58053 records to 42149 (keeping 200 days of data) [2025-09-17T05:13:55.046918] [DEBUG] [LOCAL ] MUX: Primary data saved (42149 records). [2025-09-17T05:13:55.047150] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-17T05:13:55.047284] [INFO ] [MAIN ] Update Progress: 1435/2369 symbols completed. MUX took 25.2s. Estimated remaining: 2h 16m 33s. Rate: 6.8 symbols/min [2025-09-17T05:13:55.095270] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-17T05:13:55.230857] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:13:55.241051] [DEBUG] [LOCAL ] MVT: Loaded 7404 existing records from primary storage. [2025-09-17T05:13:55.241256] [INFO ] [MAIN ] MVT: Loaded 7404 existing records. [2025-09-17T05:13:55.429128] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:13:55.429513] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-17T05:13:55.429775] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-17T05:13:55.430377] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-17T05:13:55.430501] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-17T05:13:55.521284] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T05:13:55.835087] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:13:55.847808] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T05:13:55.890142] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-17T05:13:56.673152] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T05:13:56.690107] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-17T05:13:57.490166] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-17T05:13:57.502485] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T05:13:58.290165] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-11. [2025-09-17T05:13:58.649316] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T05:13:59.029249] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T05:13:59.090155] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-17T05:13:59.890209] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-17T05:14:00.013348] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T05:14:00.690152] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-17T05:14:00.737808] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T05:14:01.490199] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-17T05:14:01.935673] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T05:14:01.939542] [INFO ] [REMOTE ] MUSA: Full fetch complete (34878 records). [2025-09-17T05:14:01.939762] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-17T05:14:02.294829] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-17T05:14:02.295693] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T05:14:02.351538] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-17T05:14:02.351714] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-17T05:14:02.352722] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-17T05:14:02.352786] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-17T05:14:02.354190] [DEBUG] [LOCAL ] MUSA: Trimmed 34878 records to 25138 (keeping 200 days of data) [2025-09-17T05:14:02.524179] [DEBUG] [LOCAL ] MUSA: Primary data saved (25138 records). [2025-09-17T05:14:02.524384] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-17T05:14:02.524536] [INFO ] [MAIN ] Update Progress: 1436/2369 symbols completed. MUSA took 56.2s. Estimated remaining: 2h 16m 24s. Rate: 6.8 symbols/min [2025-09-17T05:14:02.703240] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:14:02.741594] [DEBUG] [LOCAL ] MWA: Loaded 34072 existing records from primary storage. [2025-09-17T05:14:02.741845] [INFO ] [MAIN ] MWA: Loaded 34072 existing records. [2025-09-17T05:14:02.926196] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:14:02.926497] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-17T05:14:02.926564] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-17T05:14:02.927464] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-17T05:14:02.927536] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-17T05:14:03.093515] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-09-17T05:14:03.308593] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:14:03.319152] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T05:14:03.890136] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-17T05:14:04.192316] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T05:14:04.612270] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T05:14:04.614971] [INFO ] [REMOTE ] MVF: Full fetch complete (19083 records). [2025-09-17T05:14:04.615208] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-17T05:14:04.695472] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-09-17T05:14:05.005464] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-17T05:14:05.005596] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-17T05:14:05.006193] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-17T05:14:05.006257] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-17T05:14:05.006967] [DEBUG] [LOCAL ] MVF: Trimmed 19083 records to 12821 (keeping 200 days of data) [2025-09-17T05:14:05.090773] [DEBUG] [LOCAL ] MVF: Primary data saved (12821 records). [2025-09-17T05:14:05.091008] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-17T05:14:05.091141] [INFO ] [MAIN ] Update Progress: 1437/2369 symbols completed. MVF took 32.2s. Estimated remaining: 2h 16m 11s. Rate: 6.8 symbols/min [2025-09-17T05:14:05.493274] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-11. [2025-09-17T05:14:05.497249] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T05:14:06.290195] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-17T05:14:06.985564] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T05:14:06.987511] [INFO ] [REMOTE ] MVO: Full fetch complete (14615 records). [2025-09-17T05:14:06.987609] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-17T05:14:07.096881] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-17T05:14:07.378618] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-17T05:14:07.378869] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-17T05:14:07.379436] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-17T05:14:07.379528] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-17T05:14:07.380210] [DEBUG] [LOCAL ] MVO: Trimmed 14615 records to 9083 (keeping 200 days of data) [2025-09-17T05:14:07.452912] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T05:14:07.475881] [DEBUG] [LOCAL ] MVO: Primary data saved (9083 records). [2025-09-17T05:14:07.476077] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-17T05:14:07.476209] [INFO ] [MAIN ] Update Progress: 1438/2369 symbols completed. MVO took 31.5s. Estimated remaining: 2h 15m 58s. Rate: 6.8 symbols/min [2025-09-17T05:14:07.746469] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T05:14:07.890198] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-17T05:14:08.643733] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T05:14:08.690173] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-17T05:14:09.454429] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T05:14:09.490131] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-17T05:14:10.290241] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-09-17T05:14:10.307494] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T05:14:11.090163] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-17T05:14:11.823617] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T05:14:11.890096] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-09-17T05:14:11.991405] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T05:14:12.690184] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-17T05:14:13.317770] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T05:14:13.359713] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T05:14:13.490218] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-17T05:14:14.290172] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-17T05:14:15.997968] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T05:14:16.008717] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-17T05:14:17.894861] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (4.40 seconds). [2025-09-17T05:14:17.902689] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T05:14:17.903622] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-17T05:14:17.917250] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-17T05:14:18.878761] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T05:14:18.880622] [INFO ] [REMOTE ] MVT: Full fetch complete (14444 records). [2025-09-17T05:14:18.880758] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-17T05:14:19.258988] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-17T05:14:19.259130] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-17T05:14:19.259724] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-17T05:14:19.259803] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-17T05:14:19.260451] [DEBUG] [LOCAL ] MVT: Trimmed 14444 records to 10021 (keeping 200 days of data) [2025-09-17T05:14:19.336705] [DEBUG] [LOCAL ] MVT: Primary data saved (10021 records). [2025-09-17T05:14:19.337073] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-17T05:14:19.337328] [INFO ] [MAIN ] Update Progress: 1439/2369 symbols completed. MVT took 24.3s. Estimated remaining: 2h 15m 51s. Rate: 6.8 symbols/min [2025-09-17T05:14:19.650804] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T05:14:19.661892] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-17T05:14:21.362074] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T05:14:21.372776] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-17T05:14:22.971212] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T05:14:22.981799] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-17T05:14:24.585918] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T05:14:24.597346] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-17T05:14:26.151871] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T05:14:26.162533] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-17T05:14:27.330765] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T05:14:27.336537] [INFO ] [REMOTE ] MWA: Full fetch complete (67651 records). [2025-09-17T05:14:27.336817] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-17T05:14:27.821982] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-17T05:14:27.822104] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-17T05:14:27.823480] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-17T05:14:27.823550] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-17T05:14:27.825164] [DEBUG] [LOCAL ] MWA: Trimmed 67651 records to 47255 (keeping 200 days of data) [2025-09-17T05:14:28.129140] [DEBUG] [LOCAL ] MWA: Primary data saved (47255 records). [2025-09-17T05:14:28.129376] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-17T05:14:28.129517] [INFO ] [MAIN ] Update Progress: 1440/2369 symbols completed. MWA took 25.6s. Estimated remaining: 2h 15m 43s. Rate: 6.8 symbols/min [2025-09-17T05:14:28.738154] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:14:28.866359] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:14:28.871879] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:14:28.895197] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:14:28.898544] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-17T05:14:28.898991] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-17T05:14:28.899380] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-17T05:14:28.899920] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-17T05:14:28.904899] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-17T05:14:28.905005] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-17T05:14:28.918988] [DEBUG] [LOCAL ] MYD: Loaded 9219 existing records from primary storage. [2025-09-17T05:14:28.944533] [INFO ] [MAIN ] MYD: Loaded 9219 existing records. [2025-09-17T05:14:28.958240] [DEBUG] [LOCAL ] MXF: Loaded 4061 existing records from primary storage. [2025-09-17T05:14:29.061804] [INFO ] [MAIN ] MXF: Loaded 4061 existing records. [2025-09-17T05:14:29.195837] [DEBUG] [LOCAL ] MX: Loaded 16635 existing records from primary storage. [2025-09-17T05:14:29.335404] [INFO ] [MAIN ] MX: Loaded 16635 existing records. [2025-09-17T05:14:29.415164] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:14:29.525286] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-17T05:14:29.685687] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-17T05:14:29.699739] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:14:29.752365] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-17T05:14:29.781621] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-17T05:14:29.815044] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-17T05:14:29.815142] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-17T05:14:29.880757] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:14:29.898018] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-17T05:14:29.843924] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:14:29.913963] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-17T05:14:29.934294] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-11. [2025-09-17T05:14:29.924707] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-17T05:14:30.029494] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-17T05:14:30.111137] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-17T05:14:30.189996] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-17T05:14:30.556882] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T05:14:30.711775] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-17T05:14:30.757534] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:14:30.801302] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-11. [2025-09-17T05:14:30.883964] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:14:30.940715] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-11. [2025-09-17T05:14:31.061059] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:14:31.061553] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-11. [2025-09-17T05:14:31.425686] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T05:14:31.427133] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-17T05:14:31.817673] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T05:14:31.821429] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-09-17T05:14:31.891327] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T05:14:31.892788] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-17T05:14:31.926115] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T05:14:31.930493] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-09-17T05:14:32.119779] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T05:14:32.125173] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-09-17T05:14:32.167167] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-17T05:14:32.168462] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-17T05:14:32.264406] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-17T05:14:32.267524] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-09-17T05:14:32.599789] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-17T05:14:32.601026] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-17T05:14:32.667833] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T05:14:32.672669] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-17T05:14:33.020148] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T05:14:33.021774] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-17T05:14:33.040824] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T05:14:33.143729] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T05:14:33.294522] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T05:14:33.362974] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T05:14:33.490173] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-17T05:14:34.290146] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-17T05:14:34.502283] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T05:14:35.033000] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T05:14:35.090173] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-09-17T05:14:35.890192] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-17T05:14:36.038225] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T05:14:36.664584] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T05:14:36.690161] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-17T05:14:37.450872] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T05:14:37.490123] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-17T05:14:38.251503] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T05:14:38.290171] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-17T05:14:39.090236] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-17T05:14:39.329867] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T05:14:39.368841] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-17T05:14:39.890182] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-17T05:14:40.354103] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T05:14:40.690169] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-17T05:14:41.135417] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T05:14:41.490201] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-17T05:14:42.290201] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-17T05:14:42.504749] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T05:14:42.841198] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T05:14:42.842516] [INFO ] [REMOTE ] MXE: Full fetch complete (2690 records). [2025-09-17T05:14:42.842926] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-17T05:14:43.024909] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T05:14:43.025172] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:14:43.025225] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:14:43.025330] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-17T05:14:43.025433] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-17T05:14:43.025488] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-17T05:14:43.025540] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-17T05:14:43.025628] [INFO ] [MAIN ] Update Progress: 1441/2369 symbols completed. MXE took 14.9s. Estimated remaining: 2h 15m 38s. Rate: 6.8 symbols/min [2025-09-17T05:14:43.095315] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-17T05:14:43.203301] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:14:43.224714] [DEBUG] [LOCAL ] MYE: Loaded 17614 existing records from primary storage. [2025-09-17T05:14:43.224907] [INFO ] [MAIN ] MYE: Loaded 17614 existing records. [2025-09-17T05:14:43.404266] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:14:43.404587] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-17T05:14:43.404696] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-17T05:14:43.405468] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-17T05:14:43.405559] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-17T05:14:43.766833] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:14:43.890179] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-17T05:14:44.188530] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T05:14:44.541589] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T05:14:44.690216] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-11. [2025-09-17T05:14:45.490177] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-17T05:14:46.138706] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T05:14:46.290175] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-17T05:14:46.436369] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T05:14:47.090126] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-17T05:14:47.309740] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T05:14:47.890154] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-17T05:14:48.010306] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T05:14:48.505422] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T05:14:48.690214] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-17T05:14:49.153280] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T05:14:49.490190] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-17T05:14:50.038287] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T05:14:50.039768] [INFO ] [REMOTE ] MXF: Full fetch complete (10736 records). [2025-09-17T05:14:50.039874] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-17T05:14:50.295437] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-17T05:14:50.429480] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-17T05:14:50.429620] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-17T05:14:50.430109] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-17T05:14:50.430165] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-17T05:14:50.430670] [DEBUG] [LOCAL ] MXF: Trimmed 10736 records to 6138 (keeping 200 days of data) [2025-09-17T05:14:50.472123] [DEBUG] [LOCAL ] MXF: Primary data saved (6138 records). [2025-09-17T05:14:50.472332] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-17T05:14:50.472449] [INFO ] [MAIN ] Update Progress: 1442/2369 symbols completed. MXF took 22.3s. Estimated remaining: 2h 15m 28s. Rate: 6.8 symbols/min [2025-09-17T05:14:50.644999] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:14:50.662034] [DEBUG] [LOCAL ] MYI: Loaded 13530 existing records from primary storage. [2025-09-17T05:14:50.662239] [INFO ] [MAIN ] MYI: Loaded 13530 existing records. [2025-09-17T05:14:50.846140] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:14:50.846414] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-17T05:14:50.846472] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-17T05:14:50.847172] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-17T05:14:50.847241] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-17T05:14:51.097082] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-17T05:14:51.220752] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:14:51.232091] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T05:14:51.890176] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-11. [2025-09-17T05:14:52.486297] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T05:14:52.690204] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-17T05:14:53.042960] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T05:14:53.480419] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T05:14:53.490088] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-17T05:14:54.290179] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-17T05:14:54.315456] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T05:14:54.317763] [INFO ] [REMOTE ] MYD: Full fetch complete (20940 records). [2025-09-17T05:14:54.317890] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-17T05:14:54.678814] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-17T05:14:54.678984] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-17T05:14:54.679817] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-17T05:14:54.679896] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-17T05:14:54.680617] [DEBUG] [LOCAL ] MYD: Trimmed 20940 records to 13768 (keeping 200 days of data) [2025-09-17T05:14:54.767574] [DEBUG] [LOCAL ] MYD: Primary data saved (13768 records). [2025-09-17T05:14:54.767782] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-17T05:14:54.767942] [INFO ] [MAIN ] Update Progress: 1443/2369 symbols completed. MYD took 26.6s. Estimated remaining: 2h 15m 16s. Rate: 6.8 symbols/min [2025-09-17T05:14:54.947082] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:14:54.957531] [DEBUG] [LOCAL ] MYN: Loaded 7569 existing records from primary storage. [2025-09-17T05:14:54.957798] [INFO ] [MAIN ] MYN: Loaded 7569 existing records. [2025-09-17T05:14:55.095303] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-17T05:14:55.157145] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:14:55.157707] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-17T05:14:55.157781] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-17T05:14:55.158261] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-17T05:14:55.158327] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-17T05:14:55.569191] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:14:55.581532] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T05:14:55.890163] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-17T05:14:56.435152] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T05:14:56.690175] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-17T05:14:56.919415] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T05:14:57.474623] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T05:14:57.490093] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-17T05:14:58.248544] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T05:14:58.290111] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-17T05:14:59.090208] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-17T05:14:59.653353] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T05:14:59.815270] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T05:14:59.890245] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-17T05:15:00.690205] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-11. [2025-09-17T05:15:01.287392] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T05:15:01.490213] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-17T05:15:01.659372] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T05:15:02.290173] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-17T05:15:03.090195] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-09-17T05:15:03.483055] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T05:15:03.890183] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-09-17T05:15:04.690208] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-17T05:15:05.149003] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T05:15:05.194854] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-17T05:15:05.212182] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (2.92 seconds). [2025-09-17T05:15:05.215970] [INFO ] [REMOTE ] MX: Full fetch complete (31770 records). [2025-09-17T05:15:05.216311] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-17T05:15:05.495326] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-09-17T05:15:05.674266] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-17T05:15:05.674400] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-17T05:15:05.675227] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-17T05:15:05.675286] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-17T05:15:05.676396] [DEBUG] [LOCAL ] MX: Trimmed 31770 records to 22967 (keeping 200 days of data) [2025-09-17T05:15:05.795864] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T05:15:05.839520] [DEBUG] [LOCAL ] MX: Primary data saved (22967 records). [2025-09-17T05:15:05.839755] [INFO ] [MAIN ] MX: Full history saved. [2025-09-17T05:15:05.839884] [INFO ] [MAIN ] Update Progress: 1444/2369 symbols completed. MX took 37.7s. Estimated remaining: 2h 15m 9s. Rate: 6.8 symbols/min [2025-09-17T05:15:06.012942] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:15:06.042732] [DEBUG] [LOCAL ] NABL: Loaded 29329 existing records from primary storage. [2025-09-17T05:15:06.042922] [INFO ] [MAIN ] NABL: Loaded 29329 existing records. [2025-09-17T05:15:06.225200] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:15:06.225480] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-17T05:15:06.225544] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-17T05:15:06.226327] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-17T05:15:06.226400] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-17T05:15:06.297721] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-17T05:15:06.477860] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T05:15:06.606903] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:15:07.090141] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-17T05:15:07.129107] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T05:15:07.890117] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-17T05:15:08.184517] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T05:15:08.690216] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-17T05:15:09.157217] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T05:15:09.490165] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-11. [2025-09-17T05:15:09.661411] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T05:15:10.290147] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-17T05:15:10.799063] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T05:15:11.090116] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-17T05:15:11.450276] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T05:15:11.843987] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T05:15:11.890149] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-17T05:15:12.690157] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-17T05:15:12.825305] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T05:15:13.490194] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-09-17T05:15:13.772874] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T05:15:14.290199] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-17T05:15:14.427037] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T05:15:15.084197] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T05:15:15.090079] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-17T05:15:15.890184] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-17T05:15:16.196630] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T05:15:16.690139] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-17T05:15:17.490201] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-09-17T05:15:17.730470] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T05:15:17.802435] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T05:15:18.290150] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-17T05:15:18.867119] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T05:15:19.021194] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T05:15:19.090173] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-17T05:15:19.870342] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T05:15:19.890118] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-17T05:15:20.690131] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-17T05:15:20.830878] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T05:15:21.490150] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-17T05:15:21.707007] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T05:15:22.259862] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T05:15:22.290152] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-17T05:15:23.090147] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-17T05:15:23.323788] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T05:15:23.894590] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-17T05:15:23.897773] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T05:15:23.900904] [INFO ] [REMOTE ] MYE: Full fetch complete (37378 records). [2025-09-17T05:15:23.900998] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-17T05:15:24.275342] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-17T05:15:24.275465] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-17T05:15:24.276410] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-17T05:15:24.276489] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-17T05:15:24.277455] [DEBUG] [LOCAL ] MYE: Trimmed 37378 records to 25615 (keeping 200 days of data) [2025-09-17T05:15:24.464862] [DEBUG] [LOCAL ] MYE: Primary data saved (25615 records). [2025-09-17T05:15:24.465044] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-17T05:15:24.465159] [INFO ] [MAIN ] Update Progress: 1445/2369 symbols completed. MYE took 41.4s. Estimated remaining: 2h 15m 7s. Rate: 6.8 symbols/min [2025-09-17T05:15:24.636294] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:15:24.655672] [DEBUG] [LOCAL ] NAC: Loaded 17830 existing records from primary storage. [2025-09-17T05:15:24.655869] [INFO ] [MAIN ] NAC: Loaded 17830 existing records. [2025-09-17T05:15:24.697805] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-17T05:15:24.837708] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:15:24.837969] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-17T05:15:24.838029] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-17T05:15:24.838529] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-17T05:15:24.838587] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-17T05:15:25.151583] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T05:15:25.216509] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:15:25.216886] [INFO ] [REMOTE ] MYI: Full fetch complete (29428 records). [2025-09-17T05:15:25.217258] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-17T05:15:25.500347] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-17T05:15:25.542811] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T05:15:25.595766] [INFO ] [REMOTE ] MYN: Full fetch complete (15552 records). [2025-09-17T05:15:25.609659] [DEBUG] [VALIDATOR ] MYI: All expected trading days are present. [2025-09-17T05:15:25.607797] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-17T05:15:25.609899] [DEBUG] [VALIDATOR ] MYI: Primary data validation passed. [2025-09-17T05:15:25.610925] [INFO ] [MAIN ] MYI: Fetched primary data is valid. [2025-09-17T05:15:25.644125] [DEBUG] [LOCAL ] MYI: Saving primary data. [2025-09-17T05:15:25.741817] [DEBUG] [LOCAL ] MYI: Trimmed 29428 records to 19326 (keeping 200 days of data) [2025-09-17T05:15:26.105235] [DEBUG] [LOCAL ] MYI: Primary data saved (19326 records). [2025-09-17T05:15:26.149383] [INFO ] [MAIN ] MYI: Full history saved. [2025-09-17T05:15:26.164553] [INFO ] [MAIN ] Update Progress: 1446/2369 symbols completed. MYI took 35.7s. Estimated remaining: 2h 14m 53s. Rate: 6.8 symbols/min [2025-09-17T05:15:26.164758] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-17T05:15:26.165005] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-17T05:15:26.178351] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-17T05:15:26.212936] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-17T05:15:26.273545] [DEBUG] [LOCAL ] MYN: Trimmed 15552 records to 10308 (keeping 200 days of data) [2025-09-17T05:15:26.314339] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-11. [2025-09-17T05:15:26.397299] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:15:26.426717] [DEBUG] [LOCAL ] MYN: Primary data saved (10308 records). [2025-09-17T05:15:26.426940] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-17T05:15:26.427076] [INFO ] [MAIN ] Update Progress: 1447/2369 symbols completed. MYN took 31.7s. Estimated remaining: 2h 14m 39s. Rate: 6.8 symbols/min [2025-09-17T05:15:26.542073] [DEBUG] [LOCAL ] NAD: Loaded 25046 existing records from primary storage. [2025-09-17T05:15:26.563177] [INFO ] [MAIN ] NAD: Loaded 25046 existing records. [2025-09-17T05:15:26.681345] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:15:26.808427] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:15:26.808285] [DEBUG] [LOCAL ] NAN: Loaded 6308 existing records from primary storage. [2025-09-17T05:15:26.808978] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-17T05:15:26.809102] [INFO ] [MAIN ] NAN: Loaded 6308 existing records. [2025-09-17T05:15:26.809303] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-17T05:15:26.874589] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-17T05:15:26.891357] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-17T05:15:27.085958] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:15:27.112275] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-17T05:15:27.132842] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-17T05:15:27.171450] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-17T05:15:27.229768] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-17T05:15:27.415764] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T05:15:27.511837] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:15:27.520866] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-11. [2025-09-17T05:15:27.803427] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:15:27.805417] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T05:15:27.890078] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-09-17T05:15:28.690158] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-11. [2025-09-17T05:15:28.840685] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T05:15:29.493726] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-09-17T05:15:29.501859] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T05:15:29.624117] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T05:15:30.290192] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-09-17T05:15:30.872607] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T05:15:31.090200] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-09-17T05:15:31.275981] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T05:15:31.890145] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-09-17T05:15:32.205255] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T05:15:32.662941] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T05:15:32.690157] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-09-17T05:15:33.490197] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-17T05:15:34.067475] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T05:15:34.290219] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-17T05:15:34.387931] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T05:15:35.090200] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-17T05:15:35.374983] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T05:15:35.890195] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-17T05:15:36.627415] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T05:15:36.673056] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T05:15:36.690162] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-17T05:15:37.490192] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-17T05:15:37.509526] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T05:15:38.290190] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-17T05:15:38.823931] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T05:15:39.090211] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-17T05:15:39.765986] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T05:15:39.876324] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T05:15:39.890072] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-17T05:15:40.690167] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-17T05:15:41.226782] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T05:15:41.442230] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T05:15:41.490139] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-17T05:15:41.873522] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-17T05:15:42.290154] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-17T05:15:43.069671] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T05:15:43.090101] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-17T05:15:43.890189] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-17T05:15:44.590953] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T05:15:44.690133] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-17T05:15:45.184297] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T05:15:45.439069] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T05:15:45.490172] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-17T05:15:46.290298] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-17T05:15:46.327850] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T05:15:46.330097] [INFO ] [REMOTE ] NAN: Full fetch complete (14308 records). [2025-09-17T05:15:46.330217] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-17T05:15:46.687491] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-17T05:15:46.687591] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-17T05:15:46.687832] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-17T05:15:46.687888] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-17T05:15:46.688392] [DEBUG] [LOCAL ] NAN: Trimmed 14308 records to 9137 (keeping 200 days of data) [2025-09-17T05:15:46.744629] [DEBUG] [LOCAL ] NAN: Primary data saved (9137 records). [2025-09-17T05:15:46.744813] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-17T05:15:46.744907] [INFO ] [MAIN ] Update Progress: 1448/2369 symbols completed. NAN took 20.3s. Estimated remaining: 2h 14m 38s. Rate: 6.8 symbols/min [2025-09-17T05:15:46.912766] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:15:46.948451] [DEBUG] [LOCAL ] NAT: Loaded 36263 existing records from primary storage. [2025-09-17T05:15:46.948668] [INFO ] [MAIN ] NAT: Loaded 36263 existing records. [2025-09-17T05:15:47.095434] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-17T05:15:47.135337] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:15:47.135725] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-17T05:15:47.135786] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-17T05:15:47.136975] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-17T05:15:47.137041] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-17T05:15:47.494258] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:15:47.522672] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T05:15:47.890172] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-11. [2025-09-17T05:15:48.400521] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T05:15:48.690131] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-17T05:15:49.490195] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-17T05:15:49.714612] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T05:15:49.784666] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T05:15:50.290186] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-09-17T05:15:50.895017] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T05:15:51.090209] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-17T05:15:51.890184] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-17T05:15:52.175576] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T05:15:52.265157] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T05:15:52.690130] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-17T05:15:53.314236] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T05:15:53.490146] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-17T05:15:53.979112] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T05:15:54.290187] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-17T05:15:54.997609] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T05:15:55.090180] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-09-17T05:15:55.459687] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T05:15:55.890175] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-17T05:15:56.690138] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-17T05:15:56.862328] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T05:15:57.232624] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T05:15:57.490165] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-17T05:15:57.570421] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T05:15:58.290162] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-17T05:15:59.085339] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T05:15:59.094831] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-17T05:15:59.675859] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T05:15:59.682473] [INFO ] [REMOTE ] NAD: Full fetch complete (50230 records). [2025-09-17T05:15:59.682722] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-17T05:15:59.896187] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-17T05:16:00.086612] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-17T05:16:00.086765] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-17T05:16:00.087943] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-17T05:16:00.088009] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-17T05:16:00.089266] [DEBUG] [LOCAL ] NAD: Trimmed 50230 records to 34164 (keeping 200 days of data) [2025-09-17T05:16:00.312209] [DEBUG] [LOCAL ] NAD: Primary data saved (34164 records). [2025-09-17T05:16:00.312445] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-17T05:16:00.312568] [INFO ] [MAIN ] Update Progress: 1449/2369 symbols completed. NAD took 34.1s. Estimated remaining: 2h 14m 32s. Rate: 6.8 symbols/min [2025-09-17T05:16:00.488402] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:16:00.498026] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T05:16:00.502537] [INFO ] [REMOTE ] NAC: Full fetch complete (36176 records). [2025-09-17T05:16:00.502922] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-17T05:16:00.690914] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-17T05:16:00.735739] [DEBUG] [LOCAL ] NATL: Loaded 24282 existing records from primary storage. [2025-09-17T05:16:00.768053] [INFO ] [MAIN ] NATL: Loaded 24282 existing records. [2025-09-17T05:16:01.112447] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-17T05:16:01.112225] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:16:01.112718] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-17T05:16:01.113755] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-17T05:16:01.113832] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-17T05:16:01.114019] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-17T05:16:01.114307] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-17T05:16:01.115091] [DEBUG] [LOCAL ] NAC: Trimmed 36176 records to 24749 (keeping 200 days of data) [2025-09-17T05:16:01.115019] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-17T05:16:01.115375] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-17T05:16:01.625498] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:16:01.629851] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-11. [2025-09-17T05:16:01.688746] [DEBUG] [LOCAL ] NAC: Primary data saved (24749 records). [2025-09-17T05:16:01.688939] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-17T05:16:01.689052] [INFO ] [MAIN ] Update Progress: 1450/2369 symbols completed. NAC took 37.2s. Estimated remaining: 2h 14m 19s. Rate: 6.8 symbols/min [2025-09-17T05:16:01.868842] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:16:01.873236] [DEBUG] [LOCAL ] NAZ: Loaded 1976 existing records from primary storage. [2025-09-17T05:16:01.873366] [INFO ] [MAIN ] NAZ: Loaded 1976 existing records. [2025-09-17T05:16:02.057336] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:16:02.058474] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-17T05:16:02.059073] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-17T05:16:02.059493] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-17T05:16:02.059750] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-17T05:16:02.320339] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T05:16:02.372812] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-17T05:16:02.395013] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-17T05:16:02.534290] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:16:02.895670] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T05:16:03.090165] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-11. [2025-09-17T05:16:03.672775] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T05:16:03.806302] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T05:16:03.811753] [INFO ] [REMOTE ] NABL: Full fetch complete (56601 records). [2025-09-17T05:16:03.811907] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-17T05:16:03.895325] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-09-17T05:16:04.199125] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-17T05:16:04.199245] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-17T05:16:04.200226] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-17T05:16:04.200284] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-17T05:16:04.202006] [DEBUG] [LOCAL ] NABL: Trimmed 56601 records to 40431 (keeping 200 days of data) [2025-09-17T05:16:04.448831] [DEBUG] [LOCAL ] NABL: Primary data saved (40431 records). [2025-09-17T05:16:04.449037] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-17T05:16:04.449164] [INFO ] [MAIN ] Update Progress: 1451/2369 symbols completed. NABL took 58.6s. Estimated remaining: 2h 14m 6s. Rate: 6.8 symbols/min [2025-09-17T05:16:04.618968] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:16:04.628283] [DEBUG] [LOCAL ] NBB: Loaded 6451 existing records from primary storage. [2025-09-17T05:16:04.628434] [INFO ] [MAIN ] NBB: Loaded 6451 existing records. [2025-09-17T05:16:04.695253] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-09-17T05:16:04.807464] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:16:04.807749] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-17T05:16:04.807811] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-17T05:16:04.808117] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-17T05:16:04.808183] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-17T05:16:05.165916] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:16:05.344191] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T05:16:05.390114] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T05:16:05.490095] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-09-17T05:16:05.887710] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-17T05:16:06.290178] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-11. [2025-09-17T05:16:06.976859] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T05:16:07.090191] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-17T05:16:07.890191] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-09-17T05:16:08.690149] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-17T05:16:08.767772] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T05:16:08.789956] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T05:16:09.218864] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T05:16:09.490147] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-17T05:16:09.889378] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T05:16:10.290139] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-09-17T05:16:10.973466] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T05:16:11.090146] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-17T05:16:11.808770] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T05:16:11.890178] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-17T05:16:12.401757] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T05:16:12.690201] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-17T05:16:13.490164] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-17T05:16:14.233963] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T05:16:14.290145] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-09-17T05:16:14.449682] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T05:16:15.090175] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-17T05:16:15.545419] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T05:16:15.886699] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T05:16:15.890068] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-17T05:16:16.624319] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T05:16:16.690139] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-17T05:16:17.394577] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T05:16:17.490155] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-17T05:16:18.290162] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-17T05:16:18.855684] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T05:16:19.090155] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-17T05:16:19.186084] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T05:16:19.845326] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T05:16:19.890111] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-17T05:16:20.183151] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-17T05:16:20.690152] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-17T05:16:21.490309] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-17T05:16:21.821598] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T05:16:22.290144] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-17T05:16:22.630500] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-17T05:16:22.944145] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T05:16:23.090164] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-17T05:16:23.577177] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T05:16:23.890214] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-17T05:16:24.436515] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T05:16:24.690165] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-17T05:16:25.297125] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T05:16:25.298912] [INFO ] [REMOTE ] NBB: Full fetch complete (14005 records). [2025-09-17T05:16:25.299008] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-17T05:16:25.495210] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-17T05:16:25.674274] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-17T05:16:25.674435] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-17T05:16:25.674911] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-17T05:16:25.674988] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-17T05:16:25.675810] [DEBUG] [LOCAL ] NBB: Trimmed 14005 records to 8923 (keeping 200 days of data) [2025-09-17T05:16:25.736559] [DEBUG] [LOCAL ] NBB: Primary data saved (8923 records). [2025-09-17T05:16:25.736812] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-17T05:16:25.736950] [INFO ] [MAIN ] Update Progress: 1452/2369 symbols completed. NBB took 21.3s. Estimated remaining: 2h 14m 5s. Rate: 6.8 symbols/min [2025-09-17T05:16:25.916056] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:16:25.934269] [DEBUG] [LOCAL ] NBHC: Loaded 16614 existing records from primary storage. [2025-09-17T05:16:25.934484] [INFO ] [MAIN ] NBHC: Loaded 16614 existing records. [2025-09-17T05:16:26.121506] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:16:26.121845] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-17T05:16:26.121922] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-17T05:16:26.122456] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-17T05:16:26.122524] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-17T05:16:26.281542] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T05:16:26.295773] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-17T05:16:26.314571] [INFO ] [REMOTE ] NAZ: Full fetch complete (4447 records). [2025-09-17T05:16:26.348874] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-17T05:16:26.662386] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:16:26.872230] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-17T05:16:26.872369] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-17T05:16:26.872706] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-17T05:16:26.872766] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-17T05:16:26.873201] [DEBUG] [LOCAL ] NAZ: Trimmed 4447 records to 2723 (keeping 200 days of data) [2025-09-17T05:16:26.891927] [DEBUG] [LOCAL ] NAZ: Primary data saved (2723 records). [2025-09-17T05:16:26.892093] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-17T05:16:26.892205] [INFO ] [MAIN ] Update Progress: 1453/2369 symbols completed. NAZ took 25.2s. Estimated remaining: 2h 13m 52s. Rate: 6.8 symbols/min [2025-09-17T05:16:27.075179] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:16:27.092177] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-11. [2025-09-17T05:16:27.109773] [DEBUG] [LOCAL ] NBR: Loaded 26240 existing records from primary storage. [2025-09-17T05:16:27.110035] [INFO ] [MAIN ] NBR: Loaded 26240 existing records. [2025-09-17T05:16:27.305965] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:16:27.306430] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-17T05:16:27.306502] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-17T05:16:27.307256] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-17T05:16:27.307326] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-17T05:16:27.701025] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:16:27.725076] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T05:16:27.890181] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-17T05:16:28.210596] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T05:16:28.690200] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-11. [2025-09-17T05:16:29.293710] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T05:16:29.490203] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-17T05:16:30.035312] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T05:16:30.290185] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-09-17T05:16:30.872351] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T05:16:31.090214] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-17T05:16:31.451292] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T05:16:31.890147] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-09-17T05:16:31.982090] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T05:16:32.690188] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-17T05:16:32.742772] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T05:16:33.490236] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-17T05:16:34.299335] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-17T05:16:34.334310] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T05:16:34.822238] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T05:16:34.959608] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T05:16:35.090213] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-17T05:16:35.890170] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-09-17T05:16:36.174351] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T05:16:36.690213] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-17T05:16:36.920826] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T05:16:37.490235] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-09-17T05:16:38.290219] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-17T05:16:38.371276] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T05:16:38.378013] [INFO ] [REMOTE ] NAT: Full fetch complete (72173 records). [2025-09-17T05:16:38.378252] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-17T05:16:38.787351] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-17T05:16:38.787492] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-17T05:16:38.788751] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-17T05:16:38.788824] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-17T05:16:38.806751] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T05:16:38.812909] [DEBUG] [LOCAL ] NAT: Trimmed 72173 records to 49168 (keeping 200 days of data) [2025-09-17T05:16:39.090899] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-17T05:16:39.127453] [DEBUG] [LOCAL ] NAT: Primary data saved (49168 records). [2025-09-17T05:16:39.127630] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-17T05:16:39.127770] [INFO ] [MAIN ] Update Progress: 1454/2369 symbols completed. NAT took 52.4s. Estimated remaining: 2h 13m 45s. Rate: 6.8 symbols/min [2025-09-17T05:16:39.307482] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:16:39.331834] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T05:16:39.358032] [DEBUG] [LOCAL ] NBXG: Loaded 16130 existing records from primary storage. [2025-09-17T05:16:39.358297] [INFO ] [MAIN ] NBXG: Loaded 16130 existing records. [2025-09-17T05:16:39.550190] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:16:39.550555] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-17T05:16:39.550634] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-17T05:16:39.551495] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-17T05:16:39.551576] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-17T05:16:39.891495] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-17T05:16:39.912278] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:16:40.302380] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T05:16:40.690162] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-17T05:16:40.704200] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T05:16:41.490245] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-17T05:16:41.795396] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T05:16:42.125144] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T05:16:42.290174] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-17T05:16:43.090188] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-17T05:16:43.657340] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T05:16:43.890263] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-11. [2025-09-17T05:16:44.231170] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T05:16:44.690207] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-17T05:16:44.908527] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T05:16:45.490168] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-17T05:16:45.792378] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T05:16:46.290195] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-17T05:16:46.877188] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T05:16:47.090161] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-17T05:16:47.709982] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T05:16:47.893029] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T05:16:47.892164] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-17T05:16:47.897126] [INFO ] [REMOTE ] NBHC: Full fetch complete (31222 records). [2025-09-17T05:16:47.897221] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-17T05:16:48.277339] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-17T05:16:48.277470] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-17T05:16:48.278554] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-17T05:16:48.278637] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-17T05:16:48.279697] [DEBUG] [LOCAL ] NBHC: Trimmed 31222 records to 22776 (keeping 200 days of data) [2025-09-17T05:16:48.424337] [DEBUG] [LOCAL ] NBHC: Primary data saved (22776 records). [2025-09-17T05:16:48.424528] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-17T05:16:48.424679] [INFO ] [MAIN ] Update Progress: 1455/2369 symbols completed. NBHC took 22.7s. Estimated remaining: 2h 13m 37s. Rate: 6.8 symbols/min [2025-09-17T05:16:48.593717] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:16:48.596901] [DEBUG] [LOCAL ] NC: Loaded 1170 existing records from primary storage. [2025-09-17T05:16:48.597036] [INFO ] [MAIN ] NC: Loaded 1170 existing records. [2025-09-17T05:16:48.695295] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-17T05:16:48.788202] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:16:48.788509] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-17T05:16:48.788603] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-17T05:16:48.788830] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-17T05:16:48.788894] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-17T05:16:49.163557] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:16:49.341903] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T05:16:49.346548] [INFO ] [REMOTE ] NATL: Full fetch complete (45454 records). [2025-09-17T05:16:49.346688] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-17T05:16:49.495563] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-09-17T05:16:49.729355] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-17T05:16:49.729513] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-17T05:16:49.730677] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-17T05:16:49.730755] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-17T05:16:49.732208] [DEBUG] [LOCAL ] NATL: Trimmed 45454 records to 32794 (keeping 200 days of data) [2025-09-17T05:16:49.949109] [DEBUG] [LOCAL ] NATL: Primary data saved (32794 records). [2025-09-17T05:16:49.949373] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-17T05:16:49.949553] [INFO ] [MAIN ] Update Progress: 1456/2369 symbols completed. NATL took 49.6s. Estimated remaining: 2h 13m 23s. Rate: 6.8 symbols/min [2025-09-17T05:16:50.203726] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:16:50.234752] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T05:16:50.247154] [DEBUG] [LOCAL ] NCA: Loaded 7192 existing records from primary storage. [2025-09-17T05:16:50.247526] [INFO ] [MAIN ] NCA: Loaded 7192 existing records. [2025-09-17T05:16:50.297742] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-11. [2025-09-17T05:16:50.454349] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:16:50.454690] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-17T05:16:50.454755] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-17T05:16:50.455071] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-17T05:16:50.455132] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-17T05:16:50.839080] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T05:16:50.889680] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:16:50.890751] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T05:16:51.090178] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-11. [2025-09-17T05:16:51.890180] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-17T05:16:51.950501] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T05:16:52.690150] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-09-17T05:16:53.336484] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T05:16:53.490143] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-09-17T05:16:53.674807] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T05:16:54.082032] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T05:16:54.290201] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-17T05:16:55.090154] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-09-17T05:16:55.105474] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T05:16:55.561029] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T05:16:55.890190] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-17T05:16:56.690229] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-09-17T05:16:56.715261] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T05:16:57.490188] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-17T05:16:57.564329] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T05:16:57.787524] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-17T05:16:58.290201] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-17T05:16:59.090222] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-17T05:16:59.658176] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T05:16:59.890174] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-17T05:17:00.228126] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-17T05:17:00.245129] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T05:17:00.690150] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-17T05:17:01.490190] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-17T05:17:02.142193] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T05:17:02.147243] [INFO ] [REMOTE ] NBR: Full fetch complete (49109 records). [2025-09-17T05:17:02.147481] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-17T05:17:02.295286] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-17T05:17:02.477207] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T05:17:02.563346] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-17T05:17:02.563489] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-17T05:17:02.564725] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-17T05:17:02.564828] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-17T05:17:02.566354] [DEBUG] [LOCAL ] NBR: Trimmed 49109 records to 35065 (keeping 200 days of data) [2025-09-17T05:17:02.794544] [DEBUG] [LOCAL ] NBR: Primary data saved (35065 records). [2025-09-17T05:17:02.794790] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-17T05:17:02.794915] [INFO ] [MAIN ] Update Progress: 1457/2369 symbols completed. NBR took 35.9s. Estimated remaining: 2h 13m 17s. Rate: 6.8 symbols/min [2025-09-17T05:17:02.967702] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:17:02.985333] [DEBUG] [LOCAL ] NCDL: Loaded 15032 existing records from primary storage. [2025-09-17T05:17:02.985556] [INFO ] [MAIN ] NCDL: Loaded 15032 existing records. [2025-09-17T05:17:03.091716] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T05:17:03.090945] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-17T05:17:03.173756] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:17:03.174030] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-17T05:17:03.174137] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-17T05:17:03.174596] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-17T05:17:03.174693] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-17T05:17:03.554793] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:17:03.890225] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-17T05:17:03.932862] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T05:17:04.350252] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T05:17:04.690177] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-11. [2025-09-17T05:17:05.490142] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-17T05:17:05.774086] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T05:17:05.914231] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T05:17:06.290192] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-17T05:17:06.802858] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T05:17:07.090140] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-09-17T05:17:07.890128] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-17T05:17:08.217504] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T05:17:08.690136] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-17T05:17:09.007776] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T05:17:09.049464] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-17T05:17:09.490192] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-17T05:17:09.844121] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T05:17:09.845190] [INFO ] [REMOTE ] NC: Full fetch complete (2696 records). [2025-09-17T05:17:09.845304] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-17T05:17:10.217899] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-17T05:17:10.218040] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-17T05:17:10.218239] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-17T05:17:10.218303] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-17T05:17:10.218871] [DEBUG] [LOCAL ] NC: Trimmed 2696 records to 1919 (keeping 200 days of data) [2025-09-17T05:17:10.232229] [DEBUG] [LOCAL ] NC: Primary data saved (1919 records). [2025-09-17T05:17:10.232435] [INFO ] [MAIN ] NC: Full history saved. [2025-09-17T05:17:10.232627] [INFO ] [MAIN ] Update Progress: 1458/2369 symbols completed. NC took 21.8s. Estimated remaining: 2h 13m 7s. Rate: 6.8 symbols/min [2025-09-17T05:17:10.300054] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-17T05:17:10.419662] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:17:10.472180] [DEBUG] [LOCAL ] NCLH: Loaded 40103 existing records from primary storage. [2025-09-17T05:17:10.472420] [INFO ] [MAIN ] NCLH: Loaded 40103 existing records. [2025-09-17T05:17:10.659532] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:17:10.659862] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-17T05:17:10.659930] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-17T05:17:10.661211] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-17T05:17:10.661289] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-17T05:17:11.040168] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:17:11.090174] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-09-17T05:17:11.518797] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T05:17:11.890136] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-17T05:17:12.339004] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T05:17:12.690159] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-11. [2025-09-17T05:17:12.716917] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T05:17:13.490192] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-17T05:17:14.290163] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-17T05:17:14.434174] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T05:17:14.677588] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T05:17:15.090203] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-17T05:17:15.374346] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T05:17:15.890160] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-17T05:17:16.251433] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T05:17:16.339525] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T05:17:16.690195] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-17T05:17:17.490147] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-09-17T05:17:17.847694] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T05:17:18.290155] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-17T05:17:19.066064] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T05:17:19.090079] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-17T05:17:19.199855] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T05:17:19.890146] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-17T05:17:20.080753] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T05:17:20.083534] [INFO ] [REMOTE ] NBXG: Full fetch complete (33224 records). [2025-09-17T05:17:20.083680] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-17T05:17:20.461075] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-17T05:17:20.461266] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-17T05:17:20.463119] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-17T05:17:20.463220] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-17T05:17:20.464879] [DEBUG] [LOCAL ] NBXG: Trimmed 33224 records to 22900 (keeping 200 days of data) [2025-09-17T05:17:20.620254] [DEBUG] [LOCAL ] NBXG: Primary data saved (22900 records). [2025-09-17T05:17:20.620468] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-17T05:17:20.620616] [INFO ] [MAIN ] Update Progress: 1459/2369 symbols completed. NBXG took 41.5s. Estimated remaining: 2h 12m 60s. Rate: 6.8 symbols/min [2025-09-17T05:17:20.695413] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-17T05:17:20.804010] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:17:20.817485] [DEBUG] [LOCAL ] NCV: Loaded 9628 existing records from primary storage. [2025-09-17T05:17:20.817732] [INFO ] [MAIN ] NCV: Loaded 9628 existing records. [2025-09-17T05:17:21.006304] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:17:21.006759] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-17T05:17:21.006837] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-17T05:17:21.007574] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-17T05:17:21.007680] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-17T05:17:21.378461] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:17:21.490130] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-11. [2025-09-17T05:17:21.605026] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T05:17:21.829454] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T05:17:22.290140] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-17T05:17:22.728046] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T05:17:22.815056] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T05:17:23.090119] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-17T05:17:23.807995] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T05:17:23.890150] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-09-17T05:17:24.690188] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-17T05:17:24.799257] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T05:17:25.490176] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-17T05:17:25.508744] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T05:17:25.511016] [INFO ] [REMOTE ] NCA: Full fetch complete (16045 records). [2025-09-17T05:17:25.511140] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-17T05:17:25.891963] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-17T05:17:25.892090] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-17T05:17:25.892797] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-17T05:17:25.892873] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-17T05:17:25.893605] [DEBUG] [LOCAL ] NCA: Trimmed 16045 records to 9900 (keeping 200 days of data) [2025-09-17T05:17:25.967113] [DEBUG] [LOCAL ] NCA: Primary data saved (9900 records). [2025-09-17T05:17:25.967339] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-17T05:17:25.967508] [INFO ] [MAIN ] Update Progress: 1460/2369 symbols completed. NCA took 36.0s. Estimated remaining: 2h 12m 49s. Rate: 6.8 symbols/min [2025-09-17T05:17:26.142046] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:17:26.154245] [DEBUG] [LOCAL ] NCZ: Loaded 8195 existing records from primary storage. [2025-09-17T05:17:26.154443] [INFO ] [MAIN ] NCZ: Loaded 8195 existing records. [2025-09-17T05:17:26.298445] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-09-17T05:17:26.341102] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:17:26.341371] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-17T05:17:26.341435] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-17T05:17:26.342184] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-17T05:17:26.342254] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-17T05:17:26.705907] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:17:27.090202] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-11. [2025-09-17T05:17:27.388678] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T05:17:27.522375] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T05:17:27.805543] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T05:17:27.890144] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-09-17T05:17:28.690247] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-17T05:17:28.923823] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T05:17:29.490172] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-17T05:17:29.530765] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T05:17:30.290193] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-17T05:17:31.090200] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-17T05:17:31.498733] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T05:17:31.688344] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T05:17:31.880759] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-17T05:17:31.891762] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-09-17T05:17:32.690207] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-17T05:17:33.036131] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T05:17:33.490210] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-17T05:17:34.290190] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-17T05:17:34.463033] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T05:17:35.007058] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-17T05:17:35.090153] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-17T05:17:35.236695] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T05:17:35.890203] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-17T05:17:36.690143] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-17T05:17:36.786959] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T05:17:37.251003] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T05:17:37.490174] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-17T05:17:37.726129] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T05:17:38.290206] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-17T05:17:39.090197] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-17T05:17:39.283848] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T05:17:39.546100] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T05:17:39.890245] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-17T05:17:39.988439] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T05:17:40.459121] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T05:17:40.690183] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-17T05:17:41.490202] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-17T05:17:41.661574] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T05:17:42.290188] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-17T05:17:43.094470] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-17T05:17:43.097099] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T05:17:43.801274] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-17T05:17:43.890190] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-17T05:17:44.113037] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T05:17:44.690195] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-17T05:17:45.490167] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-17T05:17:45.635976] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T05:17:45.907671] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T05:17:46.290187] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-17T05:17:46.429457] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T05:17:47.090745] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-17T05:17:47.091636] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T05:17:47.889385] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T05:17:47.891985] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-17T05:17:48.690191] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-17T05:17:49.490425] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-17T05:17:49.510288] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T05:17:49.513760] [INFO ] [REMOTE ] NCDL: Full fetch complete (33679 records). [2025-09-17T05:17:49.513939] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-17T05:17:49.913430] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-17T05:17:49.913769] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-17T05:17:49.914957] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-17T05:17:49.915305] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-17T05:17:49.917044] [DEBUG] [LOCAL ] NCDL: Trimmed 33679 records to 21877 (keeping 200 days of data) [2025-09-17T05:17:50.041522] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-17T05:17:50.057198] [INFO ] [REMOTE ] NCLH: Full fetch complete (77718 records). [2025-09-17T05:17:50.063393] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-17T05:17:50.306156] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-17T05:17:50.449672] [DEBUG] [LOCAL ] NCDL: Primary data saved (21877 records). [2025-09-17T05:17:50.450198] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-17T05:17:50.461614] [INFO ] [MAIN ] Update Progress: 1461/2369 symbols completed. NCDL took 47.7s. Estimated remaining: 2h 12m 50s. Rate: 6.8 symbols/min [2025-09-17T05:17:50.666398] [DEBUG] [VALIDATOR ] NCLH: All expected trading days are present. [2025-09-17T05:17:50.686044] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T05:17:50.679012] [DEBUG] [VALIDATOR ] NCLH: Primary data validation passed. [2025-09-17T05:17:50.729975] [INFO ] [MAIN ] NCLH: Fetched primary data is valid. [2025-09-17T05:17:50.750326] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:17:50.750451] [DEBUG] [LOCAL ] NCLH: Saving primary data. [2025-09-17T05:17:50.753778] [DEBUG] [LOCAL ] NCLH: Trimmed 77718 records to 53753 (keeping 200 days of data) [2025-09-17T05:17:50.872390] [DEBUG] [LOCAL ] NDMO: Loaded 12625 existing records from primary storage. [2025-09-17T05:17:50.880211] [INFO ] [MAIN ] NDMO: Loaded 12625 existing records. [2025-09-17T05:17:51.029502] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T05:17:51.107443] [INFO ] [REMOTE ] NCZ: Full fetch complete (21610 records). [2025-09-17T05:17:51.102892] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-17T05:17:51.116284] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:17:51.116468] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-17T05:17:51.169394] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-17T05:17:51.191850] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-17T05:17:51.278959] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-17T05:17:51.298715] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-17T05:17:52.032833] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-17T05:17:52.141869] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:17:52.143786] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-17T05:17:52.144576] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-11. [2025-09-17T05:17:52.147723] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-17T05:17:52.150137] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-17T05:17:52.167134] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T05:17:52.165760] [DEBUG] [LOCAL ] NCZ: Trimmed 21610 records to 11724 (keeping 200 days of data) [2025-09-17T05:17:52.348062] [DEBUG] [LOCAL ] NCZ: Primary data saved (11724 records). [2025-09-17T05:17:52.352211] [DEBUG] [LOCAL ] NCLH: Primary data saved (53753 records). [2025-09-17T05:17:52.352471] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-17T05:17:52.352719] [INFO ] [MAIN ] Update Progress: 1462/2369 symbols completed. NCZ took 26.4s. Estimated remaining: 2h 12m 37s. Rate: 6.8 symbols/min [2025-09-17T05:17:52.352523] [INFO ] [MAIN ] NCLH: Full history saved. [2025-09-17T05:17:52.420485] [INFO ] [MAIN ] Update Progress: 1463/2369 symbols completed. NCLH took 42.2s. Estimated remaining: 2h 12m 23s. Rate: 6.8 symbols/min [2025-09-17T05:17:52.693710] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:17:52.699437] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-17T05:17:52.725867] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:17:52.768908] [DEBUG] [LOCAL ] NEA: Loaded 26143 existing records from primary storage. [2025-09-17T05:17:52.769375] [INFO ] [MAIN ] NEA: Loaded 26143 existing records. [2025-09-17T05:17:52.909777] [DEBUG] [LOCAL ] NE: Loaded 38963 existing records from primary storage. [2025-09-17T05:17:52.946053] [INFO ] [MAIN ] NE: Loaded 38963 existing records. [2025-09-17T05:17:53.039613] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:17:53.078560] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-17T05:17:53.084476] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-17T05:17:53.090213] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-17T05:17:53.115481] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-17T05:17:53.181444] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:17:53.148551] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T05:17:53.247758] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-17T05:17:53.265529] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-17T05:17:53.294198] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-17T05:17:53.328859] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-17T05:17:53.506570] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-09-17T05:17:53.753364] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:17:53.877329] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T05:17:53.924992] [INFO ] [REMOTE ] NCV: Full fetch complete (23383 records). [2025-09-17T05:17:53.945321] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-17T05:17:53.966084] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:17:54.301247] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-11. [2025-09-17T05:17:54.353940] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-17T05:17:54.354085] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-17T05:17:54.355223] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-17T05:17:54.355312] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-17T05:17:54.356399] [DEBUG] [LOCAL ] NCV: Trimmed 23383 records to 13380 (keeping 200 days of data) [2025-09-17T05:17:54.450845] [DEBUG] [LOCAL ] NCV: Primary data saved (13380 records). [2025-09-17T05:17:54.451089] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-17T05:17:54.451220] [INFO ] [MAIN ] Update Progress: 1464/2369 symbols completed. NCV took 33.8s. Estimated remaining: 2h 12m 10s. Rate: 6.8 symbols/min [2025-09-17T05:17:54.633820] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:17:54.678047] [DEBUG] [LOCAL ] NEE: Loaded 40057 existing records from primary storage. [2025-09-17T05:17:54.678327] [INFO ] [MAIN ] NEE: Loaded 40057 existing records. [2025-09-17T05:17:54.872449] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T05:17:54.903057] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:17:54.908578] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-17T05:17:54.908681] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-17T05:17:54.909909] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-17T05:17:54.909988] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-17T05:17:55.101058] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-11. [2025-09-17T05:17:55.288788] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:17:55.890250] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-11. [2025-09-17T05:17:56.191980] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T05:17:56.534324] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T05:17:56.690163] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-09-17T05:17:57.490162] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-09-17T05:17:57.887777] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T05:17:58.290156] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-17T05:17:58.506604] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T05:17:59.066833] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T05:17:59.090093] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-09-17T05:17:59.890261] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-09-17T05:18:00.268575] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T05:18:00.523466] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T05:18:00.690206] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-17T05:18:01.490159] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-17T05:18:01.550286] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T05:18:01.903119] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T05:18:02.290201] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-17T05:18:03.090169] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-09-17T05:18:03.890173] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-17T05:18:04.830269] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T05:18:04.834310] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-17T05:18:05.504819] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (4.01 seconds). [2025-09-17T05:18:05.517817] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-17T05:18:05.595619] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (3.31 seconds). [2025-09-17T05:18:05.735358] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T05:18:06.083201] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-17T05:18:06.290175] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-17T05:18:07.090145] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-17T05:18:07.468709] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T05:18:07.890276] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-17T05:18:08.109025] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T05:18:08.691575] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T05:18:08.690410] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-17T05:18:09.490167] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-17T05:18:09.889841] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T05:18:10.220436] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T05:18:10.290137] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-17T05:18:10.362972] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T05:18:11.090148] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-17T05:18:11.870992] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T05:18:11.890082] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-17T05:18:12.412379] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T05:18:12.690159] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-17T05:18:13.490150] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-17T05:18:13.697086] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T05:18:13.760206] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T05:18:14.290159] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-17T05:18:15.090154] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-17T05:18:15.847259] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-17T05:18:15.890169] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-17T05:18:16.214528] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T05:18:16.690196] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-17T05:18:17.490149] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-17T05:18:17.678054] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-17T05:18:18.290162] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-17T05:18:18.471846] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T05:18:18.527611] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T05:18:18.945483] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (3.06 seconds). [2025-09-17T05:18:19.090165] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-17T05:18:19.890207] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-17T05:18:20.088399] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T05:18:20.690218] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-17T05:18:21.050101] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T05:18:21.490187] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-17T05:18:21.530955] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T05:18:21.538274] [INFO ] [REMOTE ] NEA: Full fetch complete (52388 records). [2025-09-17T05:18:21.538497] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-17T05:18:21.930661] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-17T05:18:21.930780] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-17T05:18:21.931761] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-17T05:18:21.931820] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-17T05:18:21.933033] [DEBUG] [LOCAL ] NEA: Trimmed 52388 records to 35411 (keeping 200 days of data) [2025-09-17T05:18:22.086195] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T05:18:22.095198] [INFO ] [REMOTE ] NE: Full fetch complete (75135 records). [2025-09-17T05:18:22.096973] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-17T05:18:22.291218] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-17T05:18:22.617852] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-17T05:18:22.620421] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-17T05:18:22.622554] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-17T05:18:22.623246] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-17T05:18:22.628881] [DEBUG] [LOCAL ] NE: Trimmed 75135 records to 52384 (keeping 200 days of data) [2025-09-17T05:18:22.690930] [DEBUG] [LOCAL ] NEA: Primary data saved (35411 records). [2025-09-17T05:18:22.727448] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-17T05:18:22.730181] [INFO ] [MAIN ] Update Progress: 1465/2369 symbols completed. NEA took 30.3s. Estimated remaining: 2h 12m 13s. Rate: 6.8 symbols/min [2025-09-17T05:18:22.916717] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:18:23.082195] [DEBUG] [LOCAL ] NEM: Loaded 40058 existing records from primary storage. [2025-09-17T05:18:23.083817] [INFO ] [MAIN ] NEM: Loaded 40058 existing records. [2025-09-17T05:18:23.280928] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:18:23.283315] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-17T05:18:23.283997] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-17T05:18:23.287052] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-17T05:18:23.287421] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-17T05:18:23.506968] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T05:18:23.555693] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-17T05:18:23.819383] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:18:23.872944] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-17T05:18:23.890321] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-17T05:18:23.894235] [DEBUG] [LOCAL ] NE: Primary data saved (52384 records). [2025-09-17T05:18:23.895304] [INFO ] [MAIN ] NE: Full history saved. [2025-09-17T05:18:23.895434] [INFO ] [MAIN ] Update Progress: 1466/2369 symbols completed. NE took 31.5s. Estimated remaining: 2h 11m 59s. Rate: 6.8 symbols/min [2025-09-17T05:18:24.077348] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:18:24.116998] [DEBUG] [LOCAL ] NET: Loaded 39495 existing records from primary storage. [2025-09-17T05:18:24.117232] [INFO ] [MAIN ] NET: Loaded 39495 existing records. [2025-09-17T05:18:24.298871] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:18:24.299152] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-17T05:18:24.299212] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-17T05:18:24.300206] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-17T05:18:24.300270] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-17T05:18:24.669866] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T05:18:24.686128] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:18:24.690093] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-17T05:18:25.490172] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-11. [2025-09-17T05:18:25.650166] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T05:18:26.159910] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-17T05:18:26.290163] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-17T05:18:27.090114] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-11. [2025-09-17T05:18:27.335136] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T05:18:27.521168] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-17T05:18:27.890193] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-17T05:18:28.690189] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-09-17T05:18:29.261334] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T05:18:29.264311] [INFO ] [REMOTE ] NDMO: Full fetch complete (24994 records). [2025-09-17T05:18:29.264428] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-17T05:18:29.497762] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-17T05:18:29.646359] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-17T05:18:29.646579] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-17T05:18:29.647358] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-17T05:18:29.647444] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-17T05:18:29.648595] [DEBUG] [LOCAL ] NDMO: Trimmed 24994 records to 16383 (keeping 200 days of data) [2025-09-17T05:18:29.822004] [DEBUG] [LOCAL ] NDMO: Primary data saved (16383 records). [2025-09-17T05:18:29.824121] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-11 (2.73 seconds). [2025-09-17T05:18:29.824385] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-17T05:18:29.836175] [INFO ] [MAIN ] Update Progress: 1467/2369 symbols completed. NDMO took 39.4s. Estimated remaining: 2h 11m 49s. Rate: 6.8 symbols/min [2025-09-17T05:18:30.012974] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:18:30.023106] [DEBUG] [LOCAL ] NEU: Loaded 6819 existing records from primary storage. [2025-09-17T05:18:30.023304] [INFO ] [MAIN ] NEU: Loaded 6819 existing records. [2025-09-17T05:18:30.206434] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:18:30.206795] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-17T05:18:30.206863] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-17T05:18:30.207513] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-17T05:18:30.207586] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-17T05:18:30.299093] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-17T05:18:30.583440] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:18:31.089182] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-17T05:18:31.099844] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-11. [2025-09-17T05:18:31.781876] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T05:18:31.802761] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (2.30 seconds). [2025-09-17T05:18:31.810404] [INFO ] [REMOTE ] NEE: Full fetch complete (77633 records). [2025-09-17T05:18:31.810687] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-17T05:18:31.895271] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-09-17T05:18:32.224242] [DEBUG] [VALIDATOR ] NEE: All expected trading days are present. [2025-09-17T05:18:32.224403] [DEBUG] [VALIDATOR ] NEE: Primary data validation passed. [2025-09-17T05:18:32.225777] [INFO ] [MAIN ] NEE: Fetched primary data is valid. [2025-09-17T05:18:32.225873] [DEBUG] [LOCAL ] NEE: Saving primary data. [2025-09-17T05:18:32.227840] [DEBUG] [LOCAL ] NEE: Trimmed 77633 records to 53707 (keeping 200 days of data) [2025-09-17T05:18:32.530536] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-17T05:18:32.615420] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T05:18:32.643182] [DEBUG] [LOCAL ] NEE: Primary data saved (53707 records). [2025-09-17T05:18:32.643412] [INFO ] [MAIN ] NEE: Full history saved. [2025-09-17T05:18:32.643527] [INFO ] [MAIN ] Update Progress: 1468/2369 symbols completed. NEE took 38.2s. Estimated remaining: 2h 11m 37s. Rate: 6.8 symbols/min [2025-09-17T05:18:32.695315] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-09-17T05:18:32.845609] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:18:32.849034] [DEBUG] [LOCAL ] NEUE: Loaded 1188 existing records from primary storage. [2025-09-17T05:18:32.849139] [INFO ] [MAIN ] NEUE: Loaded 1188 existing records. [2025-09-17T05:18:33.035921] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:18:33.036260] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-17T05:18:33.036330] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-17T05:18:33.036737] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-17T05:18:33.036819] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-17T05:18:33.401083] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:18:33.490099] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-11. [2025-09-17T05:18:33.499702] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T05:18:33.920114] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T05:18:34.290136] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-09-17T05:18:34.900573] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T05:18:35.090145] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-09-17T05:18:35.731424] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T05:18:35.890230] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-17T05:18:36.690155] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-09-17T05:18:37.490220] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-17T05:18:37.948878] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T05:18:37.951042] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T05:18:38.290160] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-17T05:18:38.775184] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-17T05:18:38.939941] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T05:18:39.090138] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-17T05:18:39.549363] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T05:18:39.890177] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-17T05:18:40.690175] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-17T05:18:41.438978] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T05:18:41.490159] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-17T05:18:42.074305] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-17T05:18:42.156943] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T05:18:42.290219] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-17T05:18:43.090186] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-17T05:18:43.890230] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-17T05:18:44.470103] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (2.18 seconds). [2025-09-17T05:18:44.571337] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T05:18:44.690109] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-17T05:18:45.247166] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-17T05:18:45.297215] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T05:18:45.490143] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-17T05:18:46.290208] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-17T05:18:46.721819] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T05:18:47.090164] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-17T05:18:47.526016] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T05:18:47.708793] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-17T05:18:47.890172] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-17T05:18:48.690216] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-17T05:18:48.866173] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T05:18:49.490244] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-17T05:18:50.290140] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-17T05:18:50.308925] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T05:18:50.927938] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-17T05:18:51.090185] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-17T05:18:51.890162] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-17T05:18:52.454832] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-17T05:18:52.676580] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T05:18:52.690074] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-17T05:18:53.203777] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T05:18:53.482714] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T05:18:53.485005] [INFO ] [REMOTE ] NEU: Full fetch complete (10071 records). [2025-09-17T05:18:53.485258] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-17T05:18:53.497724] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-17T05:18:53.853064] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-17T05:18:53.853192] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-17T05:18:53.854300] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-17T05:18:53.854362] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-17T05:18:53.854889] [DEBUG] [LOCAL ] NEU: Trimmed 10071 records to 8109 (keeping 200 days of data) [2025-09-17T05:18:53.909404] [DEBUG] [LOCAL ] NEU: Primary data saved (8109 records). [2025-09-17T05:18:53.909596] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-17T05:18:53.909715] [INFO ] [MAIN ] Update Progress: 1469/2369 symbols completed. NEU took 24.1s. Estimated remaining: 2h 11m 35s. Rate: 6.8 symbols/min [2025-09-17T05:18:54.019497] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T05:18:54.102719] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:18:54.107787] [DEBUG] [LOCAL ] NEXA: Loaded 3014 existing records from primary storage. [2025-09-17T05:18:54.107899] [INFO ] [MAIN ] NEXA: Loaded 3014 existing records. [2025-09-17T05:18:54.287323] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:18:54.287626] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-17T05:18:54.287702] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-17T05:18:54.287931] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-17T05:18:54.287992] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-17T05:18:54.298846] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-17T05:18:54.647845] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:18:55.090199] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-11. [2025-09-17T05:18:55.666022] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T05:18:55.890139] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-09-17T05:18:56.521906] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-17T05:18:56.667966] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T05:18:56.690083] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-09-17T05:18:57.421467] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T05:18:57.490093] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-17T05:18:58.086305] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T05:18:58.290178] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-17T05:18:58.750077] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T05:18:59.090143] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-17T05:18:59.890139] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-17T05:19:00.487294] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T05:19:00.690143] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-17T05:19:01.259410] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T05:19:01.292367] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-17T05:19:01.490185] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-17T05:19:02.010702] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T05:19:02.011560] [INFO ] [REMOTE ] NEUE: Full fetch complete (3997 records). [2025-09-17T05:19:02.011668] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-17T05:19:02.295290] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-17T05:19:02.385584] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-17T05:19:02.385713] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-17T05:19:02.385892] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-17T05:19:02.385942] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-17T05:19:02.386340] [DEBUG] [LOCAL ] NEUE: Trimmed 3997 records to 2258 (keeping 200 days of data) [2025-09-17T05:19:02.399400] [DEBUG] [LOCAL ] NEUE: Primary data saved (2258 records). [2025-09-17T05:19:02.399475] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-17T05:19:02.399562] [INFO ] [MAIN ] Update Progress: 1470/2369 symbols completed. NEUE took 29.8s. Estimated remaining: 2h 11m 26s. Rate: 6.8 symbols/min [2025-09-17T05:19:02.571013] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:19:02.598572] [DEBUG] [LOCAL ] NFG: Loaded 28137 existing records from primary storage. [2025-09-17T05:19:02.598802] [INFO ] [MAIN ] NFG: Loaded 28137 existing records. [2025-09-17T05:19:02.775657] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:19:02.775926] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-17T05:19:02.775984] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-17T05:19:02.776912] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-17T05:19:02.776975] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-17T05:19:03.100503] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-17T05:19:03.129602] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:19:03.890153] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-17T05:19:04.472789] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T05:19:04.690119] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-17T05:19:04.749140] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-17T05:19:05.167540] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-17T05:19:05.174407] [INFO ] [REMOTE ] NET: Full fetch complete (76773 records). [2025-09-17T05:19:05.174599] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-17T05:19:05.287151] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T05:19:05.495250] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-11. [2025-09-17T05:19:05.580941] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-17T05:19:05.581131] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-17T05:19:05.582474] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-17T05:19:05.582539] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-17T05:19:05.584401] [DEBUG] [LOCAL ] NET: Trimmed 76773 records to 53095 (keeping 200 days of data) [2025-09-17T05:19:05.930055] [DEBUG] [LOCAL ] NET: Primary data saved (53095 records). [2025-09-17T05:19:05.930263] [INFO ] [MAIN ] NET: Full history saved. [2025-09-17T05:19:05.930384] [INFO ] [MAIN ] Update Progress: 1471/2369 symbols completed. NET took 42.0s. Estimated remaining: 2h 11m 15s. Rate: 6.8 symbols/min [2025-09-17T05:19:06.105879] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:19:06.121931] [DEBUG] [LOCAL ] NFJ: Loaded 14583 existing records from primary storage. [2025-09-17T05:19:06.122124] [INFO ] [MAIN ] NFJ: Loaded 14583 existing records. [2025-09-17T05:19:06.301328] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-17T05:19:06.308078] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:19:06.309214] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-17T05:19:06.309307] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-17T05:19:06.309923] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-17T05:19:06.310000] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-17T05:19:06.685184] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:19:06.949417] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T05:19:07.090149] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-17T05:19:07.758145] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T05:19:07.890149] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-11. [2025-09-17T05:19:08.576286] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-17T05:19:08.690137] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-17T05:19:08.834092] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T05:19:09.490178] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-09-17T05:19:10.290190] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-09-17T05:19:10.668700] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T05:19:10.762986] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-17T05:19:11.090148] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-17T05:19:11.245596] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T05:19:11.890138] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-09-17T05:19:12.690142] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-09-17T05:19:13.327387] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-17T05:19:13.466491] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T05:19:13.490102] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-17T05:19:13.833904] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T05:19:14.290321] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-17T05:19:14.734614] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T05:19:15.090095] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-17T05:19:15.507390] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T05:19:15.890140] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-17T05:19:16.550847] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T05:19:16.690167] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-17T05:19:17.490199] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-17T05:19:18.021906] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-17T05:19:18.019970] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T05:19:18.029195] [INFO ] [REMOTE ] NEXA: Full fetch complete (7389 records). [2025-09-17T05:19:18.029473] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-17T05:19:18.075054] [INFO ] [REMOTE ] NEM: Full fetch complete (77652 records). [2025-09-17T05:19:18.113803] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-17T05:19:18.292084] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-17T05:19:18.667702] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-17T05:19:18.685191] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-17T05:19:18.717165] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-17T05:19:18.735620] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-17T05:19:18.766042] [DEBUG] [LOCAL ] NEXA: Trimmed 7389 records to 3859 (keeping 200 days of data) [2025-09-17T05:19:18.897163] [DEBUG] [VALIDATOR ] NEM: All expected trading days are present. [2025-09-17T05:19:18.896763] [DEBUG] [LOCAL ] NEXA: Primary data saved (3859 records). [2025-09-17T05:19:18.897404] [DEBUG] [VALIDATOR ] NEM: Primary data validation passed. [2025-09-17T05:19:18.897733] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-17T05:19:18.908887] [INFO ] [MAIN ] NEM: Fetched primary data is valid. [2025-09-17T05:19:18.926825] [INFO ] [MAIN ] Update Progress: 1472/2369 symbols completed. NEXA took 25.0s. Estimated remaining: 2h 11m 8s. Rate: 6.8 symbols/min [2025-09-17T05:19:18.927166] [DEBUG] [LOCAL ] NEM: Saving primary data. [2025-09-17T05:19:18.969791] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-17T05:19:19.031921] [DEBUG] [LOCAL ] NEM: Trimmed 77652 records to 53708 (keeping 200 days of data) [2025-09-17T05:19:19.118256] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-17T05:19:19.222723] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:19:19.267699] [DEBUG] [LOCAL ] NGG: Loaded 34801 existing records from primary storage. [2025-09-17T05:19:19.268656] [INFO ] [MAIN ] NGG: Loaded 34801 existing records. [2025-09-17T05:19:19.470099] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:19:19.476520] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-17T05:19:19.476838] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-17T05:19:19.534040] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-17T05:19:19.544193] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-17T05:19:19.711715] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T05:19:19.898013] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-17T05:19:20.063066] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:19:20.110266] [DEBUG] [LOCAL ] NEM: Primary data saved (53708 records). [2025-09-17T05:19:20.110514] [INFO ] [MAIN ] NEM: Full history saved. [2025-09-17T05:19:20.110657] [INFO ] [MAIN ] Update Progress: 1473/2369 symbols completed. NEM took 57.4s. Estimated remaining: 2h 10m 55s. Rate: 6.8 symbols/min [2025-09-17T05:19:20.289869] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:19:20.314872] [DEBUG] [LOCAL ] NGL: Loaded 22839 existing records from primary storage. [2025-09-17T05:19:20.315092] [INFO ] [MAIN ] NGL: Loaded 22839 existing records. [2025-09-17T05:19:20.502196] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:19:20.502524] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-17T05:19:20.502590] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-17T05:19:20.503339] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-17T05:19:20.503408] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-17T05:19:20.695635] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-11. [2025-09-17T05:19:20.885914] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:19:20.916124] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T05:19:21.123272] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T05:19:21.490199] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-11. [2025-09-17T05:19:22.063695] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T05:19:22.290209] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-17T05:19:22.547818] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T05:19:23.090186] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-09-17T05:19:23.773399] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T05:19:23.849430] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T05:19:23.890162] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-09-17T05:19:24.690177] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-17T05:19:25.008700] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T05:19:25.490241] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-17T05:19:26.045214] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T05:19:26.290214] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-17T05:19:26.594236] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T05:19:27.090180] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-09-17T05:19:27.892275] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-17T05:19:27.904480] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T05:19:28.695045] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T05:19:28.690390] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-17T05:19:28.746155] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T05:19:29.490188] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-09-17T05:19:29.812058] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T05:19:30.290183] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-17T05:19:30.973685] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T05:19:31.090215] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-17T05:19:31.774702] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T05:19:31.890162] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-17T05:19:32.316208] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T05:19:32.625220] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T05:19:32.690175] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-17T05:19:33.490170] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-17T05:19:33.722021] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T05:19:34.290203] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-17T05:19:34.400032] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T05:19:35.090181] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-17T05:19:35.407891] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T05:19:35.890208] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-17T05:19:36.565075] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T05:19:36.690183] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-17T05:19:37.305935] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T05:19:37.490273] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-17T05:19:37.890983] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T05:19:38.290198] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-17T05:19:38.599665] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T05:19:39.090161] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-17T05:19:39.680913] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T05:19:39.686727] [INFO ] [REMOTE ] NFG: Full fetch complete (56301 records). [2025-09-17T05:19:39.686895] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-17T05:19:39.901278] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-17T05:19:40.086190] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-17T05:19:40.091502] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-17T05:19:40.099347] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-17T05:19:40.099945] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T05:19:40.100099] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-17T05:19:40.106872] [DEBUG] [LOCAL ] NFG: Trimmed 56301 records to 38883 (keeping 200 days of data) [2025-09-17T05:19:40.348732] [DEBUG] [LOCAL ] NFG: Primary data saved (38883 records). [2025-09-17T05:19:40.348932] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-17T05:19:40.349085] [INFO ] [MAIN ] Update Progress: 1474/2369 symbols completed. NFG took 37.9s. Estimated remaining: 2h 10m 53s. Rate: 6.8 symbols/min [2025-09-17T05:19:40.533822] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:19:40.545886] [DEBUG] [LOCAL ] NGS: Loaded 8086 existing records from primary storage. [2025-09-17T05:19:40.546125] [INFO ] [MAIN ] NGS: Loaded 8086 existing records. [2025-09-17T05:19:40.695358] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-17T05:19:40.735525] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:19:40.735790] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-17T05:19:40.735857] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-17T05:19:40.736273] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-17T05:19:40.736364] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-17T05:19:41.108090] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:19:41.135964] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T05:19:41.490203] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-17T05:19:41.755743] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T05:19:41.758564] [INFO ] [REMOTE ] NFJ: Full fetch complete (30502 records). [2025-09-17T05:19:41.758693] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-17T05:19:42.136080] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-17T05:19:42.136200] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-17T05:19:42.136971] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-17T05:19:42.137033] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-17T05:19:42.137932] [DEBUG] [LOCAL ] NFJ: Trimmed 30502 records to 20515 (keeping 200 days of data) [2025-09-17T05:19:42.273354] [DEBUG] [LOCAL ] NFJ: Primary data saved (20515 records). [2025-09-17T05:19:42.273527] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-17T05:19:42.273767] [INFO ] [MAIN ] Update Progress: 1475/2369 symbols completed. NFJ took 36.3s. Estimated remaining: 2h 10m 40s. Rate: 6.8 symbols/min [2025-09-17T05:19:42.295279] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-17T05:19:42.468955] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:19:42.491231] [DEBUG] [LOCAL ] NGVC: Loaded 17387 existing records from primary storage. [2025-09-17T05:19:42.491449] [INFO ] [MAIN ] NGVC: Loaded 17387 existing records. [2025-09-17T05:19:42.680804] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:19:42.681124] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-17T05:19:42.681193] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-17T05:19:42.681837] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-17T05:19:42.681935] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-17T05:19:42.933260] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T05:19:42.994460] [INFO ] [REMOTE ] NGL: Full fetch complete (40072 records). [2025-09-17T05:19:42.996992] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-17T05:19:43.103125] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-11. [2025-09-17T05:19:43.192639] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:19:43.469403] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-17T05:19:43.469532] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-17T05:19:43.470447] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-17T05:19:43.470507] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-17T05:19:43.471693] [DEBUG] [LOCAL ] NGL: Trimmed 40072 records to 30328 (keeping 200 days of data) [2025-09-17T05:19:43.645453] [DEBUG] [LOCAL ] NGL: Primary data saved (30328 records). [2025-09-17T05:19:43.645661] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-17T05:19:43.645817] [INFO ] [MAIN ] Update Progress: 1476/2369 symbols completed. NGL took 23.5s. Estimated remaining: 2h 10m 27s. Rate: 6.8 symbols/min [2025-09-17T05:19:43.820218] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:19:43.840534] [DEBUG] [LOCAL ] NGVT: Loaded 17986 existing records from primary storage. [2025-09-17T05:19:43.840784] [INFO ] [MAIN ] NGVT: Loaded 17986 existing records. [2025-09-17T05:19:43.898748] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-11. [2025-09-17T05:19:44.036741] [WARN ] [MAIN ] NGVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:19:44.037528] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-17T05:19:44.037781] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-17T05:19:44.045772] [DEBUG] [LOCAL ] NGVT: Deleted primary data file. [2025-09-17T05:19:44.046689] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-17T05:19:44.046976] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T05:19:44.393996] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T05:19:44.492499] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:19:44.690140] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-11. [2025-09-17T05:19:44.998392] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T05:19:45.490199] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-09-17T05:19:45.781108] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T05:19:46.036254] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T05:19:46.290165] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-09-17T05:19:47.090146] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-09-17T05:19:47.301800] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T05:19:47.849850] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T05:19:47.890172] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-17T05:19:48.690185] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-09-17T05:19:49.490110] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-09-17T05:19:49.637766] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T05:19:49.661188] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T05:19:50.157054] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T05:19:50.290142] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-09-17T05:19:51.090152] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-17T05:19:51.406480] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T05:19:51.890146] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-17T05:19:52.637144] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T05:19:52.656034] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T05:19:52.690141] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-17T05:19:53.490194] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-17T05:19:53.622779] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T05:19:54.290219] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-17T05:19:55.090189] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-17T05:19:55.207690] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T05:19:55.361765] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T05:19:55.890206] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-17T05:19:56.134385] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T05:19:56.690173] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-17T05:19:56.914877] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T05:19:57.490171] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-17T05:19:57.638409] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T05:19:58.290157] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-17T05:19:59.097467] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-17T05:19:59.104265] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T05:19:59.124537] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T05:19:59.890103] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-17T05:20:00.178973] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T05:20:00.690171] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-17T05:20:01.490190] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-17T05:20:01.526084] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T05:20:01.532252] [INFO ] [REMOTE ] NGG: Full fetch complete (66187 records). [2025-09-17T05:20:01.532494] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-17T05:20:01.765100] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T05:20:01.989533] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-17T05:20:01.989696] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-17T05:20:01.991274] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-17T05:20:01.991355] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-17T05:20:01.993256] [DEBUG] [LOCAL ] NGG: Trimmed 66187 records to 46207 (keeping 200 days of data) [2025-09-17T05:20:02.297715] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-17T05:20:02.324500] [DEBUG] [LOCAL ] NGG: Primary data saved (46207 records). [2025-09-17T05:20:02.324734] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-17T05:20:02.324941] [INFO ] [MAIN ] Update Progress: 1477/2369 symbols completed. NGG took 43.4s. Estimated remaining: 2h 10m 24s. Rate: 6.8 symbols/min [2025-09-17T05:20:02.871958] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T05:20:03.090160] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-17T05:20:03.171942] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T05:20:03.890204] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-17T05:20:03.992946] [DEBUG] [REMOTE ] NGVT: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-17T05:20:03.993428] [WARN ] [REMOTE ] NGVT: No data returned for month 2025-04 [2025-09-17T05:20:04.252634] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T05:20:04.690217] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-17T05:20:05.478507] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T05:20:05.490096] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-17T05:20:06.290138] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-17T05:20:06.370727] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T05:20:06.372432] [INFO ] [REMOTE ] NGS: Full fetch complete (17101 records). [2025-09-17T05:20:06.372519] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-17T05:20:06.754968] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-17T05:20:06.755150] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-17T05:20:06.755903] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-17T05:20:06.755978] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-17T05:20:06.757266] [DEBUG] [LOCAL ] NGS: Trimmed 17101 records to 11791 (keeping 200 days of data) [2025-09-17T05:20:06.838332] [DEBUG] [LOCAL ] NGS: Primary data saved (11791 records). [2025-09-17T05:20:06.838584] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-17T05:20:06.838751] [INFO ] [MAIN ] Update Progress: 1478/2369 symbols completed. NGS took 26.5s. Estimated remaining: 2h 10m 13s. Rate: 6.8 symbols/min [2025-09-17T05:20:07.090134] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-17T05:20:07.474316] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T05:20:07.890171] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-17T05:20:07.925172] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T05:20:08.690112] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-17T05:20:09.064266] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T05:20:09.348900] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T05:20:09.490129] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-17T05:20:10.290157] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-17T05:20:10.551421] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T05:20:11.090166] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-17T05:20:11.388320] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T05:20:11.890108] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-17T05:20:12.311481] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T05:20:12.690097] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-17T05:20:12.700866] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T05:20:12.704194] [INFO ] [REMOTE ] NGVC: Full fetch complete (30181 records). [2025-09-17T05:20:12.704317] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-17T05:20:13.078953] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-17T05:20:13.079086] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-17T05:20:13.079823] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-17T05:20:13.079890] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-17T05:20:13.080815] [DEBUG] [LOCAL ] NGVC: Trimmed 30181 records to 22399 (keeping 200 days of data) [2025-09-17T05:20:13.228317] [DEBUG] [LOCAL ] NGVC: Primary data saved (22399 records). [2025-09-17T05:20:13.228504] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-17T05:20:13.228616] [INFO ] [MAIN ] Update Progress: 1479/2369 symbols completed. NGVC took 31.0s. Estimated remaining: 2h 10m 3s. Rate: 6.8 symbols/min [2025-09-17T05:20:14.078151] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T05:20:14.081690] [INFO ] [REMOTE ] NGVT: Full fetch complete (30158 records). [2025-09-17T05:20:14.081847] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-17T05:20:14.346552] [WARN ] [VALIDATOR ] NGVT: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T05:20:14.347240] [FATAL] [MAIN ] NGVT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:20:14.347311] [WARN ] [MAIN ] NGVT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:20:14.347365] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-17T05:20:14.347459] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-09-17T05:20:14.347514] [INFO ] [LOCAL ] NGVT: Starting deletion of derivative data. [2025-09-17T05:20:14.348090] [DEBUG] [LOCAL ] NGVT: Deleted derivative data file. [2025-09-17T05:20:14.348262] [INFO ] [MAIN ] Update Progress: 1480/2369 symbols completed. NGVT took 30.7s. Estimated remaining: 2h 9m 49s. Rate: 6.8 symbols/min [2025-09-17T05:20:14.995028] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:20:15.059354] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:20:15.060197] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:20:15.078340] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:20:15.091967] [DEBUG] [LOCAL ] NIC: Loaded 6454 existing records from primary storage. [2025-09-17T05:20:15.092147] [INFO ] [MAIN ] NIC: Loaded 6454 existing records. [2025-09-17T05:20:15.124515] [DEBUG] [LOCAL ] NIE: Loaded 8168 existing records from primary storage. [2025-09-17T05:20:15.136009] [INFO ] [MAIN ] NIE: Loaded 8168 existing records. [2025-09-17T05:20:15.315808] [DEBUG] [LOCAL ] NHI: Loaded 16442 existing records from primary storage. [2025-09-17T05:20:15.366516] [INFO ] [MAIN ] NHI: Loaded 16442 existing records. [2025-09-17T05:20:15.418021] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:20:15.559146] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:20:15.528188] [DEBUG] [LOCAL ] NI: Loaded 39798 existing records from primary storage. [2025-09-17T05:20:15.579974] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-17T05:20:15.580180] [INFO ] [MAIN ] NI: Loaded 39798 existing records. [2025-09-17T05:20:15.580095] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-17T05:20:15.595749] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-17T05:20:15.595816] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-17T05:20:15.643475] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-17T05:20:15.675364] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-17T05:20:15.696222] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-17T05:20:15.808731] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-17T05:20:15.854421] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:20:15.880528] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-17T05:20:15.955711] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-17T05:20:16.055858] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:20:16.077277] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-17T05:20:16.092836] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-17T05:20:16.097999] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-17T05:20:16.153000] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-17T05:20:16.364352] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-09-17T05:20:16.436587] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-17T05:20:16.885849] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:20:16.937887] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:20:16.943232] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-11. [2025-09-17T05:20:17.004823] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-11. [2025-09-17T05:20:17.144910] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:20:17.192504] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-11. [2025-09-17T05:20:17.299702] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:20:17.300115] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-11. [2025-09-17T05:20:17.910588] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T05:20:17.912920] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-09-17T05:20:17.952833] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T05:20:17.955777] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-09-17T05:20:18.317430] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T05:20:18.322954] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-09-17T05:20:18.540819] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T05:20:18.635769] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T05:20:18.726670] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T05:20:19.090179] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-09-17T05:20:19.121670] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T05:20:19.877743] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T05:20:19.890070] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-17T05:20:20.528391] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T05:20:20.690330] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-17T05:20:21.492745] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-09-17T05:20:22.290240] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-17T05:20:22.356852] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T05:20:22.384180] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T05:20:23.090193] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-17T05:20:23.172474] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T05:20:23.890148] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-17T05:20:23.909375] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T05:20:24.690163] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-17T05:20:25.373710] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T05:20:25.490156] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-17T05:20:25.635555] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T05:20:26.290142] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-17T05:20:26.440248] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T05:20:27.090152] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-17T05:20:27.840497] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T05:20:27.870560] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T05:20:27.890092] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-17T05:20:28.340742] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T05:20:28.690163] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-17T05:20:29.490171] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-17T05:20:30.246504] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T05:20:30.290111] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-17T05:20:30.478428] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T05:20:31.090130] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-17T05:20:31.281154] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T05:20:31.890239] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-17T05:20:32.690202] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-17T05:20:32.939428] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T05:20:32.994579] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T05:20:33.490166] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-17T05:20:33.569095] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T05:20:34.290152] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-17T05:20:34.507441] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T05:20:34.961736] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T05:20:35.090163] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-17T05:20:35.890112] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-17T05:20:36.165553] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T05:20:36.657277] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T05:20:36.690121] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-17T05:20:37.490188] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-17T05:20:37.531350] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T05:20:38.290152] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-17T05:20:38.602543] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T05:20:39.090197] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-17T05:20:39.170899] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T05:20:39.811856] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T05:20:39.813253] [INFO ] [REMOTE ] NIC: Full fetch complete (12025 records). [2025-09-17T05:20:39.813342] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-17T05:20:39.895313] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-17T05:20:40.180516] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-17T05:20:40.180636] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-17T05:20:40.180993] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-17T05:20:40.181048] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-17T05:20:40.181543] [DEBUG] [LOCAL ] NIC: Trimmed 12025 records to 8892 (keeping 200 days of data) [2025-09-17T05:20:40.246717] [DEBUG] [LOCAL ] NIC: Primary data saved (8892 records). [2025-09-17T05:20:40.246893] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-17T05:20:40.246996] [INFO ] [MAIN ] Update Progress: 1481/2369 symbols completed. NIC took 25.9s. Estimated remaining: 2h 9m 51s. Rate: 6.8 symbols/min [2025-09-17T05:20:40.420531] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:20:40.424967] [DEBUG] [LOCAL ] NIM: Loaded 2731 existing records from primary storage. [2025-09-17T05:20:40.425074] [INFO ] [MAIN ] NIM: Loaded 2731 existing records. [2025-09-17T05:20:40.604483] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:20:40.604766] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-17T05:20:40.604881] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-17T05:20:40.605184] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-17T05:20:40.605247] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-17T05:20:40.696585] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-17T05:20:40.969861] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:20:41.490158] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-11. [2025-09-17T05:20:41.715566] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T05:20:41.768200] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T05:20:41.835395] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T05:20:42.290193] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-17T05:20:43.090161] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-17T05:20:43.136870] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T05:20:43.890177] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-17T05:20:44.690149] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-09-17T05:20:44.799538] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T05:20:44.969260] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T05:20:45.096943] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-17T05:20:45.490168] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-17T05:20:46.247789] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T05:20:46.249709] [INFO ] [REMOTE ] NIE: Full fetch complete (16355 records). [2025-09-17T05:20:46.249810] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-17T05:20:46.295311] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-17T05:20:46.630906] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-17T05:20:46.631035] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-17T05:20:46.631444] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-17T05:20:46.631502] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-17T05:20:46.632164] [DEBUG] [LOCAL ] NIE: Trimmed 16355 records to 11665 (keeping 200 days of data) [2025-09-17T05:20:46.714431] [DEBUG] [LOCAL ] NIE: Primary data saved (11665 records). [2025-09-17T05:20:46.714671] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-17T05:20:46.714782] [INFO ] [MAIN ] Update Progress: 1482/2369 symbols completed. NIE took 32.4s. Estimated remaining: 2h 9m 41s. Rate: 6.8 symbols/min [2025-09-17T05:20:46.885548] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:20:46.907661] [DEBUG] [LOCAL ] NINE: Loaded 21737 existing records from primary storage. [2025-09-17T05:20:46.907879] [INFO ] [MAIN ] NINE: Loaded 21737 existing records. [2025-09-17T05:20:47.090904] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:20:47.090705] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-09-17T05:20:47.092015] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-17T05:20:47.092087] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-17T05:20:47.092676] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-17T05:20:47.092738] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-17T05:20:47.460138] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:20:47.476706] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T05:20:47.759297] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T05:20:47.890187] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-11. [2025-09-17T05:20:48.690179] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-17T05:20:49.365908] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T05:20:49.392424] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T05:20:49.395917] [INFO ] [REMOTE ] NHI: Full fetch complete (31687 records). [2025-09-17T05:20:49.396110] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-17T05:20:49.495313] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-17T05:20:49.809479] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-17T05:20:49.809602] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-17T05:20:49.810442] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-17T05:20:49.810501] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-17T05:20:49.811592] [DEBUG] [LOCAL ] NHI: Trimmed 31687 records to 22187 (keeping 200 days of data) [2025-09-17T05:20:49.953913] [DEBUG] [LOCAL ] NHI: Primary data saved (22187 records). [2025-09-17T05:20:49.954111] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-17T05:20:49.954229] [INFO ] [MAIN ] Update Progress: 1483/2369 symbols completed. NHI took 35.6s. Estimated remaining: 2h 9m 29s. Rate: 6.8 symbols/min [2025-09-17T05:20:50.124637] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:20:50.169082] [DEBUG] [LOCAL ] NIO: Loaded 40152 existing records from primary storage. [2025-09-17T05:20:50.169279] [INFO ] [MAIN ] NIO: Loaded 40152 existing records. [2025-09-17T05:20:50.291052] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-17T05:20:50.297555] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T05:20:50.366580] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:20:50.367867] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-17T05:20:50.367949] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-17T05:20:50.368775] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-17T05:20:50.369001] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-17T05:20:50.744146] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:20:51.090170] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-17T05:20:51.797993] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T05:20:51.890153] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-11. [2025-09-17T05:20:52.302061] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T05:20:52.690196] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-17T05:20:53.284625] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T05:20:53.490166] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-09-17T05:20:54.137089] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-11 (2.25 seconds). [2025-09-17T05:20:54.290142] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-09-17T05:20:54.876736] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T05:20:55.090144] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-17T05:20:55.890154] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-17T05:20:56.466858] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T05:20:56.690171] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-17T05:20:56.913026] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-17T05:20:56.914398] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T05:20:57.041738] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T05:20:57.490187] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-17T05:20:58.058236] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T05:20:58.290170] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-17T05:20:58.750077] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T05:20:59.090184] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-09-17T05:20:59.890154] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-17T05:21:00.690173] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-09-17T05:21:01.490167] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-17T05:21:01.669547] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T05:21:01.677241] [INFO ] [REMOTE ] NI: Full fetch complete (77081 records). [2025-09-17T05:21:01.707213] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-17T05:21:01.713030] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-17T05:21:02.139553] [DEBUG] [VALIDATOR ] NI: All expected trading days are present. [2025-09-17T05:21:02.139795] [DEBUG] [VALIDATOR ] NI: Primary data validation passed. [2025-09-17T05:21:02.140909] [INFO ] [MAIN ] NI: Fetched primary data is valid. [2025-09-17T05:21:02.140974] [DEBUG] [LOCAL ] NI: Saving primary data. [2025-09-17T05:21:02.142860] [DEBUG] [LOCAL ] NI: Trimmed 77081 records to 53423 (keeping 200 days of data) [2025-09-17T05:21:02.337319] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-17T05:21:02.498372] [DEBUG] [LOCAL ] NI: Primary data saved (53423 records). [2025-09-17T05:21:02.498660] [INFO ] [MAIN ] NI: Full history saved. [2025-09-17T05:21:02.498779] [INFO ] [MAIN ] Update Progress: 1484/2369 symbols completed. NI took 48.1s. Estimated remaining: 2h 9m 22s. Rate: 6.8 symbols/min [2025-09-17T05:21:02.693255] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:21:02.695324] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-17T05:21:02.695217] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T05:21:02.702983] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-17T05:21:02.703771] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-17T05:21:02.703834] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-17T05:21:02.703891] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-17T05:21:02.703932] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-17T05:21:03.063872] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:21:03.090085] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-11. [2025-09-17T05:21:03.429899] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:21:03.430289] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-11 [2025-09-17T05:21:03.676671] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-17T05:21:03.677832] [INFO ] [REMOTE ] NIM: Full fetch complete (6944 records). [2025-09-17T05:21:03.677927] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-17T05:21:03.895338] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-17T05:21:04.044302] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-17T05:21:04.044427] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-17T05:21:04.044719] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-17T05:21:04.044777] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-17T05:21:04.045178] [DEBUG] [LOCAL ] NIM: Trimmed 6944 records to 4172 (keeping 200 days of data) [2025-09-17T05:21:04.070841] [DEBUG] [LOCAL ] NIM: Primary data saved (4172 records). [2025-09-17T05:21:04.070924] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-17T05:21:04.071007] [INFO ] [MAIN ] Update Progress: 1485/2369 symbols completed. NIM took 23.8s. Estimated remaining: 2h 9m 9s. Rate: 6.8 symbols/min [2025-09-17T05:21:04.173000] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:21:04.176235] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-17T05:21:04.257555] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:21:04.289091] [DEBUG] [LOCAL ] NJR: Loaded 28028 existing records from primary storage. [2025-09-17T05:21:04.289371] [INFO ] [MAIN ] NJR: Loaded 28028 existing records. [2025-09-17T05:21:04.484939] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:21:04.485338] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-17T05:21:04.485406] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-17T05:21:04.486508] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-17T05:21:04.486581] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-17T05:21:04.698168] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-17T05:21:04.879198] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:21:05.204883] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.87 seconds). [2025-09-17T05:21:05.490157] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-17T05:21:05.681701] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T05:21:06.290154] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-17T05:21:07.090158] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-11. [2025-09-17T05:21:07.594783] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T05:21:07.890178] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-09-17T05:21:08.188059] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:21:08.191561] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-17T05:21:08.191754] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-09-17T05:21:08.227236] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T05:21:08.690202] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-17T05:21:08.885634] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:21:08.886060] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-17T05:21:09.490193] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-17T05:21:10.290165] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-17T05:21:10.484221] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:21:10.484665] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-17T05:21:10.736688] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T05:21:11.090093] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-17T05:21:11.281401] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:21:11.281855] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-17T05:21:11.890193] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-09-17T05:21:12.690153] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-17T05:21:12.884386] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:21:12.884814] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-17T05:21:13.324258] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T05:21:13.490255] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-17T05:21:14.290209] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-17T05:21:14.520256] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:21:14.520697] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-17T05:21:15.090150] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-17T05:21:15.890159] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-17T05:21:16.690172] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-09-17T05:21:16.809318] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (3.32 seconds). [2025-09-17T05:21:17.424894] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-17T05:21:17.490198] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-17T05:21:17.537110] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T05:21:18.190452] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T05:21:18.290221] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-17T05:21:19.090149] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-17T05:21:19.225099] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T05:21:19.714978] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T05:21:19.890240] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-17T05:21:20.484377] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T05:21:20.690154] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-17T05:21:21.147144] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T05:21:21.152415] [INFO ] [REMOTE ] NIQ: Full fetch complete (13337 records). [2025-09-17T05:21:21.152541] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-17T05:21:21.337954] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 39 unique days, need 200 days [2025-09-17T05:21:21.338299] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:21:21.338428] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:21:21.338495] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-17T05:21:21.338583] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-17T05:21:21.338705] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-17T05:21:21.338795] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-17T05:21:21.338947] [INFO ] [MAIN ] Update Progress: 1486/2369 symbols completed. NIQ took 18.8s. Estimated remaining: 2h 9m 5s. Rate: 6.8 symbols/min [2025-09-17T05:21:21.490357] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-17T05:21:21.511460] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:21:21.512386] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-17T05:21:21.512449] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-17T05:21:21.512581] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-17T05:21:21.512626] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-17T05:21:21.512700] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-17T05:21:21.512740] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-17T05:21:21.871270] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:21:22.290210] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-11. [2025-09-17T05:21:23.095510] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-17T05:21:23.126970] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-17T05:21:23.165286] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T05:21:23.890201] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-17T05:21:24.631636] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T05:21:24.690160] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-17T05:21:24.808682] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-11 (2.52 seconds). [2025-09-17T05:21:25.403400] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T05:21:25.495666] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-17T05:21:25.506663] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T05:21:26.290205] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-17T05:21:27.090269] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-17T05:21:27.824902] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-17T05:21:27.857060] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T05:21:27.890076] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-17T05:21:28.690191] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-17T05:21:29.338290] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T05:21:29.429227] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-17T05:21:29.490101] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-17T05:21:30.290177] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-17T05:21:31.090175] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-17T05:21:31.406961] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-17T05:21:31.476315] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T05:21:31.480825] [INFO ] [REMOTE ] NINE: Full fetch complete (44787 records). [2025-09-17T05:21:31.480941] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-17T05:21:31.892532] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-17T05:21:31.893004] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-17T05:21:31.894385] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-17T05:21:31.895523] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-17T05:21:31.895853] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-17T05:21:31.897775] [DEBUG] [LOCAL ] NINE: Trimmed 44787 records to 29103 (keeping 200 days of data) [2025-09-17T05:21:32.049159] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-17T05:21:32.140213] [DEBUG] [LOCAL ] NINE: Primary data saved (29103 records). [2025-09-17T05:21:32.140425] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-17T05:21:32.140563] [INFO ] [MAIN ] Update Progress: 1487/2369 symbols completed. NINE took 45.4s. Estimated remaining: 2h 8m 58s. Rate: 6.8 symbols/min [2025-09-17T05:21:32.318278] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:21:32.331386] [DEBUG] [LOCAL ] NKX: Loaded 10327 existing records from primary storage. [2025-09-17T05:21:32.331570] [INFO ] [MAIN ] NKX: Loaded 10327 existing records. [2025-09-17T05:21:32.513458] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:21:32.513813] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-17T05:21:32.513877] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-17T05:21:32.514401] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-17T05:21:32.514460] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-17T05:21:32.693919] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-17T05:21:32.908629] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:21:32.910738] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T05:21:33.490110] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-11. [2025-09-17T05:21:34.290233] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-17T05:21:34.509155] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-17T05:21:34.510091] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T05:21:35.090241] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-17T05:21:35.153881] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-17T05:21:35.720769] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T05:21:35.890202] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-17T05:21:36.690202] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-09-17T05:21:37.281092] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T05:21:37.287933] [INFO ] [REMOTE ] NJR: Full fetch complete (53985 records). [2025-09-17T05:21:37.288152] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-17T05:21:37.519107] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-17T05:21:37.689121] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-17T05:21:37.689467] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-17T05:21:37.690955] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-17T05:21:37.700772] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-17T05:21:37.702574] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T05:21:37.723885] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-17T05:21:37.722733] [DEBUG] [LOCAL ] NJR: Trimmed 53985 records to 37915 (keeping 200 days of data) [2025-09-17T05:21:37.732107] [INFO ] [REMOTE ] NIO: Full fetch complete (77970 records). [2025-09-17T05:21:37.732330] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-17T05:21:38.262259] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-17T05:21:38.263216] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-17T05:21:38.265062] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-17T05:21:38.265737] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-17T05:21:38.270698] [DEBUG] [LOCAL ] NIO: Trimmed 77970 records to 53802 (keeping 200 days of data) [2025-09-17T05:21:38.331689] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-09-17T05:21:38.646434] [DEBUG] [LOCAL ] NJR: Primary data saved (37915 records). [2025-09-17T05:21:38.651797] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-17T05:21:38.654479] [INFO ] [MAIN ] Update Progress: 1488/2369 symbols completed. NJR took 34.6s. Estimated remaining: 2h 8m 48s. Rate: 6.8 symbols/min [2025-09-17T05:21:38.927288] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:21:38.940296] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-09-17T05:21:38.937847] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-17T05:21:38.940446] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-17T05:21:38.940511] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-17T05:21:38.942345] [INFO ] [MAIN ] Update Progress: 1489/2369 symbols completed. NIO took 49.0s. Estimated remaining: 2h 8m 34s. Rate: 6.8 symbols/min [2025-09-17T05:21:38.942552] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-17T05:21:39.006925] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-17T05:21:39.044722] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-17T05:21:39.044886] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-17T05:21:39.220531] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:21:39.376849] [DEBUG] [LOCAL ] NLOP: Loaded 8444 existing records from primary storage. [2025-09-17T05:21:39.409790] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T05:21:39.427192] [INFO ] [MAIN ] NLOP: Loaded 8444 existing records. [2025-09-17T05:21:39.453111] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-17T05:21:39.619223] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:21:39.696820] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:21:39.697094] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-17T05:21:39.697153] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-17T05:21:39.697504] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-17T05:21:39.697566] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-17T05:21:39.912861] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-11. [2025-09-17T05:21:40.063787] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:21:40.103896] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-17T05:21:40.359048] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T05:21:40.571214] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T05:21:40.690131] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-17T05:21:41.490186] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-11. [2025-09-17T05:21:42.290224] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-17T05:21:42.410049] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T05:21:42.897241] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T05:21:43.090172] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-17T05:21:43.417565] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (2.73 seconds). [2025-09-17T05:21:43.696391] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T05:21:43.890157] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-17T05:21:44.680023] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T05:21:44.690075] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-17T05:21:45.490143] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-09-17T05:21:45.600064] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T05:21:46.271987] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T05:21:46.290071] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-09-17T05:21:47.090145] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-17T05:21:47.257562] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T05:21:47.665590] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T05:21:47.890151] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-17T05:21:48.690248] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-17T05:21:48.698916] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T05:21:49.323612] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T05:21:49.490228] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-17T05:21:49.928861] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T05:21:50.290188] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-17T05:21:51.090172] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-17T05:21:51.369504] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T05:21:51.484359] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-17T05:21:51.890180] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-17T05:21:52.600567] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T05:21:52.690148] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-17T05:21:53.490161] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-17T05:21:53.630694] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T05:21:54.290148] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-17T05:21:55.090178] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-17T05:21:55.130738] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T05:21:55.745585] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-17T05:21:55.763995] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T05:21:55.890110] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-17T05:21:56.690145] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-17T05:21:56.715919] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T05:21:57.490155] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-17T05:21:58.078302] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T05:21:58.290202] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-17T05:21:58.947298] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-17T05:21:59.090208] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-17T05:21:59.184382] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T05:21:59.714559] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T05:21:59.890183] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-17T05:22:00.543776] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T05:22:00.545211] [INFO ] [REMOTE ] NL: Full fetch complete (6962 records). [2025-09-17T05:22:00.545312] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-17T05:22:00.708168] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-17T05:22:00.753744] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T05:22:00.753998] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:22:00.754050] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:22:00.754098] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-17T05:22:00.754185] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-17T05:22:00.754234] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-17T05:22:00.754287] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-17T05:22:00.754376] [INFO ] [MAIN ] Update Progress: 1490/2369 symbols completed. NL took 22.1s. Estimated remaining: 2h 8m 33s. Rate: 6.8 symbols/min [2025-09-17T05:22:00.932504] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:22:00.972658] [DEBUG] [LOCAL ] NLY: Loaded 39940 existing records from primary storage. [2025-09-17T05:22:00.972885] [INFO ] [MAIN ] NLY: Loaded 39940 existing records. [2025-09-17T05:22:01.159830] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:22:01.160223] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-17T05:22:01.160311] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-17T05:22:01.161482] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-17T05:22:01.161574] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-17T05:22:01.495318] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-17T05:22:01.563303] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:22:02.290171] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-17T05:22:02.528525] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T05:22:02.531236] [INFO ] [REMOTE ] NKX: Full fetch complete (19574 records). [2025-09-17T05:22:02.531580] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-17T05:22:02.925579] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-17T05:22:02.925720] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-17T05:22:02.926275] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-17T05:22:02.926330] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-17T05:22:02.927033] [DEBUG] [LOCAL ] NKX: Trimmed 19574 records to 13626 (keeping 200 days of data) [2025-09-17T05:22:03.018682] [DEBUG] [LOCAL ] NKX: Primary data saved (13626 records). [2025-09-17T05:22:03.018932] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-17T05:22:03.019042] [INFO ] [MAIN ] Update Progress: 1491/2369 symbols completed. NKX took 30.9s. Estimated remaining: 2h 8m 20s. Rate: 6.8 symbols/min [2025-09-17T05:22:03.090689] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-11. [2025-09-17T05:22:03.197190] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T05:22:03.221809] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:22:03.233753] [DEBUG] [LOCAL ] NMAI: Loaded 9353 existing records from primary storage. [2025-09-17T05:22:03.233977] [INFO ] [MAIN ] NMAI: Loaded 9353 existing records. [2025-09-17T05:22:03.424885] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:22:03.425476] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-17T05:22:03.425553] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-17T05:22:03.426162] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-17T05:22:03.426232] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-17T05:22:03.791815] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:22:03.830215] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (3.12 seconds). [2025-09-17T05:22:03.890145] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-17T05:22:04.690155] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-17T05:22:04.737982] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T05:22:04.951479] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T05:22:05.490140] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-09-17T05:22:06.290143] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-11. [2025-09-17T05:22:07.012004] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-17T05:22:07.089491] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T05:22:07.100260] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-17T05:22:07.118947] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T05:22:07.602519] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T05:22:07.890144] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-17T05:22:08.690205] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-09-17T05:22:09.490327] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-17T05:22:09.602462] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T05:22:10.096509] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-17T05:22:10.102530] [INFO ] [REMOTE ] NKE: Full fetch complete (77178 records). [2025-09-17T05:22:10.102716] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-17T05:22:10.301542] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T05:22:10.302327] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:22:10.298799] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-09-17T05:22:10.302403] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:22:10.303296] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-17T05:22:10.312526] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-17T05:22:10.312849] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T05:22:10.316656] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-17T05:22:10.317062] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-17T05:22:10.317155] [INFO ] [MAIN ] Update Progress: 1492/2369 symbols completed. NKE took 49.0s. Estimated remaining: 2h 8m 11s. Rate: 6.8 symbols/min [2025-09-17T05:22:10.490573] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:22:10.490831] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-17T05:22:10.490883] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-17T05:22:10.491000] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-17T05:22:10.491044] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-17T05:22:10.491090] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-17T05:22:10.491130] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-17T05:22:10.847981] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:22:11.090138] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-17T05:22:11.372185] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T05:22:11.800827] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T05:22:11.803369] [INFO ] [REMOTE ] NLOP: Full fetch complete (17608 records). [2025-09-17T05:22:11.803499] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-17T05:22:11.895264] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-17T05:22:12.180455] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-17T05:22:12.180583] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-17T05:22:12.181100] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-17T05:22:12.181178] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-17T05:22:12.182462] [DEBUG] [LOCAL ] NLOP: Trimmed 17608 records to 11781 (keeping 200 days of data) [2025-09-17T05:22:12.257228] [DEBUG] [LOCAL ] NLOP: Primary data saved (11781 records). [2025-09-17T05:22:12.257419] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-17T05:22:12.257556] [INFO ] [MAIN ] Update Progress: 1493/2369 symbols completed. NLOP took 33.3s. Estimated remaining: 2h 7m 58s. Rate: 6.8 symbols/min [2025-09-17T05:22:12.427807] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:22:12.444604] [DEBUG] [LOCAL ] NMCO: Loaded 12358 existing records from primary storage. [2025-09-17T05:22:12.444840] [INFO ] [MAIN ] NMCO: Loaded 12358 existing records. [2025-09-17T05:22:12.622901] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:22:12.623197] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-17T05:22:12.623274] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-17T05:22:12.623792] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-17T05:22:12.623859] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-17T05:22:12.698465] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-17T05:22:12.993801] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:22:13.490150] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-11. [2025-09-17T05:22:13.521465] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T05:22:13.773519] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T05:22:14.290143] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-11. [2025-09-17T05:22:14.391213] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T05:22:14.478825] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:22:14.479218] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-11 [2025-09-17T05:22:15.090143] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-17T05:22:15.890243] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-17T05:22:16.128361] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T05:22:16.690195] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-17T05:22:16.891228] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:22:16.891681] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-17T05:22:17.490158] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-09-17T05:22:17.693634] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:22:17.694138] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-09-17T05:22:17.760237] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T05:22:18.290152] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-17T05:22:18.497100] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:22:18.497488] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-17T05:22:19.090194] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-09-17T05:22:19.890128] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-17T05:22:20.241956] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T05:22:20.690150] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-09-17T05:22:21.490188] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-17T05:22:21.610760] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T05:22:21.670976] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T05:22:22.279619] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T05:22:22.290071] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-17T05:22:22.963211] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T05:22:23.090183] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-17T05:22:23.504917] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-17T05:22:23.890186] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-17T05:22:24.690227] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-17T05:22:24.782285] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T05:22:25.490185] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-17T05:22:26.290229] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-17T05:22:26.721306] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T05:22:27.090232] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-17T05:22:27.175306] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T05:22:27.379963] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T05:22:27.890228] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-17T05:22:28.690176] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-17T05:22:28.832930] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T05:22:29.027063] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T05:22:29.490156] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-17T05:22:30.290184] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-17T05:22:30.376471] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T05:22:30.551203] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T05:22:31.090220] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-17T05:22:31.237419] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T05:22:31.890159] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-17T05:22:32.112169] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T05:22:32.115529] [INFO ] [REMOTE ] NMAI: Full fetch complete (19866 records). [2025-09-17T05:22:32.115794] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-17T05:22:32.541890] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-17T05:22:32.542052] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-17T05:22:32.542880] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-17T05:22:32.542978] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-17T05:22:32.543755] [DEBUG] [LOCAL ] NMAI: Trimmed 19866 records to 13188 (keeping 200 days of data) [2025-09-17T05:22:32.636675] [DEBUG] [LOCAL ] NMAI: Primary data saved (13188 records). [2025-09-17T05:22:32.636925] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-17T05:22:32.637067] [INFO ] [MAIN ] Update Progress: 1494/2369 symbols completed. NMAI took 29.6s. Estimated remaining: 2h 7m 56s. Rate: 6.8 symbols/min [2025-09-17T05:22:32.696819] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-17T05:22:32.831308] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:22:32.839634] [DEBUG] [LOCAL ] NMG: Loaded 5702 existing records from primary storage. [2025-09-17T05:22:32.839823] [INFO ] [MAIN ] NMG: Loaded 5702 existing records. [2025-09-17T05:22:33.027328] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:22:33.027702] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-17T05:22:33.027795] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-17T05:22:33.028238] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-17T05:22:33.028332] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-17T05:22:33.396638] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:22:33.490230] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-11. [2025-09-17T05:22:33.792811] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T05:22:34.194129] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-17T05:22:34.245144] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T05:22:34.290217] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-09-17T05:22:35.090170] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-17T05:22:35.217971] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T05:22:35.890176] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-17T05:22:36.123700] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T05:22:36.690172] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-17T05:22:37.376216] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T05:22:37.490185] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-17T05:22:37.886320] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T05:22:38.290148] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-17T05:22:38.478857] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T05:22:39.090152] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-09-17T05:22:39.890196] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-17T05:22:40.168064] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T05:22:40.188325] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T05:22:40.690142] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-17T05:22:41.386736] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T05:22:41.490100] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-17T05:22:41.545098] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T05:22:42.001054] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T05:22:42.290241] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-17T05:22:43.090159] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-17T05:22:43.871224] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T05:22:43.890098] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-17T05:22:44.028823] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T05:22:44.035933] [INFO ] [REMOTE ] NLY: Full fetch complete (77425 records). [2025-09-17T05:22:44.036187] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-17T05:22:44.452344] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-17T05:22:44.452509] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-17T05:22:44.453904] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-17T05:22:44.453981] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-17T05:22:44.456226] [DEBUG] [LOCAL ] NLY: Trimmed 77425 records to 53583 (keeping 200 days of data) [2025-09-17T05:22:44.562865] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T05:22:44.692046] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-17T05:22:44.814991] [DEBUG] [LOCAL ] NLY: Primary data saved (53583 records). [2025-09-17T05:22:44.815180] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-17T05:22:44.815347] [INFO ] [MAIN ] Update Progress: 1495/2369 symbols completed. NLY took 44.1s. Estimated remaining: 2h 7m 49s. Rate: 6.8 symbols/min [2025-09-17T05:22:44.982104] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:22:44.987429] [DEBUG] [LOCAL ] NMI: Loaded 3398 existing records from primary storage. [2025-09-17T05:22:44.987549] [INFO ] [MAIN ] NMI: Loaded 3398 existing records. [2025-09-17T05:22:45.207037] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:22:45.207309] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-17T05:22:45.207396] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-17T05:22:45.207706] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-17T05:22:45.207765] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-17T05:22:45.495275] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-17T05:22:45.569932] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:22:45.659875] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T05:22:46.188609] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T05:22:46.290115] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-11. [2025-09-17T05:22:46.874742] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T05:22:47.090179] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-09-17T05:22:47.711282] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T05:22:47.890144] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-17T05:22:48.443091] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T05:22:48.690140] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-17T05:22:49.357774] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T05:22:49.490187] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-17T05:22:50.006823] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-17T05:22:50.290167] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-17T05:22:51.090222] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-17T05:22:51.256265] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T05:22:51.890184] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-17T05:22:52.567821] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T05:22:52.599535] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T05:22:52.690178] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-17T05:22:53.490152] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-17T05:22:54.290186] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-17T05:22:54.314393] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T05:22:54.321090] [INFO ] [REMOTE ] NMAX: Full fetch complete (38469 records). [2025-09-17T05:22:54.321279] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-17T05:22:54.524163] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T05:22:54.539947] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 117 unique days, need 200 days [2025-09-17T05:22:54.543897] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:22:54.543974] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:22:54.544021] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-17T05:22:54.544109] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-17T05:22:54.544154] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-17T05:22:54.544219] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-17T05:22:54.544316] [INFO ] [MAIN ] Update Progress: 1496/2369 symbols completed. NMAX took 44.2s. Estimated remaining: 2h 7m 41s. Rate: 6.8 symbols/min [2025-09-17T05:22:54.727900] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:22:54.741339] [DEBUG] [LOCAL ] NMM: Loaded 9943 existing records from primary storage. [2025-09-17T05:22:54.741554] [INFO ] [MAIN ] NMM: Loaded 9943 existing records. [2025-09-17T05:22:54.929978] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:22:54.930340] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-17T05:22:54.930412] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-17T05:22:54.930922] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-17T05:22:54.930990] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-17T05:22:55.094740] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-17T05:22:55.310310] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:22:55.318411] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T05:22:55.321204] [INFO ] [REMOTE ] NMCO: Full fetch complete (24497 records). [2025-09-17T05:22:55.321335] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-17T05:22:55.691717] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-17T05:22:55.691841] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-17T05:22:55.692415] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-17T05:22:55.692469] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-17T05:22:55.693132] [DEBUG] [LOCAL ] NMCO: Trimmed 24497 records to 16350 (keeping 200 days of data) [2025-09-17T05:22:55.758721] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T05:22:55.812763] [DEBUG] [LOCAL ] NMCO: Primary data saved (16350 records). [2025-09-17T05:22:55.812984] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-17T05:22:55.813099] [INFO ] [MAIN ] Update Progress: 1497/2369 symbols completed. NMCO took 43.6s. Estimated remaining: 2h 7m 28s. Rate: 6.8 symbols/min [2025-09-17T05:22:55.895373] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-11. [2025-09-17T05:22:55.993788] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:22:56.021449] [DEBUG] [LOCAL ] NMR: Loaded 25500 existing records from primary storage. [2025-09-17T05:22:56.021670] [INFO ] [MAIN ] NMR: Loaded 25500 existing records. [2025-09-17T05:22:56.201287] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:22:56.201615] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-17T05:22:56.201697] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-17T05:22:56.202325] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-17T05:22:56.202385] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-17T05:22:56.554411] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:22:56.690105] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-11. [2025-09-17T05:22:57.078618] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T05:22:57.490153] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-09-17T05:22:58.043571] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T05:22:58.290138] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-17T05:22:58.519158] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T05:22:58.635168] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T05:22:59.090151] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-09-17T05:22:59.890150] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-17T05:23:00.392761] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T05:23:00.690185] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-17T05:23:00.884501] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T05:23:01.488511] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T05:23:01.490617] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-09-17T05:23:02.290170] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-17T05:23:03.090143] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-17T05:23:03.890159] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-17T05:23:04.750166] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T05:23:04.751726] [INFO ] [REMOTE ] NMG: Full fetch complete (12796 records). [2025-09-17T05:23:04.751832] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-17T05:23:05.113741] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-17T05:23:05.113952] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-17T05:23:05.123320] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-17T05:23:05.123985] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-17T05:23:05.124324] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (2.83 seconds). [2025-09-17T05:23:05.128845] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-17T05:23:05.129064] [DEBUG] [LOCAL ] NMG: Trimmed 12796 records to 7359 (keeping 200 days of data) [2025-09-17T05:23:05.169904] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T05:23:05.182465] [DEBUG] [LOCAL ] NMG: Primary data saved (7359 records). [2025-09-17T05:23:05.182601] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-17T05:23:05.182757] [INFO ] [MAIN ] Update Progress: 1498/2369 symbols completed. NMG took 32.5s. Estimated remaining: 2h 7m 19s. Rate: 6.8 symbols/min [2025-09-17T05:23:05.355161] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:23:05.360486] [DEBUG] [LOCAL ] NMS: Loaded 2310 existing records from primary storage. [2025-09-17T05:23:05.360599] [INFO ] [MAIN ] NMS: Loaded 2310 existing records. [2025-09-17T05:23:05.499820] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-17T05:23:05.539932] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:23:05.540325] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-17T05:23:05.540388] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-17T05:23:05.540768] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-17T05:23:05.540831] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-17T05:23:05.921954] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (4.43 seconds). [2025-09-17T05:23:05.945515] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:23:06.194266] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T05:23:06.290118] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-17T05:23:06.313279] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T05:23:07.090144] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-17T05:23:07.624848] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T05:23:07.764707] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T05:23:07.766182] [INFO ] [REMOTE ] NMI: Full fetch complete (6357 records). [2025-09-17T05:23:07.766278] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-17T05:23:07.895281] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-17T05:23:08.136222] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-17T05:23:08.136336] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-17T05:23:08.136533] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-17T05:23:08.136583] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-17T05:23:08.137005] [DEBUG] [LOCAL ] NMI: Trimmed 6357 records to 4088 (keeping 200 days of data) [2025-09-17T05:23:08.161663] [DEBUG] [LOCAL ] NMI: Primary data saved (4088 records). [2025-09-17T05:23:08.161756] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-17T05:23:08.161898] [INFO ] [MAIN ] Update Progress: 1499/2369 symbols completed. NMI took 23.3s. Estimated remaining: 2h 7m 7s. Rate: 6.8 symbols/min [2025-09-17T05:23:08.331308] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:23:08.335280] [DEBUG] [LOCAL ] NMT: Loaded 2165 existing records from primary storage. [2025-09-17T05:23:08.335394] [INFO ] [MAIN ] NMT: Loaded 2165 existing records. [2025-09-17T05:23:08.518572] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:23:08.518923] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-17T05:23:08.518989] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-17T05:23:08.519318] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-17T05:23:08.519385] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-17T05:23:08.691437] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-11. [2025-09-17T05:23:08.901409] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:23:09.242956] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T05:23:09.374699] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T05:23:09.490135] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-17T05:23:10.290191] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-09-17T05:23:10.731320] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-17T05:23:11.090233] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-17T05:23:11.278584] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T05:23:11.890170] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-09-17T05:23:12.176783] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T05:23:12.228097] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T05:23:12.690175] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-17T05:23:13.337932] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T05:23:13.490209] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-11. [2025-09-17T05:23:14.025126] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T05:23:14.290180] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-17T05:23:15.090187] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-09-17T05:23:15.727671] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T05:23:15.803295] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T05:23:15.890094] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-17T05:23:16.690139] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-09-17T05:23:17.149568] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T05:23:17.237311] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T05:23:17.490148] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-17T05:23:17.931323] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T05:23:18.290154] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-17T05:23:19.090208] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-17T05:23:19.531088] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T05:23:19.723817] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T05:23:19.890082] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-17T05:23:20.690236] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-17T05:23:21.196225] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T05:23:21.490228] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-17T05:23:21.533366] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T05:23:22.290173] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-17T05:23:22.721166] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-17T05:23:22.768836] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T05:23:22.773321] [INFO ] [REMOTE ] NMR: Full fetch complete (50083 records). [2025-09-17T05:23:22.773450] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-17T05:23:23.103448] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-17T05:23:23.159198] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-17T05:23:23.159329] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-17T05:23:23.160558] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-17T05:23:23.160621] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-17T05:23:23.162168] [DEBUG] [LOCAL ] NMR: Trimmed 50083 records to 35260 (keeping 200 days of data) [2025-09-17T05:23:23.379175] [DEBUG] [LOCAL ] NMR: Primary data saved (35260 records). [2025-09-17T05:23:23.379382] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-17T05:23:23.379488] [INFO ] [MAIN ] Update Progress: 1500/2369 symbols completed. NMR took 27.6s. Estimated remaining: 2h 7m 2s. Rate: 6.8 symbols/min [2025-09-17T05:23:23.550573] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:23:23.568549] [DEBUG] [LOCAL ] NMZ: Loaded 15515 existing records from primary storage. [2025-09-17T05:23:23.568767] [INFO ] [MAIN ] NMZ: Loaded 15515 existing records. [2025-09-17T05:23:23.769738] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:23:23.770066] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-17T05:23:23.770131] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-17T05:23:23.770704] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-17T05:23:23.770767] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-17T05:23:23.891067] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-17T05:23:24.158098] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:23:24.168534] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T05:23:24.505222] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T05:23:24.690161] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-11. [2025-09-17T05:23:25.490157] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-17T05:23:25.674438] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T05:23:26.290206] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-17T05:23:26.314520] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T05:23:26.836905] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T05:23:27.090152] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-17T05:23:27.565893] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T05:23:27.890160] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-17T05:23:28.426449] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-17T05:23:28.690200] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-09-17T05:23:29.490179] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-17T05:23:29.775633] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T05:23:29.949951] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T05:23:30.290147] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-17T05:23:31.090200] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-17T05:23:31.333709] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T05:23:31.564472] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T05:23:31.890204] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-17T05:23:32.690201] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-17T05:23:32.854316] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T05:23:32.857154] [INFO ] [REMOTE ] NMM: Full fetch complete (22667 records). [2025-09-17T05:23:32.857249] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-17T05:23:33.261552] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-17T05:23:33.261948] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-17T05:23:33.262614] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-17T05:23:33.266613] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T05:23:33.266751] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-17T05:23:33.268288] [INFO ] [REMOTE ] NMT: Full fetch complete (4338 records). [2025-09-17T05:23:33.268983] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-17T05:23:33.301743] [DEBUG] [LOCAL ] NMM: Trimmed 22667 records to 14418 (keeping 200 days of data) [2025-09-17T05:23:33.492996] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-17T05:23:33.742319] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-17T05:23:33.743429] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-17T05:23:33.744030] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-17T05:23:33.750379] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-17T05:23:33.752027] [DEBUG] [LOCAL ] NMT: Trimmed 4338 records to 2822 (keeping 200 days of data) [2025-09-17T05:23:33.773311] [DEBUG] [LOCAL ] NMT: Primary data saved (2822 records). [2025-09-17T05:23:33.777015] [DEBUG] [LOCAL ] NMM: Primary data saved (14418 records). [2025-09-17T05:23:33.777243] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-17T05:23:33.777633] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-17T05:23:33.777538] [INFO ] [MAIN ] Update Progress: 1501/2369 symbols completed. NMT took 25.6s. Estimated remaining: 2h 6m 54s. Rate: 6.8 symbols/min [2025-09-17T05:23:33.810362] [INFO ] [MAIN ] Update Progress: 1502/2369 symbols completed. NMM took 39.2s. Estimated remaining: 2h 6m 40s. Rate: 6.8 symbols/min [2025-09-17T05:23:34.085524] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:23:34.146709] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:23:34.156453] [DEBUG] [LOCAL ] NNI: Loaded 8009 existing records from primary storage. [2025-09-17T05:23:34.156726] [INFO ] [MAIN ] NNI: Loaded 8009 existing records. [2025-09-17T05:23:34.248317] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T05:23:34.295242] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-17T05:23:34.383982] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:23:34.386626] [DEBUG] [LOCAL ] NNN: Loaded 35852 existing records from primary storage. [2025-09-17T05:23:34.387005] [INFO ] [MAIN ] NNN: Loaded 35852 existing records. [2025-09-17T05:23:34.386852] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-17T05:23:34.387139] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-17T05:23:34.406747] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-17T05:23:34.429370] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-17T05:23:34.739283] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:23:34.777129] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-17T05:23:34.842773] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-17T05:23:34.869853] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-17T05:23:34.884224] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T05:23:34.884472] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-17T05:23:35.096017] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-17T05:23:35.095881] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:23:35.339841] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:23:35.680325] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T05:23:35.890185] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-11. [2025-09-17T05:23:36.690209] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-09-17T05:23:37.497930] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-17T05:23:37.503344] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T05:23:37.758940] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T05:23:37.996008] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T05:23:38.290150] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-11. [2025-09-17T05:23:39.039073] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T05:23:39.090082] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-17T05:23:39.647230] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T05:23:39.648337] [INFO ] [REMOTE ] NMS: Full fetch complete (4023 records). [2025-09-17T05:23:39.648421] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-17T05:23:39.895296] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-17T05:23:40.008245] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-17T05:23:40.008352] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-17T05:23:40.008574] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-17T05:23:40.008661] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-17T05:23:40.009053] [DEBUG] [LOCAL ] NMS: Trimmed 4023 records to 2903 (keeping 200 days of data) [2025-09-17T05:23:40.028800] [DEBUG] [LOCAL ] NMS: Primary data saved (2903 records). [2025-09-17T05:23:40.028885] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-17T05:23:40.028987] [INFO ] [MAIN ] Update Progress: 1503/2369 symbols completed. NMS took 34.8s. Estimated remaining: 2h 6m 30s. Rate: 6.8 symbols/min [2025-09-17T05:23:40.197376] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:23:40.207847] [DEBUG] [LOCAL ] NNY: Loaded 4241 existing records from primary storage. [2025-09-17T05:23:40.207997] [INFO ] [MAIN ] NNY: Loaded 4241 existing records. [2025-09-17T05:23:40.391342] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:23:40.391656] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-17T05:23:40.391727] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-17T05:23:40.392049] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-17T05:23:40.392121] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-17T05:23:40.695228] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-09-17T05:23:40.756534] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:23:40.980422] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T05:23:41.490143] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-17T05:23:42.290098] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-09-17T05:23:42.401585] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T05:23:42.465075] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T05:23:43.093754] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-11. [2025-09-17T05:23:43.094808] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T05:23:43.704085] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T05:23:43.890127] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-09-17T05:23:44.647695] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T05:23:44.690105] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-09-17T05:23:45.490143] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-09-17T05:23:46.290103] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-17T05:23:46.322826] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T05:23:46.330147] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T05:23:47.090128] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-09-17T05:23:47.548530] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T05:23:47.687939] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T05:23:47.890161] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-17T05:23:48.489384] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T05:23:48.690209] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-17T05:23:49.490213] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-17T05:23:50.290100] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-17T05:23:50.324452] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T05:23:50.374453] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T05:23:50.979200] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T05:23:51.090134] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-17T05:23:51.890197] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-17T05:23:52.590027] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T05:23:52.662152] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T05:23:52.690084] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-17T05:23:53.490158] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-17T05:23:54.290113] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-17T05:23:54.367611] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T05:23:54.542518] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T05:23:54.985233] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T05:23:55.090205] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-17T05:23:55.730141] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T05:23:55.890163] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-17T05:23:56.690160] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-17T05:23:57.478861] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T05:23:57.490080] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-17T05:23:57.534033] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T05:23:58.290206] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-17T05:23:58.922292] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T05:23:59.037151] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T05:23:59.090141] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-17T05:23:59.890140] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-17T05:24:00.690141] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-17T05:24:00.699865] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T05:24:01.014556] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T05:24:01.490139] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-17T05:24:02.290142] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-17T05:24:02.326410] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T05:24:03.090209] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-17T05:24:03.335268] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T05:24:03.403690] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T05:24:03.890168] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-17T05:24:04.690122] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-17T05:24:04.840011] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T05:24:05.490145] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-17T05:24:05.629479] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-17T05:24:05.634748] [INFO ] [REMOTE ] NMZ: Full fetch complete (31961 records). [2025-09-17T05:24:05.635092] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-17T05:24:05.710911] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T05:24:05.974855] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T05:24:06.100264] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-17T05:24:06.100388] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-17T05:24:06.101277] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-17T05:24:06.101336] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-17T05:24:06.102212] [DEBUG] [LOCAL ] NMZ: Trimmed 31961 records to 21401 (keeping 200 days of data) [2025-09-17T05:24:06.233787] [DEBUG] [LOCAL ] NMZ: Primary data saved (21401 records). [2025-09-17T05:24:06.233966] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-17T05:24:06.234083] [INFO ] [MAIN ] Update Progress: 1504/2369 symbols completed. NMZ took 42.9s. Estimated remaining: 2h 6m 31s. Rate: 6.8 symbols/min [2025-09-17T05:24:06.295238] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-17T05:24:06.409186] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:24:06.423172] [DEBUG] [LOCAL ] NOA: Loaded 11427 existing records from primary storage. [2025-09-17T05:24:06.423391] [INFO ] [MAIN ] NOA: Loaded 11427 existing records. [2025-09-17T05:24:06.600635] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:24:06.600981] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-17T05:24:06.601057] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-17T05:24:06.601576] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-17T05:24:06.601708] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-17T05:24:06.948717] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:24:07.090111] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-17T05:24:07.715917] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T05:24:07.890055] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-17T05:24:07.996680] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T05:24:08.603315] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T05:24:08.605475] [INFO ] [REMOTE ] NNY: Full fetch complete (8985 records). [2025-09-17T05:24:08.605607] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-17T05:24:08.695282] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-17T05:24:08.986469] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-17T05:24:08.986633] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-17T05:24:08.986976] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-17T05:24:08.987050] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-17T05:24:08.987637] [DEBUG] [LOCAL ] NNY: Trimmed 8985 records to 5701 (keeping 200 days of data) [2025-09-17T05:24:09.026820] [DEBUG] [LOCAL ] NNY: Primary data saved (5701 records). [2025-09-17T05:24:09.027023] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-17T05:24:09.027173] [INFO ] [MAIN ] Update Progress: 1505/2369 symbols completed. NNY took 29.0s. Estimated remaining: 2h 6m 19s. Rate: 6.8 symbols/min [2025-09-17T05:24:09.203352] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:24:09.221452] [DEBUG] [LOCAL ] NOAH: Loaded 14444 existing records from primary storage. [2025-09-17T05:24:09.221683] [INFO ] [MAIN ] NOAH: Loaded 14444 existing records. [2025-09-17T05:24:09.409388] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:24:09.409786] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-17T05:24:09.409854] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-17T05:24:09.410317] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-17T05:24:09.410377] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-17T05:24:09.499627] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-11. [2025-09-17T05:24:09.769253] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:24:10.290162] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-17T05:24:10.426666] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T05:24:10.433157] [INFO ] [REMOTE ] NNN: Full fetch complete (70030 records). [2025-09-17T05:24:10.433418] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-17T05:24:10.606285] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T05:24:10.853632] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-17T05:24:10.853773] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-17T05:24:10.854893] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-17T05:24:10.854958] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-17T05:24:10.856476] [DEBUG] [LOCAL ] NNN: Trimmed 70030 records to 48494 (keeping 200 days of data) [2025-09-17T05:24:11.092111] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-09-17T05:24:11.109104] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T05:24:11.195418] [DEBUG] [LOCAL ] NNN: Primary data saved (48494 records). [2025-09-17T05:24:11.195633] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-17T05:24:11.195776] [INFO ] [MAIN ] Update Progress: 1506/2369 symbols completed. NNN took 37.3s. Estimated remaining: 2h 6m 7s. Rate: 6.8 symbols/min [2025-09-17T05:24:11.365938] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:24:11.400232] [DEBUG] [LOCAL ] NOC: Loaded 31318 existing records from primary storage. [2025-09-17T05:24:11.400419] [INFO ] [MAIN ] NOC: Loaded 31318 existing records. [2025-09-17T05:24:11.587476] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:24:11.587855] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-17T05:24:11.587920] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-17T05:24:11.588987] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-17T05:24:11.589054] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-17T05:24:11.895273] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-11. [2025-09-17T05:24:11.963678] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:24:11.970844] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T05:24:12.690191] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-11. [2025-09-17T05:24:12.836854] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T05:24:13.490235] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-17T05:24:14.290175] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-09-17T05:24:15.076445] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T05:24:15.079363] [INFO ] [REMOTE ] NNI: Full fetch complete (12324 records). [2025-09-17T05:24:15.079730] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-17T05:24:15.113301] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-09-17T05:24:15.461481] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-17T05:24:15.461621] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-17T05:24:15.462008] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-17T05:24:15.462063] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-17T05:24:15.462706] [DEBUG] [LOCAL ] NNI: Trimmed 12324 records to 9793 (keeping 200 days of data) [2025-09-17T05:24:15.525945] [DEBUG] [LOCAL ] NNI: Primary data saved (9793 records). [2025-09-17T05:24:15.526125] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-17T05:24:15.526224] [INFO ] [MAIN ] Update Progress: 1507/2369 symbols completed. NNI took 41.7s. Estimated remaining: 2h 5m 55s. Rate: 6.8 symbols/min [2025-09-17T05:24:15.733835] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:24:15.744154] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T05:24:15.790058] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-11 (3.10 seconds). [2025-09-17T05:24:15.817730] [DEBUG] [LOCAL ] NOG: Loaded 37995 existing records from primary storage. [2025-09-17T05:24:15.817941] [INFO ] [MAIN ] NOG: Loaded 37995 existing records. [2025-09-17T05:24:15.895297] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-09-17T05:24:16.001205] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:24:16.001484] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-17T05:24:16.001548] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-17T05:24:16.002973] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-17T05:24:16.003272] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-17T05:24:16.387132] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:24:16.445335] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T05:24:16.690160] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-17T05:24:17.490145] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-11. [2025-09-17T05:24:17.561677] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T05:24:17.584198] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T05:24:18.290194] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-17T05:24:18.860326] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T05:24:19.079745] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T05:24:19.090071] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-17T05:24:19.890104] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-09-17T05:24:20.199611] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T05:24:20.690151] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-09-17T05:24:21.490142] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-17T05:24:21.576597] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T05:24:22.296512] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-17T05:24:22.312990] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T05:24:22.592009] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T05:24:23.090190] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-09-17T05:24:23.222592] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T05:24:23.890148] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-17T05:24:24.690180] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-17T05:24:24.745516] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T05:24:25.490131] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-17T05:24:25.575330] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T05:24:25.611520] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T05:24:26.290155] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-17T05:24:26.530761] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T05:24:27.090145] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-17T05:24:27.890138] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-17T05:24:28.088035] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T05:24:28.127752] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T05:24:28.690189] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-17T05:24:29.498168] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-17T05:24:29.504313] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T05:24:29.549184] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T05:24:30.290170] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-17T05:24:30.368472] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T05:24:31.090150] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-17T05:24:31.890147] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-17T05:24:31.948199] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T05:24:32.690214] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-17T05:24:32.879419] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T05:24:32.940476] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T05:24:33.490199] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-17T05:24:34.290135] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-17T05:24:34.397209] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T05:24:35.090155] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-17T05:24:35.233835] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T05:24:35.387628] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T05:24:35.890153] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-17T05:24:36.595501] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T05:24:36.690165] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-17T05:24:37.490142] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-17T05:24:37.708245] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T05:24:37.768781] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T05:24:38.290130] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-17T05:24:38.507936] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T05:24:39.090174] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-17T05:24:39.292610] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T05:24:39.295867] [INFO ] [REMOTE ] NOA: Full fetch complete (21610 records). [2025-09-17T05:24:39.295972] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-17T05:24:39.668258] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-17T05:24:39.668394] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-17T05:24:39.669024] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-17T05:24:39.669098] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-17T05:24:39.670892] [DEBUG] [LOCAL ] NOA: Trimmed 21610 records to 16566 (keeping 200 days of data) [2025-09-17T05:24:39.781553] [DEBUG] [LOCAL ] NOA: Primary data saved (16566 records). [2025-09-17T05:24:39.781777] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-17T05:24:39.781896] [INFO ] [MAIN ] Update Progress: 1508/2369 symbols completed. NOA took 33.5s. Estimated remaining: 2h 5m 55s. Rate: 6.8 symbols/min [2025-09-17T05:24:39.895295] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-17T05:24:39.956758] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:24:39.998697] [DEBUG] [LOCAL ] NOK: Loaded 39972 existing records from primary storage. [2025-09-17T05:24:39.998917] [INFO ] [MAIN ] NOK: Loaded 39972 existing records. [2025-09-17T05:24:40.195626] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:24:40.196808] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T05:24:40.197032] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-17T05:24:40.200857] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-17T05:24:40.201913] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-17T05:24:40.201988] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-17T05:24:40.562087] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:24:40.690141] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-11. [2025-09-17T05:24:41.490197] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-17T05:24:41.607811] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T05:24:42.290159] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-17T05:24:42.692389] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T05:24:43.090196] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-09-17T05:24:43.159560] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T05:24:43.864924] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T05:24:43.890132] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-17T05:24:44.690240] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-17T05:24:45.055429] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T05:24:45.294038] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T05:24:45.298631] [INFO ] [REMOTE ] NOC: Full fetch complete (62157 records). [2025-09-17T05:24:45.298794] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-17T05:24:45.500763] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-17T05:24:45.689689] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T05:24:45.710338] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-17T05:24:45.710539] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-17T05:24:45.712052] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-17T05:24:45.712169] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-17T05:24:45.713958] [INFO ] [REMOTE ] NOAH: Full fetch complete (28809 records). [2025-09-17T05:24:45.714184] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-17T05:24:45.714102] [DEBUG] [LOCAL ] NOC: Trimmed 62157 records to 42980 (keeping 200 days of data) [2025-09-17T05:24:46.206121] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-17T05:24:46.208696] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-17T05:24:46.210137] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-17T05:24:46.212463] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-17T05:24:46.221693] [DEBUG] [LOCAL ] NOAH: Trimmed 28809 records to 20019 (keeping 200 days of data) [2025-09-17T05:24:46.339512] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-09-17T05:24:46.471348] [DEBUG] [LOCAL ] NOAH: Primary data saved (20019 records). [2025-09-17T05:24:46.473392] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-17T05:24:46.473827] [INFO ] [MAIN ] Update Progress: 1509/2369 symbols completed. NOAH took 37.4s. Estimated remaining: 2h 5m 45s. Rate: 6.8 symbols/min [2025-09-17T05:24:46.670812] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:24:46.675859] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-17T05:24:46.676156] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-17T05:24:46.677774] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-17T05:24:46.677850] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-17T05:24:46.678134] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-17T05:24:46.678976] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-17T05:24:46.754623] [DEBUG] [LOCAL ] NOC: Primary data saved (42980 records). [2025-09-17T05:24:46.778108] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-17T05:24:46.780332] [INFO ] [MAIN ] Update Progress: 1510/2369 symbols completed. NOC took 35.6s. Estimated remaining: 2h 5m 32s. Rate: 6.8 symbols/min [2025-09-17T05:24:47.136060] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:24:47.219899] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:24:47.220436] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-11. [2025-09-17T05:24:47.250379] [DEBUG] [LOCAL ] NOMD: Loaded 31155 existing records from primary storage. [2025-09-17T05:24:47.250556] [INFO ] [MAIN ] NOMD: Loaded 31155 existing records. [2025-09-17T05:24:47.436419] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:24:47.437368] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-17T05:24:47.437446] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-17T05:24:47.449582] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-17T05:24:47.463985] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-17T05:24:47.541497] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T05:24:47.541635] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-17T05:24:47.841846] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:24:47.890078] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-11. [2025-09-17T05:24:48.368576] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T05:24:48.690131] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-17T05:24:49.205331] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T05:24:49.284617] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T05:24:49.490173] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-17T05:24:50.290150] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-09-17T05:24:51.090176] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-17T05:24:51.151372] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T05:24:51.411681] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-17T05:24:51.742321] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T05:24:51.890183] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-17T05:24:52.690215] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-17T05:24:53.038427] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T05:24:53.490165] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-09-17T05:24:53.565007] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T05:24:53.571632] [INFO ] [REMOTE ] NOG: Full fetch complete (73298 records). [2025-09-17T05:24:53.571924] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-17T05:24:53.981222] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-17T05:24:53.981358] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-17T05:24:53.982715] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-17T05:24:53.982796] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-17T05:24:53.984529] [DEBUG] [LOCAL ] NOG: Trimmed 73298 records to 51174 (keeping 200 days of data) [2025-09-17T05:24:54.295443] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-17T05:24:54.317165] [DEBUG] [LOCAL ] NOG: Primary data saved (51174 records). [2025-09-17T05:24:54.317362] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-17T05:24:54.317486] [INFO ] [MAIN ] Update Progress: 1511/2369 symbols completed. NOG took 38.8s. Estimated remaining: 2h 5m 22s. Rate: 6.8 symbols/min [2025-09-17T05:24:54.485679] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:24:54.516682] [DEBUG] [LOCAL ] NOTE: Loaded 32557 existing records from primary storage. [2025-09-17T05:24:54.516880] [INFO ] [MAIN ] NOTE: Loaded 32557 existing records. [2025-09-17T05:24:54.712167] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:24:54.712549] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-17T05:24:54.712624] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-17T05:24:54.713369] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-17T05:24:54.713432] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-17T05:24:54.806843] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T05:24:55.091985] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-17T05:24:55.152451] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:24:55.181517] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T05:24:55.890187] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-11. [2025-09-17T05:24:56.690155] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-17T05:24:57.033511] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T05:24:57.160246] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T05:24:57.277409] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T05:24:57.490164] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-17T05:24:57.755138] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-17T05:24:58.290179] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-17T05:24:59.090168] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-17T05:24:59.589399] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-17T05:24:59.676894] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T05:24:59.890162] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-17T05:25:00.348065] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T05:25:00.690152] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-17T05:25:01.184790] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T05:25:01.490158] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-17T05:25:02.290149] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-09-17T05:25:03.090144] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-17T05:25:03.597037] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T05:25:03.598030] [INFO ] [REMOTE ] NOM: Full fetch complete (1726 records). [2025-09-17T05:25:03.598135] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-17T05:25:03.788792] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-17T05:25:03.789189] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:25:03.789796] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:25:03.789929] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-17T05:25:03.790190] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-17T05:25:03.790494] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-17T05:25:03.790582] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-17T05:25:03.790828] [INFO ] [MAIN ] Update Progress: 1512/2369 symbols completed. NOM took 17.3s. Estimated remaining: 2h 5m 14s. Rate: 6.8 symbols/min [2025-09-17T05:25:03.904355] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-17T05:25:03.956733] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-17T05:25:04.041290] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:25:04.046863] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T05:25:04.101828] [DEBUG] [LOCAL ] NOV: Loaded 39589 existing records from primary storage. [2025-09-17T05:25:04.102099] [INFO ] [MAIN ] NOV: Loaded 39589 existing records. [2025-09-17T05:25:04.321416] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:25:04.321802] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-17T05:25:04.321891] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-17T05:25:04.322932] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-17T05:25:04.323002] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-17T05:25:04.695923] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-09-17T05:25:04.709603] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:25:05.193059] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T05:25:05.490157] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-17T05:25:06.290176] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-17T05:25:06.595277] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T05:25:07.090132] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-11. [2025-09-17T05:25:07.648081] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-17T05:25:07.721837] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T05:25:07.890197] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-17T05:25:08.672537] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T05:25:08.690082] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-09-17T05:25:09.490105] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-17T05:25:09.837796] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T05:25:10.290172] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-17T05:25:10.408948] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T05:25:10.889669] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T05:25:11.090144] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-09-17T05:25:11.732495] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T05:25:11.890163] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-17T05:25:12.551086] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T05:25:12.690086] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-17T05:25:13.327922] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T05:25:13.490145] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-17T05:25:14.290139] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-17T05:25:14.408054] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T05:25:15.090117] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-17T05:25:15.197901] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T05:25:15.276082] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T05:25:15.890185] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-17T05:25:16.690150] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-17T05:25:16.886726] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T05:25:17.490215] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-17T05:25:17.778861] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T05:25:18.290161] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-17T05:25:18.351356] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T05:25:19.090133] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-17T05:25:19.237849] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T05:25:19.890139] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-17T05:25:20.506513] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-17T05:25:20.690173] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-17T05:25:20.782488] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T05:25:21.311796] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T05:25:21.490164] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-17T05:25:22.168242] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T05:25:22.290113] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-17T05:25:23.090149] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-17T05:25:23.552342] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T05:25:23.626322] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T05:25:23.890121] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-17T05:25:24.690147] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-17T05:25:24.750260] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T05:25:25.360047] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T05:25:25.366256] [INFO ] [REMOTE ] NOMD: Full fetch complete (58585 records). [2025-09-17T05:25:25.366416] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-17T05:25:25.495241] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-17T05:25:25.845829] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-17T05:25:25.846015] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-17T05:25:25.848136] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-17T05:25:25.848251] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-17T05:25:25.850431] [DEBUG] [LOCAL ] NOMD: Trimmed 58585 records to 41377 (keeping 200 days of data) [2025-09-17T05:25:26.239828] [DEBUG] [LOCAL ] NOMD: Primary data saved (41377 records). [2025-09-17T05:25:26.240091] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-17T05:25:26.240245] [INFO ] [MAIN ] Update Progress: 1513/2369 symbols completed. NOMD took 39.5s. Estimated remaining: 2h 5m 13s. Rate: 6.8 symbols/min [2025-09-17T05:25:26.292337] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-17T05:25:26.496143] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:25:26.570727] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T05:25:26.608076] [DEBUG] [LOCAL ] NOW: Loaded 35748 existing records from primary storage. [2025-09-17T05:25:26.608331] [INFO ] [MAIN ] NOW: Loaded 35748 existing records. [2025-09-17T05:25:26.872118] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:25:26.872416] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-17T05:25:26.872486] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-17T05:25:26.873322] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-09-17T05:25:26.873406] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-17T05:25:27.097982] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-17T05:25:27.262402] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:25:27.402635] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T05:25:27.890166] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-17T05:25:27.942843] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T05:25:27.949692] [INFO ] [REMOTE ] NOK: Full fetch complete (77523 records). [2025-09-17T05:25:27.949930] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-17T05:25:28.357449] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-17T05:25:28.357595] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-17T05:25:28.358793] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-17T05:25:28.358875] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-17T05:25:28.360577] [DEBUG] [LOCAL ] NOK: Trimmed 77523 records to 53620 (keeping 200 days of data) [2025-09-17T05:25:28.692478] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-11. [2025-09-17T05:25:28.697373] [DEBUG] [LOCAL ] NOK: Primary data saved (53620 records). [2025-09-17T05:25:28.697487] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-17T05:25:28.697579] [INFO ] [MAIN ] Update Progress: 1514/2369 symbols completed. NOK took 48.9s. Estimated remaining: 2h 5m 1s. Rate: 6.8 symbols/min [2025-09-17T05:25:28.867095] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:25:28.867358] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-17T05:25:28.867533] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-17T05:25:28.867682] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-17T05:25:28.867732] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-17T05:25:28.867782] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-17T05:25:28.867834] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-17T05:25:29.251402] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:25:29.265268] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-17T05:25:29.301946] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T05:25:29.490112] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-17T05:25:30.290160] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-17T05:25:30.693055] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T05:25:31.056881] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T05:25:31.062329] [INFO ] [REMOTE ] NOTE: Full fetch complete (64891 records). [2025-09-17T05:25:31.062518] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-17T05:25:31.101234] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-11. [2025-09-17T05:25:31.464098] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-17T05:25:31.464238] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-17T05:25:31.465419] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-17T05:25:31.465483] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-17T05:25:31.467008] [DEBUG] [LOCAL ] NOTE: Trimmed 64891 records to 43642 (keeping 200 days of data) [2025-09-17T05:25:31.731911] [DEBUG] [LOCAL ] NOTE: Primary data saved (43642 records). [2025-09-17T05:25:31.732100] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-17T05:25:31.732208] [INFO ] [MAIN ] Update Progress: 1515/2369 symbols completed. NOTE took 37.4s. Estimated remaining: 2h 4m 49s. Rate: 6.8 symbols/min [2025-09-17T05:25:31.898269] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-17T05:25:31.923008] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:25:31.939697] [DEBUG] [LOCAL ] NPCT: Loaded 12794 existing records from primary storage. [2025-09-17T05:25:31.939911] [INFO ] [MAIN ] NPCT: Loaded 12794 existing records. [2025-09-17T05:25:32.123229] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:25:32.123743] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-17T05:25:32.123944] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-17T05:25:32.131602] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-17T05:25:32.142398] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-17T05:25:32.149512] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T05:25:32.254781] [INFO ] [REMOTE ] NOV: Full fetch complete (76782 records). [2025-09-17T05:25:32.255387] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-17T05:25:32.831041] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:25:32.852280] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-11. [2025-09-17T05:25:32.930169] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-17T05:25:32.930298] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-17T05:25:32.931458] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-17T05:25:32.931519] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-17T05:25:32.933896] [DEBUG] [LOCAL ] NOV: Trimmed 76782 records to 53201 (keeping 200 days of data) [2025-09-17T05:25:33.294020] [DEBUG] [LOCAL ] NOV: Primary data saved (53201 records). [2025-09-17T05:25:33.294233] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-17T05:25:33.294345] [INFO ] [MAIN ] Update Progress: 1516/2369 symbols completed. NOV took 29.5s. Estimated remaining: 2h 4m 36s. Rate: 6.8 symbols/min [2025-09-17T05:25:33.491399] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:25:33.500678] [DEBUG] [LOCAL ] NPFD: Loaded 6777 existing records from primary storage. [2025-09-17T05:25:33.500843] [INFO ] [MAIN ] NPFD: Loaded 6777 existing records. [2025-09-17T05:25:33.687222] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:25:33.687545] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-17T05:25:33.687605] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-17T05:25:33.688055] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-17T05:25:33.688119] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-17T05:25:34.001328] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T05:25:34.040719] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-09-17T05:25:34.069462] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:25:34.290222] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-11. [2025-09-17T05:25:34.858716] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:25:34.859087] [WARN ] [REMOTE ] NPB: No data returned for month 2024-11 [2025-09-17T05:25:35.044883] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T05:25:35.090097] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-09-17T05:25:35.116919] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T05:25:35.890167] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-09-17T05:25:36.138636] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T05:25:36.543387] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T05:25:36.690136] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-09-17T05:25:37.028601] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (5.13 seconds). [2025-09-17T05:25:37.300294] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T05:25:37.490161] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-17T05:25:38.212555] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T05:25:38.290154] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-17T05:25:38.476978] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:25:38.478118] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-17T05:25:39.090186] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-17T05:25:39.890146] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-17T05:25:40.633093] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T05:25:40.690157] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-09-17T05:25:40.883857] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T05:25:40.893994] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:25:40.895466] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-09-17T05:25:41.490206] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-17T05:25:42.290177] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-17T05:25:43.090205] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-17T05:25:43.201135] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T05:25:43.470337] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T05:25:43.890133] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-17T05:25:43.932007] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T05:25:44.690153] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-17T05:25:45.490139] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-17T05:25:45.720166] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T05:25:45.918736] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T05:25:45.978342] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T05:25:46.290150] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-17T05:25:47.012675] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T05:25:47.090136] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-17T05:25:47.890148] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-17T05:25:48.058109] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T05:25:48.690153] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-17T05:25:48.896299] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T05:25:49.490235] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-17T05:25:50.290185] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-17T05:25:50.433260] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T05:25:50.978412] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-17T05:25:51.028915] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T05:25:51.090148] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-17T05:25:51.890181] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-17T05:25:52.690098] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-17T05:25:52.916232] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T05:25:53.188347] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T05:25:53.472799] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T05:25:53.490080] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-17T05:25:54.127601] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T05:25:54.290153] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-17T05:25:55.090192] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-17T05:25:55.835082] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T05:25:55.836965] [INFO ] [REMOTE ] NPFD: Full fetch complete (14757 records). [2025-09-17T05:25:55.837068] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-17T05:25:55.902773] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-17T05:25:56.225723] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-17T05:25:56.225966] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-17T05:25:56.226543] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-17T05:25:56.226613] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-17T05:25:56.227859] [DEBUG] [LOCAL ] NPFD: Trimmed 14757 records to 9755 (keeping 200 days of data) [2025-09-17T05:25:56.306165] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T05:25:56.332420] [DEBUG] [LOCAL ] NPFD: Primary data saved (9755 records). [2025-09-17T05:25:56.332600] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-17T05:25:56.332726] [INFO ] [MAIN ] Update Progress: 1517/2369 symbols completed. NPFD took 23.0s. Estimated remaining: 2h 4m 35s. Rate: 6.8 symbols/min [2025-09-17T05:25:56.467332] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T05:25:56.690143] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-17T05:25:57.490173] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-17T05:25:58.290129] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-17T05:25:58.491183] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T05:25:58.803265] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T05:25:59.093791] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-17T05:25:59.095073] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T05:25:59.890178] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-17T05:26:00.155927] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T05:26:00.574249] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T05:26:00.690174] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-17T05:26:01.490131] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-17T05:26:01.745158] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T05:26:02.290137] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-17T05:26:03.090144] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-17T05:26:03.294067] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T05:26:03.296665] [INFO ] [REMOTE ] NPB: Full fetch complete (15434 records). [2025-09-17T05:26:03.296777] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-17T05:26:03.481194] [WARN ] [VALIDATOR ] NPB: Validation failed - insufficient historical data. Have 147 unique days, need 200 days [2025-09-17T05:26:03.481636] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:26:03.481759] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:26:03.481880] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-17T05:26:03.482093] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-17T05:26:03.482515] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-17T05:26:03.482707] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-17T05:26:03.482840] [INFO ] [MAIN ] Update Progress: 1518/2369 symbols completed. NPB took 34.8s. Estimated remaining: 2h 4m 25s. Rate: 6.8 symbols/min [2025-09-17T05:26:03.601032] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-17T05:26:03.663273] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T05:26:03.890199] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-17T05:26:04.690148] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-17T05:26:04.829562] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T05:26:04.832818] [INFO ] [REMOTE ] NPCT: Full fetch complete (25345 records). [2025-09-17T05:26:04.833049] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-17T05:26:05.249724] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-17T05:26:05.250076] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-17T05:26:05.250860] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-17T05:26:05.250921] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-17T05:26:05.251813] [DEBUG] [LOCAL ] NPCT: Trimmed 25345 records to 17213 (keeping 200 days of data) [2025-09-17T05:26:05.363574] [DEBUG] [LOCAL ] NPCT: Primary data saved (17213 records). [2025-09-17T05:26:05.363791] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-17T05:26:05.363899] [INFO ] [MAIN ] Update Progress: 1519/2369 symbols completed. NPCT took 33.6s. Estimated remaining: 2h 4m 13s. Rate: 6.8 symbols/min [2025-09-17T05:26:06.585629] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T05:26:06.591847] [INFO ] [REMOTE ] NOW: Full fetch complete (70670 records). [2025-09-17T05:26:06.592051] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-17T05:26:06.984345] [DEBUG] [VALIDATOR ] NOW: All expected trading days are present. [2025-09-17T05:26:06.984484] [DEBUG] [VALIDATOR ] NOW: Primary data validation passed. [2025-09-17T05:26:06.985735] [INFO ] [MAIN ] NOW: Fetched primary data is valid. [2025-09-17T05:26:06.985807] [DEBUG] [LOCAL ] NOW: Saving primary data. [2025-09-17T05:26:06.987532] [DEBUG] [LOCAL ] NOW: Trimmed 70670 records to 49012 (keeping 200 days of data) [2025-09-17T05:26:07.320812] [DEBUG] [LOCAL ] NOW: Primary data saved (49012 records). [2025-09-17T05:26:07.321017] [INFO ] [MAIN ] NOW: Full history saved. [2025-09-17T05:26:07.321125] [INFO ] [MAIN ] Update Progress: 1520/2369 symbols completed. NOW took 41.1s. Estimated remaining: 2h 4m 0s. Rate: 6.8 symbols/min [2025-09-17T05:26:07.935823] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:26:07.965856] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:26:08.010437] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:26:08.031983] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:26:08.043502] [DEBUG] [LOCAL ] NPO: Loaded 9372 existing records from primary storage. [2025-09-17T05:26:08.045858] [INFO ] [MAIN ] NPO: Loaded 9372 existing records. [2025-09-17T05:26:08.053499] [DEBUG] [LOCAL ] NPV: Loaded 3802 existing records from primary storage. [2025-09-17T05:26:08.053746] [INFO ] [MAIN ] NPV: Loaded 3802 existing records. [2025-09-17T05:26:08.103556] [DEBUG] [LOCAL ] NPK: Loaded 6388 existing records from primary storage. [2025-09-17T05:26:08.192683] [INFO ] [MAIN ] NPK: Loaded 6388 existing records. [2025-09-17T05:26:08.313374] [DEBUG] [LOCAL ] NPKI: Loaded 30489 existing records from primary storage. [2025-09-17T05:26:08.355217] [INFO ] [MAIN ] NPKI: Loaded 30489 existing records. [2025-09-17T05:26:08.579058] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:26:08.674072] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-17T05:26:08.723818] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:26:08.731739] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-17T05:26:08.749231] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-17T05:26:08.749317] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-17T05:26:08.761637] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-17T05:26:08.756443] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:26:08.772177] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-17T05:26:08.803686] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-17T05:26:08.777679] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-17T05:26:08.839592] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-17T05:26:08.839700] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-17T05:26:08.934675] [WARN ] [MAIN ] NPKI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:26:08.979277] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-17T05:26:09.026688] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-17T05:26:08.997219] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-17T05:26:09.118511] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-17T05:26:09.327069] [DEBUG] [LOCAL ] NPKI: Deleted primary data file. [2025-09-17T05:26:09.442798] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-17T05:26:09.887668] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:26:10.013944] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:26:09.986225] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-11. [2025-09-17T05:26:10.085358] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-11. [2025-09-17T05:26:10.278100] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:26:10.278726] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-11. [2025-09-17T05:26:10.368082] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:26:10.368462] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-11. [2025-09-17T05:26:10.567835] [DEBUG] [REMOTE ] NPKI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:26:10.568225] [WARN ] [REMOTE ] NPKI: No data returned for month 2024-11 [2025-09-17T05:26:10.568778] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-17T05:26:10.608360] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T05:26:10.609843] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-09-17T05:26:11.060964] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T05:26:11.064571] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-09-17T05:26:11.070771] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T05:26:11.090074] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-09-17T05:26:11.193061] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T05:26:11.200745] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T05:26:11.860005] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T05:26:11.890165] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-09-17T05:26:11.950969] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T05:26:12.571522] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T05:26:12.690162] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-17T05:26:13.317438] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T05:26:13.490135] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-09-17T05:26:13.895367] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-17T05:26:14.290186] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-17T05:26:14.839134] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T05:26:15.090187] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-17T05:26:15.748909] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T05:26:15.890139] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-17T05:26:16.639350] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T05:26:16.690123] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-09-17T05:26:17.490162] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-17T05:26:17.545622] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T05:26:18.290216] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-17T05:26:18.845392] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T05:26:18.915927] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T05:26:19.090176] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-17T05:26:19.890173] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-17T05:26:19.969960] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T05:26:20.690204] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-17T05:26:20.769951] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T05:26:21.322412] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T05:26:21.490181] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-17T05:26:22.290178] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-17T05:26:22.764630] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T05:26:23.090279] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-17T05:26:23.302063] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T05:26:23.890149] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-17T05:26:24.028483] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T05:26:24.690209] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-17T05:26:24.948856] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T05:26:25.221388] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-17T05:26:25.490184] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-17T05:26:26.069624] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T05:26:26.290162] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-17T05:26:26.920845] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T05:26:27.090160] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-17T05:26:27.890151] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-17T05:26:28.467381] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T05:26:28.492007] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T05:26:28.690162] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-17T05:26:29.490166] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-17T05:26:29.771717] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T05:26:30.290164] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-17T05:26:30.754326] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T05:26:31.016921] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T05:26:31.090114] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-17T05:26:31.786900] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T05:26:31.788850] [INFO ] [REMOTE ] NPV: Full fetch complete (6708 records). [2025-09-17T05:26:31.788963] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-17T05:26:31.890251] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-17T05:26:32.148297] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-17T05:26:32.148411] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-17T05:26:32.148618] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-17T05:26:32.148695] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-17T05:26:32.149132] [DEBUG] [LOCAL ] NPV: Trimmed 6708 records to 4978 (keeping 200 days of data) [2025-09-17T05:26:32.180132] [DEBUG] [LOCAL ] NPV: Primary data saved (4978 records). [2025-09-17T05:26:32.180232] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-17T05:26:32.180328] [INFO ] [MAIN ] Update Progress: 1521/2369 symbols completed. NPV took 24.9s. Estimated remaining: 2h 4m 0s. Rate: 6.8 symbols/min [2025-09-17T05:26:32.347731] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:26:32.378305] [DEBUG] [LOCAL ] NPWR: Loaded 32076 existing records from primary storage. [2025-09-17T05:26:32.378501] [INFO ] [MAIN ] NPWR: Loaded 32076 existing records. [2025-09-17T05:26:32.559479] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:26:32.559856] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-17T05:26:32.559925] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-17T05:26:32.560799] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-17T05:26:32.560871] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-17T05:26:32.698635] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-17T05:26:32.923679] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:26:32.932104] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T05:26:33.490173] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-11. [2025-09-17T05:26:34.290213] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-17T05:26:34.367241] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T05:26:34.493227] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T05:26:35.090212] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-09-17T05:26:35.148330] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T05:26:35.890158] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-17T05:26:36.163390] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T05:26:36.690167] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-17T05:26:36.850115] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T05:26:37.131660] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T05:26:37.490138] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-09-17T05:26:38.290172] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-17T05:26:38.864133] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T05:26:39.008027] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T05:26:39.009512] [INFO ] [REMOTE ] NPK: Full fetch complete (11039 records). [2025-09-17T05:26:39.009602] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-17T05:26:39.095374] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-17T05:26:39.390049] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-17T05:26:39.390178] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-17T05:26:39.390539] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-17T05:26:39.390602] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-17T05:26:39.391191] [DEBUG] [LOCAL ] NPK: Trimmed 11039 records to 8172 (keeping 200 days of data) [2025-09-17T05:26:39.443251] [DEBUG] [LOCAL ] NPK: Primary data saved (8172 records). [2025-09-17T05:26:39.443464] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-17T05:26:39.443620] [INFO ] [MAIN ] Update Progress: 1522/2369 symbols completed. NPK took 32.1s. Estimated remaining: 2h 3m 51s. Rate: 6.8 symbols/min [2025-09-17T05:26:39.617530] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:26:39.627070] [DEBUG] [LOCAL ] NQP: Loaded 6743 existing records from primary storage. [2025-09-17T05:26:39.627247] [INFO ] [MAIN ] NQP: Loaded 6743 existing records. [2025-09-17T05:26:39.813932] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:26:39.814273] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-17T05:26:39.814330] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-17T05:26:39.814720] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-17T05:26:39.814788] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-17T05:26:39.895319] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-17T05:26:40.120154] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T05:26:40.142384] [INFO ] [REMOTE ] NPO: Full fetch complete (18165 records). [2025-09-17T05:26:40.152767] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-17T05:26:40.291548] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:26:40.600310] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-17T05:26:40.600519] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-17T05:26:40.601066] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-17T05:26:40.601131] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-17T05:26:40.601820] [DEBUG] [LOCAL ] NPO: Trimmed 18165 records to 12893 (keeping 200 days of data) [2025-09-17T05:26:40.687897] [DEBUG] [LOCAL ] NPO: Primary data saved (12893 records). [2025-09-17T05:26:40.688109] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-17T05:26:40.688238] [INFO ] [MAIN ] Update Progress: 1523/2369 symbols completed. NPO took 33.4s. Estimated remaining: 2h 3m 38s. Rate: 6.8 symbols/min [2025-09-17T05:26:40.699585] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-17T05:26:40.867627] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:26:40.893234] [DEBUG] [LOCAL ] NRDY: Loaded 24025 existing records from primary storage. [2025-09-17T05:26:40.893445] [INFO ] [MAIN ] NRDY: Loaded 24025 existing records. [2025-09-17T05:26:41.078879] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:26:41.079209] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-17T05:26:41.079274] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-17T05:26:41.080152] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-17T05:26:41.080229] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-17T05:26:41.447849] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:26:41.472204] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T05:26:41.490096] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-17T05:26:42.021395] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T05:26:42.290172] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-17T05:26:42.758614] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T05:26:43.090231] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-17T05:26:43.558553] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T05:26:43.890199] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-11. [2025-09-17T05:26:44.517675] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T05:26:44.690225] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-11. [2025-09-17T05:26:45.164616] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T05:26:45.496400] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-09-17T05:26:45.499050] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T05:26:46.290233] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-09-17T05:26:47.090208] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-17T05:26:47.151364] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T05:26:47.236753] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T05:26:47.890168] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-09-17T05:26:48.539332] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T05:26:48.567170] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T05:26:48.571840] [INFO ] [REMOTE ] NPKI: Full fetch complete (51583 records). [2025-09-17T05:26:48.571976] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-17T05:26:48.695274] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-09-17T05:26:48.764560] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-17T05:26:48.765220] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:26:48.765303] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:26:48.765363] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-17T05:26:48.765453] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-17T05:26:48.765518] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-17T05:26:48.765889] [DEBUG] [LOCAL ] NPKI: Deleted derivative data file. [2025-09-17T05:26:48.766001] [INFO ] [MAIN ] Update Progress: 1524/2369 symbols completed. NPKI took 41.4s. Estimated remaining: 2h 3m 29s. Rate: 6.8 symbols/min [2025-09-17T05:26:48.940455] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:26:48.949270] [DEBUG] [LOCAL ] NREF: Loaded 5655 existing records from primary storage. [2025-09-17T05:26:48.949443] [INFO ] [MAIN ] NREF: Loaded 5655 existing records. [2025-09-17T05:26:49.126926] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:26:49.127222] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-17T05:26:49.127285] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-17T05:26:49.127603] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-17T05:26:49.127694] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-17T05:26:49.486927] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:26:49.490078] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-11. [2025-09-17T05:26:50.207428] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T05:26:50.290206] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-17T05:26:50.322958] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T05:26:51.090142] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-17T05:26:51.776515] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T05:26:51.890182] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-17T05:26:52.489400] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T05:26:52.660308] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T05:26:52.690096] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-17T05:26:53.463436] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T05:26:53.490128] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-17T05:26:54.057019] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T05:26:54.290145] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-09-17T05:26:55.090183] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-17T05:26:55.098261] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T05:26:55.890135] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-17T05:26:56.542336] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T05:26:56.690097] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-17T05:26:57.454710] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T05:26:57.490085] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-17T05:26:57.567617] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T05:26:58.290174] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-09-17T05:26:58.984056] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T05:26:59.090129] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-17T05:26:59.152458] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T05:26:59.890180] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-17T05:27:00.515125] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T05:27:00.535231] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T05:27:00.690134] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-17T05:27:01.490197] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-17T05:27:01.623676] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T05:27:02.290148] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-17T05:27:03.090136] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-17T05:27:03.588528] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-17T05:27:03.890182] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-17T05:27:04.253605] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T05:27:04.690153] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-17T05:27:04.936825] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T05:27:05.293165] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T05:27:05.330043] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-17T05:27:05.490149] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-17T05:27:06.213478] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T05:27:06.290141] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-17T05:27:07.084713] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T05:27:07.090067] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-17T05:27:07.851677] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T05:27:07.890076] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-17T05:27:08.522712] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T05:27:08.525253] [INFO ] [REMOTE ] NQP: Full fetch complete (13518 records). [2025-09-17T05:27:08.525388] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-17T05:27:08.697549] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-17T05:27:08.909451] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-17T05:27:08.909571] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-17T05:27:08.909952] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-17T05:27:08.910014] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-17T05:27:08.910601] [DEBUG] [LOCAL ] NQP: Trimmed 13518 records to 9175 (keeping 200 days of data) [2025-09-17T05:27:08.967670] [DEBUG] [LOCAL ] NQP: Primary data saved (9175 records). [2025-09-17T05:27:08.967831] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-17T05:27:08.967961] [INFO ] [MAIN ] Update Progress: 1525/2369 symbols completed. NQP took 29.5s. Estimated remaining: 2h 3m 26s. Rate: 6.8 symbols/min [2025-09-17T05:27:09.135040] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:27:09.176339] [DEBUG] [LOCAL ] NRG: Loaded 39448 existing records from primary storage. [2025-09-17T05:27:09.176529] [INFO ] [MAIN ] NRG: Loaded 39448 existing records. [2025-09-17T05:27:09.354396] [WARN ] [MAIN ] NRG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:27:09.354710] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-17T05:27:09.354776] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-17T05:27:09.355825] [DEBUG] [LOCAL ] NRG: Deleted primary data file. [2025-09-17T05:27:09.355891] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-17T05:27:09.500716] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-17T05:27:09.718367] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:27:10.120518] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T05:27:10.290098] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-11. [2025-09-17T05:27:11.025046] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T05:27:11.090162] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-17T05:27:11.890264] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-17T05:27:11.949427] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T05:27:12.126126] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T05:27:12.690196] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-17T05:27:13.289941] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T05:27:13.295399] [INFO ] [REMOTE ] NPWR: Full fetch complete (58832 records). [2025-09-17T05:27:13.295595] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-17T05:27:13.496034] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-17T05:27:13.693802] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-17T05:27:13.693935] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-17T05:27:13.695108] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-17T05:27:13.695182] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-17T05:27:13.696922] [DEBUG] [LOCAL ] NPWR: Trimmed 58832 records to 42970 (keeping 200 days of data) [2025-09-17T05:27:13.958414] [DEBUG] [LOCAL ] NPWR: Primary data saved (42970 records). [2025-09-17T05:27:13.958684] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-17T05:27:13.958885] [INFO ] [MAIN ] Update Progress: 1526/2369 symbols completed. NPWR took 41.8s. Estimated remaining: 2h 3m 15s. Rate: 6.8 symbols/min [2025-09-17T05:27:14.131611] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:27:14.163536] [DEBUG] [LOCAL ] NRGV: Loaded 31331 existing records from primary storage. [2025-09-17T05:27:14.163767] [INFO ] [MAIN ] NRGV: Loaded 31331 existing records. [2025-09-17T05:27:14.311749] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-17T05:27:14.350444] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:27:14.350886] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-17T05:27:14.351076] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-17T05:27:14.351808] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-17T05:27:14.351895] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-17T05:27:14.747061] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:27:14.749752] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-17T05:27:14.917542] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T05:27:15.090705] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T05:27:15.090763] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-17T05:27:15.890147] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-17T05:27:16.346549] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T05:27:16.350599] [INFO ] [REMOTE ] NRDY: Full fetch complete (52721 records). [2025-09-17T05:27:16.350816] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-17T05:27:16.697753] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-11. [2025-09-17T05:27:16.751206] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-17T05:27:16.751319] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-17T05:27:16.752438] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-17T05:27:16.752502] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-17T05:27:16.755346] [DEBUG] [LOCAL ] NRDY: Trimmed 52721 records to 33381 (keeping 200 days of data) [2025-09-17T05:27:16.951526] [DEBUG] [LOCAL ] NRDY: Primary data saved (33381 records). [2025-09-17T05:27:16.951749] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-17T05:27:16.951896] [INFO ] [MAIN ] Update Progress: 1527/2369 symbols completed. NRDY took 36.3s. Estimated remaining: 2h 3m 3s. Rate: 6.8 symbols/min [2025-09-17T05:27:17.127567] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:27:17.127879] [DEBUG] [LOCAL ] NRK: No existing data file found in primary storage. [2025-09-17T05:27:17.127935] [WARN ] [MAIN ] NRK: No existing data found, performing full refresh instead. [2025-09-17T05:27:17.128057] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-17T05:27:17.128117] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-17T05:27:17.128169] [DEBUG] [LOCAL ] NRK: No primary data file found to delete. [2025-09-17T05:27:17.128217] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-17T05:27:17.496745] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:27:17.493278] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-17T05:27:18.085248] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-17T05:27:18.291610] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-11. [2025-09-17T05:27:18.292438] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T05:27:18.992235] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-11 (2.29 seconds). [2025-09-17T05:27:19.090091] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-17T05:27:19.420305] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T05:27:19.890129] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-09-17T05:27:20.690172] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-17T05:27:20.755113] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T05:27:21.397256] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T05:27:21.399166] [INFO ] [REMOTE ] NREF: Full fetch complete (10781 records). [2025-09-17T05:27:21.399308] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-17T05:27:21.499864] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-17T05:27:21.788363] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-17T05:27:21.788522] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-17T05:27:21.788903] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-17T05:27:21.788992] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-17T05:27:21.789773] [DEBUG] [LOCAL ] NREF: Trimmed 10781 records to 7779 (keeping 200 days of data) [2025-09-17T05:27:21.914575] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T05:27:21.936588] [DEBUG] [LOCAL ] NREF: Primary data saved (7779 records). [2025-09-17T05:27:21.936735] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-17T05:27:21.936877] [INFO ] [MAIN ] Update Progress: 1528/2369 symbols completed. NREF took 33.2s. Estimated remaining: 2h 2m 53s. Rate: 6.8 symbols/min [2025-09-17T05:27:22.104257] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:27:22.110079] [DEBUG] [LOCAL ] NRP: Loaded 2791 existing records from primary storage. [2025-09-17T05:27:22.110237] [INFO ] [MAIN ] NRP: Loaded 2791 existing records. [2025-09-17T05:27:22.287150] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:27:22.287432] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-17T05:27:22.287509] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-17T05:27:22.287819] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-17T05:27:22.287901] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-17T05:27:22.299128] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-09-17T05:27:22.658982] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:27:23.090210] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-11. [2025-09-17T05:27:23.416100] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T05:27:23.692638] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T05:27:23.897600] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-17T05:27:23.918438] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T05:27:24.690167] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-09-17T05:27:25.490167] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-09-17T05:27:25.818876] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T05:27:25.843970] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T05:27:26.107071] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T05:27:26.290204] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-17T05:27:27.090238] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-09-17T05:27:27.890255] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-17T05:27:28.058496] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T05:27:28.242188] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T05:27:28.690215] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-17T05:27:29.237470] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T05:27:29.490162] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-17T05:27:30.208885] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T05:27:30.290137] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-17T05:27:30.874995] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T05:27:31.090157] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-17T05:27:31.890149] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-09-17T05:27:32.155388] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T05:27:32.234831] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T05:27:32.251971] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T05:27:32.690173] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-17T05:27:33.321392] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T05:27:33.490160] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-17T05:27:34.290234] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-17T05:27:35.090192] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-17T05:27:35.127032] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T05:27:35.188835] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T05:27:35.710107] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T05:27:35.890266] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-17T05:27:36.478606] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T05:27:36.690152] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-17T05:27:37.193162] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T05:27:37.490185] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-17T05:27:38.290168] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-17T05:27:38.581526] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T05:27:39.090156] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-17T05:27:39.890172] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-17T05:27:40.176093] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T05:27:40.582591] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T05:27:40.690154] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-17T05:27:40.953885] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T05:27:41.490199] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-17T05:27:41.948607] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T05:27:42.290179] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-17T05:27:42.879350] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T05:27:43.090138] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-17T05:27:43.129285] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T05:27:43.136160] [INFO ] [REMOTE ] NRG: Full fetch complete (76413 records). [2025-09-17T05:27:43.136396] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-17T05:27:43.547193] [DEBUG] [VALIDATOR ] NRG: All expected trading days are present. [2025-09-17T05:27:43.547340] [DEBUG] [VALIDATOR ] NRG: Primary data validation passed. [2025-09-17T05:27:43.548512] [INFO ] [MAIN ] NRG: Fetched primary data is valid. [2025-09-17T05:27:43.548574] [DEBUG] [LOCAL ] NRG: Saving primary data. [2025-09-17T05:27:43.550215] [DEBUG] [LOCAL ] NRG: Trimmed 76413 records to 52949 (keeping 200 days of data) [2025-09-17T05:27:43.890970] [DEBUG] [LOCAL ] NRG: Primary data saved (52949 records). [2025-09-17T05:27:43.891056] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-17T05:27:43.891332] [INFO ] [MAIN ] NRG: Full history saved. [2025-09-17T05:27:43.891507] [INFO ] [MAIN ] Update Progress: 1529/2369 symbols completed. NRG took 34.9s. Estimated remaining: 2h 2m 51s. Rate: 6.8 symbols/min [2025-09-17T05:27:44.061863] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:27:44.067471] [DEBUG] [LOCAL ] NRT: Loaded 3683 existing records from primary storage. [2025-09-17T05:27:44.067578] [INFO ] [MAIN ] NRT: Loaded 3683 existing records. [2025-09-17T05:27:44.226002] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T05:27:44.264793] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:27:44.265796] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-17T05:27:44.265912] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-17T05:27:44.266225] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-17T05:27:44.266284] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-17T05:27:44.639231] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:27:44.641413] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T05:27:44.690151] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-17T05:27:45.164966] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T05:27:45.490158] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-11. [2025-09-17T05:27:46.140779] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T05:27:46.290149] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-09-17T05:27:46.942958] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T05:27:47.090167] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-17T05:27:47.890194] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-17T05:27:48.233251] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T05:27:48.579747] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T05:27:48.580848] [INFO ] [REMOTE ] NRP: Full fetch complete (6516 records). [2025-09-17T05:27:48.580939] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-17T05:27:48.695354] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-17T05:27:48.950760] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-17T05:27:48.950877] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-17T05:27:48.951102] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-17T05:27:48.951156] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-17T05:27:48.951662] [DEBUG] [LOCAL ] NRP: Trimmed 6516 records to 4166 (keeping 200 days of data) [2025-09-17T05:27:48.978473] [DEBUG] [LOCAL ] NRP: Primary data saved (4166 records). [2025-09-17T05:27:48.978573] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-17T05:27:48.978680] [INFO ] [MAIN ] Update Progress: 1530/2369 symbols completed. NRP took 27.0s. Estimated remaining: 2h 2m 40s. Rate: 6.8 symbols/min [2025-09-17T05:27:49.151848] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:27:49.156031] [DEBUG] [LOCAL ] NRUC: Loaded 2230 existing records from primary storage. [2025-09-17T05:27:49.156157] [INFO ] [MAIN ] NRUC: Loaded 2230 existing records. [2025-09-17T05:27:49.338450] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:27:49.338797] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-17T05:27:49.338863] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-17T05:27:49.339159] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-17T05:27:49.339230] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-17T05:27:49.490582] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-17T05:27:49.708353] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:27:50.290114] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-11. [2025-09-17T05:27:50.333723] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T05:27:50.647164] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T05:27:50.843292] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T05:27:51.090141] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-17T05:27:51.890150] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-09-17T05:27:52.226458] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T05:27:52.229679] [INFO ] [REMOTE ] NRK: Full fetch complete (27554 records). [2025-09-17T05:27:52.229797] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-17T05:27:52.597688] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-17T05:27:52.597830] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-17T05:27:52.598475] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-17T05:27:52.598549] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-17T05:27:52.599389] [DEBUG] [LOCAL ] NRK: Trimmed 27554 records to 19390 (keeping 200 days of data) [2025-09-17T05:27:52.690725] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-17T05:27:52.704553] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T05:27:52.733591] [DEBUG] [LOCAL ] NRK: Primary data saved (19390 records). [2025-09-17T05:27:52.733801] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-17T05:27:52.733902] [INFO ] [MAIN ] Update Progress: 1531/2369 symbols completed. NRK took 35.8s. Estimated remaining: 2h 2m 29s. Rate: 6.8 symbols/min [2025-09-17T05:27:52.910451] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:27:52.952282] [DEBUG] [LOCAL ] NSA: Loaded 33725 existing records from primary storage. [2025-09-17T05:27:52.952517] [INFO ] [MAIN ] NSA: Loaded 33725 existing records. [2025-09-17T05:27:53.142456] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:27:53.142824] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-17T05:27:53.142894] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-17T05:27:53.144263] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-17T05:27:53.144347] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-17T05:27:53.490959] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-09-17T05:27:53.517843] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:27:54.205023] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T05:27:54.290103] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-09-17T05:27:54.377024] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T05:27:54.865345] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T05:27:55.090158] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-17T05:27:55.605696] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T05:27:55.890181] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-17T05:27:56.690193] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-17T05:27:57.269298] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T05:27:57.490204] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-17T05:27:57.513315] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T05:27:57.520376] [INFO ] [REMOTE ] NRGV: Full fetch complete (61445 records). [2025-09-17T05:27:57.520676] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-17T05:27:57.917625] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-17T05:27:57.917781] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-17T05:27:57.918995] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-17T05:27:57.919074] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-17T05:27:57.920800] [DEBUG] [LOCAL ] NRGV: Trimmed 61445 records to 42570 (keeping 200 days of data) [2025-09-17T05:27:58.141786] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T05:27:58.196596] [DEBUG] [LOCAL ] NRGV: Primary data saved (42570 records). [2025-09-17T05:27:58.196805] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-17T05:27:58.196915] [INFO ] [MAIN ] Update Progress: 1532/2369 symbols completed. NRGV took 44.2s. Estimated remaining: 2h 2m 18s. Rate: 6.8 symbols/min [2025-09-17T05:27:58.298236] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-11. [2025-09-17T05:27:58.381565] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:27:58.424056] [DEBUG] [LOCAL ] NSC: Loaded 36514 existing records from primary storage. [2025-09-17T05:27:58.424317] [INFO ] [MAIN ] NSC: Loaded 36514 existing records. [2025-09-17T05:27:58.607654] [WARN ] [MAIN ] NSC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:27:58.607974] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-17T05:27:58.608050] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-17T05:27:58.609276] [DEBUG] [LOCAL ] NSC: Deleted primary data file. [2025-09-17T05:27:58.609368] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-17T05:27:58.989198] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:27:59.090178] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-17T05:27:59.674991] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T05:27:59.699792] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T05:27:59.890133] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-17T05:28:00.522048] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T05:28:00.690155] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-11. [2025-09-17T05:28:01.490157] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-09-17T05:28:02.290113] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-17T05:28:02.384519] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T05:28:02.761385] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T05:28:02.899315] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T05:28:03.090133] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-09-17T05:28:03.890138] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-17T05:28:04.351142] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T05:28:04.490301] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T05:28:04.690188] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-17T05:28:05.345630] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T05:28:05.490196] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-17T05:28:06.290146] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-17T05:28:06.890228] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T05:28:07.099504] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-17T05:28:07.112454] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T05:28:07.779944] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T05:28:07.890141] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-17T05:28:08.482860] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T05:28:08.690160] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-17T05:28:09.246271] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T05:28:09.490129] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-17T05:28:10.087078] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T05:28:10.088113] [INFO ] [REMOTE ] NRUC: Full fetch complete (5559 records). [2025-09-17T05:28:10.088199] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-17T05:28:10.295774] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-17T05:28:10.457468] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-17T05:28:10.457620] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-17T05:28:10.457854] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-17T05:28:10.457912] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-17T05:28:10.458433] [DEBUG] [LOCAL ] NRUC: Trimmed 5559 records to 3116 (keeping 200 days of data) [2025-09-17T05:28:10.478339] [DEBUG] [LOCAL ] NRUC: Primary data saved (3116 records). [2025-09-17T05:28:10.478422] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-17T05:28:10.478509] [INFO ] [MAIN ] Update Progress: 1533/2369 symbols completed. NRUC took 21.5s. Estimated remaining: 2h 2m 11s. Rate: 6.8 symbols/min [2025-09-17T05:28:10.651257] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:28:10.684021] [DEBUG] [LOCAL ] NSP: Loaded 26492 existing records from primary storage. [2025-09-17T05:28:10.684247] [INFO ] [MAIN ] NSP: Loaded 26492 existing records. [2025-09-17T05:28:10.863947] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:28:10.864218] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-17T05:28:10.864277] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-17T05:28:10.865063] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-17T05:28:10.865126] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-17T05:28:11.102576] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-17T05:28:11.224433] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:28:11.890144] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-17T05:28:11.982874] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T05:28:12.463686] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T05:28:12.515542] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T05:28:12.690153] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-17T05:28:13.394476] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T05:28:13.490171] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-17T05:28:14.112058] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T05:28:14.113315] [INFO ] [REMOTE ] NRT: Full fetch complete (8137 records). [2025-09-17T05:28:14.113456] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-17T05:28:14.295300] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-11. [2025-09-17T05:28:14.489409] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-17T05:28:14.489553] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-17T05:28:14.489803] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-17T05:28:14.489862] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-17T05:28:14.490487] [DEBUG] [LOCAL ] NRT: Trimmed 8137 records to 4956 (keeping 200 days of data) [2025-09-17T05:28:14.521430] [DEBUG] [LOCAL ] NRT: Primary data saved (4956 records). [2025-09-17T05:28:14.521661] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-17T05:28:14.521806] [INFO ] [MAIN ] Update Progress: 1534/2369 symbols completed. NRT took 30.6s. Estimated remaining: 2h 1m 60s. Rate: 6.8 symbols/min [2025-09-17T05:28:14.695483] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:28:14.713804] [DEBUG] [LOCAL ] NTB: Loaded 14787 existing records from primary storage. [2025-09-17T05:28:14.714001] [INFO ] [MAIN ] NTB: Loaded 14787 existing records. [2025-09-17T05:28:14.893266] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:28:14.893622] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-17T05:28:14.893751] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-17T05:28:14.894524] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-17T05:28:14.894594] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-17T05:28:15.098678] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-17T05:28:15.262334] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:28:15.686960] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T05:28:15.890181] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-11. [2025-09-17T05:28:16.690140] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-09-17T05:28:16.935730] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T05:28:16.959385] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T05:28:17.490196] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-09-17T05:28:18.124880] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T05:28:18.290172] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-17T05:28:18.524976] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T05:28:19.090181] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-09-17T05:28:19.816907] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T05:28:19.890101] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-17T05:28:20.395597] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T05:28:20.690139] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-17T05:28:20.993864] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T05:28:21.490154] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-09-17T05:28:22.000506] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T05:28:22.233328] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T05:28:22.290122] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-17T05:28:23.090150] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-17T05:28:23.341826] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T05:28:23.890144] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-17T05:28:24.690135] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-17T05:28:24.759020] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T05:28:25.257105] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T05:28:25.490188] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-17T05:28:26.290207] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-17T05:28:26.448817] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T05:28:26.914848] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T05:28:27.090162] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-17T05:28:27.850915] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T05:28:27.890133] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-17T05:28:28.187602] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T05:28:28.690184] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-17T05:28:29.342737] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T05:28:29.490190] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-17T05:28:30.230154] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T05:28:30.290104] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-17T05:28:31.090138] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-17T05:28:31.131012] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T05:28:31.659920] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T05:28:31.890091] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-17T05:28:32.298272] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T05:28:32.690147] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-17T05:28:33.019454] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T05:28:33.490187] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-17T05:28:34.272091] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T05:28:34.290087] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-17T05:28:35.090155] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-17T05:28:35.231526] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T05:28:35.882119] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T05:28:35.888024] [INFO ] [REMOTE ] NSA: Full fetch complete (61289 records). [2025-09-17T05:28:35.888171] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-17T05:28:35.900892] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-17T05:28:36.288044] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-17T05:28:36.288402] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-17T05:28:36.289551] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-17T05:28:36.289634] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-17T05:28:36.291076] [DEBUG] [LOCAL ] NSA: Trimmed 61289 records to 44838 (keeping 200 days of data) [2025-09-17T05:28:36.593716] [DEBUG] [LOCAL ] NSA: Primary data saved (44838 records). [2025-09-17T05:28:36.594809] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T05:28:36.594964] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-17T05:28:36.603060] [INFO ] [MAIN ] Update Progress: 1535/2369 symbols completed. NSA took 43.9s. Estimated remaining: 2h 1m 58s. Rate: 6.8 symbols/min [2025-09-17T05:28:36.694416] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-17T05:28:36.808550] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:28:36.808909] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-17T05:28:36.809011] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-17T05:28:36.809134] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-17T05:28:36.820173] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-17T05:28:36.820529] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T05:28:36.824719] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-17T05:28:36.825127] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-17T05:28:37.183780] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:28:37.490137] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-11. [2025-09-17T05:28:37.917079] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T05:28:38.115291] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T05:28:38.120285] [INFO ] [REMOTE ] NSP: Full fetch complete (49149 records). [2025-09-17T05:28:38.120420] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-17T05:28:38.297191] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-17T05:28:38.513344] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-17T05:28:38.513464] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-17T05:28:38.514509] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-17T05:28:38.514606] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-17T05:28:38.515893] [DEBUG] [LOCAL ] NSP: Trimmed 49149 records to 34941 (keeping 200 days of data) [2025-09-17T05:28:38.744767] [DEBUG] [LOCAL ] NSP: Primary data saved (34941 records). [2025-09-17T05:28:38.744974] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-17T05:28:38.745113] [INFO ] [MAIN ] Update Progress: 1536/2369 symbols completed. NSP took 28.3s. Estimated remaining: 2h 1m 46s. Rate: 6.8 symbols/min [2025-09-17T05:28:38.916713] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:28:38.964058] [DEBUG] [LOCAL ] NTR: Loaded 39127 existing records from primary storage. [2025-09-17T05:28:38.964307] [INFO ] [MAIN ] NTR: Loaded 39127 existing records. [2025-09-17T05:28:39.095346] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-17T05:28:39.147664] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:28:39.147870] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-17T05:28:39.147948] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-17T05:28:39.149455] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-17T05:28:39.149537] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-17T05:28:39.516613] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:28:39.528061] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T05:28:39.634026] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T05:28:39.890135] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-11. [2025-09-17T05:28:40.690195] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-17T05:28:41.447137] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T05:28:41.490132] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-17T05:28:41.783707] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T05:28:42.078067] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T05:28:42.290135] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-17T05:28:43.090158] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-17T05:28:43.317531] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T05:28:43.890183] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-17T05:28:44.406712] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T05:28:44.661069] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T05:28:44.690172] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-17T05:28:45.490143] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-17T05:28:45.686094] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T05:28:45.688938] [INFO ] [REMOTE ] NTB: Full fetch complete (30848 records). [2025-09-17T05:28:45.689042] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-17T05:28:45.967873] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T05:28:46.072186] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-17T05:28:46.072345] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-17T05:28:46.073190] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-17T05:28:46.073254] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-17T05:28:46.074451] [DEBUG] [LOCAL ] NTB: Trimmed 30848 records to 20891 (keeping 200 days of data) [2025-09-17T05:28:46.208112] [DEBUG] [LOCAL ] NTB: Primary data saved (20891 records). [2025-09-17T05:28:46.208290] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-17T05:28:46.208386] [INFO ] [MAIN ] Update Progress: 1537/2369 symbols completed. NTB took 31.7s. Estimated remaining: 2h 1m 37s. Rate: 6.8 symbols/min [2025-09-17T05:28:46.295422] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-17T05:28:46.382090] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:28:46.422685] [DEBUG] [LOCAL ] NTST: Loaded 32324 existing records from primary storage. [2025-09-17T05:28:46.422913] [INFO ] [MAIN ] NTST: Loaded 32324 existing records. [2025-09-17T05:28:46.599671] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:28:46.599971] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-17T05:28:46.600041] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-17T05:28:46.601217] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-17T05:28:46.601287] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-17T05:28:46.957884] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:28:47.090134] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-17T05:28:47.540841] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T05:28:47.890186] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-09-17T05:28:48.189123] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T05:28:48.690203] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-17T05:28:49.490211] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-11. [2025-09-17T05:28:49.589004] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T05:28:49.637207] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T05:28:50.290180] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-17T05:28:50.724686] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T05:28:50.979467] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T05:28:51.090133] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-09-17T05:28:51.890206] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-17T05:28:52.536229] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T05:28:52.690142] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-09-17T05:28:53.490177] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-17T05:28:53.636575] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T05:28:54.124951] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T05:28:54.151995] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T05:28:54.290193] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-17T05:28:54.789241] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T05:28:55.090137] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-09-17T05:28:55.890133] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-17T05:28:56.690133] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-17T05:28:56.765853] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T05:28:57.262833] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T05:28:57.263604] [INFO ] [REMOTE ] NTEST: Full fetch complete (2021 records). [2025-09-17T05:28:57.263704] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-17T05:28:57.442507] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-17T05:28:57.442740] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:28:57.442796] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:28:57.442838] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-17T05:28:57.442899] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-17T05:28:57.442948] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-17T05:28:57.443018] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-17T05:28:57.443084] [INFO ] [MAIN ] Update Progress: 1538/2369 symbols completed. NTEST took 20.8s. Estimated remaining: 2h 1m 29s. Rate: 6.8 symbols/min [2025-09-17T05:28:57.496922] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-17T05:28:57.617980] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:28:57.636060] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T05:28:57.642288] [INFO ] [REMOTE ] NSC: Full fetch complete (70630 records). [2025-09-17T05:28:57.642442] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-17T05:28:57.898179] [DEBUG] [LOCAL ] NU: Loaded 40096 existing records from primary storage. [2025-09-17T05:28:57.947866] [INFO ] [MAIN ] NU: Loaded 40096 existing records. [2025-09-17T05:28:58.183707] [DEBUG] [VALIDATOR ] NSC: All expected trading days are present. [2025-09-17T05:28:58.188950] [DEBUG] [VALIDATOR ] NSC: Primary data validation passed. [2025-09-17T05:28:58.220630] [INFO ] [MAIN ] NSC: Fetched primary data is valid. [2025-09-17T05:28:58.230045] [DEBUG] [LOCAL ] NSC: Saving primary data. [2025-09-17T05:28:58.252779] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:28:58.253603] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-17T05:28:58.253509] [DEBUG] [LOCAL ] NSC: Trimmed 70630 records to 49164 (keeping 200 days of data) [2025-09-17T05:28:58.253850] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-17T05:28:58.255353] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-17T05:28:58.255451] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-17T05:28:58.343526] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-17T05:28:58.742877] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:28:58.958520] [DEBUG] [LOCAL ] NSC: Primary data saved (49164 records). [2025-09-17T05:28:58.958774] [INFO ] [MAIN ] NSC: Full history saved. [2025-09-17T05:28:58.958895] [INFO ] [MAIN ] Update Progress: 1539/2369 symbols completed. NSC took 1m 1s. Estimated remaining: 2h 1m 16s. Rate: 6.8 symbols/min [2025-09-17T05:28:59.091966] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-11. [2025-09-17T05:28:59.140610] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:28:59.141251] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-17T05:28:59.142407] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-17T05:28:59.142755] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-17T05:28:59.142824] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-17T05:28:59.142939] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-17T05:28:59.143012] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-17T05:28:59.486356] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T05:28:59.603966] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:28:59.890177] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-17T05:28:59.922020] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T05:29:00.690146] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-17T05:29:01.482164] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-11 (2.39 seconds). [2025-09-17T05:29:01.492440] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-11. [2025-09-17T05:29:01.683351] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T05:29:01.839401] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T05:29:02.290184] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-17T05:29:03.090173] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-09-17T05:29:03.326181] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T05:29:03.890134] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-17T05:29:04.067405] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T05:29:04.690129] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-17T05:29:05.308858] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-17T05:29:05.375046] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T05:29:05.490124] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-09-17T05:29:06.290128] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-17T05:29:06.581480] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T05:29:07.090198] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-17T05:29:07.696838] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-17T05:29:07.729558] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T05:29:07.890131] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-17T05:29:08.690124] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-17T05:29:08.735633] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T05:29:09.321567] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T05:29:09.490145] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-17T05:29:10.290154] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-17T05:29:10.409490] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T05:29:10.863280] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T05:29:11.090202] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-17T05:29:11.890204] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-17T05:29:12.096320] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T05:29:12.641549] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T05:29:12.690136] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-17T05:29:13.490129] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-17T05:29:13.522762] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T05:29:14.218503] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T05:29:14.224934] [INFO ] [REMOTE ] NTST: Full fetch complete (60391 records). [2025-09-17T05:29:14.225161] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-17T05:29:14.295424] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-17T05:29:14.626035] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-17T05:29:14.626187] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-17T05:29:14.627180] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-17T05:29:14.627264] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-17T05:29:14.628746] [DEBUG] [LOCAL ] NTST: Trimmed 60391 records to 43393 (keeping 200 days of data) [2025-09-17T05:29:14.926082] [DEBUG] [LOCAL ] NTST: Primary data saved (43393 records). [2025-09-17T05:29:14.926250] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-17T05:29:14.926353] [INFO ] [MAIN ] Update Progress: 1540/2369 symbols completed. NTST took 28.7s. Estimated remaining: 2h 1m 12s. Rate: 6.8 symbols/min [2025-09-17T05:29:15.112724] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-17T05:29:15.117386] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:29:15.145698] [DEBUG] [LOCAL ] NUS: Loaded 26600 existing records from primary storage. [2025-09-17T05:29:15.145905] [INFO ] [MAIN ] NUS: Loaded 26600 existing records. [2025-09-17T05:29:15.322148] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:29:15.322735] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-17T05:29:15.322882] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-17T05:29:15.323959] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-17T05:29:15.324033] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-17T05:29:15.727673] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:29:15.730273] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-17T05:29:15.890131] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-17T05:29:16.571140] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-17T05:29:16.690195] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-17T05:29:16.878122] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T05:29:17.492695] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-11. [2025-09-17T05:29:17.937420] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T05:29:18.290275] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-17T05:29:18.636456] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T05:29:18.995415] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-17T05:29:19.090151] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-17T05:29:19.890167] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-09-17T05:29:20.144622] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T05:29:20.690203] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-17T05:29:21.348293] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T05:29:21.468486] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.38 seconds). [2025-09-17T05:29:21.490095] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-17T05:29:22.290230] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-17T05:29:22.487163] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T05:29:23.090181] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-17T05:29:23.558256] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-17T05:29:23.890123] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-17T05:29:24.246108] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T05:29:24.690165] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-17T05:29:24.807911] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T05:29:24.814364] [INFO ] [REMOTE ] NTR: Full fetch complete (76135 records). [2025-09-17T05:29:24.814524] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-17T05:29:25.206147] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-17T05:29:25.206299] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-17T05:29:25.207545] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-17T05:29:25.207610] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-17T05:29:25.209134] [DEBUG] [LOCAL ] NTR: Trimmed 76135 records to 52624 (keeping 200 days of data) [2025-09-17T05:29:25.496207] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-17T05:29:25.544379] [DEBUG] [LOCAL ] NTR: Primary data saved (52624 records). [2025-09-17T05:29:25.544603] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-17T05:29:25.544753] [INFO ] [MAIN ] Update Progress: 1541/2369 symbols completed. NTR took 46.8s. Estimated remaining: 2h 1m 4s. Rate: 6.8 symbols/min [2025-09-17T05:29:25.713897] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:29:25.730921] [DEBUG] [LOCAL ] NUV: Loaded 16417 existing records from primary storage. [2025-09-17T05:29:25.731095] [INFO ] [MAIN ] NUV: Loaded 16417 existing records. [2025-09-17T05:29:25.911739] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:29:25.912048] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-17T05:29:25.912109] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-17T05:29:25.912575] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-17T05:29:25.912632] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-17T05:29:26.274383] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:29:26.293471] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-11. [2025-09-17T05:29:26.298538] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T05:29:26.344598] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-17T05:29:27.090157] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-17T05:29:27.392504] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T05:29:27.441735] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T05:29:27.890226] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-17T05:29:28.592626] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T05:29:28.690196] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-09-17T05:29:29.490219] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-17T05:29:29.853486] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T05:29:30.022352] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T05:29:30.290238] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-17T05:29:30.951852] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T05:29:31.090114] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-17T05:29:31.890135] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-17T05:29:32.451592] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-17T05:29:32.458843] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-09-17T05:29:32.459105] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-17T05:29:32.703747] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-17T05:29:32.893476] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-17T05:29:32.893723] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-17T05:29:32.895771] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-17T05:29:32.895982] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-17T05:29:32.898290] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 53746 (keeping 200 days of data) [2025-09-17T05:29:33.212830] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-17T05:29:33.350741] [DEBUG] [LOCAL ] NU: Primary data saved (53746 records). [2025-09-17T05:29:33.350934] [INFO ] [MAIN ] NU: Full history saved. [2025-09-17T05:29:33.351030] [INFO ] [MAIN ] Update Progress: 1542/2369 symbols completed. NU took 35.9s. Estimated remaining: 2h 0m 55s. Rate: 6.8 symbols/min [2025-09-17T05:29:33.493077] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-17T05:29:33.528877] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:29:33.559820] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T05:29:33.603178] [DEBUG] [LOCAL ] NUVB: Loaded 38462 existing records from primary storage. [2025-09-17T05:29:33.603418] [INFO ] [MAIN ] NUVB: Loaded 38462 existing records. [2025-09-17T05:29:33.785715] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:29:33.786002] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-17T05:29:33.786064] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-17T05:29:33.786971] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-17T05:29:33.787041] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-17T05:29:34.052738] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T05:29:34.168818] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:29:34.290169] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-17T05:29:35.090178] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-11. [2025-09-17T05:29:35.441130] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T05:29:35.657298] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T05:29:35.890155] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-17T05:29:36.643238] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T05:29:36.690096] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-09-17T05:29:37.179377] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T05:29:37.490208] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-17T05:29:38.220628] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T05:29:38.290135] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-09-17T05:29:39.090169] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-17T05:29:39.282002] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T05:29:39.288151] [INFO ] [REMOTE ] NUE: Full fetch complete (74733 records). [2025-09-17T05:29:39.288410] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-17T05:29:39.493152] [WARN ] [VALIDATOR ] NUE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T05:29:39.494174] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:29:39.494334] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:29:39.494434] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-17T05:29:39.494705] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-17T05:29:39.494795] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-17T05:29:39.495040] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-17T05:29:39.495248] [INFO ] [MAIN ] Update Progress: 1543/2369 symbols completed. NUE took 40.5s. Estimated remaining: 2h 0m 44s. Rate: 6.8 symbols/min [2025-09-17T05:29:39.690005] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:29:39.709208] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T05:29:39.723576] [DEBUG] [LOCAL ] NUW: Loaded 5126 existing records from primary storage. [2025-09-17T05:29:39.723725] [INFO ] [MAIN ] NUW: Loaded 5126 existing records. [2025-09-17T05:29:39.890877] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-17T05:29:39.914980] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:29:39.915440] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-17T05:29:39.915552] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-17T05:29:39.915928] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-17T05:29:39.916028] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-17T05:29:40.216968] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T05:29:40.300570] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:29:40.690132] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-17T05:29:41.090915] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T05:29:41.490127] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-17T05:29:41.776560] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T05:29:42.290217] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-11. [2025-09-17T05:29:42.591871] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T05:29:43.002136] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T05:29:43.090127] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-09-17T05:29:43.869628] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T05:29:43.890152] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-17T05:29:44.690159] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-17T05:29:45.352892] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T05:29:45.490113] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-09-17T05:29:46.290129] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-17T05:29:46.300836] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T05:29:46.356396] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T05:29:47.090150] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-17T05:29:47.575568] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T05:29:47.580814] [INFO ] [REMOTE ] NUS: Full fetch complete (53906 records). [2025-09-17T05:29:47.581045] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-17T05:29:47.893263] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-17T05:29:47.903303] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T05:29:47.999935] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-17T05:29:48.000114] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-17T05:29:48.001686] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-17T05:29:48.001763] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-17T05:29:48.003569] [DEBUG] [LOCAL ] NUS: Trimmed 53906 records to 36492 (keeping 200 days of data) [2025-09-17T05:29:48.266450] [DEBUG] [LOCAL ] NUS: Primary data saved (36492 records). [2025-09-17T05:29:48.266774] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-17T05:29:48.266976] [INFO ] [MAIN ] Update Progress: 1544/2369 symbols completed. NUS took 33.3s. Estimated remaining: 2h 0m 36s. Rate: 6.8 symbols/min [2025-09-17T05:29:48.469808] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:29:48.492012] [DEBUG] [LOCAL ] NVG: Loaded 20150 existing records from primary storage. [2025-09-17T05:29:48.492218] [INFO ] [MAIN ] NVG: Loaded 20150 existing records. [2025-09-17T05:29:48.693932] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-17T05:29:48.694231] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:29:48.695841] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-17T05:29:48.695996] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-17T05:29:48.696771] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-17T05:29:48.696851] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-17T05:29:49.070439] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:29:49.272314] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T05:29:49.490158] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-17T05:29:50.290113] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-17T05:29:50.476010] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T05:29:50.599195] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T05:29:51.023230] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T05:29:51.090127] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-17T05:29:51.890113] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-17T05:29:52.163221] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T05:29:52.690243] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-11. [2025-09-17T05:29:53.486381] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T05:29:53.496223] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-17T05:29:53.953191] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T05:29:54.290137] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-09-17T05:29:54.621887] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T05:29:55.090170] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-17T05:29:55.617319] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T05:29:55.890138] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-17T05:29:56.677222] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T05:29:56.690096] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-17T05:29:56.924195] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T05:29:57.158145] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T05:29:57.490136] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-17T05:29:58.290174] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-17T05:29:58.322591] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T05:29:59.090167] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-17T05:29:59.890165] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-17T05:30:00.155516] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T05:30:00.373787] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T05:30:00.690107] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-17T05:30:01.146697] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T05:30:01.490166] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-17T05:30:02.290164] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-17T05:30:03.090171] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-17T05:30:03.317465] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-17T05:30:03.890158] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-17T05:30:04.342498] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (2.85 seconds). [2025-09-17T05:30:04.690180] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-17T05:30:04.771848] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-17T05:30:04.775255] [INFO ] [REMOTE ] NUV: Full fetch complete (34326 records). [2025-09-17T05:30:04.775463] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-17T05:30:05.183519] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-17T05:30:05.183729] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-17T05:30:05.184879] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-17T05:30:05.184987] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-17T05:30:05.186476] [DEBUG] [LOCAL ] NUV: Trimmed 34326 records to 23052 (keeping 200 days of data) [2025-09-17T05:30:05.288323] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-17T05:30:05.349586] [DEBUG] [LOCAL ] NUV: Primary data saved (23052 records). [2025-09-17T05:30:05.349827] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-17T05:30:05.349998] [INFO ] [MAIN ] Update Progress: 1545/2369 symbols completed. NUV took 39.8s. Estimated remaining: 2h 0m 31s. Rate: 6.8 symbols/min [2025-09-17T05:30:05.498812] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-17T05:30:05.534436] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:30:05.561949] [DEBUG] [LOCAL ] NVGS: Loaded 23457 existing records from primary storage. [2025-09-17T05:30:05.562167] [INFO ] [MAIN ] NVGS: Loaded 23457 existing records. [2025-09-17T05:30:05.751605] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:30:05.751980] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-17T05:30:05.752058] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-17T05:30:05.752955] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-17T05:30:05.753023] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-17T05:30:06.077580] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T05:30:06.165883] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T05:30:06.188254] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:30:06.216408] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-17T05:30:06.224343] [INFO ] [REMOTE ] NUVB: Full fetch complete (72172 records). [2025-09-17T05:30:06.224621] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-17T05:30:06.295345] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-17T05:30:06.629225] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-17T05:30:06.629383] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-17T05:30:06.630981] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-17T05:30:06.631069] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-17T05:30:06.633238] [DEBUG] [LOCAL ] NUVB: Trimmed 72172 records to 51136 (keeping 200 days of data) [2025-09-17T05:30:06.951448] [DEBUG] [LOCAL ] NUVB: Primary data saved (51136 records). [2025-09-17T05:30:06.951681] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-17T05:30:06.951800] [INFO ] [MAIN ] Update Progress: 1546/2369 symbols completed. NUVB took 33.6s. Estimated remaining: 2h 0m 19s. Rate: 6.8 symbols/min [2025-09-17T05:30:07.069999] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T05:30:07.108460] [INFO ] [REMOTE ] NUW: Full fetch complete (11756 records). [2025-09-17T05:30:07.108569] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-17T05:30:07.140091] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:30:07.140620] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-17T05:30:07.463875] [DEBUG] [LOCAL ] NVO: Loaded 40134 existing records from primary storage. [2025-09-17T05:30:07.498679] [INFO ] [MAIN ] NVO: Loaded 40134 existing records. [2025-09-17T05:30:07.659514] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-17T05:30:07.659736] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-17T05:30:07.666196] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-17T05:30:07.681756] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-17T05:30:07.738665] [DEBUG] [LOCAL ] NUW: Trimmed 11756 records to 7444 (keeping 200 days of data) [2025-09-17T05:30:07.743441] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:30:07.744361] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-17T05:30:07.744870] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-17T05:30:07.746103] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-17T05:30:07.746166] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-17T05:30:07.900592] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-11. [2025-09-17T05:30:08.099595] [DEBUG] [LOCAL ] NUW: Primary data saved (7444 records). [2025-09-17T05:30:08.110144] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-17T05:30:08.146369] [INFO ] [MAIN ] Update Progress: 1547/2369 symbols completed. NUW took 28.7s. Estimated remaining: 2h 0m 6s. Rate: 6.8 symbols/min [2025-09-17T05:30:08.169710] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:30:08.337943] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:30:08.352739] [DEBUG] [LOCAL ] NVR: Loaded 13127 existing records from primary storage. [2025-09-17T05:30:08.352938] [INFO ] [MAIN ] NVR: Loaded 13127 existing records. [2025-09-17T05:30:08.531609] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:30:08.531950] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-17T05:30:08.532011] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-17T05:30:08.532558] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-17T05:30:08.532618] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-17T05:30:08.691578] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-11. [2025-09-17T05:30:08.933925] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:30:08.936337] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T05:30:08.959543] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T05:30:09.490206] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-17T05:30:10.290243] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-11. [2025-09-17T05:30:10.579062] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T05:30:10.883327] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-11 (2.19 seconds). [2025-09-17T05:30:11.090160] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-09-17T05:30:11.380974] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T05:30:11.890168] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-09-17T05:30:12.690230] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-17T05:30:13.093376] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T05:30:13.490184] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-09-17T05:30:13.600012] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T05:30:13.642288] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-17T05:30:14.207359] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T05:30:14.290193] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-17T05:30:15.090198] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-17T05:30:15.628962] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T05:30:15.890161] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-17T05:30:16.690183] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-09-17T05:30:17.490133] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-17T05:30:17.885524] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T05:30:18.016890] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.93 seconds). [2025-09-17T05:30:18.042995] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T05:30:18.290164] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-17T05:30:18.594866] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T05:30:19.090166] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-17T05:30:19.581168] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T05:30:19.890195] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-17T05:30:20.690220] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-17T05:30:21.059764] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T05:30:21.430105] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-17T05:30:21.488336] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T05:30:21.493573] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-17T05:30:22.290152] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-17T05:30:22.717498] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T05:30:22.721759] [INFO ] [REMOTE ] NVG: Full fetch complete (40594 records). [2025-09-17T05:30:22.721878] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-17T05:30:23.096289] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-17T05:30:23.100143] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-17T05:30:23.100296] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-17T05:30:23.101333] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-17T05:30:23.101520] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-17T05:30:23.102723] [DEBUG] [LOCAL ] NVG: Trimmed 40594 records to 27231 (keeping 200 days of data) [2025-09-17T05:30:23.275134] [DEBUG] [LOCAL ] NVG: Primary data saved (27231 records). [2025-09-17T05:30:23.275327] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-17T05:30:23.275469] [INFO ] [MAIN ] Update Progress: 1548/2369 symbols completed. NVG took 35.0s. Estimated remaining: 2h 0m 0s. Rate: 6.8 symbols/min [2025-09-17T05:30:23.453657] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:30:23.486814] [DEBUG] [LOCAL ] NVRI: Loaded 28361 existing records from primary storage. [2025-09-17T05:30:23.487042] [INFO ] [MAIN ] NVRI: Loaded 28361 existing records. [2025-09-17T05:30:23.667124] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:30:23.667478] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-17T05:30:23.667546] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-17T05:30:23.668282] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-17T05:30:23.668351] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-17T05:30:23.909131] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-17T05:30:24.027177] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:30:24.459026] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T05:30:24.690244] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-17T05:30:24.925285] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.64 seconds). [2025-09-17T05:30:24.957213] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T05:30:25.490178] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-11. [2025-09-17T05:30:26.038176] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T05:30:26.290138] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-17T05:30:26.910602] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T05:30:27.090200] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-17T05:30:27.890202] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-09-17T05:30:28.139072] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T05:30:28.690149] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-17T05:30:28.989893] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-17T05:30:29.042952] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T05:30:29.490153] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-17T05:30:29.813801] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T05:30:30.290188] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-17T05:30:30.790156] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T05:30:31.090116] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-17T05:30:31.495232] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T05:30:31.890132] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-09-17T05:30:32.690167] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-17T05:30:33.304341] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T05:30:33.490158] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-17T05:30:33.764726] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.67 seconds). [2025-09-17T05:30:33.785713] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T05:30:34.290142] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-17T05:30:34.421204] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T05:30:35.090180] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-17T05:30:35.330966] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T05:30:35.334470] [INFO ] [REMOTE ] NVR: Full fetch complete (29775 records). [2025-09-17T05:30:35.334601] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-17T05:30:35.713006] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-17T05:30:35.713143] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-17T05:30:35.714093] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-17T05:30:35.714173] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-17T05:30:35.715023] [DEBUG] [LOCAL ] NVR: Trimmed 29775 records to 19506 (keeping 200 days of data) [2025-09-17T05:30:35.848457] [DEBUG] [LOCAL ] NVR: Primary data saved (19506 records). [2025-09-17T05:30:35.848712] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-17T05:30:35.848883] [INFO ] [MAIN ] Update Progress: 1549/2369 symbols completed. NVR took 27.7s. Estimated remaining: 1h 59m 54s. Rate: 6.8 symbols/min [2025-09-17T05:30:35.895244] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-17T05:30:36.029398] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:30:36.072784] [DEBUG] [LOCAL ] NVS: Loaded 38269 existing records from primary storage. [2025-09-17T05:30:36.073006] [INFO ] [MAIN ] NVS: Loaded 38269 existing records. [2025-09-17T05:30:36.257480] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:30:36.257771] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-17T05:30:36.257832] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-17T05:30:36.259204] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-17T05:30:36.259274] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-17T05:30:36.626100] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:30:36.690090] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-17T05:30:37.382272] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T05:30:37.490131] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-11. [2025-09-17T05:30:37.701805] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-17T05:30:37.733311] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T05:30:38.290150] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-17T05:30:39.090152] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-17T05:30:39.288695] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T05:30:39.326610] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T05:30:39.890268] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-09-17T05:30:40.690171] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-17T05:30:41.490260] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-17T05:30:41.578393] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T05:30:41.733191] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.64 seconds). [2025-09-17T05:30:41.790949] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T05:30:42.290138] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-17T05:30:42.345528] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T05:30:43.090189] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-17T05:30:43.890157] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-17T05:30:44.434813] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T05:30:44.606181] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-17T05:30:44.690150] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-17T05:30:45.105751] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T05:30:45.109207] [INFO ] [REMOTE ] NVGS: Full fetch complete (41457 records). [2025-09-17T05:30:45.109403] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-17T05:30:45.491838] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-09-17T05:30:45.492176] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-17T05:30:45.493081] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-17T05:30:45.493965] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-17T05:30:45.494117] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-17T05:30:45.495457] [DEBUG] [LOCAL ] NVGS: Trimmed 41457 records to 31402 (keeping 200 days of data) [2025-09-17T05:30:45.694742] [DEBUG] [LOCAL ] NVGS: Primary data saved (31402 records). [2025-09-17T05:30:45.694959] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-17T05:30:45.695109] [INFO ] [MAIN ] Update Progress: 1550/2369 symbols completed. NVGS took 40.3s. Estimated remaining: 1h 59m 45s. Rate: 6.8 symbols/min [2025-09-17T05:30:45.866539] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:30:45.907601] [DEBUG] [LOCAL ] NVST: Loaded 38272 existing records from primary storage. [2025-09-17T05:30:45.907821] [INFO ] [MAIN ] NVST: Loaded 38272 existing records. [2025-09-17T05:30:46.083676] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:30:46.083950] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-17T05:30:46.084018] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-17T05:30:46.084803] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-17T05:30:46.084867] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-17T05:30:46.301448] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-17T05:30:46.438579] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:30:47.090138] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-11. [2025-09-17T05:30:47.301461] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-17T05:30:47.308158] [INFO ] [REMOTE ] NVO: Full fetch complete (77914 records). [2025-09-17T05:30:47.308359] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-17T05:30:47.794318] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T05:30:47.816384] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-17T05:30:47.820582] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-17T05:30:47.838086] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-17T05:30:47.840073] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-17T05:30:47.840417] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-17T05:30:47.841926] [DEBUG] [LOCAL ] NVO: Trimmed 77914 records to 53784 (keeping 200 days of data) [2025-09-17T05:30:47.899517] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-17T05:30:48.193106] [DEBUG] [LOCAL ] NVO: Primary data saved (53784 records). [2025-09-17T05:30:48.193303] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-17T05:30:48.193434] [INFO ] [MAIN ] Update Progress: 1551/2369 symbols completed. NVO took 41.2s. Estimated remaining: 1h 59m 33s. Rate: 6.8 symbols/min [2025-09-17T05:30:48.360548] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:30:48.396451] [DEBUG] [LOCAL ] NVT: Loaded 38225 existing records from primary storage. [2025-09-17T05:30:48.396692] [INFO ] [MAIN ] NVT: Loaded 38225 existing records. [2025-09-17T05:30:48.586341] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:30:48.587081] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-17T05:30:48.587155] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-17T05:30:48.588342] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-17T05:30:48.588414] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-17T05:30:48.694766] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-17T05:30:49.013481] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:30:49.051872] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T05:30:49.284555] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T05:30:49.490171] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-11. [2025-09-17T05:30:50.290214] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-09-17T05:30:50.640054] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T05:30:51.090190] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-17T05:30:51.180396] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T05:30:51.550729] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T05:30:51.890131] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-09-17T05:30:52.647209] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T05:30:52.690122] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-17T05:30:53.495304] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-09-17T05:30:53.520742] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T05:30:54.180428] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T05:30:54.189295] [INFO ] [REMOTE ] NVRI: Full fetch complete (55736 records). [2025-09-17T05:30:54.189589] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-17T05:30:54.297834] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-17T05:30:54.615027] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-17T05:30:54.615235] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-17T05:30:54.616534] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-17T05:30:54.616602] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-17T05:30:54.618440] [DEBUG] [LOCAL ] NVRI: Trimmed 55736 records to 38963 (keeping 200 days of data) [2025-09-17T05:30:54.864116] [DEBUG] [LOCAL ] NVRI: Primary data saved (38963 records). [2025-09-17T05:30:54.864372] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-17T05:30:54.864526] [INFO ] [MAIN ] Update Progress: 1552/2369 symbols completed. NVRI took 31.6s. Estimated remaining: 1h 59m 24s. Rate: 6.8 symbols/min [2025-09-17T05:30:55.040461] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:30:55.088101] [DEBUG] [LOCAL ] NWG: Loaded 38406 existing records from primary storage. [2025-09-17T05:30:55.088509] [INFO ] [MAIN ] NWG: Loaded 38406 existing records. [2025-09-17T05:30:55.093863] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-17T05:30:55.288337] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:30:55.288794] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-17T05:30:55.288958] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-17T05:30:55.300491] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-17T05:30:55.314463] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-17T05:30:55.366568] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T05:30:55.729755] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:30:55.890184] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-11. [2025-09-17T05:30:56.191486] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T05:30:56.690178] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-17T05:30:56.792128] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T05:30:57.490144] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-17T05:30:57.541410] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T05:30:58.187419] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T05:30:58.290130] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-09-17T05:30:59.090132] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-17T05:30:59.297993] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T05:30:59.874159] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T05:30:59.890079] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-09-17T05:31:00.690101] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-09-17T05:31:00.855333] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T05:31:01.490126] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-17T05:31:01.667947] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T05:31:02.290176] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-17T05:31:02.342393] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T05:31:03.090213] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-17T05:31:03.274505] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T05:31:03.890138] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-17T05:31:03.943602] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T05:31:04.419273] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T05:31:04.690179] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-17T05:31:05.490168] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-17T05:31:05.691742] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T05:31:06.290155] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-17T05:31:06.340933] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T05:31:07.090162] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-17T05:31:07.523796] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T05:31:07.895219] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-17T05:31:07.912744] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T05:31:08.502320] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T05:31:08.690165] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-17T05:31:09.490203] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-17T05:31:09.745515] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T05:31:09.817982] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T05:31:10.290164] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-17T05:31:11.090206] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-17T05:31:11.184547] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T05:31:11.890171] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-17T05:31:12.053743] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T05:31:12.060186] [INFO ] [REMOTE ] NVS: Full fetch complete (74639 records). [2025-09-17T05:31:12.060438] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-17T05:31:12.463399] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-17T05:31:12.463514] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-17T05:31:12.464691] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-17T05:31:12.464777] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-17T05:31:12.466297] [DEBUG] [LOCAL ] NVS: Trimmed 74639 records to 51723 (keeping 200 days of data) [2025-09-17T05:31:12.690231] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-17T05:31:12.781541] [DEBUG] [LOCAL ] NVS: Primary data saved (51723 records). [2025-09-17T05:31:12.781751] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-17T05:31:12.782001] [INFO ] [MAIN ] Update Progress: 1553/2369 symbols completed. NVS took 36.9s. Estimated remaining: 1h 59m 20s. Rate: 6.8 symbols/min [2025-09-17T05:31:12.955830] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:31:13.014555] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T05:31:13.033870] [DEBUG] [LOCAL ] NWN: Loaded 20316 existing records from primary storage. [2025-09-17T05:31:13.034053] [INFO ] [MAIN ] NWN: Loaded 20316 existing records. [2025-09-17T05:31:13.219889] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:31:13.220277] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-17T05:31:13.220354] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-17T05:31:13.221145] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-17T05:31:13.221216] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-17T05:31:13.498338] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-17T05:31:13.595418] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:31:13.625854] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T05:31:14.290202] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-17T05:31:14.498682] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T05:31:15.090152] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-17T05:31:15.304631] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T05:31:15.890132] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-17T05:31:16.100332] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T05:31:16.601275] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T05:31:16.690187] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-17T05:31:17.467686] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T05:31:17.474031] [INFO ] [REMOTE ] NVST: Full fetch complete (73856 records). [2025-09-17T05:31:17.474272] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-17T05:31:17.495989] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-11. [2025-09-17T05:31:17.876309] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-17T05:31:17.876482] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-17T05:31:17.877603] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-17T05:31:17.877698] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-17T05:31:17.879352] [DEBUG] [LOCAL ] NVST: Trimmed 73856 records to 51696 (keeping 200 days of data) [2025-09-17T05:31:18.189020] [DEBUG] [LOCAL ] NVST: Primary data saved (51696 records). [2025-09-17T05:31:18.189196] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-17T05:31:18.189299] [INFO ] [MAIN ] Update Progress: 1554/2369 symbols completed. NVST took 32.5s. Estimated remaining: 1h 59m 9s. Rate: 6.8 symbols/min [2025-09-17T05:31:18.290255] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-17T05:31:18.366387] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:31:18.398835] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T05:31:18.425195] [DEBUG] [LOCAL ] NX: Loaded 24326 existing records from primary storage. [2025-09-17T05:31:18.425372] [INFO ] [MAIN ] NX: Loaded 24326 existing records. [2025-09-17T05:31:18.612540] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:31:18.612874] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-17T05:31:18.612936] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-17T05:31:18.613589] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-17T05:31:18.613687] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-17T05:31:18.985360] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T05:31:18.989259] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:31:19.090122] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-09-17T05:31:19.890146] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-17T05:31:19.991973] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T05:31:20.156620] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T05:31:20.690199] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-11. [2025-09-17T05:31:21.490150] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-17T05:31:21.695617] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T05:31:21.702462] [INFO ] [REMOTE ] NVT: Full fetch complete (74247 records). [2025-09-17T05:31:21.702720] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-17T05:31:21.851259] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T05:31:22.149788] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-17T05:31:22.149943] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-17T05:31:22.151253] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-17T05:31:22.151334] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-17T05:31:22.153087] [DEBUG] [LOCAL ] NVT: Trimmed 74247 records to 51625 (keeping 200 days of data) [2025-09-17T05:31:22.344236] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-09-17T05:31:22.490229] [DEBUG] [LOCAL ] NVT: Primary data saved (51625 records). [2025-09-17T05:31:22.490435] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-17T05:31:22.490551] [INFO ] [MAIN ] Update Progress: 1555/2369 symbols completed. NVT took 34.3s. Estimated remaining: 1h 58m 58s. Rate: 6.8 symbols/min [2025-09-17T05:31:22.667964] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:31:22.672955] [DEBUG] [LOCAL ] NXC: Loaded 2965 existing records from primary storage. [2025-09-17T05:31:22.673099] [INFO ] [MAIN ] NXC: Loaded 2965 existing records. [2025-09-17T05:31:22.854170] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:31:22.854472] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-17T05:31:22.854532] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-17T05:31:22.854775] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-17T05:31:22.854834] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-17T05:31:23.095749] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-09-17T05:31:23.215091] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:31:23.297956] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T05:31:23.562373] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T05:31:23.890143] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-17T05:31:24.690172] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-17T05:31:24.717255] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T05:31:24.740774] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T05:31:25.490196] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-09-17T05:31:26.290171] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-17T05:31:26.545923] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T05:31:26.863610] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T05:31:27.090098] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-17T05:31:27.496624] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T05:31:27.890131] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-17T05:31:28.392272] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T05:31:28.690139] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-17T05:31:29.192454] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T05:31:29.490142] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-17T05:31:30.290193] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-17T05:31:30.411461] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T05:31:30.475092] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T05:31:31.090179] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-17T05:31:31.797058] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T05:31:31.890131] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-11. [2025-09-17T05:31:32.459655] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T05:31:32.491761] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T05:31:32.498028] [INFO ] [REMOTE ] NWG: Full fetch complete (72752 records). [2025-09-17T05:31:32.498201] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-17T05:31:32.695276] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-09-17T05:31:32.892199] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-17T05:31:32.892318] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-17T05:31:32.893397] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-17T05:31:32.893458] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-17T05:31:32.895028] [DEBUG] [LOCAL ] NWG: Trimmed 72752 records to 51721 (keeping 200 days of data) [2025-09-17T05:31:33.231367] [DEBUG] [LOCAL ] NWG: Primary data saved (51721 records). [2025-09-17T05:31:33.231553] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-17T05:31:33.231678] [INFO ] [MAIN ] Update Progress: 1556/2369 symbols completed. NWG took 38.4s. Estimated remaining: 1h 58m 50s. Rate: 6.8 symbols/min [2025-09-17T05:31:33.400512] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:31:33.400773] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-17T05:31:33.400846] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-17T05:31:33.400992] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-17T05:31:33.401051] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-17T05:31:33.401122] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-17T05:31:33.401252] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-17T05:31:33.494582] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-17T05:31:33.568352] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T05:31:33.773010] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:31:34.290088] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-17T05:31:34.766199] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T05:31:35.090135] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-09-17T05:31:35.546550] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T05:31:35.722688] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T05:31:35.890148] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-17T05:31:36.690145] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-17T05:31:37.271175] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T05:31:37.490136] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-17T05:31:37.985607] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T05:31:38.290158] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-17T05:31:38.657037] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T05:31:38.717601] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T05:31:39.090149] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-17T05:31:39.890102] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-11. [2025-09-17T05:31:40.150019] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:31:40.150430] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-11 [2025-09-17T05:31:40.204596] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T05:31:40.209088] [INFO ] [REMOTE ] NWN: Full fetch complete (36751 records). [2025-09-17T05:31:40.209282] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-17T05:31:40.597411] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-17T05:31:40.597543] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-17T05:31:40.598657] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-17T05:31:40.598742] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-17T05:31:40.599703] [DEBUG] [LOCAL ] NWN: Trimmed 36751 records to 26946 (keeping 200 days of data) [2025-09-17T05:31:40.690331] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-17T05:31:40.771213] [DEBUG] [LOCAL ] NWN: Primary data saved (26946 records). [2025-09-17T05:31:40.771407] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-17T05:31:40.771524] [INFO ] [MAIN ] Update Progress: 1557/2369 symbols completed. NWN took 28.0s. Estimated remaining: 1h 58m 41s. Rate: 6.8 symbols/min [2025-09-17T05:31:41.490170] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-17T05:31:41.691114] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:31:41.691524] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-17T05:31:42.041490] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T05:31:42.290132] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-09-17T05:31:42.484746] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:31:42.485110] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-09-17T05:31:43.090147] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-17T05:31:43.890136] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-17T05:31:44.087240] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:31:44.087608] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-17T05:31:44.467338] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T05:31:44.690196] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-17T05:31:44.872736] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:31:44.873077] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-17T05:31:45.490139] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-17T05:31:46.290168] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-17T05:31:46.741165] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:31:46.741547] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-17T05:31:46.760337] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T05:31:47.090163] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-17T05:31:47.890142] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-17T05:31:48.090504] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:31:48.090931] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-17T05:31:48.627090] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T05:31:48.632349] [INFO ] [REMOTE ] NX: Full fetch complete (47809 records). [2025-09-17T05:31:48.632494] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-17T05:31:48.696199] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-17T05:31:48.975604] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:31:49.000880] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-17T05:31:49.016864] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-17T05:31:49.017836] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-17T05:31:49.018879] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-17T05:31:49.018943] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-17T05:31:49.020295] [DEBUG] [LOCAL ] NX: Trimmed 47809 records to 33431 (keeping 200 days of data) [2025-09-17T05:31:49.236336] [DEBUG] [LOCAL ] NX: Primary data saved (33431 records). [2025-09-17T05:31:49.236589] [INFO ] [MAIN ] NX: Full history saved. [2025-09-17T05:31:49.236764] [INFO ] [MAIN ] Update Progress: 1558/2369 symbols completed. NX took 31.0s. Estimated remaining: 1h 58m 32s. Rate: 6.8 symbols/min [2025-09-17T05:31:49.490320] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-17T05:31:50.290208] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-17T05:31:50.606815] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T05:31:50.623989] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T05:31:51.090210] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-17T05:31:51.890185] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-17T05:31:52.716551] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T05:31:52.717418] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T05:31:52.730075] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-17T05:31:53.308791] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T05:31:53.490138] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-17T05:31:54.057573] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T05:31:54.290134] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-17T05:31:55.090208] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-17T05:31:55.647106] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T05:31:55.890838] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-17T05:31:56.001314] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T05:31:56.010123] [INFO ] [REMOTE ] NXDR: Full fetch complete (14808 records). [2025-09-17T05:31:56.010300] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-17T05:31:56.308456] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 41 unique days, need 200 days [2025-09-17T05:31:56.308799] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:31:56.308853] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:31:56.308900] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-17T05:31:56.308969] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-17T05:31:56.309052] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-17T05:31:56.309119] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-17T05:31:56.309192] [INFO ] [MAIN ] Update Progress: 1559/2369 symbols completed. NXDR took 23.1s. Estimated remaining: 1h 58m 22s. Rate: 6.8 symbols/min [2025-09-17T05:31:56.373324] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T05:31:56.690150] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-17T05:31:57.310817] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T05:31:57.311990] [INFO ] [REMOTE ] NXC: Full fetch complete (6010 records). [2025-09-17T05:31:57.312078] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-17T05:31:57.691062] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-17T05:31:57.691289] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-17T05:31:57.691505] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-17T05:31:57.691558] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-17T05:31:57.692277] [DEBUG] [LOCAL ] NXC: Trimmed 6010 records to 4142 (keeping 200 days of data) [2025-09-17T05:31:57.720067] [DEBUG] [LOCAL ] NXC: Primary data saved (4142 records). [2025-09-17T05:31:57.720270] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-17T05:31:57.720380] [INFO ] [MAIN ] Update Progress: 1560/2369 symbols completed. NXC took 35.2s. Estimated remaining: 1h 58m 10s. Rate: 6.8 symbols/min [2025-09-17T05:31:58.354820] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:31:58.431365] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:31:58.462906] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:31:58.512318] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:31:58.531118] [DEBUG] [LOCAL ] NXG: Loaded 7436 existing records from primary storage. [2025-09-17T05:31:58.531536] [INFO ] [MAIN ] NXG: Loaded 7436 existing records. [2025-09-17T05:31:58.588450] [DEBUG] [LOCAL ] NXDT: Loaded 10785 existing records from primary storage. [2025-09-17T05:31:58.621876] [DEBUG] [LOCAL ] NXJ: Loaded 11778 existing records from primary storage. [2025-09-17T05:31:58.627163] [INFO ] [MAIN ] NXDT: Loaded 10785 existing records. [2025-09-17T05:31:58.660479] [INFO ] [MAIN ] NXJ: Loaded 11778 existing records. [2025-09-17T05:31:58.975265] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:31:58.950804] [DEBUG] [LOCAL ] NXE: Loaded 39497 existing records from primary storage. [2025-09-17T05:31:59.129114] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:31:59.089537] [INFO ] [MAIN ] NXE: Loaded 39497 existing records. [2025-09-17T05:31:59.135127] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:31:59.120942] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-17T05:31:59.136003] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-17T05:31:59.171232] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-17T05:31:59.171097] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-17T05:31:59.217590] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-17T05:31:59.217690] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-17T05:31:59.232224] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-17T05:31:59.244280] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-17T05:31:59.255579] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-17T05:31:59.260992] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-17T05:31:59.266180] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-17T05:31:59.361761] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-17T05:31:59.372489] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:31:59.527628] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-17T05:31:59.633215] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-17T05:31:59.703307] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-17T05:31:59.799531] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-17T05:32:00.550493] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:32:00.627698] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-11. [2025-09-17T05:32:00.625878] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:32:00.604738] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:32:00.641495] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-11. [2025-09-17T05:32:00.655612] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-11. [2025-09-17T05:32:00.812392] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:32:00.812746] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-11. [2025-09-17T05:32:01.396517] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T05:32:01.398630] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-09-17T05:32:01.612249] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T05:32:01.617066] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-09-17T05:32:01.676530] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T05:32:02.212474] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T05:32:02.270389] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T05:32:02.290140] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-09-17T05:32:02.350901] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T05:32:03.014469] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T05:32:03.090170] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-17T05:32:03.782091] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T05:32:03.890133] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-17T05:32:04.623989] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T05:32:04.690119] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-17T05:32:05.490154] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-09-17T05:32:05.505502] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T05:32:06.290144] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-17T05:32:07.090108] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-09-17T05:32:07.127403] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T05:32:07.199560] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T05:32:07.890093] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-17T05:32:08.149147] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T05:32:08.690170] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-17T05:32:08.839514] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T05:32:09.490185] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-17T05:32:09.578921] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T05:32:10.290140] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-09-17T05:32:10.391003] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T05:32:11.090144] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-09-17T05:32:11.890153] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-17T05:32:11.941766] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T05:32:11.986994] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T05:32:12.690156] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-17T05:32:12.855353] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T05:32:13.490197] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-17T05:32:13.722851] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T05:32:14.290206] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-17T05:32:15.090123] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-17T05:32:15.163236] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T05:32:15.370361] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T05:32:15.890160] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-17T05:32:16.167505] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T05:32:16.690172] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-17T05:32:17.490174] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-17T05:32:17.747019] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T05:32:17.843441] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T05:32:18.049446] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T05:32:18.290143] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-17T05:32:19.072135] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T05:32:19.090099] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-17T05:32:19.890121] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-17T05:32:20.690162] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-17T05:32:20.884252] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T05:32:20.942687] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T05:32:21.490150] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-17T05:32:21.679703] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T05:32:21.682133] [INFO ] [REMOTE ] NXJ: Full fetch complete (21252 records). [2025-09-17T05:32:21.682291] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-17T05:32:22.062050] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-17T05:32:22.062194] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-17T05:32:22.062921] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-17T05:32:22.063019] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-17T05:32:22.063984] [DEBUG] [LOCAL ] NXJ: Trimmed 21252 records to 14746 (keeping 200 days of data) [2025-09-17T05:32:22.175177] [DEBUG] [LOCAL ] NXJ: Primary data saved (14746 records). [2025-09-17T05:32:22.175386] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-17T05:32:22.175521] [INFO ] [MAIN ] Update Progress: 1561/2369 symbols completed. NXJ took 24.4s. Estimated remaining: 1h 58m 9s. Rate: 6.8 symbols/min [2025-09-17T05:32:22.295052] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-17T05:32:22.341134] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T05:32:22.376445] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:32:22.380504] [DEBUG] [LOCAL ] NXN: Loaded 1750 existing records from primary storage. [2025-09-17T05:32:22.380625] [INFO ] [MAIN ] NXN: Loaded 1750 existing records. [2025-09-17T05:32:22.556324] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:32:22.556582] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-17T05:32:22.556667] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-17T05:32:22.556898] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-17T05:32:22.556968] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-17T05:32:22.910995] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:32:23.090127] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-11. [2025-09-17T05:32:23.172187] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T05:32:23.541004] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T05:32:23.890146] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-09-17T05:32:24.465405] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T05:32:24.690188] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-17T05:32:25.395243] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T05:32:25.490217] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-17T05:32:25.960893] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T05:32:26.290155] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-17T05:32:27.090177] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-17T05:32:27.890179] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-17T05:32:27.935616] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T05:32:28.060221] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T05:32:28.382953] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T05:32:28.690178] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-17T05:32:29.490181] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-17T05:32:29.686568] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T05:32:30.290153] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-17T05:32:30.320448] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T05:32:30.599241] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-17T05:32:31.090146] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-17T05:32:31.687088] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T05:32:31.890166] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-17T05:32:32.690139] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-17T05:32:32.787618] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T05:32:33.490117] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-17T05:32:33.665229] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T05:32:33.667499] [INFO ] [REMOTE ] NXDT: Full fetch complete (25828 records). [2025-09-17T05:32:33.667608] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-17T05:32:34.033904] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-17T05:32:34.034014] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-17T05:32:34.034606] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-17T05:32:34.034719] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-17T05:32:34.035397] [DEBUG] [LOCAL ] NXDT: Trimmed 25828 records to 16606 (keeping 200 days of data) [2025-09-17T05:32:34.141152] [DEBUG] [LOCAL ] NXDT: Primary data saved (16606 records). [2025-09-17T05:32:34.141404] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-17T05:32:34.141568] [INFO ] [MAIN ] Update Progress: 1562/2369 symbols completed. NXDT took 36.4s. Estimated remaining: 1h 58m 2s. Rate: 6.8 symbols/min [2025-09-17T05:32:34.309201] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-17T05:32:34.313006] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:32:34.327057] [DEBUG] [LOCAL ] NXP: Loaded 9142 existing records from primary storage. [2025-09-17T05:32:34.327267] [INFO ] [MAIN ] NXP: Loaded 9142 existing records. [2025-09-17T05:32:34.503094] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:32:34.503363] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-17T05:32:34.503422] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-17T05:32:34.503845] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-17T05:32:34.503914] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-17T05:32:34.859798] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:32:34.862604] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T05:32:35.090079] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-17T05:32:35.203031] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T05:32:35.666700] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T05:32:35.890196] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-11. [2025-09-17T05:32:36.652283] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T05:32:36.690138] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-09-17T05:32:37.490138] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-17T05:32:37.513422] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T05:32:38.290164] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-17T05:32:38.337733] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T05:32:38.339718] [INFO ] [REMOTE ] NXG: Full fetch complete (14374 records). [2025-09-17T05:32:38.339821] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-17T05:32:38.710941] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-17T05:32:38.711059] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-17T05:32:38.711515] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-17T05:32:38.711603] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-17T05:32:38.712291] [DEBUG] [LOCAL ] NXG: Trimmed 14374 records to 10581 (keeping 200 days of data) [2025-09-17T05:32:38.784110] [DEBUG] [LOCAL ] NXG: Primary data saved (10581 records). [2025-09-17T05:32:38.784285] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-17T05:32:38.784397] [INFO ] [MAIN ] Update Progress: 1563/2369 symbols completed. NXG took 41.1s. Estimated remaining: 1h 57m 51s. Rate: 6.8 symbols/min [2025-09-17T05:32:38.908092] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T05:32:38.965682] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:32:38.981696] [DEBUG] [LOCAL ] NXRT: Loaded 13690 existing records from primary storage. [2025-09-17T05:32:38.981848] [INFO ] [MAIN ] NXRT: Loaded 13690 existing records. [2025-09-17T05:32:39.095184] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-17T05:32:39.159206] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:32:39.159429] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-17T05:32:39.159493] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-17T05:32:39.160084] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-17T05:32:39.160158] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-17T05:32:39.513311] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:32:39.613573] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T05:32:39.890136] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-17T05:32:40.364599] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T05:32:40.690196] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-17T05:32:41.446336] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T05:32:41.490088] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-17T05:32:42.290183] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-17T05:32:42.802871] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T05:32:42.804157] [INFO ] [REMOTE ] NXN: Full fetch complete (3697 records). [2025-09-17T05:32:42.804243] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-17T05:32:43.095247] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-17T05:32:43.171287] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-17T05:32:43.171480] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-17T05:32:43.171716] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-17T05:32:43.171783] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-17T05:32:43.172273] [DEBUG] [LOCAL ] NXN: Trimmed 3697 records to 2339 (keeping 200 days of data) [2025-09-17T05:32:43.187917] [DEBUG] [LOCAL ] NXN: Primary data saved (2339 records). [2025-09-17T05:32:43.188074] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-17T05:32:43.188168] [INFO ] [MAIN ] Update Progress: 1564/2369 symbols completed. NXN took 21.0s. Estimated remaining: 1h 57m 40s. Rate: 6.8 symbols/min [2025-09-17T05:32:43.357742] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:32:43.357968] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-17T05:32:43.369992] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-17T05:32:43.390350] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-17T05:32:43.392143] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T05:32:43.392211] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-17T05:32:43.403566] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-17T05:32:43.403790] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-17T05:32:43.766969] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:32:43.890130] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-11. [2025-09-17T05:32:43.942945] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T05:32:44.690144] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-11. [2025-09-17T05:32:44.757661] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T05:32:45.020548] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T05:32:45.490148] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-17T05:32:45.904314] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-17T05:32:46.290136] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-17T05:32:46.763706] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T05:32:47.090139] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-17T05:32:47.515385] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T05:32:47.890140] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-17T05:32:48.690115] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-09-17T05:32:48.878951] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T05:32:49.490199] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-17T05:32:49.504568] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T05:32:50.252441] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T05:32:50.290092] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-17T05:32:51.063830] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T05:32:51.090103] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-17T05:32:51.890141] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-17T05:32:52.313685] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T05:32:52.690120] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-09-17T05:32:52.730289] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T05:32:53.490145] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-17T05:32:53.613023] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T05:32:54.290184] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-17T05:32:55.090158] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-17T05:32:55.183846] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T05:32:55.407087] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-17T05:32:55.408517] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T05:32:55.416457] [INFO ] [REMOTE ] NXE: Full fetch complete (76476 records). [2025-09-17T05:32:55.416600] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-17T05:32:55.804842] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-17T05:32:55.804962] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-17T05:32:55.806092] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-17T05:32:55.806151] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-17T05:32:55.808177] [DEBUG] [LOCAL ] NXE: Trimmed 76476 records to 52978 (keeping 200 days of data) [2025-09-17T05:32:55.893922] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-17T05:32:56.121006] [DEBUG] [LOCAL ] NXE: Primary data saved (52978 records). [2025-09-17T05:32:56.121196] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-17T05:32:56.121312] [INFO ] [MAIN ] Update Progress: 1565/2369 symbols completed. NXE took 58.4s. Estimated remaining: 1h 57m 33s. Rate: 6.8 symbols/min [2025-09-17T05:32:56.254743] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-17T05:32:56.297206] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:32:56.336004] [DEBUG] [LOCAL ] NYT: Loaded 37131 existing records from primary storage. [2025-09-17T05:32:56.336230] [INFO ] [MAIN ] NYT: Loaded 37131 existing records. [2025-09-17T05:32:56.517259] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:32:56.517570] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-17T05:32:56.517631] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-17T05:32:56.518796] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-17T05:32:56.518875] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-17T05:32:56.694783] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-17T05:32:56.877896] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:32:57.147299] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T05:32:57.490132] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-17T05:32:58.290130] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-17T05:32:58.409024] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T05:32:58.632025] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-17T05:32:59.090152] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-17T05:32:59.890184] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-17T05:32:59.903724] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T05:33:00.690148] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-17T05:33:00.942911] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T05:33:01.025451] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-17T05:33:01.490176] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-17T05:33:02.290154] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-17T05:33:02.854824] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T05:33:02.855749] [INFO ] [REMOTE ] NYC: Full fetch complete (1840 records). [2025-09-17T05:33:02.855833] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-17T05:33:03.044439] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-17T05:33:03.044719] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:33:03.044797] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:33:03.044847] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-17T05:33:03.044926] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-17T05:33:03.044983] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-17T05:33:03.045045] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-17T05:33:03.045113] [INFO ] [MAIN ] Update Progress: 1566/2369 symbols completed. NYC took 19.9s. Estimated remaining: 1h 57m 24s. Rate: 6.8 symbols/min [2025-09-17T05:33:03.101350] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-11. [2025-09-17T05:33:03.224015] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:33:03.249224] [DEBUG] [LOCAL ] NZF: Loaded 21331 existing records from primary storage. [2025-09-17T05:33:03.249471] [INFO ] [MAIN ] NZF: Loaded 21331 existing records. [2025-09-17T05:33:03.430659] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:33:03.430944] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-17T05:33:03.431055] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-17T05:33:03.431814] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-17T05:33:03.431875] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-17T05:33:03.785212] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:33:03.890107] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-11. [2025-09-17T05:33:04.690147] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-17T05:33:05.000482] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-17T05:33:05.002967] [INFO ] [REMOTE ] NXP: Full fetch complete (16811 records). [2025-09-17T05:33:05.003058] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-17T05:33:05.378818] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-17T05:33:05.378949] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-17T05:33:05.379440] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-17T05:33:05.379495] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-17T05:33:05.380124] [DEBUG] [LOCAL ] NXP: Trimmed 16811 records to 12194 (keeping 200 days of data) [2025-09-17T05:33:05.457834] [DEBUG] [LOCAL ] NXP: Primary data saved (12194 records). [2025-09-17T05:33:05.458031] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-17T05:33:05.458152] [INFO ] [MAIN ] Update Progress: 1567/2369 symbols completed. NXP took 31.3s. Estimated remaining: 1h 57m 12s. Rate: 6.8 symbols/min [2025-09-17T05:33:05.672262] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:33:05.672964] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-17T05:33:05.673383] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-17T05:33:05.674017] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-17T05:33:05.674119] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-17T05:33:05.674424] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-17T05:33:05.674516] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-17T05:33:05.823717] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T05:33:05.859448] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-09-17T05:33:05.959176] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T05:33:06.072718] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-11 (2.97 seconds). [2025-09-17T05:33:06.145842] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:33:06.290152] [INFO ] [REMOTE ] O: Fetching primary data for 2024-11. [2025-09-17T05:33:07.090205] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-17T05:33:07.479426] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T05:33:07.890167] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-09-17T05:33:08.147812] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T05:33:08.690223] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-09-17T05:33:08.836179] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-11 (2.55 seconds). [2025-09-17T05:33:08.864271] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T05:33:09.490142] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-17T05:33:10.290190] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-17T05:33:10.403218] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T05:33:10.757975] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T05:33:11.090191] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-17T05:33:11.890150] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-17T05:33:12.330672] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T05:33:12.493911] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-17T05:33:12.549684] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T05:33:12.690167] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-17T05:33:13.490142] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-17T05:33:14.076918] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T05:33:14.290178] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-17T05:33:14.559373] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T05:33:15.090178] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-17T05:33:15.890119] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-09-17T05:33:16.221857] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T05:33:16.682943] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.39 seconds). [2025-09-17T05:33:16.693017] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-17T05:33:17.490153] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-17T05:33:18.290195] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-17T05:33:18.321538] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T05:33:18.376383] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-17T05:33:19.090208] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-17T05:33:19.679468] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T05:33:19.890144] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-17T05:33:20.578388] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (3.09 seconds). [2025-09-17T05:33:20.690089] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-17T05:33:20.803734] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T05:33:20.950347] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T05:33:20.953017] [INFO ] [REMOTE ] NXRT: Full fetch complete (24761 records). [2025-09-17T05:33:20.953110] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-17T05:33:21.327933] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-17T05:33:21.328043] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-17T05:33:21.328619] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-17T05:33:21.328704] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-17T05:33:21.329779] [DEBUG] [LOCAL ] NXRT: Trimmed 24761 records to 18844 (keeping 200 days of data) [2025-09-17T05:33:21.460779] [DEBUG] [LOCAL ] NXRT: Primary data saved (18844 records). [2025-09-17T05:33:21.461087] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-17T05:33:21.461241] [INFO ] [MAIN ] Update Progress: 1568/2369 symbols completed. NXRT took 42.7s. Estimated remaining: 1h 57m 6s. Rate: 6.8 symbols/min [2025-09-17T05:33:21.495242] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-17T05:33:21.643202] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:33:21.685953] [DEBUG] [LOCAL ] OBDC: Loaded 38178 existing records from primary storage. [2025-09-17T05:33:21.686149] [INFO ] [MAIN ] OBDC: Loaded 38178 existing records. [2025-09-17T05:33:21.870839] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:33:21.871159] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-17T05:33:21.871220] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-17T05:33:21.872093] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-17T05:33:21.872157] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-17T05:33:22.267923] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:33:22.269408] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T05:33:22.290072] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-17T05:33:23.090124] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-11. [2025-09-17T05:33:23.513362] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T05:33:23.890151] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-17T05:33:24.091266] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-09-17T05:33:24.322180] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T05:33:24.690202] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-17T05:33:25.490189] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-09-17T05:33:25.614326] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T05:33:26.059779] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T05:33:26.063851] [INFO ] [REMOTE ] NZF: Full fetch complete (43850 records). [2025-09-17T05:33:26.063977] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-17T05:33:26.295253] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-17T05:33:26.459350] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-17T05:33:26.459497] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-17T05:33:26.460413] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-17T05:33:26.460471] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-17T05:33:26.461478] [DEBUG] [LOCAL ] NZF: Trimmed 43850 records to 29303 (keeping 200 days of data) [2025-09-17T05:33:26.649322] [DEBUG] [LOCAL ] NZF: Primary data saved (29303 records). [2025-09-17T05:33:26.649503] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-17T05:33:26.649614] [INFO ] [MAIN ] Update Progress: 1569/2369 symbols completed. NZF took 23.6s. Estimated remaining: 1h 56m 56s. Rate: 6.8 symbols/min [2025-09-17T05:33:26.828940] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:33:26.844553] [DEBUG] [LOCAL ] OBK: Loaded 11883 existing records from primary storage. [2025-09-17T05:33:26.844836] [INFO ] [MAIN ] OBK: Loaded 11883 existing records. [2025-09-17T05:33:27.037955] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:33:27.038266] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-17T05:33:27.038323] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-17T05:33:27.039124] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-17T05:33:27.039196] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-17T05:33:27.098240] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-17T05:33:27.418706] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:33:27.449932] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T05:33:27.735839] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T05:33:27.890162] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-09-17T05:33:28.690192] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-11. [2025-09-17T05:33:29.481748] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T05:33:29.490075] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-09-17T05:33:29.653379] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T05:33:29.740267] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-17T05:33:30.290128] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-17T05:33:30.599988] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T05:33:31.090190] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-17T05:33:31.890324] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-17T05:33:32.392334] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T05:33:32.690154] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-09-17T05:33:33.283733] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T05:33:33.490147] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-17T05:33:33.577704] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-17T05:33:33.714437] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T05:33:34.290146] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-17T05:33:35.095275] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-17T05:33:35.118830] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T05:33:35.890165] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-17T05:33:36.145807] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T05:33:36.517980] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T05:33:36.690155] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-17T05:33:37.500336] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-17T05:33:37.503587] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-17T05:33:38.290181] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-17T05:33:38.529899] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T05:33:38.705595] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T05:33:39.090144] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-17T05:33:39.890201] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-17T05:33:40.690181] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-17T05:33:40.796402] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-17T05:33:40.840686] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T05:33:41.490158] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-17T05:33:41.652806] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T05:33:41.673811] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T05:33:42.290191] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-17T05:33:43.090203] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-17T05:33:43.890216] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-17T05:33:44.043370] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-17T05:33:44.096138] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T05:33:44.118791] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T05:33:44.690187] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-17T05:33:45.490157] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-17T05:33:45.545865] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T05:33:45.551849] [INFO ] [REMOTE ] NYT: Full fetch complete (71969 records). [2025-09-17T05:33:45.552005] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-17T05:33:45.805898] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T05:33:45.977421] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-17T05:33:45.977602] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-17T05:33:45.979550] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-17T05:33:45.979670] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-17T05:33:45.981891] [DEBUG] [LOCAL ] NYT: Trimmed 71969 records to 50091 (keeping 200 days of data) [2025-09-17T05:33:46.292958] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-17T05:33:46.332606] [DEBUG] [LOCAL ] NYT: Primary data saved (50091 records). [2025-09-17T05:33:46.332805] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-17T05:33:46.332935] [INFO ] [MAIN ] Update Progress: 1570/2369 symbols completed. NYT took 50.2s. Estimated remaining: 1h 56m 53s. Rate: 6.8 symbols/min [2025-09-17T05:33:46.501101] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:33:46.537523] [DEBUG] [LOCAL ] OC: Loaded 32752 existing records from primary storage. [2025-09-17T05:33:46.537741] [INFO ] [MAIN ] OC: Loaded 32752 existing records. [2025-09-17T05:33:46.719613] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:33:46.719970] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-17T05:33:46.720039] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-17T05:33:46.721261] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-17T05:33:46.721342] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-17T05:33:47.093694] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-17T05:33:47.097123] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:33:47.623403] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-17T05:33:47.630873] [INFO ] [REMOTE ] O: Full fetch complete (77534 records). [2025-09-17T05:33:47.631039] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-17T05:33:47.836808] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T05:33:47.837837] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T05:33:47.841232] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:33:47.845371] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:33:47.845589] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-17T05:33:47.845710] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-17T05:33:47.846104] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-17T05:33:47.846184] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-17T05:33:47.846284] [INFO ] [MAIN ] Update Progress: 1571/2369 symbols completed. O took 42.4s. Estimated remaining: 1h 56m 40s. Rate: 6.8 symbols/min [2025-09-17T05:33:47.901100] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-17T05:33:48.026415] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:33:48.034812] [DEBUG] [LOCAL ] OCFT: Loaded 5772 existing records from primary storage. [2025-09-17T05:33:48.035002] [INFO ] [MAIN ] OCFT: Loaded 5772 existing records. [2025-09-17T05:33:48.219386] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:33:48.252093] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-17T05:33:48.255702] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-17T05:33:48.256030] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-17T05:33:48.256119] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-17T05:33:48.263593] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T05:33:48.635181] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:33:48.690143] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-11. [2025-09-17T05:33:48.948336] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T05:33:49.294089] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T05:33:49.490189] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-11. [2025-09-17T05:33:50.290176] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-17T05:33:51.024842] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T05:33:51.090160] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-17T05:33:51.298401] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T05:33:51.890182] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-09-17T05:33:52.690159] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-09-17T05:33:52.959237] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T05:33:53.231222] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T05:33:53.501352] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-17T05:33:53.504837] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T05:33:54.290309] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-17T05:33:54.582901] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T05:33:54.585789] [INFO ] [REMOTE ] OBK: Full fetch complete (23852 records). [2025-09-17T05:33:54.585919] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-17T05:33:54.998776] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-17T05:33:54.998971] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-17T05:33:54.999792] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-17T05:33:54.999858] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-17T05:33:55.001019] [DEBUG] [LOCAL ] OBK: Trimmed 23852 records to 16147 (keeping 200 days of data) [2025-09-17T05:33:55.097720] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-17T05:33:55.112395] [DEBUG] [LOCAL ] OBK: Primary data saved (16147 records). [2025-09-17T05:33:55.112706] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-17T05:33:55.112837] [INFO ] [MAIN ] Update Progress: 1572/2369 symbols completed. OBK took 28.5s. Estimated remaining: 1h 56m 31s. Rate: 6.8 symbols/min [2025-09-17T05:33:55.285501] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:33:55.294335] [DEBUG] [LOCAL ] ODC: Loaded 6472 existing records from primary storage. [2025-09-17T05:33:55.294489] [INFO ] [MAIN ] ODC: Loaded 6472 existing records. [2025-09-17T05:33:55.470418] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:33:55.470724] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-17T05:33:55.470784] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-17T05:33:55.471152] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-17T05:33:55.471209] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-17T05:33:55.826843] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:33:55.892389] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-17T05:33:55.895542] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T05:33:56.474776] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T05:33:56.690150] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-11. [2025-09-17T05:33:56.734579] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T05:33:56.741236] [INFO ] [REMOTE ] OBDC: Full fetch complete (74644 records). [2025-09-17T05:33:56.741455] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-17T05:33:57.153559] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-17T05:33:57.153720] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-17T05:33:57.155003] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-17T05:33:57.155086] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-17T05:33:57.156912] [DEBUG] [LOCAL ] OBDC: Trimmed 74644 records to 51637 (keeping 200 days of data) [2025-09-17T05:33:57.355891] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T05:33:57.491830] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-09-17T05:33:57.495223] [DEBUG] [LOCAL ] OBDC: Primary data saved (51637 records). [2025-09-17T05:33:57.496454] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-17T05:33:57.496586] [INFO ] [MAIN ] Update Progress: 1573/2369 symbols completed. OBDC took 36.0s. Estimated remaining: 1h 56m 19s. Rate: 6.8 symbols/min [2025-09-17T05:33:57.668859] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:33:57.689120] [DEBUG] [LOCAL ] ODV: Loaded 20103 existing records from primary storage. [2025-09-17T05:33:57.689311] [INFO ] [MAIN ] ODV: Loaded 20103 existing records. [2025-09-17T05:33:57.870847] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:33:57.871168] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-17T05:33:57.871228] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-17T05:33:57.871829] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-17T05:33:57.871892] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-17T05:33:58.255796] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:33:58.288280] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T05:33:58.290362] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-09-17T05:33:58.854191] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T05:33:59.090129] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-11. [2025-09-17T05:33:59.890167] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-17T05:34:00.102553] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T05:34:00.690148] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-09-17T05:34:01.490140] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-17T05:34:01.536581] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T05:34:01.736213] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T05:34:01.982397] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T05:34:02.290168] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-17T05:34:03.090134] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-17T05:34:03.417029] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T05:34:03.890162] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-09-17T05:34:04.690118] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-17T05:34:04.725122] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T05:34:04.742160] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T05:34:05.429703] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T05:34:05.490173] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-17T05:34:06.135317] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T05:34:06.290175] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-17T05:34:07.090149] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-17T05:34:07.688227] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T05:34:07.890212] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-17T05:34:08.009894] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T05:34:08.605661] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T05:34:08.690193] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-17T05:34:09.479106] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T05:34:09.490119] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-17T05:34:10.261069] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T05:34:10.290073] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-17T05:34:11.090242] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-17T05:34:11.137786] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T05:34:11.890164] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-17T05:34:12.539365] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T05:34:12.667375] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T05:34:12.690085] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-17T05:34:13.490155] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-17T05:34:14.290175] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-17T05:34:14.314548] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T05:34:14.350070] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T05:34:14.931366] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T05:34:14.932694] [INFO ] [REMOTE ] OCFT: Full fetch complete (11669 records). [2025-09-17T05:34:14.932797] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-17T05:34:15.099085] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-17T05:34:15.316293] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-17T05:34:15.316452] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-17T05:34:15.317079] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-17T05:34:15.317152] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-17T05:34:15.317732] [DEBUG] [LOCAL ] OCFT: Trimmed 11669 records to 9725 (keeping 200 days of data) [2025-09-17T05:34:15.378826] [DEBUG] [LOCAL ] OCFT: Primary data saved (9725 records). [2025-09-17T05:34:15.379055] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-17T05:34:15.379192] [INFO ] [MAIN ] Update Progress: 1574/2369 symbols completed. OCFT took 27.5s. Estimated remaining: 1h 56m 14s. Rate: 6.8 symbols/min [2025-09-17T05:34:15.563875] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:34:15.597668] [DEBUG] [LOCAL ] OEC: Loaded 27552 existing records from primary storage. [2025-09-17T05:34:15.597886] [INFO ] [MAIN ] OEC: Loaded 27552 existing records. [2025-09-17T05:34:15.789674] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:34:15.789997] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-17T05:34:15.790056] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-17T05:34:15.790849] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-17T05:34:15.790912] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-17T05:34:15.891695] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-17T05:34:15.983782] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T05:34:16.168575] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:34:16.690175] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-17T05:34:17.490175] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-11. [2025-09-17T05:34:17.532337] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T05:34:17.784013] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T05:34:18.290198] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-17T05:34:18.934413] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T05:34:19.090116] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-09-17T05:34:19.740247] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T05:34:19.890148] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-17T05:34:20.468832] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T05:34:20.690176] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-17T05:34:20.866746] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T05:34:21.240136] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T05:34:21.490160] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-09-17T05:34:22.290156] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-17T05:34:22.838081] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T05:34:23.070010] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T05:34:23.090117] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-17T05:34:23.648190] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T05:34:23.890166] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-17T05:34:24.690183] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-17T05:34:25.490128] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-17T05:34:25.526537] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T05:34:25.532298] [INFO ] [REMOTE ] OC: Full fetch complete (63803 records). [2025-09-17T05:34:25.532466] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-17T05:34:25.923388] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-17T05:34:25.923678] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-17T05:34:25.925323] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-17T05:34:25.925464] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-17T05:34:25.927266] [DEBUG] [LOCAL ] OC: Trimmed 63803 records to 44862 (keeping 200 days of data) [2025-09-17T05:34:26.049573] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T05:34:26.258150] [DEBUG] [LOCAL ] OC: Primary data saved (44862 records). [2025-09-17T05:34:26.258399] [INFO ] [MAIN ] OC: Full history saved. [2025-09-17T05:34:26.258547] [INFO ] [MAIN ] Update Progress: 1575/2369 symbols completed. OC took 39.9s. Estimated remaining: 1h 56m 7s. Rate: 6.8 symbols/min [2025-09-17T05:34:26.295288] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-17T05:34:26.446100] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:34:26.447983] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T05:34:26.470313] [DEBUG] [LOCAL ] OFG: Loaded 15322 existing records from primary storage. [2025-09-17T05:34:26.470507] [INFO ] [MAIN ] OFG: Loaded 15322 existing records. [2025-09-17T05:34:26.657535] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:34:26.657884] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-17T05:34:26.657949] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-17T05:34:26.658627] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-17T05:34:26.658729] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-17T05:34:27.022105] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:34:27.090099] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-11. [2025-09-17T05:34:27.446462] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T05:34:27.890107] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-17T05:34:28.215864] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T05:34:28.690175] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-17T05:34:29.278779] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T05:34:29.280609] [INFO ] [REMOTE ] ODC: Full fetch complete (10733 records). [2025-09-17T05:34:29.280760] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-17T05:34:29.496340] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-17T05:34:29.678308] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-17T05:34:29.699934] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-17T05:34:29.703093] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-17T05:34:29.703394] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-17T05:34:29.705502] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T05:34:29.706737] [DEBUG] [LOCAL ] ODC: Trimmed 10733 records to 8458 (keeping 200 days of data) [2025-09-17T05:34:29.775624] [DEBUG] [LOCAL ] ODC: Primary data saved (8458 records). [2025-09-17T05:34:29.775875] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-17T05:34:29.776010] [INFO ] [MAIN ] Update Progress: 1576/2369 symbols completed. ODC took 34.7s. Estimated remaining: 1h 55m 55s. Rate: 6.8 symbols/min [2025-09-17T05:34:29.951481] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:34:29.986710] [DEBUG] [LOCAL ] OGE: Loaded 34385 existing records from primary storage. [2025-09-17T05:34:29.986938] [INFO ] [MAIN ] OGE: Loaded 34385 existing records. [2025-09-17T05:34:30.171880] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:34:30.172233] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-17T05:34:30.172300] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-17T05:34:30.173435] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-17T05:34:30.173562] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-17T05:34:30.295300] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-17T05:34:30.561994] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:34:30.751403] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T05:34:31.090210] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-09-17T05:34:31.895330] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-11. [2025-09-17T05:34:31.911211] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T05:34:32.227185] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T05:34:32.690191] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-17T05:34:33.495290] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-17T05:34:33.511750] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T05:34:34.074773] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T05:34:34.290166] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-09-17T05:34:34.713230] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T05:34:35.090154] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-09-17T05:34:35.890880] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-17T05:34:35.896904] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T05:34:36.348599] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T05:34:36.690148] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-09-17T05:34:37.083038] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T05:34:37.088219] [INFO ] [REMOTE ] ODV: Full fetch complete (30797 records). [2025-09-17T05:34:37.088342] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-17T05:34:37.460892] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-17T05:34:37.461013] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-17T05:34:37.461713] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-17T05:34:37.461771] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-17T05:34:37.462575] [DEBUG] [LOCAL ] ODV: Trimmed 30797 records to 24721 (keeping 200 days of data) [2025-09-17T05:34:37.513747] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-17T05:34:37.612543] [DEBUG] [LOCAL ] ODV: Primary data saved (24721 records). [2025-09-17T05:34:37.612787] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-17T05:34:37.612920] [INFO ] [MAIN ] Update Progress: 1577/2369 symbols completed. ODV took 40.1s. Estimated remaining: 1h 55m 46s. Rate: 6.8 symbols/min [2025-09-17T05:34:37.784576] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:34:37.826879] [DEBUG] [LOCAL ] OGN: Loaded 39602 existing records from primary storage. [2025-09-17T05:34:37.827102] [INFO ] [MAIN ] OGN: Loaded 39602 existing records. [2025-09-17T05:34:38.003250] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:34:38.003563] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-17T05:34:38.003626] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-17T05:34:38.004952] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-17T05:34:38.005018] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-17T05:34:38.292872] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-17T05:34:38.378558] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:34:38.408966] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T05:34:38.788751] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T05:34:39.090175] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-11. [2025-09-17T05:34:39.708593] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T05:34:39.890146] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-17T05:34:40.690199] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-17T05:34:40.775312] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T05:34:41.238913] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T05:34:41.490143] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-17T05:34:41.833311] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T05:34:42.290118] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-09-17T05:34:42.769671] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T05:34:43.090134] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-17T05:34:43.890205] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-17T05:34:43.985302] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T05:34:44.350071] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T05:34:44.690139] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-09-17T05:34:45.490137] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-17T05:34:45.599522] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T05:34:46.290162] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-17T05:34:46.446210] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T05:34:46.539516] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T05:34:47.090214] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-17T05:34:47.313248] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T05:34:47.890154] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-17T05:34:48.349682] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T05:34:48.690320] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-17T05:34:48.919626] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T05:34:49.490181] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-17T05:34:50.293061] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-17T05:34:50.300539] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T05:34:50.773344] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T05:34:50.778250] [INFO ] [REMOTE ] OEC: Full fetch complete (52458 records). [2025-09-17T05:34:50.778407] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-17T05:34:51.095214] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-17T05:34:51.167857] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-17T05:34:51.167971] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-17T05:34:51.168866] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-17T05:34:51.168946] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-17T05:34:51.170152] [DEBUG] [LOCAL ] OEC: Trimmed 52458 records to 37497 (keeping 200 days of data) [2025-09-17T05:34:51.405983] [DEBUG] [LOCAL ] OEC: Primary data saved (37497 records). [2025-09-17T05:34:51.406196] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-17T05:34:51.406334] [INFO ] [MAIN ] Update Progress: 1578/2369 symbols completed. OEC took 36.0s. Estimated remaining: 1h 55m 40s. Rate: 6.8 symbols/min [2025-09-17T05:34:51.577350] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:34:51.603084] [DEBUG] [LOCAL ] OGS: Loaded 25928 existing records from primary storage. [2025-09-17T05:34:51.603284] [INFO ] [MAIN ] OGS: Loaded 25928 existing records. [2025-09-17T05:34:51.781732] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:34:51.781997] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-17T05:34:51.782070] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-17T05:34:51.782812] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-17T05:34:51.782894] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-17T05:34:51.890384] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-17T05:34:52.159454] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:34:52.190092] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T05:34:52.214403] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T05:34:52.690146] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-17T05:34:53.500965] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-17T05:34:53.509155] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T05:34:53.563875] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T05:34:54.290193] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-11. [2025-09-17T05:34:55.027591] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T05:34:55.090624] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T05:34:55.090789] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-17T05:34:55.890139] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-09-17T05:34:56.700694] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-17T05:34:56.721634] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T05:34:57.193430] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T05:34:57.490143] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-17T05:34:58.290124] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-17T05:34:58.665026] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T05:34:58.952847] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T05:34:58.956100] [INFO ] [REMOTE ] OFG: Full fetch complete (34485 records). [2025-09-17T05:34:58.971589] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-17T05:34:59.049236] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T05:34:59.095520] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-09-17T05:34:59.374190] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-17T05:34:59.374308] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-17T05:34:59.375104] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-17T05:34:59.375177] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-17T05:34:59.376076] [DEBUG] [LOCAL ] OFG: Trimmed 34485 records to 22442 (keeping 200 days of data) [2025-09-17T05:34:59.514022] [DEBUG] [LOCAL ] OFG: Primary data saved (22442 records). [2025-09-17T05:34:59.514195] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-17T05:34:59.514307] [INFO ] [MAIN ] Update Progress: 1579/2369 symbols completed. OFG took 33.3s. Estimated remaining: 1h 55m 31s. Rate: 6.8 symbols/min [2025-09-17T05:34:59.691288] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:34:59.741252] [DEBUG] [LOCAL ] OHI: Loaded 38819 existing records from primary storage. [2025-09-17T05:34:59.741542] [INFO ] [MAIN ] OHI: Loaded 38819 existing records. [2025-09-17T05:34:59.895368] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-17T05:34:59.935944] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:34:59.936845] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-17T05:34:59.936933] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-17T05:34:59.937931] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-17T05:34:59.938011] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-17T05:35:00.300827] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:35:00.411995] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T05:35:00.690148] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-17T05:35:01.490150] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-17T05:35:02.023870] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T05:35:02.277871] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T05:35:02.283693] [INFO ] [REMOTE ] OGE: Full fetch complete (66593 records). [2025-09-17T05:35:02.283857] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-17T05:35:02.297584] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-17T05:35:02.692227] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-17T05:35:02.692382] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-17T05:35:02.693708] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-17T05:35:02.693776] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-17T05:35:02.695507] [DEBUG] [LOCAL ] OGE: Trimmed 66593 records to 46674 (keeping 200 days of data) [2025-09-17T05:35:02.943930] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T05:35:03.020569] [DEBUG] [LOCAL ] OGE: Primary data saved (46674 records). [2025-09-17T05:35:03.020773] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-17T05:35:03.020887] [INFO ] [MAIN ] Update Progress: 1580/2369 symbols completed. OGE took 33.2s. Estimated remaining: 1h 55m 19s. Rate: 6.8 symbols/min [2025-09-17T05:35:03.098072] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-17T05:35:03.201509] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:35:03.237230] [DEBUG] [LOCAL ] OI: Loaded 34975 existing records from primary storage. [2025-09-17T05:35:03.237442] [INFO ] [MAIN ] OI: Loaded 34975 existing records. [2025-09-17T05:35:03.413510] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:35:03.413806] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-17T05:35:03.413863] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-17T05:35:03.414708] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-17T05:35:03.414770] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-17T05:35:03.834141] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:35:03.890151] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-11. [2025-09-17T05:35:03.978927] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T05:35:04.477154] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T05:35:04.690256] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-11. [2025-09-17T05:35:05.491853] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-17T05:35:05.500053] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T05:35:05.969724] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T05:35:06.290187] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-09-17T05:35:07.090164] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-17T05:35:07.354442] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T05:35:07.599702] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T05:35:07.890162] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-09-17T05:35:08.460032] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T05:35:08.690199] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-09-17T05:35:09.490169] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-17T05:35:09.655758] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T05:35:10.292796] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T05:35:10.292978] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-17T05:35:11.090159] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-17T05:35:11.269070] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T05:35:11.738890] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T05:35:11.890133] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-17T05:35:12.690166] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-17T05:35:12.772410] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T05:35:13.295580] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T05:35:13.490170] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-17T05:35:14.168593] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T05:35:14.176885] [INFO ] [REMOTE ] OGN: Full fetch complete (76632 records). [2025-09-17T05:35:14.177063] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-17T05:35:14.295257] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-17T05:35:14.568765] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-17T05:35:14.568882] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-17T05:35:14.569979] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-17T05:35:14.570061] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-17T05:35:14.571584] [DEBUG] [LOCAL ] OGN: Trimmed 76632 records to 53131 (keeping 200 days of data) [2025-09-17T05:35:14.900386] [DEBUG] [LOCAL ] OGN: Primary data saved (53131 records). [2025-09-17T05:35:14.900772] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-17T05:35:14.900872] [INFO ] [MAIN ] Update Progress: 1581/2369 symbols completed. OGN took 37.3s. Estimated remaining: 1h 55m 12s. Rate: 6.8 symbols/min [2025-09-17T05:35:15.070000] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:35:15.092629] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-17T05:35:15.100148] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T05:35:15.113636] [DEBUG] [LOCAL ] OIA: Loaded 9965 existing records from primary storage. [2025-09-17T05:35:15.113780] [INFO ] [MAIN ] OIA: Loaded 9965 existing records. [2025-09-17T05:35:15.294512] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:35:15.294820] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-17T05:35:15.294881] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-17T05:35:15.295229] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-17T05:35:15.295296] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-17T05:35:15.651922] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:35:15.879427] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T05:35:15.890100] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-17T05:35:16.690157] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-11. [2025-09-17T05:35:16.982056] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T05:35:17.332014] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T05:35:17.398816] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T05:35:17.490079] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-17T05:35:18.290198] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-17T05:35:19.090216] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-09-17T05:35:19.178173] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T05:35:19.581636] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T05:35:19.645536] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T05:35:19.890145] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-17T05:35:20.690174] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-17T05:35:21.126537] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T05:35:21.131013] [INFO ] [REMOTE ] OGS: Full fetch complete (47695 records). [2025-09-17T05:35:21.131202] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-17T05:35:21.495369] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-17T05:35:21.596068] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-17T05:35:21.596216] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-17T05:35:21.597348] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-17T05:35:21.597415] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-17T05:35:21.599150] [DEBUG] [LOCAL ] OGS: Trimmed 47695 records to 33927 (keeping 200 days of data) [2025-09-17T05:35:21.820162] [DEBUG] [LOCAL ] OGS: Primary data saved (33927 records). [2025-09-17T05:35:21.820363] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-17T05:35:21.820463] [INFO ] [MAIN ] Update Progress: 1582/2369 symbols completed. OGS took 30.4s. Estimated remaining: 1h 55m 2s. Rate: 6.8 symbols/min [2025-09-17T05:35:21.993561] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:35:22.029063] [DEBUG] [LOCAL ] OII: Loaded 31404 existing records from primary storage. [2025-09-17T05:35:22.029249] [INFO ] [MAIN ] OII: Loaded 31404 existing records. [2025-09-17T05:35:22.215788] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:35:22.216247] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-17T05:35:22.216322] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-17T05:35:22.217072] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-17T05:35:22.217136] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-17T05:35:22.290211] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-09-17T05:35:22.435669] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T05:35:22.631215] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:35:23.090202] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-11. [2025-09-17T05:35:23.222153] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T05:35:23.471156] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T05:35:23.890188] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-17T05:35:24.528720] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T05:35:24.690210] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-09-17T05:35:25.490190] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-17T05:35:25.647693] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T05:35:26.219187] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T05:35:26.290150] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-09-17T05:35:26.458459] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T05:35:27.090182] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-17T05:35:27.499569] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T05:35:27.890159] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-17T05:35:28.656268] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T05:35:28.690108] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-17T05:35:28.865832] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T05:35:29.490144] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-17T05:35:30.222956] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T05:35:30.290084] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-17T05:35:30.452689] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T05:35:31.090179] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-17T05:35:31.890179] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-17T05:35:32.045289] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T05:35:32.646397] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T05:35:32.690136] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-17T05:35:33.439686] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T05:35:33.490099] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-17T05:35:34.290197] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-17T05:35:34.385575] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T05:35:35.090164] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-17T05:35:35.107963] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T05:35:35.279181] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T05:35:35.890185] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-17T05:35:36.690160] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-17T05:35:36.734909] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T05:35:37.293550] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T05:35:37.299411] [INFO ] [REMOTE ] OI: Full fetch complete (68106 records). [2025-09-17T05:35:37.299552] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-17T05:35:37.495225] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-17T05:35:37.697041] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-17T05:35:37.697188] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-17T05:35:37.698322] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-17T05:35:37.698386] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-17T05:35:37.699919] [DEBUG] [LOCAL ] OI: Trimmed 68106 records to 47479 (keeping 200 days of data) [2025-09-17T05:35:37.990531] [DEBUG] [LOCAL ] OI: Primary data saved (47479 records). [2025-09-17T05:35:37.990774] [INFO ] [MAIN ] OI: Full history saved. [2025-09-17T05:35:37.990917] [INFO ] [MAIN ] Update Progress: 1583/2369 symbols completed. OI took 35.0s. Estimated remaining: 1h 54m 57s. Rate: 6.8 symbols/min [2025-09-17T05:35:38.162316] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:35:38.191021] [DEBUG] [LOCAL ] OIS: Loaded 29731 existing records from primary storage. [2025-09-17T05:35:38.191221] [INFO ] [MAIN ] OIS: Loaded 29731 existing records. [2025-09-17T05:35:38.295702] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-17T05:35:38.376529] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:35:38.376835] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-17T05:35:38.376900] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-17T05:35:38.378330] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-17T05:35:38.378410] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-17T05:35:38.550782] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T05:35:38.818054] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T05:35:38.815280] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:35:39.090150] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-11. [2025-09-17T05:35:39.890150] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-17T05:35:40.030927] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T05:35:40.462149] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T05:35:40.690453] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T05:35:40.690202] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-09-17T05:35:41.490141] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-17T05:35:42.114138] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T05:35:42.290189] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-17T05:35:42.543013] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T05:35:43.090151] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-17T05:35:43.726275] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T05:35:43.890092] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-17T05:35:43.899026] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T05:35:43.901738] [INFO ] [REMOTE ] OIA: Full fetch complete (20750 records). [2025-09-17T05:35:43.901922] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-17T05:35:44.272760] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-17T05:35:44.272894] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-17T05:35:44.273451] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-17T05:35:44.273545] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-17T05:35:44.274382] [DEBUG] [LOCAL ] OIA: Trimmed 20750 records to 13630 (keeping 200 days of data) [2025-09-17T05:35:44.357779] [DEBUG] [LOCAL ] OIA: Primary data saved (13630 records). [2025-09-17T05:35:44.357994] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-17T05:35:44.358143] [INFO ] [MAIN ] Update Progress: 1584/2369 symbols completed. OIA took 29.5s. Estimated remaining: 1h 54m 47s. Rate: 6.8 symbols/min [2025-09-17T05:35:44.543710] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:35:44.587102] [DEBUG] [LOCAL ] OKE: Loaded 39937 existing records from primary storage. [2025-09-17T05:35:44.587510] [INFO ] [MAIN ] OKE: Loaded 39937 existing records. [2025-09-17T05:35:44.695328] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-17T05:35:44.771487] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:35:44.771766] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-17T05:35:44.771828] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-17T05:35:44.772976] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-17T05:35:44.773044] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-17T05:35:45.131485] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:35:45.370592] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T05:35:45.490144] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-17T05:35:46.096901] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T05:35:46.103170] [INFO ] [REMOTE ] OHI: Full fetch complete (74932 records). [2025-09-17T05:35:46.103328] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-17T05:35:46.295951] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-11. [2025-09-17T05:35:46.499359] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-17T05:35:46.499489] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-17T05:35:46.500743] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-17T05:35:46.500836] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-17T05:35:46.502920] [DEBUG] [LOCAL ] OHI: Trimmed 74932 records to 52178 (keeping 200 days of data) [2025-09-17T05:35:46.768271] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T05:35:46.882361] [DEBUG] [LOCAL ] OHI: Primary data saved (52178 records). [2025-09-17T05:35:46.882620] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-17T05:35:46.882767] [INFO ] [MAIN ] Update Progress: 1585/2369 symbols completed. OHI took 47.4s. Estimated remaining: 1h 54m 35s. Rate: 6.8 symbols/min [2025-09-17T05:35:47.054445] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:35:47.092600] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-09-17T05:35:47.096764] [DEBUG] [LOCAL ] OKLO: Loaded 40169 existing records from primary storage. [2025-09-17T05:35:47.097122] [INFO ] [MAIN ] OKLO: Loaded 40169 existing records. [2025-09-17T05:35:47.292615] [WARN ] [MAIN ] OKLO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:35:47.292968] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-17T05:35:47.293034] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-17T05:35:47.294346] [DEBUG] [LOCAL ] OKLO: Deleted primary data file. [2025-09-17T05:35:47.294413] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-17T05:35:47.817549] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:35:47.890234] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-11. [2025-09-17T05:35:48.210920] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T05:35:48.522370] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T05:35:48.690154] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-17T05:35:49.490195] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-17T05:35:50.087337] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T05:35:50.189476] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-11 (2.30 seconds). [2025-09-17T05:35:50.290086] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-17T05:35:50.405655] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T05:35:51.090139] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-09-17T05:35:51.890213] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-17T05:35:52.690100] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-17T05:35:52.844802] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T05:35:52.927336] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-09-17T05:35:53.471367] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T05:35:53.490099] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-17T05:35:54.131884] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T05:35:54.136904] [INFO ] [REMOTE ] OII: Full fetch complete (62182 records). [2025-09-17T05:35:54.137046] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-17T05:35:54.298772] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-17T05:35:54.529321] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-17T05:35:54.529443] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-17T05:35:54.530508] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-17T05:35:54.530567] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-17T05:35:54.532037] [DEBUG] [LOCAL ] OII: Trimmed 62182 records to 43228 (keeping 200 days of data) [2025-09-17T05:35:54.802545] [DEBUG] [LOCAL ] OII: Primary data saved (43228 records). [2025-09-17T05:35:54.803058] [INFO ] [MAIN ] OII: Full history saved. [2025-09-17T05:35:54.818465] [INFO ] [MAIN ] Update Progress: 1586/2369 symbols completed. OII took 33.0s. Estimated remaining: 1h 54m 26s. Rate: 6.8 symbols/min [2025-09-17T05:35:54.840143] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T05:35:55.022488] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:35:55.060484] [DEBUG] [LOCAL ] OLN: Loaded 38719 existing records from primary storage. [2025-09-17T05:35:55.060751] [INFO ] [MAIN ] OLN: Loaded 38719 existing records. [2025-09-17T05:35:55.095274] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-09-17T05:35:55.241230] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:35:55.241703] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-17T05:35:55.241786] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-17T05:35:55.242675] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-17T05:35:55.242757] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-17T05:35:55.659622] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:35:55.890139] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-17T05:35:56.690152] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-11. [2025-09-17T05:35:56.830196] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T05:35:56.914133] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-17T05:35:57.314666] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T05:35:57.490195] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-17T05:35:58.024784] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T05:35:58.290149] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-09-17T05:35:58.831579] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T05:35:59.090143] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-17T05:35:59.822269] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T05:35:59.890174] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-17T05:36:00.690198] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-09-17T05:36:00.990474] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T05:36:01.444574] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T05:36:01.490148] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-17T05:36:02.290173] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-17T05:36:03.090166] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-17T05:36:03.189540] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-17T05:36:03.675558] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T05:36:03.890141] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-17T05:36:04.690145] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-17T05:36:05.486515] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-17T05:36:05.498070] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-17T05:36:05.671141] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (3.38 seconds). [2025-09-17T05:36:05.694588] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T05:36:05.699278] [INFO ] [REMOTE ] OIS: Full fetch complete (56704 records). [2025-09-17T05:36:05.699411] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-17T05:36:06.100773] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-17T05:36:06.100952] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-17T05:36:06.102188] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-17T05:36:06.102330] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-17T05:36:06.103834] [DEBUG] [LOCAL ] OIS: Trimmed 56704 records to 41051 (keeping 200 days of data) [2025-09-17T05:36:06.216023] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T05:36:06.306033] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-17T05:36:06.382813] [DEBUG] [LOCAL ] OIS: Primary data saved (41051 records). [2025-09-17T05:36:06.382989] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-17T05:36:06.383095] [INFO ] [MAIN ] Update Progress: 1587/2369 symbols completed. OIS took 28.4s. Estimated remaining: 1h 54m 19s. Rate: 6.8 symbols/min [2025-09-17T05:36:06.561098] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:36:06.569841] [DEBUG] [LOCAL ] OLP: Loaded 6931 existing records from primary storage. [2025-09-17T05:36:06.570007] [INFO ] [MAIN ] OLP: Loaded 6931 existing records. [2025-09-17T05:36:06.748745] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:36:06.749002] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-17T05:36:06.749059] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-17T05:36:06.749392] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-17T05:36:06.749450] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-17T05:36:07.091121] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-17T05:36:07.112042] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:36:07.460795] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T05:36:07.890161] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-11. [2025-09-17T05:36:08.218776] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T05:36:08.664279] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T05:36:08.690124] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-09-17T05:36:09.485749] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T05:36:09.490087] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-09-17T05:36:09.819060] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-17T05:36:10.290145] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-17T05:36:10.396709] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T05:36:11.090153] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-17T05:36:11.890145] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-17T05:36:12.202830] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T05:36:12.628910] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T05:36:12.690151] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-17T05:36:12.835811] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T05:36:13.490156] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-17T05:36:14.290143] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-17T05:36:15.090154] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-17T05:36:15.265199] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T05:36:15.344801] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-17T05:36:15.890156] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-17T05:36:15.950192] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T05:36:16.048335] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T05:36:16.690160] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-17T05:36:17.490166] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-17T05:36:18.277408] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T05:36:18.290080] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-17T05:36:18.686820] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-17T05:36:19.064790] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T05:36:19.090100] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-17T05:36:19.890264] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-17T05:36:20.354610] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-17T05:36:20.507275] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T05:36:20.626696] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T05:36:20.690338] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-17T05:36:21.230591] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-17T05:36:21.490145] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-17T05:36:22.290136] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-17T05:36:23.090151] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-17T05:36:23.878590] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T05:36:23.890075] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-17T05:36:24.104268] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-17T05:36:24.185330] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T05:36:24.690145] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-17T05:36:25.030629] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T05:36:25.032416] [INFO ] [REMOTE ] OLP: Full fetch complete (13802 records). [2025-09-17T05:36:25.032505] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-17T05:36:25.409458] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-17T05:36:25.409612] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-17T05:36:25.410119] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-17T05:36:25.410183] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-17T05:36:25.410941] [DEBUG] [LOCAL ] OLP: Trimmed 13802 records to 9608 (keeping 200 days of data) [2025-09-17T05:36:25.474675] [DEBUG] [LOCAL ] OLP: Primary data saved (9608 records). [2025-09-17T05:36:25.474888] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-17T05:36:25.475025] [INFO ] [MAIN ] Update Progress: 1588/2369 symbols completed. OLP took 19.1s. Estimated remaining: 1h 54m 15s. Rate: 6.8 symbols/min [2025-09-17T05:36:25.496576] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-17T05:36:25.648498] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:36:25.685350] [DEBUG] [LOCAL ] OMC: Loaded 39669 existing records from primary storage. [2025-09-17T05:36:25.685543] [INFO ] [MAIN ] OMC: Loaded 39669 existing records. [2025-09-17T05:36:25.871219] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:36:25.871583] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-17T05:36:25.871668] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-17T05:36:25.872593] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-17T05:36:25.872687] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-17T05:36:26.230541] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:36:26.290100] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-11. [2025-09-17T05:36:26.416077] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T05:36:27.090143] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-17T05:36:27.889734] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T05:36:27.900071] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-09-17T05:36:28.036280] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.54 seconds). [2025-09-17T05:36:28.690190] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-17T05:36:28.836838] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T05:36:28.843837] [INFO ] [REMOTE ] OLN: Full fetch complete (74146 records). [2025-09-17T05:36:28.844091] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-17T05:36:29.261424] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-17T05:36:29.261707] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-17T05:36:29.263411] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-17T05:36:29.263556] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-17T05:36:29.266036] [DEBUG] [LOCAL ] OLN: Trimmed 74146 records to 51697 (keeping 200 days of data) [2025-09-17T05:36:29.409442] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T05:36:29.499056] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-17T05:36:29.642231] [DEBUG] [LOCAL ] OLN: Primary data saved (51697 records). [2025-09-17T05:36:29.642441] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-17T05:36:29.642548] [INFO ] [MAIN ] Update Progress: 1589/2369 symbols completed. OLN took 34.8s. Estimated remaining: 1h 54m 4s. Rate: 6.8 symbols/min [2025-09-17T05:36:29.813269] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:36:29.850510] [DEBUG] [LOCAL ] OMF: Loaded 34025 existing records from primary storage. [2025-09-17T05:36:29.850744] [INFO ] [MAIN ] OMF: Loaded 34025 existing records. [2025-09-17T05:36:30.032858] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:36:30.033191] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-17T05:36:30.033264] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-17T05:36:30.034187] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-17T05:36:30.034261] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-17T05:36:30.304111] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-09-17T05:36:30.395478] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:36:31.090201] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-11. [2025-09-17T05:36:31.858205] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (3.17 seconds). [2025-09-17T05:36:31.912053] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-17T05:36:31.930395] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-17T05:36:32.283296] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T05:36:32.690167] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-17T05:36:32.788678] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T05:36:33.490237] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-09-17T05:36:34.216381] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T05:36:34.290169] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-17T05:36:34.373573] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-17T05:36:34.380582] [INFO ] [REMOTE ] OKLO: Full fetch complete (77977 records). [2025-09-17T05:36:34.380853] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-17T05:36:34.802607] [DEBUG] [VALIDATOR ] OKLO: All expected trading days are present. [2025-09-17T05:36:34.802797] [DEBUG] [VALIDATOR ] OKLO: Primary data validation passed. [2025-09-17T05:36:34.804246] [INFO ] [MAIN ] OKLO: Fetched primary data is valid. [2025-09-17T05:36:34.804399] [DEBUG] [LOCAL ] OKLO: Saving primary data. [2025-09-17T05:36:34.806501] [DEBUG] [LOCAL ] OKLO: Trimmed 77977 records to 53819 (keeping 200 days of data) [2025-09-17T05:36:34.927681] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T05:36:35.090449] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-09-17T05:36:35.205464] [DEBUG] [LOCAL ] OKLO: Primary data saved (53819 records). [2025-09-17T05:36:35.205736] [INFO ] [MAIN ] OKLO: Full history saved. [2025-09-17T05:36:35.206046] [INFO ] [MAIN ] Update Progress: 1590/2369 symbols completed. OKLO took 48.3s. Estimated remaining: 1h 53m 54s. Rate: 6.8 symbols/min [2025-09-17T05:36:35.385393] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:36:35.425158] [DEBUG] [LOCAL ] OMI: Loaded 33837 existing records from primary storage. [2025-09-17T05:36:35.425409] [INFO ] [MAIN ] OMI: Loaded 33837 existing records. [2025-09-17T05:36:35.607857] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:36:35.608160] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-17T05:36:35.608225] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-17T05:36:35.609041] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-17T05:36:35.609129] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-17T05:36:35.890991] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-17T05:36:35.988493] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:36:36.067362] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T05:36:36.667076] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T05:36:36.690096] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-17T05:36:37.490201] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-11. [2025-09-17T05:36:37.521153] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T05:36:37.531373] [INFO ] [REMOTE ] OKE: Full fetch complete (77324 records). [2025-09-17T05:36:37.531665] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-17T05:36:37.946609] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-17T05:36:37.946779] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-17T05:36:37.948195] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-17T05:36:37.948312] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-17T05:36:37.950587] [DEBUG] [LOCAL ] OKE: Trimmed 77324 records to 53535 (keeping 200 days of data) [2025-09-17T05:36:38.290285] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-17T05:36:38.344970] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T05:36:38.379246] [DEBUG] [LOCAL ] OKE: Primary data saved (53535 records). [2025-09-17T05:36:38.379502] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-17T05:36:38.379679] [INFO ] [MAIN ] Update Progress: 1591/2369 symbols completed. OKE took 54.0s. Estimated remaining: 1h 53m 42s. Rate: 6.8 symbols/min [2025-09-17T05:36:38.559085] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:36:38.570071] [DEBUG] [LOCAL ] ONIT: Loaded 5817 existing records from primary storage. [2025-09-17T05:36:38.570252] [INFO ] [MAIN ] ONIT: Loaded 5817 existing records. [2025-09-17T05:36:38.758355] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:36:38.758728] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-17T05:36:38.758801] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-17T05:36:38.759234] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-17T05:36:38.759328] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-17T05:36:39.096304] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-17T05:36:39.184318] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:36:39.213848] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T05:36:39.890186] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-09-17T05:36:40.169036] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T05:36:40.690198] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-11. [2025-09-17T05:36:40.999237] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T05:36:41.356474] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T05:36:41.418077] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T05:36:41.490126] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-17T05:36:42.290225] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-17T05:36:43.090173] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-09-17T05:36:43.270768] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T05:36:43.571356] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T05:36:43.835422] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T05:36:43.890167] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-09-17T05:36:44.615113] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T05:36:44.690169] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-17T05:36:45.490161] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-17T05:36:46.223130] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T05:36:46.290187] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-17T05:36:46.493428] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T05:36:47.077788] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T05:36:47.090086] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-17T05:36:47.890184] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-17T05:36:47.915430] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T05:36:48.690196] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-17T05:36:49.490125] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-17T05:36:49.532734] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T05:36:50.287976] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T05:36:50.296727] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-17T05:36:51.044211] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T05:36:51.090074] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-17T05:36:51.168118] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T05:36:51.707118] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T05:36:51.890104] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-17T05:36:52.690125] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-17T05:36:53.385910] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T05:36:53.490108] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-17T05:36:54.271848] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T05:36:54.290093] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-17T05:36:54.518943] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T05:36:55.058373] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T05:36:55.090078] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-17T05:36:55.848993] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T05:36:55.850695] [INFO ] [REMOTE ] ONIT: Full fetch complete (11148 records). [2025-09-17T05:36:55.850806] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-17T05:36:55.895275] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-17T05:36:56.245096] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-17T05:36:56.245227] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-17T05:36:56.245567] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-17T05:36:56.245665] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-17T05:36:56.246216] [DEBUG] [LOCAL ] ONIT: Trimmed 11148 records to 7766 (keeping 200 days of data) [2025-09-17T05:36:56.292757] [DEBUG] [LOCAL ] ONIT: Primary data saved (7766 records). [2025-09-17T05:36:56.292912] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-17T05:36:56.293053] [INFO ] [MAIN ] Update Progress: 1592/2369 symbols completed. ONIT took 17.9s. Estimated remaining: 1h 53m 38s. Rate: 6.8 symbols/min [2025-09-17T05:36:56.464050] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:36:56.485729] [DEBUG] [LOCAL ] ONL: Loaded 22251 existing records from primary storage. [2025-09-17T05:36:56.485921] [INFO ] [MAIN ] ONL: Loaded 22251 existing records. [2025-09-17T05:36:56.666167] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:36:56.666400] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-17T05:36:56.666464] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-17T05:36:56.667103] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-17T05:36:56.667182] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-17T05:36:56.698110] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-17T05:36:57.031391] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:36:57.490108] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-11. [2025-09-17T05:36:57.697918] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T05:36:58.290099] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-17T05:36:58.430219] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T05:36:58.659262] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T05:36:59.090209] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-09-17T05:36:59.890318] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-17T05:37:00.081205] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T05:37:00.088766] [INFO ] [REMOTE ] OMC: Full fetch complete (76510 records). [2025-09-17T05:37:00.089007] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-17T05:37:00.542866] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-17T05:37:00.544143] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T05:37:00.544208] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-17T05:37:00.551914] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-17T05:37:00.552009] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-17T05:37:00.553922] [DEBUG] [LOCAL ] OMC: Trimmed 76510 records to 53295 (keeping 200 days of data) [2025-09-17T05:37:00.742213] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-09-17T05:37:00.898049] [DEBUG] [LOCAL ] OMC: Primary data saved (53295 records). [2025-09-17T05:37:00.898249] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-17T05:37:00.898374] [INFO ] [MAIN ] Update Progress: 1593/2369 symbols completed. OMC took 35.4s. Estimated remaining: 1h 53m 27s. Rate: 6.8 symbols/min [2025-09-17T05:37:01.066147] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:37:01.102949] [DEBUG] [LOCAL ] ONON: Loaded 39970 existing records from primary storage. [2025-09-17T05:37:01.103241] [INFO ] [MAIN ] ONON: Loaded 39970 existing records. [2025-09-17T05:37:01.278167] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:37:01.278468] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-17T05:37:01.278546] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-17T05:37:01.279541] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-17T05:37:01.279621] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-17T05:37:01.494378] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-17T05:37:01.648949] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:37:01.675823] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T05:37:02.090249] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T05:37:02.290144] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-17T05:37:03.090152] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-11. [2025-09-17T05:37:03.327157] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T05:37:03.454864] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T05:37:03.890126] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-17T05:37:04.690118] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-17T05:37:05.083998] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T05:37:05.395809] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T05:37:05.490146] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-09-17T05:37:06.290159] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-17T05:37:06.344595] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T05:37:07.090174] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-17T05:37:07.450826] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T05:37:07.534728] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T05:37:07.540094] [INFO ] [REMOTE ] OMF: Full fetch complete (66384 records). [2025-09-17T05:37:07.540249] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-17T05:37:07.892312] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-17T05:37:07.933384] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-17T05:37:07.933502] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-17T05:37:07.934530] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-17T05:37:07.934590] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-17T05:37:07.935940] [DEBUG] [LOCAL ] OMF: Trimmed 66384 records to 46316 (keeping 200 days of data) [2025-09-17T05:37:08.227843] [DEBUG] [LOCAL ] OMF: Primary data saved (46316 records). [2025-09-17T05:37:08.228031] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-17T05:37:08.228138] [INFO ] [MAIN ] Update Progress: 1594/2369 symbols completed. OMF took 38.6s. Estimated remaining: 1h 53m 18s. Rate: 6.8 symbols/min [2025-09-17T05:37:08.401971] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:37:08.428582] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T05:37:08.448371] [DEBUG] [LOCAL ] ONTF: Loaded 17288 existing records from primary storage. [2025-09-17T05:37:08.448525] [INFO ] [MAIN ] ONTF: Loaded 17288 existing records. [2025-09-17T05:37:08.629599] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:37:08.629943] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-17T05:37:08.630006] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-17T05:37:08.630433] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-17T05:37:08.630495] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-17T05:37:08.698504] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-17T05:37:09.005539] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:37:09.430208] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T05:37:09.490156] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-17T05:37:09.877688] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T05:37:10.290219] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-11. [2025-09-17T05:37:11.055769] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T05:37:11.090139] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-17T05:37:11.343472] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T05:37:11.890186] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-17T05:37:12.364780] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T05:37:12.690388] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-09-17T05:37:13.490171] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-17T05:37:13.520310] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T05:37:13.877712] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T05:37:14.290171] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-09-17T05:37:15.073941] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T05:37:15.080016] [INFO ] [REMOTE ] OMI: Full fetch complete (63006 records). [2025-09-17T05:37:15.080180] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-17T05:37:15.095304] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-17T05:37:15.472130] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T05:37:15.491679] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-17T05:37:15.492090] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-17T05:37:15.493161] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-17T05:37:15.493238] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-17T05:37:15.494635] [DEBUG] [LOCAL ] OMI: Trimmed 63006 records to 45878 (keeping 200 days of data) [2025-09-17T05:37:15.756703] [DEBUG] [LOCAL ] OMI: Primary data saved (45878 records). [2025-09-17T05:37:15.756887] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-17T05:37:15.757006] [INFO ] [MAIN ] Update Progress: 1595/2369 symbols completed. OMI took 40.6s. Estimated remaining: 1h 53m 8s. Rate: 6.8 symbols/min [2025-09-17T05:37:15.897854] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-17T05:37:15.929954] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:37:15.965390] [DEBUG] [LOCAL ] ONTO: Loaded 35074 existing records from primary storage. [2025-09-17T05:37:15.965606] [INFO ] [MAIN ] ONTO: Loaded 35074 existing records. [2025-09-17T05:37:16.147311] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:37:16.147600] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-17T05:37:16.147700] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-17T05:37:16.149155] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-17T05:37:16.149230] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-17T05:37:16.521279] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:37:16.681682] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T05:37:16.690084] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-17T05:37:17.490123] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-17T05:37:17.913206] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T05:37:18.181558] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T05:37:18.290146] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-17T05:37:18.473114] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T05:37:19.090177] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-11. [2025-09-17T05:37:19.515347] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T05:37:19.890145] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-17T05:37:20.679862] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T05:37:20.690087] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-09-17T05:37:20.962686] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T05:37:21.490152] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-17T05:37:22.255011] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T05:37:22.290174] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-17T05:37:22.513273] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T05:37:23.090130] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-09-17T05:37:23.510285] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T05:37:23.890156] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-17T05:37:24.642344] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T05:37:24.690085] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-17T05:37:25.015023] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T05:37:25.019530] [INFO ] [REMOTE ] ONL: Full fetch complete (43876 records). [2025-09-17T05:37:25.019782] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-17T05:37:25.400581] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-17T05:37:25.400717] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-17T05:37:25.401553] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-17T05:37:25.401608] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-17T05:37:25.402713] [DEBUG] [LOCAL ] ONL: Trimmed 43876 records to 32227 (keeping 200 days of data) [2025-09-17T05:37:25.494711] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-17T05:37:25.596612] [DEBUG] [LOCAL ] ONL: Primary data saved (32227 records). [2025-09-17T05:37:25.596827] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-17T05:37:25.596967] [INFO ] [MAIN ] Update Progress: 1596/2369 symbols completed. ONL took 29.3s. Estimated remaining: 1h 53m 0s. Rate: 6.8 symbols/min [2025-09-17T05:37:25.765983] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:37:25.780884] [DEBUG] [LOCAL ] OOMA: Loaded 13831 existing records from primary storage. [2025-09-17T05:37:25.781054] [INFO ] [MAIN ] OOMA: Loaded 13831 existing records. [2025-09-17T05:37:25.959223] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:37:25.959511] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-17T05:37:25.959569] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-17T05:37:25.960025] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-17T05:37:25.960085] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-17T05:37:26.291574] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-17T05:37:26.325033] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:37:26.351313] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T05:37:26.669717] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T05:37:27.090144] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-17T05:37:27.890119] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-17T05:37:28.291069] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T05:37:28.397359] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-17T05:37:28.690164] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-17T05:37:29.495282] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-17T05:37:29.508133] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T05:37:30.290152] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-17T05:37:30.701491] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T05:37:30.751715] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T05:37:31.090140] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-17T05:37:31.890146] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-17T05:37:32.130003] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T05:37:32.690111] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-17T05:37:32.751396] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T05:37:33.084905] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T05:37:33.490140] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-11. [2025-09-17T05:37:34.298554] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-17T05:37:34.307000] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T05:37:34.453072] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T05:37:35.090130] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-09-17T05:37:35.890136] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-17T05:37:36.104799] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T05:37:36.132943] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T05:37:36.690127] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-09-17T05:37:37.008077] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T05:37:37.011796] [INFO ] [REMOTE ] ONTF: Full fetch complete (31774 records). [2025-09-17T05:37:37.011989] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-17T05:37:37.393545] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-17T05:37:37.393695] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-17T05:37:37.394489] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-17T05:37:37.394546] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-17T05:37:37.395552] [DEBUG] [LOCAL ] ONTF: Trimmed 31774 records to 23024 (keeping 200 days of data) [2025-09-17T05:37:37.490232] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-17T05:37:37.529885] [DEBUG] [LOCAL ] ONTF: Primary data saved (23024 records). [2025-09-17T05:37:37.530067] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-17T05:37:37.530165] [INFO ] [MAIN ] Update Progress: 1597/2369 symbols completed. ONTF took 29.3s. Estimated remaining: 1h 52m 53s. Rate: 6.8 symbols/min [2025-09-17T05:37:37.540608] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T05:37:38.290230] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-17T05:37:39.090152] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-17T05:37:39.176918] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T05:37:39.254258] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T05:37:39.890168] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-17T05:37:40.690157] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-17T05:37:41.059085] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T05:37:41.490290] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-17T05:37:41.676671] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T05:37:41.748372] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T05:37:42.290180] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-17T05:37:43.090123] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-17T05:37:43.590444] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-17T05:37:43.694651] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T05:37:43.890247] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-17T05:37:44.212159] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T05:37:44.690154] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-17T05:37:45.490199] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-17T05:37:45.678029] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T05:37:45.781325] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-17T05:37:45.788245] [INFO ] [REMOTE ] ONON: Full fetch complete (77409 records). [2025-09-17T05:37:45.788487] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-17T05:37:46.207172] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-17T05:37:46.207375] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-17T05:37:46.208551] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-17T05:37:46.208625] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-17T05:37:46.210380] [DEBUG] [LOCAL ] ONON: Trimmed 77409 records to 53613 (keeping 200 days of data) [2025-09-17T05:37:46.300521] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-17T05:37:46.539617] [DEBUG] [LOCAL ] ONON: Primary data saved (53613 records). [2025-09-17T05:37:46.539829] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-17T05:37:46.539962] [INFO ] [MAIN ] Update Progress: 1598/2369 symbols completed. ONON took 45.6s. Estimated remaining: 1h 52m 44s. Rate: 6.8 symbols/min [2025-09-17T05:37:47.157318] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T05:37:47.176733] [INFO ] [REMOTE ] ONTO: Full fetch complete (65092 records). [2025-09-17T05:37:47.177036] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-17T05:37:47.178298] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T05:37:47.233787] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-17T05:37:47.599318] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-17T05:37:47.599469] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-17T05:37:47.601120] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-17T05:37:47.601199] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-17T05:37:47.603123] [DEBUG] [LOCAL ] ONTO: Trimmed 65092 records to 46467 (keeping 200 days of data) [2025-09-17T05:37:47.940535] [DEBUG] [LOCAL ] ONTO: Primary data saved (46467 records). [2025-09-17T05:37:47.940777] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-17T05:37:47.940903] [INFO ] [MAIN ] Update Progress: 1599/2369 symbols completed. ONTO took 32.2s. Estimated remaining: 1h 52m 32s. Rate: 6.8 symbols/min [2025-09-17T05:37:48.326867] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T05:37:48.331848] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-17T05:37:49.188059] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T05:37:49.193038] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-17T05:37:50.167256] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T05:37:50.170202] [INFO ] [REMOTE ] OOMA: Full fetch complete (26222 records). [2025-09-17T05:37:50.170314] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-17T05:37:50.538442] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-17T05:37:50.538563] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-17T05:37:50.539341] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-17T05:37:50.539417] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-17T05:37:50.540172] [DEBUG] [LOCAL ] OOMA: Trimmed 26222 records to 19116 (keeping 200 days of data) [2025-09-17T05:37:50.657773] [DEBUG] [LOCAL ] OOMA: Primary data saved (19116 records). [2025-09-17T05:37:50.658191] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-17T05:37:50.658307] [INFO ] [MAIN ] Update Progress: 1600/2369 symbols completed. OOMA took 25.1s. Estimated remaining: 1h 52m 20s. Rate: 6.8 symbols/min [2025-09-17T05:37:51.311162] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:37:51.312113] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:37:51.351752] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:37:51.422745] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:37:51.423323] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-17T05:37:51.423520] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-17T05:37:51.423698] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-17T05:37:51.428077] [DEBUG] [LOCAL ] OPP: Loaded 8770 existing records from primary storage. [2025-09-17T05:37:51.428137] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-17T05:37:51.428470] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-17T05:37:51.428858] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-17T05:37:51.428723] [INFO ] [MAIN ] OPP: Loaded 8770 existing records. [2025-09-17T05:37:51.627100] [DEBUG] [LOCAL ] OPAD: Loaded 16833 existing records from primary storage. [2025-09-17T05:37:51.663222] [INFO ] [MAIN ] OPAD: Loaded 16833 existing records. [2025-09-17T05:37:51.760950] [DEBUG] [LOCAL ] OPFI: Loaded 34683 existing records from primary storage. [2025-09-17T05:37:51.862544] [INFO ] [MAIN ] OPFI: Loaded 34683 existing records. [2025-09-17T05:37:52.393186] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:37:52.451167] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-17T05:37:52.588010] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-17T05:37:52.645434] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:37:52.672145] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-17T05:37:52.709042] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-17T05:37:52.825021] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-17T05:37:52.878630] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:37:52.920145] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-17T05:37:52.924016] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:37:52.955477] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-17T05:37:52.971407] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-17T05:37:52.966121] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-11. [2025-09-17T05:37:53.002595] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-17T05:37:52.976590] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-17T05:37:53.014276] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-17T05:37:53.014464] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-17T05:37:53.860362] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:37:53.911132] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-11. [2025-09-17T05:37:53.981494] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T05:37:54.083720] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:37:54.080488] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:37:54.087290] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-11. [2025-09-17T05:37:54.086910] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-17T05:37:54.089377] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-11. [2025-09-17T05:37:54.693362] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T05:37:54.695261] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-09-17T05:37:54.794974] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T05:37:54.797199] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-17T05:37:55.074947] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T05:37:55.090076] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-09-17T05:37:55.236937] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T05:37:55.413278] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T05:37:55.484734] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T05:37:55.890213] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-17T05:37:56.122710] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T05:37:56.372862] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T05:37:56.690163] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-09-17T05:37:57.288926] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T05:37:57.490152] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-09-17T05:37:58.248882] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T05:37:58.290127] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-17T05:37:59.090171] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-09-17T05:37:59.121091] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T05:37:59.890144] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-17T05:38:00.335109] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T05:38:00.528825] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T05:38:00.690151] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-17T05:38:01.321202] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T05:38:01.490193] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-09-17T05:38:02.290167] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-17T05:38:03.090218] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-17T05:38:03.167524] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T05:38:03.419014] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T05:38:03.471136] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-17T05:38:03.890160] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-17T05:38:04.690129] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-17T05:38:05.490152] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-17T05:38:05.526019] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T05:38:05.727874] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T05:38:06.290181] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-17T05:38:06.430129] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T05:38:07.092066] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-17T05:38:07.094227] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T05:38:07.890183] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-17T05:38:08.690127] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-17T05:38:08.776691] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T05:38:08.899456] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T05:38:09.427556] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T05:38:09.490108] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-17T05:38:10.169850] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T05:38:10.290174] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-17T05:38:11.074259] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T05:38:11.090143] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-17T05:38:11.890152] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-17T05:38:12.034427] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T05:38:12.690138] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-17T05:38:13.464722] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T05:38:13.490072] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-17T05:38:13.498952] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T05:38:14.290155] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-17T05:38:14.941017] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T05:38:15.090155] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-17T05:38:15.120689] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T05:38:15.852080] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T05:38:15.890140] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-17T05:38:16.678618] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T05:38:16.690068] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-17T05:38:17.490199] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-17T05:38:17.528854] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T05:38:18.290232] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-17T05:38:19.090707] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-17T05:38:19.091460] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T05:38:19.094343] [INFO ] [REMOTE ] OPY: Full fetch complete (10137 records). [2025-09-17T05:38:19.094429] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-17T05:38:19.285426] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T05:38:19.285805] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:38:19.285972] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:38:19.286079] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-17T05:38:19.286220] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-17T05:38:19.286412] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-17T05:38:19.286536] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-17T05:38:19.286751] [INFO ] [MAIN ] Update Progress: 1601/2369 symbols completed. OPY took 28.6s. Estimated remaining: 1h 52m 21s. Rate: 6.8 symbols/min [2025-09-17T05:38:19.506959] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:38:19.509094] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T05:38:19.559523] [DEBUG] [LOCAL ] OR: Loaded 33968 existing records from primary storage. [2025-09-17T05:38:19.559741] [INFO ] [MAIN ] OR: Loaded 33968 existing records. [2025-09-17T05:38:19.759705] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:38:19.759971] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-17T05:38:19.760030] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-17T05:38:19.760985] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-17T05:38:19.761051] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-17T05:38:19.895316] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-17T05:38:20.143388] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:38:20.271171] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T05:38:20.690154] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-17T05:38:20.795513] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T05:38:20.797600] [INFO ] [REMOTE ] OPP: Full fetch complete (18076 records). [2025-09-17T05:38:20.797709] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-17T05:38:21.159801] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-17T05:38:21.159920] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-17T05:38:21.160378] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-17T05:38:21.160440] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-17T05:38:21.161133] [DEBUG] [LOCAL ] OPP: Trimmed 18076 records to 11811 (keeping 200 days of data) [2025-09-17T05:38:21.241866] [DEBUG] [LOCAL ] OPP: Primary data saved (11811 records). [2025-09-17T05:38:21.242128] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-17T05:38:21.242306] [INFO ] [MAIN ] Update Progress: 1602/2369 symbols completed. OPP took 30.6s. Estimated remaining: 1h 52m 9s. Rate: 6.8 symbols/min [2025-09-17T05:38:21.412442] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:38:21.434598] [DEBUG] [LOCAL ] ORA: Loaded 23864 existing records from primary storage. [2025-09-17T05:38:21.434790] [INFO ] [MAIN ] ORA: Loaded 23864 existing records. [2025-09-17T05:38:21.496906] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-11. [2025-09-17T05:38:21.615354] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:38:21.615703] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-17T05:38:21.615771] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-17T05:38:21.616581] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-17T05:38:21.616675] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-17T05:38:21.977974] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:38:22.290217] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-17T05:38:22.474356] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T05:38:22.993738] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T05:38:23.090106] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-09-17T05:38:23.890169] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-17T05:38:24.099344] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T05:38:24.182240] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T05:38:24.690145] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-17T05:38:25.490158] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-09-17T05:38:25.593205] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T05:38:26.290156] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-11. [2025-09-17T05:38:26.788770] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-17T05:38:26.795236] [INFO ] [REMOTE ] OPAD: Full fetch complete (21187 records). [2025-09-17T05:38:26.795426] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-17T05:38:27.090193] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-17T05:38:27.181452] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-17T05:38:27.181657] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-17T05:38:27.182279] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-17T05:38:27.182423] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-17T05:38:27.204854] [DEBUG] [LOCAL ] OPAD: Trimmed 21187 records to 18309 (keeping 200 days of data) [2025-09-17T05:38:27.206104] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T05:38:27.320093] [DEBUG] [LOCAL ] OPAD: Primary data saved (18309 records). [2025-09-17T05:38:27.320316] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-17T05:38:27.320470] [INFO ] [MAIN ] Update Progress: 1603/2369 symbols completed. OPAD took 36.7s. Estimated remaining: 1h 51m 59s. Rate: 6.8 symbols/min [2025-09-17T05:38:27.489553] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:38:27.534501] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T05:38:27.557729] [DEBUG] [LOCAL ] ORC: Loaded 39061 existing records from primary storage. [2025-09-17T05:38:27.557936] [INFO ] [MAIN ] ORC: Loaded 39061 existing records. [2025-09-17T05:38:27.735890] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:38:27.736214] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-17T05:38:27.736295] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-17T05:38:27.737295] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-17T05:38:27.737373] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-17T05:38:27.893786] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-09-17T05:38:28.109917] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:38:28.690183] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-11. [2025-09-17T05:38:28.727678] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T05:38:28.733918] [INFO ] [REMOTE ] OPFI: Full fetch complete (67076 records). [2025-09-17T05:38:28.734119] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-17T05:38:29.128981] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-17T05:38:29.129113] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-17T05:38:29.130141] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-17T05:38:29.130201] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-17T05:38:29.131746] [DEBUG] [LOCAL ] OPFI: Trimmed 67076 records to 46843 (keeping 200 days of data) [2025-09-17T05:38:29.444259] [DEBUG] [LOCAL ] OPFI: Primary data saved (46843 records). [2025-09-17T05:38:29.444501] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-17T05:38:29.444618] [INFO ] [MAIN ] Update Progress: 1604/2369 symbols completed. OPFI took 38.8s. Estimated remaining: 1h 51m 47s. Rate: 6.8 symbols/min [2025-09-17T05:38:29.500804] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-17T05:38:29.621190] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:38:29.621694] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-17T05:38:29.621856] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-17T05:38:29.622031] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-17T05:38:29.622127] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-17T05:38:29.622259] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-17T05:38:29.622307] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-17T05:38:29.925018] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T05:38:30.013960] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:38:30.290199] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-09-17T05:38:30.359302] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T05:38:31.064971] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T05:38:31.090086] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-17T05:38:31.810497] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T05:38:31.890170] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-09-17T05:38:32.676271] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T05:38:32.690083] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-17T05:38:33.490386] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-17T05:38:33.807320] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T05:38:33.857099] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T05:38:34.290173] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-09-17T05:38:35.090141] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-17T05:38:35.209543] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T05:38:35.890240] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-17T05:38:36.174913] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T05:38:36.242149] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T05:38:36.690151] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-17T05:38:37.490200] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-17T05:38:37.537141] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T05:38:38.290213] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-17T05:38:38.460565] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T05:38:39.065948] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T05:38:39.090092] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-17T05:38:39.876443] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T05:38:39.890134] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-11. [2025-09-17T05:38:40.434777] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T05:38:40.690155] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-17T05:38:41.490178] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-17T05:38:42.127009] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-17T05:38:42.290166] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-17T05:38:42.677691] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T05:38:42.880344] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T05:38:43.090168] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-17T05:38:43.890159] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-17T05:38:43.949546] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T05:38:44.454779] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T05:38:44.690280] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-17T05:38:45.490146] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-17T05:38:46.110207] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T05:38:46.256518] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-17T05:38:46.290175] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-17T05:38:47.090218] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-17T05:38:47.498358] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T05:38:47.890168] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-17T05:38:48.562242] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T05:38:48.568445] [INFO ] [REMOTE ] OR: Full fetch complete (64415 records). [2025-09-17T05:38:48.568702] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-17T05:38:48.691689] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-17T05:38:48.972733] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-17T05:38:48.972952] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-17T05:38:48.974253] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-17T05:38:48.974455] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-17T05:38:48.976417] [DEBUG] [LOCAL ] OR: Trimmed 64415 records to 45886 (keeping 200 days of data) [2025-09-17T05:38:49.103471] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.81 seconds). [2025-09-17T05:38:49.298004] [DEBUG] [LOCAL ] OR: Primary data saved (45886 records). [2025-09-17T05:38:49.298202] [INFO ] [MAIN ] OR: Full history saved. [2025-09-17T05:38:49.298344] [INFO ] [MAIN ] Update Progress: 1605/2369 symbols completed. OR took 30.0s. Estimated remaining: 1h 51m 43s. Rate: 6.8 symbols/min [2025-09-17T05:38:49.469351] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:38:49.469715] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-17T05:38:49.469864] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-17T05:38:49.470120] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-17T05:38:49.470292] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-17T05:38:49.470385] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-17T05:38:49.470551] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-17T05:38:49.513338] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-17T05:38:49.745126] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T05:38:49.861698] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:38:50.290204] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-17T05:38:50.931120] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-17T05:38:51.090092] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-17T05:38:51.635366] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T05:38:51.639539] [INFO ] [REMOTE ] ORA: Full fetch complete (49071 records). [2025-09-17T05:38:51.639684] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-17T05:38:51.895289] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-11. [2025-09-17T05:38:52.043743] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-17T05:38:52.044071] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-17T05:38:52.045057] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-17T05:38:52.045131] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-17T05:38:52.046552] [DEBUG] [LOCAL ] ORA: Trimmed 49071 records to 32627 (keeping 200 days of data) [2025-09-17T05:38:52.213033] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.70 seconds). [2025-09-17T05:38:52.300009] [DEBUG] [LOCAL ] ORA: Primary data saved (32627 records). [2025-09-17T05:38:52.300198] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-17T05:38:52.300297] [INFO ] [MAIN ] Update Progress: 1606/2369 symbols completed. ORA took 31.1s. Estimated remaining: 1h 51m 32s. Rate: 6.8 symbols/min [2025-09-17T05:38:52.475005] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:38:52.498576] [DEBUG] [LOCAL ] ORN: Loaded 23286 existing records from primary storage. [2025-09-17T05:38:52.498787] [INFO ] [MAIN ] ORN: Loaded 23286 existing records. [2025-09-17T05:38:52.677085] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:38:52.677326] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-17T05:38:52.677385] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-17T05:38:52.678054] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-17T05:38:52.678119] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-17T05:38:52.708959] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-17T05:38:53.036745] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:38:53.068134] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T05:38:53.490239] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-17T05:38:53.658204] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T05:38:54.290163] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-17T05:38:55.090192] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-11. [2025-09-17T05:38:55.264675] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-17T05:38:55.663764] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T05:38:55.700525] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T05:38:55.890099] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-17T05:38:56.097376] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T05:38:56.690151] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-17T05:38:57.490101] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-17T05:38:57.906670] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T05:38:58.290117] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-17T05:38:58.333323] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T05:38:59.090142] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-17T05:38:59.890157] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-09-17T05:38:59.936072] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-17T05:39:00.194210] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T05:39:00.201885] [INFO ] [REMOTE ] ORC: Full fetch complete (74989 records). [2025-09-17T05:39:00.202168] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-17T05:39:00.612166] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-17T05:39:00.612324] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-17T05:39:00.613555] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-17T05:39:00.613658] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-17T05:39:00.615573] [DEBUG] [LOCAL ] ORC: Trimmed 74989 records to 52270 (keeping 200 days of data) [2025-09-17T05:39:00.708944] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-17T05:39:00.863869] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T05:39:00.975876] [DEBUG] [LOCAL ] ORC: Primary data saved (52270 records). [2025-09-17T05:39:00.976082] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-17T05:39:00.976263] [INFO ] [MAIN ] Update Progress: 1607/2369 symbols completed. ORC took 33.7s. Estimated remaining: 1h 51m 23s. Rate: 6.8 symbols/min [2025-09-17T05:39:01.146369] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:39:01.184499] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T05:39:01.203452] [DEBUG] [LOCAL ] OSCR: Loaded 40152 existing records from primary storage. [2025-09-17T05:39:01.203621] [INFO ] [MAIN ] OSCR: Loaded 40152 existing records. [2025-09-17T05:39:01.380321] [WARN ] [MAIN ] OSCR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:39:01.380618] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-17T05:39:01.380703] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-17T05:39:01.381548] [DEBUG] [LOCAL ] OSCR: Deleted primary data file. [2025-09-17T05:39:01.381629] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-17T05:39:01.528574] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-09-17T05:39:01.793687] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:39:02.290216] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-11. [2025-09-17T05:39:03.090128] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-17T05:39:03.556469] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T05:39:03.890147] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-17T05:39:04.076300] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (3.37 seconds). [2025-09-17T05:39:04.649206] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-11 (2.36 seconds). [2025-09-17T05:39:04.690087] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-09-17T05:39:05.354938] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-17T05:39:05.490089] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-17T05:39:05.599029] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T05:39:06.212347] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T05:39:06.290084] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-17T05:39:07.090152] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-17T05:39:07.234148] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T05:39:07.890144] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-17T05:39:08.222033] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T05:39:08.690206] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-17T05:39:09.270583] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T05:39:09.377241] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T05:39:09.490160] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-17T05:39:10.294436] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-17T05:39:10.297765] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T05:39:10.367346] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T05:39:11.090191] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-17T05:39:11.890174] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-17T05:39:12.691914] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-17T05:39:12.697758] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T05:39:12.787907] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-17T05:39:12.854673] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T05:39:13.490173] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-17T05:39:14.290182] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-17T05:39:14.713161] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T05:39:14.813207] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T05:39:15.090179] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-17T05:39:15.421682] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T05:39:15.890176] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-17T05:39:15.989445] [DEBUG] [REMOTE ] OSCR: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-17T05:39:15.989838] [WARN ] [REMOTE ] OSCR: No data returned for month 2025-03 [2025-09-17T05:39:16.372110] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T05:39:16.690187] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-17T05:39:17.490167] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-17T05:39:18.290203] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-17T05:39:19.090179] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-17T05:39:19.450285] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-17T05:39:19.890189] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-17T05:39:19.967985] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T05:39:20.136112] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-09-17T05:39:20.622852] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T05:39:20.629095] [INFO ] [REMOTE ] ORI: Full fetch complete (69937 records). [2025-09-17T05:39:20.629261] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-17T05:39:20.695223] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-17T05:39:20.826601] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T05:39:20.827333] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:39:20.827388] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:39:20.827435] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-17T05:39:20.827526] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-17T05:39:20.827579] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-17T05:39:20.827655] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-17T05:39:20.827747] [INFO ] [MAIN ] Update Progress: 1608/2369 symbols completed. ORI took 31.5s. Estimated remaining: 1h 51m 20s. Rate: 6.8 symbols/min [2025-09-17T05:39:20.995345] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:39:20.995587] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-17T05:39:20.995636] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-17T05:39:20.995765] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-17T05:39:20.995812] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-17T05:39:20.995860] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-17T05:39:20.995901] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-17T05:39:21.353701] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:39:21.490097] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-11. [2025-09-17T05:39:22.286923] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-17T05:39:22.297601] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-17T05:39:22.862659] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T05:39:22.930795] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-17T05:39:22.940121] [INFO ] [REMOTE ] ORCL: Full fetch complete (77450 records). [2025-09-17T05:39:22.940367] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-17T05:39:23.095376] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-17T05:39:23.166800] [WARN ] [VALIDATOR ] ORCL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T05:39:23.167980] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:39:23.168057] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:39:23.168139] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-17T05:39:23.168303] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-17T05:39:23.168360] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-17T05:39:23.168411] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-17T05:39:23.168580] [INFO ] [MAIN ] Update Progress: 1609/2369 symbols completed. ORCL took 53.7s. Estimated remaining: 1h 51m 8s. Rate: 6.8 symbols/min [2025-09-17T05:39:23.369556] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:39:23.370183] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-17T05:39:23.370249] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-17T05:39:23.370400] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-17T05:39:23.370457] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-17T05:39:23.370512] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-17T05:39:23.370553] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-17T05:39:23.795558] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:39:23.818056] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T05:39:23.890119] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-11. [2025-09-17T05:39:24.080447] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:39:24.080933] [WARN ] [REMOTE ] OTF: No data returned for month 2024-11 [2025-09-17T05:39:24.690191] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-17T05:39:24.779780] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T05:39:25.490253] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-17T05:39:26.030568] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T05:39:26.034558] [INFO ] [REMOTE ] ORN: Full fetch complete (45523 records). [2025-09-17T05:39:26.034699] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-17T05:39:26.298191] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-17T05:39:26.415798] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-17T05:39:26.415909] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-17T05:39:26.416777] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-17T05:39:26.416834] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-17T05:39:26.418594] [DEBUG] [LOCAL ] ORN: Trimmed 45523 records to 31790 (keeping 200 days of data) [2025-09-17T05:39:26.583870] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:39:26.586888] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-17T05:39:26.604138] [DEBUG] [LOCAL ] ORN: Primary data saved (31790 records). [2025-09-17T05:39:26.604261] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-17T05:39:26.604386] [INFO ] [MAIN ] Update Progress: 1610/2369 symbols completed. ORN took 34.3s. Estimated remaining: 1h 50m 56s. Rate: 6.8 symbols/min [2025-09-17T05:39:26.776093] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:39:26.816222] [DEBUG] [LOCAL ] OTIS: Loaded 39307 existing records from primary storage. [2025-09-17T05:39:26.816676] [INFO ] [MAIN ] OTIS: Loaded 39307 existing records. [2025-09-17T05:39:26.998341] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:39:26.998696] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-17T05:39:26.998752] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-17T05:39:26.999936] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-17T05:39:27.000010] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-17T05:39:27.095492] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-09-17T05:39:27.364520] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:39:27.367856] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:39:27.368563] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-09-17T05:39:27.890104] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-17T05:39:27.980582] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-17T05:39:28.690182] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-11. [2025-09-17T05:39:29.490199] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-17T05:39:29.549745] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T05:39:29.694550] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:39:29.694972] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-17T05:39:30.290589] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T05:39:30.290671] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-17T05:39:31.090164] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-17T05:39:31.289671] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:39:31.290053] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-17T05:39:31.890140] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-17T05:39:32.092559] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:39:32.092980] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-17T05:39:32.690170] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-17T05:39:32.890441] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:39:32.890839] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-17T05:39:33.226748] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.94 seconds). [2025-09-17T05:39:33.490165] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-17T05:39:34.216321] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T05:39:34.290133] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-17T05:39:35.090168] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-17T05:39:35.890180] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-17T05:39:36.619568] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T05:39:36.661300] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T05:39:36.690193] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-17T05:39:36.842128] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-17T05:39:37.490214] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-09-17T05:39:38.209908] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T05:39:38.290089] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-17T05:39:39.090117] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-17T05:39:39.133119] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T05:39:39.897828] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-17T05:39:39.903009] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T05:39:39.958456] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T05:39:40.690138] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-09-17T05:39:41.490151] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-17T05:39:42.295193] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-17T05:39:42.312220] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T05:39:42.380624] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-17T05:39:42.387987] [INFO ] [REMOTE ] OSCR: Full fetch complete (69177 records). [2025-09-17T05:39:42.388223] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-17T05:39:42.622711] [WARN ] [VALIDATOR ] OSCR: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T05:39:42.623589] [FATAL] [MAIN ] OSCR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:39:42.623709] [WARN ] [MAIN ] OSCR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:39:42.623770] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-17T05:39:42.623876] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-09-17T05:39:42.623937] [INFO ] [LOCAL ] OSCR: Starting deletion of derivative data. [2025-09-17T05:39:42.624325] [DEBUG] [LOCAL ] OSCR: Deleted derivative data file. [2025-09-17T05:39:42.624445] [INFO ] [MAIN ] Update Progress: 1611/2369 symbols completed. OSCR took 41.6s. Estimated remaining: 1h 50m 51s. Rate: 6.8 symbols/min [2025-09-17T05:39:42.800123] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:39:42.837431] [DEBUG] [LOCAL ] OUT: Loaded 35820 existing records from primary storage. [2025-09-17T05:39:42.837680] [INFO ] [MAIN ] OUT: Loaded 35820 existing records. [2025-09-17T05:39:43.019384] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:39:43.019932] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-17T05:39:43.020149] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-17T05:39:43.021363] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-17T05:39:43.021437] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-17T05:39:43.093340] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-17T05:39:43.308174] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T05:39:43.415746] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:39:43.431876] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T05:39:43.435075] [INFO ] [REMOTE ] OTF: Full fetch complete (6610 records). [2025-09-17T05:39:43.435160] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-17T05:39:43.611739] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 66 unique days, need 200 days [2025-09-17T05:39:43.612036] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:39:43.612083] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:39:43.612129] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-17T05:39:43.612219] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-17T05:39:43.612266] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-17T05:39:43.612339] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-17T05:39:43.612411] [INFO ] [MAIN ] Update Progress: 1612/2369 symbols completed. OTF took 20.4s. Estimated remaining: 1h 50m 39s. Rate: 6.8 symbols/min [2025-09-17T05:39:43.781269] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:39:43.820982] [DEBUG] [LOCAL ] OVV: Loaded 39887 existing records from primary storage. [2025-09-17T05:39:43.821180] [INFO ] [MAIN ] OVV: Loaded 39887 existing records. [2025-09-17T05:39:43.895226] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-11. [2025-09-17T05:39:44.008412] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:39:44.008773] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-17T05:39:44.008846] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-17T05:39:44.010474] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-17T05:39:44.010554] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-17T05:39:44.382851] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:39:44.690103] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-11. [2025-09-17T05:39:44.798896] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T05:39:45.490133] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-17T05:39:45.563801] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T05:39:45.988151] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T05:39:46.290136] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-09-17T05:39:46.979660] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T05:39:47.090148] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-09-17T05:39:47.406302] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T05:39:47.890185] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-09-17T05:39:48.690165] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-17T05:39:48.868134] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T05:39:49.163582] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T05:39:49.490156] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-17T05:39:50.290539] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-17T05:39:50.292389] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T05:39:50.936901] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T05:39:51.090141] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-17T05:39:51.730346] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T05:39:51.890130] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-17T05:39:52.690150] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-17T05:39:52.737681] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T05:39:53.372064] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T05:39:53.490151] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-17T05:39:54.196306] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T05:39:54.290334] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-17T05:39:55.090200] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-17T05:39:55.201690] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T05:39:55.660041] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T05:39:55.665403] [INFO ] [REMOTE ] OSK: Full fetch complete (61200 records). [2025-09-17T05:39:55.665554] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-17T05:39:55.855270] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T05:39:55.855954] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:39:55.856011] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:39:55.856058] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-17T05:39:55.856125] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-17T05:39:55.856170] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-17T05:39:55.856217] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-17T05:39:55.856287] [INFO ] [MAIN ] Update Progress: 1613/2369 symbols completed. OSK took 35.0s. Estimated remaining: 1h 50m 32s. Rate: 6.8 symbols/min [2025-09-17T05:39:55.898227] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-17T05:39:56.027288] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:39:56.027551] [DEBUG] [LOCAL ] OWL: No existing data file found in primary storage. [2025-09-17T05:39:56.027611] [WARN ] [MAIN ] OWL: No existing data found, performing full refresh instead. [2025-09-17T05:39:56.027754] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-17T05:39:56.027808] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-17T05:39:56.027858] [DEBUG] [LOCAL ] OWL: No primary data file found to delete. [2025-09-17T05:39:56.027901] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-17T05:39:56.385843] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:39:56.690202] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-11. [2025-09-17T05:39:56.745497] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T05:39:57.490205] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-17T05:39:57.750020] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T05:39:58.290193] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-17T05:39:58.490658] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T05:39:59.089041] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T05:39:59.098819] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-09-17T05:39:59.890200] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-17T05:40:00.112279] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T05:40:00.690225] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-17T05:40:01.068898] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T05:40:01.490184] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-17T05:40:01.787248] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T05:40:02.287421] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T05:40:02.300678] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-17T05:40:03.090150] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-17T05:40:03.228620] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T05:40:03.853157] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T05:40:03.890098] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-17T05:40:04.690171] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-17T05:40:04.848621] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T05:40:05.152446] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T05:40:05.490145] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-17T05:40:06.290193] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-17T05:40:06.461766] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T05:40:07.090211] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-17T05:40:07.204952] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T05:40:07.890201] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-17T05:40:08.021150] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T05:40:08.270746] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T05:40:08.690174] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-17T05:40:09.490177] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-17T05:40:09.727942] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T05:40:10.290231] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-17T05:40:10.554950] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T05:40:10.960697] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T05:40:10.966463] [INFO ] [REMOTE ] OUT: Full fetch complete (68998 records). [2025-09-17T05:40:10.966600] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-17T05:40:11.106632] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-17T05:40:11.356652] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-17T05:40:11.356765] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-17T05:40:11.357786] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-17T05:40:11.357844] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-17T05:40:11.359278] [DEBUG] [LOCAL ] OUT: Trimmed 68998 records to 48284 (keeping 200 days of data) [2025-09-17T05:40:11.657429] [DEBUG] [LOCAL ] OUT: Primary data saved (48284 records). [2025-09-17T05:40:11.657598] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-17T05:40:11.657709] [INFO ] [MAIN ] Update Progress: 1614/2369 symbols completed. OUT took 29.0s. Estimated remaining: 1h 50m 26s. Rate: 6.8 symbols/min [2025-09-17T05:40:11.829406] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:40:11.837944] [DEBUG] [LOCAL ] OWLT: Loaded 7029 existing records from primary storage. [2025-09-17T05:40:11.838126] [INFO ] [MAIN ] OWLT: Loaded 7029 existing records. [2025-09-17T05:40:11.900766] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-17T05:40:12.020017] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:40:12.020275] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-17T05:40:12.020334] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-17T05:40:12.020688] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-17T05:40:12.020748] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-17T05:40:12.397503] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:40:12.428240] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T05:40:12.690153] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-11. [2025-09-17T05:40:12.965673] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T05:40:13.435106] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T05:40:13.490130] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-09-17T05:40:13.718383] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T05:40:13.941680] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T05:40:14.290164] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-17T05:40:15.090186] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-17T05:40:15.635991] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T05:40:15.865652] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T05:40:15.890101] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-17T05:40:16.690171] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-17T05:40:17.490211] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-17T05:40:17.735191] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T05:40:18.109789] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T05:40:18.290157] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-17T05:40:18.447370] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T05:40:18.767314] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T05:40:19.090146] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-17T05:40:19.890138] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-17T05:40:20.528538] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T05:40:20.690187] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-17T05:40:20.993181] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T05:40:21.000370] [INFO ] [REMOTE ] OVV: Full fetch complete (77120 records). [2025-09-17T05:40:21.000536] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-17T05:40:21.413817] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-17T05:40:21.413980] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-17T05:40:21.415172] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-17T05:40:21.415236] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-17T05:40:21.416895] [DEBUG] [LOCAL ] OVV: Trimmed 77120 records to 53517 (keeping 200 days of data) [2025-09-17T05:40:21.516867] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-17T05:40:21.767937] [DEBUG] [LOCAL ] OVV: Primary data saved (53517 records). [2025-09-17T05:40:21.768135] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-17T05:40:21.768261] [INFO ] [MAIN ] Update Progress: 1615/2369 symbols completed. OVV took 38.2s. Estimated remaining: 1h 50m 18s. Rate: 6.8 symbols/min [2025-09-17T05:40:21.944506] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:40:21.969801] [DEBUG] [LOCAL ] OXM: Loaded 24453 existing records from primary storage. [2025-09-17T05:40:21.969993] [INFO ] [MAIN ] OXM: Loaded 24453 existing records. [2025-09-17T05:40:22.156828] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:40:22.157247] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-17T05:40:22.157448] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-17T05:40:22.158253] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-17T05:40:22.158321] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-17T05:40:22.309863] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-17T05:40:22.560444] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:40:22.563347] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T05:40:23.017403] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T05:40:23.090119] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-17T05:40:23.314072] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T05:40:23.324427] [INFO ] [REMOTE ] OTIS: Full fetch complete (75488 records). [2025-09-17T05:40:23.324679] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-17T05:40:23.736934] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-17T05:40:23.737284] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-17T05:40:23.738565] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-17T05:40:23.738629] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-17T05:40:23.740864] [DEBUG] [LOCAL ] OTIS: Trimmed 75488 records to 52711 (keeping 200 days of data) [2025-09-17T05:40:23.941329] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-11. [2025-09-17T05:40:24.029778] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T05:40:24.120596] [DEBUG] [LOCAL ] OTIS: Primary data saved (52711 records). [2025-09-17T05:40:24.120807] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-17T05:40:24.120940] [INFO ] [MAIN ] Update Progress: 1616/2369 symbols completed. OTIS took 57.5s. Estimated remaining: 1h 50m 6s. Rate: 6.8 symbols/min [2025-09-17T05:40:24.299972] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:40:24.300199] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-17T05:40:24.300244] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-17T05:40:24.300355] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-17T05:40:24.300407] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-17T05:40:24.300462] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-17T05:40:24.300509] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-17T05:40:24.666959] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:40:24.690145] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-17T05:40:25.247137] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T05:40:25.490125] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-09-17T05:40:26.290151] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-11. [2025-09-17T05:40:26.468958] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T05:40:26.780617] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T05:40:27.090136] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-09-17T05:40:27.890114] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-17T05:40:28.370400] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T05:40:28.690156] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-17T05:40:28.723060] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-11 (2.43 seconds). [2025-09-17T05:40:29.282325] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T05:40:29.289256] [INFO ] [REMOTE ] OWL: Full fetch complete (77347 records). [2025-09-17T05:40:29.289488] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-17T05:40:29.495213] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-17T05:40:29.696589] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-17T05:40:29.696748] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-17T05:40:29.697875] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-17T05:40:29.697940] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-17T05:40:29.699678] [DEBUG] [LOCAL ] OWL: Trimmed 77347 records to 53557 (keeping 200 days of data) [2025-09-17T05:40:29.971522] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T05:40:30.097454] [DEBUG] [LOCAL ] OWL: Primary data saved (53557 records). [2025-09-17T05:40:30.097716] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-17T05:40:30.097846] [INFO ] [MAIN ] Update Progress: 1617/2369 symbols completed. OWL took 34.2s. Estimated remaining: 1h 49m 56s. Rate: 6.8 symbols/min [2025-09-17T05:40:30.283474] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:40:30.290112] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-17T05:40:30.326926] [DEBUG] [LOCAL ] PAAS: Loaded 39975 existing records from primary storage. [2025-09-17T05:40:30.327155] [INFO ] [MAIN ] PAAS: Loaded 39975 existing records. [2025-09-17T05:40:30.533072] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:40:30.533348] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-17T05:40:30.533405] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-17T05:40:30.534511] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-17T05:40:30.534577] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-17T05:40:30.885776] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:40:31.090122] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-11. [2025-09-17T05:40:31.614518] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T05:40:31.721500] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-17T05:40:31.890118] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-17T05:40:32.690178] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-17T05:40:33.019442] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T05:40:33.490149] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-09-17T05:40:33.527200] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T05:40:34.294362] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-17T05:40:34.305855] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-17T05:40:35.090188] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-17T05:40:35.313326] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T05:40:35.773480] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T05:40:35.890167] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-09-17T05:40:36.690153] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-17T05:40:37.336182] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-17T05:40:37.490090] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-17T05:40:37.731051] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T05:40:38.192863] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T05:40:38.290152] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-17T05:40:38.877858] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T05:40:39.090137] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-17T05:40:39.593936] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T05:40:39.890127] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-17T05:40:40.651386] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T05:40:40.653039] [INFO ] [REMOTE ] OWLT: Full fetch complete (11409 records). [2025-09-17T05:40:40.653126] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-17T05:40:40.695463] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-17T05:40:41.021815] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-17T05:40:41.021995] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-17T05:40:41.022585] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-17T05:40:41.022780] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-17T05:40:41.023775] [DEBUG] [LOCAL ] OWLT: Trimmed 11409 records to 8697 (keeping 200 days of data) [2025-09-17T05:40:41.089754] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T05:40:41.131200] [DEBUG] [LOCAL ] OWLT: Primary data saved (8697 records). [2025-09-17T05:40:41.131472] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-17T05:40:41.131673] [INFO ] [MAIN ] Update Progress: 1618/2369 symbols completed. OWLT took 29.5s. Estimated remaining: 1h 49m 48s. Rate: 6.8 symbols/min [2025-09-17T05:40:41.304308] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:40:41.314698] [DEBUG] [LOCAL ] PAC: Loaded 8440 existing records from primary storage. [2025-09-17T05:40:41.314873] [INFO ] [MAIN ] PAC: Loaded 8440 existing records. [2025-09-17T05:40:41.493927] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:40:41.493751] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-17T05:40:41.494196] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-17T05:40:41.495844] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-17T05:40:41.496217] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-17T05:40:41.496279] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-17T05:40:41.868604] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:40:42.290178] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-11. [2025-09-17T05:40:43.090141] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-17T05:40:43.332111] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.64 seconds). [2025-09-17T05:40:43.352332] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T05:40:43.635689] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T05:40:43.890128] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-17T05:40:44.143020] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T05:40:44.690159] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-09-17T05:40:45.490134] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-17T05:40:45.563795] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T05:40:45.854731] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T05:40:46.290134] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-09-17T05:40:47.090208] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-17T05:40:47.175578] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T05:40:47.890161] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-17T05:40:47.985217] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-17T05:40:48.690236] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-17T05:40:48.804476] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T05:40:48.832124] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T05:40:49.490146] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-17T05:40:49.962192] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T05:40:50.290135] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-17T05:40:50.354845] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T05:40:51.090116] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-17T05:40:51.554237] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T05:40:51.718205] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T05:40:51.890179] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-17T05:40:52.690145] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-17T05:40:53.490116] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-17T05:40:53.592476] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T05:40:53.882551] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-17T05:40:54.290141] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-17T05:40:55.090125] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-17T05:40:55.165403] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T05:40:55.861816] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-17T05:40:55.890107] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-17T05:40:56.690188] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-17T05:40:57.071242] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T05:40:57.261532] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T05:40:57.266630] [INFO ] [REMOTE ] OXM: Full fetch complete (46052 records). [2025-09-17T05:40:57.266835] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-17T05:40:57.495335] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-17T05:40:57.681798] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-17T05:40:57.682197] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-17T05:40:57.692608] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-17T05:40:57.693029] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T05:40:57.693254] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-17T05:40:57.697939] [DEBUG] [LOCAL ] OXM: Trimmed 46052 records to 33661 (keeping 200 days of data) [2025-09-17T05:40:57.911736] [DEBUG] [LOCAL ] OXM: Primary data saved (33661 records). [2025-09-17T05:40:57.911915] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-17T05:40:57.912033] [INFO ] [MAIN ] Update Progress: 1619/2369 symbols completed. OXM took 36.1s. Estimated remaining: 1h 49m 43s. Rate: 6.8 symbols/min [2025-09-17T05:40:58.093774] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:40:58.117108] [DEBUG] [LOCAL ] PACK: Loaded 22965 existing records from primary storage. [2025-09-17T05:40:58.117349] [INFO ] [MAIN ] PACK: Loaded 22965 existing records. [2025-09-17T05:40:58.298833] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-17T05:40:58.299020] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:40:58.300114] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-17T05:40:58.300195] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-17T05:40:58.300816] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-17T05:40:58.300903] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-17T05:40:58.672379] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:40:59.090168] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-17T05:40:59.444677] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T05:40:59.890144] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-11. [2025-09-17T05:40:59.959668] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T05:41:00.690172] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-17T05:41:00.862363] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-17T05:41:01.042960] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T05:41:01.472023] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T05:41:01.473872] [INFO ] [REMOTE ] PAC: Full fetch complete (16679 records). [2025-09-17T05:41:01.474100] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-17T05:41:01.497407] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-17T05:41:01.887129] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-17T05:41:01.887270] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-17T05:41:01.887752] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-17T05:41:01.887812] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-17T05:41:01.888664] [DEBUG] [LOCAL ] PAC: Trimmed 16679 records to 11690 (keeping 200 days of data) [2025-09-17T05:41:01.967447] [DEBUG] [LOCAL ] PAC: Primary data saved (11690 records). [2025-09-17T05:41:01.967680] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-17T05:41:01.967787] [INFO ] [MAIN ] Update Progress: 1620/2369 symbols completed. PAC took 20.8s. Estimated remaining: 1h 49m 32s. Rate: 6.8 symbols/min [2025-09-17T05:41:02.145412] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:41:02.170303] [DEBUG] [LOCAL ] PACS: Loaded 25146 existing records from primary storage. [2025-09-17T05:41:02.170511] [INFO ] [MAIN ] PACS: Loaded 25146 existing records. [2025-09-17T05:41:02.295400] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-09-17T05:41:02.366817] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:41:02.367090] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-17T05:41:02.367151] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-17T05:41:02.367993] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-17T05:41:02.368068] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-17T05:41:02.744079] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:41:03.090110] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-17T05:41:03.473442] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T05:41:03.495269] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-17T05:41:03.501840] [INFO ] [REMOTE ] PAAS: Full fetch complete (77240 records). [2025-09-17T05:41:03.502005] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-17T05:41:03.891159] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-17T05:41:03.891468] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-17T05:41:03.892375] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-17T05:41:03.893611] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-17T05:41:03.893800] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-17T05:41:03.895553] [DEBUG] [LOCAL ] PAAS: Trimmed 77240 records to 53603 (keeping 200 days of data) [2025-09-17T05:41:04.232463] [DEBUG] [LOCAL ] PAAS: Primary data saved (53603 records). [2025-09-17T05:41:04.232667] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-17T05:41:04.232768] [INFO ] [MAIN ] Update Progress: 1621/2369 symbols completed. PAAS took 34.1s. Estimated remaining: 1h 49m 21s. Rate: 6.8 symbols/min [2025-09-17T05:41:04.400132] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:41:04.417864] [DEBUG] [LOCAL ] PAG: Loaded 15484 existing records from primary storage. [2025-09-17T05:41:04.418043] [INFO ] [MAIN ] PAG: Loaded 15484 existing records. [2025-09-17T05:41:04.597969] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:41:04.598297] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-17T05:41:04.598351] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-17T05:41:04.598879] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-17T05:41:04.598940] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-17T05:41:04.697236] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-11. [2025-09-17T05:41:04.970943] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:41:04.986205] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T05:41:05.490151] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-17T05:41:05.549541] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-17T05:41:06.290186] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-17T05:41:06.445132] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T05:41:06.508538] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T05:41:07.090181] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-09-17T05:41:07.890141] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-17T05:41:08.323917] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-17T05:41:08.330154] [INFO ] [REMOTE ] OXY: Full fetch complete (77518 records). [2025-09-17T05:41:08.330350] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-17T05:41:08.531339] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T05:41:08.532268] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:41:08.532349] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:41:08.532421] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-17T05:41:08.532560] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-17T05:41:08.532633] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-17T05:41:08.532759] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-17T05:41:08.532891] [INFO ] [MAIN ] Update Progress: 1622/2369 symbols completed. OXY took 44.4s. Estimated remaining: 1h 49m 10s. Rate: 6.8 symbols/min [2025-09-17T05:41:08.706865] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-11. [2025-09-17T05:41:08.709271] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:41:08.736345] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T05:41:08.775216] [DEBUG] [LOCAL ] PAGS: Loaded 39351 existing records from primary storage. [2025-09-17T05:41:08.775423] [INFO ] [MAIN ] PAGS: Loaded 39351 existing records. [2025-09-17T05:41:08.952912] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:41:08.953213] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-17T05:41:08.953287] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-17T05:41:08.954233] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-17T05:41:08.954315] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-17T05:41:09.317239] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:41:09.338798] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T05:41:09.491093] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-17T05:41:09.492736] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T05:41:10.290161] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-09-17T05:41:10.609532] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T05:41:11.090116] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-17T05:41:11.101544] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T05:41:11.890132] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-09-17T05:41:12.375052] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T05:41:12.690133] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-11. [2025-09-17T05:41:13.330215] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T05:41:13.490164] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-17T05:41:14.279313] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T05:41:14.291819] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-17T05:41:14.596479] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T05:41:15.090179] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-17T05:41:15.890147] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-17T05:41:16.216914] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T05:41:16.275552] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T05:41:16.690177] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-17T05:41:16.811015] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T05:41:17.490150] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-17T05:41:18.290143] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-17T05:41:18.475505] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T05:41:18.675333] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T05:41:19.090163] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-17T05:41:19.370722] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T05:41:19.890125] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-17T05:41:20.690609] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T05:41:20.690706] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-09-17T05:41:21.157769] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T05:41:21.162163] [INFO ] [REMOTE ] PACK: Full fetch complete (42870 records). [2025-09-17T05:41:21.162288] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-17T05:41:21.495525] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-17T05:41:21.545031] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-17T05:41:21.545162] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-17T05:41:21.546032] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-17T05:41:21.546093] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-17T05:41:21.547300] [DEBUG] [LOCAL ] PACK: Trimmed 42870 records to 32001 (keeping 200 days of data) [2025-09-17T05:41:21.736229] [DEBUG] [LOCAL ] PACK: Primary data saved (32001 records). [2025-09-17T05:41:21.736563] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-17T05:41:21.736889] [INFO ] [MAIN ] Update Progress: 1623/2369 symbols completed. PACK took 23.8s. Estimated remaining: 1h 49m 3s. Rate: 6.8 symbols/min [2025-09-17T05:41:21.826455] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T05:41:21.927867] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:41:21.931755] [DEBUG] [LOCAL ] PAI: Loaded 2013 existing records from primary storage. [2025-09-17T05:41:21.931892] [INFO ] [MAIN ] PAI: Loaded 2013 existing records. [2025-09-17T05:41:22.109529] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:41:22.109835] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-17T05:41:22.109896] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-17T05:41:22.110160] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-17T05:41:22.110240] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-17T05:41:22.298024] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-17T05:41:22.474847] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:41:22.915929] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T05:41:23.090150] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-17T05:41:23.515960] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T05:41:23.890148] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-17T05:41:24.660521] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T05:41:24.690099] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-17T05:41:25.090125] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T05:41:25.490197] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-17T05:41:26.290147] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-17T05:41:26.514194] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T05:41:26.545624] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T05:41:27.090137] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-17T05:41:27.577060] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T05:41:27.890126] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-17T05:41:28.103747] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T05:41:28.690120] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-11. [2025-09-17T05:41:28.965412] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T05:41:29.142381] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T05:41:29.490141] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-09-17T05:41:30.110271] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T05:41:30.290134] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-17T05:41:31.090185] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-17T05:41:31.656293] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T05:41:31.783801] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T05:41:31.890085] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-17T05:41:32.690115] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-17T05:41:33.009124] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T05:41:33.490137] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-17T05:41:34.008624] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T05:41:34.290137] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-09-17T05:41:34.679171] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-17T05:41:34.936761] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T05:41:35.090105] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-17T05:41:35.890144] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-17T05:41:36.357820] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T05:41:36.695252] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-17T05:41:36.715560] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T05:41:37.490136] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-17T05:41:38.044431] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T05:41:38.123456] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T05:41:38.131520] [INFO ] [REMOTE ] PACS: Full fetch complete (50813 records). [2025-09-17T05:41:38.132028] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-17T05:41:38.309188] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-17T05:41:38.622086] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-17T05:41:38.622215] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-17T05:41:38.623157] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-17T05:41:38.623217] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-17T05:41:38.625631] [DEBUG] [LOCAL ] PACS: Trimmed 50813 records to 33702 (keeping 200 days of data) [2025-09-17T05:41:38.831749] [DEBUG] [LOCAL ] PACS: Primary data saved (33702 records). [2025-09-17T05:41:38.831942] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-17T05:41:38.832063] [INFO ] [MAIN ] Update Progress: 1624/2369 symbols completed. PACS took 36.9s. Estimated remaining: 1h 48m 58s. Rate: 6.8 symbols/min [2025-09-17T05:41:39.003466] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:41:39.008170] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-17T05:41:39.008102] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T05:41:39.009852] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-17T05:41:39.010198] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-17T05:41:39.010256] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-17T05:41:39.010322] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-17T05:41:39.010379] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-17T05:41:39.095263] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-17T05:41:39.379445] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:41:39.890132] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-17T05:41:40.239562] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T05:41:40.348856] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T05:41:40.690185] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-17T05:41:41.490199] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-11. [2025-09-17T05:41:41.740906] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:41:41.741439] [WARN ] [REMOTE ] PAII: No data returned for month 2024-11 [2025-09-17T05:41:41.748664] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T05:41:41.751575] [INFO ] [REMOTE ] PAG: Full fetch complete (29755 records). [2025-09-17T05:41:41.751741] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-17T05:41:42.137278] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-17T05:41:42.137413] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-17T05:41:42.138180] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-17T05:41:42.138236] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-17T05:41:42.139598] [DEBUG] [LOCAL ] PAG: Trimmed 29755 records to 22217 (keeping 200 days of data) [2025-09-17T05:41:42.292629] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-17T05:41:42.300040] [DEBUG] [LOCAL ] PAG: Primary data saved (22217 records). [2025-09-17T05:41:42.300212] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-17T05:41:42.300329] [INFO ] [MAIN ] Update Progress: 1625/2369 symbols completed. PAG took 38.1s. Estimated remaining: 1h 48m 47s. Rate: 6.8 symbols/min [2025-09-17T05:41:42.487432] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:41:42.510068] [DEBUG] [LOCAL ] PAM: Loaded 20264 existing records from primary storage. [2025-09-17T05:41:42.510264] [INFO ] [MAIN ] PAM: Loaded 20264 existing records. [2025-09-17T05:41:42.554505] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:41:42.603563] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-17T05:41:42.701892] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:41:42.702199] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-17T05:41:42.702285] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-17T05:41:42.702837] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-17T05:41:42.702973] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-17T05:41:43.073347] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:41:43.090085] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-11. [2025-09-17T05:41:43.890188] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-17T05:41:44.364494] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T05:41:44.440934] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T05:41:44.690133] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-17T05:41:45.490154] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-09-17T05:41:46.290152] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-09-17T05:41:46.528955] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:41:46.529458] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-09-17T05:41:46.532448] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T05:41:46.839899] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T05:41:47.090172] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-17T05:41:47.284741] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:41:47.285137] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-17T05:41:47.890140] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-17T05:41:48.690199] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-09-17T05:41:49.490142] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-17T05:41:49.647219] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T05:41:49.797776] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-17T05:41:49.965015] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T05:41:50.290134] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-17T05:41:51.090141] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-17T05:41:51.545969] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T05:41:51.555722] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T05:41:51.890140] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-17T05:41:52.595249] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T05:41:52.596860] [INFO ] [REMOTE ] PAI: Full fetch complete (4129 records). [2025-09-17T05:41:52.596957] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-17T05:41:52.695631] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-17T05:41:52.940510] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:41:52.967496] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-17T05:41:52.972587] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-17T05:41:52.972686] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-17T05:41:52.972852] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-17T05:41:52.972904] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-17T05:41:52.973309] [DEBUG] [LOCAL ] PAI: Trimmed 4129 records to 2716 (keeping 200 days of data) [2025-09-17T05:41:52.990581] [DEBUG] [LOCAL ] PAI: Primary data saved (2716 records). [2025-09-17T05:41:52.990680] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-17T05:41:52.990786] [INFO ] [MAIN ] Update Progress: 1626/2369 symbols completed. PAI took 31.3s. Estimated remaining: 1h 48m 39s. Rate: 6.8 symbols/min [2025-09-17T05:41:53.159358] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:41:53.185989] [DEBUG] [LOCAL ] PAR: Loaded 24137 existing records from primary storage. [2025-09-17T05:41:53.186158] [INFO ] [MAIN ] PAR: Loaded 24137 existing records. [2025-09-17T05:41:53.360436] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:41:53.360721] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-17T05:41:53.360787] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-17T05:41:53.361472] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-17T05:41:53.361540] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-17T05:41:53.502754] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-17T05:41:53.718497] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:41:54.290125] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-17T05:41:55.090099] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-17T05:41:55.277552] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:41:55.277960] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-17T05:41:55.347364] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T05:41:55.353999] [INFO ] [REMOTE ] PAGS: Full fetch complete (76187 records). [2025-09-17T05:41:55.354185] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-17T05:41:55.756212] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-17T05:41:55.768584] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-17T05:41:55.769259] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T05:41:55.776227] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-17T05:41:55.776784] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-17T05:41:55.778299] [DEBUG] [LOCAL ] PAGS: Trimmed 76187 records to 52680 (keeping 200 days of data) [2025-09-17T05:41:55.892974] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-17T05:41:56.102416] [DEBUG] [LOCAL ] PAGS: Primary data saved (52680 records). [2025-09-17T05:41:56.102612] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-17T05:41:56.102763] [INFO ] [MAIN ] Update Progress: 1627/2369 symbols completed. PAGS took 47.6s. Estimated remaining: 1h 48m 28s. Rate: 6.8 symbols/min [2025-09-17T05:41:56.274542] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:41:56.310448] [DEBUG] [LOCAL ] PARR: Loaded 35926 existing records from primary storage. [2025-09-17T05:41:56.310663] [INFO ] [MAIN ] PARR: Loaded 35926 existing records. [2025-09-17T05:41:56.488904] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:41:56.489226] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-17T05:41:56.489285] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-17T05:41:56.490313] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-17T05:41:56.490376] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-17T05:41:56.701348] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-17T05:41:56.856563] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:41:56.958620] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:41:56.959077] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-17T05:41:57.257444] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T05:41:57.490157] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-17T05:41:58.290202] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-11. [2025-09-17T05:41:58.405764] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T05:41:59.090184] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-17T05:41:59.663077] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T05:41:59.890139] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-11. [2025-09-17T05:42:00.142770] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T05:42:00.690273] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-17T05:42:01.346186] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T05:42:01.490166] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-17T05:42:01.898031] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:42:01.898425] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-17T05:42:02.155062] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T05:42:02.290149] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-09-17T05:42:03.090136] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-09-17T05:42:03.890193] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-17T05:42:04.265283] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:42:04.265740] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-17T05:42:04.690224] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-17T05:42:04.914919] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:42:04.916401] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-17T05:42:04.916966] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-17T05:42:05.090120] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T05:42:05.490185] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-09-17T05:42:06.290178] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-17T05:42:06.588741] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-17T05:42:06.589435] [INFO ] [REMOTE ] PAII: Full fetch complete (36 records). [2025-09-17T05:42:06.589532] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-17T05:42:06.777971] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 5 unique days, need 200 days [2025-09-17T05:42:06.778197] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:42:06.778250] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:42:06.778347] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-17T05:42:06.778458] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-17T05:42:06.778533] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-17T05:42:06.778668] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-17T05:42:06.778762] [INFO ] [MAIN ] Update Progress: 1628/2369 symbols completed. PAII took 27.9s. Estimated remaining: 1h 48m 20s. Rate: 6.8 symbols/min [2025-09-17T05:42:06.957822] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:42:06.994262] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T05:42:07.041119] [DEBUG] [LOCAL ] PATH: Loaded 40034 existing records from primary storage. [2025-09-17T05:42:07.041339] [INFO ] [MAIN ] PATH: Loaded 40034 existing records. [2025-09-17T05:42:07.097254] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-17T05:42:07.223961] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:42:07.224239] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-17T05:42:07.224314] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-17T05:42:07.225346] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-17T05:42:07.225424] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-17T05:42:07.603986] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:42:07.890089] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-17T05:42:08.369389] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T05:42:08.690159] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-09-17T05:42:08.905019] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T05:42:09.490190] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-11. [2025-09-17T05:42:10.264024] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T05:42:10.290137] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-17T05:42:11.090143] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-17T05:42:11.556098] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T05:42:11.605403] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T05:42:11.890142] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-17T05:42:12.450954] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T05:42:12.456195] [INFO ] [REMOTE ] PAM: Full fetch complete (41659 records). [2025-09-17T05:42:12.456380] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-17T05:42:12.697851] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-09-17T05:42:12.856320] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-17T05:42:12.856469] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-17T05:42:12.857494] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-17T05:42:12.857565] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-17T05:42:12.858865] [DEBUG] [LOCAL ] PAM: Trimmed 41659 records to 27442 (keeping 200 days of data) [2025-09-17T05:42:12.986396] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T05:42:13.052833] [DEBUG] [LOCAL ] PAM: Primary data saved (27442 records). [2025-09-17T05:42:13.053024] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-17T05:42:13.053128] [INFO ] [MAIN ] Update Progress: 1629/2369 symbols completed. PAM took 30.8s. Estimated remaining: 1h 48m 10s. Rate: 6.8 symbols/min [2025-09-17T05:42:13.223080] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:42:13.239751] [DEBUG] [LOCAL ] PAXS: Loaded 15865 existing records from primary storage. [2025-09-17T05:42:13.239933] [INFO ] [MAIN ] PAXS: Loaded 15865 existing records. [2025-09-17T05:42:13.422616] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:42:13.422947] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-17T05:42:13.423021] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-17T05:42:13.423591] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-17T05:42:13.423695] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-17T05:42:13.498126] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-17T05:42:13.778032] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:42:14.290142] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-11. [2025-09-17T05:42:14.852339] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T05:42:15.090176] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-17T05:42:15.146241] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-17T05:42:15.342806] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T05:42:15.890213] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-09-17T05:42:16.259400] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T05:42:16.690154] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-17T05:42:17.372525] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T05:42:17.490143] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-17T05:42:18.290195] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-09-17T05:42:18.851010] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-17T05:42:19.090123] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-17T05:42:19.296377] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T05:42:19.554998] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T05:42:19.890184] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-17T05:42:20.657081] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T05:42:20.690120] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-17T05:42:21.294928] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T05:42:21.490185] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-09-17T05:42:21.937613] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T05:42:22.290172] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-17T05:42:23.090157] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-17T05:42:23.765899] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-17T05:42:23.893844] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-17T05:42:23.896974] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T05:42:24.140422] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T05:42:24.145723] [INFO ] [REMOTE ] PAR: Full fetch complete (46773 records). [2025-09-17T05:42:24.145868] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-17T05:42:24.527672] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-17T05:42:24.527793] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-17T05:42:24.528694] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-17T05:42:24.528762] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-17T05:42:24.529820] [DEBUG] [LOCAL ] PAR: Trimmed 46773 records to 32494 (keeping 200 days of data) [2025-09-17T05:42:24.691768] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-17T05:42:24.736307] [DEBUG] [LOCAL ] PAR: Primary data saved (32494 records). [2025-09-17T05:42:24.736509] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-17T05:42:24.736614] [INFO ] [MAIN ] Update Progress: 1630/2369 symbols completed. PAR took 31.7s. Estimated remaining: 1h 48m 2s. Rate: 6.8 symbols/min [2025-09-17T05:42:24.913584] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:42:24.940996] [DEBUG] [LOCAL ] PAY: Loaded 28642 existing records from primary storage. [2025-09-17T05:42:24.941175] [INFO ] [MAIN ] PAY: Loaded 28642 existing records. [2025-09-17T05:42:25.117585] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:42:25.117854] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-17T05:42:25.117913] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-17T05:42:25.118537] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-17T05:42:25.118595] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-17T05:42:25.474567] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:42:25.490081] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-11. [2025-09-17T05:42:25.650455] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T05:42:26.019159] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-17T05:42:26.290156] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-17T05:42:26.492200] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T05:42:27.090168] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-17T05:42:27.257910] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T05:42:27.890182] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-17T05:42:28.690140] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-09-17T05:42:28.849788] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T05:42:29.490232] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-17T05:42:30.046365] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T05:42:30.290158] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-09-17T05:42:30.347970] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-17T05:42:31.090209] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-17T05:42:31.168580] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T05:42:31.613306] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T05:42:31.890214] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-17T05:42:32.690200] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-17T05:42:33.174942] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T05:42:33.392330] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-17T05:42:33.490172] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-17T05:42:34.099540] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T05:42:34.290213] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-17T05:42:35.090158] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-17T05:42:35.650379] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T05:42:35.691916] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-17T05:42:35.890217] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-17T05:42:36.689237] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T05:42:36.695263] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-17T05:42:36.698097] [INFO ] [REMOTE ] PARR: Full fetch complete (68201 records). [2025-09-17T05:42:36.698308] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-17T05:42:37.094616] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-17T05:42:37.094751] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-17T05:42:37.095797] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-17T05:42:37.095855] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-17T05:42:37.097812] [DEBUG] [LOCAL ] PARR: Trimmed 68201 records to 48464 (keeping 200 days of data) [2025-09-17T05:42:37.403524] [DEBUG] [LOCAL ] PARR: Primary data saved (48464 records). [2025-09-17T05:42:37.403802] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-17T05:42:37.403976] [INFO ] [MAIN ] Update Progress: 1631/2369 symbols completed. PARR took 41.3s. Estimated remaining: 1h 47m 55s. Rate: 6.8 symbols/min [2025-09-17T05:42:37.495286] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-17T05:42:37.578917] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:42:37.605991] [DEBUG] [LOCAL ] PAYC: Loaded 26339 existing records from primary storage. [2025-09-17T05:42:37.606193] [INFO ] [MAIN ] PAYC: Loaded 26339 existing records. [2025-09-17T05:42:37.786059] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:42:37.786492] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-17T05:42:37.786561] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-17T05:42:37.787435] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-17T05:42:37.787504] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-17T05:42:38.105592] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-17T05:42:38.196823] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:42:38.219755] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T05:42:38.252627] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T05:42:38.290212] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-17T05:42:39.090131] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-17T05:42:39.331372] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T05:42:39.890197] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-11. [2025-09-17T05:42:40.574048] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T05:42:40.690107] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-17T05:42:41.435771] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T05:42:41.490127] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-17T05:42:42.094703] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T05:42:42.290189] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-09-17T05:42:42.508082] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T05:42:43.090158] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-17T05:42:43.771409] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T05:42:43.890145] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-17T05:42:44.629251] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T05:42:44.690160] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-17T05:42:45.490146] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-09-17T05:42:46.126031] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-17T05:42:46.234265] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T05:42:46.290144] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-17T05:42:46.526469] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T05:42:47.090159] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-17T05:42:47.662190] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T05:42:47.667327] [INFO ] [REMOTE ] PAY: Full fetch complete (52824 records). [2025-09-17T05:42:47.667484] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-17T05:42:47.895331] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-17T05:42:48.069702] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-17T05:42:48.069822] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-17T05:42:48.070955] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-17T05:42:48.071043] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-17T05:42:48.072468] [DEBUG] [LOCAL ] PAY: Trimmed 52824 records to 38059 (keeping 200 days of data) [2025-09-17T05:42:48.296951] [DEBUG] [LOCAL ] PAY: Primary data saved (38059 records). [2025-09-17T05:42:48.297121] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-17T05:42:48.297222] [INFO ] [MAIN ] Update Progress: 1632/2369 symbols completed. PAY took 23.6s. Estimated remaining: 1h 47m 47s. Rate: 6.8 symbols/min [2025-09-17T05:42:48.467738] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:42:48.498440] [DEBUG] [LOCAL ] PB: Loaded 31070 existing records from primary storage. [2025-09-17T05:42:48.498605] [INFO ] [MAIN ] PB: Loaded 31070 existing records. [2025-09-17T05:42:48.677956] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:42:48.678240] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-17T05:42:48.678308] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-17T05:42:48.679282] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-17T05:42:48.679351] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-17T05:42:48.711097] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-17T05:42:49.052918] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:42:49.345206] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-17T05:42:49.497137] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-17T05:42:49.512798] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T05:42:50.027871] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T05:42:50.290151] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-11. [2025-09-17T05:42:51.090127] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-17T05:42:51.563711] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-17T05:42:51.570560] [INFO ] [REMOTE ] PATH: Full fetch complete (77702 records). [2025-09-17T05:42:51.570765] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-17T05:42:51.896207] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-17T05:42:51.980474] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-17T05:42:51.980780] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-17T05:42:51.982498] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-17T05:42:52.004609] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-17T05:42:52.006673] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T05:42:52.015865] [DEBUG] [LOCAL ] PATH: Trimmed 77702 records to 53678 (keeping 200 days of data) [2025-09-17T05:42:52.352506] [DEBUG] [LOCAL ] PATH: Primary data saved (53678 records). [2025-09-17T05:42:52.352724] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-17T05:42:52.352838] [INFO ] [MAIN ] Update Progress: 1633/2369 symbols completed. PATH took 45.6s. Estimated remaining: 1h 47m 37s. Rate: 6.8 symbols/min [2025-09-17T05:42:52.526503] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:42:52.562622] [DEBUG] [LOCAL ] PBA: Loaded 36557 existing records from primary storage. [2025-09-17T05:42:52.562944] [INFO ] [MAIN ] PBA: Loaded 36557 existing records. [2025-09-17T05:42:52.694671] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-17T05:42:52.758378] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:42:52.758952] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-17T05:42:52.759088] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-17T05:42:52.771879] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-17T05:42:52.790755] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-17T05:42:52.792687] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T05:42:53.044014] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T05:42:53.209945] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:42:53.490145] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-17T05:42:54.193995] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T05:42:54.290131] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-17T05:42:54.563981] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T05:42:54.566931] [INFO ] [REMOTE ] PAXS: Full fetch complete (31512 records). [2025-09-17T05:42:54.567024] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-17T05:42:54.941748] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-17T05:42:54.941859] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-17T05:42:54.942549] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-17T05:42:54.942603] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-17T05:42:54.943483] [DEBUG] [LOCAL ] PAXS: Trimmed 31512 records to 21177 (keeping 200 days of data) [2025-09-17T05:42:55.077589] [DEBUG] [LOCAL ] PAXS: Primary data saved (21177 records). [2025-09-17T05:42:55.077764] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-17T05:42:55.077868] [INFO ] [MAIN ] Update Progress: 1634/2369 symbols completed. PAXS took 42.0s. Estimated remaining: 1h 47m 25s. Rate: 6.8 symbols/min [2025-09-17T05:42:55.099139] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-17T05:42:55.257615] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:42:55.301595] [DEBUG] [LOCAL ] PBF: Loaded 39624 existing records from primary storage. [2025-09-17T05:42:55.301782] [INFO ] [MAIN ] PBF: Loaded 39624 existing records. [2025-09-17T05:42:55.483599] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:42:55.483907] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-17T05:42:55.483975] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-17T05:42:55.484803] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-17T05:42:55.484863] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-17T05:42:55.844511] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:42:55.869211] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T05:42:55.890082] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-17T05:42:56.699139] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-11. [2025-09-17T05:42:56.720952] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T05:42:57.388739] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T05:42:57.490140] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-17T05:42:58.290184] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-11. [2025-09-17T05:42:58.414923] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T05:42:58.814422] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T05:42:59.090177] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-09-17T05:42:59.890166] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-17T05:43:00.063676] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T05:43:00.690159] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-09-17T05:43:00.988520] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T05:43:01.351413] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T05:43:01.490143] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-17T05:43:02.290120] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-09-17T05:43:02.377226] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T05:43:02.944346] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T05:43:03.090078] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-17T05:43:03.890205] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-17T05:43:04.088161] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T05:43:04.520240] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T05:43:04.524927] [INFO ] [REMOTE ] PAYC: Full fetch complete (52558 records). [2025-09-17T05:43:04.525091] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-17T05:43:04.690764] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-09-17T05:43:04.926795] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-17T05:43:04.926961] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-17T05:43:04.927946] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-17T05:43:04.928151] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-17T05:43:04.929772] [DEBUG] [LOCAL ] PAYC: Trimmed 52558 records to 36455 (keeping 200 days of data) [2025-09-17T05:43:04.951377] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T05:43:05.189613] [DEBUG] [LOCAL ] PAYC: Primary data saved (36455 records). [2025-09-17T05:43:05.189835] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-17T05:43:05.189982] [INFO ] [MAIN ] Update Progress: 1635/2369 symbols completed. PAYC took 27.8s. Estimated remaining: 1h 47m 17s. Rate: 6.8 symbols/min [2025-09-17T05:43:05.362847] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:43:05.385037] [DEBUG] [LOCAL ] PBH: Loaded 23938 existing records from primary storage. [2025-09-17T05:43:05.385201] [INFO ] [MAIN ] PBH: Loaded 23938 existing records. [2025-09-17T05:43:05.495218] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-17T05:43:05.563405] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:43:05.563638] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-17T05:43:05.563735] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-17T05:43:05.564373] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-17T05:43:05.564453] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-17T05:43:05.913710] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:43:06.290164] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-17T05:43:06.463565] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T05:43:06.973312] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T05:43:07.090135] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-17T05:43:07.745388] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T05:43:07.890127] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-17T05:43:08.695596] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-11. [2025-09-17T05:43:08.711834] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T05:43:09.490139] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-17T05:43:09.674603] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T05:43:09.873435] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T05:43:10.290148] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-09-17T05:43:10.984999] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T05:43:11.090145] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-17T05:43:11.425970] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T05:43:11.890168] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-17T05:43:12.690139] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-09-17T05:43:12.913712] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T05:43:13.479340] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T05:43:13.490077] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-17T05:43:13.949468] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T05:43:14.290164] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-17T05:43:15.063919] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T05:43:15.090080] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-17T05:43:15.890171] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-17T05:43:16.230602] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T05:43:16.690152] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-17T05:43:16.744179] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T05:43:16.896174] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T05:43:17.490191] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-17T05:43:18.290152] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-17T05:43:18.405686] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T05:43:19.090116] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-17T05:43:19.243464] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T05:43:19.475171] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T05:43:19.890187] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-17T05:43:20.681469] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T05:43:20.692627] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-17T05:43:21.490213] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-17T05:43:21.587897] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T05:43:22.036256] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T05:43:22.290165] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-17T05:43:22.948334] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T05:43:23.090104] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-17T05:43:23.455470] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T05:43:23.890155] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-17T05:43:24.347838] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T05:43:24.690118] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-17T05:43:25.110305] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T05:43:25.490163] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-17T05:43:26.290211] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-17T05:43:26.521950] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T05:43:27.060945] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T05:43:27.090092] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-17T05:43:27.890151] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-17T05:43:28.040437] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T05:43:28.652452] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T05:43:28.658696] [INFO ] [REMOTE ] PB: Full fetch complete (57191 records). [2025-09-17T05:43:28.658908] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-17T05:43:28.695254] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-17T05:43:29.051832] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-17T05:43:29.051961] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-17T05:43:29.053034] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-17T05:43:29.053095] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-17T05:43:29.054358] [DEBUG] [LOCAL ] PB: Trimmed 57191 records to 41317 (keeping 200 days of data) [2025-09-17T05:43:29.298867] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T05:43:29.346706] [DEBUG] [LOCAL ] PB: Primary data saved (41317 records). [2025-09-17T05:43:29.346979] [INFO ] [MAIN ] PB: Full history saved. [2025-09-17T05:43:29.347099] [INFO ] [MAIN ] Update Progress: 1636/2369 symbols completed. PB took 41.0s. Estimated remaining: 1h 47m 15s. Rate: 6.8 symbols/min [2025-09-17T05:43:29.499330] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-17T05:43:29.519184] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:43:29.556917] [DEBUG] [LOCAL ] PBI: Loaded 37127 existing records from primary storage. [2025-09-17T05:43:29.557115] [INFO ] [MAIN ] PBI: Loaded 37127 existing records. [2025-09-17T05:43:29.778807] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:43:29.779142] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-17T05:43:29.779222] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-17T05:43:29.780057] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-17T05:43:29.780127] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-17T05:43:30.133163] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:43:30.290160] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-11. [2025-09-17T05:43:30.411010] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T05:43:30.951919] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T05:43:30.958538] [INFO ] [REMOTE ] PBF: Full fetch complete (76323 records). [2025-09-17T05:43:30.958720] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-17T05:43:31.100399] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-17T05:43:31.359327] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-17T05:43:31.359462] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-17T05:43:31.360691] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-17T05:43:31.360769] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-17T05:43:31.362484] [DEBUG] [LOCAL ] PBF: Trimmed 76323 records to 53093 (keeping 200 days of data) [2025-09-17T05:43:31.694021] [DEBUG] [LOCAL ] PBF: Primary data saved (53093 records). [2025-09-17T05:43:31.694199] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-17T05:43:31.694306] [INFO ] [MAIN ] Update Progress: 1637/2369 symbols completed. PBF took 36.6s. Estimated remaining: 1h 47m 3s. Rate: 6.8 symbols/min [2025-09-17T05:43:31.890121] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-17T05:43:31.971014] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T05:43:32.518206] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T05:43:32.524452] [INFO ] [REMOTE ] PBA: Full fetch complete (71452 records). [2025-09-17T05:43:32.524624] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-17T05:43:32.699466] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-09-17T05:43:32.918892] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-17T05:43:32.919003] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-17T05:43:32.920081] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-17T05:43:32.920141] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-17T05:43:32.921680] [DEBUG] [LOCAL ] PBA: Trimmed 71452 records to 49111 (keeping 200 days of data) [2025-09-17T05:43:33.253045] [DEBUG] [LOCAL ] PBA: Primary data saved (49111 records). [2025-09-17T05:43:33.253239] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-17T05:43:33.253356] [INFO ] [MAIN ] Update Progress: 1638/2369 symbols completed. PBA took 40.9s. Estimated remaining: 1h 46m 51s. Rate: 6.8 symbols/min [2025-09-17T05:43:33.305010] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T05:43:33.490120] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-17T05:43:34.046597] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T05:43:34.290284] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-09-17T05:43:35.004928] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T05:43:35.010426] [INFO ] [REMOTE ] PBH: Full fetch complete (42287 records). [2025-09-17T05:43:35.010599] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-17T05:43:35.400959] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-17T05:43:35.401097] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-17T05:43:35.402151] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-17T05:43:35.402239] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-17T05:43:35.403426] [DEBUG] [LOCAL ] PBH: Trimmed 42287 records to 31362 (keeping 200 days of data) [2025-09-17T05:43:35.607339] [DEBUG] [LOCAL ] PBH: Primary data saved (31362 records). [2025-09-17T05:43:35.607558] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-17T05:43:35.607807] [INFO ] [MAIN ] Update Progress: 1639/2369 symbols completed. PBH took 30.4s. Estimated remaining: 1h 46m 40s. Rate: 6.8 symbols/min [2025-09-17T05:43:35.636773] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T05:43:35.647051] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-17T05:43:37.274372] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T05:43:37.284191] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-17T05:43:38.823786] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T05:43:38.834897] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-17T05:43:40.587323] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T05:43:40.599485] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-17T05:43:42.233296] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T05:43:42.243853] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-17T05:43:43.809830] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T05:43:43.820239] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-17T05:43:45.681270] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T05:43:45.692946] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-17T05:43:47.444089] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T05:43:47.458995] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-17T05:43:49.134799] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T05:43:49.142185] [INFO ] [REMOTE ] PBI: Full fetch complete (71738 records). [2025-09-17T05:43:49.142441] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-17T05:43:49.535049] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-17T05:43:49.535196] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-17T05:43:49.536313] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-17T05:43:49.536377] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-17T05:43:49.537915] [DEBUG] [LOCAL ] PBI: Trimmed 71738 records to 50164 (keeping 200 days of data) [2025-09-17T05:43:49.865072] [DEBUG] [LOCAL ] PBI: Primary data saved (50164 records). [2025-09-17T05:43:49.865283] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-17T05:43:49.865468] [INFO ] [MAIN ] Update Progress: 1640/2369 symbols completed. PBI took 20.5s. Estimated remaining: 1h 46m 33s. Rate: 6.8 symbols/min [2025-09-17T05:43:50.548435] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:43:50.569251] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:43:50.635545] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:43:50.593604] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:43:50.652118] [DEBUG] [LOCAL ] PCF: Loaded 6580 existing records from primary storage. [2025-09-17T05:43:50.656740] [INFO ] [MAIN ] PCF: Loaded 6580 existing records. [2025-09-17T05:43:50.742798] [DEBUG] [LOCAL ] PBT: Loaded 13404 existing records from primary storage. [2025-09-17T05:43:50.759257] [INFO ] [MAIN ] PBT: Loaded 13404 existing records. [2025-09-17T05:43:50.987849] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:43:51.005223] [DEBUG] [LOCAL ] PBR: Loaded 40068 existing records from primary storage. [2025-09-17T05:43:51.039542] [INFO ] [MAIN ] PBR: Loaded 40068 existing records. [2025-09-17T05:43:51.039734] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-17T05:43:51.047029] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-17T05:43:51.041631] [DEBUG] [LOCAL ] PCG: Loaded 40069 existing records from primary storage. [2025-09-17T05:43:51.087932] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-17T05:43:51.103859] [INFO ] [MAIN ] PCG: Loaded 40069 existing records. [2025-09-17T05:43:51.167239] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-17T05:43:51.231291] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:43:51.304528] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-17T05:43:51.372331] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-17T05:43:51.449768] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-17T05:43:51.484601] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-17T05:43:51.642963] [WARN ] [MAIN ] PCG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:43:51.792967] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:43:51.882230] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-17T05:43:51.943917] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-17T05:43:51.943859] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-17T05:43:52.003262] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-17T05:43:52.019309] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-17T05:43:52.052167] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-17T05:43:52.058539] [DEBUG] [LOCAL ] PCG: Deleted primary data file. [2025-09-17T05:43:52.164576] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-17T05:43:52.268212] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:43:52.312345] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-11. [2025-09-17T05:43:52.519471] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:43:52.573528] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-11. [2025-09-17T05:43:52.915089] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:43:52.915899] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-11. [2025-09-17T05:43:52.997539] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:43:52.997928] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-11. [2025-09-17T05:43:53.417814] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T05:43:53.422391] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-09-17T05:43:53.764714] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T05:43:53.769521] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-09-17T05:43:54.444122] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T05:43:54.448174] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-09-17T05:43:54.786842] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T05:43:54.798072] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-17T05:43:54.837743] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T05:43:54.842546] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-09-17T05:43:54.971177] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T05:43:54.973938] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-17T05:43:55.023483] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-17T05:43:55.034011] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-09-17T05:43:55.458754] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T05:43:55.462127] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-17T05:43:55.799085] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T05:43:55.803164] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-17T05:43:55.898572] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T05:43:55.900973] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-17T05:43:56.493260] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T05:43:56.496782] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-17T05:43:56.530705] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T05:43:56.541910] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-17T05:43:56.665191] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T05:43:56.667877] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-17T05:43:56.926073] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T05:43:56.937440] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-09-17T05:43:57.100503] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T05:43:57.102953] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-17T05:43:57.255204] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T05:43:57.260165] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-17T05:43:57.762261] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T05:43:57.765109] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-17T05:43:57.900123] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T05:43:58.290175] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-17T05:43:58.448160] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T05:43:58.459586] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T05:43:58.797870] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T05:43:59.050539] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T05:43:59.090142] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-17T05:43:59.866394] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T05:43:59.890125] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-17T05:44:00.690176] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-17T05:44:00.893975] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T05:44:01.490155] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-17T05:44:01.636553] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T05:44:01.640004] [INFO ] [REMOTE ] PCF: Full fetch complete (14780 records). [2025-09-17T05:44:01.640163] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-17T05:44:02.028834] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-17T05:44:02.028942] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-17T05:44:02.029320] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-17T05:44:02.029388] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-17T05:44:02.029975] [DEBUG] [LOCAL ] PCF: Trimmed 14780 records to 8753 (keeping 200 days of data) [2025-09-17T05:44:02.084631] [DEBUG] [LOCAL ] PCF: Primary data saved (8753 records). [2025-09-17T05:44:02.084837] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-17T05:44:02.084988] [INFO ] [MAIN ] Update Progress: 1641/2369 symbols completed. PCF took 12.2s. Estimated remaining: 1h 46m 26s. Rate: 6.8 symbols/min [2025-09-17T05:44:02.255213] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:44:02.261908] [DEBUG] [LOCAL ] PCM: Loaded 4972 existing records from primary storage. [2025-09-17T05:44:02.262051] [INFO ] [MAIN ] PCM: Loaded 4972 existing records. [2025-09-17T05:44:02.293498] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-17T05:44:02.474178] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T05:44:02.473410] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:44:02.478946] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-17T05:44:02.479464] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-17T05:44:02.479809] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-17T05:44:02.479870] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-17T05:44:02.832614] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:44:03.090130] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-17T05:44:03.890201] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-17T05:44:04.304734] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T05:44:04.690136] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-11. [2025-09-17T05:44:04.970916] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T05:44:05.074310] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T05:44:05.323370] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T05:44:05.490124] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-17T05:44:06.290380] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-17T05:44:07.090141] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-09-17T05:44:07.359675] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T05:44:07.362733] [INFO ] [REMOTE ] PBT: Full fetch complete (25422 records). [2025-09-17T05:44:07.362877] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-17T05:44:07.641175] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T05:44:07.706893] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-17T05:44:07.791796] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-17T05:44:07.791889] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-17T05:44:07.792521] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-17T05:44:07.792574] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-17T05:44:07.793252] [DEBUG] [LOCAL ] PBT: Trimmed 25422 records to 17639 (keeping 200 days of data) [2025-09-17T05:44:07.890210] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-17T05:44:07.909919] [DEBUG] [LOCAL ] PBT: Primary data saved (17639 records). [2025-09-17T05:44:07.910042] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-17T05:44:07.910147] [INFO ] [MAIN ] Update Progress: 1642/2369 symbols completed. PBT took 18.0s. Estimated remaining: 1h 46m 16s. Rate: 6.8 symbols/min [2025-09-17T05:44:08.079658] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:44:08.098717] [DEBUG] [LOCAL ] PCN: Loaded 18268 existing records from primary storage. [2025-09-17T05:44:08.098885] [INFO ] [MAIN ] PCN: Loaded 18268 existing records. [2025-09-17T05:44:08.275638] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:44:08.275901] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-17T05:44:08.275957] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-17T05:44:08.276581] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-17T05:44:08.276665] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-17T05:44:08.633853] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:44:08.690142] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-11. [2025-09-17T05:44:09.490230] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-17T05:44:09.734613] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T05:44:09.897851] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T05:44:10.290145] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-17T05:44:11.090114] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-09-17T05:44:11.302252] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T05:44:11.890176] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-17T05:44:12.231381] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T05:44:12.555332] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-17T05:44:12.690137] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-09-17T05:44:13.490131] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-17T05:44:13.703666] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T05:44:13.806485] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T05:44:14.290144] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-17T05:44:15.090151] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-09-17T05:44:15.548563] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T05:44:15.881483] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T05:44:15.890065] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-17T05:44:16.068890] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T05:44:16.582606] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T05:44:16.690157] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-17T05:44:17.490177] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-17T05:44:18.276135] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T05:44:18.290083] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-17T05:44:18.741780] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-17T05:44:19.007433] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T05:44:19.090079] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-17T05:44:19.890172] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-17T05:44:20.690155] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-17T05:44:21.187441] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T05:44:21.296731] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T05:44:21.490134] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-17T05:44:21.632863] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T05:44:22.269008] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T05:44:22.290090] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-17T05:44:22.955205] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T05:44:23.090121] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-17T05:44:23.791217] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T05:44:23.890122] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-17T05:44:24.690148] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-17T05:44:25.490140] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-17T05:44:25.825018] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T05:44:26.290189] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-17T05:44:26.547574] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T05:44:26.613411] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T05:44:27.090141] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-17T05:44:27.890182] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-17T05:44:27.901396] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T05:44:27.903294] [INFO ] [REMOTE ] PCM: Full fetch complete (10392 records). [2025-09-17T05:44:27.903378] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-17T05:44:28.264082] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-17T05:44:28.264187] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-17T05:44:28.264578] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-17T05:44:28.264804] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-17T05:44:28.280963] [DEBUG] [LOCAL ] PCM: Trimmed 10392 records to 6779 (keeping 200 days of data) [2025-09-17T05:44:28.281954] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-17T05:44:28.305704] [INFO ] [REMOTE ] PCG: Full fetch complete (77581 records). [2025-09-17T05:44:28.318525] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-17T05:44:28.599774] [DEBUG] [LOCAL ] PCM: Primary data saved (6779 records). [2025-09-17T05:44:28.626916] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-17T05:44:28.637478] [INFO ] [MAIN ] Update Progress: 1643/2369 symbols completed. PCM took 26.6s. Estimated remaining: 1h 46m 13s. Rate: 6.8 symbols/min [2025-09-17T05:44:28.698554] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-17T05:44:28.791627] [DEBUG] [VALIDATOR ] PCG: All expected trading days are present. [2025-09-17T05:44:28.817617] [DEBUG] [VALIDATOR ] PCG: Primary data validation passed. [2025-09-17T05:44:28.857503] [INFO ] [MAIN ] PCG: Fetched primary data is valid. [2025-09-17T05:44:28.859130] [DEBUG] [LOCAL ] PCG: Saving primary data. [2025-09-17T05:44:28.858969] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T05:44:28.932239] [DEBUG] [LOCAL ] PCG: Trimmed 77581 records to 53718 (keeping 200 days of data) [2025-09-17T05:44:28.934873] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:44:29.202988] [DEBUG] [LOCAL ] PCOR: Loaded 35516 existing records from primary storage. [2025-09-17T05:44:29.204690] [INFO ] [MAIN ] PCOR: Loaded 35516 existing records. [2025-09-17T05:44:29.468126] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:44:29.469834] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-17T05:44:29.471337] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-17T05:44:29.472366] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-17T05:44:29.472775] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-17T05:44:29.495573] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-17T05:44:29.870296] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:44:29.874836] [DEBUG] [LOCAL ] PCG: Primary data saved (53718 records). [2025-09-17T05:44:29.874948] [INFO ] [MAIN ] PCG: Full history saved. [2025-09-17T05:44:29.875075] [INFO ] [MAIN ] Update Progress: 1644/2369 symbols completed. PCG took 40.0s. Estimated remaining: 1h 46m 1s. Rate: 6.8 symbols/min [2025-09-17T05:44:30.043403] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:44:30.053112] [DEBUG] [LOCAL ] PCQ: Loaded 8657 existing records from primary storage. [2025-09-17T05:44:30.053262] [INFO ] [MAIN ] PCQ: Loaded 8657 existing records. [2025-09-17T05:44:30.228007] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:44:30.228268] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-17T05:44:30.228351] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-17T05:44:30.228832] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-17T05:44:30.228910] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-17T05:44:30.296464] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-11. [2025-09-17T05:44:30.584584] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:44:30.789969] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-17T05:44:30.796476] [INFO ] [REMOTE ] PBR: Full fetch complete (77702 records). [2025-09-17T05:44:30.796691] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-17T05:44:31.093082] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-11. [2025-09-17T05:44:31.249081] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-17T05:44:31.249697] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-17T05:44:31.250331] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T05:44:31.257324] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-17T05:44:31.257734] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-17T05:44:31.259428] [DEBUG] [LOCAL ] PBR: Trimmed 77702 records to 53715 (keeping 200 days of data) [2025-09-17T05:44:31.598535] [DEBUG] [LOCAL ] PBR: Primary data saved (53715 records). [2025-09-17T05:44:31.598742] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-17T05:44:31.598937] [INFO ] [MAIN ] Update Progress: 1645/2369 symbols completed. PBR took 41.7s. Estimated remaining: 1h 45m 49s. Rate: 6.8 symbols/min [2025-09-17T05:44:31.771503] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:44:31.810736] [DEBUG] [LOCAL ] PD: Loaded 35634 existing records from primary storage. [2025-09-17T05:44:31.810928] [INFO ] [MAIN ] PD: Loaded 35634 existing records. [2025-09-17T05:44:31.892392] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-17T05:44:31.993282] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:44:31.993709] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-17T05:44:31.993798] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-17T05:44:31.994745] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-17T05:44:31.994824] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-17T05:44:32.106001] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T05:44:32.316273] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T05:44:32.407345] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:44:32.690082] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-09-17T05:44:33.009709] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T05:44:33.490133] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-11. [2025-09-17T05:44:34.028879] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T05:44:34.290099] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-09-17T05:44:34.650978] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T05:44:34.816048] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-17T05:44:35.090119] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-09-17T05:44:35.890136] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-09-17T05:44:36.690115] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-09-17T05:44:36.722335] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T05:44:37.231393] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T05:44:37.385207] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T05:44:37.490216] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-17T05:44:38.290164] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-17T05:44:39.012555] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T05:44:39.084684] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T05:44:39.090076] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-17T05:44:39.864958] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T05:44:39.890081] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-17T05:44:40.690111] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-17T05:44:40.856963] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T05:44:41.490128] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-17T05:44:41.792978] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T05:44:42.290147] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-17T05:44:43.098783] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-17T05:44:43.120182] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T05:44:43.143031] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T05:44:43.890112] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-17T05:44:44.117713] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T05:44:44.663562] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T05:44:44.690119] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-17T05:44:45.490137] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-17T05:44:45.621798] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T05:44:46.290125] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-09-17T05:44:46.588971] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T05:44:47.090209] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-17T05:44:47.753517] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T05:44:47.890141] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-17T05:44:48.291136] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T05:44:48.294870] [INFO ] [REMOTE ] PCN: Full fetch complete (33627 records). [2025-09-17T05:44:48.294967] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-17T05:44:48.664333] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-17T05:44:48.664435] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-17T05:44:48.665137] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-17T05:44:48.665201] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-17T05:44:48.665995] [DEBUG] [LOCAL ] PCN: Trimmed 33627 records to 24169 (keeping 200 days of data) [2025-09-17T05:44:48.722484] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-17T05:44:48.820893] [DEBUG] [LOCAL ] PCN: Primary data saved (24169 records). [2025-09-17T05:44:48.821042] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-17T05:44:48.821139] [INFO ] [MAIN ] Update Progress: 1646/2369 symbols completed. PCN took 40.9s. Estimated remaining: 1h 45m 44s. Rate: 6.8 symbols/min [2025-09-17T05:44:48.990427] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:44:48.990622] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-17T05:44:48.990689] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-17T05:44:48.990792] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-17T05:44:48.990840] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-17T05:44:48.990884] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-17T05:44:48.990932] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-17T05:44:49.353636] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:44:49.374727] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T05:44:49.490073] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-11. [2025-09-17T05:44:49.782538] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-11 (0.29 seconds). [2025-09-17T05:44:50.301837] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-17T05:44:50.324715] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T05:44:51.090170] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-17T05:44:51.890145] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-17T05:44:51.976903] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T05:44:52.053239] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T05:44:52.690164] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-17T05:44:53.474870] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T05:44:53.490074] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-17T05:44:54.279812] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T05:44:54.292439] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-17T05:44:54.516183] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.22 seconds). [2025-09-17T05:44:54.992973] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T05:44:55.090115] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-17T05:44:55.890118] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-17T05:44:56.103858] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T05:44:56.106380] [INFO ] [REMOTE ] PCQ: Full fetch complete (17374 records). [2025-09-17T05:44:56.106479] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-17T05:44:56.203260] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-17T05:44:56.492597] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-17T05:44:56.492729] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-17T05:44:56.493180] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-17T05:44:56.493236] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-17T05:44:56.494057] [DEBUG] [LOCAL ] PCQ: Trimmed 17374 records to 11994 (keeping 200 days of data) [2025-09-17T05:44:56.573776] [DEBUG] [LOCAL ] PCQ: Primary data saved (11994 records). [2025-09-17T05:44:56.573970] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-17T05:44:56.574083] [INFO ] [MAIN ] Update Progress: 1647/2369 symbols completed. PCQ took 26.7s. Estimated remaining: 1h 45m 34s. Rate: 6.8 symbols/min [2025-09-17T05:44:56.695175] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-17T05:44:56.748562] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:44:56.787245] [DEBUG] [LOCAL ] PDI: Loaded 37200 existing records from primary storage. [2025-09-17T05:44:56.787431] [INFO ] [MAIN ] PDI: Loaded 37200 existing records. [2025-09-17T05:44:56.973148] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:44:56.973421] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-17T05:44:56.973480] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-17T05:44:56.974530] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-17T05:44:56.974599] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-17T05:44:57.346244] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:44:57.490105] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-17T05:44:57.914464] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T05:44:58.292082] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-17T05:44:58.295120] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T05:44:59.090130] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-17T05:44:59.827891] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T05:44:59.890093] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-17T05:45:00.654601] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T05:45:00.690181] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-17T05:45:01.096585] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T05:45:01.157704] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T05:45:01.490192] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-17T05:45:02.290168] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-11. [2025-09-17T05:45:02.624692] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T05:45:03.090125] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-17T05:45:03.890142] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-17T05:45:04.690175] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-17T05:45:05.039598] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-17T05:45:05.193774] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-11 (2.90 seconds). [2025-09-17T05:45:05.490136] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-09-17T05:45:05.560973] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-17T05:45:05.716682] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T05:45:05.722552] [INFO ] [REMOTE ] PCOR: Full fetch complete (69622 records). [2025-09-17T05:45:05.722775] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-17T05:45:06.114564] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-17T05:45:06.114690] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-17T05:45:06.115804] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-17T05:45:06.115865] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-17T05:45:06.117846] [DEBUG] [LOCAL ] PCOR: Trimmed 69622 records to 48151 (keeping 200 days of data) [2025-09-17T05:45:06.294984] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-17T05:45:06.409965] [DEBUG] [LOCAL ] PCOR: Primary data saved (48151 records). [2025-09-17T05:45:06.410115] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-17T05:45:06.410217] [INFO ] [MAIN ] Update Progress: 1648/2369 symbols completed. PCOR took 37.8s. Estimated remaining: 1h 45m 26s. Rate: 6.8 symbols/min [2025-09-17T05:45:06.578766] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:45:06.605488] [DEBUG] [LOCAL ] PDM: Loaded 29341 existing records from primary storage. [2025-09-17T05:45:06.605658] [INFO ] [MAIN ] PDM: Loaded 29341 existing records. [2025-09-17T05:45:06.781900] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:45:06.782147] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-17T05:45:06.782205] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-17T05:45:06.782854] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-17T05:45:06.782916] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-17T05:45:07.105321] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-17T05:45:07.144378] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:45:07.426790] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T05:45:07.459030] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T05:45:07.890096] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-17T05:45:08.072565] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T05:45:08.333607] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T05:45:08.690139] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-17T05:45:09.490183] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-09-17T05:45:10.290182] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-17T05:45:10.440439] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T05:45:10.447029] [INFO ] [REMOTE ] PD: Full fetch complete (67311 records). [2025-09-17T05:45:10.447197] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-17T05:45:10.554381] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.26 seconds). [2025-09-17T05:45:10.848628] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-17T05:45:10.848796] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-17T05:45:10.849923] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-17T05:45:10.849992] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-17T05:45:10.851727] [DEBUG] [LOCAL ] PD: Trimmed 67311 records to 47686 (keeping 200 days of data) [2025-09-17T05:45:11.090800] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-17T05:45:11.138331] [DEBUG] [LOCAL ] PD: Primary data saved (47686 records). [2025-09-17T05:45:11.138590] [INFO ] [MAIN ] PD: Full history saved. [2025-09-17T05:45:11.138759] [INFO ] [MAIN ] Update Progress: 1649/2369 symbols completed. PD took 39.5s. Estimated remaining: 1h 45m 16s. Rate: 6.8 symbols/min [2025-09-17T05:45:11.313071] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:45:11.348753] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T05:45:11.377259] [DEBUG] [LOCAL ] PDO: Loaded 22731 existing records from primary storage. [2025-09-17T05:45:11.377424] [INFO ] [MAIN ] PDO: Loaded 22731 existing records. [2025-09-17T05:45:11.478917] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T05:45:11.495520] [INFO ] [REMOTE ] PDCC: Full fetch complete (1318 records). [2025-09-17T05:45:11.531221] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-17T05:45:11.629511] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:45:11.661630] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-17T05:45:11.661967] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-17T05:45:11.688160] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-17T05:45:11.710775] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-17T05:45:11.744711] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-09-17T05:45:11.808114] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:45:11.824676] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:45:11.836636] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-17T05:45:11.847127] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-17T05:45:11.847466] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-17T05:45:11.863137] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-17T05:45:11.887781] [INFO ] [MAIN ] Update Progress: 1650/2369 symbols completed. PDCC took 23.1s. Estimated remaining: 1h 45m 3s. Rate: 6.8 symbols/min [2025-09-17T05:45:11.897865] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-17T05:45:12.297749] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:45:12.322898] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:45:12.335479] [DEBUG] [LOCAL ] PDS: Loaded 12219 existing records from primary storage. [2025-09-17T05:45:12.335668] [INFO ] [MAIN ] PDS: Loaded 12219 existing records. [2025-09-17T05:45:12.519180] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:45:12.519471] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-17T05:45:12.519546] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-17T05:45:12.519957] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-17T05:45:12.520033] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-17T05:45:12.695316] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-11. [2025-09-17T05:45:12.884687] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:45:13.490193] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-11. [2025-09-17T05:45:13.811440] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-17T05:45:14.275072] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T05:45:14.290068] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-09-17T05:45:14.757764] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T05:45:15.090174] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-11. [2025-09-17T05:45:15.513734] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T05:45:15.890158] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-09-17T05:45:16.144619] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T05:45:16.690198] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-17T05:45:17.490129] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-09-17T05:45:18.207306] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-17T05:45:18.290161] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-09-17T05:45:18.903516] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-17T05:45:19.090174] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-09-17T05:45:19.472479] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T05:45:19.502803] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T05:45:19.890207] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-17T05:45:20.043247] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T05:45:20.690232] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-17T05:45:21.490202] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-09-17T05:45:21.880893] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T05:45:21.983964] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T05:45:22.290235] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-17T05:45:22.470395] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T05:45:23.090212] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-17T05:45:23.890240] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-17T05:45:23.929897] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T05:45:24.486916] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T05:45:24.690159] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-17T05:45:25.291600] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T05:45:25.445030] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T05:45:25.490110] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-17T05:45:26.290205] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-17T05:45:26.565530] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T05:45:27.090162] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-17T05:45:27.890151] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-17T05:45:28.088987] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T05:45:28.411820] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T05:45:28.690185] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-17T05:45:29.442783] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T05:45:29.490151] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-17T05:45:29.629100] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T05:45:30.290206] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-17T05:45:31.090157] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-17T05:45:31.890169] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-17T05:45:31.974151] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-17T05:45:32.263485] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T05:45:32.357396] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T05:45:32.690175] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-17T05:45:32.905077] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T05:45:33.490199] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-17T05:45:33.911439] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T05:45:34.290111] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-17T05:45:34.489357] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T05:45:35.090161] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-17T05:45:35.720154] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T05:45:35.890109] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-17T05:45:36.339591] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T05:45:36.690166] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-17T05:45:37.448557] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T05:45:37.490108] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-17T05:45:37.643226] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T05:45:38.164170] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T05:45:38.166342] [INFO ] [REMOTE ] PDS: Full fetch complete (25741 records). [2025-09-17T05:45:38.166432] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-17T05:45:38.295196] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-17T05:45:38.542779] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-17T05:45:38.542905] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-17T05:45:38.543580] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-17T05:45:38.543685] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-17T05:45:38.544686] [DEBUG] [LOCAL ] PDS: Trimmed 25741 records to 18821 (keeping 200 days of data) [2025-09-17T05:45:38.663176] [DEBUG] [LOCAL ] PDS: Primary data saved (18821 records). [2025-09-17T05:45:38.663416] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-17T05:45:38.663586] [INFO ] [MAIN ] Update Progress: 1651/2369 symbols completed. PDS took 26.8s. Estimated remaining: 1h 45m 2s. Rate: 6.8 symbols/min [2025-09-17T05:45:38.847939] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:45:38.865025] [DEBUG] [LOCAL ] PDT: Loaded 12983 existing records from primary storage. [2025-09-17T05:45:38.865191] [INFO ] [MAIN ] PDT: Loaded 12983 existing records. [2025-09-17T05:45:39.049128] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:45:39.049415] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-17T05:45:39.049477] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-17T05:45:39.050067] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-17T05:45:39.050139] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-17T05:45:39.092875] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-17T05:45:39.440953] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:45:39.528938] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T05:45:39.890210] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-17T05:45:40.662476] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T05:45:40.690099] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-17T05:45:41.230048] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T05:45:41.490261] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-17T05:45:42.124354] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T05:45:42.290129] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-17T05:45:42.833860] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T05:45:43.090154] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-11. [2025-09-17T05:45:43.598342] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T05:45:43.603126] [INFO ] [REMOTE ] PDM: Full fetch complete (57193 records). [2025-09-17T05:45:43.603289] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-17T05:45:43.895265] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-17T05:45:43.991255] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-17T05:45:43.991375] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-17T05:45:43.992309] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-17T05:45:43.992370] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-17T05:45:43.993748] [DEBUG] [LOCAL ] PDM: Trimmed 57193 records to 39865 (keeping 200 days of data) [2025-09-17T05:45:44.090263] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T05:45:44.238845] [DEBUG] [LOCAL ] PDM: Primary data saved (39865 records). [2025-09-17T05:45:44.239049] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-17T05:45:44.239183] [INFO ] [MAIN ] Update Progress: 1652/2369 symbols completed. PDM took 37.8s. Estimated remaining: 1h 44m 52s. Rate: 6.8 symbols/min [2025-09-17T05:45:44.416030] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:45:44.427330] [DEBUG] [LOCAL ] PDX: Loaded 10487 existing records from primary storage. [2025-09-17T05:45:44.427512] [INFO ] [MAIN ] PDX: Loaded 10487 existing records. [2025-09-17T05:45:44.608568] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:45:44.608848] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-17T05:45:44.608921] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-17T05:45:44.609310] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-17T05:45:44.609381] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-17T05:45:44.695341] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-09-17T05:45:44.970567] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:45:45.307847] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T05:45:45.312893] [INFO ] [REMOTE ] PDO: Full fetch complete (48273 records). [2025-09-17T05:45:45.313097] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-17T05:45:45.495287] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-17T05:45:45.701540] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-17T05:45:45.701669] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-17T05:45:45.702506] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-17T05:45:45.702559] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-17T05:45:45.703588] [DEBUG] [LOCAL ] PDO: Trimmed 48273 records to 32021 (keeping 200 days of data) [2025-09-17T05:45:45.896873] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T05:45:45.928422] [DEBUG] [LOCAL ] PDO: Primary data saved (32021 records). [2025-09-17T05:45:45.928629] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-17T05:45:45.928772] [INFO ] [MAIN ] Update Progress: 1653/2369 symbols completed. PDO took 34.8s. Estimated remaining: 1h 44m 40s. Rate: 6.8 symbols/min [2025-09-17T05:45:46.098139] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:45:46.138210] [DEBUG] [LOCAL ] PEB: Loaded 37647 existing records from primary storage. [2025-09-17T05:45:46.138386] [INFO ] [MAIN ] PEB: Loaded 37647 existing records. [2025-09-17T05:45:46.315737] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-09-17T05:45:46.320849] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:45:46.322126] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-17T05:45:46.322188] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-17T05:45:46.323081] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-17T05:45:46.323153] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-17T05:45:46.693612] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:45:47.090136] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-11. [2025-09-17T05:45:47.421979] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T05:45:47.438783] [INFO ] [REMOTE ] PDI: Full fetch complete (72962 records). [2025-09-17T05:45:47.439151] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-17T05:45:47.440256] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T05:45:47.844899] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-17T05:45:47.845034] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-17T05:45:47.846214] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-17T05:45:47.846292] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-17T05:45:47.847886] [DEBUG] [LOCAL ] PDI: Trimmed 72962 records to 50271 (keeping 200 days of data) [2025-09-17T05:45:47.905060] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-17T05:45:48.173075] [DEBUG] [LOCAL ] PDI: Primary data saved (50271 records). [2025-09-17T05:45:48.173248] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-17T05:45:48.173348] [INFO ] [MAIN ] Update Progress: 1654/2369 symbols completed. PDI took 51.6s. Estimated remaining: 1h 44m 29s. Rate: 6.8 symbols/min [2025-09-17T05:45:48.351039] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:45:48.387262] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T05:45:48.434450] [DEBUG] [LOCAL ] PEG: Loaded 39629 existing records from primary storage. [2025-09-17T05:45:48.434701] [INFO ] [MAIN ] PEG: Loaded 39629 existing records. [2025-09-17T05:45:48.628773] [WARN ] [MAIN ] PEG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:45:48.629058] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-17T05:45:48.629117] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-17T05:45:48.630059] [DEBUG] [LOCAL ] PEG: Deleted primary data file. [2025-09-17T05:45:48.630129] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-17T05:45:48.696609] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-09-17T05:45:49.005740] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:45:49.016383] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T05:45:49.490138] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-17T05:45:50.295426] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-11. [2025-09-17T05:45:50.308424] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T05:45:50.463108] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T05:45:51.090159] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-11. [2025-09-17T05:45:51.301243] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T05:45:51.890148] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-09-17T05:45:52.690150] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-09-17T05:45:52.824579] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T05:45:52.928241] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T05:45:53.490141] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-17T05:45:54.204964] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T05:45:54.290162] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-17T05:45:54.866163] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T05:45:55.090145] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-17T05:45:55.895244] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-17T05:45:55.913400] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T05:45:56.690119] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-17T05:45:56.814601] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T05:45:56.855015] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T05:45:57.490161] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-17T05:45:57.719445] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T05:45:58.290133] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-17T05:45:59.007512] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T05:45:59.090103] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-17T05:45:59.890126] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-17T05:45:59.994042] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T05:46:00.192351] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T05:46:00.690135] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-17T05:46:00.858042] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T05:46:01.490106] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-17T05:46:01.639887] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T05:46:02.290175] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-17T05:46:03.090179] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-17T05:46:03.183777] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T05:46:03.890209] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-17T05:46:04.018495] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T05:46:04.104096] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T05:46:04.690171] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-17T05:46:04.812601] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T05:46:05.490168] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-17T05:46:05.727958] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T05:46:06.290166] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-17T05:46:06.964618] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T05:46:07.090146] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-17T05:46:07.156523] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T05:46:07.854769] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T05:46:07.890164] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-17T05:46:08.690179] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-17T05:46:08.906124] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T05:46:08.908455] [INFO ] [REMOTE ] PDT: Full fetch complete (25234 records). [2025-09-17T05:46:08.908589] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-17T05:46:09.299474] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-17T05:46:09.299624] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-17T05:46:09.300224] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-17T05:46:09.300292] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-17T05:46:09.301041] [DEBUG] [LOCAL ] PDT: Trimmed 25234 records to 17578 (keeping 200 days of data) [2025-09-17T05:46:09.416699] [DEBUG] [LOCAL ] PDT: Primary data saved (17578 records). [2025-09-17T05:46:09.416888] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-17T05:46:09.417076] [INFO ] [MAIN ] Update Progress: 1655/2369 symbols completed. PDT took 30.8s. Estimated remaining: 1h 44m 25s. Rate: 6.8 symbols/min [2025-09-17T05:46:09.495283] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-17T05:46:09.590383] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:46:09.614168] [DEBUG] [LOCAL ] PEN: Loaded 22527 existing records from primary storage. [2025-09-17T05:46:09.614366] [INFO ] [MAIN ] PEN: Loaded 22527 existing records. [2025-09-17T05:46:09.797366] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:46:09.797610] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-17T05:46:09.797685] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-17T05:46:09.798413] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-17T05:46:09.798480] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-17T05:46:10.165350] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:46:10.290136] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-11. [2025-09-17T05:46:10.540174] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T05:46:10.599352] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T05:46:11.090141] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-17T05:46:11.590706] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T05:46:11.890135] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-17T05:46:12.690176] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-17T05:46:12.921972] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T05:46:13.241666] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T05:46:13.445490] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T05:46:13.490150] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-17T05:46:14.290260] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-09-17T05:46:15.090149] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-17T05:46:15.270521] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T05:46:15.322026] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T05:46:15.890144] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-17T05:46:16.016711] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T05:46:16.019676] [INFO ] [REMOTE ] PDX: Full fetch complete (25075 records). [2025-09-17T05:46:16.019819] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-17T05:46:16.428134] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-17T05:46:16.428255] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-17T05:46:16.428819] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-17T05:46:16.428899] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-17T05:46:16.430147] [DEBUG] [LOCAL ] PDX: Trimmed 25075 records to 14635 (keeping 200 days of data) [2025-09-17T05:46:16.527670] [DEBUG] [LOCAL ] PDX: Primary data saved (14635 records). [2025-09-17T05:46:16.527848] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-17T05:46:16.527955] [INFO ] [MAIN ] Update Progress: 1656/2369 symbols completed. PDX took 32.3s. Estimated remaining: 1h 44m 16s. Rate: 6.8 symbols/min [2025-09-17T05:46:16.695443] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-17T05:46:16.698630] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:46:16.711275] [DEBUG] [LOCAL ] PEO: Loaded 8035 existing records from primary storage. [2025-09-17T05:46:16.711512] [INFO ] [MAIN ] PEO: Loaded 8035 existing records. [2025-09-17T05:46:16.894743] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:46:16.895036] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-17T05:46:16.895104] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-17T05:46:16.895456] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-17T05:46:16.895530] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-17T05:46:17.267903] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:46:17.287305] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T05:46:17.490191] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-17T05:46:18.290196] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-11. [2025-09-17T05:46:18.332988] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T05:46:18.865460] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T05:46:19.095936] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-17T05:46:19.096962] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T05:46:19.890127] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-17T05:46:20.690177] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-17T05:46:20.751437] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T05:46:20.761347] [INFO ] [REMOTE ] PEB: Full fetch complete (72542 records). [2025-09-17T05:46:20.761525] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-17T05:46:21.161443] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-17T05:46:21.161621] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-17T05:46:21.162951] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-17T05:46:21.163054] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-17T05:46:21.164864] [DEBUG] [LOCAL ] PEB: Trimmed 72542 records to 50711 (keeping 200 days of data) [2025-09-17T05:46:21.491108] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-09-17T05:46:21.492916] [DEBUG] [LOCAL ] PEB: Primary data saved (50711 records). [2025-09-17T05:46:21.493979] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-17T05:46:21.494131] [INFO ] [MAIN ] Update Progress: 1657/2369 symbols completed. PEB took 35.6s. Estimated remaining: 1h 44m 5s. Rate: 6.8 symbols/min [2025-09-17T05:46:21.674894] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:46:21.715831] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T05:46:21.732752] [DEBUG] [LOCAL ] PERF: Loaded 11407 existing records from primary storage. [2025-09-17T05:46:21.732921] [INFO ] [MAIN ] PERF: Loaded 11407 existing records. [2025-09-17T05:46:21.910989] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:46:21.911299] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-17T05:46:21.911362] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-17T05:46:21.911864] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-17T05:46:21.911935] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-17T05:46:22.305572] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-17T05:46:22.312286] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:46:22.351957] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T05:46:22.388936] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T05:46:23.090194] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-17T05:46:23.789449] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T05:46:23.890205] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-11. [2025-09-17T05:46:24.519749] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T05:46:24.543485] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T05:46:24.690153] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-09-17T05:46:25.490207] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-17T05:46:25.505283] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T05:46:26.290199] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-09-17T05:46:27.090231] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-17T05:46:27.225758] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T05:46:27.262795] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T05:46:27.890150] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-17T05:46:28.296150] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T05:46:28.664954] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T05:46:28.690104] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-17T05:46:29.402384] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T05:46:29.490206] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-17T05:46:30.290127] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-17T05:46:30.440098] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T05:46:31.090173] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-17T05:46:31.858072] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T05:46:31.890137] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-17T05:46:32.130387] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T05:46:32.675158] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T05:46:32.690067] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-17T05:46:33.490225] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-17T05:46:33.618372] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T05:46:34.290211] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-17T05:46:34.942703] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T05:46:35.090137] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-17T05:46:35.890170] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-17T05:46:36.093532] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T05:46:36.100482] [INFO ] [REMOTE ] PEG: Full fetch complete (76489 records). [2025-09-17T05:46:36.100698] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-17T05:46:36.498980] [DEBUG] [VALIDATOR ] PEG: All expected trading days are present. [2025-09-17T05:46:36.499133] [DEBUG] [VALIDATOR ] PEG: Primary data validation passed. [2025-09-17T05:46:36.500326] [INFO ] [MAIN ] PEG: Fetched primary data is valid. [2025-09-17T05:46:36.500441] [DEBUG] [LOCAL ] PEG: Saving primary data. [2025-09-17T05:46:36.525500] [DEBUG] [LOCAL ] PEG: Trimmed 76489 records to 53144 (keeping 200 days of data) [2025-09-17T05:46:36.526605] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T05:46:36.722193] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-17T05:46:36.879290] [DEBUG] [LOCAL ] PEG: Primary data saved (53144 records). [2025-09-17T05:46:36.879470] [INFO ] [MAIN ] PEG: Full history saved. [2025-09-17T05:46:36.879583] [INFO ] [MAIN ] Update Progress: 1658/2369 symbols completed. PEG took 48.7s. Estimated remaining: 1h 43m 60s. Rate: 6.8 symbols/min [2025-09-17T05:46:37.052852] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T05:46:37.072710] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:46:37.077010] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-17T05:46:37.077073] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-17T05:46:37.077203] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-17T05:46:37.077261] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-17T05:46:37.077599] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-17T05:46:37.077677] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-17T05:46:37.450294] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:46:37.490141] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-11. [2025-09-17T05:46:37.687336] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:46:37.687739] [WARN ] [REMOTE ] PEW: No data returned for month 2024-11 [2025-09-17T05:46:38.121603] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T05:46:38.290118] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-17T05:46:39.067867] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T05:46:39.090083] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-17T05:46:39.890176] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-17T05:46:39.909376] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T05:46:39.912262] [INFO ] [REMOTE ] PEO: Full fetch complete (16382 records). [2025-09-17T05:46:39.912374] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-17T05:46:40.299783] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-17T05:46:40.299893] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-17T05:46:40.300330] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-17T05:46:40.300384] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-17T05:46:40.300947] [DEBUG] [LOCAL ] PEO: Trimmed 16382 records to 10880 (keeping 200 days of data) [2025-09-17T05:46:40.370514] [DEBUG] [LOCAL ] PEO: Primary data saved (10880 records). [2025-09-17T05:46:40.370729] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-17T05:46:40.370836] [INFO ] [MAIN ] Update Progress: 1659/2369 symbols completed. PEO took 23.8s. Estimated remaining: 1h 43m 48s. Rate: 6.8 symbols/min [2025-09-17T05:46:40.544223] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:46:40.550201] [DEBUG] [LOCAL ] PFD: Loaded 3849 existing records from primary storage. [2025-09-17T05:46:40.550325] [INFO ] [MAIN ] PFD: Loaded 3849 existing records. [2025-09-17T05:46:40.699398] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-17T05:46:40.731163] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:46:40.731621] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-17T05:46:40.731716] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-17T05:46:40.731987] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-17T05:46:40.732048] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-17T05:46:41.088190] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:46:41.171592] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:46:41.172021] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-17T05:46:41.189882] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T05:46:41.490148] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-09-17T05:46:41.690554] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:46:41.690984] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-09-17T05:46:42.290138] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-11. [2025-09-17T05:46:42.946546] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T05:46:43.090122] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-17T05:46:43.281599] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:46:43.281987] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-17T05:46:43.890145] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-17T05:46:44.084006] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:46:44.084428] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-17T05:46:44.690134] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-17T05:46:45.490162] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-17T05:46:45.543483] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T05:46:45.699008] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:46:45.699361] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-17T05:46:46.290137] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-09-17T05:46:46.980542] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T05:46:47.090137] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-09-17T05:46:47.426074] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T05:46:47.890134] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-17T05:46:48.690137] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-17T05:46:49.145131] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T05:46:49.148969] [INFO ] [REMOTE ] PEN: Full fetch complete (43978 records). [2025-09-17T05:46:49.149130] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-17T05:46:49.385208] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T05:46:49.495497] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-17T05:46:49.537854] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-17T05:46:49.537954] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-17T05:46:49.538855] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-17T05:46:49.538918] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-17T05:46:49.540005] [DEBUG] [LOCAL ] PEN: Trimmed 43978 records to 30797 (keeping 200 days of data) [2025-09-17T05:46:49.732222] [DEBUG] [LOCAL ] PEN: Primary data saved (30797 records). [2025-09-17T05:46:49.732389] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-17T05:46:49.732486] [INFO ] [MAIN ] Update Progress: 1660/2369 symbols completed. PEN took 40.3s. Estimated remaining: 1h 43m 40s. Rate: 6.8 symbols/min [2025-09-17T05:46:49.806025] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:46:49.839042] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-17T05:46:49.907718] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:46:49.947113] [DEBUG] [LOCAL ] PFE: Loaded 40163 existing records from primary storage. [2025-09-17T05:46:49.947297] [INFO ] [MAIN ] PFE: Loaded 40163 existing records. [2025-09-17T05:46:50.122190] [WARN ] [MAIN ] PFE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:46:50.122433] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-17T05:46:50.122493] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-17T05:46:50.123458] [DEBUG] [LOCAL ] PFE: Deleted primary data file. [2025-09-17T05:46:50.123520] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-17T05:46:50.295135] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-17T05:46:50.475201] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:46:50.992954] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T05:46:51.090091] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-17T05:46:51.873393] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T05:46:51.890088] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-17T05:46:52.481673] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T05:46:52.690131] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-17T05:46:53.276199] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T05:46:53.490127] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-17T05:46:54.096402] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T05:46:54.290111] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-17T05:46:55.049694] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T05:46:55.090142] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-11. [2025-09-17T05:46:55.890213] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-17T05:46:56.600958] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T05:46:56.690124] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-17T05:46:57.490097] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-17T05:46:57.559625] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T05:46:57.560984] [INFO ] [REMOTE ] PFD: Full fetch complete (7346 records). [2025-09-17T05:46:57.561070] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-17T05:46:57.963220] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-17T05:46:57.963837] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-17T05:46:57.966580] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-11 (2.88 seconds). [2025-09-17T05:46:57.966938] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-17T05:46:57.980827] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-17T05:46:57.988607] [DEBUG] [LOCAL ] PFD: Trimmed 7346 records to 5090 (keeping 200 days of data) [2025-09-17T05:46:57.989602] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T05:46:58.034237] [DEBUG] [LOCAL ] PFD: Primary data saved (5090 records). [2025-09-17T05:46:58.034453] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-17T05:46:58.034593] [INFO ] [MAIN ] Update Progress: 1661/2369 symbols completed. PFD took 17.7s. Estimated remaining: 1h 43m 31s. Rate: 6.8 symbols/min [2025-09-17T05:46:58.212470] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:46:58.254118] [DEBUG] [LOCAL ] PFGC: Loaded 35322 existing records from primary storage. [2025-09-17T05:46:58.254300] [INFO ] [MAIN ] PFGC: Loaded 35322 existing records. [2025-09-17T05:46:58.295215] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-17T05:46:58.436803] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:46:58.437061] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-17T05:46:58.437115] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-17T05:46:58.438441] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-17T05:46:58.438507] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-17T05:46:58.826748] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:46:59.090121] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-17T05:46:59.890166] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-17T05:47:00.093358] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:47:00.093768] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-17T05:47:00.111988] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T05:47:00.690133] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-17T05:47:01.057030] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-17T05:47:01.490141] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-17T05:47:01.827141] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T05:47:02.290237] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-17T05:47:03.090148] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-17T05:47:03.890104] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-11. [2025-09-17T05:47:03.913521] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T05:47:04.121261] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-09-17T05:47:04.194874] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T05:47:04.690140] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-17T05:47:05.420024] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T05:47:05.490161] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-17T05:47:06.290143] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-09-17T05:47:06.488273] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T05:47:07.090222] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-17T05:47:07.767364] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T05:47:07.831485] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-17T05:47:07.890090] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-09-17T05:47:08.444555] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T05:47:08.449217] [INFO ] [REMOTE ] PEW: Full fetch complete (14139 records). [2025-09-17T05:47:08.449332] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-17T05:47:08.634550] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 44 unique days, need 200 days [2025-09-17T05:47:08.634890] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:47:08.634956] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:47:08.635005] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-17T05:47:08.635081] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-17T05:47:08.635133] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-17T05:47:08.635198] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-17T05:47:08.635285] [INFO ] [MAIN ] Update Progress: 1662/2369 symbols completed. PEW took 31.8s. Estimated remaining: 1h 43m 23s. Rate: 6.8 symbols/min [2025-09-17T05:47:08.702230] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-17T05:47:08.820915] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:47:08.828206] [DEBUG] [LOCAL ] PFH: Loaded 5118 existing records from primary storage. [2025-09-17T05:47:08.828369] [INFO ] [MAIN ] PFH: Loaded 5118 existing records. [2025-09-17T05:47:09.014612] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:47:09.014998] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-17T05:47:09.015058] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-17T05:47:09.015441] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-17T05:47:09.015498] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-17T05:47:09.400558] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:47:09.431347] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T05:47:09.490169] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-17T05:47:10.290135] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-11. [2025-09-17T05:47:10.840148] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T05:47:11.056380] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T05:47:11.090085] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-17T05:47:11.403472] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-17T05:47:11.890138] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-17T05:47:12.369211] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T05:47:12.690153] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-17T05:47:12.777696] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T05:47:12.779709] [INFO ] [REMOTE ] PERF: Full fetch complete (21985 records). [2025-09-17T05:47:12.779810] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-17T05:47:13.154472] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-17T05:47:13.154577] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-17T05:47:13.155087] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-17T05:47:13.155141] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-17T05:47:13.155771] [DEBUG] [LOCAL ] PERF: Trimmed 21985 records to 14131 (keeping 200 days of data) [2025-09-17T05:47:13.237791] [DEBUG] [LOCAL ] PERF: Primary data saved (14131 records). [2025-09-17T05:47:13.237972] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-17T05:47:13.238072] [INFO ] [MAIN ] Update Progress: 1663/2369 symbols completed. PERF took 51.7s. Estimated remaining: 1h 43m 12s. Rate: 6.8 symbols/min [2025-09-17T05:47:13.413878] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:47:13.425333] [DEBUG] [LOCAL ] PFL: Loaded 9789 existing records from primary storage. [2025-09-17T05:47:13.425475] [INFO ] [MAIN ] PFL: Loaded 9789 existing records. [2025-09-17T05:47:13.499385] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-17T05:47:13.610037] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:47:13.610318] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-17T05:47:13.610379] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-17T05:47:13.611075] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-17T05:47:13.611140] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-17T05:47:13.980614] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:47:14.296903] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-09-17T05:47:14.317418] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T05:47:15.090224] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-17T05:47:15.112040] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T05:47:15.890202] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-09-17T05:47:16.078909] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.58 seconds). [2025-09-17T05:47:16.690217] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-17T05:47:16.787459] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T05:47:16.805309] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T05:47:17.490184] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-11. [2025-09-17T05:47:18.290141] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-17T05:47:18.417936] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T05:47:19.090131] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-09-17T05:47:19.422767] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-09-17T05:47:19.736379] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T05:47:19.890169] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-17T05:47:20.043708] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T05:47:20.690150] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-17T05:47:21.146886] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T05:47:21.412208] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T05:47:21.490121] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-17T05:47:22.290149] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-17T05:47:22.991672] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T05:47:23.090223] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-17T05:47:23.890253] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-17T05:47:23.928293] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-17T05:47:24.656165] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T05:47:24.695222] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-17T05:47:24.713974] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T05:47:25.490174] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-17T05:47:26.290144] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-17T05:47:26.334759] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T05:47:27.090199] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-17T05:47:27.223120] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-17T05:47:27.809186] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T05:47:27.815205] [INFO ] [REMOTE ] PFGC: Full fetch complete (66937 records). [2025-09-17T05:47:27.815393] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-17T05:47:27.895183] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-17T05:47:27.929711] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T05:47:28.225625] [DEBUG] [VALIDATOR ] PFGC: All expected trading days are present. [2025-09-17T05:47:28.225748] [DEBUG] [VALIDATOR ] PFGC: Primary data validation passed. [2025-09-17T05:47:28.226900] [INFO ] [MAIN ] PFGC: Fetched primary data is valid. [2025-09-17T05:47:28.226961] [DEBUG] [LOCAL ] PFGC: Saving primary data. [2025-09-17T05:47:28.228328] [DEBUG] [LOCAL ] PFGC: Trimmed 66937 records to 47003 (keeping 200 days of data) [2025-09-17T05:47:28.518207] [DEBUG] [LOCAL ] PFGC: Primary data saved (47003 records). [2025-09-17T05:47:28.518376] [INFO ] [MAIN ] PFGC: Full history saved. [2025-09-17T05:47:28.518469] [INFO ] [MAIN ] Update Progress: 1664/2369 symbols completed. PFGC took 30.5s. Estimated remaining: 1h 43m 6s. Rate: 6.8 symbols/min [2025-09-17T05:47:28.690419] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-17T05:47:28.691836] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:47:28.723839] [DEBUG] [LOCAL ] PFLT: Loaded 31693 existing records from primary storage. [2025-09-17T05:47:28.724035] [INFO ] [MAIN ] PFLT: Loaded 31693 existing records. [2025-09-17T05:47:28.907947] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:47:28.917505] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T05:47:28.917250] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-17T05:47:28.921033] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-17T05:47:28.922122] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-17T05:47:28.922188] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-17T05:47:29.247840] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T05:47:29.283862] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:47:29.490167] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-17T05:47:30.270147] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T05:47:30.290087] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-11. [2025-09-17T05:47:31.090167] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-17T05:47:31.742109] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T05:47:31.890133] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-17T05:47:32.045797] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T05:47:32.281210] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-17T05:47:32.690129] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-17T05:47:33.280999] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T05:47:33.282204] [INFO ] [REMOTE ] PFH: Full fetch complete (10778 records). [2025-09-17T05:47:33.282302] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-17T05:47:33.495253] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-17T05:47:33.647317] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-17T05:47:33.647415] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-17T05:47:33.647776] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-17T05:47:33.647866] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-17T05:47:33.648381] [DEBUG] [LOCAL ] PFH: Trimmed 10778 records to 6959 (keeping 200 days of data) [2025-09-17T05:47:33.691098] [DEBUG] [LOCAL ] PFH: Primary data saved (6959 records). [2025-09-17T05:47:33.691231] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-17T05:47:33.691319] [INFO ] [MAIN ] Update Progress: 1665/2369 symbols completed. PFH took 25.1s. Estimated remaining: 1h 42m 56s. Rate: 6.8 symbols/min [2025-09-17T05:47:33.859855] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:47:33.875387] [DEBUG] [LOCAL ] PFN: Loaded 15615 existing records from primary storage. [2025-09-17T05:47:33.875558] [INFO ] [MAIN ] PFN: Loaded 15615 existing records. [2025-09-17T05:47:34.053347] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:47:34.053627] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-17T05:47:34.053720] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-17T05:47:34.054322] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-17T05:47:34.054401] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-17T05:47:34.295970] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-17T05:47:34.413091] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:47:35.090102] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-09-17T05:47:35.449147] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T05:47:35.792150] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-17T05:47:35.890113] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-17T05:47:36.659753] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T05:47:36.690085] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-09-17T05:47:37.490161] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-11. [2025-09-17T05:47:38.223683] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T05:47:38.290138] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-17T05:47:38.432489] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-17T05:47:38.439405] [INFO ] [REMOTE ] PFE: Full fetch complete (77974 records). [2025-09-17T05:47:38.439589] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-17T05:47:38.855848] [DEBUG] [VALIDATOR ] PFE: All expected trading days are present. [2025-09-17T05:47:38.870026] [DEBUG] [VALIDATOR ] PFE: Primary data validation passed. [2025-09-17T05:47:38.871860] [INFO ] [MAIN ] PFE: Fetched primary data is valid. [2025-09-17T05:47:38.872885] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T05:47:38.873140] [DEBUG] [LOCAL ] PFE: Saving primary data. [2025-09-17T05:47:38.886759] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T05:47:38.889976] [DEBUG] [LOCAL ] PFE: Trimmed 77974 records to 53813 (keeping 200 days of data) [2025-09-17T05:47:39.112268] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-17T05:47:39.241189] [DEBUG] [LOCAL ] PFE: Primary data saved (53813 records). [2025-09-17T05:47:39.241372] [INFO ] [MAIN ] PFE: Full history saved. [2025-09-17T05:47:39.241469] [INFO ] [MAIN ] Update Progress: 1666/2369 symbols completed. PFE took 49.5s. Estimated remaining: 1h 42m 46s. Rate: 6.8 symbols/min [2025-09-17T05:47:39.424165] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:47:39.430486] [DEBUG] [LOCAL ] PFO: Loaded 4550 existing records from primary storage. [2025-09-17T05:47:39.430632] [INFO ] [MAIN ] PFO: Loaded 4550 existing records. [2025-09-17T05:47:39.612564] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:47:39.612857] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-17T05:47:39.612918] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-17T05:47:39.613188] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-17T05:47:39.613257] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-17T05:47:39.895292] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-17T05:47:39.977351] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:47:40.510199] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T05:47:40.690170] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-11. [2025-09-17T05:47:40.777206] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T05:47:41.052220] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T05:47:41.490156] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-09-17T05:47:42.174279] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T05:47:42.290149] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-17T05:47:42.895950] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T05:47:43.090137] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-09-17T05:47:43.735751] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T05:47:43.890149] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-17T05:47:44.690168] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-17T05:47:45.274250] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T05:47:45.490144] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-17T05:47:45.621475] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T05:47:46.082251] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T05:47:46.290176] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-17T05:47:46.930978] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T05:47:47.090146] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-17T05:47:47.700160] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T05:47:47.890148] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-09-17T05:47:48.690125] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-17T05:47:48.983044] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T05:47:49.490139] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-17T05:47:50.033084] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T05:47:50.290137] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-17T05:47:50.365593] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T05:47:51.090149] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-17T05:47:51.378785] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T05:47:51.890125] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-17T05:47:52.368251] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T05:47:52.694470] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-17T05:47:52.702077] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T05:47:53.398780] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T05:47:53.490104] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-17T05:47:54.290139] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-17T05:47:54.475058] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T05:47:54.477617] [INFO ] [REMOTE ] PFL: Full fetch complete (20273 records). [2025-09-17T05:47:54.477729] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-17T05:47:54.858366] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-17T05:47:54.858591] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-17T05:47:54.859456] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-17T05:47:54.859560] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-17T05:47:54.860956] [DEBUG] [LOCAL ] PFL: Trimmed 20273 records to 13859 (keeping 200 days of data) [2025-09-17T05:47:54.954796] [DEBUG] [LOCAL ] PFL: Primary data saved (13859 records). [2025-09-17T05:47:54.955055] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-17T05:47:54.955183] [INFO ] [MAIN ] Update Progress: 1667/2369 symbols completed. PFL took 41.7s. Estimated remaining: 1h 42m 40s. Rate: 6.8 symbols/min [2025-09-17T05:47:55.107392] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-17T05:47:55.141176] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:47:55.168470] [DEBUG] [LOCAL ] PFS: Loaded 25628 existing records from primary storage. [2025-09-17T05:47:55.168681] [INFO ] [MAIN ] PFS: Loaded 25628 existing records. [2025-09-17T05:47:55.350146] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:47:55.350446] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-17T05:47:55.350524] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-17T05:47:55.351297] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-17T05:47:55.351392] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-17T05:47:55.730074] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:47:55.738379] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T05:47:55.779400] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T05:47:55.890117] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-17T05:47:56.690195] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-11. [2025-09-17T05:47:57.490138] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-17T05:47:57.534896] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T05:47:58.078701] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T05:47:58.209867] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T05:47:58.290197] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-09-17T05:47:59.090140] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-17T05:47:59.670836] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T05:47:59.890225] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-17T05:48:00.682079] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T05:48:00.683957] [INFO ] [REMOTE ] PFO: Full fetch complete (7601 records). [2025-09-17T05:48:00.684082] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-17T05:48:00.695690] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-17T05:48:01.063177] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-17T05:48:01.063466] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-17T05:48:01.063917] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-17T05:48:01.064015] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-17T05:48:01.064685] [DEBUG] [LOCAL ] PFO: Trimmed 7601 records to 5667 (keeping 200 days of data) [2025-09-17T05:48:01.120175] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T05:48:01.137609] [DEBUG] [LOCAL ] PFO: Primary data saved (5667 records). [2025-09-17T05:48:01.137809] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-17T05:48:01.137922] [INFO ] [MAIN ] Update Progress: 1668/2369 symbols completed. PFO took 21.9s. Estimated remaining: 1h 42m 30s. Rate: 6.8 symbols/min [2025-09-17T05:48:01.306367] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:48:01.328019] [DEBUG] [LOCAL ] PFSI: Loaded 20936 existing records from primary storage. [2025-09-17T05:48:01.328190] [INFO ] [MAIN ] PFSI: Loaded 20936 existing records. [2025-09-17T05:48:01.493009] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-17T05:48:01.509767] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:48:01.509969] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-17T05:48:01.510031] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-17T05:48:01.510903] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-17T05:48:01.510997] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-17T05:48:01.913379] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:48:02.270283] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T05:48:02.290145] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-17T05:48:03.090118] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-17T05:48:03.890139] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-11. [2025-09-17T05:48:04.072195] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-17T05:48:04.080047] [INFO ] [REMOTE ] PFLT: Full fetch complete (63059 records). [2025-09-17T05:48:04.080235] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-17T05:48:04.469759] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-17T05:48:04.469899] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-17T05:48:04.470878] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-17T05:48:04.470944] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-17T05:48:04.472309] [DEBUG] [LOCAL ] PFLT: Trimmed 63059 records to 43664 (keeping 200 days of data) [2025-09-17T05:48:04.712177] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T05:48:04.720518] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-17T05:48:04.769789] [DEBUG] [LOCAL ] PFLT: Primary data saved (43664 records). [2025-09-17T05:48:04.769976] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-17T05:48:04.770111] [INFO ] [MAIN ] Update Progress: 1669/2369 symbols completed. PFLT took 36.3s. Estimated remaining: 1h 42m 19s. Rate: 6.8 symbols/min [2025-09-17T05:48:04.944715] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:48:04.964398] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (2.67 seconds). [2025-09-17T05:48:05.013836] [DEBUG] [LOCAL ] PG: Loaded 40104 existing records from primary storage. [2025-09-17T05:48:05.014016] [INFO ] [MAIN ] PG: Loaded 40104 existing records. [2025-09-17T05:48:05.191107] [WARN ] [MAIN ] PG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:48:05.191367] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-17T05:48:05.191442] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-17T05:48:05.192351] [DEBUG] [LOCAL ] PG: Deleted primary data file. [2025-09-17T05:48:05.192429] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-17T05:48:05.495242] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-17T05:48:05.546383] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:48:05.861040] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T05:48:05.997626] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T05:48:06.290173] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-09-17T05:48:06.827735] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T05:48:07.090197] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-11. [2025-09-17T05:48:07.183139] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T05:48:07.890166] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-17T05:48:08.690138] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-17T05:48:09.283862] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-11 (2.19 seconds). [2025-09-17T05:48:09.366914] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T05:48:09.490152] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-17T05:48:09.760895] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T05:48:10.290151] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-17T05:48:10.830168] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T05:48:11.090165] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-09-17T05:48:11.331950] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T05:48:11.890145] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-17T05:48:12.213677] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T05:48:12.690155] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-17T05:48:13.277737] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T05:48:13.423936] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T05:48:13.490150] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-17T05:48:14.290088] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-17T05:48:14.616445] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T05:48:15.090144] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-17T05:48:15.890166] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-17T05:48:16.423574] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-17T05:48:16.459950] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T05:48:16.690137] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-17T05:48:17.462163] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T05:48:17.490115] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-17T05:48:18.290159] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-17T05:48:18.759697] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T05:48:19.090110] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-17T05:48:19.171901] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-17T05:48:19.383043] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T05:48:19.386414] [INFO ] [REMOTE ] PFN: Full fetch complete (30650 records). [2025-09-17T05:48:19.386544] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-17T05:48:19.778191] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-17T05:48:19.778320] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-17T05:48:19.779010] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-17T05:48:19.779086] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-17T05:48:19.779938] [DEBUG] [LOCAL ] PFN: Trimmed 30650 records to 21775 (keeping 200 days of data) [2025-09-17T05:48:19.890234] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-17T05:48:19.913244] [DEBUG] [LOCAL ] PFN: Primary data saved (21775 records). [2025-09-17T05:48:19.913378] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-17T05:48:19.913480] [INFO ] [MAIN ] Update Progress: 1670/2369 symbols completed. PFN took 46.2s. Estimated remaining: 1h 42m 13s. Rate: 6.8 symbols/min [2025-09-17T05:48:20.084455] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:48:20.090597] [DEBUG] [LOCAL ] PGP: Loaded 4027 existing records from primary storage. [2025-09-17T05:48:20.090746] [INFO ] [MAIN ] PGP: Loaded 4027 existing records. [2025-09-17T05:48:20.273965] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:48:20.274256] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-17T05:48:20.274327] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-17T05:48:20.274667] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-17T05:48:20.274727] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-17T05:48:20.650684] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:48:20.673435] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T05:48:20.690083] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-17T05:48:21.490113] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-11. [2025-09-17T05:48:21.834719] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T05:48:21.884206] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T05:48:22.056875] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T05:48:22.290215] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-09-17T05:48:23.027506] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T05:48:23.090092] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-17T05:48:23.890145] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-17T05:48:24.531998] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T05:48:24.690133] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-17T05:48:25.490169] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-09-17T05:48:25.767545] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T05:48:26.008091] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T05:48:26.077461] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T05:48:26.290199] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-17T05:48:26.706519] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T05:48:27.090177] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-17T05:48:27.890172] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-17T05:48:28.354364] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T05:48:28.359350] [INFO ] [REMOTE ] PFS: Full fetch complete (51368 records). [2025-09-17T05:48:28.359482] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-17T05:48:28.699673] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-17T05:48:28.752630] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-17T05:48:28.752764] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-17T05:48:28.753892] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-17T05:48:28.753985] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-17T05:48:28.755745] [DEBUG] [LOCAL ] PFS: Trimmed 51368 records to 35764 (keeping 200 days of data) [2025-09-17T05:48:28.984606] [DEBUG] [LOCAL ] PFS: Primary data saved (35764 records). [2025-09-17T05:48:28.984785] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-17T05:48:28.984916] [INFO ] [MAIN ] Update Progress: 1671/2369 symbols completed. PFS took 34.0s. Estimated remaining: 1h 42m 5s. Rate: 6.8 symbols/min [2025-09-17T05:48:29.155022] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:48:29.195793] [DEBUG] [LOCAL ] PGR: Loaded 39425 existing records from primary storage. [2025-09-17T05:48:29.195964] [INFO ] [MAIN ] PGR: Loaded 39425 existing records. [2025-09-17T05:48:29.317927] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T05:48:29.388380] [WARN ] [MAIN ] PGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:48:29.389147] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-17T05:48:29.389287] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-17T05:48:29.397988] [DEBUG] [LOCAL ] PGR: Deleted primary data file. [2025-09-17T05:48:29.398097] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-17T05:48:29.485586] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T05:48:29.495969] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-17T05:48:29.775135] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:48:30.290191] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-11. [2025-09-17T05:48:30.455198] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T05:48:31.090166] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-17T05:48:31.890151] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-17T05:48:32.168223] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T05:48:32.456799] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T05:48:32.690162] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-17T05:48:33.391144] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T05:48:33.396213] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-17T05:48:33.490127] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-17T05:48:34.290105] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-17T05:48:34.445313] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T05:48:35.090112] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-17T05:48:35.698829] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T05:48:35.890120] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-17T05:48:36.158180] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T05:48:36.472326] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T05:48:36.690146] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-17T05:48:37.490183] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-17T05:48:38.290137] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-17T05:48:38.921005] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-17T05:48:39.090113] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-17T05:48:39.160232] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T05:48:39.165427] [INFO ] [REMOTE ] PFSI: Full fetch complete (40026 records). [2025-09-17T05:48:39.165697] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-17T05:48:39.547842] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-17T05:48:39.547977] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-17T05:48:39.583699] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-17T05:48:39.586786] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-17T05:48:39.588935] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-17T05:48:39.599462] [DEBUG] [LOCAL ] PFSI: Trimmed 40026 records to 28599 (keeping 200 days of data) [2025-09-17T05:48:39.786779] [DEBUG] [LOCAL ] PFSI: Primary data saved (28599 records). [2025-09-17T05:48:39.786948] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-17T05:48:39.787120] [INFO ] [MAIN ] Update Progress: 1672/2369 symbols completed. PFSI took 38.6s. Estimated remaining: 1h 41m 57s. Rate: 6.8 symbols/min [2025-09-17T05:48:39.895225] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-17T05:48:39.959935] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:48:39.996156] [DEBUG] [LOCAL ] PGRE: Loaded 34845 existing records from primary storage. [2025-09-17T05:48:39.996362] [INFO ] [MAIN ] PGRE: Loaded 34845 existing records. [2025-09-17T05:48:40.178235] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:48:40.178524] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-17T05:48:40.178608] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-17T05:48:40.179316] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-17T05:48:40.179396] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-17T05:48:40.540410] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:48:40.690107] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-11. [2025-09-17T05:48:40.753820] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T05:48:40.755540] [INFO ] [REMOTE ] PGP: Full fetch complete (7936 records). [2025-09-17T05:48:40.755631] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-17T05:48:41.130259] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-17T05:48:41.130479] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-17T05:48:41.130831] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-17T05:48:41.131029] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-17T05:48:41.132145] [DEBUG] [LOCAL ] PGP: Trimmed 7936 records to 5459 (keeping 200 days of data) [2025-09-17T05:48:41.192319] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-17T05:48:41.209998] [DEBUG] [LOCAL ] PGP: Primary data saved (5459 records). [2025-09-17T05:48:41.210239] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-17T05:48:41.210758] [INFO ] [MAIN ] Update Progress: 1673/2369 symbols completed. PGP took 21.3s. Estimated remaining: 1h 41m 45s. Rate: 6.8 symbols/min [2025-09-17T05:48:41.377235] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:48:41.385334] [DEBUG] [LOCAL ] PGZ: Loaded 4157 existing records from primary storage. [2025-09-17T05:48:41.385484] [INFO ] [MAIN ] PGZ: Loaded 4157 existing records. [2025-09-17T05:48:41.495238] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-17T05:48:41.562742] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:48:41.563026] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-17T05:48:41.563082] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-17T05:48:41.563339] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-17T05:48:41.563393] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-17T05:48:41.917800] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:48:42.201289] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T05:48:42.290181] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-09-17T05:48:43.090134] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-17T05:48:43.247863] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T05:48:43.429320] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T05:48:43.890136] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-17T05:48:44.690159] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-09-17T05:48:45.392974] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-17T05:48:45.490125] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-17T05:48:45.859275] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T05:48:45.919858] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T05:48:46.290182] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-17T05:48:47.090166] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-17T05:48:47.134886] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T05:48:47.672924] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T05:48:47.890144] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-11. [2025-09-17T05:48:48.464992] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T05:48:48.690152] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-17T05:48:49.315240] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T05:48:49.490122] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-17T05:48:50.290138] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-17T05:48:50.800875] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-17T05:48:50.807442] [INFO ] [REMOTE ] PG: Full fetch complete (77673 records). [2025-09-17T05:48:50.807622] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-17T05:48:51.100547] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-09-17T05:48:51.214723] [DEBUG] [VALIDATOR ] PG: All expected trading days are present. [2025-09-17T05:48:51.214906] [DEBUG] [VALIDATOR ] PG: Primary data validation passed. [2025-09-17T05:48:51.216517] [INFO ] [MAIN ] PG: Fetched primary data is valid. [2025-09-17T05:48:51.216591] [DEBUG] [LOCAL ] PG: Saving primary data. [2025-09-17T05:48:51.218615] [DEBUG] [LOCAL ] PG: Trimmed 77673 records to 53752 (keeping 200 days of data) [2025-09-17T05:48:51.500961] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T05:48:51.555452] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T05:48:51.687938] [DEBUG] [LOCAL ] PG: Primary data saved (53752 records). [2025-09-17T05:48:51.688231] [INFO ] [MAIN ] PG: Full history saved. [2025-09-17T05:48:51.688388] [INFO ] [MAIN ] Update Progress: 1674/2369 symbols completed. PG took 46.9s. Estimated remaining: 1h 41m 37s. Rate: 6.8 symbols/min [2025-09-17T05:48:51.873965] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:48:51.893433] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-17T05:48:51.903192] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T05:48:51.917954] [DEBUG] [LOCAL ] PH: Loaded 27760 existing records from primary storage. [2025-09-17T05:48:51.918212] [INFO ] [MAIN ] PH: Loaded 27760 existing records. [2025-09-17T05:48:52.107570] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:48:52.107958] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-17T05:48:52.108032] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-17T05:48:52.108883] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-17T05:48:52.108965] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-17T05:48:52.480400] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:48:52.690133] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-09-17T05:48:53.429732] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T05:48:53.490163] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-11. [2025-09-17T05:48:53.758669] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T05:48:54.290139] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-17T05:48:54.848506] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T05:48:54.978062] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T05:48:55.090111] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-09-17T05:48:55.890152] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-17T05:48:56.512069] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T05:48:56.599904] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T05:48:56.690117] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-17T05:48:57.282933] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T05:48:57.490165] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-17T05:48:58.290141] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-17T05:48:58.994504] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T05:48:59.090117] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-17T05:48:59.630326] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T05:48:59.890143] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-17T05:49:00.690112] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-17T05:49:00.728171] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T05:49:01.315136] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T05:49:01.490165] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-17T05:49:01.820352] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T05:49:02.101002] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T05:49:02.290180] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-09-17T05:49:03.090168] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-17T05:49:03.791179] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T05:49:03.890182] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-17T05:49:04.543963] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T05:49:04.691035] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-17T05:49:04.697188] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T05:49:05.490171] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-17T05:49:06.290145] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-17T05:49:06.546370] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T05:49:06.553211] [INFO ] [REMOTE ] PGR: Full fetch complete (76448 records). [2025-09-17T05:49:06.553444] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-17T05:49:06.957027] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T05:49:06.957103] [DEBUG] [VALIDATOR ] PGR: All expected trading days are present. [2025-09-17T05:49:06.958743] [INFO ] [REMOTE ] PGZ: Full fetch complete (8980 records). [2025-09-17T05:49:06.959006] [DEBUG] [VALIDATOR ] PGR: Primary data validation passed. [2025-09-17T05:49:06.960794] [INFO ] [MAIN ] PGR: Fetched primary data is valid. [2025-09-17T05:49:06.959413] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-17T05:49:06.961328] [DEBUG] [LOCAL ] PGR: Saving primary data. [2025-09-17T05:49:07.066537] [DEBUG] [LOCAL ] PGR: Trimmed 76448 records to 52999 (keeping 200 days of data) [2025-09-17T05:49:07.108080] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-17T05:49:07.334098] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T05:49:07.640734] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-17T05:49:07.650801] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-17T05:49:07.656071] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-17T05:49:07.660463] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-17T05:49:07.667511] [DEBUG] [LOCAL ] PGZ: Trimmed 8980 records to 5424 (keeping 200 days of data) [2025-09-17T05:49:07.771032] [DEBUG] [LOCAL ] PGZ: Primary data saved (5424 records). [2025-09-17T05:49:07.780056] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-17T05:49:07.783827] [INFO ] [MAIN ] Update Progress: 1675/2369 symbols completed. PGZ took 26.6s. Estimated remaining: 1h 41m 31s. Rate: 6.8 symbols/min [2025-09-17T05:49:07.864170] [DEBUG] [LOCAL ] PGR: Primary data saved (52999 records). [2025-09-17T05:49:07.877770] [INFO ] [MAIN ] PGR: Full history saved. [2025-09-17T05:49:07.896605] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-17T05:49:07.896920] [INFO ] [MAIN ] Update Progress: 1676/2369 symbols completed. PGR took 38.9s. Estimated remaining: 1h 41m 19s. Rate: 6.8 symbols/min [2025-09-17T05:49:08.083734] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:49:08.157739] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:49:08.161689] [DEBUG] [LOCAL ] PHD: Loaded 6883 existing records from primary storage. [2025-09-17T05:49:08.161956] [INFO ] [MAIN ] PHD: Loaded 6883 existing records. [2025-09-17T05:49:08.361768] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:49:08.371601] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-17T05:49:08.372709] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-17T05:49:08.373302] [DEBUG] [LOCAL ] PHG: Loaded 34281 existing records from primary storage. [2025-09-17T05:49:08.373379] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-17T05:49:08.373690] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-17T05:49:08.373606] [INFO ] [MAIN ] PHG: Loaded 34281 existing records. [2025-09-17T05:49:08.804311] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:49:08.818662] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-17T05:49:08.841101] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-17T05:49:08.867107] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-17T05:49:08.877445] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-17T05:49:08.962660] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:49:08.962949] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-11. [2025-09-17T05:49:09.329092] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-17T05:49:09.396621] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:49:09.490124] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-11. [2025-09-17T05:49:09.593973] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T05:49:09.765914] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T05:49:10.290132] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-17T05:49:10.950457] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T05:49:11.090152] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-09-17T05:49:11.876076] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T05:49:11.890102] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-17T05:49:12.644495] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T05:49:12.690182] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-17T05:49:13.290529] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T05:49:13.298337] [INFO ] [REMOTE ] PGRE: Full fetch complete (62679 records). [2025-09-17T05:49:13.298504] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-17T05:49:13.495231] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-17T05:49:13.686945] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-17T05:49:13.687046] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-17T05:49:13.688301] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-17T05:49:13.688358] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-17T05:49:13.689555] [DEBUG] [LOCAL ] PGRE: Trimmed 62679 records to 46058 (keeping 200 days of data) [2025-09-17T05:49:13.952948] [DEBUG] [LOCAL ] PGRE: Primary data saved (46058 records). [2025-09-17T05:49:13.953111] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-17T05:49:13.953210] [INFO ] [MAIN ] Update Progress: 1677/2369 symbols completed. PGRE took 34.2s. Estimated remaining: 1h 41m 9s. Rate: 6.8 symbols/min [2025-09-17T05:49:14.064738] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T05:49:14.267954] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T05:49:14.290090] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-09-17T05:49:15.090184] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-17T05:49:15.813368] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T05:49:15.872158] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T05:49:15.890082] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-17T05:49:16.645410] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T05:49:16.690075] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-17T05:49:17.227426] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T05:49:17.490167] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-17T05:49:18.290179] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-17T05:49:19.097063] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-17T05:49:19.102355] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T05:49:19.142612] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T05:49:19.890197] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-17T05:49:20.690159] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-17T05:49:20.825514] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T05:49:21.416232] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T05:49:21.490189] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-17T05:49:21.618009] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T05:49:22.290144] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-17T05:49:23.011774] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T05:49:23.090128] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-17T05:49:23.137171] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T05:49:23.890127] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-17T05:49:24.690116] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-17T05:49:24.733112] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T05:49:24.861743] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T05:49:25.490171] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-17T05:49:26.169108] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T05:49:26.290160] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-17T05:49:27.027333] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T05:49:27.088876] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T05:49:27.098358] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-17T05:49:27.890173] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-17T05:49:28.338908] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T05:49:28.625443] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T05:49:28.628056] [INFO ] [REMOTE ] PHD: Full fetch complete (13643 records). [2025-09-17T05:49:28.628184] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-17T05:49:28.695335] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-17T05:49:29.001283] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-17T05:49:29.001417] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-17T05:49:29.001829] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-17T05:49:29.001890] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-17T05:49:29.002802] [DEBUG] [LOCAL ] PHD: Trimmed 13643 records to 9559 (keeping 200 days of data) [2025-09-17T05:49:29.063668] [DEBUG] [LOCAL ] PHD: Primary data saved (9559 records). [2025-09-17T05:49:29.063855] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-17T05:49:29.063960] [INFO ] [MAIN ] Update Progress: 1678/2369 symbols completed. PHD took 21.3s. Estimated remaining: 1h 41m 3s. Rate: 6.8 symbols/min [2025-09-17T05:49:29.490210] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-17T05:49:30.291164] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T05:49:30.301106] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-17T05:49:31.012330] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T05:49:31.090114] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-17T05:49:32.020329] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T05:49:32.031038] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-17T05:49:32.090977] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T05:49:32.097051] [INFO ] [REMOTE ] PH: Full fetch complete (56593 records). [2025-09-17T05:49:32.097219] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-17T05:49:32.498829] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-17T05:49:32.499090] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-17T05:49:32.501063] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-17T05:49:32.501137] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-17T05:49:32.503073] [DEBUG] [LOCAL ] PH: Trimmed 56593 records to 39450 (keeping 200 days of data) [2025-09-17T05:49:32.778059] [DEBUG] [LOCAL ] PH: Primary data saved (39450 records). [2025-09-17T05:49:32.778306] [INFO ] [MAIN ] PH: Full history saved. [2025-09-17T05:49:32.778430] [INFO ] [MAIN ] Update Progress: 1679/2369 symbols completed. PH took 41.1s. Estimated remaining: 1h 40m 52s. Rate: 6.8 symbols/min [2025-09-17T05:49:33.577923] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T05:49:33.588399] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-17T05:49:34.986548] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T05:49:34.992054] [INFO ] [REMOTE ] PHG: Full fetch complete (65513 records). [2025-09-17T05:49:34.992200] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-17T05:49:35.397805] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-17T05:49:35.397958] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-17T05:49:35.398993] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-17T05:49:35.399052] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-17T05:49:35.400410] [DEBUG] [LOCAL ] PHG: Trimmed 65513 records to 46302 (keeping 200 days of data) [2025-09-17T05:49:35.681161] [DEBUG] [LOCAL ] PHG: Primary data saved (46302 records). [2025-09-17T05:49:35.681315] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-17T05:49:35.681432] [INFO ] [MAIN ] Update Progress: 1680/2369 symbols completed. PHG took 27.8s. Estimated remaining: 1h 40m 41s. Rate: 6.8 symbols/min [2025-09-17T05:49:36.318178] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:49:36.398573] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:49:36.408338] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:49:36.430969] [DEBUG] [LOCAL ] PHI: No existing data file found in primary storage. [2025-09-17T05:49:36.436481] [WARN ] [MAIN ] PHI: No existing data found, performing full refresh instead. [2025-09-17T05:49:36.434603] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:49:36.437704] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-17T05:49:36.437801] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-17T05:49:36.438181] [DEBUG] [LOCAL ] PHI: No primary data file found to delete. [2025-09-17T05:49:36.438241] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-17T05:49:36.629479] [DEBUG] [LOCAL ] PHIN: Loaded 23455 existing records from primary storage. [2025-09-17T05:49:36.639763] [INFO ] [MAIN ] PHIN: Loaded 23455 existing records. [2025-09-17T05:49:36.656413] [DEBUG] [LOCAL ] PHK: Loaded 19231 existing records from primary storage. [2025-09-17T05:49:36.695050] [INFO ] [MAIN ] PHK: Loaded 19231 existing records. [2025-09-17T05:49:36.830941] [DEBUG] [LOCAL ] PHM: Loaded 38479 existing records from primary storage. [2025-09-17T05:49:36.896463] [INFO ] [MAIN ] PHM: Loaded 38479 existing records. [2025-09-17T05:49:37.264885] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:49:37.268093] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:49:37.371075] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-17T05:49:37.320549] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-11. [2025-09-17T05:49:37.382456] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-17T05:49:37.426782] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:49:37.430529] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-17T05:49:37.431158] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-17T05:49:37.430760] [WARN ] [MAIN ] PHM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:49:37.452883] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-17T05:49:37.468901] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-17T05:49:37.474152] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-17T05:49:37.516869] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-17T05:49:37.511688] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-17T05:49:37.528565] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-17T05:49:37.551396] [DEBUG] [LOCAL ] PHM: Deleted primary data file. [2025-09-17T05:49:37.570574] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-17T05:49:38.449232] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:49:38.468280] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-11. [2025-09-17T05:49:38.388812] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:49:38.493322] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-11. [2025-09-17T05:49:38.562400] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:49:38.563112] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-11. [2025-09-17T05:49:38.532440] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T05:49:38.566508] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-09-17T05:49:39.482055] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T05:49:39.485890] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-09-17T05:49:39.693248] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T05:49:39.699179] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-09-17T05:49:39.860916] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T05:49:39.868284] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-09-17T05:49:39.977408] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T05:49:39.988045] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-17T05:49:40.298393] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T05:49:40.690254] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-17T05:49:40.958346] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T05:49:41.261984] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T05:49:41.453533] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T05:49:41.490086] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-17T05:49:41.585782] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T05:49:42.290192] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-17T05:49:43.015424] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T05:49:43.090089] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-17T05:49:43.491539] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T05:49:43.890140] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-17T05:49:44.702154] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-17T05:49:44.708044] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T05:49:44.816572] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T05:49:45.490142] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-17T05:49:46.003384] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T05:49:46.290146] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-17T05:49:47.090118] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-09-17T05:49:47.243667] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T05:49:47.822231] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T05:49:47.890086] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-17T05:49:48.347694] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T05:49:48.690147] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-17T05:49:49.122690] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T05:49:49.490162] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-17T05:49:50.290153] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-17T05:49:50.362348] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T05:49:50.494264] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T05:49:51.090178] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-17T05:49:51.520781] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T05:49:51.890134] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-17T05:49:52.598159] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T05:49:52.690122] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-17T05:49:53.200058] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T05:49:53.490139] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-17T05:49:54.290133] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-17T05:49:54.371905] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T05:49:54.416606] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-17T05:49:55.090165] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-17T05:49:55.567583] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T05:49:55.890102] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-17T05:49:56.301769] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T05:49:56.598941] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T05:49:56.690128] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-17T05:49:57.490172] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-17T05:49:57.536670] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T05:49:58.290144] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-17T05:49:58.815596] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T05:49:59.090192] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-17T05:49:59.855895] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T05:49:59.882094] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T05:49:59.890073] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-17T05:50:00.690138] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-17T05:50:01.114499] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T05:50:01.117817] [INFO ] [REMOTE ] PHI: Full fetch complete (20470 records). [2025-09-17T05:50:01.117979] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-17T05:50:01.496303] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-17T05:50:01.498226] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-17T05:50:01.499359] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-17T05:50:01.499899] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-17T05:50:01.499970] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-17T05:50:01.500893] [DEBUG] [LOCAL ] PHI: Trimmed 20470 records to 14815 (keeping 200 days of data) [2025-09-17T05:50:01.596915] [DEBUG] [LOCAL ] PHI: Primary data saved (14815 records). [2025-09-17T05:50:01.597112] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-17T05:50:01.597199] [INFO ] [MAIN ] Update Progress: 1681/2369 symbols completed. PHI took 25.9s. Estimated remaining: 1h 40m 39s. Rate: 6.8 symbols/min [2025-09-17T05:50:01.774337] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:50:01.805189] [DEBUG] [LOCAL ] PHR: Loaded 27627 existing records from primary storage. [2025-09-17T05:50:01.805405] [INFO ] [MAIN ] PHR: Loaded 27627 existing records. [2025-09-17T05:50:01.995402] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:50:01.995782] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-17T05:50:01.995966] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-17T05:50:01.996706] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-17T05:50:01.996838] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-17T05:50:02.292891] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-17T05:50:02.279520] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T05:50:02.413956] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:50:03.090145] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-17T05:50:03.516323] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T05:50:03.652589] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T05:50:03.890192] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-17T05:50:04.532829] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T05:50:04.681087] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T05:50:04.690069] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-17T05:50:05.490113] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-11. [2025-09-17T05:50:05.883521] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T05:50:06.290210] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-17T05:50:06.805034] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T05:50:07.090157] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-17T05:50:07.799209] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T05:50:07.805609] [INFO ] [REMOTE ] PHM: Full fetch complete (74807 records). [2025-09-17T05:50:07.805802] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-17T05:50:07.895973] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-17T05:50:08.205531] [DEBUG] [VALIDATOR ] PHM: All expected trading days are present. [2025-09-17T05:50:08.205874] [DEBUG] [VALIDATOR ] PHM: Primary data validation passed. [2025-09-17T05:50:08.207209] [INFO ] [MAIN ] PHM: Fetched primary data is valid. [2025-09-17T05:50:08.207295] [DEBUG] [LOCAL ] PHM: Saving primary data. [2025-09-17T05:50:08.220929] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T05:50:08.225356] [DEBUG] [LOCAL ] PHM: Trimmed 74807 records to 51713 (keeping 200 days of data) [2025-09-17T05:50:08.226632] [INFO ] [REMOTE ] PHIN: Full fetch complete (48106 records). [2025-09-17T05:50:08.227190] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-17T05:50:08.705390] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-09-17T05:50:08.760585] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-17T05:50:08.760807] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-17T05:50:08.762034] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-17T05:50:08.819441] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-17T05:50:08.866888] [DEBUG] [LOCAL ] PHIN: Trimmed 48106 records to 33538 (keeping 200 days of data) [2025-09-17T05:50:09.063554] [DEBUG] [LOCAL ] PHM: Primary data saved (51713 records). [2025-09-17T05:50:09.067781] [INFO ] [MAIN ] PHM: Full history saved. [2025-09-17T05:50:09.069083] [INFO ] [MAIN ] Update Progress: 1682/2369 symbols completed. PHM took 33.4s. Estimated remaining: 1h 40m 30s. Rate: 6.8 symbols/min [2025-09-17T05:50:09.249999] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:50:09.279190] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T05:50:09.291998] [DEBUG] [LOCAL ] PHT: Loaded 12100 existing records from primary storage. [2025-09-17T05:50:09.293183] [INFO ] [MAIN ] PHT: Loaded 12100 existing records. [2025-09-17T05:50:09.494301] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-17T05:50:09.558110] [WARN ] [MAIN ] PHT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:50:09.560039] [INFO ] [MAIN ] PHT: Wiping existing primary data before full refresh. [2025-09-17T05:50:09.564681] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-17T05:50:09.569717] [DEBUG] [LOCAL ] PHT: Deleted primary data file. [2025-09-17T05:50:09.571291] [INFO ] [MAIN ] PHT: Starting full primary refresh. [2025-09-17T05:50:09.704723] [DEBUG] [LOCAL ] PHIN: Primary data saved (33538 records). [2025-09-17T05:50:09.728743] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-17T05:50:09.764117] [INFO ] [MAIN ] Update Progress: 1683/2369 symbols completed. PHIN took 34.1s. Estimated remaining: 1h 40m 17s. Rate: 6.8 symbols/min [2025-09-17T05:50:10.096900] [INFO ] [REMOTE ] PHT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:50:10.152600] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:50:10.189991] [DEBUG] [LOCAL ] PII: Loaded 36553 existing records from primary storage. [2025-09-17T05:50:10.190192] [INFO ] [MAIN ] PII: Loaded 36553 existing records. [2025-09-17T05:50:10.291793] [INFO ] [REMOTE ] PHT: Fetching primary data for 2024-11. [2025-09-17T05:50:10.381824] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T05:50:10.411960] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:50:10.412681] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-17T05:50:10.413000] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-17T05:50:10.414070] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-17T05:50:10.414142] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-17T05:50:10.767724] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:50:10.886911] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T05:50:10.891927] [INFO ] [REMOTE ] PHK: Full fetch complete (39395 records). [2025-09-17T05:50:10.892128] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-17T05:50:11.063792] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T05:50:11.102043] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-17T05:50:11.328928] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-17T05:50:11.329161] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-17T05:50:11.330701] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-17T05:50:11.330792] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-17T05:50:11.332340] [DEBUG] [LOCAL ] PHK: Trimmed 39395 records to 26713 (keeping 200 days of data) [2025-09-17T05:50:11.527466] [DEBUG] [LOCAL ] PHK: Primary data saved (26713 records). [2025-09-17T05:50:11.527774] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-17T05:50:11.527911] [INFO ] [MAIN ] Update Progress: 1684/2369 symbols completed. PHK took 35.8s. Estimated remaining: 1h 40m 6s. Rate: 6.8 symbols/min [2025-09-17T05:50:11.770256] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:50:11.778427] [DEBUG] [LOCAL ] PIM: Loaded 3777 existing records from primary storage. [2025-09-17T05:50:11.778708] [INFO ] [MAIN ] PIM: Loaded 3777 existing records. [2025-09-17T05:50:11.895682] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-11. [2025-09-17T05:50:12.032520] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:50:12.032914] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-17T05:50:12.032993] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-17T05:50:12.033259] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-17T05:50:12.033335] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-17T05:50:12.665869] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:50:12.690926] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-11. [2025-09-17T05:50:12.697306] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T05:50:13.290114] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T05:50:13.475070] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T05:50:13.490081] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-09-17T05:50:14.290178] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-09-17T05:50:14.946315] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T05:50:15.090160] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-09-17T05:50:15.166569] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T05:50:15.617065] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T05:50:15.890156] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-09-17T05:50:16.690166] [INFO ] [REMOTE ] PHT: Fetching primary data for 2024-12. [2025-09-17T05:50:17.490143] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-17T05:50:17.522799] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T05:50:17.566777] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T05:50:18.057024] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T05:50:18.290134] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-17T05:50:18.783634] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-17T05:50:19.090153] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-17T05:50:19.728219] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T05:50:19.890173] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-01. [2025-09-17T05:50:20.602666] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T05:50:20.690178] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-17T05:50:21.323250] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T05:50:21.490162] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-02. [2025-09-17T05:50:22.088847] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T05:50:22.290148] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-17T05:50:23.090194] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-03. [2025-09-17T05:50:23.552931] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T05:50:23.889512] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T05:50:23.892269] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-17T05:50:24.456900] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T05:50:24.690130] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-17T05:50:25.258294] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T05:50:25.490152] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-17T05:50:26.290134] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-17T05:50:26.896841] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T05:50:27.090130] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-17T05:50:27.666447] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T05:50:27.890152] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-17T05:50:28.494063] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T05:50:28.494881] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T05:50:28.690139] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-17T05:50:29.197886] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T05:50:29.199713] [INFO ] [REMOTE ] PIM: Full fetch complete (6588 records). [2025-09-17T05:50:29.199809] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-17T05:50:29.493131] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-17T05:50:29.573632] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-17T05:50:29.573755] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-17T05:50:29.573963] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-17T05:50:29.574017] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-17T05:50:29.574513] [DEBUG] [LOCAL ] PIM: Trimmed 6588 records to 4766 (keeping 200 days of data) [2025-09-17T05:50:29.603365] [DEBUG] [LOCAL ] PIM: Primary data saved (4766 records). [2025-09-17T05:50:29.603525] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-17T05:50:29.603629] [INFO ] [MAIN ] Update Progress: 1685/2369 symbols completed. PIM took 18.1s. Estimated remaining: 1h 40m 1s. Rate: 6.8 symbols/min [2025-09-17T05:50:29.772808] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:50:29.784945] [DEBUG] [LOCAL ] PINE: Loaded 10458 existing records from primary storage. [2025-09-17T05:50:29.785108] [INFO ] [MAIN ] PINE: Loaded 10458 existing records. [2025-09-17T05:50:29.969444] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:50:29.969736] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-17T05:50:29.969790] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-17T05:50:29.970236] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-17T05:50:29.970303] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-17T05:50:30.290584] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-17T05:50:30.325033] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:50:30.874696] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T05:50:31.090187] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-11. [2025-09-17T05:50:31.890129] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-04. [2025-09-17T05:50:31.977569] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T05:50:32.046372] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T05:50:32.690134] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-09-17T05:50:32.845371] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T05:50:33.490193] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-05. [2025-09-17T05:50:33.625059] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T05:50:34.290147] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-17T05:50:34.325933] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T05:50:35.090173] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-06. [2025-09-17T05:50:35.890147] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-17T05:50:35.949044] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T05:50:36.082506] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T05:50:36.690224] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-17T05:50:36.828207] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T05:50:37.490195] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-17T05:50:38.031792] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T05:50:38.290174] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-07. [2025-09-17T05:50:38.440080] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T05:50:39.090197] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-17T05:50:39.393276] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T05:50:39.631738] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T05:50:39.890144] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-17T05:50:40.690155] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-17T05:50:41.490121] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-08. [2025-09-17T05:50:41.563481] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T05:50:42.098748] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T05:50:42.290181] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-17T05:50:42.466728] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T05:50:43.090138] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-17T05:50:43.355742] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T05:50:43.890153] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-17T05:50:44.690201] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-17T05:50:44.805504] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T05:50:44.837891] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T05:50:44.841299] [INFO ] [REMOTE ] PHT: Full fetch complete (19122 records). [2025-09-17T05:50:44.841424] [DEBUG] [VALIDATOR ] PHT: Validating primary data. [2025-09-17T05:50:45.221046] [DEBUG] [VALIDATOR ] PHT: All expected trading days are present. [2025-09-17T05:50:45.221153] [DEBUG] [VALIDATOR ] PHT: Primary data validation passed. [2025-09-17T05:50:45.221519] [INFO ] [MAIN ] PHT: Fetched primary data is valid. [2025-09-17T05:50:45.221571] [DEBUG] [LOCAL ] PHT: Saving primary data. [2025-09-17T05:50:45.222240] [DEBUG] [LOCAL ] PHT: Trimmed 19122 records to 15346 (keeping 200 days of data) [2025-09-17T05:50:45.310991] [DEBUG] [LOCAL ] PHT: Primary data saved (15346 records). [2025-09-17T05:50:45.311147] [INFO ] [MAIN ] PHT: Full history saved. [2025-09-17T05:50:45.311240] [INFO ] [MAIN ] Update Progress: 1686/2369 symbols completed. PHT took 36.2s. Estimated remaining: 1h 39m 55s. Rate: 6.8 symbols/min [2025-09-17T05:50:45.488268] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:50:45.490117] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-17T05:50:45.533031] [DEBUG] [LOCAL ] PINS: Loaded 40043 existing records from primary storage. [2025-09-17T05:50:45.533270] [INFO ] [MAIN ] PINS: Loaded 40043 existing records. [2025-09-17T05:50:45.714720] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:50:45.714993] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-17T05:50:45.715072] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-17T05:50:45.716015] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-17T05:50:45.716088] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-17T05:50:46.004062] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T05:50:46.083080] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:50:46.290077] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-11. [2025-09-17T05:50:47.013554] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T05:50:47.090106] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-17T05:50:47.890155] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-17T05:50:47.997079] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T05:50:48.239733] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T05:50:48.245554] [INFO ] [REMOTE ] PHR: Full fetch complete (51587 records). [2025-09-17T05:50:48.245695] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-17T05:50:48.621291] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-17T05:50:48.621404] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-17T05:50:48.622324] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-17T05:50:48.622384] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-17T05:50:48.623508] [DEBUG] [LOCAL ] PHR: Trimmed 51587 records to 36960 (keeping 200 days of data) [2025-09-17T05:50:48.692056] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-17T05:50:48.752653] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T05:50:48.875189] [DEBUG] [LOCAL ] PHR: Primary data saved (36960 records). [2025-09-17T05:50:48.875393] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-17T05:50:48.875550] [INFO ] [MAIN ] Update Progress: 1687/2369 symbols completed. PHR took 47.3s. Estimated remaining: 1h 39m 44s. Rate: 6.8 symbols/min [2025-09-17T05:50:49.048160] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:50:49.061616] [DEBUG] [LOCAL ] PIPR: Loaded 10931 existing records from primary storage. [2025-09-17T05:50:49.061809] [INFO ] [MAIN ] PIPR: Loaded 10931 existing records. [2025-09-17T05:50:49.241558] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:50:49.241879] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-17T05:50:49.241946] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-17T05:50:49.242428] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-17T05:50:49.242504] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-17T05:50:49.499168] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-09-17T05:50:49.607323] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:50:50.290138] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-11. [2025-09-17T05:50:50.727015] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T05:50:51.090141] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-17T05:50:51.150233] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T05:50:51.528259] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T05:50:51.893380] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-09-17T05:50:51.898796] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T05:50:52.690125] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-17T05:50:53.490170] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-09-17T05:50:53.787617] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T05:50:54.287807] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T05:50:54.290090] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-17T05:50:54.336321] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T05:50:55.090170] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-17T05:50:55.890151] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-09-17T05:50:56.056228] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T05:50:56.242844] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T05:50:56.690150] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-17T05:50:56.852394] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T05:50:57.378176] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T05:50:57.380634] [INFO ] [REMOTE ] PINE: Full fetch complete (21347 records). [2025-09-17T05:50:57.380792] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-17T05:50:57.495202] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-17T05:50:57.759581] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-17T05:50:57.759745] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-17T05:50:57.760273] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-17T05:50:57.760350] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-17T05:50:57.761064] [DEBUG] [LOCAL ] PINE: Trimmed 21347 records to 14240 (keeping 200 days of data) [2025-09-17T05:50:57.851330] [DEBUG] [LOCAL ] PINE: Primary data saved (14240 records). [2025-09-17T05:50:57.851503] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-17T05:50:57.851660] [INFO ] [MAIN ] Update Progress: 1688/2369 symbols completed. PINE took 28.2s. Estimated remaining: 1h 39m 35s. Rate: 6.8 symbols/min [2025-09-17T05:50:58.020929] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:50:58.039360] [DEBUG] [LOCAL ] PJT: Loaded 15907 existing records from primary storage. [2025-09-17T05:50:58.039545] [INFO ] [MAIN ] PJT: Loaded 15907 existing records. [2025-09-17T05:50:58.219311] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:50:58.219575] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-17T05:50:58.219670] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-17T05:50:58.220347] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-17T05:50:58.220425] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-17T05:50:58.295210] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-17T05:50:58.578944] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:50:59.090140] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-17T05:50:59.612790] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T05:50:59.666952] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T05:50:59.890144] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-17T05:50:59.975233] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T05:50:59.983431] [INFO ] [REMOTE ] PII: Full fetch complete (70920 records). [2025-09-17T05:50:59.983607] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-17T05:51:00.375340] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-17T05:51:00.375451] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-17T05:51:00.376472] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-17T05:51:00.376536] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-17T05:51:00.378035] [DEBUG] [LOCAL ] PII: Trimmed 70920 records to 49453 (keeping 200 days of data) [2025-09-17T05:51:00.691336] [DEBUG] [LOCAL ] PII: Primary data saved (49453 records). [2025-09-17T05:51:00.690170] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-17T05:51:00.692334] [INFO ] [MAIN ] PII: Full history saved. [2025-09-17T05:51:00.692521] [INFO ] [MAIN ] Update Progress: 1689/2369 symbols completed. PII took 50.9s. Estimated remaining: 1h 39m 24s. Rate: 6.8 symbols/min [2025-09-17T05:51:00.872321] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:51:00.883918] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T05:51:00.930106] [DEBUG] [LOCAL ] PK: Loaded 39339 existing records from primary storage. [2025-09-17T05:51:00.930445] [INFO ] [MAIN ] PK: Loaded 39339 existing records. [2025-09-17T05:51:01.151960] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:51:01.152331] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-17T05:51:01.152456] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-17T05:51:01.153545] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-17T05:51:01.153626] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-17T05:51:01.495550] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-17T05:51:01.560125] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:51:02.290149] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-11. [2025-09-17T05:51:03.090151] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-11. [2025-09-17T05:51:03.367829] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.68 seconds). [2025-09-17T05:51:03.721704] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T05:51:03.890166] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-17T05:51:04.576587] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-11 (2.29 seconds). [2025-09-17T05:51:04.690280] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-17T05:51:04.988379] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T05:51:05.490149] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-09-17T05:51:05.717214] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T05:51:06.020786] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T05:51:06.290177] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-17T05:51:07.090185] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-09-17T05:51:07.154879] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T05:51:07.267301] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T05:51:07.890165] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-17T05:51:08.145259] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T05:51:08.690226] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-17T05:51:09.490115] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-09-17T05:51:09.693823] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T05:51:09.787211] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T05:51:10.290127] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-17T05:51:10.554073] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T05:51:11.090145] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-09-17T05:51:11.890136] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-17T05:51:12.342585] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T05:51:12.690153] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-17T05:51:12.801278] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T05:51:12.886418] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T05:51:13.490153] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-17T05:51:14.290157] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-17T05:51:14.599225] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T05:51:14.928843] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-17T05:51:15.090152] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-17T05:51:15.537220] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T05:51:15.890160] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-17T05:51:16.690184] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-17T05:51:17.490197] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-17T05:51:17.610226] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-17T05:51:17.616960] [INFO ] [REMOTE ] PINS: Full fetch complete (77649 records). [2025-09-17T05:51:17.617167] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-17T05:51:18.038568] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-17T05:51:18.038692] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-17T05:51:18.039766] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-17T05:51:18.039825] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-17T05:51:18.041337] [DEBUG] [LOCAL ] PINS: Trimmed 77649 records to 53693 (keeping 200 days of data) [2025-09-17T05:51:18.384161] [DEBUG] [LOCAL ] PINS: Primary data saved (53693 records). [2025-09-17T05:51:18.403544] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-17T05:51:18.403919] [INFO ] [MAIN ] Update Progress: 1690/2369 symbols completed. PINS took 33.1s. Estimated remaining: 1h 39m 19s. Rate: 6.8 symbols/min [2025-09-17T05:51:18.417493] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-17T05:51:18.465796] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T05:51:18.531626] [INFO ] [REMOTE ] PIPR: Full fetch complete (20129 records). [2025-09-17T05:51:18.537143] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-17T05:51:18.557916] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-17T05:51:18.611226] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:51:18.875030] [DEBUG] [LOCAL ] PKE: Loaded 10033 existing records from primary storage. [2025-09-17T05:51:18.898391] [INFO ] [MAIN ] PKE: Loaded 10033 existing records. [2025-09-17T05:51:19.113524] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T05:51:19.173481] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-17T05:51:19.189668] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-17T05:51:19.211553] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:51:19.205021] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-17T05:51:19.213355] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-17T05:51:19.213663] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-17T05:51:19.213789] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-17T05:51:19.213835] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-17T05:51:19.214545] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-17T05:51:19.214762] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-17T05:51:19.214696] [DEBUG] [LOCAL ] PIPR: Trimmed 20129 records to 15340 (keeping 200 days of data) [2025-09-17T05:51:19.679492] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:51:19.691948] [DEBUG] [LOCAL ] PIPR: Primary data saved (15340 records). [2025-09-17T05:51:19.692129] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-17T05:51:19.692223] [INFO ] [MAIN ] Update Progress: 1691/2369 symbols completed. PIPR took 30.8s. Estimated remaining: 1h 39m 7s. Rate: 6.8 symbols/min [2025-09-17T05:51:19.869790] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:51:19.890151] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-11. [2025-09-17T05:51:19.906113] [DEBUG] [LOCAL ] PKG: Loaded 28855 existing records from primary storage. [2025-09-17T05:51:19.906358] [INFO ] [MAIN ] PKG: Loaded 28855 existing records. [2025-09-17T05:51:20.107322] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:51:20.107599] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-17T05:51:20.107704] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-17T05:51:20.108550] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-17T05:51:20.108631] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-17T05:51:20.471159] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:51:20.504301] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T05:51:20.545860] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T05:51:20.560401] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T05:51:20.690123] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-09-17T05:51:21.487243] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T05:51:21.490457] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-17T05:51:22.290209] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-11. [2025-09-17T05:51:22.386287] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T05:51:23.090218] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-17T05:51:23.733676] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T05:51:23.890145] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-09-17T05:51:24.690141] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-17T05:51:24.823104] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T05:51:24.953011] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T05:51:25.490185] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-17T05:51:25.517459] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T05:51:26.290129] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-17T05:51:27.090178] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-09-17T05:51:27.256051] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T05:51:27.443569] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T05:51:27.890168] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-17T05:51:28.690179] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-17T05:51:28.846711] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T05:51:29.361945] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T05:51:29.490138] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-17T05:51:29.631297] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T05:51:30.290147] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-17T05:51:30.732671] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T05:51:30.856911] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T05:51:31.090137] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-17T05:51:31.890155] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-17T05:51:31.904782] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T05:51:32.690154] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-17T05:51:32.874999] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T05:51:33.490141] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-17T05:51:34.273796] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T05:51:34.290545] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T05:51:34.290889] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-17T05:51:35.090184] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-17T05:51:35.890111] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-17T05:51:36.043996] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T05:51:36.207808] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T05:51:36.690171] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-17T05:51:37.490153] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-17T05:51:37.642159] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T05:51:37.950984] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T05:51:38.290159] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-17T05:51:38.450060] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T05:51:39.090126] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-17T05:51:39.376365] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T05:51:39.890178] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-17T05:51:40.612356] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T05:51:40.690153] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-17T05:51:40.934007] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T05:51:40.936538] [INFO ] [REMOTE ] PKE: Full fetch complete (16645 records). [2025-09-17T05:51:40.936683] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-17T05:51:41.306750] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-17T05:51:41.306882] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-17T05:51:41.307330] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-17T05:51:41.307386] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-17T05:51:41.308100] [DEBUG] [LOCAL ] PKE: Trimmed 16645 records to 12253 (keeping 200 days of data) [2025-09-17T05:51:41.381809] [DEBUG] [LOCAL ] PKE: Primary data saved (12253 records). [2025-09-17T05:51:41.381968] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-17T05:51:41.382065] [INFO ] [MAIN ] Update Progress: 1692/2369 symbols completed. PKE took 23.0s. Estimated remaining: 1h 39m 4s. Rate: 6.8 symbols/min [2025-09-17T05:51:41.522538] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-17T05:51:41.609753] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:51:41.625561] [DEBUG] [LOCAL ] PKST: Loaded 12953 existing records from primary storage. [2025-09-17T05:51:41.625771] [INFO ] [MAIN ] PKST: Loaded 12953 existing records. [2025-09-17T05:51:41.811503] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:51:41.811805] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-17T05:51:41.811859] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-17T05:51:41.812340] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-17T05:51:41.812409] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-17T05:51:42.177902] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:51:42.290108] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-17T05:51:42.380208] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T05:51:42.386811] [INFO ] [REMOTE ] PK: Full fetch complete (76191 records). [2025-09-17T05:51:42.386985] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-17T05:51:42.671926] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T05:51:42.705342] [INFO ] [REMOTE ] PJT: Full fetch complete (32215 records). [2025-09-17T05:51:42.720839] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-17T05:51:42.885335] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-17T05:51:42.908949] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-17T05:51:42.912779] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-17T05:51:42.923624] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-17T05:51:42.994665] [DEBUG] [LOCAL ] PK: Trimmed 76191 records to 52885 (keeping 200 days of data) [2025-09-17T05:51:43.091025] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-11. [2025-09-17T05:51:43.304856] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-17T05:51:43.306991] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-17T05:51:43.313293] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-17T05:51:43.319144] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-17T05:51:43.328041] [DEBUG] [LOCAL ] PJT: Trimmed 32215 records to 23021 (keeping 200 days of data) [2025-09-17T05:51:43.596941] [DEBUG] [LOCAL ] PJT: Primary data saved (23021 records). [2025-09-17T05:51:43.598040] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-17T05:51:43.598656] [INFO ] [MAIN ] Update Progress: 1693/2369 symbols completed. PJT took 45.7s. Estimated remaining: 1h 38m 52s. Rate: 6.8 symbols/min [2025-09-17T05:51:43.788210] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:51:43.905203] [DEBUG] [LOCAL ] PK: Primary data saved (52885 records). [2025-09-17T05:51:43.914804] [INFO ] [MAIN ] PK: Full history saved. [2025-09-17T05:51:43.914686] [DEBUG] [LOCAL ] PKX: Loaded 16636 existing records from primary storage. [2025-09-17T05:51:43.918288] [INFO ] [MAIN ] PKX: Loaded 16636 existing records. [2025-09-17T05:51:43.918083] [INFO ] [MAIN ] Update Progress: 1694/2369 symbols completed. PK took 43.2s. Estimated remaining: 1h 38m 40s. Rate: 6.8 symbols/min [2025-09-17T05:51:43.975162] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T05:51:44.103923] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-17T05:51:44.269011] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:51:44.288106] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-17T05:51:44.287877] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:51:44.288229] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-17T05:51:44.296466] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-17T05:51:44.307820] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-17T05:51:44.320189] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T05:51:44.606371] [DEBUG] [LOCAL ] PL: Loaded 39639 existing records from primary storage. [2025-09-17T05:51:44.616530] [INFO ] [MAIN ] PL: Loaded 39639 existing records. [2025-09-17T05:51:44.712208] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-09-17T05:51:44.817761] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:51:44.880020] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:51:44.880237] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-17T05:51:44.880312] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-17T05:51:44.881223] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-17T05:51:44.881296] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-17T05:51:45.230825] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:51:45.490139] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-11. [2025-09-17T05:51:45.739107] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T05:51:45.980614] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T05:51:46.290143] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-09-17T05:51:46.640622] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T05:51:47.090159] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-17T05:51:47.312074] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T05:51:47.890140] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-11. [2025-09-17T05:51:48.341565] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T05:51:48.690147] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-17T05:51:49.490141] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-09-17T05:51:49.680110] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T05:51:50.226390] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T05:51:50.231367] [INFO ] [REMOTE ] PKG: Full fetch complete (57305 records). [2025-09-17T05:51:50.231525] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-17T05:51:50.295248] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-09-17T05:51:50.649244] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-17T05:51:50.649384] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-17T05:51:50.650486] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-17T05:51:50.650566] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-17T05:51:50.651928] [DEBUG] [LOCAL ] PKG: Trimmed 57305 records to 39476 (keeping 200 days of data) [2025-09-17T05:51:50.906290] [DEBUG] [LOCAL ] PKG: Primary data saved (39476 records). [2025-09-17T05:51:50.906502] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-17T05:51:50.906720] [INFO ] [MAIN ] Update Progress: 1695/2369 symbols completed. PKG took 31.2s. Estimated remaining: 1h 38m 31s. Rate: 6.8 symbols/min [2025-09-17T05:51:51.045236] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T05:51:51.100035] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-17T05:51:51.120021] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:51:51.164834] [DEBUG] [LOCAL ] PLD: Loaded 39856 existing records from primary storage. [2025-09-17T05:51:51.165023] [INFO ] [MAIN ] PLD: Loaded 39856 existing records. [2025-09-17T05:51:51.343305] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:51:51.343583] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-17T05:51:51.343674] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-17T05:51:51.344882] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-17T05:51:51.344948] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-17T05:51:51.706298] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:51:51.890128] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-09-17T05:51:52.198132] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T05:51:52.529156] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-17T05:51:52.690136] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-17T05:51:53.076975] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T05:51:53.490147] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-11. [2025-09-17T05:51:53.860152] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T05:51:54.290156] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-17T05:51:55.090115] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-17T05:51:55.147999] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T05:51:55.467527] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T05:51:55.890137] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-09-17T05:51:56.045238] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T05:51:56.690132] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-09-17T05:51:57.360302] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T05:51:57.490125] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-17T05:51:58.290178] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-17T05:51:58.775149] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-17T05:51:58.813286] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T05:51:58.931075] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T05:51:59.090219] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-09-17T05:51:59.890139] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-17T05:52:00.690174] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-17T05:52:00.883761] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T05:52:00.949226] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T05:52:01.490246] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-17T05:52:02.084802] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T05:52:02.290284] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-17T05:52:03.090084] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-17T05:52:03.523809] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-17T05:52:03.557744] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T05:52:03.890161] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-17T05:52:04.624836] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T05:52:04.690163] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-17T05:52:04.859584] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T05:52:05.490235] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-17T05:52:06.290123] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-17T05:52:06.441575] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T05:52:06.724972] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T05:52:07.090158] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-17T05:52:07.890110] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-17T05:52:08.179476] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T05:52:08.313096] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T05:52:08.690181] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-17T05:52:09.490159] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-17T05:52:09.672675] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T05:52:09.676881] [INFO ] [REMOTE ] PKST: Full fetch complete (29774 records). [2025-09-17T05:52:09.677081] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-17T05:52:10.054099] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-17T05:52:10.054301] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-17T05:52:10.055092] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-17T05:52:10.055297] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-17T05:52:10.085136] [DEBUG] [LOCAL ] PKST: Trimmed 29774 records to 19656 (keeping 200 days of data) [2025-09-17T05:52:10.086774] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T05:52:10.220461] [DEBUG] [LOCAL ] PKST: Primary data saved (19656 records). [2025-09-17T05:52:10.220685] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-17T05:52:10.220826] [INFO ] [MAIN ] Update Progress: 1696/2369 symbols completed. PKST took 28.8s. Estimated remaining: 1h 38m 26s. Rate: 6.8 symbols/min [2025-09-17T05:52:10.298113] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-17T05:52:10.401583] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:52:10.448697] [DEBUG] [LOCAL ] PLNT: Loaded 35944 existing records from primary storage. [2025-09-17T05:52:10.448884] [INFO ] [MAIN ] PLNT: Loaded 35944 existing records. [2025-09-17T05:52:10.624600] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:52:10.624883] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-17T05:52:10.624958] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-17T05:52:10.625868] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-09-17T05:52:10.625935] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-17T05:52:10.984842] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:52:11.090186] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-11. [2025-09-17T05:52:11.416698] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T05:52:11.890151] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-17T05:52:12.335224] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-17T05:52:12.505385] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T05:52:12.690154] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-17T05:52:13.490138] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-09-17T05:52:13.926162] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-17T05:52:14.290173] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-17T05:52:14.402880] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T05:52:14.655129] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T05:52:15.090179] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-17T05:52:15.890186] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-17T05:52:16.471320] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-17T05:52:16.690108] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-17T05:52:16.770311] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T05:52:17.490138] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-17T05:52:17.822192] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T05:52:18.290218] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-17T05:52:19.093342] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T05:52:19.090234] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-17T05:52:19.139211] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-17T05:52:19.477929] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T05:52:19.890149] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-17T05:52:20.690147] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-17T05:52:20.799070] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T05:52:21.490175] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-17T05:52:21.669519] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T05:52:22.290170] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-17T05:52:22.434039] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T05:52:23.095221] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-17T05:52:23.106967] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T05:52:23.113659] [INFO ] [REMOTE ] PLD: Full fetch complete (77283 records). [2025-09-17T05:52:23.113806] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-17T05:52:23.511708] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-17T05:52:23.511818] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-17T05:52:23.513039] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-17T05:52:23.513110] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-17T05:52:23.514678] [DEBUG] [LOCAL ] PLD: Trimmed 77283 records to 53485 (keeping 200 days of data) [2025-09-17T05:52:23.863395] [DEBUG] [LOCAL ] PLD: Primary data saved (53485 records). [2025-09-17T05:52:23.863586] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-17T05:52:23.863703] [INFO ] [MAIN ] Update Progress: 1697/2369 symbols completed. PLD took 33.0s. Estimated remaining: 1h 38m 19s. Rate: 6.8 symbols/min [2025-09-17T05:52:23.895386] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-17T05:52:24.036417] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:52:24.052491] [DEBUG] [LOCAL ] PLOW: Loaded 15306 existing records from primary storage. [2025-09-17T05:52:24.052683] [INFO ] [MAIN ] PLOW: Loaded 15306 existing records. [2025-09-17T05:52:24.231932] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:52:24.232210] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-17T05:52:24.232270] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-17T05:52:24.232837] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-17T05:52:24.232904] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-17T05:52:24.605295] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:52:24.624579] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.33 seconds). [2025-09-17T05:52:24.631407] [INFO ] [REMOTE ] PL: Full fetch complete (76830 records). [2025-09-17T05:52:24.631665] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-17T05:52:24.697376] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-11. [2025-09-17T05:52:24.964293] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T05:52:25.070682] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-17T05:52:25.071046] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-17T05:52:25.072178] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-17T05:52:25.087162] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-17T05:52:25.103730] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T05:52:25.114124] [DEBUG] [LOCAL ] PL: Trimmed 76830 records to 53099 (keeping 200 days of data) [2025-09-17T05:52:25.429693] [DEBUG] [LOCAL ] PL: Primary data saved (53099 records). [2025-09-17T05:52:25.429964] [INFO ] [MAIN ] PL: Full history saved. [2025-09-17T05:52:25.436954] [INFO ] [MAIN ] Update Progress: 1698/2369 symbols completed. PL took 41.4s. Estimated remaining: 1h 38m 8s. Rate: 6.8 symbols/min [2025-09-17T05:52:25.442361] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T05:52:25.495486] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-17T05:52:25.621957] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:52:25.646360] [DEBUG] [LOCAL ] PLYM: Loaded 24687 existing records from primary storage. [2025-09-17T05:52:25.646536] [INFO ] [MAIN ] PLYM: Loaded 24687 existing records. [2025-09-17T05:52:25.831898] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:52:25.832141] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-17T05:52:25.832199] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-17T05:52:25.832934] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-17T05:52:25.832997] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-17T05:52:26.189370] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:52:26.290103] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-11. [2025-09-17T05:52:26.537025] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T05:52:26.540785] [INFO ] [REMOTE ] PKX: Full fetch complete (38330 records). [2025-09-17T05:52:26.540900] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-17T05:52:26.922615] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-17T05:52:26.922748] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-17T05:52:26.923567] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-17T05:52:26.923628] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-17T05:52:26.924754] [DEBUG] [LOCAL ] PKX: Trimmed 38330 records to 25476 (keeping 200 days of data) [2025-09-17T05:52:27.086291] [DEBUG] [LOCAL ] PKX: Primary data saved (25476 records). [2025-09-17T05:52:27.086445] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-17T05:52:27.086546] [INFO ] [MAIN ] Update Progress: 1699/2369 symbols completed. PKX took 43.5s. Estimated remaining: 1h 37m 56s. Rate: 6.8 symbols/min [2025-09-17T05:52:27.098153] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-09-17T05:52:27.259192] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:52:27.302181] [DEBUG] [LOCAL ] PM: Loaded 40027 existing records from primary storage. [2025-09-17T05:52:27.302367] [INFO ] [MAIN ] PM: Loaded 40027 existing records. [2025-09-17T05:52:27.481802] [WARN ] [MAIN ] PM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:52:27.482048] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-17T05:52:27.482106] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-17T05:52:27.482993] [DEBUG] [LOCAL ] PM: Deleted primary data file. [2025-09-17T05:52:27.483055] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-17T05:52:27.849775] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:52:27.870185] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T05:52:27.890098] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-09-17T05:52:28.035675] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T05:52:28.690119] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-17T05:52:29.156440] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T05:52:29.490189] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-11. [2025-09-17T05:52:30.290164] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-09-17T05:52:30.411217] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T05:52:31.090134] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-09-17T05:52:31.163719] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T05:52:31.393699] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T05:52:31.890103] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-17T05:52:32.061478] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T05:52:32.690147] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-17T05:52:32.778093] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T05:52:33.490166] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-17T05:52:33.834486] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T05:52:34.290136] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-17T05:52:35.090224] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-17T05:52:35.420343] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T05:52:35.890106] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-17T05:52:35.970926] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T05:52:35.992495] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T05:52:36.690141] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-17T05:52:37.490321] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-17T05:52:37.822503] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T05:52:38.025954] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T05:52:38.290172] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-17T05:52:39.098334] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-17T05:52:39.135447] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T05:52:39.657118] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T05:52:39.890141] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-17T05:52:40.690155] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-17T05:52:41.017470] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T05:52:41.055275] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-17T05:52:41.490142] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-17T05:52:41.679632] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T05:52:42.290188] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-17T05:52:42.647329] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T05:52:43.090222] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-17T05:52:43.890160] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-17T05:52:44.220782] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T05:52:44.678778] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T05:52:44.690075] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-17T05:52:44.784914] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T05:52:45.490196] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-17T05:52:45.956012] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T05:52:45.961768] [INFO ] [REMOTE ] PLNT: Full fetch complete (69936 records). [2025-09-17T05:52:45.961918] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-17T05:52:46.295299] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-17T05:52:46.370700] [DEBUG] [VALIDATOR ] PLNT: All expected trading days are present. [2025-09-17T05:52:46.370814] [DEBUG] [VALIDATOR ] PLNT: Primary data validation passed. [2025-09-17T05:52:46.372103] [INFO ] [MAIN ] PLNT: Fetched primary data is valid. [2025-09-17T05:52:46.372164] [DEBUG] [LOCAL ] PLNT: Saving primary data. [2025-09-17T05:52:46.374052] [DEBUG] [LOCAL ] PLNT: Trimmed 69936 records to 48629 (keeping 200 days of data) [2025-09-17T05:52:46.676463] [DEBUG] [LOCAL ] PLNT: Primary data saved (48629 records). [2025-09-17T05:52:46.676696] [INFO ] [MAIN ] PLNT: Full history saved. [2025-09-17T05:52:46.676822] [INFO ] [MAIN ] Update Progress: 1700/2369 symbols completed. PLNT took 36.5s. Estimated remaining: 1h 37m 51s. Rate: 6.8 symbols/min [2025-09-17T05:52:46.846993] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:52:46.863177] [DEBUG] [LOCAL ] PML: Loaded 15622 existing records from primary storage. [2025-09-17T05:52:46.863350] [INFO ] [MAIN ] PML: Loaded 15622 existing records. [2025-09-17T05:52:47.040290] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:52:47.040587] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-17T05:52:47.040672] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-17T05:52:47.041300] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-17T05:52:47.041359] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-17T05:52:47.108185] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-17T05:52:47.491213] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:52:47.600825] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T05:52:47.627177] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T05:52:47.890171] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-11. [2025-09-17T05:52:48.480349] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T05:52:48.640420] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T05:52:48.690155] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-17T05:52:49.490157] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-17T05:52:49.826539] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T05:52:50.290138] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-09-17T05:52:50.940671] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T05:52:51.090134] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-17T05:52:51.411774] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T05:52:51.772181] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T05:52:51.890154] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-17T05:52:52.690220] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-17T05:52:52.837488] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T05:52:52.839895] [INFO ] [REMOTE ] PLOW: Full fetch complete (28855 records). [2025-09-17T05:52:52.840001] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-17T05:52:53.230759] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-17T05:52:53.230870] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-17T05:52:53.231514] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-17T05:52:53.231569] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-17T05:52:53.232372] [DEBUG] [LOCAL ] PLOW: Trimmed 28855 records to 20830 (keeping 200 days of data) [2025-09-17T05:52:53.366059] [DEBUG] [LOCAL ] PLOW: Primary data saved (20830 records). [2025-09-17T05:52:53.366215] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-17T05:52:53.366308] [INFO ] [MAIN ] Update Progress: 1701/2369 symbols completed. PLOW took 29.5s. Estimated remaining: 1h 37m 42s. Rate: 6.8 symbols/min [2025-09-17T05:52:53.495410] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-17T05:52:53.543917] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:52:53.553188] [DEBUG] [LOCAL ] PMM: Loaded 6847 existing records from primary storage. [2025-09-17T05:52:53.553475] [INFO ] [MAIN ] PMM: Loaded 6847 existing records. [2025-09-17T05:52:53.736472] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:52:53.736820] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-17T05:52:53.736930] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-17T05:52:53.737287] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-17T05:52:53.737353] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-17T05:52:54.103969] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:52:54.290102] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-17T05:52:54.563021] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T05:52:54.778183] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T05:52:55.090128] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-11. [2025-09-17T05:52:55.838226] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T05:52:55.843728] [INFO ] [REMOTE ] PLYM: Full fetch complete (45878 records). [2025-09-17T05:52:55.843924] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-17T05:52:55.899723] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-17T05:52:56.122486] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T05:52:56.239446] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-17T05:52:56.239559] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-17T05:52:56.240458] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-17T05:52:56.240536] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-17T05:52:56.241618] [DEBUG] [LOCAL ] PLYM: Trimmed 45878 records to 32964 (keeping 200 days of data) [2025-09-17T05:52:56.443519] [DEBUG] [LOCAL ] PLYM: Primary data saved (32964 records). [2025-09-17T05:52:56.443704] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-17T05:52:56.443824] [INFO ] [MAIN ] Update Progress: 1702/2369 symbols completed. PLYM took 31.0s. Estimated remaining: 1h 37m 31s. Rate: 6.8 symbols/min [2025-09-17T05:52:56.620857] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:52:56.629891] [DEBUG] [LOCAL ] PMO: Loaded 6885 existing records from primary storage. [2025-09-17T05:52:56.630065] [INFO ] [MAIN ] PMO: Loaded 6885 existing records. [2025-09-17T05:52:56.695197] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-17T05:52:56.810516] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:52:56.810795] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-17T05:52:56.810881] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-17T05:52:56.811294] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-17T05:52:56.811367] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-17T05:52:57.117906] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T05:52:57.183787] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:52:57.490138] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-11. [2025-09-17T05:52:58.290098] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-09-17T05:52:58.429372] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T05:52:58.473219] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T05:52:59.090148] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-09-17T05:52:59.189461] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T05:52:59.739240] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T05:52:59.890205] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-09-17T05:53:00.690177] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-17T05:53:00.893168] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T05:53:01.490155] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-17T05:53:02.290167] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-17T05:53:02.427139] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T05:53:02.619109] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T05:53:02.830300] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T05:53:03.090188] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-17T05:53:03.876999] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T05:53:03.890075] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-17T05:53:04.690150] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-17T05:53:04.766149] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T05:53:05.490144] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-17T05:53:05.523399] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T05:53:06.290145] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-17T05:53:07.090178] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-17T05:53:07.252969] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T05:53:07.511217] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T05:53:07.890162] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-17T05:53:08.085487] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T05:53:08.690137] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-17T05:53:09.490168] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-17T05:53:09.631546] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T05:53:09.658316] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T05:53:09.664920] [INFO ] [REMOTE ] PM: Full fetch complete (77589 records). [2025-09-17T05:53:09.665063] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-17T05:53:10.065473] [DEBUG] [VALIDATOR ] PM: All expected trading days are present. [2025-09-17T05:53:10.065606] [DEBUG] [VALIDATOR ] PM: Primary data validation passed. [2025-09-17T05:53:10.067072] [INFO ] [MAIN ] PM: Fetched primary data is valid. [2025-09-17T05:53:10.067196] [DEBUG] [LOCAL ] PM: Saving primary data. [2025-09-17T05:53:10.070479] [DEBUG] [LOCAL ] PM: Trimmed 77589 records to 53666 (keeping 200 days of data) [2025-09-17T05:53:10.184141] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T05:53:10.310121] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-17T05:53:10.433370] [DEBUG] [LOCAL ] PM: Primary data saved (53666 records). [2025-09-17T05:53:10.433551] [INFO ] [MAIN ] PM: Full history saved. [2025-09-17T05:53:10.433693] [INFO ] [MAIN ] Update Progress: 1703/2369 symbols completed. PM took 43.3s. Estimated remaining: 1h 37m 24s. Rate: 6.8 symbols/min [2025-09-17T05:53:10.606127] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:53:10.644457] [DEBUG] [LOCAL ] PMT: Loaded 29376 existing records from primary storage. [2025-09-17T05:53:10.644665] [INFO ] [MAIN ] PMT: Loaded 29376 existing records. [2025-09-17T05:53:10.922477] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:53:10.923017] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-17T05:53:10.923106] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-17T05:53:10.923965] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-17T05:53:10.924071] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-17T05:53:11.103716] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-17T05:53:11.127976] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T05:53:11.511608] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:53:11.890138] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-17T05:53:11.981613] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T05:53:12.690142] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-11. [2025-09-17T05:53:12.818098] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T05:53:13.490186] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-17T05:53:14.073432] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T05:53:14.224509] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T05:53:14.290164] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-17T05:53:15.009627] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T05:53:15.090133] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-17T05:53:15.833963] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T05:53:15.890134] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-17T05:53:16.688358] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T05:53:16.690474] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-09-17T05:53:17.490154] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-17T05:53:18.146517] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T05:53:18.230301] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T05:53:18.290136] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-17T05:53:19.090887] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-17T05:53:19.091710] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T05:53:19.890149] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-17T05:53:20.165536] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T05:53:20.690148] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-17T05:53:21.368031] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T05:53:21.394970] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T05:53:21.490146] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-17T05:53:22.290154] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-17T05:53:22.313724] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T05:53:22.315461] [INFO ] [REMOTE ] PMM: Full fetch complete (18428 records). [2025-09-17T05:53:22.315584] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-17T05:53:22.683491] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-17T05:53:22.683614] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-17T05:53:22.684175] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-17T05:53:22.684282] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-17T05:53:22.684975] [DEBUG] [LOCAL ] PMM: Trimmed 18428 records to 10757 (keeping 200 days of data) [2025-09-17T05:53:22.750653] [DEBUG] [LOCAL ] PMM: Primary data saved (10757 records). [2025-09-17T05:53:22.750818] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-17T05:53:22.750955] [INFO ] [MAIN ] Update Progress: 1704/2369 symbols completed. PMM took 29.4s. Estimated remaining: 1h 37m 17s. Rate: 6.8 symbols/min [2025-09-17T05:53:22.920522] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:53:22.920788] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-17T05:53:22.920863] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-17T05:53:22.920998] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-17T05:53:22.921062] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-17T05:53:22.921134] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-17T05:53:22.921214] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-17T05:53:23.099665] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-17T05:53:23.288525] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:53:23.450557] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T05:53:23.890176] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-11. [2025-09-17T05:53:23.954013] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T05:53:23.956436] [INFO ] [REMOTE ] PMO: Full fetch complete (17669 records). [2025-09-17T05:53:23.956530] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-17T05:53:24.238007] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T05:53:24.338542] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-17T05:53:24.338659] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-17T05:53:24.339066] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-17T05:53:24.339116] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-17T05:53:24.339718] [DEBUG] [LOCAL ] PMO: Trimmed 17669 records to 10707 (keeping 200 days of data) [2025-09-17T05:53:24.409167] [DEBUG] [LOCAL ] PMO: Primary data saved (10707 records). [2025-09-17T05:53:24.409324] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-17T05:53:24.409430] [INFO ] [MAIN ] Update Progress: 1705/2369 symbols completed. PMO took 28.0s. Estimated remaining: 1h 37m 5s. Rate: 6.8 symbols/min [2025-09-17T05:53:24.585478] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:53:24.585729] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-17T05:53:24.585780] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-17T05:53:24.585893] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-17T05:53:24.585943] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-17T05:53:24.585999] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-17T05:53:24.586050] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-17T05:53:24.695300] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-17T05:53:24.946036] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:53:25.040528] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-17T05:53:25.490138] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-17T05:53:25.814691] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-17T05:53:26.290128] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-11. [2025-09-17T05:53:26.482890] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:53:26.483265] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-11 [2025-09-17T05:53:27.090167] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-17T05:53:27.287109] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:53:27.287472] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-17T05:53:27.890232] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-17T05:53:28.690131] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-09-17T05:53:28.878768] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:53:28.879073] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-09-17T05:53:29.338694] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T05:53:29.490138] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-17T05:53:29.899354] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T05:53:30.290134] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-17T05:53:31.090140] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-17T05:53:31.529864] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T05:53:31.533975] [INFO ] [REMOTE ] PML: Full fetch complete (29454 records). [2025-09-17T05:53:31.534078] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-17T05:53:31.896923] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-17T05:53:31.910901] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-17T05:53:31.910983] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-17T05:53:31.911936] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-17T05:53:31.912103] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-17T05:53:31.913216] [DEBUG] [LOCAL ] PML: Trimmed 29454 records to 20193 (keeping 200 days of data) [2025-09-17T05:53:32.041189] [DEBUG] [LOCAL ] PML: Primary data saved (20193 records). [2025-09-17T05:53:32.041344] [INFO ] [MAIN ] PML: Full history saved. [2025-09-17T05:53:32.041455] [INFO ] [MAIN ] Update Progress: 1706/2369 symbols completed. PML took 45.4s. Estimated remaining: 1h 36m 56s. Rate: 6.8 symbols/min [2025-09-17T05:53:32.211354] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:53:32.211556] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-17T05:53:32.211603] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-17T05:53:32.211729] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-17T05:53:32.211796] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-17T05:53:32.211848] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-17T05:53:32.211890] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-17T05:53:32.364768] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T05:53:32.579029] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:53:32.601294] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T05:53:32.690120] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-17T05:53:33.401113] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T05:53:33.490128] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-17T05:53:33.926792] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T05:53:34.290336] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-17T05:53:34.607089] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T05:53:35.090142] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-17T05:53:35.408375] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T05:53:35.890132] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-17T05:53:36.222361] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-17T05:53:36.690133] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-17T05:53:37.245759] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T05:53:37.490158] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-17T05:53:38.003548] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T05:53:38.290182] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-17T05:53:38.599383] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-17T05:53:39.090138] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-17T05:53:39.890134] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-17T05:53:40.282388] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T05:53:40.283171] [INFO ] [REMOTE ] PMTU: Full fetch complete (1191 records). [2025-09-17T05:53:40.283263] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-17T05:53:40.475575] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-09-17T05:53:40.475851] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:53:40.475961] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:53:40.476016] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-17T05:53:40.476089] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-17T05:53:40.476146] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-17T05:53:40.476211] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-17T05:53:40.476306] [INFO ] [MAIN ] Update Progress: 1707/2369 symbols completed. PMTU took 17.7s. Estimated remaining: 1h 36m 47s. Rate: 6.8 symbols/min [2025-09-17T05:53:40.643915] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:53:40.690554] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-11. [2025-09-17T05:53:40.692169] [DEBUG] [LOCAL ] PNC: Loaded 38873 existing records from primary storage. [2025-09-17T05:53:40.692327] [INFO ] [MAIN ] PNC: Loaded 38873 existing records. [2025-09-17T05:53:40.889841] [WARN ] [MAIN ] PNC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:53:40.890191] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-17T05:53:40.890358] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-17T05:53:40.903023] [DEBUG] [LOCAL ] PNC: Deleted primary data file. [2025-09-17T05:53:40.916057] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:53:40.916219] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-17T05:53:40.919354] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-11 [2025-09-17T05:53:40.985458] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T05:53:41.283683] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:53:41.490154] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-17T05:53:42.290149] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-11. [2025-09-17T05:53:42.971967] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T05:53:43.090109] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-17T05:53:43.890138] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-17T05:53:43.946982] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T05:53:44.318916] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T05:53:44.488139] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T05:53:44.690146] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-17T05:53:44.890916] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:53:44.891274] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-17T05:53:45.490126] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-17T05:53:46.290133] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-09-17T05:53:46.489568] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:53:46.489977] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-09-17T05:53:47.097527] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-17T05:53:47.102876] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T05:53:47.890137] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-17T05:53:48.690129] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-17T05:53:48.903409] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:53:48.903836] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-17T05:53:48.969103] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T05:53:49.332070] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T05:53:49.490133] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-17T05:53:50.290148] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-17T05:53:50.713582] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T05:53:50.908499] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T05:53:50.913046] [INFO ] [REMOTE ] PMT: Full fetch complete (57881 records). [2025-09-17T05:53:50.913207] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-17T05:53:51.092681] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-17T05:53:51.303114] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-17T05:53:51.303268] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-17T05:53:51.304392] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-17T05:53:51.304484] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-17T05:53:51.305929] [DEBUG] [LOCAL ] PMT: Trimmed 57881 records to 40314 (keeping 200 days of data) [2025-09-17T05:53:51.563293] [DEBUG] [LOCAL ] PMT: Primary data saved (40314 records). [2025-09-17T05:53:51.563466] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-17T05:53:51.563619] [INFO ] [MAIN ] Update Progress: 1708/2369 symbols completed. PMT took 41.1s. Estimated remaining: 1h 36m 39s. Rate: 6.8 symbols/min [2025-09-17T05:53:51.672895] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T05:53:51.738979] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:53:51.746581] [DEBUG] [LOCAL ] PNI: Loaded 4914 existing records from primary storage. [2025-09-17T05:53:51.746748] [INFO ] [MAIN ] PNI: Loaded 4914 existing records. [2025-09-17T05:53:51.902256] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-17T05:53:51.943690] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:53:51.944073] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-17T05:53:51.944217] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-17T05:53:51.944541] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-17T05:53:51.944600] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-17T05:53:52.349599] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:53:52.526998] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T05:53:52.690131] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-17T05:53:53.353038] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T05:53:53.354100] [INFO ] [REMOTE ] PMTV: Full fetch complete (6021 records). [2025-09-17T05:53:53.354187] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-17T05:53:53.495281] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-11. [2025-09-17T05:53:53.543058] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 147 unique days, need 200 days [2025-09-17T05:53:53.543465] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:53:53.543521] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:53:53.543564] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-17T05:53:53.543665] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-17T05:53:53.543721] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-17T05:53:53.543779] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-17T05:53:53.543853] [INFO ] [MAIN ] Update Progress: 1709/2369 symbols completed. PMTV took 29.1s. Estimated remaining: 1h 36m 28s. Rate: 6.8 symbols/min [2025-09-17T05:53:53.746194] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:53:53.769732] [DEBUG] [LOCAL ] PNNT: Loaded 24027 existing records from primary storage. [2025-09-17T05:53:53.769901] [INFO ] [MAIN ] PNNT: Loaded 24027 existing records. [2025-09-17T05:53:53.946630] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:53:53.946877] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-17T05:53:53.946935] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-17T05:53:53.947777] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-17T05:53:53.947842] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-17T05:53:54.230712] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T05:53:54.295703] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-17T05:53:54.320435] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:53:55.090152] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-11. [2025-09-17T05:53:55.890172] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-17T05:53:56.090809] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:53:56.091161] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-17T05:53:56.174110] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T05:53:56.508407] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T05:53:56.690164] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-17T05:53:56.891688] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:53:56.892118] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-17T05:53:57.490133] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-09-17T05:53:58.290143] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-17T05:53:58.867936] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T05:53:59.090178] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-09-17T05:53:59.890122] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-17T05:54:00.015079] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T05:54:00.083529] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:54:00.083896] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-17T05:54:00.471604] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T05:54:00.690153] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-09-17T05:54:01.467248] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T05:54:01.490122] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-09-17T05:54:02.290142] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-17T05:54:02.963709] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T05:54:03.090213] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-17T05:54:03.879080] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T05:54:03.890135] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-17T05:54:04.675290] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T05:54:04.690093] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-17T05:54:04.913438] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T05:54:05.266667] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T05:54:05.490188] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-17T05:54:06.069760] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T05:54:06.071165] [INFO ] [REMOTE ] PMTW: Full fetch complete (3583 records). [2025-09-17T05:54:06.071267] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-17T05:54:06.261119] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 66 unique days, need 200 days [2025-09-17T05:54:06.261322] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:54:06.261374] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:54:06.261416] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-17T05:54:06.261499] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-17T05:54:06.261551] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-17T05:54:06.261602] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-17T05:54:06.261688] [INFO ] [MAIN ] Update Progress: 1710/2369 symbols completed. PMTW took 34.2s. Estimated remaining: 1h 36m 20s. Rate: 6.8 symbols/min [2025-09-17T05:54:06.295245] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-17T05:54:06.435315] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:54:06.475972] [DEBUG] [LOCAL ] PNR: Loaded 35430 existing records from primary storage. [2025-09-17T05:54:06.476201] [INFO ] [MAIN ] PNR: Loaded 35430 existing records. [2025-09-17T05:54:06.655428] [WARN ] [MAIN ] PNR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:54:06.655708] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-17T05:54:06.655806] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-17T05:54:06.656737] [DEBUG] [LOCAL ] PNR: Deleted primary data file. [2025-09-17T05:54:06.656801] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-17T05:54:07.013451] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:54:07.090080] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-11. [2025-09-17T05:54:07.890204] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-17T05:54:08.210286] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T05:54:08.687331] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T05:54:08.690073] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-17T05:54:08.863859] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T05:54:09.271419] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T05:54:09.490231] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-17T05:54:10.290141] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-17T05:54:11.066562] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T05:54:11.090113] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-17T05:54:11.508308] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T05:54:11.771256] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T05:54:11.890157] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-17T05:54:12.690169] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-17T05:54:13.313861] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T05:54:13.491343] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T05:54:13.490182] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-17T05:54:14.290205] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-17T05:54:15.090166] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-17T05:54:15.281807] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T05:54:15.655121] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T05:54:15.890188] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-17T05:54:16.690178] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-17T05:54:17.490176] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-17T05:54:17.789782] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-17T05:54:18.290203] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-17T05:54:18.345629] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T05:54:18.372191] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-17T05:54:18.493354] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T05:54:19.090246] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-17T05:54:19.570685] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T05:54:19.598795] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T05:54:19.890187] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-17T05:54:20.690142] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-17T05:54:21.349617] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T05:54:21.351449] [INFO ] [REMOTE ] PNI: Full fetch complete (10030 records). [2025-09-17T05:54:21.351553] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-17T05:54:21.492171] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-17T05:54:21.731805] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-17T05:54:21.732059] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-17T05:54:21.732353] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-17T05:54:21.732428] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-17T05:54:21.733095] [DEBUG] [LOCAL ] PNI: Trimmed 10030 records to 6704 (keeping 200 days of data) [2025-09-17T05:54:21.773652] [DEBUG] [LOCAL ] PNI: Primary data saved (6704 records). [2025-09-17T05:54:21.773929] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-17T05:54:21.774073] [INFO ] [MAIN ] Update Progress: 1711/2369 symbols completed. PNI took 30.2s. Estimated remaining: 1h 36m 14s. Rate: 6.8 symbols/min [2025-09-17T05:54:21.898305] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T05:54:21.990386] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:54:22.029843] [DEBUG] [LOCAL ] PNW: Loaded 34266 existing records from primary storage. [2025-09-17T05:54:22.030029] [INFO ] [MAIN ] PNW: Loaded 34266 existing records. [2025-09-17T05:54:22.210188] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:54:22.210483] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-17T05:54:22.210538] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-17T05:54:22.211517] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-17T05:54:22.211606] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-17T05:54:22.295275] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-17T05:54:22.574557] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:54:23.027524] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T05:54:23.090136] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-11. [2025-09-17T05:54:23.890150] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-17T05:54:24.186286] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T05:54:24.690165] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-17T05:54:24.738997] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T05:54:25.288274] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T05:54:25.490207] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-09-17T05:54:26.259839] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T05:54:26.290087] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-17T05:54:27.054887] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T05:54:27.090131] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-17T05:54:27.893960] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-17T05:54:27.897168] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T05:54:28.690158] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-17T05:54:28.750875] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T05:54:28.757548] [INFO ] [REMOTE ] PNC: Full fetch complete (75401 records). [2025-09-17T05:54:28.757757] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-17T05:54:29.185982] [DEBUG] [VALIDATOR ] PNC: All expected trading days are present. [2025-09-17T05:54:29.186468] [DEBUG] [VALIDATOR ] PNC: Primary data validation passed. [2025-09-17T05:54:29.187815] [INFO ] [MAIN ] PNC: Fetched primary data is valid. [2025-09-17T05:54:29.187962] [DEBUG] [LOCAL ] PNC: Saving primary data. [2025-09-17T05:54:29.213054] [DEBUG] [LOCAL ] PNC: Trimmed 75401 records to 52383 (keeping 200 days of data) [2025-09-17T05:54:29.215017] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T05:54:29.490663] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-17T05:54:29.578458] [DEBUG] [LOCAL ] PNC: Primary data saved (52383 records). [2025-09-17T05:54:29.578617] [INFO ] [MAIN ] PNC: Full history saved. [2025-09-17T05:54:29.578731] [INFO ] [MAIN ] Update Progress: 1712/2369 symbols completed. PNC took 49.1s. Estimated remaining: 1h 36m 5s. Rate: 6.8 symbols/min [2025-09-17T05:54:29.750129] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:54:29.784009] [DEBUG] [LOCAL ] POR: Loaded 34867 existing records from primary storage. [2025-09-17T05:54:29.784222] [INFO ] [MAIN ] POR: Loaded 34867 existing records. [2025-09-17T05:54:29.965743] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:54:29.966062] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-17T05:54:29.966138] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-17T05:54:29.967078] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-17T05:54:29.967158] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-17T05:54:30.300924] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-17T05:54:30.346175] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:54:30.388918] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T05:54:31.037953] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T05:54:31.090104] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-17T05:54:31.346449] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T05:54:31.890177] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-17T05:54:32.690201] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-11. [2025-09-17T05:54:32.778428] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T05:54:33.490153] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-17T05:54:33.699680] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T05:54:34.183031] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T05:54:34.290173] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-09-17T05:54:35.076539] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T05:54:35.090068] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-17T05:54:35.820986] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T05:54:35.890107] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-09-17T05:54:36.690158] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-17T05:54:36.739243] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T05:54:37.490127] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-17T05:54:37.597232] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T05:54:38.260049] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T05:54:38.290149] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-17T05:54:39.042402] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T05:54:39.090118] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-17T05:54:39.868669] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T05:54:39.874512] [INFO ] [REMOTE ] PNR: Full fetch complete (69202 records). [2025-09-17T05:54:39.874688] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-17T05:54:39.896093] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-17T05:54:40.269161] [DEBUG] [VALIDATOR ] PNR: All expected trading days are present. [2025-09-17T05:54:40.269301] [DEBUG] [VALIDATOR ] PNR: Primary data validation passed. [2025-09-17T05:54:40.270566] [INFO ] [MAIN ] PNR: Fetched primary data is valid. [2025-09-17T05:54:40.270636] [DEBUG] [LOCAL ] PNR: Saving primary data. [2025-09-17T05:54:40.272275] [DEBUG] [LOCAL ] PNR: Trimmed 69202 records to 48283 (keeping 200 days of data) [2025-09-17T05:54:40.574383] [DEBUG] [LOCAL ] PNR: Primary data saved (48283 records). [2025-09-17T05:54:40.574558] [INFO ] [MAIN ] PNR: Full history saved. [2025-09-17T05:54:40.574667] [INFO ] [MAIN ] Update Progress: 1713/2369 symbols completed. PNR took 34.3s. Estimated remaining: 1h 35m 57s. Rate: 6.8 symbols/min [2025-09-17T05:54:40.692324] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-17T05:54:40.747778] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:54:40.775533] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T05:54:40.812346] [DEBUG] [LOCAL ] POST: Loaded 28970 existing records from primary storage. [2025-09-17T05:54:40.812524] [INFO ] [MAIN ] POST: Loaded 28970 existing records. [2025-09-17T05:54:40.989363] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:54:40.989698] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-17T05:54:40.989781] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-17T05:54:40.990463] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-17T05:54:40.990542] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-17T05:54:41.351539] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:54:41.371411] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T05:54:41.490113] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-11. [2025-09-17T05:54:42.290109] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-17T05:54:42.391200] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T05:54:42.904694] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T05:54:43.090130] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-09-17T05:54:43.890153] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-17T05:54:43.984405] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T05:54:44.691171] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T05:54:44.690324] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-17T05:54:45.288347] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T05:54:45.490130] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-17T05:54:46.290108] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-17T05:54:46.403275] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T05:54:47.009332] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T05:54:47.015089] [INFO ] [REMOTE ] PNW: Full fetch complete (66153 records). [2025-09-17T05:54:47.015251] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-17T05:54:47.095255] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-17T05:54:47.416587] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-17T05:54:47.416763] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-17T05:54:47.417975] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-17T05:54:47.418087] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-17T05:54:47.419636] [DEBUG] [LOCAL ] PNW: Trimmed 66153 records to 46144 (keeping 200 days of data) [2025-09-17T05:54:47.668397] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T05:54:47.741316] [DEBUG] [LOCAL ] PNW: Primary data saved (46144 records). [2025-09-17T05:54:47.741493] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-17T05:54:47.741596] [INFO ] [MAIN ] Update Progress: 1714/2369 symbols completed. PNW took 25.9s. Estimated remaining: 1h 35m 48s. Rate: 6.8 symbols/min [2025-09-17T05:54:47.901493] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-09-17T05:54:47.920419] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:54:47.958714] [DEBUG] [LOCAL ] PPG: Loaded 37459 existing records from primary storage. [2025-09-17T05:54:47.958889] [INFO ] [MAIN ] PPG: Loaded 37459 existing records. [2025-09-17T05:54:48.145470] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:54:48.145880] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-17T05:54:48.145950] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-17T05:54:48.146885] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-17T05:54:48.146955] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-17T05:54:48.525099] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:54:48.690168] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-11. [2025-09-17T05:54:48.735247] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T05:54:49.274686] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T05:54:49.490148] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-17T05:54:50.290124] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-17T05:54:50.335045] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T05:54:50.930035] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T05:54:51.090125] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-17T05:54:51.720058] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T05:54:51.890140] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-17T05:54:52.512716] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T05:54:52.690125] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-17T05:54:53.403456] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T05:54:53.490170] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-17T05:54:53.634259] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T05:54:53.638997] [INFO ] [REMOTE ] PNNT: Full fetch complete (47551 records). [2025-09-17T05:54:53.639173] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-17T05:54:54.044628] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-17T05:54:54.044766] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-17T05:54:54.045629] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-17T05:54:54.045706] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-17T05:54:54.046827] [DEBUG] [LOCAL ] PNNT: Trimmed 47551 records to 32998 (keeping 200 days of data) [2025-09-17T05:54:54.259155] [DEBUG] [LOCAL ] PNNT: Primary data saved (32998 records). [2025-09-17T05:54:54.259384] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-17T05:54:54.259527] [INFO ] [MAIN ] Update Progress: 1715/2369 symbols completed. PNNT took 1m 1s. Estimated remaining: 1h 35m 38s. Rate: 6.8 symbols/min [2025-09-17T05:54:54.295272] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-17T05:54:54.442932] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:54:54.480607] [DEBUG] [LOCAL ] PPL: Loaded 39888 existing records from primary storage. [2025-09-17T05:54:54.480807] [INFO ] [MAIN ] PPL: Loaded 39888 existing records. [2025-09-17T05:54:54.659876] [WARN ] [MAIN ] PPL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:54:54.660145] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-17T05:54:54.660208] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-17T05:54:54.661227] [DEBUG] [LOCAL ] PPL: Deleted primary data file. [2025-09-17T05:54:54.661293] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-17T05:54:55.023380] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:54:55.091376] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-09-17T05:54:55.094456] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T05:54:55.897879] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-11. [2025-09-17T05:54:55.927608] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T05:54:56.584310] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T05:54:56.690159] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-17T05:54:57.490194] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-09-17T05:54:57.676973] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T05:54:58.195390] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T05:54:58.201399] [INFO ] [REMOTE ] POR: Full fetch complete (67510 records). [2025-09-17T05:54:58.201553] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-17T05:54:58.295259] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-17T05:54:58.596019] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-17T05:54:58.596126] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-17T05:54:58.597148] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-17T05:54:58.597207] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-17T05:54:58.598507] [DEBUG] [LOCAL ] POR: Trimmed 67510 records to 46953 (keeping 200 days of data) [2025-09-17T05:54:58.880977] [DEBUG] [LOCAL ] POR: Primary data saved (46953 records). [2025-09-17T05:54:58.881136] [INFO ] [MAIN ] POR: Full history saved. [2025-09-17T05:54:58.881240] [INFO ] [MAIN ] Update Progress: 1716/2369 symbols completed. POR took 29.3s. Estimated remaining: 1h 35m 28s. Rate: 6.8 symbols/min [2025-09-17T05:54:59.052298] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:54:59.067623] [DEBUG] [LOCAL ] PPT: Loaded 14800 existing records from primary storage. [2025-09-17T05:54:59.067895] [INFO ] [MAIN ] PPT: Loaded 14800 existing records. [2025-09-17T05:54:59.098473] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-17T05:54:59.249420] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:54:59.249784] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-17T05:54:59.249848] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-17T05:54:59.250233] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-17T05:54:59.250289] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-17T05:54:59.669743] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-17T05:54:59.673453] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:54:59.826821] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T05:54:59.890089] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-11. [2025-09-17T05:55:00.690143] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-17T05:55:00.780298] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T05:55:00.808322] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T05:55:01.490188] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-09-17T05:55:02.065779] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T05:55:02.290149] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-17T05:55:02.583309] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T05:55:03.090209] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-17T05:55:03.639411] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T05:55:03.890146] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-17T05:55:04.690397] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-09-17T05:55:04.889307] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T05:55:05.490227] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-17T05:55:05.704525] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T05:55:05.752678] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T05:55:06.290238] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-17T05:55:06.968425] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T05:55:07.090133] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-17T05:55:07.890164] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-17T05:55:08.201016] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T05:55:08.624517] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T05:55:08.630319] [INFO ] [REMOTE ] POST: Full fetch complete (55711 records). [2025-09-17T05:55:08.630553] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-17T05:55:08.699180] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-17T05:55:09.050406] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-17T05:55:09.050269] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T05:55:09.050537] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-17T05:55:09.055891] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-17T05:55:09.056296] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-17T05:55:09.057533] [DEBUG] [LOCAL ] POST: Trimmed 55711 records to 38940 (keeping 200 days of data) [2025-09-17T05:55:09.300733] [DEBUG] [LOCAL ] POST: Primary data saved (38940 records). [2025-09-17T05:55:09.300945] [INFO ] [MAIN ] POST: Full history saved. [2025-09-17T05:55:09.301059] [INFO ] [MAIN ] Update Progress: 1717/2369 symbols completed. POST took 28.7s. Estimated remaining: 1h 35m 20s. Rate: 6.8 symbols/min [2025-09-17T05:55:09.490204] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-17T05:55:10.290248] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-17T05:55:10.474045] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T05:55:11.090211] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-17T05:55:11.242936] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T05:55:11.374091] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T05:55:11.890212] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-17T05:55:12.690164] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-17T05:55:12.760379] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T05:55:12.967819] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T05:55:13.490180] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-17T05:55:14.290205] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-17T05:55:14.528571] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T05:55:15.090156] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-17T05:55:15.239861] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T05:55:15.309060] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T05:55:15.890154] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-17T05:55:16.690181] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-17T05:55:16.972289] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T05:55:17.031152] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T05:55:17.490164] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-17T05:55:18.186970] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T05:55:18.290178] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-17T05:55:19.090137] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-17T05:55:19.278480] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T05:55:19.890226] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-17T05:55:19.972743] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T05:55:20.177120] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T05:55:20.690175] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-17T05:55:21.490139] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-17T05:55:21.534724] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T05:55:22.290129] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-17T05:55:22.403995] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T05:55:22.410616] [INFO ] [REMOTE ] PPG: Full fetch complete (73514 records). [2025-09-17T05:55:22.410841] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-17T05:55:22.578910] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T05:55:22.826094] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-17T05:55:22.826212] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-17T05:55:22.827412] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-17T05:55:22.827476] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-17T05:55:22.829101] [DEBUG] [LOCAL ] PPG: Trimmed 73514 records to 50772 (keeping 200 days of data) [2025-09-17T05:55:23.090301] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-17T05:55:23.166265] [DEBUG] [LOCAL ] PPG: Primary data saved (50772 records). [2025-09-17T05:55:23.166433] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-17T05:55:23.166529] [INFO ] [MAIN ] Update Progress: 1718/2369 symbols completed. PPG took 35.4s. Estimated remaining: 1h 35m 13s. Rate: 6.8 symbols/min [2025-09-17T05:55:24.087457] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T05:55:24.099757] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-17T05:55:24.140744] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T05:55:24.143766] [INFO ] [REMOTE ] PPT: Full fetch complete (29515 records). [2025-09-17T05:55:24.143879] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-17T05:55:24.518058] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-17T05:55:24.518190] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-17T05:55:24.518937] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-17T05:55:24.519031] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-17T05:55:24.520420] [DEBUG] [LOCAL ] PPT: Trimmed 29515 records to 20338 (keeping 200 days of data) [2025-09-17T05:55:24.642538] [DEBUG] [LOCAL ] PPT: Primary data saved (20338 records). [2025-09-17T05:55:24.642732] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-17T05:55:24.642894] [INFO ] [MAIN ] Update Progress: 1719/2369 symbols completed. PPT took 25.8s. Estimated remaining: 1h 35m 1s. Rate: 6.8 symbols/min [2025-09-17T05:55:25.920339] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T05:55:25.932342] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-17T05:55:27.707512] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T05:55:27.714425] [INFO ] [REMOTE ] PPL: Full fetch complete (77255 records). [2025-09-17T05:55:27.714659] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-17T05:55:28.163384] [DEBUG] [VALIDATOR ] PPL: All expected trading days are present. [2025-09-17T05:55:28.163551] [DEBUG] [VALIDATOR ] PPL: Primary data validation passed. [2025-09-17T05:55:28.165673] [INFO ] [MAIN ] PPL: Fetched primary data is valid. [2025-09-17T05:55:28.165747] [DEBUG] [LOCAL ] PPL: Saving primary data. [2025-09-17T05:55:28.169037] [DEBUG] [LOCAL ] PPL: Trimmed 77255 records to 53516 (keeping 200 days of data) [2025-09-17T05:55:28.510899] [DEBUG] [LOCAL ] PPL: Primary data saved (53516 records). [2025-09-17T05:55:28.511078] [INFO ] [MAIN ] PPL: Full history saved. [2025-09-17T05:55:28.511209] [INFO ] [MAIN ] Update Progress: 1720/2369 symbols completed. PPL took 34.3s. Estimated remaining: 1h 34m 51s. Rate: 6.8 symbols/min [2025-09-17T05:55:29.054074] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:55:29.077537] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:55:29.241775] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:55:29.243604] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:55:29.246537] [DEBUG] [LOCAL ] PRCS: Loaded 2004 existing records from primary storage. [2025-09-17T05:55:29.247473] [INFO ] [MAIN ] PRCS: Loaded 2004 existing records. [2025-09-17T05:55:29.376397] [DEBUG] [LOCAL ] PRG: Loaded 21741 existing records from primary storage. [2025-09-17T05:55:29.387467] [INFO ] [MAIN ] PRG: Loaded 21741 existing records. [2025-09-17T05:55:29.557499] [WARN ] [MAIN ] PRCS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:55:29.597007] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-17T05:55:29.570570] [DEBUG] [LOCAL ] PRA: Loaded 25842 existing records from primary storage. [2025-09-17T05:55:29.622739] [INFO ] [MAIN ] PRA: Loaded 25842 existing records. [2025-09-17T05:55:29.611303] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-17T05:55:29.639138] [DEBUG] [LOCAL ] PR: Loaded 39964 existing records from primary storage. [2025-09-17T05:55:29.677418] [DEBUG] [LOCAL ] PRCS: Deleted primary data file. [2025-09-17T05:55:29.696509] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-17T05:55:29.718272] [INFO ] [MAIN ] PR: Loaded 39964 existing records. [2025-09-17T05:55:29.759315] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:55:29.796277] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-17T05:55:29.858828] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-17T05:55:29.943391] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-17T05:55:29.970982] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-17T05:55:30.253720] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:55:30.321884] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-17T05:55:30.321574] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:55:30.420862] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-17T05:55:30.438564] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-17T05:55:30.452580] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-17T05:55:30.457750] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-17T05:55:30.447165] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-17T05:55:30.494304] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-17T05:55:30.557867] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-17T05:55:30.645391] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:55:30.742432] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-11. [2025-09-17T05:55:31.111441] [DEBUG] [REMOTE ] PRCS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:55:31.166964] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:55:31.194634] [WARN ] [REMOTE ] PRCS: No data returned for month 2024-11 [2025-09-17T05:55:31.210355] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-17T05:55:31.210571] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-11. [2025-09-17T05:55:31.331170] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:55:31.398829] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-11. [2025-09-17T05:55:31.498597] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:55:31.498941] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-11. [2025-09-17T05:55:31.606450] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-17T05:55:31.607457] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-17T05:55:32.054251] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T05:55:32.055581] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-17T05:55:32.445550] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T05:55:32.450547] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-09-17T05:55:32.509053] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T05:55:32.510418] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-17T05:55:32.622118] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T05:55:32.690075] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-09-17T05:55:32.832889] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T05:55:32.956500] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T05:55:33.490088] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-17T05:55:33.531935] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T05:55:33.943268] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T05:55:34.095129] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T05:55:34.290141] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-17T05:55:35.090189] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-17T05:55:35.526697] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T05:55:35.625900] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T05:55:35.890132] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-17T05:55:36.690146] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-17T05:55:37.229247] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T05:55:37.276477] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T05:55:37.490180] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-17T05:55:38.290139] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-17T05:55:38.758629] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T05:55:39.034328] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T05:55:39.090143] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-09-17T05:55:39.890178] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-17T05:55:40.341695] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T05:55:40.690136] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-17T05:55:40.879862] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T05:55:41.490157] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-09-17T05:55:42.134697] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T05:55:42.290123] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-17T05:55:43.090138] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-17T05:55:43.240514] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T05:55:43.534254] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T05:55:43.535373] [INFO ] [REMOTE ] PRCS: Full fetch complete (3692 records). [2025-09-17T05:55:43.535490] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-17T05:55:43.724401] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 189 unique days, need 200 days [2025-09-17T05:55:43.724810] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:55:43.725154] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:55:43.725313] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-17T05:55:43.725880] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-17T05:55:43.726131] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-17T05:55:43.726636] [DEBUG] [LOCAL ] PRCS: Deleted derivative data file. [2025-09-17T05:55:43.747258] [INFO ] [MAIN ] Update Progress: 1721/2369 symbols completed. PRCS took 15.2s. Estimated remaining: 1h 34m 44s. Rate: 6.8 symbols/min [2025-09-17T05:55:43.813982] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T05:55:43.899031] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-17T05:55:43.930555] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:55:43.970316] [DEBUG] [LOCAL ] PRGO: Loaded 34405 existing records from primary storage. [2025-09-17T05:55:43.970516] [INFO ] [MAIN ] PRGO: Loaded 34405 existing records. [2025-09-17T05:55:44.147259] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:55:44.147531] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-17T05:55:44.147606] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-17T05:55:44.148637] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-17T05:55:44.148736] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-17T05:55:44.509993] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:55:44.690135] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-17T05:55:45.199394] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T05:55:45.490136] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-17T05:55:46.290128] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-11. [2025-09-17T05:55:46.383586] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T05:55:46.888676] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T05:55:47.090134] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-17T05:55:47.711921] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T05:55:47.890114] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-09-17T05:55:48.329037] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T05:55:48.690146] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-17T05:55:49.402798] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T05:55:49.490131] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-09-17T05:55:50.290107] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-17T05:55:50.414137] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T05:55:50.979408] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T05:55:51.090128] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-09-17T05:55:51.413976] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T05:55:51.417431] [INFO ] [REMOTE ] PRG: Full fetch complete (44053 records). [2025-09-17T05:55:51.417544] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-17T05:55:51.797835] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-17T05:55:51.797971] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-17T05:55:51.799217] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-17T05:55:51.799311] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-17T05:55:51.810941] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T05:55:51.815168] [DEBUG] [LOCAL ] PRG: Trimmed 44053 records to 30591 (keeping 200 days of data) [2025-09-17T05:55:51.890161] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-17T05:55:52.015985] [DEBUG] [LOCAL ] PRG: Primary data saved (30591 records). [2025-09-17T05:55:52.016148] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-17T05:55:52.016242] [INFO ] [MAIN ] Update Progress: 1722/2369 symbols completed. PRG took 23.5s. Estimated remaining: 1h 34m 35s. Rate: 6.8 symbols/min [2025-09-17T05:55:52.184738] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:55:52.190464] [DEBUG] [LOCAL ] PRH: Loaded 3527 existing records from primary storage. [2025-09-17T05:55:52.190595] [INFO ] [MAIN ] PRH: Loaded 3527 existing records. [2025-09-17T05:55:52.369071] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:55:52.369319] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-17T05:55:52.369376] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-17T05:55:52.369624] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-17T05:55:52.369710] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-17T05:55:52.695178] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-17T05:55:52.731479] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:55:53.475416] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T05:55:53.490072] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-17T05:55:53.699621] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T05:55:54.290164] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-11. [2025-09-17T05:55:55.090126] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-17T05:55:55.142373] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T05:55:55.171945] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T05:55:55.890176] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-17T05:55:56.508242] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T05:55:56.690143] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-17T05:55:57.152621] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T05:55:57.490188] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-17T05:55:58.290165] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-17T05:55:58.618421] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T05:55:58.989425] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T05:55:59.090146] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-17T05:55:59.895729] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-09-17T05:55:59.909088] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T05:56:00.049968] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T05:56:00.542178] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T05:56:00.690167] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-17T05:56:01.286066] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T05:56:01.490198] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-17T05:56:02.273071] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T05:56:02.290089] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-17T05:56:02.900873] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T05:56:03.090193] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-17T05:56:03.890190] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-17T05:56:04.583965] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T05:56:04.690139] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-17T05:56:05.110532] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T05:56:05.490189] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-17T05:56:06.220947] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T05:56:06.290129] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-17T05:56:06.481754] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T05:56:07.004202] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T05:56:07.090187] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-17T05:56:07.890209] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-17T05:56:08.533174] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T05:56:08.690197] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-17T05:56:08.835325] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T05:56:09.490169] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-17T05:56:10.262838] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T05:56:10.290121] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-17T05:56:10.650428] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T05:56:11.090198] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-17T05:56:11.646950] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T05:56:11.890162] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-17T05:56:11.950962] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T05:56:12.690171] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-17T05:56:13.139818] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T05:56:13.490156] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-17T05:56:14.187257] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T05:56:14.193748] [INFO ] [REMOTE ] PRGO: Full fetch complete (68036 records). [2025-09-17T05:56:14.193903] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-17T05:56:14.293491] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-17T05:56:14.308898] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T05:56:14.601177] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-17T05:56:14.601359] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-17T05:56:14.602563] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-17T05:56:14.602627] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-17T05:56:14.604134] [DEBUG] [LOCAL ] PRGO: Trimmed 68036 records to 46972 (keeping 200 days of data) [2025-09-17T05:56:14.901847] [DEBUG] [LOCAL ] PRGO: Primary data saved (46972 records). [2025-09-17T05:56:14.902019] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-17T05:56:14.902111] [INFO ] [MAIN ] Update Progress: 1723/2369 symbols completed. PRGO took 31.2s. Estimated remaining: 1h 34m 32s. Rate: 6.8 symbols/min [2025-09-17T05:56:15.070395] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:56:15.084758] [DEBUG] [LOCAL ] PRI: Loaded 13205 existing records from primary storage. [2025-09-17T05:56:15.084911] [INFO ] [MAIN ] PRI: Loaded 13205 existing records. [2025-09-17T05:56:15.095970] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-17T05:56:15.265851] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:56:15.266101] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-17T05:56:15.266161] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-17T05:56:15.266690] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-17T05:56:15.266750] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-17T05:56:15.609462] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T05:56:15.649110] [INFO ] [REMOTE ] PRA: Full fetch complete (43202 records). [2025-09-17T05:56:15.653451] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:56:15.653610] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-17T05:56:15.896108] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-11. [2025-09-17T05:56:16.030311] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-17T05:56:16.030410] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-17T05:56:16.031217] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-17T05:56:16.031273] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-17T05:56:16.032364] [DEBUG] [LOCAL ] PRA: Trimmed 43202 records to 34724 (keeping 200 days of data) [2025-09-17T05:56:16.245618] [DEBUG] [LOCAL ] PRA: Primary data saved (34724 records). [2025-09-17T05:56:16.245824] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-17T05:56:16.245946] [INFO ] [MAIN ] Update Progress: 1724/2369 symbols completed. PRA took 47.7s. Estimated remaining: 1h 34m 20s. Rate: 6.8 symbols/min [2025-09-17T05:56:16.424798] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:56:16.467034] [DEBUG] [LOCAL ] PRIM: Loaded 33058 existing records from primary storage. [2025-09-17T05:56:16.467227] [INFO ] [MAIN ] PRIM: Loaded 33058 existing records. [2025-09-17T05:56:16.646270] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:56:16.646509] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-17T05:56:16.646568] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-17T05:56:16.647347] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-17T05:56:16.647409] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-17T05:56:16.711277] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-17T05:56:17.045125] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:56:17.056737] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T05:56:17.096271] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T05:56:17.195974] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T05:56:17.196981] [INFO ] [REMOTE ] PRH: Full fetch complete (7723 records). [2025-09-17T05:56:17.197066] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-17T05:56:17.495341] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-09-17T05:56:17.573005] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-17T05:56:17.573109] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-17T05:56:17.573327] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-17T05:56:17.573379] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-17T05:56:17.573844] [DEBUG] [LOCAL ] PRH: Trimmed 7723 records to 4987 (keeping 200 days of data) [2025-09-17T05:56:17.606465] [DEBUG] [LOCAL ] PRH: Primary data saved (4987 records). [2025-09-17T05:56:17.606660] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-17T05:56:17.606787] [INFO ] [MAIN ] Update Progress: 1725/2369 symbols completed. PRH took 25.6s. Estimated remaining: 1h 34m 9s. Rate: 6.8 symbols/min [2025-09-17T05:56:17.782082] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:56:17.820862] [DEBUG] [LOCAL ] PRKS: Loaded 31477 existing records from primary storage. [2025-09-17T05:56:17.821079] [INFO ] [MAIN ] PRKS: Loaded 31477 existing records. [2025-09-17T05:56:18.004705] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:56:18.004997] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-17T05:56:18.005052] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-17T05:56:18.005948] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-17T05:56:18.006019] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-17T05:56:18.295458] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-11. [2025-09-17T05:56:18.374012] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:56:18.527880] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T05:56:19.090196] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-17T05:56:19.672287] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T05:56:19.819477] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T05:56:19.890153] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-17T05:56:20.690169] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-17T05:56:20.946530] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T05:56:21.490190] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-09-17T05:56:22.290215] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-17T05:56:22.520813] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T05:56:23.001679] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T05:56:23.090121] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-11. [2025-09-17T05:56:23.480838] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T05:56:23.890193] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-17T05:56:24.602159] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T05:56:24.690172] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-09-17T05:56:25.490183] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-17T05:56:25.638846] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T05:56:25.646035] [INFO ] [REMOTE ] PR: Full fetch complete (77413 records). [2025-09-17T05:56:25.646246] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-17T05:56:26.045143] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-17T05:56:26.045473] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-17T05:56:26.046750] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-17T05:56:26.046838] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-17T05:56:26.048695] [DEBUG] [LOCAL ] PR: Trimmed 77413 records to 53609 (keeping 200 days of data) [2025-09-17T05:56:26.189887] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T05:56:26.299426] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-09-17T05:56:26.424513] [DEBUG] [LOCAL ] PR: Primary data saved (53609 records). [2025-09-17T05:56:26.424789] [INFO ] [MAIN ] PR: Full history saved. [2025-09-17T05:56:26.424949] [INFO ] [MAIN ] Update Progress: 1726/2369 symbols completed. PR took 57.9s. Estimated remaining: 1h 34m 0s. Rate: 6.8 symbols/min [2025-09-17T05:56:26.604732] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:56:26.620587] [DEBUG] [LOCAL ] PRLB: Loaded 14854 existing records from primary storage. [2025-09-17T05:56:26.620811] [INFO ] [MAIN ] PRLB: Loaded 14854 existing records. [2025-09-17T05:56:26.818602] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:56:26.819029] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-17T05:56:26.819110] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-17T05:56:26.824961] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-17T05:56:26.832923] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-17T05:56:26.897946] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T05:56:27.095418] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-17T05:56:27.198253] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:56:27.614532] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T05:56:27.890184] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-17T05:56:28.688255] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T05:56:28.696761] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-17T05:56:29.308705] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T05:56:29.490215] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-17T05:56:29.779961] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T05:56:30.290221] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-17T05:56:30.984520] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T05:56:31.090206] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-17T05:56:31.120659] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T05:56:31.890216] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-17T05:56:32.677946] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T05:56:32.690067] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-17T05:56:32.838083] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T05:56:33.490139] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-17T05:56:34.282083] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T05:56:34.290936] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-17T05:56:35.085755] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T05:56:35.094900] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-11. [2025-09-17T05:56:35.256446] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T05:56:35.890141] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-17T05:56:36.358410] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T05:56:36.690139] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-17T05:56:37.490103] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-17T05:56:37.603392] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T05:56:38.134957] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T05:56:38.137685] [INFO ] [REMOTE ] PRI: Full fetch complete (25576 records). [2025-09-17T05:56:38.137793] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-17T05:56:38.294522] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-09-17T05:56:38.463434] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T05:56:38.559936] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-17T05:56:38.560049] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-17T05:56:38.560687] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-17T05:56:38.560745] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-17T05:56:38.561415] [DEBUG] [LOCAL ] PRI: Trimmed 25576 records to 18506 (keeping 200 days of data) [2025-09-17T05:56:38.681867] [DEBUG] [LOCAL ] PRI: Primary data saved (18506 records). [2025-09-17T05:56:38.682063] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-17T05:56:38.682176] [INFO ] [MAIN ] Update Progress: 1727/2369 symbols completed. PRI took 23.8s. Estimated remaining: 1h 33m 53s. Rate: 6.8 symbols/min [2025-09-17T05:56:38.876395] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:56:38.909359] [DEBUG] [LOCAL ] PRM: Loaded 32987 existing records from primary storage. [2025-09-17T05:56:38.909589] [INFO ] [MAIN ] PRM: Loaded 32987 existing records. [2025-09-17T05:56:39.092497] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-17T05:56:39.096256] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:56:39.097516] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-17T05:56:39.097585] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-17T05:56:39.098586] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-17T05:56:39.098678] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-17T05:56:39.465728] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:56:39.479350] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T05:56:39.890137] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-09-17T05:56:40.690113] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-11. [2025-09-17T05:56:40.763613] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T05:56:40.964182] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T05:56:41.490133] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-17T05:56:42.214323] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T05:56:42.290087] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-09-17T05:56:42.637226] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T05:56:43.090172] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-17T05:56:43.732959] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T05:56:43.890144] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-09-17T05:56:44.690159] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-17T05:56:44.726477] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T05:56:45.456735] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T05:56:45.490076] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-17T05:56:46.295362] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-17T05:56:46.306937] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T05:56:46.995444] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T05:56:47.090177] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-17T05:56:47.773544] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T05:56:47.890185] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-17T05:56:48.676521] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T05:56:48.690086] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-17T05:56:49.250482] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T05:56:49.490134] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-17T05:56:49.957390] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T05:56:50.290124] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-17T05:56:51.023499] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T05:56:51.090092] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-17T05:56:51.407450] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T05:56:51.890128] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-17T05:56:52.691886] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-17T05:56:52.697380] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T05:56:52.757117] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T05:56:53.490160] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-17T05:56:54.027617] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T05:56:54.290149] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-17T05:56:54.888373] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T05:56:55.090145] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-17T05:56:55.801151] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T05:56:55.808438] [INFO ] [REMOTE ] PRKS: Full fetch complete (60677 records). [2025-09-17T05:56:55.808822] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-17T05:56:55.895461] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-17T05:56:56.183194] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T05:56:56.233872] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-17T05:56:56.234015] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-17T05:56:56.235037] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-17T05:56:56.235109] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-17T05:56:56.236428] [DEBUG] [LOCAL ] PRKS: Trimmed 60677 records to 42756 (keeping 200 days of data) [2025-09-17T05:56:56.498738] [DEBUG] [LOCAL ] PRKS: Primary data saved (42756 records). [2025-09-17T05:56:56.498931] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-17T05:56:56.499038] [INFO ] [MAIN ] Update Progress: 1728/2369 symbols completed. PRKS took 38.9s. Estimated remaining: 1h 33m 47s. Rate: 6.8 symbols/min [2025-09-17T05:56:56.669869] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:56:56.690415] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-17T05:56:56.707505] [DEBUG] [LOCAL ] PRMB: Loaded 39667 existing records from primary storage. [2025-09-17T05:56:56.707702] [INFO ] [MAIN ] PRMB: Loaded 39667 existing records. [2025-09-17T05:56:56.883873] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:56:56.884105] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-17T05:56:56.884164] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-17T05:56:56.885267] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-17T05:56:56.885334] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-17T05:56:57.243553] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:56:57.495109] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-11. [2025-09-17T05:56:57.501122] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T05:56:57.721920] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T05:56:58.290128] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-17T05:56:58.520562] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T05:56:59.090164] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-09-17T05:56:59.348585] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T05:56:59.890210] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-17T05:57:00.690212] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-17T05:57:00.833941] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T05:57:00.983675] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T05:57:01.490164] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-17T05:57:02.249672] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T05:57:02.255402] [INFO ] [REMOTE ] PRIM: Full fetch complete (62885 records). [2025-09-17T05:57:02.255556] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-17T05:57:02.298589] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-17T05:57:02.649037] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-17T05:57:02.649165] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-17T05:57:02.650364] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-17T05:57:02.650453] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-17T05:57:02.652056] [DEBUG] [LOCAL ] PRIM: Trimmed 62885 records to 44570 (keeping 200 days of data) [2025-09-17T05:57:02.943807] [DEBUG] [LOCAL ] PRIM: Primary data saved (44570 records). [2025-09-17T05:57:02.944035] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-17T05:57:02.944202] [INFO ] [MAIN ] Update Progress: 1729/2369 symbols completed. PRIM took 46.7s. Estimated remaining: 1h 33m 38s. Rate: 6.8 symbols/min [2025-09-17T05:57:03.097307] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-09-17T05:57:03.116366] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:57:03.146885] [DEBUG] [LOCAL ] PRO: Loaded 28842 existing records from primary storage. [2025-09-17T05:57:03.147086] [INFO ] [MAIN ] PRO: Loaded 28842 existing records. [2025-09-17T05:57:03.328169] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:57:03.328448] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-17T05:57:03.328526] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-17T05:57:03.329211] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-17T05:57:03.329287] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-17T05:57:03.685747] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:57:03.890135] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-11. [2025-09-17T05:57:04.324901] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-17T05:57:04.579873] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-17T05:57:04.584452] [INFO ] [REMOTE ] PRLB: Full fetch complete (31060 records). [2025-09-17T05:57:04.584774] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-17T05:57:04.693367] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-17T05:57:04.979677] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-17T05:57:04.979871] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-17T05:57:04.980669] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-17T05:57:04.980729] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-17T05:57:04.981622] [DEBUG] [LOCAL ] PRLB: Trimmed 31060 records to 20950 (keeping 200 days of data) [2025-09-17T05:57:05.098529] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T05:57:05.148739] [DEBUG] [LOCAL ] PRLB: Primary data saved (20950 records). [2025-09-17T05:57:05.148954] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-17T05:57:05.149076] [INFO ] [MAIN ] Update Progress: 1730/2369 symbols completed. PRLB took 38.7s. Estimated remaining: 1h 33m 26s. Rate: 6.8 symbols/min [2025-09-17T05:57:05.325058] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T05:57:05.356228] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:57:05.374813] [DEBUG] [LOCAL ] PRSU: Loaded 17710 existing records from primary storage. [2025-09-17T05:57:05.374992] [INFO ] [MAIN ] PRSU: Loaded 17710 existing records. [2025-09-17T05:57:05.495225] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-17T05:57:05.560137] [WARN ] [MAIN ] PRSU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:57:05.560408] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-17T05:57:05.560470] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-17T05:57:05.561075] [DEBUG] [LOCAL ] PRSU: Deleted primary data file. [2025-09-17T05:57:05.561145] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-17T05:57:05.925504] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:57:06.290164] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-09-17T05:57:06.315450] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T05:57:06.322674] [INFO ] [REMOTE ] PRM: Full fetch complete (64071 records). [2025-09-17T05:57:06.322893] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-17T05:57:06.734284] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-17T05:57:06.734409] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-17T05:57:06.735367] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-17T05:57:06.735426] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-17T05:57:06.736794] [DEBUG] [LOCAL ] PRM: Trimmed 64071 records to 44761 (keeping 200 days of data) [2025-09-17T05:57:06.998210] [DEBUG] [LOCAL ] PRM: Primary data saved (44761 records). [2025-09-17T05:57:06.998365] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-17T05:57:06.998460] [INFO ] [MAIN ] Update Progress: 1731/2369 symbols completed. PRM took 28.3s. Estimated remaining: 1h 33m 15s. Rate: 6.8 symbols/min [2025-09-17T05:57:07.099124] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-11. [2025-09-17T05:57:07.175044] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:57:07.222692] [DEBUG] [LOCAL ] PRT: Loaded 3670 existing records from primary storage. [2025-09-17T05:57:07.222388] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T05:57:07.222842] [INFO ] [MAIN ] PRT: Loaded 3670 existing records. [2025-09-17T05:57:07.251366] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T05:57:07.342056] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:57:07.344683] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-11 [2025-09-17T05:57:07.421985] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:57:07.422263] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-17T05:57:07.422342] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-17T05:57:07.422604] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-17T05:57:07.422700] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-17T05:57:07.782931] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:57:07.890120] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-17T05:57:08.690162] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-17T05:57:08.906464] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:57:08.906859] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-17T05:57:09.490188] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-11. [2025-09-17T05:57:09.764377] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T05:57:10.126918] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T05:57:10.290146] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-09-17T05:57:11.068016] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T05:57:11.090085] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-17T05:57:11.846332] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T05:57:11.890082] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-17T05:57:12.640331] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T05:57:12.690215] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-17T05:57:13.388768] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T05:57:13.490155] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-17T05:57:14.112884] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T05:57:14.290152] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-17T05:57:14.864179] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T05:57:15.090190] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-17T05:57:15.678991] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T05:57:15.890214] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-17T05:57:16.690188] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-17T05:57:17.490139] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-17T05:57:17.611868] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T05:57:18.007617] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T05:57:18.290149] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-17T05:57:18.891276] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T05:57:19.090166] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-17T05:57:19.423882] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T05:57:19.890145] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-17T05:57:20.409491] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T05:57:20.586762] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T05:57:20.588159] [INFO ] [REMOTE ] PRT: Full fetch complete (9169 records). [2025-09-17T05:57:20.588265] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-17T05:57:20.690498] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-17T05:57:20.966431] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-17T05:57:20.966539] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-17T05:57:20.966838] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-17T05:57:20.966919] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-17T05:57:20.967398] [DEBUG] [LOCAL ] PRT: Trimmed 9169 records to 5446 (keeping 200 days of data) [2025-09-17T05:57:21.000673] [DEBUG] [LOCAL ] PRT: Primary data saved (5446 records). [2025-09-17T05:57:21.000773] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-17T05:57:21.000882] [INFO ] [MAIN ] Update Progress: 1732/2369 symbols completed. PRT took 14.0s. Estimated remaining: 1h 33m 8s. Rate: 6.8 symbols/min [2025-09-17T05:57:21.176885] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:57:21.220139] [DEBUG] [LOCAL ] PRU: Loaded 38205 existing records from primary storage. [2025-09-17T05:57:21.220312] [INFO ] [MAIN ] PRU: Loaded 38205 existing records. [2025-09-17T05:57:21.407375] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:57:21.407633] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-17T05:57:21.407727] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-17T05:57:21.408912] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-17T05:57:21.408985] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-17T05:57:21.495252] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-09-17T05:57:21.785272] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:57:22.290152] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-17T05:57:22.482957] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T05:57:22.670267] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T05:57:23.090141] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-11. [2025-09-17T05:57:23.628276] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T05:57:23.890138] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-17T05:57:24.690152] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-17T05:57:24.820816] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T05:57:25.006181] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T05:57:25.490139] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-09-17T05:57:26.290170] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-17T05:57:26.405879] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T05:57:27.090146] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-17T05:57:27.209943] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T05:57:27.722749] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T05:57:27.890130] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-17T05:57:28.548787] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T05:57:28.690095] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-17T05:57:29.490180] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-17T05:57:29.639474] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T05:57:30.295275] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-17T05:57:30.309335] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T05:57:30.903818] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T05:57:31.090146] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-17T05:57:31.710441] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T05:57:31.890146] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-17T05:57:32.505291] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T05:57:32.690139] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-17T05:57:33.356302] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T05:57:33.490147] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-17T05:57:33.858853] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T05:57:34.290140] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-17T05:57:35.090159] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-17T05:57:35.269307] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T05:57:35.706615] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T05:57:35.890107] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-17T05:57:35.931621] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T05:57:36.690242] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-17T05:57:37.490192] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-17T05:57:37.573475] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T05:57:37.580022] [INFO ] [REMOTE ] PRMB: Full fetch complete (75803 records). [2025-09-17T05:57:37.580176] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-17T05:57:37.969602] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-17T05:57:37.969744] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-17T05:57:37.970835] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-17T05:57:37.970911] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-17T05:57:37.972487] [DEBUG] [LOCAL ] PRMB: Trimmed 75803 records to 53131 (keeping 200 days of data) [2025-09-17T05:57:38.240723] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T05:57:38.311214] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-17T05:57:38.362203] [DEBUG] [LOCAL ] PRMB: Primary data saved (53131 records). [2025-09-17T05:57:38.362366] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-17T05:57:38.362476] [INFO ] [MAIN ] Update Progress: 1733/2369 symbols completed. PRMB took 41.9s. Estimated remaining: 1h 33m 3s. Rate: 6.8 symbols/min [2025-09-17T05:57:38.536438] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:57:38.536719] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-17T05:57:38.536766] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-17T05:57:38.536888] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-17T05:57:38.536964] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-17T05:57:38.537017] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-17T05:57:38.537055] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-17T05:57:38.840700] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T05:57:38.914593] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:57:39.090127] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-11. [2025-09-17T05:57:39.288205] [DEBUG] [REMOTE ] PRVS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T05:57:39.288462] [WARN ] [REMOTE ] PRVS: No data returned for month 2024-11 [2025-09-17T05:57:39.890113] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-17T05:57:39.920425] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T05:57:40.230551] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-17T05:57:40.690138] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-17T05:57:41.103739] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-17T05:57:41.490158] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-17T05:57:42.290190] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-17T05:57:43.091113] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-17T05:57:43.093695] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T05:57:43.356384] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-17T05:57:43.470629] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T05:57:43.890140] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-17T05:57:44.217213] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T05:57:44.690159] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-17T05:57:45.490166] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-17T05:57:46.203148] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T05:57:46.290123] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-17T05:57:47.090183] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-17T05:57:47.406846] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T05:57:47.430583] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T05:57:47.435299] [INFO ] [REMOTE ] PRO: Full fetch complete (50519 records). [2025-09-17T05:57:47.435405] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-17T05:57:47.538591] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T05:57:47.818055] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-17T05:57:47.818169] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-17T05:57:47.819039] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-17T05:57:47.819095] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-17T05:57:47.820249] [DEBUG] [LOCAL ] PRO: Trimmed 50519 records to 37111 (keeping 200 days of data) [2025-09-17T05:57:47.912634] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-17T05:57:48.047565] [DEBUG] [LOCAL ] PRO: Primary data saved (37111 records). [2025-09-17T05:57:48.047778] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-17T05:57:48.047923] [INFO ] [MAIN ] Update Progress: 1734/2369 symbols completed. PRO took 45.1s. Estimated remaining: 1h 32m 54s. Rate: 6.8 symbols/min [2025-09-17T05:57:48.218359] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:57:48.256102] [DEBUG] [LOCAL ] PSA: Loaded 31255 existing records from primary storage. [2025-09-17T05:57:48.256266] [INFO ] [MAIN ] PSA: Loaded 31255 existing records. [2025-09-17T05:57:48.433813] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:57:48.434050] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-17T05:57:48.434105] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-17T05:57:48.435131] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-17T05:57:48.435206] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-17T05:57:48.695236] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-17T05:57:48.803109] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:57:49.014546] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T05:57:49.490146] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-17T05:57:49.911020] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T05:57:50.290118] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-17T05:57:50.510548] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T05:57:51.090087] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-17T05:57:51.395558] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T05:57:51.398491] [INFO ] [REMOTE ] PRSU: Full fetch complete (31140 records). [2025-09-17T05:57:51.398614] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-17T05:57:51.588324] [WARN ] [VALIDATOR ] PRSU: Validation failed - insufficient historical data. Have 176 unique days, need 200 days [2025-09-17T05:57:51.588822] [FATAL] [MAIN ] PRSU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:57:51.588908] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:57:51.588986] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-17T05:57:51.589089] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-17T05:57:51.589159] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-17T05:57:51.589517] [DEBUG] [LOCAL ] PRSU: Deleted derivative data file. [2025-09-17T05:57:51.589634] [INFO ] [MAIN ] Update Progress: 1735/2369 symbols completed. PRSU took 46.4s. Estimated remaining: 1h 32m 43s. Rate: 6.8 symbols/min [2025-09-17T05:57:51.763534] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:57:51.773587] [DEBUG] [LOCAL ] PSBD: Loaded 5191 existing records from primary storage. [2025-09-17T05:57:51.773764] [INFO ] [MAIN ] PSBD: Loaded 5191 existing records. [2025-09-17T05:57:51.895232] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-11. [2025-09-17T05:57:51.958662] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:57:51.958912] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-17T05:57:51.958973] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-17T05:57:51.959224] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-17T05:57:51.959281] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-17T05:57:52.394922] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:57:52.690200] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-17T05:57:52.781671] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T05:57:52.794496] [INFO ] [REMOTE ] PRU: Full fetch complete (74067 records). [2025-09-17T05:57:52.794817] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-17T05:57:53.104211] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-17T05:57:53.346229] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-17T05:57:53.346369] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-17T05:57:53.347595] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-17T05:57:53.347697] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-17T05:57:53.349368] [DEBUG] [LOCAL ] PRU: Trimmed 74067 records to 51578 (keeping 200 days of data) [2025-09-17T05:57:53.490494] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-11. [2025-09-17T05:57:53.720683] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T05:57:53.751868] [DEBUG] [LOCAL ] PRU: Primary data saved (51578 records). [2025-09-17T05:57:53.752108] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-17T05:57:53.752273] [INFO ] [MAIN ] Update Progress: 1736/2369 symbols completed. PRU took 32.8s. Estimated remaining: 1h 32m 32s. Rate: 6.8 symbols/min [2025-09-17T05:57:53.926454] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:57:53.932464] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T05:57:53.939706] [DEBUG] [LOCAL ] PSF: Loaded 5008 existing records from primary storage. [2025-09-17T05:57:53.939867] [INFO ] [MAIN ] PSF: Loaded 5008 existing records. [2025-09-17T05:57:54.113349] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:57:54.113665] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-17T05:57:54.113738] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-17T05:57:54.114052] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-17T05:57:54.114127] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-17T05:57:54.299350] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-09-17T05:57:54.472370] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:57:55.090174] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-11. [2025-09-17T05:57:55.821113] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T05:57:55.859867] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T05:57:55.890140] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-17T05:57:56.690220] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-17T05:57:57.007122] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-17T05:57:57.438088] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T05:57:57.490091] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-17T05:57:57.801259] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-17T05:57:58.290155] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-17T05:57:59.090153] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-17T05:57:59.494797] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T05:57:59.495849] [INFO ] [REMOTE ] PRVS: Full fetch complete (1227 records). [2025-09-17T05:57:59.495973] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-17T05:57:59.691869] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-17T05:57:59.692250] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T05:57:59.692437] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T05:57:59.692530] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-17T05:57:59.692635] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-17T05:57:59.692717] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-17T05:57:59.692991] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-17T05:57:59.693414] [INFO ] [MAIN ] Update Progress: 1737/2369 symbols completed. PRVS took 21.3s. Estimated remaining: 1h 32m 22s. Rate: 6.8 symbols/min [2025-09-17T05:57:59.890148] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:57:59.890390] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-09-17T05:57:59.920047] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T05:57:59.952539] [DEBUG] [LOCAL ] PSFE: Loaded 22752 existing records from primary storage. [2025-09-17T05:57:59.952778] [INFO ] [MAIN ] PSFE: Loaded 22752 existing records. [2025-09-17T05:58:00.141265] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:58:00.141572] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-17T05:58:00.141633] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-17T05:58:00.142316] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-17T05:58:00.142379] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-17T05:58:00.499203] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:58:00.648422] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T05:58:00.690096] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-09-17T05:58:01.195659] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T05:58:01.490169] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-09-17T05:58:02.118271] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T05:58:02.290192] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-17T05:58:02.875870] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T05:58:03.090153] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-17T05:58:03.890174] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-11. [2025-09-17T05:58:04.695373] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-09-17T05:58:04.712445] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T05:58:05.241532] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T05:58:05.421439] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T05:58:05.490173] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-17T05:58:06.123122] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T05:58:06.290142] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-17T05:58:06.999494] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T05:58:07.090173] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-17T05:58:07.701140] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T05:58:07.890177] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-17T05:58:08.601773] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T05:58:08.690133] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-17T05:58:09.473395] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T05:58:09.490090] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-17T05:58:09.931159] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T05:58:10.290169] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-17T05:58:10.891913] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T05:58:11.090144] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-17T05:58:11.860049] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T05:58:11.890106] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-17T05:58:12.521455] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T05:58:12.690152] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-17T05:58:13.428993] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T05:58:13.490216] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-17T05:58:14.290141] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-09-17T05:58:14.310944] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T05:58:14.312620] [INFO ] [REMOTE ] PSF: Full fetch complete (9637 records). [2025-09-17T05:58:14.312738] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-17T05:58:14.694622] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-17T05:58:14.694750] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-17T05:58:14.695005] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-17T05:58:14.695057] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-17T05:58:14.695502] [DEBUG] [LOCAL ] PSF: Trimmed 9637 records to 6679 (keeping 200 days of data) [2025-09-17T05:58:14.737176] [DEBUG] [LOCAL ] PSF: Primary data saved (6679 records). [2025-09-17T05:58:14.737338] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-17T05:58:14.737471] [INFO ] [MAIN ] Update Progress: 1738/2369 symbols completed. PSF took 21.0s. Estimated remaining: 1h 32m 16s. Rate: 6.8 symbols/min [2025-09-17T05:58:14.907813] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:58:14.942164] [DEBUG] [LOCAL ] PSN: Loaded 33985 existing records from primary storage. [2025-09-17T05:58:14.942335] [INFO ] [MAIN ] PSN: Loaded 33985 existing records. [2025-09-17T05:58:15.100173] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-17T05:58:15.122628] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:58:15.124016] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-17T05:58:15.124081] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-17T05:58:15.125210] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-17T05:58:15.125291] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-17T05:58:15.488608] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:58:15.541674] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T05:58:15.890190] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-17T05:58:16.595839] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T05:58:16.690153] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-17T05:58:16.902165] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T05:58:17.490178] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-17T05:58:17.591569] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T05:58:18.178487] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T05:58:18.290229] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-17T05:58:19.090142] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-17T05:58:19.824467] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T05:58:19.890183] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-11. [2025-09-17T05:58:20.393899] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T05:58:20.690180] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-17T05:58:21.313808] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T05:58:21.490186] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-17T05:58:21.795890] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T05:58:22.240797] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T05:58:22.290076] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-17T05:58:23.093574] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-17T05:58:23.094435] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T05:58:23.097685] [INFO ] [REMOTE ] PSBD: Full fetch complete (9037 records). [2025-09-17T05:58:23.097799] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-17T05:58:23.460467] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-17T05:58:23.460582] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-17T05:58:23.460853] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-17T05:58:23.460907] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-17T05:58:23.461397] [DEBUG] [LOCAL ] PSBD: Trimmed 9037 records to 6796 (keeping 200 days of data) [2025-09-17T05:58:23.506183] [DEBUG] [LOCAL ] PSBD: Primary data saved (6796 records). [2025-09-17T05:58:23.506394] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-17T05:58:23.506505] [INFO ] [MAIN ] Update Progress: 1739/2369 symbols completed. PSBD took 31.9s. Estimated remaining: 1h 32m 7s. Rate: 6.8 symbols/min [2025-09-17T05:58:23.675933] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:58:23.704561] [DEBUG] [LOCAL ] PSO: Loaded 27028 existing records from primary storage. [2025-09-17T05:58:23.704756] [INFO ] [MAIN ] PSO: Loaded 27028 existing records. [2025-09-17T05:58:23.886807] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:58:23.887109] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-17T05:58:23.887167] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-17T05:58:23.887964] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-17T05:58:23.888026] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-17T05:58:23.899238] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-09-17T05:58:24.249389] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:58:24.690161] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-17T05:58:24.868840] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T05:58:25.460043] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T05:58:25.490107] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-17T05:58:26.048548] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T05:58:26.290159] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-17T05:58:26.900249] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T05:58:27.090145] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-11. [2025-09-17T05:58:27.379864] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T05:58:27.890143] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-17T05:58:28.503418] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T05:58:28.690163] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-09-17T05:58:29.411145] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T05:58:29.420767] [INFO ] [REMOTE ] PSA: Full fetch complete (58922 records). [2025-09-17T05:58:29.420973] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-17T05:58:29.498567] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-09-17T05:58:29.830197] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-17T05:58:29.830306] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-17T05:58:29.831249] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-17T05:58:29.831307] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-17T05:58:29.832712] [DEBUG] [LOCAL ] PSA: Trimmed 58922 records to 41934 (keeping 200 days of data) [2025-09-17T05:58:30.110680] [DEBUG] [LOCAL ] PSA: Primary data saved (41934 records). [2025-09-17T05:58:30.110993] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-17T05:58:30.111110] [INFO ] [MAIN ] Update Progress: 1740/2369 symbols completed. PSA took 42.1s. Estimated remaining: 1h 31m 58s. Rate: 6.8 symbols/min [2025-09-17T05:58:30.194239] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T05:58:30.304606] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-17T05:58:30.335981] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:58:30.362503] [DEBUG] [LOCAL ] PSQH: Loaded 25211 existing records from primary storage. [2025-09-17T05:58:30.362723] [INFO ] [MAIN ] PSQH: Loaded 25211 existing records. [2025-09-17T05:58:30.544470] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:58:30.544753] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-17T05:58:30.544822] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-17T05:58:30.545345] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-17T05:58:30.545403] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-17T05:58:30.904761] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:58:30.921094] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T05:58:31.090093] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-11. [2025-09-17T05:58:31.342287] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T05:58:31.890142] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-17T05:58:32.169101] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T05:58:32.690132] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-09-17T05:58:33.155277] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T05:58:33.490223] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-09-17T05:58:34.290174] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-17T05:58:34.791439] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-17T05:58:34.905619] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T05:58:35.090139] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-17T05:58:35.625091] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T05:58:35.890124] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-17T05:58:36.690091] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-17T05:58:36.724489] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T05:58:36.793095] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T05:58:37.490152] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-09-17T05:58:38.042126] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T05:58:38.290115] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-17T05:58:39.090114] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-17T05:58:39.183279] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T05:58:39.577795] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T05:58:39.890146] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-17T05:58:40.238170] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T05:58:40.242782] [INFO ] [REMOTE ] PSFE: Full fetch complete (43523 records). [2025-09-17T05:58:40.242987] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-17T05:58:40.631480] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-17T05:58:40.631593] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-17T05:58:40.632392] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-17T05:58:40.632451] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-17T05:58:40.634419] [DEBUG] [LOCAL ] PSFE: Trimmed 43523 records to 30931 (keeping 200 days of data) [2025-09-17T05:58:40.697977] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-17T05:58:40.834191] [DEBUG] [LOCAL ] PSFE: Primary data saved (30931 records). [2025-09-17T05:58:40.834399] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-17T05:58:40.834513] [INFO ] [MAIN ] Update Progress: 1741/2369 symbols completed. PSFE took 41.1s. Estimated remaining: 1h 31m 50s. Rate: 6.8 symbols/min [2025-09-17T05:58:41.003791] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:58:41.043552] [DEBUG] [LOCAL ] PSTG: Loaded 39292 existing records from primary storage. [2025-09-17T05:58:41.043744] [INFO ] [MAIN ] PSTG: Loaded 39292 existing records. [2025-09-17T05:58:41.224141] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:58:41.224527] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-17T05:58:41.224633] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-17T05:58:41.225549] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-17T05:58:41.225613] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-17T05:58:41.363694] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T05:58:41.496030] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-17T05:58:41.627208] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:58:42.290185] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-11. [2025-09-17T05:58:42.477282] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T05:58:43.101761] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-17T05:58:43.107678] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T05:58:43.890129] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-17T05:58:44.059686] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T05:58:44.151027] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T05:58:44.690132] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-17T05:58:45.306431] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T05:58:45.490209] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-17T05:58:46.181001] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T05:58:46.290178] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-09-17T05:58:46.418254] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-17T05:58:47.090184] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-17T05:58:47.890142] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-17T05:58:48.185560] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T05:58:48.521012] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T05:58:48.690118] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-17T05:58:49.260461] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T05:58:49.490183] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-17T05:58:50.187713] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T05:58:50.290111] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-17T05:58:50.936757] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T05:58:51.090132] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-17T05:58:51.638791] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T05:58:51.890139] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-09-17T05:58:52.573403] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T05:58:52.690161] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-17T05:58:53.490152] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-17T05:58:53.726021] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T05:58:54.182830] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T05:58:54.290136] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-17T05:58:54.667214] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T05:58:55.090185] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-17T05:58:55.692260] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T05:58:55.697955] [INFO ] [REMOTE ] PSN: Full fetch complete (66462 records). [2025-09-17T05:58:55.698111] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-17T05:58:55.895226] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-17T05:58:56.094041] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-17T05:58:56.094147] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-17T05:58:56.095281] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-17T05:58:56.095350] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-17T05:58:56.096793] [DEBUG] [LOCAL ] PSN: Trimmed 66462 records to 46387 (keeping 200 days of data) [2025-09-17T05:58:56.373076] [DEBUG] [LOCAL ] PSN: Primary data saved (46387 records). [2025-09-17T05:58:56.373319] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-17T05:58:56.373422] [INFO ] [MAIN ] Update Progress: 1742/2369 symbols completed. PSN took 41.6s. Estimated remaining: 1h 31m 43s. Rate: 6.8 symbols/min [2025-09-17T05:58:56.542784] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:58:56.558126] [DEBUG] [LOCAL ] PSTL: Loaded 14935 existing records from primary storage. [2025-09-17T05:58:56.558275] [INFO ] [MAIN ] PSTL: Loaded 14935 existing records. [2025-09-17T05:58:56.697270] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-17T05:58:56.765288] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T05:58:56.765460] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:58:56.775763] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-17T05:58:56.775938] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-17T05:58:56.776833] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-17T05:58:56.776899] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-17T05:58:57.137708] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:58:57.331252] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T05:58:57.490179] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-17T05:58:58.134228] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T05:58:58.139756] [INFO ] [REMOTE ] PSO: Full fetch complete (51477 records). [2025-09-17T05:58:58.139865] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-17T05:58:58.296885] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-11. [2025-09-17T05:58:58.524620] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-17T05:58:58.524743] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-17T05:58:58.525691] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-17T05:58:58.525754] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-17T05:58:58.526947] [DEBUG] [LOCAL ] PSO: Trimmed 51477 records to 37841 (keeping 200 days of data) [2025-09-17T05:58:58.764029] [DEBUG] [LOCAL ] PSO: Primary data saved (37841 records). [2025-09-17T05:58:58.764208] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-17T05:58:58.764302] [INFO ] [MAIN ] Update Progress: 1743/2369 symbols completed. PSO took 35.3s. Estimated remaining: 1h 31m 32s. Rate: 6.8 symbols/min [2025-09-17T05:58:58.934664] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:58:58.957516] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T05:58:59.010575] [DEBUG] [LOCAL ] PSX: Loaded 39616 existing records from primary storage. [2025-09-17T05:58:59.010877] [INFO ] [MAIN ] PSX: Loaded 39616 existing records. [2025-09-17T05:58:59.095314] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-17T05:58:59.196102] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:58:59.196366] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-17T05:58:59.196427] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-17T05:58:59.197662] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-17T05:58:59.197726] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-17T05:58:59.457619] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T05:58:59.570596] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:58:59.890146] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-11. [2025-09-17T05:59:00.690116] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-17T05:59:00.985442] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T05:59:01.237629] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T05:59:01.490146] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-17T05:59:02.212005] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T05:59:02.290167] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-09-17T05:59:03.090207] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-09-17T05:59:03.395139] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T05:59:03.418957] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T05:59:03.890141] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-17T05:59:04.690146] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-17T05:59:04.815289] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T05:59:05.346921] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T05:59:05.490135] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-09-17T05:59:06.183320] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T05:59:06.190891] [INFO ] [REMOTE ] PSQH: Full fetch complete (53112 records). [2025-09-17T05:59:06.191104] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-17T05:59:06.295262] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-17T05:59:06.611861] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-17T05:59:06.611997] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-17T05:59:06.613128] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-17T05:59:06.613245] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-17T05:59:06.614767] [DEBUG] [LOCAL ] PSQH: Trimmed 53112 records to 34432 (keeping 200 days of data) [2025-09-17T05:59:06.812738] [DEBUG] [LOCAL ] PSQH: Primary data saved (34432 records). [2025-09-17T05:59:06.812907] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-17T05:59:06.813002] [INFO ] [MAIN ] Update Progress: 1744/2369 symbols completed. PSQH took 36.7s. Estimated remaining: 1h 31m 23s. Rate: 6.8 symbols/min [2025-09-17T05:59:06.985755] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:59:06.998310] [DEBUG] [LOCAL ] PTA: Loaded 10626 existing records from primary storage. [2025-09-17T05:59:06.998460] [INFO ] [MAIN ] PTA: Loaded 10626 existing records. [2025-09-17T05:59:07.096464] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-09-17T05:59:07.182136] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:59:07.182551] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-17T05:59:07.182667] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-17T05:59:07.183358] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-17T05:59:07.183422] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-17T05:59:07.568516] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:59:07.573969] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-17T05:59:07.890133] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-11. [2025-09-17T05:59:08.099618] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T05:59:08.148152] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T05:59:08.620886] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T05:59:08.690226] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-09-17T05:59:09.490245] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-17T05:59:09.863619] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T05:59:10.290172] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-17T05:59:11.090204] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-09-17T05:59:11.374086] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T05:59:11.890159] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-17T05:59:12.080160] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T05:59:12.125426] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T05:59:12.690149] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-17T05:59:13.338897] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T05:59:13.490139] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-17T05:59:13.782773] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T05:59:14.290173] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-17T05:59:14.461829] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T05:59:15.090152] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-17T05:59:15.890148] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-17T05:59:16.060140] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T05:59:16.133257] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T05:59:16.140856] [INFO ] [REMOTE ] PSTG: Full fetch complete (76397 records). [2025-09-17T05:59:16.141155] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-17T05:59:16.563331] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-17T05:59:16.563492] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-17T05:59:16.565180] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-17T05:59:16.565290] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-17T05:59:16.567492] [DEBUG] [LOCAL ] PSTG: Trimmed 76397 records to 52858 (keeping 200 days of data) [2025-09-17T05:59:16.691551] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-17T05:59:16.839024] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T05:59:16.921882] [DEBUG] [LOCAL ] PSTG: Primary data saved (52858 records). [2025-09-17T05:59:16.922086] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-17T05:59:16.922212] [INFO ] [MAIN ] Update Progress: 1745/2369 symbols completed. PSTG took 36.1s. Estimated remaining: 1h 31m 15s. Rate: 6.8 symbols/min [2025-09-17T05:59:17.097434] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:59:17.125333] [DEBUG] [LOCAL ] PTY: Loaded 27365 existing records from primary storage. [2025-09-17T05:59:17.125506] [INFO ] [MAIN ] PTY: Loaded 27365 existing records. [2025-09-17T05:59:17.313371] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:59:17.313725] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-17T05:59:17.313799] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-17T05:59:17.314539] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-17T05:59:17.314605] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-17T05:59:17.491031] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-17T05:59:17.537804] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T05:59:17.716203] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:59:18.290137] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-11. [2025-09-17T05:59:19.090197] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-17T05:59:19.446548] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T05:59:19.482520] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T05:59:19.890167] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-09-17T05:59:20.160940] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T05:59:20.690178] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-17T05:59:21.315160] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T05:59:21.490176] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-09-17T05:59:21.607134] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T05:59:22.290168] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-17T05:59:22.751212] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T05:59:23.090199] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-17T05:59:23.890155] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-17T05:59:24.267403] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T05:59:24.300208] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T05:59:24.690142] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-17T05:59:24.784168] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T05:59:25.490187] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-17T05:59:25.544247] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T05:59:26.290193] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-17T05:59:26.426709] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T05:59:27.090135] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-17T05:59:27.702136] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T05:59:27.890218] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-17T05:59:28.668347] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T05:59:28.690107] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-17T05:59:28.952364] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T05:59:29.490145] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-17T05:59:30.290143] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-17T05:59:30.483217] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T05:59:30.505890] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T05:59:31.090158] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-17T05:59:31.218976] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T05:59:31.221886] [INFO ] [REMOTE ] PTA: Full fetch complete (23750 records). [2025-09-17T05:59:31.221990] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-17T05:59:31.609915] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-17T05:59:31.610027] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-17T05:59:31.610576] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-17T05:59:31.610659] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-17T05:59:31.611321] [DEBUG] [LOCAL ] PTA: Trimmed 23750 records to 15067 (keeping 200 days of data) [2025-09-17T05:59:31.711931] [DEBUG] [LOCAL ] PTA: Primary data saved (15067 records). [2025-09-17T05:59:31.712145] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-17T05:59:31.712254] [INFO ] [MAIN ] Update Progress: 1746/2369 symbols completed. PTA took 24.9s. Estimated remaining: 1h 31m 8s. Rate: 6.8 symbols/min [2025-09-17T05:59:31.890496] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:59:31.890570] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-17T05:59:31.933383] [DEBUG] [LOCAL ] PUK: Loaded 32480 existing records from primary storage. [2025-09-17T05:59:31.933587] [INFO ] [MAIN ] PUK: Loaded 32480 existing records. [2025-09-17T05:59:32.118574] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:59:32.119212] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-17T05:59:32.119360] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-17T05:59:32.125471] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-17T05:59:32.132177] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-17T05:59:32.167219] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T05:59:32.535087] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:59:32.690114] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-17T05:59:33.307086] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T05:59:33.472486] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T05:59:33.475946] [INFO ] [REMOTE ] PSTL: Full fetch complete (29432 records). [2025-09-17T05:59:33.476131] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-17T05:59:33.498162] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-11. [2025-09-17T05:59:33.893317] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-17T05:59:33.893452] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-17T05:59:33.894192] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-17T05:59:33.894254] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-17T05:59:33.895188] [DEBUG] [LOCAL ] PSTL: Trimmed 29432 records to 20679 (keeping 200 days of data) [2025-09-17T05:59:34.025370] [DEBUG] [LOCAL ] PSTL: Primary data saved (20679 records). [2025-09-17T05:59:34.025541] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-17T05:59:34.025669] [INFO ] [MAIN ] Update Progress: 1747/2369 symbols completed. PSTL took 37.7s. Estimated remaining: 1h 30m 57s. Rate: 6.8 symbols/min [2025-09-17T05:59:34.201170] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:59:34.234847] [DEBUG] [LOCAL ] PUMP: Loaded 36673 existing records from primary storage. [2025-09-17T05:59:34.235040] [INFO ] [MAIN ] PUMP: Loaded 36673 existing records. [2025-09-17T05:59:34.297816] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-17T05:59:34.437960] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:59:34.438340] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-17T05:59:34.438408] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-17T05:59:34.439424] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-17T05:59:34.439495] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-17T05:59:34.813161] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:59:35.090178] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-17T05:59:35.256138] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T05:59:35.890165] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-09-17T05:59:36.229241] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T05:59:36.655717] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T05:59:36.690085] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-17T05:59:37.424042] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T05:59:37.490078] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-17T05:59:38.157162] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T05:59:38.290155] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-17T05:59:38.819471] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T05:59:39.090133] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-17T05:59:39.762381] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T05:59:39.890121] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-11. [2025-09-17T05:59:40.582920] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T05:59:40.690086] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-17T05:59:41.495244] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-17T05:59:41.513031] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T05:59:42.295951] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-17T05:59:42.298598] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T05:59:42.907363] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T05:59:43.090128] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-17T05:59:43.767321] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T05:59:43.890094] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-17T05:59:44.690137] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-09-17T05:59:44.798606] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T05:59:45.303297] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T05:59:45.490115] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-17T05:59:46.290156] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-17T05:59:46.378404] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T05:59:47.052045] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T05:59:47.090103] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-17T05:59:47.619356] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T05:59:47.625776] [INFO ] [REMOTE ] PSX: Full fetch complete (76890 records). [2025-09-17T05:59:47.625923] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-17T05:59:47.896004] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-17T05:59:48.020410] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-17T05:59:48.020514] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-17T05:59:48.021603] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-17T05:59:48.021679] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-17T05:59:48.023199] [DEBUG] [LOCAL ] PSX: Trimmed 76890 records to 53144 (keeping 200 days of data) [2025-09-17T05:59:48.361270] [DEBUG] [LOCAL ] PSX: Primary data saved (53144 records). [2025-09-17T05:59:48.361479] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-17T05:59:48.361620] [INFO ] [MAIN ] Update Progress: 1748/2369 symbols completed. PSX took 49.6s. Estimated remaining: 1h 30m 50s. Rate: 6.8 symbols/min [2025-09-17T05:59:48.537218] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:59:48.576170] [DEBUG] [LOCAL ] PVH: Loaded 37679 existing records from primary storage. [2025-09-17T05:59:48.576354] [INFO ] [MAIN ] PVH: Loaded 37679 existing records. [2025-09-17T05:59:48.694464] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-09-17T05:59:48.760762] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:59:48.761098] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-17T05:59:48.761188] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-17T05:59:48.776182] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-17T05:59:48.784373] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-17T05:59:48.855259] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T05:59:49.151754] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:59:49.164720] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T05:59:49.169718] [INFO ] [REMOTE ] PTY: Full fetch complete (53663 records). [2025-09-17T05:59:49.169825] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-17T05:59:49.503222] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-11. [2025-09-17T05:59:49.555851] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-17T05:59:49.555963] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-17T05:59:49.556936] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-17T05:59:49.557018] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-17T05:59:49.558216] [DEBUG] [LOCAL ] PTY: Trimmed 53663 records to 37375 (keeping 200 days of data) [2025-09-17T05:59:49.790354] [DEBUG] [LOCAL ] PTY: Primary data saved (37375 records). [2025-09-17T05:59:49.790523] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-17T05:59:49.790665] [INFO ] [MAIN ] Update Progress: 1749/2369 symbols completed. PTY took 32.9s. Estimated remaining: 1h 30m 39s. Rate: 6.8 symbols/min [2025-09-17T05:59:49.960121] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T05:59:49.965307] [DEBUG] [LOCAL ] PVL: Loaded 3507 existing records from primary storage. [2025-09-17T05:59:49.965438] [INFO ] [MAIN ] PVL: Loaded 3507 existing records. [2025-09-17T05:59:50.141104] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T05:59:50.141350] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-17T05:59:50.141414] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-17T05:59:50.141724] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-17T05:59:50.141815] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-17T05:59:50.300424] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-17T05:59:50.506736] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T05:59:50.538612] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T05:59:51.027405] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T05:59:51.090148] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-09-17T05:59:51.890149] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-11. [2025-09-17T05:59:52.051236] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T05:59:52.273984] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-11 (0.38 seconds). [2025-09-17T05:59:52.695214] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-17T05:59:52.712550] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T05:59:53.490130] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-17T05:59:54.234513] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T05:59:54.290159] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-09-17T05:59:54.987354] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T05:59:55.052121] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T05:59:55.090123] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-17T05:59:55.567892] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T05:59:55.890136] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-17T05:59:56.690180] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-17T05:59:57.283110] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T05:59:57.501470] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-17T05:59:57.511575] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T05:59:58.290154] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-17T05:59:58.930144] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T05:59:59.100877] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-17T05:59:59.123024] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T05:59:59.890190] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-17T06:00:00.690575] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-17T06:00:00.696255] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T06:00:01.174028] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T06:00:01.179541] [INFO ] [REMOTE ] PUK: Full fetch complete (64831 records). [2025-09-17T06:00:01.179713] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-17T06:00:01.495245] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-17T06:00:01.587332] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-17T06:00:01.587476] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-17T06:00:01.588697] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-17T06:00:01.588781] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-17T06:00:01.590249] [DEBUG] [LOCAL ] PUK: Trimmed 64831 records to 45047 (keeping 200 days of data) [2025-09-17T06:00:01.905962] [DEBUG] [LOCAL ] PUK: Primary data saved (45047 records). [2025-09-17T06:00:01.906169] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-17T06:00:01.906309] [INFO ] [MAIN ] Update Progress: 1750/2369 symbols completed. PUK took 30.2s. Estimated remaining: 1h 30m 31s. Rate: 6.8 symbols/min [2025-09-17T06:00:02.099177] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:00:02.140929] [DEBUG] [LOCAL ] PWR: Loaded 34768 existing records from primary storage. [2025-09-17T06:00:02.141158] [INFO ] [MAIN ] PWR: Loaded 34768 existing records. [2025-09-17T06:00:02.301062] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-17T06:00:02.348724] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:00:02.349003] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-17T06:00:02.349073] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-17T06:00:02.349856] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-17T06:00:02.349928] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-17T06:00:02.747793] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:00:02.876208] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-17T06:00:03.090194] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-17T06:00:03.890182] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-11. [2025-09-17T06:00:03.981112] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-17T06:00:04.690233] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-17T06:00:05.350809] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T06:00:05.490139] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-17T06:00:06.015325] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-17T06:00:06.157699] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T06:00:06.250531] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (3.16 seconds). [2025-09-17T06:00:06.290140] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-09-17T06:00:06.475013] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (4.17 seconds). [2025-09-17T06:00:07.090175] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-17T06:00:07.890189] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-17T06:00:07.926521] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T06:00:08.596528] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T06:00:08.690128] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-09-17T06:00:08.719774] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T06:00:09.490133] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-17T06:00:09.990972] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T06:00:10.229380] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T06:00:10.290149] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-17T06:00:11.090163] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-17T06:00:11.737550] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T06:00:11.890172] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-17T06:00:12.690157] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-17T06:00:12.760562] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T06:00:13.490191] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-17T06:00:13.720550] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T06:00:14.290171] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-17T06:00:14.429887] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T06:00:14.431018] [INFO ] [REMOTE ] PVL: Full fetch complete (7535 records). [2025-09-17T06:00:14.431123] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-17T06:00:14.737668] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T06:00:14.893740] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-17T06:00:14.893857] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-17T06:00:14.894094] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-17T06:00:14.894162] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-17T06:00:14.894691] [DEBUG] [LOCAL ] PVL: Trimmed 7535 records to 4696 (keeping 200 days of data) [2025-09-17T06:00:14.924254] [DEBUG] [LOCAL ] PVL: Primary data saved (4696 records). [2025-09-17T06:00:14.924451] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-17T06:00:14.924591] [INFO ] [MAIN ] Update Progress: 1751/2369 symbols completed. PVL took 25.1s. Estimated remaining: 1h 30m 24s. Rate: 6.8 symbols/min [2025-09-17T06:00:15.090973] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-17T06:00:15.111874] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:00:15.140664] [DEBUG] [LOCAL ] PX: Loaded 25920 existing records from primary storage. [2025-09-17T06:00:15.140870] [INFO ] [MAIN ] PX: Loaded 25920 existing records. [2025-09-17T06:00:15.325121] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:00:15.325405] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-17T06:00:15.325476] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-17T06:00:15.326245] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-17T06:00:15.326317] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-17T06:00:15.685301] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:00:15.890144] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-11. [2025-09-17T06:00:16.129313] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T06:00:16.690159] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-17T06:00:16.834062] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T06:00:17.490178] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-17T06:00:18.096025] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-17T06:00:18.290159] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-17T06:00:19.090151] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-17T06:00:19.321166] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-17T06:00:19.406313] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T06:00:19.895245] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-17T06:00:19.911687] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T06:00:20.388741] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T06:00:20.690169] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-17T06:00:21.396449] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T06:00:21.403463] [INFO ] [REMOTE ] PUMP: Full fetch complete (71354 records). [2025-09-17T06:00:21.403681] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-17T06:00:21.495433] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-17T06:00:21.821893] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-17T06:00:21.822036] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-17T06:00:21.823262] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-17T06:00:21.823358] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-17T06:00:21.826031] [DEBUG] [LOCAL ] PUMP: Trimmed 71354 records to 49500 (keeping 200 days of data) [2025-09-17T06:00:22.114589] [DEBUG] [LOCAL ] PUMP: Primary data saved (49500 records). [2025-09-17T06:00:22.114788] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-17T06:00:22.114916] [INFO ] [MAIN ] Update Progress: 1752/2369 symbols completed. PUMP took 48.1s. Estimated remaining: 1h 30m 15s. Rate: 6.8 symbols/min [2025-09-17T06:00:22.287447] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:00:22.290135] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-17T06:00:22.327059] [DEBUG] [LOCAL ] QBTS: Loaded 40170 existing records from primary storage. [2025-09-17T06:00:22.327270] [INFO ] [MAIN ] QBTS: Loaded 40170 existing records. [2025-09-17T06:00:22.510220] [WARN ] [MAIN ] QBTS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:00:22.510635] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-17T06:00:22.510809] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-17T06:00:22.511688] [DEBUG] [LOCAL ] QBTS: Deleted primary data file. [2025-09-17T06:00:22.511779] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-17T06:00:22.714535] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T06:00:22.922925] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:00:22.960797] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T06:00:23.090185] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-17T06:00:23.307778] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T06:00:23.890147] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-17T06:00:24.690165] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-11. [2025-09-17T06:00:24.825984] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T06:00:25.313428] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T06:00:25.490132] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-17T06:00:26.290154] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-17T06:00:26.937108] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-11 (2.25 seconds). [2025-09-17T06:00:27.090144] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-17T06:00:27.273570] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T06:00:27.280213] [INFO ] [REMOTE ] PVH: Full fetch complete (70573 records). [2025-09-17T06:00:27.280424] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-17T06:00:27.675698] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-17T06:00:27.675824] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-17T06:00:27.676890] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-17T06:00:27.676973] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-17T06:00:27.678451] [DEBUG] [LOCAL ] PVH: Trimmed 70573 records to 50376 (keeping 200 days of data) [2025-09-17T06:00:27.898353] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-17T06:00:28.000448] [DEBUG] [LOCAL ] PVH: Primary data saved (50376 records). [2025-09-17T06:00:28.000622] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-17T06:00:28.000793] [INFO ] [MAIN ] Update Progress: 1753/2369 symbols completed. PVH took 39.6s. Estimated remaining: 1h 30m 5s. Rate: 6.8 symbols/min [2025-09-17T06:00:28.223551] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:00:28.243392] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T06:00:28.270377] [DEBUG] [LOCAL ] QD: Loaded 20498 existing records from primary storage. [2025-09-17T06:00:28.270547] [INFO ] [MAIN ] QD: Loaded 20498 existing records. [2025-09-17T06:00:28.456434] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:00:28.456743] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-17T06:00:28.456821] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-17T06:00:28.457363] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-17T06:00:28.457440] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-17T06:00:28.701262] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-17T06:00:28.831988] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:00:29.036531] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T06:00:29.490133] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-17T06:00:29.868898] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-09-17T06:00:30.290108] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-17T06:00:30.400910] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T06:00:30.965619] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T06:00:31.090162] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-17T06:00:31.890136] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-17T06:00:32.532930] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T06:00:32.690149] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-11. [2025-09-17T06:00:32.944286] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-17T06:00:33.228465] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T06:00:33.234578] [INFO ] [REMOTE ] PWR: Full fetch complete (68818 records). [2025-09-17T06:00:33.234825] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-17T06:00:33.496571] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-17T06:00:33.643592] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-17T06:00:33.643734] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-17T06:00:33.644785] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-17T06:00:33.644850] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-17T06:00:33.646669] [DEBUG] [LOCAL ] PWR: Trimmed 68818 records to 47691 (keeping 200 days of data) [2025-09-17T06:00:33.900171] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T06:00:33.974555] [DEBUG] [LOCAL ] PWR: Primary data saved (47691 records). [2025-09-17T06:00:33.974747] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-17T06:00:33.974868] [INFO ] [MAIN ] Update Progress: 1754/2369 symbols completed. PWR took 32.1s. Estimated remaining: 1h 29m 55s. Rate: 6.8 symbols/min [2025-09-17T06:00:34.144089] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:00:34.184887] [DEBUG] [LOCAL ] QGEN: Loaded 36667 existing records from primary storage. [2025-09-17T06:00:34.185060] [INFO ] [MAIN ] QGEN: Loaded 36667 existing records. [2025-09-17T06:00:34.292453] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-09-17T06:00:34.387722] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:00:34.387967] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-17T06:00:34.388017] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-17T06:00:34.388834] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-17T06:00:34.388917] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-17T06:00:34.758965] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:00:35.090162] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-17T06:00:35.627807] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T06:00:35.738779] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-17T06:00:35.890135] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-17T06:00:36.579492] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T06:00:36.690146] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-17T06:00:37.490127] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-17T06:00:37.744075] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T06:00:38.290179] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-17T06:00:38.604430] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-17T06:00:38.674979] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T06:00:39.090163] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-17T06:00:39.447220] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T06:00:39.890139] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-11. [2025-09-17T06:00:40.447305] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T06:00:40.690134] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-17T06:00:41.490159] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-17T06:00:41.578672] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T06:00:41.939196] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T06:00:41.944402] [INFO ] [REMOTE ] PX: Full fetch complete (51150 records). [2025-09-17T06:00:41.944569] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-17T06:00:42.295253] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-09-17T06:00:42.335351] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-17T06:00:42.335453] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-17T06:00:42.336337] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-17T06:00:42.336407] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-17T06:00:42.338454] [DEBUG] [LOCAL ] PX: Trimmed 51150 records to 34755 (keeping 200 days of data) [2025-09-17T06:00:42.459337] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T06:00:42.584560] [DEBUG] [LOCAL ] PX: Primary data saved (34755 records). [2025-09-17T06:00:42.584777] [INFO ] [MAIN ] PX: Full history saved. [2025-09-17T06:00:42.584890] [INFO ] [MAIN ] Update Progress: 1755/2369 symbols completed. PX took 27.7s. Estimated remaining: 1h 29m 46s. Rate: 6.8 symbols/min [2025-09-17T06:00:42.761926] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:00:42.805489] [DEBUG] [LOCAL ] QS: Loaded 40119 existing records from primary storage. [2025-09-17T06:00:42.805713] [INFO ] [MAIN ] QS: Loaded 40119 existing records. [2025-09-17T06:00:43.007726] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:00:43.007995] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-17T06:00:43.008058] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-17T06:00:43.008885] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-17T06:00:43.008949] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-17T06:00:43.097994] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-17T06:00:43.366487] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:00:43.728948] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T06:00:43.890135] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-17T06:00:44.447617] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T06:00:44.690175] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-11. [2025-09-17T06:00:45.490142] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-09-17T06:00:46.290136] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-17T06:00:46.585745] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-17T06:00:46.888174] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-17T06:00:47.009437] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T06:00:47.080259] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T06:00:47.090085] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-09-17T06:00:47.890126] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-17T06:00:48.690209] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-17T06:00:49.115038] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T06:00:49.497953] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-17T06:00:49.507114] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-17T06:00:50.290218] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-09-17T06:00:50.645816] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T06:00:51.090269] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-17T06:00:51.387331] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.70 seconds). [2025-09-17T06:00:51.890194] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-17T06:00:52.361266] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T06:00:52.667735] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-17T06:00:52.690110] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-17T06:00:53.490193] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-17T06:00:54.290242] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-17T06:00:54.809999] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.92 seconds). [2025-09-17T06:00:54.892443] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-17T06:00:55.090120] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-17T06:00:55.338377] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T06:00:55.609687] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T06:00:55.890132] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-17T06:00:56.690081] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-17T06:00:56.971888] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T06:00:57.167662] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T06:00:57.171298] [INFO ] [REMOTE ] QD: Full fetch complete (40842 records). [2025-09-17T06:00:57.171423] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-17T06:00:57.501873] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-17T06:00:57.570014] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-17T06:00:57.570143] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-17T06:00:57.571182] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-17T06:00:57.571247] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-17T06:00:57.572508] [DEBUG] [LOCAL ] QD: Trimmed 40842 records to 27951 (keeping 200 days of data) [2025-09-17T06:00:57.735277] [DEBUG] [LOCAL ] QD: Primary data saved (27951 records). [2025-09-17T06:00:57.735464] [INFO ] [MAIN ] QD: Full history saved. [2025-09-17T06:00:57.735603] [INFO ] [MAIN ] Update Progress: 1756/2369 symbols completed. QD took 29.7s. Estimated remaining: 1h 29m 40s. Rate: 6.8 symbols/min [2025-09-17T06:00:57.908516] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:00:57.946507] [DEBUG] [LOCAL ] QSR: Loaded 39075 existing records from primary storage. [2025-09-17T06:00:57.946705] [INFO ] [MAIN ] QSR: Loaded 39075 existing records. [2025-09-17T06:00:58.130302] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:00:58.130571] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-17T06:00:58.130634] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-17T06:00:58.131514] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-17T06:00:58.131580] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-17T06:00:58.305478] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-17T06:00:58.499805] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:00:58.532061] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T06:00:59.090144] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-17T06:00:59.890165] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-11. [2025-09-17T06:01:00.217119] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-17T06:01:00.638308] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-17T06:01:00.690093] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-17T06:01:00.722139] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T06:01:01.490177] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-17T06:01:01.616356] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T06:01:02.290190] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-17T06:01:02.881542] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T06:01:03.090191] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-17T06:01:03.890177] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-09-17T06:01:04.021092] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T06:01:04.323778] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-17T06:01:04.690179] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-17T06:01:05.361247] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-17T06:01:05.490173] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-17T06:01:05.663922] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T06:01:06.290181] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-17T06:01:06.489104] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T06:01:07.090229] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-09-17T06:01:07.890159] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-17T06:01:08.272580] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-17T06:01:08.615003] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-17T06:01:08.622311] [INFO ] [REMOTE ] QBTS: Full fetch complete (77922 records). [2025-09-17T06:01:08.622596] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-17T06:01:08.701232] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-17T06:01:09.119972] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T06:01:09.118093] [DEBUG] [VALIDATOR ] QBTS: All expected trading days are present. [2025-09-17T06:01:09.120178] [DEBUG] [VALIDATOR ] QBTS: Primary data validation passed. [2025-09-17T06:01:09.131881] [INFO ] [MAIN ] QBTS: Fetched primary data is valid. [2025-09-17T06:01:09.132760] [DEBUG] [LOCAL ] QBTS: Saving primary data. [2025-09-17T06:01:09.134264] [DEBUG] [LOCAL ] QBTS: Trimmed 77922 records to 53743 (keeping 200 days of data) [2025-09-17T06:01:09.474118] [DEBUG] [LOCAL ] QBTS: Primary data saved (53743 records). [2025-09-17T06:01:09.474307] [INFO ] [MAIN ] QBTS: Full history saved. [2025-09-17T06:01:09.474430] [INFO ] [MAIN ] Update Progress: 1757/2369 symbols completed. QBTS took 47.4s. Estimated remaining: 1h 29m 32s. Rate: 6.8 symbols/min [2025-09-17T06:01:09.490102] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-17T06:01:09.625739] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T06:01:10.290185] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-17T06:01:11.205769] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T06:01:11.217407] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-17T06:01:11.322927] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.62 seconds). [2025-09-17T06:01:11.890248] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-17T06:01:12.038930] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T06:01:12.044953] [INFO ] [REMOTE ] QGEN: Full fetch complete (69790 records). [2025-09-17T06:01:12.045098] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-17T06:01:12.457683] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-17T06:01:12.457865] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-17T06:01:12.458916] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-17T06:01:12.458977] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-17T06:01:12.462500] [DEBUG] [LOCAL ] QGEN: Trimmed 69790 records to 49187 (keeping 200 days of data) [2025-09-17T06:01:12.767180] [DEBUG] [LOCAL ] QGEN: Primary data saved (49187 records). [2025-09-17T06:01:12.767341] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-17T06:01:12.767449] [INFO ] [MAIN ] Update Progress: 1758/2369 symbols completed. QGEN took 38.8s. Estimated remaining: 1h 29m 21s. Rate: 6.8 symbols/min [2025-09-17T06:01:13.034628] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T06:01:13.046109] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-17T06:01:14.467251] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-17T06:01:14.474590] [INFO ] [REMOTE ] QS: Full fetch complete (77810 records). [2025-09-17T06:01:14.474764] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-17T06:01:14.892857] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-17T06:01:14.893105] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-17T06:01:14.894358] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-17T06:01:14.894571] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-17T06:01:14.896569] [DEBUG] [LOCAL ] QS: Trimmed 77810 records to 53742 (keeping 200 days of data) [2025-09-17T06:01:15.017824] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T06:01:15.033635] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-17T06:01:15.258401] [DEBUG] [LOCAL ] QS: Primary data saved (53742 records). [2025-09-17T06:01:15.258573] [INFO ] [MAIN ] QS: Full history saved. [2025-09-17T06:01:15.258696] [INFO ] [MAIN ] Update Progress: 1759/2369 symbols completed. QS took 32.7s. Estimated remaining: 1h 29m 10s. Rate: 6.8 symbols/min [2025-09-17T06:01:16.774281] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T06:01:16.786202] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-17T06:01:18.440419] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T06:01:18.451691] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-17T06:01:20.167267] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T06:01:20.179046] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-17T06:01:21.998183] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T06:01:22.013552] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-17T06:01:23.673599] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T06:01:23.680190] [INFO ] [REMOTE ] QSR: Full fetch complete (75667 records). [2025-09-17T06:01:23.680346] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-17T06:01:24.077275] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-17T06:01:24.077417] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-17T06:01:24.078546] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-17T06:01:24.078609] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-17T06:01:24.080305] [DEBUG] [LOCAL ] QSR: Trimmed 75667 records to 52412 (keeping 200 days of data) [2025-09-17T06:01:24.411680] [DEBUG] [LOCAL ] QSR: Primary data saved (52412 records). [2025-09-17T06:01:24.411838] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-17T06:01:24.411932] [INFO ] [MAIN ] Update Progress: 1760/2369 symbols completed. QSR took 26.7s. Estimated remaining: 1h 29m 2s. Rate: 6.8 symbols/min [2025-09-17T06:01:25.103889] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:01:25.081932] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:01:25.081151] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:01:25.017790] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:01:25.113238] [DEBUG] [LOCAL ] QVCD: Loaded 3381 existing records from primary storage. [2025-09-17T06:01:25.113520] [INFO ] [MAIN ] QVCD: Loaded 3381 existing records. [2025-09-17T06:01:25.162472] [DEBUG] [LOCAL ] QVCC: Loaded 6522 existing records from primary storage. [2025-09-17T06:01:25.181880] [INFO ] [MAIN ] QVCC: Loaded 6522 existing records. [2025-09-17T06:01:25.315372] [DEBUG] [LOCAL ] QUAD: Loaded 17753 existing records from primary storage. [2025-09-17T06:01:25.292893] [DEBUG] [LOCAL ] QTWO: Loaded 28169 existing records from primary storage. [2025-09-17T06:01:25.336458] [INFO ] [MAIN ] QUAD: Loaded 17753 existing records. [2025-09-17T06:01:25.383875] [INFO ] [MAIN ] QTWO: Loaded 28169 existing records. [2025-09-17T06:01:25.641169] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:01:25.697199] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-17T06:01:25.760675] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:01:25.717954] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-17T06:01:25.819754] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-17T06:01:25.830210] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-17T06:01:25.851297] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-17T06:01:25.891347] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-17T06:01:25.883144] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:01:25.854163] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-17T06:01:25.891612] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-17T06:01:25.891969] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-17T06:01:25.959356] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-17T06:01:26.028995] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-17T06:01:25.994259] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:01:26.039439] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-17T06:01:26.073466] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-17T06:01:26.115000] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-17T06:01:26.210057] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-17T06:01:26.225840] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-17T06:01:27.091444] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:01:27.162221] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-11. [2025-09-17T06:01:27.227429] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:01:27.240422] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-11. [2025-09-17T06:01:27.288447] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:01:27.329944] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-11. [2025-09-17T06:01:27.422997] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:01:27.423343] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-11. [2025-09-17T06:01:27.783324] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T06:01:27.784716] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-09-17T06:01:28.062185] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T06:01:28.064432] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-09-17T06:01:28.520311] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T06:01:28.526207] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-09-17T06:01:28.545364] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T06:01:28.547080] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-09-17T06:01:28.800664] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T06:01:28.803569] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-09-17T06:01:28.829969] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T06:01:28.838374] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-09-17T06:01:28.929889] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T06:01:28.931270] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-17T06:01:29.224451] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-17T06:01:29.225706] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-17T06:01:29.388625] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T06:01:29.394620] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-09-17T06:01:29.444415] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T06:01:29.446258] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-17T06:01:29.725983] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T06:01:29.727813] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-17T06:01:29.993256] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T06:01:29.994866] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-17T06:01:30.026214] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T06:01:30.046368] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T06:01:30.293030] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-17T06:01:30.294459] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T06:01:30.467839] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T06:01:31.090127] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-17T06:01:31.396966] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T06:01:31.803635] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T06:01:31.890130] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-09-17T06:01:32.690172] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-17T06:01:33.490145] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-17T06:01:33.551216] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T06:01:33.919148] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T06:01:34.142480] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T06:01:34.290133] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-17T06:01:34.690880] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T06:01:35.090177] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-17T06:01:35.890139] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-17T06:01:36.242360] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T06:01:36.690137] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-17T06:01:37.376338] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T06:01:37.444258] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T06:01:37.490136] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-17T06:01:38.290156] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-17T06:01:38.771380] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T06:01:39.090146] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-17T06:01:39.804811] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T06:01:39.890123] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-17T06:01:39.929015] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T06:01:40.690140] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-17T06:01:41.264608] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T06:01:41.434794] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T06:01:41.490130] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-17T06:01:42.290134] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-17T06:01:42.981763] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T06:01:43.006036] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T06:01:43.090104] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-17T06:01:43.890159] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-17T06:01:44.423283] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T06:01:44.520693] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T06:01:44.522166] [INFO ] [REMOTE ] QVCD: Full fetch complete (6202 records). [2025-09-17T06:01:44.524895] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-17T06:01:44.692002] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-17T06:01:44.904941] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-17T06:01:44.905049] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-17T06:01:44.905248] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-17T06:01:44.905331] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-17T06:01:44.905779] [DEBUG] [LOCAL ] QVCD: Trimmed 6202 records to 4664 (keeping 200 days of data) [2025-09-17T06:01:44.935551] [DEBUG] [LOCAL ] QVCD: Primary data saved (4664 records). [2025-09-17T06:01:44.935743] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-17T06:01:44.935842] [INFO ] [MAIN ] Update Progress: 1761/2369 symbols completed. QVCD took 20.5s. Estimated remaining: 1h 28m 57s. Rate: 6.8 symbols/min [2025-09-17T06:01:45.107901] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:01:45.151924] [DEBUG] [LOCAL ] QXO: Loaded 39903 existing records from primary storage. [2025-09-17T06:01:45.152111] [INFO ] [MAIN ] QXO: Loaded 39903 existing records. [2025-09-17T06:01:45.332829] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:01:45.333118] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-17T06:01:45.333201] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-17T06:01:45.334249] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-17T06:01:45.334339] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-17T06:01:45.493283] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-17T06:01:45.636125] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T06:01:45.719712] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:01:46.290170] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-17T06:01:46.556434] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T06:01:47.090203] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-17T06:01:47.671281] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T06:01:47.890128] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-17T06:01:48.086145] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T06:01:48.690152] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-17T06:01:49.268565] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T06:01:49.427463] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T06:01:49.490115] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-17T06:01:50.265990] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T06:01:50.267812] [INFO ] [REMOTE ] QVCC: Full fetch complete (11965 records). [2025-09-17T06:01:50.267924] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-17T06:01:50.298496] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-17T06:01:50.647128] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-17T06:01:50.647272] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-17T06:01:50.647615] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-17T06:01:50.647694] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-17T06:01:50.648270] [DEBUG] [LOCAL ] QVCC: Trimmed 11965 records to 9092 (keeping 200 days of data) [2025-09-17T06:01:50.707466] [DEBUG] [LOCAL ] QVCC: Primary data saved (9092 records). [2025-09-17T06:01:50.707632] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-17T06:01:50.707955] [INFO ] [MAIN ] Update Progress: 1762/2369 symbols completed. QVCC took 26.3s. Estimated remaining: 1h 28m 47s. Rate: 6.8 symbols/min [2025-09-17T06:01:50.884157] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:01:50.905594] [DEBUG] [LOCAL ] R: Loaded 20314 existing records from primary storage. [2025-09-17T06:01:50.905806] [INFO ] [MAIN ] R: Loaded 20314 existing records. [2025-09-17T06:01:51.087610] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:01:51.087916] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-17T06:01:51.087976] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-17T06:01:51.088688] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-17T06:01:51.088754] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-17T06:01:51.099798] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-11. [2025-09-17T06:01:51.476228] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:01:51.640138] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T06:01:51.890154] [INFO ] [REMOTE ] R: Fetching primary data for 2024-11. [2025-09-17T06:01:52.690146] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-17T06:01:52.861064] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T06:01:52.952162] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T06:01:53.490189] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-09-17T06:01:54.232845] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T06:01:54.239234] [INFO ] [REMOTE ] QTWO: Full fetch complete (56719 records). [2025-09-17T06:01:54.239447] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-17T06:01:54.295850] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-17T06:01:54.643138] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-17T06:01:54.643275] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-17T06:01:54.644505] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-17T06:01:54.644567] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-17T06:01:54.646387] [DEBUG] [LOCAL ] QTWO: Trimmed 56719 records to 38982 (keeping 200 days of data) [2025-09-17T06:01:54.789502] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T06:01:54.904929] [DEBUG] [LOCAL ] QTWO: Primary data saved (38982 records). [2025-09-17T06:01:54.905097] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-17T06:01:54.905196] [INFO ] [MAIN ] Update Progress: 1763/2369 symbols completed. QTWO took 30.5s. Estimated remaining: 1h 28m 37s. Rate: 6.8 symbols/min [2025-09-17T06:01:55.078052] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:01:55.094280] [DEBUG] [LOCAL ] RA: Loaded 15866 existing records from primary storage. [2025-09-17T06:01:55.094016] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-09-17T06:01:55.095261] [INFO ] [MAIN ] RA: Loaded 15866 existing records. [2025-09-17T06:01:55.274143] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:01:55.274413] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-17T06:01:55.274479] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-17T06:01:55.275045] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-17T06:01:55.275105] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-17T06:01:55.638233] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T06:01:55.641566] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:01:55.644730] [INFO ] [REMOTE ] QUAD: Full fetch complete (35120 records). [2025-09-17T06:01:55.644876] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-17T06:01:55.895277] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-09-17T06:01:56.017857] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-17T06:01:56.017964] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-17T06:01:56.018687] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-17T06:01:56.018743] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-17T06:01:56.019580] [DEBUG] [LOCAL ] QUAD: Trimmed 35120 records to 24268 (keeping 200 days of data) [2025-09-17T06:01:56.164868] [DEBUG] [LOCAL ] QUAD: Primary data saved (24268 records). [2025-09-17T06:01:56.165037] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-17T06:01:56.165139] [INFO ] [MAIN ] Update Progress: 1764/2369 symbols completed. QUAD took 31.8s. Estimated remaining: 1h 28m 26s. Rate: 6.8 symbols/min [2025-09-17T06:01:56.332079] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:01:56.354407] [DEBUG] [LOCAL ] RACE: Loaded 22749 existing records from primary storage. [2025-09-17T06:01:56.354573] [INFO ] [MAIN ] RACE: Loaded 22749 existing records. [2025-09-17T06:01:56.535411] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:01:56.535698] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-17T06:01:56.535879] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-17T06:01:56.536616] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-17T06:01:56.536706] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-17T06:01:56.656427] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T06:01:56.702115] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-17T06:01:56.919035] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:01:57.490167] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-11. [2025-09-17T06:01:57.522751] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T06:01:58.097290] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T06:01:58.290164] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-17T06:01:59.042614] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T06:01:59.090131] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-09-17T06:01:59.848142] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T06:01:59.890089] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-17T06:02:00.552052] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T06:02:00.690150] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-11. [2025-09-17T06:02:01.081124] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T06:02:01.490147] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-17T06:02:01.865966] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T06:02:02.290199] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-09-17T06:02:03.090186] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-17T06:02:03.284801] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T06:02:03.333704] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T06:02:03.890171] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-17T06:02:04.577710] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T06:02:04.690131] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-17T06:02:05.490334] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-17T06:02:05.749453] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T06:02:05.809403] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T06:02:06.290351] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-17T06:02:06.655471] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T06:02:07.090108] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-17T06:02:07.397521] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T06:02:07.890165] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-17T06:02:08.011049] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T06:02:08.690337] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-17T06:02:09.490168] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-17T06:02:09.806884] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T06:02:09.907470] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T06:02:10.290124] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-17T06:02:10.351973] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T06:02:11.090148] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-17T06:02:11.890160] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-17T06:02:12.074572] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T06:02:12.246448] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T06:02:12.690136] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-17T06:02:13.341349] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T06:02:13.490175] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-17T06:02:14.290144] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-17T06:02:14.494628] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T06:02:14.766775] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T06:02:15.090166] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-17T06:02:15.463804] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T06:02:15.890175] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-17T06:02:16.690113] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-17T06:02:17.035316] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T06:02:17.193812] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-17T06:02:17.490098] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-17T06:02:17.888831] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T06:02:18.290140] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-17T06:02:19.090110] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-17T06:02:19.374533] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T06:02:19.381348] [INFO ] [REMOTE ] QXO: Full fetch complete (75244 records). [2025-09-17T06:02:19.381548] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-17T06:02:19.782132] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T06:02:19.836272] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-17T06:02:19.836704] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-17T06:02:19.838240] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-17T06:02:19.838322] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-17T06:02:19.840595] [DEBUG] [LOCAL ] QXO: Trimmed 75244 records to 53128 (keeping 200 days of data) [2025-09-17T06:02:19.898311] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-17T06:02:20.181938] [DEBUG] [LOCAL ] QXO: Primary data saved (53128 records). [2025-09-17T06:02:20.182128] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-17T06:02:20.182245] [INFO ] [MAIN ] Update Progress: 1765/2369 symbols completed. QXO took 35.2s. Estimated remaining: 1h 28m 22s. Rate: 6.8 symbols/min [2025-09-17T06:02:20.359913] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:02:20.360140] [DEBUG] [LOCAL ] RAMP: No existing data file found in primary storage. [2025-09-17T06:02:20.360190] [WARN ] [MAIN ] RAMP: No existing data found, performing full refresh instead. [2025-09-17T06:02:20.360298] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-17T06:02:20.360349] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-17T06:02:20.360398] [DEBUG] [LOCAL ] RAMP: No primary data file found to delete. [2025-09-17T06:02:20.360447] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-17T06:02:20.693382] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-17T06:02:20.722727] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:02:20.746039] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T06:02:21.079777] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T06:02:21.490131] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-17T06:02:21.936956] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T06:02:21.940353] [INFO ] [REMOTE ] R: Full fetch complete (41845 records). [2025-09-17T06:02:21.940523] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-17T06:02:22.295687] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-11. [2025-09-17T06:02:22.330443] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-17T06:02:22.330543] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-17T06:02:22.331523] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-17T06:02:22.331706] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-17T06:02:22.332984] [DEBUG] [LOCAL ] R: Trimmed 41845 records to 29854 (keeping 200 days of data) [2025-09-17T06:02:22.453666] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T06:02:22.457722] [INFO ] [REMOTE ] RA: Full fetch complete (31901 records). [2025-09-17T06:02:22.458512] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-17T06:02:22.857777] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-17T06:02:22.860414] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-17T06:02:22.861493] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-17T06:02:22.906452] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-17T06:02:22.910967] [DEBUG] [LOCAL ] RA: Trimmed 31901 records to 21816 (keeping 200 days of data) [2025-09-17T06:02:23.030712] [DEBUG] [LOCAL ] R: Primary data saved (29854 records). [2025-09-17T06:02:23.031689] [INFO ] [MAIN ] R: Full history saved. [2025-09-17T06:02:23.032115] [INFO ] [MAIN ] Update Progress: 1766/2369 symbols completed. R took 32.3s. Estimated remaining: 1h 28m 11s. Rate: 6.8 symbols/min [2025-09-17T06:02:23.101226] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-17T06:02:23.227715] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:02:23.269071] [DEBUG] [LOCAL ] RA: Primary data saved (21816 records). [2025-09-17T06:02:23.269236] [INFO ] [MAIN ] RA: Full history saved. [2025-09-17T06:02:23.269370] [INFO ] [MAIN ] Update Progress: 1767/2369 symbols completed. RA took 28.4s. Estimated remaining: 1h 27m 59s. Rate: 6.8 symbols/min [2025-09-17T06:02:23.381509] [DEBUG] [LOCAL ] RBA: Loaded 34109 existing records from primary storage. [2025-09-17T06:02:23.387310] [INFO ] [MAIN ] RBA: Loaded 34109 existing records. [2025-09-17T06:02:23.590570] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:02:23.680835] [DEBUG] [LOCAL ] RBC: Loaded 10908 existing records from primary storage. [2025-09-17T06:02:23.680946] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:02:23.681295] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-17T06:02:23.681376] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-17T06:02:23.681436] [INFO ] [MAIN ] RBC: Loaded 10908 existing records. [2025-09-17T06:02:23.686899] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-17T06:02:23.686983] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-17T06:02:23.992508] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:02:24.077001] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-17T06:02:24.140190] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-17T06:02:24.173681] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T06:02:24.189265] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-17T06:02:24.218909] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-09-17T06:02:24.219020] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-17T06:02:24.436108] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:02:24.675863] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:02:24.690074] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-11. [2025-09-17T06:02:24.874861] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T06:02:25.367930] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T06:02:25.441280] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T06:02:25.490147] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-09-17T06:02:26.285240] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T06:02:26.290140] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-09-17T06:02:27.090145] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-11. [2025-09-17T06:02:27.209107] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T06:02:27.890193] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-09-17T06:02:28.570710] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T06:02:28.690149] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-17T06:02:29.305275] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T06:02:29.490151] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-17T06:02:29.654951] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T06:02:30.290182] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-17T06:02:30.856956] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T06:02:31.090133] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-09-17T06:02:31.163148] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T06:02:31.890151] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-17T06:02:32.592164] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T06:02:32.690122] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-17T06:02:32.944936] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T06:02:33.490149] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-17T06:02:34.290156] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-17T06:02:34.409929] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T06:02:34.946801] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T06:02:35.090151] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-17T06:02:35.768253] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T06:02:35.890148] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-17T06:02:36.627338] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T06:02:36.690200] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-17T06:02:36.976612] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T06:02:37.490143] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-17T06:02:37.714458] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T06:02:38.290143] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-17T06:02:38.971867] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T06:02:39.090136] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-17T06:02:39.777287] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T06:02:39.890135] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-17T06:02:40.059293] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T06:02:40.690141] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-17T06:02:41.426152] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T06:02:41.490162] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-17T06:02:42.153968] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T06:02:42.290155] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-17T06:02:42.405090] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T06:02:43.090147] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-17T06:02:43.875966] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T06:02:43.890100] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-17T06:02:44.587814] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T06:02:44.690139] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-17T06:02:45.490139] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-17T06:02:45.538597] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T06:02:45.768084] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T06:02:46.290154] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-17T06:02:46.432895] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T06:02:47.090203] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-17T06:02:47.450516] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T06:02:47.890384] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-17T06:02:48.205144] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T06:02:48.209754] [INFO ] [REMOTE ] RACE: Full fetch complete (47410 records). [2025-09-17T06:02:48.209903] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-17T06:02:48.592882] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-17T06:02:48.593006] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-17T06:02:48.594056] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-17T06:02:48.594143] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-17T06:02:48.595382] [DEBUG] [LOCAL ] RACE: Trimmed 47410 records to 33210 (keeping 200 days of data) [2025-09-17T06:02:48.691353] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-17T06:02:48.819476] [DEBUG] [LOCAL ] RACE: Primary data saved (33210 records). [2025-09-17T06:02:48.819711] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-17T06:02:48.819873] [INFO ] [MAIN ] Update Progress: 1768/2369 symbols completed. RACE took 52.7s. Estimated remaining: 1h 27m 56s. Rate: 6.8 symbols/min [2025-09-17T06:02:48.991918] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:02:49.033143] [DEBUG] [LOCAL ] RBLX: Loaded 40082 existing records from primary storage. [2025-09-17T06:02:49.033320] [INFO ] [MAIN ] RBLX: Loaded 40082 existing records. [2025-09-17T06:02:49.212253] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:02:49.212621] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-17T06:02:49.212816] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-17T06:02:49.219726] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-17T06:02:49.230696] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-17T06:02:49.238189] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T06:02:49.495243] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-17T06:02:49.606635] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:02:49.642566] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T06:02:49.644787] [INFO ] [REMOTE ] RBC: Full fetch complete (21988 records). [2025-09-17T06:02:49.644881] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-17T06:02:50.013218] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-17T06:02:50.013332] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-17T06:02:50.013903] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-17T06:02:50.013961] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-17T06:02:50.014852] [DEBUG] [LOCAL ] RBC: Trimmed 21988 records to 14994 (keeping 200 days of data) [2025-09-17T06:02:50.109678] [DEBUG] [LOCAL ] RBC: Primary data saved (14994 records). [2025-09-17T06:02:50.109855] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-17T06:02:50.109988] [INFO ] [MAIN ] Update Progress: 1769/2369 symbols completed. RBC took 26.8s. Estimated remaining: 1h 27m 45s. Rate: 6.8 symbols/min [2025-09-17T06:02:50.276357] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:02:50.282155] [DEBUG] [LOCAL ] RBOT: Loaded 3831 existing records from primary storage. [2025-09-17T06:02:50.282269] [INFO ] [MAIN ] RBOT: Loaded 3831 existing records. [2025-09-17T06:02:50.295233] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-11. [2025-09-17T06:02:50.460857] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:02:50.461099] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-17T06:02:50.461170] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-17T06:02:50.461438] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-17T06:02:50.461494] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-17T06:02:50.829227] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:02:51.090366] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-17T06:02:51.146307] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T06:02:51.890161] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-11. [2025-09-17T06:02:52.508820] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-17T06:02:52.624933] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T06:02:52.635284] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T06:02:52.690107] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-17T06:02:53.490147] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-09-17T06:02:54.033874] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T06:02:54.038656] [INFO ] [REMOTE ] RAMP: Full fetch complete (52902 records). [2025-09-17T06:02:54.038765] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-17T06:02:54.295274] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-09-17T06:02:54.428216] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-17T06:02:54.428334] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-17T06:02:54.429818] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-17T06:02:54.429878] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-17T06:02:54.431210] [DEBUG] [LOCAL ] RAMP: Trimmed 52902 records to 37720 (keeping 200 days of data) [2025-09-17T06:02:54.659196] [DEBUG] [LOCAL ] RAMP: Primary data saved (37720 records). [2025-09-17T06:02:54.659375] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-17T06:02:54.659490] [INFO ] [MAIN ] Update Progress: 1770/2369 symbols completed. RAMP took 34.5s. Estimated remaining: 1h 27m 35s. Rate: 6.8 symbols/min [2025-09-17T06:02:54.829873] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:02:54.869499] [DEBUG] [LOCAL ] RBRK: Loaded 39640 existing records from primary storage. [2025-09-17T06:02:54.869689] [INFO ] [MAIN ] RBRK: Loaded 39640 existing records. [2025-09-17T06:02:55.049251] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:02:55.049574] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-17T06:02:55.049632] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-17T06:02:55.050888] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-17T06:02:55.050951] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-17T06:02:55.115915] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-17T06:02:55.362634] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T06:02:55.433669] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:02:55.834919] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-17T06:02:55.890162] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-09-17T06:02:56.647913] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T06:02:56.678320] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T06:02:56.690066] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-17T06:02:57.490169] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-11. [2025-09-17T06:02:58.231253] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T06:02:58.290150] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-17T06:02:59.079125] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T06:02:59.090075] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-09-17T06:02:59.819843] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T06:02:59.827442] [INFO ] [REMOTE ] RBA: Full fetch complete (65160 records). [2025-09-17T06:02:59.827620] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-17T06:02:59.895229] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-09-17T06:03:00.233620] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-17T06:03:00.233758] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-17T06:03:00.234845] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-17T06:03:00.234941] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-17T06:03:00.237153] [DEBUG] [LOCAL ] RBA: Trimmed 65160 records to 46158 (keeping 200 days of data) [2025-09-17T06:03:00.538980] [DEBUG] [LOCAL ] RBA: Primary data saved (46158 records). [2025-09-17T06:03:00.539163] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-17T06:03:00.539340] [INFO ] [MAIN ] Update Progress: 1771/2369 symbols completed. RBA took 37.5s. Estimated remaining: 1h 27m 25s. Rate: 6.8 symbols/min [2025-09-17T06:03:00.695216] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-17T06:03:00.715480] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:03:00.752902] [DEBUG] [LOCAL ] RC: Loaded 36064 existing records from primary storage. [2025-09-17T06:03:00.753066] [INFO ] [MAIN ] RC: Loaded 36064 existing records. [2025-09-17T06:03:00.930031] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:03:00.930337] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-17T06:03:00.930404] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-17T06:03:00.931188] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-17T06:03:00.931260] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-17T06:03:01.291344] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:03:01.296588] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T06:03:01.329570] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-17T06:03:01.490122] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-17T06:03:02.290241] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-11. [2025-09-17T06:03:02.354563] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.46 seconds). [2025-09-17T06:03:03.090150] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-09-17T06:03:03.890188] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-17T06:03:04.985539] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-11 (2.70 seconds). [2025-09-17T06:03:04.995009] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-09-17T06:03:05.042535] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (3.55 seconds). [2025-09-17T06:03:05.066656] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T06:03:05.490189] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-17T06:03:06.034341] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (2.94 seconds). [2025-09-17T06:03:06.290132] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-17T06:03:06.454585] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T06:03:07.090153] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-17T06:03:07.372996] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T06:03:07.694143] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T06:03:07.890185] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-09-17T06:03:07.969312] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T06:03:08.690226] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-17T06:03:09.256943] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T06:03:09.490138] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-17T06:03:09.565766] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T06:03:09.965876] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T06:03:10.290185] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-17T06:03:10.983900] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T06:03:11.090189] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-17T06:03:11.890153] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-17T06:03:12.690165] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-17T06:03:13.102996] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T06:03:13.490150] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-17T06:03:14.159113] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-17T06:03:14.206003] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T06:03:14.290165] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-17T06:03:15.090166] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-17T06:03:15.369358] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T06:03:15.599448] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T06:03:15.890141] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-17T06:03:16.690159] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-17T06:03:17.490167] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-17T06:03:18.147914] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (3.06 seconds). [2025-09-17T06:03:18.290307] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-17T06:03:18.387608] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T06:03:18.563531] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-17T06:03:19.090142] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-17T06:03:19.752067] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T06:03:19.753558] [INFO ] [REMOTE ] RBOT: Full fetch complete (8744 records). [2025-09-17T06:03:19.753784] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-17T06:03:19.896238] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-17T06:03:20.120309] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-17T06:03:20.120431] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-17T06:03:20.120708] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-17T06:03:20.120763] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-17T06:03:20.121213] [DEBUG] [LOCAL ] RBOT: Trimmed 8744 records to 5058 (keeping 200 days of data) [2025-09-17T06:03:20.152559] [DEBUG] [LOCAL ] RBOT: Primary data saved (5058 records). [2025-09-17T06:03:20.152788] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-17T06:03:20.152949] [INFO ] [MAIN ] Update Progress: 1772/2369 symbols completed. RBOT took 30.0s. Estimated remaining: 1h 27m 20s. Rate: 6.8 symbols/min [2025-09-17T06:03:20.345912] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:03:20.346233] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-17T06:03:20.346318] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-17T06:03:20.346459] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-17T06:03:20.346619] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-17T06:03:20.346701] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-17T06:03:20.346805] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-17T06:03:20.660453] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (3.17 seconds). [2025-09-17T06:03:20.751521] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:03:20.752021] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-17T06:03:20.784675] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-17T06:03:21.463602] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T06:03:21.490089] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-17T06:03:22.290160] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-17T06:03:22.790650] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T06:03:23.080197] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T06:03:23.090135] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-11. [2025-09-17T06:03:23.341915] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-11 (0.25 seconds). [2025-09-17T06:03:23.890140] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-17T06:03:24.648986] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-17T06:03:24.690190] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-17T06:03:25.490156] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-17T06:03:26.019728] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T06:03:26.088097] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T06:03:26.290122] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-17T06:03:27.090165] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-17T06:03:27.519146] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T06:03:27.890093] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-17T06:03:28.005522] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-17T06:03:28.152445] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T06:03:28.328431] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T06:03:28.690139] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-17T06:03:29.490186] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-17T06:03:30.290174] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-17T06:03:30.784311] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-17T06:03:30.791406] [INFO ] [REMOTE ] RBRK: Full fetch complete (76158 records). [2025-09-17T06:03:30.791607] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-17T06:03:31.099019] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-17T06:03:31.201270] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-17T06:03:31.201414] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-17T06:03:31.202585] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-17T06:03:31.202687] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-17T06:03:31.204489] [DEBUG] [LOCAL ] RBRK: Trimmed 76158 records to 53056 (keeping 200 days of data) [2025-09-17T06:03:31.537946] [DEBUG] [LOCAL ] RBRK: Primary data saved (53056 records). [2025-09-17T06:03:31.538124] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-17T06:03:31.538249] [INFO ] [MAIN ] Update Progress: 1773/2369 symbols completed. RBRK took 36.9s. Estimated remaining: 1h 27m 12s. Rate: 6.8 symbols/min [2025-09-17T06:03:31.708312] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:03:31.712604] [DEBUG] [LOCAL ] RCD: Loaded 2583 existing records from primary storage. [2025-09-17T06:03:31.712718] [INFO ] [MAIN ] RCD: Loaded 2583 existing records. [2025-09-17T06:03:31.832236] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T06:03:31.902032] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-17T06:03:31.905293] [WARN ] [MAIN ] RCD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:03:31.906599] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-17T06:03:31.906705] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-17T06:03:31.907174] [DEBUG] [LOCAL ] RCD: Deleted primary data file. [2025-09-17T06:03:31.907293] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-17T06:03:32.044379] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.55 seconds). [2025-09-17T06:03:32.185916] [INFO ] [REMOTE ] RBLX: Full fetch complete (77702 records). [2025-09-17T06:03:32.209087] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-17T06:03:32.420346] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:03:32.436451] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T06:03:32.577979] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T06:03:32.690402] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-17T06:03:32.844131] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-17T06:03:32.844246] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-17T06:03:32.845540] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-17T06:03:32.845608] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-17T06:03:32.847159] [DEBUG] [LOCAL ] RBLX: Trimmed 77702 records to 53722 (keeping 200 days of data) [2025-09-17T06:03:33.088281] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-17T06:03:33.215496] [DEBUG] [LOCAL ] RBLX: Primary data saved (53722 records). [2025-09-17T06:03:33.215694] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-17T06:03:33.215791] [INFO ] [MAIN ] Update Progress: 1774/2369 symbols completed. RBLX took 44.4s. Estimated remaining: 1h 27m 1s. Rate: 6.8 symbols/min [2025-09-17T06:03:33.387017] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:03:33.426125] [DEBUG] [LOCAL ] RCI: Loaded 36083 existing records from primary storage. [2025-09-17T06:03:33.426297] [INFO ] [MAIN ] RCI: Loaded 36083 existing records. [2025-09-17T06:03:33.495306] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-11. [2025-09-17T06:03:33.615247] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:03:33.615556] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-17T06:03:33.615616] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-17T06:03:33.616902] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-17T06:03:33.616965] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-17T06:03:33.766856] [DEBUG] [REMOTE ] RCD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:03:33.782700] [WARN ] [REMOTE ] RCD: No data returned for month 2024-11 [2025-09-17T06:03:33.984282] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:03:34.290151] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-17T06:03:35.090147] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-17T06:03:35.784115] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T06:03:35.818415] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T06:03:35.890146] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-17T06:03:36.690139] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-11. [2025-09-17T06:03:37.490200] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-17T06:03:37.555423] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T06:03:37.562876] [INFO ] [REMOTE ] RC: Full fetch complete (70582 records). [2025-09-17T06:03:37.563217] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-17T06:03:37.971020] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-17T06:03:37.971169] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-17T06:03:37.972903] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-17T06:03:37.972970] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-17T06:03:37.974935] [DEBUG] [LOCAL ] RC: Trimmed 70582 records to 49154 (keeping 200 days of data) [2025-09-17T06:03:38.208057] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T06:03:38.295045] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-17T06:03:38.342719] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T06:03:38.360440] [DEBUG] [LOCAL ] RC: Primary data saved (49154 records). [2025-09-17T06:03:38.360699] [INFO ] [MAIN ] RC: Full history saved. [2025-09-17T06:03:38.360849] [INFO ] [MAIN ] Update Progress: 1775/2369 symbols completed. RC took 37.8s. Estimated remaining: 1h 26m 51s. Rate: 6.8 symbols/min [2025-09-17T06:03:38.543017] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:03:38.590614] [DEBUG] [LOCAL ] RCL: Loaded 38736 existing records from primary storage. [2025-09-17T06:03:38.590862] [INFO ] [MAIN ] RCL: Loaded 38736 existing records. [2025-09-17T06:03:38.767639] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T06:03:38.794010] [WARN ] [MAIN ] RCL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:03:38.794477] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-17T06:03:38.794566] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-17T06:03:38.796078] [DEBUG] [LOCAL ] RCL: Deleted primary data file. [2025-09-17T06:03:38.796159] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-17T06:03:39.096967] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-17T06:03:39.183765] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:03:39.653199] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T06:03:39.890157] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-17T06:03:40.618925] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T06:03:40.690156] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-09-17T06:03:41.490267] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-17T06:03:41.887357] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T06:03:42.290247] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-17T06:03:42.401211] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T06:03:42.764312] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T06:03:43.090219] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-09-17T06:03:43.890189] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-17T06:03:44.415106] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T06:03:44.416078] [INFO ] [REMOTE ] RCB: Full fetch complete (3771 records). [2025-09-17T06:03:44.416176] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-17T06:03:44.626678] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T06:03:44.627176] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:03:44.627353] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:03:44.627516] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-17T06:03:44.627664] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-17T06:03:44.627725] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-17T06:03:44.627930] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-17T06:03:44.628028] [INFO ] [MAIN ] Update Progress: 1776/2369 symbols completed. RCB took 24.5s. Estimated remaining: 1h 26m 41s. Rate: 6.8 symbols/min [2025-09-17T06:03:44.695311] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-17T06:03:44.817209] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:03:44.849311] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T06:03:44.868349] [DEBUG] [LOCAL ] RCS: Loaded 8493 existing records from primary storage. [2025-09-17T06:03:44.868591] [INFO ] [MAIN ] RCS: Loaded 8493 existing records. [2025-09-17T06:03:45.054815] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:03:45.055136] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-17T06:03:45.055204] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-17T06:03:45.055686] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-17T06:03:45.055749] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-17T06:03:45.386773] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T06:03:45.473818] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:03:45.490162] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-17T06:03:46.290187] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-11. [2025-09-17T06:03:46.979866] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T06:03:47.090168] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-17T06:03:47.890154] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-17T06:03:48.131661] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T06:03:48.439548] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T06:03:48.708791] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-17T06:03:48.757909] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T06:03:49.490168] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-11. [2025-09-17T06:03:50.290135] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-17T06:03:50.335604] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T06:03:50.652486] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T06:03:51.090185] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-17T06:03:51.890127] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-09-17T06:03:52.016137] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T06:03:52.690179] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-17T06:03:52.831936] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T06:03:53.023175] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T06:03:53.073789] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-17T06:03:53.490157] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-17T06:03:53.896781] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-17T06:03:54.290131] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-17T06:03:55.090162] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-09-17T06:03:55.890126] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-17T06:03:56.100060] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T06:03:56.189927] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T06:03:56.690148] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-17T06:03:57.199307] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T06:03:57.490134] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-17T06:03:57.711033] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T06:03:58.045809] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T06:03:58.290124] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-17T06:03:59.090134] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-17T06:03:59.871869] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T06:03:59.890075] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-17T06:04:00.690165] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-17T06:04:01.234260] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T06:04:01.490148] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-17T06:04:01.509407] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T06:04:01.675541] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T06:04:02.138102] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T06:04:02.139212] [INFO ] [REMOTE ] RCD: Full fetch complete (6629 records). [2025-09-17T06:04:02.139298] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-17T06:04:02.318355] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 184 unique days, need 200 days [2025-09-17T06:04:02.291743] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-17T06:04:02.319403] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:04:02.319464] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:04:02.319511] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-17T06:04:02.319569] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-17T06:04:02.319607] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-17T06:04:02.320007] [DEBUG] [LOCAL ] RCD: Deleted derivative data file. [2025-09-17T06:04:02.320099] [INFO ] [MAIN ] Update Progress: 1777/2369 symbols completed. RCD took 30.8s. Estimated remaining: 1h 26m 36s. Rate: 6.8 symbols/min [2025-09-17T06:04:02.487985] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:04:02.520137] [DEBUG] [LOCAL ] RCUS: Loaded 31661 existing records from primary storage. [2025-09-17T06:04:02.520313] [INFO ] [MAIN ] RCUS: Loaded 31661 existing records. [2025-09-17T06:04:02.712569] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:04:02.712947] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-17T06:04:02.713031] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-17T06:04:02.713871] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-17T06:04:02.713945] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-17T06:04:03.087147] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:04:03.090083] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-11. [2025-09-17T06:04:03.890124] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-17T06:04:04.414301] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T06:04:04.623288] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T06:04:04.690091] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-09-17T06:04:05.292259] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T06:04:05.490201] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-17T06:04:06.176941] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T06:04:06.290150] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-17T06:04:06.441764] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T06:04:07.090142] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-17T06:04:07.630403] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T06:04:07.886618] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T06:04:07.890077] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-17T06:04:08.690219] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-17T06:04:08.865087] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T06:04:09.490182] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-17T06:04:10.290165] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-17T06:04:10.710301] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T06:04:10.936258] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T06:04:11.090132] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-17T06:04:11.524938] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T06:04:11.531054] [INFO ] [REMOTE ] RCI: Full fetch complete (70406 records). [2025-09-17T06:04:11.531255] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-17T06:04:11.892863] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-17T06:04:11.949313] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-17T06:04:11.949420] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-17T06:04:11.950442] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-17T06:04:11.950512] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-17T06:04:11.952340] [DEBUG] [LOCAL ] RCI: Trimmed 70406 records to 48841 (keeping 200 days of data) [2025-09-17T06:04:12.267329] [DEBUG] [LOCAL ] RCI: Primary data saved (48841 records). [2025-09-17T06:04:12.267510] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-17T06:04:12.267611] [INFO ] [MAIN ] Update Progress: 1778/2369 symbols completed. RCI took 39.1s. Estimated remaining: 1h 26m 27s. Rate: 6.8 symbols/min [2025-09-17T06:04:12.442327] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:04:12.489779] [DEBUG] [LOCAL ] RDDT: Loaded 40138 existing records from primary storage. [2025-09-17T06:04:12.490007] [INFO ] [MAIN ] RDDT: Loaded 40138 existing records. [2025-09-17T06:04:12.676661] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:04:12.677098] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-17T06:04:12.677175] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-17T06:04:12.678290] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-17T06:04:12.678361] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-17T06:04:12.709628] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-17T06:04:12.918358] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T06:04:13.006299] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T06:04:13.088748] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:04:13.490124] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-11. [2025-09-17T06:04:14.290099] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-17T06:04:14.788873] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-17T06:04:15.090717] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-17T06:04:15.092247] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T06:04:15.410846] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T06:04:15.890181] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-09-17T06:04:16.690150] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-17T06:04:17.153043] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T06:04:17.490151] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-17T06:04:17.863620] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T06:04:18.234003] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T06:04:18.290096] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-17T06:04:18.380875] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T06:04:18.382925] [INFO ] [REMOTE ] RCS: Full fetch complete (19143 records). [2025-09-17T06:04:18.383034] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-17T06:04:18.745801] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-17T06:04:18.745928] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-17T06:04:18.746391] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-17T06:04:18.746453] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-17T06:04:18.747082] [DEBUG] [LOCAL ] RCS: Trimmed 19143 records to 11533 (keeping 200 days of data) [2025-09-17T06:04:18.818173] [DEBUG] [LOCAL ] RCS: Primary data saved (11533 records). [2025-09-17T06:04:18.818349] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-17T06:04:18.818450] [INFO ] [MAIN ] Update Progress: 1779/2369 symbols completed. RCS took 34.2s. Estimated remaining: 1h 26m 18s. Rate: 6.8 symbols/min [2025-09-17T06:04:18.985241] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:04:19.018614] [DEBUG] [LOCAL ] RDN: Loaded 32603 existing records from primary storage. [2025-09-17T06:04:19.018806] [INFO ] [MAIN ] RDN: Loaded 32603 existing records. [2025-09-17T06:04:19.095207] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-17T06:04:19.196846] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:04:19.197059] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-17T06:04:19.197116] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-17T06:04:19.198109] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-17T06:04:19.198172] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-17T06:04:19.569348] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:04:19.880086] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T06:04:19.890114] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-17T06:04:20.690197] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-17T06:04:21.109216] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T06:04:21.182704] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T06:04:21.490164] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-17T06:04:22.290199] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-17T06:04:22.975389] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T06:04:23.023673] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (2.33 seconds). [2025-09-17T06:04:23.090126] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-17T06:04:23.806885] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T06:04:23.813691] [INFO ] [REMOTE ] RCL: Full fetch complete (75349 records). [2025-09-17T06:04:23.813899] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-17T06:04:23.895187] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-11. [2025-09-17T06:04:24.207939] [DEBUG] [VALIDATOR ] RCL: All expected trading days are present. [2025-09-17T06:04:24.208081] [DEBUG] [VALIDATOR ] RCL: Primary data validation passed. [2025-09-17T06:04:24.209278] [INFO ] [MAIN ] RCL: Fetched primary data is valid. [2025-09-17T06:04:24.209411] [DEBUG] [LOCAL ] RCL: Saving primary data. [2025-09-17T06:04:24.211005] [DEBUG] [LOCAL ] RCL: Trimmed 75349 records to 52254 (keeping 200 days of data) [2025-09-17T06:04:24.558896] [DEBUG] [LOCAL ] RCL: Primary data saved (52254 records). [2025-09-17T06:04:24.559070] [INFO ] [MAIN ] RCL: Full history saved. [2025-09-17T06:04:24.559195] [INFO ] [MAIN ] Update Progress: 1780/2369 symbols completed. RCL took 46.2s. Estimated remaining: 1h 26m 8s. Rate: 6.8 symbols/min [2025-09-17T06:04:24.702860] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-17T06:04:24.734083] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:04:24.772213] [DEBUG] [LOCAL ] RDW: Loaded 38815 existing records from primary storage. [2025-09-17T06:04:24.772375] [INFO ] [MAIN ] RDW: Loaded 38815 existing records. [2025-09-17T06:04:24.953807] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:04:24.954075] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-17T06:04:24.954135] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-17T06:04:24.955040] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-17T06:04:24.955106] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-17T06:04:25.317541] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:04:25.442281] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T06:04:25.481609] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-17T06:04:25.491476] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-09-17T06:04:26.233130] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T06:04:26.290140] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-17T06:04:26.788150] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T06:04:27.090148] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-09-17T06:04:27.777715] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T06:04:27.783291] [INFO ] [REMOTE ] RCUS: Full fetch complete (60186 records). [2025-09-17T06:04:27.783423] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-17T06:04:27.898910] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-11. [2025-09-17T06:04:28.215998] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-17T06:04:28.216141] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-17T06:04:28.217153] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-17T06:04:28.217231] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-17T06:04:28.219905] [DEBUG] [LOCAL ] RCUS: Trimmed 60186 records to 42981 (keeping 200 days of data) [2025-09-17T06:04:28.478206] [DEBUG] [LOCAL ] RCUS: Primary data saved (42981 records). [2025-09-17T06:04:28.478374] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-17T06:04:28.478495] [INFO ] [MAIN ] Update Progress: 1781/2369 symbols completed. RCUS took 26.2s. Estimated remaining: 1h 25m 58s. Rate: 6.8 symbols/min [2025-09-17T06:04:28.653290] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:04:28.693590] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-17T06:04:28.694363] [DEBUG] [LOCAL ] RDY: Loaded 34693 existing records from primary storage. [2025-09-17T06:04:28.695941] [INFO ] [MAIN ] RDY: Loaded 34693 existing records. [2025-09-17T06:04:28.885081] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:04:28.885687] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-17T06:04:28.885794] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-17T06:04:28.886554] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-17T06:04:28.886622] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-17T06:04:29.078514] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T06:04:29.341247] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:04:29.490163] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-17T06:04:29.647170] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T06:04:30.290132] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-09-17T06:04:30.991842] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T06:04:31.090133] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-17T06:04:31.290916] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-09-17T06:04:31.769440] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T06:04:31.890099] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-09-17T06:04:32.690134] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-11. [2025-09-17T06:04:32.882037] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T06:04:33.490145] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-17T06:04:33.803292] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T06:04:34.231471] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T06:04:34.290185] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-09-17T06:04:35.090109] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-17T06:04:35.186219] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T06:04:35.890130] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-17T06:04:35.940687] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T06:04:36.690130] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-09-17T06:04:37.490094] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-17T06:04:37.535028] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-17T06:04:37.974961] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T06:04:38.290123] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-17T06:04:38.347769] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T06:04:38.775068] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T06:04:39.090129] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-17T06:04:39.890149] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-17T06:04:40.600117] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T06:04:40.690173] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-17T06:04:40.841726] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-17T06:04:41.490256] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-17T06:04:41.492624] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T06:04:42.290098] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-17T06:04:42.327723] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T06:04:43.090156] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-17T06:04:43.610563] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T06:04:43.890191] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-17T06:04:44.598959] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T06:04:44.695289] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-17T06:04:44.714743] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-17T06:04:45.490190] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-17T06:04:45.796306] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T06:04:46.290142] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-17T06:04:46.363957] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T06:04:47.090182] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-17T06:04:47.762286] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T06:04:47.767904] [INFO ] [REMOTE ] RDN: Full fetch complete (65245 records). [2025-09-17T06:04:47.768107] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-17T06:04:47.897591] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-17T06:04:48.181852] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-17T06:04:48.182090] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-17T06:04:48.183233] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-17T06:04:48.183354] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-17T06:04:48.185402] [DEBUG] [LOCAL ] RDN: Trimmed 65245 records to 45192 (keeping 200 days of data) [2025-09-17T06:04:48.285977] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (2.80 seconds). [2025-09-17T06:04:48.378200] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T06:04:48.577596] [DEBUG] [LOCAL ] RDN: Primary data saved (45192 records). [2025-09-17T06:04:48.577793] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-17T06:04:48.577915] [INFO ] [MAIN ] Update Progress: 1782/2369 symbols completed. RDN took 29.8s. Estimated remaining: 1h 25m 52s. Rate: 6.8 symbols/min [2025-09-17T06:04:48.695419] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-17T06:04:48.765883] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:04:48.806357] [DEBUG] [LOCAL ] RELX: Loaded 36011 existing records from primary storage. [2025-09-17T06:04:48.806604] [INFO ] [MAIN ] RELX: Loaded 36011 existing records. [2025-09-17T06:04:49.002527] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:04:49.002833] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-17T06:04:49.002914] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-17T06:04:49.003945] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-17T06:04:49.004028] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-17T06:04:49.359354] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:04:49.490148] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-11. [2025-09-17T06:04:49.694153] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T06:04:50.290159] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-17T06:04:50.371974] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T06:04:51.090149] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-17T06:04:51.197221] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T06:04:51.890137] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-09-17T06:04:52.655058] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T06:04:52.690177] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-17T06:04:52.882850] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-17T06:04:53.349530] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T06:04:53.490157] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-17T06:04:53.902219] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T06:04:54.290128] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-17T06:04:55.090186] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-09-17T06:04:55.890208] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-17T06:04:55.926489] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T06:04:56.014761] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-17T06:04:56.021676] [INFO ] [REMOTE ] RDDT: Full fetch complete (77832 records). [2025-09-17T06:04:56.021889] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-17T06:04:56.448316] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-17T06:04:56.448493] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-17T06:04:56.450392] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-17T06:04:56.450540] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-17T06:04:56.477417] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T06:04:56.477628] [DEBUG] [LOCAL ] RDDT: Trimmed 77832 records to 53784 (keeping 200 days of data) [2025-09-17T06:04:56.698183] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-17T06:04:56.856687] [DEBUG] [LOCAL ] RDDT: Primary data saved (53784 records). [2025-09-17T06:04:56.856863] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-17T06:04:56.856997] [INFO ] [MAIN ] Update Progress: 1783/2369 symbols completed. RDDT took 44.6s. Estimated remaining: 1h 25m 44s. Rate: 6.8 symbols/min [2025-09-17T06:04:57.031307] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:04:57.063322] [DEBUG] [LOCAL ] RERE: Loaded 30764 existing records from primary storage. [2025-09-17T06:04:57.063502] [INFO ] [MAIN ] RERE: Loaded 30764 existing records. [2025-09-17T06:04:57.253597] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:04:57.254050] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-17T06:04:57.254132] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-17T06:04:57.255100] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-17T06:04:57.255177] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-17T06:04:57.505170] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-17T06:04:57.632032] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:04:58.011547] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-17T06:04:58.240610] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T06:04:58.290101] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-17T06:04:59.090247] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-11. [2025-09-17T06:04:59.114960] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T06:04:59.122008] [INFO ] [REMOTE ] RDY: Full fetch complete (69164 records). [2025-09-17T06:04:59.122261] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-17T06:04:59.520320] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-17T06:04:59.520460] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-17T06:04:59.521687] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-17T06:04:59.521749] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-17T06:04:59.523208] [DEBUG] [LOCAL ] RDY: Trimmed 69164 records to 47089 (keeping 200 days of data) [2025-09-17T06:04:59.819933] [DEBUG] [LOCAL ] RDY: Primary data saved (47089 records). [2025-09-17T06:04:59.820102] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-17T06:04:59.820198] [INFO ] [MAIN ] Update Progress: 1784/2369 symbols completed. RDY took 31.3s. Estimated remaining: 1h 25m 33s. Rate: 6.8 symbols/min [2025-09-17T06:04:59.897385] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-17T06:04:59.995013] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:05:00.032631] [DEBUG] [LOCAL ] RES: Loaded 34980 existing records from primary storage. [2025-09-17T06:05:00.032818] [INFO ] [MAIN ] RES: Loaded 34980 existing records. [2025-09-17T06:05:00.212818] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:05:00.213390] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-17T06:05:00.213475] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-17T06:05:00.214472] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-17T06:05:00.242701] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-17T06:05:00.265658] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T06:05:00.576997] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-17T06:05:00.667456] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:05:00.690115] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-11. [2025-09-17T06:05:01.490158] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-17T06:05:01.633410] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T06:05:02.295996] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-09-17T06:05:02.321154] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T06:05:03.090176] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-17T06:05:03.781950] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T06:05:03.890442] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-09-17T06:05:03.890354] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-17T06:05:04.690155] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-17T06:05:04.838437] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T06:05:05.188280] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T06:05:05.490128] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-17T06:05:06.290136] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-17T06:05:06.857608] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T06:05:06.925060] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-17T06:05:06.931624] [INFO ] [REMOTE ] RDW: Full fetch complete (74006 records). [2025-09-17T06:05:06.931828] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-17T06:05:07.095291] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-17T06:05:07.339051] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-17T06:05:07.339182] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-17T06:05:07.340319] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-17T06:05:07.340391] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-17T06:05:07.341998] [DEBUG] [LOCAL ] RDW: Trimmed 74006 records to 51968 (keeping 200 days of data) [2025-09-17T06:05:07.692950] [DEBUG] [LOCAL ] RDW: Primary data saved (51968 records). [2025-09-17T06:05:07.693171] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-17T06:05:07.693316] [INFO ] [MAIN ] Update Progress: 1785/2369 symbols completed. RDW took 43.1s. Estimated remaining: 1h 25m 24s. Rate: 6.8 symbols/min [2025-09-17T06:05:07.880576] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:05:07.897571] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-09-17T06:05:07.911683] [DEBUG] [LOCAL ] REVG: Loaded 30284 existing records from primary storage. [2025-09-17T06:05:07.911854] [INFO ] [MAIN ] REVG: Loaded 30284 existing records. [2025-09-17T06:05:08.111954] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:05:08.112377] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-17T06:05:08.112466] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-17T06:05:08.113233] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-17T06:05:08.113376] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-17T06:05:08.266215] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T06:05:08.518998] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:05:08.695929] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-11. [2025-09-17T06:05:08.725949] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T06:05:09.492186] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-17T06:05:09.498292] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T06:05:10.025086] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T06:05:10.290132] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-09-17T06:05:10.768838] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T06:05:11.090170] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-09-17T06:05:11.609838] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T06:05:11.890160] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-17T06:05:12.690184] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-17T06:05:12.811218] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T06:05:13.461919] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T06:05:13.490137] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-17T06:05:14.110061] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T06:05:14.290170] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-09-17T06:05:15.010711] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T06:05:15.090152] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-17T06:05:15.681739] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T06:05:15.890189] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-17T06:05:16.690153] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-17T06:05:17.004131] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T06:05:17.225518] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T06:05:17.490140] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-17T06:05:17.688182] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T06:05:18.290144] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-17T06:05:18.866317] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T06:05:18.872663] [INFO ] [REMOTE ] RELX: Full fetch complete (66628 records). [2025-09-17T06:05:18.872889] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-17T06:05:19.096234] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-17T06:05:19.281199] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-17T06:05:19.281302] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-17T06:05:19.282328] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-17T06:05:19.282388] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-17T06:05:19.283769] [DEBUG] [LOCAL ] RELX: Trimmed 66628 records to 47809 (keeping 200 days of data) [2025-09-17T06:05:19.581625] [DEBUG] [LOCAL ] RELX: Primary data saved (47809 records). [2025-09-17T06:05:19.581806] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-17T06:05:19.581900] [INFO ] [MAIN ] Update Progress: 1786/2369 symbols completed. RELX took 31.0s. Estimated remaining: 1h 25m 16s. Rate: 6.8 symbols/min [2025-09-17T06:05:19.756098] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:05:19.790554] [DEBUG] [LOCAL ] REX: Loaded 9297 existing records from primary storage. [2025-09-17T06:05:19.792167] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T06:05:19.792241] [INFO ] [MAIN ] REX: Loaded 9297 existing records. [2025-09-17T06:05:19.899141] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-17T06:05:19.980343] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:05:19.980575] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-17T06:05:19.980636] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-17T06:05:19.980995] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-17T06:05:19.981053] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-17T06:05:20.352660] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:05:20.371135] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T06:05:20.690126] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-11. [2025-09-17T06:05:21.490185] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-17T06:05:21.535451] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T06:05:21.569177] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T06:05:22.290164] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-17T06:05:23.012629] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T06:05:23.090141] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-17T06:05:23.890130] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-09-17T06:05:23.996961] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T06:05:24.588141] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T06:05:24.690180] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-17T06:05:24.996582] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T06:05:25.490147] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-17T06:05:26.179582] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T06:05:26.290124] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-17T06:05:27.002389] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T06:05:27.090139] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-09-17T06:05:27.890718] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-17T06:05:27.890482] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T06:05:27.927700] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T06:05:28.690190] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-17T06:05:29.439547] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T06:05:29.490187] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-17T06:05:30.290175] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-17T06:05:30.434098] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T06:05:30.668309] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T06:05:31.090120] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-17T06:05:31.890130] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-17T06:05:31.934464] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T06:05:32.430958] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T06:05:32.614576] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T06:05:32.620387] [INFO ] [REMOTE ] REVG: Full fetch complete (57977 records). [2025-09-17T06:05:32.620525] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-17T06:05:32.695434] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-17T06:05:33.039749] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-17T06:05:33.039921] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-17T06:05:33.041520] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-17T06:05:33.041617] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-17T06:05:33.043252] [DEBUG] [LOCAL ] REVG: Trimmed 57977 records to 41330 (keeping 200 days of data) [2025-09-17T06:05:33.410223] [DEBUG] [LOCAL ] REVG: Primary data saved (41330 records). [2025-09-17T06:05:33.411367] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-17T06:05:33.411578] [INFO ] [MAIN ] Update Progress: 1787/2369 symbols completed. REVG took 25.7s. Estimated remaining: 1h 25m 9s. Rate: 6.8 symbols/min [2025-09-17T06:05:33.510514] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-17T06:05:33.717774] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:05:33.768530] [DEBUG] [LOCAL ] REXR: Loaded 38785 existing records from primary storage. [2025-09-17T06:05:33.769894] [INFO ] [MAIN ] REXR: Loaded 38785 existing records. [2025-09-17T06:05:34.010720] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:05:34.011083] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-17T06:05:34.011162] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-17T06:05:34.012237] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-17T06:05:34.012354] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-17T06:05:34.298530] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-17T06:05:34.413628] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:05:34.554183] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T06:05:35.040634] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T06:05:35.090083] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-17T06:05:35.447577] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T06:05:35.890148] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-17T06:05:36.657822] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T06:05:36.664498] [INFO ] [REMOTE ] RES: Full fetch complete (68638 records). [2025-09-17T06:05:36.664726] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-17T06:05:36.700185] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-17T06:05:37.057514] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-17T06:05:37.057686] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-17T06:05:37.058720] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-17T06:05:37.064078] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-17T06:05:37.073278] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T06:05:37.078972] [DEBUG] [LOCAL ] RES: Trimmed 68638 records to 47631 (keeping 200 days of data) [2025-09-17T06:05:37.390050] [DEBUG] [LOCAL ] RES: Primary data saved (47631 records). [2025-09-17T06:05:37.390249] [INFO ] [MAIN ] RES: Full history saved. [2025-09-17T06:05:37.390356] [INFO ] [MAIN ] Update Progress: 1788/2369 symbols completed. RES took 37.6s. Estimated remaining: 1h 24m 59s. Rate: 6.8 symbols/min [2025-09-17T06:05:37.495225] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-17T06:05:37.575670] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:05:37.614686] [DEBUG] [LOCAL ] REZI: Loaded 34828 existing records from primary storage. [2025-09-17T06:05:37.614876] [INFO ] [MAIN ] REZI: Loaded 34828 existing records. [2025-09-17T06:05:37.794699] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:05:37.795005] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-17T06:05:37.795066] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-17T06:05:37.795798] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-17T06:05:37.795858] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-17T06:05:38.157241] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:05:38.290166] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-11. [2025-09-17T06:05:38.429156] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T06:05:38.435156] [INFO ] [REMOTE ] RERE: Full fetch complete (57433 records). [2025-09-17T06:05:38.435292] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-17T06:05:38.680479] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T06:05:38.849161] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-17T06:05:38.849290] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-17T06:05:38.850298] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-17T06:05:38.850377] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-17T06:05:38.851798] [DEBUG] [LOCAL ] RERE: Trimmed 57433 records to 40806 (keeping 200 days of data) [2025-09-17T06:05:39.091457] [DEBUG] [LOCAL ] RERE: Primary data saved (40806 records). [2025-09-17T06:05:39.091218] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-11. [2025-09-17T06:05:39.091974] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-17T06:05:39.092443] [INFO ] [MAIN ] Update Progress: 1789/2369 symbols completed. RERE took 42.2s. Estimated remaining: 1h 24m 47s. Rate: 6.8 symbols/min [2025-09-17T06:05:39.269769] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:05:39.306990] [DEBUG] [LOCAL ] RF: Loaded 39983 existing records from primary storage. [2025-09-17T06:05:39.307167] [INFO ] [MAIN ] RF: Loaded 39983 existing records. [2025-09-17T06:05:39.488419] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:05:39.488730] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-17T06:05:39.488808] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-17T06:05:39.489706] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-17T06:05:39.489783] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-17T06:05:39.843587] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:05:39.872481] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T06:05:39.890073] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-09-17T06:05:40.690174] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-11. [2025-09-17T06:05:40.908029] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T06:05:41.450278] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T06:05:41.490105] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-17T06:05:42.290143] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-09-17T06:05:42.452282] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T06:05:42.514999] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T06:05:43.090227] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-17T06:05:43.890151] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-09-17T06:05:44.001331] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T06:05:44.472770] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T06:05:44.690178] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-09-17T06:05:45.490139] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-17T06:05:45.673296] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T06:05:45.869069] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T06:05:46.290125] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-09-17T06:05:47.020841] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T06:05:47.090151] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-17T06:05:47.823177] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T06:05:47.890127] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-17T06:05:48.009081] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T06:05:48.668430] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T06:05:48.690105] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-17T06:05:49.336790] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T06:05:49.490189] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-17T06:05:50.290127] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-17T06:05:51.072060] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T06:05:51.090104] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-17T06:05:51.219130] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T06:05:51.221679] [INFO ] [REMOTE ] REX: Full fetch complete (20962 records). [2025-09-17T06:05:51.221807] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-17T06:05:51.590789] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-17T06:05:51.590918] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-17T06:05:51.591464] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-17T06:05:51.591537] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-17T06:05:51.592230] [DEBUG] [LOCAL ] REX: Trimmed 20962 records to 13623 (keeping 200 days of data) [2025-09-17T06:05:51.676399] [DEBUG] [LOCAL ] REX: Primary data saved (13623 records). [2025-09-17T06:05:51.676589] [INFO ] [MAIN ] REX: Full history saved. [2025-09-17T06:05:51.676733] [INFO ] [MAIN ] Update Progress: 1790/2369 symbols completed. REX took 32.1s. Estimated remaining: 1h 24m 40s. Rate: 6.8 symbols/min [2025-09-17T06:05:51.853521] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:05:51.863909] [DEBUG] [LOCAL ] RFI: Loaded 7806 existing records from primary storage. [2025-09-17T06:05:51.864049] [INFO ] [MAIN ] RFI: Loaded 7806 existing records. [2025-09-17T06:05:51.895706] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-17T06:05:52.055166] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:05:52.055482] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-17T06:05:52.055551] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-17T06:05:52.056147] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-17T06:05:52.056232] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-17T06:05:52.432439] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:05:52.603563] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T06:05:52.690154] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-11. [2025-09-17T06:05:53.210316] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T06:05:53.468788] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T06:05:53.490099] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-09-17T06:05:54.290133] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-17T06:05:54.477056] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T06:05:55.090169] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-09-17T06:05:55.891082] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-17T06:05:55.912796] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T06:05:55.930712] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T06:05:56.690147] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-17T06:05:57.490110] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-17T06:05:57.594571] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T06:05:58.271350] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T06:05:58.290072] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-17T06:05:58.315983] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T06:05:59.090183] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-17T06:05:59.870816] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T06:05:59.890097] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-17T06:06:00.690173] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-17T06:06:00.999514] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T06:06:01.490157] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-17T06:06:01.634278] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T06:06:02.290126] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-17T06:06:03.090176] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-17T06:06:03.224832] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-17T06:06:03.890194] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-17T06:06:03.942294] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T06:06:04.335730] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-09-17T06:06:04.690208] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-17T06:06:05.490204] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-17T06:06:05.504702] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T06:06:05.600382] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-17T06:06:05.606682] [INFO ] [REMOTE ] REZI: Full fetch complete (65215 records). [2025-09-17T06:06:05.606821] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-17T06:06:06.015661] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-17T06:06:06.015841] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-17T06:06:06.017162] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-17T06:06:06.017236] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-17T06:06:06.019056] [DEBUG] [LOCAL ] REZI: Trimmed 65215 records to 46738 (keeping 200 days of data) [2025-09-17T06:06:06.134511] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-17T06:06:06.290285] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-17T06:06:06.333974] [DEBUG] [LOCAL ] REZI: Primary data saved (46738 records). [2025-09-17T06:06:06.334148] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-17T06:06:06.334247] [INFO ] [MAIN ] Update Progress: 1791/2369 symbols completed. REZI took 28.9s. Estimated remaining: 1h 24m 33s. Rate: 6.8 symbols/min [2025-09-17T06:06:06.508946] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:06:06.518771] [DEBUG] [LOCAL ] RFL: Loaded 9143 existing records from primary storage. [2025-09-17T06:06:06.518907] [INFO ] [MAIN ] RFL: Loaded 9143 existing records. [2025-09-17T06:06:06.699192] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:06:06.699464] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-17T06:06:06.699523] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-17T06:06:06.699884] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-17T06:06:06.699946] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-17T06:06:07.052533] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:06:07.090085] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-11. [2025-09-17T06:06:07.227629] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T06:06:07.440270] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T06:06:07.790340] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T06:06:07.890180] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-17T06:06:08.690176] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-17T06:06:09.460970] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T06:06:09.490158] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-17T06:06:09.580441] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T06:06:10.264496] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T06:06:10.290187] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-17T06:06:11.090189] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-09-17T06:06:11.117787] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T06:06:11.811444] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T06:06:11.890161] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-09-17T06:06:12.460634] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T06:06:12.690137] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-17T06:06:13.489027] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T06:06:13.491630] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-17T06:06:14.290195] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-17T06:06:14.781158] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T06:06:15.090119] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-17T06:06:15.195723] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T06:06:15.680628] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T06:06:15.890180] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-17T06:06:16.690146] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-17T06:06:17.490104] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-17T06:06:17.576051] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T06:06:18.290107] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-17T06:06:18.333258] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T06:06:18.335241] [INFO ] [REMOTE ] RFI: Full fetch complete (15852 records). [2025-09-17T06:06:18.335331] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-17T06:06:18.465323] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T06:06:18.527487] [INFO ] [REMOTE ] REXR: Full fetch complete (74887 records). [2025-09-17T06:06:18.586172] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-17T06:06:18.905467] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-17T06:06:18.950066] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-17T06:06:18.998753] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-17T06:06:19.027359] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-17T06:06:19.068366] [DEBUG] [LOCAL ] RFI: Trimmed 15852 records to 10593 (keeping 200 days of data) [2025-09-17T06:06:19.116352] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-17T06:06:19.201394] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T06:06:19.240300] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-17T06:06:19.245438] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-17T06:06:19.252165] [DEBUG] [LOCAL ] RFI: Primary data saved (10593 records). [2025-09-17T06:06:19.253217] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-17T06:06:19.253336] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-17T06:06:19.253432] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-17T06:06:19.253636] [INFO ] [MAIN ] Update Progress: 1792/2369 symbols completed. RFI took 27.6s. Estimated remaining: 1h 24m 26s. Rate: 6.8 symbols/min [2025-09-17T06:06:19.355227] [DEBUG] [LOCAL ] REXR: Trimmed 74887 records to 52016 (keeping 200 days of data) [2025-09-17T06:06:19.481739] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:06:19.531836] [DEBUG] [LOCAL ] RFM: Loaded 2907 existing records from primary storage. [2025-09-17T06:06:19.534852] [INFO ] [MAIN ] RFM: Loaded 2907 existing records. [2025-09-17T06:06:19.739255] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:06:19.740930] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-17T06:06:19.741976] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-17T06:06:19.743160] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-17T06:06:19.743785] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-17T06:06:19.893840] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-17T06:06:20.217623] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:06:20.334469] [DEBUG] [LOCAL ] REXR: Primary data saved (52016 records). [2025-09-17T06:06:20.334679] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-17T06:06:20.334783] [INFO ] [MAIN ] Update Progress: 1793/2369 symbols completed. REXR took 46.9s. Estimated remaining: 1h 24m 14s. Rate: 6.8 symbols/min [2025-09-17T06:06:20.515319] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:06:20.523770] [DEBUG] [LOCAL ] RFMZ: Loaded 6057 existing records from primary storage. [2025-09-17T06:06:20.523928] [INFO ] [MAIN ] RFMZ: Loaded 6057 existing records. [2025-09-17T06:06:20.703445] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-11. [2025-09-17T06:06:20.708120] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:06:20.709189] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-17T06:06:20.709253] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-17T06:06:20.709575] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-17T06:06:20.709631] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-17T06:06:21.096760] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:06:21.198542] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T06:06:21.269890] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T06:06:21.490353] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-09-17T06:06:21.494225] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-17T06:06:22.187360] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T06:06:22.290109] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-17T06:06:22.852142] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T06:06:23.090132] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-11. [2025-09-17T06:06:23.867619] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T06:06:23.890346] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-17T06:06:24.345766] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T06:06:24.690162] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-17T06:06:25.490129] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-17T06:06:25.745057] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T06:06:26.290198] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-17T06:06:26.844083] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T06:06:27.090177] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-09-17T06:06:27.304119] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T06:06:27.890156] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-17T06:06:28.002745] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T06:06:28.484193] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T06:06:28.690136] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-17T06:06:29.490142] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-17T06:06:30.082146] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T06:06:30.290124] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-17T06:06:30.392205] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T06:06:30.398963] [INFO ] [REMOTE ] RF: Full fetch complete (77459 records). [2025-09-17T06:06:30.399146] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-17T06:06:30.703000] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-17T06:06:30.820290] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-17T06:06:30.820403] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-17T06:06:30.821455] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-17T06:06:30.821516] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-17T06:06:30.823187] [DEBUG] [LOCAL ] RF: Trimmed 77459 records to 53630 (keeping 200 days of data) [2025-09-17T06:06:31.125922] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-17T06:06:31.180796] [DEBUG] [LOCAL ] RF: Primary data saved (53630 records). [2025-09-17T06:06:31.180983] [INFO ] [MAIN ] RF: Full history saved. [2025-09-17T06:06:31.181107] [INFO ] [MAIN ] Update Progress: 1794/2369 symbols completed. RF took 52.1s. Estimated remaining: 1h 24m 6s. Rate: 6.8 symbols/min [2025-09-17T06:06:31.353720] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:06:31.375268] [DEBUG] [LOCAL ] RGA: Loaded 21395 existing records from primary storage. [2025-09-17T06:06:31.375444] [INFO ] [MAIN ] RGA: Loaded 21395 existing records. [2025-09-17T06:06:31.550942] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:06:31.551182] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-17T06:06:31.551242] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-17T06:06:31.551905] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-17T06:06:31.551968] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-17T06:06:31.823290] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T06:06:31.893331] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-17T06:06:31.915302] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:06:32.690177] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-17T06:06:32.732909] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T06:06:33.329231] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T06:06:33.490128] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-17T06:06:34.260463] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T06:06:34.261921] [INFO ] [REMOTE ] RFM: Full fetch complete (5949 records). [2025-09-17T06:06:34.262008] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-17T06:06:34.295280] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-09-17T06:06:34.641224] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-17T06:06:34.641348] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-17T06:06:34.641530] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-17T06:06:34.641584] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-17T06:06:34.642141] [DEBUG] [LOCAL ] RFM: Trimmed 5949 records to 3963 (keeping 200 days of data) [2025-09-17T06:06:34.668183] [DEBUG] [LOCAL ] RFM: Primary data saved (3963 records). [2025-09-17T06:06:34.668365] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-17T06:06:34.668480] [INFO ] [MAIN ] Update Progress: 1795/2369 symbols completed. RFM took 15.4s. Estimated remaining: 1h 23m 56s. Rate: 6.8 symbols/min [2025-09-17T06:06:34.868243] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:06:34.884076] [DEBUG] [LOCAL ] RGR: Loaded 15556 existing records from primary storage. [2025-09-17T06:06:34.884234] [INFO ] [MAIN ] RGR: Loaded 15556 existing records. [2025-09-17T06:06:35.061086] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:06:35.061354] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-17T06:06:35.061601] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-17T06:06:35.062071] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-17T06:06:35.062142] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-17T06:06:35.095222] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-17T06:06:35.171908] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T06:06:35.425563] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:06:35.890121] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-17T06:06:35.941716] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T06:06:36.496774] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T06:06:36.690163] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-11. [2025-09-17T06:06:37.490188] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-17T06:06:38.082149] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T06:06:38.207518] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T06:06:38.290118] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-17T06:06:38.942456] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-17T06:06:39.090159] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-11. [2025-09-17T06:06:39.890128] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-09-17T06:06:40.199147] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T06:06:40.690140] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-17T06:06:41.433894] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T06:06:41.490147] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-09-17T06:06:41.616784] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T06:06:41.619423] [INFO ] [REMOTE ] RFL: Full fetch complete (12113 records). [2025-09-17T06:06:41.619526] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-17T06:06:41.996765] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-17T06:06:41.996877] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-17T06:06:41.997177] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-17T06:06:41.997230] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-17T06:06:41.997769] [DEBUG] [LOCAL ] RFL: Trimmed 12113 records to 10286 (keeping 200 days of data) [2025-09-17T06:06:42.058277] [DEBUG] [LOCAL ] RFL: Primary data saved (10286 records). [2025-09-17T06:06:42.058468] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-17T06:06:42.058580] [INFO ] [MAIN ] Update Progress: 1796/2369 symbols completed. RFL took 35.7s. Estimated remaining: 1h 23m 47s. Rate: 6.8 symbols/min [2025-09-17T06:06:42.227939] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:06:42.231750] [DEBUG] [LOCAL ] RGT: Loaded 1979 existing records from primary storage. [2025-09-17T06:06:42.231859] [INFO ] [MAIN ] RGT: Loaded 1979 existing records. [2025-09-17T06:06:42.295195] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-09-17T06:06:42.412378] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:06:42.412626] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-17T06:06:42.412706] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-17T06:06:42.412960] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-17T06:06:42.413021] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-17T06:06:42.778233] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:06:42.958390] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T06:06:43.090155] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-17T06:06:43.455746] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T06:06:43.824047] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T06:06:43.890126] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-17T06:06:44.597350] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T06:06:44.690128] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-17T06:06:45.490186] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-11. [2025-09-17T06:06:45.921498] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T06:06:46.196196] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T06:06:46.290131] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-09-17T06:06:46.613975] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-17T06:06:47.090263] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-17T06:06:47.890174] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-17T06:06:48.358835] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T06:06:48.400991] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T06:06:48.690220] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-17T06:06:49.464218] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T06:06:49.490118] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-17T06:06:50.150685] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T06:06:50.152395] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12843 records). [2025-09-17T06:06:50.152502] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-17T06:06:50.300765] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-17T06:06:50.566484] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-17T06:06:50.566604] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-17T06:06:50.566975] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-17T06:06:50.567038] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-17T06:06:50.567752] [DEBUG] [LOCAL ] RFMZ: Trimmed 12843 records to 8442 (keeping 200 days of data) [2025-09-17T06:06:50.622284] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8442 records). [2025-09-17T06:06:50.622466] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-17T06:06:50.622568] [INFO ] [MAIN ] Update Progress: 1797/2369 symbols completed. RFMZ took 30.3s. Estimated remaining: 1h 23m 38s. Rate: 6.8 symbols/min [2025-09-17T06:06:51.090190] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-09-17T06:06:51.562412] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T06:06:51.791434] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T06:06:51.890119] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-17T06:06:52.690190] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-09-17T06:06:53.347259] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T06:06:53.363852] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T06:06:53.490157] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-17T06:06:54.290128] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-17T06:06:54.557088] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T06:06:55.090163] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-17T06:06:55.419242] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T06:06:55.429811] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T06:06:55.890142] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-17T06:06:56.690199] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-17T06:06:57.192256] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T06:06:57.226782] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T06:06:57.490104] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-17T06:06:58.290157] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-17T06:06:58.579126] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T06:06:59.090151] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-17T06:06:59.618260] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T06:06:59.890120] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-17T06:07:00.141225] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T06:07:00.690125] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-17T06:07:01.193759] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T06:07:01.199441] [INFO ] [REMOTE ] RGA: Full fetch complete (45530 records). [2025-09-17T06:07:01.199674] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-17T06:07:01.512798] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-17T06:07:01.657814] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-17T06:07:01.657933] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-17T06:07:01.658865] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-17T06:07:01.658925] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-17T06:07:01.661301] [DEBUG] [LOCAL ] RGA: Trimmed 45530 records to 30127 (keeping 200 days of data) [2025-09-17T06:07:01.860472] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T06:07:01.880273] [DEBUG] [LOCAL ] RGA: Primary data saved (30127 records). [2025-09-17T06:07:01.880461] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-17T06:07:01.880576] [INFO ] [MAIN ] Update Progress: 1798/2369 symbols completed. RGA took 30.7s. Estimated remaining: 1h 23m 30s. Rate: 6.8 symbols/min [2025-09-17T06:07:02.189822] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T06:07:02.290179] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-17T06:07:02.760263] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T06:07:03.090205] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-17T06:07:03.890127] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-17T06:07:04.144172] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T06:07:04.437731] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T06:07:04.690176] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-17T06:07:05.244568] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T06:07:05.490191] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-17T06:07:05.942428] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T06:07:06.290194] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-17T06:07:06.845447] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T06:07:06.846552] [INFO ] [REMOTE ] RGT: Full fetch complete (4081 records). [2025-09-17T06:07:06.846677] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-17T06:07:07.098714] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-17T06:07:07.223032] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-17T06:07:07.223139] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-17T06:07:07.223284] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-17T06:07:07.223341] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-17T06:07:07.223733] [DEBUG] [LOCAL ] RGT: Trimmed 4081 records to 2886 (keeping 200 days of data) [2025-09-17T06:07:07.242213] [DEBUG] [LOCAL ] RGT: Primary data saved (2886 records). [2025-09-17T06:07:07.242296] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-17T06:07:07.242386] [INFO ] [MAIN ] Update Progress: 1799/2369 symbols completed. RGT took 25.2s. Estimated remaining: 1h 23m 20s. Rate: 6.8 symbols/min [2025-09-17T06:07:11.602591] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (4.50 seconds). [2025-09-17T06:07:11.607713] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-17T06:07:12.651143] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T06:07:12.656496] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-17T06:07:13.724390] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T06:07:13.727927] [INFO ] [REMOTE ] RGR: Full fetch complete (28087 records). [2025-09-17T06:07:13.728104] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-17T06:07:14.116242] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-17T06:07:14.116409] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-17T06:07:14.117255] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-17T06:07:14.117326] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-17T06:07:14.118163] [DEBUG] [LOCAL ] RGR: Trimmed 28087 records to 19999 (keeping 200 days of data) [2025-09-17T06:07:14.246278] [DEBUG] [LOCAL ] RGR: Primary data saved (19999 records). [2025-09-17T06:07:14.246458] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-17T06:07:14.246599] [INFO ] [MAIN ] Update Progress: 1800/2369 symbols completed. RGR took 39.6s. Estimated remaining: 1h 23m 11s. Rate: 6.8 symbols/min [2025-09-17T06:07:14.784859] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:07:14.837108] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:07:14.908730] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:07:14.978920] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:07:15.065860] [DEBUG] [LOCAL ] RHP: Loaded 29862 existing records from primary storage. [2025-09-17T06:07:15.079349] [DEBUG] [LOCAL ] RIG: Loaded 40031 existing records from primary storage. [2025-09-17T06:07:15.079487] [INFO ] [MAIN ] RHP: Loaded 29862 existing records. [2025-09-17T06:07:15.092633] [DEBUG] [LOCAL ] RHI: Loaded 37038 existing records from primary storage. [2025-09-17T06:07:15.091866] [DEBUG] [LOCAL ] RH: Loaded 35174 existing records from primary storage. [2025-09-17T06:07:15.091993] [INFO ] [MAIN ] RIG: Loaded 40031 existing records. [2025-09-17T06:07:15.116287] [INFO ] [MAIN ] RH: Loaded 35174 existing records. [2025-09-17T06:07:15.116376] [INFO ] [MAIN ] RHI: Loaded 37038 existing records. [2025-09-17T06:07:15.617757] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:07:15.702776] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-17T06:07:15.785511] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-17T06:07:15.817768] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-17T06:07:15.785721] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:07:15.840833] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-17T06:07:15.846313] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:07:15.850508] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-17T06:07:15.867364] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-17T06:07:15.850716] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:07:15.882454] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-17T06:07:15.903230] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-17T06:07:15.917308] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-17T06:07:15.928826] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-17T06:07:15.939178] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-17T06:07:15.944370] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-17T06:07:15.958486] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-17T06:07:15.963845] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-17T06:07:15.958406] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-17T06:07:15.998119] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-17T06:07:17.046755] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:07:17.117457] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-11. [2025-09-17T06:07:17.298623] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:07:17.331673] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:07:17.345538] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-11. [2025-09-17T06:07:17.345903] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-11. [2025-09-17T06:07:17.359557] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:07:17.360010] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-11. [2025-09-17T06:07:18.514166] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T06:07:18.521029] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-09-17T06:07:18.834892] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T06:07:18.843475] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-09-17T06:07:18.900597] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T06:07:18.909558] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-09-17T06:07:19.002435] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T06:07:19.013535] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-09-17T06:07:19.705348] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T06:07:19.713464] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-09-17T06:07:19.942209] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T06:07:19.951461] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-17T06:07:20.173845] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T06:07:20.183003] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-09-17T06:07:20.925339] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T06:07:20.936704] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-09-17T06:07:21.111690] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T06:07:21.122307] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-17T06:07:21.225225] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T06:07:21.234347] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-17T06:07:21.366344] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T06:07:21.374334] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-17T06:07:22.506259] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T06:07:22.517601] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-17T06:07:22.537807] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T06:07:22.545448] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-17T06:07:22.660141] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T06:07:22.865021] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T06:07:23.090147] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-17T06:07:23.890160] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-17T06:07:24.186159] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T06:07:24.243345] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T06:07:24.413147] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T06:07:24.690154] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-17T06:07:25.405421] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T06:07:25.490091] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-17T06:07:26.290131] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-17T06:07:26.599863] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T06:07:27.082931] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T06:07:27.092345] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-17T06:07:27.890160] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-17T06:07:28.323442] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T06:07:28.690145] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-17T06:07:28.854822] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T06:07:29.422772] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T06:07:29.490179] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-17T06:07:30.290168] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-17T06:07:30.478529] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T06:07:30.703619] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T06:07:31.090185] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-17T06:07:31.890161] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-17T06:07:32.112481] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T06:07:32.548860] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T06:07:32.690135] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-17T06:07:33.463457] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T06:07:33.490092] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-17T06:07:33.821215] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T06:07:34.290136] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-17T06:07:34.855167] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T06:07:35.090158] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-17T06:07:35.313493] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T06:07:35.318520] [INFO ] [REMOTE ] RHP: Full fetch complete (57643 records). [2025-09-17T06:07:35.318710] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-17T06:07:35.699446] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-17T06:07:35.699550] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-17T06:07:35.700505] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-17T06:07:35.700567] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-17T06:07:35.702271] [DEBUG] [LOCAL ] RHP: Trimmed 57643 records to 41774 (keeping 200 days of data) [2025-09-17T06:07:35.893909] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-17T06:07:35.966677] [DEBUG] [LOCAL ] RHP: Primary data saved (41774 records). [2025-09-17T06:07:35.966851] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-17T06:07:35.966982] [INFO ] [MAIN ] Update Progress: 1801/2369 symbols completed. RHP took 21.7s. Estimated remaining: 1h 23m 6s. Rate: 6.8 symbols/min [2025-09-17T06:07:36.133480] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:07:36.172696] [DEBUG] [LOCAL ] RIO: Loaded 39773 existing records from primary storage. [2025-09-17T06:07:36.172874] [INFO ] [MAIN ] RIO: Loaded 39773 existing records. [2025-09-17T06:07:36.348607] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:07:36.348934] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-17T06:07:36.348998] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-17T06:07:36.350034] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-17T06:07:36.350098] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-17T06:07:36.700320] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-17T06:07:36.704729] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:07:37.103247] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T06:07:37.490133] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-17T06:07:37.633937] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T06:07:38.290223] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-11. [2025-09-17T06:07:38.649193] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T06:07:39.090243] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-17T06:07:39.411958] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T06:07:39.890122] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-17T06:07:40.056756] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T06:07:40.690156] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-17T06:07:40.853137] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T06:07:41.490225] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-17T06:07:41.818799] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T06:07:42.290181] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-17T06:07:42.675344] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T06:07:43.090141] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-17T06:07:43.208773] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T06:07:43.890181] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-17T06:07:44.176354] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T06:07:44.690193] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-17T06:07:44.842453] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T06:07:45.424158] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T06:07:45.430276] [INFO ] [REMOTE ] RHI: Full fetch complete (69167 records). [2025-09-17T06:07:45.430415] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-17T06:07:45.495305] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-17T06:07:45.821266] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-17T06:07:45.821427] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-17T06:07:45.822542] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-17T06:07:45.822621] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-17T06:07:45.824393] [DEBUG] [LOCAL ] RHI: Trimmed 69167 records to 49251 (keeping 200 days of data) [2025-09-17T06:07:46.140382] [DEBUG] [LOCAL ] RHI: Primary data saved (49251 records). [2025-09-17T06:07:46.140569] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-17T06:07:46.140705] [INFO ] [MAIN ] Update Progress: 1802/2369 symbols completed. RHI took 31.9s. Estimated remaining: 1h 22m 58s. Rate: 6.8 symbols/min [2025-09-17T06:07:46.291705] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-17T06:07:46.310194] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:07:46.311173] [DEBUG] [LOCAL ] RITM: No existing data file found in primary storage. [2025-09-17T06:07:46.311233] [WARN ] [MAIN ] RITM: No existing data found, performing full refresh instead. [2025-09-17T06:07:46.311342] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-17T06:07:46.311389] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-17T06:07:46.311436] [DEBUG] [LOCAL ] RITM: No primary data file found to delete. [2025-09-17T06:07:46.311472] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-17T06:07:46.673278] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:07:46.690529] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-17T06:07:46.697098] [INFO ] [REMOTE ] RIG: Full fetch complete (77564 records). [2025-09-17T06:07:46.697270] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-17T06:07:47.095138] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-11. [2025-09-17T06:07:47.118809] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-17T06:07:47.119859] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-17T06:07:47.121324] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-17T06:07:47.121544] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-17T06:07:47.123280] [DEBUG] [LOCAL ] RIG: Trimmed 77564 records to 53673 (keeping 200 days of data) [2025-09-17T06:07:47.255604] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T06:07:47.484538] [DEBUG] [LOCAL ] RIG: Primary data saved (53673 records). [2025-09-17T06:07:47.484743] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-17T06:07:47.484847] [INFO ] [MAIN ] Update Progress: 1803/2369 symbols completed. RIG took 33.2s. Estimated remaining: 1h 22m 46s. Rate: 6.8 symbols/min [2025-09-17T06:07:47.655521] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:07:47.666666] [DEBUG] [LOCAL ] RIV: Loaded 8780 existing records from primary storage. [2025-09-17T06:07:47.666818] [INFO ] [MAIN ] RIV: Loaded 8780 existing records. [2025-09-17T06:07:47.846086] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:07:47.846352] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-17T06:07:47.846427] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-17T06:07:47.846856] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-17T06:07:47.846924] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-17T06:07:47.911402] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-17T06:07:48.214584] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:07:48.229616] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T06:07:48.235387] [INFO ] [REMOTE ] RH: Full fetch complete (65177 records). [2025-09-17T06:07:48.235529] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-17T06:07:48.670907] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-17T06:07:48.671034] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-17T06:07:48.672043] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-17T06:07:48.672103] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-17T06:07:48.674160] [DEBUG] [LOCAL ] RH: Trimmed 65177 records to 47702 (keeping 200 days of data) [2025-09-17T06:07:48.733891] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-11. [2025-09-17T06:07:48.977206] [DEBUG] [LOCAL ] RH: Primary data saved (47702 records). [2025-09-17T06:07:48.977388] [INFO ] [MAIN ] RH: Full history saved. [2025-09-17T06:07:48.977500] [INFO ] [MAIN ] Update Progress: 1804/2369 symbols completed. RH took 34.7s. Estimated remaining: 1h 22m 35s. Rate: 6.8 symbols/min [2025-09-17T06:07:49.147314] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:07:49.179654] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T06:07:49.222383] [DEBUG] [LOCAL ] RJF: Loaded 34319 existing records from primary storage. [2025-09-17T06:07:49.222603] [INFO ] [MAIN ] RJF: Loaded 34319 existing records. [2025-09-17T06:07:49.403945] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:07:49.404193] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-17T06:07:49.404252] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-17T06:07:49.405264] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-17T06:07:49.405333] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-17T06:07:49.496632] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-09-17T06:07:49.767333] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:07:49.893316] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T06:07:50.290140] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-11. [2025-09-17T06:07:51.090243] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-17T06:07:51.496699] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T06:07:51.676111] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T06:07:51.890160] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-09-17T06:07:52.645744] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-11 (3.91 seconds). [2025-09-17T06:07:52.690150] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-09-17T06:07:52.917953] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T06:07:53.354140] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T06:07:53.419503] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T06:07:53.490089] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-17T06:07:54.290232] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-09-17T06:07:55.090194] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-09-17T06:07:55.114474] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T06:07:55.367057] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T06:07:55.890213] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-17T06:07:56.429151] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T06:07:56.690129] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-17T06:07:56.738670] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T06:07:57.222262] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T06:07:57.490147] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-17T06:07:58.290153] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-09-17T06:07:58.301146] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T06:07:59.090141] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-17T06:07:59.890172] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-17T06:07:59.986558] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T06:08:00.032657] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T06:08:00.690142] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-17T06:08:01.483327] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T06:08:01.490065] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-17T06:08:01.753317] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T06:08:02.149625] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T06:08:02.290178] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-17T06:08:03.090190] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-17T06:08:03.890354] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-17T06:08:03.892804] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T06:08:04.690153] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-17T06:08:04.798753] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T06:08:05.248194] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-17T06:08:05.490169] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-17T06:08:06.290174] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-17T06:08:06.494124] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T06:08:06.513421] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T06:08:06.516848] [INFO ] [REMOTE ] RIV: Full fetch complete (17009 records). [2025-09-17T06:08:06.517084] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-17T06:08:06.887687] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-17T06:08:06.887795] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-17T06:08:06.888217] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-17T06:08:06.888278] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-17T06:08:06.888921] [DEBUG] [LOCAL ] RIV: Trimmed 17009 records to 11587 (keeping 200 days of data) [2025-09-17T06:08:06.961378] [DEBUG] [LOCAL ] RIV: Primary data saved (11587 records). [2025-09-17T06:08:06.961538] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-17T06:08:06.961656] [INFO ] [MAIN ] Update Progress: 1805/2369 symbols completed. RIV took 19.5s. Estimated remaining: 1h 22m 29s. Rate: 6.8 symbols/min [2025-09-17T06:08:07.100501] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-17T06:08:07.130357] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:08:07.172448] [DEBUG] [LOCAL ] RKT: Loaded 40080 existing records from primary storage. [2025-09-17T06:08:07.172617] [INFO ] [MAIN ] RKT: Loaded 40080 existing records. [2025-09-17T06:08:07.361278] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:08:07.361772] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-17T06:08:07.361854] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-17T06:08:07.363099] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-17T06:08:07.363177] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-17T06:08:07.735990] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:08:07.890183] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-17T06:08:08.254520] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T06:08:08.690154] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-11. [2025-09-17T06:08:09.034473] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T06:08:09.490155] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-17T06:08:09.857470] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T06:08:10.112554] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T06:08:10.290131] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-09-17T06:08:11.095182] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-17T06:08:11.110873] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T06:08:11.890170] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-17T06:08:12.297254] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T06:08:12.690231] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-09-17T06:08:13.293857] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-17T06:08:13.490168] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-17T06:08:13.956000] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-17T06:08:14.139905] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T06:08:14.290149] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-17T06:08:15.090207] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-17T06:08:15.346385] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T06:08:15.890156] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-17T06:08:16.404946] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T06:08:16.696312] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-17T06:08:16.701984] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T06:08:17.490156] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-17T06:08:17.733001] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T06:08:18.290169] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-17T06:08:18.507783] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T06:08:18.774889] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T06:08:19.090165] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-17T06:08:19.890254] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-17T06:08:20.136243] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T06:08:20.690134] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-17T06:08:21.050005] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T06:08:21.474662] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T06:08:21.490094] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-17T06:08:22.163829] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T06:08:22.170798] [INFO ] [REMOTE ] RITM: Full fetch complete (76426 records). [2025-09-17T06:08:22.170995] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-17T06:08:22.295354] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-17T06:08:22.577222] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-17T06:08:22.577343] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-17T06:08:22.578413] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-17T06:08:22.578494] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-17T06:08:22.580145] [DEBUG] [LOCAL ] RITM: Trimmed 76426 records to 52792 (keeping 200 days of data) [2025-09-17T06:08:22.830429] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T06:08:22.855808] [INFO ] [REMOTE ] RJF: Full fetch complete (68140 records). [2025-09-17T06:08:22.864031] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-17T06:08:23.112576] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-17T06:08:23.344322] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-17T06:08:23.350098] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-17T06:08:23.352667] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-17T06:08:23.353365] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-17T06:08:23.358279] [DEBUG] [LOCAL ] RITM: Primary data saved (52792 records). [2025-09-17T06:08:23.358849] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-17T06:08:23.359210] [INFO ] [MAIN ] Update Progress: 1806/2369 symbols completed. RITM took 37.2s. Estimated remaining: 1h 22m 23s. Rate: 6.8 symbols/min [2025-09-17T06:08:23.371663] [DEBUG] [LOCAL ] RJF: Trimmed 68140 records to 47105 (keeping 200 days of data) [2025-09-17T06:08:23.638677] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:08:23.784045] [DEBUG] [LOCAL ] RL: Loaded 29962 existing records from primary storage. [2025-09-17T06:08:23.785007] [INFO ] [MAIN ] RL: Loaded 29962 existing records. [2025-09-17T06:08:23.973244] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:08:23.974831] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-17T06:08:23.975687] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-17T06:08:23.977698] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-17T06:08:23.978286] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-17T06:08:24.369708] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:08:24.371533] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-11. [2025-09-17T06:08:24.446652] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-17T06:08:24.469318] [DEBUG] [LOCAL ] RJF: Primary data saved (47105 records). [2025-09-17T06:08:24.469527] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-17T06:08:24.469664] [INFO ] [MAIN ] Update Progress: 1807/2369 symbols completed. RJF took 35.5s. Estimated remaining: 1h 22m 12s. Rate: 6.8 symbols/min [2025-09-17T06:08:24.649167] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:08:24.672991] [DEBUG] [LOCAL ] RLI: Loaded 25044 existing records from primary storage. [2025-09-17T06:08:24.673369] [INFO ] [MAIN ] RLI: Loaded 25044 existing records. [2025-09-17T06:08:24.706365] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-17T06:08:24.861216] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:08:24.861506] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-17T06:08:24.861566] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-17T06:08:24.862434] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-17T06:08:24.862499] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-17T06:08:25.224810] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:08:25.243699] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-17T06:08:25.250582] [INFO ] [REMOTE ] RIO: Full fetch complete (77200 records). [2025-09-17T06:08:25.250800] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-17T06:08:25.514550] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-11. [2025-09-17T06:08:25.652853] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-17T06:08:25.653035] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-17T06:08:25.654359] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-17T06:08:25.654545] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-17T06:08:25.656358] [DEBUG] [LOCAL ] RIO: Trimmed 77200 records to 53404 (keeping 200 days of data) [2025-09-17T06:08:25.774088] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T06:08:26.028967] [DEBUG] [LOCAL ] RIO: Primary data saved (53404 records). [2025-09-17T06:08:26.029161] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-17T06:08:26.029301] [INFO ] [MAIN ] Update Progress: 1808/2369 symbols completed. RIO took 50.1s. Estimated remaining: 1h 22m 1s. Rate: 6.8 symbols/min [2025-09-17T06:08:26.198509] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:08:26.234558] [DEBUG] [LOCAL ] RLJ: Loaded 35399 existing records from primary storage. [2025-09-17T06:08:26.234765] [INFO ] [MAIN ] RLJ: Loaded 35399 existing records. [2025-09-17T06:08:26.298230] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-09-17T06:08:26.416682] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:08:26.417046] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-17T06:08:26.417128] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-17T06:08:26.426083] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-17T06:08:26.426350] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-17T06:08:26.427002] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T06:08:26.792468] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:08:26.823775] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T06:08:27.090137] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-17T06:08:27.890175] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-09-17T06:08:28.159517] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T06:08:28.687228] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T06:08:28.697465] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-09-17T06:08:28.884608] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T06:08:29.490148] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-11. [2025-09-17T06:08:30.177264] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T06:08:30.290202] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-17T06:08:30.715799] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T06:08:31.090150] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-09-17T06:08:31.890142] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-17T06:08:32.114198] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T06:08:32.690133] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-17T06:08:32.758466] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T06:08:33.490118] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-09-17T06:08:33.557684] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T06:08:34.290136] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-17T06:08:34.861431] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T06:08:34.982410] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-17T06:08:35.090116] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-09-17T06:08:35.731915] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T06:08:35.890121] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-17T06:08:36.628161] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T06:08:36.690121] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-17T06:08:37.490212] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-17T06:08:38.193215] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-17T06:08:38.290152] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-17T06:08:38.467060] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T06:08:38.862419] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T06:08:39.090185] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-17T06:08:39.890153] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-17T06:08:40.344674] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T06:08:40.456704] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-17T06:08:40.463155] [INFO ] [REMOTE ] RKT: Full fetch complete (77157 records). [2025-09-17T06:08:40.463303] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-17T06:08:40.695283] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-17T06:08:40.854763] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-17T06:08:40.854888] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-17T06:08:40.856128] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-17T06:08:40.856237] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-17T06:08:40.857808] [DEBUG] [LOCAL ] RKT: Trimmed 77157 records to 53720 (keeping 200 days of data) [2025-09-17T06:08:41.185153] [DEBUG] [LOCAL ] RKT: Primary data saved (53720 records). [2025-09-17T06:08:41.185355] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-17T06:08:41.185479] [INFO ] [MAIN ] Update Progress: 1809/2369 symbols completed. RKT took 34.2s. Estimated remaining: 1h 21m 54s. Rate: 6.8 symbols/min [2025-09-17T06:08:41.367136] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:08:41.397109] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T06:08:41.409848] [DEBUG] [LOCAL ] RLTY: Loaded 7978 existing records from primary storage. [2025-09-17T06:08:41.410258] [INFO ] [MAIN ] RLTY: Loaded 7978 existing records. [2025-09-17T06:08:41.495274] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-17T06:08:41.599802] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:08:41.600054] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-17T06:08:41.600114] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-17T06:08:41.600482] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-17T06:08:41.600556] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-17T06:08:41.953048] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:08:42.151056] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T06:08:42.290139] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-11. [2025-09-17T06:08:43.037846] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T06:08:43.090100] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-09-17T06:08:43.281985] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T06:08:43.890133] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-17T06:08:44.053522] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T06:08:44.690147] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-17T06:08:45.495226] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-17T06:08:45.520049] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T06:08:46.145150] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T06:08:46.290176] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-09-17T06:08:46.776756] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T06:08:47.090146] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-17T06:08:47.122961] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T06:08:47.890189] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-17T06:08:48.686993] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T06:08:48.695542] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-17T06:08:49.490172] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-17T06:08:49.607366] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T06:08:50.008926] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T06:08:50.290128] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-17T06:08:50.544104] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T06:08:51.090136] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-17T06:08:51.890174] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-17T06:08:51.956009] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T06:08:51.992068] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T06:08:52.690170] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-17T06:08:53.409556] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T06:08:53.490180] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-17T06:08:54.218581] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T06:08:54.290159] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-17T06:08:54.490106] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T06:08:55.090191] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-17T06:08:55.874280] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T06:08:55.890142] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-17T06:08:56.669193] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T06:08:56.690096] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-17T06:08:57.479634] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T06:08:57.490117] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-17T06:08:57.981769] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T06:08:58.159174] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T06:08:58.290123] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-17T06:08:58.895039] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T06:08:59.090179] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-17T06:08:59.890141] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-17T06:09:00.260411] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T06:09:00.265579] [INFO ] [REMOTE ] RLI: Full fetch complete (45404 records). [2025-09-17T06:09:00.265748] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-17T06:09:00.646812] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-17T06:09:00.646941] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-17T06:09:00.647852] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-17T06:09:00.647916] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-17T06:09:00.649121] [DEBUG] [LOCAL ] RLI: Trimmed 45404 records to 33303 (keeping 200 days of data) [2025-09-17T06:09:00.707116] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-17T06:09:00.859905] [DEBUG] [LOCAL ] RLI: Primary data saved (33303 records). [2025-09-17T06:09:00.860077] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-17T06:09:00.860182] [INFO ] [MAIN ] Update Progress: 1810/2369 symbols completed. RLI took 36.4s. Estimated remaining: 1h 21m 49s. Rate: 6.8 symbols/min [2025-09-17T06:09:01.032319] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:09:01.065011] [DEBUG] [LOCAL ] RLX: Loaded 35429 existing records from primary storage. [2025-09-17T06:09:01.065198] [INFO ] [MAIN ] RLX: Loaded 35429 existing records. [2025-09-17T06:09:01.243409] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:09:01.243704] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-17T06:09:01.243769] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-17T06:09:01.244766] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-17T06:09:01.244841] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-17T06:09:01.495347] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-17T06:09:01.617114] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:09:01.633547] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T06:09:01.639845] [INFO ] [REMOTE ] RLJ: Full fetch complete (69110 records). [2025-09-17T06:09:01.640009] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-17T06:09:02.043400] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-17T06:09:02.043528] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-17T06:09:02.044829] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-17T06:09:02.044925] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-17T06:09:02.046517] [DEBUG] [LOCAL ] RLJ: Trimmed 69110 records to 48337 (keeping 200 days of data) [2025-09-17T06:09:02.290240] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-11. [2025-09-17T06:09:02.341354] [DEBUG] [LOCAL ] RLJ: Primary data saved (48337 records). [2025-09-17T06:09:02.341498] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-17T06:09:02.341668] [INFO ] [MAIN ] Update Progress: 1811/2369 symbols completed. RLJ took 36.3s. Estimated remaining: 1h 21m 38s. Rate: 6.8 symbols/min [2025-09-17T06:09:02.511695] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:09:02.526582] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T06:09:02.534617] [DEBUG] [LOCAL ] RM: Loaded 5649 existing records from primary storage. [2025-09-17T06:09:02.534395] [INFO ] [REMOTE ] RL: Full fetch complete (60243 records). [2025-09-17T06:09:02.534786] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-17T06:09:02.534825] [INFO ] [MAIN ] RM: Loaded 5649 existing records. [2025-09-17T06:09:02.868748] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:09:02.919657] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-17T06:09:02.948073] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-17T06:09:03.004170] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-17T06:09:03.006637] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-17T06:09:03.221264] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-17T06:09:03.245043] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-17T06:09:03.283276] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-17T06:09:03.342291] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-17T06:09:03.379867] [DEBUG] [LOCAL ] RL: Trimmed 60243 records to 42063 (keeping 200 days of data) [2025-09-17T06:09:03.461783] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:09:03.462191] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-11. [2025-09-17T06:09:03.738455] [DEBUG] [LOCAL ] RL: Primary data saved (42063 records). [2025-09-17T06:09:03.738622] [INFO ] [MAIN ] RL: Full history saved. [2025-09-17T06:09:03.738774] [INFO ] [MAIN ] Update Progress: 1812/2369 symbols completed. RL took 40.4s. Estimated remaining: 1h 21m 27s. Rate: 6.8 symbols/min [2025-09-17T06:09:03.906872] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:09:03.922815] [DEBUG] [LOCAL ] RMAX: Loaded 16631 existing records from primary storage. [2025-09-17T06:09:03.922967] [INFO ] [MAIN ] RMAX: Loaded 16631 existing records. [2025-09-17T06:09:04.099661] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:09:04.099912] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-17T06:09:04.099974] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-17T06:09:04.100430] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-17T06:09:04.100501] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-17T06:09:04.457226] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:09:04.457660] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-11. [2025-09-17T06:09:05.156274] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T06:09:05.158158] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-09-17T06:09:05.485460] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-11 (3.20 seconds). [2025-09-17T06:09:05.495571] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-09-17T06:09:05.730600] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T06:09:05.883584] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T06:09:06.290134] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-09-17T06:09:07.080055] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T06:09:07.090299] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-17T06:09:07.328140] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T06:09:07.890241] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-17T06:09:07.935560] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T06:09:08.690144] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-17T06:09:08.963346] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T06:09:09.453622] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T06:09:09.490126] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-17T06:09:10.242887] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T06:09:10.290099] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-17T06:09:11.083857] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T06:09:11.090084] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-17T06:09:11.890129] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-17T06:09:12.437354] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T06:09:12.690133] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-17T06:09:13.490188] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-17T06:09:13.575746] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T06:09:13.656041] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T06:09:14.156243] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T06:09:14.290124] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-17T06:09:14.930699] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T06:09:15.090145] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-17T06:09:15.846761] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (14.35 seconds). [2025-09-17T06:09:15.890116] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-17T06:09:16.120585] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T06:09:16.690130] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-17T06:09:17.490137] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-17T06:09:17.550719] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T06:09:17.590246] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T06:09:18.290136] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-17T06:09:19.092502] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-17T06:09:19.096489] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T06:09:19.430169] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T06:09:19.432150] [INFO ] [REMOTE ] RLTY: Full fetch complete (18105 records). [2025-09-17T06:09:19.432310] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-17T06:09:19.809769] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-17T06:09:19.809900] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-17T06:09:19.810445] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-17T06:09:19.810518] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-17T06:09:19.811111] [DEBUG] [LOCAL ] RLTY: Trimmed 18105 records to 11238 (keeping 200 days of data) [2025-09-17T06:09:19.881495] [DEBUG] [LOCAL ] RLTY: Primary data saved (11238 records). [2025-09-17T06:09:19.881685] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-17T06:09:19.881811] [INFO ] [MAIN ] Update Progress: 1813/2369 symbols completed. RLTY took 38.7s. Estimated remaining: 1h 21m 20s. Rate: 6.8 symbols/min [2025-09-17T06:09:19.895283] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-17T06:09:20.055043] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:09:20.068210] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T06:09:20.105496] [DEBUG] [LOCAL ] RMD: Loaded 31128 existing records from primary storage. [2025-09-17T06:09:20.105701] [INFO ] [MAIN ] RMD: Loaded 31128 existing records. [2025-09-17T06:09:20.280356] [WARN ] [MAIN ] RMD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:09:20.280625] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-17T06:09:20.280712] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-17T06:09:20.281465] [DEBUG] [LOCAL ] RMD: Deleted primary data file. [2025-09-17T06:09:20.281529] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-17T06:09:20.633843] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:09:20.690092] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-11. [2025-09-17T06:09:21.464976] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T06:09:21.490087] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-17T06:09:22.280108] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T06:09:22.290094] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-17T06:09:23.046209] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T06:09:23.047872] [INFO ] [REMOTE ] RM: Full fetch complete (11353 records). [2025-09-17T06:09:23.047972] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-17T06:09:23.095452] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-09-17T06:09:23.631405] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T06:09:23.685845] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-17T06:09:23.686033] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-17T06:09:23.686688] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-17T06:09:23.686808] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-17T06:09:23.687906] [DEBUG] [LOCAL ] RM: Trimmed 11353 records to 7725 (keeping 200 days of data) [2025-09-17T06:09:23.757484] [DEBUG] [LOCAL ] RM: Primary data saved (7725 records). [2025-09-17T06:09:23.757753] [INFO ] [MAIN ] RM: Full history saved. [2025-09-17T06:09:23.757927] [INFO ] [MAIN ] Update Progress: 1814/2369 symbols completed. RM took 21.4s. Estimated remaining: 1h 21m 10s. Rate: 6.8 symbols/min [2025-09-17T06:09:23.898559] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-17T06:09:23.994093] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:09:24.001229] [DEBUG] [LOCAL ] RMI: Loaded 3529 existing records from primary storage. [2025-09-17T06:09:24.001429] [INFO ] [MAIN ] RMI: Loaded 3529 existing records. [2025-09-17T06:09:24.242318] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:09:24.242599] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-17T06:09:24.242688] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-17T06:09:24.242960] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-17T06:09:24.243030] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-17T06:09:24.608759] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:09:24.687859] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T06:09:24.695761] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-11. [2025-09-17T06:09:25.029377] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T06:09:25.490132] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-17T06:09:25.540462] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T06:09:26.290141] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-09-17T06:09:26.566371] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T06:09:26.898909] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T06:09:27.090138] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-17T06:09:27.890194] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-17T06:09:28.690102] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-17T06:09:28.750607] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T06:09:29.000889] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T06:09:29.490137] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-17T06:09:30.260396] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T06:09:30.290092] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-17T06:09:30.407958] [DEBUG] [REMOTE ] RMD: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T06:09:30.408304] [WARN ] [REMOTE ] RMD: No data returned for month 2025-02 [2025-09-17T06:09:31.090130] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-17T06:09:31.183707] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T06:09:31.890131] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-17T06:09:32.244114] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T06:09:32.690133] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-09-17T06:09:33.143152] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T06:09:33.490136] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-17T06:09:33.558300] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T06:09:34.290137] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-17T06:09:34.585567] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-17T06:09:35.090132] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-17T06:09:35.155728] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T06:09:35.890126] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-17T06:09:36.690129] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-17T06:09:36.883410] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T06:09:37.462068] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T06:09:37.468324] [INFO ] [REMOTE ] RLX: Full fetch complete (70216 records). [2025-09-17T06:09:37.468470] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-17T06:09:37.500819] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-17T06:09:37.868229] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-17T06:09:37.868385] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-17T06:09:37.869745] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-17T06:09:37.869811] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-17T06:09:37.872938] [DEBUG] [LOCAL ] RLX: Trimmed 70216 records to 48166 (keeping 200 days of data) [2025-09-17T06:09:38.113729] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T06:09:38.129436] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T06:09:38.193078] [DEBUG] [LOCAL ] RLX: Primary data saved (48166 records). [2025-09-17T06:09:38.193247] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-17T06:09:38.193403] [INFO ] [MAIN ] Update Progress: 1815/2369 symbols completed. RLX took 37.3s. Estimated remaining: 1h 21m 3s. Rate: 6.8 symbols/min [2025-09-17T06:09:38.292995] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-17T06:09:38.365250] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:09:38.375258] [DEBUG] [LOCAL ] RMM: Loaded 7584 existing records from primary storage. [2025-09-17T06:09:38.375398] [INFO ] [MAIN ] RMM: Loaded 7584 existing records. [2025-09-17T06:09:38.557145] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:09:38.557363] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-17T06:09:38.557422] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-17T06:09:38.557784] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-17T06:09:38.557864] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-17T06:09:38.838995] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T06:09:38.916477] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:09:39.090095] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-11. [2025-09-17T06:09:39.815984] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T06:09:39.890097] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-17T06:09:40.384003] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T06:09:40.690132] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-17T06:09:41.490146] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-17T06:09:41.709345] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T06:09:41.712292] [INFO ] [REMOTE ] RMAX: Full fetch complete (29511 records). [2025-09-17T06:09:41.712441] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-17T06:09:42.004036] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T06:09:42.103071] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-17T06:09:42.103175] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-17T06:09:42.103919] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-17T06:09:42.104007] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-17T06:09:42.104971] [DEBUG] [LOCAL ] RMAX: Trimmed 29511 records to 21710 (keeping 200 days of data) [2025-09-17T06:09:42.233968] [DEBUG] [LOCAL ] RMAX: Primary data saved (21710 records). [2025-09-17T06:09:42.234121] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-17T06:09:42.234236] [INFO ] [MAIN ] Update Progress: 1816/2369 symbols completed. RMAX took 38.5s. Estimated remaining: 1h 20m 53s. Rate: 6.8 symbols/min [2025-09-17T06:09:42.296034] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-17T06:09:42.405000] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:09:42.410807] [DEBUG] [LOCAL ] RMMZ: Loaded 3694 existing records from primary storage. [2025-09-17T06:09:42.410929] [INFO ] [MAIN ] RMMZ: Loaded 3694 existing records. [2025-09-17T06:09:42.585416] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:09:42.585686] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-17T06:09:42.585781] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-17T06:09:42.586027] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-17T06:09:42.586094] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-17T06:09:42.892323] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T06:09:42.959748] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:09:43.090116] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-11. [2025-09-17T06:09:43.724494] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T06:09:43.890131] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-09-17T06:09:44.697875] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T06:09:44.697026] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-09-17T06:09:45.412387] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T06:09:45.490130] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-09-17T06:09:46.068345] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T06:09:46.290184] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-17T06:09:47.090168] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-17T06:09:47.589309] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T06:09:47.861231] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T06:09:47.890142] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-17T06:09:48.345168] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T06:09:48.690147] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-17T06:09:49.160953] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T06:09:49.490214] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-17T06:09:50.242807] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T06:09:50.290160] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-17T06:09:50.963570] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T06:09:50.965049] [INFO ] [REMOTE ] RMI: Full fetch complete (6236 records). [2025-09-17T06:09:50.965152] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-17T06:09:51.104840] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-17T06:09:51.330390] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-17T06:09:51.330518] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-17T06:09:51.330786] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-17T06:09:51.330864] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-17T06:09:51.331361] [DEBUG] [LOCAL ] RMI: Trimmed 6236 records to 4502 (keeping 200 days of data) [2025-09-17T06:09:51.361236] [DEBUG] [LOCAL ] RMI: Primary data saved (4502 records). [2025-09-17T06:09:51.361342] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-17T06:09:51.361487] [INFO ] [MAIN ] Update Progress: 1817/2369 symbols completed. RMI took 27.6s. Estimated remaining: 1h 20m 44s. Rate: 6.8 symbols/min [2025-09-17T06:09:51.529252] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:09:51.543750] [DEBUG] [LOCAL ] RMT: Loaded 12707 existing records from primary storage. [2025-09-17T06:09:51.543894] [INFO ] [MAIN ] RMT: Loaded 12707 existing records. [2025-09-17T06:09:51.717788] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:09:51.718008] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-17T06:09:51.718067] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-17T06:09:51.718548] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-17T06:09:51.718609] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-17T06:09:51.831303] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T06:09:51.895513] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-17T06:09:52.082755] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:09:52.628538] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T06:09:52.690081] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-17T06:09:53.248823] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T06:09:53.490199] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-17T06:09:54.106912] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T06:09:54.290188] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-17T06:09:55.090213] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-11. [2025-09-17T06:09:55.792000] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T06:09:55.890122] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-17T06:09:56.048238] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T06:09:56.690170] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-17T06:09:57.304848] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T06:09:57.490115] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-17T06:09:57.583486] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T06:09:58.245869] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T06:09:58.290107] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-17T06:09:59.093749] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-17T06:09:59.096781] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T06:09:59.890131] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-17T06:10:00.553035] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T06:10:00.690126] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-17T06:10:00.856966] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T06:10:01.262728] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T06:10:01.490140] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-17T06:10:02.290153] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-17T06:10:02.404455] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T06:10:02.913447] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T06:10:03.090192] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-17T06:10:03.890141] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-17T06:10:04.637252] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T06:10:04.644579] [INFO ] [REMOTE ] RMD: Full fetch complete (54789 records). [2025-09-17T06:10:04.644841] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-17T06:10:04.701536] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-09-17T06:10:04.813803] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T06:10:04.875494] [WARN ] [VALIDATOR ] RMD: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T06:10:04.876284] [FATAL] [MAIN ] RMD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:10:04.876343] [WARN ] [MAIN ] RMD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:10:04.876395] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-17T06:10:04.876487] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-09-17T06:10:04.876538] [INFO ] [LOCAL ] RMD: Starting deletion of derivative data. [2025-09-17T06:10:04.876952] [DEBUG] [LOCAL ] RMD: Deleted derivative data file. [2025-09-17T06:10:04.877080] [INFO ] [MAIN ] Update Progress: 1818/2369 symbols completed. RMD took 45.0s. Estimated remaining: 1h 20m 37s. Rate: 6.8 symbols/min [2025-09-17T06:10:05.044450] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:10:05.082758] [DEBUG] [LOCAL ] RNG: Loaded 35432 existing records from primary storage. [2025-09-17T06:10:05.082964] [INFO ] [MAIN ] RNG: Loaded 35432 existing records. [2025-09-17T06:10:05.259207] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:10:05.259498] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-17T06:10:05.259557] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-17T06:10:05.260863] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-17T06:10:05.260926] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-17T06:10:05.500588] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-17T06:10:05.618474] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:10:05.792747] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T06:10:06.183132] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T06:10:06.185969] [INFO ] [REMOTE ] RMM: Full fetch complete (14653 records). [2025-09-17T06:10:06.186061] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-17T06:10:06.295215] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-09-17T06:10:06.558326] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-17T06:10:06.558460] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-17T06:10:06.558879] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-17T06:10:06.558955] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-17T06:10:06.559739] [DEBUG] [LOCAL ] RMM: Trimmed 14653 records to 10113 (keeping 200 days of data) [2025-09-17T06:10:06.631364] [DEBUG] [LOCAL ] RMM: Primary data saved (10113 records). [2025-09-17T06:10:06.631579] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-17T06:10:06.631720] [INFO ] [MAIN ] Update Progress: 1819/2369 symbols completed. RMM took 28.4s. Estimated remaining: 1h 20m 26s. Rate: 6.8 symbols/min [2025-09-17T06:10:06.809269] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:10:06.827175] [DEBUG] [LOCAL ] RNGR: Loaded 15757 existing records from primary storage. [2025-09-17T06:10:06.827364] [INFO ] [MAIN ] RNGR: Loaded 15757 existing records. [2025-09-17T06:10:07.017936] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:10:07.018185] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-17T06:10:07.018249] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-17T06:10:07.018837] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-17T06:10:07.018900] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-17T06:10:07.095281] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-17T06:10:07.412624] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:10:07.426125] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T06:10:07.820549] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T06:10:07.821744] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7303 records). [2025-09-17T06:10:07.821829] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-17T06:10:07.895235] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-17T06:10:08.206937] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-17T06:10:08.207054] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-17T06:10:08.207270] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-17T06:10:08.207323] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-17T06:10:08.207827] [DEBUG] [LOCAL ] RMMZ: Trimmed 7303 records to 4796 (keeping 200 days of data) [2025-09-17T06:10:08.238712] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4796 records). [2025-09-17T06:10:08.238887] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-17T06:10:08.238989] [INFO ] [MAIN ] Update Progress: 1820/2369 symbols completed. RMMZ took 26.0s. Estimated remaining: 1h 20m 15s. Rate: 6.8 symbols/min [2025-09-17T06:10:08.409481] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:10:08.422901] [DEBUG] [LOCAL ] RNP: Loaded 11693 existing records from primary storage. [2025-09-17T06:10:08.423072] [INFO ] [MAIN ] RNP: Loaded 11693 existing records. [2025-09-17T06:10:08.618356] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:10:08.618634] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-17T06:10:08.618715] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-17T06:10:08.619160] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-17T06:10:08.619221] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-17T06:10:08.695287] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-11. [2025-09-17T06:10:08.980316] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T06:10:08.994334] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:10:09.490174] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-11. [2025-09-17T06:10:09.799828] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T06:10:10.290164] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-11. [2025-09-17T06:10:11.095202] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-09-17T06:10:11.110700] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T06:10:11.209036] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T06:10:11.890192] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-09-17T06:10:12.632881] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T06:10:12.690171] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-17T06:10:13.488305] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T06:10:13.497535] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-09-17T06:10:13.541734] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T06:10:14.290171] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-17T06:10:14.501683] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T06:10:15.041467] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T06:10:15.090176] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-17T06:10:15.893013] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T06:10:15.893145] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-17T06:10:16.690139] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-17T06:10:16.839397] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T06:10:17.404090] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T06:10:17.490142] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-17T06:10:18.290146] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-17T06:10:18.600335] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T06:10:19.036513] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T06:10:19.090096] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-17T06:10:19.890153] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-17T06:10:20.069127] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T06:10:20.690147] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-09-17T06:10:21.443692] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T06:10:21.490135] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-17T06:10:21.733770] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T06:10:22.290147] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-17T06:10:22.527169] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T06:10:23.090122] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-17T06:10:23.348564] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T06:10:23.890174] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-17T06:10:24.110572] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T06:10:24.690164] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-17T06:10:24.913891] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T06:10:25.490135] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-17T06:10:25.817608] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T06:10:26.290174] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-17T06:10:26.443677] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T06:10:26.446478] [INFO ] [REMOTE ] RMT: Full fetch complete (25542 records). [2025-09-17T06:10:26.446668] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-17T06:10:26.833627] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-17T06:10:26.833776] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-17T06:10:26.834516] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-17T06:10:26.834602] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-17T06:10:26.836013] [DEBUG] [LOCAL ] RMT: Trimmed 25542 records to 17795 (keeping 200 days of data) [2025-09-17T06:10:26.948271] [DEBUG] [LOCAL ] RMT: Primary data saved (17795 records). [2025-09-17T06:10:26.948460] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-17T06:10:26.948572] [INFO ] [MAIN ] Update Progress: 1821/2369 symbols completed. RMT took 35.6s. Estimated remaining: 1h 20m 9s. Rate: 6.8 symbols/min [2025-09-17T06:10:27.102507] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-17T06:10:27.135770] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:10:27.163227] [DEBUG] [LOCAL ] RNR: Loaded 25274 existing records from primary storage. [2025-09-17T06:10:27.163401] [INFO ] [MAIN ] RNR: Loaded 25274 existing records. [2025-09-17T06:10:27.342738] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:10:27.343013] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-17T06:10:27.343076] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-17T06:10:27.343877] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-17T06:10:27.343939] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-17T06:10:27.708505] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:10:27.890134] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-11. [2025-09-17T06:10:27.967234] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T06:10:28.303630] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T06:10:28.690145] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-17T06:10:29.342813] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T06:10:29.368522] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T06:10:29.490141] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-09-17T06:10:30.290141] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-17T06:10:30.688065] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T06:10:31.090140] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-17T06:10:31.732665] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T06:10:31.890140] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-17T06:10:32.575888] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T06:10:32.690134] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-17T06:10:33.491900] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-17T06:10:33.497705] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T06:10:34.170972] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T06:10:34.290134] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-17T06:10:34.399542] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T06:10:34.402180] [INFO ] [REMOTE ] RNGR: Full fetch complete (28282 records). [2025-09-17T06:10:34.402290] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-17T06:10:34.779368] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-17T06:10:34.779472] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-17T06:10:34.780094] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-17T06:10:34.780150] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-17T06:10:34.780868] [DEBUG] [LOCAL ] RNGR: Trimmed 28282 records to 20302 (keeping 200 days of data) [2025-09-17T06:10:34.906057] [DEBUG] [LOCAL ] RNGR: Primary data saved (20302 records). [2025-09-17T06:10:34.906205] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-17T06:10:34.906294] [INFO ] [MAIN ] Update Progress: 1822/2369 symbols completed. RNGR took 28.3s. Estimated remaining: 1h 19m 60s. Rate: 6.8 symbols/min [2025-09-17T06:10:35.083342] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:10:35.090146] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-17T06:10:35.113030] [DEBUG] [LOCAL ] RNST: Loaded 26578 existing records from primary storage. [2025-09-17T06:10:35.113212] [INFO ] [MAIN ] RNST: Loaded 26578 existing records. [2025-09-17T06:10:35.304272] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:10:35.304551] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-17T06:10:35.304613] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-17T06:10:35.305485] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-17T06:10:35.305550] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-17T06:10:35.710512] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:10:35.746079] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T06:10:35.890131] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-11. [2025-09-17T06:10:35.908543] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T06:10:36.690098] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-17T06:10:37.152845] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T06:10:37.435592] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T06:10:37.490137] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-17T06:10:38.290252] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-09-17T06:10:39.090188] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-17T06:10:39.216266] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T06:10:39.633596] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T06:10:39.890126] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-09-17T06:10:40.075144] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T06:10:40.690153] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-17T06:10:40.970000] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T06:10:41.490155] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-17T06:10:42.260834] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T06:10:42.290130] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-17T06:10:43.075512] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T06:10:43.090074] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-17T06:10:43.618749] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T06:10:43.890147] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-17T06:10:44.614731] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T06:10:44.690129] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-17T06:10:44.808082] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T06:10:45.490138] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-17T06:10:46.018997] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T06:10:46.290193] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-17T06:10:46.499836] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T06:10:47.090164] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-17T06:10:47.890095] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-17T06:10:47.961772] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T06:10:48.627938] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T06:10:48.690110] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-17T06:10:48.943393] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T06:10:49.490167] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-17T06:10:50.286167] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T06:10:50.295430] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-17T06:10:50.523940] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T06:10:51.090162] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-17T06:10:51.791372] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T06:10:51.890127] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-17T06:10:52.402980] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T06:10:52.690261] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-17T06:10:53.108120] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T06:10:53.443513] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T06:10:53.445875] [INFO ] [REMOTE ] RNP: Full fetch complete (23532 records). [2025-09-17T06:10:53.445970] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-17T06:10:53.499125] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-17T06:10:53.832790] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-17T06:10:53.832940] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-17T06:10:53.833749] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-17T06:10:53.833820] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-17T06:10:53.834823] [DEBUG] [LOCAL ] RNP: Trimmed 23532 records to 15896 (keeping 200 days of data) [2025-09-17T06:10:53.954755] [DEBUG] [LOCAL ] RNP: Primary data saved (15896 records). [2025-09-17T06:10:53.955094] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-17T06:10:53.955208] [INFO ] [MAIN ] Update Progress: 1823/2369 symbols completed. RNP took 45.7s. Estimated remaining: 1h 19m 54s. Rate: 6.8 symbols/min [2025-09-17T06:10:54.153106] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:10:54.170683] [DEBUG] [LOCAL ] ROG: Loaded 16504 existing records from primary storage. [2025-09-17T06:10:54.170848] [INFO ] [MAIN ] ROG: Loaded 16504 existing records. [2025-09-17T06:10:54.295294] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-17T06:10:54.358378] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:10:54.358657] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-17T06:10:54.358726] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-17T06:10:54.359267] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-17T06:10:54.359327] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-17T06:10:54.725920] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:10:54.790746] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T06:10:55.090158] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-11. [2025-09-17T06:10:55.890201] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-17T06:10:56.075785] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T06:10:56.110503] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T06:10:56.117225] [INFO ] [REMOTE ] RNG: Full fetch complete (69303 records). [2025-09-17T06:10:56.117434] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-17T06:10:56.510576] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-17T06:10:56.510736] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-17T06:10:56.511820] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-17T06:10:56.511879] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-17T06:10:56.513373] [DEBUG] [LOCAL ] RNG: Trimmed 69303 records to 48288 (keeping 200 days of data) [2025-09-17T06:10:56.696631] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-09-17T06:10:56.811237] [DEBUG] [LOCAL ] RNG: Primary data saved (48288 records). [2025-09-17T06:10:56.811398] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-17T06:10:56.811507] [INFO ] [MAIN ] Update Progress: 1824/2369 symbols completed. RNG took 51.9s. Estimated remaining: 1h 19m 44s. Rate: 6.8 symbols/min [2025-09-17T06:10:56.981934] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:10:57.016108] [DEBUG] [LOCAL ] ROK: Loaded 32359 existing records from primary storage. [2025-09-17T06:10:57.016269] [INFO ] [MAIN ] ROK: Loaded 32359 existing records. [2025-09-17T06:10:57.195520] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:10:57.195791] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-17T06:10:57.195850] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-17T06:10:57.196723] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-17T06:10:57.196791] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-17T06:10:57.492061] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-17T06:10:57.561168] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:10:57.584090] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T06:10:57.714337] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T06:10:58.290122] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-11. [2025-09-17T06:10:58.859983] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T06:10:58.864127] [INFO ] [REMOTE ] RNR: Full fetch complete (51505 records). [2025-09-17T06:10:58.864278] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-17T06:10:59.099497] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-17T06:10:59.248126] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-17T06:10:59.248240] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-17T06:10:59.249135] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-17T06:10:59.249210] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-17T06:10:59.250331] [DEBUG] [LOCAL ] RNR: Trimmed 51505 records to 34912 (keeping 200 days of data) [2025-09-17T06:10:59.505035] [DEBUG] [LOCAL ] RNR: Primary data saved (34912 records). [2025-09-17T06:10:59.505298] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-17T06:10:59.505468] [INFO ] [MAIN ] Update Progress: 1825/2369 symbols completed. RNR took 32.6s. Estimated remaining: 1h 19m 33s. Rate: 6.8 symbols/min [2025-09-17T06:10:59.686180] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:10:59.730094] [DEBUG] [LOCAL ] ROL: Loaded 37082 existing records from primary storage. [2025-09-17T06:10:59.730286] [INFO ] [MAIN ] ROL: Loaded 37082 existing records. [2025-09-17T06:10:59.893077] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-17T06:10:59.916833] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:10:59.917968] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-17T06:10:59.918121] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-17T06:10:59.919065] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-17T06:10:59.919130] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-17T06:11:00.275915] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T06:11:00.309311] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:11:00.329867] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T06:11:00.690131] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-09-17T06:11:01.387221] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T06:11:01.490102] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-11. [2025-09-17T06:11:02.274069] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T06:11:02.290094] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-09-17T06:11:03.090115] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-17T06:11:03.168123] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T06:11:03.890193] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-17T06:11:03.969415] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T06:11:04.182454] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T06:11:04.188352] [INFO ] [REMOTE ] RNST: Full fetch complete (52684 records). [2025-09-17T06:11:04.188574] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-17T06:11:04.599873] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-17T06:11:04.600010] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-17T06:11:04.601267] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-17T06:11:04.601365] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-17T06:11:04.602864] [DEBUG] [LOCAL ] RNST: Trimmed 52684 records to 37415 (keeping 200 days of data) [2025-09-17T06:11:04.695160] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-09-17T06:11:04.804414] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T06:11:04.865985] [DEBUG] [LOCAL ] RNST: Primary data saved (37415 records). [2025-09-17T06:11:04.866170] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-17T06:11:04.866283] [INFO ] [MAIN ] Update Progress: 1826/2369 symbols completed. RNST took 30.0s. Estimated remaining: 1h 19m 23s. Rate: 6.8 symbols/min [2025-09-17T06:11:05.067973] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:11:05.100424] [DEBUG] [LOCAL ] RPM: Loaded 30788 existing records from primary storage. [2025-09-17T06:11:05.100595] [INFO ] [MAIN ] RPM: Loaded 30788 existing records. [2025-09-17T06:11:05.283950] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:11:05.284191] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-17T06:11:05.284252] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-17T06:11:05.285092] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-17T06:11:05.285169] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-17T06:11:05.498788] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-17T06:11:05.649979] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:11:06.290186] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-17T06:11:06.404502] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T06:11:07.090130] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-17T06:11:07.176321] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T06:11:07.426630] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T06:11:07.890152] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-17T06:11:08.690101] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-17T06:11:08.805053] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T06:11:09.301427] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T06:11:09.490101] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-17T06:11:10.290224] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-11. [2025-09-17T06:11:10.480293] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T06:11:11.090164] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-17T06:11:11.170901] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T06:11:11.480936] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T06:11:11.890197] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-09-17T06:11:12.689534] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T06:11:12.699543] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-17T06:11:12.888373] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T06:11:13.490197] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-09-17T06:11:13.870818] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T06:11:14.290209] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-17T06:11:14.817456] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T06:11:15.090150] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-17T06:11:15.304058] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T06:11:15.890202] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-17T06:11:16.690096] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-17T06:11:16.726049] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T06:11:17.353304] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T06:11:17.490173] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-17T06:11:18.290112] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-17T06:11:18.487313] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T06:11:18.870815] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T06:11:19.090081] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-17T06:11:19.486166] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T06:11:19.890152] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-17T06:11:20.690208] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-17T06:11:20.948936] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T06:11:21.016787] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T06:11:21.490200] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-17T06:11:21.768454] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T06:11:22.290144] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-17T06:11:23.090164] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-17T06:11:23.250786] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T06:11:23.376999] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T06:11:23.890131] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-17T06:11:24.091666] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T06:11:24.094291] [INFO ] [REMOTE ] ROG: Full fetch complete (30641 records). [2025-09-17T06:11:24.094417] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-17T06:11:24.481329] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-17T06:11:24.481430] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-17T06:11:24.482091] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-17T06:11:24.482156] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-17T06:11:24.482951] [DEBUG] [LOCAL ] ROG: Trimmed 30641 records to 23511 (keeping 200 days of data) [2025-09-17T06:11:24.624498] [DEBUG] [LOCAL ] ROG: Primary data saved (23511 records). [2025-09-17T06:11:24.624669] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-17T06:11:24.624763] [INFO ] [MAIN ] Update Progress: 1827/2369 symbols completed. ROG took 30.7s. Estimated remaining: 1h 19m 18s. Rate: 6.8 symbols/min [2025-09-17T06:11:24.695321] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-17T06:11:24.806593] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:11:24.822081] [DEBUG] [LOCAL ] RPT: Loaded 14514 existing records from primary storage. [2025-09-17T06:11:24.822227] [INFO ] [MAIN ] RPT: Loaded 14514 existing records. [2025-09-17T06:11:24.998547] [WARN ] [MAIN ] RPT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:11:24.998849] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-17T06:11:24.998903] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-17T06:11:24.999261] [DEBUG] [LOCAL ] RPT: Deleted primary data file. [2025-09-17T06:11:24.999318] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-17T06:11:25.358849] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:11:25.490167] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-17T06:11:25.585690] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T06:11:26.290194] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-11. [2025-09-17T06:11:26.488451] [DEBUG] [REMOTE ] RPT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:11:26.488830] [WARN ] [REMOTE ] RPT: No data returned for month 2024-11 [2025-09-17T06:11:26.532876] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T06:11:26.923097] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T06:11:27.090141] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-17T06:11:27.890182] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-17T06:11:28.291976] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T06:11:28.690143] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-17T06:11:29.490165] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-09-17T06:11:29.547423] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T06:11:30.290106] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-17T06:11:30.478391] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T06:11:30.613464] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T06:11:31.090130] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-17T06:11:31.746504] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T06:11:31.751703] [INFO ] [REMOTE ] ROK: Full fetch complete (63466 records). [2025-09-17T06:11:31.751915] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-17T06:11:31.898893] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-17T06:11:32.154966] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-17T06:11:32.155144] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-17T06:11:32.156271] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-17T06:11:32.156445] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-17T06:11:32.169361] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T06:11:32.174170] [DEBUG] [LOCAL ] ROK: Trimmed 63466 records to 44181 (keeping 200 days of data) [2025-09-17T06:11:32.458984] [DEBUG] [LOCAL ] ROK: Primary data saved (44181 records). [2025-09-17T06:11:32.459146] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-17T06:11:32.459241] [INFO ] [MAIN ] Update Progress: 1828/2369 symbols completed. ROK took 35.6s. Estimated remaining: 1h 19m 9s. Rate: 6.8 symbols/min [2025-09-17T06:11:32.635165] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:11:32.658152] [DEBUG] [LOCAL ] RQI: Loaded 21100 existing records from primary storage. [2025-09-17T06:11:32.658338] [INFO ] [MAIN ] RQI: Loaded 21100 existing records. [2025-09-17T06:11:32.695197] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-17T06:11:32.844200] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:11:32.844547] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-17T06:11:32.844626] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-17T06:11:32.845262] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-17T06:11:32.845340] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-17T06:11:33.227546] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:11:33.490128] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-17T06:11:33.764899] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T06:11:34.290121] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-17T06:11:34.332077] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T06:11:34.498012] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T06:11:35.090194] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-11. [2025-09-17T06:11:35.890171] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-17T06:11:35.930523] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T06:11:36.247233] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T06:11:36.690149] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-17T06:11:37.277194] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T06:11:37.282309] [INFO ] [REMOTE ] RPM: Full fetch complete (58329 records). [2025-09-17T06:11:37.282499] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-17T06:11:37.495269] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-17T06:11:37.684924] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-17T06:11:37.685036] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-17T06:11:37.686177] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-17T06:11:37.686237] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-17T06:11:37.687405] [DEBUG] [LOCAL ] RPM: Trimmed 58329 records to 41100 (keeping 200 days of data) [2025-09-17T06:11:37.810838] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T06:11:37.970982] [DEBUG] [LOCAL ] RPM: Primary data saved (41100 records). [2025-09-17T06:11:37.971193] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-17T06:11:37.971319] [INFO ] [MAIN ] Update Progress: 1829/2369 symbols completed. RPM took 33.1s. Estimated remaining: 1h 18m 59s. Rate: 6.8 symbols/min [2025-09-17T06:11:38.141838] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:11:38.178607] [DEBUG] [LOCAL ] RRC: Loaded 39320 existing records from primary storage. [2025-09-17T06:11:38.178817] [INFO ] [MAIN ] RRC: Loaded 39320 existing records. [2025-09-17T06:11:38.295214] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-09-17T06:11:38.357250] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:11:38.357496] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-17T06:11:38.357572] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-17T06:11:38.358542] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-17T06:11:38.358622] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-17T06:11:38.737038] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:11:39.090153] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-17T06:11:39.266708] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T06:11:39.274588] [INFO ] [REMOTE ] ROL: Full fetch complete (72394 records). [2025-09-17T06:11:39.274763] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-17T06:11:39.676228] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-17T06:11:39.676446] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-17T06:11:39.677672] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-17T06:11:39.677862] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-17T06:11:39.697090] [DEBUG] [LOCAL ] ROL: Trimmed 72394 records to 50280 (keeping 200 days of data) [2025-09-17T06:11:39.697752] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T06:11:39.896736] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-09-17T06:11:40.034805] [DEBUG] [LOCAL ] ROL: Primary data saved (50280 records). [2025-09-17T06:11:40.034978] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-17T06:11:40.035077] [INFO ] [MAIN ] Update Progress: 1830/2369 symbols completed. ROL took 40.5s. Estimated remaining: 1h 18m 48s. Rate: 6.8 symbols/min [2025-09-17T06:11:40.229897] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:11:40.231554] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T06:11:40.272876] [DEBUG] [LOCAL ] RRX: Loaded 30168 existing records from primary storage. [2025-09-17T06:11:40.273053] [INFO ] [MAIN ] RRX: Loaded 30168 existing records. [2025-09-17T06:11:40.449997] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:11:40.450246] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-17T06:11:40.450303] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-17T06:11:40.451014] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-17T06:11:40.451074] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-17T06:11:40.698707] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-11. [2025-09-17T06:11:40.810255] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:11:41.307700] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T06:11:41.490142] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-17T06:11:42.290102] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-17T06:11:42.536278] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T06:11:42.971461] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-11 (2.27 seconds). [2025-09-17T06:11:43.090083] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-17T06:11:43.643021] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T06:11:43.890112] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-17T06:11:44.690103] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-11. [2025-09-17T06:11:44.738764] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T06:11:45.257295] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T06:11:45.490133] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-17T06:11:46.117244] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T06:11:46.290108] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-17T06:11:46.373922] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T06:11:47.090129] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-17T06:11:47.890154] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-09-17T06:11:48.116392] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T06:11:48.439375] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T06:11:48.690143] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-17T06:11:48.978133] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T06:11:49.490169] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-09-17T06:11:49.688114] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T06:11:50.290132] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-17T06:11:51.090236] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-17T06:11:51.362874] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T06:11:51.365307] [INFO ] [REMOTE ] RPT: Full fetch complete (28160 records). [2025-09-17T06:11:51.365410] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-17T06:11:51.557426] [WARN ] [VALIDATOR ] RPT: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-17T06:11:51.557876] [FATAL] [MAIN ] RPT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:11:51.557938] [WARN ] [MAIN ] RPT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:11:51.558006] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-17T06:11:51.558078] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-09-17T06:11:51.558124] [INFO ] [LOCAL ] RPT: Starting deletion of derivative data. [2025-09-17T06:11:51.558513] [DEBUG] [LOCAL ] RPT: Deleted derivative data file. [2025-09-17T06:11:51.558627] [INFO ] [MAIN ] Update Progress: 1831/2369 symbols completed. RPT took 26.9s. Estimated remaining: 1h 18m 40s. Rate: 6.8 symbols/min [2025-09-17T06:11:51.730751] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:11:51.751499] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-17T06:11:51.779164] [DEBUG] [LOCAL ] RS: Loaded 18087 existing records from primary storage. [2025-09-17T06:11:51.779332] [INFO ] [MAIN ] RS: Loaded 18087 existing records. [2025-09-17T06:11:51.895235] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-17T06:11:51.970031] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:11:51.970263] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-17T06:11:51.970334] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-17T06:11:51.970847] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-17T06:11:51.970910] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-17T06:11:52.327491] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:11:52.690182] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-11. [2025-09-17T06:11:52.767175] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T06:11:53.490116] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-17T06:11:53.616490] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T06:11:53.871109] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T06:11:54.290287] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-09-17T06:11:55.090140] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-17T06:11:55.339494] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T06:11:55.898319] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-17T06:11:55.900503] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T06:11:56.690142] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-09-17T06:11:56.903475] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T06:11:57.246346] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T06:11:57.490170] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-17T06:11:58.091896] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T06:11:58.290151] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-17T06:11:58.715667] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T06:11:59.090110] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-17T06:11:59.486630] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T06:11:59.890148] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-17T06:12:00.661913] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T06:12:00.690082] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-17T06:12:01.271052] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T06:12:01.490171] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-17T06:12:02.290110] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-17T06:12:02.673370] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T06:12:03.090149] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-17T06:12:03.890136] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-17T06:12:04.306486] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T06:12:04.659227] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T06:12:04.690093] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-17T06:12:04.839805] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (3.35 seconds). [2025-09-17T06:12:05.358827] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T06:12:05.490105] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-17T06:12:05.842992] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T06:12:06.290141] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-17T06:12:06.939044] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T06:12:07.090139] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-17T06:12:07.890100] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-17T06:12:08.061455] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T06:12:08.454157] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T06:12:08.690166] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-17T06:12:09.379400] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T06:12:09.490151] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-17T06:12:09.979062] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T06:12:10.290146] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-17T06:12:10.743951] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T06:12:10.748269] [INFO ] [REMOTE ] RQI: Full fetch complete (42974 records). [2025-09-17T06:12:10.748421] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-17T06:12:11.095345] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-17T06:12:11.142823] [DEBUG] [VALIDATOR ] RQI: All expected trading days are present. [2025-09-17T06:12:11.142931] [DEBUG] [VALIDATOR ] RQI: Primary data validation passed. [2025-09-17T06:12:11.143860] [INFO ] [MAIN ] RQI: Fetched primary data is valid. [2025-09-17T06:12:11.143946] [DEBUG] [LOCAL ] RQI: Saving primary data. [2025-09-17T06:12:11.146033] [DEBUG] [LOCAL ] RQI: Trimmed 42974 records to 29102 (keeping 200 days of data) [2025-09-17T06:12:11.346002] [DEBUG] [LOCAL ] RQI: Primary data saved (29102 records). [2025-09-17T06:12:11.346262] [INFO ] [MAIN ] RQI: Full history saved. [2025-09-17T06:12:11.346443] [INFO ] [MAIN ] Update Progress: 1832/2369 symbols completed. RQI took 38.9s. Estimated remaining: 1h 18m 35s. Rate: 6.8 symbols/min [2025-09-17T06:12:11.522511] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:12:11.529194] [DEBUG] [LOCAL ] RSF: Loaded 3399 existing records from primary storage. [2025-09-17T06:12:11.529367] [INFO ] [MAIN ] RSF: Loaded 3399 existing records. [2025-09-17T06:12:11.722465] [WARN ] [MAIN ] RSF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:12:11.722814] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-17T06:12:11.722898] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-17T06:12:11.723167] [DEBUG] [LOCAL ] RSF: Deleted primary data file. [2025-09-17T06:12:11.723244] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-17T06:12:11.904761] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-17T06:12:12.101411] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:12:12.321058] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T06:12:12.444694] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T06:12:12.690164] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-17T06:12:13.490113] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-17T06:12:13.553581] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T06:12:13.625464] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T06:12:14.290134] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-17T06:12:15.090141] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-17T06:12:15.632997] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T06:12:15.890130] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-17T06:12:15.967499] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T06:12:15.973121] [INFO ] [REMOTE ] RRX: Full fetch complete (57722 records). [2025-09-17T06:12:15.973352] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-17T06:12:16.165254] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T06:12:16.217346] [INFO ] [REMOTE ] RS: Full fetch complete (39297 records). [2025-09-17T06:12:16.266216] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-17T06:12:16.509193] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-17T06:12:16.538536] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-17T06:12:16.539632] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-17T06:12:16.548421] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-17T06:12:16.652530] [DEBUG] [LOCAL ] RRX: Trimmed 57722 records to 41134 (keeping 200 days of data) [2025-09-17T06:12:16.690369] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-11. [2025-09-17T06:12:16.866931] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-17T06:12:16.870804] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-17T06:12:16.872528] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-17T06:12:16.874803] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-17T06:12:16.879319] [DEBUG] [LOCAL ] RS: Trimmed 39297 records to 25931 (keeping 200 days of data) [2025-09-17T06:12:17.183145] [DEBUG] [LOCAL ] RS: Primary data saved (25931 records). [2025-09-17T06:12:17.184901] [INFO ] [MAIN ] RS: Full history saved. [2025-09-17T06:12:17.186584] [INFO ] [MAIN ] Update Progress: 1833/2369 symbols completed. RS took 25.6s. Estimated remaining: 1h 18m 25s. Rate: 6.8 symbols/min [2025-09-17T06:12:17.372026] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:12:17.389313] [DEBUG] [LOCAL ] RRX: Primary data saved (41134 records). [2025-09-17T06:12:17.389498] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-17T06:12:17.389670] [INFO ] [MAIN ] Update Progress: 1834/2369 symbols completed. RRX took 37.4s. Estimated remaining: 1h 18m 14s. Rate: 6.8 symbols/min [2025-09-17T06:12:17.587549] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:12:17.589392] [DEBUG] [LOCAL ] RSG: Loaded 35194 existing records from primary storage. [2025-09-17T06:12:17.589572] [INFO ] [MAIN ] RSG: Loaded 35194 existing records. [2025-09-17T06:12:17.786286] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:12:17.796055] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-17T06:12:17.796546] [DEBUG] [LOCAL ] RSI: Loaded 34601 existing records from primary storage. [2025-09-17T06:12:17.796601] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-17T06:12:17.796714] [INFO ] [MAIN ] RSI: Loaded 34601 existing records. [2025-09-17T06:12:17.827814] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-17T06:12:17.876419] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-17T06:12:18.091726] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:12:18.150035] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-17T06:12:18.191472] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-17T06:12:18.219810] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-17T06:12:18.228030] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T06:12:18.260620] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-17T06:12:18.246135] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-09-17T06:12:18.433245] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:12:18.443753] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-11. [2025-09-17T06:12:18.703354] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:12:18.734211] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (2.84 seconds). [2025-09-17T06:12:18.756456] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T06:12:19.090130] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-11. [2025-09-17T06:12:19.890192] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-17T06:12:20.191010] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T06:12:20.449590] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T06:12:20.690132] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-09-17T06:12:20.780890] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T06:12:21.490162] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-17T06:12:22.073113] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T06:12:22.290185] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-17T06:12:22.347838] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T06:12:23.090147] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-09-17T06:12:23.890175] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-09-17T06:12:23.986673] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T06:12:23.993435] [INFO ] [REMOTE ] RRC: Full fetch complete (76015 records). [2025-09-17T06:12:23.993616] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-17T06:12:24.427351] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-17T06:12:24.427478] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-17T06:12:24.428729] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-17T06:12:24.428808] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-17T06:12:24.430659] [DEBUG] [LOCAL ] RRC: Trimmed 76015 records to 52781 (keeping 200 days of data) [2025-09-17T06:12:24.690781] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-17T06:12:24.780431] [DEBUG] [LOCAL ] RRC: Primary data saved (52781 records). [2025-09-17T06:12:24.780617] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-17T06:12:24.780773] [INFO ] [MAIN ] Update Progress: 1835/2369 symbols completed. RRC took 46.8s. Estimated remaining: 1h 18m 5s. Rate: 6.8 symbols/min [2025-09-17T06:12:24.951777] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:12:24.979242] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T06:12:25.005683] [DEBUG] [LOCAL ] RSKD: Loaded 24980 existing records from primary storage. [2025-09-17T06:12:25.005842] [INFO ] [MAIN ] RSKD: Loaded 24980 existing records. [2025-09-17T06:12:25.111488] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T06:12:25.192237] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:12:25.192468] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-17T06:12:25.192538] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-17T06:12:25.193111] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-17T06:12:25.193176] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-17T06:12:25.494864] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-17T06:12:25.552886] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:12:25.583261] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T06:12:26.290192] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-09-17T06:12:27.090136] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-11. [2025-09-17T06:12:27.241989] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T06:12:27.620050] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T06:12:27.890130] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-17T06:12:28.499814] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T06:12:28.690147] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-09-17T06:12:29.452737] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T06:12:29.490122] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-17T06:12:30.024168] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T06:12:30.290133] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-09-17T06:12:31.090130] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-17T06:12:31.203369] [DEBUG] [REMOTE ] RSF: Error fetching primary data for 2025-04: 'API call returned an empty response.' [2025-09-17T06:12:31.203733] [WARN ] [REMOTE ] RSF: No data returned for month 2025-04 [2025-09-17T06:12:31.751022] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T06:12:31.832193] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-17T06:12:31.890109] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-17T06:12:32.690136] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-17T06:12:33.099403] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-17T06:12:33.490124] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-17T06:12:33.782229] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T06:12:33.851949] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-17T06:12:34.290136] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-17T06:12:35.090150] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-17T06:12:35.890121] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-17T06:12:36.130876] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T06:12:36.541022] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T06:12:36.690122] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-17T06:12:36.776579] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T06:12:37.490352] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-17T06:12:38.047354] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T06:12:38.290149] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-17T06:12:38.730030] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T06:12:39.090149] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-17T06:12:39.552095] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T06:12:39.890143] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-17T06:12:40.690102] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-17T06:12:41.035473] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T06:12:41.191895] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T06:12:41.192901] [INFO ] [REMOTE ] RSF: Full fetch complete (5055 records). [2025-09-17T06:12:41.192999] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-17T06:12:41.369514] [WARN ] [VALIDATOR ] RSF: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T06:12:41.369748] [FATAL] [MAIN ] RSF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:12:41.369798] [WARN ] [MAIN ] RSF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:12:41.369839] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-17T06:12:41.369915] [DEBUG] [LOCAL ] RSF: No primary data file found to delete. [2025-09-17T06:12:41.369961] [INFO ] [LOCAL ] RSF: Starting deletion of derivative data. [2025-09-17T06:12:41.370267] [DEBUG] [LOCAL ] RSF: Deleted derivative data file. [2025-09-17T06:12:41.370359] [INFO ] [MAIN ] Update Progress: 1836/2369 symbols completed. RSF took 30.0s. Estimated remaining: 1h 17m 58s. Rate: 6.8 symbols/min [2025-09-17T06:12:41.495240] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-17T06:12:41.542901] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:12:41.578311] [DEBUG] [LOCAL ] RTO: Loaded 29228 existing records from primary storage. [2025-09-17T06:12:41.578537] [INFO ] [MAIN ] RTO: Loaded 29228 existing records. [2025-09-17T06:12:41.760704] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:12:41.760959] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-17T06:12:41.761251] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-17T06:12:41.770357] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-17T06:12:41.783120] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-17T06:12:41.853883] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T06:12:42.159165] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:12:42.290121] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-11. [2025-09-17T06:12:43.039432] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T06:12:43.090179] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-17T06:12:43.863918] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T06:12:43.890107] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-17T06:12:44.651078] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T06:12:44.690099] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-17T06:12:45.374992] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T06:12:45.490117] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-09-17T06:12:46.239117] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T06:12:46.290092] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-17T06:12:47.090140] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-17T06:12:47.190059] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T06:12:47.854882] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T06:12:47.890109] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-17T06:12:48.690200] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-17T06:12:48.954589] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T06:12:48.960876] [INFO ] [REMOTE ] RSG: Full fetch complete (67512 records). [2025-09-17T06:12:48.961053] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-17T06:12:49.365198] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-17T06:12:49.365335] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-17T06:12:49.366413] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-17T06:12:49.366485] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-17T06:12:49.369852] [DEBUG] [LOCAL ] RSG: Trimmed 67512 records to 47449 (keeping 200 days of data) [2025-09-17T06:12:49.494838] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-09-17T06:12:49.651076] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T06:12:49.723060] [DEBUG] [LOCAL ] RSG: Primary data saved (47449 records). [2025-09-17T06:12:49.723294] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-17T06:12:49.723428] [INFO ] [MAIN ] Update Progress: 1837/2369 symbols completed. RSG took 32.5s. Estimated remaining: 1h 17m 49s. Rate: 6.8 symbols/min [2025-09-17T06:12:50.099467] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T06:12:50.290194] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-17T06:12:51.090191] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-17T06:12:51.307943] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T06:12:51.623575] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T06:12:51.890134] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-17T06:12:52.629467] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T06:12:52.635799] [INFO ] [REMOTE ] RSI: Full fetch complete (69420 records). [2025-09-17T06:12:52.636006] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-17T06:12:52.698130] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-17T06:12:53.051483] [DEBUG] [VALIDATOR ] RSI: All expected trading days are present. [2025-09-17T06:12:53.051607] [DEBUG] [VALIDATOR ] RSI: Primary data validation passed. [2025-09-17T06:12:53.052763] [INFO ] [MAIN ] RSI: Fetched primary data is valid. [2025-09-17T06:12:53.052824] [DEBUG] [LOCAL ] RSI: Saving primary data. [2025-09-17T06:12:53.054469] [DEBUG] [LOCAL ] RSI: Trimmed 69420 records to 47306 (keeping 200 days of data) [2025-09-17T06:12:53.348255] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T06:12:53.365237] [DEBUG] [LOCAL ] RSI: Primary data saved (47306 records). [2025-09-17T06:12:53.365356] [INFO ] [MAIN ] RSI: Full history saved. [2025-09-17T06:12:53.365453] [INFO ] [MAIN ] Update Progress: 1838/2369 symbols completed. RSI took 36.0s. Estimated remaining: 1h 17m 39s. Rate: 6.8 symbols/min [2025-09-17T06:12:53.490180] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-17T06:12:54.045104] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T06:12:54.290177] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-17T06:12:55.085152] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T06:12:55.092458] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-17T06:12:55.952584] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T06:12:55.962295] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-17T06:12:56.099067] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T06:12:56.690148] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-17T06:12:57.615683] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T06:12:57.625234] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-17T06:12:57.664951] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T06:12:57.669015] [INFO ] [REMOTE ] RSKD: Full fetch complete (48328 records). [2025-09-17T06:12:57.669117] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-17T06:12:58.049106] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-17T06:12:58.049205] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-17T06:12:58.050127] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-17T06:12:58.050212] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-17T06:12:58.051464] [DEBUG] [LOCAL ] RSKD: Trimmed 48328 records to 34258 (keeping 200 days of data) [2025-09-17T06:12:58.245950] [DEBUG] [LOCAL ] RSKD: Primary data saved (34258 records). [2025-09-17T06:12:58.246148] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-17T06:12:58.246296] [INFO ] [MAIN ] Update Progress: 1839/2369 symbols completed. RSKD took 33.5s. Estimated remaining: 1h 17m 29s. Rate: 6.8 symbols/min [2025-09-17T06:12:59.135824] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T06:12:59.144256] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-17T06:13:00.603850] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T06:13:00.611885] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-17T06:13:02.322572] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T06:13:02.332315] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-17T06:13:03.972231] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T06:13:03.981786] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-17T06:13:05.251176] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T06:13:05.256143] [INFO ] [REMOTE ] RTO: Full fetch complete (58531 records). [2025-09-17T06:13:05.256287] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-17T06:13:05.642834] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-17T06:13:05.642936] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-17T06:13:05.643862] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-17T06:13:05.643919] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-17T06:13:05.645171] [DEBUG] [LOCAL ] RTO: Trimmed 58531 records to 40747 (keeping 200 days of data) [2025-09-17T06:13:05.900079] [DEBUG] [LOCAL ] RTO: Primary data saved (40747 records). [2025-09-17T06:13:05.900246] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-17T06:13:05.900373] [INFO ] [MAIN ] Update Progress: 1840/2369 symbols completed. RTO took 24.5s. Estimated remaining: 1h 17m 20s. Rate: 6.8 symbols/min [2025-09-17T06:13:06.597711] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:13:06.596185] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:13:06.589658] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:13:06.600881] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:13:06.641931] [DEBUG] [LOCAL ] RVT: Loaded 19541 existing records from primary storage. [2025-09-17T06:13:06.659403] [INFO ] [MAIN ] RVT: Loaded 19541 existing records. [2025-09-17T06:13:06.789053] [DEBUG] [LOCAL ] RVLV: Loaded 35444 existing records from primary storage. [2025-09-17T06:13:06.801805] [INFO ] [MAIN ] RVLV: Loaded 35444 existing records. [2025-09-17T06:13:06.802634] [DEBUG] [LOCAL ] RVTY: Loaded 35314 existing records from primary storage. [2025-09-17T06:13:06.801606] [DEBUG] [LOCAL ] RTX: Loaded 40065 existing records from primary storage. [2025-09-17T06:13:06.819354] [INFO ] [MAIN ] RVTY: Loaded 35314 existing records. [2025-09-17T06:13:06.835074] [INFO ] [MAIN ] RTX: Loaded 40065 existing records. [2025-09-17T06:13:07.096025] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:13:07.215201] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-17T06:13:07.294444] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-17T06:13:07.362891] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:13:07.402271] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-17T06:13:07.465109] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:13:07.464905] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:13:07.464774] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-17T06:13:07.465546] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-17T06:13:07.465669] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-17T06:13:07.464969] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-17T06:13:07.466028] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-17T06:13:07.465866] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-17T06:13:07.477698] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-17T06:13:07.512044] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-17T06:13:07.521060] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-17T06:13:07.520889] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-17T06:13:07.540837] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-17T06:13:07.546091] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-17T06:13:07.594349] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-17T06:13:08.778864] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:13:08.842559] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:13:08.830753] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-11. [2025-09-17T06:13:08.936755] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-11. [2025-09-17T06:13:08.970296] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:13:08.991921] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-11. [2025-09-17T06:13:08.991546] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:13:08.993420] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-11. [2025-09-17T06:13:10.257530] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T06:13:10.264043] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-09-17T06:13:10.563483] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T06:13:10.574608] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-09-17T06:13:10.602079] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T06:13:10.611441] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-09-17T06:13:11.041587] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-17T06:13:11.053162] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-09-17T06:13:11.219505] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T06:13:11.226490] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-17T06:13:12.112467] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T06:13:12.120613] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-17T06:13:12.153762] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T06:13:12.163925] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-17T06:13:12.462856] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T06:13:12.472010] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-17T06:13:12.610939] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T06:13:12.622209] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-09-17T06:13:13.445848] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T06:13:13.455347] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-17T06:13:13.507987] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T06:13:13.513465] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-17T06:13:13.789236] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T06:13:13.798561] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-17T06:13:14.568372] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T06:13:14.586005] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-17T06:13:14.652751] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T06:13:14.971557] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T06:13:15.090183] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-17T06:13:15.385929] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T06:13:15.890158] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-17T06:13:16.421167] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T06:13:16.509101] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T06:13:16.690171] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-17T06:13:17.364569] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T06:13:17.490131] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-17T06:13:18.290183] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-17T06:13:18.445794] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T06:13:19.090109] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-17T06:13:19.234557] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T06:13:19.890125] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-17T06:13:20.324414] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T06:13:20.349457] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T06:13:20.690134] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-17T06:13:21.490148] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-17T06:13:21.541845] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T06:13:22.263604] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T06:13:22.290082] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-17T06:13:22.723015] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T06:13:23.090174] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-17T06:13:23.890142] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-17T06:13:23.965570] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T06:13:24.690159] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-17T06:13:25.091870] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T06:13:25.496702] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-17T06:13:25.501983] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T06:13:26.035701] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T06:13:26.290131] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-17T06:13:26.809238] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T06:13:27.090098] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-17T06:13:27.561281] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T06:13:27.890141] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-17T06:13:28.690182] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-17T06:13:28.722251] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T06:13:29.490173] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-17T06:13:29.678277] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T06:13:30.128392] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T06:13:30.132259] [INFO ] [REMOTE ] RVT: Full fetch complete (40123 records). [2025-09-17T06:13:30.132394] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-17T06:13:30.309151] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-17T06:13:30.520143] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-17T06:13:30.520261] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-17T06:13:30.521042] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-17T06:13:30.521098] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-17T06:13:30.522378] [DEBUG] [LOCAL ] RVT: Trimmed 40123 records to 27371 (keeping 200 days of data) [2025-09-17T06:13:30.694836] [DEBUG] [LOCAL ] RVT: Primary data saved (27371 records). [2025-09-17T06:13:30.694993] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-17T06:13:30.695091] [INFO ] [MAIN ] Update Progress: 1841/2369 symbols completed. RVT took 24.8s. Estimated remaining: 1h 17m 16s. Rate: 6.8 symbols/min [2025-09-17T06:13:30.867439] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:13:30.898661] [DEBUG] [LOCAL ] RWT: Loaded 29629 existing records from primary storage. [2025-09-17T06:13:30.898839] [INFO ] [MAIN ] RWT: Loaded 29629 existing records. [2025-09-17T06:13:31.092065] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-17T06:13:31.097824] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:13:31.099336] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-17T06:13:31.099514] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-17T06:13:31.100345] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-17T06:13:31.100408] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-17T06:13:31.426896] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T06:13:31.514525] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:13:31.890139] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-11. [2025-09-17T06:13:32.546083] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-17T06:13:32.690169] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-17T06:13:32.875311] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T06:13:33.401859] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T06:13:33.490124] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-17T06:13:34.290128] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-17T06:13:34.866963] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T06:13:34.873483] [INFO ] [REMOTE ] RVLV: Full fetch complete (68814 records). [2025-09-17T06:13:34.873702] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-17T06:13:35.090105] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-09-17T06:13:35.221685] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.53 seconds). [2025-09-17T06:13:35.338140] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-17T06:13:35.338250] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-17T06:13:35.339332] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-17T06:13:35.339399] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-17T06:13:35.340936] [DEBUG] [LOCAL ] RVLV: Trimmed 68814 records to 48038 (keeping 200 days of data) [2025-09-17T06:13:35.623789] [DEBUG] [LOCAL ] RVLV: Primary data saved (48038 records). [2025-09-17T06:13:35.624009] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-17T06:13:35.624134] [INFO ] [MAIN ] Update Progress: 1842/2369 symbols completed. RVLV took 29.7s. Estimated remaining: 1h 17m 6s. Rate: 6.8 symbols/min [2025-09-17T06:13:35.830478] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:13:35.845551] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-17T06:13:35.847764] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-17T06:13:35.847566] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T06:13:35.857855] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-17T06:13:35.858495] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-17T06:13:35.858575] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-17T06:13:35.858627] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-17T06:13:35.890960] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-17T06:13:36.239273] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:13:36.690132] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-17T06:13:36.800944] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T06:13:37.490204] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-09-17T06:13:38.079539] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T06:13:38.282734] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T06:13:38.288561] [INFO ] [REMOTE ] RVTY: Full fetch complete (66089 records). [2025-09-17T06:13:38.288777] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-17T06:13:38.300756] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-17T06:13:38.714823] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-17T06:13:38.715065] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-17T06:13:38.716262] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-17T06:13:38.716381] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-17T06:13:38.719087] [DEBUG] [LOCAL ] RVTY: Trimmed 66089 records to 47546 (keeping 200 days of data) [2025-09-17T06:13:38.847319] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T06:13:39.085835] [DEBUG] [LOCAL ] RVTY: Primary data saved (47546 records). [2025-09-17T06:13:39.086160] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-17T06:13:39.086333] [INFO ] [MAIN ] Update Progress: 1843/2369 symbols completed. RVTY took 33.2s. Estimated remaining: 1h 16m 56s. Rate: 6.8 symbols/min [2025-09-17T06:13:39.099003] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-17T06:13:39.270931] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:13:39.271211] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-17T06:13:39.271266] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-17T06:13:39.271394] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-17T06:13:39.271456] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-17T06:13:39.271551] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-17T06:13:39.271606] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-17T06:13:39.642154] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:13:39.845681] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T06:13:39.852975] [INFO ] [REMOTE ] RTX: Full fetch complete (77616 records). [2025-09-17T06:13:39.853228] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-17T06:13:39.892724] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-11. [2025-09-17T06:13:40.314939] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-17T06:13:40.322413] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-17T06:13:40.336166] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-17T06:13:40.336361] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-17T06:13:40.338137] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T06:13:40.347393] [DEBUG] [LOCAL ] RTX: Trimmed 77616 records to 53712 (keeping 200 days of data) [2025-09-17T06:13:40.427451] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T06:13:40.690451] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-17T06:13:40.741115] [DEBUG] [LOCAL ] RTX: Primary data saved (53712 records). [2025-09-17T06:13:40.741281] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-17T06:13:40.741379] [INFO ] [MAIN ] Update Progress: 1844/2369 symbols completed. RTX took 34.8s. Estimated remaining: 1h 16m 45s. Rate: 6.8 symbols/min [2025-09-17T06:13:40.913211] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:13:40.917262] [DEBUG] [LOCAL ] RWTP: Loaded 1997 existing records from primary storage. [2025-09-17T06:13:40.917369] [INFO ] [MAIN ] RWTP: Loaded 1997 existing records. [2025-09-17T06:13:41.101698] [WARN ] [MAIN ] RWTP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:13:41.101994] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-17T06:13:41.102056] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-17T06:13:41.102256] [DEBUG] [LOCAL ] RWTP: Deleted primary data file. [2025-09-17T06:13:41.102313] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-17T06:13:41.205248] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T06:13:41.459198] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:13:41.490078] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-11. [2025-09-17T06:13:41.688473] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:13:41.688913] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-11 [2025-09-17T06:13:42.290189] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-17T06:13:42.479372] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:13:42.479778] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-17T06:13:43.090161] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-11. [2025-09-17T06:13:43.425422] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-17T06:13:43.890145] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-17T06:13:44.416033] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T06:13:44.690127] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-09-17T06:13:45.029543] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T06:13:45.490141] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-17T06:13:45.916759] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T06:13:46.290134] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-17T06:13:47.090137] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-17T06:13:47.684135] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T06:13:47.780554] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T06:13:47.890191] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-17T06:13:48.563519] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T06:13:48.690165] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-17T06:13:49.028335] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T06:13:49.490155] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-17T06:13:49.930055] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T06:13:50.290172] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-17T06:13:50.708319] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T06:13:51.090164] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-17T06:13:51.546116] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T06:13:51.890159] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-17T06:13:52.336614] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T06:13:52.690166] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-17T06:13:53.131763] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T06:13:53.490181] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-17T06:13:53.903863] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-17T06:13:54.290136] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-17T06:13:54.866706] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T06:13:55.090130] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-17T06:13:55.890173] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-17T06:13:56.318343] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T06:13:56.690186] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-17T06:13:56.823400] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T06:13:57.243221] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T06:13:57.490147] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-17T06:13:58.290177] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-17T06:13:58.823142] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T06:13:58.957660] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T06:13:59.090198] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-17T06:13:59.374719] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-17T06:13:59.890161] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-17T06:14:00.210754] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T06:14:00.690199] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-17T06:14:01.134693] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T06:14:01.490142] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-17T06:14:02.088407] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T06:14:02.290145] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-17T06:14:02.866195] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T06:14:03.090146] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-17T06:14:03.823268] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T06:14:03.824573] [INFO ] [REMOTE ] RWTO: Full fetch complete (4688 records). [2025-09-17T06:14:03.824694] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-17T06:14:03.895349] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-17T06:14:04.019044] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T06:14:04.019269] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:14:04.019325] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:14:04.019384] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-17T06:14:04.019462] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-17T06:14:04.019513] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-17T06:14:04.019571] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-17T06:14:04.019661] [INFO ] [MAIN ] Update Progress: 1845/2369 symbols completed. RWTO took 24.9s. Estimated remaining: 1h 16m 40s. Rate: 6.8 symbols/min [2025-09-17T06:14:04.195518] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:14:04.236947] [DEBUG] [LOCAL ] RXO: Loaded 35638 existing records from primary storage. [2025-09-17T06:14:04.237134] [INFO ] [MAIN ] RXO: Loaded 35638 existing records. [2025-09-17T06:14:04.416976] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:14:04.417362] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-17T06:14:04.417434] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-17T06:14:04.418571] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-17T06:14:04.418685] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-17T06:14:04.695332] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-17T06:14:04.804703] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:14:05.091107] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T06:14:05.376496] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T06:14:05.490144] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-17T06:14:06.118581] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T06:14:06.290175] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-11. [2025-09-17T06:14:07.090186] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-17T06:14:07.887044] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T06:14:07.899353] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-17T06:14:08.464809] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T06:14:08.466236] [INFO ] [REMOTE ] RWTN: Full fetch complete (3149 records). [2025-09-17T06:14:08.466381] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-17T06:14:08.667619] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T06:14:08.668243] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:14:08.668312] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:14:08.668368] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-17T06:14:08.668669] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-17T06:14:08.668786] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-17T06:14:08.668886] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-17T06:14:08.669058] [INFO ] [MAIN ] Update Progress: 1846/2369 symbols completed. RWTN took 33.0s. Estimated remaining: 1h 16m 30s. Rate: 6.8 symbols/min [2025-09-17T06:14:08.697756] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-09-17T06:14:08.857317] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T06:14:08.874104] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:14:08.922979] [DEBUG] [LOCAL ] RY: Loaded 35331 existing records from primary storage. [2025-09-17T06:14:08.923153] [INFO ] [MAIN ] RY: Loaded 35331 existing records. [2025-09-17T06:14:09.103263] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:14:09.103536] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-17T06:14:09.103596] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-17T06:14:09.104525] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-17T06:14:09.104590] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-17T06:14:09.467360] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:14:09.490082] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-11. [2025-09-17T06:14:10.299959] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-17T06:14:10.305577] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T06:14:11.047384] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T06:14:11.090093] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-09-17T06:14:11.785197] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T06:14:11.890107] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-17T06:14:12.701159] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-17T06:14:12.703787] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T06:14:13.271696] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T06:14:13.286345] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T06:14:13.291547] [INFO ] [REMOTE ] RWT: Full fetch complete (58140 records). [2025-09-17T06:14:13.291711] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-17T06:14:13.495248] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-09-17T06:14:13.673731] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-17T06:14:13.673834] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-17T06:14:13.674772] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-17T06:14:13.674829] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-17T06:14:13.676063] [DEBUG] [LOCAL ] RWT: Trimmed 58140 records to 40497 (keeping 200 days of data) [2025-09-17T06:14:13.914307] [DEBUG] [LOCAL ] RWT: Primary data saved (40497 records). [2025-09-17T06:14:13.914473] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-17T06:14:13.914602] [INFO ] [MAIN ] Update Progress: 1847/2369 symbols completed. RWT took 43.2s. Estimated remaining: 1h 16m 20s. Rate: 6.8 symbols/min [2025-09-17T06:14:14.082823] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:14:14.108631] [DEBUG] [LOCAL ] RYAM: Loaded 25883 existing records from primary storage. [2025-09-17T06:14:14.108819] [INFO ] [MAIN ] RYAM: Loaded 25883 existing records. [2025-09-17T06:14:14.291005] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:14:14.290706] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-17T06:14:14.292235] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-17T06:14:14.292312] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-17T06:14:14.292984] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-17T06:14:14.293050] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-17T06:14:14.647965] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:14:14.848276] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T06:14:15.050812] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T06:14:15.090125] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-11. [2025-09-17T06:14:15.890146] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-17T06:14:16.412938] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T06:14:16.690142] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-09-17T06:14:17.098748] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T06:14:17.490194] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-17T06:14:18.088044] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T06:14:18.290156] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-09-17T06:14:19.074574] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T06:14:19.090083] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-17T06:14:19.400819] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T06:14:19.890155] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-17T06:14:20.690693] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-17T06:14:20.696415] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T06:14:21.096247] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T06:14:21.490201] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-17T06:14:22.223448] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T06:14:22.290176] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-17T06:14:23.020688] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T06:14:23.090101] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-17T06:14:23.732454] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T06:14:23.890159] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-17T06:14:24.552357] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T06:14:24.690187] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-17T06:14:25.498946] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-17T06:14:25.504169] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T06:14:26.290159] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-17T06:14:26.361214] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T06:14:26.954011] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T06:14:26.955961] [INFO ] [REMOTE ] RWTP: Full fetch complete (4236 records). [2025-09-17T06:14:26.956168] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-17T06:14:27.090682] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-17T06:14:27.202167] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T06:14:27.200194] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 158 unique days, need 200 days [2025-09-17T06:14:27.211238] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:14:27.211887] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:14:27.211955] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-17T06:14:27.212032] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-17T06:14:27.212079] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-17T06:14:27.212429] [DEBUG] [LOCAL ] RWTP: Deleted derivative data file. [2025-09-17T06:14:27.212579] [INFO ] [MAIN ] Update Progress: 1848/2369 symbols completed. RWTP took 46.5s. Estimated remaining: 1h 16m 13s. Rate: 6.8 symbols/min [2025-09-17T06:14:27.385588] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:14:27.426486] [DEBUG] [LOCAL ] RYAN: Loaded 32531 existing records from primary storage. [2025-09-17T06:14:27.426691] [INFO ] [MAIN ] RYAN: Loaded 32531 existing records. [2025-09-17T06:14:27.611162] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:14:27.611437] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-17T06:14:27.611498] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-17T06:14:27.612415] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-17T06:14:27.612484] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-17T06:14:27.899129] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-17T06:14:27.985423] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:14:28.611284] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T06:14:28.690322] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-17T06:14:29.343773] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T06:14:29.490199] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-17T06:14:30.270252] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T06:14:30.290088] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-17T06:14:31.090188] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-17T06:14:31.171126] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T06:14:31.178200] [INFO ] [REMOTE ] RXO: Full fetch complete (67499 records). [2025-09-17T06:14:31.178366] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-17T06:14:31.598258] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-17T06:14:31.598431] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-17T06:14:31.600181] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-17T06:14:31.600399] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-17T06:14:31.602914] [DEBUG] [LOCAL ] RXO: Trimmed 67499 records to 47716 (keeping 200 days of data) [2025-09-17T06:14:31.871803] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T06:14:31.890351] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-17T06:14:31.967242] [DEBUG] [LOCAL ] RXO: Primary data saved (47716 records). [2025-09-17T06:14:31.967446] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-17T06:14:31.967595] [INFO ] [MAIN ] Update Progress: 1849/2369 symbols completed. RXO took 27.9s. Estimated remaining: 1h 16m 3s. Rate: 6.8 symbols/min [2025-09-17T06:14:32.145711] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:14:32.161904] [DEBUG] [LOCAL ] RYI: Loaded 16169 existing records from primary storage. [2025-09-17T06:14:32.162048] [INFO ] [MAIN ] RYI: Loaded 16169 existing records. [2025-09-17T06:14:32.338972] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:14:32.339239] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-17T06:14:32.339298] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-17T06:14:32.339878] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-17T06:14:32.339940] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-17T06:14:32.693062] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-11. [2025-09-17T06:14:32.722837] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:14:32.724727] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T06:14:33.490125] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-11. [2025-09-17T06:14:33.622921] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T06:14:33.773705] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T06:14:34.290162] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-09-17T06:14:34.579683] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T06:14:35.090141] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-17T06:14:35.890110] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-17T06:14:35.972157] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T06:14:36.511899] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T06:14:36.690108] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-17T06:14:37.455095] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T06:14:37.490138] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-17T06:14:38.070717] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T06:14:38.290223] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-09-17T06:14:39.028430] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T06:14:39.090128] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-17T06:14:39.842446] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T06:14:39.890099] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-09-17T06:14:40.690141] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-17T06:14:40.755594] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T06:14:40.781307] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T06:14:41.490138] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-17T06:14:42.145241] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T06:14:42.290195] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-17T06:14:42.718936] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T06:14:42.724775] [INFO ] [REMOTE ] RY: Full fetch complete (68387 records). [2025-09-17T06:14:42.724933] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-17T06:14:43.098121] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-17T06:14:43.125904] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-17T06:14:43.126025] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-17T06:14:43.127213] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-17T06:14:43.127395] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-17T06:14:43.129059] [DEBUG] [LOCAL ] RY: Trimmed 68387 records to 48093 (keeping 200 days of data) [2025-09-17T06:14:43.458992] [DEBUG] [LOCAL ] RY: Primary data saved (48093 records). [2025-09-17T06:14:43.459285] [INFO ] [MAIN ] RY: Full history saved. [2025-09-17T06:14:43.459476] [INFO ] [MAIN ] Update Progress: 1850/2369 symbols completed. RY took 34.8s. Estimated remaining: 1h 15m 55s. Rate: 6.8 symbols/min [2025-09-17T06:14:43.636344] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:14:43.650435] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T06:14:43.655702] [INFO ] [REMOTE ] RYAM: Full fetch complete (48445 records). [2025-09-17T06:14:43.655890] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-17T06:14:43.861040] [DEBUG] [LOCAL ] RYN: Loaded 33847 existing records from primary storage. [2025-09-17T06:14:43.895921] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-09-17T06:14:43.896010] [INFO ] [MAIN ] RYN: Loaded 33847 existing records. [2025-09-17T06:14:44.254339] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-17T06:14:44.278724] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-17T06:14:44.280330] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-17T06:14:44.278927] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:14:44.280540] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-17T06:14:44.280810] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-17T06:14:44.281204] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-17T06:14:44.282692] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-17T06:14:44.282783] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-17T06:14:44.317476] [DEBUG] [LOCAL ] RYAM: Trimmed 48445 records to 35181 (keeping 200 days of data) [2025-09-17T06:14:44.779880] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:14:44.792598] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-11. [2025-09-17T06:14:44.900021] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T06:14:44.927153] [DEBUG] [LOCAL ] RYAM: Primary data saved (35181 records). [2025-09-17T06:14:44.927304] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-17T06:14:44.927427] [INFO ] [MAIN ] Update Progress: 1851/2369 symbols completed. RYAM took 31.0s. Estimated remaining: 1h 15m 44s. Rate: 6.8 symbols/min [2025-09-17T06:14:45.097750] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:14:45.105390] [DEBUG] [LOCAL ] RZB: Loaded 4735 existing records from primary storage. [2025-09-17T06:14:45.105591] [INFO ] [MAIN ] RZB: Loaded 4735 existing records. [2025-09-17T06:14:45.286739] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:14:45.287202] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-17T06:14:45.287292] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-17T06:14:45.292951] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-17T06:14:45.300959] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-17T06:14:45.307256] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T06:14:45.500889] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-17T06:14:45.679338] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:14:46.290101] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-11. [2025-09-17T06:14:46.368807] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T06:14:46.936966] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T06:14:47.090141] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-09-17T06:14:47.286525] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T06:14:47.890198] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-09-17T06:14:48.517221] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T06:14:48.582589] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T06:14:48.690140] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-17T06:14:49.490149] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-09-17T06:14:49.748323] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T06:14:49.992748] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T06:14:50.290134] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-17T06:14:51.090157] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-09-17T06:14:51.754507] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T06:14:51.890126] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-17T06:14:52.482478] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T06:14:52.690182] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-17T06:14:52.906096] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T06:14:53.490154] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-17T06:14:53.922664] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T06:14:54.290144] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-17T06:14:54.745997] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T06:14:55.090192] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-17T06:14:55.539080] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T06:14:55.890183] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-17T06:14:56.181272] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T06:14:56.690177] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-17T06:14:57.330680] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T06:14:57.490151] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-17T06:14:58.196951] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T06:14:58.229147] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T06:14:58.290152] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-17T06:14:59.090132] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-17T06:14:59.637156] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T06:14:59.820677] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T06:14:59.890136] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-17T06:15:00.690168] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-17T06:15:00.961223] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T06:15:01.490207] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-17T06:15:02.290132] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-17T06:15:02.751931] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-17T06:15:02.760378] [INFO ] [REMOTE ] RYAN: Full fetch complete (62895 records). [2025-09-17T06:15:02.760615] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-17T06:15:03.106295] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T06:15:03.099837] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-17T06:15:03.191976] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-17T06:15:03.192106] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-17T06:15:03.193253] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-17T06:15:03.193344] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-17T06:15:03.194967] [DEBUG] [LOCAL ] RYAN: Trimmed 62895 records to 43877 (keeping 200 days of data) [2025-09-17T06:15:03.480842] [DEBUG] [LOCAL ] RYAN: Primary data saved (43877 records). [2025-09-17T06:15:03.481052] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-17T06:15:03.481212] [INFO ] [MAIN ] Update Progress: 1852/2369 symbols completed. RYAN took 36.3s. Estimated remaining: 1h 15m 38s. Rate: 6.8 symbols/min [2025-09-17T06:15:03.662099] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:15:03.669243] [DEBUG] [LOCAL ] RZC: Loaded 4971 existing records from primary storage. [2025-09-17T06:15:03.669432] [INFO ] [MAIN ] RZC: Loaded 4971 existing records. [2025-09-17T06:15:03.868901] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:15:03.869178] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-17T06:15:03.869245] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-17T06:15:03.869701] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-17T06:15:03.869778] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-17T06:15:03.904767] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-17T06:15:04.344335] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:15:04.690154] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-11. [2025-09-17T06:15:04.723484] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-17T06:15:04.733526] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T06:15:05.490156] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-17T06:15:05.537173] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T06:15:06.133169] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-09-17T06:15:06.290108] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-09-17T06:15:06.644743] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T06:15:07.041220] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T06:15:07.090134] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-17T06:15:07.715431] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T06:15:07.890133] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-17T06:15:08.690185] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-09-17T06:15:09.490174] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-17T06:15:09.518060] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T06:15:09.547248] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T06:15:10.290151] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-17T06:15:10.606667] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T06:15:10.609921] [INFO ] [REMOTE ] RYI: Full fetch complete (32129 records). [2025-09-17T06:15:10.610049] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-17T06:15:10.895447] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T06:15:11.002354] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-17T06:15:11.002461] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-17T06:15:11.003361] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-17T06:15:11.003419] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-17T06:15:11.004192] [DEBUG] [LOCAL ] RYI: Trimmed 32129 records to 21534 (keeping 200 days of data) [2025-09-17T06:15:11.097864] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-17T06:15:11.141968] [DEBUG] [LOCAL ] RYI: Primary data saved (21534 records). [2025-09-17T06:15:11.142214] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-17T06:15:11.142327] [INFO ] [MAIN ] Update Progress: 1853/2369 symbols completed. RYI took 39.2s. Estimated remaining: 1h 15m 29s. Rate: 6.8 symbols/min [2025-09-17T06:15:11.314366] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:15:11.354735] [DEBUG] [LOCAL ] S: Loaded 39911 existing records from primary storage. [2025-09-17T06:15:11.354917] [INFO ] [MAIN ] S: Loaded 39911 existing records. [2025-09-17T06:15:11.539871] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:15:11.540145] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-17T06:15:11.540209] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-17T06:15:11.541211] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-17T06:15:11.541280] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-17T06:15:11.901569] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-17T06:15:11.907597] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:15:12.075897] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T06:15:12.690184] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-17T06:15:13.359306] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T06:15:13.490158] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-17T06:15:13.597884] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T06:15:14.134418] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T06:15:14.290177] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-17T06:15:15.090142] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-17T06:15:15.827517] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T06:15:15.890144] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-17T06:15:16.343100] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T06:15:16.516525] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T06:15:16.517725] [INFO ] [REMOTE ] RZB: Full fetch complete (8731 records). [2025-09-17T06:15:16.517819] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-17T06:15:16.700156] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-17T06:15:16.901983] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-17T06:15:16.902096] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-17T06:15:16.902387] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-17T06:15:16.902441] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-17T06:15:16.903080] [DEBUG] [LOCAL ] RZB: Trimmed 8731 records to 6241 (keeping 200 days of data) [2025-09-17T06:15:16.942404] [DEBUG] [LOCAL ] RZB: Primary data saved (6241 records). [2025-09-17T06:15:16.942558] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-17T06:15:16.942680] [INFO ] [MAIN ] Update Progress: 1854/2369 symbols completed. RZB took 32.0s. Estimated remaining: 1h 15m 19s. Rate: 6.8 symbols/min [2025-09-17T06:15:17.122263] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:15:17.159949] [DEBUG] [LOCAL ] SA: Loaded 31891 existing records from primary storage. [2025-09-17T06:15:17.160132] [INFO ] [MAIN ] SA: Loaded 31891 existing records. [2025-09-17T06:15:17.348212] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:15:17.348461] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-17T06:15:17.348520] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-17T06:15:17.349303] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-17T06:15:17.349365] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-17T06:15:17.498322] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-17T06:15:17.652565] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T06:15:17.741183] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:15:18.290133] [INFO ] [REMOTE ] S: Fetching primary data for 2024-11. [2025-09-17T06:15:19.090185] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-17T06:15:19.136624] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T06:15:19.143228] [INFO ] [REMOTE ] RYN: Full fetch complete (64189 records). [2025-09-17T06:15:19.143420] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-17T06:15:19.706747] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-17T06:15:19.706908] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-17T06:15:19.708405] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-17T06:15:19.708510] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-17T06:15:19.710296] [DEBUG] [LOCAL ] RYN: Trimmed 64189 records to 45815 (keeping 200 days of data) [2025-09-17T06:15:19.901589] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-11. [2025-09-17T06:15:20.164354] [DEBUG] [LOCAL ] RYN: Primary data saved (45815 records). [2025-09-17T06:15:20.164638] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-17T06:15:20.164814] [INFO ] [MAIN ] Update Progress: 1855/2369 symbols completed. RYN took 36.7s. Estimated remaining: 1h 15m 9s. Rate: 6.8 symbols/min [2025-09-17T06:15:20.410684] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:15:20.420524] [DEBUG] [LOCAL ] SABA: Loaded 6936 existing records from primary storage. [2025-09-17T06:15:20.420720] [INFO ] [MAIN ] SABA: Loaded 6936 existing records. [2025-09-17T06:15:20.631160] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:15:20.631664] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-17T06:15:20.631727] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-17T06:15:20.632176] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-17T06:15:20.632239] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-17T06:15:20.763212] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T06:15:20.806344] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-17T06:15:21.019266] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:15:21.053433] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-11 (2.76 seconds). [2025-09-17T06:15:21.490188] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-11. [2025-09-17T06:15:21.599903] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T06:15:21.753521] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T06:15:21.906875] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T06:15:22.290163] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-09-17T06:15:23.090438] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-17T06:15:23.789561] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T06:15:23.815797] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T06:15:23.890143] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-17T06:15:24.374335] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T06:15:24.690173] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-09-17T06:15:25.490139] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-09-17T06:15:25.513319] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T06:15:26.290218] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-17T06:15:27.007913] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T06:15:27.009529] [INFO ] [REMOTE ] RZC: Full fetch complete (9948 records). [2025-09-17T06:15:27.009628] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-17T06:15:27.095261] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-17T06:15:27.480403] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-17T06:15:27.480556] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-17T06:15:27.480964] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-17T06:15:27.481034] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-17T06:15:27.482056] [DEBUG] [LOCAL ] RZC: Trimmed 9948 records to 6928 (keeping 200 days of data) [2025-09-17T06:15:27.533476] [DEBUG] [LOCAL ] RZC: Primary data saved (6928 records). [2025-09-17T06:15:27.533795] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-17T06:15:27.533986] [INFO ] [MAIN ] Update Progress: 1856/2369 symbols completed. RZC took 24.1s. Estimated remaining: 1h 15m 0s. Rate: 6.8 symbols/min [2025-09-17T06:15:27.756270] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:15:27.817664] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-17T06:15:27.817857] [DEBUG] [LOCAL ] SAFE: Loaded 22425 existing records from primary storage. [2025-09-17T06:15:27.832456] [INFO ] [MAIN ] SAFE: Loaded 22425 existing records. [2025-09-17T06:15:27.900410] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-09-17T06:15:28.040534] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:15:28.040930] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-17T06:15:28.041001] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-17T06:15:28.041835] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-17T06:15:28.041904] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-17T06:15:28.476320] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:15:28.690337] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-09-17T06:15:28.760393] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T06:15:29.490168] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-17T06:15:29.728117] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T06:15:29.934101] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T06:15:30.290118] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-17T06:15:31.042839] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T06:15:31.090113] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-17T06:15:31.890135] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-11. [2025-09-17T06:15:32.109412] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T06:15:32.501196] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T06:15:32.690134] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-17T06:15:33.113141] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T06:15:33.490128] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-09-17T06:15:34.248282] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T06:15:34.290117] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-17T06:15:34.965776] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T06:15:35.090105] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-09-17T06:15:35.890146] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-17T06:15:35.951039] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T06:15:36.014052] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T06:15:36.690157] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-17T06:15:37.490209] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-17T06:15:38.282092] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T06:15:38.290839] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-17T06:15:38.750027] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T06:15:39.090133] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-17T06:15:39.118616] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T06:15:39.890172] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-17T06:15:40.561892] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T06:15:40.690172] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-17T06:15:41.087542] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (5.20 seconds). [2025-09-17T06:15:41.127452] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T06:15:41.155425] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T06:15:41.490169] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-17T06:15:42.290150] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-17T06:15:42.900119] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T06:15:43.090202] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-17T06:15:43.796971] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T06:15:43.866726] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T06:15:43.890080] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-17T06:15:44.681308] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T06:15:44.690068] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-17T06:15:45.465715] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T06:15:45.490093] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-17T06:15:46.290187] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-17T06:15:47.090189] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-17T06:15:47.522072] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T06:15:47.555106] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T06:15:47.833943] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T06:15:47.890147] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-17T06:15:48.630117] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T06:15:48.690151] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-17T06:15:49.490130] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-17T06:15:50.290137] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-17T06:15:50.315051] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T06:15:50.323825] [INFO ] [REMOTE ] SA: Full fetch complete (61186 records). [2025-09-17T06:15:50.324020] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-17T06:15:50.727541] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-17T06:15:50.727730] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-17T06:15:50.728794] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-17T06:15:50.728896] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-17T06:15:50.730536] [DEBUG] [LOCAL ] SA: Trimmed 61186 records to 42890 (keeping 200 days of data) [2025-09-17T06:15:50.748199] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T06:15:51.012878] [DEBUG] [LOCAL ] SA: Primary data saved (42890 records). [2025-09-17T06:15:51.013051] [INFO ] [MAIN ] SA: Full history saved. [2025-09-17T06:15:51.013151] [INFO ] [MAIN ] Update Progress: 1857/2369 symbols completed. SA took 34.1s. Estimated remaining: 1h 14m 55s. Rate: 6.8 symbols/min [2025-09-17T06:15:51.095243] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-17T06:15:51.194290] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:15:51.215338] [DEBUG] [LOCAL ] SAH: Loaded 15649 existing records from primary storage. [2025-09-17T06:15:51.215544] [INFO ] [MAIN ] SAH: Loaded 15649 existing records. [2025-09-17T06:15:51.376862] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T06:15:51.406286] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:15:51.409991] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-17T06:15:51.410171] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-17T06:15:51.410109] [INFO ] [REMOTE ] SABA: Full fetch complete (15549 records). [2025-09-17T06:15:51.410305] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-17T06:15:51.416179] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-17T06:15:51.435682] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-17T06:15:51.896764] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-17T06:15:52.186330] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:15:52.214053] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-17T06:15:52.214166] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-17T06:15:52.214669] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-17T06:15:52.214737] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-17T06:15:52.215339] [DEBUG] [LOCAL ] SABA: Trimmed 15549 records to 9425 (keeping 200 days of data) [2025-09-17T06:15:52.276571] [DEBUG] [LOCAL ] SABA: Primary data saved (9425 records). [2025-09-17T06:15:52.276770] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-17T06:15:52.276873] [INFO ] [MAIN ] Update Progress: 1858/2369 symbols completed. SABA took 32.1s. Estimated remaining: 1h 14m 44s. Rate: 6.8 symbols/min [2025-09-17T06:15:52.450936] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:15:52.451265] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-17T06:15:52.451412] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-17T06:15:52.451615] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-17T06:15:52.451695] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-17T06:15:52.451913] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-17T06:15:52.451992] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-17T06:15:52.702752] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-11. [2025-09-17T06:15:52.740456] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T06:15:52.864725] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:15:53.490167] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-17T06:15:53.835998] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T06:15:54.097331] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-17T06:15:54.290188] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-17T06:15:54.791920] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T06:15:55.090188] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-11. [2025-09-17T06:15:55.409671] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-17T06:15:55.890172] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-09-17T06:15:56.062466] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T06:15:56.690163] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-17T06:15:56.716547] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T06:15:57.009579] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-17T06:15:57.490178] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-17T06:15:58.290144] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-17T06:15:59.090130] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-17T06:15:59.418667] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T06:15:59.547896] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T06:15:59.552599] [INFO ] [REMOTE ] SAFE: Full fetch complete (44836 records). [2025-09-17T06:15:59.552834] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-17T06:15:59.900275] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-09-17T06:15:59.931765] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-17T06:16:00.016028] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-17T06:16:00.016179] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-17T06:16:00.017137] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-17T06:16:00.017614] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-17T06:16:00.018708] [DEBUG] [LOCAL ] SAFE: Trimmed 44836 records to 30542 (keeping 200 days of data) [2025-09-17T06:16:00.210977] [DEBUG] [LOCAL ] SAFE: Primary data saved (30542 records). [2025-09-17T06:16:00.211184] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-17T06:16:00.211349] [INFO ] [MAIN ] Update Progress: 1859/2369 symbols completed. SAFE took 32.7s. Estimated remaining: 1h 14m 35s. Rate: 6.8 symbols/min [2025-09-17T06:16:00.381934] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:16:00.401225] [DEBUG] [LOCAL ] SAM: Loaded 16309 existing records from primary storage. [2025-09-17T06:16:00.401402] [INFO ] [MAIN ] SAM: Loaded 16309 existing records. [2025-09-17T06:16:00.584621] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:16:00.584951] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-17T06:16:00.585038] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-17T06:16:00.585565] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-17T06:16:00.585637] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-17T06:16:00.690293] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-17T06:16:00.971635] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:16:00.986289] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T06:16:01.490192] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-11. [2025-09-17T06:16:02.290192] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-17T06:16:02.455540] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T06:16:02.616534] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T06:16:03.048905] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T06:16:03.090194] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-17T06:16:03.890175] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-17T06:16:04.167404] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T06:16:04.205577] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-17T06:16:04.690145] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-17T06:16:05.027661] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T06:16:05.490132] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-17T06:16:06.290142] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-17T06:16:07.090100] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-17T06:16:07.412766] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T06:16:07.498514] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T06:16:07.529461] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-17T06:16:07.537897] [INFO ] [REMOTE ] S: Full fetch complete (77494 records). [2025-09-17T06:16:07.538306] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-17T06:16:07.895241] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-09-17T06:16:07.946059] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-17T06:16:07.946171] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-17T06:16:07.947266] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-17T06:16:07.947335] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-17T06:16:07.949039] [DEBUG] [LOCAL ] S: Trimmed 77494 records to 53543 (keeping 200 days of data) [2025-09-17T06:16:08.280332] [DEBUG] [LOCAL ] S: Primary data saved (53543 records). [2025-09-17T06:16:08.280549] [INFO ] [MAIN ] S: Full history saved. [2025-09-17T06:16:08.280707] [INFO ] [MAIN ] Update Progress: 1860/2369 symbols completed. S took 57.1s. Estimated remaining: 1h 14m 26s. Rate: 6.8 symbols/min [2025-09-17T06:16:08.450620] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:16:08.492031] [DEBUG] [LOCAL ] SAN: Loaded 39512 existing records from primary storage. [2025-09-17T06:16:08.492409] [INFO ] [MAIN ] SAN: Loaded 39512 existing records. [2025-09-17T06:16:08.681438] [WARN ] [MAIN ] SAN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:16:08.681776] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-17T06:16:08.681865] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-17T06:16:08.690696] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-17T06:16:08.689286] [DEBUG] [LOCAL ] SAN: Deleted primary data file. [2025-09-17T06:16:08.691106] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-17T06:16:08.715632] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T06:16:09.069448] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:16:09.490140] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-11. [2025-09-17T06:16:09.885524] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T06:16:10.290129] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-17T06:16:10.635963] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T06:16:11.090208] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-17T06:16:11.167745] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T06:16:11.890181] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-09-17T06:16:12.230619] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T06:16:12.690355] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-17T06:16:13.490205] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-17T06:16:13.562476] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T06:16:13.820110] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T06:16:13.821990] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-17T06:16:14.290253] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-17T06:16:15.090168] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-17T06:16:15.425670] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T06:16:15.890158] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-09-17T06:16:16.051125] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T06:16:16.690172] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-17T06:16:17.490876] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-17T06:16:17.596517] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T06:16:17.824576] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-17T06:16:17.900312] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T06:16:18.290146] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-17T06:16:19.090189] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-17T06:16:19.466535] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T06:16:19.890212] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-17T06:16:20.016059] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T06:16:20.250743] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T06:16:20.251561] [INFO ] [REMOTE ] SAJ: Full fetch complete (973 records). [2025-09-17T06:16:20.251668] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-17T06:16:20.437472] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-17T06:16:20.437708] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:16:20.437779] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:16:20.437853] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-17T06:16:20.437945] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-17T06:16:20.438019] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-17T06:16:20.438138] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-17T06:16:20.438239] [INFO ] [MAIN ] Update Progress: 1861/2369 symbols completed. SAJ took 28.2s. Estimated remaining: 1h 14m 19s. Rate: 6.8 symbols/min [2025-09-17T06:16:20.616802] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:16:20.658949] [DEBUG] [LOCAL ] SAND: Loaded 38514 existing records from primary storage. [2025-09-17T06:16:20.659152] [INFO ] [MAIN ] SAND: Loaded 38514 existing records. [2025-09-17T06:16:20.695257] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-17T06:16:20.844838] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:16:20.845101] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-17T06:16:20.845165] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-17T06:16:20.846104] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-17T06:16:20.846181] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-17T06:16:21.226888] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:16:21.490133] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-17T06:16:21.505749] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T06:16:22.290145] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-17T06:16:22.956323] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T06:16:23.090133] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-17T06:16:23.361620] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T06:16:23.860333] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T06:16:23.890153] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-17T06:16:24.690149] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-17T06:16:25.490131] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-17T06:16:25.904063] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T06:16:26.047329] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T06:16:26.184076] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T06:16:26.186928] [INFO ] [REMOTE ] SAH: Full fetch complete (30325 records). [2025-09-17T06:16:26.187099] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-17T06:16:26.295228] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-17T06:16:26.586027] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-17T06:16:26.586151] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-17T06:16:26.586958] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-17T06:16:26.587034] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-17T06:16:26.588044] [DEBUG] [LOCAL ] SAH: Trimmed 30325 records to 22358 (keeping 200 days of data) [2025-09-17T06:16:26.750865] [DEBUG] [LOCAL ] SAH: Primary data saved (22358 records). [2025-09-17T06:16:26.751038] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-17T06:16:26.751178] [INFO ] [MAIN ] Update Progress: 1862/2369 symbols completed. SAH took 35.7s. Estimated remaining: 1h 14m 9s. Rate: 6.8 symbols/min [2025-09-17T06:16:26.928626] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:16:26.966754] [DEBUG] [LOCAL ] SAP: Loaded 36995 existing records from primary storage. [2025-09-17T06:16:26.966925] [INFO ] [MAIN ] SAP: Loaded 36995 existing records. [2025-09-17T06:16:27.095391] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-17T06:16:27.162435] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:16:27.162729] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-17T06:16:27.162804] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-17T06:16:27.163592] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-17T06:16:27.163691] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-17T06:16:27.532053] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:16:27.550146] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T06:16:27.890140] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-17T06:16:28.690114] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-11. [2025-09-17T06:16:29.041572] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T06:16:29.066188] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T06:16:29.071153] [INFO ] [REMOTE ] SAM: Full fetch complete (29917 records). [2025-09-17T06:16:29.071333] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-17T06:16:29.468293] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-17T06:16:29.468421] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-17T06:16:29.469159] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-17T06:16:29.469257] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-17T06:16:29.470220] [DEBUG] [LOCAL ] SAM: Trimmed 29917 records to 21690 (keeping 200 days of data) [2025-09-17T06:16:29.530850] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-11. [2025-09-17T06:16:29.623973] [DEBUG] [LOCAL ] SAM: Primary data saved (21690 records). [2025-09-17T06:16:29.624137] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-17T06:16:29.624271] [INFO ] [MAIN ] Update Progress: 1863/2369 symbols completed. SAM took 29.4s. Estimated remaining: 1h 13m 59s. Rate: 6.8 symbols/min [2025-09-17T06:16:29.801995] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:16:29.816736] [DEBUG] [LOCAL ] SAR: Loaded 12205 existing records from primary storage. [2025-09-17T06:16:29.816909] [INFO ] [MAIN ] SAR: Loaded 12205 existing records. [2025-09-17T06:16:30.010177] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:16:30.010452] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-17T06:16:30.010514] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-17T06:16:30.010926] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-17T06:16:30.011001] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-17T06:16:30.300883] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-17T06:16:30.390624] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:16:30.421361] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T06:16:31.090151] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-11. [2025-09-17T06:16:31.162419] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T06:16:31.890135] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-09-17T06:16:32.010060] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T06:16:32.157368] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T06:16:32.690179] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-09-17T06:16:33.490164] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-17T06:16:33.543705] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T06:16:33.590504] [DEBUG] [REMOTE ] SAN: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-17T06:16:33.590935] [WARN ] [REMOTE ] SAN: No data returned for month 2025-06 [2025-09-17T06:16:34.057588] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T06:16:34.290231] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-09-17T06:16:35.090167] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-09-17T06:16:35.890151] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-09-17T06:16:36.013759] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T06:16:36.066902] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T06:16:36.690138] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-17T06:16:37.490125] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-09-17T06:16:37.556634] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T06:16:37.980220] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T06:16:38.290099] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-17T06:16:38.374448] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T06:16:39.090150] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-17T06:16:39.890166] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-17T06:16:40.155045] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T06:16:40.690114] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-17T06:16:41.155207] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-17T06:16:41.482839] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T06:16:41.492850] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-17T06:16:42.246282] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T06:16:42.290076] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-17T06:16:43.090130] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-17T06:16:43.124036] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T06:16:43.890170] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-17T06:16:44.079845] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T06:16:44.089030] [INFO ] [REMOTE ] SAN: Full fetch complete (68414 records). [2025-09-17T06:16:44.089336] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-17T06:16:44.295712] [WARN ] [VALIDATOR ] SAN: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T06:16:44.296505] [FATAL] [MAIN ] SAN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:16:44.296575] [WARN ] [MAIN ] SAN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:16:44.296824] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-17T06:16:44.296998] [DEBUG] [LOCAL ] SAN: No primary data file found to delete. [2025-09-17T06:16:44.297079] [INFO ] [LOCAL ] SAN: Starting deletion of derivative data. [2025-09-17T06:16:44.297427] [DEBUG] [LOCAL ] SAN: Deleted derivative data file. [2025-09-17T06:16:44.297590] [INFO ] [MAIN ] Update Progress: 1864/2369 symbols completed. SAN took 36.0s. Estimated remaining: 1h 13m 52s. Rate: 6.8 symbols/min [2025-09-17T06:16:44.470334] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:16:44.506285] [DEBUG] [LOCAL ] SARO: Loaded 35849 existing records from primary storage. [2025-09-17T06:16:44.506457] [INFO ] [MAIN ] SARO: Loaded 35849 existing records. [2025-09-17T06:16:44.684786] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:16:44.685059] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-17T06:16:44.685119] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-17T06:16:44.685828] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-17T06:16:44.685888] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-17T06:16:44.716666] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-17T06:16:45.110394] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:16:45.139099] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T06:16:45.490179] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-17T06:16:45.818585] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T06:16:45.844246] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T06:16:46.290181] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-17T06:16:47.090191] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-17T06:16:47.298848] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T06:16:47.322336] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T06:16:47.890134] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-17T06:16:48.699322] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-17T06:16:48.704117] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T06:16:48.851484] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T06:16:49.490134] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-17T06:16:50.290169] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-17T06:16:50.436765] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T06:16:51.090207] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-17T06:16:51.263766] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T06:16:51.322211] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T06:16:51.890133] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-17T06:16:52.558489] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T06:16:52.690164] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-17T06:16:52.876564] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T06:16:53.490199] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-11. [2025-09-17T06:16:54.290146] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-17T06:16:54.732943] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T06:16:54.860037] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T06:16:55.090181] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-09-17T06:16:55.802438] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T06:16:55.890172] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-17T06:16:56.307676] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T06:16:56.690142] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-17T06:16:57.490144] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-17T06:16:57.778508] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-17T06:16:57.784871] [INFO ] [REMOTE ] SAP: Full fetch complete (71311 records). [2025-09-17T06:16:57.785023] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-17T06:16:58.183987] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-17T06:16:58.184209] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-17T06:16:58.185812] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-17T06:16:58.185902] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-17T06:16:58.188000] [DEBUG] [LOCAL ] SAP: Trimmed 71311 records to 50090 (keeping 200 days of data) [2025-09-17T06:16:58.290344] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-17T06:16:58.324225] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T06:16:58.558508] [DEBUG] [LOCAL ] SAP: Primary data saved (50090 records). [2025-09-17T06:16:58.558718] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-17T06:16:58.558854] [INFO ] [MAIN ] Update Progress: 1865/2369 symbols completed. SAP took 31.8s. Estimated remaining: 1h 13m 44s. Rate: 6.8 symbols/min [2025-09-17T06:16:58.737165] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:16:58.737382] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-17T06:16:58.737457] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-17T06:16:58.737606] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-17T06:16:58.737688] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-17T06:16:58.737743] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-17T06:16:58.737784] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-17T06:16:59.099535] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-17T06:16:59.125137] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:16:59.166767] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T06:16:59.419052] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T06:16:59.890152] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-11. [2025-09-17T06:17:00.310979] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T06:17:00.572207] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T06:17:00.690102] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-17T06:17:01.490167] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-17T06:17:02.290154] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-17T06:17:02.464021] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T06:17:02.497284] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T06:17:02.730483] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-17T06:17:03.090153] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-17T06:17:03.890172] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-17T06:17:04.093530] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T06:17:04.096720] [INFO ] [REMOTE ] SAR: Full fetch complete (22735 records). [2025-09-17T06:17:04.096854] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-17T06:17:04.475355] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-17T06:17:04.475477] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-17T06:17:04.476043] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-17T06:17:04.476420] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-17T06:17:04.477188] [DEBUG] [LOCAL ] SAR: Trimmed 22735 records to 16529 (keeping 200 days of data) [2025-09-17T06:17:04.580731] [DEBUG] [LOCAL ] SAR: Primary data saved (16529 records). [2025-09-17T06:17:04.580886] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-17T06:17:04.580979] [INFO ] [MAIN ] Update Progress: 1866/2369 symbols completed. SAR took 35.0s. Estimated remaining: 1h 13m 35s. Rate: 6.8 symbols/min [2025-09-17T06:17:04.695279] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-17T06:17:04.752635] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:17:04.752878] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-17T06:17:04.752927] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-17T06:17:04.753040] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-17T06:17:04.753100] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-17T06:17:04.753151] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-17T06:17:04.753195] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-17T06:17:05.105063] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-17T06:17:05.109774] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:17:05.490155] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-17T06:17:05.512590] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T06:17:05.518813] [INFO ] [REMOTE ] SAND: Full fetch complete (74057 records). [2025-09-17T06:17:05.518945] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-17T06:17:05.868612] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-17T06:17:05.908395] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-17T06:17:05.908506] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-17T06:17:05.909590] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-17T06:17:05.909677] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-17T06:17:05.911228] [DEBUG] [LOCAL ] SAND: Trimmed 74057 records to 51777 (keeping 200 days of data) [2025-09-17T06:17:06.288972] [DEBUG] [LOCAL ] SAND: Primary data saved (51777 records). [2025-09-17T06:17:06.289211] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-17T06:17:06.289372] [INFO ] [MAIN ] Update Progress: 1867/2369 symbols completed. SAND took 45.9s. Estimated remaining: 1h 13m 24s. Rate: 6.8 symbols/min [2025-09-17T06:17:06.296932] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-17T06:17:06.561519] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:17:06.561821] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-17T06:17:06.563107] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-17T06:17:06.563278] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-17T06:17:06.563343] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-17T06:17:06.563422] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-17T06:17:06.563487] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-17T06:17:07.095987] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:17:07.091544] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-17T06:17:07.521338] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-17T06:17:07.890143] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-11. [2025-09-17T06:17:08.011393] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T06:17:08.208488] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-17T06:17:08.690149] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-17T06:17:09.172895] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T06:17:09.490148] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-17T06:17:09.912527] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T06:17:10.290128] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-17T06:17:10.538950] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.25 seconds). [2025-09-17T06:17:11.090141] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-11. [2025-09-17T06:17:11.444431] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T06:17:11.890144] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-17T06:17:12.235559] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-17T06:17:12.690144] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-17T06:17:13.490148] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-17T06:17:13.751821] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-17T06:17:14.176222] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T06:17:14.290119] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-17T06:17:14.618084] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T06:17:15.090141] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-17T06:17:15.424736] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T06:17:15.890169] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-17T06:17:16.211360] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-17T06:17:16.690163] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-17T06:17:17.043404] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T06:17:17.490124] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-17T06:17:17.750824] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-17T06:17:18.290184] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-17T06:17:18.535803] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-17T06:17:19.090130] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-17T06:17:19.380486] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (0.29 seconds). [2025-09-17T06:17:19.890148] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-17T06:17:20.310842] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T06:17:20.690194] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-17T06:17:21.066822] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T06:17:21.490142] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-17T06:17:22.290142] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-17T06:17:22.644902] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-17T06:17:23.089130] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T06:17:23.098467] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-17T06:17:23.420971] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T06:17:23.421751] [INFO ] [REMOTE ] SAT: Full fetch complete (1622 records). [2025-09-17T06:17:23.421834] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-17T06:17:23.602473] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-17T06:17:23.602720] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:17:23.602773] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:17:23.602824] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-17T06:17:23.602927] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-17T06:17:23.602976] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-17T06:17:23.603037] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-17T06:17:23.603111] [INFO ] [MAIN ] Update Progress: 1868/2369 symbols completed. SAT took 25.0s. Estimated remaining: 1h 13m 18s. Rate: 6.8 symbols/min [2025-09-17T06:17:23.776099] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:17:23.799770] [DEBUG] [LOCAL ] SB: Loaded 24178 existing records from primary storage. [2025-09-17T06:17:23.799930] [INFO ] [MAIN ] SB: Loaded 24178 existing records. [2025-09-17T06:17:23.897802] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-17T06:17:23.988816] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:17:23.989056] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-17T06:17:23.989111] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-17T06:17:23.989880] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-17T06:17:23.989943] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-17T06:17:24.345282] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:17:24.690138] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-17T06:17:25.170784] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-17T06:17:25.490130] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-17T06:17:25.628989] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T06:17:25.918945] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T06:17:26.290146] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-17T06:17:26.594837] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-17T06:17:27.090157] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-17T06:17:27.890128] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-11. [2025-09-17T06:17:28.673511] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T06:17:28.690087] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-17T06:17:28.819763] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T06:17:28.964503] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-17T06:17:29.490151] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-17T06:17:29.819882] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-17T06:17:30.290127] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-17T06:17:31.090163] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-09-17T06:17:31.838838] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T06:17:31.845043] [INFO ] [REMOTE ] SARO: Full fetch complete (68624 records). [2025-09-17T06:17:31.845274] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-17T06:17:31.901672] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-17T06:17:32.247656] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-17T06:17:32.247787] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-17T06:17:32.248933] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-17T06:17:32.249004] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-17T06:17:32.250568] [DEBUG] [LOCAL ] SARO: Trimmed 68624 records to 48767 (keeping 200 days of data) [2025-09-17T06:17:32.317178] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-17T06:17:32.557243] [DEBUG] [LOCAL ] SARO: Primary data saved (48767 records). [2025-09-17T06:17:32.557431] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-17T06:17:32.557542] [INFO ] [MAIN ] Update Progress: 1869/2369 symbols completed. SARO took 48.3s. Estimated remaining: 1h 13m 9s. Rate: 6.8 symbols/min [2025-09-17T06:17:32.690336] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-17T06:17:32.739212] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:17:32.739603] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-17T06:17:32.739836] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-17T06:17:32.740119] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-17T06:17:32.740214] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-17T06:17:32.740372] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-17T06:17:32.740532] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-17T06:17:32.888388] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T06:17:33.089067] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-17T06:17:33.169007] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:17:33.490113] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-11. [2025-09-17T06:17:33.684377] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:17:33.684825] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-11 [2025-09-17T06:17:34.290357] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-17T06:17:34.390185] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-17T06:17:34.390475] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-17T06:17:35.090135] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-17T06:17:35.502634] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T06:17:35.503436] [INFO ] [REMOTE ] SAY: Full fetch complete (1466 records). [2025-09-17T06:17:35.503533] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-17T06:17:35.683190] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T06:17:35.683383] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:17:35.683442] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:17:35.683512] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-17T06:17:35.683633] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-17T06:17:35.683723] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-17T06:17:35.683795] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-17T06:17:35.683885] [INFO ] [MAIN ] Update Progress: 1870/2369 symbols completed. SAY took 31.1s. Estimated remaining: 1h 12m 59s. Rate: 6.8 symbols/min [2025-09-17T06:17:35.854160] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:17:35.894158] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-09-17T06:17:35.895177] [DEBUG] [LOCAL ] SBH: Loaded 36732 existing records from primary storage. [2025-09-17T06:17:35.895913] [INFO ] [MAIN ] SBH: Loaded 36732 existing records. [2025-09-17T06:17:36.073029] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:17:36.073293] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-17T06:17:36.073383] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-17T06:17:36.074298] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-17T06:17:36.074371] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-17T06:17:36.174935] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:17:36.175529] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-09-17T06:17:36.427137] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:17:36.690122] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-17T06:17:36.896896] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:17:36.897260] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-17T06:17:37.490133] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-09-17T06:17:38.290131] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-17T06:17:38.704158] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T06:17:38.884695] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T06:17:39.090154] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-17T06:17:39.890145] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-17T06:17:40.080425] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:17:40.080849] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-17T06:17:40.538631] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T06:17:40.690149] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-17T06:17:40.887432] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:17:40.887878] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-17T06:17:41.490164] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-17T06:17:41.675672] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:17:41.676036] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-17T06:17:42.290189] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-17T06:17:42.693768] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T06:17:42.694627] [INFO ] [REMOTE ] SAZ: Full fetch complete (1818 records). [2025-09-17T06:17:42.694731] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-17T06:17:42.872968] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T06:17:42.873201] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:17:42.873280] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:17:42.873344] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-17T06:17:42.873474] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-17T06:17:42.873540] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-17T06:17:42.873635] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-17T06:17:42.873768] [INFO ] [MAIN ] Update Progress: 1871/2369 symbols completed. SAZ took 36.6s. Estimated remaining: 1h 12m 49s. Rate: 6.8 symbols/min [2025-09-17T06:17:43.045269] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:17:43.052681] [DEBUG] [LOCAL ] SBI: Loaded 5420 existing records from primary storage. [2025-09-17T06:17:43.052846] [INFO ] [MAIN ] SBI: Loaded 5420 existing records. [2025-09-17T06:17:43.095355] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-17T06:17:43.236320] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:17:43.236577] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-17T06:17:43.236634] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-17T06:17:43.236972] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-17T06:17:43.237029] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-17T06:17:43.587195] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:17:43.890144] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-17T06:17:44.085625] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:17:44.086010] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-17T06:17:44.520147] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T06:17:44.690175] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-11. [2025-09-17T06:17:45.490170] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-11. [2025-09-17T06:17:46.140244] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T06:17:46.144580] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T06:17:46.290207] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-09-17T06:17:46.889343] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T06:17:47.090166] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-09-17T06:17:47.758908] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T06:17:47.890165] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-17T06:17:48.690140] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-17T06:17:49.013072] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-17T06:17:49.307523] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T06:17:49.490149] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-17T06:17:49.888678] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-17T06:17:50.290139] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-17T06:17:50.856895] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T06:17:51.090137] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-17T06:17:51.890184] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-17T06:17:52.300175] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-17T06:17:52.421110] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T06:17:52.690165] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-17T06:17:53.490146] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-09-17T06:17:53.641126] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T06:17:54.290164] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-17T06:17:55.090149] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-17T06:17:55.212368] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T06:17:55.642073] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T06:17:55.643192] [INFO ] [REMOTE ] SBDS: Full fetch complete (896 records). [2025-09-17T06:17:55.643286] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-17T06:17:55.836152] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 38 unique days, need 200 days [2025-09-17T06:17:55.836397] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:17:55.836608] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:17:55.836693] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-17T06:17:55.836784] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-17T06:17:55.836901] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-17T06:17:55.836963] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-17T06:17:55.837209] [INFO ] [MAIN ] Update Progress: 1872/2369 symbols completed. SBDS took 23.3s. Estimated remaining: 1h 12m 42s. Rate: 6.8 symbols/min [2025-09-17T06:17:55.890663] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-17T06:17:55.907831] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T06:17:56.043190] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:17:56.050992] [DEBUG] [LOCAL ] SBR: Loaded 5269 existing records from primary storage. [2025-09-17T06:17:56.051120] [INFO ] [MAIN ] SBR: Loaded 5269 existing records. [2025-09-17T06:17:56.225688] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:17:56.225964] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-17T06:17:56.226022] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-17T06:17:56.226289] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-17T06:17:56.226346] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-17T06:17:56.579002] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:17:56.587103] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T06:17:56.690115] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-11. [2025-09-17T06:17:57.329686] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T06:17:57.490167] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-09-17T06:17:58.015807] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-17T06:17:58.290214] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-17T06:17:59.090172] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-09-17T06:17:59.686318] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T06:17:59.708852] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T06:17:59.890213] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-17T06:18:00.513236] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T06:18:00.690196] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-09-17T06:18:01.490154] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-17T06:18:02.290162] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-17T06:18:02.635107] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T06:18:02.785271] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-17T06:18:03.090198] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-17T06:18:03.890182] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-17T06:18:04.344679] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T06:18:04.690123] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-17T06:18:05.197059] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T06:18:05.230629] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T06:18:05.490133] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-17T06:18:05.533036] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (3.24 seconds). [2025-09-17T06:18:05.537079] [INFO ] [REMOTE ] SB: Full fetch complete (51020 records). [2025-09-17T06:18:05.537193] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-17T06:18:05.933274] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-17T06:18:05.933395] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-17T06:18:05.934656] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-17T06:18:05.934734] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-17T06:18:05.935972] [DEBUG] [LOCAL ] SB: Trimmed 51020 records to 33778 (keeping 200 days of data) [2025-09-17T06:18:06.139127] [DEBUG] [LOCAL ] SB: Primary data saved (33778 records). [2025-09-17T06:18:06.139300] [INFO ] [MAIN ] SB: Full history saved. [2025-09-17T06:18:06.139404] [INFO ] [MAIN ] Update Progress: 1873/2369 symbols completed. SB took 42.5s. Estimated remaining: 1h 12m 33s. Rate: 6.8 symbols/min [2025-09-17T06:18:06.297925] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-17T06:18:06.318974] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:18:06.354284] [DEBUG] [LOCAL ] SBS: Loaded 36694 existing records from primary storage. [2025-09-17T06:18:06.354481] [INFO ] [MAIN ] SBS: Loaded 36694 existing records. [2025-09-17T06:18:06.531128] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:18:06.531411] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-17T06:18:06.531492] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-17T06:18:06.532344] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-17T06:18:06.532424] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-17T06:18:06.893605] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:18:06.927465] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T06:18:06.987216] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T06:18:07.090146] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-17T06:18:07.890156] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-17T06:18:07.920660] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T06:18:08.395982] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T06:18:08.690175] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-17T06:18:09.113419] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T06:18:09.114638] [INFO ] [REMOTE ] SBI: Full fetch complete (10603 records). [2025-09-17T06:18:09.114751] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-17T06:18:09.479263] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-17T06:18:09.479364] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-17T06:18:09.479655] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-17T06:18:09.479705] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-17T06:18:09.480244] [DEBUG] [LOCAL ] SBI: Trimmed 10603 records to 7698 (keeping 200 days of data) [2025-09-17T06:18:09.499571] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-17T06:18:09.528122] [DEBUG] [LOCAL ] SBI: Primary data saved (7698 records). [2025-09-17T06:18:09.528249] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-17T06:18:09.528339] [INFO ] [MAIN ] Update Progress: 1874/2369 symbols completed. SBI took 26.7s. Estimated remaining: 1h 12m 23s. Rate: 6.8 symbols/min [2025-09-17T06:18:09.697164] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:18:09.709818] [DEBUG] [LOCAL ] SBSI: Loaded 10476 existing records from primary storage. [2025-09-17T06:18:09.709968] [INFO ] [MAIN ] SBSI: Loaded 10476 existing records. [2025-09-17T06:18:09.892137] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:18:09.892406] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-17T06:18:09.892466] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-17T06:18:09.893673] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-17T06:18:09.893736] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-17T06:18:10.260200] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:18:10.265707] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T06:18:10.290082] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-11. [2025-09-17T06:18:11.090190] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-17T06:18:11.222355] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T06:18:11.890206] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-09-17T06:18:12.530885] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T06:18:12.690153] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-17T06:18:12.792189] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T06:18:13.418382] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T06:18:13.490143] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-17T06:18:14.290181] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-11. [2025-09-17T06:18:15.079087] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T06:18:15.090086] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-17T06:18:15.864437] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T06:18:15.890079] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-09-17T06:18:16.503490] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T06:18:16.690203] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-17T06:18:17.490173] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-17T06:18:18.290171] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-09-17T06:18:18.489523] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T06:18:18.531097] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-09-17T06:18:18.953149] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T06:18:19.090176] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-17T06:18:19.393597] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T06:18:19.890146] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-17T06:18:20.306296] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T06:18:20.398792] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T06:18:20.690129] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-09-17T06:18:21.490134] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-17T06:18:22.260131] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T06:18:22.275612] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T06:18:22.290089] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-17T06:18:23.090135] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-17T06:18:23.750584] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T06:18:23.752343] [INFO ] [REMOTE ] SBR: Full fetch complete (10962 records). [2025-09-17T06:18:23.752482] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-17T06:18:23.890137] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T06:18:23.895322] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-17T06:18:24.198275] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-17T06:18:24.198385] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-17T06:18:24.198710] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-17T06:18:24.198784] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-17T06:18:24.199426] [DEBUG] [LOCAL ] SBR: Trimmed 10962 records to 7276 (keeping 200 days of data) [2025-09-17T06:18:24.246272] [DEBUG] [LOCAL ] SBR: Primary data saved (7276 records). [2025-09-17T06:18:24.246422] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-17T06:18:24.246521] [INFO ] [MAIN ] Update Progress: 1875/2369 symbols completed. SBR took 28.4s. Estimated remaining: 1h 12m 16s. Rate: 6.8 symbols/min [2025-09-17T06:18:24.429006] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:18:24.469966] [DEBUG] [LOCAL ] SBSW: Loaded 39565 existing records from primary storage. [2025-09-17T06:18:24.470167] [INFO ] [MAIN ] SBSW: Loaded 39565 existing records. [2025-09-17T06:18:24.657718] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:18:24.657977] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-17T06:18:24.658036] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-17T06:18:24.658844] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-17T06:18:24.658907] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-17T06:18:24.695297] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-17T06:18:25.023395] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:18:25.038320] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T06:18:25.490174] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-11. [2025-09-17T06:18:26.290142] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-17T06:18:26.441302] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T06:18:26.447591] [INFO ] [REMOTE ] SBH: Full fetch complete (72629 records). [2025-09-17T06:18:26.447771] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-17T06:18:26.847152] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-17T06:18:26.847271] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-17T06:18:26.848356] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-17T06:18:26.848447] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-17T06:18:26.849940] [DEBUG] [LOCAL ] SBH: Trimmed 72629 records to 49788 (keeping 200 days of data) [2025-09-17T06:18:27.093744] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-17T06:18:27.152921] [DEBUG] [LOCAL ] SBH: Primary data saved (49788 records). [2025-09-17T06:18:27.153071] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-17T06:18:27.153165] [INFO ] [MAIN ] Update Progress: 1876/2369 symbols completed. SBH took 51.5s. Estimated remaining: 1h 12m 6s. Rate: 6.8 symbols/min [2025-09-17T06:18:27.324364] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:18:27.328046] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-17T06:18:27.328291] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-17T06:18:27.328580] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-17T06:18:27.328791] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-17T06:18:27.329088] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-17T06:18:27.329186] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-17T06:18:27.430728] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T06:18:27.753183] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-11 (2.26 seconds). [2025-09-17T06:18:27.751105] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:18:27.890146] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-11. [2025-09-17T06:18:28.205425] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-17T06:18:28.695225] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-09-17T06:18:28.713182] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T06:18:29.490132] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-17T06:18:30.290144] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-17T06:18:30.326427] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T06:18:31.090129] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-17T06:18:31.232093] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T06:18:31.315844] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-09-17T06:18:31.514515] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T06:18:31.890130] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-17T06:18:32.690135] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-17T06:18:32.815250] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T06:18:32.907699] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-09-17T06:18:33.490134] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-17T06:18:34.290123] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-17T06:18:34.436815] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T06:18:34.539411] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-17T06:18:35.090149] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-09-17T06:18:35.890152] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-17T06:18:36.690173] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-17T06:18:36.833760] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T06:18:37.490179] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-17T06:18:37.641543] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T06:18:37.670036] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T06:18:37.701799] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-09-17T06:18:38.290132] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-17T06:18:39.090177] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-17T06:18:39.307579] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.22 seconds). [2025-09-17T06:18:39.810730] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T06:18:39.890123] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-17T06:18:40.209428] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T06:18:40.690165] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-17T06:18:41.490191] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-17T06:18:42.290185] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-17T06:18:42.542620] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T06:18:43.090186] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-17T06:18:43.165869] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T06:18:43.196064] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T06:18:43.198418] [INFO ] [REMOTE ] SBSI: Full fetch complete (20830 records). [2025-09-17T06:18:43.198516] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-17T06:18:43.563275] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-17T06:18:43.563382] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-17T06:18:43.563891] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-17T06:18:43.563948] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-17T06:18:43.564599] [DEBUG] [LOCAL ] SBSI: Trimmed 20830 records to 14601 (keeping 200 days of data) [2025-09-17T06:18:43.657456] [DEBUG] [LOCAL ] SBSI: Primary data saved (14601 records). [2025-09-17T06:18:43.657623] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-17T06:18:43.657764] [INFO ] [MAIN ] Update Progress: 1877/2369 symbols completed. SBSI took 34.1s. Estimated remaining: 1h 11m 59s. Rate: 6.8 symbols/min [2025-09-17T06:18:43.890190] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-17T06:18:44.690228] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-17T06:18:44.968815] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T06:18:45.221667] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T06:18:45.490241] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-17T06:18:45.626071] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T06:18:45.868794] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-17T06:18:46.290141] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-17T06:18:47.090189] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-17T06:18:47.852413] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T06:18:47.858526] [INFO ] [REMOTE ] SBS: Full fetch complete (69945 records). [2025-09-17T06:18:47.858695] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-17T06:18:47.902820] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-17T06:18:48.252287] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-17T06:18:48.252392] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-17T06:18:48.253409] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-17T06:18:48.253475] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-17T06:18:48.254864] [DEBUG] [LOCAL ] SBS: Trimmed 69945 records to 49352 (keeping 200 days of data) [2025-09-17T06:18:48.348963] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T06:18:48.583672] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T06:18:48.598506] [DEBUG] [LOCAL ] SBS: Primary data saved (49352 records). [2025-09-17T06:18:48.598637] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-17T06:18:48.598742] [INFO ] [MAIN ] Update Progress: 1878/2369 symbols completed. SBS took 42.5s. Estimated remaining: 1h 11m 49s. Rate: 6.8 symbols/min [2025-09-17T06:18:48.690084] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-17T06:18:49.104678] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T06:18:49.105498] [INFO ] [REMOTE ] SBXD: Full fetch complete (3081 records). [2025-09-17T06:18:49.105595] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-17T06:18:49.284241] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-17T06:18:49.284467] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:18:49.284542] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:18:49.284639] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-17T06:18:49.284750] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-17T06:18:49.284817] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-17T06:18:49.284886] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-17T06:18:49.284973] [INFO ] [MAIN ] Update Progress: 1879/2369 symbols completed. SBXD took 22.1s. Estimated remaining: 1h 11m 38s. Rate: 6.8 symbols/min [2025-09-17T06:18:49.490240] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-17T06:18:51.388685] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T06:18:51.399991] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-17T06:18:53.323131] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T06:18:53.334364] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-17T06:18:55.463423] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T06:18:55.475424] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-17T06:18:57.369502] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T06:18:57.380806] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-17T06:18:59.078370] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T06:18:59.084980] [INFO ] [REMOTE ] SBSW: Full fetch complete (76345 records). [2025-09-17T06:18:59.085136] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-17T06:18:59.472293] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-17T06:18:59.472427] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-17T06:18:59.473774] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-17T06:18:59.473859] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-17T06:18:59.475426] [DEBUG] [LOCAL ] SBSW: Trimmed 76345 records to 52930 (keeping 200 days of data) [2025-09-17T06:18:59.779781] [DEBUG] [LOCAL ] SBSW: Primary data saved (52930 records). [2025-09-17T06:18:59.779956] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-17T06:18:59.780080] [INFO ] [MAIN ] Update Progress: 1880/2369 symbols completed. SBSW took 35.5s. Estimated remaining: 1h 11m 30s. Rate: 6.8 symbols/min [2025-09-17T06:19:00.393754] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:19:00.421014] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:19:00.427337] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:19:00.472016] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:19:00.482799] [DEBUG] [LOCAL ] SCD: Loaded 10312 existing records from primary storage. [2025-09-17T06:19:00.483000] [INFO ] [MAIN ] SCD: Loaded 10312 existing records. [2025-09-17T06:19:00.739352] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:19:00.741104] [DEBUG] [LOCAL ] SCI: Loaded 34725 existing records from primary storage. [2025-09-17T06:19:00.741869] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-17T06:19:00.742051] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-17T06:19:00.740173] [DEBUG] [LOCAL ] SCCO: Loaded 36392 existing records from primary storage. [2025-09-17T06:19:00.741920] [INFO ] [MAIN ] SCI: Loaded 34725 existing records. [2025-09-17T06:19:00.741740] [DEBUG] [LOCAL ] SCHW: Loaded 40035 existing records from primary storage. [2025-09-17T06:19:00.747434] [INFO ] [MAIN ] SCCO: Loaded 36392 existing records. [2025-09-17T06:19:00.753354] [INFO ] [MAIN ] SCHW: Loaded 40035 existing records. [2025-09-17T06:19:00.753387] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-17T06:19:00.816757] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-17T06:19:01.231339] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:19:01.457488] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:19:01.457542] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-17T06:19:01.481915] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-17T06:19:01.444091] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:19:01.515687] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-17T06:19:01.515722] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-17T06:19:01.515775] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-17T06:19:01.539541] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-17T06:19:01.529219] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-17T06:19:01.567322] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-17T06:19:01.539670] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-17T06:19:01.587379] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-17T06:19:01.592838] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-17T06:19:01.736952] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-17T06:19:01.852474] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:19:01.883141] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-11. [2025-09-17T06:19:02.565900] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:19:02.626220] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-11. [2025-09-17T06:19:02.637291] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T06:19:02.640147] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-09-17T06:19:02.686120] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:19:02.698219] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-11. [2025-09-17T06:19:02.769004] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:19:02.769366] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-11. [2025-09-17T06:19:03.491855] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T06:19:03.494006] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-09-17T06:19:04.224477] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T06:19:04.233307] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-09-17T06:19:04.509033] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T06:19:04.518839] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-09-17T06:19:04.543025] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T06:19:04.545626] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-17T06:19:04.626899] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T06:19:04.637625] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-09-17T06:19:04.973130] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T06:19:04.975481] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-17T06:19:05.400609] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T06:19:05.409428] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-09-17T06:19:05.694948] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T06:19:05.697365] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-17T06:19:05.940588] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T06:19:05.950370] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-17T06:19:06.178509] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-17T06:19:06.181316] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-17T06:19:06.276437] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T06:19:06.287513] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-09-17T06:19:06.551901] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T06:19:06.565891] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-17T06:19:06.600884] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T06:19:07.090203] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-17T06:19:07.262348] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T06:19:07.890135] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-17T06:19:08.024900] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T06:19:08.054928] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T06:19:08.120665] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T06:19:08.690179] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-17T06:19:09.490171] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-17T06:19:09.568358] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T06:19:10.238018] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T06:19:10.290135] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-17T06:19:10.656328] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T06:19:11.090160] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-17T06:19:11.890136] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-17T06:19:12.144919] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T06:19:12.451744] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T06:19:12.485298] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T06:19:12.690142] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-17T06:19:13.490120] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-17T06:19:14.290210] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-17T06:19:14.593448] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T06:19:14.658329] [INFO ] [REMOTE ] SCD: Full fetch complete (15926 records). [2025-09-17T06:19:14.658785] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-17T06:19:14.680027] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T06:19:15.105622] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-17T06:19:15.118396] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-17T06:19:15.118486] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-17T06:19:15.118889] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-17T06:19:15.118954] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-17T06:19:15.119766] [DEBUG] [LOCAL ] SCD: Trimmed 15926 records to 12537 (keeping 200 days of data) [2025-09-17T06:19:15.207623] [DEBUG] [LOCAL ] SCD: Primary data saved (12537 records). [2025-09-17T06:19:15.208028] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-17T06:19:15.208142] [INFO ] [MAIN ] Update Progress: 1881/2369 symbols completed. SCD took 15.4s. Estimated remaining: 1h 11m 23s. Rate: 6.8 symbols/min [2025-09-17T06:19:15.386013] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:19:15.399949] [DEBUG] [LOCAL ] SCL: Loaded 10807 existing records from primary storage. [2025-09-17T06:19:15.400102] [INFO ] [MAIN ] SCL: Loaded 10807 existing records. [2025-09-17T06:19:15.580372] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:19:15.580774] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-17T06:19:15.581073] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-17T06:19:15.581517] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-17T06:19:15.581638] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-17T06:19:15.910259] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-17T06:19:15.971368] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T06:19:15.976810] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:19:16.690133] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-17T06:19:17.131728] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T06:19:17.490131] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-17T06:19:17.842800] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T06:19:18.290171] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-17T06:19:18.372413] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T06:19:19.090140] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-17T06:19:19.325384] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T06:19:19.564191] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T06:19:19.890123] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-17T06:19:20.146059] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T06:19:20.690134] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-11. [2025-09-17T06:19:21.490145] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-17T06:19:21.543854] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T06:19:21.572066] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T06:19:22.290146] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-09-17T06:19:22.642306] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T06:19:23.090141] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-17T06:19:23.131100] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T06:19:23.890137] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-09-17T06:19:24.690148] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-17T06:19:24.907789] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T06:19:24.967825] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T06:19:25.490192] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-17T06:19:26.290127] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-17T06:19:26.543811] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T06:19:26.910743] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T06:19:26.953432] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T06:19:27.090126] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-17T06:19:27.890144] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-17T06:19:28.690142] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-17T06:19:29.126353] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T06:19:29.351343] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T06:19:29.356934] [INFO ] [REMOTE ] SCI: Full fetch complete (66941 records). [2025-09-17T06:19:29.357084] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-17T06:19:29.500477] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-17T06:19:29.749362] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-17T06:19:29.749471] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-17T06:19:29.750500] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-17T06:19:29.750560] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-17T06:19:29.751948] [DEBUG] [LOCAL ] SCI: Trimmed 66941 records to 46821 (keeping 200 days of data) [2025-09-17T06:19:30.050898] [DEBUG] [LOCAL ] SCI: Primary data saved (46821 records). [2025-09-17T06:19:30.051063] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-17T06:19:30.051186] [INFO ] [MAIN ] Update Progress: 1882/2369 symbols completed. SCI took 30.3s. Estimated remaining: 1h 11m 16s. Rate: 6.8 symbols/min [2025-09-17T06:19:30.220473] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:19:30.235601] [DEBUG] [LOCAL ] SCM: Loaded 13659 existing records from primary storage. [2025-09-17T06:19:30.235810] [INFO ] [MAIN ] SCM: Loaded 13659 existing records. [2025-09-17T06:19:30.299305] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-17T06:19:30.423396] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:19:30.424051] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-17T06:19:30.424156] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-17T06:19:30.424784] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-17T06:19:30.424863] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-17T06:19:30.755764] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T06:19:30.824458] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:19:31.090106] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-11. [2025-09-17T06:19:31.494091] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T06:19:31.515032] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T06:19:31.890098] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-17T06:19:32.210044] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T06:19:32.690126] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-17T06:19:32.916732] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T06:19:33.490125] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-17T06:19:34.154702] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T06:19:34.160861] [INFO ] [REMOTE ] SCCO: Full fetch complete (70476 records). [2025-09-17T06:19:34.161021] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-17T06:19:34.292129] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-17T06:19:34.495907] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T06:19:34.582558] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-17T06:19:34.582717] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-17T06:19:34.583787] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-17T06:19:34.583866] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-17T06:19:34.585460] [DEBUG] [LOCAL ] SCCO: Trimmed 70476 records to 49398 (keeping 200 days of data) [2025-09-17T06:19:34.894928] [DEBUG] [LOCAL ] SCCO: Primary data saved (49398 records). [2025-09-17T06:19:34.895098] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-17T06:19:34.895260] [INFO ] [MAIN ] Update Progress: 1883/2369 symbols completed. SCCO took 35.1s. Estimated remaining: 1h 11m 6s. Rate: 6.8 symbols/min [2025-09-17T06:19:35.068747] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:19:35.090724] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-17T06:19:35.108909] [DEBUG] [LOCAL ] SCS: Loaded 31531 existing records from primary storage. [2025-09-17T06:19:35.109093] [INFO ] [MAIN ] SCS: Loaded 31531 existing records. [2025-09-17T06:19:35.290482] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:19:35.290752] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-17T06:19:35.290823] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-17T06:19:35.291618] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-17T06:19:35.291727] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-17T06:19:35.647959] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:19:35.847685] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T06:19:35.890085] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-17T06:19:36.020759] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T06:19:36.027397] [INFO ] [REMOTE ] SCHW: Full fetch complete (77560 records). [2025-09-17T06:19:36.027550] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-17T06:19:36.422025] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-17T06:19:36.422164] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-17T06:19:36.423252] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-17T06:19:36.423312] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-17T06:19:36.424874] [DEBUG] [LOCAL ] SCHW: Trimmed 77560 records to 53685 (keeping 200 days of data) [2025-09-17T06:19:36.690150] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-11. [2025-09-17T06:19:36.784853] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-09-17T06:19:36.785180] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-17T06:19:36.785534] [INFO ] [MAIN ] Update Progress: 1884/2369 symbols completed. SCHW took 37.0s. Estimated remaining: 1h 10m 55s. Rate: 6.8 symbols/min [2025-09-17T06:19:36.862275] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T06:19:36.978190] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:19:37.004285] [DEBUG] [LOCAL ] SD: Loaded 20834 existing records from primary storage. [2025-09-17T06:19:37.004495] [INFO ] [MAIN ] SD: Loaded 20834 existing records. [2025-09-17T06:19:37.195303] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:19:37.195567] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-17T06:19:37.195629] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-17T06:19:37.196212] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-17T06:19:37.196270] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-17T06:19:37.495258] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-17T06:19:37.565529] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:19:38.225609] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T06:19:38.290121] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-09-17T06:19:38.640720] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T06:19:39.090117] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-17T06:19:39.387791] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T06:19:39.890175] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-09-17T06:19:40.030606] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T06:19:40.033149] [INFO ] [REMOTE ] SCL: Full fetch complete (20661 records). [2025-09-17T06:19:40.033272] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-17T06:19:40.397693] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-17T06:19:40.397798] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-17T06:19:40.398225] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-17T06:19:40.398278] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-17T06:19:40.398971] [DEBUG] [LOCAL ] SCL: Trimmed 20661 records to 14755 (keeping 200 days of data) [2025-09-17T06:19:40.493950] [DEBUG] [LOCAL ] SCL: Primary data saved (14755 records). [2025-09-17T06:19:40.494125] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-17T06:19:40.494225] [INFO ] [MAIN ] Update Progress: 1885/2369 symbols completed. SCL took 25.3s. Estimated remaining: 1h 10m 45s. Rate: 6.8 symbols/min [2025-09-17T06:19:40.664709] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:19:40.674436] [DEBUG] [LOCAL ] SDHC: Loaded 7272 existing records from primary storage. [2025-09-17T06:19:40.674605] [INFO ] [MAIN ] SDHC: Loaded 7272 existing records. [2025-09-17T06:19:40.690110] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-09-17T06:19:40.863217] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:19:40.863619] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-17T06:19:40.863736] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-17T06:19:40.864131] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-17T06:19:40.864206] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-17T06:19:41.150951] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T06:19:41.233150] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:19:41.490111] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-17T06:19:42.292499] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-11. [2025-09-17T06:19:42.296425] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T06:19:42.475150] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T06:19:43.090139] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-17T06:19:43.525982] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T06:19:43.890145] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-17T06:19:44.445403] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T06:19:44.690118] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-11. [2025-09-17T06:19:45.120581] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T06:19:45.444466] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T06:19:45.490107] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-09-17T06:19:46.265351] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T06:19:46.290086] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-09-17T06:19:47.090126] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-09-17T06:19:47.317852] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T06:19:47.890174] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-09-17T06:19:48.030925] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T06:19:48.690127] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-17T06:19:49.126674] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T06:19:49.198414] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T06:19:49.490171] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-17T06:19:50.225121] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T06:19:50.290101] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-17T06:19:51.090181] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-17T06:19:51.261819] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T06:19:51.890186] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-17T06:19:52.029568] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T06:19:52.690180] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-17T06:19:52.786560] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T06:19:53.490125] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-17T06:19:54.143588] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T06:19:54.288277] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T06:19:54.293804] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-17T06:19:55.090179] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-17T06:19:55.162574] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T06:19:55.864415] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T06:19:55.890111] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-17T06:19:56.406039] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T06:19:56.690157] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-17T06:19:57.490119] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-17T06:19:57.957488] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T06:19:58.290210] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-17T06:19:59.090145] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-17T06:19:59.132450] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T06:19:59.185679] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T06:19:59.716317] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T06:19:59.890156] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-17T06:20:00.690216] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-17T06:20:00.691321] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T06:20:01.490148] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-17T06:20:01.954998] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T06:20:02.290193] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-17T06:20:02.336737] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T06:20:03.070462] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T06:20:03.072261] [INFO ] [REMOTE ] SDHC: Full fetch complete (16728 records). [2025-09-17T06:20:03.072363] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-17T06:20:03.095853] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-17T06:20:03.477744] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-17T06:20:03.477854] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-17T06:20:03.478326] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-17T06:20:03.478388] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-17T06:20:03.478964] [DEBUG] [LOCAL ] SDHC: Trimmed 16728 records to 10516 (keeping 200 days of data) [2025-09-17T06:20:03.545007] [DEBUG] [LOCAL ] SDHC: Primary data saved (10516 records). [2025-09-17T06:20:03.545168] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-17T06:20:03.545269] [INFO ] [MAIN ] Update Progress: 1886/2369 symbols completed. SDHC took 23.1s. Estimated remaining: 1h 10m 40s. Rate: 6.8 symbols/min [2025-09-17T06:20:03.725142] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:20:03.736693] [DEBUG] [LOCAL ] SDHY: Loaded 7757 existing records from primary storage. [2025-09-17T06:20:03.736860] [INFO ] [MAIN ] SDHY: Loaded 7757 existing records. [2025-09-17T06:20:03.892387] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-17T06:20:03.916349] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:20:03.916621] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-17T06:20:03.916725] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-17T06:20:03.917108] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-17T06:20:03.917183] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-17T06:20:04.289720] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:20:04.307505] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T06:20:04.671848] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T06:20:04.690117] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-17T06:20:05.490109] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-11. [2025-09-17T06:20:05.831418] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T06:20:06.002357] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T06:20:06.290147] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-09-17T06:20:07.090190] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-17T06:20:07.264189] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T06:20:07.890214] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-09-17T06:20:08.157743] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T06:20:08.360849] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T06:20:08.690176] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-17T06:20:09.453503] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T06:20:09.490126] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-17T06:20:10.265971] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T06:20:10.290141] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-17T06:20:11.090146] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-17T06:20:11.351047] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T06:20:11.890143] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-17T06:20:12.111192] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T06:20:12.690182] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-17T06:20:12.744680] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T06:20:13.490184] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-17T06:20:14.270663] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T06:20:14.290093] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-17T06:20:14.706571] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T06:20:14.710046] [INFO ] [REMOTE ] SD: Full fetch complete (40895 records). [2025-09-17T06:20:14.710167] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-17T06:20:15.095277] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-17T06:20:15.096023] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-17T06:20:15.096158] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-17T06:20:15.097941] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-17T06:20:15.098088] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-17T06:20:15.099326] [DEBUG] [LOCAL ] SD: Trimmed 40895 records to 29171 (keeping 200 days of data) [2025-09-17T06:20:15.280442] [DEBUG] [LOCAL ] SD: Primary data saved (29171 records). [2025-09-17T06:20:15.280676] [INFO ] [MAIN ] SD: Full history saved. [2025-09-17T06:20:15.280779] [INFO ] [MAIN ] Update Progress: 1887/2369 symbols completed. SD took 38.5s. Estimated remaining: 1h 10m 32s. Rate: 6.8 symbols/min [2025-09-17T06:20:15.455499] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:20:15.488376] [DEBUG] [LOCAL ] SDRL: Loaded 30554 existing records from primary storage. [2025-09-17T06:20:15.488777] [INFO ] [MAIN ] SDRL: Loaded 30554 existing records. [2025-09-17T06:20:15.674952] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:20:15.675335] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-17T06:20:15.675439] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-17T06:20:15.687130] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-17T06:20:15.705918] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-17T06:20:15.792720] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T06:20:15.895555] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-17T06:20:16.037746] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T06:20:16.125038] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:20:16.690094] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-17T06:20:16.702042] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T06:20:16.705048] [INFO ] [REMOTE ] SCM: Full fetch complete (28229 records). [2025-09-17T06:20:16.705203] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-17T06:20:17.096452] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-17T06:20:17.096622] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-17T06:20:17.097417] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-17T06:20:17.097496] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-17T06:20:17.098612] [DEBUG] [LOCAL ] SCM: Trimmed 28229 records to 20156 (keeping 200 days of data) [2025-09-17T06:20:17.230325] [DEBUG] [LOCAL ] SCM: Primary data saved (20156 records). [2025-09-17T06:20:17.230498] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-17T06:20:17.230622] [INFO ] [MAIN ] Update Progress: 1888/2369 symbols completed. SCM took 47.2s. Estimated remaining: 1h 10m 22s. Rate: 6.8 symbols/min [2025-09-17T06:20:17.399672] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:20:17.399895] [DEBUG] [LOCAL ] SE: No existing data file found in primary storage. [2025-09-17T06:20:17.399965] [WARN ] [MAIN ] SE: No existing data found, performing full refresh instead. [2025-09-17T06:20:17.400115] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-17T06:20:17.400185] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-17T06:20:17.400256] [DEBUG] [LOCAL ] SE: No primary data file found to delete. [2025-09-17T06:20:17.400316] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-17T06:20:17.497995] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-17T06:20:17.775403] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:20:18.047129] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T06:20:18.175806] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T06:20:18.181717] [INFO ] [REMOTE ] SCS: Full fetch complete (59539 records). [2025-09-17T06:20:18.181878] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-17T06:20:18.295268] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-11. [2025-09-17T06:20:18.571261] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-17T06:20:18.571368] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-17T06:20:18.572317] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-17T06:20:18.572376] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-17T06:20:18.573659] [DEBUG] [LOCAL ] SCS: Trimmed 59539 records to 42722 (keeping 200 days of data) [2025-09-17T06:20:18.841299] [DEBUG] [LOCAL ] SCS: Primary data saved (42722 records). [2025-09-17T06:20:18.841455] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-17T06:20:18.841548] [INFO ] [MAIN ] Update Progress: 1889/2369 symbols completed. SCS took 43.9s. Estimated remaining: 1h 10m 11s. Rate: 6.8 symbols/min [2025-09-17T06:20:19.018109] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:20:19.057704] [DEBUG] [LOCAL ] SEE: Loaded 35487 existing records from primary storage. [2025-09-17T06:20:19.057883] [INFO ] [MAIN ] SEE: Loaded 35487 existing records. [2025-09-17T06:20:19.100203] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-17T06:20:19.238710] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:20:19.238950] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-17T06:20:19.239001] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-17T06:20:19.239879] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-17T06:20:19.239940] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-17T06:20:19.610582] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:20:19.890166] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-11. [2025-09-17T06:20:19.978606] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T06:20:20.385479] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-11 (2.09 seconds). [2025-09-17T06:20:20.690158] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-17T06:20:21.444107] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T06:20:21.490138] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-09-17T06:20:22.290149] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-17T06:20:22.690307] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T06:20:22.770609] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T06:20:23.077061] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T06:20:23.090078] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-09-17T06:20:23.890132] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-11. [2025-09-17T06:20:24.586458] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T06:20:24.690144] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-17T06:20:25.490111] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-17T06:20:25.562138] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T06:20:26.228115] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T06:20:26.290130] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-09-17T06:20:26.601947] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T06:20:27.090155] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-17T06:20:27.758384] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T06:20:27.760413] [INFO ] [REMOTE ] SDHY: Full fetch complete (16478 records). [2025-09-17T06:20:27.760502] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-17T06:20:27.890189] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-17T06:20:28.092964] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T06:20:28.182133] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-17T06:20:28.182252] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-17T06:20:28.182744] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-17T06:20:28.182817] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-17T06:20:28.183388] [DEBUG] [LOCAL ] SDHY: Trimmed 16478 records to 10765 (keeping 200 days of data) [2025-09-17T06:20:28.254116] [DEBUG] [LOCAL ] SDHY: Primary data saved (10765 records). [2025-09-17T06:20:28.254318] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-17T06:20:28.254438] [INFO ] [MAIN ] Update Progress: 1890/2369 symbols completed. SDHY took 24.7s. Estimated remaining: 1h 10m 2s. Rate: 6.8 symbols/min [2025-09-17T06:20:28.426005] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:20:28.438200] [DEBUG] [LOCAL ] SEG: Loaded 9675 existing records from primary storage. [2025-09-17T06:20:28.438353] [INFO ] [MAIN ] SEG: Loaded 9675 existing records. [2025-09-17T06:20:28.624792] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:20:28.625095] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-17T06:20:28.625169] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-17T06:20:28.625798] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-17T06:20:28.625873] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-17T06:20:28.695290] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-17T06:20:28.990064] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:20:29.490133] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-09-17T06:20:29.861714] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T06:20:30.232669] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T06:20:30.290081] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-17T06:20:31.046220] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T06:20:31.090092] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-17T06:20:31.890186] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-17T06:20:32.393416] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T06:20:32.648402] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T06:20:32.690111] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-17T06:20:33.152715] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T06:20:33.490127] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-17T06:20:34.290161] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-17T06:20:34.418040] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T06:20:35.090094] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-17T06:20:35.156767] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T06:20:35.890161] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-17T06:20:36.394009] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T06:20:36.469630] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T06:20:36.690219] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-17T06:20:37.341345] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T06:20:37.490165] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-17T06:20:38.290188] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-17T06:20:38.801194] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-17T06:20:39.090106] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-17T06:20:39.192871] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T06:20:39.860625] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T06:20:39.890081] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-17T06:20:40.690163] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-11. [2025-09-17T06:20:41.029542] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T06:20:41.106297] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T06:20:41.473932] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T06:20:41.490086] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-09-17T06:20:42.253236] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T06:20:42.290126] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-17T06:20:43.090172] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-17T06:20:43.207464] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T06:20:43.890168] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-17T06:20:44.539884] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T06:20:44.690115] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-17T06:20:45.446036] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T06:20:45.490079] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-17T06:20:45.657490] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T06:20:46.290168] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-17T06:20:47.097011] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-17T06:20:47.116817] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T06:20:47.280149] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T06:20:47.890144] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-17T06:20:48.690119] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-17T06:20:49.186113] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T06:20:49.328100] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T06:20:49.333153] [INFO ] [REMOTE ] SDRL: Full fetch complete (61765 records). [2025-09-17T06:20:49.333303] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-17T06:20:49.495269] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-17T06:20:49.751941] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T06:20:49.755342] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-17T06:20:49.759607] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-17T06:20:49.761070] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-17T06:20:49.761204] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-17T06:20:49.762805] [DEBUG] [LOCAL ] SDRL: Trimmed 61765 records to 42247 (keeping 200 days of data) [2025-09-17T06:20:50.016184] [DEBUG] [LOCAL ] SDRL: Primary data saved (42247 records). [2025-09-17T06:20:50.016353] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-17T06:20:50.016453] [INFO ] [MAIN ] Update Progress: 1891/2369 symbols completed. SDRL took 34.7s. Estimated remaining: 1h 9m 57s. Rate: 6.8 symbols/min [2025-09-17T06:20:50.187232] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:20:50.222290] [DEBUG] [LOCAL ] SEI: Loaded 36632 existing records from primary storage. [2025-09-17T06:20:50.222475] [INFO ] [MAIN ] SEI: Loaded 36632 existing records. [2025-09-17T06:20:50.296974] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-17T06:20:50.405778] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:20:50.406032] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-17T06:20:50.406092] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-17T06:20:50.407034] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-17T06:20:50.407100] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-17T06:20:50.762816] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:20:51.090142] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-17T06:20:51.637465] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T06:20:51.711009] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T06:20:51.890200] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-11. [2025-09-17T06:20:52.004447] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T06:20:52.690169] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-17T06:20:53.353980] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T06:20:53.497247] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-09-17T06:20:53.500731] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T06:20:54.290188] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-17T06:20:54.777999] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T06:20:55.090133] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-09-17T06:20:55.814005] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T06:20:55.820014] [INFO ] [REMOTE ] SEE: Full fetch complete (69345 records). [2025-09-17T06:20:55.820188] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-17T06:20:55.895379] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-17T06:20:56.221547] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-17T06:20:56.221674] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-17T06:20:56.222693] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-17T06:20:56.222754] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-17T06:20:56.224194] [DEBUG] [LOCAL ] SEE: Trimmed 69345 records to 48491 (keeping 200 days of data) [2025-09-17T06:20:56.541285] [DEBUG] [LOCAL ] SEE: Primary data saved (48491 records). [2025-09-17T06:20:56.541472] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-17T06:20:56.541586] [INFO ] [MAIN ] Update Progress: 1892/2369 symbols completed. SEE took 37.7s. Estimated remaining: 1h 9m 48s. Rate: 6.8 symbols/min [2025-09-17T06:20:56.692152] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-17T06:20:56.715736] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:20:56.746551] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T06:20:56.793878] [DEBUG] [LOCAL ] SEM: Loaded 32479 existing records from primary storage. [2025-09-17T06:20:56.794074] [INFO ] [MAIN ] SEM: Loaded 32479 existing records. [2025-09-17T06:20:56.976475] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:20:56.976773] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-17T06:20:56.976833] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-17T06:20:56.977564] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-17T06:20:56.977623] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-17T06:20:57.338703] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:20:57.490152] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-11. [2025-09-17T06:20:57.526478] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T06:20:57.532974] [INFO ] [REMOTE ] SE: Full fetch complete (76945 records). [2025-09-17T06:20:57.533116] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-17T06:20:57.738349] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T06:20:57.941104] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-09-17T06:20:57.941219] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-09-17T06:20:57.942323] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-09-17T06:20:57.942403] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-09-17T06:20:57.944034] [DEBUG] [LOCAL ] SE: Trimmed 76945 records to 53405 (keeping 200 days of data) [2025-09-17T06:20:58.266387] [DEBUG] [LOCAL ] SE: Primary data saved (53405 records). [2025-09-17T06:20:58.266562] [INFO ] [MAIN ] SE: Full history saved. [2025-09-17T06:20:58.266700] [INFO ] [MAIN ] Update Progress: 1893/2369 symbols completed. SE took 41.0s. Estimated remaining: 1h 9m 37s. Rate: 6.8 symbols/min [2025-09-17T06:20:58.300814] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-17T06:20:58.442758] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:20:58.471799] [DEBUG] [LOCAL ] SEMR: Loaded 30918 existing records from primary storage. [2025-09-17T06:20:58.471966] [INFO ] [MAIN ] SEMR: Loaded 30918 existing records. [2025-09-17T06:20:58.647903] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:20:58.648167] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-17T06:20:58.648227] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-17T06:20:58.648911] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-17T06:20:58.648974] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-17T06:20:59.009816] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:20:59.037590] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T06:20:59.090122] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-09-17T06:20:59.882330] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T06:20:59.891328] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-17T06:21:00.275867] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T06:21:00.422254] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T06:21:00.690203] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-17T06:21:01.490202] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-17T06:21:02.258332] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T06:21:02.260238] [INFO ] [REMOTE ] SEG: Full fetch complete (19801 records). [2025-09-17T06:21:02.260438] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-17T06:21:02.295323] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-11. [2025-09-17T06:21:02.631854] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-17T06:21:02.631966] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-17T06:21:02.632446] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-17T06:21:02.632498] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-17T06:21:02.633233] [DEBUG] [LOCAL ] SEG: Trimmed 19801 records to 14006 (keeping 200 days of data) [2025-09-17T06:21:02.720416] [DEBUG] [LOCAL ] SEG: Primary data saved (14006 records). [2025-09-17T06:21:02.720598] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-17T06:21:02.720810] [INFO ] [MAIN ] Update Progress: 1894/2369 symbols completed. SEG took 34.5s. Estimated remaining: 1h 9m 27s. Rate: 6.8 symbols/min [2025-09-17T06:21:02.890690] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:21:02.928061] [DEBUG] [LOCAL ] SES: Loaded 38115 existing records from primary storage. [2025-09-17T06:21:02.928227] [INFO ] [MAIN ] SES: Loaded 38115 existing records. [2025-09-17T06:21:03.103497] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-09-17T06:21:03.109072] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:21:03.109233] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-17T06:21:03.109295] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-17T06:21:03.110035] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-17T06:21:03.110097] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-17T06:21:03.490707] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:21:03.537731] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (2.85 seconds). [2025-09-17T06:21:03.890121] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-17T06:21:04.690112] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-11. [2025-09-17T06:21:05.081965] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-11 (2.79 seconds). [2025-09-17T06:21:05.138284] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T06:21:05.490142] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-17T06:21:05.733938] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T06:21:06.290149] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-17T06:21:06.578882] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T06:21:06.966708] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T06:21:07.090136] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-17T06:21:07.859632] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T06:21:07.890135] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-09-17T06:21:08.515916] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T06:21:08.690138] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-09-17T06:21:09.490141] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-17T06:21:09.851047] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T06:21:10.024265] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T06:21:10.290186] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-09-17T06:21:10.990997] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T06:21:11.090140] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-17T06:21:11.671006] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T06:21:11.890142] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-17T06:21:12.308161] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T06:21:12.690158] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-17T06:21:13.490115] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-17T06:21:13.553951] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T06:21:14.216999] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T06:21:14.290131] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-17T06:21:14.742338] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T06:21:15.090204] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-09-17T06:21:15.507311] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T06:21:15.890246] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-17T06:21:16.690138] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-17T06:21:17.490182] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-17T06:21:17.949987] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T06:21:18.290195] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-17T06:21:18.438537] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (3.35 seconds). [2025-09-17T06:21:18.591123] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T06:21:19.090184] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-17T06:21:19.209145] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T06:21:19.822310] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T06:21:19.890146] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-17T06:21:20.332372] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T06:21:20.690143] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-17T06:21:20.992888] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T06:21:21.490200] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-17T06:21:22.290152] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-17T06:21:22.448578] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T06:21:22.457251] [INFO ] [REMOTE ] SEI: Full fetch complete (69174 records). [2025-09-17T06:21:22.457504] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-17T06:21:22.881202] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-17T06:21:22.881320] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-17T06:21:22.882496] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-17T06:21:22.882564] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-17T06:21:22.884349] [DEBUG] [LOCAL ] SEI: Trimmed 69174 records to 49547 (keeping 200 days of data) [2025-09-17T06:21:23.012909] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T06:21:23.103375] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-17T06:21:23.239520] [DEBUG] [LOCAL ] SEI: Primary data saved (49547 records). [2025-09-17T06:21:23.239706] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-17T06:21:23.239837] [INFO ] [MAIN ] Update Progress: 1895/2369 symbols completed. SEI took 33.2s. Estimated remaining: 1h 9m 21s. Rate: 6.8 symbols/min [2025-09-17T06:21:23.413073] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:21:23.445664] [DEBUG] [LOCAL ] SF: Loaded 30312 existing records from primary storage. [2025-09-17T06:21:23.445839] [INFO ] [MAIN ] SF: Loaded 30312 existing records. [2025-09-17T06:21:23.620828] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:21:23.621080] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-17T06:21:23.621139] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-17T06:21:23.622111] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-17T06:21:23.622243] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-17T06:21:23.814918] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T06:21:23.896747] [INFO ] [REMOTE ] SEM: Full fetch complete (61935 records). [2025-09-17T06:21:23.896817] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-17T06:21:23.923804] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-17T06:21:24.099784] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:21:24.400345] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-17T06:21:24.400465] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-17T06:21:24.401405] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-17T06:21:24.401482] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-17T06:21:24.402862] [DEBUG] [LOCAL ] SEM: Trimmed 61935 records to 43155 (keeping 200 days of data) [2025-09-17T06:21:24.671346] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T06:21:24.690133] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-17T06:21:24.724233] [DEBUG] [LOCAL ] SEM: Primary data saved (43155 records). [2025-09-17T06:21:24.724377] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-17T06:21:24.724475] [INFO ] [MAIN ] Update Progress: 1896/2369 symbols completed. SEM took 28.2s. Estimated remaining: 1h 9m 11s. Rate: 6.8 symbols/min [2025-09-17T06:21:24.897952] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:21:24.902543] [DEBUG] [LOCAL ] SFB: Loaded 2592 existing records from primary storage. [2025-09-17T06:21:24.902659] [INFO ] [MAIN ] SFB: Loaded 2592 existing records. [2025-09-17T06:21:25.084108] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:21:25.084371] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-17T06:21:25.084434] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-17T06:21:25.084721] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-17T06:21:25.084780] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-17T06:21:25.439519] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:21:25.490096] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-11. [2025-09-17T06:21:25.899699] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T06:21:26.049336] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T06:21:26.290139] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-09-17T06:21:26.345429] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T06:21:26.852580] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T06:21:27.090132] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-09-17T06:21:27.670316] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T06:21:27.890135] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-17T06:21:28.275337] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-17T06:21:28.690156] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-17T06:21:29.490161] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-17T06:21:30.115073] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T06:21:30.121213] [INFO ] [REMOTE ] SEMR: Full fetch complete (58322 records). [2025-09-17T06:21:30.121371] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-17T06:21:30.301321] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-17T06:21:30.513329] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-17T06:21:30.513466] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-17T06:21:30.514549] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-17T06:21:30.514700] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-17T06:21:30.516060] [DEBUG] [LOCAL ] SEMR: Trimmed 58322 records to 41787 (keeping 200 days of data) [2025-09-17T06:21:30.763810] [DEBUG] [LOCAL ] SEMR: Primary data saved (41787 records). [2025-09-17T06:21:30.763969] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-17T06:21:30.764101] [INFO ] [MAIN ] Update Progress: 1897/2369 symbols completed. SEMR took 32.5s. Estimated remaining: 1h 9m 1s. Rate: 6.8 symbols/min [2025-09-17T06:21:30.932997] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:21:30.948579] [DEBUG] [LOCAL ] SFBS: Loaded 15423 existing records from primary storage. [2025-09-17T06:21:30.948752] [INFO ] [MAIN ] SFBS: Loaded 15423 existing records. [2025-09-17T06:21:31.095264] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-11. [2025-09-17T06:21:31.130175] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:21:31.131466] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-17T06:21:31.131563] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-17T06:21:31.132098] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-17T06:21:31.132299] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-17T06:21:31.296108] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T06:21:31.502912] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:21:31.890134] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-11. [2025-09-17T06:21:31.972030] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.48 seconds). [2025-09-17T06:21:32.684869] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T06:21:32.693111] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-17T06:21:33.017135] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T06:21:33.338163] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-17T06:21:33.490121] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-09-17T06:21:34.290200] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-09-17T06:21:34.885262] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T06:21:35.090128] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-17T06:21:35.377339] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T06:21:35.647389] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T06:21:35.890133] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-09-17T06:21:36.690198] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-09-17T06:21:37.401227] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T06:21:37.484464] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T06:21:37.490073] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-17T06:21:38.290123] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-17T06:21:38.467590] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T06:21:39.090153] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-17T06:21:39.890138] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-17T06:21:40.183064] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T06:21:40.351236] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T06:21:40.435452] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T06:21:40.690136] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-17T06:21:41.490145] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-17T06:21:41.944161] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T06:21:42.290153] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-17T06:21:43.002088] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T06:21:43.090168] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-17T06:21:43.350904] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T06:21:43.890194] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-17T06:21:44.474070] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T06:21:44.690196] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-17T06:21:45.491390] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-17T06:21:45.497738] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-17T06:21:46.290138] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-17T06:21:46.369937] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T06:21:46.571496] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T06:21:46.601953] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-17T06:21:47.090128] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-17T06:21:47.890330] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-17T06:21:48.468838] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T06:21:48.469842] [INFO ] [REMOTE ] SFB: Full fetch complete (5733 records). [2025-09-17T06:21:48.469950] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-17T06:21:48.697346] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-17T06:21:48.835789] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-17T06:21:48.835901] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-17T06:21:48.836073] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-17T06:21:48.836130] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-17T06:21:48.836624] [DEBUG] [LOCAL ] SFB: Trimmed 5733 records to 4095 (keeping 200 days of data) [2025-09-17T06:21:48.862210] [DEBUG] [LOCAL ] SFB: Primary data saved (4095 records). [2025-09-17T06:21:48.862300] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-17T06:21:48.862411] [INFO ] [MAIN ] Update Progress: 1898/2369 symbols completed. SFB took 24.1s. Estimated remaining: 1h 8m 55s. Rate: 6.8 symbols/min [2025-09-17T06:21:49.029117] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:21:49.071741] [DEBUG] [LOCAL ] SFL: Loaded 33082 existing records from primary storage. [2025-09-17T06:21:49.071909] [INFO ] [MAIN ] SFL: Loaded 33082 existing records. [2025-09-17T06:21:49.252696] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:21:49.253319] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-17T06:21:49.253395] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-17T06:21:49.254349] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-17T06:21:49.254422] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-17T06:21:49.497480] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-17T06:21:49.570654] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-17T06:21:49.679768] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:21:49.944502] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T06:21:50.290158] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-17T06:21:50.941224] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T06:21:51.090182] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-11. [2025-09-17T06:21:51.296116] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T06:21:51.890172] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-17T06:21:52.592358] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T06:21:52.690144] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-09-17T06:21:53.490214] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-17T06:21:53.829821] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T06:21:53.894221] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T06:21:54.290195] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-09-17T06:21:54.745555] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T06:21:55.090130] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-17T06:21:55.748522] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T06:21:55.890121] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-17T06:21:56.690150] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-17T06:21:57.222432] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T06:21:57.293683] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T06:21:57.490166] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-17T06:21:58.101714] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T06:21:58.290150] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-17T06:21:59.090177] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-17T06:21:59.338524] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T06:21:59.345389] [INFO ] [REMOTE ] SES: Full fetch complete (74011 records). [2025-09-17T06:21:59.345520] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-17T06:21:59.749465] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-17T06:21:59.749630] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-17T06:21:59.750907] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-17T06:21:59.751068] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-17T06:21:59.752740] [DEBUG] [LOCAL ] SES: Trimmed 74011 records to 51522 (keeping 200 days of data) [2025-09-17T06:21:59.882035] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T06:21:59.894198] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-17T06:22:00.112249] [DEBUG] [LOCAL ] SES: Primary data saved (51522 records). [2025-09-17T06:22:00.112431] [INFO ] [MAIN ] SES: Full history saved. [2025-09-17T06:22:00.112554] [INFO ] [MAIN ] Update Progress: 1899/2369 symbols completed. SES took 57.4s. Estimated remaining: 1h 8m 47s. Rate: 6.8 symbols/min [2025-09-17T06:22:00.290060] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:22:00.330991] [DEBUG] [LOCAL ] SG: Loaded 39909 existing records from primary storage. [2025-09-17T06:22:00.331174] [INFO ] [MAIN ] SG: Loaded 39909 existing records. [2025-09-17T06:22:00.524659] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:22:00.525187] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-17T06:22:00.525319] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-17T06:22:00.526821] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-17T06:22:00.526903] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-17T06:22:00.699125] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-17T06:22:00.829856] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T06:22:00.943946] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:22:00.951795] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T06:22:00.954815] [INFO ] [REMOTE ] SFBS: Full fetch complete (30049 records). [2025-09-17T06:22:00.954933] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-17T06:22:01.361720] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-17T06:22:01.361839] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-17T06:22:01.362630] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-17T06:22:01.362716] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-17T06:22:01.363612] [DEBUG] [LOCAL ] SFBS: Trimmed 30049 records to 21394 (keeping 200 days of data) [2025-09-17T06:22:01.492041] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-11. [2025-09-17T06:22:01.503003] [DEBUG] [LOCAL ] SFBS: Primary data saved (21394 records). [2025-09-17T06:22:01.503164] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-17T06:22:01.503499] [INFO ] [MAIN ] Update Progress: 1900/2369 symbols completed. SFBS took 30.7s. Estimated remaining: 1h 8m 36s. Rate: 6.8 symbols/min [2025-09-17T06:22:01.681055] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:22:01.718567] [DEBUG] [LOCAL ] SGHC: Loaded 34694 existing records from primary storage. [2025-09-17T06:22:01.718783] [INFO ] [MAIN ] SGHC: Loaded 34694 existing records. [2025-09-17T06:22:01.899890] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:22:01.900229] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-17T06:22:01.900314] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-17T06:22:01.901290] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-17T06:22:01.901559] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-17T06:22:02.306661] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-17T06:22:02.312160] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:22:02.337182] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T06:22:03.090140] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-17T06:22:03.157486] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T06:22:03.890144] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-11. [2025-09-17T06:22:04.007853] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T06:22:04.556538] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T06:22:04.562471] [INFO ] [REMOTE ] SF: Full fetch complete (59126 records). [2025-09-17T06:22:04.562674] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-17T06:22:04.695356] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-09-17T06:22:04.956622] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-17T06:22:04.956895] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-17T06:22:04.957887] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-17T06:22:04.957958] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-17T06:22:04.966728] [DEBUG] [LOCAL ] SF: Trimmed 59126 records to 41950 (keeping 200 days of data) [2025-09-17T06:22:04.983081] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T06:22:05.258327] [DEBUG] [LOCAL ] SF: Primary data saved (41950 records). [2025-09-17T06:22:05.258481] [INFO ] [MAIN ] SF: Full history saved. [2025-09-17T06:22:05.258602] [INFO ] [MAIN ] Update Progress: 1901/2369 symbols completed. SF took 42.0s. Estimated remaining: 1h 8m 26s. Rate: 6.8 symbols/min [2025-09-17T06:22:05.425259] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:22:05.425475] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-17T06:22:05.425525] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-17T06:22:05.425632] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-17T06:22:05.425737] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-17T06:22:05.425792] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-17T06:22:05.425830] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-17T06:22:05.498852] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-09-17T06:22:05.779837] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:22:06.290153] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-11. [2025-09-17T06:22:06.418896] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T06:22:06.478080] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:22:06.478367] [WARN ] [REMOTE ] SGI: No data returned for month 2024-11 [2025-09-17T06:22:06.948752] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T06:22:07.090156] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-09-17T06:22:07.890211] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-17T06:22:08.100069] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:22:08.100476] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-17T06:22:08.690146] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-09-17T06:22:08.935988] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T06:22:09.490129] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-09-17T06:22:09.763500] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:22:09.763903] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-09-17T06:22:10.092219] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T06:22:10.290187] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-17T06:22:11.090203] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-17T06:22:11.143453] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T06:22:11.890135] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-17T06:22:12.646923] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T06:22:12.690089] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-17T06:22:13.490145] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-17T06:22:13.637115] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T06:22:14.218734] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T06:22:14.290148] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-17T06:22:14.996246] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T06:22:15.090128] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-17T06:22:15.890246] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-17T06:22:16.128085] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T06:22:16.167658] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T06:22:16.690142] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-17T06:22:17.051974] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T06:22:17.490160] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-17T06:22:18.290204] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-17T06:22:18.432467] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T06:22:19.090140] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-17T06:22:19.289324] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T06:22:19.687468] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T06:22:19.890186] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-17T06:22:20.199469] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T06:22:20.690148] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-17T06:22:21.490155] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-17T06:22:21.975652] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T06:22:22.290189] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-17T06:22:22.629758] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T06:22:23.003564] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T06:22:23.090148] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-17T06:22:23.690673] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T06:22:23.890127] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-17T06:22:24.603403] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T06:22:24.609612] [INFO ] [REMOTE ] SFL: Full fetch complete (65139 records). [2025-09-17T06:22:24.609850] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-17T06:22:24.695204] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-17T06:22:25.021403] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-17T06:22:25.021536] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-17T06:22:25.022622] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-17T06:22:25.022736] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-17T06:22:25.024991] [DEBUG] [LOCAL ] SFL: Trimmed 65139 records to 45538 (keeping 200 days of data) [2025-09-17T06:22:25.283247] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T06:22:25.362751] [DEBUG] [LOCAL ] SFL: Primary data saved (45538 records). [2025-09-17T06:22:25.362915] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-17T06:22:25.363022] [INFO ] [MAIN ] Update Progress: 1902/2369 symbols completed. SFL took 36.5s. Estimated remaining: 1h 8m 20s. Rate: 6.8 symbols/min [2025-09-17T06:22:25.503707] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-17T06:22:25.535973] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:22:25.544105] [DEBUG] [LOCAL ] SGU: Loaded 5112 existing records from primary storage. [2025-09-17T06:22:25.544251] [INFO ] [MAIN ] SGU: Loaded 5112 existing records. [2025-09-17T06:22:25.726004] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:22:25.726261] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-17T06:22:25.726319] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-17T06:22:25.726596] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-17T06:22:25.726680] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-17T06:22:26.138924] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:22:26.290139] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-11. [2025-09-17T06:22:26.524074] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T06:22:26.922309] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T06:22:27.090154] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-09-17T06:22:27.256565] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T06:22:27.458794] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-17T06:22:27.890135] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-09-17T06:22:28.561725] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T06:22:28.690169] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-17T06:22:29.490157] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-17T06:22:30.292501] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-17T06:22:30.295346] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T06:22:30.914988] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T06:22:31.090129] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-17T06:22:31.516931] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T06:22:31.890118] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-17T06:22:32.690143] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-17T06:22:32.739601] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T06:22:33.490101] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-17T06:22:33.587580] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T06:22:34.290206] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-17T06:22:34.322261] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T06:22:34.329309] [INFO ] [REMOTE ] SGHC: Full fetch complete (62823 records). [2025-09-17T06:22:34.329490] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-17T06:22:34.737139] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-17T06:22:34.738088] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-17T06:22:34.738031] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T06:22:34.739867] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-17T06:22:34.742590] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-17T06:22:34.744396] [DEBUG] [LOCAL ] SGHC: Trimmed 62823 records to 45273 (keeping 200 days of data) [2025-09-17T06:22:35.023198] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T06:22:35.086808] [DEBUG] [LOCAL ] SGHC: Primary data saved (45273 records). [2025-09-17T06:22:35.086996] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-17T06:22:35.087282] [INFO ] [MAIN ] Update Progress: 1903/2369 symbols completed. SGHC took 33.6s. Estimated remaining: 1h 8m 11s. Rate: 6.8 symbols/min [2025-09-17T06:22:35.098441] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-17T06:22:35.262539] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:22:35.299421] [DEBUG] [LOCAL ] SHAK: Loaded 36372 existing records from primary storage. [2025-09-17T06:22:35.299602] [INFO ] [MAIN ] SHAK: Loaded 36372 existing records. [2025-09-17T06:22:35.481679] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:22:35.481955] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-17T06:22:35.482012] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-17T06:22:35.483132] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-17T06:22:35.483197] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-17T06:22:35.854405] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:22:35.890306] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-11. [2025-09-17T06:22:36.690117] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-17T06:22:37.174331] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-17T06:22:37.184005] [INFO ] [REMOTE ] SG: Full fetch complete (77069 records). [2025-09-17T06:22:37.184231] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-17T06:22:37.494108] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-17T06:22:37.603661] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-17T06:22:37.603889] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-17T06:22:37.605533] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-17T06:22:37.605730] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-17T06:22:37.617487] [DEBUG] [LOCAL ] SG: Trimmed 77069 records to 53464 (keeping 200 days of data) [2025-09-17T06:22:37.635137] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T06:22:37.974479] [DEBUG] [LOCAL ] SG: Primary data saved (53464 records). [2025-09-17T06:22:37.974688] [INFO ] [MAIN ] SG: Full history saved. [2025-09-17T06:22:37.974795] [INFO ] [MAIN ] Update Progress: 1904/2369 symbols completed. SG took 37.9s. Estimated remaining: 1h 8m 1s. Rate: 6.8 symbols/min [2025-09-17T06:22:38.152121] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:22:38.170219] [DEBUG] [LOCAL ] SHCO: Loaded 18339 existing records from primary storage. [2025-09-17T06:22:38.170382] [INFO ] [MAIN ] SHCO: Loaded 18339 existing records. [2025-09-17T06:22:38.299068] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-09-17T06:22:38.288730] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T06:22:38.368627] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:22:38.369203] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-17T06:22:38.369461] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-17T06:22:38.370354] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-17T06:22:38.370450] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-17T06:22:38.786673] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:22:38.789397] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-17T06:22:39.090135] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-11. [2025-09-17T06:22:39.668800] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T06:22:39.817674] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T06:22:39.890158] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-09-17T06:22:40.690182] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-17T06:22:40.891030] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T06:22:41.490181] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-17T06:22:42.290138] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-09-17T06:22:42.391288] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T06:22:43.090178] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-17T06:22:43.142016] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T06:22:43.148368] [INFO ] [REMOTE ] SGI: Full fetch complete (55312 records). [2025-09-17T06:22:43.148552] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-17T06:22:43.350536] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 146 unique days, need 200 days [2025-09-17T06:22:43.351555] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:22:43.351658] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:22:43.351735] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-17T06:22:43.352185] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-17T06:22:43.352298] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-17T06:22:43.352485] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-17T06:22:43.352763] [INFO ] [MAIN ] Update Progress: 1905/2369 symbols completed. SGI took 38.1s. Estimated remaining: 1h 7m 52s. Rate: 6.8 symbols/min [2025-09-17T06:22:43.488181] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T06:22:43.574182] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:22:43.574412] [DEBUG] [LOCAL ] SHEL: No existing data file found in primary storage. [2025-09-17T06:22:43.574492] [WARN ] [MAIN ] SHEL: No existing data found, performing full refresh instead. [2025-09-17T06:22:43.574698] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-17T06:22:43.574770] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-17T06:22:43.574836] [DEBUG] [LOCAL ] SHEL: No primary data file found to delete. [2025-09-17T06:22:43.574894] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-17T06:22:43.860136] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T06:22:43.895220] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-17T06:22:43.955099] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:22:44.690179] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-17T06:22:44.916895] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T06:22:45.356806] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T06:22:45.490171] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-17T06:22:46.290173] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-11. [2025-09-17T06:22:47.092534] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-17T06:22:47.099708] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T06:22:47.849149] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T06:22:47.890128] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-17T06:22:48.279739] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T06:22:48.350587] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T06:22:48.690131] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-17T06:22:49.490144] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-09-17T06:22:49.941595] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T06:22:50.290141] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-17T06:22:51.090191] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-17T06:22:51.598142] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T06:22:51.600311] [INFO ] [REMOTE ] SGU: Full fetch complete (8809 records). [2025-09-17T06:22:51.602415] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-17T06:22:51.602719] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-17T06:22:51.896263] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-09-17T06:22:51.985616] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-17T06:22:51.985736] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-17T06:22:51.985987] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-17T06:22:51.986061] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-17T06:22:51.986779] [DEBUG] [LOCAL ] SGU: Trimmed 8809 records to 6617 (keeping 200 days of data) [2025-09-17T06:22:52.030954] [DEBUG] [LOCAL ] SGU: Primary data saved (6617 records). [2025-09-17T06:22:52.031133] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-17T06:22:52.031343] [INFO ] [MAIN ] Update Progress: 1906/2369 symbols completed. SGU took 26.7s. Estimated remaining: 1h 7m 43s. Rate: 6.8 symbols/min [2025-09-17T06:22:52.202526] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:22:52.233323] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T06:22:52.257084] [DEBUG] [LOCAL ] SHG: Loaded 19184 existing records from primary storage. [2025-09-17T06:22:52.257269] [INFO ] [MAIN ] SHG: Loaded 19184 existing records. [2025-09-17T06:22:52.433801] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:22:52.434129] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-17T06:22:52.434193] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-17T06:22:52.435143] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-17T06:22:52.435207] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-17T06:22:52.695274] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-17T06:22:52.803851] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:22:53.490172] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-17T06:22:53.996258] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-17T06:22:54.290149] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-11. [2025-09-17T06:22:54.666408] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T06:22:54.693818] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T06:22:55.001396] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T06:22:55.090164] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-17T06:22:55.741801] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T06:22:55.890134] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-17T06:22:56.690135] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-17T06:22:57.490135] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-17T06:22:57.653948] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T06:22:58.069706] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T06:22:58.290130] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-17T06:22:58.461239] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T06:22:59.090169] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-17T06:22:59.164968] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T06:22:59.890179] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-17T06:23:00.690139] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-09-17T06:23:01.490162] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-17T06:23:02.063828] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T06:23:02.290186] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-09-17T06:23:04.661374] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (4.77 seconds). [2025-09-17T06:23:04.671203] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-17T06:23:05.039408] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (2.75 seconds). [2025-09-17T06:23:05.066922] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-17T06:23:05.138090] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (6.05 seconds). [2025-09-17T06:23:05.158160] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-17T06:23:05.206929] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (3.72 seconds). [2025-09-17T06:23:05.490190] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-17T06:23:06.198195] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T06:23:06.202834] [INFO ] [REMOTE ] SHCO: Full fetch complete (36996 records). [2025-09-17T06:23:06.202962] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-17T06:23:06.622910] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-17T06:23:06.623044] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-17T06:23:06.623930] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-17T06:23:06.624112] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-17T06:23:06.643884] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T06:23:06.644214] [DEBUG] [LOCAL ] SHCO: Trimmed 36996 records to 26419 (keeping 200 days of data) [2025-09-17T06:23:06.651681] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-17T06:23:06.806556] [DEBUG] [LOCAL ] SHCO: Primary data saved (26419 records). [2025-09-17T06:23:06.806741] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-17T06:23:06.806842] [INFO ] [MAIN ] Update Progress: 1907/2369 symbols completed. SHCO took 28.8s. Estimated remaining: 1h 7m 36s. Rate: 6.8 symbols/min [2025-09-17T06:23:06.980966] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:23:07.015264] [DEBUG] [LOCAL ] SHO: Loaded 36918 existing records from primary storage. [2025-09-17T06:23:07.015438] [INFO ] [MAIN ] SHO: Loaded 36918 existing records. [2025-09-17T06:23:07.200011] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:23:07.200378] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-17T06:23:07.200455] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-17T06:23:07.201298] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-17T06:23:07.201369] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-17T06:23:07.487577] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T06:23:07.564846] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-17T06:23:07.620494] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:23:07.654107] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-17T06:23:07.890139] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-11. [2025-09-17T06:23:08.145209] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T06:23:08.690135] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-17T06:23:09.336092] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T06:23:09.450288] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T06:23:09.490119] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-09-17T06:23:09.544355] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T06:23:10.290210] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-17T06:23:11.090117] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-17T06:23:11.120878] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T06:23:11.890129] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-09-17T06:23:12.323585] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T06:23:12.690149] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-17T06:23:12.752334] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T06:23:12.758606] [INFO ] [REMOTE ] SHAK: Full fetch complete (69753 records). [2025-09-17T06:23:12.758814] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-17T06:23:13.172533] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-17T06:23:13.172726] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-17T06:23:13.173802] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-17T06:23:13.174020] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-17T06:23:13.175665] [DEBUG] [LOCAL ] SHAK: Trimmed 69753 records to 49228 (keeping 200 days of data) [2025-09-17T06:23:13.293105] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T06:23:13.500746] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-17T06:23:13.520993] [DEBUG] [LOCAL ] SHAK: Primary data saved (49228 records). [2025-09-17T06:23:13.521183] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-17T06:23:13.521310] [INFO ] [MAIN ] Update Progress: 1908/2369 symbols completed. SHAK took 38.4s. Estimated remaining: 1h 7m 26s. Rate: 6.8 symbols/min [2025-09-17T06:23:13.702933] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:23:13.707505] [DEBUG] [LOCAL ] SHOC: Loaded 2069 existing records from primary storage. [2025-09-17T06:23:13.707730] [INFO ] [MAIN ] SHOC: Loaded 2069 existing records. [2025-09-17T06:23:13.893764] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:23:13.894193] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-17T06:23:13.894266] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-17T06:23:13.894531] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-17T06:23:13.894725] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-17T06:23:14.049043] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T06:23:14.291305] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-17T06:23:14.314324] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:23:14.670613] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T06:23:15.090142] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-11. [2025-09-17T06:23:15.813253] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T06:23:15.890099] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-17T06:23:16.135186] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T06:23:16.690125] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-09-17T06:23:17.042565] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T06:23:17.422618] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T06:23:17.490128] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-17T06:23:18.290131] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-17T06:23:19.090160] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-09-17T06:23:19.143685] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T06:23:19.566830] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T06:23:19.845058] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T06:23:19.890116] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-17T06:23:20.690139] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-17T06:23:20.974472] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T06:23:21.490136] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-17T06:23:22.290107] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-17T06:23:22.337223] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T06:23:23.090141] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-17T06:23:23.243290] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T06:23:23.426291] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T06:23:23.430097] [INFO ] [REMOTE ] SHG: Full fetch complete (41675 records). [2025-09-17T06:23:23.430227] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-17T06:23:23.814000] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-17T06:23:23.818940] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T06:23:23.819005] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-17T06:23:23.822044] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-17T06:23:23.822129] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-17T06:23:23.823058] [DEBUG] [LOCAL ] SHG: Trimmed 41675 records to 27707 (keeping 200 days of data) [2025-09-17T06:23:23.890099] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-17T06:23:24.006103] [DEBUG] [LOCAL ] SHG: Primary data saved (27707 records). [2025-09-17T06:23:24.006279] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-17T06:23:24.006387] [INFO ] [MAIN ] Update Progress: 1909/2369 symbols completed. SHG took 32.0s. Estimated remaining: 1h 7m 18s. Rate: 6.8 symbols/min [2025-09-17T06:23:24.181047] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:23:24.222319] [DEBUG] [LOCAL ] SHW: Loaded 37355 existing records from primary storage. [2025-09-17T06:23:24.222514] [INFO ] [MAIN ] SHW: Loaded 37355 existing records. [2025-09-17T06:23:24.405933] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:23:24.406204] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-17T06:23:24.406264] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-17T06:23:24.407157] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-17T06:23:24.407225] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-17T06:23:24.560118] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T06:23:24.695315] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-17T06:23:24.787365] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:23:25.315570] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T06:23:25.490117] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-17T06:23:25.953753] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T06:23:26.290139] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-17T06:23:27.090133] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-11. [2025-09-17T06:23:27.890195] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-17T06:23:28.028954] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T06:23:28.203686] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-17T06:23:28.690169] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-17T06:23:28.880389] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T06:23:29.490150] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-09-17T06:23:30.290157] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-17T06:23:30.712770] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T06:23:31.090151] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-17T06:23:31.224788] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T06:23:31.890102] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-17T06:23:31.927500] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T06:23:32.690221] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-17T06:23:33.004298] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T06:23:33.011552] [INFO ] [REMOTE ] SHEL: Full fetch complete (77600 records). [2025-09-17T06:23:33.011798] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-17T06:23:33.291739] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T06:23:33.424317] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-17T06:23:33.424545] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-17T06:23:33.426022] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-17T06:23:33.426152] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-17T06:23:33.451237] [DEBUG] [LOCAL ] SHEL: Trimmed 77600 records to 53673 (keeping 200 days of data) [2025-09-17T06:23:33.456675] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T06:23:33.522527] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-17T06:23:33.813221] [DEBUG] [LOCAL ] SHEL: Primary data saved (53673 records). [2025-09-17T06:23:33.813401] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-17T06:23:33.813499] [INFO ] [MAIN ] Update Progress: 1910/2369 symbols completed. SHEL took 50.5s. Estimated remaining: 1h 7m 9s. Rate: 6.8 symbols/min [2025-09-17T06:23:33.985160] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:23:33.985377] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-17T06:23:33.985428] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-17T06:23:33.985535] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-17T06:23:33.985591] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-17T06:23:33.985660] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-17T06:23:33.985709] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-17T06:23:34.306502] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-17T06:23:34.345904] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:23:34.889077] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T06:23:35.090181] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-17T06:23:35.218916] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T06:23:35.890134] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-11. [2025-09-17T06:23:36.088633] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:23:36.088997] [WARN ] [REMOTE ] SI: No data returned for month 2024-11 [2025-09-17T06:23:36.690127] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-17T06:23:36.790966] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T06:23:36.882169] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:23:36.882534] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-17T06:23:37.490136] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-17T06:23:38.021173] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T06:23:38.022198] [INFO ] [REMOTE ] SHOC: Full fetch complete (7595 records). [2025-09-17T06:23:38.022286] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-17T06:23:38.295261] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-17T06:23:38.386660] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-17T06:23:38.386765] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-17T06:23:38.387000] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-17T06:23:38.387090] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-17T06:23:38.387549] [DEBUG] [LOCAL ] SHOC: Trimmed 7595 records to 4280 (keeping 200 days of data) [2025-09-17T06:23:38.414290] [DEBUG] [LOCAL ] SHOC: Primary data saved (4280 records). [2025-09-17T06:23:38.414415] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-17T06:23:38.414560] [INFO ] [MAIN ] Update Progress: 1911/2369 symbols completed. SHOC took 24.9s. Estimated remaining: 1h 6m 60s. Rate: 6.8 symbols/min [2025-09-17T06:23:38.600757] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:23:38.635539] [DEBUG] [LOCAL ] SID: Loaded 31673 existing records from primary storage. [2025-09-17T06:23:38.635767] [INFO ] [MAIN ] SID: Loaded 31673 existing records. [2025-09-17T06:23:38.811304] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:23:38.811614] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-17T06:23:38.811707] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-17T06:23:38.812361] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-17T06:23:38.812445] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-17T06:23:39.095250] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-09-17T06:23:39.169952] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:23:39.345727] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:23:39.346106] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-09-17T06:23:39.890718] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-17T06:23:39.893357] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T06:23:40.087551] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:23:40.087961] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-17T06:23:40.690148] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-17T06:23:41.490126] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-11. [2025-09-17T06:23:42.289229] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T06:23:42.294994] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-17T06:23:42.298488] [INFO ] [REMOTE ] SHO: Full fetch complete (71040 records). [2025-09-17T06:23:42.298684] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-17T06:23:42.734519] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-17T06:23:42.734717] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-17T06:23:42.736310] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-17T06:23:42.736379] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-17T06:23:42.738532] [DEBUG] [LOCAL ] SHO: Trimmed 71040 records to 49830 (keeping 200 days of data) [2025-09-17T06:23:43.046934] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T06:23:43.091491] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-09-17T06:23:43.137134] [DEBUG] [LOCAL ] SHO: Primary data saved (49830 records). [2025-09-17T06:23:43.137392] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-17T06:23:43.137568] [INFO ] [MAIN ] Update Progress: 1912/2369 symbols completed. SHO took 36.3s. Estimated remaining: 1h 6m 50s. Rate: 6.8 symbols/min [2025-09-17T06:23:43.329922] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:23:43.373712] [DEBUG] [LOCAL ] SIG: Loaded 34072 existing records from primary storage. [2025-09-17T06:23:43.373968] [INFO ] [MAIN ] SIG: Loaded 34072 existing records. [2025-09-17T06:23:43.586855] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:23:43.587248] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-17T06:23:43.587340] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-17T06:23:43.588244] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-17T06:23:43.588334] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-17T06:23:43.895278] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-17T06:23:43.963554] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:23:44.137872] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:23:44.138284] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-17T06:23:44.297723] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T06:23:44.653414] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T06:23:44.690075] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-09-17T06:23:45.490124] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-17T06:23:45.691072] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:23:45.691419] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-17T06:23:46.216312] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T06:23:46.290142] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-17T06:23:46.485108] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:23:46.485476] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-17T06:23:47.090139] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-11. [2025-09-17T06:23:47.890153] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-17T06:23:48.083385] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:23:48.083755] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-17T06:23:48.599986] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T06:23:48.690111] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-09-17T06:23:49.490113] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-17T06:23:49.887109] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T06:23:50.253289] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T06:23:50.290076] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-09-17T06:23:51.090149] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-17T06:23:51.890207] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-17T06:23:52.061054] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T06:23:52.195471] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T06:23:52.690182] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-17T06:23:53.490272] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-17T06:23:53.629399] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T06:23:54.255080] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T06:23:54.290154] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-17T06:23:54.903480] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T06:23:55.090140] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-17T06:23:55.890206] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-17T06:23:56.103361] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T06:23:56.437611] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T06:23:56.690313] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-17T06:23:57.490211] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-17T06:23:57.617903] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T06:23:58.217153] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T06:23:58.220243] [INFO ] [REMOTE ] SI: Full fetch complete (5052 records). [2025-09-17T06:23:58.220439] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-17T06:23:58.295486] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-17T06:23:58.418770] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 33 unique days, need 200 days [2025-09-17T06:23:58.419037] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:23:58.419140] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:23:58.419356] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-17T06:23:58.419818] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-17T06:23:58.420222] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-17T06:23:58.420354] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-17T06:23:58.420681] [INFO ] [MAIN ] Update Progress: 1913/2369 symbols completed. SI took 24.6s. Estimated remaining: 1h 6m 43s. Rate: 6.8 symbols/min [2025-09-17T06:23:58.607556] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:23:58.642659] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T06:23:58.676306] [DEBUG] [LOCAL ] SII: Loaded 17013 existing records from primary storage. [2025-09-17T06:23:58.676578] [INFO ] [MAIN ] SII: Loaded 17013 existing records. [2025-09-17T06:23:58.867289] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:23:58.867693] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-17T06:23:58.867802] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-17T06:23:58.868365] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-17T06:23:58.868427] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-17T06:23:59.095433] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-17T06:23:59.250792] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:23:59.890195] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-11. [2025-09-17T06:24:00.103808] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T06:24:00.350474] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T06:24:00.690170] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-17T06:24:00.860084] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T06:24:01.490205] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-17T06:24:02.290135] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-17T06:24:02.780552] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T06:24:03.090152] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-17T06:24:03.890150] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-09-17T06:24:04.716752] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (3.23 seconds). [2025-09-17T06:24:04.728925] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-17T06:24:04.803738] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-17T06:24:05.016250] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T06:24:05.076015] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T06:24:05.490124] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-17T06:24:06.290540] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-17T06:24:06.296243] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T06:24:07.095243] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-09-17T06:24:07.109239] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T06:24:07.635997] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T06:24:07.758630] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T06:24:07.890150] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-17T06:24:08.690141] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-17T06:24:09.490132] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-17T06:24:09.606377] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T06:24:09.612985] [INFO ] [REMOTE ] SHW: Full fetch complete (72874 records). [2025-09-17T06:24:09.613194] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-17T06:24:09.903405] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T06:24:10.040306] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-17T06:24:10.040435] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-17T06:24:10.041504] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-17T06:24:10.041567] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-17T06:24:10.043215] [DEBUG] [LOCAL ] SHW: Trimmed 72874 records to 50554 (keeping 200 days of data) [2025-09-17T06:24:10.290264] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-17T06:24:10.372465] [DEBUG] [LOCAL ] SHW: Primary data saved (50554 records). [2025-09-17T06:24:10.372673] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-17T06:24:10.372796] [INFO ] [MAIN ] Update Progress: 1914/2369 symbols completed. SHW took 46.4s. Estimated remaining: 1h 6m 35s. Rate: 6.8 symbols/min [2025-09-17T06:24:10.544601] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:24:10.567479] [DEBUG] [LOCAL ] SILA: Loaded 22844 existing records from primary storage. [2025-09-17T06:24:10.567667] [INFO ] [MAIN ] SILA: Loaded 22844 existing records. [2025-09-17T06:24:10.745040] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:24:10.745280] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-17T06:24:10.745359] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-17T06:24:10.746009] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-17T06:24:10.746072] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-17T06:24:11.093046] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-17T06:24:11.099178] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:24:11.136171] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T06:24:11.577390] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T06:24:11.890149] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-17T06:24:12.150204] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T06:24:12.690156] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-17T06:24:13.479280] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T06:24:13.490098] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-11. [2025-09-17T06:24:13.839408] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T06:24:14.290201] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-17T06:24:14.456179] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T06:24:14.994333] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T06:24:15.090135] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-17T06:24:15.890138] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-17T06:24:16.567722] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T06:24:16.573666] [INFO ] [REMOTE ] SID: Full fetch complete (60844 records). [2025-09-17T06:24:16.573804] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-17T06:24:16.695287] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-09-17T06:24:16.956583] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-17T06:24:16.956709] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-17T06:24:16.957799] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-17T06:24:16.957870] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-17T06:24:16.959774] [DEBUG] [LOCAL ] SID: Trimmed 60844 records to 42068 (keeping 200 days of data) [2025-09-17T06:24:17.033506] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T06:24:17.224049] [DEBUG] [LOCAL ] SID: Primary data saved (42068 records). [2025-09-17T06:24:17.224218] [INFO ] [MAIN ] SID: Full history saved. [2025-09-17T06:24:17.224316] [INFO ] [MAIN ] Update Progress: 1915/2369 symbols completed. SID took 38.8s. Estimated remaining: 1h 6m 25s. Rate: 6.8 symbols/min [2025-09-17T06:24:17.400883] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:24:17.434686] [DEBUG] [LOCAL ] SITC: Loaded 30627 existing records from primary storage. [2025-09-17T06:24:17.434882] [INFO ] [MAIN ] SITC: Loaded 30627 existing records. [2025-09-17T06:24:17.499717] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-17T06:24:17.637136] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:24:17.637480] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-17T06:24:17.637545] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-17T06:24:17.638249] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-17T06:24:17.638321] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-17T06:24:18.043771] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:24:18.290132] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-17T06:24:19.090116] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-11. [2025-09-17T06:24:19.122887] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-17T06:24:19.191371] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T06:24:19.890136] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-17T06:24:20.080558] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T06:24:20.086975] [INFO ] [REMOTE ] SIG: Full fetch complete (68217 records). [2025-09-17T06:24:20.087238] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-17T06:24:20.487172] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-17T06:24:20.487324] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-17T06:24:20.488362] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-17T06:24:20.488476] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-17T06:24:20.490852] [DEBUG] [LOCAL ] SIG: Trimmed 68217 records to 46812 (keeping 200 days of data) [2025-09-17T06:24:20.515232] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T06:24:20.704935] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-09-17T06:24:20.819595] [DEBUG] [LOCAL ] SIG: Primary data saved (46812 records). [2025-09-17T06:24:20.819771] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-17T06:24:20.819876] [INFO ] [MAIN ] Update Progress: 1916/2369 symbols completed. SIG took 37.7s. Estimated remaining: 1h 6m 15s. Rate: 6.8 symbols/min [2025-09-17T06:24:20.987813] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:24:21.014772] [DEBUG] [LOCAL ] SITE: Loaded 25828 existing records from primary storage. [2025-09-17T06:24:21.014933] [INFO ] [MAIN ] SITE: Loaded 25828 existing records. [2025-09-17T06:24:21.197354] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:24:21.197773] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-17T06:24:21.197870] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-17T06:24:21.204064] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-17T06:24:21.213419] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-17T06:24:21.290051] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T06:24:21.495336] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-17T06:24:21.592795] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:24:22.106119] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T06:24:22.290143] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-17T06:24:22.394386] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T06:24:23.090135] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-11. [2025-09-17T06:24:23.798204] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T06:24:23.890102] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-17T06:24:24.449517] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T06:24:24.691758] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-17T06:24:24.697868] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T06:24:25.490140] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-17T06:24:26.137630] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T06:24:26.290117] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-17T06:24:26.898322] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T06:24:27.090153] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-17T06:24:27.821196] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T06:24:27.890119] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-17T06:24:28.110673] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T06:24:28.113508] [INFO ] [REMOTE ] SII: Full fetch complete (29260 records). [2025-09-17T06:24:28.113613] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-17T06:24:28.487348] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-17T06:24:28.487463] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-17T06:24:28.488193] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-17T06:24:28.488254] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-17T06:24:28.489225] [DEBUG] [LOCAL ] SII: Trimmed 29260 records to 22885 (keeping 200 days of data) [2025-09-17T06:24:28.638328] [DEBUG] [LOCAL ] SII: Primary data saved (22885 records). [2025-09-17T06:24:28.638481] [INFO ] [MAIN ] SII: Full history saved. [2025-09-17T06:24:28.638573] [INFO ] [MAIN ] Update Progress: 1917/2369 symbols completed. SII took 30.2s. Estimated remaining: 1h 6m 6s. Rate: 6.8 symbols/min [2025-09-17T06:24:28.690077] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-17T06:24:28.988699] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T06:24:29.490142] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-17T06:24:30.154988] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T06:24:30.290165] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-17T06:24:30.863922] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T06:24:31.090148] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-17T06:24:31.625670] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T06:24:31.890144] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-17T06:24:32.315103] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T06:24:32.690161] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-09-17T06:24:33.380252] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T06:24:33.490113] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-17T06:24:33.520203] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T06:24:34.290263] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-17T06:24:34.844068] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T06:24:35.090137] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-17T06:24:35.781222] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T06:24:35.890156] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-17T06:24:36.347505] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T06:24:36.690136] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-17T06:24:37.149837] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T06:24:37.490156] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-17T06:24:37.972285] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T06:24:38.238672] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T06:24:38.242806] [INFO ] [REMOTE ] SILA: Full fetch complete (45417 records). [2025-09-17T06:24:38.242928] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-17T06:24:38.298247] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-17T06:24:38.625753] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-17T06:24:38.625870] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-17T06:24:38.626727] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-17T06:24:38.626796] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-17T06:24:38.629107] [DEBUG] [LOCAL ] SILA: Trimmed 45417 records to 31315 (keeping 200 days of data) [2025-09-17T06:24:38.829558] [DEBUG] [LOCAL ] SILA: Primary data saved (31315 records). [2025-09-17T06:24:38.829746] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-17T06:24:38.829871] [INFO ] [MAIN ] Update Progress: 1918/2369 symbols completed. SILA took 28.5s. Estimated remaining: 1h 5m 58s. Rate: 6.8 symbols/min [2025-09-17T06:24:39.090202] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-17T06:24:39.767241] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T06:24:39.890133] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-17T06:24:40.554236] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T06:24:40.560085] [INFO ] [REMOTE ] SITC: Full fetch complete (60670 records). [2025-09-17T06:24:40.560273] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-17T06:24:40.947372] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-17T06:24:40.947475] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-17T06:24:40.948433] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-17T06:24:40.948491] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-17T06:24:40.949710] [DEBUG] [LOCAL ] SITC: Trimmed 60670 records to 41687 (keeping 200 days of data) [2025-09-17T06:24:41.210129] [DEBUG] [LOCAL ] SITC: Primary data saved (41687 records). [2025-09-17T06:24:41.210311] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-17T06:24:41.210427] [INFO ] [MAIN ] Update Progress: 1919/2369 symbols completed. SITC took 24.0s. Estimated remaining: 1h 5m 48s. Rate: 6.8 symbols/min [2025-09-17T06:24:41.250132] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T06:24:41.258596] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-17T06:24:42.824052] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T06:24:42.832849] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-17T06:24:44.210834] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T06:24:44.218177] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-17T06:24:45.491588] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T06:24:45.499561] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-17T06:24:46.931037] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T06:24:46.940283] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-17T06:24:48.342436] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T06:24:48.350229] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-17T06:24:49.779588] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T06:24:49.787638] [INFO ] [REMOTE ] SITE: Full fetch complete (48979 records). [2025-09-17T06:24:49.787959] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-17T06:24:50.365305] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-17T06:24:50.365525] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-17T06:24:50.366523] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-17T06:24:50.366586] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-17T06:24:50.367881] [DEBUG] [LOCAL ] SITE: Trimmed 48979 records to 35336 (keeping 200 days of data) [2025-09-17T06:24:50.591186] [DEBUG] [LOCAL ] SITE: Primary data saved (35336 records). [2025-09-17T06:24:50.591373] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-17T06:24:50.591474] [INFO ] [MAIN ] Update Progress: 1920/2369 symbols completed. SITE took 29.8s. Estimated remaining: 1h 5m 39s. Rate: 6.8 symbols/min [2025-09-17T06:24:51.221217] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:24:51.258408] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:24:51.293833] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:24:51.341194] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:24:51.353763] [DEBUG] [LOCAL ] SKIL: Loaded 4546 existing records from primary storage. [2025-09-17T06:24:51.354255] [INFO ] [MAIN ] SKIL: Loaded 4546 existing records. [2025-09-17T06:24:51.472935] [DEBUG] [LOCAL ] SKE: Loaded 25861 existing records from primary storage. [2025-09-17T06:24:51.495928] [DEBUG] [LOCAL ] SJT: Loaded 16711 existing records from primary storage. [2025-09-17T06:24:51.496028] [INFO ] [MAIN ] SKE: Loaded 25861 existing records. [2025-09-17T06:24:51.501729] [INFO ] [MAIN ] SJT: Loaded 16711 existing records. [2025-09-17T06:24:51.650767] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:24:51.681425] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-17T06:24:51.736032] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-17T06:24:51.701979] [DEBUG] [LOCAL ] SJM: Loaded 37491 existing records from primary storage. [2025-09-17T06:24:51.755532] [INFO ] [MAIN ] SJM: Loaded 37491 existing records. [2025-09-17T06:24:51.790827] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-17T06:24:51.935762] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-17T06:24:51.955410] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:24:52.029312] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-17T06:24:52.104457] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-17T06:24:52.164896] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:24:52.186128] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-17T06:24:52.194087] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-17T06:24:52.194636] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-17T06:24:52.230724] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-17T06:24:52.387485] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:24:52.415238] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-17T06:24:52.437663] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-17T06:24:52.452304] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-17T06:24:52.437754] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-17T06:24:52.466216] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-17T06:24:52.519431] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-17T06:24:53.123504] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:24:53.300212] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-11. [2025-09-17T06:24:53.378142] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:24:53.414830] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-11. [2025-09-17T06:24:53.570697] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:24:53.609585] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-11. [2025-09-17T06:24:53.656424] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:24:53.656885] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-11. [2025-09-17T06:24:54.026484] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T06:24:54.027941] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-09-17T06:24:54.792260] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T06:24:54.797267] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-09-17T06:24:54.848720] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T06:24:54.856168] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-09-17T06:24:54.862102] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T06:24:54.864382] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-09-17T06:24:55.337509] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T06:24:55.347289] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-09-17T06:24:55.650400] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T06:24:55.664185] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-09-17T06:24:55.665426] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T06:24:55.669629] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-17T06:24:56.143865] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T06:24:56.150850] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-09-17T06:24:56.227131] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T06:24:56.229904] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-17T06:24:56.609824] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T06:24:56.620871] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-09-17T06:24:56.719426] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T06:24:56.723873] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-17T06:24:56.948236] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T06:24:57.140557] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T06:24:57.490280] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-17T06:24:57.598823] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T06:24:58.295340] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-17T06:24:58.311387] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T06:24:58.761487] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T06:24:58.881903] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T06:24:59.090204] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-17T06:24:59.890210] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-17T06:25:00.696702] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-17T06:25:00.704543] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T06:25:01.058897] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T06:25:01.302732] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T06:25:01.490208] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-17T06:25:02.290568] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-17T06:25:02.290902] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T06:25:03.090179] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-17T06:25:03.259769] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T06:25:03.890143] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-17T06:25:04.690212] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-17T06:25:04.784016] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T06:25:05.229445] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T06:25:05.490142] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-17T06:25:06.017024] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T06:25:06.290167] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-17T06:25:06.923915] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T06:25:07.090141] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-17T06:25:07.226734] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T06:25:07.890136] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-17T06:25:08.466457] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T06:25:08.536418] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T06:25:08.690157] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-17T06:25:09.490377] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-17T06:25:09.710209] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T06:25:10.290137] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-17T06:25:10.883172] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T06:25:10.884832] [INFO ] [REMOTE ] SKIL: Full fetch complete (9849 records). [2025-09-17T06:25:10.884941] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-17T06:25:11.099383] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-17T06:25:11.262958] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-17T06:25:11.268499] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-17T06:25:11.274783] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-17T06:25:11.275156] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T06:25:11.275398] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-17T06:25:11.280825] [DEBUG] [LOCAL ] SKIL: Trimmed 9849 records to 6295 (keeping 200 days of data) [2025-09-17T06:25:11.323585] [DEBUG] [LOCAL ] SKIL: Primary data saved (6295 records). [2025-09-17T06:25:11.323812] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-17T06:25:11.323967] [INFO ] [MAIN ] Update Progress: 1921/2369 symbols completed. SKIL took 20.7s. Estimated remaining: 1h 5m 33s. Rate: 6.8 symbols/min [2025-09-17T06:25:11.503563] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:25:11.514005] [DEBUG] [LOCAL ] SKLZ: Loaded 8571 existing records from primary storage. [2025-09-17T06:25:11.514168] [INFO ] [MAIN ] SKLZ: Loaded 8571 existing records. [2025-09-17T06:25:11.693041] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:25:11.693322] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-17T06:25:11.693385] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-17T06:25:11.693814] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-17T06:25:11.693879] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-17T06:25:11.895461] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-17T06:25:12.068550] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:25:12.690152] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-17T06:25:12.834626] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T06:25:13.376535] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T06:25:13.490113] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-11. [2025-09-17T06:25:13.860500] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T06:25:14.290154] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-17T06:25:14.540386] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T06:25:15.090217] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-17T06:25:15.890162] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-09-17T06:25:16.123331] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T06:25:16.188951] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T06:25:16.690149] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-17T06:25:16.957188] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T06:25:17.490157] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-17T06:25:17.850190] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T06:25:18.290131] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-17T06:25:18.508963] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T06:25:19.090152] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-17T06:25:19.890162] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-17T06:25:19.929277] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T06:25:20.030352] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T06:25:20.646842] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T06:25:20.650136] [INFO ] [REMOTE ] SJT: Full fetch complete (32186 records). [2025-09-17T06:25:20.650224] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-17T06:25:20.695290] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-17T06:25:21.022332] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-17T06:25:21.022438] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-17T06:25:21.023137] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-17T06:25:21.023203] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-17T06:25:21.024205] [DEBUG] [LOCAL ] SJT: Trimmed 32186 records to 22075 (keeping 200 days of data) [2025-09-17T06:25:21.147975] [DEBUG] [LOCAL ] SJT: Primary data saved (22075 records). [2025-09-17T06:25:21.148129] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-17T06:25:21.148222] [INFO ] [MAIN ] Update Progress: 1922/2369 symbols completed. SJT took 30.6s. Estimated remaining: 1h 5m 24s. Rate: 6.8 symbols/min [2025-09-17T06:25:21.342334] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:25:21.368046] [DEBUG] [LOCAL ] SKM: Loaded 26304 existing records from primary storage. [2025-09-17T06:25:21.368208] [INFO ] [MAIN ] SKM: Loaded 26304 existing records. [2025-09-17T06:25:21.495250] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-17T06:25:21.550174] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:25:21.550365] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-17T06:25:21.550421] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-17T06:25:21.551104] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-17T06:25:21.551180] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-17T06:25:21.905293] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:25:22.051496] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T06:25:22.290136] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-11. [2025-09-17T06:25:22.402698] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T06:25:23.090111] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-17T06:25:23.499915] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T06:25:23.890140] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-17T06:25:24.117926] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T06:25:24.122971] [INFO ] [REMOTE ] SKE: Full fetch complete (49584 records). [2025-09-17T06:25:24.123132] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-17T06:25:24.526259] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-17T06:25:24.526391] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-17T06:25:24.527275] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-17T06:25:24.527332] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-17T06:25:24.528523] [DEBUG] [LOCAL ] SKE: Trimmed 49584 records to 35179 (keeping 200 days of data) [2025-09-17T06:25:24.693222] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-17T06:25:24.744295] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T06:25:24.764125] [DEBUG] [LOCAL ] SKE: Primary data saved (35179 records). [2025-09-17T06:25:24.764280] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-17T06:25:24.764397] [INFO ] [MAIN ] Update Progress: 1923/2369 symbols completed. SKE took 34.2s. Estimated remaining: 1h 5m 14s. Rate: 6.8 symbols/min [2025-09-17T06:25:24.940966] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:25:24.971906] [DEBUG] [LOCAL ] SKT: Loaded 31523 existing records from primary storage. [2025-09-17T06:25:24.972076] [INFO ] [MAIN ] SKT: Loaded 31523 existing records. [2025-09-17T06:25:25.150165] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:25:25.150430] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-17T06:25:25.150490] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-17T06:25:25.151224] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-17T06:25:25.151288] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-17T06:25:25.494238] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-17T06:25:25.520850] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:25:26.290126] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-11. [2025-09-17T06:25:26.305416] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T06:25:26.567626] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T06:25:27.090126] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-17T06:25:27.726847] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T06:25:27.890133] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-09-17T06:25:27.901217] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T06:25:28.690132] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-17T06:25:29.316874] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T06:25:29.464182] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T06:25:29.490101] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-17T06:25:30.290182] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-09-17T06:25:30.525328] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T06:25:31.090144] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-17T06:25:31.661920] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T06:25:31.890123] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-17T06:25:32.690205] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-17T06:25:32.721488] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T06:25:32.728020] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T06:25:32.730751] [INFO ] [REMOTE ] SKLZ: Full fetch complete (19228 records). [2025-09-17T06:25:32.730623] [INFO ] [REMOTE ] SJM: Full fetch complete (71823 records). [2025-09-17T06:25:32.730977] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-17T06:25:32.731215] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-17T06:25:33.503943] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-09-17T06:25:33.535082] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-17T06:25:33.536355] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-17T06:25:33.537159] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-17T06:25:33.537025] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-17T06:25:33.537386] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-17T06:25:33.537487] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-17T06:25:33.538772] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-17T06:25:33.539432] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-17T06:25:33.539911] [DEBUG] [LOCAL ] SKLZ: Trimmed 19228 records to 12028 (keeping 200 days of data) [2025-09-17T06:25:33.569414] [DEBUG] [LOCAL ] SJM: Trimmed 71823 records to 50109 (keeping 200 days of data) [2025-09-17T06:25:33.834222] [DEBUG] [LOCAL ] SKLZ: Primary data saved (12028 records). [2025-09-17T06:25:33.835618] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-17T06:25:33.836257] [INFO ] [MAIN ] Update Progress: 1924/2369 symbols completed. SKLZ took 22.5s. Estimated remaining: 1h 5m 6s. Rate: 6.8 symbols/min [2025-09-17T06:25:34.020422] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:25:34.057926] [DEBUG] [LOCAL ] SKY: Loaded 28683 existing records from primary storage. [2025-09-17T06:25:34.059017] [INFO ] [MAIN ] SKY: Loaded 28683 existing records. [2025-09-17T06:25:34.318182] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:25:34.321724] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-17T06:25:34.322207] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-17T06:25:34.324431] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-17T06:25:34.325118] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-17T06:25:34.526063] [DEBUG] [LOCAL ] SJM: Primary data saved (50109 records). [2025-09-17T06:25:34.535759] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T06:25:34.552581] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-17T06:25:34.592827] [INFO ] [MAIN ] Update Progress: 1925/2369 symbols completed. SJM took 44.0s. Estimated remaining: 1h 4m 55s. Rate: 6.8 symbols/min [2025-09-17T06:25:34.641355] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-17T06:25:34.922092] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:25:34.975679] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:25:34.998088] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T06:25:35.012295] [DEBUG] [LOCAL ] SKYH: Loaded 11462 existing records from primary storage. [2025-09-17T06:25:35.012461] [INFO ] [MAIN ] SKYH: Loaded 11462 existing records. [2025-09-17T06:25:35.095255] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-09-17T06:25:35.193343] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:25:35.193604] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-17T06:25:35.193681] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-17T06:25:35.194012] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-17T06:25:35.194068] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-17T06:25:35.569165] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:25:35.890149] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-11. [2025-09-17T06:25:36.270246] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T06:25:36.411856] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T06:25:36.690127] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-11. [2025-09-17T06:25:37.165119] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T06:25:37.490174] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-17T06:25:37.579608] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T06:25:38.290166] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-09-17T06:25:39.026961] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T06:25:39.090146] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-09-17T06:25:39.819048] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T06:25:39.890093] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-17T06:25:40.062201] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T06:25:40.690206] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-17T06:25:41.243362] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T06:25:41.490171] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-17T06:25:42.285198] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T06:25:42.294725] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-17T06:25:42.824984] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T06:25:43.090127] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-17T06:25:43.580117] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T06:25:43.890208] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-17T06:25:44.161514] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T06:25:44.690163] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-17T06:25:44.955801] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T06:25:45.490162] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-17T06:25:46.017385] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T06:25:46.290177] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-17T06:25:46.562102] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T06:25:47.090140] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-17T06:25:47.774468] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T06:25:47.890123] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-17T06:25:48.549663] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T06:25:48.690176] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-17T06:25:49.441817] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T06:25:49.490147] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-17T06:25:50.152105] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T06:25:50.290132] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-17T06:25:50.922534] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T06:25:51.090188] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-17T06:25:51.392595] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T06:25:51.398067] [INFO ] [REMOTE ] SKT: Full fetch complete (59511 records). [2025-09-17T06:25:51.398287] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-17T06:25:51.784337] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-17T06:25:51.784462] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-17T06:25:51.785414] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-17T06:25:51.785496] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-17T06:25:51.786761] [DEBUG] [LOCAL ] SKT: Trimmed 59511 records to 42515 (keeping 200 days of data) [2025-09-17T06:25:51.893978] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-17T06:25:52.048265] [DEBUG] [LOCAL ] SKT: Primary data saved (42515 records). [2025-09-17T06:25:52.048419] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-17T06:25:52.048538] [INFO ] [MAIN ] Update Progress: 1926/2369 symbols completed. SKT took 27.3s. Estimated remaining: 1h 4m 48s. Rate: 6.8 symbols/min [2025-09-17T06:25:52.227542] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:25:52.265398] [DEBUG] [LOCAL ] SLB: Loaded 40047 existing records from primary storage. [2025-09-17T06:25:52.265580] [INFO ] [MAIN ] SLB: Loaded 40047 existing records. [2025-09-17T06:25:52.468696] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:25:52.470419] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T06:25:52.470592] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-17T06:25:52.477885] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-17T06:25:52.479361] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-17T06:25:52.479464] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-17T06:25:52.700210] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-17T06:25:52.843405] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:25:52.851175] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T06:25:53.490141] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-17T06:25:54.066076] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T06:25:54.289285] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T06:25:54.291963] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-11. [2025-09-17T06:25:55.090191] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-17T06:25:55.890246] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-17T06:25:56.035717] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T06:25:56.152407] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T06:25:56.690246] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-09-17T06:25:57.052397] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T06:25:57.490128] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-17T06:25:58.290133] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-17T06:25:58.404373] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T06:25:58.859357] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T06:25:59.090131] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-17T06:25:59.301184] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T06:25:59.890123] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-09-17T06:26:00.043297] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T06:26:00.690145] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-17T06:26:01.490135] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-17T06:26:01.544680] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T06:26:01.982868] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-17T06:26:02.290135] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-17T06:26:02.626029] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T06:26:02.630668] [INFO ] [REMOTE ] SKM: Full fetch complete (47896 records). [2025-09-17T06:26:02.630798] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-17T06:26:03.009420] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-17T06:26:03.009547] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-17T06:26:03.010392] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-17T06:26:03.010480] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-17T06:26:03.011788] [DEBUG] [LOCAL ] SKM: Trimmed 47896 records to 35464 (keeping 200 days of data) [2025-09-17T06:26:03.104300] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-17T06:26:03.234805] [DEBUG] [LOCAL ] SKM: Primary data saved (35464 records). [2025-09-17T06:26:03.234997] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-17T06:26:03.235127] [INFO ] [MAIN ] Update Progress: 1927/2369 symbols completed. SKM took 42.1s. Estimated remaining: 1h 4m 40s. Rate: 6.8 symbols/min [2025-09-17T06:26:03.402819] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:26:03.443844] [DEBUG] [LOCAL ] SLF: Loaded 28993 existing records from primary storage. [2025-09-17T06:26:03.444103] [INFO ] [MAIN ] SLF: Loaded 28993 existing records. [2025-09-17T06:26:03.621150] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:26:03.621430] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-17T06:26:03.621499] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-17T06:26:03.622194] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-17T06:26:03.622265] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-17T06:26:03.895280] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-17T06:26:03.977046] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:26:04.182677] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T06:26:04.567683] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T06:26:04.690275] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-17T06:26:05.014963] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T06:26:05.490140] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-17T06:26:06.290182] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-11. [2025-09-17T06:26:06.638110] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T06:26:06.988356] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T06:26:06.994033] [INFO ] [REMOTE ] SKY: Full fetch complete (54542 records). [2025-09-17T06:26:06.994191] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-17T06:26:07.095331] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-17T06:26:07.387768] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-17T06:26:07.387897] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-17T06:26:07.388951] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-17T06:26:07.389049] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-17T06:26:07.390304] [DEBUG] [LOCAL ] SKY: Trimmed 54542 records to 37601 (keeping 200 days of data) [2025-09-17T06:26:07.616729] [DEBUG] [LOCAL ] SKY: Primary data saved (37601 records). [2025-09-17T06:26:07.616905] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-17T06:26:07.617034] [INFO ] [MAIN ] Update Progress: 1928/2369 symbols completed. SKY took 33.8s. Estimated remaining: 1h 4m 30s. Rate: 6.8 symbols/min [2025-09-17T06:26:07.790213] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:26:07.801872] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T06:26:07.830405] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T06:26:07.863059] [DEBUG] [LOCAL ] SLG: Loaded 34057 existing records from primary storage. [2025-09-17T06:26:07.863260] [INFO ] [MAIN ] SLG: Loaded 34057 existing records. [2025-09-17T06:26:07.895200] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-17T06:26:08.044043] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:26:08.044320] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-17T06:26:08.044393] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-17T06:26:08.045120] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-17T06:26:08.045202] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-17T06:26:08.412311] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:26:08.690175] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-11. [2025-09-17T06:26:09.490133] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-09-17T06:26:09.872554] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T06:26:10.290132] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-17T06:26:10.323262] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T06:26:10.889792] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T06:26:11.090148] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-09-17T06:26:11.890209] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-09-17T06:26:12.185423] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T06:26:12.237601] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T06:26:12.690194] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-17T06:26:13.468573] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T06:26:13.490076] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-09-17T06:26:13.656832] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T06:26:14.290149] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-17T06:26:15.090830] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T06:26:15.090933] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-17T06:26:15.106289] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T06:26:15.108462] [INFO ] [REMOTE ] SKYH: Full fetch complete (22387 records). [2025-09-17T06:26:15.108556] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-17T06:26:15.492900] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-17T06:26:15.493051] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-17T06:26:15.493685] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-17T06:26:15.493774] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-17T06:26:15.495380] [DEBUG] [LOCAL ] SKYH: Trimmed 22387 records to 16523 (keeping 200 days of data) [2025-09-17T06:26:15.600255] [DEBUG] [LOCAL ] SKYH: Primary data saved (16523 records). [2025-09-17T06:26:15.600452] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-17T06:26:15.600554] [INFO ] [MAIN ] Update Progress: 1929/2369 symbols completed. SKYH took 41.0s. Estimated remaining: 1h 4m 21s. Rate: 6.8 symbols/min [2025-09-17T06:26:15.814466] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:26:15.847319] [DEBUG] [LOCAL ] SLGN: Loaded 29559 existing records from primary storage. [2025-09-17T06:26:15.847486] [INFO ] [MAIN ] SLGN: Loaded 29559 existing records. [2025-09-17T06:26:15.901733] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-17T06:26:16.034203] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:26:16.034482] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-17T06:26:16.034545] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-17T06:26:16.035294] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-17T06:26:16.035370] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-17T06:26:16.396035] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:26:16.690183] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-11. [2025-09-17T06:26:17.088362] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T06:26:17.477819] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T06:26:17.490068] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-17T06:26:18.096243] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T06:26:18.290127] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-17T06:26:18.586477] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T06:26:19.090154] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-17T06:26:19.776139] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T06:26:19.890141] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-09-17T06:26:20.146340] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T06:26:20.690179] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-17T06:26:20.944351] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T06:26:21.490171] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-17T06:26:22.290200] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-17T06:26:22.326777] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T06:26:23.090133] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-09-17T06:26:23.581319] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T06:26:23.673400] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T06:26:23.890168] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-17T06:26:24.131912] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T06:26:24.690146] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-17T06:26:25.465949] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T06:26:25.490105] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-17T06:26:26.142444] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T06:26:26.290169] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-17T06:26:26.532131] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T06:26:27.090191] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-17T06:26:27.890218] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-17T06:26:27.941931] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T06:26:27.949316] [INFO ] [REMOTE ] SLB: Full fetch complete (77603 records). [2025-09-17T06:26:27.949820] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-17T06:26:28.380591] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-17T06:26:28.380846] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-17T06:26:28.382468] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-17T06:26:28.382542] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-17T06:26:28.385795] [DEBUG] [LOCAL ] SLB: Trimmed 77603 records to 53697 (keeping 200 days of data) [2025-09-17T06:26:28.655512] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T06:26:28.691942] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-17T06:26:28.794101] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-09-17T06:26:28.794344] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-17T06:26:28.794491] [INFO ] [MAIN ] Update Progress: 1930/2369 symbols completed. SLB took 36.7s. Estimated remaining: 1h 4m 14s. Rate: 6.8 symbols/min [2025-09-17T06:26:28.974159] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:26:28.974444] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-17T06:26:28.974495] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-17T06:26:28.974619] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-17T06:26:28.974745] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-17T06:26:28.974806] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-17T06:26:28.974854] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-17T06:26:29.364871] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:26:29.393610] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T06:26:29.490141] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-17T06:26:30.290147] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-17T06:26:30.351341] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T06:26:30.947782] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T06:26:31.090163] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-11. [2025-09-17T06:26:31.389781] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-11 (0.30 seconds). [2025-09-17T06:26:31.890188] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-17T06:26:31.936589] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T06:26:32.690248] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-17T06:26:33.388439] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T06:26:33.490139] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-17T06:26:34.014846] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T06:26:34.290185] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-17T06:26:34.882463] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T06:26:35.090148] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-17T06:26:35.676251] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T06:26:35.890215] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-17T06:26:36.690177] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-17T06:26:36.804518] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T06:26:37.010050] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.32 seconds). [2025-09-17T06:26:37.490223] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-17T06:26:37.651933] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T06:26:37.744111] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-17T06:26:38.290168] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-17T06:26:39.090142] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-17T06:26:39.718240] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T06:26:39.751422] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T06:26:39.890236] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-17T06:26:40.690181] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-17T06:26:41.220534] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T06:26:41.233290] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T06:26:41.238158] [INFO ] [REMOTE ] SLF: Full fetch complete (56647 records). [2025-09-17T06:26:41.238275] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-17T06:26:41.495253] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-17T06:26:41.625196] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-17T06:26:41.625300] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-17T06:26:41.626240] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-17T06:26:41.626297] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-17T06:26:41.627578] [DEBUG] [LOCAL ] SLF: Trimmed 56647 records to 39373 (keeping 200 days of data) [2025-09-17T06:26:41.879090] [DEBUG] [LOCAL ] SLF: Primary data saved (39373 records). [2025-09-17T06:26:41.879262] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-17T06:26:41.879362] [INFO ] [MAIN ] Update Progress: 1931/2369 symbols completed. SLF took 38.6s. Estimated remaining: 1h 4m 6s. Rate: 6.8 symbols/min [2025-09-17T06:26:42.048160] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:26:42.080895] [DEBUG] [LOCAL ] SLQT: Loaded 32692 existing records from primary storage. [2025-09-17T06:26:42.081056] [INFO ] [MAIN ] SLQT: Loaded 32692 existing records. [2025-09-17T06:26:42.259845] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:26:42.260113] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-17T06:26:42.260175] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-17T06:26:42.260918] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-17T06:26:42.260992] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-17T06:26:42.295279] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-17T06:26:42.626490] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:26:42.697272] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-17T06:26:42.970746] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T06:26:42.976297] [INFO ] [REMOTE ] SLGN: Full fetch complete (57462 records). [2025-09-17T06:26:42.976419] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-17T06:26:43.095225] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-17T06:26:43.360372] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-17T06:26:43.360478] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-17T06:26:43.361402] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-17T06:26:43.361460] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-17T06:26:43.362694] [DEBUG] [LOCAL ] SLGN: Trimmed 57462 records to 40234 (keeping 200 days of data) [2025-09-17T06:26:43.478006] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T06:26:43.632757] [DEBUG] [LOCAL ] SLGN: Primary data saved (40234 records). [2025-09-17T06:26:43.632945] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-17T06:26:43.633077] [INFO ] [MAIN ] Update Progress: 1932/2369 symbols completed. SLGN took 28.0s. Estimated remaining: 1h 3m 55s. Rate: 6.8 symbols/min [2025-09-17T06:26:43.803415] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:26:43.823241] [DEBUG] [LOCAL ] SLVM: Loaded 20486 existing records from primary storage. [2025-09-17T06:26:43.823402] [INFO ] [MAIN ] SLVM: Loaded 20486 existing records. [2025-09-17T06:26:43.895228] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-17T06:26:44.005512] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:26:44.005802] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-17T06:26:44.005864] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-17T06:26:44.006394] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-17T06:26:44.006453] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-17T06:26:44.286406] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-17T06:26:44.368331] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:26:44.690193] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-17T06:26:45.490172] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-17T06:26:45.804983] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-17T06:26:46.249877] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T06:26:46.290105] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-11. [2025-09-17T06:26:47.090137] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-11. [2025-09-17T06:26:47.428310] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T06:26:47.890129] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-17T06:26:48.199319] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T06:26:48.690174] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-09-17T06:26:49.366017] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T06:26:49.372186] [INFO ] [REMOTE ] SLG: Full fetch complete (65277 records). [2025-09-17T06:26:49.372350] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-17T06:26:49.495210] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-17T06:26:49.765455] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-17T06:26:49.765574] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-17T06:26:49.766717] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-17T06:26:49.766782] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-17T06:26:49.768663] [DEBUG] [LOCAL ] SLG: Trimmed 65277 records to 45558 (keeping 200 days of data) [2025-09-17T06:26:49.867470] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-17T06:26:50.063484] [DEBUG] [LOCAL ] SLG: Primary data saved (45558 records). [2025-09-17T06:26:50.063671] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-17T06:26:50.063797] [INFO ] [MAIN ] Update Progress: 1933/2369 symbols completed. SLG took 42.4s. Estimated remaining: 1h 3m 46s. Rate: 6.8 symbols/min [2025-09-17T06:26:50.240797] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:26:50.265572] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T06:26:50.291783] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-09-17T06:26:50.308418] [DEBUG] [LOCAL ] SM: Loaded 38863 existing records from primary storage. [2025-09-17T06:26:50.308592] [INFO ] [MAIN ] SM: Loaded 38863 existing records. [2025-09-17T06:26:50.484284] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:26:50.484558] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-17T06:26:50.484618] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-17T06:26:50.485538] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-17T06:26:50.485597] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-17T06:26:50.847560] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:26:51.090149] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-09-17T06:26:51.826090] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T06:26:51.890094] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-17T06:26:52.247446] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T06:26:52.690132] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-17T06:26:53.054013] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T06:26:53.054794] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1093 records). [2025-09-17T06:26:53.054884] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-17T06:26:53.237243] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-17T06:26:53.237458] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:26:53.237509] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:26:53.237556] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-17T06:26:53.237625] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-17T06:26:53.237697] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-17T06:26:53.237768] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-17T06:26:53.237842] [INFO ] [MAIN ] Update Progress: 1934/2369 symbols completed. SLNZ took 24.4s. Estimated remaining: 1h 3m 36s. Rate: 6.8 symbols/min [2025-09-17T06:26:53.412564] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:26:53.412984] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-17T06:26:53.413132] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-17T06:26:53.413360] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-17T06:26:53.413463] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-17T06:26:53.413594] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-17T06:26:53.413776] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-17T06:26:53.495765] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-11. [2025-09-17T06:26:53.716948] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T06:26:53.815638] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:26:54.290187] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-11. [2025-09-17T06:26:54.491908] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:26:54.492313] [WARN ] [REMOTE ] SMA: No data returned for month 2024-11 [2025-09-17T06:26:55.090251] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-17T06:26:55.233371] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T06:26:55.890140] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-09-17T06:26:56.405896] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T06:26:56.690165] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-17T06:26:56.927299] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T06:26:57.490139] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-17T06:26:58.252400] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T06:26:58.290110] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-17T06:26:58.593227] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T06:26:59.090164] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-17T06:26:59.289193] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:26:59.289545] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-17T06:26:59.613364] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T06:26:59.890144] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-09-17T06:27:00.690139] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-17T06:27:01.490196] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-09-17T06:27:01.562857] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T06:27:01.926325] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:27:01.926723] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-09-17T06:27:02.290134] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-09-17T06:27:02.768827] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-17T06:27:03.090140] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-17T06:27:03.440706] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:27:03.441088] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-17T06:27:03.890136] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-17T06:27:04.690208] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-17T06:27:04.904766] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:27:04.905193] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-17T06:27:05.295382] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (3.01 seconds). [2025-09-17T06:27:05.500999] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-17T06:27:05.507753] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T06:27:06.290172] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-17T06:27:06.971795] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T06:27:07.090144] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-17T06:27:07.890145] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-17T06:27:08.038162] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T06:27:08.690175] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-17T06:27:08.857097] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T06:27:09.123830] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T06:27:09.490151] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-17T06:27:10.052313] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T06:27:10.290137] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-17T06:27:10.683897] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T06:27:11.090131] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-17T06:27:11.890159] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-17T06:27:12.132225] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T06:27:12.320247] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T06:27:12.690152] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-17T06:27:13.490166] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-17T06:27:13.528194] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T06:27:13.533325] [INFO ] [REMOTE ] SLQT: Full fetch complete (63495 records). [2025-09-17T06:27:13.533545] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-17T06:27:13.931114] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-17T06:27:13.931317] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-17T06:27:13.932436] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-17T06:27:13.932530] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-17T06:27:13.934189] [DEBUG] [LOCAL ] SLQT: Trimmed 63495 records to 44443 (keeping 200 days of data) [2025-09-17T06:27:14.006672] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T06:27:14.209457] [DEBUG] [LOCAL ] SLQT: Primary data saved (44443 records). [2025-09-17T06:27:14.209636] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-17T06:27:14.209758] [INFO ] [MAIN ] Update Progress: 1935/2369 symbols completed. SLQT took 32.3s. Estimated remaining: 1h 3m 30s. Rate: 6.8 symbols/min [2025-09-17T06:27:14.300383] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-17T06:27:14.387405] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:27:14.395587] [DEBUG] [LOCAL ] SMBK: Loaded 5935 existing records from primary storage. [2025-09-17T06:27:14.395753] [INFO ] [MAIN ] SMBK: Loaded 5935 existing records. [2025-09-17T06:27:14.575151] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:27:14.575447] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-17T06:27:14.575509] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-17T06:27:14.575969] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-17T06:27:14.576033] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-17T06:27:14.952469] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:27:14.973047] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T06:27:15.090204] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-17T06:27:15.628153] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T06:27:15.890188] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-11. [2025-09-17T06:27:16.365338] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T06:27:16.690139] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-09-17T06:27:16.887386] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T06:27:17.451711] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T06:27:17.490094] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-17T06:27:18.106144] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T06:27:18.290186] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-17T06:27:19.090142] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-17T06:27:19.314942] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T06:27:19.890140] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-17T06:27:20.658203] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T06:27:20.690110] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-17T06:27:20.771217] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T06:27:21.490139] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-17T06:27:22.290168] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-17T06:27:22.471455] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T06:27:22.747591] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T06:27:22.751803] [INFO ] [REMOTE ] SMA: Full fetch complete (28210 records). [2025-09-17T06:27:22.751909] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-17T06:27:22.956967] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 115 unique days, need 200 days [2025-09-17T06:27:22.957395] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:27:22.957459] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:27:22.957520] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-17T06:27:22.957614] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-17T06:27:22.957707] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-17T06:27:22.957763] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-17T06:27:22.957845] [INFO ] [MAIN ] Update Progress: 1936/2369 symbols completed. SMA took 29.7s. Estimated remaining: 1h 3m 21s. Rate: 6.8 symbols/min [2025-09-17T06:27:23.090851] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-17T06:27:23.152602] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:27:23.155342] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T06:27:23.166726] [DEBUG] [LOCAL ] SMC: Loaded 7825 existing records from primary storage. [2025-09-17T06:27:23.166918] [INFO ] [MAIN ] SMC: Loaded 7825 existing records. [2025-09-17T06:27:23.360939] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:27:23.361274] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-17T06:27:23.361371] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-17T06:27:23.361774] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-17T06:27:23.361860] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-17T06:27:23.776591] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:27:23.890127] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-11. [2025-09-17T06:27:24.614826] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T06:27:24.695793] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-09-17T06:27:24.716494] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T06:27:25.490129] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-17T06:27:25.599194] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T06:27:26.290118] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-17T06:27:27.090095] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-09-17T06:27:27.195979] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T06:27:27.511458] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T06:27:27.881190] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T06:27:27.890085] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-17T06:27:28.690167] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-17T06:27:28.742203] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T06:27:29.490144] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-17T06:27:30.290136] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-17T06:27:30.440994] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T06:27:30.810210] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T06:27:31.090146] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-17T06:27:31.196619] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T06:27:31.890187] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-17T06:27:32.190021] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T06:27:32.193763] [INFO ] [REMOTE ] SLVM: Full fetch complete (39239 records). [2025-09-17T06:27:32.193860] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-17T06:27:32.569664] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-17T06:27:32.569770] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-17T06:27:32.570540] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-17T06:27:32.570590] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-17T06:27:32.571528] [DEBUG] [LOCAL ] SLVM: Trimmed 39239 records to 28030 (keeping 200 days of data) [2025-09-17T06:27:32.690173] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-17T06:27:32.745067] [DEBUG] [LOCAL ] SLVM: Primary data saved (28030 records). [2025-09-17T06:27:32.745207] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-17T06:27:32.745297] [INFO ] [MAIN ] Update Progress: 1937/2369 symbols completed. SLVM took 49.1s. Estimated remaining: 1h 3m 13s. Rate: 6.8 symbols/min [2025-09-17T06:27:32.919889] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:27:32.955454] [DEBUG] [LOCAL ] SMFG: Loaded 35752 existing records from primary storage. [2025-09-17T06:27:32.955625] [INFO ] [MAIN ] SMFG: Loaded 35752 existing records. [2025-09-17T06:27:33.133314] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:27:33.133540] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-17T06:27:33.133623] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-17T06:27:33.134528] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-17T06:27:33.134605] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-17T06:27:33.494591] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:27:33.491031] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-17T06:27:33.502291] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T06:27:33.521629] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T06:27:33.527978] [INFO ] [REMOTE ] SM: Full fetch complete (74878 records). [2025-09-17T06:27:33.528114] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-17T06:27:33.914256] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-17T06:27:33.914356] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-17T06:27:33.915459] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-17T06:27:33.915540] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-17T06:27:33.917092] [DEBUG] [LOCAL ] SM: Trimmed 74878 records to 52323 (keeping 200 days of data) [2025-09-17T06:27:34.254387] [DEBUG] [LOCAL ] SM: Primary data saved (52323 records). [2025-09-17T06:27:34.254604] [INFO ] [MAIN ] SM: Full history saved. [2025-09-17T06:27:34.254757] [INFO ] [MAIN ] Update Progress: 1938/2369 symbols completed. SM took 44.2s. Estimated remaining: 1h 3m 2s. Rate: 6.8 symbols/min [2025-09-17T06:27:34.298909] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-11. [2025-09-17T06:27:34.429402] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:27:34.460841] [DEBUG] [LOCAL ] SMG: Loaded 32250 existing records from primary storage. [2025-09-17T06:27:34.461031] [INFO ] [MAIN ] SMG: Loaded 32250 existing records. [2025-09-17T06:27:34.637554] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:27:34.638165] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-17T06:27:34.638258] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-17T06:27:34.645918] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-17T06:27:34.646195] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-17T06:27:34.653930] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T06:27:35.013044] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:27:35.090127] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-11. [2025-09-17T06:27:35.652942] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T06:27:35.890140] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-09-17T06:27:36.615757] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T06:27:36.690150] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-09-17T06:27:37.495895] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-17T06:27:37.501220] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T06:27:38.168320] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T06:27:38.251754] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T06:27:38.290139] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-09-17T06:27:39.090193] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-09-17T06:27:39.846766] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T06:27:39.890104] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-17T06:27:40.670589] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T06:27:40.690080] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-17T06:27:41.359218] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T06:27:41.490143] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-17T06:27:42.016484] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T06:27:42.271409] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T06:27:42.290087] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-17T06:27:42.877490] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T06:27:43.090143] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-17T06:27:43.890156] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-17T06:27:44.590291] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T06:27:44.690152] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-17T06:27:45.475976] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T06:27:45.490071] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-17T06:27:46.035665] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T06:27:46.290149] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-17T06:27:47.058472] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T06:27:47.090171] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-17T06:27:47.243885] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T06:27:47.497149] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T06:27:47.890189] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-17T06:27:48.690153] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-17T06:27:49.450891] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T06:27:49.495199] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-17T06:27:49.513323] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T06:27:50.290152] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-17T06:27:50.360363] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T06:27:50.361811] [INFO ] [REMOTE ] SMBK: Full fetch complete (11704 records). [2025-09-17T06:27:50.361895] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-17T06:27:50.739466] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-17T06:27:50.739601] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-17T06:27:50.739999] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-17T06:27:50.740063] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-17T06:27:50.740691] [DEBUG] [LOCAL ] SMBK: Trimmed 11704 records to 8272 (keeping 200 days of data) [2025-09-17T06:27:50.795525] [DEBUG] [LOCAL ] SMBK: Primary data saved (8272 records). [2025-09-17T06:27:50.795724] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-17T06:27:50.795836] [INFO ] [MAIN ] Update Progress: 1939/2369 symbols completed. SMBK took 36.6s. Estimated remaining: 1h 2m 55s. Rate: 6.8 symbols/min [2025-09-17T06:27:50.966822] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:27:50.977457] [DEBUG] [LOCAL ] SMHI: Loaded 9646 existing records from primary storage. [2025-09-17T06:27:50.977583] [INFO ] [MAIN ] SMHI: Loaded 9646 existing records. [2025-09-17T06:27:51.095232] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-17T06:27:51.160574] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:27:51.160840] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-17T06:27:51.160899] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-17T06:27:51.161212] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-17T06:27:51.161269] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-17T06:27:51.514372] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:27:51.830211] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T06:27:51.890116] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-17T06:27:52.554796] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T06:27:52.690084] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-17T06:27:53.427243] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T06:27:53.490159] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-11. [2025-09-17T06:27:53.908150] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T06:27:54.290109] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-17T06:27:54.746055] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T06:27:55.090148] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-17T06:27:55.835903] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T06:27:55.890118] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-17T06:27:56.697865] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-17T06:27:56.703915] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T06:27:56.913074] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T06:27:56.918232] [INFO ] [REMOTE ] SMG: Full fetch complete (62766 records). [2025-09-17T06:27:56.918375] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-17T06:27:57.309826] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-17T06:27:57.309957] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-17T06:27:57.311028] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-17T06:27:57.311091] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-17T06:27:57.312420] [DEBUG] [LOCAL ] SMG: Trimmed 62766 records to 44376 (keeping 200 days of data) [2025-09-17T06:27:57.497536] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-17T06:27:57.603451] [DEBUG] [LOCAL ] SMG: Primary data saved (44376 records). [2025-09-17T06:27:57.603619] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-17T06:27:57.603737] [INFO ] [MAIN ] Update Progress: 1940/2369 symbols completed. SMG took 23.3s. Estimated remaining: 1h 2m 46s. Rate: 6.8 symbols/min [2025-09-17T06:27:57.776273] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:27:57.792180] [DEBUG] [LOCAL ] SMP: Loaded 13817 existing records from primary storage. [2025-09-17T06:27:57.792348] [INFO ] [MAIN ] SMP: Loaded 13817 existing records. [2025-09-17T06:27:57.972510] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:27:57.972860] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-17T06:27:57.972922] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-17T06:27:57.973425] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-17T06:27:57.973482] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-17T06:27:58.294750] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-17T06:27:58.356514] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T06:27:58.354341] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:27:59.104346] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-17T06:27:59.109592] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T06:27:59.151915] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T06:27:59.890143] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-17T06:28:00.238462] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T06:28:00.690140] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-17T06:28:00.703193] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T06:28:00.704977] [INFO ] [REMOTE ] SMC: Full fetch complete (16789 records). [2025-09-17T06:28:00.705068] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-17T06:28:01.073530] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-17T06:28:01.073672] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-17T06:28:01.074094] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-17T06:28:01.074159] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-17T06:28:01.074973] [DEBUG] [LOCAL ] SMC: Trimmed 16789 records to 11502 (keeping 200 days of data) [2025-09-17T06:28:01.143971] [DEBUG] [LOCAL ] SMC: Primary data saved (11502 records). [2025-09-17T06:28:01.144138] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-17T06:28:01.144234] [INFO ] [MAIN ] Update Progress: 1941/2369 symbols completed. SMC took 38.2s. Estimated remaining: 1h 2m 36s. Rate: 6.8 symbols/min [2025-09-17T06:28:01.315672] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:28:01.315893] [DEBUG] [LOCAL ] SMR: No existing data file found in primary storage. [2025-09-17T06:28:01.315945] [WARN ] [MAIN ] SMR: No existing data found, performing full refresh instead. [2025-09-17T06:28:01.316057] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-17T06:28:01.316107] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-17T06:28:01.316157] [DEBUG] [LOCAL ] SMR: No primary data file found to delete. [2025-09-17T06:28:01.316201] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-17T06:28:01.500036] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-17T06:28:01.718387] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:28:02.290133] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-11. [2025-09-17T06:28:02.358559] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T06:28:02.364755] [INFO ] [REMOTE ] SMFG: Full fetch complete (68609 records). [2025-09-17T06:28:02.364921] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-17T06:28:02.738745] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T06:28:02.793599] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-17T06:28:02.793843] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-17T06:28:02.795135] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-17T06:28:02.795204] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-17T06:28:02.796848] [DEBUG] [LOCAL ] SMFG: Trimmed 68609 records to 48184 (keeping 200 days of data) [2025-09-17T06:28:03.090247] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-17T06:28:03.091161] [DEBUG] [LOCAL ] SMFG: Primary data saved (48184 records). [2025-09-17T06:28:03.092368] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-17T06:28:03.092498] [INFO ] [MAIN ] Update Progress: 1942/2369 symbols completed. SMFG took 30.3s. Estimated remaining: 1h 2m 26s. Rate: 6.8 symbols/min [2025-09-17T06:28:03.266662] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:28:03.297717] [DEBUG] [LOCAL ] SMRT: Loaded 33024 existing records from primary storage. [2025-09-17T06:28:03.297889] [INFO ] [MAIN ] SMRT: Loaded 33024 existing records. [2025-09-17T06:28:03.481155] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:28:03.481440] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-17T06:28:03.481500] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-17T06:28:03.482235] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-17T06:28:03.482301] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-17T06:28:03.846706] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:28:03.890131] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-11. [2025-09-17T06:28:03.981210] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T06:28:04.690118] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-17T06:28:04.745953] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-11 (2.46 seconds). [2025-09-17T06:28:04.890431] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T06:28:05.490140] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-09-17T06:28:05.772335] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T06:28:06.290134] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-17T06:28:06.921418] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T06:28:07.090131] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-09-17T06:28:07.890240] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-17T06:28:08.470007] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T06:28:08.690196] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-17T06:28:08.855999] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.57 seconds). [2025-09-17T06:28:08.857042] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T06:28:09.490131] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-17T06:28:09.834909] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T06:28:10.290131] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-17T06:28:11.090141] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-11. [2025-09-17T06:28:11.203165] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T06:28:11.766284] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-17T06:28:11.890150] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-17T06:28:12.053996] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T06:28:12.484537] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T06:28:12.690325] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-17T06:28:13.490195] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-09-17T06:28:14.290136] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-17T06:28:14.512903] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T06:28:15.095256] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-17T06:28:15.113452] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-17T06:28:15.890190] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-17T06:28:16.690187] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-09-17T06:28:16.984759] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T06:28:17.490191] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-17T06:28:17.521823] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T06:28:18.098632] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (3.81 seconds). [2025-09-17T06:28:18.287166] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-17T06:28:18.297831] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-17T06:28:18.937246] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T06:28:19.011001] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T06:28:19.012751] [INFO ] [REMOTE ] SMHI: Full fetch complete (25120 records). [2025-09-17T06:28:19.012836] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-17T06:28:19.095225] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-17T06:28:19.383441] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-17T06:28:19.383555] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-17T06:28:19.384246] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-17T06:28:19.384311] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-17T06:28:19.385106] [DEBUG] [LOCAL ] SMHI: Trimmed 25120 records to 14649 (keeping 200 days of data) [2025-09-17T06:28:19.472050] [DEBUG] [LOCAL ] SMHI: Primary data saved (14649 records). [2025-09-17T06:28:19.472234] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-17T06:28:19.472368] [INFO ] [MAIN ] Update Progress: 1943/2369 symbols completed. SMHI took 28.7s. Estimated remaining: 1h 2m 19s. Rate: 6.8 symbols/min [2025-09-17T06:28:19.639567] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:28:19.663053] [DEBUG] [LOCAL ] SMWB: Loaded 24814 existing records from primary storage. [2025-09-17T06:28:19.663238] [INFO ] [MAIN ] SMWB: Loaded 24814 existing records. [2025-09-17T06:28:19.846230] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:28:19.846473] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-17T06:28:19.846529] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-17T06:28:19.847113] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-17T06:28:19.847179] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-17T06:28:19.900734] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-17T06:28:20.268718] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T06:28:20.272746] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:28:20.690145] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-11. [2025-09-17T06:28:21.388143] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T06:28:21.490111] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-17T06:28:21.925245] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T06:28:22.290133] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-17T06:28:23.012150] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T06:28:23.090089] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-17T06:28:23.890142] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-09-17T06:28:24.658234] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T06:28:24.690125] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-17T06:28:24.816554] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-17T06:28:25.004022] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T06:28:25.490119] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-17T06:28:25.866969] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T06:28:26.290110] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-09-17T06:28:26.563133] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T06:28:27.090154] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-17T06:28:27.791192] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T06:28:27.890106] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-17T06:28:28.196009] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T06:28:28.690133] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-17T06:28:29.352818] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T06:28:29.490173] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-17T06:28:29.729306] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T06:28:30.290177] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-17T06:28:30.828717] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T06:28:31.090189] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-17T06:28:31.658115] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T06:28:31.664598] [INFO ] [REMOTE ] SMRT: Full fetch complete (62244 records). [2025-09-17T06:28:31.664895] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-17T06:28:31.897409] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-17T06:28:32.090133] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-17T06:28:32.090332] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-17T06:28:32.091856] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-17T06:28:32.091967] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-17T06:28:32.093927] [DEBUG] [LOCAL ] SMRT: Trimmed 62244 records to 44448 (keeping 200 days of data) [2025-09-17T06:28:32.381508] [DEBUG] [LOCAL ] SMRT: Primary data saved (44448 records). [2025-09-17T06:28:32.381755] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-17T06:28:32.381935] [INFO ] [MAIN ] Update Progress: 1944/2369 symbols completed. SMRT took 29.3s. Estimated remaining: 1h 2m 11s. Rate: 6.8 symbols/min [2025-09-17T06:28:32.560821] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:28:32.612666] [DEBUG] [LOCAL ] SN: Loaded 37194 existing records from primary storage. [2025-09-17T06:28:32.612987] [INFO ] [MAIN ] SN: Loaded 37194 existing records. [2025-09-17T06:28:32.699230] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-17T06:28:32.817937] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:28:32.818333] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-17T06:28:32.818412] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-17T06:28:32.819352] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-17T06:28:32.819435] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-17T06:28:33.204216] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:28:33.367593] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T06:28:33.490099] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-17T06:28:33.609906] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.52 seconds). [2025-09-17T06:28:33.645209] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T06:28:34.290147] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-17T06:28:34.835352] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T06:28:35.090160] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-17T06:28:35.330957] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T06:28:35.890162] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-17T06:28:36.491614] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T06:28:36.690093] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-17T06:28:37.490096] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-17T06:28:37.960142] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T06:28:38.069749] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-17T06:28:38.290145] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-11. [2025-09-17T06:28:38.552732] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T06:28:39.090176] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-17T06:28:39.888819] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T06:28:39.892279] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-17T06:28:39.894420] [INFO ] [REMOTE ] SMP: Full fetch complete (25871 records). [2025-09-17T06:28:39.894591] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-17T06:28:40.372609] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T06:28:40.559246] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-17T06:28:40.559413] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-17T06:28:40.560457] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-17T06:28:40.560549] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-17T06:28:40.561856] [DEBUG] [LOCAL ] SMP: Trimmed 25871 records to 20039 (keeping 200 days of data) [2025-09-17T06:28:40.692192] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-09-17T06:28:40.740782] [DEBUG] [LOCAL ] SMP: Primary data saved (20039 records). [2025-09-17T06:28:40.740951] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-17T06:28:40.741055] [INFO ] [MAIN ] Update Progress: 1945/2369 symbols completed. SMP took 43.1s. Estimated remaining: 1h 2m 2s. Rate: 6.8 symbols/min [2025-09-17T06:28:40.919595] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:28:40.942037] [DEBUG] [LOCAL ] SNA: Loaded 18449 existing records from primary storage. [2025-09-17T06:28:40.942220] [INFO ] [MAIN ] SNA: Loaded 18449 existing records. [2025-09-17T06:28:41.135414] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:28:41.135733] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-17T06:28:41.135796] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-17T06:28:41.136455] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-17T06:28:41.136530] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-17T06:28:41.499032] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-17T06:28:41.503595] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:28:42.298992] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-11. [2025-09-17T06:28:42.304365] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T06:28:42.718664] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-17T06:28:42.806553] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T06:28:43.090138] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-09-17T06:28:43.656597] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T06:28:43.890136] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-17T06:28:44.350015] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T06:28:44.690145] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-17T06:28:45.490165] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-17T06:28:46.007040] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T06:28:46.011163] [INFO ] [REMOTE ] SMWB: Full fetch complete (50734 records). [2025-09-17T06:28:46.011299] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-17T06:28:46.294474] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-09-17T06:28:46.397708] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-17T06:28:46.397918] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-17T06:28:46.398917] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-17T06:28:46.398988] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-17T06:28:46.400236] [DEBUG] [LOCAL ] SMWB: Trimmed 50734 records to 33445 (keeping 200 days of data) [2025-09-17T06:28:46.527189] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-17T06:28:46.636602] [DEBUG] [LOCAL ] SMWB: Primary data saved (33445 records). [2025-09-17T06:28:46.636794] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-17T06:28:46.636916] [INFO ] [MAIN ] Update Progress: 1946/2369 symbols completed. SMWB took 27.2s. Estimated remaining: 1h 1m 53s. Rate: 6.8 symbols/min [2025-09-17T06:28:46.805114] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:28:46.848223] [DEBUG] [LOCAL ] SNAP: Loaded 40146 existing records from primary storage. [2025-09-17T06:28:46.848427] [INFO ] [MAIN ] SNAP: Loaded 40146 existing records. [2025-09-17T06:28:47.034304] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:28:47.034756] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-17T06:28:47.034864] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-17T06:28:47.036211] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-17T06:28:47.036292] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-17T06:28:47.099980] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-17T06:28:47.372318] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T06:28:47.442688] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:28:47.696347] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T06:28:47.890293] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-11. [2025-09-17T06:28:48.690139] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-09-17T06:28:49.490301] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-17T06:28:49.861564] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-17T06:28:49.868109] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-09-17T06:28:49.868266] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-17T06:28:50.272271] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-09-17T06:28:50.272683] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-09-17T06:28:50.274115] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-09-17T06:28:50.274486] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-09-17T06:28:50.293113] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T06:28:50.318144] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 53797 (keeping 200 days of data) [2025-09-17T06:28:50.328319] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-17T06:28:50.330989] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-11 (2.44 seconds). [2025-09-17T06:28:50.661000] [DEBUG] [LOCAL ] SMR: Primary data saved (53797 records). [2025-09-17T06:28:50.661168] [INFO ] [MAIN ] SMR: Full history saved. [2025-09-17T06:28:50.661277] [INFO ] [MAIN ] Update Progress: 1947/2369 symbols completed. SMR took 49.5s. Estimated remaining: 1h 1m 43s. Rate: 6.8 symbols/min [2025-09-17T06:28:50.829167] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:28:50.834068] [DEBUG] [LOCAL ] SNDA: Loaded 3277 existing records from primary storage. [2025-09-17T06:28:50.834171] [INFO ] [MAIN ] SNDA: Loaded 3277 existing records. [2025-09-17T06:28:51.008366] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:28:51.008611] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-17T06:28:51.008684] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-17T06:28:51.008948] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-17T06:28:51.009005] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-17T06:28:51.097078] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-09-17T06:28:51.362506] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:28:51.389950] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T06:28:51.802857] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T06:28:51.890088] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-17T06:28:52.690131] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-11. [2025-09-17T06:28:53.339257] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-17T06:28:53.369503] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T06:28:53.485978] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T06:28:53.490061] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-09-17T06:28:54.290125] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-09-17T06:28:54.433335] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T06:28:55.090164] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-17T06:28:55.890191] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-09-17T06:28:56.603521] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-17T06:28:56.666719] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T06:28:56.690116] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-17T06:28:56.839052] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T06:28:57.302813] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T06:28:57.490206] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-17T06:28:58.290181] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-17T06:28:59.090165] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-17T06:28:59.614429] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-17T06:28:59.615280] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T06:28:59.890105] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-17T06:29:00.055075] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T06:29:00.690135] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-17T06:29:01.490147] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-17T06:29:02.213738] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-17T06:29:02.290105] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-17T06:29:02.479926] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T06:29:02.575149] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T06:29:03.090180] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-17T06:29:03.890104] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-17T06:29:04.292501] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T06:29:04.517933] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T06:29:04.690149] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-17T06:29:04.739433] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-17T06:29:05.490155] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-17T06:29:05.918825] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T06:29:06.290162] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-17T06:29:06.983798] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T06:29:07.090123] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-17T06:29:07.695006] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-17T06:29:07.890137] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-17T06:29:08.690157] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-17T06:29:08.883039] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T06:29:09.098865] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T06:29:09.099786] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-17T06:29:09.490152] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-17T06:29:10.290215] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-17T06:29:10.557350] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T06:29:11.090158] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-17T06:29:11.663979] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T06:29:11.890161] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-17T06:29:12.527794] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T06:29:12.529819] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-17T06:29:12.690171] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-17T06:29:13.490127] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-17T06:29:14.290134] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-17T06:29:14.676288] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T06:29:14.679422] [INFO ] [REMOTE ] SNA: Full fetch complete (39077 records). [2025-09-17T06:29:14.679525] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-17T06:29:14.922371] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T06:29:14.950505] [INFO ] [REMOTE ] SNDA: Full fetch complete (8664 records). [2025-09-17T06:29:14.985002] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-17T06:29:15.094355] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-17T06:29:15.143191] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-17T06:29:15.169902] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-17T06:29:15.174158] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-17T06:29:15.174572] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-17T06:29:15.319845] [DEBUG] [LOCAL ] SNA: Trimmed 39077 records to 26389 (keeping 200 days of data) [2025-09-17T06:29:15.534438] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-17T06:29:15.565224] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-17T06:29:15.566267] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-17T06:29:15.566626] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-17T06:29:15.569949] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.88 seconds). [2025-09-17T06:29:15.570722] [DEBUG] [LOCAL ] SNDA: Trimmed 8664 records to 4759 (keeping 200 days of data) [2025-09-17T06:29:15.613560] [DEBUG] [LOCAL ] SNDA: Primary data saved (4759 records). [2025-09-17T06:29:15.614857] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-17T06:29:15.615685] [INFO ] [MAIN ] Update Progress: 1948/2369 symbols completed. SNDA took 25.0s. Estimated remaining: 1h 1m 38s. Rate: 6.8 symbols/min [2025-09-17T06:29:15.796604] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:29:15.861309] [DEBUG] [LOCAL ] SNA: Primary data saved (26389 records). [2025-09-17T06:29:15.869872] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-17T06:29:15.869995] [INFO ] [MAIN ] Update Progress: 1949/2369 symbols completed. SNA took 35.1s. Estimated remaining: 1h 1m 27s. Rate: 6.8 symbols/min [2025-09-17T06:29:15.870376] [DEBUG] [LOCAL ] SNDR: Loaded 29750 existing records from primary storage. [2025-09-17T06:29:15.933087] [INFO ] [MAIN ] SNDR: Loaded 29750 existing records. [2025-09-17T06:29:15.924323] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-17T06:29:16.150293] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:29:16.226545] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:29:16.226853] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-17T06:29:16.226991] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-17T06:29:16.227858] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-17T06:29:16.227936] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-17T06:29:16.476775] [DEBUG] [LOCAL ] SNN: Loaded 33254 existing records from primary storage. [2025-09-17T06:29:16.509676] [INFO ] [MAIN ] SNN: Loaded 33254 existing records. [2025-09-17T06:29:16.732749] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:29:16.770299] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-11. [2025-09-17T06:29:16.797745] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:29:16.798061] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-17T06:29:16.798158] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-17T06:29:16.799000] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-17T06:29:16.799075] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-17T06:29:17.182132] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-17T06:29:17.211887] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:29:17.490158] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-11. [2025-09-17T06:29:18.278178] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T06:29:18.290071] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-09-17T06:29:18.385962] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-17T06:29:18.995301] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T06:29:19.090091] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-17T06:29:19.722972] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T06:29:19.890097] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-17T06:29:20.293981] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T06:29:20.690155] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-17T06:29:21.490188] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-09-17T06:29:22.090507] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-17T06:29:22.104578] [INFO ] [REMOTE ] SNAP: Full fetch complete (77895 records). [2025-09-17T06:29:22.104833] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-17T06:29:22.303629] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-17T06:29:22.512719] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-17T06:29:22.512939] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-17T06:29:22.514389] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-17T06:29:22.520166] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-17T06:29:22.530540] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T06:29:22.537196] [INFO ] [REMOTE ] SN: Full fetch complete (70679 records). [2025-09-17T06:29:22.537489] [DEBUG] [LOCAL ] SNAP: Trimmed 77895 records to 53796 (keeping 200 days of data) [2025-09-17T06:29:22.537372] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-17T06:29:23.036176] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-17T06:29:23.038020] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-17T06:29:23.041262] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-17T06:29:23.042174] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-17T06:29:23.052769] [DEBUG] [LOCAL ] SN: Trimmed 70679 records to 49829 (keeping 200 days of data) [2025-09-17T06:29:23.140900] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T06:29:23.245874] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-17T06:29:23.548521] [DEBUG] [LOCAL ] SN: Primary data saved (49829 records). [2025-09-17T06:29:23.553332] [INFO ] [MAIN ] SN: Full history saved. [2025-09-17T06:29:23.554309] [INFO ] [MAIN ] Update Progress: 1950/2369 symbols completed. SN took 51.2s. Estimated remaining: 1h 1m 18s. Rate: 6.8 symbols/min [2025-09-17T06:29:23.593462] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T06:29:23.802106] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:29:23.804757] [DEBUG] [LOCAL ] SNOW: No existing data file found in primary storage. [2025-09-17T06:29:23.805432] [WARN ] [MAIN ] SNOW: No existing data found, performing full refresh instead. [2025-09-17T06:29:23.806788] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-17T06:29:23.807102] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-17T06:29:23.808576] [DEBUG] [LOCAL ] SNOW: No primary data file found to delete. [2025-09-17T06:29:23.808977] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-17T06:29:23.895532] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-17T06:29:24.179632] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:29:24.183699] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-09-17T06:29:24.184186] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-17T06:29:24.184304] [INFO ] [MAIN ] Update Progress: 1951/2369 symbols completed. SNAP took 37.5s. Estimated remaining: 1h 1m 7s. Rate: 6.8 symbols/min [2025-09-17T06:29:24.351593] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:29:24.375985] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T06:29:24.421504] [DEBUG] [LOCAL ] SNV: Loaded 35827 existing records from primary storage. [2025-09-17T06:29:24.421852] [INFO ] [MAIN ] SNV: Loaded 35827 existing records. [2025-09-17T06:29:24.597881] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:29:24.598166] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-17T06:29:24.598229] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-17T06:29:24.599169] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-17T06:29:24.599234] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-17T06:29:24.695199] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-11. [2025-09-17T06:29:24.948396] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:29:25.382239] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T06:29:25.490083] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-17T06:29:26.290141] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-11. [2025-09-17T06:29:26.679257] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T06:29:26.761394] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T06:29:27.090218] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-09-17T06:29:27.890188] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-17T06:29:27.930824] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T06:29:28.690192] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-09-17T06:29:29.445405] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-17T06:29:29.490138] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-17T06:29:29.491059] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T06:29:30.263143] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T06:29:30.290138] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-17T06:29:31.091519] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-09-17T06:29:31.097060] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T06:29:31.675536] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T06:29:31.890193] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-17T06:29:32.690212] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-17T06:29:33.208717] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T06:29:33.490157] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-17T06:29:33.553707] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T06:29:34.066151] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T06:29:34.290334] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-17T06:29:35.090189] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-17T06:29:35.746065] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-17T06:29:35.822431] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T06:29:35.890085] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-17T06:29:36.217401] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T06:29:36.690202] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-09-17T06:29:37.057144] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T06:29:37.490192] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-17T06:29:37.999078] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T06:29:38.290148] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-17T06:29:38.999368] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T06:29:39.090147] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-17T06:29:39.890147] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-17T06:29:40.143092] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T06:29:40.148013] [INFO ] [REMOTE ] SNDR: Full fetch complete (58782 records). [2025-09-17T06:29:40.148187] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-17T06:29:40.544900] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-17T06:29:40.545232] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-17T06:29:40.546397] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-17T06:29:40.546498] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-17T06:29:40.548049] [DEBUG] [LOCAL ] SNDR: Trimmed 58782 records to 40411 (keeping 200 days of data) [2025-09-17T06:29:40.690283] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-17T06:29:40.699010] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-17T06:29:40.851674] [DEBUG] [LOCAL ] SNDR: Primary data saved (40411 records). [2025-09-17T06:29:40.851857] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-17T06:29:40.851971] [INFO ] [MAIN ] Update Progress: 1952/2369 symbols completed. SNDR took 25.2s. Estimated remaining: 1h 1m 0s. Rate: 6.8 symbols/min [2025-09-17T06:29:41.041120] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:29:41.069984] [DEBUG] [LOCAL ] SNX: Loaded 27915 existing records from primary storage. [2025-09-17T06:29:41.070152] [INFO ] [MAIN ] SNX: Loaded 27915 existing records. [2025-09-17T06:29:41.255545] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:29:41.256417] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-17T06:29:41.256481] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-17T06:29:41.257448] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-17T06:29:41.257514] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-17T06:29:41.498701] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-17T06:29:41.634032] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:29:41.674270] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T06:29:42.290095] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-17T06:29:42.354561] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T06:29:43.090135] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-17T06:29:43.872691] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-17T06:29:43.890108] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-17T06:29:43.956435] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T06:29:44.690461] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-17T06:29:44.694459] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T06:29:45.490172] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-17T06:29:46.203357] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T06:29:46.290088] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-17T06:29:46.354937] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-17T06:29:46.973427] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T06:29:46.979072] [INFO ] [REMOTE ] SNN: Full fetch complete (62783 records). [2025-09-17T06:29:46.979243] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-17T06:29:47.095209] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-17T06:29:47.366304] [DEBUG] [VALIDATOR ] SNN: All expected trading days are present. [2025-09-17T06:29:47.366424] [DEBUG] [VALIDATOR ] SNN: Primary data validation passed. [2025-09-17T06:29:47.367469] [INFO ] [MAIN ] SNN: Fetched primary data is valid. [2025-09-17T06:29:47.367549] [DEBUG] [LOCAL ] SNN: Saving primary data. [2025-09-17T06:29:47.369006] [DEBUG] [LOCAL ] SNN: Trimmed 62783 records to 44398 (keeping 200 days of data) [2025-09-17T06:29:47.660395] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T06:29:47.674062] [DEBUG] [LOCAL ] SNN: Primary data saved (44398 records). [2025-09-17T06:29:47.674193] [INFO ] [MAIN ] SNN: Full history saved. [2025-09-17T06:29:47.674329] [INFO ] [MAIN ] Update Progress: 1953/2369 symbols completed. SNN took 31.8s. Estimated remaining: 1h 0m 51s. Rate: 6.8 symbols/min [2025-09-17T06:29:47.840487] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:29:47.840737] [DEBUG] [LOCAL ] SO: No existing data file found in primary storage. [2025-09-17T06:29:47.840807] [WARN ] [MAIN ] SO: No existing data found, performing full refresh instead. [2025-09-17T06:29:47.840989] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-17T06:29:47.841060] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-17T06:29:47.841130] [DEBUG] [LOCAL ] SO: No primary data file found to delete. [2025-09-17T06:29:47.841189] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-17T06:29:47.902805] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-11. [2025-09-17T06:29:48.199523] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:29:48.690130] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-11. [2025-09-17T06:29:49.327463] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-17T06:29:49.419331] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T06:29:49.490116] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-09-17T06:29:50.290136] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-17T06:29:50.472634] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T06:29:50.565760] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T06:29:51.090152] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-09-17T06:29:51.890129] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-17T06:29:52.413522] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-17T06:29:52.690194] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-09-17T06:29:52.843047] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T06:29:53.434801] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T06:29:53.490140] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-17T06:29:54.022761] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T06:29:54.290144] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-09-17T06:29:55.080607] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T06:29:55.091229] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-17T06:29:55.730058] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T06:29:55.890128] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-17T06:29:56.485267] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T06:29:56.690139] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-17T06:29:57.490169] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-17T06:29:57.658833] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T06:29:58.290134] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-17T06:29:58.404526] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T06:29:59.059391] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T06:29:59.090102] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-17T06:29:59.890149] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-17T06:29:59.949665] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T06:30:00.690193] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-17T06:30:00.770575] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T06:30:01.451072] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T06:30:01.458701] [INFO ] [REMOTE ] SNV: Full fetch complete (70850 records). [2025-09-17T06:30:01.459018] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-17T06:30:01.495315] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-17T06:30:01.912298] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-17T06:30:01.912435] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-17T06:30:01.913560] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-17T06:30:01.913636] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-17T06:30:01.915627] [DEBUG] [LOCAL ] SNV: Trimmed 70850 records to 48938 (keeping 200 days of data) [2025-09-17T06:30:02.267657] [DEBUG] [LOCAL ] SNV: Primary data saved (48938 records). [2025-09-17T06:30:02.267846] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-17T06:30:02.267948] [INFO ] [MAIN ] Update Progress: 1954/2369 symbols completed. SNV took 38.1s. Estimated remaining: 1h 0m 44s. Rate: 6.8 symbols/min [2025-09-17T06:30:02.299938] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-17T06:30:02.447595] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:30:02.484761] [DEBUG] [LOCAL ] SOBO: Loaded 28826 existing records from primary storage. [2025-09-17T06:30:02.484935] [INFO ] [MAIN ] SOBO: Loaded 28826 existing records. [2025-09-17T06:30:02.661919] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:30:02.662196] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-17T06:30:02.662259] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-17T06:30:02.662903] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-17T06:30:02.662964] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-17T06:30:03.025428] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:30:03.090215] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-11. [2025-09-17T06:30:03.532400] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (2.84 seconds). [2025-09-17T06:30:03.890158] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-17T06:30:05.537180] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (4.04 seconds). [2025-09-17T06:30:05.545159] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-17T06:30:06.165958] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-17T06:30:06.181299] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-17T06:30:06.291839] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-11 (3.20 seconds). [2025-09-17T06:30:06.300509] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-09-17T06:30:06.578497] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (4.28 seconds). [2025-09-17T06:30:07.044289] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T06:30:07.090090] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-17T06:30:07.888392] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T06:30:07.897305] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-17T06:30:08.005851] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T06:30:08.078584] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T06:30:08.690121] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-17T06:30:09.490131] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-17T06:30:10.098728] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T06:30:10.276965] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-17T06:30:10.283480] [INFO ] [REMOTE ] SNOW: Full fetch complete (77616 records). [2025-09-17T06:30:10.283668] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-17T06:30:10.295830] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-17T06:30:10.680432] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-09-17T06:30:10.680706] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-09-17T06:30:10.681890] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-09-17T06:30:10.682039] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-09-17T06:30:10.706947] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T06:30:10.705795] [DEBUG] [LOCAL ] SNOW: Trimmed 77616 records to 53570 (keeping 200 days of data) [2025-09-17T06:30:11.054322] [DEBUG] [LOCAL ] SNOW: Primary data saved (53570 records). [2025-09-17T06:30:11.054573] [INFO ] [MAIN ] SNOW: Full history saved. [2025-09-17T06:30:11.054761] [INFO ] [MAIN ] Update Progress: 1955/2369 symbols completed. SNOW took 47.5s. Estimated remaining: 1h 0m 35s. Rate: 6.8 symbols/min [2025-09-17T06:30:11.097223] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-17T06:30:11.225564] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:30:11.261236] [DEBUG] [LOCAL ] SOC: Loaded 37811 existing records from primary storage. [2025-09-17T06:30:11.261440] [INFO ] [MAIN ] SOC: Loaded 37811 existing records. [2025-09-17T06:30:11.437940] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:30:11.438243] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-17T06:30:11.438327] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-17T06:30:11.439095] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-17T06:30:11.439171] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-17T06:30:11.799406] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:30:11.890134] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-11. [2025-09-17T06:30:12.357184] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T06:30:12.381231] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T06:30:12.386015] [INFO ] [REMOTE ] SNX: Full fetch complete (56045 records). [2025-09-17T06:30:12.386166] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-17T06:30:12.695404] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-17T06:30:12.776389] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-17T06:30:12.776526] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-17T06:30:12.777749] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-17T06:30:12.777837] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-17T06:30:12.779333] [DEBUG] [LOCAL ] SNX: Trimmed 56045 records to 39615 (keeping 200 days of data) [2025-09-17T06:30:13.040172] [DEBUG] [LOCAL ] SNX: Primary data saved (39615 records). [2025-09-17T06:30:13.040388] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-17T06:30:13.040521] [INFO ] [MAIN ] Update Progress: 1956/2369 symbols completed. SNX took 32.2s. Estimated remaining: 1h 0m 25s. Rate: 6.8 symbols/min [2025-09-17T06:30:13.212730] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:30:13.218077] [DEBUG] [LOCAL ] SOJC: Loaded 3394 existing records from primary storage. [2025-09-17T06:30:13.218227] [INFO ] [MAIN ] SOJC: Loaded 3394 existing records. [2025-09-17T06:30:13.396351] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:30:13.396701] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-17T06:30:13.396765] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-17T06:30:13.397024] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-17T06:30:13.397080] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-17T06:30:13.494983] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-17T06:30:13.752601] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:30:13.780696] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T06:30:14.162158] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T06:30:14.290177] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-11. [2025-09-17T06:30:14.794531] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T06:30:15.089223] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T06:30:15.096718] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-09-17T06:30:15.890148] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-17T06:30:16.690173] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-17T06:30:17.391158] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-17T06:30:17.490161] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-09-17T06:30:18.290132] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-09-17T06:30:18.517159] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-17T06:30:18.669403] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T06:30:18.755350] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T06:30:18.955802] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-17T06:30:18.962326] [INFO ] [REMOTE ] SO: Full fetch complete (77424 records). [2025-09-17T06:30:18.962480] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-17T06:30:19.095185] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-17T06:30:19.367069] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-09-17T06:30:19.367206] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-09-17T06:30:19.368372] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-09-17T06:30:19.368458] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-09-17T06:30:19.370106] [DEBUG] [LOCAL ] SO: Trimmed 77424 records to 53602 (keeping 200 days of data) [2025-09-17T06:30:19.724356] [DEBUG] [LOCAL ] SO: Primary data saved (53602 records). [2025-09-17T06:30:19.724583] [INFO ] [MAIN ] SO: Full history saved. [2025-09-17T06:30:19.724756] [INFO ] [MAIN ] Update Progress: 1957/2369 symbols completed. SO took 32.1s. Estimated remaining: 1h 0m 15s. Rate: 6.8 symbols/min [2025-09-17T06:30:19.890136] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-17T06:30:20.601703] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T06:30:20.690143] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-17T06:30:21.471526] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T06:30:21.490112] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-17T06:30:22.136924] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T06:30:22.290131] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-17T06:30:23.095190] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-09-17T06:30:23.112023] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T06:30:23.499521] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T06:30:23.730611] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T06:30:23.890141] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-17T06:30:24.454810] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T06:30:24.690125] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-17T06:30:25.490137] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-17T06:30:26.290143] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-17T06:30:26.376409] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T06:30:26.838750] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T06:30:27.090142] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-17T06:30:27.890158] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-17T06:30:28.085173] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T06:30:28.688733] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T06:30:28.698912] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-17T06:30:28.906874] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T06:30:29.414108] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T06:30:29.490130] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-17T06:30:30.085107] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T06:30:30.290161] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-17T06:30:30.903478] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T06:30:31.090197] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-17T06:30:31.663115] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T06:30:31.890140] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-17T06:30:32.690130] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-17T06:30:33.490207] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-17T06:30:33.632843] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T06:30:33.825616] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-17T06:30:33.996250] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T06:30:34.001432] [INFO ] [REMOTE ] SOBO: Full fetch complete (58854 records). [2025-09-17T06:30:34.001578] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-17T06:30:34.295548] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-17T06:30:34.427834] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-17T06:30:34.427943] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-17T06:30:34.429018] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-17T06:30:34.429080] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-17T06:30:34.430567] [DEBUG] [LOCAL ] SOBO: Trimmed 58854 records to 40151 (keeping 200 days of data) [2025-09-17T06:30:34.682719] [DEBUG] [LOCAL ] SOBO: Primary data saved (40151 records). [2025-09-17T06:30:34.682899] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-17T06:30:34.683009] [INFO ] [MAIN ] Update Progress: 1958/2369 symbols completed. SOBO took 32.4s. Estimated remaining: 1h 0m 8s. Rate: 6.8 symbols/min [2025-09-17T06:30:34.927618] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T06:30:34.928944] [INFO ] [REMOTE ] SOJC: Full fetch complete (8247 records). [2025-09-17T06:30:34.929062] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-17T06:30:35.092976] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-17T06:30:35.305518] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-17T06:30:35.305625] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-17T06:30:35.305924] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-17T06:30:35.305976] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-17T06:30:35.306417] [DEBUG] [LOCAL ] SOJC: Trimmed 8247 records to 5175 (keeping 200 days of data) [2025-09-17T06:30:35.340179] [DEBUG] [LOCAL ] SOJC: Primary data saved (5175 records). [2025-09-17T06:30:35.340315] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-17T06:30:35.340413] [INFO ] [MAIN ] Update Progress: 1959/2369 symbols completed. SOJC took 22.3s. Estimated remaining: 59m 57s. Rate: 6.8 symbols/min [2025-09-17T06:30:37.069565] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T06:30:37.082541] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-17T06:30:38.720335] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T06:30:38.731300] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-17T06:30:40.525357] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T06:30:40.532174] [INFO ] [REMOTE ] SOC: Full fetch complete (70893 records). [2025-09-17T06:30:40.532398] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-17T06:30:40.935239] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-17T06:30:40.935360] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-17T06:30:40.936707] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-17T06:30:40.936814] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-17T06:30:40.938421] [DEBUG] [LOCAL ] SOC: Trimmed 70893 records to 50117 (keeping 200 days of data) [2025-09-17T06:30:41.264238] [DEBUG] [LOCAL ] SOC: Primary data saved (50117 records). [2025-09-17T06:30:41.264572] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-17T06:30:41.264891] [INFO ] [MAIN ] Update Progress: 1960/2369 symbols completed. SOC took 30.2s. Estimated remaining: 59m 48s. Rate: 6.8 symbols/min [2025-09-17T06:30:41.913447] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:30:41.915389] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:30:42.013925] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:30:42.097232] [DEBUG] [LOCAL ] SOL: Loaded 9672 existing records from primary storage. [2025-09-17T06:30:42.096482] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:30:42.102748] [DEBUG] [LOCAL ] SOJD: Loaded 9281 existing records from primary storage. [2025-09-17T06:30:42.102841] [INFO ] [MAIN ] SOL: Loaded 9672 existing records. [2025-09-17T06:30:42.103439] [INFO ] [MAIN ] SOJD: Loaded 9281 existing records. [2025-09-17T06:30:42.283512] [DEBUG] [LOCAL ] SOJE: Loaded 6675 existing records from primary storage. [2025-09-17T06:30:42.323296] [INFO ] [MAIN ] SOJE: Loaded 6675 existing records. [2025-09-17T06:30:42.343352] [DEBUG] [LOCAL ] SOJF: Loaded 5968 existing records from primary storage. [2025-09-17T06:30:42.454016] [INFO ] [MAIN ] SOJF: Loaded 5968 existing records. [2025-09-17T06:30:42.552193] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:30:42.652823] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:30:42.717051] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-17T06:30:42.786183] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-17T06:30:42.781324] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-17T06:30:42.786035] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:30:42.786448] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-17T06:30:42.797249] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-17T06:30:42.827345] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-17T06:30:42.837615] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-17T06:30:42.838033] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-17T06:30:42.837956] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-17T06:30:42.846718] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-17T06:30:42.897411] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-17T06:30:42.888620] [WARN ] [MAIN ] SOJF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:30:42.945103] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-17T06:30:42.984576] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-17T06:30:43.057042] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-17T06:30:43.112289] [DEBUG] [LOCAL ] SOJF: Deleted primary data file. [2025-09-17T06:30:43.219258] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-17T06:30:44.173037] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:30:44.260617] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:30:44.271477] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-11. [2025-09-17T06:30:44.317955] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:30:44.318443] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-11. [2025-09-17T06:30:44.335948] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-11. [2025-09-17T06:30:44.404924] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:30:44.405371] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-11. [2025-09-17T06:30:44.602850] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:30:44.603254] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-11 [2025-09-17T06:30:44.603802] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-17T06:30:44.789060] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:30:44.789410] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-17T06:30:44.789862] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-09-17T06:30:45.145067] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T06:30:45.147920] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-09-17T06:30:45.233584] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T06:30:45.238602] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-09-17T06:30:45.450174] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T06:30:45.454964] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-09-17T06:30:45.701876] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T06:30:45.705763] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-09-17T06:30:45.743626] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T06:30:45.748202] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-17T06:30:46.018739] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T06:30:46.290144] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-09-17T06:30:46.458955] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T06:30:46.530090] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T06:30:46.595276] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T06:30:46.993209] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T06:30:47.090153] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-17T06:30:47.890192] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-09-17T06:30:47.980249] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T06:30:48.690197] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-17T06:30:49.013516] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T06:30:49.435985] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T06:30:49.490211] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-17T06:30:50.290163] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-17T06:30:50.411504] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T06:30:51.090125] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-17T06:30:51.158937] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T06:30:51.894541] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-17T06:30:51.898579] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T06:30:52.690221] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-17T06:30:52.926311] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T06:30:53.495707] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-17T06:30:53.502141] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T06:30:54.290202] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-17T06:30:54.546521] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T06:30:55.090180] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-17T06:30:55.194671] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T06:30:55.554662] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T06:30:55.890223] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-17T06:30:56.690162] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-17T06:30:56.823333] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T06:30:57.482882] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T06:30:57.490071] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-17T06:30:58.243037] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T06:30:58.290172] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-17T06:30:59.062979] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T06:30:59.090089] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-17T06:30:59.870928] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T06:30:59.890080] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-17T06:31:00.654077] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T06:31:00.690102] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-17T06:31:01.490151] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-17T06:31:01.558351] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T06:31:01.560251] [INFO ] [REMOTE ] SOJF: Full fetch complete (12905 records). [2025-09-17T06:31:01.560401] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-17T06:31:01.754918] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-17T06:31:01.755260] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:31:01.755338] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:31:01.755416] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-17T06:31:01.755539] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-17T06:31:01.755625] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-17T06:31:01.756004] [DEBUG] [LOCAL ] SOJF: Deleted derivative data file. [2025-09-17T06:31:01.756161] [INFO ] [MAIN ] Update Progress: 1961/2369 symbols completed. SOJF took 20.5s. Estimated remaining: 59m 42s. Rate: 6.8 symbols/min [2025-09-17T06:31:01.933119] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:31:01.969982] [DEBUG] [LOCAL ] SOLV: Loaded 32331 existing records from primary storage. [2025-09-17T06:31:01.970162] [INFO ] [MAIN ] SOLV: Loaded 32331 existing records. [2025-09-17T06:31:02.152054] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:31:02.152340] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-17T06:31:02.152417] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-17T06:31:02.153165] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-17T06:31:02.153251] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-17T06:31:02.295280] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-17T06:31:02.500493] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T06:31:02.556316] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:31:03.090144] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-11. [2025-09-17T06:31:03.322032] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T06:31:03.890168] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-17T06:31:04.565053] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T06:31:04.690101] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-09-17T06:31:04.711839] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T06:31:05.490128] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-17T06:31:06.056719] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T06:31:06.218184] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T06:31:06.290134] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-17T06:31:07.090156] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-17T06:31:07.187234] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T06:31:07.528902] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T06:31:07.890158] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-17T06:31:08.690113] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-09-17T06:31:08.888849] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T06:31:09.490135] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-17T06:31:10.115394] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T06:31:10.147444] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T06:31:10.290165] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-17T06:31:11.004855] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T06:31:11.090102] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-17T06:31:11.890130] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-17T06:31:11.911910] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T06:31:12.418101] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T06:31:12.420167] [INFO ] [REMOTE ] SOJD: Full fetch complete (20266 records). [2025-09-17T06:31:12.420278] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-17T06:31:12.695295] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-17T06:31:12.804245] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-17T06:31:12.804361] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-17T06:31:12.804868] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-17T06:31:12.804932] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-17T06:31:12.805529] [DEBUG] [LOCAL ] SOJD: Trimmed 20266 records to 12980 (keeping 200 days of data) [2025-09-17T06:31:12.888717] [DEBUG] [LOCAL ] SOJD: Primary data saved (12980 records). [2025-09-17T06:31:12.888874] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-17T06:31:12.888984] [INFO ] [MAIN ] Update Progress: 1962/2369 symbols completed. SOJD took 31.6s. Estimated remaining: 59m 33s. Rate: 6.8 symbols/min [2025-09-17T06:31:13.078417] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:31:13.117080] [DEBUG] [LOCAL ] SON: Loaded 31708 existing records from primary storage. [2025-09-17T06:31:13.117265] [INFO ] [MAIN ] SON: Loaded 31708 existing records. [2025-09-17T06:31:13.308925] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:31:13.309236] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-17T06:31:13.309298] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-17T06:31:13.310104] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-17T06:31:13.310169] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-17T06:31:13.502532] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-17T06:31:13.698797] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T06:31:13.703172] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:31:13.705873] [INFO ] [REMOTE ] SOL: Full fetch complete (22086 records). [2025-09-17T06:31:13.705995] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-17T06:31:14.077971] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-17T06:31:14.078081] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-17T06:31:14.078832] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-17T06:31:14.078889] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-17T06:31:14.079765] [DEBUG] [LOCAL ] SOL: Trimmed 22086 records to 13753 (keeping 200 days of data) [2025-09-17T06:31:14.162144] [DEBUG] [LOCAL ] SOL: Primary data saved (13753 records). [2025-09-17T06:31:14.162315] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-17T06:31:14.162414] [INFO ] [MAIN ] Update Progress: 1963/2369 symbols completed. SOL took 32.9s. Estimated remaining: 59m 23s. Rate: 6.8 symbols/min [2025-09-17T06:31:14.295287] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-17T06:31:14.351218] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:31:14.394373] [DEBUG] [LOCAL ] SONY: Loaded 39777 existing records from primary storage. [2025-09-17T06:31:14.394598] [INFO ] [MAIN ] SONY: Loaded 39777 existing records. [2025-09-17T06:31:14.578534] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:31:14.578819] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-17T06:31:14.578882] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-17T06:31:14.579770] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-17T06:31:14.579841] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-17T06:31:14.942663] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:31:15.069612] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T06:31:15.084063] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T06:31:15.090073] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-17T06:31:15.822469] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T06:31:15.823965] [INFO ] [REMOTE ] SOJE: Full fetch complete (14739 records). [2025-09-17T06:31:15.824138] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-17T06:31:15.895271] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-11. [2025-09-17T06:31:16.191298] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-17T06:31:16.191409] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-17T06:31:16.191780] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-17T06:31:16.191837] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-17T06:31:16.192392] [DEBUG] [LOCAL ] SOJE: Trimmed 14739 records to 9503 (keeping 200 days of data) [2025-09-17T06:31:16.253052] [DEBUG] [LOCAL ] SOJE: Primary data saved (9503 records). [2025-09-17T06:31:16.253228] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-17T06:31:16.253325] [INFO ] [MAIN ] Update Progress: 1964/2369 symbols completed. SOJE took 35.0s. Estimated remaining: 59m 13s. Rate: 6.8 symbols/min [2025-09-17T06:31:16.421855] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:31:16.425954] [DEBUG] [LOCAL ] SOR: Loaded 2187 existing records from primary storage. [2025-09-17T06:31:16.426075] [INFO ] [MAIN ] SOR: Loaded 2187 existing records. [2025-09-17T06:31:16.603883] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:31:16.604167] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-17T06:31:16.604230] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-17T06:31:16.604502] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-17T06:31:16.604582] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-17T06:31:16.695440] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-11. [2025-09-17T06:31:16.958179] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:31:17.490140] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-17T06:31:17.822300] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T06:31:18.119317] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T06:31:18.290179] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-11. [2025-09-17T06:31:18.889917] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T06:31:19.081805] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T06:31:19.091067] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-09-17T06:31:19.562118] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T06:31:19.890208] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-17T06:31:20.690162] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-09-17T06:31:21.490147] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-09-17T06:31:21.524621] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T06:31:22.290139] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-17T06:31:22.639749] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T06:31:22.865587] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T06:31:23.090121] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-09-17T06:31:23.839703] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T06:31:23.890123] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-17T06:31:24.264984] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T06:31:24.690138] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-09-17T06:31:25.060335] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-17T06:31:25.293161] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T06:31:25.490125] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-17T06:31:25.956263] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T06:31:26.290173] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-17T06:31:27.090179] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-17T06:31:27.806803] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T06:31:27.890114] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-17T06:31:28.633258] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T06:31:28.690162] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-17T06:31:29.050040] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T06:31:29.490146] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-09-17T06:31:29.962805] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T06:31:30.290149] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-17T06:31:31.090146] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-17T06:31:31.354901] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T06:31:31.487615] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T06:31:31.493929] [INFO ] [REMOTE ] SOLV: Full fetch complete (63164 records). [2025-09-17T06:31:31.494101] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-17T06:31:31.733172] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T06:31:31.901437] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-17T06:31:31.924933] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-17T06:31:31.925051] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-17T06:31:31.926204] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-17T06:31:31.926281] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-17T06:31:31.927831] [DEBUG] [LOCAL ] SOLV: Trimmed 63164 records to 44355 (keeping 200 days of data) [2025-09-17T06:31:32.209068] [DEBUG] [LOCAL ] SOLV: Primary data saved (44355 records). [2025-09-17T06:31:32.209246] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-17T06:31:32.209354] [INFO ] [MAIN ] Update Progress: 1965/2369 symbols completed. SOLV took 30.5s. Estimated remaining: 59m 6s. Rate: 6.8 symbols/min [2025-09-17T06:31:32.378995] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:31:32.388460] [DEBUG] [LOCAL ] SOS: Loaded 6828 existing records from primary storage. [2025-09-17T06:31:32.388625] [INFO ] [MAIN ] SOS: Loaded 6828 existing records. [2025-09-17T06:31:32.567885] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:31:32.568175] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-17T06:31:32.568252] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-17T06:31:32.568570] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-17T06:31:32.568670] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-17T06:31:32.695203] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-17T06:31:32.938775] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:31:33.490201] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-17T06:31:33.843078] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T06:31:33.909263] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T06:31:34.042130] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T06:31:34.290142] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-17T06:31:35.090163] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-17T06:31:35.886924] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T06:31:35.890082] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-17T06:31:36.433379] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T06:31:36.690139] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-17T06:31:36.837492] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T06:31:37.299029] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T06:31:37.490143] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-17T06:31:38.290141] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-17T06:31:38.824328] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T06:31:38.942846] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T06:31:39.090190] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-17T06:31:39.890128] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-11. [2025-09-17T06:31:40.692499] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-17T06:31:40.698032] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T06:31:41.056678] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T06:31:41.162265] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T06:31:41.490198] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-17T06:31:42.085259] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T06:31:42.086752] [INFO ] [REMOTE ] SOR: Full fetch complete (4390 records). [2025-09-17T06:31:42.086880] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-17T06:31:42.299156] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-17T06:31:42.587927] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-17T06:31:42.588099] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-17T06:31:42.588416] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-17T06:31:42.588508] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-17T06:31:42.589300] [DEBUG] [LOCAL ] SOR: Trimmed 4390 records to 2976 (keeping 200 days of data) [2025-09-17T06:31:42.619268] [DEBUG] [LOCAL ] SOR: Primary data saved (2976 records). [2025-09-17T06:31:42.619471] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-17T06:31:42.619603] [INFO ] [MAIN ] Update Progress: 1966/2369 symbols completed. SOR took 26.4s. Estimated remaining: 58m 57s. Rate: 6.8 symbols/min [2025-09-17T06:31:42.870160] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:31:42.906702] [DEBUG] [LOCAL ] SPB: Loaded 26255 existing records from primary storage. [2025-09-17T06:31:42.906952] [INFO ] [MAIN ] SPB: Loaded 26255 existing records. [2025-09-17T06:31:43.095292] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-17T06:31:43.148975] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:31:43.149330] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-17T06:31:43.149421] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-17T06:31:43.150238] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-17T06:31:43.150336] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-17T06:31:43.537540] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:31:43.870166] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T06:31:43.890101] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-17T06:31:44.690125] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-11. [2025-09-17T06:31:45.149861] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T06:31:45.236606] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T06:31:45.242391] [INFO ] [REMOTE ] SON: Full fetch complete (61484 records). [2025-09-17T06:31:45.242551] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-17T06:31:45.496664] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-17T06:31:45.675791] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-17T06:31:45.675904] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-17T06:31:45.676999] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-17T06:31:45.677062] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-17T06:31:45.678311] [DEBUG] [LOCAL ] SON: Trimmed 61484 records to 42910 (keeping 200 days of data) [2025-09-17T06:31:45.810757] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T06:31:45.978445] [DEBUG] [LOCAL ] SON: Primary data saved (42910 records). [2025-09-17T06:31:45.978601] [INFO ] [MAIN ] SON: Full history saved. [2025-09-17T06:31:45.978711] [INFO ] [MAIN ] Update Progress: 1967/2369 symbols completed. SON took 33.1s. Estimated remaining: 58m 47s. Rate: 6.8 symbols/min [2025-09-17T06:31:46.148554] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:31:46.182667] [DEBUG] [LOCAL ] SPCE: Loaded 37032 existing records from primary storage. [2025-09-17T06:31:46.182832] [INFO ] [MAIN ] SPCE: Loaded 37032 existing records. [2025-09-17T06:31:46.295331] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-09-17T06:31:46.362223] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:31:46.362496] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-17T06:31:46.362557] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-17T06:31:46.363824] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-17T06:31:46.363889] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-17T06:31:46.722638] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:31:47.090184] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-11. [2025-09-17T06:31:47.660864] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T06:31:47.708840] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-17T06:31:47.890150] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-17T06:31:48.690117] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-17T06:31:49.104012] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T06:31:49.157360] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T06:31:49.490178] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-09-17T06:31:50.290135] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-09-17T06:31:50.441720] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T06:31:51.090163] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-17T06:31:51.366024] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T06:31:51.599990] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-17T06:31:51.890136] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-09-17T06:31:52.553367] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T06:31:52.690190] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-09-17T06:31:53.112817] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T06:31:53.490147] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-17T06:31:54.290153] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-17T06:31:54.407767] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T06:31:54.740699] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T06:31:55.090182] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-17T06:31:55.890141] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-17T06:31:56.319586] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T06:31:56.321280] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T06:31:56.413709] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T06:31:56.690141] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-17T06:31:57.161312] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T06:31:57.490137] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-17T06:31:57.964114] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T06:31:58.290160] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-17T06:31:59.090185] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-17T06:31:59.890164] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-17T06:32:00.270458] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-17T06:32:00.277381] [INFO ] [REMOTE ] SONY: Full fetch complete (77087 records). [2025-09-17T06:32:00.277536] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-17T06:32:00.697486] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-17T06:32:00.696853] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-17T06:32:00.698318] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-17T06:32:00.699434] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-17T06:32:00.699557] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-17T06:32:00.701278] [DEBUG] [LOCAL ] SONY: Trimmed 77087 records to 53367 (keeping 200 days of data) [2025-09-17T06:32:01.024866] [DEBUG] [LOCAL ] SONY: Primary data saved (53367 records). [2025-09-17T06:32:01.025051] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-17T06:32:01.025148] [INFO ] [MAIN ] Update Progress: 1968/2369 symbols completed. SONY took 46.9s. Estimated remaining: 58m 40s. Rate: 6.8 symbols/min [2025-09-17T06:32:01.207313] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T06:32:01.208407] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:32:01.236031] [DEBUG] [LOCAL ] SPE: Loaded 4513 existing records from primary storage. [2025-09-17T06:32:01.236298] [INFO ] [MAIN ] SPE: Loaded 4513 existing records. [2025-09-17T06:32:01.262911] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T06:32:01.372180] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-17T06:32:01.492800] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:32:01.492879] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-17T06:32:01.493461] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-17T06:32:01.494423] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-17T06:32:01.494911] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-17T06:32:01.495002] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-17T06:32:01.894320] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:32:02.064431] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T06:32:02.290141] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-17T06:32:03.090176] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-17T06:32:03.675837] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T06:32:03.890148] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-11. [2025-09-17T06:32:04.237603] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T06:32:04.338976] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T06:32:04.690143] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-17T06:32:05.490196] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-17T06:32:06.025817] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T06:32:06.290150] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-09-17T06:32:06.602284] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T06:32:07.053162] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T06:32:07.090167] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-17T06:32:07.890161] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-17T06:32:08.690144] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-09-17T06:32:08.883970] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T06:32:09.036323] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T06:32:09.038724] [INFO ] [REMOTE ] SOS: Full fetch complete (11585 records). [2025-09-17T06:32:09.038809] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-17T06:32:09.396582] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-17T06:32:09.396708] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-17T06:32:09.397071] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-17T06:32:09.401511] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-17T06:32:09.402211] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T06:32:09.404826] [DEBUG] [LOCAL ] SOS: Trimmed 11585 records to 7354 (keeping 200 days of data) [2025-09-17T06:32:09.450296] [DEBUG] [LOCAL ] SOS: Primary data saved (7354 records). [2025-09-17T06:32:09.450741] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-17T06:32:09.450940] [INFO ] [MAIN ] Update Progress: 1969/2369 symbols completed. SOS took 37.2s. Estimated remaining: 58m 31s. Rate: 6.8 symbols/min [2025-09-17T06:32:09.495184] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-17T06:32:09.625713] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:32:09.666496] [DEBUG] [LOCAL ] SPG: Loaded 37370 existing records from primary storage. [2025-09-17T06:32:09.666671] [INFO ] [MAIN ] SPG: Loaded 37370 existing records. [2025-09-17T06:32:09.842859] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:32:09.843113] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-17T06:32:09.843164] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-17T06:32:09.844042] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-17T06:32:09.844111] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-17T06:32:10.195142] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:32:10.290087] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-11. [2025-09-17T06:32:10.350469] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T06:32:11.090170] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-17T06:32:11.794704] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T06:32:11.890111] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-17T06:32:11.950559] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T06:32:12.690134] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-17T06:32:12.761292] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T06:32:13.490135] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-17T06:32:14.077123] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T06:32:14.290126] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-17T06:32:14.360680] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T06:32:15.090145] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-17T06:32:15.671839] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T06:32:15.890180] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-09-17T06:32:16.690131] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-17T06:32:17.014137] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T06:32:17.089068] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-17T06:32:17.490132] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-17T06:32:17.715836] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T06:32:17.878860] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-17T06:32:18.290204] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-17T06:32:18.913963] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T06:32:19.090134] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-17T06:32:19.890155] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-17T06:32:20.469546] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T06:32:20.670065] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T06:32:20.672084] [INFO ] [REMOTE ] SPE: Full fetch complete (10124 records). [2025-09-17T06:32:20.672184] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-17T06:32:20.695312] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-17T06:32:21.044693] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-17T06:32:21.044829] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-17T06:32:21.045140] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-17T06:32:21.045198] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-17T06:32:21.045679] [DEBUG] [LOCAL ] SPE: Trimmed 10124 records to 6381 (keeping 200 days of data) [2025-09-17T06:32:21.085077] [DEBUG] [LOCAL ] SPE: Primary data saved (6381 records). [2025-09-17T06:32:21.085251] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-17T06:32:21.085359] [INFO ] [MAIN ] Update Progress: 1970/2369 symbols completed. SPE took 20.1s. Estimated remaining: 58m 23s. Rate: 6.8 symbols/min [2025-09-17T06:32:21.261582] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:32:21.299497] [DEBUG] [LOCAL ] SPGI: Loaded 33166 existing records from primary storage. [2025-09-17T06:32:21.299680] [INFO ] [MAIN ] SPGI: Loaded 33166 existing records. [2025-09-17T06:32:21.475141] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:32:21.475437] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-17T06:32:21.475491] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-17T06:32:21.476520] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-17T06:32:21.476586] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-17T06:32:21.497249] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-17T06:32:21.844550] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:32:22.290181] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-11. [2025-09-17T06:32:22.795398] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T06:32:22.800655] [INFO ] [REMOTE ] SPB: Full fetch complete (47277 records). [2025-09-17T06:32:22.800816] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-17T06:32:23.094685] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-09-17T06:32:23.188790] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-17T06:32:23.188968] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-17T06:32:23.189996] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-17T06:32:23.190128] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-17T06:32:23.217161] [DEBUG] [LOCAL ] SPB: Trimmed 47277 records to 34191 (keeping 200 days of data) [2025-09-17T06:32:23.218777] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-17T06:32:23.453791] [DEBUG] [LOCAL ] SPB: Primary data saved (34191 records). [2025-09-17T06:32:23.453967] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-17T06:32:23.454087] [INFO ] [MAIN ] Update Progress: 1971/2369 symbols completed. SPB took 40.8s. Estimated remaining: 58m 13s. Rate: 6.8 symbols/min [2025-09-17T06:32:23.626749] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:32:23.640851] [DEBUG] [LOCAL ] SPH: Loaded 12796 existing records from primary storage. [2025-09-17T06:32:23.641010] [INFO ] [MAIN ] SPH: Loaded 12796 existing records. [2025-09-17T06:32:23.817007] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:32:23.817308] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-17T06:32:23.817386] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-17T06:32:23.817860] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-17T06:32:23.817935] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-17T06:32:23.890678] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-17T06:32:24.181611] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:32:24.208470] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T06:32:24.394823] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T06:32:24.690149] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-09-17T06:32:25.490129] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-11. [2025-09-17T06:32:26.127632] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T06:32:26.168121] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T06:32:26.290169] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-09-17T06:32:26.519433] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T06:32:27.090129] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-17T06:32:27.890181] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-17T06:32:28.003764] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T06:32:28.673558] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T06:32:28.690079] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-17T06:32:29.490155] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-17T06:32:30.130215] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-17T06:32:30.290149] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-17T06:32:30.484651] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T06:32:31.090380] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-09-17T06:32:31.290279] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T06:32:31.890205] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-17T06:32:32.017219] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T06:32:32.102305] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T06:32:32.108610] [INFO ] [REMOTE ] SPCE: Full fetch complete (72260 records). [2025-09-17T06:32:32.108824] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-17T06:32:32.547410] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-17T06:32:32.547553] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-17T06:32:32.549427] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-17T06:32:32.549539] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-17T06:32:32.551350] [DEBUG] [LOCAL ] SPCE: Trimmed 72260 records to 49815 (keeping 200 days of data) [2025-09-17T06:32:32.717473] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-17T06:32:32.856029] [DEBUG] [LOCAL ] SPCE: Primary data saved (49815 records). [2025-09-17T06:32:32.856231] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-17T06:32:32.856350] [INFO ] [MAIN ] Update Progress: 1972/2369 symbols completed. SPCE took 46.9s. Estimated remaining: 58m 4s. Rate: 6.8 symbols/min [2025-09-17T06:32:33.041726] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:32:33.070409] [DEBUG] [LOCAL ] SPHR: Loaded 28867 existing records from primary storage. [2025-09-17T06:32:33.070592] [INFO ] [MAIN ] SPHR: Loaded 28867 existing records. [2025-09-17T06:32:33.268706] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:32:33.268994] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-17T06:32:33.269061] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-17T06:32:33.269698] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-17T06:32:33.269759] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-17T06:32:33.510303] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-17T06:32:33.670464] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:32:33.796509] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T06:32:33.935704] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T06:32:34.290175] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-11. [2025-09-17T06:32:35.090214] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-17T06:32:35.468593] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T06:32:35.684509] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T06:32:35.890179] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-17T06:32:36.690156] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-09-17T06:32:37.050575] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T06:32:37.151821] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T06:32:37.490150] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-17T06:32:38.063870] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T06:32:38.290164] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-09-17T06:32:39.090211] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-17T06:32:39.321747] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T06:32:39.697683] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T06:32:39.890166] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-17T06:32:40.690107] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-17T06:32:40.756899] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T06:32:41.174698] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T06:32:41.490138] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-17T06:32:41.607607] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T06:32:42.290152] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-17T06:32:42.731834] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T06:32:43.090197] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-17T06:32:43.458579] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T06:32:43.890149] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-17T06:32:44.059570] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T06:32:44.690153] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-17T06:32:45.377547] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T06:32:45.490148] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-17T06:32:46.290206] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-17T06:32:46.351886] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T06:32:46.548064] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T06:32:47.090193] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-17T06:32:47.760756] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T06:32:47.890165] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-17T06:32:48.690146] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-17T06:32:48.882926] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T06:32:49.490155] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-17T06:32:49.682205] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T06:32:50.055911] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T06:32:50.290134] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-17T06:32:50.525825] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T06:32:51.090148] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-17T06:32:51.586114] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T06:32:51.890143] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-17T06:32:52.533300] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T06:32:52.690152] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-17T06:32:52.876037] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T06:32:53.490191] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-17T06:32:54.288878] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T06:32:54.298881] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-17T06:32:55.090175] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-17T06:32:55.217360] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T06:32:55.224960] [INFO ] [REMOTE ] SPG: Full fetch complete (71878 records). [2025-09-17T06:32:55.225206] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-17T06:32:55.549197] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T06:32:55.647220] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-17T06:32:55.647359] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-17T06:32:55.648466] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-17T06:32:55.648533] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-17T06:32:55.650139] [DEBUG] [LOCAL ] SPG: Trimmed 71878 records to 50452 (keeping 200 days of data) [2025-09-17T06:32:55.890190] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-17T06:32:55.988888] [DEBUG] [LOCAL ] SPG: Primary data saved (50452 records). [2025-09-17T06:32:55.989051] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-17T06:32:55.989137] [INFO ] [MAIN ] Update Progress: 1973/2369 symbols completed. SPG took 46.5s. Estimated remaining: 57m 58s. Rate: 6.8 symbols/min [2025-09-17T06:32:56.159498] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:32:56.185699] [DEBUG] [LOCAL ] SPIR: Loaded 27817 existing records from primary storage. [2025-09-17T06:32:56.185867] [INFO ] [MAIN ] SPIR: Loaded 27817 existing records. [2025-09-17T06:32:56.366258] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:32:56.366526] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-17T06:32:56.366584] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-17T06:32:56.367231] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-17T06:32:56.367292] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-17T06:32:56.730135] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:32:56.699731] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-17T06:32:56.755758] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T06:32:57.478360] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T06:32:57.485810] [INFO ] [REMOTE ] SPGI: Full fetch complete (66185 records). [2025-09-17T06:32:57.486024] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-17T06:32:57.492709] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-17T06:32:57.802248] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T06:32:57.826570] [INFO ] [REMOTE ] SPH: Full fetch complete (28704 records). [2025-09-17T06:32:57.866704] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-17T06:32:58.016506] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-17T06:32:58.054666] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-17T06:32:58.071503] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-17T06:32:58.107815] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-17T06:32:58.205600] [DEBUG] [LOCAL ] SPGI: Trimmed 66185 records to 45837 (keeping 200 days of data) [2025-09-17T06:32:58.309211] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-11. [2025-09-17T06:32:58.430965] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-17T06:32:58.432592] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-17T06:32:58.433856] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-17T06:32:58.434413] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-17T06:32:58.438771] [DEBUG] [LOCAL ] SPH: Trimmed 28704 records to 18605 (keeping 200 days of data) [2025-09-17T06:32:58.691199] [DEBUG] [LOCAL ] SPH: Primary data saved (18605 records). [2025-09-17T06:32:58.692531] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-17T06:32:58.693182] [INFO ] [MAIN ] Update Progress: 1974/2369 symbols completed. SPH took 35.2s. Estimated remaining: 57m 48s. Rate: 6.8 symbols/min [2025-09-17T06:32:58.885255] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:32:58.896479] [DEBUG] [LOCAL ] SPMC: Loaded 3849 existing records from primary storage. [2025-09-17T06:32:58.897946] [INFO ] [MAIN ] SPMC: Loaded 3849 existing records. [2025-09-17T06:32:59.115859] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:32:59.119341] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-17T06:32:59.119735] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-17T06:32:59.123333] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-17T06:32:59.124212] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-17T06:32:59.145910] [DEBUG] [LOCAL ] SPGI: Primary data saved (45837 records). [2025-09-17T06:32:59.188509] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-17T06:32:59.206583] [INFO ] [MAIN ] Update Progress: 1975/2369 symbols completed. SPGI took 38.1s. Estimated remaining: 57m 38s. Rate: 6.8 symbols/min [2025-09-17T06:32:59.489868] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-17T06:32:59.624145] [INFO ] [REMOTE ] SPHR: Full fetch complete (56890 records). [2025-09-17T06:32:59.623949] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:32:59.635013] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-17T06:32:59.629745] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-17T06:32:59.645474] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-17T06:32:59.723870] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-17T06:32:59.726763] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:32:59.747813] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-11. [2025-09-17T06:32:59.747510] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-17T06:32:59.795759] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-17T06:32:59.811555] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-17T06:33:00.247612] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T06:33:00.337766] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-09-17T06:33:00.399267] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-17T06:33:00.400238] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-17T06:33:00.407150] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-17T06:33:00.458322] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-17T06:33:00.481834] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:33:00.487492] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T06:33:00.489717] [DEBUG] [LOCAL ] SPHR: Trimmed 56890 records to 40044 (keeping 200 days of data) [2025-09-17T06:33:00.692145] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-09-17T06:33:00.726843] [DEBUG] [LOCAL ] SPHR: Primary data saved (40044 records). [2025-09-17T06:33:00.726976] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-17T06:33:00.727086] [INFO ] [MAIN ] Update Progress: 1976/2369 symbols completed. SPHR took 27.9s. Estimated remaining: 57m 27s. Rate: 6.8 symbols/min [2025-09-17T06:33:00.893939] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:33:00.919338] [DEBUG] [LOCAL ] SPNT: Loaded 25754 existing records from primary storage. [2025-09-17T06:33:00.919493] [INFO ] [MAIN ] SPNT: Loaded 25754 existing records. [2025-09-17T06:33:01.095412] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:33:01.095676] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-17T06:33:01.095735] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-17T06:33:01.096362] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-17T06:33:01.096428] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-17T06:33:01.391779] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T06:33:01.466163] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:33:01.490148] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-11. [2025-09-17T06:33:01.876873] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T06:33:02.290170] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-09-17T06:33:03.090191] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-09-17T06:33:03.890202] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-11. [2025-09-17T06:33:04.033882] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T06:33:04.162577] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:33:04.162983] [WARN ] [REMOTE ] SPME: No data returned for month 2024-11 [2025-09-17T06:33:04.494420] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-11 (3.00 seconds). [2025-09-17T06:33:04.690183] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-17T06:33:05.002636] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T06:33:05.464791] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T06:33:05.490104] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-17T06:33:06.201525] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T06:33:06.290196] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-17T06:33:06.832950] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-17T06:33:07.090145] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-09-17T06:33:07.890156] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-17T06:33:08.182436] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T06:33:08.521494] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T06:33:08.690137] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-17T06:33:09.303277] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T06:33:09.490206] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-09-17T06:33:10.290185] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-17T06:33:10.669178] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T06:33:11.090192] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-17T06:33:11.876265] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T06:33:11.890086] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-17T06:33:11.946811] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T06:33:12.690224] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-17T06:33:12.879226] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:33:12.879593] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-17T06:33:13.388635] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T06:33:13.490163] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-17T06:33:13.972995] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T06:33:14.290155] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-17T06:33:14.912909] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T06:33:15.090150] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-17T06:33:15.890167] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-09-17T06:33:16.690161] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-17T06:33:16.902745] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:33:16.905715] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-09-17T06:33:16.907091] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T06:33:17.490154] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-17T06:33:17.844503] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:33:17.844958] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-17T06:33:18.290144] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-17T06:33:18.499793] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:33:18.500145] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-17T06:33:19.088122] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-17T06:33:19.096405] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-17T06:33:19.829545] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T06:33:19.830815] [INFO ] [REMOTE ] SPMC: Full fetch complete (8143 records). [2025-09-17T06:33:19.830911] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-17T06:33:19.895271] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-17T06:33:20.202983] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-17T06:33:20.203108] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-17T06:33:20.203374] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-17T06:33:20.203458] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-17T06:33:20.203952] [DEBUG] [LOCAL ] SPMC: Trimmed 8143 records to 5764 (keeping 200 days of data) [2025-09-17T06:33:20.240186] [DEBUG] [LOCAL ] SPMC: Primary data saved (5764 records). [2025-09-17T06:33:20.240331] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-17T06:33:20.240491] [INFO ] [MAIN ] Update Progress: 1977/2369 symbols completed. SPMC took 21.5s. Estimated remaining: 57m 21s. Rate: 6.8 symbols/min [2025-09-17T06:33:20.411225] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:33:20.411461] [DEBUG] [LOCAL ] SPOT: No existing data file found in primary storage. [2025-09-17T06:33:20.411513] [WARN ] [MAIN ] SPOT: No existing data found, performing full refresh instead. [2025-09-17T06:33:20.411757] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-17T06:33:20.411861] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-17T06:33:20.411951] [DEBUG] [LOCAL ] SPOT: No primary data file found to delete. [2025-09-17T06:33:20.412026] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-17T06:33:20.695246] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-17T06:33:20.791962] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:33:21.334189] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T06:33:21.490135] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-11. [2025-09-17T06:33:22.219914] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T06:33:22.290134] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-17T06:33:22.551291] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:33:22.551636] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-17T06:33:23.090120] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-17T06:33:23.169834] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T06:33:23.890149] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-17T06:33:24.155587] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T06:33:24.690131] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-17T06:33:24.901912] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:33:24.904945] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-17T06:33:24.907429] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T06:33:25.490118] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-17T06:33:25.688169] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:33:25.688638] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-17T06:33:26.290167] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-09-17T06:33:27.090147] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-17T06:33:27.609306] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T06:33:27.890192] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-17T06:33:28.426593] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-17T06:33:28.690162] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-17T06:33:29.119069] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T06:33:29.177016] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T06:33:29.490140] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-17T06:33:30.290203] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-17T06:33:31.045164] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T06:33:31.090150] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-17T06:33:31.526798] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T06:33:31.527861] [INFO ] [REMOTE ] SPME: Full fetch complete (629 records). [2025-09-17T06:33:31.527967] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-17T06:33:31.721977] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 42 unique days, need 200 days [2025-09-17T06:33:31.722285] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:33:31.722382] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:33:31.722602] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-17T06:33:31.722741] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-17T06:33:31.722876] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-17T06:33:31.722953] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-17T06:33:31.723038] [INFO ] [MAIN ] Update Progress: 1978/2369 symbols completed. SPME took 32.5s. Estimated remaining: 57m 13s. Rate: 6.8 symbols/min [2025-09-17T06:33:31.898509] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-09-17T06:33:31.906251] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:33:31.930328] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T06:33:31.964847] [DEBUG] [LOCAL ] SPR: Loaded 29941 existing records from primary storage. [2025-09-17T06:33:31.965019] [INFO ] [MAIN ] SPR: Loaded 29941 existing records. [2025-09-17T06:33:32.142211] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:33:32.142494] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-17T06:33:32.142556] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-17T06:33:32.143281] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-17T06:33:32.143348] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-17T06:33:32.498590] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:33:32.690146] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-17T06:33:33.490153] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-11. [2025-09-17T06:33:33.886198] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T06:33:33.957759] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T06:33:34.290129] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-17T06:33:34.965409] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T06:33:35.090151] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-17T06:33:35.335537] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T06:33:35.340291] [INFO ] [REMOTE ] SPNT: Full fetch complete (48577 records). [2025-09-17T06:33:35.340464] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-17T06:33:35.737703] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-17T06:33:35.737837] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-17T06:33:35.738783] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-17T06:33:35.738863] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-17T06:33:35.741136] [DEBUG] [LOCAL ] SPNT: Trimmed 48577 records to 34707 (keeping 200 days of data) [2025-09-17T06:33:35.899541] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-09-17T06:33:35.958352] [DEBUG] [LOCAL ] SPNT: Primary data saved (34707 records). [2025-09-17T06:33:35.958594] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-17T06:33:35.958807] [INFO ] [MAIN ] Update Progress: 1979/2369 symbols completed. SPNT took 35.2s. Estimated remaining: 57m 3s. Rate: 6.8 symbols/min [2025-09-17T06:33:36.130010] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:33:36.139321] [DEBUG] [LOCAL ] SPRU: Loaded 6874 existing records from primary storage. [2025-09-17T06:33:36.139480] [INFO ] [MAIN ] SPRU: Loaded 6874 existing records. [2025-09-17T06:33:36.315434] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:33:36.315745] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-17T06:33:36.315831] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-17T06:33:36.316176] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-17T06:33:36.316251] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-17T06:33:36.674045] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:33:36.700227] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-17T06:33:36.705967] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T06:33:37.408039] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T06:33:37.490154] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-09-17T06:33:38.290177] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-17T06:33:38.609699] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T06:33:38.832940] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-17T06:33:39.090149] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-11. [2025-09-17T06:33:39.472242] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T06:33:39.476743] [INFO ] [REMOTE ] SPIR: Full fetch complete (51883 records). [2025-09-17T06:33:39.476931] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-17T06:33:39.612517] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T06:33:39.877772] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-17T06:33:39.877887] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-17T06:33:39.878795] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-17T06:33:39.878854] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-17T06:33:39.879970] [DEBUG] [LOCAL ] SPIR: Trimmed 51883 records to 37514 (keeping 200 days of data) [2025-09-17T06:33:39.933052] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-17T06:33:40.103731] [DEBUG] [LOCAL ] SPIR: Primary data saved (37514 records). [2025-09-17T06:33:40.103893] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-17T06:33:40.103991] [INFO ] [MAIN ] Update Progress: 1980/2369 symbols completed. SPIR took 44.1s. Estimated remaining: 56m 53s. Rate: 6.8 symbols/min [2025-09-17T06:33:40.271422] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:33:40.289863] [DEBUG] [LOCAL ] SPXC: Loaded 16896 existing records from primary storage. [2025-09-17T06:33:40.290025] [INFO ] [MAIN ] SPXC: Loaded 16896 existing records. [2025-09-17T06:33:40.464513] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:33:40.464830] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-17T06:33:40.464895] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-17T06:33:40.465464] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-17T06:33:40.465526] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-17T06:33:40.701202] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-17T06:33:40.816541] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:33:41.356300] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T06:33:41.490164] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-11. [2025-09-17T06:33:42.290109] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-09-17T06:33:42.575986] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T06:33:43.030028] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-17T06:33:43.090118] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-17T06:33:43.145448] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T06:33:43.890136] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-09-17T06:33:44.690161] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-17T06:33:45.306015] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T06:33:45.490110] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-17T06:33:45.564028] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-17T06:33:46.218719] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T06:33:46.290150] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-09-17T06:33:46.473939] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T06:33:47.086411] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T06:33:47.091323] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-17T06:33:47.890152] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-17T06:33:48.500720] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T06:33:48.690135] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-17T06:33:49.343550] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-17T06:33:49.490096] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-17T06:33:49.784187] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T06:33:50.290127] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-17T06:33:50.860695] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T06:33:51.090125] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-17T06:33:51.570955] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-17T06:33:51.890134] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-17T06:33:52.690161] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-17T06:33:52.750922] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T06:33:53.027244] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T06:33:53.490157] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-17T06:33:54.290156] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-17T06:33:54.994026] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-17T06:33:55.035090] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T06:33:55.077825] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T06:33:55.090081] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-17T06:33:55.841560] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T06:33:55.890115] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-17T06:33:56.512989] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T06:33:56.690209] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-17T06:33:57.490144] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-17T06:33:58.045557] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T06:33:58.290139] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-17T06:33:59.090111] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-17T06:33:59.516479] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T06:33:59.839248] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T06:33:59.881568] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T06:33:59.890170] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-17T06:34:00.690139] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-17T06:34:01.161165] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T06:34:01.490191] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-17T06:34:01.728359] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T06:34:02.290157] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-17T06:34:02.616383] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T06:34:03.090159] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-17T06:34:03.890150] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-17T06:34:04.156059] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T06:34:04.251074] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-17T06:34:04.257681] [INFO ] [REMOTE ] SPOT: Full fetch complete (74171 records). [2025-09-17T06:34:04.257910] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-17T06:34:04.581549] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T06:34:04.600085] [INFO ] [REMOTE ] SPRU: Full fetch complete (11500 records). [2025-09-17T06:34:04.610452] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-17T06:34:04.698000] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-17T06:34:04.759825] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-09-17T06:34:04.787578] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-09-17T06:34:04.799177] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-09-17T06:34:04.810112] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-09-17T06:34:04.913480] [DEBUG] [LOCAL ] SPOT: Trimmed 74171 records to 51116 (keeping 200 days of data) [2025-09-17T06:34:05.156176] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-17T06:34:05.157406] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-17T06:34:05.158238] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-17T06:34:05.158914] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-17T06:34:05.161489] [DEBUG] [LOCAL ] SPRU: Trimmed 11500 records to 8280 (keeping 200 days of data) [2025-09-17T06:34:05.215174] [DEBUG] [LOCAL ] SPRU: Primary data saved (8280 records). [2025-09-17T06:34:05.216152] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-17T06:34:05.217456] [INFO ] [MAIN ] Update Progress: 1981/2369 symbols completed. SPRU took 29.3s. Estimated remaining: 56m 48s. Rate: 6.8 symbols/min [2025-09-17T06:34:05.438965] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:34:05.451617] [DEBUG] [LOCAL ] SPXX: Loaded 5916 existing records from primary storage. [2025-09-17T06:34:05.455509] [INFO ] [MAIN ] SPXX: Loaded 5916 existing records. [2025-09-17T06:34:05.530664] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-17T06:34:05.737899] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:34:05.741624] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-17T06:34:05.742756] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-17T06:34:05.744162] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-17T06:34:05.745053] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-17T06:34:06.150109] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T06:34:06.153859] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:34:06.231926] [DEBUG] [LOCAL ] SPOT: Primary data saved (51116 records). [2025-09-17T06:34:06.232126] [INFO ] [MAIN ] SPOT: Full history saved. [2025-09-17T06:34:06.232224] [INFO ] [MAIN ] Update Progress: 1982/2369 symbols completed. SPOT took 46.0s. Estimated remaining: 56m 37s. Rate: 6.8 symbols/min [2025-09-17T06:34:06.295198] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-17T06:34:06.404839] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:34:06.443543] [DEBUG] [LOCAL ] SQM: Loaded 36168 existing records from primary storage. [2025-09-17T06:34:06.443760] [INFO ] [MAIN ] SQM: Loaded 36168 existing records. [2025-09-17T06:34:06.619480] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:34:06.619765] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-17T06:34:06.619822] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-17T06:34:06.620666] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-17T06:34:06.620731] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-17T06:34:06.975967] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:34:07.033328] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T06:34:07.039038] [INFO ] [REMOTE ] SPR: Full fetch complete (59894 records). [2025-09-17T06:34:07.039195] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-17T06:34:07.100957] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-11. [2025-09-17T06:34:07.456550] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-17T06:34:07.456696] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-17T06:34:07.457794] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-17T06:34:07.457865] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-17T06:34:07.459506] [DEBUG] [LOCAL ] SPR: Trimmed 59894 records to 41447 (keeping 200 days of data) [2025-09-17T06:34:07.592843] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T06:34:07.741075] [DEBUG] [LOCAL ] SPR: Primary data saved (41447 records). [2025-09-17T06:34:07.741242] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-17T06:34:07.741343] [INFO ] [MAIN ] Update Progress: 1983/2369 symbols completed. SPR took 36.0s. Estimated remaining: 56m 27s. Rate: 6.8 symbols/min [2025-09-17T06:34:07.890681] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-17T06:34:07.913614] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:34:07.936476] [DEBUG] [LOCAL ] SQNS: Loaded 23260 existing records from primary storage. [2025-09-17T06:34:07.936660] [INFO ] [MAIN ] SQNS: Loaded 23260 existing records. [2025-09-17T06:34:08.119512] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:34:08.119808] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-17T06:34:08.119871] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-17T06:34:08.120397] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-17T06:34:08.120457] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-17T06:34:08.486535] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:34:08.690180] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-11. [2025-09-17T06:34:09.019101] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T06:34:09.064777] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T06:34:09.243689] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T06:34:09.490131] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-17T06:34:10.290098] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-11. [2025-09-17T06:34:10.601131] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T06:34:10.604219] [INFO ] [REMOTE ] SPXC: Full fetch complete (33865 records). [2025-09-17T06:34:10.604343] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-17T06:34:10.983534] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-17T06:34:10.983677] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-17T06:34:10.984601] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-17T06:34:10.984725] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-17T06:34:10.985749] [DEBUG] [LOCAL ] SPXC: Trimmed 33865 records to 23501 (keeping 200 days of data) [2025-09-17T06:34:11.091387] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-09-17T06:34:11.134733] [DEBUG] [LOCAL ] SPXC: Primary data saved (23501 records). [2025-09-17T06:34:11.134962] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-17T06:34:11.135109] [INFO ] [MAIN ] Update Progress: 1984/2369 symbols completed. SPXC took 31.0s. Estimated remaining: 56m 17s. Rate: 6.8 symbols/min [2025-09-17T06:34:11.305855] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:34:11.329635] [DEBUG] [LOCAL ] SR: Loaded 24257 existing records from primary storage. [2025-09-17T06:34:11.329837] [INFO ] [MAIN ] SR: Loaded 24257 existing records. [2025-09-17T06:34:11.515835] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:34:11.516613] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T06:34:11.520364] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-17T06:34:11.520454] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-17T06:34:11.521123] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-17T06:34:11.521205] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-17T06:34:11.880486] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:34:11.890097] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-09-17T06:34:12.690161] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-11. [2025-09-17T06:34:12.730395] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T06:34:12.954262] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T06:34:13.490144] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-09-17T06:34:13.988729] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T06:34:14.290165] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-09-17T06:34:14.991837] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T06:34:15.090136] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-17T06:34:15.542932] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T06:34:15.890187] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-09-17T06:34:16.659358] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T06:34:16.690086] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-17T06:34:17.197151] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T06:34:17.490162] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-09-17T06:34:18.130709] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T06:34:18.290104] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-09-17T06:34:18.381843] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T06:34:19.090138] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-17T06:34:19.149193] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T06:34:19.890139] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-17T06:34:20.536610] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T06:34:20.690126] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-17T06:34:20.812628] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T06:34:21.490151] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-17T06:34:22.019417] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T06:34:22.257446] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T06:34:22.290084] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-17T06:34:23.021423] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T06:34:23.090132] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-17T06:34:23.836528] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T06:34:23.890128] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-17T06:34:24.461536] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T06:34:24.690135] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-17T06:34:25.397190] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T06:34:25.490084] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-17T06:34:26.290142] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-17T06:34:26.335459] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T06:34:27.090144] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-17T06:34:27.321712] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T06:34:27.890171] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-17T06:34:28.468948] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T06:34:28.690154] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-17T06:34:29.490172] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-17T06:34:29.544506] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T06:34:30.290207] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T06:34:30.290272] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-17T06:34:30.923724] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T06:34:31.090214] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-17T06:34:31.565311] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T06:34:31.890137] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-17T06:34:32.690132] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-17T06:34:32.952774] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T06:34:33.062746] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T06:34:33.490159] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-17T06:34:34.239958] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T06:34:34.290078] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-17T06:34:34.550192] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T06:34:35.090144] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-17T06:34:35.723376] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T06:34:35.729507] [INFO ] [REMOTE ] SQNS: Full fetch complete (31354 records). [2025-09-17T06:34:35.729630] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-17T06:34:35.893440] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-17T06:34:36.123019] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-17T06:34:36.123127] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-17T06:34:36.123885] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-17T06:34:36.123941] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-17T06:34:36.125019] [DEBUG] [LOCAL ] SQNS: Trimmed 31354 records to 24998 (keeping 200 days of data) [2025-09-17T06:34:36.277924] [DEBUG] [LOCAL ] SQNS: Primary data saved (24998 records). [2025-09-17T06:34:36.278102] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-17T06:34:36.278210] [INFO ] [MAIN ] Update Progress: 1985/2369 symbols completed. SQNS took 28.5s. Estimated remaining: 56m 12s. Rate: 6.8 symbols/min [2025-09-17T06:34:36.464469] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:34:36.464720] [DEBUG] [LOCAL ] SRE: No existing data file found in primary storage. [2025-09-17T06:34:36.464772] [WARN ] [MAIN ] SRE: No existing data found, performing full refresh instead. [2025-09-17T06:34:36.464916] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-17T06:34:36.464976] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-17T06:34:36.465036] [DEBUG] [LOCAL ] SRE: No primary data file found to delete. [2025-09-17T06:34:36.465088] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-17T06:34:36.696901] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-17T06:34:36.838006] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:34:36.871931] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T06:34:37.422222] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T06:34:37.479849] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T06:34:37.490068] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-17T06:34:38.216747] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T06:34:38.290146] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-17T06:34:39.090176] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-17T06:34:39.103717] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T06:34:39.890137] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-17T06:34:40.427104] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T06:34:40.690123] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-17T06:34:41.490138] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-11. [2025-09-17T06:34:41.628748] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T06:34:42.025011] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T06:34:42.030584] [INFO ] [REMOTE ] SR: Full fetch complete (45439 records). [2025-09-17T06:34:42.030766] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-17T06:34:42.295239] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-17T06:34:42.436117] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-17T06:34:42.436230] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-17T06:34:42.437161] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-17T06:34:42.437221] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-17T06:34:42.438298] [DEBUG] [LOCAL ] SR: Trimmed 45439 records to 32597 (keeping 200 days of data) [2025-09-17T06:34:42.650145] [DEBUG] [LOCAL ] SR: Primary data saved (32597 records). [2025-09-17T06:34:42.650307] [INFO ] [MAIN ] SR: Full history saved. [2025-09-17T06:34:42.650412] [INFO ] [MAIN ] Update Progress: 1986/2369 symbols completed. SR took 31.5s. Estimated remaining: 56m 3s. Rate: 6.8 symbols/min [2025-09-17T06:34:42.818480] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:34:42.827415] [DEBUG] [LOCAL ] SREA: Loaded 7518 existing records from primary storage. [2025-09-17T06:34:42.827549] [INFO ] [MAIN ] SREA: Loaded 7518 existing records. [2025-09-17T06:34:43.013745] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:34:43.014394] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-17T06:34:43.014460] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-17T06:34:43.014873] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-17T06:34:43.014935] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-17T06:34:43.095332] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-17T06:34:43.377343] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:34:43.451296] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T06:34:43.859903] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T06:34:43.890127] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-09-17T06:34:44.052027] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T06:34:44.058206] [INFO ] [REMOTE ] SQM: Full fetch complete (68814 records). [2025-09-17T06:34:44.058383] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-17T06:34:44.445256] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-17T06:34:44.445365] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-17T06:34:44.446461] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-17T06:34:44.446569] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-17T06:34:44.448101] [DEBUG] [LOCAL ] SQM: Trimmed 68814 records to 48657 (keeping 200 days of data) [2025-09-17T06:34:44.690187] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-11. [2025-09-17T06:34:44.753843] [DEBUG] [LOCAL ] SQM: Primary data saved (48657 records). [2025-09-17T06:34:44.753996] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-17T06:34:44.754111] [INFO ] [MAIN ] Update Progress: 1987/2369 symbols completed. SQM took 38.5s. Estimated remaining: 55m 52s. Rate: 6.8 symbols/min [2025-09-17T06:34:44.928322] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:34:44.956136] [DEBUG] [LOCAL ] SRFM: Loaded 29197 existing records from primary storage. [2025-09-17T06:34:44.956302] [INFO ] [MAIN ] SRFM: Loaded 29197 existing records. [2025-09-17T06:34:45.143059] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:34:45.143300] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-17T06:34:45.143359] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-17T06:34:45.144038] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-17T06:34:45.144101] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-17T06:34:45.490543] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T06:34:45.490684] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-17T06:34:45.518101] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:34:45.651730] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T06:34:46.290145] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-11. [2025-09-17T06:34:46.341728] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T06:34:46.343586] [INFO ] [REMOTE ] SPXX: Full fetch complete (12191 records). [2025-09-17T06:34:46.343710] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-17T06:34:46.710388] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-17T06:34:46.710490] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-17T06:34:46.710830] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-17T06:34:46.710884] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-17T06:34:46.711378] [DEBUG] [LOCAL ] SPXX: Trimmed 12191 records to 8978 (keeping 200 days of data) [2025-09-17T06:34:46.765700] [DEBUG] [LOCAL ] SPXX: Primary data saved (8978 records). [2025-09-17T06:34:46.765838] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-17T06:34:46.765934] [INFO ] [MAIN ] Update Progress: 1988/2369 symbols completed. SPXX took 41.5s. Estimated remaining: 55m 42s. Rate: 6.8 symbols/min [2025-09-17T06:34:46.933478] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:34:46.946120] [DEBUG] [LOCAL ] SRG: Loaded 10612 existing records from primary storage. [2025-09-17T06:34:46.946268] [INFO ] [MAIN ] SRG: Loaded 10612 existing records. [2025-09-17T06:34:47.095366] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-09-17T06:34:47.134262] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:34:47.134526] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-17T06:34:47.134590] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-17T06:34:47.135190] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-17T06:34:47.135256] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-17T06:34:47.495638] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:34:47.632447] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T06:34:47.890164] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-09-17T06:34:48.690190] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-09-17T06:34:49.008628] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T06:34:49.384012] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T06:34:49.490137] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-11. [2025-09-17T06:34:49.632053] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T06:34:50.290139] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-09-17T06:34:50.697357] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T06:34:50.866434] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T06:34:51.090201] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-17T06:34:51.634678] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T06:34:51.890148] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-17T06:34:52.658544] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T06:34:52.690088] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-17T06:34:53.482578] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T06:34:53.490083] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-17T06:34:54.290164] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-09-17T06:34:54.582439] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T06:34:55.090149] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-17T06:34:55.365759] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T06:34:55.890137] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-17T06:34:56.690133] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-17T06:34:56.788082] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T06:34:56.857337] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T06:34:57.457716] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T06:34:57.490166] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-17T06:34:58.290148] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-17T06:34:58.659788] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T06:34:59.063949] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T06:34:59.090088] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-17T06:34:59.833618] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T06:34:59.890125] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-17T06:35:00.690133] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-17T06:35:00.921459] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T06:35:01.490172] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-17T06:35:01.537476] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T06:35:01.539558] [INFO ] [REMOTE ] SREA: Full fetch complete (15989 records). [2025-09-17T06:35:01.539731] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-17T06:35:01.961408] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-17T06:35:01.961518] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-17T06:35:01.961915] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-17T06:35:01.961968] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-17T06:35:01.962475] [DEBUG] [LOCAL ] SREA: Trimmed 15989 records to 10434 (keeping 200 days of data) [2025-09-17T06:35:02.027969] [DEBUG] [LOCAL ] SREA: Primary data saved (10434 records). [2025-09-17T06:35:02.028133] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-17T06:35:02.028223] [INFO ] [MAIN ] Update Progress: 1989/2369 symbols completed. SREA took 19.4s. Estimated remaining: 55m 35s. Rate: 6.8 symbols/min [2025-09-17T06:35:02.195434] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:35:02.214226] [DEBUG] [LOCAL ] SRI: Loaded 20511 existing records from primary storage. [2025-09-17T06:35:02.214378] [INFO ] [MAIN ] SRI: Loaded 20511 existing records. [2025-09-17T06:35:02.295327] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-17T06:35:02.393043] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:35:02.393303] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-17T06:35:02.393361] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-17T06:35:02.393829] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-17T06:35:02.393889] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-17T06:35:02.761158] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:35:03.090170] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-17T06:35:03.555128] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T06:35:03.581792] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T06:35:03.890161] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-17T06:35:04.161288] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T06:35:04.690170] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-11. [2025-09-17T06:35:05.490130] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-17T06:35:05.566762] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T06:35:06.140819] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T06:35:06.290139] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-17T06:35:06.497363] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T06:35:07.090142] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-17T06:35:07.890182] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-09-17T06:35:08.112732] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T06:35:08.690088] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-17T06:35:08.881984] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T06:35:09.166205] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T06:35:09.490131] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-17T06:35:09.924274] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T06:35:10.290153] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-17T06:35:11.090161] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-09-17T06:35:11.890110] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-17T06:35:11.941918] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-17T06:35:12.103764] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T06:35:12.279594] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T06:35:12.690181] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-17T06:35:12.872996] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T06:35:13.490131] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-17T06:35:14.290188] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-17T06:35:14.461666] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T06:35:14.517608] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T06:35:15.090176] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-17T06:35:15.890112] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-17T06:35:16.217631] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T06:35:16.399686] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-17T06:35:16.690137] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-17T06:35:17.188705] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T06:35:17.490181] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-17T06:35:18.290137] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-17T06:35:18.646268] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-17T06:35:18.652035] [INFO ] [REMOTE ] SRFM: Full fetch complete (48030 records). [2025-09-17T06:35:18.652146] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-17T06:35:19.056073] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T06:35:19.056194] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-17T06:35:19.062637] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-17T06:35:19.064023] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-17T06:35:19.064439] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-17T06:35:19.065728] [DEBUG] [LOCAL ] SRFM: Trimmed 48030 records to 34615 (keeping 200 days of data) [2025-09-17T06:35:19.113780] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-17T06:35:19.273804] [DEBUG] [LOCAL ] SRFM: Primary data saved (34615 records). [2025-09-17T06:35:19.274006] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-17T06:35:19.274125] [INFO ] [MAIN ] Update Progress: 1990/2369 symbols completed. SRFM took 34.5s. Estimated remaining: 55m 28s. Rate: 6.8 symbols/min [2025-09-17T06:35:19.462005] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T06:35:19.465058] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:35:19.468429] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-17T06:35:19.468592] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-17T06:35:19.469010] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-17T06:35:19.469305] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-17T06:35:19.469363] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-17T06:35:19.469402] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-17T06:35:19.826054] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:35:19.890130] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-17T06:35:20.652243] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T06:35:20.690120] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-17T06:35:20.908982] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T06:35:20.916433] [INFO ] [REMOTE ] SRE: Full fetch complete (77098 records). [2025-09-17T06:35:20.916758] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-17T06:35:21.312910] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T06:35:21.358714] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-09-17T06:35:21.358850] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-09-17T06:35:21.360191] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-09-17T06:35:21.360271] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-09-17T06:35:21.362001] [DEBUG] [LOCAL ] SRE: Trimmed 77098 records to 53422 (keeping 200 days of data) [2025-09-17T06:35:21.490329] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-17T06:35:21.729338] [DEBUG] [LOCAL ] SRE: Primary data saved (53422 records). [2025-09-17T06:35:21.729551] [INFO ] [MAIN ] SRE: Full history saved. [2025-09-17T06:35:21.729685] [INFO ] [MAIN ] Update Progress: 1991/2369 symbols completed. SRE took 45.5s. Estimated remaining: 55m 18s. Rate: 6.8 symbols/min [2025-09-17T06:35:21.903137] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:35:21.910966] [DEBUG] [LOCAL ] SRV: Loaded 5351 existing records from primary storage. [2025-09-17T06:35:21.911120] [INFO ] [MAIN ] SRV: Loaded 5351 existing records. [2025-09-17T06:35:22.092626] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:35:22.092894] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-17T06:35:22.092954] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-17T06:35:22.093278] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-17T06:35:22.093367] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-17T06:35:22.298370] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-11. [2025-09-17T06:35:22.460697] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:35:22.525757] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T06:35:22.927232] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T06:35:23.090189] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-17T06:35:23.438323] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-17T06:35:23.890142] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-17T06:35:24.690130] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-17T06:35:25.096262] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T06:35:25.162155] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T06:35:25.490125] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-17T06:35:26.290147] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-17T06:35:26.769851] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T06:35:27.090130] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-17T06:35:27.237188] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T06:35:27.239825] [INFO ] [REMOTE ] SRG: Full fetch complete (25844 records). [2025-09-17T06:35:27.239922] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-17T06:35:27.617413] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-17T06:35:27.617574] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-17T06:35:27.618228] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-17T06:35:27.618307] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-17T06:35:27.619116] [DEBUG] [LOCAL ] SRG: Trimmed 25844 records to 16138 (keeping 200 days of data) [2025-09-17T06:35:27.713998] [DEBUG] [LOCAL ] SRG: Primary data saved (16138 records). [2025-09-17T06:35:27.714188] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-17T06:35:27.714310] [INFO ] [MAIN ] Update Progress: 1992/2369 symbols completed. SRG took 40.9s. Estimated remaining: 55m 8s. Rate: 6.8 symbols/min [2025-09-17T06:35:27.888109] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:35:27.890151] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-17T06:35:27.921930] [DEBUG] [LOCAL ] SSB: Loaded 32137 existing records from primary storage. [2025-09-17T06:35:27.922094] [INFO ] [MAIN ] SSB: Loaded 32137 existing records. [2025-09-17T06:35:28.107712] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:35:28.108084] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-17T06:35:28.108183] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-17T06:35:28.114083] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-17T06:35:28.123841] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-17T06:35:28.124313] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T06:35:28.296173] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T06:35:28.493561] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:35:28.690163] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-11. [2025-09-17T06:35:29.490172] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-11. [2025-09-17T06:35:30.295456] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-17T06:35:30.310813] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T06:35:30.326097] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T06:35:31.090192] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-09-17T06:35:31.667963] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T06:35:31.846621] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T06:35:31.890172] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-17T06:35:32.690182] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-17T06:35:33.035789] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T06:35:33.082947] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T06:35:33.490145] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-17T06:35:33.847828] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-17T06:35:34.290132] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-09-17T06:35:35.090170] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-09-17T06:35:35.721444] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T06:35:35.858499] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T06:35:35.890100] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-17T06:35:36.597586] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T06:35:36.690116] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-17T06:35:37.444482] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T06:35:37.490151] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-17T06:35:38.077450] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T06:35:38.290143] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-09-17T06:35:39.090140] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-17T06:35:39.817682] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T06:35:39.871795] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T06:35:39.890083] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-17T06:35:40.318785] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T06:35:40.690174] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-17T06:35:41.490159] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-17T06:35:41.499325] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T06:35:42.290140] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-17T06:35:42.501874] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T06:35:42.504990] [INFO ] [REMOTE ] SRI: Full fetch complete (41964 records). [2025-09-17T06:35:42.505141] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-17T06:35:42.880584] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-17T06:35:42.880747] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-17T06:35:42.881620] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-17T06:35:42.881712] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-17T06:35:42.882748] [DEBUG] [LOCAL ] SRI: Trimmed 41964 records to 28243 (keeping 200 days of data) [2025-09-17T06:35:43.040686] [DEBUG] [LOCAL ] SRI: Primary data saved (28243 records). [2025-09-17T06:35:43.040906] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-17T06:35:43.041038] [INFO ] [MAIN ] Update Progress: 1993/2369 symbols completed. SRI took 41.0s. Estimated remaining: 55m 1s. Rate: 6.8 symbols/min [2025-09-17T06:35:43.096003] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-17T06:35:43.219000] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:35:43.236986] [DEBUG] [LOCAL ] SSD: Loaded 16733 existing records from primary storage. [2025-09-17T06:35:43.237168] [INFO ] [MAIN ] SSD: Loaded 16733 existing records. [2025-09-17T06:35:43.435558] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:35:43.436039] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-17T06:35:43.436167] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-17T06:35:43.436774] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-17T06:35:43.436838] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-17T06:35:43.533567] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T06:35:43.714870] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T06:35:43.842689] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:35:43.890093] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-11. [2025-09-17T06:35:44.690125] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-17T06:35:45.171905] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T06:35:45.490137] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-17T06:35:45.850104] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-17T06:35:46.232918] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T06:35:46.290151] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-17T06:35:47.090134] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-17T06:35:47.461399] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-17T06:35:47.892371] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-09-17T06:35:47.897859] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T06:35:48.690201] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-17T06:35:49.100400] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T06:35:49.490211] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-17T06:35:49.878755] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T06:35:49.879813] [INFO ] [REMOTE ] SRL: Full fetch complete (1939 records). [2025-09-17T06:35:49.879940] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-17T06:35:50.082612] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-17T06:35:50.082861] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:35:50.082918] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:35:50.082963] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-17T06:35:50.083033] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-17T06:35:50.083080] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-17T06:35:50.083144] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-17T06:35:50.083230] [INFO ] [MAIN ] Update Progress: 1994/2369 symbols completed. SRL took 30.8s. Estimated remaining: 54m 52s. Rate: 6.8 symbols/min [2025-09-17T06:35:50.265615] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:35:50.291307] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-09-17T06:35:50.298033] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T06:35:50.331634] [DEBUG] [LOCAL ] SSL: Loaded 30474 existing records from primary storage. [2025-09-17T06:35:50.331839] [INFO ] [MAIN ] SSL: Loaded 30474 existing records. [2025-09-17T06:35:50.530837] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:35:50.531133] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-17T06:35:50.531199] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-17T06:35:50.531878] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-17T06:35:50.531946] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-17T06:35:51.041391] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:35:51.090117] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-17T06:35:51.508101] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T06:35:51.890180] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-17T06:35:52.593006] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T06:35:52.690127] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-17T06:35:52.860407] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T06:35:53.490170] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-17T06:35:54.229107] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T06:35:54.290156] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-17T06:35:54.775544] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T06:35:55.090133] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-17T06:35:55.116535] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T06:35:55.890150] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-11. [2025-09-17T06:35:56.695260] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-17T06:35:56.719866] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T06:35:57.436667] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T06:35:57.490141] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-17T06:35:57.756805] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T06:35:58.215242] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T06:35:58.216798] [INFO ] [REMOTE ] SRV: Full fetch complete (11640 records). [2025-09-17T06:35:58.216943] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-17T06:35:58.295392] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-09-17T06:35:58.609512] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-17T06:35:58.609663] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-17T06:35:58.609962] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-17T06:35:58.610023] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-17T06:35:58.611115] [DEBUG] [LOCAL ] SRV: Trimmed 11640 records to 7807 (keeping 200 days of data) [2025-09-17T06:35:58.666809] [DEBUG] [LOCAL ] SRV: Primary data saved (7807 records). [2025-09-17T06:35:58.666990] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-17T06:35:58.667145] [INFO ] [MAIN ] Update Progress: 1995/2369 symbols completed. SRV took 36.9s. Estimated remaining: 54m 43s. Rate: 6.8 symbols/min [2025-09-17T06:35:58.847141] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:35:58.860353] [DEBUG] [LOCAL ] SST: Loaded 9722 existing records from primary storage. [2025-09-17T06:35:58.860523] [INFO ] [MAIN ] SST: Loaded 9722 existing records. [2025-09-17T06:35:59.047550] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:35:59.047843] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-17T06:35:59.047905] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-17T06:35:59.048235] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-17T06:35:59.048298] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-17T06:35:59.095300] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-17T06:35:59.415676] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:35:59.868455] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T06:35:59.890102] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-09-17T06:36:00.328556] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T06:36:00.690179] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-17T06:36:01.233212] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T06:36:01.490146] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-17T06:36:01.837592] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T06:36:02.290134] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-17T06:36:03.090134] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-11. [2025-09-17T06:36:03.890183] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-17T06:36:09.617288] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (5.73 seconds). [2025-09-17T06:36:09.622697] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-17T06:36:10.241397] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-11 (7.15 seconds). [2025-09-17T06:36:10.244496] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-09-17T06:36:10.772138] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (9.28 seconds). [2025-09-17T06:36:10.780188] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-17T06:36:11.255689] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T06:36:11.258868] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-17T06:36:11.414046] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (9.12 seconds). [2025-09-17T06:36:11.420359] [INFO ] [REMOTE ] SSB: Full fetch complete (60874 records). [2025-09-17T06:36:11.420582] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-17T06:36:11.826028] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-17T06:36:11.826151] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-17T06:36:11.827881] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-17T06:36:11.828000] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-17T06:36:11.830430] [DEBUG] [LOCAL ] SSB: Trimmed 60874 records to 42892 (keeping 200 days of data) [2025-09-17T06:36:12.109042] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T06:36:12.120079] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-17T06:36:12.147328] [DEBUG] [LOCAL ] SSB: Primary data saved (42892 records). [2025-09-17T06:36:12.147512] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-17T06:36:12.147655] [INFO ] [MAIN ] Update Progress: 1996/2369 symbols completed. SSB took 44.4s. Estimated remaining: 54m 35s. Rate: 6.8 symbols/min [2025-09-17T06:36:12.323084] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:36:12.342379] [DEBUG] [LOCAL ] SSTK: Loaded 18124 existing records from primary storage. [2025-09-17T06:36:12.342554] [INFO ] [MAIN ] SSTK: Loaded 18124 existing records. [2025-09-17T06:36:12.572544] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:36:12.572858] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-17T06:36:12.572921] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-17T06:36:12.573391] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-17T06:36:12.573452] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-17T06:36:12.941637] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:36:12.942134] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-11. [2025-09-17T06:36:12.976903] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (3.35 seconds). [2025-09-17T06:36:12.982857] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-17T06:36:13.269885] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T06:36:13.274520] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-17T06:36:13.810487] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T06:36:13.820931] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-17T06:36:13.861249] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T06:36:13.864693] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-17T06:36:14.160333] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T06:36:14.165968] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-17T06:36:14.439820] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T06:36:14.447118] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-09-17T06:36:14.473224] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T06:36:14.476500] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-17T06:36:15.533102] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T06:36:15.536340] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-17T06:36:15.916896] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T06:36:15.920601] [INFO ] [REMOTE ] SSD: Full fetch complete (32082 records). [2025-09-17T06:36:15.920782] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-17T06:36:16.298529] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-17T06:36:16.320246] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-17T06:36:16.321266] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-17T06:36:16.321549] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-17T06:36:16.323162] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-17T06:36:16.332347] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-17T06:36:16.332485] [DEBUG] [LOCAL ] SSD: Trimmed 32082 records to 22476 (keeping 200 days of data) [2025-09-17T06:36:16.477693] [DEBUG] [LOCAL ] SSD: Primary data saved (22476 records). [2025-09-17T06:36:16.477847] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-17T06:36:16.477949] [INFO ] [MAIN ] Update Progress: 1997/2369 symbols completed. SSD took 33.4s. Estimated remaining: 54m 25s. Rate: 6.8 symbols/min [2025-09-17T06:36:16.638786] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-17T06:36:16.690124] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-09-17T06:36:17.488132] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T06:36:17.491421] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-17T06:36:18.046497] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T06:36:18.290120] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-17T06:36:18.319321] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-17T06:36:18.376086] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T06:36:19.090145] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-17T06:36:19.591941] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T06:36:19.890139] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-17T06:36:20.021486] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T06:36:20.690150] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-17T06:36:21.279061] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T06:36:21.490148] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-17T06:36:22.021911] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T06:36:22.263293] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T06:36:22.290081] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-17T06:36:23.090120] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-17T06:36:23.800351] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T06:36:23.865083] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T06:36:23.866885] [INFO ] [REMOTE ] SST: Full fetch complete (19126 records). [2025-09-17T06:36:23.866975] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-17T06:36:23.899872] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-17T06:36:24.244159] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-17T06:36:24.244284] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-17T06:36:24.244832] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-17T06:36:24.244911] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-17T06:36:24.245631] [DEBUG] [LOCAL ] SST: Trimmed 19126 records to 12517 (keeping 200 days of data) [2025-09-17T06:36:24.326868] [DEBUG] [LOCAL ] SST: Primary data saved (12517 records). [2025-09-17T06:36:24.327046] [INFO ] [MAIN ] SST: Full history saved. [2025-09-17T06:36:24.327185] [INFO ] [MAIN ] Update Progress: 1998/2369 symbols completed. SST took 25.7s. Estimated remaining: 54m 16s. Rate: 6.8 symbols/min [2025-09-17T06:36:24.690160] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-17T06:36:25.255375] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T06:36:25.261394] [INFO ] [REMOTE ] SSL: Full fetch complete (60249 records). [2025-09-17T06:36:25.261628] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-17T06:36:25.658688] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-17T06:36:25.658830] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-17T06:36:25.660181] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-17T06:36:25.660259] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-17T06:36:25.661889] [DEBUG] [LOCAL ] SSL: Trimmed 60249 records to 41100 (keeping 200 days of data) [2025-09-17T06:36:25.905491] [DEBUG] [LOCAL ] SSL: Primary data saved (41100 records). [2025-09-17T06:36:25.905771] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-17T06:36:25.905925] [INFO ] [MAIN ] Update Progress: 1999/2369 symbols completed. SSL took 35.8s. Estimated remaining: 54m 6s. Rate: 6.8 symbols/min [2025-09-17T06:36:26.062394] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T06:36:26.070222] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-17T06:36:26.824394] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T06:36:26.830558] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-17T06:36:27.957290] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T06:36:27.962749] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-17T06:36:29.109287] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T06:36:29.117212] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-17T06:36:30.462404] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T06:36:30.468528] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-17T06:36:31.500752] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T06:36:31.503986] [INFO ] [REMOTE ] SSTK: Full fetch complete (42512 records). [2025-09-17T06:36:31.504086] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-17T06:36:31.882291] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-17T06:36:31.882404] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-17T06:36:31.883223] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-17T06:36:31.883330] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-17T06:36:31.884469] [DEBUG] [LOCAL ] SSTK: Trimmed 42512 records to 27284 (keeping 200 days of data) [2025-09-17T06:36:32.062433] [DEBUG] [LOCAL ] SSTK: Primary data saved (27284 records). [2025-09-17T06:36:32.062617] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-17T06:36:32.062735] [INFO ] [MAIN ] Update Progress: 2000/2369 symbols completed. SSTK took 19.9s. Estimated remaining: 53m 57s. Rate: 6.8 symbols/min [2025-09-17T06:36:32.777823] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:36:32.751702] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:36:32.760570] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:36:32.805024] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:36:32.840383] [DEBUG] [LOCAL ] STC: Loaded 13235 existing records from primary storage. [2025-09-17T06:36:32.840634] [INFO ] [MAIN ] STC: Loaded 13235 existing records. [2025-09-17T06:36:32.941022] [DEBUG] [LOCAL ] STE: Loaded 26260 existing records from primary storage. [2025-09-17T06:36:32.975410] [INFO ] [MAIN ] STE: Loaded 26260 existing records. [2025-09-17T06:36:33.049689] [DEBUG] [LOCAL ] ST: Loaded 36896 existing records from primary storage. [2025-09-17T06:36:33.120554] [INFO ] [MAIN ] ST: Loaded 36896 existing records. [2025-09-17T06:36:33.196247] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:36:33.186653] [DEBUG] [LOCAL ] STAG: Loaded 36988 existing records from primary storage. [2025-09-17T06:36:33.263968] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-17T06:36:33.302879] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-17T06:36:33.287172] [INFO ] [MAIN ] STAG: Loaded 36988 existing records. [2025-09-17T06:36:33.373390] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-17T06:36:33.455046] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-17T06:36:33.501435] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:36:33.555735] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-17T06:36:33.594306] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:36:33.599816] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-17T06:36:33.644966] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-17T06:36:33.668487] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-17T06:36:33.704172] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-17T06:36:33.801944] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-17T06:36:33.821071] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:36:33.866912] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-17T06:36:33.882792] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-17T06:36:33.882488] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-17T06:36:33.923944] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-17T06:36:34.077113] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-17T06:36:34.162544] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-17T06:36:34.785405] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:36:34.864676] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-11. [2025-09-17T06:36:34.956184] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:36:35.019603] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-11. [2025-09-17T06:36:35.099030] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:36:35.121460] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-11. [2025-09-17T06:36:35.218983] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:36:35.219333] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-11. [2025-09-17T06:36:36.223050] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T06:36:36.226391] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-09-17T06:36:36.472110] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T06:36:36.481852] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-09-17T06:36:36.718759] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T06:36:36.726946] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-09-17T06:36:37.009882] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T06:36:37.019451] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-09-17T06:36:37.227740] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T06:36:37.232405] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-09-17T06:36:37.894062] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T06:36:37.901437] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-09-17T06:36:37.959111] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T06:36:37.963526] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-17T06:36:38.051555] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T06:36:38.207443] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T06:36:38.290113] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-09-17T06:36:38.934546] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T06:36:39.090141] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-09-17T06:36:39.357869] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T06:36:39.890144] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-17T06:36:39.949131] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T06:36:40.690090] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-17T06:36:40.722274] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T06:36:41.268787] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T06:36:41.490151] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-17T06:36:42.290487] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-17T06:36:42.292326] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T06:36:43.095246] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-17T06:36:43.113957] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T06:36:43.747937] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T06:36:43.890193] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-17T06:36:44.690244] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-17T06:36:44.738310] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T06:36:44.971144] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T06:36:45.490184] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-17T06:36:46.014256] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T06:36:46.290179] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-17T06:36:46.904870] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T06:36:47.090126] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-17T06:36:47.822062] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T06:36:47.890156] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-17T06:36:48.690123] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-17T06:36:48.828035] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T06:36:49.219207] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T06:36:49.490140] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-17T06:36:50.109625] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T06:36:50.290128] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-17T06:36:50.919747] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T06:36:51.090154] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-17T06:36:51.314934] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T06:36:51.890165] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-17T06:36:52.690107] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-17T06:36:52.787265] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T06:36:53.490127] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-17T06:36:53.576984] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T06:36:53.753722] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T06:36:54.290132] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-17T06:36:54.699280] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T06:36:54.984281] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T06:36:55.090155] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-17T06:36:55.890158] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-17T06:36:56.700073] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-17T06:36:56.707171] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T06:36:57.490171] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-17T06:36:57.606211] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T06:36:58.074096] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T06:36:58.078671] [INFO ] [REMOTE ] STE: Full fetch complete (50678 records). [2025-09-17T06:36:58.078835] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-17T06:36:58.295359] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-17T06:36:58.480566] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-17T06:36:58.480699] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-17T06:36:58.481619] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-17T06:36:58.481755] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-17T06:36:58.482932] [DEBUG] [LOCAL ] STE: Trimmed 50678 records to 35550 (keeping 200 days of data) [2025-09-17T06:36:58.603809] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T06:36:58.736434] [DEBUG] [LOCAL ] STE: Primary data saved (35550 records). [2025-09-17T06:36:58.736717] [INFO ] [MAIN ] STE: Full history saved. [2025-09-17T06:36:58.736905] [INFO ] [MAIN ] Update Progress: 2001/2369 symbols completed. STE took 26.7s. Estimated remaining: 53m 52s. Rate: 6.8 symbols/min [2025-09-17T06:36:58.915735] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:36:58.933120] [DEBUG] [LOCAL ] STEL: Loaded 16712 existing records from primary storage. [2025-09-17T06:36:58.933298] [INFO ] [MAIN ] STEL: Loaded 16712 existing records. [2025-09-17T06:36:59.098780] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-17T06:36:59.136575] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:36:59.136857] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-17T06:36:59.136918] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-17T06:36:59.137385] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-17T06:36:59.137448] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-17T06:36:59.501360] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:36:59.890185] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-17T06:37:00.020824] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T06:37:00.183385] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T06:37:00.690167] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-11. [2025-09-17T06:37:01.490219] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-17T06:37:01.576207] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T06:37:02.014086] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T06:37:02.290159] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-17T06:37:03.090205] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-09-17T06:37:03.140320] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T06:37:03.820004] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T06:37:03.825954] [INFO ] [REMOTE ] STAG: Full fetch complete (71583 records). [2025-09-17T06:37:03.826092] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-17T06:37:03.895274] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-17T06:37:04.230190] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-17T06:37:04.230367] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-17T06:37:04.231615] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-17T06:37:04.231782] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-17T06:37:04.244466] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T06:37:04.249891] [DEBUG] [LOCAL ] STAG: Trimmed 71583 records to 50011 (keeping 200 days of data) [2025-09-17T06:37:04.573104] [DEBUG] [LOCAL ] STAG: Primary data saved (50011 records). [2025-09-17T06:37:04.573289] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-17T06:37:04.573391] [INFO ] [MAIN ] Update Progress: 2002/2369 symbols completed. STAG took 32.5s. Estimated remaining: 53m 42s. Rate: 6.8 symbols/min [2025-09-17T06:37:04.710757] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-17T06:37:04.780133] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:37:04.807493] [DEBUG] [LOCAL ] STEM: Loaded 28350 existing records from primary storage. [2025-09-17T06:37:04.807673] [INFO ] [MAIN ] STEM: Loaded 28350 existing records. [2025-09-17T06:37:04.992364] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:37:04.992826] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-17T06:37:04.992912] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-17T06:37:05.003065] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-17T06:37:05.003795] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T06:37:05.004148] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-17T06:37:05.012180] [INFO ] [REMOTE ] STC: Full fetch complete (25901 records). [2025-09-17T06:37:05.076922] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-17T06:37:05.495985] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-09-17T06:37:05.643541] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:37:05.792477] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-17T06:37:05.792596] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-17T06:37:05.793179] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-17T06:37:05.793237] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-17T06:37:05.794134] [DEBUG] [LOCAL ] STC: Trimmed 25901 records to 17853 (keeping 200 days of data) [2025-09-17T06:37:05.917230] [DEBUG] [LOCAL ] STC: Primary data saved (17853 records). [2025-09-17T06:37:05.917418] [INFO ] [MAIN ] STC: Full history saved. [2025-09-17T06:37:05.917520] [INFO ] [MAIN ] Update Progress: 2003/2369 symbols completed. STC took 33.9s. Estimated remaining: 53m 32s. Rate: 6.8 symbols/min [2025-09-17T06:37:06.091109] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:37:06.103805] [DEBUG] [LOCAL ] STEW: Loaded 11286 existing records from primary storage. [2025-09-17T06:37:06.103983] [INFO ] [MAIN ] STEW: Loaded 11286 existing records. [2025-09-17T06:37:06.300864] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-11. [2025-09-17T06:37:06.307709] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:37:06.309119] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-17T06:37:06.309199] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-17T06:37:06.309549] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-17T06:37:06.309685] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-17T06:37:06.715053] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:37:06.717013] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T06:37:06.737985] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T06:37:07.090149] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-11. [2025-09-17T06:37:07.890134] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-17T06:37:08.020794] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T06:37:08.140876] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T06:37:08.690179] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-09-17T06:37:09.366488] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T06:37:09.372456] [INFO ] [REMOTE ] ST: Full fetch complete (71724 records). [2025-09-17T06:37:09.372627] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-17T06:37:09.495289] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-17T06:37:09.766915] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-17T06:37:09.767052] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-17T06:37:09.768172] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-17T06:37:09.768268] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-17T06:37:09.769826] [DEBUG] [LOCAL ] ST: Trimmed 71724 records to 49890 (keeping 200 days of data) [2025-09-17T06:37:10.084968] [DEBUG] [LOCAL ] ST: Primary data saved (49890 records). [2025-09-17T06:37:10.085135] [INFO ] [MAIN ] ST: Full history saved. [2025-09-17T06:37:10.085243] [INFO ] [MAIN ] Update Progress: 2004/2369 symbols completed. ST took 38.0s. Estimated remaining: 53m 23s. Rate: 6.8 symbols/min [2025-09-17T06:37:10.259107] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:37:10.259298] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-17T06:37:10.259344] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-17T06:37:10.259451] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-17T06:37:10.259503] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-17T06:37:10.259554] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-17T06:37:10.259599] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-17T06:37:10.302002] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-09-17T06:37:10.615177] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:37:10.632911] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T06:37:10.670341] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T06:37:10.914743] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T06:37:11.090128] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-11. [2025-09-17T06:37:11.537543] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T06:37:11.890170] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-17T06:37:12.228701] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-17T06:37:12.690187] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-09-17T06:37:13.490127] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-17T06:37:13.911694] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T06:37:14.290145] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-09-17T06:37:14.820592] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T06:37:15.075497] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T06:37:15.090072] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-17T06:37:15.847418] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T06:37:15.890156] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-17T06:37:16.690135] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-17T06:37:17.490196] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-17T06:37:17.739722] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T06:37:17.769123] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T06:37:17.802602] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-17T06:37:18.290129] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-17T06:37:18.643190] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T06:37:19.090161] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-17T06:37:19.413428] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-17T06:37:19.890191] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-17T06:37:20.690192] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-17T06:37:21.039018] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T06:37:21.490145] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-17T06:37:21.725920] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T06:37:22.290109] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-17T06:37:22.509615] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T06:37:22.642084] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-17T06:37:23.090134] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-17T06:37:23.399946] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-17T06:37:23.890130] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-17T06:37:24.690121] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-17T06:37:24.914699] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T06:37:25.436044] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T06:37:25.490148] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-17T06:37:26.274809] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T06:37:26.290069] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-17T06:37:27.090177] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-17T06:37:27.500902] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T06:37:27.890169] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-17T06:37:28.085747] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T06:37:28.690145] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-17T06:37:28.744550] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T06:37:29.130105] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T06:37:29.490148] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-17T06:37:29.942366] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T06:37:29.943316] [INFO ] [REMOTE ] STG: Full fetch complete (2450 records). [2025-09-17T06:37:29.943425] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-17T06:37:30.131170] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-17T06:37:30.131390] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:37:30.131439] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:37:30.131488] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-17T06:37:30.131558] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-17T06:37:30.131607] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-17T06:37:30.131693] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-17T06:37:30.131798] [INFO ] [MAIN ] Update Progress: 2005/2369 symbols completed. STG took 20.0s. Estimated remaining: 53m 16s. Rate: 6.8 symbols/min [2025-09-17T06:37:30.298163] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-17T06:37:30.300716] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:37:30.310874] [DEBUG] [LOCAL ] STK: Loaded 6525 existing records from primary storage. [2025-09-17T06:37:30.311349] [INFO ] [MAIN ] STK: Loaded 6525 existing records. [2025-09-17T06:37:30.491345] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:37:30.492391] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-17T06:37:30.492454] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-17T06:37:30.493056] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-17T06:37:30.493116] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-17T06:37:30.843157] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:37:31.090188] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-17T06:37:31.260956] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T06:37:31.840306] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T06:37:31.843601] [INFO ] [REMOTE ] STEL: Full fetch complete (32009 records). [2025-09-17T06:37:31.843744] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-17T06:37:31.895301] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-11. [2025-09-17T06:37:32.228256] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-17T06:37:32.228367] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-17T06:37:32.229092] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-17T06:37:32.229149] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-17T06:37:32.229990] [DEBUG] [LOCAL ] STEL: Trimmed 32009 records to 23747 (keeping 200 days of data) [2025-09-17T06:37:32.377269] [DEBUG] [LOCAL ] STEL: Primary data saved (23747 records). [2025-09-17T06:37:32.377433] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-17T06:37:32.377530] [INFO ] [MAIN ] Update Progress: 2006/2369 symbols completed. STEL took 33.6s. Estimated remaining: 53m 6s. Rate: 6.8 symbols/min [2025-09-17T06:37:32.545777] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:37:32.583913] [DEBUG] [LOCAL ] STLA: Loaded 39924 existing records from primary storage. [2025-09-17T06:37:32.584087] [INFO ] [MAIN ] STLA: Loaded 39924 existing records. [2025-09-17T06:37:32.695350] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-17T06:37:32.766907] [WARN ] [MAIN ] STLA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:37:32.767146] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-17T06:37:32.767224] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-17T06:37:32.768018] [DEBUG] [LOCAL ] STLA: Deleted primary data file. [2025-09-17T06:37:32.768089] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-17T06:37:33.126535] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T06:37:33.126228] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:37:33.490136] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-11. [2025-09-17T06:37:33.673467] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T06:37:34.290230] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-09-17T06:37:35.038328] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T06:37:35.090139] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-09-17T06:37:35.768281] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-11 (2.28 seconds). [2025-09-17T06:37:35.831061] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T06:37:35.890150] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-17T06:37:36.344721] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T06:37:36.690251] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-09-17T06:37:37.490195] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-17T06:37:38.290153] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-17T06:37:38.338439] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T06:37:38.848524] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-17T06:37:39.090138] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-09-17T06:37:39.890139] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-17T06:37:39.947043] [DEBUG] [REMOTE ] STLA: Error fetching primary data for 2025-01: ('Connection aborted.', RemoteDisconnected('Remote end closed connection without response')) [2025-09-17T06:37:39.947206] [WARN ] [REMOTE ] STLA: No data returned for month 2025-01 [2025-09-17T06:37:40.033109] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T06:37:40.690161] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-17T06:37:40.721591] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T06:37:41.337785] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T06:37:41.339993] [INFO ] [REMOTE ] STEW: Full fetch complete (22127 records). [2025-09-17T06:37:41.340135] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-17T06:37:41.495294] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-17T06:37:41.733321] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-17T06:37:41.733448] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-17T06:37:41.734217] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-17T06:37:41.734281] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-17T06:37:41.735291] [DEBUG] [LOCAL ] STEW: Trimmed 22127 records to 16424 (keeping 200 days of data) [2025-09-17T06:37:41.843416] [DEBUG] [LOCAL ] STEW: Primary data saved (16424 records). [2025-09-17T06:37:41.843603] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-17T06:37:41.843727] [INFO ] [MAIN ] Update Progress: 2007/2369 symbols completed. STEW took 35.9s. Estimated remaining: 52m 57s. Rate: 6.8 symbols/min [2025-09-17T06:37:42.016006] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:37:42.059580] [DEBUG] [LOCAL ] STM: Loaded 39950 existing records from primary storage. [2025-09-17T06:37:42.059791] [INFO ] [MAIN ] STM: Loaded 39950 existing records. [2025-09-17T06:37:42.237540] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:37:42.237843] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-17T06:37:42.237903] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-17T06:37:42.238734] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-17T06:37:42.238793] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-17T06:37:42.296933] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-17T06:37:42.599486] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:37:43.090116] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-17T06:37:43.360315] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T06:37:43.547039] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-17T06:37:43.890141] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-17T06:37:44.690181] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-11. [2025-09-17T06:37:44.867616] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T06:37:45.490200] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-17T06:37:46.153788] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-17T06:37:46.174486] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T06:37:46.290175] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-17T06:37:46.898036] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-17T06:37:47.090172] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-17T06:37:47.890169] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-17T06:37:48.603183] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-17T06:37:48.645786] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T06:37:48.660846] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T06:37:48.690084] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-17T06:37:49.490134] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-17T06:37:50.290178] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-17T06:37:50.719571] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T06:37:51.047675] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T06:37:51.090156] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-17T06:37:51.127350] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T06:37:51.890133] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-17T06:37:52.690097] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-17T06:37:53.176584] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-17T06:37:53.456443] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T06:37:53.490093] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-09-17T06:37:53.617282] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T06:37:54.290141] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-17T06:37:55.090145] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-17T06:37:55.534927] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T06:37:55.890204] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-09-17T06:37:56.484952] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T06:37:56.573195] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T06:37:56.690112] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-17T06:37:57.490095] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-17T06:37:57.807130] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T06:37:57.810426] [INFO ] [REMOTE ] STEM: Full fetch complete (63153 records). [2025-09-17T06:37:57.810674] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-17T06:37:58.196785] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-17T06:37:58.251125] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-17T06:37:58.251233] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-17T06:37:58.252336] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-17T06:37:58.252407] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-17T06:37:58.253736] [DEBUG] [LOCAL ] STEM: Trimmed 63153 records to 40395 (keeping 200 days of data) [2025-09-17T06:37:58.303381] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-17T06:37:58.493393] [DEBUG] [LOCAL ] STEM: Primary data saved (40395 records). [2025-09-17T06:37:58.493558] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-17T06:37:58.493666] [INFO ] [MAIN ] Update Progress: 2008/2369 symbols completed. STEM took 53.9s. Estimated remaining: 52m 50s. Rate: 6.8 symbols/min [2025-09-17T06:37:58.667099] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:37:58.685062] [DEBUG] [LOCAL ] STN: Loaded 17015 existing records from primary storage. [2025-09-17T06:37:58.685225] [INFO ] [MAIN ] STN: Loaded 17015 existing records. [2025-09-17T06:37:58.865120] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:37:58.865410] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-17T06:37:58.865460] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-17T06:37:58.865980] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-17T06:37:58.866041] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-17T06:37:59.095730] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-17T06:37:59.237048] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:37:59.241360] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T06:37:59.243061] [INFO ] [REMOTE ] STK: Full fetch complete (13741 records). [2025-09-17T06:37:59.243161] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-17T06:37:59.619954] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-17T06:37:59.620184] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-17T06:37:59.620566] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-17T06:37:59.620719] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-17T06:37:59.621450] [DEBUG] [LOCAL ] STK: Trimmed 13741 records to 9356 (keeping 200 days of data) [2025-09-17T06:37:59.713743] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-17T06:37:59.713852] [DEBUG] [LOCAL ] STK: Primary data saved (9356 records). [2025-09-17T06:37:59.714033] [INFO ] [MAIN ] STK: Full history saved. [2025-09-17T06:37:59.725283] [INFO ] [MAIN ] Update Progress: 2009/2369 symbols completed. STK took 29.6s. Estimated remaining: 52m 40s. Rate: 6.8 symbols/min [2025-09-17T06:37:59.896326] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:37:59.896395] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-11. [2025-09-17T06:37:59.929320] [DEBUG] [LOCAL ] STNG: Loaded 32590 existing records from primary storage. [2025-09-17T06:37:59.929507] [INFO ] [MAIN ] STNG: Loaded 32590 existing records. [2025-09-17T06:38:00.108023] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:38:00.108318] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-17T06:38:00.108394] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-17T06:38:00.109160] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-17T06:38:00.109239] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-17T06:38:00.472673] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:38:00.690145] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-11. [2025-09-17T06:38:01.275431] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T06:38:01.307199] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-17T06:38:01.490150] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-17T06:38:02.127317] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T06:38:02.290111] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-09-17T06:38:03.090184] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-17T06:38:03.325003] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T06:38:03.540228] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T06:38:03.890162] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-17T06:38:04.690349] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-09-17T06:38:05.161901] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-17T06:38:05.168355] [INFO ] [REMOTE ] STLA: Full fetch complete (69622 records). [2025-09-17T06:38:05.168519] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-17T06:38:05.366028] [WARN ] [VALIDATOR ] STLA: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T06:38:05.366838] [FATAL] [MAIN ] STLA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:38:05.366916] [WARN ] [MAIN ] STLA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:38:05.366979] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-17T06:38:05.367084] [DEBUG] [LOCAL ] STLA: No primary data file found to delete. [2025-09-17T06:38:05.367149] [INFO ] [LOCAL ] STLA: Starting deletion of derivative data. [2025-09-17T06:38:05.367508] [DEBUG] [LOCAL ] STLA: Deleted derivative data file. [2025-09-17T06:38:05.367665] [INFO ] [MAIN ] Update Progress: 2010/2369 symbols completed. STLA took 33.0s. Estimated remaining: 52m 30s. Rate: 6.8 symbols/min [2025-09-17T06:38:05.495277] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-09-17T06:38:05.543349] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:38:05.554244] [DEBUG] [LOCAL ] STRV: Loaded 7657 existing records from primary storage. [2025-09-17T06:38:05.554785] [INFO ] [MAIN ] STRV: Loaded 7657 existing records. [2025-09-17T06:38:05.734835] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:38:05.735264] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-17T06:38:05.735327] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-17T06:38:05.735637] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-17T06:38:05.735725] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-17T06:38:06.106138] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:38:06.142227] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-17T06:38:06.183412] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T06:38:06.205603] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T06:38:06.290155] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-11. [2025-09-17T06:38:07.059062] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T06:38:07.090136] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-17T06:38:07.890177] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-09-17T06:38:08.690144] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-17T06:38:09.141496] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T06:38:09.186018] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T06:38:09.490159] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-17T06:38:09.735293] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T06:38:10.290133] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-17T06:38:10.994344] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T06:38:11.090130] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-17T06:38:11.437607] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T06:38:11.890142] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-17T06:38:12.690133] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-09-17T06:38:13.023027] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T06:38:13.058337] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T06:38:13.490152] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-17T06:38:13.727882] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T06:38:14.290148] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-17T06:38:15.090186] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-17T06:38:15.464824] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T06:38:15.895315] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-17T06:38:15.907343] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T06:38:16.349110] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T06:38:16.690188] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-17T06:38:17.490156] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-09-17T06:38:17.812434] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T06:38:18.290191] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-17T06:38:18.359230] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T06:38:18.401871] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T06:38:19.090182] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-17T06:38:19.872695] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T06:38:19.890073] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-17T06:38:20.043801] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T06:38:20.050879] [INFO ] [REMOTE ] STM: Full fetch complete (77362 records). [2025-09-17T06:38:20.051109] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-17T06:38:20.465389] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-17T06:38:20.465518] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-17T06:38:20.466763] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-17T06:38:20.466839] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-17T06:38:20.468452] [DEBUG] [LOCAL ] STM: Trimmed 77362 records to 53590 (keeping 200 days of data) [2025-09-17T06:38:20.573016] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T06:38:20.700182] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-17T06:38:20.821088] [DEBUG] [LOCAL ] STM: Primary data saved (53590 records). [2025-09-17T06:38:20.821292] [INFO ] [MAIN ] STM: Full history saved. [2025-09-17T06:38:20.821414] [INFO ] [MAIN ] Update Progress: 2011/2369 symbols completed. STM took 39.0s. Estimated remaining: 52m 23s. Rate: 6.8 symbols/min [2025-09-17T06:38:20.993881] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:38:20.994126] [DEBUG] [LOCAL ] STT: No existing data file found in primary storage. [2025-09-17T06:38:20.994177] [WARN ] [MAIN ] STT: No existing data found, performing full refresh instead. [2025-09-17T06:38:20.994293] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-17T06:38:20.994338] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-17T06:38:20.994380] [DEBUG] [LOCAL ] STT: No primary data file found to delete. [2025-09-17T06:38:20.994428] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-17T06:38:21.346760] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:38:21.490131] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-11. [2025-09-17T06:38:21.769866] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T06:38:22.290197] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-17T06:38:23.090150] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-17T06:38:23.279685] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T06:38:23.631475] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-11 (2.14 seconds). [2025-09-17T06:38:23.890104] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-17T06:38:24.206255] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T06:38:24.690190] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-17T06:38:24.766140] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T06:38:25.490191] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-17T06:38:25.865098] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T06:38:26.290150] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-09-17T06:38:26.784576] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T06:38:27.090171] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-17T06:38:27.890111] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-17T06:38:27.948896] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T06:38:28.612035] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T06:38:28.666474] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T06:38:28.690084] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-17T06:38:29.490191] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-17T06:38:30.211688] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T06:38:30.290145] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-17T06:38:30.479955] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T06:38:30.483012] [INFO ] [REMOTE ] STN: Full fetch complete (32094 records). [2025-09-17T06:38:30.483124] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-17T06:38:30.856804] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-17T06:38:30.856976] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-17T06:38:30.857604] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-17T06:38:30.857682] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-17T06:38:30.858488] [DEBUG] [LOCAL ] STN: Trimmed 32094 records to 23240 (keeping 200 days of data) [2025-09-17T06:38:31.002526] [DEBUG] [LOCAL ] STN: Primary data saved (23240 records). [2025-09-17T06:38:31.002700] [INFO ] [MAIN ] STN: Full history saved. [2025-09-17T06:38:31.002822] [INFO ] [MAIN ] Update Progress: 2012/2369 symbols completed. STN took 32.5s. Estimated remaining: 52m 14s. Rate: 6.8 symbols/min [2025-09-17T06:38:31.095216] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-09-17T06:38:31.176702] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:38:31.195793] [DEBUG] [LOCAL ] STVN: Loaded 19497 existing records from primary storage. [2025-09-17T06:38:31.195988] [INFO ] [MAIN ] STVN: Loaded 19497 existing records. [2025-09-17T06:38:31.382961] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:38:31.383369] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-17T06:38:31.383449] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-17T06:38:31.384013] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-17T06:38:31.384107] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-17T06:38:31.778765] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:38:31.805905] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T06:38:31.890097] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-17T06:38:32.690183] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-11. [2025-09-17T06:38:32.885856] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T06:38:33.400854] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T06:38:33.406871] [INFO ] [REMOTE ] STNG: Full fetch complete (64301 records). [2025-09-17T06:38:33.407051] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-17T06:38:33.497764] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-17T06:38:33.799795] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-17T06:38:33.799901] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-17T06:38:33.800918] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-17T06:38:33.800997] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-17T06:38:33.802391] [DEBUG] [LOCAL ] STNG: Trimmed 64301 records to 44153 (keeping 200 days of data) [2025-09-17T06:38:34.081238] [DEBUG] [LOCAL ] STNG: Primary data saved (44153 records). [2025-09-17T06:38:34.082322] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-17T06:38:34.082523] [INFO ] [MAIN ] Update Progress: 2013/2369 symbols completed. STNG took 34.4s. Estimated remaining: 52m 4s. Rate: 6.8 symbols/min [2025-09-17T06:38:34.183279] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T06:38:34.284241] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:38:34.290103] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-17T06:38:34.325186] [DEBUG] [LOCAL ] STWD: Loaded 38509 existing records from primary storage. [2025-09-17T06:38:34.325393] [INFO ] [MAIN ] STWD: Loaded 38509 existing records. [2025-09-17T06:38:34.493174] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T06:38:34.512694] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:38:34.514947] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-17T06:38:34.515028] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-17T06:38:34.515837] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-17T06:38:34.515913] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-17T06:38:34.865462] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:38:35.090136] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-17T06:38:35.865349] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T06:38:35.890090] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-17T06:38:35.903208] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T06:38:36.690136] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-17T06:38:37.449495] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T06:38:37.451313] [INFO ] [REMOTE ] STRV: Full fetch complete (18735 records). [2025-09-17T06:38:37.451432] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-17T06:38:37.495285] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-09-17T06:38:37.840471] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-17T06:38:37.840716] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-17T06:38:37.841397] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-17T06:38:37.841566] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-17T06:38:37.842577] [DEBUG] [LOCAL ] STRV: Trimmed 18735 records to 11753 (keeping 200 days of data) [2025-09-17T06:38:37.928296] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T06:38:37.958902] [DEBUG] [LOCAL ] STRV: Primary data saved (11753 records). [2025-09-17T06:38:37.959042] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-17T06:38:37.959184] [INFO ] [MAIN ] Update Progress: 2014/2369 symbols completed. STRV took 32.6s. Estimated remaining: 51m 55s. Rate: 6.8 symbols/min [2025-09-17T06:38:38.126176] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:38:38.128683] [DEBUG] [LOCAL ] STXD: Loaded 811 existing records from primary storage. [2025-09-17T06:38:38.128789] [INFO ] [MAIN ] STXD: Loaded 811 existing records. [2025-09-17T06:38:38.293394] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-17T06:38:38.314714] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:38:38.315764] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-17T06:38:38.315851] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-17T06:38:38.316108] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-17T06:38:38.316189] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-17T06:38:38.637614] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T06:38:38.717982] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:38:39.090144] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-09-17T06:38:39.890176] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-11. [2025-09-17T06:38:40.147999] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T06:38:40.399990] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T06:38:40.690196] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-11. [2025-09-17T06:38:41.197676] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T06:38:41.490122] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-17T06:38:41.696597] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T06:38:42.290213] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-09-17T06:38:43.090124] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-17T06:38:43.161851] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T06:38:43.890107] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-09-17T06:38:43.983926] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T06:38:44.047589] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T06:38:44.324589] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T06:38:44.690120] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-17T06:38:45.490172] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-09-17T06:38:45.796546] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T06:38:45.966227] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T06:38:46.290139] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-17T06:38:47.090142] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-09-17T06:38:47.890155] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-17T06:38:47.921958] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T06:38:48.330985] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T06:38:48.690141] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-17T06:38:48.896116] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T06:38:49.123308] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-17T06:38:49.490135] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-17T06:38:49.924575] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T06:38:50.290132] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-17T06:38:50.689601] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-17T06:38:51.090162] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-17T06:38:51.890111] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-17T06:38:52.228764] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T06:38:52.690125] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-17T06:38:53.490188] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-17T06:38:53.544586] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T06:38:54.290201] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-17T06:38:54.536683] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T06:38:54.579858] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-17T06:38:54.953024] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T06:38:55.090148] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-17T06:38:55.890184] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-17T06:38:56.237281] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T06:38:56.255434] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T06:38:56.690142] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-17T06:38:57.007706] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-17T06:38:57.490166] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-17T06:38:58.290161] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-17T06:38:59.090181] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-17T06:38:59.189330] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T06:38:59.425282] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T06:38:59.457103] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T06:38:59.457954] [INFO ] [REMOTE ] STXD: Full fetch complete (2049 records). [2025-09-17T06:38:59.458076] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-17T06:38:59.844965] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-17T06:38:59.845071] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-17T06:38:59.845183] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-17T06:38:59.845228] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-17T06:38:59.845559] [DEBUG] [LOCAL ] STXD: Trimmed 2049 records to 1330 (keeping 200 days of data) [2025-09-17T06:38:59.854312] [DEBUG] [LOCAL ] STXD: Primary data saved (1330 records). [2025-09-17T06:38:59.854383] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-17T06:38:59.854479] [INFO ] [MAIN ] Update Progress: 2015/2369 symbols completed. STXD took 21.9s. Estimated remaining: 51m 48s. Rate: 6.8 symbols/min [2025-09-17T06:38:59.895343] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-17T06:39:00.028372] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:39:00.032338] [DEBUG] [LOCAL ] STXE: Loaded 1425 existing records from primary storage. [2025-09-17T06:39:00.032427] [INFO ] [MAIN ] STXE: Loaded 1425 existing records. [2025-09-17T06:39:00.213530] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:39:00.213923] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-17T06:39:00.214037] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-17T06:39:00.214408] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-17T06:39:00.214491] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-17T06:39:00.564772] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:39:00.690124] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-17T06:39:01.201472] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T06:39:01.490195] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-17T06:39:02.290138] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-17T06:39:02.725115] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-17T06:39:02.732123] [INFO ] [REMOTE ] STT: Full fetch complete (74599 records). [2025-09-17T06:39:02.732367] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-17T06:39:03.106825] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-11. [2025-09-17T06:39:03.130207] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-09-17T06:39:03.130952] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-09-17T06:39:03.132153] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-09-17T06:39:03.132320] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-09-17T06:39:03.133956] [DEBUG] [LOCAL ] STT: Trimmed 74599 records to 51275 (keeping 200 days of data) [2025-09-17T06:39:03.462189] [DEBUG] [LOCAL ] STT: Primary data saved (51275 records). [2025-09-17T06:39:03.462379] [INFO ] [MAIN ] STT: Full history saved. [2025-09-17T06:39:03.462494] [INFO ] [MAIN ] Update Progress: 2016/2369 symbols completed. STT took 42.6s. Estimated remaining: 51m 39s. Rate: 6.8 symbols/min [2025-09-17T06:39:03.636744] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:39:03.640080] [DEBUG] [LOCAL ] STXG: Loaded 1492 existing records from primary storage. [2025-09-17T06:39:03.640198] [INFO ] [MAIN ] STXG: Loaded 1492 existing records. [2025-09-17T06:39:03.819766] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:39:03.820011] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-17T06:39:03.820061] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-17T06:39:03.820332] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-17T06:39:03.820388] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-17T06:39:04.131376] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (2.64 seconds). [2025-09-17T06:39:04.131657] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T06:39:04.133838] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-09-17T06:39:04.159123] [INFO ] [REMOTE ] STVN: Full fetch complete (39426 records). [2025-09-17T06:39:04.200059] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-17T06:39:04.222745] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:39:04.616564] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-17T06:39:04.616787] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-17T06:39:04.618117] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-17T06:39:04.618267] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-17T06:39:04.620676] [DEBUG] [LOCAL ] STVN: Trimmed 39426 records to 26636 (keeping 200 days of data) [2025-09-17T06:39:04.714014] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-11. [2025-09-17T06:39:04.760534] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-17T06:39:04.791327] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T06:39:04.860089] [DEBUG] [LOCAL ] STVN: Primary data saved (26636 records). [2025-09-17T06:39:04.860278] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-17T06:39:04.860397] [INFO ] [MAIN ] Update Progress: 2017/2369 symbols completed. STVN took 33.9s. Estimated remaining: 51m 29s. Rate: 6.8 symbols/min [2025-09-17T06:39:05.034193] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:39:05.037028] [DEBUG] [LOCAL ] STXK: Loaded 959 existing records from primary storage. [2025-09-17T06:39:05.037121] [INFO ] [MAIN ] STXK: Loaded 959 existing records. [2025-09-17T06:39:05.219024] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:39:05.219343] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-17T06:39:05.219423] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-17T06:39:05.219733] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-17T06:39:05.219808] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-17T06:39:05.325444] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T06:39:05.495266] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-09-17T06:39:05.587806] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:39:06.021583] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T06:39:06.290133] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-17T06:39:06.736081] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T06:39:07.090139] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-11. [2025-09-17T06:39:07.676353] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T06:39:07.890123] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-09-17T06:39:08.435226] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T06:39:08.690123] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-17T06:39:09.219138] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T06:39:09.490151] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-09-17T06:39:10.025405] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T06:39:10.290147] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-17T06:39:11.090151] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-09-17T06:39:11.517948] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T06:39:11.890139] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-09-17T06:39:12.161329] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T06:39:12.331857] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T06:39:12.690144] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-17T06:39:13.490192] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-17T06:39:13.952164] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T06:39:14.290175] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-17T06:39:14.413330] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T06:39:14.769065] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T06:39:15.090129] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-17T06:39:15.553188] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T06:39:15.890171] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-17T06:39:16.690203] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-17T06:39:17.200277] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T06:39:17.490201] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-17T06:39:17.760385] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T06:39:18.290128] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-17T06:39:19.046980] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T06:39:19.090095] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-17T06:39:19.367376] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-17T06:39:19.890143] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-17T06:39:20.130910] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T06:39:20.325885] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T06:39:20.690129] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-17T06:39:21.122092] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T06:39:21.490141] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-17T06:39:21.985476] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T06:39:22.290172] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-17T06:39:22.705515] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T06:39:23.090141] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-17T06:39:23.509042] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T06:39:23.890142] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-17T06:39:24.319402] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T06:39:24.320309] [INFO ] [REMOTE ] STXE: Full fetch complete (3725 records). [2025-09-17T06:39:24.320391] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-17T06:39:24.677441] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-17T06:39:24.677543] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-17T06:39:24.677717] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-17T06:39:24.677798] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-17T06:39:24.678263] [DEBUG] [LOCAL ] STXE: Trimmed 3725 records to 2282 (keeping 200 days of data) [2025-09-17T06:39:24.690085] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-17T06:39:24.694182] [DEBUG] [LOCAL ] STXE: Primary data saved (2282 records). [2025-09-17T06:39:24.694275] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-17T06:39:24.694399] [INFO ] [MAIN ] Update Progress: 2018/2369 symbols completed. STXE took 24.8s. Estimated remaining: 51m 22s. Rate: 6.8 symbols/min [2025-09-17T06:39:24.864990] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:39:24.865202] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-17T06:39:24.865270] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-17T06:39:24.865411] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-17T06:39:24.865488] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-17T06:39:24.865558] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-17T06:39:24.865624] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-17T06:39:25.146033] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T06:39:25.224269] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:39:25.490116] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-11. [2025-09-17T06:39:25.923939] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T06:39:26.290139] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-17T06:39:26.726704] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T06:39:27.090183] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-17T06:39:27.646767] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T06:39:27.890157] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-17T06:39:28.498814] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T06:39:28.499596] [INFO ] [REMOTE ] STXK: Full fetch complete (2451 records). [2025-09-17T06:39:28.499711] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-17T06:39:28.697052] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-17T06:39:28.867945] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-17T06:39:28.868151] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-17T06:39:28.868304] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-17T06:39:28.868375] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-17T06:39:28.868812] [DEBUG] [LOCAL ] STXK: Trimmed 2451 records to 1518 (keeping 200 days of data) [2025-09-17T06:39:28.878602] [DEBUG] [LOCAL ] STXK: Primary data saved (1518 records). [2025-09-17T06:39:28.878694] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-17T06:39:28.878779] [INFO ] [MAIN ] Update Progress: 2019/2369 symbols completed. STXK took 24.0s. Estimated remaining: 51m 12s. Rate: 6.8 symbols/min [2025-09-17T06:39:29.054097] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:39:29.057912] [DEBUG] [LOCAL ] STXT: Loaded 1919 existing records from primary storage. [2025-09-17T06:39:29.058020] [INFO ] [MAIN ] STXT: Loaded 1919 existing records. [2025-09-17T06:39:29.238077] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:39:29.238336] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-17T06:39:29.238400] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-17T06:39:29.238608] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-17T06:39:29.238687] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-17T06:39:29.494269] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-17T06:39:29.529218] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T06:39:29.619366] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:39:30.290134] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-17T06:39:30.736494] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T06:39:31.090177] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-11. [2025-09-17T06:39:31.294412] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T06:39:31.708035] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T06:39:31.890161] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-09-17T06:39:32.529779] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T06:39:32.690121] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-17T06:39:33.099332] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-17T06:39:33.490128] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-17T06:39:33.855099] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T06:39:34.290194] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-17T06:39:34.706518] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T06:39:35.090164] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-09-17T06:39:35.628687] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T06:39:35.890164] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-17T06:39:36.231823] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-17T06:39:36.690146] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-17T06:39:37.204895] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T06:39:37.490159] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-17T06:39:37.963353] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T06:39:38.290153] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-17T06:39:38.715711] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T06:39:39.090153] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-17T06:39:39.515067] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T06:39:39.890225] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-17T06:39:40.690178] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-17T06:39:41.030937] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T06:39:41.490192] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-17T06:39:41.529095] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T06:39:41.535957] [INFO ] [REMOTE ] STWD: Full fetch complete (74729 records). [2025-09-17T06:39:41.536162] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-17T06:39:41.850462] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-17T06:39:41.965929] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-17T06:39:41.966122] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-17T06:39:41.967457] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-17T06:39:41.967538] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-17T06:39:41.969283] [DEBUG] [LOCAL ] STWD: Trimmed 74729 records to 51905 (keeping 200 days of data) [2025-09-17T06:39:42.290264] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-17T06:39:42.308054] [DEBUG] [LOCAL ] STWD: Primary data saved (51905 records). [2025-09-17T06:39:42.308916] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-17T06:39:42.309200] [INFO ] [MAIN ] Update Progress: 2020/2369 symbols completed. STWD took 1m 8s. Estimated remaining: 51m 4s. Rate: 6.8 symbols/min [2025-09-17T06:39:42.476622] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:39:42.479869] [DEBUG] [LOCAL ] STXV: Loaded 1101 existing records from primary storage. [2025-09-17T06:39:42.479962] [INFO ] [MAIN ] STXV: Loaded 1101 existing records. [2025-09-17T06:39:42.642275] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T06:39:42.661227] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:39:42.662626] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-17T06:39:42.662719] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-17T06:39:42.662987] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-17T06:39:42.663047] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-17T06:39:43.014743] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:39:43.090107] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-11. [2025-09-17T06:39:43.612911] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T06:39:43.890152] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-17T06:39:44.227544] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-17T06:39:44.690138] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-17T06:39:45.064209] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T06:39:45.065028] [INFO ] [REMOTE ] STXM: Full fetch complete (1466 records). [2025-09-17T06:39:45.065128] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-17T06:39:45.241158] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T06:39:45.241425] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:39:45.241495] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:39:45.241555] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-17T06:39:45.241639] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-17T06:39:45.241728] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-17T06:39:45.241815] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-17T06:39:45.241908] [INFO ] [MAIN ] Update Progress: 2021/2369 symbols completed. STXM took 20.5s. Estimated remaining: 50m 54s. Rate: 6.8 symbols/min [2025-09-17T06:39:45.432327] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:39:45.476321] [DEBUG] [LOCAL ] STZ: Loaded 38935 existing records from primary storage. [2025-09-17T06:39:45.476524] [INFO ] [MAIN ] STZ: Loaded 38935 existing records. [2025-09-17T06:39:45.497884] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-17T06:39:45.719936] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:39:45.720275] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-17T06:39:45.720340] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-17T06:39:45.721424] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-17T06:39:45.721496] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-17T06:39:46.085795] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T06:39:46.107378] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:39:46.290169] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-11. [2025-09-17T06:39:47.090178] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-17T06:39:47.538897] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T06:39:47.890226] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-17T06:39:48.065210] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T06:39:48.334681] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T06:39:48.342117] [INFO ] [REMOTE ] STXG: Full fetch complete (4221 records). [2025-09-17T06:39:48.345924] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-17T06:39:48.695456] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-09-17T06:39:48.812196] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-17T06:39:48.812315] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-17T06:39:48.812513] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-17T06:39:48.812567] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-17T06:39:48.812995] [DEBUG] [LOCAL ] STXG: Trimmed 4221 records to 2663 (keeping 200 days of data) [2025-09-17T06:39:48.831702] [DEBUG] [LOCAL ] STXG: Primary data saved (2663 records). [2025-09-17T06:39:48.831864] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-17T06:39:48.831966] [INFO ] [MAIN ] Update Progress: 2022/2369 symbols completed. STXG took 45.4s. Estimated remaining: 50m 45s. Rate: 6.8 symbols/min [2025-09-17T06:39:49.011737] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:39:49.061198] [DEBUG] [LOCAL ] SU: Loaded 39838 existing records from primary storage. [2025-09-17T06:39:49.061379] [INFO ] [MAIN ] SU: Loaded 39838 existing records. [2025-09-17T06:39:49.250806] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:39:49.251129] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-17T06:39:49.251192] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-17T06:39:49.252120] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-17T06:39:49.252195] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-17T06:39:49.501770] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-17T06:39:49.630042] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:39:50.000315] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T06:39:50.290146] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-09-17T06:39:50.547080] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T06:39:50.725030] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T06:39:51.090177] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-09-17T06:39:51.509227] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T06:39:51.890148] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-17T06:39:52.318198] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T06:39:52.690137] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-17T06:39:53.138001] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T06:39:53.490179] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-09-17T06:39:54.290153] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-17T06:39:54.831268] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T06:39:55.090170] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-17T06:39:55.376917] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T06:39:55.471683] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-17T06:39:55.890155] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-17T06:39:56.333160] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T06:39:56.690143] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-17T06:39:57.490152] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-17T06:39:57.923688] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T06:39:58.290217] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-11. [2025-09-17T06:39:58.635403] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T06:39:59.090199] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-17T06:39:59.890160] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-17T06:40:00.359148] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T06:40:00.393896] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T06:40:00.690112] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-17T06:40:01.167773] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T06:40:01.276182] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T06:40:01.277264] [INFO ] [REMOTE ] STXT: Full fetch complete (4079 records). [2025-09-17T06:40:01.277359] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-17T06:40:01.498144] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-09-17T06:40:01.658525] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-17T06:40:01.658755] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-17T06:40:01.658989] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-17T06:40:01.659076] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-17T06:40:01.659766] [DEBUG] [LOCAL ] STXT: Trimmed 4079 records to 2625 (keeping 200 days of data) [2025-09-17T06:40:01.678474] [DEBUG] [LOCAL ] STXT: Primary data saved (2625 records). [2025-09-17T06:40:01.678683] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-17T06:40:01.678809] [INFO ] [MAIN ] Update Progress: 2023/2369 symbols completed. STXT took 32.8s. Estimated remaining: 50m 37s. Rate: 6.8 symbols/min [2025-09-17T06:40:01.857400] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:40:01.896937] [DEBUG] [LOCAL ] SUI: Loaded 31654 existing records from primary storage. [2025-09-17T06:40:01.897164] [INFO ] [MAIN ] SUI: Loaded 31654 existing records. [2025-09-17T06:40:02.092313] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:40:02.092671] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-17T06:40:02.092751] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-17T06:40:02.093565] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-17T06:40:02.093639] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-17T06:40:02.296810] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-17T06:40:02.465239] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:40:02.825612] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T06:40:03.090099] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-17T06:40:03.519809] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T06:40:03.890127] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-09-17T06:40:04.690178] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-17T06:40:04.981766] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T06:40:05.078005] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-17T06:40:05.235454] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T06:40:05.490130] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-17T06:40:05.919171] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T06:40:06.290147] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-17T06:40:07.090132] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-17T06:40:07.890159] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-11. [2025-09-17T06:40:08.271880] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T06:40:08.690112] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-17T06:40:08.729293] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T06:40:09.407084] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T06:40:09.490136] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-17T06:40:09.882220] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-17T06:40:10.290163] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-09-17T06:40:10.754032] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T06:40:11.090135] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-17T06:40:11.532738] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T06:40:11.890144] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-17T06:40:12.690192] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-09-17T06:40:12.922046] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T06:40:13.490136] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-17T06:40:13.709916] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T06:40:14.214092] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T06:40:14.290122] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-17T06:40:15.090112] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-17T06:40:15.155139] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T06:40:15.156089] [INFO ] [REMOTE ] STXV: Full fetch complete (2662 records). [2025-09-17T06:40:15.156179] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-17T06:40:15.518619] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-17T06:40:15.518745] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-17T06:40:15.518965] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-17T06:40:15.519104] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-17T06:40:15.519558] [DEBUG] [LOCAL ] STXV: Trimmed 2662 records to 1694 (keeping 200 days of data) [2025-09-17T06:40:15.531381] [DEBUG] [LOCAL ] STXV: Primary data saved (1694 records). [2025-09-17T06:40:15.531477] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-17T06:40:15.531725] [INFO ] [MAIN ] Update Progress: 2024/2369 symbols completed. STXV took 33.2s. Estimated remaining: 50m 29s. Rate: 6.8 symbols/min [2025-09-17T06:40:15.740367] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:40:15.742518] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-17T06:40:15.785112] [DEBUG] [LOCAL ] SUN: Loaded 28477 existing records from primary storage. [2025-09-17T06:40:15.785290] [INFO ] [MAIN ] SUN: Loaded 28477 existing records. [2025-09-17T06:40:15.890692] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-17T06:40:15.970603] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:40:15.970891] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-17T06:40:15.970964] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-17T06:40:15.971701] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-17T06:40:15.971778] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-17T06:40:16.328822] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:40:16.690169] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-11. [2025-09-17T06:40:16.834939] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T06:40:17.490136] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-17T06:40:17.986975] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-17T06:40:17.997419] [INFO ] [REMOTE ] STZ: Full fetch complete (75488 records). [2025-09-17T06:40:17.997693] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-17T06:40:18.121259] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T06:40:18.301248] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-17T06:40:18.438634] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-17T06:40:18.438764] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-17T06:40:18.439866] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-17T06:40:18.439925] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-17T06:40:18.441399] [DEBUG] [LOCAL ] STZ: Trimmed 75488 records to 52271 (keeping 200 days of data) [2025-09-17T06:40:18.771318] [DEBUG] [LOCAL ] STZ: Primary data saved (52271 records). [2025-09-17T06:40:18.771465] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-17T06:40:18.771557] [INFO ] [MAIN ] Update Progress: 2025/2369 symbols completed. STZ took 33.5s. Estimated remaining: 50m 19s. Rate: 6.8 symbols/min [2025-09-17T06:40:18.944724] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:40:18.978885] [DEBUG] [LOCAL ] SUPV: Loaded 35144 existing records from primary storage. [2025-09-17T06:40:18.979055] [INFO ] [MAIN ] SUPV: Loaded 35144 existing records. [2025-09-17T06:40:19.095227] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-17T06:40:19.159033] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:40:19.159521] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-17T06:40:19.159779] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-17T06:40:19.160491] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-17T06:40:19.160565] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-17T06:40:19.544169] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T06:40:19.548149] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:40:19.798367] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T06:40:19.890114] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-17T06:40:20.510387] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T06:40:20.690132] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-17T06:40:21.261414] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T06:40:21.490156] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-17T06:40:21.835612] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T06:40:22.290174] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-11. [2025-09-17T06:40:23.008808] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T06:40:23.090093] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-17T06:40:23.834056] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T06:40:23.890133] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-17T06:40:24.695258] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-17T06:40:24.710808] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T06:40:25.490156] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-09-17T06:40:25.687536] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T06:40:26.194973] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T06:40:26.290182] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-17T06:40:26.827323] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T06:40:27.090159] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-17T06:40:27.811113] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T06:40:27.890134] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-17T06:40:28.291659] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T06:40:28.690151] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-09-17T06:40:29.490136] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-17T06:40:29.725351] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T06:40:30.295302] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-17T06:40:30.311491] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T06:40:31.042475] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T06:40:31.090085] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-17T06:40:31.729063] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T06:40:31.890168] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-17T06:40:32.684035] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T06:40:32.693497] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-17T06:40:33.409142] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T06:40:33.490118] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-17T06:40:34.227458] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T06:40:34.290115] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-17T06:40:34.996147] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T06:40:35.001770] [INFO ] [REMOTE ] SUI: Full fetch complete (61099 records). [2025-09-17T06:40:35.001947] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-17T06:40:35.096978] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-17T06:40:35.400414] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-17T06:40:35.400516] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-17T06:40:35.401492] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-17T06:40:35.401549] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-17T06:40:35.402848] [DEBUG] [LOCAL ] SUI: Trimmed 61099 records to 42301 (keeping 200 days of data) [2025-09-17T06:40:35.666665] [DEBUG] [LOCAL ] SUI: Primary data saved (42301 records). [2025-09-17T06:40:35.666829] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-17T06:40:35.666919] [INFO ] [MAIN ] Update Progress: 2026/2369 symbols completed. SUI took 34.0s. Estimated remaining: 50m 12s. Rate: 6.8 symbols/min [2025-09-17T06:40:35.836952] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:40:35.864611] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T06:40:35.897778] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-17T06:40:35.899499] [DEBUG] [LOCAL ] SUZ: Loaded 33932 existing records from primary storage. [2025-09-17T06:40:35.900407] [INFO ] [MAIN ] SUZ: Loaded 33932 existing records. [2025-09-17T06:40:36.098620] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:40:36.098891] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-17T06:40:36.098963] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-17T06:40:36.099770] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-17T06:40:36.099842] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-17T06:40:36.457243] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:40:36.532262] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T06:40:36.690138] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-17T06:40:37.490193] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-11. [2025-09-17T06:40:37.747844] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T06:40:37.755143] [INFO ] [REMOTE ] SU: Full fetch complete (77264 records). [2025-09-17T06:40:37.755432] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-17T06:40:38.115207] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T06:40:38.220514] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-17T06:40:38.220621] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-17T06:40:38.221708] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-17T06:40:38.221767] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-17T06:40:38.223338] [DEBUG] [LOCAL ] SU: Trimmed 77264 records to 53474 (keeping 200 days of data) [2025-09-17T06:40:38.294758] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-17T06:40:38.568392] [DEBUG] [LOCAL ] SU: Primary data saved (53474 records). [2025-09-17T06:40:38.568583] [INFO ] [MAIN ] SU: Full history saved. [2025-09-17T06:40:38.568715] [INFO ] [MAIN ] Update Progress: 2027/2369 symbols completed. SU took 49.7s. Estimated remaining: 50m 2s. Rate: 6.8 symbols/min [2025-09-17T06:40:38.737078] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:40:38.764852] [DEBUG] [LOCAL ] SVV: Loaded 28638 existing records from primary storage. [2025-09-17T06:40:38.765033] [INFO ] [MAIN ] SVV: Loaded 28638 existing records. [2025-09-17T06:40:38.940185] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:40:38.940408] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-17T06:40:38.940468] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-17T06:40:38.941052] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-17T06:40:38.941112] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-17T06:40:39.100335] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-17T06:40:39.299510] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:40:39.329993] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T06:40:39.483267] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T06:40:39.890146] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-17T06:40:40.690215] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-11. [2025-09-17T06:40:40.822180] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T06:40:41.317756] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T06:40:41.328523] [INFO ] [REMOTE ] SUN: Full fetch complete (54076 records). [2025-09-17T06:40:41.328845] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-17T06:40:41.495379] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-17T06:40:41.832598] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-17T06:40:41.832834] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-17T06:40:41.835236] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-17T06:40:41.835367] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-17T06:40:41.837198] [DEBUG] [LOCAL ] SUN: Trimmed 54076 records to 37234 (keeping 200 days of data) [2025-09-17T06:40:42.078800] [DEBUG] [LOCAL ] SUN: Primary data saved (37234 records). [2025-09-17T06:40:42.078969] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-17T06:40:42.079120] [INFO ] [MAIN ] Update Progress: 2028/2369 symbols completed. SUN took 26.5s. Estimated remaining: 49m 52s. Rate: 6.8 symbols/min [2025-09-17T06:40:42.252932] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:40:42.275442] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T06:40:42.290086] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-09-17T06:40:42.316345] [DEBUG] [LOCAL ] SW: Loaded 39567 existing records from primary storage. [2025-09-17T06:40:42.316499] [INFO ] [MAIN ] SW: Loaded 39567 existing records. [2025-09-17T06:40:42.538096] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:40:42.538427] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-17T06:40:42.538505] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-17T06:40:42.539376] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-17T06:40:42.539469] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-17T06:40:42.928743] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:40:42.996411] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T06:40:43.090123] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-17T06:40:43.658983] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T06:40:43.890160] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-09-17T06:40:44.616420] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T06:40:44.690114] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-17T06:40:45.260410] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T06:40:45.490192] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-17T06:40:46.289880] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T06:40:46.299055] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-09-17T06:40:46.784395] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T06:40:47.090162] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-17T06:40:47.584488] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T06:40:47.890145] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-17T06:40:48.690147] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-11. [2025-09-17T06:40:48.812919] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T06:40:49.365352] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T06:40:49.490169] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-17T06:40:50.290152] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-09-17T06:40:50.412377] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T06:40:51.074730] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T06:40:51.090080] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-17T06:40:51.868147] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T06:40:51.890127] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-09-17T06:40:52.690126] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-17T06:40:52.755586] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T06:40:52.761834] [INFO ] [REMOTE ] SUPV: Full fetch complete (67910 records). [2025-09-17T06:40:52.761968] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-17T06:40:53.152003] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-17T06:40:53.152148] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-17T06:40:53.153225] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-17T06:40:53.153288] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-17T06:40:53.154732] [DEBUG] [LOCAL ] SUPV: Trimmed 67910 records to 46933 (keeping 200 days of data) [2025-09-17T06:40:53.445225] [DEBUG] [LOCAL ] SUPV: Primary data saved (46933 records). [2025-09-17T06:40:53.445415] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-17T06:40:53.445584] [INFO ] [MAIN ] Update Progress: 2029/2369 symbols completed. SUPV took 34.7s. Estimated remaining: 49m 44s. Rate: 6.8 symbols/min [2025-09-17T06:40:53.500527] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-17T06:40:53.623909] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:40:53.661806] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T06:40:53.712990] [DEBUG] [LOCAL ] SWK: Loaded 39239 existing records from primary storage. [2025-09-17T06:40:53.713163] [INFO ] [MAIN ] SWK: Loaded 39239 existing records. [2025-09-17T06:40:53.888720] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:40:53.888979] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-17T06:40:53.889052] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-17T06:40:53.889935] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-17T06:40:53.890007] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-17T06:40:54.243074] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:40:54.272780] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T06:40:54.290087] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-17T06:40:55.090178] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-11. [2025-09-17T06:40:55.158604] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T06:40:55.889753] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T06:40:55.899252] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-09-17T06:40:56.330610] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T06:40:56.690133] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-17T06:40:57.490147] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-09-17T06:40:57.665931] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T06:40:57.952959] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T06:40:58.290137] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-17T06:40:59.090149] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-17T06:40:59.298262] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T06:40:59.890174] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-17T06:41:00.095522] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T06:41:00.227619] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T06:41:00.690187] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-17T06:41:00.900706] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T06:41:01.490132] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-17T06:41:02.290253] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-17T06:41:02.519906] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T06:41:03.090165] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-17T06:41:03.120090] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T06:41:03.319230] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T06:41:03.890183] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-09-17T06:41:04.690119] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-17T06:41:05.079530] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T06:41:05.490189] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-17T06:41:05.630717] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T06:41:06.130201] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T06:41:06.136389] [INFO ] [REMOTE ] SVV: Full fetch complete (55351 records). [2025-09-17T06:41:06.136551] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-17T06:41:06.295534] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-17T06:41:06.525751] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-17T06:41:06.525857] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-17T06:41:06.526899] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-17T06:41:06.526977] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-17T06:41:06.528270] [DEBUG] [LOCAL ] SVV: Trimmed 55351 records to 39392 (keeping 200 days of data) [2025-09-17T06:41:06.759341] [DEBUG] [LOCAL ] SVV: Primary data saved (39392 records). [2025-09-17T06:41:06.759538] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-17T06:41:06.759667] [INFO ] [MAIN ] Update Progress: 2030/2369 symbols completed. SVV took 28.2s. Estimated remaining: 49m 36s. Rate: 6.8 symbols/min [2025-09-17T06:41:06.928913] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:41:06.950677] [DEBUG] [LOCAL ] SWX: Loaded 23297 existing records from primary storage. [2025-09-17T06:41:06.950835] [INFO ] [MAIN ] SWX: Loaded 23297 existing records. [2025-09-17T06:41:07.102226] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-17T06:41:07.132325] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:41:07.133671] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-17T06:41:07.133828] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-17T06:41:07.134599] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-17T06:41:07.134752] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-17T06:41:07.309784] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T06:41:07.532158] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:41:07.890175] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-11. [2025-09-17T06:41:08.224039] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T06:41:08.618272] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T06:41:08.690102] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-09-17T06:41:08.783739] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T06:41:09.490129] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-17T06:41:09.922588] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T06:41:10.290134] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-17T06:41:10.943774] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T06:41:11.090112] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-17T06:41:11.831375] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T06:41:11.890131] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-17T06:41:12.571065] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T06:41:12.690175] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-09-17T06:41:13.490150] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-17T06:41:13.537373] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T06:41:13.928797] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T06:41:14.290144] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-17T06:41:15.090131] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-17T06:41:15.203024] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T06:41:15.230505] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T06:41:15.890141] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-17T06:41:16.460352] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T06:41:16.690130] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-17T06:41:16.817318] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T06:41:17.490144] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-17T06:41:18.290144] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-17T06:41:18.646835] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T06:41:18.677318] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T06:41:18.682949] [INFO ] [REMOTE ] SUZ: Full fetch complete (67216 records). [2025-09-17T06:41:18.683114] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-17T06:41:19.084723] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-17T06:41:19.084839] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-17T06:41:19.089280] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-17T06:41:19.089485] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-17T06:41:19.090349] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-17T06:41:19.092398] [DEBUG] [LOCAL ] SUZ: Trimmed 67216 records to 46060 (keeping 200 days of data) [2025-09-17T06:41:19.362892] [DEBUG] [LOCAL ] SUZ: Primary data saved (46060 records). [2025-09-17T06:41:19.363053] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-17T06:41:19.363180] [INFO ] [MAIN ] Update Progress: 2031/2369 symbols completed. SUZ took 43.7s. Estimated remaining: 49m 28s. Rate: 6.8 symbols/min [2025-09-17T06:41:19.530947] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:41:19.537782] [DEBUG] [LOCAL ] SWZ: Loaded 4158 existing records from primary storage. [2025-09-17T06:41:19.537909] [INFO ] [MAIN ] SWZ: Loaded 4158 existing records. [2025-09-17T06:41:19.716487] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:41:19.717110] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-17T06:41:19.717272] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-17T06:41:19.717584] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-17T06:41:19.717928] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-17T06:41:19.899609] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-17T06:41:20.089821] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:41:20.120047] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T06:41:20.690114] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-17T06:41:20.916570] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T06:41:21.362753] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T06:41:21.490128] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-17T06:41:22.290105] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-11. [2025-09-17T06:41:22.440492] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T06:41:23.090129] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-17T06:41:23.301158] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T06:41:23.319557] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T06:41:23.326266] [INFO ] [REMOTE ] SW: Full fetch complete (76534 records). [2025-09-17T06:41:23.326472] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-17T06:41:23.731473] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-17T06:41:23.731582] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-17T06:41:23.732668] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-17T06:41:23.732726] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-17T06:41:23.734135] [DEBUG] [LOCAL ] SW: Trimmed 76534 records to 53166 (keeping 200 days of data) [2025-09-17T06:41:23.917960] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-09-17T06:41:24.070712] [DEBUG] [LOCAL ] SW: Primary data saved (53166 records). [2025-09-17T06:41:24.070893] [INFO ] [MAIN ] SW: Full history saved. [2025-09-17T06:41:24.070999] [INFO ] [MAIN ] Update Progress: 2032/2369 symbols completed. SW took 42.0s. Estimated remaining: 49m 18s. Rate: 6.8 symbols/min [2025-09-17T06:41:24.243552] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:41:24.267002] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T06:41:24.293487] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-17T06:41:24.305999] [DEBUG] [LOCAL ] SXC: Loaded 30644 existing records from primary storage. [2025-09-17T06:41:24.306171] [INFO ] [MAIN ] SXC: Loaded 30644 existing records. [2025-09-17T06:41:24.481812] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:41:24.482056] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-17T06:41:24.482115] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-17T06:41:24.482834] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-17T06:41:24.482897] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-17T06:41:24.695290] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-17T06:41:24.854239] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:41:25.490188] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-17T06:41:26.145050] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T06:41:26.290143] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-11. [2025-09-17T06:41:27.090150] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-09-17T06:41:27.472258] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T06:41:27.510493] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T06:41:27.686927] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T06:41:27.890141] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-17T06:41:28.690117] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-09-17T06:41:29.490134] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-17T06:41:29.679408] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T06:41:30.108198] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T06:41:30.194758] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T06:41:30.290154] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-09-17T06:41:31.090151] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-17T06:41:31.883342] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T06:41:31.891747] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-17T06:41:31.984181] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T06:41:32.486825] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T06:41:32.690115] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-17T06:41:33.488836] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T06:41:33.493591] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-17T06:41:34.290208] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-17T06:41:34.883242] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T06:41:35.090103] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-17T06:41:35.125302] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T06:41:35.131683] [INFO ] [REMOTE ] SWK: Full fetch complete (75203 records). [2025-09-17T06:41:35.131828] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-17T06:41:35.524176] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-17T06:41:35.524283] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-17T06:41:35.525413] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-17T06:41:35.525473] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-17T06:41:35.527233] [DEBUG] [LOCAL ] SWK: Trimmed 75203 records to 52524 (keeping 200 days of data) [2025-09-17T06:41:35.855120] [DEBUG] [LOCAL ] SWK: Primary data saved (52524 records). [2025-09-17T06:41:35.855269] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-17T06:41:35.855365] [INFO ] [MAIN ] Update Progress: 2033/2369 symbols completed. SWK took 42.4s. Estimated remaining: 49m 10s. Rate: 6.8 symbols/min [2025-09-17T06:41:35.898738] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-17T06:41:36.028681] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:41:36.039044] [DEBUG] [LOCAL ] SXI: Loaded 8769 existing records from primary storage. [2025-09-17T06:41:36.039193] [INFO ] [MAIN ] SXI: Loaded 8769 existing records. [2025-09-17T06:41:36.217430] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:41:36.217716] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-17T06:41:36.217775] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-17T06:41:36.218178] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-17T06:41:36.218263] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-17T06:41:36.485911] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T06:41:36.586953] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T06:41:36.607403] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:41:36.690074] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-11. [2025-09-17T06:41:37.490134] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-17T06:41:37.596386] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T06:41:38.290133] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-09-17T06:41:38.917018] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T06:41:38.945449] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T06:41:39.090149] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-17T06:41:39.695518] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T06:41:39.890132] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-09-17T06:41:40.579024] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T06:41:40.690132] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-17T06:41:41.490205] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-17T06:41:41.512228] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T06:41:42.237561] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T06:41:42.290143] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-17T06:41:42.948516] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T06:41:42.949825] [INFO ] [REMOTE ] SWZ: Full fetch complete (8092 records). [2025-09-17T06:41:42.949922] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-17T06:41:43.102747] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-17T06:41:43.327581] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-17T06:41:43.327707] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-17T06:41:43.327942] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-17T06:41:43.327998] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-17T06:41:43.328440] [DEBUG] [LOCAL ] SWZ: Trimmed 8092 records to 6209 (keeping 200 days of data) [2025-09-17T06:41:43.363251] [DEBUG] [LOCAL ] SWZ: Primary data saved (6209 records). [2025-09-17T06:41:43.363405] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-17T06:41:43.363494] [INFO ] [MAIN ] Update Progress: 2034/2369 symbols completed. SWZ took 24.0s. Estimated remaining: 49m 1s. Rate: 6.8 symbols/min [2025-09-17T06:41:43.532881] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:41:43.554669] [DEBUG] [LOCAL ] SXT: Loaded 21998 existing records from primary storage. [2025-09-17T06:41:43.554847] [INFO ] [MAIN ] SXT: Loaded 21998 existing records. [2025-09-17T06:41:43.735072] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:41:43.735346] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-17T06:41:43.735408] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-17T06:41:43.735948] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-17T06:41:43.736009] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-17T06:41:43.892687] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-17T06:41:44.109192] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:41:44.690127] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-17T06:41:44.751193] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T06:41:44.770765] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T06:41:45.490142] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-17T06:41:46.038441] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T06:41:46.044946] [INFO ] [REMOTE ] SWX: Full fetch complete (43563 records). [2025-09-17T06:41:46.045120] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-17T06:41:46.300300] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-17T06:41:46.446864] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-17T06:41:46.447839] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T06:41:46.447934] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-17T06:41:46.451849] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-17T06:41:46.452228] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-17T06:41:46.453427] [DEBUG] [LOCAL ] SWX: Trimmed 43563 records to 31321 (keeping 200 days of data) [2025-09-17T06:41:46.672620] [DEBUG] [LOCAL ] SWX: Primary data saved (31321 records). [2025-09-17T06:41:46.672801] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-17T06:41:46.672920] [INFO ] [MAIN ] Update Progress: 2035/2369 symbols completed. SWX took 39.9s. Estimated remaining: 48m 51s. Rate: 6.8 symbols/min [2025-09-17T06:41:46.839502] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:41:46.839735] [DEBUG] [LOCAL ] SYF: No existing data file found in primary storage. [2025-09-17T06:41:46.839787] [WARN ] [MAIN ] SYF: No existing data found, performing full refresh instead. [2025-09-17T06:41:46.839889] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-17T06:41:46.839943] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-17T06:41:46.839987] [DEBUG] [LOCAL ] SYF: No primary data file found to delete. [2025-09-17T06:41:46.840031] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-17T06:41:47.095364] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-11. [2025-09-17T06:41:47.190982] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:41:47.852618] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T06:41:47.890127] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-17T06:41:47.903943] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T06:41:48.690141] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-09-17T06:41:49.470771] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T06:41:49.490094] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-17T06:41:49.525763] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T06:41:50.290140] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-17T06:41:50.969607] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T06:41:51.090117] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-11. [2025-09-17T06:41:51.134204] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T06:41:51.890130] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-17T06:41:52.690114] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-09-17T06:41:52.849509] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T06:41:53.417445] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T06:41:53.490100] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-17T06:41:53.696343] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T06:41:54.290139] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-17T06:41:54.806934] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T06:41:55.090134] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-17T06:41:55.138936] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T06:41:55.755382] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T06:41:55.890147] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-09-17T06:41:56.690142] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-17T06:41:57.490138] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-17T06:41:57.742181] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T06:41:57.829351] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T06:41:58.290138] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-17T06:41:58.905467] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T06:41:58.910679] [INFO ] [REMOTE ] SXC: Full fetch complete (61118 records). [2025-09-17T06:41:58.910857] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-17T06:41:59.101152] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-17T06:41:59.297068] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-17T06:41:59.304529] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-17T06:41:59.306191] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-17T06:41:59.306535] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T06:41:59.306724] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-17T06:41:59.311266] [DEBUG] [LOCAL ] SXC: Trimmed 61118 records to 41817 (keeping 200 days of data) [2025-09-17T06:41:59.563870] [DEBUG] [LOCAL ] SXC: Primary data saved (41817 records). [2025-09-17T06:41:59.564027] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-17T06:41:59.564130] [INFO ] [MAIN ] Update Progress: 2036/2369 symbols completed. SXC took 35.5s. Estimated remaining: 48m 43s. Rate: 6.8 symbols/min [2025-09-17T06:41:59.731426] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:41:59.731666] [DEBUG] [LOCAL ] SYK: No existing data file found in primary storage. [2025-09-17T06:41:59.731730] [WARN ] [MAIN ] SYK: No existing data found, performing full refresh instead. [2025-09-17T06:41:59.731867] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-17T06:41:59.731942] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-17T06:41:59.732011] [DEBUG] [LOCAL ] SYK: No primary data file found to delete. [2025-09-17T06:41:59.732078] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-17T06:41:59.898316] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-17T06:42:00.131090] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:42:00.501576] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T06:42:00.690125] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-11. [2025-09-17T06:42:01.015543] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T06:42:01.490161] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-17T06:42:02.290149] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-17T06:42:02.795583] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-17T06:42:03.090146] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-09-17T06:42:03.256336] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T06:42:03.258374] [INFO ] [REMOTE ] SXI: Full fetch complete (14282 records). [2025-09-17T06:42:03.258499] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-17T06:42:03.615195] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-17T06:42:03.615315] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-17T06:42:03.615734] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-17T06:42:03.615818] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-17T06:42:03.616660] [DEBUG] [LOCAL ] SXI: Trimmed 14282 records to 11371 (keeping 200 days of data) [2025-09-17T06:42:03.691338] [DEBUG] [LOCAL ] SXI: Primary data saved (11371 records). [2025-09-17T06:42:03.691522] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-17T06:42:03.691675] [INFO ] [MAIN ] Update Progress: 2037/2369 symbols completed. SXI took 27.8s. Estimated remaining: 48m 34s. Rate: 6.8 symbols/min [2025-09-17T06:42:03.890133] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-17T06:42:04.646191] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-17T06:42:04.690125] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-17T06:42:04.824489] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T06:42:05.104359] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T06:42:05.490179] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-17T06:42:06.290236] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-09-17T06:42:06.430402] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T06:42:06.497606] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T06:42:07.090153] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-17T06:42:07.890203] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-17T06:42:08.084766] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T06:42:08.661968] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T06:42:08.690155] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-17T06:42:09.175697] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T06:42:09.490141] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-17T06:42:10.112108] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T06:42:10.290136] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-17T06:42:10.761133] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T06:42:11.090169] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-17T06:42:11.890189] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-17T06:42:12.037810] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T06:42:12.375066] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T06:42:12.378924] [INFO ] [REMOTE ] SXT: Full fetch complete (37055 records). [2025-09-17T06:42:12.379025] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-17T06:42:12.695230] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-17T06:42:12.763898] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-17T06:42:12.764033] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-17T06:42:12.764953] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-17T06:42:12.765035] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-17T06:42:12.766468] [DEBUG] [LOCAL ] SXT: Trimmed 37055 records to 28811 (keeping 200 days of data) [2025-09-17T06:42:12.948693] [DEBUG] [LOCAL ] SXT: Primary data saved (28811 records). [2025-09-17T06:42:12.948870] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-17T06:42:12.948971] [INFO ] [MAIN ] Update Progress: 2038/2369 symbols completed. SXT took 29.6s. Estimated remaining: 48m 25s. Rate: 6.8 symbols/min [2025-09-17T06:42:13.596869] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T06:42:13.606327] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-17T06:42:14.589940] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T06:42:14.601113] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-17T06:42:15.504560] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T06:42:15.515385] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-17T06:42:17.579565] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (2.98 seconds). [2025-09-17T06:42:17.592015] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-17T06:42:18.209795] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-17T06:42:18.220776] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-17T06:42:19.333600] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T06:42:19.345533] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-17T06:42:19.960389] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T06:42:19.971091] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-17T06:42:21.146888] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T06:42:21.153926] [INFO ] [REMOTE ] SYF: Full fetch complete (77168 records). [2025-09-17T06:42:21.154144] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-17T06:42:21.547499] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-17T06:42:21.547664] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-17T06:42:21.548798] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-17T06:42:21.548931] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-17T06:42:21.550788] [DEBUG] [LOCAL ] SYF: Trimmed 77168 records to 53466 (keeping 200 days of data) [2025-09-17T06:42:21.690089] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T06:42:21.701764] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-17T06:42:21.930890] [DEBUG] [LOCAL ] SYF: Primary data saved (53466 records). [2025-09-17T06:42:21.931060] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-17T06:42:21.931147] [INFO ] [MAIN ] Update Progress: 2039/2369 symbols completed. SYF took 35.3s. Estimated remaining: 48m 16s. Rate: 6.8 symbols/min [2025-09-17T06:42:23.410797] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T06:42:23.421398] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-17T06:42:25.092454] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T06:42:25.102317] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-17T06:42:26.627005] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T06:42:26.632890] [INFO ] [REMOTE ] SYK: Full fetch complete (68557 records). [2025-09-17T06:42:26.633078] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-17T06:42:27.030622] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-17T06:42:27.030797] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-17T06:42:27.031844] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-17T06:42:27.031902] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-17T06:42:27.033619] [DEBUG] [LOCAL ] SYK: Trimmed 68557 records to 47201 (keeping 200 days of data) [2025-09-17T06:42:27.334225] [DEBUG] [LOCAL ] SYK: Primary data saved (47201 records). [2025-09-17T06:42:27.334386] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-17T06:42:27.334495] [INFO ] [MAIN ] Update Progress: 2040/2369 symbols completed. SYK took 27.8s. Estimated remaining: 48m 7s. Rate: 6.8 symbols/min [2025-09-17T06:42:27.987545] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:42:27.988311] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:42:28.008894] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:42:28.011918] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:42:28.012084] [DEBUG] [LOCAL ] SYY: No existing data file found in primary storage. [2025-09-17T06:42:28.012556] [WARN ] [MAIN ] SYY: No existing data found, performing full refresh instead. [2025-09-17T06:42:28.013026] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-17T06:42:28.012603] [DEBUG] [LOCAL ] T: No existing data file found in primary storage. [2025-09-17T06:42:28.013111] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-17T06:42:28.013437] [DEBUG] [LOCAL ] SYY: No primary data file found to delete. [2025-09-17T06:42:28.013543] [WARN ] [MAIN ] T: No existing data found, performing full refresh instead. [2025-09-17T06:42:28.013504] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-17T06:42:28.013968] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-17T06:42:28.030529] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-17T06:42:28.077580] [DEBUG] [LOCAL ] T: No primary data file found to delete. [2025-09-17T06:42:28.099551] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-17T06:42:28.469486] [DEBUG] [LOCAL ] TAC: Loaded 31268 existing records from primary storage. [2025-09-17T06:42:28.468570] [DEBUG] [LOCAL ] TAK: Loaded 37579 existing records from primary storage. [2025-09-17T06:42:28.489555] [INFO ] [MAIN ] TAK: Loaded 37579 existing records. [2025-09-17T06:42:28.499741] [INFO ] [MAIN ] TAC: Loaded 31268 existing records. [2025-09-17T06:42:28.803814] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:42:28.855248] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-11. [2025-09-17T06:42:29.063788] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:42:29.163137] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:42:29.167971] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-17T06:42:29.168579] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-17T06:42:29.167901] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:42:29.168926] [INFO ] [REMOTE ] T: Fetching primary data for 2024-11. [2025-09-17T06:42:29.168404] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-17T06:42:29.169093] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-17T06:42:29.170000] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-17T06:42:29.170089] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-17T06:42:29.181354] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-17T06:42:29.206351] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-17T06:42:29.910471] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:42:29.923673] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:42:29.924410] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-11. [2025-09-17T06:42:29.925341] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-11. [2025-09-17T06:42:31.012323] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-17T06:42:31.022550] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-09-17T06:42:31.548612] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T06:42:31.558334] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-09-17T06:42:31.590422] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-11 (2.42 seconds). [2025-09-17T06:42:31.601142] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-09-17T06:42:31.627077] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T06:42:31.635604] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-09-17T06:42:32.671016] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T06:42:32.681924] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-09-17T06:42:33.035327] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T06:42:33.045139] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-09-17T06:42:33.211511] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T06:42:33.221376] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-09-17T06:42:34.038629] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T06:42:34.049333] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-17T06:42:34.099376] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-17T06:42:34.111051] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-09-17T06:42:34.673854] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T06:42:34.685018] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-17T06:42:34.742297] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T06:42:34.752335] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-17T06:42:35.396156] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T06:42:35.406758] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-17T06:42:35.872219] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T06:42:35.885254] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-17T06:42:35.915496] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T06:42:35.925538] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-17T06:42:36.337485] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-17T06:42:36.348237] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-17T06:42:36.809990] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T06:42:36.821501] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-17T06:42:37.173945] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T06:42:37.215879] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T06:42:37.490150] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-17T06:42:38.290101] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-17T06:42:38.488383] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T06:42:38.634203] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-17T06:42:38.773967] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T06:42:39.090145] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-17T06:42:39.620321] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T06:42:39.890163] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-17T06:42:40.695185] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-17T06:42:40.714052] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T06:42:41.343131] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T06:42:41.490142] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-17T06:42:42.290197] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-17T06:42:43.086597] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T06:42:43.090213] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-17T06:42:43.200760] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-17T06:42:43.890192] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-17T06:42:44.145764] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T06:42:44.205848] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T06:42:44.690161] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-17T06:42:45.490133] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-17T06:42:46.224204] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T06:42:46.290081] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-17T06:42:46.420282] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-17T06:42:46.652894] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T06:42:47.090170] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-17T06:42:47.890182] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-17T06:42:48.002934] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T06:42:48.690198] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-17T06:42:48.910149] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T06:42:49.490179] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-17T06:42:50.229981] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T06:42:50.243058] [INFO ] [REMOTE ] TAK: Full fetch complete (71323 records). [2025-09-17T06:42:50.243341] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-17T06:42:50.290594] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-17T06:42:50.496358] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-17T06:42:50.898193] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-17T06:42:50.898332] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-17T06:42:50.900801] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-17T06:42:50.900955] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-17T06:42:50.902810] [DEBUG] [LOCAL ] TAK: Trimmed 71323 records to 49933 (keeping 200 days of data) [2025-09-17T06:42:51.115359] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-17T06:42:51.263034] [DEBUG] [LOCAL ] TAK: Primary data saved (49933 records). [2025-09-17T06:42:51.263262] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-17T06:42:51.263417] [INFO ] [MAIN ] Update Progress: 2041/2369 symbols completed. TAK took 23.9s. Estimated remaining: 48m 1s. Rate: 6.8 symbols/min [2025-09-17T06:42:51.436774] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:42:51.469879] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T06:42:51.518793] [DEBUG] [LOCAL ] TAL: Loaded 38618 existing records from primary storage. [2025-09-17T06:42:51.518996] [INFO ] [MAIN ] TAL: Loaded 38618 existing records. [2025-09-17T06:42:51.694677] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:42:51.694987] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-17T06:42:51.695050] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-17T06:42:51.695871] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-17T06:42:51.695930] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-17T06:42:51.905959] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-17T06:42:52.059543] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:42:52.085719] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T06:42:52.690146] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-17T06:42:53.462886] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-17T06:42:53.490168] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-11. [2025-09-17T06:42:53.712270] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T06:42:53.717998] [INFO ] [REMOTE ] TAC: Full fetch complete (64040 records). [2025-09-17T06:42:53.718212] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-17T06:42:54.072149] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-17T06:42:54.170189] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-17T06:42:54.170323] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-17T06:42:54.171449] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-17T06:42:54.171513] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-17T06:42:54.173017] [DEBUG] [LOCAL ] TAC: Trimmed 64040 records to 43006 (keeping 200 days of data) [2025-09-17T06:42:54.290856] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-17T06:42:54.447108] [DEBUG] [LOCAL ] TAC: Primary data saved (43006 records). [2025-09-17T06:42:54.447274] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-17T06:42:54.447376] [INFO ] [MAIN ] Update Progress: 2042/2369 symbols completed. TAC took 27.1s. Estimated remaining: 47m 51s. Rate: 6.8 symbols/min [2025-09-17T06:42:54.618450] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:42:54.662345] [DEBUG] [LOCAL ] TALO: Loaded 37968 existing records from primary storage. [2025-09-17T06:42:54.662556] [INFO ] [MAIN ] TALO: Loaded 37968 existing records. [2025-09-17T06:42:54.840132] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:42:54.840393] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-17T06:42:54.840452] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-17T06:42:54.841202] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-17T06:42:54.841264] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-17T06:42:55.113534] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-17T06:42:55.229666] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:42:55.263394] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T06:42:55.890162] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-09-17T06:42:56.578221] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-17T06:42:56.690129] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-17T06:42:56.878380] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T06:42:56.887168] [INFO ] [REMOTE ] SYY: Full fetch complete (76800 records). [2025-09-17T06:42:56.887355] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-17T06:42:57.286931] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-17T06:42:57.287055] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-17T06:42:57.288170] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-17T06:42:57.288232] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-17T06:42:57.289764] [DEBUG] [LOCAL ] SYY: Trimmed 76800 records to 53255 (keeping 200 days of data) [2025-09-17T06:42:57.512329] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-11. [2025-09-17T06:42:57.642981] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T06:42:57.674346] [DEBUG] [LOCAL ] SYY: Primary data saved (53255 records). [2025-09-17T06:42:57.674492] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-17T06:42:57.674570] [INFO ] [MAIN ] Update Progress: 2043/2369 symbols completed. SYY took 30.3s. Estimated remaining: 47m 41s. Rate: 6.8 symbols/min [2025-09-17T06:42:57.841919] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:42:57.877969] [DEBUG] [LOCAL ] TAP: Loaded 39488 existing records from primary storage. [2025-09-17T06:42:57.878163] [INFO ] [MAIN ] TAP: Loaded 39488 existing records. [2025-09-17T06:42:58.054200] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:42:58.054435] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-17T06:42:58.054492] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-17T06:42:58.055348] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-17T06:42:58.055415] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-17T06:42:58.304601] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-09-17T06:42:58.421445] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:42:59.025686] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-17T06:42:59.090106] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-17T06:42:59.205575] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T06:42:59.890129] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-09-17T06:43:00.214697] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T06:43:00.690121] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-17T06:43:01.168115] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T06:43:01.320521] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-17T06:43:01.330482] [INFO ] [REMOTE ] T: Full fetch complete (77910 records). [2025-09-17T06:43:01.330753] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-17T06:43:01.508668] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-09-17T06:43:01.728533] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-17T06:43:01.728661] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-17T06:43:01.729769] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-17T06:43:01.729833] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-17T06:43:01.731385] [DEBUG] [LOCAL ] T: Trimmed 77910 records to 53798 (keeping 200 days of data) [2025-09-17T06:43:02.077509] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-09-17T06:43:02.077689] [INFO ] [MAIN ] T: Full history saved. [2025-09-17T06:43:02.077777] [INFO ] [MAIN ] Update Progress: 2044/2369 symbols completed. T took 34.7s. Estimated remaining: 47m 32s. Rate: 6.8 symbols/min [2025-09-17T06:43:02.250572] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:43:02.260254] [DEBUG] [LOCAL ] TBB: Loaded 8677 existing records from primary storage. [2025-09-17T06:43:02.260383] [INFO ] [MAIN ] TBB: Loaded 8677 existing records. [2025-09-17T06:43:02.302495] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-11. [2025-09-17T06:43:02.440549] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:43:02.440950] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-17T06:43:02.441097] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-17T06:43:02.441464] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-17T06:43:02.441556] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-17T06:43:02.727046] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-17T06:43:02.841839] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:43:03.090139] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-11. [2025-09-17T06:43:03.179502] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T06:43:03.717449] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T06:43:03.890142] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-09-17T06:43:04.000107] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T06:43:04.690195] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-09-17T06:43:05.490096] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-17T06:43:05.566359] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T06:43:05.713414] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T06:43:06.290136] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-17T06:43:07.050130] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T06:43:07.090072] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-17T06:43:07.890186] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-09-17T06:43:08.112123] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T06:43:08.690121] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-17T06:43:08.747593] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T06:43:08.813968] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T06:43:09.490178] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-17T06:43:10.290141] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-09-17T06:43:10.510559] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T06:43:11.090145] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-17T06:43:11.238696] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T06:43:11.764955] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T06:43:11.850399] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T06:43:11.890125] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-17T06:43:12.388269] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T06:43:12.690123] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-17T06:43:13.490151] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-17T06:43:13.552354] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T06:43:14.290179] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-17T06:43:15.090111] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-17T06:43:15.177804] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T06:43:15.890123] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-17T06:43:16.282662] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T06:43:16.690117] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-17T06:43:16.776031] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T06:43:17.492217] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-17T06:43:17.497757] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T06:43:18.178066] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T06:43:18.290138] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-17T06:43:19.090153] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-17T06:43:19.349158] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T06:43:19.890132] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-17T06:43:20.000026] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T06:43:20.640702] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T06:43:20.690129] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-17T06:43:21.490173] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-17T06:43:21.542505] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T06:43:22.290156] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-17T06:43:22.401381] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T06:43:22.433059] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T06:43:23.090141] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-17T06:43:23.856437] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T06:43:23.890149] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-17T06:43:24.103684] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T06:43:24.690186] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-17T06:43:25.216836] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T06:43:25.223155] [INFO ] [REMOTE ] TAL: Full fetch complete (75541 records). [2025-09-17T06:43:25.223317] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-17T06:43:25.492743] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-17T06:43:25.587524] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T06:43:25.634139] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-17T06:43:25.634235] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-17T06:43:25.635398] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-17T06:43:25.635502] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-17T06:43:25.637181] [DEBUG] [LOCAL ] TAL: Trimmed 75541 records to 52199 (keeping 200 days of data) [2025-09-17T06:43:25.944975] [DEBUG] [LOCAL ] TAL: Primary data saved (52199 records). [2025-09-17T06:43:25.945139] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-17T06:43:25.945262] [INFO ] [MAIN ] Update Progress: 2045/2369 symbols completed. TAL took 34.7s. Estimated remaining: 47m 25s. Rate: 6.8 symbols/min [2025-09-17T06:43:26.112559] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:43:26.137801] [DEBUG] [LOCAL ] TBBB: Loaded 26199 existing records from primary storage. [2025-09-17T06:43:26.137993] [INFO ] [MAIN ] TBBB: Loaded 26199 existing records. [2025-09-17T06:43:26.295289] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-17T06:43:26.316373] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:43:26.317438] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-17T06:43:26.317515] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-17T06:43:26.318213] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-17T06:43:26.318390] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-17T06:43:26.689981] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:43:27.014516] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T06:43:27.090130] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-17T06:43:27.701197] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T06:43:27.890211] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-17T06:43:28.645069] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T06:43:28.651214] [INFO ] [REMOTE ] TALO: Full fetch complete (72910 records). [2025-09-17T06:43:28.651366] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-17T06:43:28.695404] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-17T06:43:28.971917] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T06:43:29.060748] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-17T06:43:29.060856] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-17T06:43:29.062001] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-17T06:43:29.062075] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-17T06:43:29.065129] [DEBUG] [LOCAL ] TALO: Trimmed 72910 records to 50842 (keeping 200 days of data) [2025-09-17T06:43:29.359824] [DEBUG] [LOCAL ] TALO: Primary data saved (50842 records). [2025-09-17T06:43:29.360009] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-17T06:43:29.360166] [INFO ] [MAIN ] Update Progress: 2046/2369 symbols completed. TALO took 34.9s. Estimated remaining: 47m 16s. Rate: 6.8 symbols/min [2025-09-17T06:43:29.500002] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-17T06:43:29.532121] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:43:29.548989] [DEBUG] [LOCAL ] TBI: Loaded 16333 existing records from primary storage. [2025-09-17T06:43:29.549127] [INFO ] [MAIN ] TBI: Loaded 16333 existing records. [2025-09-17T06:43:29.731528] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:43:29.731923] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-17T06:43:29.732009] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-17T06:43:29.732503] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-17T06:43:29.732588] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-17T06:43:30.079398] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:43:30.290116] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-11. [2025-09-17T06:43:30.333570] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T06:43:30.336077] [INFO ] [REMOTE ] TBB: Full fetch complete (18422 records). [2025-09-17T06:43:30.336163] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-17T06:43:30.698336] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-17T06:43:30.698515] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-17T06:43:30.698993] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-17T06:43:30.699057] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-17T06:43:30.700246] [DEBUG] [LOCAL ] TBB: Trimmed 18422 records to 11757 (keeping 200 days of data) [2025-09-17T06:43:30.792008] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T06:43:30.822451] [DEBUG] [LOCAL ] TBB: Primary data saved (11757 records). [2025-09-17T06:43:30.822602] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-17T06:43:30.822732] [INFO ] [MAIN ] Update Progress: 2047/2369 symbols completed. TBB took 28.7s. Estimated remaining: 47m 6s. Rate: 6.8 symbols/min [2025-09-17T06:43:30.992054] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:43:30.992218] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-17T06:43:30.992268] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-17T06:43:30.992370] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-17T06:43:30.992427] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-17T06:43:30.992476] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-17T06:43:30.992527] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-17T06:43:31.091788] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-11. [2025-09-17T06:43:31.346304] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:43:31.360596] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T06:43:31.890140] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-09-17T06:43:32.442870] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T06:43:32.690158] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-09-17T06:43:32.954212] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T06:43:33.490125] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-09-17T06:43:33.995333] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T06:43:34.290163] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-11. [2025-09-17T06:43:34.491447] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T06:43:34.744665] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T06:43:35.090166] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-17T06:43:35.340052] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.25 seconds). [2025-09-17T06:43:35.890143] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-17T06:43:36.690173] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-17T06:43:36.929332] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T06:43:37.009902] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-17T06:43:37.490137] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-09-17T06:43:38.290113] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-17T06:43:38.712864] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T06:43:39.090185] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-17T06:43:39.372837] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-17T06:43:39.388019] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T06:43:39.890140] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-17T06:43:40.690164] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-17T06:43:41.028175] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-17T06:43:41.056292] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T06:43:41.490194] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-17T06:43:42.290162] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-17T06:43:42.917276] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T06:43:43.090202] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-17T06:43:43.890203] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-17T06:43:44.088751] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T06:43:44.519828] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T06:43:44.690169] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-17T06:43:45.098906] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T06:43:45.490172] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-17T06:43:45.831261] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T06:43:46.290110] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-17T06:43:46.360533] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T06:43:46.367223] [INFO ] [REMOTE ] TAP: Full fetch complete (75969 records). [2025-09-17T06:43:46.367400] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-17T06:43:46.767987] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-17T06:43:46.768106] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-17T06:43:46.769187] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-17T06:43:46.769249] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-17T06:43:46.772473] [DEBUG] [LOCAL ] TAP: Trimmed 75969 records to 52841 (keeping 200 days of data) [2025-09-17T06:43:47.095148] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-17T06:43:47.132420] [DEBUG] [LOCAL ] TAP: Primary data saved (52841 records). [2025-09-17T06:43:47.132697] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-17T06:43:47.132893] [INFO ] [MAIN ] Update Progress: 2048/2369 symbols completed. TAP took 49.5s. Estimated remaining: 46m 58s. Rate: 6.8 symbols/min [2025-09-17T06:43:47.313170] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:43:47.317702] [DEBUG] [LOCAL ] TBN: Loaded 2191 existing records from primary storage. [2025-09-17T06:43:47.317806] [INFO ] [MAIN ] TBN: Loaded 2191 existing records. [2025-09-17T06:43:47.509746] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:43:47.522673] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-17T06:43:47.523752] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T06:43:47.523831] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-17T06:43:47.529296] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-17T06:43:47.529383] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-17T06:43:47.893114] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-17T06:43:47.896807] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:43:48.650009] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T06:43:48.690103] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-17T06:43:48.947040] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T06:43:49.490172] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-17T06:43:50.045788] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T06:43:50.290144] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-11. [2025-09-17T06:43:50.514356] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T06:43:50.565147] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-11 (0.28 seconds). [2025-09-17T06:43:51.090172] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-17T06:43:51.407331] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T06:43:51.890135] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-09-17T06:43:52.385699] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T06:43:52.690152] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-17T06:43:53.490169] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-17T06:43:53.962063] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T06:43:54.247075] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T06:43:54.250938] [INFO ] [REMOTE ] TBI: Full fetch complete (31525 records). [2025-09-17T06:43:54.251157] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-17T06:43:54.295327] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-09-17T06:43:54.633095] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-17T06:43:54.633204] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-17T06:43:54.633895] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-17T06:43:54.633951] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-17T06:43:54.634927] [DEBUG] [LOCAL ] TBI: Trimmed 31525 records to 22761 (keeping 200 days of data) [2025-09-17T06:43:54.764776] [DEBUG] [LOCAL ] TBI: Primary data saved (22761 records). [2025-09-17T06:43:54.764983] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-17T06:43:54.765124] [INFO ] [MAIN ] Update Progress: 2049/2369 symbols completed. TBI took 25.4s. Estimated remaining: 46m 49s. Rate: 6.8 symbols/min [2025-09-17T06:43:54.936524] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:43:54.936734] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-17T06:43:54.936785] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-17T06:43:54.936892] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-17T06:43:54.936970] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-17T06:43:54.937022] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-17T06:43:54.937073] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-17T06:43:55.060424] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T06:43:55.090135] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-17T06:43:55.301949] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:43:55.890164] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-17T06:43:56.483264] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T06:43:56.636678] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T06:43:56.690125] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-17T06:43:57.009335] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-17T06:43:57.490214] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-17T06:43:58.290136] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-17T06:43:58.611589] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T06:43:58.904490] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T06:43:59.090142] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-11. [2025-09-17T06:43:59.286467] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:43:59.286930] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-11 [2025-09-17T06:43:59.890175] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-17T06:44:00.690132] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-17T06:44:01.109413] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T06:44:01.286186] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T06:44:01.290894] [INFO ] [REMOTE ] TBBB: Full fetch complete (51727 records). [2025-09-17T06:44:01.291041] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-17T06:44:01.495356] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-17T06:44:01.736572] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-17T06:44:01.736689] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-17T06:44:01.737623] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-17T06:44:01.737699] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-17T06:44:01.739618] [DEBUG] [LOCAL ] TBBB: Trimmed 51727 records to 36156 (keeping 200 days of data) [2025-09-17T06:44:01.916339] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-17T06:44:01.965149] [DEBUG] [LOCAL ] TBBB: Primary data saved (36156 records). [2025-09-17T06:44:01.965318] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-17T06:44:01.965428] [INFO ] [MAIN ] Update Progress: 2050/2369 symbols completed. TBBB took 36.0s. Estimated remaining: 46m 40s. Rate: 6.8 symbols/min [2025-09-17T06:44:02.132427] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:44:02.171941] [DEBUG] [LOCAL ] TD: Loaded 38888 existing records from primary storage. [2025-09-17T06:44:02.172167] [INFO ] [MAIN ] TD: Loaded 38888 existing records. [2025-09-17T06:44:02.295231] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-17T06:44:02.356311] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:44:02.356612] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-17T06:44:02.356693] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-17T06:44:02.357555] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-17T06:44:02.357636] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-17T06:44:02.548884] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:44:02.621975] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-17T06:44:02.732219] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:44:03.090184] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-17T06:44:03.430391] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-17T06:44:03.890142] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-09-17T06:44:04.076559] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:44:04.076951] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-09-17T06:44:04.690158] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-17T06:44:04.888985] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:44:04.889334] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-17T06:44:05.490155] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-17T06:44:05.910984] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T06:44:06.290175] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-11. [2025-09-17T06:44:07.090136] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-17T06:44:07.546007] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T06:44:07.546779] [INFO ] [REMOTE ] TBLU: Full fetch complete (1181 records). [2025-09-17T06:44:07.546876] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-17T06:44:07.740405] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T06:44:07.740587] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:44:07.740637] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:44:07.740703] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-17T06:44:07.740768] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-17T06:44:07.740814] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-17T06:44:07.740877] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-17T06:44:07.740956] [INFO ] [MAIN ] Update Progress: 2051/2369 symbols completed. TBLU took 36.9s. Estimated remaining: 46m 31s. Rate: 6.8 symbols/min [2025-09-17T06:44:07.895176] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-17T06:44:07.913237] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:44:07.953371] [DEBUG] [LOCAL ] TDC: Loaded 34252 existing records from primary storage. [2025-09-17T06:44:07.953740] [INFO ] [MAIN ] TDC: Loaded 34252 existing records. [2025-09-17T06:44:08.134054] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:44:08.139195] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:44:08.139606] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-17T06:44:08.139967] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-17T06:44:08.140520] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-17T06:44:08.141305] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-17T06:44:08.141371] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-17T06:44:08.441183] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-17T06:44:08.578554] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:44:08.690139] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-11. [2025-09-17T06:44:09.490154] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-17T06:44:09.680842] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:44:09.681221] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-17T06:44:09.974266] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T06:44:10.290167] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-09-17T06:44:11.090136] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-09-17T06:44:11.890183] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-17T06:44:12.054454] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T06:44:12.417478] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T06:44:12.641510] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T06:44:12.690118] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-09-17T06:44:13.490141] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-09-17T06:44:14.136921] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T06:44:14.290160] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-17T06:44:14.861055] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T06:44:14.940951] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T06:44:15.090135] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-17T06:44:15.661042] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T06:44:15.890172] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-17T06:44:16.690142] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-17T06:44:17.300165] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T06:44:17.301481] [INFO ] [REMOTE ] TBN: Full fetch complete (4642 records). [2025-09-17T06:44:17.301567] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-17T06:44:17.499950] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-17T06:44:17.667300] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-17T06:44:17.667447] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-17T06:44:17.667754] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-17T06:44:17.667858] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-17T06:44:17.668431] [DEBUG] [LOCAL ] TBN: Trimmed 4642 records to 2988 (keeping 200 days of data) [2025-09-17T06:44:17.715335] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T06:44:17.716504] [DEBUG] [LOCAL ] TBN: Primary data saved (2988 records). [2025-09-17T06:44:17.726628] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-17T06:44:17.726792] [INFO ] [MAIN ] Update Progress: 2052/2369 symbols completed. TBN took 30.6s. Estimated remaining: 46m 22s. Rate: 6.8 symbols/min [2025-09-17T06:44:17.896152] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:44:17.903376] [DEBUG] [LOCAL ] TDF: Loaded 4186 existing records from primary storage. [2025-09-17T06:44:17.903517] [INFO ] [MAIN ] TDF: Loaded 4186 existing records. [2025-09-17T06:44:18.080461] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:44:18.080739] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-17T06:44:18.080800] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-17T06:44:18.081076] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-17T06:44:18.081135] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-17T06:44:18.299085] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-17T06:44:18.444435] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:44:18.555289] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:44:18.555702] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-17T06:44:18.840311] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T06:44:19.090132] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-17T06:44:19.890148] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-17T06:44:20.074567] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:44:20.075062] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-17T06:44:20.690121] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-11. [2025-09-17T06:44:20.809303] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T06:44:21.490134] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-17T06:44:21.549954] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T06:44:22.290152] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-17T06:44:23.090293] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-17T06:44:23.285769] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:44:23.286141] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-17T06:44:23.382142] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T06:44:23.890326] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-17T06:44:23.983751] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T06:44:24.297713] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T06:44:24.690145] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-09-17T06:44:25.229558] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T06:44:25.490144] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-17T06:44:26.290131] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-09-17T06:44:26.989418] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T06:44:27.090129] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-17T06:44:27.225037] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T06:44:27.542572] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T06:44:27.890171] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-17T06:44:28.690185] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-17T06:44:29.444621] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T06:44:29.490111] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-17T06:44:29.720345] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T06:44:29.975393] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T06:44:29.976434] [INFO ] [REMOTE ] TCAI: Full fetch complete (767 records). [2025-09-17T06:44:29.976518] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-17T06:44:30.155570] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 30 unique days, need 200 days [2025-09-17T06:44:30.155798] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:44:30.155851] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:44:30.155900] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-17T06:44:30.156006] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-17T06:44:30.156064] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-17T06:44:30.156127] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-17T06:44:30.156197] [INFO ] [MAIN ] Update Progress: 2053/2369 symbols completed. TCAI took 35.4s. Estimated remaining: 46m 14s. Rate: 6.8 symbols/min [2025-09-17T06:44:30.298011] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-17T06:44:30.330613] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:44:30.352975] [DEBUG] [LOCAL ] TDG: Loaded 16109 existing records from primary storage. [2025-09-17T06:44:30.353138] [INFO ] [MAIN ] TDG: Loaded 16109 existing records. [2025-09-17T06:44:30.554157] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:44:30.554426] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-17T06:44:30.554486] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-17T06:44:30.558092] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-17T06:44:30.558167] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-17T06:44:30.912156] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:44:31.090111] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-11. [2025-09-17T06:44:31.898226] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-17T06:44:31.903888] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T06:44:32.470960] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T06:44:32.477450] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T06:44:32.690120] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-17T06:44:33.325583] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T06:44:33.490186] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-17T06:44:34.290181] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-17T06:44:34.872567] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T06:44:35.090142] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-09-17T06:44:35.143260] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T06:44:35.890133] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-17T06:44:36.231834] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T06:44:36.524494] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T06:44:36.690205] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-17T06:44:37.490202] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-09-17T06:44:38.247034] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T06:44:38.290094] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-17T06:44:38.313840] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T06:44:39.090148] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-17T06:44:39.862423] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T06:44:39.890116] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-17T06:44:40.226422] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T06:44:40.690142] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-17T06:44:41.448511] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T06:44:41.490096] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-17T06:44:41.517252] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T06:44:42.290128] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-17T06:44:43.026466] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T06:44:43.032411] [INFO ] [REMOTE ] TDC: Full fetch complete (66313 records). [2025-09-17T06:44:43.032628] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-17T06:44:43.099747] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-17T06:44:43.430276] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-17T06:44:43.430400] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-17T06:44:43.431511] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-17T06:44:43.431589] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-17T06:44:43.433021] [DEBUG] [LOCAL ] TDC: Trimmed 66313 records to 47071 (keeping 200 days of data) [2025-09-17T06:44:43.568341] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T06:44:43.737101] [DEBUG] [LOCAL ] TDC: Primary data saved (47071 records). [2025-09-17T06:44:43.737252] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-17T06:44:43.737349] [INFO ] [MAIN ] Update Progress: 2054/2369 symbols completed. TDC took 36.0s. Estimated remaining: 46m 6s. Rate: 6.8 symbols/min [2025-09-17T06:44:43.894531] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-17T06:44:43.916224] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:44:43.966513] [DEBUG] [LOCAL ] TDOC: Loaded 39754 existing records from primary storage. [2025-09-17T06:44:43.966813] [INFO ] [MAIN ] TDOC: Loaded 39754 existing records. [2025-09-17T06:44:44.168220] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:44:44.168602] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-17T06:44:44.168683] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-17T06:44:44.169592] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-17T06:44:44.169705] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-17T06:44:44.559837] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:44:44.690158] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-17T06:44:45.007896] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T06:44:45.118614] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T06:44:45.162329] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T06:44:45.490204] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-17T06:44:46.265678] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T06:44:46.267261] [INFO ] [REMOTE ] TDF: Full fetch complete (10677 records). [2025-09-17T06:44:46.267354] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-17T06:44:46.296758] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-11. [2025-09-17T06:44:46.638596] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-17T06:44:46.638722] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-17T06:44:46.639040] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-17T06:44:46.639092] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-17T06:44:46.639538] [DEBUG] [LOCAL ] TDF: Trimmed 10677 records to 6480 (keeping 200 days of data) [2025-09-17T06:44:46.679079] [DEBUG] [LOCAL ] TDF: Primary data saved (6480 records). [2025-09-17T06:44:46.679249] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-17T06:44:46.679347] [INFO ] [MAIN ] Update Progress: 2055/2369 symbols completed. TDF took 29.0s. Estimated remaining: 45m 56s. Rate: 6.8 symbols/min [2025-09-17T06:44:46.845764] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:44:46.877695] [DEBUG] [LOCAL ] TDS: Loaded 31745 existing records from primary storage. [2025-09-17T06:44:46.877888] [INFO ] [MAIN ] TDS: Loaded 31745 existing records. [2025-09-17T06:44:47.057947] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:44:47.058186] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-17T06:44:47.058237] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-17T06:44:47.059039] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-17T06:44:47.059103] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-17T06:44:47.095342] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-17T06:44:47.418490] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:44:47.890167] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-17T06:44:48.498054] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-17T06:44:48.594921] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T06:44:48.690139] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-09-17T06:44:48.864200] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T06:44:49.490166] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-11. [2025-09-17T06:44:50.290139] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-17T06:44:50.702980] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T06:44:50.983356] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T06:44:51.008698] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T06:44:51.090188] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-17T06:44:51.890207] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-09-17T06:44:52.306136] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T06:44:52.690134] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-17T06:44:53.468164] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T06:44:53.490090] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-09-17T06:44:53.932568] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T06:44:53.936445] [INFO ] [REMOTE ] TDG: Full fetch complete (32646 records). [2025-09-17T06:44:53.936547] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-17T06:44:54.294412] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-09-17T06:44:54.305909] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-17T06:44:54.306925] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-17T06:44:54.307738] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-17T06:44:54.307800] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-17T06:44:54.308715] [DEBUG] [LOCAL ] TDG: Trimmed 32646 records to 22147 (keeping 200 days of data) [2025-09-17T06:44:54.464710] [DEBUG] [LOCAL ] TDG: Primary data saved (22147 records). [2025-09-17T06:44:54.464864] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-17T06:44:54.464974] [INFO ] [MAIN ] Update Progress: 2056/2369 symbols completed. TDG took 24.3s. Estimated remaining: 45m 48s. Rate: 6.8 symbols/min [2025-09-17T06:44:54.636120] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:44:54.672703] [DEBUG] [LOCAL ] TDW: Loaded 33219 existing records from primary storage. [2025-09-17T06:44:54.672902] [INFO ] [MAIN ] TDW: Loaded 33219 existing records. [2025-09-17T06:44:54.856864] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:44:54.857277] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-17T06:44:54.857407] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-17T06:44:54.866036] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-17T06:44:54.879428] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-17T06:44:54.886864] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T06:44:55.096700] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-17T06:44:55.257011] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:44:55.890181] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-17T06:44:56.275520] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T06:44:56.690152] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-17T06:44:56.799523] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T06:44:56.832941] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T06:44:56.839906] [INFO ] [REMOTE ] TD: Full fetch complete (75657 records). [2025-09-17T06:44:56.840078] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-17T06:44:57.234102] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-17T06:44:57.234228] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-17T06:44:57.235458] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-17T06:44:57.235531] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-17T06:44:57.237337] [DEBUG] [LOCAL ] TD: Trimmed 75657 records to 52304 (keeping 200 days of data) [2025-09-17T06:44:57.520449] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-11. [2025-09-17T06:44:57.564889] [DEBUG] [LOCAL ] TD: Primary data saved (52304 records). [2025-09-17T06:44:57.565086] [INFO ] [MAIN ] TD: Full history saved. [2025-09-17T06:44:57.565200] [INFO ] [MAIN ] Update Progress: 2057/2369 symbols completed. TD took 55.6s. Estimated remaining: 45m 38s. Rate: 6.8 symbols/min [2025-09-17T06:44:57.736256] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:44:57.754631] [DEBUG] [LOCAL ] TDY: Loaded 16790 existing records from primary storage. [2025-09-17T06:44:57.754821] [INFO ] [MAIN ] TDY: Loaded 16790 existing records. [2025-09-17T06:44:57.934707] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:44:57.935631] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-17T06:44:57.935709] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-17T06:44:57.936512] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-17T06:44:57.936574] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-17T06:44:58.289995] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:44:58.290156] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-17T06:44:58.650136] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-17T06:44:59.090180] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-17T06:44:59.214438] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T06:44:59.815036] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T06:44:59.890095] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-09-17T06:45:00.690127] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-17T06:45:00.839889] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T06:45:01.218145] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T06:45:01.490181] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-09-17T06:45:02.290194] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-17T06:45:03.043254] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-17T06:45:03.090162] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-11. [2025-09-17T06:45:03.890191] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-17T06:45:04.508900] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (3.02 seconds). [2025-09-17T06:45:04.690127] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-17T06:45:04.852449] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T06:45:05.108241] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T06:45:05.490087] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-09-17T06:45:05.961382] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T06:45:06.003780] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (3.71 seconds). [2025-09-17T06:45:06.290143] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-17T06:45:06.682031] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T06:45:07.090143] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-17T06:45:07.890154] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-17T06:45:08.210586] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T06:45:08.690181] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-09-17T06:45:08.734597] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T06:45:09.342489] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T06:45:09.490105] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-17T06:45:09.841859] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T06:45:10.290142] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-17T06:45:11.090140] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-17T06:45:11.155789] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T06:45:11.179514] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T06:45:11.890153] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-17T06:45:12.690187] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-17T06:45:12.993480] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T06:45:13.490145] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-17T06:45:13.572440] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T06:45:13.888874] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T06:45:14.290203] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-17T06:45:15.090197] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-17T06:45:15.857375] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.37 seconds). [2025-09-17T06:45:15.890111] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-17T06:45:16.012407] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T06:45:16.017684] [INFO ] [REMOTE ] TDS: Full fetch complete (61321 records). [2025-09-17T06:45:16.017872] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-17T06:45:16.421660] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-17T06:45:16.421807] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-17T06:45:16.422904] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-17T06:45:16.422992] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-17T06:45:16.424351] [DEBUG] [LOCAL ] TDS: Trimmed 61321 records to 42884 (keeping 200 days of data) [2025-09-17T06:45:16.692839] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-17T06:45:16.700039] [DEBUG] [LOCAL ] TDS: Primary data saved (42884 records). [2025-09-17T06:45:16.700234] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-17T06:45:16.700369] [INFO ] [MAIN ] Update Progress: 2058/2369 symbols completed. TDS took 30.0s. Estimated remaining: 45m 31s. Rate: 6.8 symbols/min [2025-09-17T06:45:16.884816] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:45:16.885202] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-17T06:45:16.885423] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-17T06:45:16.885622] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-17T06:45:16.885794] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-17T06:45:16.885899] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-17T06:45:16.885980] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-17T06:45:17.260302] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-17T06:45:17.304280] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:45:17.490133] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-11. [2025-09-17T06:45:17.696201] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:45:17.696588] [WARN ] [REMOTE ] TE: No data returned for month 2024-11 [2025-09-17T06:45:18.290106] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-17T06:45:18.485938] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-17T06:45:18.707088] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T06:45:19.090122] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-17T06:45:19.373074] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T06:45:19.890146] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-17T06:45:20.076285] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:45:20.076639] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-17T06:45:20.670810] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T06:45:20.690129] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-17T06:45:21.490147] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-17T06:45:22.290168] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-09-17T06:45:22.505387] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:45:22.508281] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T06:45:22.513547] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-09-17T06:45:22.533977] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T06:45:22.541104] [INFO ] [REMOTE ] TDOC: Full fetch complete (77190 records). [2025-09-17T06:45:22.541281] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-17T06:45:22.943975] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-17T06:45:22.944115] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-17T06:45:22.945291] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-17T06:45:22.945395] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-17T06:45:22.947121] [DEBUG] [LOCAL ] TDOC: Trimmed 77190 records to 53358 (keeping 200 days of data) [2025-09-17T06:45:23.126292] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-17T06:45:23.277419] [DEBUG] [LOCAL ] TDOC: Primary data saved (53358 records). [2025-09-17T06:45:23.277603] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-17T06:45:23.277730] [INFO ] [MAIN ] Update Progress: 2059/2369 symbols completed. TDOC took 39.5s. Estimated remaining: 45m 22s. Rate: 6.8 symbols/min [2025-09-17T06:45:23.377488] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:45:23.378091] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-17T06:45:23.447003] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:45:23.454136] [DEBUG] [LOCAL ] TEAF: Loaded 5025 existing records from primary storage. [2025-09-17T06:45:23.454278] [INFO ] [MAIN ] TEAF: Loaded 5025 existing records. [2025-09-17T06:45:23.633163] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:45:23.633401] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-17T06:45:23.633463] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-17T06:45:23.633759] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-17T06:45:23.633819] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-17T06:45:23.895321] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-17T06:45:24.022804] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:45:24.690130] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-17T06:45:25.366551] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T06:45:25.490140] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-17T06:45:26.057789] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T06:45:26.290136] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-17T06:45:27.090189] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-11. [2025-09-17T06:45:27.275972] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T06:45:27.317108] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T06:45:27.587229] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T06:45:27.890155] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-17T06:45:28.690195] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-17T06:45:29.434526] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T06:45:29.490195] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-17T06:45:29.637561] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T06:45:29.641181] [INFO ] [REMOTE ] TDY: Full fetch complete (32237 records). [2025-09-17T06:45:29.641352] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-17T06:45:30.030560] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-17T06:45:30.030686] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-17T06:45:30.031429] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-17T06:45:30.031483] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-17T06:45:30.032329] [DEBUG] [LOCAL ] TDY: Trimmed 32237 records to 23036 (keeping 200 days of data) [2025-09-17T06:45:30.181014] [DEBUG] [LOCAL ] TDY: Primary data saved (23036 records). [2025-09-17T06:45:30.181167] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-17T06:45:30.181268] [INFO ] [MAIN ] Update Progress: 2060/2369 symbols completed. TDY took 32.6s. Estimated remaining: 45m 13s. Rate: 6.8 symbols/min [2025-09-17T06:45:30.292549] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-17T06:45:30.364016] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:45:30.400195] [DEBUG] [LOCAL ] TECK: Loaded 39817 existing records from primary storage. [2025-09-17T06:45:30.400370] [INFO ] [MAIN ] TECK: Loaded 39817 existing records. [2025-09-17T06:45:30.597279] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:45:30.597587] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-17T06:45:30.597666] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-17T06:45:30.598515] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-17T06:45:30.598570] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-17T06:45:30.997114] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:45:31.044084] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T06:45:31.090208] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-09-17T06:45:31.698977] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T06:45:31.895319] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-11. [2025-09-17T06:45:31.919784] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T06:45:32.690259] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-17T06:45:33.490163] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-09-17T06:45:33.850834] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T06:45:34.061919] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T06:45:34.290106] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-09-17T06:45:34.331586] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T06:45:35.090147] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-17T06:45:35.890121] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-17T06:45:35.942288] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T06:45:36.178952] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T06:45:36.690167] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-17T06:45:37.398622] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T06:45:37.403794] [INFO ] [REMOTE ] TDW: Full fetch complete (67167 records). [2025-09-17T06:45:37.403957] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-17T06:45:37.498038] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-17T06:45:37.809602] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-17T06:45:37.809731] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-17T06:45:37.810740] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-17T06:45:37.810806] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-17T06:45:37.812335] [DEBUG] [LOCAL ] TDW: Trimmed 67167 records to 45810 (keeping 200 days of data) [2025-09-17T06:45:38.096810] [DEBUG] [LOCAL ] TDW: Primary data saved (45810 records). [2025-09-17T06:45:38.096992] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-17T06:45:38.097116] [INFO ] [MAIN ] Update Progress: 2061/2369 symbols completed. TDW took 43.6s. Estimated remaining: 45m 4s. Rate: 6.8 symbols/min [2025-09-17T06:45:38.277464] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:45:38.292834] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-09-17T06:45:38.305427] [DEBUG] [LOCAL ] TEF: Loaded 26843 existing records from primary storage. [2025-09-17T06:45:38.305567] [INFO ] [MAIN ] TEF: Loaded 26843 existing records. [2025-09-17T06:45:38.411313] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T06:45:38.492878] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:45:38.493184] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-17T06:45:38.493312] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-17T06:45:38.493954] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-17T06:45:38.494019] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-17T06:45:38.697588] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T06:45:38.896797] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:45:39.090138] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-11. [2025-09-17T06:45:39.684768] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T06:45:39.890142] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-17T06:45:40.595367] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T06:45:40.690149] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-17T06:45:41.395690] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T06:45:41.490151] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-17T06:45:41.647803] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T06:45:42.258556] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T06:45:42.290075] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-17T06:45:42.892044] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T06:45:43.090177] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-17T06:45:43.890153] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-09-17T06:45:44.674359] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T06:45:44.690095] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-17T06:45:45.316240] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T06:45:45.490130] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-09-17T06:45:46.290218] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-17T06:45:46.364963] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T06:45:47.051219] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T06:45:47.090132] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-17T06:45:47.809947] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T06:45:47.890199] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-17T06:45:48.018527] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T06:45:48.342828] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T06:45:48.690155] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-17T06:45:49.490144] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-17T06:45:50.290206] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-17T06:45:50.500793] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T06:45:51.042833] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T06:45:51.059574] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T06:45:51.090091] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-17T06:45:51.755062] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T06:45:51.890213] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-17T06:45:52.690178] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-17T06:45:53.421240] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T06:45:53.490358] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-17T06:45:53.926185] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T06:45:54.290208] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-17T06:45:54.730164] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T06:45:55.090143] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-17T06:45:55.833017] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T06:45:55.834322] [INFO ] [REMOTE ] TEAF: Full fetch complete (9631 records). [2025-09-17T06:45:55.834437] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-17T06:45:55.898312] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-17T06:45:56.212223] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-17T06:45:56.212482] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-17T06:45:56.212779] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-17T06:45:56.212839] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-17T06:45:56.213820] [DEBUG] [LOCAL ] TEAF: Trimmed 9631 records to 7142 (keeping 200 days of data) [2025-09-17T06:45:56.263753] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-17T06:45:56.283669] [DEBUG] [LOCAL ] TEAF: Primary data saved (7142 records). [2025-09-17T06:45:56.284110] [INFO ] [REMOTE ] TE: Full fetch complete (44618 records). [2025-09-17T06:45:56.284001] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-17T06:45:56.284242] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-17T06:45:56.284418] [INFO ] [MAIN ] Update Progress: 2062/2369 symbols completed. TEAF took 33.0s. Estimated remaining: 44m 56s. Rate: 6.8 symbols/min [2025-09-17T06:45:56.652172] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 137 unique days, need 200 days [2025-09-17T06:45:56.653140] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:45:56.654239] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:45:56.654417] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:45:56.654506] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-17T06:45:56.654610] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-17T06:45:56.654702] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-17T06:45:56.654880] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-17T06:45:56.655166] [INFO ] [MAIN ] Update Progress: 2063/2369 symbols completed. TE took 40.0s. Estimated remaining: 44m 46s. Rate: 6.8 symbols/min [2025-09-17T06:45:56.699052] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-17T06:45:56.772791] [DEBUG] [LOCAL ] TEI: Loaded 15194 existing records from primary storage. [2025-09-17T06:45:56.783670] [INFO ] [MAIN ] TEI: Loaded 15194 existing records. [2025-09-17T06:45:56.927807] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:45:56.954790] [DEBUG] [LOCAL ] TEL: No existing data file found in primary storage. [2025-09-17T06:45:56.955004] [WARN ] [MAIN ] TEL: No existing data found, performing full refresh instead. [2025-09-17T06:45:56.960952] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-17T06:45:56.971293] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-17T06:45:56.995913] [DEBUG] [LOCAL ] TEL: No primary data file found to delete. [2025-09-17T06:45:57.015221] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-17T06:45:57.058016] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:45:57.135192] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-17T06:45:57.138657] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-17T06:45:57.144296] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-17T06:45:57.164787] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-17T06:45:57.486454] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T06:45:57.628448] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:45:57.664821] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-17T06:45:57.806199] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:45:58.290133] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-11. [2025-09-17T06:45:58.597908] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T06:45:59.090133] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-11. [2025-09-17T06:45:59.171834] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T06:45:59.538488] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T06:45:59.890222] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-09-17T06:46:00.690159] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-17T06:46:00.749573] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T06:46:01.051593] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T06:46:01.490176] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-09-17T06:46:02.192620] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T06:46:02.290204] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-09-17T06:46:02.626461] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T06:46:03.090146] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-17T06:46:03.893989] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-17T06:46:03.899625] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T06:46:04.146525] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T06:46:04.690148] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-17T06:46:05.299392] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T06:46:05.305941] [INFO ] [REMOTE ] TEF: Full fetch complete (54348 records). [2025-09-17T06:46:05.306177] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-17T06:46:05.491373] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-17T06:46:05.601253] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T06:46:05.752471] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-17T06:46:05.752586] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-17T06:46:05.753543] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-17T06:46:05.753617] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-17T06:46:05.754930] [DEBUG] [LOCAL ] TEF: Trimmed 54348 records to 37615 (keeping 200 days of data) [2025-09-17T06:46:05.986675] [DEBUG] [LOCAL ] TEF: Primary data saved (37615 records). [2025-09-17T06:46:05.986919] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-17T06:46:05.987053] [INFO ] [MAIN ] Update Progress: 2064/2369 symbols completed. TEF took 27.9s. Estimated remaining: 44m 37s. Rate: 6.8 symbols/min [2025-09-17T06:46:06.162271] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:46:06.185254] [DEBUG] [LOCAL ] TEN: Loaded 22445 existing records from primary storage. [2025-09-17T06:46:06.185458] [INFO ] [MAIN ] TEN: Loaded 22445 existing records. [2025-09-17T06:46:06.296350] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-09-17T06:46:06.385809] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:46:06.386101] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-17T06:46:06.386176] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-17T06:46:06.386829] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-17T06:46:06.386907] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-17T06:46:06.774320] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:46:07.090125] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-11. [2025-09-17T06:46:07.494326] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T06:46:07.890242] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-17T06:46:08.045809] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T06:46:08.148275] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T06:46:08.539976] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-17T06:46:08.690151] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-17T06:46:09.490165] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-17T06:46:10.290173] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-09-17T06:46:10.391994] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T06:46:11.090164] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-17T06:46:11.254292] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T06:46:11.261400] [INFO ] [REMOTE ] TECK: Full fetch complete (77130 records). [2025-09-17T06:46:11.261711] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-17T06:46:11.498881] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T06:46:11.713511] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-17T06:46:11.713656] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-17T06:46:11.714863] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-17T06:46:11.714986] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-17T06:46:11.717736] [DEBUG] [LOCAL ] TECK: Trimmed 77130 records to 53443 (keeping 200 days of data) [2025-09-17T06:46:11.911258] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-09-17T06:46:12.075270] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T06:46:12.101422] [DEBUG] [LOCAL ] TECK: Primary data saved (53443 records). [2025-09-17T06:46:12.101800] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-17T06:46:12.101928] [INFO ] [MAIN ] Update Progress: 2065/2369 symbols completed. TECK took 41.9s. Estimated remaining: 44m 28s. Rate: 6.8 symbols/min [2025-09-17T06:46:12.280397] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:46:12.298146] [DEBUG] [LOCAL ] TEO: Loaded 16345 existing records from primary storage. [2025-09-17T06:46:12.298303] [INFO ] [MAIN ] TEO: Loaded 16345 existing records. [2025-09-17T06:46:12.477485] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:46:12.477769] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-17T06:46:12.477838] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-17T06:46:12.478202] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-17T06:46:12.478273] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-17T06:46:12.699880] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-17T06:46:12.847532] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:46:13.265229] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T06:46:13.490141] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-11. [2025-09-17T06:46:13.866076] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T06:46:14.290158] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-17T06:46:14.937207] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T06:46:15.090118] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-17T06:46:15.529096] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T06:46:15.890155] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-17T06:46:16.690145] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-17T06:46:16.844237] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T06:46:17.490155] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-17T06:46:17.565090] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T06:46:17.590059] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T06:46:18.290137] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-17T06:46:19.090159] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-17T06:46:19.310766] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T06:46:19.715809] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T06:46:19.890148] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-17T06:46:20.132824] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T06:46:20.690125] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-17T06:46:21.490132] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-09-17T06:46:21.561029] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T06:46:21.757894] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T06:46:21.760926] [INFO ] [REMOTE ] TEI: Full fetch complete (29637 records). [2025-09-17T06:46:21.761059] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-17T06:46:22.193880] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-17T06:46:22.193999] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-17T06:46:22.194662] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-17T06:46:22.194718] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-17T06:46:22.195549] [DEBUG] [LOCAL ] TEI: Trimmed 29637 records to 20309 (keeping 200 days of data) [2025-09-17T06:46:22.309686] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-17T06:46:22.326505] [DEBUG] [LOCAL ] TEI: Primary data saved (20309 records). [2025-09-17T06:46:22.326759] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-17T06:46:22.326939] [INFO ] [MAIN ] Update Progress: 2066/2369 symbols completed. TEI took 26.0s. Estimated remaining: 44m 20s. Rate: 6.8 symbols/min [2025-09-17T06:46:22.439156] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T06:46:22.516297] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:46:22.556888] [DEBUG] [LOCAL ] TEVA: Loaded 39987 existing records from primary storage. [2025-09-17T06:46:22.557095] [INFO ] [MAIN ] TEVA: Loaded 39987 existing records. [2025-09-17T06:46:22.740738] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:46:22.740986] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-17T06:46:22.741046] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-17T06:46:22.741943] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-17T06:46:22.742017] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-17T06:46:23.099601] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-17T06:46:23.104068] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:46:23.458039] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T06:46:23.890143] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-11. [2025-09-17T06:46:24.695254] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-17T06:46:24.714628] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T06:46:25.490197] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-09-17T06:46:25.735853] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T06:46:25.798384] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T06:46:26.290181] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-17T06:46:26.726784] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T06:46:27.090204] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-09-17T06:46:27.654859] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T06:46:27.890208] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-17T06:46:28.657820] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T06:46:28.690154] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-17T06:46:29.266743] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T06:46:29.490124] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-17T06:46:29.705408] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T06:46:30.290141] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-17T06:46:31.090206] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-17T06:46:31.220100] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T06:46:31.668796] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T06:46:31.674317] [INFO ] [REMOTE ] TEN: Full fetch complete (45216 records). [2025-09-17T06:46:31.674444] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-17T06:46:31.895327] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-17T06:46:32.056389] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-17T06:46:32.056512] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-17T06:46:32.057496] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-17T06:46:32.057568] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-17T06:46:32.058682] [DEBUG] [LOCAL ] TEN: Trimmed 45216 records to 31223 (keeping 200 days of data) [2025-09-17T06:46:32.183599] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T06:46:32.269332] [DEBUG] [LOCAL ] TEN: Primary data saved (31223 records). [2025-09-17T06:46:32.269500] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-17T06:46:32.269603] [INFO ] [MAIN ] Update Progress: 2067/2369 symbols completed. TEN took 26.3s. Estimated remaining: 44m 11s. Rate: 6.8 symbols/min [2025-09-17T06:46:32.438373] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:46:32.474801] [DEBUG] [LOCAL ] TEX: Loaded 32728 existing records from primary storage. [2025-09-17T06:46:32.474979] [INFO ] [MAIN ] TEX: Loaded 32728 existing records. [2025-09-17T06:46:32.653149] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:46:32.653456] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-17T06:46:32.653516] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-17T06:46:32.654359] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-17T06:46:32.654434] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-17T06:46:32.698330] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-17T06:46:33.014164] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:46:33.490141] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-11. [2025-09-17T06:46:33.664632] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T06:46:33.924202] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T06:46:34.290159] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-17T06:46:35.034329] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T06:46:35.090090] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-09-17T06:46:35.890109] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-09-17T06:46:35.947509] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T06:46:35.953563] [INFO ] [REMOTE ] TEL: Full fetch complete (73070 records). [2025-09-17T06:46:35.953798] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-17T06:46:36.350818] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-17T06:46:36.350991] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-17T06:46:36.352200] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-17T06:46:36.352260] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-17T06:46:36.354158] [DEBUG] [LOCAL ] TEL: Trimmed 73070 records to 51197 (keeping 200 days of data) [2025-09-17T06:46:36.472918] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T06:46:36.693668] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-17T06:46:36.719472] [DEBUG] [LOCAL ] TEL: Primary data saved (51197 records). [2025-09-17T06:46:36.719655] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-17T06:46:36.719742] [INFO ] [MAIN ] Update Progress: 2068/2369 symbols completed. TEL took 40.1s. Estimated remaining: 44m 2s. Rate: 6.8 symbols/min [2025-09-17T06:46:36.895169] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:46:36.895402] [DEBUG] [LOCAL ] TFC: No existing data file found in primary storage. [2025-09-17T06:46:36.895454] [WARN ] [MAIN ] TFC: No existing data found, performing full refresh instead. [2025-09-17T06:46:36.895557] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-17T06:46:36.895606] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-17T06:46:36.895674] [DEBUG] [LOCAL ] TFC: No primary data file found to delete. [2025-09-17T06:46:36.895718] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-17T06:46:37.264812] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:46:37.490113] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-09-17T06:46:37.548732] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T06:46:37.798049] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T06:46:38.290140] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-17T06:46:38.673563] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T06:46:39.090118] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-17T06:46:39.890162] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-11. [2025-09-17T06:46:40.172137] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T06:46:40.347271] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-17T06:46:40.690207] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-17T06:46:41.490167] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-17T06:46:41.563237] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T06:46:42.297068] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-09-17T06:46:42.299900] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T06:46:42.574496] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T06:46:43.090140] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-17T06:46:43.890140] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-17T06:46:44.157588] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T06:46:44.690154] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-09-17T06:46:44.739770] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T06:46:45.490161] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-17T06:46:45.961516] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-17T06:46:46.290176] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-17T06:46:46.383026] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T06:46:46.506274] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T06:46:47.090162] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-17T06:46:47.890117] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-17T06:46:48.376347] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T06:46:48.690161] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-17T06:46:48.739704] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T06:46:49.122699] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T06:46:49.126759] [INFO ] [REMOTE ] TEO: Full fetch complete (32466 records). [2025-09-17T06:46:49.126933] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-17T06:46:49.490540] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-17T06:46:49.530853] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-17T06:46:49.530982] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-17T06:46:49.531990] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-17T06:46:49.532076] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-17T06:46:49.533058] [DEBUG] [LOCAL ] TEO: Trimmed 32466 records to 21560 (keeping 200 days of data) [2025-09-17T06:46:49.661988] [DEBUG] [LOCAL ] TEO: Primary data saved (21560 records). [2025-09-17T06:46:49.662158] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-17T06:46:49.662276] [INFO ] [MAIN ] Update Progress: 2069/2369 symbols completed. TEO took 37.6s. Estimated remaining: 43m 54s. Rate: 6.8 symbols/min [2025-09-17T06:46:49.837216] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:46:49.859938] [DEBUG] [LOCAL ] TFII: Loaded 23958 existing records from primary storage. [2025-09-17T06:46:49.860123] [INFO ] [MAIN ] TFII: Loaded 23958 existing records. [2025-09-17T06:46:50.036893] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:46:50.037214] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-17T06:46:50.037299] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-17T06:46:50.037949] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-17T06:46:50.038046] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-17T06:46:50.293308] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-17T06:46:50.404376] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:46:50.434421] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T06:46:51.090155] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-11. [2025-09-17T06:46:51.606434] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T06:46:51.681228] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T06:46:51.890218] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-17T06:46:52.329546] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T06:46:52.690183] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-17T06:46:53.490136] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-17T06:46:53.597715] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T06:46:53.727315] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T06:46:54.290151] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-17T06:46:55.090143] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-17T06:46:55.316710] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T06:46:55.408314] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T06:46:55.890184] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-17T06:46:56.690162] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-17T06:46:57.117237] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T06:46:57.448535] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T06:46:57.490127] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-17T06:46:58.290184] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-09-17T06:46:58.585776] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T06:46:58.962478] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T06:46:58.967799] [INFO ] [REMOTE ] TEX: Full fetch complete (64621 records). [2025-09-17T06:46:58.967938] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-17T06:46:59.113525] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-17T06:46:59.386621] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-17T06:46:59.404268] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-17T06:46:59.407905] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T06:46:59.406263] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-17T06:46:59.413657] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-17T06:46:59.415474] [DEBUG] [LOCAL ] TEX: Trimmed 64621 records to 45043 (keeping 200 days of data) [2025-09-17T06:46:59.710119] [DEBUG] [LOCAL ] TEX: Primary data saved (45043 records). [2025-09-17T06:46:59.710316] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-17T06:46:59.710441] [INFO ] [MAIN ] Update Progress: 2070/2369 symbols completed. TEX took 27.4s. Estimated remaining: 43m 45s. Rate: 6.8 symbols/min [2025-09-17T06:46:59.881328] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:46:59.891200] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-09-17T06:46:59.900399] [DEBUG] [LOCAL ] TFIN: Loaded 17170 existing records from primary storage. [2025-09-17T06:46:59.900668] [INFO ] [MAIN ] TFIN: Loaded 17170 existing records. [2025-09-17T06:47:00.084065] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:47:00.084358] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-17T06:47:00.084434] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-17T06:47:00.084966] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-17T06:47:00.085044] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-17T06:47:00.445893] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:47:00.690118] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-11. [2025-09-17T06:47:00.974131] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T06:47:01.291596] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T06:47:01.490186] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-17T06:47:01.636858] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T06:47:02.290142] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-17T06:47:03.090100] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-17T06:47:03.358568] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T06:47:03.365128] [INFO ] [REMOTE ] TEVA: Full fetch complete (77514 records). [2025-09-17T06:47:03.365266] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-17T06:47:03.753917] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-17T06:47:03.754025] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-17T06:47:03.755126] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-17T06:47:03.755187] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-17T06:47:03.756809] [DEBUG] [LOCAL ] TEVA: Trimmed 77514 records to 53632 (keeping 200 days of data) [2025-09-17T06:47:03.939613] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-09-17T06:47:04.106344] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T06:47:04.135868] [DEBUG] [LOCAL ] TEVA: Primary data saved (53632 records). [2025-09-17T06:47:04.136007] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-17T06:47:04.136097] [INFO ] [MAIN ] Update Progress: 2071/2369 symbols completed. TEVA took 41.8s. Estimated remaining: 43m 36s. Rate: 6.8 symbols/min [2025-09-17T06:47:04.305985] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:47:04.337807] [DEBUG] [LOCAL ] TFPM: Loaded 28849 existing records from primary storage. [2025-09-17T06:47:04.337964] [INFO ] [MAIN ] TFPM: Loaded 28849 existing records. [2025-09-17T06:47:04.515750] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:47:04.516005] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-17T06:47:04.516114] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-17T06:47:04.516822] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-17T06:47:04.516887] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-17T06:47:04.660360] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T06:47:04.701843] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-17T06:47:04.837051] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T06:47:04.918550] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:47:05.490182] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-11. [2025-09-17T06:47:06.290089] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-17T06:47:06.524497] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T06:47:06.764825] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T06:47:07.090135] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-09-17T06:47:07.890132] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-17T06:47:07.897675] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T06:47:08.384415] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T06:47:08.690144] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-09-17T06:47:09.490136] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-09-17T06:47:09.702873] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T06:47:09.756520] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T06:47:10.290170] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-17T06:47:10.511339] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T06:47:11.090174] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-17T06:47:11.800415] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T06:47:11.890135] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-17T06:47:12.690124] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-17T06:47:12.842835] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T06:47:12.886041] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T06:47:13.490158] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-17T06:47:13.671495] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T06:47:14.290157] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-17T06:47:14.777752] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T06:47:15.090187] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-17T06:47:15.600084] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T06:47:15.890187] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-17T06:47:16.586958] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T06:47:16.593591] [INFO ] [REMOTE ] TFC: Full fetch complete (77519 records). [2025-09-17T06:47:16.593788] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-17T06:47:16.696260] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-17T06:47:16.990797] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-17T06:47:16.990916] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-17T06:47:16.992142] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-17T06:47:16.992220] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-17T06:47:16.993765] [DEBUG] [LOCAL ] TFC: Trimmed 77519 records to 53667 (keeping 200 days of data) [2025-09-17T06:47:17.236972] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T06:47:17.347317] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-09-17T06:47:17.347482] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-17T06:47:17.347575] [INFO ] [MAIN ] Update Progress: 2072/2369 symbols completed. TFC took 40.6s. Estimated remaining: 43m 27s. Rate: 6.8 symbols/min [2025-09-17T06:47:17.496437] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-17T06:47:17.521333] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:47:17.548106] [DEBUG] [LOCAL ] TFX: Loaded 26181 existing records from primary storage. [2025-09-17T06:47:17.548262] [INFO ] [MAIN ] TFX: Loaded 26181 existing records. [2025-09-17T06:47:17.726469] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:47:17.726728] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-17T06:47:17.726787] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-17T06:47:17.727424] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-17T06:47:17.727486] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-17T06:47:18.086087] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:47:18.107247] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T06:47:18.290122] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-11. [2025-09-17T06:47:18.640316] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T06:47:19.090197] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-17T06:47:19.667865] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T06:47:19.890235] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-17T06:47:20.628195] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T06:47:20.690089] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-17T06:47:21.111198] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T06:47:21.490134] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-09-17T06:47:22.166248] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T06:47:22.290103] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-17T06:47:22.926021] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T06:47:23.090138] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-09-17T06:47:23.799462] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T06:47:23.890157] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-17T06:47:24.653119] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T06:47:24.690138] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-17T06:47:25.254457] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T06:47:25.490170] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-17T06:47:26.218467] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T06:47:26.290124] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-17T06:47:26.565362] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T06:47:27.090200] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-17T06:47:27.890184] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-17T06:47:28.067125] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T06:47:28.217313] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T06:47:28.690094] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-17T06:47:29.169605] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T06:47:29.490184] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-17T06:47:29.694056] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T06:47:30.290198] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-17T06:47:30.415324] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T06:47:30.419155] [INFO ] [REMOTE ] TFII: Full fetch complete (47342 records). [2025-09-17T06:47:30.419321] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-17T06:47:30.818924] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-17T06:47:30.819048] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-17T06:47:30.819944] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-17T06:47:30.820012] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-17T06:47:30.821285] [DEBUG] [LOCAL ] TFII: Trimmed 47342 records to 34947 (keeping 200 days of data) [2025-09-17T06:47:31.037821] [DEBUG] [LOCAL ] TFII: Primary data saved (34947 records). [2025-09-17T06:47:31.037992] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-17T06:47:31.038083] [INFO ] [MAIN ] Update Progress: 2073/2369 symbols completed. TFII took 41.4s. Estimated remaining: 43m 19s. Rate: 6.8 symbols/min [2025-09-17T06:47:31.096841] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-17T06:47:31.213242] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:47:31.222188] [DEBUG] [LOCAL ] TG: Loaded 7400 existing records from primary storage. [2025-09-17T06:47:31.222321] [INFO ] [MAIN ] TG: Loaded 7400 existing records. [2025-09-17T06:47:31.403931] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:47:31.404193] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-17T06:47:31.404252] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-17T06:47:31.404821] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-17T06:47:31.404884] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-17T06:47:31.777280] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:47:31.893702] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T06:47:31.890789] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-17T06:47:32.537074] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T06:47:32.542540] [INFO ] [REMOTE ] TFPM: Full fetch complete (49664 records). [2025-09-17T06:47:32.542726] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-17T06:47:32.694577] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-11. [2025-09-17T06:47:32.961941] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-17T06:47:32.962046] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-17T06:47:32.962936] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-17T06:47:32.962991] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-17T06:47:32.964097] [DEBUG] [LOCAL ] TFPM: Trimmed 49664 records to 36910 (keeping 200 days of data) [2025-09-17T06:47:33.191657] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T06:47:33.228543] [DEBUG] [LOCAL ] TFPM: Primary data saved (36910 records). [2025-09-17T06:47:33.228775] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-17T06:47:33.228884] [INFO ] [MAIN ] Update Progress: 2074/2369 symbols completed. TFPM took 29.1s. Estimated remaining: 43m 10s. Rate: 6.8 symbols/min [2025-09-17T06:47:33.400203] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:47:33.400409] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-17T06:47:33.400521] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-17T06:47:33.400659] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-17T06:47:33.400711] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-17T06:47:33.400766] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-17T06:47:33.400807] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-17T06:47:33.497017] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-17T06:47:33.771522] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:47:33.782255] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T06:47:34.290140] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-17T06:47:34.868984] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T06:47:35.090159] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-17T06:47:35.390366] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T06:47:35.890156] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-11. [2025-09-17T06:47:36.090452] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:47:36.090897] [WARN ] [REMOTE ] TGE: No data returned for month 2024-11 [2025-09-17T06:47:36.425606] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T06:47:36.690162] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-17T06:47:37.490157] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-17T06:47:38.043986] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T06:47:38.290121] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-17T06:47:38.485839] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:47:38.486186] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-17T06:47:38.582236] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T06:47:38.585548] [INFO ] [REMOTE ] TFIN: Full fetch complete (30391 records). [2025-09-17T06:47:38.585693] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-17T06:47:38.960630] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-17T06:47:38.960774] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-17T06:47:38.961534] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-17T06:47:38.961618] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-17T06:47:38.962759] [DEBUG] [LOCAL ] TFIN: Trimmed 30391 records to 23538 (keeping 200 days of data) [2025-09-17T06:47:39.096254] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-09-17T06:47:39.109608] [DEBUG] [LOCAL ] TFIN: Primary data saved (23538 records). [2025-09-17T06:47:39.109738] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-17T06:47:39.109851] [INFO ] [MAIN ] Update Progress: 2075/2369 symbols completed. TFIN took 39.4s. Estimated remaining: 43m 0s. Rate: 6.8 symbols/min [2025-09-17T06:47:39.281200] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:47:39.301494] [DEBUG] [LOCAL ] TGLS: Loaded 20263 existing records from primary storage. [2025-09-17T06:47:39.301713] [INFO ] [MAIN ] TGLS: Loaded 20263 existing records. [2025-09-17T06:47:39.480183] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:47:39.480458] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-17T06:47:39.480518] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-17T06:47:39.481050] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-17T06:47:39.481116] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-17T06:47:39.836863] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:47:39.890144] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-17T06:47:40.080493] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T06:47:40.690163] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-11. [2025-09-17T06:47:41.318589] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T06:47:41.490152] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-09-17T06:47:41.678889] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:47:41.679257] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-09-17T06:47:41.961826] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T06:47:42.290162] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-17T06:47:42.493375] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:47:42.493755] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-17T06:47:43.090159] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-09-17T06:47:43.890212] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-17T06:47:44.245703] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T06:47:44.690206] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-09-17T06:47:45.150140] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T06:47:45.155232] [INFO ] [REMOTE ] TFX: Full fetch complete (53775 records). [2025-09-17T06:47:45.155380] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-17T06:47:45.495270] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-09-17T06:47:45.551340] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-17T06:47:45.551461] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-17T06:47:45.552463] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-17T06:47:45.552537] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-17T06:47:45.553908] [DEBUG] [LOCAL ] TFX: Trimmed 53775 records to 37839 (keeping 200 days of data) [2025-09-17T06:47:45.803883] [DEBUG] [LOCAL ] TFX: Primary data saved (37839 records). [2025-09-17T06:47:45.804085] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-17T06:47:45.804202] [INFO ] [MAIN ] Update Progress: 2076/2369 symbols completed. TFX took 28.5s. Estimated remaining: 42m 51s. Rate: 6.8 symbols/min [2025-09-17T06:47:45.984534] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:47:46.002498] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T06:47:46.039029] [DEBUG] [LOCAL ] TGNA: Loaded 35921 existing records from primary storage. [2025-09-17T06:47:46.039200] [INFO ] [MAIN ] TGNA: Loaded 35921 existing records. [2025-09-17T06:47:46.226071] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:47:46.226316] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-17T06:47:46.226411] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-17T06:47:46.227168] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-17T06:47:46.227231] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-17T06:47:46.295246] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-17T06:47:46.430219] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T06:47:46.620569] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:47:47.090091] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-17T06:47:47.190897] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T06:47:47.559928] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T06:47:47.890141] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-17T06:47:48.690183] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-17T06:47:48.736021] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T06:47:48.894458] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:47:48.894851] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-17T06:47:49.490131] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-17T06:47:50.290129] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-17T06:47:50.812177] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T06:47:50.842219] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T06:47:51.090143] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-17T06:47:51.299820] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:47:51.300207] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-17T06:47:51.890148] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-17T06:47:52.686437] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T06:47:52.690073] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-17T06:47:53.179737] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T06:47:53.490151] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-11. [2025-09-17T06:47:54.290137] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-17T06:47:55.083256] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T06:47:55.090076] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-17T06:47:55.161636] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T06:47:55.890143] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-17T06:47:55.905814] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T06:47:56.690095] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-09-17T06:47:57.172770] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T06:47:57.490135] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-17T06:47:57.854435] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T06:47:58.233433] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T06:47:58.235509] [INFO ] [REMOTE ] TG: Full fetch complete (15160 records). [2025-09-17T06:47:58.235676] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-17T06:47:58.298910] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-09-17T06:47:58.620608] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-17T06:47:58.620758] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-17T06:47:58.621159] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-17T06:47:58.621215] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-17T06:47:58.621868] [DEBUG] [LOCAL ] TG: Trimmed 15160 records to 10281 (keeping 200 days of data) [2025-09-17T06:47:58.689788] [DEBUG] [LOCAL ] TG: Primary data saved (10281 records). [2025-09-17T06:47:58.690015] [INFO ] [MAIN ] TG: Full history saved. [2025-09-17T06:47:58.690153] [INFO ] [MAIN ] Update Progress: 2077/2369 symbols completed. TG took 27.7s. Estimated remaining: 42m 43s. Rate: 6.8 symbols/min [2025-09-17T06:47:59.090213] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-17T06:47:59.890236] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-17T06:47:59.964516] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T06:48:00.376511] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:48:00.377047] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-17T06:48:00.396867] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T06:48:00.690136] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-17T06:48:01.490169] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-17T06:48:02.158858] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T06:48:02.290160] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-17T06:48:03.090225] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-17T06:48:04.410813] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (2.92 seconds). [2025-09-17T06:48:04.420836] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-17T06:48:04.581166] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-17T06:48:04.700951] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-17T06:48:04.705495] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T06:48:05.490226] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-17T06:48:06.143679] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T06:48:06.280330] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T06:48:06.290204] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-17T06:48:06.386832] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T06:48:07.090182] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-17T06:48:07.348530] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T06:48:07.352121] [INFO ] [REMOTE ] TGLS: Full fetch complete (40047 records). [2025-09-17T06:48:07.352253] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-17T06:48:07.741412] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-17T06:48:07.741542] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-17T06:48:07.742497] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-17T06:48:07.742575] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-17T06:48:07.743785] [DEBUG] [LOCAL ] TGLS: Trimmed 40047 records to 28570 (keeping 200 days of data) [2025-09-17T06:48:07.896551] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-17T06:48:07.923577] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T06:48:07.951003] [DEBUG] [LOCAL ] TGLS: Primary data saved (28570 records). [2025-09-17T06:48:07.951327] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-17T06:48:07.951611] [INFO ] [MAIN ] Update Progress: 2078/2369 symbols completed. TGLS took 28.8s. Estimated remaining: 42m 34s. Rate: 6.8 symbols/min [2025-09-17T06:48:08.690172] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-17T06:48:09.478170] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T06:48:09.490067] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-17T06:48:09.527104] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T06:48:09.529081] [INFO ] [REMOTE ] TGE: Full fetch complete (7563 records). [2025-09-17T06:48:09.529170] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-17T06:48:09.707633] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 71 unique days, need 200 days [2025-09-17T06:48:09.707884] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:48:09.707939] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:48:09.707986] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-17T06:48:09.708062] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-17T06:48:09.708111] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-17T06:48:09.708177] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-17T06:48:09.708260] [INFO ] [MAIN ] Update Progress: 2079/2369 symbols completed. TGE took 36.5s. Estimated remaining: 42m 25s. Rate: 6.8 symbols/min [2025-09-17T06:48:11.120430] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T06:48:11.130899] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-17T06:48:12.643775] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T06:48:12.653665] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-17T06:48:14.092032] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T06:48:14.102584] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-17T06:48:16.740877] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (2.64 seconds). [2025-09-17T06:48:16.752209] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-17T06:48:18.398164] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T06:48:18.404218] [INFO ] [REMOTE ] TGNA: Full fetch complete (69669 records). [2025-09-17T06:48:18.404363] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-17T06:48:18.796661] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-17T06:48:18.796775] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-17T06:48:18.797816] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-17T06:48:18.797887] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-17T06:48:18.799325] [DEBUG] [LOCAL ] TGNA: Trimmed 69669 records to 48714 (keeping 200 days of data) [2025-09-17T06:48:19.105334] [DEBUG] [LOCAL ] TGNA: Primary data saved (48714 records). [2025-09-17T06:48:19.105498] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-17T06:48:19.105596] [INFO ] [MAIN ] Update Progress: 2080/2369 symbols completed. TGNA took 33.3s. Estimated remaining: 42m 16s. Rate: 6.8 symbols/min [2025-09-17T06:48:19.718076] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:48:19.719837] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:48:19.780057] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:48:19.830889] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:48:19.865582] [DEBUG] [LOCAL ] THG: Loaded 15613 existing records from primary storage. [2025-09-17T06:48:19.874700] [INFO ] [MAIN ] THG: Loaded 15613 existing records. [2025-09-17T06:48:19.919036] [DEBUG] [LOCAL ] TGS: Loaded 23951 existing records from primary storage. [2025-09-17T06:48:19.962478] [INFO ] [MAIN ] TGS: Loaded 23951 existing records. [2025-09-17T06:48:19.997635] [DEBUG] [LOCAL ] THC: Loaded 35826 existing records from primary storage. [2025-09-17T06:48:20.055701] [INFO ] [MAIN ] THC: Loaded 35826 existing records. [2025-09-17T06:48:20.258295] [DEBUG] [LOCAL ] TGT: Loaded 40128 existing records from primary storage. [2025-09-17T06:48:20.350248] [INFO ] [MAIN ] TGT: Loaded 40128 existing records. [2025-09-17T06:48:20.383116] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:48:20.444958] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:48:20.419125] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-17T06:48:20.522313] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-17T06:48:20.550432] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-17T06:48:20.573515] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:48:20.573659] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-17T06:48:20.578796] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-17T06:48:20.596083] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-17T06:48:20.607011] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-17T06:48:20.646052] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-17T06:48:20.633488] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-17T06:48:20.690977] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-17T06:48:20.823618] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-17T06:48:20.800661] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:48:20.874415] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-17T06:48:20.907521] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-17T06:48:21.022224] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-17T06:48:21.173239] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-17T06:48:21.260551] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-17T06:48:21.560061] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:48:21.617308] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-11. [2025-09-17T06:48:21.790862] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:48:21.921937] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-11. [2025-09-17T06:48:22.212555] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:48:22.227081] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-11. [2025-09-17T06:48:22.231541] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:48:22.232952] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-11. [2025-09-17T06:48:22.754695] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T06:48:22.758991] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-09-17T06:48:23.258851] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T06:48:23.265267] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-09-17T06:48:23.637426] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T06:48:23.647277] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-09-17T06:48:23.825742] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T06:48:23.832192] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-17T06:48:23.881750] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T06:48:23.892955] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-09-17T06:48:24.485986] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T06:48:24.492827] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-09-17T06:48:24.921587] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T06:48:24.925986] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-17T06:48:25.094993] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T06:48:25.104557] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-09-17T06:48:25.734627] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T06:48:25.739991] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-17T06:48:25.764988] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T06:48:25.773566] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-17T06:48:26.084041] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-17T06:48:26.095551] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-09-17T06:48:26.471042] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T06:48:26.482291] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-17T06:48:26.583809] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T06:48:26.590929] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-17T06:48:26.947145] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T06:48:27.090144] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-17T06:48:27.704564] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T06:48:27.890133] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-17T06:48:28.421207] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T06:48:28.527427] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.43 seconds). [2025-09-17T06:48:28.570778] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T06:48:28.690118] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-17T06:48:29.189145] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T06:48:29.490175] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-17T06:48:30.290146] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-17T06:48:30.353960] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T06:48:30.381697] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T06:48:31.090196] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-17T06:48:31.613876] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T06:48:31.890146] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-17T06:48:32.099624] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T06:48:32.690090] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-17T06:48:33.175926] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T06:48:33.490169] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-17T06:48:33.755239] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T06:48:34.290194] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-17T06:48:34.980326] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T06:48:35.090150] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-17T06:48:35.141618] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T06:48:35.890128] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-17T06:48:36.193986] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T06:48:36.690174] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-17T06:48:37.490109] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-17T06:48:38.009744] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-17T06:48:38.290107] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-17T06:48:38.452958] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T06:48:38.529284] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T06:48:38.532094] [INFO ] [REMOTE ] THG: Full fetch complete (31075 records). [2025-09-17T06:48:38.532255] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-17T06:48:38.923608] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-17T06:48:38.923733] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-17T06:48:38.924428] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-17T06:48:38.924492] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-17T06:48:38.925360] [DEBUG] [LOCAL ] THG: Trimmed 31075 records to 22228 (keeping 200 days of data) [2025-09-17T06:48:39.078677] [DEBUG] [LOCAL ] THG: Primary data saved (22228 records). [2025-09-17T06:48:39.078841] [INFO ] [MAIN ] THG: Full history saved. [2025-09-17T06:48:39.079162] [INFO ] [MAIN ] Update Progress: 2081/2369 symbols completed. THG took 20.0s. Estimated remaining: 42m 9s. Rate: 6.8 symbols/min [2025-09-17T06:48:39.099876] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-17T06:48:39.270762] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:48:39.276216] [DEBUG] [LOCAL ] THIR: Loaded 1806 existing records from primary storage. [2025-09-17T06:48:39.276369] [INFO ] [MAIN ] THIR: Loaded 1806 existing records. [2025-09-17T06:48:39.468196] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:48:39.468544] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-17T06:48:39.468636] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-17T06:48:39.468882] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-17T06:48:39.469168] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-17T06:48:39.846610] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:48:39.890143] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-11. [2025-09-17T06:48:40.286430] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-17T06:48:40.553452] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T06:48:40.644433] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-17T06:48:40.690095] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-17T06:48:41.490143] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-09-17T06:48:41.801744] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-17T06:48:42.290175] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-17T06:48:42.989726] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-17T06:48:43.090101] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-17T06:48:43.689715] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T06:48:43.695453] [INFO ] [REMOTE ] TGS: Full fetch complete (46703 records). [2025-09-17T06:48:43.695594] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-17T06:48:43.901266] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-17T06:48:44.090995] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-17T06:48:44.091306] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-17T06:48:44.092286] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-17T06:48:44.092375] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-17T06:48:44.094586] [DEBUG] [LOCAL ] TGS: Trimmed 46703 records to 32080 (keeping 200 days of data) [2025-09-17T06:48:44.226565] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T06:48:44.308950] [DEBUG] [LOCAL ] TGS: Primary data saved (32080 records). [2025-09-17T06:48:44.309130] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-17T06:48:44.309265] [INFO ] [MAIN ] Update Progress: 2082/2369 symbols completed. TGS took 25.2s. Estimated remaining: 41m 60s. Rate: 6.8 symbols/min [2025-09-17T06:48:44.491613] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:48:44.494582] [DEBUG] [LOCAL ] THLV: Loaded 1090 existing records from primary storage. [2025-09-17T06:48:44.494695] [INFO ] [MAIN ] THLV: Loaded 1090 existing records. [2025-09-17T06:48:44.682678] [WARN ] [MAIN ] THLV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:48:44.682955] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-17T06:48:44.683027] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-17T06:48:44.683224] [DEBUG] [LOCAL ] THLV: Deleted primary data file. [2025-09-17T06:48:44.683294] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-17T06:48:44.696345] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-17T06:48:45.061461] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:48:45.359270] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-17T06:48:45.490187] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-17T06:48:46.290120] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-11. [2025-09-17T06:48:46.324792] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T06:48:46.575683] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-11 (0.29 seconds). [2025-09-17T06:48:47.090169] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-17T06:48:47.605483] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-17T06:48:47.890178] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-17T06:48:48.690099] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-17T06:48:48.780445] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T06:48:49.001283] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.31 seconds). [2025-09-17T06:48:49.490219] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-17T06:48:49.817578] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T06:48:50.202149] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-17T06:48:50.290107] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-17T06:48:50.735204] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T06:48:51.090138] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-17T06:48:51.890140] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-17T06:48:52.611900] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T06:48:52.690106] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-17T06:48:53.490138] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-09-17T06:48:53.591385] [DEBUG] [REMOTE ] THLV: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-17T06:48:53.591725] [WARN ] [REMOTE ] THLV: No data returned for month 2024-12 [2025-09-17T06:48:54.209469] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T06:48:54.215365] [INFO ] [REMOTE ] THC: Full fetch complete (69584 records). [2025-09-17T06:48:54.215629] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-17T06:48:54.294286] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-17T06:48:54.463375] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-17T06:48:54.681068] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-17T06:48:54.681181] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-17T06:48:54.682364] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-17T06:48:54.682436] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-17T06:48:54.684389] [DEBUG] [LOCAL ] THC: Trimmed 69584 records to 48406 (keeping 200 days of data) [2025-09-17T06:48:54.907564] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T06:48:54.999722] [DEBUG] [LOCAL ] THC: Primary data saved (48406 records). [2025-09-17T06:48:54.999906] [INFO ] [MAIN ] THC: Full history saved. [2025-09-17T06:48:55.000032] [INFO ] [MAIN ] Update Progress: 2083/2369 symbols completed. THC took 35.9s. Estimated remaining: 41m 51s. Rate: 6.8 symbols/min [2025-09-17T06:48:55.098752] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-09-17T06:48:55.174198] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:48:55.206416] [DEBUG] [LOCAL ] THO: Loaded 30596 existing records from primary storage. [2025-09-17T06:48:55.206581] [INFO ] [MAIN ] THO: Loaded 30596 existing records. [2025-09-17T06:48:55.400957] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:48:55.401246] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-17T06:48:55.401312] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-17T06:48:55.402096] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-17T06:48:55.402171] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-17T06:48:55.628711] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T06:48:55.761259] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:48:55.890144] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-17T06:48:56.326747] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T06:48:56.690125] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-17T06:48:57.124920] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-17T06:48:57.490160] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-17T06:48:57.918252] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T06:48:58.290149] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-11. [2025-09-17T06:48:59.090135] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-17T06:48:59.756889] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T06:48:59.890117] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-09-17T06:49:00.690137] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-17T06:49:01.048562] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-17T06:49:01.371794] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T06:49:01.433327] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-17T06:49:01.439944] [INFO ] [REMOTE ] TGT: Full fetch complete (77834 records). [2025-09-17T06:49:01.440106] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-17T06:49:01.495211] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-09-17T06:49:01.853861] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-17T06:49:01.854021] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-17T06:49:01.855228] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-17T06:49:01.855296] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-17T06:49:01.858513] [DEBUG] [LOCAL ] TGT: Trimmed 77834 records to 53778 (keeping 200 days of data) [2025-09-17T06:49:02.209838] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-09-17T06:49:02.210023] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-17T06:49:02.210152] [INFO ] [MAIN ] Update Progress: 2084/2369 symbols completed. TGT took 43.1s. Estimated remaining: 41m 42s. Rate: 6.8 symbols/min [2025-09-17T06:49:02.295343] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-17T06:49:02.385078] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:49:02.406094] [DEBUG] [LOCAL ] THQ: Loaded 19445 existing records from primary storage. [2025-09-17T06:49:02.406263] [INFO ] [MAIN ] THQ: Loaded 19445 existing records. [2025-09-17T06:49:02.585909] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:49:02.586285] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-17T06:49:02.586361] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-17T06:49:02.587064] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-17T06:49:02.587135] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-17T06:49:02.869618] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T06:49:02.950903] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:49:03.096192] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-11. [2025-09-17T06:49:03.116314] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T06:49:03.890164] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-17T06:49:04.123468] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T06:49:04.690176] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-17T06:49:05.014024] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T06:49:05.240722] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T06:49:05.490159] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-17T06:49:05.762035] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.27 seconds). [2025-09-17T06:49:06.290160] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-17T06:49:06.706784] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-17T06:49:07.090230] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-17T06:49:07.890136] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-17T06:49:08.624836] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T06:49:08.625674] [INFO ] [REMOTE ] THLV: Full fetch complete (2363 records). [2025-09-17T06:49:08.625756] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-17T06:49:08.694116] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-17T06:49:08.812814] [WARN ] [VALIDATOR ] THLV: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T06:49:08.813063] [FATAL] [MAIN ] THLV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:49:08.813213] [WARN ] [MAIN ] THLV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:49:08.813330] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-17T06:49:08.813601] [DEBUG] [LOCAL ] THLV: No primary data file found to delete. [2025-09-17T06:49:08.813735] [INFO ] [LOCAL ] THLV: Starting deletion of derivative data. [2025-09-17T06:49:08.814191] [DEBUG] [LOCAL ] THLV: Deleted derivative data file. [2025-09-17T06:49:08.814357] [INFO ] [MAIN ] Update Progress: 2085/2369 symbols completed. THLV took 24.5s. Estimated remaining: 41m 33s. Rate: 6.8 symbols/min [2025-09-17T06:49:08.943990] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T06:49:09.022593] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:49:09.039385] [DEBUG] [LOCAL ] THR: Loaded 14544 existing records from primary storage. [2025-09-17T06:49:09.039555] [INFO ] [MAIN ] THR: Loaded 14544 existing records. [2025-09-17T06:49:09.222159] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:49:09.222340] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T06:49:09.224068] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-17T06:49:09.224134] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-17T06:49:09.224677] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-17T06:49:09.224758] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-17T06:49:09.495300] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-17T06:49:09.592614] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:49:10.078451] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T06:49:10.290136] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-17T06:49:11.090199] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-09-17T06:49:11.890138] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-11. [2025-09-17T06:49:11.970278] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T06:49:12.196220] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T06:49:12.690127] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-09-17T06:49:13.001422] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T06:49:13.490160] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-09-17T06:49:13.873312] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T06:49:14.290199] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-17T06:49:14.337894] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T06:49:15.090145] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-17T06:49:15.345357] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T06:49:15.719457] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T06:49:15.720786] [INFO ] [REMOTE ] THIR: Full fetch complete (2574 records). [2025-09-17T06:49:15.720892] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-17T06:49:15.900676] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-09-17T06:49:16.109962] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-17T06:49:16.110061] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-17T06:49:16.110166] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-17T06:49:16.110217] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-17T06:49:16.110589] [DEBUG] [LOCAL ] THIR: Trimmed 2574 records to 2128 (keeping 200 days of data) [2025-09-17T06:49:16.124682] [DEBUG] [LOCAL ] THIR: Primary data saved (2128 records). [2025-09-17T06:49:16.124769] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-17T06:49:16.124897] [INFO ] [MAIN ] Update Progress: 2086/2369 symbols completed. THIR took 37.0s. Estimated remaining: 41m 24s. Rate: 6.8 symbols/min [2025-09-17T06:49:16.294569] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:49:16.325546] [DEBUG] [LOCAL ] THS: Loaded 28416 existing records from primary storage. [2025-09-17T06:49:16.325748] [INFO ] [MAIN ] THS: Loaded 28416 existing records. [2025-09-17T06:49:16.507839] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:49:16.508139] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-17T06:49:16.508198] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-17T06:49:16.508851] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-17T06:49:16.508911] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-17T06:49:16.698402] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-17T06:49:16.866522] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:49:16.970342] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T06:49:17.490184] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-17T06:49:17.764488] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T06:49:18.285964] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T06:49:18.290630] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-17T06:49:18.984677] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T06:49:19.090191] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-17T06:49:19.890183] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-11. [2025-09-17T06:49:19.957987] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T06:49:20.690145] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-17T06:49:21.293092] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T06:49:21.490119] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-09-17T06:49:22.115474] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T06:49:22.290136] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-17T06:49:22.857357] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T06:49:23.090173] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-09-17T06:49:23.750960] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T06:49:23.890146] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-17T06:49:24.409507] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T06:49:24.690166] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-17T06:49:24.935160] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T06:49:25.490146] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-17T06:49:26.025273] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T06:49:26.290131] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-17T06:49:26.454993] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T06:49:27.090172] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-17T06:49:27.475952] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T06:49:27.481251] [INFO ] [REMOTE ] THO: Full fetch complete (59782 records). [2025-09-17T06:49:27.481431] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-17T06:49:27.873216] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-17T06:49:27.873324] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-17T06:49:27.874468] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-17T06:49:27.874526] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-17T06:49:27.878902] [DEBUG] [LOCAL ] THO: Trimmed 59782 records to 42393 (keeping 200 days of data) [2025-09-17T06:49:27.935213] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-17T06:49:28.150241] [DEBUG] [LOCAL ] THO: Primary data saved (42393 records). [2025-09-17T06:49:28.150405] [INFO ] [MAIN ] THO: Full history saved. [2025-09-17T06:49:28.150511] [INFO ] [MAIN ] Update Progress: 2087/2369 symbols completed. THO took 33.2s. Estimated remaining: 41m 16s. Rate: 6.8 symbols/min [2025-09-17T06:49:28.329130] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:49:28.345080] [DEBUG] [LOCAL ] THW: Loaded 14902 existing records from primary storage. [2025-09-17T06:49:28.345266] [INFO ] [MAIN ] THW: Loaded 14902 existing records. [2025-09-17T06:49:28.528061] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:49:28.528523] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-17T06:49:28.528762] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-17T06:49:28.529380] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-17T06:49:28.529523] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-17T06:49:28.653622] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T06:49:28.692885] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-17T06:49:28.928347] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:49:29.119372] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T06:49:29.490157] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-17T06:49:29.913679] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T06:49:30.290224] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-17T06:49:30.934097] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T06:49:31.090201] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-11. [2025-09-17T06:49:31.418290] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T06:49:31.890202] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-17T06:49:32.169340] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T06:49:32.690156] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-17T06:49:33.083551] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T06:49:33.490181] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-09-17T06:49:33.747270] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T06:49:34.272589] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T06:49:34.290169] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-17T06:49:35.090246] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-17T06:49:35.496135] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T06:49:35.726254] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T06:49:35.890173] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-17T06:49:36.690196] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-17T06:49:36.819705] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T06:49:37.490152] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-17T06:49:37.593329] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T06:49:38.290157] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-17T06:49:38.866206] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T06:49:39.090144] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-17T06:49:39.697788] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T06:49:39.864079] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T06:49:39.890120] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-17T06:49:40.690149] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-17T06:49:40.879162] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T06:49:41.490154] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-17T06:49:42.201873] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T06:49:42.290128] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-17T06:49:42.790051] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T06:49:43.090181] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-17T06:49:43.685576] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T06:49:43.690598] [INFO ] [REMOTE ] THS: Full fetch complete (53301 records). [2025-09-17T06:49:43.690737] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-17T06:49:43.900001] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-17T06:49:44.072134] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-17T06:49:44.072251] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-17T06:49:44.073261] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-17T06:49:44.073368] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-17T06:49:44.083601] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T06:49:44.091150] [DEBUG] [LOCAL ] THS: Trimmed 53301 records to 37914 (keeping 200 days of data) [2025-09-17T06:49:44.324259] [DEBUG] [LOCAL ] THS: Primary data saved (37914 records). [2025-09-17T06:49:44.324430] [INFO ] [MAIN ] THS: Full history saved. [2025-09-17T06:49:44.324545] [INFO ] [MAIN ] Update Progress: 2088/2369 symbols completed. THS took 28.2s. Estimated remaining: 41m 8s. Rate: 6.8 symbols/min [2025-09-17T06:49:44.491227] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:49:44.491432] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-17T06:49:44.491483] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-17T06:49:44.491588] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-17T06:49:44.491657] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-17T06:49:44.491714] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-17T06:49:44.491752] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-17T06:49:44.715019] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-17T06:49:44.897962] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:49:44.957068] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T06:49:44.959866] [INFO ] [REMOTE ] THR: Full fetch complete (28791 records). [2025-09-17T06:49:44.959959] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-17T06:49:45.325626] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-17T06:49:45.325763] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-17T06:49:45.326406] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-17T06:49:45.326482] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-17T06:49:45.327316] [DEBUG] [LOCAL ] THR: Trimmed 28791 records to 20002 (keeping 200 days of data) [2025-09-17T06:49:45.449872] [DEBUG] [LOCAL ] THR: Primary data saved (20002 records). [2025-09-17T06:49:45.450023] [INFO ] [MAIN ] THR: Full history saved. [2025-09-17T06:49:45.450119] [INFO ] [MAIN ] Update Progress: 2089/2369 symbols completed. THR took 36.6s. Estimated remaining: 40m 58s. Rate: 6.8 symbols/min [2025-09-17T06:49:45.495213] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-17T06:49:45.624792] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:49:45.651738] [DEBUG] [LOCAL ] TIMB: Loaded 26686 existing records from primary storage. [2025-09-17T06:49:45.651918] [INFO ] [MAIN ] TIMB: Loaded 26686 existing records. [2025-09-17T06:49:45.837086] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:49:45.837345] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-17T06:49:45.837409] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-17T06:49:45.838092] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-17T06:49:45.838156] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-17T06:49:46.083570] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T06:49:46.124997] [INFO ] [REMOTE ] THQ: Full fetch complete (34585 records). [2025-09-17T06:49:46.136495] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-17T06:49:46.298022] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-11. [2025-09-17T06:49:46.331828] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:49:46.538070] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T06:49:46.565073] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:49:46.629876] [WARN ] [REMOTE ] TIC: No data returned for month 2024-11 [2025-09-17T06:49:46.630015] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-17T06:49:46.630145] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-17T06:49:46.631204] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-17T06:49:46.631266] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-17T06:49:46.632162] [DEBUG] [LOCAL ] THQ: Trimmed 34585 records to 24343 (keeping 200 days of data) [2025-09-17T06:49:46.785683] [DEBUG] [LOCAL ] THQ: Primary data saved (24343 records). [2025-09-17T06:49:46.785952] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-17T06:49:46.786061] [INFO ] [MAIN ] Update Progress: 2090/2369 symbols completed. THQ took 44.6s. Estimated remaining: 40m 48s. Rate: 6.8 symbols/min [2025-09-17T06:49:46.965011] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:49:46.970029] [DEBUG] [LOCAL ] TISI: Loaded 2147 existing records from primary storage. [2025-09-17T06:49:46.970134] [INFO ] [MAIN ] TISI: Loaded 2147 existing records. [2025-09-17T06:49:47.095212] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-17T06:49:47.155285] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:49:47.155545] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-17T06:49:47.155609] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-17T06:49:47.155891] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-17T06:49:47.155947] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-17T06:49:47.419366] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:49:47.458516] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-17T06:49:47.544616] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:49:47.890174] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-09-17T06:49:48.091404] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:49:48.091764] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-09-17T06:49:48.690200] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-17T06:49:49.132323] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T06:49:49.490178] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-11. [2025-09-17T06:49:50.290201] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-17T06:49:50.533404] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T06:49:51.090121] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-09-17T06:49:51.141402] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T06:49:51.662262] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T06:49:51.890147] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-11. [2025-09-17T06:49:52.690131] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-17T06:49:53.108001] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T06:49:53.490198] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-09-17T06:49:53.564404] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T06:49:54.290188] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-17T06:49:54.763676] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T06:49:55.090171] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-17T06:49:55.306879] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T06:49:55.890109] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-17T06:49:56.163002] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T06:49:56.690120] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-09-17T06:49:57.000231] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T06:49:57.490172] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-17T06:49:58.091953] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T06:49:58.290123] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-17T06:49:58.839674] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T06:49:59.090134] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-17T06:49:59.707590] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T06:49:59.890204] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-17T06:50:00.143314] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T06:50:00.690134] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-09-17T06:50:01.210764] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T06:50:01.501079] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-17T06:50:01.506502] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T06:50:02.290139] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-17T06:50:02.751094] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T06:50:03.071054] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T06:50:03.090103] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-17T06:50:03.890186] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-17T06:50:04.690155] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-17T06:50:04.773073] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T06:50:05.444710] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T06:50:05.490116] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-17T06:50:05.721465] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T06:50:05.724352] [INFO ] [REMOTE ] THW: Full fetch complete (29461 records). [2025-09-17T06:50:05.724518] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-17T06:50:06.107173] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-17T06:50:06.107293] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-17T06:50:06.108033] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-17T06:50:06.108091] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-17T06:50:06.109020] [DEBUG] [LOCAL ] THW: Trimmed 29461 records to 19191 (keeping 200 days of data) [2025-09-17T06:50:06.227068] [DEBUG] [LOCAL ] THW: Primary data saved (19191 records). [2025-09-17T06:50:06.227241] [INFO ] [MAIN ] THW: Full history saved. [2025-09-17T06:50:06.227337] [INFO ] [MAIN ] Update Progress: 2091/2369 symbols completed. THW took 38.1s. Estimated remaining: 40m 41s. Rate: 6.8 symbols/min [2025-09-17T06:50:06.295316] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-17T06:50:06.404564] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:50:06.427738] [DEBUG] [LOCAL ] TIXT: Loaded 24290 existing records from primary storage. [2025-09-17T06:50:06.427892] [INFO ] [MAIN ] TIXT: Loaded 24290 existing records. [2025-09-17T06:50:06.605010] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:50:06.605303] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-17T06:50:06.605364] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-17T06:50:06.606020] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-17T06:50:06.606083] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-17T06:50:06.974785] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T06:50:06.974272] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:50:06.998756] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T06:50:07.090140] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-17T06:50:07.885916] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T06:50:07.890067] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-17T06:50:08.480111] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T06:50:08.690142] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-17T06:50:09.490132] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-11. [2025-09-17T06:50:10.292348] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-17T06:50:10.295326] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T06:50:10.353526] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T06:50:10.894466] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T06:50:11.090128] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-17T06:50:11.517903] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T06:50:11.890137] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-17T06:50:12.332908] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T06:50:12.690131] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-17T06:50:13.490139] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-17T06:50:13.941356] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T06:50:13.942301] [INFO ] [REMOTE ] TISI: Full fetch complete (5074 records). [2025-09-17T06:50:13.942387] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-17T06:50:14.319308] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-17T06:50:14.311829] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-17T06:50:14.320484] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-17T06:50:14.320901] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-17T06:50:14.320963] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-17T06:50:14.321901] [DEBUG] [LOCAL ] TISI: Trimmed 5074 records to 3869 (keeping 200 days of data) [2025-09-17T06:50:14.346160] [DEBUG] [LOCAL ] TISI: Primary data saved (3869 records). [2025-09-17T06:50:14.346248] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-17T06:50:14.346363] [INFO ] [MAIN ] Update Progress: 2092/2369 symbols completed. TISI took 27.6s. Estimated remaining: 40m 32s. Rate: 6.8 symbols/min [2025-09-17T06:50:14.528178] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:50:14.528411] [DEBUG] [LOCAL ] TJX: No existing data file found in primary storage. [2025-09-17T06:50:14.528463] [WARN ] [MAIN ] TJX: No existing data found, performing full refresh instead. [2025-09-17T06:50:14.528576] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-17T06:50:14.528628] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-17T06:50:14.528702] [DEBUG] [LOCAL ] TJX: No primary data file found to delete. [2025-09-17T06:50:14.528746] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-17T06:50:14.878944] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:50:15.090105] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-11. [2025-09-17T06:50:15.543801] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (2.85 seconds). [2025-09-17T06:50:15.550001] [INFO ] [REMOTE ] TIC: Full fetch complete (36088 records). [2025-09-17T06:50:15.550218] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-17T06:50:15.741969] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 144 unique days, need 200 days [2025-09-17T06:50:15.742429] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:50:15.742482] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:50:15.742522] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-17T06:50:15.742594] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-17T06:50:15.742655] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-17T06:50:15.742727] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-17T06:50:15.742822] [INFO ] [MAIN ] Update Progress: 2093/2369 symbols completed. TIC took 31.4s. Estimated remaining: 40m 22s. Rate: 6.8 symbols/min [2025-09-17T06:50:15.914548] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:50:15.910681] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-09-17T06:50:15.941317] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T06:50:15.969512] [DEBUG] [LOCAL ] TK: Loaded 29721 existing records from primary storage. [2025-09-17T06:50:15.969692] [INFO ] [MAIN ] TK: Loaded 29721 existing records. [2025-09-17T06:50:16.147514] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:50:16.147807] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-17T06:50:16.147868] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-17T06:50:16.148498] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-17T06:50:16.148558] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-17T06:50:16.509108] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:50:16.690133] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-11. [2025-09-17T06:50:16.966479] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T06:50:16.996519] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T06:50:17.490135] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-09-17T06:50:17.815276] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T06:50:18.290178] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-09-17T06:50:19.090090] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-17T06:50:19.442920] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T06:50:19.551148] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T06:50:19.890131] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-17T06:50:20.219254] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T06:50:20.690083] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-17T06:50:21.126690] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T06:50:21.490191] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-17T06:50:22.058935] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T06:50:22.290224] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-09-17T06:50:22.436509] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T06:50:23.090150] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-17T06:50:23.890188] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-17T06:50:24.069352] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T06:50:24.401922] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T06:50:24.406584] [INFO ] [REMOTE ] TIMB: Full fetch complete (55277 records). [2025-09-17T06:50:24.406815] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-17T06:50:24.695256] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-17T06:50:24.824346] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T06:50:24.863057] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-17T06:50:24.863172] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-17T06:50:24.864146] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-17T06:50:24.864224] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-17T06:50:24.865586] [DEBUG] [LOCAL ] TIMB: Trimmed 55277 records to 37199 (keeping 200 days of data) [2025-09-17T06:50:25.101516] [DEBUG] [LOCAL ] TIMB: Primary data saved (37199 records). [2025-09-17T06:50:25.101733] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-17T06:50:25.101911] [INFO ] [MAIN ] Update Progress: 2094/2369 symbols completed. TIMB took 39.7s. Estimated remaining: 40m 14s. Rate: 6.8 symbols/min [2025-09-17T06:50:25.269104] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:50:25.295586] [DEBUG] [LOCAL ] TKC: Loaded 28470 existing records from primary storage. [2025-09-17T06:50:25.295812] [INFO ] [MAIN ] TKC: Loaded 28470 existing records. [2025-09-17T06:50:25.470986] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:50:25.471254] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-17T06:50:25.471334] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-17T06:50:25.471978] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-17T06:50:25.472056] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-17T06:50:25.495285] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-17T06:50:25.832733] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:50:26.290217] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-11. [2025-09-17T06:50:26.551529] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T06:50:26.604958] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T06:50:27.090171] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-09-17T06:50:27.477195] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T06:50:27.890218] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-17T06:50:28.542527] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T06:50:28.690168] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-09-17T06:50:29.490201] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-09-17T06:50:29.738804] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T06:50:29.767374] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T06:50:30.290166] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-17T06:50:30.531568] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T06:50:31.090247] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-17T06:50:31.890222] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-09-17T06:50:32.121008] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T06:50:32.292066] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T06:50:32.690225] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-17T06:50:33.274675] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T06:50:33.490174] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-17T06:50:34.044184] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T06:50:34.290194] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-17T06:50:34.977462] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T06:50:35.090168] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-17T06:50:35.498285] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T06:50:35.890172] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-17T06:50:36.684573] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T06:50:36.693366] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-17T06:50:37.173200] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T06:50:37.490183] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-17T06:50:38.301549] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-17T06:50:38.308230] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T06:50:38.559058] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T06:50:39.090189] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-17T06:50:39.481741] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T06:50:39.487822] [INFO ] [REMOTE ] TIXT: Full fetch complete (45043 records). [2025-09-17T06:50:39.487999] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-17T06:50:39.876669] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-17T06:50:39.876790] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-17T06:50:39.877636] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-17T06:50:39.877712] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-17T06:50:39.878777] [DEBUG] [LOCAL ] TIXT: Trimmed 45043 records to 30994 (keeping 200 days of data) [2025-09-17T06:50:39.924124] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-17T06:50:40.055569] [DEBUG] [LOCAL ] TIXT: Primary data saved (30994 records). [2025-09-17T06:50:40.055764] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-17T06:50:40.055865] [INFO ] [MAIN ] Update Progress: 2095/2369 symbols completed. TIXT took 33.8s. Estimated remaining: 40m 6s. Rate: 6.8 symbols/min [2025-09-17T06:50:40.224484] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:50:40.224685] [DEBUG] [LOCAL ] TKO: No existing data file found in primary storage. [2025-09-17T06:50:40.224739] [WARN ] [MAIN ] TKO: No existing data found, performing full refresh instead. [2025-09-17T06:50:40.224851] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-17T06:50:40.224928] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-17T06:50:40.224983] [DEBUG] [LOCAL ] TKO: No primary data file found to delete. [2025-09-17T06:50:40.225021] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-17T06:50:40.589358] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:50:40.613003] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T06:50:40.690089] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-11. [2025-09-17T06:50:41.490196] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-17T06:50:42.165177] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-17T06:50:42.290099] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-17T06:50:42.620962] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T06:50:42.901825] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T06:50:43.090187] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-09-17T06:50:43.881051] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T06:50:43.892207] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-17T06:50:44.690116] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-17T06:50:44.822556] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T06:50:45.490159] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-09-17T06:50:45.851219] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T06:50:46.290149] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-17T06:50:46.489058] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T06:50:47.090134] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-17T06:50:47.255941] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T06:50:47.714440] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T06:50:47.890127] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-17T06:50:48.168085] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T06:50:48.690211] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-17T06:50:49.222050] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T06:50:49.227050] [INFO ] [REMOTE ] TK: Full fetch complete (57354 records). [2025-09-17T06:50:49.227231] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-17T06:50:49.500606] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-17T06:50:49.667585] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-17T06:50:49.667746] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-17T06:50:49.668918] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-17T06:50:49.669036] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-17T06:50:49.670425] [DEBUG] [LOCAL ] TK: Trimmed 57354 records to 39986 (keeping 200 days of data) [2025-09-17T06:50:49.912279] [DEBUG] [LOCAL ] TK: Primary data saved (39986 records). [2025-09-17T06:50:49.912462] [INFO ] [MAIN ] TK: Full history saved. [2025-09-17T06:50:49.912560] [INFO ] [MAIN ] Update Progress: 2096/2369 symbols completed. TK took 34.2s. Estimated remaining: 39m 57s. Rate: 6.8 symbols/min [2025-09-17T06:50:50.083528] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:50:50.113972] [DEBUG] [LOCAL ] TKR: Loaded 28992 existing records from primary storage. [2025-09-17T06:50:50.114158] [INFO ] [MAIN ] TKR: Loaded 28992 existing records. [2025-09-17T06:50:50.291011] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-17T06:50:50.294396] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:50:50.296317] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-17T06:50:50.296385] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-17T06:50:50.297092] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-17T06:50:50.297154] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-17T06:50:50.681259] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:50:50.682703] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-17T06:50:50.689770] [INFO ] [REMOTE ] TJX: Full fetch complete (77542 records). [2025-09-17T06:50:50.689936] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-17T06:50:51.086862] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-17T06:50:51.087030] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-17T06:50:51.088205] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-17T06:50:51.088317] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-17T06:50:51.090112] [DEBUG] [LOCAL ] TJX: Trimmed 77542 records to 53676 (keeping 200 days of data) [2025-09-17T06:50:51.090228] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-11. [2025-09-17T06:50:51.358474] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T06:50:51.488810] [DEBUG] [LOCAL ] TJX: Primary data saved (53676 records). [2025-09-17T06:50:51.489015] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-17T06:50:51.489147] [INFO ] [MAIN ] Update Progress: 2097/2369 symbols completed. TJX took 37.1s. Estimated remaining: 39m 47s. Rate: 6.8 symbols/min [2025-09-17T06:50:51.661943] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:50:51.696212] [DEBUG] [LOCAL ] TLK: Loaded 28852 existing records from primary storage. [2025-09-17T06:50:51.696428] [INFO ] [MAIN ] TLK: Loaded 28852 existing records. [2025-09-17T06:50:51.880180] [WARN ] [MAIN ] TLK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:50:51.880567] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-17T06:50:51.880676] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-17T06:50:51.881362] [DEBUG] [LOCAL ] TLK: Deleted primary data file. [2025-09-17T06:50:51.881427] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-17T06:50:51.895271] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-17T06:50:52.038089] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T06:50:52.309683] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:50:52.550632] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T06:50:52.690139] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-09-17T06:50:53.490161] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-11. [2025-09-17T06:50:53.855972] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T06:50:54.153492] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T06:50:54.290133] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-09-17T06:50:54.820567] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T06:50:55.090180] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-17T06:50:55.195878] [DEBUG] [REMOTE ] TLK: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-17T06:50:55.196265] [WARN ] [REMOTE ] TLK: No data returned for month 2024-12 [2025-09-17T06:50:55.890147] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-17T06:50:55.993880] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T06:50:56.690227] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-17T06:50:57.315353] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T06:50:57.490172] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-17T06:50:58.290199] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-17T06:50:58.436739] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T06:50:58.970196] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T06:50:59.090177] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-17T06:50:59.450964] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T06:50:59.890168] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-17T06:51:00.625572] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T06:51:00.690115] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-17T06:51:01.362134] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T06:51:01.490142] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-17T06:51:02.290160] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-17T06:51:03.044531] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-17T06:51:03.090089] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-17T06:51:03.890195] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-17T06:51:05.672394] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (3.38 seconds). [2025-09-17T06:51:05.681481] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-17T06:51:05.772089] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (4.28 seconds). [2025-09-17T06:51:05.782155] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-17T06:51:05.917304] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-09-17T06:51:06.254813] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-17T06:51:06.290109] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-17T06:51:06.836193] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T06:51:07.090142] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-17T06:51:07.653296] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T06:51:07.890131] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-17T06:51:07.959493] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T06:51:08.644025] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T06:51:08.690105] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-17T06:51:09.244496] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T06:51:09.490127] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-17T06:51:10.225902] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T06:51:10.290123] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-17T06:51:11.099996] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-17T06:51:11.110234] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T06:51:11.303155] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T06:51:11.890154] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-17T06:51:12.690150] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-17T06:51:12.879805] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T06:51:12.914347] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T06:51:13.490120] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-17T06:51:14.141013] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T06:51:14.146847] [INFO ] [REMOTE ] TKC: Full fetch complete (50559 records). [2025-09-17T06:51:14.146987] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-17T06:51:14.296543] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-17T06:51:14.555628] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-17T06:51:14.555788] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-17T06:51:14.556837] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-17T06:51:14.556913] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-17T06:51:14.558393] [DEBUG] [LOCAL ] TKC: Trimmed 50559 records to 37674 (keeping 200 days of data) [2025-09-17T06:51:14.794544] [DEBUG] [LOCAL ] TKC: Primary data saved (37674 records). [2025-09-17T06:51:14.794832] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-17T06:51:14.795049] [INFO ] [MAIN ] Update Progress: 2098/2369 symbols completed. TKC took 49.7s. Estimated remaining: 39m 40s. Rate: 6.8 symbols/min [2025-09-17T06:51:14.970406] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:51:14.988050] [DEBUG] [LOCAL ] TLYS: Loaded 14099 existing records from primary storage. [2025-09-17T06:51:14.988251] [INFO ] [MAIN ] TLYS: Loaded 14099 existing records. [2025-09-17T06:51:15.095279] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-17T06:51:15.170566] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:51:15.170828] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-17T06:51:15.170888] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-17T06:51:15.171241] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-17T06:51:15.171303] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-17T06:51:15.524122] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:51:15.664280] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-17T06:51:15.671268] [INFO ] [REMOTE ] TKR: Full fetch complete (56906 records). [2025-09-17T06:51:15.671472] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-17T06:51:15.904206] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-11. [2025-09-17T06:51:16.055719] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-17T06:51:16.055862] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-17T06:51:16.057141] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-17T06:51:16.057270] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-17T06:51:16.059009] [DEBUG] [LOCAL ] TKR: Trimmed 56906 records to 40115 (keeping 200 days of data) [2025-09-17T06:51:16.318303] [DEBUG] [LOCAL ] TKR: Primary data saved (40115 records). [2025-09-17T06:51:16.318486] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-17T06:51:16.318634] [INFO ] [MAIN ] Update Progress: 2099/2369 symbols completed. TKR took 26.4s. Estimated remaining: 39m 31s. Rate: 6.8 symbols/min [2025-09-17T06:51:16.491020] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:51:16.521432] [DEBUG] [LOCAL ] TM: Loaded 27414 existing records from primary storage. [2025-09-17T06:51:16.521606] [INFO ] [MAIN ] TM: Loaded 27414 existing records. [2025-09-17T06:51:16.702702] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:51:16.703119] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-17T06:51:16.703244] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-17T06:51:16.704048] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-17T06:51:16.704185] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-17T06:51:16.841592] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-17T06:51:16.859433] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T06:51:16.872293] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-09-17T06:51:17.123630] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:51:17.490122] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-17T06:51:17.553342] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (2.46 seconds). [2025-09-17T06:51:17.562055] [INFO ] [REMOTE ] TKO: Full fetch complete (64454 records). [2025-09-17T06:51:17.562234] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-17T06:51:17.968835] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-17T06:51:17.968995] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-17T06:51:17.970344] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-17T06:51:17.970438] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-17T06:51:17.980403] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T06:51:17.984870] [DEBUG] [LOCAL ] TKO: Trimmed 64454 records to 44448 (keeping 200 days of data) [2025-09-17T06:51:18.274008] [DEBUG] [LOCAL ] TKO: Primary data saved (44448 records). [2025-09-17T06:51:18.274180] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-17T06:51:18.274275] [INFO ] [MAIN ] Update Progress: 2100/2369 symbols completed. TKO took 38.2s. Estimated remaining: 39m 21s. Rate: 6.8 symbols/min [2025-09-17T06:51:18.295263] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-11. [2025-09-17T06:51:18.444355] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:51:18.488365] [DEBUG] [LOCAL ] TME: Loaded 39626 existing records from primary storage. [2025-09-17T06:51:18.488554] [INFO ] [MAIN ] TME: Loaded 39626 existing records. [2025-09-17T06:51:18.664712] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:51:18.665025] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-17T06:51:18.665138] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-17T06:51:18.665928] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-17T06:51:18.665989] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-17T06:51:19.024235] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:51:19.048109] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T06:51:19.090163] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-11. [2025-09-17T06:51:19.890166] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-17T06:51:20.053146] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T06:51:20.690188] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-09-17T06:51:20.886606] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T06:51:21.375181] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T06:51:21.474422] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T06:51:21.490100] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-17T06:51:22.290153] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-17T06:51:22.722130] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T06:51:22.728759] [INFO ] [REMOTE ] TLK: Full fetch complete (51620 records). [2025-09-17T06:51:22.728951] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-17T06:51:22.920248] [WARN ] [VALIDATOR ] TLK: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T06:51:22.920880] [FATAL] [MAIN ] TLK: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:51:22.920945] [WARN ] [MAIN ] TLK: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:51:22.920994] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-17T06:51:22.921087] [DEBUG] [LOCAL ] TLK: No primary data file found to delete. [2025-09-17T06:51:22.921143] [INFO ] [LOCAL ] TLK: Starting deletion of derivative data. [2025-09-17T06:51:22.921459] [DEBUG] [LOCAL ] TLK: Deleted derivative data file. [2025-09-17T06:51:22.921573] [INFO ] [MAIN ] Update Progress: 2101/2369 symbols completed. TLK took 31.4s. Estimated remaining: 39m 12s. Rate: 6.8 symbols/min [2025-09-17T06:51:23.078527] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T06:51:23.101713] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-09-17T06:51:23.108474] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:51:23.154247] [DEBUG] [LOCAL ] TMHC: Loaded 33787 existing records from primary storage. [2025-09-17T06:51:23.154451] [INFO ] [MAIN ] TMHC: Loaded 33787 existing records. [2025-09-17T06:51:23.363075] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:51:23.363358] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-17T06:51:23.363422] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-17T06:51:23.364093] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-17T06:51:23.364154] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-17T06:51:23.723491] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:51:23.890145] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-11. [2025-09-17T06:51:24.690159] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-17T06:51:25.068844] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T06:51:25.437370] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T06:51:25.487215] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T06:51:25.490122] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-09-17T06:51:26.290158] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-09-17T06:51:27.069237] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T06:51:27.090097] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-09-17T06:51:27.890143] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-09-17T06:51:27.942682] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T06:51:28.668447] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T06:51:28.690090] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-17T06:51:29.490239] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-17T06:51:29.540502] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T06:51:30.290143] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-17T06:51:30.467146] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T06:51:30.544808] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T06:51:31.090153] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-17T06:51:31.110408] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T06:51:31.890145] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-17T06:51:32.690117] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-09-17T06:51:32.761689] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T06:51:33.490150] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-17T06:51:33.657990] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T06:51:34.270757] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T06:51:34.290076] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-17T06:51:34.718209] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T06:51:35.090192] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-17T06:51:35.420806] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T06:51:35.890113] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-17T06:51:36.089738] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T06:51:36.690203] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-17T06:51:37.490135] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-17T06:51:37.838314] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T06:51:38.214271] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T06:51:38.290147] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-17T06:51:38.832215] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T06:51:39.090124] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-17T06:51:39.890138] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-17T06:51:40.154146] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T06:51:40.177338] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T06:51:40.690173] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-17T06:51:41.430553] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T06:51:41.490242] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-17T06:51:42.290214] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-17T06:51:42.438976] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T06:51:42.922185] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T06:51:43.090137] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-17T06:51:43.890158] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-17T06:51:44.142774] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T06:51:44.334988] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T06:51:44.690117] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-17T06:51:45.476201] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T06:51:45.490083] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-17T06:51:46.290116] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-17T06:51:46.499211] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T06:51:47.090201] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-17T06:51:47.175970] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T06:51:47.426328] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T06:51:47.890146] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-17T06:51:48.690146] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-17T06:51:48.734046] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T06:51:49.490120] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-17T06:51:49.857053] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T06:51:49.882620] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T06:51:49.888440] [INFO ] [REMOTE ] TMHC: Full fetch complete (65567 records). [2025-09-17T06:51:49.888572] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-17T06:51:50.299088] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-17T06:51:50.336303] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-17T06:51:50.336474] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-17T06:51:50.338523] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-17T06:51:50.338967] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-17T06:51:50.341224] [DEBUG] [LOCAL ] TMHC: Trimmed 65567 records to 45641 (keeping 200 days of data) [2025-09-17T06:51:50.747702] [DEBUG] [LOCAL ] TMHC: Primary data saved (45641 records). [2025-09-17T06:51:50.748831] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-17T06:51:50.748982] [INFO ] [MAIN ] Update Progress: 2102/2369 symbols completed. TMHC took 27.8s. Estimated remaining: 39m 5s. Rate: 6.8 symbols/min [2025-09-17T06:51:50.983873] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:51:50.984188] [DEBUG] [LOCAL ] TMO: No existing data file found in primary storage. [2025-09-17T06:51:50.984266] [WARN ] [MAIN ] TMO: No existing data found, performing full refresh instead. [2025-09-17T06:51:50.984384] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-17T06:51:50.984437] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-17T06:51:50.984538] [DEBUG] [LOCAL ] TMO: No primary data file found to delete. [2025-09-17T06:51:50.984611] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-17T06:51:51.091992] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-17T06:51:51.404398] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:51:51.412456] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T06:51:51.416047] [INFO ] [REMOTE ] TLYS: Full fetch complete (21950 records). [2025-09-17T06:51:51.416488] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-17T06:51:51.540631] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T06:51:51.811505] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-17T06:51:51.811606] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-17T06:51:51.812120] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-17T06:51:51.812174] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-17T06:51:51.812843] [DEBUG] [LOCAL ] TLYS: Trimmed 21950 records to 17143 (keeping 200 days of data) [2025-09-17T06:51:51.890181] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-17T06:51:51.917263] [DEBUG] [LOCAL ] TLYS: Primary data saved (17143 records). [2025-09-17T06:51:51.917393] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-17T06:51:51.917487] [INFO ] [MAIN ] Update Progress: 2103/2369 symbols completed. TLYS took 37.1s. Estimated remaining: 38m 56s. Rate: 6.8 symbols/min [2025-09-17T06:51:52.084891] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:51:52.096196] [DEBUG] [LOCAL ] TNC: Loaded 10537 existing records from primary storage. [2025-09-17T06:51:52.096336] [INFO ] [MAIN ] TNC: Loaded 10537 existing records. [2025-09-17T06:51:52.271870] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:51:52.272125] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-17T06:51:52.272183] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-17T06:51:52.272577] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-17T06:51:52.272633] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-17T06:51:52.658678] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:51:52.690143] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-11. [2025-09-17T06:51:52.738790] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T06:51:52.745693] [INFO ] [REMOTE ] TME: Full fetch complete (76755 records). [2025-09-17T06:51:52.745854] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-17T06:51:53.144991] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-17T06:51:53.145127] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-17T06:51:53.146261] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-17T06:51:53.146330] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-17T06:51:53.148025] [DEBUG] [LOCAL ] TME: Trimmed 76755 records to 53201 (keeping 200 days of data) [2025-09-17T06:51:53.385607] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T06:51:53.490395] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-17T06:51:53.510011] [DEBUG] [LOCAL ] TME: Primary data saved (53201 records). [2025-09-17T06:51:53.510209] [INFO ] [MAIN ] TME: Full history saved. [2025-09-17T06:51:53.510337] [INFO ] [MAIN ] Update Progress: 2104/2369 symbols completed. TME took 35.2s. Estimated remaining: 38m 46s. Rate: 6.8 symbols/min [2025-09-17T06:51:53.685465] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:51:53.705764] [DEBUG] [LOCAL ] TNET: Loaded 21161 existing records from primary storage. [2025-09-17T06:51:53.706032] [INFO ] [MAIN ] TNET: Loaded 21161 existing records. [2025-09-17T06:51:53.806344] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T06:51:53.937966] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:51:53.938209] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-17T06:51:53.938270] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-17T06:51:53.938870] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-17T06:51:53.938934] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-17T06:51:54.293471] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-09-17T06:51:54.307243] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:51:54.859182] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T06:51:54.863252] [INFO ] [REMOTE ] TM: Full fetch complete (53496 records). [2025-09-17T06:51:54.863411] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-17T06:51:55.095344] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-11. [2025-09-17T06:51:55.260068] [DEBUG] [VALIDATOR ] TM: All expected trading days are present. [2025-09-17T06:51:55.260194] [DEBUG] [VALIDATOR ] TM: Primary data validation passed. [2025-09-17T06:51:55.261142] [INFO ] [MAIN ] TM: Fetched primary data is valid. [2025-09-17T06:51:55.261212] [DEBUG] [LOCAL ] TM: Saving primary data. [2025-09-17T06:51:55.262791] [DEBUG] [LOCAL ] TM: Trimmed 53496 records to 37137 (keeping 200 days of data) [2025-09-17T06:51:55.388260] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T06:51:55.528146] [DEBUG] [LOCAL ] TM: Primary data saved (37137 records). [2025-09-17T06:51:55.528346] [INFO ] [MAIN ] TM: Full history saved. [2025-09-17T06:51:55.528502] [INFO ] [MAIN ] Update Progress: 2105/2369 symbols completed. TM took 39.2s. Estimated remaining: 38m 36s. Rate: 6.8 symbols/min [2025-09-17T06:51:55.712189] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:51:55.712405] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-17T06:51:55.712478] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-17T06:51:55.712614] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-17T06:51:55.712703] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-17T06:51:55.712775] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-17T06:51:55.712836] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-17T06:51:55.898712] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-09-17T06:51:56.067829] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:51:56.690132] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-11. [2025-09-17T06:51:56.851681] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T06:51:56.942091] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T06:51:57.490208] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-17T06:51:58.049151] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T06:51:58.290241] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-09-17T06:51:58.509557] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T06:51:59.090151] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-11. [2025-09-17T06:51:59.255971] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T06:51:59.285981] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:51:59.286349] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-11 [2025-09-17T06:51:59.890137] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-17T06:52:00.076439] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:52:00.076809] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-17T06:52:00.690187] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-09-17T06:52:00.879366] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:52:00.879757] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-09-17T06:52:01.490145] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-17T06:52:02.290102] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-09-17T06:52:02.611552] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T06:52:03.090129] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-09-17T06:52:03.890173] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-17T06:52:04.065107] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T06:52:04.149707] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T06:52:04.556430] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T06:52:04.690131] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-17T06:52:04.896316] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:52:04.896684] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-17T06:52:05.490130] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-17T06:52:06.290234] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-09-17T06:52:06.434748] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T06:52:07.090190] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-17T06:52:07.890172] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-17T06:52:08.043113] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T06:52:08.086300] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:52:08.086904] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-17T06:52:08.439729] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T06:52:08.690212] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-17T06:52:09.490175] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-17T06:52:09.615499] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T06:52:10.290156] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-17T06:52:10.879082] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T06:52:11.090170] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-17T06:52:11.242477] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T06:52:11.276345] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:52:11.276779] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-17T06:52:11.890132] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-17T06:52:12.082205] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:52:12.082794] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-17T06:52:12.690192] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-17T06:52:13.327866] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T06:52:13.490190] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-17T06:52:14.290146] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-17T06:52:14.369208] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T06:52:14.371373] [INFO ] [REMOTE ] TNC: Full fetch complete (23344 records). [2025-09-17T06:52:14.371468] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-17T06:52:14.777886] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T06:52:14.778818] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-17T06:52:14.780394] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-17T06:52:14.781507] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-17T06:52:14.781596] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-17T06:52:14.782740] [DEBUG] [LOCAL ] TNC: Trimmed 23344 records to 15540 (keeping 200 days of data) [2025-09-17T06:52:14.894979] [DEBUG] [LOCAL ] TNC: Primary data saved (15540 records). [2025-09-17T06:52:14.895231] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-17T06:52:14.895360] [INFO ] [MAIN ] Update Progress: 2106/2369 symbols completed. TNC took 23.0s. Estimated remaining: 38m 29s. Rate: 6.8 symbols/min [2025-09-17T06:52:15.083896] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:52:15.084427] [DEBUG] [LOCAL ] TNK: No existing data file found in primary storage. [2025-09-17T06:52:15.084491] [WARN ] [MAIN ] TNK: No existing data found, performing full refresh instead. [2025-09-17T06:52:15.084671] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-17T06:52:15.084732] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-17T06:52:15.084789] [DEBUG] [LOCAL ] TNK: No primary data file found to delete. [2025-09-17T06:52:15.084899] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-17T06:52:15.096502] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-17T06:52:15.476148] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:52:15.890186] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-11. [2025-09-17T06:52:16.690181] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-17T06:52:16.916697] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T06:52:17.091606] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T06:52:17.123491] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T06:52:17.490140] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-09-17T06:52:18.290176] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-17T06:52:18.819628] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T06:52:19.090168] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-17T06:52:19.890171] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-17T06:52:20.151452] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T06:52:20.591259] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T06:52:20.620427] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T06:52:20.690128] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-17T06:52:21.370484] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T06:52:21.373415] [INFO ] [REMOTE ] TNGY: Full fetch complete (2985 records). [2025-09-17T06:52:21.373507] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-17T06:52:21.495287] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-09-17T06:52:21.557327] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 64 unique days, need 200 days [2025-09-17T06:52:21.557503] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:52:21.557547] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:52:21.557592] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-17T06:52:21.557678] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-17T06:52:21.557725] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-17T06:52:21.557799] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-17T06:52:21.557896] [INFO ] [MAIN ] Update Progress: 2107/2369 symbols completed. TNGY took 26.0s. Estimated remaining: 38m 20s. Rate: 6.8 symbols/min [2025-09-17T06:52:21.728133] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:52:21.762040] [DEBUG] [LOCAL ] TNL: Loaded 30982 existing records from primary storage. [2025-09-17T06:52:21.762248] [INFO ] [MAIN ] TNL: Loaded 30982 existing records. [2025-09-17T06:52:21.943475] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:52:21.943738] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-17T06:52:21.943799] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-17T06:52:21.944581] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-17T06:52:21.944663] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-17T06:52:22.304184] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-17T06:52:22.308877] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:52:23.015357] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T06:52:23.090094] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-17T06:52:23.890173] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-17T06:52:24.365899] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T06:52:24.690146] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-17T06:52:24.833453] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.53 seconds). [2025-09-17T06:52:25.470491] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T06:52:25.490071] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-17T06:52:25.890026] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T06:52:26.290145] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-17T06:52:26.926838] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T06:52:27.090161] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-11. [2025-09-17T06:52:27.890129] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-17T06:52:28.188948] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T06:52:28.221898] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T06:52:28.690157] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-17T06:52:29.453719] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T06:52:29.490177] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-17T06:52:30.290676] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-17T06:52:30.661747] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T06:52:30.853524] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T06:52:31.090204] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-09-17T06:52:31.569007] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T06:52:31.890179] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-17T06:52:32.690191] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-17T06:52:32.830294] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T06:52:33.490240] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-09-17T06:52:33.538090] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T06:52:34.290179] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-17T06:52:34.750928] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T06:52:34.782307] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T06:52:35.090111] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-17T06:52:35.526457] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T06:52:35.890135] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-17T06:52:36.690139] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-17T06:52:36.893158] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T06:52:36.926328] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T06:52:37.490107] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-17T06:52:37.963013] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T06:52:38.290168] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-17T06:52:39.073047] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T06:52:39.079387] [INFO ] [REMOTE ] TMO: Full fetch complete (75396 records). [2025-09-17T06:52:39.079595] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-17T06:52:39.095271] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-17T06:52:39.480660] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-17T06:52:39.480781] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-17T06:52:39.481919] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-17T06:52:39.481997] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-17T06:52:39.483655] [DEBUG] [LOCAL ] TMO: Trimmed 75396 records to 52386 (keeping 200 days of data) [2025-09-17T06:52:39.595294] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T06:52:39.600339] [INFO ] [REMOTE ] TNET: Full fetch complete (41589 records). [2025-09-17T06:52:39.601026] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-17T06:52:39.898798] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-17T06:52:40.012615] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-17T06:52:40.013242] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-17T06:52:40.015304] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-17T06:52:40.015915] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-17T06:52:40.020588] [DEBUG] [LOCAL ] TNET: Trimmed 41589 records to 29245 (keeping 200 days of data) [2025-09-17T06:52:40.346200] [DEBUG] [LOCAL ] TNET: Primary data saved (29245 records). [2025-09-17T06:52:40.347332] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-17T06:52:40.347897] [INFO ] [MAIN ] Update Progress: 2108/2369 symbols completed. TNET took 46.8s. Estimated remaining: 38m 12s. Rate: 6.8 symbols/min [2025-09-17T06:52:40.589662] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:52:40.591003] [DEBUG] [LOCAL ] TOL: No existing data file found in primary storage. [2025-09-17T06:52:40.591397] [WARN ] [MAIN ] TOL: No existing data found, performing full refresh instead. [2025-09-17T06:52:40.593625] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-17T06:52:40.594090] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-17T06:52:40.595521] [DEBUG] [LOCAL ] TOL: No primary data file found to delete. [2025-09-17T06:52:40.596239] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-17T06:52:40.908054] [DEBUG] [LOCAL ] TMO: Primary data saved (52386 records). [2025-09-17T06:52:40.914504] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-17T06:52:40.927669] [INFO ] [MAIN ] Update Progress: 2109/2369 symbols completed. TMO took 50.2s. Estimated remaining: 38m 2s. Rate: 6.8 symbols/min [2025-09-17T06:52:40.927532] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T06:52:41.069407] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-17T06:52:41.097618] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:52:41.197798] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:52:41.233535] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T06:52:41.252121] [DEBUG] [LOCAL ] TOST: Loaded 40041 existing records from primary storage. [2025-09-17T06:52:41.252248] [INFO ] [REMOTE ] TNK: Full fetch complete (51852 records). [2025-09-17T06:52:41.252427] [INFO ] [MAIN ] TOST: Loaded 40041 existing records. [2025-09-17T06:52:41.285477] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-17T06:52:41.505379] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-11. [2025-09-17T06:52:41.647495] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:52:41.742709] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-17T06:52:41.745126] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-17T06:52:41.751124] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-17T06:52:41.771613] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-17T06:52:41.936726] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-17T06:52:41.952706] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-17T06:52:41.988501] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-17T06:52:42.022720] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-17T06:52:42.121056] [DEBUG] [LOCAL ] TNK: Trimmed 51852 records to 35484 (keeping 200 days of data) [2025-09-17T06:52:42.283819] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:52:42.310018] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-11. [2025-09-17T06:52:42.451180] [DEBUG] [LOCAL ] TNK: Primary data saved (35484 records). [2025-09-17T06:52:42.451397] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-17T06:52:42.451535] [INFO ] [MAIN ] Update Progress: 2110/2369 symbols completed. TNK took 27.6s. Estimated remaining: 37m 53s. Rate: 6.8 symbols/min [2025-09-17T06:52:42.629455] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:52:42.650988] [DEBUG] [LOCAL ] TPB: Loaded 19048 existing records from primary storage. [2025-09-17T06:52:42.651229] [INFO ] [MAIN ] TPB: Loaded 19048 existing records. [2025-09-17T06:52:42.919328] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:52:42.919969] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-17T06:52:42.958932] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-17T06:52:42.967094] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T06:52:42.967190] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-17T06:52:42.980768] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-17T06:52:43.093029] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-17T06:52:43.410760] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T06:52:43.646686] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:52:43.890187] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-09-17T06:52:44.234616] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T06:52:44.690098] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-11. [2025-09-17T06:52:44.815215] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T06:52:45.490159] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-17T06:52:45.725667] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T06:52:45.784321] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T06:52:46.290185] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-09-17T06:52:46.689585] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T06:52:47.090135] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-09-17T06:52:47.890179] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-17T06:52:48.165511] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T06:52:48.317476] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T06:52:48.690142] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-17T06:52:49.334083] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T06:52:49.490144] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-09-17T06:52:50.290111] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-17T06:52:50.419167] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T06:52:51.090201] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-17T06:52:51.225434] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T06:52:51.386405] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T06:52:51.890165] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-09-17T06:52:52.690192] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-17T06:52:52.923984] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T06:52:52.970786] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T06:52:53.490193] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-09-17T06:52:54.134212] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T06:52:54.199383] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T06:52:54.290107] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-17T06:52:55.090139] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-17T06:52:55.728166] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T06:52:55.733308] [INFO ] [REMOTE ] TNL: Full fetch complete (58504 records). [2025-09-17T06:52:55.733444] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-17T06:52:55.892701] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-17T06:52:56.120668] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-17T06:52:56.120802] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-17T06:52:56.121828] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-17T06:52:56.121894] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-17T06:52:56.123233] [DEBUG] [LOCAL ] TNL: Trimmed 58504 records to 42031 (keeping 200 days of data) [2025-09-17T06:52:56.385265] [DEBUG] [LOCAL ] TNL: Primary data saved (42031 records). [2025-09-17T06:52:56.385432] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-17T06:52:56.385543] [INFO ] [MAIN ] Update Progress: 2111/2369 symbols completed. TNL took 34.8s. Estimated remaining: 37m 45s. Rate: 6.8 symbols/min [2025-09-17T06:52:56.555182] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:52:56.582899] [DEBUG] [LOCAL ] TPC: Loaded 29430 existing records from primary storage. [2025-09-17T06:52:56.583064] [INFO ] [MAIN ] TPC: Loaded 29430 existing records. [2025-09-17T06:52:56.695270] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-17T06:52:56.765724] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:52:56.765991] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-17T06:52:56.766055] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-17T06:52:56.766730] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-17T06:52:56.766790] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-17T06:52:57.133819] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:52:57.173404] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T06:52:57.421147] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T06:52:57.490076] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-17T06:52:57.875671] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T06:52:58.290229] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-11. [2025-09-17T06:52:59.090127] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-17T06:52:59.351976] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T06:52:59.541194] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T06:52:59.890192] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-17T06:53:00.690180] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-09-17T06:53:01.023508] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T06:53:01.389268] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T06:53:01.490190] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-17T06:53:02.089984] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T06:53:02.290156] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-17T06:53:03.090118] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-09-17T06:53:03.172347] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T06:53:03.890145] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-17T06:53:04.097520] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T06:53:04.270282] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T06:53:04.690164] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-17T06:53:05.490174] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-17T06:53:05.884979] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T06:53:06.041866] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T06:53:06.290146] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-17T06:53:07.090117] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-17T06:53:07.508403] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T06:53:07.890145] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-17T06:53:08.078824] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T06:53:08.104090] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T06:53:08.114320] [INFO ] [REMOTE ] TOL: Full fetch complete (73633 records). [2025-09-17T06:53:08.114571] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-17T06:53:08.531441] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-09-17T06:53:08.531555] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-09-17T06:53:08.532762] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-09-17T06:53:08.532825] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-09-17T06:53:08.534325] [DEBUG] [LOCAL ] TOL: Trimmed 73633 records to 51126 (keeping 200 days of data) [2025-09-17T06:53:08.730302] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-17T06:53:08.873584] [DEBUG] [LOCAL ] TOL: Primary data saved (51126 records). [2025-09-17T06:53:08.873768] [INFO ] [MAIN ] TOL: Full history saved. [2025-09-17T06:53:08.873860] [INFO ] [MAIN ] Update Progress: 2112/2369 symbols completed. TOL took 28.5s. Estimated remaining: 37m 36s. Rate: 6.8 symbols/min [2025-09-17T06:53:09.046285] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:53:09.079190] [DEBUG] [LOCAL ] TPH: Loaded 33501 existing records from primary storage. [2025-09-17T06:53:09.079375] [INFO ] [MAIN ] TPH: Loaded 33501 existing records. [2025-09-17T06:53:09.256394] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:53:09.256679] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-17T06:53:09.256740] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-17T06:53:09.257469] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-17T06:53:09.257529] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-17T06:53:09.502248] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-17T06:53:09.624409] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:53:09.902383] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T06:53:09.928711] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T06:53:10.290177] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-17T06:53:11.008161] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T06:53:11.090125] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-17T06:53:11.134851] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T06:53:11.890194] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-17T06:53:12.595690] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T06:53:12.690124] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-17T06:53:13.490123] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-11. [2025-09-17T06:53:13.543091] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T06:53:13.613132] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T06:53:14.290132] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-17T06:53:14.889528] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T06:53:15.090127] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-09-17T06:53:15.890127] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-17T06:53:16.340680] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T06:53:16.445384] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T06:53:16.690124] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-17T06:53:17.373624] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T06:53:17.490128] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-17T06:53:18.278717] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T06:53:18.290085] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-17T06:53:18.627248] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T06:53:18.634496] [INFO ] [REMOTE ] TOST: Full fetch complete (77554 records). [2025-09-17T06:53:18.634750] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-17T06:53:19.039994] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-17T06:53:19.040158] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-17T06:53:19.042010] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-17T06:53:19.042092] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-17T06:53:19.044179] [DEBUG] [LOCAL ] TOST: Trimmed 77554 records to 53681 (keeping 200 days of data) [2025-09-17T06:53:19.102875] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-17T06:53:19.181900] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T06:53:19.441509] [DEBUG] [LOCAL ] TOST: Primary data saved (53681 records). [2025-09-17T06:53:19.441778] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-17T06:53:19.441918] [INFO ] [MAIN ] Update Progress: 2113/2369 symbols completed. TOST took 38.5s. Estimated remaining: 37m 28s. Rate: 6.8 symbols/min [2025-09-17T06:53:19.619773] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:53:19.620099] [DEBUG] [LOCAL ] TPL: No existing data file found in primary storage. [2025-09-17T06:53:19.620153] [WARN ] [MAIN ] TPL: No existing data found, performing full refresh instead. [2025-09-17T06:53:19.620277] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-17T06:53:19.620340] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-17T06:53:19.620445] [DEBUG] [LOCAL ] TPL: No primary data file found to delete. [2025-09-17T06:53:19.620495] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-17T06:53:19.895347] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-17T06:53:20.004771] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:53:20.690493] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-11. [2025-09-17T06:53:20.696060] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T06:53:21.119701] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T06:53:21.490209] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-17T06:53:21.840052] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T06:53:22.290199] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-09-17T06:53:22.913809] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T06:53:22.923820] [INFO ] [REMOTE ] TPC: Full fetch complete (54252 records). [2025-09-17T06:53:22.924031] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-17T06:53:23.102576] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-17T06:53:23.313819] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-17T06:53:23.313931] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-17T06:53:23.314983] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-17T06:53:23.315057] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-17T06:53:23.316248] [DEBUG] [LOCAL ] TPC: Trimmed 54252 records to 39019 (keeping 200 days of data) [2025-09-17T06:53:23.457952] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T06:53:23.581858] [DEBUG] [LOCAL ] TPC: Primary data saved (39019 records). [2025-09-17T06:53:23.582024] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-17T06:53:23.582139] [INFO ] [MAIN ] Update Progress: 2114/2369 symbols completed. TPC took 27.2s. Estimated remaining: 37m 18s. Rate: 6.8 symbols/min [2025-09-17T06:53:23.763821] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:53:23.802292] [DEBUG] [LOCAL ] TPR: Loaded 39870 existing records from primary storage. [2025-09-17T06:53:23.802461] [INFO ] [MAIN ] TPR: Loaded 39870 existing records. [2025-09-17T06:53:23.900317] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-17T06:53:23.981846] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:53:23.982076] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-17T06:53:23.982131] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-17T06:53:23.983014] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-17T06:53:23.983077] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-17T06:53:24.348099] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:53:24.535976] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T06:53:24.690114] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-17T06:53:25.414151] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T06:53:25.490093] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-09-17T06:53:25.871620] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T06:53:25.875311] [INFO ] [REMOTE ] TPB: Full fetch complete (34501 records). [2025-09-17T06:53:25.875434] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-17T06:53:26.270581] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-17T06:53:26.270766] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-17T06:53:26.271803] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-17T06:53:26.272026] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-17T06:53:26.273274] [DEBUG] [LOCAL ] TPB: Trimmed 34501 records to 24918 (keeping 200 days of data) [2025-09-17T06:53:26.288009] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T06:53:26.292149] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-11. [2025-09-17T06:53:26.472114] [DEBUG] [LOCAL ] TPB: Primary data saved (24918 records). [2025-09-17T06:53:26.472419] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-17T06:53:26.472593] [INFO ] [MAIN ] Update Progress: 2115/2369 symbols completed. TPB took 44.0s. Estimated remaining: 37m 9s. Rate: 6.8 symbols/min [2025-09-17T06:53:26.663861] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:53:26.687790] [DEBUG] [LOCAL ] TPVG: Loaded 19127 existing records from primary storage. [2025-09-17T06:53:26.688028] [INFO ] [MAIN ] TPVG: Loaded 19127 existing records. [2025-09-17T06:53:26.883896] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:53:26.884333] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-17T06:53:26.884406] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-17T06:53:26.885006] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-17T06:53:26.885112] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-17T06:53:27.095333] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-09-17T06:53:27.263460] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:53:27.890120] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-11. [2025-09-17T06:53:27.982292] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T06:53:28.186435] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T06:53:28.690108] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-09-17T06:53:28.778592] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T06:53:29.490159] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-17T06:53:30.290139] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-09-17T06:53:30.474600] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T06:53:31.090146] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-17T06:53:31.131436] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T06:53:31.700362] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T06:53:31.890122] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-17T06:53:31.943729] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T06:53:32.690137] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-09-17T06:53:33.490107] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-17T06:53:33.572598] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T06:53:34.290182] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-17T06:53:34.386900] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T06:53:34.404545] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T06:53:35.090136] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-17T06:53:35.517764] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T06:53:35.890185] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-17T06:53:36.690199] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-09-17T06:53:36.859672] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T06:53:36.911515] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T06:53:37.490144] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-17T06:53:37.897083] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T06:53:38.290162] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-17T06:53:38.337450] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T06:53:39.090145] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-17T06:53:39.559741] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T06:53:39.890185] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-17T06:53:40.502922] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T06:53:40.690119] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-17T06:53:41.002347] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T06:53:41.490183] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-17T06:53:42.290134] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-17T06:53:42.484589] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T06:53:43.029996] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T06:53:43.090175] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-17T06:53:43.244870] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T06:53:43.890188] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-17T06:53:44.690130] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-17T06:53:44.754183] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T06:53:44.970695] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T06:53:44.976679] [INFO ] [REMOTE ] TPH: Full fetch complete (64615 records). [2025-09-17T06:53:44.976854] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-17T06:53:45.376657] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-17T06:53:45.376815] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-17T06:53:45.378199] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-17T06:53:45.378277] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-17T06:53:45.379788] [DEBUG] [LOCAL ] TPH: Trimmed 64615 records to 45377 (keeping 200 days of data) [2025-09-17T06:53:45.490205] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-17T06:53:45.660498] [DEBUG] [LOCAL ] TPH: Primary data saved (45377 records). [2025-09-17T06:53:45.660703] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-17T06:53:45.660829] [INFO ] [MAIN ] Update Progress: 2116/2369 symbols completed. TPH took 36.8s. Estimated remaining: 37m 1s. Rate: 6.8 symbols/min [2025-09-17T06:53:45.833282] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:53:45.841688] [DEBUG] [LOCAL ] TPYP: Loaded 5830 existing records from primary storage. [2025-09-17T06:53:45.841816] [INFO ] [MAIN ] TPYP: Loaded 5830 existing records. [2025-09-17T06:53:46.028010] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:53:46.044226] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-17T06:53:46.046781] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-17T06:53:46.047572] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-17T06:53:46.048587] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T06:53:46.048856] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-17T06:53:46.296996] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-17T06:53:46.426621] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:53:47.090147] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-17T06:53:47.515317] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T06:53:47.856483] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-17T06:53:47.890207] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-17T06:53:48.119753] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T06:53:48.690172] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-11. [2025-09-17T06:53:48.927768] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T06:53:49.454442] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T06:53:49.490154] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-09-17T06:53:50.145470] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T06:53:50.290214] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-09-17T06:53:51.090137] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-17T06:53:51.113594] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T06:53:51.890124] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-17T06:53:52.690150] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-17T06:53:53.063164] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T06:53:53.093402] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T06:53:53.497817] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-17T06:53:53.517215] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T06:53:54.290230] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-17T06:53:54.360214] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T06:53:55.090138] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-17T06:53:55.890123] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-17T06:53:56.227479] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T06:53:56.246762] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T06:53:56.690177] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-17T06:53:56.697441] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T06:53:57.490172] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-17T06:53:58.290136] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-17T06:53:58.362954] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T06:53:58.372759] [INFO ] [REMOTE ] TPR: Full fetch complete (77300 records). [2025-09-17T06:53:58.373005] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-17T06:53:58.779744] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-17T06:53:58.779973] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-17T06:53:58.786410] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-17T06:53:58.795466] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-17T06:53:58.797336] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T06:53:58.804292] [DEBUG] [LOCAL ] TPR: Trimmed 77300 records to 53489 (keeping 200 days of data) [2025-09-17T06:53:59.098062] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-17T06:53:59.149278] [DEBUG] [LOCAL ] TPR: Primary data saved (53489 records). [2025-09-17T06:53:59.149456] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-17T06:53:59.149558] [INFO ] [MAIN ] Update Progress: 2117/2369 symbols completed. TPR took 35.6s. Estimated remaining: 36m 53s. Rate: 6.8 symbols/min [2025-09-17T06:53:59.173477] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T06:53:59.175561] [INFO ] [REMOTE ] TPL: Full fetch complete (18886 records). [2025-09-17T06:53:59.175674] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-17T06:53:59.571131] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-17T06:53:59.571304] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-17T06:53:59.572009] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-17T06:53:59.572079] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-17T06:53:59.573344] [DEBUG] [LOCAL ] TPL: Trimmed 18886 records to 12498 (keeping 200 days of data) [2025-09-17T06:53:59.674509] [DEBUG] [LOCAL ] TPL: Primary data saved (12498 records). [2025-09-17T06:53:59.674785] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-17T06:53:59.674945] [INFO ] [MAIN ] Update Progress: 2118/2369 symbols completed. TPL took 40.2s. Estimated remaining: 36m 43s. Rate: 6.8 symbols/min [2025-09-17T06:53:59.890182] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-17T06:53:59.936590] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T06:54:00.690153] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-17T06:54:00.933163] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T06:54:01.479310] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T06:54:01.490075] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-17T06:54:02.290171] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-17T06:54:03.103273] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T06:54:03.105727] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-17T06:54:04.054897] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T06:54:04.057258] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-17T06:54:04.479564] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-17T06:54:04.483337] [INFO ] [REMOTE ] TPVG: Full fetch complete (40065 records). [2025-09-17T06:54:04.483439] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-17T06:54:04.801577] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T06:54:04.850601] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-17T06:54:04.866408] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-17T06:54:04.866497] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-17T06:54:04.867408] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-17T06:54:04.867480] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-17T06:54:04.868776] [DEBUG] [LOCAL ] TPVG: Trimmed 40065 records to 27104 (keeping 200 days of data) [2025-09-17T06:54:05.027152] [DEBUG] [LOCAL ] TPVG: Primary data saved (27104 records). [2025-09-17T06:54:05.027306] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-17T06:54:05.027416] [INFO ] [MAIN ] Update Progress: 2119/2369 symbols completed. TPVG took 38.6s. Estimated remaining: 36m 34s. Rate: 6.8 symbols/min [2025-09-17T06:54:05.666014] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T06:54:05.667958] [INFO ] [REMOTE ] TPYP: Full fetch complete (12486 records). [2025-09-17T06:54:05.668091] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-17T06:54:06.076437] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-17T06:54:06.076539] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-17T06:54:06.076842] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-17T06:54:06.076894] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-17T06:54:06.077402] [DEBUG] [LOCAL ] TPYP: Trimmed 12486 records to 8038 (keeping 200 days of data) [2025-09-17T06:54:06.126178] [DEBUG] [LOCAL ] TPYP: Primary data saved (8038 records). [2025-09-17T06:54:06.126318] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-17T06:54:06.126414] [INFO ] [MAIN ] Update Progress: 2120/2369 symbols completed. TPYP took 20.5s. Estimated remaining: 36m 25s. Rate: 6.8 symbols/min [2025-09-17T06:54:06.631553] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:54:06.812786] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:54:06.833595] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:54:06.832120] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:54:06.836849] [DEBUG] [LOCAL ] TPZ: Loaded 3290 existing records from primary storage. [2025-09-17T06:54:06.837386] [INFO ] [MAIN ] TPZ: Loaded 3290 existing records. [2025-09-17T06:54:06.949742] [DEBUG] [LOCAL ] TRAK: Loaded 6721 existing records from primary storage. [2025-09-17T06:54:06.953428] [INFO ] [MAIN ] TRAK: Loaded 6721 existing records. [2025-09-17T06:54:06.969995] [DEBUG] [LOCAL ] TRC: Loaded 11443 existing records from primary storage. [2025-09-17T06:54:06.980406] [INFO ] [MAIN ] TRC: Loaded 11443 existing records. [2025-09-17T06:54:06.980673] [DEBUG] [LOCAL ] TR: Loaded 14855 existing records from primary storage. [2025-09-17T06:54:07.080354] [INFO ] [MAIN ] TR: Loaded 14855 existing records. [2025-09-17T06:54:07.156597] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:54:07.260554] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-17T06:54:07.334216] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-17T06:54:07.366284] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-17T06:54:07.398633] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-17T06:54:07.525330] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:54:07.618878] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:54:07.631753] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-17T06:54:07.686539] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-17T06:54:07.686693] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-17T06:54:07.686496] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:54:07.697473] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-17T06:54:07.737129] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-17T06:54:07.707809] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-17T06:54:07.737083] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-17T06:54:07.745464] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-17T06:54:07.745547] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-17T06:54:07.745579] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-17T06:54:07.928521] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-17T06:54:07.988000] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-17T06:54:08.469509] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:54:08.599998] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-11. [2025-09-17T06:54:08.968499] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:54:08.995940] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:54:09.006539] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-11. [2025-09-17T06:54:09.006815] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-11. [2025-09-17T06:54:09.063994] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:54:09.064947] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-11. [2025-09-17T06:54:09.359885] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T06:54:09.361417] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-09-17T06:54:09.844196] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T06:54:09.846997] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-09-17T06:54:09.940797] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T06:54:10.021891] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T06:54:10.071010] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T06:54:10.290160] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-09-17T06:54:10.617966] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T06:54:11.090134] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-09-17T06:54:11.193127] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T06:54:11.890138] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-09-17T06:54:11.916879] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T06:54:12.690144] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-09-17T06:54:12.819829] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T06:54:13.490129] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-09-17T06:54:13.555843] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T06:54:14.290144] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-17T06:54:14.403700] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T06:54:15.090146] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-09-17T06:54:15.135149] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T06:54:15.890128] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-17T06:54:16.690139] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-17T06:54:17.064384] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T06:54:17.078875] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T06:54:17.490198] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-17T06:54:17.603890] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T06:54:18.204719] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T06:54:18.290147] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-17T06:54:19.090176] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-17T06:54:19.143713] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T06:54:19.860985] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T06:54:19.890074] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-17T06:54:20.615146] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T06:54:20.690167] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-17T06:54:21.305198] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T06:54:21.490146] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-17T06:54:22.290135] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-17T06:54:22.433420] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T06:54:22.627130] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T06:54:23.090165] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-17T06:54:23.779997] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T06:54:23.890205] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-17T06:54:24.690141] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-17T06:54:24.938308] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T06:54:25.490156] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-17T06:54:25.725792] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T06:54:26.290163] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-17T06:54:26.557791] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T06:54:27.084590] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T06:54:27.090065] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-17T06:54:27.890187] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-17T06:54:27.974166] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T06:54:28.517794] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T06:54:28.690161] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-17T06:54:29.200067] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T06:54:29.490138] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-17T06:54:30.290158] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-17T06:54:30.475780] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T06:54:31.031083] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T06:54:31.090132] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-17T06:54:31.863886] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T06:54:31.890115] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-17T06:54:32.492616] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T06:54:32.494133] [INFO ] [REMOTE ] TPZ: Full fetch complete (9316 records). [2025-09-17T06:54:32.494282] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-17T06:54:32.695204] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-17T06:54:32.876382] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-17T06:54:32.876486] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-17T06:54:32.876737] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-17T06:54:32.876790] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-17T06:54:32.877252] [DEBUG] [LOCAL ] TPZ: Trimmed 9316 records to 5319 (keeping 200 days of data) [2025-09-17T06:54:32.909970] [DEBUG] [LOCAL ] TPZ: Primary data saved (5319 records). [2025-09-17T06:54:32.910075] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-17T06:54:32.910156] [INFO ] [MAIN ] Update Progress: 2121/2369 symbols completed. TPZ took 26.8s. Estimated remaining: 36m 18s. Rate: 6.8 symbols/min [2025-09-17T06:54:33.081327] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:54:33.116757] [DEBUG] [LOCAL ] TREX: Loaded 36864 existing records from primary storage. [2025-09-17T06:54:33.116942] [INFO ] [MAIN ] TREX: Loaded 36864 existing records. [2025-09-17T06:54:33.297874] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:54:33.298112] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-17T06:54:33.298171] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-17T06:54:33.298988] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-17T06:54:33.299049] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-17T06:54:33.495188] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-17T06:54:33.638463] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T06:54:33.666424] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:54:34.290187] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-17T06:54:34.315886] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T06:54:35.090198] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-17T06:54:35.128158] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T06:54:35.130058] [INFO ] [REMOTE ] TRAK: Full fetch complete (13365 records). [2025-09-17T06:54:35.130160] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-17T06:54:35.493750] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-17T06:54:35.493855] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-17T06:54:35.494176] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-17T06:54:35.494226] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-17T06:54:35.494718] [DEBUG] [LOCAL ] TRAK: Trimmed 13365 records to 9431 (keeping 200 days of data) [2025-09-17T06:54:35.554398] [DEBUG] [LOCAL ] TRAK: Primary data saved (9431 records). [2025-09-17T06:54:35.554561] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-17T06:54:35.554683] [INFO ] [MAIN ] Update Progress: 2122/2369 symbols completed. TRAK took 29.4s. Estimated remaining: 36m 8s. Rate: 6.8 symbols/min [2025-09-17T06:54:35.730358] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:54:35.730597] [DEBUG] [LOCAL ] TRGP: No existing data file found in primary storage. [2025-09-17T06:54:35.730668] [WARN ] [MAIN ] TRGP: No existing data found, performing full refresh instead. [2025-09-17T06:54:35.730776] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-17T06:54:35.730827] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-17T06:54:35.730934] [DEBUG] [LOCAL ] TRGP: No primary data file found to delete. [2025-09-17T06:54:35.730981] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-17T06:54:35.891678] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-17T06:54:36.092321] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:54:36.109601] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T06:54:36.690224] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-11. [2025-09-17T06:54:36.953760] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T06:54:37.490166] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-17T06:54:38.230216] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T06:54:38.290111] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-17T06:54:38.621900] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T06:54:38.856862] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T06:54:39.090184] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-17T06:54:39.890151] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-09-17T06:54:40.063960] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T06:54:40.066152] [INFO ] [REMOTE ] TRC: Full fetch complete (21816 records). [2025-09-17T06:54:40.066248] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-17T06:54:40.437261] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-17T06:54:40.437389] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-17T06:54:40.437993] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-17T06:54:40.438053] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-17T06:54:40.438791] [DEBUG] [LOCAL ] TRC: Trimmed 21816 records to 15940 (keeping 200 days of data) [2025-09-17T06:54:40.535967] [DEBUG] [LOCAL ] TRC: Primary data saved (15940 records). [2025-09-17T06:54:40.536148] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-17T06:54:40.536246] [INFO ] [MAIN ] Update Progress: 2123/2369 symbols completed. TRC took 34.4s. Estimated remaining: 35m 59s. Rate: 6.8 symbols/min [2025-09-17T06:54:40.702851] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-17T06:54:40.705459] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:54:40.734122] [DEBUG] [LOCAL ] TRN: Loaded 27550 existing records from primary storage. [2025-09-17T06:54:40.734291] [INFO ] [MAIN ] TRN: Loaded 27550 existing records. [2025-09-17T06:54:40.920251] [WARN ] [MAIN ] TRN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:54:40.920524] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-17T06:54:40.920583] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-17T06:54:40.921268] [DEBUG] [LOCAL ] TRN: Deleted primary data file. [2025-09-17T06:54:40.921333] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-17T06:54:41.274705] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:54:41.367735] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T06:54:41.490110] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-11. [2025-09-17T06:54:41.770309] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T06:54:42.290137] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-17T06:54:43.020850] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T06:54:43.024281] [INFO ] [REMOTE ] TR: Full fetch complete (24437 records). [2025-09-17T06:54:43.024485] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-17T06:54:43.098098] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-09-17T06:54:43.166773] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T06:54:43.448302] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-17T06:54:43.448438] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-17T06:54:43.449030] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-17T06:54:43.449093] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-17T06:54:43.450101] [DEBUG] [LOCAL ] TR: Trimmed 24437 records to 18117 (keeping 200 days of data) [2025-09-17T06:54:43.562234] [DEBUG] [LOCAL ] TR: Primary data saved (18117 records). [2025-09-17T06:54:43.562399] [INFO ] [MAIN ] TR: Full history saved. [2025-09-17T06:54:43.562508] [INFO ] [MAIN ] Update Progress: 2124/2369 symbols completed. TR took 37.4s. Estimated remaining: 35m 50s. Rate: 6.8 symbols/min [2025-09-17T06:54:43.754135] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:54:43.795024] [DEBUG] [LOCAL ] TRNO: Loaded 32854 existing records from primary storage. [2025-09-17T06:54:43.795200] [INFO ] [MAIN ] TRNO: Loaded 32854 existing records. [2025-09-17T06:54:43.894431] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-11. [2025-09-17T06:54:43.973604] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:54:43.973858] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-17T06:54:43.973915] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-17T06:54:43.974616] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-17T06:54:43.974698] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-17T06:54:44.328791] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:54:44.690122] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-11. [2025-09-17T06:54:44.740901] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T06:54:44.873102] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T06:54:45.490145] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-09-17T06:54:45.770607] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T06:54:46.290166] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-09-17T06:54:47.090110] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-17T06:54:47.130654] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T06:54:47.416531] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T06:54:47.890159] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-09-17T06:54:48.640723] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T06:54:48.690094] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-17T06:54:49.490137] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-09-17T06:54:49.588943] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T06:54:50.290144] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-17T06:54:50.422223] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T06:54:50.460532] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T06:54:51.090155] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-09-17T06:54:51.832506] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T06:54:51.890196] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-17T06:54:52.195144] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T06:54:52.690184] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-17T06:54:53.289836] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T06:54:53.490146] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-17T06:54:54.290151] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-17T06:54:54.689453] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T06:54:54.776049] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T06:54:55.090231] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-17T06:54:55.684090] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T06:54:55.890186] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-17T06:54:56.690120] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-17T06:54:56.808777] [DEBUG] [REMOTE ] TRN: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-17T06:54:56.809300] [WARN ] [REMOTE ] TRN: No data returned for month 2025-03 [2025-09-17T06:54:56.846752] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T06:54:57.380720] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T06:54:57.490107] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-17T06:54:58.290131] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-17T06:54:58.918121] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T06:54:59.090173] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-17T06:54:59.651374] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T06:54:59.890149] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-17T06:55:00.165215] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T06:55:00.690144] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-17T06:55:01.490194] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-17T06:55:01.633410] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T06:55:02.290221] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-17T06:55:02.352021] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T06:55:02.860570] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T06:55:03.090159] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-17T06:55:03.799779] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T06:55:03.890174] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-17T06:55:04.700694] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-17T06:55:04.707590] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T06:55:05.490137] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-17T06:55:05.540498] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T06:55:06.290147] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-17T06:55:06.396876] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T06:55:07.011747] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T06:55:07.090207] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-17T06:55:07.649022] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T06:55:07.890130] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-17T06:55:08.419950] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T06:55:08.690141] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-17T06:55:09.490140] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-17T06:55:09.582318] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T06:55:10.207032] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T06:55:10.290193] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-17T06:55:10.846842] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T06:55:11.090138] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-17T06:55:11.890145] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-17T06:55:12.086979] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T06:55:12.093323] [INFO ] [REMOTE ] TREX: Full fetch complete (70488 records). [2025-09-17T06:55:12.093519] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-17T06:55:12.531497] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-17T06:55:12.531637] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-17T06:55:12.532859] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-17T06:55:12.532941] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-17T06:55:12.534464] [DEBUG] [LOCAL ] TREX: Trimmed 70488 records to 49979 (keeping 200 days of data) [2025-09-17T06:55:12.723480] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-17T06:55:12.771455] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T06:55:12.783940] [INFO ] [REMOTE ] TRGP: Full fetch complete (73343 records). [2025-09-17T06:55:12.786140] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-17T06:55:13.209663] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-17T06:55:13.210357] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-17T06:55:13.212627] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-17T06:55:13.213071] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-17T06:55:13.243824] [DEBUG] [LOCAL ] TRGP: Trimmed 73343 records to 50889 (keeping 200 days of data) [2025-09-17T06:55:13.291114] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T06:55:13.429619] [DEBUG] [LOCAL ] TREX: Primary data saved (49979 records). [2025-09-17T06:55:13.430721] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-17T06:55:13.432739] [INFO ] [MAIN ] Update Progress: 2125/2369 symbols completed. TREX took 40.5s. Estimated remaining: 35m 43s. Rate: 6.8 symbols/min [2025-09-17T06:55:13.491613] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-17T06:55:13.672102] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:55:13.749797] [DEBUG] [LOCAL ] TROX: Loaded 38819 existing records from primary storage. [2025-09-17T06:55:13.752421] [INFO ] [MAIN ] TROX: Loaded 38819 existing records. [2025-09-17T06:55:13.993532] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:55:14.009017] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-17T06:55:14.009582] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-17T06:55:14.011876] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-17T06:55:14.012432] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-17T06:55:14.340758] [DEBUG] [LOCAL ] TRGP: Primary data saved (50889 records). [2025-09-17T06:55:14.399842] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:55:14.400370] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-11. [2025-09-17T06:55:14.400052] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-17T06:55:14.401547] [INFO ] [MAIN ] Update Progress: 2126/2369 symbols completed. TRGP took 38.8s. Estimated remaining: 35m 34s. Rate: 6.8 symbols/min [2025-09-17T06:55:14.586402] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T06:55:14.604403] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:55:14.654728] [DEBUG] [LOCAL ] TRP: Loaded 38806 existing records from primary storage. [2025-09-17T06:55:14.654935] [INFO ] [MAIN ] TRP: Loaded 38806 existing records. [2025-09-17T06:55:14.835249] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:55:14.835601] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-17T06:55:14.835740] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-17T06:55:14.844299] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-17T06:55:14.857557] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-17T06:55:14.876668] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T06:55:15.098061] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-17T06:55:15.241310] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:55:15.890127] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-11. [2025-09-17T06:55:15.940995] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T06:55:16.690127] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-09-17T06:55:16.786188] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T06:55:16.792180] [INFO ] [REMOTE ] TRNO: Full fetch complete (63869 records). [2025-09-17T06:55:16.792372] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-17T06:55:17.211090] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-17T06:55:17.211203] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-17T06:55:17.212301] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-17T06:55:17.212390] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-17T06:55:17.213915] [DEBUG] [LOCAL ] TRNO: Trimmed 63869 records to 44293 (keeping 200 days of data) [2025-09-17T06:55:17.492366] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-17T06:55:17.508582] [DEBUG] [LOCAL ] TRNO: Primary data saved (44293 records). [2025-09-17T06:55:17.508764] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-17T06:55:17.508866] [INFO ] [MAIN ] Update Progress: 2127/2369 symbols completed. TRNO took 33.9s. Estimated remaining: 35m 24s. Rate: 6.8 symbols/min [2025-09-17T06:55:17.711893] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:55:17.737776] [DEBUG] [LOCAL ] TRTX: Loaded 26718 existing records from primary storage. [2025-09-17T06:55:17.737969] [INFO ] [MAIN ] TRTX: Loaded 26718 existing records. [2025-09-17T06:55:17.928341] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:55:17.928673] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-17T06:55:17.928801] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-17T06:55:17.929339] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-17T06:55:17.929405] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-17T06:55:18.337713] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-11 (2.45 seconds). [2025-09-17T06:55:18.334514] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:55:18.348596] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-11. [2025-09-17T06:55:18.376503] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T06:55:18.794435] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T06:55:18.802994] [INFO ] [REMOTE ] TRN: Full fetch complete (46943 records). [2025-09-17T06:55:18.803211] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-17T06:55:18.996780] [WARN ] [VALIDATOR ] TRN: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T06:55:18.997351] [FATAL] [MAIN ] TRN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:55:18.997406] [WARN ] [MAIN ] TRN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:55:18.997456] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-17T06:55:18.997537] [DEBUG] [LOCAL ] TRN: No primary data file found to delete. [2025-09-17T06:55:18.997590] [INFO ] [LOCAL ] TRN: Starting deletion of derivative data. [2025-09-17T06:55:18.997947] [DEBUG] [LOCAL ] TRN: Deleted derivative data file. [2025-09-17T06:55:18.998048] [INFO ] [MAIN ] Update Progress: 2128/2369 symbols completed. TRN took 38.5s. Estimated remaining: 35m 15s. Rate: 6.8 symbols/min [2025-09-17T06:55:19.096867] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-09-17T06:55:19.172923] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:55:19.210216] [DEBUG] [LOCAL ] TRU: Loaded 37991 existing records from primary storage. [2025-09-17T06:55:19.210411] [INFO ] [MAIN ] TRU: Loaded 37991 existing records. [2025-09-17T06:55:19.388303] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:55:19.388557] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-17T06:55:19.388616] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-17T06:55:19.389348] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-17T06:55:19.389407] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-17T06:55:19.759760] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:55:19.780240] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T06:55:19.890151] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-09-17T06:55:20.236747] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T06:55:20.690161] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-09-17T06:55:21.258910] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T06:55:21.490134] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-17T06:55:22.290176] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-09-17T06:55:22.520109] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T06:55:23.090159] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-09-17T06:55:23.238575] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T06:55:23.387542] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T06:55:23.890141] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-17T06:55:24.690151] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-17T06:55:24.730998] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T06:55:24.991903] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T06:55:25.490196] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-17T06:55:26.094014] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T06:55:26.290145] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-17T06:55:26.886017] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T06:55:27.090133] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-17T06:55:27.510737] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T06:55:27.890153] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-17T06:55:28.330331] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T06:55:28.690148] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-17T06:55:29.246328] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T06:55:29.490168] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-17T06:55:30.034075] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T06:55:30.290151] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-11. [2025-09-17T06:55:31.007016] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T06:55:31.090171] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-17T06:55:31.890163] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-17T06:55:31.995671] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T06:55:32.430145] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T06:55:32.690146] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-17T06:55:33.114572] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T06:55:33.490196] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-09-17T06:55:34.290204] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-17T06:55:34.431100] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T06:55:34.634550] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T06:55:35.090140] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-17T06:55:35.571127] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T06:55:35.890237] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-17T06:55:36.690172] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-09-17T06:55:36.750931] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T06:55:37.036219] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T06:55:37.490177] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-17T06:55:38.008342] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T06:55:38.290227] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-17T06:55:38.975350] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T06:55:38.980105] [INFO ] [REMOTE ] TRTX: Full fetch complete (52663 records). [2025-09-17T06:55:38.980252] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-17T06:55:39.095351] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-17T06:55:39.378620] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-17T06:55:39.378776] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-17T06:55:39.379854] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-17T06:55:39.379942] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-17T06:55:39.381282] [DEBUG] [LOCAL ] TRTX: Trimmed 52663 records to 37314 (keeping 200 days of data) [2025-09-17T06:55:39.610429] [DEBUG] [LOCAL ] TRTX: Primary data saved (37314 records). [2025-09-17T06:55:39.610634] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-17T06:55:39.610792] [INFO ] [MAIN ] Update Progress: 2129/2369 symbols completed. TRTX took 22.1s. Estimated remaining: 35m 7s. Rate: 6.8 symbols/min [2025-09-17T06:55:39.790020] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:55:39.790304] [DEBUG] [LOCAL ] TRV: No existing data file found in primary storage. [2025-09-17T06:55:39.790370] [WARN ] [MAIN ] TRV: No existing data found, performing full refresh instead. [2025-09-17T06:55:39.790529] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-17T06:55:39.790602] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-17T06:55:39.790697] [DEBUG] [LOCAL ] TRV: No primary data file found to delete. [2025-09-17T06:55:39.790761] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-17T06:55:39.892692] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-17T06:55:40.164400] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:55:40.199010] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T06:55:40.690193] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-11. [2025-09-17T06:55:40.728840] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T06:55:41.490214] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-17T06:55:41.736228] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T06:55:42.290177] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-17T06:55:42.393880] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T06:55:43.090196] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-17T06:55:43.219017] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T06:55:43.526274] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T06:55:43.890139] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-17T06:55:44.690177] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-17T06:55:44.860663] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T06:55:45.490209] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-17T06:55:45.563534] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T06:55:45.570584] [INFO ] [REMOTE ] TROX: Full fetch complete (71930 records). [2025-09-17T06:55:45.570833] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-17T06:55:45.972079] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-17T06:55:45.972250] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-17T06:55:45.973439] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-17T06:55:45.973522] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-17T06:55:45.975496] [DEBUG] [LOCAL ] TROX: Trimmed 71930 records to 51715 (keeping 200 days of data) [2025-09-17T06:55:46.287262] [DEBUG] [LOCAL ] TROX: Primary data saved (51715 records). [2025-09-17T06:55:46.287448] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-17T06:55:46.287587] [INFO ] [MAIN ] Update Progress: 2130/2369 symbols completed. TROX took 32.9s. Estimated remaining: 34m 58s. Rate: 6.8 symbols/min [2025-09-17T06:55:46.319394] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-17T06:55:46.465190] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:55:46.501777] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T06:55:46.544719] [DEBUG] [LOCAL ] TS: Loaded 38422 existing records from primary storage. [2025-09-17T06:55:46.544930] [INFO ] [MAIN ] TS: Loaded 38422 existing records. [2025-09-17T06:55:46.725047] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:55:46.725292] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-17T06:55:46.725345] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-17T06:55:46.726160] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-17T06:55:46.726228] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-17T06:55:47.088051] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:55:47.090085] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-11. [2025-09-17T06:55:47.307384] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T06:55:47.699555] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T06:55:47.890185] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-17T06:55:48.690186] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-17T06:55:48.867994] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T06:55:49.490186] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-17T06:55:49.648428] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T06:55:50.290195] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-17T06:55:50.397174] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T06:55:51.090395] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-17T06:55:51.171343] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T06:55:51.890140] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-09-17T06:55:51.957022] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T06:55:52.341162] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T06:55:52.690162] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-17T06:55:53.490202] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-17T06:55:53.644895] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T06:55:54.290180] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-09-17T06:55:54.501179] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T06:55:54.975900] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T06:55:55.090148] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-17T06:55:55.890146] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-17T06:55:56.562300] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T06:55:56.690116] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-17T06:55:57.293043] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T06:55:57.490164] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-17T06:55:58.162684] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T06:55:58.169527] [INFO ] [REMOTE ] TRU: Full fetch complete (72729 records). [2025-09-17T06:55:58.169729] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-17T06:55:58.295294] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-17T06:55:58.590367] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-17T06:55:58.590483] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-17T06:55:58.591747] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-17T06:55:58.591814] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-17T06:55:58.595029] [DEBUG] [LOCAL ] TRU: Trimmed 72729 records to 51160 (keeping 200 days of data) [2025-09-17T06:55:58.920205] [DEBUG] [LOCAL ] TRU: Primary data saved (51160 records). [2025-09-17T06:55:58.920373] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-17T06:55:58.920488] [INFO ] [MAIN ] Update Progress: 2131/2369 symbols completed. TRU took 39.9s. Estimated remaining: 34m 50s. Rate: 6.8 symbols/min [2025-09-17T06:55:59.103163] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:55:59.125052] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T06:55:59.135402] [INFO ] [REMOTE ] TRP: Full fetch complete (75466 records). [2025-09-17T06:55:59.135625] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-17T06:55:59.253629] [DEBUG] [LOCAL ] TSE: Loaded 21302 existing records from primary storage. [2025-09-17T06:55:59.300899] [INFO ] [MAIN ] TSE: Loaded 21302 existing records. [2025-09-17T06:55:59.701721] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:55:59.741828] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-17T06:55:59.742162] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-17T06:55:59.742275] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-17T06:55:59.743865] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-17T06:55:59.742453] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-17T06:55:59.744014] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-17T06:55:59.745108] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-17T06:55:59.745293] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-17T06:55:59.836925] [DEBUG] [LOCAL ] TRP: Trimmed 75466 records to 52181 (keeping 200 days of data) [2025-09-17T06:55:59.922486] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (5.63 seconds). [2025-09-17T06:56:00.097540] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-17T06:56:00.468114] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T06:56:00.655907] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-17T06:56:00.733258] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:56:00.740578] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-11. [2025-09-17T06:56:00.923210] [DEBUG] [LOCAL ] TRP: Primary data saved (52181 records). [2025-09-17T06:56:00.923469] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-17T06:56:00.923690] [INFO ] [MAIN ] Update Progress: 2132/2369 symbols completed. TRP took 46.5s. Estimated remaining: 34m 40s. Rate: 6.8 symbols/min [2025-09-17T06:56:01.168187] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:56:01.176356] [DEBUG] [LOCAL ] TSI: Loaded 5465 existing records from primary storage. [2025-09-17T06:56:01.176520] [INFO ] [MAIN ] TSI: Loaded 5465 existing records. [2025-09-17T06:56:01.356548] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:56:01.356821] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-17T06:56:01.356889] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-17T06:56:01.357143] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-17T06:56:01.357207] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-17T06:56:01.708584] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:56:01.708973] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-11. [2025-09-17T06:56:01.740959] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T06:56:01.972632] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T06:56:02.294024] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-09-17T06:56:02.301619] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T06:56:02.441779] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T06:56:03.090133] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-17T06:56:03.490092] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T06:56:03.890157] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-09-17T06:56:04.690105] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-09-17T06:56:04.805534] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T06:56:05.126980] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T06:56:05.415114] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T06:56:05.490151] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-09-17T06:56:06.197757] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T06:56:06.290127] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-17T06:56:07.090184] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-17T06:56:07.890143] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-17T06:56:08.041726] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T06:56:08.073961] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T06:56:08.690137] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-17T06:56:09.475564] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T06:56:09.490076] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-17T06:56:09.598982] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T06:56:10.290145] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-17T06:56:11.090118] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-17T06:56:11.260929] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T06:56:11.419914] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T06:56:11.890129] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-17T06:56:12.690178] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-17T06:56:12.759192] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T06:56:12.764990] [INFO ] [REMOTE ] TRV: Full fetch complete (70006 records). [2025-09-17T06:56:12.765192] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-17T06:56:13.162566] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-17T06:56:13.162740] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-17T06:56:13.163835] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-17T06:56:13.163933] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-17T06:56:13.171762] [DEBUG] [LOCAL ] TRV: Trimmed 70006 records to 48449 (keeping 200 days of data) [2025-09-17T06:56:13.183431] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T06:56:13.442784] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T06:56:13.495220] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-17T06:56:13.528960] [DEBUG] [LOCAL ] TRV: Primary data saved (48449 records). [2025-09-17T06:56:13.529109] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-17T06:56:13.529267] [INFO ] [MAIN ] Update Progress: 2133/2369 symbols completed. TRV took 33.9s. Estimated remaining: 34m 32s. Rate: 6.8 symbols/min [2025-09-17T06:56:13.720066] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:56:13.747043] [DEBUG] [LOCAL ] TSLX: Loaded 25751 existing records from primary storage. [2025-09-17T06:56:13.747247] [INFO ] [MAIN ] TSLX: Loaded 25751 existing records. [2025-09-17T06:56:13.940701] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:56:13.940963] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-17T06:56:13.941054] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-17T06:56:13.941778] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-17T06:56:13.941843] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-17T06:56:14.305017] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-17T06:56:14.311397] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:56:14.445748] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T06:56:15.090188] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-17T06:56:15.664831] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T06:56:15.890158] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-11. [2025-09-17T06:56:16.093567] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T06:56:16.690128] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-17T06:56:17.095104] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T06:56:17.490114] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-09-17T06:56:18.057157] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T06:56:18.290102] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-17T06:56:18.366004] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T06:56:19.090147] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-09-17T06:56:19.890144] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-17T06:56:20.101559] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T06:56:20.133860] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T06:56:20.690101] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-17T06:56:21.148017] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T06:56:21.413131] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T06:56:21.490211] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-17T06:56:22.290152] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-17T06:56:22.664479] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T06:56:23.090147] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-17T06:56:23.890139] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-17T06:56:23.962941] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T06:56:23.997495] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T06:56:24.690174] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-17T06:56:25.221319] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T06:56:25.490141] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-17T06:56:26.093775] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T06:56:26.290206] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-17T06:56:27.090141] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-17T06:56:27.223702] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T06:56:27.313597] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T06:56:27.890172] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-17T06:56:28.534427] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T06:56:28.690133] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-17T06:56:29.458053] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T06:56:29.472170] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T06:56:29.475528] [INFO ] [REMOTE ] TS: Full fetch complete (74271 records). [2025-09-17T06:56:29.475724] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-17T06:56:29.475813] [INFO ] [REMOTE ] TSE: Full fetch complete (42143 records). [2025-09-17T06:56:29.476080] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-17T06:56:29.497155] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-17T06:56:30.259081] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-17T06:56:30.259156] [DEBUG] [VALIDATOR ] TS: All expected trading days are present. [2025-09-17T06:56:30.259356] [DEBUG] [VALIDATOR ] TS: Primary data validation passed. [2025-09-17T06:56:30.259315] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-17T06:56:30.260326] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-17T06:56:30.261086] [INFO ] [MAIN ] TS: Fetched primary data is valid. [2025-09-17T06:56:30.261187] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-17T06:56:30.261286] [DEBUG] [LOCAL ] TS: Saving primary data. [2025-09-17T06:56:30.263500] [DEBUG] [LOCAL ] TS: Trimmed 74271 records to 51706 (keeping 200 days of data) [2025-09-17T06:56:30.264093] [DEBUG] [LOCAL ] TSE: Trimmed 42143 records to 29040 (keeping 200 days of data) [2025-09-17T06:56:30.369592] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-17T06:56:30.592568] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T06:56:30.743507] [DEBUG] [LOCAL ] TSE: Primary data saved (29040 records). [2025-09-17T06:56:30.744864] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-17T06:56:30.745877] [INFO ] [MAIN ] Update Progress: 2134/2369 symbols completed. TSE took 31.8s. Estimated remaining: 34m 24s. Rate: 6.8 symbols/min [2025-09-17T06:56:30.928730] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:56:30.929722] [DEBUG] [LOCAL ] TSM: No existing data file found in primary storage. [2025-09-17T06:56:30.930385] [WARN ] [MAIN ] TSM: No existing data found, performing full refresh instead. [2025-09-17T06:56:30.932083] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-17T06:56:30.932930] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-17T06:56:30.933749] [DEBUG] [LOCAL ] TSM: No primary data file found to delete. [2025-09-17T06:56:30.934385] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-17T06:56:30.935970] [DEBUG] [LOCAL ] TS: Primary data saved (51706 records). [2025-09-17T06:56:30.936095] [INFO ] [MAIN ] TS: Full history saved. [2025-09-17T06:56:30.978297] [INFO ] [MAIN ] Update Progress: 2135/2369 symbols completed. TS took 44.7s. Estimated remaining: 34m 14s. Rate: 6.8 symbols/min [2025-09-17T06:56:31.102449] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-17T06:56:31.409683] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:56:31.436420] [DEBUG] [LOCAL ] TSN: No existing data file found in primary storage. [2025-09-17T06:56:31.471668] [WARN ] [MAIN ] TSN: No existing data found, performing full refresh instead. [2025-09-17T06:56:31.492501] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:56:31.493056] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-17T06:56:31.493504] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-17T06:56:31.493587] [DEBUG] [LOCAL ] TSN: No primary data file found to delete. [2025-09-17T06:56:31.493634] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-17T06:56:31.868432] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:56:31.891230] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T06:56:31.890256] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-11. [2025-09-17T06:56:31.987585] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T06:56:31.989268] [INFO ] [REMOTE ] TSI: Full fetch complete (13279 records). [2025-09-17T06:56:31.989358] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-17T06:56:32.349670] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-17T06:56:32.349777] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-17T06:56:32.350085] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-17T06:56:32.350152] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-17T06:56:32.350689] [DEBUG] [LOCAL ] TSI: Trimmed 13279 records to 8680 (keeping 200 days of data) [2025-09-17T06:56:32.401860] [DEBUG] [LOCAL ] TSI: Primary data saved (8680 records). [2025-09-17T06:56:32.402011] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-17T06:56:32.402107] [INFO ] [MAIN ] Update Progress: 2136/2369 symbols completed. TSI took 31.5s. Estimated remaining: 34m 5s. Rate: 6.8 symbols/min [2025-09-17T06:56:32.571555] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:56:32.582478] [DEBUG] [LOCAL ] TSQ: Loaded 9426 existing records from primary storage. [2025-09-17T06:56:32.582629] [INFO ] [MAIN ] TSQ: Loaded 9426 existing records. [2025-09-17T06:56:32.695275] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-17T06:56:32.764963] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:56:32.765229] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-17T06:56:32.765281] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-17T06:56:32.765634] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-17T06:56:32.765719] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-17T06:56:33.110919] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:56:33.490159] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-11. [2025-09-17T06:56:33.678322] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T06:56:33.960563] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T06:56:34.075623] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T06:56:34.290134] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-09-17T06:56:35.090151] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-11. [2025-09-17T06:56:35.115119] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T06:56:35.890131] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-09-17T06:56:36.690146] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-17T06:56:37.490107] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-09-17T06:56:37.570529] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T06:56:37.672769] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-11 (2.58 seconds). [2025-09-17T06:56:37.742592] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T06:56:38.290114] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-17T06:56:38.345489] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T06:56:39.090151] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-09-17T06:56:39.442412] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T06:56:39.890148] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-17T06:56:40.690149] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-17T06:56:40.821943] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T06:56:41.107666] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T06:56:41.111873] [INFO ] [REMOTE ] TSLX: Full fetch complete (48812 records). [2025-09-17T06:56:41.112042] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-17T06:56:41.436792] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T06:56:41.493117] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-17T06:56:41.506612] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-17T06:56:41.506735] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-17T06:56:41.507899] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-17T06:56:41.507960] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-17T06:56:41.509241] [DEBUG] [LOCAL ] TSLX: Trimmed 48812 records to 35436 (keeping 200 days of data) [2025-09-17T06:56:41.730145] [DEBUG] [LOCAL ] TSLX: Primary data saved (35436 records). [2025-09-17T06:56:41.730316] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-17T06:56:41.730435] [INFO ] [MAIN ] Update Progress: 2137/2369 symbols completed. TSLX took 28.2s. Estimated remaining: 33m 56s. Rate: 6.8 symbols/min [2025-09-17T06:56:41.899995] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:56:41.940989] [DEBUG] [LOCAL ] TT: Loaded 34994 existing records from primary storage. [2025-09-17T06:56:41.941151] [INFO ] [MAIN ] TT: Loaded 34994 existing records. [2025-09-17T06:56:42.142914] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:56:42.143290] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-17T06:56:42.143369] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-17T06:56:42.144518] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-17T06:56:42.144865] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-17T06:56:42.297370] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-17T06:56:42.513687] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:56:42.514111] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T06:56:43.090166] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-09-17T06:56:43.890175] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-17T06:56:43.942774] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T06:56:44.657695] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T06:56:44.690164] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-17T06:56:45.490180] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-17T06:56:45.599946] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T06:56:45.809846] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-17T06:56:46.290143] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-17T06:56:46.890586] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T06:56:47.090146] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-09-17T06:56:47.205484] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T06:56:47.890127] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-11. [2025-09-17T06:56:48.690201] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-17T06:56:49.422154] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T06:56:49.490149] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-09-17T06:56:49.769410] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.68 seconds). [2025-09-17T06:56:50.290156] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-17T06:56:50.547708] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T06:56:51.090176] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-17T06:56:51.100899] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T06:56:51.132083] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T06:56:51.890175] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-09-17T06:56:52.690153] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-17T06:56:53.490102] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-17T06:56:53.538239] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.45 seconds). [2025-09-17T06:56:53.572243] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T06:56:53.612401] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T06:56:54.290206] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-17T06:56:55.090190] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-17T06:56:55.388379] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T06:56:55.890144] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-17T06:56:56.019506] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T06:56:56.690142] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-17T06:56:57.170925] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T06:56:57.490139] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-17T06:56:57.679962] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T06:56:58.290143] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-17T06:56:58.364845] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T06:56:58.366578] [INFO ] [REMOTE ] TSQ: Full fetch complete (16719 records). [2025-09-17T06:56:58.366685] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-17T06:56:58.736972] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-17T06:56:58.737165] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-17T06:56:58.737625] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-17T06:56:58.737784] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-17T06:56:58.748914] [DEBUG] [LOCAL ] TSQ: Trimmed 16719 records to 12055 (keeping 200 days of data) [2025-09-17T06:56:58.773315] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T06:56:58.856170] [DEBUG] [LOCAL ] TSQ: Primary data saved (12055 records). [2025-09-17T06:56:58.856366] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-17T06:56:58.856487] [INFO ] [MAIN ] Update Progress: 2138/2369 symbols completed. TSQ took 26.5s. Estimated remaining: 33m 48s. Rate: 6.8 symbols/min [2025-09-17T06:56:59.023709] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:56:59.043194] [DEBUG] [LOCAL ] TTAM: Loaded 20405 existing records from primary storage. [2025-09-17T06:56:59.043357] [INFO ] [MAIN ] TTAM: Loaded 20405 existing records. [2025-09-17T06:56:59.097135] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-17T06:56:59.221241] [WARN ] [MAIN ] TTAM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:56:59.221483] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-17T06:56:59.221560] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-17T06:56:59.222163] [DEBUG] [LOCAL ] TTAM: Deleted primary data file. [2025-09-17T06:56:59.222231] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-17T06:56:59.570576] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:56:59.890143] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-17T06:57:00.278950] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T06:57:00.690209] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-17T06:57:01.084533] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T06:57:01.490184] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-17T06:57:02.290134] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-11. [2025-09-17T06:57:03.341578] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (2.65 seconds). [2025-09-17T06:57:03.352994] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-17T06:57:03.784243] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (3.89 seconds). [2025-09-17T06:57:03.890079] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-17T06:57:04.136890] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:57:04.137250] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-11 [2025-09-17T06:57:04.690213] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-17T06:57:04.888625] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:57:04.889022] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-17T06:57:05.187729] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (3.70 seconds). [2025-09-17T06:57:05.490134] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-17T06:57:05.665911] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-17T06:57:05.672604] [INFO ] [REMOTE ] TSN: Full fetch complete (76010 records). [2025-09-17T06:57:05.672859] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-17T06:57:06.062153] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-17T06:57:06.062270] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-17T06:57:06.063379] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-17T06:57:06.063438] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-17T06:57:06.064983] [DEBUG] [LOCAL ] TSN: Trimmed 76010 records to 52836 (keeping 200 days of data) [2025-09-17T06:57:06.290764] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-09-17T06:57:06.402548] [DEBUG] [LOCAL ] TSN: Primary data saved (52836 records). [2025-09-17T06:57:06.402737] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-17T06:57:06.402843] [INFO ] [MAIN ] Update Progress: 2139/2369 symbols completed. TSN took 35.4s. Estimated remaining: 33m 39s. Rate: 6.8 symbols/min [2025-09-17T06:57:06.575942] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:57:06.606925] [DEBUG] [LOCAL ] TTC: Loaded 31230 existing records from primary storage. [2025-09-17T06:57:06.607085] [INFO ] [MAIN ] TTC: Loaded 31230 existing records. [2025-09-17T06:57:06.651001] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:57:06.699152] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-09-17T06:57:06.799628] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-17T06:57:06.830013] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:57:06.830587] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-17T06:57:06.830805] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-17T06:57:06.831534] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-17T06:57:06.831594] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-17T06:57:07.095495] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-17T06:57:07.190079] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:57:07.219207] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T06:57:07.890119] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-17T06:57:08.690143] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-17T06:57:09.490114] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-11. [2025-09-17T06:57:09.658878] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T06:57:09.702676] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-17T06:57:09.851323] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T06:57:10.290145] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-17T06:57:10.993507] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T06:57:11.090073] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-09-17T06:57:11.672562] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T06:57:11.890088] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-17T06:57:12.690178] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-17T06:57:12.715882] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T06:57:12.964138] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T06:57:13.490193] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-09-17T06:57:14.296512] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-17T06:57:14.330676] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T06:57:14.946606] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T06:57:15.090096] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-17T06:57:15.890146] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-17T06:57:16.690154] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-17T06:57:17.424662] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-17T06:57:17.480544] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T06:57:17.490078] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-17T06:57:17.938854] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (3.64 seconds). [2025-09-17T06:57:18.048064] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T06:57:18.053893] [INFO ] [REMOTE ] TT: Full fetch complete (69617 records). [2025-09-17T06:57:18.054023] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-17T06:57:18.301552] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-17T06:57:18.442527] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-17T06:57:18.442630] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-17T06:57:18.443720] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-17T06:57:18.443780] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-17T06:57:18.445237] [DEBUG] [LOCAL ] TT: Trimmed 69617 records to 48061 (keeping 200 days of data) [2025-09-17T06:57:18.573533] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T06:57:18.778417] [DEBUG] [LOCAL ] TT: Primary data saved (48061 records). [2025-09-17T06:57:18.778576] [INFO ] [MAIN ] TT: Full history saved. [2025-09-17T06:57:18.778695] [INFO ] [MAIN ] Update Progress: 2140/2369 symbols completed. TT took 37.0s. Estimated remaining: 33m 31s. Rate: 6.8 symbols/min [2025-09-17T06:57:18.948497] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:57:18.989578] [DEBUG] [LOCAL ] TTE: Loaded 38310 existing records from primary storage. [2025-09-17T06:57:18.989778] [INFO ] [MAIN ] TTE: Loaded 38310 existing records. [2025-09-17T06:57:19.114608] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-17T06:57:19.192089] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:57:19.192299] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-17T06:57:19.192357] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-17T06:57:19.193162] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-17T06:57:19.193223] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-17T06:57:19.545248] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:57:19.890207] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-17T06:57:20.517685] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T06:57:20.690174] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-11. [2025-09-17T06:57:21.036899] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-17T06:57:21.490195] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-17T06:57:21.529623] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T06:57:22.290147] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-17T06:57:22.636229] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-17T06:57:23.090182] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-17T06:57:23.569786] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T06:57:23.890187] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-17T06:57:24.107333] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.62 seconds). [2025-09-17T06:57:24.113931] [INFO ] [REMOTE ] TSM: Full fetch complete (77974 records). [2025-09-17T06:57:24.114088] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-17T06:57:24.509445] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T06:57:24.552495] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-17T06:57:24.552990] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-17T06:57:24.554513] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-17T06:57:24.554600] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-17T06:57:24.556117] [DEBUG] [LOCAL ] TSM: Trimmed 77974 records to 53819 (keeping 200 days of data) [2025-09-17T06:57:24.744420] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-17T06:57:24.901069] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-09-17T06:57:24.901226] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-17T06:57:24.901310] [INFO ] [MAIN ] Update Progress: 2141/2369 symbols completed. TSM took 54.2s. Estimated remaining: 33m 22s. Rate: 6.8 symbols/min [2025-09-17T06:57:25.069546] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:57:25.100922] [DEBUG] [LOCAL ] TTI: Loaded 33942 existing records from primary storage. [2025-09-17T06:57:25.101083] [INFO ] [MAIN ] TTI: Loaded 33942 existing records. [2025-09-17T06:57:25.283940] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:57:25.284170] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-17T06:57:25.284226] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-17T06:57:25.284934] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-17T06:57:25.284996] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-17T06:57:25.492633] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-09-17T06:57:25.641516] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:57:25.650975] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T06:57:25.654625] [INFO ] [REMOTE ] TTAM: Full fetch complete (31797 records). [2025-09-17T06:57:25.654840] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-17T06:57:25.779396] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T06:57:25.873911] [WARN ] [VALIDATOR ] TTAM: Validation failed - insufficient historical data. Have 152 unique days, need 200 days [2025-09-17T06:57:25.874336] [FATAL] [MAIN ] TTAM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:57:25.874390] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:57:25.874437] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-17T06:57:25.874529] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-17T06:57:25.874574] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-17T06:57:25.875003] [DEBUG] [LOCAL ] TTAM: Deleted derivative data file. [2025-09-17T06:57:25.875105] [INFO ] [MAIN ] Update Progress: 2142/2369 symbols completed. TTAM took 27.0s. Estimated remaining: 33m 12s. Rate: 6.8 symbols/min [2025-09-17T06:57:26.041823] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:57:26.082742] [DEBUG] [LOCAL ] TU: Loaded 36881 existing records from primary storage. [2025-09-17T06:57:26.082923] [INFO ] [MAIN ] TU: Loaded 36881 existing records. [2025-09-17T06:57:26.256990] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:57:26.257218] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-17T06:57:26.257272] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-17T06:57:26.258141] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-17T06:57:26.258205] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-17T06:57:26.300118] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-17T06:57:26.616325] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:57:27.090189] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-11. [2025-09-17T06:57:27.326237] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T06:57:27.890189] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-09-17T06:57:27.958729] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T06:57:28.690181] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-11. [2025-09-17T06:57:28.881489] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T06:57:29.490133] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-09-17T06:57:29.750080] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T06:57:30.300786] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-17T06:57:30.303707] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T06:57:31.090187] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-17T06:57:31.172903] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T06:57:31.758577] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T06:57:31.890146] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-17T06:57:32.528924] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T06:57:32.690183] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-09-17T06:57:33.302576] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T06:57:33.490190] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-09-17T06:57:34.147302] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T06:57:34.290181] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-17T06:57:35.090155] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-09-17T06:57:35.143470] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T06:57:35.890137] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-17T06:57:36.032237] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T06:57:36.690197] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-17T06:57:36.733773] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T06:57:37.317498] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T06:57:37.323317] [INFO ] [REMOTE ] TTC: Full fetch complete (62075 records). [2025-09-17T06:57:37.323542] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-17T06:57:37.493430] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-17T06:57:37.730702] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-17T06:57:37.730852] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-17T06:57:37.732363] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-17T06:57:37.732428] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-17T06:57:37.734875] [DEBUG] [LOCAL ] TTC: Trimmed 62075 records to 43142 (keeping 200 days of data) [2025-09-17T06:57:38.022453] [DEBUG] [LOCAL ] TTC: Primary data saved (43142 records). [2025-09-17T06:57:38.022695] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-17T06:57:38.022819] [INFO ] [MAIN ] Update Progress: 2143/2369 symbols completed. TTC took 31.6s. Estimated remaining: 33m 4s. Rate: 6.8 symbols/min [2025-09-17T06:57:38.210078] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:57:38.249658] [DEBUG] [LOCAL ] TUYA: Loaded 34277 existing records from primary storage. [2025-09-17T06:57:38.249964] [INFO ] [MAIN ] TUYA: Loaded 34277 existing records. [2025-09-17T06:57:38.295373] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-17T06:57:38.438792] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:57:38.439153] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-17T06:57:38.439220] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-17T06:57:38.440077] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-17T06:57:38.440147] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-17T06:57:38.826476] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:57:39.024918] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T06:57:39.078785] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T06:57:39.090011] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-17T06:57:39.566698] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T06:57:39.890120] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-17T06:57:40.548619] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T06:57:40.690145] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-11. [2025-09-17T06:57:41.195288] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T06:57:41.490136] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-17T06:57:42.140479] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T06:57:42.290132] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-09-17T06:57:43.090137] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-17T06:57:43.248783] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T06:57:43.803805] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T06:57:43.890130] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-17T06:57:44.305338] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T06:57:44.690146] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-09-17T06:57:45.490215] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-17T06:57:45.674803] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T06:57:45.749167] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T06:57:46.290152] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-17T06:57:47.090136] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-17T06:57:47.284828] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T06:57:47.758441] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T06:57:47.890207] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-17T06:57:48.667369] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T06:57:48.690091] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-17T06:57:49.490240] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-17T06:57:49.677937] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T06:57:50.290219] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-17T06:57:50.466025] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T06:57:50.472549] [INFO ] [REMOTE ] TTE: Full fetch complete (74971 records). [2025-09-17T06:57:50.472771] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-17T06:57:50.890360] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-17T06:57:50.890488] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-17T06:57:50.891610] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-17T06:57:50.891708] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-17T06:57:50.893258] [DEBUG] [LOCAL ] TTE: Trimmed 74971 records to 51677 (keeping 200 days of data) [2025-09-17T06:57:51.111163] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-17T06:57:51.222990] [DEBUG] [LOCAL ] TTE: Primary data saved (51677 records). [2025-09-17T06:57:51.223248] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-17T06:57:51.223368] [INFO ] [MAIN ] Update Progress: 2144/2369 symbols completed. TTE took 32.4s. Estimated remaining: 32m 56s. Rate: 6.8 symbols/min [2025-09-17T06:57:51.410289] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:57:51.451219] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T06:57:51.496462] [DEBUG] [LOCAL ] TV: Loaded 31597 existing records from primary storage. [2025-09-17T06:57:51.496635] [INFO ] [MAIN ] TV: Loaded 31597 existing records. [2025-09-17T06:57:51.683690] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:57:51.683983] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-17T06:57:51.684044] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-17T06:57:51.684740] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-17T06:57:51.684828] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-17T06:57:51.914356] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-17T06:57:52.069935] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:57:52.390087] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T06:57:52.600751] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T06:57:52.690144] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-11. [2025-09-17T06:57:53.490174] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-17T06:57:53.611176] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T06:57:54.205178] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T06:57:54.290159] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-09-17T06:57:55.016981] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T06:57:55.090116] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-17T06:57:55.888926] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T06:57:55.897683] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-17T06:57:56.690158] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-17T06:57:56.797393] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T06:57:57.490089] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-17T06:57:57.579573] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T06:57:58.120146] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T06:57:58.290133] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-09-17T06:57:59.090136] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-17T06:57:59.231364] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T06:57:59.871346] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T06:57:59.890102] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-17T06:58:00.562671] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T06:58:00.690157] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-17T06:58:01.469420] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T06:58:01.490146] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-17T06:58:02.272901] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T06:58:02.279854] [INFO ] [REMOTE ] TU: Full fetch complete (72850 records). [2025-09-17T06:58:02.280112] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-17T06:58:02.295762] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-17T06:58:02.684367] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-17T06:58:02.684508] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-17T06:58:02.685800] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-17T06:58:02.685870] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-17T06:58:02.687506] [DEBUG] [LOCAL ] TU: Trimmed 72850 records to 49987 (keeping 200 days of data) [2025-09-17T06:58:03.002885] [DEBUG] [LOCAL ] TU: Primary data saved (49987 records). [2025-09-17T06:58:03.003070] [INFO ] [MAIN ] TU: Full history saved. [2025-09-17T06:58:03.003172] [INFO ] [MAIN ] Update Progress: 2145/2369 symbols completed. TU took 37.1s. Estimated remaining: 32m 47s. Rate: 6.8 symbols/min [2025-09-17T06:58:03.094444] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-17T06:58:03.181679] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:58:03.213231] [DEBUG] [LOCAL ] TVC: Loaded 2406 existing records from primary storage. [2025-09-17T06:58:03.214062] [INFO ] [MAIN ] TVC: Loaded 2406 existing records. [2025-09-17T06:58:03.215867] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T06:58:03.412918] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:58:03.413281] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-17T06:58:03.413354] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-17T06:58:03.413740] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-17T06:58:03.413804] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-17T06:58:03.785129] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:58:03.814746] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T06:58:03.890149] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-11. [2025-09-17T06:58:04.430988] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T06:58:04.661874] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T06:58:04.690146] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-17T06:58:05.490142] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-17T06:58:06.217031] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T06:58:06.222438] [INFO ] [REMOTE ] TTI: Full fetch complete (64475 records). [2025-09-17T06:58:06.222620] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-17T06:58:06.298749] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-17T06:58:06.626536] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-17T06:58:06.626686] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-17T06:58:06.627914] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-17T06:58:06.628010] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-17T06:58:06.630496] [DEBUG] [LOCAL ] TTI: Trimmed 64475 records to 45236 (keeping 200 days of data) [2025-09-17T06:58:06.900603] [DEBUG] [LOCAL ] TTI: Primary data saved (45236 records). [2025-09-17T06:58:06.900847] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-17T06:58:06.900956] [INFO ] [MAIN ] Update Progress: 2146/2369 symbols completed. TTI took 42.0s. Estimated remaining: 32m 38s. Rate: 6.8 symbols/min [2025-09-17T06:58:07.079721] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:58:07.083497] [DEBUG] [LOCAL ] TVE: Loaded 1871 existing records from primary storage. [2025-09-17T06:58:07.083610] [INFO ] [MAIN ] TVE: Loaded 1871 existing records. [2025-09-17T06:58:07.114662] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-09-17T06:58:07.298955] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:58:07.299340] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-17T06:58:07.299431] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-17T06:58:07.299930] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-17T06:58:07.300211] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-17T06:58:07.432611] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T06:58:07.731815] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:58:07.895429] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-11. [2025-09-17T06:58:07.920145] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T06:58:07.959346] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T06:58:08.477918] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T06:58:08.690162] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-09-17T06:58:09.259458] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T06:58:09.490187] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-17T06:58:10.290128] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-17T06:58:11.000175] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T06:58:11.005780] [INFO ] [REMOTE ] TUYA: Full fetch complete (65729 records). [2025-09-17T06:58:11.005932] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-17T06:58:11.097040] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-09-17T06:58:11.414932] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-17T06:58:11.415052] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-17T06:58:11.416238] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-17T06:58:11.416301] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-17T06:58:11.417798] [DEBUG] [LOCAL ] TUYA: Trimmed 65729 records to 46709 (keeping 200 days of data) [2025-09-17T06:58:11.681953] [DEBUG] [LOCAL ] TUYA: Primary data saved (46709 records). [2025-09-17T06:58:11.682114] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-17T06:58:11.682214] [INFO ] [MAIN ] Update Progress: 2147/2369 symbols completed. TUYA took 33.7s. Estimated remaining: 32m 29s. Rate: 6.8 symbols/min [2025-09-17T06:58:11.795100] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T06:58:11.859919] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:58:11.889563] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T06:58:11.893301] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-09-17T06:58:11.917559] [DEBUG] [LOCAL ] TWI: Loaded 24637 existing records from primary storage. [2025-09-17T06:58:11.917718] [INFO ] [MAIN ] TWI: Loaded 24637 existing records. [2025-09-17T06:58:12.093678] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:58:12.093947] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-17T06:58:12.094012] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-17T06:58:12.094578] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-17T06:58:12.094666] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-17T06:58:12.446873] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:58:12.451272] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T06:58:12.690132] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-11. [2025-09-17T06:58:13.490123] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-17T06:58:14.001923] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T06:58:14.079776] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T06:58:14.290153] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-17T06:58:14.857940] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T06:58:15.090190] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-17T06:58:15.680564] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T06:58:15.890123] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-17T06:58:16.359807] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T06:58:16.690180] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-17T06:58:17.141062] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T06:58:17.490164] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-17T06:58:18.290181] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-17T06:58:18.972817] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T06:58:19.005885] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T06:58:19.090193] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-17T06:58:19.570113] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T06:58:19.890121] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-17T06:58:20.690182] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-17T06:58:21.261797] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T06:58:21.338952] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T06:58:21.490096] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-09-17T06:58:22.290142] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-17T06:58:22.684001] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-17T06:58:23.041753] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T06:58:23.090093] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-17T06:58:23.582440] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T06:58:23.890169] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-17T06:58:24.332049] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T06:58:24.690186] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-09-17T06:58:25.490136] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-17T06:58:25.991339] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-17T06:58:26.217207] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T06:58:26.290118] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-17T06:58:26.751772] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T06:58:27.090186] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-17T06:58:27.599089] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T06:58:27.600130] [INFO ] [REMOTE ] TVE: Full fetch complete (4480 records). [2025-09-17T06:58:27.600221] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-17T06:58:27.895277] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-17T06:58:28.012056] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-17T06:58:28.012175] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-17T06:58:28.012348] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-17T06:58:28.012399] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-17T06:58:28.012807] [DEBUG] [LOCAL ] TVE: Trimmed 4480 records to 2870 (keeping 200 days of data) [2025-09-17T06:58:28.032233] [DEBUG] [LOCAL ] TVE: Primary data saved (2870 records). [2025-09-17T06:58:28.032358] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-17T06:58:28.032450] [INFO ] [MAIN ] Update Progress: 2148/2369 symbols completed. TVE took 21.1s. Estimated remaining: 32m 21s. Rate: 6.8 symbols/min [2025-09-17T06:58:28.200309] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:58:28.239584] [DEBUG] [LOCAL ] TWLO: Loaded 39340 existing records from primary storage. [2025-09-17T06:58:28.239768] [INFO ] [MAIN ] TWLO: Loaded 39340 existing records. [2025-09-17T06:58:28.415152] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:58:28.415389] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-17T06:58:28.415442] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-17T06:58:28.416252] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-17T06:58:28.416315] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-17T06:58:28.690155] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-17T06:58:28.777133] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:58:29.224537] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T06:58:29.494117] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-11. [2025-09-17T06:58:29.498738] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T06:58:30.290133] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-17T06:58:31.090119] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-17T06:58:31.477516] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-17T06:58:31.759972] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T06:58:31.890135] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-17T06:58:32.445509] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T06:58:32.446688] [INFO ] [REMOTE ] TVC: Full fetch complete (5791 records). [2025-09-17T06:58:32.446796] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-17T06:58:32.697708] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-17T06:58:32.828054] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-17T06:58:32.828167] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-17T06:58:32.828438] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-17T06:58:32.837209] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-17T06:58:32.853096] [DEBUG] [LOCAL ] TVC: Trimmed 5791 records to 3570 (keeping 200 days of data) [2025-09-17T06:58:32.854086] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T06:58:32.886706] [DEBUG] [LOCAL ] TVC: Primary data saved (3570 records). [2025-09-17T06:58:32.886825] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-17T06:58:32.886962] [INFO ] [MAIN ] Update Progress: 2149/2369 symbols completed. TVC took 29.9s. Estimated remaining: 32m 11s. Rate: 6.8 symbols/min [2025-09-17T06:58:33.065888] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:58:33.071230] [DEBUG] [LOCAL ] TWN: Loaded 2061 existing records from primary storage. [2025-09-17T06:58:33.071359] [INFO ] [MAIN ] TWN: Loaded 2061 existing records. [2025-09-17T06:58:33.259764] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:58:33.260039] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-17T06:58:33.260101] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-17T06:58:33.260321] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-17T06:58:33.260395] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-17T06:58:33.495354] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-17T06:58:33.641805] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:58:34.267485] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T06:58:34.290109] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-17T06:58:35.090147] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-09-17T06:58:35.126356] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T06:58:35.767208] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T06:58:35.890140] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-17T06:58:36.690153] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-17T06:58:37.028722] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T06:58:37.098952] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T06:58:37.490196] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-09-17T06:58:38.058685] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T06:58:38.064137] [INFO ] [REMOTE ] TV: Full fetch complete (62771 records). [2025-09-17T06:58:38.064305] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-17T06:58:38.295244] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-17T06:58:38.462166] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-17T06:58:38.462280] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-17T06:58:38.463411] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-17T06:58:38.463509] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-17T06:58:38.465224] [DEBUG] [LOCAL ] TV: Trimmed 62771 records to 43171 (keeping 200 days of data) [2025-09-17T06:58:38.730035] [DEBUG] [LOCAL ] TV: Primary data saved (43171 records). [2025-09-17T06:58:38.730224] [INFO ] [MAIN ] TV: Full history saved. [2025-09-17T06:58:38.730344] [INFO ] [MAIN ] Update Progress: 2150/2369 symbols completed. TV took 47.5s. Estimated remaining: 32m 2s. Rate: 6.8 symbols/min [2025-09-17T06:58:38.897896] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:58:38.938051] [DEBUG] [LOCAL ] TWO: Loaded 35938 existing records from primary storage. [2025-09-17T06:58:38.938229] [INFO ] [MAIN ] TWO: Loaded 35938 existing records. [2025-09-17T06:58:39.095276] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-11. [2025-09-17T06:58:39.123554] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:58:39.123830] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-17T06:58:39.123909] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-17T06:58:39.124692] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-17T06:58:39.124763] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-17T06:58:39.498473] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:58:39.714829] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T06:58:39.780700] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T06:58:39.842592] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-17T06:58:39.890090] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-17T06:58:40.690152] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-09-17T06:58:41.311062] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T06:58:41.490182] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-17T06:58:41.867964] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T06:58:41.872560] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T06:58:42.290136] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-17T06:58:42.802973] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T06:58:43.090140] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-17T06:58:43.890102] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-17T06:58:44.364742] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T06:58:44.569104] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T06:58:44.690146] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-17T06:58:45.490179] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-11. [2025-09-17T06:58:46.290141] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-17T06:58:46.544215] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T06:58:46.888732] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T06:58:47.090140] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-09-17T06:58:47.571087] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T06:58:47.575367] [INFO ] [REMOTE ] TWI: Full fetch complete (53521 records). [2025-09-17T06:58:47.575574] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-17T06:58:47.906669] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-17T06:58:47.958445] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-17T06:58:47.958555] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-17T06:58:47.959576] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-17T06:58:47.959635] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-17T06:58:47.962272] [DEBUG] [LOCAL ] TWI: Trimmed 53521 records to 35061 (keeping 200 days of data) [2025-09-17T06:58:48.169611] [DEBUG] [LOCAL ] TWI: Primary data saved (35061 records). [2025-09-17T06:58:48.169793] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-17T06:58:48.169912] [INFO ] [MAIN ] Update Progress: 2151/2369 symbols completed. TWI took 36.5s. Estimated remaining: 31m 54s. Rate: 6.8 symbols/min [2025-09-17T06:58:48.343905] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:58:48.344223] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-17T06:58:48.344275] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-17T06:58:48.344392] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-17T06:58:48.344453] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-17T06:58:48.344504] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-17T06:58:48.344545] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-17T06:58:48.459716] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T06:58:48.710051] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-17T06:58:48.715201] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:58:48.745526] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T06:58:49.355539] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T06:58:49.490174] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-17T06:58:49.952135] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T06:58:50.290182] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-17T06:58:51.090159] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-11. [2025-09-17T06:58:51.282383] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:58:51.282757] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-11 [2025-09-17T06:58:51.890191] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-17T06:58:52.321481] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:58:52.321923] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-17T06:58:52.367222] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T06:58:52.690142] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-09-17T06:58:52.883752] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:58:52.884107] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-09-17T06:58:53.490182] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-17T06:58:54.154675] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T06:58:54.290129] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-17T06:58:55.090136] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-17T06:58:55.286315] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:58:55.286715] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-17T06:58:55.890181] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-17T06:58:56.089292] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T06:58:56.327668] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T06:58:56.690184] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-17T06:58:57.490179] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-17T06:58:57.678397] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:58:57.678801] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-17T06:58:58.290137] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-09-17T06:58:58.478247] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T06:58:59.090142] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-17T06:58:59.288536] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T06:58:59.288963] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-17T06:58:59.890192] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-17T06:58:59.938687] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T06:58:59.989781] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-17T06:58:59.990138] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-05 [2025-09-17T06:59:00.690142] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-17T06:59:01.257717] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T06:59:01.490157] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-17T06:59:02.290133] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-17T06:59:02.907918] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T06:59:02.908999] [INFO ] [REMOTE ] TWN: Full fetch complete (5375 records). [2025-09-17T06:59:02.909128] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-17T06:59:03.095185] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-17T06:59:03.276243] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-17T06:59:03.276413] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-17T06:59:03.276672] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-17T06:59:03.276763] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-17T06:59:03.277513] [DEBUG] [LOCAL ] TWN: Trimmed 5375 records to 3344 (keeping 200 days of data) [2025-09-17T06:59:03.300805] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T06:59:03.328910] [DEBUG] [LOCAL ] TWN: Primary data saved (3344 records). [2025-09-17T06:59:03.329039] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-17T06:59:03.329122] [INFO ] [MAIN ] Update Progress: 2152/2369 symbols completed. TWN took 30.4s. Estimated remaining: 31m 45s. Rate: 6.8 symbols/min [2025-09-17T06:59:03.505769] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:59:03.525505] [DEBUG] [LOCAL ] TX: Loaded 17035 existing records from primary storage. [2025-09-17T06:59:03.525683] [INFO ] [MAIN ] TX: Loaded 17035 existing records. [2025-09-17T06:59:03.711340] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:59:03.711668] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-17T06:59:03.711732] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-17T06:59:03.712204] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-17T06:59:03.712267] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-17T06:59:03.893487] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-17T06:59:04.101607] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:59:04.690174] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-17T06:59:05.126305] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T06:59:05.141732] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T06:59:05.194429] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T06:59:05.490141] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-17T06:59:06.290143] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-11. [2025-09-17T06:59:07.090240] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-17T06:59:07.486318] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T06:59:07.611348] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-17T06:59:07.890160] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-09-17T06:59:08.690097] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-17T06:59:08.903978] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T06:59:08.933348] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T06:59:09.432012] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T06:59:09.490112] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-17T06:59:10.195677] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T06:59:10.197219] [INFO ] [REMOTE ] TWOD: Full fetch complete (2546 records). [2025-09-17T06:59:10.197307] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-17T06:59:10.295301] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-17T06:59:10.388802] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 74 unique days, need 200 days [2025-09-17T06:59:10.389044] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T06:59:10.389145] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T06:59:10.389198] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-17T06:59:10.389267] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-17T06:59:10.389323] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-17T06:59:10.389391] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-17T06:59:10.389486] [INFO ] [MAIN ] Update Progress: 2153/2369 symbols completed. TWOD took 22.2s. Estimated remaining: 31m 37s. Rate: 6.8 symbols/min [2025-09-17T06:59:10.566507] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:59:10.604729] [DEBUG] [LOCAL ] TXNM: Loaded 32423 existing records from primary storage. [2025-09-17T06:59:10.604971] [INFO ] [MAIN ] TXNM: Loaded 32423 existing records. [2025-09-17T06:59:10.786384] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:59:10.786680] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-17T06:59:10.786740] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-17T06:59:10.787486] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-17T06:59:10.787549] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-17T06:59:11.095234] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-17T06:59:11.160935] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:59:11.890130] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-11. [2025-09-17T06:59:12.408537] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-17T06:59:12.415230] [INFO ] [REMOTE ] TWLO: Full fetch complete (76273 records). [2025-09-17T06:59:12.415411] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-17T06:59:12.700309] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-09-17T06:59:12.829401] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-17T06:59:12.829674] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-17T06:59:12.831588] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-17T06:59:12.831736] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-17T06:59:12.833623] [DEBUG] [LOCAL ] TWLO: Trimmed 76273 records to 52726 (keeping 200 days of data) [2025-09-17T06:59:12.966146] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T06:59:13.204211] [DEBUG] [LOCAL ] TWLO: Primary data saved (52726 records). [2025-09-17T06:59:13.204391] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-17T06:59:13.204493] [INFO ] [MAIN ] Update Progress: 2154/2369 symbols completed. TWLO took 45.2s. Estimated remaining: 31m 27s. Rate: 6.8 symbols/min [2025-09-17T06:59:13.374875] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:59:13.392142] [DEBUG] [LOCAL ] TXO: Loaded 15226 existing records from primary storage. [2025-09-17T06:59:13.392406] [INFO ] [MAIN ] TXO: Loaded 15226 existing records. [2025-09-17T06:59:13.491705] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-17T06:59:13.585900] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:59:13.586349] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-17T06:59:13.586424] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-17T06:59:13.587044] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-17T06:59:13.587116] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-17T06:59:13.716011] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T06:59:14.007578] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:59:14.022208] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T06:59:14.290116] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-09-17T06:59:15.090150] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-17T06:59:15.295584] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T06:59:15.375022] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T06:59:15.890118] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-11. [2025-09-17T06:59:16.013664] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T06:59:16.347579] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T06:59:16.690141] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-09-17T06:59:17.490175] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-17T06:59:17.585175] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T06:59:18.290136] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-09-17T06:59:19.090172] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-17T06:59:19.351354] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T06:59:19.884152] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T06:59:19.892952] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-17T06:59:20.340848] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T06:59:20.690149] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-09-17T06:59:21.490165] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-17T06:59:21.654834] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T06:59:21.693220] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T06:59:22.290139] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-17T06:59:23.000710] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T06:59:23.090089] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-17T06:59:23.262416] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T06:59:23.890120] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-17T06:59:24.278497] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T06:59:24.690148] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-17T06:59:25.490143] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-17T06:59:25.513102] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T06:59:25.519034] [INFO ] [REMOTE ] TWO: Full fetch complete (68432 records). [2025-09-17T06:59:25.519165] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-17T06:59:25.912394] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-17T06:59:25.912538] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-17T06:59:25.914083] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-17T06:59:25.914247] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-17T06:59:25.915897] [DEBUG] [LOCAL ] TWO: Trimmed 68432 records to 48191 (keeping 200 days of data) [2025-09-17T06:59:26.227338] [DEBUG] [LOCAL ] TWO: Primary data saved (48191 records). [2025-09-17T06:59:26.227505] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-17T06:59:26.227681] [INFO ] [MAIN ] Update Progress: 2155/2369 symbols completed. TWO took 47.5s. Estimated remaining: 31m 19s. Rate: 6.8 symbols/min [2025-09-17T06:59:26.302792] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-17T06:59:26.422053] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:59:26.450848] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T06:59:26.495933] [DEBUG] [LOCAL ] TXT: Loaded 36917 existing records from primary storage. [2025-09-17T06:59:26.496102] [INFO ] [MAIN ] TXT: Loaded 36917 existing records. [2025-09-17T06:59:26.680909] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:59:26.681235] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-17T06:59:26.681406] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-17T06:59:26.687419] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-17T06:59:26.693888] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-17T06:59:26.726988] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T06:59:27.080422] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:59:27.090088] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-11. [2025-09-17T06:59:27.186950] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T06:59:27.890119] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-17T06:59:28.430020] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T06:59:28.461756] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T06:59:28.690128] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-17T06:59:29.490158] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-17T06:59:29.770106] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T06:59:30.290176] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-09-17T06:59:31.025097] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T06:59:31.090178] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-17T06:59:31.890101] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-17T06:59:31.957664] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T06:59:32.021194] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T06:59:32.690123] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-17T06:59:33.485565] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T06:59:33.495073] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-17T06:59:33.794213] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T06:59:34.290182] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-17T06:59:34.577044] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T06:59:35.090155] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-17T06:59:35.679608] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T06:59:35.874293] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T06:59:35.890069] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-17T06:59:36.690111] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-17T06:59:36.939611] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T06:59:37.490170] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-17T06:59:37.741611] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T06:59:37.744502] [INFO ] [REMOTE ] TX: Full fetch complete (35847 records). [2025-09-17T06:59:37.744615] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-17T06:59:38.121568] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-17T06:59:38.121695] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-17T06:59:38.122435] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-17T06:59:38.122488] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-17T06:59:38.123350] [DEBUG] [LOCAL ] TX: Trimmed 35847 records to 23964 (keeping 200 days of data) [2025-09-17T06:59:38.274727] [DEBUG] [LOCAL ] TX: Primary data saved (23964 records). [2025-09-17T06:59:38.274910] [INFO ] [MAIN ] TX: Full history saved. [2025-09-17T06:59:38.275028] [INFO ] [MAIN ] Update Progress: 2156/2369 symbols completed. TX took 34.9s. Estimated remaining: 31m 10s. Rate: 6.8 symbols/min [2025-09-17T06:59:38.295790] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-17T06:59:38.449269] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T06:59:38.457478] [DEBUG] [LOCAL ] TY: Loaded 5517 existing records from primary storage. [2025-09-17T06:59:38.457715] [INFO ] [MAIN ] TY: Loaded 5517 existing records. [2025-09-17T06:59:38.681178] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T06:59:38.681499] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-17T06:59:38.681575] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-17T06:59:38.681903] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-17T06:59:38.681985] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-17T06:59:39.084333] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T06:59:39.090081] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-17T06:59:39.186174] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T06:59:39.890106] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-17T06:59:40.056230] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T06:59:40.079040] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T06:59:40.690135] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-17T06:59:41.028908] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T06:59:41.490112] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-17T06:59:41.666633] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T06:59:41.669210] [INFO ] [REMOTE ] TXO: Full fetch complete (25494 records). [2025-09-17T06:59:41.669309] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-17T06:59:42.046268] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-17T06:59:42.046376] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-17T06:59:42.046928] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-17T06:59:42.046982] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-17T06:59:42.047726] [DEBUG] [LOCAL ] TXO: Trimmed 25494 records to 18636 (keeping 200 days of data) [2025-09-17T06:59:42.162158] [DEBUG] [LOCAL ] TXO: Primary data saved (18636 records). [2025-09-17T06:59:42.162328] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-17T06:59:42.162427] [INFO ] [MAIN ] Update Progress: 2157/2369 symbols completed. TXO took 29.0s. Estimated remaining: 31m 1s. Rate: 6.8 symbols/min [2025-09-17T06:59:42.290164] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-17T06:59:43.075616] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T06:59:43.090075] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-17T06:59:43.675690] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T06:59:43.680512] [INFO ] [REMOTE ] TXNM: Full fetch complete (62770 records). [2025-09-17T06:59:43.680683] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-17T06:59:43.895274] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-11. [2025-09-17T06:59:44.097326] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-17T06:59:44.097480] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-17T06:59:44.098599] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-17T06:59:44.098686] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-17T06:59:44.100055] [DEBUG] [LOCAL ] TXNM: Trimmed 62770 records to 44157 (keeping 200 days of data) [2025-09-17T06:59:44.389155] [DEBUG] [LOCAL ] TXNM: Primary data saved (44157 records). [2025-09-17T06:59:44.389319] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-17T06:59:44.389431] [INFO ] [MAIN ] Update Progress: 2158/2369 symbols completed. TXNM took 34.0s. Estimated remaining: 30m 52s. Rate: 6.8 symbols/min [2025-09-17T06:59:44.606871] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T06:59:44.690159] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-17T06:59:44.729411] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T06:59:45.490185] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-09-17T06:59:46.384006] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T06:59:46.395383] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-17T06:59:46.405955] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T06:59:47.090147] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-17T06:59:47.841037] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T06:59:47.890166] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-17T06:59:47.905533] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T06:59:48.690192] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-17T06:59:49.428031] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T06:59:49.479622] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T06:59:49.490600] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-17T06:59:50.207088] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T06:59:50.290213] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-17T06:59:51.056681] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T06:59:51.090129] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-17T06:59:51.549814] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T06:59:51.890132] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-17T06:59:52.455144] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T06:59:52.690186] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-17T06:59:53.411728] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T06:59:53.490137] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-17T06:59:54.290190] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-17T06:59:54.323293] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T06:59:55.090178] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-17T06:59:55.848147] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T06:59:55.849628] [INFO ] [REMOTE ] TY: Full fetch complete (11708 records). [2025-09-17T06:59:55.849856] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-17T06:59:56.266463] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-17T06:59:56.266988] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-17T06:59:56.267741] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-17T06:59:56.267845] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-17T06:59:56.303120] [DEBUG] [LOCAL ] TY: Trimmed 11708 records to 7680 (keeping 200 days of data) [2025-09-17T06:59:56.306339] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T06:59:56.367697] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-17T06:59:56.373896] [DEBUG] [LOCAL ] TY: Primary data saved (7680 records). [2025-09-17T06:59:56.375267] [INFO ] [MAIN ] TY: Full history saved. [2025-09-17T06:59:56.375411] [INFO ] [MAIN ] Update Progress: 2159/2369 symbols completed. TY took 18.1s. Estimated remaining: 30m 43s. Rate: 6.8 symbols/min [2025-09-17T06:59:58.061847] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T06:59:58.072752] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-17T06:59:59.716696] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T06:59:59.725972] [INFO ] [REMOTE ] TXT: Full fetch complete (71953 records). [2025-09-17T06:59:59.726231] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-17T07:00:00.356861] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-17T07:00:00.358505] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-17T07:00:00.360963] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-17T07:00:00.361093] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-17T07:00:00.363304] [DEBUG] [LOCAL ] TXT: Trimmed 71953 records to 49827 (keeping 200 days of data) [2025-09-17T07:00:00.853922] [DEBUG] [LOCAL ] TXT: Primary data saved (49827 records). [2025-09-17T07:00:00.854363] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-17T07:00:00.854553] [INFO ] [MAIN ] Update Progress: 2160/2369 symbols completed. TXT took 34.6s. Estimated remaining: 30m 34s. Rate: 6.8 symbols/min [2025-09-17T07:00:01.452871] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:00:01.557623] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:00:01.595180] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:00:01.641486] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:00:01.661020] [DEBUG] [LOCAL ] TYG: Loaded 10386 existing records from primary storage. [2025-09-17T07:00:01.661771] [INFO ] [MAIN ] TYG: Loaded 10386 existing records. [2025-09-17T07:00:01.731794] [DEBUG] [LOCAL ] TYL: Loaded 16482 existing records from primary storage. [2025-09-17T07:00:01.790908] [INFO ] [MAIN ] TYL: Loaded 16482 existing records. [2025-09-17T07:00:02.007400] [DEBUG] [LOCAL ] U: Loaded 40149 existing records from primary storage. [2025-09-17T07:00:02.066261] [INFO ] [MAIN ] U: Loaded 40149 existing records. [2025-09-17T07:00:02.072220] [DEBUG] [LOCAL ] UA: Loaded 37234 existing records from primary storage. [2025-09-17T07:00:02.137504] [INFO ] [MAIN ] UA: Loaded 37234 existing records. [2025-09-17T07:00:02.132232] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:00:02.322369] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-17T07:00:02.472559] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:00:02.488312] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-17T07:00:02.539981] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-17T07:00:02.619938] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-17T07:00:02.601701] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-17T07:00:02.626580] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:00:02.657400] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-17T07:00:02.657914] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:00:02.658255] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-17T07:00:02.697552] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-17T07:00:02.681562] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-17T07:00:02.713688] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-17T07:00:02.720782] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-17T07:00:02.736501] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-17T07:00:02.748049] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-17T07:00:02.772420] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-17T07:00:02.790185] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-17T07:00:02.833695] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-17T07:00:03.936261] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:00:04.002023] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-11. [2025-09-17T07:00:04.176744] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:00:04.226731] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-11. [2025-09-17T07:00:04.277245] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:00:04.290865] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-11. [2025-09-17T07:00:04.378882] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:00:04.379301] [INFO ] [REMOTE ] U: Fetching primary data for 2024-11. [2025-09-17T07:00:05.086711] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T07:00:05.089428] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-09-17T07:00:05.680259] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T07:00:05.686499] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-09-17T07:00:05.743235] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T07:00:05.747127] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-09-17T07:00:06.372087] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T07:00:06.382479] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-09-17T07:00:06.718970] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-17T07:00:06.729545] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-09-17T07:00:06.807914] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T07:00:06.813030] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-09-17T07:00:06.886847] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T07:00:06.892337] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-17T07:00:07.917543] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T07:00:07.921825] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-17T07:00:08.005746] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T07:00:08.010567] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-17T07:00:08.106099] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T07:00:08.117475] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-09-17T07:00:08.521397] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T07:00:08.690161] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-17T07:00:09.097789] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-17T07:00:09.139571] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T07:00:09.494682] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-17T07:00:09.501071] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T07:00:09.699450] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T07:00:10.290148] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-17T07:00:10.772170] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T07:00:11.090138] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-17T07:00:11.209950] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T07:00:11.890137] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-17T07:00:12.456563] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T07:00:12.690138] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-17T07:00:13.388124] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T07:00:13.490117] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-09-17T07:00:13.883233] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T07:00:14.290135] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-17T07:00:15.090122] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-17T07:00:15.462777] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T07:00:15.489974] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T07:00:15.890123] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-17T07:00:16.690182] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-17T07:00:17.323973] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-17T07:00:17.490178] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-17T07:00:18.290139] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-17T07:00:18.547964] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-17T07:00:18.819478] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T07:00:19.090111] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-17T07:00:19.223917] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T07:00:19.522803] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T07:00:19.890174] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-17T07:00:20.690177] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-17T07:00:20.951383] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T07:00:21.490103] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-17T07:00:21.589163] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T07:00:21.660102] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T07:00:22.290208] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-17T07:00:23.090174] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-17T07:00:23.401539] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T07:00:23.731870] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-17T07:00:23.846031] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T07:00:23.890137] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-17T07:00:24.690140] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-17T07:00:25.490175] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-17T07:00:25.656121] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T07:00:25.659185] [INFO ] [REMOTE ] TYL: Full fetch complete (31241 records). [2025-09-17T07:00:25.659345] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-17T07:00:26.087031] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-17T07:00:26.087202] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-17T07:00:26.088010] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-17T07:00:26.088202] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-17T07:00:26.089563] [DEBUG] [LOCAL ] TYL: Trimmed 31241 records to 22399 (keeping 200 days of data) [2025-09-17T07:00:26.263378] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-17T07:00:26.292965] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-17T07:00:26.298830] [DEBUG] [LOCAL ] TYL: Primary data saved (22399 records). [2025-09-17T07:00:26.298984] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-17T07:00:26.299090] [INFO ] [MAIN ] Update Progress: 2161/2369 symbols completed. TYL took 25.4s. Estimated remaining: 30m 27s. Rate: 6.8 symbols/min [2025-09-17T07:00:26.470411] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:00:26.507911] [DEBUG] [LOCAL ] UAA: Loaded 39875 existing records from primary storage. [2025-09-17T07:00:26.508104] [INFO ] [MAIN ] UAA: Loaded 39875 existing records. [2025-09-17T07:00:26.694509] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:00:26.694839] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-17T07:00:26.694899] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-17T07:00:26.695743] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-17T07:00:26.695818] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-17T07:00:27.057857] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:00:27.087535] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T07:00:27.096594] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-17T07:00:27.356036] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T07:00:27.358123] [INFO ] [REMOTE ] TYG: Full fetch complete (22413 records). [2025-09-17T07:00:27.358252] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-17T07:00:27.729719] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-17T07:00:27.729845] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-17T07:00:27.730372] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-17T07:00:27.730424] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-17T07:00:27.731086] [DEBUG] [LOCAL ] TYG: Trimmed 22413 records to 14549 (keeping 200 days of data) [2025-09-17T07:00:27.825003] [DEBUG] [LOCAL ] TYG: Primary data saved (14549 records). [2025-09-17T07:00:27.825181] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-17T07:00:27.825293] [INFO ] [MAIN ] Update Progress: 2162/2369 symbols completed. TYG took 27.0s. Estimated remaining: 30m 17s. Rate: 6.8 symbols/min [2025-09-17T07:00:27.899402] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-17T07:00:27.999999] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:00:28.000223] [DEBUG] [LOCAL ] UAN: No existing data file found in primary storage. [2025-09-17T07:00:28.000269] [WARN ] [MAIN ] UAN: No existing data found, performing full refresh instead. [2025-09-17T07:00:28.000425] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-17T07:00:28.000496] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-17T07:00:28.000569] [DEBUG] [LOCAL ] UAN: No primary data file found to delete. [2025-09-17T07:00:28.000627] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-17T07:00:28.351480] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:00:28.690144] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-11. [2025-09-17T07:00:29.037668] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T07:00:29.321414] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T07:00:29.490144] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-17T07:00:30.290134] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-17T07:00:30.482025] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T07:00:31.090188] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-11. [2025-09-17T07:00:31.358865] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T07:00:31.813730] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T07:00:31.890138] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-17T07:00:32.690177] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-09-17T07:00:32.741544] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-17T07:00:33.496689] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-17T07:00:33.497727] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T07:00:33.719235] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T07:00:33.725602] [INFO ] [REMOTE ] UA: Full fetch complete (72675 records). [2025-09-17T07:00:33.725762] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-17T07:00:34.132776] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-17T07:00:34.132896] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-17T07:00:34.134004] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-17T07:00:34.134066] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-17T07:00:34.135541] [DEBUG] [LOCAL ] UA: Trimmed 72675 records to 50324 (keeping 200 days of data) [2025-09-17T07:00:34.308472] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-17T07:00:34.449291] [DEBUG] [LOCAL ] UA: Primary data saved (50324 records). [2025-09-17T07:00:34.449535] [INFO ] [MAIN ] UA: Full history saved. [2025-09-17T07:00:34.449687] [INFO ] [MAIN ] Update Progress: 2163/2369 symbols completed. UA took 33.6s. Estimated remaining: 30m 8s. Rate: 6.8 symbols/min [2025-09-17T07:00:34.626421] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:00:34.669976] [DEBUG] [LOCAL ] UBER: Loaded 40156 existing records from primary storage. [2025-09-17T07:00:34.670162] [INFO ] [MAIN ] UBER: Loaded 40156 existing records. [2025-09-17T07:00:34.870017] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:00:34.870267] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-17T07:00:34.870329] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-17T07:00:34.871208] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-17T07:00:34.871279] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-17T07:00:35.097208] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-09-17T07:00:35.224412] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T07:00:35.249237] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:00:35.619356] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-17T07:00:35.890144] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-11. [2025-09-17T07:00:36.690153] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-17T07:00:36.760208] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T07:00:37.490171] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-09-17T07:00:38.295747] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-17T07:00:38.310269] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-11 (2.42 seconds). [2025-09-17T07:00:38.614326] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T07:00:38.621530] [INFO ] [REMOTE ] U: Full fetch complete (77872 records). [2025-09-17T07:00:38.621757] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-17T07:00:38.945834] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T07:00:39.034912] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-17T07:00:39.035042] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-17T07:00:39.036171] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-17T07:00:39.036237] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-17T07:00:39.037854] [DEBUG] [LOCAL ] U: Trimmed 77872 records to 53799 (keeping 200 days of data) [2025-09-17T07:00:39.100679] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-09-17T07:00:39.384617] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T07:00:39.413079] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-09-17T07:00:39.413244] [INFO ] [MAIN ] U: Full history saved. [2025-09-17T07:00:39.413366] [INFO ] [MAIN ] Update Progress: 2164/2369 symbols completed. U took 38.6s. Estimated remaining: 29m 59s. Rate: 6.8 symbols/min [2025-09-17T07:00:39.591714] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:00:39.633938] [DEBUG] [LOCAL ] UBS: Loaded 38933 existing records from primary storage. [2025-09-17T07:00:39.634142] [INFO ] [MAIN ] UBS: Loaded 38933 existing records. [2025-09-17T07:00:39.821074] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:00:39.821363] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-17T07:00:39.821473] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-17T07:00:39.822283] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-17T07:00:39.822347] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-17T07:00:39.895289] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-17T07:00:40.196044] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:00:40.690155] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-11. [2025-09-17T07:00:41.490190] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-17T07:00:41.649924] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.55 seconds). [2025-09-17T07:00:41.732120] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T07:00:42.188345] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T07:00:42.292557] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-17T07:00:42.296343] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T07:00:43.090175] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-09-17T07:00:43.890222] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-17T07:00:44.104563] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T07:00:44.661156] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T07:00:44.690095] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-17T07:00:45.500302] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-17T07:00:45.507318] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-17T07:00:45.524974] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T07:00:46.290191] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-09-17T07:00:47.090154] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-17T07:00:47.446731] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T07:00:47.890121] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-17T07:00:47.995235] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T07:00:48.496472] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T07:00:48.690153] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-17T07:00:49.293910] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T07:00:49.495261] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-17T07:00:49.520453] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-17T07:00:50.142164] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T07:00:50.290128] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-17T07:00:51.090193] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-17T07:00:51.666478] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T07:00:51.668030] [INFO ] [REMOTE ] UAN: Full fetch complete (8641 records). [2025-09-17T07:00:51.668147] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-17T07:00:51.897546] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-17T07:00:52.039140] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-17T07:00:52.039247] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-17T07:00:52.039456] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-17T07:00:52.039530] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-17T07:00:52.040067] [DEBUG] [LOCAL ] UAN: Trimmed 8641 records to 5534 (keeping 200 days of data) [2025-09-17T07:00:52.074098] [DEBUG] [LOCAL ] UAN: Primary data saved (5534 records). [2025-09-17T07:00:52.074223] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-17T07:00:52.074308] [INFO ] [MAIN ] Update Progress: 2165/2369 symbols completed. UAN took 24.2s. Estimated remaining: 29m 51s. Rate: 6.8 symbols/min [2025-09-17T07:00:52.244420] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:00:52.277002] [DEBUG] [LOCAL ] UCB: Loaded 27510 existing records from primary storage. [2025-09-17T07:00:52.277169] [INFO ] [MAIN ] UCB: Loaded 27510 existing records. [2025-09-17T07:00:52.456183] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:00:52.456458] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-17T07:00:52.456521] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-17T07:00:52.457325] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-17T07:00:52.457396] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-17T07:00:52.701738] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-09-17T07:00:52.822531] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:00:52.855858] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-17T07:00:53.490164] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-17T07:00:53.851767] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T07:00:54.290102] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-17T07:00:54.567231] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T07:00:55.090174] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-17T07:00:55.854029] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T07:00:55.890165] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-17T07:00:55.955960] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.47 seconds). [2025-09-17T07:00:56.690245] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-17T07:00:56.844532] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T07:00:57.490147] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-17T07:00:57.935236] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T07:00:58.290156] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-11. [2025-09-17T07:00:59.090167] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-17T07:00:59.275539] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T07:00:59.333758] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-17T07:00:59.371903] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T07:00:59.890125] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-17T07:01:00.690132] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-17T07:01:00.928103] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T07:01:01.490137] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-17T07:01:02.290132] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-09-17T07:01:02.399939] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-17T07:01:02.570106] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T07:01:03.090181] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-17T07:01:03.361922] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T07:01:03.368524] [INFO ] [REMOTE ] UAA: Full fetch complete (77324 records). [2025-09-17T07:01:03.368719] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-17T07:01:03.468124] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T07:01:03.797076] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-17T07:01:03.797198] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-17T07:01:03.798312] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-17T07:01:03.798387] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-17T07:01:03.800041] [DEBUG] [LOCAL ] UAA: Trimmed 77324 records to 53514 (keeping 200 days of data) [2025-09-17T07:01:03.890697] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-09-17T07:01:04.113201] [DEBUG] [LOCAL ] UAA: Primary data saved (53514 records). [2025-09-17T07:01:04.113376] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-17T07:01:04.113483] [INFO ] [MAIN ] Update Progress: 2166/2369 symbols completed. UAA took 37.8s. Estimated remaining: 29m 42s. Rate: 6.8 symbols/min [2025-09-17T07:01:04.286363] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:01:04.327939] [DEBUG] [LOCAL ] UDR: Loaded 38694 existing records from primary storage. [2025-09-17T07:01:04.328107] [INFO ] [MAIN ] UDR: Loaded 38694 existing records. [2025-09-17T07:01:04.511245] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:01:04.511507] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-17T07:01:04.511586] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-17T07:01:04.512351] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-17T07:01:04.512430] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-17T07:01:04.716092] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-17T07:01:04.862058] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:01:05.340598] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T07:01:05.490140] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-17T07:01:05.700599] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-17T07:01:06.290212] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-17T07:01:06.599430] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T07:01:06.907916] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T07:01:07.090141] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-17T07:01:07.890148] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-11. [2025-09-17T07:01:08.695268] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-17T07:01:08.719490] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.43 seconds). [2025-09-17T07:01:08.794717] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T07:01:09.490145] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-17T07:01:09.587522] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T07:01:10.281413] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T07:01:10.290417] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-17T07:01:11.090135] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-17T07:01:11.368292] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T07:01:11.890141] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-17T07:01:12.325381] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T07:01:12.650292] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (2.36 seconds). [2025-09-17T07:01:12.657662] [INFO ] [REMOTE ] UBER: Full fetch complete (77952 records). [2025-09-17T07:01:12.657907] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-17T07:01:12.695261] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-17T07:01:13.063511] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-17T07:01:13.063665] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-17T07:01:13.065019] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-17T07:01:13.065170] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-17T07:01:13.067033] [DEBUG] [LOCAL ] UBER: Trimmed 77952 records to 53806 (keeping 200 days of data) [2025-09-17T07:01:13.419696] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-09-17T07:01:13.419945] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-17T07:01:13.420115] [INFO ] [MAIN ] Update Progress: 2167/2369 symbols completed. UBER took 39.0s. Estimated remaining: 29m 34s. Rate: 6.8 symbols/min [2025-09-17T07:01:13.495733] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-09-17T07:01:13.603932] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:01:13.640329] [DEBUG] [LOCAL ] UE: Loaded 31985 existing records from primary storage. [2025-09-17T07:01:13.640533] [INFO ] [MAIN ] UE: Loaded 31985 existing records. [2025-09-17T07:01:13.852238] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:01:13.852693] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-17T07:01:13.852853] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-17T07:01:13.853634] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-17T07:01:13.853740] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-17T07:01:13.984169] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T07:01:14.185930] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-17T07:01:14.301490] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-17T07:01:14.308565] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:01:15.090159] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-11. [2025-09-17T07:01:15.234412] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T07:01:15.890185] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-09-17T07:01:16.058737] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T07:01:16.065883] [INFO ] [REMOTE ] UBS: Full fetch complete (75401 records). [2025-09-17T07:01:16.066082] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-17T07:01:16.473562] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-17T07:01:16.473779] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-17T07:01:16.475045] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-17T07:01:16.475142] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-17T07:01:16.477967] [DEBUG] [LOCAL ] UBS: Trimmed 75401 records to 52518 (keeping 200 days of data) [2025-09-17T07:01:16.605580] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T07:01:16.702022] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-09-17T07:01:16.857842] [DEBUG] [LOCAL ] UBS: Primary data saved (52518 records). [2025-09-17T07:01:16.858032] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-17T07:01:16.858146] [INFO ] [MAIN ] Update Progress: 2168/2369 symbols completed. UBS took 37.4s. Estimated remaining: 29m 24s. Rate: 6.8 symbols/min [2025-09-17T07:01:17.042926] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:01:17.050609] [DEBUG] [LOCAL ] UFI: Loaded 5514 existing records from primary storage. [2025-09-17T07:01:17.050837] [INFO ] [MAIN ] UFI: Loaded 5514 existing records. [2025-09-17T07:01:17.241293] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:01:17.241582] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-17T07:01:17.241681] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-17T07:01:17.241931] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-17T07:01:17.241988] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-17T07:01:17.493316] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-17T07:01:17.609222] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:01:17.641923] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T07:01:17.824263] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T07:01:18.290204] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-17T07:01:18.674611] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T07:01:19.090239] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-11. [2025-09-17T07:01:19.851567] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T07:01:19.867249] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T07:01:19.890069] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-09-17T07:01:20.690140] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-17T07:01:20.710729] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T07:01:21.490195] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-09-17T07:01:22.207250] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T07:01:22.221367] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T07:01:22.290153] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-17T07:01:23.090124] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-17T07:01:23.650767] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T07:01:23.881448] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T07:01:23.890180] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-09-17T07:01:24.690160] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-17T07:01:25.351286] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T07:01:25.490119] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-17T07:01:26.290133] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-17T07:01:26.406779] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T07:01:26.441825] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T07:01:27.044398] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T07:01:27.090099] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-17T07:01:27.890132] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-17T07:01:27.961923] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T07:01:28.690185] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-17T07:01:29.490124] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-17T07:01:29.654881] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T07:01:29.990556] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T07:01:29.996350] [INFO ] [REMOTE ] UCB: Full fetch complete (54604 records). [2025-09-17T07:01:29.996539] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-17T07:01:30.295168] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-17T07:01:30.388475] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-17T07:01:30.388575] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-17T07:01:30.389506] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-17T07:01:30.389564] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-17T07:01:30.390734] [DEBUG] [LOCAL ] UCB: Trimmed 54604 records to 38163 (keeping 200 days of data) [2025-09-17T07:01:30.630652] [DEBUG] [LOCAL ] UCB: Primary data saved (38163 records). [2025-09-17T07:01:30.630824] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-17T07:01:30.630957] [INFO ] [MAIN ] Update Progress: 2169/2369 symbols completed. UCB took 38.6s. Estimated remaining: 29m 16s. Rate: 6.8 symbols/min [2025-09-17T07:01:30.801335] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:01:30.831976] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T07:01:30.869387] [DEBUG] [LOCAL ] UGI: Loaded 37549 existing records from primary storage. [2025-09-17T07:01:30.869552] [INFO ] [MAIN ] UGI: Loaded 37549 existing records. [2025-09-17T07:01:31.046793] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:01:31.047050] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-17T07:01:31.047115] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-17T07:01:31.047938] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-17T07:01:31.048009] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-17T07:01:31.095400] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-17T07:01:31.414203] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:01:31.890142] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-17T07:01:32.009015] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T07:01:32.094126] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T07:01:32.690176] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-11. [2025-09-17T07:01:33.438542] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T07:01:33.490143] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-17T07:01:34.290147] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-17T07:01:34.384962] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T07:01:35.090127] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-09-17T07:01:35.257435] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T07:01:35.295459] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T07:01:35.890154] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-17T07:01:36.690129] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-17T07:01:36.776821] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T07:01:37.490191] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-09-17T07:01:37.703277] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T07:01:37.741787] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T07:01:38.290147] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-17T07:01:38.902936] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T07:01:39.090154] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-17T07:01:39.883291] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T07:01:39.893233] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-17T07:01:40.352704] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T07:01:40.690136] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-17T07:01:40.851464] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T07:01:41.310573] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T07:01:41.490137] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-17T07:01:42.194904] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T07:01:42.290102] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-17T07:01:43.090142] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-17T07:01:43.890131] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-17T07:01:43.916732] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T07:01:43.923713] [INFO ] [REMOTE ] UDR: Full fetch complete (74104 records). [2025-09-17T07:01:43.923846] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-17T07:01:44.328374] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-17T07:01:44.328486] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-17T07:01:44.329579] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-17T07:01:44.329656] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-17T07:01:44.331194] [DEBUG] [LOCAL ] UDR: Trimmed 74104 records to 51800 (keeping 200 days of data) [2025-09-17T07:01:44.636634] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T07:01:44.640277] [INFO ] [REMOTE ] UFI: Full fetch complete (12315 records). [2025-09-17T07:01:44.641450] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-17T07:01:44.715183] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-17T07:01:44.762926] [DEBUG] [LOCAL ] UDR: Primary data saved (51800 records). [2025-09-17T07:01:44.763632] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-17T07:01:44.805137] [INFO ] [MAIN ] Update Progress: 2170/2369 symbols completed. UDR took 40.7s. Estimated remaining: 29m 8s. Rate: 6.8 symbols/min [2025-09-17T07:01:45.044331] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T07:01:45.223373] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:01:45.249124] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-17T07:01:45.249203] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-17T07:01:45.249564] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-17T07:01:45.249708] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-17T07:01:45.250272] [DEBUG] [LOCAL ] UFI: Trimmed 12315 records to 8273 (keeping 200 days of data) [2025-09-17T07:01:45.306397] [DEBUG] [LOCAL ] UFI: Primary data saved (8273 records). [2025-09-17T07:01:45.306591] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-17T07:01:45.306750] [INFO ] [MAIN ] Update Progress: 2171/2369 symbols completed. UFI took 28.4s. Estimated remaining: 28m 58s. Rate: 6.8 symbols/min [2025-09-17T07:01:45.419682] [DEBUG] [LOCAL ] UGP: Loaded 31714 existing records from primary storage. [2025-09-17T07:01:45.440606] [INFO ] [MAIN ] UGP: Loaded 31714 existing records. [2025-09-17T07:01:45.495202] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-17T07:01:45.528935] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:01:45.684901] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:01:45.689606] [DEBUG] [LOCAL ] UHAL: Loaded 12408 existing records from primary storage. [2025-09-17T07:01:45.689825] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-17T07:01:45.689930] [INFO ] [MAIN ] UHAL: Loaded 12408 existing records. [2025-09-17T07:01:45.690101] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-17T07:01:45.770438] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-17T07:01:45.791446] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-17T07:01:45.994783] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:01:46.026615] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-17T07:01:46.029497] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-17T07:01:46.095359] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-17T07:01:46.122275] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-17T07:01:46.355371] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:01:46.396568] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-11. [2025-09-17T07:01:46.598719] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:01:46.627680] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T07:01:47.090176] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-17T07:01:47.310681] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T07:01:47.890168] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-11. [2025-09-17T07:01:48.037792] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T07:01:48.299371] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T07:01:48.304814] [INFO ] [REMOTE ] UE: Full fetch complete (61532 records). [2025-09-17T07:01:48.304975] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-17T07:01:48.701991] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-17T07:01:48.725811] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-17T07:01:48.727195] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-17T07:01:48.729429] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-17T07:01:48.745997] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-17T07:01:48.747932] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T07:01:48.756699] [DEBUG] [LOCAL ] UE: Trimmed 61532 records to 43085 (keeping 200 days of data) [2025-09-17T07:01:49.180624] [DEBUG] [LOCAL ] UE: Primary data saved (43085 records). [2025-09-17T07:01:49.180887] [INFO ] [MAIN ] UE: Full history saved. [2025-09-17T07:01:49.181023] [INFO ] [MAIN ] Update Progress: 2172/2369 symbols completed. UE took 35.8s. Estimated remaining: 28m 49s. Rate: 6.8 symbols/min [2025-09-17T07:01:49.420028] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:01:49.468208] [DEBUG] [LOCAL ] UHS: Loaded 30267 existing records from primary storage. [2025-09-17T07:01:49.468417] [INFO ] [MAIN ] UHS: Loaded 30267 existing records. [2025-09-17T07:01:49.490194] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-09-17T07:01:49.758942] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:01:49.759248] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-17T07:01:49.759327] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-17T07:01:49.760151] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-17T07:01:49.760238] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-17T07:01:50.218559] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:01:50.290141] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-09-17T07:01:50.598373] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T07:01:50.980784] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-17T07:01:51.090152] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-17T07:01:51.839283] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T07:01:51.890127] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-11. [2025-09-17T07:01:52.690143] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-09-17T07:01:52.813298] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T07:01:53.361250] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T07:01:53.490149] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-09-17T07:01:53.761290] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T07:01:54.290176] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-17T07:01:54.917726] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T07:01:55.090183] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-17T07:01:55.135276] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T07:01:55.890179] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-09-17T07:01:56.690184] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-17T07:01:56.793320] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T07:01:57.385061] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T07:01:57.490108] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-17T07:01:57.631167] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T07:01:58.290155] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-17T07:01:58.970138] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T07:01:59.090143] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-09-17T07:01:59.890194] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-17T07:02:00.021265] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T07:02:00.337811] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T07:02:00.690137] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-17T07:02:00.863883] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T07:02:01.490194] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-17T07:02:02.257518] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T07:02:02.290128] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-17T07:02:03.095207] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-17T07:02:03.110511] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T07:02:03.890113] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-17T07:02:03.995802] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T07:02:04.117546] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T07:02:04.690154] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-17T07:02:05.490163] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-17T07:02:05.660476] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T07:02:05.786599] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T07:02:06.290122] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-17T07:02:07.090107] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-17T07:02:07.352926] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T07:02:07.766825] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T07:02:07.773312] [INFO ] [REMOTE ] UGI: Full fetch complete (73315 records). [2025-09-17T07:02:07.773488] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-17T07:02:07.895221] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-17T07:02:08.185527] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-17T07:02:08.185720] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-17T07:02:08.187008] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-17T07:02:08.187174] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-17T07:02:08.199709] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T07:02:08.204120] [DEBUG] [LOCAL ] UGI: Trimmed 73315 records to 50537 (keeping 200 days of data) [2025-09-17T07:02:08.520537] [DEBUG] [LOCAL ] UGI: Primary data saved (50537 records). [2025-09-17T07:02:08.520720] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-17T07:02:08.520828] [INFO ] [MAIN ] Update Progress: 2173/2369 symbols completed. UGI took 37.9s. Estimated remaining: 28m 41s. Rate: 6.8 symbols/min [2025-09-17T07:02:08.693582] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:02:08.691668] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-17T07:02:08.707490] [DEBUG] [LOCAL ] UHT: Loaded 7210 existing records from primary storage. [2025-09-17T07:02:08.707751] [INFO ] [MAIN ] UHT: Loaded 7210 existing records. [2025-09-17T07:02:08.897422] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:02:08.897744] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-17T07:02:08.897817] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-17T07:02:08.898173] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-17T07:02:08.898242] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-17T07:02:09.265360] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:02:09.490125] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-11. [2025-09-17T07:02:09.552964] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T07:02:09.643665] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T07:02:10.290137] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-17T07:02:10.322238] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T07:02:11.090142] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-17T07:02:11.851777] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T07:02:11.890168] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-17T07:02:12.027993] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T07:02:12.031188] [INFO ] [REMOTE ] UHAL: Full fetch complete (22837 records). [2025-09-17T07:02:12.031289] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-17T07:02:12.435841] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-17T07:02:12.435982] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-17T07:02:12.436561] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-17T07:02:12.436633] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-17T07:02:12.437406] [DEBUG] [LOCAL ] UHAL: Trimmed 22837 records to 16291 (keeping 200 days of data) [2025-09-17T07:02:12.539827] [DEBUG] [LOCAL ] UHAL: Primary data saved (16291 records). [2025-09-17T07:02:12.540008] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-17T07:02:12.540120] [INFO ] [MAIN ] Update Progress: 2174/2369 symbols completed. UHAL took 27.2s. Estimated remaining: 28m 32s. Rate: 6.8 symbols/min [2025-09-17T07:02:12.698739] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-09-17T07:02:12.736159] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:02:12.751518] [DEBUG] [LOCAL ] UI: Loaded 9552 existing records from primary storage. [2025-09-17T07:02:12.751779] [INFO ] [MAIN ] UI: Loaded 9552 existing records. [2025-09-17T07:02:12.953297] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:02:12.953669] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-17T07:02:12.953738] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-17T07:02:12.954148] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-17T07:02:12.954215] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-17T07:02:13.359153] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:02:13.436201] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T07:02:13.490182] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-17T07:02:13.520747] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T07:02:14.290171] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-17T07:02:14.882609] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T07:02:15.090135] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-09-17T07:02:15.764781] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T07:02:15.890167] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-11. [2025-09-17T07:02:15.937810] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T07:02:16.690184] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-17T07:02:16.778755] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T07:02:17.460593] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T07:02:17.490162] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-17T07:02:18.290185] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-17T07:02:18.373792] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T07:02:19.090155] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-17T07:02:19.768505] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T07:02:19.890132] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-17T07:02:20.690156] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-17T07:02:20.706419] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T07:02:20.763588] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T07:02:21.490180] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-09-17T07:02:21.915955] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T07:02:22.290178] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-17T07:02:22.312018] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T07:02:23.090128] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-09-17T07:02:23.708266] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T07:02:23.715289] [INFO ] [REMOTE ] UGP: Full fetch complete (62119 records). [2025-09-17T07:02:23.715494] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-17T07:02:23.904101] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-17T07:02:24.119209] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T07:02:24.142234] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-17T07:02:24.143605] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-17T07:02:24.144993] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-17T07:02:24.145093] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-17T07:02:24.146739] [DEBUG] [LOCAL ] UGP: Trimmed 62119 records to 42658 (keeping 200 days of data) [2025-09-17T07:02:24.411466] [DEBUG] [LOCAL ] UGP: Primary data saved (42658 records). [2025-09-17T07:02:24.411662] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-17T07:02:24.411789] [INFO ] [MAIN ] Update Progress: 2175/2369 symbols completed. UGP took 39.6s. Estimated remaining: 28m 23s. Rate: 6.8 symbols/min [2025-09-17T07:02:24.584766] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:02:24.613092] [DEBUG] [LOCAL ] UIS: Loaded 27701 existing records from primary storage. [2025-09-17T07:02:24.613277] [INFO ] [MAIN ] UIS: Loaded 27701 existing records. [2025-09-17T07:02:24.695460] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-17T07:02:24.795039] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:02:24.795320] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-17T07:02:24.795395] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-17T07:02:24.795954] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-17T07:02:24.796029] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-17T07:02:25.173019] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:02:25.435311] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T07:02:25.490113] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-17T07:02:25.576697] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T07:02:26.290236] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-17T07:02:26.970710] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T07:02:26.975681] [INFO ] [REMOTE ] UHS: Full fetch complete (58385 records). [2025-09-17T07:02:26.975822] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-17T07:02:27.095264] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-11. [2025-09-17T07:02:27.366887] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-17T07:02:27.367129] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-17T07:02:27.368261] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-17T07:02:27.368393] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-17T07:02:27.376934] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T07:02:27.380796] [DEBUG] [LOCAL ] UHS: Trimmed 58385 records to 41601 (keeping 200 days of data) [2025-09-17T07:02:27.657580] [DEBUG] [LOCAL ] UHS: Primary data saved (41601 records). [2025-09-17T07:02:27.657951] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-17T07:02:27.658122] [INFO ] [MAIN ] Update Progress: 2176/2369 symbols completed. UHS took 38.5s. Estimated remaining: 28m 14s. Rate: 6.8 symbols/min [2025-09-17T07:02:27.826986] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:02:27.872491] [DEBUG] [LOCAL ] UL: Loaded 39494 existing records from primary storage. [2025-09-17T07:02:27.872689] [INFO ] [MAIN ] UL: Loaded 39494 existing records. [2025-09-17T07:02:27.895260] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-17T07:02:28.053521] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:02:28.053748] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-17T07:02:28.053800] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-17T07:02:28.054680] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-17T07:02:28.054785] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-17T07:02:28.410800] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:02:28.633338] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T07:02:28.690113] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-09-17T07:02:28.858461] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T07:02:29.490131] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-17T07:02:29.716322] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T07:02:30.273685] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T07:02:30.290098] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-09-17T07:02:31.090189] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-11. [2025-09-17T07:02:31.579373] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T07:02:31.890214] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-17T07:02:32.690184] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-17T07:02:32.837014] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T07:02:32.877241] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T07:02:33.473613] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T07:02:33.490081] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-17T07:02:34.290336] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-17T07:02:34.290732] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T07:02:35.090150] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-17T07:02:35.630044] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T07:02:35.890201] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-09-17T07:02:35.928453] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T07:02:36.690187] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-17T07:02:37.483632] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T07:02:37.490082] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-17T07:02:37.753871] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T07:02:38.290166] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-17T07:02:38.311094] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T07:02:38.313432] [INFO ] [REMOTE ] UHT: Full fetch complete (15152 records). [2025-09-17T07:02:38.313521] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-17T07:02:38.689663] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-17T07:02:38.689761] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-17T07:02:38.690114] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-17T07:02:38.690182] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-17T07:02:38.690736] [DEBUG] [LOCAL ] UHT: Trimmed 15152 records to 10008 (keeping 200 days of data) [2025-09-17T07:02:38.752759] [DEBUG] [LOCAL ] UHT: Primary data saved (10008 records). [2025-09-17T07:02:38.752919] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-17T07:02:38.753023] [INFO ] [MAIN ] Update Progress: 2177/2369 symbols completed. UHT took 30.2s. Estimated remaining: 28m 6s. Rate: 6.8 symbols/min [2025-09-17T07:02:38.927981] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:02:38.957025] [DEBUG] [LOCAL ] ULS: Loaded 29182 existing records from primary storage. [2025-09-17T07:02:38.957188] [INFO ] [MAIN ] ULS: Loaded 29182 existing records. [2025-09-17T07:02:39.100069] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-17T07:02:39.143505] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:02:39.143944] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-17T07:02:39.144045] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-17T07:02:39.149281] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-17T07:02:39.153065] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-17T07:02:39.197910] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T07:02:39.517296] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:02:39.890194] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-17T07:02:40.620737] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T07:02:40.690089] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-17T07:02:41.078381] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T07:02:41.490174] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-17T07:02:42.069683] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T07:02:42.290113] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-09-17T07:02:42.597345] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T07:02:42.599533] [INFO ] [REMOTE ] UI: Full fetch complete (17857 records). [2025-09-17T07:02:42.599622] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-17T07:02:42.965726] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-17T07:02:42.965861] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-17T07:02:42.966263] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-17T07:02:42.966317] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-17T07:02:42.967002] [DEBUG] [LOCAL ] UI: Trimmed 17857 records to 12584 (keeping 200 days of data) [2025-09-17T07:02:43.047252] [DEBUG] [LOCAL ] UI: Primary data saved (12584 records). [2025-09-17T07:02:43.047404] [INFO ] [MAIN ] UI: Full history saved. [2025-09-17T07:02:43.047491] [INFO ] [MAIN ] Update Progress: 2178/2369 symbols completed. UI took 30.5s. Estimated remaining: 27m 56s. Rate: 6.8 symbols/min [2025-09-17T07:02:43.095270] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-11. [2025-09-17T07:02:43.229078] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:02:43.267040] [DEBUG] [LOCAL ] UMC: Loaded 39172 existing records from primary storage. [2025-09-17T07:02:43.267228] [INFO ] [MAIN ] UMC: Loaded 39172 existing records. [2025-09-17T07:02:43.465690] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:02:43.465943] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-17T07:02:43.466000] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-17T07:02:43.466779] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-17T07:02:43.466841] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-17T07:02:43.829398] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:02:43.890099] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-11. [2025-09-17T07:02:44.152694] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T07:02:44.490474] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T07:02:44.690156] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-17T07:02:45.490165] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-17T07:02:45.576218] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T07:02:46.290158] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-09-17T07:02:46.471133] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T07:02:46.928244] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T07:02:47.090123] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-17T07:02:47.463635] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T07:02:47.890169] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-17T07:02:48.503327] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T07:02:48.690136] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-09-17T07:02:49.490188] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-09-17T07:02:50.190505] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-17T07:02:50.290142] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-17T07:02:50.599221] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T07:02:50.692103] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T07:02:51.090151] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-17T07:02:51.859494] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T07:02:51.890136] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-09-17T07:02:52.271115] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T07:02:52.690169] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-17T07:02:53.490161] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-17T07:02:53.799516] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T07:02:54.290164] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-17T07:02:54.539869] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T07:02:54.897402] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T07:02:55.090119] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-17T07:02:55.302038] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T07:02:55.890143] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-17T07:02:56.686267] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T07:02:56.696518] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-17T07:02:57.490142] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-17T07:02:57.669040] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T07:02:57.796851] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T07:02:58.290173] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-17T07:02:59.090137] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-17T07:02:59.445559] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-17T07:02:59.782270] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T07:02:59.890132] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-17T07:03:00.690196] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-17T07:03:01.041005] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T07:03:01.120922] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T07:03:01.490156] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-17T07:03:02.290138] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-17T07:03:03.090125] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-17T07:03:03.247635] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-17T07:03:03.890183] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-17T07:03:03.967142] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-17T07:03:03.971460] [INFO ] [REMOTE ] UIS: Full fetch complete (51845 records). [2025-09-17T07:03:03.971576] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-17T07:03:04.359773] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-17T07:03:04.359897] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-17T07:03:04.360851] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-17T07:03:04.360909] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-17T07:03:04.362133] [DEBUG] [LOCAL ] UIS: Trimmed 51845 records to 37298 (keeping 200 days of data) [2025-09-17T07:03:04.580020] [DEBUG] [LOCAL ] UIS: Primary data saved (37298 records). [2025-09-17T07:03:04.580307] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-17T07:03:04.580439] [INFO ] [MAIN ] Update Progress: 2179/2369 symbols completed. UIS took 40.2s. Estimated remaining: 27m 49s. Rate: 6.8 symbols/min [2025-09-17T07:03:04.760418] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:03:04.787661] [DEBUG] [LOCAL ] UMH: Loaded 24358 existing records from primary storage. [2025-09-17T07:03:04.787900] [INFO ] [MAIN ] UMH: Loaded 24358 existing records. [2025-09-17T07:03:04.978777] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:03:04.979117] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-17T07:03:04.979180] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-17T07:03:04.979826] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-17T07:03:04.979894] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-17T07:03:05.337162] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:03:05.337779] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-11. [2025-09-17T07:03:05.361343] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (3.07 seconds). [2025-09-17T07:03:05.490131] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-17T07:03:05.770679] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T07:03:05.859392] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-17T07:03:06.290108] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-17T07:03:06.679494] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T07:03:07.090171] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-09-17T07:03:07.197372] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T07:03:07.890178] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-17T07:03:07.950049] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T07:03:08.472288] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T07:03:08.690187] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-09-17T07:03:09.422193] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T07:03:09.428590] [INFO ] [REMOTE ] UL: Full fetch complete (76658 records). [2025-09-17T07:03:09.428762] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-17T07:03:09.495210] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-17T07:03:09.833959] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-17T07:03:09.834170] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-17T07:03:09.848471] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-17T07:03:09.850671] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-17T07:03:09.851536] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T07:03:09.858736] [DEBUG] [LOCAL ] UL: Trimmed 76658 records to 53076 (keeping 200 days of data) [2025-09-17T07:03:10.221680] [DEBUG] [LOCAL ] UL: Primary data saved (53076 records). [2025-09-17T07:03:10.221918] [INFO ] [MAIN ] UL: Full history saved. [2025-09-17T07:03:10.222086] [INFO ] [MAIN ] Update Progress: 2180/2369 symbols completed. UL took 42.6s. Estimated remaining: 27m 40s. Rate: 6.8 symbols/min [2025-09-17T07:03:10.295259] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-17T07:03:10.442045] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:03:10.456228] [DEBUG] [LOCAL ] UNF: Loaded 7936 existing records from primary storage. [2025-09-17T07:03:10.456454] [INFO ] [MAIN ] UNF: Loaded 7936 existing records. [2025-09-17T07:03:10.760949] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:03:10.761295] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-17T07:03:10.761357] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-17T07:03:10.761739] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-17T07:03:10.761838] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-17T07:03:11.095486] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-17T07:03:11.238393] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T07:03:11.266627] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:03:11.273184] [INFO ] [REMOTE ] ULS: Full fetch complete (54333 records). [2025-09-17T07:03:11.273333] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-17T07:03:11.654651] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-17T07:03:11.654784] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-17T07:03:11.655744] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-17T07:03:11.655801] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-17T07:03:11.656947] [DEBUG] [LOCAL ] ULS: Trimmed 54333 records to 39229 (keeping 200 days of data) [2025-09-17T07:03:11.890237] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-11. [2025-09-17T07:03:11.903934] [DEBUG] [LOCAL ] ULS: Primary data saved (39229 records). [2025-09-17T07:03:11.904053] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-17T07:03:11.904146] [INFO ] [MAIN ] Update Progress: 2181/2369 symbols completed. ULS took 33.2s. Estimated remaining: 27m 30s. Rate: 6.8 symbols/min [2025-09-17T07:03:12.070676] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:03:12.101899] [DEBUG] [LOCAL ] UNFI: Loaded 31439 existing records from primary storage. [2025-09-17T07:03:12.102087] [INFO ] [MAIN ] UNFI: Loaded 31439 existing records. [2025-09-17T07:03:12.288256] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:03:12.288986] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-17T07:03:12.289105] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-17T07:03:12.294993] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-17T07:03:12.304413] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-17T07:03:12.346392] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T07:03:12.484326] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-17T07:03:12.705534] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-17T07:03:12.744856] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:03:12.780848] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T07:03:13.490145] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-09-17T07:03:14.108191] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T07:03:14.122455] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T07:03:14.290132] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-17T07:03:15.090148] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-11. [2025-09-17T07:03:15.650911] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T07:03:15.890131] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-17T07:03:16.063686] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T07:03:16.690223] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-09-17T07:03:17.290788] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T07:03:17.490142] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-17T07:03:18.290111] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-09-17T07:03:18.517460] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T07:03:19.090163] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-17T07:03:19.555004] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T07:03:19.664304] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T07:03:19.890145] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-17T07:03:20.690147] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-09-17T07:03:21.236892] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T07:03:21.336302] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-17T07:03:21.490129] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-17T07:03:21.998007] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T07:03:22.290165] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-17T07:03:23.090143] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-17T07:03:23.118309] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T07:03:23.341893] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T07:03:23.890170] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-17T07:03:24.068271] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T07:03:24.690226] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-17T07:03:24.768752] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T07:03:25.490141] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-17T07:03:26.130467] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T07:03:26.290118] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-17T07:03:26.585802] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T07:03:27.090152] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-17T07:03:27.568897] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T07:03:27.890187] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-17T07:03:28.109802] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T07:03:28.114435] [INFO ] [REMOTE ] UMH: Full fetch complete (46113 records). [2025-09-17T07:03:28.114545] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-17T07:03:28.508748] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-17T07:03:28.508898] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-17T07:03:28.509929] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-17T07:03:28.510015] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-17T07:03:28.511161] [DEBUG] [LOCAL ] UMH: Trimmed 46113 records to 32897 (keeping 200 days of data) [2025-09-17T07:03:28.692573] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-17T07:03:28.717270] [DEBUG] [LOCAL ] UMH: Primary data saved (32897 records). [2025-09-17T07:03:28.717408] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-17T07:03:28.717503] [INFO ] [MAIN ] Update Progress: 2182/2369 symbols completed. UMH took 24.1s. Estimated remaining: 27m 22s. Rate: 6.8 symbols/min [2025-09-17T07:03:28.885946] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:03:28.925692] [DEBUG] [LOCAL ] UNH: Loaded 40169 existing records from primary storage. [2025-09-17T07:03:28.925868] [INFO ] [MAIN ] UNH: Loaded 40169 existing records. [2025-09-17T07:03:29.101772] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:03:29.102074] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-17T07:03:29.102141] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-17T07:03:29.103042] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-17T07:03:29.103108] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-17T07:03:29.461588] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:03:29.484254] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T07:03:29.492330] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-17T07:03:29.500526] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T07:03:30.290152] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-17T07:03:31.090172] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-11. [2025-09-17T07:03:31.174602] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T07:03:31.181188] [INFO ] [REMOTE ] UMC: Full fetch complete (76467 records). [2025-09-17T07:03:31.181419] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-17T07:03:31.518959] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T07:03:31.605987] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-17T07:03:31.606105] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-17T07:03:31.607331] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-17T07:03:31.607407] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-17T07:03:31.608982] [DEBUG] [LOCAL ] UMC: Trimmed 76467 records to 52736 (keeping 200 days of data) [2025-09-17T07:03:31.902825] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-17T07:03:31.926816] [DEBUG] [LOCAL ] UMC: Primary data saved (52736 records). [2025-09-17T07:03:31.926991] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-17T07:03:31.927097] [INFO ] [MAIN ] Update Progress: 2183/2369 symbols completed. UMC took 48.9s. Estimated remaining: 27m 13s. Rate: 6.8 symbols/min [2025-09-17T07:03:32.101738] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:03:32.136289] [DEBUG] [LOCAL ] UNM: Loaded 35962 existing records from primary storage. [2025-09-17T07:03:32.136471] [INFO ] [MAIN ] UNM: Loaded 35962 existing records. [2025-09-17T07:03:32.319504] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:03:32.319777] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-17T07:03:32.319837] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-17T07:03:32.320626] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-17T07:03:32.320721] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-17T07:03:32.679483] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:03:32.690079] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-11. [2025-09-17T07:03:32.868895] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T07:03:33.000075] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T07:03:33.490214] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-17T07:03:33.916183] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T07:03:34.290185] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-17T07:03:34.953271] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T07:03:34.957185] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T07:03:35.090176] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-09-17T07:03:35.890136] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-09-17T07:03:36.699278] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-17T07:03:36.705172] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T07:03:37.490168] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-09-17T07:03:37.542353] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T07:03:37.544355] [INFO ] [REMOTE ] UNF: Full fetch complete (16923 records). [2025-09-17T07:03:37.544484] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-17T07:03:37.943346] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-17T07:03:37.943478] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-17T07:03:37.943949] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-17T07:03:37.944011] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-17T07:03:37.944637] [DEBUG] [LOCAL ] UNF: Trimmed 16923 records to 11770 (keeping 200 days of data) [2025-09-17T07:03:38.024841] [DEBUG] [LOCAL ] UNF: Primary data saved (11770 records). [2025-09-17T07:03:38.025011] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-17T07:03:38.025103] [INFO ] [MAIN ] Update Progress: 2184/2369 symbols completed. UNF took 27.8s. Estimated remaining: 27m 4s. Rate: 6.8 symbols/min [2025-09-17T07:03:38.207433] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:03:38.212175] [DEBUG] [LOCAL ] UNMA: Loaded 2628 existing records from primary storage. [2025-09-17T07:03:38.212298] [INFO ] [MAIN ] UNMA: Loaded 2628 existing records. [2025-09-17T07:03:38.300159] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-17T07:03:38.408484] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:03:38.409259] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-17T07:03:38.409395] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-17T07:03:38.409769] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-17T07:03:38.409836] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-17T07:03:38.784916] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-17T07:03:38.838080] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:03:39.088382] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T07:03:39.097297] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-11. [2025-09-17T07:03:39.697097] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T07:03:39.890147] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-09-17T07:03:40.068169] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T07:03:40.491314] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T07:03:40.690165] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-17T07:03:41.490218] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-09-17T07:03:42.077965] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T07:03:42.290191] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-17T07:03:42.331879] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T07:03:42.839734] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T07:03:43.090204] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-17T07:03:43.688125] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T07:03:43.890160] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-17T07:03:44.690181] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-17T07:03:45.241887] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T07:03:45.490151] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-17T07:03:45.835306] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T07:03:46.048490] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T07:03:46.290153] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-17T07:03:47.090157] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-17T07:03:47.797323] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T07:03:47.890146] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-17T07:03:48.690177] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-09-17T07:03:48.834438] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T07:03:48.920006] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T07:03:49.490222] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-17T07:03:50.290242] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-17T07:03:50.890232] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-17T07:03:50.932563] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T07:03:50.938026] [INFO ] [REMOTE ] UNFI: Full fetch complete (58489 records). [2025-09-17T07:03:50.938220] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-17T07:03:51.095326] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-17T07:03:51.398191] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-17T07:03:51.398398] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-17T07:03:51.400303] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-17T07:03:51.400430] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-17T07:03:51.402862] [DEBUG] [LOCAL ] UNFI: Trimmed 58489 records to 41886 (keeping 200 days of data) [2025-09-17T07:03:51.648696] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T07:03:51.739336] [DEBUG] [LOCAL ] UNFI: Primary data saved (41886 records). [2025-09-17T07:03:51.739539] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-17T07:03:51.739695] [INFO ] [MAIN ] Update Progress: 2185/2369 symbols completed. UNFI took 39.8s. Estimated remaining: 26m 56s. Rate: 6.8 symbols/min [2025-09-17T07:03:51.860295] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T07:03:51.899113] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-17T07:03:51.934916] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:03:51.935158] [DEBUG] [LOCAL ] UNP: No existing data file found in primary storage. [2025-09-17T07:03:51.935221] [WARN ] [MAIN ] UNP: No existing data found, performing full refresh instead. [2025-09-17T07:03:51.935355] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-17T07:03:51.935415] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-17T07:03:51.935467] [DEBUG] [LOCAL ] UNP: No primary data file found to delete. [2025-09-17T07:03:51.935506] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-17T07:03:52.313263] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:03:52.546497] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T07:03:52.690153] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-17T07:03:53.490167] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-11. [2025-09-17T07:03:54.274080] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T07:03:54.290087] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-17T07:03:55.090222] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-17T07:03:55.291839] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T07:03:55.890218] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-09-17T07:03:56.024902] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T07:03:56.690147] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-17T07:03:56.786391] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T07:03:57.244082] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T07:03:57.490187] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-17T07:03:57.588062] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T07:03:57.959245] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T07:03:57.960414] [INFO ] [REMOTE ] UNMA: Full fetch complete (5847 records). [2025-09-17T07:03:57.960514] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-17T07:03:58.293200] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-17T07:03:58.322499] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-17T07:03:58.322616] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-17T07:03:58.322875] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-17T07:03:58.322930] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-17T07:03:58.323359] [DEBUG] [LOCAL ] UNMA: Trimmed 5847 records to 3766 (keeping 200 days of data) [2025-09-17T07:03:58.348887] [DEBUG] [LOCAL ] UNMA: Primary data saved (3766 records). [2025-09-17T07:03:58.348988] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-17T07:03:58.349095] [INFO ] [MAIN ] Update Progress: 2186/2369 symbols completed. UNMA took 20.3s. Estimated remaining: 26m 47s. Rate: 6.8 symbols/min [2025-09-17T07:03:58.517635] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:03:58.555824] [DEBUG] [LOCAL ] UP: Loaded 32050 existing records from primary storage. [2025-09-17T07:03:58.555991] [INFO ] [MAIN ] UP: Loaded 32050 existing records. [2025-09-17T07:03:58.736405] [WARN ] [MAIN ] UP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:03:58.736685] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-17T07:03:58.736764] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-17T07:03:58.737439] [DEBUG] [LOCAL ] UP: Deleted primary data file. [2025-09-17T07:03:58.737518] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-17T07:03:59.092799] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:03:59.092984] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-17T07:03:59.890135] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-11. [2025-09-17T07:04:00.450344] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-17T07:04:00.690150] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-17T07:04:00.831700] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T07:04:01.373795] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T07:04:01.490164] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-09-17T07:04:02.290148] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-17T07:04:02.981780] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T07:04:03.022450] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-17T07:04:03.090149] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-17T07:04:03.890283] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-09-17T07:04:03.967087] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T07:04:03.977928] [INFO ] [REMOTE ] UNM: Full fetch complete (69920 records). [2025-09-17T07:04:03.978235] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-17T07:04:04.486173] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-17T07:04:04.486328] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-17T07:04:04.488062] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-17T07:04:04.488182] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-17T07:04:04.490897] [DEBUG] [LOCAL ] UNM: Trimmed 69920 records to 48832 (keeping 200 days of data) [2025-09-17T07:04:04.714454] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-09-17T07:04:04.802545] [DEBUG] [LOCAL ] UNM: Primary data saved (48832 records). [2025-09-17T07:04:04.802718] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-17T07:04:04.802827] [INFO ] [MAIN ] Update Progress: 2187/2369 symbols completed. UNM took 32.9s. Estimated remaining: 26m 38s. Rate: 6.8 symbols/min [2025-09-17T07:04:04.973573] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:04:04.973807] [DEBUG] [LOCAL ] UPS: No existing data file found in primary storage. [2025-09-17T07:04:04.973861] [WARN ] [MAIN ] UPS: No existing data found, performing full refresh instead. [2025-09-17T07:04:04.973977] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-17T07:04:04.974032] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-17T07:04:04.974085] [DEBUG] [LOCAL ] UPS: No primary data file found to delete. [2025-09-17T07:04:04.974139] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-17T07:04:05.333759] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:04:05.455050] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T07:04:05.490119] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-17T07:04:05.593712] [DEBUG] [REMOTE ] UP: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T07:04:05.594068] [WARN ] [REMOTE ] UP: No data returned for month 2025-02 [2025-09-17T07:04:05.751480] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.66 seconds). [2025-09-17T07:04:06.290133] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-17T07:04:06.438971] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T07:04:07.090152] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-11. [2025-09-17T07:04:07.890126] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-17T07:04:08.690110] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-17T07:04:08.841671] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-17T07:04:08.885098] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T07:04:09.233062] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T07:04:09.490127] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-17T07:04:10.032059] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T07:04:10.290123] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-17T07:04:11.090141] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-17T07:04:11.386936] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T07:04:11.890154] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-17T07:04:12.630559] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T07:04:12.690159] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-17T07:04:12.749281] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-17T07:04:13.490157] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-17T07:04:13.866283] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T07:04:14.188885] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T07:04:14.290179] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-09-17T07:04:15.090174] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-17T07:04:15.890125] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-17T07:04:16.152522] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T07:04:16.207178] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-17T07:04:16.690175] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-17T07:04:17.012935] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T07:04:17.312620] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T07:04:17.490145] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-17T07:04:18.290157] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-09-17T07:04:19.097361] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-17T07:04:19.100434] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T07:04:19.413522] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (2.72 seconds). [2025-09-17T07:04:19.420590] [INFO ] [REMOTE ] UNH: Full fetch complete (77718 records). [2025-09-17T07:04:19.420853] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-17T07:04:19.829952] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-17T07:04:19.830108] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-17T07:04:19.831259] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-17T07:04:19.831333] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-17T07:04:19.833794] [DEBUG] [LOCAL ] UNH: Trimmed 77718 records to 53793 (keeping 200 days of data) [2025-09-17T07:04:19.899142] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-17T07:04:20.204262] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T07:04:20.232144] [DEBUG] [LOCAL ] UNH: Primary data saved (53793 records). [2025-09-17T07:04:20.232337] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-17T07:04:20.232469] [INFO ] [MAIN ] Update Progress: 2188/2369 symbols completed. UNH took 51.5s. Estimated remaining: 26m 29s. Rate: 6.8 symbols/min [2025-09-17T07:04:20.408540] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:04:20.438224] [DEBUG] [LOCAL ] URI: Loaded 25957 existing records from primary storage. [2025-09-17T07:04:20.438479] [INFO ] [MAIN ] URI: Loaded 25957 existing records. [2025-09-17T07:04:20.621029] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:04:20.621353] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-17T07:04:20.621421] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-17T07:04:20.622135] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-17T07:04:20.622195] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-17T07:04:20.691393] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-17T07:04:20.994533] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:04:21.026977] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T07:04:21.490158] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-11. [2025-09-17T07:04:21.558529] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T07:04:22.290189] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-17T07:04:22.809008] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-17T07:04:22.936295] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T07:04:23.090183] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-17T07:04:23.898566] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-17T07:04:23.902013] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T07:04:24.690109] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-09-17T07:04:25.125230] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T07:04:25.490114] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-17T07:04:25.556278] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T07:04:25.562930] [INFO ] [REMOTE ] UP: Full fetch complete (56463 records). [2025-09-17T07:04:25.563116] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-17T07:04:25.758432] [WARN ] [VALIDATOR ] UP: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T07:04:25.759203] [FATAL] [MAIN ] UP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:04:25.759366] [WARN ] [MAIN ] UP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:04:25.759454] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-17T07:04:25.759660] [DEBUG] [LOCAL ] UP: No primary data file found to delete. [2025-09-17T07:04:25.759826] [INFO ] [LOCAL ] UP: Starting deletion of derivative data. [2025-09-17T07:04:25.760292] [DEBUG] [LOCAL ] UP: Deleted derivative data file. [2025-09-17T07:04:25.760405] [INFO ] [MAIN ] Update Progress: 2189/2369 symbols completed. UP took 27.4s. Estimated remaining: 26m 20s. Rate: 6.8 symbols/min [2025-09-17T07:04:25.933146] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:04:25.954292] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T07:04:25.986663] [DEBUG] [LOCAL ] USA: Loaded 26152 existing records from primary storage. [2025-09-17T07:04:25.986822] [INFO ] [MAIN ] USA: Loaded 26152 existing records. [2025-09-17T07:04:26.163356] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:04:26.163635] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-17T07:04:26.163715] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-17T07:04:26.164348] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-17T07:04:26.164411] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-17T07:04:26.303194] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-17T07:04:26.516347] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:04:27.090178] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-09-17T07:04:27.735660] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-17T07:04:27.885687] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T07:04:27.896078] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-17T07:04:28.690128] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-17T07:04:28.738065] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T07:04:29.490153] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-11. [2025-09-17T07:04:29.994691] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T07:04:30.290151] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-17T07:04:30.493732] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T07:04:30.500135] [INFO ] [REMOTE ] UNP: Full fetch complete (76712 records). [2025-09-17T07:04:30.500290] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-17T07:04:30.891529] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-17T07:04:30.891731] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-17T07:04:30.892901] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-17T07:04:30.892989] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-17T07:04:30.912457] [DEBUG] [LOCAL ] UNP: Trimmed 76712 records to 53215 (keeping 200 days of data) [2025-09-17T07:04:30.914412] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T07:04:31.106916] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-17T07:04:31.258835] [DEBUG] [LOCAL ] UNP: Primary data saved (53215 records). [2025-09-17T07:04:31.258995] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-17T07:04:31.259094] [INFO ] [MAIN ] Update Progress: 2190/2369 symbols completed. UNP took 39.5s. Estimated remaining: 26m 11s. Rate: 6.8 symbols/min [2025-09-17T07:04:31.426265] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:04:31.441951] [DEBUG] [LOCAL ] USAC: Loaded 15856 existing records from primary storage. [2025-09-17T07:04:31.442094] [INFO ] [MAIN ] USAC: Loaded 15856 existing records. [2025-09-17T07:04:31.618246] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:04:31.618477] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-17T07:04:31.618538] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-17T07:04:31.618943] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-17T07:04:31.619006] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-17T07:04:31.894471] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-09-17T07:04:31.973694] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:04:32.199721] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T07:04:32.645211] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T07:04:32.690081] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-17T07:04:32.990008] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T07:04:33.490195] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-17T07:04:34.002282] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T07:04:34.290137] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-17T07:04:35.090097] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-11. [2025-09-17T07:04:35.576761] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T07:04:35.890095] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-17T07:04:36.028147] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T07:04:36.202178] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T07:04:36.690184] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-09-17T07:04:37.490190] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-17T07:04:38.049949] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T07:04:38.166158] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-17T07:04:38.290115] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-17T07:04:38.557753] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T07:04:39.090143] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-17T07:04:39.890140] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-17T07:04:40.481853] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T07:04:40.660889] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.37 seconds). [2025-09-17T07:04:40.667718] [INFO ] [REMOTE ] UPS: Full fetch complete (77650 records). [2025-09-17T07:04:40.667883] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-17T07:04:40.703003] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-17T07:04:41.084793] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-17T07:04:41.081026] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T07:04:41.084924] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-17T07:04:41.092165] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-17T07:04:41.092730] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-17T07:04:41.094932] [DEBUG] [LOCAL ] UPS: Trimmed 77650 records to 53710 (keeping 200 days of data) [2025-09-17T07:04:41.441895] [DEBUG] [LOCAL ] UPS: Primary data saved (53710 records). [2025-09-17T07:04:41.442059] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-17T07:04:41.442172] [INFO ] [MAIN ] Update Progress: 2191/2369 symbols completed. UPS took 36.6s. Estimated remaining: 26m 3s. Rate: 6.8 symbols/min [2025-09-17T07:04:41.496266] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-17T07:04:41.614154] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:04:41.614364] [DEBUG] [LOCAL ] USB: No existing data file found in primary storage. [2025-09-17T07:04:41.614427] [WARN ] [MAIN ] USB: No existing data found, performing full refresh instead. [2025-09-17T07:04:41.614578] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-17T07:04:41.614689] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-17T07:04:41.614791] [DEBUG] [LOCAL ] USB: No primary data file found to delete. [2025-09-17T07:04:41.614856] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-17T07:04:41.968985] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:04:42.298546] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-09-17T07:04:42.301611] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T07:04:42.976011] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T07:04:43.090207] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-17T07:04:43.428542] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T07:04:43.890194] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-09-17T07:04:44.345952] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T07:04:44.690161] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-11. [2025-09-17T07:04:44.745244] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T07:04:45.490197] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-17T07:04:46.290166] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-17T07:04:46.577955] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T07:04:46.641887] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T07:04:47.090149] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-09-17T07:04:47.608551] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T07:04:47.612929] [INFO ] [REMOTE ] URI: Full fetch complete (53529 records). [2025-09-17T07:04:47.613045] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-17T07:04:47.899859] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-17T07:04:48.010360] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-17T07:04:48.010483] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-17T07:04:48.011560] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-17T07:04:48.011624] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-17T07:04:48.012937] [DEBUG] [LOCAL ] URI: Trimmed 53529 records to 36877 (keeping 200 days of data) [2025-09-17T07:04:48.267594] [DEBUG] [LOCAL ] URI: Primary data saved (36877 records). [2025-09-17T07:04:48.267810] [INFO ] [MAIN ] URI: Full history saved. [2025-09-17T07:04:48.267916] [INFO ] [MAIN ] Update Progress: 2192/2369 symbols completed. URI took 28.0s. Estimated remaining: 25m 54s. Rate: 6.8 symbols/min [2025-09-17T07:04:48.436015] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:04:48.473376] [DEBUG] [LOCAL ] USFD: Loaded 38200 existing records from primary storage. [2025-09-17T07:04:48.473564] [INFO ] [MAIN ] USFD: Loaded 38200 existing records. [2025-09-17T07:04:48.653774] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:04:48.654031] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-17T07:04:48.654102] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-17T07:04:48.654931] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-17T07:04:48.655001] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-17T07:04:48.698255] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-17T07:04:49.023353] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:04:49.055386] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T07:04:49.492232] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-09-17T07:04:49.494875] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T07:04:49.995324] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T07:04:50.290142] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-11. [2025-09-17T07:04:51.090183] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-17T07:04:51.430091] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T07:04:51.890148] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-17T07:04:51.963098] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T07:04:52.254221] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T07:04:52.690150] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-17T07:04:53.479513] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T07:04:53.490068] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-17T07:04:53.874178] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T07:04:54.290148] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-17T07:04:55.090154] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-17T07:04:55.371414] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T07:04:55.606760] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T07:04:55.890125] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-09-17T07:04:56.257860] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T07:04:56.690160] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-17T07:04:57.226443] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T07:04:57.490202] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-17T07:04:58.254191] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T07:04:58.290089] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-17T07:04:58.860133] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T07:04:59.090123] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-17T07:04:59.890172] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-17T07:05:00.200032] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T07:05:00.488469] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T07:05:00.517425] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T07:05:00.690143] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-17T07:05:01.490136] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-09-17T07:05:02.112377] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T07:05:02.290140] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-17T07:05:03.090179] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-17T07:05:03.232416] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T07:05:03.769439] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T07:05:03.774466] [INFO ] [REMOTE ] USA: Full fetch complete (51217 records). [2025-09-17T07:05:03.774618] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-17T07:05:03.895240] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-17T07:05:04.160387] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-17T07:05:04.160493] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-17T07:05:04.161369] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-17T07:05:04.161425] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-17T07:05:04.162490] [DEBUG] [LOCAL ] USA: Trimmed 51217 records to 36134 (keeping 200 days of data) [2025-09-17T07:05:04.378180] [DEBUG] [LOCAL ] USA: Primary data saved (36134 records). [2025-09-17T07:05:04.378350] [INFO ] [MAIN ] USA: Full history saved. [2025-09-17T07:05:04.378447] [INFO ] [MAIN ] Update Progress: 2193/2369 symbols completed. USA took 38.6s. Estimated remaining: 25m 46s. Rate: 6.8 symbols/min [2025-09-17T07:05:04.552137] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:05:04.566113] [DEBUG] [LOCAL ] USNA: Loaded 12855 existing records from primary storage. [2025-09-17T07:05:04.566292] [INFO ] [MAIN ] USNA: Loaded 12855 existing records. [2025-09-17T07:05:04.695247] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-17T07:05:04.749468] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:05:04.750513] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-17T07:05:04.750592] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-17T07:05:04.751073] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-17T07:05:04.751161] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-17T07:05:05.112634] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:05:05.143851] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-17T07:05:05.490104] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-17T07:05:05.642100] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T07:05:05.841071] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T07:05:06.290143] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-17T07:05:07.090117] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-11. [2025-09-17T07:05:07.484945] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T07:05:07.653369] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T07:05:07.890132] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-17T07:05:07.942386] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T07:05:08.690186] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-17T07:05:09.490320] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-09-17T07:05:09.496090] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T07:05:10.290137] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-17T07:05:10.521432] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T07:05:10.559573] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T07:05:11.090129] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-09-17T07:05:11.890066] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-17T07:05:11.968731] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T07:05:12.144845] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T07:05:12.690129] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-17T07:05:12.999970] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T07:05:13.004097] [INFO ] [REMOTE ] USAC: Full fetch complete (35146 records). [2025-09-17T07:05:13.004282] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-17T07:05:13.407336] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-17T07:05:13.407506] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-17T07:05:13.408443] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-17T07:05:13.408519] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-17T07:05:13.409781] [DEBUG] [LOCAL ] USAC: Trimmed 35146 records to 22930 (keeping 200 days of data) [2025-09-17T07:05:13.505272] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-17T07:05:13.563481] [DEBUG] [LOCAL ] USAC: Primary data saved (22930 records). [2025-09-17T07:05:13.563674] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-17T07:05:13.563770] [INFO ] [MAIN ] Update Progress: 2194/2369 symbols completed. USAC took 42.3s. Estimated remaining: 25m 37s. Rate: 6.8 symbols/min [2025-09-17T07:05:13.738561] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:05:13.753724] [DEBUG] [LOCAL ] USPH: Loaded 12501 existing records from primary storage. [2025-09-17T07:05:13.753913] [INFO ] [MAIN ] USPH: Loaded 12501 existing records. [2025-09-17T07:05:13.947979] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:05:13.948227] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-17T07:05:13.948287] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-17T07:05:13.948676] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-17T07:05:13.948737] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-17T07:05:14.290626] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-17T07:05:14.375678] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:05:14.409249] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T07:05:14.878672] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T07:05:14.886381] [INFO ] [REMOTE ] USB: Full fetch complete (77606 records). [2025-09-17T07:05:14.886719] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-17T07:05:15.091290] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-11. [2025-09-17T07:05:15.328767] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-17T07:05:15.328906] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-17T07:05:15.330190] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-17T07:05:15.330260] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-17T07:05:15.332034] [DEBUG] [LOCAL ] USB: Trimmed 77606 records to 53688 (keeping 200 days of data) [2025-09-17T07:05:15.468935] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T07:05:15.688902] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-09-17T07:05:15.689070] [INFO ] [MAIN ] USB: Full history saved. [2025-09-17T07:05:15.689160] [INFO ] [MAIN ] Update Progress: 2195/2369 symbols completed. USB took 34.2s. Estimated remaining: 25m 27s. Rate: 6.8 symbols/min [2025-09-17T07:05:15.867235] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:05:15.887248] [DEBUG] [LOCAL ] UTF: Loaded 20137 existing records from primary storage. [2025-09-17T07:05:15.887414] [INFO ] [MAIN ] UTF: Loaded 20137 existing records. [2025-09-17T07:05:15.898665] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-17T07:05:16.084050] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:05:16.084540] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-17T07:05:16.084612] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-17T07:05:16.085381] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-17T07:05:16.085451] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-17T07:05:16.463340] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:05:16.464774] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T07:05:16.690160] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-11. [2025-09-17T07:05:17.490161] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-17T07:05:17.809581] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T07:05:17.864888] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T07:05:18.222790] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T07:05:18.290146] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-17T07:05:19.090147] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-17T07:05:19.451561] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T07:05:19.890132] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-17T07:05:20.690190] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-09-17T07:05:20.832285] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T07:05:20.888186] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T07:05:21.490191] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-17T07:05:21.726455] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T07:05:22.290183] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-09-17T07:05:23.090163] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-17T07:05:23.120533] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T07:05:23.126779] [INFO ] [REMOTE ] USFD: Full fetch complete (73768 records). [2025-09-17T07:05:23.126959] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-17T07:05:23.534524] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-17T07:05:23.534817] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-17T07:05:23.536164] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-17T07:05:23.536381] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-17T07:05:23.556337] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T07:05:23.556510] [DEBUG] [LOCAL ] USFD: Trimmed 73768 records to 51317 (keeping 200 days of data) [2025-09-17T07:05:23.876553] [DEBUG] [LOCAL ] USFD: Primary data saved (51317 records). [2025-09-17T07:05:23.876757] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-17T07:05:23.876877] [INFO ] [MAIN ] Update Progress: 2196/2369 symbols completed. USFD took 35.6s. Estimated remaining: 25m 19s. Rate: 6.8 symbols/min [2025-09-17T07:05:23.897592] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-09-17T07:05:24.047821] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:05:24.075364] [DEBUG] [LOCAL ] UTI: Loaded 30039 existing records from primary storage. [2025-09-17T07:05:24.075540] [INFO ] [MAIN ] UTI: Loaded 30039 existing records. [2025-09-17T07:05:24.260691] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:05:24.261099] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-17T07:05:24.261223] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-17T07:05:24.273003] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-17T07:05:24.273080] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-17T07:05:24.273768] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T07:05:24.630450] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:05:24.690082] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-11. [2025-09-17T07:05:24.858589] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T07:05:25.490184] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-17T07:05:25.917040] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T07:05:26.290114] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-09-17T07:05:26.471536] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T07:05:27.090195] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-17T07:05:27.704378] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T07:05:27.890122] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-09-17T07:05:28.094373] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T07:05:28.690177] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-17T07:05:29.269576] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T07:05:29.490181] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-17T07:05:29.671800] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T07:05:30.290132] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-09-17T07:05:30.985134] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T07:05:31.090083] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-17T07:05:31.115328] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T07:05:31.890114] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-17T07:05:32.168509] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T07:05:32.690198] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-17T07:05:33.059096] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T07:05:33.490223] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-17T07:05:34.144200] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T07:05:34.290161] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-17T07:05:34.352883] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T07:05:35.090142] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-17T07:05:35.757858] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T07:05:35.890131] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-17T07:05:36.039170] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T07:05:36.690147] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-17T07:05:37.496373] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-17T07:05:37.502122] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T07:05:37.614319] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T07:05:37.616701] [INFO ] [REMOTE ] USNA: Full fetch complete (26405 records). [2025-09-17T07:05:37.616813] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-17T07:05:37.988481] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-17T07:05:37.988586] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-17T07:05:37.989157] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-17T07:05:37.989215] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-17T07:05:37.990089] [DEBUG] [LOCAL ] USNA: Trimmed 26405 records to 18532 (keeping 200 days of data) [2025-09-17T07:05:38.101168] [DEBUG] [LOCAL ] USNA: Primary data saved (18532 records). [2025-09-17T07:05:38.101373] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-17T07:05:38.101508] [INFO ] [MAIN ] Update Progress: 2197/2369 symbols completed. USNA took 33.7s. Estimated remaining: 25m 10s. Rate: 6.8 symbols/min [2025-09-17T07:05:38.290137] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-17T07:05:38.576039] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T07:05:39.090219] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-17T07:05:39.806370] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T07:05:39.890171] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-17T07:05:40.325273] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T07:05:40.690102] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-17T07:05:41.372883] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T07:05:41.490076] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-17T07:05:41.976337] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T07:05:42.290230] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-17T07:05:42.972617] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T07:05:43.090132] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-17T07:05:43.701593] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T07:05:43.890141] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-17T07:05:44.443238] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T07:05:44.447874] [INFO ] [REMOTE ] UTI: Full fetch complete (57914 records). [2025-09-17T07:05:44.447989] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-17T07:05:44.704629] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-17T07:05:44.833956] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-17T07:05:44.834077] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-17T07:05:44.835128] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-17T07:05:44.835195] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-17T07:05:44.836492] [DEBUG] [LOCAL ] UTI: Trimmed 57914 records to 40724 (keeping 200 days of data) [2025-09-17T07:05:45.082796] [DEBUG] [LOCAL ] UTI: Primary data saved (40724 records). [2025-09-17T07:05:45.083142] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-17T07:05:45.083247] [INFO ] [MAIN ] Update Progress: 2198/2369 symbols completed. UTI took 21.2s. Estimated remaining: 25m 1s. Rate: 6.8 symbols/min [2025-09-17T07:05:45.131257] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T07:05:45.368148] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T07:05:45.490087] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-17T07:05:46.266052] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T07:05:46.268232] [INFO ] [REMOTE ] USPH: Full fetch complete (22310 records). [2025-09-17T07:05:46.268321] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-17T07:05:46.299727] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-17T07:05:46.644801] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-17T07:05:46.644912] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-17T07:05:46.645410] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-17T07:05:46.645466] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-17T07:05:46.646122] [DEBUG] [LOCAL ] USPH: Trimmed 22310 records to 16762 (keeping 200 days of data) [2025-09-17T07:05:46.756526] [DEBUG] [LOCAL ] USPH: Primary data saved (16762 records). [2025-09-17T07:05:46.756700] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-17T07:05:46.756794] [INFO ] [MAIN ] Update Progress: 2199/2369 symbols completed. USPH took 33.2s. Estimated remaining: 24m 52s. Rate: 6.8 symbols/min [2025-09-17T07:05:47.609211] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T07:05:47.615350] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-17T07:05:48.850978] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T07:05:48.857867] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-17T07:05:49.988087] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T07:05:49.993879] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-17T07:05:51.299753] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T07:05:51.307783] [INFO ] [REMOTE ] UTF: Full fetch complete (40135 records). [2025-09-17T07:05:51.308050] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-17T07:05:51.852457] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-17T07:05:51.852594] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-17T07:05:51.853613] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-17T07:05:51.853701] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-17T07:05:51.854888] [DEBUG] [LOCAL ] UTF: Trimmed 40135 records to 28029 (keeping 200 days of data) [2025-09-17T07:05:52.045768] [DEBUG] [LOCAL ] UTF: Primary data saved (28029 records). [2025-09-17T07:05:52.045945] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-17T07:05:52.046063] [INFO ] [MAIN ] Update Progress: 2200/2369 symbols completed. UTF took 36.4s. Estimated remaining: 24m 43s. Rate: 6.8 symbols/min [2025-09-17T07:05:52.669922] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:05:52.753832] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:05:52.833967] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:05:52.829972] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:05:52.844223] [DEBUG] [LOCAL ] UTL: Loaded 8545 existing records from primary storage. [2025-09-17T07:05:52.846175] [INFO ] [MAIN ] UTL: Loaded 8545 existing records. [2025-09-17T07:05:52.992583] [DEBUG] [LOCAL ] UVV: Loaded 17480 existing records from primary storage. [2025-09-17T07:05:52.986105] [DEBUG] [LOCAL ] UVE: Loaded 16896 existing records from primary storage. [2025-09-17T07:05:53.010051] [INFO ] [MAIN ] UVE: Loaded 16896 existing records. [2025-09-17T07:05:53.010168] [INFO ] [MAIN ] UVV: Loaded 17480 existing records. [2025-09-17T07:05:53.104730] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:05:53.250199] [DEBUG] [LOCAL ] UTZ: Loaded 33183 existing records from primary storage. [2025-09-17T07:05:53.242772] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-17T07:05:53.303519] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-17T07:05:53.325036] [INFO ] [MAIN ] UTZ: Loaded 33183 existing records. [2025-09-17T07:05:53.451002] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-17T07:05:53.639985] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:05:53.645498] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:05:53.569334] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-17T07:05:53.724191] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-17T07:05:53.775212] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-17T07:05:53.724289] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-17T07:05:53.801618] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-17T07:05:53.831758] [WARN ] [MAIN ] UTZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:05:53.832618] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-17T07:05:53.833334] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-17T07:05:53.834001] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-17T07:05:53.833136] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-17T07:05:53.844433] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-17T07:05:53.882084] [DEBUG] [LOCAL ] UTZ: Deleted primary data file. [2025-09-17T07:05:53.876771] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-17T07:05:53.931736] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-17T07:05:54.601911] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:05:54.710108] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-11. [2025-09-17T07:05:55.118803] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:05:55.174389] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-11. [2025-09-17T07:05:55.276586] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:05:55.285317] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:05:55.285679] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-11. [2025-09-17T07:05:55.286297] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-11. [2025-09-17T07:05:55.706305] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T07:05:55.708852] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-09-17T07:05:55.907152] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T07:05:55.912569] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-09-17T07:05:56.378777] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T07:05:56.382735] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-09-17T07:05:56.474380] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T07:05:56.477042] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-09-17T07:05:56.776881] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T07:05:56.785316] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-09-17T07:05:56.794772] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T07:05:56.798665] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-09-17T07:05:57.017062] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T07:05:57.336720] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T07:05:57.490095] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-09-17T07:05:57.865955] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T07:05:58.175034] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T07:05:58.240085] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T07:05:58.290152] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-17T07:05:59.090149] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-17T07:05:59.136383] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T07:05:59.890140] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-09-17T07:06:00.039419] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T07:06:00.690135] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-17T07:06:01.490143] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-17T07:06:01.576994] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T07:06:01.921467] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T07:06:02.290151] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-17T07:06:02.929480] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T07:06:03.090143] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-17T07:06:03.890183] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-17T07:06:04.386750] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T07:06:04.392706] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T07:06:04.404153] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T07:06:04.690139] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-17T07:06:05.490143] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-17T07:06:05.508123] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T07:06:06.290165] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-17T07:06:06.391796] [DEBUG] [REMOTE ] UTZ: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T07:06:06.392159] [WARN ] [REMOTE ] UTZ: No data returned for month 2025-02 [2025-09-17T07:06:06.605937] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T07:06:07.090123] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-17T07:06:07.890150] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-17T07:06:08.211347] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T07:06:08.691343] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-17T07:06:08.692370] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T07:06:09.490120] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-17T07:06:09.942289] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T07:06:10.290068] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-17T07:06:11.036101] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T07:06:11.097348] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-17T07:06:11.101526] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T07:06:11.890137] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-17T07:06:12.271386] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T07:06:12.690154] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-17T07:06:13.490103] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-17T07:06:13.557417] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T07:06:13.789261] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T07:06:14.290183] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-17T07:06:14.729709] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T07:06:14.795317] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T07:06:15.090156] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-17T07:06:15.890127] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-17T07:06:16.159940] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T07:06:16.162851] [INFO ] [REMOTE ] UVV: Full fetch complete (29377 records). [2025-09-17T07:06:16.162973] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-17T07:06:16.557571] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-17T07:06:16.557706] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-17T07:06:16.558444] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-17T07:06:16.558511] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-17T07:06:16.559468] [DEBUG] [LOCAL ] UVV: Trimmed 29377 records to 22132 (keeping 200 days of data) [2025-09-17T07:06:16.691352] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-17T07:06:16.706145] [DEBUG] [LOCAL ] UVV: Primary data saved (22132 records). [2025-09-17T07:06:16.706330] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-17T07:06:16.706462] [INFO ] [MAIN ] Update Progress: 2201/2369 symbols completed. UVV took 24.7s. Estimated remaining: 24m 35s. Rate: 6.8 symbols/min [2025-09-17T07:06:16.886800] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:06:16.923957] [DEBUG] [LOCAL ] UWMC: Loaded 39396 existing records from primary storage. [2025-09-17T07:06:16.924133] [INFO ] [MAIN ] UWMC: Loaded 39396 existing records. [2025-09-17T07:06:17.114022] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:06:17.114301] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-17T07:06:17.114365] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-17T07:06:17.118218] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-17T07:06:17.118335] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-17T07:06:17.473366] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:06:17.490086] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-11. [2025-09-17T07:06:17.505205] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T07:06:18.290128] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-17T07:06:18.814139] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T07:06:18.903921] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T07:06:19.090141] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-09-17T07:06:19.246356] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T07:06:19.890154] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-17T07:06:20.690196] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-17T07:06:20.874552] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T07:06:21.132848] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T07:06:21.327734] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T07:06:21.329998] [INFO ] [REMOTE ] UTL: Full fetch complete (14818 records). [2025-09-17T07:06:21.330087] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-17T07:06:21.503086] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-17T07:06:21.702253] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-17T07:06:21.702370] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-17T07:06:21.702791] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-17T07:06:21.702849] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-17T07:06:21.703381] [DEBUG] [LOCAL ] UTL: Trimmed 14818 records to 10762 (keeping 200 days of data) [2025-09-17T07:06:21.771777] [DEBUG] [LOCAL ] UTL: Primary data saved (10762 records). [2025-09-17T07:06:21.771943] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-17T07:06:21.772048] [INFO ] [MAIN ] Update Progress: 2202/2369 symbols completed. UTL took 29.7s. Estimated remaining: 24m 26s. Rate: 6.8 symbols/min [2025-09-17T07:06:21.946473] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:06:21.953047] [DEBUG] [LOCAL ] UZD: Loaded 4704 existing records from primary storage. [2025-09-17T07:06:21.953199] [INFO ] [MAIN ] UZD: Loaded 4704 existing records. [2025-09-17T07:06:22.133144] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:06:22.133408] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-17T07:06:22.133467] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-17T07:06:22.133754] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-17T07:06:22.133813] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-17T07:06:22.291901] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-09-17T07:06:22.507838] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:06:22.636077] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T07:06:23.090152] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-17T07:06:23.890137] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-11. [2025-09-17T07:06:24.110071] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T07:06:24.287297] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-17T07:06:24.657275] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T07:06:24.690074] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-17T07:06:25.490193] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-17T07:06:26.291311] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-17T07:06:26.293954] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T07:06:27.090738] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-17T07:06:27.096433] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T07:06:27.353674] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T07:06:27.356282] [INFO ] [REMOTE ] UVE: Full fetch complete (29305 records). [2025-09-17T07:06:27.356437] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-17T07:06:27.740386] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-17T07:06:27.740525] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-17T07:06:27.741428] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-17T07:06:27.741489] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-17T07:06:27.744033] [DEBUG] [LOCAL ] UVE: Trimmed 29305 records to 21898 (keeping 200 days of data) [2025-09-17T07:06:27.881860] [DEBUG] [LOCAL ] UVE: Primary data saved (21898 records). [2025-09-17T07:06:27.882011] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-17T07:06:27.882147] [INFO ] [MAIN ] Update Progress: 2203/2369 symbols completed. UVE took 35.8s. Estimated remaining: 24m 17s. Rate: 6.8 symbols/min [2025-09-17T07:06:27.895183] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-09-17T07:06:28.053485] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:06:28.061024] [DEBUG] [LOCAL ] UZE: Loaded 5629 existing records from primary storage. [2025-09-17T07:06:28.061155] [INFO ] [MAIN ] UZE: Loaded 5629 existing records. [2025-09-17T07:06:28.238774] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:06:28.239030] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-17T07:06:28.239088] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-17T07:06:28.239332] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-17T07:06:28.239395] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-17T07:06:28.604861] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:06:28.610576] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T07:06:28.635425] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T07:06:28.690081] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-11. [2025-09-17T07:06:29.465075] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T07:06:29.490108] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-09-17T07:06:30.198163] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T07:06:30.290130] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-09-17T07:06:30.983174] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T07:06:31.090118] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-09-17T07:06:31.806100] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T07:06:31.890150] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-17T07:06:32.690179] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-17T07:06:33.184837] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T07:06:33.189975] [INFO ] [REMOTE ] UTZ: Full fetch complete (57162 records). [2025-09-17T07:06:33.190139] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-17T07:06:33.383772] [WARN ] [VALIDATOR ] UTZ: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T07:06:33.384421] [FATAL] [MAIN ] UTZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:06:33.384476] [WARN ] [MAIN ] UTZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:06:33.384529] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-17T07:06:33.384600] [DEBUG] [LOCAL ] UTZ: No primary data file found to delete. [2025-09-17T07:06:33.384662] [INFO ] [LOCAL ] UTZ: Starting deletion of derivative data. [2025-09-17T07:06:33.384973] [DEBUG] [LOCAL ] UTZ: Deleted derivative data file. [2025-09-17T07:06:33.385084] [INFO ] [MAIN ] Update Progress: 2204/2369 symbols completed. UTZ took 41.3s. Estimated remaining: 24m 8s. Rate: 6.8 symbols/min [2025-09-17T07:06:33.495332] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-17T07:06:33.561593] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:06:33.568773] [DEBUG] [LOCAL ] UZF: Loaded 4680 existing records from primary storage. [2025-09-17T07:06:33.568936] [INFO ] [MAIN ] UZF: Loaded 4680 existing records. [2025-09-17T07:06:33.751072] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:06:33.751356] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-17T07:06:33.751417] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-17T07:06:33.751743] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-17T07:06:33.751805] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-17T07:06:34.114780] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:06:34.119905] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T07:06:34.290188] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-11. [2025-09-17T07:06:34.433042] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T07:06:34.988407] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-17T07:06:35.090139] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-09-17T07:06:35.775881] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T07:06:35.890139] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-17T07:06:36.637922] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T07:06:36.690122] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-17T07:06:37.348767] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T07:06:37.490145] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-09-17T07:06:38.077205] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T07:06:38.290137] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-17T07:06:38.838886] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T07:06:39.090150] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-17T07:06:39.777119] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T07:06:39.890139] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-17T07:06:40.573703] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T07:06:40.690132] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-17T07:06:41.374757] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T07:06:41.490092] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-17T07:06:42.151050] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T07:06:42.290143] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-17T07:06:43.012611] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T07:06:43.090100] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-17T07:06:43.794496] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T07:06:43.890154] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-17T07:06:44.497992] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T07:06:44.690189] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-17T07:06:45.260330] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T07:06:45.490194] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-17T07:06:46.290222] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-17T07:06:46.408043] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T07:06:46.986623] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T07:06:47.090254] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-17T07:06:47.890172] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-17T07:06:47.899366] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T07:06:47.901545] [INFO ] [REMOTE ] UZE: Full fetch complete (10281 records). [2025-09-17T07:06:47.901673] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-17T07:06:48.285042] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-17T07:06:48.285212] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-17T07:06:48.285884] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-17T07:06:48.285972] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-17T07:06:48.286589] [DEBUG] [LOCAL ] UZE: Trimmed 10281 records to 7506 (keeping 200 days of data) [2025-09-17T07:06:48.341459] [DEBUG] [LOCAL ] UZE: Primary data saved (7506 records). [2025-09-17T07:06:48.341729] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-17T07:06:48.341922] [INFO ] [MAIN ] Update Progress: 2205/2369 symbols completed. UZE took 20.5s. Estimated remaining: 24m 0s. Rate: 6.8 symbols/min [2025-09-17T07:06:48.530851] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:06:48.589792] [DEBUG] [LOCAL ] V: Loaded 40114 existing records from primary storage. [2025-09-17T07:06:48.590062] [INFO ] [MAIN ] V: Loaded 40114 existing records. [2025-09-17T07:06:48.696271] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-17T07:06:48.785945] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:06:48.786210] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-17T07:06:48.786294] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-17T07:06:48.787727] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-17T07:06:48.787826] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-17T07:06:49.171589] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:06:49.490183] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-17T07:06:49.540687] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T07:06:49.898071] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T07:06:50.160423] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T07:06:50.290168] [INFO ] [REMOTE ] V: Fetching primary data for 2024-11. [2025-09-17T07:06:51.090174] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-17T07:06:51.477343] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-17T07:06:51.890184] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-17T07:06:52.227747] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T07:06:52.463336] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T07:06:52.690186] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-17T07:06:53.228635] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-17T07:06:53.490156] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-17T07:06:54.290240] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-09-17T07:06:55.090196] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-17T07:06:55.269174] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T07:06:55.890222] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-17T07:06:55.957755] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T07:06:56.368466] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T07:06:56.690198] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-17T07:06:57.437739] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T07:06:57.490093] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-17T07:06:57.553492] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T07:06:58.290194] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-09-17T07:06:59.090226] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-17T07:06:59.302945] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T07:06:59.727541] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T07:06:59.729129] [INFO ] [REMOTE ] UZF: Full fetch complete (8849 records). [2025-09-17T07:06:59.729233] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-17T07:06:59.890281] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-17T07:07:00.113970] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-17T07:07:00.114150] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-17T07:07:00.114528] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-17T07:07:00.114706] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-17T07:07:00.115487] [DEBUG] [LOCAL ] UZF: Trimmed 8849 records to 6559 (keeping 200 days of data) [2025-09-17T07:07:00.197433] [DEBUG] [LOCAL ] UZF: Primary data saved (6559 records). [2025-09-17T07:07:00.197854] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-17T07:07:00.198077] [INFO ] [MAIN ] Update Progress: 2206/2369 symbols completed. UZF took 26.8s. Estimated remaining: 23m 51s. Rate: 6.8 symbols/min [2025-09-17T07:07:00.201958] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T07:07:00.388247] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:07:00.415017] [DEBUG] [LOCAL ] VAC: Loaded 25381 existing records from primary storage. [2025-09-17T07:07:00.415196] [INFO ] [MAIN ] VAC: Loaded 25381 existing records. [2025-09-17T07:07:00.594200] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:07:00.594446] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-17T07:07:00.594518] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-17T07:07:00.595166] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-17T07:07:00.595231] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-17T07:07:00.692284] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-17T07:07:00.699691] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T07:07:00.729637] [INFO ] [REMOTE ] UZD: Full fetch complete (9741 records). [2025-09-17T07:07:00.768892] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-17T07:07:01.211376] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:07:01.408835] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-17T07:07:01.408986] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-17T07:07:01.409304] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-17T07:07:01.409372] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-17T07:07:01.410019] [DEBUG] [LOCAL ] UZD: Trimmed 9741 records to 6403 (keeping 200 days of data) [2025-09-17T07:07:01.458882] [DEBUG] [LOCAL ] UZD: Primary data saved (6403 records). [2025-09-17T07:07:01.459173] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-17T07:07:01.459337] [INFO ] [MAIN ] Update Progress: 2207/2369 symbols completed. UZD took 39.7s. Estimated remaining: 23m 42s. Rate: 6.8 symbols/min [2025-09-17T07:07:01.495426] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-17T07:07:01.658370] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:07:01.707543] [DEBUG] [LOCAL ] VAL: Loaded 37419 existing records from primary storage. [2025-09-17T07:07:01.707821] [INFO ] [MAIN ] VAL: Loaded 37419 existing records. [2025-09-17T07:07:01.906606] [WARN ] [MAIN ] VAL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:07:01.907126] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-17T07:07:01.907201] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-17T07:07:01.908208] [DEBUG] [LOCAL ] VAL: Deleted primary data file. [2025-09-17T07:07:01.908281] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-17T07:07:02.291819] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-11. [2025-09-17T07:07:02.295700] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:07:02.609802] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T07:07:03.090128] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-17T07:07:03.692842] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-17T07:07:03.723000] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T07:07:03.890108] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-17T07:07:04.595845] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T07:07:04.605310] [INFO ] [REMOTE ] UWMC: Full fetch complete (75198 records). [2025-09-17T07:07:04.605567] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-17T07:07:04.695297] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-09-17T07:07:05.009307] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-17T07:07:05.009416] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-17T07:07:05.010541] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-17T07:07:05.010602] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-17T07:07:05.012034] [DEBUG] [LOCAL ] UWMC: Trimmed 75198 records to 52705 (keeping 200 days of data) [2025-09-17T07:07:05.323872] [DEBUG] [LOCAL ] UWMC: Primary data saved (52705 records). [2025-09-17T07:07:05.324036] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-17T07:07:05.324142] [INFO ] [MAIN ] Update Progress: 2208/2369 symbols completed. UWMC took 48.6s. Estimated remaining: 23m 33s. Rate: 6.8 symbols/min [2025-09-17T07:07:05.492360] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:07:05.491049] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-11. [2025-09-17T07:07:05.530764] [DEBUG] [LOCAL ] VALE: Loaded 40045 existing records from primary storage. [2025-09-17T07:07:05.530929] [INFO ] [MAIN ] VALE: Loaded 40045 existing records. [2025-09-17T07:07:05.709335] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:07:05.709575] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-17T07:07:05.709631] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-17T07:07:05.710492] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-17T07:07:05.710558] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-17T07:07:06.075479] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:07:06.090980] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T07:07:06.161739] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-17T07:07:06.290125] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-09-17T07:07:07.058310] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T07:07:07.090105] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-09-17T07:07:07.191990] [DEBUG] [REMOTE ] VAL: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-17T07:07:07.192381] [WARN ] [REMOTE ] VAL: No data returned for month 2024-12 [2025-09-17T07:07:07.539169] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T07:07:07.890140] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-17T07:07:08.690124] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-09-17T07:07:09.490129] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-11. [2025-09-17T07:07:10.300938] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-17T07:07:10.306310] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-17T07:07:10.345471] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T07:07:11.090150] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-17T07:07:11.224495] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T07:07:11.481763] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T07:07:11.890190] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-17T07:07:12.690153] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-09-17T07:07:12.771741] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T07:07:13.490144] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-17T07:07:14.140495] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-17T07:07:14.290131] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-17T07:07:14.825220] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-17T07:07:15.090174] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-09-17T07:07:15.212365] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T07:07:15.890184] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-17T07:07:16.157325] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T07:07:16.690198] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-17T07:07:17.003988] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T07:07:17.490204] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-17T07:07:17.690623] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T07:07:17.843184] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T07:07:18.290163] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-17T07:07:19.090177] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-17T07:07:19.674407] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T07:07:19.890130] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-17T07:07:20.036328] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T07:07:20.598969] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T07:07:20.690117] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-17T07:07:21.490153] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-17T07:07:21.834802] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T07:07:22.290178] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-17T07:07:22.676753] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T07:07:22.931870] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T07:07:23.090188] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-17T07:07:23.890180] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-17T07:07:24.133806] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T07:07:24.140240] [INFO ] [REMOTE ] V: Full fetch complete (77725 records). [2025-09-17T07:07:24.140376] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-17T07:07:24.532829] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-17T07:07:24.532940] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-17T07:07:24.534144] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-17T07:07:24.534229] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-17T07:07:24.535923] [DEBUG] [LOCAL ] V: Trimmed 77725 records to 53763 (keeping 200 days of data) [2025-09-17T07:07:24.728865] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-17T07:07:24.885921] [DEBUG] [LOCAL ] V: Primary data saved (53763 records). [2025-09-17T07:07:24.886103] [INFO ] [MAIN ] V: Full history saved. [2025-09-17T07:07:24.886196] [INFO ] [MAIN ] Update Progress: 2209/2369 symbols completed. V took 36.5s. Estimated remaining: 23m 25s. Rate: 6.8 symbols/min [2025-09-17T07:07:25.062906] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:07:25.068921] [DEBUG] [LOCAL ] VATE: Loaded 3713 existing records from primary storage. [2025-09-17T07:07:25.069072] [INFO ] [MAIN ] VATE: Loaded 3713 existing records. [2025-09-17T07:07:25.292284] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-17T07:07:25.290419] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:07:25.303235] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-17T07:07:25.303401] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-17T07:07:25.303763] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-17T07:07:25.303825] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-17T07:07:25.495195] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-17T07:07:25.712064] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:07:25.742186] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T07:07:26.224893] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T07:07:26.290119] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-17T07:07:27.090155] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-17T07:07:27.714427] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T07:07:27.777218] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-17T07:07:27.890134] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-17T07:07:28.690200] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-17T07:07:28.898840] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T07:07:29.181198] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T07:07:29.490138] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-17T07:07:30.290143] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-11. [2025-09-17T07:07:30.420825] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T07:07:31.019086] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T07:07:31.090105] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-17T07:07:31.152386] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T07:07:31.890138] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-17T07:07:32.690102] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-17T07:07:33.150802] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T07:07:33.477487] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T07:07:33.483358] [INFO ] [REMOTE ] VAL: Full fetch complete (65531 records). [2025-09-17T07:07:33.483488] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-17T07:07:33.497270] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-17T07:07:33.682414] [WARN ] [VALIDATOR ] VAL: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T07:07:33.683176] [FATAL] [MAIN ] VAL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:07:33.683240] [WARN ] [MAIN ] VAL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:07:33.683291] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-17T07:07:33.683378] [DEBUG] [LOCAL ] VAL: No primary data file found to delete. [2025-09-17T07:07:33.683432] [INFO ] [LOCAL ] VAL: Starting deletion of derivative data. [2025-09-17T07:07:33.683760] [DEBUG] [LOCAL ] VAL: Deleted derivative data file. [2025-09-17T07:07:33.683887] [INFO ] [MAIN ] Update Progress: 2210/2369 symbols completed. VAL took 32.2s. Estimated remaining: 23m 16s. Rate: 6.8 symbols/min [2025-09-17T07:07:33.856298] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:07:33.864797] [DEBUG] [LOCAL ] VBF: Loaded 5071 existing records from primary storage. [2025-09-17T07:07:33.864936] [INFO ] [MAIN ] VBF: Loaded 5071 existing records. [2025-09-17T07:07:34.044085] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:07:34.044636] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-17T07:07:34.056280] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-17T07:07:34.059583] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-17T07:07:34.059531] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T07:07:34.059783] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-17T07:07:34.107558] [INFO ] [REMOTE ] VAC: Full fetch complete (47404 records). [2025-09-17T07:07:34.144477] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-17T07:07:34.312277] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-09-17T07:07:34.702980] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:07:34.827505] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-17T07:07:34.827613] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-17T07:07:34.828597] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-17T07:07:34.828673] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-17T07:07:34.829819] [DEBUG] [LOCAL ] VAC: Trimmed 47404 records to 34869 (keeping 200 days of data) [2025-09-17T07:07:35.043293] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T07:07:35.054437] [DEBUG] [LOCAL ] VAC: Primary data saved (34869 records). [2025-09-17T07:07:35.054572] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-17T07:07:35.054675] [INFO ] [MAIN ] Update Progress: 2211/2369 symbols completed. VAC took 34.9s. Estimated remaining: 23m 7s. Rate: 6.8 symbols/min [2025-09-17T07:07:35.098324] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-11. [2025-09-17T07:07:35.229454] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:07:35.240929] [DEBUG] [LOCAL ] VCV: Loaded 10243 existing records from primary storage. [2025-09-17T07:07:35.241079] [INFO ] [MAIN ] VCV: Loaded 10243 existing records. [2025-09-17T07:07:35.424516] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:07:35.424819] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-17T07:07:35.424885] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-17T07:07:35.425310] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-17T07:07:35.425375] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-17T07:07:35.782789] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:07:35.817063] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-17T07:07:35.864131] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T07:07:35.890084] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-17T07:07:36.690131] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-11. [2025-09-17T07:07:37.490140] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-09-17T07:07:37.652950] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T07:07:37.713005] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T07:07:38.157492] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T07:07:38.290115] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-17T07:07:39.090119] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-09-17T07:07:39.146244] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T07:07:39.717394] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T07:07:39.890157] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-09-17T07:07:40.475904] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T07:07:40.690170] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-17T07:07:41.462028] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T07:07:41.490131] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-17T07:07:42.205507] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T07:07:42.290170] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-09-17T07:07:43.090169] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-17T07:07:43.295684] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T07:07:43.539141] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T07:07:43.890146] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-17T07:07:44.690186] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-17T07:07:44.714808] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T07:07:45.490142] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-09-17T07:07:46.290180] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-17T07:07:46.328588] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T07:07:46.631059] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T07:07:46.637490] [INFO ] [REMOTE ] VALE: Full fetch complete (77712 records). [2025-09-17T07:07:46.637664] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-17T07:07:47.035398] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-17T07:07:47.035556] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-17T07:07:47.036964] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-17T07:07:47.037088] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-17T07:07:47.044211] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T07:07:47.047605] [DEBUG] [LOCAL ] VALE: Trimmed 77712 records to 53695 (keeping 200 days of data) [2025-09-17T07:07:47.105693] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-17T07:07:47.392067] [DEBUG] [LOCAL ] VALE: Primary data saved (53695 records). [2025-09-17T07:07:47.392257] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-17T07:07:47.392352] [INFO ] [MAIN ] Update Progress: 2212/2369 symbols completed. VALE took 42.1s. Estimated remaining: 22m 58s. Rate: 6.8 symbols/min [2025-09-17T07:07:47.562280] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:07:47.597787] [DEBUG] [LOCAL ] VEEV: Loaded 35243 existing records from primary storage. [2025-09-17T07:07:47.597963] [INFO ] [MAIN ] VEEV: Loaded 35243 existing records. [2025-09-17T07:07:47.774932] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:07:47.780441] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-17T07:07:47.780237] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T07:07:47.780666] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-17T07:07:47.783818] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-17T07:07:47.783945] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-17T07:07:47.895304] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-17T07:07:48.147524] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:07:48.690192] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-17T07:07:48.721743] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T07:07:49.372385] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T07:07:49.490169] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-17T07:07:50.283039] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T07:07:50.290085] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-17T07:07:50.782716] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T07:07:51.090136] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-11. [2025-09-17T07:07:51.890139] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-17T07:07:52.690123] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-17T07:07:52.720336] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T07:07:52.943167] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T07:07:53.032560] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T07:07:53.490248] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-17T07:07:54.189990] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T07:07:54.290166] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-09-17T07:07:55.090134] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-17T07:07:55.720139] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T07:07:55.890148] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-17T07:07:55.991819] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T07:07:56.611142] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T07:07:56.612606] [INFO ] [REMOTE ] VATE: Full fetch complete (10415 records). [2025-09-17T07:07:56.612725] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-17T07:07:56.695244] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-17T07:07:56.992018] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-17T07:07:56.992122] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-17T07:07:56.992408] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-17T07:07:56.992462] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-17T07:07:56.992946] [DEBUG] [LOCAL ] VATE: Trimmed 10415 records to 5853 (keeping 200 days of data) [2025-09-17T07:07:57.025845] [DEBUG] [LOCAL ] VATE: Primary data saved (5853 records). [2025-09-17T07:07:57.025994] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-17T07:07:57.026097] [INFO ] [MAIN ] Update Progress: 2213/2369 symbols completed. VATE took 32.1s. Estimated remaining: 22m 50s. Rate: 6.8 symbols/min [2025-09-17T07:07:57.199606] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:07:57.209564] [DEBUG] [LOCAL ] VEL: Loaded 8936 existing records from primary storage. [2025-09-17T07:07:57.209718] [INFO ] [MAIN ] VEL: Loaded 8936 existing records. [2025-09-17T07:07:57.388250] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:07:57.388513] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-17T07:07:57.388574] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-17T07:07:57.388966] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-17T07:07:57.389030] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-17T07:07:57.492426] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-09-17T07:07:57.564086] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T07:07:57.776051] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:07:58.290143] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-17T07:07:59.090165] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-11. [2025-09-17T07:07:59.214272] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T07:07:59.250001] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T07:07:59.759888] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T07:07:59.890152] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-09-17T07:08:00.690129] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-17T07:08:00.705236] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T07:08:01.493600] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-17T07:08:01.495416] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T07:08:02.290129] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-09-17T07:08:03.030578] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T07:08:03.046133] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T07:08:03.090116] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-17T07:08:03.890134] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-17T07:08:04.623545] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T07:08:04.625214] [INFO ] [REMOTE ] VBF: Full fetch complete (10537 records). [2025-09-17T07:08:04.625327] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-17T07:08:04.691488] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-17T07:08:05.015536] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-17T07:08:05.016898] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T07:08:05.017071] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-17T07:08:05.027110] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-17T07:08:05.027495] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-17T07:08:05.028039] [DEBUG] [LOCAL ] VBF: Trimmed 10537 records to 7160 (keeping 200 days of data) [2025-09-17T07:08:05.072071] [DEBUG] [LOCAL ] VBF: Primary data saved (7160 records). [2025-09-17T07:08:05.072200] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-17T07:08:05.072293] [INFO ] [MAIN ] Update Progress: 2214/2369 symbols completed. VBF took 31.4s. Estimated remaining: 22m 41s. Rate: 6.8 symbols/min [2025-09-17T07:08:05.239017] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:08:05.278495] [DEBUG] [LOCAL ] VET: Loaded 32383 existing records from primary storage. [2025-09-17T07:08:05.278704] [INFO ] [MAIN ] VET: Loaded 32383 existing records. [2025-09-17T07:08:05.456034] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:08:05.456263] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-17T07:08:05.456317] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-17T07:08:05.457032] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-17T07:08:05.457094] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-17T07:08:05.499325] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-17T07:08:05.818200] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:08:05.828760] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T07:08:05.977349] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T07:08:06.290129] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-17T07:08:07.090129] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-17T07:08:07.890133] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-11. [2025-09-17T07:08:08.098004] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T07:08:08.122771] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T07:08:08.690134] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-17T07:08:09.158744] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T07:08:09.490122] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-17T07:08:10.089820] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T07:08:10.290190] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-17T07:08:10.427030] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T07:08:11.090172] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-17T07:08:11.233634] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T07:08:11.890142] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-09-17T07:08:12.094196] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T07:08:12.690162] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-17T07:08:13.478478] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T07:08:13.490073] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-09-17T07:08:14.290191] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-17T07:08:14.468390] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T07:08:14.615893] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T07:08:15.090156] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-17T07:08:15.229069] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T07:08:15.231366] [INFO ] [REMOTE ] VCV: Full fetch complete (19853 records). [2025-09-17T07:08:15.231461] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-17T07:08:15.596981] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-17T07:08:15.597079] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-17T07:08:15.597568] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-17T07:08:15.597677] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-17T07:08:15.598316] [DEBUG] [LOCAL ] VCV: Trimmed 19853 records to 13449 (keeping 200 days of data) [2025-09-17T07:08:15.681801] [DEBUG] [LOCAL ] VCV: Primary data saved (13449 records). [2025-09-17T07:08:15.681991] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-17T07:08:15.682106] [INFO ] [MAIN ] Update Progress: 2215/2369 symbols completed. VCV took 40.6s. Estimated remaining: 22m 32s. Rate: 6.8 symbols/min [2025-09-17T07:08:15.850471] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:08:15.891788] [DEBUG] [LOCAL ] VFC: Loaded 39970 existing records from primary storage. [2025-09-17T07:08:15.891049] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-17T07:08:15.891947] [INFO ] [MAIN ] VFC: Loaded 39970 existing records. [2025-09-17T07:08:16.074825] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:08:16.075176] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-17T07:08:16.075284] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-17T07:08:16.084604] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T07:08:16.087746] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-17T07:08:16.088244] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-17T07:08:16.443981] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:08:16.690202] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-17T07:08:17.490166] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-17T07:08:17.723867] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T07:08:18.298174] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-17T07:08:18.305093] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T07:08:18.405806] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T07:08:19.090141] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-17T07:08:19.890216] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-17T07:08:19.932677] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T07:08:19.981416] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T07:08:20.690188] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-17T07:08:21.260825] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T07:08:21.490121] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-11. [2025-09-17T07:08:21.519091] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T07:08:22.290190] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-17T07:08:23.061193] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T07:08:23.090071] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-09-17T07:08:23.890153] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-17T07:08:24.042888] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T07:08:24.048895] [INFO ] [REMOTE ] VEEV: Full fetch complete (68510 records). [2025-09-17T07:08:24.049048] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-17T07:08:24.437090] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-17T07:08:24.437198] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-17T07:08:24.438291] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-17T07:08:24.438365] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-17T07:08:24.439893] [DEBUG] [LOCAL ] VEEV: Trimmed 68510 records to 47556 (keeping 200 days of data) [2025-09-17T07:08:24.690508] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-17T07:08:24.733447] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T07:08:24.737710] [INFO ] [REMOTE ] VEL: Full fetch complete (16374 records). [2025-09-17T07:08:24.738900] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-17T07:08:24.835413] [DEBUG] [LOCAL ] VEEV: Primary data saved (47556 records). [2025-09-17T07:08:24.852379] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-17T07:08:24.852701] [INFO ] [MAIN ] Update Progress: 2216/2369 symbols completed. VEEV took 37.5s. Estimated remaining: 22m 23s. Rate: 6.8 symbols/min [2025-09-17T07:08:25.211850] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:08:25.298787] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-17T07:08:25.299892] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-17T07:08:25.300595] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-17T07:08:25.300692] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-17T07:08:25.301837] [DEBUG] [LOCAL ] VEL: Trimmed 16374 records to 12933 (keeping 200 days of data) [2025-09-17T07:08:25.403763] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-17T07:08:25.438821] [DEBUG] [LOCAL ] VG: Loaded 39825 existing records from primary storage. [2025-09-17T07:08:25.439934] [INFO ] [MAIN ] VG: Loaded 39825 existing records. [2025-09-17T07:08:25.497015] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-09-17T07:08:25.522102] [DEBUG] [LOCAL ] VEL: Primary data saved (12933 records). [2025-09-17T07:08:25.547051] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-17T07:08:25.550778] [INFO ] [MAIN ] Update Progress: 2217/2369 symbols completed. VEL took 28.5s. Estimated remaining: 22m 14s. Rate: 6.8 symbols/min [2025-09-17T07:08:25.731801] [WARN ] [MAIN ] VG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:08:25.801333] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:08:25.801465] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-17T07:08:25.801849] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-17T07:08:25.802612] [DEBUG] [LOCAL ] VG: Deleted primary data file. [2025-09-17T07:08:25.802691] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-17T07:08:25.904090] [DEBUG] [LOCAL ] VGI: Loaded 3918 existing records from primary storage. [2025-09-17T07:08:25.906373] [INFO ] [MAIN ] VGI: Loaded 3918 existing records. [2025-09-17T07:08:26.279153] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:08:26.321558] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-17T07:08:26.347187] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-17T07:08:26.347079] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:08:26.347614] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-11. [2025-09-17T07:08:26.349045] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-17T07:08:26.349321] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-17T07:08:26.626598] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:08:26.681513] [WARN ] [REMOTE ] VG: No data returned for month 2024-11 [2025-09-17T07:08:26.712304] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T07:08:26.805577] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:08:27.090177] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-11. [2025-09-17T07:08:27.439007] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T07:08:27.710427] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T07:08:27.890158] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-17T07:08:28.690143] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-09-17T07:08:29.280115] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T07:08:29.437600] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T07:08:29.490077] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-17T07:08:30.290190] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-17T07:08:30.545996] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:08:30.546225] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-17T07:08:31.087567] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T07:08:31.096315] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-09-17T07:08:31.564430] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T07:08:31.890206] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-17T07:08:32.690136] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-17T07:08:33.264539] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T07:08:33.354251] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T07:08:33.490141] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-17T07:08:33.828709] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-17T07:08:34.290315] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-17T07:08:34.791475] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T07:08:35.090178] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-17T07:08:35.890164] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-09-17T07:08:36.690136] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-17T07:08:36.864565] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T07:08:36.954857] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T07:08:37.490186] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-17T07:08:38.233342] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T07:08:38.290106] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-17T07:08:39.090152] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-17T07:08:39.281916] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T07:08:39.747869] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T07:08:39.753499] [INFO ] [REMOTE ] VET: Full fetch complete (64258 records). [2025-09-17T07:08:39.753721] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-17T07:08:39.903243] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-17T07:08:40.171419] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-17T07:08:40.171552] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-17T07:08:40.172772] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-17T07:08:40.172856] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-17T07:08:40.174524] [DEBUG] [LOCAL ] VET: Trimmed 64258 records to 44421 (keeping 200 days of data) [2025-09-17T07:08:40.450848] [DEBUG] [LOCAL ] VET: Primary data saved (44421 records). [2025-09-17T07:08:40.451061] [INFO ] [MAIN ] VET: Full history saved. [2025-09-17T07:08:40.451189] [INFO ] [MAIN ] Update Progress: 2218/2369 symbols completed. VET took 35.4s. Estimated remaining: 22m 6s. Rate: 6.8 symbols/min [2025-09-17T07:08:40.632570] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:08:40.647442] [DEBUG] [LOCAL ] VGM: Loaded 14407 existing records from primary storage. [2025-09-17T07:08:40.647587] [INFO ] [MAIN ] VGM: Loaded 14407 existing records. [2025-09-17T07:08:40.711608] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-17T07:08:40.834209] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:08:40.834504] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-17T07:08:40.834728] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-17T07:08:40.835196] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-17T07:08:40.835295] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-17T07:08:41.222537] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:08:41.253665] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-17T07:08:41.330592] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T07:08:41.490148] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-17T07:08:41.689604] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T07:08:42.052270] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T07:08:42.290128] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-17T07:08:43.090165] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-11. [2025-09-17T07:08:43.890154] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-17T07:08:44.118041] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T07:08:44.273800] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T07:08:44.690140] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-17T07:08:45.490133] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-17T07:08:45.894532] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T07:08:46.133363] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T07:08:46.290182] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-17T07:08:46.719486] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T07:08:47.090131] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-17T07:08:47.775600] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T07:08:47.890146] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-17T07:08:48.131313] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T07:08:48.690138] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-09-17T07:08:49.490170] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-17T07:08:49.772715] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T07:08:49.838781] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T07:08:50.290174] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-17T07:08:51.090186] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-17T07:08:51.242862] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T07:08:51.850483] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T07:08:51.852328] [INFO ] [REMOTE ] VGI: Full fetch complete (7733 records). [2025-09-17T07:08:51.852412] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-17T07:08:51.895192] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-17T07:08:52.220171] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-17T07:08:52.220449] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-17T07:08:52.220799] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-17T07:08:52.221003] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-17T07:08:52.221683] [DEBUG] [LOCAL ] VGI: Trimmed 7733 records to 5227 (keeping 200 days of data) [2025-09-17T07:08:52.253854] [DEBUG] [LOCAL ] VGI: Primary data saved (5227 records). [2025-09-17T07:08:52.254025] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-17T07:08:52.254141] [INFO ] [MAIN ] Update Progress: 2219/2369 symbols completed. VGI took 26.7s. Estimated remaining: 21m 57s. Rate: 6.8 symbols/min [2025-09-17T07:08:52.436727] [INFO ] [MAIN ] VHC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:08:52.437048] [DEBUG] [LOCAL ] VHC: No existing data file found in primary storage. [2025-09-17T07:08:52.437284] [WARN ] [MAIN ] VHC: No existing data found, performing full refresh instead. [2025-09-17T07:08:52.437502] [INFO ] [MAIN ] VHC: Wiping existing primary data before full refresh. [2025-09-17T07:08:52.437597] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-17T07:08:52.437755] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-17T07:08:52.437922] [INFO ] [MAIN ] VHC: Starting full primary refresh. [2025-09-17T07:08:52.577093] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-17T07:08:52.699504] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-09-17T07:08:52.851883] [INFO ] [REMOTE ] VHC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:08:53.490116] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-17T07:08:53.604078] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T07:08:53.981522] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T07:08:54.290138] [INFO ] [REMOTE ] VHC: Fetching primary data for 2024-11. [2025-09-17T07:08:54.701000] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2024-11 (0.41 seconds). [2025-09-17T07:08:55.090094] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-17T07:08:55.164107] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T07:08:55.829906] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T07:08:55.890110] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-17T07:08:56.496536] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T07:08:56.690125] [INFO ] [REMOTE ] VHC: Fetching primary data for 2024-12. [2025-09-17T07:08:57.274897] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T07:08:57.490135] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-01. [2025-09-17T07:08:58.019290] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T07:08:58.290176] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-17T07:08:59.090121] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-17T07:08:59.890155] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-17T07:09:00.038265] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T07:09:00.151614] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T07:09:00.690145] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-17T07:09:01.490180] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-02. [2025-09-17T07:09:01.786301] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T07:09:01.793793] [INFO ] [REMOTE ] VG: Full fetch complete (62563 records). [2025-09-17T07:09:01.794028] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-17T07:09:02.005967] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-09-17T07:09:02.020223] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:09:02.020529] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:09:02.021428] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-17T07:09:02.023014] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-17T07:09:02.022767] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T07:09:02.023148] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-17T07:09:02.029131] [DEBUG] [LOCAL ] VG: Deleted derivative data file. [2025-09-17T07:09:02.029366] [INFO ] [MAIN ] Update Progress: 2220/2369 symbols completed. VG took 37.2s. Estimated remaining: 21m 48s. Rate: 6.8 symbols/min [2025-09-17T07:09:02.212272] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:09:02.212534] [DEBUG] [LOCAL ] VHI: No existing data file found in primary storage. [2025-09-17T07:09:02.212593] [WARN ] [MAIN ] VHI: No existing data found, performing full refresh instead. [2025-09-17T07:09:02.212767] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-17T07:09:02.212871] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-17T07:09:02.212932] [DEBUG] [LOCAL ] VHI: No primary data file found to delete. [2025-09-17T07:09:02.212977] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-17T07:09:02.295202] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-17T07:09:02.498340] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T07:09:02.590810] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:09:03.090179] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-03. [2025-09-17T07:09:03.890236] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-11. [2025-09-17T07:09:04.026286] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T07:09:04.690174] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-04. [2025-09-17T07:09:05.302167] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T07:09:05.490173] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-05. [2025-09-17T07:09:05.568056] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T07:09:05.907483] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T07:09:06.243290] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (3.95 seconds). [2025-09-17T07:09:06.249920] [INFO ] [REMOTE ] VFC: Full fetch complete (77426 records). [2025-09-17T07:09:06.250133] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-17T07:09:06.295271] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-09-17T07:09:06.673700] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-17T07:09:06.673820] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-17T07:09:06.675011] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-17T07:09:06.675073] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-17T07:09:06.676689] [DEBUG] [LOCAL ] VFC: Trimmed 77426 records to 53609 (keeping 200 days of data) [2025-09-17T07:09:07.000301] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T07:09:07.023393] [DEBUG] [LOCAL ] VFC: Primary data saved (53609 records). [2025-09-17T07:09:07.023564] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-17T07:09:07.023893] [INFO ] [MAIN ] Update Progress: 2221/2369 symbols completed. VFC took 51.3s. Estimated remaining: 21m 39s. Rate: 6.8 symbols/min [2025-09-17T07:09:07.095302] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-17T07:09:07.205199] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:09:07.205562] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-17T07:09:07.205619] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-17T07:09:07.205774] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-17T07:09:07.205832] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-17T07:09:07.205885] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-17T07:09:07.205932] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-17T07:09:07.598414] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:09:07.890131] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-09-17T07:09:08.188889] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T07:09:08.251011] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T07:09:08.690128] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-17T07:09:09.490140] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-06. [2025-09-17T07:09:09.734524] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T07:09:10.057462] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T07:09:10.290150] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-17T07:09:10.774129] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T07:09:11.090136] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-17T07:09:11.668667] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T07:09:11.890132] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-11. [2025-09-17T07:09:12.099700] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:09:12.100034] [WARN ] [REMOTE ] VIA: No data returned for month 2024-11 [2025-09-17T07:09:12.690184] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-17T07:09:13.254224] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T07:09:13.490153] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-17T07:09:14.290170] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-17T07:09:14.548982] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T07:09:14.789020] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T07:09:15.090145] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-17T07:09:15.890175] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-07. [2025-09-17T07:09:16.228138] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T07:09:16.232136] [INFO ] [REMOTE ] VGM: Full fetch complete (26197 records). [2025-09-17T07:09:16.232337] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-17T07:09:16.574894] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T07:09:16.650857] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-17T07:09:16.650966] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-17T07:09:16.651538] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-17T07:09:16.651598] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-17T07:09:16.652297] [DEBUG] [LOCAL ] VGM: Trimmed 26197 records to 18287 (keeping 200 days of data) [2025-09-17T07:09:16.700523] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-17T07:09:16.770866] [DEBUG] [LOCAL ] VGM: Primary data saved (18287 records). [2025-09-17T07:09:16.771036] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-17T07:09:16.771158] [INFO ] [MAIN ] Update Progress: 2222/2369 symbols completed. VGM took 36.3s. Estimated remaining: 21m 31s. Rate: 6.8 symbols/min [2025-09-17T07:09:16.931257] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:09:16.951137] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:09:16.951440] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-17T07:09:16.997345] [DEBUG] [LOCAL ] VICI: Loaded 40006 existing records from primary storage. [2025-09-17T07:09:16.997537] [INFO ] [MAIN ] VICI: Loaded 40006 existing records. [2025-09-17T07:09:17.181323] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:09:17.181575] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-17T07:09:17.181668] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-17T07:09:17.182557] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-17T07:09:17.182620] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-17T07:09:17.502884] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-09-17T07:09:17.543735] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:09:18.290222] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-17T07:09:18.299333] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:09:18.299590] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-09-17T07:09:19.090166] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-11. [2025-09-17T07:09:19.514427] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T07:09:19.890190] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-08. [2025-09-17T07:09:20.690127] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-17T07:09:20.818627] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T07:09:20.897196] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:09:20.909084] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-17T07:09:20.910957] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T07:09:21.490244] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-09. [2025-09-17T07:09:22.016486] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T07:09:22.017476] [INFO ] [REMOTE ] VHC: Full fetch complete (3762 records). [2025-09-17T07:09:22.017576] [DEBUG] [VALIDATOR ] VHC: Validating primary data. [2025-09-17T07:09:22.194159] [WARN ] [VALIDATOR ] VHC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T07:09:22.194366] [FATAL] [MAIN ] VHC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:09:22.194426] [WARN ] [MAIN ] VHC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:09:22.194504] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-17T07:09:22.194575] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-17T07:09:22.194633] [INFO ] [LOCAL ] VHC: Starting deletion of derivative data. [2025-09-17T07:09:22.194727] [DEBUG] [LOCAL ] VHC: No derivative data file found to delete. [2025-09-17T07:09:22.194815] [INFO ] [MAIN ] Update Progress: 2223/2369 symbols completed. VHC took 29.9s. Estimated remaining: 21m 22s. Rate: 6.8 symbols/min [2025-09-17T07:09:22.292953] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-09-17T07:09:22.363902] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:09:22.411092] [DEBUG] [LOCAL ] VIK: Loaded 39118 existing records from primary storage. [2025-09-17T07:09:22.411255] [INFO ] [MAIN ] VIK: Loaded 39118 existing records. [2025-09-17T07:09:22.585410] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:09:22.585655] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-17T07:09:22.585716] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-17T07:09:22.586541] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-17T07:09:22.586607] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-17T07:09:22.940024] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:09:23.090106] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-11. [2025-09-17T07:09:23.890175] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-17T07:09:24.304388] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T07:09:24.460926] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T07:09:24.690098] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-17T07:09:24.837409] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T07:09:24.877526] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:09:24.877847] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-17T07:09:25.490135] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-17T07:09:25.937179] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T07:09:26.290144] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-09-17T07:09:27.090173] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-09-17T07:09:27.890138] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-17T07:09:28.007348] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T07:09:28.414067] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T07:09:28.415334] [INFO ] [REMOTE ] VHI: Full fetch complete (4726 records). [2025-09-17T07:09:28.415433] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-17T07:09:28.695485] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-17T07:09:28.779202] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-17T07:09:28.779307] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-17T07:09:28.779472] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-17T07:09:28.779522] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-17T07:09:28.779922] [DEBUG] [LOCAL ] VHI: Trimmed 4726 records to 2980 (keeping 200 days of data) [2025-09-17T07:09:28.798816] [DEBUG] [LOCAL ] VHI: Primary data saved (2980 records). [2025-09-17T07:09:28.798918] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-17T07:09:28.799019] [INFO ] [MAIN ] Update Progress: 2224/2369 symbols completed. VHI took 26.8s. Estimated remaining: 21m 13s. Rate: 6.8 symbols/min [2025-09-17T07:09:28.929995] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:09:28.976609] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:09:28.977003] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-17T07:09:29.016256] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T07:09:29.063498] [DEBUG] [LOCAL ] VIPS: Loaded 38049 existing records from primary storage. [2025-09-17T07:09:29.063710] [INFO ] [MAIN ] VIPS: Loaded 38049 existing records. [2025-09-17T07:09:29.240127] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:09:29.240402] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-17T07:09:29.240454] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-17T07:09:29.241217] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-17T07:09:29.241278] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-17T07:09:29.495227] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-09-17T07:09:29.597260] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:09:30.290149] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-11. [2025-09-17T07:09:31.090164] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-17T07:09:31.151198] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T07:09:31.890102] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-17T07:09:31.924903] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T07:09:32.471148] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T07:09:32.690162] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-09-17T07:09:33.440526] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T07:09:33.490086] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-17T07:09:34.290135] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-17T07:09:34.479056] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:09:34.479379] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-17T07:09:34.594043] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T07:09:34.832864] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T07:09:35.090124] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-17T07:09:35.280576] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:09:35.280968] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-17T07:09:35.890127] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-17T07:09:36.074494] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:09:36.074877] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-17T07:09:36.690203] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-09-17T07:09:37.490181] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-17T07:09:38.290131] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-17T07:09:38.357009] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T07:09:38.500585] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:09:38.500972] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-17T07:09:39.090144] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-17T07:09:39.139686] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T07:09:39.805027] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T07:09:39.806972] [INFO ] [REMOTE ] VIA: Full fetch complete (811 records). [2025-09-17T07:09:39.807096] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-17T07:09:39.895357] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-17T07:09:39.991314] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 3 unique days, need 200 days [2025-09-17T07:09:39.991504] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:09:39.991588] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:09:39.991659] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-17T07:09:39.991742] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-17T07:09:39.991810] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-17T07:09:39.991880] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-17T07:09:39.991962] [INFO ] [MAIN ] Update Progress: 2225/2369 symbols completed. VIA took 33.0s. Estimated remaining: 21m 4s. Rate: 6.8 symbols/min [2025-09-17T07:09:40.160757] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:09:40.201190] [DEBUG] [LOCAL ] VIRT: Loaded 34659 existing records from primary storage. [2025-09-17T07:09:40.201355] [INFO ] [MAIN ] VIRT: Loaded 34659 existing records. [2025-09-17T07:09:40.379192] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:09:40.379444] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-17T07:09:40.379496] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-17T07:09:40.380240] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-17T07:09:40.380326] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-17T07:09:40.700521] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-17T07:09:40.793409] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:09:41.490217] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-17T07:09:41.625163] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T07:09:42.290142] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-17T07:09:42.676422] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T07:09:43.090119] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-11. [2025-09-17T07:09:43.177022] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T07:09:43.890185] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-17T07:09:43.938071] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T07:09:44.401446] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T07:09:44.690134] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-09-17T07:09:45.490143] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-17T07:09:45.543914] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T07:09:45.837536] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T07:09:46.290184] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-17T07:09:47.090131] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-17T07:09:47.405508] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T07:09:47.890182] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-17T07:09:48.055504] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T07:09:48.598497] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T07:09:48.690128] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-17T07:09:49.423307] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T07:09:49.490103] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-17T07:09:50.290138] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-17T07:09:50.654119] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T07:09:51.090106] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-17T07:09:51.190576] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T07:09:51.533997] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T07:09:51.890142] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-17T07:09:52.690134] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-17T07:09:52.812330] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T07:09:53.443865] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T07:09:53.490163] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-17T07:09:54.251574] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T07:09:54.290203] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-17T07:09:55.090135] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-17T07:09:55.394916] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T07:09:55.890145] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-17T07:09:55.950588] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T07:09:56.690194] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-17T07:09:56.742527] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T07:09:56.750305] [INFO ] [REMOTE ] VIK: Full fetch complete (75729 records). [2025-09-17T07:09:56.750528] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-17T07:09:57.358989] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-17T07:09:57.359164] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-17T07:09:57.361115] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-17T07:09:57.361234] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-17T07:09:57.363280] [DEBUG] [LOCAL ] VIK: Trimmed 75729 records to 52545 (keeping 200 days of data) [2025-09-17T07:09:57.490420] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-17T07:09:57.809427] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T07:09:57.828114] [DEBUG] [LOCAL ] VIK: Primary data saved (52545 records). [2025-09-17T07:09:57.828780] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-17T07:09:57.828930] [INFO ] [MAIN ] Update Progress: 2226/2369 symbols completed. VIK took 35.6s. Estimated remaining: 20m 56s. Rate: 6.8 symbols/min [2025-09-17T07:09:57.999036] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:09:58.030747] [DEBUG] [LOCAL ] VIST: Loaded 34025 existing records from primary storage. [2025-09-17T07:09:58.030960] [INFO ] [MAIN ] VIST: Loaded 34025 existing records. [2025-09-17T07:09:58.210952] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:09:58.211216] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-17T07:09:58.211269] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-17T07:09:58.212023] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-17T07:09:58.212083] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-17T07:09:58.300613] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-17T07:09:58.568890] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:09:58.598370] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T07:09:58.761970] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T07:09:59.090174] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-17T07:09:59.890173] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-11. [2025-09-17T07:09:59.917816] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T07:09:59.927000] [INFO ] [REMOTE ] VICI: Full fetch complete (77505 records). [2025-09-17T07:09:59.927208] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-17T07:10:00.320445] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-17T07:10:00.320548] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-17T07:10:00.321733] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-17T07:10:00.321813] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-17T07:10:00.323283] [DEBUG] [LOCAL ] VICI: Trimmed 77505 records to 53647 (keeping 200 days of data) [2025-09-17T07:10:00.655885] [DEBUG] [LOCAL ] VICI: Primary data saved (53647 records). [2025-09-17T07:10:00.656047] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-17T07:10:00.656154] [INFO ] [MAIN ] Update Progress: 2227/2369 symbols completed. VICI took 43.9s. Estimated remaining: 20m 47s. Rate: 6.8 symbols/min [2025-09-17T07:10:00.699311] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-17T07:10:00.830314] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:10:00.847679] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T07:10:00.854210] [INFO ] [REMOTE ] VIPS: Full fetch complete (74462 records). [2025-09-17T07:10:00.854420] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-17T07:10:01.119655] [DEBUG] [LOCAL ] VIV: Loaded 33811 existing records from primary storage. [2025-09-17T07:10:01.156538] [INFO ] [MAIN ] VIV: Loaded 33811 existing records. [2025-09-17T07:10:01.466179] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:10:01.470027] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-17T07:10:01.470560] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-17T07:10:01.470497] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-17T07:10:01.470741] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-17T07:10:01.472017] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-17T07:10:01.472118] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-17T07:10:01.473810] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-17T07:10:01.473759] [DEBUG] [LOCAL ] VIPS: Trimmed 74462 records to 51406 (keeping 200 days of data) [2025-09-17T07:10:01.473963] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-17T07:10:01.809194] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T07:10:01.881885] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-09-17T07:10:01.999033] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:10:02.221617] [DEBUG] [LOCAL ] VIPS: Primary data saved (51406 records). [2025-09-17T07:10:02.221852] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-17T07:10:02.221987] [INFO ] [MAIN ] Update Progress: 2228/2369 symbols completed. VIPS took 33.4s. Estimated remaining: 20m 38s. Rate: 6.8 symbols/min [2025-09-17T07:10:02.300175] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-11. [2025-09-17T07:10:02.401155] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:10:02.416410] [DEBUG] [LOCAL ] VKQ: Loaded 13433 existing records from primary storage. [2025-09-17T07:10:02.416664] [INFO ] [MAIN ] VKQ: Loaded 13433 existing records. [2025-09-17T07:10:02.603635] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:10:02.604091] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-17T07:10:02.604203] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-17T07:10:02.604609] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-17T07:10:02.604728] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-17T07:10:03.023159] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-17T07:10:03.027301] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:10:03.090182] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-11. [2025-09-17T07:10:03.565624] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T07:10:03.641128] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T07:10:03.890165] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-17T07:10:03.971114] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T07:10:04.690174] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-09-17T07:10:05.311130] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T07:10:05.490133] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-17T07:10:05.925222] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T07:10:06.290130] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-09-17T07:10:07.055434] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T07:10:07.090109] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-17T07:10:07.303471] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T07:10:07.890145] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-09-17T07:10:08.685990] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T07:10:08.692665] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-09-17T07:10:08.782785] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T07:10:09.490129] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-17T07:10:10.183067] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T07:10:10.290103] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-17T07:10:10.744687] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T07:10:11.090129] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-09-17T07:10:11.693254] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T07:10:11.890166] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-17T07:10:12.690117] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-17T07:10:12.795370] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T07:10:13.414092] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T07:10:13.490149] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-17T07:10:13.569012] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T07:10:14.290137] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-17T07:10:15.072019] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T07:10:15.078491] [INFO ] [REMOTE ] VIRT: Full fetch complete (66742 records). [2025-09-17T07:10:15.078691] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-17T07:10:15.100771] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-17T07:10:15.480991] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-17T07:10:15.481115] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-17T07:10:15.482192] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-17T07:10:15.482256] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-17T07:10:15.483757] [DEBUG] [LOCAL ] VIRT: Trimmed 66742 records to 47139 (keeping 200 days of data) [2025-09-17T07:10:15.775899] [DEBUG] [LOCAL ] VIRT: Primary data saved (47139 records). [2025-09-17T07:10:15.776063] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-17T07:10:15.776151] [INFO ] [MAIN ] Update Progress: 2229/2369 symbols completed. VIRT took 35.8s. Estimated remaining: 20m 29s. Rate: 6.8 symbols/min [2025-09-17T07:10:15.894983] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-17T07:10:15.953630] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:10:15.982105] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T07:10:16.007221] [DEBUG] [LOCAL ] VLN: Loaded 22121 existing records from primary storage. [2025-09-17T07:10:16.007402] [INFO ] [MAIN ] VLN: Loaded 22121 existing records. [2025-09-17T07:10:16.190385] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:10:16.190668] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-17T07:10:16.190745] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-17T07:10:16.191278] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-17T07:10:16.191347] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-17T07:10:16.547552] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:10:16.690119] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-17T07:10:16.736876] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T07:10:16.892431] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T07:10:17.490162] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-17T07:10:18.115516] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T07:10:18.290125] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-11. [2025-09-17T07:10:18.473605] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T07:10:19.090135] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-17T07:10:19.141578] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T07:10:19.890139] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-09-17T07:10:20.030599] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T07:10:20.690144] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-17T07:10:21.206143] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T07:10:21.490162] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-17T07:10:22.262666] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T07:10:22.290075] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-17T07:10:23.055486] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T07:10:23.090088] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-17T07:10:23.890162] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-17T07:10:24.058012] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T07:10:24.690541] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-09-17T07:10:24.696869] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T07:10:24.797466] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T07:10:25.490164] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-17T07:10:25.774987] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T07:10:26.290155] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-17T07:10:26.509391] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T07:10:27.089129] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T07:10:27.094433] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-17T07:10:27.890134] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-17T07:10:28.572953] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T07:10:28.690096] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-17T07:10:29.416144] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T07:10:29.490163] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-17T07:10:29.706848] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T07:10:30.290152] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-17T07:10:30.922144] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T07:10:30.927488] [INFO ] [REMOTE ] VIV: Full fetch complete (64807 records). [2025-09-17T07:10:30.927657] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-17T07:10:31.101022] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-17T07:10:31.319767] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-17T07:10:31.319903] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-17T07:10:31.320980] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-17T07:10:31.321077] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-17T07:10:31.333318] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T07:10:31.337536] [DEBUG] [LOCAL ] VIV: Trimmed 64807 records to 45523 (keeping 200 days of data) [2025-09-17T07:10:31.636261] [DEBUG] [LOCAL ] VIV: Primary data saved (45523 records). [2025-09-17T07:10:31.636429] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-17T07:10:31.636540] [INFO ] [MAIN ] Update Progress: 2230/2369 symbols completed. VIV took 31.0s. Estimated remaining: 20m 21s. Rate: 6.8 symbols/min [2025-09-17T07:10:31.806533] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:10:31.848277] [DEBUG] [LOCAL ] VLO: Loaded 39583 existing records from primary storage. [2025-09-17T07:10:31.848443] [INFO ] [MAIN ] VLO: Loaded 39583 existing records. [2025-09-17T07:10:31.895277] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-17T07:10:32.034090] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:10:32.034362] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-17T07:10:32.034423] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-17T07:10:32.035345] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-17T07:10:32.035412] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-17T07:10:32.394605] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:10:32.680965] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T07:10:32.690077] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-17T07:10:32.993813] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T07:10:32.997003] [INFO ] [REMOTE ] VKQ: Full fetch complete (24410 records). [2025-09-17T07:10:32.997113] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-17T07:10:33.366740] [DEBUG] [VALIDATOR ] VKQ: All expected trading days are present. [2025-09-17T07:10:33.366854] [DEBUG] [VALIDATOR ] VKQ: Primary data validation passed. [2025-09-17T07:10:33.367398] [INFO ] [MAIN ] VKQ: Fetched primary data is valid. [2025-09-17T07:10:33.367453] [DEBUG] [LOCAL ] VKQ: Saving primary data. [2025-09-17T07:10:33.368310] [DEBUG] [LOCAL ] VKQ: Trimmed 24410 records to 17541 (keeping 200 days of data) [2025-09-17T07:10:33.479539] [DEBUG] [LOCAL ] VKQ: Primary data saved (17541 records). [2025-09-17T07:10:33.479741] [INFO ] [MAIN ] VKQ: Full history saved. [2025-09-17T07:10:33.479850] [INFO ] [MAIN ] Update Progress: 2231/2369 symbols completed. VKQ took 31.3s. Estimated remaining: 20m 12s. Rate: 6.8 symbols/min [2025-09-17T07:10:33.495369] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-11. [2025-09-17T07:10:33.656838] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:10:33.684566] [DEBUG] [LOCAL ] VLRS: Loaded 29529 existing records from primary storage. [2025-09-17T07:10:33.685180] [INFO ] [MAIN ] VLRS: Loaded 29529 existing records. [2025-09-17T07:10:33.863449] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:10:33.863770] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-17T07:10:33.863853] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-17T07:10:33.864544] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-17T07:10:33.864613] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-17T07:10:34.236514] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:10:34.276875] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T07:10:34.290089] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-17T07:10:35.017553] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T07:10:35.090114] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-09-17T07:10:35.890168] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-17T07:10:35.949411] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T07:10:36.690177] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-11. [2025-09-17T07:10:36.831364] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T07:10:37.044767] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T07:10:37.490208] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-17T07:10:37.821088] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T07:10:38.290144] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-17T07:10:38.534219] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T07:10:39.090192] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-17T07:10:39.791274] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T07:10:39.797274] [INFO ] [REMOTE ] VIST: Full fetch complete (66491 records). [2025-09-17T07:10:39.797447] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-17T07:10:39.895380] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-09-17T07:10:40.213374] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-17T07:10:40.213529] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-17T07:10:40.214658] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-17T07:10:40.214804] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-17T07:10:40.231007] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T07:10:40.231114] [DEBUG] [LOCAL ] VIST: Trimmed 66491 records to 45918 (keeping 200 days of data) [2025-09-17T07:10:40.530794] [DEBUG] [LOCAL ] VIST: Primary data saved (45918 records). [2025-09-17T07:10:40.530970] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-17T07:10:40.531078] [INFO ] [MAIN ] Update Progress: 2232/2369 symbols completed. VIST took 42.7s. Estimated remaining: 20m 3s. Rate: 6.8 symbols/min [2025-09-17T07:10:40.702173] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:10:40.699827] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-17T07:10:40.708294] [DEBUG] [LOCAL ] VLT: Loaded 3187 existing records from primary storage. [2025-09-17T07:10:40.708405] [INFO ] [MAIN ] VLT: Loaded 3187 existing records. [2025-09-17T07:10:40.885670] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:10:40.885944] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-17T07:10:40.886004] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-17T07:10:40.886354] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-17T07:10:40.886425] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-17T07:10:41.282362] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:10:41.306524] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T07:10:41.490158] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-11. [2025-09-17T07:10:41.763409] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T07:10:42.080052] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T07:10:42.290156] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-17T07:10:43.090152] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-09-17T07:10:43.821442] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T07:10:43.890151] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-09-17T07:10:44.690144] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-17T07:10:44.933587] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T07:10:45.357096] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T07:10:45.490193] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-09-17T07:10:46.056808] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T07:10:46.109214] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T07:10:46.113892] [INFO ] [REMOTE ] VLN: Full fetch complete (43292 records). [2025-09-17T07:10:46.114013] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-17T07:10:46.300430] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-17T07:10:46.502869] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-17T07:10:46.502990] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-17T07:10:46.503824] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-17T07:10:46.503974] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-17T07:10:46.504936] [DEBUG] [LOCAL ] VLN: Trimmed 43292 records to 27959 (keeping 200 days of data) [2025-09-17T07:10:46.661457] [DEBUG] [LOCAL ] VLN: Primary data saved (27959 records). [2025-09-17T07:10:46.661618] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-17T07:10:46.661743] [INFO ] [MAIN ] Update Progress: 2233/2369 symbols completed. VLN took 30.9s. Estimated remaining: 19m 54s. Rate: 6.8 symbols/min [2025-09-17T07:10:46.834537] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:10:46.868017] [DEBUG] [LOCAL ] VLTO: Loaded 33945 existing records from primary storage. [2025-09-17T07:10:46.868186] [INFO ] [MAIN ] VLTO: Loaded 33945 existing records. [2025-09-17T07:10:47.056578] [WARN ] [MAIN ] VLTO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:10:47.056866] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-17T07:10:47.056928] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-17T07:10:47.058047] [DEBUG] [LOCAL ] VLTO: Deleted primary data file. [2025-09-17T07:10:47.058125] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-17T07:10:47.095286] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-09-17T07:10:47.436968] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:10:47.874462] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T07:10:47.890083] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-17T07:10:48.121873] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T07:10:48.557830] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T07:10:48.690139] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-17T07:10:49.490150] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-17T07:10:50.110633] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T07:10:50.290117] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-17T07:10:50.509590] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T07:10:51.090167] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-17T07:10:51.782236] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T07:10:51.890149] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-17T07:10:52.690188] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-11. [2025-09-17T07:10:52.920592] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T07:10:53.480310] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T07:10:53.490201] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-17T07:10:54.256167] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T07:10:54.290113] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-17T07:10:55.036236] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T07:10:55.090149] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-09-17T07:10:55.200844] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T07:10:55.890201] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-17T07:10:56.690199] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-17T07:10:56.718581] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T07:10:57.379867] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T07:10:57.490129] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-17T07:10:58.231924] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T07:10:58.290157] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-17T07:10:59.098032] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-17T07:10:59.103655] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T07:10:59.135022] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T07:10:59.890205] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-17T07:11:00.510295] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T07:11:00.690166] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-17T07:11:01.490215] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-17T07:11:01.746624] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T07:11:01.826831] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T07:11:02.265117] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T07:11:02.290101] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-17T07:11:03.090128] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-17T07:11:03.711398] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T07:11:03.890139] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-17T07:11:04.690147] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-17T07:11:04.759733] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T07:11:05.121053] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T07:11:05.125479] [INFO ] [REMOTE ] VLRS: Full fetch complete (58863 records). [2025-09-17T07:11:05.125690] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-17T07:11:05.428762] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T07:11:05.490164] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-17T07:11:05.526933] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-17T07:11:05.527029] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-17T07:11:05.528033] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-17T07:11:05.528100] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-17T07:11:05.529368] [DEBUG] [LOCAL ] VLRS: Trimmed 58863 records to 41064 (keeping 200 days of data) [2025-09-17T07:11:05.764112] [DEBUG] [LOCAL ] VLRS: Primary data saved (41064 records). [2025-09-17T07:11:05.764263] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-17T07:11:05.764355] [INFO ] [MAIN ] Update Progress: 2234/2369 symbols completed. VLRS took 32.3s. Estimated remaining: 19m 46s. Rate: 6.8 symbols/min [2025-09-17T07:11:05.933780] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:11:05.969141] [DEBUG] [LOCAL ] VMC: Loaded 31862 existing records from primary storage. [2025-09-17T07:11:05.969312] [INFO ] [MAIN ] VMC: Loaded 31862 existing records. [2025-09-17T07:11:06.157300] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:11:06.158239] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T07:11:06.158451] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-17T07:11:06.158591] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-17T07:11:06.161749] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-17T07:11:06.161825] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-17T07:11:06.301861] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-17T07:11:06.538738] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:11:07.090137] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-17T07:11:07.817280] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T07:11:07.818758] [INFO ] [REMOTE ] VLT: Full fetch complete (7523 records). [2025-09-17T07:11:07.818860] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-17T07:11:07.896079] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-11. [2025-09-17T07:11:08.205245] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-17T07:11:08.205371] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-17T07:11:08.205757] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-17T07:11:08.205916] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-17T07:11:08.206558] [DEBUG] [LOCAL ] VLT: Trimmed 7523 records to 4731 (keeping 200 days of data) [2025-09-17T07:11:08.237248] [DEBUG] [LOCAL ] VLT: Primary data saved (4731 records). [2025-09-17T07:11:08.237466] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-17T07:11:08.237697] [INFO ] [MAIN ] Update Progress: 2235/2369 symbols completed. VLT took 27.7s. Estimated remaining: 19m 36s. Rate: 6.8 symbols/min [2025-09-17T07:11:08.440818] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T07:11:08.458477] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:11:08.481865] [DEBUG] [LOCAL ] VMI: Loaded 11308 existing records from primary storage. [2025-09-17T07:11:08.482036] [INFO ] [MAIN ] VMI: Loaded 11308 existing records. [2025-09-17T07:11:08.660123] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:11:08.660410] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-17T07:11:08.660491] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-17T07:11:08.660878] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-17T07:11:08.660947] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-17T07:11:08.695320] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-17T07:11:09.023012] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:11:09.303385] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T07:11:09.490122] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-17T07:11:09.594855] [DEBUG] [REMOTE ] VLTO: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-17T07:11:09.595265] [WARN ] [REMOTE ] VLTO: No data returned for month 2025-03 [2025-09-17T07:11:10.290124] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-17T07:11:10.559996] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T07:11:11.090187] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-11. [2025-09-17T07:11:11.890109] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-09-17T07:11:12.000670] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T07:11:12.094816] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T07:11:12.690145] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-17T07:11:13.262164] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T07:11:13.490179] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-09-17T07:11:14.290111] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-17T07:11:14.392006] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T07:11:14.428054] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T07:11:15.090177] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-17T07:11:15.890194] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-09-17T07:11:16.081379] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T07:11:16.087876] [INFO ] [REMOTE ] VLO: Full fetch complete (76781 records). [2025-09-17T07:11:16.088043] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-17T07:11:16.509253] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-17T07:11:16.509522] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-17T07:11:16.511502] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-17T07:11:16.511792] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-17T07:11:16.514308] [DEBUG] [LOCAL ] VLO: Trimmed 76781 records to 53110 (keeping 200 days of data) [2025-09-17T07:11:16.675581] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T07:11:16.690535] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-17T07:11:16.901442] [DEBUG] [LOCAL ] VLO: Primary data saved (53110 records). [2025-09-17T07:11:16.901618] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-17T07:11:16.901734] [INFO ] [MAIN ] Update Progress: 2236/2369 symbols completed. VLO took 45.3s. Estimated remaining: 19m 28s. Rate: 6.8 symbols/min [2025-09-17T07:11:17.073746] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:11:17.090431] [DEBUG] [LOCAL ] VMO: Loaded 15362 existing records from primary storage. [2025-09-17T07:11:17.090617] [INFO ] [MAIN ] VMO: Loaded 15362 existing records. [2025-09-17T07:11:17.272774] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:11:17.273060] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-17T07:11:17.273122] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-17T07:11:17.273506] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-17T07:11:17.273565] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-17T07:11:17.495522] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-17T07:11:17.634291] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:11:17.658411] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T07:11:17.760410] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T07:11:18.290146] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-11. [2025-09-17T07:11:18.987064] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T07:11:19.090139] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-17T07:11:19.428809] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T07:11:19.890139] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-17T07:11:20.585318] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T07:11:20.690141] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-17T07:11:20.775417] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T07:11:21.490199] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-17T07:11:22.290155] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-09-17T07:11:22.321114] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T07:11:22.326830] [INFO ] [REMOTE ] VLTO: Full fetch complete (59373 records). [2025-09-17T07:11:22.326951] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-17T07:11:22.521240] [WARN ] [VALIDATOR ] VLTO: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T07:11:22.522256] [FATAL] [MAIN ] VLTO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:11:22.522325] [WARN ] [MAIN ] VLTO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:11:22.522393] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-17T07:11:22.522491] [DEBUG] [LOCAL ] VLTO: No primary data file found to delete. [2025-09-17T07:11:22.522605] [INFO ] [LOCAL ] VLTO: Starting deletion of derivative data. [2025-09-17T07:11:22.522982] [DEBUG] [LOCAL ] VLTO: Deleted derivative data file. [2025-09-17T07:11:22.532478] [INFO ] [MAIN ] Update Progress: 2237/2369 symbols completed. VLTO took 35.9s. Estimated remaining: 19m 19s. Rate: 6.8 symbols/min [2025-09-17T07:11:22.537822] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T07:11:23.090113] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-17T07:11:23.338240] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T07:11:23.890158] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-09-17T07:11:24.641633] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T07:11:24.690159] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-17T07:11:24.992591] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T07:11:25.490199] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-17T07:11:26.290261] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-17T07:11:26.483045] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T07:11:26.513344] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T07:11:27.090152] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-17T07:11:27.502553] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T07:11:27.890133] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-17T07:11:27.962330] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T07:11:28.690119] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-17T07:11:28.958440] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T07:11:29.490185] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-17T07:11:29.632259] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T07:11:30.290203] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-17T07:11:30.516526] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T07:11:31.090131] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-17T07:11:31.836500] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T07:11:31.878030] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T07:11:31.890082] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-17T07:11:32.690139] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-17T07:11:32.832629] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T07:11:33.490152] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-17T07:11:33.761957] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T07:11:34.290162] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-17T07:11:34.473521] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T07:11:34.480456] [INFO ] [REMOTE ] VMI: Full fetch complete (21130 records). [2025-09-17T07:11:34.480633] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-17T07:11:34.858685] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-17T07:11:34.858788] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-17T07:11:34.859240] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-17T07:11:34.859290] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-17T07:11:34.859947] [DEBUG] [LOCAL ] VMI: Trimmed 21130 records to 15524 (keeping 200 days of data) [2025-09-17T07:11:34.958106] [DEBUG] [LOCAL ] VMI: Primary data saved (15524 records). [2025-09-17T07:11:34.958285] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-17T07:11:34.958403] [INFO ] [MAIN ] Update Progress: 2238/2369 symbols completed. VMI took 26.7s. Estimated remaining: 19m 10s. Rate: 6.8 symbols/min [2025-09-17T07:11:35.090229] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-17T07:11:35.984605] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T07:11:35.995041] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-17T07:11:36.188396] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T07:11:36.690136] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-17T07:11:37.536185] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T07:11:37.545589] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-17T07:11:37.616435] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T07:11:38.290237] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-17T07:11:38.939366] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T07:11:39.090150] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-17T07:11:39.219470] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T07:11:39.890159] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-17T07:11:40.645730] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T07:11:40.690134] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-17T07:11:41.036693] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T07:11:41.041156] [INFO ] [REMOTE ] VMO: Full fetch complete (31441 records). [2025-09-17T07:11:41.041359] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-17T07:11:41.431808] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-17T07:11:41.431933] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-17T07:11:41.432816] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-17T07:11:41.432885] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-17T07:11:41.434132] [DEBUG] [LOCAL ] VMO: Trimmed 31441 records to 20891 (keeping 200 days of data) [2025-09-17T07:11:41.567155] [DEBUG] [LOCAL ] VMO: Primary data saved (20891 records). [2025-09-17T07:11:41.567332] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-17T07:11:41.567457] [INFO ] [MAIN ] Update Progress: 2239/2369 symbols completed. VMO took 24.7s. Estimated remaining: 19m 1s. Rate: 6.8 symbols/min [2025-09-17T07:11:41.917268] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T07:11:41.922185] [INFO ] [REMOTE ] VMC: Full fetch complete (62428 records). [2025-09-17T07:11:41.922318] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-17T07:11:42.319334] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-17T07:11:42.319455] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-17T07:11:42.320592] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-17T07:11:42.320705] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-17T07:11:42.322213] [DEBUG] [LOCAL ] VMC: Trimmed 62428 records to 44136 (keeping 200 days of data) [2025-09-17T07:11:42.602912] [DEBUG] [LOCAL ] VMC: Primary data saved (44136 records). [2025-09-17T07:11:42.603111] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-17T07:11:42.603260] [INFO ] [MAIN ] Update Progress: 2240/2369 symbols completed. VMC took 36.8s. Estimated remaining: 18m 52s. Rate: 6.8 symbols/min [2025-09-17T07:11:43.301938] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:11:43.349027] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:11:43.331427] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:11:43.302696] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:11:43.359668] [DEBUG] [LOCAL ] VNCE: Loaded 4887 existing records from primary storage. [2025-09-17T07:11:43.359846] [INFO ] [MAIN ] VNCE: Loaded 4887 existing records. [2025-09-17T07:11:43.432958] [DEBUG] [LOCAL ] VOC: Loaded 6945 existing records from primary storage. [2025-09-17T07:11:43.480129] [INFO ] [MAIN ] VOC: Loaded 6945 existing records. [2025-09-17T07:11:43.670929] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:11:43.677288] [DEBUG] [LOCAL ] VNT: Loaded 32549 existing records from primary storage. [2025-09-17T07:11:43.708114] [INFO ] [MAIN ] VNT: Loaded 32549 existing records. [2025-09-17T07:11:43.708217] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-17T07:11:43.748050] [DEBUG] [LOCAL ] VNO: Loaded 36612 existing records from primary storage. [2025-09-17T07:11:43.758530] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-17T07:11:43.805952] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-17T07:11:43.785250] [INFO ] [MAIN ] VNO: Loaded 36612 existing records. [2025-09-17T07:11:43.905817] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:11:43.936224] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-17T07:11:43.989192] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-17T07:11:44.004709] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-17T07:11:44.161062] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-17T07:11:44.195421] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-17T07:11:44.236074] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:11:44.334827] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-17T07:11:44.360870] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-17T07:11:44.437967] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:11:44.438041] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-17T07:11:44.462301] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-17T07:11:44.476275] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-17T07:11:44.503415] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-17T07:11:44.567825] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-17T07:11:44.611935] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-17T07:11:44.896561] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:11:44.950218] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-11. [2025-09-17T07:11:45.522194] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:11:45.577363] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-11. [2025-09-17T07:11:45.609540] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:11:45.610804] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-11. [2025-09-17T07:11:45.691889] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:11:45.692215] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-11. [2025-09-17T07:11:45.758436] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T07:11:45.759662] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-09-17T07:11:46.206923] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T07:11:46.209146] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-09-17T07:11:46.808320] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T07:11:46.812853] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-09-17T07:11:47.014108] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T07:11:47.090209] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-09-17T07:11:47.211089] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T07:11:47.265473] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T07:11:47.890184] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-09-17T07:11:47.957256] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T07:11:48.121797] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T07:11:48.690175] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-09-17T07:11:49.490144] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-17T07:11:49.698632] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T07:11:50.183913] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T07:11:50.198542] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T07:11:50.290087] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-17T07:11:51.090130] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-17T07:11:51.698482] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T07:11:51.890376] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-09-17T07:11:51.892360] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T07:11:52.690143] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-17T07:11:53.446057] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T07:11:53.495211] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-17T07:11:53.518285] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T07:11:54.290170] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-17T07:11:54.869267] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T07:11:54.922328] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T07:11:55.090143] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-17T07:11:55.890164] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-17T07:11:55.900016] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T07:11:56.470180] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T07:11:56.690189] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-17T07:11:57.490221] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-17T07:11:58.230475] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T07:11:58.277578] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T07:11:58.290082] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-17T07:11:59.090151] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-17T07:11:59.748267] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T07:11:59.890137] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-17T07:12:00.150266] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T07:12:00.690134] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-17T07:12:01.492897] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-17T07:12:01.499002] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T07:12:01.631228] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T07:12:02.290147] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-17T07:12:03.090146] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-17T07:12:03.890134] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-17T07:12:04.562929] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (3.07 seconds). [2025-09-17T07:12:04.614049] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T07:12:04.640236] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-17T07:12:04.690099] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-17T07:12:04.760618] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T07:12:05.490132] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-17T07:12:06.124417] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T07:12:06.193597] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T07:12:06.290124] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-17T07:12:06.783261] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T07:12:07.090125] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-17T07:12:07.890130] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-17T07:12:08.690117] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-17T07:12:08.738373] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T07:12:08.836149] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T07:12:08.838855] [INFO ] [REMOTE ] VNCE: Full fetch complete (13936 records). [2025-09-17T07:12:08.838967] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-17T07:12:09.203180] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-17T07:12:09.203295] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-17T07:12:09.203634] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-17T07:12:09.203745] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-17T07:12:09.204248] [DEBUG] [LOCAL ] VNCE: Trimmed 13936 records to 6051 (keeping 200 days of data) [2025-09-17T07:12:09.242562] [DEBUG] [LOCAL ] VNCE: Primary data saved (6051 records). [2025-09-17T07:12:09.242759] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-17T07:12:09.242928] [INFO ] [MAIN ] Update Progress: 2241/2369 symbols completed. VNCE took 26.6s. Estimated remaining: 18m 44s. Rate: 6.8 symbols/min [2025-09-17T07:12:09.412764] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:12:09.447800] [DEBUG] [LOCAL ] VOYA: Loaded 31278 existing records from primary storage. [2025-09-17T07:12:09.447970] [INFO ] [MAIN ] VOYA: Loaded 31278 existing records. [2025-09-17T07:12:09.495244] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-17T07:12:09.630581] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:12:09.630852] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-17T07:12:09.630922] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-17T07:12:09.631554] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-17T07:12:09.631622] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-17T07:12:09.994796] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:12:10.224419] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T07:12:10.290122] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-17T07:12:11.061938] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T07:12:11.090090] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-17T07:12:11.224562] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T07:12:11.229978] [INFO ] [REMOTE ] VNT: Full fetch complete (63423 records). [2025-09-17T07:12:11.230153] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-17T07:12:11.621760] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-17T07:12:11.621882] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-17T07:12:11.623039] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-17T07:12:11.623113] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-17T07:12:11.624530] [DEBUG] [LOCAL ] VNT: Trimmed 63423 records to 44405 (keeping 200 days of data) [2025-09-17T07:12:11.895435] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-11. [2025-09-17T07:12:11.911849] [DEBUG] [LOCAL ] VNT: Primary data saved (44405 records). [2025-09-17T07:12:11.912033] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-17T07:12:11.912229] [INFO ] [MAIN ] Update Progress: 2242/2369 symbols completed. VNT took 29.3s. Estimated remaining: 18m 35s. Rate: 6.8 symbols/min [2025-09-17T07:12:12.086714] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:12:12.086954] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-17T07:12:12.087010] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-17T07:12:12.087126] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-17T07:12:12.087188] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-17T07:12:12.087239] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-17T07:12:12.087281] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-17T07:12:12.460775] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:12:12.547763] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T07:12:12.690136] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-17T07:12:13.357779] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T07:12:13.490189] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-17T07:12:13.566744] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T07:12:14.290388] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-11. [2025-09-17T07:12:14.493422] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:12:14.493802] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-11 [2025-09-17T07:12:15.090172] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-09-17T07:12:15.259324] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T07:12:15.890203] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-17T07:12:16.088153] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:12:16.088513] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-17T07:12:16.637571] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T07:12:16.690080] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-09-17T07:12:17.490259] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-17T07:12:17.843943] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T07:12:18.270633] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T07:12:18.290082] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-17T07:12:19.046234] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T07:12:19.047801] [INFO ] [REMOTE ] VOC: Full fetch complete (13184 records). [2025-09-17T07:12:19.047899] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-17T07:12:19.100241] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-17T07:12:19.417214] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-17T07:12:19.417346] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-17T07:12:19.417726] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-17T07:12:19.417803] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-17T07:12:19.418407] [DEBUG] [LOCAL ] VOC: Trimmed 13184 records to 8980 (keeping 200 days of data) [2025-09-17T07:12:19.473156] [DEBUG] [LOCAL ] VOC: Primary data saved (8980 records). [2025-09-17T07:12:19.473304] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-17T07:12:19.473421] [INFO ] [MAIN ] Update Progress: 2243/2369 symbols completed. VOC took 36.8s. Estimated remaining: 18m 26s. Rate: 6.8 symbols/min [2025-09-17T07:12:19.642830] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:12:19.657144] [DEBUG] [LOCAL ] VPG: Loaded 12703 existing records from primary storage. [2025-09-17T07:12:19.657329] [INFO ] [MAIN ] VPG: Loaded 12703 existing records. [2025-09-17T07:12:19.835313] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:12:19.835563] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-17T07:12:19.835621] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-17T07:12:19.836089] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-17T07:12:19.836179] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-17T07:12:19.899160] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-09-17T07:12:20.200233] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:12:20.200391] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:12:20.201489] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-09-17T07:12:20.690117] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-17T07:12:20.724024] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T07:12:20.887423] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:12:20.887829] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-17T07:12:21.490203] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-17T07:12:22.290159] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-17T07:12:22.480775] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:12:22.481209] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-17T07:12:23.038865] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T07:12:23.090139] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-17T07:12:23.890191] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-17T07:12:24.690154] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-17T07:12:24.779286] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T07:12:24.894817] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:12:24.895194] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-17T07:12:25.490157] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-11. [2025-09-17T07:12:25.551183] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T07:12:26.290190] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-17T07:12:26.364309] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T07:12:27.090172] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-17T07:12:27.285222] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:12:27.285682] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-17T07:12:27.821346] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T07:12:27.827635] [INFO ] [REMOTE ] VNO: Full fetch complete (70256 records). [2025-09-17T07:12:27.827820] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-17T07:12:27.895232] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-09-17T07:12:28.218215] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-17T07:12:28.218345] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-17T07:12:28.219434] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-17T07:12:28.219514] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-17T07:12:28.221491] [DEBUG] [LOCAL ] VNO: Trimmed 70256 records to 48987 (keeping 200 days of data) [2025-09-17T07:12:28.526501] [DEBUG] [LOCAL ] VNO: Primary data saved (48987 records). [2025-09-17T07:12:28.526689] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-17T07:12:28.526799] [INFO ] [MAIN ] Update Progress: 2244/2369 symbols completed. VNO took 45.9s. Estimated remaining: 18m 17s. Rate: 6.8 symbols/min [2025-09-17T07:12:28.684933] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T07:12:28.698882] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-17T07:12:28.708761] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:12:28.720712] [DEBUG] [LOCAL ] VPV: Loaded 3663 existing records from primary storage. [2025-09-17T07:12:28.720862] [INFO ] [MAIN ] VPV: Loaded 3663 existing records. [2025-09-17T07:12:28.900481] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:12:28.900815] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-17T07:12:28.900878] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-17T07:12:28.901234] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-17T07:12:28.901299] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-17T07:12:29.272780] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:12:29.490197] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-09-17T07:12:30.190881] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T07:12:30.290165] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-17T07:12:30.368109] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T07:12:31.090127] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-11. [2025-09-17T07:12:31.510006] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T07:12:31.870117] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T07:12:31.890095] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-09-17T07:12:32.638708] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T07:12:32.690107] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-09-17T07:12:33.359414] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T07:12:33.490142] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-17T07:12:34.233596] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T07:12:34.290151] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-17T07:12:35.090178] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-17T07:12:35.772092] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T07:12:35.890192] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-17T07:12:35.975777] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T07:12:36.690174] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-17T07:12:37.407912] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T07:12:37.490159] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-17T07:12:38.122052] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T07:12:38.290140] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-17T07:12:38.501311] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T07:12:38.851798] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T07:12:39.090152] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-17T07:12:39.674106] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T07:12:39.890142] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-17T07:12:40.690204] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-17T07:12:40.781135] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T07:12:41.276379] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T07:12:41.490142] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-17T07:12:42.290201] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-17T07:12:43.090164] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-17T07:12:43.184314] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T07:12:43.391738] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T07:12:43.639272] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T07:12:43.890138] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-17T07:12:44.690120] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-17T07:12:45.096872] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T07:12:45.490150] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-17T07:12:46.116833] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T07:12:46.122450] [INFO ] [REMOTE ] VOYA: Full fetch complete (61867 records). [2025-09-17T07:12:46.122630] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-17T07:12:46.229690] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T07:12:46.290133] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-17T07:12:46.523436] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-17T07:12:46.523571] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-17T07:12:46.524619] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-17T07:12:46.524729] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-17T07:12:46.526124] [DEBUG] [LOCAL ] VOYA: Trimmed 61867 records to 43015 (keeping 200 days of data) [2025-09-17T07:12:46.797727] [DEBUG] [LOCAL ] VOYA: Primary data saved (43015 records). [2025-09-17T07:12:46.797874] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-17T07:12:46.797976] [INFO ] [MAIN ] Update Progress: 2245/2369 symbols completed. VOYA took 37.6s. Estimated remaining: 18m 9s. Rate: 6.8 symbols/min [2025-09-17T07:12:46.967791] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:12:46.993767] [DEBUG] [LOCAL ] VRE: Loaded 25937 existing records from primary storage. [2025-09-17T07:12:46.993926] [INFO ] [MAIN ] VRE: Loaded 25937 existing records. [2025-09-17T07:12:47.093692] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-17T07:12:47.176960] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:12:47.177205] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-17T07:12:47.177267] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-17T07:12:47.177966] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-17T07:12:47.178041] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-17T07:12:47.542486] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:12:47.554566] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T07:12:47.890133] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-17T07:12:48.690136] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-17T07:12:48.706951] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T07:12:48.711999] [INFO ] [REMOTE ] VOYG: Full fetch complete (22009 records). [2025-09-17T07:12:48.712091] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-17T07:12:48.895123] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 67 unique days, need 200 days [2025-09-17T07:12:48.895500] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:12:48.895555] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:12:48.895598] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-17T07:12:48.895702] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-17T07:12:48.895818] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-17T07:12:48.895884] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-17T07:12:48.895982] [INFO ] [MAIN ] Update Progress: 2246/2369 symbols completed. VOYG took 37.0s. Estimated remaining: 18m 0s. Rate: 6.8 symbols/min [2025-09-17T07:12:49.079530] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:12:49.080694] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T07:12:49.084689] [DEBUG] [LOCAL ] VRT: No existing data file found in primary storage. [2025-09-17T07:12:49.085195] [WARN ] [MAIN ] VRT: No existing data found, performing full refresh instead. [2025-09-17T07:12:49.085582] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-17T07:12:49.085638] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-17T07:12:49.085709] [DEBUG] [LOCAL ] VRT: No primary data file found to delete. [2025-09-17T07:12:49.085746] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-17T07:12:49.437756] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:12:49.490091] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-11. [2025-09-17T07:12:49.580285] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T07:12:49.581769] [INFO ] [REMOTE ] VPV: Full fetch complete (9506 records). [2025-09-17T07:12:49.581858] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-17T07:12:49.956258] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-17T07:12:49.956370] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-17T07:12:49.956635] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-17T07:12:49.956704] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-17T07:12:49.957171] [DEBUG] [LOCAL ] VPV: Trimmed 9506 records to 5391 (keeping 200 days of data) [2025-09-17T07:12:49.991523] [DEBUG] [LOCAL ] VPV: Primary data saved (5391 records). [2025-09-17T07:12:49.991680] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-17T07:12:49.991771] [INFO ] [MAIN ] Update Progress: 2247/2369 symbols completed. VPV took 21.5s. Estimated remaining: 17m 51s. Rate: 6.8 symbols/min [2025-09-17T07:12:50.162056] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:12:50.171389] [DEBUG] [LOCAL ] VRTS: Loaded 7362 existing records from primary storage. [2025-09-17T07:12:50.171524] [INFO ] [MAIN ] VRTS: Loaded 7362 existing records. [2025-09-17T07:12:50.295212] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-11. [2025-09-17T07:12:50.352491] [WARN ] [MAIN ] VRTS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:12:50.352790] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-17T07:12:50.352849] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-17T07:12:50.353153] [DEBUG] [LOCAL ] VRTS: Deleted primary data file. [2025-09-17T07:12:50.353215] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-17T07:12:50.710064] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:12:51.090138] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-11. [2025-09-17T07:12:51.676978] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T07:12:51.695587] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T07:12:51.726000] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-17T07:12:51.890155] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-17T07:12:52.690139] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-09-17T07:12:52.870352] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T07:12:53.303939] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T07:12:53.490137] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-09-17T07:12:54.290131] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-09-17T07:12:55.090122] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-17T07:12:55.478234] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T07:12:55.607100] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-17T07:12:55.890132] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-09-17T07:12:55.961458] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-17T07:12:56.690104] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-09-17T07:12:57.027223] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T07:12:57.490140] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-17T07:12:58.290157] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-17T07:12:58.661862] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T07:12:58.896063] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-17T07:12:59.090153] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-17T07:12:59.890133] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-17T07:13:00.690138] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-09-17T07:13:01.257233] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T07:13:01.324855] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T07:13:01.419968] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-17T07:13:01.490104] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-17T07:13:02.155506] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T07:13:02.290137] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-17T07:13:02.776922] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (4.49 seconds). [2025-09-17T07:13:02.779092] [INFO ] [REMOTE ] VPG: Full fetch complete (23204 records). [2025-09-17T07:13:02.779205] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-17T07:13:03.095293] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-17T07:13:03.173309] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-17T07:13:03.173415] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-17T07:13:03.174030] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-17T07:13:03.174115] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-17T07:13:03.174900] [DEBUG] [LOCAL ] VPG: Trimmed 23204 records to 17220 (keeping 200 days of data) [2025-09-17T07:13:03.284546] [DEBUG] [LOCAL ] VPG: Primary data saved (17220 records). [2025-09-17T07:13:03.284758] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-17T07:13:03.284853] [INFO ] [MAIN ] Update Progress: 2248/2369 symbols completed. VPG took 43.8s. Estimated remaining: 17m 42s. Rate: 6.8 symbols/min [2025-09-17T07:13:03.490163] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:13:03.529208] [DEBUG] [LOCAL ] VSCO: Loaded 39303 existing records from primary storage. [2025-09-17T07:13:03.529397] [INFO ] [MAIN ] VSCO: Loaded 39303 existing records. [2025-09-17T07:13:03.713736] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:13:03.713998] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-17T07:13:03.714059] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-17T07:13:03.714874] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-17T07:13:03.714942] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-17T07:13:03.898417] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-17T07:13:04.119759] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:13:04.125586] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T07:13:04.690145] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-11. [2025-09-17T07:13:04.773150] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T07:13:05.490137] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-17T07:13:05.529807] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.43 seconds). [2025-09-17T07:13:06.270730] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T07:13:06.290076] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-09-17T07:13:06.326690] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T07:13:07.090175] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-17T07:13:07.775635] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T07:13:07.890155] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-17T07:13:08.636900] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T07:13:08.690173] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-09-17T07:13:09.339397] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-17T07:13:09.490214] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-17T07:13:10.290170] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-17T07:13:10.392158] [DEBUG] [REMOTE ] VRTS: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-17T07:13:10.392587] [WARN ] [REMOTE ] VRTS: No data returned for month 2025-06 [2025-09-17T07:13:10.456602] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T07:13:10.817365] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T07:13:11.090152] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-17T07:13:11.890163] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-17T07:13:12.331324] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T07:13:12.690141] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-17T07:13:12.788518] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T07:13:13.490153] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-17T07:13:14.069124] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T07:13:14.290158] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-17T07:13:15.028759] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T07:13:15.090111] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-17T07:13:15.809344] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T07:13:15.890126] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-17T07:13:16.690183] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-17T07:13:17.150718] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T07:13:17.403032] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T07:13:17.408420] [INFO ] [REMOTE ] VRE: Full fetch complete (47505 records). [2025-09-17T07:13:17.408527] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-17T07:13:17.504741] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-17T07:13:17.679338] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T07:13:17.794479] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-17T07:13:17.794568] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-17T07:13:17.795441] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-17T07:13:17.795499] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-17T07:13:17.796519] [DEBUG] [LOCAL ] VRE: Trimmed 47505 records to 34620 (keeping 200 days of data) [2025-09-17T07:13:18.010425] [DEBUG] [LOCAL ] VRE: Primary data saved (34620 records). [2025-09-17T07:13:18.010820] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-17T07:13:18.010980] [INFO ] [MAIN ] Update Progress: 2249/2369 symbols completed. VRE took 31.2s. Estimated remaining: 17m 34s. Rate: 6.8 symbols/min [2025-09-17T07:13:18.179859] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:13:18.213745] [DEBUG] [LOCAL ] VSH: Loaded 35897 existing records from primary storage. [2025-09-17T07:13:18.213925] [INFO ] [MAIN ] VSH: Loaded 35897 existing records. [2025-09-17T07:13:18.295268] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-17T07:13:18.391197] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:13:18.391400] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-17T07:13:18.391457] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-17T07:13:18.392275] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-17T07:13:18.392339] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-17T07:13:18.748070] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:13:19.090106] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-17T07:13:19.308953] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T07:13:19.890188] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-11. [2025-09-17T07:13:19.922960] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T07:13:19.924438] [INFO ] [REMOTE ] VRTS: Full fetch complete (8830 records). [2025-09-17T07:13:19.924540] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-17T07:13:20.111106] [WARN ] [VALIDATOR ] VRTS: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T07:13:20.111857] [FATAL] [MAIN ] VRTS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:13:20.111926] [WARN ] [MAIN ] VRTS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:13:20.111991] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-17T07:13:20.112092] [DEBUG] [LOCAL ] VRTS: No primary data file found to delete. [2025-09-17T07:13:20.112154] [INFO ] [LOCAL ] VRTS: Starting deletion of derivative data. [2025-09-17T07:13:20.112908] [DEBUG] [LOCAL ] VRTS: Deleted derivative data file. [2025-09-17T07:13:20.113030] [INFO ] [MAIN ] Update Progress: 2250/2369 symbols completed. VRTS took 30.1s. Estimated remaining: 17m 25s. Rate: 6.8 symbols/min [2025-09-17T07:13:20.285615] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:13:20.285900] [DEBUG] [LOCAL ] VST: No existing data file found in primary storage. [2025-09-17T07:13:20.285953] [WARN ] [MAIN ] VST: No existing data found, performing full refresh instead. [2025-09-17T07:13:20.286069] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-17T07:13:20.286121] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-17T07:13:20.286173] [DEBUG] [LOCAL ] VST: No primary data file found to delete. [2025-09-17T07:13:20.286213] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-17T07:13:20.646132] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:13:20.690084] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-11. [2025-09-17T07:13:20.723632] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-17T07:13:21.195661] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T07:13:21.490187] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-09-17T07:13:22.290138] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-17T07:13:23.045395] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-11 (2.36 seconds). [2025-09-17T07:13:23.090082] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-09-17T07:13:23.174632] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T07:13:23.890193] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-17T07:13:24.300267] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T07:13:24.690207] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-17T07:13:24.921040] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T07:13:25.490110] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-09-17T07:13:25.737224] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T07:13:26.290192] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-17T07:13:27.090122] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-09-17T07:13:27.153792] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T07:13:27.530331] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.84 seconds). [2025-09-17T07:13:27.890132] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-17T07:13:28.122454] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T07:13:28.690152] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-17T07:13:29.490107] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-17T07:13:29.559899] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-17T07:13:29.600391] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T07:13:30.290129] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-17T07:13:31.022913] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-17T07:13:31.090100] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-17T07:13:31.394852] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T07:13:31.549195] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T07:13:31.890145] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-17T07:13:32.690174] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-17T07:13:33.364001] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-17T07:13:33.370772] [INFO ] [REMOTE ] VRT: Full fetch complete (77786 records). [2025-09-17T07:13:33.370935] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-17T07:13:33.495266] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-17T07:13:33.778124] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-17T07:13:33.778305] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-17T07:13:33.779605] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-17T07:13:33.779851] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-17T07:13:33.781565] [DEBUG] [LOCAL ] VRT: Trimmed 77786 records to 53753 (keeping 200 days of data) [2025-09-17T07:13:33.907919] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T07:13:34.177102] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-09-17T07:13:34.177301] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-17T07:13:34.177421] [INFO ] [MAIN ] Update Progress: 2251/2369 symbols completed. VRT took 45.3s. Estimated remaining: 17m 16s. Rate: 6.8 symbols/min [2025-09-17T07:13:34.297683] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-17T07:13:34.391475] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:13:34.396813] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T07:13:34.444676] [DEBUG] [LOCAL ] VSTS: Loaded 36350 existing records from primary storage. [2025-09-17T07:13:34.444871] [INFO ] [MAIN ] VSTS: Loaded 36350 existing records. [2025-09-17T07:13:34.620176] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:13:34.620449] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-17T07:13:34.620512] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-17T07:13:34.621324] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-17T07:13:34.621391] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-17T07:13:34.980441] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:13:35.090153] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-11. [2025-09-17T07:13:35.699348] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-17T07:13:35.890138] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-17T07:13:35.985799] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T07:13:36.695207] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-17T07:13:36.711246] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T07:13:37.490182] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-09-17T07:13:38.218338] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T07:13:38.290118] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-17T07:13:38.455117] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-17T07:13:39.090123] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-17T07:13:39.137583] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T07:13:39.890192] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-17T07:13:39.949972] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T07:13:40.690182] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-17T07:13:40.929904] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T07:13:40.936466] [INFO ] [REMOTE ] VSCO: Full fetch complete (76085 records). [2025-09-17T07:13:40.936678] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-17T07:13:41.337599] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-17T07:13:41.337731] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-17T07:13:41.339347] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-17T07:13:41.339408] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-17T07:13:41.340931] [DEBUG] [LOCAL ] VSCO: Trimmed 76085 records to 52905 (keeping 200 days of data) [2025-09-17T07:13:41.514057] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-09-17T07:13:41.658908] [DEBUG] [LOCAL ] VSCO: Primary data saved (52905 records). [2025-09-17T07:13:41.659092] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-17T07:13:41.659192] [INFO ] [MAIN ] Update Progress: 2252/2369 symbols completed. VSCO took 38.4s. Estimated remaining: 17m 7s. Rate: 6.8 symbols/min [2025-09-17T07:13:41.832510] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:13:41.862789] [DEBUG] [LOCAL ] VTEX: Loaded 32273 existing records from primary storage. [2025-09-17T07:13:41.862955] [INFO ] [MAIN ] VTEX: Loaded 32273 existing records. [2025-09-17T07:13:42.046008] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:13:42.046332] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-17T07:13:42.046397] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-17T07:13:42.047020] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-17T07:13:42.047081] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-17T07:13:42.409875] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:13:42.410510] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-11. [2025-09-17T07:13:42.462235] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T07:13:42.484991] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-17T07:13:42.571898] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T07:13:43.090159] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-17T07:13:43.739107] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T07:13:43.890140] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-09-17T07:13:44.690144] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-17T07:13:45.266018] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T07:13:45.490154] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-09-17T07:13:45.541597] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-17T07:13:46.164240] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T07:13:46.169849] [INFO ] [REMOTE ] VSH: Full fetch complete (71423 records). [2025-09-17T07:13:46.169990] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-17T07:13:46.295227] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-17T07:13:46.565406] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-17T07:13:46.565578] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-17T07:13:46.566914] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-17T07:13:46.567114] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-17T07:13:46.585296] [DEBUG] [LOCAL ] VSH: Trimmed 71423 records to 48836 (keeping 200 days of data) [2025-09-17T07:13:46.589517] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T07:13:46.908694] [DEBUG] [LOCAL ] VSH: Primary data saved (48836 records). [2025-09-17T07:13:46.908861] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-17T07:13:46.909004] [INFO ] [MAIN ] Update Progress: 2253/2369 symbols completed. VSH took 28.9s. Estimated remaining: 16m 58s. Rate: 6.8 symbols/min [2025-09-17T07:13:47.077147] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:13:47.095714] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-17T07:13:47.113873] [DEBUG] [LOCAL ] VTLE: Loaded 36084 existing records from primary storage. [2025-09-17T07:13:47.114025] [INFO ] [MAIN ] VTLE: Loaded 36084 existing records. [2025-09-17T07:13:47.296401] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:13:47.296813] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-17T07:13:47.296885] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-17T07:13:47.297807] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-17T07:13:47.297874] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-17T07:13:47.673176] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:13:47.890190] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-11. [2025-09-17T07:13:48.690849] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-17T07:13:48.693210] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T07:13:48.834163] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-17T07:13:49.455205] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T07:13:49.490188] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-17T07:13:50.147189] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T07:13:50.290185] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-17T07:13:51.013126] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T07:13:51.090180] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-17T07:13:51.890203] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-09-17T07:13:52.695253] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-17T07:13:52.715855] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-17T07:13:52.759984] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T07:13:53.056768] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T07:13:53.490144] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-17T07:13:54.298693] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-09-17T07:13:54.321846] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T07:13:55.090153] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-17T07:13:55.788175] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T07:13:55.845463] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T07:13:55.890088] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-17T07:13:56.212339] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T07:13:56.690174] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-17T07:13:57.434473] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T07:13:57.490107] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-17T07:13:58.290130] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-17T07:13:58.687014] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-17T07:13:58.693865] [INFO ] [REMOTE ] VST: Full fetch complete (77733 records). [2025-09-17T07:13:58.694026] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-17T07:13:59.089128] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-17T07:13:59.089309] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-17T07:13:59.090532] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-17T07:13:59.090727] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-17T07:13:59.091001] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-17T07:13:59.115940] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T07:13:59.124460] [DEBUG] [LOCAL ] VST: Trimmed 77733 records to 53723 (keeping 200 days of data) [2025-09-17T07:13:59.484814] [DEBUG] [LOCAL ] VST: Primary data saved (53723 records). [2025-09-17T07:13:59.485117] [INFO ] [MAIN ] VST: Full history saved. [2025-09-17T07:13:59.485270] [INFO ] [MAIN ] Update Progress: 2254/2369 symbols completed. VST took 39.4s. Estimated remaining: 16m 50s. Rate: 6.8 symbols/min [2025-09-17T07:13:59.661778] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:13:59.675754] [DEBUG] [LOCAL ] VTMX: Loaded 13067 existing records from primary storage. [2025-09-17T07:13:59.675918] [INFO ] [MAIN ] VTMX: Loaded 13067 existing records. [2025-09-17T07:13:59.851497] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:13:59.851764] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-17T07:13:59.851825] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-17T07:13:59.852208] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-17T07:13:59.852270] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-17T07:13:59.914287] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-17T07:14:00.235472] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:14:00.264244] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T07:14:00.678034] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T07:14:00.690072] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-17T07:14:01.490179] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-17T07:14:01.595431] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T07:14:02.027805] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T07:14:02.290203] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-11. [2025-09-17T07:14:02.793953] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T07:14:02.913892] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T07:14:03.090124] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-17T07:14:03.890138] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-17T07:14:04.658973] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T07:14:04.690076] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-17T07:14:05.511511] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-09-17T07:14:05.531628] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T07:14:06.290139] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-17T07:14:06.361513] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T07:14:06.566382] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T07:14:07.090179] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-17T07:14:07.678883] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T07:14:07.702603] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T07:14:07.890179] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-17T07:14:08.690224] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-17T07:14:08.927507] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T07:14:09.490147] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-17T07:14:10.290140] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-17T07:14:10.349806] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T07:14:10.444795] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T07:14:11.090143] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-17T07:14:11.699766] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T07:14:11.707387] [INFO ] [REMOTE ] VTEX: Full fetch complete (60389 records). [2025-09-17T07:14:11.707634] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-17T07:14:11.899346] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-17T07:14:12.123901] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-17T07:14:12.124032] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-17T07:14:12.125082] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-17T07:14:12.125156] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-17T07:14:12.126535] [DEBUG] [LOCAL ] VTEX: Trimmed 60389 records to 43460 (keeping 200 days of data) [2025-09-17T07:14:12.370361] [DEBUG] [LOCAL ] VTEX: Primary data saved (43460 records). [2025-09-17T07:14:12.370519] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-17T07:14:12.370616] [INFO ] [MAIN ] Update Progress: 2255/2369 symbols completed. VTEX took 30.7s. Estimated remaining: 16m 41s. Rate: 6.8 symbols/min [2025-09-17T07:14:12.544013] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:14:12.551251] [DEBUG] [LOCAL ] VTN: Loaded 5082 existing records from primary storage. [2025-09-17T07:14:12.551405] [INFO ] [MAIN ] VTN: Loaded 5082 existing records. [2025-09-17T07:14:12.706918] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-17T07:14:12.738785] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:14:12.740324] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-17T07:14:12.740432] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-17T07:14:12.740845] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-17T07:14:12.741001] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-17T07:14:13.125057] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T07:14:13.135734] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:14:13.490174] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-17T07:14:13.536132] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T07:14:13.704182] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T07:14:14.290137] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-17T07:14:14.888526] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T07:14:14.894949] [INFO ] [REMOTE ] VSTS: Full fetch complete (69752 records). [2025-09-17T07:14:14.895150] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-17T07:14:15.095263] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-17T07:14:15.316137] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-17T07:14:15.316245] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-17T07:14:15.317443] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-17T07:14:15.317517] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-17T07:14:15.319037] [DEBUG] [LOCAL ] VSTS: Trimmed 69752 records to 48963 (keeping 200 days of data) [2025-09-17T07:14:15.610670] [DEBUG] [LOCAL ] VSTS: Primary data saved (48963 records). [2025-09-17T07:14:15.610873] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-17T07:14:15.611019] [INFO ] [MAIN ] Update Progress: 2256/2369 symbols completed. VSTS took 41.4s. Estimated remaining: 16m 32s. Rate: 6.8 symbols/min [2025-09-17T07:14:15.786880] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:14:15.821938] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T07:14:15.837898] [DEBUG] [LOCAL ] VTOL: Loaded 14677 existing records from primary storage. [2025-09-17T07:14:15.838042] [INFO ] [MAIN ] VTOL: Loaded 14677 existing records. [2025-09-17T07:14:15.901986] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-17T07:14:16.018548] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:14:16.018827] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-17T07:14:16.018920] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-17T07:14:16.019357] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-17T07:14:16.019429] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-17T07:14:16.371507] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:14:16.384030] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T07:14:16.690147] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-11. [2025-09-17T07:14:17.165064] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T07:14:17.490270] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-17T07:14:17.525188] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T07:14:17.530850] [INFO ] [REMOTE ] VTLE: Full fetch complete (68463 records). [2025-09-17T07:14:17.531021] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-17T07:14:17.917444] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-17T07:14:17.917618] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-17T07:14:17.919068] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-17T07:14:17.919127] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-17T07:14:17.922119] [DEBUG] [LOCAL ] VTLE: Trimmed 68463 records to 48752 (keeping 200 days of data) [2025-09-17T07:14:18.213289] [DEBUG] [LOCAL ] VTLE: Primary data saved (48752 records). [2025-09-17T07:14:18.213441] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-17T07:14:18.213576] [INFO ] [MAIN ] Update Progress: 2257/2369 symbols completed. VTLE took 31.3s. Estimated remaining: 16m 23s. Rate: 6.8 symbols/min [2025-09-17T07:14:18.295367] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-11. [2025-09-17T07:14:18.384014] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:14:18.420560] [DEBUG] [LOCAL ] VTR: Loaded 39315 existing records from primary storage. [2025-09-17T07:14:18.420732] [INFO ] [MAIN ] VTR: Loaded 39315 existing records. [2025-09-17T07:14:18.597661] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:14:18.609237] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-17T07:14:18.609671] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T07:14:18.609800] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-17T07:14:18.614740] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-17T07:14:18.614813] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-17T07:14:18.970488] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:14:19.017138] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T07:14:19.090083] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-11. [2025-09-17T07:14:19.890210] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-09-17T07:14:20.690167] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-17T07:14:20.816290] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T07:14:20.860432] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T07:14:21.490184] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-09-17T07:14:21.770540] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T07:14:22.290149] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-09-17T07:14:23.090111] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-09-17T07:14:23.176400] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T07:14:23.233011] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T07:14:23.871200] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T07:14:23.890078] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-17T07:14:24.411636] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T07:14:24.690193] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-17T07:14:25.490157] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-09-17T07:14:25.513547] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T07:14:26.290155] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-17T07:14:26.300129] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T07:14:26.938991] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T07:14:27.090139] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-17T07:14:27.890127] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-17T07:14:28.088494] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T07:14:28.432783] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T07:14:28.434753] [INFO ] [REMOTE ] VTMX: Full fetch complete (26123 records). [2025-09-17T07:14:28.434884] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-17T07:14:28.695277] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-09-17T07:14:28.803009] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-17T07:14:28.803114] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-17T07:14:28.803786] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-17T07:14:28.803877] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-17T07:14:28.805072] [DEBUG] [LOCAL ] VTMX: Trimmed 26123 records to 17366 (keeping 200 days of data) [2025-09-17T07:14:28.924460] [DEBUG] [LOCAL ] VTMX: Primary data saved (17366 records). [2025-09-17T07:14:28.924691] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-17T07:14:28.924874] [INFO ] [MAIN ] Update Progress: 2258/2369 symbols completed. VTMX took 29.4s. Estimated remaining: 16m 14s. Rate: 6.8 symbols/min [2025-09-17T07:14:29.092494] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:14:29.114109] [DEBUG] [LOCAL ] VTS: Loaded 21848 existing records from primary storage. [2025-09-17T07:14:29.114283] [INFO ] [MAIN ] VTS: Loaded 21848 existing records. [2025-09-17T07:14:29.289096] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:14:29.289401] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-17T07:14:29.289502] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-17T07:14:29.290155] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-17T07:14:29.290232] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-17T07:14:29.496104] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-17T07:14:29.648056] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:14:30.290180] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-17T07:14:30.489425] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T07:14:30.572249] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T07:14:30.681412] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-17T07:14:31.090147] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-17T07:14:31.890092] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-11. [2025-09-17T07:14:32.217179] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T07:14:32.690139] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-17T07:14:32.975834] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T07:14:33.490179] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-17T07:14:33.720739] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T07:14:33.898143] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-17T07:14:34.290137] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-17T07:14:34.983426] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T07:14:35.090124] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-17T07:14:35.890190] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-17T07:14:36.019888] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T07:14:36.690161] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-09-17T07:14:37.401353] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T07:14:37.428467] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T07:14:37.490166] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-17T07:14:38.216770] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T07:14:38.290104] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-17T07:14:39.090126] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-17T07:14:39.807824] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T07:14:39.890123] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-09-17T07:14:40.046140] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T07:14:40.690154] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-17T07:14:40.971942] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T07:14:41.490152] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-17T07:14:42.230917] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T07:14:42.233024] [INFO ] [REMOTE ] VTN: Full fetch complete (11615 records). [2025-09-17T07:14:42.233121] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-17T07:14:42.296114] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-17T07:14:42.613959] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-17T07:14:42.614112] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-17T07:14:42.614462] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-17T07:14:42.614533] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-17T07:14:42.615630] [DEBUG] [LOCAL ] VTN: Trimmed 11615 records to 7161 (keeping 200 days of data) [2025-09-17T07:14:42.685830] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T07:14:42.709577] [DEBUG] [LOCAL ] VTN: Primary data saved (7161 records). [2025-09-17T07:14:42.709793] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-17T07:14:42.709920] [INFO ] [MAIN ] Update Progress: 2259/2369 symbols completed. VTN took 30.3s. Estimated remaining: 16m 6s. Rate: 6.8 symbols/min [2025-09-17T07:14:42.880324] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:14:42.902268] [DEBUG] [LOCAL ] VVR: Loaded 21685 existing records from primary storage. [2025-09-17T07:14:42.902429] [INFO ] [MAIN ] VVR: Loaded 21685 existing records. [2025-09-17T07:14:43.080479] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:14:43.080787] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-17T07:14:43.080859] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-17T07:14:43.081428] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-17T07:14:43.081503] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-17T07:14:43.095286] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-17T07:14:43.464578] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:14:43.478909] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T07:14:43.890154] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-11. [2025-09-17T07:14:44.221340] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T07:14:44.690141] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-17T07:14:45.209392] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T07:14:45.490232] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-17T07:14:45.698353] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T07:14:46.290137] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-17T07:14:47.090219] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-17T07:14:47.246710] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T07:14:47.693254] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T07:14:47.890146] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-09-17T07:14:48.022578] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T07:14:48.025192] [INFO ] [REMOTE ] VTOL: Full fetch complete (25977 records). [2025-09-17T07:14:48.025319] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-17T07:14:48.394471] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-17T07:14:48.394574] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-17T07:14:48.395172] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-17T07:14:48.395240] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-17T07:14:48.396102] [DEBUG] [LOCAL ] VTOL: Trimmed 25977 records to 19916 (keeping 200 days of data) [2025-09-17T07:14:48.515894] [DEBUG] [LOCAL ] VTOL: Primary data saved (19916 records). [2025-09-17T07:14:48.516048] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-17T07:14:48.516152] [INFO ] [MAIN ] Update Progress: 2260/2369 symbols completed. VTOL took 32.9s. Estimated remaining: 15m 57s. Rate: 6.8 symbols/min [2025-09-17T07:14:48.685610] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:14:48.690104] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-17T07:14:48.730093] [DEBUG] [LOCAL ] VVV: Loaded 37484 existing records from primary storage. [2025-09-17T07:14:48.730258] [INFO ] [MAIN ] VVV: Loaded 37484 existing records. [2025-09-17T07:14:48.910255] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:14:48.910524] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-17T07:14:48.910583] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-17T07:14:48.911374] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-17T07:14:48.911434] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-17T07:14:49.265799] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:14:49.284113] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T07:14:49.490118] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-11. [2025-09-17T07:14:49.689944] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T07:14:50.290141] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-17T07:14:51.079247] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T07:14:51.090085] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-17T07:14:51.561164] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T07:14:51.890147] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-17T07:14:52.690164] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-17T07:14:52.777237] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T07:14:52.838018] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T07:14:53.490141] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-17T07:14:54.057802] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T07:14:54.290169] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-09-17T07:14:54.777598] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T07:14:55.090134] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-17T07:14:55.889615] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T07:14:55.898938] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-17T07:14:56.690130] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-17T07:14:56.902479] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T07:14:57.208002] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T07:14:57.490182] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-17T07:14:58.214540] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T07:14:58.290103] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-17T07:14:59.090101] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-17T07:14:59.178571] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T07:14:59.883689] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T07:14:59.892708] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-17T07:15:00.492745] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T07:15:00.690174] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-17T07:15:01.490246] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-17T07:15:01.884721] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-17T07:15:01.894137] [INFO ] [REMOTE ] VTR: Full fetch complete (76130 records). [2025-09-17T07:15:01.894385] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-17T07:15:02.298591] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-17T07:15:02.318621] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-17T07:15:02.318757] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-17T07:15:02.320289] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-17T07:15:02.320566] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-17T07:15:02.343162] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T07:15:02.350461] [DEBUG] [LOCAL ] VTR: Trimmed 76130 records to 52829 (keeping 200 days of data) [2025-09-17T07:15:02.691682] [DEBUG] [LOCAL ] VTR: Primary data saved (52829 records). [2025-09-17T07:15:02.691876] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-17T07:15:02.692178] [INFO ] [MAIN ] Update Progress: 2261/2369 symbols completed. VTR took 44.5s. Estimated remaining: 15m 48s. Rate: 6.8 symbols/min [2025-09-17T07:15:02.903654] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:15:02.921505] [DEBUG] [LOCAL ] VVX: Loaded 17316 existing records from primary storage. [2025-09-17T07:15:02.921672] [INFO ] [MAIN ] VVX: Loaded 17316 existing records. [2025-09-17T07:15:03.095417] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-17T07:15:03.106353] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:15:03.107413] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-17T07:15:03.107543] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-17T07:15:03.108131] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-17T07:15:03.108234] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-17T07:15:03.494447] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:15:03.890131] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-11. [2025-09-17T07:15:04.874107] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (3.38 seconds). [2025-09-17T07:15:04.884828] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-17T07:15:04.932823] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T07:15:05.490210] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-17T07:15:06.057598] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-17T07:15:06.139264] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (3.84 seconds). [2025-09-17T07:15:06.247367] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T07:15:06.290151] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-09-17T07:15:06.861921] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T07:15:07.090136] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-17T07:15:07.467723] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T07:15:07.890145] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-17T07:15:08.690119] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-09-17T07:15:08.747420] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T07:15:09.207674] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T07:15:09.211820] [INFO ] [REMOTE ] VTS: Full fetch complete (40102 records). [2025-09-17T07:15:09.211917] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-17T07:15:09.497119] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-17T07:15:09.589000] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-17T07:15:09.589100] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-17T07:15:09.589933] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-17T07:15:09.589991] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-17T07:15:09.590892] [DEBUG] [LOCAL ] VTS: Trimmed 40102 records to 30206 (keeping 200 days of data) [2025-09-17T07:15:09.780395] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T07:15:09.797653] [DEBUG] [LOCAL ] VTS: Primary data saved (30206 records). [2025-09-17T07:15:09.803471] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-17T07:15:09.804128] [INFO ] [MAIN ] Update Progress: 2262/2369 symbols completed. VTS took 40.9s. Estimated remaining: 15m 40s. Rate: 6.8 symbols/min [2025-09-17T07:15:09.971885] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:15:10.007573] [DEBUG] [LOCAL ] VYX: Loaded 36254 existing records from primary storage. [2025-09-17T07:15:10.007754] [INFO ] [MAIN ] VYX: Loaded 36254 existing records. [2025-09-17T07:15:10.183931] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:15:10.184165] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-17T07:15:10.184220] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-17T07:15:10.185070] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-17T07:15:10.185135] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-17T07:15:10.295221] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-17T07:15:10.541875] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:15:10.816986] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T07:15:11.090178] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-17T07:15:11.890129] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-17T07:15:12.007529] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T07:15:12.387768] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T07:15:12.661398] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T07:15:12.690093] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-17T07:15:13.490194] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-11. [2025-09-17T07:15:13.862514] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T07:15:14.290155] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-17T07:15:14.787227] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T07:15:15.090152] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-17T07:15:15.890175] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-17T07:15:16.695215] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-09-17T07:15:16.716065] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-17T07:15:17.030418] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T07:15:17.035087] [INFO ] [REMOTE ] VVR: Full fetch complete (45689 records). [2025-09-17T07:15:17.035237] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-17T07:15:17.425087] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-17T07:15:17.425206] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-17T07:15:17.426172] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-17T07:15:17.426238] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-17T07:15:17.427549] [DEBUG] [LOCAL ] VVR: Trimmed 45689 records to 30198 (keeping 200 days of data) [2025-09-17T07:15:17.490684] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-17T07:15:17.608891] [DEBUG] [LOCAL ] VVR: Primary data saved (30198 records). [2025-09-17T07:15:17.609049] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-17T07:15:17.609157] [INFO ] [MAIN ] Update Progress: 2263/2369 symbols completed. VVR took 34.9s. Estimated remaining: 15m 31s. Rate: 6.8 symbols/min [2025-09-17T07:15:17.790743] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:15:17.790962] [DEBUG] [LOCAL ] VZ: No existing data file found in primary storage. [2025-09-17T07:15:17.791012] [WARN ] [MAIN ] VZ: No existing data found, performing full refresh instead. [2025-09-17T07:15:17.791124] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-17T07:15:17.791175] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-17T07:15:17.791221] [DEBUG] [LOCAL ] VZ: No primary data file found to delete. [2025-09-17T07:15:17.791266] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-17T07:15:18.150668] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:15:18.165003] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-17T07:15:18.290129] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-11. [2025-09-17T07:15:18.498383] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T07:15:19.090121] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-17T07:15:19.121408] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T07:15:19.893192] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-17T07:15:19.896365] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T07:15:20.194837] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T07:15:20.690145] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-17T07:15:21.439843] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T07:15:21.445746] [INFO ] [REMOTE ] VVV: Full fetch complete (72047 records). [2025-09-17T07:15:21.445885] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-17T07:15:21.500725] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-09-17T07:15:21.844889] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-17T07:15:21.845174] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-17T07:15:21.858252] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-17T07:15:21.858716] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T07:15:21.863201] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-17T07:15:21.865019] [DEBUG] [LOCAL ] VVV: Trimmed 72047 records to 50151 (keeping 200 days of data) [2025-09-17T07:15:22.172470] [DEBUG] [LOCAL ] VVV: Primary data saved (50151 records). [2025-09-17T07:15:22.172632] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-17T07:15:22.172737] [INFO ] [MAIN ] Update Progress: 2264/2369 symbols completed. VVV took 33.7s. Estimated remaining: 15m 22s. Rate: 6.8 symbols/min [2025-09-17T07:15:22.295319] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-17T07:15:22.351091] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:15:22.392983] [DEBUG] [LOCAL ] W: Loaded 39909 existing records from primary storage. [2025-09-17T07:15:22.393168] [INFO ] [MAIN ] W: Loaded 39909 existing records. [2025-09-17T07:15:22.569415] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:15:22.569719] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-17T07:15:22.569791] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-17T07:15:22.570794] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-17T07:15:22.570873] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-17T07:15:22.929494] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:15:23.090104] [INFO ] [REMOTE ] W: Fetching primary data for 2024-11. [2025-09-17T07:15:23.402522] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T07:15:23.868424] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.37 seconds). [2025-09-17T07:15:23.890083] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-09-17T07:15:24.690160] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-17T07:15:25.114669] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T07:15:25.490191] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-09-17T07:15:25.737269] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T07:15:26.241808] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-17T07:15:26.290172] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-17T07:15:27.090228] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-17T07:15:27.445221] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T07:15:27.544259] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T07:15:27.549628] [INFO ] [REMOTE ] VVX: Full fetch complete (33206 records). [2025-09-17T07:15:27.549818] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-17T07:15:27.896629] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-09-17T07:15:27.949325] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-17T07:15:27.949431] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-17T07:15:27.950139] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-17T07:15:27.950201] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-17T07:15:27.951144] [DEBUG] [LOCAL ] VVX: Trimmed 33206 records to 23239 (keeping 200 days of data) [2025-09-17T07:15:28.089817] [DEBUG] [LOCAL ] VVX: Primary data saved (23239 records). [2025-09-17T07:15:28.089982] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-17T07:15:28.090083] [INFO ] [MAIN ] Update Progress: 2265/2369 symbols completed. VVX took 25.4s. Estimated remaining: 15m 13s. Rate: 6.8 symbols/min [2025-09-17T07:15:28.265226] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:15:28.300441] [DEBUG] [LOCAL ] WAB: Loaded 32519 existing records from primary storage. [2025-09-17T07:15:28.300620] [INFO ] [MAIN ] WAB: Loaded 32519 existing records. [2025-09-17T07:15:28.481005] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:15:28.481256] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-17T07:15:28.481314] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-17T07:15:28.482080] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-17T07:15:28.482141] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-17T07:15:28.703278] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-09-17T07:15:28.840130] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:15:29.003422] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-17T07:15:29.490100] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-11. [2025-09-17T07:15:29.780668] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T07:15:29.867895] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T07:15:30.290143] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-17T07:15:31.090114] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-17T07:15:31.298353] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T07:15:31.890220] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-17T07:15:32.681692] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-17T07:15:32.692723] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-09-17T07:15:32.842669] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T07:15:33.001563] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T07:15:33.490177] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-17T07:15:34.290178] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-17T07:15:34.415914] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T07:15:34.983388] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T07:15:35.090117] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-09-17T07:15:35.890119] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-17T07:15:35.932760] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T07:15:36.677506] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T07:15:36.690080] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-17T07:15:37.490883] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-17T07:15:38.288818] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-17T07:15:38.301109] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-17T07:15:38.350317] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T07:15:38.731333] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T07:15:39.090198] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-17T07:15:39.890154] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-17T07:15:40.318933] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T07:15:40.690123] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-17T07:15:40.778632] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T07:15:41.490166] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-17T07:15:41.921885] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T07:15:42.290178] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-17T07:15:42.650222] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T07:15:42.717092] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T07:15:43.090149] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-17T07:15:43.890160] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-17T07:15:44.611334] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-17T07:15:44.690139] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-17T07:15:44.964412] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T07:15:45.171943] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T07:15:45.490202] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-17T07:15:46.290200] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-17T07:15:47.090197] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-17T07:15:47.162364] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.47 seconds). [2025-09-17T07:15:47.280169] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T07:15:47.890174] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-17T07:15:48.191664] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T07:15:48.690146] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-17T07:15:48.726472] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T07:15:49.497874] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-17T07:15:49.515167] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T07:15:50.290136] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-17T07:15:50.715350] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T07:15:51.090149] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-17T07:15:51.224060] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T07:15:51.360885] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T07:15:51.890205] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-17T07:15:52.690138] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-17T07:15:52.988749] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T07:15:52.995145] [INFO ] [REMOTE ] W: Full fetch complete (77312 records). [2025-09-17T07:15:52.995304] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-17T07:15:53.395823] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-17T07:15:53.395934] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-17T07:15:53.397266] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-17T07:15:53.397343] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-17T07:15:53.398954] [DEBUG] [LOCAL ] W: Trimmed 77312 records to 53533 (keeping 200 days of data) [2025-09-17T07:15:53.490331] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-17T07:15:53.662885] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T07:15:53.791799] [DEBUG] [LOCAL ] W: Primary data saved (53533 records). [2025-09-17T07:15:53.791974] [INFO ] [MAIN ] W: Full history saved. [2025-09-17T07:15:53.792073] [INFO ] [MAIN ] Update Progress: 2266/2369 symbols completed. W took 31.6s. Estimated remaining: 15m 5s. Rate: 6.8 symbols/min [2025-09-17T07:15:53.962723] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:15:53.998046] [DEBUG] [LOCAL ] WAL: Loaded 33162 existing records from primary storage. [2025-09-17T07:15:53.998217] [INFO ] [MAIN ] WAL: Loaded 33162 existing records. [2025-09-17T07:15:54.184101] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:15:54.184408] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-17T07:15:54.184470] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-17T07:15:54.185495] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-17T07:15:54.185561] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-17T07:15:54.295250] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-17T07:15:54.564464] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:15:54.676287] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T07:15:55.050411] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T07:15:55.056210] [INFO ] [REMOTE ] VYX: Full fetch complete (70159 records). [2025-09-17T07:15:55.056343] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-17T07:15:55.099471] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-17T07:15:55.453878] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-17T07:15:55.454003] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-17T07:15:55.455148] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-17T07:15:55.455210] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-17T07:15:55.456718] [DEBUG] [LOCAL ] VYX: Trimmed 70159 records to 49292 (keeping 200 days of data) [2025-09-17T07:15:55.775559] [DEBUG] [LOCAL ] VYX: Primary data saved (49292 records). [2025-09-17T07:15:55.775792] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-17T07:15:55.775912] [INFO ] [MAIN ] Update Progress: 2267/2369 symbols completed. VYX took 46.0s. Estimated remaining: 14m 56s. Rate: 6.8 symbols/min [2025-09-17T07:15:55.890334] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-11. [2025-09-17T07:15:55.958844] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:15:55.986934] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T07:15:56.016289] [DEBUG] [LOCAL ] WAT: Loaded 26221 existing records from primary storage. [2025-09-17T07:15:56.016480] [INFO ] [MAIN ] WAT: Loaded 26221 existing records. [2025-09-17T07:15:56.193925] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:15:56.194228] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-17T07:15:56.194312] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-17T07:15:56.195001] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-17T07:15:56.195085] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-17T07:15:56.555419] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:15:56.690145] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-17T07:15:57.490190] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-11. [2025-09-17T07:15:57.523939] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-17T07:15:57.530574] [INFO ] [REMOTE ] VZ: Full fetch complete (77905 records). [2025-09-17T07:15:57.530795] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-17T07:15:57.949107] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-11 (2.06 seconds). [2025-09-17T07:15:57.980265] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-17T07:15:57.981895] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-17T07:15:57.983124] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-17T07:15:57.983340] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-17T07:15:57.985918] [DEBUG] [LOCAL ] VZ: Trimmed 77905 records to 53791 (keeping 200 days of data) [2025-09-17T07:15:58.100990] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T07:15:58.117259] [INFO ] [REMOTE ] WAB: Full fetch complete (64276 records). [2025-09-17T07:15:58.119505] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-17T07:15:58.299965] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-09-17T07:15:58.628538] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-17T07:15:58.655681] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-17T07:15:58.662290] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-17T07:15:58.665245] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-17T07:15:58.688264] [DEBUG] [LOCAL ] WAB: Trimmed 64276 records to 44433 (keeping 200 days of data) [2025-09-17T07:15:58.886561] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-09-17T07:15:58.887666] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-17T07:15:58.888445] [INFO ] [MAIN ] Update Progress: 2268/2369 symbols completed. VZ took 41.3s. Estimated remaining: 14m 47s. Rate: 6.8 symbols/min [2025-09-17T07:15:59.070954] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:15:59.203268] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T07:15:59.221064] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-09-17T07:15:59.242023] [DEBUG] [LOCAL ] WBS: Loaded 36149 existing records from primary storage. [2025-09-17T07:15:59.242945] [INFO ] [MAIN ] WBS: Loaded 36149 existing records. [2025-09-17T07:15:59.435428] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:15:59.437534] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-17T07:15:59.437877] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-17T07:15:59.439172] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-17T07:15:59.439744] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-17T07:15:59.819623] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:15:59.851027] [DEBUG] [LOCAL ] WAB: Primary data saved (44433 records). [2025-09-17T07:15:59.851175] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-17T07:15:59.851279] [INFO ] [MAIN ] Update Progress: 2269/2369 symbols completed. WAB took 31.8s. Estimated remaining: 14m 38s. Rate: 6.8 symbols/min [2025-09-17T07:15:59.894733] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-11. [2025-09-17T07:16:00.026668] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:16:00.055789] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T07:16:00.068948] [DEBUG] [LOCAL ] WBX: Loaded 7488 existing records from primary storage. [2025-09-17T07:16:00.069101] [INFO ] [MAIN ] WBX: Loaded 7488 existing records. [2025-09-17T07:16:00.247969] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:16:00.248213] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-17T07:16:00.248271] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-17T07:16:00.248541] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-17T07:16:00.248597] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-17T07:16:00.603349] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:16:00.690124] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-11. [2025-09-17T07:16:00.784669] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T07:16:01.490149] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-17T07:16:01.737561] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T07:16:02.188842] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T07:16:02.290179] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-09-17T07:16:03.090106] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-09-17T07:16:03.203617] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T07:16:03.437833] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T07:16:03.890144] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-09-17T07:16:04.549445] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T07:16:04.690148] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-17T07:16:05.490146] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-17T07:16:05.533574] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T07:16:06.267342] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T07:16:06.290070] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-17T07:16:06.942608] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T07:16:07.090160] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-09-17T07:16:07.606213] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T07:16:07.890144] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-09-17T07:16:08.413711] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T07:16:08.690146] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-17T07:16:09.490115] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-17T07:16:09.564767] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T07:16:10.116267] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T07:16:10.290143] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-17T07:16:11.090146] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-17T07:16:11.278631] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T07:16:11.315294] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T07:16:11.890142] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-17T07:16:12.680787] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T07:16:12.690072] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-17T07:16:13.490161] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-17T07:16:13.516923] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T07:16:14.290091] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-17T07:16:14.373733] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T07:16:14.831982] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T07:16:15.090112] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-17T07:16:15.522031] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T07:16:15.890160] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-17T07:16:16.469927] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T07:16:16.690132] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-17T07:16:17.382825] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T07:16:17.490161] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-17T07:16:18.290113] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-17T07:16:18.369990] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T07:16:19.090187] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-17T07:16:19.142450] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T07:16:19.540239] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T07:16:19.890149] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-17T07:16:20.471541] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T07:16:20.690152] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-17T07:16:20.949346] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T07:16:21.490154] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-17T07:16:22.295250] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-17T07:16:22.311800] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T07:16:22.495997] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T07:16:23.090169] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-17T07:16:23.711707] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T07:16:23.716556] [INFO ] [REMOTE ] WAT: Full fetch complete (49728 records). [2025-09-17T07:16:23.716720] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-17T07:16:23.905950] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-17T07:16:24.121113] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-17T07:16:24.121226] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-17T07:16:24.122131] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-17T07:16:24.122188] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-17T07:16:24.123391] [DEBUG] [LOCAL ] WAT: Trimmed 49728 records to 35149 (keeping 200 days of data) [2025-09-17T07:16:24.342835] [DEBUG] [LOCAL ] WAT: Primary data saved (35149 records). [2025-09-17T07:16:24.343008] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-17T07:16:24.343115] [INFO ] [MAIN ] Update Progress: 2270/2369 symbols completed. WAT took 28.6s. Estimated remaining: 14m 30s. Rate: 6.8 symbols/min [2025-09-17T07:16:24.520204] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:16:24.550052] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T07:16:24.585543] [DEBUG] [LOCAL ] WCC: Loaded 29047 existing records from primary storage. [2025-09-17T07:16:24.585741] [INFO ] [MAIN ] WCC: Loaded 29047 existing records. [2025-09-17T07:16:24.695203] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-17T07:16:24.769783] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:16:24.770066] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-17T07:16:24.770137] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-17T07:16:24.770945] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-17T07:16:24.771020] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-17T07:16:25.131022] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:16:25.490112] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-17T07:16:25.533031] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T07:16:26.290167] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-11. [2025-09-17T07:16:26.567032] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T07:16:26.590707] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T07:16:27.090163] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-17T07:16:27.479927] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T07:16:27.890145] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-17T07:16:28.695182] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-17T07:16:28.704051] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T07:16:28.710247] [INFO ] [REMOTE ] WAL: Full fetch complete (66022 records). [2025-09-17T07:16:28.710425] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-17T07:16:29.107989] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-17T07:16:29.108112] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-17T07:16:29.109286] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-17T07:16:29.109373] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-17T07:16:29.110799] [DEBUG] [LOCAL ] WAL: Trimmed 66022 records to 45495 (keeping 200 days of data) [2025-09-17T07:16:29.416295] [DEBUG] [LOCAL ] WAL: Primary data saved (45495 records). [2025-09-17T07:16:29.416566] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-17T07:16:29.416804] [INFO ] [MAIN ] Update Progress: 2271/2369 symbols completed. WAL took 35.6s. Estimated remaining: 14m 21s. Rate: 6.8 symbols/min [2025-09-17T07:16:29.493304] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-09-17T07:16:29.600033] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:16:29.629519] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T07:16:29.672239] [DEBUG] [LOCAL ] WCN: Loaded 35591 existing records from primary storage. [2025-09-17T07:16:29.672433] [INFO ] [MAIN ] WCN: Loaded 35591 existing records. [2025-09-17T07:16:29.889224] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:16:29.889727] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-17T07:16:29.889867] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-17T07:16:29.895783] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-17T07:16:29.901026] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-17T07:16:29.901845] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T07:16:30.277721] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:16:30.290081] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-11. [2025-09-17T07:16:30.783632] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T07:16:31.090236] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-17T07:16:31.890214] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-09-17T07:16:31.964438] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T07:16:32.680995] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T07:16:32.687405] [INFO ] [REMOTE ] WBS: Full fetch complete (69140 records). [2025-09-17T07:16:32.687605] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-17T07:16:32.699662] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-17T07:16:33.092863] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-17T07:16:33.093006] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-17T07:16:33.094537] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-17T07:16:33.094694] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-17T07:16:33.096813] [DEBUG] [LOCAL ] WBS: Trimmed 69140 records to 48884 (keeping 200 days of data) [2025-09-17T07:16:33.212464] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T07:16:33.430859] [DEBUG] [LOCAL ] WBS: Primary data saved (48884 records). [2025-09-17T07:16:33.431020] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-17T07:16:33.431133] [INFO ] [MAIN ] Update Progress: 2272/2369 symbols completed. WBS took 34.5s. Estimated remaining: 14m 12s. Rate: 6.8 symbols/min [2025-09-17T07:16:33.495276] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-09-17T07:16:33.578911] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T07:16:33.609974] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:16:33.627186] [DEBUG] [LOCAL ] WD: Loaded 17197 existing records from primary storage. [2025-09-17T07:16:33.627336] [INFO ] [MAIN ] WD: Loaded 17197 existing records. [2025-09-17T07:16:33.808084] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:16:33.808321] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-17T07:16:33.808401] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-17T07:16:33.808864] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-17T07:16:33.808936] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-17T07:16:34.171396] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:16:34.290177] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-17T07:16:34.960058] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T07:16:35.090107] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-17T07:16:35.254997] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T07:16:35.622891] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T07:16:35.624112] [INFO ] [REMOTE ] WBX: Full fetch complete (26851 records). [2025-09-17T07:16:35.624214] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-17T07:16:35.895230] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-11. [2025-09-17T07:16:36.007123] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-17T07:16:36.007245] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-17T07:16:36.007910] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-17T07:16:36.007991] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-17T07:16:36.009082] [DEBUG] [LOCAL ] WBX: Trimmed 26851 records to 13601 (keeping 200 days of data) [2025-09-17T07:16:36.092422] [DEBUG] [LOCAL ] WBX: Primary data saved (13601 records). [2025-09-17T07:16:36.092605] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-17T07:16:36.092752] [INFO ] [MAIN ] Update Progress: 2273/2369 symbols completed. WBX took 36.2s. Estimated remaining: 14m 3s. Rate: 6.8 symbols/min [2025-09-17T07:16:36.269669] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:16:36.285706] [DEBUG] [LOCAL ] WDH: Loaded 12206 existing records from primary storage. [2025-09-17T07:16:36.285873] [INFO ] [MAIN ] WDH: Loaded 12206 existing records. [2025-09-17T07:16:36.466359] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:16:36.466612] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-17T07:16:36.466690] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-17T07:16:36.467036] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-17T07:16:36.467094] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-17T07:16:36.697856] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-09-17T07:16:36.823394] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:16:36.881015] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T07:16:37.490184] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-17T07:16:38.290182] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-09-17T07:16:38.479124] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T07:16:38.925384] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T07:16:39.090132] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-17T07:16:39.305354] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T07:16:39.890174] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-17T07:16:40.682565] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T07:16:40.691385] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-09-17T07:16:41.188555] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T07:16:41.490156] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-11. [2025-09-17T07:16:41.711801] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T07:16:42.206052] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T07:16:42.290134] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-09-17T07:16:43.090128] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-17T07:16:43.259946] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T07:16:43.890166] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-17T07:16:44.220005] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T07:16:44.690151] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-17T07:16:45.490141] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-17T07:16:45.641482] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T07:16:46.253194] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T07:16:46.290135] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-17T07:16:46.315106] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T07:16:47.090170] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-17T07:16:47.817077] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T07:16:47.890151] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-17T07:16:48.369830] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T07:16:48.690160] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-09-17T07:16:49.451365] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T07:16:49.490311] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-17T07:16:49.493617] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T07:16:50.290189] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-17T07:16:51.028000] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T07:16:51.090115] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-17T07:16:51.495735] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T07:16:51.890156] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-17T07:16:52.522612] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T07:16:52.690108] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-17T07:16:53.490136] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-17T07:16:53.708174] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T07:16:53.731967] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T07:16:53.736891] [INFO ] [REMOTE ] WCC: Full fetch complete (57594 records). [2025-09-17T07:16:53.737063] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-17T07:16:54.123971] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-17T07:16:54.124082] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-17T07:16:54.125139] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-17T07:16:54.125206] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-17T07:16:54.126472] [DEBUG] [LOCAL ] WCC: Trimmed 57594 records to 40293 (keeping 200 days of data) [2025-09-17T07:16:54.322636] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-17T07:16:54.371611] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T07:16:54.411914] [DEBUG] [LOCAL ] WCC: Primary data saved (40293 records). [2025-09-17T07:16:54.412092] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-17T07:16:54.412232] [INFO ] [MAIN ] Update Progress: 2274/2369 symbols completed. WCC took 30.1s. Estimated remaining: 13m 54s. Rate: 6.8 symbols/min [2025-09-17T07:16:54.581858] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:16:54.597999] [DEBUG] [LOCAL ] WDI: Loaded 15400 existing records from primary storage. [2025-09-17T07:16:54.598162] [INFO ] [MAIN ] WDI: Loaded 15400 existing records. [2025-09-17T07:16:54.777448] [WARN ] [MAIN ] WDI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:16:54.777765] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-17T07:16:54.777860] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-17T07:16:54.778369] [DEBUG] [LOCAL ] WDI: Deleted primary data file. [2025-09-17T07:16:54.778448] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-17T07:16:55.097261] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-17T07:16:55.136236] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:16:55.485100] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T07:16:55.890130] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-17T07:16:56.151458] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T07:16:56.690183] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-17T07:16:57.357938] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T07:16:57.490133] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-17T07:16:57.832802] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T07:16:58.290147] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-11. [2025-09-17T07:16:59.090674] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-17T07:16:59.102083] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T07:16:59.162261] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T07:16:59.890130] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-17T07:16:59.950823] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T07:17:00.690127] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-17T07:17:01.490132] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-09-17T07:17:01.655633] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T07:17:01.656424] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T07:17:02.295245] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-17T07:17:02.307820] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T07:17:03.090115] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-09-17T07:17:03.891572] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-17T07:17:03.898774] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T07:17:04.128872] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T07:17:04.690121] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-17T07:17:05.002345] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T07:17:05.490128] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-17T07:17:05.529286] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T07:17:06.290136] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-17T07:17:07.090157] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-17T07:17:07.149028] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T07:17:07.155384] [INFO ] [REMOTE ] WCN: Full fetch complete (69128 records). [2025-09-17T07:17:07.155607] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-17T07:17:07.579174] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-17T07:17:07.585863] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-17T07:17:07.598441] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-17T07:17:07.599271] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T07:17:07.604768] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-17T07:17:07.607912] [DEBUG] [LOCAL ] WCN: Trimmed 69128 records to 48138 (keeping 200 days of data) [2025-09-17T07:17:07.893110] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-17T07:17:07.924774] [DEBUG] [LOCAL ] WCN: Primary data saved (48138 records). [2025-09-17T07:17:07.924943] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-17T07:17:07.925089] [INFO ] [MAIN ] Update Progress: 2275/2369 symbols completed. WCN took 38.5s. Estimated remaining: 13m 46s. Rate: 6.8 symbols/min [2025-09-17T07:17:08.089161] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T07:17:08.107274] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:17:08.144667] [DEBUG] [LOCAL ] WDS: Loaded 31569 existing records from primary storage. [2025-09-17T07:17:08.144843] [INFO ] [MAIN ] WDS: Loaded 31569 existing records. [2025-09-17T07:17:08.322222] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:17:08.322458] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-17T07:17:08.322509] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-17T07:17:08.323216] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-17T07:17:08.323277] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-17T07:17:08.696367] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-17T07:17:08.722186] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:17:09.102336] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T07:17:09.490121] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-17T07:17:09.729706] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T07:17:09.732580] [INFO ] [REMOTE ] WD: Full fetch complete (32311 records). [2025-09-17T07:17:09.732708] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-17T07:17:10.120496] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-17T07:17:10.120626] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-17T07:17:10.121417] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-17T07:17:10.121492] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-17T07:17:10.122480] [DEBUG] [LOCAL ] WD: Trimmed 32311 records to 23478 (keeping 200 days of data) [2025-09-17T07:17:10.278715] [DEBUG] [LOCAL ] WD: Primary data saved (23478 records). [2025-09-17T07:17:10.278913] [INFO ] [MAIN ] WD: Full history saved. [2025-09-17T07:17:10.279045] [INFO ] [MAIN ] Update Progress: 2276/2369 symbols completed. WD took 36.8s. Estimated remaining: 13m 37s. Rate: 6.8 symbols/min [2025-09-17T07:17:10.300505] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-17T07:17:10.461525] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:17:10.469954] [DEBUG] [LOCAL ] WEA: Loaded 6181 existing records from primary storage. [2025-09-17T07:17:10.470143] [INFO ] [MAIN ] WEA: Loaded 6181 existing records. [2025-09-17T07:17:10.655006] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:17:10.655383] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-17T07:17:10.660690] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-17T07:17:10.668760] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-17T07:17:10.669361] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T07:17:10.669506] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-17T07:17:11.039462] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:17:11.090148] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-17T07:17:11.134951] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T07:17:11.890114] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-17T07:17:11.996168] [DEBUG] [REMOTE ] WDI: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-17T07:17:11.996567] [WARN ] [REMOTE ] WDI: No data returned for month 2025-06 [2025-09-17T07:17:12.184288] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T07:17:12.690160] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-11. [2025-09-17T07:17:13.320597] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T07:17:13.490137] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-17T07:17:14.290181] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-17T07:17:14.750519] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T07:17:14.754683] [INFO ] [REMOTE ] WDH: Full fetch complete (21681 records). [2025-09-17T07:17:14.754805] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-17T07:17:15.096192] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-11. [2025-09-17T07:17:15.126761] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-17T07:17:15.126854] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-17T07:17:15.127391] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-17T07:17:15.127476] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-17T07:17:15.128261] [DEBUG] [LOCAL ] WDH: Trimmed 21681 records to 16065 (keeping 200 days of data) [2025-09-17T07:17:15.224518] [DEBUG] [LOCAL ] WDH: Primary data saved (16065 records). [2025-09-17T07:17:15.224750] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-17T07:17:15.224876] [INFO ] [MAIN ] Update Progress: 2277/2369 symbols completed. WDH took 39.1s. Estimated remaining: 13m 28s. Rate: 6.8 symbols/min [2025-09-17T07:17:15.347802] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T07:17:15.890133] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-17T07:17:16.690136] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-09-17T07:17:16.753741] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T07:17:17.048885] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T07:17:17.345783] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T07:17:17.490152] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-09-17T07:17:18.290146] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-17T07:17:19.090183] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-09-17T07:17:19.169309] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T07:17:19.207013] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T07:17:19.209619] [INFO ] [REMOTE ] WDI: Full fetch complete (27720 records). [2025-09-17T07:17:19.209736] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-17T07:17:19.402512] [WARN ] [VALIDATOR ] WDI: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T07:17:19.403024] [FATAL] [MAIN ] WDI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:17:19.403086] [WARN ] [MAIN ] WDI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:17:19.403131] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-17T07:17:19.403205] [DEBUG] [LOCAL ] WDI: No primary data file found to delete. [2025-09-17T07:17:19.403254] [INFO ] [LOCAL ] WDI: Starting deletion of derivative data. [2025-09-17T07:17:19.403607] [DEBUG] [LOCAL ] WDI: Deleted derivative data file. [2025-09-17T07:17:19.403758] [INFO ] [MAIN ] Update Progress: 2278/2369 symbols completed. WDI took 25.0s. Estimated remaining: 13m 19s. Rate: 6.8 symbols/min [2025-09-17T07:17:19.784705] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T07:17:19.890111] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-17T07:17:20.461803] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T07:17:20.690167] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-09-17T07:17:21.490186] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-17T07:17:22.075665] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T07:17:22.247126] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T07:17:22.290070] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-17T07:17:23.090152] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-17T07:17:23.782194] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T07:17:23.823988] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T07:17:23.890108] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-17T07:17:24.694812] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-17T07:17:25.523406] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T07:17:25.528097] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-17T07:17:25.570335] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T07:17:26.073671] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T07:17:26.290127] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-17T07:17:27.090138] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-17T07:17:27.102375] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T07:17:27.890203] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-17T07:17:28.611889] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T07:17:28.690142] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-17T07:17:28.896174] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T07:17:29.236782] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T07:17:29.238395] [INFO ] [REMOTE ] WEA: Full fetch complete (9957 records). [2025-09-17T07:17:29.238491] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-17T07:17:29.495247] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-17T07:17:29.598296] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-17T07:17:29.598403] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-17T07:17:29.598705] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-17T07:17:29.598778] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-17T07:17:29.599291] [DEBUG] [LOCAL ] WEA: Trimmed 9957 records to 7463 (keeping 200 days of data) [2025-09-17T07:17:29.645760] [DEBUG] [LOCAL ] WEA: Primary data saved (7463 records). [2025-09-17T07:17:29.645917] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-17T07:17:29.646056] [INFO ] [MAIN ] Update Progress: 2279/2369 symbols completed. WEA took 19.4s. Estimated remaining: 13m 10s. Rate: 6.8 symbols/min [2025-09-17T07:17:31.086326] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T07:17:31.095693] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-17T07:17:32.428413] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T07:17:32.437871] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-17T07:17:34.061064] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T07:17:34.074477] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-17T07:17:35.542223] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T07:17:35.551515] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-17T07:17:37.024314] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T07:17:37.030227] [INFO ] [REMOTE ] WDS: Full fetch complete (64738 records). [2025-09-17T07:17:37.030449] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-17T07:17:37.415513] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-17T07:17:37.415670] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-17T07:17:37.416845] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-17T07:17:37.416920] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-17T07:17:37.418875] [DEBUG] [LOCAL ] WDS: Trimmed 64738 records to 43801 (keeping 200 days of data) [2025-09-17T07:17:37.698287] [DEBUG] [LOCAL ] WDS: Primary data saved (43801 records). [2025-09-17T07:17:37.698458] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-17T07:17:37.698583] [INFO ] [MAIN ] Update Progress: 2280/2369 symbols completed. WDS took 29.8s. Estimated remaining: 13m 1s. Rate: 6.8 symbols/min [2025-09-17T07:17:38.328545] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:17:38.362804] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:17:38.405261] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:17:38.410395] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:17:38.471103] [DEBUG] [LOCAL ] WEAV: Loaded 31145 existing records from primary storage. [2025-09-17T07:17:38.471443] [INFO ] [MAIN ] WEAV: Loaded 31145 existing records. [2025-09-17T07:17:38.568044] [DEBUG] [LOCAL ] WES: Loaded 35771 existing records from primary storage. [2025-09-17T07:17:38.566536] [DEBUG] [LOCAL ] WELL: Loaded 38889 existing records from primary storage. [2025-09-17T07:17:38.586367] [INFO ] [MAIN ] WES: Loaded 35771 existing records. [2025-09-17T07:17:38.586447] [INFO ] [MAIN ] WELL: Loaded 38889 existing records. [2025-09-17T07:17:38.609175] [DEBUG] [LOCAL ] WEC: Loaded 38901 existing records from primary storage. [2025-09-17T07:17:38.672545] [INFO ] [MAIN ] WEC: Loaded 38901 existing records. [2025-09-17T07:17:38.861087] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:17:39.001312] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-17T07:17:39.091505] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-17T07:17:39.141947] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:17:39.208474] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-17T07:17:39.241393] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:17:39.241487] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-17T07:17:39.266983] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-17T07:17:39.272793] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-17T07:17:39.267296] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-17T07:17:39.267533] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-17T07:17:39.284084] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-17T07:17:39.281453] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-17T07:17:39.284953] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-17T07:17:39.331203] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-17T07:17:39.404627] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:17:39.549056] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-17T07:17:39.582412] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-17T07:17:39.664593] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-17T07:17:39.706105] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-17T07:17:40.520802] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:17:40.678023] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:17:40.686025] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-11. [2025-09-17T07:17:40.772770] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:17:40.778410] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-11. [2025-09-17T07:17:40.768832] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-11. [2025-09-17T07:17:40.897975] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:17:40.898348] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-11. [2025-09-17T07:17:42.344701] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T07:17:42.354279] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-09-17T07:17:42.461206] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T07:17:42.471565] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-09-17T07:17:42.516825] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T07:17:42.529362] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-09-17T07:17:42.562079] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T07:17:42.572499] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-09-17T07:17:43.942392] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T07:17:43.952345] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-09-17T07:17:44.054414] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T07:17:44.097384] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-17T07:17:44.100897] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T07:17:44.112384] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-09-17T07:17:44.362617] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T07:17:44.373487] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-09-17T07:17:45.367712] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T07:17:45.377347] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-17T07:17:45.447801] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T07:17:45.458548] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-17T07:17:45.491427] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T07:17:45.502082] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-17T07:17:45.945067] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T07:17:45.955800] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-17T07:17:46.752426] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T07:17:46.762145] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-17T07:17:46.912445] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T07:17:47.014084] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T07:17:47.090095] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-17T07:17:47.135847] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T07:17:47.890129] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-17T07:17:48.411604] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T07:17:48.591430] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T07:17:48.690087] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-17T07:17:49.410045] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T07:17:49.490087] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-17T07:17:50.232262] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T07:17:50.290079] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-17T07:17:51.090200] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-17T07:17:51.256411] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T07:17:51.811780] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T07:17:51.890145] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-17T07:17:52.695208] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-17T07:17:52.711438] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T07:17:53.490169] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-17T07:17:53.766940] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T07:17:54.290131] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-17T07:17:54.579699] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T07:17:55.090182] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-17T07:17:55.212568] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T07:17:55.890133] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-17T07:17:56.096597] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T07:17:56.482537] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T07:17:56.690117] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-17T07:17:57.438018] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T07:17:57.490125] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-17T07:17:58.290122] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-17T07:17:58.582385] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T07:17:59.090164] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-17T07:17:59.146707] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T07:17:59.890134] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-17T07:18:00.111039] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T07:18:00.690134] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-17T07:18:00.987537] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T07:18:01.060887] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T07:18:01.490123] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-17T07:18:02.290133] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-17T07:18:03.091068] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-17T07:18:03.094582] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-17T07:18:03.890130] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-17T07:18:04.372223] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (2.88 seconds). [2025-09-17T07:18:04.378092] [INFO ] [REMOTE ] WES: Full fetch complete (69528 records). [2025-09-17T07:18:04.378223] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-17T07:18:04.778748] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-17T07:18:04.778949] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-17T07:18:04.780064] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-17T07:18:04.780131] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-17T07:18:04.781712] [DEBUG] [LOCAL ] WES: Trimmed 69528 records to 48111 (keeping 200 days of data) [2025-09-17T07:18:05.079087] [DEBUG] [LOCAL ] WES: Primary data saved (48111 records). [2025-09-17T07:18:05.079254] [INFO ] [MAIN ] WES: Full history saved. [2025-09-17T07:18:05.079345] [INFO ] [MAIN ] Update Progress: 2281/2369 symbols completed. WES took 27.4s. Estimated remaining: 12m 53s. Rate: 6.8 symbols/min [2025-09-17T07:18:05.247715] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:18:05.271624] [DEBUG] [LOCAL ] WEX: Loaded 24346 existing records from primary storage. [2025-09-17T07:18:05.271826] [INFO ] [MAIN ] WEX: Loaded 24346 existing records. [2025-09-17T07:18:05.455046] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:18:05.455395] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-17T07:18:05.455813] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-17T07:18:05.456806] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-17T07:18:05.456872] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-17T07:18:05.587268] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (3.30 seconds). [2025-09-17T07:18:05.680383] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-17T07:18:05.859781] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:18:05.870467] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-11. [2025-09-17T07:18:05.890627] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (2.80 seconds). [2025-09-17T07:18:05.918714] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-17T07:18:05.924967] [INFO ] [REMOTE ] WELL: Full fetch complete (75530 records). [2025-09-17T07:18:05.925112] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-17T07:18:06.298281] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-17T07:18:06.322186] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-17T07:18:06.322272] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-17T07:18:06.323543] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-17T07:18:06.323916] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-17T07:18:06.326072] [DEBUG] [LOCAL ] WELL: Trimmed 75530 records to 52362 (keeping 200 days of data) [2025-09-17T07:18:06.673905] [DEBUG] [LOCAL ] WELL: Primary data saved (52362 records). [2025-09-17T07:18:06.674072] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-17T07:18:06.674168] [INFO ] [MAIN ] Update Progress: 2282/2369 symbols completed. WELL took 29.0s. Estimated remaining: 12m 44s. Rate: 6.8 symbols/min [2025-09-17T07:18:06.846995] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:18:06.856520] [DEBUG] [LOCAL ] WF: Loaded 8075 existing records from primary storage. [2025-09-17T07:18:06.856706] [INFO ] [MAIN ] WF: Loaded 8075 existing records. [2025-09-17T07:18:07.035398] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:18:07.035697] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-17T07:18:07.035758] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-17T07:18:07.036051] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-17T07:18:07.036106] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-17T07:18:07.403236] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:18:07.403765] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-11. [2025-09-17T07:18:07.438713] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T07:18:07.455767] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T07:18:07.890145] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-09-17T07:18:08.211820] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T07:18:08.257617] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T07:18:08.690168] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-17T07:18:09.294255] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T07:18:09.490137] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-17T07:18:10.290137] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-17T07:18:10.455721] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T07:18:10.894316] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T07:18:10.901762] [INFO ] [REMOTE ] WEAV: Full fetch complete (61385 records). [2025-09-17T07:18:10.901982] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-17T07:18:11.101981] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-17T07:18:11.309624] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-17T07:18:11.309758] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-17T07:18:11.310780] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-17T07:18:11.310851] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-17T07:18:11.312196] [DEBUG] [LOCAL ] WEAV: Trimmed 61385 records to 42016 (keeping 200 days of data) [2025-09-17T07:18:11.563111] [DEBUG] [LOCAL ] WEAV: Primary data saved (42016 records). [2025-09-17T07:18:11.563272] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-17T07:18:11.563373] [INFO ] [MAIN ] Update Progress: 2283/2369 symbols completed. WEAV took 33.9s. Estimated remaining: 12m 35s. Rate: 6.8 symbols/min [2025-09-17T07:18:11.734964] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:18:11.735227] [DEBUG] [LOCAL ] WFC: No existing data file found in primary storage. [2025-09-17T07:18:11.735358] [WARN ] [MAIN ] WFC: No existing data found, performing full refresh instead. [2025-09-17T07:18:11.735481] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-17T07:18:11.735591] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-17T07:18:11.735796] [DEBUG] [LOCAL ] WFC: No primary data file found to delete. [2025-09-17T07:18:11.735857] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-17T07:18:11.890183] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-09-17T07:18:12.005810] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T07:18:12.123454] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:18:12.690114] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-17T07:18:12.882702] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T07:18:12.888990] [INFO ] [REMOTE ] WEC: Full fetch complete (75272 records). [2025-09-17T07:18:12.889129] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-17T07:18:13.185778] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T07:18:13.296911] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-17T07:18:13.297032] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-17T07:18:13.298212] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-17T07:18:13.298281] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-17T07:18:13.299856] [DEBUG] [LOCAL ] WEC: Trimmed 75272 records to 52248 (keeping 200 days of data) [2025-09-17T07:18:13.494514] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-09-17T07:18:13.630715] [DEBUG] [LOCAL ] WEC: Primary data saved (52248 records). [2025-09-17T07:18:13.630884] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-17T07:18:13.630982] [INFO ] [MAIN ] Update Progress: 2284/2369 symbols completed. WEC took 35.9s. Estimated remaining: 12m 26s. Rate: 6.8 symbols/min [2025-09-17T07:18:13.801457] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:18:13.819149] [DEBUG] [LOCAL ] WFG: Loaded 18005 existing records from primary storage. [2025-09-17T07:18:13.819299] [INFO ] [MAIN ] WFG: Loaded 18005 existing records. [2025-09-17T07:18:13.999382] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:18:13.999636] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-17T07:18:13.999712] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-17T07:18:14.000160] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-17T07:18:14.000218] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-17T07:18:14.295233] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-11. [2025-09-17T07:18:14.378474] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:18:14.401608] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T07:18:14.437218] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T07:18:15.090151] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-17T07:18:15.890144] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-17T07:18:16.690158] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-11. [2025-09-17T07:18:16.719635] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T07:18:17.420869] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-11 (3.13 seconds). [2025-09-17T07:18:17.490183] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-09-17T07:18:18.025974] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T07:18:18.205957] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-17T07:18:18.290207] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-17T07:18:19.038211] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T07:18:19.056219] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T07:18:19.090089] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-17T07:18:19.890168] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-17T07:18:19.970975] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T07:18:20.690164] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-17T07:18:21.467015] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T07:18:21.497148] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-09-17T07:18:21.520314] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T07:18:22.290185] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-17T07:18:22.560420] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T07:18:23.090182] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-09-17T07:18:23.768575] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T07:18:23.890137] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-17T07:18:24.690133] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-17T07:18:25.090201] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T07:18:25.124318] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T07:18:25.490145] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-17T07:18:25.569491] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T07:18:26.290148] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-09-17T07:18:27.090147] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-17T07:18:27.381037] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T07:18:27.407482] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T07:18:27.890196] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-17T07:18:28.523034] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T07:18:28.690156] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-17T07:18:29.490094] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-17T07:18:29.968484] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T07:18:29.990418] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T07:18:30.290098] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-17T07:18:30.762278] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T07:18:31.090135] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-17T07:18:31.497671] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T07:18:31.855035] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T07:18:31.890133] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-17T07:18:32.690161] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-17T07:18:33.106327] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T07:18:33.457330] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T07:18:33.459109] [INFO ] [REMOTE ] WF: Full fetch complete (16936 records). [2025-09-17T07:18:33.459199] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-17T07:18:33.495293] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-17T07:18:33.827344] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-17T07:18:33.827448] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-17T07:18:33.827865] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-17T07:18:33.827921] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-17T07:18:33.828458] [DEBUG] [LOCAL ] WF: Trimmed 16936 records to 11170 (keeping 200 days of data) [2025-09-17T07:18:33.898551] [DEBUG] [LOCAL ] WF: Primary data saved (11170 records). [2025-09-17T07:18:33.898741] [INFO ] [MAIN ] WF: Full history saved. [2025-09-17T07:18:33.898850] [INFO ] [MAIN ] Update Progress: 2285/2369 symbols completed. WF took 27.2s. Estimated remaining: 12m 18s. Rate: 6.8 symbols/min [2025-09-17T07:18:34.086216] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:18:34.116093] [DEBUG] [LOCAL ] WGO: Loaded 28067 existing records from primary storage. [2025-09-17T07:18:34.116278] [INFO ] [MAIN ] WGO: Loaded 28067 existing records. [2025-09-17T07:18:34.295715] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-17T07:18:34.318824] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:18:34.319902] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-17T07:18:34.319982] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-17T07:18:34.321025] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-17T07:18:34.321087] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-17T07:18:34.679797] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:18:34.862515] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T07:18:34.866484] [INFO ] [REMOTE ] WEX: Full fetch complete (50579 records). [2025-09-17T07:18:34.866594] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-17T07:18:35.097394] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-11. [2025-09-17T07:18:35.244813] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-17T07:18:35.244932] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-17T07:18:35.245917] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-17T07:18:35.245998] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-17T07:18:35.247549] [DEBUG] [LOCAL ] WEX: Trimmed 50579 records to 35787 (keeping 200 days of data) [2025-09-17T07:18:35.465467] [DEBUG] [LOCAL ] WEX: Primary data saved (35787 records). [2025-09-17T07:18:35.465674] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-17T07:18:35.465804] [INFO ] [MAIN ] Update Progress: 2286/2369 symbols completed. WEX took 30.4s. Estimated remaining: 12m 9s. Rate: 6.8 symbols/min [2025-09-17T07:18:35.636108] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:18:35.671881] [DEBUG] [LOCAL ] WH: Loaded 34050 existing records from primary storage. [2025-09-17T07:18:35.672065] [INFO ] [MAIN ] WH: Loaded 34050 existing records. [2025-09-17T07:18:35.875480] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:18:35.875823] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-17T07:18:35.875889] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-17T07:18:35.876665] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-17T07:18:35.876728] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-17T07:18:35.909109] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-17T07:18:36.245812] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:18:36.446080] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-17T07:18:36.603044] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T07:18:36.690091] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-09-17T07:18:37.490366] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-11. [2025-09-17T07:18:37.668959] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T07:18:38.193409] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T07:18:38.290189] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-09-17T07:18:38.651631] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T07:18:39.090178] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-17T07:18:39.813822] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T07:18:39.890125] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-17T07:18:40.690114] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-17T07:18:41.213413] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T07:18:41.281340] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T07:18:41.365851] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T07:18:41.490122] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-17T07:18:42.290176] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-17T07:18:42.628124] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T07:18:43.090210] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-09-17T07:18:43.890155] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-17T07:18:44.362852] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.07 seconds). [2025-09-17T07:18:44.609428] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T07:18:44.690097] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-09-17T07:18:45.090197] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T07:18:45.490204] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-17T07:18:46.085778] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T07:18:46.202882] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T07:18:46.290126] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-17T07:18:47.090143] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-17T07:18:47.783365] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T07:18:47.890128] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-17T07:18:48.690127] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-17T07:18:48.751035] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T07:18:49.490148] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-17T07:18:50.138534] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-17T07:18:50.290092] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-17T07:18:50.399326] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T07:18:50.430509] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T07:18:50.433929] [INFO ] [REMOTE ] WFG: Full fetch complete (35296 records). [2025-09-17T07:18:50.434035] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-17T07:18:50.804887] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-17T07:18:50.804991] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-17T07:18:50.805738] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-17T07:18:50.805799] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-17T07:18:50.806602] [DEBUG] [LOCAL ] WFG: Trimmed 35296 records to 25080 (keeping 200 days of data) [2025-09-17T07:18:50.956387] [DEBUG] [LOCAL ] WFG: Primary data saved (25080 records). [2025-09-17T07:18:50.956538] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-17T07:18:50.956658] [INFO ] [MAIN ] Update Progress: 2287/2369 symbols completed. WFG took 37.3s. Estimated remaining: 12m 0s. Rate: 6.8 symbols/min [2025-09-17T07:18:51.096374] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-17T07:18:51.126932] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:18:51.155766] [DEBUG] [LOCAL ] WHD: Loaded 29279 existing records from primary storage. [2025-09-17T07:18:51.155923] [INFO ] [MAIN ] WHD: Loaded 29279 existing records. [2025-09-17T07:18:51.336807] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:18:51.337080] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-17T07:18:51.337138] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-17T07:18:51.337829] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-17T07:18:51.337893] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-17T07:18:51.688156] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:18:51.890094] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-11. [2025-09-17T07:18:52.237444] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T07:18:52.690136] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-17T07:18:52.741976] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T07:18:53.470175] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T07:18:53.490095] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-09-17T07:18:54.185763] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T07:18:54.290151] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-17T07:18:54.863752] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T07:18:55.090147] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-17T07:18:55.637253] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T07:18:55.890139] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-17T07:18:56.689413] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T07:18:56.698755] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-17T07:18:57.490125] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-09-17T07:18:57.820065] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T07:18:57.826541] [INFO ] [REMOTE ] WFC: Full fetch complete (77755 records). [2025-09-17T07:18:57.826703] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-17T07:18:58.221372] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-17T07:18:58.221597] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-17T07:18:58.222745] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-17T07:18:58.222836] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-17T07:18:58.232457] [DEBUG] [LOCAL ] WFC: Trimmed 77755 records to 53748 (keeping 200 days of data) [2025-09-17T07:18:58.247922] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T07:18:58.311804] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-17T07:18:58.604631] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-09-17T07:18:58.604872] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-17T07:18:58.604979] [INFO ] [MAIN ] Update Progress: 2288/2369 symbols completed. WFC took 47.0s. Estimated remaining: 11m 51s. Rate: 6.8 symbols/min [2025-09-17T07:18:58.775523] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:18:58.780006] [DEBUG] [LOCAL ] WHG: Loaded 2596 existing records from primary storage. [2025-09-17T07:18:58.780113] [INFO ] [MAIN ] WHG: Loaded 2596 existing records. [2025-09-17T07:18:58.956669] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:18:58.957072] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-17T07:18:58.957199] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-17T07:18:58.957739] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-17T07:18:58.957810] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-17T07:18:59.097949] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-17T07:18:59.120042] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T07:18:59.349148] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:18:59.821107] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T07:18:59.890116] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-17T07:19:00.599526] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T07:19:00.690133] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-11. [2025-09-17T07:19:01.135840] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T07:19:01.490129] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-09-17T07:19:01.572500] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T07:19:02.046707] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T07:19:02.290155] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-17T07:19:03.090133] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-17T07:19:03.674426] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T07:19:03.890134] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-17T07:19:04.559832] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T07:19:04.690136] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-17T07:19:05.214992] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T07:19:05.220062] [INFO ] [REMOTE ] WGO: Full fetch complete (57062 records). [2025-09-17T07:19:05.220198] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-17T07:19:05.495268] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-09-17T07:19:05.612679] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-17T07:19:05.612795] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-17T07:19:05.614075] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-17T07:19:05.614162] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-17T07:19:05.615443] [DEBUG] [LOCAL ] WGO: Trimmed 57062 records to 39661 (keeping 200 days of data) [2025-09-17T07:19:05.863907] [DEBUG] [LOCAL ] WGO: Primary data saved (39661 records). [2025-09-17T07:19:05.864064] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-17T07:19:05.864229] [INFO ] [MAIN ] Update Progress: 2289/2369 symbols completed. WGO took 32.0s. Estimated remaining: 11m 42s. Rate: 6.8 symbols/min [2025-09-17T07:19:06.035926] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:19:06.039559] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T07:19:06.075390] [DEBUG] [LOCAL ] WHR: Loaded 36249 existing records from primary storage. [2025-09-17T07:19:06.075584] [INFO ] [MAIN ] WHR: Loaded 36249 existing records. [2025-09-17T07:19:06.261345] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:19:06.261885] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-17T07:19:06.262021] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-17T07:19:06.263017] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-17T07:19:06.263106] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-17T07:19:06.295199] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-17T07:19:06.552630] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T07:19:06.673322] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:19:07.090126] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-17T07:19:07.661850] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T07:19:07.828102] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T07:19:07.890129] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-17T07:19:08.430700] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T07:19:08.690142] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-17T07:19:09.490181] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-17T07:19:10.290121] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-11. [2025-09-17T07:19:10.371952] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T07:19:11.008378] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T07:19:11.013917] [INFO ] [REMOTE ] WH: Full fetch complete (64888 records). [2025-09-17T07:19:11.014053] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-17T07:19:11.095294] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-17T07:19:11.401581] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-17T07:19:11.401708] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-17T07:19:11.402845] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-17T07:19:11.402905] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-17T07:19:11.406265] [DEBUG] [LOCAL ] WH: Trimmed 64888 records to 45949 (keeping 200 days of data) [2025-09-17T07:19:11.729732] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T07:19:11.731789] [DEBUG] [LOCAL ] WH: Primary data saved (45949 records). [2025-09-17T07:19:11.740812] [INFO ] [MAIN ] WH: Full history saved. [2025-09-17T07:19:11.740934] [INFO ] [MAIN ] Update Progress: 2290/2369 symbols completed. WH took 36.3s. Estimated remaining: 11m 34s. Rate: 6.8 symbols/min [2025-09-17T07:19:11.895247] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-09-17T07:19:11.950038] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:19:11.955184] [DEBUG] [LOCAL ] WIA: Loaded 3615 existing records from primary storage. [2025-09-17T07:19:11.955289] [INFO ] [MAIN ] WIA: Loaded 3615 existing records. [2025-09-17T07:19:12.132662] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:19:12.132919] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-17T07:19:12.132970] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-17T07:19:12.133197] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-17T07:19:12.133276] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-17T07:19:12.488470] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:19:12.564876] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T07:19:12.690080] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-17T07:19:13.297882] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T07:19:13.490158] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-09-17T07:19:14.120890] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T07:19:14.290171] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-11. [2025-09-17T07:19:14.765396] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T07:19:15.012816] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T07:19:15.090096] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-09-17T07:19:15.890168] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-17T07:19:15.940890] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T07:19:16.479670] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T07:19:16.690170] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-09-17T07:19:17.264933] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T07:19:17.490194] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-17T07:19:18.063126] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T07:19:18.290111] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-17T07:19:19.090187] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-17T07:19:19.693446] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T07:19:19.890136] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-17T07:19:20.695217] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-17T07:19:20.711867] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T07:19:21.282147] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T07:19:21.308498] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T07:19:21.490156] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-17T07:19:22.290177] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-17T07:19:22.947268] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T07:19:23.093540] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-17T07:19:23.099874] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T07:19:23.890150] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-17T07:19:24.455682] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T07:19:24.494996] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T07:19:24.501209] [INFO ] [REMOTE ] WHD: Full fetch complete (56971 records). [2025-09-17T07:19:24.501388] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-17T07:19:24.700852] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-17T07:19:24.911034] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-17T07:19:24.911158] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-17T07:19:24.912274] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-17T07:19:24.912361] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-17T07:19:24.913811] [DEBUG] [LOCAL ] WHD: Trimmed 56971 records to 40896 (keeping 200 days of data) [2025-09-17T07:19:25.178077] [DEBUG] [LOCAL ] WHD: Primary data saved (40896 records). [2025-09-17T07:19:25.178244] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-17T07:19:25.178390] [INFO ] [MAIN ] Update Progress: 2291/2369 symbols completed. WHD took 34.2s. Estimated remaining: 11m 25s. Rate: 6.8 symbols/min [2025-09-17T07:19:25.348435] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:19:25.358404] [DEBUG] [LOCAL ] WINN: Loaded 8042 existing records from primary storage. [2025-09-17T07:19:25.358566] [INFO ] [MAIN ] WINN: Loaded 8042 existing records. [2025-09-17T07:19:25.468728] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T07:19:25.504586] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-17T07:19:25.546073] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:19:25.546328] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-17T07:19:25.546443] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-17T07:19:25.546824] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-17T07:19:25.546901] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-17T07:19:25.910727] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:19:26.033405] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T07:19:26.290133] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-17T07:19:26.746040] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T07:19:26.746949] [INFO ] [REMOTE ] WHG: Full fetch complete (4697 records). [2025-09-17T07:19:26.747037] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-17T07:19:27.108015] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-17T07:19:27.117764] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-17T07:19:27.118599] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-17T07:19:27.118819] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-17T07:19:27.118900] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-17T07:19:27.119387] [DEBUG] [LOCAL ] WHG: Trimmed 4697 records to 3423 (keeping 200 days of data) [2025-09-17T07:19:27.142894] [DEBUG] [LOCAL ] WHG: Primary data saved (3423 records). [2025-09-17T07:19:27.143000] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-17T07:19:27.143106] [INFO ] [MAIN ] Update Progress: 2292/2369 symbols completed. WHG took 28.5s. Estimated remaining: 11m 16s. Rate: 6.8 symbols/min [2025-09-17T07:19:27.311359] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:19:27.356688] [DEBUG] [LOCAL ] WIT: Loaded 39032 existing records from primary storage. [2025-09-17T07:19:27.356942] [INFO ] [MAIN ] WIT: Loaded 39032 existing records. [2025-09-17T07:19:27.532376] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:19:27.532700] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-17T07:19:27.532773] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-17T07:19:27.533849] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-17T07:19:27.533927] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-17T07:19:27.889195] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:19:27.890099] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-11. [2025-09-17T07:19:28.652508] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T07:19:28.690092] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-09-17T07:19:29.037348] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T07:19:29.490149] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-17T07:19:29.534068] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T07:19:30.090523] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T07:19:30.290144] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-17T07:19:31.090165] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-11. [2025-09-17T07:19:31.890122] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-09-17T07:19:32.070949] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T07:19:32.662633] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T07:19:32.690164] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-17T07:19:32.803818] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T07:19:33.490188] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-17T07:19:34.033100] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T07:19:34.046417] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T07:19:34.290107] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-17T07:19:35.090247] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-17T07:19:35.864577] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T07:19:35.890159] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-17T07:19:36.166236] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T07:19:36.402192] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T07:19:36.690162] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-09-17T07:19:37.490174] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-17T07:19:38.297432] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-17T07:19:38.307780] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T07:19:38.449976] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T07:19:39.090174] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-17T07:19:39.650342] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T07:19:39.890142] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-09-17T07:19:39.979244] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T07:19:40.690192] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-17T07:19:41.487561] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T07:19:41.499154] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T07:19:41.499239] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-17T07:19:42.097902] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T07:19:42.290121] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-17T07:19:42.928141] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T07:19:43.090137] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-17T07:19:43.890307] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-17T07:19:44.604857] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T07:19:44.606723] [INFO ] [REMOTE ] WIA: Full fetch complete (7538 records). [2025-09-17T07:19:44.606815] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-17T07:19:44.695366] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-17T07:19:44.996770] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-17T07:19:44.997298] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-17T07:19:44.997744] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T07:19:44.998031] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-17T07:19:45.003235] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-17T07:19:45.003781] [INFO ] [REMOTE ] WHR: Full fetch complete (67934 records). [2025-09-17T07:19:45.004042] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-17T07:19:45.003975] [DEBUG] [LOCAL ] WIA: Trimmed 7538 records to 4865 (keeping 200 days of data) [2025-09-17T07:19:45.330108] [DEBUG] [LOCAL ] WIA: Primary data saved (4865 records). [2025-09-17T07:19:45.330267] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-17T07:19:45.330421] [INFO ] [MAIN ] Update Progress: 2293/2369 symbols completed. WIA took 33.6s. Estimated remaining: 11m 7s. Rate: 6.8 symbols/min [2025-09-17T07:19:45.503692] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-17T07:19:45.552445] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-17T07:19:45.596506] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-17T07:19:45.599061] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:19:45.600310] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-17T07:19:45.600665] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-17T07:19:45.602600] [DEBUG] [LOCAL ] WHR: Trimmed 67934 records to 48127 (keeping 200 days of data) [2025-09-17T07:19:45.710083] [DEBUG] [LOCAL ] WIW: Loaded 15447 existing records from primary storage. [2025-09-17T07:19:45.713117] [INFO ] [MAIN ] WIW: Loaded 15447 existing records. [2025-09-17T07:19:45.988737] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:19:46.022523] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-17T07:19:46.023472] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-17T07:19:46.025419] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-17T07:19:46.026975] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-17T07:19:46.461617] [DEBUG] [LOCAL ] WHR: Primary data saved (48127 records). [2025-09-17T07:19:46.481286] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:19:46.481414] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-17T07:19:46.482308] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T07:19:46.482737] [INFO ] [MAIN ] Update Progress: 2294/2369 symbols completed. WHR took 40.6s. Estimated remaining: 10m 58s. Rate: 6.8 symbols/min [2025-09-17T07:19:46.482612] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-11. [2025-09-17T07:19:46.693745] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:19:46.695853] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T07:19:46.732064] [DEBUG] [LOCAL ] WK: Loaded 26749 existing records from primary storage. [2025-09-17T07:19:46.732235] [INFO ] [MAIN ] WK: Loaded 26749 existing records. [2025-09-17T07:19:46.918303] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:19:46.918569] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-17T07:19:46.918631] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-17T07:19:46.919257] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-17T07:19:46.919319] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-17T07:19:47.099341] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-17T07:19:47.297781] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:19:47.569863] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T07:19:47.865867] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T07:19:47.890082] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-17T07:19:48.690147] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-17T07:19:48.739585] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T07:19:49.490204] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-11. [2025-09-17T07:19:50.290239] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-09-17T07:19:50.459042] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T07:19:50.534186] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T07:19:51.090163] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-17T07:19:51.388768] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T07:19:51.890130] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-17T07:19:52.630027] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T07:19:52.669241] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T07:19:52.671123] [INFO ] [REMOTE ] WINN: Full fetch complete (17686 records). [2025-09-17T07:19:52.671210] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-17T07:19:52.695237] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-09-17T07:19:53.045518] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-17T07:19:53.045657] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-17T07:19:53.046110] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-17T07:19:53.046170] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-17T07:19:53.046872] [DEBUG] [LOCAL ] WINN: Trimmed 17686 records to 11989 (keeping 200 days of data) [2025-09-17T07:19:53.122185] [DEBUG] [LOCAL ] WINN: Primary data saved (11989 records). [2025-09-17T07:19:53.122355] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-17T07:19:53.122466] [INFO ] [MAIN ] Update Progress: 2295/2369 symbols completed. WINN took 27.9s. Estimated remaining: 10m 50s. Rate: 6.8 symbols/min [2025-09-17T07:19:53.294387] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:19:53.319856] [DEBUG] [LOCAL ] WKC: Loaded 25862 existing records from primary storage. [2025-09-17T07:19:53.320052] [INFO ] [MAIN ] WKC: Loaded 25862 existing records. [2025-09-17T07:19:53.493977] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-09-17T07:19:53.504382] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:19:53.505572] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-17T07:19:53.505636] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-17T07:19:53.506309] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-17T07:19:53.506450] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-17T07:19:53.871032] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:19:53.884740] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T07:19:54.290164] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-11. [2025-09-17T07:19:54.870737] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T07:19:55.090149] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-17T07:19:55.729293] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T07:19:55.890165] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-09-17T07:19:56.046339] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T07:19:56.690164] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-17T07:19:57.390395] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T07:19:57.490166] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-09-17T07:19:58.040300] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T07:19:58.290173] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-17T07:19:58.781534] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T07:19:59.090155] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-17T07:19:59.890193] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-09-17T07:19:59.983989] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T07:20:00.096525] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T07:20:00.690138] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-17T07:20:01.340389] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T07:20:01.490173] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-17T07:20:01.508034] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T07:20:02.290143] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-17T07:20:03.090150] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-17T07:20:03.466243] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T07:20:03.688670] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T07:20:03.890105] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-17T07:20:04.147593] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T07:20:04.690126] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-17T07:20:05.114790] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T07:20:05.490144] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-17T07:20:05.719677] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T07:20:06.290164] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-17T07:20:06.845929] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T07:20:07.090123] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-17T07:20:07.890142] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-17T07:20:08.146395] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T07:20:08.533917] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T07:20:08.690181] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-17T07:20:09.381962] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T07:20:09.490167] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-17T07:20:10.290176] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-17T07:20:10.439594] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T07:20:10.448165] [INFO ] [REMOTE ] WIT: Full fetch complete (75371 records). [2025-09-17T07:20:10.448347] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-17T07:20:10.866375] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-17T07:20:10.866514] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-17T07:20:10.867848] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-17T07:20:10.867913] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-17T07:20:10.869577] [DEBUG] [LOCAL ] WIT: Trimmed 75371 records to 52254 (keeping 200 days of data) [2025-09-17T07:20:11.098938] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-17T07:20:11.128228] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T07:20:11.238384] [DEBUG] [LOCAL ] WIT: Primary data saved (52254 records). [2025-09-17T07:20:11.238550] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-17T07:20:11.238670] [INFO ] [MAIN ] Update Progress: 2296/2369 symbols completed. WIT took 44.1s. Estimated remaining: 10m 41s. Rate: 6.8 symbols/min [2025-09-17T07:20:11.410320] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:20:11.432259] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T07:20:11.468264] [DEBUG] [LOCAL ] WLK: Loaded 34384 existing records from primary storage. [2025-09-17T07:20:11.468429] [INFO ] [MAIN ] WLK: Loaded 34384 existing records. [2025-09-17T07:20:11.647288] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:20:11.647542] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-17T07:20:11.647601] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-17T07:20:11.648338] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-17T07:20:11.648399] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-17T07:20:11.899198] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-17T07:20:12.015686] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:20:12.267689] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T07:20:12.690184] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-11. [2025-09-17T07:20:12.933917] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T07:20:13.490147] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-17T07:20:14.167073] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T07:20:14.290222] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-17T07:20:14.599954] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T07:20:15.090155] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-17T07:20:15.890166] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-09-17T07:20:15.955817] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T07:20:16.245547] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T07:20:16.249084] [INFO ] [REMOTE ] WIW: Full fetch complete (30457 records). [2025-09-17T07:20:16.249197] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-17T07:20:16.615632] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-17T07:20:16.615752] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-17T07:20:16.616404] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-17T07:20:16.616462] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-17T07:20:16.617423] [DEBUG] [LOCAL ] WIW: Trimmed 30457 records to 20830 (keeping 200 days of data) [2025-09-17T07:20:16.714569] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-17T07:20:16.760409] [DEBUG] [LOCAL ] WIW: Primary data saved (20830 records). [2025-09-17T07:20:16.760590] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-17T07:20:16.760729] [INFO ] [MAIN ] Update Progress: 2297/2369 symbols completed. WIW took 31.4s. Estimated remaining: 10m 32s. Rate: 6.8 symbols/min [2025-09-17T07:20:16.933755] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:20:16.940918] [DEBUG] [LOCAL ] WLKP: Loaded 4973 existing records from primary storage. [2025-09-17T07:20:16.941050] [INFO ] [MAIN ] WLKP: Loaded 4973 existing records. [2025-09-17T07:20:17.116563] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:20:17.116810] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-17T07:20:17.116863] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-17T07:20:17.117219] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-17T07:20:17.117278] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-17T07:20:17.477561] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:20:17.498968] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-11. [2025-09-17T07:20:17.503855] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T07:20:18.160439] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T07:20:18.268876] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T07:20:18.290088] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-09-17T07:20:19.090166] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-17T07:20:19.119571] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T07:20:19.890148] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-17T07:20:20.207517] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T07:20:20.690120] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-17T07:20:21.219561] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T07:20:21.490194] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-17T07:20:21.766611] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T07:20:21.771682] [INFO ] [REMOTE ] WKC: Full fetch complete (51358 records). [2025-09-17T07:20:21.771864] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-17T07:20:22.167828] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-17T07:20:22.167997] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-17T07:20:22.169078] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-17T07:20:22.169170] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-17T07:20:22.170624] [DEBUG] [LOCAL ] WKC: Trimmed 51358 records to 35368 (keeping 200 days of data) [2025-09-17T07:20:22.290178] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-09-17T07:20:22.401291] [DEBUG] [LOCAL ] WKC: Primary data saved (35368 records). [2025-09-17T07:20:22.401479] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-17T07:20:22.401659] [INFO ] [MAIN ] Update Progress: 2298/2369 symbols completed. WKC took 29.3s. Estimated remaining: 10m 23s. Rate: 6.8 symbols/min [2025-09-17T07:20:22.585199] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:20:22.588291] [DEBUG] [LOCAL ] WLTG: Loaded 892 existing records from primary storage. [2025-09-17T07:20:22.588387] [INFO ] [MAIN ] WLTG: Loaded 892 existing records. [2025-09-17T07:20:22.723085] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T07:20:22.802425] [WARN ] [MAIN ] WLTG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:20:22.803040] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-17T07:20:22.803109] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-17T07:20:22.803340] [DEBUG] [LOCAL ] WLTG: Deleted primary data file. [2025-09-17T07:20:22.803403] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-17T07:20:23.093328] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-17T07:20:23.153028] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T07:20:23.177945] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:20:23.890129] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-17T07:20:24.288173] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T07:20:24.615673] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T07:20:24.690163] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-11. [2025-09-17T07:20:24.997014] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-17T07:20:25.490171] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-17T07:20:25.823909] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-17T07:20:26.290168] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-17T07:20:27.090210] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-17T07:20:27.672100] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T07:20:27.688756] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T07:20:27.693853] [INFO ] [REMOTE ] WK: Full fetch complete (51527 records). [2025-09-17T07:20:27.694039] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-17T07:20:27.895223] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-17T07:20:28.087301] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-17T07:20:28.087416] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-17T07:20:28.088468] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-17T07:20:28.088566] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-17T07:20:28.089826] [DEBUG] [LOCAL ] WK: Trimmed 51527 records to 36517 (keeping 200 days of data) [2025-09-17T07:20:28.311921] [DEBUG] [LOCAL ] WK: Primary data saved (36517 records). [2025-09-17T07:20:28.312113] [INFO ] [MAIN ] WK: Full history saved. [2025-09-17T07:20:28.312212] [INFO ] [MAIN ] Update Progress: 2299/2369 symbols completed. WK took 41.8s. Estimated remaining: 10m 14s. Rate: 6.8 symbols/min [2025-09-17T07:20:28.485152] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:20:28.507474] [DEBUG] [LOCAL ] WLY: Loaded 22463 existing records from primary storage. [2025-09-17T07:20:28.507662] [INFO ] [MAIN ] WLY: Loaded 22463 existing records. [2025-09-17T07:20:28.692951] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-09-17T07:20:28.692866] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:20:28.694916] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-17T07:20:28.694983] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-17T07:20:28.695791] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-17T07:20:28.695854] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-17T07:20:28.814576] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T07:20:29.072299] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:20:29.490219] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-17T07:20:29.811678] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-17T07:20:30.181505] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T07:20:30.290141] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-17T07:20:31.090129] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-17T07:20:31.335126] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.24 seconds). [2025-09-17T07:20:31.860322] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T07:20:31.890131] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-17T07:20:32.289071] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T07:20:32.690181] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-17T07:20:33.408926] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T07:20:33.490109] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-11. [2025-09-17T07:20:34.290148] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-17T07:20:34.672158] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T07:20:34.729351] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T07:20:35.090127] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-09-17T07:20:35.890150] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-17T07:20:36.223855] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T07:20:36.435599] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T07:20:36.690139] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-17T07:20:37.490190] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-17T07:20:38.290224] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-17T07:20:38.353993] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T07:20:38.732120] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T07:20:38.749861] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T07:20:39.090183] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-17T07:20:39.890160] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-17T07:20:40.302251] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T07:20:40.690194] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-17T07:20:41.210040] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T07:20:41.368339] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T07:20:41.490147] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-17T07:20:42.205553] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T07:20:42.290128] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-17T07:20:43.090167] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-17T07:20:43.799750] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T07:20:43.801187] [INFO ] [REMOTE ] WLKP: Full fetch complete (10126 records). [2025-09-17T07:20:43.801272] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-17T07:20:43.897400] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-17T07:20:44.171856] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-17T07:20:44.172023] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-17T07:20:44.172371] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-17T07:20:44.172469] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-17T07:20:44.173164] [DEBUG] [LOCAL ] WLKP: Trimmed 10126 records to 6539 (keeping 200 days of data) [2025-09-17T07:20:44.239284] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T07:20:44.258164] [DEBUG] [LOCAL ] WLKP: Primary data saved (6539 records). [2025-09-17T07:20:44.258332] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-17T07:20:44.258458] [INFO ] [MAIN ] Update Progress: 2300/2369 symbols completed. WLKP took 27.5s. Estimated remaining: 10m 6s. Rate: 6.8 symbols/min [2025-09-17T07:20:44.426746] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:20:44.426936] [DEBUG] [LOCAL ] WM: No existing data file found in primary storage. [2025-09-17T07:20:44.426978] [WARN ] [MAIN ] WM: No existing data found, performing full refresh instead. [2025-09-17T07:20:44.427086] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-17T07:20:44.427138] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-17T07:20:44.427249] [DEBUG] [LOCAL ] WM: No primary data file found to delete. [2025-09-17T07:20:44.427312] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-17T07:20:44.695216] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-17T07:20:44.808842] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:20:45.294180] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T07:20:45.490169] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-17T07:20:45.835391] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T07:20:46.290100] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-17T07:20:46.388109] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T07:20:47.090147] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-17T07:20:47.515502] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T07:20:47.548410] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T07:20:47.890177] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-17T07:20:48.334065] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T07:20:48.690175] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-17T07:20:49.490158] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-17T07:20:49.956630] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T07:20:49.957421] [INFO ] [REMOTE ] WLTG: Full fetch complete (1641 records). [2025-09-17T07:20:49.957504] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-17T07:20:50.156549] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T07:20:50.156778] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:20:50.156833] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:20:50.156875] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-17T07:20:50.156942] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-17T07:20:50.156992] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-17T07:20:50.157347] [DEBUG] [LOCAL ] WLTG: Deleted derivative data file. [2025-09-17T07:20:50.157447] [INFO ] [MAIN ] Update Progress: 2301/2369 symbols completed. WLTG took 27.8s. Estimated remaining: 9m 57s. Rate: 6.8 symbols/min [2025-09-17T07:20:50.299861] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-17T07:20:50.335875] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:20:50.336146] [DEBUG] [LOCAL ] WMB: No existing data file found in primary storage. [2025-09-17T07:20:50.336235] [WARN ] [MAIN ] WMB: No existing data found, performing full refresh instead. [2025-09-17T07:20:50.336540] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-17T07:20:50.336727] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-17T07:20:50.336863] [DEBUG] [LOCAL ] WMB: No primary data file found to delete. [2025-09-17T07:20:50.336993] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-17T07:20:50.711259] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:20:50.739933] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T07:20:51.090147] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-11. [2025-09-17T07:20:51.682381] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T07:20:51.890138] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-17T07:20:52.690141] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-17T07:20:52.967031] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T07:20:53.319037] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T07:20:53.490172] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-11. [2025-09-17T07:20:54.250165] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T07:20:54.290142] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-09-17T07:20:55.090135] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-17T07:20:55.277308] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T07:20:55.890137] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-09-17T07:20:56.055855] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T07:20:56.100205] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T07:20:56.690139] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-17T07:20:57.490102] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-17T07:20:57.783510] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T07:20:57.807052] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T07:20:58.290186] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-17T07:20:58.737432] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T07:20:58.745803] [INFO ] [REMOTE ] WLK: Full fetch complete (62296 records). [2025-09-17T07:20:58.746004] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-17T07:20:59.096333] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-09-17T07:20:59.155794] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-17T07:20:59.155902] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-17T07:20:59.156928] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-17T07:20:59.156998] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-17T07:20:59.158406] [DEBUG] [LOCAL ] WLK: Trimmed 62296 records to 45219 (keeping 200 days of data) [2025-09-17T07:20:59.462517] [DEBUG] [LOCAL ] WLK: Primary data saved (45219 records). [2025-09-17T07:20:59.462746] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-17T07:20:59.462882] [INFO ] [MAIN ] Update Progress: 2302/2369 symbols completed. WLK took 48.2s. Estimated remaining: 9m 48s. Rate: 6.8 symbols/min [2025-09-17T07:20:59.645443] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:20:59.655398] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T07:20:59.659768] [INFO ] [REMOTE ] WLY: Full fetch complete (43023 records). [2025-09-17T07:20:59.659929] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-17T07:20:59.808685] [DEBUG] [LOCAL ] WMK: Loaded 10884 existing records from primary storage. [2025-09-17T07:20:59.843494] [INFO ] [MAIN ] WMK: Loaded 10884 existing records. [2025-09-17T07:20:59.891663] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-09-17T07:21:00.195709] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:21:00.212592] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-17T07:21:00.225738] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-17T07:21:00.225823] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-17T07:21:00.225876] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-17T07:21:00.226863] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-17T07:21:00.226821] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-17T07:21:00.226971] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-17T07:21:00.227032] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-17T07:21:00.327795] [DEBUG] [LOCAL ] WLY: Trimmed 43023 records to 30570 (keeping 200 days of data) [2025-09-17T07:21:00.680407] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:21:00.690273] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-11. [2025-09-17T07:21:00.772327] [DEBUG] [LOCAL ] WLY: Primary data saved (30570 records). [2025-09-17T07:21:00.772484] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-17T07:21:00.772578] [INFO ] [MAIN ] Update Progress: 2303/2369 symbols completed. WLY took 32.5s. Estimated remaining: 9m 39s. Rate: 6.8 symbols/min [2025-09-17T07:21:00.938935] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:21:00.970301] [DEBUG] [LOCAL ] WMS: Loaded 29675 existing records from primary storage. [2025-09-17T07:21:00.970730] [INFO ] [MAIN ] WMS: Loaded 29675 existing records. [2025-09-17T07:21:01.149790] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:21:01.150095] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-17T07:21:01.150261] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-17T07:21:01.151129] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-17T07:21:01.151193] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-17T07:21:01.521171] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-17T07:21:01.540295] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:21:01.550385] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-11. [2025-09-17T07:21:01.673461] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T07:21:02.290161] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-17T07:21:02.610443] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (2.72 seconds). [2025-09-17T07:21:03.090137] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-17T07:21:03.890160] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-09-17T07:21:04.737792] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-11 (3.19 seconds). [2025-09-17T07:21:04.746082] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-09-17T07:21:04.774303] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T07:21:05.155720] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (2.87 seconds). [2025-09-17T07:21:05.490127] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-09-17T07:21:05.716615] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (2.63 seconds). [2025-09-17T07:21:05.927206] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T07:21:06.057207] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T07:21:06.290125] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-17T07:21:07.090179] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-17T07:21:07.890156] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-17T07:21:08.280182] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T07:21:08.418954] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T07:21:08.690150] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-17T07:21:09.053526] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T07:21:09.490280] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-17T07:21:09.655164] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T07:21:10.290202] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-17T07:21:10.775965] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T07:21:11.090158] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-17T07:21:11.294679] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T07:21:11.890145] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-17T07:21:12.592789] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T07:21:12.690196] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-17T07:21:13.490176] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-17T07:21:13.816229] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T07:21:13.852784] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T07:21:14.290177] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-17T07:21:14.714119] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T07:21:15.090199] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-17T07:21:15.754683] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T07:21:15.890153] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-17T07:21:16.690175] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-17T07:21:17.306405] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-17T07:21:17.490108] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-17T07:21:17.545006] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T07:21:18.290225] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-17T07:21:19.090203] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-17T07:21:19.507203] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (2.82 seconds). [2025-09-17T07:21:19.890167] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-17T07:21:20.019349] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T07:21:20.159569] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (2.67 seconds). [2025-09-17T07:21:20.260103] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T07:21:20.690192] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-17T07:21:21.464313] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T07:21:21.490079] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-17T07:21:22.290141] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-17T07:21:22.827012] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T07:21:22.997053] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T07:21:23.090129] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-17T07:21:23.355564] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T07:21:23.890152] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-17T07:21:24.690186] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-17T07:21:24.948945] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T07:21:25.297485] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T07:21:25.490144] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-17T07:21:26.290127] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-17T07:21:26.658473] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T07:21:27.090199] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-17T07:21:27.182424] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T07:21:27.195987] [INFO ] [REMOTE ] WMS: Full fetch complete (57100 records). [2025-09-17T07:21:27.196922] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T07:21:27.197019] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-17T07:21:27.593287] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-17T07:21:27.593419] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-17T07:21:27.594618] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-17T07:21:27.594766] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-17T07:21:27.596030] [DEBUG] [LOCAL ] WMS: Trimmed 57100 records to 39558 (keeping 200 days of data) [2025-09-17T07:21:27.846435] [DEBUG] [LOCAL ] WMS: Primary data saved (39558 records). [2025-09-17T07:21:27.846608] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-17T07:21:27.846745] [INFO ] [MAIN ] Update Progress: 2304/2369 symbols completed. WMS took 27.1s. Estimated remaining: 9m 31s. Rate: 6.8 symbols/min [2025-09-17T07:21:27.901279] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-17T07:21:28.019579] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:21:28.019786] [DEBUG] [LOCAL ] WMT: No existing data file found in primary storage. [2025-09-17T07:21:28.019837] [WARN ] [MAIN ] WMT: No existing data found, performing full refresh instead. [2025-09-17T07:21:28.019950] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-17T07:21:28.019998] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-17T07:21:28.020048] [DEBUG] [LOCAL ] WMT: No primary data file found to delete. [2025-09-17T07:21:28.020086] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-17T07:21:28.376880] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:21:28.690104] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-17T07:21:28.924499] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T07:21:29.007124] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T07:21:29.013459] [INFO ] [REMOTE ] WM: Full fetch complete (73498 records). [2025-09-17T07:21:29.013626] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-17T07:21:29.410685] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-17T07:21:29.410802] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-17T07:21:29.411964] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-17T07:21:29.412026] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-17T07:21:29.413491] [DEBUG] [LOCAL ] WM: Trimmed 73498 records to 51022 (keeping 200 days of data) [2025-09-17T07:21:29.511008] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-17T07:21:29.745851] [DEBUG] [LOCAL ] WM: Primary data saved (51022 records). [2025-09-17T07:21:29.746024] [INFO ] [MAIN ] WM: Full history saved. [2025-09-17T07:21:29.746107] [INFO ] [MAIN ] Update Progress: 2305/2369 symbols completed. WM took 45.5s. Estimated remaining: 9m 22s. Rate: 6.8 symbols/min [2025-09-17T07:21:29.914752] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:21:29.942400] [DEBUG] [LOCAL ] WNC: Loaded 28820 existing records from primary storage. [2025-09-17T07:21:29.942591] [INFO ] [MAIN ] WNC: Loaded 28820 existing records. [2025-09-17T07:21:30.123835] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:21:30.124145] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-17T07:21:30.124205] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-17T07:21:30.124903] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-17T07:21:30.124976] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-17T07:21:30.302981] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-11. [2025-09-17T07:21:30.486311] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:21:30.527461] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T07:21:30.605375] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T07:21:30.607721] [INFO ] [REMOTE ] WMK: Full fetch complete (18984 records). [2025-09-17T07:21:30.607805] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-17T07:21:30.974742] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-17T07:21:30.974852] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-17T07:21:30.975301] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-17T07:21:30.975371] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-17T07:21:30.976003] [DEBUG] [LOCAL ] WMK: Trimmed 18984 records to 14403 (keeping 200 days of data) [2025-09-17T07:21:31.067726] [DEBUG] [LOCAL ] WMK: Primary data saved (14403 records). [2025-09-17T07:21:31.067898] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-17T07:21:31.068024] [INFO ] [MAIN ] Update Progress: 2306/2369 symbols completed. WMK took 31.6s. Estimated remaining: 9m 13s. Rate: 6.8 symbols/min [2025-09-17T07:21:31.098718] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-11. [2025-09-17T07:21:31.238260] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:21:31.267305] [DEBUG] [LOCAL ] WNS: Loaded 30095 existing records from primary storage. [2025-09-17T07:21:31.267473] [INFO ] [MAIN ] WNS: Loaded 30095 existing records. [2025-09-17T07:21:31.443370] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:21:31.443611] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-17T07:21:31.443693] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-17T07:21:31.444480] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-17T07:21:31.444555] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-17T07:21:31.893700] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-17T07:21:31.899863] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:21:32.466142] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T07:21:32.587519] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-11 (2.28 seconds). [2025-09-17T07:21:32.690185] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-09-17T07:21:33.490205] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-09-17T07:21:33.630805] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T07:21:33.638205] [INFO ] [REMOTE ] WMB: Full fetch complete (77535 records). [2025-09-17T07:21:33.638416] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-17T07:21:34.049773] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-17T07:21:34.067381] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-17T07:21:34.068673] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T07:21:34.070331] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-17T07:21:34.077299] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-17T07:21:34.079350] [DEBUG] [LOCAL ] WMB: Trimmed 77535 records to 53671 (keeping 200 days of data) [2025-09-17T07:21:34.305126] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-11. [2025-09-17T07:21:34.438272] [DEBUG] [LOCAL ] WMB: Primary data saved (53671 records). [2025-09-17T07:21:34.438493] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-17T07:21:34.438621] [INFO ] [MAIN ] Update Progress: 2307/2369 symbols completed. WMB took 44.3s. Estimated remaining: 9m 4s. Rate: 6.8 symbols/min [2025-09-17T07:21:34.618802] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:21:34.659234] [DEBUG] [LOCAL ] WOLF: Loaded 39889 existing records from primary storage. [2025-09-17T07:21:34.659457] [INFO ] [MAIN ] WOLF: Loaded 39889 existing records. [2025-09-17T07:21:34.859810] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:21:34.860131] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-17T07:21:34.860212] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-17T07:21:34.861082] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-17T07:21:34.861152] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-17T07:21:35.099520] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-09-17T07:21:35.250065] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:21:35.574204] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T07:21:35.890107] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-09-17T07:21:36.021171] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-17T07:21:36.590001] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T07:21:36.690089] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-17T07:21:37.133343] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T07:21:37.490218] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-11. [2025-09-17T07:21:37.679217] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T07:21:38.290162] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-09-17T07:21:39.090133] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-17T07:21:39.691922] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T07:21:39.729038] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-17T07:21:39.890093] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-09-17T07:21:40.672227] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T07:21:40.690089] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-17T07:21:41.490171] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-09-17T07:21:42.142469] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-17T07:21:42.197099] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T07:21:42.290144] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-17T07:21:43.090141] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-17T07:21:43.798255] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T07:21:43.896131] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-09-17T07:21:43.910456] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.42 seconds). [2025-09-17T07:21:44.355409] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T07:21:44.690176] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-17T07:21:45.490202] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-17T07:21:46.273742] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-17T07:21:46.290076] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-17T07:21:46.838810] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T07:21:47.090137] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-17T07:21:47.127740] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-17T07:21:47.890185] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-17T07:21:48.391949] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T07:21:48.612378] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T07:21:48.690123] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-17T07:21:49.490179] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-17T07:21:49.600263] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T07:21:49.980254] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T07:21:50.290144] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-17T07:21:51.090198] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-17T07:21:51.751466] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T07:21:51.890178] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-17T07:21:52.087588] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.60 seconds). [2025-09-17T07:21:52.473016] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T07:21:52.690195] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-17T07:21:52.964060] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T07:21:53.490162] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-17T07:21:54.290162] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-17T07:21:55.090196] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-17T07:21:55.280787] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-17T07:21:55.363768] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T07:21:55.388408] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T07:21:55.393098] [INFO ] [REMOTE ] WNC: Full fetch complete (57627 records). [2025-09-17T07:21:55.393312] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-17T07:21:55.805721] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-17T07:21:55.805913] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-17T07:21:55.807542] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-17T07:21:55.807685] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-17T07:21:55.809794] [DEBUG] [LOCAL ] WNC: Trimmed 57627 records to 40771 (keeping 200 days of data) [2025-09-17T07:21:55.907635] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-17T07:21:56.086972] [DEBUG] [LOCAL ] WNC: Primary data saved (40771 records). [2025-09-17T07:21:56.087201] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-17T07:21:56.087338] [INFO ] [MAIN ] Update Progress: 2308/2369 symbols completed. WNC took 26.3s. Estimated remaining: 8m 56s. Rate: 6.8 symbols/min [2025-09-17T07:21:56.276797] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:21:56.299526] [DEBUG] [LOCAL ] WOR: Loaded 16781 existing records from primary storage. [2025-09-17T07:21:56.299776] [INFO ] [MAIN ] WOR: Loaded 16781 existing records. [2025-09-17T07:21:56.487930] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:21:56.488324] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-17T07:21:56.488409] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-17T07:21:56.489097] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-17T07:21:56.489180] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-17T07:21:56.701586] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-17T07:21:56.880114] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:21:56.920165] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T07:21:57.490142] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-17T07:21:58.204343] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-17T07:21:58.290243] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-17T07:21:58.872446] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T07:21:59.090194] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-11. [2025-09-17T07:21:59.316106] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-17T07:21:59.890169] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-17T07:22:00.140183] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T07:22:00.690165] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-09-17T07:22:01.136574] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.85 seconds). [2025-09-17T07:22:01.181626] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T07:22:01.186739] [INFO ] [REMOTE ] WNS: Full fetch complete (54562 records). [2025-09-17T07:22:01.186953] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-17T07:22:01.498834] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-17T07:22:01.611775] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-17T07:22:01.611901] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-17T07:22:01.612980] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-17T07:22:01.613059] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-17T07:22:01.615471] [DEBUG] [LOCAL ] WNS: Trimmed 54562 records to 39684 (keeping 200 days of data) [2025-09-17T07:22:01.739172] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T07:22:01.890320] [DEBUG] [LOCAL ] WNS: Primary data saved (39684 records). [2025-09-17T07:22:01.890503] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-17T07:22:01.890670] [INFO ] [MAIN ] Update Progress: 2309/2369 symbols completed. WNS took 30.8s. Estimated remaining: 8m 47s. Rate: 6.8 symbols/min [2025-09-17T07:22:02.058364] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:22:02.080226] [DEBUG] [LOCAL ] WOW: Loaded 21995 existing records from primary storage. [2025-09-17T07:22:02.080420] [INFO ] [MAIN ] WOW: Loaded 21995 existing records. [2025-09-17T07:22:02.256352] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:22:02.256606] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-17T07:22:02.256683] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-17T07:22:02.257251] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-17T07:22:02.257312] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-17T07:22:02.295278] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-17T07:22:02.634339] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:22:03.090152] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-17T07:22:03.570798] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T07:22:03.780109] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-17T07:22:03.890149] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-17T07:22:04.690122] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-11. [2025-09-17T07:22:04.986206] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T07:22:05.490102] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-17T07:22:05.560585] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-17T07:22:05.794577] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T07:22:06.290139] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-09-17T07:22:06.864909] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T07:22:07.090199] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-17T07:22:07.494364] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T07:22:07.890159] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-17T07:22:08.690145] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-17T07:22:09.490225] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-17T07:22:09.635701] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.55 seconds). [2025-09-17T07:22:09.663501] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T07:22:10.073810] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T07:22:10.290131] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-17T07:22:10.804891] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T07:22:11.090147] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-17T07:22:11.890175] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-17T07:22:12.152186] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T07:22:12.340953] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T07:22:12.690186] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-17T07:22:13.122998] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T07:22:13.490231] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-17T07:22:14.290196] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-17T07:22:15.090160] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-17T07:22:15.131927] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-17T07:22:15.678188] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T07:22:15.766634] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-17T07:22:15.777321] [INFO ] [REMOTE ] WOLF: Full fetch complete (77532 records). [2025-09-17T07:22:15.777565] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-17T07:22:15.895482] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-17T07:22:16.205993] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-17T07:22:16.206106] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-17T07:22:16.207226] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-17T07:22:16.207285] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-17T07:22:16.208831] [DEBUG] [LOCAL ] WOLF: Trimmed 77532 records to 53532 (keeping 200 days of data) [2025-09-17T07:22:16.447124] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T07:22:16.552914] [DEBUG] [LOCAL ] WOLF: Primary data saved (53532 records). [2025-09-17T07:22:16.553081] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-17T07:22:16.553176] [INFO ] [MAIN ] Update Progress: 2310/2369 symbols completed. WOLF took 42.1s. Estimated remaining: 8m 38s. Rate: 6.8 symbols/min [2025-09-17T07:22:16.695319] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-17T07:22:16.726687] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:22:16.763409] [DEBUG] [LOCAL ] WPC: Loaded 36004 existing records from primary storage. [2025-09-17T07:22:16.763590] [INFO ] [MAIN ] WPC: Loaded 36004 existing records. [2025-09-17T07:22:16.960400] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:22:16.960672] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-17T07:22:16.960733] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-17T07:22:16.961521] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-17T07:22:16.961594] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-17T07:22:17.351342] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:22:17.490156] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-17T07:22:18.024259] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T07:22:18.109632] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-17T07:22:18.116582] [INFO ] [REMOTE ] WMT: Full fetch complete (77964 records). [2025-09-17T07:22:18.116771] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-17T07:22:18.294074] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-17T07:22:18.528121] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-09-17T07:22:18.534529] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-09-17T07:22:18.546171] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-09-17T07:22:18.546847] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-09-17T07:22:18.547905] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T07:22:18.557239] [DEBUG] [LOCAL ] WMT: Trimmed 77964 records to 53800 (keeping 200 days of data) [2025-09-17T07:22:18.905474] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-09-17T07:22:18.905678] [INFO ] [MAIN ] WMT: Full history saved. [2025-09-17T07:22:18.905794] [INFO ] [MAIN ] Update Progress: 2311/2369 symbols completed. WMT took 51.1s. Estimated remaining: 8m 29s. Rate: 6.8 symbols/min [2025-09-17T07:22:19.078142] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:22:19.090137] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-17T07:22:19.117430] [DEBUG] [LOCAL ] WPM: Loaded 39229 existing records from primary storage. [2025-09-17T07:22:19.117601] [INFO ] [MAIN ] WPM: Loaded 39229 existing records. [2025-09-17T07:22:19.299819] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:22:19.300051] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-17T07:22:19.300105] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-17T07:22:19.301620] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-17T07:22:19.301698] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-17T07:22:19.665413] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T07:22:19.670920] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:22:19.890131] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-11. [2025-09-17T07:22:20.215157] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T07:22:20.690134] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-17T07:22:21.423629] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T07:22:21.490153] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-09-17T07:22:21.629401] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T07:22:21.632362] [INFO ] [REMOTE ] WOR: Full fetch complete (35386 records). [2025-09-17T07:22:21.632469] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-17T07:22:22.014336] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-17T07:22:22.014452] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-17T07:22:22.015240] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-17T07:22:22.015299] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-17T07:22:22.018061] [DEBUG] [LOCAL ] WOR: Trimmed 35386 records to 24797 (keeping 200 days of data) [2025-09-17T07:22:22.177381] [DEBUG] [LOCAL ] WOR: Primary data saved (24797 records). [2025-09-17T07:22:22.177544] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-17T07:22:22.177677] [INFO ] [MAIN ] Update Progress: 2312/2369 symbols completed. WOR took 26.1s. Estimated remaining: 8m 20s. Rate: 6.8 symbols/min [2025-09-17T07:22:22.295305] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-17T07:22:22.357200] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:22:22.381124] [DEBUG] [LOCAL ] WPP: Loaded 24838 existing records from primary storage. [2025-09-17T07:22:22.381292] [INFO ] [MAIN ] WPP: Loaded 24838 existing records. [2025-09-17T07:22:22.565225] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:22:22.565494] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-17T07:22:22.565554] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-17T07:22:22.566156] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-17T07:22:22.566226] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-17T07:22:22.935789] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:22:23.090116] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-11. [2025-09-17T07:22:23.250590] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T07:22:23.472083] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T07:22:23.890162] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-17T07:22:23.916329] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T07:22:24.690105] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-11. [2025-09-17T07:22:25.085401] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T07:22:25.490141] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-17T07:22:26.290169] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-09-17T07:22:26.406620] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T07:22:26.559677] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T07:22:27.090215] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-17T07:22:27.890212] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-09-17T07:22:28.034475] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T07:22:28.118410] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T07:22:28.123201] [INFO ] [REMOTE ] WOW: Full fetch complete (40964 records). [2025-09-17T07:22:28.123398] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-17T07:22:28.518453] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-17T07:22:28.518603] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-17T07:22:28.519574] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-17T07:22:28.519662] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-17T07:22:28.520625] [DEBUG] [LOCAL ] WOW: Trimmed 40964 records to 29596 (keeping 200 days of data) [2025-09-17T07:22:28.691991] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-17T07:22:28.692128] [DEBUG] [LOCAL ] WOW: Primary data saved (29596 records). [2025-09-17T07:22:28.693353] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-17T07:22:28.693753] [INFO ] [MAIN ] Update Progress: 2313/2369 symbols completed. WOW took 26.8s. Estimated remaining: 8m 12s. Rate: 6.8 symbols/min [2025-09-17T07:22:28.892395] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:22:28.935967] [DEBUG] [LOCAL ] WRB: Loaded 37551 existing records from primary storage. [2025-09-17T07:22:28.936322] [INFO ] [MAIN ] WRB: Loaded 37551 existing records. [2025-09-17T07:22:29.141041] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:22:29.143527] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T07:22:29.150501] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-17T07:22:29.151134] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-17T07:22:29.152261] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-17T07:22:29.152342] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-17T07:22:29.495285] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-09-17T07:22:29.524459] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:22:30.272902] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T07:22:30.290144] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-11. [2025-09-17T07:22:30.889214] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T07:22:31.090167] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-17T07:22:31.890143] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-09-17T07:22:31.937474] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T07:22:32.690175] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-09-17T07:22:32.932153] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T07:22:33.122750] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T07:22:33.490137] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-09-17T07:22:33.991706] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T07:22:34.290137] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-17T07:22:35.090120] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-17T07:22:35.152144] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T07:22:35.867915] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T07:22:35.890095] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-09-17T07:22:36.183616] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T07:22:36.690175] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-17T07:22:37.490526] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-17T07:22:37.494420] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T07:22:38.160870] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T07:22:38.290198] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-17T07:22:39.090162] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-17T07:22:39.433008] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T07:22:39.890237] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-17T07:22:39.972586] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T07:22:40.488494] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T07:22:40.690202] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-17T07:22:41.490157] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-17T07:22:41.586232] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T07:22:41.968583] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T07:22:42.290230] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-17T07:22:43.090147] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-17T07:22:43.391576] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T07:22:43.532402] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T07:22:43.890206] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-17T07:22:44.690166] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-17T07:22:44.746376] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T07:22:45.490164] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-17T07:22:45.712413] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T07:22:45.830607] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T07:22:46.290175] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-17T07:22:47.090195] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-17T07:22:47.292805] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T07:22:47.782153] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T07:22:47.890148] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-17T07:22:48.690098] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-17T07:22:48.803222] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T07:22:49.401921] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T07:22:49.407487] [INFO ] [REMOTE ] WPP: Full fetch complete (44420 records). [2025-09-17T07:22:49.407758] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-17T07:22:49.496096] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-17T07:22:49.826455] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-17T07:22:49.826584] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-17T07:22:49.827626] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-17T07:22:49.827708] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-17T07:22:49.828968] [DEBUG] [LOCAL ] WPP: Trimmed 44420 records to 33614 (keeping 200 days of data) [2025-09-17T07:22:50.059659] [DEBUG] [LOCAL ] WPP: Primary data saved (33614 records). [2025-09-17T07:22:50.060006] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-17T07:22:50.060111] [INFO ] [MAIN ] Update Progress: 2314/2369 symbols completed. WPP took 27.9s. Estimated remaining: 8m 3s. Rate: 6.8 symbols/min [2025-09-17T07:22:50.236203] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:22:50.277177] [DEBUG] [LOCAL ] WRBY: Loaded 37611 existing records from primary storage. [2025-09-17T07:22:50.277402] [INFO ] [MAIN ] WRBY: Loaded 37611 existing records. [2025-09-17T07:22:50.309236] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-17T07:22:50.460961] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:22:50.461227] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-17T07:22:50.461289] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-17T07:22:50.462077] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-17T07:22:50.462139] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-17T07:22:50.851404] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:22:50.886317] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-17T07:22:51.090134] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-17T07:22:51.327381] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T07:22:51.890169] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-11. [2025-09-17T07:22:52.115420] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T07:22:52.502577] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T07:22:52.690152] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-17T07:22:53.495317] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-17T07:22:53.515944] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T07:22:54.290143] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-09-17T07:22:54.547414] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T07:22:54.553957] [INFO ] [REMOTE ] WPM: Full fetch complete (75589 records). [2025-09-17T07:22:54.554146] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-17T07:22:54.992383] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-17T07:22:54.992513] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-17T07:22:54.993684] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-17T07:22:54.993751] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-17T07:22:54.995318] [DEBUG] [LOCAL ] WPM: Trimmed 75589 records to 52724 (keeping 200 days of data) [2025-09-17T07:22:55.095771] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-17T07:22:55.263452] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T07:22:55.378560] [DEBUG] [LOCAL ] WPM: Primary data saved (52724 records). [2025-09-17T07:22:55.378752] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-17T07:22:55.378874] [INFO ] [MAIN ] Update Progress: 2315/2369 symbols completed. WPM took 36.5s. Estimated remaining: 7m 54s. Rate: 6.8 symbols/min [2025-09-17T07:22:55.556690] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:22:55.574053] [DEBUG] [LOCAL ] WS: Loaded 16884 existing records from primary storage. [2025-09-17T07:22:55.574201] [INFO ] [MAIN ] WS: Loaded 16884 existing records. [2025-09-17T07:22:55.759318] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:22:55.759600] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-17T07:22:55.759679] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-17T07:22:55.760362] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-17T07:22:55.760428] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-17T07:22:55.892484] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-17T07:22:56.140070] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:22:56.168886] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T07:22:56.690135] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-09-17T07:22:56.754690] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T07:22:57.490098] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-17T07:22:57.591883] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T07:22:58.290179] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-11. [2025-09-17T07:22:58.399861] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T07:22:59.090125] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-17T07:22:59.302509] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T07:22:59.890154] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-17T07:23:00.690201] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-09-17T07:23:03.992259] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (3.30 seconds). [2025-09-17T07:23:03.998750] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-09-17T07:23:04.685234] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (5.60 seconds). [2025-09-17T07:23:04.695865] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-17T07:23:04.930695] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (5.04 seconds). [2025-09-17T07:23:04.942309] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-17T07:23:04.971952] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (7.48 seconds). [2025-09-17T07:23:04.982373] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-17T07:23:05.100970] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T07:23:05.106969] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-17T07:23:06.272456] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T07:23:06.278275] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-17T07:23:06.412914] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T07:23:06.424372] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-17T07:23:06.529155] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T07:23:06.562201] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T07:23:06.570910] [INFO ] [REMOTE ] WPC: Full fetch complete (70907 records). [2025-09-17T07:23:06.571119] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-17T07:23:06.963663] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-17T07:23:06.963784] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-17T07:23:06.964943] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-17T07:23:06.965026] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-17T07:23:06.966535] [DEBUG] [LOCAL ] WPC: Trimmed 70907 records to 48812 (keeping 200 days of data) [2025-09-17T07:23:07.091984] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-17T07:23:07.301442] [DEBUG] [LOCAL ] WPC: Primary data saved (48812 records). [2025-09-17T07:23:07.303240] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T07:23:07.303466] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-17T07:23:07.310024] [INFO ] [MAIN ] Update Progress: 2316/2369 symbols completed. WPC took 50.8s. Estimated remaining: 7m 45s. Rate: 6.8 symbols/min [2025-09-17T07:23:07.487116] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:23:07.526688] [DEBUG] [LOCAL ] WSM: Loaded 36902 existing records from primary storage. [2025-09-17T07:23:07.526869] [INFO ] [MAIN ] WSM: Loaded 36902 existing records. [2025-09-17T07:23:07.708047] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:23:07.708286] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-17T07:23:07.708343] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-17T07:23:07.709157] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-17T07:23:07.709217] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-17T07:23:07.897388] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-17T07:23:08.079325] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:23:08.110217] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T07:23:08.568102] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T07:23:08.574672] [INFO ] [REMOTE ] WRB: Full fetch complete (72782 records). [2025-09-17T07:23:08.574899] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-17T07:23:08.695257] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-17T07:23:08.973331] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-17T07:23:08.973434] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-17T07:23:08.974571] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-17T07:23:08.974676] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-17T07:23:08.976079] [DEBUG] [LOCAL ] WRB: Trimmed 72782 records to 50593 (keeping 200 days of data) [2025-09-17T07:23:09.114027] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T07:23:09.313983] [DEBUG] [LOCAL ] WRB: Primary data saved (50593 records). [2025-09-17T07:23:09.314163] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-17T07:23:09.314265] [INFO ] [MAIN ] Update Progress: 2317/2369 symbols completed. WRB took 40.6s. Estimated remaining: 7m 37s. Rate: 6.8 symbols/min [2025-09-17T07:23:09.490125] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-11. [2025-09-17T07:23:10.290155] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-17T07:23:10.498798] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T07:23:11.090231] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-17T07:23:11.237585] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T07:23:11.310153] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T07:23:11.890180] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-09-17T07:23:12.690149] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-17T07:23:12.834571] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T07:23:13.490164] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-17T07:23:13.626273] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T07:23:13.671099] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T07:23:14.290167] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-17T07:23:15.090110] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-09-17T07:23:15.189919] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T07:23:15.453695] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T07:23:15.890205] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-17T07:23:16.690212] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-17T07:23:16.828680] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T07:23:16.923416] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T07:23:17.490143] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-17T07:23:18.290170] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-17T07:23:18.409938] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T07:23:18.511974] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T07:23:18.515166] [INFO ] [REMOTE ] WS: Full fetch complete (36060 records). [2025-09-17T07:23:18.515266] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-17T07:23:18.926389] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-17T07:23:18.926548] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-17T07:23:18.927713] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-17T07:23:18.927789] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-17T07:23:18.929250] [DEBUG] [LOCAL ] WS: Trimmed 36060 records to 23971 (keeping 200 days of data) [2025-09-17T07:23:19.087611] [DEBUG] [LOCAL ] WS: Primary data saved (23971 records). [2025-09-17T07:23:19.087862] [INFO ] [MAIN ] WS: Full history saved. [2025-09-17T07:23:19.088007] [INFO ] [MAIN ] Update Progress: 2318/2369 symbols completed. WS took 23.7s. Estimated remaining: 7m 28s. Rate: 6.8 symbols/min [2025-09-17T07:23:19.090119] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-17T07:23:19.887440] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T07:23:19.896723] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-17T07:23:20.267213] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T07:23:20.276173] [INFO ] [REMOTE ] WRBY: Full fetch complete (73168 records). [2025-09-17T07:23:20.276504] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-17T07:23:20.664991] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-17T07:23:20.665103] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-17T07:23:20.666249] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-17T07:23:20.666308] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-17T07:23:20.667766] [DEBUG] [LOCAL ] WRBY: Trimmed 73168 records to 50932 (keeping 200 days of data) [2025-09-17T07:23:20.994303] [DEBUG] [LOCAL ] WRBY: Primary data saved (50932 records). [2025-09-17T07:23:20.994531] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-17T07:23:20.994707] [INFO ] [MAIN ] Update Progress: 2319/2369 symbols completed. WRBY took 30.9s. Estimated remaining: 7m 19s. Rate: 6.8 symbols/min [2025-09-17T07:23:21.683197] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T07:23:21.695190] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-17T07:23:23.528209] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T07:23:23.539920] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-17T07:23:25.275348] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T07:23:25.286543] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-17T07:23:26.902801] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T07:23:26.914034] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-17T07:23:28.721367] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T07:23:28.732306] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-17T07:23:30.468588] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T07:23:30.481563] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-17T07:23:32.098564] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T07:23:32.104318] [INFO ] [REMOTE ] WSM: Full fetch complete (72411 records). [2025-09-17T07:23:32.104468] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-17T07:23:32.502530] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-17T07:23:32.502674] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-17T07:23:32.503812] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-17T07:23:32.503879] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-17T07:23:32.505798] [DEBUG] [LOCAL ] WSM: Trimmed 72411 records to 50190 (keeping 200 days of data) [2025-09-17T07:23:32.824941] [DEBUG] [LOCAL ] WSM: Primary data saved (50190 records). [2025-09-17T07:23:32.825098] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-17T07:23:32.825194] [INFO ] [MAIN ] Update Progress: 2320/2369 symbols completed. WSM took 25.5s. Estimated remaining: 7m 10s. Rate: 6.8 symbols/min [2025-09-17T07:23:33.416205] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:23:33.496483] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:23:33.536331] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:23:33.538269] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:23:33.568229] [DEBUG] [LOCAL ] WSO: Loaded 18610 existing records from primary storage. [2025-09-17T07:23:33.574193] [INFO ] [MAIN ] WSO: Loaded 18610 existing records. [2025-09-17T07:23:33.629581] [DEBUG] [LOCAL ] WSR: Loaded 16799 existing records from primary storage. [2025-09-17T07:23:33.675624] [INFO ] [MAIN ] WSR: Loaded 16799 existing records. [2025-09-17T07:23:33.757068] [DEBUG] [LOCAL ] WT: Loaded 35275 existing records from primary storage. [2025-09-17T07:23:33.730918] [DEBUG] [LOCAL ] WST: Loaded 27018 existing records from primary storage. [2025-09-17T07:23:33.805298] [INFO ] [MAIN ] WST: Loaded 27018 existing records. [2025-09-17T07:23:33.783433] [INFO ] [MAIN ] WT: Loaded 35275 existing records. [2025-09-17T07:23:34.030741] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:23:34.120619] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-17T07:23:34.199601] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-17T07:23:34.300376] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-17T07:23:34.300520] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:23:34.368306] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:23:34.368160] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-17T07:23:34.364841] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:23:34.368547] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-17T07:23:34.389195] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-17T07:23:34.403088] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-17T07:23:34.389254] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-17T07:23:34.442459] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-17T07:23:34.408429] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-17T07:23:34.423530] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-17T07:23:34.463431] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-17T07:23:34.468726] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-17T07:23:34.477331] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-17T07:23:34.477241] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-17T07:23:34.523254] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-17T07:23:35.456611] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:23:35.532794] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-11. [2025-09-17T07:23:35.809468] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:23:35.840455] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-11. [2025-09-17T07:23:35.904163] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:23:35.943447] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-11. [2025-09-17T07:23:35.962789] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:23:35.963890] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-11. [2025-09-17T07:23:36.870265] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T07:23:36.874976] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-09-17T07:23:36.952199] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T07:23:36.958077] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-09-17T07:23:37.292079] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T07:23:37.299525] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-09-17T07:23:37.519835] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T07:23:37.529347] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-09-17T07:23:37.624095] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T07:23:37.632910] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-09-17T07:23:37.981269] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T07:23:37.985490] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-09-17T07:23:38.563915] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T07:23:38.568857] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-17T07:23:38.753214] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T07:23:38.759960] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-09-17T07:23:38.850504] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T07:23:38.860462] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-09-17T07:23:39.105450] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T07:23:39.110038] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-17T07:23:39.202667] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T07:23:39.207278] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-17T07:23:40.220140] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T07:23:40.227179] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-17T07:23:40.307098] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T07:23:40.312389] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-17T07:23:40.352348] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T07:23:40.358918] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-17T07:23:40.432110] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T07:23:40.442462] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-17T07:23:41.544254] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T07:23:41.549657] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-17T07:23:41.575705] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T07:23:41.581673] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-17T07:23:41.705173] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T07:23:41.814383] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T07:23:42.290127] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-17T07:23:42.394614] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T07:23:42.428196] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T07:23:43.090132] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-17T07:23:43.871313] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T07:23:43.890075] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-17T07:23:44.226420] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T07:23:44.690189] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-17T07:23:45.476908] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T07:23:45.495257] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-17T07:23:45.509933] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T07:23:46.290145] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-17T07:23:47.078635] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T07:23:47.090077] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-17T07:23:47.509020] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T07:23:47.890194] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-17T07:23:48.589412] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T07:23:48.690155] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-17T07:23:48.843871] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T07:23:49.490154] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-17T07:23:49.862575] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T07:23:50.290140] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-17T07:23:51.090191] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-17T07:23:51.330138] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T07:23:51.358286] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T07:23:51.890136] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-17T07:23:52.672199] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T07:23:52.690096] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-17T07:23:52.964697] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T07:23:53.490162] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-17T07:23:54.290171] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-17T07:23:54.355880] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T07:23:54.738623] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T07:23:54.742685] [INFO ] [REMOTE ] WSO: Full fetch complete (33508 records). [2025-09-17T07:23:54.742798] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-17T07:23:55.095264] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-17T07:23:55.150525] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-17T07:23:55.150675] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-17T07:23:55.151681] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-17T07:23:55.151763] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-17T07:23:55.153127] [DEBUG] [LOCAL ] WSO: Trimmed 33508 records to 24633 (keeping 200 days of data) [2025-09-17T07:23:55.310243] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T07:23:55.319734] [INFO ] [REMOTE ] WSR: Full fetch complete (32690 records). [2025-09-17T07:23:55.321524] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-17T07:23:55.831946] [DEBUG] [LOCAL ] WSO: Primary data saved (24633 records). [2025-09-17T07:23:55.832251] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-17T07:23:55.832602] [INFO ] [MAIN ] Update Progress: 2321/2369 symbols completed. WSO took 23.0s. Estimated remaining: 7m 2s. Rate: 6.8 symbols/min [2025-09-17T07:23:55.909511] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-17T07:23:56.152424] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-17T07:23:56.184617] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-17T07:23:56.201369] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-17T07:23:56.220494] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-17T07:23:56.222054] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:23:56.225498] [DEBUG] [LOCAL ] WSR: Trimmed 32690 records to 23492 (keeping 200 days of data) [2025-09-17T07:23:56.387156] [DEBUG] [LOCAL ] WTI: Loaded 32866 existing records from primary storage. [2025-09-17T07:23:56.388478] [INFO ] [MAIN ] WTI: Loaded 32866 existing records. [2025-09-17T07:23:56.600526] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:23:56.606565] [DEBUG] [LOCAL ] WSR: Primary data saved (23492 records). [2025-09-17T07:23:56.606604] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-17T07:23:56.606937] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-17T07:23:56.606800] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-17T07:23:56.607291] [INFO ] [MAIN ] Update Progress: 2322/2369 symbols completed. WSR took 23.8s. Estimated remaining: 6m 53s. Rate: 6.8 symbols/min [2025-09-17T07:23:56.618175] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-17T07:23:56.650869] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-17T07:23:56.883163] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:23:56.888857] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-17T07:23:56.899191] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-17T07:23:56.933442] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-17T07:23:56.972618] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-17T07:23:57.014233] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-17T07:23:57.042440] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-17T07:23:57.145736] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T07:23:57.267720] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-17T07:23:57.306219] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:23:57.497435] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-11. [2025-09-17T07:23:57.588175] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:23:57.618012] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T07:23:58.290201] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-17T07:23:58.499299] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T07:23:59.090161] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-17T07:23:59.277155] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T07:23:59.855772] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T07:23:59.861934] [INFO ] [REMOTE ] WT: Full fetch complete (68892 records). [2025-09-17T07:23:59.862084] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-17T07:23:59.895183] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-09-17T07:24:00.259400] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-17T07:24:00.259516] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-17T07:24:00.260676] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-17T07:24:00.260736] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-17T07:24:00.262309] [DEBUG] [LOCAL ] WT: Trimmed 68892 records to 47538 (keeping 200 days of data) [2025-09-17T07:24:00.566236] [DEBUG] [LOCAL ] WT: Primary data saved (47538 records). [2025-09-17T07:24:00.566420] [INFO ] [MAIN ] WT: Full history saved. [2025-09-17T07:24:00.566551] [INFO ] [MAIN ] Update Progress: 2323/2369 symbols completed. WT took 27.7s. Estimated remaining: 6m 44s. Rate: 6.8 symbols/min [2025-09-17T07:24:00.695086] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-11. [2025-09-17T07:24:00.746909] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:24:00.772327] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T07:24:00.813370] [DEBUG] [LOCAL ] WTRG: Loaded 37901 existing records from primary storage. [2025-09-17T07:24:00.813560] [INFO ] [MAIN ] WTRG: Loaded 37901 existing records. [2025-09-17T07:24:00.999665] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:24:00.999942] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-17T07:24:00.999997] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-17T07:24:01.000831] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-17T07:24:01.000897] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-17T07:24:01.173247] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T07:24:01.379189] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:24:01.490116] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-11. [2025-09-17T07:24:01.800555] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T07:24:02.290125] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-17T07:24:03.090188] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-17T07:24:03.890149] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-09-17T07:24:04.180789] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T07:24:04.690196] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-17T07:24:04.777144] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-11 (3.29 seconds). [2025-09-17T07:24:04.970492] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-17T07:24:05.173759] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T07:24:05.490241] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-17T07:24:05.655307] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T07:24:05.916876] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T07:24:06.290185] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-17T07:24:07.090206] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-09-17T07:24:07.738827] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T07:24:07.890290] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-17T07:24:08.373873] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T07:24:08.656818] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T07:24:08.690130] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-17T07:24:09.490128] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-09-17T07:24:10.219080] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T07:24:10.290238] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-17T07:24:10.815440] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T07:24:11.090161] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-17T07:24:11.849563] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T07:24:11.890151] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-17T07:24:12.450409] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T07:24:12.455891] [INFO ] [REMOTE ] WST: Full fetch complete (53193 records). [2025-09-17T07:24:12.456240] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-17T07:24:12.695937] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-17T07:24:12.889807] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-17T07:24:12.889945] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-17T07:24:12.891113] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-17T07:24:12.891190] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-17T07:24:12.892907] [DEBUG] [LOCAL ] WST: Trimmed 53193 records to 38122 (keeping 200 days of data) [2025-09-17T07:24:13.151731] [DEBUG] [LOCAL ] WST: Primary data saved (38122 records). [2025-09-17T07:24:13.151939] [INFO ] [MAIN ] WST: Full history saved. [2025-09-17T07:24:13.152091] [INFO ] [MAIN ] Update Progress: 2324/2369 symbols completed. WST took 40.3s. Estimated remaining: 6m 35s. Rate: 6.8 symbols/min [2025-09-17T07:24:13.328775] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:24:13.345173] [DEBUG] [LOCAL ] WTS: Loaded 13467 existing records from primary storage. [2025-09-17T07:24:13.345346] [INFO ] [MAIN ] WTS: Loaded 13467 existing records. [2025-09-17T07:24:13.496389] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-17T07:24:13.538422] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:24:13.539031] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-17T07:24:13.539671] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-17T07:24:13.540170] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-17T07:24:13.540232] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-17T07:24:13.826512] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T07:24:13.951042] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:24:13.984080] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T07:24:14.083187] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T07:24:14.290140] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-17T07:24:15.090151] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-17T07:24:15.890179] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-11. [2025-09-17T07:24:16.406180] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T07:24:16.690146] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-17T07:24:17.490128] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-17T07:24:17.530369] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (3.24 seconds). [2025-09-17T07:24:17.551235] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T07:24:17.796115] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-17T07:24:18.290153] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-17T07:24:18.505422] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T07:24:18.613883] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-17T07:24:19.090130] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-17T07:24:19.890133] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-17T07:24:20.130804] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T07:24:20.690184] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-17T07:24:21.490168] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-17T07:24:21.525537] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T07:24:21.986187] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T07:24:22.290170] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-17T07:24:22.348185] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T07:24:22.882807] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T07:24:22.884233] [INFO ] [REMOTE ] WTM: Full fetch complete (2103 records). [2025-09-17T07:24:22.884339] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-17T07:24:23.072941] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T07:24:23.073140] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:24:23.073209] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:24:23.073256] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-17T07:24:23.073323] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-17T07:24:23.073380] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-17T07:24:23.073457] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-17T07:24:23.073571] [INFO ] [MAIN ] Update Progress: 2325/2369 symbols completed. WTM took 26.5s. Estimated remaining: 6m 26s. Rate: 6.8 symbols/min [2025-09-17T07:24:23.095193] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-17T07:24:23.249303] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:24:23.284105] [DEBUG] [LOCAL ] WTTR: Loaded 32517 existing records from primary storage. [2025-09-17T07:24:23.284279] [INFO ] [MAIN ] WTTR: Loaded 32517 existing records. [2025-09-17T07:24:23.460916] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:24:23.461160] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-17T07:24:23.461213] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-17T07:24:23.461955] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-17T07:24:23.462022] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-17T07:24:23.813590] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:24:23.890114] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-17T07:24:24.690181] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-17T07:24:24.721270] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T07:24:24.820914] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T07:24:25.490186] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-11. [2025-09-17T07:24:26.295259] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-17T07:24:26.307412] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T07:24:26.976906] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T07:24:27.090155] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-17T07:24:27.349979] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T07:24:27.890209] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-17T07:24:28.563028] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T07:24:28.570139] [INFO ] [REMOTE ] WTI: Full fetch complete (63974 records). [2025-09-17T07:24:28.570295] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-17T07:24:28.695198] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-17T07:24:28.957593] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-17T07:24:28.957718] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-17T07:24:28.958858] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-17T07:24:28.958916] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-17T07:24:28.960994] [DEBUG] [LOCAL ] WTI: Trimmed 63974 records to 43681 (keeping 200 days of data) [2025-09-17T07:24:29.220653] [DEBUG] [LOCAL ] WTI: Primary data saved (43681 records). [2025-09-17T07:24:29.220830] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-17T07:24:29.220962] [INFO ] [MAIN ] Update Progress: 2326/2369 symbols completed. WTI took 33.4s. Estimated remaining: 6m 18s. Rate: 6.8 symbols/min [2025-09-17T07:24:29.404797] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:24:29.442336] [DEBUG] [LOCAL ] WU: Loaded 39873 existing records from primary storage. [2025-09-17T07:24:29.442520] [INFO ] [MAIN ] WU: Loaded 39873 existing records. [2025-09-17T07:24:29.506902] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-09-17T07:24:29.640592] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:24:29.641005] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-17T07:24:29.641166] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-17T07:24:29.642153] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-17T07:24:29.642219] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-17T07:24:29.889036] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T07:24:30.085983] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T07:24:30.089211] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:24:30.290141] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-11. [2025-09-17T07:24:31.080544] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T07:24:31.090619] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-17T07:24:31.890138] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-09-17T07:24:32.030719] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T07:24:32.189254] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T07:24:32.690185] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-09-17T07:24:33.067178] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T07:24:33.490152] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-17T07:24:34.290188] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-17T07:24:34.465864] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T07:24:35.090158] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-09-17T07:24:35.236392] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T07:24:35.814091] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T07:24:35.890142] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-17T07:24:36.350888] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T07:24:36.690152] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-17T07:24:37.490158] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-17T07:24:37.588364] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T07:24:38.290132] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-17T07:24:38.420130] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T07:24:39.090133] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-17T07:24:39.274180] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T07:24:39.819448] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T07:24:39.890111] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-17T07:24:40.157470] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T07:24:40.690136] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-17T07:24:41.200283] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T07:24:41.490175] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-17T07:24:42.280707] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T07:24:42.289692] [INFO ] [REMOTE ] WTRG: Full fetch complete (72948 records). [2025-09-17T07:24:42.289881] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-17T07:24:42.290082] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-17T07:24:42.686509] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-17T07:24:42.686636] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-17T07:24:42.687814] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-17T07:24:42.687919] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-17T07:24:42.689417] [DEBUG] [LOCAL ] WTRG: Trimmed 72948 records to 50955 (keeping 200 days of data) [2025-09-17T07:24:43.009392] [DEBUG] [LOCAL ] WTRG: Primary data saved (50955 records). [2025-09-17T07:24:43.009567] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-17T07:24:43.009720] [INFO ] [MAIN ] Update Progress: 2327/2369 symbols completed. WTRG took 42.4s. Estimated remaining: 6m 9s. Rate: 6.8 symbols/min [2025-09-17T07:24:43.101566] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-17T07:24:43.218565] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:24:43.262024] [DEBUG] [LOCAL ] WWW: Loaded 36583 existing records from primary storage. [2025-09-17T07:24:43.262226] [INFO ] [MAIN ] WWW: Loaded 36583 existing records. [2025-09-17T07:24:43.471978] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T07:24:43.486051] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:24:43.499832] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-17T07:24:43.501203] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T07:24:43.505039] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-17T07:24:43.506175] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-17T07:24:43.506244] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-17T07:24:43.862955] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:24:43.890082] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-17T07:24:44.628916] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T07:24:44.690163] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T07:24:44.690244] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-11. [2025-09-17T07:24:45.490147] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-17T07:24:46.251125] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T07:24:46.290124] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-09-17T07:24:46.616333] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T07:24:47.090201] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-17T07:24:47.593435] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T07:24:47.890203] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-09-17T07:24:48.511476] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T07:24:48.690171] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-17T07:24:49.382220] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T07:24:49.490330] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-17T07:24:50.237531] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T07:24:50.290092] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-17T07:24:51.090211] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-17T07:24:51.289042] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T07:24:51.767117] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T07:24:51.890154] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-17T07:24:52.692696] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-17T07:24:52.700899] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T07:24:53.327664] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T07:24:53.333300] [INFO ] [REMOTE ] WTTR: Full fetch complete (65332 records). [2025-09-17T07:24:53.333439] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-17T07:24:53.490946] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-17T07:24:53.740455] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-17T07:24:53.740674] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-17T07:24:53.748940] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-17T07:24:53.749737] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T07:24:53.749801] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-17T07:24:53.753097] [INFO ] [REMOTE ] WTS: Full fetch complete (26348 records). [2025-09-17T07:24:53.753277] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-17T07:24:53.759132] [DEBUG] [LOCAL ] WTTR: Trimmed 65332 records to 45096 (keeping 200 days of data) [2025-09-17T07:24:54.233491] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-17T07:24:54.234127] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-17T07:24:54.235849] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-17T07:24:54.236428] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-17T07:24:54.239919] [DEBUG] [LOCAL ] WTS: Trimmed 26348 records to 18759 (keeping 200 days of data) [2025-09-17T07:24:54.295918] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-17T07:24:54.488146] [DEBUG] [LOCAL ] WTS: Primary data saved (18759 records). [2025-09-17T07:24:54.488848] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-17T07:24:54.489467] [INFO ] [MAIN ] Update Progress: 2328/2369 symbols completed. WTS took 41.3s. Estimated remaining: 6m 0s. Rate: 6.8 symbols/min [2025-09-17T07:24:54.664985] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:24:54.666241] [DEBUG] [LOCAL ] WY: No existing data file found in primary storage. [2025-09-17T07:24:54.681992] [WARN ] [MAIN ] WY: No existing data found, performing full refresh instead. [2025-09-17T07:24:54.690970] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-17T07:24:54.691253] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-17T07:24:54.691842] [DEBUG] [LOCAL ] WY: No primary data file found to delete. [2025-09-17T07:24:54.692158] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-17T07:24:54.965015] [DEBUG] [LOCAL ] WTTR: Primary data saved (45096 records). [2025-09-17T07:24:54.981345] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-17T07:24:54.992091] [INFO ] [MAIN ] Update Progress: 2329/2369 symbols completed. WTTR took 31.9s. Estimated remaining: 5m 51s. Rate: 6.8 symbols/min [2025-09-17T07:24:55.070494] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:24:55.126978] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-11. [2025-09-17T07:24:55.232076] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:24:55.261076] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T07:24:55.287150] [DEBUG] [LOCAL ] XFLT: Loaded 21740 existing records from primary storage. [2025-09-17T07:24:55.287303] [INFO ] [MAIN ] XFLT: Loaded 21740 existing records. [2025-09-17T07:24:55.463456] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:24:55.463708] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-17T07:24:55.463844] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-17T07:24:55.464456] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-17T07:24:55.464526] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-17T07:24:55.821592] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:24:55.890128] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-11. [2025-09-17T07:24:56.104664] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T07:24:56.690137] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-17T07:24:56.881001] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T07:24:57.152587] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T07:24:57.490149] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-09-17T07:24:58.295261] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-09-17T07:24:58.313751] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T07:24:58.776831] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T07:24:59.090173] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-17T07:24:59.664687] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T07:24:59.890155] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-17T07:25:00.690149] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-09-17T07:25:01.012109] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T07:25:01.490162] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-17T07:25:01.705879] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T07:25:01.784222] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T07:25:02.290186] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-09-17T07:25:03.072388] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T07:25:03.079053] [INFO ] [REMOTE ] WU: Full fetch complete (77147 records). [2025-09-17T07:25:03.079220] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-17T07:25:03.095293] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-17T07:25:03.492379] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-17T07:25:03.492544] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-17T07:25:03.494280] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-17T07:25:03.494354] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-17T07:25:03.498504] [DEBUG] [LOCAL ] WU: Trimmed 77147 records to 53445 (keeping 200 days of data) [2025-09-17T07:25:03.850553] [DEBUG] [LOCAL ] WU: Primary data saved (53445 records). [2025-09-17T07:25:03.850989] [INFO ] [MAIN ] WU: Full history saved. [2025-09-17T07:25:03.851178] [INFO ] [MAIN ] Update Progress: 2330/2369 symbols completed. WU took 34.6s. Estimated remaining: 5m 42s. Rate: 6.8 symbols/min [2025-09-17T07:25:03.897802] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-17T07:25:04.034917] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:25:04.067259] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T07:25:04.106095] [DEBUG] [LOCAL ] XHR: Loaded 32834 existing records from primary storage. [2025-09-17T07:25:04.106281] [INFO ] [MAIN ] XHR: Loaded 32834 existing records. [2025-09-17T07:25:04.289827] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:25:04.290151] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-17T07:25:04.290208] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-17T07:25:04.291228] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-17T07:25:04.291303] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-17T07:25:04.669261] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T07:25:04.688560] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:25:04.694837] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-17T07:25:05.490170] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-11. [2025-09-17T07:25:05.671092] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T07:25:06.290124] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-17T07:25:06.341278] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T07:25:06.888807] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T07:25:07.090142] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-09-17T07:25:07.435693] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T07:25:07.890165] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-17T07:25:08.608029] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T07:25:08.690136] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-17T07:25:09.490146] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-17T07:25:09.781453] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T07:25:10.290209] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-17T07:25:10.390773] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T07:25:10.859021] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T07:25:11.090106] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-17T07:25:11.890171] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-09-17T07:25:12.029836] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T07:25:12.483698] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T07:25:12.690142] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-17T07:25:13.266090] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T07:25:13.490133] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-17T07:25:14.290095] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-17T07:25:14.445436] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T07:25:14.751818] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T07:25:15.090131] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-17T07:25:15.761103] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T07:25:15.890162] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-17T07:25:16.690160] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-17T07:25:16.738365] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T07:25:16.744928] [INFO ] [REMOTE ] WWW: Full fetch complete (69535 records). [2025-09-17T07:25:16.745124] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-17T07:25:17.151627] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-17T07:25:17.151826] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-17T07:25:17.153152] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-17T07:25:17.153253] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-17T07:25:17.154955] [DEBUG] [LOCAL ] WWW: Trimmed 69535 records to 49115 (keeping 200 days of data) [2025-09-17T07:25:17.401770] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T07:25:17.490218] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-17T07:25:17.508368] [DEBUG] [LOCAL ] WWW: Primary data saved (49115 records). [2025-09-17T07:25:17.508555] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-17T07:25:17.508683] [INFO ] [MAIN ] Update Progress: 2331/2369 symbols completed. WWW took 34.5s. Estimated remaining: 5m 34s. Rate: 6.8 symbols/min [2025-09-17T07:25:17.681563] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:25:17.713615] [DEBUG] [LOCAL ] XIFR: Loaded 33036 existing records from primary storage. [2025-09-17T07:25:17.713809] [INFO ] [MAIN ] XIFR: Loaded 33036 existing records. [2025-09-17T07:25:17.902961] [WARN ] [MAIN ] XIFR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:25:17.903238] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-17T07:25:17.903299] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-17T07:25:17.904175] [DEBUG] [LOCAL ] XIFR: Deleted primary data file. [2025-09-17T07:25:17.904246] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-17T07:25:18.283342] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:25:18.290079] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-11. [2025-09-17T07:25:18.438560] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T07:25:18.488019] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:25:18.488397] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-11 [2025-09-17T07:25:19.055782] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T07:25:19.090106] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-17T07:25:19.890148] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-17T07:25:20.690182] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-17T07:25:20.882784] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:25:20.883126] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-17T07:25:21.065412] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T07:25:21.490176] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-09-17T07:25:21.625828] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T07:25:21.684777] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:25:21.685133] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-09-17T07:25:22.290129] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-17T07:25:23.090184] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-17T07:25:23.802971] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T07:25:23.890108] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-17T07:25:24.292466] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T07:25:24.690176] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-17T07:25:25.490146] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-17T07:25:25.693571] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T07:25:26.290192] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-17T07:25:26.566117] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T07:25:26.930982] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T07:25:27.090101] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-17T07:25:27.890132] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-17T07:25:27.973410] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T07:25:28.355082] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T07:25:28.690178] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-17T07:25:29.490158] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-17T07:25:29.742731] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T07:25:29.928948] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T07:25:29.932856] [INFO ] [REMOTE ] XFLT: Full fetch complete (44429 records). [2025-09-17T07:25:29.932969] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-17T07:25:30.294032] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-17T07:25:30.309043] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-17T07:25:30.309128] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-17T07:25:30.310110] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-17T07:25:30.310173] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-17T07:25:30.311296] [DEBUG] [LOCAL ] XFLT: Trimmed 44429 records to 29797 (keeping 200 days of data) [2025-09-17T07:25:30.488882] [DEBUG] [LOCAL ] XFLT: Primary data saved (29797 records). [2025-09-17T07:25:30.489038] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-17T07:25:30.489131] [INFO ] [MAIN ] Update Progress: 2332/2369 symbols completed. XFLT took 35.5s. Estimated remaining: 5m 25s. Rate: 6.8 symbols/min [2025-09-17T07:25:30.661512] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:25:30.661711] [DEBUG] [LOCAL ] XOM: No existing data file found in primary storage. [2025-09-17T07:25:30.661755] [WARN ] [MAIN ] XOM: No existing data found, performing full refresh instead. [2025-09-17T07:25:30.661879] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-17T07:25:30.661931] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-17T07:25:30.661979] [DEBUG] [LOCAL ] XOM: No primary data file found to delete. [2025-09-17T07:25:30.662021] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-17T07:25:31.015038] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:25:31.095231] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-17T07:25:31.111788] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T07:25:31.898175] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-17T07:25:31.916782] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T07:25:32.516894] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T07:25:32.523586] [INFO ] [REMOTE ] WY: Full fetch complete (76621 records). [2025-09-17T07:25:32.523749] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-17T07:25:32.695687] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-17T07:25:32.923057] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-17T07:25:32.923168] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-17T07:25:32.924589] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-17T07:25:32.924695] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-17T07:25:32.926370] [DEBUG] [LOCAL ] WY: Trimmed 76621 records to 53109 (keeping 200 days of data) [2025-09-17T07:25:33.255332] [DEBUG] [LOCAL ] WY: Primary data saved (53109 records). [2025-09-17T07:25:33.255506] [INFO ] [MAIN ] WY: Full history saved. [2025-09-17T07:25:33.255590] [INFO ] [MAIN ] Update Progress: 2333/2369 symbols completed. WY took 38.8s. Estimated remaining: 5m 16s. Rate: 6.8 symbols/min [2025-09-17T07:25:33.424663] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:25:33.450665] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T07:25:33.476358] [DEBUG] [LOCAL ] XPER: Loaded 21940 existing records from primary storage. [2025-09-17T07:25:33.476512] [INFO ] [MAIN ] XPER: Loaded 21940 existing records. [2025-09-17T07:25:33.496699] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-11. [2025-09-17T07:25:33.653665] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:25:33.653910] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-17T07:25:33.653960] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-17T07:25:33.654503] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-17T07:25:33.654561] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-17T07:25:34.011421] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:25:34.290163] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-17T07:25:34.357733] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T07:25:35.090179] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-17T07:25:35.478910] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T07:25:35.484252] [INFO ] [REMOTE ] XHR: Full fetch complete (61363 records). [2025-09-17T07:25:35.484377] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-17T07:25:35.867146] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-17T07:25:35.867419] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-17T07:25:35.868530] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-17T07:25:35.868757] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-17T07:25:35.870263] [DEBUG] [LOCAL ] XHR: Trimmed 61363 records to 44490 (keeping 200 days of data) [2025-09-17T07:25:35.926013] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-11. [2025-09-17T07:25:36.001495] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-11 (2.50 seconds). [2025-09-17T07:25:36.192711] [DEBUG] [LOCAL ] XHR: Primary data saved (44490 records). [2025-09-17T07:25:36.192876] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-17T07:25:36.192976] [INFO ] [MAIN ] Update Progress: 2334/2369 symbols completed. XHR took 32.3s. Estimated remaining: 5m 7s. Rate: 6.8 symbols/min [2025-09-17T07:25:36.367265] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:25:36.408238] [DEBUG] [LOCAL ] XPEV: Loaded 39998 existing records from primary storage. [2025-09-17T07:25:36.408454] [INFO ] [MAIN ] XPEV: Loaded 39998 existing records. [2025-09-17T07:25:36.592448] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:25:36.592793] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-17T07:25:36.592862] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-17T07:25:36.593716] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-17T07:25:36.593780] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-17T07:25:36.695049] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-17T07:25:36.964205] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:25:36.989244] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T07:25:37.278144] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T07:25:37.490226] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-09-17T07:25:38.290215] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-17T07:25:38.824627] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T07:25:39.090102] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-11. [2025-09-17T07:25:39.177665] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-17T07:25:39.610029] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T07:25:39.890156] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-17T07:25:40.690195] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-09-17T07:25:41.493549] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-17T07:25:41.501157] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-11 (2.41 seconds). [2025-09-17T07:25:41.868907] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T07:25:42.134236] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-17T07:25:42.290199] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-09-17T07:25:42.736695] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T07:25:43.090153] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-17T07:25:43.890219] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-17T07:25:44.612519] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-17T07:25:44.644147] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T07:25:44.650661] [INFO ] [REMOTE ] XIFR: Full fetch complete (52595 records). [2025-09-17T07:25:44.650857] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-17T07:25:44.700021] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-09-17T07:25:44.873558] [WARN ] [VALIDATOR ] XIFR: Validation failed - insufficient historical data. Have 156 unique days, need 200 days [2025-09-17T07:25:44.874167] [FATAL] [MAIN ] XIFR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:25:44.874222] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:25:44.874270] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-17T07:25:44.874339] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-17T07:25:44.874382] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-17T07:25:44.874873] [DEBUG] [LOCAL ] XIFR: Deleted derivative data file. [2025-09-17T07:25:44.874991] [INFO ] [MAIN ] Update Progress: 2335/2369 symbols completed. XIFR took 27.4s. Estimated remaining: 4m 58s. Rate: 6.8 symbols/min [2025-09-17T07:25:45.043559] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:25:45.043816] [DEBUG] [LOCAL ] XPO: No existing data file found in primary storage. [2025-09-17T07:25:45.043898] [WARN ] [MAIN ] XPO: No existing data found, performing full refresh instead. [2025-09-17T07:25:45.044012] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-17T07:25:45.044091] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-17T07:25:45.044143] [DEBUG] [LOCAL ] XPO: No primary data file found to delete. [2025-09-17T07:25:45.044188] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-17T07:25:45.417342] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:25:45.490293] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-11. [2025-09-17T07:25:45.766384] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T07:25:46.290142] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-17T07:25:46.849146] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T07:25:47.090186] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-17T07:25:47.138790] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T07:25:47.890139] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-09-17T07:25:48.249827] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T07:25:48.463715] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-17T07:25:48.690132] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-17T07:25:49.490194] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-17T07:25:49.546842] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T07:25:50.290164] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-17T07:25:50.785162] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T07:25:51.090136] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-17T07:25:51.615684] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-17T07:25:51.642098] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T07:25:51.890164] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-17T07:25:52.690137] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-17T07:25:53.288466] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T07:25:53.423593] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-17T07:25:53.490092] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-17T07:25:54.290202] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-17T07:25:54.728261] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T07:25:55.090191] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-09-17T07:25:55.133824] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-17T07:25:55.890134] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-17T07:25:56.674217] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-17T07:25:56.696062] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-17T07:25:56.715383] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T07:25:57.490138] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-17T07:25:57.894410] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T07:25:58.226741] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-17T07:25:58.290144] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-17T07:25:59.031511] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T07:25:59.090104] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-17T07:25:59.571805] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T07:25:59.890146] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-17T07:26:00.690149] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-17T07:26:01.497625] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-17T07:26:01.506860] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-17T07:26:02.094351] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T07:26:02.295257] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-17T07:26:02.314500] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-17T07:26:03.090171] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-17T07:26:03.246821] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T07:26:03.258378] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T07:26:03.273400] [INFO ] [REMOTE ] XPER: Full fetch complete (43164 records). [2025-09-17T07:26:03.273556] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-17T07:26:03.707001] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-17T07:26:03.707117] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-17T07:26:03.708022] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-17T07:26:03.708081] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-17T07:26:03.709214] [DEBUG] [LOCAL ] XPER: Trimmed 43164 records to 29576 (keeping 200 days of data) [2025-09-17T07:26:03.890132] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-17T07:26:03.899521] [DEBUG] [LOCAL ] XPER: Primary data saved (29576 records). [2025-09-17T07:26:03.899695] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-17T07:26:03.899853] [INFO ] [MAIN ] Update Progress: 2336/2369 symbols completed. XPER took 30.6s. Estimated remaining: 4m 50s. Rate: 6.8 symbols/min [2025-09-17T07:26:04.085324] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:26:04.112023] [DEBUG] [LOCAL ] XPOF: Loaded 28233 existing records from primary storage. [2025-09-17T07:26:04.112188] [INFO ] [MAIN ] XPOF: Loaded 28233 existing records. [2025-09-17T07:26:04.287408] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:26:04.287707] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-17T07:26:04.287779] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-17T07:26:04.288708] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-17T07:26:04.288788] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-17T07:26:04.648844] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:26:04.690195] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-11. [2025-09-17T07:26:05.188012] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-17T07:26:05.490120] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-17T07:26:05.595387] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T07:26:06.103997] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T07:26:06.290152] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-09-17T07:26:07.090118] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-17T07:26:07.381078] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T07:26:07.476526] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T07:26:07.890174] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-17T07:26:08.690147] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-09-17T07:26:09.317542] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-17T07:26:09.324096] [INFO ] [REMOTE ] XOM: Full fetch complete (77880 records). [2025-09-17T07:26:09.324253] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-17T07:26:09.506876] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-17T07:26:09.734690] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-17T07:26:09.734832] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-17T07:26:09.736235] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-17T07:26:09.736387] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-17T07:26:09.738051] [DEBUG] [LOCAL ] XOM: Trimmed 77880 records to 53793 (keeping 200 days of data) [2025-09-17T07:26:09.858860] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T07:26:10.016410] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T07:26:10.143933] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-09-17T07:26:10.144114] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-17T07:26:10.144236] [INFO ] [MAIN ] Update Progress: 2337/2369 symbols completed. XOM took 39.7s. Estimated remaining: 4m 41s. Rate: 6.8 symbols/min [2025-09-17T07:26:10.298275] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-17T07:26:10.316900] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:26:10.349958] [DEBUG] [LOCAL ] XPRO: Loaded 34015 existing records from primary storage. [2025-09-17T07:26:10.350137] [INFO ] [MAIN ] XPRO: Loaded 34015 existing records. [2025-09-17T07:26:10.526159] [WARN ] [MAIN ] XPRO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:26:10.526439] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-17T07:26:10.526519] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-17T07:26:10.527323] [DEBUG] [LOCAL ] XPRO: Deleted primary data file. [2025-09-17T07:26:10.527395] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-17T07:26:10.877914] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:26:11.090092] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-11. [2025-09-17T07:26:11.868754] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-17T07:26:11.890081] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-17T07:26:12.011827] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T07:26:12.090233] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T07:26:12.690138] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-09-17T07:26:13.490175] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-17T07:26:14.296937] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-17T07:26:14.304326] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-17T07:26:14.347947] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T07:26:14.674062] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T07:26:15.090201] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-09-17T07:26:15.890201] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-17T07:26:15.961288] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T07:26:16.679114] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T07:26:16.691533] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-17T07:26:17.490134] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-17T07:26:17.598869] [DEBUG] [REMOTE ] XPRO: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T07:26:17.599327] [WARN ] [REMOTE ] XPRO: No data returned for month 2025-02 [2025-09-17T07:26:18.240606] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-17T07:26:18.247338] [INFO ] [REMOTE ] XPEV: Full fetch complete (77602 records). [2025-09-17T07:26:18.247565] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-17T07:26:18.295228] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-17T07:26:18.607587] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T07:26:18.703277] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-17T07:26:18.703382] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-17T07:26:18.704541] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-17T07:26:18.704657] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-17T07:26:18.706341] [DEBUG] [LOCAL ] XPEV: Trimmed 77602 records to 53647 (keeping 200 days of data) [2025-09-17T07:26:19.042962] [DEBUG] [LOCAL ] XPEV: Primary data saved (53647 records). [2025-09-17T07:26:19.043144] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-17T07:26:19.043257] [INFO ] [MAIN ] Update Progress: 2338/2369 symbols completed. XPEV took 42.9s. Estimated remaining: 4m 32s. Rate: 6.8 symbols/min [2025-09-17T07:26:19.099621] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-17T07:26:19.222579] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:26:19.244924] [DEBUG] [LOCAL ] XYF: Loaded 21809 existing records from primary storage. [2025-09-17T07:26:19.245099] [INFO ] [MAIN ] XYF: Loaded 21809 existing records. [2025-09-17T07:26:19.428717] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:26:19.428967] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-17T07:26:19.429029] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-17T07:26:19.429572] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-17T07:26:19.429637] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-17T07:26:19.783249] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:26:19.891424] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-11. [2025-09-17T07:26:19.897052] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T07:26:20.439596] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T07:26:20.690117] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-17T07:26:20.775761] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T07:26:21.490189] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-09-17T07:26:22.084565] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T07:26:22.260613] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T07:26:22.290118] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-17T07:26:23.090170] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-17T07:26:23.875980] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T07:26:23.890094] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-17T07:26:24.352396] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T07:26:24.358391] [INFO ] [REMOTE ] XPO: Full fetch complete (70122 records). [2025-09-17T07:26:24.358616] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-17T07:26:24.695242] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-17T07:26:24.771382] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-09-17T07:26:24.771505] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-09-17T07:26:24.772679] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-09-17T07:26:24.772767] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-09-17T07:26:24.774345] [DEBUG] [LOCAL ] XPO: Trimmed 70122 records to 48336 (keeping 200 days of data) [2025-09-17T07:26:25.029248] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T07:26:25.111179] [DEBUG] [LOCAL ] XPO: Primary data saved (48336 records). [2025-09-17T07:26:25.111345] [INFO ] [MAIN ] XPO: Full history saved. [2025-09-17T07:26:25.111436] [INFO ] [MAIN ] Update Progress: 2339/2369 symbols completed. XPO took 40.2s. Estimated remaining: 4m 23s. Rate: 6.8 symbols/min [2025-09-17T07:26:25.279155] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:26:25.279358] [DEBUG] [LOCAL ] XYL: No existing data file found in primary storage. [2025-09-17T07:26:25.279408] [WARN ] [MAIN ] XYL: No existing data found, performing full refresh instead. [2025-09-17T07:26:25.279518] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-17T07:26:25.279562] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-17T07:26:25.279614] [DEBUG] [LOCAL ] XYL: No primary data file found to delete. [2025-09-17T07:26:25.279680] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-17T07:26:25.495350] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-09-17T07:26:25.642032] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:26:26.145846] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T07:26:26.225903] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T07:26:26.290116] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-17T07:26:27.078462] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T07:26:27.090066] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-17T07:26:27.890163] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-17T07:26:28.178382] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T07:26:28.690212] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-17T07:26:29.490145] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-11. [2025-09-17T07:26:29.553967] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T07:26:29.614829] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T07:26:30.290141] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-17T07:26:31.090136] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-17T07:26:31.121029] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T07:26:31.727542] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T07:26:31.890154] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-17T07:26:32.690117] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-17T07:26:32.733585] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T07:26:33.242517] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T07:26:33.490171] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-17T07:26:33.904241] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T07:26:34.290184] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-17T07:26:35.046906] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T07:26:35.090101] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-17T07:26:35.679345] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T07:26:35.890139] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-17T07:26:36.690118] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-17T07:26:36.745150] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T07:26:37.298010] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T07:26:37.490183] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-17T07:26:38.234018] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T07:26:38.290190] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-17T07:26:39.039316] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T07:26:39.045094] [INFO ] [REMOTE ] XPRO: Full fetch complete (60740 records). [2025-09-17T07:26:39.045219] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-17T07:26:39.099177] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-17T07:26:39.261745] [WARN ] [VALIDATOR ] XPRO: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T07:26:39.262674] [FATAL] [MAIN ] XPRO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:26:39.262753] [WARN ] [MAIN ] XPRO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:26:39.262912] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-17T07:26:39.263041] [DEBUG] [LOCAL ] XPRO: No primary data file found to delete. [2025-09-17T07:26:39.263147] [INFO ] [LOCAL ] XPRO: Starting deletion of derivative data. [2025-09-17T07:26:39.263672] [DEBUG] [LOCAL ] XPRO: Deleted derivative data file. [2025-09-17T07:26:39.263935] [INFO ] [MAIN ] Update Progress: 2340/2369 symbols completed. XPRO took 29.1s. Estimated remaining: 4m 15s. Rate: 6.8 symbols/min [2025-09-17T07:26:39.436573] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T07:26:39.467686] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:26:39.505978] [DEBUG] [LOCAL ] XYZ: Loaded 40104 existing records from primary storage. [2025-09-17T07:26:39.506168] [INFO ] [MAIN ] XYZ: Loaded 40104 existing records. [2025-09-17T07:26:39.683835] [WARN ] [MAIN ] XYZ: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:26:39.684072] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-17T07:26:39.684124] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-17T07:26:39.684907] [DEBUG] [LOCAL ] XYZ: Deleted primary data file. [2025-09-17T07:26:39.684968] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-17T07:26:39.895224] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-17T07:26:40.041824] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:26:40.690095] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-11. [2025-09-17T07:26:40.795224] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T07:26:40.879122] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:26:40.879473] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-11 [2025-09-17T07:26:41.126630] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T07:26:41.130629] [INFO ] [REMOTE ] XYF: Full fetch complete (30887 records). [2025-09-17T07:26:41.130743] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-17T07:26:41.497923] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-17T07:26:41.495997] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-17T07:26:41.498837] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-17T07:26:41.499670] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-17T07:26:41.499790] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-17T07:26:41.500719] [DEBUG] [LOCAL ] XYF: Trimmed 30887 records to 27636 (keeping 200 days of data) [2025-09-17T07:26:41.679721] [DEBUG] [LOCAL ] XYF: Primary data saved (27636 records). [2025-09-17T07:26:41.679878] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-17T07:26:41.680006] [INFO ] [MAIN ] Update Progress: 2341/2369 symbols completed. XYF took 22.6s. Estimated remaining: 4m 6s. Rate: 6.8 symbols/min [2025-09-17T07:26:41.759386] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T07:26:41.786576] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-17T07:26:41.858280] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:26:41.888711] [DEBUG] [LOCAL ] YALA: Loaded 28536 existing records from primary storage. [2025-09-17T07:26:41.888884] [INFO ] [MAIN ] YALA: Loaded 28536 existing records. [2025-09-17T07:26:42.071895] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:26:42.072151] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-17T07:26:42.072212] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-17T07:26:42.072916] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-17T07:26:42.072994] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-17T07:26:42.295243] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-09-17T07:26:42.453453] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:26:43.090143] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-17T07:26:43.640017] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T07:26:43.890182] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-17T07:26:44.628728] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T07:26:44.690155] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-11. [2025-09-17T07:26:45.490186] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-17T07:26:45.751968] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T07:26:46.032733] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-17T07:26:46.290150] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-17T07:26:46.859198] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T07:26:46.864766] [INFO ] [REMOTE ] XPOF: Full fetch complete (52083 records). [2025-09-17T07:26:46.864905] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-17T07:26:47.095293] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-09-17T07:26:47.244678] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-17T07:26:47.244792] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-17T07:26:47.245839] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-17T07:26:47.245921] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-17T07:26:47.247382] [DEBUG] [LOCAL ] XPOF: Trimmed 52083 records to 38918 (keeping 200 days of data) [2025-09-17T07:26:47.474171] [DEBUG] [LOCAL ] XPOF: Primary data saved (38918 records). [2025-09-17T07:26:47.474373] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-17T07:26:47.474554] [INFO ] [MAIN ] Update Progress: 2342/2369 symbols completed. XPOF took 43.6s. Estimated remaining: 3m 57s. Rate: 6.8 symbols/min [2025-09-17T07:26:47.648358] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:26:47.686220] [DEBUG] [LOCAL ] YELP: Loaded 33499 existing records from primary storage. [2025-09-17T07:26:47.686420] [INFO ] [MAIN ] YELP: Loaded 33499 existing records. [2025-09-17T07:26:47.871032] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:26:47.871348] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-17T07:26:47.871432] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-17T07:26:47.872178] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-17T07:26:47.872254] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-17T07:26:47.914999] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-17T07:26:48.232885] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:26:48.249557] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T07:26:48.283345] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T07:26:48.690139] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-11. [2025-09-17T07:26:49.490144] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-17T07:26:50.116257] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-17T07:26:50.155251] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T07:26:50.290110] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-09-17T07:26:51.090137] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-17T07:26:51.325691] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T07:26:51.763720] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T07:26:51.890138] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-09-17T07:26:52.690154] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-09-17T07:26:53.183904] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T07:26:53.345866] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T07:26:53.490180] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-17T07:26:53.729468] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T07:26:54.290148] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-17T07:26:54.870206] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T07:26:55.090194] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-17T07:26:55.890156] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-17T07:26:56.690972] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.40 seconds). [2025-09-17T07:26:56.691204] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-17T07:26:56.734134] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T07:26:56.888754] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T07:26:57.490193] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-17T07:26:58.290197] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-17T07:26:58.333377] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T07:26:59.090140] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-17T07:26:59.157058] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T07:26:59.656251] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T07:26:59.890130] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-17T07:27:00.430186] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T07:27:00.690123] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-17T07:27:01.490125] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-17T07:27:02.290183] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-17T07:27:02.893734] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T07:27:02.945088] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-09-17T07:27:03.090150] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-17T07:27:03.890233] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-17T07:27:04.130582] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-17T07:27:04.690124] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-17T07:27:04.756474] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T07:27:05.385606] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (3.10 seconds). [2025-09-17T07:27:05.490146] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-17T07:27:05.828419] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T07:27:06.240680] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T07:27:06.290111] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-17T07:27:06.940667] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T07:27:07.090208] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-17T07:27:07.892563] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-17T07:27:07.898410] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T07:27:08.453082] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T07:27:08.690155] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-17T07:27:09.490136] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-17T07:27:10.023153] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-17T07:27:10.030168] [INFO ] [REMOTE ] XYZ: Full fetch complete (64278 records). [2025-09-17T07:27:10.030387] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-17T07:27:10.231095] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-17T07:27:10.231913] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T07:27:10.232074] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T07:27:10.232226] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-17T07:27:10.232364] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-17T07:27:10.232528] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-17T07:27:10.233042] [DEBUG] [LOCAL ] XYZ: Deleted derivative data file. [2025-09-17T07:27:10.233206] [INFO ] [MAIN ] Update Progress: 2343/2369 symbols completed. XYZ took 31.0s. Estimated remaining: 3m 48s. Rate: 6.8 symbols/min [2025-09-17T07:27:10.298330] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-17T07:27:10.413945] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:27:10.444112] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T07:27:10.489492] [DEBUG] [LOCAL ] YETI: Loaded 39396 existing records from primary storage. [2025-09-17T07:27:10.489689] [INFO ] [MAIN ] YETI: Loaded 39396 existing records. [2025-09-17T07:27:10.671160] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:27:10.671397] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-17T07:27:10.671448] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-17T07:27:10.672290] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-17T07:27:10.672354] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-17T07:27:11.026310] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:27:11.052310] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T07:27:11.090088] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-11. [2025-09-17T07:27:11.852425] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T07:27:11.890142] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-17T07:27:12.690168] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-17T07:27:12.731574] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T07:27:12.971199] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T07:27:12.976933] [INFO ] [REMOTE ] YELP: Full fetch complete (63987 records). [2025-09-17T07:27:12.977110] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-17T07:27:13.369873] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-17T07:27:13.370027] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-17T07:27:13.371332] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-17T07:27:13.371431] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-17T07:27:13.373048] [DEBUG] [LOCAL ] YELP: Trimmed 63987 records to 45380 (keeping 200 days of data) [2025-09-17T07:27:13.490470] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-17T07:27:13.646051] [DEBUG] [LOCAL ] YELP: Primary data saved (45380 records). [2025-09-17T07:27:13.646221] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-17T07:27:13.646333] [INFO ] [MAIN ] Update Progress: 2344/2369 symbols completed. YELP took 26.2s. Estimated remaining: 3m 40s. Rate: 6.8 symbols/min [2025-09-17T07:27:13.816036] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:27:13.845281] [DEBUG] [LOCAL ] YEXT: Loaded 31636 existing records from primary storage. [2025-09-17T07:27:13.845448] [INFO ] [MAIN ] YEXT: Loaded 31636 existing records. [2025-09-17T07:27:14.027406] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:27:14.041476] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-17T07:27:14.041861] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-17T07:27:14.042928] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T07:27:14.042997] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-17T07:27:14.045035] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-17T07:27:14.111500] [INFO ] [REMOTE ] YALA: Full fetch complete (46522 records). [2025-09-17T07:27:14.149150] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-17T07:27:14.296411] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-09-17T07:27:14.672418] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:27:14.833546] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-17T07:27:14.833671] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-17T07:27:14.834550] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-17T07:27:14.834620] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-17T07:27:14.835759] [DEBUG] [LOCAL ] YALA: Trimmed 46522 records to 37282 (keeping 200 days of data) [2025-09-17T07:27:15.046036] [DEBUG] [LOCAL ] YALA: Primary data saved (37282 records). [2025-09-17T07:27:15.046213] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-17T07:27:15.046313] [INFO ] [MAIN ] Update Progress: 2345/2369 symbols completed. YALA took 33.4s. Estimated remaining: 3m 31s. Rate: 6.8 symbols/min [2025-09-17T07:27:15.095257] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-11. [2025-09-17T07:27:15.223518] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:27:15.251593] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T07:27:15.296522] [DEBUG] [LOCAL ] YMM: Loaded 39200 existing records from primary storage. [2025-09-17T07:27:15.296716] [INFO ] [MAIN ] YMM: Loaded 39200 existing records. [2025-09-17T07:27:15.471505] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:27:15.471764] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-17T07:27:15.471823] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-17T07:27:15.472543] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-17T07:27:15.472600] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-17T07:27:15.822015] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:27:15.890089] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-11. [2025-09-17T07:27:16.082535] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T07:27:16.690145] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-09-17T07:27:16.747883] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T07:27:17.490183] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-09-17T07:27:17.539249] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T07:27:18.290178] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-09-17T07:27:18.346050] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T07:27:19.090167] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-17T07:27:19.531133] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T07:27:19.890140] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-09-17T07:27:20.690154] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-17T07:27:21.012376] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-17T07:27:21.234476] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (2.14 seconds). [2025-09-17T07:27:21.240899] [INFO ] [REMOTE ] XYL: Full fetch complete (69813 records). [2025-09-17T07:27:21.241132] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-17T07:27:21.499604] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-09-17T07:27:21.637774] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-17T07:27:21.637948] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-17T07:27:21.639151] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-17T07:27:21.639304] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-17T07:27:21.641160] [DEBUG] [LOCAL ] XYL: Trimmed 69813 records to 48228 (keeping 200 days of data) [2025-09-17T07:27:21.764219] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T07:27:21.984517] [DEBUG] [LOCAL ] XYL: Primary data saved (48228 records). [2025-09-17T07:27:21.984736] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-17T07:27:21.984843] [INFO ] [MAIN ] Update Progress: 2346/2369 symbols completed. XYL took 56.9s. Estimated remaining: 3m 22s. Rate: 6.8 symbols/min [2025-09-17T07:27:22.155485] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:27:22.193157] [DEBUG] [LOCAL ] YOU: Loaded 36926 existing records from primary storage. [2025-09-17T07:27:22.193362] [INFO ] [MAIN ] YOU: Loaded 36926 existing records. [2025-09-17T07:27:22.292466] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-17T07:27:22.379906] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:27:22.380289] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-17T07:27:22.380485] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-17T07:27:22.389449] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-17T07:27:22.396395] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-17T07:27:22.506880] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T07:27:22.779073] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:27:22.974081] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T07:27:23.090187] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-17T07:27:23.480812] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T07:27:23.890187] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-17T07:27:24.573521] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T07:27:24.690116] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-17T07:27:25.492718] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-11. [2025-09-17T07:27:25.498518] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T07:27:26.290214] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-17T07:27:26.412735] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T07:27:27.090153] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-17T07:27:27.251403] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T07:27:27.868814] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T07:27:27.890107] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-09-17T07:27:28.690245] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-17T07:27:28.921202] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T07:27:29.271161] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T07:27:29.490134] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-17T07:27:30.290131] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-17T07:27:30.466303] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T07:27:31.090184] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-17T07:27:31.173069] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T07:27:31.740690] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T07:27:31.890134] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-17T07:27:32.690191] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-17T07:27:32.720423] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T07:27:33.480879] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T07:27:33.490273] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-17T07:27:34.290188] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-17T07:27:34.543502] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T07:27:35.090150] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-17T07:27:35.184976] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T07:27:35.433845] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T07:27:35.890144] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-17T07:27:36.300070] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T07:27:36.690137] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-17T07:27:37.436100] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T07:27:37.490094] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-17T07:27:38.290183] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-17T07:27:38.492845] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T07:27:38.973862] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T07:27:38.979592] [INFO ] [REMOTE ] YEXT: Full fetch complete (63168 records). [2025-09-17T07:27:38.979755] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-17T07:27:39.095290] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-17T07:27:39.367538] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-17T07:27:39.367722] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-17T07:27:39.368773] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-17T07:27:39.368830] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-17T07:27:39.370268] [DEBUG] [LOCAL ] YEXT: Trimmed 63168 records to 43384 (keeping 200 days of data) [2025-09-17T07:27:39.619706] [DEBUG] [LOCAL ] YEXT: Primary data saved (43384 records). [2025-09-17T07:27:39.619869] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-17T07:27:39.619976] [INFO ] [MAIN ] Update Progress: 2347/2369 symbols completed. YEXT took 26.0s. Estimated remaining: 3m 13s. Rate: 6.8 symbols/min [2025-09-17T07:27:39.789143] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:27:39.828495] [DEBUG] [LOCAL ] YPF: Loaded 37391 existing records from primary storage. [2025-09-17T07:27:39.828729] [INFO ] [MAIN ] YPF: Loaded 37391 existing records. [2025-09-17T07:27:39.896853] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-17T07:27:40.011003] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:27:40.011335] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-17T07:27:40.011406] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-17T07:27:40.012271] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-17T07:27:40.012338] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-17T07:27:40.302335] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T07:27:40.419534] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:27:40.690101] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-11. [2025-09-17T07:27:40.934489] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T07:27:41.490189] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-17T07:27:41.659439] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T07:27:42.290153] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-17T07:27:42.475820] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T07:27:42.930581] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T07:27:43.090137] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-17T07:27:43.597358] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T07:27:43.607752] [INFO ] [REMOTE ] YMM: Full fetch complete (76306 records). [2025-09-17T07:27:43.608005] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-17T07:27:43.895389] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-09-17T07:27:44.025302] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-17T07:27:44.025486] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-17T07:27:44.026735] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-17T07:27:44.026798] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-17T07:27:44.028396] [DEBUG] [LOCAL ] YMM: Trimmed 76306 records to 52714 (keeping 200 days of data) [2025-09-17T07:27:44.348897] [DEBUG] [LOCAL ] YMM: Primary data saved (52714 records). [2025-09-17T07:27:44.349067] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-17T07:27:44.349192] [INFO ] [MAIN ] Update Progress: 2348/2369 symbols completed. YMM took 29.3s. Estimated remaining: 3m 4s. Rate: 6.8 symbols/min [2025-09-17T07:27:44.530582] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:27:44.569360] [DEBUG] [LOCAL ] YRD: Loaded 7983 existing records from primary storage. [2025-09-17T07:27:44.569558] [INFO ] [MAIN ] YRD: Loaded 7983 existing records. [2025-09-17T07:27:44.605433] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T07:27:44.690383] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-17T07:27:44.773990] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:27:44.774225] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-17T07:27:44.774285] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-17T07:27:44.774669] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-17T07:27:44.774732] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-17T07:27:45.139674] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:27:45.490132] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-11. [2025-09-17T07:27:45.654680] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T07:27:46.296498] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-17T07:27:46.315134] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T07:27:46.489512] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T07:27:47.090128] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-09-17T07:27:47.890135] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-09-17T07:27:47.984913] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T07:27:48.156278] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T07:27:48.690133] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-17T07:27:49.490169] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-17T07:27:49.637397] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T07:27:50.290170] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-09-17T07:27:50.518614] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T07:27:51.095351] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-17T07:27:51.108757] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T07:27:51.128511] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T07:27:51.890164] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-17T07:27:52.699484] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-17T07:27:52.720696] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T07:27:52.860002] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T07:27:53.490127] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-17T07:27:54.290133] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-17T07:27:54.492389] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T07:27:55.037521] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T07:27:55.090096] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-17T07:27:55.611349] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T07:27:55.617991] [INFO ] [REMOTE ] YETI: Full fetch complete (75251 records). [2025-09-17T07:27:55.618194] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-17T07:27:55.899468] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-17T07:27:56.055214] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-17T07:27:56.055384] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-17T07:27:56.057703] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-17T07:27:56.057850] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-17T07:27:56.060065] [DEBUG] [LOCAL ] YETI: Trimmed 75251 records to 52519 (keeping 200 days of data) [2025-09-17T07:27:56.558984] [DEBUG] [LOCAL ] YETI: Primary data saved (52519 records). [2025-09-17T07:27:56.559218] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-17T07:27:56.559351] [INFO ] [MAIN ] Update Progress: 2349/2369 symbols completed. YETI took 46.3s. Estimated remaining: 2m 56s. Rate: 6.8 symbols/min [2025-09-17T07:27:56.695237] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-17T07:27:56.806710] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:27:56.873075] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T07:27:56.897912] [DEBUG] [LOCAL ] YSG: Loaded 19736 existing records from primary storage. [2025-09-17T07:27:56.898768] [INFO ] [MAIN ] YSG: Loaded 19736 existing records. [2025-09-17T07:27:57.110775] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:27:57.111038] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-17T07:27:57.111097] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-17T07:27:57.111668] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-17T07:27:57.111728] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-17T07:27:57.475670] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:27:57.491210] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-17T07:27:57.492673] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T07:27:57.511358] [INFO ] [REMOTE ] YOU: Full fetch complete (72111 records). [2025-09-17T07:27:57.511818] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T07:27:57.512150] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-17T07:27:57.902127] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-17T07:27:57.902234] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-17T07:27:57.903336] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-17T07:27:57.903394] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-17T07:27:57.904819] [DEBUG] [LOCAL ] YOU: Trimmed 72111 records to 49976 (keeping 200 days of data) [2025-09-17T07:27:58.219773] [DEBUG] [LOCAL ] YOU: Primary data saved (49976 records). [2025-09-17T07:27:58.219930] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-17T07:27:58.220021] [INFO ] [MAIN ] Update Progress: 2350/2369 symbols completed. YOU took 36.2s. Estimated remaining: 2m 47s. Rate: 6.8 symbols/min [2025-09-17T07:27:58.295768] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-17T07:27:58.396359] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:27:58.396600] [DEBUG] [LOCAL ] YUM: No existing data file found in primary storage. [2025-09-17T07:27:58.396671] [WARN ] [MAIN ] YUM: No existing data found, performing full refresh instead. [2025-09-17T07:27:58.396785] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-17T07:27:58.396838] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-17T07:27:58.396889] [DEBUG] [LOCAL ] YUM: No primary data file found to delete. [2025-09-17T07:27:58.396930] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-17T07:27:58.771099] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:27:59.090147] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-11. [2025-09-17T07:27:59.256701] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T07:27:59.293279] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T07:27:59.890129] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-17T07:28:00.671010] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T07:28:00.690089] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-11. [2025-09-17T07:28:00.718324] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T07:28:01.490126] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-09-17T07:28:02.039634] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T07:28:02.290156] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-17T07:28:02.817676] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T07:28:03.090139] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-17T07:28:03.127747] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T07:28:03.890150] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-17T07:28:04.690207] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-09-17T07:28:04.832605] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T07:28:04.867452] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T07:28:05.490181] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-09-17T07:28:06.023336] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T07:28:06.290139] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-09-17T07:28:07.090149] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-17T07:28:07.137813] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T07:28:07.260279] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T07:28:07.894966] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-17T07:28:07.896707] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T07:28:08.690173] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-17T07:28:09.497723] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-17T07:28:09.516233] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T07:28:09.744099] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T07:28:09.745872] [INFO ] [REMOTE ] YRD: Full fetch complete (19514 records). [2025-09-17T07:28:09.745959] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-17T07:28:10.114018] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-17T07:28:10.114161] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-17T07:28:10.114667] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-17T07:28:10.115269] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-17T07:28:10.115930] [DEBUG] [LOCAL ] YRD: Trimmed 19514 records to 12652 (keeping 200 days of data) [2025-09-17T07:28:10.190332] [DEBUG] [LOCAL ] YRD: Primary data saved (12652 records). [2025-09-17T07:28:10.190485] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-17T07:28:10.190595] [INFO ] [MAIN ] Update Progress: 2351/2369 symbols completed. YRD took 25.8s. Estimated remaining: 2m 38s. Rate: 6.8 symbols/min [2025-09-17T07:28:10.290285] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-17T07:28:10.363370] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:28:10.399943] [DEBUG] [LOCAL ] YUMC: Loaded 39174 existing records from primary storage. [2025-09-17T07:28:10.400118] [INFO ] [MAIN ] YUMC: Loaded 39174 existing records. [2025-09-17T07:28:10.578860] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:28:10.579109] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-17T07:28:10.579164] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-17T07:28:10.580078] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-17T07:28:10.580141] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-17T07:28:10.934504] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:28:11.090159] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-17T07:28:11.120726] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T07:28:11.182876] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T07:28:11.890152] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-17T07:28:12.690197] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-11. [2025-09-17T07:28:12.898568] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T07:28:13.490202] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-17T07:28:13.591974] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T07:28:14.290193] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-17T07:28:14.368929] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T07:28:14.918674] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T07:28:15.090128] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-17T07:28:15.521385] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T07:28:15.890137] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-09-17T07:28:16.615781] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T07:28:16.690109] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-17T07:28:17.502618] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-17T07:28:17.528414] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T07:28:18.290138] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-17T07:28:18.423083] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T07:28:18.638413] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T07:28:19.090136] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-17T07:28:19.890197] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-17T07:28:19.966850] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T07:28:19.973419] [INFO ] [REMOTE ] YPF: Full fetch complete (73375 records). [2025-09-17T07:28:19.973573] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-17T07:28:20.374063] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-17T07:28:20.374168] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-17T07:28:20.375627] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-17T07:28:20.375730] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-17T07:28:20.377289] [DEBUG] [LOCAL ] YPF: Trimmed 73375 records to 50473 (keeping 200 days of data) [2025-09-17T07:28:20.683420] [DEBUG] [LOCAL ] YPF: Primary data saved (50473 records). [2025-09-17T07:28:20.683588] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-17T07:28:20.683706] [INFO ] [MAIN ] Update Progress: 2352/2369 symbols completed. YPF took 41.1s. Estimated remaining: 2m 29s. Rate: 6.8 symbols/min [2025-09-17T07:28:20.695514] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-09-17T07:28:20.857046] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:28:20.868478] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T07:28:20.905306] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T07:28:20.942011] [DEBUG] [LOCAL ] ZBH: Loaded 38056 existing records from primary storage. [2025-09-17T07:28:20.942196] [INFO ] [MAIN ] ZBH: Loaded 38056 existing records. [2025-09-17T07:28:21.118576] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:28:21.118928] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-17T07:28:21.118988] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-17T07:28:21.119764] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-17T07:28:21.119823] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-17T07:28:21.477845] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:28:21.490095] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-11. [2025-09-17T07:28:22.290185] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-17T07:28:22.500126] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T07:28:23.079684] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T07:28:23.090072] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-09-17T07:28:23.890160] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-17T07:28:24.056746] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T07:28:24.690128] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-17T07:28:24.798820] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T07:28:25.490246] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-09-17T07:28:25.624999] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T07:28:26.290104] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-17T07:28:26.375234] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T07:28:26.381700] [INFO ] [REMOTE ] YUM: Full fetch complete (74154 records). [2025-09-17T07:28:26.381878] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-17T07:28:26.784852] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-17T07:28:26.784959] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-17T07:28:26.786063] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-17T07:28:26.786120] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-17T07:28:26.787522] [DEBUG] [LOCAL ] YUM: Trimmed 74154 records to 51307 (keeping 200 days of data) [2025-09-17T07:28:27.093444] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-17T07:28:27.116617] [DEBUG] [LOCAL ] YUM: Primary data saved (51307 records). [2025-09-17T07:28:27.116863] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-17T07:28:27.116966] [INFO ] [MAIN ] Update Progress: 2353/2369 symbols completed. YUM took 28.9s. Estimated remaining: 2m 20s. Rate: 6.8 symbols/min [2025-09-17T07:28:27.303125] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:28:27.341662] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T07:28:27.351668] [DEBUG] [LOCAL ] ZEPP: Loaded 14833 existing records from primary storage. [2025-09-17T07:28:27.366220] [INFO ] [MAIN ] ZEPP: Loaded 14833 existing records. [2025-09-17T07:28:27.416034] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T07:28:27.578190] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:28:27.578466] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-17T07:28:27.578524] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-17T07:28:27.578978] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-17T07:28:27.579042] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-17T07:28:27.895316] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-17T07:28:27.949574] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:28:28.690179] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-11. [2025-09-17T07:28:28.997900] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-17T07:28:28.999512] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T07:28:29.490268] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-17T07:28:29.612440] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T07:28:30.290186] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-09-17T07:28:30.802725] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T07:28:30.848630] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T07:28:31.090173] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-17T07:28:31.890141] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-09-17T07:28:32.409550] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T07:28:32.433071] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T07:28:32.690154] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-17T07:28:33.490158] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-17T07:28:33.974715] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T07:28:34.290181] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-17T07:28:34.821920] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T07:28:35.090107] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-17T07:28:35.163910] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T07:28:35.890132] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-17T07:28:36.675057] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T07:28:36.690077] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-17T07:28:37.490154] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-17T07:28:37.690116] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T07:28:38.290106] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-17T07:28:38.458893] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T07:28:38.479598] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T07:28:38.483322] [INFO ] [REMOTE ] YSG: Full fetch complete (33092 records). [2025-09-17T07:28:38.483454] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-17T07:28:38.864817] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-17T07:28:38.864947] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-17T07:28:38.865712] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-17T07:28:38.865771] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-17T07:28:38.866785] [DEBUG] [LOCAL ] YSG: Trimmed 33092 records to 24539 (keeping 200 days of data) [2025-09-17T07:28:39.008807] [DEBUG] [LOCAL ] YSG: Primary data saved (24539 records). [2025-09-17T07:28:39.008976] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-17T07:28:39.009077] [INFO ] [MAIN ] Update Progress: 2354/2369 symbols completed. YSG took 42.4s. Estimated remaining: 2m 12s. Rate: 6.8 symbols/min [2025-09-17T07:28:39.099359] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-17T07:28:39.180629] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:28:39.180919] [DEBUG] [LOCAL ] ZETA: No existing data file found in primary storage. [2025-09-17T07:28:39.180993] [WARN ] [MAIN ] ZETA: No existing data found, performing full refresh instead. [2025-09-17T07:28:39.181134] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-17T07:28:39.181216] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-17T07:28:39.181292] [DEBUG] [LOCAL ] ZETA: No primary data file found to delete. [2025-09-17T07:28:39.181347] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-17T07:28:39.568999] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:28:39.890162] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-11. [2025-09-17T07:28:40.055307] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T07:28:40.690270] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-17T07:28:40.882423] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T07:28:41.490182] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-17T07:28:42.065811] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-11 (2.18 seconds). [2025-09-17T07:28:42.290159] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-09-17T07:28:42.480608] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T07:28:43.090146] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-17T07:28:43.237491] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T07:28:43.434200] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-17T07:28:43.890156] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-17T07:28:44.439995] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T07:28:44.688988] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-17T07:28:44.696464] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-17T07:28:45.490154] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-09-17T07:28:46.290154] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-17T07:28:46.337291] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T07:28:47.090163] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-17T07:28:47.682938] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T07:28:47.716741] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-17T07:28:47.890147] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-17T07:28:48.017133] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T07:28:48.537196] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T07:28:48.690135] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-17T07:28:49.490142] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-17T07:28:50.290181] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-17T07:28:50.442075] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T07:28:51.090202] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-17T07:28:51.737154] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T07:28:51.786540] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-17T07:28:51.890132] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-17T07:28:52.690150] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-17T07:28:52.798735] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T07:28:52.805636] [INFO ] [REMOTE ] YUMC: Full fetch complete (75925 records). [2025-09-17T07:28:52.805868] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-17T07:28:53.213745] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-17T07:28:53.213930] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-17T07:28:53.215133] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-17T07:28:53.215224] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-17T07:28:53.218257] [DEBUG] [LOCAL ] YUMC: Trimmed 75925 records to 52731 (keeping 200 days of data) [2025-09-17T07:28:53.516803] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-17T07:28:53.566987] [DEBUG] [LOCAL ] YUMC: Primary data saved (52731 records). [2025-09-17T07:28:53.567145] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-17T07:28:53.567282] [INFO ] [MAIN ] Update Progress: 2355/2369 symbols completed. YUMC took 43.4s. Estimated remaining: 2m 3s. Rate: 6.8 symbols/min [2025-09-17T07:28:53.749291] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:28:53.781605] [DEBUG] [LOCAL ] ZGN: Loaded 30276 existing records from primary storage. [2025-09-17T07:28:53.781798] [INFO ] [MAIN ] ZGN: Loaded 30276 existing records. [2025-09-17T07:28:53.972985] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:28:53.973451] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-17T07:28:53.973570] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-17T07:28:53.974226] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-17T07:28:53.974313] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-17T07:28:54.195751] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-17T07:28:54.295328] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-17T07:28:54.391282] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:28:54.413965] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T07:28:55.090150] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-17T07:28:55.188460] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T07:28:55.196093] [INFO ] [REMOTE ] ZBH: Full fetch complete (73506 records). [2025-09-17T07:28:55.196242] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-17T07:28:55.589008] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-17T07:28:55.589123] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-17T07:28:55.590382] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-17T07:28:55.590444] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-17T07:28:55.592060] [DEBUG] [LOCAL ] ZBH: Trimmed 73506 records to 51201 (keeping 200 days of data) [2025-09-17T07:28:55.899141] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-11. [2025-09-17T07:28:55.921312] [DEBUG] [LOCAL ] ZBH: Primary data saved (51201 records). [2025-09-17T07:28:55.921565] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-17T07:28:55.921771] [INFO ] [MAIN ] Update Progress: 2356/2369 symbols completed. ZBH took 35.2s. Estimated remaining: 1m 54s. Rate: 6.8 symbols/min [2025-09-17T07:28:56.124082] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T07:28:56.127373] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:28:56.157733] [DEBUG] [LOCAL ] ZH: Loaded 17989 existing records from primary storage. [2025-09-17T07:28:56.157932] [INFO ] [MAIN ] ZH: Loaded 17989 existing records. [2025-09-17T07:28:56.337827] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:28:56.338116] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-17T07:28:56.338174] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-17T07:28:56.338623] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-17T07:28:56.338721] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-17T07:28:56.701835] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-17T07:28:56.706994] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:28:56.721198] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T07:28:56.725893] [INFO ] [REMOTE ] ZEPP: Full fetch complete (17181 records). [2025-09-17T07:28:56.725994] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-17T07:28:57.109065] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-17T07:28:57.109294] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-17T07:28:57.110034] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-17T07:28:57.110114] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-17T07:28:57.111119] [DEBUG] [LOCAL ] ZEPP: Trimmed 17181 records to 15909 (keeping 200 days of data) [2025-09-17T07:28:57.135103] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T07:28:57.248969] [DEBUG] [LOCAL ] ZEPP: Primary data saved (15909 records). [2025-09-17T07:28:57.249146] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-17T07:28:57.249305] [INFO ] [MAIN ] Update Progress: 2357/2369 symbols completed. ZEPP took 30.1s. Estimated remaining: 1m 45s. Rate: 6.8 symbols/min [2025-09-17T07:28:57.490269] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-11. [2025-09-17T07:28:58.290230] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-09-17T07:28:58.638972] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T07:28:58.886514] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-17T07:28:59.090205] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-17T07:28:59.890193] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-09-17T07:28:59.945176] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T07:29:00.690108] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-09-17T07:29:00.951431] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T07:29:01.133575] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T07:29:01.490121] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-09-17T07:29:02.234173] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T07:29:02.290106] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-17T07:29:02.498919] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T07:29:03.090191] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-17T07:29:03.652966] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T07:29:03.890128] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-17T07:29:04.690158] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-17T07:29:05.308370] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-17T07:29:05.394794] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T07:29:05.490159] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-17T07:29:05.824207] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T07:29:06.290147] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-17T07:29:06.768814] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T07:29:07.090147] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-17T07:29:07.767118] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T07:29:07.890173] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-17T07:29:08.690191] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-17T07:29:09.314503] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T07:29:09.490113] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-17T07:29:09.561328] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-17T07:29:09.961961] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T07:29:10.290174] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-17T07:29:10.966022] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T07:29:11.090122] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-17T07:29:11.890234] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-17T07:29:12.470745] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-17T07:29:12.477463] [INFO ] [REMOTE ] ZETA: Full fetch complete (77640 records). [2025-09-17T07:29:12.477696] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-17T07:29:12.693888] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T07:29:12.785564] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-17T07:29:12.918618] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-17T07:29:12.918854] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-17T07:29:12.920089] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-17T07:29:12.920244] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-17T07:29:12.950026] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T07:29:12.950177] [DEBUG] [LOCAL ] ZETA: Trimmed 77640 records to 53595 (keeping 200 days of data) [2025-09-17T07:29:13.286388] [DEBUG] [LOCAL ] ZETA: Primary data saved (53595 records). [2025-09-17T07:29:13.286565] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-17T07:29:13.286679] [INFO ] [MAIN ] Update Progress: 2358/2369 symbols completed. ZETA took 34.3s. Estimated remaining: 1m 37s. Rate: 6.8 symbols/min [2025-09-17T07:29:13.490096] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-17T07:29:13.884889] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T07:29:14.290143] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-17T07:29:14.868067] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T07:29:15.090200] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-17T07:29:15.538558] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T07:29:15.890209] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-17T07:29:16.503547] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T07:29:16.508909] [INFO ] [REMOTE ] ZGN: Full fetch complete (58293 records). [2025-09-17T07:29:16.509039] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-17T07:29:16.900971] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-17T07:29:16.901102] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-17T07:29:16.902309] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-17T07:29:16.902410] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-17T07:29:16.903970] [DEBUG] [LOCAL ] ZGN: Trimmed 58293 records to 40934 (keeping 200 days of data) [2025-09-17T07:29:17.011670] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T07:29:17.019371] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-17T07:29:17.175478] [DEBUG] [LOCAL ] ZGN: Primary data saved (40934 records). [2025-09-17T07:29:17.175662] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-17T07:29:17.175767] [INFO ] [MAIN ] Update Progress: 2359/2369 symbols completed. ZGN took 23.6s. Estimated remaining: 1m 28s. Rate: 6.8 symbols/min [2025-09-17T07:29:18.409925] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T07:29:18.413706] [INFO ] [REMOTE ] ZH: Full fetch complete (39598 records). [2025-09-17T07:29:18.413848] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-17T07:29:18.790615] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-17T07:29:18.790755] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-17T07:29:18.791637] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-17T07:29:18.791722] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-17T07:29:18.792838] [DEBUG] [LOCAL ] ZH: Trimmed 39598 records to 27365 (keeping 200 days of data) [2025-09-17T07:29:18.945449] [DEBUG] [LOCAL ] ZH: Primary data saved (27365 records). [2025-09-17T07:29:18.945611] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-17T07:29:18.945733] [INFO ] [MAIN ] Update Progress: 2360/2369 symbols completed. ZH took 23.0s. Estimated remaining: 1m 19s. Rate: 6.8 symbols/min [2025-09-17T07:29:19.654342] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:29:19.599252] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:29:19.655120] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:29:19.686376] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:29:19.697398] [DEBUG] [LOCAL ] ZKH: Loaded 5809 existing records from primary storage. [2025-09-17T07:29:19.697806] [INFO ] [MAIN ] ZKH: Loaded 5809 existing records. [2025-09-17T07:29:19.931329] [DEBUG] [LOCAL ] ZK: Loaded 28414 existing records from primary storage. [2025-09-17T07:29:19.943121] [INFO ] [MAIN ] ZK: Loaded 28414 existing records. [2025-09-17T07:29:19.931250] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:29:19.982386] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-17T07:29:19.983005] [DEBUG] [LOCAL ] ZIM: Loaded 39916 existing records from primary storage. [2025-09-17T07:29:19.989045] [DEBUG] [LOCAL ] ZIP: Loaded 32337 existing records from primary storage. [2025-09-17T07:29:20.008005] [INFO ] [MAIN ] ZIP: Loaded 32337 existing records. [2025-09-17T07:29:20.007860] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-17T07:29:20.028584] [INFO ] [MAIN ] ZIM: Loaded 39916 existing records. [2025-09-17T07:29:20.091538] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-17T07:29:20.280152] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-17T07:29:20.344032] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:29:20.388527] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-17T07:29:20.515593] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-17T07:29:20.592883] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:29:20.598592] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-17T07:29:20.684260] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-17T07:29:20.659571] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:29:20.703482] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-17T07:29:20.722708] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-17T07:29:20.825081] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-17T07:29:20.840657] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-17T07:29:20.824991] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-17T07:29:20.859578] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-17T07:29:20.884228] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-17T07:29:21.015196] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-17T07:29:21.185086] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:29:21.299743] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-11. [2025-09-17T07:29:21.727889] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:29:21.761153] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-11. [2025-09-17T07:29:21.866060] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:29:21.882059] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-11. [2025-09-17T07:29:21.935027] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:29:21.935305] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-11. [2025-09-17T07:29:22.187116] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T07:29:22.189231] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-09-17T07:29:22.762581] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T07:29:22.764457] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-09-17T07:29:23.272954] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T07:29:23.280811] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-09-17T07:29:23.287578] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T07:29:23.290572] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-17T07:29:23.318208] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T07:29:23.809629] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T07:29:23.814381] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T07:29:23.890148] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-09-17T07:29:24.622458] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T07:29:24.690102] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-09-17T07:29:25.497055] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-17T07:29:25.513765] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T07:29:25.957418] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T07:29:26.286059] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T07:29:26.290081] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-17T07:29:26.898234] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T07:29:27.090132] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-17T07:29:27.890155] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-09-17T07:29:28.446491] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T07:29:28.690180] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-09-17T07:29:29.263265] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T07:29:29.490161] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-17T07:29:30.062731] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T07:29:30.290145] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-17T07:29:30.604657] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T07:29:31.090173] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-09-17T07:29:31.824786] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T07:29:31.890145] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-17T07:29:32.690149] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-17T07:29:33.246956] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-17T07:29:33.495232] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-17T07:29:33.513930] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T07:29:34.126087] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T07:29:34.137386] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T07:29:34.290120] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-17T07:29:35.090132] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-17T07:29:35.127069] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T07:29:35.890134] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-17T07:29:36.690148] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-17T07:29:36.798886] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T07:29:37.434392] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T07:29:37.490131] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-17T07:29:37.898787] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T07:29:38.236618] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T07:29:38.238127] [INFO ] [REMOTE ] ZKH: Full fetch complete (11803 records). [2025-09-17T07:29:38.238222] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-17T07:29:38.295304] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-17T07:29:38.607630] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-17T07:29:38.607772] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-17T07:29:38.608114] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-17T07:29:38.608188] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-17T07:29:38.608766] [DEBUG] [LOCAL ] ZKH: Trimmed 11803 records to 7984 (keeping 200 days of data) [2025-09-17T07:29:38.651314] [DEBUG] [LOCAL ] ZKH: Primary data saved (7984 records). [2025-09-17T07:29:38.651465] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-17T07:29:38.651568] [INFO ] [MAIN ] Update Progress: 2361/2369 symbols completed. ZKH took 19.7s. Estimated remaining: 1m 10s. Rate: 6.8 symbols/min [2025-09-17T07:29:38.819700] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:29:38.857811] [DEBUG] [LOCAL ] ZTO: Loaded 36806 existing records from primary storage. [2025-09-17T07:29:38.858021] [INFO ] [MAIN ] ZTO: Loaded 36806 existing records. [2025-09-17T07:29:39.036749] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:29:39.036990] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-17T07:29:39.037051] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-17T07:29:39.037860] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-17T07:29:39.037925] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-17T07:29:39.101264] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-17T07:29:39.437212] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:29:39.890184] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-11. [2025-09-17T07:29:40.024818] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T07:29:40.690143] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-17T07:29:40.753432] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T07:29:41.160050] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T07:29:41.490194] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-09-17T07:29:42.188673] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T07:29:42.290173] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-17T07:29:43.090242] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-17T07:29:43.199974] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T07:29:43.781890] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T07:29:43.890188] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-17T07:29:44.690138] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-09-17T07:29:45.296689] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T07:29:45.359424] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-17T07:29:45.490116] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-17T07:29:46.290189] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-17T07:29:46.388487] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T07:29:46.911768] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T07:29:46.916878] [INFO ] [REMOTE ] ZIP: Full fetch complete (59068 records). [2025-09-17T07:29:46.917023] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-17T07:29:47.097586] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-17T07:29:47.312246] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-17T07:29:47.312359] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-17T07:29:47.313350] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-17T07:29:47.313407] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-17T07:29:47.314625] [DEBUG] [LOCAL ] ZIP: Trimmed 59068 records to 44671 (keeping 200 days of data) [2025-09-17T07:29:47.577185] [DEBUG] [LOCAL ] ZIP: Primary data saved (44671 records). [2025-09-17T07:29:47.577349] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-17T07:29:47.577460] [INFO ] [MAIN ] Update Progress: 2362/2369 symbols completed. ZIP took 28.6s. Estimated remaining: 1m 1s. Rate: 6.8 symbols/min [2025-09-17T07:29:47.750565] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:29:47.762948] [DEBUG] [LOCAL ] ZTR: Loaded 12251 existing records from primary storage. [2025-09-17T07:29:47.763086] [INFO ] [MAIN ] ZTR: Loaded 12251 existing records. [2025-09-17T07:29:47.907033] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-17T07:29:47.947629] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:29:47.947872] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-17T07:29:47.947928] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-17T07:29:47.948337] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-17T07:29:47.948397] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-17T07:29:48.308921] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:29:48.343582] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T07:29:48.408351] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T07:29:48.690170] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-11. [2025-09-17T07:29:49.467628] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T07:29:49.490111] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-17T07:29:49.723007] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T07:29:50.290179] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-17T07:29:51.089761] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T07:29:51.099888] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-17T07:29:51.622417] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T07:29:51.890133] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-17T07:29:52.690195] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-09-17T07:29:53.218439] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T07:29:53.417800] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.32 seconds). [2025-09-17T07:29:53.490151] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-17T07:29:53.668523] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T07:29:54.290132] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-09-17T07:29:55.090095] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-17T07:29:55.424155] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T07:29:55.635371] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-17T07:29:55.890132] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-17T07:29:56.497256] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T07:29:56.690118] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-17T07:29:56.962876] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T07:29:57.490132] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-17T07:29:58.072026] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T07:29:58.077691] [INFO ] [REMOTE ] ZK: Full fetch complete (57133 records). [2025-09-17T07:29:58.077869] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-17T07:29:58.308495] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-17T07:29:58.315001] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T07:29:58.480928] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-17T07:29:58.481131] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-17T07:29:58.482134] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-17T07:29:58.482191] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-17T07:29:58.483429] [DEBUG] [LOCAL ] ZK: Trimmed 57133 records to 40092 (keeping 200 days of data) [2025-09-17T07:29:58.723865] [DEBUG] [LOCAL ] ZK: Primary data saved (40092 records). [2025-09-17T07:29:58.724021] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-17T07:29:58.724107] [INFO ] [MAIN ] Update Progress: 2363/2369 symbols completed. ZK took 39.8s. Estimated remaining: 52.7s. Rate: 6.8 symbols/min [2025-09-17T07:29:58.896326] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:29:58.896537] [DEBUG] [LOCAL ] ZTS: No existing data file found in primary storage. [2025-09-17T07:29:58.896582] [WARN ] [MAIN ] ZTS: No existing data found, performing full refresh instead. [2025-09-17T07:29:58.896708] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-17T07:29:58.896762] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-17T07:29:58.896813] [DEBUG] [LOCAL ] ZTS: No primary data file found to delete. [2025-09-17T07:29:58.896852] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-17T07:29:59.099318] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-17T07:29:59.268155] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:29:59.890178] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-17T07:30:00.188879] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T07:30:00.641425] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-17T07:30:00.690110] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-17T07:30:01.490159] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-17T07:30:01.747534] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T07:30:02.290136] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-17T07:30:02.929610] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T07:30:03.090122] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-11. [2025-09-17T07:30:03.737356] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (3.05 seconds). [2025-09-17T07:30:03.890113] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-17T07:30:04.690144] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-17T07:30:05.411415] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-09-17T07:30:05.490113] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-17T07:30:05.883592] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T07:30:06.290152] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-17T07:30:06.377524] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-11 (3.29 seconds). [2025-09-17T07:30:06.546701] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.66 seconds). [2025-09-17T07:30:06.553074] [INFO ] [REMOTE ] ZIM: Full fetch complete (77516 records). [2025-09-17T07:30:06.553221] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-17T07:30:06.959778] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-17T07:30:06.960118] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-17T07:30:06.961435] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-17T07:30:06.961506] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-17T07:30:06.963075] [DEBUG] [LOCAL ] ZIM: Trimmed 77516 records to 53554 (keeping 200 days of data) [2025-09-17T07:30:07.090319] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-09-17T07:30:07.234520] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T07:30:07.351138] [DEBUG] [LOCAL ] ZIM: Primary data saved (53554 records). [2025-09-17T07:30:07.351330] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-17T07:30:07.351441] [INFO ] [MAIN ] Update Progress: 2364/2369 symbols completed. ZIM took 48.4s. Estimated remaining: 43.9s. Rate: 6.8 symbols/min [2025-09-17T07:30:07.522853] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:30:07.536718] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T07:30:07.565934] [DEBUG] [LOCAL ] ZVIA: Loaded 27081 existing records from primary storage. [2025-09-17T07:30:07.566096] [INFO ] [MAIN ] ZVIA: Loaded 27081 existing records. [2025-09-17T07:30:07.741093] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:30:07.741314] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-17T07:30:07.741373] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-17T07:30:07.742093] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-17T07:30:07.742155] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-17T07:30:07.900611] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-17T07:30:08.098345] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:30:08.690161] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-11. [2025-09-17T07:30:08.849764] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T07:30:09.490180] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-17T07:30:09.725393] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T07:30:10.019370] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T07:30:10.290160] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-09-17T07:30:10.600189] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T07:30:11.090180] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-17T07:30:11.723390] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T07:30:11.890133] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-17T07:30:12.098736] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T07:30:12.101273] [INFO ] [REMOTE ] ZTR: Full fetch complete (26998 records). [2025-09-17T07:30:12.101381] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-17T07:30:12.491014] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-17T07:30:12.491121] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-17T07:30:12.491782] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-17T07:30:12.491839] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-17T07:30:12.492591] [DEBUG] [LOCAL ] ZTR: Trimmed 26998 records to 16939 (keeping 200 days of data) [2025-09-17T07:30:12.597934] [DEBUG] [LOCAL ] ZTR: Primary data saved (16939 records). [2025-09-17T07:30:12.598129] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-17T07:30:12.598254] [INFO ] [MAIN ] Update Progress: 2365/2369 symbols completed. ZTR took 25.0s. Estimated remaining: 35.1s. Rate: 6.8 symbols/min [2025-09-17T07:30:12.695868] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-09-17T07:30:12.772169] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-08 to 2025-09-16. [2025-09-17T07:30:12.804627] [DEBUG] [LOCAL ] ZWS: Loaded 31021 existing records from primary storage. [2025-09-17T07:30:12.804856] [INFO ] [MAIN ] ZWS: Loaded 31021 existing records. [2025-09-17T07:30:12.982757] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-04-21, but need from 2024-11-26 for 200 day retention. Performing full refresh. [2025-09-17T07:30:12.983034] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-17T07:30:12.983093] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-17T07:30:12.983841] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-17T07:30:12.983912] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-17T07:30:13.341760] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-11-26 to 2025-09-16 (requires 11 months of data pull). [2025-09-17T07:30:13.467065] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T07:30:13.490075] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-17T07:30:14.290114] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-11. [2025-09-17T07:30:14.670756] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T07:30:15.089438] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T07:30:15.094942] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-09-17T07:30:15.097009] [INFO ] [REMOTE ] ZTO: Full fetch complete (73166 records). [2025-09-17T07:30:15.097426] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-17T07:30:15.504929] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-17T07:30:15.505073] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-17T07:30:15.506251] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-17T07:30:15.506351] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-17T07:30:15.508063] [DEBUG] [LOCAL ] ZTO: Trimmed 73166 records to 50213 (keeping 200 days of data) [2025-09-17T07:30:15.843667] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T07:30:15.861002] [DEBUG] [LOCAL ] ZTO: Primary data saved (50213 records). [2025-09-17T07:30:15.861168] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-17T07:30:15.861279] [INFO ] [MAIN ] Update Progress: 2366/2369 symbols completed. ZTO took 37.2s. Estimated remaining: 26.3s. Rate: 6.8 symbols/min [2025-09-17T07:30:15.890108] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-09-17T07:30:16.627606] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T07:30:16.690136] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-17T07:30:17.490180] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-17T07:30:18.399953] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-17T07:30:18.408973] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-09-17T07:30:19.085575] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (2.40 seconds). [2025-09-17T07:30:19.093431] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-17T07:30:19.997717] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T07:30:20.007028] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-17T07:30:20.282331] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (2.79 seconds). [2025-09-17T07:30:20.423256] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T07:30:20.690135] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-17T07:30:21.209987] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T07:30:21.490158] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-17T07:30:22.290159] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-17T07:30:22.550105] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T07:30:23.048661] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T07:30:23.090148] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-17T07:30:23.577499] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T07:30:23.890131] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-17T07:30:24.399942] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T07:30:24.690140] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-17T07:30:24.933482] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T07:30:25.490163] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-17T07:30:26.088350] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T07:30:26.290200] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-17T07:30:27.090162] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-17T07:30:27.390824] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T07:30:27.663373] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T07:30:27.890180] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-17T07:30:28.550003] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T07:30:28.690153] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-17T07:30:29.490151] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-17T07:30:29.717533] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T07:30:29.907915] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T07:30:30.290131] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-17T07:30:31.090214] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-17T07:30:31.144977] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T07:30:31.890202] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-17T07:30:32.136066] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T07:30:32.204077] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T07:30:32.690190] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-17T07:30:33.469190] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T07:30:33.490108] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-17T07:30:34.118504] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T07:30:34.290099] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-17T07:30:34.907419] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T07:30:34.913031] [INFO ] [REMOTE ] ZWS: Full fetch complete (61725 records). [2025-09-17T07:30:34.913177] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-17T07:30:35.095223] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-17T07:30:35.304113] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-17T07:30:35.304233] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-17T07:30:35.305342] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-17T07:30:35.305450] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-17T07:30:35.306859] [DEBUG] [LOCAL ] ZWS: Trimmed 61725 records to 42622 (keeping 200 days of data) [2025-09-17T07:30:35.572713] [DEBUG] [LOCAL ] ZWS: Primary data saved (42622 records). [2025-09-17T07:30:35.572882] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-17T07:30:35.573065] [INFO ] [MAIN ] Update Progress: 2367/2369 symbols completed. ZWS took 23.0s. Estimated remaining: 17.6s. Rate: 6.8 symbols/min [2025-09-17T07:30:36.159116] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T07:30:36.173591] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-17T07:30:36.636273] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T07:30:36.641737] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52280 records). [2025-09-17T07:30:36.641976] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-17T07:30:37.203589] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-17T07:30:37.203759] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-17T07:30:37.204939] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-17T07:30:37.205022] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-17T07:30:37.206509] [DEBUG] [LOCAL ] ZVIA: Trimmed 52280 records to 35478 (keeping 200 days of data) [2025-09-17T07:30:37.421064] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35478 records). [2025-09-17T07:30:37.421286] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-17T07:30:37.421385] [INFO ] [MAIN ] Update Progress: 2368/2369 symbols completed. ZVIA took 30.1s. Estimated remaining: 8.8s. Rate: 6.8 symbols/min [2025-09-17T07:30:37.913610] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T07:30:37.920510] [INFO ] [REMOTE ] ZTS: Full fetch complete (76532 records). [2025-09-17T07:30:37.920750] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-17T07:30:38.337884] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-17T07:30:38.337998] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-17T07:30:38.339260] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-17T07:30:38.339331] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-17T07:30:38.340936] [DEBUG] [LOCAL ] ZTS: Trimmed 76532 records to 52999 (keeping 200 days of data) [2025-09-17T07:30:38.678531] [DEBUG] [LOCAL ] ZTS: Primary data saved (52999 records). [2025-09-17T07:30:38.678724] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-17T07:30:38.678829] [INFO ] [MAIN ] Update Progress: 2369/2369 symbols completed. ZTS took 40.0s. Estimated remaining: 0.0s. Rate: 6.8 symbols/min [2025-09-17T07:30:38.679904] [INFO ] [MAIN ] Parallel update completed in 5h 46m 32s [2025-09-17T07:30:38.680169] [WARN ] [MAIN ] Failed symbols (197): AAM, AACT, AAMI, AAUC, AD, AHL, AII, AIV, AKA, AMBQ... [2025-09-17T07:30:38.680276] [INFO ] [MAIN ] Update success rate: 91.7% (2172/2369 symbols) [2025-09-17T07:30:39.242373] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2172/2369 @ 91.68%)' [2025-09-17T07:30:39.243366] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-17T07:30:39.243693] [INFO ] [STATE ] Last completion updated: 2025-09-17T07:30:39.243437 [2025-09-17T07:30:39.243947] [WARN ] [STATE ] State set to: RUNNING [2025-09-17T07:30:39.244005] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-17T07:30:39.244136] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-17T07:30:39.244194] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-17T07:30:39.245841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-17T07:30:39.246174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-17T07:30:39.246413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-17T07:30:39.246613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-17T07:30:39.246829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-17T07:30:39.247067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-17T07:30:39.247246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-17T07:30:39.247429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-17T07:30:39.247633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-17T07:30:39.247865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-17T07:30:39.248043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-17T07:30:39.248305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-17T07:30:39.248511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-17T07:30:39.248715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-17T07:30:39.248906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-17T07:30:39.249138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-17T07:30:39.249287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-17T07:30:39.249477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-17T07:30:39.249724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-09-17T07:30:39.249962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-17T07:30:39.250166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXYZ.csv [2025-09-17T07:30:39.250348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-17T07:30:39.250563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-17T07:30:39.250837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-17T07:30:39.251034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-17T07:30:39.251234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-17T07:30:39.251442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-09-17T07:30:39.251631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACV.csv [2025-09-17T07:30:39.251830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-17T07:30:39.251966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-17T07:30:39.252208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-17T07:30:39.252363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-17T07:30:39.252558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-17T07:30:39.252761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-17T07:30:39.252915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-17T07:30:39.253090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-17T07:30:39.253270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-17T07:30:39.253421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-17T07:30:39.253594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-17T07:30:39.253766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-17T07:30:39.253918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-17T07:30:39.254120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-17T07:30:39.254294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRK.csv [2025-09-17T07:30:39.254467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-09-17T07:30:39.254719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-17T07:30:39.254892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-17T07:30:39.255067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-17T07:30:39.255266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-17T07:30:39.255418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-09-17T07:30:39.255676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-17T07:30:39.255850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-17T07:30:39.256062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-17T07:30:39.256230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VKQ.csv [2025-09-17T07:30:39.256388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-17T07:30:39.256542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-17T07:30:39.256735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-17T07:30:39.256900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-17T07:30:39.257038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-17T07:30:39.257215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-17T07:30:39.257365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-17T07:30:39.257488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-17T07:30:39.257656] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-17T07:30:39.257864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-17T07:30:39.258003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-17T07:30:39.258174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-17T07:30:39.258316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-17T07:30:39.258497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-17T07:30:39.258699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-17T07:30:39.258889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-17T07:30:39.259087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-17T07:30:39.259262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-17T07:30:39.259401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-17T07:30:39.259557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-17T07:30:39.259752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-17T07:30:39.259899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-17T07:30:39.260034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-17T07:30:39.260222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BP.csv [2025-09-17T07:30:39.260383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRC.csv [2025-09-17T07:30:39.260592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-17T07:30:39.260757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-17T07:30:39.261140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-17T07:30:39.261294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-17T07:30:39.261449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-17T07:30:39.261923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-17T07:30:39.262125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-17T07:30:39.262286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-17T07:30:39.262442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-17T07:30:39.262634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-17T07:30:39.262806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-17T07:30:39.262939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-17T07:30:39.263098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-17T07:30:39.263252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-17T07:30:39.263390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-17T07:30:39.263567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-17T07:30:39.263754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-17T07:30:39.263951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-09-17T07:30:39.264094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-17T07:30:39.264223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-17T07:30:39.264374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-17T07:30:39.264551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-17T07:30:39.264739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-17T07:30:39.264924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-17T07:30:39.265107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-17T07:30:39.265310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DECK.csv [2025-09-17T07:30:39.265497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-17T07:30:39.265813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-17T07:30:39.266009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-17T07:30:39.266191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-17T07:30:39.266373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-17T07:30:39.266543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-17T07:30:39.266701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-17T07:30:39.266842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-17T07:30:39.266967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-17T07:30:39.267125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-17T07:30:39.267295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-09-17T07:30:39.267433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-17T07:30:39.267580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-17T07:30:39.267737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-17T07:30:39.267905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-17T07:30:39.268077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-17T07:30:39.268286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-17T07:30:39.268420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-17T07:30:39.268562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-17T07:30:39.268727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-17T07:30:39.268897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-17T07:30:39.269029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-17T07:30:39.269161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-17T07:30:39.269296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PG.csv [2025-09-17T07:30:39.269424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-17T07:30:39.269562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-17T07:30:39.269701] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-17T07:30:39.269832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-17T07:30:39.269978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-17T07:30:39.270102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-17T07:30:39.270224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-17T07:30:39.270357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-17T07:30:39.270536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOV.csv [2025-09-17T07:30:39.270857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-17T07:30:39.271019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-17T07:30:39.271176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-17T07:30:39.271338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-17T07:30:39.271469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-09-17T07:30:39.271600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-17T07:30:39.271776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-17T07:30:39.271927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-17T07:30:39.272146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-17T07:30:39.272313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-17T07:30:39.272616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-17T07:30:39.272785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-17T07:30:39.272939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-17T07:30:39.273110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-17T07:30:39.273264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-17T07:30:39.273401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-17T07:30:39.273554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-17T07:30:39.273714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-17T07:30:39.273835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-17T07:30:39.274023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-17T07:30:39.274167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-17T07:30:39.274324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-17T07:30:39.274493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-09-17T07:30:39.274665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-17T07:30:39.274799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-17T07:30:39.274948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-17T07:30:39.275078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-17T07:30:39.275241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-17T07:30:39.275378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEA.csv [2025-09-17T07:30:39.275506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-17T07:30:39.275761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-17T07:30:39.275889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-17T07:30:39.276049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-17T07:30:39.276175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-17T07:30:39.276339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-17T07:30:39.276461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-17T07:30:39.276578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-17T07:30:39.276725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-17T07:30:39.276856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-17T07:30:39.276993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-17T07:30:39.277134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-17T07:30:39.277283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-17T07:30:39.277415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-17T07:30:39.277554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-17T07:30:39.277693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-17T07:30:39.277843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-17T07:30:39.277992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-17T07:30:39.278180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-17T07:30:39.278342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-17T07:30:39.278490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-17T07:30:39.278619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-17T07:30:39.278778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-17T07:30:39.278916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-17T07:30:39.279063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-17T07:30:39.279231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-17T07:30:39.279382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-17T07:30:39.279519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-17T07:30:39.279670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-17T07:30:39.279794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-17T07:30:39.279938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-17T07:30:39.280076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-17T07:30:39.280213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-17T07:30:39.280362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-17T07:30:39.280490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-17T07:30:39.280703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-17T07:30:39.280836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-17T07:30:39.280962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-17T07:30:39.281103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-17T07:30:39.281263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-17T07:30:39.281397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-17T07:30:39.281533] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-17T07:30:39.281818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-17T07:30:39.281960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-17T07:30:39.282082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-17T07:30:39.282234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRK.csv [2025-09-17T07:30:39.282391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-17T07:30:39.282540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-09-17T07:30:39.282697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-17T07:30:39.282831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-17T07:30:39.282993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-17T07:30:39.283129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-17T07:30:39.283251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-17T07:30:39.283384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-17T07:30:39.283553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-17T07:30:39.283732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-17T07:30:39.283899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-17T07:30:39.284037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-17T07:30:39.284191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-17T07:30:39.284323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-17T07:30:39.284444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHN.csv [2025-09-17T07:30:39.284601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-17T07:30:39.284823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-17T07:30:39.284960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-17T07:30:39.285112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-17T07:30:39.285244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-17T07:30:39.285373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-17T07:30:39.285529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-17T07:30:39.285663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-17T07:30:39.285805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-17T07:30:39.285951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-17T07:30:39.286087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-17T07:30:39.286229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-17T07:30:39.286371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-17T07:30:39.286503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-17T07:30:39.286676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-17T07:30:39.286836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-17T07:30:39.286974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-09-17T07:30:39.287117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-17T07:30:39.287271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-09-17T07:30:39.287456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-17T07:30:39.287621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-17T07:30:39.287785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-17T07:30:39.287915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-09-17T07:30:39.288052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-17T07:30:39.288184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-17T07:30:39.288328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-17T07:30:39.288474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-17T07:30:39.288871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-17T07:30:39.289024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWT.csv [2025-09-17T07:30:39.289153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-17T07:30:39.289310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-17T07:30:39.289456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-17T07:30:39.289591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-17T07:30:39.289755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-17T07:30:39.289870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-17T07:30:39.290016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-17T07:30:39.290151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-17T07:30:39.290280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-17T07:30:39.290416] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-17T07:30:39.290562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-17T07:30:39.290694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-17T07:30:39.290816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCG.csv [2025-09-17T07:30:39.290942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-17T07:30:39.291069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-17T07:30:39.291205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-17T07:30:39.291340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-17T07:30:39.291495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-17T07:30:39.291653] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-17T07:30:39.291780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-17T07:30:39.291955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-17T07:30:39.292090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-17T07:30:39.292201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-17T07:30:39.292346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-17T07:30:39.292484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-17T07:30:39.292613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-17T07:30:39.292757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-17T07:30:39.292904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BARK.csv [2025-09-17T07:30:39.293048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-17T07:30:39.293170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-17T07:30:39.293289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-17T07:30:39.293412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-17T07:30:39.293522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-17T07:30:39.293782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-17T07:30:39.293926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-17T07:30:39.294058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-17T07:30:39.294172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-17T07:30:39.294311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-17T07:30:39.294455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-17T07:30:39.294666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-17T07:30:39.294790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-17T07:30:39.294917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-17T07:30:39.295057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-17T07:30:39.295305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-17T07:30:39.295454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-17T07:30:39.295587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-17T07:30:39.295775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALUR.csv [2025-09-17T07:30:39.295944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-17T07:30:39.296079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-17T07:30:39.296229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-17T07:30:39.296381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-17T07:30:39.296514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-17T07:30:39.296633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-17T07:30:39.296894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-17T07:30:39.297062] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-17T07:30:39.297223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-17T07:30:39.297401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-17T07:30:39.297546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-17T07:30:39.297748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-17T07:30:39.297882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-17T07:30:39.298010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-17T07:30:39.298134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-17T07:30:39.298289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-17T07:30:39.298408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-17T07:30:39.298541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-17T07:30:39.298746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-17T07:30:39.298872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-17T07:30:39.299001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-17T07:30:39.299148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CW.csv [2025-09-17T07:30:39.299287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-17T07:30:39.299431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-17T07:30:39.299610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYI.csv [2025-09-17T07:30:39.299746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-17T07:30:39.299860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-17T07:30:39.299979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-17T07:30:39.300099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-17T07:30:39.300222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-17T07:30:39.300359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-17T07:30:39.300487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-17T07:30:39.300665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-17T07:30:39.300793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AKR.csv [2025-09-17T07:30:39.300914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-17T07:30:39.301024] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMM.csv [2025-09-17T07:30:39.301154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-09-17T07:30:39.301311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPH.csv [2025-09-17T07:30:39.301496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-17T07:30:39.301693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-17T07:30:39.301839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-09-17T07:30:39.302006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-17T07:30:39.302145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-17T07:30:39.302278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-17T07:30:39.302390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-17T07:30:39.302520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNC.csv [2025-09-17T07:30:39.302725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-17T07:30:39.302865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-17T07:30:39.302992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-17T07:30:39.303205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-17T07:30:39.303331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-17T07:30:39.303455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-09-17T07:30:39.303578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-17T07:30:39.303729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-17T07:30:39.303879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-17T07:30:39.304060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-17T07:30:39.304197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-17T07:30:39.304313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-17T07:30:39.304425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-17T07:30:39.304582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-09-17T07:30:39.304726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-17T07:30:39.304854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-17T07:30:39.304981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-17T07:30:39.305099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-17T07:30:39.305219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-17T07:30:39.305343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-17T07:30:39.305462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-17T07:30:39.305582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-17T07:30:39.305714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-17T07:30:39.305843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-17T07:30:39.305962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-17T07:30:39.306068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-17T07:30:39.306190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-17T07:30:39.306313] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-17T07:30:39.306427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-17T07:30:39.306582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-17T07:30:39.306723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-17T07:30:39.307012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-17T07:30:39.307173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-17T07:30:39.307311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-17T07:30:39.307444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-17T07:30:39.307572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-17T07:30:39.307712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-09-17T07:30:39.307837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-17T07:30:39.307977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-17T07:30:39.308112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-17T07:30:39.308260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-17T07:30:39.308405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-17T07:30:39.308535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-17T07:30:39.308663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-17T07:30:39.308780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-17T07:30:39.308901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-17T07:30:39.309019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-17T07:30:39.309132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-17T07:30:39.309256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-17T07:30:39.309408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-17T07:30:39.309541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-17T07:30:39.309678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-17T07:30:39.309799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-17T07:30:39.309916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-17T07:30:39.310035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHGG.csv [2025-09-17T07:30:39.310145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-17T07:30:39.310252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-17T07:30:39.310391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-17T07:30:39.310540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-17T07:30:39.310719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-17T07:30:39.310859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-17T07:30:39.310979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-17T07:30:39.311086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMB.csv [2025-09-17T07:30:39.311209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-17T07:30:39.311349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-17T07:30:39.311463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-17T07:30:39.311586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-17T07:30:39.311818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-17T07:30:39.311957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-17T07:30:39.312066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-17T07:30:39.312200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-17T07:30:39.312326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-17T07:30:39.312447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-17T07:30:39.312594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-17T07:30:39.312736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-17T07:30:39.312857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEFC.csv [2025-09-17T07:30:39.312996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-17T07:30:39.313146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-17T07:30:39.313254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CULP.csv [2025-09-17T07:30:39.313384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-17T07:30:39.313510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-17T07:30:39.313618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURV.csv [2025-09-17T07:30:39.313771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-17T07:30:39.313907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-17T07:30:39.314030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-17T07:30:39.314151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-17T07:30:39.314273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-17T07:30:39.314526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-17T07:30:39.314711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-17T07:30:39.314842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-17T07:30:39.314965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-17T07:30:39.315082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-17T07:30:39.315201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-17T07:30:39.315314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-17T07:30:39.315446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-17T07:30:39.315583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-17T07:30:39.315767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-17T07:30:39.315910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-17T07:30:39.316054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-17T07:30:39.316184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-17T07:30:39.316320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-17T07:30:39.316443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-17T07:30:39.316571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-17T07:30:39.316745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-09-17T07:30:39.316869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-17T07:30:39.317000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-17T07:30:39.317168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-17T07:30:39.317337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-17T07:30:39.317526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-17T07:30:39.317690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-17T07:30:39.317828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-17T07:30:39.317949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-17T07:30:39.318078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-17T07:30:39.318203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-17T07:30:39.318347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-17T07:30:39.318491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-17T07:30:39.318661] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-17T07:30:39.318783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-17T07:30:39.318899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-17T07:30:39.319034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-17T07:30:39.319152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-17T07:30:39.319278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-17T07:30:39.319404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-17T07:30:39.319527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-17T07:30:39.319637] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-17T07:30:39.319777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-17T07:30:39.319886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-17T07:30:39.320025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCI.csv [2025-09-17T07:30:39.320153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-17T07:30:39.320271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-09-17T07:30:39.320395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-17T07:30:39.320797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-17T07:30:39.320934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-17T07:30:39.321052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-17T07:30:39.321174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-17T07:30:39.321308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-17T07:30:39.321437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-17T07:30:39.321556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-17T07:30:39.321702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTM.csv [2025-09-17T07:30:39.321835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-17T07:30:39.321947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-17T07:30:39.322061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-17T07:30:39.322175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-17T07:30:39.322293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-17T07:30:39.322417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-17T07:30:39.322579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-17T07:30:39.322715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-17T07:30:39.322828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-17T07:30:39.322938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-17T07:30:39.323059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-17T07:30:39.323206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-17T07:30:39.323326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-17T07:30:39.323445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-17T07:30:39.323586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-09-17T07:30:39.323727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-17T07:30:39.323848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-17T07:30:39.323974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-17T07:30:39.324117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-17T07:30:39.324234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-17T07:30:39.324350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-17T07:30:39.324460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-17T07:30:39.324600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-17T07:30:39.324738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-17T07:30:39.324857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-17T07:30:39.324984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-17T07:30:39.325127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-17T07:30:39.325245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-09-17T07:30:39.325346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-17T07:30:39.325462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-17T07:30:39.325579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-17T07:30:39.325703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-17T07:30:39.325828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-17T07:30:39.325936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-17T07:30:39.326035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-17T07:30:39.326170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-17T07:30:39.326289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-17T07:30:39.326402] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNP.csv [2025-09-17T07:30:39.326522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRI.csv [2025-09-17T07:30:39.326743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-17T07:30:39.326876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-17T07:30:39.326981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-17T07:30:39.327269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-17T07:30:39.327403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-17T07:30:39.327530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-17T07:30:39.327665] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-17T07:30:39.327791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-17T07:30:39.327888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-17T07:30:39.328010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-17T07:30:39.328127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-17T07:30:39.328243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-17T07:30:39.328361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-17T07:30:39.328487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-17T07:30:39.328593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-17T07:30:39.328730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-17T07:30:39.328848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-17T07:30:39.328967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-17T07:30:39.329071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-17T07:30:39.329175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-17T07:30:39.329290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-17T07:30:39.329400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-17T07:30:39.329515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-17T07:30:39.329666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-17T07:30:39.329793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-17T07:30:39.329904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-17T07:30:39.330088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEM.csv [2025-09-17T07:30:39.330231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-17T07:30:39.330340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-17T07:30:39.330454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-09-17T07:30:39.330570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-17T07:30:39.330722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-09-17T07:30:39.330840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-17T07:30:39.330943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-17T07:30:39.331054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPL.csv [2025-09-17T07:30:39.331171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-17T07:30:39.331301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-17T07:30:39.331432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-17T07:30:39.331586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-17T07:30:39.331733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-17T07:30:39.331847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-17T07:30:39.331965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-17T07:30:39.332081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-17T07:30:39.332214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-17T07:30:39.332393] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-17T07:30:39.332541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-17T07:30:39.332731] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-17T07:30:39.332874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-17T07:30:39.332998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-17T07:30:39.333107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-17T07:30:39.333236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-17T07:30:39.333370] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-17T07:30:39.333474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-17T07:30:39.333591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-17T07:30:39.333718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-17T07:30:39.333838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-17T07:30:39.333953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-17T07:30:39.334061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-17T07:30:39.334170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-17T07:30:39.334291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-17T07:30:39.334407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-17T07:30:39.334549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBU.csv [2025-09-17T07:30:39.334720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-17T07:30:39.334841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-17T07:30:39.334956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-17T07:30:39.335217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-17T07:30:39.335337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-17T07:30:39.335441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-17T07:30:39.335549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-17T07:30:39.335675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-17T07:30:39.335786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-17T07:30:39.335903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-17T07:30:39.336014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-17T07:30:39.336128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-17T07:30:39.336266] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-17T07:30:39.336434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-17T07:30:39.336588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-17T07:30:39.336765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-17T07:30:39.336891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-17T07:30:39.337003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-17T07:30:39.337107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-17T07:30:39.337222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-17T07:30:39.337339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-17T07:30:39.337449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-17T07:30:39.337582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-17T07:30:39.337745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-17T07:30:39.337871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-17T07:30:39.337990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-17T07:30:39.338103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-17T07:30:39.338214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-17T07:30:39.338336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-17T07:30:39.338445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-17T07:30:39.338578] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-17T07:30:39.338726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-17T07:30:39.338844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-17T07:30:39.338951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-17T07:30:39.339061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-17T07:30:39.339168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-17T07:30:39.339282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-17T07:30:39.339400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-17T07:30:39.339519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-17T07:30:39.339632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-17T07:30:39.339840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-17T07:30:39.339961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-17T07:30:39.340101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-17T07:30:39.340244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APH.csv [2025-09-17T07:30:39.340356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NI.csv [2025-09-17T07:30:39.340469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-17T07:30:39.340576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-17T07:30:39.340698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-17T07:30:39.340820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-17T07:30:39.340928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-17T07:30:39.341207] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-17T07:30:39.341330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-17T07:30:39.341441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-17T07:30:39.341551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-17T07:30:39.341685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-17T07:30:39.341802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-17T07:30:39.341920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-17T07:30:39.342026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-17T07:30:39.342138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-17T07:30:39.342255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-17T07:30:39.342364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-17T07:30:39.342485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALEX.csv [2025-09-17T07:30:39.342623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOW.csv [2025-09-17T07:30:39.342769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-17T07:30:39.342890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-17T07:30:39.343006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-17T07:30:39.343149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-17T07:30:39.343277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-17T07:30:39.343390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-17T07:30:39.343490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-17T07:30:39.343607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-17T07:30:39.343736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGR.csv [2025-09-17T07:30:39.343847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-17T07:30:39.343964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-17T07:30:39.344083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-17T07:30:39.344204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-09-17T07:30:39.344317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-17T07:30:39.344429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-17T07:30:39.344548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-17T07:30:39.344707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-17T07:30:39.344815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-17T07:30:39.344919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-17T07:30:39.345033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-17T07:30:39.345171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-09-17T07:30:39.345335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-09-17T07:30:39.345500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-17T07:30:39.345618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDP.csv [2025-09-17T07:30:39.345843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-17T07:30:39.345965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-17T07:30:39.346113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-17T07:30:39.346227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-17T07:30:39.346342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-09-17T07:30:39.346454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-17T07:30:39.346568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-17T07:30:39.346685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-17T07:30:39.346797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-17T07:30:39.346894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-17T07:30:39.346996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-17T07:30:39.347108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-17T07:30:39.347209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-17T07:30:39.347315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-17T07:30:39.347427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-17T07:30:39.347544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-17T07:30:39.347673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-17T07:30:39.347839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-17T07:30:39.347955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-17T07:30:39.348171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-17T07:30:39.348291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-17T07:30:39.348387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-17T07:30:39.348566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-17T07:30:39.348717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIC.csv [2025-09-17T07:30:39.348829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-17T07:30:39.348995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-17T07:30:39.349149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-17T07:30:39.349274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-17T07:30:39.349387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-17T07:30:39.349508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-17T07:30:39.349636] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-17T07:30:39.349766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-17T07:30:39.349873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-17T07:30:39.349989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-17T07:30:39.350113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-17T07:30:39.350221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-17T07:30:39.350340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-17T07:30:39.350453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHM.csv [2025-09-17T07:30:39.350567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-09-17T07:30:39.350729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-17T07:30:39.350857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-17T07:30:39.350963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-17T07:30:39.351076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-17T07:30:39.351178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-17T07:30:39.351276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-17T07:30:39.351387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTW.csv [2025-09-17T07:30:39.351485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-17T07:30:39.351605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-17T07:30:39.351743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-17T07:30:39.351854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-17T07:30:39.351968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-17T07:30:39.352076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-17T07:30:39.352185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-17T07:30:39.352296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-17T07:30:39.352419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-17T07:30:39.352605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-17T07:30:39.352837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-17T07:30:39.352951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-17T07:30:39.353071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-17T07:30:39.353187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-17T07:30:39.353303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-17T07:30:39.353425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-17T07:30:39.353542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-17T07:30:39.353693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-17T07:30:39.353834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-17T07:30:39.353967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-17T07:30:39.354077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-17T07:30:39.354187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-17T07:30:39.354287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-17T07:30:39.354405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-17T07:30:39.354528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-17T07:30:39.354753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-17T07:30:39.354875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-17T07:30:39.354992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-17T07:30:39.355114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-17T07:30:39.355232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-17T07:30:39.355346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-17T07:30:39.355462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-17T07:30:39.355576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-17T07:30:39.355700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-17T07:30:39.355811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-17T07:30:39.355930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-17T07:30:39.356035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-17T07:30:39.356146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-17T07:30:39.356251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-17T07:30:39.356377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-09-17T07:30:39.356525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-09-17T07:30:39.356634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-17T07:30:39.356790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-17T07:30:39.356952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-17T07:30:39.357111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-17T07:30:39.357510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-17T07:30:39.357666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-17T07:30:39.357820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-17T07:30:39.357948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-17T07:30:39.358059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-17T07:30:39.358172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DX.csv [2025-09-17T07:30:39.358285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-17T07:30:39.358410] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-17T07:30:39.358527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-17T07:30:39.358727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-17T07:30:39.358850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDF.csv [2025-09-17T07:30:39.358988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-17T07:30:39.359105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-17T07:30:39.359213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-17T07:30:39.359320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-17T07:30:39.359415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-17T07:30:39.359519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-17T07:30:39.359624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-09-17T07:30:39.359749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-17T07:30:39.359873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-17T07:30:39.359987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOD.csv [2025-09-17T07:30:39.360153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-17T07:30:39.360283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-17T07:30:39.360397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-17T07:30:39.360501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-17T07:30:39.360602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-17T07:30:39.360750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-17T07:30:39.360874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-17T07:30:39.360997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-17T07:30:39.361096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-17T07:30:39.361206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-17T07:30:39.361326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVS.csv [2025-09-17T07:30:39.361446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-17T07:30:39.361576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-17T07:30:39.361708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-17T07:30:39.361818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-17T07:30:39.361926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-17T07:30:39.362034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-17T07:30:39.362145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-17T07:30:39.362251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-09-17T07:30:39.362360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-17T07:30:39.362497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-17T07:30:39.362612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-17T07:30:39.362786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-09-17T07:30:39.362922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-17T07:30:39.363057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-17T07:30:39.363217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-09-17T07:30:39.363324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KO.csv [2025-09-17T07:30:39.363421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-17T07:30:39.363526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-17T07:30:39.363622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-17T07:30:39.363758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-09-17T07:30:39.363949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-17T07:30:39.364086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-17T07:30:39.364230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-17T07:30:39.364352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-17T07:30:39.364459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-17T07:30:39.364583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-17T07:30:39.364738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-17T07:30:39.364863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-17T07:30:39.364995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-17T07:30:39.365109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-17T07:30:39.365222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-09-17T07:30:39.365325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DK.csv [2025-09-17T07:30:39.365441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-17T07:30:39.365570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-17T07:30:39.365748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-17T07:30:39.366035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DMA.csv [2025-09-17T07:30:39.366151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-17T07:30:39.366260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-17T07:30:39.366386] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-17T07:30:39.366515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-17T07:30:39.366664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-17T07:30:39.366794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-17T07:30:39.366915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-17T07:30:39.367031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-17T07:30:39.367143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-17T07:30:39.367257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATEN.csv [2025-09-17T07:30:39.367368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-17T07:30:39.367479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-17T07:30:39.367596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-17T07:30:39.367753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-17T07:30:39.367880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-17T07:30:39.367988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-17T07:30:39.368092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-17T07:30:39.368203] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-09-17T07:30:39.368330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNO.csv [2025-09-17T07:30:39.368431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-17T07:30:39.368558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-17T07:30:39.368748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-09-17T07:30:39.368881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-17T07:30:39.368989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-17T07:30:39.369118] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-17T07:30:39.369235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-17T07:30:39.369345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-17T07:30:39.369444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-17T07:30:39.369558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-17T07:30:39.369683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-17T07:30:39.369794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-17T07:30:39.369907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-17T07:30:39.370018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-17T07:30:39.370129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-17T07:30:39.370235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-17T07:30:39.370339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-17T07:30:39.370453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TM.csv [2025-09-17T07:30:39.370569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-17T07:30:39.370704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-17T07:30:39.370832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-17T07:30:39.370939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-17T07:30:39.371043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-17T07:30:39.371152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-17T07:30:39.371262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-17T07:30:39.371359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-17T07:30:39.371467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-17T07:30:39.371576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-17T07:30:39.371697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-17T07:30:39.371808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-17T07:30:39.371934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-17T07:30:39.372041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-17T07:30:39.372151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-09-17T07:30:39.372262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-17T07:30:39.372382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-17T07:30:39.372491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-17T07:30:39.372605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-17T07:30:39.372783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-17T07:30:39.372897] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-17T07:30:39.373122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-17T07:30:39.373301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-17T07:30:39.373425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-17T07:30:39.373528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-17T07:30:39.373669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-17T07:30:39.373811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-17T07:30:39.373917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-17T07:30:39.374030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-17T07:30:39.374137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-17T07:30:39.374248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-17T07:30:39.374353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-17T07:30:39.374458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-17T07:30:39.374594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-17T07:30:39.374725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-17T07:30:39.374856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-17T07:30:39.374960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-17T07:30:39.375094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-17T07:30:39.375209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-17T07:30:39.375321] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-17T07:30:39.375435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-17T07:30:39.375538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-17T07:30:39.375633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-17T07:30:39.375760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-17T07:30:39.375868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-17T07:30:39.375976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-17T07:30:39.376079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-09-17T07:30:39.376185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-17T07:30:39.376288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-17T07:30:39.376397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-17T07:30:39.376518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-17T07:30:39.376687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-09-17T07:30:39.376807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-17T07:30:39.376905] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-17T07:30:39.377007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-17T07:30:39.377119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-17T07:30:39.377226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-17T07:30:39.377324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-17T07:30:39.377420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-17T07:30:39.377519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-09-17T07:30:39.377628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-17T07:30:39.377875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-17T07:30:39.378000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-17T07:30:39.378109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-17T07:30:39.378215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELC.csv [2025-09-17T07:30:39.378469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNN.csv [2025-09-17T07:30:39.378587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-17T07:30:39.378720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-17T07:30:39.378855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-17T07:30:39.378986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-17T07:30:39.379103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-17T07:30:39.379211] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-17T07:30:39.379324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-09-17T07:30:39.379437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-17T07:30:39.379549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-17T07:30:39.379678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-17T07:30:39.379799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-17T07:30:39.379910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-17T07:30:39.380022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-17T07:30:39.380127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-17T07:30:39.380229] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-09-17T07:30:39.380330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-17T07:30:39.380435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-17T07:30:39.380552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-17T07:30:39.380678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-17T07:30:39.380808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-17T07:30:39.380916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-17T07:30:39.381029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-17T07:30:39.381164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-17T07:30:39.381272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-17T07:30:39.381378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-17T07:30:39.381480] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-17T07:30:39.381587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPRI.csv [2025-09-17T07:30:39.381721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-17T07:30:39.381824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-17T07:30:39.381945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-17T07:30:39.382059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-17T07:30:39.382175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-17T07:30:39.382283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-17T07:30:39.382390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-17T07:30:39.382494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-17T07:30:39.382598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-17T07:30:39.382726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-17T07:30:39.382840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-17T07:30:39.382955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-17T07:30:39.383063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-17T07:30:39.383176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-17T07:30:39.383277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-17T07:30:39.383403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-17T07:30:39.383507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-17T07:30:39.383619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-17T07:30:39.383743] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-17T07:30:39.383843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-17T07:30:39.384129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-17T07:30:39.384251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-17T07:30:39.384362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-17T07:30:39.384466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-17T07:30:39.384598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-17T07:30:39.384733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-17T07:30:39.384843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-17T07:30:39.384959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-17T07:30:39.385072] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DD.csv [2025-09-17T07:30:39.385186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-17T07:30:39.385298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-17T07:30:39.385414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-17T07:30:39.385520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-17T07:30:39.385629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-17T07:30:39.385768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-17T07:30:39.385883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-17T07:30:39.386016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-17T07:30:39.386133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-17T07:30:39.386249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPY.csv [2025-09-17T07:30:39.386364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-17T07:30:39.386477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-17T07:30:39.386576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-09-17T07:30:39.386768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-17T07:30:39.386894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-17T07:30:39.387004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-17T07:30:39.387111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-17T07:30:39.387232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-17T07:30:39.387333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-17T07:30:39.387441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-17T07:30:39.387556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-17T07:30:39.387697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-17T07:30:39.387818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-17T07:30:39.387932] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-09-17T07:30:39.388033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-17T07:30:39.388145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-17T07:30:39.388262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-17T07:30:39.388373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-17T07:30:39.388483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-17T07:30:39.388597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-17T07:30:39.388723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-17T07:30:39.388836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-17T07:30:39.388943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-17T07:30:39.389056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-17T07:30:39.389166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-09-17T07:30:39.389283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-17T07:30:39.389387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-17T07:30:39.389498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-17T07:30:39.389610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-17T07:30:39.389737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-17T07:30:39.389851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BG.csv [2025-09-17T07:30:39.389960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-09-17T07:30:39.390059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-17T07:30:39.390184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-17T07:30:39.390307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-17T07:30:39.390422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-17T07:30:39.390527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-17T07:30:39.390630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-17T07:30:39.390792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-17T07:30:39.390891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-17T07:30:39.391129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-17T07:30:39.391249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-17T07:30:39.391366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-17T07:30:39.391476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-17T07:30:39.391595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-17T07:30:39.391722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRT.csv [2025-09-17T07:30:39.391835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-17T07:30:39.391948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-17T07:30:39.392054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-17T07:30:39.392169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-17T07:30:39.392277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSU.csv [2025-09-17T07:30:39.392385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-17T07:30:39.392498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-17T07:30:39.392619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-17T07:30:39.392747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-17T07:30:39.392864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-17T07:30:39.392975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-17T07:30:39.393082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-17T07:30:39.393189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-17T07:30:39.393339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-17T07:30:39.393454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-17T07:30:39.393562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-17T07:30:39.393694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-17T07:30:39.393810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-17T07:30:39.393927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-17T07:30:39.394030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-17T07:30:39.394139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-17T07:30:39.394252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-17T07:30:39.394359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-17T07:30:39.394470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-17T07:30:39.394598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-17T07:30:39.394976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-09-17T07:30:39.395280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-17T07:30:39.395419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-17T07:30:39.395556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLD.csv [2025-09-17T07:30:39.395991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-17T07:30:39.396123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-17T07:30:39.396259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-17T07:30:39.396381] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-17T07:30:39.396517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-17T07:30:39.396620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-17T07:30:39.396755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-17T07:30:39.397131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-17T07:30:39.397251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-17T07:30:39.397372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-17T07:30:39.397500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RQI.csv [2025-09-17T07:30:39.397624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-17T07:30:39.397760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-17T07:30:39.397878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-17T07:30:39.397985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-17T07:30:39.398102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-17T07:30:39.398212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-17T07:30:39.398326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-17T07:30:39.398428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-17T07:30:39.398530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMD.csv [2025-09-17T07:30:39.398671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-17T07:30:39.398796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CE.csv [2025-09-17T07:30:39.398936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-17T07:30:39.399050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-17T07:30:39.399171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-09-17T07:30:39.399295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-17T07:30:39.399398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-17T07:30:39.399510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-17T07:30:39.399625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-17T07:30:39.399747] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-17T07:30:39.399862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-17T07:30:39.399973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-17T07:30:39.400095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-17T07:30:39.400215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-17T07:30:39.400355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-17T07:30:39.400606] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-17T07:30:39.400745] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-17T07:30:39.400862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-17T07:30:39.400982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-17T07:30:39.401107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-17T07:30:39.401223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-17T07:30:39.401328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-17T07:30:39.401434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEE.csv [2025-09-17T07:30:39.401531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-17T07:30:39.401630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCL.csv [2025-09-17T07:30:39.401758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-17T07:30:39.401878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-17T07:30:39.401990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-17T07:30:39.402099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-17T07:30:39.402222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-17T07:30:39.402520] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-17T07:30:39.402634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-17T07:30:39.402763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-17T07:30:39.402882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-17T07:30:39.403007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-17T07:30:39.403105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-17T07:30:39.403226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXP.csv [2025-09-17T07:30:39.403329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-17T07:30:39.403438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-17T07:30:39.403554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-17T07:30:39.403679] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-17T07:30:39.403793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-17T07:30:39.403911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-17T07:30:39.404044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-17T07:30:39.404187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-17T07:30:39.404303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-17T07:30:39.404437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-17T07:30:39.404592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-17T07:30:39.404744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSC.csv [2025-09-17T07:30:39.404876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-17T07:30:39.405004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-17T07:30:39.405138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ING.csv [2025-09-17T07:30:39.405269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-09-17T07:30:39.405422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-17T07:30:39.405548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFE.csv [2025-09-17T07:30:39.405775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-17T07:30:39.405931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-17T07:30:39.406058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEG.csv [2025-09-17T07:30:39.406180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-17T07:30:39.406301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-17T07:30:39.406428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-09-17T07:30:39.406543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-17T07:30:39.406697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-17T07:30:39.406819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-17T07:30:39.406951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-17T07:30:39.407076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-17T07:30:39.407208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-17T07:30:39.407335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-17T07:30:39.407463] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLNT.csv [2025-09-17T07:30:39.407592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-17T07:30:39.407726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-17T07:30:39.407853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-17T07:30:39.407963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-17T07:30:39.408065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-17T07:30:39.408200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-17T07:30:39.408309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-17T07:30:39.408435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-17T07:30:39.408566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-17T07:30:39.408703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-17T07:30:39.408829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-17T07:30:39.408945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-17T07:30:39.409314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-17T07:30:39.409443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-09-17T07:30:39.409559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-17T07:30:39.409708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-17T07:30:39.409839] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-17T07:30:39.409956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-17T07:30:39.410075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-17T07:30:39.410197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-17T07:30:39.410327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-17T07:30:39.410444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOW.csv [2025-09-17T07:30:39.410580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-17T07:30:39.410791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-17T07:30:39.410920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-17T07:30:39.411035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIF.csv [2025-09-17T07:30:39.411167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-17T07:30:39.411298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-17T07:30:39.411426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-17T07:30:39.411541] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-17T07:30:39.411692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-17T07:30:39.411821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-17T07:30:39.411954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-17T07:30:39.412076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-09-17T07:30:39.412205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-17T07:30:39.412329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-17T07:30:39.412451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-17T07:30:39.412566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-17T07:30:39.412699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-17T07:30:39.412838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-17T07:30:39.412965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-17T07:30:39.413090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-17T07:30:39.413215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-17T07:30:39.413316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-17T07:30:39.413427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-09-17T07:30:39.413542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-17T07:30:39.413676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-17T07:30:39.413790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-17T07:30:39.413907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-17T07:30:39.414017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DB.csv [2025-09-17T07:30:39.414124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADNT.csv [2025-09-17T07:30:39.414233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-17T07:30:39.414341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-17T07:30:39.414444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-17T07:30:39.414587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-17T07:30:39.414719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-17T07:30:39.414836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-17T07:30:39.414946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-17T07:30:39.415057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOD.csv [2025-09-17T07:30:39.415164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-17T07:30:39.415288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-17T07:30:39.415404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-17T07:30:39.415514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-17T07:30:39.415630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-17T07:30:39.415925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-17T07:30:39.416036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-17T07:30:39.416140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-17T07:30:39.416256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-17T07:30:39.416372] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-17T07:30:39.416487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-17T07:30:39.416594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-17T07:30:39.416720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-17T07:30:39.416843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-17T07:30:39.417132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-17T07:30:39.417244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-17T07:30:39.417357] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-17T07:30:39.417457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-17T07:30:39.417569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-17T07:30:39.417725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-17T07:30:39.417844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-17T07:30:39.417949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-17T07:30:39.418064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-17T07:30:39.418185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-17T07:30:39.418298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-17T07:30:39.418411] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-17T07:30:39.418514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-17T07:30:39.418635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-17T07:30:39.418770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCH.csv [2025-09-17T07:30:39.418876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-17T07:30:39.418988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-17T07:30:39.419115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-17T07:30:39.419221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-17T07:30:39.419331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-17T07:30:39.419437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-17T07:30:39.419536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-17T07:30:39.419726] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-17T07:30:39.419846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-17T07:30:39.419961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-17T07:30:39.420109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-17T07:30:39.420232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-17T07:30:39.420336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-17T07:30:39.420450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-17T07:30:39.420567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-17T07:30:39.420693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-17T07:30:39.420809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-17T07:30:39.420919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-17T07:30:39.421032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-17T07:30:39.421140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-17T07:30:39.421248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-17T07:30:39.421359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-17T07:30:39.421461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-17T07:30:39.421564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-17T07:30:39.421690] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADCT.csv [2025-09-17T07:30:39.421797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-17T07:30:39.421901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-09-17T07:30:39.422003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-17T07:30:39.422107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-17T07:30:39.422208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-17T07:30:39.422314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-09-17T07:30:39.422407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-17T07:30:39.422517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-17T07:30:39.422856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-17T07:30:39.422978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-17T07:30:39.423097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-17T07:30:39.423212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-17T07:30:39.423335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-17T07:30:39.423447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-17T07:30:39.423556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-17T07:30:39.423684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-17T07:30:39.423793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-17T07:30:39.423908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-17T07:30:39.424015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-17T07:30:39.424126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPI.csv [2025-09-17T07:30:39.424231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-17T07:30:39.424346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-17T07:30:39.424464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-17T07:30:39.424609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-09-17T07:30:39.424779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-17T07:30:39.424889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-17T07:30:39.424996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-17T07:30:39.425121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-17T07:30:39.425262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-09-17T07:30:39.425363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-17T07:30:39.425467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-17T07:30:39.425613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-17T07:30:39.425754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-17T07:30:39.425857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-17T07:30:39.425956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-17T07:30:39.426065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-17T07:30:39.426169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAO.csv [2025-09-17T07:30:39.426302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-17T07:30:39.426420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-17T07:30:39.426530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-17T07:30:39.426655] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-17T07:30:39.426758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-17T07:30:39.426861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-17T07:30:39.426984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-17T07:30:39.427102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-17T07:30:39.427220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-17T07:30:39.427326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-17T07:30:39.427427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-17T07:30:39.427545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-17T07:30:39.427693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-17T07:30:39.427834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-17T07:30:39.427942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-17T07:30:39.428048] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-17T07:30:39.428165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-17T07:30:39.428282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-17T07:30:39.428406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-17T07:30:39.428519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-17T07:30:39.428625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-17T07:30:39.428787] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-17T07:30:39.428895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-17T07:30:39.429022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-17T07:30:39.429149] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-17T07:30:39.429286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-17T07:30:39.429428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-17T07:30:39.429790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-17T07:30:39.429923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-17T07:30:39.430041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-17T07:30:39.430145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-17T07:30:39.430258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-17T07:30:39.430359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-17T07:30:39.430464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-17T07:30:39.430605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-17T07:30:39.430740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-17T07:30:39.430854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-17T07:30:39.430957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-17T07:30:39.431064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-17T07:30:39.431168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-17T07:30:39.431284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-17T07:30:39.431396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-17T07:30:39.431509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-17T07:30:39.431614] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-17T07:30:39.431741] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-17T07:30:39.431843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-17T07:30:39.431959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-17T07:30:39.432065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-17T07:30:39.432173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-17T07:30:39.432292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADX.csv [2025-09-17T07:30:39.432401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFG.csv [2025-09-17T07:30:39.432510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-17T07:30:39.432609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-17T07:30:39.432740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-17T07:30:39.432867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-17T07:30:39.432980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-17T07:30:39.433092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-17T07:30:39.433199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-17T07:30:39.433299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-17T07:30:39.433399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-17T07:30:39.433500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-17T07:30:39.433607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-17T07:30:39.433736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXT.csv [2025-09-17T07:30:39.433991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-09-17T07:30:39.434114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-17T07:30:39.434221] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-17T07:30:39.434340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-17T07:30:39.434442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-17T07:30:39.434545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-17T07:30:39.434749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-17T07:30:39.434879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-17T07:30:39.434995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-17T07:30:39.435102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSBR.csv [2025-09-17T07:30:39.435213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-17T07:30:39.435323] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-17T07:30:39.435435] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-17T07:30:39.435539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-17T07:30:39.435656] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-17T07:30:39.435776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-17T07:30:39.435902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-17T07:30:39.436013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-17T07:30:39.436126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-17T07:30:39.436231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-17T07:30:39.436341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-17T07:30:39.436441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-09-17T07:30:39.436549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-17T07:30:39.436681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-17T07:30:39.436794] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-17T07:30:39.436902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-17T07:30:39.437008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKLO.csv [2025-09-17T07:30:39.437120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-17T07:30:39.437232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-17T07:30:39.437333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PM.csv [2025-09-17T07:30:39.437437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-17T07:30:39.437552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-09-17T07:30:39.437682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-17T07:30:39.438051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-17T07:30:39.438168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-17T07:30:39.438276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-17T07:30:39.438384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSI.csv [2025-09-17T07:30:39.438498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-17T07:30:39.438633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-17T07:30:39.438757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-17T07:30:39.438858] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-17T07:30:39.438953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-17T07:30:39.439051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-17T07:30:39.439163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-17T07:30:39.439268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-17T07:30:39.439377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-17T07:30:39.439484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-17T07:30:39.439581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-17T07:30:39.439879] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-17T07:30:39.439999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-17T07:30:39.440113] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-17T07:30:39.440231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-17T07:30:39.440341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-17T07:30:39.440456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-17T07:30:39.440566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-17T07:30:39.440692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-17T07:30:39.440803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-17T07:30:39.440907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-17T07:30:39.441013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-17T07:30:39.441125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-17T07:30:39.441233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-17T07:30:39.441343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KW.csv [2025-09-17T07:30:39.441443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-17T07:30:39.441553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-17T07:30:39.441685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-17T07:30:39.441800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-17T07:30:39.441907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-17T07:30:39.442034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-17T07:30:39.442153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-17T07:30:39.442263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-17T07:30:39.442368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNR.csv [2025-09-17T07:30:39.442488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-17T07:30:39.442601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-17T07:30:39.442752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGM.csv [2025-09-17T07:30:39.442877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-17T07:30:39.442989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-17T07:30:39.443107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-17T07:30:39.443213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-17T07:30:39.443309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-17T07:30:39.443424] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-17T07:30:39.443536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-17T07:30:39.443662] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-17T07:30:39.443770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-17T07:30:39.443877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-17T07:30:39.443976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-17T07:30:39.444109] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-17T07:30:39.444215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-09-17T07:30:39.444322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-09-17T07:30:39.444420] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-17T07:30:39.444529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-17T07:30:39.444782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-17T07:30:39.444914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-17T07:30:39.445021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-17T07:30:39.445159] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-17T07:30:39.445285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-17T07:30:39.445395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-17T07:30:39.445524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-09-17T07:30:39.445673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-17T07:30:39.445791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-17T07:30:39.446106] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MO.csv [2025-09-17T07:30:39.446232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-17T07:30:39.446345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-17T07:30:39.446455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-17T07:30:39.446572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-17T07:30:39.446702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-17T07:30:39.446822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-17T07:30:39.446951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBD.csv [2025-09-17T07:30:39.447065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-17T07:30:39.447170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-09-17T07:30:39.447304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-17T07:30:39.447408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-17T07:30:39.447565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-17T07:30:39.447700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMU.csv [2025-09-17T07:30:39.447825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGH.csv [2025-09-17T07:30:39.447965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEF.csv [2025-09-17T07:30:39.448083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-17T07:30:39.448198] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-17T07:30:39.448325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-17T07:30:39.448442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-17T07:30:39.448553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-09-17T07:30:39.448694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-17T07:30:39.448815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-17T07:30:39.448928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-17T07:30:39.449051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-17T07:30:39.449167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-17T07:30:39.449288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MP.csv [2025-09-17T07:30:39.449404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-17T07:30:39.449514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-17T07:30:39.449655] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-17T07:30:39.449789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-17T07:30:39.449938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/A.csv [2025-09-17T07:30:39.450052] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-17T07:30:39.450170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-17T07:30:39.450290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-17T07:30:39.450407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-17T07:30:39.450521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-17T07:30:39.450631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-17T07:30:39.450824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-17T07:30:39.450927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-17T07:30:39.451031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-17T07:30:39.451135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-17T07:30:39.451243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-17T07:30:39.451354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-17T07:30:39.451462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-17T07:30:39.451565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-17T07:30:39.451687] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-17T07:30:39.451791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-17T07:30:39.451890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-17T07:30:39.451994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-17T07:30:39.452105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-17T07:30:39.452208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-17T07:30:39.452316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-17T07:30:39.452455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-17T07:30:39.452593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-17T07:30:39.452717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-17T07:30:39.452990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-17T07:30:39.453104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-17T07:30:39.453235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-17T07:30:39.453358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-17T07:30:39.453489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-17T07:30:39.453599] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-17T07:30:39.453733] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-17T07:30:39.453855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-17T07:30:39.453966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-17T07:30:39.454077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-17T07:30:39.454195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-17T07:30:39.454318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-17T07:30:39.454438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-17T07:30:39.454554] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-17T07:30:39.454713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-17T07:30:39.454833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-17T07:30:39.454953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-17T07:30:39.455075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-17T07:30:39.455185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-17T07:30:39.455363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-17T07:30:39.455478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-17T07:30:39.455590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-17T07:30:39.455738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-17T07:30:39.455862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-17T07:30:39.455985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIM.csv [2025-09-17T07:30:39.456090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-17T07:30:39.456190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-17T07:30:39.456318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-17T07:30:39.456432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-17T07:30:39.456540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-17T07:30:39.456666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-17T07:30:39.456782] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-17T07:30:39.456914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-17T07:30:39.457022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-17T07:30:39.457136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-17T07:30:39.457261] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-17T07:30:39.457508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-17T07:30:39.457632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-17T07:30:39.457776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-17T07:30:39.457891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-17T07:30:39.458010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-17T07:30:39.458117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-17T07:30:39.458234] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-17T07:30:39.458356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-17T07:30:39.458469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-17T07:30:39.458579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-17T07:30:39.458730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-17T07:30:39.458848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-17T07:30:39.458971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-17T07:30:39.459089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-17T07:30:39.459214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-17T07:30:39.459322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-17T07:30:39.459432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-17T07:30:39.459536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-17T07:30:39.459752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-17T07:30:39.459910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-17T07:30:39.460054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-17T07:30:39.460169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-17T07:30:39.460288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-17T07:30:39.460415] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWSN.csv [2025-09-17T07:30:39.460544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-17T07:30:39.460683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-17T07:30:39.460793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-17T07:30:39.460915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AN.csv [2025-09-17T07:30:39.461030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-17T07:30:39.461148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-17T07:30:39.461274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-17T07:30:39.461399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-17T07:30:39.461510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-17T07:30:39.461626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-17T07:30:39.462025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-17T07:30:39.462146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-17T07:30:39.462269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-17T07:30:39.462398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-17T07:30:39.462538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-17T07:30:39.462669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-17T07:30:39.462784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-17T07:30:39.462920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-17T07:30:39.463035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-17T07:30:39.463157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-17T07:30:39.463262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-17T07:30:39.463377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-17T07:30:39.463487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-17T07:30:39.463604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-17T07:30:39.463746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-17T07:30:39.463867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-17T07:30:39.463999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-17T07:30:39.464116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-17T07:30:39.464231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-17T07:30:39.464349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-17T07:30:39.464471] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLG.csv [2025-09-17T07:30:39.464597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-17T07:30:39.464803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-17T07:30:39.464927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-17T07:30:39.465029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-17T07:30:39.465129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-17T07:30:39.465238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-17T07:30:39.465347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-17T07:30:39.465455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-17T07:30:39.465556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-17T07:30:39.465695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDE.csv [2025-09-17T07:30:39.465808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-17T07:30:39.465921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-17T07:30:39.466022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-17T07:30:39.466120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-17T07:30:39.466227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-17T07:30:39.466332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-17T07:30:39.466444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-17T07:30:39.466544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-17T07:30:39.466669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-17T07:30:39.466775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRG.csv [2025-09-17T07:30:39.466874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-17T07:30:39.466993] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-17T07:30:39.467099] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-17T07:30:39.467213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-17T07:30:39.467324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-17T07:30:39.467433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-17T07:30:39.467524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-17T07:30:39.467622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-17T07:30:39.467816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-17T07:30:39.467931] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCD.csv [2025-09-17T07:30:39.468039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-17T07:30:39.468138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-17T07:30:39.468240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-17T07:30:39.468341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-17T07:30:39.468478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-17T07:30:39.468587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-17T07:30:39.468714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-17T07:30:39.468828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-17T07:30:39.468936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-17T07:30:39.469034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-17T07:30:39.469139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-17T07:30:39.469242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-17T07:30:39.469349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-17T07:30:39.469449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-17T07:30:39.469561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-17T07:30:39.469795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-17T07:30:39.470131] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFGC.csv [2025-09-17T07:30:39.470246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-17T07:30:39.470358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-17T07:30:39.470460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-17T07:30:39.470569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-17T07:30:39.470689] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-17T07:30:39.470800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-17T07:30:39.470911] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-17T07:30:39.471015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-17T07:30:39.471112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-09-17T07:30:39.471208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-17T07:30:39.471307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-17T07:30:39.471404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-17T07:30:39.471524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-17T07:30:39.471628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-17T07:30:39.471754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-17T07:30:39.471851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-17T07:30:39.471956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-17T07:30:39.472051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-17T07:30:39.472157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-17T07:30:39.472257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-17T07:30:39.472365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-17T07:30:39.472476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMC.csv [2025-09-17T07:30:39.472579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-17T07:30:39.472699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-17T07:30:39.472809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-17T07:30:39.472910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-17T07:30:39.473008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-17T07:30:39.473112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-17T07:30:39.473219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-17T07:30:39.473362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-17T07:30:39.473466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-17T07:30:39.473561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-17T07:30:39.473676] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-17T07:30:39.473777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-17T07:30:39.473875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-17T07:30:39.473968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-17T07:30:39.474081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-17T07:30:39.474178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-17T07:30:39.474284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-17T07:30:39.474389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-17T07:30:39.474488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-17T07:30:39.474609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QBTS.csv [2025-09-17T07:30:39.474728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-17T07:30:39.474832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-17T07:30:39.474939] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-17T07:30:39.475037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-17T07:30:39.475139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-17T07:30:39.475245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-17T07:30:39.475375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-17T07:30:39.475491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-17T07:30:39.475619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-17T07:30:39.475772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-17T07:30:39.475883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-17T07:30:39.476002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-09-17T07:30:39.476107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-17T07:30:39.476233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-17T07:30:39.476344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-17T07:30:39.476594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-17T07:30:39.476723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-17T07:30:39.476825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-17T07:30:39.476927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-17T07:30:39.477029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-17T07:30:39.477142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-17T07:30:39.477248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-17T07:30:39.477352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-17T07:30:39.477464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-17T07:30:39.477568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-17T07:30:39.477768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-17T07:30:39.477893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-17T07:30:39.478006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-17T07:30:39.478121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-17T07:30:39.478223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-17T07:30:39.478333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-17T07:30:39.478440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-17T07:30:39.478539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-09-17T07:30:39.478683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNP.csv [2025-09-17T07:30:39.478900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-17T07:30:39.479023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-17T07:30:39.479123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-17T07:30:39.479226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-17T07:30:39.479332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-17T07:30:39.479439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-17T07:30:39.479549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-17T07:30:39.479666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-17T07:30:39.479784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-17T07:30:39.479892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-17T07:30:39.479991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-17T07:30:39.480130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-17T07:30:39.480236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-17T07:30:39.480349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-17T07:30:39.480451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-17T07:30:39.480559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-17T07:30:39.480677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-17T07:30:39.480788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-17T07:30:39.480906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-17T07:30:39.481013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-17T07:30:39.481294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-17T07:30:39.481397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-17T07:30:39.481509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-17T07:30:39.481607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-17T07:30:39.481727] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-17T07:30:39.481838] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-17T07:30:39.481938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRFS.csv [2025-09-17T07:30:39.482039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-17T07:30:39.482154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-09-17T07:30:39.482265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-17T07:30:39.482375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-17T07:30:39.482482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-17T07:30:39.482581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-17T07:30:39.482703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-17T07:30:39.482817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-17T07:30:39.483115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CADE.csv [2025-09-17T07:30:39.483225] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-09-17T07:30:39.483339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-17T07:30:39.483440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-17T07:30:39.483538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-17T07:30:39.483663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-17T07:30:39.483816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-17T07:30:39.483922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-17T07:30:39.484215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-17T07:30:39.484326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-17T07:30:39.484430] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-17T07:30:39.484529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-17T07:30:39.484681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-17T07:30:39.484793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-17T07:30:39.484902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-09-17T07:30:39.485007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-17T07:30:39.485134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-17T07:30:39.485237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-17T07:30:39.485346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-17T07:30:39.485475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-17T07:30:39.485586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-17T07:30:39.485709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-17T07:30:39.485819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-17T07:30:39.485916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-17T07:30:39.486189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-17T07:30:39.486295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-17T07:30:39.486564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASR.csv [2025-09-17T07:30:39.486693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-17T07:30:39.486811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-17T07:30:39.486918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-09-17T07:30:39.487196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-17T07:30:39.487303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-17T07:30:39.487409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-17T07:30:39.487508] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-17T07:30:39.487615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-17T07:30:39.487833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-17T07:30:39.487944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-17T07:30:39.488045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-17T07:30:39.488147] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-17T07:30:39.488243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-17T07:30:39.488336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-17T07:30:39.488441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-17T07:30:39.488542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-17T07:30:39.488663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-17T07:30:39.488803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-17T07:30:39.488906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-17T07:30:39.489009] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-17T07:30:39.489122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-17T07:30:39.489280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-09-17T07:30:39.489391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-17T07:30:39.489499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-17T07:30:39.489597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-17T07:30:39.489744] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-17T07:30:39.489849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-17T07:30:39.489974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-17T07:30:39.490094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-17T07:30:39.490213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-17T07:30:39.490319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-17T07:30:39.490431] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-17T07:30:39.490531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAC.csv [2025-09-17T07:30:39.490630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-17T07:30:39.490767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHPT.csv [2025-09-17T07:30:39.490870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-17T07:30:39.490981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-17T07:30:39.491089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-17T07:30:39.491190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-17T07:30:39.491292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-17T07:30:39.491396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-17T07:30:39.491496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-17T07:30:39.491968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-17T07:30:39.492083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TS.csv [2025-09-17T07:30:39.492186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-17T07:30:39.492287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-17T07:30:39.492390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-17T07:30:39.492487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-17T07:30:39.492589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-17T07:30:39.492706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-17T07:30:39.492813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-17T07:30:39.492915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-17T07:30:39.493029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-17T07:30:39.493138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-17T07:30:39.493249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-17T07:30:39.493367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-17T07:30:39.493487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-09-17T07:30:39.493589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-17T07:30:39.493717] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-17T07:30:39.493836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-17T07:30:39.493952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCLH.csv [2025-09-17T07:30:39.494055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-17T07:30:39.494158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-17T07:30:39.494258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-17T07:30:39.494367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-17T07:30:39.494492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DE.csv [2025-09-17T07:30:39.494618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-17T07:30:39.494740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-17T07:30:39.494846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-17T07:30:39.494958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-17T07:30:39.495058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-17T07:30:39.495161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-17T07:30:39.495260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-17T07:30:39.495399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-17T07:30:39.495515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-17T07:30:39.495656] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-17T07:30:39.495772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-17T07:30:39.495912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-17T07:30:39.496045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-17T07:30:39.496166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-17T07:30:39.496286] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-17T07:30:39.496407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-17T07:30:39.496530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-17T07:30:39.496781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-17T07:30:39.496895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-17T07:30:39.497028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-09-17T07:30:39.497153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-17T07:30:39.497268] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-17T07:30:39.497382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-17T07:30:39.497507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-17T07:30:39.497624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-17T07:30:39.498064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-17T07:30:39.498190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-17T07:30:39.498288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-17T07:30:39.498427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-17T07:30:39.498567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-17T07:30:39.498715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-17T07:30:39.498841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-17T07:30:39.498955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-17T07:30:39.499076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-17T07:30:39.499202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-17T07:30:39.499318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-17T07:30:39.499438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-17T07:30:39.499551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-17T07:30:39.499700] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-17T07:30:39.499825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-17T07:30:39.499940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-17T07:30:39.500046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-09-17T07:30:39.500161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-09-17T07:30:39.500271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-17T07:30:39.500382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-17T07:30:39.500486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-17T07:30:39.500585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-17T07:30:39.500708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-17T07:30:39.500808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-17T07:30:39.500907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-17T07:30:39.501021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-17T07:30:39.501127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-17T07:30:39.501235] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-17T07:30:39.501337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-17T07:30:39.501446] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-09-17T07:30:39.501569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHT.csv [2025-09-17T07:30:39.501763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-17T07:30:39.501876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-17T07:30:39.501989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-17T07:30:39.502280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-17T07:30:39.502388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-17T07:30:39.502494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-17T07:30:39.502607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-17T07:30:39.502735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-17T07:30:39.502843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-17T07:30:39.502950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-17T07:30:39.503075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-17T07:30:39.503190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-17T07:30:39.503298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-17T07:30:39.503558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-17T07:30:39.503692] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-17T07:30:39.503804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-17T07:30:39.503924] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-17T07:30:39.504066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-17T07:30:39.504192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-17T07:30:39.504309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-17T07:30:39.504436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-17T07:30:39.504549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-17T07:30:39.504698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-09-17T07:30:39.504855] [INFO ] [LOCAL ] Deleted 1957 derivative data files. [2025-09-17T07:30:39.504903] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-17T07:30:39.507178] [INFO ] [LOCAL ] Found 2172 symbols with primary data. [2025-09-17T07:30:39.507340] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2172 symbols [2025-09-17T07:30:39.507916] [INFO ] [MAIN ] A: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:39.508771] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:39.509142] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:39.600317] [DEBUG] [LOCAL ] AAP: Loaded 52202 existing records from primary storage. [2025-09-17T07:30:39.601591] [INFO ] [MAIN ] AAP: Loaded 52202 primary data records. [2025-09-17T07:30:39.602324] [DEBUG] [LOCAL ] AA: Loaded 53585 existing records from primary storage. [2025-09-17T07:30:39.639385] [INFO ] [MAIN ] AA: Loaded 53585 primary data records. [2025-09-17T07:30:39.794012] [DEBUG] [LOCAL ] A: Loaded 50850 existing records from primary storage. [2025-09-17T07:30:39.841137] [INFO ] [MAIN ] A: Loaded 50850 primary data records. [2025-09-17T07:30:40.588771] [DEBUG] [MAIN ] AAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:40.588309] [DEBUG] [MAIN ] AA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:40.589858] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 52202 primary records. [2025-09-17T07:30:40.590400] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53585 primary records. [2025-09-17T07:30:40.590668] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-17T07:30:40.590999] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-17T07:30:40.635058] [DEBUG] [MAIN ] A: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:40.637907] [INFO ] [MAIN ] A: Generated 1794 derivative records from 50850 primary records. [2025-09-17T07:30:40.638380] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-09-17T07:30:40.639579] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-17T07:30:40.639470] [DEBUG] [LOCAL ] A: Saving derivative data. [2025-09-17T07:30:40.641844] [INFO ] [MAIN ] Derivative Progress: 1/2172 symbols completed. AA took 1.1s. Estimated remaining: 41m 3s. Rate: 52.9 symbols/min [2025-09-17T07:30:40.639340] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-09-17T07:30:40.642823] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-17T07:30:40.643013] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:40.644935] [INFO ] [MAIN ] Derivative Progress: 2/2172 symbols completed. AAP took 1.1s. Estimated remaining: 20m 34s. Rate: 105.5 symbols/min [2025-09-17T07:30:40.645695] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:40.661894] [DEBUG] [LOCAL ] A: Derivative data saved (1794 records). [2025-09-17T07:30:40.662279] [INFO ] [MAIN ] A: Successfully saved derivative data. [2025-09-17T07:30:40.664809] [INFO ] [MAIN ] Derivative Progress: 3/2172 symbols completed. A took 1.2s. Estimated remaining: 13m 57s. Rate: 155.5 symbols/min [2025-09-17T07:30:40.665231] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:40.705295] [DEBUG] [LOCAL ] AAT: Loaded 30568 existing records from primary storage. [2025-09-17T07:30:40.705482] [INFO ] [MAIN ] AAT: Loaded 30568 primary data records. [2025-09-17T07:30:40.815605] [DEBUG] [LOCAL ] AB: Loaded 29296 existing records from primary storage. [2025-09-17T07:30:40.845290] [INFO ] [MAIN ] AB: Loaded 29296 primary data records. [2025-09-17T07:30:41.163398] [DEBUG] [LOCAL ] ABBV: Loaded 53690 existing records from primary storage. [2025-09-17T07:30:41.213419] [INFO ] [MAIN ] ABBV: Loaded 53690 primary data records. [2025-09-17T07:30:41.752742] [DEBUG] [MAIN ] AAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:41.754314] [INFO ] [MAIN ] AAT: Generated 1794 derivative records from 30568 primary records. [2025-09-17T07:30:41.754498] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-17T07:30:41.789232] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-09-17T07:30:41.786421] [DEBUG] [MAIN ] AB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:41.789755] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-17T07:30:41.790849] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 29296 primary records. [2025-09-17T07:30:41.792604] [INFO ] [MAIN ] Derivative Progress: 4/2172 symbols completed. AAT took 1.1s. Estimated remaining: 20m 39s. Rate: 105.0 symbols/min [2025-09-17T07:30:41.792963] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:41.793210] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-17T07:30:41.814482] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-09-17T07:30:41.814695] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-17T07:30:41.816948] [INFO ] [MAIN ] Derivative Progress: 5/2172 symbols completed. AB took 1.2s. Estimated remaining: 16m 41s. Rate: 129.9 symbols/min [2025-09-17T07:30:41.817472] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:41.850089] [DEBUG] [MAIN ] ABBV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:41.850944] [INFO ] [MAIN ] ABBV: Generated 1794 derivative records from 53690 primary records. [2025-09-17T07:30:41.851313] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-17T07:30:41.880007] [DEBUG] [LOCAL ] ABCB: Loaded 30681 existing records from primary storage. [2025-09-17T07:30:41.880785] [INFO ] [MAIN ] ABCB: Loaded 30681 primary data records. [2025-09-17T07:30:42.014245] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1794 records). [2025-09-17T07:30:42.060955] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-17T07:30:42.106497] [INFO ] [MAIN ] Derivative Progress: 6/2172 symbols completed. ABBV took 1.4s. Estimated remaining: 15m 38s. Rate: 138.5 symbols/min [2025-09-17T07:30:42.106972] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:42.211709] [DEBUG] [LOCAL ] ABEV: Loaded 53272 existing records from primary storage. [2025-09-17T07:30:42.222348] [INFO ] [MAIN ] ABEV: Loaded 53272 primary data records. [2025-09-17T07:30:42.425945] [DEBUG] [LOCAL ] ABG: Loaded 18953 existing records from primary storage. [2025-09-17T07:30:42.427401] [INFO ] [MAIN ] ABG: Loaded 18953 primary data records. [2025-09-17T07:30:42.879926] [DEBUG] [MAIN ] ABCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:42.880665] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30681 primary records. [2025-09-17T07:30:42.881017] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-17T07:30:42.902460] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-09-17T07:30:42.902808] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-17T07:30:42.915816] [DEBUG] [MAIN ] ABEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:42.917940] [INFO ] [MAIN ] Derivative Progress: 7/2172 symbols completed. ABCB took 1.1s. Estimated remaining: 17m 35s. Rate: 123.1 symbols/min [2025-09-17T07:30:42.919869] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53272 primary records. [2025-09-17T07:30:42.920095] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:42.920349] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-17T07:30:42.937707] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-09-17T07:30:42.938148] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-17T07:30:42.939851] [INFO ] [MAIN ] Derivative Progress: 8/2172 symbols completed. ABEV took 1.1s. Estimated remaining: 15m 29s. Rate: 139.8 symbols/min [2025-09-17T07:30:42.940285] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:42.956777] [DEBUG] [MAIN ] ABG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:42.957539] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 18953 primary records. [2025-09-17T07:30:42.965823] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-17T07:30:42.982383] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-09-17T07:30:42.983266] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-17T07:30:42.993751] [INFO ] [MAIN ] Derivative Progress: 9/2172 symbols completed. ABG took 0.9s. Estimated remaining: 13m 58s. Rate: 154.9 symbols/min [2025-09-17T07:30:42.995341] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:42.996216] [DEBUG] [LOCAL ] ABM: Loaded 32145 existing records from primary storage. [2025-09-17T07:30:42.996602] [INFO ] [MAIN ] ABM: Loaded 32145 primary data records. [2025-09-17T07:30:43.332661] [DEBUG] [LOCAL ] ABR: Loaded 52177 existing records from primary storage. [2025-09-17T07:30:43.332864] [INFO ] [MAIN ] ABR: Loaded 52177 primary data records. [2025-09-17T07:30:43.462039] [DEBUG] [LOCAL ] ABT: Loaded 53621 existing records from primary storage. [2025-09-17T07:30:43.528502] [INFO ] [MAIN ] ABT: Loaded 53621 primary data records. [2025-09-17T07:30:44.006213] [DEBUG] [MAIN ] ABM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:44.007163] [INFO ] [MAIN ] ABM: Generated 1794 derivative records from 32145 primary records. [2025-09-17T07:30:44.007400] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-17T07:30:44.024588] [DEBUG] [LOCAL ] ABM: Derivative data saved (1794 records). [2025-09-17T07:30:44.025723] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-17T07:30:44.028137] [INFO ] [MAIN ] Derivative Progress: 10/2172 symbols completed. ABM took 1.1s. Estimated remaining: 16m 17s. Rate: 132.7 symbols/min [2025-09-17T07:30:44.029459] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:44.046395] [DEBUG] [MAIN ] ABR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:44.047147] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 52177 primary records. [2025-09-17T07:30:44.047750] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-17T07:30:44.077074] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-09-17T07:30:44.077331] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-17T07:30:44.079427] [INFO ] [MAIN ] Derivative Progress: 11/2172 symbols completed. ABR took 1.1s. Estimated remaining: 14m 58s. Rate: 144.4 symbols/min [2025-09-17T07:30:44.079715] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:44.105601] [DEBUG] [LOCAL ] ACA: Loaded 24455 existing records from primary storage. [2025-09-17T07:30:44.105949] [DEBUG] [MAIN ] ABT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:44.107844] [INFO ] [MAIN ] ACA: Loaded 24455 primary data records. [2025-09-17T07:30:44.108612] [INFO ] [MAIN ] ABT: Generated 1794 derivative records from 53621 primary records. [2025-09-17T07:30:44.139500] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-17T07:30:44.333634] [DEBUG] [LOCAL ] ACCO: Loaded 38109 existing records from primary storage. [2025-09-17T07:30:44.334546] [DEBUG] [LOCAL ] ABT: Derivative data saved (1794 records). [2025-09-17T07:30:44.453574] [INFO ] [MAIN ] ACCO: Loaded 38109 primary data records. [2025-09-17T07:30:44.453780] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-17T07:30:44.469046] [INFO ] [MAIN ] Derivative Progress: 12/2172 symbols completed. ABT took 1.5s. Estimated remaining: 14m 53s. Rate: 145.1 symbols/min [2025-09-17T07:30:44.500499] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:44.771242] [DEBUG] [LOCAL ] ACEL: Loaded 27547 existing records from primary storage. [2025-09-17T07:30:44.772609] [INFO ] [MAIN ] ACEL: Loaded 27547 primary data records. [2025-09-17T07:30:44.894751] [DEBUG] [MAIN ] ACA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:44.896504] [INFO ] [MAIN ] ACA: Generated 1794 derivative records from 24455 primary records. [2025-09-17T07:30:44.897210] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-17T07:30:45.025123] [DEBUG] [LOCAL ] ACA: Derivative data saved (1794 records). [2025-09-17T07:30:45.106633] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-17T07:30:45.109518] [INFO ] [MAIN ] Derivative Progress: 13/2172 symbols completed. ACA took 1.1s. Estimated remaining: 15m 30s. Rate: 139.2 symbols/min [2025-09-17T07:30:45.125984] [DEBUG] [MAIN ] ACCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:45.127769] [INFO ] [MAIN ] ACCO: Generated 1794 derivative records from 38109 primary records. [2025-09-17T07:30:45.128037] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-17T07:30:45.145810] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1794 records). [2025-09-17T07:30:45.145951] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-17T07:30:45.147979] [INFO ] [MAIN ] Derivative Progress: 14/2172 symbols completed. ACCO took 1.1s. Estimated remaining: 14m 29s. Rate: 148.9 symbols/min [2025-09-17T07:30:45.167162] [DEBUG] [MAIN ] ACEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:45.167829] [INFO ] [MAIN ] ACEL: Generated 1794 derivative records from 27547 primary records. [2025-09-17T07:30:45.167905] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-17T07:30:45.184268] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1794 records). [2025-09-17T07:30:45.184363] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-17T07:30:45.187139] [INFO ] [MAIN ] Derivative Progress: 15/2172 symbols completed. ACEL took 0.7s. Estimated remaining: 13m 37s. Rate: 158.5 symbols/min [2025-09-17T07:30:45.187894] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:45.187983] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:45.188098] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:45.255023] [DEBUG] [LOCAL ] ACM: Loaded 43150 existing records from primary storage. [2025-09-17T07:30:45.255813] [INFO ] [MAIN ] ACM: Loaded 43150 primary data records. [2025-09-17T07:30:45.357555] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-09-17T07:30:45.384020] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-09-17T07:30:45.387964] [DEBUG] [LOCAL ] ACI: Loaded 53268 existing records from primary storage. [2025-09-17T07:30:45.398361] [INFO ] [MAIN ] ACI: Loaded 53268 primary data records. [2025-09-17T07:30:46.287218] [DEBUG] [MAIN ] ACM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:46.288941] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 43150 primary records. [2025-09-17T07:30:46.289296] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-17T07:30:46.307312] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-09-17T07:30:46.307708] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-17T07:30:46.310310] [INFO ] [MAIN ] Derivative Progress: 16/2172 symbols completed. ACM took 1.1s. Estimated remaining: 15m 17s. Rate: 141.1 symbols/min [2025-09-17T07:30:46.311200] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:46.340919] [DEBUG] [MAIN ] ACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:46.341216] [DEBUG] [MAIN ] ACHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:46.342586] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53268 primary records. [2025-09-17T07:30:46.342713] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-17T07:30:46.342044] [INFO ] [MAIN ] ACHR: Generated 1794 derivative records from 53818 primary records. [2025-09-17T07:30:46.343242] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-17T07:30:46.371442] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-09-17T07:30:46.373615] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-17T07:30:46.377354] [INFO ] [MAIN ] Derivative Progress: 17/2172 symbols completed. ACI took 1.2s. Estimated remaining: 14m 31s. Rate: 148.5 symbols/min [2025-09-17T07:30:46.378334] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:46.379313] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-09-17T07:30:46.379438] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-17T07:30:46.381986] [INFO ] [MAIN ] Derivative Progress: 18/2172 symbols completed. ACHR took 1.2s. Estimated remaining: 13m 43s. Rate: 157.1 symbols/min [2025-09-17T07:30:46.382608] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:46.391494] [DEBUG] [LOCAL ] ACR: Loaded 6495 existing records from primary storage. [2025-09-17T07:30:46.391668] [INFO ] [MAIN ] ACR: Loaded 6495 primary data records. [2025-09-17T07:30:46.632771] [DEBUG] [LOCAL ] ACP: Loaded 31437 existing records from primary storage. [2025-09-17T07:30:46.740184] [DEBUG] [LOCAL ] ACN: Loaded 53419 existing records from primary storage. [2025-09-17T07:30:46.749974] [INFO ] [MAIN ] ACP: Loaded 31437 primary data records. [2025-09-17T07:30:46.750163] [INFO ] [MAIN ] ACN: Loaded 53419 primary data records. [2025-09-17T07:30:47.410580] [DEBUG] [MAIN ] ACR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:47.412773] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 6495 primary records. [2025-09-17T07:30:47.412901] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-17T07:30:47.431024] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-09-17T07:30:47.432303] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-17T07:30:47.434483] [INFO ] [MAIN ] Derivative Progress: 19/2172 symbols completed. ACR took 1.1s. Estimated remaining: 14m 58s. Rate: 143.8 symbols/min [2025-09-17T07:30:47.436308] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:47.472789] [DEBUG] [MAIN ] ACP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:47.473376] [DEBUG] [MAIN ] ACN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:47.474478] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 31437 primary records. [2025-09-17T07:30:47.475621] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53419 primary records. [2025-09-17T07:30:47.475851] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-17T07:30:47.475895] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-17T07:30:47.513858] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-09-17T07:30:47.514802] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-17T07:30:47.517309] [INFO ] [MAIN ] Derivative Progress: 20/2172 symbols completed. ACP took 1.1s. Estimated remaining: 14m 22s. Rate: 149.8 symbols/min [2025-09-17T07:30:47.518515] [INFO ] [MAIN ] ACV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:47.532977] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-09-17T07:30:47.533709] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-17T07:30:47.533792] [DEBUG] [LOCAL ] ACRE: Loaded 33740 existing records from primary storage. [2025-09-17T07:30:47.538869] [INFO ] [MAIN ] ACRE: Loaded 33740 primary data records. [2025-09-17T07:30:47.538576] [INFO ] [MAIN ] Derivative Progress: 21/2172 symbols completed. ACN took 1.2s. Estimated remaining: 13m 43s. Rate: 156.9 symbols/min [2025-09-17T07:30:47.539322] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:47.583749] [DEBUG] [LOCAL ] ACV: Loaded 6862 existing records from primary storage. [2025-09-17T07:30:47.613571] [INFO ] [MAIN ] ACV: Loaded 6862 primary data records. [2025-09-17T07:30:48.159350] [DEBUG] [LOCAL ] ACVA: Loaded 49402 existing records from primary storage. [2025-09-17T07:30:48.276506] [INFO ] [MAIN ] ACVA: Loaded 49402 primary data records. [2025-09-17T07:30:48.609834] [DEBUG] [MAIN ] ACRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:48.612545] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33740 primary records. [2025-09-17T07:30:48.612764] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-17T07:30:48.626372] [DEBUG] [MAIN ] ACV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:48.642579] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-09-17T07:30:48.638510] [INFO ] [MAIN ] ACV: Generated 1794 derivative records from 6862 primary records. [2025-09-17T07:30:48.643415] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-17T07:30:48.647155] [DEBUG] [LOCAL ] ACV: Saving derivative data. [2025-09-17T07:30:48.647048] [INFO ] [MAIN ] Derivative Progress: 22/2172 symbols completed. ACRE took 1.2s. Estimated remaining: 14m 53s. Rate: 144.4 symbols/min [2025-09-17T07:30:48.648132] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:48.667367] [DEBUG] [LOCAL ] ACV: Derivative data saved (1794 records). [2025-09-17T07:30:48.667627] [INFO ] [MAIN ] ACV: Successfully saved derivative data. [2025-09-17T07:30:48.669940] [INFO ] [MAIN ] Derivative Progress: 23/2172 symbols completed. ACV took 1.2s. Estimated remaining: 14m 16s. Rate: 150.6 symbols/min [2025-09-17T07:30:48.670469] [INFO ] [MAIN ] ADCT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:48.689002] [DEBUG] [MAIN ] ACVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:48.689851] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49402 primary records. [2025-09-17T07:30:48.690067] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-17T07:30:48.718032] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-09-17T07:30:48.718197] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-17T07:30:48.720664] [INFO ] [MAIN ] Derivative Progress: 24/2172 symbols completed. ACVA took 1.2s. Estimated remaining: 13m 45s. Rate: 156.3 symbols/min [2025-09-17T07:30:48.728466] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:48.748401] [DEBUG] [LOCAL ] ADC: Loaded 46698 existing records from primary storage. [2025-09-17T07:30:48.758494] [INFO ] [MAIN ] ADC: Loaded 46698 primary data records. [2025-09-17T07:30:48.759412] [DEBUG] [LOCAL ] ADCT: Loaded 33554 existing records from primary storage. [2025-09-17T07:30:48.771632] [INFO ] [MAIN ] ADCT: Loaded 33554 primary data records. [2025-09-17T07:30:49.287459] [DEBUG] [LOCAL ] ADM: Loaded 53399 existing records from primary storage. [2025-09-17T07:30:49.404078] [INFO ] [MAIN ] ADM: Loaded 53399 primary data records. [2025-09-17T07:30:49.805129] [DEBUG] [MAIN ] ADC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:49.806523] [INFO ] [MAIN ] ADC: Generated 1794 derivative records from 46698 primary records. [2025-09-17T07:30:49.806927] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-17T07:30:49.820395] [DEBUG] [MAIN ] ADCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:49.832381] [INFO ] [MAIN ] ADCT: Generated 1794 derivative records from 33554 primary records. [2025-09-17T07:30:49.837487] [DEBUG] [LOCAL ] ADCT: Saving derivative data. [2025-09-17T07:30:49.857384] [DEBUG] [LOCAL ] ADC: Derivative data saved (1794 records). [2025-09-17T07:30:49.858729] [DEBUG] [LOCAL ] ADCT: Derivative data saved (1794 records). [2025-09-17T07:30:49.858955] [INFO ] [MAIN ] ADCT: Successfully saved derivative data. [2025-09-17T07:30:49.859154] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-17T07:30:49.861477] [INFO ] [MAIN ] Derivative Progress: 25/2172 symbols completed. ADCT took 1.2s. Estimated remaining: 14m 49s. Rate: 144.9 symbols/min [2025-09-17T07:30:49.864067] [INFO ] [MAIN ] ADNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:49.864111] [INFO ] [MAIN ] Derivative Progress: 26/2172 symbols completed. ADC took 1.2s. Estimated remaining: 14m 15s. Rate: 150.6 symbols/min [2025-09-17T07:30:49.865142] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:49.881418] [DEBUG] [MAIN ] ADM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:49.882329] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53399 primary records. [2025-09-17T07:30:49.882508] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-17T07:30:49.899381] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-09-17T07:30:49.899552] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-17T07:30:49.901885] [INFO ] [MAIN ] Derivative Progress: 27/2172 symbols completed. ADM took 1.2s. Estimated remaining: 13m 46s. Rate: 155.8 symbols/min [2025-09-17T07:30:49.902275] [INFO ] [MAIN ] ADX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:49.964463] [DEBUG] [LOCAL ] ADT: Loaded 53455 existing records from primary storage. [2025-09-17T07:30:49.964733] [INFO ] [MAIN ] ADT: Loaded 53455 primary data records. [2025-09-17T07:30:50.091368] [DEBUG] [LOCAL ] ADX: Loaded 28110 existing records from primary storage. [2025-09-17T07:30:50.097971] [INFO ] [MAIN ] ADX: Loaded 28110 primary data records. [2025-09-17T07:30:50.092234] [DEBUG] [LOCAL ] ADNT: Loaded 47668 existing records from primary storage. [2025-09-17T07:30:50.157208] [INFO ] [MAIN ] ADNT: Loaded 47668 primary data records. [2025-09-17T07:30:50.911793] [DEBUG] [MAIN ] ADT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:50.912562] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53455 primary records. [2025-09-17T07:30:50.912815] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-17T07:30:50.930843] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-09-17T07:30:50.931137] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-17T07:30:50.933250] [INFO ] [MAIN ] Derivative Progress: 28/2172 symbols completed. ADT took 1.1s. Estimated remaining: 14m 35s. Rate: 147.0 symbols/min [2025-09-17T07:30:50.970111] [DEBUG] [MAIN ] ADX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:50.970309] [DEBUG] [MAIN ] ADNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:50.971901] [INFO ] [MAIN ] ADNT: Generated 1794 derivative records from 47668 primary records. [2025-09-17T07:30:50.971154] [INFO ] [MAIN ] ADX: Generated 1794 derivative records from 28110 primary records. [2025-09-17T07:30:50.972075] [DEBUG] [LOCAL ] ADX: Saving derivative data. [2025-09-17T07:30:50.972149] [DEBUG] [LOCAL ] ADNT: Saving derivative data. [2025-09-17T07:30:51.002323] [DEBUG] [LOCAL ] ADX: Derivative data saved (1794 records). [2025-09-17T07:30:51.006737] [INFO ] [MAIN ] ADX: Successfully saved derivative data. [2025-09-17T07:30:51.009701] [INFO ] [MAIN ] Derivative Progress: 29/2172 symbols completed. ADX took 1.1s. Estimated remaining: 14m 10s. Rate: 151.3 symbols/min [2025-09-17T07:30:51.015965] [DEBUG] [LOCAL ] ADNT: Derivative data saved (1794 records). [2025-09-17T07:30:51.016103] [INFO ] [MAIN ] ADNT: Successfully saved derivative data. [2025-09-17T07:30:51.019045] [INFO ] [MAIN ] Derivative Progress: 30/2172 symbols completed. ADNT took 1.2s. Estimated remaining: 13m 42s. Rate: 156.4 symbols/min [2025-09-17T07:30:51.019812] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:51.019713] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:51.019888] [INFO ] [MAIN ] AEFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:51.032978] [DEBUG] [LOCAL ] AEFC: Loaded 8704 existing records from primary storage. [2025-09-17T07:30:51.033152] [INFO ] [MAIN ] AEFC: Loaded 8704 primary data records. [2025-09-17T07:30:51.385871] [DEBUG] [LOCAL ] AEG: Loaded 49588 existing records from primary storage. [2025-09-17T07:30:51.387102] [DEBUG] [LOCAL ] AEE: Loaded 50355 existing records from primary storage. [2025-09-17T07:30:51.386078] [INFO ] [MAIN ] AEG: Loaded 49588 primary data records. [2025-09-17T07:30:51.387348] [INFO ] [MAIN ] AEE: Loaded 50355 primary data records. [2025-09-17T07:30:52.062462] [DEBUG] [MAIN ] AEFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:52.064611] [INFO ] [MAIN ] AEFC: Generated 1794 derivative records from 8704 primary records. [2025-09-17T07:30:52.065191] [DEBUG] [LOCAL ] AEFC: Saving derivative data. [2025-09-17T07:30:52.086287] [DEBUG] [LOCAL ] AEFC: Derivative data saved (1794 records). [2025-09-17T07:30:52.086474] [INFO ] [MAIN ] AEFC: Successfully saved derivative data. [2025-09-17T07:30:52.088518] [INFO ] [MAIN ] Derivative Progress: 31/2172 symbols completed. AEFC took 1.1s. Estimated remaining: 14m 29s. Rate: 147.8 symbols/min [2025-09-17T07:30:52.089273] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:52.122614] [DEBUG] [MAIN ] AEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:52.130372] [DEBUG] [MAIN ] AEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:52.131135] [INFO ] [MAIN ] AEG: Generated 1794 derivative records from 49588 primary records. [2025-09-17T07:30:52.132030] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50355 primary records. [2025-09-17T07:30:52.132281] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-17T07:30:52.132228] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-17T07:30:52.169196] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-09-17T07:30:52.170839] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-17T07:30:52.174784] [INFO ] [MAIN ] Derivative Progress: 32/2172 symbols completed. AEG took 1.2s. Estimated remaining: 14m 7s. Rate: 151.6 symbols/min [2025-09-17T07:30:52.175761] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:52.177231] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-09-17T07:30:52.177916] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-17T07:30:52.195174] [INFO ] [MAIN ] Derivative Progress: 33/2172 symbols completed. AEE took 1.2s. Estimated remaining: 13m 42s. Rate: 156.1 symbols/min [2025-09-17T07:30:52.195721] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:52.219222] [DEBUG] [LOCAL ] AEM: Loaded 53464 existing records from primary storage. [2025-09-17T07:30:52.219617] [INFO ] [MAIN ] AEM: Loaded 53464 primary data records. [2025-09-17T07:30:52.575948] [DEBUG] [LOCAL ] AEO: Loaded 53556 existing records from primary storage. [2025-09-17T07:30:52.576314] [INFO ] [MAIN ] AEO: Loaded 53556 primary data records. [2025-09-17T07:30:52.577107] [DEBUG] [LOCAL ] AER: Loaded 48929 existing records from primary storage. [2025-09-17T07:30:52.598884] [INFO ] [MAIN ] AER: Loaded 48929 primary data records. [2025-09-17T07:30:53.212838] [DEBUG] [MAIN ] AEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:53.214101] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53464 primary records. [2025-09-17T07:30:53.214493] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-17T07:30:53.242454] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-09-17T07:30:53.244057] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-17T07:30:53.246363] [INFO ] [MAIN ] Derivative Progress: 34/2172 symbols completed. AEM took 1.2s. Estimated remaining: 14m 24s. Rate: 148.5 symbols/min [2025-09-17T07:30:53.246982] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:53.261730] [DEBUG] [MAIN ] AEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:53.263270] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53556 primary records. [2025-09-17T07:30:53.271117] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-17T07:30:53.276512] [DEBUG] [MAIN ] AER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:53.277512] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48929 primary records. [2025-09-17T07:30:53.289410] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-17T07:30:53.308003] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-09-17T07:30:53.310275] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-17T07:30:53.313464] [INFO ] [MAIN ] Derivative Progress: 35/2172 symbols completed. AER took 1.1s. Estimated remaining: 14m 3s. Rate: 152.1 symbols/min [2025-09-17T07:30:53.315066] [INFO ] [MAIN ] AESI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:53.315686] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-09-17T07:30:53.316155] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-17T07:30:53.318430] [INFO ] [MAIN ] Derivative Progress: 36/2172 symbols completed. AEO took 1.1s. Estimated remaining: 13m 39s. Rate: 156.4 symbols/min [2025-09-17T07:30:53.319075] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:53.347038] [DEBUG] [LOCAL ] AFB: Loaded 11419 existing records from primary storage. [2025-09-17T07:30:53.347354] [INFO ] [MAIN ] AFB: Loaded 11419 primary data records. [2025-09-17T07:30:53.460668] [DEBUG] [LOCAL ] AES: Loaded 53674 existing records from primary storage. [2025-09-17T07:30:53.481329] [INFO ] [MAIN ] AES: Loaded 53674 primary data records. [2025-09-17T07:30:53.679300] [DEBUG] [LOCAL ] AESI: Loaded 49577 existing records from primary storage. [2025-09-17T07:30:53.793197] [INFO ] [MAIN ] AESI: Loaded 49577 primary data records. [2025-09-17T07:30:54.389416] [DEBUG] [MAIN ] AFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:54.390811] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11419 primary records. [2025-09-17T07:30:54.391077] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-17T07:30:54.409315] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-09-17T07:30:54.421863] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-17T07:30:54.422272] [DEBUG] [MAIN ] AES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:54.424876] [INFO ] [MAIN ] Derivative Progress: 37/2172 symbols completed. AFB took 1.1s. Estimated remaining: 14m 21s. Rate: 148.8 symbols/min [2025-09-17T07:30:54.425911] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:54.425705] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53674 primary records. [2025-09-17T07:30:54.427626] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-17T07:30:54.459052] [DEBUG] [MAIN ] AESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:54.460890] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-09-17T07:30:54.461022] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-17T07:30:54.462014] [INFO ] [MAIN ] AESI: Generated 1794 derivative records from 49577 primary records. [2025-09-17T07:30:54.464934] [INFO ] [MAIN ] Derivative Progress: 38/2172 symbols completed. AES took 1.2s. Estimated remaining: 13m 60s. Rate: 152.4 symbols/min [2025-09-17T07:30:54.465112] [DEBUG] [LOCAL ] AESI: Saving derivative data. [2025-09-17T07:30:54.465386] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:54.497250] [DEBUG] [LOCAL ] AFGB: Loaded 2539 existing records from primary storage. [2025-09-17T07:30:54.500492] [INFO ] [MAIN ] AFGB: Loaded 2539 primary data records. [2025-09-17T07:30:54.501707] [DEBUG] [LOCAL ] AESI: Derivative data saved (1794 records). [2025-09-17T07:30:54.553750] [INFO ] [MAIN ] AESI: Successfully saved derivative data. [2025-09-17T07:30:54.600580] [INFO ] [MAIN ] Derivative Progress: 39/2172 symbols completed. AESI took 1.3s. Estimated remaining: 13m 45s. Rate: 155.0 symbols/min [2025-09-17T07:30:54.617339] [DEBUG] [LOCAL ] AFG: Loaded 32732 existing records from primary storage. [2025-09-17T07:30:54.616397] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:54.626473] [INFO ] [MAIN ] AFG: Loaded 32732 primary data records. [2025-09-17T07:30:54.785750] [DEBUG] [LOCAL ] AFGC: Loaded 2528 existing records from primary storage. [2025-09-17T07:30:54.942577] [INFO ] [MAIN ] AFGC: Loaded 2528 primary data records. [2025-09-17T07:30:55.460197] [DEBUG] [MAIN ] AFGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:55.463085] [INFO ] [MAIN ] AFGB: Generated 1794 derivative records from 2539 primary records. [2025-09-17T07:30:55.463745] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-17T07:30:55.477939] [DEBUG] [MAIN ] AFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:55.486347] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32732 primary records. [2025-09-17T07:30:55.490246] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-17T07:30:55.505705] [DEBUG] [MAIN ] AFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:55.518034] [INFO ] [MAIN ] AFGC: Generated 1794 derivative records from 2528 primary records. [2025-09-17T07:30:55.519026] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-17T07:30:55.521445] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1794 records). [2025-09-17T07:30:55.528669] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-17T07:30:55.532465] [INFO ] [MAIN ] Derivative Progress: 40/2172 symbols completed. AFGB took 1.1s. Estimated remaining: 14m 14s. Rate: 149.8 symbols/min [2025-09-17T07:30:55.535864] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:55.537525] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-09-17T07:30:55.538611] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-17T07:30:55.543164] [INFO ] [MAIN ] Derivative Progress: 41/2172 symbols completed. AFG took 1.1s. Estimated remaining: 13m 53s. Rate: 153.4 symbols/min [2025-09-17T07:30:55.540971] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1794 records). [2025-09-17T07:30:55.544061] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:55.544164] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-17T07:30:55.546619] [INFO ] [MAIN ] Derivative Progress: 42/2172 symbols completed. AFGC took 0.9s. Estimated remaining: 13m 33s. Rate: 157.1 symbols/min [2025-09-17T07:30:55.547484] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:55.550343] [DEBUG] [LOCAL ] AFGD: Loaded 1851 existing records from primary storage. [2025-09-17T07:30:55.550839] [INFO ] [MAIN ] AFGD: Loaded 1851 primary data records. [2025-09-17T07:30:55.589608] [DEBUG] [LOCAL ] AFGE: Loaded 2498 existing records from primary storage. [2025-09-17T07:30:55.630807] [INFO ] [MAIN ] AFGE: Loaded 2498 primary data records. [2025-09-17T07:30:56.206678] [DEBUG] [LOCAL ] AFL: Loaded 53150 existing records from primary storage. [2025-09-17T07:30:56.208012] [INFO ] [MAIN ] AFL: Loaded 53150 primary data records. [2025-09-17T07:30:56.529658] [DEBUG] [MAIN ] AFGD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:30:56.531001] [INFO ] [MAIN ] AFGD: Generated 1792 derivative records from 1851 primary records. [2025-09-17T07:30:56.543083] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-17T07:30:56.543334] [DEBUG] [MAIN ] AFGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:56.555035] [INFO ] [MAIN ] AFGE: Generated 1794 derivative records from 2498 primary records. [2025-09-17T07:30:56.555730] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-17T07:30:56.570134] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1792 records). [2025-09-17T07:30:56.571074] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-17T07:30:56.574298] [INFO ] [MAIN ] Derivative Progress: 43/2172 symbols completed. AFGD took 1.0s. Estimated remaining: 14m 5s. Rate: 151.2 symbols/min [2025-09-17T07:30:56.577235] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1794 records). [2025-09-17T07:30:56.577409] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-17T07:30:56.579436] [INFO ] [MAIN ] Derivative Progress: 44/2172 symbols completed. AFGE took 1.0s. Estimated remaining: 13m 46s. Rate: 154.6 symbols/min [2025-09-17T07:30:56.596343] [DEBUG] [MAIN ] AFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:56.596956] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53150 primary records. [2025-09-17T07:30:56.597032] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-17T07:30:56.612466] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-09-17T07:30:56.612540] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-17T07:30:56.616974] [INFO ] [MAIN ] Derivative Progress: 45/2172 symbols completed. AFL took 1.1s. Estimated remaining: 13m 29s. Rate: 157.8 symbols/min [2025-09-17T07:30:56.617486] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:56.617600] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:56.617658] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:56.637965] [DEBUG] [LOCAL ] AGD: Loaded 17535 existing records from primary storage. [2025-09-17T07:30:56.638151] [INFO ] [MAIN ] AGD: Loaded 17535 primary data records. [2025-09-17T07:30:56.962966] [DEBUG] [LOCAL ] AGCO: Loaded 42801 existing records from primary storage. [2025-09-17T07:30:56.963292] [INFO ] [MAIN ] AGCO: Loaded 42801 primary data records. [2025-09-17T07:30:56.999880] [DEBUG] [LOCAL ] AG: Loaded 53641 existing records from primary storage. [2025-09-17T07:30:57.024115] [INFO ] [MAIN ] AG: Loaded 53641 primary data records. [2025-09-17T07:30:57.587858] [DEBUG] [MAIN ] AGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:57.589026] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 17535 primary records. [2025-09-17T07:30:57.589397] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-17T07:30:57.608456] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-09-17T07:30:57.609437] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-17T07:30:57.611687] [INFO ] [MAIN ] Derivative Progress: 46/2172 symbols completed. AGD took 1.0s. Estimated remaining: 13m 57s. Rate: 152.4 symbols/min [2025-09-17T07:30:57.612282] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:57.625218] [DEBUG] [MAIN ] AGCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:57.626122] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42801 primary records. [2025-09-17T07:30:57.627697] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-17T07:30:57.653688] [DEBUG] [MAIN ] AG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:57.656577] [INFO ] [MAIN ] AG: Generated 1794 derivative records from 53641 primary records. [2025-09-17T07:30:57.657834] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-09-17T07:30:57.658010] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-17T07:30:57.658098] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-17T07:30:57.660821] [INFO ] [MAIN ] Derivative Progress: 47/2172 symbols completed. AGCO took 1.0s. Estimated remaining: 13m 41s. Rate: 155.3 symbols/min [2025-09-17T07:30:57.661415] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:57.677721] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-09-17T07:30:57.677955] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-17T07:30:57.680001] [INFO ] [MAIN ] Derivative Progress: 48/2172 symbols completed. AG took 1.1s. Estimated remaining: 13m 24s. Rate: 158.5 symbols/min [2025-09-17T07:30:57.680275] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:57.705298] [DEBUG] [LOCAL ] AGM: Loaded 9795 existing records from primary storage. [2025-09-17T07:30:57.705456] [INFO ] [MAIN ] AGM: Loaded 9795 primary data records. [2025-09-17T07:30:57.842917] [DEBUG] [LOCAL ] AGI: Loaded 53412 existing records from primary storage. [2025-09-17T07:30:57.843090] [INFO ] [MAIN ] AGI: Loaded 53412 primary data records. [2025-09-17T07:30:58.058860] [DEBUG] [LOCAL ] AGL: Loaded 52404 existing records from primary storage. [2025-09-17T07:30:58.196540] [INFO ] [MAIN ] AGL: Loaded 52404 primary data records. [2025-09-17T07:30:58.689215] [DEBUG] [MAIN ] AGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:58.690842] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 9795 primary records. [2025-09-17T07:30:58.691481] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-17T07:30:58.724520] [DEBUG] [MAIN ] AGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:58.724602] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-09-17T07:30:58.725604] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53412 primary records. [2025-09-17T07:30:58.725795] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-17T07:30:58.724966] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-17T07:30:58.728532] [INFO ] [MAIN ] Derivative Progress: 49/2172 symbols completed. AGM took 1.0s. Estimated remaining: 13m 53s. Rate: 153.0 symbols/min [2025-09-17T07:30:58.730040] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:58.759944] [DEBUG] [MAIN ] AGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:58.761352] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52404 primary records. [2025-09-17T07:30:58.762481] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-09-17T07:30:58.762441] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-17T07:30:58.762613] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-17T07:30:58.765470] [INFO ] [MAIN ] Derivative Progress: 50/2172 symbols completed. AGI took 1.2s. Estimated remaining: 13m 37s. Rate: 155.8 symbols/min [2025-09-17T07:30:58.765999] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:58.790481] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-09-17T07:30:58.790658] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-17T07:30:58.793221] [INFO ] [MAIN ] Derivative Progress: 51/2172 symbols completed. AGL took 1.1s. Estimated remaining: 13m 22s. Rate: 158.7 symbols/min [2025-09-17T07:30:58.793577] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:58.803621] [DEBUG] [LOCAL ] AGO: Loaded 28268 existing records from primary storage. [2025-09-17T07:30:58.803795] [INFO ] [MAIN ] AGO: Loaded 28268 primary data records. [2025-09-17T07:30:58.945283] [DEBUG] [LOCAL ] AGRO: Loaded 34178 existing records from primary storage. [2025-09-17T07:30:58.984663] [INFO ] [MAIN ] AGRO: Loaded 34178 primary data records. [2025-09-17T07:30:59.206220] [DEBUG] [LOCAL ] AGX: Loaded 33599 existing records from primary storage. [2025-09-17T07:30:59.241253] [INFO ] [MAIN ] AGX: Loaded 33599 primary data records. [2025-09-17T07:30:59.802123] [DEBUG] [MAIN ] AGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:59.803154] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 28268 primary records. [2025-09-17T07:30:59.804539] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-17T07:30:59.832296] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-09-17T07:30:59.837537] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-17T07:30:59.837451] [DEBUG] [MAIN ] AGRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:59.838270] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 34178 primary records. [2025-09-17T07:30:59.840334] [INFO ] [MAIN ] Derivative Progress: 52/2172 symbols completed. AGO took 1.1s. Estimated remaining: 13m 49s. Rate: 153.4 symbols/min [2025-09-17T07:30:59.840411] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-17T07:30:59.840696] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:59.859390] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-09-17T07:30:59.861358] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-17T07:30:59.863569] [INFO ] [MAIN ] Derivative Progress: 53/2172 symbols completed. AGRO took 1.1s. Estimated remaining: 13m 34s. Rate: 156.2 symbols/min [2025-09-17T07:30:59.876712] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:59.876949] [DEBUG] [MAIN ] AGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:30:59.877718] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33599 primary records. [2025-09-17T07:30:59.878054] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-17T07:30:59.897440] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-09-17T07:30:59.906544] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-17T07:30:59.908685] [INFO ] [MAIN ] Derivative Progress: 54/2172 symbols completed. AGX took 1.1s. Estimated remaining: 13m 20s. Rate: 158.8 symbols/min [2025-09-17T07:30:59.909082] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:30:59.926748] [DEBUG] [LOCAL ] AHH: Loaded 41687 existing records from primary storage. [2025-09-17T07:30:59.926975] [INFO ] [MAIN ] AHH: Loaded 41687 primary data records. [2025-09-17T07:30:59.950893] [DEBUG] [LOCAL ] AHT: Loaded 5923 existing records from primary storage. [2025-09-17T07:30:59.986699] [INFO ] [MAIN ] AHT: Loaded 5923 primary data records. [2025-09-17T07:31:00.270150] [DEBUG] [LOCAL ] AHR: Loaded 49406 existing records from primary storage. [2025-09-17T07:31:00.412308] [INFO ] [MAIN ] AHR: Loaded 49406 primary data records. [2025-09-17T07:31:00.892414] [DEBUG] [MAIN ] AHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:00.894188] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 41687 primary records. [2025-09-17T07:31:00.895765] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-17T07:31:00.922049] [DEBUG] [MAIN ] AHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:00.926886] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-09-17T07:31:00.926005] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 5923 primary records. [2025-09-17T07:31:00.927054] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-17T07:31:00.927510] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-17T07:31:00.929956] [INFO ] [MAIN ] Derivative Progress: 55/2172 symbols completed. AHH took 1.1s. Estimated remaining: 13m 45s. Rate: 154.0 symbols/min [2025-09-17T07:31:00.932533] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:00.960976] [DEBUG] [MAIN ] AHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:00.962394] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-09-17T07:31:00.963217] [INFO ] [MAIN ] AHR: Generated 1794 derivative records from 49406 primary records. [2025-09-17T07:31:00.963284] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-17T07:31:00.965755] [INFO ] [MAIN ] Derivative Progress: 56/2172 symbols completed. AHT took 1.1s. Estimated remaining: 13m 31s. Rate: 156.6 symbols/min [2025-09-17T07:31:00.963432] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-17T07:31:00.966901] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:00.983152] [DEBUG] [LOCAL ] AHR: Derivative data saved (1794 records). [2025-09-17T07:31:00.983334] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-17T07:31:00.985702] [INFO ] [MAIN ] Derivative Progress: 57/2172 symbols completed. AHR took 1.1s. Estimated remaining: 13m 17s. Rate: 159.2 symbols/min [2025-09-17T07:31:00.986319] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:01.024427] [DEBUG] [LOCAL ] AIN: Loaded 24660 existing records from primary storage. [2025-09-17T07:31:01.040108] [INFO ] [MAIN ] AIN: Loaded 24660 primary data records. [2025-09-17T07:31:01.053533] [DEBUG] [LOCAL ] AI: Loaded 53749 existing records from primary storage. [2025-09-17T07:31:01.089381] [INFO ] [MAIN ] AI: Loaded 53749 primary data records. [2025-09-17T07:31:01.278002] [DEBUG] [LOCAL ] AIG: Loaded 53477 existing records from primary storage. [2025-09-17T07:31:01.350022] [INFO ] [MAIN ] AIG: Loaded 53477 primary data records. [2025-09-17T07:31:02.089422] [DEBUG] [MAIN ] AIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:02.090688] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24660 primary records. [2025-09-17T07:31:02.091679] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-17T07:31:02.109705] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-09-17T07:31:02.110087] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-17T07:31:02.112206] [INFO ] [MAIN ] Derivative Progress: 58/2172 symbols completed. AIN took 1.1s. Estimated remaining: 13m 44s. Rate: 153.9 symbols/min [2025-09-17T07:31:02.125367] [DEBUG] [MAIN ] AI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:02.126154] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53749 primary records. [2025-09-17T07:31:02.126811] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-17T07:31:02.154592] [DEBUG] [MAIN ] AIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:02.156440] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53477 primary records. [2025-09-17T07:31:02.157405] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-17T07:31:02.158275] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-09-17T07:31:02.158368] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-17T07:31:02.160618] [INFO ] [MAIN ] Derivative Progress: 59/2172 symbols completed. AI took 1.2s. Estimated remaining: 13m 31s. Rate: 156.3 symbols/min [2025-09-17T07:31:02.175882] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-09-17T07:31:02.175967] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-17T07:31:02.178286] [INFO ] [MAIN ] Derivative Progress: 60/2172 symbols completed. AIG took 1.2s. Estimated remaining: 13m 18s. Rate: 158.8 symbols/min [2025-09-17T07:31:02.178730] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:02.179282] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:02.179046] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:02.193617] [DEBUG] [LOCAL ] AIO: Loaded 13435 existing records from primary storage. [2025-09-17T07:31:02.193825] [INFO ] [MAIN ] AIO: Loaded 13435 primary data records. [2025-09-17T07:31:02.352171] [DEBUG] [LOCAL ] AIR: Loaded 26867 existing records from primary storage. [2025-09-17T07:31:02.397932] [DEBUG] [LOCAL ] AIT: Loaded 28542 existing records from primary storage. [2025-09-17T07:31:02.402978] [INFO ] [MAIN ] AIR: Loaded 26867 primary data records. [2025-09-17T07:31:02.403255] [INFO ] [MAIN ] AIT: Loaded 28542 primary data records. [2025-09-17T07:31:03.162114] [DEBUG] [MAIN ] AIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:03.163572] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13435 primary records. [2025-09-17T07:31:03.163737] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-17T07:31:03.183007] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-09-17T07:31:03.183284] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-17T07:31:03.185341] [INFO ] [MAIN ] Derivative Progress: 61/2172 symbols completed. AIO took 1.0s. Estimated remaining: 13m 39s. Rate: 154.6 symbols/min [2025-09-17T07:31:03.200860] [DEBUG] [MAIN ] AIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:03.201155] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:03.202010] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 26867 primary records. [2025-09-17T07:31:03.202537] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-17T07:31:03.228327] [DEBUG] [MAIN ] AIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:03.232571] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-09-17T07:31:03.233436] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 28542 primary records. [2025-09-17T07:31:03.233668] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-17T07:31:03.236131] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-17T07:31:03.236005] [INFO ] [MAIN ] Derivative Progress: 62/2172 symbols completed. AIR took 1.1s. Estimated remaining: 13m 28s. Rate: 156.8 symbols/min [2025-09-17T07:31:03.236702] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:03.258615] [DEBUG] [LOCAL ] AIZN: Loaded 3961 existing records from primary storage. [2025-09-17T07:31:03.260197] [INFO ] [MAIN ] AIZN: Loaded 3961 primary data records. [2025-09-17T07:31:03.336012] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-09-17T07:31:03.359692] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-17T07:31:03.379095] [INFO ] [MAIN ] Derivative Progress: 63/2172 symbols completed. AIT took 1.2s. Estimated remaining: 13m 19s. Rate: 158.3 symbols/min [2025-09-17T07:31:03.415483] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:03.410162] [DEBUG] [LOCAL ] AIZ: Loaded 30481 existing records from primary storage. [2025-09-17T07:31:03.439181] [INFO ] [MAIN ] AIZ: Loaded 30481 primary data records. [2025-09-17T07:31:03.956530] [DEBUG] [LOCAL ] AJG: Loaded 47178 existing records from primary storage. [2025-09-17T07:31:03.957098] [INFO ] [MAIN ] AJG: Loaded 47178 primary data records. [2025-09-17T07:31:04.124849] [DEBUG] [MAIN ] AIZN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:04.152854] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 3961 primary records. [2025-09-17T07:31:04.271349] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-17T07:31:04.292185] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-09-17T07:31:04.292827] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-17T07:31:04.309365] [INFO ] [MAIN ] Derivative Progress: 64/2172 symbols completed. AIZN took 1.1s. Estimated remaining: 13m 37s. Rate: 154.8 symbols/min [2025-09-17T07:31:04.307237] [DEBUG] [MAIN ] AIZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:04.310230] [INFO ] [MAIN ] AKR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:04.311028] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 30481 primary records. [2025-09-17T07:31:04.311488] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-17T07:31:04.331175] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-09-17T07:31:04.331451] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-17T07:31:04.334115] [INFO ] [MAIN ] Derivative Progress: 65/2172 symbols completed. AIZ took 1.1s. Estimated remaining: 13m 25s. Rate: 157.1 symbols/min [2025-09-17T07:31:04.334915] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:04.352075] [DEBUG] [MAIN ] AJG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:04.352796] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 47178 primary records. [2025-09-17T07:31:04.352873] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-17T07:31:04.378594] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-09-17T07:31:04.378783] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-17T07:31:04.381150] [INFO ] [MAIN ] Derivative Progress: 66/2172 symbols completed. AJG took 1.0s. Estimated remaining: 13m 14s. Rate: 159.2 symbols/min [2025-09-17T07:31:04.381733] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:04.409823] [DEBUG] [LOCAL ] AKR: Loaded 45615 existing records from primary storage. [2025-09-17T07:31:04.410175] [INFO ] [MAIN ] AKR: Loaded 45615 primary data records. [2025-09-17T07:31:04.528468] [DEBUG] [LOCAL ] AL: Loaded 43858 existing records from primary storage. [2025-09-17T07:31:04.569373] [INFO ] [MAIN ] AL: Loaded 43858 primary data records. [2025-09-17T07:31:04.832159] [DEBUG] [LOCAL ] ALB: Loaded 53258 existing records from primary storage. [2025-09-17T07:31:04.859827] [INFO ] [MAIN ] ALB: Loaded 53258 primary data records. [2025-09-17T07:31:05.373839] [DEBUG] [MAIN ] AKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:05.375128] [INFO ] [MAIN ] AKR: Generated 1794 derivative records from 45615 primary records. [2025-09-17T07:31:05.375322] [DEBUG] [LOCAL ] AKR: Saving derivative data. [2025-09-17T07:31:05.394139] [DEBUG] [LOCAL ] AKR: Derivative data saved (1794 records). [2025-09-17T07:31:05.396139] [INFO ] [MAIN ] AKR: Successfully saved derivative data. [2025-09-17T07:31:05.398124] [INFO ] [MAIN ] Derivative Progress: 67/2172 symbols completed. AKR took 1.1s. Estimated remaining: 13m 33s. Rate: 155.3 symbols/min [2025-09-17T07:31:05.398549] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:05.412395] [DEBUG] [MAIN ] AL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:05.413244] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 43858 primary records. [2025-09-17T07:31:05.413495] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-17T07:31:05.441965] [DEBUG] [MAIN ] ALB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:05.444686] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53258 primary records. [2025-09-17T07:31:05.445530] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-09-17T07:31:05.445588] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-17T07:31:05.446553] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-17T07:31:05.449232] [INFO ] [MAIN ] Derivative Progress: 68/2172 symbols completed. AL took 1.1s. Estimated remaining: 13m 23s. Rate: 157.3 symbols/min [2025-09-17T07:31:05.460743] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:05.479059] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-09-17T07:31:05.479250] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-17T07:31:05.481698] [INFO ] [MAIN ] Derivative Progress: 69/2172 symbols completed. ALB took 1.1s. Estimated remaining: 13m 12s. Rate: 159.4 symbols/min [2025-09-17T07:31:05.482037] [INFO ] [MAIN ] ALEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:05.502135] [DEBUG] [LOCAL ] ALC: Loaded 50818 existing records from primary storage. [2025-09-17T07:31:05.509609] [INFO ] [MAIN ] ALC: Loaded 50818 primary data records. [2025-09-17T07:31:05.641966] [DEBUG] [LOCAL ] ALE: Loaded 29897 existing records from primary storage. [2025-09-17T07:31:05.642464] [INFO ] [MAIN ] ALE: Loaded 29897 primary data records. [2025-09-17T07:31:05.642847] [DEBUG] [LOCAL ] ALEX: Loaded 31541 existing records from primary storage. [2025-09-17T07:31:05.658483] [INFO ] [MAIN ] ALEX: Loaded 31541 primary data records. [2025-09-17T07:31:06.490577] [DEBUG] [MAIN ] ALC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:06.493262] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 50818 primary records. [2025-09-17T07:31:06.493759] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-17T07:31:06.521572] [DEBUG] [MAIN ] ALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:06.523691] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 29897 primary records. [2025-09-17T07:31:06.523926] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-17T07:31:06.524112] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-09-17T07:31:06.525304] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-17T07:31:06.527859] [INFO ] [MAIN ] Derivative Progress: 70/2172 symbols completed. ALC took 1.1s. Estimated remaining: 13m 31s. Rate: 155.4 symbols/min [2025-09-17T07:31:06.528120] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:06.558439] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-09-17T07:31:06.559171] [DEBUG] [MAIN ] ALEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:06.558869] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-17T07:31:06.559946] [INFO ] [MAIN ] ALEX: Generated 1794 derivative records from 31541 primary records. [2025-09-17T07:31:06.562291] [DEBUG] [LOCAL ] ALEX: Saving derivative data. [2025-09-17T07:31:06.562118] [INFO ] [MAIN ] Derivative Progress: 71/2172 symbols completed. ALE took 1.1s. Estimated remaining: 13m 21s. Rate: 157.5 symbols/min [2025-09-17T07:31:06.563454] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:06.585274] [DEBUG] [LOCAL ] ALG: Loaded 10846 existing records from primary storage. [2025-09-17T07:31:06.586447] [INFO ] [MAIN ] ALG: Loaded 10846 primary data records. [2025-09-17T07:31:06.608720] [DEBUG] [LOCAL ] ALEX: Derivative data saved (1794 records). [2025-09-17T07:31:06.625482] [INFO ] [MAIN ] ALEX: Successfully saved derivative data. [2025-09-17T07:31:06.628098] [INFO ] [MAIN ] Derivative Progress: 72/2172 symbols completed. ALEX took 1.1s. Estimated remaining: 13m 11s. Rate: 159.3 symbols/min [2025-09-17T07:31:06.648412] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:06.913803] [DEBUG] [LOCAL ] ALIT: Loaded 52733 existing records from primary storage. [2025-09-17T07:31:06.914939] [INFO ] [MAIN ] ALIT: Loaded 52733 primary data records. [2025-09-17T07:31:07.250682] [DEBUG] [LOCAL ] ALK: Loaded 53061 existing records from primary storage. [2025-09-17T07:31:07.251525] [INFO ] [MAIN ] ALK: Loaded 53061 primary data records. [2025-09-17T07:31:07.451333] [DEBUG] [MAIN ] ALG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:07.608294] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 10846 primary records. [2025-09-17T07:31:07.617869] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-17T07:31:07.636611] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-09-17T07:31:07.639454] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-17T07:31:07.641828] [INFO ] [MAIN ] Derivative Progress: 73/2172 symbols completed. ALG took 1.1s. Estimated remaining: 13m 29s. Rate: 155.7 symbols/min [2025-09-17T07:31:07.655875] [DEBUG] [MAIN ] ALIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:07.656570] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52733 primary records. [2025-09-17T07:31:07.656756] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-17T07:31:07.672664] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-09-17T07:31:07.672836] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-17T07:31:07.675206] [INFO ] [MAIN ] Derivative Progress: 74/2172 symbols completed. ALIT took 1.1s. Estimated remaining: 13m 19s. Rate: 157.6 symbols/min [2025-09-17T07:31:07.689897] [DEBUG] [MAIN ] ALK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:07.690501] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53061 primary records. [2025-09-17T07:31:07.690609] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-17T07:31:07.706232] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-09-17T07:31:07.706331] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-17T07:31:07.708615] [INFO ] [MAIN ] Derivative Progress: 75/2172 symbols completed. ALK took 1.1s. Estimated remaining: 13m 9s. Rate: 159.6 symbols/min [2025-09-17T07:31:07.709179] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:07.709063] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:07.709305] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:07.792014] [DEBUG] [LOCAL ] ALL: Loaded 50196 existing records from primary storage. [2025-09-17T07:31:07.807296] [INFO ] [MAIN ] ALL: Loaded 50196 primary data records. [2025-09-17T07:31:07.808092] [DEBUG] [LOCAL ] ALLE: Loaded 45257 existing records from primary storage. [2025-09-17T07:31:07.830179] [INFO ] [MAIN ] ALLE: Loaded 45257 primary data records. [2025-09-17T07:31:07.830872] [DEBUG] [LOCAL ] ALLY: Loaded 53217 existing records from primary storage. [2025-09-17T07:31:07.854959] [INFO ] [MAIN ] ALLY: Loaded 53217 primary data records. [2025-09-17T07:31:08.738369] [DEBUG] [MAIN ] ALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:08.743900] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 50196 primary records. [2025-09-17T07:31:08.744186] [DEBUG] [MAIN ] ALLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:08.744312] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-17T07:31:08.744904] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 45257 primary records. [2025-09-17T07:31:08.766738] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-17T07:31:08.769771] [DEBUG] [MAIN ] ALLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:08.771613] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53217 primary records. [2025-09-17T07:31:08.772287] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-17T07:31:08.786948] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-09-17T07:31:08.787044] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-17T07:31:08.791834] [INFO ] [MAIN ] Derivative Progress: 76/2172 symbols completed. ALL took 1.1s. Estimated remaining: 13m 28s. Rate: 155.7 symbols/min [2025-09-17T07:31:08.801124] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-09-17T07:31:08.801229] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-17T07:31:08.803159] [INFO ] [MAIN ] Derivative Progress: 77/2172 symbols completed. ALLE took 1.1s. Estimated remaining: 13m 17s. Rate: 157.7 symbols/min [2025-09-17T07:31:08.803259] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:08.807750] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:08.811742] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-09-17T07:31:08.812250] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-17T07:31:08.815007] [INFO ] [MAIN ] Derivative Progress: 78/2172 symbols completed. ALLY took 1.1s. Estimated remaining: 13m 7s. Rate: 159.7 symbols/min [2025-09-17T07:31:08.815484] [INFO ] [MAIN ] ALUR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:08.828822] [DEBUG] [LOCAL ] ALUR: Loaded 11175 existing records from primary storage. [2025-09-17T07:31:08.829138] [INFO ] [MAIN ] ALUR: Loaded 11175 primary data records. [2025-09-17T07:31:08.958603] [DEBUG] [LOCAL ] ALTG: Loaded 24291 existing records from primary storage. [2025-09-17T07:31:08.969788] [INFO ] [MAIN ] ALTG: Loaded 24291 primary data records. [2025-09-17T07:31:09.247424] [DEBUG] [LOCAL ] ALSN: Loaded 43400 existing records from primary storage. [2025-09-17T07:31:09.273178] [INFO ] [MAIN ] ALSN: Loaded 43400 primary data records. [2025-09-17T07:31:09.850735] [DEBUG] [MAIN ] ALUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:09.851444] [INFO ] [MAIN ] ALUR: Generated 1794 derivative records from 11175 primary records. [2025-09-17T07:31:09.851782] [DEBUG] [LOCAL ] ALUR: Saving derivative data. [2025-09-17T07:31:09.882940] [DEBUG] [LOCAL ] ALUR: Derivative data saved (1794 records). [2025-09-17T07:31:09.883181] [DEBUG] [MAIN ] ALTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:09.883825] [INFO ] [MAIN ] ALUR: Successfully saved derivative data. [2025-09-17T07:31:09.885926] [INFO ] [MAIN ] Derivative Progress: 79/2172 symbols completed. ALUR took 1.1s. Estimated remaining: 13m 25s. Rate: 156.0 symbols/min [2025-09-17T07:31:09.887449] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:09.886908] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 24291 primary records. [2025-09-17T07:31:09.887866] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-17T07:31:09.908325] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-09-17T07:31:09.921330] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-17T07:31:09.921920] [DEBUG] [MAIN ] ALSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:09.924032] [INFO ] [MAIN ] Derivative Progress: 80/2172 symbols completed. ALTG took 1.1s. Estimated remaining: 13m 15s. Rate: 157.8 symbols/min [2025-09-17T07:31:09.924966] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43400 primary records. [2025-09-17T07:31:09.925194] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:09.925254] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-17T07:31:09.954536] [DEBUG] [LOCAL ] ALX: Loaded 5730 existing records from primary storage. [2025-09-17T07:31:09.956106] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-09-17T07:31:09.956306] [INFO ] [MAIN ] ALX: Loaded 5730 primary data records. [2025-09-17T07:31:09.956372] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-17T07:31:09.981205] [INFO ] [MAIN ] Derivative Progress: 81/2172 symbols completed. ALSN took 1.2s. Estimated remaining: 13m 7s. Rate: 159.5 symbols/min [2025-09-17T07:31:10.025206] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:10.077769] [DEBUG] [LOCAL ] ALV: Loaded 42973 existing records from primary storage. [2025-09-17T07:31:10.099021] [INFO ] [MAIN ] ALV: Loaded 42973 primary data records. [2025-09-17T07:31:10.596249] [DEBUG] [LOCAL ] AM: Loaded 52184 existing records from primary storage. [2025-09-17T07:31:10.596840] [INFO ] [MAIN ] AM: Loaded 52184 primary data records. [2025-09-17T07:31:10.917803] [DEBUG] [MAIN ] ALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:10.919439] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 5730 primary records. [2025-09-17T07:31:10.920621] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-17T07:31:10.945527] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-09-17T07:31:10.947778] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-17T07:31:10.950247] [INFO ] [MAIN ] Derivative Progress: 82/2172 symbols completed. ALX took 1.0s. Estimated remaining: 13m 21s. Rate: 156.5 symbols/min [2025-09-17T07:31:10.950907] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:10.965459] [DEBUG] [MAIN ] ALV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:10.966422] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42973 primary records. [2025-09-17T07:31:10.967097] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-17T07:31:10.985935] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-09-17T07:31:10.987145] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-17T07:31:10.989606] [INFO ] [MAIN ] Derivative Progress: 83/2172 symbols completed. ALV took 1.1s. Estimated remaining: 13m 12s. Rate: 158.2 symbols/min [2025-09-17T07:31:10.990331] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:11.018203] [DEBUG] [MAIN ] AM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:11.019093] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 52184 primary records. [2025-09-17T07:31:11.019217] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-17T07:31:11.048763] [DEBUG] [LOCAL ] AMBC: Loaded 37826 existing records from primary storage. [2025-09-17T07:31:11.049629] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-09-17T07:31:11.049933] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-17T07:31:11.052392] [INFO ] [MAIN ] Derivative Progress: 84/2172 symbols completed. AM took 1.0s. Estimated remaining: 13m 4s. Rate: 159.8 symbols/min [2025-09-17T07:31:11.052884] [INFO ] [MAIN ] AMBC: Loaded 37826 primary data records. [2025-09-17T07:31:11.064466] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:11.205883] [DEBUG] [LOCAL ] AMBP: Loaded 45373 existing records from primary storage. [2025-09-17T07:31:11.235521] [INFO ] [MAIN ] AMBP: Loaded 45373 primary data records. [2025-09-17T07:31:11.532736] [DEBUG] [LOCAL ] AMC: Loaded 53757 existing records from primary storage. [2025-09-17T07:31:11.576694] [INFO ] [MAIN ] AMC: Loaded 53757 primary data records. [2025-09-17T07:31:12.087860] [DEBUG] [MAIN ] AMBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:12.089963] [INFO ] [MAIN ] AMBC: Generated 1794 derivative records from 37826 primary records. [2025-09-17T07:31:12.090855] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-17T07:31:12.111386] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1794 records). [2025-09-17T07:31:12.111811] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-17T07:31:12.115106] [INFO ] [MAIN ] Derivative Progress: 85/2172 symbols completed. AMBC took 1.2s. Estimated remaining: 13m 21s. Rate: 156.4 symbols/min [2025-09-17T07:31:12.128601] [DEBUG] [MAIN ] AMBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:12.128710] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:12.129940] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 45373 primary records. [2025-09-17T07:31:12.130511] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-17T07:31:12.149446] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-09-17T07:31:12.151162] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-17T07:31:12.153480] [INFO ] [MAIN ] Derivative Progress: 86/2172 symbols completed. AMBP took 1.2s. Estimated remaining: 13m 12s. Rate: 158.1 symbols/min [2025-09-17T07:31:12.153998] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:12.167129] [DEBUG] [MAIN ] AMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:12.167853] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53757 primary records. [2025-09-17T07:31:12.168039] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-17T07:31:12.189370] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-09-17T07:31:12.189539] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-17T07:31:12.192173] [INFO ] [MAIN ] Derivative Progress: 87/2172 symbols completed. AMC took 1.1s. Estimated remaining: 13m 3s. Rate: 159.7 symbols/min [2025-09-17T07:31:12.192565] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:12.246917] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-09-17T07:31:12.247542] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-09-17T07:31:12.254710] [DEBUG] [LOCAL ] AMG: Loaded 20806 existing records from primary storage. [2025-09-17T07:31:12.348002] [INFO ] [MAIN ] AMG: Loaded 20806 primary data records. [2025-09-17T07:31:12.353793] [DEBUG] [LOCAL ] AME: Loaded 48589 existing records from primary storage. [2025-09-17T07:31:12.370780] [INFO ] [MAIN ] AME: Loaded 48589 primary data records. [2025-09-17T07:31:13.202172] [DEBUG] [MAIN ] AMCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:13.204336] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-09-17T07:31:13.205035] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-17T07:31:13.227809] [DEBUG] [MAIN ] AMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:13.231208] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20806 primary records. [2025-09-17T07:31:13.231905] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-17T07:31:13.253020] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-09-17T07:31:13.254255] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-09-17T07:31:13.266567] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-17T07:31:13.269131] [INFO ] [MAIN ] Derivative Progress: 88/2172 symbols completed. AMG took 1.1s. Estimated remaining: 13m 20s. Rate: 156.4 symbols/min [2025-09-17T07:31:13.269477] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-17T07:31:13.269834] [DEBUG] [MAIN ] AME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:13.271732] [INFO ] [MAIN ] Derivative Progress: 89/2172 symbols completed. AMCR took 1.1s. Estimated remaining: 13m 10s. Rate: 158.2 symbols/min [2025-09-17T07:31:13.272513] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48589 primary records. [2025-09-17T07:31:13.272709] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-17T07:31:13.288193] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-09-17T07:31:13.288266] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-17T07:31:13.290608] [INFO ] [MAIN ] Derivative Progress: 90/2172 symbols completed. AME took 1.1s. Estimated remaining: 13m 2s. Rate: 159.8 symbols/min [2025-09-17T07:31:13.291108] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:13.291542] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:13.291735] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:13.350608] [DEBUG] [LOCAL ] AMN: Loaded 42235 existing records from primary storage. [2025-09-17T07:31:13.351857] [INFO ] [MAIN ] AMN: Loaded 42235 primary data records. [2025-09-17T07:31:13.352437] [DEBUG] [LOCAL ] AMP: Loaded 32856 existing records from primary storage. [2025-09-17T07:31:13.386589] [INFO ] [MAIN ] AMP: Loaded 32856 primary data records. [2025-09-17T07:31:13.642217] [DEBUG] [LOCAL ] AMH: Loaded 51703 existing records from primary storage. [2025-09-17T07:31:13.665180] [INFO ] [MAIN ] AMH: Loaded 51703 primary data records. [2025-09-17T07:31:14.345789] [DEBUG] [MAIN ] AMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:14.347312] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 42235 primary records. [2025-09-17T07:31:14.347661] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-17T07:31:14.366597] [DEBUG] [MAIN ] AMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:14.377372] [INFO ] [MAIN ] AMP: Generated 1794 derivative records from 32856 primary records. [2025-09-17T07:31:14.383973] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-17T07:31:14.384257] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-09-17T07:31:14.385661] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-17T07:31:14.396031] [INFO ] [MAIN ] Derivative Progress: 91/2172 symbols completed. AMN took 1.1s. Estimated remaining: 13m 18s. Rate: 156.5 symbols/min [2025-09-17T07:31:14.403265] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-09-17T07:31:14.404022] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-17T07:31:14.406549] [INFO ] [MAIN ] Derivative Progress: 92/2172 symbols completed. AMP took 1.1s. Estimated remaining: 13m 9s. Rate: 158.2 symbols/min [2025-09-17T07:31:14.403870] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:14.406963] [INFO ] [MAIN ] AMPY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:14.432196] [DEBUG] [MAIN ] AMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:14.433578] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51703 primary records. [2025-09-17T07:31:14.433706] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-17T07:31:14.458955] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-09-17T07:31:14.459237] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-17T07:31:14.461988] [INFO ] [MAIN ] Derivative Progress: 93/2172 symbols completed. AMH took 1.2s. Estimated remaining: 13m 1s. Rate: 159.6 symbols/min [2025-09-17T07:31:14.462504] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:14.501090] [DEBUG] [LOCAL ] AMPY: Loaded 37324 existing records from primary storage. [2025-09-17T07:31:14.502147] [INFO ] [MAIN ] AMPY: Loaded 37324 primary data records. [2025-09-17T07:31:14.559840] [DEBUG] [LOCAL ] AMPX: Loaded 52052 existing records from primary storage. [2025-09-17T07:31:14.605009] [INFO ] [MAIN ] AMPX: Loaded 52052 primary data records. [2025-09-17T07:31:14.685551] [DEBUG] [LOCAL ] AMR: Loaded 29397 existing records from primary storage. [2025-09-17T07:31:14.792994] [INFO ] [MAIN ] AMR: Loaded 29397 primary data records. [2025-09-17T07:31:15.512824] [DEBUG] [MAIN ] AMPY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:15.515695] [INFO ] [MAIN ] AMPY: Generated 1794 derivative records from 37324 primary records. [2025-09-17T07:31:15.518016] [DEBUG] [LOCAL ] AMPY: Saving derivative data. [2025-09-17T07:31:15.548664] [DEBUG] [LOCAL ] AMPY: Derivative data saved (1794 records). [2025-09-17T07:31:15.548974] [INFO ] [MAIN ] AMPY: Successfully saved derivative data. [2025-09-17T07:31:15.550941] [INFO ] [MAIN ] Derivative Progress: 94/2172 symbols completed. AMPY took 1.1s. Estimated remaining: 13m 17s. Rate: 156.5 symbols/min [2025-09-17T07:31:15.552120] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:15.551374] [DEBUG] [MAIN ] AMPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:15.553604] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52052 primary records. [2025-09-17T07:31:15.553971] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-17T07:31:15.584878] [DEBUG] [MAIN ] AMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:15.586697] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 29397 primary records. [2025-09-17T07:31:15.587711] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-17T07:31:15.588110] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-09-17T07:31:15.596697] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-17T07:31:15.603506] [INFO ] [MAIN ] Derivative Progress: 95/2172 symbols completed. AMPX took 1.2s. Estimated remaining: 13m 9s. Rate: 157.9 symbols/min [2025-09-17T07:31:15.616818] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-09-17T07:31:15.617205] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-17T07:31:15.616997] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:15.619835] [INFO ] [MAIN ] Derivative Progress: 96/2172 symbols completed. AMR took 1.2s. Estimated remaining: 13m 1s. Rate: 159.5 symbols/min [2025-09-17T07:31:15.620262] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:15.640749] [DEBUG] [LOCAL ] AMRC: Loaded 38785 existing records from primary storage. [2025-09-17T07:31:15.640988] [INFO ] [MAIN ] AMRC: Loaded 38785 primary data records. [2025-09-17T07:31:15.759550] [DEBUG] [LOCAL ] AMTB: Loaded 20592 existing records from primary storage. [2025-09-17T07:31:15.763615] [INFO ] [MAIN ] AMTB: Loaded 20592 primary data records. [2025-09-17T07:31:16.154992] [DEBUG] [LOCAL ] AMT: Loaded 52460 existing records from primary storage. [2025-09-17T07:31:16.195142] [INFO ] [MAIN ] AMT: Loaded 52460 primary data records. [2025-09-17T07:31:16.660298] [DEBUG] [MAIN ] AMRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:16.661506] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38785 primary records. [2025-09-17T07:31:16.661764] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-17T07:31:16.693971] [DEBUG] [MAIN ] AMTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:16.696380] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20592 primary records. [2025-09-17T07:31:16.697403] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-09-17T07:31:16.696888] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-17T07:31:16.697728] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-17T07:31:16.699984] [INFO ] [MAIN ] Derivative Progress: 97/2172 symbols completed. AMRC took 1.1s. Estimated remaining: 13m 16s. Rate: 156.5 symbols/min [2025-09-17T07:31:16.708548] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:16.721918] [DEBUG] [LOCAL ] AMTD: Loaded 3497 existing records from primary storage. [2025-09-17T07:31:16.719308] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-09-17T07:31:16.722375] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-17T07:31:16.725211] [INFO ] [MAIN ] Derivative Progress: 98/2172 symbols completed. AMTB took 1.1s. Estimated remaining: 13m 8s. Rate: 158.0 symbols/min [2025-09-17T07:31:16.722501] [INFO ] [MAIN ] AMTD: Loaded 3497 primary data records. [2025-09-17T07:31:16.731962] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:16.824817] [DEBUG] [MAIN ] AMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:16.851167] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52460 primary records. [2025-09-17T07:31:16.851623] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-17T07:31:16.948718] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-09-17T07:31:16.949089] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-17T07:31:17.079232] [INFO ] [MAIN ] Derivative Progress: 99/2172 symbols completed. AMT took 1.5s. Estimated remaining: 13m 7s. Rate: 158.1 symbols/min [2025-09-17T07:31:17.079727] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:17.101921] [DEBUG] [LOCAL ] AMTM: Loaded 50733 existing records from primary storage. [2025-09-17T07:31:17.102666] [INFO ] [MAIN ] AMTM: Loaded 50733 primary data records. [2025-09-17T07:31:17.176486] [DEBUG] [LOCAL ] AMWL: Loaded 8606 existing records from primary storage. [2025-09-17T07:31:17.207464] [INFO ] [MAIN ] AMWL: Loaded 8606 primary data records. [2025-09-17T07:31:17.611918] [DEBUG] [MAIN ] AMTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:17.768395] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3497 primary records. [2025-09-17T07:31:17.769171] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-17T07:31:17.786634] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-09-17T07:31:17.788041] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-17T07:31:17.790458] [INFO ] [MAIN ] Derivative Progress: 100/2172 symbols completed. AMTD took 1.1s. Estimated remaining: 13m 13s. Rate: 156.7 symbols/min [2025-09-17T07:31:17.790730] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:17.809683] [DEBUG] [MAIN ] AMTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:17.810504] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50733 primary records. [2025-09-17T07:31:17.811127] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-17T07:31:17.830256] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-09-17T07:31:17.830728] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-17T07:31:17.833075] [INFO ] [MAIN ] Derivative Progress: 101/2172 symbols completed. AMTM took 1.1s. Estimated remaining: 13m 6s. Rate: 158.1 symbols/min [2025-09-17T07:31:17.833396] [INFO ] [MAIN ] AN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:17.849322] [DEBUG] [MAIN ] AMWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:17.861066] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 8606 primary records. [2025-09-17T07:31:17.861176] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-17T07:31:17.876003] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-09-17T07:31:17.876975] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-17T07:31:17.879587] [INFO ] [MAIN ] Derivative Progress: 102/2172 symbols completed. AMWL took 0.8s. Estimated remaining: 12m 59s. Rate: 159.5 symbols/min [2025-09-17T07:31:17.880489] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:17.904793] [DEBUG] [LOCAL ] AMX: Loaded 49004 existing records from primary storage. [2025-09-17T07:31:17.905196] [INFO ] [MAIN ] AMX: Loaded 49004 primary data records. [2025-09-17T07:31:18.019379] [DEBUG] [LOCAL ] AN: Loaded 32970 existing records from primary storage. [2025-09-17T07:31:18.025512] [INFO ] [MAIN ] AN: Loaded 32970 primary data records. [2025-09-17T07:31:18.413528] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-17T07:31:18.529836] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-09-17T07:31:18.845606] [DEBUG] [MAIN ] AMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:18.849127] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49004 primary records. [2025-09-17T07:31:18.849850] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-17T07:31:18.863404] [DEBUG] [MAIN ] AN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:18.876433] [INFO ] [MAIN ] AN: Generated 1794 derivative records from 32970 primary records. [2025-09-17T07:31:18.879481] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-09-17T07:31:18.880079] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-17T07:31:18.880001] [DEBUG] [LOCAL ] AN: Saving derivative data. [2025-09-17T07:31:18.883838] [INFO ] [MAIN ] Derivative Progress: 103/2172 symbols completed. AMX took 1.1s. Estimated remaining: 13m 11s. Rate: 156.9 symbols/min [2025-09-17T07:31:18.900860] [DEBUG] [LOCAL ] AN: Derivative data saved (1794 records). [2025-09-17T07:31:18.901241] [INFO ] [MAIN ] AN: Successfully saved derivative data. [2025-09-17T07:31:18.903458] [INFO ] [MAIN ] Derivative Progress: 104/2172 symbols completed. AN took 1.1s. Estimated remaining: 13m 3s. Rate: 158.4 symbols/min [2025-09-17T07:31:18.919800] [DEBUG] [MAIN ] ANET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:18.920381] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-09-17T07:31:18.920456] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-17T07:31:18.935981] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-09-17T07:31:18.936064] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-17T07:31:18.939145] [INFO ] [MAIN ] Derivative Progress: 105/2172 symbols completed. ANET took 1.1s. Estimated remaining: 12m 56s. Rate: 159.8 symbols/min [2025-09-17T07:31:18.939593] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:18.939719] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:18.939971] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:18.971088] [DEBUG] [LOCAL ] ANRO: Loaded 20465 existing records from primary storage. [2025-09-17T07:31:18.971260] [INFO ] [MAIN ] ANRO: Loaded 20465 primary data records. [2025-09-17T07:31:19.079112] [DEBUG] [LOCAL ] ANVS: Loaded 23544 existing records from primary storage. [2025-09-17T07:31:19.106478] [INFO ] [MAIN ] ANVS: Loaded 23544 primary data records. [2025-09-17T07:31:19.117284] [DEBUG] [LOCAL ] ANF: Loaded 52297 existing records from primary storage. [2025-09-17T07:31:19.127828] [INFO ] [MAIN ] ANF: Loaded 52297 primary data records. [2025-09-17T07:31:19.972506] [DEBUG] [MAIN ] ANVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:19.972854] [DEBUG] [MAIN ] ANRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:19.973537] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 20465 primary records. [2025-09-17T07:31:19.974340] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-17T07:31:19.974049] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23544 primary records. [2025-09-17T07:31:19.975302] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-17T07:31:20.003818] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-09-17T07:31:20.006324] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-17T07:31:20.008216] [INFO ] [MAIN ] Derivative Progress: 106/2172 symbols completed. ANRO took 1.1s. Estimated remaining: 13m 9s. Rate: 157.0 symbols/min [2025-09-17T07:31:20.010146] [INFO ] [MAIN ] AOD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:20.010393] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-09-17T07:31:20.010613] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-17T07:31:20.025256] [INFO ] [MAIN ] Derivative Progress: 107/2172 symbols completed. ANVS took 1.1s. Estimated remaining: 13m 2s. Rate: 158.4 symbols/min [2025-09-17T07:31:20.026032] [DEBUG] [MAIN ] ANF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:20.026151] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:20.027002] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52297 primary records. [2025-09-17T07:31:20.027340] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-17T07:31:20.043674] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-09-17T07:31:20.047732] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-17T07:31:20.050364] [INFO ] [MAIN ] Derivative Progress: 108/2172 symbols completed. ANF took 1.1s. Estimated remaining: 12m 55s. Rate: 159.8 symbols/min [2025-09-17T07:31:20.050780] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:20.058682] [DEBUG] [LOCAL ] AOMR: Loaded 17073 existing records from primary storage. [2025-09-17T07:31:20.065742] [INFO ] [MAIN ] AOMR: Loaded 17073 primary data records. [2025-09-17T07:31:20.177677] [DEBUG] [LOCAL ] AOD: Loaded 30403 existing records from primary storage. [2025-09-17T07:31:20.203600] [INFO ] [MAIN ] AOD: Loaded 30403 primary data records. [2025-09-17T07:31:20.535422] [DEBUG] [LOCAL ] AON: Loaded 45693 existing records from primary storage. [2025-09-17T07:31:20.542476] [INFO ] [MAIN ] AON: Loaded 45693 primary data records. [2025-09-17T07:31:21.051543] [DEBUG] [MAIN ] AOMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:21.052281] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 17073 primary records. [2025-09-17T07:31:21.053508] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-17T07:31:21.074227] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-09-17T07:31:21.075203] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-17T07:31:21.078128] [INFO ] [MAIN ] Derivative Progress: 109/2172 symbols completed. AOMR took 1.1s. Estimated remaining: 13m 7s. Rate: 157.3 symbols/min [2025-09-17T07:31:21.078864] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:21.099056] [DEBUG] [MAIN ] AOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:21.100202] [INFO ] [MAIN ] AOD: Generated 1794 derivative records from 30403 primary records. [2025-09-17T07:31:21.100814] [DEBUG] [LOCAL ] AOD: Saving derivative data. [2025-09-17T07:31:21.118658] [DEBUG] [LOCAL ] AOD: Derivative data saved (1794 records). [2025-09-17T07:31:21.118900] [INFO ] [MAIN ] AOD: Successfully saved derivative data. [2025-09-17T07:31:21.131106] [INFO ] [MAIN ] Derivative Progress: 110/2172 symbols completed. AOD took 1.1s. Estimated remaining: 13m 0s. Rate: 158.6 symbols/min [2025-09-17T07:31:21.132272] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:21.146618] [DEBUG] [MAIN ] AON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:21.157252] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45693 primary records. [2025-09-17T07:31:21.157487] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-17T07:31:21.158437] [DEBUG] [LOCAL ] AORT: Loaded 29976 existing records from primary storage. [2025-09-17T07:31:21.159136] [INFO ] [MAIN ] AORT: Loaded 29976 primary data records. [2025-09-17T07:31:21.302392] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-09-17T07:31:21.334858] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-17T07:31:21.499951] [INFO ] [MAIN ] Derivative Progress: 111/2172 symbols completed. AON took 1.4s. Estimated remaining: 12m 60s. Rate: 158.6 symbols/min [2025-09-17T07:31:21.515716] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:21.529891] [DEBUG] [LOCAL ] AOS: Loaded 49470 existing records from primary storage. [2025-09-17T07:31:21.530437] [INFO ] [MAIN ] AOS: Loaded 49470 primary data records. [2025-09-17T07:31:21.640182] [DEBUG] [LOCAL ] AP: Loaded 6759 existing records from primary storage. [2025-09-17T07:31:21.640414] [INFO ] [MAIN ] AP: Loaded 6759 primary data records. [2025-09-17T07:31:22.183965] [DEBUG] [MAIN ] AORT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:22.186997] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 29976 primary records. [2025-09-17T07:31:22.188694] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-17T07:31:22.211764] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-09-17T07:31:22.212217] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-17T07:31:22.227388] [INFO ] [MAIN ] Derivative Progress: 112/2172 symbols completed. AORT took 1.1s. Estimated remaining: 13m 6s. Rate: 157.3 symbols/min [2025-09-17T07:31:22.228231] [DEBUG] [MAIN ] AOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:22.230118] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 49470 primary records. [2025-09-17T07:31:22.228545] [INFO ] [MAIN ] APAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:22.232418] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-17T07:31:22.253268] [DEBUG] [MAIN ] AP: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:31:22.257992] [INFO ] [MAIN ] AP: Generated 1792 derivative records from 6759 primary records. [2025-09-17T07:31:22.258355] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-17T07:31:22.276333] [DEBUG] [LOCAL ] AP: Derivative data saved (1792 records). [2025-09-17T07:31:22.277254] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-09-17T07:31:22.277326] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-17T07:31:22.277423] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-17T07:31:22.279882] [INFO ] [MAIN ] Derivative Progress: 113/2172 symbols completed. AOS took 1.1s. Estimated remaining: 12m 59s. Rate: 158.5 symbols/min [2025-09-17T07:31:22.282795] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:22.282911] [INFO ] [MAIN ] Derivative Progress: 114/2172 symbols completed. AP took 0.8s. Estimated remaining: 12m 52s. Rate: 159.9 symbols/min [2025-09-17T07:31:22.283705] [INFO ] [MAIN ] APH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:22.309560] [DEBUG] [LOCAL ] APAM: Loaded 36872 existing records from primary storage. [2025-09-17T07:31:22.309867] [INFO ] [MAIN ] APAM: Loaded 36872 primary data records. [2025-09-17T07:31:22.660125] [DEBUG] [LOCAL ] APD: Loaded 45559 existing records from primary storage. [2025-09-17T07:31:22.661904] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-09-17T07:31:22.662132] [INFO ] [MAIN ] APD: Loaded 45559 primary data records. [2025-09-17T07:31:22.662366] [INFO ] [MAIN ] APH: Loaded 53691 primary data records. [2025-09-17T07:31:23.308143] [DEBUG] [MAIN ] APAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:23.309395] [INFO ] [MAIN ] APAM: Generated 1794 derivative records from 36872 primary records. [2025-09-17T07:31:23.310083] [DEBUG] [LOCAL ] APAM: Saving derivative data. [2025-09-17T07:31:23.339337] [DEBUG] [LOCAL ] APAM: Derivative data saved (1794 records). [2025-09-17T07:31:23.340449] [INFO ] [MAIN ] APAM: Successfully saved derivative data. [2025-09-17T07:31:23.357810] [DEBUG] [MAIN ] APD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:23.357270] [INFO ] [MAIN ] Derivative Progress: 115/2172 symbols completed. APAM took 1.1s. Estimated remaining: 13m 4s. Rate: 157.4 symbols/min [2025-09-17T07:31:23.358295] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:23.358988] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45559 primary records. [2025-09-17T07:31:23.359520] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-17T07:31:23.393465] [DEBUG] [MAIN ] APH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:23.395280] [INFO ] [MAIN ] APH: Generated 1794 derivative records from 53691 primary records. [2025-09-17T07:31:23.396665] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-09-17T07:31:23.395983] [DEBUG] [LOCAL ] APH: Saving derivative data. [2025-09-17T07:31:23.396893] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-17T07:31:23.399725] [INFO ] [MAIN ] Derivative Progress: 116/2172 symbols completed. APD took 1.1s. Estimated remaining: 12m 58s. Rate: 158.6 symbols/min [2025-09-17T07:31:23.400325] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:23.417042] [DEBUG] [LOCAL ] APH: Derivative data saved (1794 records). [2025-09-17T07:31:23.417198] [INFO ] [MAIN ] APH: Successfully saved derivative data. [2025-09-17T07:31:23.420145] [INFO ] [MAIN ] Derivative Progress: 117/2172 symbols completed. APH took 1.1s. Estimated remaining: 12m 51s. Rate: 159.9 symbols/min [2025-09-17T07:31:23.420549] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:23.430352] [DEBUG] [LOCAL ] APOS: Loaded 7511 existing records from primary storage. [2025-09-17T07:31:23.447889] [INFO ] [MAIN ] APOS: Loaded 7511 primary data records. [2025-09-17T07:31:23.625308] [DEBUG] [LOCAL ] APLE: Loaded 52087 existing records from primary storage. [2025-09-17T07:31:23.646130] [INFO ] [MAIN ] APLE: Loaded 52087 primary data records. [2025-09-17T07:31:23.930243] [DEBUG] [LOCAL ] APO: Loaded 53385 existing records from primary storage. [2025-09-17T07:31:23.934390] [INFO ] [MAIN ] APO: Loaded 53385 primary data records. [2025-09-17T07:31:24.453275] [DEBUG] [MAIN ] APOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:24.454338] [INFO ] [MAIN ] APOS: Generated 1794 derivative records from 7511 primary records. [2025-09-17T07:31:24.455864] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-17T07:31:24.486713] [DEBUG] [MAIN ] APLE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:31:24.488502] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-09-17T07:31:24.489330] [INFO ] [MAIN ] APLE: Generated 1793 derivative records from 52087 primary records. [2025-09-17T07:31:24.489451] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-17T07:31:24.489492] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-17T07:31:24.492447] [INFO ] [MAIN ] Derivative Progress: 118/2172 symbols completed. APOS took 1.1s. Estimated remaining: 13m 3s. Rate: 157.4 symbols/min [2025-09-17T07:31:24.519575] [DEBUG] [MAIN ] APO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:24.520840] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53385 primary records. [2025-09-17T07:31:24.521509] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-17T07:31:24.532499] [DEBUG] [LOCAL ] APLE: Derivative data saved (1793 records). [2025-09-17T07:31:24.535535] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-17T07:31:24.538826] [INFO ] [MAIN ] Derivative Progress: 119/2172 symbols completed. APLE took 1.2s. Estimated remaining: 12m 57s. Rate: 158.6 symbols/min [2025-09-17T07:31:24.541662] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-09-17T07:31:24.541752] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-17T07:31:24.544212] [INFO ] [MAIN ] Derivative Progress: 120/2172 symbols completed. APO took 1.1s. Estimated remaining: 12m 50s. Rate: 159.9 symbols/min [2025-09-17T07:31:24.544680] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:24.544917] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:24.544949] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:24.552149] [DEBUG] [LOCAL ] AQNB: Loaded 4213 existing records from primary storage. [2025-09-17T07:31:24.552425] [INFO ] [MAIN ] AQNB: Loaded 4213 primary data records. [2025-09-17T07:31:24.916632] [DEBUG] [LOCAL ] APTV: Loaded 52269 existing records from primary storage. [2025-09-17T07:31:24.919841] [DEBUG] [LOCAL ] AQN: Loaded 51986 existing records from primary storage. [2025-09-17T07:31:24.921129] [INFO ] [MAIN ] APTV: Loaded 52269 primary data records. [2025-09-17T07:31:24.921191] [INFO ] [MAIN ] AQN: Loaded 51986 primary data records. [2025-09-17T07:31:25.581352] [DEBUG] [MAIN ] AQNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:25.583924] [INFO ] [MAIN ] AQNB: Generated 1794 derivative records from 4213 primary records. [2025-09-17T07:31:25.585752] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-17T07:31:25.602792] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1794 records). [2025-09-17T07:31:25.603456] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-17T07:31:25.606176] [INFO ] [MAIN ] Derivative Progress: 121/2172 symbols completed. AQNB took 1.1s. Estimated remaining: 13m 1s. Rate: 157.5 symbols/min [2025-09-17T07:31:25.606496] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:25.625788] [DEBUG] [MAIN ] APTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:25.626549] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 52269 primary records. [2025-09-17T07:31:25.626875] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-17T07:31:25.646029] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-09-17T07:31:25.646586] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-17T07:31:25.648674] [INFO ] [MAIN ] Derivative Progress: 122/2172 symbols completed. APTV took 1.1s. Estimated remaining: 12m 55s. Rate: 158.6 symbols/min [2025-09-17T07:31:25.656860] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:25.662324] [DEBUG] [MAIN ] AQN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:25.663232] [INFO ] [MAIN ] AQN: Generated 1794 derivative records from 51986 primary records. [2025-09-17T07:31:25.663451] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-17T07:31:25.693481] [DEBUG] [LOCAL ] AQN: Derivative data saved (1794 records). [2025-09-17T07:31:25.693563] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-17T07:31:25.699876] [INFO ] [MAIN ] Derivative Progress: 123/2172 symbols completed. AQN took 1.2s. Estimated remaining: 12m 50s. Rate: 159.8 symbols/min [2025-09-17T07:31:25.700148] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:25.728264] [DEBUG] [LOCAL ] AR: Loaded 53586 existing records from primary storage. [2025-09-17T07:31:25.728712] [INFO ] [MAIN ] AR: Loaded 53586 primary data records. [2025-09-17T07:31:25.844028] [DEBUG] [LOCAL ] ARCO: Loaded 44788 existing records from primary storage. [2025-09-17T07:31:25.854681] [INFO ] [MAIN ] ARCO: Loaded 44788 primary data records. [2025-09-17T07:31:25.855497] [DEBUG] [LOCAL ] ARDC: Loaded 14850 existing records from primary storage. [2025-09-17T07:31:25.877879] [INFO ] [MAIN ] ARDC: Loaded 14850 primary data records. [2025-09-17T07:31:26.661183] [DEBUG] [MAIN ] AR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:26.662898] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53586 primary records. [2025-09-17T07:31:26.663218] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-17T07:31:26.682996] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-09-17T07:31:26.684749] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-17T07:31:26.687094] [INFO ] [MAIN ] Derivative Progress: 124/2172 symbols completed. AR took 1.1s. Estimated remaining: 12m 59s. Rate: 157.7 symbols/min [2025-09-17T07:31:26.695293] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:26.700700] [DEBUG] [MAIN ] ARDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:26.701963] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 14850 primary records. [2025-09-17T07:31:26.709779] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-17T07:31:26.714737] [DEBUG] [MAIN ] ARCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:26.720309] [INFO ] [MAIN ] ARCO: Generated 1794 derivative records from 44788 primary records. [2025-09-17T07:31:26.720541] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-17T07:31:26.750360] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-09-17T07:31:26.750866] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-17T07:31:26.754073] [INFO ] [MAIN ] Derivative Progress: 125/2172 symbols completed. ARDC took 1.1s. Estimated remaining: 12m 54s. Rate: 158.7 symbols/min [2025-09-17T07:31:26.762484] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:26.765610] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1794 records). [2025-09-17T07:31:26.766354] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-17T07:31:26.768883] [INFO ] [MAIN ] Derivative Progress: 126/2172 symbols completed. ARCO took 1.1s. Estimated remaining: 12m 47s. Rate: 160.0 symbols/min [2025-09-17T07:31:26.769318] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:26.782083] [DEBUG] [LOCAL ] ARDT: Loaded 28796 existing records from primary storage. [2025-09-17T07:31:26.782347] [INFO ] [MAIN ] ARDT: Loaded 28796 primary data records. [2025-09-17T07:31:27.122389] [DEBUG] [LOCAL ] ARE: Loaded 50602 existing records from primary storage. [2025-09-17T07:31:27.122771] [INFO ] [MAIN ] ARE: Loaded 50602 primary data records. [2025-09-17T07:31:27.242373] [DEBUG] [LOCAL ] ARES: Loaded 49727 existing records from primary storage. [2025-09-17T07:31:27.242958] [INFO ] [MAIN ] ARES: Loaded 49727 primary data records. [2025-09-17T07:31:27.793189] [DEBUG] [MAIN ] ARDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:27.794292] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 28796 primary records. [2025-09-17T07:31:27.795175] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-17T07:31:27.818104] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-09-17T07:31:27.818373] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-17T07:31:27.820910] [INFO ] [MAIN ] Derivative Progress: 127/2172 symbols completed. ARDT took 1.1s. Estimated remaining: 12m 58s. Rate: 157.7 symbols/min [2025-09-17T07:31:27.821398] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:27.835402] [DEBUG] [MAIN ] ARE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:27.836311] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50602 primary records. [2025-09-17T07:31:27.836561] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-17T07:31:27.869050] [DEBUG] [MAIN ] ARES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:27.870857] [INFO ] [MAIN ] ARES: Generated 1794 derivative records from 49727 primary records. [2025-09-17T07:31:27.871367] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-09-17T07:31:27.871449] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-17T07:31:27.872245] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-17T07:31:27.874312] [INFO ] [MAIN ] Derivative Progress: 128/2172 symbols completed. ARE took 1.1s. Estimated remaining: 12m 52s. Rate: 158.8 symbols/min [2025-09-17T07:31:27.895179] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:27.900683] [DEBUG] [LOCAL ] ARES: Derivative data saved (1794 records). [2025-09-17T07:31:27.900949] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-17T07:31:27.903459] [INFO ] [MAIN ] Derivative Progress: 129/2172 symbols completed. ARES took 1.1s. Estimated remaining: 12m 46s. Rate: 159.9 symbols/min [2025-09-17T07:31:27.915334] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:27.917616] [DEBUG] [LOCAL ] ARI: Loaded 43268 existing records from primary storage. [2025-09-17T07:31:27.917838] [INFO ] [MAIN ] ARI: Loaded 43268 primary data records. [2025-09-17T07:31:28.251614] [DEBUG] [LOCAL ] ARIS: Loaded 42003 existing records from primary storage. [2025-09-17T07:31:28.253552] [INFO ] [MAIN ] ARIS: Loaded 42003 primary data records. [2025-09-17T07:31:28.254412] [DEBUG] [LOCAL ] ARLO: Loaded 44220 existing records from primary storage. [2025-09-17T07:31:28.276472] [INFO ] [MAIN ] ARLO: Loaded 44220 primary data records. [2025-09-17T07:31:28.887457] [DEBUG] [MAIN ] ARI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:28.888951] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43268 primary records. [2025-09-17T07:31:28.889364] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-17T07:31:28.923294] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-09-17T07:31:28.923723] [DEBUG] [MAIN ] ARIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:28.924060] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-17T07:31:28.924883] [INFO ] [MAIN ] ARIS: Generated 1794 derivative records from 42003 primary records. [2025-09-17T07:31:28.927323] [INFO ] [MAIN ] Derivative Progress: 130/2172 symbols completed. ARI took 1.1s. Estimated remaining: 12m 56s. Rate: 157.8 symbols/min [2025-09-17T07:31:28.927687] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-17T07:31:28.928682] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:28.959468] [DEBUG] [MAIN ] ARLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:28.961661] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 44220 primary records. [2025-09-17T07:31:28.962273] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1794 records). [2025-09-17T07:31:28.962333] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-17T07:31:28.962503] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-17T07:31:28.965024] [INFO ] [MAIN ] Derivative Progress: 131/2172 symbols completed. ARIS took 1.1s. Estimated remaining: 12m 51s. Rate: 158.9 symbols/min [2025-09-17T07:31:28.966381] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:28.982088] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-09-17T07:31:28.982220] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-17T07:31:28.985051] [INFO ] [MAIN ] Derivative Progress: 132/2172 symbols completed. ARLO took 1.1s. Estimated remaining: 12m 45s. Rate: 160.1 symbols/min [2025-09-17T07:31:28.985384] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:29.019779] [DEBUG] [LOCAL ] ARMK: Loaded 50341 existing records from primary storage. [2025-09-17T07:31:29.019997] [INFO ] [MAIN ] ARMK: Loaded 50341 primary data records. [2025-09-17T07:31:29.368569] [DEBUG] [LOCAL ] AROC: Loaded 49022 existing records from primary storage. [2025-09-17T07:31:29.396821] [INFO ] [MAIN ] AROC: Loaded 49022 primary data records. [2025-09-17T07:31:29.397871] [DEBUG] [LOCAL ] ARR: Loaded 52034 existing records from primary storage. [2025-09-17T07:31:29.429250] [INFO ] [MAIN ] ARR: Loaded 52034 primary data records. [2025-09-17T07:31:30.012342] [DEBUG] [MAIN ] ARMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:30.013927] [INFO ] [MAIN ] ARMK: Generated 1794 derivative records from 50341 primary records. [2025-09-17T07:31:30.015112] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-17T07:31:30.035635] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1794 records). [2025-09-17T07:31:30.049835] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-17T07:31:30.050240] [DEBUG] [MAIN ] AROC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:30.050960] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 49022 primary records. [2025-09-17T07:31:30.053184] [INFO ] [MAIN ] Derivative Progress: 133/2172 symbols completed. ARMK took 1.1s. Estimated remaining: 12m 55s. Rate: 157.9 symbols/min [2025-09-17T07:31:30.053413] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-17T07:31:30.066801] [DEBUG] [MAIN ] ARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:30.067568] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52034 primary records. [2025-09-17T07:31:30.076345] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-17T07:31:30.101049] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-09-17T07:31:30.102301] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-17T07:31:30.105278] [INFO ] [MAIN ] Derivative Progress: 134/2172 symbols completed. AROC took 1.1s. Estimated remaining: 12m 50s. Rate: 158.9 symbols/min [2025-09-17T07:31:30.105360] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-09-17T07:31:30.105631] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-17T07:31:30.108739] [INFO ] [MAIN ] Derivative Progress: 135/2172 symbols completed. ARR took 1.1s. Estimated remaining: 12m 44s. Rate: 160.1 symbols/min [2025-09-17T07:31:30.109177] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:30.109304] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:30.109377] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:30.127228] [DEBUG] [LOCAL ] ASA: Loaded 13358 existing records from primary storage. [2025-09-17T07:31:30.127547] [INFO ] [MAIN ] ASA: Loaded 13358 primary data records. [2025-09-17T07:31:30.465712] [DEBUG] [LOCAL ] AS: Loaded 53067 existing records from primary storage. [2025-09-17T07:31:30.466901] [DEBUG] [LOCAL ] ARW: Loaded 33077 existing records from primary storage. [2025-09-17T07:31:30.467245] [INFO ] [MAIN ] AS: Loaded 53067 primary data records. [2025-09-17T07:31:30.467180] [INFO ] [MAIN ] ARW: Loaded 33077 primary data records. [2025-09-17T07:31:31.097568] [DEBUG] [MAIN ] ASA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:31.099789] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 13358 primary records. [2025-09-17T07:31:31.100052] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-17T07:31:31.118709] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-09-17T07:31:31.119322] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-17T07:31:31.121571] [INFO ] [MAIN ] Derivative Progress: 136/2172 symbols completed. ASA took 1.0s. Estimated remaining: 12m 53s. Rate: 158.1 symbols/min [2025-09-17T07:31:31.122005] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:31.154585] [DEBUG] [MAIN ] ARW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:31.155094] [DEBUG] [MAIN ] AS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:31.156443] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33077 primary records. [2025-09-17T07:31:31.156359] [INFO ] [MAIN ] AS: Generated 1794 derivative records from 53067 primary records. [2025-09-17T07:31:31.156762] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-17T07:31:31.156695] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-17T07:31:31.188373] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-09-17T07:31:31.189315] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-17T07:31:31.204855] [DEBUG] [LOCAL ] AS: Derivative data saved (1794 records). [2025-09-17T07:31:31.206972] [INFO ] [MAIN ] Derivative Progress: 137/2172 symbols completed. ARW took 1.1s. Estimated remaining: 12m 48s. Rate: 159.0 symbols/min [2025-09-17T07:31:31.207522] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:31.207291] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-17T07:31:31.210439] [INFO ] [MAIN ] Derivative Progress: 138/2172 symbols completed. AS took 1.1s. Estimated remaining: 12m 42s. Rate: 160.1 symbols/min [2025-09-17T07:31:31.211076] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:31.216991] [DEBUG] [LOCAL ] ASBA: Loaded 3437 existing records from primary storage. [2025-09-17T07:31:31.217913] [INFO ] [MAIN ] ASBA: Loaded 3437 primary data records. [2025-09-17T07:31:31.319138] [DEBUG] [LOCAL ] ASAN: Loaded 52754 existing records from primary storage. [2025-09-17T07:31:31.336144] [INFO ] [MAIN ] ASAN: Loaded 52754 primary data records. [2025-09-17T07:31:31.698419] [DEBUG] [LOCAL ] ASB: Loaded 49653 existing records from primary storage. [2025-09-17T07:31:31.737789] [INFO ] [MAIN ] ASB: Loaded 49653 primary data records. [2025-09-17T07:31:32.205789] [DEBUG] [MAIN ] ASBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:32.207688] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3437 primary records. [2025-09-17T07:31:32.208251] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-17T07:31:32.227833] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-09-17T07:31:32.228894] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-17T07:31:32.238757] [INFO ] [MAIN ] Derivative Progress: 139/2172 symbols completed. ASBA took 1.0s. Estimated remaining: 12m 51s. Rate: 158.2 symbols/min [2025-09-17T07:31:32.244319] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:32.245134] [DEBUG] [MAIN ] ASAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:32.246329] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52754 primary records. [2025-09-17T07:31:32.246840] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-17T07:31:32.267586] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-09-17T07:31:32.267962] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-17T07:31:32.270430] [INFO ] [MAIN ] Derivative Progress: 140/2172 symbols completed. ASAN took 1.1s. Estimated remaining: 12m 46s. Rate: 159.2 symbols/min [2025-09-17T07:31:32.270927] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:32.285631] [DEBUG] [MAIN ] ASB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:32.286819] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49653 primary records. [2025-09-17T07:31:32.287118] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-17T07:31:32.319107] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-09-17T07:31:32.319636] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-17T07:31:32.329010] [INFO ] [MAIN ] Derivative Progress: 141/2172 symbols completed. ASB took 1.1s. Estimated remaining: 12m 41s. Rate: 160.2 symbols/min [2025-09-17T07:31:32.330562] [DEBUG] [LOCAL ] ASG: Loaded 21145 existing records from primary storage. [2025-09-17T07:31:32.329974] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:32.341324] [INFO ] [MAIN ] ASG: Loaded 21145 primary data records. [2025-09-17T07:31:32.342421] [DEBUG] [LOCAL ] ASC: Loaded 38179 existing records from primary storage. [2025-09-17T07:31:32.347747] [INFO ] [MAIN ] ASC: Loaded 38179 primary data records. [2025-09-17T07:31:32.658018] [DEBUG] [LOCAL ] ASGI: Loaded 22154 existing records from primary storage. [2025-09-17T07:31:32.785855] [INFO ] [MAIN ] ASGI: Loaded 22154 primary data records. [2025-09-17T07:31:33.341818] [DEBUG] [MAIN ] ASG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:33.342887] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 21145 primary records. [2025-09-17T07:31:33.343115] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-17T07:31:33.364454] [DEBUG] [MAIN ] ASC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:33.369163] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 38179 primary records. [2025-09-17T07:31:33.369610] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-17T07:31:33.389015] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-09-17T07:31:33.389760] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-17T07:31:33.389981] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-09-17T07:31:33.392364] [INFO ] [MAIN ] Derivative Progress: 142/2172 symbols completed. ASC took 1.1s. Estimated remaining: 12m 50s. Rate: 158.1 symbols/min [2025-09-17T07:31:33.392659] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:33.392952] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-17T07:31:33.395167] [INFO ] [MAIN ] Derivative Progress: 143/2172 symbols completed. ASG took 1.1s. Estimated remaining: 12m 45s. Rate: 159.2 symbols/min [2025-09-17T07:31:33.396097] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:33.411852] [DEBUG] [MAIN ] ASGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:33.412552] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22154 primary records. [2025-09-17T07:31:33.412678] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-17T07:31:33.429796] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-09-17T07:31:33.438341] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-17T07:31:33.440771] [INFO ] [MAIN ] Derivative Progress: 144/2172 symbols completed. ASGI took 1.1s. Estimated remaining: 12m 40s. Rate: 160.2 symbols/min [2025-09-17T07:31:33.441205] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:33.463918] [DEBUG] [LOCAL ] ASGN: Loaded 36021 existing records from primary storage. [2025-09-17T07:31:33.474613] [INFO ] [MAIN ] ASGN: Loaded 36021 primary data records. [2025-09-17T07:31:33.480546] [DEBUG] [LOCAL ] ASH: Loaded 38086 existing records from primary storage. [2025-09-17T07:31:33.518662] [INFO ] [MAIN ] ASH: Loaded 38086 primary data records. [2025-09-17T07:31:33.645318] [DEBUG] [LOCAL ] ASIX: Loaded 22344 existing records from primary storage. [2025-09-17T07:31:33.672225] [INFO ] [MAIN ] ASIX: Loaded 22344 primary data records. [2025-09-17T07:31:34.472187] [DEBUG] [MAIN ] ASGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:34.473173] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 36021 primary records. [2025-09-17T07:31:34.473626] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-17T07:31:34.495627] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-09-17T07:31:34.496085] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-17T07:31:34.522678] [INFO ] [MAIN ] Derivative Progress: 145/2172 symbols completed. ASGN took 1.1s. Estimated remaining: 12m 49s. Rate: 158.1 symbols/min [2025-09-17T07:31:34.523409] [DEBUG] [MAIN ] ASIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:34.524425] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 22344 primary records. [2025-09-17T07:31:34.523740] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:34.523009] [DEBUG] [MAIN ] ASH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:34.524528] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-17T07:31:34.525193] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 38086 primary records. [2025-09-17T07:31:34.526255] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-17T07:31:34.557816] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-09-17T07:31:34.558776] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-17T07:31:34.559060] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-09-17T07:31:34.559193] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-17T07:31:34.561454] [INFO ] [MAIN ] Derivative Progress: 146/2172 symbols completed. ASIX took 1.1s. Estimated remaining: 12m 44s. Rate: 159.1 symbols/min [2025-09-17T07:31:34.565496] [INFO ] [MAIN ] ASR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:34.565549] [INFO ] [MAIN ] Derivative Progress: 147/2172 symbols completed. ASH took 1.2s. Estimated remaining: 12m 38s. Rate: 160.2 symbols/min [2025-09-17T07:31:34.566362] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:34.577330] [DEBUG] [LOCAL ] ASR: Loaded 9147 existing records from primary storage. [2025-09-17T07:31:34.577515] [INFO ] [MAIN ] ASR: Loaded 9147 primary data records. [2025-09-17T07:31:34.807301] [DEBUG] [LOCAL ] ASPN: Loaded 49681 existing records from primary storage. [2025-09-17T07:31:34.920727] [INFO ] [MAIN ] ASPN: Loaded 49681 primary data records. [2025-09-17T07:31:35.051161] [DEBUG] [LOCAL ] ASX: Loaded 52931 existing records from primary storage. [2025-09-17T07:31:35.095268] [INFO ] [MAIN ] ASX: Loaded 52931 primary data records. [2025-09-17T07:31:35.598826] [DEBUG] [MAIN ] ASR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:35.600303] [INFO ] [MAIN ] ASR: Generated 1794 derivative records from 9147 primary records. [2025-09-17T07:31:35.601461] [DEBUG] [LOCAL ] ASR: Saving derivative data. [2025-09-17T07:31:35.626375] [DEBUG] [LOCAL ] ASR: Derivative data saved (1794 records). [2025-09-17T07:31:35.628223] [INFO ] [MAIN ] ASR: Successfully saved derivative data. [2025-09-17T07:31:35.639158] [INFO ] [MAIN ] Derivative Progress: 148/2172 symbols completed. ASR took 1.1s. Estimated remaining: 12m 48s. Rate: 158.2 symbols/min [2025-09-17T07:31:35.645357] [DEBUG] [MAIN ] ASPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:35.646696] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49681 primary records. [2025-09-17T07:31:35.646826] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-17T07:31:35.665930] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-09-17T07:31:35.666105] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-17T07:31:35.668300] [INFO ] [MAIN ] Derivative Progress: 149/2172 symbols completed. ASPN took 1.1s. Estimated remaining: 12m 43s. Rate: 159.2 symbols/min [2025-09-17T07:31:35.681408] [DEBUG] [MAIN ] ASX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:35.682201] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52931 primary records. [2025-09-17T07:31:35.682306] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-17T07:31:35.698078] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-09-17T07:31:35.698171] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-17T07:31:35.700835] [INFO ] [MAIN ] Derivative Progress: 150/2172 symbols completed. ASX took 1.1s. Estimated remaining: 12m 37s. Rate: 160.2 symbols/min [2025-09-17T07:31:35.701380] [INFO ] [MAIN ] ATEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:35.701532] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:35.701775] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:35.752430] [DEBUG] [LOCAL ] ATGE: Loaded 32297 existing records from primary storage. [2025-09-17T07:31:35.761784] [INFO ] [MAIN ] ATGE: Loaded 32297 primary data records. [2025-09-17T07:31:35.762296] [DEBUG] [LOCAL ] ATHM: Loaded 33265 existing records from primary storage. [2025-09-17T07:31:35.773475] [INFO ] [MAIN ] ATHM: Loaded 33265 primary data records. [2025-09-17T07:31:35.938662] [DEBUG] [LOCAL ] ATEN: Loaded 40190 existing records from primary storage. [2025-09-17T07:31:35.960176] [INFO ] [MAIN ] ATEN: Loaded 40190 primary data records. [2025-09-17T07:31:36.731574] [DEBUG] [MAIN ] ATHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:36.732715] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 33265 primary records. [2025-09-17T07:31:36.732903] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-17T07:31:36.755661] [DEBUG] [MAIN ] ATGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:36.761883] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 32297 primary records. [2025-09-17T07:31:36.764013] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-17T07:31:36.774749] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-09-17T07:31:36.782749] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-09-17T07:31:36.783069] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-17T07:31:36.782994] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-17T07:31:36.785374] [INFO ] [MAIN ] Derivative Progress: 151/2172 symbols completed. ATGE took 1.1s. Estimated remaining: 12m 47s. Rate: 158.2 symbols/min [2025-09-17T07:31:36.788886] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:36.789008] [INFO ] [MAIN ] Derivative Progress: 152/2172 symbols completed. ATHM took 1.1s. Estimated remaining: 12m 41s. Rate: 159.2 symbols/min [2025-09-17T07:31:36.791225] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:36.805565] [DEBUG] [MAIN ] ATEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:36.808415] [INFO ] [MAIN ] ATEN: Generated 1794 derivative records from 40190 primary records. [2025-09-17T07:31:36.808841] [DEBUG] [LOCAL ] ATEN: Saving derivative data. [2025-09-17T07:31:36.813018] [DEBUG] [LOCAL ] ATHS: Loaded 7197 existing records from primary storage. [2025-09-17T07:31:36.813468] [INFO ] [MAIN ] ATHS: Loaded 7197 primary data records. [2025-09-17T07:31:36.968780] [DEBUG] [LOCAL ] ATEN: Derivative data saved (1794 records). [2025-09-17T07:31:36.991611] [INFO ] [MAIN ] ATEN: Successfully saved derivative data. [2025-09-17T07:31:37.022494] [INFO ] [MAIN ] Derivative Progress: 153/2172 symbols completed. ATEN took 1.3s. Estimated remaining: 12m 39s. Rate: 159.6 symbols/min [2025-09-17T07:31:37.149324] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:37.151056] [DEBUG] [LOCAL ] ATI: Loaded 51702 existing records from primary storage. [2025-09-17T07:31:37.151355] [INFO ] [MAIN ] ATI: Loaded 51702 primary data records. [2025-09-17T07:31:37.506030] [DEBUG] [LOCAL ] ATKR: Loaded 35889 existing records from primary storage. [2025-09-17T07:31:37.506942] [INFO ] [MAIN ] ATKR: Loaded 35889 primary data records. [2025-09-17T07:31:37.711933] [DEBUG] [MAIN ] ATHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:37.815972] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 7197 primary records. [2025-09-17T07:31:37.825823] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-17T07:31:37.850011] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-09-17T07:31:37.862912] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-17T07:31:37.865529] [INFO ] [MAIN ] Derivative Progress: 154/2172 symbols completed. ATHS took 1.1s. Estimated remaining: 12m 45s. Rate: 158.3 symbols/min [2025-09-17T07:31:37.862847] [DEBUG] [MAIN ] ATI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:37.866530] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51702 primary records. [2025-09-17T07:31:37.866876] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:37.867044] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-17T07:31:37.887431] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-09-17T07:31:37.899863] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-17T07:31:37.902945] [INFO ] [MAIN ] Derivative Progress: 155/2172 symbols completed. ATI took 1.1s. Estimated remaining: 12m 40s. Rate: 159.3 symbols/min [2025-09-17T07:31:37.900370] [DEBUG] [MAIN ] ATKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:37.903268] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:37.904535] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35889 primary records. [2025-09-17T07:31:37.904802] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-17T07:31:37.930201] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-09-17T07:31:37.930417] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-17T07:31:37.932663] [INFO ] [MAIN ] Derivative Progress: 156/2172 symbols completed. ATKR took 0.8s. Estimated remaining: 12m 35s. Rate: 160.2 symbols/min [2025-09-17T07:31:37.933120] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:37.947339] [DEBUG] [LOCAL ] ATMU: Loaded 39756 existing records from primary storage. [2025-09-17T07:31:37.947832] [INFO ] [MAIN ] ATMU: Loaded 39756 primary data records. [2025-09-17T07:31:38.273388] [DEBUG] [LOCAL ] ATR: Loaded 30540 existing records from primary storage. [2025-09-17T07:31:38.273469] [DEBUG] [LOCAL ] ATO: Loaded 42075 existing records from primary storage. [2025-09-17T07:31:38.287824] [INFO ] [MAIN ] ATR: Loaded 30540 primary data records. [2025-09-17T07:31:38.287931] [INFO ] [MAIN ] ATO: Loaded 42075 primary data records. [2025-09-17T07:31:38.899229] [DEBUG] [MAIN ] ATMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:38.900367] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 39756 primary records. [2025-09-17T07:31:38.901541] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-17T07:31:38.919015] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-09-17T07:31:38.919210] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-17T07:31:38.921486] [INFO ] [MAIN ] Derivative Progress: 157/2172 symbols completed. ATMU took 1.1s. Estimated remaining: 12m 43s. Rate: 158.5 symbols/min [2025-09-17T07:31:38.922327] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:38.941589] [DEBUG] [MAIN ] ATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:38.958498] [DEBUG] [MAIN ] ATR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:38.959189] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 42075 primary records. [2025-09-17T07:31:38.959931] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-17T07:31:38.959831] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30540 primary records. [2025-09-17T07:31:38.960025] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-17T07:31:38.989525] [DEBUG] [LOCAL ] ATS: Loaded 18304 existing records from primary storage. [2025-09-17T07:31:38.993264] [INFO ] [MAIN ] ATS: Loaded 18304 primary data records. [2025-09-17T07:31:39.026355] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-09-17T07:31:39.039492] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-17T07:31:39.042623] [INFO ] [MAIN ] Derivative Progress: 158/2172 symbols completed. ATR took 1.1s. Estimated remaining: 12m 39s. Rate: 159.2 symbols/min [2025-09-17T07:31:39.063794] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:39.082169] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-09-17T07:31:39.104587] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-17T07:31:39.111963] [INFO ] [MAIN ] Derivative Progress: 159/2172 symbols completed. ATO took 1.2s. Estimated remaining: 12m 35s. Rate: 160.1 symbols/min [2025-09-17T07:31:39.113021] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:39.367095] [DEBUG] [LOCAL ] ATUS: Loaded 49193 existing records from primary storage. [2025-09-17T07:31:39.368319] [INFO ] [MAIN ] ATUS: Loaded 49193 primary data records. [2025-09-17T07:31:39.580074] [DEBUG] [LOCAL ] AU: Loaded 52895 existing records from primary storage. [2025-09-17T07:31:39.580966] [INFO ] [MAIN ] AU: Loaded 52895 primary data records. [2025-09-17T07:31:39.789804] [DEBUG] [MAIN ] ATS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:31:39.820246] [INFO ] [MAIN ] ATS: Generated 1793 derivative records from 18304 primary records. [2025-09-17T07:31:39.826145] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-17T07:31:40.040603] [DEBUG] [LOCAL ] ATS: Derivative data saved (1793 records). [2025-09-17T07:31:40.041850] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-17T07:31:40.045287] [INFO ] [MAIN ] Derivative Progress: 160/2172 symbols completed. ATS took 1.1s. Estimated remaining: 12m 41s. Rate: 158.6 symbols/min [2025-09-17T07:31:40.045803] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:40.066628] [DEBUG] [MAIN ] ATUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:40.067484] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49193 primary records. [2025-09-17T07:31:40.067745] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-17T07:31:40.085277] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-09-17T07:31:40.086993] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-17T07:31:40.089341] [INFO ] [MAIN ] Derivative Progress: 161/2172 symbols completed. ATUS took 1.0s. Estimated remaining: 12m 37s. Rate: 159.5 symbols/min [2025-09-17T07:31:40.089718] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:40.103335] [DEBUG] [MAIN ] AU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:40.105362] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 52895 primary records. [2025-09-17T07:31:40.105472] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-17T07:31:40.109069] [DEBUG] [LOCAL ] AUNA: Loaded 4611 existing records from primary storage. [2025-09-17T07:31:40.130077] [INFO ] [MAIN ] AUNA: Loaded 4611 primary data records. [2025-09-17T07:31:40.256860] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-09-17T07:31:40.252785] [DEBUG] [LOCAL ] AUB: Loaded 46562 existing records from primary storage. [2025-09-17T07:31:40.257097] [INFO ] [MAIN ] AUB: Loaded 46562 primary data records. [2025-09-17T07:31:40.257161] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-17T07:31:40.259887] [INFO ] [MAIN ] Derivative Progress: 162/2172 symbols completed. AU took 1.1s. Estimated remaining: 12m 34s. Rate: 160.0 symbols/min [2025-09-17T07:31:40.265568] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:40.795397] [DEBUG] [LOCAL ] AVA: Loaded 39688 existing records from primary storage. [2025-09-17T07:31:40.796240] [INFO ] [MAIN ] AVA: Loaded 39688 primary data records. [2025-09-17T07:31:40.997385] [DEBUG] [MAIN ] AUNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:41.004062] [INFO ] [MAIN ] AUNA: Generated 1794 derivative records from 4611 primary records. [2025-09-17T07:31:41.165294] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-17T07:31:41.192841] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-09-17T07:31:41.205751] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-17T07:31:41.206328] [DEBUG] [MAIN ] AUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:41.207038] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46562 primary records. [2025-09-17T07:31:41.209070] [INFO ] [MAIN ] Derivative Progress: 163/2172 symbols completed. AUNA took 1.1s. Estimated remaining: 12m 40s. Rate: 158.5 symbols/min [2025-09-17T07:31:41.209302] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-17T07:31:41.227250] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-09-17T07:31:41.227378] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-17T07:31:41.229682] [INFO ] [MAIN ] Derivative Progress: 164/2172 symbols completed. AUB took 1.2s. Estimated remaining: 12m 36s. Rate: 159.4 symbols/min [2025-09-17T07:31:41.246149] [DEBUG] [MAIN ] AVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:41.246807] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 39688 primary records. [2025-09-17T07:31:41.246884] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-17T07:31:41.262422] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-09-17T07:31:41.262503] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-17T07:31:41.264895] [INFO ] [MAIN ] Derivative Progress: 165/2172 symbols completed. AVA took 1.0s. Estimated remaining: 12m 31s. Rate: 160.3 symbols/min [2025-09-17T07:31:41.265345] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:41.265497] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:41.265572] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:41.278228] [DEBUG] [LOCAL ] AVAL: Loaded 9704 existing records from primary storage. [2025-09-17T07:31:41.278681] [INFO ] [MAIN ] AVAL: Loaded 9704 primary data records. [2025-09-17T07:31:41.461219] [DEBUG] [LOCAL ] AVD: Loaded 23298 existing records from primary storage. [2025-09-17T07:31:41.589938] [INFO ] [MAIN ] AVD: Loaded 23298 primary data records. [2025-09-17T07:31:41.617506] [DEBUG] [LOCAL ] AVB: Loaded 41477 existing records from primary storage. [2025-09-17T07:31:41.656467] [INFO ] [MAIN ] AVB: Loaded 41477 primary data records. [2025-09-17T07:31:42.237047] [DEBUG] [MAIN ] AVAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:42.238741] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 9704 primary records. [2025-09-17T07:31:42.239089] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-17T07:31:42.256975] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-09-17T07:31:42.258772] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-17T07:31:42.261176] [INFO ] [MAIN ] Derivative Progress: 166/2172 symbols completed. AVAL took 1.0s. Estimated remaining: 12m 38s. Rate: 158.7 symbols/min [2025-09-17T07:31:42.261578] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:42.277038] [DEBUG] [MAIN ] AVD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:42.278739] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 23298 primary records. [2025-09-17T07:31:42.280145] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-17T07:31:42.308505] [DEBUG] [MAIN ] AVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:42.311407] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 41477 primary records. [2025-09-17T07:31:42.311938] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-17T07:31:42.313395] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-09-17T07:31:42.319941] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-17T07:31:42.330167] [INFO ] [MAIN ] Derivative Progress: 167/2172 symbols completed. AVD took 1.1s. Estimated remaining: 12m 34s. Rate: 159.5 symbols/min [2025-09-17T07:31:42.334716] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:42.335413] [DEBUG] [LOCAL ] AVK: Loaded 18256 existing records from primary storage. [2025-09-17T07:31:42.336327] [INFO ] [MAIN ] AVK: Loaded 18256 primary data records. [2025-09-17T07:31:42.435551] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-09-17T07:31:42.448302] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-17T07:31:42.480783] [INFO ] [MAIN ] Derivative Progress: 168/2172 symbols completed. AVB took 1.2s. Estimated remaining: 12m 31s. Rate: 160.1 symbols/min [2025-09-17T07:31:42.541296] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:42.668260] [DEBUG] [LOCAL ] AVNS: Loaded 33740 existing records from primary storage. [2025-09-17T07:31:42.669314] [INFO ] [MAIN ] AVNS: Loaded 33740 primary data records. [2025-09-17T07:31:43.014273] [DEBUG] [LOCAL ] AVNT: Loaded 39625 existing records from primary storage. [2025-09-17T07:31:43.016070] [INFO ] [MAIN ] AVNT: Loaded 39625 primary data records. [2025-09-17T07:31:43.137695] [DEBUG] [MAIN ] AVK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:43.150391] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 18256 primary records. [2025-09-17T07:31:43.202996] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-17T07:31:43.432085] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-09-17T07:31:43.432892] [DEBUG] [MAIN ] AVNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:43.433882] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33740 primary records. [2025-09-17T07:31:43.433086] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-17T07:31:43.436997] [INFO ] [MAIN ] Derivative Progress: 169/2172 symbols completed. AVK took 1.2s. Estimated remaining: 12m 38s. Rate: 158.6 symbols/min [2025-09-17T07:31:43.437297] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-17T07:31:43.437672] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:43.457938] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-09-17T07:31:43.458314] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-17T07:31:43.460858] [INFO ] [MAIN ] Derivative Progress: 170/2172 symbols completed. AVNS took 1.1s. Estimated remaining: 12m 33s. Rate: 159.5 symbols/min [2025-09-17T07:31:43.461576] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:43.478053] [DEBUG] [MAIN ] AVNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:43.479313] [INFO ] [MAIN ] AVNT: Generated 1794 derivative records from 39625 primary records. [2025-09-17T07:31:43.479421] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-17T07:31:43.510626] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-09-17T07:31:43.510894] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-17T07:31:43.513410] [INFO ] [MAIN ] Derivative Progress: 171/2172 symbols completed. AVNT took 1.0s. Estimated remaining: 12m 29s. Rate: 160.3 symbols/min [2025-09-17T07:31:43.513890] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:43.558502] [DEBUG] [LOCAL ] AVTR: Loaded 53571 existing records from primary storage. [2025-09-17T07:31:43.558713] [INFO ] [MAIN ] AVTR: Loaded 53571 primary data records. [2025-09-17T07:31:43.559379] [DEBUG] [LOCAL ] AVY: Loaded 37751 existing records from primary storage. [2025-09-17T07:31:43.559518] [INFO ] [MAIN ] AVY: Loaded 37751 primary data records. [2025-09-17T07:31:43.771172] [DEBUG] [LOCAL ] AWF: Loaded 24095 existing records from primary storage. [2025-09-17T07:31:43.771385] [INFO ] [MAIN ] AWF: Loaded 24095 primary data records. [2025-09-17T07:31:44.488177] [DEBUG] [MAIN ] AVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:44.502278] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53571 primary records. [2025-09-17T07:31:44.502518] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-17T07:31:44.502947] [DEBUG] [MAIN ] AVY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:44.506107] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 37751 primary records. [2025-09-17T07:31:44.514269] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-17T07:31:44.546903] [DEBUG] [MAIN ] AWF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:44.549190] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24095 primary records. [2025-09-17T07:31:44.552878] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-17T07:31:44.552813] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-09-17T07:31:44.554288] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-09-17T07:31:44.554444] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-17T07:31:44.554997] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-17T07:31:44.557203] [INFO ] [MAIN ] Derivative Progress: 172/2172 symbols completed. AVY took 1.1s. Estimated remaining: 12m 36s. Rate: 158.6 symbols/min [2025-09-17T07:31:44.567295] [INFO ] [MAIN ] Derivative Progress: 173/2172 symbols completed. AVTR took 1.1s. Estimated remaining: 12m 32s. Rate: 159.5 symbols/min [2025-09-17T07:31:44.564732] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:44.571710] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:44.577413] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-09-17T07:31:44.577559] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-17T07:31:44.580219] [INFO ] [MAIN ] Derivative Progress: 174/2172 symbols completed. AWF took 1.1s. Estimated remaining: 12m 27s. Rate: 160.4 symbols/min [2025-09-17T07:31:44.580686] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:44.615012] [DEBUG] [LOCAL ] AWI: Loaded 26291 existing records from primary storage. [2025-09-17T07:31:44.616501] [DEBUG] [LOCAL ] AWP: Loaded 22238 existing records from primary storage. [2025-09-17T07:31:44.616600] [INFO ] [MAIN ] AWI: Loaded 26291 primary data records. [2025-09-17T07:31:44.616770] [INFO ] [MAIN ] AWP: Loaded 22238 primary data records. [2025-09-17T07:31:45.004400] [DEBUG] [LOCAL ] AWK: Loaded 48881 existing records from primary storage. [2025-09-17T07:31:45.272630] [INFO ] [MAIN ] AWK: Loaded 48881 primary data records. [2025-09-17T07:31:45.619952] [DEBUG] [MAIN ] AWP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:45.625550] [DEBUG] [MAIN ] AWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:45.626362] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 22238 primary records. [2025-09-17T07:31:45.627435] [INFO ] [MAIN ] AWI: Generated 1794 derivative records from 26291 primary records. [2025-09-17T07:31:45.627991] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-17T07:31:45.628522] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-17T07:31:45.665197] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-09-17T07:31:45.665435] [DEBUG] [LOCAL ] AWI: Derivative data saved (1794 records). [2025-09-17T07:31:45.665723] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-17T07:31:45.680911] [INFO ] [MAIN ] Derivative Progress: 175/2172 symbols completed. AWP took 1.1s. Estimated remaining: 12m 35s. Rate: 158.7 symbols/min [2025-09-17T07:31:45.681787] [DEBUG] [MAIN ] AWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:45.678170] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-17T07:31:45.682630] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48881 primary records. [2025-09-17T07:31:45.683070] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-17T07:31:45.682989] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:45.685098] [INFO ] [MAIN ] Derivative Progress: 176/2172 symbols completed. AWI took 1.1s. Estimated remaining: 12m 31s. Rate: 159.6 symbols/min [2025-09-17T07:31:45.694054] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:45.703338] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-09-17T07:31:45.703506] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-17T07:31:45.705954] [INFO ] [MAIN ] Derivative Progress: 177/2172 symbols completed. AWK took 1.1s. Estimated remaining: 12m 26s. Rate: 160.4 symbols/min [2025-09-17T07:31:45.706470] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:45.732310] [DEBUG] [LOCAL ] AWR: Loaded 22408 existing records from primary storage. [2025-09-17T07:31:45.732655] [INFO ] [MAIN ] AWR: Loaded 22408 primary data records. [2025-09-17T07:31:45.870703] [DEBUG] [LOCAL ] AX: Loaded 28693 existing records from primary storage. [2025-09-17T07:31:45.905974] [INFO ] [MAIN ] AX: Loaded 28693 primary data records. [2025-09-17T07:31:46.138831] [DEBUG] [LOCAL ] AXL: Loaded 50534 existing records from primary storage. [2025-09-17T07:31:46.157350] [INFO ] [MAIN ] AXL: Loaded 50534 primary data records. [2025-09-17T07:31:46.713811] [DEBUG] [MAIN ] AWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:46.715591] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22408 primary records. [2025-09-17T07:31:46.716148] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-17T07:31:46.736873] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-09-17T07:31:46.739693] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-17T07:31:46.754912] [INFO ] [MAIN ] Derivative Progress: 178/2172 symbols completed. AWR took 1.1s. Estimated remaining: 12m 33s. Rate: 158.8 symbols/min [2025-09-17T07:31:46.763073] [DEBUG] [MAIN ] AX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:46.768822] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28693 primary records. [2025-09-17T07:31:46.769185] [DEBUG] [MAIN ] AXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:46.769222] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-17T07:31:46.769801] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50534 primary records. [2025-09-17T07:31:46.770459] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-17T07:31:46.799061] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-09-17T07:31:46.799599] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-17T07:31:46.802457] [INFO ] [MAIN ] Derivative Progress: 179/2172 symbols completed. AX took 1.1s. Estimated remaining: 12m 29s. Rate: 159.6 symbols/min [2025-09-17T07:31:46.803980] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-09-17T07:31:46.804059] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-17T07:31:46.806677] [INFO ] [MAIN ] Derivative Progress: 180/2172 symbols completed. AXL took 1.1s. Estimated remaining: 12m 25s. Rate: 160.5 symbols/min [2025-09-17T07:31:46.807215] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:46.807419] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:46.807556] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:46.814120] [DEBUG] [LOCAL ] AXR: Loaded 3125 existing records from primary storage. [2025-09-17T07:31:46.814278] [INFO ] [MAIN ] AXR: Loaded 3125 primary data records. [2025-09-17T07:31:47.218557] [DEBUG] [LOCAL ] AXS: Loaded 38288 existing records from primary storage. [2025-09-17T07:31:47.219158] [INFO ] [MAIN ] AXS: Loaded 38288 primary data records. [2025-09-17T07:31:47.355124] [DEBUG] [LOCAL ] AXP: Loaded 53258 existing records from primary storage. [2025-09-17T07:31:47.420299] [INFO ] [MAIN ] AXP: Loaded 53258 primary data records. [2025-09-17T07:31:47.883398] [DEBUG] [MAIN ] AXR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:31:47.885966] [INFO ] [MAIN ] AXR: Generated 1793 derivative records from 3125 primary records. [2025-09-17T07:31:47.886355] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-17T07:31:47.915703] [DEBUG] [LOCAL ] AXR: Derivative data saved (1793 records). [2025-09-17T07:31:47.921898] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-17T07:31:47.921814] [DEBUG] [MAIN ] AXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:47.924159] [INFO ] [MAIN ] Derivative Progress: 181/2172 symbols completed. AXR took 1.1s. Estimated remaining: 12m 33s. Rate: 158.7 symbols/min [2025-09-17T07:31:47.925742] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38288 primary records. [2025-09-17T07:31:47.924737] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:47.925938] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-17T07:31:47.944796] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-09-17T07:31:47.946517] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-17T07:31:47.948933] [INFO ] [MAIN ] Derivative Progress: 182/2172 symbols completed. AXS took 1.1s. Estimated remaining: 12m 28s. Rate: 159.6 symbols/min [2025-09-17T07:31:47.949370] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:47.963005] [DEBUG] [MAIN ] AXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:47.963855] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53258 primary records. [2025-09-17T07:31:47.964085] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-17T07:31:47.984132] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-09-17T07:31:47.984357] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-17T07:31:47.987517] [INFO ] [MAIN ] Derivative Progress: 183/2172 symbols completed. AXP took 1.2s. Estimated remaining: 12m 24s. Rate: 160.3 symbols/min [2025-09-17T07:31:47.988080] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:48.024808] [DEBUG] [LOCAL ] AYI: Loaded 25758 existing records from primary storage. [2025-09-17T07:31:48.030984] [DEBUG] [LOCAL ] AZO: Loaded 11621 existing records from primary storage. [2025-09-17T07:31:48.044905] [INFO ] [MAIN ] AYI: Loaded 25758 primary data records. [2025-09-17T07:31:48.046070] [INFO ] [MAIN ] AZO: Loaded 11621 primary data records. [2025-09-17T07:31:48.097198] [DEBUG] [LOCAL ] AXTA: Loaded 52032 existing records from primary storage. [2025-09-17T07:31:48.152076] [INFO ] [MAIN ] AXTA: Loaded 52032 primary data records. [2025-09-17T07:31:49.089622] [DEBUG] [MAIN ] AZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:49.095473] [DEBUG] [MAIN ] AYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:49.096313] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11621 primary records. [2025-09-17T07:31:49.097016] [INFO ] [MAIN ] AYI: Generated 1794 derivative records from 25758 primary records. [2025-09-17T07:31:49.097728] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-17T07:31:49.097842] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-17T07:31:49.123414] [DEBUG] [LOCAL ] AYI: Derivative data saved (1794 records). [2025-09-17T07:31:49.125471] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-17T07:31:49.131397] [INFO ] [MAIN ] Derivative Progress: 184/2172 symbols completed. AYI took 1.2s. Estimated remaining: 12m 32s. Rate: 158.6 symbols/min [2025-09-17T07:31:49.131970] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:49.150910] [DEBUG] [MAIN ] AXTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:49.153320] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52032 primary records. [2025-09-17T07:31:49.153931] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-09-17T07:31:49.154014] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-17T07:31:49.154908] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-17T07:31:49.157312] [INFO ] [MAIN ] Derivative Progress: 185/2172 symbols completed. AZO took 1.2s. Estimated remaining: 12m 28s. Rate: 159.4 symbols/min [2025-09-17T07:31:49.165479] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:49.188323] [DEBUG] [LOCAL ] AZZ: Loaded 22142 existing records from primary storage. [2025-09-17T07:31:49.188965] [INFO ] [MAIN ] AZZ: Loaded 22142 primary data records. [2025-09-17T07:31:49.189769] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-09-17T07:31:49.190158] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-17T07:31:49.204666] [INFO ] [MAIN ] Derivative Progress: 186/2172 symbols completed. AXTA took 1.3s. Estimated remaining: 12m 24s. Rate: 160.1 symbols/min [2025-09-17T07:31:49.225993] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:49.527572] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-17T07:31:49.528053] [INFO ] [MAIN ] BA: Loaded 53791 primary data records. [2025-09-17T07:31:49.868490] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-17T07:31:49.869578] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-09-17T07:31:50.080351] [DEBUG] [MAIN ] AZZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:50.130942] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 22142 primary records. [2025-09-17T07:31:50.206621] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-17T07:31:50.228587] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-09-17T07:31:50.231799] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-17T07:31:50.234437] [INFO ] [MAIN ] Derivative Progress: 187/2172 symbols completed. AZZ took 1.1s. Estimated remaining: 12m 31s. Rate: 158.6 symbols/min [2025-09-17T07:31:50.243113] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:50.248448] [DEBUG] [MAIN ] BA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:50.250204] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53791 primary records. [2025-09-17T07:31:50.250839] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-17T07:31:50.269450] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-09-17T07:31:50.269769] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-17T07:31:50.272791] [INFO ] [MAIN ] Derivative Progress: 188/2172 symbols completed. BA took 1.1s. Estimated remaining: 12m 27s. Rate: 159.4 symbols/min [2025-09-17T07:31:50.273364] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:50.291904] [DEBUG] [MAIN ] BABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:50.292817] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-09-17T07:31:50.293003] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-17T07:31:50.312375] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-09-17T07:31:50.312587] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-17T07:31:50.315360] [INFO ] [MAIN ] Derivative Progress: 189/2172 symbols completed. BABA took 1.1s. Estimated remaining: 12m 23s. Rate: 160.2 symbols/min [2025-09-17T07:31:50.315953] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:50.355180] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-17T07:31:50.355702] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-09-17T07:31:50.525471] [DEBUG] [LOCAL ] BAH: Loaded 51820 existing records from primary storage. [2025-09-17T07:31:50.564884] [DEBUG] [LOCAL ] BAK: Loaded 38907 existing records from primary storage. [2025-09-17T07:31:50.565032] [INFO ] [MAIN ] BAH: Loaded 51820 primary data records. [2025-09-17T07:31:50.595599] [INFO ] [MAIN ] BAK: Loaded 38907 primary data records. [2025-09-17T07:31:51.393091] [DEBUG] [MAIN ] BAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:51.394186] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-09-17T07:31:51.394538] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-17T07:31:51.414534] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-09-17T07:31:51.427714] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-17T07:31:51.428434] [DEBUG] [MAIN ] BAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:51.431457] [INFO ] [MAIN ] Derivative Progress: 190/2172 symbols completed. BAC took 1.2s. Estimated remaining: 12m 30s. Rate: 158.5 symbols/min [2025-09-17T07:31:51.433770] [INFO ] [MAIN ] BAH: Generated 1794 derivative records from 51820 primary records. [2025-09-17T07:31:51.434977] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:51.434876] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-17T07:31:51.450183] [DEBUG] [MAIN ] BAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:51.462577] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 38907 primary records. [2025-09-17T07:31:51.463978] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-17T07:31:51.476875] [DEBUG] [LOCAL ] BAH: Derivative data saved (1794 records). [2025-09-17T07:31:51.485246] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-17T07:31:51.485027] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-09-17T07:31:51.491366] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-17T07:31:51.491237] [INFO ] [MAIN ] Derivative Progress: 191/2172 symbols completed. BAH took 1.2s. Estimated remaining: 12m 27s. Rate: 159.2 symbols/min [2025-09-17T07:31:51.495148] [INFO ] [MAIN ] Derivative Progress: 192/2172 symbols completed. BAK took 1.2s. Estimated remaining: 12m 22s. Rate: 160.0 symbols/min [2025-09-17T07:31:51.495902] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:51.495325] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:51.576974] [DEBUG] [LOCAL ] BALL: Loaded 51856 existing records from primary storage. [2025-09-17T07:31:51.578105] [INFO ] [MAIN ] BALL: Loaded 51856 primary data records. [2025-09-17T07:31:51.672362] [DEBUG] [LOCAL ] BANC: Loaded 51263 existing records from primary storage. [2025-09-17T07:31:51.690497] [INFO ] [MAIN ] BANC: Loaded 51263 primary data records. [2025-09-17T07:31:51.772607] [DEBUG] [LOCAL ] BAM: Loaded 52019 existing records from primary storage. [2025-09-17T07:31:51.838182] [INFO ] [MAIN ] BAM: Loaded 52019 primary data records. [2025-09-17T07:31:52.598861] [DEBUG] [MAIN ] BALL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:52.612929] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51856 primary records. [2025-09-17T07:31:52.613038] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-17T07:31:52.615040] [DEBUG] [MAIN ] BANC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:52.633896] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51263 primary records. [2025-09-17T07:31:52.635606] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-17T07:31:52.635442] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-09-17T07:31:52.636463] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-17T07:31:52.646712] [INFO ] [MAIN ] Derivative Progress: 193/2172 symbols completed. BALL took 1.2s. Estimated remaining: 12m 30s. Rate: 158.3 symbols/min [2025-09-17T07:31:52.661053] [DEBUG] [MAIN ] BAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:52.667143] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52019 primary records. [2025-09-17T07:31:52.668339] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-17T07:31:52.668413] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-09-17T07:31:52.669258] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-17T07:31:52.671710] [INFO ] [MAIN ] Derivative Progress: 194/2172 symbols completed. BANC took 1.2s. Estimated remaining: 12m 26s. Rate: 159.1 symbols/min [2025-09-17T07:31:52.686960] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-09-17T07:31:52.687063] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-17T07:31:52.689702] [INFO ] [MAIN ] Derivative Progress: 195/2172 symbols completed. BAM took 1.2s. Estimated remaining: 12m 22s. Rate: 159.9 symbols/min [2025-09-17T07:31:52.690537] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:52.690758] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:52.690900] [INFO ] [MAIN ] BARK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:52.728838] [DEBUG] [LOCAL ] BAP: Loaded 26418 existing records from primary storage. [2025-09-17T07:31:52.728996] [INFO ] [MAIN ] BAP: Loaded 26418 primary data records. [2025-09-17T07:31:52.860932] [DEBUG] [LOCAL ] BARK: Loaded 38682 existing records from primary storage. [2025-09-17T07:31:52.878340] [INFO ] [MAIN ] BARK: Loaded 38682 primary data records. [2025-09-17T07:31:53.125169] [DEBUG] [LOCAL ] BAX: Loaded 53491 existing records from primary storage. [2025-09-17T07:31:53.160690] [INFO ] [MAIN ] BAX: Loaded 53491 primary data records. [2025-09-17T07:31:53.763142] [DEBUG] [MAIN ] BAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:53.765024] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 26418 primary records. [2025-09-17T07:31:53.765378] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-17T07:31:53.785191] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-09-17T07:31:53.785681] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-17T07:31:53.787918] [INFO ] [MAIN ] Derivative Progress: 196/2172 symbols completed. BAP took 1.1s. Estimated remaining: 12m 29s. Rate: 158.3 symbols/min [2025-09-17T07:31:53.788551] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:53.802361] [DEBUG] [MAIN ] BARK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:53.803453] [INFO ] [MAIN ] BARK: Generated 1794 derivative records from 38682 primary records. [2025-09-17T07:31:53.803793] [DEBUG] [LOCAL ] BARK: Saving derivative data. [2025-09-17T07:31:53.822707] [DEBUG] [LOCAL ] BARK: Derivative data saved (1794 records). [2025-09-17T07:31:53.823878] [INFO ] [MAIN ] BARK: Successfully saved derivative data. [2025-09-17T07:31:53.826242] [INFO ] [MAIN ] Derivative Progress: 197/2172 symbols completed. BARK took 1.1s. Estimated remaining: 12m 25s. Rate: 159.0 symbols/min [2025-09-17T07:31:53.826673] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:53.841277] [DEBUG] [MAIN ] BAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:53.842066] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53491 primary records. [2025-09-17T07:31:53.842346] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-17T07:31:53.858971] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-09-17T07:31:53.859064] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-17T07:31:53.861817] [INFO ] [MAIN ] Derivative Progress: 198/2172 symbols completed. BAX took 1.2s. Estimated remaining: 12m 21s. Rate: 159.8 symbols/min [2025-09-17T07:31:53.862258] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:53.899402] [DEBUG] [LOCAL ] BB: Loaded 52930 existing records from primary storage. [2025-09-17T07:31:53.899835] [INFO ] [MAIN ] BB: Loaded 52930 primary data records. [2025-09-17T07:31:54.095735] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-17T07:31:54.131081] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-09-17T07:31:54.277598] [DEBUG] [LOCAL ] BBAR: Loaded 40983 existing records from primary storage. [2025-09-17T07:31:54.321571] [INFO ] [MAIN ] BBAR: Loaded 40983 primary data records. [2025-09-17T07:31:54.920010] [DEBUG] [MAIN ] BB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:54.921626] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52930 primary records. [2025-09-17T07:31:54.922501] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-17T07:31:54.941289] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-09-17T07:31:54.943022] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-17T07:31:54.945343] [INFO ] [MAIN ] Derivative Progress: 199/2172 symbols completed. BB took 1.2s. Estimated remaining: 12m 28s. Rate: 158.3 symbols/min [2025-09-17T07:31:54.946340] [INFO ] [MAIN ] BBD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:54.960101] [DEBUG] [MAIN ] BBAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:54.960932] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-09-17T07:31:54.961216] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-17T07:31:54.981557] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-09-17T07:31:54.981795] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-17T07:31:54.983997] [INFO ] [MAIN ] Derivative Progress: 200/2172 symbols completed. BBAI took 1.2s. Estimated remaining: 12m 24s. Rate: 159.0 symbols/min [2025-09-17T07:31:54.992143] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:54.997424] [DEBUG] [MAIN ] BBAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:54.998834] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 40983 primary records. [2025-09-17T07:31:54.999061] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-17T07:31:55.016484] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-09-17T07:31:55.016670] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-17T07:31:55.019610] [INFO ] [MAIN ] Derivative Progress: 201/2172 symbols completed. BBAR took 1.2s. Estimated remaining: 12m 20s. Rate: 159.7 symbols/min [2025-09-17T07:31:55.020244] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:55.043124] [DEBUG] [LOCAL ] BBDO: Loaded 5109 existing records from primary storage. [2025-09-17T07:31:55.051048] [INFO ] [MAIN ] BBDO: Loaded 5109 primary data records. [2025-09-17T07:31:55.133110] [DEBUG] [LOCAL ] BBD: Loaded 53176 existing records from primary storage. [2025-09-17T07:31:55.159493] [INFO ] [MAIN ] BBD: Loaded 53176 primary data records. [2025-09-17T07:31:55.226620] [DEBUG] [LOCAL ] BBDC: Loaded 33544 existing records from primary storage. [2025-09-17T07:31:55.240464] [INFO ] [MAIN ] BBDC: Loaded 33544 primary data records. [2025-09-17T07:31:56.081869] [DEBUG] [MAIN ] BBDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:56.082895] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 5109 primary records. [2025-09-17T07:31:56.083265] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-17T07:31:56.113069] [DEBUG] [MAIN ] BBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:56.117841] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-09-17T07:31:56.120253] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-17T07:31:56.119407] [INFO ] [MAIN ] BBD: Generated 1794 derivative records from 53176 primary records. [2025-09-17T07:31:56.122443] [INFO ] [MAIN ] Derivative Progress: 202/2172 symbols completed. BBDO took 1.1s. Estimated remaining: 12m 27s. Rate: 158.2 symbols/min [2025-09-17T07:31:56.120447] [DEBUG] [LOCAL ] BBD: Saving derivative data. [2025-09-17T07:31:56.123780] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:56.151330] [DEBUG] [MAIN ] BBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:56.153251] [DEBUG] [LOCAL ] BBD: Derivative data saved (1794 records). [2025-09-17T07:31:56.154293] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 33544 primary records. [2025-09-17T07:31:56.154597] [INFO ] [MAIN ] BBD: Successfully saved derivative data. [2025-09-17T07:31:56.154757] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-17T07:31:56.157113] [INFO ] [MAIN ] Derivative Progress: 203/2172 symbols completed. BBD took 1.2s. Estimated remaining: 12m 23s. Rate: 158.9 symbols/min [2025-09-17T07:31:56.158489] [INFO ] [MAIN ] BBU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:56.178904] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-09-17T07:31:56.179251] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-17T07:31:56.182000] [INFO ] [MAIN ] Derivative Progress: 204/2172 symbols completed. BBDC took 1.2s. Estimated remaining: 12m 20s. Rate: 159.6 symbols/min [2025-09-17T07:31:56.182363] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:56.187989] [DEBUG] [LOCAL ] BBU: Loaded 4015 existing records from primary storage. [2025-09-17T07:31:56.194282] [INFO ] [MAIN ] BBU: Loaded 4015 primary data records. [2025-09-17T07:31:56.206043] [DEBUG] [LOCAL ] BBN: Loaded 18010 existing records from primary storage. [2025-09-17T07:31:56.237946] [INFO ] [MAIN ] BBN: Loaded 18010 primary data records. [2025-09-17T07:31:56.371609] [DEBUG] [LOCAL ] BBUC: Loaded 13185 existing records from primary storage. [2025-09-17T07:31:56.410159] [INFO ] [MAIN ] BBUC: Loaded 13185 primary data records. [2025-09-17T07:31:57.171524] [DEBUG] [MAIN ] BBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:57.173152] [INFO ] [MAIN ] BBU: Generated 1794 derivative records from 4015 primary records. [2025-09-17T07:31:57.172448] [DEBUG] [MAIN ] BBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:57.173956] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 18010 primary records. [2025-09-17T07:31:57.174016] [DEBUG] [LOCAL ] BBU: Saving derivative data. [2025-09-17T07:31:57.174263] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-17T07:31:57.214492] [DEBUG] [LOCAL ] BBU: Derivative data saved (1794 records). [2025-09-17T07:31:57.220853] [INFO ] [MAIN ] BBU: Successfully saved derivative data. [2025-09-17T07:31:57.221418] [DEBUG] [MAIN ] BBUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:57.221813] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-09-17T07:31:57.223977] [INFO ] [MAIN ] Derivative Progress: 205/2172 symbols completed. BBU took 1.1s. Estimated remaining: 12m 26s. Rate: 158.3 symbols/min [2025-09-17T07:31:57.224929] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13185 primary records. [2025-09-17T07:31:57.225387] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:57.225147] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-17T07:31:57.225682] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-17T07:31:57.228393] [INFO ] [MAIN ] Derivative Progress: 206/2172 symbols completed. BBN took 1.1s. Estimated remaining: 12m 22s. Rate: 159.0 symbols/min [2025-09-17T07:31:57.237106] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:57.247602] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-09-17T07:31:57.247792] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-17T07:31:57.251055] [INFO ] [MAIN ] Derivative Progress: 207/2172 symbols completed. BBUC took 1.1s. Estimated remaining: 12m 18s. Rate: 159.8 symbols/min [2025-09-17T07:31:57.251512] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:57.282312] [DEBUG] [LOCAL ] BBW: Loaded 26342 existing records from primary storage. [2025-09-17T07:31:57.282566] [INFO ] [MAIN ] BBW: Loaded 26342 primary data records. [2025-09-17T07:31:57.436569] [DEBUG] [LOCAL ] BBVA: Loaded 49642 existing records from primary storage. [2025-09-17T07:31:57.480280] [INFO ] [MAIN ] BBVA: Loaded 49642 primary data records. [2025-09-17T07:31:57.791165] [DEBUG] [LOCAL ] BBWI: Loaded 53573 existing records from primary storage. [2025-09-17T07:31:57.803449] [INFO ] [MAIN ] BBWI: Loaded 53573 primary data records. [2025-09-17T07:31:58.310589] [DEBUG] [MAIN ] BBW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:58.312052] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 26342 primary records. [2025-09-17T07:31:58.312420] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-17T07:31:58.331774] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-09-17T07:31:58.335209] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-17T07:31:58.337854] [INFO ] [MAIN ] Derivative Progress: 208/2172 symbols completed. BBW took 1.1s. Estimated remaining: 12m 24s. Rate: 158.3 symbols/min [2025-09-17T07:31:58.356096] [DEBUG] [MAIN ] BBVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:58.356887] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49642 primary records. [2025-09-17T07:31:58.357165] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-17T07:31:58.398809] [DEBUG] [MAIN ] BBWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:58.398931] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-09-17T07:31:58.400048] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-17T07:31:58.399967] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53573 primary records. [2025-09-17T07:31:58.400185] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-17T07:31:58.402268] [INFO ] [MAIN ] Derivative Progress: 209/2172 symbols completed. BBVA took 1.2s. Estimated remaining: 12m 21s. Rate: 158.9 symbols/min [2025-09-17T07:31:58.426427] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-09-17T07:31:58.426626] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-17T07:31:58.429920] [INFO ] [MAIN ] Derivative Progress: 210/2172 symbols completed. BBWI took 1.2s. Estimated remaining: 12m 17s. Rate: 159.6 symbols/min [2025-09-17T07:31:58.430783] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:58.430680] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:58.430844] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:58.477524] [DEBUG] [LOCAL ] BCAT: Loaded 34598 existing records from primary storage. [2025-09-17T07:31:58.477789] [INFO ] [MAIN ] BCAT: Loaded 34598 primary data records. [2025-09-17T07:31:58.673575] [DEBUG] [LOCAL ] BC: Loaded 44798 existing records from primary storage. [2025-09-17T07:31:58.706300] [INFO ] [MAIN ] BC: Loaded 44798 primary data records. [2025-09-17T07:31:58.778714] [DEBUG] [LOCAL ] BBY: Loaded 53485 existing records from primary storage. [2025-09-17T07:31:58.811354] [INFO ] [MAIN ] BBY: Loaded 53485 primary data records. [2025-09-17T07:31:59.875276] [DEBUG] [MAIN ] BCAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:59.876188] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34598 primary records. [2025-09-17T07:31:59.876604] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-17T07:31:59.893621] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-09-17T07:31:59.893898] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-17T07:31:59.895854] [INFO ] [MAIN ] Derivative Progress: 211/2172 symbols completed. BCAT took 1.5s. Estimated remaining: 12m 27s. Rate: 157.5 symbols/min [2025-09-17T07:31:59.896272] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:59.913945] [DEBUG] [MAIN ] BBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:59.927032] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53485 primary records. [2025-09-17T07:31:59.927508] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-17T07:31:59.927447] [DEBUG] [MAIN ] BC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:31:59.928954] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44798 primary records. [2025-09-17T07:31:59.929247] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-17T07:31:59.966992] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-09-17T07:31:59.975522] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-17T07:31:59.975429] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-09-17T07:31:59.978195] [INFO ] [MAIN ] Derivative Progress: 212/2172 symbols completed. BC took 1.5s. Estimated remaining: 12m 24s. Rate: 158.1 symbols/min [2025-09-17T07:31:59.978308] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-17T07:31:59.978977] [DEBUG] [LOCAL ] BCC: Loaded 28404 existing records from primary storage. [2025-09-17T07:31:59.982477] [INFO ] [MAIN ] BCC: Loaded 28404 primary data records. [2025-09-17T07:31:59.982365] [INFO ] [MAIN ] Derivative Progress: 213/2172 symbols completed. BBY took 1.6s. Estimated remaining: 12m 20s. Rate: 158.8 symbols/min [2025-09-17T07:31:59.982990] [INFO ] [MAIN ] BCH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:31:59.979166] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:00.308272] [DEBUG] [LOCAL ] BCH: Loaded 29507 existing records from primary storage. [2025-09-17T07:32:00.308781] [INFO ] [MAIN ] BCH: Loaded 29507 primary data records. [2025-09-17T07:32:00.428335] [DEBUG] [LOCAL ] BCE: Loaded 52381 existing records from primary storage. [2025-09-17T07:32:00.473753] [INFO ] [MAIN ] BCE: Loaded 52381 primary data records. [2025-09-17T07:32:00.937757] [DEBUG] [MAIN ] BCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:00.939067] [INFO ] [MAIN ] BCC: Generated 1794 derivative records from 28404 primary records. [2025-09-17T07:32:00.939268] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-17T07:32:00.961600] [DEBUG] [LOCAL ] BCC: Derivative data saved (1794 records). [2025-09-17T07:32:00.962773] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-17T07:32:00.965129] [INFO ] [MAIN ] Derivative Progress: 214/2172 symbols completed. BCC took 1.1s. Estimated remaining: 12m 25s. Rate: 157.6 symbols/min [2025-09-17T07:32:00.973408] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:00.979700] [DEBUG] [MAIN ] BCH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:00.981071] [INFO ] [MAIN ] BCH: Generated 1794 derivative records from 29507 primary records. [2025-09-17T07:32:00.981340] [DEBUG] [LOCAL ] BCH: Saving derivative data. [2025-09-17T07:32:00.998565] [DEBUG] [LOCAL ] BCH: Derivative data saved (1794 records). [2025-09-17T07:32:00.999194] [INFO ] [MAIN ] BCH: Successfully saved derivative data. [2025-09-17T07:32:01.001294] [INFO ] [MAIN ] Derivative Progress: 215/2172 symbols completed. BCH took 1.0s. Estimated remaining: 12m 22s. Rate: 158.3 symbols/min [2025-09-17T07:32:01.002023] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:01.027446] [DEBUG] [MAIN ] BCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:01.028374] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52381 primary records. [2025-09-17T07:32:01.028453] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-17T07:32:01.053883] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-09-17T07:32:01.054123] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-17T07:32:01.057873] [INFO ] [MAIN ] Derivative Progress: 216/2172 symbols completed. BCE took 1.1s. Estimated remaining: 12m 18s. Rate: 158.9 symbols/min [2025-09-17T07:32:01.055305] [DEBUG] [LOCAL ] BCO: Loaded 26552 existing records from primary storage. [2025-09-17T07:32:01.058469] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:01.058604] [INFO ] [MAIN ] BCO: Loaded 26552 primary data records. [2025-09-17T07:32:01.417205] [DEBUG] [LOCAL ] BCSF: Loaded 27938 existing records from primary storage. [2025-09-17T07:32:01.418591] [DEBUG] [LOCAL ] BCS: Loaded 53480 existing records from primary storage. [2025-09-17T07:32:01.419921] [INFO ] [MAIN ] BCSF: Loaded 27938 primary data records. [2025-09-17T07:32:01.420754] [INFO ] [MAIN ] BCS: Loaded 53480 primary data records. [2025-09-17T07:32:02.130969] [DEBUG] [MAIN ] BCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:02.133504] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 26552 primary records. [2025-09-17T07:32:02.134138] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-17T07:32:02.157193] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-09-17T07:32:02.158232] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-17T07:32:02.160447] [INFO ] [MAIN ] Derivative Progress: 217/2172 symbols completed. BCO took 1.2s. Estimated remaining: 12m 25s. Rate: 157.5 symbols/min [2025-09-17T07:32:02.161652] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:02.195597] [DEBUG] [MAIN ] BCSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:02.196155] [DEBUG] [MAIN ] BCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:02.202795] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 27938 primary records. [2025-09-17T07:32:02.203500] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53480 primary records. [2025-09-17T07:32:02.203797] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-17T07:32:02.203880] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-17T07:32:02.243028] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-09-17T07:32:02.241166] [DEBUG] [LOCAL ] BCX: Loaded 22031 existing records from primary storage. [2025-09-17T07:32:02.243585] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-17T07:32:02.246680] [INFO ] [MAIN ] Derivative Progress: 218/2172 symbols completed. BCSF took 1.2s. Estimated remaining: 12m 22s. Rate: 158.1 symbols/min [2025-09-17T07:32:02.246860] [INFO ] [MAIN ] BCX: Loaded 22031 primary data records. [2025-09-17T07:32:02.248025] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:02.306936] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-09-17T07:32:02.337757] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-17T07:32:02.356953] [INFO ] [MAIN ] Derivative Progress: 219/2172 symbols completed. BCS took 1.4s. Estimated remaining: 12m 19s. Rate: 158.6 symbols/min [2025-09-17T07:32:02.374928] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:02.450830] [DEBUG] [LOCAL ] BDC: Loaded 25094 existing records from primary storage. [2025-09-17T07:32:02.538317] [INFO ] [MAIN ] BDC: Loaded 25094 primary data records. [2025-09-17T07:32:02.750102] [DEBUG] [LOCAL ] BDJ: Loaded 29272 existing records from primary storage. [2025-09-17T07:32:02.869823] [INFO ] [MAIN ] BDJ: Loaded 29272 primary data records. [2025-09-17T07:32:03.087950] [DEBUG] [MAIN ] BCX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:03.088852] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 22031 primary records. [2025-09-17T07:32:03.205816] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-17T07:32:03.224575] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-09-17T07:32:03.225754] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-17T07:32:03.227832] [INFO ] [MAIN ] Derivative Progress: 220/2172 symbols completed. BCX took 1.1s. Estimated remaining: 12m 23s. Rate: 157.7 symbols/min [2025-09-17T07:32:03.228764] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:03.246021] [DEBUG] [MAIN ] BDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:03.247253] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 25094 primary records. [2025-09-17T07:32:03.248279] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-17T07:32:03.268673] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-09-17T07:32:03.269017] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-17T07:32:03.272861] [INFO ] [MAIN ] Derivative Progress: 221/2172 symbols completed. BDC took 1.0s. Estimated remaining: 12m 19s. Rate: 158.3 symbols/min [2025-09-17T07:32:03.274324] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:03.299337] [DEBUG] [MAIN ] BDJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:03.300121] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 29272 primary records. [2025-09-17T07:32:03.300282] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-17T07:32:03.317448] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-09-17T07:32:03.331929] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-17T07:32:03.334441] [INFO ] [MAIN ] Derivative Progress: 222/2172 symbols completed. BDJ took 1.0s. Estimated remaining: 12m 16s. Rate: 158.9 symbols/min [2025-09-17T07:32:03.334762] [INFO ] [MAIN ] BE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:03.335628] [DEBUG] [LOCAL ] BDN: Loaded 47698 existing records from primary storage. [2025-09-17T07:32:03.336354] [INFO ] [MAIN ] BDN: Loaded 47698 primary data records. [2025-09-17T07:32:03.698189] [DEBUG] [LOCAL ] BDX: Loaded 52531 existing records from primary storage. [2025-09-17T07:32:03.699361] [INFO ] [MAIN ] BDX: Loaded 52531 primary data records. [2025-09-17T07:32:03.826477] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-09-17T07:32:03.869021] [INFO ] [MAIN ] BE: Loaded 53653 primary data records. [2025-09-17T07:32:04.387691] [DEBUG] [MAIN ] BDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:04.389231] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47698 primary records. [2025-09-17T07:32:04.390116] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-17T07:32:04.409108] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-09-17T07:32:04.410043] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-17T07:32:04.413763] [INFO ] [MAIN ] Derivative Progress: 223/2172 symbols completed. BDN took 1.2s. Estimated remaining: 12m 22s. Rate: 157.6 symbols/min [2025-09-17T07:32:04.430071] [DEBUG] [MAIN ] BDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:04.430910] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52531 primary records. [2025-09-17T07:32:04.431101] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-17T07:32:04.449153] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-09-17T07:32:04.450164] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-17T07:32:04.453000] [INFO ] [MAIN ] Derivative Progress: 224/2172 symbols completed. BDX took 1.2s. Estimated remaining: 12m 19s. Rate: 158.2 symbols/min [2025-09-17T07:32:04.466485] [DEBUG] [MAIN ] BE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:04.467218] [INFO ] [MAIN ] BE: Generated 1794 derivative records from 53653 primary records. [2025-09-17T07:32:04.467308] [DEBUG] [LOCAL ] BE: Saving derivative data. [2025-09-17T07:32:04.483310] [DEBUG] [LOCAL ] BE: Derivative data saved (1794 records). [2025-09-17T07:32:04.483458] [INFO ] [MAIN ] BE: Successfully saved derivative data. [2025-09-17T07:32:04.487333] [INFO ] [MAIN ] Derivative Progress: 225/2172 symbols completed. BE took 1.2s. Estimated remaining: 12m 15s. Rate: 158.9 symbols/min [2025-09-17T07:32:04.488222] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:04.488423] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:04.488934] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:04.561401] [DEBUG] [LOCAL ] BEP: Loaded 38899 existing records from primary storage. [2025-09-17T07:32:04.577137] [INFO ] [MAIN ] BEP: Loaded 38899 primary data records. [2025-09-17T07:32:04.632887] [DEBUG] [LOCAL ] BEKE: Loaded 53268 existing records from primary storage. [2025-09-17T07:32:04.678903] [INFO ] [MAIN ] BEKE: Loaded 53268 primary data records. [2025-09-17T07:32:04.749222] [DEBUG] [LOCAL ] BEN: Loaded 53087 existing records from primary storage. [2025-09-17T07:32:04.810118] [INFO ] [MAIN ] BEN: Loaded 53087 primary data records. [2025-09-17T07:32:05.547255] [DEBUG] [MAIN ] BEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:05.549205] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38899 primary records. [2025-09-17T07:32:05.549809] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-17T07:32:05.573842] [DEBUG] [MAIN ] BEKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:05.582879] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-09-17T07:32:05.583001] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-17T07:32:05.577990] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53268 primary records. [2025-09-17T07:32:05.585028] [INFO ] [MAIN ] Derivative Progress: 226/2172 symbols completed. BEP took 1.1s. Estimated remaining: 12m 21s. Rate: 157.5 symbols/min [2025-09-17T07:32:05.583197] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-17T07:32:05.585762] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:05.621257] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-09-17T07:32:05.621946] [DEBUG] [MAIN ] BEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:05.622020] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-17T07:32:05.624694] [INFO ] [MAIN ] Derivative Progress: 227/2172 symbols completed. BEKE took 1.1s. Estimated remaining: 12m 18s. Rate: 158.2 symbols/min [2025-09-17T07:32:05.625036] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:05.626515] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53087 primary records. [2025-09-17T07:32:05.627019] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-17T07:32:05.646409] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-09-17T07:32:05.646742] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-17T07:32:05.649604] [INFO ] [MAIN ] Derivative Progress: 228/2172 symbols completed. BEN took 1.2s. Estimated remaining: 12m 14s. Rate: 158.8 symbols/min [2025-09-17T07:32:05.650059] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:05.653249] [DEBUG] [LOCAL ] BEPH: Loaded 5228 existing records from primary storage. [2025-09-17T07:32:05.653774] [INFO ] [MAIN ] BEPH: Loaded 5228 primary data records. [2025-09-17T07:32:05.733813] [DEBUG] [LOCAL ] BEPI: Loaded 3428 existing records from primary storage. [2025-09-17T07:32:05.776345] [INFO ] [MAIN ] BEPI: Loaded 3428 primary data records. [2025-09-17T07:32:05.831364] [DEBUG] [LOCAL ] BEPC: Loaded 46706 existing records from primary storage. [2025-09-17T07:32:05.892508] [INFO ] [MAIN ] BEPC: Loaded 46706 primary data records. [2025-09-17T07:32:06.657436] [DEBUG] [MAIN ] BEPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:06.658745] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5228 primary records. [2025-09-17T07:32:06.658953] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-17T07:32:06.690433] [DEBUG] [MAIN ] BEPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:06.692774] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-09-17T07:32:06.695067] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-17T07:32:06.693518] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3428 primary records. [2025-09-17T07:32:06.697953] [INFO ] [MAIN ] Derivative Progress: 229/2172 symbols completed. BEPH took 1.1s. Estimated remaining: 12m 20s. Rate: 157.6 symbols/min [2025-09-17T07:32:06.698338] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:06.698781] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-17T07:32:06.729543] [DEBUG] [MAIN ] BEPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:06.732465] [DEBUG] [LOCAL ] BEPJ: Loaded 3356 existing records from primary storage. [2025-09-17T07:32:06.733930] [INFO ] [MAIN ] BEPC: Generated 1794 derivative records from 46706 primary records. [2025-09-17T07:32:06.734613] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-17T07:32:06.734246] [INFO ] [MAIN ] BEPJ: Loaded 3356 primary data records. [2025-09-17T07:32:06.796417] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-09-17T07:32:06.809679] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-17T07:32:06.827053] [INFO ] [MAIN ] Derivative Progress: 230/2172 symbols completed. BEPI took 1.2s. Estimated remaining: 12m 17s. Rate: 158.0 symbols/min [2025-09-17T07:32:06.845193] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:06.851534] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-09-17T07:32:06.887961] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-17T07:32:06.950320] [INFO ] [MAIN ] Derivative Progress: 231/2172 symbols completed. BEPC took 1.4s. Estimated remaining: 12m 15s. Rate: 158.5 symbols/min [2025-09-17T07:32:07.065691] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:07.096624] [DEBUG] [LOCAL ] BFAM: Loaded 32885 existing records from primary storage. [2025-09-17T07:32:07.097229] [INFO ] [MAIN ] BFAM: Loaded 32885 primary data records. [2025-09-17T07:32:07.309482] [DEBUG] [MAIN ] BEPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:07.424431] [INFO ] [MAIN ] BEPJ: Generated 1794 derivative records from 3356 primary records. [2025-09-17T07:32:07.426207] [DEBUG] [LOCAL ] BFH: Loaded 42060 existing records from primary storage. [2025-09-17T07:32:07.426341] [INFO ] [MAIN ] BFH: Loaded 42060 primary data records. [2025-09-17T07:32:07.426436] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-17T07:32:07.621812] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1794 records). [2025-09-17T07:32:07.627430] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-17T07:32:07.797021] [INFO ] [MAIN ] Derivative Progress: 232/2172 symbols completed. BEPJ took 1.1s. Estimated remaining: 12m 18s. Rate: 157.7 symbols/min [2025-09-17T07:32:07.797960] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:07.823563] [DEBUG] [MAIN ] BFAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:07.824682] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 32885 primary records. [2025-09-17T07:32:07.830514] [DEBUG] [LOCAL ] BFK: Loaded 13903 existing records from primary storage. [2025-09-17T07:32:07.829826] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-17T07:32:07.831318] [INFO ] [MAIN ] BFK: Loaded 13903 primary data records. [2025-09-17T07:32:07.960828] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-09-17T07:32:07.961162] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-17T07:32:07.971709] [INFO ] [MAIN ] Derivative Progress: 233/2172 symbols completed. BFAM took 1.1s. Estimated remaining: 12m 16s. Rate: 158.0 symbols/min [2025-09-17T07:32:08.007912] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:08.165532] [DEBUG] [MAIN ] BFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:08.181384] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 42060 primary records. [2025-09-17T07:32:08.181710] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-17T07:32:08.200935] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-09-17T07:32:08.201275] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-17T07:32:08.203928] [INFO ] [MAIN ] Derivative Progress: 234/2172 symbols completed. BFH took 1.1s. Estimated remaining: 12m 15s. Rate: 158.3 symbols/min [2025-09-17T07:32:08.205022] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:08.237322] [DEBUG] [LOCAL ] BFS: Loaded 8999 existing records from primary storage. [2025-09-17T07:32:08.250356] [INFO ] [MAIN ] BFS: Loaded 8999 primary data records. [2025-09-17T07:32:08.250854] [DEBUG] [MAIN ] BFK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:08.257315] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13903 primary records. [2025-09-17T07:32:08.294767] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-17T07:32:08.378133] [DEBUG] [LOCAL ] BFLY: Loaded 51856 existing records from primary storage. [2025-09-17T07:32:08.385728] [INFO ] [MAIN ] BFLY: Loaded 51856 primary data records. [2025-09-17T07:32:08.656208] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-09-17T07:32:08.683825] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-17T07:32:08.701746] [INFO ] [MAIN ] Derivative Progress: 235/2172 symbols completed. BFK took 0.9s. Estimated remaining: 12m 15s. Rate: 158.1 symbols/min [2025-09-17T07:32:08.705525] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:08.919727] [DEBUG] [LOCAL ] BFZ: Loaded 11334 existing records from primary storage. [2025-09-17T07:32:08.921106] [INFO ] [MAIN ] BFZ: Loaded 11334 primary data records. [2025-09-17T07:32:09.128798] [DEBUG] [MAIN ] BFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:09.232333] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 8999 primary records. [2025-09-17T07:32:09.247061] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-17T07:32:09.282109] [DEBUG] [MAIN ] BFLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:09.284276] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51856 primary records. [2025-09-17T07:32:09.285192] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-17T07:32:09.305130] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-09-17T07:32:09.307397] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-17T07:32:09.311790] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-09-17T07:32:09.311072] [INFO ] [MAIN ] Derivative Progress: 236/2172 symbols completed. BFS took 1.1s. Estimated remaining: 12m 17s. Rate: 157.7 symbols/min [2025-09-17T07:32:09.312081] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-17T07:32:09.314307] [INFO ] [MAIN ] BG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:09.314481] [INFO ] [MAIN ] Derivative Progress: 237/2172 symbols completed. BFLY took 1.3s. Estimated remaining: 12m 13s. Rate: 158.3 symbols/min [2025-09-17T07:32:09.315133] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:09.333168] [DEBUG] [MAIN ] BFZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:09.333979] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 11334 primary records. [2025-09-17T07:32:09.334174] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-17T07:32:09.363244] [DEBUG] [LOCAL ] BGB: Loaded 17666 existing records from primary storage. [2025-09-17T07:32:09.364848] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-09-17T07:32:09.365074] [INFO ] [MAIN ] BGB: Loaded 17666 primary data records. [2025-09-17T07:32:09.376579] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-17T07:32:09.405060] [INFO ] [MAIN ] Derivative Progress: 238/2172 symbols completed. BFZ took 0.7s. Estimated remaining: 12m 11s. Rate: 158.8 symbols/min [2025-09-17T07:32:09.641409] [DEBUG] [LOCAL ] BG: Loaded 50385 existing records from primary storage. [2025-09-17T07:32:09.654210] [INFO ] [MAIN ] BG: Loaded 50385 primary data records. [2025-09-17T07:32:10.053395] [DEBUG] [MAIN ] BGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:10.054621] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17666 primary records. [2025-09-17T07:32:10.055048] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-17T07:32:10.072808] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-09-17T07:32:10.073061] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-17T07:32:10.075105] [INFO ] [MAIN ] Derivative Progress: 239/2172 symbols completed. BGB took 0.8s. Estimated remaining: 12m 13s. Rate: 158.3 symbols/min [2025-09-17T07:32:10.091345] [DEBUG] [MAIN ] BG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:10.092014] [INFO ] [MAIN ] BG: Generated 1794 derivative records from 50385 primary records. [2025-09-17T07:32:10.092099] [DEBUG] [LOCAL ] BG: Saving derivative data. [2025-09-17T07:32:10.107279] [DEBUG] [LOCAL ] BG: Derivative data saved (1794 records). [2025-09-17T07:32:10.107358] [INFO ] [MAIN ] BG: Successfully saved derivative data. [2025-09-17T07:32:10.109880] [INFO ] [MAIN ] Derivative Progress: 240/2172 symbols completed. BG took 0.8s. Estimated remaining: 12m 9s. Rate: 158.9 symbols/min [2025-09-17T07:32:10.110487] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:10.110612] [INFO ] [MAIN ] BGH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:10.110828] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:10.119453] [DEBUG] [LOCAL ] BGSF: Loaded 5765 existing records from primary storage. [2025-09-17T07:32:10.119606] [INFO ] [MAIN ] BGSF: Loaded 5765 primary data records. [2025-09-17T07:32:10.252582] [DEBUG] [LOCAL ] BGH: Loaded 16427 existing records from primary storage. [2025-09-17T07:32:10.274310] [INFO ] [MAIN ] BGH: Loaded 16427 primary data records. [2025-09-17T07:32:10.573356] [DEBUG] [LOCAL ] BGS: Loaded 50432 existing records from primary storage. [2025-09-17T07:32:10.595035] [INFO ] [MAIN ] BGS: Loaded 50432 primary data records. [2025-09-17T07:32:11.131304] [DEBUG] [MAIN ] BGSF: Filtered 7001 bins outside market hours, 7826 incomplete bins [2025-09-17T07:32:11.132417] [INFO ] [MAIN ] BGSF: Generated 1788 derivative records from 5765 primary records. [2025-09-17T07:32:11.132735] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-17T07:32:11.151984] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1788 records). [2025-09-17T07:32:11.152230] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-17T07:32:11.155689] [INFO ] [MAIN ] Derivative Progress: 241/2172 symbols completed. BGSF took 1.0s. Estimated remaining: 12m 14s. Rate: 157.8 symbols/min [2025-09-17T07:32:11.157017] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:11.178022] [DEBUG] [MAIN ] BGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:11.196370] [INFO ] [MAIN ] BGH: Generated 1794 derivative records from 16427 primary records. [2025-09-17T07:32:11.196883] [DEBUG] [LOCAL ] BGH: Saving derivative data. [2025-09-17T07:32:11.196760] [DEBUG] [MAIN ] BGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:11.197975] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50432 primary records. [2025-09-17T07:32:11.198515] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-17T07:32:11.239429] [DEBUG] [LOCAL ] BGH: Derivative data saved (1794 records). [2025-09-17T07:32:11.240687] [DEBUG] [LOCAL ] BGT: Loaded 16701 existing records from primary storage. [2025-09-17T07:32:11.241216] [INFO ] [MAIN ] BGH: Successfully saved derivative data. [2025-09-17T07:32:11.241954] [INFO ] [MAIN ] BGT: Loaded 16701 primary data records. [2025-09-17T07:32:11.245542] [INFO ] [MAIN ] Derivative Progress: 242/2172 symbols completed. BGH took 1.1s. Estimated remaining: 12m 12s. Rate: 158.3 symbols/min [2025-09-17T07:32:11.245866] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:11.247936] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-09-17T07:32:11.248232] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-17T07:32:11.251698] [INFO ] [MAIN ] Derivative Progress: 243/2172 symbols completed. BGS took 1.1s. Estimated remaining: 12m 8s. Rate: 158.9 symbols/min [2025-09-17T07:32:11.290320] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:11.376616] [DEBUG] [LOCAL ] BGX: Loaded 10884 existing records from primary storage. [2025-09-17T07:32:11.376855] [INFO ] [MAIN ] BGX: Loaded 10884 primary data records. [2025-09-17T07:32:11.723772] [DEBUG] [LOCAL ] BGY: Loaded 23194 existing records from primary storage. [2025-09-17T07:32:11.774859] [INFO ] [MAIN ] BGY: Loaded 23194 primary data records. [2025-09-17T07:32:12.261929] [DEBUG] [MAIN ] BGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:12.264401] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16701 primary records. [2025-09-17T07:32:12.264611] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-17T07:32:12.304849] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-09-17T07:32:12.305432] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-17T07:32:12.306046] [DEBUG] [MAIN ] BGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:12.308522] [INFO ] [MAIN ] Derivative Progress: 244/2172 symbols completed. BGT took 1.2s. Estimated remaining: 12m 13s. Rate: 157.8 symbols/min [2025-09-17T07:32:12.309610] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 10884 primary records. [2025-09-17T07:32:12.310102] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:12.310474] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-17T07:32:12.353434] [DEBUG] [MAIN ] BGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:12.363696] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-09-17T07:32:12.363573] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 23194 primary records. [2025-09-17T07:32:12.363803] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-17T07:32:12.363979] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-17T07:32:12.366801] [INFO ] [MAIN ] Derivative Progress: 245/2172 symbols completed. BGX took 1.1s. Estimated remaining: 12m 10s. Rate: 158.3 symbols/min [2025-09-17T07:32:12.368316] [DEBUG] [LOCAL ] BH: Loaded 15192 existing records from primary storage. [2025-09-17T07:32:12.370212] [INFO ] [MAIN ] BH: Loaded 15192 primary data records. [2025-09-17T07:32:12.370105] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:12.402455] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-09-17T07:32:12.429483] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-17T07:32:12.465184] [INFO ] [MAIN ] Derivative Progress: 246/2172 symbols completed. BGY took 1.2s. Estimated remaining: 12m 8s. Rate: 158.8 symbols/min [2025-09-17T07:32:12.482519] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:12.741959] [DEBUG] [LOCAL ] BHC: Loaded 46774 existing records from primary storage. [2025-09-17T07:32:12.742996] [INFO ] [MAIN ] BHC: Loaded 46774 primary data records. [2025-09-17T07:32:12.854254] [DEBUG] [LOCAL ] BHE: Loaded 25454 existing records from primary storage. [2025-09-17T07:32:12.855237] [INFO ] [MAIN ] BHE: Loaded 25454 primary data records. [2025-09-17T07:32:13.362779] [DEBUG] [MAIN ] BH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:13.363834] [INFO ] [MAIN ] BH: Generated 1794 derivative records from 15192 primary records. [2025-09-17T07:32:13.364860] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-17T07:32:13.383515] [DEBUG] [LOCAL ] BH: Derivative data saved (1794 records). [2025-09-17T07:32:13.384030] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-17T07:32:13.386490] [INFO ] [MAIN ] Derivative Progress: 247/2172 symbols completed. BH took 1.1s. Estimated remaining: 12m 12s. Rate: 157.9 symbols/min [2025-09-17T07:32:13.387629] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:13.405711] [DEBUG] [MAIN ] BHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:13.406568] [INFO ] [MAIN ] BHC: Generated 1794 derivative records from 46774 primary records. [2025-09-17T07:32:13.406858] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-17T07:32:13.428751] [DEBUG] [LOCAL ] BHC: Derivative data saved (1794 records). [2025-09-17T07:32:13.429322] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-17T07:32:13.431678] [INFO ] [MAIN ] Derivative Progress: 248/2172 symbols completed. BHC took 1.1s. Estimated remaining: 12m 9s. Rate: 158.4 symbols/min [2025-09-17T07:32:13.432164] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:13.450856] [DEBUG] [LOCAL ] BHK: Loaded 22400 existing records from primary storage. [2025-09-17T07:32:13.455982] [DEBUG] [MAIN ] BHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:13.456851] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 25454 primary records. [2025-09-17T07:32:13.456204] [INFO ] [MAIN ] BHK: Loaded 22400 primary data records. [2025-09-17T07:32:13.456957] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-17T07:32:13.583096] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-09-17T07:32:13.613299] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-17T07:32:13.685286] [INFO ] [MAIN ] Derivative Progress: 249/2172 symbols completed. BHE took 1.2s. Estimated remaining: 12m 7s. Rate: 158.6 symbols/min [2025-09-17T07:32:13.822995] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:13.858511] [DEBUG] [LOCAL ] BHP: Loaded 53394 existing records from primary storage. [2025-09-17T07:32:13.858890] [INFO ] [MAIN ] BHP: Loaded 53394 primary data records. [2025-09-17T07:32:14.004769] [DEBUG] [LOCAL ] BHR: Loaded 21378 existing records from primary storage. [2025-09-17T07:32:14.054920] [INFO ] [MAIN ] BHR: Loaded 21378 primary data records. [2025-09-17T07:32:14.487000] [DEBUG] [MAIN ] BHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:14.488689] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 22400 primary records. [2025-09-17T07:32:14.489257] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-17T07:32:14.510843] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-09-17T07:32:14.524417] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-17T07:32:14.524879] [DEBUG] [MAIN ] BHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:14.528238] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53394 primary records. [2025-09-17T07:32:14.527269] [INFO ] [MAIN ] Derivative Progress: 250/2172 symbols completed. BHK took 1.1s. Estimated remaining: 12m 11s. Rate: 157.9 symbols/min [2025-09-17T07:32:14.528959] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-17T07:32:14.528761] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:14.550477] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-09-17T07:32:14.563195] [DEBUG] [MAIN ] BHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:14.563435] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-17T07:32:14.566622] [INFO ] [MAIN ] Derivative Progress: 251/2172 symbols completed. BHP took 1.1s. Estimated remaining: 12m 8s. Rate: 158.4 symbols/min [2025-09-17T07:32:14.564193] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21378 primary records. [2025-09-17T07:32:14.567158] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:14.567272] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-17T07:32:14.601531] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-09-17T07:32:14.601774] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-17T07:32:14.604773] [INFO ] [MAIN ] Derivative Progress: 252/2172 symbols completed. BHR took 0.8s. Estimated remaining: 12m 5s. Rate: 159.0 symbols/min [2025-09-17T07:32:14.605304] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:14.627108] [DEBUG] [LOCAL ] BHVN: Loaded 49499 existing records from primary storage. [2025-09-17T07:32:14.649687] [INFO ] [MAIN ] BHVN: Loaded 49499 primary data records. [2025-09-17T07:32:14.765295] [DEBUG] [LOCAL ] BIO: Loaded 25844 existing records from primary storage. [2025-09-17T07:32:14.795138] [INFO ] [MAIN ] BIO: Loaded 25844 primary data records. [2025-09-17T07:32:14.806441] [DEBUG] [LOCAL ] BILL: Loaded 52322 existing records from primary storage. [2025-09-17T07:32:14.851745] [INFO ] [MAIN ] BILL: Loaded 52322 primary data records. [2025-09-17T07:32:15.647499] [DEBUG] [MAIN ] BHVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:15.649435] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 49499 primary records. [2025-09-17T07:32:15.651146] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-17T07:32:15.684604] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-09-17T07:32:15.685298] [DEBUG] [MAIN ] BIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:15.693346] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-17T07:32:15.699216] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 25844 primary records. [2025-09-17T07:32:15.703052] [INFO ] [MAIN ] Derivative Progress: 253/2172 symbols completed. BHVN took 1.2s. Estimated remaining: 12m 10s. Rate: 157.8 symbols/min [2025-09-17T07:32:15.703387] [DEBUG] [MAIN ] BILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:15.703487] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-17T07:32:15.704792] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52322 primary records. [2025-09-17T07:32:15.705928] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-17T07:32:15.739691] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-09-17T07:32:15.743665] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-17T07:32:15.743923] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-09-17T07:32:15.747176] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-17T07:32:15.746988] [INFO ] [MAIN ] Derivative Progress: 254/2172 symbols completed. BIO took 1.1s. Estimated remaining: 12m 7s. Rate: 158.4 symbols/min [2025-09-17T07:32:15.750689] [INFO ] [MAIN ] Derivative Progress: 255/2172 symbols completed. BILL took 1.2s. Estimated remaining: 12m 4s. Rate: 159.0 symbols/min [2025-09-17T07:32:15.751539] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:15.751430] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:15.751766] [INFO ] [MAIN ] BIPH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:15.759181] [DEBUG] [LOCAL ] BIPH: Loaded 2628 existing records from primary storage. [2025-09-17T07:32:15.759350] [INFO ] [MAIN ] BIPH: Loaded 2628 primary data records. [2025-09-17T07:32:16.096512] [DEBUG] [LOCAL ] BIP: Loaded 39768 existing records from primary storage. [2025-09-17T07:32:16.097691] [DEBUG] [LOCAL ] BIPC: Loaded 41793 existing records from primary storage. [2025-09-17T07:32:16.098532] [INFO ] [MAIN ] BIPC: Loaded 41793 primary data records. [2025-09-17T07:32:16.099103] [INFO ] [MAIN ] BIP: Loaded 39768 primary data records. [2025-09-17T07:32:16.743140] [DEBUG] [MAIN ] BIPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:16.745624] [INFO ] [MAIN ] BIPH: Generated 1794 derivative records from 2628 primary records. [2025-09-17T07:32:16.746498] [DEBUG] [LOCAL ] BIPH: Saving derivative data. [2025-09-17T07:32:16.765118] [DEBUG] [LOCAL ] BIPH: Derivative data saved (1794 records). [2025-09-17T07:32:16.765690] [INFO ] [MAIN ] BIPH: Successfully saved derivative data. [2025-09-17T07:32:16.768329] [INFO ] [MAIN ] Derivative Progress: 256/2172 symbols completed. BIPH took 1.0s. Estimated remaining: 12m 8s. Rate: 157.9 symbols/min [2025-09-17T07:32:16.769678] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:16.779369] [DEBUG] [LOCAL ] BIPI: Loaded 3447 existing records from primary storage. [2025-09-17T07:32:16.780052] [INFO ] [MAIN ] BIPI: Loaded 3447 primary data records. [2025-09-17T07:32:16.945892] [DEBUG] [MAIN ] BIPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:16.999060] [DEBUG] [MAIN ] BIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:17.000578] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41793 primary records. [2025-09-17T07:32:17.001462] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39768 primary records. [2025-09-17T07:32:17.001840] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-17T07:32:17.001762] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-17T07:32:17.146573] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-09-17T07:32:17.151665] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-17T07:32:17.155506] [INFO ] [MAIN ] Derivative Progress: 257/2172 symbols completed. BIPC took 1.4s. Estimated remaining: 12m 8s. Rate: 157.9 symbols/min [2025-09-17T07:32:17.157965] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:17.162518] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-09-17T07:32:17.163498] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-17T07:32:17.166478] [INFO ] [MAIN ] Derivative Progress: 258/2172 symbols completed. BIP took 1.4s. Estimated remaining: 12m 4s. Rate: 158.5 symbols/min [2025-09-17T07:32:17.169496] [DEBUG] [LOCAL ] BIPJ: Loaded 2907 existing records from primary storage. [2025-09-17T07:32:17.169657] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:17.169727] [INFO ] [MAIN ] BIPJ: Loaded 2907 primary data records. [2025-09-17T07:32:17.504386] [DEBUG] [MAIN ] BIPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:17.506056] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3447 primary records. [2025-09-17T07:32:17.506864] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-17T07:32:17.538039] [DEBUG] [LOCAL ] BIRK: Loaded 50829 existing records from primary storage. [2025-09-17T07:32:17.539300] [INFO ] [MAIN ] BIRK: Loaded 50829 primary data records. [2025-09-17T07:32:17.540297] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-09-17T07:32:17.540616] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-17T07:32:17.579618] [INFO ] [MAIN ] Derivative Progress: 259/2172 symbols completed. BIPI took 0.8s. Estimated remaining: 12m 4s. Rate: 158.5 symbols/min [2025-09-17T07:32:17.612472] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:17.759008] [DEBUG] [MAIN ] BIPJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:17.780436] [INFO ] [MAIN ] BIPJ: Generated 1794 derivative records from 2907 primary records. [2025-09-17T07:32:17.891126] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-17T07:32:17.925561] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1794 records). [2025-09-17T07:32:17.926039] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-17T07:32:17.928180] [INFO ] [MAIN ] Derivative Progress: 260/2172 symbols completed. BIPJ took 0.8s. Estimated remaining: 12m 4s. Rate: 158.5 symbols/min [2025-09-17T07:32:17.929214] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:17.948520] [DEBUG] [LOCAL ] BJ: Loaded 51453 existing records from primary storage. [2025-09-17T07:32:17.949032] [INFO ] [MAIN ] BJ: Loaded 51453 primary data records. [2025-09-17T07:32:18.123123] [DEBUG] [MAIN ] BIRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:18.160753] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 50829 primary records. [2025-09-17T07:32:18.262187] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-17T07:32:18.303382] [DEBUG] [LOCAL ] BK: Loaded 53569 existing records from primary storage. [2025-09-17T07:32:18.305439] [INFO ] [MAIN ] BK: Loaded 53569 primary data records. [2025-09-17T07:32:18.368091] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-09-17T07:32:18.416268] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-17T07:32:18.435215] [INFO ] [MAIN ] Derivative Progress: 261/2172 symbols completed. BIRK took 1.3s. Estimated remaining: 12m 4s. Rate: 158.3 symbols/min [2025-09-17T07:32:18.500066] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:18.632681] [DEBUG] [MAIN ] BJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:18.633967] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51453 primary records. [2025-09-17T07:32:18.634430] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-17T07:32:18.651916] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-09-17T07:32:18.652479] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-17T07:32:18.654604] [INFO ] [MAIN ] Derivative Progress: 262/2172 symbols completed. BJ took 1.0s. Estimated remaining: 12m 3s. Rate: 158.6 symbols/min [2025-09-17T07:32:18.655620] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:18.684328] [DEBUG] [MAIN ] BK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:18.685381] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53569 primary records. [2025-09-17T07:32:18.685697] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-17T07:32:18.726265] [DEBUG] [LOCAL ] BKD: Loaded 50081 existing records from primary storage. [2025-09-17T07:32:18.727701] [INFO ] [MAIN ] BKD: Loaded 50081 primary data records. [2025-09-17T07:32:18.728568] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-09-17T07:32:18.759286] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-17T07:32:18.785300] [INFO ] [MAIN ] Derivative Progress: 263/2172 symbols completed. BK took 0.9s. Estimated remaining: 12m 1s. Rate: 158.9 symbols/min [2025-09-17T07:32:18.830116] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:18.842020] [DEBUG] [LOCAL ] BKE: Loaded 35017 existing records from primary storage. [2025-09-17T07:32:18.858426] [INFO ] [MAIN ] BKE: Loaded 35017 primary data records. [2025-09-17T07:32:19.349241] [DEBUG] [LOCAL ] BKH: Loaded 36686 existing records from primary storage. [2025-09-17T07:32:19.350225] [INFO ] [MAIN ] BKH: Loaded 36686 primary data records. [2025-09-17T07:32:19.707467] [DEBUG] [MAIN ] BKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:19.708315] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50081 primary records. [2025-09-17T07:32:19.709031] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-17T07:32:19.741099] [DEBUG] [MAIN ] BKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:19.742884] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-09-17T07:32:19.743528] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 35017 primary records. [2025-09-17T07:32:19.743786] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-17T07:32:19.746839] [INFO ] [MAIN ] Derivative Progress: 264/2172 symbols completed. BKD took 1.2s. Estimated remaining: 12m 4s. Rate: 158.0 symbols/min [2025-09-17T07:32:19.746894] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-17T07:32:19.747429] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:19.769402] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-09-17T07:32:19.769616] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-17T07:32:19.771965] [INFO ] [MAIN ] Derivative Progress: 265/2172 symbols completed. BKE took 1.1s. Estimated remaining: 12m 2s. Rate: 158.6 symbols/min [2025-09-17T07:32:19.772563] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:19.789112] [DEBUG] [MAIN ] BKH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:19.789820] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36686 primary records. [2025-09-17T07:32:19.798586] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-17T07:32:19.814271] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-09-17T07:32:19.823527] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-17T07:32:19.827032] [INFO ] [MAIN ] Derivative Progress: 266/2172 symbols completed. BKH took 1.0s. Estimated remaining: 11m 59s. Rate: 159.1 symbols/min [2025-09-17T07:32:19.827508] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:19.828722] [DEBUG] [LOCAL ] BKKT: Loaded 33804 existing records from primary storage. [2025-09-17T07:32:19.829014] [INFO ] [MAIN ] BKKT: Loaded 33804 primary data records. [2025-09-17T07:32:19.951445] [DEBUG] [LOCAL ] BKT: Loaded 10412 existing records from primary storage. [2025-09-17T07:32:19.975277] [INFO ] [MAIN ] BKT: Loaded 10412 primary data records. [2025-09-17T07:32:20.044739] [DEBUG] [LOCAL ] BKSY: Loaded 48305 existing records from primary storage. [2025-09-17T07:32:20.097147] [INFO ] [MAIN ] BKSY: Loaded 48305 primary data records. [2025-09-17T07:32:20.765333] [DEBUG] [MAIN ] BKKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:20.767111] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 33804 primary records. [2025-09-17T07:32:20.768825] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-17T07:32:20.793496] [DEBUG] [MAIN ] BKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:20.797295] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 10412 primary records. [2025-09-17T07:32:20.797664] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-17T07:32:20.813236] [DEBUG] [MAIN ] BKSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:20.815465] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-09-17T07:32:20.815043] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48305 primary records. [2025-09-17T07:32:20.815564] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-17T07:32:20.824827] [INFO ] [MAIN ] Derivative Progress: 267/2172 symbols completed. BKKT took 1.1s. Estimated remaining: 12m 3s. Rate: 158.1 symbols/min [2025-09-17T07:32:20.829087] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:20.829020] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-17T07:32:20.833961] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-09-17T07:32:20.845518] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-17T07:32:20.849790] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-09-17T07:32:20.852312] [INFO ] [MAIN ] Derivative Progress: 268/2172 symbols completed. BKT took 1.0s. Estimated remaining: 12m 0s. Rate: 158.7 symbols/min [2025-09-17T07:32:20.852551] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-17T07:32:20.855154] [INFO ] [MAIN ] Derivative Progress: 269/2172 symbols completed. BKSY took 1.1s. Estimated remaining: 11m 57s. Rate: 159.3 symbols/min [2025-09-17T07:32:20.888576] [DEBUG] [LOCAL ] BKU: Loaded 42061 existing records from primary storage. [2025-09-17T07:32:20.888760] [INFO ] [MAIN ] BKU: Loaded 42061 primary data records. [2025-09-17T07:32:21.202443] [DEBUG] [MAIN ] BKU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:21.203213] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 42061 primary records. [2025-09-17T07:32:21.203295] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-17T07:32:21.218617] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-09-17T07:32:21.218713] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-17T07:32:21.220786] [INFO ] [MAIN ] Derivative Progress: 270/2172 symbols completed. BKU took 0.4s. Estimated remaining: 11m 57s. Rate: 159.3 symbols/min [2025-09-17T07:32:21.221361] [INFO ] [MAIN ] BLD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:21.221446] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:21.221604] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:21.266874] [DEBUG] [LOCAL ] BLD: Loaded 28206 existing records from primary storage. [2025-09-17T07:32:21.267347] [DEBUG] [LOCAL ] BKV: Loaded 30298 existing records from primary storage. [2025-09-17T07:32:21.267596] [INFO ] [MAIN ] BKV: Loaded 30298 primary data records. [2025-09-17T07:32:21.276923] [INFO ] [MAIN ] BLD: Loaded 28206 primary data records. [2025-09-17T07:32:21.490980] [DEBUG] [LOCAL ] BLCO: Loaded 36497 existing records from primary storage. [2025-09-17T07:32:21.496669] [INFO ] [MAIN ] BLCO: Loaded 36497 primary data records. [2025-09-17T07:32:22.251139] [DEBUG] [MAIN ] BKV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:22.250596] [DEBUG] [MAIN ] BLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:22.252022] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 30298 primary records. [2025-09-17T07:32:22.252815] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-17T07:32:22.253003] [INFO ] [MAIN ] BLD: Generated 1794 derivative records from 28206 primary records. [2025-09-17T07:32:22.263585] [DEBUG] [LOCAL ] BLD: Saving derivative data. [2025-09-17T07:32:22.297157] [DEBUG] [MAIN ] BLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:22.301613] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 36497 primary records. [2025-09-17T07:32:22.300921] [DEBUG] [LOCAL ] BLD: Derivative data saved (1794 records). [2025-09-17T07:32:22.296615] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-09-17T07:32:22.301790] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-17T07:32:22.301946] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-17T07:32:22.305109] [INFO ] [MAIN ] Derivative Progress: 271/2172 symbols completed. BKV took 1.1s. Estimated remaining: 12m 1s. Rate: 158.2 symbols/min [2025-09-17T07:32:22.305220] [INFO ] [MAIN ] BLD: Successfully saved derivative data. [2025-09-17T07:32:22.308095] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:22.308032] [INFO ] [MAIN ] Derivative Progress: 272/2172 symbols completed. BLD took 1.1s. Estimated remaining: 11m 58s. Rate: 158.8 symbols/min [2025-09-17T07:32:22.317667] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:22.326161] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-09-17T07:32:22.326445] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-17T07:32:22.329032] [INFO ] [MAIN ] Derivative Progress: 273/2172 symbols completed. BLCO took 1.1s. Estimated remaining: 11m 55s. Rate: 159.3 symbols/min [2025-09-17T07:32:22.329398] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:22.345220] [DEBUG] [LOCAL ] BLE: Loaded 14696 existing records from primary storage. [2025-09-17T07:32:22.345584] [INFO ] [MAIN ] BLE: Loaded 14696 primary data records. [2025-09-17T07:32:22.663944] [DEBUG] [LOCAL ] BLK: Loaded 35450 existing records from primary storage. [2025-09-17T07:32:22.692704] [INFO ] [MAIN ] BLK: Loaded 35450 primary data records. [2025-09-17T07:32:22.693547] [DEBUG] [LOCAL ] BLDR: Loaded 51613 existing records from primary storage. [2025-09-17T07:32:22.693766] [INFO ] [MAIN ] BLDR: Loaded 51613 primary data records. [2025-09-17T07:32:23.376163] [DEBUG] [MAIN ] BLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:23.377105] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 14696 primary records. [2025-09-17T07:32:23.377623] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-17T07:32:23.397464] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-09-17T07:32:23.400226] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-17T07:32:23.402903] [INFO ] [MAIN ] Derivative Progress: 274/2172 symbols completed. BLE took 1.1s. Estimated remaining: 11m 60s. Rate: 158.2 symbols/min [2025-09-17T07:32:23.403134] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:23.418928] [DEBUG] [MAIN ] BLDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:23.419922] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51613 primary records. [2025-09-17T07:32:23.432870] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-17T07:32:23.433796] [DEBUG] [MAIN ] BLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:23.434937] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 35450 primary records. [2025-09-17T07:32:23.435200] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-17T07:32:23.465521] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-09-17T07:32:23.467361] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-09-17T07:32:23.467597] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-17T07:32:23.467635] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-17T07:32:23.470138] [INFO ] [MAIN ] Derivative Progress: 275/2172 symbols completed. BLK took 1.1s. Estimated remaining: 11m 57s. Rate: 158.7 symbols/min [2025-09-17T07:32:23.472725] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:23.472840] [INFO ] [MAIN ] Derivative Progress: 276/2172 symbols completed. BLDR took 1.2s. Estimated remaining: 11m 54s. Rate: 159.3 symbols/min [2025-09-17T07:32:23.473625] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:23.499406] [DEBUG] [LOCAL ] BLW: Loaded 12961 existing records from primary storage. [2025-09-17T07:32:23.499631] [INFO ] [MAIN ] BLW: Loaded 12961 primary data records. [2025-09-17T07:32:23.626238] [DEBUG] [LOCAL ] BLX: Loaded 16056 existing records from primary storage. [2025-09-17T07:32:23.627517] [INFO ] [MAIN ] BLX: Loaded 16056 primary data records. [2025-09-17T07:32:23.627435] [DEBUG] [LOCAL ] BLND: Loaded 49537 existing records from primary storage. [2025-09-17T07:32:23.628042] [INFO ] [MAIN ] BLND: Loaded 49537 primary data records. [2025-09-17T07:32:24.431767] [DEBUG] [MAIN ] BLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:24.433208] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 12961 primary records. [2025-09-17T07:32:24.433371] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-17T07:32:24.466200] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-09-17T07:32:24.466583] [DEBUG] [MAIN ] BLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:24.466925] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-17T07:32:24.467495] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 16056 primary records. [2025-09-17T07:32:24.481947] [INFO ] [MAIN ] Derivative Progress: 277/2172 symbols completed. BLW took 1.0s. Estimated remaining: 11m 58s. Rate: 158.3 symbols/min [2025-09-17T07:32:24.482743] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-17T07:32:24.482997] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:24.482944] [DEBUG] [MAIN ] BLND: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:32:24.484998] [INFO ] [MAIN ] BLND: Generated 1793 derivative records from 49537 primary records. [2025-09-17T07:32:24.493980] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-17T07:32:24.514040] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-09-17T07:32:24.515737] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-17T07:32:24.518177] [INFO ] [MAIN ] Derivative Progress: 278/2172 symbols completed. BLX took 1.0s. Estimated remaining: 11m 55s. Rate: 158.8 symbols/min [2025-09-17T07:32:24.519474] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:24.520592] [DEBUG] [LOCAL ] BLND: Derivative data saved (1793 records). [2025-09-17T07:32:24.521161] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-17T07:32:24.524419] [INFO ] [MAIN ] Derivative Progress: 279/2172 symbols completed. BLND took 1.1s. Estimated remaining: 11m 53s. Rate: 159.4 symbols/min [2025-09-17T07:32:24.528705] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:24.557277] [DEBUG] [LOCAL ] BME: Loaded 10803 existing records from primary storage. [2025-09-17T07:32:24.557948] [DEBUG] [LOCAL ] BMA: Loaded 34448 existing records from primary storage. [2025-09-17T07:32:24.558244] [INFO ] [MAIN ] BMA: Loaded 34448 primary data records. [2025-09-17T07:32:24.558203] [INFO ] [MAIN ] BME: Loaded 10803 primary data records. [2025-09-17T07:32:24.858060] [DEBUG] [LOCAL ] BMEZ: Loaded 26034 existing records from primary storage. [2025-09-17T07:32:24.891974] [INFO ] [MAIN ] BMEZ: Loaded 26034 primary data records. [2025-09-17T07:32:25.529879] [DEBUG] [MAIN ] BME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:25.530789] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 10803 primary records. [2025-09-17T07:32:25.532364] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-17T07:32:25.557709] [DEBUG] [MAIN ] BMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:25.559383] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 34448 primary records. [2025-09-17T07:32:25.560382] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-17T07:32:25.585747] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-09-17T07:32:25.592005] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-17T07:32:25.595138] [INFO ] [MAIN ] Derivative Progress: 280/2172 symbols completed. BME took 1.1s. Estimated remaining: 11m 57s. Rate: 158.4 symbols/min [2025-09-17T07:32:25.595381] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:25.592954] [DEBUG] [MAIN ] BMEZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:25.596026] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-09-17T07:32:25.597134] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26034 primary records. [2025-09-17T07:32:25.597322] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-17T07:32:25.597400] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-17T07:32:25.599886] [INFO ] [MAIN ] Derivative Progress: 281/2172 symbols completed. BMA took 1.1s. Estimated remaining: 11m 54s. Rate: 158.9 symbols/min [2025-09-17T07:32:25.601225] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:25.617805] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-09-17T07:32:25.620176] [DEBUG] [LOCAL ] BMN: Loaded 2573 existing records from primary storage. [2025-09-17T07:32:25.620450] [INFO ] [MAIN ] BMN: Loaded 2573 primary data records. [2025-09-17T07:32:25.620382] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-17T07:32:25.643278] [INFO ] [MAIN ] Derivative Progress: 282/2172 symbols completed. BMEZ took 1.1s. Estimated remaining: 11m 51s. Rate: 159.4 symbols/min [2025-09-17T07:32:25.686231] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:25.804729] [DEBUG] [LOCAL ] BMI: Loaded 23761 existing records from primary storage. [2025-09-17T07:32:25.899425] [INFO ] [MAIN ] BMI: Loaded 23761 primary data records. [2025-09-17T07:32:26.151121] [DEBUG] [LOCAL ] BMO: Loaded 41443 existing records from primary storage. [2025-09-17T07:32:26.154846] [INFO ] [MAIN ] BMO: Loaded 41443 primary data records. [2025-09-17T07:32:26.593200] [DEBUG] [MAIN ] BMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:26.594270] [INFO ] [MAIN ] BMN: Generated 1794 derivative records from 2573 primary records. [2025-09-17T07:32:26.594727] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-17T07:32:26.612500] [DEBUG] [LOCAL ] BMN: Derivative data saved (1794 records). [2025-09-17T07:32:26.613186] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-17T07:32:26.616966] [INFO ] [MAIN ] Derivative Progress: 283/2172 symbols completed. BMN took 1.0s. Estimated remaining: 11m 55s. Rate: 158.5 symbols/min [2025-09-17T07:32:26.632493] [DEBUG] [MAIN ] BMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:26.633285] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 23761 primary records. [2025-09-17T07:32:26.633452] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-17T07:32:26.650127] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-09-17T07:32:26.650809] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-17T07:32:26.653296] [INFO ] [MAIN ] Derivative Progress: 284/2172 symbols completed. BMI took 1.1s. Estimated remaining: 11m 52s. Rate: 159.0 symbols/min [2025-09-17T07:32:26.667603] [DEBUG] [MAIN ] BMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:26.668185] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41443 primary records. [2025-09-17T07:32:26.668259] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-17T07:32:26.683859] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-09-17T07:32:26.683936] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-17T07:32:26.686215] [INFO ] [MAIN ] Derivative Progress: 285/2172 symbols completed. BMO took 1.0s. Estimated remaining: 11m 50s. Rate: 159.5 symbols/min [2025-09-17T07:32:26.687040] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:26.686944] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:26.687138] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:26.745250] [DEBUG] [LOCAL ] BNED: Loaded 30086 existing records from primary storage. [2025-09-17T07:32:26.745447] [INFO ] [MAIN ] BNED: Loaded 30086 primary data records. [2025-09-17T07:32:26.898020] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-17T07:32:26.903800] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-09-17T07:32:26.941089] [DEBUG] [LOCAL ] BN: Loaded 53015 existing records from primary storage. [2025-09-17T07:32:27.056103] [INFO ] [MAIN ] BN: Loaded 53015 primary data records. [2025-09-17T07:32:27.804931] [DEBUG] [MAIN ] BNED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:27.806326] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 30086 primary records. [2025-09-17T07:32:27.806800] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-17T07:32:27.833211] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-09-17T07:32:27.833904] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-17T07:32:27.836448] [INFO ] [MAIN ] Derivative Progress: 286/2172 symbols completed. BNED took 1.1s. Estimated remaining: 11m 54s. Rate: 158.4 symbols/min [2025-09-17T07:32:27.852020] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:27.852330] [DEBUG] [MAIN ] BMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:27.853601] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-09-17T07:32:27.853898] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-17T07:32:27.872618] [DEBUG] [LOCAL ] BNH: Loaded 4836 existing records from primary storage. [2025-09-17T07:32:27.875845] [INFO ] [MAIN ] BNH: Loaded 4836 primary data records. [2025-09-17T07:32:27.946887] [DEBUG] [MAIN ] BN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:27.933779] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-09-17T07:32:27.973273] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-17T07:32:27.973710] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 53015 primary records. [2025-09-17T07:32:27.998173] [INFO ] [MAIN ] Derivative Progress: 287/2172 symbols completed. BMY took 1.3s. Estimated remaining: 11m 53s. Rate: 158.7 symbols/min [2025-09-17T07:32:27.998273] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-17T07:32:27.998676] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:28.192951] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-09-17T07:32:28.198354] [DEBUG] [LOCAL ] BNJ: Loaded 2609 existing records from primary storage. [2025-09-17T07:32:28.208028] [INFO ] [MAIN ] BNJ: Loaded 2609 primary data records. [2025-09-17T07:32:28.207915] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-17T07:32:28.241972] [INFO ] [MAIN ] Derivative Progress: 288/2172 symbols completed. BN took 1.6s. Estimated remaining: 11m 51s. Rate: 158.9 symbols/min [2025-09-17T07:32:28.267873] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:28.531801] [DEBUG] [MAIN ] BNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:28.532748] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 4836 primary records. [2025-09-17T07:32:28.532887] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-17T07:32:28.561948] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-09-17T07:32:28.562191] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-17T07:32:28.564815] [INFO ] [MAIN ] Derivative Progress: 289/2172 symbols completed. BNH took 0.7s. Estimated remaining: 11m 51s. Rate: 159.0 symbols/min [2025-09-17T07:32:28.565729] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:28.596306] [DEBUG] [MAIN ] BNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:28.598748] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2609 primary records. [2025-09-17T07:32:28.598861] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-17T07:32:28.599671] [DEBUG] [LOCAL ] BNL: Loaded 46995 existing records from primary storage. [2025-09-17T07:32:28.600489] [INFO ] [MAIN ] BNL: Loaded 46995 primary data records. [2025-09-17T07:32:28.736541] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-09-17T07:32:28.742372] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-17T07:32:28.760229] [INFO ] [MAIN ] Derivative Progress: 290/2172 symbols completed. BNJ took 0.8s. Estimated remaining: 11m 49s. Rate: 159.3 symbols/min [2025-09-17T07:32:28.815554] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:28.952810] [DEBUG] [LOCAL ] BNS: Loaded 51521 existing records from primary storage. [2025-09-17T07:32:28.953131] [INFO ] [MAIN ] BNS: Loaded 51521 primary data records. [2025-09-17T07:32:29.031575] [DEBUG] [LOCAL ] BNT: Loaded 3333 existing records from primary storage. [2025-09-17T07:32:29.049475] [INFO ] [MAIN ] BNT: Loaded 3333 primary data records. [2025-09-17T07:32:29.624445] [DEBUG] [MAIN ] BNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:29.626080] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 46995 primary records. [2025-09-17T07:32:29.626203] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-17T07:32:29.646015] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-09-17T07:32:29.647654] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-17T07:32:29.652047] [INFO ] [MAIN ] Derivative Progress: 291/2172 symbols completed. BNL took 1.4s. Estimated remaining: 11m 52s. Rate: 158.5 symbols/min [2025-09-17T07:32:29.653205] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:29.666429] [DEBUG] [MAIN ] BNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:29.668054] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51521 primary records. [2025-09-17T07:32:29.669018] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-17T07:32:29.699680] [DEBUG] [LOCAL ] BNY: Loaded 7359 existing records from primary storage. [2025-09-17T07:32:29.701409] [INFO ] [MAIN ] BNY: Loaded 7359 primary data records. [2025-09-17T07:32:29.700608] [DEBUG] [MAIN ] BNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:29.702254] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3333 primary records. [2025-09-17T07:32:29.723371] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-17T07:32:29.790750] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-09-17T07:32:29.818372] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-17T07:32:29.822019] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-09-17T07:32:29.824406] [INFO ] [MAIN ] Derivative Progress: 292/2172 symbols completed. BNS took 1.3s. Estimated remaining: 11m 50s. Rate: 158.8 symbols/min [2025-09-17T07:32:29.824784] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:29.835575] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-17T07:32:29.843357] [INFO ] [MAIN ] Derivative Progress: 293/2172 symbols completed. BNT took 1.1s. Estimated remaining: 11m 48s. Rate: 159.3 symbols/min [2025-09-17T07:32:29.854136] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:30.036060] [DEBUG] [LOCAL ] BOC: Loaded 18393 existing records from primary storage. [2025-09-17T07:32:30.036765] [INFO ] [MAIN ] BOC: Loaded 18393 primary data records. [2025-09-17T07:32:30.154245] [DEBUG] [LOCAL ] BOE: Loaded 17559 existing records from primary storage. [2025-09-17T07:32:30.170485] [INFO ] [MAIN ] BOE: Loaded 17559 primary data records. [2025-09-17T07:32:30.663899] [DEBUG] [MAIN ] BNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:30.665831] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7359 primary records. [2025-09-17T07:32:30.666300] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-17T07:32:30.685572] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-09-17T07:32:30.686358] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-17T07:32:30.691015] [INFO ] [MAIN ] Derivative Progress: 294/2172 symbols completed. BNY took 1.0s. Estimated remaining: 11m 50s. Rate: 158.7 symbols/min [2025-09-17T07:32:30.691603] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:30.706202] [DEBUG] [MAIN ] BOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:30.707229] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18393 primary records. [2025-09-17T07:32:30.707791] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-17T07:32:30.726899] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-09-17T07:32:30.729197] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-17T07:32:30.731889] [INFO ] [MAIN ] Derivative Progress: 295/2172 symbols completed. BOC took 0.9s. Estimated remaining: 11m 48s. Rate: 159.1 symbols/min [2025-09-17T07:32:30.732516] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:30.754105] [DEBUG] [MAIN ] BOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:30.756735] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 17559 primary records. [2025-09-17T07:32:30.756966] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-17T07:32:30.786806] [DEBUG] [LOCAL ] BOH: Loaded 31453 existing records from primary storage. [2025-09-17T07:32:30.787992] [INFO ] [MAIN ] BOH: Loaded 31453 primary data records. [2025-09-17T07:32:30.879973] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-09-17T07:32:30.919801] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-17T07:32:30.923464] [INFO ] [MAIN ] Derivative Progress: 296/2172 symbols completed. BOE took 1.1s. Estimated remaining: 11m 46s. Rate: 159.4 symbols/min [2025-09-17T07:32:30.924765] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:30.924429] [DEBUG] [LOCAL ] BOND: Loaded 32137 existing records from primary storage. [2025-09-17T07:32:30.935936] [INFO ] [MAIN ] BOND: Loaded 32137 primary data records. [2025-09-17T07:32:31.413996] [DEBUG] [LOCAL ] BOOT: Loaded 41539 existing records from primary storage. [2025-09-17T07:32:31.517752] [INFO ] [MAIN ] BOOT: Loaded 41539 primary data records. [2025-09-17T07:32:31.820576] [DEBUG] [MAIN ] BOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:31.832305] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 31453 primary records. [2025-09-17T07:32:31.832828] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-17T07:32:31.854817] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-09-17T07:32:31.867496] [DEBUG] [MAIN ] BOND: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:32:31.867126] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-17T07:32:31.869788] [INFO ] [MAIN ] Derivative Progress: 297/2172 symbols completed. BOH took 1.2s. Estimated remaining: 11m 49s. Rate: 158.6 symbols/min [2025-09-17T07:32:31.870177] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:31.870839] [INFO ] [MAIN ] BOND: Generated 1793 derivative records from 32137 primary records. [2025-09-17T07:32:31.871850] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-17T07:32:31.890034] [DEBUG] [LOCAL ] BOND: Derivative data saved (1793 records). [2025-09-17T07:32:31.890471] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-17T07:32:31.892655] [INFO ] [MAIN ] Derivative Progress: 298/2172 symbols completed. BOND took 1.2s. Estimated remaining: 11m 47s. Rate: 159.1 symbols/min [2025-09-17T07:32:31.908835] [DEBUG] [MAIN ] BOOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:31.909551] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 41539 primary records. [2025-09-17T07:32:31.909660] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-17T07:32:31.938891] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-09-17T07:32:31.939060] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-17T07:32:31.941849] [INFO ] [MAIN ] Derivative Progress: 299/2172 symbols completed. BOOT took 1.0s. Estimated remaining: 11m 44s. Rate: 159.6 symbols/min [2025-09-17T07:32:31.960668] [DEBUG] [LOCAL ] BORR: Loaded 51200 existing records from primary storage. [2025-09-17T07:32:31.960835] [INFO ] [MAIN ] BORR: Loaded 51200 primary data records. [2025-09-17T07:32:32.267966] [DEBUG] [MAIN ] BORR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:32.268784] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51200 primary records. [2025-09-17T07:32:32.268866] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-17T07:32:32.284204] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-09-17T07:32:32.284282] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-17T07:32:32.286835] [INFO ] [MAIN ] Derivative Progress: 300/2172 symbols completed. BORR took 0.4s. Estimated remaining: 11m 44s. Rate: 159.6 symbols/min [2025-09-17T07:32:32.287414] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:32.287751] [INFO ] [MAIN ] BP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:32.287634] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:32.328276] [DEBUG] [LOCAL ] BOW: Loaded 23758 existing records from primary storage. [2025-09-17T07:32:32.328457] [INFO ] [MAIN ] BOW: Loaded 23758 primary data records. [2025-09-17T07:32:32.465121] [DEBUG] [LOCAL ] BOX: Loaded 50349 existing records from primary storage. [2025-09-17T07:32:32.466105] [INFO ] [MAIN ] BOX: Loaded 50349 primary data records. [2025-09-17T07:32:32.561383] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-17T07:32:32.617690] [INFO ] [MAIN ] BP: Loaded 53711 primary data records. [2025-09-17T07:32:33.320492] [DEBUG] [MAIN ] BOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:33.321588] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23758 primary records. [2025-09-17T07:32:33.321954] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-17T07:32:33.340636] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-09-17T07:32:33.341740] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-17T07:32:33.356757] [INFO ] [MAIN ] Derivative Progress: 301/2172 symbols completed. BOW took 1.1s. Estimated remaining: 11m 48s. Rate: 158.6 symbols/min [2025-09-17T07:32:33.358030] [DEBUG] [MAIN ] BOX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:33.358490] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:33.359182] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50349 primary records. [2025-09-17T07:32:33.359323] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-17T07:32:33.372834] [DEBUG] [MAIN ] BP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:33.373823] [INFO ] [MAIN ] BP: Generated 1794 derivative records from 53711 primary records. [2025-09-17T07:32:33.382403] [DEBUG] [LOCAL ] BP: Saving derivative data. [2025-09-17T07:32:33.401515] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-09-17T07:32:33.403813] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-17T07:32:33.406313] [INFO ] [MAIN ] Derivative Progress: 302/2172 symbols completed. BOX took 1.1s. Estimated remaining: 11m 45s. Rate: 159.1 symbols/min [2025-09-17T07:32:33.406909] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:33.408625] [DEBUG] [LOCAL ] BP: Derivative data saved (1794 records). [2025-09-17T07:32:33.409077] [INFO ] [MAIN ] BP: Successfully saved derivative data. [2025-09-17T07:32:33.412057] [INFO ] [MAIN ] Derivative Progress: 303/2172 symbols completed. BP took 1.1s. Estimated remaining: 11m 43s. Rate: 159.6 symbols/min [2025-09-17T07:32:33.412635] [INFO ] [MAIN ] BRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:33.442148] [DEBUG] [LOCAL ] BR: Loaded 34763 existing records from primary storage. [2025-09-17T07:32:33.442407] [INFO ] [MAIN ] BR: Loaded 34763 primary data records. [2025-09-17T07:32:33.573776] [DEBUG] [LOCAL ] BRC: Loaded 19870 existing records from primary storage. [2025-09-17T07:32:33.589570] [INFO ] [MAIN ] BRC: Loaded 19870 primary data records. [2025-09-17T07:32:33.897465] [DEBUG] [LOCAL ] BRBR: Loaded 51173 existing records from primary storage. [2025-09-17T07:32:33.898352] [INFO ] [MAIN ] BRBR: Loaded 51173 primary data records. [2025-09-17T07:32:34.420162] [DEBUG] [MAIN ] BR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:34.421293] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34763 primary records. [2025-09-17T07:32:34.422332] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-17T07:32:34.454366] [DEBUG] [MAIN ] BRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:34.453954] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-09-17T07:32:34.455738] [INFO ] [MAIN ] BRC: Generated 1794 derivative records from 19870 primary records. [2025-09-17T07:32:34.455805] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-17T07:32:34.455913] [DEBUG] [LOCAL ] BRC: Saving derivative data. [2025-09-17T07:32:34.458276] [INFO ] [MAIN ] Derivative Progress: 304/2172 symbols completed. BR took 1.1s. Estimated remaining: 11m 46s. Rate: 158.7 symbols/min [2025-09-17T07:32:34.461661] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:34.488373] [DEBUG] [MAIN ] BRBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:34.490881] [DEBUG] [LOCAL ] BRC: Derivative data saved (1794 records). [2025-09-17T07:32:34.491074] [INFO ] [MAIN ] BRC: Successfully saved derivative data. [2025-09-17T07:32:34.493534] [INFO ] [MAIN ] Derivative Progress: 305/2172 symbols completed. BRC took 1.1s. Estimated remaining: 11m 44s. Rate: 159.1 symbols/min [2025-09-17T07:32:34.494747] [INFO ] [MAIN ] BRFS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:34.494508] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51173 primary records. [2025-09-17T07:32:34.494964] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-17T07:32:34.512258] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-09-17T07:32:34.512472] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-17T07:32:34.514702] [INFO ] [MAIN ] Derivative Progress: 306/2172 symbols completed. BRBR took 1.1s. Estimated remaining: 11m 41s. Rate: 159.6 symbols/min [2025-09-17T07:32:34.515104] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:34.556364] [DEBUG] [LOCAL ] BRCC: Loaded 40368 existing records from primary storage. [2025-09-17T07:32:34.556708] [INFO ] [MAIN ] BRCC: Loaded 40368 primary data records. [2025-09-17T07:32:34.687829] [DEBUG] [LOCAL ] BRFS: Loaded 41078 existing records from primary storage. [2025-09-17T07:32:34.693764] [INFO ] [MAIN ] BRFS: Loaded 41078 primary data records. [2025-09-17T07:32:34.862046] [DEBUG] [LOCAL ] BRO: Loaded 51909 existing records from primary storage. [2025-09-17T07:32:35.003902] [INFO ] [MAIN ] BRO: Loaded 51909 primary data records. [2025-09-17T07:32:35.546983] [DEBUG] [MAIN ] BRCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:35.548569] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40368 primary records. [2025-09-17T07:32:35.549291] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-17T07:32:35.570081] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-09-17T07:32:35.570605] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-17T07:32:35.585781] [INFO ] [MAIN ] Derivative Progress: 307/2172 symbols completed. BRCC took 1.1s. Estimated remaining: 11m 45s. Rate: 158.7 symbols/min [2025-09-17T07:32:35.583689] [DEBUG] [MAIN ] BRFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:35.586037] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:35.586996] [INFO ] [MAIN ] BRFS: Generated 1794 derivative records from 41078 primary records. [2025-09-17T07:32:35.587675] [DEBUG] [LOCAL ] BRFS: Saving derivative data. [2025-09-17T07:32:35.618974] [DEBUG] [MAIN ] BRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:35.620273] [DEBUG] [LOCAL ] BRFS: Derivative data saved (1794 records). [2025-09-17T07:32:35.621090] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 51909 primary records. [2025-09-17T07:32:35.621258] [INFO ] [MAIN ] BRFS: Successfully saved derivative data. [2025-09-17T07:32:35.621314] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-17T07:32:35.624245] [INFO ] [MAIN ] Derivative Progress: 308/2172 symbols completed. BRFS took 1.1s. Estimated remaining: 11m 43s. Rate: 159.1 symbols/min [2025-09-17T07:32:35.624764] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:35.641192] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-09-17T07:32:35.641381] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-17T07:32:35.645824] [INFO ] [MAIN ] Derivative Progress: 309/2172 symbols completed. BRO took 1.1s. Estimated remaining: 11m 40s. Rate: 159.6 symbols/min [2025-09-17T07:32:35.646286] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:35.666290] [DEBUG] [LOCAL ] BRT: Loaded 4783 existing records from primary storage. [2025-09-17T07:32:35.666518] [INFO ] [MAIN ] BRT: Loaded 4783 primary data records. [2025-09-17T07:32:35.792199] [DEBUG] [LOCAL ] BROS: Loaded 53282 existing records from primary storage. [2025-09-17T07:32:35.803019] [INFO ] [MAIN ] BROS: Loaded 53282 primary data records. [2025-09-17T07:32:36.046890] [DEBUG] [LOCAL ] BRSP: Loaded 36992 existing records from primary storage. [2025-09-17T07:32:36.089713] [INFO ] [MAIN ] BRSP: Loaded 36992 primary data records. [2025-09-17T07:32:36.590685] [DEBUG] [MAIN ] BRT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:32:36.591610] [INFO ] [MAIN ] BRT: Generated 1793 derivative records from 4783 primary records. [2025-09-17T07:32:36.594455] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-17T07:32:36.618597] [DEBUG] [MAIN ] BROS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:36.620110] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53282 primary records. [2025-09-17T07:32:36.620694] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-17T07:32:36.636482] [DEBUG] [LOCAL ] BRT: Derivative data saved (1793 records). [2025-09-17T07:32:36.640098] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-17T07:32:36.640165] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-09-17T07:32:36.643205] [INFO ] [MAIN ] Derivative Progress: 310/2172 symbols completed. BRT took 1.0s. Estimated remaining: 11m 44s. Rate: 158.8 symbols/min [2025-09-17T07:32:36.644108] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-17T07:32:36.647131] [INFO ] [MAIN ] Derivative Progress: 311/2172 symbols completed. BROS took 1.1s. Estimated remaining: 11m 41s. Rate: 159.3 symbols/min [2025-09-17T07:32:36.659953] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:36.660020] [INFO ] [MAIN ] BRX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:36.660466] [DEBUG] [MAIN ] BRSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:36.661609] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36992 primary records. [2025-09-17T07:32:36.661898] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-17T07:32:36.684898] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-09-17T07:32:36.691398] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-17T07:32:36.695337] [DEBUG] [LOCAL ] BRW: Loaded 18882 existing records from primary storage. [2025-09-17T07:32:36.694420] [INFO ] [MAIN ] Derivative Progress: 312/2172 symbols completed. BRSP took 1.1s. Estimated remaining: 11m 39s. Rate: 159.7 symbols/min [2025-09-17T07:32:36.695806] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:36.695588] [INFO ] [MAIN ] BRW: Loaded 18882 primary data records. [2025-09-17T07:32:37.030802] [DEBUG] [LOCAL ] BRX: Loaded 51877 existing records from primary storage. [2025-09-17T07:32:37.031143] [INFO ] [MAIN ] BRX: Loaded 51877 primary data records. [2025-09-17T07:32:37.031556] [DEBUG] [LOCAL ] BSAC: Loaded 33089 existing records from primary storage. [2025-09-17T07:32:37.031712] [INFO ] [MAIN ] BSAC: Loaded 33089 primary data records. [2025-09-17T07:32:37.707461] [DEBUG] [MAIN ] BRW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:37.709757] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 18882 primary records. [2025-09-17T07:32:37.710080] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-17T07:32:37.728811] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-09-17T07:32:37.729335] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-17T07:32:37.731617] [INFO ] [MAIN ] Derivative Progress: 313/2172 symbols completed. BRW took 1.1s. Estimated remaining: 11m 42s. Rate: 158.9 symbols/min [2025-09-17T07:32:37.747615] [DEBUG] [MAIN ] BRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:37.749314] [INFO ] [MAIN ] BRX: Generated 1794 derivative records from 51877 primary records. [2025-09-17T07:32:37.749514] [DEBUG] [LOCAL ] BRX: Saving derivative data. [2025-09-17T07:32:37.769896] [DEBUG] [MAIN ] BSAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:37.773977] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 33089 primary records. [2025-09-17T07:32:37.775717] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-17T07:32:37.786415] [DEBUG] [LOCAL ] BRX: Derivative data saved (1794 records). [2025-09-17T07:32:37.788974] [INFO ] [MAIN ] BRX: Successfully saved derivative data. [2025-09-17T07:32:37.792355] [INFO ] [MAIN ] Derivative Progress: 314/2172 symbols completed. BRX took 1.1s. Estimated remaining: 11m 40s. Rate: 159.3 symbols/min [2025-09-17T07:32:37.795666] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-09-17T07:32:37.795741] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-17T07:32:37.798351] [INFO ] [MAIN ] Derivative Progress: 315/2172 symbols completed. BSAC took 1.1s. Estimated remaining: 11m 37s. Rate: 159.8 symbols/min [2025-09-17T07:32:37.799094] [INFO ] [MAIN ] BSBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:37.799180] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:37.799255] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:37.810626] [DEBUG] [LOCAL ] BSL: Loaded 8201 existing records from primary storage. [2025-09-17T07:32:37.810794] [INFO ] [MAIN ] BSL: Loaded 8201 primary data records. [2025-09-17T07:32:38.020227] [DEBUG] [LOCAL ] BSBR: Loaded 35023 existing records from primary storage. [2025-09-17T07:32:38.145111] [INFO ] [MAIN ] BSBR: Loaded 35023 primary data records. [2025-09-17T07:32:38.145905] [DEBUG] [LOCAL ] BSM: Loaded 32621 existing records from primary storage. [2025-09-17T07:32:38.157908] [INFO ] [MAIN ] BSM: Loaded 32621 primary data records. [2025-09-17T07:32:38.799633] [DEBUG] [MAIN ] BSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:38.801520] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 8201 primary records. [2025-09-17T07:32:38.802196] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-17T07:32:38.823354] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-09-17T07:32:38.823938] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-17T07:32:38.826500] [INFO ] [MAIN ] Derivative Progress: 316/2172 symbols completed. BSL took 1.0s. Estimated remaining: 11m 41s. Rate: 158.9 symbols/min [2025-09-17T07:32:38.827354] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:38.848730] [DEBUG] [MAIN ] BSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:38.849690] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32621 primary records. [2025-09-17T07:32:38.849966] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-17T07:32:38.862816] [DEBUG] [MAIN ] BSBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:38.876885] [INFO ] [MAIN ] BSBR: Generated 1794 derivative records from 35023 primary records. [2025-09-17T07:32:38.881197] [DEBUG] [LOCAL ] BSBR: Saving derivative data. [2025-09-17T07:32:38.907761] [DEBUG] [LOCAL ] BST: Loaded 19513 existing records from primary storage. [2025-09-17T07:32:38.908840] [INFO ] [MAIN ] BST: Loaded 19513 primary data records. [2025-09-17T07:32:38.907265] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-09-17T07:32:38.920910] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-17T07:32:38.940969] [DEBUG] [LOCAL ] BSBR: Derivative data saved (1794 records). [2025-09-17T07:32:38.961760] [INFO ] [MAIN ] Derivative Progress: 317/2172 symbols completed. BSM took 1.2s. Estimated remaining: 11m 39s. Rate: 159.2 symbols/min [2025-09-17T07:32:38.990520] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:38.990354] [INFO ] [MAIN ] BSBR: Successfully saved derivative data. [2025-09-17T07:32:39.004349] [INFO ] [MAIN ] Derivative Progress: 318/2172 symbols completed. BSBR took 1.2s. Estimated remaining: 11m 37s. Rate: 159.7 symbols/min [2025-09-17T07:32:39.025379] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:39.261734] [DEBUG] [LOCAL ] BSTZ: Loaded 25114 existing records from primary storage. [2025-09-17T07:32:39.262197] [INFO ] [MAIN ] BSTZ: Loaded 25114 primary data records. [2025-09-17T07:32:39.599049] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-17T07:32:39.606378] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-09-17T07:32:39.674879] [DEBUG] [MAIN ] BST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:39.707165] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 19513 primary records. [2025-09-17T07:32:39.724076] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-17T07:32:39.820766] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-09-17T07:32:39.939305] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-17T07:32:39.942219] [INFO ] [MAIN ] Derivative Progress: 319/2172 symbols completed. BST took 1.1s. Estimated remaining: 11m 40s. Rate: 158.9 symbols/min [2025-09-17T07:32:39.942718] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:39.962575] [DEBUG] [MAIN ] BSTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:39.966027] [DEBUG] [LOCAL ] BTA: Loaded 5233 existing records from primary storage. [2025-09-17T07:32:39.966764] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 25114 primary records. [2025-09-17T07:32:39.967006] [INFO ] [MAIN ] BTA: Loaded 5233 primary data records. [2025-09-17T07:32:39.979248] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-17T07:32:40.130268] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-09-17T07:32:40.167856] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-17T07:32:40.170568] [INFO ] [MAIN ] Derivative Progress: 320/2172 symbols completed. BSTZ took 1.2s. Estimated remaining: 11m 38s. Rate: 159.1 symbols/min [2025-09-17T07:32:40.288950] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:40.307452] [DEBUG] [MAIN ] BSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:40.309187] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-09-17T07:32:40.309918] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-17T07:32:40.336706] [DEBUG] [LOCAL ] BTCM: Loaded 14034 existing records from primary storage. [2025-09-17T07:32:40.337802] [INFO ] [MAIN ] BTCM: Loaded 14034 primary data records. [2025-09-17T07:32:40.338770] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-09-17T07:32:40.370110] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-17T07:32:40.405178] [INFO ] [MAIN ] Derivative Progress: 321/2172 symbols completed. BSX took 1.4s. Estimated remaining: 11m 37s. Rate: 159.3 symbols/min [2025-09-17T07:32:40.433249] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:40.629922] [DEBUG] [MAIN ] BTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:40.644867] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5233 primary records. [2025-09-17T07:32:40.645226] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-17T07:32:40.677879] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-09-17T07:32:40.678072] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-17T07:32:40.680430] [INFO ] [MAIN ] Derivative Progress: 322/2172 symbols completed. BTA took 0.7s. Estimated remaining: 11m 36s. Rate: 159.4 symbols/min [2025-09-17T07:32:40.680927] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:40.704830] [DEBUG] [LOCAL ] BTE: Loaded 52758 existing records from primary storage. [2025-09-17T07:32:40.717035] [INFO ] [MAIN ] BTE: Loaded 52758 primary data records. [2025-09-17T07:32:40.729757] [DEBUG] [MAIN ] BTCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:40.775526] [INFO ] [MAIN ] BTCM: Generated 1794 derivative records from 14034 primary records. [2025-09-17T07:32:40.806470] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-17T07:32:41.081142] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1794 records). [2025-09-17T07:32:41.091578] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-17T07:32:41.109976] [INFO ] [MAIN ] Derivative Progress: 323/2172 symbols completed. BTCM took 0.8s. Estimated remaining: 11m 36s. Rate: 159.4 symbols/min [2025-09-17T07:32:41.111169] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:41.112526] [DEBUG] [LOCAL ] BTI: Loaded 53552 existing records from primary storage. [2025-09-17T07:32:41.113206] [INFO ] [MAIN ] BTI: Loaded 53552 primary data records. [2025-09-17T07:32:41.226866] [DEBUG] [LOCAL ] BTO: Loaded 9032 existing records from primary storage. [2025-09-17T07:32:41.243630] [INFO ] [MAIN ] BTO: Loaded 9032 primary data records. [2025-09-17T07:32:41.618458] [DEBUG] [MAIN ] BTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:41.725281] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52758 primary records. [2025-09-17T07:32:41.741928] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-17T07:32:41.766080] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-09-17T07:32:41.768212] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-17T07:32:41.770701] [INFO ] [MAIN ] Derivative Progress: 324/2172 symbols completed. BTE took 1.3s. Estimated remaining: 11m 37s. Rate: 159.0 symbols/min [2025-09-17T07:32:41.779428] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:41.784823] [DEBUG] [MAIN ] BTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:41.786070] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53552 primary records. [2025-09-17T07:32:41.786730] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-17T07:32:41.811196] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-09-17T07:32:41.812566] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-17T07:32:41.815222] [INFO ] [MAIN ] Derivative Progress: 325/2172 symbols completed. BTI took 1.1s. Estimated remaining: 11m 35s. Rate: 159.4 symbols/min [2025-09-17T07:32:41.815726] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:41.836498] [DEBUG] [LOCAL ] BTT: Loaded 16117 existing records from primary storage. [2025-09-17T07:32:41.836427] [DEBUG] [MAIN ] BTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:41.837326] [INFO ] [MAIN ] BTT: Loaded 16117 primary data records. [2025-09-17T07:32:41.837247] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 9032 primary records. [2025-09-17T07:32:41.837724] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-17T07:32:41.984843] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-09-17T07:32:42.018455] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-17T07:32:42.067533] [INFO ] [MAIN ] Derivative Progress: 326/2172 symbols completed. BTO took 1.0s. Estimated remaining: 11m 34s. Rate: 159.6 symbols/min [2025-09-17T07:32:42.176808] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:42.198774] [DEBUG] [LOCAL ] BTU: Loaded 53303 existing records from primary storage. [2025-09-17T07:32:42.199288] [INFO ] [MAIN ] BTU: Loaded 53303 primary data records. [2025-09-17T07:32:42.390200] [DEBUG] [LOCAL ] BTZ: Loaded 23121 existing records from primary storage. [2025-09-17T07:32:42.398577] [INFO ] [MAIN ] BTZ: Loaded 23121 primary data records. [2025-09-17T07:32:42.669483] [DEBUG] [MAIN ] BTT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:42.709752] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 16117 primary records. [2025-09-17T07:32:42.743837] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-17T07:32:42.879542] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-09-17T07:32:42.880208] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-17T07:32:42.884274] [INFO ] [MAIN ] Derivative Progress: 327/2172 symbols completed. BTT took 1.1s. Estimated remaining: 11m 36s. Rate: 159.0 symbols/min [2025-09-17T07:32:42.885889] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:42.900052] [DEBUG] [MAIN ] BTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:42.902167] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53303 primary records. [2025-09-17T07:32:42.902426] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-17T07:32:42.920607] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-09-17T07:32:42.921607] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-17T07:32:42.924504] [INFO ] [MAIN ] Derivative Progress: 328/2172 symbols completed. BTU took 1.1s. Estimated remaining: 11m 34s. Rate: 159.5 symbols/min [2025-09-17T07:32:42.938189] [DEBUG] [MAIN ] BTZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:42.938841] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 23121 primary records. [2025-09-17T07:32:42.938922] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-17T07:32:42.968110] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-09-17T07:32:42.968253] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-17T07:32:42.970570] [INFO ] [MAIN ] Derivative Progress: 329/2172 symbols completed. BTZ took 0.8s. Estimated remaining: 11m 32s. Rate: 159.9 symbols/min [2025-09-17T07:32:42.988181] [DEBUG] [LOCAL ] BUD: Loaded 52767 existing records from primary storage. [2025-09-17T07:32:42.988390] [INFO ] [MAIN ] BUD: Loaded 52767 primary data records. [2025-09-17T07:32:43.316596] [DEBUG] [MAIN ] BUD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:43.317272] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52767 primary records. [2025-09-17T07:32:43.317347] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-17T07:32:43.332790] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-09-17T07:32:43.332862] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-17T07:32:43.335221] [INFO ] [MAIN ] Derivative Progress: 330/2172 symbols completed. BUD took 0.5s. Estimated remaining: 11m 31s. Rate: 159.9 symbols/min [2025-09-17T07:32:43.335942] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:43.336514] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:43.336103] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:43.352430] [DEBUG] [LOCAL ] BUI: Loaded 11424 existing records from primary storage. [2025-09-17T07:32:43.352619] [INFO ] [MAIN ] BUI: Loaded 11424 primary data records. [2025-09-17T07:32:43.690870] [DEBUG] [LOCAL ] BUR: Loaded 45181 existing records from primary storage. [2025-09-17T07:32:43.691737] [DEBUG] [LOCAL ] BURL: Loaded 46558 existing records from primary storage. [2025-09-17T07:32:43.692072] [INFO ] [MAIN ] BUR: Loaded 45181 primary data records. [2025-09-17T07:32:43.692152] [INFO ] [MAIN ] BURL: Loaded 46558 primary data records. [2025-09-17T07:32:44.329311] [DEBUG] [MAIN ] BUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:44.330790] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11424 primary records. [2025-09-17T07:32:44.331519] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-17T07:32:44.353744] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-09-17T07:32:44.354115] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-17T07:32:44.357135] [INFO ] [MAIN ] Derivative Progress: 331/2172 symbols completed. BUI took 1.0s. Estimated remaining: 11m 34s. Rate: 159.1 symbols/min [2025-09-17T07:32:44.358534] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:44.377966] [DEBUG] [MAIN ] BUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:44.390840] [DEBUG] [MAIN ] BURL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:44.395794] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45181 primary records. [2025-09-17T07:32:44.396388] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 46558 primary records. [2025-09-17T07:32:44.396554] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-17T07:32:44.397548] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-17T07:32:44.424666] [DEBUG] [LOCAL ] BUXX: Loaded 15255 existing records from primary storage. [2025-09-17T07:32:44.428009] [INFO ] [MAIN ] BUXX: Loaded 15255 primary data records. [2025-09-17T07:32:44.542802] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-09-17T07:32:44.531340] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-09-17T07:32:44.542986] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-17T07:32:44.543335] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-17T07:32:44.561026] [INFO ] [MAIN ] Derivative Progress: 332/2172 symbols completed. BURL took 1.2s. Estimated remaining: 11m 33s. Rate: 159.3 symbols/min [2025-09-17T07:32:44.589990] [INFO ] [MAIN ] Derivative Progress: 333/2172 symbols completed. BUR took 1.3s. Estimated remaining: 11m 31s. Rate: 159.7 symbols/min [2025-09-17T07:32:44.589906] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:44.593757] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:44.806979] [DEBUG] [LOCAL ] BV: Loaded 38711 existing records from primary storage. [2025-09-17T07:32:44.807895] [INFO ] [MAIN ] BV: Loaded 38711 primary data records. [2025-09-17T07:32:44.807280] [DEBUG] [MAIN ] BUXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:44.808756] [INFO ] [MAIN ] BUXX: Generated 1794 derivative records from 15255 primary records. [2025-09-17T07:32:44.844305] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-17T07:32:44.905166] [DEBUG] [LOCAL ] BVN: Loaded 43450 existing records from primary storage. [2025-09-17T07:32:44.924488] [INFO ] [MAIN ] BVN: Loaded 43450 primary data records. [2025-09-17T07:32:45.283717] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1794 records). [2025-09-17T07:32:45.289756] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-17T07:32:45.302673] [INFO ] [MAIN ] Derivative Progress: 334/2172 symbols completed. BUXX took 0.9s. Estimated remaining: 11m 32s. Rate: 159.3 symbols/min [2025-09-17T07:32:45.361764] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:45.510608] [DEBUG] [MAIN ] BV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:45.520558] [INFO ] [MAIN ] BV: Generated 1794 derivative records from 38711 primary records. [2025-09-17T07:32:45.520744] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-17T07:32:45.547246] [DEBUG] [LOCAL ] BV: Derivative data saved (1794 records). [2025-09-17T07:32:45.563991] [DEBUG] [LOCAL ] BW: Loaded 39416 existing records from primary storage. [2025-09-17T07:32:45.564168] [DEBUG] [MAIN ] BVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:45.563011] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-17T07:32:45.567002] [INFO ] [MAIN ] Derivative Progress: 335/2172 symbols completed. BV took 1.0s. Estimated remaining: 11m 31s. Rate: 159.4 symbols/min [2025-09-17T07:32:45.564323] [INFO ] [MAIN ] BW: Loaded 39416 primary data records. [2025-09-17T07:32:45.564983] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 43450 primary records. [2025-09-17T07:32:45.567265] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:45.588523] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-17T07:32:45.890456] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-09-17T07:32:45.890678] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-17T07:32:45.893081] [INFO ] [MAIN ] Derivative Progress: 336/2172 symbols completed. BVN took 1.3s. Estimated remaining: 11m 31s. Rate: 159.5 symbols/min [2025-09-17T07:32:45.893583] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:45.919719] [DEBUG] [LOCAL ] BWA: Loaded 52277 existing records from primary storage. [2025-09-17T07:32:45.920301] [INFO ] [MAIN ] BWA: Loaded 52277 primary data records. [2025-09-17T07:32:45.962751] [DEBUG] [LOCAL ] BWG: Loaded 12291 existing records from primary storage. [2025-09-17T07:32:45.992289] [INFO ] [MAIN ] BWG: Loaded 12291 primary data records. [2025-09-17T07:32:46.195827] [DEBUG] [MAIN ] BW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:46.240348] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 39416 primary records. [2025-09-17T07:32:46.416882] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-17T07:32:46.552508] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-09-17T07:32:46.553286] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-17T07:32:46.556339] [INFO ] [MAIN ] Derivative Progress: 337/2172 symbols completed. BW took 1.2s. Estimated remaining: 11m 32s. Rate: 159.2 symbols/min [2025-09-17T07:32:46.556799] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:46.582775] [DEBUG] [MAIN ] BWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:46.591860] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12291 primary records. [2025-09-17T07:32:46.598351] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-17T07:32:46.619122] [DEBUG] [MAIN ] BWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:46.620846] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52277 primary records. [2025-09-17T07:32:46.622761] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-17T07:32:46.646921] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-09-17T07:32:46.647262] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-17T07:32:46.650228] [INFO ] [MAIN ] Derivative Progress: 338/2172 symbols completed. BWG took 0.8s. Estimated remaining: 11m 30s. Rate: 159.5 symbols/min [2025-09-17T07:32:46.651168] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:46.651828] [DEBUG] [LOCAL ] BWLP: Loaded 33066 existing records from primary storage. [2025-09-17T07:32:46.655108] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-09-17T07:32:46.655185] [INFO ] [MAIN ] BWLP: Loaded 33066 primary data records. [2025-09-17T07:32:46.655322] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-17T07:32:46.657492] [INFO ] [MAIN ] Derivative Progress: 339/2172 symbols completed. BWA took 1.1s. Estimated remaining: 11m 28s. Rate: 160.0 symbols/min [2025-09-17T07:32:46.695994] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:46.757700] [DEBUG] [LOCAL ] BWMX: Loaded 7551 existing records from primary storage. [2025-09-17T07:32:46.757840] [INFO ] [MAIN ] BWMX: Loaded 7551 primary data records. [2025-09-17T07:32:46.904772] [DEBUG] [LOCAL ] BWNB: Loaded 4520 existing records from primary storage. [2025-09-17T07:32:46.943728] [INFO ] [MAIN ] BWNB: Loaded 4520 primary data records. [2025-09-17T07:32:47.667794] [DEBUG] [MAIN ] BWLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:47.672796] [DEBUG] [MAIN ] BWMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:47.673404] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 33066 primary records. [2025-09-17T07:32:47.673985] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7551 primary records. [2025-09-17T07:32:47.674131] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-17T07:32:47.674224] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-17T07:32:47.706102] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-09-17T07:32:47.707692] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-17T07:32:47.707607] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-09-17T07:32:47.707910] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-17T07:32:47.710590] [INFO ] [MAIN ] Derivative Progress: 340/2172 symbols completed. BWMX took 1.1s. Estimated remaining: 11m 31s. Rate: 159.1 symbols/min [2025-09-17T07:32:47.725792] [INFO ] [MAIN ] Derivative Progress: 341/2172 symbols completed. BWLP took 1.2s. Estimated remaining: 11m 28s. Rate: 159.6 symbols/min [2025-09-17T07:32:47.725375] [INFO ] [MAIN ] BWSN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:47.725996] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:47.725673] [DEBUG] [MAIN ] BWNB: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:32:47.727001] [INFO ] [MAIN ] BWNB: Generated 1793 derivative records from 4520 primary records. [2025-09-17T07:32:47.727188] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-17T07:32:47.745205] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1793 records). [2025-09-17T07:32:47.745442] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-17T07:32:47.747845] [INFO ] [MAIN ] Derivative Progress: 342/2172 symbols completed. BWNB took 1.1s. Estimated remaining: 11m 26s. Rate: 160.0 symbols/min [2025-09-17T07:32:47.748181] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:47.752113] [DEBUG] [LOCAL ] BWSN: Loaded 5150 existing records from primary storage. [2025-09-17T07:32:47.752331] [INFO ] [MAIN ] BWSN: Loaded 5150 primary data records. [2025-09-17T07:32:48.072941] [DEBUG] [LOCAL ] BWXT: Loaded 46628 existing records from primary storage. [2025-09-17T07:32:48.073141] [INFO ] [MAIN ] BWXT: Loaded 46628 primary data records. [2025-09-17T07:32:48.240889] [DEBUG] [LOCAL ] BX: Loaded 53502 existing records from primary storage. [2025-09-17T07:32:48.291358] [INFO ] [MAIN ] BX: Loaded 53502 primary data records. [2025-09-17T07:32:48.610006] [DEBUG] [MAIN ] BWSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:48.774788] [INFO ] [MAIN ] BWSN: Generated 1794 derivative records from 5150 primary records. [2025-09-17T07:32:48.776141] [DEBUG] [LOCAL ] BWSN: Saving derivative data. [2025-09-17T07:32:48.792409] [DEBUG] [LOCAL ] BWSN: Derivative data saved (1794 records). [2025-09-17T07:32:48.792860] [INFO ] [MAIN ] BWSN: Successfully saved derivative data. [2025-09-17T07:32:48.795405] [INFO ] [MAIN ] Derivative Progress: 343/2172 symbols completed. BWSN took 1.1s. Estimated remaining: 11m 29s. Rate: 159.2 symbols/min [2025-09-17T07:32:48.815547] [DEBUG] [MAIN ] BWXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:48.816210] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 46628 primary records. [2025-09-17T07:32:48.816675] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-17T07:32:48.834957] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-09-17T07:32:48.835244] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-17T07:32:48.837288] [INFO ] [MAIN ] Derivative Progress: 344/2172 symbols completed. BWXT took 1.1s. Estimated remaining: 11m 27s. Rate: 159.6 symbols/min [2025-09-17T07:32:48.852580] [DEBUG] [MAIN ] BX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:48.853160] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53502 primary records. [2025-09-17T07:32:48.853233] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-17T07:32:48.868982] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-09-17T07:32:48.869082] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-17T07:32:48.871203] [INFO ] [MAIN ] Derivative Progress: 345/2172 symbols completed. BX took 1.1s. Estimated remaining: 11m 25s. Rate: 160.0 symbols/min [2025-09-17T07:32:48.871659] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:48.872248] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:48.872437] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:48.891763] [DEBUG] [LOCAL ] BXC: Loaded 13555 existing records from primary storage. [2025-09-17T07:32:48.891982] [INFO ] [MAIN ] BXC: Loaded 13555 primary data records. [2025-09-17T07:32:48.976128] [DEBUG] [LOCAL ] BXMX: Loaded 19672 existing records from primary storage. [2025-09-17T07:32:49.000605] [INFO ] [MAIN ] BXMX: Loaded 19672 primary data records. [2025-09-17T07:32:49.293847] [DEBUG] [LOCAL ] BXMT: Loaded 47249 existing records from primary storage. [2025-09-17T07:32:49.311738] [INFO ] [MAIN ] BXMT: Loaded 47249 primary data records. [2025-09-17T07:32:49.862331] [DEBUG] [MAIN ] BXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:49.863126] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13555 primary records. [2025-09-17T07:32:49.864718] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-17T07:32:49.897552] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-09-17T07:32:49.897873] [DEBUG] [MAIN ] BXMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:49.899342] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19672 primary records. [2025-09-17T07:32:49.900979] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-17T07:32:49.900220] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-17T07:32:49.903365] [INFO ] [MAIN ] Derivative Progress: 346/2172 symbols completed. BXC took 1.0s. Estimated remaining: 11m 28s. Rate: 159.2 symbols/min [2025-09-17T07:32:49.904402] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:49.927163] [DEBUG] [MAIN ] BXMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:49.934145] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-09-17T07:32:49.935242] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-17T07:32:49.935068] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47249 primary records. [2025-09-17T07:32:49.937445] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-17T07:32:49.937369] [INFO ] [MAIN ] Derivative Progress: 347/2172 symbols completed. BXMX took 1.1s. Estimated remaining: 11m 26s. Rate: 159.6 symbols/min [2025-09-17T07:32:49.937912] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:49.956414] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-09-17T07:32:49.956599] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-17T07:32:49.959105] [INFO ] [MAIN ] Derivative Progress: 348/2172 symbols completed. BXMT took 1.1s. Estimated remaining: 11m 24s. Rate: 160.1 symbols/min [2025-09-17T07:32:49.959501] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:49.991464] [DEBUG] [LOCAL ] BY: Loaded 21379 existing records from primary storage. [2025-09-17T07:32:50.001198] [INFO ] [MAIN ] BY: Loaded 21379 primary data records. [2025-09-17T07:32:50.093285] [DEBUG] [LOCAL ] BXP: Loaded 49916 existing records from primary storage. [2025-09-17T07:32:50.134238] [INFO ] [MAIN ] BXP: Loaded 49916 primary data records. [2025-09-17T07:32:50.134867] [DEBUG] [LOCAL ] BXSL: Loaded 47311 existing records from primary storage. [2025-09-17T07:32:50.196007] [INFO ] [MAIN ] BXSL: Loaded 47311 primary data records. [2025-09-17T07:32:50.987033] [DEBUG] [MAIN ] BY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:50.987754] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21379 primary records. [2025-09-17T07:32:50.988197] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-17T07:32:51.005963] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-09-17T07:32:51.006186] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-17T07:32:51.008860] [INFO ] [MAIN ] Derivative Progress: 349/2172 symbols completed. BY took 1.0s. Estimated remaining: 11m 27s. Rate: 159.2 symbols/min [2025-09-17T07:32:51.009056] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:51.047350] [DEBUG] [MAIN ] BXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:51.047769] [DEBUG] [MAIN ] BXSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:51.048817] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 47311 primary records. [2025-09-17T07:32:51.050121] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49916 primary records. [2025-09-17T07:32:51.050262] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-17T07:32:51.050366] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-17T07:32:51.086058] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-09-17T07:32:51.086917] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-17T07:32:51.090761] [INFO ] [MAIN ] Derivative Progress: 350/2172 symbols completed. BXSL took 1.2s. Estimated remaining: 11m 25s. Rate: 159.6 symbols/min [2025-09-17T07:32:51.092003] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:51.091788] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-09-17T07:32:51.092762] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-17T07:32:51.106970] [INFO ] [MAIN ] Derivative Progress: 351/2172 symbols completed. BXP took 1.2s. Estimated remaining: 11m 23s. Rate: 160.0 symbols/min [2025-09-17T07:32:51.107625] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:51.127747] [DEBUG] [LOCAL ] BYD: Loaded 45406 existing records from primary storage. [2025-09-17T07:32:51.127958] [INFO ] [MAIN ] BYD: Loaded 45406 primary data records. [2025-09-17T07:32:51.215843] [DEBUG] [LOCAL ] BYM: Loaded 12284 existing records from primary storage. [2025-09-17T07:32:51.238929] [INFO ] [MAIN ] BYM: Loaded 12284 primary data records. [2025-09-17T07:32:51.419300] [DEBUG] [LOCAL ] BZH: Loaded 32935 existing records from primary storage. [2025-09-17T07:32:51.437564] [INFO ] [MAIN ] BZH: Loaded 32935 primary data records. [2025-09-17T07:32:52.083228] [DEBUG] [MAIN ] BYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:52.085289] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 45406 primary records. [2025-09-17T07:32:52.087050] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-17T07:32:52.117768] [DEBUG] [MAIN ] BYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:52.118919] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 12284 primary records. [2025-09-17T07:32:52.117854] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-09-17T07:32:52.119050] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-17T07:32:52.122085] [INFO ] [MAIN ] Derivative Progress: 352/2172 symbols completed. BYD took 1.1s. Estimated remaining: 11m 26s. Rate: 159.3 symbols/min [2025-09-17T07:32:52.122213] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-17T07:32:52.123968] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:52.157498] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-09-17T07:32:52.157859] [DEBUG] [MAIN ] BZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:52.158876] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32935 primary records. [2025-09-17T07:32:52.158143] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-17T07:32:52.159023] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-17T07:32:52.161343] [INFO ] [MAIN ] Derivative Progress: 353/2172 symbols completed. BYM took 1.1s. Estimated remaining: 11m 24s. Rate: 159.7 symbols/min [2025-09-17T07:32:52.170453] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:52.180046] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-09-17T07:32:52.180189] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-17T07:32:52.182411] [INFO ] [MAIN ] Derivative Progress: 354/2172 symbols completed. BZH took 1.1s. Estimated remaining: 11m 21s. Rate: 160.1 symbols/min [2025-09-17T07:32:52.182774] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:52.219044] [DEBUG] [LOCAL ] CAAP: Loaded 18993 existing records from primary storage. [2025-09-17T07:32:52.219997] [INFO ] [MAIN ] CAAP: Loaded 18993 primary data records. [2025-09-17T07:32:52.311990] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-17T07:32:52.324818] [INFO ] [MAIN ] C: Loaded 53741 primary data records. [2025-09-17T07:32:52.324717] [DEBUG] [LOCAL ] CABO: Loaded 17848 existing records from primary storage. [2025-09-17T07:32:52.331774] [INFO ] [MAIN ] CABO: Loaded 17848 primary data records. [2025-09-17T07:32:53.310354] [DEBUG] [MAIN ] CAAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:53.311892] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 18993 primary records. [2025-09-17T07:32:53.312290] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-17T07:32:53.332253] [DEBUG] [MAIN ] C: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:53.335144] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53741 primary records. [2025-09-17T07:32:53.348963] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-17T07:32:53.353624] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-09-17T07:32:53.381761] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-17T07:32:53.388459] [DEBUG] [MAIN ] CABO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:53.391593] [INFO ] [MAIN ] Derivative Progress: 355/2172 symbols completed. CAAP took 1.2s. Estimated remaining: 11m 25s. Rate: 159.1 symbols/min [2025-09-17T07:32:53.393634] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 17848 primary records. [2025-09-17T07:32:53.398283] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-17T07:32:53.398696] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:53.401773] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-09-17T07:32:53.402053] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-17T07:32:53.417296] [INFO ] [MAIN ] Derivative Progress: 356/2172 symbols completed. C took 1.3s. Estimated remaining: 11m 23s. Rate: 159.5 symbols/min [2025-09-17T07:32:53.427919] [INFO ] [MAIN ] CADE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:53.433587] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-09-17T07:32:53.433927] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-17T07:32:53.436602] [INFO ] [MAIN ] Derivative Progress: 357/2172 symbols completed. CABO took 1.3s. Estimated remaining: 11m 21s. Rate: 159.9 symbols/min [2025-09-17T07:32:53.437316] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:53.471134] [DEBUG] [LOCAL ] CACI: Loaded 26198 existing records from primary storage. [2025-09-17T07:32:53.471845] [INFO ] [MAIN ] CACI: Loaded 26198 primary data records. [2025-09-17T07:32:53.656878] [DEBUG] [LOCAL ] CADE: Loaded 48730 existing records from primary storage. [2025-09-17T07:32:53.705684] [INFO ] [MAIN ] CADE: Loaded 48730 primary data records. [2025-09-17T07:32:53.706724] [DEBUG] [LOCAL ] CAE: Loaded 38936 existing records from primary storage. [2025-09-17T07:32:53.723249] [INFO ] [MAIN ] CAE: Loaded 38936 primary data records. [2025-09-17T07:32:54.745576] [DEBUG] [MAIN ] CACI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:54.746813] [INFO ] [MAIN ] CACI: Generated 1794 derivative records from 26198 primary records. [2025-09-17T07:32:54.747042] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-17T07:32:54.768011] [DEBUG] [LOCAL ] CACI: Derivative data saved (1794 records). [2025-09-17T07:32:54.768434] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-17T07:32:54.795909] [DEBUG] [MAIN ] CADE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:54.796274] [DEBUG] [MAIN ] CAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:54.796930] [INFO ] [MAIN ] CADE: Generated 1794 derivative records from 48730 primary records. [2025-09-17T07:32:54.795438] [INFO ] [MAIN ] Derivative Progress: 358/2172 symbols completed. CACI took 1.4s. Estimated remaining: 11m 26s. Rate: 158.8 symbols/min [2025-09-17T07:32:54.797635] [DEBUG] [LOCAL ] CADE: Saving derivative data. [2025-09-17T07:32:54.797586] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 38936 primary records. [2025-09-17T07:32:54.798546] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-17T07:32:54.828916] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-09-17T07:32:54.829504] [DEBUG] [LOCAL ] CADE: Derivative data saved (1794 records). [2025-09-17T07:32:54.829653] [INFO ] [MAIN ] CADE: Successfully saved derivative data. [2025-09-17T07:32:54.829566] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-17T07:32:54.832255] [INFO ] [MAIN ] Derivative Progress: 359/2172 symbols completed. CADE took 1.4s. Estimated remaining: 11m 23s. Rate: 159.2 symbols/min [2025-09-17T07:32:54.834818] [INFO ] [MAIN ] Derivative Progress: 360/2172 symbols completed. CAE took 1.4s. Estimated remaining: 11m 21s. Rate: 159.6 symbols/min [2025-09-17T07:32:54.835371] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:54.835550] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:54.835510] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:54.846216] [DEBUG] [LOCAL ] CAF: Loaded 3394 existing records from primary storage. [2025-09-17T07:32:54.846419] [INFO ] [MAIN ] CAF: Loaded 3394 primary data records. [2025-09-17T07:32:55.252584] [DEBUG] [LOCAL ] CAH: Loaded 51555 existing records from primary storage. [2025-09-17T07:32:55.253771] [INFO ] [MAIN ] CAH: Loaded 51555 primary data records. [2025-09-17T07:32:55.253509] [DEBUG] [LOCAL ] CAG: Loaded 53658 existing records from primary storage. [2025-09-17T07:32:55.254735] [INFO ] [MAIN ] CAG: Loaded 53658 primary data records. [2025-09-17T07:32:55.848174] [DEBUG] [MAIN ] CAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:55.849664] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3394 primary records. [2025-09-17T07:32:55.849928] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-17T07:32:55.867800] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-09-17T07:32:55.867925] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-17T07:32:55.870400] [INFO ] [MAIN ] Derivative Progress: 361/2172 symbols completed. CAF took 1.0s. Estimated remaining: 11m 24s. Rate: 158.8 symbols/min [2025-09-17T07:32:55.870951] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:55.896147] [DEBUG] [MAIN ] CAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:55.901419] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51555 primary records. [2025-09-17T07:32:55.901858] [DEBUG] [MAIN ] CAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:55.901991] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-17T07:32:55.902920] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53658 primary records. [2025-09-17T07:32:55.903403] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-17T07:32:55.932709] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-09-17T07:32:55.934187] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-17T07:32:55.945887] [INFO ] [MAIN ] Derivative Progress: 362/2172 symbols completed. CAG took 1.1s. Estimated remaining: 11m 22s. Rate: 159.2 symbols/min [2025-09-17T07:32:55.946884] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-09-17T07:32:55.947102] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:55.947200] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-17T07:32:55.949366] [INFO ] [MAIN ] Derivative Progress: 363/2172 symbols completed. CAH took 1.1s. Estimated remaining: 11m 20s. Rate: 159.6 symbols/min [2025-09-17T07:32:55.949803] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:55.965140] [DEBUG] [LOCAL ] CAL: Loaded 43386 existing records from primary storage. [2025-09-17T07:32:55.965316] [INFO ] [MAIN ] CAL: Loaded 43386 primary data records. [2025-09-17T07:32:56.110012] [DEBUG] [LOCAL ] CANG: Loaded 26623 existing records from primary storage. [2025-09-17T07:32:56.163434] [INFO ] [MAIN ] CANG: Loaded 26623 primary data records. [2025-09-17T07:32:56.417677] [DEBUG] [LOCAL ] CALX: Loaded 38851 existing records from primary storage. [2025-09-17T07:32:56.467496] [INFO ] [MAIN ] CALX: Loaded 38851 primary data records. [2025-09-17T07:32:56.911273] [DEBUG] [MAIN ] CAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:56.913521] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 43386 primary records. [2025-09-17T07:32:56.913868] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-17T07:32:56.932193] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-09-17T07:32:56.933143] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-17T07:32:56.936096] [INFO ] [MAIN ] Derivative Progress: 364/2172 symbols completed. CAL took 1.1s. Estimated remaining: 11m 23s. Rate: 158.9 symbols/min [2025-09-17T07:32:56.936674] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:56.950159] [DEBUG] [MAIN ] CANG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:56.951003] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 26623 primary records. [2025-09-17T07:32:56.951169] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-17T07:32:56.970954] [DEBUG] [LOCAL ] CAPL: Loaded 5967 existing records from primary storage. [2025-09-17T07:32:56.972578] [INFO ] [MAIN ] CAPL: Loaded 5967 primary data records. [2025-09-17T07:32:56.972446] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-09-17T07:32:57.009627] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-17T07:32:57.039098] [INFO ] [MAIN ] Derivative Progress: 365/2172 symbols completed. CANG took 1.1s. Estimated remaining: 11m 21s. Rate: 159.2 symbols/min [2025-09-17T07:32:57.086407] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:57.090367] [DEBUG] [MAIN ] CALX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:57.097283] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 38851 primary records. [2025-09-17T07:32:57.132015] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-17T07:32:57.327946] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-09-17T07:32:57.328358] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-17T07:32:57.330934] [INFO ] [MAIN ] Derivative Progress: 366/2172 symbols completed. CALX took 1.4s. Estimated remaining: 11m 20s. Rate: 159.3 symbols/min [2025-09-17T07:32:57.332711] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:57.371349] [DEBUG] [MAIN ] CAPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:57.386384] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5967 primary records. [2025-09-17T07:32:57.386589] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-17T07:32:57.388200] [DEBUG] [LOCAL ] CARR: Loaded 53598 existing records from primary storage. [2025-09-17T07:32:57.388621] [INFO ] [MAIN ] CARR: Loaded 53598 primary data records. [2025-09-17T07:32:57.602991] [DEBUG] [LOCAL ] CARS: Loaded 40574 existing records from primary storage. [2025-09-17T07:32:57.598674] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-09-17T07:32:57.603224] [INFO ] [MAIN ] CARS: Loaded 40574 primary data records. [2025-09-17T07:32:57.713184] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-17T07:32:57.745787] [INFO ] [MAIN ] Derivative Progress: 367/2172 symbols completed. CAPL took 0.8s. Estimated remaining: 11m 20s. Rate: 159.3 symbols/min [2025-09-17T07:32:57.777626] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:58.027325] [DEBUG] [MAIN ] CARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:58.028120] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53598 primary records. [2025-09-17T07:32:58.029069] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-17T07:32:58.045372] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-09-17T07:32:58.045569] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-17T07:32:58.047725] [INFO ] [MAIN ] Derivative Progress: 368/2172 symbols completed. CARR took 1.0s. Estimated remaining: 11m 19s. Rate: 159.4 symbols/min [2025-09-17T07:32:58.061340] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:58.098475] [DEBUG] [LOCAL ] CATO: Loaded 7469 existing records from primary storage. [2025-09-17T07:32:58.080819] [DEBUG] [MAIN ] CARS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:58.098706] [INFO ] [MAIN ] CATO: Loaded 7469 primary data records. [2025-09-17T07:32:58.099455] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 40574 primary records. [2025-09-17T07:32:58.099599] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-17T07:32:58.147892] [DEBUG] [LOCAL ] CAT: Loaded 52929 existing records from primary storage. [2025-09-17T07:32:58.195384] [INFO ] [MAIN ] CAT: Loaded 52929 primary data records. [2025-09-17T07:32:58.406956] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-09-17T07:32:58.410121] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-17T07:32:58.542811] [INFO ] [MAIN ] Derivative Progress: 369/2172 symbols completed. CARS took 1.2s. Estimated remaining: 11m 19s. Rate: 159.2 symbols/min [2025-09-17T07:32:58.598300] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:58.734292] [DEBUG] [MAIN ] CATO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:58.735266] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 7469 primary records. [2025-09-17T07:32:58.735367] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-17T07:32:58.751658] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-09-17T07:32:58.752467] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-17T07:32:58.754591] [INFO ] [MAIN ] Derivative Progress: 370/2172 symbols completed. CATO took 0.7s. Estimated remaining: 11m 18s. Rate: 159.4 symbols/min [2025-09-17T07:32:58.768957] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:58.782969] [DEBUG] [MAIN ] CAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:58.783866] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52929 primary records. [2025-09-17T07:32:58.784054] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-17T07:32:58.800854] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-09-17T07:32:58.814363] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-17T07:32:58.817980] [INFO ] [MAIN ] Derivative Progress: 371/2172 symbols completed. CAT took 1.0s. Estimated remaining: 11m 16s. Rate: 159.8 symbols/min [2025-09-17T07:32:58.818486] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:58.820124] [DEBUG] [LOCAL ] CAVA: Loaded 53553 existing records from primary storage. [2025-09-17T07:32:58.820627] [INFO ] [MAIN ] CAVA: Loaded 53553 primary data records. [2025-09-17T07:32:58.980614] [DEBUG] [LOCAL ] CBAN: Loaded 11184 existing records from primary storage. [2025-09-17T07:32:59.013163] [INFO ] [MAIN ] CBAN: Loaded 11184 primary data records. [2025-09-17T07:32:59.257673] [DEBUG] [LOCAL ] CB: Loaded 50110 existing records from primary storage. [2025-09-17T07:32:59.276157] [INFO ] [MAIN ] CB: Loaded 50110 primary data records. [2025-09-17T07:32:59.787821] [DEBUG] [MAIN ] CAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:59.790289] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53553 primary records. [2025-09-17T07:32:59.791778] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-17T07:32:59.810886] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-09-17T07:32:59.811060] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-17T07:32:59.813002] [INFO ] [MAIN ] Derivative Progress: 372/2172 symbols completed. CAVA took 1.2s. Estimated remaining: 11m 19s. Rate: 159.1 symbols/min [2025-09-17T07:32:59.813625] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:32:59.847246] [DEBUG] [MAIN ] CBAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:59.854535] [DEBUG] [LOCAL ] CBL: Loaded 16900 existing records from primary storage. [2025-09-17T07:32:59.854246] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 11184 primary records. [2025-09-17T07:32:59.854757] [INFO ] [MAIN ] CBL: Loaded 16900 primary data records. [2025-09-17T07:32:59.854827] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-17T07:32:59.906562] [DEBUG] [MAIN ] CB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:32:59.943253] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 50110 primary records. [2025-09-17T07:32:59.958151] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-09-17T07:32:59.968476] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-17T07:32:59.968544] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-17T07:32:59.986699] [INFO ] [MAIN ] Derivative Progress: 373/2172 symbols completed. CBAN took 1.2s. Estimated remaining: 11m 18s. Rate: 159.3 symbols/min [2025-09-17T07:33:00.195999] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-09-17T07:33:00.196365] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-17T07:33:00.198735] [INFO ] [MAIN ] Derivative Progress: 374/2172 symbols completed. CB took 1.4s. Estimated remaining: 11m 16s. Rate: 159.5 symbols/min [2025-09-17T07:33:00.222997] [DEBUG] [MAIN ] CBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:00.223662] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16900 primary records. [2025-09-17T07:33:00.223738] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-17T07:33:00.239433] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-09-17T07:33:00.239507] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-17T07:33:00.241617] [INFO ] [MAIN ] Derivative Progress: 375/2172 symbols completed. CBL took 0.4s. Estimated remaining: 11m 14s. Rate: 159.9 symbols/min [2025-09-17T07:33:00.242094] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:00.242302] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:00.242340] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:00.247817] [DEBUG] [LOCAL ] CBNA: Loaded 2964 existing records from primary storage. [2025-09-17T07:33:00.247979] [INFO ] [MAIN ] CBNA: Loaded 2964 primary data records. [2025-09-17T07:33:00.571370] [DEBUG] [LOCAL ] CBT: Loaded 31500 existing records from primary storage. [2025-09-17T07:33:00.571582] [INFO ] [MAIN ] CBT: Loaded 31500 primary data records. [2025-09-17T07:33:00.690050] [DEBUG] [LOCAL ] CBRE: Loaded 50758 existing records from primary storage. [2025-09-17T07:33:00.745490] [INFO ] [MAIN ] CBRE: Loaded 50758 primary data records. [2025-09-17T07:33:01.230515] [DEBUG] [MAIN ] CBNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:01.231683] [INFO ] [MAIN ] CBNA: Generated 1794 derivative records from 2964 primary records. [2025-09-17T07:33:01.232077] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-17T07:33:01.249585] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1794 records). [2025-09-17T07:33:01.262143] [DEBUG] [MAIN ] CBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:01.262318] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-17T07:33:01.263321] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 31500 primary records. [2025-09-17T07:33:01.265658] [INFO ] [MAIN ] Derivative Progress: 376/2172 symbols completed. CBNA took 1.0s. Estimated remaining: 11m 17s. Rate: 159.1 symbols/min [2025-09-17T07:33:01.265759] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-17T07:33:01.266094] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:01.302941] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-09-17T07:33:01.297323] [DEBUG] [MAIN ] CBRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:01.303112] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-17T07:33:01.303809] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50758 primary records. [2025-09-17T07:33:01.305913] [INFO ] [MAIN ] Derivative Progress: 377/2172 symbols completed. CBT took 1.1s. Estimated remaining: 11m 15s. Rate: 159.5 symbols/min [2025-09-17T07:33:01.306120] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-17T07:33:01.306756] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:01.330445] [DEBUG] [LOCAL ] CBU: Loaded 22732 existing records from primary storage. [2025-09-17T07:33:01.331368] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-09-17T07:33:01.331570] [INFO ] [MAIN ] CBU: Loaded 22732 primary data records. [2025-09-17T07:33:01.331652] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-17T07:33:01.334095] [INFO ] [MAIN ] Derivative Progress: 378/2172 symbols completed. CBRE took 1.1s. Estimated remaining: 11m 13s. Rate: 159.9 symbols/min [2025-09-17T07:33:01.376862] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:01.497295] [DEBUG] [LOCAL ] CBZ: Loaded 33222 existing records from primary storage. [2025-09-17T07:33:01.531633] [INFO ] [MAIN ] CBZ: Loaded 33222 primary data records. [2025-09-17T07:33:02.024841] [DEBUG] [LOCAL ] CC: Loaded 53027 existing records from primary storage. [2025-09-17T07:33:02.025289] [INFO ] [MAIN ] CC: Loaded 53027 primary data records. [2025-09-17T07:33:02.346559] [DEBUG] [MAIN ] CBU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:02.347694] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22732 primary records. [2025-09-17T07:33:02.348313] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-17T07:33:02.369292] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-09-17T07:33:02.382130] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-17T07:33:02.382409] [DEBUG] [MAIN ] CBZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:02.385578] [INFO ] [MAIN ] Derivative Progress: 379/2172 symbols completed. CBU took 1.1s. Estimated remaining: 11m 16s. Rate: 159.2 symbols/min [2025-09-17T07:33:02.383411] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 33222 primary records. [2025-09-17T07:33:02.385932] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-17T07:33:02.386090] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:02.404740] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-09-17T07:33:02.406387] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-17T07:33:02.409572] [INFO ] [MAIN ] Derivative Progress: 380/2172 symbols completed. CBZ took 1.1s. Estimated remaining: 11m 14s. Rate: 159.5 symbols/min [2025-09-17T07:33:02.409976] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:02.424917] [DEBUG] [MAIN ] CC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:02.425623] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53027 primary records. [2025-09-17T07:33:02.425718] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-17T07:33:02.442419] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-09-17T07:33:02.446292] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-17T07:33:02.448613] [INFO ] [MAIN ] Derivative Progress: 381/2172 symbols completed. CC took 1.1s. Estimated remaining: 11m 12s. Rate: 159.9 symbols/min [2025-09-17T07:33:02.449023] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:02.456187] [DEBUG] [LOCAL ] CCIF: Loaded 15299 existing records from primary storage. [2025-09-17T07:33:02.469741] [INFO ] [MAIN ] CCIF: Loaded 15299 primary data records. [2025-09-17T07:33:02.607380] [DEBUG] [LOCAL ] CCI: Loaded 53166 existing records from primary storage. [2025-09-17T07:33:02.662921] [INFO ] [MAIN ] CCI: Loaded 53166 primary data records. [2025-09-17T07:33:02.919233] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-09-17T07:33:02.940391] [INFO ] [MAIN ] CCJ: Loaded 53675 primary data records. [2025-09-17T07:33:03.472729] [DEBUG] [MAIN ] CCIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:03.479413] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15299 primary records. [2025-09-17T07:33:03.481132] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-17T07:33:03.501465] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-09-17T07:33:03.502756] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-17T07:33:03.506061] [INFO ] [MAIN ] Derivative Progress: 382/2172 symbols completed. CCIF took 1.1s. Estimated remaining: 11m 15s. Rate: 159.2 symbols/min [2025-09-17T07:33:03.507481] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:03.521561] [DEBUG] [MAIN ] CCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:03.522668] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53166 primary records. [2025-09-17T07:33:03.522902] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-17T07:33:03.555431] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-09-17T07:33:03.555566] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-17T07:33:03.554066] [DEBUG] [MAIN ] CCJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:03.557884] [INFO ] [MAIN ] Derivative Progress: 383/2172 symbols completed. CCI took 1.2s. Estimated remaining: 11m 13s. Rate: 159.5 symbols/min [2025-09-17T07:33:03.558815] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53675 primary records. [2025-09-17T07:33:03.559242] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:03.559376] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-17T07:33:03.576927] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-09-17T07:33:03.577076] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-17T07:33:03.579929] [INFO ] [MAIN ] Derivative Progress: 384/2172 symbols completed. CCJ took 1.1s. Estimated remaining: 11m 11s. Rate: 159.9 symbols/min [2025-09-17T07:33:03.580215] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:03.602063] [DEBUG] [LOCAL ] CCRD: Loaded 8902 existing records from primary storage. [2025-09-17T07:33:03.602229] [INFO ] [MAIN ] CCRD: Loaded 8902 primary data records. [2025-09-17T07:33:03.737010] [DEBUG] [LOCAL ] CCK: Loaded 46625 existing records from primary storage. [2025-09-17T07:33:03.760052] [INFO ] [MAIN ] CCK: Loaded 46625 primary data records. [2025-09-17T07:33:03.862819] [DEBUG] [LOCAL ] CCO: Loaded 47470 existing records from primary storage. [2025-09-17T07:33:03.887499] [INFO ] [MAIN ] CCO: Loaded 47470 primary data records. [2025-09-17T07:33:04.571129] [DEBUG] [MAIN ] CCRD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:33:04.574231] [INFO ] [MAIN ] CCRD: Generated 1793 derivative records from 8902 primary records. [2025-09-17T07:33:04.575090] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-17T07:33:04.597544] [DEBUG] [MAIN ] CCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:04.603327] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46625 primary records. [2025-09-17T07:33:04.604462] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-17T07:33:04.605117] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1793 records). [2025-09-17T07:33:04.605306] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-17T07:33:04.607624] [INFO ] [MAIN ] Derivative Progress: 385/2172 symbols completed. CCRD took 1.0s. Estimated remaining: 11m 13s. Rate: 159.2 symbols/min [2025-09-17T07:33:04.608341] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:04.639701] [DEBUG] [MAIN ] CCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:04.640347] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-09-17T07:33:04.641146] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 47470 primary records. [2025-09-17T07:33:04.641328] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-17T07:33:04.641293] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-17T07:33:04.644154] [INFO ] [MAIN ] Derivative Progress: 386/2172 symbols completed. CCK took 1.1s. Estimated remaining: 11m 12s. Rate: 159.6 symbols/min [2025-09-17T07:33:04.652441] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:04.669148] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-09-17T07:33:04.669270] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-17T07:33:04.672043] [INFO ] [MAIN ] Derivative Progress: 387/2172 symbols completed. CCO took 1.1s. Estimated remaining: 11m 10s. Rate: 160.0 symbols/min [2025-09-17T07:33:04.672544] [INFO ] [MAIN ] CDE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:04.690269] [DEBUG] [LOCAL ] CCS: Loaded 30631 existing records from primary storage. [2025-09-17T07:33:04.690654] [INFO ] [MAIN ] CCS: Loaded 30631 primary data records. [2025-09-17T07:33:04.847219] [DEBUG] [LOCAL ] CCU: Loaded 24179 existing records from primary storage. [2025-09-17T07:33:04.875573] [INFO ] [MAIN ] CCU: Loaded 24179 primary data records. [2025-09-17T07:33:05.111944] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-17T07:33:05.146659] [INFO ] [MAIN ] CDE: Loaded 53641 primary data records. [2025-09-17T07:33:05.695026] [DEBUG] [MAIN ] CCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:05.696034] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30631 primary records. [2025-09-17T07:33:05.696364] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-17T07:33:05.727941] [DEBUG] [MAIN ] CCU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:05.729668] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 24179 primary records. [2025-09-17T07:33:05.730995] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-09-17T07:33:05.731069] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-17T07:33:05.731168] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-17T07:33:05.734236] [INFO ] [MAIN ] Derivative Progress: 388/2172 symbols completed. CCS took 1.1s. Estimated remaining: 11m 12s. Rate: 159.2 symbols/min [2025-09-17T07:33:05.763330] [DEBUG] [MAIN ] CDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:05.764119] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-09-17T07:33:05.764860] [INFO ] [MAIN ] CDE: Generated 1794 derivative records from 53641 primary records. [2025-09-17T07:33:05.764990] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-17T07:33:05.765056] [DEBUG] [LOCAL ] CDE: Saving derivative data. [2025-09-17T07:33:05.766905] [INFO ] [MAIN ] Derivative Progress: 389/2172 symbols completed. CCU took 1.1s. Estimated remaining: 11m 10s. Rate: 159.6 symbols/min [2025-09-17T07:33:05.782353] [DEBUG] [LOCAL ] CDE: Derivative data saved (1794 records). [2025-09-17T07:33:05.782441] [INFO ] [MAIN ] CDE: Successfully saved derivative data. [2025-09-17T07:33:05.785128] [INFO ] [MAIN ] Derivative Progress: 390/2172 symbols completed. CDE took 1.1s. Estimated remaining: 11m 8s. Rate: 160.0 symbols/min [2025-09-17T07:33:05.785632] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:05.785580] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:05.785800] [INFO ] [MAIN ] CDP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:05.799092] [DEBUG] [LOCAL ] CDLR: Loaded 10291 existing records from primary storage. [2025-09-17T07:33:05.799441] [INFO ] [MAIN ] CDLR: Loaded 10291 primary data records. [2025-09-17T07:33:06.006399] [DEBUG] [LOCAL ] CDRE: Loaded 25093 existing records from primary storage. [2025-09-17T07:33:06.006740] [INFO ] [MAIN ] CDRE: Loaded 25093 primary data records. [2025-09-17T07:33:06.233275] [DEBUG] [LOCAL ] CDP: Loaded 42807 existing records from primary storage. [2025-09-17T07:33:06.242004] [INFO ] [MAIN ] CDP: Loaded 42807 primary data records. [2025-09-17T07:33:06.814620] [DEBUG] [MAIN ] CDLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:06.816489] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 10291 primary records. [2025-09-17T07:33:06.816995] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-17T07:33:06.833623] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-09-17T07:33:06.834123] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-17T07:33:06.837589] [INFO ] [MAIN ] Derivative Progress: 391/2172 symbols completed. CDLR took 1.1s. Estimated remaining: 11m 11s. Rate: 159.2 symbols/min [2025-09-17T07:33:06.839831] [INFO ] [MAIN ] CE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:06.855373] [DEBUG] [MAIN ] CDRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:06.856254] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 25093 primary records. [2025-09-17T07:33:06.856754] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-17T07:33:06.888631] [DEBUG] [MAIN ] CDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:06.889916] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-09-17T07:33:06.890869] [INFO ] [MAIN ] CDP: Generated 1794 derivative records from 42807 primary records. [2025-09-17T07:33:06.891046] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-17T07:33:06.891200] [DEBUG] [LOCAL ] CDP: Saving derivative data. [2025-09-17T07:33:06.893528] [INFO ] [MAIN ] Derivative Progress: 392/2172 symbols completed. CDRE took 1.1s. Estimated remaining: 11m 9s. Rate: 159.6 symbols/min [2025-09-17T07:33:06.894619] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:06.927296] [DEBUG] [LOCAL ] CDP: Derivative data saved (1794 records). [2025-09-17T07:33:06.930965] [DEBUG] [LOCAL ] CEE: Loaded 7167 existing records from primary storage. [2025-09-17T07:33:06.931136] [INFO ] [MAIN ] CDP: Successfully saved derivative data. [2025-09-17T07:33:06.931239] [INFO ] [MAIN ] CEE: Loaded 7167 primary data records. [2025-09-17T07:33:06.933856] [INFO ] [MAIN ] Derivative Progress: 393/2172 symbols completed. CDP took 1.1s. Estimated remaining: 11m 7s. Rate: 159.9 symbols/min [2025-09-17T07:33:06.955227] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:07.082712] [DEBUG] [LOCAL ] CE: Loaded 51604 existing records from primary storage. [2025-09-17T07:33:07.083625] [INFO ] [MAIN ] CE: Loaded 51604 primary data records. [2025-09-17T07:33:07.391028] [DEBUG] [LOCAL ] CEPU: Loaded 25572 existing records from primary storage. [2025-09-17T07:33:07.402704] [INFO ] [MAIN ] CEPU: Loaded 25572 primary data records. [2025-09-17T07:33:07.967811] [DEBUG] [MAIN ] CEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:07.969207] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 7167 primary records. [2025-09-17T07:33:07.970283] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-17T07:33:08.001339] [DEBUG] [MAIN ] CE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:08.003544] [INFO ] [MAIN ] CE: Generated 1794 derivative records from 51604 primary records. [2025-09-17T07:33:08.004381] [DEBUG] [LOCAL ] CE: Saving derivative data. [2025-09-17T07:33:08.004669] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-09-17T07:33:08.005042] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-17T07:33:08.007523] [INFO ] [MAIN ] Derivative Progress: 394/2172 symbols completed. CEE took 1.1s. Estimated remaining: 11m 10s. Rate: 159.2 symbols/min [2025-09-17T07:33:08.016351] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:08.028254] [DEBUG] [LOCAL ] CE: Derivative data saved (1794 records). [2025-09-17T07:33:08.028471] [INFO ] [MAIN ] CE: Successfully saved derivative data. [2025-09-17T07:33:08.031181] [INFO ] [MAIN ] Derivative Progress: 395/2172 symbols completed. CE took 1.2s. Estimated remaining: 11m 8s. Rate: 159.6 symbols/min [2025-09-17T07:33:08.039593] [INFO ] [MAIN ] CFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:08.046183] [DEBUG] [MAIN ] CEPU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:08.047341] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 25572 primary records. [2025-09-17T07:33:08.047688] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-17T07:33:08.066694] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-09-17T07:33:08.066851] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-17T07:33:08.069606] [INFO ] [MAIN ] Derivative Progress: 396/2172 symbols completed. CEPU took 1.1s. Estimated remaining: 11m 6s. Rate: 159.9 symbols/min [2025-09-17T07:33:08.069996] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:08.122072] [DEBUG] [LOCAL ] CF: Loaded 52272 existing records from primary storage. [2025-09-17T07:33:08.122328] [INFO ] [MAIN ] CF: Loaded 52272 primary data records. [2025-09-17T07:33:08.277683] [DEBUG] [LOCAL ] CFR: Loaded 33633 existing records from primary storage. [2025-09-17T07:33:08.278459] [DEBUG] [LOCAL ] CFG: Loaded 53621 existing records from primary storage. [2025-09-17T07:33:08.317990] [INFO ] [MAIN ] CFR: Loaded 33633 primary data records. [2025-09-17T07:33:08.342711] [INFO ] [MAIN ] CFG: Loaded 53621 primary data records. [2025-09-17T07:33:09.160511] [DEBUG] [MAIN ] CF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:09.161582] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52272 primary records. [2025-09-17T07:33:09.161912] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-17T07:33:09.184159] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-09-17T07:33:09.184703] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-17T07:33:09.194318] [INFO ] [MAIN ] Derivative Progress: 397/2172 symbols completed. CF took 1.2s. Estimated remaining: 11m 9s. Rate: 159.1 symbols/min [2025-09-17T07:33:09.206970] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:09.212102] [DEBUG] [MAIN ] CFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:09.212807] [DEBUG] [MAIN ] CFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:09.213520] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 33633 primary records. [2025-09-17T07:33:09.214301] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-17T07:33:09.214150] [INFO ] [MAIN ] CFG: Generated 1794 derivative records from 53621 primary records. [2025-09-17T07:33:09.215294] [DEBUG] [LOCAL ] CFG: Saving derivative data. [2025-09-17T07:33:09.248361] [DEBUG] [LOCAL ] CFG: Derivative data saved (1794 records). [2025-09-17T07:33:09.248849] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-09-17T07:33:09.249047] [INFO ] [MAIN ] CFG: Successfully saved derivative data. [2025-09-17T07:33:09.249164] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-17T07:33:09.251825] [INFO ] [MAIN ] Derivative Progress: 398/2172 symbols completed. CFG took 1.2s. Estimated remaining: 11m 7s. Rate: 159.5 symbols/min [2025-09-17T07:33:09.255027] [INFO ] [MAIN ] Derivative Progress: 399/2172 symbols completed. CFR took 1.2s. Estimated remaining: 11m 5s. Rate: 159.9 symbols/min [2025-09-17T07:33:09.254800] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:09.255334] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:09.259419] [DEBUG] [LOCAL ] CGV: Loaded 1441 existing records from primary storage. [2025-09-17T07:33:09.259773] [INFO ] [MAIN ] CGV: Loaded 1441 primary data records. [2025-09-17T07:33:09.537154] [DEBUG] [LOCAL ] CHCT: Loaded 24153 existing records from primary storage. [2025-09-17T07:33:09.590462] [INFO ] [MAIN ] CHCT: Loaded 24153 primary data records. [2025-09-17T07:33:09.585112] [DEBUG] [LOCAL ] CGAU: Loaded 42404 existing records from primary storage. [2025-09-17T07:33:09.606482] [INFO ] [MAIN ] CGAU: Loaded 42404 primary data records. [2025-09-17T07:33:10.262729] [DEBUG] [MAIN ] CGV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:33:10.263921] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1441 primary records. [2025-09-17T07:33:10.265987] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-17T07:33:10.282780] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-09-17T07:33:10.283301] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-17T07:33:10.286174] [INFO ] [MAIN ] Derivative Progress: 400/2172 symbols completed. CGV took 1.0s. Estimated remaining: 11m 8s. Rate: 159.2 symbols/min [2025-09-17T07:33:10.287129] [INFO ] [MAIN ] CHD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:10.307960] [DEBUG] [MAIN ] CHCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:10.321736] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 24153 primary records. [2025-09-17T07:33:10.322075] [DEBUG] [MAIN ] CGAU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:10.323058] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 42404 primary records. [2025-09-17T07:33:10.323153] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-17T07:33:10.322389] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-17T07:33:10.353173] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-09-17T07:33:10.354400] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-17T07:33:10.357285] [INFO ] [MAIN ] Derivative Progress: 401/2172 symbols completed. CHCT took 1.1s. Estimated remaining: 11m 6s. Rate: 159.5 symbols/min [2025-09-17T07:33:10.358431] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:10.359408] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-09-17T07:33:10.359674] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-17T07:33:10.362139] [INFO ] [MAIN ] Derivative Progress: 402/2172 symbols completed. CGAU took 1.2s. Estimated remaining: 11m 4s. Rate: 159.9 symbols/min [2025-09-17T07:33:10.362562] [INFO ] [MAIN ] CHGG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:10.391033] [DEBUG] [LOCAL ] CHE: Loaded 14516 existing records from primary storage. [2025-09-17T07:33:10.392139] [INFO ] [MAIN ] CHE: Loaded 14516 primary data records. [2025-09-17T07:33:10.476543] [DEBUG] [LOCAL ] CHD: Loaded 51984 existing records from primary storage. [2025-09-17T07:33:10.515165] [INFO ] [MAIN ] CHD: Loaded 51984 primary data records. [2025-09-17T07:33:10.713586] [DEBUG] [LOCAL ] CHGG: Loaded 47838 existing records from primary storage. [2025-09-17T07:33:10.837421] [INFO ] [MAIN ] CHGG: Loaded 47838 primary data records. [2025-09-17T07:33:11.410672] [DEBUG] [MAIN ] CHE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:11.411713] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 14516 primary records. [2025-09-17T07:33:11.411828] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-17T07:33:11.431311] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-09-17T07:33:11.433816] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-17T07:33:11.444569] [INFO ] [MAIN ] Derivative Progress: 403/2172 symbols completed. CHE took 1.1s. Estimated remaining: 11m 7s. Rate: 159.1 symbols/min [2025-09-17T07:33:11.452130] [DEBUG] [MAIN ] CHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:11.453160] [INFO ] [MAIN ] CHD: Generated 1794 derivative records from 51984 primary records. [2025-09-17T07:33:11.453525] [DEBUG] [LOCAL ] CHD: Saving derivative data. [2025-09-17T07:33:11.485188] [DEBUG] [LOCAL ] CHD: Derivative data saved (1794 records). [2025-09-17T07:33:11.485693] [DEBUG] [MAIN ] CHGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:11.485784] [INFO ] [MAIN ] CHD: Successfully saved derivative data. [2025-09-17T07:33:11.486499] [INFO ] [MAIN ] CHGG: Generated 1794 derivative records from 47838 primary records. [2025-09-17T07:33:11.489430] [INFO ] [MAIN ] Derivative Progress: 404/2172 symbols completed. CHD took 1.2s. Estimated remaining: 11m 5s. Rate: 159.5 symbols/min [2025-09-17T07:33:11.489574] [DEBUG] [LOCAL ] CHGG: Saving derivative data. [2025-09-17T07:33:11.506910] [DEBUG] [LOCAL ] CHGG: Derivative data saved (1794 records). [2025-09-17T07:33:11.507025] [INFO ] [MAIN ] CHGG: Successfully saved derivative data. [2025-09-17T07:33:11.509539] [INFO ] [MAIN ] Derivative Progress: 405/2172 symbols completed. CHGG took 1.1s. Estimated remaining: 11m 3s. Rate: 159.9 symbols/min [2025-09-17T07:33:11.510382] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:11.510087] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:11.510233] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:11.518483] [DEBUG] [LOCAL ] CHN: Loaded 4839 existing records from primary storage. [2025-09-17T07:33:11.518691] [INFO ] [MAIN ] CHN: Loaded 4839 primary data records. [2025-09-17T07:33:11.694344] [DEBUG] [LOCAL ] CHMI: Loaded 22006 existing records from primary storage. [2025-09-17T07:33:11.775804] [INFO ] [MAIN ] CHMI: Loaded 22006 primary data records. [2025-09-17T07:33:11.807510] [DEBUG] [LOCAL ] CHH: Loaded 32484 existing records from primary storage. [2025-09-17T07:33:11.867521] [INFO ] [MAIN ] CHH: Loaded 32484 primary data records. [2025-09-17T07:33:12.527217] [DEBUG] [MAIN ] CHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:12.530597] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4839 primary records. [2025-09-17T07:33:12.531603] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-17T07:33:12.552020] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-09-17T07:33:12.552227] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-17T07:33:12.554665] [INFO ] [MAIN ] Derivative Progress: 406/2172 symbols completed. CHN took 1.0s. Estimated remaining: 11m 6s. Rate: 159.2 symbols/min [2025-09-17T07:33:12.556923] [INFO ] [MAIN ] CHPT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:12.573694] [DEBUG] [MAIN ] CHMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:12.575995] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 22006 primary records. [2025-09-17T07:33:12.576484] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-17T07:33:12.590787] [DEBUG] [MAIN ] CHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:12.592374] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32484 primary records. [2025-09-17T07:33:12.600402] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-17T07:33:12.622932] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-09-17T07:33:12.624812] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-17T07:33:12.628117] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-09-17T07:33:12.631680] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-17T07:33:12.631449] [INFO ] [MAIN ] Derivative Progress: 407/2172 symbols completed. CHMI took 1.1s. Estimated remaining: 11m 4s. Rate: 159.5 symbols/min [2025-09-17T07:33:12.634665] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:12.634720] [INFO ] [MAIN ] Derivative Progress: 408/2172 symbols completed. CHH took 1.1s. Estimated remaining: 11m 2s. Rate: 159.9 symbols/min [2025-09-17T07:33:12.635840] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:12.670728] [DEBUG] [LOCAL ] CHT: Loaded 19821 existing records from primary storage. [2025-09-17T07:33:12.686694] [INFO ] [MAIN ] CHT: Loaded 19821 primary data records. [2025-09-17T07:33:12.721302] [DEBUG] [LOCAL ] CHPT: Loaded 49915 existing records from primary storage. [2025-09-17T07:33:12.761258] [INFO ] [MAIN ] CHPT: Loaded 49915 primary data records. [2025-09-17T07:33:13.007593] [DEBUG] [LOCAL ] CHWY: Loaded 53626 existing records from primary storage. [2025-09-17T07:33:13.163512] [INFO ] [MAIN ] CHWY: Loaded 53626 primary data records. [2025-09-17T07:33:13.684338] [DEBUG] [MAIN ] CHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:13.687058] [INFO ] [MAIN ] CHT: Generated 1794 derivative records from 19821 primary records. [2025-09-17T07:33:13.688260] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-17T07:33:13.718848] [DEBUG] [LOCAL ] CHT: Derivative data saved (1794 records). [2025-09-17T07:33:13.719005] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-17T07:33:13.716055] [DEBUG] [MAIN ] CHPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:13.721163] [INFO ] [MAIN ] Derivative Progress: 409/2172 symbols completed. CHT took 1.1s. Estimated remaining: 11m 5s. Rate: 159.1 symbols/min [2025-09-17T07:33:13.722375] [INFO ] [MAIN ] CHPT: Generated 1794 derivative records from 49915 primary records. [2025-09-17T07:33:13.722989] [DEBUG] [LOCAL ] CHPT: Saving derivative data. [2025-09-17T07:33:13.722417] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:13.756003] [DEBUG] [LOCAL ] CHPT: Derivative data saved (1794 records). [2025-09-17T07:33:13.756295] [INFO ] [MAIN ] CHPT: Successfully saved derivative data. [2025-09-17T07:33:13.756580] [DEBUG] [MAIN ] CHWY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:13.760424] [INFO ] [MAIN ] Derivative Progress: 410/2172 symbols completed. CHPT took 1.2s. Estimated remaining: 11m 3s. Rate: 159.5 symbols/min [2025-09-17T07:33:13.761684] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:13.761478] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53626 primary records. [2025-09-17T07:33:13.762478] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-17T07:33:13.785281] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-09-17T07:33:13.785510] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-17T07:33:13.788282] [INFO ] [MAIN ] Derivative Progress: 411/2172 symbols completed. CHWY took 1.2s. Estimated remaining: 11m 1s. Rate: 159.8 symbols/min [2025-09-17T07:33:13.788929] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:13.796911] [DEBUG] [LOCAL ] CIA: Loaded 16768 existing records from primary storage. [2025-09-17T07:33:13.797058] [INFO ] [MAIN ] CIA: Loaded 16768 primary data records. [2025-09-17T07:33:13.949774] [DEBUG] [LOCAL ] CI: Loaded 49995 existing records from primary storage. [2025-09-17T07:33:13.975073] [INFO ] [MAIN ] CI: Loaded 49995 primary data records. [2025-09-17T07:33:14.044531] [DEBUG] [LOCAL ] CIB: Loaded 31191 existing records from primary storage. [2025-09-17T07:33:14.184059] [INFO ] [MAIN ] CIB: Loaded 31191 primary data records. [2025-09-17T07:33:14.866833] [DEBUG] [MAIN ] CIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:14.867932] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 16768 primary records. [2025-09-17T07:33:14.868589] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-17T07:33:14.901063] [DEBUG] [MAIN ] CI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:14.902756] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 49995 primary records. [2025-09-17T07:33:14.904044] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-17T07:33:14.913462] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-09-17T07:33:14.918820] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-17T07:33:14.921320] [INFO ] [MAIN ] Derivative Progress: 412/2172 symbols completed. CIA took 1.2s. Estimated remaining: 11m 4s. Rate: 159.1 symbols/min [2025-09-17T07:33:14.922363] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:14.926249] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-09-17T07:33:14.927768] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-17T07:33:14.932146] [INFO ] [MAIN ] Derivative Progress: 413/2172 symbols completed. CI took 1.2s. Estimated remaining: 11m 2s. Rate: 159.4 symbols/min [2025-09-17T07:33:14.933423] [INFO ] [MAIN ] CIF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:14.947181] [DEBUG] [MAIN ] CIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:14.948050] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 31191 primary records. [2025-09-17T07:33:14.948326] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-17T07:33:14.966621] [DEBUG] [LOCAL ] CIF: Loaded 4548 existing records from primary storage. [2025-09-17T07:33:14.967678] [INFO ] [MAIN ] CIF: Loaded 4548 primary data records. [2025-09-17T07:33:15.064405] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-09-17T07:33:15.072470] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-17T07:33:15.118954] [INFO ] [MAIN ] Derivative Progress: 414/2172 symbols completed. CIB took 1.3s. Estimated remaining: 11m 1s. Rate: 159.6 symbols/min [2025-09-17T07:33:15.167677] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:15.304371] [DEBUG] [LOCAL ] CIEN: Loaded 52112 existing records from primary storage. [2025-09-17T07:33:15.304821] [INFO ] [MAIN ] CIEN: Loaded 52112 primary data records. [2025-09-17T07:33:15.628975] [DEBUG] [LOCAL ] CIG: Loaded 43581 existing records from primary storage. [2025-09-17T07:33:15.630422] [INFO ] [MAIN ] CIG: Loaded 43581 primary data records. [2025-09-17T07:33:15.749184] [DEBUG] [MAIN ] CIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:15.828630] [INFO ] [MAIN ] CIF: Generated 1794 derivative records from 4548 primary records. [2025-09-17T07:33:15.927844] [DEBUG] [LOCAL ] CIF: Saving derivative data. [2025-09-17T07:33:15.960605] [DEBUG] [LOCAL ] CIF: Derivative data saved (1794 records). [2025-09-17T07:33:15.961659] [INFO ] [MAIN ] CIF: Successfully saved derivative data. [2025-09-17T07:33:15.965032] [INFO ] [MAIN ] Derivative Progress: 415/2172 symbols completed. CIF took 1.0s. Estimated remaining: 11m 2s. Rate: 159.1 symbols/min [2025-09-17T07:33:15.967451] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:15.982867] [DEBUG] [MAIN ] CIEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:15.983609] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52112 primary records. [2025-09-17T07:33:15.984088] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-17T07:33:16.010215] [DEBUG] [LOCAL ] CII: Loaded 15733 existing records from primary storage. [2025-09-17T07:33:16.013097] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-09-17T07:33:16.013382] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-17T07:33:16.013462] [INFO ] [MAIN ] CII: Loaded 15733 primary data records. [2025-09-17T07:33:16.017034] [INFO ] [MAIN ] Derivative Progress: 416/2172 symbols completed. CIEN took 1.1s. Estimated remaining: 11m 1s. Rate: 159.5 symbols/min [2025-09-17T07:33:16.029657] [INFO ] [MAIN ] CIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:16.136275] [DEBUG] [MAIN ] CIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:16.158232] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 43581 primary records. [2025-09-17T07:33:16.180414] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-17T07:33:16.352507] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-09-17T07:33:16.364199] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-17T07:33:16.367155] [INFO ] [MAIN ] Derivative Progress: 417/2172 symbols completed. CIG took 1.2s. Estimated remaining: 11m 0s. Rate: 159.5 symbols/min [2025-09-17T07:33:16.367949] [DEBUG] [LOCAL ] CIM: Loaded 37164 existing records from primary storage. [2025-09-17T07:33:16.369309] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:16.369996] [INFO ] [MAIN ] CIM: Loaded 37164 primary data records. [2025-09-17T07:33:16.555789] [DEBUG] [LOCAL ] CINT: Loaded 17895 existing records from primary storage. [2025-09-17T07:33:16.583929] [INFO ] [MAIN ] CINT: Loaded 17895 primary data records. [2025-09-17T07:33:16.819409] [DEBUG] [MAIN ] CII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:16.841550] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15733 primary records. [2025-09-17T07:33:16.860514] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-17T07:33:17.093690] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-09-17T07:33:17.093929] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-17T07:33:17.097034] [INFO ] [MAIN ] Derivative Progress: 418/2172 symbols completed. CII took 1.1s. Estimated remaining: 11m 1s. Rate: 159.1 symbols/min [2025-09-17T07:33:17.114090] [DEBUG] [MAIN ] CIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:17.114853] [INFO ] [MAIN ] CIM: Generated 1794 derivative records from 37164 primary records. [2025-09-17T07:33:17.115072] [DEBUG] [LOCAL ] CIM: Saving derivative data. [2025-09-17T07:33:17.133479] [DEBUG] [LOCAL ] CIM: Derivative data saved (1794 records). [2025-09-17T07:33:17.145842] [DEBUG] [MAIN ] CINT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:17.145883] [INFO ] [MAIN ] CIM: Successfully saved derivative data. [2025-09-17T07:33:17.149045] [INFO ] [MAIN ] Derivative Progress: 419/2172 symbols completed. CIM took 1.1s. Estimated remaining: 10m 60s. Rate: 159.5 symbols/min [2025-09-17T07:33:17.146520] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 17895 primary records. [2025-09-17T07:33:17.149196] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-17T07:33:17.164520] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-09-17T07:33:17.164608] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-17T07:33:17.167214] [INFO ] [MAIN ] Derivative Progress: 420/2172 symbols completed. CINT took 0.8s. Estimated remaining: 10m 58s. Rate: 159.8 symbols/min [2025-09-17T07:33:17.167932] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:17.168098] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:17.167760] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:17.196229] [DEBUG] [LOCAL ] CIO: Loaded 19855 existing records from primary storage. [2025-09-17T07:33:17.196679] [INFO ] [MAIN ] CIO: Loaded 19855 primary data records. [2025-09-17T07:33:17.327288] [DEBUG] [LOCAL ] CION: Loaded 29384 existing records from primary storage. [2025-09-17T07:33:17.327979] [INFO ] [MAIN ] CION: Loaded 29384 primary data records. [2025-09-17T07:33:17.648303] [DEBUG] [LOCAL ] CIVI: Loaded 52586 existing records from primary storage. [2025-09-17T07:33:17.670435] [INFO ] [MAIN ] CIVI: Loaded 52586 primary data records. [2025-09-17T07:33:18.178861] [DEBUG] [MAIN ] CIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:18.180034] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 19855 primary records. [2025-09-17T07:33:18.180698] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-17T07:33:18.209361] [DEBUG] [MAIN ] CION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:18.211538] [INFO ] [MAIN ] CION: Generated 1794 derivative records from 29384 primary records. [2025-09-17T07:33:18.212448] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-17T07:33:18.229211] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-09-17T07:33:18.230058] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-17T07:33:18.234735] [INFO ] [MAIN ] Derivative Progress: 421/2172 symbols completed. CIO took 1.1s. Estimated remaining: 11m 0s. Rate: 159.1 symbols/min [2025-09-17T07:33:18.235770] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:18.251108] [DEBUG] [MAIN ] CIVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:18.251727] [DEBUG] [LOCAL ] CION: Derivative data saved (1794 records). [2025-09-17T07:33:18.252442] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52586 primary records. [2025-09-17T07:33:18.252661] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-17T07:33:18.254941] [INFO ] [MAIN ] Derivative Progress: 422/2172 symbols completed. CION took 1.1s. Estimated remaining: 10m 58s. Rate: 159.5 symbols/min [2025-09-17T07:33:18.252704] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-17T07:33:18.255208] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:18.272712] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-09-17T07:33:18.272983] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-17T07:33:18.276507] [INFO ] [MAIN ] Derivative Progress: 423/2172 symbols completed. CIVI took 1.1s. Estimated remaining: 10m 56s. Rate: 159.9 symbols/min [2025-09-17T07:33:18.276897] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:18.314665] [DEBUG] [LOCAL ] CLCO: Loaded 13763 existing records from primary storage. [2025-09-17T07:33:18.314831] [INFO ] [MAIN ] CLCO: Loaded 13763 primary data records. [2025-09-17T07:33:18.446421] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-17T07:33:18.447081] [DEBUG] [LOCAL ] CLB: Loaded 33316 existing records from primary storage. [2025-09-17T07:33:18.447182] [INFO ] [MAIN ] CL: Loaded 53644 primary data records. [2025-09-17T07:33:18.453035] [INFO ] [MAIN ] CLB: Loaded 33316 primary data records. [2025-09-17T07:33:19.320054] [DEBUG] [MAIN ] CLCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:19.321712] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 13763 primary records. [2025-09-17T07:33:19.322221] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-17T07:33:19.339336] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-09-17T07:33:19.341147] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-17T07:33:19.344163] [INFO ] [MAIN ] Derivative Progress: 424/2172 symbols completed. CLCO took 1.1s. Estimated remaining: 10m 59s. Rate: 159.2 symbols/min [2025-09-17T07:33:19.346744] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:19.373334] [DEBUG] [MAIN ] CL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:19.373806] [DEBUG] [MAIN ] CLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:19.374615] [INFO ] [MAIN ] CL: Generated 1794 derivative records from 53644 primary records. [2025-09-17T07:33:19.375282] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33316 primary records. [2025-09-17T07:33:19.375348] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-17T07:33:19.375558] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-17T07:33:19.407618] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-09-17T07:33:19.415238] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-17T07:33:19.416061] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-09-17T07:33:19.419099] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-17T07:33:19.418868] [INFO ] [MAIN ] Derivative Progress: 425/2172 symbols completed. CLB took 1.2s. Estimated remaining: 10m 57s. Rate: 159.5 symbols/min [2025-09-17T07:33:19.422321] [INFO ] [MAIN ] Derivative Progress: 426/2172 symbols completed. CL took 1.2s. Estimated remaining: 10m 55s. Rate: 159.8 symbols/min [2025-09-17T07:33:19.422591] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:19.422384] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:19.432965] [DEBUG] [LOCAL ] CLDT: Loaded 26196 existing records from primary storage. [2025-09-17T07:33:19.433309] [INFO ] [MAIN ] CLDT: Loaded 26196 primary data records. [2025-09-17T07:33:19.771425] [DEBUG] [LOCAL ] CLH: Loaded 28607 existing records from primary storage. [2025-09-17T07:33:19.786419] [INFO ] [MAIN ] CLH: Loaded 28607 primary data records. [2025-09-17T07:33:19.819843] [DEBUG] [LOCAL ] CLF: Loaded 53742 existing records from primary storage. [2025-09-17T07:33:19.855333] [INFO ] [MAIN ] CLF: Loaded 53742 primary data records. [2025-09-17T07:33:20.411422] [DEBUG] [MAIN ] CLDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:20.414289] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 26196 primary records. [2025-09-17T07:33:20.415420] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-17T07:33:20.434219] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-09-17T07:33:20.434608] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-17T07:33:20.437209] [INFO ] [MAIN ] Derivative Progress: 427/2172 symbols completed. CLDT took 1.1s. Estimated remaining: 10m 58s. Rate: 159.2 symbols/min [2025-09-17T07:33:20.440120] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:20.454740] [DEBUG] [MAIN ] CLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:20.455841] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 28607 primary records. [2025-09-17T07:33:20.456108] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-17T07:33:20.481375] [DEBUG] [LOCAL ] CLPR: Loaded 11659 existing records from primary storage. [2025-09-17T07:33:20.485336] [INFO ] [MAIN ] CLPR: Loaded 11659 primary data records. [2025-09-17T07:33:20.485163] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-09-17T07:33:20.504240] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-17T07:33:20.565273] [DEBUG] [MAIN ] CLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:20.567600] [INFO ] [MAIN ] Derivative Progress: 428/2172 symbols completed. CLH took 1.1s. Estimated remaining: 10m 56s. Rate: 159.4 symbols/min [2025-09-17T07:33:20.585051] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53742 primary records. [2025-09-17T07:33:20.601672] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-17T07:33:20.602743] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:20.686020] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-09-17T07:33:20.705966] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-17T07:33:20.720337] [INFO ] [MAIN ] Derivative Progress: 429/2172 symbols completed. CLF took 1.3s. Estimated remaining: 10m 55s. Rate: 159.7 symbols/min [2025-09-17T07:33:20.848600] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:20.911839] [DEBUG] [MAIN ] CLPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:20.912736] [INFO ] [MAIN ] CLPR: Generated 1794 derivative records from 11659 primary records. [2025-09-17T07:33:20.912832] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-17T07:33:20.956887] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1794 records). [2025-09-17T07:33:20.958189] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-17T07:33:20.958048] [DEBUG] [LOCAL ] CLS: Loaded 53648 existing records from primary storage. [2025-09-17T07:33:20.958421] [INFO ] [MAIN ] CLS: Loaded 53648 primary data records. [2025-09-17T07:33:20.961235] [INFO ] [MAIN ] Derivative Progress: 430/2172 symbols completed. CLPR took 0.5s. Estimated remaining: 10m 54s. Rate: 159.8 symbols/min [2025-09-17T07:33:20.966862] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:21.023684] [DEBUG] [LOCAL ] CLVT: Loaded 52056 existing records from primary storage. [2025-09-17T07:33:21.045684] [INFO ] [MAIN ] CLVT: Loaded 52056 primary data records. [2025-09-17T07:33:21.304306] [DEBUG] [LOCAL ] CLW: Loaded 22083 existing records from primary storage. [2025-09-17T07:33:21.461191] [INFO ] [MAIN ] CLW: Loaded 22083 primary data records. [2025-09-17T07:33:21.959293] [DEBUG] [MAIN ] CLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:21.961090] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53648 primary records. [2025-09-17T07:33:21.974829] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-17T07:33:21.974623] [DEBUG] [MAIN ] CLVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:21.976589] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 52056 primary records. [2025-09-17T07:33:21.977139] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-17T07:33:22.011609] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-09-17T07:33:22.014024] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-09-17T07:33:22.014160] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-17T07:33:22.016357] [INFO ] [MAIN ] Derivative Progress: 431/2172 symbols completed. CLVT took 1.2s. Estimated remaining: 10m 56s. Rate: 159.1 symbols/min [2025-09-17T07:33:22.016795] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-17T07:33:22.017232] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:22.020053] [INFO ] [MAIN ] Derivative Progress: 432/2172 symbols completed. CLS took 1.4s. Estimated remaining: 10m 55s. Rate: 159.5 symbols/min [2025-09-17T07:33:22.020778] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:22.040094] [DEBUG] [MAIN ] CLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:22.041164] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 22083 primary records. [2025-09-17T07:33:22.041247] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-17T07:33:22.062725] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-09-17T07:33:22.062993] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-17T07:33:22.065955] [INFO ] [MAIN ] Derivative Progress: 433/2172 symbols completed. CLW took 1.1s. Estimated remaining: 10m 53s. Rate: 159.8 symbols/min [2025-09-17T07:33:22.129318] [DEBUG] [LOCAL ] CLX: Loaded 51381 existing records from primary storage. [2025-09-17T07:33:22.130084] [DEBUG] [LOCAL ] CM: Loaded 48670 existing records from primary storage. [2025-09-17T07:33:22.130383] [INFO ] [MAIN ] CLX: Loaded 51381 primary data records. [2025-09-17T07:33:22.130460] [INFO ] [MAIN ] CM: Loaded 48670 primary data records. [2025-09-17T07:33:22.792055] [DEBUG] [MAIN ] CLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:22.794890] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51381 primary records. [2025-09-17T07:33:22.795121] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-17T07:33:22.822218] [DEBUG] [MAIN ] CM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:22.825840] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48670 primary records. [2025-09-17T07:33:22.825062] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-09-17T07:33:22.826081] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-17T07:33:22.825995] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-17T07:33:22.828487] [INFO ] [MAIN ] Derivative Progress: 434/2172 symbols completed. CLX took 0.8s. Estimated remaining: 10m 54s. Rate: 159.4 symbols/min [2025-09-17T07:33:22.844307] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-09-17T07:33:22.844410] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-17T07:33:22.846701] [INFO ] [MAIN ] Derivative Progress: 435/2172 symbols completed. CM took 0.8s. Estimated remaining: 10m 52s. Rate: 159.8 symbols/min [2025-09-17T07:33:22.847418] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:22.847625] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:22.847703] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:22.872091] [DEBUG] [LOCAL ] CMBT: Loaded 20842 existing records from primary storage. [2025-09-17T07:33:22.872346] [INFO ] [MAIN ] CMBT: Loaded 20842 primary data records. [2025-09-17T07:33:23.051731] [DEBUG] [LOCAL ] CMC: Loaded 45782 existing records from primary storage. [2025-09-17T07:33:23.108085] [INFO ] [MAIN ] CMC: Loaded 45782 primary data records. [2025-09-17T07:33:23.244336] [DEBUG] [LOCAL ] CMA: Loaded 50291 existing records from primary storage. [2025-09-17T07:33:23.285401] [INFO ] [MAIN ] CMA: Loaded 50291 primary data records. [2025-09-17T07:33:23.881954] [DEBUG] [MAIN ] CMBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:23.883768] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 20842 primary records. [2025-09-17T07:33:23.883950] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-17T07:33:23.921240] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-09-17T07:33:23.927042] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-17T07:33:23.927303] [DEBUG] [MAIN ] CMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:23.931101] [INFO ] [MAIN ] Derivative Progress: 436/2172 symbols completed. CMBT took 1.1s. Estimated remaining: 10m 55s. Rate: 159.1 symbols/min [2025-09-17T07:33:23.932070] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45782 primary records. [2025-09-17T07:33:23.932617] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:23.932752] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-17T07:33:23.947037] [DEBUG] [MAIN ] CMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:23.961022] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 50291 primary records. [2025-09-17T07:33:23.962097] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-17T07:33:23.967741] [DEBUG] [LOCAL ] CMCM: Loaded 4621 existing records from primary storage. [2025-09-17T07:33:23.969158] [INFO ] [MAIN ] CMCM: Loaded 4621 primary data records. [2025-09-17T07:33:23.970408] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-09-17T07:33:24.025479] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-17T07:33:24.062818] [INFO ] [MAIN ] Derivative Progress: 437/2172 symbols completed. CMC took 1.2s. Estimated remaining: 10m 53s. Rate: 159.3 symbols/min [2025-09-17T07:33:24.093372] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-09-17T07:33:24.103824] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:24.166161] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-17T07:33:24.173866] [INFO ] [MAIN ] Derivative Progress: 438/2172 symbols completed. CMA took 1.3s. Estimated remaining: 10m 52s. Rate: 159.6 symbols/min [2025-09-17T07:33:24.286065] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:24.323406] [DEBUG] [MAIN ] CMCM: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:33:24.324185] [INFO ] [MAIN ] CMCM: Generated 1793 derivative records from 4621 primary records. [2025-09-17T07:33:24.324475] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-17T07:33:24.362589] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1793 records). [2025-09-17T07:33:24.364621] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-17T07:33:24.366835] [INFO ] [MAIN ] Derivative Progress: 439/2172 symbols completed. CMCM took 0.4s. Estimated remaining: 10m 51s. Rate: 159.8 symbols/min [2025-09-17T07:33:24.368468] [DEBUG] [LOCAL ] CMI: Loaded 41940 existing records from primary storage. [2025-09-17T07:33:24.381764] [INFO ] [MAIN ] CMI: Loaded 41940 primary data records. [2025-09-17T07:33:24.381837] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:24.407321] [DEBUG] [LOCAL ] CMG: Loaded 53720 existing records from primary storage. [2025-09-17T07:33:24.426314] [INFO ] [MAIN ] CMG: Loaded 53720 primary data records. [2025-09-17T07:33:25.045482] [DEBUG] [LOCAL ] CMP: Loaded 36718 existing records from primary storage. [2025-09-17T07:33:25.053940] [INFO ] [MAIN ] CMP: Loaded 36718 primary data records. [2025-09-17T07:33:25.397039] [DEBUG] [MAIN ] CMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:25.397407] [DEBUG] [MAIN ] CMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:25.398355] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41940 primary records. [2025-09-17T07:33:25.399091] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53720 primary records. [2025-09-17T07:33:25.399248] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-17T07:33:25.399294] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-17T07:33:25.431164] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-09-17T07:33:25.432886] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-17T07:33:25.433965] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-09-17T07:33:25.435706] [INFO ] [MAIN ] Derivative Progress: 440/2172 symbols completed. CMG took 1.3s. Estimated remaining: 10m 53s. Rate: 159.1 symbols/min [2025-09-17T07:33:25.436035] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-17T07:33:25.438332] [INFO ] [MAIN ] Derivative Progress: 441/2172 symbols completed. CMI took 1.2s. Estimated remaining: 10m 51s. Rate: 159.5 symbols/min [2025-09-17T07:33:25.438455] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:25.438908] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:25.470823] [DEBUG] [MAIN ] CMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:25.472118] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 36718 primary records. [2025-09-17T07:33:25.472299] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-17T07:33:25.498959] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-09-17T07:33:25.499555] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-17T07:33:25.511656] [INFO ] [MAIN ] Derivative Progress: 442/2172 symbols completed. CMP took 1.1s. Estimated remaining: 10m 50s. Rate: 159.8 symbols/min [2025-09-17T07:33:25.513180] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:25.514360] [DEBUG] [LOCAL ] CMRE: Loaded 35823 existing records from primary storage. [2025-09-17T07:33:25.514876] [INFO ] [MAIN ] CMRE: Loaded 35823 primary data records. [2025-09-17T07:33:25.628254] [DEBUG] [LOCAL ] CMSA: Loaded 3350 existing records from primary storage. [2025-09-17T07:33:25.653168] [INFO ] [MAIN ] CMSA: Loaded 3350 primary data records. [2025-09-17T07:33:25.670762] [DEBUG] [LOCAL ] CMS: Loaded 52662 existing records from primary storage. [2025-09-17T07:33:25.726983] [INFO ] [MAIN ] CMS: Loaded 52662 primary data records. [2025-09-17T07:33:26.459357] [DEBUG] [MAIN ] CMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:26.460314] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35823 primary records. [2025-09-17T07:33:26.460526] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-17T07:33:26.507568] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-09-17T07:33:26.507864] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-17T07:33:26.510157] [INFO ] [MAIN ] Derivative Progress: 443/2172 symbols completed. CMRE took 1.1s. Estimated remaining: 10m 52s. Rate: 159.2 symbols/min [2025-09-17T07:33:26.510791] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:26.510720] [DEBUG] [MAIN ] CMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:26.511272] [DEBUG] [MAIN ] CMSA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:33:26.513191] [INFO ] [MAIN ] CMSA: Generated 1793 derivative records from 3350 primary records. [2025-09-17T07:33:26.513357] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52662 primary records. [2025-09-17T07:33:26.513462] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-17T07:33:26.513521] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-17T07:33:26.542763] [DEBUG] [LOCAL ] CMSC: Loaded 5117 existing records from primary storage. [2025-09-17T07:33:26.544960] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-09-17T07:33:26.548833] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1793 records). [2025-09-17T07:33:26.548968] [INFO ] [MAIN ] CMSC: Loaded 5117 primary data records. [2025-09-17T07:33:26.546091] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-17T07:33:26.549036] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-17T07:33:26.581242] [INFO ] [MAIN ] Derivative Progress: 444/2172 symbols completed. CMS took 1.1s. Estimated remaining: 10m 50s. Rate: 159.5 symbols/min [2025-09-17T07:33:26.622147] [INFO ] [MAIN ] Derivative Progress: 445/2172 symbols completed. CMSA took 1.1s. Estimated remaining: 10m 49s. Rate: 159.8 symbols/min [2025-09-17T07:33:26.616976] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:26.651133] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:26.879483] [DEBUG] [LOCAL ] CMSD: Loaded 8150 existing records from primary storage. [2025-09-17T07:33:26.879719] [INFO ] [MAIN ] CMSD: Loaded 8150 primary data records. [2025-09-17T07:33:27.193067] [DEBUG] [LOCAL ] CMTG: Loaded 37899 existing records from primary storage. [2025-09-17T07:33:27.193660] [INFO ] [MAIN ] CMTG: Loaded 37899 primary data records. [2025-09-17T07:33:27.509575] [DEBUG] [MAIN ] CMSC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:27.510480] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 5117 primary records. [2025-09-17T07:33:27.510845] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-17T07:33:27.534756] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-09-17T07:33:27.553893] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-17T07:33:27.554192] [DEBUG] [MAIN ] CMSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:27.557104] [INFO ] [MAIN ] Derivative Progress: 446/2172 symbols completed. CMSC took 1.0s. Estimated remaining: 10m 50s. Rate: 159.2 symbols/min [2025-09-17T07:33:27.558167] [INFO ] [MAIN ] CMSD: Generated 1794 derivative records from 8150 primary records. [2025-09-17T07:33:27.558613] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-17T07:33:27.558559] [INFO ] [MAIN ] CMU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:27.580544] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-09-17T07:33:27.582155] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-17T07:33:27.589522] [INFO ] [MAIN ] Derivative Progress: 447/2172 symbols completed. CMSD took 1.0s. Estimated remaining: 10m 49s. Rate: 159.6 symbols/min [2025-09-17T07:33:27.587160] [DEBUG] [LOCAL ] CMU: Loaded 7307 existing records from primary storage. [2025-09-17T07:33:27.590257] [INFO ] [MAIN ] CMU: Loaded 7307 primary data records. [2025-09-17T07:33:27.590514] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:27.629233] [DEBUG] [MAIN ] CMTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:27.648870] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 37899 primary records. [2025-09-17T07:33:27.684484] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-17T07:33:27.946100] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-09-17T07:33:27.947275] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-17T07:33:27.950010] [INFO ] [MAIN ] Derivative Progress: 448/2172 symbols completed. CMTG took 1.3s. Estimated remaining: 10m 48s. Rate: 159.6 symbols/min [2025-09-17T07:33:27.951103] [DEBUG] [LOCAL ] CNA: Loaded 32891 existing records from primary storage. [2025-09-17T07:33:27.951729] [INFO ] [MAIN ] CNA: Loaded 32891 primary data records. [2025-09-17T07:33:28.272128] [DEBUG] [MAIN ] CMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:28.273166] [INFO ] [MAIN ] CMU: Generated 1794 derivative records from 7307 primary records. [2025-09-17T07:33:28.273671] [DEBUG] [LOCAL ] CMU: Saving derivative data. [2025-09-17T07:33:28.289982] [DEBUG] [LOCAL ] CMU: Derivative data saved (1794 records). [2025-09-17T07:33:28.290152] [INFO ] [MAIN ] CMU: Successfully saved derivative data. [2025-09-17T07:33:28.292347] [INFO ] [MAIN ] Derivative Progress: 449/2172 symbols completed. CMU took 0.7s. Estimated remaining: 10m 48s. Rate: 159.6 symbols/min [2025-09-17T07:33:28.309288] [DEBUG] [MAIN ] CNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:28.310111] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32891 primary records. [2025-09-17T07:33:28.310194] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-17T07:33:28.326025] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-09-17T07:33:28.326107] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-17T07:33:28.328055] [INFO ] [MAIN ] Derivative Progress: 450/2172 symbols completed. CNA took 0.7s. Estimated remaining: 10m 46s. Rate: 159.9 symbols/min [2025-09-17T07:33:28.328768] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:28.328561] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:28.328924] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:28.341925] [DEBUG] [LOCAL ] CNF: Loaded 10664 existing records from primary storage. [2025-09-17T07:33:28.342083] [INFO ] [MAIN ] CNF: Loaded 10664 primary data records. [2025-09-17T07:33:28.685867] [DEBUG] [LOCAL ] CNC: Loaded 53728 existing records from primary storage. [2025-09-17T07:33:28.687278] [INFO ] [MAIN ] CNC: Loaded 53728 primary data records. [2025-09-17T07:33:28.747098] [DEBUG] [LOCAL ] CNH: Loaded 53563 existing records from primary storage. [2025-09-17T07:33:28.797976] [INFO ] [MAIN ] CNH: Loaded 53563 primary data records. [2025-09-17T07:33:29.197098] [DEBUG] [MAIN ] CNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:29.230878] [INFO ] [MAIN ] CNF: Generated 1794 derivative records from 10664 primary records. [2025-09-17T07:33:29.350451] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-17T07:33:29.383734] [DEBUG] [LOCAL ] CNF: Derivative data saved (1794 records). [2025-09-17T07:33:29.385329] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-17T07:33:29.388430] [INFO ] [MAIN ] Derivative Progress: 451/2172 symbols completed. CNF took 1.1s. Estimated remaining: 10m 48s. Rate: 159.3 symbols/min [2025-09-17T07:33:29.389413] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:29.409518] [DEBUG] [MAIN ] CNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:29.410672] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53728 primary records. [2025-09-17T07:33:29.411020] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-17T07:33:29.444060] [DEBUG] [MAIN ] CNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:29.445075] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-09-17T07:33:29.445225] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-17T07:33:29.445945] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53563 primary records. [2025-09-17T07:33:29.447944] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-17T07:33:29.447723] [INFO ] [MAIN ] Derivative Progress: 452/2172 symbols completed. CNC took 1.1s. Estimated remaining: 10m 47s. Rate: 159.6 symbols/min [2025-09-17T07:33:29.449234] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:29.478916] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-09-17T07:33:29.479089] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-17T07:33:29.482020] [INFO ] [MAIN ] Derivative Progress: 453/2172 symbols completed. CNH took 1.2s. Estimated remaining: 10m 45s. Rate: 159.9 symbols/min [2025-09-17T07:33:29.482353] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:29.503001] [DEBUG] [LOCAL ] CNI: Loaded 51669 existing records from primary storage. [2025-09-17T07:33:29.503296] [INFO ] [MAIN ] CNI: Loaded 51669 primary data records. [2025-09-17T07:33:29.854464] [DEBUG] [LOCAL ] CNK: Loaded 52898 existing records from primary storage. [2025-09-17T07:33:29.868584] [INFO ] [MAIN ] CNK: Loaded 52898 primary data records. [2025-09-17T07:33:29.891535] [DEBUG] [LOCAL ] CNM: Loaded 50935 existing records from primary storage. [2025-09-17T07:33:29.927700] [INFO ] [MAIN ] CNM: Loaded 50935 primary data records. [2025-09-17T07:33:30.522252] [DEBUG] [MAIN ] CNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:30.524510] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51669 primary records. [2025-09-17T07:33:30.525136] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-17T07:33:30.559789] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-09-17T07:33:30.559151] [DEBUG] [MAIN ] CNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:30.560116] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-17T07:33:30.562818] [INFO ] [MAIN ] Derivative Progress: 454/2172 symbols completed. CNI took 1.2s. Estimated remaining: 10m 47s. Rate: 159.2 symbols/min [2025-09-17T07:33:30.576061] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52898 primary records. [2025-09-17T07:33:30.576482] [DEBUG] [MAIN ] CNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:30.576553] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-17T07:33:30.577138] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 50935 primary records. [2025-09-17T07:33:30.577312] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:30.578235] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-17T07:33:30.609400] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-09-17T07:33:30.610334] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-17T07:33:30.610830] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-09-17T07:33:30.612856] [INFO ] [MAIN ] Derivative Progress: 455/2172 symbols completed. CNK took 1.2s. Estimated remaining: 10m 46s. Rate: 159.6 symbols/min [2025-09-17T07:33:30.613423] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-17T07:33:30.613495] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:30.616557] [INFO ] [MAIN ] Derivative Progress: 456/2172 symbols completed. CNM took 1.1s. Estimated remaining: 10m 44s. Rate: 159.9 symbols/min [2025-09-17T07:33:30.617148] [INFO ] [MAIN ] CNO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:30.639434] [DEBUG] [LOCAL ] CNMD: Loaded 32711 existing records from primary storage. [2025-09-17T07:33:30.639680] [INFO ] [MAIN ] CNMD: Loaded 32711 primary data records. [2025-09-17T07:33:30.984943] [DEBUG] [LOCAL ] CNO: Loaded 41625 existing records from primary storage. [2025-09-17T07:33:31.001349] [DEBUG] [LOCAL ] CNNE: Loaded 36921 existing records from primary storage. [2025-09-17T07:33:31.001981] [INFO ] [MAIN ] CNNE: Loaded 36921 primary data records. [2025-09-17T07:33:31.001671] [INFO ] [MAIN ] CNO: Loaded 41625 primary data records. [2025-09-17T07:33:31.627032] [DEBUG] [MAIN ] CNMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:31.628789] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32711 primary records. [2025-09-17T07:33:31.628926] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-17T07:33:31.650048] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-09-17T07:33:31.650142] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-17T07:33:31.652361] [INFO ] [MAIN ] Derivative Progress: 457/2172 symbols completed. CNMD took 1.1s. Estimated remaining: 10m 46s. Rate: 159.3 symbols/min [2025-09-17T07:33:31.652835] [INFO ] [MAIN ] CNP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:31.671149] [DEBUG] [MAIN ] CNNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:31.671926] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 36921 primary records. [2025-09-17T07:33:31.672218] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-17T07:33:31.701550] [DEBUG] [MAIN ] CNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:31.706037] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-09-17T07:33:31.706777] [INFO ] [MAIN ] CNO: Generated 1794 derivative records from 41625 primary records. [2025-09-17T07:33:31.706962] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-17T07:33:31.709813] [INFO ] [MAIN ] Derivative Progress: 458/2172 symbols completed. CNNE took 1.1s. Estimated remaining: 10m 44s. Rate: 159.6 symbols/min [2025-09-17T07:33:31.710074] [DEBUG] [LOCAL ] CNO: Saving derivative data. [2025-09-17T07:33:31.710360] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:31.741490] [DEBUG] [LOCAL ] CNO: Derivative data saved (1794 records). [2025-09-17T07:33:31.741823] [INFO ] [MAIN ] CNO: Successfully saved derivative data. [2025-09-17T07:33:31.744431] [INFO ] [MAIN ] Derivative Progress: 459/2172 symbols completed. CNO took 1.1s. Estimated remaining: 10m 43s. Rate: 159.9 symbols/min [2025-09-17T07:33:31.745826] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:31.762829] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-17T07:33:31.763237] [INFO ] [MAIN ] CNP: Loaded 53469 primary data records. [2025-09-17T07:33:31.988628] [DEBUG] [LOCAL ] CNS: Loaded 21168 existing records from primary storage. [2025-09-17T07:33:32.086243] [DEBUG] [LOCAL ] CNQ: Loaded 53584 existing records from primary storage. [2025-09-17T07:33:32.091485] [INFO ] [MAIN ] CNS: Loaded 21168 primary data records. [2025-09-17T07:33:32.101082] [INFO ] [MAIN ] CNQ: Loaded 53584 primary data records. [2025-09-17T07:33:32.787094] [DEBUG] [MAIN ] CNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:32.790682] [INFO ] [MAIN ] CNP: Generated 1794 derivative records from 53469 primary records. [2025-09-17T07:33:32.791288] [DEBUG] [LOCAL ] CNP: Saving derivative data. [2025-09-17T07:33:32.810029] [DEBUG] [LOCAL ] CNP: Derivative data saved (1794 records). [2025-09-17T07:33:32.810598] [INFO ] [MAIN ] CNP: Successfully saved derivative data. [2025-09-17T07:33:32.812765] [INFO ] [MAIN ] Derivative Progress: 460/2172 symbols completed. CNP took 1.2s. Estimated remaining: 10m 45s. Rate: 159.3 symbols/min [2025-09-17T07:33:32.814743] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:32.833480] [DEBUG] [MAIN ] CNQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:32.834308] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53584 primary records. [2025-09-17T07:33:32.834694] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-17T07:33:32.854912] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-09-17T07:33:32.855384] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-17T07:33:32.857809] [INFO ] [MAIN ] Derivative Progress: 461/2172 symbols completed. CNQ took 1.1s. Estimated remaining: 10m 43s. Rate: 159.6 symbols/min [2025-09-17T07:33:32.866120] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:32.872274] [DEBUG] [MAIN ] CNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:32.887384] [INFO ] [MAIN ] CNS: Generated 1794 derivative records from 21168 primary records. [2025-09-17T07:33:32.887732] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-17T07:33:32.920189] [DEBUG] [LOCAL ] CNX: Loaded 51387 existing records from primary storage. [2025-09-17T07:33:32.921322] [INFO ] [MAIN ] CNX: Loaded 51387 primary data records. [2025-09-17T07:33:32.921137] [DEBUG] [LOCAL ] CNS: Derivative data saved (1794 records). [2025-09-17T07:33:32.921533] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-17T07:33:32.924236] [INFO ] [MAIN ] Derivative Progress: 462/2172 symbols completed. CNS took 1.2s. Estimated remaining: 10m 42s. Rate: 159.8 symbols/min [2025-09-17T07:33:32.971146] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:33.248683] [DEBUG] [LOCAL ] CODI: Loaded 39540 existing records from primary storage. [2025-09-17T07:33:33.248969] [INFO ] [MAIN ] CODI: Loaded 39540 primary data records. [2025-09-17T07:33:33.580569] [DEBUG] [LOCAL ] COF: Loaded 53612 existing records from primary storage. [2025-09-17T07:33:33.581333] [INFO ] [MAIN ] COF: Loaded 53612 primary data records. [2025-09-17T07:33:33.787207] [DEBUG] [MAIN ] CNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:33.902721] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51387 primary records. [2025-09-17T07:33:33.904219] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-17T07:33:33.924243] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-09-17T07:33:33.925174] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-17T07:33:33.929110] [INFO ] [MAIN ] Derivative Progress: 463/2172 symbols completed. CNX took 1.1s. Estimated remaining: 10m 44s. Rate: 159.3 symbols/min [2025-09-17T07:33:33.944894] [DEBUG] [MAIN ] CODI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:33.947116] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 39540 primary records. [2025-09-17T07:33:33.947501] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-17T07:33:33.965451] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-09-17T07:33:33.965549] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-17T07:33:33.967773] [INFO ] [MAIN ] Derivative Progress: 464/2172 symbols completed. CODI took 1.1s. Estimated remaining: 10m 42s. Rate: 159.6 symbols/min [2025-09-17T07:33:33.987893] [DEBUG] [MAIN ] COF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:33.988718] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53612 primary records. [2025-09-17T07:33:33.988799] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-17T07:33:34.009393] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-09-17T07:33:34.009586] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-17T07:33:34.012369] [INFO ] [MAIN ] Derivative Progress: 465/2172 symbols completed. COF took 1.1s. Estimated remaining: 10m 41s. Rate: 159.9 symbols/min [2025-09-17T07:33:34.013341] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:34.013125] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:34.013753] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:34.094803] [DEBUG] [LOCAL ] COMP: Loaded 53386 existing records from primary storage. [2025-09-17T07:33:34.124002] [INFO ] [MAIN ] COMP: Loaded 53386 primary data records. [2025-09-17T07:33:34.125939] [DEBUG] [LOCAL ] COLD: Loaded 51879 existing records from primary storage. [2025-09-17T07:33:34.137961] [DEBUG] [LOCAL ] COHR: Loaded 53372 existing records from primary storage. [2025-09-17T07:33:34.147982] [INFO ] [MAIN ] COHR: Loaded 53372 primary data records. [2025-09-17T07:33:34.147889] [INFO ] [MAIN ] COLD: Loaded 51879 primary data records. [2025-09-17T07:33:35.145325] [DEBUG] [MAIN ] COLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:35.146938] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 51879 primary records. [2025-09-17T07:33:35.146057] [DEBUG] [MAIN ] COMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:35.147178] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-17T07:33:35.155686] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53386 primary records. [2025-09-17T07:33:35.161476] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-17T07:33:35.161791] [DEBUG] [MAIN ] COHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:35.171462] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53372 primary records. [2025-09-17T07:33:35.175040] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-17T07:33:35.206749] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-09-17T07:33:35.208022] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-17T07:33:35.212274] [INFO ] [MAIN ] Derivative Progress: 466/2172 symbols completed. COLD took 1.2s. Estimated remaining: 10m 43s. Rate: 159.1 symbols/min [2025-09-17T07:33:35.212361] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-09-17T07:33:35.213807] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-17T07:33:35.214171] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:35.216762] [INFO ] [MAIN ] Derivative Progress: 467/2172 symbols completed. COHR took 1.2s. Estimated remaining: 10m 42s. Rate: 159.5 symbols/min [2025-09-17T07:33:35.218139] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:35.218480] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-09-17T07:33:35.219026] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-17T07:33:35.222419] [INFO ] [MAIN ] Derivative Progress: 468/2172 symbols completed. COMP took 1.2s. Estimated remaining: 10m 40s. Rate: 159.8 symbols/min [2025-09-17T07:33:35.222886] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:35.270129] [DEBUG] [LOCAL ] COOK: Loaded 24123 existing records from primary storage. [2025-09-17T07:33:35.270781] [DEBUG] [LOCAL ] CON: Loaded 38860 existing records from primary storage. [2025-09-17T07:33:35.271084] [INFO ] [MAIN ] COOK: Loaded 24123 primary data records. [2025-09-17T07:33:35.271401] [INFO ] [MAIN ] CON: Loaded 38860 primary data records. [2025-09-17T07:33:35.731926] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-17T07:33:35.783010] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-09-17T07:33:36.244196] [DEBUG] [MAIN ] CON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:36.246061] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38860 primary records. [2025-09-17T07:33:36.246317] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-17T07:33:36.278946] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-09-17T07:33:36.279752] [DEBUG] [MAIN ] COOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:36.279991] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-17T07:33:36.280775] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24123 primary records. [2025-09-17T07:33:36.283006] [INFO ] [MAIN ] Derivative Progress: 469/2172 symbols completed. CON took 1.1s. Estimated remaining: 10m 42s. Rate: 159.2 symbols/min [2025-09-17T07:33:36.283212] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:36.283245] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-17T07:33:36.312074] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-09-17T07:33:36.316735] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-17T07:33:36.319084] [INFO ] [MAIN ] Derivative Progress: 470/2172 symbols completed. COOK took 1.1s. Estimated remaining: 10m 40s. Rate: 159.5 symbols/min [2025-09-17T07:33:36.319903] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:36.319726] [DEBUG] [MAIN ] COP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:36.321174] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-09-17T07:33:36.321496] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-17T07:33:36.338884] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-09-17T07:33:36.339067] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-17T07:33:36.341722] [INFO ] [MAIN ] Derivative Progress: 471/2172 symbols completed. COP took 1.1s. Estimated remaining: 10m 39s. Rate: 159.8 symbols/min [2025-09-17T07:33:36.342022] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:36.383313] [DEBUG] [LOCAL ] COR: Loaded 47345 existing records from primary storage. [2025-09-17T07:33:36.383848] [INFO ] [MAIN ] COR: Loaded 47345 primary data records. [2025-09-17T07:33:36.517577] [DEBUG] [LOCAL ] COUR: Loaded 48849 existing records from primary storage. [2025-09-17T07:33:36.528822] [INFO ] [MAIN ] COUR: Loaded 48849 primary data records. [2025-09-17T07:33:36.746014] [DEBUG] [LOCAL ] CP: Loaded 53294 existing records from primary storage. [2025-09-17T07:33:36.848525] [INFO ] [MAIN ] CP: Loaded 53294 primary data records. [2025-09-17T07:33:37.426431] [DEBUG] [MAIN ] COR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:37.428510] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 47345 primary records. [2025-09-17T07:33:37.428688] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-17T07:33:37.447398] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-09-17T07:33:37.460192] [DEBUG] [MAIN ] COUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:37.460235] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-17T07:33:37.462902] [INFO ] [MAIN ] Derivative Progress: 472/2172 symbols completed. COR took 1.2s. Estimated remaining: 10m 41s. Rate: 159.1 symbols/min [2025-09-17T07:33:37.461065] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 48849 primary records. [2025-09-17T07:33:37.463253] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-17T07:33:37.463402] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:37.481383] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-09-17T07:33:37.481822] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-17T07:33:37.484203] [INFO ] [MAIN ] Derivative Progress: 473/2172 symbols completed. COUR took 1.2s. Estimated remaining: 10m 39s. Rate: 159.5 symbols/min [2025-09-17T07:33:37.484732] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:37.501586] [DEBUG] [MAIN ] CP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:37.510146] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53294 primary records. [2025-09-17T07:33:37.510459] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-17T07:33:37.542978] [DEBUG] [LOCAL ] CPA: Loaded 29179 existing records from primary storage. [2025-09-17T07:33:37.544326] [INFO ] [MAIN ] CPA: Loaded 29179 primary data records. [2025-09-17T07:33:37.545600] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-09-17T07:33:37.600275] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-17T07:33:37.636363] [INFO ] [MAIN ] Derivative Progress: 474/2172 symbols completed. CP took 1.3s. Estimated remaining: 10m 38s. Rate: 159.7 symbols/min [2025-09-17T07:33:37.659792] [DEBUG] [LOCAL ] CPAY: Loaded 31348 existing records from primary storage. [2025-09-17T07:33:37.659183] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:37.659953] [INFO ] [MAIN ] CPAY: Loaded 31348 primary data records. [2025-09-17T07:33:38.023821] [DEBUG] [LOCAL ] CPF: Loaded 15552 existing records from primary storage. [2025-09-17T07:33:38.032535] [INFO ] [MAIN ] CPF: Loaded 15552 primary data records. [2025-09-17T07:33:38.488948] [DEBUG] [MAIN ] CPA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:38.491813] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 29179 primary records. [2025-09-17T07:33:38.492361] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-17T07:33:38.514072] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-09-17T07:33:38.514357] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-17T07:33:38.516433] [INFO ] [MAIN ] Derivative Progress: 475/2172 symbols completed. CPA took 1.1s. Estimated remaining: 10m 40s. Rate: 159.2 symbols/min [2025-09-17T07:33:38.529860] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:38.530358] [DEBUG] [MAIN ] CPAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:38.531621] [INFO ] [MAIN ] CPAY: Generated 1794 derivative records from 31348 primary records. [2025-09-17T07:33:38.532077] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-17T07:33:38.564569] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1794 records). [2025-09-17T07:33:38.574399] [DEBUG] [MAIN ] CPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:38.574075] [DEBUG] [LOCAL ] CPK: Loaded 13129 existing records from primary storage. [2025-09-17T07:33:38.575326] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15552 primary records. [2025-09-17T07:33:38.575396] [INFO ] [MAIN ] CPK: Loaded 13129 primary data records. [2025-09-17T07:33:38.575569] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-17T07:33:38.574605] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-17T07:33:38.578579] [INFO ] [MAIN ] Derivative Progress: 476/2172 symbols completed. CPAY took 1.1s. Estimated remaining: 10m 38s. Rate: 159.5 symbols/min [2025-09-17T07:33:38.606755] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:38.697170] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-09-17T07:33:38.701145] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-17T07:33:38.709930] [INFO ] [MAIN ] Derivative Progress: 477/2172 symbols completed. CPF took 1.1s. Estimated remaining: 10m 37s. Rate: 159.7 symbols/min [2025-09-17T07:33:38.725735] [INFO ] [MAIN ] CPRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:38.988240] [DEBUG] [LOCAL ] CPNG: Loaded 53671 existing records from primary storage. [2025-09-17T07:33:38.988689] [INFO ] [MAIN ] CPNG: Loaded 53671 primary data records. [2025-09-17T07:33:39.120629] [DEBUG] [LOCAL ] CPRI: Loaded 52592 existing records from primary storage. [2025-09-17T07:33:39.121070] [DEBUG] [MAIN ] CPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:39.121554] [INFO ] [MAIN ] CPRI: Loaded 52592 primary data records. [2025-09-17T07:33:39.122141] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13129 primary records. [2025-09-17T07:33:39.159035] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-17T07:33:39.476134] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-09-17T07:33:39.504638] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-17T07:33:39.512095] [INFO ] [MAIN ] Derivative Progress: 478/2172 symbols completed. CPK took 1.0s. Estimated remaining: 10m 38s. Rate: 159.3 symbols/min [2025-09-17T07:33:39.648992] [DEBUG] [MAIN ] CPNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:39.649784] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53671 primary records. [2025-09-17T07:33:39.650081] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-17T07:33:39.670297] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-09-17T07:33:39.670533] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-17T07:33:39.672277] [INFO ] [MAIN ] Derivative Progress: 479/2172 symbols completed. CPNG took 1.1s. Estimated remaining: 10m 37s. Rate: 159.5 symbols/min [2025-09-17T07:33:39.684811] [DEBUG] [MAIN ] CPRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:39.685475] [INFO ] [MAIN ] CPRI: Generated 1794 derivative records from 52592 primary records. [2025-09-17T07:33:39.685563] [DEBUG] [LOCAL ] CPRI: Saving derivative data. [2025-09-17T07:33:39.701320] [DEBUG] [LOCAL ] CPRI: Derivative data saved (1794 records). [2025-09-17T07:33:39.701414] [INFO ] [MAIN ] CPRI: Successfully saved derivative data. [2025-09-17T07:33:39.703598] [INFO ] [MAIN ] Derivative Progress: 480/2172 symbols completed. CPRI took 1.0s. Estimated remaining: 10m 35s. Rate: 159.8 symbols/min [2025-09-17T07:33:39.704074] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:39.704223] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:39.704279] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:39.741838] [DEBUG] [LOCAL ] CPS: Loaded 26379 existing records from primary storage. [2025-09-17T07:33:39.742031] [INFO ] [MAIN ] CPS: Loaded 26379 primary data records. [2025-09-17T07:33:39.742431] [DEBUG] [LOCAL ] CQP: Loaded 20155 existing records from primary storage. [2025-09-17T07:33:39.763143] [INFO ] [MAIN ] CQP: Loaded 20155 primary data records. [2025-09-17T07:33:40.126390] [DEBUG] [LOCAL ] CPT: Loaded 44332 existing records from primary storage. [2025-09-17T07:33:40.240327] [INFO ] [MAIN ] CPT: Loaded 44332 primary data records. [2025-09-17T07:33:40.738735] [DEBUG] [MAIN ] CQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:40.739601] [DEBUG] [MAIN ] CPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:40.740299] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 20155 primary records. [2025-09-17T07:33:40.740944] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 26379 primary records. [2025-09-17T07:33:40.741090] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-17T07:33:40.741931] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-17T07:33:40.781835] [DEBUG] [MAIN ] CPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:40.784678] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44332 primary records. [2025-09-17T07:33:40.786849] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-09-17T07:33:40.786284] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-17T07:33:40.787714] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-17T07:33:40.791059] [INFO ] [MAIN ] Derivative Progress: 481/2172 symbols completed. CQP took 1.1s. Estimated remaining: 10m 37s. Rate: 159.2 symbols/min [2025-09-17T07:33:40.801189] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:40.800261] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-09-17T07:33:40.801357] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-17T07:33:40.809379] [INFO ] [MAIN ] Derivative Progress: 482/2172 symbols completed. CPS took 1.1s. Estimated remaining: 10m 36s. Rate: 159.5 symbols/min [2025-09-17T07:33:40.811137] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:40.810916] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-09-17T07:33:40.811676] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-17T07:33:40.814354] [INFO ] [MAIN ] Derivative Progress: 483/2172 symbols completed. CPT took 1.1s. Estimated remaining: 10m 34s. Rate: 159.8 symbols/min [2025-09-17T07:33:40.814858] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:40.838620] [DEBUG] [LOCAL ] CR: Loaded 24734 existing records from primary storage. [2025-09-17T07:33:40.838845] [INFO ] [MAIN ] CR: Loaded 24734 primary data records. [2025-09-17T07:33:41.188487] [DEBUG] [LOCAL ] CRC: Loaded 44456 existing records from primary storage. [2025-09-17T07:33:41.189791] [DEBUG] [LOCAL ] CRBG: Loaded 52342 existing records from primary storage. [2025-09-17T07:33:41.190001] [INFO ] [MAIN ] CRBG: Loaded 52342 primary data records. [2025-09-17T07:33:41.190064] [INFO ] [MAIN ] CRC: Loaded 44456 primary data records. [2025-09-17T07:33:41.871809] [DEBUG] [MAIN ] CR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:41.874711] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24734 primary records. [2025-09-17T07:33:41.874822] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-17T07:33:41.894231] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-09-17T07:33:41.894339] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-17T07:33:41.896298] [INFO ] [MAIN ] Derivative Progress: 484/2172 symbols completed. CR took 1.1s. Estimated remaining: 10m 36s. Rate: 159.2 symbols/min [2025-09-17T07:33:41.897401] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:41.919658] [DEBUG] [MAIN ] CRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:41.927982] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44456 primary records. [2025-09-17T07:33:41.932967] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-17T07:33:41.933297] [DEBUG] [MAIN ] CRBG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:41.934810] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52342 primary records. [2025-09-17T07:33:41.942557] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-17T07:33:41.951171] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-09-17T07:33:41.951474] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-17T07:33:41.962293] [INFO ] [MAIN ] Derivative Progress: 485/2172 symbols completed. CRC took 1.1s. Estimated remaining: 10m 35s. Rate: 159.5 symbols/min [2025-09-17T07:33:41.969122] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-09-17T07:33:41.983184] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-17T07:33:41.969058] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:41.986909] [INFO ] [MAIN ] Derivative Progress: 486/2172 symbols completed. CRBG took 1.2s. Estimated remaining: 10m 33s. Rate: 159.8 symbols/min [2025-09-17T07:33:41.987557] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:42.008372] [DEBUG] [LOCAL ] CRGY: Loaded 52518 existing records from primary storage. [2025-09-17T07:33:42.008632] [INFO ] [MAIN ] CRGY: Loaded 52518 primary data records. [2025-09-17T07:33:42.365340] [DEBUG] [LOCAL ] CRI: Loaded 50019 existing records from primary storage. [2025-09-17T07:33:42.365740] [INFO ] [MAIN ] CRI: Loaded 50019 primary data records. [2025-09-17T07:33:42.366343] [DEBUG] [LOCAL ] CRH: Loaded 53476 existing records from primary storage. [2025-09-17T07:33:42.372445] [INFO ] [MAIN ] CRH: Loaded 53476 primary data records. [2025-09-17T07:33:43.047409] [DEBUG] [MAIN ] CRGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:43.048997] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52518 primary records. [2025-09-17T07:33:43.049953] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-17T07:33:43.068359] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-09-17T07:33:43.069860] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-17T07:33:43.072248] [INFO ] [MAIN ] Derivative Progress: 487/2172 symbols completed. CRGY took 1.2s. Estimated remaining: 10m 35s. Rate: 159.2 symbols/min [2025-09-17T07:33:43.072591] [INFO ] [MAIN ] CRK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:43.108045] [DEBUG] [MAIN ] CRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:43.109336] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 50019 primary records. [2025-09-17T07:33:43.108527] [DEBUG] [MAIN ] CRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:43.109530] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-17T07:33:43.110664] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53476 primary records. [2025-09-17T07:33:43.110923] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-17T07:33:43.138957] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-09-17T07:33:43.140249] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-17T07:33:43.144739] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-09-17T07:33:43.142583] [INFO ] [MAIN ] Derivative Progress: 488/2172 symbols completed. CRI took 1.2s. Estimated remaining: 10m 34s. Rate: 159.4 symbols/min [2025-09-17T07:33:43.145016] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-17T07:33:43.148179] [INFO ] [MAIN ] Derivative Progress: 489/2172 symbols completed. CRH took 1.2s. Estimated remaining: 10m 32s. Rate: 159.8 symbols/min [2025-09-17T07:33:43.148603] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:43.148470] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:43.187350] [DEBUG] [LOCAL ] CRK: Loaded 52103 existing records from primary storage. [2025-09-17T07:33:43.187598] [INFO ] [MAIN ] CRK: Loaded 52103 primary data records. [2025-09-17T07:33:43.402219] [DEBUG] [LOCAL ] CRL: Loaded 43871 existing records from primary storage. [2025-09-17T07:33:43.504982] [INFO ] [MAIN ] CRL: Loaded 43871 primary data records. [2025-09-17T07:33:43.535324] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-17T07:33:43.568336] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-09-17T07:33:44.169950] [DEBUG] [MAIN ] CRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:44.171275] [INFO ] [MAIN ] CRK: Generated 1794 derivative records from 52103 primary records. [2025-09-17T07:33:44.172116] [DEBUG] [LOCAL ] CRK: Saving derivative data. [2025-09-17T07:33:44.191025] [DEBUG] [LOCAL ] CRK: Derivative data saved (1794 records). [2025-09-17T07:33:44.192192] [INFO ] [MAIN ] CRK: Successfully saved derivative data. [2025-09-17T07:33:44.195334] [INFO ] [MAIN ] Derivative Progress: 490/2172 symbols completed. CRK took 1.1s. Estimated remaining: 10m 34s. Rate: 159.2 symbols/min [2025-09-17T07:33:44.196249] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:44.210105] [DEBUG] [MAIN ] CRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:44.211848] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 43871 primary records. [2025-09-17T07:33:44.212068] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-17T07:33:44.232837] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-09-17T07:33:44.246018] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-17T07:33:44.248456] [INFO ] [MAIN ] Derivative Progress: 491/2172 symbols completed. CRL took 1.1s. Estimated remaining: 10m 32s. Rate: 159.5 symbols/min [2025-09-17T07:33:44.246565] [DEBUG] [MAIN ] CRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:44.248916] [INFO ] [MAIN ] CRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:44.249794] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-09-17T07:33:44.250088] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-17T07:33:44.269559] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-09-17T07:33:44.269908] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-17T07:33:44.273131] [INFO ] [MAIN ] Derivative Progress: 492/2172 symbols completed. CRM took 1.1s. Estimated remaining: 10m 31s. Rate: 159.8 symbols/min [2025-09-17T07:33:44.273567] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:44.277321] [DEBUG] [LOCAL ] CRT: Loaded 4909 existing records from primary storage. [2025-09-17T07:33:44.277507] [INFO ] [MAIN ] CRT: Loaded 4909 primary data records. [2025-09-17T07:33:44.506715] [DEBUG] [LOCAL ] CRS: Loaded 43571 existing records from primary storage. [2025-09-17T07:33:44.622417] [INFO ] [MAIN ] CRS: Loaded 43571 primary data records. [2025-09-17T07:33:44.692562] [DEBUG] [LOCAL ] CSAN: Loaded 42022 existing records from primary storage. [2025-09-17T07:33:44.704160] [INFO ] [MAIN ] CSAN: Loaded 42022 primary data records. [2025-09-17T07:33:45.325714] [DEBUG] [MAIN ] CRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:45.328170] [INFO ] [MAIN ] CRT: Generated 1794 derivative records from 4909 primary records. [2025-09-17T07:33:45.330214] [DEBUG] [LOCAL ] CRT: Saving derivative data. [2025-09-17T07:33:45.348816] [DEBUG] [LOCAL ] CRT: Derivative data saved (1794 records). [2025-09-17T07:33:45.349006] [INFO ] [MAIN ] CRT: Successfully saved derivative data. [2025-09-17T07:33:45.353174] [INFO ] [MAIN ] Derivative Progress: 493/2172 symbols completed. CRT took 1.1s. Estimated remaining: 10m 33s. Rate: 159.2 symbols/min [2025-09-17T07:33:45.371574] [DEBUG] [MAIN ] CRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:45.372496] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43571 primary records. [2025-09-17T07:33:45.372725] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-17T07:33:45.393984] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-09-17T07:33:45.394245] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-17T07:33:45.396423] [INFO ] [MAIN ] Derivative Progress: 494/2172 symbols completed. CRS took 1.2s. Estimated remaining: 10m 31s. Rate: 159.4 symbols/min [2025-09-17T07:33:45.410062] [DEBUG] [MAIN ] CSAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:45.410948] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42022 primary records. [2025-09-17T07:33:45.411031] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-17T07:33:45.434348] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-09-17T07:33:45.434582] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-17T07:33:45.438553] [INFO ] [MAIN ] Derivative Progress: 495/2172 symbols completed. CSAN took 1.2s. Estimated remaining: 10m 30s. Rate: 159.7 symbols/min [2025-09-17T07:33:45.439375] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:45.439521] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:45.439756] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:45.461180] [DEBUG] [LOCAL ] CSR: Loaded 12356 existing records from primary storage. [2025-09-17T07:33:45.461404] [INFO ] [MAIN ] CSR: Loaded 12356 primary data records. [2025-09-17T07:33:45.642058] [DEBUG] [LOCAL ] CSL: Loaded 31340 existing records from primary storage. [2025-09-17T07:33:45.668048] [INFO ] [MAIN ] CSL: Loaded 31340 primary data records. [2025-09-17T07:33:45.689876] [DEBUG] [LOCAL ] CSTM: Loaded 47878 existing records from primary storage. [2025-09-17T07:33:45.710905] [INFO ] [MAIN ] CSTM: Loaded 47878 primary data records. [2025-09-17T07:33:46.716368] [DEBUG] [MAIN ] CSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:46.717942] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 12356 primary records. [2025-09-17T07:33:46.718340] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-17T07:33:46.735898] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-09-17T07:33:46.736216] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-17T07:33:46.738172] [INFO ] [MAIN ] Derivative Progress: 496/2172 symbols completed. CSR took 1.3s. Estimated remaining: 10m 33s. Rate: 158.9 symbols/min [2025-09-17T07:33:46.738598] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:46.772249] [DEBUG] [MAIN ] CSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:46.772770] [DEBUG] [MAIN ] CSTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:46.773399] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31340 primary records. [2025-09-17T07:33:46.774099] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47878 primary records. [2025-09-17T07:33:46.773527] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-17T07:33:46.779537] [DEBUG] [LOCAL ] CSV: Loaded 13134 existing records from primary storage. [2025-09-17T07:33:46.779308] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-17T07:33:46.780339] [INFO ] [MAIN ] CSV: Loaded 13134 primary data records. [2025-09-17T07:33:46.907861] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-09-17T07:33:46.913243] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-09-17T07:33:46.911821] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-17T07:33:46.931401] [INFO ] [MAIN ] Derivative Progress: 497/2172 symbols completed. CSL took 1.5s. Estimated remaining: 10m 32s. Rate: 159.1 symbols/min [2025-09-17T07:33:46.918835] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-17T07:33:46.941999] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:46.944481] [INFO ] [MAIN ] Derivative Progress: 498/2172 symbols completed. CSTM took 1.5s. Estimated remaining: 10m 30s. Rate: 159.4 symbols/min [2025-09-17T07:33:47.011913] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:47.147990] [DEBUG] [LOCAL ] CTBB: Loaded 7339 existing records from primary storage. [2025-09-17T07:33:47.148332] [INFO ] [MAIN ] CTBB: Loaded 7339 primary data records. [2025-09-17T07:33:47.231788] [DEBUG] [LOCAL ] CTDD: Loaded 5902 existing records from primary storage. [2025-09-17T07:33:47.264121] [INFO ] [MAIN ] CTDD: Loaded 5902 primary data records. [2025-09-17T07:33:47.806473] [DEBUG] [MAIN ] CSV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:47.808243] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 13134 primary records. [2025-09-17T07:33:47.808570] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-17T07:33:47.828921] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-09-17T07:33:47.829441] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-17T07:33:47.831674] [INFO ] [MAIN ] Derivative Progress: 499/2172 symbols completed. CSV took 1.1s. Estimated remaining: 10m 31s. Rate: 159.0 symbols/min [2025-09-17T07:33:47.832408] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:47.851895] [DEBUG] [MAIN ] CTBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:47.852795] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 7339 primary records. [2025-09-17T07:33:47.852984] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-17T07:33:47.879543] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-09-17T07:33:47.893679] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-17T07:33:47.896318] [INFO ] [MAIN ] Derivative Progress: 500/2172 symbols completed. CTBB took 1.0s. Estimated remaining: 10m 30s. Rate: 159.2 symbols/min [2025-09-17T07:33:47.896927] [DEBUG] [MAIN ] CTDD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:33:47.908106] [INFO ] [MAIN ] CTDD: Generated 1793 derivative records from 5902 primary records. [2025-09-17T07:33:47.905953] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:47.908388] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-17T07:33:47.908967] [DEBUG] [LOCAL ] CTO: Loaded 28582 existing records from primary storage. [2025-09-17T07:33:47.910386] [INFO ] [MAIN ] CTO: Loaded 28582 primary data records. [2025-09-17T07:33:48.085748] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1793 records). [2025-09-17T07:33:48.099161] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-17T07:33:48.119361] [INFO ] [MAIN ] Derivative Progress: 501/2172 symbols completed. CTDD took 1.1s. Estimated remaining: 10m 29s. Rate: 159.4 symbols/min [2025-09-17T07:33:48.231948] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:48.255127] [DEBUG] [LOCAL ] CTOS: Loaded 37086 existing records from primary storage. [2025-09-17T07:33:48.255633] [INFO ] [MAIN ] CTOS: Loaded 37086 primary data records. [2025-09-17T07:33:48.597512] [DEBUG] [MAIN ] CTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:48.613239] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 28582 primary records. [2025-09-17T07:33:48.614243] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-17T07:33:48.615114] [DEBUG] [LOCAL ] CTRA: Loaded 53650 existing records from primary storage. [2025-09-17T07:33:48.616530] [INFO ] [MAIN ] CTRA: Loaded 53650 primary data records. [2025-09-17T07:33:48.688879] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-09-17T07:33:48.715911] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-17T07:33:48.741507] [INFO ] [MAIN ] Derivative Progress: 502/2172 symbols completed. CTO took 0.9s. Estimated remaining: 10m 30s. Rate: 159.2 symbols/min [2025-09-17T07:33:48.757278] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:48.946163] [DEBUG] [MAIN ] CTOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:48.946953] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 37086 primary records. [2025-09-17T07:33:48.947190] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-17T07:33:48.966103] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-09-17T07:33:48.966664] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-17T07:33:48.968931] [INFO ] [MAIN ] Derivative Progress: 503/2172 symbols completed. CTOS took 1.1s. Estimated remaining: 10m 29s. Rate: 159.3 symbols/min [2025-09-17T07:33:48.970081] [INFO ] [MAIN ] CTRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:49.002629] [DEBUG] [MAIN ] CTRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:49.003425] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53650 primary records. [2025-09-17T07:33:49.004871] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-17T07:33:49.021186] [DEBUG] [LOCAL ] CTRE: Loaded 49196 existing records from primary storage. [2025-09-17T07:33:49.040311] [INFO ] [MAIN ] CTRE: Loaded 49196 primary data records. [2025-09-17T07:33:49.045183] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-09-17T07:33:49.075606] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-17T07:33:49.095676] [INFO ] [MAIN ] Derivative Progress: 504/2172 symbols completed. CTRA took 0.9s. Estimated remaining: 10m 27s. Rate: 159.5 symbols/min [2025-09-17T07:33:49.123087] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:49.164485] [DEBUG] [LOCAL ] CTRI: Loaded 37167 existing records from primary storage. [2025-09-17T07:33:49.213243] [INFO ] [MAIN ] CTRI: Loaded 37167 primary data records. [2025-09-17T07:33:49.494251] [DEBUG] [LOCAL ] CTS: Loaded 19337 existing records from primary storage. [2025-09-17T07:33:49.495413] [INFO ] [MAIN ] CTS: Loaded 19337 primary data records. [2025-09-17T07:33:50.021305] [DEBUG] [MAIN ] CTRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:50.023580] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49196 primary records. [2025-09-17T07:33:50.024613] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-17T07:33:50.056358] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-09-17T07:33:50.057004] [DEBUG] [MAIN ] CTRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:50.057157] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-17T07:33:50.059363] [INFO ] [MAIN ] Derivative Progress: 505/2172 symbols completed. CTRE took 1.3s. Estimated remaining: 10m 29s. Rate: 159.0 symbols/min [2025-09-17T07:33:50.060803] [INFO ] [MAIN ] CTRI: Generated 1794 derivative records from 37167 primary records. [2025-09-17T07:33:50.060984] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:50.061082] [DEBUG] [LOCAL ] CTRI: Saving derivative data. [2025-09-17T07:33:50.080770] [DEBUG] [LOCAL ] CTRI: Derivative data saved (1794 records). [2025-09-17T07:33:50.080991] [INFO ] [MAIN ] CTRI: Successfully saved derivative data. [2025-09-17T07:33:50.083446] [INFO ] [MAIN ] Derivative Progress: 506/2172 symbols completed. CTRI took 1.1s. Estimated remaining: 10m 27s. Rate: 159.3 symbols/min [2025-09-17T07:33:50.091694] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:50.097518] [DEBUG] [MAIN ] CTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:50.098207] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19337 primary records. [2025-09-17T07:33:50.098601] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-17T07:33:50.115957] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-09-17T07:33:50.116125] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-17T07:33:50.118580] [INFO ] [MAIN ] Derivative Progress: 507/2172 symbols completed. CTS took 1.0s. Estimated remaining: 10m 26s. Rate: 159.6 symbols/min [2025-09-17T07:33:50.118939] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:50.174627] [DEBUG] [LOCAL ] CTVA: Loaded 53231 existing records from primary storage. [2025-09-17T07:33:50.174939] [INFO ] [MAIN ] CTVA: Loaded 53231 primary data records. [2025-09-17T07:33:50.297779] [DEBUG] [LOCAL ] CUBE: Loaded 50775 existing records from primary storage. [2025-09-17T07:33:50.301428] [DEBUG] [LOCAL ] CUBI: Loaded 27203 existing records from primary storage. [2025-09-17T07:33:50.301740] [INFO ] [MAIN ] CUBE: Loaded 50775 primary data records. [2025-09-17T07:33:50.302131] [INFO ] [MAIN ] CUBI: Loaded 27203 primary data records. [2025-09-17T07:33:51.175245] [DEBUG] [MAIN ] CTVA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:33:51.176002] [INFO ] [MAIN ] CTVA: Generated 1793 derivative records from 53231 primary records. [2025-09-17T07:33:51.177675] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-17T07:33:51.208332] [DEBUG] [MAIN ] CUBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:51.210297] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27203 primary records. [2025-09-17T07:33:51.210561] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-17T07:33:51.232615] [DEBUG] [MAIN ] CUBE: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:33:51.237886] [INFO ] [MAIN ] CUBE: Generated 1793 derivative records from 50775 primary records. [2025-09-17T07:33:51.239832] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-17T07:33:51.238489] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1793 records). [2025-09-17T07:33:51.241405] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-17T07:33:51.245605] [INFO ] [MAIN ] Derivative Progress: 508/2172 symbols completed. CTVA took 1.2s. Estimated remaining: 10m 28s. Rate: 159.0 symbols/min [2025-09-17T07:33:51.246576] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-09-17T07:33:51.257983] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-17T07:33:51.260964] [INFO ] [MAIN ] Derivative Progress: 509/2172 symbols completed. CUBI took 1.1s. Estimated remaining: 10m 26s. Rate: 159.3 symbols/min [2025-09-17T07:33:51.264094] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1793 records). [2025-09-17T07:33:51.264171] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-17T07:33:51.266694] [INFO ] [MAIN ] Derivative Progress: 510/2172 symbols completed. CUBE took 1.2s. Estimated remaining: 10m 25s. Rate: 159.6 symbols/min [2025-09-17T07:33:51.267154] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:51.267733] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:51.267870] [INFO ] [MAIN ] CULP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:51.275568] [DEBUG] [LOCAL ] CULP: Loaded 3102 existing records from primary storage. [2025-09-17T07:33:51.275795] [INFO ] [MAIN ] CULP: Loaded 3102 primary data records. [2025-09-17T07:33:51.496311] [DEBUG] [LOCAL ] CURB: Loaded 33001 existing records from primary storage. [2025-09-17T07:33:51.617752] [INFO ] [MAIN ] CURB: Loaded 33001 primary data records. [2025-09-17T07:33:51.748706] [DEBUG] [LOCAL ] CUK: Loaded 51034 existing records from primary storage. [2025-09-17T07:33:51.749362] [INFO ] [MAIN ] CUK: Loaded 51034 primary data records. [2025-09-17T07:33:52.254476] [DEBUG] [MAIN ] CULP: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:33:52.255814] [INFO ] [MAIN ] CULP: Generated 1793 derivative records from 3102 primary records. [2025-09-17T07:33:52.256880] [DEBUG] [LOCAL ] CULP: Saving derivative data. [2025-09-17T07:33:52.271705] [DEBUG] [LOCAL ] CULP: Derivative data saved (1793 records). [2025-09-17T07:33:52.272600] [INFO ] [MAIN ] CULP: Successfully saved derivative data. [2025-09-17T07:33:52.275251] [INFO ] [MAIN ] Derivative Progress: 511/2172 symbols completed. CULP took 1.0s. Estimated remaining: 10m 27s. Rate: 159.1 symbols/min [2025-09-17T07:33:52.275730] [INFO ] [MAIN ] CURV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:52.293086] [DEBUG] [MAIN ] CURB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:52.293821] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 33001 primary records. [2025-09-17T07:33:52.294044] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-17T07:33:52.327146] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-09-17T07:33:52.331987] [DEBUG] [MAIN ] CUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:52.332029] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-17T07:33:52.332804] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 51034 primary records. [2025-09-17T07:33:52.334869] [INFO ] [MAIN ] Derivative Progress: 512/2172 symbols completed. CURB took 1.1s. Estimated remaining: 10m 25s. Rate: 159.3 symbols/min [2025-09-17T07:33:52.335107] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-17T07:33:52.335719] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:52.358235] [DEBUG] [LOCAL ] CURV: Loaded 26461 existing records from primary storage. [2025-09-17T07:33:52.359522] [INFO ] [MAIN ] CURV: Loaded 26461 primary data records. [2025-09-17T07:33:52.362028] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-09-17T07:33:52.367432] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-17T07:33:52.385756] [INFO ] [MAIN ] Derivative Progress: 513/2172 symbols completed. CUK took 1.1s. Estimated remaining: 10m 24s. Rate: 159.6 symbols/min [2025-09-17T07:33:52.402036] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:52.685244] [DEBUG] [LOCAL ] CUZ: Loaded 49328 existing records from primary storage. [2025-09-17T07:33:52.686119] [INFO ] [MAIN ] CUZ: Loaded 49328 primary data records. [2025-09-17T07:33:53.051914] [DEBUG] [LOCAL ] CVE: Loaded 53560 existing records from primary storage. [2025-09-17T07:33:53.052453] [INFO ] [MAIN ] CVE: Loaded 53560 primary data records. [2025-09-17T07:33:53.246890] [DEBUG] [MAIN ] CURV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:53.357927] [INFO ] [MAIN ] CURV: Generated 1794 derivative records from 26461 primary records. [2025-09-17T07:33:53.358426] [DEBUG] [LOCAL ] CURV: Saving derivative data. [2025-09-17T07:33:53.378409] [DEBUG] [LOCAL ] CURV: Derivative data saved (1794 records). [2025-09-17T07:33:53.379301] [INFO ] [MAIN ] CURV: Successfully saved derivative data. [2025-09-17T07:33:53.381587] [INFO ] [MAIN ] Derivative Progress: 514/2172 symbols completed. CURV took 1.1s. Estimated remaining: 10m 25s. Rate: 159.1 symbols/min [2025-09-17T07:33:53.395301] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:53.395577] [DEBUG] [MAIN ] CUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:53.396631] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49328 primary records. [2025-09-17T07:33:53.397178] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-17T07:33:53.413746] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-09-17T07:33:53.414005] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-17T07:33:53.416786] [INFO ] [MAIN ] Derivative Progress: 515/2172 symbols completed. CUZ took 1.1s. Estimated remaining: 10m 24s. Rate: 159.4 symbols/min [2025-09-17T07:33:53.417368] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:53.430492] [DEBUG] [LOCAL ] CVEO: Loaded 15752 existing records from primary storage. [2025-09-17T07:33:53.430902] [INFO ] [MAIN ] CVEO: Loaded 15752 primary data records. [2025-09-17T07:33:53.478742] [DEBUG] [MAIN ] CVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:53.499039] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53560 primary records. [2025-09-17T07:33:53.543345] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-17T07:33:53.778757] [DEBUG] [LOCAL ] CVI: Loaded 46411 existing records from primary storage. [2025-09-17T07:33:53.778934] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-09-17T07:33:53.779091] [INFO ] [MAIN ] CVI: Loaded 46411 primary data records. [2025-09-17T07:33:53.779183] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-17T07:33:53.781460] [INFO ] [MAIN ] Derivative Progress: 516/2172 symbols completed. CVE took 1.4s. Estimated remaining: 10m 23s. Rate: 159.4 symbols/min [2025-09-17T07:33:53.846948] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:54.093844] [DEBUG] [LOCAL ] CVLG: Loaded 15371 existing records from primary storage. [2025-09-17T07:33:54.094541] [INFO ] [MAIN ] CVLG: Loaded 15371 primary data records. [2025-09-17T07:33:54.290326] [DEBUG] [MAIN ] CVEO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:33:54.299430] [INFO ] [MAIN ] CVEO: Generated 1793 derivative records from 15752 primary records. [2025-09-17T07:33:54.407520] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-17T07:33:54.435466] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1793 records). [2025-09-17T07:33:54.435619] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-17T07:33:54.438283] [INFO ] [MAIN ] Derivative Progress: 517/2172 symbols completed. CVEO took 1.0s. Estimated remaining: 10m 24s. Rate: 159.1 symbols/min [2025-09-17T07:33:54.438540] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:54.456052] [DEBUG] [MAIN ] CVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:54.458212] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46411 primary records. [2025-09-17T07:33:54.458465] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-17T07:33:54.475506] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-09-17T07:33:54.475720] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-17T07:33:54.477803] [INFO ] [MAIN ] Derivative Progress: 518/2172 symbols completed. CVI took 1.1s. Estimated remaining: 10m 23s. Rate: 159.4 symbols/min [2025-09-17T07:33:54.478053] [INFO ] [MAIN ] CVS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:54.495207] [DEBUG] [MAIN ] CVLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:54.495954] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15371 primary records. [2025-09-17T07:33:54.496204] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-17T07:33:54.514210] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-09-17T07:33:54.527362] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-17T07:33:54.530079] [INFO ] [MAIN ] Derivative Progress: 519/2172 symbols completed. CVLG took 0.7s. Estimated remaining: 10m 21s. Rate: 159.7 symbols/min [2025-09-17T07:33:54.530596] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:54.566371] [DEBUG] [LOCAL ] CVNA: Loaded 53080 existing records from primary storage. [2025-09-17T07:33:54.566673] [INFO ] [MAIN ] CVNA: Loaded 53080 primary data records. [2025-09-17T07:33:54.683433] [DEBUG] [LOCAL ] CVS: Loaded 53698 existing records from primary storage. [2025-09-17T07:33:54.719056] [INFO ] [MAIN ] CVS: Loaded 53698 primary data records. [2025-09-17T07:33:54.999149] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-17T07:33:55.011018] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-09-17T07:33:55.569505] [DEBUG] [MAIN ] CVNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:55.571070] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 53080 primary records. [2025-09-17T07:33:55.571425] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-17T07:33:55.592011] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-09-17T07:33:55.593966] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-17T07:33:55.596085] [INFO ] [MAIN ] Derivative Progress: 520/2172 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 23s. Rate: 159.1 symbols/min [2025-09-17T07:33:55.596763] [INFO ] [MAIN ] CW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:55.609957] [DEBUG] [MAIN ] CVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:55.611605] [INFO ] [MAIN ] CVS: Generated 1794 derivative records from 53698 primary records. [2025-09-17T07:33:55.613823] [DEBUG] [LOCAL ] CVS: Saving derivative data. [2025-09-17T07:33:55.642614] [DEBUG] [MAIN ] CVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:55.642701] [DEBUG] [LOCAL ] CVS: Derivative data saved (1794 records). [2025-09-17T07:33:55.643627] [INFO ] [MAIN ] CVS: Successfully saved derivative data. [2025-09-17T07:33:55.643495] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-09-17T07:33:55.645955] [INFO ] [MAIN ] Derivative Progress: 521/2172 symbols completed. CVS took 1.2s. Estimated remaining: 10m 22s. Rate: 159.4 symbols/min [2025-09-17T07:33:55.646336] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-17T07:33:55.646430] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:55.670252] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-09-17T07:33:55.677351] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-17T07:33:55.680506] [INFO ] [MAIN ] Derivative Progress: 522/2172 symbols completed. CVX took 1.1s. Estimated remaining: 10m 20s. Rate: 159.7 symbols/min [2025-09-17T07:33:55.681359] [DEBUG] [LOCAL ] CW: Loaded 22793 existing records from primary storage. [2025-09-17T07:33:55.681669] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:55.681880] [INFO ] [MAIN ] CW: Loaded 22793 primary data records. [2025-09-17T07:33:56.024303] [DEBUG] [LOCAL ] CWAN: Loaded 52389 existing records from primary storage. [2025-09-17T07:33:56.024864] [INFO ] [MAIN ] CWAN: Loaded 52389 primary data records. [2025-09-17T07:33:56.137011] [DEBUG] [LOCAL ] CWEN: Loaded 45036 existing records from primary storage. [2025-09-17T07:33:56.149509] [INFO ] [MAIN ] CWEN: Loaded 45036 primary data records. [2025-09-17T07:33:56.681983] [DEBUG] [MAIN ] CW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:56.686058] [INFO ] [MAIN ] CW: Generated 1794 derivative records from 22793 primary records. [2025-09-17T07:33:56.686515] [DEBUG] [LOCAL ] CW: Saving derivative data. [2025-09-17T07:33:56.709495] [DEBUG] [LOCAL ] CW: Derivative data saved (1794 records). [2025-09-17T07:33:56.711199] [INFO ] [MAIN ] CW: Successfully saved derivative data. [2025-09-17T07:33:56.714119] [INFO ] [MAIN ] Derivative Progress: 523/2172 symbols completed. CW took 1.1s. Estimated remaining: 10m 22s. Rate: 159.1 symbols/min [2025-09-17T07:33:56.730947] [DEBUG] [MAIN ] CWAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:56.732056] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52389 primary records. [2025-09-17T07:33:56.732250] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-17T07:33:56.761980] [DEBUG] [MAIN ] CWEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:56.763274] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 45036 primary records. [2025-09-17T07:33:56.764052] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-17T07:33:56.764002] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-09-17T07:33:56.764715] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-17T07:33:56.766908] [INFO ] [MAIN ] Derivative Progress: 524/2172 symbols completed. CWAN took 1.1s. Estimated remaining: 10m 20s. Rate: 159.4 symbols/min [2025-09-17T07:33:56.781803] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-09-17T07:33:56.781879] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-17T07:33:56.784227] [INFO ] [MAIN ] Derivative Progress: 525/2172 symbols completed. CWEN took 1.1s. Estimated remaining: 10m 19s. Rate: 159.7 symbols/min [2025-09-17T07:33:56.784907] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:56.785025] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:56.785072] [INFO ] [MAIN ] CWT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:56.832340] [DEBUG] [LOCAL ] CWT: Loaded 27984 existing records from primary storage. [2025-09-17T07:33:56.832512] [INFO ] [MAIN ] CWT: Loaded 27984 primary data records. [2025-09-17T07:33:56.962917] [DEBUG] [LOCAL ] CWH: Loaded 51418 existing records from primary storage. [2025-09-17T07:33:56.963419] [INFO ] [MAIN ] CWH: Loaded 51418 primary data records. [2025-09-17T07:33:57.121512] [DEBUG] [LOCAL ] CWK: Loaded 49395 existing records from primary storage. [2025-09-17T07:33:57.289258] [INFO ] [MAIN ] CWK: Loaded 49395 primary data records. [2025-09-17T07:33:57.811877] [DEBUG] [MAIN ] CWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:57.812774] [INFO ] [MAIN ] CWT: Generated 1794 derivative records from 27984 primary records. [2025-09-17T07:33:57.815272] [DEBUG] [LOCAL ] CWT: Saving derivative data. [2025-09-17T07:33:57.840577] [DEBUG] [MAIN ] CWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:57.842101] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51418 primary records. [2025-09-17T07:33:57.842596] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-17T07:33:57.859980] [DEBUG] [LOCAL ] CWT: Derivative data saved (1794 records). [2025-09-17T07:33:57.863671] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-09-17T07:33:57.864188] [INFO ] [MAIN ] CWT: Successfully saved derivative data. [2025-09-17T07:33:57.864434] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-17T07:33:57.866518] [INFO ] [MAIN ] Derivative Progress: 526/2172 symbols completed. CWT took 1.1s. Estimated remaining: 10m 21s. Rate: 159.1 symbols/min [2025-09-17T07:33:57.869422] [INFO ] [MAIN ] Derivative Progress: 527/2172 symbols completed. CWH took 1.1s. Estimated remaining: 10m 19s. Rate: 159.4 symbols/min [2025-09-17T07:33:57.869299] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:57.870119] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:57.883304] [DEBUG] [MAIN ] CWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:57.883939] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49395 primary records. [2025-09-17T07:33:57.884175] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-17T07:33:57.903090] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-09-17T07:33:57.903295] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-17T07:33:57.905869] [INFO ] [MAIN ] Derivative Progress: 528/2172 symbols completed. CWK took 1.1s. Estimated remaining: 10m 18s. Rate: 159.7 symbols/min [2025-09-17T07:33:57.909705] [DEBUG] [LOCAL ] CXE: Loaded 7151 existing records from primary storage. [2025-09-17T07:33:57.909841] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:57.910006] [INFO ] [MAIN ] CXE: Loaded 7151 primary data records. [2025-09-17T07:33:58.029980] [DEBUG] [LOCAL ] CXH: Loaded 4413 existing records from primary storage. [2025-09-17T07:33:58.035810] [INFO ] [MAIN ] CXH: Loaded 4413 primary data records. [2025-09-17T07:33:58.215054] [DEBUG] [LOCAL ] CX: Loaded 52846 existing records from primary storage. [2025-09-17T07:33:58.335132] [INFO ] [MAIN ] CX: Loaded 52846 primary data records. [2025-09-17T07:33:58.916816] [DEBUG] [MAIN ] CXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:58.918955] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 7151 primary records. [2025-09-17T07:33:58.920714] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-17T07:33:58.937558] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-09-17T07:33:58.937856] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-17T07:33:58.952158] [INFO ] [MAIN ] Derivative Progress: 529/2172 symbols completed. CXE took 1.1s. Estimated remaining: 10m 19s. Rate: 159.1 symbols/min [2025-09-17T07:33:58.954082] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:58.953859] [DEBUG] [MAIN ] CXH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:58.955208] [INFO ] [MAIN ] CXH: Generated 1794 derivative records from 4413 primary records. [2025-09-17T07:33:58.956819] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-17T07:33:58.984093] [DEBUG] [MAIN ] CX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:33:58.984902] [DEBUG] [LOCAL ] CXH: Derivative data saved (1794 records). [2025-09-17T07:33:58.985130] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-17T07:33:58.985904] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52846 primary records. [2025-09-17T07:33:58.988552] [INFO ] [MAIN ] Derivative Progress: 530/2172 symbols completed. CXH took 1.1s. Estimated remaining: 10m 18s. Rate: 159.4 symbols/min [2025-09-17T07:33:58.988996] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-17T07:33:58.988898] [INFO ] [MAIN ] CXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:59.008560] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-09-17T07:33:59.009030] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-17T07:33:59.012076] [INFO ] [MAIN ] Derivative Progress: 531/2172 symbols completed. CX took 1.1s. Estimated remaining: 10m 17s. Rate: 159.7 symbols/min [2025-09-17T07:33:59.012576] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:33:59.053264] [DEBUG] [LOCAL ] CXM: Loaded 47979 existing records from primary storage. [2025-09-17T07:33:59.053618] [INFO ] [MAIN ] CXM: Loaded 47979 primary data records. [2025-09-17T07:33:59.147224] [DEBUG] [LOCAL ] CXT: Loaded 30981 existing records from primary storage. [2025-09-17T07:33:59.159050] [INFO ] [MAIN ] CXT: Loaded 30981 primary data records. [2025-09-17T07:33:59.484838] [DEBUG] [LOCAL ] CXW: Loaded 44708 existing records from primary storage. [2025-09-17T07:33:59.546527] [INFO ] [MAIN ] CXW: Loaded 44708 primary data records. [2025-09-17T07:34:00.008870] [DEBUG] [MAIN ] CXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:00.017762] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47979 primary records. [2025-09-17T07:34:00.023669] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-17T07:34:00.023611] [DEBUG] [MAIN ] CXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:00.026073] [INFO ] [MAIN ] CXT: Generated 1794 derivative records from 30981 primary records. [2025-09-17T07:34:00.033584] [DEBUG] [LOCAL ] CXT: Saving derivative data. [2025-09-17T07:34:00.057865] [DEBUG] [LOCAL ] CXT: Derivative data saved (1794 records). [2025-09-17T07:34:00.059350] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-09-17T07:34:00.059905] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-17T07:34:00.060025] [INFO ] [MAIN ] CXT: Successfully saved derivative data. [2025-09-17T07:34:00.062010] [INFO ] [MAIN ] Derivative Progress: 532/2172 symbols completed. CXM took 1.1s. Estimated remaining: 10m 18s. Rate: 159.2 symbols/min [2025-09-17T07:34:00.066670] [INFO ] [MAIN ] Derivative Progress: 533/2172 symbols completed. CXT took 1.1s. Estimated remaining: 10m 17s. Rate: 159.5 symbols/min [2025-09-17T07:34:00.066804] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:00.068305] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:00.082809] [DEBUG] [MAIN ] CXW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:00.083859] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 44708 primary records. [2025-09-17T07:34:00.084025] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-17T07:34:00.105882] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-09-17T07:34:00.106134] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-17T07:34:00.109119] [INFO ] [MAIN ] Derivative Progress: 534/2172 symbols completed. CXW took 1.1s. Estimated remaining: 10m 15s. Rate: 159.7 symbols/min [2025-09-17T07:34:00.109625] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:00.130778] [DEBUG] [LOCAL ] CYD: Loaded 26833 existing records from primary storage. [2025-09-17T07:34:00.130943] [INFO ] [MAIN ] CYD: Loaded 26833 primary data records. [2025-09-17T07:34:00.309838] [DEBUG] [LOCAL ] CYH: Loaded 48064 existing records from primary storage. [2025-09-17T07:34:00.353214] [INFO ] [MAIN ] CYH: Loaded 48064 primary data records. [2025-09-17T07:34:00.579507] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-09-17T07:34:00.590964] [INFO ] [MAIN ] D: Loaded 53647 primary data records. [2025-09-17T07:34:01.161460] [DEBUG] [MAIN ] CYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:01.163228] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26833 primary records. [2025-09-17T07:34:01.164334] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-17T07:34:01.197755] [DEBUG] [MAIN ] CYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:01.197401] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-09-17T07:34:01.198706] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-17T07:34:01.198608] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 48064 primary records. [2025-09-17T07:34:01.201229] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-17T07:34:01.200980] [INFO ] [MAIN ] Derivative Progress: 535/2172 symbols completed. CYD took 1.1s. Estimated remaining: 10m 17s. Rate: 159.2 symbols/min [2025-09-17T07:34:01.202065] [INFO ] [MAIN ] DAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:01.225017] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-09-17T07:34:01.230098] [DEBUG] [LOCAL ] DAC: Loaded 12820 existing records from primary storage. [2025-09-17T07:34:01.230278] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-17T07:34:01.245519] [INFO ] [MAIN ] Derivative Progress: 536/2172 symbols completed. CYH took 1.2s. Estimated remaining: 10m 16s. Rate: 159.4 symbols/min [2025-09-17T07:34:01.242891] [INFO ] [MAIN ] DAC: Loaded 12820 primary data records. [2025-09-17T07:34:01.246303] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:01.246020] [DEBUG] [MAIN ] D: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:01.283159] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53647 primary records. [2025-09-17T07:34:01.283282] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-17T07:34:01.404811] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-09-17T07:34:01.437263] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-17T07:34:01.443828] [INFO ] [MAIN ] Derivative Progress: 537/2172 symbols completed. D took 1.3s. Estimated remaining: 10m 15s. Rate: 159.6 symbols/min [2025-09-17T07:34:01.568394] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:01.592963] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-17T07:34:01.593468] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-09-17T07:34:01.804521] [DEBUG] [MAIN ] DAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:01.919730] [INFO ] [MAIN ] DAC: Generated 1794 derivative records from 12820 primary records. [2025-09-17T07:34:01.933622] [DEBUG] [LOCAL ] DAC: Saving derivative data. [2025-09-17T07:34:01.936172] [DEBUG] [LOCAL ] DAN: Loaded 49040 existing records from primary storage. [2025-09-17T07:34:01.936443] [INFO ] [MAIN ] DAN: Loaded 49040 primary data records. [2025-09-17T07:34:02.082014] [DEBUG] [LOCAL ] DAC: Derivative data saved (1794 records). [2025-09-17T07:34:02.111607] [INFO ] [MAIN ] DAC: Successfully saved derivative data. [2025-09-17T07:34:02.135027] [INFO ] [MAIN ] Derivative Progress: 538/2172 symbols completed. DAC took 0.9s. Estimated remaining: 10m 15s. Rate: 159.3 symbols/min [2025-09-17T07:34:02.269821] [DEBUG] [MAIN ] DAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:02.270968] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-09-17T07:34:02.271306] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-17T07:34:02.289211] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-09-17T07:34:02.289365] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-17T07:34:02.291872] [INFO ] [MAIN ] Derivative Progress: 539/2172 symbols completed. DAL took 1.0s. Estimated remaining: 10m 14s. Rate: 159.5 symbols/min [2025-09-17T07:34:02.307557] [DEBUG] [MAIN ] DAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:02.308184] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 49040 primary records. [2025-09-17T07:34:02.308259] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-17T07:34:02.323685] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-09-17T07:34:02.323771] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-17T07:34:02.330714] [INFO ] [MAIN ] Derivative Progress: 540/2172 symbols completed. DAN took 0.8s. Estimated remaining: 10m 13s. Rate: 159.7 symbols/min [2025-09-17T07:34:02.331932] [INFO ] [MAIN ] DAR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:02.332074] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:02.331884] [INFO ] [MAIN ] DAO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:02.357982] [DEBUG] [LOCAL ] DAO: Loaded 21549 existing records from primary storage. [2025-09-17T07:34:02.358149] [INFO ] [MAIN ] DAO: Loaded 21549 primary data records. [2025-09-17T07:34:02.552513] [DEBUG] [LOCAL ] DAR: Loaded 51810 existing records from primary storage. [2025-09-17T07:34:02.589516] [INFO ] [MAIN ] DAR: Loaded 51810 primary data records. [2025-09-17T07:34:02.556911] [DEBUG] [LOCAL ] DAVA: Loaded 40301 existing records from primary storage. [2025-09-17T07:34:02.702770] [INFO ] [MAIN ] DAVA: Loaded 40301 primary data records. [2025-09-17T07:34:03.345351] [DEBUG] [MAIN ] DAO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:03.347086] [INFO ] [MAIN ] DAO: Generated 1794 derivative records from 21549 primary records. [2025-09-17T07:34:03.347209] [DEBUG] [LOCAL ] DAO: Saving derivative data. [2025-09-17T07:34:03.367366] [DEBUG] [LOCAL ] DAO: Derivative data saved (1794 records). [2025-09-17T07:34:03.367675] [INFO ] [MAIN ] DAO: Successfully saved derivative data. [2025-09-17T07:34:03.369625] [INFO ] [MAIN ] Derivative Progress: 541/2172 symbols completed. DAO took 1.0s. Estimated remaining: 10m 15s. Rate: 159.2 symbols/min [2025-09-17T07:34:03.370205] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:03.388334] [DEBUG] [MAIN ] DAVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:03.400959] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 40301 primary records. [2025-09-17T07:34:03.401314] [DEBUG] [MAIN ] DAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:03.401478] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-17T07:34:03.401993] [INFO ] [MAIN ] DAR: Generated 1794 derivative records from 51810 primary records. [2025-09-17T07:34:03.402797] [DEBUG] [LOCAL ] DAR: Saving derivative data. [2025-09-17T07:34:03.431717] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-09-17T07:34:03.433972] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-17T07:34:03.438125] [INFO ] [MAIN ] Derivative Progress: 542/2172 symbols completed. DAVA took 1.1s. Estimated remaining: 10m 13s. Rate: 159.5 symbols/min [2025-09-17T07:34:03.438765] [INFO ] [MAIN ] DB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:03.438464] [DEBUG] [LOCAL ] DAR: Derivative data saved (1794 records). [2025-09-17T07:34:03.439188] [INFO ] [MAIN ] DAR: Successfully saved derivative data. [2025-09-17T07:34:03.441910] [INFO ] [MAIN ] Derivative Progress: 543/2172 symbols completed. DAR took 1.1s. Estimated remaining: 10m 12s. Rate: 159.8 symbols/min [2025-09-17T07:34:03.442228] [INFO ] [MAIN ] DBD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:03.487807] [DEBUG] [LOCAL ] DAY: Loaded 50078 existing records from primary storage. [2025-09-17T07:34:03.488072] [INFO ] [MAIN ] DAY: Loaded 50078 primary data records. [2025-09-17T07:34:03.488570] [DEBUG] [LOCAL ] DBD: Loaded 23783 existing records from primary storage. [2025-09-17T07:34:03.519229] [INFO ] [MAIN ] DBD: Loaded 23783 primary data records. [2025-09-17T07:34:03.796940] [DEBUG] [LOCAL ] DB: Loaded 52651 existing records from primary storage. [2025-09-17T07:34:03.981192] [INFO ] [MAIN ] DB: Loaded 52651 primary data records. [2025-09-17T07:34:04.469148] [DEBUG] [MAIN ] DAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:04.470496] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 50078 primary records. [2025-09-17T07:34:04.470621] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-17T07:34:04.496822] [DEBUG] [MAIN ] DBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:04.497993] [INFO ] [MAIN ] DBD: Generated 1794 derivative records from 23783 primary records. [2025-09-17T07:34:04.500429] [DEBUG] [LOCAL ] DBD: Saving derivative data. [2025-09-17T07:34:04.511188] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-09-17T07:34:04.516170] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-17T07:34:04.518806] [INFO ] [MAIN ] Derivative Progress: 544/2172 symbols completed. DAY took 1.1s. Estimated remaining: 10m 14s. Rate: 159.2 symbols/min [2025-09-17T07:34:04.520566] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:04.525630] [DEBUG] [LOCAL ] DBD: Derivative data saved (1794 records). [2025-09-17T07:34:04.525927] [INFO ] [MAIN ] DBD: Successfully saved derivative data. [2025-09-17T07:34:04.529561] [INFO ] [MAIN ] Derivative Progress: 545/2172 symbols completed. DBD took 1.1s. Estimated remaining: 10m 12s. Rate: 159.5 symbols/min [2025-09-17T07:34:04.530795] [INFO ] [MAIN ] DBL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:04.554742] [DEBUG] [MAIN ] DB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:04.555626] [INFO ] [MAIN ] DB: Generated 1794 derivative records from 52651 primary records. [2025-09-17T07:34:04.555972] [DEBUG] [LOCAL ] DB: Saving derivative data. [2025-09-17T07:34:04.562521] [DEBUG] [LOCAL ] DBL: Loaded 9038 existing records from primary storage. [2025-09-17T07:34:04.589073] [DEBUG] [LOCAL ] DB: Derivative data saved (1794 records). [2025-09-17T07:34:04.589245] [INFO ] [MAIN ] DBL: Loaded 9038 primary data records. [2025-09-17T07:34:04.589929] [INFO ] [MAIN ] DB: Successfully saved derivative data. [2025-09-17T07:34:04.598078] [INFO ] [MAIN ] Derivative Progress: 546/2172 symbols completed. DB took 1.2s. Estimated remaining: 10m 11s. Rate: 159.7 symbols/min [2025-09-17T07:34:04.632846] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:04.709505] [DEBUG] [LOCAL ] DBI: Loaded 45312 existing records from primary storage. [2025-09-17T07:34:04.721480] [INFO ] [MAIN ] DBI: Loaded 45312 primary data records. [2025-09-17T07:34:05.275157] [DEBUG] [LOCAL ] DBRG: Loaded 49842 existing records from primary storage. [2025-09-17T07:34:05.288120] [INFO ] [MAIN ] DBRG: Loaded 49842 primary data records. [2025-09-17T07:34:05.625116] [DEBUG] [MAIN ] DBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:05.626351] [INFO ] [MAIN ] DBL: Generated 1794 derivative records from 9038 primary records. [2025-09-17T07:34:05.629191] [DEBUG] [LOCAL ] DBL: Saving derivative data. [2025-09-17T07:34:05.655752] [DEBUG] [MAIN ] DBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:05.658179] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 45312 primary records. [2025-09-17T07:34:05.658654] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-17T07:34:05.661522] [DEBUG] [LOCAL ] DBL: Derivative data saved (1794 records). [2025-09-17T07:34:05.661685] [INFO ] [MAIN ] DBL: Successfully saved derivative data. [2025-09-17T07:34:05.664143] [INFO ] [MAIN ] Derivative Progress: 547/2172 symbols completed. DBL took 1.1s. Estimated remaining: 10m 12s. Rate: 159.2 symbols/min [2025-09-17T07:34:05.671767] [INFO ] [MAIN ] DCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:05.681419] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-09-17T07:34:05.681612] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-17T07:34:05.684331] [INFO ] [MAIN ] Derivative Progress: 548/2172 symbols completed. DBI took 1.2s. Estimated remaining: 10m 11s. Rate: 159.5 symbols/min [2025-09-17T07:34:05.684681] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:05.701829] [DEBUG] [MAIN ] DBRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:05.702724] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49842 primary records. [2025-09-17T07:34:05.706710] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-17T07:34:05.736498] [DEBUG] [LOCAL ] DCO: Loaded 13446 existing records from primary storage. [2025-09-17T07:34:05.737832] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-09-17T07:34:05.738084] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-17T07:34:05.737996] [INFO ] [MAIN ] DCO: Loaded 13446 primary data records. [2025-09-17T07:34:05.741221] [INFO ] [MAIN ] Derivative Progress: 549/2172 symbols completed. DBRG took 1.1s. Estimated remaining: 10m 10s. Rate: 159.7 symbols/min [2025-09-17T07:34:05.742182] [INFO ] [MAIN ] DD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:05.837798] [DEBUG] [LOCAL ] DCI: Loaded 37761 existing records from primary storage. [2025-09-17T07:34:05.856342] [INFO ] [MAIN ] DCI: Loaded 37761 primary data records. [2025-09-17T07:34:06.412872] [DEBUG] [LOCAL ] DD: Loaded 52790 existing records from primary storage. [2025-09-17T07:34:06.413401] [INFO ] [MAIN ] DD: Loaded 52790 primary data records. [2025-09-17T07:34:06.793972] [DEBUG] [MAIN ] DCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:06.795521] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 13446 primary records. [2025-09-17T07:34:06.795848] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-17T07:34:06.818771] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-09-17T07:34:06.827085] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-17T07:34:06.832930] [DEBUG] [MAIN ] DCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:06.835491] [INFO ] [MAIN ] Derivative Progress: 550/2172 symbols completed. DCO took 1.2s. Estimated remaining: 10m 11s. Rate: 159.2 symbols/min [2025-09-17T07:34:06.835933] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:06.836612] [INFO ] [MAIN ] DCI: Generated 1794 derivative records from 37761 primary records. [2025-09-17T07:34:06.837085] [DEBUG] [LOCAL ] DCI: Saving derivative data. [2025-09-17T07:34:06.856720] [DEBUG] [LOCAL ] DCI: Derivative data saved (1794 records). [2025-09-17T07:34:06.857727] [INFO ] [MAIN ] DCI: Successfully saved derivative data. [2025-09-17T07:34:06.860790] [INFO ] [MAIN ] Derivative Progress: 551/2172 symbols completed. DCI took 1.2s. Estimated remaining: 10m 10s. Rate: 159.4 symbols/min [2025-09-17T07:34:06.861455] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:06.875899] [DEBUG] [MAIN ] DD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:06.886245] [INFO ] [MAIN ] DD: Generated 1794 derivative records from 52790 primary records. [2025-09-17T07:34:06.886494] [DEBUG] [LOCAL ] DD: Saving derivative data. [2025-09-17T07:34:06.924460] [DEBUG] [LOCAL ] DDL: Loaded 36243 existing records from primary storage. [2025-09-17T07:34:06.923134] [DEBUG] [LOCAL ] DD: Derivative data saved (1794 records). [2025-09-17T07:34:06.924739] [INFO ] [MAIN ] DD: Successfully saved derivative data. [2025-09-17T07:34:06.923364] [DEBUG] [LOCAL ] DDS: Loaded 13640 existing records from primary storage. [2025-09-17T07:34:06.924930] [INFO ] [MAIN ] DDS: Loaded 13640 primary data records. [2025-09-17T07:34:06.925058] [INFO ] [MAIN ] DDL: Loaded 36243 primary data records. [2025-09-17T07:34:06.947990] [INFO ] [MAIN ] Derivative Progress: 552/2172 symbols completed. DD took 1.2s. Estimated remaining: 10m 9s. Rate: 159.7 symbols/min [2025-09-17T07:34:07.022381] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:07.245399] [DEBUG] [LOCAL ] DDT: Loaded 2071 existing records from primary storage. [2025-09-17T07:34:07.421418] [INFO ] [MAIN ] DDT: Loaded 2071 primary data records. [2025-09-17T07:34:07.873994] [DEBUG] [MAIN ] DDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:07.887477] [INFO ] [MAIN ] DDS: Generated 1794 derivative records from 13640 primary records. [2025-09-17T07:34:07.888769] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-17T07:34:07.888632] [DEBUG] [MAIN ] DDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:07.890205] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36243 primary records. [2025-09-17T07:34:07.890522] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-17T07:34:07.928104] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-09-17T07:34:07.930682] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-17T07:34:07.930619] [DEBUG] [LOCAL ] DDS: Derivative data saved (1794 records). [2025-09-17T07:34:07.932264] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-17T07:34:07.934916] [INFO ] [MAIN ] Derivative Progress: 553/2172 symbols completed. DDL took 1.1s. Estimated remaining: 10m 10s. Rate: 159.2 symbols/min [2025-09-17T07:34:07.949467] [INFO ] [MAIN ] Derivative Progress: 554/2172 symbols completed. DDS took 1.1s. Estimated remaining: 10m 9s. Rate: 159.5 symbols/min [2025-09-17T07:34:07.949956] [DEBUG] [MAIN ] DDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:07.950727] [INFO ] [MAIN ] DDT: Generated 1794 derivative records from 2071 primary records. [2025-09-17T07:34:07.950823] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-17T07:34:07.964356] [DEBUG] [LOCAL ] DDT: Derivative data saved (1794 records). [2025-09-17T07:34:07.964428] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-17T07:34:07.967162] [INFO ] [MAIN ] Derivative Progress: 555/2172 symbols completed. DDT took 1.0s. Estimated remaining: 10m 7s. Rate: 159.7 symbols/min [2025-09-17T07:34:07.967689] [INFO ] [MAIN ] DE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:07.967659] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:07.967748] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:08.038095] [DEBUG] [LOCAL ] DEA: Loaded 41800 existing records from primary storage. [2025-09-17T07:34:08.037165] [DEBUG] [LOCAL ] DEC: Loaded 30937 existing records from primary storage. [2025-09-17T07:34:08.038421] [INFO ] [MAIN ] DEA: Loaded 41800 primary data records. [2025-09-17T07:34:08.038355] [INFO ] [MAIN ] DEC: Loaded 30937 primary data records. [2025-09-17T07:34:08.245249] [DEBUG] [LOCAL ] DE: Loaded 47823 existing records from primary storage. [2025-09-17T07:34:08.282742] [INFO ] [MAIN ] DE: Loaded 47823 primary data records. [2025-09-17T07:34:09.040772] [DEBUG] [MAIN ] DEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:09.042852] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 41800 primary records. [2025-09-17T07:34:09.043448] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-17T07:34:09.056953] [DEBUG] [MAIN ] DEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:09.066317] [INFO ] [MAIN ] DEC: Generated 1794 derivative records from 30937 primary records. [2025-09-17T07:34:09.067772] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-17T07:34:09.075479] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-09-17T07:34:09.075863] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-17T07:34:09.086239] [INFO ] [MAIN ] Derivative Progress: 556/2172 symbols completed. DEA took 1.1s. Estimated remaining: 10m 9s. Rate: 159.2 symbols/min [2025-09-17T07:34:09.086783] [INFO ] [MAIN ] DECK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:09.097017] [DEBUG] [LOCAL ] DEC: Derivative data saved (1794 records). [2025-09-17T07:34:09.098761] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-17T07:34:09.101926] [INFO ] [MAIN ] Derivative Progress: 557/2172 symbols completed. DEC took 1.1s. Estimated remaining: 10m 8s. Rate: 159.5 symbols/min [2025-09-17T07:34:09.102383] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:09.118871] [DEBUG] [MAIN ] DE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:09.119623] [INFO ] [MAIN ] DE: Generated 1794 derivative records from 47823 primary records. [2025-09-17T07:34:09.119920] [DEBUG] [LOCAL ] DE: Saving derivative data. [2025-09-17T07:34:09.136756] [DEBUG] [LOCAL ] DE: Derivative data saved (1794 records). [2025-09-17T07:34:09.136930] [INFO ] [MAIN ] DE: Successfully saved derivative data. [2025-09-17T07:34:09.140017] [INFO ] [MAIN ] Derivative Progress: 558/2172 symbols completed. DE took 1.2s. Estimated remaining: 10m 6s. Rate: 159.7 symbols/min [2025-09-17T07:34:09.140536] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:09.189991] [DEBUG] [LOCAL ] DECK: Loaded 53324 existing records from primary storage. [2025-09-17T07:34:09.190274] [INFO ] [MAIN ] DECK: Loaded 53324 primary data records. [2025-09-17T07:34:09.313815] [DEBUG] [LOCAL ] DEI: Loaded 48518 existing records from primary storage. [2025-09-17T07:34:09.324833] [INFO ] [MAIN ] DEI: Loaded 48518 primary data records. [2025-09-17T07:34:09.682106] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-09-17T07:34:09.714997] [INFO ] [MAIN ] DELL: Loaded 53736 primary data records. [2025-09-17T07:34:10.188811] [DEBUG] [MAIN ] DECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:10.190471] [INFO ] [MAIN ] DECK: Generated 1794 derivative records from 53324 primary records. [2025-09-17T07:34:10.190947] [DEBUG] [LOCAL ] DECK: Saving derivative data. [2025-09-17T07:34:10.211435] [DEBUG] [LOCAL ] DECK: Derivative data saved (1794 records). [2025-09-17T07:34:10.224130] [INFO ] [MAIN ] DECK: Successfully saved derivative data. [2025-09-17T07:34:10.224384] [DEBUG] [MAIN ] DEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:10.226920] [INFO ] [MAIN ] Derivative Progress: 559/2172 symbols completed. DECK took 1.1s. Estimated remaining: 10m 8s. Rate: 159.2 symbols/min [2025-09-17T07:34:10.227840] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48518 primary records. [2025-09-17T07:34:10.228072] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-17T07:34:10.228550] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:10.261465] [DEBUG] [MAIN ] DELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:10.263089] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-09-17T07:34:10.264346] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53736 primary records. [2025-09-17T07:34:10.264450] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-17T07:34:10.264608] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-09-17T07:34:10.269146] [INFO ] [MAIN ] Derivative Progress: 560/2172 symbols completed. DEI took 1.2s. Estimated remaining: 10m 7s. Rate: 159.4 symbols/min [2025-09-17T07:34:10.277506] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:10.288048] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-09-17T07:34:10.288504] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-17T07:34:10.290958] [INFO ] [MAIN ] Derivative Progress: 561/2172 symbols completed. DELL took 1.2s. Estimated remaining: 10m 5s. Rate: 159.7 symbols/min [2025-09-17T07:34:10.291372] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:10.335412] [DEBUG] [LOCAL ] DEO: Loaded 48913 existing records from primary storage. [2025-09-17T07:34:10.335748] [INFO ] [MAIN ] DEO: Loaded 48913 primary data records. [2025-09-17T07:34:10.438178] [DEBUG] [LOCAL ] DFIN: Loaded 23614 existing records from primary storage. [2025-09-17T07:34:10.462391] [INFO ] [MAIN ] DFIN: Loaded 23614 primary data records. [2025-09-17T07:34:10.473635] [DEBUG] [LOCAL ] DFH: Loaded 33205 existing records from primary storage. [2025-09-17T07:34:10.549713] [INFO ] [MAIN ] DFH: Loaded 33205 primary data records. [2025-09-17T07:34:11.327619] [DEBUG] [MAIN ] DEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:11.328476] [INFO ] [MAIN ] DEO: Generated 1794 derivative records from 48913 primary records. [2025-09-17T07:34:11.328906] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-17T07:34:11.348412] [DEBUG] [LOCAL ] DEO: Derivative data saved (1794 records). [2025-09-17T07:34:11.361192] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-17T07:34:11.364160] [DEBUG] [MAIN ] DFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:11.363802] [INFO ] [MAIN ] Derivative Progress: 562/2172 symbols completed. DEO took 1.1s. Estimated remaining: 10m 7s. Rate: 159.2 symbols/min [2025-09-17T07:34:11.365319] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:11.365046] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 23614 primary records. [2025-09-17T07:34:11.365897] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-17T07:34:11.392216] [DEBUG] [MAIN ] DFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:11.393544] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 33205 primary records. [2025-09-17T07:34:11.398200] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-09-17T07:34:11.398419] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-17T07:34:11.398359] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-17T07:34:11.400892] [INFO ] [MAIN ] Derivative Progress: 563/2172 symbols completed. DFIN took 1.1s. Estimated remaining: 10m 6s. Rate: 159.4 symbols/min [2025-09-17T07:34:11.402558] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:11.419165] [DEBUG] [LOCAL ] DFP: Loaded 11859 existing records from primary storage. [2025-09-17T07:34:11.419998] [INFO ] [MAIN ] DFP: Loaded 11859 primary data records. [2025-09-17T07:34:11.605029] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-09-17T07:34:11.619217] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-17T07:34:11.740476] [INFO ] [MAIN ] Derivative Progress: 564/2172 symbols completed. DFH took 1.5s. Estimated remaining: 10m 5s. Rate: 159.4 symbols/min [2025-09-17T07:34:11.741053] [INFO ] [MAIN ] DGX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:11.765317] [DEBUG] [LOCAL ] DG: Loaded 53312 existing records from primary storage. [2025-09-17T07:34:11.766263] [INFO ] [MAIN ] DG: Loaded 53312 primary data records. [2025-09-17T07:34:12.100261] [DEBUG] [LOCAL ] DGX: Loaded 45571 existing records from primary storage. [2025-09-17T07:34:12.100671] [INFO ] [MAIN ] DGX: Loaded 45571 primary data records. [2025-09-17T07:34:12.156970] [DEBUG] [MAIN ] DFP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:12.195046] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11859 primary records. [2025-09-17T07:34:12.217731] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-17T07:34:12.423800] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-09-17T07:34:12.424581] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-17T07:34:12.426807] [INFO ] [MAIN ] Derivative Progress: 565/2172 symbols completed. DFP took 1.1s. Estimated remaining: 10m 6s. Rate: 159.2 symbols/min [2025-09-17T07:34:12.427381] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:12.447065] [DEBUG] [MAIN ] DG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:12.447906] [INFO ] [MAIN ] DG: Generated 1794 derivative records from 53312 primary records. [2025-09-17T07:34:12.448149] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-17T07:34:12.477256] [DEBUG] [LOCAL ] DHF: Loaded 21188 existing records from primary storage. [2025-09-17T07:34:12.478780] [INFO ] [MAIN ] DHF: Loaded 21188 primary data records. [2025-09-17T07:34:12.478855] [DEBUG] [LOCAL ] DG: Derivative data saved (1794 records). [2025-09-17T07:34:12.479063] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-17T07:34:12.501875] [INFO ] [MAIN ] Derivative Progress: 566/2172 symbols completed. DG took 1.1s. Estimated remaining: 10m 4s. Rate: 159.4 symbols/min [2025-09-17T07:34:12.554287] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:12.675036] [DEBUG] [MAIN ] DGX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:12.680234] [INFO ] [MAIN ] DGX: Generated 1794 derivative records from 45571 primary records. [2025-09-17T07:34:12.832390] [DEBUG] [LOCAL ] DGX: Saving derivative data. [2025-09-17T07:34:12.856331] [DEBUG] [LOCAL ] DGX: Derivative data saved (1794 records). [2025-09-17T07:34:12.856689] [INFO ] [MAIN ] DGX: Successfully saved derivative data. [2025-09-17T07:34:12.859947] [INFO ] [MAIN ] Derivative Progress: 567/2172 symbols completed. DGX took 1.1s. Estimated remaining: 10m 4s. Rate: 159.5 symbols/min [2025-09-17T07:34:12.860420] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:12.893267] [DEBUG] [MAIN ] DHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:12.893987] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 21188 primary records. [2025-09-17T07:34:12.894149] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-17T07:34:12.925095] [DEBUG] [LOCAL ] DHI: Loaded 53376 existing records from primary storage. [2025-09-17T07:34:12.926043] [INFO ] [MAIN ] DHI: Loaded 53376 primary data records. [2025-09-17T07:34:12.925956] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-09-17T07:34:12.926342] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-17T07:34:12.959803] [INFO ] [MAIN ] Derivative Progress: 568/2172 symbols completed. DHF took 0.5s. Estimated remaining: 10m 3s. Rate: 159.7 symbols/min [2025-09-17T07:34:13.245502] [DEBUG] [LOCAL ] DHR: Loaded 53370 existing records from primary storage. [2025-09-17T07:34:13.245732] [INFO ] [MAIN ] DHR: Loaded 53370 primary data records. [2025-09-17T07:34:13.553632] [DEBUG] [MAIN ] DHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:13.554348] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53376 primary records. [2025-09-17T07:34:13.554701] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-17T07:34:13.571468] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-09-17T07:34:13.571574] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-17T07:34:13.573786] [INFO ] [MAIN ] Derivative Progress: 569/2172 symbols completed. DHI took 1.0s. Estimated remaining: 10m 3s. Rate: 159.5 symbols/min [2025-09-17T07:34:13.590422] [DEBUG] [MAIN ] DHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:13.591203] [INFO ] [MAIN ] DHR: Generated 1794 derivative records from 53370 primary records. [2025-09-17T07:34:13.591280] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-09-17T07:34:13.608599] [DEBUG] [LOCAL ] DHR: Derivative data saved (1794 records). [2025-09-17T07:34:13.608782] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-17T07:34:13.611074] [INFO ] [MAIN ] Derivative Progress: 570/2172 symbols completed. DHR took 0.8s. Estimated remaining: 10m 2s. Rate: 159.7 symbols/min [2025-09-17T07:34:13.611717] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:13.612196] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:13.611931] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:13.633655] [DEBUG] [LOCAL ] DIAX: Loaded 12242 existing records from primary storage. [2025-09-17T07:34:13.638209] [DEBUG] [LOCAL ] DHX: Loaded 13256 existing records from primary storage. [2025-09-17T07:34:13.638470] [INFO ] [MAIN ] DHX: Loaded 13256 primary data records. [2025-09-17T07:34:13.638365] [INFO ] [MAIN ] DIAX: Loaded 12242 primary data records. [2025-09-17T07:34:14.036402] [DEBUG] [LOCAL ] DHT: Loaded 48005 existing records from primary storage. [2025-09-17T07:34:14.240010] [INFO ] [MAIN ] DHT: Loaded 48005 primary data records. [2025-09-17T07:34:14.565950] [DEBUG] [MAIN ] DIAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:14.578834] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 12242 primary records. [2025-09-17T07:34:14.579060] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-09-17T07:34:14.579279] [DEBUG] [MAIN ] DHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:14.580485] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 13256 primary records. [2025-09-17T07:34:14.580790] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-17T07:34:14.612048] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-09-17T07:34:14.612743] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-17T07:34:14.615816] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-09-17T07:34:14.615985] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-09-17T07:34:14.615709] [INFO ] [MAIN ] Derivative Progress: 571/2172 symbols completed. DHX took 1.0s. Estimated remaining: 10m 3s. Rate: 159.3 symbols/min [2025-09-17T07:34:14.618769] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:14.618835] [INFO ] [MAIN ] Derivative Progress: 572/2172 symbols completed. DIAX took 1.0s. Estimated remaining: 10m 2s. Rate: 159.5 symbols/min [2025-09-17T07:34:14.619700] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:14.637530] [DEBUG] [MAIN ] DHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:14.638393] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 48005 primary records. [2025-09-17T07:34:14.638504] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-09-17T07:34:14.659400] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-09-17T07:34:14.667955] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-09-17T07:34:14.670355] [INFO ] [MAIN ] Derivative Progress: 573/2172 symbols completed. DHT took 1.1s. Estimated remaining: 10m 0s. Rate: 159.8 symbols/min [2025-09-17T07:34:14.672879] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:14.687473] [DEBUG] [LOCAL ] DIN: Loaded 37412 existing records from primary storage. [2025-09-17T07:34:14.700565] [INFO ] [MAIN ] DIN: Loaded 37412 primary data records. [2025-09-17T07:34:14.829105] [DEBUG] [LOCAL ] DINO: Loaded 52976 existing records from primary storage. [2025-09-17T07:34:14.840437] [INFO ] [MAIN ] DINO: Loaded 52976 primary data records. [2025-09-17T07:34:15.210446] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-17T07:34:15.371350] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-09-17T07:34:15.683299] [DEBUG] [MAIN ] DIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:15.684914] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37412 primary records. [2025-09-17T07:34:15.685271] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-17T07:34:15.702475] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-09-17T07:34:15.705717] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-17T07:34:15.708392] [INFO ] [MAIN ] Derivative Progress: 574/2172 symbols completed. DIN took 1.1s. Estimated remaining: 10m 2s. Rate: 159.3 symbols/min [2025-09-17T07:34:15.709141] [INFO ] [MAIN ] DK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:15.722376] [DEBUG] [MAIN ] DINO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:15.723255] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52976 primary records. [2025-09-17T07:34:15.723441] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-17T07:34:15.740763] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-09-17T07:34:15.741749] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-17T07:34:15.744504] [INFO ] [MAIN ] Derivative Progress: 575/2172 symbols completed. DINO took 1.1s. Estimated remaining: 10m 1s. Rate: 159.5 symbols/min [2025-09-17T07:34:15.745106] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:15.758755] [DEBUG] [MAIN ] DIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:15.759559] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-09-17T07:34:15.759771] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-17T07:34:15.780786] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-09-17T07:34:15.780982] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-17T07:34:15.783678] [INFO ] [MAIN ] Derivative Progress: 576/2172 symbols completed. DIS took 1.1s. Estimated remaining: 9m 59s. Rate: 159.8 symbols/min [2025-09-17T07:34:15.793826] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:15.801897] [DEBUG] [LOCAL ] DKL: Loaded 19633 existing records from primary storage. [2025-09-17T07:34:15.802171] [INFO ] [MAIN ] DKL: Loaded 19633 primary data records. [2025-09-17T07:34:15.917284] [DEBUG] [LOCAL ] DK: Loaded 49528 existing records from primary storage. [2025-09-17T07:34:15.917568] [INFO ] [MAIN ] DK: Loaded 49528 primary data records. [2025-09-17T07:34:16.424822] [DEBUG] [LOCAL ] DKS: Loaded 50024 existing records from primary storage. [2025-09-17T07:34:16.425533] [INFO ] [MAIN ] DKS: Loaded 50024 primary data records. [2025-09-17T07:34:16.784389] [DEBUG] [MAIN ] DKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:16.786145] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 19633 primary records. [2025-09-17T07:34:16.786468] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-17T07:34:16.817625] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-09-17T07:34:16.818351] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-17T07:34:16.818226] [DEBUG] [MAIN ] DK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:16.820426] [INFO ] [MAIN ] Derivative Progress: 577/2172 symbols completed. DKL took 1.1s. Estimated remaining: 10m 1s. Rate: 159.3 symbols/min [2025-09-17T07:34:16.821551] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:16.821176] [INFO ] [MAIN ] DK: Generated 1794 derivative records from 49528 primary records. [2025-09-17T07:34:16.822035] [DEBUG] [LOCAL ] DK: Saving derivative data. [2025-09-17T07:34:16.842037] [DEBUG] [LOCAL ] DK: Derivative data saved (1794 records). [2025-09-17T07:34:16.843712] [INFO ] [MAIN ] DK: Successfully saved derivative data. [2025-09-17T07:34:16.846566] [INFO ] [MAIN ] Derivative Progress: 578/2172 symbols completed. DK took 1.1s. Estimated remaining: 9m 59s. Rate: 159.6 symbols/min [2025-09-17T07:34:16.847006] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:16.868501] [DEBUG] [MAIN ] DKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:16.869448] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 50024 primary records. [2025-09-17T07:34:16.869689] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-17T07:34:16.887461] [DEBUG] [LOCAL ] DLNG: Loaded 6341 existing records from primary storage. [2025-09-17T07:34:16.896094] [INFO ] [MAIN ] DLNG: Loaded 6341 primary data records. [2025-09-17T07:34:16.934161] [DEBUG] [LOCAL ] DLB: Loaded 32255 existing records from primary storage. [2025-09-17T07:34:16.941210] [INFO ] [MAIN ] DLB: Loaded 32255 primary data records. [2025-09-17T07:34:17.019544] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-09-17T07:34:17.047517] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-17T07:34:17.081323] [INFO ] [MAIN ] Derivative Progress: 579/2172 symbols completed. DKS took 1.3s. Estimated remaining: 9m 59s. Rate: 159.7 symbols/min [2025-09-17T07:34:17.107154] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:17.583453] [DEBUG] [MAIN ] DLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:17.585860] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6341 primary records. [2025-09-17T07:34:17.586762] [DEBUG] [LOCAL ] DLR: Loaded 51267 existing records from primary storage. [2025-09-17T07:34:17.587224] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-17T07:34:17.587337] [INFO ] [MAIN ] DLR: Loaded 51267 primary data records. [2025-09-17T07:34:17.678176] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-09-17T07:34:17.683438] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-17T07:34:17.706465] [INFO ] [MAIN ] Derivative Progress: 580/2172 symbols completed. DLNG took 0.9s. Estimated remaining: 9m 59s. Rate: 159.5 symbols/min [2025-09-17T07:34:17.729207] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:17.921524] [DEBUG] [MAIN ] DLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:17.922502] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 32255 primary records. [2025-09-17T07:34:17.923206] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-17T07:34:17.949481] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-09-17T07:34:17.949747] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-17T07:34:17.953427] [INFO ] [MAIN ] Derivative Progress: 581/2172 symbols completed. DLB took 1.1s. Estimated remaining: 9m 58s. Rate: 159.6 symbols/min [2025-09-17T07:34:17.954762] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:17.964199] [DEBUG] [LOCAL ] DLX: Loaded 29367 existing records from primary storage. [2025-09-17T07:34:17.964579] [INFO ] [MAIN ] DLX: Loaded 29367 primary data records. [2025-09-17T07:34:18.152151] [DEBUG] [MAIN ] DLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:18.169174] [DEBUG] [LOCAL ] DLY: Loaded 19079 existing records from primary storage. [2025-09-17T07:34:18.173393] [INFO ] [MAIN ] DLY: Loaded 19079 primary data records. [2025-09-17T07:34:18.173336] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 51267 primary records. [2025-09-17T07:34:18.282453] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-17T07:34:18.645367] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-09-17T07:34:18.645702] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-17T07:34:18.647992] [INFO ] [MAIN ] Derivative Progress: 582/2172 symbols completed. DLR took 1.5s. Estimated remaining: 9m 59s. Rate: 159.3 symbols/min [2025-09-17T07:34:18.648813] [INFO ] [MAIN ] DMA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:18.658048] [DEBUG] [LOCAL ] DMA: Loaded 4541 existing records from primary storage. [2025-09-17T07:34:18.660007] [INFO ] [MAIN ] DMA: Loaded 4541 primary data records. [2025-09-17T07:34:18.765433] [DEBUG] [MAIN ] DLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:18.777176] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 29367 primary records. [2025-09-17T07:34:18.793368] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-17T07:34:18.993583] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-09-17T07:34:19.006382] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-17T07:34:19.006635] [DEBUG] [MAIN ] DLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:19.009299] [INFO ] [MAIN ] Derivative Progress: 583/2172 symbols completed. DLX took 1.3s. Estimated remaining: 9m 58s. Rate: 159.4 symbols/min [2025-09-17T07:34:19.010115] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 19079 primary records. [2025-09-17T07:34:19.010311] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-17T07:34:19.028328] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-09-17T07:34:19.028617] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-17T07:34:19.030894] [INFO ] [MAIN ] Derivative Progress: 584/2172 symbols completed. DLY took 1.1s. Estimated remaining: 9m 57s. Rate: 159.6 symbols/min [2025-09-17T07:34:19.045811] [DEBUG] [MAIN ] DMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:19.046372] [INFO ] [MAIN ] DMA: Generated 1794 derivative records from 4541 primary records. [2025-09-17T07:34:19.046446] [DEBUG] [LOCAL ] DMA: Saving derivative data. [2025-09-17T07:34:19.060115] [DEBUG] [LOCAL ] DMA: Derivative data saved (1794 records). [2025-09-17T07:34:19.060185] [INFO ] [MAIN ] DMA: Successfully saved derivative data. [2025-09-17T07:34:19.062450] [INFO ] [MAIN ] Derivative Progress: 585/2172 symbols completed. DMA took 0.4s. Estimated remaining: 9m 56s. Rate: 159.9 symbols/min [2025-09-17T07:34:19.062930] [INFO ] [MAIN ] DMB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:19.063014] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:19.063147] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:19.074800] [DEBUG] [LOCAL ] DMB: Loaded 10037 existing records from primary storage. [2025-09-17T07:34:19.075011] [INFO ] [MAIN ] DMB: Loaded 10037 primary data records. [2025-09-17T07:34:19.301230] [DEBUG] [LOCAL ] DNOW: Loaded 43432 existing records from primary storage. [2025-09-17T07:34:19.412306] [INFO ] [MAIN ] DNOW: Loaded 43432 primary data records. [2025-09-17T07:34:19.413050] [DEBUG] [LOCAL ] DNA: Loaded 48560 existing records from primary storage. [2025-09-17T07:34:19.413287] [INFO ] [MAIN ] DNA: Loaded 48560 primary data records. [2025-09-17T07:34:20.031155] [DEBUG] [MAIN ] DMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:20.032317] [INFO ] [MAIN ] DMB: Generated 1794 derivative records from 10037 primary records. [2025-09-17T07:34:20.033129] [DEBUG] [LOCAL ] DMB: Saving derivative data. [2025-09-17T07:34:20.051403] [DEBUG] [LOCAL ] DMB: Derivative data saved (1794 records). [2025-09-17T07:34:20.052133] [INFO ] [MAIN ] DMB: Successfully saved derivative data. [2025-09-17T07:34:20.054601] [INFO ] [MAIN ] Derivative Progress: 586/2172 symbols completed. DMB took 1.0s. Estimated remaining: 9m 57s. Rate: 159.4 symbols/min [2025-09-17T07:34:20.055474] [INFO ] [MAIN ] DNP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:20.087081] [DEBUG] [MAIN ] DNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:20.087311] [DEBUG] [MAIN ] DNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:20.088074] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48560 primary records. [2025-09-17T07:34:20.088767] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-17T07:34:20.088688] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43432 primary records. [2025-09-17T07:34:20.089406] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-17T07:34:20.128024] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-09-17T07:34:20.138234] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-17T07:34:20.138325] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-09-17T07:34:20.138545] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-17T07:34:20.141155] [INFO ] [MAIN ] Derivative Progress: 587/2172 symbols completed. DNOW took 1.1s. Estimated remaining: 9m 56s. Rate: 159.6 symbols/min [2025-09-17T07:34:20.141894] [DEBUG] [LOCAL ] DNP: Loaded 33548 existing records from primary storage. [2025-09-17T07:34:20.142228] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:20.144879] [INFO ] [MAIN ] Derivative Progress: 588/2172 symbols completed. DNA took 1.1s. Estimated remaining: 9m 54s. Rate: 159.9 symbols/min [2025-09-17T07:34:20.145066] [INFO ] [MAIN ] DNP: Loaded 33548 primary data records. [2025-09-17T07:34:20.145251] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:20.484979] [DEBUG] [LOCAL ] DOCN: Loaded 50377 existing records from primary storage. [2025-09-17T07:34:20.485400] [INFO ] [MAIN ] DOCN: Loaded 50377 primary data records. [2025-09-17T07:34:20.587086] [DEBUG] [LOCAL ] DOC: Loaded 53537 existing records from primary storage. [2025-09-17T07:34:20.610736] [INFO ] [MAIN ] DOC: Loaded 53537 primary data records. [2025-09-17T07:34:20.973034] [DEBUG] [MAIN ] DNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:20.986321] [INFO ] [MAIN ] DNP: Generated 1794 derivative records from 33548 primary records. [2025-09-17T07:34:21.016438] [DEBUG] [LOCAL ] DNP: Saving derivative data. [2025-09-17T07:34:21.187072] [DEBUG] [LOCAL ] DNP: Derivative data saved (1794 records). [2025-09-17T07:34:21.188279] [INFO ] [MAIN ] DNP: Successfully saved derivative data. [2025-09-17T07:34:21.191489] [INFO ] [MAIN ] Derivative Progress: 589/2172 symbols completed. DNP took 1.1s. Estimated remaining: 9m 56s. Rate: 159.4 symbols/min [2025-09-17T07:34:21.192132] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:21.216306] [DEBUG] [MAIN ] DOCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:21.219590] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50377 primary records. [2025-09-17T07:34:21.220520] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-17T07:34:21.241513] [DEBUG] [MAIN ] DOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:21.246658] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53537 primary records. [2025-09-17T07:34:21.260523] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-17T07:34:21.265103] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-09-17T07:34:21.265458] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-17T07:34:21.276304] [INFO ] [MAIN ] Derivative Progress: 590/2172 symbols completed. DOCN took 1.1s. Estimated remaining: 9m 55s. Rate: 159.6 symbols/min [2025-09-17T07:34:21.281658] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:21.298731] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-09-17T07:34:21.299896] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-17T07:34:21.299730] [DEBUG] [LOCAL ] DOCS: Loaded 51441 existing records from primary storage. [2025-09-17T07:34:21.302357] [INFO ] [MAIN ] Derivative Progress: 591/2172 symbols completed. DOC took 1.2s. Estimated remaining: 9m 53s. Rate: 159.9 symbols/min [2025-09-17T07:34:21.302604] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:21.302754] [INFO ] [MAIN ] DOCS: Loaded 51441 primary data records. [2025-09-17T07:34:21.633497] [DEBUG] [LOCAL ] DOUG: Loaded 34879 existing records from primary storage. [2025-09-17T07:34:21.634446] [INFO ] [MAIN ] DOUG: Loaded 34879 primary data records. [2025-09-17T07:34:21.634359] [DEBUG] [LOCAL ] DOLE: Loaded 37771 existing records from primary storage. [2025-09-17T07:34:21.634721] [INFO ] [MAIN ] DOLE: Loaded 37771 primary data records. [2025-09-17T07:34:22.240947] [DEBUG] [MAIN ] DOCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:22.242076] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 51441 primary records. [2025-09-17T07:34:22.242613] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-17T07:34:22.267548] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-09-17T07:34:22.268124] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-17T07:34:22.270182] [INFO ] [MAIN ] Derivative Progress: 592/2172 symbols completed. DOCS took 1.1s. Estimated remaining: 9m 55s. Rate: 159.5 symbols/min [2025-09-17T07:34:22.271195] [INFO ] [MAIN ] DOV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:22.300475] [DEBUG] [MAIN ] DOLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:22.300867] [DEBUG] [MAIN ] DOUG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:22.301521] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 37771 primary records. [2025-09-17T07:34:22.301672] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-17T07:34:22.302495] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34879 primary records. [2025-09-17T07:34:22.302877] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-17T07:34:22.331548] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-09-17T07:34:22.334875] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-09-17T07:34:22.335236] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-17T07:34:22.335417] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-17T07:34:22.337870] [INFO ] [MAIN ] Derivative Progress: 593/2172 symbols completed. DOLE took 1.1s. Estimated remaining: 9m 53s. Rate: 159.7 symbols/min [2025-09-17T07:34:22.340543] [INFO ] [MAIN ] DOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:22.340612] [INFO ] [MAIN ] Derivative Progress: 594/2172 symbols completed. DOUG took 1.0s. Estimated remaining: 9m 52s. Rate: 159.9 symbols/min [2025-09-17T07:34:22.340842] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:22.370676] [DEBUG] [LOCAL ] DPG: Loaded 13284 existing records from primary storage. [2025-09-17T07:34:22.385477] [INFO ] [MAIN ] DPG: Loaded 13284 primary data records. [2025-09-17T07:34:22.417671] [DEBUG] [LOCAL ] DOV: Loaded 45883 existing records from primary storage. [2025-09-17T07:34:22.422939] [INFO ] [MAIN ] DOV: Loaded 45883 primary data records. [2025-09-17T07:34:22.771364] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-09-17T07:34:22.902746] [INFO ] [MAIN ] DOW: Loaded 53733 primary data records. [2025-09-17T07:34:23.369697] [DEBUG] [MAIN ] DPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:23.370339] [DEBUG] [MAIN ] DOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:23.371046] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13284 primary records. [2025-09-17T07:34:23.371628] [INFO ] [MAIN ] DOV: Generated 1794 derivative records from 45883 primary records. [2025-09-17T07:34:23.372044] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-17T07:34:23.372109] [DEBUG] [LOCAL ] DOV: Saving derivative data. [2025-09-17T07:34:23.405549] [DEBUG] [LOCAL ] DOV: Derivative data saved (1794 records). [2025-09-17T07:34:23.406420] [INFO ] [MAIN ] DOV: Successfully saved derivative data. [2025-09-17T07:34:23.420892] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-09-17T07:34:23.421569] [DEBUG] [MAIN ] DOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:23.421719] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-17T07:34:23.424013] [INFO ] [MAIN ] Derivative Progress: 595/2172 symbols completed. DOV took 1.2s. Estimated remaining: 9m 53s. Rate: 159.4 symbols/min [2025-09-17T07:34:23.424835] [INFO ] [MAIN ] DOW: Generated 1794 derivative records from 53733 primary records. [2025-09-17T07:34:23.427093] [INFO ] [MAIN ] Derivative Progress: 596/2172 symbols completed. DPG took 1.1s. Estimated remaining: 9m 52s. Rate: 159.7 symbols/min [2025-09-17T07:34:23.427192] [DEBUG] [LOCAL ] DOW: Saving derivative data. [2025-09-17T07:34:23.427534] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:23.427355] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:23.445006] [DEBUG] [LOCAL ] DOW: Derivative data saved (1794 records). [2025-09-17T07:34:23.445156] [INFO ] [MAIN ] DOW: Successfully saved derivative data. [2025-09-17T07:34:23.447307] [INFO ] [MAIN ] Derivative Progress: 597/2172 symbols completed. DOW took 1.1s. Estimated remaining: 9m 51s. Rate: 160.0 symbols/min [2025-09-17T07:34:23.447624] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:23.509026] [DEBUG] [LOCAL ] DRD: Loaded 36102 existing records from primary storage. [2025-09-17T07:34:23.533496] [INFO ] [MAIN ] DRD: Loaded 36102 primary data records. [2025-09-17T07:34:23.534453] [DEBUG] [LOCAL ] DRH: Loaded 50464 existing records from primary storage. [2025-09-17T07:34:23.555918] [INFO ] [MAIN ] DRH: Loaded 50464 primary data records. [2025-09-17T07:34:23.555845] [DEBUG] [LOCAL ] DQ: Loaded 43010 existing records from primary storage. [2025-09-17T07:34:23.571405] [INFO ] [MAIN ] DQ: Loaded 43010 primary data records. [2025-09-17T07:34:24.511577] [DEBUG] [MAIN ] DRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:24.512167] [DEBUG] [MAIN ] DQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:24.513751] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 36102 primary records. [2025-09-17T07:34:24.513195] [INFO ] [MAIN ] DQ: Generated 1794 derivative records from 43010 primary records. [2025-09-17T07:34:24.514084] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-17T07:34:24.514170] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-17T07:34:24.547027] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-09-17T07:34:24.549569] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-17T07:34:24.551592] [INFO ] [MAIN ] Derivative Progress: 598/2172 symbols completed. DRD took 1.1s. Estimated remaining: 9m 52s. Rate: 159.4 symbols/min [2025-09-17T07:34:24.549300] [DEBUG] [LOCAL ] DQ: Derivative data saved (1794 records). [2025-09-17T07:34:24.551884] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-17T07:34:24.566326] [INFO ] [MAIN ] Derivative Progress: 599/2172 symbols completed. DQ took 1.1s. Estimated remaining: 9m 51s. Rate: 159.7 symbols/min [2025-09-17T07:34:24.566712] [DEBUG] [MAIN ] DRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:24.567448] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50464 primary records. [2025-09-17T07:34:24.567661] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-17T07:34:24.587512] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-09-17T07:34:24.587600] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-17T07:34:24.590497] [INFO ] [MAIN ] Derivative Progress: 600/2172 symbols completed. DRH took 1.1s. Estimated remaining: 9m 50s. Rate: 159.9 symbols/min [2025-09-17T07:34:24.591063] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:24.591236] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:24.591153] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:24.607013] [DEBUG] [LOCAL ] DRLL: Loaded 10058 existing records from primary storage. [2025-09-17T07:34:24.607270] [INFO ] [MAIN ] DRLL: Loaded 10058 primary data records. [2025-09-17T07:34:24.813014] [DEBUG] [LOCAL ] DSL: Loaded 28139 existing records from primary storage. [2025-09-17T07:34:24.922667] [INFO ] [MAIN ] DSL: Loaded 28139 primary data records. [2025-09-17T07:34:25.041315] [DEBUG] [LOCAL ] DRI: Loaded 47769 existing records from primary storage. [2025-09-17T07:34:25.046969] [INFO ] [MAIN ] DRI: Loaded 47769 primary data records. [2025-09-17T07:34:25.568009] [DEBUG] [MAIN ] DRLL: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:34:25.569474] [INFO ] [MAIN ] DRLL: Generated 1793 derivative records from 10058 primary records. [2025-09-17T07:34:25.571048] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-17T07:34:25.588449] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1793 records). [2025-09-17T07:34:25.588959] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-17T07:34:25.591244] [INFO ] [MAIN ] Derivative Progress: 601/2172 symbols completed. DRLL took 1.0s. Estimated remaining: 9m 51s. Rate: 159.5 symbols/min [2025-09-17T07:34:25.593224] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:25.609964] [DEBUG] [MAIN ] DSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:25.610781] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28139 primary records. [2025-09-17T07:34:25.611138] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-17T07:34:25.636582] [DEBUG] [LOCAL ] DSM: Loaded 15831 existing records from primary storage. [2025-09-17T07:34:25.637526] [INFO ] [MAIN ] DSM: Loaded 15831 primary data records. [2025-09-17T07:34:25.671484] [DEBUG] [MAIN ] DRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:25.682828] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47769 primary records. [2025-09-17T07:34:25.688301] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-17T07:34:25.717787] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-09-17T07:34:25.745792] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-17T07:34:25.767990] [INFO ] [MAIN ] Derivative Progress: 602/2172 symbols completed. DSL took 1.2s. Estimated remaining: 9m 50s. Rate: 159.6 symbols/min [2025-09-17T07:34:25.768830] [INFO ] [MAIN ] DSMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:25.774752] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-09-17T07:34:25.785857] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-17T07:34:25.818857] [INFO ] [MAIN ] Derivative Progress: 603/2172 symbols completed. DRI took 1.2s. Estimated remaining: 9m 49s. Rate: 159.9 symbols/min [2025-09-17T07:34:25.852962] [INFO ] [MAIN ] DSU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:25.858001] [DEBUG] [LOCAL ] DSMC: Loaded 1993 existing records from primary storage. [2025-09-17T07:34:25.956575] [INFO ] [MAIN ] DSMC: Loaded 1993 primary data records. [2025-09-17T07:34:26.170684] [DEBUG] [LOCAL ] DSU: Loaded 21420 existing records from primary storage. [2025-09-17T07:34:26.285684] [INFO ] [MAIN ] DSU: Loaded 21420 primary data records. [2025-09-17T07:34:26.627682] [DEBUG] [MAIN ] DSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:26.642783] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 15831 primary records. [2025-09-17T07:34:26.643227] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-17T07:34:26.661666] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-09-17T07:34:26.664200] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-17T07:34:26.666844] [INFO ] [MAIN ] Derivative Progress: 604/2172 symbols completed. DSM took 1.1s. Estimated remaining: 9m 50s. Rate: 159.5 symbols/min [2025-09-17T07:34:26.680811] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:26.680727] [DEBUG] [MAIN ] DSMC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:34:26.681968] [INFO ] [MAIN ] DSMC: Generated 1793 derivative records from 1993 primary records. [2025-09-17T07:34:26.682462] [DEBUG] [LOCAL ] DSMC: Saving derivative data. [2025-09-17T07:34:26.699963] [DEBUG] [LOCAL ] DSMC: Derivative data saved (1793 records). [2025-09-17T07:34:26.700112] [INFO ] [MAIN ] DSMC: Successfully saved derivative data. [2025-09-17T07:34:26.702616] [INFO ] [MAIN ] Derivative Progress: 605/2172 symbols completed. DSMC took 0.9s. Estimated remaining: 9m 48s. Rate: 159.8 symbols/min [2025-09-17T07:34:26.703196] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:26.745684] [DEBUG] [LOCAL ] DSX: Loaded 24732 existing records from primary storage. [2025-09-17T07:34:26.744995] [DEBUG] [MAIN ] DSU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:26.745971] [INFO ] [MAIN ] DSX: Loaded 24732 primary data records. [2025-09-17T07:34:26.746864] [INFO ] [MAIN ] DSU: Generated 1794 derivative records from 21420 primary records. [2025-09-17T07:34:26.768306] [DEBUG] [LOCAL ] DSU: Saving derivative data. [2025-09-17T07:34:26.934115] [DEBUG] [LOCAL ] DSU: Derivative data saved (1794 records). [2025-09-17T07:34:26.964958] [INFO ] [MAIN ] DSU: Successfully saved derivative data. [2025-09-17T07:34:27.107538] [DEBUG] [LOCAL ] DT: Loaded 52955 existing records from primary storage. [2025-09-17T07:34:27.105958] [INFO ] [MAIN ] Derivative Progress: 606/2172 symbols completed. DSU took 1.3s. Estimated remaining: 9m 48s. Rate: 159.8 symbols/min [2025-09-17T07:34:27.107799] [INFO ] [MAIN ] DT: Loaded 52955 primary data records. [2025-09-17T07:34:27.108068] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:27.207054] [DEBUG] [LOCAL ] DTB: Loaded 4660 existing records from primary storage. [2025-09-17T07:34:27.227330] [INFO ] [MAIN ] DTB: Loaded 4660 primary data records. [2025-09-17T07:34:27.751325] [DEBUG] [MAIN ] DSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:27.752566] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 24732 primary records. [2025-09-17T07:34:27.753413] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-17T07:34:27.771996] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-09-17T07:34:27.772508] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-17T07:34:27.775251] [INFO ] [MAIN ] Derivative Progress: 607/2172 symbols completed. DSX took 1.1s. Estimated remaining: 9m 49s. Rate: 159.5 symbols/min [2025-09-17T07:34:27.776513] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:27.793519] [DEBUG] [MAIN ] DT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:27.794266] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52955 primary records. [2025-09-17T07:34:27.794751] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-17T07:34:27.812975] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-09-17T07:34:27.814777] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-17T07:34:27.817383] [INFO ] [MAIN ] Derivative Progress: 608/2172 symbols completed. DT took 1.1s. Estimated remaining: 9m 47s. Rate: 159.8 symbols/min [2025-09-17T07:34:27.830076] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:27.830744] [DEBUG] [MAIN ] DTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:27.832455] [INFO ] [MAIN ] DTB: Generated 1794 derivative records from 4660 primary records. [2025-09-17T07:34:27.832582] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-17T07:34:27.851484] [DEBUG] [LOCAL ] DTB: Derivative data saved (1794 records). [2025-09-17T07:34:27.854998] [DEBUG] [LOCAL ] DTG: Loaded 5874 existing records from primary storage. [2025-09-17T07:34:27.855129] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-17T07:34:27.857976] [INFO ] [MAIN ] Derivative Progress: 609/2172 symbols completed. DTB took 0.7s. Estimated remaining: 9m 46s. Rate: 160.0 symbols/min [2025-09-17T07:34:27.858061] [INFO ] [MAIN ] DTG: Loaded 5874 primary data records. [2025-09-17T07:34:27.858371] [INFO ] [MAIN ] DTM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:28.028614] [DEBUG] [LOCAL ] DTE: Loaded 48037 existing records from primary storage. [2025-09-17T07:34:28.064401] [INFO ] [MAIN ] DTE: Loaded 48037 primary data records. [2025-09-17T07:34:28.307823] [DEBUG] [LOCAL ] DTM: Loaded 44706 existing records from primary storage. [2025-09-17T07:34:28.329984] [INFO ] [MAIN ] DTM: Loaded 44706 primary data records. [2025-09-17T07:34:28.866367] [DEBUG] [MAIN ] DTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:28.867238] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5874 primary records. [2025-09-17T07:34:28.867755] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-17T07:34:28.887667] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-09-17T07:34:28.888004] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-17T07:34:28.890073] [INFO ] [MAIN ] Derivative Progress: 610/2172 symbols completed. DTG took 1.1s. Estimated remaining: 9m 47s. Rate: 159.6 symbols/min [2025-09-17T07:34:28.891405] [INFO ] [MAIN ] DTW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:28.913888] [DEBUG] [LOCAL ] DTW: Loaded 4921 existing records from primary storage. [2025-09-17T07:34:28.914474] [INFO ] [MAIN ] DTW: Loaded 4921 primary data records. [2025-09-17T07:34:28.914251] [DEBUG] [MAIN ] DTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:28.936712] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 48037 primary records. [2025-09-17T07:34:28.951958] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-17T07:34:29.039261] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-09-17T07:34:29.069143] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-17T07:34:29.104235] [INFO ] [MAIN ] Derivative Progress: 611/2172 symbols completed. DTE took 1.3s. Estimated remaining: 9m 47s. Rate: 159.7 symbols/min [2025-09-17T07:34:29.115853] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:29.116420] [DEBUG] [MAIN ] DTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:29.246866] [INFO ] [MAIN ] DTM: Generated 1794 derivative records from 44706 primary records. [2025-09-17T07:34:29.261813] [DEBUG] [LOCAL ] DTM: Saving derivative data. [2025-09-17T07:34:29.280802] [DEBUG] [LOCAL ] DTM: Derivative data saved (1794 records). [2025-09-17T07:34:29.281474] [INFO ] [MAIN ] DTM: Successfully saved derivative data. [2025-09-17T07:34:29.284775] [INFO ] [MAIN ] Derivative Progress: 612/2172 symbols completed. DTM took 1.4s. Estimated remaining: 9m 46s. Rate: 159.8 symbols/min [2025-09-17T07:34:29.285506] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:29.295593] [DEBUG] [LOCAL ] DUKB: Loaded 6446 existing records from primary storage. [2025-09-17T07:34:29.295924] [INFO ] [MAIN ] DUKB: Loaded 6446 primary data records. [2025-09-17T07:34:29.499296] [DEBUG] [MAIN ] DTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:29.521076] [INFO ] [MAIN ] DTW: Generated 1794 derivative records from 4921 primary records. [2025-09-17T07:34:29.624652] [DEBUG] [LOCAL ] DUK: Loaded 53479 existing records from primary storage. [2025-09-17T07:34:29.634171] [INFO ] [MAIN ] DUK: Loaded 53479 primary data records. [2025-09-17T07:34:29.633431] [DEBUG] [LOCAL ] DTW: Saving derivative data. [2025-09-17T07:34:29.755935] [DEBUG] [LOCAL ] DTW: Derivative data saved (1794 records). [2025-09-17T07:34:29.766609] [INFO ] [MAIN ] DTW: Successfully saved derivative data. [2025-09-17T07:34:29.774798] [INFO ] [MAIN ] Derivative Progress: 613/2172 symbols completed. DTW took 0.9s. Estimated remaining: 9m 46s. Rate: 159.7 symbols/min [2025-09-17T07:34:29.982944] [DEBUG] [MAIN ] DUKB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:29.984242] [INFO ] [MAIN ] DUKB: Generated 1794 derivative records from 6446 primary records. [2025-09-17T07:34:29.984831] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-17T07:34:30.001993] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1794 records). [2025-09-17T07:34:30.002548] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-17T07:34:30.005236] [INFO ] [MAIN ] Derivative Progress: 614/2172 symbols completed. DUKB took 0.7s. Estimated remaining: 9m 45s. Rate: 159.8 symbols/min [2025-09-17T07:34:30.021136] [DEBUG] [MAIN ] DUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:30.021747] [INFO ] [MAIN ] DUK: Generated 1794 derivative records from 53479 primary records. [2025-09-17T07:34:30.021823] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-17T07:34:30.037688] [DEBUG] [LOCAL ] DUK: Derivative data saved (1794 records). [2025-09-17T07:34:30.037780] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-17T07:34:30.040096] [INFO ] [MAIN ] Derivative Progress: 615/2172 symbols completed. DUK took 0.9s. Estimated remaining: 9m 44s. Rate: 160.1 symbols/min [2025-09-17T07:34:30.040773] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:30.040860] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:30.040988] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:30.115419] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-17T07:34:30.115935] [INFO ] [MAIN ] DVN: Loaded 53699 primary data records. [2025-09-17T07:34:30.247260] [DEBUG] [LOCAL ] DV: Loaded 51294 existing records from primary storage. [2025-09-17T07:34:30.248737] [INFO ] [MAIN ] DV: Loaded 51294 primary data records. [2025-09-17T07:34:30.249881] [DEBUG] [LOCAL ] DVA: Loaded 41816 existing records from primary storage. [2025-09-17T07:34:30.290989] [INFO ] [MAIN ] DVA: Loaded 41816 primary data records. [2025-09-17T07:34:31.086958] [DEBUG] [MAIN ] DVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:31.088414] [INFO ] [MAIN ] DVN: Generated 1794 derivative records from 53699 primary records. [2025-09-17T07:34:31.088546] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-17T07:34:31.121259] [DEBUG] [LOCAL ] DVN: Derivative data saved (1794 records). [2025-09-17T07:34:31.119909] [DEBUG] [MAIN ] DV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:31.122861] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-17T07:34:31.125437] [INFO ] [MAIN ] Derivative Progress: 616/2172 symbols completed. DVN took 1.1s. Estimated remaining: 9m 45s. Rate: 159.6 symbols/min [2025-09-17T07:34:31.123525] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51294 primary records. [2025-09-17T07:34:31.125729] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-17T07:34:31.125952] [INFO ] [MAIN ] DX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:31.150562] [DEBUG] [MAIN ] DVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:31.151625] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 41816 primary records. [2025-09-17T07:34:31.152341] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-17T07:34:31.164858] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-09-17T07:34:31.165001] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-17T07:34:31.167460] [INFO ] [MAIN ] Derivative Progress: 617/2172 symbols completed. DV took 1.1s. Estimated remaining: 9m 44s. Rate: 159.8 symbols/min [2025-09-17T07:34:31.171242] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:31.175871] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-09-17T07:34:31.176004] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-17T07:34:31.178599] [INFO ] [MAIN ] Derivative Progress: 618/2172 symbols completed. DVA took 1.1s. Estimated remaining: 9m 43s. Rate: 160.1 symbols/min [2025-09-17T07:34:31.179209] [INFO ] [MAIN ] DXYZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:31.240243] [DEBUG] [LOCAL ] DXYZ: Loaded 36774 existing records from primary storage. [2025-09-17T07:34:31.240504] [INFO ] [MAIN ] DXYZ: Loaded 36774 primary data records. [2025-09-17T07:34:31.339245] [DEBUG] [LOCAL ] DXC: Loaded 49444 existing records from primary storage. [2025-09-17T07:34:31.374835] [INFO ] [MAIN ] DXC: Loaded 49444 primary data records. [2025-09-17T07:34:31.374222] [DEBUG] [LOCAL ] DX: Loaded 52464 existing records from primary storage. [2025-09-17T07:34:31.390539] [INFO ] [MAIN ] DX: Loaded 52464 primary data records. [2025-09-17T07:34:32.250465] [DEBUG] [MAIN ] DXYZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:32.252439] [INFO ] [MAIN ] DXYZ: Generated 1794 derivative records from 36774 primary records. [2025-09-17T07:34:32.252588] [DEBUG] [LOCAL ] DXYZ: Saving derivative data. [2025-09-17T07:34:32.285920] [DEBUG] [MAIN ] DXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:32.294038] [DEBUG] [MAIN ] DX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:32.295222] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49444 primary records. [2025-09-17T07:34:32.296317] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-17T07:34:32.296210] [INFO ] [MAIN ] DX: Generated 1794 derivative records from 52464 primary records. [2025-09-17T07:34:32.296668] [DEBUG] [LOCAL ] DX: Saving derivative data. [2025-09-17T07:34:32.301282] [DEBUG] [LOCAL ] DXYZ: Derivative data saved (1794 records). [2025-09-17T07:34:32.301627] [INFO ] [MAIN ] DXYZ: Successfully saved derivative data. [2025-09-17T07:34:32.318781] [INFO ] [MAIN ] Derivative Progress: 619/2172 symbols completed. DXYZ took 1.1s. Estimated remaining: 9m 44s. Rate: 159.5 symbols/min [2025-09-17T07:34:32.329009] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:32.332189] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-09-17T07:34:32.333780] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-17T07:34:32.335354] [DEBUG] [LOCAL ] DX: Derivative data saved (1794 records). [2025-09-17T07:34:32.339046] [INFO ] [MAIN ] Derivative Progress: 620/2172 symbols completed. DXC took 1.2s. Estimated remaining: 9m 43s. Rate: 159.8 symbols/min [2025-09-17T07:34:32.339390] [INFO ] [MAIN ] DX: Successfully saved derivative data. [2025-09-17T07:34:32.342372] [INFO ] [MAIN ] Derivative Progress: 621/2172 symbols completed. DX took 1.2s. Estimated remaining: 9m 42s. Rate: 160.0 symbols/min [2025-09-17T07:34:32.339707] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:32.342701] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:32.393193] [DEBUG] [LOCAL ] DY: Loaded 30199 existing records from primary storage. [2025-09-17T07:34:32.393426] [INFO ] [MAIN ] DY: Loaded 30199 primary data records. [2025-09-17T07:34:32.518249] [DEBUG] [LOCAL ] EAF: Loaded 44408 existing records from primary storage. [2025-09-17T07:34:32.518692] [INFO ] [MAIN ] EAF: Loaded 44408 primary data records. [2025-09-17T07:34:32.529676] [DEBUG] [LOCAL ] E: Loaded 33761 existing records from primary storage. [2025-09-17T07:34:32.634099] [INFO ] [MAIN ] E: Loaded 33761 primary data records. [2025-09-17T07:34:33.312178] [DEBUG] [MAIN ] DY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:33.315755] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 30199 primary records. [2025-09-17T07:34:33.316032] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-17T07:34:33.337860] [DEBUG] [MAIN ] EAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:33.342501] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 44408 primary records. [2025-09-17T07:34:33.342979] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-17T07:34:33.355870] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-09-17T07:34:33.360178] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-17T07:34:33.364701] [INFO ] [MAIN ] Derivative Progress: 622/2172 symbols completed. DY took 1.0s. Estimated remaining: 9m 43s. Rate: 159.6 symbols/min [2025-09-17T07:34:33.365986] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:33.373167] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-09-17T07:34:33.373501] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-17T07:34:33.378790] [INFO ] [MAIN ] Derivative Progress: 623/2172 symbols completed. EAF took 1.0s. Estimated remaining: 9m 41s. Rate: 159.8 symbols/min [2025-09-17T07:34:33.376407] [DEBUG] [LOCAL ] EAI: Loaded 4019 existing records from primary storage. [2025-09-17T07:34:33.391301] [INFO ] [MAIN ] EAI: Loaded 4019 primary data records. [2025-09-17T07:34:33.391535] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:33.434049] [DEBUG] [MAIN ] E: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:33.456594] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33761 primary records. [2025-09-17T07:34:33.491217] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-17T07:34:33.707124] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-09-17T07:34:33.708220] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-17T07:34:33.710937] [INFO ] [MAIN ] Derivative Progress: 624/2172 symbols completed. E took 1.4s. Estimated remaining: 9m 41s. Rate: 159.9 symbols/min [2025-09-17T07:34:33.721442] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:33.722331] [DEBUG] [LOCAL ] EARN: Loaded 30932 existing records from primary storage. [2025-09-17T07:34:33.723097] [INFO ] [MAIN ] EARN: Loaded 30932 primary data records. [2025-09-17T07:34:34.071794] [DEBUG] [MAIN ] EAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:34.072888] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 4019 primary records. [2025-09-17T07:34:34.074163] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-17T07:34:34.074428] [DEBUG] [LOCAL ] EAT: Loaded 49816 existing records from primary storage. [2025-09-17T07:34:34.075073] [INFO ] [MAIN ] EAT: Loaded 49816 primary data records. [2025-09-17T07:34:34.211118] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-09-17T07:34:34.266540] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-17T07:34:34.275850] [INFO ] [MAIN ] Derivative Progress: 625/2172 symbols completed. EAI took 0.9s. Estimated remaining: 9m 41s. Rate: 159.7 symbols/min [2025-09-17T07:34:34.425075] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:34.439029] [DEBUG] [MAIN ] EARN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:34.439923] [INFO ] [MAIN ] EARN: Generated 1794 derivative records from 30932 primary records. [2025-09-17T07:34:34.440092] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-17T07:34:34.457693] [DEBUG] [LOCAL ] EARN: Derivative data saved (1794 records). [2025-09-17T07:34:34.458393] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-17T07:34:34.460923] [INFO ] [MAIN ] Derivative Progress: 626/2172 symbols completed. EARN took 1.1s. Estimated remaining: 9m 40s. Rate: 159.9 symbols/min [2025-09-17T07:34:34.461157] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:34.519822] [DEBUG] [LOCAL ] EBF: Loaded 19671 existing records from primary storage. [2025-09-17T07:34:34.520311] [DEBUG] [MAIN ] EAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:34.521450] [INFO ] [MAIN ] EBF: Loaded 19671 primary data records. [2025-09-17T07:34:34.522305] [INFO ] [MAIN ] EAT: Generated 1794 derivative records from 49816 primary records. [2025-09-17T07:34:34.523077] [DEBUG] [LOCAL ] EB: Loaded 38243 existing records from primary storage. [2025-09-17T07:34:34.543507] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-17T07:34:34.577182] [INFO ] [MAIN ] EB: Loaded 38243 primary data records. [2025-09-17T07:34:34.805271] [DEBUG] [LOCAL ] EAT: Derivative data saved (1794 records). [2025-09-17T07:34:34.934156] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-17T07:34:34.952526] [INFO ] [MAIN ] Derivative Progress: 627/2172 symbols completed. EAT took 1.2s. Estimated remaining: 9m 40s. Rate: 159.8 symbols/min [2025-09-17T07:34:35.009945] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:35.152284] [DEBUG] [MAIN ] EBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:35.153324] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19671 primary records. [2025-09-17T07:34:35.153811] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-17T07:34:35.199369] [DEBUG] [MAIN ] EB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:35.211882] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 38243 primary records. [2025-09-17T07:34:35.213728] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-09-17T07:34:35.214848] [DEBUG] [LOCAL ] EBR: Loaded 43127 existing records from primary storage. [2025-09-17T07:34:35.214973] [INFO ] [MAIN ] EBR: Loaded 43127 primary data records. [2025-09-17T07:34:35.215071] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-17T07:34:35.213840] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-17T07:34:35.217505] [INFO ] [MAIN ] Derivative Progress: 628/2172 symbols completed. EBF took 0.8s. Estimated remaining: 9m 40s. Rate: 159.9 symbols/min [2025-09-17T07:34:35.396038] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-09-17T07:34:35.417000] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-17T07:34:35.534389] [INFO ] [MAIN ] Derivative Progress: 629/2172 symbols completed. EB took 1.1s. Estimated remaining: 9m 39s. Rate: 159.9 symbols/min [2025-09-17T07:34:35.558192] [DEBUG] [MAIN ] EBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:35.558869] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43127 primary records. [2025-09-17T07:34:35.558948] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-17T07:34:35.573776] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-09-17T07:34:35.573848] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-17T07:34:35.576182] [INFO ] [MAIN ] Derivative Progress: 630/2172 symbols completed. EBR took 0.6s. Estimated remaining: 9m 38s. Rate: 160.1 symbols/min [2025-09-17T07:34:35.576894] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:35.576999] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:35.577687] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:35.619063] [DEBUG] [LOCAL ] ECAT: Loaded 29887 existing records from primary storage. [2025-09-17T07:34:35.619326] [INFO ] [MAIN ] ECAT: Loaded 29887 primary data records. [2025-09-17T07:34:35.745537] [DEBUG] [LOCAL ] EBS: Loaded 47015 existing records from primary storage. [2025-09-17T07:34:35.769107] [INFO ] [MAIN ] EBS: Loaded 47015 primary data records. [2025-09-17T07:34:35.815835] [DEBUG] [LOCAL ] EC: Loaded 49499 existing records from primary storage. [2025-09-17T07:34:35.989558] [INFO ] [MAIN ] EC: Loaded 49499 primary data records. [2025-09-17T07:34:36.605747] [DEBUG] [MAIN ] ECAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:36.607700] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29887 primary records. [2025-09-17T07:34:36.609451] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-17T07:34:36.640284] [DEBUG] [MAIN ] EBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:36.641622] [INFO ] [MAIN ] EBS: Generated 1794 derivative records from 47015 primary records. [2025-09-17T07:34:36.642414] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-09-17T07:34:36.642109] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-17T07:34:36.643852] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-17T07:34:36.645705] [INFO ] [MAIN ] Derivative Progress: 631/2172 symbols completed. ECAT took 1.1s. Estimated remaining: 9m 39s. Rate: 159.7 symbols/min [2025-09-17T07:34:36.646624] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:36.675074] [DEBUG] [LOCAL ] EBS: Derivative data saved (1794 records). [2025-09-17T07:34:36.675717] [DEBUG] [MAIN ] EC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:36.675770] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-17T07:34:36.678297] [INFO ] [MAIN ] Derivative Progress: 632/2172 symbols completed. EBS took 1.1s. Estimated remaining: 9m 38s. Rate: 159.9 symbols/min [2025-09-17T07:34:36.679044] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49499 primary records. [2025-09-17T07:34:36.679613] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:36.679780] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-17T07:34:36.696743] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-09-17T07:34:36.696865] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-17T07:34:36.699957] [INFO ] [MAIN ] Derivative Progress: 633/2172 symbols completed. EC took 1.1s. Estimated remaining: 9m 37s. Rate: 160.1 symbols/min [2025-09-17T07:34:36.700364] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:36.740367] [DEBUG] [LOCAL ] ECG: Loaded 34791 existing records from primary storage. [2025-09-17T07:34:36.740552] [INFO ] [MAIN ] ECG: Loaded 34791 primary data records. [2025-09-17T07:34:36.865327] [DEBUG] [LOCAL ] ECC: Loaded 43407 existing records from primary storage. [2025-09-17T07:34:36.869127] [INFO ] [MAIN ] ECC: Loaded 43407 primary data records. [2025-09-17T07:34:37.157608] [DEBUG] [LOCAL ] ECL: Loaded 46722 existing records from primary storage. [2025-09-17T07:34:37.195523] [INFO ] [MAIN ] ECL: Loaded 46722 primary data records. [2025-09-17T07:34:37.737527] [DEBUG] [MAIN ] ECG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:37.739605] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 34791 primary records. [2025-09-17T07:34:37.740010] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-17T07:34:37.776984] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-09-17T07:34:37.777563] [DEBUG] [MAIN ] ECC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:37.778016] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-17T07:34:37.781224] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43407 primary records. [2025-09-17T07:34:37.780438] [INFO ] [MAIN ] Derivative Progress: 634/2172 symbols completed. ECG took 1.1s. Estimated remaining: 9m 38s. Rate: 159.6 symbols/min [2025-09-17T07:34:37.781723] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-17T07:34:37.782876] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:37.801686] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-09-17T07:34:37.801874] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-17T07:34:37.804328] [INFO ] [MAIN ] Derivative Progress: 635/2172 symbols completed. ECC took 1.2s. Estimated remaining: 9m 37s. Rate: 159.9 symbols/min [2025-09-17T07:34:37.804838] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:37.825756] [DEBUG] [MAIN ] ECL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:37.831529] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46722 primary records. [2025-09-17T07:34:37.832408] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-17T07:34:37.849687] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-09-17T07:34:37.850238] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-17T07:34:37.862357] [INFO ] [MAIN ] Derivative Progress: 636/2172 symbols completed. ECL took 1.2s. Estimated remaining: 9m 36s. Rate: 160.1 symbols/min [2025-09-17T07:34:37.862603] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:37.863294] [DEBUG] [LOCAL ] ECO: Loaded 18701 existing records from primary storage. [2025-09-17T07:34:37.864183] [INFO ] [MAIN ] ECO: Loaded 18701 primary data records. [2025-09-17T07:34:38.063713] [DEBUG] [LOCAL ] ECVT: Loaded 43110 existing records from primary storage. [2025-09-17T07:34:38.087276] [INFO ] [MAIN ] ECVT: Loaded 43110 primary data records. [2025-09-17T07:34:38.408488] [DEBUG] [LOCAL ] ED: Loaded 52817 existing records from primary storage. [2025-09-17T07:34:38.423244] [INFO ] [MAIN ] ED: Loaded 52817 primary data records. [2025-09-17T07:34:38.904007] [DEBUG] [MAIN ] ECO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:38.913903] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18701 primary records. [2025-09-17T07:34:38.914092] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-17T07:34:39.019503] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-09-17T07:34:39.019773] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-17T07:34:39.022698] [INFO ] [MAIN ] Derivative Progress: 637/2172 symbols completed. ECO took 1.2s. Estimated remaining: 9m 37s. Rate: 159.6 symbols/min [2025-09-17T07:34:39.023105] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:39.262283] [DEBUG] [MAIN ] ECVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:39.263421] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43110 primary records. [2025-09-17T07:34:39.263749] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-17T07:34:39.296670] [DEBUG] [LOCAL ] EDD: Loaded 27136 existing records from primary storage. [2025-09-17T07:34:39.300380] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-09-17T07:34:39.298873] [INFO ] [MAIN ] EDD: Loaded 27136 primary data records. [2025-09-17T07:34:39.300769] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-17T07:34:39.325329] [INFO ] [MAIN ] Derivative Progress: 638/2172 symbols completed. ECVT took 1.5s. Estimated remaining: 9m 37s. Rate: 159.6 symbols/min [2025-09-17T07:34:39.342210] [INFO ] [MAIN ] EDF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:39.490859] [DEBUG] [LOCAL ] EDF: Loaded 13446 existing records from primary storage. [2025-09-17T07:34:39.514693] [INFO ] [MAIN ] EDF: Loaded 13446 primary data records. [2025-09-17T07:34:39.783536] [DEBUG] [MAIN ] ED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:39.840790] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52817 primary records. [2025-09-17T07:34:39.937445] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-17T07:34:39.977839] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-09-17T07:34:39.978158] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-17T07:34:39.981135] [INFO ] [MAIN ] Derivative Progress: 639/2172 symbols completed. ED took 2.1s. Estimated remaining: 9m 37s. Rate: 159.4 symbols/min [2025-09-17T07:34:39.983726] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:40.000537] [DEBUG] [MAIN ] EDD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:40.001836] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 27136 primary records. [2025-09-17T07:34:40.002221] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-17T07:34:40.036933] [DEBUG] [LOCAL ] EDN: Loaded 17603 existing records from primary storage. [2025-09-17T07:34:40.046336] [INFO ] [MAIN ] EDN: Loaded 17603 primary data records. [2025-09-17T07:34:40.038462] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-09-17T07:34:40.056637] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-17T07:34:40.063605] [DEBUG] [MAIN ] EDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:40.098632] [INFO ] [MAIN ] Derivative Progress: 640/2172 symbols completed. EDD took 1.1s. Estimated remaining: 9m 36s. Rate: 159.6 symbols/min [2025-09-17T07:34:40.089479] [INFO ] [MAIN ] EDF: Generated 1794 derivative records from 13446 primary records. [2025-09-17T07:34:40.131806] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:40.148528] [DEBUG] [LOCAL ] EDF: Saving derivative data. [2025-09-17T07:34:40.369714] [DEBUG] [LOCAL ] EDF: Derivative data saved (1794 records). [2025-09-17T07:34:40.369885] [INFO ] [MAIN ] EDF: Successfully saved derivative data. [2025-09-17T07:34:40.372246] [INFO ] [MAIN ] Derivative Progress: 641/2172 symbols completed. EDF took 1.0s. Estimated remaining: 9m 35s. Rate: 159.7 symbols/min [2025-09-17T07:34:40.372763] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:40.407621] [DEBUG] [LOCAL ] EDU: Loaded 45350 existing records from primary storage. [2025-09-17T07:34:40.408032] [INFO ] [MAIN ] EDU: Loaded 45350 primary data records. [2025-09-17T07:34:40.531668] [DEBUG] [MAIN ] EDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:40.558530] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 17603 primary records. [2025-09-17T07:34:40.552239] [DEBUG] [LOCAL ] EE: Loaded 32616 existing records from primary storage. [2025-09-17T07:34:40.626402] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-17T07:34:40.611961] [INFO ] [MAIN ] EE: Loaded 32616 primary data records. [2025-09-17T07:34:40.890988] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-09-17T07:34:40.919842] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-17T07:34:40.922491] [INFO ] [MAIN ] Derivative Progress: 642/2172 symbols completed. EDN took 0.9s. Estimated remaining: 9m 35s. Rate: 159.6 symbols/min [2025-09-17T07:34:40.928393] [INFO ] [MAIN ] EEA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:41.118861] [DEBUG] [LOCAL ] EEA: Loaded 2847 existing records from primary storage. [2025-09-17T07:34:41.119446] [INFO ] [MAIN ] EEA: Loaded 2847 primary data records. [2025-09-17T07:34:41.436880] [DEBUG] [MAIN ] EDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:41.437622] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 45350 primary records. [2025-09-17T07:34:41.437782] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-17T07:34:41.456596] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-09-17T07:34:41.456913] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-17T07:34:41.461578] [INFO ] [MAIN ] Derivative Progress: 643/2172 symbols completed. EDU took 1.3s. Estimated remaining: 9m 35s. Rate: 159.5 symbols/min [2025-09-17T07:34:41.475513] [DEBUG] [MAIN ] EE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:41.476281] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32616 primary records. [2025-09-17T07:34:41.476512] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-17T07:34:41.492734] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-09-17T07:34:41.493431] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-17T07:34:41.496204] [INFO ] [MAIN ] Derivative Progress: 644/2172 symbols completed. EE took 1.1s. Estimated remaining: 9m 34s. Rate: 159.7 symbols/min [2025-09-17T07:34:41.509628] [DEBUG] [MAIN ] EEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:41.510217] [INFO ] [MAIN ] EEA: Generated 1794 derivative records from 2847 primary records. [2025-09-17T07:34:41.510291] [DEBUG] [LOCAL ] EEA: Saving derivative data. [2025-09-17T07:34:41.523887] [DEBUG] [LOCAL ] EEA: Derivative data saved (1794 records). [2025-09-17T07:34:41.523962] [INFO ] [MAIN ] EEA: Successfully saved derivative data. [2025-09-17T07:34:41.526364] [INFO ] [MAIN ] Derivative Progress: 645/2172 symbols completed. EEA took 0.6s. Estimated remaining: 9m 33s. Rate: 159.9 symbols/min [2025-09-17T07:34:41.527079] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:41.526964] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:41.527219] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:41.544971] [DEBUG] [LOCAL ] EEX: Loaded 12348 existing records from primary storage. [2025-09-17T07:34:41.549733] [INFO ] [MAIN ] EEX: Loaded 12348 primary data records. [2025-09-17T07:34:41.550006] [DEBUG] [LOCAL ] EFR: Loaded 14030 existing records from primary storage. [2025-09-17T07:34:41.570519] [INFO ] [MAIN ] EFR: Loaded 14030 primary data records. [2025-09-17T07:34:42.009342] [DEBUG] [LOCAL ] EFC: Loaded 46276 existing records from primary storage. [2025-09-17T07:34:42.064380] [INFO ] [MAIN ] EFC: Loaded 46276 primary data records. [2025-09-17T07:34:42.563264] [DEBUG] [MAIN ] EEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:42.564687] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 12348 primary records. [2025-09-17T07:34:42.565122] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-17T07:34:42.591377] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-09-17T07:34:42.596460] [DEBUG] [MAIN ] EFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:42.597309] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 14030 primary records. [2025-09-17T07:34:42.596620] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-17T07:34:42.597466] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-09-17T07:34:42.599650] [INFO ] [MAIN ] Derivative Progress: 646/2172 symbols completed. EEX took 1.1s. Estimated remaining: 9m 34s. Rate: 159.4 symbols/min [2025-09-17T07:34:42.600431] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:42.619208] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-09-17T07:34:42.631306] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-17T07:34:42.637263] [INFO ] [MAIN ] Derivative Progress: 647/2172 symbols completed. EFR took 1.1s. Estimated remaining: 9m 33s. Rate: 159.7 symbols/min [2025-09-17T07:34:42.637556] [DEBUG] [MAIN ] EFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:42.637834] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:42.638598] [INFO ] [MAIN ] EFC: Generated 1794 derivative records from 46276 primary records. [2025-09-17T07:34:42.639005] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-17T07:34:42.656359] [DEBUG] [LOCAL ] EFT: Loaded 12466 existing records from primary storage. [2025-09-17T07:34:42.658080] [INFO ] [MAIN ] EFT: Loaded 12466 primary data records. [2025-09-17T07:34:42.753086] [DEBUG] [LOCAL ] EFC: Derivative data saved (1794 records). [2025-09-17T07:34:42.771259] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-17T07:34:42.800594] [INFO ] [MAIN ] Derivative Progress: 648/2172 symbols completed. EFC took 1.3s. Estimated remaining: 9m 32s. Rate: 159.8 symbols/min [2025-09-17T07:34:42.859849] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:42.970620] [DEBUG] [LOCAL ] EFXT: Loaded 29735 existing records from primary storage. [2025-09-17T07:34:42.971345] [INFO ] [MAIN ] EFXT: Loaded 29735 primary data records. [2025-09-17T07:34:43.287198] [DEBUG] [LOCAL ] EG: Loaded 29036 existing records from primary storage. [2025-09-17T07:34:43.298132] [INFO ] [MAIN ] EG: Loaded 29036 primary data records. [2025-09-17T07:34:43.481817] [DEBUG] [MAIN ] EFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:43.500302] [INFO ] [MAIN ] EFT: Generated 1794 derivative records from 12466 primary records. [2025-09-17T07:34:43.500547] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-17T07:34:43.635442] [DEBUG] [LOCAL ] EFT: Derivative data saved (1794 records). [2025-09-17T07:34:43.637217] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-17T07:34:43.639774] [INFO ] [MAIN ] Derivative Progress: 649/2172 symbols completed. EFT took 1.0s. Estimated remaining: 9m 33s. Rate: 159.5 symbols/min [2025-09-17T07:34:43.640474] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:43.658027] [DEBUG] [MAIN ] EFXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:43.659391] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29735 primary records. [2025-09-17T07:34:43.659847] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-17T07:34:43.676944] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-09-17T07:34:43.677331] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-17T07:34:43.679803] [INFO ] [MAIN ] Derivative Progress: 650/2172 symbols completed. EFXT took 1.0s. Estimated remaining: 9m 32s. Rate: 159.7 symbols/min [2025-09-17T07:34:43.682243] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:43.697224] [DEBUG] [MAIN ] EG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:43.698116] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 29036 primary records. [2025-09-17T07:34:43.698245] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-17T07:34:43.715239] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-09-17T07:34:43.728961] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-17T07:34:43.731368] [INFO ] [MAIN ] Derivative Progress: 651/2172 symbols completed. EG took 0.9s. Estimated remaining: 9m 31s. Rate: 159.9 symbols/min [2025-09-17T07:34:43.732038] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:43.761774] [DEBUG] [LOCAL ] EGO: Loaded 51384 existing records from primary storage. [2025-09-17T07:34:43.762140] [INFO ] [MAIN ] EGO: Loaded 51384 primary data records. [2025-09-17T07:34:43.915980] [DEBUG] [LOCAL ] EGY: Loaded 42423 existing records from primary storage. [2025-09-17T07:34:43.916865] [DEBUG] [LOCAL ] EHAB: Loaded 30206 existing records from primary storage. [2025-09-17T07:34:43.970674] [INFO ] [MAIN ] EHAB: Loaded 30206 primary data records. [2025-09-17T07:34:43.970752] [INFO ] [MAIN ] EGY: Loaded 42423 primary data records. [2025-09-17T07:34:44.739910] [DEBUG] [MAIN ] EGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:44.740763] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51384 primary records. [2025-09-17T07:34:44.741269] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-17T07:34:44.758339] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-09-17T07:34:44.760759] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-17T07:34:44.774486] [INFO ] [MAIN ] Derivative Progress: 652/2172 symbols completed. EGO took 1.1s. Estimated remaining: 9m 32s. Rate: 159.5 symbols/min [2025-09-17T07:34:44.780062] [DEBUG] [MAIN ] EGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:44.780345] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:44.789011] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 42423 primary records. [2025-09-17T07:34:44.794540] [DEBUG] [MAIN ] EHAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:44.795264] [INFO ] [MAIN ] EHAB: Generated 1794 derivative records from 30206 primary records. [2025-09-17T07:34:44.795537] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-17T07:34:44.795731] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-17T07:34:44.826742] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1794 records). [2025-09-17T07:34:44.825553] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-09-17T07:34:44.826948] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-17T07:34:44.829211] [INFO ] [MAIN ] Derivative Progress: 653/2172 symbols completed. EHAB took 1.1s. Estimated remaining: 9m 31s. Rate: 159.7 symbols/min [2025-09-17T07:34:44.829437] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:44.829505] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-17T07:34:44.832373] [INFO ] [MAIN ] Derivative Progress: 654/2172 symbols completed. EGY took 1.2s. Estimated remaining: 9m 29s. Rate: 160.0 symbols/min [2025-09-17T07:34:44.832672] [INFO ] [MAIN ] EIC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:44.854256] [DEBUG] [LOCAL ] EHI: Loaded 10156 existing records from primary storage. [2025-09-17T07:34:44.854436] [INFO ] [MAIN ] EHI: Loaded 10156 primary data records. [2025-09-17T07:34:44.993035] [DEBUG] [LOCAL ] EHC: Loaded 41727 existing records from primary storage. [2025-09-17T07:34:45.004310] [DEBUG] [LOCAL ] EIC: Loaded 24807 existing records from primary storage. [2025-09-17T07:34:45.009583] [INFO ] [MAIN ] EHC: Loaded 41727 primary data records. [2025-09-17T07:34:45.019922] [INFO ] [MAIN ] EIC: Loaded 24807 primary data records. [2025-09-17T07:34:45.797497] [DEBUG] [MAIN ] EHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:45.798350] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10156 primary records. [2025-09-17T07:34:45.798909] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-17T07:34:45.818031] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-09-17T07:34:45.830770] [DEBUG] [MAIN ] EIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:45.830231] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-17T07:34:45.844783] [INFO ] [MAIN ] Derivative Progress: 655/2172 symbols completed. EHI took 1.0s. Estimated remaining: 9m 31s. Rate: 159.5 symbols/min [2025-09-17T07:34:45.845435] [INFO ] [MAIN ] EIC: Generated 1794 derivative records from 24807 primary records. [2025-09-17T07:34:45.845977] [DEBUG] [MAIN ] EHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:45.846125] [INFO ] [MAIN ] EICC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:45.846288] [DEBUG] [LOCAL ] EIC: Saving derivative data. [2025-09-17T07:34:45.846886] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 41727 primary records. [2025-09-17T07:34:45.847925] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-17T07:34:45.884261] [DEBUG] [LOCAL ] EICC: Loaded 5979 existing records from primary storage. [2025-09-17T07:34:45.884062] [DEBUG] [LOCAL ] EIC: Derivative data saved (1794 records). [2025-09-17T07:34:45.884541] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-09-17T07:34:45.884858] [INFO ] [MAIN ] EICC: Loaded 5979 primary data records. [2025-09-17T07:34:45.885254] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-17T07:34:45.885145] [INFO ] [MAIN ] EIC: Successfully saved derivative data. [2025-09-17T07:34:45.887894] [INFO ] [MAIN ] Derivative Progress: 656/2172 symbols completed. EHC took 1.1s. Estimated remaining: 9m 29s. Rate: 159.8 symbols/min [2025-09-17T07:34:45.925938] [INFO ] [MAIN ] Derivative Progress: 657/2172 symbols completed. EIC took 1.1s. Estimated remaining: 9m 28s. Rate: 160.0 symbols/min [2025-09-17T07:34:45.926101] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:45.982011] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:46.199463] [DEBUG] [LOCAL ] EIG: Loaded 20226 existing records from primary storage. [2025-09-17T07:34:46.199761] [INFO ] [MAIN ] EIG: Loaded 20226 primary data records. [2025-09-17T07:34:46.553310] [DEBUG] [LOCAL ] EIX: Loaded 53361 existing records from primary storage. [2025-09-17T07:34:46.567989] [INFO ] [MAIN ] EIX: Loaded 53361 primary data records. [2025-09-17T07:34:46.768856] [DEBUG] [MAIN ] EICC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:46.777457] [INFO ] [MAIN ] EICC: Generated 1794 derivative records from 5979 primary records. [2025-09-17T07:34:46.870791] [DEBUG] [LOCAL ] EICC: Saving derivative data. [2025-09-17T07:34:46.907725] [DEBUG] [LOCAL ] EICC: Derivative data saved (1794 records). [2025-09-17T07:34:46.908274] [INFO ] [MAIN ] EICC: Successfully saved derivative data. [2025-09-17T07:34:46.910767] [INFO ] [MAIN ] Derivative Progress: 658/2172 symbols completed. EICC took 1.1s. Estimated remaining: 9m 29s. Rate: 159.6 symbols/min [2025-09-17T07:34:46.924811] [DEBUG] [MAIN ] EIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:46.925460] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20226 primary records. [2025-09-17T07:34:46.925564] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-17T07:34:46.944218] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-09-17T07:34:46.944579] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-17T07:34:46.946811] [INFO ] [MAIN ] Derivative Progress: 659/2172 symbols completed. EIG took 1.0s. Estimated remaining: 9m 28s. Rate: 159.8 symbols/min [2025-09-17T07:34:46.962513] [DEBUG] [MAIN ] EIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:46.963102] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53361 primary records. [2025-09-17T07:34:46.963188] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-09-17T07:34:46.978517] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-09-17T07:34:46.978615] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-17T07:34:46.981124] [INFO ] [MAIN ] Derivative Progress: 660/2172 symbols completed. EIX took 1.0s. Estimated remaining: 9m 27s. Rate: 160.0 symbols/min [2025-09-17T07:34:46.981571] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:46.981686] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:46.981794] [INFO ] [MAIN ] ELC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:46.989946] [DEBUG] [LOCAL ] ELC: Loaded 3552 existing records from primary storage. [2025-09-17T07:34:46.990283] [INFO ] [MAIN ] ELC: Loaded 3552 primary data records. [2025-09-17T07:34:47.328804] [DEBUG] [LOCAL ] ELAN: Loaded 53179 existing records from primary storage. [2025-09-17T07:34:47.329287] [INFO ] [MAIN ] ELAN: Loaded 53179 primary data records. [2025-09-17T07:34:47.457692] [DEBUG] [LOCAL ] EL: Loaded 53472 existing records from primary storage. [2025-09-17T07:34:47.461910] [INFO ] [MAIN ] EL: Loaded 53472 primary data records. [2025-09-17T07:34:48.008488] [DEBUG] [MAIN ] ELC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:48.010182] [INFO ] [MAIN ] ELC: Generated 1794 derivative records from 3552 primary records. [2025-09-17T07:34:48.010513] [DEBUG] [LOCAL ] ELC: Saving derivative data. [2025-09-17T07:34:48.031088] [DEBUG] [LOCAL ] ELC: Derivative data saved (1794 records). [2025-09-17T07:34:48.031417] [INFO ] [MAIN ] ELC: Successfully saved derivative data. [2025-09-17T07:34:48.034772] [INFO ] [MAIN ] Derivative Progress: 661/2172 symbols completed. ELC took 1.1s. Estimated remaining: 9m 28s. Rate: 159.6 symbols/min [2025-09-17T07:34:48.035133] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:48.056359] [DEBUG] [MAIN ] ELAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:48.057435] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53179 primary records. [2025-09-17T07:34:48.057889] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-17T07:34:48.078209] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-09-17T07:34:48.086258] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-17T07:34:48.091452] [DEBUG] [MAIN ] EL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:48.093429] [INFO ] [MAIN ] Derivative Progress: 662/2172 symbols completed. ELAN took 1.1s. Estimated remaining: 9m 27s. Rate: 159.8 symbols/min [2025-09-17T07:34:48.094376] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53472 primary records. [2025-09-17T07:34:48.094496] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-17T07:34:48.094861] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:48.125792] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-09-17T07:34:48.125902] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-17T07:34:48.128482] [INFO ] [MAIN ] Derivative Progress: 663/2172 symbols completed. EL took 1.1s. Estimated remaining: 9m 26s. Rate: 160.0 symbols/min [2025-09-17T07:34:48.129149] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:48.150468] [DEBUG] [LOCAL ] ELF: Loaded 52338 existing records from primary storage. [2025-09-17T07:34:48.150952] [INFO ] [MAIN ] ELF: Loaded 52338 primary data records. [2025-09-17T07:34:48.301909] [DEBUG] [LOCAL ] ELME: Loaded 39208 existing records from primary storage. [2025-09-17T07:34:48.343295] [DEBUG] [LOCAL ] ELP: Loaded 26074 existing records from primary storage. [2025-09-17T07:34:48.343409] [INFO ] [MAIN ] ELME: Loaded 39208 primary data records. [2025-09-17T07:34:48.379882] [INFO ] [MAIN ] ELP: Loaded 26074 primary data records. [2025-09-17T07:34:49.181444] [DEBUG] [MAIN ] ELF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:49.182318] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52338 primary records. [2025-09-17T07:34:49.183482] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-17T07:34:49.204833] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-09-17T07:34:49.205200] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-17T07:34:49.207523] [INFO ] [MAIN ] Derivative Progress: 664/2172 symbols completed. ELF took 1.2s. Estimated remaining: 9m 27s. Rate: 159.6 symbols/min [2025-09-17T07:34:49.208364] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:49.228350] [DEBUG] [MAIN ] ELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:49.229701] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 26074 primary records. [2025-09-17T07:34:49.238331] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-17T07:34:49.244514] [DEBUG] [MAIN ] ELME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:49.245830] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39208 primary records. [2025-09-17T07:34:49.253219] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-17T07:34:49.270564] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-09-17T07:34:49.274854] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-17T07:34:49.278247] [INFO ] [MAIN ] Derivative Progress: 665/2172 symbols completed. ELP took 1.1s. Estimated remaining: 9m 26s. Rate: 159.7 symbols/min [2025-09-17T07:34:49.289852] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:49.293577] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-09-17T07:34:49.293895] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-17T07:34:49.296294] [INFO ] [MAIN ] Derivative Progress: 666/2172 symbols completed. ELME took 1.2s. Estimated remaining: 9m 25s. Rate: 160.0 symbols/min [2025-09-17T07:34:49.296719] [INFO ] [MAIN ] EMD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:49.313574] [DEBUG] [LOCAL ] ELS: Loaded 49335 existing records from primary storage. [2025-09-17T07:34:49.313887] [INFO ] [MAIN ] ELS: Loaded 49335 primary data records. [2025-09-17T07:34:49.478425] [DEBUG] [LOCAL ] EMD: Loaded 21538 existing records from primary storage. [2025-09-17T07:34:49.528974] [INFO ] [MAIN ] EMD: Loaded 21538 primary data records. [2025-09-17T07:34:49.695471] [DEBUG] [LOCAL ] ELV: Loaded 50445 existing records from primary storage. [2025-09-17T07:34:49.730095] [INFO ] [MAIN ] ELV: Loaded 50445 primary data records. [2025-09-17T07:34:50.338160] [DEBUG] [MAIN ] ELS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:50.339472] [INFO ] [MAIN ] ELS: Generated 1794 derivative records from 49335 primary records. [2025-09-17T07:34:50.339962] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-17T07:34:50.361076] [DEBUG] [LOCAL ] ELS: Derivative data saved (1794 records). [2025-09-17T07:34:50.362781] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-17T07:34:50.365690] [INFO ] [MAIN ] Derivative Progress: 667/2172 symbols completed. ELS took 1.2s. Estimated remaining: 9m 26s. Rate: 159.5 symbols/min [2025-09-17T07:34:50.366206] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:50.382049] [DEBUG] [MAIN ] EMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:50.394460] [DEBUG] [MAIN ] ELV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:50.395725] [INFO ] [MAIN ] ELV: Generated 1794 derivative records from 50445 primary records. [2025-09-17T07:34:50.395179] [INFO ] [MAIN ] EMD: Generated 1794 derivative records from 21538 primary records. [2025-09-17T07:34:50.395922] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-09-17T07:34:50.396450] [DEBUG] [LOCAL ] EMD: Saving derivative data. [2025-09-17T07:34:50.425047] [DEBUG] [LOCAL ] EMD: Derivative data saved (1794 records). [2025-09-17T07:34:50.433340] [INFO ] [MAIN ] EMD: Successfully saved derivative data. [2025-09-17T07:34:50.436295] [INFO ] [MAIN ] Derivative Progress: 668/2172 symbols completed. EMD took 1.1s. Estimated remaining: 9m 25s. Rate: 159.7 symbols/min [2025-09-17T07:34:50.437539] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:50.439692] [DEBUG] [LOCAL ] ELV: Derivative data saved (1794 records). [2025-09-17T07:34:50.440423] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-09-17T07:34:50.453536] [INFO ] [MAIN ] Derivative Progress: 669/2172 symbols completed. ELV took 1.2s. Estimated remaining: 9m 24s. Rate: 160.0 symbols/min [2025-09-17T07:34:50.453925] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:50.455303] [DEBUG] [LOCAL ] EME: Loaded 31886 existing records from primary storage. [2025-09-17T07:34:50.455563] [INFO ] [MAIN ] EME: Loaded 31886 primary data records. [2025-09-17T07:34:50.459620] [DEBUG] [LOCAL ] EMF: Loaded 3675 existing records from primary storage. [2025-09-17T07:34:50.517946] [INFO ] [MAIN ] EMF: Loaded 3675 primary data records. [2025-09-17T07:34:51.103904] [DEBUG] [LOCAL ] EMN: Loaded 50214 existing records from primary storage. [2025-09-17T07:34:51.105566] [INFO ] [MAIN ] EMN: Loaded 50214 primary data records. [2025-09-17T07:34:51.434849] [DEBUG] [MAIN ] EME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:51.435758] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 31886 primary records. [2025-09-17T07:34:51.436392] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-17T07:34:51.472384] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-09-17T07:34:51.472740] [DEBUG] [MAIN ] EMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:51.472995] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-17T07:34:51.475397] [INFO ] [MAIN ] Derivative Progress: 670/2172 symbols completed. EME took 1.1s. Estimated remaining: 9m 25s. Rate: 159.5 symbols/min [2025-09-17T07:34:51.477364] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:51.476939] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3675 primary records. [2025-09-17T07:34:51.477513] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-17T07:34:51.493525] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-09-17T07:34:51.493777] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-17T07:34:51.496444] [INFO ] [MAIN ] Derivative Progress: 671/2172 symbols completed. EMF took 1.1s. Estimated remaining: 9m 24s. Rate: 159.8 symbols/min [2025-09-17T07:34:51.499821] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:51.507674] [DEBUG] [LOCAL ] EMO: Loaded 12202 existing records from primary storage. [2025-09-17T07:34:51.520823] [INFO ] [MAIN ] EMO: Loaded 12202 primary data records. [2025-09-17T07:34:51.521041] [DEBUG] [MAIN ] EMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:51.542223] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50214 primary records. [2025-09-17T07:34:51.559513] [DEBUG] [LOCAL ] EMP: Loaded 2984 existing records from primary storage. [2025-09-17T07:34:51.614910] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-17T07:34:51.609084] [INFO ] [MAIN ] EMP: Loaded 2984 primary data records. [2025-09-17T07:34:51.998319] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-09-17T07:34:52.016027] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-17T07:34:52.120145] [INFO ] [MAIN ] Derivative Progress: 672/2172 symbols completed. EMN took 1.7s. Estimated remaining: 9m 24s. Rate: 159.6 symbols/min [2025-09-17T07:34:52.135437] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:52.158735] [DEBUG] [MAIN ] EMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:52.159536] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 12202 primary records. [2025-09-17T07:34:52.159908] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-17T07:34:52.190662] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-09-17T07:34:52.191294] [DEBUG] [MAIN ] EMP: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:34:52.191362] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-17T07:34:52.194330] [INFO ] [MAIN ] Derivative Progress: 673/2172 symbols completed. EMO took 0.7s. Estimated remaining: 9m 23s. Rate: 159.8 symbols/min [2025-09-17T07:34:52.192115] [INFO ] [MAIN ] EMP: Generated 1792 derivative records from 2984 primary records. [2025-09-17T07:34:52.194725] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-17T07:34:52.222513] [DEBUG] [LOCAL ] EMP: Derivative data saved (1792 records). [2025-09-17T07:34:52.222704] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-17T07:34:52.224989] [INFO ] [MAIN ] Derivative Progress: 674/2172 symbols completed. EMP took 0.7s. Estimated remaining: 9m 22s. Rate: 160.0 symbols/min [2025-09-17T07:34:52.246343] [DEBUG] [LOCAL ] EMR: Loaded 53256 existing records from primary storage. [2025-09-17T07:34:52.246514] [INFO ] [MAIN ] EMR: Loaded 53256 primary data records. [2025-09-17T07:34:52.573483] [DEBUG] [MAIN ] EMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:52.574274] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53256 primary records. [2025-09-17T07:34:52.574362] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-17T07:34:52.590380] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-09-17T07:34:52.590464] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-17T07:34:52.593255] [INFO ] [MAIN ] Derivative Progress: 675/2172 symbols completed. EMR took 0.5s. Estimated remaining: 9m 21s. Rate: 160.0 symbols/min [2025-09-17T07:34:52.593872] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:52.593724] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:52.593933] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:52.602224] [DEBUG] [LOCAL ] ENFY: Loaded 3056 existing records from primary storage. [2025-09-17T07:34:52.602487] [INFO ] [MAIN ] ENFY: Loaded 3056 primary data records. [2025-09-17T07:34:52.928205] [DEBUG] [LOCAL ] ENIC: Loaded 36932 existing records from primary storage. [2025-09-17T07:34:52.928408] [INFO ] [MAIN ] ENIC: Loaded 36932 primary data records. [2025-09-17T07:34:53.047832] [DEBUG] [LOCAL ] ENB: Loaded 53528 existing records from primary storage. [2025-09-17T07:34:53.058538] [INFO ] [MAIN ] ENB: Loaded 53528 primary data records. [2025-09-17T07:34:53.558779] [DEBUG] [MAIN ] ENFY: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-17T07:34:53.560607] [INFO ] [MAIN ] ENFY: Generated 1791 derivative records from 3056 primary records. [2025-09-17T07:34:53.561078] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-17T07:34:53.577262] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1791 records). [2025-09-17T07:34:53.577818] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-17T07:34:53.580515] [INFO ] [MAIN ] Derivative Progress: 676/2172 symbols completed. ENFY took 1.0s. Estimated remaining: 9m 22s. Rate: 159.6 symbols/min [2025-09-17T07:34:53.581133] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:53.588666] [DEBUG] [LOCAL ] ENO: Loaded 2001 existing records from primary storage. [2025-09-17T07:34:53.589274] [INFO ] [MAIN ] ENO: Loaded 2001 primary data records. [2025-09-17T07:34:53.638474] [DEBUG] [MAIN ] ENIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:53.694711] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36932 primary records. [2025-09-17T07:34:53.706176] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-17T07:34:53.789271] [DEBUG] [MAIN ] ENB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:53.908839] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53528 primary records. [2025-09-17T07:34:53.923458] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-17T07:34:53.926690] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-09-17T07:34:53.927527] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-17T07:34:53.938080] [INFO ] [MAIN ] Derivative Progress: 677/2172 symbols completed. ENIC took 1.3s. Estimated remaining: 9m 22s. Rate: 159.7 symbols/min [2025-09-17T07:34:53.945573] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:53.945673] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-09-17T07:34:53.946313] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-17T07:34:53.949264] [INFO ] [MAIN ] Derivative Progress: 678/2172 symbols completed. ENB took 1.4s. Estimated remaining: 9m 21s. Rate: 159.9 symbols/min [2025-09-17T07:34:53.950562] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:53.976747] [DEBUG] [MAIN ] ENO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:34:53.977909] [INFO ] [MAIN ] ENO: Generated 1793 derivative records from 2001 primary records. [2025-09-17T07:34:53.978060] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-17T07:34:54.008355] [DEBUG] [LOCAL ] ENO: Derivative data saved (1793 records). [2025-09-17T07:34:54.017951] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-17T07:34:54.020466] [INFO ] [MAIN ] Derivative Progress: 679/2172 symbols completed. ENO took 0.4s. Estimated remaining: 9m 20s. Rate: 160.1 symbols/min [2025-09-17T07:34:54.020829] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:54.034752] [DEBUG] [LOCAL ] ENR: Loaded 42493 existing records from primary storage. [2025-09-17T07:34:54.035096] [INFO ] [MAIN ] ENR: Loaded 42493 primary data records. [2025-09-17T07:34:54.169601] [DEBUG] [LOCAL ] ENOV: Loaded 45347 existing records from primary storage. [2025-09-17T07:34:54.185672] [INFO ] [MAIN ] ENOV: Loaded 45347 primary data records. [2025-09-17T07:34:54.513904] [DEBUG] [LOCAL ] ENS: Loaded 29286 existing records from primary storage. [2025-09-17T07:34:54.520231] [INFO ] [MAIN ] ENS: Loaded 29286 primary data records. [2025-09-17T07:34:55.031293] [DEBUG] [MAIN ] ENR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:55.034587] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 42493 primary records. [2025-09-17T07:34:55.034953] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-09-17T07:34:55.048915] [DEBUG] [MAIN ] ENOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:55.058298] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 45347 primary records. [2025-09-17T07:34:55.062700] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-17T07:34:55.067599] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-09-17T07:34:55.076898] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-09-17T07:34:55.082814] [INFO ] [MAIN ] Derivative Progress: 680/2172 symbols completed. ENR took 1.1s. Estimated remaining: 9m 21s. Rate: 159.6 symbols/min [2025-09-17T07:34:55.087014] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:55.100215] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-09-17T07:34:55.100915] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-17T07:34:55.100812] [DEBUG] [MAIN ] ENS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:55.101610] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29286 primary records. [2025-09-17T07:34:55.103978] [INFO ] [MAIN ] Derivative Progress: 681/2172 symbols completed. ENOV took 1.2s. Estimated remaining: 9m 20s. Rate: 159.9 symbols/min [2025-09-17T07:34:55.104299] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-17T07:34:55.104520] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:55.122109] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-09-17T07:34:55.122353] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-17T07:34:55.125268] [INFO ] [MAIN ] Derivative Progress: 682/2172 symbols completed. ENS took 1.1s. Estimated remaining: 9m 18s. Rate: 160.1 symbols/min [2025-09-17T07:34:55.129080] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:55.144121] [DEBUG] [LOCAL ] EOD: Loaded 14172 existing records from primary storage. [2025-09-17T07:34:55.144299] [INFO ] [MAIN ] EOD: Loaded 14172 primary data records. [2025-09-17T07:34:55.258001] [DEBUG] [LOCAL ] ENVA: Loaded 25610 existing records from primary storage. [2025-09-17T07:34:55.264137] [INFO ] [MAIN ] ENVA: Loaded 25610 primary data records. [2025-09-17T07:34:55.634433] [DEBUG] [LOCAL ] EOG: Loaded 53343 existing records from primary storage. [2025-09-17T07:34:55.673363] [INFO ] [MAIN ] EOG: Loaded 53343 primary data records. [2025-09-17T07:34:56.155238] [DEBUG] [MAIN ] EOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:56.156678] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 14172 primary records. [2025-09-17T07:34:56.158026] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-17T07:34:56.183241] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-09-17T07:34:56.183677] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-17T07:34:56.194442] [INFO ] [MAIN ] Derivative Progress: 683/2172 symbols completed. EOD took 1.1s. Estimated remaining: 9m 20s. Rate: 159.6 symbols/min [2025-09-17T07:34:56.202997] [DEBUG] [MAIN ] ENVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:56.202598] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:56.204081] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25610 primary records. [2025-09-17T07:34:56.204708] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-17T07:34:56.223066] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-09-17T07:34:56.223581] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-17T07:34:56.225720] [INFO ] [MAIN ] Derivative Progress: 684/2172 symbols completed. ENVA took 1.1s. Estimated remaining: 9m 18s. Rate: 159.9 symbols/min [2025-09-17T07:34:56.230299] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:56.257051] [DEBUG] [LOCAL ] EOI: Loaded 10634 existing records from primary storage. [2025-09-17T07:34:56.257917] [DEBUG] [MAIN ] EOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:56.258916] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53343 primary records. [2025-09-17T07:34:56.259079] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-17T07:34:56.258034] [INFO ] [MAIN ] EOI: Loaded 10634 primary data records. [2025-09-17T07:34:56.411748] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-09-17T07:34:56.412889] [DEBUG] [LOCAL ] EOS: Loaded 15587 existing records from primary storage. [2025-09-17T07:34:56.424077] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-17T07:34:56.439803] [INFO ] [MAIN ] EOS: Loaded 15587 primary data records. [2025-09-17T07:34:56.458193] [INFO ] [MAIN ] Derivative Progress: 685/2172 symbols completed. EOG took 1.3s. Estimated remaining: 9m 18s. Rate: 160.0 symbols/min [2025-09-17T07:34:56.546193] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:56.818600] [DEBUG] [LOCAL ] EOT: Loaded 6764 existing records from primary storage. [2025-09-17T07:34:56.923066] [INFO ] [MAIN ] EOT: Loaded 6764 primary data records. [2025-09-17T07:34:57.249303] [DEBUG] [MAIN ] EOI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:57.250914] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10634 primary records. [2025-09-17T07:34:57.251978] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-17T07:34:57.271723] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-09-17T07:34:57.272140] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-17T07:34:57.275078] [INFO ] [MAIN ] Derivative Progress: 686/2172 symbols completed. EOI took 1.1s. Estimated remaining: 9m 18s. Rate: 159.7 symbols/min [2025-09-17T07:34:57.288160] [DEBUG] [MAIN ] EOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:57.288469] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:57.289333] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15587 primary records. [2025-09-17T07:34:57.289933] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-17T07:34:57.306857] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-09-17T07:34:57.307143] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-17T07:34:57.309849] [INFO ] [MAIN ] Derivative Progress: 687/2172 symbols completed. EOS took 1.1s. Estimated remaining: 9m 17s. Rate: 159.9 symbols/min [2025-09-17T07:34:57.310316] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:57.333786] [DEBUG] [MAIN ] EOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:57.334603] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6764 primary records. [2025-09-17T07:34:57.334764] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-17T07:34:57.350251] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-09-17T07:34:57.358545] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-17T07:34:57.361687] [INFO ] [MAIN ] Derivative Progress: 688/2172 symbols completed. EOT took 0.8s. Estimated remaining: 9m 16s. Rate: 160.1 symbols/min [2025-09-17T07:34:57.359203] [DEBUG] [LOCAL ] EPAC: Loaded 26910 existing records from primary storage. [2025-09-17T07:34:57.362111] [INFO ] [MAIN ] EPAC: Loaded 26910 primary data records. [2025-09-17T07:34:57.568571] [DEBUG] [LOCAL ] EPAM: Loaded 39770 existing records from primary storage. [2025-09-17T07:34:57.681623] [INFO ] [MAIN ] EPAM: Loaded 39770 primary data records. [2025-09-17T07:34:58.008820] [DEBUG] [MAIN ] EPAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:58.009899] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 26910 primary records. [2025-09-17T07:34:58.010910] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-17T07:34:58.028869] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-09-17T07:34:58.028974] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-17T07:34:58.031037] [INFO ] [MAIN ] Derivative Progress: 689/2172 symbols completed. EPAC took 0.7s. Estimated remaining: 9m 16s. Rate: 159.9 symbols/min [2025-09-17T07:34:58.046024] [DEBUG] [MAIN ] EPAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:58.046629] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39770 primary records. [2025-09-17T07:34:58.046728] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-17T07:34:58.062266] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-09-17T07:34:58.062336] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-17T07:34:58.064885] [INFO ] [MAIN ] Derivative Progress: 690/2172 symbols completed. EPAM took 0.8s. Estimated remaining: 9m 15s. Rate: 160.1 symbols/min [2025-09-17T07:34:58.065509] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:58.065771] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:58.065858] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:58.116632] [DEBUG] [LOCAL ] EPR: Loaded 44485 existing records from primary storage. [2025-09-17T07:34:58.117009] [INFO ] [MAIN ] EPR: Loaded 44485 primary data records. [2025-09-17T07:34:58.259383] [DEBUG] [LOCAL ] EPC: Loaded 39929 existing records from primary storage. [2025-09-17T07:34:58.300977] [INFO ] [MAIN ] EPC: Loaded 39929 primary data records. [2025-09-17T07:34:58.276296] [DEBUG] [LOCAL ] EPD: Loaded 53616 existing records from primary storage. [2025-09-17T07:34:58.348412] [INFO ] [MAIN ] EPD: Loaded 53616 primary data records. [2025-09-17T07:34:59.078664] [DEBUG] [MAIN ] EPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:59.079598] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 44485 primary records. [2025-09-17T07:34:59.079957] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-17T07:34:59.099013] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-09-17T07:34:59.099161] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-17T07:34:59.101281] [INFO ] [MAIN ] Derivative Progress: 691/2172 symbols completed. EPR took 1.0s. Estimated remaining: 9m 16s. Rate: 159.7 symbols/min [2025-09-17T07:34:59.101988] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:59.116226] [DEBUG] [MAIN ] EPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:59.116947] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39929 primary records. [2025-09-17T07:34:59.117167] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-17T07:34:59.135822] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-09-17T07:34:59.148335] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-17T07:34:59.148567] [DEBUG] [MAIN ] EPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:34:59.151319] [INFO ] [MAIN ] Derivative Progress: 692/2172 symbols completed. EPC took 1.1s. Estimated remaining: 9m 15s. Rate: 159.9 symbols/min [2025-09-17T07:34:59.152448] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:59.152214] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53616 primary records. [2025-09-17T07:34:59.152870] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-17T07:34:59.185885] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-09-17T07:34:59.186140] [DEBUG] [LOCAL ] EQBK: Loaded 10852 existing records from primary storage. [2025-09-17T07:34:59.186299] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-17T07:34:59.186385] [INFO ] [MAIN ] EQBK: Loaded 10852 primary data records. [2025-09-17T07:34:59.201016] [INFO ] [MAIN ] Derivative Progress: 693/2172 symbols completed. EPD took 1.1s. Estimated remaining: 9m 14s. Rate: 160.1 symbols/min [2025-09-17T07:34:59.276696] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:34:59.306869] [DEBUG] [LOCAL ] EPRT: Loaded 48707 existing records from primary storage. [2025-09-17T07:34:59.323902] [INFO ] [MAIN ] EPRT: Loaded 48707 primary data records. [2025-09-17T07:34:59.825408] [DEBUG] [LOCAL ] EQH: Loaded 52657 existing records from primary storage. [2025-09-17T07:34:59.826222] [INFO ] [MAIN ] EQH: Loaded 52657 primary data records. [2025-09-17T07:35:00.015125] [DEBUG] [MAIN ] EQBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:00.039123] [INFO ] [MAIN ] EQBK: Generated 1794 derivative records from 10852 primary records. [2025-09-17T07:35:00.207821] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-17T07:35:00.241258] [DEBUG] [MAIN ] EPRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:00.227766] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1794 records). [2025-09-17T07:35:00.242616] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-17T07:35:00.242355] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48707 primary records. [2025-09-17T07:35:00.244983] [INFO ] [MAIN ] Derivative Progress: 694/2172 symbols completed. EQBK took 1.1s. Estimated remaining: 9m 15s. Rate: 159.7 symbols/min [2025-09-17T07:35:00.245086] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-17T07:35:00.246106] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:00.263955] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-09-17T07:35:00.264238] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-17T07:35:00.267118] [INFO ] [MAIN ] Derivative Progress: 695/2172 symbols completed. EPRT took 1.2s. Estimated remaining: 9m 14s. Rate: 159.9 symbols/min [2025-09-17T07:35:00.267794] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:00.284687] [DEBUG] [MAIN ] EQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:00.285351] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52657 primary records. [2025-09-17T07:35:00.285531] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-17T07:35:00.303908] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-09-17T07:35:00.304118] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-17T07:35:00.307102] [INFO ] [MAIN ] Derivative Progress: 696/2172 symbols completed. EQH took 1.0s. Estimated remaining: 9m 13s. Rate: 160.1 symbols/min [2025-09-17T07:35:00.321569] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:00.343490] [DEBUG] [LOCAL ] EQNR: Loaded 53054 existing records from primary storage. [2025-09-17T07:35:00.343894] [INFO ] [MAIN ] EQNR: Loaded 53054 primary data records. [2025-09-17T07:35:00.692833] [DEBUG] [LOCAL ] EQR: Loaded 51365 existing records from primary storage. [2025-09-17T07:35:00.693219] [INFO ] [MAIN ] EQR: Loaded 51365 primary data records. [2025-09-17T07:35:00.813540] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-17T07:35:00.862150] [INFO ] [MAIN ] EQT: Loaded 53682 primary data records. [2025-09-17T07:35:01.307664] [DEBUG] [MAIN ] EQNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:01.309128] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53054 primary records. [2025-09-17T07:35:01.309511] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-17T07:35:01.330412] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-09-17T07:35:01.343055] [DEBUG] [MAIN ] EQR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:01.343126] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-17T07:35:01.346436] [INFO ] [MAIN ] Derivative Progress: 697/2172 symbols completed. EQNR took 1.1s. Estimated remaining: 9m 14s. Rate: 159.7 symbols/min [2025-09-17T07:35:01.343752] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51365 primary records. [2025-09-17T07:35:01.347237] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:01.347408] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-17T07:35:01.365516] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-09-17T07:35:01.369547] [DEBUG] [LOCAL ] EQV: Loaded 2934 existing records from primary storage. [2025-09-17T07:35:01.366548] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-17T07:35:01.372522] [INFO ] [MAIN ] EQV: Loaded 2934 primary data records. [2025-09-17T07:35:01.372427] [INFO ] [MAIN ] Derivative Progress: 698/2172 symbols completed. EQR took 1.1s. Estimated remaining: 9m 13s. Rate: 159.9 symbols/min [2025-09-17T07:35:01.379391] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:01.412186] [DEBUG] [MAIN ] EQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:01.456184] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53682 primary records. [2025-09-17T07:35:01.484654] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-17T07:35:01.730882] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-09-17T07:35:01.731055] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-17T07:35:01.733886] [INFO ] [MAIN ] Derivative Progress: 699/2172 symbols completed. EQT took 1.4s. Estimated remaining: 9m 13s. Rate: 159.9 symbols/min [2025-09-17T07:35:01.735206] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:01.768034] [DEBUG] [LOCAL ] ERJ: Loaded 51018 existing records from primary storage. [2025-09-17T07:35:01.769414] [INFO ] [MAIN ] ERJ: Loaded 51018 primary data records. [2025-09-17T07:35:02.007303] [DEBUG] [MAIN ] EQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:02.019022] [DEBUG] [LOCAL ] ERO: Loaded 41171 existing records from primary storage. [2025-09-17T07:35:02.139249] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2934 primary records. [2025-09-17T07:35:02.139318] [INFO ] [MAIN ] ERO: Loaded 41171 primary data records. [2025-09-17T07:35:02.186326] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-17T07:35:02.394872] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-09-17T07:35:02.514379] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-17T07:35:02.517464] [INFO ] [MAIN ] Derivative Progress: 700/2172 symbols completed. EQV took 1.2s. Estimated remaining: 9m 13s. Rate: 159.7 symbols/min [2025-09-17T07:35:02.518165] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:02.538550] [DEBUG] [MAIN ] ERJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:02.539407] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 51018 primary records. [2025-09-17T07:35:02.539584] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-17T07:35:02.558422] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-09-17T07:35:02.558907] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-17T07:35:02.561109] [INFO ] [MAIN ] Derivative Progress: 701/2172 symbols completed. ERJ took 1.2s. Estimated remaining: 9m 12s. Rate: 159.9 symbols/min [2025-09-17T07:35:02.574937] [INFO ] [MAIN ] ESAB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:02.605338] [DEBUG] [MAIN ] ERO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:02.607024] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41171 primary records. [2025-09-17T07:35:02.608008] [DEBUG] [LOCAL ] ES: Loaded 52512 existing records from primary storage. [2025-09-17T07:35:02.607198] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-17T07:35:02.608578] [INFO ] [MAIN ] ES: Loaded 52512 primary data records. [2025-09-17T07:35:02.742759] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-09-17T07:35:02.792503] [DEBUG] [LOCAL ] ESAB: Loaded 25485 existing records from primary storage. [2025-09-17T07:35:02.817598] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-17T07:35:02.824980] [INFO ] [MAIN ] Derivative Progress: 702/2172 symbols completed. ERO took 1.1s. Estimated remaining: 9m 11s. Rate: 160.0 symbols/min [2025-09-17T07:35:02.825055] [INFO ] [MAIN ] ESAB: Loaded 25485 primary data records. [2025-09-17T07:35:02.936961] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:03.147249] [DEBUG] [LOCAL ] ESE: Loaded 16547 existing records from primary storage. [2025-09-17T07:35:03.258760] [INFO ] [MAIN ] ESE: Loaded 16547 primary data records. [2025-09-17T07:35:03.465540] [DEBUG] [MAIN ] ES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:03.584584] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52512 primary records. [2025-09-17T07:35:03.594630] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-17T07:35:03.615767] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-09-17T07:35:03.617891] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-17T07:35:03.620048] [INFO ] [MAIN ] Derivative Progress: 703/2172 symbols completed. ES took 1.1s. Estimated remaining: 9m 12s. Rate: 159.7 symbols/min [2025-09-17T07:35:03.634766] [DEBUG] [MAIN ] ESAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:03.635509] [INFO ] [MAIN ] ESAB: Generated 1794 derivative records from 25485 primary records. [2025-09-17T07:35:03.635720] [DEBUG] [LOCAL ] ESAB: Saving derivative data. [2025-09-17T07:35:03.654130] [DEBUG] [LOCAL ] ESAB: Derivative data saved (1794 records). [2025-09-17T07:35:03.654396] [INFO ] [MAIN ] ESAB: Successfully saved derivative data. [2025-09-17T07:35:03.656801] [INFO ] [MAIN ] Derivative Progress: 704/2172 symbols completed. ESAB took 1.1s. Estimated remaining: 9m 11s. Rate: 159.9 symbols/min [2025-09-17T07:35:03.671755] [DEBUG] [MAIN ] ESE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:03.672353] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16547 primary records. [2025-09-17T07:35:03.672427] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-17T07:35:03.688019] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-09-17T07:35:03.688099] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-17T07:35:03.690369] [INFO ] [MAIN ] Derivative Progress: 705/2172 symbols completed. ESE took 0.8s. Estimated remaining: 9m 10s. Rate: 160.1 symbols/min [2025-09-17T07:35:03.690921] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:03.691084] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:03.690984] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:03.760689] [DEBUG] [LOCAL ] ESI: Loaded 50857 existing records from primary storage. [2025-09-17T07:35:03.761893] [INFO ] [MAIN ] ESI: Loaded 50857 primary data records. [2025-09-17T07:35:03.821331] [DEBUG] [LOCAL ] ESNT: Loaded 38806 existing records from primary storage. [2025-09-17T07:35:03.882323] [INFO ] [MAIN ] ESNT: Loaded 38806 primary data records. [2025-09-17T07:35:03.890603] [DEBUG] [LOCAL ] ESRT: Loaded 46391 existing records from primary storage. [2025-09-17T07:35:03.905404] [INFO ] [MAIN ] ESRT: Loaded 46391 primary data records. [2025-09-17T07:35:04.800263] [DEBUG] [MAIN ] ESI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:04.801387] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50857 primary records. [2025-09-17T07:35:04.801822] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-17T07:35:04.843813] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-09-17T07:35:04.849038] [DEBUG] [MAIN ] ESRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:04.849164] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-17T07:35:04.849946] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46391 primary records. [2025-09-17T07:35:04.843156] [DEBUG] [MAIN ] ESNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:04.850090] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-17T07:35:04.850621] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38806 primary records. [2025-09-17T07:35:04.852283] [INFO ] [MAIN ] Derivative Progress: 706/2172 symbols completed. ESI took 1.2s. Estimated remaining: 9m 11s. Rate: 159.6 symbols/min [2025-09-17T07:35:04.853170] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-17T07:35:04.853418] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:04.882434] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-09-17T07:35:04.884840] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-17T07:35:04.885287] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-09-17T07:35:04.887768] [INFO ] [MAIN ] Derivative Progress: 707/2172 symbols completed. ESNT took 1.2s. Estimated remaining: 9m 10s. Rate: 159.8 symbols/min [2025-09-17T07:35:04.887979] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-17T07:35:04.888199] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:04.890869] [INFO ] [MAIN ] Derivative Progress: 708/2172 symbols completed. ESRT took 1.2s. Estimated remaining: 9m 9s. Rate: 160.1 symbols/min [2025-09-17T07:35:04.891551] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:04.913161] [DEBUG] [LOCAL ] ESS: Loaded 30217 existing records from primary storage. [2025-09-17T07:35:04.913450] [INFO ] [MAIN ] ESS: Loaded 30217 primary data records. [2025-09-17T07:35:05.253836] [DEBUG] [LOCAL ] ESTC: Loaded 50254 existing records from primary storage. [2025-09-17T07:35:05.268396] [INFO ] [MAIN ] ESTC: Loaded 50254 primary data records. [2025-09-17T07:35:05.300984] [DEBUG] [LOCAL ] ET: Loaded 53790 existing records from primary storage. [2025-09-17T07:35:05.314821] [INFO ] [MAIN ] ET: Loaded 53790 primary data records. [2025-09-17T07:35:05.886310] [DEBUG] [MAIN ] ESS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:05.887993] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 30217 primary records. [2025-09-17T07:35:05.888235] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-17T07:35:05.907903] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-09-17T07:35:05.909840] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-17T07:35:05.912107] [INFO ] [MAIN ] Derivative Progress: 709/2172 symbols completed. ESS took 1.1s. Estimated remaining: 9m 10s. Rate: 159.7 symbols/min [2025-09-17T07:35:05.912594] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:05.926306] [DEBUG] [MAIN ] ESTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:05.928126] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50254 primary records. [2025-09-17T07:35:05.928357] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-17T07:35:05.967834] [DEBUG] [MAIN ] ET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:05.969191] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-09-17T07:35:05.969924] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53790 primary records. [2025-09-17T07:35:05.968390] [DEBUG] [LOCAL ] ETB: Loaded 12202 existing records from primary storage. [2025-09-17T07:35:05.970108] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-17T07:35:05.970185] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-17T07:35:05.972139] [INFO ] [MAIN ] Derivative Progress: 710/2172 symbols completed. ESTC took 1.1s. Estimated remaining: 9m 9s. Rate: 159.9 symbols/min [2025-09-17T07:35:05.972625] [INFO ] [MAIN ] ETB: Loaded 12202 primary data records. [2025-09-17T07:35:05.973210] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:06.187126] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-09-17T07:35:06.349760] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-17T07:35:06.350689] [DEBUG] [LOCAL ] ETD: Loaded 27390 existing records from primary storage. [2025-09-17T07:35:06.353341] [INFO ] [MAIN ] Derivative Progress: 711/2172 symbols completed. ET took 1.5s. Estimated remaining: 9m 8s. Rate: 159.9 symbols/min [2025-09-17T07:35:06.353883] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:06.353668] [INFO ] [MAIN ] ETD: Loaded 27390 primary data records. [2025-09-17T07:35:06.498089] [DEBUG] [LOCAL ] ETG: Loaded 17067 existing records from primary storage. [2025-09-17T07:35:06.549877] [INFO ] [MAIN ] ETG: Loaded 17067 primary data records. [2025-09-17T07:35:06.908992] [DEBUG] [MAIN ] ETB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:06.995313] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 12202 primary records. [2025-09-17T07:35:06.995801] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-17T07:35:07.028465] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-09-17T07:35:07.035562] [DEBUG] [MAIN ] ETD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:07.034146] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-17T07:35:07.038108] [INFO ] [MAIN ] Derivative Progress: 712/2172 symbols completed. ETB took 1.1s. Estimated remaining: 9m 9s. Rate: 159.7 symbols/min [2025-09-17T07:35:07.039552] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27390 primary records. [2025-09-17T07:35:07.039679] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:07.039793] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-17T07:35:07.060114] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-09-17T07:35:07.064287] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-17T07:35:07.066929] [INFO ] [MAIN ] Derivative Progress: 713/2172 symbols completed. ETD took 1.1s. Estimated remaining: 9m 8s. Rate: 159.9 symbols/min [2025-09-17T07:35:07.075285] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:07.087401] [DEBUG] [LOCAL ] ETJ: Loaded 16905 existing records from primary storage. [2025-09-17T07:35:07.087578] [DEBUG] [MAIN ] ETG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:07.088513] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 17067 primary records. [2025-09-17T07:35:07.087779] [INFO ] [MAIN ] ETJ: Loaded 16905 primary data records. [2025-09-17T07:35:07.088635] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-17T07:35:07.257672] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-09-17T07:35:07.405505] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-17T07:35:07.418327] [INFO ] [MAIN ] Derivative Progress: 714/2172 symbols completed. ETG took 1.1s. Estimated remaining: 9m 7s. Rate: 159.9 symbols/min [2025-09-17T07:35:07.418850] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:07.441426] [DEBUG] [LOCAL ] ETN: Loaded 52880 existing records from primary storage. [2025-09-17T07:35:07.444867] [INFO ] [MAIN ] ETN: Loaded 52880 primary data records. [2025-09-17T07:35:07.444634] [DEBUG] [LOCAL ] ETO: Loaded 6670 existing records from primary storage. [2025-09-17T07:35:07.445572] [INFO ] [MAIN ] ETO: Loaded 6670 primary data records. [2025-09-17T07:35:08.107485] [DEBUG] [MAIN ] ETJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:08.108760] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16905 primary records. [2025-09-17T07:35:08.109894] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-17T07:35:08.130527] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-09-17T07:35:08.131056] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-17T07:35:08.133031] [INFO ] [MAIN ] Derivative Progress: 715/2172 symbols completed. ETJ took 1.1s. Estimated remaining: 9m 7s. Rate: 159.7 symbols/min [2025-09-17T07:35:08.133406] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:08.169053] [DEBUG] [MAIN ] ETO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:08.169448] [DEBUG] [MAIN ] ETN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:08.170065] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6670 primary records. [2025-09-17T07:35:08.170935] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52880 primary records. [2025-09-17T07:35:08.171126] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-17T07:35:08.171167] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-17T07:35:08.204222] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-09-17T07:35:08.205388] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-09-17T07:35:08.205492] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-17T07:35:08.208032] [INFO ] [MAIN ] Derivative Progress: 716/2172 symbols completed. ETN took 1.1s. Estimated remaining: 9m 6s. Rate: 159.9 symbols/min [2025-09-17T07:35:08.205596] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-17T07:35:08.211375] [INFO ] [MAIN ] Derivative Progress: 717/2172 symbols completed. ETO took 0.8s. Estimated remaining: 9m 5s. Rate: 160.1 symbols/min [2025-09-17T07:35:08.208418] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:08.212141] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:08.258111] [DEBUG] [LOCAL ] ETR: Loaded 53253 existing records from primary storage. [2025-09-17T07:35:08.264815] [INFO ] [MAIN ] ETR: Loaded 53253 primary data records. [2025-09-17T07:35:08.362030] [DEBUG] [LOCAL ] ETV: Loaded 21483 existing records from primary storage. [2025-09-17T07:35:08.380738] [INFO ] [MAIN ] ETV: Loaded 21483 primary data records. [2025-09-17T07:35:08.432866] [DEBUG] [LOCAL ] ETW: Loaded 25369 existing records from primary storage. [2025-09-17T07:35:08.534345] [INFO ] [MAIN ] ETW: Loaded 25369 primary data records. [2025-09-17T07:35:09.212903] [DEBUG] [MAIN ] ETR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:09.213749] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53253 primary records. [2025-09-17T07:35:09.214894] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-17T07:35:09.244478] [DEBUG] [MAIN ] ETV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:09.246377] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 21483 primary records. [2025-09-17T07:35:09.246482] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-17T07:35:09.261337] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-09-17T07:35:09.263513] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-17T07:35:09.266460] [INFO ] [MAIN ] Derivative Progress: 718/2172 symbols completed. ETR took 1.1s. Estimated remaining: 9m 6s. Rate: 159.7 symbols/min [2025-09-17T07:35:09.280944] [DEBUG] [MAIN ] ETW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:09.282149] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25369 primary records. [2025-09-17T07:35:09.282631] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-09-17T07:35:09.282738] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-17T07:35:09.282845] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-17T07:35:09.285714] [INFO ] [MAIN ] Derivative Progress: 719/2172 symbols completed. ETV took 1.1s. Estimated remaining: 9m 5s. Rate: 159.9 symbols/min [2025-09-17T07:35:09.300542] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-09-17T07:35:09.300616] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-17T07:35:09.303024] [INFO ] [MAIN ] Derivative Progress: 720/2172 symbols completed. ETW took 1.1s. Estimated remaining: 9m 4s. Rate: 160.1 symbols/min [2025-09-17T07:35:09.303401] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:09.303525] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:09.304075] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:09.312753] [DEBUG] [LOCAL ] ETX: Loaded 4939 existing records from primary storage. [2025-09-17T07:35:09.312959] [INFO ] [MAIN ] ETX: Loaded 4939 primary data records. [2025-09-17T07:35:09.510245] [DEBUG] [LOCAL ] EVC: Loaded 20297 existing records from primary storage. [2025-09-17T07:35:09.631132] [INFO ] [MAIN ] EVC: Loaded 20297 primary data records. [2025-09-17T07:35:09.630321] [DEBUG] [LOCAL ] ETY: Loaded 23207 existing records from primary storage. [2025-09-17T07:35:09.642570] [INFO ] [MAIN ] ETY: Loaded 23207 primary data records. [2025-09-17T07:35:10.301459] [DEBUG] [MAIN ] ETX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:10.302541] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 4939 primary records. [2025-09-17T07:35:10.302893] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-17T07:35:10.320057] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-09-17T07:35:10.321014] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-17T07:35:10.323980] [INFO ] [MAIN ] Derivative Progress: 721/2172 symbols completed. ETX took 1.0s. Estimated remaining: 9m 5s. Rate: 159.7 symbols/min [2025-09-17T07:35:10.325359] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:10.339687] [DEBUG] [MAIN ] EVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:10.340389] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 20297 primary records. [2025-09-17T07:35:10.340574] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-17T07:35:10.367488] [DEBUG] [MAIN ] ETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:10.370007] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 23207 primary records. [2025-09-17T07:35:10.370777] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-17T07:35:10.387967] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-09-17T07:35:10.391814] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-17T07:35:10.395503] [INFO ] [MAIN ] Derivative Progress: 722/2172 symbols completed. EVC took 1.1s. Estimated remaining: 9m 4s. Rate: 159.9 symbols/min [2025-09-17T07:35:10.396837] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:10.398318] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-09-17T07:35:10.399122] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-17T07:35:10.401719] [INFO ] [MAIN ] Derivative Progress: 723/2172 symbols completed. ETY took 1.1s. Estimated remaining: 9m 3s. Rate: 160.1 symbols/min [2025-09-17T07:35:10.402109] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:10.412033] [DEBUG] [LOCAL ] EVEX: Loaded 28901 existing records from primary storage. [2025-09-17T07:35:10.412158] [INFO ] [MAIN ] EVEX: Loaded 28901 primary data records. [2025-09-17T07:35:10.523498] [DEBUG] [LOCAL ] EVF: Loaded 9065 existing records from primary storage. [2025-09-17T07:35:10.540817] [INFO ] [MAIN ] EVF: Loaded 9065 primary data records. [2025-09-17T07:35:10.529959] [DEBUG] [LOCAL ] EVG: Loaded 5848 existing records from primary storage. [2025-09-17T07:35:10.585367] [INFO ] [MAIN ] EVG: Loaded 5848 primary data records. [2025-09-17T07:35:11.366629] [DEBUG] [MAIN ] EVEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:11.367418] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 28901 primary records. [2025-09-17T07:35:11.368828] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-17T07:35:11.402008] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-09-17T07:35:11.401587] [DEBUG] [MAIN ] EVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:11.403792] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9065 primary records. [2025-09-17T07:35:11.403896] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-17T07:35:11.404010] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-17T07:35:11.406297] [INFO ] [MAIN ] Derivative Progress: 724/2172 symbols completed. EVEX took 1.1s. Estimated remaining: 9m 4s. Rate: 159.8 symbols/min [2025-09-17T07:35:11.406564] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:11.435963] [DEBUG] [MAIN ] EVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:11.437780] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5848 primary records. [2025-09-17T07:35:11.438321] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-17T07:35:11.438161] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-09-17T07:35:11.439025] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-17T07:35:11.441541] [INFO ] [MAIN ] Derivative Progress: 725/2172 symbols completed. EVF took 1.0s. Estimated remaining: 9m 3s. Rate: 160.0 symbols/min [2025-09-17T07:35:11.448965] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:11.459982] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-09-17T07:35:11.460493] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-17T07:35:11.463973] [INFO ] [MAIN ] Derivative Progress: 726/2172 symbols completed. EVG took 1.1s. Estimated remaining: 9m 2s. Rate: 160.2 symbols/min [2025-09-17T07:35:11.464820] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:11.487300] [DEBUG] [LOCAL ] EVN: Loaded 10894 existing records from primary storage. [2025-09-17T07:35:11.487495] [INFO ] [MAIN ] EVN: Loaded 10894 primary data records. [2025-09-17T07:35:11.608970] [DEBUG] [LOCAL ] EVH: Loaded 49360 existing records from primary storage. [2025-09-17T07:35:11.650500] [INFO ] [MAIN ] EVH: Loaded 49360 primary data records. [2025-09-17T07:35:11.835812] [DEBUG] [LOCAL ] EVR: Loaded 35990 existing records from primary storage. [2025-09-17T07:35:11.960502] [INFO ] [MAIN ] EVR: Loaded 35990 primary data records. [2025-09-17T07:35:12.555034] [DEBUG] [MAIN ] EVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:12.556539] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 10894 primary records. [2025-09-17T07:35:12.557672] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-17T07:35:12.581245] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-09-17T07:35:12.581978] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-17T07:35:12.595925] [DEBUG] [MAIN ] EVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:12.598152] [INFO ] [MAIN ] Derivative Progress: 727/2172 symbols completed. EVN took 1.2s. Estimated remaining: 9m 3s. Rate: 159.7 symbols/min [2025-09-17T07:35:12.598853] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:12.599909] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49360 primary records. [2025-09-17T07:35:12.602482] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-17T07:35:12.626836] [DEBUG] [MAIN ] EVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:12.631585] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 35990 primary records. [2025-09-17T07:35:12.632093] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-17T07:35:12.656266] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-09-17T07:35:12.657104] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-17T07:35:12.661364] [INFO ] [MAIN ] Derivative Progress: 728/2172 symbols completed. EVH took 1.3s. Estimated remaining: 9m 2s. Rate: 159.9 symbols/min [2025-09-17T07:35:12.662505] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:12.664064] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-09-17T07:35:12.664394] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-17T07:35:12.676006] [INFO ] [MAIN ] Derivative Progress: 729/2172 symbols completed. EVR took 1.2s. Estimated remaining: 9m 1s. Rate: 160.1 symbols/min [2025-09-17T07:35:12.676607] [DEBUG] [LOCAL ] EVT: Loaded 17714 existing records from primary storage. [2025-09-17T07:35:12.676908] [INFO ] [MAIN ] EVT: Loaded 17714 primary data records. [2025-09-17T07:35:12.677170] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:13.006082] [DEBUG] [LOCAL ] EVTC: Loaded 26661 existing records from primary storage. [2025-09-17T07:35:13.006365] [INFO ] [MAIN ] EVTC: Loaded 26661 primary data records. [2025-09-17T07:35:13.120728] [DEBUG] [LOCAL ] EVTL: Loaded 36188 existing records from primary storage. [2025-09-17T07:35:13.126948] [INFO ] [MAIN ] EVTL: Loaded 36188 primary data records. [2025-09-17T07:35:13.620379] [DEBUG] [MAIN ] EVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:13.621271] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 17714 primary records. [2025-09-17T07:35:13.622295] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-17T07:35:13.647314] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-09-17T07:35:13.647540] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-17T07:35:13.650170] [INFO ] [MAIN ] Derivative Progress: 730/2172 symbols completed. EVT took 1.1s. Estimated remaining: 9m 2s. Rate: 159.8 symbols/min [2025-09-17T07:35:13.650624] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:13.668596] [DEBUG] [MAIN ] EVTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:13.669611] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26661 primary records. [2025-09-17T07:35:13.669820] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-17T07:35:13.692235] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-09-17T07:35:13.701629] [DEBUG] [LOCAL ] EVTR: Loaded 22682 existing records from primary storage. [2025-09-17T07:35:13.701132] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-17T07:35:13.716852] [INFO ] [MAIN ] EVTR: Loaded 22682 primary data records. [2025-09-17T07:35:13.716738] [INFO ] [MAIN ] Derivative Progress: 731/2172 symbols completed. EVTC took 1.1s. Estimated remaining: 9m 1s. Rate: 160.0 symbols/min [2025-09-17T07:35:13.717331] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:13.738632] [DEBUG] [MAIN ] EVTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:13.773885] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 36188 primary records. [2025-09-17T07:35:13.804738] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-17T07:35:14.081878] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-09-17T07:35:14.092219] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-17T07:35:14.094855] [INFO ] [MAIN ] Derivative Progress: 732/2172 symbols completed. EVTL took 1.4s. Estimated remaining: 9m 0s. Rate: 159.9 symbols/min [2025-09-17T07:35:14.095277] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:14.117032] [DEBUG] [LOCAL ] EW: Loaded 53396 existing records from primary storage. [2025-09-17T07:35:14.117427] [INFO ] [MAIN ] EW: Loaded 53396 primary data records. [2025-09-17T07:35:14.443785] [DEBUG] [LOCAL ] EXG: Loaded 34986 existing records from primary storage. [2025-09-17T07:35:14.444333] [INFO ] [MAIN ] EXG: Loaded 34986 primary data records. [2025-09-17T07:35:14.502663] [DEBUG] [MAIN ] EVTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:14.529772] [INFO ] [MAIN ] EVTR: Generated 1794 derivative records from 22682 primary records. [2025-09-17T07:35:14.547742] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-17T07:35:14.789460] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1794 records). [2025-09-17T07:35:14.789963] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-17T07:35:14.793047] [INFO ] [MAIN ] Derivative Progress: 733/2172 symbols completed. EVTR took 1.1s. Estimated remaining: 9m 0s. Rate: 159.8 symbols/min [2025-09-17T07:35:14.813336] [DEBUG] [MAIN ] EW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:14.814204] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53396 primary records. [2025-09-17T07:35:14.814403] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-17T07:35:14.844850] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-09-17T07:35:14.843995] [DEBUG] [MAIN ] EXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:14.845001] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-17T07:35:14.845663] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34986 primary records. [2025-09-17T07:35:14.847906] [INFO ] [MAIN ] Derivative Progress: 734/2172 symbols completed. EW took 1.1s. Estimated remaining: 8m 59s. Rate: 159.9 symbols/min [2025-09-17T07:35:14.848212] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-17T07:35:14.863967] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-09-17T07:35:14.864062] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-17T07:35:14.866739] [INFO ] [MAIN ] Derivative Progress: 735/2172 symbols completed. EXG took 0.8s. Estimated remaining: 8m 58s. Rate: 160.2 symbols/min [2025-09-17T07:35:14.867505] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:14.867392] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:14.867743] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:14.929869] [DEBUG] [LOCAL ] EXP: Loaded 30245 existing records from primary storage. [2025-09-17T07:35:14.930109] [INFO ] [MAIN ] EXP: Loaded 30245 primary data records. [2025-09-17T07:35:15.071461] [DEBUG] [LOCAL ] EXK: Loaded 53059 existing records from primary storage. [2025-09-17T07:35:15.072294] [DEBUG] [LOCAL ] EXPD: Loaded 48243 existing records from primary storage. [2025-09-17T07:35:15.072400] [INFO ] [MAIN ] EXK: Loaded 53059 primary data records. [2025-09-17T07:35:15.072941] [INFO ] [MAIN ] EXPD: Loaded 48243 primary data records. [2025-09-17T07:35:15.987885] [DEBUG] [MAIN ] EXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:15.988786] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 30245 primary records. [2025-09-17T07:35:15.989412] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-17T07:35:16.011319] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-09-17T07:35:16.024211] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-17T07:35:16.024791] [DEBUG] [MAIN ] EXK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:16.025489] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53059 primary records. [2025-09-17T07:35:16.027763] [INFO ] [MAIN ] Derivative Progress: 736/2172 symbols completed. EXP took 1.2s. Estimated remaining: 8m 60s. Rate: 159.7 symbols/min [2025-09-17T07:35:16.035740] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-17T07:35:16.040937] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:16.041409] [DEBUG] [MAIN ] EXPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:16.042742] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 48243 primary records. [2025-09-17T07:35:16.043282] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-17T07:35:16.073834] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-09-17T07:35:16.074434] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-17T07:35:16.077316] [INFO ] [MAIN ] Derivative Progress: 737/2172 symbols completed. EXK took 1.2s. Estimated remaining: 8m 59s. Rate: 159.9 symbols/min [2025-09-17T07:35:16.082206] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-09-17T07:35:16.082301] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:16.082545] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-17T07:35:16.085344] [INFO ] [MAIN ] Derivative Progress: 738/2172 symbols completed. EXPD took 1.2s. Estimated remaining: 8m 57s. Rate: 160.1 symbols/min [2025-09-17T07:35:16.085948] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:16.124128] [DEBUG] [LOCAL ] EXR: Loaded 45648 existing records from primary storage. [2025-09-17T07:35:16.124355] [INFO ] [MAIN ] EXR: Loaded 45648 primary data records. [2025-09-17T07:35:16.353331] [DEBUG] [LOCAL ] FAF: Loaded 42029 existing records from primary storage. [2025-09-17T07:35:16.505558] [INFO ] [MAIN ] FAF: Loaded 42029 primary data records. [2025-09-17T07:35:16.515593] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-17T07:35:16.516605] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-09-17T07:35:17.141553] [DEBUG] [MAIN ] EXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:17.142841] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45648 primary records. [2025-09-17T07:35:17.142966] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-17T07:35:17.163313] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-09-17T07:35:17.163763] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-17T07:35:17.166270] [INFO ] [MAIN ] Derivative Progress: 739/2172 symbols completed. EXR took 1.1s. Estimated remaining: 8m 58s. Rate: 159.7 symbols/min [2025-09-17T07:35:17.167236] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:17.198136] [DEBUG] [MAIN ] FAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:17.198441] [DEBUG] [MAIN ] F: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:17.199717] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-09-17T07:35:17.199177] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 42029 primary records. [2025-09-17T07:35:17.200015] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-17T07:35:17.200117] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-17T07:35:17.229046] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-09-17T07:35:17.231150] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-17T07:35:17.234923] [INFO ] [MAIN ] Derivative Progress: 740/2172 symbols completed. F took 1.2s. Estimated remaining: 8m 57s. Rate: 159.9 symbols/min [2025-09-17T07:35:17.236110] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:17.236243] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-09-17T07:35:17.236748] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-17T07:35:17.238938] [INFO ] [MAIN ] Derivative Progress: 741/2172 symbols completed. FAF took 1.2s. Estimated remaining: 8m 56s. Rate: 160.1 symbols/min [2025-09-17T07:35:17.239343] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:17.280293] [DEBUG] [LOCAL ] FBIN: Loaded 50474 existing records from primary storage. [2025-09-17T07:35:17.280581] [INFO ] [MAIN ] FBIN: Loaded 50474 primary data records. [2025-09-17T07:35:17.388989] [DEBUG] [LOCAL ] FBK: Loaded 25177 existing records from primary storage. [2025-09-17T07:35:17.410478] [INFO ] [MAIN ] FBK: Loaded 25177 primary data records. [2025-09-17T07:35:17.678543] [DEBUG] [LOCAL ] FBP: Loaded 46372 existing records from primary storage. [2025-09-17T07:35:17.704573] [INFO ] [MAIN ] FBP: Loaded 46372 primary data records. [2025-09-17T07:35:18.295747] [DEBUG] [MAIN ] FBIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:18.296867] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50474 primary records. [2025-09-17T07:35:18.297086] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-17T07:35:18.314956] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-09-17T07:35:18.316753] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-17T07:35:18.319350] [INFO ] [MAIN ] Derivative Progress: 742/2172 symbols completed. FBIN took 1.2s. Estimated remaining: 8m 57s. Rate: 159.7 symbols/min [2025-09-17T07:35:18.319885] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:18.333572] [DEBUG] [MAIN ] FBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:18.334410] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 25177 primary records. [2025-09-17T07:35:18.334697] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-17T07:35:18.366206] [DEBUG] [MAIN ] FBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:18.368136] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 46372 primary records. [2025-09-17T07:35:18.375769] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-17T07:35:18.375861] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-09-17T07:35:18.376913] [DEBUG] [LOCAL ] FC: Loaded 15411 existing records from primary storage. [2025-09-17T07:35:18.377133] [INFO ] [MAIN ] FC: Loaded 15411 primary data records. [2025-09-17T07:35:18.377018] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-17T07:35:18.387947] [INFO ] [MAIN ] Derivative Progress: 743/2172 symbols completed. FBK took 1.2s. Estimated remaining: 8m 56s. Rate: 159.9 symbols/min [2025-09-17T07:35:18.463664] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:18.495889] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-09-17T07:35:18.516737] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-17T07:35:18.573703] [INFO ] [MAIN ] Derivative Progress: 744/2172 symbols completed. FBP took 1.3s. Estimated remaining: 8m 56s. Rate: 160.0 symbols/min [2025-09-17T07:35:18.684613] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:18.726373] [DEBUG] [MAIN ] FC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:18.737906] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 15411 primary records. [2025-09-17T07:35:18.744688] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-17T07:35:18.746865] [DEBUG] [LOCAL ] FCF: Loaded 39936 existing records from primary storage. [2025-09-17T07:35:18.747250] [DEBUG] [LOCAL ] FCN: Loaded 26388 existing records from primary storage. [2025-09-17T07:35:18.747548] [INFO ] [MAIN ] FCF: Loaded 39936 primary data records. [2025-09-17T07:35:18.754834] [INFO ] [MAIN ] FCN: Loaded 26388 primary data records. [2025-09-17T07:35:18.989572] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-09-17T07:35:19.085791] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-17T07:35:19.140106] [INFO ] [MAIN ] Derivative Progress: 745/2172 symbols completed. FC took 0.8s. Estimated remaining: 8m 56s. Rate: 159.9 symbols/min [2025-09-17T07:35:19.351660] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:19.404446] [DEBUG] [MAIN ] FCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:19.404884] [DEBUG] [MAIN ] FCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:19.405670] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39936 primary records. [2025-09-17T07:35:19.417874] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-17T07:35:19.406781] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 26388 primary records. [2025-09-17T07:35:19.419979] [DEBUG] [LOCAL ] FCPT: Loaded 37569 existing records from primary storage. [2025-09-17T07:35:19.420432] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-17T07:35:19.420707] [INFO ] [MAIN ] FCPT: Loaded 37569 primary data records. [2025-09-17T07:35:19.555218] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-09-17T07:35:19.559163] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-17T07:35:19.562416] [INFO ] [MAIN ] Derivative Progress: 746/2172 symbols completed. FCF took 1.1s. Estimated remaining: 8m 55s. Rate: 159.8 symbols/min [2025-09-17T07:35:19.563420] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-09-17T07:35:19.563864] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:19.564352] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-17T07:35:19.582875] [INFO ] [MAIN ] Derivative Progress: 747/2172 symbols completed. FCN took 0.9s. Estimated remaining: 8m 54s. Rate: 160.0 symbols/min [2025-09-17T07:35:19.588443] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:19.773893] [DEBUG] [LOCAL ] FCT: Loaded 14388 existing records from primary storage. [2025-09-17T07:35:19.774074] [INFO ] [MAIN ] FCT: Loaded 14388 primary data records. [2025-09-17T07:35:20.152255] [DEBUG] [LOCAL ] FCX: Loaded 53699 existing records from primary storage. [2025-09-17T07:35:20.153218] [INFO ] [MAIN ] FCX: Loaded 53699 primary data records. [2025-09-17T07:35:20.307179] [DEBUG] [MAIN ] FCPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:20.343588] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37569 primary records. [2025-09-17T07:35:20.367509] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-17T07:35:20.505595] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-09-17T07:35:20.506274] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-17T07:35:20.511705] [INFO ] [MAIN ] Derivative Progress: 748/2172 symbols completed. FCPT took 1.2s. Estimated remaining: 8m 55s. Rate: 159.7 symbols/min [2025-09-17T07:35:20.525479] [DEBUG] [MAIN ] FCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:20.527350] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14388 primary records. [2025-09-17T07:35:20.527690] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-17T07:35:20.544228] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-09-17T07:35:20.544398] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-17T07:35:20.546877] [INFO ] [MAIN ] Derivative Progress: 749/2172 symbols completed. FCT took 1.0s. Estimated remaining: 8m 54s. Rate: 159.9 symbols/min [2025-09-17T07:35:20.562847] [DEBUG] [MAIN ] FCX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:35:20.563554] [INFO ] [MAIN ] FCX: Generated 1793 derivative records from 53699 primary records. [2025-09-17T07:35:20.563632] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-17T07:35:20.580082] [DEBUG] [LOCAL ] FCX: Derivative data saved (1793 records). [2025-09-17T07:35:20.580168] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-17T07:35:20.582593] [INFO ] [MAIN ] Derivative Progress: 750/2172 symbols completed. FCX took 1.0s. Estimated remaining: 8m 53s. Rate: 160.1 symbols/min [2025-09-17T07:35:20.583270] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:20.583502] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:20.583444] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:20.617745] [DEBUG] [LOCAL ] FDS: Loaded 25360 existing records from primary storage. [2025-09-17T07:35:20.617904] [INFO ] [MAIN ] FDS: Loaded 25360 primary data records. [2025-09-17T07:35:20.745424] [DEBUG] [LOCAL ] FDP: Loaded 30448 existing records from primary storage. [2025-09-17T07:35:20.749695] [INFO ] [MAIN ] FDP: Loaded 30448 primary data records. [2025-09-17T07:35:20.873606] [DEBUG] [LOCAL ] FDX: Loaded 51550 existing records from primary storage. [2025-09-17T07:35:20.956414] [INFO ] [MAIN ] FDX: Loaded 51550 primary data records. [2025-09-17T07:35:21.610838] [DEBUG] [MAIN ] FDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:21.612625] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 25360 primary records. [2025-09-17T07:35:21.612770] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-17T07:35:21.646512] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-09-17T07:35:21.646048] [DEBUG] [MAIN ] FDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:21.646785] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-17T07:35:21.647429] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 30448 primary records. [2025-09-17T07:35:21.649487] [INFO ] [MAIN ] Derivative Progress: 751/2172 symbols completed. FDS took 1.1s. Estimated remaining: 8m 54s. Rate: 159.7 symbols/min [2025-09-17T07:35:21.650353] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-17T07:35:21.651898] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:21.678366] [DEBUG] [MAIN ] FDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:21.679919] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51550 primary records. [2025-09-17T07:35:21.680249] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-17T07:35:21.683738] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-09-17T07:35:21.691240] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-17T07:35:21.697133] [INFO ] [MAIN ] Derivative Progress: 752/2172 symbols completed. FDP took 1.1s. Estimated remaining: 8m 53s. Rate: 159.9 symbols/min [2025-09-17T07:35:21.698265] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:21.705065] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-09-17T07:35:21.705253] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-17T07:35:21.708109] [INFO ] [MAIN ] Derivative Progress: 753/2172 symbols completed. FDX took 1.1s. Estimated remaining: 8m 52s. Rate: 160.1 symbols/min [2025-09-17T07:35:21.708505] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:21.726674] [DEBUG] [LOCAL ] FET: Loaded 12577 existing records from primary storage. [2025-09-17T07:35:21.726848] [INFO ] [MAIN ] FET: Loaded 12577 primary data records. [2025-09-17T07:35:21.917385] [DEBUG] [LOCAL ] FE: Loaded 53453 existing records from primary storage. [2025-09-17T07:35:21.945671] [INFO ] [MAIN ] FE: Loaded 53453 primary data records. [2025-09-17T07:35:21.966790] [DEBUG] [LOCAL ] FERG: Loaded 49021 existing records from primary storage. [2025-09-17T07:35:22.109104] [INFO ] [MAIN ] FERG: Loaded 49021 primary data records. [2025-09-17T07:35:22.739807] [DEBUG] [MAIN ] FET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:22.742398] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12577 primary records. [2025-09-17T07:35:22.743341] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-17T07:35:22.769274] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-09-17T07:35:22.777493] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-17T07:35:22.784595] [INFO ] [MAIN ] Derivative Progress: 754/2172 symbols completed. FET took 1.1s. Estimated remaining: 8m 53s. Rate: 159.7 symbols/min [2025-09-17T07:35:22.785089] [DEBUG] [MAIN ] FE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:22.785423] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:22.787037] [INFO ] [MAIN ] FE: Generated 1794 derivative records from 53453 primary records. [2025-09-17T07:35:22.788887] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-17T07:35:22.818334] [DEBUG] [MAIN ] FERG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:22.821781] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 49021 primary records. [2025-09-17T07:35:22.820839] [DEBUG] [LOCAL ] FE: Derivative data saved (1794 records). [2025-09-17T07:35:22.821943] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-17T07:35:22.822126] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-17T07:35:22.825557] [INFO ] [MAIN ] Derivative Progress: 755/2172 symbols completed. FE took 1.2s. Estimated remaining: 8m 52s. Rate: 159.9 symbols/min [2025-09-17T07:35:22.834006] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:22.843490] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-09-17T07:35:22.851605] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-17T07:35:22.854144] [INFO ] [MAIN ] Derivative Progress: 756/2172 symbols completed. FERG took 1.2s. Estimated remaining: 8m 51s. Rate: 160.1 symbols/min [2025-09-17T07:35:22.854575] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:22.861630] [DEBUG] [LOCAL ] FFA: Loaded 5581 existing records from primary storage. [2025-09-17T07:35:22.862512] [INFO ] [MAIN ] FFA: Loaded 5581 primary data records. [2025-09-17T07:35:22.960905] [DEBUG] [LOCAL ] FF: Loaded 25945 existing records from primary storage. [2025-09-17T07:35:22.990014] [INFO ] [MAIN ] FF: Loaded 25945 primary data records. [2025-09-17T07:35:22.990786] [DEBUG] [LOCAL ] FFC: Loaded 16522 existing records from primary storage. [2025-09-17T07:35:23.052928] [INFO ] [MAIN ] FFC: Loaded 16522 primary data records. [2025-09-17T07:35:23.836773] [DEBUG] [MAIN ] FFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:23.837787] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 5581 primary records. [2025-09-17T07:35:23.838164] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-17T07:35:23.854455] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-09-17T07:35:23.855360] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-17T07:35:23.857581] [INFO ] [MAIN ] Derivative Progress: 757/2172 symbols completed. FFA took 1.0s. Estimated remaining: 8m 52s. Rate: 159.7 symbols/min [2025-09-17T07:35:23.858573] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:23.873908] [DEBUG] [MAIN ] FF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:23.877446] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 25945 primary records. [2025-09-17T07:35:23.877781] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-17T07:35:23.899753] [DEBUG] [MAIN ] FFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:23.909168] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-09-17T07:35:23.909053] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16522 primary records. [2025-09-17T07:35:23.909442] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-17T07:35:23.909583] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-17T07:35:23.912277] [INFO ] [MAIN ] Derivative Progress: 758/2172 symbols completed. FF took 1.1s. Estimated remaining: 8m 51s. Rate: 159.9 symbols/min [2025-09-17T07:35:23.912711] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:23.938809] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-09-17T07:35:23.949766] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-17T07:35:23.953730] [DEBUG] [LOCAL ] FFWM: Loaded 36298 existing records from primary storage. [2025-09-17T07:35:23.952388] [INFO ] [MAIN ] Derivative Progress: 759/2172 symbols completed. FFC took 1.1s. Estimated remaining: 8m 50s. Rate: 160.1 symbols/min [2025-09-17T07:35:23.954074] [INFO ] [MAIN ] FFWM: Loaded 36298 primary data records. [2025-09-17T07:35:23.954336] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:24.068000] [DEBUG] [LOCAL ] FGN: Loaded 4076 existing records from primary storage. [2025-09-17T07:35:24.088523] [INFO ] [MAIN ] FGN: Loaded 4076 primary data records. [2025-09-17T07:35:24.094997] [DEBUG] [LOCAL ] FG: Loaded 22162 existing records from primary storage. [2025-09-17T07:35:24.173936] [INFO ] [MAIN ] FG: Loaded 22162 primary data records. [2025-09-17T07:35:24.935896] [DEBUG] [MAIN ] FFWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:24.936934] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 36298 primary records. [2025-09-17T07:35:24.937390] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-17T07:35:24.979254] [DEBUG] [MAIN ] FGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:24.984438] [DEBUG] [MAIN ] FG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:24.985087] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 4076 primary records. [2025-09-17T07:35:24.985162] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-09-17T07:35:24.985713] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 22162 primary records. [2025-09-17T07:35:24.986119] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-17T07:35:24.985868] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-17T07:35:24.986067] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-17T07:35:24.988816] [INFO ] [MAIN ] Derivative Progress: 760/2172 symbols completed. FFWM took 1.1s. Estimated remaining: 8m 50s. Rate: 159.7 symbols/min [2025-09-17T07:35:24.989981] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:25.016626] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-09-17T07:35:25.018172] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-17T07:35:25.021598] [INFO ] [MAIN ] Derivative Progress: 761/2172 symbols completed. FGN took 1.1s. Estimated remaining: 8m 49s. Rate: 159.9 symbols/min [2025-09-17T07:35:25.023084] [INFO ] [MAIN ] FHN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:25.023231] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-09-17T07:35:25.023689] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-17T07:35:25.026340] [INFO ] [MAIN ] Derivative Progress: 762/2172 symbols completed. FG took 1.1s. Estimated remaining: 8m 48s. Rate: 160.1 symbols/min [2025-09-17T07:35:25.026543] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:25.079500] [DEBUG] [LOCAL ] FHI: Loaded 40817 existing records from primary storage. [2025-09-17T07:35:25.079913] [INFO ] [MAIN ] FHI: Loaded 40817 primary data records. [2025-09-17T07:35:25.229809] [DEBUG] [LOCAL ] FI: Loaded 53496 existing records from primary storage. [2025-09-17T07:35:25.230012] [INFO ] [MAIN ] FI: Loaded 53496 primary data records. [2025-09-17T07:35:25.241862] [DEBUG] [LOCAL ] FHN: Loaded 53367 existing records from primary storage. [2025-09-17T07:35:25.289484] [INFO ] [MAIN ] FHN: Loaded 53367 primary data records. [2025-09-17T07:35:26.130623] [DEBUG] [MAIN ] FHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:26.133204] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 40817 primary records. [2025-09-17T07:35:26.133373] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-17T07:35:26.163593] [DEBUG] [MAIN ] FI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:26.165788] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53496 primary records. [2025-09-17T07:35:26.166369] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-17T07:35:26.169662] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-09-17T07:35:26.170142] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-17T07:35:26.183633] [INFO ] [MAIN ] Derivative Progress: 763/2172 symbols completed. FHI took 1.2s. Estimated remaining: 8m 49s. Rate: 159.7 symbols/min [2025-09-17T07:35:26.200915] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-09-17T07:35:26.201481] [DEBUG] [MAIN ] FHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:26.201571] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-17T07:35:26.205877] [INFO ] [MAIN ] Derivative Progress: 764/2172 symbols completed. FI took 1.2s. Estimated remaining: 8m 48s. Rate: 159.9 symbols/min [2025-09-17T07:35:26.206685] [INFO ] [MAIN ] FHN: Generated 1794 derivative records from 53367 primary records. [2025-09-17T07:35:26.207002] [DEBUG] [LOCAL ] FHN: Saving derivative data. [2025-09-17T07:35:26.223504] [DEBUG] [LOCAL ] FHN: Derivative data saved (1794 records). [2025-09-17T07:35:26.223684] [INFO ] [MAIN ] FHN: Successfully saved derivative data. [2025-09-17T07:35:26.226347] [INFO ] [MAIN ] Derivative Progress: 765/2172 symbols completed. FHN took 1.2s. Estimated remaining: 8m 47s. Rate: 160.1 symbols/min [2025-09-17T07:35:26.227229] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:26.227025] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:26.227729] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:26.263551] [DEBUG] [LOCAL ] FICO: Loaded 20354 existing records from primary storage. [2025-09-17T07:35:26.263778] [INFO ] [MAIN ] FICO: Loaded 20354 primary data records. [2025-09-17T07:35:26.390692] [DEBUG] [LOCAL ] FIHL: Loaded 40510 existing records from primary storage. [2025-09-17T07:35:26.401835] [INFO ] [MAIN ] FIHL: Loaded 40510 primary data records. [2025-09-17T07:35:26.683669] [DEBUG] [LOCAL ] FIGS: Loaded 49138 existing records from primary storage. [2025-09-17T07:35:26.701071] [INFO ] [MAIN ] FIGS: Loaded 49138 primary data records. [2025-09-17T07:35:27.219480] [DEBUG] [MAIN ] FICO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:27.220281] [INFO ] [MAIN ] FICO: Generated 1794 derivative records from 20354 primary records. [2025-09-17T07:35:27.220613] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-17T07:35:27.250158] [DEBUG] [MAIN ] FIHL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:27.251826] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 40510 primary records. [2025-09-17T07:35:27.254904] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-17T07:35:27.255344] [DEBUG] [LOCAL ] FICO: Derivative data saved (1794 records). [2025-09-17T07:35:27.255808] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-17T07:35:27.258963] [INFO ] [MAIN ] Derivative Progress: 766/2172 symbols completed. FICO took 1.0s. Estimated remaining: 8m 48s. Rate: 159.7 symbols/min [2025-09-17T07:35:27.278913] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:27.280478] [DEBUG] [MAIN ] FIGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:27.283759] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 49138 primary records. [2025-09-17T07:35:27.284462] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-17T07:35:27.309911] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-09-17T07:35:27.307435] [DEBUG] [LOCAL ] FINS: Loaded 8211 existing records from primary storage. [2025-09-17T07:35:27.307985] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-09-17T07:35:27.310521] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-17T07:35:27.310413] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-17T07:35:27.313092] [INFO ] [MAIN ] Derivative Progress: 767/2172 symbols completed. FIHL took 1.1s. Estimated remaining: 8m 47s. Rate: 159.9 symbols/min [2025-09-17T07:35:27.317275] [INFO ] [MAIN ] FINS: Loaded 8211 primary data records. [2025-09-17T07:35:27.317572] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:27.317633] [INFO ] [MAIN ] Derivative Progress: 768/2172 symbols completed. FIGS took 1.1s. Estimated remaining: 8m 46s. Rate: 160.1 symbols/min [2025-09-17T07:35:27.364530] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:27.663587] [DEBUG] [LOCAL ] FINV: Loaded 44869 existing records from primary storage. [2025-09-17T07:35:27.664081] [INFO ] [MAIN ] FINV: Loaded 44869 primary data records. [2025-09-17T07:35:27.866161] [DEBUG] [LOCAL ] FIS: Loaded 53373 existing records from primary storage. [2025-09-17T07:35:27.900704] [INFO ] [MAIN ] FIS: Loaded 53373 primary data records. [2025-09-17T07:35:28.145836] [DEBUG] [MAIN ] FINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:28.172330] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8211 primary records. [2025-09-17T07:35:28.193229] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-17T07:35:28.417698] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-09-17T07:35:28.419050] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-17T07:35:28.421742] [INFO ] [MAIN ] Derivative Progress: 769/2172 symbols completed. FINS took 1.1s. Estimated remaining: 8m 47s. Rate: 159.7 symbols/min [2025-09-17T07:35:28.422554] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:28.446149] [DEBUG] [MAIN ] FINV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:28.447833] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 44869 primary records. [2025-09-17T07:35:28.448396] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-17T07:35:28.482953] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-09-17T07:35:28.483388] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-17T07:35:28.486296] [INFO ] [MAIN ] Derivative Progress: 770/2172 symbols completed. FINV took 1.2s. Estimated remaining: 8m 46s. Rate: 159.9 symbols/min [2025-09-17T07:35:28.499309] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:28.500094] [DEBUG] [MAIN ] FIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:28.501058] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53373 primary records. [2025-09-17T07:35:28.501322] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-17T07:35:28.531248] [DEBUG] [LOCAL ] FLC: Loaded 5733 existing records from primary storage. [2025-09-17T07:35:28.533797] [INFO ] [MAIN ] FLC: Loaded 5733 primary data records. [2025-09-17T07:35:28.533727] [DEBUG] [LOCAL ] FIX: Loaded 31072 existing records from primary storage. [2025-09-17T07:35:28.554500] [INFO ] [MAIN ] FIX: Loaded 31072 primary data records. [2025-09-17T07:35:28.564526] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-09-17T07:35:28.633274] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-17T07:35:28.722153] [INFO ] [MAIN ] Derivative Progress: 771/2172 symbols completed. FIS took 1.4s. Estimated remaining: 8m 46s. Rate: 160.0 symbols/min [2025-09-17T07:35:28.836813] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:29.176130] [DEBUG] [MAIN ] FLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:29.177494] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5733 primary records. [2025-09-17T07:35:29.177622] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-17T07:35:29.210141] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-09-17T07:35:29.225409] [DEBUG] [MAIN ] FIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:29.225531] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-17T07:35:29.227146] [INFO ] [MAIN ] FIX: Generated 1794 derivative records from 31072 primary records. [2025-09-17T07:35:29.229188] [INFO ] [MAIN ] Derivative Progress: 772/2172 symbols completed. FLC took 0.7s. Estimated remaining: 8m 45s. Rate: 159.9 symbols/min [2025-09-17T07:35:29.227059] [DEBUG] [LOCAL ] FLG: Loaded 53342 existing records from primary storage. [2025-09-17T07:35:29.229423] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-17T07:35:29.229966] [INFO ] [MAIN ] FLG: Loaded 53342 primary data records. [2025-09-17T07:35:29.229830] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:29.311110] [DEBUG] [LOCAL ] FIX: Derivative data saved (1794 records). [2025-09-17T07:35:29.328324] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-17T07:35:29.351383] [INFO ] [MAIN ] Derivative Progress: 773/2172 symbols completed. FIX took 0.9s. Estimated remaining: 8m 45s. Rate: 160.0 symbols/min [2025-09-17T07:35:29.355667] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:29.581068] [DEBUG] [LOCAL ] FLNG: Loaded 34281 existing records from primary storage. [2025-09-17T07:35:29.582103] [INFO ] [MAIN ] FLNG: Loaded 34281 primary data records. [2025-09-17T07:35:29.920104] [DEBUG] [LOCAL ] FLO: Loaded 51831 existing records from primary storage. [2025-09-17T07:35:29.921757] [INFO ] [MAIN ] FLO: Loaded 51831 primary data records. [2025-09-17T07:35:30.072423] [DEBUG] [MAIN ] FLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:30.125843] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53342 primary records. [2025-09-17T07:35:30.125971] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-17T07:35:30.316488] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-09-17T07:35:30.317687] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-17T07:35:30.320952] [INFO ] [MAIN ] Derivative Progress: 774/2172 symbols completed. FLG took 1.5s. Estimated remaining: 8m 45s. Rate: 159.7 symbols/min [2025-09-17T07:35:30.321876] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:30.336527] [DEBUG] [MAIN ] FLNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:30.337575] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 34281 primary records. [2025-09-17T07:35:30.337916] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-17T07:35:30.355773] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-09-17T07:35:30.356059] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-17T07:35:30.358521] [INFO ] [MAIN ] Derivative Progress: 775/2172 symbols completed. FLNG took 1.1s. Estimated remaining: 8m 44s. Rate: 159.9 symbols/min [2025-09-17T07:35:30.359210] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:30.376479] [DEBUG] [MAIN ] FLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:30.377248] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 51831 primary records. [2025-09-17T07:35:30.377382] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-17T07:35:30.406867] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-09-17T07:35:30.407084] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-17T07:35:30.409471] [INFO ] [MAIN ] Derivative Progress: 776/2172 symbols completed. FLO took 1.1s. Estimated remaining: 8m 43s. Rate: 160.1 symbols/min [2025-09-17T07:35:30.409830] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:30.439618] [DEBUG] [LOCAL ] FLR: Loaded 53122 existing records from primary storage. [2025-09-17T07:35:30.440057] [INFO ] [MAIN ] FLR: Loaded 53122 primary data records. [2025-09-17T07:35:30.557870] [DEBUG] [LOCAL ] FLS: Loaded 50083 existing records from primary storage. [2025-09-17T07:35:30.580134] [INFO ] [MAIN ] FLS: Loaded 50083 primary data records. [2025-09-17T07:35:30.880888] [DEBUG] [LOCAL ] FLUT: Loaded 51062 existing records from primary storage. [2025-09-17T07:35:30.908084] [INFO ] [MAIN ] FLUT: Loaded 51062 primary data records. [2025-09-17T07:35:31.389627] [DEBUG] [MAIN ] FLR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:35:31.391389] [INFO ] [MAIN ] FLR: Generated 1793 derivative records from 53122 primary records. [2025-09-17T07:35:31.391503] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-17T07:35:31.410221] [DEBUG] [LOCAL ] FLR: Derivative data saved (1793 records). [2025-09-17T07:35:31.423767] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-17T07:35:31.424067] [DEBUG] [MAIN ] FLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:31.426390] [INFO ] [MAIN ] Derivative Progress: 777/2172 symbols completed. FLR took 1.1s. Estimated remaining: 8m 44s. Rate: 159.7 symbols/min [2025-09-17T07:35:31.427217] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50083 primary records. [2025-09-17T07:35:31.427757] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:31.428113] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-17T07:35:31.446519] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-09-17T07:35:31.446896] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-17T07:35:31.450755] [INFO ] [MAIN ] Derivative Progress: 778/2172 symbols completed. FLS took 1.1s. Estimated remaining: 8m 43s. Rate: 159.9 symbols/min [2025-09-17T07:35:31.472729] [DEBUG] [MAIN ] FLUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:31.473443] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 51062 primary records. [2025-09-17T07:35:31.473554] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-17T07:35:31.493348] [DEBUG] [LOCAL ] FLXR: Loaded 19502 existing records from primary storage. [2025-09-17T07:35:31.494712] [INFO ] [MAIN ] FLXR: Loaded 19502 primary data records. [2025-09-17T07:35:31.528612] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-09-17T07:35:31.571536] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-17T07:35:31.599661] [INFO ] [MAIN ] Derivative Progress: 779/2172 symbols completed. FLUT took 1.2s. Estimated remaining: 8m 42s. Rate: 160.0 symbols/min [2025-09-17T07:35:31.804119] [DEBUG] [MAIN ] FLXR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:31.804830] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 19502 primary records. [2025-09-17T07:35:31.804909] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-17T07:35:31.820378] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-09-17T07:35:31.820457] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-17T07:35:31.822366] [INFO ] [MAIN ] Derivative Progress: 780/2172 symbols completed. FLXR took 0.4s. Estimated remaining: 8m 42s. Rate: 160.1 symbols/min [2025-09-17T07:35:31.823009] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:31.822918] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:31.823163] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:31.833462] [DEBUG] [LOCAL ] FMN: Loaded 6157 existing records from primary storage. [2025-09-17T07:35:31.833620] [INFO ] [MAIN ] FMN: Loaded 6157 primary data records. [2025-09-17T07:35:32.041734] [DEBUG] [LOCAL ] FMS: Loaded 30564 existing records from primary storage. [2025-09-17T07:35:32.184729] [INFO ] [MAIN ] FMS: Loaded 30564 primary data records. [2025-09-17T07:35:32.287447] [DEBUG] [LOCAL ] FMC: Loaded 51840 existing records from primary storage. [2025-09-17T07:35:32.307877] [INFO ] [MAIN ] FMC: Loaded 51840 primary data records. [2025-09-17T07:35:32.823114] [DEBUG] [MAIN ] FMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:32.824368] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 6157 primary records. [2025-09-17T07:35:32.824965] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-17T07:35:32.841348] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-09-17T07:35:32.841555] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-17T07:35:32.844045] [INFO ] [MAIN ] Derivative Progress: 781/2172 symbols completed. FMN took 1.0s. Estimated remaining: 8m 42s. Rate: 159.7 symbols/min [2025-09-17T07:35:32.848503] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:32.865928] [DEBUG] [MAIN ] FMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:32.866587] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30564 primary records. [2025-09-17T07:35:32.866879] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-17T07:35:32.894076] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-09-17T07:35:32.899288] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-17T07:35:32.899571] [DEBUG] [MAIN ] FMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:32.901625] [INFO ] [MAIN ] Derivative Progress: 782/2172 symbols completed. FMS took 1.1s. Estimated remaining: 8m 42s. Rate: 159.9 symbols/min [2025-09-17T07:35:32.902456] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51840 primary records. [2025-09-17T07:35:32.902798] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:32.902871] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-17T07:35:32.932846] [DEBUG] [LOCAL ] FMY: Loaded 1347 existing records from primary storage. [2025-09-17T07:35:32.930790] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-09-17T07:35:32.933051] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-17T07:35:32.933102] [INFO ] [MAIN ] FMY: Loaded 1347 primary data records. [2025-09-17T07:35:32.956934] [INFO ] [MAIN ] Derivative Progress: 783/2172 symbols completed. FMC took 1.1s. Estimated remaining: 8m 41s. Rate: 160.1 symbols/min [2025-09-17T07:35:33.038916] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:33.052315] [DEBUG] [LOCAL ] FMX: Loaded 40671 existing records from primary storage. [2025-09-17T07:35:33.063464] [INFO ] [MAIN ] FMX: Loaded 40671 primary data records. [2025-09-17T07:35:33.566632] [DEBUG] [LOCAL ] FN: Loaded 39796 existing records from primary storage. [2025-09-17T07:35:33.568056] [INFO ] [MAIN ] FN: Loaded 39796 primary data records. [2025-09-17T07:35:33.927866] [DEBUG] [MAIN ] FMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:33.929373] [INFO ] [MAIN ] FMY: Generated 1794 derivative records from 1347 primary records. [2025-09-17T07:35:33.929759] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-17T07:35:33.946922] [DEBUG] [LOCAL ] FMY: Derivative data saved (1794 records). [2025-09-17T07:35:33.947392] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-17T07:35:33.961885] [INFO ] [MAIN ] Derivative Progress: 784/2172 symbols completed. FMY took 1.1s. Estimated remaining: 8m 41s. Rate: 159.8 symbols/min [2025-09-17T07:35:33.962227] [DEBUG] [MAIN ] FMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:33.963529] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:33.964204] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40671 primary records. [2025-09-17T07:35:33.964429] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-17T07:35:33.981261] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-09-17T07:35:33.981503] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-17T07:35:33.984041] [INFO ] [MAIN ] Derivative Progress: 785/2172 symbols completed. FMX took 1.1s. Estimated remaining: 8m 40s. Rate: 159.9 symbols/min [2025-09-17T07:35:33.984843] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:34.004074] [DEBUG] [MAIN ] FN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:34.005177] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 39796 primary records. [2025-09-17T07:35:34.005414] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-17T07:35:34.037123] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-09-17T07:35:34.037277] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-17T07:35:34.039425] [INFO ] [MAIN ] Derivative Progress: 786/2172 symbols completed. FN took 1.0s. Estimated remaining: 8m 39s. Rate: 160.1 symbols/min [2025-09-17T07:35:34.039983] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:34.070366] [DEBUG] [LOCAL ] FNB: Loaded 52451 existing records from primary storage. [2025-09-17T07:35:34.070607] [INFO ] [MAIN ] FNB: Loaded 52451 primary data records. [2025-09-17T07:35:34.188571] [DEBUG] [LOCAL ] FND: Loaded 52178 existing records from primary storage. [2025-09-17T07:35:34.194626] [INFO ] [MAIN ] FND: Loaded 52178 primary data records. [2025-09-17T07:35:34.529883] [DEBUG] [LOCAL ] FNF: Loaded 49340 existing records from primary storage. [2025-09-17T07:35:34.588976] [INFO ] [MAIN ] FNF: Loaded 49340 primary data records. [2025-09-17T07:35:35.009659] [DEBUG] [MAIN ] FNB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:35.012344] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52451 primary records. [2025-09-17T07:35:35.013054] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-17T07:35:35.027242] [DEBUG] [MAIN ] FND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:35.041369] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52178 primary records. [2025-09-17T07:35:35.043294] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-09-17T07:35:35.044040] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-17T07:35:35.044248] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-17T07:35:35.046996] [INFO ] [MAIN ] Derivative Progress: 787/2172 symbols completed. FNB took 1.1s. Estimated remaining: 8m 40s. Rate: 159.8 symbols/min [2025-09-17T07:35:35.058774] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:35.064183] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-09-17T07:35:35.064513] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-17T07:35:35.066650] [INFO ] [MAIN ] Derivative Progress: 788/2172 symbols completed. FND took 1.1s. Estimated remaining: 8m 39s. Rate: 160.0 symbols/min [2025-09-17T07:35:35.066973] [INFO ] [MAIN ] FOA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:35.083024] [DEBUG] [MAIN ] FNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:35.083731] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 49340 primary records. [2025-09-17T07:35:35.083856] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-17T07:35:35.109099] [DEBUG] [LOCAL ] FOA: Loaded 13204 existing records from primary storage. [2025-09-17T07:35:35.111234] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-09-17T07:35:35.111346] [INFO ] [MAIN ] FOA: Loaded 13204 primary data records. [2025-09-17T07:35:35.122762] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-17T07:35:35.183217] [INFO ] [MAIN ] Derivative Progress: 789/2172 symbols completed. FNF took 1.1s. Estimated remaining: 8m 38s. Rate: 160.1 symbols/min [2025-09-17T07:35:35.199613] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:35.432571] [DEBUG] [LOCAL ] FNV: Loaded 46551 existing records from primary storage. [2025-09-17T07:35:35.433854] [DEBUG] [LOCAL ] FOF: Loaded 8073 existing records from primary storage. [2025-09-17T07:35:35.434157] [INFO ] [MAIN ] FNV: Loaded 46551 primary data records. [2025-09-17T07:35:35.434087] [INFO ] [MAIN ] FOF: Loaded 8073 primary data records. [2025-09-17T07:35:36.086874] [DEBUG] [MAIN ] FOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:36.088494] [INFO ] [MAIN ] FOA: Generated 1794 derivative records from 13204 primary records. [2025-09-17T07:35:36.088933] [DEBUG] [LOCAL ] FOA: Saving derivative data. [2025-09-17T07:35:36.106454] [DEBUG] [LOCAL ] FOA: Derivative data saved (1794 records). [2025-09-17T07:35:36.107036] [INFO ] [MAIN ] FOA: Successfully saved derivative data. [2025-09-17T07:35:36.109286] [INFO ] [MAIN ] Derivative Progress: 790/2172 symbols completed. FOA took 1.0s. Estimated remaining: 8m 39s. Rate: 159.8 symbols/min [2025-09-17T07:35:36.110068] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:36.125580] [DEBUG] [MAIN ] FOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:36.127905] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8073 primary records. [2025-09-17T07:35:36.128759] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-17T07:35:36.154247] [DEBUG] [MAIN ] FNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:36.155673] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46551 primary records. [2025-09-17T07:35:36.160971] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-17T07:35:36.184542] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-09-17T07:35:36.185143] [DEBUG] [LOCAL ] FOR: Loaded 20318 existing records from primary storage. [2025-09-17T07:35:36.185261] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-17T07:35:36.185809] [INFO ] [MAIN ] FOR: Loaded 20318 primary data records. [2025-09-17T07:35:36.188445] [INFO ] [MAIN ] Derivative Progress: 791/2172 symbols completed. FOF took 1.0s. Estimated remaining: 8m 38s. Rate: 160.0 symbols/min [2025-09-17T07:35:36.188717] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:36.188935] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-09-17T07:35:36.224718] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-17T07:35:36.266120] [INFO ] [MAIN ] Derivative Progress: 792/2172 symbols completed. FNV took 1.2s. Estimated remaining: 8m 37s. Rate: 160.1 symbols/min [2025-09-17T07:35:36.289782] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:36.495676] [DEBUG] [LOCAL ] FPF: Loaded 17657 existing records from primary storage. [2025-09-17T07:35:36.495879] [INFO ] [MAIN ] FPF: Loaded 17657 primary data records. [2025-09-17T07:35:36.674320] [DEBUG] [LOCAL ] FOUR: Loaded 49544 existing records from primary storage. [2025-09-17T07:35:36.714768] [INFO ] [MAIN ] FOUR: Loaded 49544 primary data records. [2025-09-17T07:35:37.145819] [DEBUG] [MAIN ] FOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:37.147259] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 20318 primary records. [2025-09-17T07:35:37.147804] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-17T07:35:37.166663] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-09-17T07:35:37.168134] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-17T07:35:37.170556] [INFO ] [MAIN ] Derivative Progress: 793/2172 symbols completed. FOR took 1.1s. Estimated remaining: 8m 38s. Rate: 159.8 symbols/min [2025-09-17T07:35:37.184100] [DEBUG] [MAIN ] FPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:37.184897] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 17657 primary records. [2025-09-17T07:35:37.185111] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-17T07:35:37.202469] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-09-17T07:35:37.202667] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-17T07:35:37.205092] [INFO ] [MAIN ] Derivative Progress: 794/2172 symbols completed. FPF took 0.9s. Estimated remaining: 8m 37s. Rate: 160.0 symbols/min [2025-09-17T07:35:37.218408] [DEBUG] [MAIN ] FOUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:37.219017] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49544 primary records. [2025-09-17T07:35:37.219090] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-17T07:35:37.234369] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-09-17T07:35:37.234439] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-17T07:35:37.236769] [INFO ] [MAIN ] Derivative Progress: 795/2172 symbols completed. FOUR took 1.0s. Estimated remaining: 8m 36s. Rate: 160.2 symbols/min [2025-09-17T07:35:37.237177] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:37.237410] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:37.237365] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:37.259046] [DEBUG] [LOCAL ] FPH: Loaded 19790 existing records from primary storage. [2025-09-17T07:35:37.259267] [INFO ] [MAIN ] FPH: Loaded 19790 primary data records. [2025-09-17T07:35:37.393769] [DEBUG] [LOCAL ] FPI: Loaded 31234 existing records from primary storage. [2025-09-17T07:35:37.415339] [INFO ] [MAIN ] FPI: Loaded 31234 primary data records. [2025-09-17T07:35:37.525899] [DEBUG] [LOCAL ] FR: Loaded 46885 existing records from primary storage. [2025-09-17T07:35:37.565599] [INFO ] [MAIN ] FR: Loaded 46885 primary data records. [2025-09-17T07:35:38.266425] [DEBUG] [MAIN ] FPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:38.267528] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19790 primary records. [2025-09-17T07:35:38.268672] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-17T07:35:38.288231] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-09-17T07:35:38.288835] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-17T07:35:38.291262] [INFO ] [MAIN ] Derivative Progress: 796/2172 symbols completed. FPH took 1.1s. Estimated remaining: 8m 36s. Rate: 159.8 symbols/min [2025-09-17T07:35:38.291743] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:38.305920] [DEBUG] [MAIN ] FPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:38.307267] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31234 primary records. [2025-09-17T07:35:38.307728] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-17T07:35:38.348742] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-09-17T07:35:38.346959] [DEBUG] [MAIN ] FR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:38.354268] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-17T07:35:38.356857] [INFO ] [MAIN ] Derivative Progress: 797/2172 symbols completed. FPI took 1.1s. Estimated remaining: 8m 36s. Rate: 160.0 symbols/min [2025-09-17T07:35:38.359207] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:38.359608] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46885 primary records. [2025-09-17T07:35:38.360208] [DEBUG] [LOCAL ] FRA: Loaded 14810 existing records from primary storage. [2025-09-17T07:35:38.361094] [INFO ] [MAIN ] FRA: Loaded 14810 primary data records. [2025-09-17T07:35:38.360997] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-17T07:35:38.473785] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-09-17T07:35:38.497999] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-17T07:35:38.511212] [INFO ] [MAIN ] Derivative Progress: 798/2172 symbols completed. FR took 1.3s. Estimated remaining: 8m 35s. Rate: 160.1 symbols/min [2025-09-17T07:35:38.522710] [DEBUG] [LOCAL ] FRGE: Loaded 19255 existing records from primary storage. [2025-09-17T07:35:38.577994] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:38.581503] [INFO ] [MAIN ] FRGE: Loaded 19255 primary data records. [2025-09-17T07:35:39.045813] [DEBUG] [MAIN ] FRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:39.061869] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14810 primary records. [2025-09-17T07:35:39.063438] [DEBUG] [LOCAL ] FRO: Loaded 51942 existing records from primary storage. [2025-09-17T07:35:39.063633] [INFO ] [MAIN ] FRO: Loaded 51942 primary data records. [2025-09-17T07:35:39.063727] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-17T07:35:39.203186] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-09-17T07:35:39.237548] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-17T07:35:39.265463] [INFO ] [MAIN ] Derivative Progress: 799/2172 symbols completed. FRA took 1.0s. Estimated remaining: 8m 35s. Rate: 159.9 symbols/min [2025-09-17T07:35:39.270471] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:39.403678] [DEBUG] [MAIN ] FRGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:39.404892] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 19255 primary records. [2025-09-17T07:35:39.405554] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-17T07:35:39.423496] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-09-17T07:35:39.423728] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-17T07:35:39.426327] [INFO ] [MAIN ] Derivative Progress: 800/2172 symbols completed. FRGE took 1.1s. Estimated remaining: 8m 34s. Rate: 160.0 symbols/min [2025-09-17T07:35:39.427279] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:39.458712] [DEBUG] [MAIN ] FRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:39.459487] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51942 primary records. [2025-09-17T07:35:39.472097] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-17T07:35:39.474298] [DEBUG] [LOCAL ] FRT: Loaded 42398 existing records from primary storage. [2025-09-17T07:35:39.474869] [INFO ] [MAIN ] FRT: Loaded 42398 primary data records. [2025-09-17T07:35:39.496320] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-09-17T07:35:39.536883] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-17T07:35:39.605586] [INFO ] [MAIN ] Derivative Progress: 801/2172 symbols completed. FRO took 1.0s. Estimated remaining: 8m 34s. Rate: 160.1 symbols/min [2025-09-17T07:35:39.618269] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:39.618038] [DEBUG] [LOCAL ] FSCO: Loaded 36874 existing records from primary storage. [2025-09-17T07:35:39.629474] [INFO ] [MAIN ] FSCO: Loaded 36874 primary data records. [2025-09-17T07:35:40.169778] [DEBUG] [LOCAL ] FSK: Loaded 49332 existing records from primary storage. [2025-09-17T07:35:40.171440] [INFO ] [MAIN ] FSK: Loaded 49332 primary data records. [2025-09-17T07:35:40.478186] [DEBUG] [MAIN ] FRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:40.494181] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 42398 primary records. [2025-09-17T07:35:40.494429] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-17T07:35:40.514495] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-09-17T07:35:40.516218] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-17T07:35:40.518708] [INFO ] [MAIN ] Derivative Progress: 802/2172 symbols completed. FRT took 1.2s. Estimated remaining: 8m 34s. Rate: 159.9 symbols/min [2025-09-17T07:35:40.519135] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:40.534633] [DEBUG] [MAIN ] FSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:40.535719] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 36874 primary records. [2025-09-17T07:35:40.536140] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-17T07:35:40.554910] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-09-17T07:35:40.556531] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-17T07:35:40.559297] [INFO ] [MAIN ] Derivative Progress: 803/2172 symbols completed. FSCO took 1.1s. Estimated remaining: 8m 33s. Rate: 160.0 symbols/min [2025-09-17T07:35:40.559819] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:40.573194] [DEBUG] [MAIN ] FSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:40.574091] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49332 primary records. [2025-09-17T07:35:40.574444] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-17T07:35:40.606745] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-09-17T07:35:40.606936] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-17T07:35:40.623026] [INFO ] [MAIN ] Derivative Progress: 804/2172 symbols completed. FSK took 1.0s. Estimated remaining: 8m 32s. Rate: 160.2 symbols/min [2025-09-17T07:35:40.623460] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:40.625070] [DEBUG] [LOCAL ] FSLY: Loaded 51270 existing records from primary storage. [2025-09-17T07:35:40.625426] [INFO ] [MAIN ] FSLY: Loaded 51270 primary data records. [2025-09-17T07:35:40.955919] [DEBUG] [LOCAL ] FSM: Loaded 53267 existing records from primary storage. [2025-09-17T07:35:40.956535] [INFO ] [MAIN ] FSM: Loaded 53267 primary data records. [2025-09-17T07:35:40.988854] [DEBUG] [LOCAL ] FSS: Loaded 35076 existing records from primary storage. [2025-09-17T07:35:41.013065] [INFO ] [MAIN ] FSS: Loaded 35076 primary data records. [2025-09-17T07:35:41.579762] [DEBUG] [MAIN ] FSLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:41.581083] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51270 primary records. [2025-09-17T07:35:41.581709] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-17T07:35:41.601312] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-09-17T07:35:41.601823] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-17T07:35:41.604259] [INFO ] [MAIN ] Derivative Progress: 805/2172 symbols completed. FSLY took 1.1s. Estimated remaining: 8m 33s. Rate: 159.9 symbols/min [2025-09-17T07:35:41.612387] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:41.617760] [DEBUG] [MAIN ] FSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:41.618587] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53267 primary records. [2025-09-17T07:35:41.618845] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-17T07:35:41.649483] [DEBUG] [LOCAL ] FT: Loaded 6306 existing records from primary storage. [2025-09-17T07:35:41.649950] [DEBUG] [MAIN ] FSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:41.653121] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 35076 primary records. [2025-09-17T07:35:41.652098] [INFO ] [MAIN ] FT: Loaded 6306 primary data records. [2025-09-17T07:35:41.653965] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-09-17T07:35:41.664991] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-17T07:35:41.689443] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-17T07:35:41.724880] [INFO ] [MAIN ] Derivative Progress: 806/2172 symbols completed. FSM took 1.2s. Estimated remaining: 8m 32s. Rate: 160.0 symbols/min [2025-09-17T07:35:41.778467] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:41.780316] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-09-17T07:35:41.824199] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-17T07:35:41.895455] [INFO ] [MAIN ] Derivative Progress: 807/2172 symbols completed. FSS took 1.3s. Estimated remaining: 8m 31s. Rate: 160.1 symbols/min [2025-09-17T07:35:42.013788] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:42.019381] [DEBUG] [LOCAL ] FTHY: Loaded 11685 existing records from primary storage. [2025-09-17T07:35:42.019488] [INFO ] [MAIN ] FTHY: Loaded 11685 primary data records. [2025-09-17T07:35:42.374569] [DEBUG] [LOCAL ] FTI: Loaded 53311 existing records from primary storage. [2025-09-17T07:35:42.378891] [INFO ] [MAIN ] FTI: Loaded 53311 primary data records. [2025-09-17T07:35:42.504975] [DEBUG] [MAIN ] FT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:42.511884] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6306 primary records. [2025-09-17T07:35:42.548542] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-17T07:35:42.740254] [DEBUG] [MAIN ] FTHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:42.740070] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-09-17T07:35:42.741164] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 11685 primary records. [2025-09-17T07:35:42.741281] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-17T07:35:42.743485] [INFO ] [MAIN ] Derivative Progress: 808/2172 symbols completed. FT took 1.1s. Estimated remaining: 8m 32s. Rate: 159.9 symbols/min [2025-09-17T07:35:42.743635] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-17T07:35:42.760678] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-09-17T07:35:42.760957] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-17T07:35:42.763543] [INFO ] [MAIN ] Derivative Progress: 809/2172 symbols completed. FTHY took 1.0s. Estimated remaining: 8m 31s. Rate: 160.1 symbols/min [2025-09-17T07:35:42.779094] [DEBUG] [MAIN ] FTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:42.779739] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53311 primary records. [2025-09-17T07:35:42.779824] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-17T07:35:42.795336] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-09-17T07:35:42.795440] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-17T07:35:42.797675] [INFO ] [MAIN ] Derivative Progress: 810/2172 symbols completed. FTI took 0.8s. Estimated remaining: 8m 30s. Rate: 160.2 symbols/min [2025-09-17T07:35:42.798224] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:42.798384] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:42.798431] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:42.869863] [DEBUG] [LOCAL ] FTS: Loaded 42229 existing records from primary storage. [2025-09-17T07:35:42.871962] [INFO ] [MAIN ] FTS: Loaded 42229 primary data records. [2025-09-17T07:35:42.872470] [DEBUG] [LOCAL ] FTK: Loaded 31793 existing records from primary storage. [2025-09-17T07:35:42.930731] [INFO ] [MAIN ] FTK: Loaded 31793 primary data records. [2025-09-17T07:35:42.970634] [DEBUG] [LOCAL ] FTV: Loaded 52888 existing records from primary storage. [2025-09-17T07:35:42.975941] [INFO ] [MAIN ] FTV: Loaded 52888 primary data records. [2025-09-17T07:35:43.863003] [DEBUG] [MAIN ] FTV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:43.856969] [DEBUG] [MAIN ] FTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:43.863884] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42229 primary records. [2025-09-17T07:35:43.876690] [DEBUG] [MAIN ] FTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:43.864452] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 52888 primary records. [2025-09-17T07:35:43.876453] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-17T07:35:43.877263] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 31793 primary records. [2025-09-17T07:35:43.877358] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-17T07:35:43.878331] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-17T07:35:43.921712] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-09-17T07:35:43.922967] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-09-17T07:35:43.923734] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-17T07:35:43.924949] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-09-17T07:35:43.925033] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-17T07:35:43.925393] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-17T07:35:43.928060] [INFO ] [MAIN ] Derivative Progress: 811/2172 symbols completed. FTV took 1.1s. Estimated remaining: 8m 31s. Rate: 159.8 symbols/min [2025-09-17T07:35:43.932446] [INFO ] [MAIN ] Derivative Progress: 812/2172 symbols completed. FTS took 1.1s. Estimated remaining: 8m 30s. Rate: 160.0 symbols/min [2025-09-17T07:35:43.932557] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:43.933136] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:43.933057] [INFO ] [MAIN ] Derivative Progress: 813/2172 symbols completed. FTK took 1.1s. Estimated remaining: 8m 29s. Rate: 160.2 symbols/min [2025-09-17T07:35:43.933812] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:43.937906] [DEBUG] [LOCAL ] FTWO: Loaded 1789 existing records from primary storage. [2025-09-17T07:35:43.938070] [INFO ] [MAIN ] FTWO: Loaded 1789 primary data records. [2025-09-17T07:35:44.260416] [DEBUG] [LOCAL ] FUL: Loaded 32927 existing records from primary storage. [2025-09-17T07:35:44.262332] [INFO ] [MAIN ] FUL: Loaded 32927 primary data records. [2025-09-17T07:35:44.314764] [DEBUG] [LOCAL ] FUBO: Loaded 53700 existing records from primary storage. [2025-09-17T07:35:44.347835] [INFO ] [MAIN ] FUBO: Loaded 53700 primary data records. [2025-09-17T07:35:44.907294] [DEBUG] [MAIN ] FTWO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:35:44.908701] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1789 primary records. [2025-09-17T07:35:44.909740] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-17T07:35:44.926192] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-09-17T07:35:44.927781] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-17T07:35:44.930459] [INFO ] [MAIN ] Derivative Progress: 814/2172 symbols completed. FTWO took 1.0s. Estimated remaining: 8m 30s. Rate: 159.9 symbols/min [2025-09-17T07:35:44.931180] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:44.952471] [DEBUG] [MAIN ] FUL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:44.953933] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 32927 primary records. [2025-09-17T07:35:44.954178] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-17T07:35:44.981280] [DEBUG] [MAIN ] FUBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:44.984884] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53700 primary records. [2025-09-17T07:35:44.985302] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-17T07:35:45.000008] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-09-17T07:35:45.016916] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-17T07:35:45.016836] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-09-17T07:35:45.018934] [INFO ] [MAIN ] Derivative Progress: 815/2172 symbols completed. FUL took 1.1s. Estimated remaining: 8m 29s. Rate: 160.1 symbols/min [2025-09-17T07:35:45.019128] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-17T07:35:45.021957] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:45.022024] [INFO ] [MAIN ] Derivative Progress: 816/2172 symbols completed. FUBO took 1.1s. Estimated remaining: 8m 28s. Rate: 160.3 symbols/min [2025-09-17T07:35:45.022687] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:45.041770] [DEBUG] [LOCAL ] FUN: Loaded 51532 existing records from primary storage. [2025-09-17T07:35:45.041961] [INFO ] [MAIN ] FUN: Loaded 51532 primary data records. [2025-09-17T07:35:45.170894] [DEBUG] [LOCAL ] FVR: Loaded 21906 existing records from primary storage. [2025-09-17T07:35:45.176671] [INFO ] [MAIN ] FVR: Loaded 21906 primary data records. [2025-09-17T07:35:45.482190] [DEBUG] [LOCAL ] FVRR: Loaded 40162 existing records from primary storage. [2025-09-17T07:35:45.482463] [INFO ] [MAIN ] FVRR: Loaded 40162 primary data records. [2025-09-17T07:35:46.043836] [DEBUG] [MAIN ] FUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:46.045708] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51532 primary records. [2025-09-17T07:35:46.049669] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-17T07:35:46.085348] [DEBUG] [MAIN ] FVR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:35:46.088586] [INFO ] [MAIN ] FVR: Generated 1793 derivative records from 21906 primary records. [2025-09-17T07:35:46.090099] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-17T07:35:46.105565] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-09-17T07:35:46.111168] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-17T07:35:46.114906] [INFO ] [MAIN ] Derivative Progress: 817/2172 symbols completed. FUN took 1.2s. Estimated remaining: 8m 29s. Rate: 159.9 symbols/min [2025-09-17T07:35:46.117869] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:46.119010] [DEBUG] [LOCAL ] FVR: Derivative data saved (1793 records). [2025-09-17T07:35:46.119197] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-17T07:35:46.127899] [INFO ] [MAIN ] Derivative Progress: 818/2172 symbols completed. FVR took 1.1s. Estimated remaining: 8m 28s. Rate: 160.1 symbols/min [2025-09-17T07:35:46.141807] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:46.142373] [DEBUG] [MAIN ] FVRR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:46.145013] [DEBUG] [LOCAL ] FXED: Loaded 1193 existing records from primary storage. [2025-09-17T07:35:46.145277] [INFO ] [MAIN ] FXED: Loaded 1193 primary data records. [2025-09-17T07:35:46.145864] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40162 primary records. [2025-09-17T07:35:46.178448] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-17T07:35:46.343907] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-09-17T07:35:46.440148] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-17T07:35:46.467924] [INFO ] [MAIN ] Derivative Progress: 819/2172 symbols completed. FVRR took 1.4s. Estimated remaining: 8m 27s. Rate: 160.1 symbols/min [2025-09-17T07:35:46.468463] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:46.490273] [DEBUG] [LOCAL ] G: Loaded 49760 existing records from primary storage. [2025-09-17T07:35:46.490533] [INFO ] [MAIN ] G: Loaded 49760 primary data records. [2025-09-17T07:35:46.672572] [DEBUG] [LOCAL ] GAB: Loaded 27670 existing records from primary storage. [2025-09-17T07:35:46.689616] [INFO ] [MAIN ] GAB: Loaded 27670 primary data records. [2025-09-17T07:35:46.865279] [DEBUG] [MAIN ] FXED: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:35:46.892239] [INFO ] [MAIN ] FXED: Generated 1793 derivative records from 1193 primary records. [2025-09-17T07:35:46.904694] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-17T07:35:47.136763] [DEBUG] [LOCAL ] FXED: Derivative data saved (1793 records). [2025-09-17T07:35:47.137235] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-17T07:35:47.139507] [INFO ] [MAIN ] Derivative Progress: 820/2172 symbols completed. FXED took 1.0s. Estimated remaining: 8m 27s. Rate: 159.9 symbols/min [2025-09-17T07:35:47.140165] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:47.161691] [DEBUG] [LOCAL ] GAM: Loaded 4400 existing records from primary storage. [2025-09-17T07:35:47.162376] [DEBUG] [MAIN ] G: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:47.162664] [INFO ] [MAIN ] GAM: Loaded 4400 primary data records. [2025-09-17T07:35:47.163392] [INFO ] [MAIN ] G: Generated 1794 derivative records from 49760 primary records. [2025-09-17T07:35:47.163693] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-17T07:35:47.332388] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-09-17T07:35:47.365042] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-17T07:35:47.550047] [INFO ] [MAIN ] Derivative Progress: 821/2172 symbols completed. G took 1.4s. Estimated remaining: 8m 27s. Rate: 159.9 symbols/min [2025-09-17T07:35:47.550501] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:47.570620] [DEBUG] [MAIN ] GAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:47.572876] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27670 primary records. [2025-09-17T07:35:47.573381] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-17T07:35:47.590331] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-09-17T07:35:47.590537] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-17T07:35:47.593695] [INFO ] [MAIN ] Derivative Progress: 822/2172 symbols completed. GAB took 1.1s. Estimated remaining: 8m 26s. Rate: 160.1 symbols/min [2025-09-17T07:35:47.595419] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:47.620289] [DEBUG] [MAIN ] GAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:47.634637] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 4400 primary records. [2025-09-17T07:35:47.634999] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-17T07:35:47.655343] [DEBUG] [LOCAL ] GATX: Loaded 17895 existing records from primary storage. [2025-09-17T07:35:47.656723] [INFO ] [MAIN ] GATX: Loaded 17895 primary data records. [2025-09-17T07:35:47.665807] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-09-17T07:35:47.743439] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-17T07:35:47.768988] [INFO ] [MAIN ] Derivative Progress: 823/2172 symbols completed. GAM took 0.6s. Estimated remaining: 8m 25s. Rate: 160.2 symbols/min [2025-09-17T07:35:47.769863] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-17T07:35:47.770084] [INFO ] [MAIN ] GAP: Loaded 53655 primary data records. [2025-09-17T07:35:48.318857] [DEBUG] [MAIN ] GAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:48.319149] [DEBUG] [MAIN ] GATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:48.319945] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53655 primary records. [2025-09-17T07:35:48.320121] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-17T07:35:48.320792] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 17895 primary records. [2025-09-17T07:35:48.321533] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-17T07:35:48.350425] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-09-17T07:35:48.350950] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-17T07:35:48.355025] [INFO ] [MAIN ] Derivative Progress: 824/2172 symbols completed. GAP took 0.8s. Estimated remaining: 8m 25s. Rate: 160.1 symbols/min [2025-09-17T07:35:48.355901] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-09-17T07:35:48.356001] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-17T07:35:48.357921] [INFO ] [MAIN ] Derivative Progress: 825/2172 symbols completed. GATX took 0.8s. Estimated remaining: 8m 24s. Rate: 160.3 symbols/min [2025-09-17T07:35:48.358454] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:48.358535] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:48.358708] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:48.404136] [DEBUG] [LOCAL ] GBX: Loaded 29493 existing records from primary storage. [2025-09-17T07:35:48.404306] [INFO ] [MAIN ] GBX: Loaded 29493 primary data records. [2025-09-17T07:35:48.529363] [DEBUG] [LOCAL ] GBCI: Loaded 40052 existing records from primary storage. [2025-09-17T07:35:48.529866] [INFO ] [MAIN ] GBCI: Loaded 40052 primary data records. [2025-09-17T07:35:48.530411] [DEBUG] [LOCAL ] GBTG: Loaded 40681 existing records from primary storage. [2025-09-17T07:35:48.553786] [INFO ] [MAIN ] GBTG: Loaded 40681 primary data records. [2025-09-17T07:35:49.335813] [DEBUG] [MAIN ] GBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:49.336802] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29493 primary records. [2025-09-17T07:35:49.337228] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-17T07:35:49.390107] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-09-17T07:35:49.390481] [DEBUG] [MAIN ] GBTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:49.392043] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-17T07:35:49.392551] [DEBUG] [MAIN ] GBCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:49.394742] [INFO ] [MAIN ] Derivative Progress: 826/2172 symbols completed. GBX took 1.0s. Estimated remaining: 8m 25s. Rate: 159.9 symbols/min [2025-09-17T07:35:49.395789] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40052 primary records. [2025-09-17T07:35:49.396058] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:49.396996] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40681 primary records. [2025-09-17T07:35:49.396241] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-17T07:35:49.397286] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-17T07:35:49.433698] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-09-17T07:35:49.435272] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-09-17T07:35:49.434893] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-17T07:35:49.438404] [INFO ] [MAIN ] Derivative Progress: 827/2172 symbols completed. GBCI took 1.1s. Estimated remaining: 8m 24s. Rate: 160.1 symbols/min [2025-09-17T07:35:49.438772] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:49.438872] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-17T07:35:49.442617] [INFO ] [MAIN ] Derivative Progress: 828/2172 symbols completed. GBTG took 1.1s. Estimated remaining: 8m 23s. Rate: 160.3 symbols/min [2025-09-17T07:35:49.443444] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:49.493932] [DEBUG] [LOCAL ] GCI: Loaded 44240 existing records from primary storage. [2025-09-17T07:35:49.494333] [INFO ] [MAIN ] GCI: Loaded 44240 primary data records. [2025-09-17T07:35:49.609720] [DEBUG] [LOCAL ] GCO: Loaded 25949 existing records from primary storage. [2025-09-17T07:35:49.596617] [DEBUG] [LOCAL ] GCTS: Loaded 19249 existing records from primary storage. [2025-09-17T07:35:49.613038] [INFO ] [MAIN ] GCO: Loaded 25949 primary data records. [2025-09-17T07:35:49.618592] [INFO ] [MAIN ] GCTS: Loaded 19249 primary data records. [2025-09-17T07:35:50.449555] [DEBUG] [MAIN ] GCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:50.450502] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 44240 primary records. [2025-09-17T07:35:50.450773] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-17T07:35:50.472971] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-09-17T07:35:50.480961] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-17T07:35:50.498080] [DEBUG] [MAIN ] GCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:50.500101] [INFO ] [MAIN ] Derivative Progress: 829/2172 symbols completed. GCI took 1.1s. Estimated remaining: 8m 24s. Rate: 159.9 symbols/min [2025-09-17T07:35:50.500596] [DEBUG] [MAIN ] GCTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:50.501294] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 19249 primary records. [2025-09-17T07:35:50.501460] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:50.502046] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 25949 primary records. [2025-09-17T07:35:50.502534] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-17T07:35:50.502688] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-17T07:35:50.540585] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-09-17T07:35:50.535624] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-09-17T07:35:50.540716] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-17T07:35:50.541198] [DEBUG] [LOCAL ] GCV: Loaded 7027 existing records from primary storage. [2025-09-17T07:35:50.543876] [INFO ] [MAIN ] Derivative Progress: 830/2172 symbols completed. GCTS took 1.1s. Estimated remaining: 8m 23s. Rate: 160.1 symbols/min [2025-09-17T07:35:50.541302] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-17T07:35:50.546757] [INFO ] [MAIN ] Derivative Progress: 831/2172 symbols completed. GCO took 1.1s. Estimated remaining: 8m 22s. Rate: 160.3 symbols/min [2025-09-17T07:35:50.544025] [INFO ] [MAIN ] GCV: Loaded 7027 primary data records. [2025-09-17T07:35:50.547125] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:50.546688] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:50.886200] [DEBUG] [LOCAL ] GDDY: Loaded 49859 existing records from primary storage. [2025-09-17T07:35:50.886566] [INFO ] [MAIN ] GDDY: Loaded 49859 primary data records. [2025-09-17T07:35:50.986950] [DEBUG] [MAIN ] GCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:50.980265] [DEBUG] [LOCAL ] GD: Loaded 47545 existing records from primary storage. [2025-09-17T07:35:51.010385] [INFO ] [MAIN ] GD: Loaded 47545 primary data records. [2025-09-17T07:35:51.011091] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7027 primary records. [2025-09-17T07:35:51.014555] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-17T07:35:51.403769] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-09-17T07:35:51.567398] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-17T07:35:51.569778] [INFO ] [MAIN ] Derivative Progress: 832/2172 symbols completed. GCV took 1.1s. Estimated remaining: 8m 23s. Rate: 160.0 symbols/min [2025-09-17T07:35:51.570821] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:51.580310] [DEBUG] [LOCAL ] GDIV: Loaded 3794 existing records from primary storage. [2025-09-17T07:35:51.580677] [INFO ] [MAIN ] GDIV: Loaded 3794 primary data records. [2025-09-17T07:35:51.776287] [DEBUG] [MAIN ] GDDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:51.865323] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49859 primary records. [2025-09-17T07:35:51.894397] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-17T07:35:51.907125] [DEBUG] [MAIN ] GD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:51.908894] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 47545 primary records. [2025-09-17T07:35:51.921741] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-17T07:35:51.926478] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-09-17T07:35:51.937687] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-17T07:35:51.939835] [INFO ] [MAIN ] Derivative Progress: 833/2172 symbols completed. GDDY took 1.4s. Estimated remaining: 8m 22s. Rate: 160.0 symbols/min [2025-09-17T07:35:51.940120] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:51.948181] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-09-17T07:35:51.948586] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-17T07:35:51.951764] [INFO ] [MAIN ] Derivative Progress: 834/2172 symbols completed. GD took 1.4s. Estimated remaining: 8m 21s. Rate: 160.2 symbols/min [2025-09-17T07:35:51.952267] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:51.969137] [DEBUG] [MAIN ] GDIV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:35:51.969895] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3794 primary records. [2025-09-17T07:35:51.970414] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-17T07:35:51.998901] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-09-17T07:35:51.999153] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-17T07:35:52.001116] [INFO ] [MAIN ] Derivative Progress: 835/2172 symbols completed. GDIV took 0.4s. Estimated remaining: 8m 20s. Rate: 160.3 symbols/min [2025-09-17T07:35:52.001498] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:52.010469] [DEBUG] [LOCAL ] GDV: Loaded 20043 existing records from primary storage. [2025-09-17T07:35:52.010617] [INFO ] [MAIN ] GDV: Loaded 20043 primary data records. [2025-09-17T07:35:52.123144] [DEBUG] [LOCAL ] GDOT: Loaded 38629 existing records from primary storage. [2025-09-17T07:35:52.139337] [INFO ] [MAIN ] GDOT: Loaded 38629 primary data records. [2025-09-17T07:35:52.642017] [DEBUG] [LOCAL ] GE: Loaded 53715 existing records from primary storage. [2025-09-17T07:35:52.642237] [INFO ] [MAIN ] GE: Loaded 53715 primary data records. [2025-09-17T07:35:52.963010] [DEBUG] [MAIN ] GDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:52.964890] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 20043 primary records. [2025-09-17T07:35:52.965517] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-17T07:35:52.985380] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-09-17T07:35:52.985674] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-17T07:35:52.988244] [INFO ] [MAIN ] Derivative Progress: 836/2172 symbols completed. GDV took 1.0s. Estimated remaining: 8m 21s. Rate: 160.0 symbols/min [2025-09-17T07:35:53.002206] [INFO ] [MAIN ] GEF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:53.002554] [DEBUG] [MAIN ] GDOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:53.004163] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 38629 primary records. [2025-09-17T07:35:53.004369] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-17T07:35:53.021838] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-09-17T07:35:53.022191] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-17T07:35:53.024283] [INFO ] [MAIN ] Derivative Progress: 837/2172 symbols completed. GDOT took 1.1s. Estimated remaining: 8m 20s. Rate: 160.2 symbols/min [2025-09-17T07:35:53.025025] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:53.046585] [DEBUG] [MAIN ] GE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:53.047402] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53715 primary records. [2025-09-17T07:35:53.047575] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-17T07:35:53.071026] [DEBUG] [LOCAL ] GEF: Loaded 20730 existing records from primary storage. [2025-09-17T07:35:53.071972] [INFO ] [MAIN ] GEF: Loaded 20730 primary data records. [2025-09-17T07:35:53.158178] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-09-17T07:35:53.169694] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-17T07:35:53.197846] [INFO ] [MAIN ] Derivative Progress: 838/2172 symbols completed. GE took 1.2s. Estimated remaining: 8m 19s. Rate: 160.3 symbols/min [2025-09-17T07:35:53.204306] [DEBUG] [LOCAL ] GEL: Loaded 34694 existing records from primary storage. [2025-09-17T07:35:53.239112] [INFO ] [MAIN ] GEL: Loaded 34694 primary data records. [2025-09-17T07:35:53.733764] [DEBUG] [MAIN ] GEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:53.734604] [INFO ] [MAIN ] GEF: Generated 1794 derivative records from 20730 primary records. [2025-09-17T07:35:53.734861] [DEBUG] [LOCAL ] GEF: Saving derivative data. [2025-09-17T07:35:53.751718] [DEBUG] [LOCAL ] GEF: Derivative data saved (1794 records). [2025-09-17T07:35:53.752688] [INFO ] [MAIN ] GEF: Successfully saved derivative data. [2025-09-17T07:35:53.755235] [INFO ] [MAIN ] Derivative Progress: 839/2172 symbols completed. GEF took 0.8s. Estimated remaining: 8m 19s. Rate: 160.2 symbols/min [2025-09-17T07:35:53.768487] [DEBUG] [MAIN ] GEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:53.769091] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 34694 primary records. [2025-09-17T07:35:53.769169] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-17T07:35:53.785103] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-09-17T07:35:53.785186] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-17T07:35:53.787228] [INFO ] [MAIN ] Derivative Progress: 840/2172 symbols completed. GEL took 0.8s. Estimated remaining: 8m 18s. Rate: 160.4 symbols/min [2025-09-17T07:35:53.787956] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:53.788124] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:53.788205] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:53.865781] [DEBUG] [LOCAL ] GENI: Loaded 52869 existing records from primary storage. [2025-09-17T07:35:53.876885] [INFO ] [MAIN ] GENI: Loaded 52869 primary data records. [2025-09-17T07:35:53.917519] [DEBUG] [LOCAL ] GES: Loaded 40748 existing records from primary storage. [2025-09-17T07:35:53.961736] [INFO ] [MAIN ] GES: Loaded 40748 primary data records. [2025-09-17T07:35:53.985752] [DEBUG] [LOCAL ] GEO: Loaded 52262 existing records from primary storage. [2025-09-17T07:35:53.998892] [INFO ] [MAIN ] GEO: Loaded 52262 primary data records. [2025-09-17T07:35:54.827706] [DEBUG] [MAIN ] GENI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:54.830427] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52869 primary records. [2025-09-17T07:35:54.830670] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-17T07:35:54.861325] [DEBUG] [MAIN ] GES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:54.867854] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 40748 primary records. [2025-09-17T07:35:54.866667] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-09-17T07:35:54.868552] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-17T07:35:54.868275] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-17T07:35:54.872281] [INFO ] [MAIN ] Derivative Progress: 841/2172 symbols completed. GENI took 1.1s. Estimated remaining: 8m 19s. Rate: 160.0 symbols/min [2025-09-17T07:35:54.873247] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:54.900386] [DEBUG] [MAIN ] GEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:54.903844] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 52262 primary records. [2025-09-17T07:35:54.903998] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-17T07:35:54.918068] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-09-17T07:35:54.924930] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-09-17T07:35:54.925181] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-17T07:35:54.925113] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-17T07:35:54.927631] [INFO ] [MAIN ] Derivative Progress: 842/2172 symbols completed. GES took 1.1s. Estimated remaining: 8m 18s. Rate: 160.2 symbols/min [2025-09-17T07:35:54.928041] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:54.931036] [INFO ] [MAIN ] Derivative Progress: 843/2172 symbols completed. GEO took 1.1s. Estimated remaining: 8m 17s. Rate: 160.4 symbols/min [2025-09-17T07:35:54.931719] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:54.947677] [DEBUG] [LOCAL ] GF: Loaded 3531 existing records from primary storage. [2025-09-17T07:35:54.948071] [INFO ] [MAIN ] GF: Loaded 3531 primary data records. [2025-09-17T07:35:55.100345] [DEBUG] [LOCAL ] GETY: Loaded 36507 existing records from primary storage. [2025-09-17T07:35:55.111389] [INFO ] [MAIN ] GETY: Loaded 36507 primary data records. [2025-09-17T07:35:55.399500] [DEBUG] [LOCAL ] GEV: Loaded 53182 existing records from primary storage. [2025-09-17T07:35:55.429116] [INFO ] [MAIN ] GEV: Loaded 53182 primary data records. [2025-09-17T07:35:55.999168] [DEBUG] [MAIN ] GF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:56.000245] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 3531 primary records. [2025-09-17T07:35:56.000521] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-17T07:35:56.019830] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-09-17T07:35:56.020261] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-17T07:35:56.030049] [INFO ] [MAIN ] Derivative Progress: 844/2172 symbols completed. GF took 1.1s. Estimated remaining: 8m 18s. Rate: 160.0 symbols/min [2025-09-17T07:35:56.035139] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:56.035894] [DEBUG] [MAIN ] GETY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:56.036970] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 36507 primary records. [2025-09-17T07:35:56.037731] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-17T07:35:56.056555] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-09-17T07:35:56.056711] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-17T07:35:56.058852] [INFO ] [MAIN ] Derivative Progress: 845/2172 symbols completed. GETY took 1.2s. Estimated remaining: 8m 17s. Rate: 160.2 symbols/min [2025-09-17T07:35:56.059371] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:56.073601] [DEBUG] [MAIN ] GEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:56.074366] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53182 primary records. [2025-09-17T07:35:56.074496] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-17T07:35:56.101172] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-09-17T07:35:56.101343] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-17T07:35:56.103854] [INFO ] [MAIN ] Derivative Progress: 846/2172 symbols completed. GEV took 1.2s. Estimated remaining: 8m 16s. Rate: 160.3 symbols/min [2025-09-17T07:35:56.104914] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:56.115672] [DEBUG] [LOCAL ] GFF: Loaded 31300 existing records from primary storage. [2025-09-17T07:35:56.116030] [INFO ] [MAIN ] GFF: Loaded 31300 primary data records. [2025-09-17T07:35:56.466486] [DEBUG] [LOCAL ] GFI: Loaded 53093 existing records from primary storage. [2025-09-17T07:35:56.467431] [INFO ] [MAIN ] GFI: Loaded 53093 primary data records. [2025-09-17T07:35:56.569715] [DEBUG] [LOCAL ] GFL: Loaded 48262 existing records from primary storage. [2025-09-17T07:35:56.586085] [INFO ] [MAIN ] GFL: Loaded 48262 primary data records. [2025-09-17T07:35:57.089226] [DEBUG] [MAIN ] GFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:57.090638] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 31300 primary records. [2025-09-17T07:35:57.091059] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-17T07:35:57.112074] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-09-17T07:35:57.113220] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-17T07:35:57.115397] [INFO ] [MAIN ] Derivative Progress: 847/2172 symbols completed. GFF took 1.1s. Estimated remaining: 8m 17s. Rate: 160.0 symbols/min [2025-09-17T07:35:57.116163] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:57.129492] [DEBUG] [MAIN ] GFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:57.130289] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53093 primary records. [2025-09-17T07:35:57.130587] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-17T07:35:57.152825] [DEBUG] [LOCAL ] GFR: Loaded 8419 existing records from primary storage. [2025-09-17T07:35:57.165842] [INFO ] [MAIN ] GFR: Loaded 8419 primary data records. [2025-09-17T07:35:57.198414] [DEBUG] [MAIN ] GFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:57.204139] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-09-17T07:35:57.243287] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 48262 primary records. [2025-09-17T07:35:57.269134] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-17T07:35:57.236319] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-17T07:35:57.271335] [INFO ] [MAIN ] Derivative Progress: 848/2172 symbols completed. GFI took 1.2s. Estimated remaining: 8m 16s. Rate: 160.1 symbols/min [2025-09-17T07:35:57.272692] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:57.337858] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-09-17T07:35:57.364731] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-17T07:35:57.367146] [INFO ] [MAIN ] Derivative Progress: 849/2172 symbols completed. GFL took 1.3s. Estimated remaining: 8m 15s. Rate: 160.3 symbols/min [2025-09-17T07:35:57.506035] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:57.549397] [DEBUG] [MAIN ] GFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:57.550092] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 8419 primary records. [2025-09-17T07:35:57.558919] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-17T07:35:57.581500] [DEBUG] [LOCAL ] GGB: Loaded 50999 existing records from primary storage. [2025-09-17T07:35:57.585398] [INFO ] [MAIN ] GGB: Loaded 50999 primary data records. [2025-09-17T07:35:57.685850] [DEBUG] [LOCAL ] GGG: Loaded 41189 existing records from primary storage. [2025-09-17T07:35:57.702861] [INFO ] [MAIN ] GGG: Loaded 41189 primary data records. [2025-09-17T07:35:57.730665] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-09-17T07:35:57.735896] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-17T07:35:57.743232] [INFO ] [MAIN ] Derivative Progress: 850/2172 symbols completed. GFR took 0.6s. Estimated remaining: 8m 15s. Rate: 160.3 symbols/min [2025-09-17T07:35:57.832277] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:58.198126] [DEBUG] [LOCAL ] GGT: Loaded 14137 existing records from primary storage. [2025-09-17T07:35:58.198869] [INFO ] [MAIN ] GGT: Loaded 14137 primary data records. [2025-09-17T07:35:58.519152] [DEBUG] [MAIN ] GGB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:58.521238] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 50999 primary records. [2025-09-17T07:35:58.522018] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-17T07:35:58.549145] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-09-17T07:35:58.550351] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-17T07:35:58.557474] [INFO ] [MAIN ] Derivative Progress: 851/2172 symbols completed. GGB took 1.3s. Estimated remaining: 8m 15s. Rate: 160.0 symbols/min [2025-09-17T07:35:58.557840] [DEBUG] [MAIN ] GGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:58.558701] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:58.559421] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 41189 primary records. [2025-09-17T07:35:58.560304] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-17T07:35:58.577615] [DEBUG] [LOCAL ] GGZ: Loaded 2481 existing records from primary storage. [2025-09-17T07:35:58.578358] [INFO ] [MAIN ] GGZ: Loaded 2481 primary data records. [2025-09-17T07:35:58.594728] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-09-17T07:35:58.604451] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-17T07:35:58.665781] [DEBUG] [MAIN ] GGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:58.679399] [INFO ] [MAIN ] Derivative Progress: 852/2172 symbols completed. GGG took 1.2s. Estimated remaining: 8m 14s. Rate: 160.2 symbols/min [2025-09-17T07:35:58.699009] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14137 primary records. [2025-09-17T07:35:58.702577] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-17T07:35:58.703077] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:58.918361] [DEBUG] [LOCAL ] GHG: Loaded 3131 existing records from primary storage. [2025-09-17T07:35:58.922298] [INFO ] [MAIN ] GHG: Loaded 3131 primary data records. [2025-09-17T07:35:58.944961] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-09-17T07:35:58.967915] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-17T07:35:58.970288] [INFO ] [MAIN ] Derivative Progress: 853/2172 symbols completed. GGT took 1.2s. Estimated remaining: 8m 14s. Rate: 160.2 symbols/min [2025-09-17T07:35:59.247871] [DEBUG] [MAIN ] GGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:59.249454] [INFO ] [MAIN ] GGZ: Generated 1794 derivative records from 2481 primary records. [2025-09-17T07:35:59.249565] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-17T07:35:59.265105] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1794 records). [2025-09-17T07:35:59.265191] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-17T07:35:59.267175] [INFO ] [MAIN ] Derivative Progress: 854/2172 symbols completed. GGZ took 0.7s. Estimated remaining: 8m 13s. Rate: 160.2 symbols/min [2025-09-17T07:35:59.287400] [DEBUG] [MAIN ] GHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:35:59.288185] [INFO ] [MAIN ] GHG: Generated 1794 derivative records from 3131 primary records. [2025-09-17T07:35:59.288271] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-17T07:35:59.304207] [DEBUG] [LOCAL ] GHG: Derivative data saved (1794 records). [2025-09-17T07:35:59.304334] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-17T07:35:59.306713] [INFO ] [MAIN ] Derivative Progress: 855/2172 symbols completed. GHG took 0.6s. Estimated remaining: 8m 13s. Rate: 160.4 symbols/min [2025-09-17T07:35:59.307398] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:59.307507] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:59.307880] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:35:59.317426] [DEBUG] [LOCAL ] GHLD: Loaded 3990 existing records from primary storage. [2025-09-17T07:35:59.317789] [INFO ] [MAIN ] GHLD: Loaded 3990 primary data records. [2025-09-17T07:35:59.389100] [DEBUG] [LOCAL ] GHI: Loaded 6996 existing records from primary storage. [2025-09-17T07:35:59.411267] [DEBUG] [LOCAL ] GHM: Loaded 14297 existing records from primary storage. [2025-09-17T07:35:59.411384] [INFO ] [MAIN ] GHI: Loaded 6996 primary data records. [2025-09-17T07:35:59.433666] [INFO ] [MAIN ] GHM: Loaded 14297 primary data records. [2025-09-17T07:36:00.266351] [DEBUG] [MAIN ] GHLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:00.267098] [INFO ] [MAIN ] GHLD: Generated 1794 derivative records from 3990 primary records. [2025-09-17T07:36:00.269612] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-17T07:36:00.293227] [DEBUG] [MAIN ] GHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:00.306168] [DEBUG] [MAIN ] GHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:00.304498] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 6996 primary records. [2025-09-17T07:36:00.311256] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14297 primary records. [2025-09-17T07:36:00.311303] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-17T07:36:00.312485] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-17T07:36:00.313006] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1794 records). [2025-09-17T07:36:00.314694] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-17T07:36:00.316981] [INFO ] [MAIN ] Derivative Progress: 856/2172 symbols completed. GHLD took 1.0s. Estimated remaining: 8m 13s. Rate: 160.1 symbols/min [2025-09-17T07:36:00.325522] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:00.346923] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-09-17T07:36:00.348422] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-17T07:36:00.350711] [INFO ] [MAIN ] Derivative Progress: 857/2172 symbols completed. GHI took 1.0s. Estimated remaining: 8m 12s. Rate: 160.3 symbols/min [2025-09-17T07:36:00.348217] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-09-17T07:36:00.350949] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-17T07:36:00.353359] [INFO ] [MAIN ] Derivative Progress: 858/2172 symbols completed. GHM took 1.0s. Estimated remaining: 8m 11s. Rate: 160.5 symbols/min [2025-09-17T07:36:00.353453] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:00.353751] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:00.384396] [DEBUG] [LOCAL ] GHY: Loaded 21321 existing records from primary storage. [2025-09-17T07:36:00.383431] [DEBUG] [LOCAL ] GIC: Loaded 13894 existing records from primary storage. [2025-09-17T07:36:00.384692] [INFO ] [MAIN ] GHY: Loaded 21321 primary data records. [2025-09-17T07:36:00.384769] [INFO ] [MAIN ] GIC: Loaded 13894 primary data records. [2025-09-17T07:36:00.626378] [DEBUG] [LOCAL ] GIB: Loaded 32607 existing records from primary storage. [2025-09-17T07:36:00.725500] [INFO ] [MAIN ] GIB: Loaded 32607 primary data records. [2025-09-17T07:36:01.379508] [DEBUG] [MAIN ] GHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:01.380746] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 21321 primary records. [2025-09-17T07:36:01.388984] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-17T07:36:01.396301] [DEBUG] [MAIN ] GIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:01.406011] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13894 primary records. [2025-09-17T07:36:01.410775] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-17T07:36:01.416071] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-09-17T07:36:01.417325] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-17T07:36:01.420261] [INFO ] [MAIN ] Derivative Progress: 859/2172 symbols completed. GHY took 1.1s. Estimated remaining: 8m 12s. Rate: 160.1 symbols/min [2025-09-17T07:36:01.433043] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:01.441131] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-09-17T07:36:01.441863] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-17T07:36:01.444683] [INFO ] [MAIN ] Derivative Progress: 860/2172 symbols completed. GIC took 1.1s. Estimated remaining: 8m 11s. Rate: 160.3 symbols/min [2025-09-17T07:36:01.459069] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:01.459874] [DEBUG] [MAIN ] GIB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:01.461384] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 32607 primary records. [2025-09-17T07:36:01.461524] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-17T07:36:01.481837] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-09-17T07:36:01.482093] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-17T07:36:01.485224] [INFO ] [MAIN ] Derivative Progress: 861/2172 symbols completed. GIB took 1.1s. Estimated remaining: 8m 10s. Rate: 160.4 symbols/min [2025-09-17T07:36:01.485876] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:01.543243] [DEBUG] [LOCAL ] GIL: Loaded 43031 existing records from primary storage. [2025-09-17T07:36:01.543917] [INFO ] [MAIN ] GIL: Loaded 43031 primary data records. [2025-09-17T07:36:01.760172] [DEBUG] [LOCAL ] GIS: Loaded 53674 existing records from primary storage. [2025-09-17T07:36:01.766022] [INFO ] [MAIN ] GIS: Loaded 53674 primary data records. [2025-09-17T07:36:01.783346] [DEBUG] [LOCAL ] GKOS: Loaded 43083 existing records from primary storage. [2025-09-17T07:36:01.813372] [INFO ] [MAIN ] GKOS: Loaded 43083 primary data records. [2025-09-17T07:36:02.901480] [DEBUG] [MAIN ] GIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:02.915545] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43031 primary records. [2025-09-17T07:36:02.916497] [DEBUG] [MAIN ] GIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:02.916611] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-17T07:36:02.917330] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53674 primary records. [2025-09-17T07:36:02.918378] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-17T07:36:02.935148] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-09-17T07:36:02.935496] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-17T07:36:02.945597] [INFO ] [MAIN ] Derivative Progress: 862/2172 symbols completed. GIL took 1.5s. Estimated remaining: 8m 12s. Rate: 159.9 symbols/min [2025-09-17T07:36:02.950493] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:02.967722] [DEBUG] [MAIN ] GKOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:02.970977] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 43083 primary records. [2025-09-17T07:36:02.970164] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-09-17T07:36:02.971145] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-17T07:36:02.971588] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-17T07:36:02.982072] [INFO ] [MAIN ] Derivative Progress: 863/2172 symbols completed. GIS took 1.5s. Estimated remaining: 8m 11s. Rate: 160.1 symbols/min [2025-09-17T07:36:02.990104] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-09-17T07:36:02.990266] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:02.990484] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-17T07:36:02.993387] [INFO ] [MAIN ] Derivative Progress: 864/2172 symbols completed. GKOS took 1.5s. Estimated remaining: 8m 10s. Rate: 160.3 symbols/min [2025-09-17T07:36:02.994144] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:03.020061] [DEBUG] [LOCAL ] GLP: Loaded 9587 existing records from primary storage. [2025-09-17T07:36:03.020331] [INFO ] [MAIN ] GLP: Loaded 9587 primary data records. [2025-09-17T07:36:03.143590] [DEBUG] [LOCAL ] GL: Loaded 38346 existing records from primary storage. [2025-09-17T07:36:03.154423] [INFO ] [MAIN ] GL: Loaded 38346 primary data records. [2025-09-17T07:36:03.424918] [DEBUG] [LOCAL ] GLOB: Loaded 47124 existing records from primary storage. [2025-09-17T07:36:03.441756] [INFO ] [MAIN ] GLOB: Loaded 47124 primary data records. [2025-09-17T07:36:04.006544] [DEBUG] [MAIN ] GLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:04.007947] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9587 primary records. [2025-09-17T07:36:04.008128] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-17T07:36:04.027737] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-09-17T07:36:04.028693] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-17T07:36:04.030744] [INFO ] [MAIN ] Derivative Progress: 865/2172 symbols completed. GLP took 1.0s. Estimated remaining: 8m 10s. Rate: 159.9 symbols/min [2025-09-17T07:36:04.031220] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:04.045305] [DEBUG] [MAIN ] GL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:04.047432] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 38346 primary records. [2025-09-17T07:36:04.047718] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-17T07:36:04.068418] [DEBUG] [MAIN ] GLOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:04.069185] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47124 primary records. [2025-09-17T07:36:04.072785] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-17T07:36:04.085319] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-09-17T07:36:04.089207] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-17T07:36:04.091998] [INFO ] [MAIN ] Derivative Progress: 866/2172 symbols completed. GL took 1.1s. Estimated remaining: 8m 10s. Rate: 160.1 symbols/min [2025-09-17T07:36:04.093914] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:04.096142] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-09-17T07:36:04.096247] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-17T07:36:04.098868] [INFO ] [MAIN ] Derivative Progress: 867/2172 symbols completed. GLOB took 1.1s. Estimated remaining: 8m 9s. Rate: 160.3 symbols/min [2025-09-17T07:36:04.099179] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:04.137425] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-17T07:36:04.137668] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-09-17T07:36:04.485951] [DEBUG] [LOCAL ] GME: Loaded 53759 existing records from primary storage. [2025-09-17T07:36:04.487324] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-17T07:36:04.487699] [INFO ] [MAIN ] GME: Loaded 53759 primary data records. [2025-09-17T07:36:04.487938] [INFO ] [MAIN ] GM: Loaded 53728 primary data records. [2025-09-17T07:36:05.114542] [DEBUG] [MAIN ] GLW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:05.116255] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53635 primary records. [2025-09-17T07:36:05.116591] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-17T07:36:05.135454] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-09-17T07:36:05.135663] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-17T07:36:05.137943] [INFO ] [MAIN ] Derivative Progress: 868/2172 symbols completed. GLW took 1.1s. Estimated remaining: 8m 9s. Rate: 159.9 symbols/min [2025-09-17T07:36:05.155171] [DEBUG] [MAIN ] GM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:05.157072] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53728 primary records. [2025-09-17T07:36:05.157793] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-17T07:36:05.181982] [DEBUG] [MAIN ] GME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:05.183961] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53759 primary records. [2025-09-17T07:36:05.185540] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-17T07:36:05.187051] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-09-17T07:36:05.187282] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-17T07:36:05.197326] [INFO ] [MAIN ] Derivative Progress: 869/2172 symbols completed. GM took 1.1s. Estimated remaining: 8m 8s. Rate: 160.1 symbols/min [2025-09-17T07:36:05.204086] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-09-17T07:36:05.204177] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-17T07:36:05.206553] [INFO ] [MAIN ] Derivative Progress: 870/2172 symbols completed. GME took 1.1s. Estimated remaining: 8m 7s. Rate: 160.3 symbols/min [2025-09-17T07:36:05.207254] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:05.207394] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:05.207163] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:05.231627] [DEBUG] [LOCAL ] GNE: Loaded 17366 existing records from primary storage. [2025-09-17T07:36:05.231898] [INFO ] [MAIN ] GNE: Loaded 17366 primary data records. [2025-09-17T07:36:05.415421] [DEBUG] [LOCAL ] GMRE: Loaded 37664 existing records from primary storage. [2025-09-17T07:36:05.455892] [INFO ] [MAIN ] GMRE: Loaded 37664 primary data records. [2025-09-17T07:36:05.570824] [DEBUG] [LOCAL ] GMED: Loaded 48301 existing records from primary storage. [2025-09-17T07:36:05.641750] [INFO ] [MAIN ] GMED: Loaded 48301 primary data records. [2025-09-17T07:36:06.226630] [DEBUG] [MAIN ] GNE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:06.229154] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17366 primary records. [2025-09-17T07:36:06.230075] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-17T07:36:06.249190] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-09-17T07:36:06.250864] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-17T07:36:06.253379] [INFO ] [MAIN ] Derivative Progress: 871/2172 symbols completed. GNE took 1.0s. Estimated remaining: 8m 8s. Rate: 159.9 symbols/min [2025-09-17T07:36:06.266574] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:06.267326] [DEBUG] [MAIN ] GMRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:06.268413] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37664 primary records. [2025-09-17T07:36:06.268666] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-17T07:36:06.300352] [DEBUG] [MAIN ] GMED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:06.300416] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-09-17T07:36:06.300658] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-17T07:36:06.301430] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48301 primary records. [2025-09-17T07:36:06.303716] [INFO ] [MAIN ] Derivative Progress: 872/2172 symbols completed. GMRE took 1.1s. Estimated remaining: 8m 7s. Rate: 160.1 symbols/min [2025-09-17T07:36:06.304156] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:06.303941] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-17T07:36:06.331978] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-09-17T07:36:06.332171] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-17T07:36:06.335562] [INFO ] [MAIN ] Derivative Progress: 873/2172 symbols completed. GMED took 1.1s. Estimated remaining: 8m 6s. Rate: 160.3 symbols/min [2025-09-17T07:36:06.336035] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:06.354497] [DEBUG] [LOCAL ] GNK: Loaded 40999 existing records from primary storage. [2025-09-17T07:36:06.354697] [INFO ] [MAIN ] GNK: Loaded 40999 primary data records. [2025-09-17T07:36:06.562659] [DEBUG] [LOCAL ] GNL: Loaded 47603 existing records from primary storage. [2025-09-17T07:36:06.682796] [INFO ] [MAIN ] GNL: Loaded 47603 primary data records. [2025-09-17T07:36:06.803636] [DEBUG] [LOCAL ] GNRC: Loaded 45192 existing records from primary storage. [2025-09-17T07:36:06.804332] [INFO ] [MAIN ] GNRC: Loaded 45192 primary data records. [2025-09-17T07:36:07.340530] [DEBUG] [MAIN ] GNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:07.341806] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40999 primary records. [2025-09-17T07:36:07.341933] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-17T07:36:07.362399] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-09-17T07:36:07.362706] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-17T07:36:07.365925] [INFO ] [MAIN ] Derivative Progress: 874/2172 symbols completed. GNK took 1.1s. Estimated remaining: 8m 7s. Rate: 159.9 symbols/min [2025-09-17T07:36:07.366685] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:07.388343] [DEBUG] [MAIN ] GNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:07.389177] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 47603 primary records. [2025-09-17T07:36:07.389315] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-17T07:36:07.407151] [DEBUG] [LOCAL ] GNT: Loaded 7773 existing records from primary storage. [2025-09-17T07:36:07.410423] [INFO ] [MAIN ] GNT: Loaded 7773 primary data records. [2025-09-17T07:36:07.478077] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-09-17T07:36:07.502287] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-17T07:36:07.522037] [INFO ] [MAIN ] Derivative Progress: 875/2172 symbols completed. GNL took 1.2s. Estimated remaining: 8m 6s. Rate: 160.1 symbols/min [2025-09-17T07:36:07.578466] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:07.670597] [DEBUG] [MAIN ] GNRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:07.764419] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45192 primary records. [2025-09-17T07:36:07.785520] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-17T07:36:07.805568] [DEBUG] [LOCAL ] GNTY: Loaded 6938 existing records from primary storage. [2025-09-17T07:36:07.810761] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-09-17T07:36:07.811351] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-17T07:36:07.811214] [INFO ] [MAIN ] GNTY: Loaded 6938 primary data records. [2025-09-17T07:36:07.814706] [INFO ] [MAIN ] Derivative Progress: 876/2172 symbols completed. GNRC took 1.5s. Estimated remaining: 8m 6s. Rate: 160.1 symbols/min [2025-09-17T07:36:07.851545] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:08.163849] [DEBUG] [MAIN ] GNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:08.164802] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 7773 primary records. [2025-09-17T07:36:08.164907] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-17T07:36:08.195769] [DEBUG] [LOCAL ] GNW: Loaded 51318 existing records from primary storage. [2025-09-17T07:36:08.196543] [INFO ] [MAIN ] GNW: Loaded 51318 primary data records. [2025-09-17T07:36:08.197538] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-09-17T07:36:08.197747] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-17T07:36:08.211360] [INFO ] [MAIN ] Derivative Progress: 877/2172 symbols completed. GNT took 0.8s. Estimated remaining: 8m 5s. Rate: 160.1 symbols/min [2025-09-17T07:36:08.243060] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:08.347397] [DEBUG] [MAIN ] GNTY: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:36:08.397211] [INFO ] [MAIN ] GNTY: Generated 1792 derivative records from 6938 primary records. [2025-09-17T07:36:08.468312] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-17T07:36:08.543150] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1792 records). [2025-09-17T07:36:08.544231] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-17T07:36:08.547501] [INFO ] [MAIN ] Derivative Progress: 878/2172 symbols completed. GNTY took 1.0s. Estimated remaining: 8m 5s. Rate: 160.1 symbols/min [2025-09-17T07:36:08.548027] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:08.570326] [DEBUG] [LOCAL ] GOF: Loaded 43094 existing records from primary storage. [2025-09-17T07:36:08.571222] [INFO ] [MAIN ] GOF: Loaded 43094 primary data records. [2025-09-17T07:36:08.827321] [DEBUG] [LOCAL ] GOLF: Loaded 32174 existing records from primary storage. [2025-09-17T07:36:08.775627] [DEBUG] [MAIN ] GNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:08.953819] [INFO ] [MAIN ] GOLF: Loaded 32174 primary data records. [2025-09-17T07:36:08.955267] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51318 primary records. [2025-09-17T07:36:08.955573] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-17T07:36:09.161276] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-09-17T07:36:09.166665] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-17T07:36:09.280254] [INFO ] [MAIN ] Derivative Progress: 879/2172 symbols completed. GNW took 1.4s. Estimated remaining: 8m 5s. Rate: 159.9 symbols/min [2025-09-17T07:36:09.281566] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:09.302817] [DEBUG] [MAIN ] GOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:09.303892] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 43094 primary records. [2025-09-17T07:36:09.304100] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-17T07:36:09.323075] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-09-17T07:36:09.323511] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-17T07:36:09.325782] [INFO ] [MAIN ] Derivative Progress: 880/2172 symbols completed. GOF took 1.1s. Estimated remaining: 8m 4s. Rate: 160.1 symbols/min [2025-09-17T07:36:09.326384] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:09.357132] [DEBUG] [MAIN ] GOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:09.358036] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 32174 primary records. [2025-09-17T07:36:09.358221] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-17T07:36:09.389513] [DEBUG] [LOCAL ] GOOS: Loaded 45921 existing records from primary storage. [2025-09-17T07:36:09.398500] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-09-17T07:36:09.398700] [INFO ] [MAIN ] GOOS: Loaded 45921 primary data records. [2025-09-17T07:36:09.398771] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-17T07:36:09.401133] [INFO ] [MAIN ] Derivative Progress: 881/2172 symbols completed. GOLF took 0.9s. Estimated remaining: 8m 3s. Rate: 160.2 symbols/min [2025-09-17T07:36:09.401593] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:09.517554] [DEBUG] [LOCAL ] GOTU: Loaded 39634 existing records from primary storage. [2025-09-17T07:36:09.522965] [INFO ] [MAIN ] GOTU: Loaded 39634 primary data records. [2025-09-17T07:36:10.074238] [DEBUG] [LOCAL ] GPC: Loaded 46858 existing records from primary storage. [2025-09-17T07:36:10.075565] [INFO ] [MAIN ] GPC: Loaded 46858 primary data records. [2025-09-17T07:36:10.405833] [DEBUG] [MAIN ] GOOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:10.406926] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 45921 primary records. [2025-09-17T07:36:10.407154] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-17T07:36:10.443171] [DEBUG] [MAIN ] GOTU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:10.445919] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-09-17T07:36:10.445853] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 39634 primary records. [2025-09-17T07:36:10.446150] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-17T07:36:10.448389] [INFO ] [MAIN ] Derivative Progress: 882/2172 symbols completed. GOOS took 1.2s. Estimated remaining: 8m 4s. Rate: 159.9 symbols/min [2025-09-17T07:36:10.448808] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-17T07:36:10.449814] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:10.469540] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-09-17T07:36:10.469982] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-17T07:36:10.472907] [INFO ] [MAIN ] Derivative Progress: 883/2172 symbols completed. GOTU took 1.1s. Estimated remaining: 8m 3s. Rate: 160.1 symbols/min [2025-09-17T07:36:10.507398] [DEBUG] [MAIN ] GPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:10.507814] [DEBUG] [LOCAL ] GPI: Loaded 15155 existing records from primary storage. [2025-09-17T07:36:10.508918] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46858 primary records. [2025-09-17T07:36:10.509026] [INFO ] [MAIN ] GPI: Loaded 15155 primary data records. [2025-09-17T07:36:10.509274] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-17T07:36:10.725070] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-09-17T07:36:10.744155] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-17T07:36:10.771308] [INFO ] [MAIN ] Derivative Progress: 884/2172 symbols completed. GPC took 1.4s. Estimated remaining: 8m 3s. Rate: 160.1 symbols/min [2025-09-17T07:36:10.862380] [DEBUG] [MAIN ] GPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:10.863048] [INFO ] [MAIN ] GPI: Generated 1794 derivative records from 15155 primary records. [2025-09-17T07:36:10.863123] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-17T07:36:10.878680] [DEBUG] [LOCAL ] GPI: Derivative data saved (1794 records). [2025-09-17T07:36:10.878802] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-17T07:36:10.880892] [INFO ] [MAIN ] Derivative Progress: 885/2172 symbols completed. GPI took 0.4s. Estimated remaining: 8m 2s. Rate: 160.2 symbols/min [2025-09-17T07:36:10.881798] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:10.881895] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:10.881950] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:10.890478] [DEBUG] [LOCAL ] GPJA: Loaded 4018 existing records from primary storage. [2025-09-17T07:36:10.890936] [INFO ] [MAIN ] GPJA: Loaded 4018 primary data records. [2025-09-17T07:36:11.037673] [DEBUG] [LOCAL ] GPMT: Loaded 26872 existing records from primary storage. [2025-09-17T07:36:11.048970] [INFO ] [MAIN ] GPMT: Loaded 26872 primary data records. [2025-09-17T07:36:11.380799] [DEBUG] [LOCAL ] GPK: Loaded 52679 existing records from primary storage. [2025-09-17T07:36:11.403217] [INFO ] [MAIN ] GPK: Loaded 52679 primary data records. [2025-09-17T07:36:11.965195] [DEBUG] [MAIN ] GPJA: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:36:11.966706] [INFO ] [MAIN ] GPJA: Generated 1793 derivative records from 4018 primary records. [2025-09-17T07:36:11.967334] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-17T07:36:11.988495] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1793 records). [2025-09-17T07:36:11.990704] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-17T07:36:11.993237] [INFO ] [MAIN ] Derivative Progress: 886/2172 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 3s. Rate: 159.9 symbols/min [2025-09-17T07:36:11.993891] [INFO ] [MAIN ] GPN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:12.008754] [DEBUG] [MAIN ] GPMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:12.010185] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 26872 primary records. [2025-09-17T07:36:12.010694] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-17T07:36:12.031953] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-09-17T07:36:12.032492] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-17T07:36:12.034989] [INFO ] [MAIN ] Derivative Progress: 887/2172 symbols completed. GPMT took 1.2s. Estimated remaining: 8m 2s. Rate: 160.0 symbols/min [2025-09-17T07:36:12.048188] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:12.048841] [DEBUG] [MAIN ] GPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:12.050155] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52679 primary records. [2025-09-17T07:36:12.050339] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-17T07:36:12.066832] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-09-17T07:36:12.067190] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-17T07:36:12.088606] [INFO ] [MAIN ] Derivative Progress: 888/2172 symbols completed. GPK took 1.2s. Estimated remaining: 8m 1s. Rate: 160.2 symbols/min [2025-09-17T07:36:12.089383] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:12.121844] [DEBUG] [LOCAL ] GPN: Loaded 52089 existing records from primary storage. [2025-09-17T07:36:12.122454] [DEBUG] [LOCAL ] GPOR: Loaded 22934 existing records from primary storage. [2025-09-17T07:36:12.122109] [INFO ] [MAIN ] GPN: Loaded 52089 primary data records. [2025-09-17T07:36:12.122683] [INFO ] [MAIN ] GPOR: Loaded 22934 primary data records. [2025-09-17T07:36:12.374873] [DEBUG] [LOCAL ] GPRK: Loaded 39088 existing records from primary storage. [2025-09-17T07:36:12.472443] [INFO ] [MAIN ] GPRK: Loaded 39088 primary data records. [2025-09-17T07:36:13.059368] [DEBUG] [MAIN ] GPOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:13.059596] [DEBUG] [MAIN ] GPN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:13.060461] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 22934 primary records. [2025-09-17T07:36:13.061162] [INFO ] [MAIN ] GPN: Generated 1794 derivative records from 52089 primary records. [2025-09-17T07:36:13.061421] [DEBUG] [LOCAL ] GPN: Saving derivative data. [2025-09-17T07:36:13.061396] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-17T07:36:13.091979] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-09-17T07:36:13.093551] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-17T07:36:13.093497] [DEBUG] [LOCAL ] GPN: Derivative data saved (1794 records). [2025-09-17T07:36:13.096668] [INFO ] [MAIN ] Derivative Progress: 889/2172 symbols completed. GPOR took 1.0s. Estimated remaining: 8m 1s. Rate: 159.9 symbols/min [2025-09-17T07:36:13.097850] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:13.098617] [INFO ] [MAIN ] GPN: Successfully saved derivative data. [2025-09-17T07:36:13.101105] [INFO ] [MAIN ] Derivative Progress: 890/2172 symbols completed. GPN took 1.1s. Estimated remaining: 8m 1s. Rate: 160.1 symbols/min [2025-09-17T07:36:13.109375] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:13.115142] [DEBUG] [MAIN ] GPRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:13.116430] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39088 primary records. [2025-09-17T07:36:13.117126] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-17T07:36:13.147093] [DEBUG] [LOCAL ] GRC: Loaded 8755 existing records from primary storage. [2025-09-17T07:36:13.148385] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-09-17T07:36:13.148954] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-17T07:36:13.151706] [INFO ] [MAIN ] Derivative Progress: 891/2172 symbols completed. GPRK took 1.1s. Estimated remaining: 7m 60s. Rate: 160.2 symbols/min [2025-09-17T07:36:13.148863] [INFO ] [MAIN ] GRC: Loaded 8755 primary data records. [2025-09-17T07:36:13.172884] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:13.264418] [DEBUG] [LOCAL ] GRBK: Loaded 27437 existing records from primary storage. [2025-09-17T07:36:13.285073] [INFO ] [MAIN ] GRBK: Loaded 27437 primary data records. [2025-09-17T07:36:13.541207] [DEBUG] [LOCAL ] GRDN: Loaded 18874 existing records from primary storage. [2025-09-17T07:36:13.558868] [INFO ] [MAIN ] GRDN: Loaded 18874 primary data records. [2025-09-17T07:36:14.126246] [DEBUG] [MAIN ] GRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:14.127814] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 8755 primary records. [2025-09-17T07:36:14.128482] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-17T07:36:14.150309] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-09-17T07:36:14.166556] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-17T07:36:14.168948] [INFO ] [MAIN ] Derivative Progress: 892/2172 symbols completed. GRC took 1.1s. Estimated remaining: 8m 0s. Rate: 159.9 symbols/min [2025-09-17T07:36:14.169211] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:14.169835] [DEBUG] [MAIN ] GRBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:14.171947] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 27437 primary records. [2025-09-17T07:36:14.172062] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-17T07:36:14.200882] [DEBUG] [MAIN ] GRDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:14.202508] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 18874 primary records. [2025-09-17T07:36:14.202843] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-17T07:36:14.204766] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-09-17T07:36:14.212031] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-17T07:36:14.218696] [INFO ] [MAIN ] Derivative Progress: 893/2172 symbols completed. GRBK took 1.1s. Estimated remaining: 7m 59s. Rate: 160.1 symbols/min [2025-09-17T07:36:14.226143] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:14.227815] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-09-17T07:36:14.227911] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-17T07:36:14.230575] [INFO ] [MAIN ] Derivative Progress: 894/2172 symbols completed. GRDN took 1.1s. Estimated remaining: 7m 58s. Rate: 160.3 symbols/min [2025-09-17T07:36:14.230858] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:14.263619] [DEBUG] [LOCAL ] GRMN: Loaded 41810 existing records from primary storage. [2025-09-17T07:36:14.263853] [INFO ] [MAIN ] GRMN: Loaded 41810 primary data records. [2025-09-17T07:36:14.430485] [DEBUG] [LOCAL ] GRND: Loaded 50159 existing records from primary storage. [2025-09-17T07:36:14.482710] [DEBUG] [LOCAL ] GRNT: Loaded 33961 existing records from primary storage. [2025-09-17T07:36:14.486069] [INFO ] [MAIN ] GRNT: Loaded 33961 primary data records. [2025-09-17T07:36:14.481804] [INFO ] [MAIN ] GRND: Loaded 50159 primary data records. [2025-09-17T07:36:15.206205] [DEBUG] [MAIN ] GRMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:15.207771] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 41810 primary records. [2025-09-17T07:36:15.208029] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-17T07:36:15.226124] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-09-17T07:36:15.226429] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-17T07:36:15.230125] [INFO ] [MAIN ] Derivative Progress: 895/2172 symbols completed. GRMN took 1.1s. Estimated remaining: 7m 59s. Rate: 160.0 symbols/min [2025-09-17T07:36:15.231240] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:15.244778] [DEBUG] [MAIN ] GRND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:15.245838] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 50159 primary records. [2025-09-17T07:36:15.245973] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-17T07:36:15.268826] [DEBUG] [LOCAL ] GROV: Loaded 9293 existing records from primary storage. [2025-09-17T07:36:15.269469] [INFO ] [MAIN ] GROV: Loaded 9293 primary data records. [2025-09-17T07:36:15.302620] [DEBUG] [MAIN ] GRNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:15.282096] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-09-17T07:36:15.357076] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-17T07:36:15.345328] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33961 primary records. [2025-09-17T07:36:15.385550] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-17T07:36:15.375099] [INFO ] [MAIN ] Derivative Progress: 896/2172 symbols completed. GRND took 1.1s. Estimated remaining: 7m 58s. Rate: 160.1 symbols/min [2025-09-17T07:36:15.391779] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:15.478595] [DEBUG] [LOCAL ] GRX: Loaded 4268 existing records from primary storage. [2025-09-17T07:36:15.628962] [INFO ] [MAIN ] GRX: Loaded 4268 primary data records. [2025-09-17T07:36:15.642331] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-09-17T07:36:15.697268] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-17T07:36:15.705397] [INFO ] [MAIN ] Derivative Progress: 897/2172 symbols completed. GRNT took 1.5s. Estimated remaining: 7m 58s. Rate: 160.1 symbols/min [2025-09-17T07:36:15.723741] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:15.950342] [DEBUG] [MAIN ] GROV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:15.951413] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 9293 primary records. [2025-09-17T07:36:15.951793] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-17T07:36:15.981680] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-09-17T07:36:15.984010] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-17T07:36:15.986481] [INFO ] [MAIN ] Derivative Progress: 898/2172 symbols completed. GROV took 0.8s. Estimated remaining: 7m 57s. Rate: 160.1 symbols/min [2025-09-17T07:36:16.001488] [DEBUG] [MAIN ] GRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:16.002460] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4268 primary records. [2025-09-17T07:36:16.016272] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-17T07:36:16.017913] [DEBUG] [LOCAL ] GS: Loaded 52208 existing records from primary storage. [2025-09-17T07:36:16.018243] [INFO ] [MAIN ] GS: Loaded 52208 primary data records. [2025-09-17T07:36:16.140975] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-09-17T07:36:16.161567] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-17T07:36:16.195363] [INFO ] [MAIN ] Derivative Progress: 899/2172 symbols completed. GRX took 0.8s. Estimated remaining: 7m 57s. Rate: 160.2 symbols/min [2025-09-17T07:36:16.347730] [DEBUG] [MAIN ] GS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:16.348405] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 52208 primary records. [2025-09-17T07:36:16.348481] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-17T07:36:16.363801] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-09-17T07:36:16.363872] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-17T07:36:16.365940] [INFO ] [MAIN ] Derivative Progress: 900/2172 symbols completed. GS took 0.6s. Estimated remaining: 7m 56s. Rate: 160.3 symbols/min [2025-09-17T07:36:16.366435] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:16.366492] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:16.366664] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:16.428315] [DEBUG] [LOCAL ] GSL: Loaded 33934 existing records from primary storage. [2025-09-17T07:36:16.439077] [INFO ] [MAIN ] GSL: Loaded 33934 primary data records. [2025-09-17T07:36:16.460211] [DEBUG] [LOCAL ] GSBD: Loaded 39330 existing records from primary storage. [2025-09-17T07:36:16.503372] [INFO ] [MAIN ] GSBD: Loaded 39330 primary data records. [2025-09-17T07:36:16.624624] [DEBUG] [LOCAL ] GSK: Loaded 53504 existing records from primary storage. [2025-09-17T07:36:16.686266] [INFO ] [MAIN ] GSK: Loaded 53504 primary data records. [2025-09-17T07:36:17.419867] [DEBUG] [MAIN ] GSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:17.425712] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33934 primary records. [2025-09-17T07:36:17.426172] [DEBUG] [MAIN ] GSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:17.426409] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-17T07:36:17.426927] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39330 primary records. [2025-09-17T07:36:17.428433] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-17T07:36:17.470095] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-09-17T07:36:17.470353] [DEBUG] [MAIN ] GSK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:17.473005] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-09-17T07:36:17.473717] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53504 primary records. [2025-09-17T07:36:17.474089] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-17T07:36:17.474000] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-17T07:36:17.473870] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-17T07:36:17.477295] [INFO ] [MAIN ] Derivative Progress: 901/2172 symbols completed. GSBD took 1.1s. Estimated remaining: 7m 57s. Rate: 160.0 symbols/min [2025-09-17T07:36:17.487176] [INFO ] [MAIN ] Derivative Progress: 902/2172 symbols completed. GSL took 1.1s. Estimated remaining: 7m 56s. Rate: 160.1 symbols/min [2025-09-17T07:36:17.487106] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:17.493837] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:17.495019] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-09-17T07:36:17.495437] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-17T07:36:17.498489] [INFO ] [MAIN ] Derivative Progress: 903/2172 symbols completed. GSK took 1.1s. Estimated remaining: 7m 55s. Rate: 160.3 symbols/min [2025-09-17T07:36:17.498946] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:17.574529] [DEBUG] [LOCAL ] GTLS: Loaded 43162 existing records from primary storage. [2025-09-17T07:36:17.575677] [INFO ] [MAIN ] GTLS: Loaded 43162 primary data records. [2025-09-17T07:36:17.575396] [DEBUG] [LOCAL ] GTN: Loaded 45912 existing records from primary storage. [2025-09-17T07:36:17.575941] [INFO ] [MAIN ] GTN: Loaded 45912 primary data records. [2025-09-17T07:36:17.744402] [DEBUG] [LOCAL ] GTES: Loaded 50740 existing records from primary storage. [2025-09-17T07:36:17.792115] [INFO ] [MAIN ] GTES: Loaded 50740 primary data records. [2025-09-17T07:36:18.513037] [DEBUG] [MAIN ] GTLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:18.513740] [DEBUG] [MAIN ] GTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:18.515845] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 43162 primary records. [2025-09-17T07:36:18.515722] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45912 primary records. [2025-09-17T07:36:18.516097] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-17T07:36:18.516140] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-17T07:36:18.542546] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-09-17T07:36:18.542806] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-17T07:36:18.548772] [INFO ] [MAIN ] Derivative Progress: 904/2172 symbols completed. GTLS took 1.1s. Estimated remaining: 7m 56s. Rate: 160.0 symbols/min [2025-09-17T07:36:18.549217] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:18.563155] [DEBUG] [MAIN ] GTES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:18.565586] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-09-17T07:36:18.566353] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50740 primary records. [2025-09-17T07:36:18.566508] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-17T07:36:18.566677] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-17T07:36:18.568976] [INFO ] [MAIN ] Derivative Progress: 905/2172 symbols completed. GTN took 1.1s. Estimated remaining: 7m 55s. Rate: 160.1 symbols/min [2025-09-17T07:36:18.570252] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:18.586660] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-09-17T07:36:18.586813] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-17T07:36:18.589071] [INFO ] [MAIN ] Derivative Progress: 906/2172 symbols completed. GTES took 1.1s. Estimated remaining: 7m 54s. Rate: 160.3 symbols/min [2025-09-17T07:36:18.589376] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:18.602438] [DEBUG] [LOCAL ] GUG: Loaded 12308 existing records from primary storage. [2025-09-17T07:36:18.602619] [INFO ] [MAIN ] GUG: Loaded 12308 primary data records. [2025-09-17T07:36:18.731953] [DEBUG] [LOCAL ] GUT: Loaded 15668 existing records from primary storage. [2025-09-17T07:36:18.741222] [INFO ] [MAIN ] GUT: Loaded 15668 primary data records. [2025-09-17T07:36:18.753237] [DEBUG] [LOCAL ] GTY: Loaded 30319 existing records from primary storage. [2025-09-17T07:36:18.833371] [INFO ] [MAIN ] GTY: Loaded 30319 primary data records. [2025-09-17T07:36:19.602025] [DEBUG] [MAIN ] GUG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:36:19.603190] [INFO ] [MAIN ] GUG: Generated 1793 derivative records from 12308 primary records. [2025-09-17T07:36:19.604660] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-17T07:36:19.633962] [DEBUG] [MAIN ] GUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:19.637356] [DEBUG] [LOCAL ] GUG: Derivative data saved (1793 records). [2025-09-17T07:36:19.639571] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15668 primary records. [2025-09-17T07:36:19.639884] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-17T07:36:19.640017] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-17T07:36:19.654454] [INFO ] [MAIN ] Derivative Progress: 907/2172 symbols completed. GUG took 1.1s. Estimated remaining: 7m 54s. Rate: 160.0 symbols/min [2025-09-17T07:36:19.656071] [DEBUG] [MAIN ] GTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:19.656379] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:19.657782] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30319 primary records. [2025-09-17T07:36:19.669010] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-17T07:36:19.673211] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-09-17T07:36:19.674022] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-17T07:36:19.676696] [INFO ] [MAIN ] Derivative Progress: 908/2172 symbols completed. GUT took 1.1s. Estimated remaining: 7m 54s. Rate: 160.2 symbols/min [2025-09-17T07:36:19.684981] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:19.695546] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-09-17T07:36:19.695730] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-17T07:36:19.697961] [INFO ] [MAIN ] Derivative Progress: 909/2172 symbols completed. GTY took 1.1s. Estimated remaining: 7m 53s. Rate: 160.3 symbols/min [2025-09-17T07:36:19.698666] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:19.725590] [DEBUG] [LOCAL ] GWH: Loaded 15026 existing records from primary storage. [2025-09-17T07:36:19.725779] [INFO ] [MAIN ] GWH: Loaded 15026 primary data records. [2025-09-17T07:36:19.849015] [DEBUG] [LOCAL ] GVA: Loaded 34117 existing records from primary storage. [2025-09-17T07:36:19.873398] [INFO ] [MAIN ] GVA: Loaded 34117 primary data records. [2025-09-17T07:36:20.110388] [DEBUG] [LOCAL ] GWRE: Loaded 41517 existing records from primary storage. [2025-09-17T07:36:20.133551] [INFO ] [MAIN ] GWRE: Loaded 41517 primary data records. [2025-09-17T07:36:20.684891] [DEBUG] [MAIN ] GWH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:20.687119] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 15026 primary records. [2025-09-17T07:36:20.687255] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-17T07:36:20.706466] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-09-17T07:36:20.709462] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-17T07:36:20.712746] [INFO ] [MAIN ] Derivative Progress: 910/2172 symbols completed. GWH took 1.0s. Estimated remaining: 7m 53s. Rate: 160.0 symbols/min [2025-09-17T07:36:20.713766] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:20.728988] [DEBUG] [MAIN ] GVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:20.729929] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 34117 primary records. [2025-09-17T07:36:20.730078] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-17T07:36:20.767013] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-09-17T07:36:20.767505] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-17T07:36:20.767798] [DEBUG] [MAIN ] GWRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:20.771112] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 41517 primary records. [2025-09-17T07:36:20.771264] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-17T07:36:20.770176] [INFO ] [MAIN ] Derivative Progress: 911/2172 symbols completed. GVA took 1.1s. Estimated remaining: 7m 52s. Rate: 160.2 symbols/min [2025-09-17T07:36:20.772407] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:20.791279] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-09-17T07:36:20.798856] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-17T07:36:20.801324] [INFO ] [MAIN ] Derivative Progress: 912/2172 symbols completed. GWRE took 1.1s. Estimated remaining: 7m 52s. Rate: 160.3 symbols/min [2025-09-17T07:36:20.802604] [DEBUG] [LOCAL ] GWW: Loaded 20108 existing records from primary storage. [2025-09-17T07:36:20.802740] [INFO ] [MAIN ] GWW: Loaded 20108 primary data records. [2025-09-17T07:36:20.808569] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:20.910604] [DEBUG] [LOCAL ] GYLD: Loaded 1521 existing records from primary storage. [2025-09-17T07:36:20.937589] [INFO ] [MAIN ] GYLD: Loaded 1521 primary data records. [2025-09-17T07:36:21.241220] [DEBUG] [LOCAL ] GXO: Loaded 47925 existing records from primary storage. [2025-09-17T07:36:21.258614] [INFO ] [MAIN ] GXO: Loaded 47925 primary data records. [2025-09-17T07:36:21.801111] [DEBUG] [MAIN ] GWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:21.802857] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 20108 primary records. [2025-09-17T07:36:21.803884] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-17T07:36:21.825196] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-09-17T07:36:21.839041] [DEBUG] [MAIN ] GYLD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:36:21.839300] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-17T07:36:21.840380] [INFO ] [MAIN ] GYLD: Generated 1793 derivative records from 1521 primary records. [2025-09-17T07:36:21.842594] [INFO ] [MAIN ] Derivative Progress: 913/2172 symbols completed. GWW took 1.1s. Estimated remaining: 7m 52s. Rate: 160.0 symbols/min [2025-09-17T07:36:21.843035] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-17T07:36:21.872545] [DEBUG] [MAIN ] GXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:21.872601] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1793 records). [2025-09-17T07:36:21.873336] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 47925 primary records. [2025-09-17T07:36:21.873399] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-17T07:36:21.873477] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-17T07:36:21.876151] [INFO ] [MAIN ] Derivative Progress: 914/2172 symbols completed. GYLD took 1.1s. Estimated remaining: 7m 51s. Rate: 160.2 symbols/min [2025-09-17T07:36:21.891621] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-09-17T07:36:21.891747] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-17T07:36:21.893986] [INFO ] [MAIN ] Derivative Progress: 915/2172 symbols completed. GXO took 1.1s. Estimated remaining: 7m 50s. Rate: 160.3 symbols/min [2025-09-17T07:36:21.894771] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:21.894876] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:21.895058] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:21.953952] [DEBUG] [LOCAL ] HAE: Loaded 39478 existing records from primary storage. [2025-09-17T07:36:21.966292] [INFO ] [MAIN ] HAE: Loaded 39478 primary data records. [2025-09-17T07:36:21.998321] [DEBUG] [LOCAL ] HAFN: Loaded 43988 existing records from primary storage. [2025-09-17T07:36:22.031999] [INFO ] [MAIN ] HAFN: Loaded 43988 primary data records. [2025-09-17T07:36:22.090079] [DEBUG] [LOCAL ] H: Loaded 45105 existing records from primary storage. [2025-09-17T07:36:22.123673] [INFO ] [MAIN ] H: Loaded 45105 primary data records. [2025-09-17T07:36:22.923461] [DEBUG] [MAIN ] HAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:22.937541] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39478 primary records. [2025-09-17T07:36:22.936842] [DEBUG] [MAIN ] HAFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:22.938406] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43988 primary records. [2025-09-17T07:36:22.938667] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-17T07:36:22.938494] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-17T07:36:22.970819] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-09-17T07:36:22.972269] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-17T07:36:22.975327] [INFO ] [MAIN ] Derivative Progress: 916/2172 symbols completed. HAFN took 1.1s. Estimated remaining: 7m 51s. Rate: 160.0 symbols/min [2025-09-17T07:36:22.976600] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:22.989866] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-09-17T07:36:22.990592] [DEBUG] [MAIN ] H: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:22.991202] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-17T07:36:22.992122] [INFO ] [MAIN ] H: Generated 1794 derivative records from 45105 primary records. [2025-09-17T07:36:22.994132] [INFO ] [MAIN ] Derivative Progress: 917/2172 symbols completed. HAE took 1.1s. Estimated remaining: 7m 50s. Rate: 160.2 symbols/min [2025-09-17T07:36:22.994505] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-17T07:36:22.995016] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:23.012057] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-09-17T07:36:23.012343] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-17T07:36:23.015094] [INFO ] [MAIN ] Derivative Progress: 918/2172 symbols completed. H took 1.1s. Estimated remaining: 7m 49s. Rate: 160.3 symbols/min [2025-09-17T07:36:23.015425] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:23.095521] [DEBUG] [LOCAL ] HASI: Loaded 47259 existing records from primary storage. [2025-09-17T07:36:23.095985] [INFO ] [MAIN ] HASI: Loaded 47259 primary data records. [2025-09-17T07:36:23.266670] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-17T07:36:23.283579] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-09-17T07:36:23.331600] [DEBUG] [LOCAL ] HAYW: Loaded 48746 existing records from primary storage. [2025-09-17T07:36:23.399670] [INFO ] [MAIN ] HAYW: Loaded 48746 primary data records. [2025-09-17T07:36:24.143156] [DEBUG] [MAIN ] HASI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:24.144754] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47259 primary records. [2025-09-17T07:36:24.145313] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-17T07:36:24.179870] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-09-17T07:36:24.180742] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-17T07:36:24.180607] [DEBUG] [MAIN ] HAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:24.189486] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-09-17T07:36:24.196537] [INFO ] [MAIN ] Derivative Progress: 919/2172 symbols completed. HASI took 1.2s. Estimated remaining: 7m 50s. Rate: 160.0 symbols/min [2025-09-17T07:36:24.196877] [DEBUG] [MAIN ] HAYW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:24.197344] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:24.194610] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-17T07:36:24.198166] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48746 primary records. [2025-09-17T07:36:24.199155] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-17T07:36:24.228626] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-09-17T07:36:24.233447] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-17T07:36:24.237921] [INFO ] [MAIN ] Derivative Progress: 920/2172 symbols completed. HAYW took 1.2s. Estimated remaining: 7m 49s. Rate: 160.1 symbols/min [2025-09-17T07:36:24.242193] [DEBUG] [LOCAL ] HBB: Loaded 6983 existing records from primary storage. [2025-09-17T07:36:24.242334] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:24.244204] [INFO ] [MAIN ] HBB: Loaded 6983 primary data records. [2025-09-17T07:36:24.244950] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-09-17T07:36:24.284152] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-17T07:36:24.307674] [INFO ] [MAIN ] Derivative Progress: 921/2172 symbols completed. HAL took 1.3s. Estimated remaining: 7m 48s. Rate: 160.3 symbols/min [2025-09-17T07:36:24.354526] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:24.581349] [DEBUG] [LOCAL ] HBI: Loaded 53046 existing records from primary storage. [2025-09-17T07:36:24.582502] [INFO ] [MAIN ] HBI: Loaded 53046 primary data records. [2025-09-17T07:36:24.908501] [DEBUG] [LOCAL ] HBM: Loaded 52925 existing records from primary storage. [2025-09-17T07:36:24.909215] [INFO ] [MAIN ] HBM: Loaded 52925 primary data records. [2025-09-17T07:36:25.027636] [DEBUG] [MAIN ] HBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:25.072635] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6983 primary records. [2025-09-17T07:36:25.088003] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-17T07:36:25.246874] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-09-17T07:36:25.247986] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-17T07:36:25.252197] [INFO ] [MAIN ] Derivative Progress: 922/2172 symbols completed. HBB took 1.1s. Estimated remaining: 7m 49s. Rate: 160.0 symbols/min [2025-09-17T07:36:25.252508] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:25.267558] [DEBUG] [MAIN ] HBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:25.269487] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 53046 primary records. [2025-09-17T07:36:25.269816] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-17T07:36:25.286658] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-09-17T07:36:25.287024] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-17T07:36:25.289522] [INFO ] [MAIN ] Derivative Progress: 923/2172 symbols completed. HBI took 1.0s. Estimated remaining: 7m 48s. Rate: 160.2 symbols/min [2025-09-17T07:36:25.290154] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:25.309302] [DEBUG] [MAIN ] HBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:25.310133] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52925 primary records. [2025-09-17T07:36:25.310296] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-17T07:36:25.338691] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-09-17T07:36:25.339027] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-17T07:36:25.341667] [INFO ] [MAIN ] Derivative Progress: 924/2172 symbols completed. HBM took 1.0s. Estimated remaining: 7m 47s. Rate: 160.3 symbols/min [2025-09-17T07:36:25.342201] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:25.385497] [DEBUG] [LOCAL ] HCA: Loaded 47465 existing records from primary storage. [2025-09-17T07:36:25.385913] [INFO ] [MAIN ] HCA: Loaded 47465 primary data records. [2025-09-17T07:36:25.458241] [DEBUG] [LOCAL ] HCI: Loaded 14074 existing records from primary storage. [2025-09-17T07:36:25.496925] [INFO ] [MAIN ] HCI: Loaded 14074 primary data records. [2025-09-17T07:36:25.504752] [DEBUG] [LOCAL ] HCC: Loaded 45429 existing records from primary storage. [2025-09-17T07:36:25.564679] [INFO ] [MAIN ] HCC: Loaded 45429 primary data records. [2025-09-17T07:36:26.436368] [DEBUG] [MAIN ] HCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:26.437998] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 47465 primary records. [2025-09-17T07:36:26.438572] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-17T07:36:26.473438] [DEBUG] [MAIN ] HCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:26.477403] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 14074 primary records. [2025-09-17T07:36:26.477920] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-17T07:36:26.476559] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-09-17T07:36:26.478941] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-17T07:36:26.490852] [INFO ] [MAIN ] Derivative Progress: 925/2172 symbols completed. HCA took 1.2s. Estimated remaining: 7m 48s. Rate: 159.9 symbols/min [2025-09-17T07:36:26.511849] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:26.513378] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-09-17T07:36:26.513801] [DEBUG] [MAIN ] HCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:26.513988] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-17T07:36:26.517618] [INFO ] [MAIN ] Derivative Progress: 926/2172 symbols completed. HCI took 1.2s. Estimated remaining: 7m 47s. Rate: 160.1 symbols/min [2025-09-17T07:36:26.518957] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45429 primary records. [2025-09-17T07:36:26.519266] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-17T07:36:26.520520] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:26.539283] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-09-17T07:36:26.539894] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-17T07:36:26.542475] [INFO ] [MAIN ] Derivative Progress: 927/2172 symbols completed. HCC took 1.3s. Estimated remaining: 7m 46s. Rate: 160.3 symbols/min [2025-09-17T07:36:26.542849] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:26.621966] [DEBUG] [LOCAL ] HD: Loaded 53522 existing records from primary storage. [2025-09-17T07:36:26.622200] [INFO ] [MAIN ] HD: Loaded 53522 primary data records. [2025-09-17T07:36:26.693129] [DEBUG] [LOCAL ] HDB: Loaded 51918 existing records from primary storage. [2025-09-17T07:36:26.743923] [DEBUG] [LOCAL ] HE: Loaded 49341 existing records from primary storage. [2025-09-17T07:36:26.755244] [INFO ] [MAIN ] HDB: Loaded 51918 primary data records. [2025-09-17T07:36:26.755371] [INFO ] [MAIN ] HE: Loaded 49341 primary data records. [2025-09-17T07:36:27.623846] [DEBUG] [MAIN ] HD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:27.624688] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53522 primary records. [2025-09-17T07:36:27.624897] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-17T07:36:27.644754] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-09-17T07:36:27.659201] [DEBUG] [MAIN ] HE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:27.659999] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 49341 primary records. [2025-09-17T07:36:27.658830] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-17T07:36:27.674729] [INFO ] [MAIN ] Derivative Progress: 928/2172 symbols completed. HD took 1.2s. Estimated remaining: 7m 47s. Rate: 159.9 symbols/min [2025-09-17T07:36:27.675574] [DEBUG] [MAIN ] HDB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:27.674924] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-17T07:36:27.676341] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51918 primary records. [2025-09-17T07:36:27.677158] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-17T07:36:27.707717] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-09-17T07:36:27.707223] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-09-17T07:36:27.707867] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-17T07:36:27.707912] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-17T07:36:27.712905] [INFO ] [MAIN ] Derivative Progress: 929/2172 symbols completed. HE took 1.2s. Estimated remaining: 7m 46s. Rate: 160.1 symbols/min [2025-09-17T07:36:27.716028] [INFO ] [MAIN ] Derivative Progress: 930/2172 symbols completed. HDB took 1.2s. Estimated remaining: 7m 45s. Rate: 160.2 symbols/min [2025-09-17T07:36:27.716750] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:27.716536] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:27.716865] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:27.727781] [DEBUG] [LOCAL ] HEQ: Loaded 6098 existing records from primary storage. [2025-09-17T07:36:27.728033] [INFO ] [MAIN ] HEQ: Loaded 6098 primary data records. [2025-09-17T07:36:27.942043] [DEBUG] [LOCAL ] HEI: Loaded 33129 existing records from primary storage. [2025-09-17T07:36:27.974862] [INFO ] [MAIN ] HEI: Loaded 33129 primary data records. [2025-09-17T07:36:28.160395] [DEBUG] [LOCAL ] HESM: Loaded 48174 existing records from primary storage. [2025-09-17T07:36:28.185841] [INFO ] [MAIN ] HESM: Loaded 48174 primary data records. [2025-09-17T07:36:28.732376] [DEBUG] [MAIN ] HEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:28.734316] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6098 primary records. [2025-09-17T07:36:28.735217] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-17T07:36:28.753652] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-09-17T07:36:28.755787] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-17T07:36:28.758413] [INFO ] [MAIN ] Derivative Progress: 931/2172 symbols completed. HEQ took 1.0s. Estimated remaining: 7m 46s. Rate: 159.9 symbols/min [2025-09-17T07:36:28.771615] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:28.772269] [DEBUG] [MAIN ] HEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:28.773730] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 33129 primary records. [2025-09-17T07:36:28.773834] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-17T07:36:28.810336] [DEBUG] [MAIN ] HESM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:28.811683] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48174 primary records. [2025-09-17T07:36:28.810877] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-09-17T07:36:28.811836] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-17T07:36:28.812013] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-17T07:36:28.814734] [INFO ] [MAIN ] Derivative Progress: 932/2172 symbols completed. HEI took 1.1s. Estimated remaining: 7m 45s. Rate: 160.1 symbols/min [2025-09-17T07:36:28.815584] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:28.833353] [DEBUG] [LOCAL ] HFRO: Loaded 17567 existing records from primary storage. [2025-09-17T07:36:28.833585] [INFO ] [MAIN ] HFRO: Loaded 17567 primary data records. [2025-09-17T07:36:28.921253] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-09-17T07:36:28.936637] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-17T07:36:28.949673] [INFO ] [MAIN ] Derivative Progress: 933/2172 symbols completed. HESM took 1.2s. Estimated remaining: 7m 44s. Rate: 160.2 symbols/min [2025-09-17T07:36:28.950106] [DEBUG] [LOCAL ] HGER: Loaded 12497 existing records from primary storage. [2025-09-17T07:36:28.950585] [INFO ] [MAIN ] HGER: Loaded 12497 primary data records. [2025-09-17T07:36:28.950774] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:29.265064] [DEBUG] [LOCAL ] HGLB: Loaded 9787 existing records from primary storage. [2025-09-17T07:36:29.290678] [INFO ] [MAIN ] HGLB: Loaded 9787 primary data records. [2025-09-17T07:36:29.809691] [DEBUG] [MAIN ] HFRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:29.811429] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17567 primary records. [2025-09-17T07:36:29.813003] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-17T07:36:29.827670] [DEBUG] [MAIN ] HGER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:29.836541] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 12497 primary records. [2025-09-17T07:36:29.839773] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-17T07:36:29.843981] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-09-17T07:36:29.844161] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-17T07:36:29.846561] [INFO ] [MAIN ] Derivative Progress: 934/2172 symbols completed. HFRO took 1.1s. Estimated remaining: 7m 44s. Rate: 160.0 symbols/min [2025-09-17T07:36:29.858306] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:29.863589] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-09-17T07:36:29.864195] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-17T07:36:29.866721] [INFO ] [MAIN ] Derivative Progress: 935/2172 symbols completed. HGER took 1.1s. Estimated remaining: 7m 44s. Rate: 160.1 symbols/min [2025-09-17T07:36:29.867111] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:29.884472] [DEBUG] [MAIN ] HGLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:29.889518] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9787 primary records. [2025-09-17T07:36:29.889717] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-17T07:36:29.907687] [DEBUG] [LOCAL ] HGTY: Loaded 12626 existing records from primary storage. [2025-09-17T07:36:29.908616] [INFO ] [MAIN ] HGTY: Loaded 12626 primary data records. [2025-09-17T07:36:29.912864] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-09-17T07:36:29.956332] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-17T07:36:30.007069] [INFO ] [MAIN ] Derivative Progress: 936/2172 symbols completed. HGLB took 1.1s. Estimated remaining: 7m 43s. Rate: 160.2 symbols/min [2025-09-17T07:36:30.028373] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:30.233572] [DEBUG] [LOCAL ] HGV: Loaded 47137 existing records from primary storage. [2025-09-17T07:36:30.233899] [INFO ] [MAIN ] HGV: Loaded 47137 primary data records. [2025-09-17T07:36:30.553436] [DEBUG] [LOCAL ] HHH: Loaded 32988 existing records from primary storage. [2025-09-17T07:36:30.554467] [INFO ] [MAIN ] HHH: Loaded 32988 primary data records. [2025-09-17T07:36:30.760206] [DEBUG] [MAIN ] HGTY: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:36:30.876620] [INFO ] [MAIN ] HGTY: Generated 1793 derivative records from 12626 primary records. [2025-09-17T07:36:30.877714] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-17T07:36:30.898668] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1793 records). [2025-09-17T07:36:30.900473] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-17T07:36:30.903019] [INFO ] [MAIN ] Derivative Progress: 937/2172 symbols completed. HGTY took 1.0s. Estimated remaining: 7m 43s. Rate: 160.0 symbols/min [2025-09-17T07:36:30.916750] [DEBUG] [MAIN ] HGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:30.916203] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:30.917964] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 47137 primary records. [2025-09-17T07:36:30.918448] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-17T07:36:30.936813] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-09-17T07:36:30.936975] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-17T07:36:30.939451] [INFO ] [MAIN ] Derivative Progress: 938/2172 symbols completed. HGV took 1.1s. Estimated remaining: 7m 42s. Rate: 160.1 symbols/min [2025-09-17T07:36:30.939917] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:30.962710] [DEBUG] [MAIN ] HHH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:30.963814] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 32988 primary records. [2025-09-17T07:36:30.964968] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-17T07:36:30.990242] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-09-17T07:36:30.990470] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-17T07:36:30.992923] [INFO ] [MAIN ] Derivative Progress: 939/2172 symbols completed. HHH took 1.0s. Estimated remaining: 7m 42s. Rate: 160.3 symbols/min [2025-09-17T07:36:30.993317] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:31.008863] [DEBUG] [LOCAL ] HI: Loaded 35100 existing records from primary storage. [2025-09-17T07:36:31.009238] [INFO ] [MAIN ] HI: Loaded 35100 primary data records. [2025-09-17T07:36:31.349627] [DEBUG] [LOCAL ] HII: Loaded 35819 existing records from primary storage. [2025-09-17T07:36:31.348899] [DEBUG] [LOCAL ] HIG: Loaded 51311 existing records from primary storage. [2025-09-17T07:36:31.350055] [INFO ] [MAIN ] HII: Loaded 35819 primary data records. [2025-09-17T07:36:31.349966] [INFO ] [MAIN ] HIG: Loaded 51311 primary data records. [2025-09-17T07:36:32.024638] [DEBUG] [MAIN ] HI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:32.026016] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35100 primary records. [2025-09-17T07:36:32.026226] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-17T07:36:32.046518] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-09-17T07:36:32.047288] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-17T07:36:32.049771] [INFO ] [MAIN ] Derivative Progress: 940/2172 symbols completed. HI took 1.1s. Estimated remaining: 7m 42s. Rate: 160.0 symbols/min [2025-09-17T07:36:32.050803] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:32.082276] [DEBUG] [MAIN ] HII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:32.082488] [DEBUG] [MAIN ] HIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:32.084541] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51311 primary records. [2025-09-17T07:36:32.084681] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-17T07:36:32.084408] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 35819 primary records. [2025-09-17T07:36:32.085375] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-17T07:36:32.116757] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-09-17T07:36:32.117724] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-17T07:36:32.119966] [INFO ] [MAIN ] Derivative Progress: 941/2172 symbols completed. HII took 1.1s. Estimated remaining: 7m 41s. Rate: 160.1 symbols/min [2025-09-17T07:36:32.121292] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-09-17T07:36:32.121507] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:32.121723] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-17T07:36:32.124535] [INFO ] [MAIN ] Derivative Progress: 942/2172 symbols completed. HIG took 1.2s. Estimated remaining: 7m 40s. Rate: 160.3 symbols/min [2025-09-17T07:36:32.125320] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:32.174802] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-17T07:36:32.175024] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-09-17T07:36:32.274330] [DEBUG] [LOCAL ] HIO: Loaded 24130 existing records from primary storage. [2025-09-17T07:36:32.291121] [INFO ] [MAIN ] HIO: Loaded 24130 primary data records. [2025-09-17T07:36:32.314320] [DEBUG] [LOCAL ] HIPO: Loaded 22908 existing records from primary storage. [2025-09-17T07:36:32.340943] [INFO ] [MAIN ] HIPO: Loaded 22908 primary data records. [2025-09-17T07:36:33.178126] [DEBUG] [MAIN ] HIMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:33.179133] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-09-17T07:36:33.180787] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-17T07:36:33.210582] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-09-17T07:36:33.211124] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-17T07:36:33.212942] [INFO ] [MAIN ] Derivative Progress: 943/2172 symbols completed. HIMS took 1.2s. Estimated remaining: 7m 41s. Rate: 160.0 symbols/min [2025-09-17T07:36:33.210854] [DEBUG] [MAIN ] HIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:33.215319] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 24130 primary records. [2025-09-17T07:36:33.215462] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-17T07:36:33.246270] [DEBUG] [MAIN ] HIPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:33.246064] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-09-17T07:36:33.246444] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-17T07:36:33.247059] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 22908 primary records. [2025-09-17T07:36:33.249658] [INFO ] [MAIN ] Derivative Progress: 944/2172 symbols completed. HIO took 1.1s. Estimated remaining: 7m 40s. Rate: 160.1 symbols/min [2025-09-17T07:36:33.249759] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-17T07:36:33.265896] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-09-17T07:36:33.265977] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-17T07:36:33.268531] [INFO ] [MAIN ] Derivative Progress: 945/2172 symbols completed. HIPO took 1.1s. Estimated remaining: 7m 39s. Rate: 160.3 symbols/min [2025-09-17T07:36:33.269282] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:33.269771] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:33.269891] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:33.292000] [DEBUG] [LOCAL ] HIX: Loaded 20301 existing records from primary storage. [2025-09-17T07:36:33.292343] [INFO ] [MAIN ] HIX: Loaded 20301 primary data records. [2025-09-17T07:36:33.462361] [DEBUG] [LOCAL ] HIW: Loaded 44891 existing records from primary storage. [2025-09-17T07:36:33.515144] [INFO ] [MAIN ] HIW: Loaded 44891 primary data records. [2025-09-17T07:36:33.638588] [DEBUG] [LOCAL ] HL: Loaded 53670 existing records from primary storage. [2025-09-17T07:36:33.745372] [INFO ] [MAIN ] HL: Loaded 53670 primary data records. [2025-09-17T07:36:34.315066] [DEBUG] [MAIN ] HIX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:34.316463] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20301 primary records. [2025-09-17T07:36:34.317720] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-17T07:36:34.348979] [DEBUG] [MAIN ] HIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:34.353173] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-09-17T07:36:34.354221] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-17T07:36:34.356197] [INFO ] [MAIN ] Derivative Progress: 946/2172 symbols completed. HIX took 1.1s. Estimated remaining: 7m 40s. Rate: 160.0 symbols/min [2025-09-17T07:36:34.354068] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44891 primary records. [2025-09-17T07:36:34.356691] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-17T07:36:34.357118] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:34.374801] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-09-17T07:36:34.375129] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-17T07:36:34.377516] [INFO ] [MAIN ] Derivative Progress: 947/2172 symbols completed. HIW took 1.1s. Estimated remaining: 7m 39s. Rate: 160.1 symbols/min [2025-09-17T07:36:34.379375] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:34.394337] [DEBUG] [MAIN ] HL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:34.395386] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53670 primary records. [2025-09-17T07:36:34.395479] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-17T07:36:34.412307] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-09-17T07:36:34.412506] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-17T07:36:34.415287] [INFO ] [MAIN ] Derivative Progress: 948/2172 symbols completed. HL took 1.1s. Estimated remaining: 7m 38s. Rate: 160.3 symbols/min [2025-09-17T07:36:34.415735] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:34.460001] [DEBUG] [LOCAL ] HLF: Loaded 48961 existing records from primary storage. [2025-09-17T07:36:34.460274] [INFO ] [MAIN ] HLF: Loaded 48961 primary data records. [2025-09-17T07:36:34.568461] [DEBUG] [LOCAL ] HLI: Loaded 31508 existing records from primary storage. [2025-09-17T07:36:34.579988] [INFO ] [MAIN ] HLI: Loaded 31508 primary data records. [2025-09-17T07:36:34.580422] [DEBUG] [LOCAL ] HLIO: Loaded 28192 existing records from primary storage. [2025-09-17T07:36:34.641501] [INFO ] [MAIN ] HLIO: Loaded 28192 primary data records. [2025-09-17T07:36:35.463942] [DEBUG] [MAIN ] HLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:35.474813] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 31508 primary records. [2025-09-17T07:36:35.473634] [DEBUG] [MAIN ] HLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:35.475121] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-17T07:36:35.476487] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48961 primary records. [2025-09-17T07:36:35.477495] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-17T07:36:35.506544] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-09-17T07:36:35.521211] [DEBUG] [MAIN ] HLIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:35.522345] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-17T07:36:35.528544] [INFO ] [MAIN ] Derivative Progress: 949/2172 symbols completed. HLI took 1.1s. Estimated remaining: 7m 39s. Rate: 159.9 symbols/min [2025-09-17T07:36:35.529691] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:35.525596] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 28192 primary records. [2025-09-17T07:36:35.533119] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-09-17T07:36:35.533387] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-17T07:36:35.533345] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-17T07:36:35.535353] [INFO ] [MAIN ] Derivative Progress: 950/2172 symbols completed. HLF took 1.2s. Estimated remaining: 7m 38s. Rate: 160.1 symbols/min [2025-09-17T07:36:35.536034] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:35.553035] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-09-17T07:36:35.553178] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-17T07:36:35.555861] [INFO ] [MAIN ] Derivative Progress: 951/2172 symbols completed. HLIO took 1.1s. Estimated remaining: 7m 37s. Rate: 160.3 symbols/min [2025-09-17T07:36:35.556414] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:35.583727] [DEBUG] [LOCAL ] HLLY: Loaded 32988 existing records from primary storage. [2025-09-17T07:36:35.583931] [INFO ] [MAIN ] HLLY: Loaded 32988 primary data records. [2025-09-17T07:36:35.809542] [DEBUG] [LOCAL ] HLN: Loaded 53082 existing records from primary storage. [2025-09-17T07:36:35.932157] [INFO ] [MAIN ] HLN: Loaded 53082 primary data records. [2025-09-17T07:36:35.973710] [DEBUG] [LOCAL ] HLT: Loaded 50770 existing records from primary storage. [2025-09-17T07:36:36.008844] [INFO ] [MAIN ] HLT: Loaded 50770 primary data records. [2025-09-17T07:36:36.574281] [DEBUG] [MAIN ] HLLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:36.576077] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 32988 primary records. [2025-09-17T07:36:36.576215] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-17T07:36:36.594812] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-09-17T07:36:36.595428] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-17T07:36:36.598795] [INFO ] [MAIN ] Derivative Progress: 952/2172 symbols completed. HLLY took 1.1s. Estimated remaining: 7m 38s. Rate: 160.0 symbols/min [2025-09-17T07:36:36.599918] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:36.621421] [DEBUG] [MAIN ] HLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:36.622868] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53082 primary records. [2025-09-17T07:36:36.622994] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-17T07:36:36.646711] [DEBUG] [MAIN ] HLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:36.651756] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50770 primary records. [2025-09-17T07:36:36.652065] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-17T07:36:36.665821] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-09-17T07:36:36.673584] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-17T07:36:36.676068] [INFO ] [MAIN ] Derivative Progress: 953/2172 symbols completed. HLN took 1.1s. Estimated remaining: 7m 37s. Rate: 160.1 symbols/min [2025-09-17T07:36:36.680585] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:36.685413] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-09-17T07:36:36.686356] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-17T07:36:36.701882] [INFO ] [MAIN ] Derivative Progress: 954/2172 symbols completed. HLT took 1.1s. Estimated remaining: 7m 36s. Rate: 160.2 symbols/min [2025-09-17T07:36:36.704081] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:36.706908] [DEBUG] [LOCAL ] HLX: Loaded 48229 existing records from primary storage. [2025-09-17T07:36:36.707523] [INFO ] [MAIN ] HLX: Loaded 48229 primary data records. [2025-09-17T07:36:36.925060] [DEBUG] [LOCAL ] HMN: Loaded 23184 existing records from primary storage. [2025-09-17T07:36:36.943861] [INFO ] [MAIN ] HMN: Loaded 23184 primary data records. [2025-09-17T07:36:37.047073] [DEBUG] [LOCAL ] HMC: Loaded 47068 existing records from primary storage. [2025-09-17T07:36:37.095145] [INFO ] [MAIN ] HMC: Loaded 47068 primary data records. [2025-09-17T07:36:37.778569] [DEBUG] [MAIN ] HLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:37.780285] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 48229 primary records. [2025-09-17T07:36:37.780436] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-17T07:36:37.798957] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-09-17T07:36:37.799538] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-17T07:36:37.802395] [INFO ] [MAIN ] Derivative Progress: 955/2172 symbols completed. HLX took 1.2s. Estimated remaining: 7m 37s. Rate: 159.9 symbols/min [2025-09-17T07:36:37.802983] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:37.840023] [DEBUG] [MAIN ] HMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:37.840898] [DEBUG] [MAIN ] HMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:37.841951] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23184 primary records. [2025-09-17T07:36:37.843108] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 47068 primary records. [2025-09-17T07:36:37.843254] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-17T07:36:37.843542] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-17T07:36:37.892701] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-09-17T07:36:37.893676] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-09-17T07:36:37.893572] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-17T07:36:37.893882] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-17T07:36:37.897429] [INFO ] [MAIN ] Derivative Progress: 956/2172 symbols completed. HMC took 1.2s. Estimated remaining: 7m 36s. Rate: 160.0 symbols/min [2025-09-17T07:36:37.900595] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:37.900714] [INFO ] [MAIN ] Derivative Progress: 957/2172 symbols completed. HMN took 1.2s. Estimated remaining: 7m 35s. Rate: 160.2 symbols/min [2025-09-17T07:36:37.902144] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:37.917953] [DEBUG] [LOCAL ] HMY: Loaded 53124 existing records from primary storage. [2025-09-17T07:36:37.918186] [INFO ] [MAIN ] HMY: Loaded 53124 primary data records. [2025-09-17T07:36:38.206677] [DEBUG] [LOCAL ] HNI: Loaded 28780 existing records from primary storage. [2025-09-17T07:36:38.265478] [INFO ] [MAIN ] HNI: Loaded 28780 primary data records. [2025-09-17T07:36:38.392631] [DEBUG] [LOCAL ] HOG: Loaded 51307 existing records from primary storage. [2025-09-17T07:36:38.393114] [INFO ] [MAIN ] HOG: Loaded 51307 primary data records. [2025-09-17T07:36:38.896037] [DEBUG] [MAIN ] HMY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:38.897507] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53124 primary records. [2025-09-17T07:36:38.898127] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-17T07:36:38.917138] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-09-17T07:36:38.917664] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-17T07:36:38.920933] [INFO ] [MAIN ] Derivative Progress: 958/2172 symbols completed. HMY took 1.1s. Estimated remaining: 7m 35s. Rate: 159.9 symbols/min [2025-09-17T07:36:38.936365] [DEBUG] [MAIN ] HNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:38.937054] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 28780 primary records. [2025-09-17T07:36:38.937204] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-17T07:36:38.967431] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-09-17T07:36:38.967909] [DEBUG] [MAIN ] HOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:38.967969] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-17T07:36:38.970893] [INFO ] [MAIN ] Derivative Progress: 959/2172 symbols completed. HNI took 1.1s. Estimated remaining: 7m 35s. Rate: 160.1 symbols/min [2025-09-17T07:36:38.968630] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 51307 primary records. [2025-09-17T07:36:38.971113] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-17T07:36:38.987257] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-09-17T07:36:38.987359] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-17T07:36:38.990024] [INFO ] [MAIN ] Derivative Progress: 960/2172 symbols completed. HOG took 1.1s. Estimated remaining: 7m 34s. Rate: 160.2 symbols/min [2025-09-17T07:36:38.990672] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:38.990785] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:38.990914] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:39.008105] [DEBUG] [LOCAL ] HOV: Loaded 13734 existing records from primary storage. [2025-09-17T07:36:39.008407] [INFO ] [MAIN ] HOV: Loaded 13734 primary data records. [2025-09-17T07:36:39.267855] [DEBUG] [LOCAL ] HOMB: Loaded 43713 existing records from primary storage. [2025-09-17T07:36:39.348448] [DEBUG] [LOCAL ] HOUS: Loaded 43953 existing records from primary storage. [2025-09-17T07:36:39.348582] [INFO ] [MAIN ] HOMB: Loaded 43713 primary data records. [2025-09-17T07:36:39.349586] [INFO ] [MAIN ] HOUS: Loaded 43953 primary data records. [2025-09-17T07:36:40.021752] [DEBUG] [MAIN ] HOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:40.024124] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 13734 primary records. [2025-09-17T07:36:40.024469] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-17T07:36:40.043018] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-09-17T07:36:40.043672] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-17T07:36:40.046237] [INFO ] [MAIN ] Derivative Progress: 961/2172 symbols completed. HOV took 1.1s. Estimated remaining: 7m 34s. Rate: 159.9 symbols/min [2025-09-17T07:36:40.047037] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:40.068161] [DEBUG] [MAIN ] HOMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:40.069256] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43713 primary records. [2025-09-17T07:36:40.069427] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-17T07:36:40.095179] [DEBUG] [MAIN ] HOUS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:36:40.100481] [INFO ] [MAIN ] HOUS: Generated 1793 derivative records from 43953 primary records. [2025-09-17T07:36:40.099421] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-09-17T07:36:40.100791] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-17T07:36:40.100727] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-17T07:36:40.104073] [INFO ] [MAIN ] Derivative Progress: 962/2172 symbols completed. HOMB took 1.1s. Estimated remaining: 7m 34s. Rate: 160.1 symbols/min [2025-09-17T07:36:40.104726] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:40.135226] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1793 records). [2025-09-17T07:36:40.135436] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-17T07:36:40.138358] [INFO ] [MAIN ] Derivative Progress: 963/2172 symbols completed. HOUS took 1.1s. Estimated remaining: 7m 33s. Rate: 160.2 symbols/min [2025-09-17T07:36:40.138888] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:40.159147] [DEBUG] [LOCAL ] HP: Loaded 51688 existing records from primary storage. [2025-09-17T07:36:40.161466] [INFO ] [MAIN ] HP: Loaded 51688 primary data records. [2025-09-17T07:36:40.241133] [DEBUG] [LOCAL ] HPF: Loaded 7213 existing records from primary storage. [2025-09-17T07:36:40.268497] [INFO ] [MAIN ] HPF: Loaded 7213 primary data records. [2025-09-17T07:36:40.651568] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-17T07:36:40.779887] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-09-17T07:36:41.129450] [DEBUG] [MAIN ] HP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:41.134916] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51688 primary records. [2025-09-17T07:36:41.135207] [DEBUG] [MAIN ] HPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:41.136161] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-17T07:36:41.136962] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7213 primary records. [2025-09-17T07:36:41.137612] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-17T07:36:41.167654] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-09-17T07:36:41.169029] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-17T07:36:41.169484] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-09-17T07:36:41.172001] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-17T07:36:41.171903] [INFO ] [MAIN ] Derivative Progress: 964/2172 symbols completed. HP took 1.1s. Estimated remaining: 7m 33s. Rate: 159.9 symbols/min [2025-09-17T07:36:41.172217] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:41.174507] [INFO ] [MAIN ] Derivative Progress: 965/2172 symbols completed. HPF took 1.0s. Estimated remaining: 7m 32s. Rate: 160.1 symbols/min [2025-09-17T07:36:41.176195] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:41.192085] [DEBUG] [MAIN ] HPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:41.195147] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-09-17T07:36:41.195357] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-17T07:36:41.215855] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-09-17T07:36:41.214745] [DEBUG] [LOCAL ] HPI: Loaded 9802 existing records from primary storage. [2025-09-17T07:36:41.216039] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-17T07:36:41.216203] [INFO ] [MAIN ] HPI: Loaded 9802 primary data records. [2025-09-17T07:36:41.219009] [INFO ] [MAIN ] Derivative Progress: 966/2172 symbols completed. HPE took 1.1s. Estimated remaining: 7m 32s. Rate: 160.2 symbols/min [2025-09-17T07:36:41.264249] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:41.416522] [DEBUG] [LOCAL ] HPP: Loaded 50711 existing records from primary storage. [2025-09-17T07:36:41.433668] [INFO ] [MAIN ] HPP: Loaded 50711 primary data records. [2025-09-17T07:36:41.923561] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-09-17T07:36:41.925206] [INFO ] [MAIN ] HPQ: Loaded 53669 primary data records. [2025-09-17T07:36:42.125623] [DEBUG] [MAIN ] HPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:42.237403] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 9802 primary records. [2025-09-17T07:36:42.238052] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-17T07:36:42.256192] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-09-17T07:36:42.256810] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-17T07:36:42.259544] [INFO ] [MAIN ] Derivative Progress: 967/2172 symbols completed. HPI took 1.1s. Estimated remaining: 7m 32s. Rate: 159.9 symbols/min [2025-09-17T07:36:42.262008] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:42.279511] [DEBUG] [MAIN ] HPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:42.280542] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 50711 primary records. [2025-09-17T07:36:42.280677] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-17T07:36:42.303958] [DEBUG] [LOCAL ] HPS: Loaded 10289 existing records from primary storage. [2025-09-17T07:36:42.305776] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-09-17T07:36:42.305871] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-17T07:36:42.309149] [INFO ] [MAIN ] Derivative Progress: 968/2172 symbols completed. HPP took 1.1s. Estimated remaining: 7m 31s. Rate: 160.1 symbols/min [2025-09-17T07:36:42.305961] [INFO ] [MAIN ] HPS: Loaded 10289 primary data records. [2025-09-17T07:36:42.314767] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:42.510246] [DEBUG] [MAIN ] HPQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:42.534856] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53669 primary records. [2025-09-17T07:36:42.543672] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-17T07:36:42.656340] [DEBUG] [LOCAL ] HQH: Loaded 24949 existing records from primary storage. [2025-09-17T07:36:42.666408] [INFO ] [MAIN ] HQH: Loaded 24949 primary data records. [2025-09-17T07:36:42.811160] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-09-17T07:36:42.817900] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-17T07:36:42.820516] [INFO ] [MAIN ] Derivative Progress: 969/2172 symbols completed. HPQ took 1.6s. Estimated remaining: 7m 31s. Rate: 160.0 symbols/min [2025-09-17T07:36:42.873828] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:43.024719] [DEBUG] [MAIN ] HPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:43.027035] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10289 primary records. [2025-09-17T07:36:43.027221] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-17T07:36:43.034590] [DEBUG] [LOCAL ] HQL: Loaded 16177 existing records from primary storage. [2025-09-17T07:36:43.048898] [INFO ] [MAIN ] HQL: Loaded 16177 primary data records. [2025-09-17T07:36:43.123923] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-09-17T07:36:43.148286] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-17T07:36:43.162357] [INFO ] [MAIN ] Derivative Progress: 970/2172 symbols completed. HPS took 0.9s. Estimated remaining: 7m 31s. Rate: 160.0 symbols/min [2025-09-17T07:36:43.179229] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:43.431635] [DEBUG] [MAIN ] HQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:43.432706] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 24949 primary records. [2025-09-17T07:36:43.433221] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-17T07:36:43.455346] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-09-17T07:36:43.455900] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-17T07:36:43.458823] [INFO ] [MAIN ] Derivative Progress: 971/2172 symbols completed. HQH took 1.1s. Estimated remaining: 7m 30s. Rate: 160.1 symbols/min [2025-09-17T07:36:43.459495] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:43.499670] [DEBUG] [MAIN ] HQL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:43.500607] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 16177 primary records. [2025-09-17T07:36:43.515334] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-17T07:36:43.517130] [DEBUG] [LOCAL ] HR: Loaded 51981 existing records from primary storage. [2025-09-17T07:36:43.526893] [INFO ] [MAIN ] HR: Loaded 51981 primary data records. [2025-09-17T07:36:43.558777] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-09-17T07:36:43.629765] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-17T07:36:43.653551] [INFO ] [MAIN ] Derivative Progress: 972/2172 symbols completed. HQL took 0.8s. Estimated remaining: 7m 30s. Rate: 160.2 symbols/min [2025-09-17T07:36:43.670750] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:43.866252] [DEBUG] [LOCAL ] HRB: Loaded 48619 existing records from primary storage. [2025-09-17T07:36:43.876260] [INFO ] [MAIN ] HRB: Loaded 48619 primary data records. [2025-09-17T07:36:44.193972] [DEBUG] [LOCAL ] HRI: Loaded 33312 existing records from primary storage. [2025-09-17T07:36:44.194828] [INFO ] [MAIN ] HRI: Loaded 33312 primary data records. [2025-09-17T07:36:44.515940] [DEBUG] [MAIN ] HR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:44.516950] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 51981 primary records. [2025-09-17T07:36:44.518055] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-17T07:36:44.538954] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-09-17T07:36:44.541194] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-17T07:36:44.543464] [INFO ] [MAIN ] Derivative Progress: 973/2172 symbols completed. HR took 1.4s. Estimated remaining: 7m 30s. Rate: 159.9 symbols/min [2025-09-17T07:36:44.558729] [DEBUG] [MAIN ] HRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:44.559410] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48619 primary records. [2025-09-17T07:36:44.559746] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-17T07:36:44.576082] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-09-17T07:36:44.576295] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-17T07:36:44.578789] [INFO ] [MAIN ] Derivative Progress: 974/2172 symbols completed. HRB took 1.1s. Estimated remaining: 7m 29s. Rate: 160.1 symbols/min [2025-09-17T07:36:44.593754] [DEBUG] [MAIN ] HRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:44.594409] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 33312 primary records. [2025-09-17T07:36:44.594482] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-17T07:36:44.610254] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-09-17T07:36:44.610332] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-17T07:36:44.613117] [INFO ] [MAIN ] Derivative Progress: 975/2172 symbols completed. HRI took 0.9s. Estimated remaining: 7m 28s. Rate: 160.2 symbols/min [2025-09-17T07:36:44.613714] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:44.613780] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:44.614042] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:44.699358] [DEBUG] [LOCAL ] HRTG: Loaded 32087 existing records from primary storage. [2025-09-17T07:36:44.700147] [INFO ] [MAIN ] HRTG: Loaded 32087 primary data records. [2025-09-17T07:36:44.701093] [DEBUG] [LOCAL ] HRL: Loaded 53088 existing records from primary storage. [2025-09-17T07:36:44.701307] [INFO ] [MAIN ] HRL: Loaded 53088 primary data records. [2025-09-17T07:36:44.889800] [DEBUG] [LOCAL ] HSBC: Loaded 51293 existing records from primary storage. [2025-09-17T07:36:44.929958] [INFO ] [MAIN ] HSBC: Loaded 51293 primary data records. [2025-09-17T07:36:45.732175] [DEBUG] [MAIN ] HRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:45.733444] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53088 primary records. [2025-09-17T07:36:45.732465] [DEBUG] [MAIN ] HRTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:45.734243] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 32087 primary records. [2025-09-17T07:36:45.733619] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-17T07:36:45.735193] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-17T07:36:45.781295] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-09-17T07:36:45.780104] [DEBUG] [MAIN ] HSBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:45.782495] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-17T07:36:45.782443] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 51293 primary records. [2025-09-17T07:36:45.784065] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-09-17T07:36:45.786437] [INFO ] [MAIN ] Derivative Progress: 976/2172 symbols completed. HRTG took 1.2s. Estimated remaining: 7m 29s. Rate: 159.9 symbols/min [2025-09-17T07:36:45.784359] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-17T07:36:45.787999] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:45.786943] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-17T07:36:45.791365] [INFO ] [MAIN ] Derivative Progress: 977/2172 symbols completed. HRL took 1.2s. Estimated remaining: 7m 28s. Rate: 160.0 symbols/min [2025-09-17T07:36:45.804730] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:45.808448] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-09-17T07:36:45.808764] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-17T07:36:45.811709] [INFO ] [MAIN ] Derivative Progress: 978/2172 symbols completed. HSBC took 1.2s. Estimated remaining: 7m 27s. Rate: 160.2 symbols/min [2025-09-17T07:36:45.812225] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:45.826365] [DEBUG] [LOCAL ] HSHP: Loaded 15645 existing records from primary storage. [2025-09-17T07:36:45.826543] [INFO ] [MAIN ] HSHP: Loaded 15645 primary data records. [2025-09-17T07:36:45.931774] [DEBUG] [LOCAL ] HTD: Loaded 13409 existing records from primary storage. [2025-09-17T07:36:45.943320] [INFO ] [MAIN ] HTD: Loaded 13409 primary data records. [2025-09-17T07:36:46.270669] [DEBUG] [LOCAL ] HSY: Loaded 50531 existing records from primary storage. [2025-09-17T07:36:46.317250] [INFO ] [MAIN ] HSY: Loaded 50531 primary data records. [2025-09-17T07:36:46.783868] [DEBUG] [MAIN ] HSHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:46.785566] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 15645 primary records. [2025-09-17T07:36:46.785769] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-17T07:36:46.816159] [DEBUG] [MAIN ] HTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:46.817173] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-09-17T07:36:46.817860] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 13409 primary records. [2025-09-17T07:36:46.818282] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-17T07:36:46.818228] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-17T07:36:46.821193] [INFO ] [MAIN ] Derivative Progress: 979/2172 symbols completed. HSHP took 1.0s. Estimated remaining: 7m 28s. Rate: 159.9 symbols/min [2025-09-17T07:36:46.822300] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:46.838858] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-09-17T07:36:46.840483] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-17T07:36:46.842851] [INFO ] [MAIN ] Derivative Progress: 980/2172 symbols completed. HTD took 1.0s. Estimated remaining: 7m 27s. Rate: 160.1 symbols/min [2025-09-17T07:36:46.843381] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:46.856387] [DEBUG] [MAIN ] HSY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:46.857264] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50531 primary records. [2025-09-17T07:36:46.857503] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-17T07:36:46.876382] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-09-17T07:36:46.886745] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-17T07:36:46.889536] [INFO ] [MAIN ] Derivative Progress: 981/2172 symbols completed. HSY took 1.1s. Estimated remaining: 7m 26s. Rate: 160.2 symbols/min [2025-09-17T07:36:46.889981] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:46.912904] [DEBUG] [LOCAL ] HTH: Loaded 32999 existing records from primary storage. [2025-09-17T07:36:46.913250] [INFO ] [MAIN ] HTH: Loaded 32999 primary data records. [2025-09-17T07:36:47.054772] [DEBUG] [LOCAL ] HTGC: Loaded 47771 existing records from primary storage. [2025-09-17T07:36:47.079074] [INFO ] [MAIN ] HTGC: Loaded 47771 primary data records. [2025-09-17T07:36:47.330542] [DEBUG] [LOCAL ] HUBB: Loaded 37695 existing records from primary storage. [2025-09-17T07:36:47.342889] [INFO ] [MAIN ] HUBB: Loaded 37695 primary data records. [2025-09-17T07:36:47.901838] [DEBUG] [MAIN ] HTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:47.903034] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32999 primary records. [2025-09-17T07:36:47.903322] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-17T07:36:47.924235] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-09-17T07:36:47.925383] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-17T07:36:47.927913] [INFO ] [MAIN ] Derivative Progress: 982/2172 symbols completed. HTH took 1.1s. Estimated remaining: 7m 26s. Rate: 159.9 symbols/min [2025-09-17T07:36:47.936340] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:47.942477] [DEBUG] [MAIN ] HTGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:47.945211] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47771 primary records. [2025-09-17T07:36:47.945663] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-17T07:36:47.959834] [DEBUG] [MAIN ] HUBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:47.960545] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 37695 primary records. [2025-09-17T07:36:47.968136] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-17T07:36:47.992467] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-09-17T07:36:47.992540] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-09-17T07:36:47.992921] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-17T07:36:48.001279] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-17T07:36:48.004426] [INFO ] [MAIN ] Derivative Progress: 983/2172 symbols completed. HUBB took 1.1s. Estimated remaining: 7m 26s. Rate: 160.1 symbols/min [2025-09-17T07:36:48.007878] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:48.007983] [INFO ] [MAIN ] Derivative Progress: 984/2172 symbols completed. HTGC took 1.2s. Estimated remaining: 7m 25s. Rate: 160.2 symbols/min [2025-09-17T07:36:48.008317] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:48.025228] [DEBUG] [LOCAL ] HUBS: Loaded 39811 existing records from primary storage. [2025-09-17T07:36:48.025483] [INFO ] [MAIN ] HUBS: Loaded 39811 primary data records. [2025-09-17T07:36:48.369963] [DEBUG] [LOCAL ] HUM: Loaded 48832 existing records from primary storage. [2025-09-17T07:36:48.371203] [DEBUG] [LOCAL ] HUN: Loaded 53188 existing records from primary storage. [2025-09-17T07:36:48.371695] [INFO ] [MAIN ] HUN: Loaded 53188 primary data records. [2025-09-17T07:36:48.371558] [INFO ] [MAIN ] HUM: Loaded 48832 primary data records. [2025-09-17T07:36:48.968338] [DEBUG] [MAIN ] HUBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:48.971196] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 39811 primary records. [2025-09-17T07:36:48.972467] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-17T07:36:48.992545] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-09-17T07:36:48.992692] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-17T07:36:48.995327] [INFO ] [MAIN ] Derivative Progress: 985/2172 symbols completed. HUBS took 1.1s. Estimated remaining: 7m 25s. Rate: 160.0 symbols/min [2025-09-17T07:36:48.996217] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:49.013813] [DEBUG] [MAIN ] HUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:49.015982] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 48832 primary records. [2025-09-17T07:36:49.016580] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-17T07:36:49.041458] [DEBUG] [MAIN ] HUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:49.044046] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53188 primary records. [2025-09-17T07:36:49.045123] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-17T07:36:49.047137] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-09-17T07:36:49.047222] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-17T07:36:49.049348] [INFO ] [MAIN ] Derivative Progress: 986/2172 symbols completed. HUM took 1.0s. Estimated remaining: 7m 24s. Rate: 160.1 symbols/min [2025-09-17T07:36:49.062128] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:49.078222] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-09-17T07:36:49.078509] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-17T07:36:49.081501] [INFO ] [MAIN ] Derivative Progress: 987/2172 symbols completed. HUN took 1.1s. Estimated remaining: 7m 24s. Rate: 160.2 symbols/min [2025-09-17T07:36:49.082182] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:49.101285] [DEBUG] [LOCAL ] HUYA: Loaded 44349 existing records from primary storage. [2025-09-17T07:36:49.101728] [INFO ] [MAIN ] HUYA: Loaded 44349 primary data records. [2025-09-17T07:36:49.211697] [DEBUG] [LOCAL ] HVT: Loaded 16336 existing records from primary storage. [2025-09-17T07:36:49.215054] [INFO ] [MAIN ] HVT: Loaded 16336 primary data records. [2025-09-17T07:36:49.635890] [DEBUG] [LOCAL ] HWM: Loaded 53037 existing records from primary storage. [2025-09-17T07:36:49.743432] [INFO ] [MAIN ] HWM: Loaded 53037 primary data records. [2025-09-17T07:36:50.072931] [DEBUG] [MAIN ] HUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:50.074306] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 44349 primary records. [2025-09-17T07:36:50.074749] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-17T07:36:50.102849] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-09-17T07:36:50.108083] [DEBUG] [MAIN ] HVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:50.108946] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 16336 primary records. [2025-09-17T07:36:50.108153] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-17T07:36:50.109223] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-17T07:36:50.111443] [INFO ] [MAIN ] Derivative Progress: 988/2172 symbols completed. HUYA took 1.1s. Estimated remaining: 7m 24s. Rate: 160.0 symbols/min [2025-09-17T07:36:50.143269] [DEBUG] [MAIN ] HWM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:50.144311] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-09-17T07:36:50.145201] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 53037 primary records. [2025-09-17T07:36:50.145311] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-17T07:36:50.145420] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-17T07:36:50.147848] [INFO ] [MAIN ] Derivative Progress: 989/2172 symbols completed. HVT took 1.1s. Estimated remaining: 7m 23s. Rate: 160.1 symbols/min [2025-09-17T07:36:50.164346] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-09-17T07:36:50.164431] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-17T07:36:50.167585] [INFO ] [MAIN ] Derivative Progress: 990/2172 symbols completed. HWM took 1.1s. Estimated remaining: 7m 23s. Rate: 160.3 symbols/min [2025-09-17T07:36:50.168082] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:50.168411] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:50.168141] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:50.186861] [DEBUG] [LOCAL ] HY: Loaded 10442 existing records from primary storage. [2025-09-17T07:36:50.187047] [DEBUG] [LOCAL ] HYI: Loaded 8940 existing records from primary storage. [2025-09-17T07:36:50.187288] [INFO ] [MAIN ] HY: Loaded 10442 primary data records. [2025-09-17T07:36:50.187339] [INFO ] [MAIN ] HYI: Loaded 8940 primary data records. [2025-09-17T07:36:50.697658] [DEBUG] [LOCAL ] HXL: Loaded 46295 existing records from primary storage. [2025-09-17T07:36:50.833428] [INFO ] [MAIN ] HXL: Loaded 46295 primary data records. [2025-09-17T07:36:51.180458] [DEBUG] [MAIN ] HY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:51.187463] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 10442 primary records. [2025-09-17T07:36:51.186271] [DEBUG] [MAIN ] HYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:51.187733] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-17T07:36:51.188593] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 8940 primary records. [2025-09-17T07:36:51.189700] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-17T07:36:51.226589] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-09-17T07:36:51.228763] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-17T07:36:51.232302] [INFO ] [MAIN ] Derivative Progress: 991/2172 symbols completed. HYI took 1.1s. Estimated remaining: 7m 23s. Rate: 160.0 symbols/min [2025-09-17T07:36:51.233544] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:51.228703] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-09-17T07:36:51.234749] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-17T07:36:51.237882] [INFO ] [MAIN ] Derivative Progress: 992/2172 symbols completed. HY took 1.1s. Estimated remaining: 7m 22s. Rate: 160.1 symbols/min [2025-09-17T07:36:51.238562] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:51.252461] [DEBUG] [MAIN ] HXL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:51.253404] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 46295 primary records. [2025-09-17T07:36:51.254594] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-17T07:36:51.266406] [DEBUG] [LOCAL ] HYTR: Loaded 3222 existing records from primary storage. [2025-09-17T07:36:51.268132] [INFO ] [MAIN ] HYTR: Loaded 3222 primary data records. [2025-09-17T07:36:51.396616] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-09-17T07:36:51.419128] [DEBUG] [LOCAL ] HYT: Loaded 33193 existing records from primary storage. [2025-09-17T07:36:51.424526] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-17T07:36:51.448000] [INFO ] [MAIN ] HYT: Loaded 33193 primary data records. [2025-09-17T07:36:51.457005] [INFO ] [MAIN ] Derivative Progress: 993/2172 symbols completed. HXL took 1.3s. Estimated remaining: 7m 22s. Rate: 160.2 symbols/min [2025-09-17T07:36:51.510552] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:51.935922] [DEBUG] [LOCAL ] HZO: Loaded 29369 existing records from primary storage. [2025-09-17T07:36:51.937176] [INFO ] [MAIN ] HZO: Loaded 29369 primary data records. [2025-09-17T07:36:52.127996] [DEBUG] [MAIN ] HYTR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:36:52.132808] [INFO ] [MAIN ] HYTR: Generated 1792 derivative records from 3222 primary records. [2025-09-17T07:36:52.243127] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-17T07:36:52.263552] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1792 records). [2025-09-17T07:36:52.271351] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-17T07:36:52.277524] [INFO ] [MAIN ] Derivative Progress: 994/2172 symbols completed. HYTR took 1.0s. Estimated remaining: 7m 22s. Rate: 160.0 symbols/min [2025-09-17T07:36:52.278816] [DEBUG] [MAIN ] HYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:52.279026] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:52.279756] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33193 primary records. [2025-09-17T07:36:52.280429] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-17T07:36:52.300532] [DEBUG] [LOCAL ] IAE: Loaded 5736 existing records from primary storage. [2025-09-17T07:36:52.301438] [INFO ] [MAIN ] IAE: Loaded 5736 primary data records. [2025-09-17T07:36:52.302360] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-09-17T07:36:52.302526] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-17T07:36:52.316196] [INFO ] [MAIN ] Derivative Progress: 995/2172 symbols completed. HYT took 1.1s. Estimated remaining: 7m 21s. Rate: 160.1 symbols/min [2025-09-17T07:36:52.365099] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:52.479246] [DEBUG] [MAIN ] HZO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:52.507794] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29369 primary records. [2025-09-17T07:36:52.620533] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-17T07:36:52.641110] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-09-17T07:36:52.641297] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-17T07:36:52.644241] [INFO ] [MAIN ] Derivative Progress: 996/2172 symbols completed. HZO took 1.1s. Estimated remaining: 7m 21s. Rate: 160.2 symbols/min [2025-09-17T07:36:52.644530] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:52.683079] [DEBUG] [MAIN ] IAE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:52.697375] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 5736 primary records. [2025-09-17T07:36:52.698510] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-17T07:36:52.700143] [DEBUG] [LOCAL ] IAG: Loaded 53432 existing records from primary storage. [2025-09-17T07:36:52.700284] [INFO ] [MAIN ] IAG: Loaded 53432 primary data records. [2025-09-17T07:36:53.037445] [DEBUG] [LOCAL ] IBM: Loaded 53609 existing records from primary storage. [2025-09-17T07:36:53.035896] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-09-17T07:36:53.037769] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-17T07:36:53.037701] [INFO ] [MAIN ] IBM: Loaded 53609 primary data records. [2025-09-17T07:36:53.039884] [INFO ] [MAIN ] Derivative Progress: 997/2172 symbols completed. IAE took 0.8s. Estimated remaining: 7m 20s. Rate: 160.1 symbols/min [2025-09-17T07:36:53.040362] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:53.416090] [DEBUG] [MAIN ] IAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:53.416936] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53432 primary records. [2025-09-17T07:36:53.418773] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-17T07:36:53.435188] [DEBUG] [LOCAL ] IBN: Loaded 52924 existing records from primary storage. [2025-09-17T07:36:53.446308] [INFO ] [MAIN ] IBN: Loaded 52924 primary data records. [2025-09-17T07:36:53.552570] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-09-17T07:36:53.565348] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-17T07:36:53.606176] [INFO ] [MAIN ] Derivative Progress: 998/2172 symbols completed. IAG took 1.2s. Estimated remaining: 7m 20s. Rate: 160.1 symbols/min [2025-09-17T07:36:53.645708] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:53.646325] [DEBUG] [MAIN ] IBM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:53.761627] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53609 primary records. [2025-09-17T07:36:53.762608] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-17T07:36:53.783661] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-09-17T07:36:53.784315] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-17T07:36:53.786726] [INFO ] [MAIN ] Derivative Progress: 999/2172 symbols completed. IBM took 1.1s. Estimated remaining: 7m 19s. Rate: 160.1 symbols/min [2025-09-17T07:36:53.787120] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:53.813871] [DEBUG] [LOCAL ] IBP: Loaded 29528 existing records from primary storage. [2025-09-17T07:36:53.814140] [INFO ] [MAIN ] IBP: Loaded 29528 primary data records. [2025-09-17T07:36:53.884392] [DEBUG] [MAIN ] IBN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:53.939073] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52924 primary records. [2025-09-17T07:36:53.942545] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-17T07:36:54.161558] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-09-17T07:36:54.161999] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-17T07:36:54.161090] [DEBUG] [LOCAL ] IBTA: Loaded 38340 existing records from primary storage. [2025-09-17T07:36:54.162112] [INFO ] [MAIN ] IBTA: Loaded 38340 primary data records. [2025-09-17T07:36:54.164527] [INFO ] [MAIN ] Derivative Progress: 1000/2172 symbols completed. IBN took 1.1s. Estimated remaining: 7m 19s. Rate: 160.1 symbols/min [2025-09-17T07:36:54.186968] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:54.512680] [DEBUG] [MAIN ] IBP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:54.513495] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 29528 primary records. [2025-09-17T07:36:54.513695] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-17T07:36:54.545588] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-09-17T07:36:54.546958] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-17T07:36:54.549465] [INFO ] [MAIN ] Derivative Progress: 1001/2172 symbols completed. IBP took 0.9s. Estimated remaining: 7m 19s. Rate: 160.1 symbols/min [2025-09-17T07:36:54.550234] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:54.551630] [DEBUG] [LOCAL ] ICE: Loaded 53026 existing records from primary storage. [2025-09-17T07:36:54.552062] [INFO ] [MAIN ] ICE: Loaded 53026 primary data records. [2025-09-17T07:36:54.752379] [DEBUG] [MAIN ] IBTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:54.869953] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 38340 primary records. [2025-09-17T07:36:54.870401] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-17T07:36:54.901202] [DEBUG] [LOCAL ] ICL: Loaded 39049 existing records from primary storage. [2025-09-17T07:36:54.902341] [INFO ] [MAIN ] ICL: Loaded 39049 primary data records. [2025-09-17T07:36:54.903199] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-09-17T07:36:54.915011] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-17T07:36:54.927544] [INFO ] [MAIN ] Derivative Progress: 1002/2172 symbols completed. IBTA took 1.1s. Estimated remaining: 7m 18s. Rate: 160.1 symbols/min [2025-09-17T07:36:54.950136] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:55.272062] [DEBUG] [MAIN ] ICE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:55.274356] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53026 primary records. [2025-09-17T07:36:55.274735] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-17T07:36:55.308373] [DEBUG] [LOCAL ] IDA: Loaded 32109 existing records from primary storage. [2025-09-17T07:36:55.312246] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-09-17T07:36:55.311680] [INFO ] [MAIN ] IDA: Loaded 32109 primary data records. [2025-09-17T07:36:55.312830] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-17T07:36:55.320838] [INFO ] [MAIN ] Derivative Progress: 1003/2172 symbols completed. ICE took 1.1s. Estimated remaining: 7m 18s. Rate: 160.1 symbols/min [2025-09-17T07:36:55.523543] [DEBUG] [MAIN ] ICL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:55.549084] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 39049 primary records. [2025-09-17T07:36:55.597897] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-17T07:36:55.726382] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-09-17T07:36:55.728037] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-17T07:36:55.730443] [INFO ] [MAIN ] Derivative Progress: 1004/2172 symbols completed. ICL took 1.2s. Estimated remaining: 7m 18s. Rate: 160.1 symbols/min [2025-09-17T07:36:55.753715] [DEBUG] [MAIN ] IDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:55.754578] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32109 primary records. [2025-09-17T07:36:55.754684] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-17T07:36:55.779048] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-09-17T07:36:55.779282] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-17T07:36:55.782470] [INFO ] [MAIN ] Derivative Progress: 1005/2172 symbols completed. IDA took 0.8s. Estimated remaining: 7m 17s. Rate: 160.3 symbols/min [2025-09-17T07:36:55.783997] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:55.783500] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:55.784140] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:55.801978] [DEBUG] [LOCAL ] IDE: Loaded 8366 existing records from primary storage. [2025-09-17T07:36:55.802196] [INFO ] [MAIN ] IDE: Loaded 8366 primary data records. [2025-09-17T07:36:55.941811] [DEBUG] [LOCAL ] IDT: Loaded 17424 existing records from primary storage. [2025-09-17T07:36:55.971184] [INFO ] [MAIN ] IDT: Loaded 17424 primary data records. [2025-09-17T07:36:56.049073] [DEBUG] [LOCAL ] IEX: Loaded 38334 existing records from primary storage. [2025-09-17T07:36:56.081162] [INFO ] [MAIN ] IEX: Loaded 38334 primary data records. [2025-09-17T07:36:56.976584] [DEBUG] [MAIN ] IDE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:56.978530] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 8366 primary records. [2025-09-17T07:36:56.978912] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-17T07:36:57.009595] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-09-17T07:36:57.009893] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-17T07:36:57.010213] [DEBUG] [MAIN ] IDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:57.013399] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 17424 primary records. [2025-09-17T07:36:57.013868] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-17T07:36:57.012606] [INFO ] [MAIN ] Derivative Progress: 1006/2172 symbols completed. IDE took 1.2s. Estimated remaining: 7m 18s. Rate: 159.9 symbols/min [2025-09-17T07:36:57.014620] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:57.049888] [DEBUG] [MAIN ] IEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:57.052127] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38334 primary records. [2025-09-17T07:36:57.052495] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-17T07:36:57.053272] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-09-17T07:36:57.053880] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-17T07:36:57.056325] [INFO ] [MAIN ] Derivative Progress: 1007/2172 symbols completed. IDT took 1.3s. Estimated remaining: 7m 17s. Rate: 160.0 symbols/min [2025-09-17T07:36:57.056658] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:57.072942] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-09-17T07:36:57.073120] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-17T07:36:57.075941] [INFO ] [MAIN ] Derivative Progress: 1008/2172 symbols completed. IEX took 1.3s. Estimated remaining: 7m 16s. Rate: 160.2 symbols/min [2025-09-17T07:36:57.076256] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:57.103273] [DEBUG] [LOCAL ] IFN: Loaded 18414 existing records from primary storage. [2025-09-17T07:36:57.103484] [INFO ] [MAIN ] IFN: Loaded 18414 primary data records. [2025-09-17T07:36:57.208401] [DEBUG] [LOCAL ] IFF: Loaded 50928 existing records from primary storage. [2025-09-17T07:36:57.230902] [INFO ] [MAIN ] IFF: Loaded 50928 primary data records. [2025-09-17T07:36:57.274162] [DEBUG] [LOCAL ] IFS: Loaded 22964 existing records from primary storage. [2025-09-17T07:36:57.306558] [INFO ] [MAIN ] IFS: Loaded 22964 primary data records. [2025-09-17T07:36:58.099738] [DEBUG] [MAIN ] IFF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:58.101466] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 50928 primary records. [2025-09-17T07:36:58.100057] [DEBUG] [MAIN ] IFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:58.102391] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18414 primary records. [2025-09-17T07:36:58.101590] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-17T07:36:58.103434] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-17T07:36:58.151257] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-09-17T07:36:58.151969] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-17T07:36:58.150389] [DEBUG] [MAIN ] IFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:58.154610] [INFO ] [MAIN ] Derivative Progress: 1009/2172 symbols completed. IFN took 1.1s. Estimated remaining: 7m 16s. Rate: 159.9 symbols/min [2025-09-17T07:36:58.156046] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-09-17T07:36:58.157218] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 22964 primary records. [2025-09-17T07:36:58.156396] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:58.156227] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-17T07:36:58.157395] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-17T07:36:58.160090] [INFO ] [MAIN ] Derivative Progress: 1010/2172 symbols completed. IFF took 1.1s. Estimated remaining: 7m 16s. Rate: 160.0 symbols/min [2025-09-17T07:36:58.161450] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:58.182140] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-09-17T07:36:58.182334] [DEBUG] [LOCAL ] IGI: Loaded 3770 existing records from primary storage. [2025-09-17T07:36:58.182552] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-17T07:36:58.182626] [INFO ] [MAIN ] IGI: Loaded 3770 primary data records. [2025-09-17T07:36:58.185561] [INFO ] [MAIN ] Derivative Progress: 1011/2172 symbols completed. IFS took 1.1s. Estimated remaining: 7m 15s. Rate: 160.2 symbols/min [2025-09-17T07:36:58.206760] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:58.300206] [DEBUG] [LOCAL ] IGD: Loaded 19381 existing records from primary storage. [2025-09-17T07:36:58.300723] [INFO ] [MAIN ] IGD: Loaded 19381 primary data records. [2025-09-17T07:36:58.660238] [DEBUG] [LOCAL ] IGR: Loaded 30578 existing records from primary storage. [2025-09-17T07:36:58.686147] [INFO ] [MAIN ] IGR: Loaded 30578 primary data records. [2025-09-17T07:36:59.125150] [DEBUG] [MAIN ] IGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:59.126906] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3770 primary records. [2025-09-17T07:36:59.127476] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-17T07:36:59.147150] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-09-17T07:36:59.147692] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-17T07:36:59.157686] [INFO ] [MAIN ] Derivative Progress: 1012/2172 symbols completed. IGI took 1.0s. Estimated remaining: 7m 15s. Rate: 159.9 symbols/min [2025-09-17T07:36:59.162760] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:59.163369] [DEBUG] [MAIN ] IGD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:59.164839] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19381 primary records. [2025-09-17T07:36:59.165101] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-17T07:36:59.183144] [DEBUG] [LOCAL ] IH: Loaded 3612 existing records from primary storage. [2025-09-17T07:36:59.191291] [INFO ] [MAIN ] IH: Loaded 3612 primary data records. [2025-09-17T07:36:59.218504] [DEBUG] [MAIN ] IGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:36:59.235635] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30578 primary records. [2025-09-17T07:36:59.242718] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-17T07:36:59.317380] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-09-17T07:36:59.330731] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-17T07:36:59.333828] [INFO ] [MAIN ] Derivative Progress: 1013/2172 symbols completed. IGD took 1.2s. Estimated remaining: 7m 15s. Rate: 160.0 symbols/min [2025-09-17T07:36:59.345212] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:59.359544] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-09-17T07:36:59.381208] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-17T07:36:59.416244] [INFO ] [MAIN ] Derivative Progress: 1014/2172 symbols completed. IGR took 1.2s. Estimated remaining: 7m 14s. Rate: 160.1 symbols/min [2025-09-17T07:36:59.565290] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:36:59.569815] [DEBUG] [LOCAL ] IHD: Loaded 7200 existing records from primary storage. [2025-09-17T07:36:59.570162] [INFO ] [MAIN ] IHD: Loaded 7200 primary data records. [2025-09-17T07:36:59.875340] [DEBUG] [LOCAL ] IHG: Loaded 24896 existing records from primary storage. [2025-09-17T07:36:59.885468] [INFO ] [MAIN ] IHG: Loaded 24896 primary data records. [2025-09-17T07:37:00.170001] [DEBUG] [MAIN ] IH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:00.213964] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 3612 primary records. [2025-09-17T07:37:00.214295] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-17T07:37:00.235065] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-09-17T07:37:00.247912] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-17T07:37:00.248441] [DEBUG] [MAIN ] IHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:00.250989] [INFO ] [MAIN ] Derivative Progress: 1015/2172 symbols completed. IH took 1.1s. Estimated remaining: 7m 14s. Rate: 160.0 symbols/min [2025-09-17T07:37:00.252760] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7200 primary records. [2025-09-17T07:37:00.253235] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-17T07:37:00.253054] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:00.270213] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-09-17T07:37:00.270591] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-17T07:37:00.272937] [INFO ] [MAIN ] Derivative Progress: 1016/2172 symbols completed. IHD took 0.9s. Estimated remaining: 7m 13s. Rate: 160.1 symbols/min [2025-09-17T07:37:00.273562] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:00.296627] [DEBUG] [MAIN ] IHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:00.297778] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24896 primary records. [2025-09-17T07:37:00.298036] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-17T07:37:00.301659] [DEBUG] [LOCAL ] IIF: Loaded 5891 existing records from primary storage. [2025-09-17T07:37:00.302709] [INFO ] [MAIN ] IIF: Loaded 5891 primary data records. [2025-09-17T07:37:00.386102] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-09-17T07:37:00.445330] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-17T07:37:00.446571] [DEBUG] [LOCAL ] IHS: Loaded 39153 existing records from primary storage. [2025-09-17T07:37:00.449653] [INFO ] [MAIN ] Derivative Progress: 1017/2172 symbols completed. IHG took 0.9s. Estimated remaining: 7m 13s. Rate: 160.2 symbols/min [2025-09-17T07:37:00.471128] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:00.471245] [INFO ] [MAIN ] IHS: Loaded 39153 primary data records. [2025-09-17T07:37:00.836992] [DEBUG] [LOCAL ] IIIN: Loaded 16995 existing records from primary storage. [2025-09-17T07:37:00.837477] [INFO ] [MAIN ] IIIN: Loaded 16995 primary data records. [2025-09-17T07:37:01.320894] [DEBUG] [MAIN ] IIF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:01.322460] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5891 primary records. [2025-09-17T07:37:01.323041] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-17T07:37:01.357880] [DEBUG] [MAIN ] IHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:01.357432] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-09-17T07:37:01.358793] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 39153 primary records. [2025-09-17T07:37:01.358111] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-17T07:37:01.359127] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-17T07:37:01.361945] [INFO ] [MAIN ] Derivative Progress: 1018/2172 symbols completed. IIF took 1.1s. Estimated remaining: 7m 13s. Rate: 160.0 symbols/min [2025-09-17T07:37:01.381105] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-09-17T07:37:01.381266] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-17T07:37:01.383781] [INFO ] [MAIN ] Derivative Progress: 1019/2172 symbols completed. IHS took 1.1s. Estimated remaining: 7m 12s. Rate: 160.1 symbols/min [2025-09-17T07:37:01.396815] [DEBUG] [MAIN ] IIIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:01.397505] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16995 primary records. [2025-09-17T07:37:01.397581] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-17T07:37:01.412936] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-09-17T07:37:01.413076] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-17T07:37:01.415959] [INFO ] [MAIN ] Derivative Progress: 1020/2172 symbols completed. IIIN took 1.0s. Estimated remaining: 7m 11s. Rate: 160.2 symbols/min [2025-09-17T07:37:01.416551] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:01.416753] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:01.416657] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:01.435068] [DEBUG] [LOCAL ] IIM: Loaded 15974 existing records from primary storage. [2025-09-17T07:37:01.442617] [INFO ] [MAIN ] IIM: Loaded 15974 primary data records. [2025-09-17T07:37:01.588469] [DEBUG] [LOCAL ] IIPR: Loaded 29629 existing records from primary storage. [2025-09-17T07:37:01.595500] [DEBUG] [LOCAL ] IMAX: Loaded 42625 existing records from primary storage. [2025-09-17T07:37:01.588745] [INFO ] [MAIN ] IIPR: Loaded 29629 primary data records. [2025-09-17T07:37:01.611209] [INFO ] [MAIN ] IMAX: Loaded 42625 primary data records. [2025-09-17T07:37:02.438482] [DEBUG] [MAIN ] IIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:02.439691] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15974 primary records. [2025-09-17T07:37:02.440414] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-17T07:37:02.459052] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-09-17T07:37:02.460864] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-17T07:37:02.465282] [INFO ] [MAIN ] Derivative Progress: 1021/2172 symbols completed. IIM took 1.0s. Estimated remaining: 7m 12s. Rate: 160.0 symbols/min [2025-09-17T07:37:02.466509] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:02.491530] [DEBUG] [MAIN ] IMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:02.492002] [DEBUG] [MAIN ] IIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:02.492729] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 42625 primary records. [2025-09-17T07:37:02.493454] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29629 primary records. [2025-09-17T07:37:02.493607] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-17T07:37:02.493536] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-17T07:37:02.522954] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-09-17T07:37:02.523944] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-17T07:37:02.527148] [INFO ] [MAIN ] Derivative Progress: 1022/2172 symbols completed. IIPR took 1.1s. Estimated remaining: 7m 11s. Rate: 160.1 symbols/min [2025-09-17T07:37:02.527458] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:02.529379] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-09-17T07:37:02.529515] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-17T07:37:02.532308] [INFO ] [MAIN ] Derivative Progress: 1023/2172 symbols completed. IMAX took 1.1s. Estimated remaining: 7m 10s. Rate: 160.3 symbols/min [2025-09-17T07:37:02.532862] [INFO ] [MAIN ] ING: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:02.618076] [DEBUG] [LOCAL ] INFA: Loaded 50208 existing records from primary storage. [2025-09-17T07:37:02.619000] [INFO ] [MAIN ] INFA: Loaded 50208 primary data records. [2025-09-17T07:37:02.689513] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-09-17T07:37:02.729470] [INFO ] [MAIN ] INFY: Loaded 53598 primary data records. [2025-09-17T07:37:02.786191] [DEBUG] [LOCAL ] ING: Loaded 50913 existing records from primary storage. [2025-09-17T07:37:02.828377] [INFO ] [MAIN ] ING: Loaded 50913 primary data records. [2025-09-17T07:37:03.647767] [DEBUG] [MAIN ] INFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:03.650133] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 50208 primary records. [2025-09-17T07:37:03.650632] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-17T07:37:03.684248] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-09-17T07:37:03.683846] [DEBUG] [MAIN ] INFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:03.685281] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-17T07:37:03.687456] [INFO ] [MAIN ] Derivative Progress: 1024/2172 symbols completed. INFA took 1.2s. Estimated remaining: 7m 11s. Rate: 159.9 symbols/min [2025-09-17T07:37:03.690112] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:03.689224] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53598 primary records. [2025-09-17T07:37:03.690392] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-17T07:37:03.717103] [DEBUG] [MAIN ] ING: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:03.719179] [INFO ] [MAIN ] ING: Generated 1794 derivative records from 50913 primary records. [2025-09-17T07:37:03.719617] [DEBUG] [LOCAL ] ING: Saving derivative data. [2025-09-17T07:37:03.735448] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-09-17T07:37:03.736164] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-17T07:37:03.740020] [INFO ] [MAIN ] Derivative Progress: 1025/2172 symbols completed. INFY took 1.2s. Estimated remaining: 7m 10s. Rate: 160.1 symbols/min [2025-09-17T07:37:03.742081] [DEBUG] [LOCAL ] ING: Derivative data saved (1794 records). [2025-09-17T07:37:03.742505] [INFO ] [MAIN ] ING: Successfully saved derivative data. [2025-09-17T07:37:03.742434] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:03.745726] [INFO ] [MAIN ] Derivative Progress: 1026/2172 symbols completed. ING took 1.2s. Estimated remaining: 7m 9s. Rate: 160.2 symbols/min [2025-09-17T07:37:03.754571] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:03.770249] [DEBUG] [LOCAL ] INGM: Loaded 29364 existing records from primary storage. [2025-09-17T07:37:03.770476] [INFO ] [MAIN ] INGM: Loaded 29364 primary data records. [2025-09-17T07:37:04.102883] [DEBUG] [LOCAL ] INN: Loaded 41964 existing records from primary storage. [2025-09-17T07:37:04.103485] [DEBUG] [LOCAL ] INGR: Loaded 33338 existing records from primary storage. [2025-09-17T07:37:04.103781] [INFO ] [MAIN ] INGR: Loaded 33338 primary data records. [2025-09-17T07:37:04.103671] [INFO ] [MAIN ] INN: Loaded 41964 primary data records. [2025-09-17T07:37:04.723098] [DEBUG] [MAIN ] INGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:04.725176] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 29364 primary records. [2025-09-17T07:37:04.725992] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-17T07:37:04.747616] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-09-17T07:37:04.761470] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-17T07:37:04.761956] [DEBUG] [MAIN ] INGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:04.766716] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33338 primary records. [2025-09-17T07:37:04.765752] [INFO ] [MAIN ] Derivative Progress: 1027/2172 symbols completed. INGM took 1.1s. Estimated remaining: 7m 10s. Rate: 159.9 symbols/min [2025-09-17T07:37:04.767165] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:04.766893] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-17T07:37:04.791346] [DEBUG] [MAIN ] INN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:04.795219] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41964 primary records. [2025-09-17T07:37:04.795623] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-17T07:37:04.815236] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-09-17T07:37:04.815736] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-17T07:37:04.818147] [INFO ] [MAIN ] Derivative Progress: 1028/2172 symbols completed. INGR took 1.1s. Estimated remaining: 7m 9s. Rate: 160.1 symbols/min [2025-09-17T07:37:04.818937] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:04.818901] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-09-17T07:37:04.819229] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-17T07:37:04.822227] [INFO ] [MAIN ] Derivative Progress: 1029/2172 symbols completed. INN took 1.1s. Estimated remaining: 7m 8s. Rate: 160.2 symbols/min [2025-09-17T07:37:04.822806] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:04.849792] [DEBUG] [LOCAL ] INSP: Loaded 36440 existing records from primary storage. [2025-09-17T07:37:04.849991] [INFO ] [MAIN ] INSP: Loaded 36440 primary data records. [2025-09-17T07:37:05.072380] [DEBUG] [LOCAL ] INSW: Loaded 40774 existing records from primary storage. [2025-09-17T07:37:05.197892] [INFO ] [MAIN ] INSW: Loaded 40774 primary data records. [2025-09-17T07:37:05.199111] [DEBUG] [LOCAL ] INVH: Loaded 53145 existing records from primary storage. [2025-09-17T07:37:05.199513] [INFO ] [MAIN ] INVH: Loaded 53145 primary data records. [2025-09-17T07:37:05.859898] [DEBUG] [MAIN ] INSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:05.861456] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 36440 primary records. [2025-09-17T07:37:05.861947] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-17T07:37:05.882853] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-09-17T07:37:05.883137] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-17T07:37:05.886415] [INFO ] [MAIN ] Derivative Progress: 1030/2172 symbols completed. INSP took 1.1s. Estimated remaining: 7m 8s. Rate: 159.9 symbols/min [2025-09-17T07:37:05.888436] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:05.902772] [DEBUG] [MAIN ] INSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:05.904142] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 40774 primary records. [2025-09-17T07:37:05.905007] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-17T07:37:05.931727] [DEBUG] [MAIN ] INVH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:37:05.933230] [INFO ] [MAIN ] INVH: Generated 1793 derivative records from 53145 primary records. [2025-09-17T07:37:05.941194] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-17T07:37:05.954896] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-09-17T07:37:05.958530] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-17T07:37:05.958416] [DEBUG] [LOCAL ] INVH: Derivative data saved (1793 records). [2025-09-17T07:37:05.961018] [INFO ] [MAIN ] Derivative Progress: 1031/2172 symbols completed. INSW took 1.1s. Estimated remaining: 7m 8s. Rate: 160.1 symbols/min [2025-09-17T07:37:05.961810] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:05.961738] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-17T07:37:05.964898] [INFO ] [MAIN ] Derivative Progress: 1032/2172 symbols completed. INVH took 1.1s. Estimated remaining: 7m 7s. Rate: 160.2 symbols/min [2025-09-17T07:37:05.974032] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:05.975807] [DEBUG] [LOCAL ] INVX: Loaded 29384 existing records from primary storage. [2025-09-17T07:37:05.975926] [INFO ] [MAIN ] INVX: Loaded 29384 primary data records. [2025-09-17T07:37:06.312802] [DEBUG] [LOCAL ] IOT: Loaded 53473 existing records from primary storage. [2025-09-17T07:37:06.327128] [INFO ] [MAIN ] IOT: Loaded 53473 primary data records. [2025-09-17T07:37:06.359832] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-17T07:37:06.392939] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-09-17T07:37:06.811118] [DEBUG] [MAIN ] INVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:06.811945] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29384 primary records. [2025-09-17T07:37:06.922110] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-17T07:37:06.941215] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-09-17T07:37:06.941833] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-17T07:37:06.944510] [INFO ] [MAIN ] Derivative Progress: 1033/2172 symbols completed. INVX took 1.1s. Estimated remaining: 7m 7s. Rate: 160.0 symbols/min [2025-09-17T07:37:06.969816] [DEBUG] [MAIN ] IOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:06.983244] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53473 primary records. [2025-09-17T07:37:06.983817] [DEBUG] [MAIN ] IONQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:06.983874] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-17T07:37:06.984617] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-09-17T07:37:06.985297] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-17T07:37:07.024507] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-09-17T07:37:07.024870] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-09-17T07:37:07.025092] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-17T07:37:07.025195] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-17T07:37:07.027882] [INFO ] [MAIN ] Derivative Progress: 1034/2172 symbols completed. IONQ took 1.1s. Estimated remaining: 7m 6s. Rate: 160.1 symbols/min [2025-09-17T07:37:07.030449] [INFO ] [MAIN ] Derivative Progress: 1035/2172 symbols completed. IOT took 1.1s. Estimated remaining: 7m 6s. Rate: 160.2 symbols/min [2025-09-17T07:37:07.031289] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:07.031408] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:07.032067] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:07.075606] [DEBUG] [LOCAL ] IPI: Loaded 21385 existing records from primary storage. [2025-09-17T07:37:07.076024] [INFO ] [MAIN ] IPI: Loaded 21385 primary data records. [2025-09-17T07:37:07.226660] [DEBUG] [LOCAL ] IPG: Loaded 53335 existing records from primary storage. [2025-09-17T07:37:07.292674] [DEBUG] [LOCAL ] IP: Loaded 53330 existing records from primary storage. [2025-09-17T07:37:07.387560] [INFO ] [MAIN ] IPG: Loaded 53335 primary data records. [2025-09-17T07:37:07.387733] [INFO ] [MAIN ] IP: Loaded 53330 primary data records. [2025-09-17T07:37:08.047221] [DEBUG] [MAIN ] IPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:08.048227] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21385 primary records. [2025-09-17T07:37:08.048611] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-17T07:37:08.067185] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-09-17T07:37:08.067351] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-17T07:37:08.070342] [INFO ] [MAIN ] Derivative Progress: 1036/2172 symbols completed. IPI took 1.0s. Estimated remaining: 7m 6s. Rate: 160.0 symbols/min [2025-09-17T07:37:08.070997] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:08.101956] [DEBUG] [MAIN ] IPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:08.101731] [DEBUG] [MAIN ] IP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:08.102621] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53335 primary records. [2025-09-17T07:37:08.103584] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53330 primary records. [2025-09-17T07:37:08.103812] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-17T07:37:08.103993] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-17T07:37:08.144108] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-09-17T07:37:08.145395] [DEBUG] [LOCAL ] IQI: Loaded 18105 existing records from primary storage. [2025-09-17T07:37:08.146208] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-17T07:37:08.148505] [INFO ] [MAIN ] Derivative Progress: 1037/2172 symbols completed. IPG took 1.1s. Estimated remaining: 7m 5s. Rate: 160.1 symbols/min [2025-09-17T07:37:08.148992] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:08.149058] [INFO ] [MAIN ] IQI: Loaded 18105 primary data records. [2025-09-17T07:37:08.149821] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-09-17T07:37:08.155268] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-17T07:37:08.173612] [INFO ] [MAIN ] Derivative Progress: 1038/2172 symbols completed. IP took 1.1s. Estimated remaining: 7m 5s. Rate: 160.2 symbols/min [2025-09-17T07:37:08.189131] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:08.504495] [DEBUG] [LOCAL ] IQV: Loaded 50594 existing records from primary storage. [2025-09-17T07:37:08.505554] [DEBUG] [LOCAL ] IR: Loaded 52700 existing records from primary storage. [2025-09-17T07:37:08.505688] [INFO ] [MAIN ] IQV: Loaded 50594 primary data records. [2025-09-17T07:37:08.506729] [INFO ] [MAIN ] IR: Loaded 52700 primary data records. [2025-09-17T07:37:08.730386] [DEBUG] [MAIN ] IQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:08.731143] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 18105 primary records. [2025-09-17T07:37:08.747153] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-17T07:37:09.177173] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-09-17T07:37:09.178421] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-17T07:37:09.181227] [INFO ] [MAIN ] Derivative Progress: 1039/2172 symbols completed. IQI took 1.1s. Estimated remaining: 7m 5s. Rate: 160.0 symbols/min [2025-09-17T07:37:09.181962] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:09.223504] [DEBUG] [MAIN ] IR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:09.223062] [DEBUG] [MAIN ] IQV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:09.224389] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52700 primary records. [2025-09-17T07:37:09.225461] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-17T07:37:09.225335] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50594 primary records. [2025-09-17T07:37:09.226331] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-17T07:37:09.249800] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-09-17T07:37:09.264498] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-17T07:37:09.273017] [INFO ] [MAIN ] Derivative Progress: 1040/2172 symbols completed. IR took 1.1s. Estimated remaining: 7m 4s. Rate: 160.1 symbols/min [2025-09-17T07:37:09.276286] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:09.279022] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-09-17T07:37:09.279218] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-17T07:37:09.284303] [INFO ] [MAIN ] Derivative Progress: 1041/2172 symbols completed. IQV took 1.1s. Estimated remaining: 7m 3s. Rate: 160.2 symbols/min [2025-09-17T07:37:09.284868] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:09.300516] [DEBUG] [LOCAL ] IRM: Loaded 49594 existing records from primary storage. [2025-09-17T07:37:09.300778] [INFO ] [MAIN ] IRM: Loaded 49594 primary data records. [2025-09-17T07:37:09.456134] [DEBUG] [LOCAL ] IRS: Loaded 21041 existing records from primary storage. [2025-09-17T07:37:09.491898] [INFO ] [MAIN ] IRS: Loaded 21041 primary data records. [2025-09-17T07:37:09.805289] [DEBUG] [LOCAL ] IRT: Loaded 50449 existing records from primary storage. [2025-09-17T07:37:09.809792] [INFO ] [MAIN ] IRT: Loaded 50449 primary data records. [2025-09-17T07:37:10.239701] [DEBUG] [MAIN ] IRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:10.240435] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49594 primary records. [2025-09-17T07:37:10.240831] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-17T07:37:10.259876] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-09-17T07:37:10.262344] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-17T07:37:10.264624] [INFO ] [MAIN ] Derivative Progress: 1042/2172 symbols completed. IRM took 1.1s. Estimated remaining: 7m 4s. Rate: 160.0 symbols/min [2025-09-17T07:37:10.272820] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:10.279424] [DEBUG] [MAIN ] IRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:10.280355] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 21041 primary records. [2025-09-17T07:37:10.280768] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-17T07:37:10.301936] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-09-17T07:37:10.302211] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-17T07:37:10.304693] [INFO ] [MAIN ] Derivative Progress: 1043/2172 symbols completed. IRS took 1.0s. Estimated remaining: 7m 3s. Rate: 160.1 symbols/min [2025-09-17T07:37:10.305085] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:10.315601] [DEBUG] [LOCAL ] ISD: Loaded 15843 existing records from primary storage. [2025-09-17T07:37:10.315915] [INFO ] [MAIN ] ISD: Loaded 15843 primary data records. [2025-09-17T07:37:10.349815] [DEBUG] [MAIN ] IRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:10.393105] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50449 primary records. [2025-09-17T07:37:10.420589] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-17T07:37:10.532099] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-09-17T07:37:10.648712] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-17T07:37:10.661896] [INFO ] [MAIN ] Derivative Progress: 1044/2172 symbols completed. IRT took 1.4s. Estimated remaining: 7m 3s. Rate: 160.1 symbols/min [2025-09-17T07:37:10.663366] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:10.664527] [DEBUG] [LOCAL ] IT: Loaded 40982 existing records from primary storage. [2025-09-17T07:37:10.667482] [INFO ] [MAIN ] IT: Loaded 40982 primary data records. [2025-09-17T07:37:10.980753] [DEBUG] [LOCAL ] ITGR: Loaded 31609 existing records from primary storage. [2025-09-17T07:37:10.981163] [INFO ] [MAIN ] ITGR: Loaded 31609 primary data records. [2025-09-17T07:37:11.152824] [DEBUG] [MAIN ] ISD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:11.250158] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15843 primary records. [2025-09-17T07:37:11.336269] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-17T07:37:11.370732] [DEBUG] [MAIN ] IT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:11.372948] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 40982 primary records. [2025-09-17T07:37:11.375042] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-09-17T07:37:11.373051] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-17T07:37:11.375441] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-17T07:37:11.377758] [INFO ] [MAIN ] Derivative Progress: 1045/2172 symbols completed. ISD took 1.1s. Estimated remaining: 7m 3s. Rate: 160.0 symbols/min [2025-09-17T07:37:11.378483] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:11.396231] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-09-17T07:37:11.397192] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-17T07:37:11.400910] [INFO ] [MAIN ] Derivative Progress: 1046/2172 symbols completed. IT took 1.1s. Estimated remaining: 7m 2s. Rate: 160.1 symbols/min [2025-09-17T07:37:11.401248] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:11.417233] [DEBUG] [MAIN ] ITGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:11.417965] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31609 primary records. [2025-09-17T07:37:11.418057] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-17T07:37:11.443020] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-09-17T07:37:11.443126] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-17T07:37:11.445905] [INFO ] [MAIN ] Derivative Progress: 1047/2172 symbols completed. ITGR took 0.8s. Estimated remaining: 7m 1s. Rate: 160.3 symbols/min [2025-09-17T07:37:11.446680] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:11.459245] [DEBUG] [LOCAL ] ITT: Loaded 33531 existing records from primary storage. [2025-09-17T07:37:11.459397] [INFO ] [MAIN ] ITT: Loaded 33531 primary data records. [2025-09-17T07:37:11.761175] [DEBUG] [LOCAL ] ITUB: Loaded 53304 existing records from primary storage. [2025-09-17T07:37:11.803152] [INFO ] [MAIN ] ITUB: Loaded 53304 primary data records. [2025-09-17T07:37:11.927975] [DEBUG] [LOCAL ] ITW: Loaded 46545 existing records from primary storage. [2025-09-17T07:37:11.977590] [INFO ] [MAIN ] ITW: Loaded 46545 primary data records. [2025-09-17T07:37:12.435931] [DEBUG] [MAIN ] ITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:12.437075] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 33531 primary records. [2025-09-17T07:37:12.437672] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-17T07:37:12.458601] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-09-17T07:37:12.458813] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-17T07:37:12.461308] [INFO ] [MAIN ] Derivative Progress: 1048/2172 symbols completed. ITT took 1.1s. Estimated remaining: 7m 1s. Rate: 160.0 symbols/min [2025-09-17T07:37:12.474852] [DEBUG] [MAIN ] ITUB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:12.475566] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53304 primary records. [2025-09-17T07:37:12.476151] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-17T07:37:12.493977] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-09-17T07:37:12.494133] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-17T07:37:12.497835] [INFO ] [MAIN ] Derivative Progress: 1049/2172 symbols completed. ITUB took 1.1s. Estimated remaining: 7m 1s. Rate: 160.2 symbols/min [2025-09-17T07:37:12.512287] [DEBUG] [MAIN ] ITW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:12.513048] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 46545 primary records. [2025-09-17T07:37:12.513126] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-17T07:37:12.529121] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-09-17T07:37:12.529260] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-17T07:37:12.531785] [INFO ] [MAIN ] Derivative Progress: 1050/2172 symbols completed. ITW took 1.1s. Estimated remaining: 6m 60s. Rate: 160.3 symbols/min [2025-09-17T07:37:12.532487] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:12.532737] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:12.532948] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:12.580792] [DEBUG] [LOCAL ] IVT: Loaded 31028 existing records from primary storage. [2025-09-17T07:37:12.581153] [INFO ] [MAIN ] IVT: Loaded 31028 primary data records. [2025-09-17T07:37:12.717709] [DEBUG] [LOCAL ] IVR: Loaded 47725 existing records from primary storage. [2025-09-17T07:37:12.717984] [INFO ] [MAIN ] IVR: Loaded 47725 primary data records. [2025-09-17T07:37:12.813599] [DEBUG] [LOCAL ] IVZ: Loaded 53141 existing records from primary storage. [2025-09-17T07:37:12.902541] [INFO ] [MAIN ] IVZ: Loaded 53141 primary data records. [2025-09-17T07:37:13.600554] [DEBUG] [MAIN ] IVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:13.601683] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 31028 primary records. [2025-09-17T07:37:13.602080] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-17T07:37:13.624080] [DEBUG] [MAIN ] IVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:13.628355] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 47725 primary records. [2025-09-17T07:37:13.628884] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-17T07:37:13.643741] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-09-17T07:37:13.646844] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-17T07:37:13.658055] [INFO ] [MAIN ] Derivative Progress: 1051/2172 symbols completed. IVT took 1.1s. Estimated remaining: 7m 0s. Rate: 160.0 symbols/min [2025-09-17T07:37:13.663494] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:13.664336] [DEBUG] [MAIN ] IVZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:13.668809] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-09-17T07:37:13.667629] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53141 primary records. [2025-09-17T07:37:13.668972] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-17T07:37:13.669069] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-17T07:37:13.671953] [INFO ] [MAIN ] Derivative Progress: 1052/2172 symbols completed. IVR took 1.1s. Estimated remaining: 6m 60s. Rate: 160.1 symbols/min [2025-09-17T07:37:13.672578] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:13.689190] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-09-17T07:37:13.694909] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-17T07:37:13.697539] [INFO ] [MAIN ] Derivative Progress: 1053/2172 symbols completed. IVZ took 1.2s. Estimated remaining: 6m 59s. Rate: 160.3 symbols/min [2025-09-17T07:37:13.697888] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:13.712398] [DEBUG] [LOCAL ] IX: Loaded 22934 existing records from primary storage. [2025-09-17T07:37:13.712827] [INFO ] [MAIN ] IX: Loaded 22934 primary data records. [2025-09-17T07:37:13.922508] [DEBUG] [LOCAL ] J: Loaded 40591 existing records from primary storage. [2025-09-17T07:37:13.925276] [INFO ] [MAIN ] J: Loaded 40591 primary data records. [2025-09-17T07:37:14.113547] [DEBUG] [LOCAL ] JBGS: Loaded 42383 existing records from primary storage. [2025-09-17T07:37:14.141664] [INFO ] [MAIN ] JBGS: Loaded 42383 primary data records. [2025-09-17T07:37:14.669603] [DEBUG] [MAIN ] IX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:14.670849] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22934 primary records. [2025-09-17T07:37:14.671712] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-17T07:37:14.692714] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-09-17T07:37:14.693411] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-17T07:37:14.695754] [INFO ] [MAIN ] Derivative Progress: 1054/2172 symbols completed. IX took 1.0s. Estimated remaining: 6m 59s. Rate: 160.0 symbols/min [2025-09-17T07:37:14.696136] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:14.714805] [DEBUG] [MAIN ] J: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:14.715855] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40591 primary records. [2025-09-17T07:37:14.716157] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-17T07:37:14.746723] [DEBUG] [MAIN ] JBGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:14.749944] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-09-17T07:37:14.748408] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42383 primary records. [2025-09-17T07:37:14.750194] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-17T07:37:14.750270] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-17T07:37:14.753173] [INFO ] [MAIN ] Derivative Progress: 1055/2172 symbols completed. J took 1.1s. Estimated remaining: 6m 58s. Rate: 160.2 symbols/min [2025-09-17T07:37:14.761322] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:14.780030] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-09-17T07:37:14.780287] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-17T07:37:14.783319] [INFO ] [MAIN ] Derivative Progress: 1056/2172 symbols completed. JBGS took 1.1s. Estimated remaining: 6m 58s. Rate: 160.3 symbols/min [2025-09-17T07:37:14.783698] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:14.802952] [DEBUG] [LOCAL ] JBI: Loaded 44256 existing records from primary storage. [2025-09-17T07:37:14.803312] [INFO ] [MAIN ] JBI: Loaded 44256 primary data records. [2025-09-17T07:37:14.933879] [DEBUG] [LOCAL ] JBND: Loaded 24961 existing records from primary storage. [2025-09-17T07:37:14.956184] [INFO ] [MAIN ] JBND: Loaded 24961 primary data records. [2025-09-17T07:37:15.247056] [DEBUG] [LOCAL ] JBL: Loaded 48381 existing records from primary storage. [2025-09-17T07:37:15.264834] [INFO ] [MAIN ] JBL: Loaded 48381 primary data records. [2025-09-17T07:37:15.806954] [DEBUG] [MAIN ] JBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:15.808879] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 44256 primary records. [2025-09-17T07:37:15.809609] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-17T07:37:15.831935] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-09-17T07:37:15.832964] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-17T07:37:15.835925] [INFO ] [MAIN ] Derivative Progress: 1057/2172 symbols completed. JBI took 1.1s. Estimated remaining: 6m 58s. Rate: 160.0 symbols/min [2025-09-17T07:37:15.849310] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:15.849783] [DEBUG] [MAIN ] JBND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:15.850957] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 24961 primary records. [2025-09-17T07:37:15.851395] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-17T07:37:15.873101] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-09-17T07:37:15.876538] [DEBUG] [LOCAL ] JCE: Loaded 6270 existing records from primary storage. [2025-09-17T07:37:15.876833] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-17T07:37:15.886901] [INFO ] [MAIN ] JCE: Loaded 6270 primary data records. [2025-09-17T07:37:15.886804] [INFO ] [MAIN ] Derivative Progress: 1058/2172 symbols completed. JBND took 1.1s. Estimated remaining: 6m 57s. Rate: 160.1 symbols/min [2025-09-17T07:37:15.928794] [DEBUG] [MAIN ] JBL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:15.928901] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:15.964534] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48381 primary records. [2025-09-17T07:37:15.972895] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-17T07:37:16.211013] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-09-17T07:37:16.221588] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-17T07:37:16.224393] [INFO ] [MAIN ] Derivative Progress: 1059/2172 symbols completed. JBL took 1.5s. Estimated remaining: 6m 57s. Rate: 160.2 symbols/min [2025-09-17T07:37:16.225055] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:16.260731] [DEBUG] [LOCAL ] JEF: Loaded 49988 existing records from primary storage. [2025-09-17T07:37:16.261234] [INFO ] [MAIN ] JEF: Loaded 49988 primary data records. [2025-09-17T07:37:16.391630] [DEBUG] [MAIN ] JCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:16.413845] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 6270 primary records. [2025-09-17T07:37:16.464716] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-17T07:37:16.587492] [DEBUG] [LOCAL ] JELD: Loaded 46260 existing records from primary storage. [2025-09-17T07:37:16.620491] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-09-17T07:37:16.620887] [INFO ] [MAIN ] JELD: Loaded 46260 primary data records. [2025-09-17T07:37:16.621059] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-17T07:37:16.624244] [INFO ] [MAIN ] Derivative Progress: 1060/2172 symbols completed. JCE took 0.8s. Estimated remaining: 6m 57s. Rate: 160.2 symbols/min [2025-09-17T07:37:16.629725] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:16.760824] [DEBUG] [LOCAL ] JEQ: Loaded 8973 existing records from primary storage. [2025-09-17T07:37:16.823191] [INFO ] [MAIN ] JEQ: Loaded 8973 primary data records. [2025-09-17T07:37:17.147632] [DEBUG] [MAIN ] JEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:17.148471] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 49988 primary records. [2025-09-17T07:37:17.311294] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-17T07:37:17.330502] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-09-17T07:37:17.331389] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-17T07:37:17.334135] [INFO ] [MAIN ] Derivative Progress: 1061/2172 symbols completed. JEF took 1.4s. Estimated remaining: 6m 57s. Rate: 160.0 symbols/min [2025-09-17T07:37:17.335113] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:17.354521] [DEBUG] [MAIN ] JELD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:17.355709] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46260 primary records. [2025-09-17T07:37:17.356023] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-17T07:37:17.383949] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-09-17T07:37:17.384260] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-17T07:37:17.399598] [INFO ] [MAIN ] Derivative Progress: 1062/2172 symbols completed. JELD took 1.2s. Estimated remaining: 6m 56s. Rate: 160.1 symbols/min [2025-09-17T07:37:17.400286] [DEBUG] [MAIN ] JEQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:17.410281] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:17.411112] [INFO ] [MAIN ] JEQ: Generated 1794 derivative records from 8973 primary records. [2025-09-17T07:37:17.412060] [DEBUG] [LOCAL ] JFR: Loaded 30705 existing records from primary storage. [2025-09-17T07:37:17.412231] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-17T07:37:17.412493] [INFO ] [MAIN ] JFR: Loaded 30705 primary data records. [2025-09-17T07:37:17.520812] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1794 records). [2025-09-17T07:37:17.542569] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-17T07:37:17.543288] [DEBUG] [LOCAL ] JGH: Loaded 10937 existing records from primary storage. [2025-09-17T07:37:17.546467] [INFO ] [MAIN ] Derivative Progress: 1063/2172 symbols completed. JEQ took 0.9s. Estimated remaining: 6m 55s. Rate: 160.2 symbols/min [2025-09-17T07:37:17.557175] [INFO ] [MAIN ] JGH: Loaded 10937 primary data records. [2025-09-17T07:37:18.083377] [DEBUG] [MAIN ] JFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:18.084489] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30705 primary records. [2025-09-17T07:37:18.084935] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-17T07:37:18.103167] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-09-17T07:37:18.103522] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-17T07:37:18.106718] [INFO ] [MAIN ] Derivative Progress: 1064/2172 symbols completed. JFR took 0.8s. Estimated remaining: 6m 55s. Rate: 160.2 symbols/min [2025-09-17T07:37:18.121663] [DEBUG] [MAIN ] JGH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:18.122462] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 10937 primary records. [2025-09-17T07:37:18.122547] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-17T07:37:18.138831] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-09-17T07:37:18.138929] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-17T07:37:18.142907] [INFO ] [MAIN ] Derivative Progress: 1065/2172 symbols completed. JGH took 0.7s. Estimated remaining: 6m 54s. Rate: 160.3 symbols/min [2025-09-17T07:37:18.143797] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:18.143915] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:18.144156] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:18.153660] [DEBUG] [LOCAL ] JHS: Loaded 2951 existing records from primary storage. [2025-09-17T07:37:18.157122] [INFO ] [MAIN ] JHS: Loaded 2951 primary data records. [2025-09-17T07:37:18.156867] [DEBUG] [LOCAL ] JHI: Loaded 3757 existing records from primary storage. [2025-09-17T07:37:18.178525] [INFO ] [MAIN ] JHI: Loaded 3757 primary data records. [2025-09-17T07:37:18.691305] [DEBUG] [LOCAL ] JHG: Loaded 48272 existing records from primary storage. [2025-09-17T07:37:18.805754] [INFO ] [MAIN ] JHG: Loaded 48272 primary data records. [2025-09-17T07:37:19.186709] [DEBUG] [MAIN ] JHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:19.189018] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2951 primary records. [2025-09-17T07:37:19.190009] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-17T07:37:19.217584] [DEBUG] [MAIN ] JHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:19.219861] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-09-17T07:37:19.218886] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3757 primary records. [2025-09-17T07:37:19.220519] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-17T07:37:19.220913] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-17T07:37:19.223439] [INFO ] [MAIN ] Derivative Progress: 1066/2172 symbols completed. JHS took 1.1s. Estimated remaining: 6m 55s. Rate: 160.0 symbols/min [2025-09-17T07:37:19.223702] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:19.244380] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-09-17T07:37:19.245668] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-17T07:37:19.249552] [INFO ] [MAIN ] Derivative Progress: 1067/2172 symbols completed. JHI took 1.1s. Estimated remaining: 6m 54s. Rate: 160.2 symbols/min [2025-09-17T07:37:19.250769] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:19.266105] [DEBUG] [MAIN ] JHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:19.267110] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 48272 primary records. [2025-09-17T07:37:19.267391] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-17T07:37:19.306562] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-09-17T07:37:19.307242] [DEBUG] [LOCAL ] JILL: Loaded 16699 existing records from primary storage. [2025-09-17T07:37:19.307560] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-17T07:37:19.307668] [INFO ] [MAIN ] JILL: Loaded 16699 primary data records. [2025-09-17T07:37:19.311427] [INFO ] [MAIN ] Derivative Progress: 1068/2172 symbols completed. JHG took 1.2s. Estimated remaining: 6m 53s. Rate: 160.3 symbols/min [2025-09-17T07:37:19.358721] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:19.428864] [DEBUG] [LOCAL ] JHX: Loaded 48640 existing records from primary storage. [2025-09-17T07:37:19.432570] [INFO ] [MAIN ] JHX: Loaded 48640 primary data records. [2025-09-17T07:37:19.793837] [DEBUG] [LOCAL ] JKS: Loaded 40291 existing records from primary storage. [2025-09-17T07:37:19.823554] [INFO ] [MAIN ] JKS: Loaded 40291 primary data records. [2025-09-17T07:37:20.289261] [DEBUG] [MAIN ] JILL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:20.291870] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16699 primary records. [2025-09-17T07:37:20.292525] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-17T07:37:20.321697] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-09-17T07:37:20.326390] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-17T07:37:20.328972] [INFO ] [MAIN ] Derivative Progress: 1069/2172 symbols completed. JILL took 1.1s. Estimated remaining: 6m 54s. Rate: 160.0 symbols/min [2025-09-17T07:37:20.329984] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:20.329810] [DEBUG] [MAIN ] JHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:20.331440] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 48640 primary records. [2025-09-17T07:37:20.331806] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-17T07:37:20.352690] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-09-17T07:37:20.352834] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-17T07:37:20.355201] [INFO ] [MAIN ] Derivative Progress: 1070/2172 symbols completed. JHX took 1.1s. Estimated remaining: 6m 53s. Rate: 160.2 symbols/min [2025-09-17T07:37:20.363218] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:20.369002] [DEBUG] [MAIN ] JKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:20.379477] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 40291 primary records. [2025-09-17T07:37:20.380630] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-17T07:37:20.391974] [DEBUG] [LOCAL ] JLS: Loaded 4101 existing records from primary storage. [2025-09-17T07:37:20.395819] [INFO ] [MAIN ] JLS: Loaded 4101 primary data records. [2025-09-17T07:37:20.482704] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-09-17T07:37:20.503194] [DEBUG] [LOCAL ] JLL: Loaded 32308 existing records from primary storage. [2025-09-17T07:37:20.502195] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-17T07:37:20.518005] [INFO ] [MAIN ] Derivative Progress: 1071/2172 symbols completed. JKS took 1.2s. Estimated remaining: 6m 52s. Rate: 160.2 symbols/min [2025-09-17T07:37:20.518094] [INFO ] [MAIN ] JLL: Loaded 32308 primary data records. [2025-09-17T07:37:20.530024] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:21.102162] [DEBUG] [LOCAL ] JMIA: Loaded 50420 existing records from primary storage. [2025-09-17T07:37:21.103054] [INFO ] [MAIN ] JMIA: Loaded 50420 primary data records. [2025-09-17T07:37:21.424362] [DEBUG] [MAIN ] JLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:21.425147] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4101 primary records. [2025-09-17T07:37:21.425833] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-17T07:37:21.447159] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-09-17T07:37:21.447536] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-17T07:37:21.462728] [INFO ] [MAIN ] Derivative Progress: 1072/2172 symbols completed. JLS took 1.1s. Estimated remaining: 6m 52s. Rate: 160.0 symbols/min [2025-09-17T07:37:21.463995] [DEBUG] [MAIN ] JLL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:21.464329] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:21.466277] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 32308 primary records. [2025-09-17T07:37:21.467892] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-17T07:37:21.485577] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-09-17T07:37:21.486042] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-17T07:37:21.488600] [INFO ] [MAIN ] Derivative Progress: 1073/2172 symbols completed. JLL took 1.2s. Estimated remaining: 6m 52s. Rate: 160.2 symbols/min [2025-09-17T07:37:21.489412] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:21.509922] [DEBUG] [MAIN ] JMIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:21.511106] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 50420 primary records. [2025-09-17T07:37:21.511416] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-17T07:37:21.528130] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-09-17T07:37:21.528237] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-17T07:37:21.530959] [INFO ] [MAIN ] Derivative Progress: 1074/2172 symbols completed. JMIA took 1.0s. Estimated remaining: 6m 51s. Rate: 160.3 symbols/min [2025-09-17T07:37:21.531309] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:21.602276] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-17T07:37:21.604539] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-09-17T07:37:21.613250] [DEBUG] [LOCAL ] JOBY: Loaded 53798 existing records from primary storage. [2025-09-17T07:37:21.649630] [DEBUG] [LOCAL ] JOE: Loaded 24912 existing records from primary storage. [2025-09-17T07:37:21.668619] [INFO ] [MAIN ] JOBY: Loaded 53798 primary data records. [2025-09-17T07:37:21.682775] [INFO ] [MAIN ] JOE: Loaded 24912 primary data records. [2025-09-17T07:37:22.530945] [DEBUG] [MAIN ] JNJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:22.531740] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-09-17T07:37:22.532561] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-17T07:37:22.553350] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-09-17T07:37:22.561332] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-17T07:37:22.563303] [INFO ] [MAIN ] Derivative Progress: 1075/2172 symbols completed. JNJ took 1.1s. Estimated remaining: 6m 51s. Rate: 160.0 symbols/min [2025-09-17T07:37:22.569786] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:22.570303] [DEBUG] [MAIN ] JOBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:22.571406] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53798 primary records. [2025-09-17T07:37:22.573689] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-17T07:37:22.601000] [DEBUG] [MAIN ] JOE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:22.609557] [DEBUG] [LOCAL ] JOF: Loaded 7173 existing records from primary storage. [2025-09-17T07:37:22.608794] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 24912 primary records. [2025-09-17T07:37:22.611161] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-17T07:37:22.610954] [INFO ] [MAIN ] JOF: Loaded 7173 primary data records. [2025-09-17T07:37:22.635790] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-09-17T07:37:22.682721] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-17T07:37:22.705467] [INFO ] [MAIN ] Derivative Progress: 1076/2172 symbols completed. JOBY took 1.2s. Estimated remaining: 6m 51s. Rate: 160.1 symbols/min [2025-09-17T07:37:22.739658] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:22.824040] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-09-17T07:37:22.937035] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-17T07:37:22.940031] [INFO ] [MAIN ] Derivative Progress: 1077/2172 symbols completed. JOE took 1.4s. Estimated remaining: 6m 50s. Rate: 160.2 symbols/min [2025-09-17T07:37:22.941520] [INFO ] [MAIN ] JPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:22.952445] [DEBUG] [LOCAL ] JPI: Loaded 5442 existing records from primary storage. [2025-09-17T07:37:22.953354] [INFO ] [MAIN ] JPI: Loaded 5442 primary data records. [2025-09-17T07:37:23.093587] [DEBUG] [LOCAL ] JPC: Loaded 37342 existing records from primary storage. [2025-09-17T07:37:23.104242] [INFO ] [MAIN ] JPC: Loaded 37342 primary data records. [2025-09-17T07:37:23.418334] [DEBUG] [MAIN ] JOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:23.441122] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 7173 primary records. [2025-09-17T07:37:23.457255] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-17T07:37:23.646292] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-09-17T07:37:23.647369] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-17T07:37:23.650287] [INFO ] [MAIN ] Derivative Progress: 1078/2172 symbols completed. JOF took 1.1s. Estimated remaining: 6m 50s. Rate: 160.0 symbols/min [2025-09-17T07:37:23.670604] [DEBUG] [MAIN ] JPI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:23.672959] [INFO ] [MAIN ] JPI: Generated 1794 derivative records from 5442 primary records. [2025-09-17T07:37:23.673193] [DEBUG] [LOCAL ] JPI: Saving derivative data. [2025-09-17T07:37:23.700824] [DEBUG] [LOCAL ] JPI: Derivative data saved (1794 records). [2025-09-17T07:37:23.697149] [DEBUG] [MAIN ] JPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:23.701462] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37342 primary records. [2025-09-17T07:37:23.701503] [INFO ] [MAIN ] JPI: Successfully saved derivative data. [2025-09-17T07:37:23.703908] [INFO ] [MAIN ] Derivative Progress: 1079/2172 symbols completed. JPI took 0.8s. Estimated remaining: 6m 49s. Rate: 160.2 symbols/min [2025-09-17T07:37:23.703970] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-17T07:37:23.719299] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-09-17T07:37:23.719383] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-17T07:37:23.722171] [INFO ] [MAIN ] Derivative Progress: 1080/2172 symbols completed. JPC took 1.0s. Estimated remaining: 6m 49s. Rate: 160.3 symbols/min [2025-09-17T07:37:23.722662] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:23.723126] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:23.723415] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:23.736951] [DEBUG] [LOCAL ] JRS: Loaded 10999 existing records from primary storage. [2025-09-17T07:37:23.737370] [INFO ] [MAIN ] JRS: Loaded 10999 primary data records. [2025-09-17T07:37:23.931932] [DEBUG] [LOCAL ] JQC: Loaded 33855 existing records from primary storage. [2025-09-17T07:37:23.949753] [INFO ] [MAIN ] JQC: Loaded 33855 primary data records. [2025-09-17T07:37:24.187399] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-17T07:37:24.229586] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-09-17T07:37:24.715036] [DEBUG] [MAIN ] JRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:24.716503] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 10999 primary records. [2025-09-17T07:37:24.716960] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-17T07:37:24.735130] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-09-17T07:37:24.735769] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-17T07:37:24.737888] [INFO ] [MAIN ] Derivative Progress: 1081/2172 symbols completed. JRS took 1.0s. Estimated remaining: 6m 49s. Rate: 160.1 symbols/min [2025-09-17T07:37:24.738630] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:24.755370] [DEBUG] [MAIN ] JQC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:24.756495] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 33855 primary records. [2025-09-17T07:37:24.756687] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-17T07:37:24.775927] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-09-17T07:37:24.788582] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-17T07:37:24.791157] [INFO ] [MAIN ] Derivative Progress: 1082/2172 symbols completed. JQC took 1.1s. Estimated remaining: 6m 48s. Rate: 160.2 symbols/min [2025-09-17T07:37:24.791591] [DEBUG] [MAIN ] JPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:24.792077] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:24.793173] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-09-17T07:37:24.793698] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-17T07:37:24.810608] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-09-17T07:37:24.810853] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-17T07:37:24.823163] [INFO ] [MAIN ] Derivative Progress: 1083/2172 symbols completed. JPM took 1.1s. Estimated remaining: 6m 48s. Rate: 160.3 symbols/min [2025-09-17T07:37:24.825942] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:24.843386] [DEBUG] [LOCAL ] JXN: Loaded 46086 existing records from primary storage. [2025-09-17T07:37:24.843875] [INFO ] [MAIN ] JXN: Loaded 46086 primary data records. [2025-09-17T07:37:24.968005] [DEBUG] [LOCAL ] KAI: Loaded 13670 existing records from primary storage. [2025-09-17T07:37:24.968411] [INFO ] [MAIN ] KAI: Loaded 13670 primary data records. [2025-09-17T07:37:25.317253] [DEBUG] [LOCAL ] K: Loaded 49749 existing records from primary storage. [2025-09-17T07:37:25.348338] [INFO ] [MAIN ] K: Loaded 49749 primary data records. [2025-09-17T07:37:25.836076] [DEBUG] [MAIN ] JXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:25.837871] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 46086 primary records. [2025-09-17T07:37:25.838247] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-17T07:37:25.856583] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-09-17T07:37:25.859204] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-17T07:37:25.861570] [INFO ] [MAIN ] Derivative Progress: 1084/2172 symbols completed. JXN took 1.1s. Estimated remaining: 6m 48s. Rate: 160.1 symbols/min [2025-09-17T07:37:25.862153] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:25.876541] [DEBUG] [MAIN ] KAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:25.877781] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13670 primary records. [2025-09-17T07:37:25.878161] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-17T07:37:25.911354] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-09-17T07:37:25.912157] [DEBUG] [MAIN ] K: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:25.913078] [INFO ] [MAIN ] K: Generated 1794 derivative records from 49749 primary records. [2025-09-17T07:37:25.912215] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-17T07:37:25.913302] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-17T07:37:25.915872] [INFO ] [MAIN ] Derivative Progress: 1085/2172 symbols completed. KAI took 1.1s. Estimated remaining: 6m 47s. Rate: 160.2 symbols/min [2025-09-17T07:37:25.916240] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:25.934580] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-09-17T07:37:25.944771] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-17T07:37:25.947654] [INFO ] [MAIN ] Derivative Progress: 1086/2172 symbols completed. K took 1.2s. Estimated remaining: 6m 46s. Rate: 160.3 symbols/min [2025-09-17T07:37:25.948071] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:25.964954] [DEBUG] [LOCAL ] KAR: Loaded 40152 existing records from primary storage. [2025-09-17T07:37:25.965228] [INFO ] [MAIN ] KAR: Loaded 40152 primary data records. [2025-09-17T07:37:26.121992] [DEBUG] [LOCAL ] KBDC: Loaded 20428 existing records from primary storage. [2025-09-17T07:37:26.169459] [DEBUG] [LOCAL ] KB: Loaded 24566 existing records from primary storage. [2025-09-17T07:37:26.173868] [INFO ] [MAIN ] KBDC: Loaded 20428 primary data records. [2025-09-17T07:37:26.174209] [INFO ] [MAIN ] KB: Loaded 24566 primary data records. [2025-09-17T07:37:27.011372] [DEBUG] [MAIN ] KAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:27.013553] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 40152 primary records. [2025-09-17T07:37:27.014008] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-17T07:37:27.044036] [DEBUG] [MAIN ] KBDC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:37:27.048543] [INFO ] [MAIN ] KBDC: Generated 1793 derivative records from 20428 primary records. [2025-09-17T07:37:27.049374] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-17T07:37:27.049268] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-09-17T07:37:27.050234] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-17T07:37:27.052550] [INFO ] [MAIN ] Derivative Progress: 1087/2172 symbols completed. KAR took 1.2s. Estimated remaining: 6m 47s. Rate: 160.0 symbols/min [2025-09-17T07:37:27.053866] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:27.074700] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1793 records). [2025-09-17T07:37:27.075299] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-17T07:37:27.079129] [INFO ] [MAIN ] Derivative Progress: 1088/2172 symbols completed. KBDC took 1.1s. Estimated remaining: 6m 46s. Rate: 160.2 symbols/min [2025-09-17T07:37:27.094245] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:27.094000] [DEBUG] [MAIN ] KB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:27.095562] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 24566 primary records. [2025-09-17T07:37:27.096106] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-17T07:37:27.114229] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-09-17T07:37:27.114758] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-17T07:37:27.120019] [INFO ] [MAIN ] Derivative Progress: 1089/2172 symbols completed. KB took 1.2s. Estimated remaining: 6m 45s. Rate: 160.3 symbols/min [2025-09-17T07:37:27.120786] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:27.175681] [DEBUG] [LOCAL ] KBH: Loaded 48821 existing records from primary storage. [2025-09-17T07:37:27.176047] [INFO ] [MAIN ] KBH: Loaded 48821 primary data records. [2025-09-17T07:37:27.297275] [DEBUG] [LOCAL ] KBR: Loaded 48401 existing records from primary storage. [2025-09-17T07:37:27.321103] [INFO ] [MAIN ] KBR: Loaded 48401 primary data records. [2025-09-17T07:37:27.652195] [DEBUG] [LOCAL ] KD: Loaded 52317 existing records from primary storage. [2025-09-17T07:37:27.674923] [INFO ] [MAIN ] KD: Loaded 52317 primary data records. [2025-09-17T07:37:28.222475] [DEBUG] [MAIN ] KBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:28.224242] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48821 primary records. [2025-09-17T07:37:28.225011] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-17T07:37:28.258514] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-09-17T07:37:28.260101] [DEBUG] [MAIN ] KBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:28.261510] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 48401 primary records. [2025-09-17T07:37:28.260751] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-17T07:37:28.261865] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-17T07:37:28.264460] [INFO ] [MAIN ] Derivative Progress: 1090/2172 symbols completed. KBH took 1.2s. Estimated remaining: 6m 46s. Rate: 160.0 symbols/min [2025-09-17T07:37:28.266018] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:28.286144] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-09-17T07:37:28.287875] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-17T07:37:28.293668] [INFO ] [MAIN ] Derivative Progress: 1091/2172 symbols completed. KBR took 1.2s. Estimated remaining: 6m 45s. Rate: 160.1 symbols/min [2025-09-17T07:37:28.298406] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:28.298590] [DEBUG] [LOCAL ] KEN: Loaded 4689 existing records from primary storage. [2025-09-17T07:37:28.299681] [INFO ] [MAIN ] KEN: Loaded 4689 primary data records. [2025-09-17T07:37:28.320848] [DEBUG] [MAIN ] KD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:28.386537] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52317 primary records. [2025-09-17T07:37:28.416690] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-17T07:37:28.547089] [DEBUG] [LOCAL ] KEP: Loaded 30335 existing records from primary storage. [2025-09-17T07:37:28.666769] [INFO ] [MAIN ] KEP: Loaded 30335 primary data records. [2025-09-17T07:37:28.666894] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-09-17T07:37:28.695804] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-17T07:37:28.743776] [INFO ] [MAIN ] Derivative Progress: 1092/2172 symbols completed. KD took 1.6s. Estimated remaining: 6m 45s. Rate: 160.1 symbols/min [2025-09-17T07:37:28.796085] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:29.030305] [DEBUG] [MAIN ] KEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:29.031452] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4689 primary records. [2025-09-17T07:37:29.032113] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-17T07:37:29.060294] [DEBUG] [LOCAL ] KEX: Loaded 37680 existing records from primary storage. [2025-09-17T07:37:29.060940] [INFO ] [MAIN ] KEX: Loaded 37680 primary data records. [2025-09-17T07:37:29.156486] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-09-17T07:37:29.176307] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-17T07:37:29.184287] [INFO ] [MAIN ] Derivative Progress: 1093/2172 symbols completed. KEN took 0.9s. Estimated remaining: 6m 44s. Rate: 160.1 symbols/min [2025-09-17T07:37:29.272120] [DEBUG] [MAIN ] KEP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:29.341677] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 30335 primary records. [2025-09-17T07:37:29.431939] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-17T07:37:29.452635] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-09-17T07:37:29.453257] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-17T07:37:29.456031] [INFO ] [MAIN ] Derivative Progress: 1094/2172 symbols completed. KEP took 1.2s. Estimated remaining: 6m 44s. Rate: 160.1 symbols/min [2025-09-17T07:37:29.476769] [DEBUG] [MAIN ] KEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:29.477694] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 37680 primary records. [2025-09-17T07:37:29.477777] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-17T07:37:29.494766] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-09-17T07:37:29.494866] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-17T07:37:29.498198] [INFO ] [MAIN ] Derivative Progress: 1095/2172 symbols completed. KEX took 0.7s. Estimated remaining: 6m 43s. Rate: 160.2 symbols/min [2025-09-17T07:37:29.498862] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:29.499246] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:29.499113] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:29.507064] [DEBUG] [LOCAL ] KF: Loaded 2521 existing records from primary storage. [2025-09-17T07:37:29.507357] [INFO ] [MAIN ] KF: Loaded 2521 primary data records. [2025-09-17T07:37:29.723380] [DEBUG] [LOCAL ] KFRC: Loaded 19076 existing records from primary storage. [2025-09-17T07:37:29.833807] [DEBUG] [LOCAL ] KEYS: Loaded 43478 existing records from primary storage. [2025-09-17T07:37:29.833894] [INFO ] [MAIN ] KFRC: Loaded 19076 primary data records. [2025-09-17T07:37:29.834605] [INFO ] [MAIN ] KEYS: Loaded 43478 primary data records. [2025-09-17T07:37:30.468898] [DEBUG] [MAIN ] KF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:30.470949] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2521 primary records. [2025-09-17T07:37:30.471325] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-17T07:37:30.487099] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-09-17T07:37:30.487661] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-17T07:37:30.490031] [INFO ] [MAIN ] Derivative Progress: 1096/2172 symbols completed. KF took 1.0s. Estimated remaining: 6m 43s. Rate: 160.0 symbols/min [2025-09-17T07:37:30.490570] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:30.529938] [DEBUG] [LOCAL ] KFS: Loaded 8004 existing records from primary storage. [2025-09-17T07:37:30.530540] [DEBUG] [MAIN ] KFRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:30.531918] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 19076 primary records. [2025-09-17T07:37:30.532026] [INFO ] [MAIN ] KFS: Loaded 8004 primary data records. [2025-09-17T07:37:30.531121] [DEBUG] [MAIN ] KEYS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:30.543322] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-17T07:37:30.569009] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43478 primary records. [2025-09-17T07:37:30.608876] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-17T07:37:30.651341] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-09-17T07:37:30.701722] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-17T07:37:30.746051] [INFO ] [MAIN ] Derivative Progress: 1097/2172 symbols completed. KFRC took 1.2s. Estimated remaining: 6m 43s. Rate: 160.1 symbols/min [2025-09-17T07:37:30.863186] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:30.875079] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-09-17T07:37:30.875724] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-17T07:37:30.878321] [INFO ] [MAIN ] Derivative Progress: 1098/2172 symbols completed. KEYS took 1.4s. Estimated remaining: 6m 42s. Rate: 160.1 symbols/min [2025-09-17T07:37:30.878881] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:30.904079] [DEBUG] [MAIN ] KFS: Filtered 7001 bins outside market hours, 7823 incomplete bins [2025-09-17T07:37:30.905291] [INFO ] [MAIN ] KFS: Generated 1791 derivative records from 8004 primary records. [2025-09-17T07:37:30.913587] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-17T07:37:30.929420] [DEBUG] [LOCAL ] KFS: Derivative data saved (1791 records). [2025-09-17T07:37:30.930305] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-17T07:37:30.943155] [INFO ] [MAIN ] Derivative Progress: 1099/2172 symbols completed. KFS took 0.5s. Estimated remaining: 6m 42s. Rate: 160.3 symbols/min [2025-09-17T07:37:30.943537] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:30.945172] [DEBUG] [LOCAL ] KFY: Loaded 30758 existing records from primary storage. [2025-09-17T07:37:30.945596] [INFO ] [MAIN ] KFY: Loaded 30758 primary data records. [2025-09-17T07:37:31.150146] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-17T07:37:31.238373] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-09-17T07:37:31.457586] [DEBUG] [LOCAL ] KGS: Loaded 45743 existing records from primary storage. [2025-09-17T07:37:31.512327] [INFO ] [MAIN ] KGS: Loaded 45743 primary data records. [2025-09-17T07:37:31.987471] [DEBUG] [MAIN ] KFY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:31.988914] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 30758 primary records. [2025-09-17T07:37:31.989347] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-17T07:37:32.007357] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-09-17T07:37:32.007808] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-17T07:37:32.010492] [INFO ] [MAIN ] Derivative Progress: 1100/2172 symbols completed. KFY took 1.1s. Estimated remaining: 6m 42s. Rate: 160.0 symbols/min [2025-09-17T07:37:32.010938] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:32.029135] [DEBUG] [MAIN ] KGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:32.029837] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53699 primary records. [2025-09-17T07:37:32.030094] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-17T07:37:32.047232] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-09-17T07:37:32.047379] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-17T07:37:32.049677] [INFO ] [MAIN ] Derivative Progress: 1101/2172 symbols completed. KGC took 1.2s. Estimated remaining: 6m 41s. Rate: 160.1 symbols/min [2025-09-17T07:37:32.050137] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:32.066986] [DEBUG] [MAIN ] KGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:32.068217] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 45743 primary records. [2025-09-17T07:37:32.068375] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-17T07:37:32.103463] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-09-17T07:37:32.103691] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-17T07:37:32.106619] [INFO ] [MAIN ] Derivative Progress: 1102/2172 symbols completed. KGS took 1.2s. Estimated remaining: 6m 41s. Rate: 160.3 symbols/min [2025-09-17T07:37:32.107206] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:32.116833] [DEBUG] [LOCAL ] KIO: Loaded 21439 existing records from primary storage. [2025-09-17T07:37:32.130612] [INFO ] [MAIN ] KIO: Loaded 21439 primary data records. [2025-09-17T07:37:32.163929] [DEBUG] [LOCAL ] KIM: Loaded 53076 existing records from primary storage. [2025-09-17T07:37:32.176361] [INFO ] [MAIN ] KIM: Loaded 53076 primary data records. [2025-09-17T07:37:32.660810] [DEBUG] [LOCAL ] KKR: Loaded 53517 existing records from primary storage. [2025-09-17T07:37:32.781018] [INFO ] [MAIN ] KKR: Loaded 53517 primary data records. [2025-09-17T07:37:33.163822] [DEBUG] [MAIN ] KIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:33.165377] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21439 primary records. [2025-09-17T07:37:33.165551] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-17T07:37:33.190125] [DEBUG] [MAIN ] KIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:33.196885] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-09-17T07:37:33.197222] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-17T07:37:33.200351] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53076 primary records. [2025-09-17T07:37:33.200246] [INFO ] [MAIN ] Derivative Progress: 1103/2172 symbols completed. KIO took 1.2s. Estimated remaining: 6m 41s. Rate: 160.0 symbols/min [2025-09-17T07:37:33.200795] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-17T07:37:33.200962] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:33.220788] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-09-17T07:37:33.221107] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-17T07:37:33.224447] [INFO ] [MAIN ] Derivative Progress: 1104/2172 symbols completed. KIM took 1.2s. Estimated remaining: 6m 40s. Rate: 160.1 symbols/min [2025-09-17T07:37:33.228119] [DEBUG] [LOCAL ] KKRS: Loaded 5780 existing records from primary storage. [2025-09-17T07:37:33.227895] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:33.228376] [INFO ] [MAIN ] KKRS: Loaded 5780 primary data records. [2025-09-17T07:37:33.345746] [DEBUG] [MAIN ] KKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:33.362368] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53517 primary records. [2025-09-17T07:37:33.423317] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-17T07:37:33.566872] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-09-17T07:37:33.580940] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-17T07:37:33.584447] [INFO ] [MAIN ] Derivative Progress: 1105/2172 symbols completed. KKR took 1.5s. Estimated remaining: 6m 40s. Rate: 160.1 symbols/min [2025-09-17T07:37:33.586133] [DEBUG] [LOCAL ] KLC: Loaded 36073 existing records from primary storage. [2025-09-17T07:37:33.586535] [INFO ] [MAIN ] KLC: Loaded 36073 primary data records. [2025-09-17T07:37:33.586337] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:33.922288] [DEBUG] [MAIN ] KKRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:33.925743] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5780 primary records. [2025-09-17T07:37:33.926531] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-17T07:37:33.953309] [DEBUG] [LOCAL ] KLG: Loaded 41934 existing records from primary storage. [2025-09-17T07:37:33.957539] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-09-17T07:37:33.957905] [INFO ] [MAIN ] KLG: Loaded 41934 primary data records. [2025-09-17T07:37:33.958279] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-17T07:37:33.973717] [INFO ] [MAIN ] Derivative Progress: 1106/2172 symbols completed. KKRS took 0.8s. Estimated remaining: 6m 39s. Rate: 160.1 symbols/min [2025-09-17T07:37:33.995603] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:34.276011] [DEBUG] [MAIN ] KLC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:34.277034] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36073 primary records. [2025-09-17T07:37:34.277340] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-17T07:37:34.312189] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-09-17T07:37:34.312373] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-17T07:37:34.315005] [INFO ] [MAIN ] Derivative Progress: 1107/2172 symbols completed. KLC took 1.1s. Estimated remaining: 6m 39s. Rate: 160.1 symbols/min [2025-09-17T07:37:34.315436] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:34.322596] [DEBUG] [LOCAL ] KMPB: Loaded 3647 existing records from primary storage. [2025-09-17T07:37:34.323821] [INFO ] [MAIN ] KMPB: Loaded 3647 primary data records. [2025-09-17T07:37:34.407803] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-17T07:37:34.440841] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-09-17T07:37:34.593580] [DEBUG] [MAIN ] KLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:34.733885] [INFO ] [MAIN ] KLG: Generated 1794 derivative records from 41934 primary records. [2025-09-17T07:37:34.763827] [DEBUG] [LOCAL ] KLG: Saving derivative data. [2025-09-17T07:37:35.008447] [DEBUG] [LOCAL ] KLG: Derivative data saved (1794 records). [2025-09-17T07:37:35.009240] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-17T07:37:35.011732] [INFO ] [MAIN ] Derivative Progress: 1108/2172 symbols completed. KLG took 1.4s. Estimated remaining: 6m 39s. Rate: 160.0 symbols/min [2025-09-17T07:37:35.031057] [DEBUG] [MAIN ] KMPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:35.032305] [INFO ] [MAIN ] KMPB: Generated 1794 derivative records from 3647 primary records. [2025-09-17T07:37:35.033049] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-17T07:37:35.058485] [DEBUG] [MAIN ] KMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:35.059758] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-09-17T07:37:35.060443] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-17T07:37:35.061018] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1794 records). [2025-09-17T07:37:35.061614] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-17T07:37:35.063908] [INFO ] [MAIN ] Derivative Progress: 1109/2172 symbols completed. KMPB took 0.7s. Estimated remaining: 6m 38s. Rate: 160.1 symbols/min [2025-09-17T07:37:35.079866] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-09-17T07:37:35.079954] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-17T07:37:35.082719] [INFO ] [MAIN ] Derivative Progress: 1110/2172 symbols completed. KMI took 1.1s. Estimated remaining: 6m 38s. Rate: 160.3 symbols/min [2025-09-17T07:37:35.083361] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:35.083191] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:35.083546] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:35.148385] [DEBUG] [LOCAL ] KMPR: Loaded 37685 existing records from primary storage. [2025-09-17T07:37:35.148631] [INFO ] [MAIN ] KMPR: Loaded 37685 primary data records. [2025-09-17T07:37:35.279624] [DEBUG] [LOCAL ] KMT: Loaded 43199 existing records from primary storage. [2025-09-17T07:37:35.280283] [DEBUG] [LOCAL ] KMX: Loaded 53084 existing records from primary storage. [2025-09-17T07:37:35.300925] [INFO ] [MAIN ] KMT: Loaded 43199 primary data records. [2025-09-17T07:37:35.328670] [INFO ] [MAIN ] KMX: Loaded 53084 primary data records. [2025-09-17T07:37:36.112443] [DEBUG] [MAIN ] KMPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:36.113858] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 37685 primary records. [2025-09-17T07:37:36.114252] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-17T07:37:36.133702] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-09-17T07:37:36.146061] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-17T07:37:36.146805] [DEBUG] [MAIN ] KMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:36.150162] [INFO ] [MAIN ] Derivative Progress: 1111/2172 symbols completed. KMPR took 1.1s. Estimated remaining: 6m 38s. Rate: 160.0 symbols/min [2025-09-17T07:37:36.147614] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53084 primary records. [2025-09-17T07:37:36.151565] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-17T07:37:36.151502] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:36.183441] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-09-17T07:37:36.183935] [DEBUG] [MAIN ] KMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:36.189969] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-17T07:37:36.189865] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 43199 primary records. [2025-09-17T07:37:36.190729] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-17T07:37:36.194723] [INFO ] [MAIN ] Derivative Progress: 1112/2172 symbols completed. KMX took 1.1s. Estimated remaining: 6m 37s. Rate: 160.1 symbols/min [2025-09-17T07:37:36.196030] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:36.213427] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-09-17T07:37:36.213598] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-17T07:37:36.216313] [INFO ] [MAIN ] Derivative Progress: 1113/2172 symbols completed. KMT took 1.1s. Estimated remaining: 6m 36s. Rate: 160.3 symbols/min [2025-09-17T07:37:36.216832] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:36.248388] [DEBUG] [LOCAL ] KNOP: Loaded 9947 existing records from primary storage. [2025-09-17T07:37:36.248578] [INFO ] [MAIN ] KNOP: Loaded 9947 primary data records. [2025-09-17T07:37:36.374343] [DEBUG] [LOCAL ] KNF: Loaded 35622 existing records from primary storage. [2025-09-17T07:37:36.378617] [INFO ] [MAIN ] KNF: Loaded 35622 primary data records. [2025-09-17T07:37:36.386105] [DEBUG] [LOCAL ] KN: Loaded 39122 existing records from primary storage. [2025-09-17T07:37:36.442362] [INFO ] [MAIN ] KN: Loaded 39122 primary data records. [2025-09-17T07:37:37.301368] [DEBUG] [MAIN ] KNOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:37.307943] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 9947 primary records. [2025-09-17T07:37:37.308981] [DEBUG] [MAIN ] KNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:37.309773] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-17T07:37:37.310765] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 35622 primary records. [2025-09-17T07:37:37.312841] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-17T07:37:37.353566] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-09-17T07:37:37.360739] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-17T07:37:37.362834] [INFO ] [MAIN ] Derivative Progress: 1114/2172 symbols completed. KNOP took 1.1s. Estimated remaining: 6m 37s. Rate: 160.0 symbols/min [2025-09-17T07:37:37.368030] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-09-17T07:37:37.368341] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:37.368866] [DEBUG] [MAIN ] KN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:37.369263] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-17T07:37:37.373057] [INFO ] [MAIN ] Derivative Progress: 1115/2172 symbols completed. KNF took 1.2s. Estimated remaining: 6m 36s. Rate: 160.1 symbols/min [2025-09-17T07:37:37.373568] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:37.370578] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 39122 primary records. [2025-09-17T07:37:37.373869] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-17T07:37:37.398333] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-09-17T07:37:37.398594] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-17T07:37:37.403230] [INFO ] [MAIN ] Derivative Progress: 1116/2172 symbols completed. KN took 1.3s. Estimated remaining: 6m 35s. Rate: 160.2 symbols/min [2025-09-17T07:37:37.410508] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:37.413791] [DEBUG] [LOCAL ] KNSL: Loaded 18049 existing records from primary storage. [2025-09-17T07:37:37.413911] [INFO ] [MAIN ] KNSL: Loaded 18049 primary data records. [2025-09-17T07:37:37.751034] [DEBUG] [LOCAL ] KNTK: Loaded 46120 existing records from primary storage. [2025-09-17T07:37:37.752807] [INFO ] [MAIN ] KNTK: Loaded 46120 primary data records. [2025-09-17T07:37:37.954714] [DEBUG] [LOCAL ] KNX: Loaded 52592 existing records from primary storage. [2025-09-17T07:37:37.979529] [INFO ] [MAIN ] KNX: Loaded 52592 primary data records. [2025-09-17T07:37:38.415982] [DEBUG] [MAIN ] KNSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:38.416930] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18049 primary records. [2025-09-17T07:37:38.417129] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-17T07:37:38.439084] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-09-17T07:37:38.439617] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-17T07:37:38.454920] [INFO ] [MAIN ] Derivative Progress: 1117/2172 symbols completed. KNSL took 1.1s. Estimated remaining: 6m 36s. Rate: 160.0 symbols/min [2025-09-17T07:37:38.455818] [DEBUG] [MAIN ] KNTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:38.456189] [INFO ] [MAIN ] KO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:38.456940] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46120 primary records. [2025-09-17T07:37:38.457580] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-17T07:37:38.476150] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-09-17T07:37:38.476346] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-17T07:37:38.478870] [INFO ] [MAIN ] Derivative Progress: 1118/2172 symbols completed. KNTK took 1.1s. Estimated remaining: 6m 35s. Rate: 160.1 symbols/min [2025-09-17T07:37:38.479287] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:38.497814] [DEBUG] [MAIN ] KNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:38.498545] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52592 primary records. [2025-09-17T07:37:38.498747] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-17T07:37:38.516956] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-09-17T07:37:38.517167] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-17T07:37:38.519860] [INFO ] [MAIN ] Derivative Progress: 1119/2172 symbols completed. KNX took 1.1s. Estimated remaining: 6m 34s. Rate: 160.2 symbols/min [2025-09-17T07:37:38.534177] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:38.576956] [DEBUG] [LOCAL ] KO: Loaded 53818 existing records from primary storage. [2025-09-17T07:37:38.577617] [DEBUG] [LOCAL ] KODK: Loaded 43444 existing records from primary storage. [2025-09-17T07:37:38.577997] [INFO ] [MAIN ] KODK: Loaded 43444 primary data records. [2025-09-17T07:37:38.578086] [INFO ] [MAIN ] KO: Loaded 53818 primary data records. [2025-09-17T07:37:38.825564] [DEBUG] [LOCAL ] KOF: Loaded 26043 existing records from primary storage. [2025-09-17T07:37:38.914506] [INFO ] [MAIN ] KOF: Loaded 26043 primary data records. [2025-09-17T07:37:39.581879] [DEBUG] [MAIN ] KODK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:39.583046] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43444 primary records. [2025-09-17T07:37:39.584528] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-17T07:37:39.615767] [DEBUG] [MAIN ] KO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:39.618021] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-09-17T07:37:39.619141] [INFO ] [MAIN ] KO: Generated 1794 derivative records from 53818 primary records. [2025-09-17T07:37:39.619346] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-17T07:37:39.622590] [INFO ] [MAIN ] Derivative Progress: 1120/2172 symbols completed. KODK took 1.1s. Estimated remaining: 6m 35s. Rate: 160.0 symbols/min [2025-09-17T07:37:39.619687] [DEBUG] [LOCAL ] KO: Saving derivative data. [2025-09-17T07:37:39.623842] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:39.665957] [DEBUG] [MAIN ] KOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:39.672815] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 26043 primary records. [2025-09-17T07:37:39.674471] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-17T07:37:39.676825] [DEBUG] [LOCAL ] KO: Derivative data saved (1794 records). [2025-09-17T07:37:39.684104] [DEBUG] [LOCAL ] KOP: Loaded 18072 existing records from primary storage. [2025-09-17T07:37:39.683708] [INFO ] [MAIN ] KO: Successfully saved derivative data. [2025-09-17T07:37:39.684279] [INFO ] [MAIN ] KOP: Loaded 18072 primary data records. [2025-09-17T07:37:39.687058] [INFO ] [MAIN ] Derivative Progress: 1121/2172 symbols completed. KO took 1.2s. Estimated remaining: 6m 34s. Rate: 160.1 symbols/min [2025-09-17T07:37:39.730575] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:39.772697] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-09-17T07:37:39.806729] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-17T07:37:39.814310] [DEBUG] [LOCAL ] KORE: Loaded 1956 existing records from primary storage. [2025-09-17T07:37:39.863409] [INFO ] [MAIN ] Derivative Progress: 1122/2172 symbols completed. KOF took 1.3s. Estimated remaining: 6m 33s. Rate: 160.1 symbols/min [2025-09-17T07:37:39.863525] [INFO ] [MAIN ] KORE: Loaded 1956 primary data records. [2025-09-17T07:37:39.932970] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:40.379347] [DEBUG] [LOCAL ] KOS: Loaded 53081 existing records from primary storage. [2025-09-17T07:37:40.387936] [INFO ] [MAIN ] KOS: Loaded 53081 primary data records. [2025-09-17T07:37:40.415296] [DEBUG] [MAIN ] KOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:40.465020] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 18072 primary records. [2025-09-17T07:37:40.499315] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-17T07:37:40.650183] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-09-17T07:37:40.733387] [DEBUG] [MAIN ] KORE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:40.734406] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-17T07:37:40.735548] [INFO ] [MAIN ] KORE: Generated 1794 derivative records from 1956 primary records. [2025-09-17T07:37:40.735870] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-17T07:37:40.739256] [INFO ] [MAIN ] Derivative Progress: 1123/2172 symbols completed. KOP took 1.1s. Estimated remaining: 6m 33s. Rate: 160.0 symbols/min [2025-09-17T07:37:40.756265] [DEBUG] [LOCAL ] KORE: Derivative data saved (1794 records). [2025-09-17T07:37:40.756864] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-17T07:37:40.759948] [INFO ] [MAIN ] Derivative Progress: 1124/2172 symbols completed. KORE took 1.0s. Estimated remaining: 6m 33s. Rate: 160.1 symbols/min [2025-09-17T07:37:40.782929] [DEBUG] [MAIN ] KOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:40.783821] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53081 primary records. [2025-09-17T07:37:40.783904] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-17T07:37:40.800949] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-09-17T07:37:40.801077] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-17T07:37:40.808962] [INFO ] [MAIN ] Derivative Progress: 1125/2172 symbols completed. KOS took 0.9s. Estimated remaining: 6m 32s. Rate: 160.2 symbols/min [2025-09-17T07:37:40.809930] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:40.810910] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:40.811026] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:40.890811] [DEBUG] [LOCAL ] KRC: Loaded 48450 existing records from primary storage. [2025-09-17T07:37:40.891991] [DEBUG] [LOCAL ] KREF: Loaded 36939 existing records from primary storage. [2025-09-17T07:37:40.906297] [INFO ] [MAIN ] KRC: Loaded 48450 primary data records. [2025-09-17T07:37:40.907952] [INFO ] [MAIN ] KREF: Loaded 36939 primary data records. [2025-09-17T07:37:40.966609] [DEBUG] [LOCAL ] KR: Loaded 53682 existing records from primary storage. [2025-09-17T07:37:41.039162] [INFO ] [MAIN ] KR: Loaded 53682 primary data records. [2025-09-17T07:37:41.924940] [DEBUG] [MAIN ] KRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:41.925824] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48450 primary records. [2025-09-17T07:37:41.926120] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-17T07:37:41.942565] [DEBUG] [MAIN ] KREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:41.950672] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 36939 primary records. [2025-09-17T07:37:41.962546] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-17T07:37:41.983405] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-09-17T07:37:41.986409] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-17T07:37:41.983960] [DEBUG] [MAIN ] KR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:41.989010] [INFO ] [MAIN ] Derivative Progress: 1126/2172 symbols completed. KRC took 1.2s. Estimated remaining: 6m 32s. Rate: 159.9 symbols/min [2025-09-17T07:37:41.989896] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53682 primary records. [2025-09-17T07:37:41.990732] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-09-17T07:37:41.991182] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-17T07:37:41.991062] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:41.991365] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-17T07:37:41.995003] [INFO ] [MAIN ] Derivative Progress: 1127/2172 symbols completed. KREF took 1.2s. Estimated remaining: 6m 32s. Rate: 160.1 symbols/min [2025-09-17T07:37:42.004074] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:42.011301] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-09-17T07:37:42.011584] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-17T07:37:42.014383] [INFO ] [MAIN ] Derivative Progress: 1128/2172 symbols completed. KR took 1.2s. Estimated remaining: 6m 31s. Rate: 160.2 symbols/min [2025-09-17T07:37:42.014873] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:42.054321] [DEBUG] [LOCAL ] KRO: Loaded 25645 existing records from primary storage. [2025-09-17T07:37:42.054629] [INFO ] [MAIN ] KRO: Loaded 25645 primary data records. [2025-09-17T07:37:42.200130] [DEBUG] [LOCAL ] KRG: Loaded 49190 existing records from primary storage. [2025-09-17T07:37:42.211815] [DEBUG] [LOCAL ] KRP: Loaded 38147 existing records from primary storage. [2025-09-17T07:37:42.217070] [INFO ] [MAIN ] KRP: Loaded 38147 primary data records. [2025-09-17T07:37:42.222406] [INFO ] [MAIN ] KRG: Loaded 49190 primary data records. [2025-09-17T07:37:43.024819] [DEBUG] [MAIN ] KRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:43.025576] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 25645 primary records. [2025-09-17T07:37:43.025909] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-17T07:37:43.042227] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-09-17T07:37:43.043325] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-17T07:37:43.045358] [INFO ] [MAIN ] Derivative Progress: 1129/2172 symbols completed. KRO took 1.0s. Estimated remaining: 6m 31s. Rate: 159.9 symbols/min [2025-09-17T07:37:43.045615] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:43.061396] [DEBUG] [MAIN ] KRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:43.065009] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 38147 primary records. [2025-09-17T07:37:43.065227] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-17T07:37:43.091190] [DEBUG] [MAIN ] KRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:43.093324] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49190 primary records. [2025-09-17T07:37:43.095413] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-17T07:37:43.110614] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-09-17T07:37:43.114324] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-17T07:37:43.114866] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-09-17T07:37:43.117499] [INFO ] [MAIN ] Derivative Progress: 1130/2172 symbols completed. KRP took 1.1s. Estimated remaining: 6m 31s. Rate: 160.1 symbols/min [2025-09-17T07:37:43.118002] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-17T07:37:43.117926] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:43.120654] [INFO ] [MAIN ] Derivative Progress: 1131/2172 symbols completed. KRG took 1.1s. Estimated remaining: 6m 30s. Rate: 160.2 symbols/min [2025-09-17T07:37:43.121289] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:43.162689] [DEBUG] [LOCAL ] KSS: Loaded 53612 existing records from primary storage. [2025-09-17T07:37:43.171029] [INFO ] [MAIN ] KSS: Loaded 53612 primary data records. [2025-09-17T07:37:43.310337] [DEBUG] [LOCAL ] KTB: Loaded 41355 existing records from primary storage. [2025-09-17T07:37:43.310836] [INFO ] [MAIN ] KTB: Loaded 41355 primary data records. [2025-09-17T07:37:43.309323] [DEBUG] [LOCAL ] KT: Loaded 45727 existing records from primary storage. [2025-09-17T07:37:43.384014] [INFO ] [MAIN ] KT: Loaded 45727 primary data records. [2025-09-17T07:37:44.149239] [DEBUG] [MAIN ] KSS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:44.150735] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53612 primary records. [2025-09-17T07:37:44.151027] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-17T07:37:44.180543] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-09-17T07:37:44.185841] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-17T07:37:44.200749] [DEBUG] [MAIN ] KT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:44.201591] [DEBUG] [MAIN ] KTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:44.203777] [INFO ] [MAIN ] Derivative Progress: 1132/2172 symbols completed. KSS took 1.2s. Estimated remaining: 6m 30s. Rate: 159.9 symbols/min [2025-09-17T07:37:44.204567] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45727 primary records. [2025-09-17T07:37:44.205768] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 41355 primary records. [2025-09-17T07:37:44.205980] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:44.206321] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-17T07:37:44.206369] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-17T07:37:44.249162] [DEBUG] [LOCAL ] KTF: Loaded 13188 existing records from primary storage. [2025-09-17T07:37:44.249453] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-09-17T07:37:44.250666] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-09-17T07:37:44.251241] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-17T07:37:44.254184] [INFO ] [MAIN ] Derivative Progress: 1133/2172 symbols completed. KT took 1.1s. Estimated remaining: 6m 30s. Rate: 160.0 symbols/min [2025-09-17T07:37:44.251317] [INFO ] [MAIN ] KTF: Loaded 13188 primary data records. [2025-09-17T07:37:44.254267] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-17T07:37:44.297508] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:44.297572] [INFO ] [MAIN ] Derivative Progress: 1134/2172 symbols completed. KTB took 1.1s. Estimated remaining: 6m 29s. Rate: 160.2 symbols/min [2025-09-17T07:37:44.368993] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:44.640851] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-17T07:37:44.641274] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-09-17T07:37:44.714562] [DEBUG] [MAIN ] KTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:44.747576] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 13188 primary records. [2025-09-17T07:37:44.775119] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-17T07:37:44.781855] [DEBUG] [LOCAL ] KVYO: Loaded 49770 existing records from primary storage. [2025-09-17T07:37:44.805019] [INFO ] [MAIN ] KVYO: Loaded 49770 primary data records. [2025-09-17T07:37:44.907316] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-09-17T07:37:44.979798] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-17T07:37:45.088275] [INFO ] [MAIN ] Derivative Progress: 1135/2172 symbols completed. KTF took 0.9s. Estimated remaining: 6m 29s. Rate: 160.0 symbols/min [2025-09-17T07:37:45.107901] [INFO ] [MAIN ] KW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:45.396801] [DEBUG] [MAIN ] KVUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:45.397833] [DEBUG] [LOCAL ] KW: Loaded 40623 existing records from primary storage. [2025-09-17T07:37:45.399236] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-09-17T07:37:45.398460] [INFO ] [MAIN ] KW: Loaded 40623 primary data records. [2025-09-17T07:37:45.399903] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-17T07:37:45.579997] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-09-17T07:37:45.580217] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-17T07:37:45.590852] [INFO ] [MAIN ] Derivative Progress: 1136/2172 symbols completed. KVUE took 1.3s. Estimated remaining: 6m 29s. Rate: 160.0 symbols/min [2025-09-17T07:37:45.553294] [DEBUG] [MAIN ] KVYO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:45.620476] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:45.621206] [INFO ] [MAIN ] KVYO: Generated 1794 derivative records from 49770 primary records. [2025-09-17T07:37:45.736841] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-17T07:37:45.759898] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1794 records). [2025-09-17T07:37:45.760933] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-17T07:37:45.762999] [INFO ] [MAIN ] Derivative Progress: 1137/2172 symbols completed. KVYO took 1.4s. Estimated remaining: 6m 28s. Rate: 160.0 symbols/min [2025-09-17T07:37:45.763336] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:45.781762] [DEBUG] [LOCAL ] KWR: Loaded 16974 existing records from primary storage. [2025-09-17T07:37:45.782268] [INFO ] [MAIN ] KWR: Loaded 16974 primary data records. [2025-09-17T07:37:45.962382] [DEBUG] [MAIN ] KW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:46.013480] [INFO ] [MAIN ] KW: Generated 1794 derivative records from 40623 primary records. [2025-09-17T07:37:46.013695] [DEBUG] [LOCAL ] KW: Saving derivative data. [2025-09-17T07:37:46.037304] [DEBUG] [LOCAL ] KYN: Loaded 30513 existing records from primary storage. [2025-09-17T07:37:46.132056] [INFO ] [MAIN ] KYN: Loaded 30513 primary data records. [2025-09-17T07:37:46.239454] [DEBUG] [LOCAL ] KW: Derivative data saved (1794 records). [2025-09-17T07:37:46.268850] [INFO ] [MAIN ] KW: Successfully saved derivative data. [2025-09-17T07:37:46.271958] [INFO ] [MAIN ] Derivative Progress: 1138/2172 symbols completed. KW took 1.2s. Estimated remaining: 6m 28s. Rate: 160.0 symbols/min [2025-09-17T07:37:46.489476] [DEBUG] [MAIN ] KWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:46.491015] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16974 primary records. [2025-09-17T07:37:46.491117] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-17T07:37:46.511272] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-09-17T07:37:46.511773] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-17T07:37:46.513938] [INFO ] [MAIN ] Derivative Progress: 1139/2172 symbols completed. KWR took 0.9s. Estimated remaining: 6m 27s. Rate: 160.0 symbols/min [2025-09-17T07:37:46.529862] [DEBUG] [MAIN ] KYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:46.530626] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30513 primary records. [2025-09-17T07:37:46.530724] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-17T07:37:46.546935] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-09-17T07:37:46.547130] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-17T07:37:46.549135] [INFO ] [MAIN ] Derivative Progress: 1140/2172 symbols completed. KYN took 0.8s. Estimated remaining: 6m 27s. Rate: 160.2 symbols/min [2025-09-17T07:37:46.549858] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:46.550091] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:46.549694] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:46.578777] [DEBUG] [LOCAL ] LAD: Loaded 24197 existing records from primary storage. [2025-09-17T07:37:46.578968] [INFO ] [MAIN ] LAD: Loaded 24197 primary data records. [2025-09-17T07:37:46.728541] [DEBUG] [LOCAL ] L: Loaded 40939 existing records from primary storage. [2025-09-17T07:37:46.744436] [INFO ] [MAIN ] L: Loaded 40939 primary data records. [2025-09-17T07:37:47.023734] [DEBUG] [LOCAL ] LAC: Loaded 52277 existing records from primary storage. [2025-09-17T07:37:47.036447] [INFO ] [MAIN ] LAC: Loaded 52277 primary data records. [2025-09-17T07:37:47.618622] [DEBUG] [MAIN ] LAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:47.619595] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 24197 primary records. [2025-09-17T07:37:47.620484] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-17T07:37:47.639225] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-09-17T07:37:47.639660] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-17T07:37:47.642150] [INFO ] [MAIN ] Derivative Progress: 1141/2172 symbols completed. LAD took 1.1s. Estimated remaining: 6m 27s. Rate: 159.9 symbols/min [2025-09-17T07:37:47.642782] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:47.659989] [DEBUG] [MAIN ] L: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:47.661529] [INFO ] [MAIN ] L: Generated 1794 derivative records from 40939 primary records. [2025-09-17T07:37:47.662133] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-17T07:37:47.679724] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-09-17T07:37:47.681398] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-17T07:37:47.683968] [INFO ] [MAIN ] Derivative Progress: 1142/2172 symbols completed. L took 1.1s. Estimated remaining: 6m 26s. Rate: 160.0 symbols/min [2025-09-17T07:37:47.697035] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:47.697541] [DEBUG] [MAIN ] LAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:47.698711] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52277 primary records. [2025-09-17T07:37:47.698934] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-17T07:37:47.723873] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-09-17T07:37:47.727191] [DEBUG] [LOCAL ] LANV: Loaded 2616 existing records from primary storage. [2025-09-17T07:37:47.727376] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-17T07:37:47.727514] [INFO ] [MAIN ] LANV: Loaded 2616 primary data records. [2025-09-17T07:37:47.730477] [INFO ] [MAIN ] Derivative Progress: 1143/2172 symbols completed. LAC took 1.2s. Estimated remaining: 6m 26s. Rate: 160.2 symbols/min [2025-09-17T07:37:47.760982] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:47.807731] [DEBUG] [LOCAL ] LADR: Loaded 38529 existing records from primary storage. [2025-09-17T07:37:47.824948] [INFO ] [MAIN ] LADR: Loaded 38529 primary data records. [2025-09-17T07:37:48.034764] [DEBUG] [LOCAL ] LAW: Loaded 13798 existing records from primary storage. [2025-09-17T07:37:48.162513] [INFO ] [MAIN ] LAW: Loaded 13798 primary data records. [2025-09-17T07:37:48.676873] [DEBUG] [MAIN ] LANV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:48.678181] [INFO ] [MAIN ] LANV: Generated 1794 derivative records from 2616 primary records. [2025-09-17T07:37:48.679286] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-17T07:37:48.704736] [DEBUG] [LOCAL ] LANV: Derivative data saved (1794 records). [2025-09-17T07:37:48.710057] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-17T07:37:48.710463] [DEBUG] [MAIN ] LADR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:48.711706] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 38529 primary records. [2025-09-17T07:37:48.713953] [INFO ] [MAIN ] Derivative Progress: 1144/2172 symbols completed. LANV took 1.0s. Estimated remaining: 6m 26s. Rate: 159.9 symbols/min [2025-09-17T07:37:48.714595] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-17T07:37:48.714868] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:48.734463] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-09-17T07:37:48.736689] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-17T07:37:48.738985] [INFO ] [MAIN ] Derivative Progress: 1145/2172 symbols completed. LADR took 1.1s. Estimated remaining: 6m 25s. Rate: 160.1 symbols/min [2025-09-17T07:37:48.739749] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:48.753935] [DEBUG] [MAIN ] LAW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:48.755073] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 13798 primary records. [2025-09-17T07:37:48.755319] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-17T07:37:48.772039] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-09-17T07:37:48.772213] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-17T07:37:48.775617] [INFO ] [MAIN ] Derivative Progress: 1146/2172 symbols completed. LAW took 1.0s. Estimated remaining: 6m 24s. Rate: 160.2 symbols/min [2025-09-17T07:37:48.776148] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:48.820256] [DEBUG] [LOCAL ] LAZ: Loaded 45488 existing records from primary storage. [2025-09-17T07:37:48.834336] [INFO ] [MAIN ] LAZ: Loaded 45488 primary data records. [2025-09-17T07:37:48.837027] [DEBUG] [LOCAL ] LB: Loaded 37949 existing records from primary storage. [2025-09-17T07:37:48.882360] [INFO ] [MAIN ] LB: Loaded 37949 primary data records. [2025-09-17T07:37:49.145380] [DEBUG] [LOCAL ] LBRT: Loaded 52928 existing records from primary storage. [2025-09-17T07:37:49.299283] [INFO ] [MAIN ] LBRT: Loaded 52928 primary data records. [2025-09-17T07:37:50.073894] [DEBUG] [MAIN ] LAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:50.119832] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 45488 primary records. [2025-09-17T07:37:50.245659] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-17T07:37:50.268810] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-09-17T07:37:50.270101] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-17T07:37:50.273710] [INFO ] [MAIN ] Derivative Progress: 1147/2172 symbols completed. LAZ took 1.6s. Estimated remaining: 6m 25s. Rate: 159.8 symbols/min [2025-09-17T07:37:50.275955] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:50.290938] [DEBUG] [MAIN ] LB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:50.292385] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37949 primary records. [2025-09-17T07:37:50.293377] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-17T07:37:50.313379] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-09-17T07:37:50.313607] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-17T07:37:50.315773] [INFO ] [MAIN ] Derivative Progress: 1148/2172 symbols completed. LB took 1.6s. Estimated remaining: 6m 24s. Rate: 159.9 symbols/min [2025-09-17T07:37:50.321342] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:50.330793] [DEBUG] [MAIN ] LBRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:50.331763] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52928 primary records. [2025-09-17T07:37:50.331965] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-17T07:37:50.368559] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-09-17T07:37:50.368766] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-17T07:37:50.371877] [INFO ] [MAIN ] Derivative Progress: 1149/2172 symbols completed. LBRT took 1.6s. Estimated remaining: 6m 24s. Rate: 160.0 symbols/min [2025-09-17T07:37:50.372257] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:50.384194] [DEBUG] [LOCAL ] LCII: Loaded 28819 existing records from primary storage. [2025-09-17T07:37:50.397107] [INFO ] [MAIN ] LCII: Loaded 28819 primary data records. [2025-09-17T07:37:50.428541] [DEBUG] [LOCAL ] LC: Loaded 48048 existing records from primary storage. [2025-09-17T07:37:50.489188] [INFO ] [MAIN ] LC: Loaded 48048 primary data records. [2025-09-17T07:37:50.867039] [DEBUG] [LOCAL ] LDI: Loaded 43208 existing records from primary storage. [2025-09-17T07:37:50.896941] [INFO ] [MAIN ] LDI: Loaded 43208 primary data records. [2025-09-17T07:37:51.330434] [DEBUG] [MAIN ] LCII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:51.333808] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 28819 primary records. [2025-09-17T07:37:51.335395] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-17T07:37:51.367717] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-09-17T07:37:51.368195] [DEBUG] [MAIN ] LC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:51.369263] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 48048 primary records. [2025-09-17T07:37:51.369407] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-17T07:37:51.369631] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-17T07:37:51.371962] [INFO ] [MAIN ] Derivative Progress: 1150/2172 symbols completed. LCII took 1.1s. Estimated remaining: 6m 24s. Rate: 159.8 symbols/min [2025-09-17T07:37:51.373113] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:51.391435] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-09-17T07:37:51.391652] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-17T07:37:51.393694] [INFO ] [MAIN ] Derivative Progress: 1151/2172 symbols completed. LC took 1.1s. Estimated remaining: 6m 23s. Rate: 159.9 symbols/min [2025-09-17T07:37:51.394425] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:51.415017] [DEBUG] [MAIN ] LDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:51.419781] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 43208 primary records. [2025-09-17T07:37:51.420239] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-17T07:37:51.440088] [DEBUG] [LOCAL ] LDP: Loaded 13181 existing records from primary storage. [2025-09-17T07:37:51.444478] [INFO ] [MAIN ] LDP: Loaded 13181 primary data records. [2025-09-17T07:37:51.444692] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-09-17T07:37:51.466286] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-17T07:37:51.529517] [INFO ] [MAIN ] Derivative Progress: 1152/2172 symbols completed. LDI took 1.2s. Estimated remaining: 6m 23s. Rate: 160.0 symbols/min [2025-09-17T07:37:51.563549] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:51.799818] [DEBUG] [LOCAL ] LDOS: Loaded 46101 existing records from primary storage. [2025-09-17T07:37:51.800167] [INFO ] [MAIN ] LDOS: Loaded 46101 primary data records. [2025-09-17T07:37:52.011228] [DEBUG] [LOCAL ] LEA: Loaded 41857 existing records from primary storage. [2025-09-17T07:37:52.111139] [INFO ] [MAIN ] LEA: Loaded 41857 primary data records. [2025-09-17T07:37:52.457522] [DEBUG] [MAIN ] LDP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:52.459438] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 13181 primary records. [2025-09-17T07:37:52.459731] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-17T07:37:52.478925] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-09-17T07:37:52.480591] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-17T07:37:52.484264] [INFO ] [MAIN ] Derivative Progress: 1153/2172 symbols completed. LDP took 1.1s. Estimated remaining: 6m 23s. Rate: 159.8 symbols/min [2025-09-17T07:37:52.500295] [DEBUG] [MAIN ] LDOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:52.501159] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 46101 primary records. [2025-09-17T07:37:52.501461] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-17T07:37:52.519157] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-09-17T07:37:52.519473] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-17T07:37:52.521985] [INFO ] [MAIN ] Derivative Progress: 1154/2172 symbols completed. LDOS took 1.1s. Estimated remaining: 6m 22s. Rate: 159.9 symbols/min [2025-09-17T07:37:52.538721] [DEBUG] [MAIN ] LEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:52.539435] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41857 primary records. [2025-09-17T07:37:52.539513] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-17T07:37:52.555749] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-09-17T07:37:52.555940] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-17T07:37:52.558955] [INFO ] [MAIN ] Derivative Progress: 1155/2172 symbols completed. LEA took 1.0s. Estimated remaining: 6m 21s. Rate: 160.0 symbols/min [2025-09-17T07:37:52.559588] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:52.559806] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:52.560188] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:52.649574] [DEBUG] [LOCAL ] LEVI: Loaded 51477 existing records from primary storage. [2025-09-17T07:37:52.649712] [DEBUG] [LOCAL ] LEG: Loaded 50399 existing records from primary storage. [2025-09-17T07:37:52.650557] [INFO ] [MAIN ] LEVI: Loaded 51477 primary data records. [2025-09-17T07:37:52.650652] [INFO ] [MAIN ] LEG: Loaded 50399 primary data records. [2025-09-17T07:37:52.745511] [DEBUG] [LOCAL ] LEN: Loaded 53179 existing records from primary storage. [2025-09-17T07:37:52.837934] [INFO ] [MAIN ] LEN: Loaded 53179 primary data records. [2025-09-17T07:37:53.657467] [DEBUG] [MAIN ] LEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:53.671042] [DEBUG] [MAIN ] LEVI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:53.672272] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50399 primary records. [2025-09-17T07:37:53.673126] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-17T07:37:53.673867] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51477 primary records. [2025-09-17T07:37:53.674881] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-17T07:37:53.719688] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-09-17T07:37:53.721203] [DEBUG] [MAIN ] LEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:53.725027] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53179 primary records. [2025-09-17T07:37:53.721318] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-17T07:37:53.725351] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-17T07:37:53.727782] [INFO ] [MAIN ] Derivative Progress: 1156/2172 symbols completed. LEG took 1.2s. Estimated remaining: 6m 22s. Rate: 159.7 symbols/min [2025-09-17T07:37:53.728094] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:53.747663] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-09-17T07:37:53.747550] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-09-17T07:37:53.747955] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-17T07:37:53.750770] [INFO ] [MAIN ] Derivative Progress: 1157/2172 symbols completed. LEN took 1.2s. Estimated remaining: 6m 21s. Rate: 159.9 symbols/min [2025-09-17T07:37:53.748014] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-17T07:37:53.753152] [INFO ] [MAIN ] Derivative Progress: 1158/2172 symbols completed. LEVI took 1.2s. Estimated remaining: 6m 20s. Rate: 160.0 symbols/min [2025-09-17T07:37:53.753095] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:53.753370] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:53.771194] [DEBUG] [LOCAL ] LFT: Loaded 17802 existing records from primary storage. [2025-09-17T07:37:53.773933] [INFO ] [MAIN ] LFT: Loaded 17802 primary data records. [2025-09-17T07:37:53.844375] [DEBUG] [LOCAL ] LGI: Loaded 10277 existing records from primary storage. [2025-09-17T07:37:53.867434] [INFO ] [MAIN ] LGI: Loaded 10277 primary data records. [2025-09-17T07:37:54.089048] [DEBUG] [LOCAL ] LH: Loaded 38865 existing records from primary storage. [2025-09-17T07:37:54.100074] [INFO ] [MAIN ] LH: Loaded 38865 primary data records. [2025-09-17T07:37:54.713687] [DEBUG] [MAIN ] LFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:54.715461] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 17802 primary records. [2025-09-17T07:37:54.715622] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-17T07:37:54.733758] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-09-17T07:37:54.746313] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-17T07:37:54.746731] [DEBUG] [MAIN ] LGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:54.749502] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 10277 primary records. [2025-09-17T07:37:54.748715] [INFO ] [MAIN ] Derivative Progress: 1159/2172 symbols completed. LFT took 1.0s. Estimated remaining: 6m 20s. Rate: 159.8 symbols/min [2025-09-17T07:37:54.749767] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-17T07:37:54.750738] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:54.766496] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-09-17T07:37:54.767418] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-17T07:37:54.771045] [INFO ] [MAIN ] Derivative Progress: 1160/2172 symbols completed. LGI took 1.0s. Estimated remaining: 6m 20s. Rate: 159.9 symbols/min [2025-09-17T07:37:54.771492] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:54.786090] [DEBUG] [MAIN ] LH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:54.786841] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 38865 primary records. [2025-09-17T07:37:54.786980] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-17T07:37:54.804884] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-09-17T07:37:54.805134] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-17T07:37:54.807743] [INFO ] [MAIN ] Derivative Progress: 1161/2172 symbols completed. LH took 1.1s. Estimated remaining: 6m 19s. Rate: 160.0 symbols/min [2025-09-17T07:37:54.808119] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:54.838351] [DEBUG] [LOCAL ] LII: Loaded 28709 existing records from primary storage. [2025-09-17T07:37:54.838611] [INFO ] [MAIN ] LII: Loaded 28709 primary data records. [2025-09-17T07:37:54.966472] [DEBUG] [LOCAL ] LHX: Loaded 49100 existing records from primary storage. [2025-09-17T07:37:54.967461] [INFO ] [MAIN ] LHX: Loaded 49100 primary data records. [2025-09-17T07:37:55.051439] [DEBUG] [LOCAL ] LION: Loaded 42056 existing records from primary storage. [2025-09-17T07:37:55.093613] [INFO ] [MAIN ] LION: Loaded 42056 primary data records. [2025-09-17T07:37:55.833179] [DEBUG] [MAIN ] LII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:55.834116] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 28709 primary records. [2025-09-17T07:37:55.834617] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-17T07:37:55.856339] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-09-17T07:37:55.857076] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-17T07:37:55.859184] [INFO ] [MAIN ] Derivative Progress: 1162/2172 symbols completed. LII took 1.1s. Estimated remaining: 6m 19s. Rate: 159.8 symbols/min [2025-09-17T07:37:55.872713] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:55.873788] [DEBUG] [MAIN ] LHX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:55.875054] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 49100 primary records. [2025-09-17T07:37:55.875362] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-17T07:37:55.894903] [DEBUG] [LOCAL ] LITB: Loaded 4237 existing records from primary storage. [2025-09-17T07:37:55.903255] [INFO ] [MAIN ] LITB: Loaded 4237 primary data records. [2025-09-17T07:37:55.942097] [DEBUG] [MAIN ] LION: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:55.955735] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 42056 primary records. [2025-09-17T07:37:55.967953] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-17T07:37:55.968346] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-09-17T07:37:55.996806] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-17T07:37:56.015552] [INFO ] [MAIN ] Derivative Progress: 1163/2172 symbols completed. LHX took 1.3s. Estimated remaining: 6m 19s. Rate: 159.9 symbols/min [2025-09-17T07:37:56.029724] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:56.046895] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-09-17T07:37:56.062840] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-17T07:37:56.094047] [INFO ] [MAIN ] Derivative Progress: 1164/2172 symbols completed. LION took 1.3s. Estimated remaining: 6m 18s. Rate: 160.0 symbols/min [2025-09-17T07:37:56.119250] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:56.295899] [DEBUG] [MAIN ] LITB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:56.310789] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4237 primary records. [2025-09-17T07:37:56.310902] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-17T07:37:56.311857] [DEBUG] [LOCAL ] LLY: Loaded 53301 existing records from primary storage. [2025-09-17T07:37:56.313187] [INFO ] [MAIN ] LLY: Loaded 53301 primary data records. [2025-09-17T07:37:56.375167] [DEBUG] [LOCAL ] LMND: Loaded 51882 existing records from primary storage. [2025-09-17T07:37:56.417489] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-09-17T07:37:56.407916] [INFO ] [MAIN ] LMND: Loaded 51882 primary data records. [2025-09-17T07:37:56.441344] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-17T07:37:56.448676] [INFO ] [MAIN ] Derivative Progress: 1165/2172 symbols completed. LITB took 0.6s. Estimated remaining: 6m 18s. Rate: 160.0 symbols/min [2025-09-17T07:37:56.470372] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:56.986345] [DEBUG] [LOCAL ] LMT: Loaded 50019 existing records from primary storage. [2025-09-17T07:37:56.987762] [INFO ] [MAIN ] LMT: Loaded 50019 primary data records. [2025-09-17T07:37:57.100511] [DEBUG] [MAIN ] LLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:57.105388] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53301 primary records. [2025-09-17T07:37:57.132264] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-17T07:37:57.328522] [DEBUG] [MAIN ] LMND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:57.336105] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 51882 primary records. [2025-09-17T07:37:57.340149] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-17T07:37:57.338753] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-09-17T07:37:57.341363] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-17T07:37:57.344379] [INFO ] [MAIN ] Derivative Progress: 1166/2172 symbols completed. LLY took 1.3s. Estimated remaining: 6m 18s. Rate: 159.8 symbols/min [2025-09-17T07:37:57.353966] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:57.361807] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-09-17T07:37:57.362007] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-17T07:37:57.364498] [INFO ] [MAIN ] Derivative Progress: 1167/2172 symbols completed. LMND took 1.2s. Estimated remaining: 6m 17s. Rate: 159.9 symbols/min [2025-09-17T07:37:57.365020] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:57.374230] [DEBUG] [LOCAL ] LND: Loaded 5274 existing records from primary storage. [2025-09-17T07:37:57.374680] [INFO ] [MAIN ] LND: Loaded 5274 primary data records. [2025-09-17T07:37:57.692439] [DEBUG] [LOCAL ] LNC: Loaded 51622 existing records from primary storage. [2025-09-17T07:37:57.781380] [INFO ] [MAIN ] LNC: Loaded 51622 primary data records. [2025-09-17T07:37:57.781201] [DEBUG] [MAIN ] LMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:57.782270] [INFO ] [MAIN ] LMT: Generated 1794 derivative records from 50019 primary records. [2025-09-17T07:37:57.819935] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-17T07:37:57.951160] [DEBUG] [LOCAL ] LMT: Derivative data saved (1794 records). [2025-09-17T07:37:57.996439] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-17T07:37:57.999416] [INFO ] [MAIN ] Derivative Progress: 1168/2172 symbols completed. LMT took 1.5s. Estimated remaining: 6m 17s. Rate: 159.8 symbols/min [2025-09-17T07:37:58.129326] [DEBUG] [MAIN ] LND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:58.130311] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 5274 primary records. [2025-09-17T07:37:58.130392] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-17T07:37:58.147063] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-09-17T07:37:58.147430] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-17T07:37:58.149399] [INFO ] [MAIN ] Derivative Progress: 1169/2172 symbols completed. LND took 0.8s. Estimated remaining: 6m 16s. Rate: 159.9 symbols/min [2025-09-17T07:37:58.165680] [DEBUG] [MAIN ] LNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:58.166279] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51622 primary records. [2025-09-17T07:37:58.166383] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-17T07:37:58.181597] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-09-17T07:37:58.181683] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-17T07:37:58.183826] [INFO ] [MAIN ] Derivative Progress: 1170/2172 symbols completed. LNC took 0.8s. Estimated remaining: 6m 16s. Rate: 160.0 symbols/min [2025-09-17T07:37:58.184282] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:58.184416] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:58.184454] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:58.203284] [DEBUG] [LOCAL ] LNN: Loaded 11221 existing records from primary storage. [2025-09-17T07:37:58.203487] [INFO ] [MAIN ] LNN: Loaded 11221 primary data records. [2025-09-17T07:37:58.519929] [DEBUG] [LOCAL ] LOAR: Loaded 41564 existing records from primary storage. [2025-09-17T07:37:58.547940] [INFO ] [MAIN ] LOAR: Loaded 41564 primary data records. [2025-09-17T07:37:58.549157] [DEBUG] [LOCAL ] LNG: Loaded 51629 existing records from primary storage. [2025-09-17T07:37:58.581236] [INFO ] [MAIN ] LNG: Loaded 51629 primary data records. [2025-09-17T07:37:59.165394] [DEBUG] [MAIN ] LNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:59.167048] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11221 primary records. [2025-09-17T07:37:59.167260] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-17T07:37:59.186595] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-09-17T07:37:59.186953] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-17T07:37:59.188976] [INFO ] [MAIN ] Derivative Progress: 1171/2172 symbols completed. LNN took 1.0s. Estimated remaining: 6m 16s. Rate: 159.8 symbols/min [2025-09-17T07:37:59.189532] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:59.210497] [DEBUG] [MAIN ] LOAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:59.228848] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 41564 primary records. [2025-09-17T07:37:59.236709] [DEBUG] [MAIN ] LNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:37:59.236847] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-17T07:37:59.237585] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51629 primary records. [2025-09-17T07:37:59.237734] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-17T07:37:59.273843] [DEBUG] [LOCAL ] LOB: Loaded 27355 existing records from primary storage. [2025-09-17T07:37:59.276048] [INFO ] [MAIN ] LOB: Loaded 27355 primary data records. [2025-09-17T07:37:59.322493] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-09-17T07:37:59.338941] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-09-17T07:37:59.361253] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-17T07:37:59.366479] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-17T07:37:59.391499] [INFO ] [MAIN ] Derivative Progress: 1172/2172 symbols completed. LNG took 1.2s. Estimated remaining: 6m 15s. Rate: 159.9 symbols/min [2025-09-17T07:37:59.394210] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:59.400132] [INFO ] [MAIN ] Derivative Progress: 1173/2172 symbols completed. LOAR took 1.2s. Estimated remaining: 6m 15s. Rate: 160.0 symbols/min [2025-09-17T07:37:59.452071] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:37:59.477804] [DEBUG] [LOCAL ] LOCL: Loaded 3235 existing records from primary storage. [2025-09-17T07:37:59.613954] [INFO ] [MAIN ] LOCL: Loaded 3235 primary data records. [2025-09-17T07:37:59.838959] [DEBUG] [LOCAL ] LOMA: Loaded 31278 existing records from primary storage. [2025-09-17T07:37:59.951575] [INFO ] [MAIN ] LOMA: Loaded 31278 primary data records. [2025-09-17T07:38:00.273497] [DEBUG] [MAIN ] LOB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:00.274438] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 27355 primary records. [2025-09-17T07:38:00.274817] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-17T07:38:00.308472] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-09-17T07:38:00.309061] [DEBUG] [MAIN ] LOCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:00.309217] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-17T07:38:00.309879] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3235 primary records. [2025-09-17T07:38:00.311992] [INFO ] [MAIN ] Derivative Progress: 1174/2172 symbols completed. LOB took 1.1s. Estimated remaining: 6m 15s. Rate: 159.8 symbols/min [2025-09-17T07:38:00.312063] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-17T07:38:00.312715] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:00.328363] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-09-17T07:38:00.328733] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-17T07:38:00.330880] [INFO ] [MAIN ] Derivative Progress: 1175/2172 symbols completed. LOCL took 0.9s. Estimated remaining: 6m 14s. Rate: 159.9 symbols/min [2025-09-17T07:38:00.331177] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:00.347686] [DEBUG] [MAIN ] LOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:00.348501] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 31278 primary records. [2025-09-17T07:38:00.348671] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-17T07:38:00.365188] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-09-17T07:38:00.365386] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-17T07:38:00.367828] [INFO ] [MAIN ] Derivative Progress: 1176/2172 symbols completed. LOMA took 1.0s. Estimated remaining: 6m 13s. Rate: 160.1 symbols/min [2025-09-17T07:38:00.368055] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:00.427392] [DEBUG] [LOCAL ] LOW: Loaded 52968 existing records from primary storage. [2025-09-17T07:38:00.428099] [DEBUG] [LOCAL ] LPG: Loaded 40564 existing records from primary storage. [2025-09-17T07:38:00.428195] [INFO ] [MAIN ] LOW: Loaded 52968 primary data records. [2025-09-17T07:38:00.428399] [INFO ] [MAIN ] LPG: Loaded 40564 primary data records. [2025-09-17T07:38:00.599715] [DEBUG] [LOCAL ] LPL: Loaded 24859 existing records from primary storage. [2025-09-17T07:38:00.653409] [INFO ] [MAIN ] LPL: Loaded 24859 primary data records. [2025-09-17T07:38:01.408826] [DEBUG] [MAIN ] LOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:01.422557] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52968 primary records. [2025-09-17T07:38:01.422870] [DEBUG] [MAIN ] LPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:01.423274] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-17T07:38:01.425315] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 40564 primary records. [2025-09-17T07:38:01.437079] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-17T07:38:01.443023] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-09-17T07:38:01.451934] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-17T07:38:01.458287] [INFO ] [MAIN ] Derivative Progress: 1177/2172 symbols completed. LOW took 1.1s. Estimated remaining: 6m 14s. Rate: 159.8 symbols/min [2025-09-17T07:38:01.459971] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:01.476188] [DEBUG] [MAIN ] LPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:01.477905] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 24859 primary records. [2025-09-17T07:38:01.478265] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-17T07:38:01.479076] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-09-17T07:38:01.479984] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-17T07:38:01.482627] [INFO ] [MAIN ] Derivative Progress: 1178/2172 symbols completed. LPG took 1.2s. Estimated remaining: 6m 13s. Rate: 159.9 symbols/min [2025-09-17T07:38:01.494101] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:01.501570] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-09-17T07:38:01.501902] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-17T07:38:01.504520] [INFO ] [MAIN ] Derivative Progress: 1179/2172 symbols completed. LPL took 1.1s. Estimated remaining: 6m 12s. Rate: 160.0 symbols/min [2025-09-17T07:38:01.514153] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:01.532089] [DEBUG] [LOCAL ] LPX: Loaded 39706 existing records from primary storage. [2025-09-17T07:38:01.532379] [INFO ] [MAIN ] LPX: Loaded 39706 primary data records. [2025-09-17T07:38:01.737208] [DEBUG] [LOCAL ] LRN: Loaded 40057 existing records from primary storage. [2025-09-17T07:38:01.874582] [INFO ] [MAIN ] LRN: Loaded 40057 primary data records. [2025-09-17T07:38:01.887488] [DEBUG] [LOCAL ] LSPD: Loaded 43757 existing records from primary storage. [2025-09-17T07:38:01.933158] [INFO ] [MAIN ] LSPD: Loaded 43757 primary data records. [2025-09-17T07:38:02.548319] [DEBUG] [MAIN ] LPX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:02.550040] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 39706 primary records. [2025-09-17T07:38:02.550479] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-17T07:38:02.572369] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-09-17T07:38:02.572679] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-17T07:38:02.575873] [INFO ] [MAIN ] Derivative Progress: 1180/2172 symbols completed. LPX took 1.1s. Estimated remaining: 6m 12s. Rate: 159.8 symbols/min [2025-09-17T07:38:02.576579] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:02.591590] [DEBUG] [MAIN ] LRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:02.593022] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 40057 primary records. [2025-09-17T07:38:02.594476] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-17T07:38:02.620006] [DEBUG] [MAIN ] LSPD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:02.621735] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 43757 primary records. [2025-09-17T07:38:02.622704] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-17T07:38:02.644556] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-09-17T07:38:02.646205] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-17T07:38:02.649169] [INFO ] [MAIN ] Derivative Progress: 1181/2172 symbols completed. LRN took 1.2s. Estimated remaining: 6m 12s. Rate: 159.9 symbols/min [2025-09-17T07:38:02.649716] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:02.652368] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-09-17T07:38:02.652586] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-17T07:38:02.655332] [INFO ] [MAIN ] Derivative Progress: 1182/2172 symbols completed. LSPD took 1.1s. Estimated remaining: 6m 11s. Rate: 160.0 symbols/min [2025-09-17T07:38:02.665107] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:02.665875] [DEBUG] [LOCAL ] LTC: Loaded 30020 existing records from primary storage. [2025-09-17T07:38:02.666063] [INFO ] [MAIN ] LTC: Loaded 30020 primary data records. [2025-09-17T07:38:03.021906] [DEBUG] [LOCAL ] LTM: Loaded 35408 existing records from primary storage. [2025-09-17T07:38:03.022868] [DEBUG] [LOCAL ] LTH: Loaded 51948 existing records from primary storage. [2025-09-17T07:38:03.024215] [INFO ] [MAIN ] LTH: Loaded 51948 primary data records. [2025-09-17T07:38:03.023197] [INFO ] [MAIN ] LTM: Loaded 35408 primary data records. [2025-09-17T07:38:03.678392] [DEBUG] [MAIN ] LTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:03.680406] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 30020 primary records. [2025-09-17T07:38:03.681011] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-17T07:38:03.702188] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-09-17T07:38:03.702592] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-17T07:38:03.705056] [INFO ] [MAIN ] Derivative Progress: 1183/2172 symbols completed. LTC took 1.1s. Estimated remaining: 6m 11s. Rate: 159.8 symbols/min [2025-09-17T07:38:03.735435] [DEBUG] [MAIN ] LTM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:03.735701] [DEBUG] [MAIN ] LTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:03.736346] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 35408 primary records. [2025-09-17T07:38:03.736882] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51948 primary records. [2025-09-17T07:38:03.737031] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-17T07:38:03.737063] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-17T07:38:03.766742] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-09-17T07:38:03.767719] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-17T07:38:03.768373] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-09-17T07:38:03.770988] [INFO ] [MAIN ] Derivative Progress: 1184/2172 symbols completed. LTM took 1.1s. Estimated remaining: 6m 11s. Rate: 159.9 symbols/min [2025-09-17T07:38:03.771093] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-17T07:38:03.773022] [INFO ] [MAIN ] Derivative Progress: 1185/2172 symbols completed. LTH took 1.1s. Estimated remaining: 6m 10s. Rate: 160.0 symbols/min [2025-09-17T07:38:03.773616] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:03.773820] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:03.773967] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:03.831949] [DEBUG] [LOCAL ] LU: Loaded 48945 existing records from primary storage. [2025-09-17T07:38:03.832121] [INFO ] [MAIN ] LU: Loaded 48945 primary data records. [2025-09-17T07:38:04.018384] [DEBUG] [LOCAL ] LUMN: Loaded 53633 existing records from primary storage. [2025-09-17T07:38:04.045598] [INFO ] [MAIN ] LUMN: Loaded 53633 primary data records. [2025-09-17T07:38:04.045503] [DEBUG] [LOCAL ] LUV: Loaded 53688 existing records from primary storage. [2025-09-17T07:38:04.129555] [INFO ] [MAIN ] LUV: Loaded 53688 primary data records. [2025-09-17T07:38:04.858247] [DEBUG] [MAIN ] LU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:04.859534] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48945 primary records. [2025-09-17T07:38:04.860250] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-17T07:38:04.887512] [DEBUG] [MAIN ] LUMN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:04.892000] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-09-17T07:38:04.889476] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53633 primary records. [2025-09-17T07:38:04.892215] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-17T07:38:04.894604] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-17T07:38:04.894508] [INFO ] [MAIN ] Derivative Progress: 1186/2172 symbols completed. LU took 1.1s. Estimated remaining: 6m 10s. Rate: 159.8 symbols/min [2025-09-17T07:38:04.896829] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:04.924148] [DEBUG] [MAIN ] LUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:04.926477] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-09-17T07:38:04.926715] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-17T07:38:04.929319] [INFO ] [MAIN ] Derivative Progress: 1187/2172 symbols completed. LUMN took 1.2s. Estimated remaining: 6m 10s. Rate: 159.9 symbols/min [2025-09-17T07:38:04.930138] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53688 primary records. [2025-09-17T07:38:04.930411] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-17T07:38:04.931367] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:04.948667] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-09-17T07:38:04.948837] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-17T07:38:04.951472] [INFO ] [MAIN ] Derivative Progress: 1188/2172 symbols completed. LUV took 1.2s. Estimated remaining: 6m 9s. Rate: 160.0 symbols/min [2025-09-17T07:38:04.951878] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:04.978154] [DEBUG] [LOCAL ] LVWR: Loaded 16907 existing records from primary storage. [2025-09-17T07:38:04.978313] [INFO ] [MAIN ] LVWR: Loaded 16907 primary data records. [2025-09-17T07:38:05.101357] [DEBUG] [LOCAL ] LVS: Loaded 53565 existing records from primary storage. [2025-09-17T07:38:05.101592] [INFO ] [MAIN ] LVS: Loaded 53565 primary data records. [2025-09-17T07:38:05.647495] [DEBUG] [LOCAL ] LW: Loaded 51336 existing records from primary storage. [2025-09-17T07:38:05.657932] [INFO ] [MAIN ] LW: Loaded 51336 primary data records. [2025-09-17T07:38:05.980574] [DEBUG] [MAIN ] LVWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:05.981841] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 16907 primary records. [2025-09-17T07:38:05.982412] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-17T07:38:06.012920] [DEBUG] [MAIN ] LVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:06.016100] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-09-17T07:38:06.015451] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53565 primary records. [2025-09-17T07:38:06.016366] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-17T07:38:06.018432] [INFO ] [MAIN ] Derivative Progress: 1189/2172 symbols completed. LVWR took 1.1s. Estimated remaining: 6m 9s. Rate: 159.8 symbols/min [2025-09-17T07:38:06.019082] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:06.019001] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-17T07:38:06.038108] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-09-17T07:38:06.039937] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-17T07:38:06.042493] [INFO ] [MAIN ] Derivative Progress: 1190/2172 symbols completed. LVS took 1.1s. Estimated remaining: 6m 8s. Rate: 159.9 symbols/min [2025-09-17T07:38:06.047779] [INFO ] [MAIN ] LXP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:06.061275] [DEBUG] [MAIN ] LW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:06.062419] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51336 primary records. [2025-09-17T07:38:06.063092] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-17T07:38:06.070422] [DEBUG] [LOCAL ] LXFR: Loaded 17200 existing records from primary storage. [2025-09-17T07:38:06.081611] [INFO ] [MAIN ] LXFR: Loaded 17200 primary data records. [2025-09-17T07:38:06.085610] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-09-17T07:38:06.109695] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-17T07:38:06.118852] [INFO ] [MAIN ] Derivative Progress: 1191/2172 symbols completed. LW took 1.2s. Estimated remaining: 6m 8s. Rate: 160.0 symbols/min [2025-09-17T07:38:06.136476] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:06.427193] [DEBUG] [LOCAL ] LXP: Loaded 50599 existing records from primary storage. [2025-09-17T07:38:06.427850] [INFO ] [MAIN ] LXP: Loaded 50599 primary data records. [2025-09-17T07:38:06.493611] [DEBUG] [LOCAL ] LXU: Loaded 32310 existing records from primary storage. [2025-09-17T07:38:06.509235] [INFO ] [MAIN ] LXU: Loaded 32310 primary data records. [2025-09-17T07:38:07.049906] [DEBUG] [MAIN ] LXFR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:07.050752] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 17200 primary records. [2025-09-17T07:38:07.051726] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-17T07:38:07.071935] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-09-17T07:38:07.072166] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-17T07:38:07.075069] [INFO ] [MAIN ] Derivative Progress: 1192/2172 symbols completed. LXFR took 1.1s. Estimated remaining: 6m 8s. Rate: 159.8 symbols/min [2025-09-17T07:38:07.075793] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:07.095599] [DEBUG] [MAIN ] LXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:07.108743] [INFO ] [MAIN ] LXP: Generated 1794 derivative records from 50599 primary records. [2025-09-17T07:38:07.109191] [DEBUG] [LOCAL ] LXP: Saving derivative data. [2025-09-17T07:38:07.109535] [DEBUG] [MAIN ] LXU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:07.111102] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 32310 primary records. [2025-09-17T07:38:07.111525] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-17T07:38:07.127510] [DEBUG] [LOCAL ] LXP: Derivative data saved (1794 records). [2025-09-17T07:38:07.136505] [INFO ] [MAIN ] LXP: Successfully saved derivative data. [2025-09-17T07:38:07.143118] [INFO ] [MAIN ] Derivative Progress: 1193/2172 symbols completed. LXP took 1.1s. Estimated remaining: 6m 7s. Rate: 159.9 symbols/min [2025-09-17T07:38:07.145571] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:07.147058] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-09-17T07:38:07.147381] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-17T07:38:07.150019] [INFO ] [MAIN ] Derivative Progress: 1194/2172 symbols completed. LXU took 1.0s. Estimated remaining: 6m 7s. Rate: 160.0 symbols/min [2025-09-17T07:38:07.150394] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:07.190298] [DEBUG] [LOCAL ] LYB: Loaded 53600 existing records from primary storage. [2025-09-17T07:38:07.190498] [INFO ] [MAIN ] LYB: Loaded 53600 primary data records. [2025-09-17T07:38:07.567993] [DEBUG] [LOCAL ] LYG: Loaded 52953 existing records from primary storage. [2025-09-17T07:38:07.567257] [DEBUG] [LOCAL ] LYV: Loaded 51308 existing records from primary storage. [2025-09-17T07:38:07.577690] [INFO ] [MAIN ] LYV: Loaded 51308 primary data records. [2025-09-17T07:38:07.578096] [INFO ] [MAIN ] LYG: Loaded 52953 primary data records. [2025-09-17T07:38:08.182723] [DEBUG] [MAIN ] LYB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:08.183556] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53600 primary records. [2025-09-17T07:38:08.183771] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-17T07:38:08.201939] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-09-17T07:38:08.202251] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-17T07:38:08.205089] [INFO ] [MAIN ] Derivative Progress: 1195/2172 symbols completed. LYB took 1.1s. Estimated remaining: 6m 7s. Rate: 159.8 symbols/min [2025-09-17T07:38:08.205955] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:08.237583] [DEBUG] [MAIN ] LYV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:08.237943] [DEBUG] [MAIN ] LYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:08.238664] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51308 primary records. [2025-09-17T07:38:08.239212] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52953 primary records. [2025-09-17T07:38:08.239313] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-17T07:38:08.239387] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-17T07:38:08.276869] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-09-17T07:38:08.278359] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-17T07:38:08.280941] [INFO ] [MAIN ] Derivative Progress: 1196/2172 symbols completed. LYV took 1.1s. Estimated remaining: 6m 6s. Rate: 159.9 symbols/min [2025-09-17T07:38:08.281857] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:08.282952] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-09-17T07:38:08.294196] [DEBUG] [LOCAL ] LZB: Loaded 35468 existing records from primary storage. [2025-09-17T07:38:08.293291] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-17T07:38:08.294360] [INFO ] [MAIN ] LZB: Loaded 35468 primary data records. [2025-09-17T07:38:08.297084] [INFO ] [MAIN ] Derivative Progress: 1197/2172 symbols completed. LYG took 1.2s. Estimated remaining: 6m 6s. Rate: 160.0 symbols/min [2025-09-17T07:38:08.334226] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:08.482703] [DEBUG] [LOCAL ] LZM: Loaded 13293 existing records from primary storage. [2025-09-17T07:38:08.486924] [INFO ] [MAIN ] LZM: Loaded 13293 primary data records. [2025-09-17T07:38:08.927016] [DEBUG] [LOCAL ] M: Loaded 53536 existing records from primary storage. [2025-09-17T07:38:08.928251] [INFO ] [MAIN ] M: Loaded 53536 primary data records. [2025-09-17T07:38:09.040998] [DEBUG] [MAIN ] LZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:09.065984] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35468 primary records. [2025-09-17T07:38:09.122846] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-17T07:38:09.267874] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-09-17T07:38:09.269377] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-17T07:38:09.271383] [INFO ] [MAIN ] Derivative Progress: 1198/2172 symbols completed. LZB took 1.1s. Estimated remaining: 6m 6s. Rate: 159.8 symbols/min [2025-09-17T07:38:09.286112] [DEBUG] [MAIN ] LZM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:09.287496] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 13293 primary records. [2025-09-17T07:38:09.287746] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-17T07:38:09.306700] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-09-17T07:38:09.306880] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-17T07:38:09.309455] [INFO ] [MAIN ] Derivative Progress: 1199/2172 symbols completed. LZM took 1.0s. Estimated remaining: 6m 5s. Rate: 159.9 symbols/min [2025-09-17T07:38:09.325667] [DEBUG] [MAIN ] M: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:09.326366] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53536 primary records. [2025-09-17T07:38:09.326440] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-17T07:38:09.342085] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-09-17T07:38:09.342210] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-17T07:38:09.344495] [INFO ] [MAIN ] Derivative Progress: 1200/2172 symbols completed. M took 1.0s. Estimated remaining: 6m 4s. Rate: 160.1 symbols/min [2025-09-17T07:38:09.345334] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:09.345480] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:09.345742] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:09.418988] [DEBUG] [LOCAL ] MA: Loaded 52594 existing records from primary storage. [2025-09-17T07:38:09.419189] [INFO ] [MAIN ] MA: Loaded 52594 primary data records. [2025-09-17T07:38:09.548778] [DEBUG] [LOCAL ] MAA: Loaded 43055 existing records from primary storage. [2025-09-17T07:38:09.549331] [INFO ] [MAIN ] MAA: Loaded 43055 primary data records. [2025-09-17T07:38:09.549974] [DEBUG] [LOCAL ] MAC: Loaded 49787 existing records from primary storage. [2025-09-17T07:38:09.575957] [INFO ] [MAIN ] MAC: Loaded 49787 primary data records. [2025-09-17T07:38:10.408600] [DEBUG] [MAIN ] MA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:10.410924] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52594 primary records. [2025-09-17T07:38:10.411777] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-17T07:38:10.442433] [DEBUG] [MAIN ] MAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:10.444681] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 43055 primary records. [2025-09-17T07:38:10.458659] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-17T07:38:10.460461] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-09-17T07:38:10.461146] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-17T07:38:10.463124] [INFO ] [MAIN ] Derivative Progress: 1201/2172 symbols completed. MA took 1.1s. Estimated remaining: 6m 5s. Rate: 159.8 symbols/min [2025-09-17T07:38:10.464136] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:10.463548] [DEBUG] [MAIN ] MAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:10.465300] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49787 primary records. [2025-09-17T07:38:10.473052] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-17T07:38:10.494939] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-09-17T07:38:10.496053] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-17T07:38:10.498684] [INFO ] [MAIN ] Derivative Progress: 1202/2172 symbols completed. MAA took 1.2s. Estimated remaining: 6m 4s. Rate: 159.9 symbols/min [2025-09-17T07:38:10.499914] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-09-17T07:38:10.500168] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:10.500277] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-17T07:38:10.503287] [INFO ] [MAIN ] Derivative Progress: 1203/2172 symbols completed. MAC took 1.2s. Estimated remaining: 6m 3s. Rate: 160.0 symbols/min [2025-09-17T07:38:10.503570] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:10.539092] [DEBUG] [LOCAL ] MAGN: Loaded 35005 existing records from primary storage. [2025-09-17T07:38:10.539371] [INFO ] [MAIN ] MAGN: Loaded 35005 primary data records. [2025-09-17T07:38:10.730553] [DEBUG] [LOCAL ] MAIN: Loaded 41397 existing records from primary storage. [2025-09-17T07:38:10.751531] [INFO ] [MAIN ] MAIN: Loaded 41397 primary data records. [2025-09-17T07:38:10.913907] [DEBUG] [LOCAL ] MAN: Loaded 43736 existing records from primary storage. [2025-09-17T07:38:10.954945] [INFO ] [MAIN ] MAN: Loaded 43736 primary data records. [2025-09-17T07:38:11.554660] [DEBUG] [MAIN ] MAGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:11.555491] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 35005 primary records. [2025-09-17T07:38:11.555762] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-17T07:38:11.574925] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-09-17T07:38:11.575524] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-17T07:38:11.578486] [INFO ] [MAIN ] Derivative Progress: 1204/2172 symbols completed. MAGN took 1.1s. Estimated remaining: 6m 3s. Rate: 159.8 symbols/min [2025-09-17T07:38:11.579391] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:11.596859] [DEBUG] [MAIN ] MAIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:11.597804] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41397 primary records. [2025-09-17T07:38:11.597927] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-17T07:38:11.617251] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-09-17T07:38:11.633130] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-17T07:38:11.640388] [INFO ] [MAIN ] Derivative Progress: 1205/2172 symbols completed. MAIN took 1.1s. Estimated remaining: 6m 3s. Rate: 159.9 symbols/min [2025-09-17T07:38:11.640803] [DEBUG] [MAIN ] MAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:11.641908] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43736 primary records. [2025-09-17T07:38:11.642364] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:11.642273] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-17T07:38:11.665309] [DEBUG] [LOCAL ] MANU: Loaded 26936 existing records from primary storage. [2025-09-17T07:38:11.669063] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-09-17T07:38:11.669341] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-17T07:38:11.672245] [INFO ] [MAIN ] Derivative Progress: 1206/2172 symbols completed. MAN took 1.2s. Estimated remaining: 6m 2s. Rate: 160.0 symbols/min [2025-09-17T07:38:11.669455] [INFO ] [MAIN ] MANU: Loaded 26936 primary data records. [2025-09-17T07:38:11.672584] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:12.002890] [DEBUG] [LOCAL ] MAS: Loaded 52368 existing records from primary storage. [2025-09-17T07:38:12.003829] [INFO ] [MAIN ] MAS: Loaded 52368 primary data records. [2025-09-17T07:38:12.119054] [DEBUG] [LOCAL ] MATV: Loaded 38024 existing records from primary storage. [2025-09-17T07:38:12.125671] [INFO ] [MAIN ] MATV: Loaded 38024 primary data records. [2025-09-17T07:38:12.621506] [DEBUG] [MAIN ] MANU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:12.623441] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 26936 primary records. [2025-09-17T07:38:12.624426] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-17T07:38:12.642460] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-09-17T07:38:12.642778] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-17T07:38:12.644938] [INFO ] [MAIN ] Derivative Progress: 1207/2172 symbols completed. MANU took 1.1s. Estimated remaining: 6m 2s. Rate: 159.8 symbols/min [2025-09-17T07:38:12.645499] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:12.662080] [DEBUG] [MAIN ] MAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:12.662795] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52368 primary records. [2025-09-17T07:38:12.663088] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-17T07:38:12.681009] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-09-17T07:38:12.681182] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-17T07:38:12.683305] [INFO ] [MAIN ] Derivative Progress: 1208/2172 symbols completed. MAS took 1.0s. Estimated remaining: 6m 2s. Rate: 159.9 symbols/min [2025-09-17T07:38:12.697207] [DEBUG] [MAIN ] MATV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:12.706828] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 38024 primary records. [2025-09-17T07:38:12.707021] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-17T07:38:12.705859] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:12.724110] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-09-17T07:38:12.725010] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-17T07:38:12.735632] [INFO ] [MAIN ] Derivative Progress: 1209/2172 symbols completed. MATV took 1.1s. Estimated remaining: 6m 1s. Rate: 160.1 symbols/min [2025-09-17T07:38:12.737156] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:12.737689] [DEBUG] [LOCAL ] MATX: Loaded 31574 existing records from primary storage. [2025-09-17T07:38:12.738124] [INFO ] [MAIN ] MATX: Loaded 31574 primary data records. [2025-09-17T07:38:12.938277] [DEBUG] [LOCAL ] MAX: Loaded 31047 existing records from primary storage. [2025-09-17T07:38:12.938915] [INFO ] [MAIN ] MAX: Loaded 31047 primary data records. [2025-09-17T07:38:13.180691] [DEBUG] [LOCAL ] MBC: Loaded 43064 existing records from primary storage. [2025-09-17T07:38:13.202675] [INFO ] [MAIN ] MBC: Loaded 43064 primary data records. [2025-09-17T07:38:13.820069] [DEBUG] [MAIN ] MATX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:13.821709] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31574 primary records. [2025-09-17T07:38:13.823087] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-17T07:38:13.842542] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-09-17T07:38:13.843375] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-17T07:38:13.845748] [INFO ] [MAIN ] Derivative Progress: 1210/2172 symbols completed. MATX took 1.2s. Estimated remaining: 6m 1s. Rate: 159.8 symbols/min [2025-09-17T07:38:13.846324] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:13.866487] [DEBUG] [MAIN ] MAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:13.868180] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 31047 primary records. [2025-09-17T07:38:13.868760] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-17T07:38:13.896903] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-09-17T07:38:13.907765] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-17T07:38:13.910255] [INFO ] [MAIN ] Derivative Progress: 1211/2172 symbols completed. MAX took 1.2s. Estimated remaining: 6m 1s. Rate: 159.9 symbols/min [2025-09-17T07:38:13.920065] [DEBUG] [LOCAL ] MBI: Loaded 25156 existing records from primary storage. [2025-09-17T07:38:13.925103] [INFO ] [MAIN ] MBI: Loaded 25156 primary data records. [2025-09-17T07:38:13.925459] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:13.950234] [DEBUG] [MAIN ] MBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:13.976119] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43064 primary records. [2025-09-17T07:38:13.999938] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-17T07:38:14.086844] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-09-17T07:38:14.110405] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-17T07:38:14.162838] [INFO ] [MAIN ] Derivative Progress: 1212/2172 symbols completed. MBC took 1.4s. Estimated remaining: 6m 0s. Rate: 159.9 symbols/min [2025-09-17T07:38:14.288355] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:14.312551] [DEBUG] [LOCAL ] MC: Loaded 44481 existing records from primary storage. [2025-09-17T07:38:14.313733] [INFO ] [MAIN ] MC: Loaded 44481 primary data records. [2025-09-17T07:38:14.388072] [DEBUG] [LOCAL ] MCB: Loaded 11776 existing records from primary storage. [2025-09-17T07:38:14.410549] [INFO ] [MAIN ] MCB: Loaded 11776 primary data records. [2025-09-17T07:38:14.940304] [DEBUG] [MAIN ] MBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:14.941980] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 25156 primary records. [2025-09-17T07:38:14.942991] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-17T07:38:14.961532] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-09-17T07:38:14.961797] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-17T07:38:14.964108] [INFO ] [MAIN ] Derivative Progress: 1213/2172 symbols completed. MBI took 1.1s. Estimated remaining: 6m 0s. Rate: 159.8 symbols/min [2025-09-17T07:38:14.983011] [DEBUG] [MAIN ] MC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:14.984262] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 44481 primary records. [2025-09-17T07:38:14.985038] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-17T07:38:15.011878] [DEBUG] [MAIN ] MCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:15.013550] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11776 primary records. [2025-09-17T07:38:15.013860] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-17T07:38:15.015372] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-09-17T07:38:15.015605] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-17T07:38:15.028251] [INFO ] [MAIN ] Derivative Progress: 1214/2172 symbols completed. MC took 1.1s. Estimated remaining: 5m 59s. Rate: 159.9 symbols/min [2025-09-17T07:38:15.032173] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-09-17T07:38:15.032248] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-17T07:38:15.034629] [INFO ] [MAIN ] Derivative Progress: 1215/2172 symbols completed. MCB took 0.9s. Estimated remaining: 5m 59s. Rate: 160.0 symbols/min [2025-09-17T07:38:15.035334] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:15.035450] [INFO ] [MAIN ] MCD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:15.035567] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:15.045580] [DEBUG] [LOCAL ] MCI: Loaded 6360 existing records from primary storage. [2025-09-17T07:38:15.045819] [INFO ] [MAIN ] MCI: Loaded 6360 primary data records. [2025-09-17T07:38:15.377958] [DEBUG] [LOCAL ] MCK: Loaded 39680 existing records from primary storage. [2025-09-17T07:38:15.393143] [INFO ] [MAIN ] MCK: Loaded 39680 primary data records. [2025-09-17T07:38:15.513403] [DEBUG] [LOCAL ] MCD: Loaded 53469 existing records from primary storage. [2025-09-17T07:38:15.570523] [INFO ] [MAIN ] MCD: Loaded 53469 primary data records. [2025-09-17T07:38:16.117674] [DEBUG] [MAIN ] MCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:16.119053] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6360 primary records. [2025-09-17T07:38:16.119994] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-17T07:38:16.142216] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-09-17T07:38:16.155396] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-17T07:38:16.157892] [INFO ] [MAIN ] Derivative Progress: 1216/2172 symbols completed. MCI took 1.1s. Estimated remaining: 5m 59s. Rate: 159.8 symbols/min [2025-09-17T07:38:16.158975] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:16.158814] [DEBUG] [MAIN ] MCK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:16.160398] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 39680 primary records. [2025-09-17T07:38:16.161239] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-17T07:38:16.185479] [DEBUG] [LOCAL ] MCN: Loaded 8162 existing records from primary storage. [2025-09-17T07:38:16.187095] [INFO ] [MAIN ] MCN: Loaded 8162 primary data records. [2025-09-17T07:38:16.244156] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-09-17T07:38:16.281946] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-17T07:38:16.349300] [INFO ] [MAIN ] Derivative Progress: 1217/2172 symbols completed. MCK took 1.3s. Estimated remaining: 5m 58s. Rate: 159.8 symbols/min [2025-09-17T07:38:16.383309] [DEBUG] [MAIN ] MCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:16.387493] [INFO ] [MAIN ] MCD: Generated 1794 derivative records from 53469 primary records. [2025-09-17T07:38:16.444819] [DEBUG] [LOCAL ] MCD: Saving derivative data. [2025-09-17T07:38:16.485791] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:16.524120] [DEBUG] [LOCAL ] MCD: Derivative data saved (1794 records). [2025-09-17T07:38:16.524768] [INFO ] [MAIN ] MCD: Successfully saved derivative data. [2025-09-17T07:38:16.527661] [INFO ] [MAIN ] Derivative Progress: 1218/2172 symbols completed. MCD took 1.5s. Estimated remaining: 5m 58s. Rate: 159.9 symbols/min [2025-09-17T07:38:16.528671] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:16.544050] [DEBUG] [LOCAL ] MCR: Loaded 9007 existing records from primary storage. [2025-09-17T07:38:16.546571] [INFO ] [MAIN ] MCR: Loaded 9007 primary data records. [2025-09-17T07:38:16.639879] [DEBUG] [MAIN ] MCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:16.674079] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8162 primary records. [2025-09-17T07:38:16.674267] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-17T07:38:16.752744] [DEBUG] [LOCAL ] MCO: Loaded 39613 existing records from primary storage. [2025-09-17T07:38:16.874956] [INFO ] [MAIN ] MCO: Loaded 39613 primary data records. [2025-09-17T07:38:16.893553] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-09-17T07:38:16.926813] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-17T07:38:16.964443] [INFO ] [MAIN ] Derivative Progress: 1219/2172 symbols completed. MCN took 0.8s. Estimated remaining: 5m 58s. Rate: 159.9 symbols/min [2025-09-17T07:38:16.988269] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:17.225530] [DEBUG] [LOCAL ] MCS: Loaded 21546 existing records from primary storage. [2025-09-17T07:38:17.238927] [INFO ] [MAIN ] MCS: Loaded 21546 primary data records. [2025-09-17T07:38:17.239420] [DEBUG] [MAIN ] MCR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:17.276378] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 9007 primary records. [2025-09-17T07:38:17.276488] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-17T07:38:17.383539] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-09-17T07:38:17.434997] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-17T07:38:17.582618] [INFO ] [MAIN ] Derivative Progress: 1220/2172 symbols completed. MCR took 1.1s. Estimated remaining: 5m 57s. Rate: 159.8 symbols/min [2025-09-17T07:38:17.597627] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:17.616758] [DEBUG] [MAIN ] MCO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:38:17.618017] [INFO ] [MAIN ] MCO: Generated 1793 derivative records from 39613 primary records. [2025-09-17T07:38:17.618225] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-17T07:38:17.647609] [DEBUG] [LOCAL ] MCO: Derivative data saved (1793 records). [2025-09-17T07:38:17.648111] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-17T07:38:17.650332] [INFO ] [MAIN ] Derivative Progress: 1221/2172 symbols completed. MCO took 1.3s. Estimated remaining: 5m 57s. Rate: 159.9 symbols/min [2025-09-17T07:38:17.650623] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:17.670221] [DEBUG] [MAIN ] MCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:17.683926] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 21546 primary records. [2025-09-17T07:38:17.683217] [DEBUG] [LOCAL ] MDST: Loaded 5396 existing records from primary storage. [2025-09-17T07:38:17.684162] [INFO ] [MAIN ] MDST: Loaded 5396 primary data records. [2025-09-17T07:38:17.684101] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-17T07:38:17.696302] [DEBUG] [LOCAL ] MD: Loaded 38818 existing records from primary storage. [2025-09-17T07:38:17.696880] [INFO ] [MAIN ] MD: Loaded 38818 primary data records. [2025-09-17T07:38:17.990950] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-09-17T07:38:18.029419] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-17T07:38:18.035371] [INFO ] [MAIN ] Derivative Progress: 1222/2172 symbols completed. MCS took 1.0s. Estimated remaining: 5m 56s. Rate: 159.9 symbols/min [2025-09-17T07:38:18.073865] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:18.336816] [DEBUG] [MAIN ] MDST: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:38:18.339074] [INFO ] [MAIN ] MDST: Generated 1793 derivative records from 5396 primary records. [2025-09-17T07:38:18.339349] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-17T07:38:18.376528] [DEBUG] [MAIN ] MD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:18.384184] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38818 primary records. [2025-09-17T07:38:18.384842] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-17T07:38:18.385183] [DEBUG] [LOCAL ] MDST: Derivative data saved (1793 records). [2025-09-17T07:38:18.386602] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-17T07:38:18.389329] [INFO ] [MAIN ] Derivative Progress: 1223/2172 symbols completed. MDST took 0.7s. Estimated remaining: 5m 56s. Rate: 159.9 symbols/min [2025-09-17T07:38:18.397026] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:18.419608] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-09-17T07:38:18.420877] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-17T07:38:18.421181] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-17T07:38:18.421101] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-09-17T07:38:18.423559] [INFO ] [MAIN ] Derivative Progress: 1224/2172 symbols completed. MD took 0.8s. Estimated remaining: 5m 55s. Rate: 160.0 symbols/min [2025-09-17T07:38:18.423815] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:18.542437] [DEBUG] [LOCAL ] MDV: Loaded 8838 existing records from primary storage. [2025-09-17T07:38:18.557093] [INFO ] [MAIN ] MDV: Loaded 8838 primary data records. [2025-09-17T07:38:18.883135] [DEBUG] [LOCAL ] MDU: Loaded 47858 existing records from primary storage. [2025-09-17T07:38:18.908828] [INFO ] [MAIN ] MDU: Loaded 47858 primary data records. [2025-09-17T07:38:19.451002] [DEBUG] [MAIN ] MDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:19.452113] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-09-17T07:38:19.452467] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-17T07:38:19.485096] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-09-17T07:38:19.481221] [DEBUG] [MAIN ] MDV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:19.486264] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8838 primary records. [2025-09-17T07:38:19.486425] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-17T07:38:19.486727] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-17T07:38:19.489028] [INFO ] [MAIN ] Derivative Progress: 1225/2172 symbols completed. MDT took 1.4s. Estimated remaining: 5m 56s. Rate: 159.8 symbols/min [2025-09-17T07:38:19.489505] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:19.508725] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-09-17T07:38:19.509011] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-17T07:38:19.527211] [INFO ] [MAIN ] Derivative Progress: 1226/2172 symbols completed. MDV took 1.1s. Estimated remaining: 5m 55s. Rate: 159.9 symbols/min [2025-09-17T07:38:19.528073] [DEBUG] [MAIN ] MDU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:19.529043] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 47858 primary records. [2025-09-17T07:38:19.528262] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:19.529255] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-17T07:38:19.545538] [DEBUG] [LOCAL ] MEC: Loaded 16612 existing records from primary storage. [2025-09-17T07:38:19.548964] [INFO ] [MAIN ] MEC: Loaded 16612 primary data records. [2025-09-17T07:38:19.639331] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-09-17T07:38:19.660885] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-17T07:38:19.669807] [INFO ] [MAIN ] Derivative Progress: 1227/2172 symbols completed. MDU took 1.3s. Estimated remaining: 5m 54s. Rate: 160.0 symbols/min [2025-09-17T07:38:19.670136] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:19.670748] [DEBUG] [LOCAL ] MED: Loaded 21964 existing records from primary storage. [2025-09-17T07:38:19.681866] [INFO ] [MAIN ] MED: Loaded 21964 primary data records. [2025-09-17T07:38:20.178104] [DEBUG] [LOCAL ] MEG: Loaded 32157 existing records from primary storage. [2025-09-17T07:38:20.180291] [INFO ] [MAIN ] MEG: Loaded 32157 primary data records. [2025-09-17T07:38:20.491808] [DEBUG] [MAIN ] MEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:20.492787] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16612 primary records. [2025-09-17T07:38:20.493135] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-17T07:38:20.516635] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-09-17T07:38:20.517005] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-17T07:38:20.519442] [INFO ] [MAIN ] Derivative Progress: 1228/2172 symbols completed. MEC took 1.0s. Estimated remaining: 5m 54s. Rate: 159.8 symbols/min [2025-09-17T07:38:20.534057] [DEBUG] [MAIN ] MED: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:20.534994] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21964 primary records. [2025-09-17T07:38:20.535270] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-17T07:38:20.552116] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-09-17T07:38:20.552965] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-17T07:38:20.555738] [INFO ] [MAIN ] Derivative Progress: 1229/2172 symbols completed. MED took 1.0s. Estimated remaining: 5m 54s. Rate: 159.9 symbols/min [2025-09-17T07:38:20.568574] [DEBUG] [MAIN ] MEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:20.569179] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 32157 primary records. [2025-09-17T07:38:20.569253] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-17T07:38:20.584513] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-09-17T07:38:20.584598] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-17T07:38:20.587068] [INFO ] [MAIN ] Derivative Progress: 1230/2172 symbols completed. MEG took 0.9s. Estimated remaining: 5m 53s. Rate: 160.1 symbols/min [2025-09-17T07:38:20.587785] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:20.587873] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:20.587531] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:20.624083] [DEBUG] [LOCAL ] MEGI: Loaded 20381 existing records from primary storage. [2025-09-17T07:38:20.624269] [INFO ] [MAIN ] MEGI: Loaded 20381 primary data records. [2025-09-17T07:38:20.734685] [DEBUG] [LOCAL ] MEI: Loaded 32583 existing records from primary storage. [2025-09-17T07:38:20.737995] [INFO ] [MAIN ] MEI: Loaded 32583 primary data records. [2025-09-17T07:38:21.107633] [DEBUG] [LOCAL ] MET: Loaded 53314 existing records from primary storage. [2025-09-17T07:38:21.133142] [INFO ] [MAIN ] MET: Loaded 53314 primary data records. [2025-09-17T07:38:21.619721] [DEBUG] [MAIN ] MEGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:21.621020] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 20381 primary records. [2025-09-17T07:38:21.621372] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-17T07:38:21.652989] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-09-17T07:38:21.653424] [DEBUG] [MAIN ] MEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:21.654111] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 32583 primary records. [2025-09-17T07:38:21.654170] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-17T07:38:21.654535] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-17T07:38:21.656923] [INFO ] [MAIN ] Derivative Progress: 1231/2172 symbols completed. MEGI took 1.1s. Estimated remaining: 5m 53s. Rate: 159.8 symbols/min [2025-09-17T07:38:21.658737] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:21.674778] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-09-17T07:38:21.674919] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-17T07:38:21.677624] [INFO ] [MAIN ] Derivative Progress: 1232/2172 symbols completed. MEI took 1.1s. Estimated remaining: 5m 53s. Rate: 159.9 symbols/min [2025-09-17T07:38:21.677953] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:21.698013] [DEBUG] [LOCAL ] MFAN: Loaded 4293 existing records from primary storage. [2025-09-17T07:38:21.695432] [DEBUG] [MAIN ] MET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:21.698870] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53314 primary records. [2025-09-17T07:38:21.699028] [INFO ] [MAIN ] MFAN: Loaded 4293 primary data records. [2025-09-17T07:38:21.699275] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-17T07:38:21.854425] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-09-17T07:38:21.865017] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-17T07:38:21.915885] [INFO ] [MAIN ] Derivative Progress: 1233/2172 symbols completed. MET took 1.3s. Estimated remaining: 5m 52s. Rate: 160.0 symbols/min [2025-09-17T07:38:21.897541] [DEBUG] [LOCAL ] MFA: Loaded 45125 existing records from primary storage. [2025-09-17T07:38:21.921137] [INFO ] [MAIN ] MFA: Loaded 45125 primary data records. [2025-09-17T07:38:21.920821] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:22.159532] [DEBUG] [LOCAL ] MFAO: Loaded 3844 existing records from primary storage. [2025-09-17T07:38:22.171925] [INFO ] [MAIN ] MFAO: Loaded 3844 primary data records. [2025-09-17T07:38:22.702954] [DEBUG] [MAIN ] MFAN: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:38:22.705178] [INFO ] [MAIN ] MFAN: Generated 1792 derivative records from 4293 primary records. [2025-09-17T07:38:22.706112] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-17T07:38:22.723776] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1792 records). [2025-09-17T07:38:22.724387] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-17T07:38:22.727580] [INFO ] [MAIN ] Derivative Progress: 1234/2172 symbols completed. MFAN took 1.0s. Estimated remaining: 5m 52s. Rate: 159.8 symbols/min [2025-09-17T07:38:22.728195] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:22.750277] [DEBUG] [MAIN ] MFA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:22.753609] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45125 primary records. [2025-09-17T07:38:22.753784] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-17T07:38:22.778802] [DEBUG] [MAIN ] MFAO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:38:22.780380] [INFO ] [MAIN ] MFAO: Generated 1793 derivative records from 3844 primary records. [2025-09-17T07:38:22.783454] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-17T07:38:22.784226] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-09-17T07:38:22.785166] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-17T07:38:22.787787] [INFO ] [MAIN ] Derivative Progress: 1235/2172 symbols completed. MFA took 1.1s. Estimated remaining: 5m 51s. Rate: 159.9 symbols/min [2025-09-17T07:38:22.801129] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:22.801337] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1793 records). [2025-09-17T07:38:22.814689] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-17T07:38:22.817495] [INFO ] [MAIN ] Derivative Progress: 1236/2172 symbols completed. MFAO took 0.9s. Estimated remaining: 5m 51s. Rate: 160.1 symbols/min [2025-09-17T07:38:22.817887] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:22.846582] [DEBUG] [LOCAL ] MFC: Loaded 51421 existing records from primary storage. [2025-09-17T07:38:22.846872] [INFO ] [MAIN ] MFC: Loaded 51421 primary data records. [2025-09-17T07:38:22.895732] [DEBUG] [LOCAL ] MFM: Loaded 14329 existing records from primary storage. [2025-09-17T07:38:22.929281] [INFO ] [MAIN ] MFM: Loaded 14329 primary data records. [2025-09-17T07:38:23.307799] [DEBUG] [LOCAL ] MFG: Loaded 48915 existing records from primary storage. [2025-09-17T07:38:23.362684] [INFO ] [MAIN ] MFG: Loaded 48915 primary data records. [2025-09-17T07:38:23.868814] [DEBUG] [MAIN ] MFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:23.882376] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51421 primary records. [2025-09-17T07:38:23.882810] [DEBUG] [MAIN ] MFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:23.884762] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-17T07:38:23.883480] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14329 primary records. [2025-09-17T07:38:23.885602] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-17T07:38:23.917097] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-09-17T07:38:23.919317] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-17T07:38:23.922591] [INFO ] [MAIN ] Derivative Progress: 1237/2172 symbols completed. MFM took 1.1s. Estimated remaining: 5m 51s. Rate: 159.8 symbols/min [2025-09-17T07:38:23.924252] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:23.923844] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-09-17T07:38:23.925257] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-17T07:38:23.928596] [INFO ] [MAIN ] Derivative Progress: 1238/2172 symbols completed. MFC took 1.2s. Estimated remaining: 5m 50s. Rate: 159.9 symbols/min [2025-09-17T07:38:23.930521] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:23.945102] [DEBUG] [MAIN ] MFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:23.945851] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 48915 primary records. [2025-09-17T07:38:23.946151] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-17T07:38:23.971749] [DEBUG] [LOCAL ] MG: Loaded 16874 existing records from primary storage. [2025-09-17T07:38:23.973034] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-09-17T07:38:23.973176] [INFO ] [MAIN ] MG: Loaded 16874 primary data records. [2025-09-17T07:38:23.973228] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-17T07:38:23.975914] [INFO ] [MAIN ] Derivative Progress: 1239/2172 symbols completed. MFG took 1.2s. Estimated remaining: 5m 50s. Rate: 160.1 symbols/min [2025-09-17T07:38:24.041150] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:24.278175] [DEBUG] [LOCAL ] MGF: Loaded 4163 existing records from primary storage. [2025-09-17T07:38:24.287671] [INFO ] [MAIN ] MGF: Loaded 4163 primary data records. [2025-09-17T07:38:24.411695] [DEBUG] [LOCAL ] MGA: Loaded 50680 existing records from primary storage. [2025-09-17T07:38:24.416441] [INFO ] [MAIN ] MGA: Loaded 50680 primary data records. [2025-09-17T07:38:24.938344] [DEBUG] [MAIN ] MG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:24.939467] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 16874 primary records. [2025-09-17T07:38:24.939876] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-17T07:38:24.960039] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-09-17T07:38:24.960416] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-17T07:38:24.962925] [INFO ] [MAIN ] Derivative Progress: 1240/2172 symbols completed. MG took 1.0s. Estimated remaining: 5m 50s. Rate: 159.8 symbols/min [2025-09-17T07:38:24.964297] [INFO ] [MAIN ] MGM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:24.980713] [DEBUG] [MAIN ] MGF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:24.981593] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4163 primary records. [2025-09-17T07:38:24.982504] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-17T07:38:25.012919] [DEBUG] [MAIN ] MGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:25.013379] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-09-17T07:38:25.014169] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50680 primary records. [2025-09-17T07:38:25.014364] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-17T07:38:25.014304] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-17T07:38:25.017601] [INFO ] [MAIN ] Derivative Progress: 1241/2172 symbols completed. MGF took 1.0s. Estimated remaining: 5m 49s. Rate: 160.0 symbols/min [2025-09-17T07:38:25.018242] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:25.039422] [DEBUG] [LOCAL ] MGR: Loaded 5661 existing records from primary storage. [2025-09-17T07:38:25.055176] [INFO ] [MAIN ] MGR: Loaded 5661 primary data records. [2025-09-17T07:38:25.055304] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-09-17T07:38:25.099497] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-17T07:38:25.137438] [INFO ] [MAIN ] Derivative Progress: 1242/2172 symbols completed. MGA took 1.2s. Estimated remaining: 5m 49s. Rate: 160.0 symbols/min [2025-09-17T07:38:25.162539] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:25.188484] [DEBUG] [LOCAL ] MGM: Loaded 53610 existing records from primary storage. [2025-09-17T07:38:25.200396] [INFO ] [MAIN ] MGM: Loaded 53610 primary data records. [2025-09-17T07:38:25.298587] [DEBUG] [LOCAL ] MGRB: Loaded 4128 existing records from primary storage. [2025-09-17T07:38:25.316397] [INFO ] [MAIN ] MGRB: Loaded 4128 primary data records. [2025-09-17T07:38:26.049259] [DEBUG] [MAIN ] MGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:26.050582] [INFO ] [MAIN ] MGR: Generated 1794 derivative records from 5661 primary records. [2025-09-17T07:38:26.051152] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-17T07:38:26.071290] [DEBUG] [LOCAL ] MGR: Derivative data saved (1794 records). [2025-09-17T07:38:26.085242] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-17T07:38:26.086302] [DEBUG] [MAIN ] MGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:26.089301] [INFO ] [MAIN ] Derivative Progress: 1243/2172 symbols completed. MGR took 1.1s. Estimated remaining: 5m 49s. Rate: 159.8 symbols/min [2025-09-17T07:38:26.090384] [INFO ] [MAIN ] MGM: Generated 1794 derivative records from 53610 primary records. [2025-09-17T07:38:26.103179] [DEBUG] [LOCAL ] MGM: Saving derivative data. [2025-09-17T07:38:26.104015] [DEBUG] [MAIN ] MGRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:26.105141] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4128 primary records. [2025-09-17T07:38:26.105449] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-17T07:38:26.132189] [DEBUG] [LOCAL ] MGM: Derivative data saved (1794 records). [2025-09-17T07:38:26.133175] [INFO ] [MAIN ] MGM: Successfully saved derivative data. [2025-09-17T07:38:26.135876] [INFO ] [MAIN ] Derivative Progress: 1244/2172 symbols completed. MGM took 1.2s. Estimated remaining: 5m 48s. Rate: 160.0 symbols/min [2025-09-17T07:38:26.138505] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-09-17T07:38:26.138598] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-17T07:38:26.141306] [INFO ] [MAIN ] Derivative Progress: 1245/2172 symbols completed. MGRB took 1.0s. Estimated remaining: 5m 47s. Rate: 160.1 symbols/min [2025-09-17T07:38:26.142040] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:26.141953] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:26.141895] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:26.148313] [DEBUG] [LOCAL ] MGRD: Loaded 2313 existing records from primary storage. [2025-09-17T07:38:26.150437] [INFO ] [MAIN ] MGRD: Loaded 2313 primary data records. [2025-09-17T07:38:26.209678] [DEBUG] [LOCAL ] MGRE: Loaded 6530 existing records from primary storage. [2025-09-17T07:38:26.230563] [INFO ] [MAIN ] MGRE: Loaded 6530 primary data records. [2025-09-17T07:38:26.783485] [DEBUG] [LOCAL ] MGY: Loaded 52438 existing records from primary storage. [2025-09-17T07:38:26.784519] [INFO ] [MAIN ] MGY: Loaded 52438 primary data records. [2025-09-17T07:38:27.115288] [DEBUG] [MAIN ] MGRD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:38:27.117195] [INFO ] [MAIN ] MGRD: Generated 1793 derivative records from 2313 primary records. [2025-09-17T07:38:27.117505] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-17T07:38:27.136500] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1793 records). [2025-09-17T07:38:27.136815] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-17T07:38:27.139819] [INFO ] [MAIN ] Derivative Progress: 1246/2172 symbols completed. MGRD took 1.0s. Estimated remaining: 5m 48s. Rate: 159.9 symbols/min [2025-09-17T07:38:27.140304] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:27.154743] [DEBUG] [MAIN ] MGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:27.156180] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6530 primary records. [2025-09-17T07:38:27.156457] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-17T07:38:27.176479] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-09-17T07:38:27.176731] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-17T07:38:27.179168] [INFO ] [MAIN ] Derivative Progress: 1247/2172 symbols completed. MGRE took 1.0s. Estimated remaining: 5m 47s. Rate: 160.0 symbols/min [2025-09-17T07:38:27.179613] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:27.187795] [DEBUG] [LOCAL ] MHD: Loaded 12270 existing records from primary storage. [2025-09-17T07:38:27.192167] [INFO ] [MAIN ] MHD: Loaded 12270 primary data records. [2025-09-17T07:38:27.243154] [DEBUG] [MAIN ] MGY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:27.259833] [DEBUG] [LOCAL ] MHF: Loaded 8507 existing records from primary storage. [2025-09-17T07:38:27.299396] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52438 primary records. [2025-09-17T07:38:27.299475] [INFO ] [MAIN ] MHF: Loaded 8507 primary data records. [2025-09-17T07:38:27.348852] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-17T07:38:27.756598] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-09-17T07:38:27.876489] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-17T07:38:27.879692] [INFO ] [MAIN ] Derivative Progress: 1248/2172 symbols completed. MGY took 1.7s. Estimated remaining: 5m 47s. Rate: 159.9 symbols/min [2025-09-17T07:38:27.880538] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:27.907450] [DEBUG] [MAIN ] MHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:27.909612] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12270 primary records. [2025-09-17T07:38:27.910219] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-17T07:38:27.933580] [DEBUG] [MAIN ] MHF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:27.935069] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8507 primary records. [2025-09-17T07:38:27.935163] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-17T07:38:27.964210] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-09-17T07:38:27.979924] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-17T07:38:27.983139] [INFO ] [MAIN ] Derivative Progress: 1249/2172 symbols completed. MHD took 0.8s. Estimated remaining: 5m 46s. Rate: 160.0 symbols/min [2025-09-17T07:38:27.985115] [DEBUG] [LOCAL ] MHK: Loaded 42482 existing records from primary storage. [2025-09-17T07:38:27.985282] [INFO ] [MAIN ] MHK: Loaded 42482 primary data records. [2025-09-17T07:38:27.983794] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-09-17T07:38:28.008753] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:27.985484] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-17T07:38:28.039327] [INFO ] [MAIN ] Derivative Progress: 1250/2172 symbols completed. MHF took 0.9s. Estimated remaining: 5m 46s. Rate: 160.1 symbols/min [2025-09-17T07:38:28.104526] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:28.120036] [DEBUG] [LOCAL ] MHN: Loaded 7800 existing records from primary storage. [2025-09-17T07:38:28.130712] [INFO ] [MAIN ] MHN: Loaded 7800 primary data records. [2025-09-17T07:38:28.517312] [DEBUG] [LOCAL ] MHO: Loaded 24434 existing records from primary storage. [2025-09-17T07:38:28.618228] [INFO ] [MAIN ] MHO: Loaded 24434 primary data records. [2025-09-17T07:38:28.968029] [DEBUG] [MAIN ] MHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:28.972967] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42482 primary records. [2025-09-17T07:38:28.974062] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-17T07:38:29.000561] [DEBUG] [MAIN ] MHN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:29.006204] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7800 primary records. [2025-09-17T07:38:29.007586] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-09-17T07:38:29.007835] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-17T07:38:29.007795] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-17T07:38:29.010792] [INFO ] [MAIN ] Derivative Progress: 1251/2172 symbols completed. MHK took 1.1s. Estimated remaining: 5m 46s. Rate: 159.9 symbols/min [2025-09-17T07:38:29.012173] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:29.033765] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-09-17T07:38:29.034353] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-17T07:38:29.040062] [INFO ] [MAIN ] Derivative Progress: 1252/2172 symbols completed. MHN took 1.0s. Estimated remaining: 5m 45s. Rate: 160.0 symbols/min [2025-09-17T07:38:29.046005] [DEBUG] [LOCAL ] MIN: Loaded 13186 existing records from primary storage. [2025-09-17T07:38:29.054448] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:29.046485] [INFO ] [MAIN ] MIN: Loaded 13186 primary data records. [2025-09-17T07:38:29.060050] [DEBUG] [MAIN ] MHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:29.142776] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 24434 primary records. [2025-09-17T07:38:29.170688] [DEBUG] [LOCAL ] MITP: Loaded 2369 existing records from primary storage. [2025-09-17T07:38:29.171115] [INFO ] [MAIN ] MITP: Loaded 2369 primary data records. [2025-09-17T07:38:29.170802] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-17T07:38:29.720875] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-09-17T07:38:29.722014] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-17T07:38:29.724809] [INFO ] [MAIN ] Derivative Progress: 1253/2172 symbols completed. MHO took 1.6s. Estimated remaining: 5m 45s. Rate: 159.9 symbols/min [2025-09-17T07:38:29.726183] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:29.755851] [DEBUG] [MAIN ] MIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:29.758294] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13186 primary records. [2025-09-17T07:38:29.758725] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-17T07:38:29.779412] [DEBUG] [LOCAL ] MITT: Loaded 23075 existing records from primary storage. [2025-09-17T07:38:29.790165] [INFO ] [MAIN ] MITT: Loaded 23075 primary data records. [2025-09-17T07:38:29.779657] [DEBUG] [MAIN ] MITP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:29.811884] [INFO ] [MAIN ] MITP: Generated 1794 derivative records from 2369 primary records. [2025-09-17T07:38:29.845543] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-17T07:38:29.907634] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-09-17T07:38:29.920064] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-17T07:38:29.962006] [INFO ] [MAIN ] Derivative Progress: 1254/2172 symbols completed. MIN took 0.9s. Estimated remaining: 5m 44s. Rate: 159.9 symbols/min [2025-09-17T07:38:29.988036] [DEBUG] [LOCAL ] MITP: Derivative data saved (1794 records). [2025-09-17T07:38:29.991533] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:30.105741] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-17T07:38:30.108513] [INFO ] [MAIN ] Derivative Progress: 1255/2172 symbols completed. MITP took 1.1s. Estimated remaining: 5m 44s. Rate: 160.0 symbols/min [2025-09-17T07:38:30.108975] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:30.116103] [DEBUG] [LOCAL ] MIY: Loaded 6029 existing records from primary storage. [2025-09-17T07:38:30.116419] [INFO ] [MAIN ] MIY: Loaded 6029 primary data records. [2025-09-17T07:38:30.483820] [DEBUG] [LOCAL ] MKC: Loaded 52466 existing records from primary storage. [2025-09-17T07:38:30.484529] [INFO ] [MAIN ] MKC: Loaded 52466 primary data records. [2025-09-17T07:38:30.484209] [DEBUG] [MAIN ] MITT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:30.485710] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 23075 primary records. [2025-09-17T07:38:30.507308] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-17T07:38:30.795165] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-09-17T07:38:30.795551] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-17T07:38:30.798087] [INFO ] [MAIN ] Derivative Progress: 1256/2172 symbols completed. MITT took 1.1s. Estimated remaining: 5m 44s. Rate: 159.9 symbols/min [2025-09-17T07:38:30.806364] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:30.811989] [DEBUG] [MAIN ] MIY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:30.814361] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 6029 primary records. [2025-09-17T07:38:30.815144] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-17T07:38:30.837736] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-09-17T07:38:30.837992] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-17T07:38:30.840763] [INFO ] [MAIN ] Derivative Progress: 1257/2172 symbols completed. MIY took 0.8s. Estimated remaining: 5m 43s. Rate: 160.0 symbols/min [2025-09-17T07:38:30.850199] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:30.866594] [DEBUG] [MAIN ] MKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:30.867256] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52466 primary records. [2025-09-17T07:38:30.867450] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-17T07:38:30.887109] [DEBUG] [LOCAL ] MKL: Loaded 34375 existing records from primary storage. [2025-09-17T07:38:30.893582] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-09-17T07:38:30.893799] [INFO ] [MAIN ] MKL: Loaded 34375 primary data records. [2025-09-17T07:38:30.893904] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-17T07:38:30.896762] [INFO ] [MAIN ] Derivative Progress: 1258/2172 symbols completed. MKC took 0.8s. Estimated remaining: 5m 42s. Rate: 160.1 symbols/min [2025-09-17T07:38:31.236096] [DEBUG] [LOCAL ] MLI: Loaded 43923 existing records from primary storage. [2025-09-17T07:38:31.236323] [INFO ] [MAIN ] MLI: Loaded 43923 primary data records. [2025-09-17T07:38:31.549522] [DEBUG] [MAIN ] MKL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:31.550844] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34375 primary records. [2025-09-17T07:38:31.550926] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-17T07:38:31.569680] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-09-17T07:38:31.569827] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-17T07:38:31.572577] [INFO ] [MAIN ] Derivative Progress: 1259/2172 symbols completed. MKL took 0.8s. Estimated remaining: 5m 42s. Rate: 160.0 symbols/min [2025-09-17T07:38:31.588700] [DEBUG] [MAIN ] MLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:31.589393] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43923 primary records. [2025-09-17T07:38:31.589471] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-17T07:38:31.605070] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-09-17T07:38:31.605156] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-17T07:38:31.608198] [INFO ] [MAIN ] Derivative Progress: 1260/2172 symbols completed. MLI took 0.8s. Estimated remaining: 5m 42s. Rate: 160.1 symbols/min [2025-09-17T07:38:31.608878] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:31.609020] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:31.608944] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:31.615782] [DEBUG] [LOCAL ] MLP: Loaded 3041 existing records from primary storage. [2025-09-17T07:38:31.616005] [INFO ] [MAIN ] MLP: Loaded 3041 primary data records. [2025-09-17T07:38:31.824709] [DEBUG] [LOCAL ] MLNK: Loaded 25490 existing records from primary storage. [2025-09-17T07:38:31.925516] [INFO ] [MAIN ] MLNK: Loaded 25490 primary data records. [2025-09-17T07:38:31.951858] [DEBUG] [LOCAL ] MLM: Loaded 31606 existing records from primary storage. [2025-09-17T07:38:31.987578] [INFO ] [MAIN ] MLM: Loaded 31606 primary data records. [2025-09-17T07:38:32.566333] [DEBUG] [MAIN ] MLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:32.567253] [INFO ] [MAIN ] MLP: Generated 1794 derivative records from 3041 primary records. [2025-09-17T07:38:32.568183] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-17T07:38:32.584593] [DEBUG] [LOCAL ] MLP: Derivative data saved (1794 records). [2025-09-17T07:38:32.585415] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-17T07:38:32.587898] [INFO ] [MAIN ] Derivative Progress: 1261/2172 symbols completed. MLP took 1.0s. Estimated remaining: 5m 42s. Rate: 159.9 symbols/min [2025-09-17T07:38:32.588597] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:32.622521] [DEBUG] [MAIN ] MLM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:32.623604] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 31606 primary records. [2025-09-17T07:38:32.622992] [DEBUG] [MAIN ] MLNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:32.624475] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 25490 primary records. [2025-09-17T07:38:32.624382] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-17T07:38:32.624699] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-17T07:38:32.654761] [DEBUG] [LOCAL ] MLR: Loaded 13173 existing records from primary storage. [2025-09-17T07:38:32.663338] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-09-17T07:38:32.661666] [INFO ] [MAIN ] MLR: Loaded 13173 primary data records. [2025-09-17T07:38:32.670297] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-17T07:38:32.680801] [INFO ] [MAIN ] Derivative Progress: 1262/2172 symbols completed. MLM took 1.1s. Estimated remaining: 5m 41s. Rate: 160.0 symbols/min [2025-09-17T07:38:32.680952] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-09-17T07:38:32.711348] [INFO ] [MAIN ] MMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:32.734110] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-17T07:38:32.753836] [INFO ] [MAIN ] Derivative Progress: 1263/2172 symbols completed. MLNK took 1.1s. Estimated remaining: 5m 41s. Rate: 160.1 symbols/min [2025-09-17T07:38:32.775250] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:32.969632] [DEBUG] [LOCAL ] MMD: Loaded 11096 existing records from primary storage. [2025-09-17T07:38:32.969989] [INFO ] [MAIN ] MMD: Loaded 11096 primary data records. [2025-09-17T07:38:33.142935] [DEBUG] [LOCAL ] MMC: Loaded 51806 existing records from primary storage. [2025-09-17T07:38:33.175022] [INFO ] [MAIN ] MMC: Loaded 51806 primary data records. [2025-09-17T07:38:33.644672] [DEBUG] [MAIN ] MLR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:33.647319] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 13173 primary records. [2025-09-17T07:38:33.647573] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-17T07:38:33.666157] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-09-17T07:38:33.668442] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-17T07:38:33.671569] [INFO ] [MAIN ] Derivative Progress: 1264/2172 symbols completed. MLR took 1.1s. Estimated remaining: 5m 41s. Rate: 159.9 symbols/min [2025-09-17T07:38:33.672319] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:33.686050] [DEBUG] [MAIN ] MMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:33.687325] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 11096 primary records. [2025-09-17T07:38:33.688255] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-17T07:38:33.709794] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-09-17T07:38:33.722863] [DEBUG] [MAIN ] MMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:33.722504] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-17T07:38:33.723870] [INFO ] [MAIN ] MMC: Generated 1794 derivative records from 51806 primary records. [2025-09-17T07:38:33.726634] [INFO ] [MAIN ] Derivative Progress: 1265/2172 symbols completed. MMD took 1.0s. Estimated remaining: 5m 40s. Rate: 160.1 symbols/min [2025-09-17T07:38:33.726736] [DEBUG] [LOCAL ] MMC: Saving derivative data. [2025-09-17T07:38:33.732742] [INFO ] [MAIN ] MMM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:33.733815] [DEBUG] [LOCAL ] MMI: Loaded 15384 existing records from primary storage. [2025-09-17T07:38:33.734424] [INFO ] [MAIN ] MMI: Loaded 15384 primary data records. [2025-09-17T07:38:33.922666] [DEBUG] [LOCAL ] MMC: Derivative data saved (1794 records). [2025-09-17T07:38:33.992971] [INFO ] [MAIN ] MMC: Successfully saved derivative data. [2025-09-17T07:38:34.059291] [INFO ] [MAIN ] Derivative Progress: 1266/2172 symbols completed. MMC took 1.4s. Estimated remaining: 5m 40s. Rate: 160.1 symbols/min [2025-09-17T07:38:34.059985] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:34.098556] [DEBUG] [LOCAL ] MMM: Loaded 53279 existing records from primary storage. [2025-09-17T07:38:34.099046] [INFO ] [MAIN ] MMM: Loaded 53279 primary data records. [2025-09-17T07:38:34.313320] [DEBUG] [MAIN ] MMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:34.314131] [DEBUG] [LOCAL ] MMS: Loaded 34185 existing records from primary storage. [2025-09-17T07:38:34.424523] [INFO ] [MAIN ] MMS: Loaded 34185 primary data records. [2025-09-17T07:38:34.425989] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15384 primary records. [2025-09-17T07:38:34.457910] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-17T07:38:34.743247] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-09-17T07:38:34.743424] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-17T07:38:34.745781] [INFO ] [MAIN ] Derivative Progress: 1267/2172 symbols completed. MMI took 1.1s. Estimated remaining: 5m 39s. Rate: 160.0 symbols/min [2025-09-17T07:38:34.746226] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:34.773564] [DEBUG] [MAIN ] MMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:34.773751] [DEBUG] [LOCAL ] MMT: Loaded 11481 existing records from primary storage. [2025-09-17T07:38:34.774692] [INFO ] [MAIN ] MMM: Generated 1794 derivative records from 53279 primary records. [2025-09-17T07:38:34.774806] [INFO ] [MAIN ] MMT: Loaded 11481 primary data records. [2025-09-17T07:38:34.774943] [DEBUG] [LOCAL ] MMM: Saving derivative data. [2025-09-17T07:38:34.978980] [DEBUG] [LOCAL ] MMM: Derivative data saved (1794 records). [2025-09-17T07:38:34.983251] [DEBUG] [MAIN ] MMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:35.145332] [INFO ] [MAIN ] MMM: Successfully saved derivative data. [2025-09-17T07:38:35.154922] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 34185 primary records. [2025-09-17T07:38:35.158006] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-17T07:38:35.157899] [INFO ] [MAIN ] Derivative Progress: 1268/2172 symbols completed. MMM took 1.4s. Estimated remaining: 5m 39s. Rate: 159.9 symbols/min [2025-09-17T07:38:35.159005] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:35.177085] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-09-17T07:38:35.177699] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-17T07:38:35.180341] [INFO ] [MAIN ] Derivative Progress: 1269/2172 symbols completed. MMS took 1.1s. Estimated remaining: 5m 38s. Rate: 160.1 symbols/min [2025-09-17T07:38:35.184701] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:35.192926] [DEBUG] [LOCAL ] MMU: Loaded 16989 existing records from primary storage. [2025-09-17T07:38:35.193121] [INFO ] [MAIN ] MMU: Loaded 16989 primary data records. [2025-09-17T07:38:35.386412] [DEBUG] [LOCAL ] MNR: Loaded 24847 existing records from primary storage. [2025-09-17T07:38:35.398524] [INFO ] [MAIN ] MNR: Loaded 24847 primary data records. [2025-09-17T07:38:35.508763] [DEBUG] [MAIN ] MMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:35.565720] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 11481 primary records. [2025-09-17T07:38:35.592493] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-17T07:38:35.818169] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-09-17T07:38:35.818994] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-17T07:38:35.821422] [INFO ] [MAIN ] Derivative Progress: 1270/2172 symbols completed. MMT took 1.1s. Estimated remaining: 5m 38s. Rate: 160.0 symbols/min [2025-09-17T07:38:35.823222] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:35.841326] [DEBUG] [MAIN ] MMU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:35.842021] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16989 primary records. [2025-09-17T07:38:35.842372] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-17T07:38:35.862563] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-09-17T07:38:35.872246] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-17T07:38:35.874764] [INFO ] [MAIN ] Derivative Progress: 1271/2172 symbols completed. MMU took 0.7s. Estimated remaining: 5m 38s. Rate: 160.1 symbols/min [2025-09-17T07:38:35.882941] [INFO ] [MAIN ] MO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:35.888621] [DEBUG] [MAIN ] MNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:35.889412] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24847 primary records. [2025-09-17T07:38:35.889717] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-17T07:38:35.917964] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-09-17T07:38:35.918140] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-17T07:38:35.920888] [INFO ] [MAIN ] Derivative Progress: 1272/2172 symbols completed. MNR took 0.7s. Estimated remaining: 5m 37s. Rate: 160.2 symbols/min [2025-09-17T07:38:35.922163] [DEBUG] [LOCAL ] MNSO: Loaded 44427 existing records from primary storage. [2025-09-17T07:38:35.922366] [INFO ] [MAIN ] MOD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:35.922541] [INFO ] [MAIN ] MNSO: Loaded 44427 primary data records. [2025-09-17T07:38:36.270690] [DEBUG] [LOCAL ] MO: Loaded 53754 existing records from primary storage. [2025-09-17T07:38:36.271028] [INFO ] [MAIN ] MO: Loaded 53754 primary data records. [2025-09-17T07:38:36.378372] [DEBUG] [LOCAL ] MOD: Loaded 45838 existing records from primary storage. [2025-09-17T07:38:36.387983] [INFO ] [MAIN ] MOD: Loaded 45838 primary data records. [2025-09-17T07:38:36.935610] [DEBUG] [MAIN ] MNSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:36.937010] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44427 primary records. [2025-09-17T07:38:36.939037] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-17T07:38:36.957442] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-09-17T07:38:36.957749] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-17T07:38:36.960076] [INFO ] [MAIN ] Derivative Progress: 1273/2172 symbols completed. MNSO took 1.1s. Estimated remaining: 5m 37s. Rate: 160.0 symbols/min [2025-09-17T07:38:36.978388] [DEBUG] [MAIN ] MO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:36.979607] [INFO ] [MAIN ] MO: Generated 1794 derivative records from 53754 primary records. [2025-09-17T07:38:36.979729] [DEBUG] [LOCAL ] MO: Saving derivative data. [2025-09-17T07:38:37.000053] [DEBUG] [MAIN ] MOD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:37.005175] [INFO ] [MAIN ] MOD: Generated 1794 derivative records from 45838 primary records. [2025-09-17T07:38:37.006214] [DEBUG] [LOCAL ] MOD: Saving derivative data. [2025-09-17T07:38:37.015913] [DEBUG] [LOCAL ] MO: Derivative data saved (1794 records). [2025-09-17T07:38:37.019230] [INFO ] [MAIN ] MO: Successfully saved derivative data. [2025-09-17T07:38:37.021309] [INFO ] [MAIN ] Derivative Progress: 1274/2172 symbols completed. MO took 1.1s. Estimated remaining: 5m 37s. Rate: 160.1 symbols/min [2025-09-17T07:38:37.025238] [DEBUG] [LOCAL ] MOD: Derivative data saved (1794 records). [2025-09-17T07:38:37.025311] [INFO ] [MAIN ] MOD: Successfully saved derivative data. [2025-09-17T07:38:37.028003] [INFO ] [MAIN ] Derivative Progress: 1275/2172 symbols completed. MOD took 1.1s. Estimated remaining: 5m 36s. Rate: 160.2 symbols/min [2025-09-17T07:38:37.028492] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:37.028684] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:37.028578] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:37.111814] [DEBUG] [LOCAL ] MOH: Loaded 41704 existing records from primary storage. [2025-09-17T07:38:37.113154] [INFO ] [MAIN ] MOH: Loaded 41704 primary data records. [2025-09-17T07:38:37.127057] [DEBUG] [LOCAL ] MODG: Loaded 51634 existing records from primary storage. [2025-09-17T07:38:37.183761] [DEBUG] [LOCAL ] MOS: Loaded 53521 existing records from primary storage. [2025-09-17T07:38:37.197822] [INFO ] [MAIN ] MOS: Loaded 53521 primary data records. [2025-09-17T07:38:37.197951] [INFO ] [MAIN ] MODG: Loaded 51634 primary data records. [2025-09-17T07:38:38.054622] [DEBUG] [MAIN ] MOH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:38.055529] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 41704 primary records. [2025-09-17T07:38:38.057164] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-17T07:38:38.085937] [DEBUG] [MAIN ] MOS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:38.099671] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53521 primary records. [2025-09-17T07:38:38.101023] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-17T07:38:38.102458] [DEBUG] [MAIN ] MODG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:38.103400] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-09-17T07:38:38.112099] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51634 primary records. [2025-09-17T07:38:38.117367] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-17T07:38:38.118733] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-09-17T07:38:38.120616] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-17T07:38:38.120537] [INFO ] [MAIN ] Derivative Progress: 1276/2172 symbols completed. MOH took 1.1s. Estimated remaining: 5m 36s. Rate: 160.0 symbols/min [2025-09-17T07:38:38.121055] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:38.120861] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-17T07:38:38.125258] [INFO ] [MAIN ] Derivative Progress: 1277/2172 symbols completed. MOS took 1.1s. Estimated remaining: 5m 35s. Rate: 160.1 symbols/min [2025-09-17T07:38:38.134769] [INFO ] [MAIN ] MP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:38.142124] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-09-17T07:38:38.142284] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-17T07:38:38.145077] [INFO ] [MAIN ] Derivative Progress: 1278/2172 symbols completed. MODG took 1.1s. Estimated remaining: 5m 35s. Rate: 160.2 symbols/min [2025-09-17T07:38:38.145453] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:38.165940] [DEBUG] [LOCAL ] MOV: Loaded 22381 existing records from primary storage. [2025-09-17T07:38:38.166200] [INFO ] [MAIN ] MOV: Loaded 22381 primary data records. [2025-09-17T07:38:38.500098] [DEBUG] [LOCAL ] MP: Loaded 53646 existing records from primary storage. [2025-09-17T07:38:38.513163] [INFO ] [MAIN ] MP: Loaded 53646 primary data records. [2025-09-17T07:38:38.539879] [DEBUG] [LOCAL ] MPC: Loaded 52148 existing records from primary storage. [2025-09-17T07:38:38.596164] [INFO ] [MAIN ] MPC: Loaded 52148 primary data records. [2025-09-17T07:38:39.200853] [DEBUG] [MAIN ] MOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:39.202244] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 22381 primary records. [2025-09-17T07:38:39.202701] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-17T07:38:39.220352] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-09-17T07:38:39.221058] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-17T07:38:39.223550] [INFO ] [MAIN ] Derivative Progress: 1279/2172 symbols completed. MOV took 1.1s. Estimated remaining: 5m 35s. Rate: 160.0 symbols/min [2025-09-17T07:38:39.224784] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:39.240815] [DEBUG] [MAIN ] MP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:39.241856] [INFO ] [MAIN ] MP: Generated 1794 derivative records from 53646 primary records. [2025-09-17T07:38:39.242240] [DEBUG] [LOCAL ] MP: Saving derivative data. [2025-09-17T07:38:39.261754] [DEBUG] [LOCAL ] MP: Derivative data saved (1794 records). [2025-09-17T07:38:39.274154] [INFO ] [MAIN ] MP: Successfully saved derivative data. [2025-09-17T07:38:39.274934] [DEBUG] [MAIN ] MPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:39.277073] [INFO ] [MAIN ] Derivative Progress: 1280/2172 symbols completed. MP took 1.1s. Estimated remaining: 5m 34s. Rate: 160.1 symbols/min [2025-09-17T07:38:39.277871] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 52148 primary records. [2025-09-17T07:38:39.278125] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:39.278292] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-17T07:38:39.312468] [DEBUG] [LOCAL ] MPV: Loaded 5206 existing records from primary storage. [2025-09-17T07:38:39.313867] [INFO ] [MAIN ] MPV: Loaded 5206 primary data records. [2025-09-17T07:38:39.346828] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-09-17T07:38:39.380132] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-17T07:38:39.399170] [INFO ] [MAIN ] Derivative Progress: 1281/2172 symbols completed. MPC took 1.3s. Estimated remaining: 5m 34s. Rate: 160.2 symbols/min [2025-09-17T07:38:39.436141] [DEBUG] [LOCAL ] MPLX: Loaded 50820 existing records from primary storage. [2025-09-17T07:38:39.435150] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:39.451814] [INFO ] [MAIN ] MPLX: Loaded 50820 primary data records. [2025-09-17T07:38:39.978292] [DEBUG] [LOCAL ] MPW: Loaded 53501 existing records from primary storage. [2025-09-17T07:38:39.978891] [INFO ] [MAIN ] MPW: Loaded 53501 primary data records. [2025-09-17T07:38:40.076322] [DEBUG] [MAIN ] MPV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:38:40.099318] [INFO ] [MAIN ] MPV: Generated 1793 derivative records from 5206 primary records. [2025-09-17T07:38:40.105515] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-17T07:38:40.323656] [DEBUG] [MAIN ] MPLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:40.329404] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50820 primary records. [2025-09-17T07:38:40.329483] [DEBUG] [LOCAL ] MPV: Derivative data saved (1793 records). [2025-09-17T07:38:40.329975] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-17T07:38:40.330919] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-17T07:38:40.342207] [INFO ] [MAIN ] Derivative Progress: 1282/2172 symbols completed. MPV took 1.1s. Estimated remaining: 5m 34s. Rate: 160.0 symbols/min [2025-09-17T07:38:40.348745] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:40.349868] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-09-17T07:38:40.350119] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-17T07:38:40.353814] [INFO ] [MAIN ] Derivative Progress: 1283/2172 symbols completed. MPLX took 1.1s. Estimated remaining: 5m 33s. Rate: 160.1 symbols/min [2025-09-17T07:38:40.354601] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:40.363560] [DEBUG] [LOCAL ] MPX: Loaded 4315 existing records from primary storage. [2025-09-17T07:38:40.363788] [INFO ] [MAIN ] MPX: Loaded 4315 primary data records. [2025-09-17T07:38:40.439063] [DEBUG] [LOCAL ] MQT: Loaded 8473 existing records from primary storage. [2025-09-17T07:38:40.470577] [INFO ] [MAIN ] MQT: Loaded 8473 primary data records. [2025-09-17T07:38:40.621221] [DEBUG] [MAIN ] MPW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:40.661950] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53501 primary records. [2025-09-17T07:38:40.738683] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-17T07:38:41.027053] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-09-17T07:38:41.028873] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-17T07:38:41.032027] [INFO ] [MAIN ] Derivative Progress: 1284/2172 symbols completed. MPW took 1.6s. Estimated remaining: 5m 33s. Rate: 160.0 symbols/min [2025-09-17T07:38:41.033046] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:41.057590] [DEBUG] [MAIN ] MPX: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:38:41.058363] [INFO ] [MAIN ] MPX: Generated 1793 derivative records from 4315 primary records. [2025-09-17T07:38:41.058657] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-17T07:38:41.075264] [DEBUG] [LOCAL ] MQY: Loaded 16732 existing records from primary storage. [2025-09-17T07:38:41.078818] [INFO ] [MAIN ] MQY: Loaded 16732 primary data records. [2025-09-17T07:38:41.130674] [DEBUG] [MAIN ] MQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:41.115092] [DEBUG] [LOCAL ] MPX: Derivative data saved (1793 records). [2025-09-17T07:38:41.157909] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-17T07:38:41.163573] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8473 primary records. [2025-09-17T07:38:41.198763] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-17T07:38:41.195387] [INFO ] [MAIN ] Derivative Progress: 1285/2172 symbols completed. MPX took 0.8s. Estimated remaining: 5m 32s. Rate: 160.1 symbols/min [2025-09-17T07:38:41.215421] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:41.294740] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-09-17T07:38:41.406777] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-17T07:38:41.410163] [INFO ] [MAIN ] Derivative Progress: 1286/2172 symbols completed. MQT took 1.1s. Estimated remaining: 5m 32s. Rate: 160.1 symbols/min [2025-09-17T07:38:41.410621] [INFO ] [MAIN ] MRK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:41.448222] [DEBUG] [LOCAL ] MRC: Loaded 37489 existing records from primary storage. [2025-09-17T07:38:41.456610] [INFO ] [MAIN ] MRC: Loaded 37489 primary data records. [2025-09-17T07:38:41.494669] [DEBUG] [MAIN ] MQY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:41.551360] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16732 primary records. [2025-09-17T07:38:41.582466] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-17T07:38:41.804069] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-09-17T07:38:41.802630] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-09-17T07:38:41.804621] [INFO ] [MAIN ] MRK: Loaded 53789 primary data records. [2025-09-17T07:38:41.804564] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-17T07:38:41.807007] [INFO ] [MAIN ] Derivative Progress: 1287/2172 symbols completed. MQY took 0.8s. Estimated remaining: 5m 32s. Rate: 160.1 symbols/min [2025-09-17T07:38:41.828877] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:42.156931] [DEBUG] [MAIN ] MRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:42.158157] [INFO ] [MAIN ] MRC: Generated 1794 derivative records from 37489 primary records. [2025-09-17T07:38:42.158374] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-17T07:38:42.195079] [DEBUG] [LOCAL ] MRC: Derivative data saved (1794 records). [2025-09-17T07:38:42.193846] [DEBUG] [LOCAL ] MS: Loaded 53696 existing records from primary storage. [2025-09-17T07:38:42.195593] [INFO ] [MAIN ] MS: Loaded 53696 primary data records. [2025-09-17T07:38:42.195887] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-17T07:38:42.198549] [INFO ] [MAIN ] Derivative Progress: 1288/2172 symbols completed. MRC took 1.0s. Estimated remaining: 5m 31s. Rate: 160.1 symbols/min [2025-09-17T07:38:42.374451] [DEBUG] [MAIN ] MRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:42.395392] [INFO ] [MAIN ] MRK: Generated 1794 derivative records from 53789 primary records. [2025-09-17T07:38:42.473692] [DEBUG] [LOCAL ] MRK: Saving derivative data. [2025-09-17T07:38:42.525561] [DEBUG] [LOCAL ] MRK: Derivative data saved (1794 records). [2025-09-17T07:38:42.525744] [INFO ] [MAIN ] MRK: Successfully saved derivative data. [2025-09-17T07:38:42.527921] [INFO ] [MAIN ] Derivative Progress: 1289/2172 symbols completed. MRK took 1.1s. Estimated remaining: 5m 31s. Rate: 160.1 symbols/min [2025-09-17T07:38:42.546978] [DEBUG] [MAIN ] MS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:42.547603] [INFO ] [MAIN ] MS: Generated 1794 derivative records from 53696 primary records. [2025-09-17T07:38:42.547708] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-17T07:38:42.563311] [DEBUG] [LOCAL ] MS: Derivative data saved (1794 records). [2025-09-17T07:38:42.563391] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-17T07:38:42.565789] [INFO ] [MAIN ] Derivative Progress: 1290/2172 symbols completed. MS took 0.7s. Estimated remaining: 5m 30s. Rate: 160.2 symbols/min [2025-09-17T07:38:42.566332] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:42.566447] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:42.566534] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:42.577064] [DEBUG] [LOCAL ] MSB: Loaded 7945 existing records from primary storage. [2025-09-17T07:38:42.577328] [INFO ] [MAIN ] MSB: Loaded 7945 primary data records. [2025-09-17T07:38:42.719159] [DEBUG] [LOCAL ] MSA: Loaded 18785 existing records from primary storage. [2025-09-17T07:38:42.785850] [INFO ] [MAIN ] MSA: Loaded 18785 primary data records. [2025-09-17T07:38:42.880525] [DEBUG] [LOCAL ] MSCI: Loaded 34729 existing records from primary storage. [2025-09-17T07:38:42.969890] [INFO ] [MAIN ] MSCI: Loaded 34729 primary data records. [2025-09-17T07:38:43.555249] [DEBUG] [MAIN ] MSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:43.557975] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7945 primary records. [2025-09-17T07:38:43.559259] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-17T07:38:43.594240] [DEBUG] [MAIN ] MSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:43.597470] [INFO ] [MAIN ] MSA: Generated 1794 derivative records from 18785 primary records. [2025-09-17T07:38:43.598723] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-17T07:38:43.605167] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-09-17T07:38:43.605439] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-17T07:38:43.633843] [DEBUG] [MAIN ] MSCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:43.637454] [INFO ] [MAIN ] Derivative Progress: 1291/2172 symbols completed. MSB took 1.1s. Estimated remaining: 5m 30s. Rate: 160.0 symbols/min [2025-09-17T07:38:43.641977] [INFO ] [MAIN ] MSCI: Generated 1794 derivative records from 34729 primary records. [2025-09-17T07:38:43.643068] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:43.643126] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-17T07:38:43.647008] [DEBUG] [LOCAL ] MSA: Derivative data saved (1794 records). [2025-09-17T07:38:43.647158] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-17T07:38:43.650345] [INFO ] [MAIN ] Derivative Progress: 1292/2172 symbols completed. MSA took 1.1s. Estimated remaining: 5m 30s. Rate: 160.1 symbols/min [2025-09-17T07:38:43.663711] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:43.681274] [DEBUG] [LOCAL ] MSD: Loaded 15571 existing records from primary storage. [2025-09-17T07:38:43.680693] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1794 records). [2025-09-17T07:38:43.681568] [INFO ] [MAIN ] MSD: Loaded 15571 primary data records. [2025-09-17T07:38:43.681683] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-17T07:38:43.690025] [INFO ] [MAIN ] Derivative Progress: 1293/2172 symbols completed. MSCI took 1.1s. Estimated remaining: 5m 29s. Rate: 160.2 symbols/min [2025-09-17T07:38:43.748512] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:44.140501] [DEBUG] [LOCAL ] MSDL: Loaded 38189 existing records from primary storage. [2025-09-17T07:38:44.140774] [INFO ] [MAIN ] MSDL: Loaded 38189 primary data records. [2025-09-17T07:38:44.294383] [DEBUG] [LOCAL ] MSGE: Loaded 26955 existing records from primary storage. [2025-09-17T07:38:44.296720] [INFO ] [MAIN ] MSGE: Loaded 26955 primary data records. [2025-09-17T07:38:45.035612] [DEBUG] [MAIN ] MSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:45.036463] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 15571 primary records. [2025-09-17T07:38:45.037446] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-17T07:38:45.055362] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-09-17T07:38:45.055930] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-17T07:38:45.058110] [INFO ] [MAIN ] Derivative Progress: 1294/2172 symbols completed. MSD took 1.4s. Estimated remaining: 5m 29s. Rate: 159.9 symbols/min [2025-09-17T07:38:45.058622] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:45.077712] [DEBUG] [MAIN ] MSDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:45.082946] [INFO ] [MAIN ] MSDL: Generated 1794 derivative records from 38189 primary records. [2025-09-17T07:38:45.083356] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-17T07:38:45.105658] [DEBUG] [LOCAL ] MSGS: Loaded 16715 existing records from primary storage. [2025-09-17T07:38:45.107505] [INFO ] [MAIN ] MSGS: Loaded 16715 primary data records. [2025-09-17T07:38:45.185550] [DEBUG] [MAIN ] MSGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:45.190838] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1794 records). [2025-09-17T07:38:45.191479] [INFO ] [MAIN ] MSGE: Generated 1794 derivative records from 26955 primary records. [2025-09-17T07:38:45.214142] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-17T07:38:45.224940] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-17T07:38:45.227359] [INFO ] [MAIN ] Derivative Progress: 1295/2172 symbols completed. MSDL took 1.6s. Estimated remaining: 5m 29s. Rate: 160.0 symbols/min [2025-09-17T07:38:45.238302] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:45.432282] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1794 records). [2025-09-17T07:38:45.434110] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-17T07:38:45.436740] [INFO ] [MAIN ] Derivative Progress: 1296/2172 symbols completed. MSGE took 1.7s. Estimated remaining: 5m 28s. Rate: 160.0 symbols/min [2025-09-17T07:38:45.437437] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:45.468995] [DEBUG] [MAIN ] MSGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:45.469782] [INFO ] [MAIN ] MSGS: Generated 1794 derivative records from 16715 primary records. [2025-09-17T07:38:45.470054] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-17T07:38:45.506234] [DEBUG] [LOCAL ] MSI: Loaded 40754 existing records from primary storage. [2025-09-17T07:38:45.507784] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1794 records). [2025-09-17T07:38:45.507878] [INFO ] [MAIN ] MSI: Loaded 40754 primary data records. [2025-09-17T07:38:45.508251] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-17T07:38:45.521767] [INFO ] [MAIN ] Derivative Progress: 1297/2172 symbols completed. MSGS took 0.5s. Estimated remaining: 5m 28s. Rate: 160.1 symbols/min [2025-09-17T07:38:45.587083] [DEBUG] [LOCAL ] MSM: Loaded 35253 existing records from primary storage. [2025-09-17T07:38:45.587178] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:45.618035] [INFO ] [MAIN ] MSM: Loaded 35253 primary data records. [2025-09-17T07:38:46.128383] [DEBUG] [LOCAL ] MT: Loaded 50934 existing records from primary storage. [2025-09-17T07:38:46.130247] [INFO ] [MAIN ] MT: Loaded 50934 primary data records. [2025-09-17T07:38:46.444729] [DEBUG] [MAIN ] MSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:46.446490] [INFO ] [MAIN ] MSI: Generated 1794 derivative records from 40754 primary records. [2025-09-17T07:38:46.447468] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-17T07:38:46.468206] [DEBUG] [LOCAL ] MSI: Derivative data saved (1794 records). [2025-09-17T07:38:46.468976] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-17T07:38:46.471681] [INFO ] [MAIN ] Derivative Progress: 1298/2172 symbols completed. MSI took 1.2s. Estimated remaining: 5m 28s. Rate: 159.9 symbols/min [2025-09-17T07:38:46.484736] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:46.485326] [DEBUG] [MAIN ] MSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:46.486938] [INFO ] [MAIN ] MSM: Generated 1794 derivative records from 35253 primary records. [2025-09-17T07:38:46.487132] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-17T07:38:46.507334] [DEBUG] [LOCAL ] MSM: Derivative data saved (1794 records). [2025-09-17T07:38:46.507677] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-17T07:38:46.509959] [INFO ] [MAIN ] Derivative Progress: 1299/2172 symbols completed. MSM took 1.1s. Estimated remaining: 5m 27s. Rate: 160.0 symbols/min [2025-09-17T07:38:46.510671] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:46.536889] [DEBUG] [MAIN ] MT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:46.537701] [INFO ] [MAIN ] MT: Generated 1794 derivative records from 50934 primary records. [2025-09-17T07:38:46.537800] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-17T07:38:46.563822] [DEBUG] [LOCAL ] MTAL: Loaded 36102 existing records from primary storage. [2025-09-17T07:38:46.564678] [INFO ] [MAIN ] MTAL: Loaded 36102 primary data records. [2025-09-17T07:38:46.635696] [DEBUG] [LOCAL ] MT: Derivative data saved (1794 records). [2025-09-17T07:38:46.679268] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-17T07:38:46.687509] [INFO ] [MAIN ] Derivative Progress: 1300/2172 symbols completed. MT took 1.1s. Estimated remaining: 5m 27s. Rate: 160.1 symbols/min [2025-09-17T07:38:46.693052] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:46.886504] [DEBUG] [LOCAL ] MTB: Loaded 47268 existing records from primary storage. [2025-09-17T07:38:46.897071] [INFO ] [MAIN ] MTB: Loaded 47268 primary data records. [2025-09-17T07:38:47.000078] [DEBUG] [LOCAL ] MTD: Loaded 15407 existing records from primary storage. [2025-09-17T07:38:47.018190] [INFO ] [MAIN ] MTD: Loaded 15407 primary data records. [2025-09-17T07:38:47.579219] [DEBUG] [MAIN ] MTAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:47.580517] [INFO ] [MAIN ] MTAL: Generated 1794 derivative records from 36102 primary records. [2025-09-17T07:38:47.581084] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-17T07:38:47.605981] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1794 records). [2025-09-17T07:38:47.606530] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-17T07:38:47.608831] [INFO ] [MAIN ] Derivative Progress: 1301/2172 symbols completed. MTAL took 1.1s. Estimated remaining: 5m 27s. Rate: 159.9 symbols/min [2025-09-17T07:38:47.621861] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:47.622315] [DEBUG] [MAIN ] MTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:47.623268] [INFO ] [MAIN ] MTB: Generated 1794 derivative records from 47268 primary records. [2025-09-17T07:38:47.623471] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-17T07:38:47.641440] [DEBUG] [LOCAL ] MTB: Derivative data saved (1794 records). [2025-09-17T07:38:47.643201] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-17T07:38:47.646189] [INFO ] [MAIN ] Derivative Progress: 1302/2172 symbols completed. MTB took 1.1s. Estimated remaining: 5m 26s. Rate: 160.0 symbols/min [2025-09-17T07:38:47.646790] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:47.660324] [DEBUG] [MAIN ] MTD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:47.661015] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15407 primary records. [2025-09-17T07:38:47.661188] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-17T07:38:47.692155] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-09-17T07:38:47.692321] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-17T07:38:47.694961] [INFO ] [MAIN ] Derivative Progress: 1303/2172 symbols completed. MTD took 1.0s. Estimated remaining: 5m 26s. Rate: 160.1 symbols/min [2025-09-17T07:38:47.716637] [DEBUG] [LOCAL ] MTDR: Loaded 51570 existing records from primary storage. [2025-09-17T07:38:47.716897] [INFO ] [MAIN ] MTDR: Loaded 51570 primary data records. [2025-09-17T07:38:47.947462] [DEBUG] [LOCAL ] MTG: Loaded 51338 existing records from primary storage. [2025-09-17T07:38:47.971765] [INFO ] [MAIN ] MTG: Loaded 51338 primary data records. [2025-09-17T07:38:48.382734] [DEBUG] [MAIN ] MTDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:48.383808] [INFO ] [MAIN ] MTDR: Generated 1794 derivative records from 51570 primary records. [2025-09-17T07:38:48.383891] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-17T07:38:48.402770] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1794 records). [2025-09-17T07:38:48.415598] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-17T07:38:48.415493] [DEBUG] [MAIN ] MTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:48.417958] [INFO ] [MAIN ] Derivative Progress: 1304/2172 symbols completed. MTDR took 0.8s. Estimated remaining: 5m 25s. Rate: 160.0 symbols/min [2025-09-17T07:38:48.418705] [INFO ] [MAIN ] MTG: Generated 1794 derivative records from 51338 primary records. [2025-09-17T07:38:48.418984] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-17T07:38:48.434871] [DEBUG] [LOCAL ] MTG: Derivative data saved (1794 records). [2025-09-17T07:38:48.434954] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-17T07:38:48.437555] [INFO ] [MAIN ] Derivative Progress: 1305/2172 symbols completed. MTG took 0.8s. Estimated remaining: 5m 25s. Rate: 160.1 symbols/min [2025-09-17T07:38:48.438025] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:48.438217] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:48.438138] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:48.459849] [DEBUG] [LOCAL ] MTRN: Loaded 17790 existing records from primary storage. [2025-09-17T07:38:48.460022] [INFO ] [MAIN ] MTRN: Loaded 17790 primary data records. [2025-09-17T07:38:48.685456] [DEBUG] [LOCAL ] MTN: Loaded 39017 existing records from primary storage. [2025-09-17T07:38:48.790258] [DEBUG] [LOCAL ] MTH: Loaded 43964 existing records from primary storage. [2025-09-17T07:38:48.790366] [INFO ] [MAIN ] MTN: Loaded 39017 primary data records. [2025-09-17T07:38:48.811851] [INFO ] [MAIN ] MTH: Loaded 43964 primary data records. [2025-09-17T07:38:49.463303] [DEBUG] [MAIN ] MTRN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:49.464578] [INFO ] [MAIN ] MTRN: Generated 1794 derivative records from 17790 primary records. [2025-09-17T07:38:49.464817] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-17T07:38:49.481878] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1794 records). [2025-09-17T07:38:49.484292] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-17T07:38:49.486953] [INFO ] [MAIN ] Derivative Progress: 1306/2172 symbols completed. MTRN took 1.0s. Estimated remaining: 5m 25s. Rate: 159.9 symbols/min [2025-09-17T07:38:49.489275] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:49.510120] [DEBUG] [MAIN ] MTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:49.511418] [INFO ] [MAIN ] MTN: Generated 1794 derivative records from 39017 primary records. [2025-09-17T07:38:49.511675] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-17T07:38:49.531331] [DEBUG] [LOCAL ] MTN: Derivative data saved (1794 records). [2025-09-17T07:38:49.551128] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-17T07:38:49.553805] [INFO ] [MAIN ] Derivative Progress: 1307/2172 symbols completed. MTN took 1.1s. Estimated remaining: 5m 24s. Rate: 160.0 symbols/min [2025-09-17T07:38:49.551510] [DEBUG] [MAIN ] MTH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:49.555040] [INFO ] [MAIN ] MTH: Generated 1794 derivative records from 43964 primary records. [2025-09-17T07:38:49.555241] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-17T07:38:49.554326] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:49.580131] [DEBUG] [LOCAL ] MTUS: Loaded 29113 existing records from primary storage. [2025-09-17T07:38:49.581277] [INFO ] [MAIN ] MTUS: Loaded 29113 primary data records. [2025-09-17T07:38:49.603852] [DEBUG] [LOCAL ] MTH: Derivative data saved (1794 records). [2025-09-17T07:38:49.604030] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-17T07:38:49.621003] [INFO ] [MAIN ] Derivative Progress: 1308/2172 symbols completed. MTH took 1.2s. Estimated remaining: 5m 24s. Rate: 160.1 symbols/min [2025-09-17T07:38:49.626482] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:49.764389] [DEBUG] [LOCAL ] MTW: Loaded 26679 existing records from primary storage. [2025-09-17T07:38:49.799442] [INFO ] [MAIN ] MTW: Loaded 26679 primary data records. [2025-09-17T07:38:50.020488] [DEBUG] [LOCAL ] MTX: Loaded 22887 existing records from primary storage. [2025-09-17T07:38:50.075429] [INFO ] [MAIN ] MTX: Loaded 22887 primary data records. [2025-09-17T07:38:50.543492] [DEBUG] [MAIN ] MTUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:50.544506] [INFO ] [MAIN ] MTUS: Generated 1794 derivative records from 29113 primary records. [2025-09-17T07:38:50.545770] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-17T07:38:50.567366] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1794 records). [2025-09-17T07:38:50.568144] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-17T07:38:50.570874] [INFO ] [MAIN ] Derivative Progress: 1309/2172 symbols completed. MTUS took 1.1s. Estimated remaining: 5m 24s. Rate: 159.9 symbols/min [2025-09-17T07:38:50.572221] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:50.586107] [DEBUG] [MAIN ] MTW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:50.587003] [INFO ] [MAIN ] MTW: Generated 1794 derivative records from 26679 primary records. [2025-09-17T07:38:50.587359] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-17T07:38:50.604973] [DEBUG] [LOCAL ] MTW: Derivative data saved (1794 records). [2025-09-17T07:38:50.605132] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-17T07:38:50.607739] [INFO ] [MAIN ] Derivative Progress: 1310/2172 symbols completed. MTW took 1.1s. Estimated remaining: 5m 23s. Rate: 160.0 symbols/min [2025-09-17T07:38:50.608298] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:50.624007] [DEBUG] [MAIN ] MTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:50.624869] [INFO ] [MAIN ] MTX: Generated 1794 derivative records from 22887 primary records. [2025-09-17T07:38:50.625005] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-17T07:38:50.645381] [DEBUG] [LOCAL ] MTX: Derivative data saved (1794 records). [2025-09-17T07:38:50.655287] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-17T07:38:50.658239] [INFO ] [MAIN ] Derivative Progress: 1311/2172 symbols completed. MTX took 1.0s. Estimated remaining: 5m 23s. Rate: 160.2 symbols/min [2025-09-17T07:38:50.663847] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:50.664405] [DEBUG] [LOCAL ] MUA: Loaded 12349 existing records from primary storage. [2025-09-17T07:38:50.664734] [INFO ] [MAIN ] MUA: Loaded 12349 primary data records. [2025-09-17T07:38:50.789340] [DEBUG] [LOCAL ] MTZ: Loaded 43668 existing records from primary storage. [2025-09-17T07:38:50.833940] [INFO ] [MAIN ] MTZ: Loaded 43668 primary data records. [2025-09-17T07:38:50.992395] [DEBUG] [LOCAL ] MUC: Loaded 20044 existing records from primary storage. [2025-09-17T07:38:51.085340] [INFO ] [MAIN ] MUC: Loaded 20044 primary data records. [2025-09-17T07:38:51.668334] [DEBUG] [MAIN ] MUA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:51.669111] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 12349 primary records. [2025-09-17T07:38:51.669661] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-17T07:38:51.687768] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-09-17T07:38:51.689885] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-17T07:38:51.691925] [INFO ] [MAIN ] Derivative Progress: 1312/2172 symbols completed. MUA took 1.1s. Estimated remaining: 5m 23s. Rate: 159.9 symbols/min [2025-09-17T07:38:51.692356] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:51.706474] [DEBUG] [MAIN ] MTZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:38:51.707209] [INFO ] [MAIN ] MTZ: Generated 1793 derivative records from 43668 primary records. [2025-09-17T07:38:51.707382] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-17T07:38:51.730142] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1793 records). [2025-09-17T07:38:51.735097] [DEBUG] [LOCAL ] MUE: Loaded 11893 existing records from primary storage. [2025-09-17T07:38:51.747353] [INFO ] [MAIN ] MUE: Loaded 11893 primary data records. [2025-09-17T07:38:51.735259] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-17T07:38:51.747909] [DEBUG] [MAIN ] MUC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:51.750831] [INFO ] [MAIN ] Derivative Progress: 1313/2172 symbols completed. MTZ took 1.2s. Estimated remaining: 5m 22s. Rate: 160.0 symbols/min [2025-09-17T07:38:51.786899] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20044 primary records. [2025-09-17T07:38:51.787062] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:51.821666] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-17T07:38:52.056933] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-09-17T07:38:52.064821] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-17T07:38:52.068320] [INFO ] [MAIN ] Derivative Progress: 1314/2172 symbols completed. MUC took 1.4s. Estimated remaining: 5m 22s. Rate: 160.1 symbols/min [2025-09-17T07:38:52.068595] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:52.099175] [DEBUG] [LOCAL ] MUJ: Loaded 13133 existing records from primary storage. [2025-09-17T07:38:52.099378] [INFO ] [MAIN ] MUJ: Loaded 13133 primary data records. [2025-09-17T07:38:52.219243] [DEBUG] [LOCAL ] MUFG: Loaded 52681 existing records from primary storage. [2025-09-17T07:38:52.219498] [INFO ] [MAIN ] MUFG: Loaded 52681 primary data records. [2025-09-17T07:38:52.278584] [DEBUG] [MAIN ] MUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:52.333816] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11893 primary records. [2025-09-17T07:38:52.458516] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-17T07:38:52.744302] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-09-17T07:38:52.744716] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-17T07:38:52.746991] [INFO ] [MAIN ] Derivative Progress: 1315/2172 symbols completed. MUE took 1.1s. Estimated remaining: 5m 21s. Rate: 160.0 symbols/min [2025-09-17T07:38:52.748836] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:52.773574] [DEBUG] [MAIN ] MUJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:52.774484] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13133 primary records. [2025-09-17T07:38:52.774800] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-17T07:38:52.787836] [DEBUG] [MAIN ] MUFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:52.788862] [INFO ] [MAIN ] MUFG: Generated 1794 derivative records from 52681 primary records. [2025-09-17T07:38:52.789190] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-17T07:38:52.820478] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-09-17T07:38:52.820910] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-17T07:38:52.824323] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1794 records). [2025-09-17T07:38:52.824239] [INFO ] [MAIN ] Derivative Progress: 1316/2172 symbols completed. MUJ took 0.8s. Estimated remaining: 5m 21s. Rate: 160.1 symbols/min [2025-09-17T07:38:52.837771] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-17T07:38:52.837985] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:52.840614] [INFO ] [MAIN ] Derivative Progress: 1317/2172 symbols completed. MUFG took 1.1s. Estimated remaining: 5m 20s. Rate: 160.2 symbols/min [2025-09-17T07:38:52.841210] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:52.862037] [DEBUG] [LOCAL ] MUR: Loaded 52946 existing records from primary storage. [2025-09-17T07:38:52.862331] [INFO ] [MAIN ] MUR: Loaded 52946 primary data records. [2025-09-17T07:38:53.038151] [DEBUG] [LOCAL ] MUSA: Loaded 25138 existing records from primary storage. [2025-09-17T07:38:53.066151] [INFO ] [MAIN ] MUSA: Loaded 25138 primary data records. [2025-09-17T07:38:53.219285] [DEBUG] [LOCAL ] MUX: Loaded 42149 existing records from primary storage. [2025-09-17T07:38:53.258918] [INFO ] [MAIN ] MUX: Loaded 42149 primary data records. [2025-09-17T07:38:53.847276] [DEBUG] [MAIN ] MUR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:53.848138] [INFO ] [MAIN ] MUR: Generated 1794 derivative records from 52946 primary records. [2025-09-17T07:38:53.849090] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-17T07:38:53.868664] [DEBUG] [LOCAL ] MUR: Derivative data saved (1794 records). [2025-09-17T07:38:53.869144] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-17T07:38:53.884413] [INFO ] [MAIN ] Derivative Progress: 1318/2172 symbols completed. MUR took 1.1s. Estimated remaining: 5m 20s. Rate: 160.0 symbols/min [2025-09-17T07:38:53.884984] [DEBUG] [MAIN ] MUSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:53.889113] [INFO ] [MAIN ] MUSA: Generated 1794 derivative records from 25138 primary records. [2025-09-17T07:38:53.889443] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-17T07:38:53.913685] [DEBUG] [MAIN ] MUX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:53.919467] [INFO ] [MAIN ] MUX: Generated 1794 derivative records from 42149 primary records. [2025-09-17T07:38:53.920891] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-17T07:38:53.939357] [DEBUG] [LOCAL ] MUX: Derivative data saved (1794 records). [2025-09-17T07:38:53.940731] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-17T07:38:53.943867] [INFO ] [MAIN ] Derivative Progress: 1319/2172 symbols completed. MUX took 1.1s. Estimated remaining: 5m 20s. Rate: 160.1 symbols/min [2025-09-17T07:38:53.945313] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1794 records). [2025-09-17T07:38:53.945393] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-17T07:38:53.947915] [INFO ] [MAIN ] Derivative Progress: 1320/2172 symbols completed. MUSA took 1.1s. Estimated remaining: 5m 19s. Rate: 160.2 symbols/min [2025-09-17T07:38:53.948811] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:53.948422] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:53.949389] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:53.967464] [DEBUG] [LOCAL ] MVO: Loaded 9083 existing records from primary storage. [2025-09-17T07:38:53.967871] [INFO ] [MAIN ] MVO: Loaded 9083 primary data records. [2025-09-17T07:38:54.015401] [DEBUG] [LOCAL ] MVT: Loaded 10021 existing records from primary storage. [2025-09-17T07:38:54.056426] [DEBUG] [LOCAL ] MVF: Loaded 12821 existing records from primary storage. [2025-09-17T07:38:54.066758] [INFO ] [MAIN ] MVT: Loaded 10021 primary data records. [2025-09-17T07:38:54.084592] [INFO ] [MAIN ] MVF: Loaded 12821 primary data records. [2025-09-17T07:38:54.966255] [DEBUG] [MAIN ] MVO: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:38:54.967230] [INFO ] [MAIN ] MVO: Generated 1793 derivative records from 9083 primary records. [2025-09-17T07:38:54.968848] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-17T07:38:55.012117] [DEBUG] [MAIN ] MVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:55.013237] [DEBUG] [MAIN ] MVF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:55.014339] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10021 primary records. [2025-09-17T07:38:55.015158] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12821 primary records. [2025-09-17T07:38:55.015709] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-17T07:38:55.016486] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-17T07:38:55.026196] [DEBUG] [LOCAL ] MVO: Derivative data saved (1793 records). [2025-09-17T07:38:55.033627] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-17T07:38:55.041848] [INFO ] [MAIN ] Derivative Progress: 1321/2172 symbols completed. MVO took 1.1s. Estimated remaining: 5m 19s. Rate: 159.9 symbols/min [2025-09-17T07:38:55.043803] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:55.049596] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-09-17T07:38:55.050561] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-17T07:38:55.052954] [INFO ] [MAIN ] Derivative Progress: 1322/2172 symbols completed. MVF took 1.1s. Estimated remaining: 5m 19s. Rate: 160.1 symbols/min [2025-09-17T07:38:55.050503] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-09-17T07:38:55.053499] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:55.053634] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-17T07:38:55.056455] [INFO ] [MAIN ] Derivative Progress: 1323/2172 symbols completed. MVT took 1.1s. Estimated remaining: 5m 18s. Rate: 160.2 symbols/min [2025-09-17T07:38:55.056989] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:55.065659] [DEBUG] [LOCAL ] MXF: Loaded 6138 existing records from primary storage. [2025-09-17T07:38:55.065870] [INFO ] [MAIN ] MXF: Loaded 6138 primary data records. [2025-09-17T07:38:55.206554] [DEBUG] [LOCAL ] MX: Loaded 22967 existing records from primary storage. [2025-09-17T07:38:55.248863] [INFO ] [MAIN ] MX: Loaded 22967 primary data records. [2025-09-17T07:38:55.450678] [DEBUG] [LOCAL ] MWA: Loaded 47255 existing records from primary storage. [2025-09-17T07:38:55.476934] [INFO ] [MAIN ] MWA: Loaded 47255 primary data records. [2025-09-17T07:38:56.015397] [DEBUG] [MAIN ] MXF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:56.016943] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 6138 primary records. [2025-09-17T07:38:56.017588] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-17T07:38:56.048461] [DEBUG] [MAIN ] MX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:56.050545] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 22967 primary records. [2025-09-17T07:38:56.050900] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-09-17T07:38:56.051031] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-17T07:38:56.053390] [INFO ] [MAIN ] Derivative Progress: 1324/2172 symbols completed. MXF took 1.0s. Estimated remaining: 5m 18s. Rate: 160.0 symbols/min [2025-09-17T07:38:56.053731] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:56.054731] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-17T07:38:56.086969] [DEBUG] [MAIN ] MWA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:56.095506] [DEBUG] [LOCAL ] MYD: Loaded 13768 existing records from primary storage. [2025-09-17T07:38:56.094474] [INFO ] [MAIN ] MWA: Generated 1794 derivative records from 47255 primary records. [2025-09-17T07:38:56.095674] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-09-17T07:38:56.095817] [INFO ] [MAIN ] MYD: Loaded 13768 primary data records. [2025-09-17T07:38:56.095919] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-17T07:38:56.095953] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-17T07:38:56.142692] [INFO ] [MAIN ] Derivative Progress: 1325/2172 symbols completed. MX took 1.1s. Estimated remaining: 5m 17s. Rate: 160.1 symbols/min [2025-09-17T07:38:56.170871] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:56.373699] [DEBUG] [LOCAL ] MWA: Derivative data saved (1794 records). [2025-09-17T07:38:56.421844] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-17T07:38:56.425009] [INFO ] [MAIN ] Derivative Progress: 1326/2172 symbols completed. MWA took 1.4s. Estimated remaining: 5m 17s. Rate: 160.1 symbols/min [2025-09-17T07:38:56.425407] [INFO ] [MAIN ] MYI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:56.435719] [DEBUG] [LOCAL ] MYE: Loaded 25615 existing records from primary storage. [2025-09-17T07:38:56.436007] [INFO ] [MAIN ] MYE: Loaded 25615 primary data records. [2025-09-17T07:38:56.635369] [DEBUG] [LOCAL ] MYI: Loaded 19326 existing records from primary storage. [2025-09-17T07:38:56.635565] [INFO ] [MAIN ] MYI: Loaded 19326 primary data records. [2025-09-17T07:38:57.153117] [DEBUG] [MAIN ] MYD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:57.164244] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13768 primary records. [2025-09-17T07:38:57.164731] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-17T07:38:57.185525] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-09-17T07:38:57.187626] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-17T07:38:57.190004] [INFO ] [MAIN ] Derivative Progress: 1327/2172 symbols completed. MYD took 1.1s. Estimated remaining: 5m 17s. Rate: 160.0 symbols/min [2025-09-17T07:38:57.190417] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:57.204962] [DEBUG] [MAIN ] MYE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:57.206673] [INFO ] [MAIN ] MYE: Generated 1794 derivative records from 25615 primary records. [2025-09-17T07:38:57.206945] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-17T07:38:57.230738] [DEBUG] [LOCAL ] MYN: Loaded 10308 existing records from primary storage. [2025-09-17T07:38:57.232955] [INFO ] [MAIN ] MYN: Loaded 10308 primary data records. [2025-09-17T07:38:57.245598] [DEBUG] [LOCAL ] MYE: Derivative data saved (1794 records). [2025-09-17T07:38:57.271199] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-17T07:38:57.300957] [INFO ] [MAIN ] Derivative Progress: 1328/2172 symbols completed. MYE took 1.1s. Estimated remaining: 5m 16s. Rate: 160.1 symbols/min [2025-09-17T07:38:57.341422] [DEBUG] [MAIN ] MYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:57.341534] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:57.352868] [INFO ] [MAIN ] MYI: Generated 1794 derivative records from 19326 primary records. [2025-09-17T07:38:57.353615] [DEBUG] [LOCAL ] MYI: Saving derivative data. [2025-09-17T07:38:57.566453] [DEBUG] [LOCAL ] MYI: Derivative data saved (1794 records). [2025-09-17T07:38:57.566796] [INFO ] [MAIN ] MYI: Successfully saved derivative data. [2025-09-17T07:38:57.569482] [INFO ] [MAIN ] Derivative Progress: 1329/2172 symbols completed. MYI took 1.1s. Estimated remaining: 5m 16s. Rate: 160.1 symbols/min [2025-09-17T07:38:57.570138] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:57.599998] [DEBUG] [LOCAL ] NABL: Loaded 40431 existing records from primary storage. [2025-09-17T07:38:57.600584] [INFO ] [MAIN ] NABL: Loaded 40431 primary data records. [2025-09-17T07:38:57.748311] [DEBUG] [LOCAL ] NAC: Loaded 24749 existing records from primary storage. [2025-09-17T07:38:57.800716] [INFO ] [MAIN ] NAC: Loaded 24749 primary data records. [2025-09-17T07:38:58.000094] [DEBUG] [MAIN ] MYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:58.035512] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 10308 primary records. [2025-09-17T07:38:58.055608] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-17T07:38:58.280881] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-09-17T07:38:58.281294] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-17T07:38:58.284000] [INFO ] [MAIN ] Derivative Progress: 1330/2172 symbols completed. MYN took 1.1s. Estimated remaining: 5m 16s. Rate: 160.0 symbols/min [2025-09-17T07:38:58.285502] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:58.307551] [DEBUG] [MAIN ] NABL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:58.308684] [INFO ] [MAIN ] NABL: Generated 1794 derivative records from 40431 primary records. [2025-09-17T07:38:58.309318] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-17T07:38:58.326865] [DEBUG] [LOCAL ] NABL: Derivative data saved (1794 records). [2025-09-17T07:38:58.336670] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-17T07:38:58.339140] [INFO ] [MAIN ] Derivative Progress: 1331/2172 symbols completed. NABL took 1.0s. Estimated remaining: 5m 15s. Rate: 160.1 symbols/min [2025-09-17T07:38:58.339668] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:58.358873] [DEBUG] [MAIN ] NAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:58.360181] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24749 primary records. [2025-09-17T07:38:58.374987] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-17T07:38:58.375281] [DEBUG] [LOCAL ] NAN: Loaded 9137 existing records from primary storage. [2025-09-17T07:38:58.375544] [INFO ] [MAIN ] NAN: Loaded 9137 primary data records. [2025-09-17T07:38:58.377211] [DEBUG] [LOCAL ] NAD: Loaded 34164 existing records from primary storage. [2025-09-17T07:38:58.446980] [INFO ] [MAIN ] NAD: Loaded 34164 primary data records. [2025-09-17T07:38:58.478932] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-09-17T07:38:58.572547] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-17T07:38:58.608276] [INFO ] [MAIN ] Derivative Progress: 1332/2172 symbols completed. NAC took 1.0s. Estimated remaining: 5m 15s. Rate: 160.1 symbols/min [2025-09-17T07:38:58.669434] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:59.115951] [DEBUG] [MAIN ] NAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:59.119832] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 9137 primary records. [2025-09-17T07:38:59.121376] [DEBUG] [LOCAL ] NAT: Loaded 49168 existing records from primary storage. [2025-09-17T07:38:59.121880] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-17T07:38:59.122289] [INFO ] [MAIN ] NAT: Loaded 49168 primary data records. [2025-09-17T07:38:59.256725] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-09-17T07:38:59.258921] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-17T07:38:59.294614] [INFO ] [MAIN ] Derivative Progress: 1333/2172 symbols completed. NAN took 1.0s. Estimated remaining: 5m 15s. Rate: 160.0 symbols/min [2025-09-17T07:38:59.362587] [DEBUG] [MAIN ] NAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:59.466706] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 34164 primary records. [2025-09-17T07:38:59.481917] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-17T07:38:59.502080] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-09-17T07:38:59.502174] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-17T07:38:59.504896] [INFO ] [MAIN ] Derivative Progress: 1334/2172 symbols completed. NAD took 1.2s. Estimated remaining: 5m 14s. Rate: 160.1 symbols/min [2025-09-17T07:38:59.524164] [DEBUG] [MAIN ] NAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:38:59.524871] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49168 primary records. [2025-09-17T07:38:59.524959] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-17T07:38:59.540482] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-09-17T07:38:59.540558] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-17T07:38:59.542886] [INFO ] [MAIN ] Derivative Progress: 1335/2172 symbols completed. NAT took 0.9s. Estimated remaining: 5m 14s. Rate: 160.2 symbols/min [2025-09-17T07:38:59.543773] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:59.543959] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:59.543831] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:38:59.550297] [DEBUG] [LOCAL ] NAZ: Loaded 2723 existing records from primary storage. [2025-09-17T07:38:59.550408] [INFO ] [MAIN ] NAZ: Loaded 2723 primary data records. [2025-09-17T07:38:59.639000] [DEBUG] [LOCAL ] NBB: Loaded 8923 existing records from primary storage. [2025-09-17T07:38:59.659247] [INFO ] [MAIN ] NBB: Loaded 8923 primary data records. [2025-09-17T07:38:59.988956] [DEBUG] [LOCAL ] NATL: Loaded 32794 existing records from primary storage. [2025-09-17T07:39:00.007133] [INFO ] [MAIN ] NATL: Loaded 32794 primary data records. [2025-09-17T07:39:00.547870] [DEBUG] [MAIN ] NAZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:00.548917] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2723 primary records. [2025-09-17T07:39:00.549236] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-17T07:39:00.566801] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-09-17T07:39:00.568392] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-17T07:39:00.571092] [INFO ] [MAIN ] Derivative Progress: 1336/2172 symbols completed. NAZ took 1.0s. Estimated remaining: 5m 14s. Rate: 160.0 symbols/min [2025-09-17T07:39:00.571626] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:00.586732] [DEBUG] [MAIN ] NBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:00.587833] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 8923 primary records. [2025-09-17T07:39:00.588079] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-17T07:39:00.605475] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-09-17T07:39:00.612675] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-17T07:39:00.615207] [INFO ] [MAIN ] Derivative Progress: 1337/2172 symbols completed. NBB took 1.1s. Estimated remaining: 5m 13s. Rate: 160.1 symbols/min [2025-09-17T07:39:00.615669] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:00.628988] [DEBUG] [MAIN ] NATL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:00.630129] [INFO ] [MAIN ] NATL: Generated 1794 derivative records from 32794 primary records. [2025-09-17T07:39:00.630912] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-17T07:39:00.640067] [DEBUG] [LOCAL ] NBHC: Loaded 22776 existing records from primary storage. [2025-09-17T07:39:00.648798] [INFO ] [MAIN ] NBHC: Loaded 22776 primary data records. [2025-09-17T07:39:00.763364] [DEBUG] [LOCAL ] NATL: Derivative data saved (1794 records). [2025-09-17T07:39:00.777437] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-17T07:39:00.802862] [INFO ] [MAIN ] Derivative Progress: 1338/2172 symbols completed. NATL took 1.3s. Estimated remaining: 5m 12s. Rate: 160.1 symbols/min [2025-09-17T07:39:00.824177] [DEBUG] [LOCAL ] NBR: Loaded 35065 existing records from primary storage. [2025-09-17T07:39:00.860895] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:00.860755] [INFO ] [MAIN ] NBR: Loaded 35065 primary data records. [2025-09-17T07:39:01.226335] [DEBUG] [LOCAL ] NBXG: Loaded 22900 existing records from primary storage. [2025-09-17T07:39:01.346381] [INFO ] [MAIN ] NBXG: Loaded 22900 primary data records. [2025-09-17T07:39:01.683694] [DEBUG] [MAIN ] NBHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:01.685204] [INFO ] [MAIN ] NBHC: Generated 1794 derivative records from 22776 primary records. [2025-09-17T07:39:01.686397] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-17T07:39:01.705269] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1794 records). [2025-09-17T07:39:01.707472] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-17T07:39:01.711195] [INFO ] [MAIN ] Derivative Progress: 1339/2172 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 12s. Rate: 160.0 symbols/min [2025-09-17T07:39:01.711934] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:01.725959] [DEBUG] [MAIN ] NBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:01.727003] [INFO ] [MAIN ] NBR: Generated 1794 derivative records from 35065 primary records. [2025-09-17T07:39:01.727429] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-17T07:39:01.731399] [DEBUG] [LOCAL ] NC: Loaded 1919 existing records from primary storage. [2025-09-17T07:39:01.747568] [DEBUG] [LOCAL ] NBR: Derivative data saved (1794 records). [2025-09-17T07:39:01.746453] [INFO ] [MAIN ] NC: Loaded 1919 primary data records. [2025-09-17T07:39:01.748553] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-17T07:39:01.764393] [INFO ] [MAIN ] Derivative Progress: 1340/2172 symbols completed. NBR took 1.1s. Estimated remaining: 5m 12s. Rate: 160.1 symbols/min [2025-09-17T07:39:01.819809] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:01.840227] [DEBUG] [MAIN ] NBXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:01.856204] [INFO ] [MAIN ] NBXG: Generated 1794 derivative records from 22900 primary records. [2025-09-17T07:39:01.879326] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-17T07:39:02.103064] [DEBUG] [LOCAL ] NCA: Loaded 9900 existing records from primary storage. [2025-09-17T07:39:02.105902] [INFO ] [MAIN ] NCA: Loaded 9900 primary data records. [2025-09-17T07:39:02.105764] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1794 records). [2025-09-17T07:39:02.106297] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-17T07:39:02.143805] [INFO ] [MAIN ] Derivative Progress: 1341/2172 symbols completed. NBXG took 1.3s. Estimated remaining: 5m 11s. Rate: 160.1 symbols/min [2025-09-17T07:39:02.169276] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:02.466275] [DEBUG] [LOCAL ] NCDL: Loaded 21877 existing records from primary storage. [2025-09-17T07:39:02.467570] [INFO ] [MAIN ] NCDL: Loaded 21877 primary data records. [2025-09-17T07:39:02.507908] [DEBUG] [MAIN ] NC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:39:02.551836] [INFO ] [MAIN ] NC: Generated 1793 derivative records from 1919 primary records. [2025-09-17T07:39:02.599030] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-17T07:39:02.724376] [DEBUG] [MAIN ] NCA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:02.728430] [DEBUG] [LOCAL ] NC: Derivative data saved (1793 records). [2025-09-17T07:39:02.891703] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-17T07:39:02.882437] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 9900 primary records. [2025-09-17T07:39:02.894848] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-17T07:39:02.894412] [INFO ] [MAIN ] Derivative Progress: 1342/2172 symbols completed. NC took 1.2s. Estimated remaining: 5m 11s. Rate: 160.0 symbols/min [2025-09-17T07:39:02.895603] [INFO ] [MAIN ] NCLH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:02.912876] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-09-17T07:39:02.913459] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-17T07:39:02.915887] [INFO ] [MAIN ] Derivative Progress: 1343/2172 symbols completed. NCA took 1.1s. Estimated remaining: 5m 11s. Rate: 160.1 symbols/min [2025-09-17T07:39:02.916909] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:02.945379] [DEBUG] [MAIN ] NCDL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:02.946344] [INFO ] [MAIN ] NCDL: Generated 1794 derivative records from 21877 primary records. [2025-09-17T07:39:02.946445] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-17T07:39:02.952444] [DEBUG] [LOCAL ] NCV: Loaded 13380 existing records from primary storage. [2025-09-17T07:39:02.952850] [INFO ] [MAIN ] NCV: Loaded 13380 primary data records. [2025-09-17T07:39:03.086038] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1794 records). [2025-09-17T07:39:03.122002] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-17T07:39:03.143087] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-09-17T07:39:03.145720] [INFO ] [MAIN ] Derivative Progress: 1344/2172 symbols completed. NCDL took 1.0s. Estimated remaining: 5m 10s. Rate: 160.1 symbols/min [2025-09-17T07:39:03.164156] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:03.180732] [INFO ] [MAIN ] NCLH: Loaded 53753 primary data records. [2025-09-17T07:39:03.417875] [DEBUG] [LOCAL ] NCZ: Loaded 11724 existing records from primary storage. [2025-09-17T07:39:03.433563] [INFO ] [MAIN ] NCZ: Loaded 11724 primary data records. [2025-09-17T07:39:03.915551] [DEBUG] [MAIN ] NCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:03.916878] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13380 primary records. [2025-09-17T07:39:03.917481] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-17T07:39:03.933694] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-09-17T07:39:03.933861] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-17T07:39:03.936266] [INFO ] [MAIN ] Derivative Progress: 1345/2172 symbols completed. NCV took 1.0s. Estimated remaining: 5m 10s. Rate: 160.0 symbols/min [2025-09-17T07:39:03.937029] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:03.953590] [DEBUG] [MAIN ] NCLH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:03.954693] [INFO ] [MAIN ] NCLH: Generated 1794 derivative records from 53753 primary records. [2025-09-17T07:39:03.954946] [DEBUG] [LOCAL ] NCLH: Saving derivative data. [2025-09-17T07:39:03.982023] [DEBUG] [LOCAL ] NDMO: Loaded 16383 existing records from primary storage. [2025-09-17T07:39:03.990332] [INFO ] [MAIN ] NDMO: Loaded 16383 primary data records. [2025-09-17T07:39:04.007106] [DEBUG] [LOCAL ] NCLH: Derivative data saved (1794 records). [2025-09-17T07:39:04.038674] [INFO ] [MAIN ] NCLH: Successfully saved derivative data. [2025-09-17T07:39:04.064357] [DEBUG] [MAIN ] NCZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:04.078144] [INFO ] [MAIN ] Derivative Progress: 1346/2172 symbols completed. NCLH took 1.2s. Estimated remaining: 5m 10s. Rate: 160.1 symbols/min [2025-09-17T07:39:04.089790] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 11724 primary records. [2025-09-17T07:39:04.100607] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:04.100725] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-17T07:39:04.306838] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-09-17T07:39:04.307145] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-17T07:39:04.309555] [INFO ] [MAIN ] Derivative Progress: 1347/2172 symbols completed. NCZ took 1.1s. Estimated remaining: 5m 9s. Rate: 160.1 symbols/min [2025-09-17T07:39:04.309961] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:04.364441] [DEBUG] [MAIN ] NDMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:04.365224] [INFO ] [MAIN ] NDMO: Generated 1794 derivative records from 16383 primary records. [2025-09-17T07:39:04.366229] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-17T07:39:04.366039] [DEBUG] [LOCAL ] NE: Loaded 52384 existing records from primary storage. [2025-09-17T07:39:04.366329] [INFO ] [MAIN ] NE: Loaded 52384 primary data records. [2025-09-17T07:39:04.476894] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1794 records). [2025-09-17T07:39:04.509063] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-17T07:39:04.511929] [INFO ] [MAIN ] Derivative Progress: 1348/2172 symbols completed. NDMO took 0.6s. Estimated remaining: 5m 9s. Rate: 160.2 symbols/min [2025-09-17T07:39:04.528626] [DEBUG] [LOCAL ] NEA: Loaded 35411 existing records from primary storage. [2025-09-17T07:39:04.561722] [INFO ] [MAIN ] NEA: Loaded 35411 primary data records. [2025-09-17T07:39:05.044204] [DEBUG] [MAIN ] NE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:05.044942] [INFO ] [MAIN ] NE: Generated 1794 derivative records from 52384 primary records. [2025-09-17T07:39:05.045089] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-17T07:39:05.061736] [DEBUG] [LOCAL ] NE: Derivative data saved (1794 records). [2025-09-17T07:39:05.061936] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-17T07:39:05.064184] [INFO ] [MAIN ] Derivative Progress: 1349/2172 symbols completed. NE took 1.0s. Estimated remaining: 5m 8s. Rate: 160.1 symbols/min [2025-09-17T07:39:05.079008] [DEBUG] [MAIN ] NEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:05.079679] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35411 primary records. [2025-09-17T07:39:05.079759] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-17T07:39:05.095459] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-09-17T07:39:05.095531] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-17T07:39:05.097983] [INFO ] [MAIN ] Derivative Progress: 1350/2172 symbols completed. NEA took 0.8s. Estimated remaining: 5m 8s. Rate: 160.2 symbols/min [2025-09-17T07:39:05.098547] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:05.098590] [INFO ] [MAIN ] NEE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:05.098721] [INFO ] [MAIN ] NEM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:05.178248] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-09-17T07:39:05.178528] [INFO ] [MAIN ] NEE: Loaded 53707 primary data records. [2025-09-17T07:39:05.311122] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-09-17T07:39:05.311856] [DEBUG] [LOCAL ] NET: Loaded 53095 existing records from primary storage. [2025-09-17T07:39:05.322366] [INFO ] [MAIN ] NEM: Loaded 53708 primary data records. [2025-09-17T07:39:05.327586] [INFO ] [MAIN ] NET: Loaded 53095 primary data records. [2025-09-17T07:39:06.101086] [DEBUG] [MAIN ] NEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:06.102524] [INFO ] [MAIN ] NEE: Generated 1794 derivative records from 53707 primary records. [2025-09-17T07:39:06.102637] [DEBUG] [LOCAL ] NEE: Saving derivative data. [2025-09-17T07:39:06.133171] [DEBUG] [MAIN ] NET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:06.142541] [INFO ] [MAIN ] NET: Generated 1794 derivative records from 53095 primary records. [2025-09-17T07:39:06.147682] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-17T07:39:06.148087] [DEBUG] [MAIN ] NEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:06.148488] [DEBUG] [LOCAL ] NEE: Derivative data saved (1794 records). [2025-09-17T07:39:06.149674] [INFO ] [MAIN ] NEM: Generated 1794 derivative records from 53708 primary records. [2025-09-17T07:39:06.149734] [INFO ] [MAIN ] NEE: Successfully saved derivative data. [2025-09-17T07:39:06.158339] [DEBUG] [LOCAL ] NEM: Saving derivative data. [2025-09-17T07:39:06.163930] [INFO ] [MAIN ] Derivative Progress: 1351/2172 symbols completed. NEE took 1.1s. Estimated remaining: 5m 8s. Rate: 160.0 symbols/min [2025-09-17T07:39:06.165071] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:06.181184] [DEBUG] [LOCAL ] NET: Derivative data saved (1794 records). [2025-09-17T07:39:06.182052] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-17T07:39:06.184974] [INFO ] [MAIN ] Derivative Progress: 1352/2172 symbols completed. NET took 1.1s. Estimated remaining: 5m 7s. Rate: 160.1 symbols/min [2025-09-17T07:39:06.185463] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:06.194879] [DEBUG] [LOCAL ] NEU: Loaded 8109 existing records from primary storage. [2025-09-17T07:39:06.194592] [DEBUG] [LOCAL ] NEM: Derivative data saved (1794 records). [2025-09-17T07:39:06.195135] [INFO ] [MAIN ] NEU: Loaded 8109 primary data records. [2025-09-17T07:39:06.195029] [INFO ] [MAIN ] NEM: Successfully saved derivative data. [2025-09-17T07:39:06.197723] [INFO ] [MAIN ] Derivative Progress: 1353/2172 symbols completed. NEM took 1.1s. Estimated remaining: 5m 7s. Rate: 160.2 symbols/min [2025-09-17T07:39:06.220321] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:06.223771] [DEBUG] [LOCAL ] NEUE: Loaded 2258 existing records from primary storage. [2025-09-17T07:39:06.267932] [INFO ] [MAIN ] NEUE: Loaded 2258 primary data records. [2025-09-17T07:39:06.477068] [DEBUG] [LOCAL ] NEXA: Loaded 3859 existing records from primary storage. [2025-09-17T07:39:06.477249] [INFO ] [MAIN ] NEXA: Loaded 3859 primary data records. [2025-09-17T07:39:07.132122] [DEBUG] [MAIN ] NEU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:07.134254] [INFO ] [MAIN ] NEU: Generated 1794 derivative records from 8109 primary records. [2025-09-17T07:39:07.134733] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-17T07:39:07.162135] [DEBUG] [MAIN ] NEUE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:07.166326] [INFO ] [MAIN ] NEUE: Generated 1794 derivative records from 2258 primary records. [2025-09-17T07:39:07.165535] [DEBUG] [LOCAL ] NEU: Derivative data saved (1794 records). [2025-09-17T07:39:07.166654] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-17T07:39:07.166604] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-17T07:39:07.168877] [INFO ] [MAIN ] Derivative Progress: 1354/2172 symbols completed. NEU took 1.0s. Estimated remaining: 5m 7s. Rate: 160.0 symbols/min [2025-09-17T07:39:07.169545] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:07.183788] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1794 records). [2025-09-17T07:39:07.184897] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-17T07:39:07.187489] [INFO ] [MAIN ] Derivative Progress: 1355/2172 symbols completed. NEUE took 1.0s. Estimated remaining: 5m 6s. Rate: 160.1 symbols/min [2025-09-17T07:39:07.187938] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:07.201299] [DEBUG] [MAIN ] NEXA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:07.202126] [INFO ] [MAIN ] NEXA: Generated 1794 derivative records from 3859 primary records. [2025-09-17T07:39:07.202356] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-17T07:39:07.224798] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1794 records). [2025-09-17T07:39:07.225174] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-17T07:39:07.227605] [INFO ] [MAIN ] Derivative Progress: 1356/2172 symbols completed. NEXA took 1.0s. Estimated remaining: 5m 6s. Rate: 160.2 symbols/min [2025-09-17T07:39:07.228114] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:07.244086] [DEBUG] [LOCAL ] NFJ: Loaded 20515 existing records from primary storage. [2025-09-17T07:39:07.244256] [INFO ] [MAIN ] NFJ: Loaded 20515 primary data records. [2025-09-17T07:39:07.356884] [DEBUG] [LOCAL ] NFG: Loaded 38883 existing records from primary storage. [2025-09-17T07:39:07.405751] [INFO ] [MAIN ] NFG: Loaded 38883 primary data records. [2025-09-17T07:39:07.702237] [DEBUG] [LOCAL ] NGG: Loaded 46207 existing records from primary storage. [2025-09-17T07:39:07.730387] [INFO ] [MAIN ] NGG: Loaded 46207 primary data records. [2025-09-17T07:39:08.194560] [DEBUG] [MAIN ] NFJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:08.196360] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 20515 primary records. [2025-09-17T07:39:08.197829] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-17T07:39:08.229729] [DEBUG] [MAIN ] NFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:08.231377] [INFO ] [MAIN ] NFG: Generated 1794 derivative records from 38883 primary records. [2025-09-17T07:39:08.232862] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-17T07:39:08.233770] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-09-17T07:39:08.234877] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-17T07:39:08.237219] [INFO ] [MAIN ] Derivative Progress: 1357/2172 symbols completed. NFJ took 1.0s. Estimated remaining: 5m 6s. Rate: 160.0 symbols/min [2025-09-17T07:39:08.244993] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:08.256199] [DEBUG] [LOCAL ] NFG: Derivative data saved (1794 records). [2025-09-17T07:39:08.258035] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-17T07:39:08.260964] [INFO ] [MAIN ] Derivative Progress: 1358/2172 symbols completed. NFG took 1.1s. Estimated remaining: 5m 5s. Rate: 160.2 symbols/min [2025-09-17T07:39:08.261263] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:08.275690] [DEBUG] [MAIN ] NGG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:08.284301] [INFO ] [MAIN ] NGG: Generated 1794 derivative records from 46207 primary records. [2025-09-17T07:39:08.284731] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-17T07:39:08.316945] [DEBUG] [LOCAL ] NGL: Loaded 30328 existing records from primary storage. [2025-09-17T07:39:08.315724] [DEBUG] [LOCAL ] NGS: Loaded 11791 existing records from primary storage. [2025-09-17T07:39:08.318073] [INFO ] [MAIN ] NGS: Loaded 11791 primary data records. [2025-09-17T07:39:08.317101] [INFO ] [MAIN ] NGL: Loaded 30328 primary data records. [2025-09-17T07:39:08.318973] [DEBUG] [LOCAL ] NGG: Derivative data saved (1794 records). [2025-09-17T07:39:08.339367] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-17T07:39:08.382165] [INFO ] [MAIN ] Derivative Progress: 1359/2172 symbols completed. NGG took 1.2s. Estimated remaining: 5m 4s. Rate: 160.2 symbols/min [2025-09-17T07:39:08.430550] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:08.948883] [DEBUG] [LOCAL ] NGVC: Loaded 22399 existing records from primary storage. [2025-09-17T07:39:08.950253] [INFO ] [MAIN ] NGVC: Loaded 22399 primary data records. [2025-09-17T07:39:09.266028] [DEBUG] [MAIN ] NGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:09.266986] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11791 primary records. [2025-09-17T07:39:09.280199] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-17T07:39:09.280437] [DEBUG] [MAIN ] NGL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:09.281050] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 30328 primary records. [2025-09-17T07:39:09.281909] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-17T07:39:09.309521] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-09-17T07:39:09.311818] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-17T07:39:09.314637] [INFO ] [MAIN ] Derivative Progress: 1360/2172 symbols completed. NGS took 1.1s. Estimated remaining: 5m 4s. Rate: 160.1 symbols/min [2025-09-17T07:39:09.316457] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-09-17T07:39:09.316882] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:09.316714] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-17T07:39:09.320264] [INFO ] [MAIN ] Derivative Progress: 1361/2172 symbols completed. NGL took 1.1s. Estimated remaining: 5m 4s. Rate: 160.2 symbols/min [2025-09-17T07:39:09.322624] [INFO ] [MAIN ] NI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:09.337014] [DEBUG] [MAIN ] NGVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:09.337971] [INFO ] [MAIN ] NGVC: Generated 1794 derivative records from 22399 primary records. [2025-09-17T07:39:09.338152] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-17T07:39:09.367014] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1794 records). [2025-09-17T07:39:09.367634] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-17T07:39:09.367462] [DEBUG] [LOCAL ] NHI: Loaded 22187 existing records from primary storage. [2025-09-17T07:39:09.370432] [INFO ] [MAIN ] Derivative Progress: 1362/2172 symbols completed. NGVC took 0.9s. Estimated remaining: 5m 3s. Rate: 160.3 symbols/min [2025-09-17T07:39:09.370898] [INFO ] [MAIN ] NHI: Loaded 22187 primary data records. [2025-09-17T07:39:09.370956] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:09.582895] [DEBUG] [LOCAL ] NIC: Loaded 8892 existing records from primary storage. [2025-09-17T07:39:09.692871] [INFO ] [MAIN ] NIC: Loaded 8892 primary data records. [2025-09-17T07:39:09.694262] [DEBUG] [LOCAL ] NI: Loaded 53423 existing records from primary storage. [2025-09-17T07:39:09.694735] [INFO ] [MAIN ] NI: Loaded 53423 primary data records. [2025-09-17T07:39:10.357663] [DEBUG] [MAIN ] NHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:10.358564] [INFO ] [MAIN ] NHI: Generated 1794 derivative records from 22187 primary records. [2025-09-17T07:39:10.359194] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-17T07:39:10.379814] [DEBUG] [LOCAL ] NHI: Derivative data saved (1794 records). [2025-09-17T07:39:10.380266] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-17T07:39:10.392884] [DEBUG] [MAIN ] NIC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:10.396032] [INFO ] [MAIN ] Derivative Progress: 1363/2172 symbols completed. NHI took 1.1s. Estimated remaining: 5m 3s. Rate: 160.1 symbols/min [2025-09-17T07:39:10.393692] [INFO ] [MAIN ] NIC: Generated 1794 derivative records from 8892 primary records. [2025-09-17T07:39:10.397152] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-17T07:39:10.423848] [DEBUG] [MAIN ] NI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:10.425676] [INFO ] [MAIN ] NI: Generated 1794 derivative records from 53423 primary records. [2025-09-17T07:39:10.427320] [DEBUG] [LOCAL ] NIC: Derivative data saved (1794 records). [2025-09-17T07:39:10.426368] [DEBUG] [LOCAL ] NI: Saving derivative data. [2025-09-17T07:39:10.427446] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-17T07:39:10.429949] [INFO ] [MAIN ] Derivative Progress: 1364/2172 symbols completed. NIC took 1.1s. Estimated remaining: 5m 3s. Rate: 160.2 symbols/min [2025-09-17T07:39:10.444793] [DEBUG] [LOCAL ] NI: Derivative data saved (1794 records). [2025-09-17T07:39:10.444872] [INFO ] [MAIN ] NI: Successfully saved derivative data. [2025-09-17T07:39:10.447493] [INFO ] [MAIN ] Derivative Progress: 1365/2172 symbols completed. NI took 1.1s. Estimated remaining: 5m 2s. Rate: 160.3 symbols/min [2025-09-17T07:39:10.447995] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:10.448081] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:10.448175] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:10.457044] [DEBUG] [LOCAL ] NIM: Loaded 4172 existing records from primary storage. [2025-09-17T07:39:10.457386] [INFO ] [MAIN ] NIM: Loaded 4172 primary data records. [2025-09-17T07:39:10.585737] [DEBUG] [LOCAL ] NIE: Loaded 11665 existing records from primary storage. [2025-09-17T07:39:10.627349] [INFO ] [MAIN ] NIE: Loaded 11665 primary data records. [2025-09-17T07:39:10.636691] [DEBUG] [LOCAL ] NINE: Loaded 29103 existing records from primary storage. [2025-09-17T07:39:10.681058] [INFO ] [MAIN ] NINE: Loaded 29103 primary data records. [2025-09-17T07:39:11.433357] [DEBUG] [MAIN ] NIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:11.434434] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 4172 primary records. [2025-09-17T07:39:11.434851] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-17T07:39:11.451615] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-09-17T07:39:11.452491] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-17T07:39:11.456553] [INFO ] [MAIN ] Derivative Progress: 1366/2172 symbols completed. NIM took 1.0s. Estimated remaining: 5m 2s. Rate: 160.1 symbols/min [2025-09-17T07:39:11.457530] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:11.470313] [DEBUG] [MAIN ] NIE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:11.471135] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11665 primary records. [2025-09-17T07:39:11.471603] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-17T07:39:11.500687] [DEBUG] [MAIN ] NINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:11.503420] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 29103 primary records. [2025-09-17T07:39:11.504138] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-17T07:39:11.507498] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-09-17T07:39:11.515824] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-17T07:39:11.523146] [INFO ] [MAIN ] Derivative Progress: 1367/2172 symbols completed. NIE took 1.1s. Estimated remaining: 5m 2s. Rate: 160.2 symbols/min [2025-09-17T07:39:11.526203] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-09-17T07:39:11.526382] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:11.526701] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-17T07:39:11.529571] [INFO ] [MAIN ] Derivative Progress: 1368/2172 symbols completed. NINE took 1.1s. Estimated remaining: 5m 1s. Rate: 160.3 symbols/min [2025-09-17T07:39:11.529957] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:11.561142] [DEBUG] [LOCAL ] NKX: Loaded 13626 existing records from primary storage. [2025-09-17T07:39:11.577101] [INFO ] [MAIN ] NKX: Loaded 13626 primary data records. [2025-09-17T07:39:11.630904] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-09-17T07:39:11.665108] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-09-17T07:39:11.751694] [DEBUG] [LOCAL ] NJR: Loaded 37915 existing records from primary storage. [2025-09-17T07:39:11.803129] [INFO ] [MAIN ] NJR: Loaded 37915 primary data records. [2025-09-17T07:39:12.564388] [DEBUG] [MAIN ] NKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:12.566080] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13626 primary records. [2025-09-17T07:39:12.566275] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-17T07:39:12.597501] [DEBUG] [MAIN ] NIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:12.599006] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-09-17T07:39:12.599405] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-09-17T07:39:12.599687] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-17T07:39:12.599773] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-17T07:39:12.601730] [INFO ] [MAIN ] Derivative Progress: 1369/2172 symbols completed. NKX took 1.1s. Estimated remaining: 5m 1s. Rate: 160.1 symbols/min [2025-09-17T07:39:12.602834] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:12.621778] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-09-17T07:39:12.629735] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-17T07:39:12.640031] [INFO ] [MAIN ] Derivative Progress: 1370/2172 symbols completed. NIO took 1.2s. Estimated remaining: 5m 0s. Rate: 160.2 symbols/min [2025-09-17T07:39:12.637522] [DEBUG] [MAIN ] NJR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:12.640445] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:12.641324] [INFO ] [MAIN ] NJR: Generated 1794 derivative records from 37915 primary records. [2025-09-17T07:39:12.641561] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-17T07:39:12.647713] [DEBUG] [LOCAL ] NLOP: Loaded 11781 existing records from primary storage. [2025-09-17T07:39:12.648058] [INFO ] [MAIN ] NLOP: Loaded 11781 primary data records. [2025-09-17T07:39:12.830390] [DEBUG] [LOCAL ] NJR: Derivative data saved (1794 records). [2025-09-17T07:39:12.859766] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-17T07:39:12.877106] [INFO ] [MAIN ] Derivative Progress: 1371/2172 symbols completed. NJR took 1.4s. Estimated remaining: 4m 60s. Rate: 160.2 symbols/min [2025-09-17T07:39:12.978113] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:12.999881] [DEBUG] [LOCAL ] NLY: Loaded 53583 existing records from primary storage. [2025-09-17T07:39:13.004807] [INFO ] [MAIN ] NLY: Loaded 53583 primary data records. [2025-09-17T07:39:13.114103] [DEBUG] [LOCAL ] NMAI: Loaded 13188 existing records from primary storage. [2025-09-17T07:39:13.136129] [INFO ] [MAIN ] NMAI: Loaded 13188 primary data records. [2025-09-17T07:39:13.446709] [DEBUG] [MAIN ] NLOP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:13.451800] [INFO ] [MAIN ] NLOP: Generated 1794 derivative records from 11781 primary records. [2025-09-17T07:39:13.452813] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-17T07:39:13.556229] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1794 records). [2025-09-17T07:39:13.556554] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-17T07:39:13.682825] [INFO ] [MAIN ] Derivative Progress: 1372/2172 symbols completed. NLOP took 1.1s. Estimated remaining: 4m 60s. Rate: 160.1 symbols/min [2025-09-17T07:39:13.683252] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:13.705006] [DEBUG] [LOCAL ] NMCO: Loaded 16350 existing records from primary storage. [2025-09-17T07:39:13.717944] [INFO ] [MAIN ] NMCO: Loaded 16350 primary data records. [2025-09-17T07:39:13.718320] [DEBUG] [MAIN ] NLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:13.719274] [INFO ] [MAIN ] NLY: Generated 1794 derivative records from 53583 primary records. [2025-09-17T07:39:13.741143] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-17T07:39:13.857010] [DEBUG] [LOCAL ] NLY: Derivative data saved (1794 records). [2025-09-17T07:39:13.867634] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-17T07:39:13.909569] [DEBUG] [MAIN ] NMAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:13.924905] [INFO ] [MAIN ] Derivative Progress: 1373/2172 symbols completed. NLY took 1.3s. Estimated remaining: 4m 59s. Rate: 160.1 symbols/min [2025-09-17T07:39:13.925810] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 13188 primary records. [2025-09-17T07:39:14.053135] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-17T07:39:13.936484] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:14.076208] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-09-17T07:39:14.080468] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-17T07:39:14.083392] [INFO ] [MAIN ] Derivative Progress: 1374/2172 symbols completed. NMAI took 1.1s. Estimated remaining: 4m 59s. Rate: 160.2 symbols/min [2025-09-17T07:39:14.085718] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:14.080743] [DEBUG] [LOCAL ] NMG: Loaded 7359 existing records from primary storage. [2025-09-17T07:39:14.086114] [INFO ] [MAIN ] NMG: Loaded 7359 primary data records. [2025-09-17T07:39:14.193851] [DEBUG] [LOCAL ] NMI: Loaded 4088 existing records from primary storage. [2025-09-17T07:39:14.194519] [INFO ] [MAIN ] NMI: Loaded 4088 primary data records. [2025-09-17T07:39:14.726492] [DEBUG] [MAIN ] NMCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:14.727608] [INFO ] [MAIN ] NMCO: Generated 1794 derivative records from 16350 primary records. [2025-09-17T07:39:14.728112] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-17T07:39:14.746698] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1794 records). [2025-09-17T07:39:14.746937] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-17T07:39:14.748944] [INFO ] [MAIN ] Derivative Progress: 1375/2172 symbols completed. NMCO took 1.1s. Estimated remaining: 4m 59s. Rate: 160.1 symbols/min [2025-09-17T07:39:14.749435] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:14.768395] [DEBUG] [MAIN ] NMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:14.772845] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 7359 primary records. [2025-09-17T07:39:14.773697] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-17T07:39:14.805444] [DEBUG] [LOCAL ] NMM: Loaded 14418 existing records from primary storage. [2025-09-17T07:39:14.806964] [INFO ] [MAIN ] NMM: Loaded 14418 primary data records. [2025-09-17T07:39:14.807264] [DEBUG] [MAIN ] NMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:14.818845] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-09-17T07:39:14.828855] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4088 primary records. [2025-09-17T07:39:14.850903] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-17T07:39:14.862590] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-17T07:39:14.900857] [INFO ] [MAIN ] Derivative Progress: 1376/2172 symbols completed. NMG took 1.0s. Estimated remaining: 4m 58s. Rate: 160.2 symbols/min [2025-09-17T07:39:14.917795] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:15.008236] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-09-17T07:39:15.117673] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-17T07:39:15.122107] [INFO ] [MAIN ] Derivative Progress: 1377/2172 symbols completed. NMI took 1.0s. Estimated remaining: 4m 58s. Rate: 160.2 symbols/min [2025-09-17T07:39:15.122962] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:15.131694] [DEBUG] [LOCAL ] NMS: Loaded 2903 existing records from primary storage. [2025-09-17T07:39:15.140802] [INFO ] [MAIN ] NMS: Loaded 2903 primary data records. [2025-09-17T07:39:15.262048] [DEBUG] [LOCAL ] NMR: Loaded 35260 existing records from primary storage. [2025-09-17T07:39:15.284011] [INFO ] [MAIN ] NMR: Loaded 35260 primary data records. [2025-09-17T07:39:15.747826] [DEBUG] [MAIN ] NMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:15.749606] [INFO ] [MAIN ] NMM: Generated 1794 derivative records from 14418 primary records. [2025-09-17T07:39:15.749758] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-17T07:39:15.770791] [DEBUG] [LOCAL ] NMM: Derivative data saved (1794 records). [2025-09-17T07:39:15.771335] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-17T07:39:15.773710] [INFO ] [MAIN ] Derivative Progress: 1378/2172 symbols completed. NMM took 1.0s. Estimated remaining: 4m 57s. Rate: 160.1 symbols/min [2025-09-17T07:39:15.790822] [DEBUG] [MAIN ] NMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:15.791577] [INFO ] [MAIN ] NMS: Generated 1794 derivative records from 2903 primary records. [2025-09-17T07:39:15.791779] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-17T07:39:15.807957] [DEBUG] [LOCAL ] NMS: Derivative data saved (1794 records). [2025-09-17T07:39:15.808783] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-17T07:39:15.811451] [INFO ] [MAIN ] Derivative Progress: 1379/2172 symbols completed. NMS took 0.7s. Estimated remaining: 4m 57s. Rate: 160.3 symbols/min [2025-09-17T07:39:15.824357] [DEBUG] [MAIN ] NMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:15.825014] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 35260 primary records. [2025-09-17T07:39:15.825091] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-17T07:39:15.840018] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-09-17T07:39:15.840090] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-17T07:39:15.842700] [INFO ] [MAIN ] Derivative Progress: 1380/2172 symbols completed. NMR took 0.9s. Estimated remaining: 4m 56s. Rate: 160.4 symbols/min [2025-09-17T07:39:15.843220] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:15.843274] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:15.843427] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:15.855597] [DEBUG] [LOCAL ] NMT: Loaded 2822 existing records from primary storage. [2025-09-17T07:39:15.855831] [INFO ] [MAIN ] NMT: Loaded 2822 primary data records. [2025-09-17T07:39:15.951499] [DEBUG] [LOCAL ] NNI: Loaded 9793 existing records from primary storage. [2025-09-17T07:39:15.967984] [INFO ] [MAIN ] NNI: Loaded 9793 primary data records. [2025-09-17T07:39:16.072257] [DEBUG] [LOCAL ] NMZ: Loaded 21401 existing records from primary storage. [2025-09-17T07:39:16.252340] [INFO ] [MAIN ] NMZ: Loaded 21401 primary data records. [2025-09-17T07:39:16.800126] [DEBUG] [MAIN ] NMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:16.801028] [INFO ] [MAIN ] NMT: Generated 1794 derivative records from 2822 primary records. [2025-09-17T07:39:16.801253] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-17T07:39:16.829664] [DEBUG] [MAIN ] NNI: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:39:16.831802] [INFO ] [MAIN ] NNI: Generated 1793 derivative records from 9793 primary records. [2025-09-17T07:39:16.832255] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-17T07:39:16.832871] [DEBUG] [LOCAL ] NMT: Derivative data saved (1794 records). [2025-09-17T07:39:16.833876] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-17T07:39:16.836124] [INFO ] [MAIN ] Derivative Progress: 1381/2172 symbols completed. NMT took 1.0s. Estimated remaining: 4m 56s. Rate: 160.2 symbols/min [2025-09-17T07:39:16.836953] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:16.867716] [DEBUG] [LOCAL ] NNI: Derivative data saved (1793 records). [2025-09-17T07:39:16.867066] [DEBUG] [MAIN ] NMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:16.867926] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-17T07:39:16.870380] [INFO ] [MAIN ] Derivative Progress: 1382/2172 symbols completed. NNI took 1.0s. Estimated remaining: 4m 56s. Rate: 160.3 symbols/min [2025-09-17T07:39:16.870595] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:16.871443] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21401 primary records. [2025-09-17T07:39:16.872010] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-17T07:39:16.896932] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-09-17T07:39:16.897111] [DEBUG] [LOCAL ] NNY: Loaded 5701 existing records from primary storage. [2025-09-17T07:39:16.897370] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-17T07:39:16.900185] [INFO ] [MAIN ] Derivative Progress: 1383/2172 symbols completed. NMZ took 1.1s. Estimated remaining: 4m 55s. Rate: 160.4 symbols/min [2025-09-17T07:39:16.897431] [INFO ] [MAIN ] NNY: Loaded 5701 primary data records. [2025-09-17T07:39:16.900505] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:17.109837] [DEBUG] [LOCAL ] NNN: Loaded 48494 existing records from primary storage. [2025-09-17T07:39:17.113196] [INFO ] [MAIN ] NNN: Loaded 48494 primary data records. [2025-09-17T07:39:17.113505] [DEBUG] [LOCAL ] NOA: Loaded 16566 existing records from primary storage. [2025-09-17T07:39:17.223132] [INFO ] [MAIN ] NOA: Loaded 16566 primary data records. [2025-09-17T07:39:17.860794] [DEBUG] [MAIN ] NNY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:17.862307] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5701 primary records. [2025-09-17T07:39:17.862507] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-17T07:39:17.881223] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-09-17T07:39:17.882600] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-17T07:39:17.885287] [INFO ] [MAIN ] Derivative Progress: 1384/2172 symbols completed. NNY took 1.0s. Estimated remaining: 4m 55s. Rate: 160.2 symbols/min [2025-09-17T07:39:17.885923] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:17.904634] [DEBUG] [MAIN ] NNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:17.905985] [INFO ] [MAIN ] NNN: Generated 1794 derivative records from 48494 primary records. [2025-09-17T07:39:17.906173] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-17T07:39:17.931665] [DEBUG] [LOCAL ] NNN: Derivative data saved (1794 records). [2025-09-17T07:39:17.932198] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-17T07:39:17.936293] [INFO ] [MAIN ] Derivative Progress: 1385/2172 symbols completed. NNN took 1.1s. Estimated remaining: 4m 55s. Rate: 160.3 symbols/min [2025-09-17T07:39:17.962138] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:17.962992] [DEBUG] [MAIN ] NOA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:17.964739] [INFO ] [MAIN ] NOA: Generated 1794 derivative records from 16566 primary records. [2025-09-17T07:39:17.964838] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-17T07:39:17.965486] [DEBUG] [LOCAL ] NOAH: Loaded 20019 existing records from primary storage. [2025-09-17T07:39:17.966972] [INFO ] [MAIN ] NOAH: Loaded 20019 primary data records. [2025-09-17T07:39:18.120362] [DEBUG] [LOCAL ] NOA: Derivative data saved (1794 records). [2025-09-17T07:39:18.189560] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-17T07:39:18.194238] [INFO ] [MAIN ] Derivative Progress: 1386/2172 symbols completed. NOA took 1.3s. Estimated remaining: 4m 54s. Rate: 160.3 symbols/min [2025-09-17T07:39:18.358458] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:18.361035] [DEBUG] [LOCAL ] NOC: Loaded 42980 existing records from primary storage. [2025-09-17T07:39:18.362597] [INFO ] [MAIN ] NOC: Loaded 42980 primary data records. [2025-09-17T07:39:18.733092] [DEBUG] [MAIN ] NOAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:18.734081] [INFO ] [MAIN ] NOAH: Generated 1794 derivative records from 20019 primary records. [2025-09-17T07:39:18.734873] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-17T07:39:18.735959] [DEBUG] [LOCAL ] NOG: Loaded 51174 existing records from primary storage. [2025-09-17T07:39:18.737197] [INFO ] [MAIN ] NOG: Loaded 51174 primary data records. [2025-09-17T07:39:18.864416] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1794 records). [2025-09-17T07:39:18.865113] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-17T07:39:18.878180] [INFO ] [MAIN ] Derivative Progress: 1387/2172 symbols completed. NOAH took 1.0s. Estimated remaining: 4m 54s. Rate: 160.2 symbols/min [2025-09-17T07:39:18.946369] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:19.083024] [DEBUG] [MAIN ] NOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:19.084430] [INFO ] [MAIN ] NOC: Generated 1794 derivative records from 42980 primary records. [2025-09-17T07:39:19.085495] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-17T07:39:19.106004] [DEBUG] [LOCAL ] NOC: Derivative data saved (1794 records). [2025-09-17T07:39:19.106090] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-17T07:39:19.109379] [INFO ] [MAIN ] Derivative Progress: 1388/2172 symbols completed. NOC took 1.1s. Estimated remaining: 4m 53s. Rate: 160.3 symbols/min [2025-09-17T07:39:19.110335] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:19.140915] [DEBUG] [MAIN ] NOG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:19.141736] [INFO ] [MAIN ] NOG: Generated 1794 derivative records from 51174 primary records. [2025-09-17T07:39:19.141882] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-17T07:39:19.173459] [DEBUG] [LOCAL ] NOG: Derivative data saved (1794 records). [2025-09-17T07:39:19.173663] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-17T07:39:19.177142] [INFO ] [MAIN ] Derivative Progress: 1389/2172 symbols completed. NOG took 0.8s. Estimated remaining: 4m 53s. Rate: 160.4 symbols/min [2025-09-17T07:39:19.174433] [DEBUG] [LOCAL ] NOK: Loaded 53620 existing records from primary storage. [2025-09-17T07:39:19.177706] [INFO ] [MAIN ] NOK: Loaded 53620 primary data records. [2025-09-17T07:39:19.177620] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:19.350188] [DEBUG] [LOCAL ] NOMD: Loaded 41377 existing records from primary storage. [2025-09-17T07:39:19.378249] [INFO ] [MAIN ] NOMD: Loaded 41377 primary data records. [2025-09-17T07:39:19.641597] [DEBUG] [LOCAL ] NOTE: Loaded 43642 existing records from primary storage. [2025-09-17T07:39:19.693633] [INFO ] [MAIN ] NOTE: Loaded 43642 primary data records. [2025-09-17T07:39:20.248778] [DEBUG] [MAIN ] NOK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:20.250555] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53620 primary records. [2025-09-17T07:39:20.250885] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-17T07:39:20.273993] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-09-17T07:39:20.274395] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-17T07:39:20.277119] [INFO ] [MAIN ] Derivative Progress: 1390/2172 symbols completed. NOK took 1.3s. Estimated remaining: 4m 53s. Rate: 160.1 symbols/min [2025-09-17T07:39:20.277673] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:20.291630] [DEBUG] [MAIN ] NOMD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:20.292924] [INFO ] [MAIN ] NOMD: Generated 1794 derivative records from 41377 primary records. [2025-09-17T07:39:20.293287] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-17T07:39:20.314274] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1794 records). [2025-09-17T07:39:20.314409] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-17T07:39:20.317036] [INFO ] [MAIN ] Derivative Progress: 1391/2172 symbols completed. NOMD took 1.2s. Estimated remaining: 4m 52s. Rate: 160.3 symbols/min [2025-09-17T07:39:20.330228] [INFO ] [MAIN ] NOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:20.332009] [DEBUG] [MAIN ] NOTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:20.333218] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 43642 primary records. [2025-09-17T07:39:20.333600] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-17T07:39:20.349306] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-09-17T07:39:20.363581] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-17T07:39:20.368293] [INFO ] [MAIN ] Derivative Progress: 1392/2172 symbols completed. NOTE took 1.2s. Estimated remaining: 4m 52s. Rate: 160.3 symbols/min [2025-09-17T07:39:20.368894] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:20.392679] [DEBUG] [LOCAL ] NOV: Loaded 53201 existing records from primary storage. [2025-09-17T07:39:20.393025] [INFO ] [MAIN ] NOV: Loaded 53201 primary data records. [2025-09-17T07:39:20.557390] [DEBUG] [LOCAL ] NOW: Loaded 49012 existing records from primary storage. [2025-09-17T07:39:20.577804] [INFO ] [MAIN ] NOW: Loaded 49012 primary data records. [2025-09-17T07:39:20.586760] [DEBUG] [LOCAL ] NPCT: Loaded 17213 existing records from primary storage. [2025-09-17T07:39:20.742346] [INFO ] [MAIN ] NPCT: Loaded 17213 primary data records. [2025-09-17T07:39:21.360549] [DEBUG] [MAIN ] NOV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:21.361855] [INFO ] [MAIN ] NOV: Generated 1794 derivative records from 53201 primary records. [2025-09-17T07:39:21.362361] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-17T07:39:21.379275] [DEBUG] [LOCAL ] NOV: Derivative data saved (1794 records). [2025-09-17T07:39:21.380296] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-17T07:39:21.383267] [INFO ] [MAIN ] Derivative Progress: 1393/2172 symbols completed. NOV took 1.1s. Estimated remaining: 4m 52s. Rate: 160.2 symbols/min [2025-09-17T07:39:21.398320] [DEBUG] [MAIN ] NOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:21.399026] [INFO ] [MAIN ] NOW: Generated 1794 derivative records from 49012 primary records. [2025-09-17T07:39:21.399217] [DEBUG] [LOCAL ] NOW: Saving derivative data. [2025-09-17T07:39:21.411498] [DEBUG] [MAIN ] NPCT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:21.412257] [INFO ] [MAIN ] NPCT: Generated 1794 derivative records from 17213 primary records. [2025-09-17T07:39:21.412533] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-17T07:39:21.441790] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1794 records). [2025-09-17T07:39:21.442515] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-17T07:39:21.442781] [DEBUG] [LOCAL ] NOW: Derivative data saved (1794 records). [2025-09-17T07:39:21.445178] [INFO ] [MAIN ] Derivative Progress: 1394/2172 symbols completed. NPCT took 1.1s. Estimated remaining: 4m 51s. Rate: 160.2 symbols/min [2025-09-17T07:39:21.445245] [INFO ] [MAIN ] NOW: Successfully saved derivative data. [2025-09-17T07:39:21.447996] [INFO ] [MAIN ] Derivative Progress: 1395/2172 symbols completed. NOW took 1.1s. Estimated remaining: 4m 51s. Rate: 160.4 symbols/min [2025-09-17T07:39:21.448676] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:21.448947] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:21.449100] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:21.469722] [DEBUG] [LOCAL ] NPK: Loaded 8172 existing records from primary storage. [2025-09-17T07:39:21.469925] [INFO ] [MAIN ] NPK: Loaded 8172 primary data records. [2025-09-17T07:39:21.556722] [DEBUG] [LOCAL ] NPFD: Loaded 9755 existing records from primary storage. [2025-09-17T07:39:21.545072] [DEBUG] [LOCAL ] NPO: Loaded 12893 existing records from primary storage. [2025-09-17T07:39:21.580964] [INFO ] [MAIN ] NPO: Loaded 12893 primary data records. [2025-09-17T07:39:21.580885] [INFO ] [MAIN ] NPFD: Loaded 9755 primary data records. [2025-09-17T07:39:22.457098] [DEBUG] [MAIN ] NPK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:22.470821] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8172 primary records. [2025-09-17T07:39:22.470992] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-17T07:39:22.472882] [DEBUG] [MAIN ] NPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:22.481981] [INFO ] [MAIN ] NPO: Generated 1794 derivative records from 12893 primary records. [2025-09-17T07:39:22.497752] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-17T07:39:22.502966] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-09-17T07:39:22.503232] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-17T07:39:22.501413] [DEBUG] [MAIN ] NPFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:22.513597] [INFO ] [MAIN ] Derivative Progress: 1396/2172 symbols completed. NPK took 1.1s. Estimated remaining: 4m 51s. Rate: 160.2 symbols/min [2025-09-17T07:39:22.518994] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:22.518577] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 9755 primary records. [2025-09-17T07:39:22.519449] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-17T07:39:22.537520] [DEBUG] [LOCAL ] NPO: Derivative data saved (1794 records). [2025-09-17T07:39:22.538659] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-17T07:39:22.544741] [INFO ] [MAIN ] Derivative Progress: 1397/2172 symbols completed. NPO took 1.1s. Estimated remaining: 4m 50s. Rate: 160.3 symbols/min [2025-09-17T07:39:22.545797] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:22.546116] [DEBUG] [LOCAL ] NPV: Loaded 4978 existing records from primary storage. [2025-09-17T07:39:22.546883] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-09-17T07:39:22.547318] [INFO ] [MAIN ] NPV: Loaded 4978 primary data records. [2025-09-17T07:39:22.547495] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-17T07:39:22.580425] [INFO ] [MAIN ] Derivative Progress: 1398/2172 symbols completed. NPFD took 1.1s. Estimated remaining: 4m 50s. Rate: 160.4 symbols/min [2025-09-17T07:39:22.624018] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:22.839675] [DEBUG] [LOCAL ] NQP: Loaded 9175 existing records from primary storage. [2025-09-17T07:39:22.853820] [INFO ] [MAIN ] NQP: Loaded 9175 primary data records. [2025-09-17T07:39:22.945773] [DEBUG] [LOCAL ] NPWR: Loaded 42970 existing records from primary storage. [2025-09-17T07:39:22.972688] [INFO ] [MAIN ] NPWR: Loaded 42970 primary data records. [2025-09-17T07:39:23.484884] [DEBUG] [MAIN ] NPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:23.486748] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 4978 primary records. [2025-09-17T07:39:23.486875] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-17T07:39:23.507067] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-09-17T07:39:23.507307] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-17T07:39:23.510891] [INFO ] [MAIN ] Derivative Progress: 1399/2172 symbols completed. NPV took 1.0s. Estimated remaining: 4m 50s. Rate: 160.2 symbols/min [2025-09-17T07:39:23.512457] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:23.529977] [DEBUG] [MAIN ] NQP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:23.531082] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9175 primary records. [2025-09-17T07:39:23.543579] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-17T07:39:23.543885] [DEBUG] [MAIN ] NPWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:23.544682] [INFO ] [MAIN ] NPWR: Generated 1794 derivative records from 42970 primary records. [2025-09-17T07:39:23.546007] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-17T07:39:23.579052] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1794 records). [2025-09-17T07:39:23.579531] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-17T07:39:23.582710] [INFO ] [MAIN ] Derivative Progress: 1400/2172 symbols completed. NPWR took 1.0s. Estimated remaining: 4m 49s. Rate: 160.3 symbols/min [2025-09-17T07:39:23.595194] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:23.596837] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-09-17T07:39:23.597422] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-17T07:39:23.600709] [INFO ] [MAIN ] Derivative Progress: 1401/2172 symbols completed. NQP took 1.0s. Estimated remaining: 4m 48s. Rate: 160.4 symbols/min [2025-09-17T07:39:23.601341] [INFO ] [MAIN ] NRG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:23.621781] [DEBUG] [LOCAL ] NRDY: Loaded 33381 existing records from primary storage. [2025-09-17T07:39:23.622068] [INFO ] [MAIN ] NRDY: Loaded 33381 primary data records. [2025-09-17T07:39:23.626061] [DEBUG] [LOCAL ] NREF: Loaded 7779 existing records from primary storage. [2025-09-17T07:39:23.641611] [INFO ] [MAIN ] NREF: Loaded 7779 primary data records. [2025-09-17T07:39:24.298958] [DEBUG] [LOCAL ] NRG: Loaded 52949 existing records from primary storage. [2025-09-17T07:39:24.299545] [INFO ] [MAIN ] NRG: Loaded 52949 primary data records. [2025-09-17T07:39:24.659377] [DEBUG] [MAIN ] NRDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:24.658942] [DEBUG] [MAIN ] NREF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:24.660600] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 33381 primary records. [2025-09-17T07:39:24.661303] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 7779 primary records. [2025-09-17T07:39:24.661368] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-17T07:39:24.662750] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-17T07:39:24.702285] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-09-17T07:39:24.702510] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-17T07:39:24.704883] [INFO ] [MAIN ] Derivative Progress: 1402/2172 symbols completed. NREF took 1.1s. Estimated remaining: 4m 48s. Rate: 160.2 symbols/min [2025-09-17T07:39:24.707744] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:24.712070] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-09-17T07:39:24.712319] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-17T07:39:24.715427] [INFO ] [MAIN ] Derivative Progress: 1403/2172 symbols completed. NRDY took 1.2s. Estimated remaining: 4m 48s. Rate: 160.3 symbols/min [2025-09-17T07:39:24.716242] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:24.741439] [DEBUG] [MAIN ] NRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:24.742725] [INFO ] [MAIN ] NRG: Generated 1794 derivative records from 52949 primary records. [2025-09-17T07:39:24.743078] [DEBUG] [LOCAL ] NRG: Saving derivative data. [2025-09-17T07:39:24.766628] [DEBUG] [LOCAL ] NRG: Derivative data saved (1794 records). [2025-09-17T07:39:24.766809] [INFO ] [MAIN ] NRG: Successfully saved derivative data. [2025-09-17T07:39:24.769472] [INFO ] [MAIN ] Derivative Progress: 1404/2172 symbols completed. NRG took 1.2s. Estimated remaining: 4m 47s. Rate: 160.4 symbols/min [2025-09-17T07:39:24.769910] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:24.786762] [DEBUG] [LOCAL ] NRK: Loaded 19390 existing records from primary storage. [2025-09-17T07:39:24.788322] [INFO ] [MAIN ] NRK: Loaded 19390 primary data records. [2025-09-17T07:39:24.846592] [DEBUG] [LOCAL ] NRP: Loaded 4166 existing records from primary storage. [2025-09-17T07:39:24.878566] [INFO ] [MAIN ] NRP: Loaded 4166 primary data records. [2025-09-17T07:39:24.943386] [DEBUG] [LOCAL ] NRGV: Loaded 42570 existing records from primary storage. [2025-09-17T07:39:24.981714] [INFO ] [MAIN ] NRGV: Loaded 42570 primary data records. [2025-09-17T07:39:25.782151] [DEBUG] [MAIN ] NRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:25.781836] [DEBUG] [MAIN ] NRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:25.783893] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 19390 primary records. [2025-09-17T07:39:25.784505] [INFO ] [MAIN ] NRP: Generated 1794 derivative records from 4166 primary records. [2025-09-17T07:39:25.784812] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-17T07:39:25.784691] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-17T07:39:25.797849] [DEBUG] [MAIN ] NRGV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:25.817608] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 42570 primary records. [2025-09-17T07:39:25.824071] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-17T07:39:25.836512] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-09-17T07:39:25.842869] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-17T07:39:25.844385] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-09-17T07:39:25.845187] [DEBUG] [LOCAL ] NRP: Derivative data saved (1794 records). [2025-09-17T07:39:25.848205] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-17T07:39:25.848425] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-17T07:39:25.848035] [INFO ] [MAIN ] Derivative Progress: 1405/2172 symbols completed. NRK took 1.1s. Estimated remaining: 4m 47s. Rate: 160.2 symbols/min [2025-09-17T07:39:25.854930] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:25.855134] [INFO ] [MAIN ] Derivative Progress: 1406/2172 symbols completed. NRGV took 1.1s. Estimated remaining: 4m 47s. Rate: 160.3 symbols/min [2025-09-17T07:39:25.855577] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:25.855669] [INFO ] [MAIN ] Derivative Progress: 1407/2172 symbols completed. NRP took 1.1s. Estimated remaining: 4m 46s. Rate: 160.4 symbols/min [2025-09-17T07:39:25.856208] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:25.865155] [DEBUG] [LOCAL ] NRUC: Loaded 3116 existing records from primary storage. [2025-09-17T07:39:25.867721] [DEBUG] [LOCAL ] NRT: Loaded 4956 existing records from primary storage. [2025-09-17T07:39:25.867938] [INFO ] [MAIN ] NRT: Loaded 4956 primary data records. [2025-09-17T07:39:25.867879] [INFO ] [MAIN ] NRUC: Loaded 3116 primary data records. [2025-09-17T07:39:26.504414] [DEBUG] [LOCAL ] NSA: Loaded 44838 existing records from primary storage. [2025-09-17T07:39:26.506214] [INFO ] [MAIN ] NSA: Loaded 44838 primary data records. [2025-09-17T07:39:26.846872] [DEBUG] [MAIN ] NRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:26.847289] [DEBUG] [MAIN ] NRUC: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:39:26.848072] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4956 primary records. [2025-09-17T07:39:26.848583] [INFO ] [MAIN ] NRUC: Generated 1792 derivative records from 3116 primary records. [2025-09-17T07:39:26.849130] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-17T07:39:26.849090] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-17T07:39:26.880398] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-09-17T07:39:26.881749] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-17T07:39:26.884354] [INFO ] [MAIN ] Derivative Progress: 1408/2172 symbols completed. NRT took 1.0s. Estimated remaining: 4m 46s. Rate: 160.2 symbols/min [2025-09-17T07:39:26.889373] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1792 records). [2025-09-17T07:39:26.889556] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-17T07:39:26.892161] [INFO ] [MAIN ] Derivative Progress: 1409/2172 symbols completed. NRUC took 1.0s. Estimated remaining: 4m 46s. Rate: 160.3 symbols/min [2025-09-17T07:39:26.918584] [DEBUG] [MAIN ] NSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:26.919897] [INFO ] [MAIN ] NSA: Generated 1794 derivative records from 44838 primary records. [2025-09-17T07:39:26.920019] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-17T07:39:26.941715] [DEBUG] [LOCAL ] NSA: Derivative data saved (1794 records). [2025-09-17T07:39:26.941941] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-17T07:39:26.945708] [INFO ] [MAIN ] Derivative Progress: 1410/2172 symbols completed. NSA took 1.1s. Estimated remaining: 4m 45s. Rate: 160.4 symbols/min [2025-09-17T07:39:26.946374] [INFO ] [MAIN ] NSC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:26.946602] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:26.946768] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:26.971375] [DEBUG] [LOCAL ] NTB: Loaded 20891 existing records from primary storage. [2025-09-17T07:39:26.971592] [INFO ] [MAIN ] NTB: Loaded 20891 primary data records. [2025-09-17T07:39:27.177004] [DEBUG] [LOCAL ] NSP: Loaded 34941 existing records from primary storage. [2025-09-17T07:39:27.192910] [INFO ] [MAIN ] NSP: Loaded 34941 primary data records. [2025-09-17T07:39:27.303149] [DEBUG] [LOCAL ] NSC: Loaded 49164 existing records from primary storage. [2025-09-17T07:39:27.335222] [INFO ] [MAIN ] NSC: Loaded 49164 primary data records. [2025-09-17T07:39:28.041750] [DEBUG] [MAIN ] NTB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:28.043275] [INFO ] [MAIN ] NTB: Generated 1794 derivative records from 20891 primary records. [2025-09-17T07:39:28.043778] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-17T07:39:28.064978] [DEBUG] [LOCAL ] NTB: Derivative data saved (1794 records). [2025-09-17T07:39:28.065596] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-17T07:39:28.080940] [DEBUG] [MAIN ] NSP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:28.080412] [INFO ] [MAIN ] Derivative Progress: 1411/2172 symbols completed. NTB took 1.1s. Estimated remaining: 4m 45s. Rate: 160.2 symbols/min [2025-09-17T07:39:28.081961] [INFO ] [MAIN ] NSP: Generated 1794 derivative records from 34941 primary records. [2025-09-17T07:39:28.082434] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-17T07:39:28.082234] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:28.100067] [DEBUG] [LOCAL ] NSP: Derivative data saved (1794 records). [2025-09-17T07:39:28.101687] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-17T07:39:28.103954] [INFO ] [MAIN ] Derivative Progress: 1412/2172 symbols completed. NSP took 1.2s. Estimated remaining: 4m 45s. Rate: 160.3 symbols/min [2025-09-17T07:39:28.104375] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:28.117952] [DEBUG] [MAIN ] NSC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:28.118714] [INFO ] [MAIN ] NSC: Generated 1794 derivative records from 49164 primary records. [2025-09-17T07:39:28.118833] [DEBUG] [LOCAL ] NSC: Saving derivative data. [2025-09-17T07:39:28.136175] [DEBUG] [LOCAL ] NSC: Derivative data saved (1794 records). [2025-09-17T07:39:28.139369] [INFO ] [MAIN ] NSC: Successfully saved derivative data. [2025-09-17T07:39:28.141973] [INFO ] [MAIN ] Derivative Progress: 1413/2172 symbols completed. NSC took 1.2s. Estimated remaining: 4m 44s. Rate: 160.4 symbols/min [2025-09-17T07:39:28.142318] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:28.188721] [DEBUG] [LOCAL ] NTR: Loaded 52624 existing records from primary storage. [2025-09-17T07:39:28.200666] [INFO ] [MAIN ] NTR: Loaded 52624 primary data records. [2025-09-17T07:39:28.201329] [DEBUG] [LOCAL ] NTST: Loaded 43393 existing records from primary storage. [2025-09-17T07:39:28.216792] [INFO ] [MAIN ] NTST: Loaded 43393 primary data records. [2025-09-17T07:39:28.556892] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-17T07:39:28.695663] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-09-17T07:39:29.140138] [DEBUG] [MAIN ] NTST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:29.152750] [DEBUG] [MAIN ] NTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:29.153433] [INFO ] [MAIN ] NTST: Generated 1794 derivative records from 43393 primary records. [2025-09-17T07:39:29.154072] [INFO ] [MAIN ] NTR: Generated 1794 derivative records from 52624 primary records. [2025-09-17T07:39:29.155042] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-17T07:39:29.155113] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-17T07:39:29.183258] [DEBUG] [LOCAL ] NTR: Derivative data saved (1794 records). [2025-09-17T07:39:29.184815] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-17T07:39:29.187959] [INFO ] [MAIN ] Derivative Progress: 1414/2172 symbols completed. NTR took 1.1s. Estimated remaining: 4m 44s. Rate: 160.2 symbols/min [2025-09-17T07:39:29.188329] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:29.190156] [DEBUG] [LOCAL ] NTST: Derivative data saved (1794 records). [2025-09-17T07:39:29.190357] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-17T07:39:29.193120] [INFO ] [MAIN ] Derivative Progress: 1415/2172 symbols completed. NTST took 1.1s. Estimated remaining: 4m 43s. Rate: 160.3 symbols/min [2025-09-17T07:39:29.193746] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:29.210305] [DEBUG] [MAIN ] NU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:29.211029] [INFO ] [MAIN ] NU: Generated 1794 derivative records from 53746 primary records. [2025-09-17T07:39:29.211105] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-17T07:39:29.232312] [DEBUG] [LOCAL ] NU: Derivative data saved (1794 records). [2025-09-17T07:39:29.232578] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-17T07:39:29.235418] [INFO ] [MAIN ] Derivative Progress: 1416/2172 symbols completed. NU took 1.1s. Estimated remaining: 4m 43s. Rate: 160.4 symbols/min [2025-09-17T07:39:29.235970] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:29.254270] [DEBUG] [LOCAL ] NUV: Loaded 23052 existing records from primary storage. [2025-09-17T07:39:29.254489] [INFO ] [MAIN ] NUV: Loaded 23052 primary data records. [2025-09-17T07:39:29.381451] [DEBUG] [LOCAL ] NUS: Loaded 36492 existing records from primary storage. [2025-09-17T07:39:29.421253] [INFO ] [MAIN ] NUS: Loaded 36492 primary data records. [2025-09-17T07:39:29.687041] [DEBUG] [LOCAL ] NUVB: Loaded 51136 existing records from primary storage. [2025-09-17T07:39:29.711036] [INFO ] [MAIN ] NUVB: Loaded 51136 primary data records. [2025-09-17T07:39:30.273260] [DEBUG] [MAIN ] NUV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:30.274059] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23052 primary records. [2025-09-17T07:39:30.275320] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-17T07:39:30.301904] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-09-17T07:39:30.307106] [DEBUG] [MAIN ] NUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:30.307211] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-17T07:39:30.307847] [INFO ] [MAIN ] NUS: Generated 1794 derivative records from 36492 primary records. [2025-09-17T07:39:30.308195] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-17T07:39:30.310585] [INFO ] [MAIN ] Derivative Progress: 1417/2172 symbols completed. NUV took 1.1s. Estimated remaining: 4m 43s. Rate: 160.2 symbols/min [2025-09-17T07:39:30.310971] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:30.344662] [DEBUG] [LOCAL ] NUS: Derivative data saved (1794 records). [2025-09-17T07:39:30.348397] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-17T07:39:30.348284] [DEBUG] [MAIN ] NUVB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:30.348978] [DEBUG] [LOCAL ] NUW: Loaded 7444 existing records from primary storage. [2025-09-17T07:39:30.349688] [INFO ] [MAIN ] NUVB: Generated 1794 derivative records from 51136 primary records. [2025-09-17T07:39:30.349905] [INFO ] [MAIN ] NUW: Loaded 7444 primary data records. [2025-09-17T07:39:30.352583] [INFO ] [MAIN ] Derivative Progress: 1418/2172 symbols completed. NUS took 1.2s. Estimated remaining: 4m 42s. Rate: 160.3 symbols/min [2025-09-17T07:39:30.352846] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:30.349957] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-17T07:39:30.480158] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1794 records). [2025-09-17T07:39:30.552177] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-17T07:39:30.554929] [INFO ] [MAIN ] Derivative Progress: 1419/2172 symbols completed. NUVB took 1.3s. Estimated remaining: 4m 42s. Rate: 160.3 symbols/min [2025-09-17T07:39:30.665824] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:30.676979] [DEBUG] [LOCAL ] NVG: Loaded 27231 existing records from primary storage. [2025-09-17T07:39:30.677312] [INFO ] [MAIN ] NVG: Loaded 27231 primary data records. [2025-09-17T07:39:30.991929] [DEBUG] [LOCAL ] NVGS: Loaded 31402 existing records from primary storage. [2025-09-17T07:39:30.992839] [INFO ] [MAIN ] NVGS: Loaded 31402 primary data records. [2025-09-17T07:39:31.112812] [DEBUG] [MAIN ] NUW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:31.162671] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 7444 primary records. [2025-09-17T07:39:31.289171] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-17T07:39:31.330525] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-09-17T07:39:31.345417] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-17T07:39:31.346070] [DEBUG] [MAIN ] NVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:31.348383] [INFO ] [MAIN ] Derivative Progress: 1420/2172 symbols completed. NUW took 1.0s. Estimated remaining: 4m 42s. Rate: 160.2 symbols/min [2025-09-17T07:39:31.349372] [INFO ] [MAIN ] NVG: Generated 1794 derivative records from 27231 primary records. [2025-09-17T07:39:31.349828] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-17T07:39:31.350503] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:31.385331] [DEBUG] [MAIN ] NVGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:31.385402] [DEBUG] [LOCAL ] NVG: Derivative data saved (1794 records). [2025-09-17T07:39:31.386162] [INFO ] [MAIN ] NVGS: Generated 1794 derivative records from 31402 primary records. [2025-09-17T07:39:31.386269] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-17T07:39:31.388944] [INFO ] [MAIN ] Derivative Progress: 1421/2172 symbols completed. NVG took 1.0s. Estimated remaining: 4m 41s. Rate: 160.3 symbols/min [2025-09-17T07:39:31.389075] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-17T07:39:31.389389] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:31.406844] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1794 records). [2025-09-17T07:39:31.406970] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-17T07:39:31.409266] [INFO ] [MAIN ] Derivative Progress: 1422/2172 symbols completed. NVGS took 0.8s. Estimated remaining: 4m 41s. Rate: 160.4 symbols/min [2025-09-17T07:39:31.410046] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:31.441603] [DEBUG] [LOCAL ] NVR: Loaded 19506 existing records from primary storage. [2025-09-17T07:39:31.441954] [INFO ] [MAIN ] NVR: Loaded 19506 primary data records. [2025-09-17T07:39:31.567895] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-17T07:39:31.568153] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-09-17T07:39:31.857941] [DEBUG] [LOCAL ] NVRI: Loaded 38963 existing records from primary storage. [2025-09-17T07:39:31.879102] [INFO ] [MAIN ] NVRI: Loaded 38963 primary data records. [2025-09-17T07:39:32.436476] [DEBUG] [MAIN ] NVR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:39:32.438249] [INFO ] [MAIN ] NVR: Generated 1793 derivative records from 19506 primary records. [2025-09-17T07:39:32.438467] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-17T07:39:32.456714] [DEBUG] [LOCAL ] NVR: Derivative data saved (1793 records). [2025-09-17T07:39:32.457751] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-17T07:39:32.459930] [INFO ] [MAIN ] Derivative Progress: 1423/2172 symbols completed. NVR took 1.1s. Estimated remaining: 4m 41s. Rate: 160.2 symbols/min [2025-09-17T07:39:32.477258] [DEBUG] [MAIN ] NVO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:32.477925] [INFO ] [MAIN ] NVO: Generated 1794 derivative records from 53784 primary records. [2025-09-17T07:39:32.478139] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-17T07:39:32.508596] [DEBUG] [MAIN ] NVRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:32.508667] [DEBUG] [LOCAL ] NVO: Derivative data saved (1794 records). [2025-09-17T07:39:32.509365] [INFO ] [MAIN ] NVRI: Generated 1794 derivative records from 38963 primary records. [2025-09-17T07:39:32.509419] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-17T07:39:32.512066] [INFO ] [MAIN ] Derivative Progress: 1424/2172 symbols completed. NVO took 1.2s. Estimated remaining: 4m 40s. Rate: 160.3 symbols/min [2025-09-17T07:39:32.509513] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-17T07:39:32.527484] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1794 records). [2025-09-17T07:39:32.527562] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-17T07:39:32.530183] [INFO ] [MAIN ] Derivative Progress: 1425/2172 symbols completed. NVRI took 1.1s. Estimated remaining: 4m 39s. Rate: 160.4 symbols/min [2025-09-17T07:39:32.530757] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:32.530595] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:32.530846] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:32.611166] [DEBUG] [LOCAL ] NVT: Loaded 51625 existing records from primary storage. [2025-09-17T07:39:32.611390] [INFO ] [MAIN ] NVT: Loaded 51625 primary data records. [2025-09-17T07:39:32.681617] [DEBUG] [LOCAL ] NVST: Loaded 51696 existing records from primary storage. [2025-09-17T07:39:32.706971] [INFO ] [MAIN ] NVST: Loaded 51696 primary data records. [2025-09-17T07:39:32.807336] [DEBUG] [LOCAL ] NVS: Loaded 51723 existing records from primary storage. [2025-09-17T07:39:32.853501] [INFO ] [MAIN ] NVS: Loaded 51723 primary data records. [2025-09-17T07:39:33.549935] [DEBUG] [MAIN ] NVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:33.552251] [INFO ] [MAIN ] NVT: Generated 1794 derivative records from 51625 primary records. [2025-09-17T07:39:33.552681] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-17T07:39:33.572758] [DEBUG] [LOCAL ] NVT: Derivative data saved (1794 records). [2025-09-17T07:39:33.573716] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-17T07:39:33.588118] [INFO ] [MAIN ] Derivative Progress: 1426/2172 symbols completed. NVT took 1.1s. Estimated remaining: 4m 39s. Rate: 160.2 symbols/min [2025-09-17T07:39:33.589513] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:33.589778] [DEBUG] [MAIN ] NVST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:33.590820] [INFO ] [MAIN ] NVST: Generated 1794 derivative records from 51696 primary records. [2025-09-17T07:39:33.603245] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-17T07:39:33.603765] [DEBUG] [MAIN ] NVS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:33.605228] [INFO ] [MAIN ] NVS: Generated 1794 derivative records from 51723 primary records. [2025-09-17T07:39:33.605515] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-17T07:39:33.636232] [DEBUG] [LOCAL ] NVST: Derivative data saved (1794 records). [2025-09-17T07:39:33.637574] [DEBUG] [LOCAL ] NVS: Derivative data saved (1794 records). [2025-09-17T07:39:33.637942] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-17T07:39:33.637762] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-17T07:39:33.640552] [INFO ] [MAIN ] Derivative Progress: 1427/2172 symbols completed. NVST took 1.1s. Estimated remaining: 4m 39s. Rate: 160.3 symbols/min [2025-09-17T07:39:33.643236] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:33.643306] [INFO ] [MAIN ] Derivative Progress: 1428/2172 symbols completed. NVS took 1.1s. Estimated remaining: 4m 38s. Rate: 160.4 symbols/min [2025-09-17T07:39:33.643782] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:33.703465] [DEBUG] [LOCAL ] NWG: Loaded 51721 existing records from primary storage. [2025-09-17T07:39:33.704043] [INFO ] [MAIN ] NWG: Loaded 51721 primary data records. [2025-09-17T07:39:33.703961] [DEBUG] [LOCAL ] NWN: Loaded 26946 existing records from primary storage. [2025-09-17T07:39:33.704231] [INFO ] [MAIN ] NWN: Loaded 26946 primary data records. [2025-09-17T07:39:33.838380] [DEBUG] [LOCAL ] NX: Loaded 33431 existing records from primary storage. [2025-09-17T07:39:33.904864] [INFO ] [MAIN ] NX: Loaded 33431 primary data records. [2025-09-17T07:39:34.662709] [DEBUG] [MAIN ] NWN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:39:34.663397] [INFO ] [MAIN ] NWN: Generated 1793 derivative records from 26946 primary records. [2025-09-17T07:39:34.663701] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-17T07:39:34.677431] [DEBUG] [MAIN ] NWG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:34.687076] [INFO ] [MAIN ] NWG: Generated 1794 derivative records from 51721 primary records. [2025-09-17T07:39:34.690797] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-17T07:39:34.711084] [DEBUG] [LOCAL ] NWN: Derivative data saved (1793 records). [2025-09-17T07:39:34.713480] [DEBUG] [LOCAL ] NWG: Derivative data saved (1794 records). [2025-09-17T07:39:34.713834] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-17T07:39:34.714039] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-17T07:39:34.728902] [INFO ] [MAIN ] Derivative Progress: 1429/2172 symbols completed. NWN took 1.1s. Estimated remaining: 4m 38s. Rate: 160.2 symbols/min [2025-09-17T07:39:34.731516] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:34.732494] [DEBUG] [MAIN ] NX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:34.731342] [INFO ] [MAIN ] Derivative Progress: 1430/2172 symbols completed. NWG took 1.1s. Estimated remaining: 4m 38s. Rate: 160.3 symbols/min [2025-09-17T07:39:34.732963] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:34.733617] [INFO ] [MAIN ] NX: Generated 1794 derivative records from 33431 primary records. [2025-09-17T07:39:34.734161] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-17T07:39:34.753435] [DEBUG] [LOCAL ] NXC: Loaded 4142 existing records from primary storage. [2025-09-17T07:39:34.755145] [DEBUG] [LOCAL ] NX: Derivative data saved (1794 records). [2025-09-17T07:39:34.755049] [INFO ] [MAIN ] NXC: Loaded 4142 primary data records. [2025-09-17T07:39:34.755261] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-17T07:39:34.789084] [INFO ] [MAIN ] Derivative Progress: 1431/2172 symbols completed. NX took 1.1s. Estimated remaining: 4m 37s. Rate: 160.4 symbols/min [2025-09-17T07:39:34.855445] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:34.887906] [DEBUG] [LOCAL ] NXDT: Loaded 16606 existing records from primary storage. [2025-09-17T07:39:34.921370] [INFO ] [MAIN ] NXDT: Loaded 16606 primary data records. [2025-09-17T07:39:35.410321] [DEBUG] [LOCAL ] NXE: Loaded 52978 existing records from primary storage. [2025-09-17T07:39:35.411012] [INFO ] [MAIN ] NXE: Loaded 52978 primary data records. [2025-09-17T07:39:35.625891] [DEBUG] [MAIN ] NXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:35.823251] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4142 primary records. [2025-09-17T07:39:35.840065] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-17T07:39:35.861051] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-09-17T07:39:35.869759] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-17T07:39:35.872258] [INFO ] [MAIN ] Derivative Progress: 1432/2172 symbols completed. NXC took 1.1s. Estimated remaining: 4m 37s. Rate: 160.2 symbols/min [2025-09-17T07:39:35.878301] [DEBUG] [MAIN ] NXDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:35.878927] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:35.879817] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 16606 primary records. [2025-09-17T07:39:35.880236] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-17T07:39:35.899961] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-09-17T07:39:35.900165] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-17T07:39:35.908072] [INFO ] [MAIN ] Derivative Progress: 1433/2172 symbols completed. NXDT took 1.2s. Estimated remaining: 4m 37s. Rate: 160.3 symbols/min [2025-09-17T07:39:35.908917] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:35.915051] [DEBUG] [LOCAL ] NXG: Loaded 10581 existing records from primary storage. [2025-09-17T07:39:35.915360] [INFO ] [MAIN ] NXG: Loaded 10581 primary data records. [2025-09-17T07:39:36.054943] [DEBUG] [LOCAL ] NXJ: Loaded 14746 existing records from primary storage. [2025-09-17T07:39:36.099532] [DEBUG] [MAIN ] NXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:36.099810] [INFO ] [MAIN ] NXJ: Loaded 14746 primary data records. [2025-09-17T07:39:36.129046] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 52978 primary records. [2025-09-17T07:39:36.266686] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-17T07:39:36.378303] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-09-17T07:39:36.424716] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-17T07:39:36.549882] [INFO ] [MAIN ] Derivative Progress: 1434/2172 symbols completed. NXE took 1.7s. Estimated remaining: 4m 36s. Rate: 160.2 symbols/min [2025-09-17T07:39:36.565374] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:36.571669] [DEBUG] [LOCAL ] NXN: Loaded 2339 existing records from primary storage. [2025-09-17T07:39:36.573907] [INFO ] [MAIN ] NXN: Loaded 2339 primary data records. [2025-09-17T07:39:36.691562] [DEBUG] [MAIN ] NXG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:36.712381] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10581 primary records. [2025-09-17T07:39:36.767862] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-17T07:39:36.901899] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-09-17T07:39:36.904458] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-17T07:39:36.907566] [INFO ] [MAIN ] Derivative Progress: 1435/2172 symbols completed. NXG took 1.0s. Estimated remaining: 4m 36s. Rate: 160.2 symbols/min [2025-09-17T07:39:36.908344] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:36.923338] [DEBUG] [MAIN ] NXJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:36.924385] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 14746 primary records. [2025-09-17T07:39:36.924803] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-17T07:39:36.944838] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-09-17T07:39:36.946020] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-17T07:39:36.951466] [DEBUG] [LOCAL ] NXP: Loaded 12194 existing records from primary storage. [2025-09-17T07:39:36.954908] [INFO ] [MAIN ] NXP: Loaded 12194 primary data records. [2025-09-17T07:39:36.954420] [INFO ] [MAIN ] Derivative Progress: 1436/2172 symbols completed. NXJ took 1.0s. Estimated remaining: 4m 35s. Rate: 160.3 symbols/min [2025-09-17T07:39:36.966987] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:37.011402] [DEBUG] [MAIN ] NXN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:37.049274] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2339 primary records. [2025-09-17T07:39:37.070579] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-17T07:39:37.269163] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-09-17T07:39:37.292457] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-17T07:39:37.292835] [DEBUG] [LOCAL ] NXRT: Loaded 18844 existing records from primary storage. [2025-09-17T07:39:37.295475] [INFO ] [MAIN ] Derivative Progress: 1437/2172 symbols completed. NXN took 0.7s. Estimated remaining: 4m 35s. Rate: 160.3 symbols/min [2025-09-17T07:39:37.295765] [INFO ] [MAIN ] NXRT: Loaded 18844 primary data records. [2025-09-17T07:39:37.295985] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:37.647140] [DEBUG] [MAIN ] NXP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:37.648999] [DEBUG] [LOCAL ] NYT: Loaded 50091 existing records from primary storage. [2025-09-17T07:39:37.649942] [INFO ] [MAIN ] NYT: Loaded 50091 primary data records. [2025-09-17T07:39:37.650023] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12194 primary records. [2025-09-17T07:39:37.650241] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-17T07:39:37.769236] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-09-17T07:39:37.775039] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-17T07:39:37.782801] [INFO ] [MAIN ] Derivative Progress: 1438/2172 symbols completed. NXP took 0.9s. Estimated remaining: 4m 35s. Rate: 160.3 symbols/min [2025-09-17T07:39:38.008866] [DEBUG] [MAIN ] NXRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:38.009611] [INFO ] [MAIN ] NXRT: Generated 1794 derivative records from 18844 primary records. [2025-09-17T07:39:38.009777] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-17T07:39:38.030588] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1794 records). [2025-09-17T07:39:38.031171] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-17T07:39:38.034365] [INFO ] [MAIN ] Derivative Progress: 1439/2172 symbols completed. NXRT took 1.1s. Estimated remaining: 4m 34s. Rate: 160.3 symbols/min [2025-09-17T07:39:38.052538] [DEBUG] [MAIN ] NYT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:38.053343] [INFO ] [MAIN ] NYT: Generated 1794 derivative records from 50091 primary records. [2025-09-17T07:39:38.053422] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-17T07:39:38.069964] [DEBUG] [LOCAL ] NYT: Derivative data saved (1794 records). [2025-09-17T07:39:38.070115] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-17T07:39:38.073180] [INFO ] [MAIN ] Derivative Progress: 1440/2172 symbols completed. NYT took 0.8s. Estimated remaining: 4m 34s. Rate: 160.4 symbols/min [2025-09-17T07:39:38.074107] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:38.074307] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:38.074871] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:38.093434] [DEBUG] [LOCAL ] OBK: Loaded 16147 existing records from primary storage. [2025-09-17T07:39:38.093743] [INFO ] [MAIN ] OBK: Loaded 16147 primary data records. [2025-09-17T07:39:38.271252] [DEBUG] [LOCAL ] NZF: Loaded 29303 existing records from primary storage. [2025-09-17T07:39:38.309710] [INFO ] [MAIN ] NZF: Loaded 29303 primary data records. [2025-09-17T07:39:38.447981] [DEBUG] [LOCAL ] OBDC: Loaded 51637 existing records from primary storage. [2025-09-17T07:39:38.495836] [INFO ] [MAIN ] OBDC: Loaded 51637 primary data records. [2025-09-17T07:39:39.109433] [DEBUG] [MAIN ] OBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:39.110758] [INFO ] [MAIN ] OBK: Generated 1794 derivative records from 16147 primary records. [2025-09-17T07:39:39.110896] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-17T07:39:39.133518] [DEBUG] [LOCAL ] OBK: Derivative data saved (1794 records). [2025-09-17T07:39:39.134852] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-17T07:39:39.137334] [INFO ] [MAIN ] Derivative Progress: 1441/2172 symbols completed. OBK took 1.1s. Estimated remaining: 4m 34s. Rate: 160.2 symbols/min [2025-09-17T07:39:39.152151] [DEBUG] [MAIN ] NZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:39.151803] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:39.153999] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 29303 primary records. [2025-09-17T07:39:39.155702] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-17T07:39:39.183167] [DEBUG] [MAIN ] OBDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:39.185236] [INFO ] [MAIN ] OBDC: Generated 1794 derivative records from 51637 primary records. [2025-09-17T07:39:39.188098] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-17T07:39:39.187971] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-09-17T07:39:39.188344] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-17T07:39:39.191382] [INFO ] [MAIN ] Derivative Progress: 1442/2172 symbols completed. NZF took 1.1s. Estimated remaining: 4m 33s. Rate: 160.3 symbols/min [2025-09-17T07:39:39.200997] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:39.207983] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1794 records). [2025-09-17T07:39:39.208290] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-17T07:39:39.211406] [INFO ] [MAIN ] Derivative Progress: 1443/2172 symbols completed. OBDC took 1.1s. Estimated remaining: 4m 33s. Rate: 160.4 symbols/min [2025-09-17T07:39:39.212039] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:39.228812] [DEBUG] [LOCAL ] ODC: Loaded 8458 existing records from primary storage. [2025-09-17T07:39:39.229160] [DEBUG] [LOCAL ] OCFT: Loaded 9725 existing records from primary storage. [2025-09-17T07:39:39.229533] [INFO ] [MAIN ] ODC: Loaded 8458 primary data records. [2025-09-17T07:39:39.229455] [INFO ] [MAIN ] OCFT: Loaded 9725 primary data records. [2025-09-17T07:39:39.483082] [DEBUG] [LOCAL ] OC: Loaded 44862 existing records from primary storage. [2025-09-17T07:39:39.483550] [INFO ] [MAIN ] OC: Loaded 44862 primary data records. [2025-09-17T07:39:40.239345] [DEBUG] [MAIN ] OCFT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:40.253044] [DEBUG] [MAIN ] ODC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:39:40.254264] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 9725 primary records. [2025-09-17T07:39:40.255831] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-17T07:39:40.259485] [INFO ] [MAIN ] ODC: Generated 1793 derivative records from 8458 primary records. [2025-09-17T07:39:40.266508] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-17T07:39:40.301030] [DEBUG] [MAIN ] OC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:40.304604] [INFO ] [MAIN ] OC: Generated 1794 derivative records from 44862 primary records. [2025-09-17T07:39:40.305635] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-09-17T07:39:40.305982] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-17T07:39:40.306090] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-17T07:39:40.311610] [INFO ] [MAIN ] Derivative Progress: 1444/2172 symbols completed. OCFT took 1.1s. Estimated remaining: 4m 33s. Rate: 160.2 symbols/min [2025-09-17T07:39:40.325366] [DEBUG] [LOCAL ] ODC: Derivative data saved (1793 records). [2025-09-17T07:39:40.325833] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:40.327009] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-17T07:39:40.330559] [INFO ] [MAIN ] Derivative Progress: 1445/2172 symbols completed. ODC took 1.1s. Estimated remaining: 4m 32s. Rate: 160.3 symbols/min [2025-09-17T07:39:40.332305] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:40.335526] [DEBUG] [LOCAL ] OC: Derivative data saved (1794 records). [2025-09-17T07:39:40.335634] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-17T07:39:40.338500] [INFO ] [MAIN ] Derivative Progress: 1446/2172 symbols completed. OC took 1.2s. Estimated remaining: 4m 32s. Rate: 160.4 symbols/min [2025-09-17T07:39:40.338901] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:40.388431] [DEBUG] [LOCAL ] OFG: Loaded 22442 existing records from primary storage. [2025-09-17T07:39:40.389773] [DEBUG] [LOCAL ] ODV: Loaded 24721 existing records from primary storage. [2025-09-17T07:39:40.389972] [INFO ] [MAIN ] ODV: Loaded 24721 primary data records. [2025-09-17T07:39:40.390052] [INFO ] [MAIN ] OFG: Loaded 22442 primary data records. [2025-09-17T07:39:40.655408] [DEBUG] [LOCAL ] OEC: Loaded 37497 existing records from primary storage. [2025-09-17T07:39:40.757177] [INFO ] [MAIN ] OEC: Loaded 37497 primary data records. [2025-09-17T07:39:41.351431] [DEBUG] [MAIN ] ODV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:41.352335] [DEBUG] [MAIN ] OFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:41.353104] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 24721 primary records. [2025-09-17T07:39:41.354225] [INFO ] [MAIN ] OFG: Generated 1794 derivative records from 22442 primary records. [2025-09-17T07:39:41.355228] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-17T07:39:41.354360] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-17T07:39:41.388143] [DEBUG] [LOCAL ] OFG: Derivative data saved (1794 records). [2025-09-17T07:39:41.391593] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-17T07:39:41.394559] [INFO ] [MAIN ] Derivative Progress: 1447/2172 symbols completed. OFG took 1.1s. Estimated remaining: 4m 32s. Rate: 160.2 symbols/min [2025-09-17T07:39:41.396960] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:41.399474] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-09-17T07:39:41.399750] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-17T07:39:41.405220] [INFO ] [MAIN ] Derivative Progress: 1448/2172 symbols completed. ODV took 1.1s. Estimated remaining: 4m 31s. Rate: 160.3 symbols/min [2025-09-17T07:39:41.406514] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:41.428862] [DEBUG] [MAIN ] OEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:41.430000] [INFO ] [MAIN ] OEC: Generated 1794 derivative records from 37497 primary records. [2025-09-17T07:39:41.430442] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-17T07:39:41.448864] [DEBUG] [LOCAL ] OEC: Derivative data saved (1794 records). [2025-09-17T07:39:41.449213] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-17T07:39:41.452397] [INFO ] [MAIN ] Derivative Progress: 1449/2172 symbols completed. OEC took 1.1s. Estimated remaining: 4m 30s. Rate: 160.4 symbols/min [2025-09-17T07:39:41.463983] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:41.483434] [DEBUG] [LOCAL ] OGE: Loaded 46674 existing records from primary storage. [2025-09-17T07:39:41.483701] [INFO ] [MAIN ] OGE: Loaded 46674 primary data records. [2025-09-17T07:39:41.717054] [DEBUG] [LOCAL ] OGS: Loaded 33927 existing records from primary storage. [2025-09-17T07:39:41.864374] [INFO ] [MAIN ] OGS: Loaded 33927 primary data records. [2025-09-17T07:39:41.874840] [DEBUG] [LOCAL ] OGN: Loaded 53131 existing records from primary storage. [2025-09-17T07:39:41.888123] [INFO ] [MAIN ] OGN: Loaded 53131 primary data records. [2025-09-17T07:39:42.516761] [DEBUG] [MAIN ] OGE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:42.518128] [INFO ] [MAIN ] OGE: Generated 1794 derivative records from 46674 primary records. [2025-09-17T07:39:42.518986] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-17T07:39:42.538200] [DEBUG] [LOCAL ] OGE: Derivative data saved (1794 records). [2025-09-17T07:39:42.538719] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-17T07:39:42.541275] [INFO ] [MAIN ] Derivative Progress: 1450/2172 symbols completed. OGE took 1.1s. Estimated remaining: 4m 30s. Rate: 160.2 symbols/min [2025-09-17T07:39:42.542625] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:42.564469] [DEBUG] [MAIN ] OGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:42.565979] [INFO ] [MAIN ] OGS: Generated 1794 derivative records from 33927 primary records. [2025-09-17T07:39:42.579428] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-17T07:39:42.579952] [DEBUG] [MAIN ] OGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:42.581968] [INFO ] [MAIN ] OGN: Generated 1794 derivative records from 53131 primary records. [2025-09-17T07:39:42.582308] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-17T07:39:42.606997] [DEBUG] [LOCAL ] OGS: Derivative data saved (1794 records). [2025-09-17T07:39:42.615081] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-17T07:39:42.614999] [DEBUG] [LOCAL ] OGN: Derivative data saved (1794 records). [2025-09-17T07:39:42.617603] [INFO ] [MAIN ] Derivative Progress: 1451/2172 symbols completed. OGS took 1.2s. Estimated remaining: 4m 30s. Rate: 160.3 symbols/min [2025-09-17T07:39:42.631324] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-17T07:39:42.634161] [INFO ] [MAIN ] Derivative Progress: 1452/2172 symbols completed. OGN took 1.2s. Estimated remaining: 4m 29s. Rate: 160.4 symbols/min [2025-09-17T07:39:42.634421] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:42.634855] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:42.658372] [DEBUG] [LOCAL ] OHI: Loaded 52178 existing records from primary storage. [2025-09-17T07:39:42.664156] [INFO ] [MAIN ] OHI: Loaded 52178 primary data records. [2025-09-17T07:39:42.664460] [DEBUG] [LOCAL ] OIA: Loaded 13630 existing records from primary storage. [2025-09-17T07:39:42.690774] [INFO ] [MAIN ] OIA: Loaded 13630 primary data records. [2025-09-17T07:39:43.275151] [DEBUG] [LOCAL ] OI: Loaded 47479 existing records from primary storage. [2025-09-17T07:39:43.290767] [INFO ] [MAIN ] OI: Loaded 47479 primary data records. [2025-09-17T07:39:43.671606] [DEBUG] [MAIN ] OHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:43.674455] [INFO ] [MAIN ] OHI: Generated 1794 derivative records from 52178 primary records. [2025-09-17T07:39:43.675127] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-17T07:39:43.700917] [DEBUG] [MAIN ] OIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:43.702392] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13630 primary records. [2025-09-17T07:39:43.703878] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-17T07:39:43.707893] [DEBUG] [LOCAL ] OHI: Derivative data saved (1794 records). [2025-09-17T07:39:43.708075] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-17T07:39:43.710869] [INFO ] [MAIN ] Derivative Progress: 1453/2172 symbols completed. OHI took 1.2s. Estimated remaining: 4m 29s. Rate: 160.2 symbols/min [2025-09-17T07:39:43.726785] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-09-17T07:39:43.726930] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-17T07:39:43.729606] [INFO ] [MAIN ] Derivative Progress: 1454/2172 symbols completed. OIA took 1.1s. Estimated remaining: 4m 29s. Rate: 160.3 symbols/min [2025-09-17T07:39:43.744850] [DEBUG] [MAIN ] OI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:43.745472] [INFO ] [MAIN ] OI: Generated 1794 derivative records from 47479 primary records. [2025-09-17T07:39:43.745563] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-17T07:39:43.762045] [DEBUG] [LOCAL ] OI: Derivative data saved (1794 records). [2025-09-17T07:39:43.762135] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-17T07:39:43.764928] [INFO ] [MAIN ] Derivative Progress: 1455/2172 symbols completed. OI took 1.1s. Estimated remaining: 4m 28s. Rate: 160.4 symbols/min [2025-09-17T07:39:43.765440] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:43.765574] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:43.765734] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:43.815552] [DEBUG] [LOCAL ] OII: Loaded 43228 existing records from primary storage. [2025-09-17T07:39:43.840759] [INFO ] [MAIN ] OII: Loaded 43228 primary data records. [2025-09-17T07:39:43.841411] [DEBUG] [LOCAL ] OIS: Loaded 41051 existing records from primary storage. [2025-09-17T07:39:43.878957] [INFO ] [MAIN ] OIS: Loaded 41051 primary data records. [2025-09-17T07:39:44.026984] [DEBUG] [LOCAL ] OKE: Loaded 53535 existing records from primary storage. [2025-09-17T07:39:44.114030] [INFO ] [MAIN ] OKE: Loaded 53535 primary data records. [2025-09-17T07:39:44.828674] [DEBUG] [MAIN ] OII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:44.829240] [DEBUG] [MAIN ] OIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:44.830144] [INFO ] [MAIN ] OII: Generated 1794 derivative records from 43228 primary records. [2025-09-17T07:39:44.830874] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 41051 primary records. [2025-09-17T07:39:44.831017] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-17T07:39:44.831376] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-17T07:39:44.876475] [DEBUG] [MAIN ] OKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:44.879466] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-09-17T07:39:44.880617] [INFO ] [MAIN ] OKE: Generated 1794 derivative records from 53535 primary records. [2025-09-17T07:39:44.881049] [DEBUG] [LOCAL ] OII: Derivative data saved (1794 records). [2025-09-17T07:39:44.881265] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-17T07:39:44.881486] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-17T07:39:44.881129] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-17T07:39:44.884366] [INFO ] [MAIN ] Derivative Progress: 1456/2172 symbols completed. OII took 1.1s. Estimated remaining: 4m 28s. Rate: 160.2 symbols/min [2025-09-17T07:39:44.887596] [INFO ] [MAIN ] OKLO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:44.895056] [INFO ] [MAIN ] Derivative Progress: 1457/2172 symbols completed. OIS took 1.1s. Estimated remaining: 4m 28s. Rate: 160.3 symbols/min [2025-09-17T07:39:44.899437] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:44.903551] [DEBUG] [LOCAL ] OKE: Derivative data saved (1794 records). [2025-09-17T07:39:44.904046] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-17T07:39:44.906530] [INFO ] [MAIN ] Derivative Progress: 1458/2172 symbols completed. OKE took 1.1s. Estimated remaining: 4m 27s. Rate: 160.4 symbols/min [2025-09-17T07:39:44.907769] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:44.919523] [DEBUG] [LOCAL ] OLP: Loaded 9608 existing records from primary storage. [2025-09-17T07:39:44.919821] [INFO ] [MAIN ] OLP: Loaded 9608 primary data records. [2025-09-17T07:39:45.274461] [DEBUG] [LOCAL ] OKLO: Loaded 53819 existing records from primary storage. [2025-09-17T07:39:45.274992] [INFO ] [MAIN ] OKLO: Loaded 53819 primary data records. [2025-09-17T07:39:45.276480] [DEBUG] [LOCAL ] OLN: Loaded 51697 existing records from primary storage. [2025-09-17T07:39:45.308545] [INFO ] [MAIN ] OLN: Loaded 51697 primary data records. [2025-09-17T07:39:45.942852] [DEBUG] [MAIN ] OLP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:45.944864] [INFO ] [MAIN ] OLP: Generated 1794 derivative records from 9608 primary records. [2025-09-17T07:39:45.945282] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-17T07:39:45.967353] [DEBUG] [LOCAL ] OLP: Derivative data saved (1794 records). [2025-09-17T07:39:45.967752] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-17T07:39:45.970543] [INFO ] [MAIN ] Derivative Progress: 1459/2172 symbols completed. OLP took 1.1s. Estimated remaining: 4m 27s. Rate: 160.2 symbols/min [2025-09-17T07:39:45.971524] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:45.989050] [DEBUG] [MAIN ] OLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:45.990485] [INFO ] [MAIN ] OLN: Generated 1794 derivative records from 51697 primary records. [2025-09-17T07:39:45.990784] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-17T07:39:46.019117] [DEBUG] [MAIN ] OKLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:46.021867] [INFO ] [MAIN ] OKLO: Generated 1794 derivative records from 53819 primary records. [2025-09-17T07:39:46.023491] [DEBUG] [LOCAL ] OLN: Derivative data saved (1794 records). [2025-09-17T07:39:46.023726] [DEBUG] [LOCAL ] OKLO: Saving derivative data. [2025-09-17T07:39:46.023850] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-17T07:39:46.027370] [INFO ] [MAIN ] Derivative Progress: 1460/2172 symbols completed. OLN took 1.1s. Estimated remaining: 4m 27s. Rate: 160.3 symbols/min [2025-09-17T07:39:46.027972] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:46.044616] [DEBUG] [LOCAL ] OKLO: Derivative data saved (1794 records). [2025-09-17T07:39:46.044776] [INFO ] [MAIN ] OKLO: Successfully saved derivative data. [2025-09-17T07:39:46.048830] [INFO ] [MAIN ] Derivative Progress: 1461/2172 symbols completed. OKLO took 1.2s. Estimated remaining: 4m 26s. Rate: 160.4 symbols/min [2025-09-17T07:39:46.062979] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:46.094893] [DEBUG] [LOCAL ] OMC: Loaded 53295 existing records from primary storage. [2025-09-17T07:39:46.095336] [INFO ] [MAIN ] OMC: Loaded 53295 primary data records. [2025-09-17T07:39:46.223608] [DEBUG] [LOCAL ] OMF: Loaded 46316 existing records from primary storage. [2025-09-17T07:39:46.244591] [INFO ] [MAIN ] OMF: Loaded 46316 primary data records. [2025-09-17T07:39:46.515746] [DEBUG] [LOCAL ] OMI: Loaded 45878 existing records from primary storage. [2025-09-17T07:39:46.542171] [INFO ] [MAIN ] OMI: Loaded 45878 primary data records. [2025-09-17T07:39:47.074364] [DEBUG] [MAIN ] OMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:47.076763] [INFO ] [MAIN ] OMC: Generated 1794 derivative records from 53295 primary records. [2025-09-17T07:39:47.077254] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-17T07:39:47.107663] [DEBUG] [LOCAL ] OMC: Derivative data saved (1794 records). [2025-09-17T07:39:47.113486] [DEBUG] [MAIN ] OMF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:47.113927] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-17T07:39:47.114973] [INFO ] [MAIN ] OMF: Generated 1794 derivative records from 46316 primary records. [2025-09-17T07:39:47.115234] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-17T07:39:47.117714] [INFO ] [MAIN ] Derivative Progress: 1462/2172 symbols completed. OMC took 1.1s. Estimated remaining: 4m 26s. Rate: 160.2 symbols/min [2025-09-17T07:39:47.118970] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:47.136879] [DEBUG] [LOCAL ] OMF: Derivative data saved (1794 records). [2025-09-17T07:39:47.139684] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-17T07:39:47.143747] [INFO ] [MAIN ] Derivative Progress: 1463/2172 symbols completed. OMF took 1.1s. Estimated remaining: 4m 25s. Rate: 160.3 symbols/min [2025-09-17T07:39:47.150333] [DEBUG] [LOCAL ] ONIT: Loaded 7766 existing records from primary storage. [2025-09-17T07:39:47.149789] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:47.150966] [INFO ] [MAIN ] ONIT: Loaded 7766 primary data records. [2025-09-17T07:39:47.229188] [DEBUG] [MAIN ] OMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:47.268673] [INFO ] [MAIN ] OMI: Generated 1794 derivative records from 45878 primary records. [2025-09-17T07:39:47.268838] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-17T07:39:47.497178] [DEBUG] [LOCAL ] OMI: Derivative data saved (1794 records). [2025-09-17T07:39:47.508140] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-17T07:39:47.511257] [INFO ] [MAIN ] Derivative Progress: 1464/2172 symbols completed. OMI took 1.4s. Estimated remaining: 4m 25s. Rate: 160.3 symbols/min [2025-09-17T07:39:47.513352] [DEBUG] [LOCAL ] ONL: Loaded 32227 existing records from primary storage. [2025-09-17T07:39:47.513900] [INFO ] [MAIN ] ONL: Loaded 32227 primary data records. [2025-09-17T07:39:47.514571] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:47.917685] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-09-17T07:39:47.916664] [DEBUG] [MAIN ] ONIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:47.917975] [INFO ] [MAIN ] ONON: Loaded 53613 primary data records. [2025-09-17T07:39:47.918828] [INFO ] [MAIN ] ONIT: Generated 1794 derivative records from 7766 primary records. [2025-09-17T07:39:47.931385] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-17T07:39:48.119635] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1794 records). [2025-09-17T07:39:48.229719] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-17T07:39:48.231845] [INFO ] [MAIN ] Derivative Progress: 1465/2172 symbols completed. ONIT took 1.1s. Estimated remaining: 4m 25s. Rate: 160.2 symbols/min [2025-09-17T07:39:48.232248] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:48.246825] [DEBUG] [MAIN ] ONL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:48.247819] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 32227 primary records. [2025-09-17T07:39:48.247984] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-17T07:39:48.267128] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-09-17T07:39:48.273281] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-17T07:39:48.276049] [INFO ] [MAIN ] Derivative Progress: 1466/2172 symbols completed. ONL took 1.1s. Estimated remaining: 4m 24s. Rate: 160.3 symbols/min [2025-09-17T07:39:48.276557] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:48.287315] [DEBUG] [LOCAL ] ONTF: Loaded 23024 existing records from primary storage. [2025-09-17T07:39:48.288268] [INFO ] [MAIN ] ONTF: Loaded 23024 primary data records. [2025-09-17T07:39:48.370995] [DEBUG] [MAIN ] ONON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:48.388763] [INFO ] [MAIN ] ONON: Generated 1794 derivative records from 53613 primary records. [2025-09-17T07:39:48.406934] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-17T07:39:48.640940] [DEBUG] [LOCAL ] ONTO: Loaded 46467 existing records from primary storage. [2025-09-17T07:39:48.642025] [DEBUG] [LOCAL ] ONON: Derivative data saved (1794 records). [2025-09-17T07:39:48.642259] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-17T07:39:48.642950] [INFO ] [MAIN ] ONTO: Loaded 46467 primary data records. [2025-09-17T07:39:48.645334] [INFO ] [MAIN ] Derivative Progress: 1467/2172 symbols completed. ONON took 1.1s. Estimated remaining: 4m 24s. Rate: 160.3 symbols/min [2025-09-17T07:39:48.651085] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:48.968228] [DEBUG] [LOCAL ] OOMA: Loaded 19116 existing records from primary storage. [2025-09-17T07:39:48.969288] [INFO ] [MAIN ] OOMA: Loaded 19116 primary data records. [2025-09-17T07:39:49.091239] [DEBUG] [MAIN ] ONTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:49.141541] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 23024 primary records. [2025-09-17T07:39:49.272821] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-17T07:39:49.309657] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-09-17T07:39:49.310415] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-17T07:39:49.321021] [INFO ] [MAIN ] Derivative Progress: 1468/2172 symbols completed. ONTF took 1.1s. Estimated remaining: 4m 24s. Rate: 160.2 symbols/min [2025-09-17T07:39:49.326773] [DEBUG] [MAIN ] ONTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:49.328093] [INFO ] [MAIN ] ONTO: Generated 1794 derivative records from 46467 primary records. [2025-09-17T07:39:49.328780] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-17T07:39:49.346037] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1794 records). [2025-09-17T07:39:49.346242] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-17T07:39:49.348493] [INFO ] [MAIN ] Derivative Progress: 1469/2172 symbols completed. ONTO took 1.1s. Estimated remaining: 4m 23s. Rate: 160.3 symbols/min [2025-09-17T07:39:49.364561] [DEBUG] [MAIN ] OOMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:49.365194] [INFO ] [MAIN ] OOMA: Generated 1794 derivative records from 19116 primary records. [2025-09-17T07:39:49.365267] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-17T07:39:49.380396] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1794 records). [2025-09-17T07:39:49.380477] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-17T07:39:49.382972] [INFO ] [MAIN ] Derivative Progress: 1470/2172 symbols completed. OOMA took 0.7s. Estimated remaining: 4m 23s. Rate: 160.4 symbols/min [2025-09-17T07:39:49.383632] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:49.383809] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:49.383748] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:49.396886] [DEBUG] [LOCAL ] OPP: Loaded 11811 existing records from primary storage. [2025-09-17T07:39:49.397230] [INFO ] [MAIN ] OPP: Loaded 11811 primary data records. [2025-09-17T07:39:49.522212] [DEBUG] [LOCAL ] OPAD: Loaded 18309 existing records from primary storage. [2025-09-17T07:39:49.547061] [INFO ] [MAIN ] OPAD: Loaded 18309 primary data records. [2025-09-17T07:39:49.862602] [DEBUG] [LOCAL ] OPFI: Loaded 46843 existing records from primary storage. [2025-09-17T07:39:49.867477] [INFO ] [MAIN ] OPFI: Loaded 46843 primary data records. [2025-09-17T07:39:50.394235] [DEBUG] [MAIN ] OPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:50.396729] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 11811 primary records. [2025-09-17T07:39:50.397366] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-17T07:39:50.431466] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-09-17T07:39:50.432183] [DEBUG] [MAIN ] OPAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:50.433446] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-17T07:39:50.433360] [INFO ] [MAIN ] OPAD: Generated 1794 derivative records from 18309 primary records. [2025-09-17T07:39:50.436564] [INFO ] [MAIN ] Derivative Progress: 1471/2172 symbols completed. OPP took 1.1s. Estimated remaining: 4m 23s. Rate: 160.2 symbols/min [2025-09-17T07:39:50.437287] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-17T07:39:50.439274] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:50.454856] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1794 records). [2025-09-17T07:39:50.455168] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-17T07:39:50.458455] [INFO ] [MAIN ] Derivative Progress: 1472/2172 symbols completed. OPAD took 1.1s. Estimated remaining: 4m 22s. Rate: 160.3 symbols/min [2025-09-17T07:39:50.459633] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:50.479740] [DEBUG] [MAIN ] OPFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:50.480791] [INFO ] [MAIN ] OPFI: Generated 1794 derivative records from 46843 primary records. [2025-09-17T07:39:50.480968] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-17T07:39:50.499074] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1794 records). [2025-09-17T07:39:50.499777] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-17T07:39:50.503990] [INFO ] [MAIN ] Derivative Progress: 1473/2172 symbols completed. OPFI took 1.1s. Estimated remaining: 4m 21s. Rate: 160.4 symbols/min [2025-09-17T07:39:50.504710] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:50.552364] [DEBUG] [LOCAL ] OR: Loaded 45886 existing records from primary storage. [2025-09-17T07:39:50.554032] [INFO ] [MAIN ] OR: Loaded 45886 primary data records. [2025-09-17T07:39:50.591564] [DEBUG] [LOCAL ] ORA: Loaded 32627 existing records from primary storage. [2025-09-17T07:39:50.645781] [INFO ] [MAIN ] ORA: Loaded 32627 primary data records. [2025-09-17T07:39:51.012477] [DEBUG] [LOCAL ] ORC: Loaded 52270 existing records from primary storage. [2025-09-17T07:39:51.013690] [INFO ] [MAIN ] ORC: Loaded 52270 primary data records. [2025-09-17T07:39:51.491405] [DEBUG] [MAIN ] OR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:51.492839] [INFO ] [MAIN ] OR: Generated 1794 derivative records from 45886 primary records. [2025-09-17T07:39:51.492945] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-17T07:39:51.510676] [DEBUG] [LOCAL ] OR: Derivative data saved (1794 records). [2025-09-17T07:39:51.511083] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-17T07:39:51.513374] [INFO ] [MAIN ] Derivative Progress: 1474/2172 symbols completed. OR took 1.1s. Estimated remaining: 4m 21s. Rate: 160.2 symbols/min [2025-09-17T07:39:51.514088] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:51.531395] [DEBUG] [MAIN ] ORA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:51.532085] [INFO ] [MAIN ] ORA: Generated 1794 derivative records from 32627 primary records. [2025-09-17T07:39:51.532354] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-17T07:39:51.571821] [DEBUG] [LOCAL ] ORA: Derivative data saved (1794 records). [2025-09-17T07:39:51.572365] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-17T07:39:51.572120] [DEBUG] [MAIN ] ORC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:51.575821] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52270 primary records. [2025-09-17T07:39:51.574795] [INFO ] [MAIN ] Derivative Progress: 1475/2172 symbols completed. ORA took 1.1s. Estimated remaining: 4m 21s. Rate: 160.3 symbols/min [2025-09-17T07:39:51.576426] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-17T07:39:51.576618] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:51.599482] [DEBUG] [LOCAL ] ORN: Loaded 31790 existing records from primary storage. [2025-09-17T07:39:51.602002] [INFO ] [MAIN ] ORN: Loaded 31790 primary data records. [2025-09-17T07:39:51.614554] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-09-17T07:39:51.633681] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-17T07:39:51.641439] [INFO ] [MAIN ] Derivative Progress: 1476/2172 symbols completed. ORC took 1.1s. Estimated remaining: 4m 20s. Rate: 160.4 symbols/min [2025-09-17T07:39:51.660792] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:51.986744] [DEBUG] [LOCAL ] OTIS: Loaded 52711 existing records from primary storage. [2025-09-17T07:39:51.987257] [INFO ] [MAIN ] OTIS: Loaded 52711 primary data records. [2025-09-17T07:39:52.108514] [DEBUG] [LOCAL ] OUT: Loaded 48284 existing records from primary storage. [2025-09-17T07:39:52.112272] [INFO ] [MAIN ] OUT: Loaded 48284 primary data records. [2025-09-17T07:39:52.621789] [DEBUG] [MAIN ] ORN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:52.638843] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 31790 primary records. [2025-09-17T07:39:52.639383] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-17T07:39:52.661112] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-09-17T07:39:52.662381] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-17T07:39:52.666212] [INFO ] [MAIN ] Derivative Progress: 1477/2172 symbols completed. ORN took 1.2s. Estimated remaining: 4m 20s. Rate: 160.2 symbols/min [2025-09-17T07:39:52.667764] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:52.692086] [DEBUG] [MAIN ] OTIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:52.693451] [INFO ] [MAIN ] OTIS: Generated 1794 derivative records from 52711 primary records. [2025-09-17T07:39:52.695129] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-17T07:39:52.718897] [DEBUG] [MAIN ] OUT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:52.719635] [INFO ] [MAIN ] OUT: Generated 1794 derivative records from 48284 primary records. [2025-09-17T07:39:52.724674] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-17T07:39:52.729384] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1794 records). [2025-09-17T07:39:52.739090] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-17T07:39:52.748093] [INFO ] [MAIN ] Derivative Progress: 1478/2172 symbols completed. OTIS took 1.2s. Estimated remaining: 4m 20s. Rate: 160.3 symbols/min [2025-09-17T07:39:52.749399] [DEBUG] [LOCAL ] OUT: Derivative data saved (1794 records). [2025-09-17T07:39:52.749956] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:52.750165] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-17T07:39:52.753075] [INFO ] [MAIN ] Derivative Progress: 1479/2172 symbols completed. OUT took 1.1s. Estimated remaining: 4m 19s. Rate: 160.4 symbols/min [2025-09-17T07:39:52.753912] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:52.782370] [DEBUG] [LOCAL ] OWLT: Loaded 8697 existing records from primary storage. [2025-09-17T07:39:52.782634] [INFO ] [MAIN ] OWLT: Loaded 8697 primary data records. [2025-09-17T07:39:52.831048] [DEBUG] [LOCAL ] OVV: Loaded 53517 existing records from primary storage. [2025-09-17T07:39:52.876503] [INFO ] [MAIN ] OVV: Loaded 53517 primary data records. [2025-09-17T07:39:53.284312] [DEBUG] [LOCAL ] OWL: Loaded 53557 existing records from primary storage. [2025-09-17T07:39:53.296581] [INFO ] [MAIN ] OWL: Loaded 53557 primary data records. [2025-09-17T07:39:53.874937] [DEBUG] [MAIN ] OWLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:53.877118] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 8697 primary records. [2025-09-17T07:39:53.877294] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-17T07:39:53.898838] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-09-17T07:39:53.900211] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-17T07:39:53.904041] [INFO ] [MAIN ] Derivative Progress: 1480/2172 symbols completed. OWLT took 1.2s. Estimated remaining: 4m 19s. Rate: 160.2 symbols/min [2025-09-17T07:39:53.918694] [DEBUG] [MAIN ] OVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:53.919513] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:53.920738] [INFO ] [MAIN ] OVV: Generated 1794 derivative records from 53517 primary records. [2025-09-17T07:39:53.920868] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-17T07:39:53.952440] [DEBUG] [MAIN ] OWL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:53.954167] [INFO ] [MAIN ] OWL: Generated 1794 derivative records from 53557 primary records. [2025-09-17T07:39:53.955407] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-17T07:39:53.959180] [DEBUG] [LOCAL ] OVV: Derivative data saved (1794 records). [2025-09-17T07:39:53.959822] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-17T07:39:53.969360] [INFO ] [MAIN ] Derivative Progress: 1481/2172 symbols completed. OVV took 1.3s. Estimated remaining: 4m 19s. Rate: 160.3 symbols/min [2025-09-17T07:39:53.973183] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:53.985971] [DEBUG] [LOCAL ] OWL: Derivative data saved (1794 records). [2025-09-17T07:39:53.986187] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-17T07:39:53.988738] [INFO ] [MAIN ] Derivative Progress: 1482/2172 symbols completed. OWL took 1.2s. Estimated remaining: 4m 18s. Rate: 160.4 symbols/min [2025-09-17T07:39:53.989171] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:54.001750] [DEBUG] [LOCAL ] OXM: Loaded 33661 existing records from primary storage. [2025-09-17T07:39:54.001923] [INFO ] [MAIN ] OXM: Loaded 33661 primary data records. [2025-09-17T07:39:54.100526] [DEBUG] [LOCAL ] PAC: Loaded 11690 existing records from primary storage. [2025-09-17T07:39:54.111234] [INFO ] [MAIN ] PAC: Loaded 11690 primary data records. [2025-09-17T07:39:54.497508] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-17T07:39:54.537094] [INFO ] [MAIN ] PAAS: Loaded 53603 primary data records. [2025-09-17T07:39:54.977596] [DEBUG] [MAIN ] OXM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:54.979396] [INFO ] [MAIN ] OXM: Generated 1794 derivative records from 33661 primary records. [2025-09-17T07:39:54.981422] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-17T07:39:55.002417] [DEBUG] [MAIN ] PAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:55.007988] [INFO ] [MAIN ] PAC: Generated 1794 derivative records from 11690 primary records. [2025-09-17T07:39:55.010258] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-17T07:39:55.011289] [DEBUG] [LOCAL ] OXM: Derivative data saved (1794 records). [2025-09-17T07:39:55.011420] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-17T07:39:55.014211] [INFO ] [MAIN ] Derivative Progress: 1483/2172 symbols completed. OXM took 1.1s. Estimated remaining: 4m 18s. Rate: 160.2 symbols/min [2025-09-17T07:39:55.035390] [DEBUG] [LOCAL ] PAC: Derivative data saved (1794 records). [2025-09-17T07:39:55.036489] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-17T07:39:55.039428] [INFO ] [MAIN ] Derivative Progress: 1484/2172 symbols completed. PAC took 1.1s. Estimated remaining: 4m 18s. Rate: 160.3 symbols/min [2025-09-17T07:39:55.052450] [DEBUG] [MAIN ] PAAS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:55.053131] [INFO ] [MAIN ] PAAS: Generated 1794 derivative records from 53603 primary records. [2025-09-17T07:39:55.053204] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-17T07:39:55.069029] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1794 records). [2025-09-17T07:39:55.069101] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-17T07:39:55.071554] [INFO ] [MAIN ] Derivative Progress: 1485/2172 symbols completed. PAAS took 1.1s. Estimated remaining: 4m 17s. Rate: 160.4 symbols/min [2025-09-17T07:39:55.072236] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:55.072078] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:55.072336] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:55.128335] [DEBUG] [LOCAL ] PAG: Loaded 22217 existing records from primary storage. [2025-09-17T07:39:55.128679] [INFO ] [MAIN ] PAG: Loaded 22217 primary data records. [2025-09-17T07:39:55.130054] [DEBUG] [LOCAL ] PACK: Loaded 32001 existing records from primary storage. [2025-09-17T07:39:55.151418] [INFO ] [MAIN ] PACK: Loaded 32001 primary data records. [2025-09-17T07:39:55.224396] [DEBUG] [LOCAL ] PACS: Loaded 33702 existing records from primary storage. [2025-09-17T07:39:55.373341] [INFO ] [MAIN ] PACS: Loaded 33702 primary data records. [2025-09-17T07:39:56.163175] [DEBUG] [MAIN ] PAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:56.165012] [INFO ] [MAIN ] PAG: Generated 1794 derivative records from 22217 primary records. [2025-09-17T07:39:56.165621] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-17T07:39:56.198745] [DEBUG] [LOCAL ] PAG: Derivative data saved (1794 records). [2025-09-17T07:39:56.198976] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-17T07:39:56.196179] [DEBUG] [MAIN ] PACK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:56.201303] [INFO ] [MAIN ] Derivative Progress: 1486/2172 symbols completed. PAG took 1.1s. Estimated remaining: 4m 17s. Rate: 160.2 symbols/min [2025-09-17T07:39:56.202533] [INFO ] [MAIN ] PACK: Generated 1794 derivative records from 32001 primary records. [2025-09-17T07:39:56.203248] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-17T07:39:56.202799] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:56.233900] [DEBUG] [MAIN ] PACS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:56.236135] [INFO ] [MAIN ] PACS: Generated 1794 derivative records from 33702 primary records. [2025-09-17T07:39:56.236566] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-17T07:39:56.237956] [DEBUG] [LOCAL ] PACK: Derivative data saved (1794 records). [2025-09-17T07:39:56.238330] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-17T07:39:56.241819] [INFO ] [MAIN ] Derivative Progress: 1487/2172 symbols completed. PACK took 1.2s. Estimated remaining: 4m 16s. Rate: 160.3 symbols/min [2025-09-17T07:39:56.243130] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:56.261259] [DEBUG] [LOCAL ] PACS: Derivative data saved (1794 records). [2025-09-17T07:39:56.261525] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-17T07:39:56.266767] [INFO ] [MAIN ] Derivative Progress: 1488/2172 symbols completed. PACS took 1.2s. Estimated remaining: 4m 16s. Rate: 160.4 symbols/min [2025-09-17T07:39:56.266987] [DEBUG] [LOCAL ] PAI: Loaded 2716 existing records from primary storage. [2025-09-17T07:39:56.267424] [INFO ] [MAIN ] PAI: Loaded 2716 primary data records. [2025-09-17T07:39:56.267558] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:56.485454] [DEBUG] [LOCAL ] PAGS: Loaded 52680 existing records from primary storage. [2025-09-17T07:39:56.597972] [INFO ] [MAIN ] PAGS: Loaded 52680 primary data records. [2025-09-17T07:39:56.619805] [DEBUG] [LOCAL ] PAM: Loaded 27442 existing records from primary storage. [2025-09-17T07:39:56.653077] [INFO ] [MAIN ] PAM: Loaded 27442 primary data records. [2025-09-17T07:39:57.226061] [DEBUG] [MAIN ] PAI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:57.227792] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2716 primary records. [2025-09-17T07:39:57.228114] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-17T07:39:57.244676] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-09-17T07:39:57.245328] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-17T07:39:57.247936] [INFO ] [MAIN ] Derivative Progress: 1489/2172 symbols completed. PAI took 1.0s. Estimated remaining: 4m 16s. Rate: 160.2 symbols/min [2025-09-17T07:39:57.248812] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:57.265912] [DEBUG] [MAIN ] PAGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:57.267871] [INFO ] [MAIN ] PAGS: Generated 1794 derivative records from 52680 primary records. [2025-09-17T07:39:57.267973] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-17T07:39:57.288731] [DEBUG] [MAIN ] PAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:57.296867] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1794 records). [2025-09-17T07:39:57.297028] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-17T07:39:57.295975] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 27442 primary records. [2025-09-17T07:39:57.297192] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-17T07:39:57.299673] [INFO ] [MAIN ] Derivative Progress: 1490/2172 symbols completed. PAGS took 1.1s. Estimated remaining: 4m 15s. Rate: 160.3 symbols/min [2025-09-17T07:39:57.300479] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:57.325966] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-09-17T07:39:57.326256] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-17T07:39:57.328824] [INFO ] [MAIN ] Derivative Progress: 1491/2172 symbols completed. PAM took 1.1s. Estimated remaining: 4m 15s. Rate: 160.4 symbols/min [2025-09-17T07:39:57.329284] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:57.343805] [DEBUG] [LOCAL ] PAR: Loaded 32494 existing records from primary storage. [2025-09-17T07:39:57.344018] [INFO ] [MAIN ] PAR: Loaded 32494 primary data records. [2025-09-17T07:39:57.680041] [DEBUG] [LOCAL ] PARR: Loaded 48464 existing records from primary storage. [2025-09-17T07:39:57.681241] [INFO ] [MAIN ] PARR: Loaded 48464 primary data records. [2025-09-17T07:39:57.766772] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-09-17T07:39:57.797923] [INFO ] [MAIN ] PATH: Loaded 53678 primary data records. [2025-09-17T07:39:58.373133] [DEBUG] [MAIN ] PAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:58.375397] [INFO ] [MAIN ] PAR: Generated 1794 derivative records from 32494 primary records. [2025-09-17T07:39:58.376206] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-17T07:39:58.396715] [DEBUG] [LOCAL ] PAR: Derivative data saved (1794 records). [2025-09-17T07:39:58.397504] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-17T07:39:58.400263] [INFO ] [MAIN ] Derivative Progress: 1492/2172 symbols completed. PAR took 1.2s. Estimated remaining: 4m 15s. Rate: 160.2 symbols/min [2025-09-17T07:39:58.400943] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:58.415767] [DEBUG] [MAIN ] PARR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:58.416625] [INFO ] [MAIN ] PARR: Generated 1794 derivative records from 48464 primary records. [2025-09-17T07:39:58.417051] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-17T07:39:58.443479] [DEBUG] [LOCAL ] PARR: Derivative data saved (1794 records). [2025-09-17T07:39:58.443740] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-17T07:39:58.446064] [INFO ] [MAIN ] Derivative Progress: 1493/2172 symbols completed. PARR took 1.1s. Estimated remaining: 4m 14s. Rate: 160.3 symbols/min [2025-09-17T07:39:58.458965] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:58.459509] [DEBUG] [MAIN ] PATH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:58.460807] [INFO ] [MAIN ] PATH: Generated 1794 derivative records from 53678 primary records. [2025-09-17T07:39:58.467255] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-17T07:39:58.469923] [DEBUG] [LOCAL ] PAXS: Loaded 21177 existing records from primary storage. [2025-09-17T07:39:58.479633] [INFO ] [MAIN ] PAXS: Loaded 21177 primary data records. [2025-09-17T07:39:58.498265] [DEBUG] [LOCAL ] PATH: Derivative data saved (1794 records). [2025-09-17T07:39:58.508467] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-17T07:39:58.542044] [INFO ] [MAIN ] Derivative Progress: 1494/2172 symbols completed. PATH took 1.2s. Estimated remaining: 4m 14s. Rate: 160.3 symbols/min [2025-09-17T07:39:58.554397] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:58.814388] [DEBUG] [LOCAL ] PAY: Loaded 38059 existing records from primary storage. [2025-09-17T07:39:58.814765] [INFO ] [MAIN ] PAY: Loaded 38059 primary data records. [2025-09-17T07:39:58.963201] [DEBUG] [LOCAL ] PAYC: Loaded 36455 existing records from primary storage. [2025-09-17T07:39:58.992489] [INFO ] [MAIN ] PAYC: Loaded 36455 primary data records. [2025-09-17T07:39:59.455569] [DEBUG] [MAIN ] PAXS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:59.456850] [INFO ] [MAIN ] PAXS: Generated 1794 derivative records from 21177 primary records. [2025-09-17T07:39:59.458220] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-17T07:39:59.487288] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1794 records). [2025-09-17T07:39:59.492828] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-17T07:39:59.495090] [INFO ] [MAIN ] Derivative Progress: 1495/2172 symbols completed. PAXS took 1.1s. Estimated remaining: 4m 14s. Rate: 160.2 symbols/min [2025-09-17T07:39:59.492765] [DEBUG] [MAIN ] PAY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:59.496316] [INFO ] [MAIN ] PAY: Generated 1794 derivative records from 38059 primary records. [2025-09-17T07:39:59.496721] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:59.496502] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-17T07:39:59.535323] [DEBUG] [MAIN ] PAYC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:39:59.536256] [INFO ] [MAIN ] PAYC: Generated 1794 derivative records from 36455 primary records. [2025-09-17T07:39:59.536434] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-17T07:39:59.535384] [DEBUG] [LOCAL ] PAY: Derivative data saved (1794 records). [2025-09-17T07:39:59.537329] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-17T07:39:59.539846] [INFO ] [MAIN ] Derivative Progress: 1496/2172 symbols completed. PAY took 1.1s. Estimated remaining: 4m 13s. Rate: 160.3 symbols/min [2025-09-17T07:39:59.551937] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:59.556859] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1794 records). [2025-09-17T07:39:59.566045] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-17T07:39:59.568583] [INFO ] [MAIN ] Derivative Progress: 1497/2172 symbols completed. PAYC took 1.0s. Estimated remaining: 4m 13s. Rate: 160.4 symbols/min [2025-09-17T07:39:59.568931] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:39:59.585304] [DEBUG] [LOCAL ] PB: Loaded 41317 existing records from primary storage. [2025-09-17T07:39:59.585688] [INFO ] [MAIN ] PB: Loaded 41317 primary data records. [2025-09-17T07:39:59.967850] [DEBUG] [LOCAL ] PBA: Loaded 49111 existing records from primary storage. [2025-09-17T07:39:59.969592] [INFO ] [MAIN ] PBA: Loaded 49111 primary data records. [2025-09-17T07:39:59.970446] [DEBUG] [LOCAL ] PBF: Loaded 53093 existing records from primary storage. [2025-09-17T07:40:00.002514] [INFO ] [MAIN ] PBF: Loaded 53093 primary data records. [2025-09-17T07:40:00.590613] [DEBUG] [MAIN ] PB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:00.592463] [INFO ] [MAIN ] PB: Generated 1794 derivative records from 41317 primary records. [2025-09-17T07:40:00.592787] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-17T07:40:00.615148] [DEBUG] [LOCAL ] PB: Derivative data saved (1794 records). [2025-09-17T07:40:00.615546] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-17T07:40:00.618237] [INFO ] [MAIN ] Derivative Progress: 1498/2172 symbols completed. PB took 1.1s. Estimated remaining: 4m 12s. Rate: 160.2 symbols/min [2025-09-17T07:40:00.638827] [DEBUG] [MAIN ] PBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:00.651367] [INFO ] [MAIN ] PBA: Generated 1794 derivative records from 49111 primary records. [2025-09-17T07:40:00.651776] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-17T07:40:00.651729] [DEBUG] [MAIN ] PBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:00.652675] [INFO ] [MAIN ] PBF: Generated 1794 derivative records from 53093 primary records. [2025-09-17T07:40:00.652998] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-17T07:40:00.682428] [DEBUG] [LOCAL ] PBA: Derivative data saved (1794 records). [2025-09-17T07:40:00.683432] [DEBUG] [LOCAL ] PBF: Derivative data saved (1794 records). [2025-09-17T07:40:00.683580] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-17T07:40:00.683630] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-17T07:40:00.686328] [INFO ] [MAIN ] Derivative Progress: 1499/2172 symbols completed. PBA took 1.1s. Estimated remaining: 4m 12s. Rate: 160.3 symbols/min [2025-09-17T07:40:00.689287] [INFO ] [MAIN ] Derivative Progress: 1500/2172 symbols completed. PBF took 1.1s. Estimated remaining: 4m 11s. Rate: 160.4 symbols/min [2025-09-17T07:40:00.689719] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:00.689807] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:00.689895] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:00.725369] [DEBUG] [LOCAL ] PBH: Loaded 31362 existing records from primary storage. [2025-09-17T07:40:00.725548] [INFO ] [MAIN ] PBH: Loaded 31362 primary data records. [2025-09-17T07:40:00.973804] [DEBUG] [LOCAL ] PBI: Loaded 50164 existing records from primary storage. [2025-09-17T07:40:01.096218] [DEBUG] [LOCAL ] PBR: Loaded 53715 existing records from primary storage. [2025-09-17T07:40:01.096334] [INFO ] [MAIN ] PBI: Loaded 50164 primary data records. [2025-09-17T07:40:01.097721] [INFO ] [MAIN ] PBR: Loaded 53715 primary data records. [2025-09-17T07:40:01.835474] [DEBUG] [MAIN ] PBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:01.836410] [INFO ] [MAIN ] PBH: Generated 1794 derivative records from 31362 primary records. [2025-09-17T07:40:01.934337] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-17T07:40:02.133080] [DEBUG] [LOCAL ] PBH: Derivative data saved (1794 records). [2025-09-17T07:40:02.133373] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-17T07:40:02.135945] [INFO ] [MAIN ] Derivative Progress: 1501/2172 symbols completed. PBH took 1.4s. Estimated remaining: 4m 12s. Rate: 160.1 symbols/min [2025-09-17T07:40:02.137939] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:02.168867] [DEBUG] [LOCAL ] PBT: Loaded 17639 existing records from primary storage. [2025-09-17T07:40:02.171566] [INFO ] [MAIN ] PBT: Loaded 17639 primary data records. [2025-09-17T07:40:02.282169] [DEBUG] [MAIN ] PBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:02.331461] [INFO ] [MAIN ] PBR: Generated 1794 derivative records from 53715 primary records. [2025-09-17T07:40:02.346182] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-17T07:40:02.335363] [DEBUG] [MAIN ] PBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:02.353362] [INFO ] [MAIN ] PBI: Generated 1794 derivative records from 50164 primary records. [2025-09-17T07:40:02.358906] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-17T07:40:02.590883] [DEBUG] [LOCAL ] PBR: Derivative data saved (1794 records). [2025-09-17T07:40:02.592673] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-17T07:40:02.596731] [INFO ] [MAIN ] Derivative Progress: 1502/2172 symbols completed. PBR took 1.9s. Estimated remaining: 4m 11s. Rate: 160.0 symbols/min [2025-09-17T07:40:02.597281] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:02.600947] [DEBUG] [LOCAL ] PBI: Derivative data saved (1794 records). [2025-09-17T07:40:02.601635] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-17T07:40:02.604267] [INFO ] [MAIN ] Derivative Progress: 1503/2172 symbols completed. PBI took 1.9s. Estimated remaining: 4m 11s. Rate: 160.2 symbols/min [2025-09-17T07:40:02.604827] [INFO ] [MAIN ] PCG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:02.615220] [DEBUG] [LOCAL ] PCF: Loaded 8753 existing records from primary storage. [2025-09-17T07:40:02.615552] [INFO ] [MAIN ] PCF: Loaded 8753 primary data records. [2025-09-17T07:40:02.837303] [DEBUG] [MAIN ] PBT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:02.952479] [INFO ] [MAIN ] PBT: Generated 1794 derivative records from 17639 primary records. [2025-09-17T07:40:02.952678] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-17T07:40:02.987496] [DEBUG] [LOCAL ] PCG: Loaded 53718 existing records from primary storage. [2025-09-17T07:40:02.989960] [DEBUG] [LOCAL ] PBT: Derivative data saved (1794 records). [2025-09-17T07:40:02.989298] [INFO ] [MAIN ] PCG: Loaded 53718 primary data records. [2025-09-17T07:40:02.990467] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-17T07:40:02.992782] [INFO ] [MAIN ] Derivative Progress: 1504/2172 symbols completed. PBT took 0.9s. Estimated remaining: 4m 10s. Rate: 160.1 symbols/min [2025-09-17T07:40:03.035299] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:03.299256] [DEBUG] [LOCAL ] PCM: Loaded 6779 existing records from primary storage. [2025-09-17T07:40:03.299547] [INFO ] [MAIN ] PCM: Loaded 6779 primary data records. [2025-09-17T07:40:03.466788] [DEBUG] [MAIN ] PCF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:03.505150] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 8753 primary records. [2025-09-17T07:40:03.625063] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-17T07:40:03.665286] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-09-17T07:40:03.666513] [DEBUG] [MAIN ] PCG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:03.667399] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-17T07:40:03.668183] [INFO ] [MAIN ] PCG: Generated 1794 derivative records from 53718 primary records. [2025-09-17T07:40:03.671107] [INFO ] [MAIN ] Derivative Progress: 1505/2172 symbols completed. PCF took 1.1s. Estimated remaining: 4m 10s. Rate: 160.1 symbols/min [2025-09-17T07:40:03.672092] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:03.672173] [DEBUG] [LOCAL ] PCG: Saving derivative data. [2025-09-17T07:40:03.697085] [DEBUG] [LOCAL ] PCG: Derivative data saved (1794 records). [2025-09-17T07:40:03.705613] [INFO ] [MAIN ] PCG: Successfully saved derivative data. [2025-09-17T07:40:03.717412] [DEBUG] [MAIN ] PCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:03.719742] [INFO ] [MAIN ] Derivative Progress: 1506/2172 symbols completed. PCG took 1.1s. Estimated remaining: 4m 10s. Rate: 160.2 symbols/min [2025-09-17T07:40:03.720805] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6779 primary records. [2025-09-17T07:40:03.721117] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:03.721262] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-17T07:40:03.747358] [DEBUG] [LOCAL ] PCN: Loaded 24169 existing records from primary storage. [2025-09-17T07:40:03.748271] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-09-17T07:40:03.748528] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-17T07:40:03.748591] [INFO ] [MAIN ] PCN: Loaded 24169 primary data records. [2025-09-17T07:40:03.751155] [INFO ] [MAIN ] Derivative Progress: 1507/2172 symbols completed. PCM took 0.7s. Estimated remaining: 4m 9s. Rate: 160.2 symbols/min [2025-09-17T07:40:03.756988] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:03.969929] [DEBUG] [LOCAL ] PCOR: Loaded 48151 existing records from primary storage. [2025-09-17T07:40:03.968523] [DEBUG] [LOCAL ] PCQ: Loaded 11994 existing records from primary storage. [2025-09-17T07:40:04.074880] [INFO ] [MAIN ] PCOR: Loaded 48151 primary data records. [2025-09-17T07:40:04.075185] [INFO ] [MAIN ] PCQ: Loaded 11994 primary data records. [2025-09-17T07:40:04.802073] [DEBUG] [MAIN ] PCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:04.803310] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 24169 primary records. [2025-09-17T07:40:04.803784] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-17T07:40:04.825609] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-09-17T07:40:04.826611] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-17T07:40:04.829506] [INFO ] [MAIN ] Derivative Progress: 1508/2172 symbols completed. PCN took 1.2s. Estimated remaining: 4m 9s. Rate: 160.1 symbols/min [2025-09-17T07:40:04.844361] [DEBUG] [MAIN ] PCQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:04.843884] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:04.858472] [DEBUG] [MAIN ] PCOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:04.858195] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 11994 primary records. [2025-09-17T07:40:04.859299] [INFO ] [MAIN ] PCOR: Generated 1794 derivative records from 48151 primary records. [2025-09-17T07:40:04.859598] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-17T07:40:04.859703] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-17T07:40:04.888855] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1794 records). [2025-09-17T07:40:04.890058] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-17T07:40:04.894309] [INFO ] [MAIN ] Derivative Progress: 1509/2172 symbols completed. PCOR took 1.2s. Estimated remaining: 4m 8s. Rate: 160.1 symbols/min [2025-09-17T07:40:04.894916] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:04.899372] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-09-17T07:40:04.899573] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-17T07:40:04.902846] [INFO ] [MAIN ] Derivative Progress: 1510/2172 symbols completed. PCQ took 1.1s. Estimated remaining: 4m 8s. Rate: 160.2 symbols/min [2025-09-17T07:40:04.903454] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:04.960588] [DEBUG] [LOCAL ] PD: Loaded 47686 existing records from primary storage. [2025-09-17T07:40:04.960891] [INFO ] [MAIN ] PD: Loaded 47686 primary data records. [2025-09-17T07:40:05.065570] [DEBUG] [LOCAL ] PDM: Loaded 39865 existing records from primary storage. [2025-09-17T07:40:05.101292] [INFO ] [MAIN ] PDM: Loaded 39865 primary data records. [2025-09-17T07:40:05.134233] [DEBUG] [LOCAL ] PDI: Loaded 50271 existing records from primary storage. [2025-09-17T07:40:05.217945] [INFO ] [MAIN ] PDI: Loaded 50271 primary data records. [2025-09-17T07:40:05.936297] [DEBUG] [MAIN ] PD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:05.938514] [INFO ] [MAIN ] PD: Generated 1794 derivative records from 47686 primary records. [2025-09-17T07:40:05.938792] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-17T07:40:05.964452] [DEBUG] [MAIN ] PDM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:05.967815] [INFO ] [MAIN ] PDM: Generated 1794 derivative records from 39865 primary records. [2025-09-17T07:40:05.968532] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-17T07:40:05.969674] [DEBUG] [LOCAL ] PD: Derivative data saved (1794 records). [2025-09-17T07:40:05.970110] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-17T07:40:05.979447] [INFO ] [MAIN ] Derivative Progress: 1511/2172 symbols completed. PD took 1.1s. Estimated remaining: 4m 8s. Rate: 160.0 symbols/min [2025-09-17T07:40:05.984180] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:05.989859] [DEBUG] [LOCAL ] PDM: Derivative data saved (1794 records). [2025-09-17T07:40:05.990094] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-17T07:40:05.993212] [INFO ] [MAIN ] Derivative Progress: 1512/2172 symbols completed. PDM took 1.1s. Estimated remaining: 4m 7s. Rate: 160.1 symbols/min [2025-09-17T07:40:06.006591] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:06.006533] [DEBUG] [MAIN ] PDI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:06.007435] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50271 primary records. [2025-09-17T07:40:06.007764] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-17T07:40:06.026718] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-09-17T07:40:06.026968] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-17T07:40:06.029370] [INFO ] [MAIN ] Derivative Progress: 1513/2172 symbols completed. PDI took 1.1s. Estimated remaining: 4m 7s. Rate: 160.2 symbols/min [2025-09-17T07:40:06.052972] [DEBUG] [LOCAL ] PDS: Loaded 18821 existing records from primary storage. [2025-09-17T07:40:06.053145] [INFO ] [MAIN ] PDS: Loaded 18821 primary data records. [2025-09-17T07:40:06.164775] [DEBUG] [LOCAL ] PDO: Loaded 32021 existing records from primary storage. [2025-09-17T07:40:06.180632] [INFO ] [MAIN ] PDO: Loaded 32021 primary data records. [2025-09-17T07:40:06.690838] [DEBUG] [MAIN ] PDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:06.691601] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 18821 primary records. [2025-09-17T07:40:06.692341] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-17T07:40:06.708629] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-09-17T07:40:06.708729] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-17T07:40:06.710482] [INFO ] [MAIN ] Derivative Progress: 1514/2172 symbols completed. PDS took 0.7s. Estimated remaining: 4m 7s. Rate: 160.2 symbols/min [2025-09-17T07:40:06.725835] [DEBUG] [MAIN ] PDO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:06.726388] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 32021 primary records. [2025-09-17T07:40:06.726463] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-17T07:40:06.742169] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-09-17T07:40:06.742239] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-17T07:40:06.744671] [INFO ] [MAIN ] Derivative Progress: 1515/2172 symbols completed. PDO took 0.8s. Estimated remaining: 4m 6s. Rate: 160.3 symbols/min [2025-09-17T07:40:06.745114] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:06.745201] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:06.745313] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:06.766927] [DEBUG] [LOCAL ] PDX: Loaded 14635 existing records from primary storage. [2025-09-17T07:40:06.767107] [INFO ] [MAIN ] PDX: Loaded 14635 primary data records. [2025-09-17T07:40:06.873690] [DEBUG] [LOCAL ] PDT: Loaded 17578 existing records from primary storage. [2025-09-17T07:40:06.876904] [INFO ] [MAIN ] PDT: Loaded 17578 primary data records. [2025-09-17T07:40:07.237910] [DEBUG] [LOCAL ] PEB: Loaded 50711 existing records from primary storage. [2025-09-17T07:40:07.272005] [INFO ] [MAIN ] PEB: Loaded 50711 primary data records. [2025-09-17T07:40:07.719717] [DEBUG] [MAIN ] PDX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:07.721076] [INFO ] [MAIN ] PDX: Generated 1794 derivative records from 14635 primary records. [2025-09-17T07:40:07.722056] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-17T07:40:07.752798] [DEBUG] [LOCAL ] PDX: Derivative data saved (1794 records). [2025-09-17T07:40:07.753039] [DEBUG] [MAIN ] PDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:07.753209] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-17T07:40:07.754066] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17578 primary records. [2025-09-17T07:40:07.756154] [INFO ] [MAIN ] Derivative Progress: 1516/2172 symbols completed. PDX took 1.0s. Estimated remaining: 4m 6s. Rate: 160.1 symbols/min [2025-09-17T07:40:07.756526] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-17T07:40:07.756583] [INFO ] [MAIN ] PEG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:07.773806] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-09-17T07:40:07.773955] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-17T07:40:07.776191] [INFO ] [MAIN ] Derivative Progress: 1517/2172 symbols completed. PDT took 1.0s. Estimated remaining: 4m 5s. Rate: 160.2 symbols/min [2025-09-17T07:40:07.776812] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:07.793849] [DEBUG] [MAIN ] PEB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:07.794703] [INFO ] [MAIN ] PEB: Generated 1794 derivative records from 50711 primary records. [2025-09-17T07:40:07.794827] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-17T07:40:07.812436] [DEBUG] [LOCAL ] PEB: Derivative data saved (1794 records). [2025-09-17T07:40:07.812666] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-17T07:40:07.815260] [INFO ] [MAIN ] Derivative Progress: 1518/2172 symbols completed. PEB took 1.1s. Estimated remaining: 4m 5s. Rate: 160.3 symbols/min [2025-09-17T07:40:07.815754] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:07.847461] [DEBUG] [LOCAL ] PEO: Loaded 10880 existing records from primary storage. [2025-09-17T07:40:07.847618] [INFO ] [MAIN ] PEO: Loaded 10880 primary data records. [2025-09-17T07:40:07.972666] [DEBUG] [LOCAL ] PEN: Loaded 30797 existing records from primary storage. [2025-09-17T07:40:07.974101] [DEBUG] [LOCAL ] PEG: Loaded 53144 existing records from primary storage. [2025-09-17T07:40:07.972883] [INFO ] [MAIN ] PEN: Loaded 30797 primary data records. [2025-09-17T07:40:07.979434] [INFO ] [MAIN ] PEG: Loaded 53144 primary data records. [2025-09-17T07:40:08.836501] [DEBUG] [MAIN ] PEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:08.837615] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 10880 primary records. [2025-09-17T07:40:08.838101] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-17T07:40:08.874241] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-09-17T07:40:08.873007] [DEBUG] [MAIN ] PEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:08.887673] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-17T07:40:08.887475] [INFO ] [MAIN ] PEN: Generated 1794 derivative records from 30797 primary records. [2025-09-17T07:40:08.890398] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-17T07:40:08.890270] [DEBUG] [MAIN ] PEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:08.889938] [INFO ] [MAIN ] Derivative Progress: 1519/2172 symbols completed. PEO took 1.1s. Estimated remaining: 4m 5s. Rate: 160.1 symbols/min [2025-09-17T07:40:08.890687] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:08.891328] [INFO ] [MAIN ] PEG: Generated 1794 derivative records from 53144 primary records. [2025-09-17T07:40:08.892404] [DEBUG] [LOCAL ] PEG: Saving derivative data. [2025-09-17T07:40:08.919756] [DEBUG] [LOCAL ] PEN: Derivative data saved (1794 records). [2025-09-17T07:40:08.924763] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-17T07:40:08.929196] [INFO ] [MAIN ] Derivative Progress: 1520/2172 symbols completed. PEN took 1.2s. Estimated remaining: 4m 4s. Rate: 160.2 symbols/min [2025-09-17T07:40:08.930037] [DEBUG] [LOCAL ] PEG: Derivative data saved (1794 records). [2025-09-17T07:40:08.930298] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:08.930507] [INFO ] [MAIN ] PEG: Successfully saved derivative data. [2025-09-17T07:40:08.933867] [INFO ] [MAIN ] Derivative Progress: 1521/2172 symbols completed. PEG took 1.2s. Estimated remaining: 4m 4s. Rate: 160.3 symbols/min [2025-09-17T07:40:08.939812] [INFO ] [MAIN ] PFE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:08.940164] [DEBUG] [LOCAL ] PERF: Loaded 14131 existing records from primary storage. [2025-09-17T07:40:08.940473] [INFO ] [MAIN ] PERF: Loaded 14131 primary data records. [2025-09-17T07:40:09.031919] [DEBUG] [LOCAL ] PFD: Loaded 5090 existing records from primary storage. [2025-09-17T07:40:09.049774] [INFO ] [MAIN ] PFD: Loaded 5090 primary data records. [2025-09-17T07:40:09.589180] [DEBUG] [LOCAL ] PFE: Loaded 53813 existing records from primary storage. [2025-09-17T07:40:09.589773] [INFO ] [MAIN ] PFE: Loaded 53813 primary data records. [2025-09-17T07:40:09.958844] [DEBUG] [MAIN ] PERF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:09.959801] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14131 primary records. [2025-09-17T07:40:09.960686] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-17T07:40:09.978919] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-09-17T07:40:09.979580] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-17T07:40:09.982411] [INFO ] [MAIN ] Derivative Progress: 1522/2172 symbols completed. PERF took 1.1s. Estimated remaining: 4m 4s. Rate: 160.1 symbols/min [2025-09-17T07:40:09.983751] [INFO ] [MAIN ] PFGC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:10.000715] [DEBUG] [MAIN ] PFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:10.001466] [INFO ] [MAIN ] PFD: Generated 1794 derivative records from 5090 primary records. [2025-09-17T07:40:10.001881] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-17T07:40:10.018028] [DEBUG] [LOCAL ] PFD: Derivative data saved (1794 records). [2025-09-17T07:40:10.018185] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-17T07:40:10.021064] [INFO ] [MAIN ] Derivative Progress: 1523/2172 symbols completed. PFD took 1.1s. Estimated remaining: 4m 3s. Rate: 160.2 symbols/min [2025-09-17T07:40:10.022131] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:10.041243] [DEBUG] [MAIN ] PFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:10.044349] [INFO ] [MAIN ] PFE: Generated 1794 derivative records from 53813 primary records. [2025-09-17T07:40:10.044567] [DEBUG] [LOCAL ] PFE: Saving derivative data. [2025-09-17T07:40:10.058861] [DEBUG] [LOCAL ] PFH: Loaded 6959 existing records from primary storage. [2025-09-17T07:40:10.063890] [INFO ] [MAIN ] PFH: Loaded 6959 primary data records. [2025-09-17T07:40:10.132453] [DEBUG] [LOCAL ] PFE: Derivative data saved (1794 records). [2025-09-17T07:40:10.142322] [INFO ] [MAIN ] PFE: Successfully saved derivative data. [2025-09-17T07:40:10.163432] [INFO ] [MAIN ] Derivative Progress: 1524/2172 symbols completed. PFE took 1.2s. Estimated remaining: 4m 3s. Rate: 160.2 symbols/min [2025-09-17T07:40:10.175090] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:10.202577] [DEBUG] [LOCAL ] PFGC: Loaded 47003 existing records from primary storage. [2025-09-17T07:40:10.258591] [INFO ] [MAIN ] PFGC: Loaded 47003 primary data records. [2025-09-17T07:40:10.513559] [DEBUG] [LOCAL ] PFL: Loaded 13859 existing records from primary storage. [2025-09-17T07:40:10.518034] [INFO ] [MAIN ] PFL: Loaded 13859 primary data records. [2025-09-17T07:40:11.045809] [DEBUG] [MAIN ] PFH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:11.047000] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6959 primary records. [2025-09-17T07:40:11.047362] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-17T07:40:11.068129] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-09-17T07:40:11.069346] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-17T07:40:11.072418] [INFO ] [MAIN ] Derivative Progress: 1525/2172 symbols completed. PFH took 1.1s. Estimated remaining: 4m 2s. Rate: 160.1 symbols/min [2025-09-17T07:40:11.073375] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:11.087462] [DEBUG] [MAIN ] PFGC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:11.089257] [INFO ] [MAIN ] PFGC: Generated 1794 derivative records from 47003 primary records. [2025-09-17T07:40:11.091143] [DEBUG] [LOCAL ] PFGC: Saving derivative data. [2025-09-17T07:40:11.106154] [DEBUG] [MAIN ] PFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:11.119838] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 13859 primary records. [2025-09-17T07:40:11.121867] [DEBUG] [LOCAL ] PFGC: Derivative data saved (1794 records). [2025-09-17T07:40:11.121942] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-17T07:40:11.122187] [INFO ] [MAIN ] PFGC: Successfully saved derivative data. [2025-09-17T07:40:11.125449] [INFO ] [MAIN ] Derivative Progress: 1526/2172 symbols completed. PFGC took 1.1s. Estimated remaining: 4m 2s. Rate: 160.2 symbols/min [2025-09-17T07:40:11.133160] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:11.142271] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-09-17T07:40:11.142551] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-17T07:40:11.145141] [INFO ] [MAIN ] Derivative Progress: 1527/2172 symbols completed. PFL took 1.0s. Estimated remaining: 4m 1s. Rate: 160.3 symbols/min [2025-09-17T07:40:11.145535] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:11.167117] [DEBUG] [LOCAL ] PFO: Loaded 5667 existing records from primary storage. [2025-09-17T07:40:11.167418] [INFO ] [MAIN ] PFO: Loaded 5667 primary data records. [2025-09-17T07:40:11.292784] [DEBUG] [LOCAL ] PFN: Loaded 21775 existing records from primary storage. [2025-09-17T07:40:11.294039] [DEBUG] [LOCAL ] PFLT: Loaded 43664 existing records from primary storage. [2025-09-17T07:40:11.305020] [INFO ] [MAIN ] PFLT: Loaded 43664 primary data records. [2025-09-17T07:40:11.294496] [INFO ] [MAIN ] PFN: Loaded 21775 primary data records. [2025-09-17T07:40:12.168309] [DEBUG] [MAIN ] PFO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:12.169991] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 5667 primary records. [2025-09-17T07:40:12.171169] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-17T07:40:12.205020] [DEBUG] [MAIN ] PFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:12.207750] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-09-17T07:40:12.209250] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-17T07:40:12.210044] [INFO ] [MAIN ] PFLT: Generated 1794 derivative records from 43664 primary records. [2025-09-17T07:40:12.213137] [INFO ] [MAIN ] Derivative Progress: 1528/2172 symbols completed. PFO took 1.1s. Estimated remaining: 4m 1s. Rate: 160.1 symbols/min [2025-09-17T07:40:12.214085] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-17T07:40:12.241230] [DEBUG] [MAIN ] PFN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:12.246004] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1794 records). [2025-09-17T07:40:12.246099] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 21775 primary records. [2025-09-17T07:40:12.246400] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-17T07:40:12.246479] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-17T07:40:12.249793] [INFO ] [MAIN ] Derivative Progress: 1529/2172 symbols completed. PFLT took 1.2s. Estimated remaining: 4m 1s. Rate: 160.2 symbols/min [2025-09-17T07:40:12.265471] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-09-17T07:40:12.265682] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-17T07:40:12.268171] [INFO ] [MAIN ] Derivative Progress: 1530/2172 symbols completed. PFN took 1.1s. Estimated remaining: 4m 0s. Rate: 160.3 symbols/min [2025-09-17T07:40:12.268917] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:12.269048] [INFO ] [MAIN ] PG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:12.269110] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:12.313381] [DEBUG] [LOCAL ] PFSI: Loaded 28599 existing records from primary storage. [2025-09-17T07:40:12.313541] [INFO ] [MAIN ] PFSI: Loaded 28599 primary data records. [2025-09-17T07:40:12.446445] [DEBUG] [LOCAL ] PFS: Loaded 35764 existing records from primary storage. [2025-09-17T07:40:12.460944] [INFO ] [MAIN ] PFS: Loaded 35764 primary data records. [2025-09-17T07:40:12.479162] [DEBUG] [LOCAL ] PG: Loaded 53752 existing records from primary storage. [2025-09-17T07:40:12.587189] [INFO ] [MAIN ] PG: Loaded 53752 primary data records. [2025-09-17T07:40:13.277134] [DEBUG] [MAIN ] PFSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:13.278225] [INFO ] [MAIN ] PFSI: Generated 1794 derivative records from 28599 primary records. [2025-09-17T07:40:13.278894] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-17T07:40:13.297578] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1794 records). [2025-09-17T07:40:13.298427] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-17T07:40:13.300379] [INFO ] [MAIN ] Derivative Progress: 1531/2172 symbols completed. PFSI took 1.0s. Estimated remaining: 4m 0s. Rate: 160.1 symbols/min [2025-09-17T07:40:13.301012] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:13.318743] [DEBUG] [MAIN ] PFS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:13.322228] [INFO ] [MAIN ] PFS: Generated 1794 derivative records from 35764 primary records. [2025-09-17T07:40:13.330523] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-17T07:40:13.348582] [DEBUG] [LOCAL ] PGP: Loaded 5459 existing records from primary storage. [2025-09-17T07:40:13.351754] [DEBUG] [MAIN ] PG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:13.355890] [DEBUG] [LOCAL ] PFS: Derivative data saved (1794 records). [2025-09-17T07:40:13.356720] [INFO ] [MAIN ] PG: Generated 1794 derivative records from 53752 primary records. [2025-09-17T07:40:13.352150] [INFO ] [MAIN ] PGP: Loaded 5459 primary data records. [2025-09-17T07:40:13.356011] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-17T07:40:13.370663] [DEBUG] [LOCAL ] PG: Saving derivative data. [2025-09-17T07:40:13.370572] [INFO ] [MAIN ] Derivative Progress: 1532/2172 symbols completed. PFS took 1.1s. Estimated remaining: 3m 60s. Rate: 160.2 symbols/min [2025-09-17T07:40:13.437296] [INFO ] [MAIN ] PGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:13.494052] [DEBUG] [LOCAL ] PG: Derivative data saved (1794 records). [2025-09-17T07:40:13.494547] [INFO ] [MAIN ] PG: Successfully saved derivative data. [2025-09-17T07:40:13.518344] [INFO ] [MAIN ] Derivative Progress: 1533/2172 symbols completed. PG took 1.2s. Estimated remaining: 3m 59s. Rate: 160.2 symbols/min [2025-09-17T07:40:13.574742] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:13.731209] [DEBUG] [MAIN ] PGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:13.746680] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5459 primary records. [2025-09-17T07:40:13.748737] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-17T07:40:13.748559] [DEBUG] [LOCAL ] PGR: Loaded 52999 existing records from primary storage. [2025-09-17T07:40:13.749837] [INFO ] [MAIN ] PGR: Loaded 52999 primary data records. [2025-09-17T07:40:13.817985] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-09-17T07:40:13.863108] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-17T07:40:13.897172] [INFO ] [MAIN ] Derivative Progress: 1534/2172 symbols completed. PGP took 0.6s. Estimated remaining: 3m 59s. Rate: 160.2 symbols/min [2025-09-17T07:40:13.904074] [DEBUG] [LOCAL ] PGRE: Loaded 46058 existing records from primary storage. [2025-09-17T07:40:13.919984] [INFO ] [MAIN ] PGRE: Loaded 46058 primary data records. [2025-09-17T07:40:13.904299] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:14.250951] [DEBUG] [LOCAL ] PGZ: Loaded 5424 existing records from primary storage. [2025-09-17T07:40:14.323716] [INFO ] [MAIN ] PGZ: Loaded 5424 primary data records. [2025-09-17T07:40:14.760867] [DEBUG] [MAIN ] PGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:14.762319] [INFO ] [MAIN ] PGR: Generated 1794 derivative records from 52999 primary records. [2025-09-17T07:40:14.762914] [DEBUG] [LOCAL ] PGR: Saving derivative data. [2025-09-17T07:40:14.798048] [DEBUG] [LOCAL ] PGR: Derivative data saved (1794 records). [2025-09-17T07:40:14.799325] [DEBUG] [MAIN ] PGRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:14.800466] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46058 primary records. [2025-09-17T07:40:14.799552] [INFO ] [MAIN ] PGR: Successfully saved derivative data. [2025-09-17T07:40:14.801068] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-17T07:40:14.803106] [INFO ] [MAIN ] Derivative Progress: 1535/2172 symbols completed. PGR took 1.4s. Estimated remaining: 3m 59s. Rate: 160.1 symbols/min [2025-09-17T07:40:14.804717] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:14.837845] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-09-17T07:40:14.838627] [DEBUG] [MAIN ] PGZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:14.838830] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-17T07:40:14.839452] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5424 primary records. [2025-09-17T07:40:14.839703] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-17T07:40:14.842334] [INFO ] [MAIN ] Derivative Progress: 1536/2172 symbols completed. PGRE took 1.3s. Estimated remaining: 3m 58s. Rate: 160.2 symbols/min [2025-09-17T07:40:14.843635] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:14.860313] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-09-17T07:40:14.860522] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-17T07:40:14.863264] [INFO ] [MAIN ] Derivative Progress: 1537/2172 symbols completed. PGZ took 1.0s. Estimated remaining: 3m 58s. Rate: 160.3 symbols/min [2025-09-17T07:40:14.863776] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:14.882840] [DEBUG] [LOCAL ] PHD: Loaded 9559 existing records from primary storage. [2025-09-17T07:40:14.883200] [INFO ] [MAIN ] PHD: Loaded 9559 primary data records. [2025-09-17T07:40:14.988317] [DEBUG] [LOCAL ] PH: Loaded 39450 existing records from primary storage. [2025-09-17T07:40:15.008127] [INFO ] [MAIN ] PH: Loaded 39450 primary data records. [2025-09-17T07:40:15.243557] [DEBUG] [LOCAL ] PHG: Loaded 46302 existing records from primary storage. [2025-09-17T07:40:15.386296] [INFO ] [MAIN ] PHG: Loaded 46302 primary data records. [2025-09-17T07:40:15.909666] [DEBUG] [MAIN ] PHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:15.911003] [INFO ] [MAIN ] PHD: Generated 1794 derivative records from 9559 primary records. [2025-09-17T07:40:15.911410] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-17T07:40:15.937938] [DEBUG] [MAIN ] PH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:15.943579] [INFO ] [MAIN ] PH: Generated 1794 derivative records from 39450 primary records. [2025-09-17T07:40:15.944040] [DEBUG] [LOCAL ] PHD: Derivative data saved (1794 records). [2025-09-17T07:40:15.944443] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-17T07:40:15.944351] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-17T07:40:15.946700] [INFO ] [MAIN ] Derivative Progress: 1538/2172 symbols completed. PHD took 1.1s. Estimated remaining: 3m 58s. Rate: 160.1 symbols/min [2025-09-17T07:40:15.948386] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:15.967111] [DEBUG] [LOCAL ] PH: Derivative data saved (1794 records). [2025-09-17T07:40:15.967351] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-17T07:40:15.969656] [INFO ] [MAIN ] Derivative Progress: 1539/2172 symbols completed. PH took 1.2s. Estimated remaining: 3m 57s. Rate: 160.2 symbols/min [2025-09-17T07:40:15.970796] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:15.992101] [DEBUG] [MAIN ] PHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:15.993510] [INFO ] [MAIN ] PHG: Generated 1794 derivative records from 46302 primary records. [2025-09-17T07:40:15.999670] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-17T07:40:16.000477] [DEBUG] [LOCAL ] PHI: Loaded 14815 existing records from primary storage. [2025-09-17T07:40:16.001237] [INFO ] [MAIN ] PHI: Loaded 14815 primary data records. [2025-09-17T07:40:16.155402] [DEBUG] [LOCAL ] PHG: Derivative data saved (1794 records). [2025-09-17T07:40:16.217902] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-17T07:40:16.225156] [DEBUG] [LOCAL ] PHIN: Loaded 33538 existing records from primary storage. [2025-09-17T07:40:16.229558] [INFO ] [MAIN ] Derivative Progress: 1540/2172 symbols completed. PHG took 1.4s. Estimated remaining: 3m 57s. Rate: 160.2 symbols/min [2025-09-17T07:40:16.347731] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:16.336687] [INFO ] [MAIN ] PHIN: Loaded 33538 primary data records. [2025-09-17T07:40:16.576015] [DEBUG] [LOCAL ] PHK: Loaded 26713 existing records from primary storage. [2025-09-17T07:40:16.696116] [INFO ] [MAIN ] PHK: Loaded 26713 primary data records. [2025-09-17T07:40:16.867824] [DEBUG] [MAIN ] PHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:16.901476] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 14815 primary records. [2025-09-17T07:40:17.027763] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-17T07:40:17.045668] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-09-17T07:40:17.046594] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-17T07:40:17.049631] [INFO ] [MAIN ] Derivative Progress: 1541/2172 symbols completed. PHI took 1.1s. Estimated remaining: 3m 56s. Rate: 160.1 symbols/min [2025-09-17T07:40:17.051619] [INFO ] [MAIN ] PHM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:17.066386] [DEBUG] [MAIN ] PHIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:17.067222] [INFO ] [MAIN ] PHIN: Generated 1794 derivative records from 33538 primary records. [2025-09-17T07:40:17.067618] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-17T07:40:17.088859] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1794 records). [2025-09-17T07:40:17.089117] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-17T07:40:17.091617] [INFO ] [MAIN ] Derivative Progress: 1542/2172 symbols completed. PHIN took 1.1s. Estimated remaining: 3m 56s. Rate: 160.2 symbols/min [2025-09-17T07:40:17.092224] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:17.110637] [DEBUG] [MAIN ] PHK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:17.111723] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26713 primary records. [2025-09-17T07:40:17.111870] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-17T07:40:17.149455] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-09-17T07:40:17.149686] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-17T07:40:17.152114] [INFO ] [MAIN ] Derivative Progress: 1543/2172 symbols completed. PHK took 0.8s. Estimated remaining: 3m 55s. Rate: 160.3 symbols/min [2025-09-17T07:40:17.165490] [DEBUG] [LOCAL ] PHR: Loaded 36960 existing records from primary storage. [2025-09-17T07:40:17.166195] [INFO ] [MAIN ] PHR: Loaded 36960 primary data records. [2025-09-17T07:40:17.284111] [DEBUG] [LOCAL ] PHM: Loaded 51713 existing records from primary storage. [2025-09-17T07:40:17.284689] [INFO ] [MAIN ] PHM: Loaded 51713 primary data records. [2025-09-17T07:40:17.816114] [DEBUG] [MAIN ] PHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:17.816833] [INFO ] [MAIN ] PHR: Generated 1794 derivative records from 36960 primary records. [2025-09-17T07:40:17.816918] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-17T07:40:17.836776] [DEBUG] [LOCAL ] PHR: Derivative data saved (1794 records). [2025-09-17T07:40:17.849470] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-17T07:40:17.851677] [INFO ] [MAIN ] Derivative Progress: 1544/2172 symbols completed. PHR took 0.8s. Estimated remaining: 3m 55s. Rate: 160.2 symbols/min [2025-09-17T07:40:17.849401] [DEBUG] [MAIN ] PHM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:17.852418] [INFO ] [MAIN ] PHM: Generated 1794 derivative records from 51713 primary records. [2025-09-17T07:40:17.852699] [DEBUG] [LOCAL ] PHM: Saving derivative data. [2025-09-17T07:40:17.873898] [DEBUG] [LOCAL ] PHM: Derivative data saved (1794 records). [2025-09-17T07:40:17.874210] [INFO ] [MAIN ] PHM: Successfully saved derivative data. [2025-09-17T07:40:17.877174] [INFO ] [MAIN ] Derivative Progress: 1545/2172 symbols completed. PHM took 0.8s. Estimated remaining: 3m 55s. Rate: 160.3 symbols/min [2025-09-17T07:40:17.877948] [INFO ] [MAIN ] PHT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:17.878149] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:17.878357] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:17.893182] [DEBUG] [LOCAL ] PIM: Loaded 4766 existing records from primary storage. [2025-09-17T07:40:17.893532] [INFO ] [MAIN ] PIM: Loaded 4766 primary data records. [2025-09-17T07:40:17.971000] [DEBUG] [LOCAL ] PHT: Loaded 15346 existing records from primary storage. [2025-09-17T07:40:17.971190] [INFO ] [MAIN ] PHT: Loaded 15346 primary data records. [2025-09-17T07:40:18.414407] [DEBUG] [LOCAL ] PII: Loaded 49453 existing records from primary storage. [2025-09-17T07:40:18.538071] [INFO ] [MAIN ] PII: Loaded 49453 primary data records. [2025-09-17T07:40:18.877373] [DEBUG] [MAIN ] PIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:18.879346] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4766 primary records. [2025-09-17T07:40:18.880589] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-17T07:40:18.910832] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-09-17T07:40:18.911152] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-17T07:40:18.912412] [DEBUG] [MAIN ] PHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:18.914970] [INFO ] [MAIN ] Derivative Progress: 1546/2172 symbols completed. PIM took 1.0s. Estimated remaining: 3m 55s. Rate: 160.1 symbols/min [2025-09-17T07:40:18.916440] [INFO ] [MAIN ] PHT: Generated 1794 derivative records from 15346 primary records. [2025-09-17T07:40:18.916719] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:18.917000] [DEBUG] [LOCAL ] PHT: Saving derivative data. [2025-09-17T07:40:18.944087] [DEBUG] [LOCAL ] PHT: Derivative data saved (1794 records). [2025-09-17T07:40:18.949938] [DEBUG] [LOCAL ] PINE: Loaded 14240 existing records from primary storage. [2025-09-17T07:40:18.958323] [INFO ] [MAIN ] PINE: Loaded 14240 primary data records. [2025-09-17T07:40:18.950149] [INFO ] [MAIN ] PHT: Successfully saved derivative data. [2025-09-17T07:40:18.975048] [DEBUG] [MAIN ] PII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:19.010978] [INFO ] [MAIN ] Derivative Progress: 1547/2172 symbols completed. PHT took 1.1s. Estimated remaining: 3m 54s. Rate: 160.2 symbols/min [2025-09-17T07:40:19.033031] [INFO ] [MAIN ] PII: Generated 1794 derivative records from 49453 primary records. [2025-09-17T07:40:19.049147] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-17T07:40:19.064806] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:19.176322] [DEBUG] [LOCAL ] PII: Derivative data saved (1794 records). [2025-09-17T07:40:19.274620] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-17T07:40:19.292057] [INFO ] [MAIN ] Derivative Progress: 1548/2172 symbols completed. PII took 1.4s. Estimated remaining: 3m 54s. Rate: 160.2 symbols/min [2025-09-17T07:40:19.293165] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:19.328218] [DEBUG] [LOCAL ] PIPR: Loaded 15340 existing records from primary storage. [2025-09-17T07:40:19.328905] [INFO ] [MAIN ] PIPR: Loaded 15340 primary data records. [2025-09-17T07:40:19.453468] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-17T07:40:19.460415] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-09-17T07:40:19.759481] [DEBUG] [MAIN ] PINE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:19.781124] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14240 primary records. [2025-09-17T07:40:19.781884] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-17T07:40:20.047837] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-09-17T07:40:20.048908] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-17T07:40:20.051017] [INFO ] [MAIN ] Derivative Progress: 1549/2172 symbols completed. PINE took 1.1s. Estimated remaining: 3m 53s. Rate: 160.1 symbols/min [2025-09-17T07:40:20.052589] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:20.081338] [DEBUG] [MAIN ] PIPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:20.082178] [INFO ] [MAIN ] PIPR: Generated 1794 derivative records from 15340 primary records. [2025-09-17T07:40:20.082632] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-17T07:40:20.105956] [DEBUG] [LOCAL ] PJT: Loaded 23021 existing records from primary storage. [2025-09-17T07:40:20.107196] [INFO ] [MAIN ] PJT: Loaded 23021 primary data records. [2025-09-17T07:40:20.142247] [DEBUG] [MAIN ] PINS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:20.179589] [INFO ] [MAIN ] PINS: Generated 1794 derivative records from 53693 primary records. [2025-09-17T07:40:20.218514] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1794 records). [2025-09-17T07:40:20.200930] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-17T07:40:20.231149] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-17T07:40:20.233236] [INFO ] [MAIN ] Derivative Progress: 1550/2172 symbols completed. PIPR took 0.9s. Estimated remaining: 3m 53s. Rate: 160.1 symbols/min [2025-09-17T07:40:20.241243] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:20.332511] [DEBUG] [LOCAL ] PINS: Derivative data saved (1794 records). [2025-09-17T07:40:20.450461] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-17T07:40:20.453183] [INFO ] [MAIN ] Derivative Progress: 1551/2172 symbols completed. PINS took 1.4s. Estimated remaining: 3m 53s. Rate: 160.2 symbols/min [2025-09-17T07:40:20.453429] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:20.483915] [DEBUG] [LOCAL ] PKE: Loaded 12253 existing records from primary storage. [2025-09-17T07:40:20.484212] [INFO ] [MAIN ] PKE: Loaded 12253 primary data records. [2025-09-17T07:40:20.619954] [DEBUG] [LOCAL ] PK: Loaded 52885 existing records from primary storage. [2025-09-17T07:40:20.699186] [DEBUG] [MAIN ] PJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:20.677634] [INFO ] [MAIN ] PK: Loaded 52885 primary data records. [2025-09-17T07:40:20.700003] [INFO ] [MAIN ] PJT: Generated 1794 derivative records from 23021 primary records. [2025-09-17T07:40:20.833425] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-17T07:40:21.107145] [DEBUG] [LOCAL ] PJT: Derivative data saved (1794 records). [2025-09-17T07:40:21.121162] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-17T07:40:21.123569] [INFO ] [MAIN ] Derivative Progress: 1552/2172 symbols completed. PJT took 1.1s. Estimated remaining: 3m 52s. Rate: 160.1 symbols/min [2025-09-17T07:40:21.124490] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:21.145590] [DEBUG] [MAIN ] PKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:21.146322] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 12253 primary records. [2025-09-17T07:40:21.146627] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-17T07:40:21.166177] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-09-17T07:40:21.167053] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-17T07:40:21.169401] [INFO ] [MAIN ] Derivative Progress: 1553/2172 symbols completed. PKE took 0.7s. Estimated remaining: 3m 52s. Rate: 160.2 symbols/min [2025-09-17T07:40:21.190895] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:21.191899] [DEBUG] [MAIN ] PK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:21.192776] [INFO ] [MAIN ] PK: Generated 1794 derivative records from 52885 primary records. [2025-09-17T07:40:21.192943] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-17T07:40:21.219388] [DEBUG] [LOCAL ] PKG: Loaded 39476 existing records from primary storage. [2025-09-17T07:40:21.221495] [DEBUG] [LOCAL ] PK: Derivative data saved (1794 records). [2025-09-17T07:40:21.221657] [INFO ] [MAIN ] PKG: Loaded 39476 primary data records. [2025-09-17T07:40:21.225898] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-17T07:40:21.228808] [INFO ] [MAIN ] Derivative Progress: 1554/2172 symbols completed. PK took 1.0s. Estimated remaining: 3m 51s. Rate: 160.3 symbols/min [2025-09-17T07:40:21.240268] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:21.338013] [DEBUG] [LOCAL ] PKST: Loaded 19656 existing records from primary storage. [2025-09-17T07:40:21.364889] [INFO ] [MAIN ] PKST: Loaded 19656 primary data records. [2025-09-17T07:40:21.866700] [DEBUG] [LOCAL ] PKX: Loaded 25476 existing records from primary storage. [2025-09-17T07:40:21.876676] [INFO ] [MAIN ] PKX: Loaded 25476 primary data records. [2025-09-17T07:40:22.197381] [DEBUG] [MAIN ] PKG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:22.201869] [INFO ] [MAIN ] PKG: Generated 1794 derivative records from 39476 primary records. [2025-09-17T07:40:22.203661] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-17T07:40:22.238070] [DEBUG] [LOCAL ] PKG: Derivative data saved (1794 records). [2025-09-17T07:40:22.238940] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-17T07:40:22.239362] [DEBUG] [MAIN ] PKST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:22.242204] [INFO ] [MAIN ] Derivative Progress: 1555/2172 symbols completed. PKG took 1.1s. Estimated remaining: 3m 51s. Rate: 160.1 symbols/min [2025-09-17T07:40:22.243198] [INFO ] [MAIN ] PKST: Generated 1794 derivative records from 19656 primary records. [2025-09-17T07:40:22.243570] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:22.243767] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-17T07:40:22.265410] [DEBUG] [LOCAL ] PKST: Derivative data saved (1794 records). [2025-09-17T07:40:22.265667] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-17T07:40:22.268011] [INFO ] [MAIN ] Derivative Progress: 1556/2172 symbols completed. PKST took 1.1s. Estimated remaining: 3m 51s. Rate: 160.2 symbols/min [2025-09-17T07:40:22.268744] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:22.285979] [DEBUG] [MAIN ] PKX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:22.286915] [INFO ] [MAIN ] PKX: Generated 1794 derivative records from 25476 primary records. [2025-09-17T07:40:22.287071] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-17T07:40:22.303422] [DEBUG] [LOCAL ] PKX: Derivative data saved (1794 records). [2025-09-17T07:40:22.303534] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-17T07:40:22.306152] [INFO ] [MAIN ] Derivative Progress: 1557/2172 symbols completed. PKX took 1.1s. Estimated remaining: 3m 50s. Rate: 160.3 symbols/min [2025-09-17T07:40:22.306595] [INFO ] [MAIN ] PLNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:22.365096] [DEBUG] [LOCAL ] PL: Loaded 53099 existing records from primary storage. [2025-09-17T07:40:22.379024] [INFO ] [MAIN ] PL: Loaded 53099 primary data records. [2025-09-17T07:40:22.381197] [DEBUG] [LOCAL ] PLD: Loaded 53485 existing records from primary storage. [2025-09-17T07:40:22.418112] [INFO ] [MAIN ] PLD: Loaded 53485 primary data records. [2025-09-17T07:40:22.686441] [DEBUG] [LOCAL ] PLNT: Loaded 48629 existing records from primary storage. [2025-09-17T07:40:22.686930] [INFO ] [MAIN ] PLNT: Loaded 48629 primary data records. [2025-09-17T07:40:23.306458] [DEBUG] [MAIN ] PL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:23.310005] [INFO ] [MAIN ] PL: Generated 1794 derivative records from 53099 primary records. [2025-09-17T07:40:23.325512] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-17T07:40:23.326207] [DEBUG] [MAIN ] PLD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:23.328378] [INFO ] [MAIN ] PLD: Generated 1794 derivative records from 53485 primary records. [2025-09-17T07:40:23.329352] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-17T07:40:23.363146] [DEBUG] [LOCAL ] PL: Derivative data saved (1794 records). [2025-09-17T07:40:23.367320] [DEBUG] [LOCAL ] PLD: Derivative data saved (1794 records). [2025-09-17T07:40:23.369279] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-17T07:40:23.369501] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-17T07:40:23.372069] [INFO ] [MAIN ] Derivative Progress: 1558/2172 symbols completed. PLD took 1.1s. Estimated remaining: 3m 50s. Rate: 160.1 symbols/min [2025-09-17T07:40:23.387862] [INFO ] [MAIN ] Derivative Progress: 1559/2172 symbols completed. PL took 1.1s. Estimated remaining: 3m 50s. Rate: 160.2 symbols/min [2025-09-17T07:40:23.388058] [DEBUG] [MAIN ] PLNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:23.389007] [INFO ] [MAIN ] PLNT: Generated 1794 derivative records from 48629 primary records. [2025-09-17T07:40:23.389217] [DEBUG] [LOCAL ] PLNT: Saving derivative data. [2025-09-17T07:40:23.404750] [DEBUG] [LOCAL ] PLNT: Derivative data saved (1794 records). [2025-09-17T07:40:23.404834] [INFO ] [MAIN ] PLNT: Successfully saved derivative data. [2025-09-17T07:40:23.407251] [INFO ] [MAIN ] Derivative Progress: 1560/2172 symbols completed. PLNT took 1.1s. Estimated remaining: 3m 49s. Rate: 160.3 symbols/min [2025-09-17T07:40:23.407742] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:23.407835] [INFO ] [MAIN ] PM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:23.407949] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:23.431764] [DEBUG] [LOCAL ] PLOW: Loaded 20830 existing records from primary storage. [2025-09-17T07:40:23.431920] [INFO ] [MAIN ] PLOW: Loaded 20830 primary data records. [2025-09-17T07:40:23.593608] [DEBUG] [LOCAL ] PLYM: Loaded 32964 existing records from primary storage. [2025-09-17T07:40:23.630126] [INFO ] [MAIN ] PLYM: Loaded 32964 primary data records. [2025-09-17T07:40:23.831780] [DEBUG] [LOCAL ] PM: Loaded 53666 existing records from primary storage. [2025-09-17T07:40:23.857308] [INFO ] [MAIN ] PM: Loaded 53666 primary data records. [2025-09-17T07:40:24.421953] [DEBUG] [MAIN ] PLOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:24.422821] [INFO ] [MAIN ] PLOW: Generated 1794 derivative records from 20830 primary records. [2025-09-17T07:40:24.423988] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-17T07:40:24.442252] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1794 records). [2025-09-17T07:40:24.442684] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-17T07:40:24.457175] [INFO ] [MAIN ] Derivative Progress: 1561/2172 symbols completed. PLOW took 1.0s. Estimated remaining: 3m 49s. Rate: 160.1 symbols/min [2025-09-17T07:40:24.457925] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:24.457459] [DEBUG] [MAIN ] PLYM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:24.458853] [INFO ] [MAIN ] PLYM: Generated 1794 derivative records from 32964 primary records. [2025-09-17T07:40:24.459265] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-17T07:40:24.487460] [DEBUG] [MAIN ] PM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:24.489256] [INFO ] [MAIN ] PM: Generated 1794 derivative records from 53666 primary records. [2025-09-17T07:40:24.490697] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1794 records). [2025-09-17T07:40:24.490865] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-17T07:40:24.492810] [INFO ] [MAIN ] Derivative Progress: 1562/2172 symbols completed. PLYM took 1.1s. Estimated remaining: 3m 48s. Rate: 160.2 symbols/min [2025-09-17T07:40:24.490801] [DEBUG] [LOCAL ] PM: Saving derivative data. [2025-09-17T07:40:24.493477] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:24.521299] [DEBUG] [LOCAL ] PM: Derivative data saved (1794 records). [2025-09-17T07:40:24.523492] [INFO ] [MAIN ] PM: Successfully saved derivative data. [2025-09-17T07:40:24.526526] [INFO ] [MAIN ] Derivative Progress: 1563/2172 symbols completed. PM took 1.1s. Estimated remaining: 3m 48s. Rate: 160.3 symbols/min [2025-09-17T07:40:24.523868] [DEBUG] [LOCAL ] PML: Loaded 20193 existing records from primary storage. [2025-09-17T07:40:24.526965] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:24.526767] [INFO ] [MAIN ] PML: Loaded 20193 primary data records. [2025-09-17T07:40:24.586853] [DEBUG] [LOCAL ] PMM: Loaded 10757 existing records from primary storage. [2025-09-17T07:40:24.619962] [INFO ] [MAIN ] PMM: Loaded 10757 primary data records. [2025-09-17T07:40:24.755108] [DEBUG] [LOCAL ] PMO: Loaded 10707 existing records from primary storage. [2025-09-17T07:40:24.913265] [INFO ] [MAIN ] PMO: Loaded 10707 primary data records. [2025-09-17T07:40:25.439775] [DEBUG] [MAIN ] PML: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:25.452240] [DEBUG] [MAIN ] PMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:25.453023] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 20193 primary records. [2025-09-17T07:40:25.453727] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10757 primary records. [2025-09-17T07:40:25.453991] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-17T07:40:25.454108] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-17T07:40:25.482320] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-09-17T07:40:25.482950] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-17T07:40:25.485918] [INFO ] [MAIN ] Derivative Progress: 1564/2172 symbols completed. PML took 1.0s. Estimated remaining: 3m 48s. Rate: 160.1 symbols/min [2025-09-17T07:40:25.494385] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:25.501204] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-09-17T07:40:25.501885] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-17T07:40:25.501735] [DEBUG] [MAIN ] PMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:25.502606] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 10707 primary records. [2025-09-17T07:40:25.505064] [INFO ] [MAIN ] Derivative Progress: 1565/2172 symbols completed. PMM took 1.0s. Estimated remaining: 3m 47s. Rate: 160.2 symbols/min [2025-09-17T07:40:25.505588] [INFO ] [MAIN ] PNC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:25.505284] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-17T07:40:25.521534] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-09-17T07:40:25.521744] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-17T07:40:25.524392] [INFO ] [MAIN ] Derivative Progress: 1566/2172 symbols completed. PMO took 1.0s. Estimated remaining: 3m 47s. Rate: 160.3 symbols/min [2025-09-17T07:40:25.525018] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:25.542603] [DEBUG] [LOCAL ] PNI: Loaded 6704 existing records from primary storage. [2025-09-17T07:40:25.542805] [INFO ] [MAIN ] PNI: Loaded 6704 primary data records. [2025-09-17T07:40:25.656748] [DEBUG] [LOCAL ] PMT: Loaded 40314 existing records from primary storage. [2025-09-17T07:40:25.669842] [INFO ] [MAIN ] PMT: Loaded 40314 primary data records. [2025-09-17T07:40:25.815146] [DEBUG] [LOCAL ] PNC: Loaded 52383 existing records from primary storage. [2025-09-17T07:40:26.011893] [INFO ] [MAIN ] PNC: Loaded 52383 primary data records. [2025-09-17T07:40:26.537345] [DEBUG] [MAIN ] PNI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:26.539041] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6704 primary records. [2025-09-17T07:40:26.540566] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-17T07:40:26.565946] [DEBUG] [MAIN ] PMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:26.569045] [INFO ] [MAIN ] PMT: Generated 1794 derivative records from 40314 primary records. [2025-09-17T07:40:26.568294] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-09-17T07:40:26.569305] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-17T07:40:26.569420] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-17T07:40:26.572722] [INFO ] [MAIN ] Derivative Progress: 1567/2172 symbols completed. PNI took 1.0s. Estimated remaining: 3m 47s. Rate: 160.2 symbols/min [2025-09-17T07:40:26.574841] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:26.603692] [DEBUG] [LOCAL ] PMT: Derivative data saved (1794 records). [2025-09-17T07:40:26.602542] [DEBUG] [MAIN ] PNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:26.603902] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-17T07:40:26.604628] [INFO ] [MAIN ] PNC: Generated 1794 derivative records from 52383 primary records. [2025-09-17T07:40:26.606896] [INFO ] [MAIN ] Derivative Progress: 1568/2172 symbols completed. PMT took 1.1s. Estimated remaining: 3m 46s. Rate: 160.2 symbols/min [2025-09-17T07:40:26.607300] [INFO ] [MAIN ] PNR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:26.607121] [DEBUG] [LOCAL ] PNC: Saving derivative data. [2025-09-17T07:40:26.632372] [DEBUG] [LOCAL ] PNC: Derivative data saved (1794 records). [2025-09-17T07:40:26.632565] [INFO ] [MAIN ] PNC: Successfully saved derivative data. [2025-09-17T07:40:26.635685] [INFO ] [MAIN ] Derivative Progress: 1569/2172 symbols completed. PNC took 1.1s. Estimated remaining: 3m 46s. Rate: 160.3 symbols/min [2025-09-17T07:40:26.636058] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:26.649114] [DEBUG] [LOCAL ] PNNT: Loaded 32998 existing records from primary storage. [2025-09-17T07:40:26.649369] [INFO ] [MAIN ] PNNT: Loaded 32998 primary data records. [2025-09-17T07:40:26.980435] [DEBUG] [LOCAL ] PNR: Loaded 48283 existing records from primary storage. [2025-09-17T07:40:26.981289] [INFO ] [MAIN ] PNR: Loaded 48283 primary data records. [2025-09-17T07:40:27.051214] [DEBUG] [LOCAL ] PNW: Loaded 46144 existing records from primary storage. [2025-09-17T07:40:27.077697] [INFO ] [MAIN ] PNW: Loaded 46144 primary data records. [2025-09-17T07:40:27.664294] [DEBUG] [MAIN ] PNNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:27.665951] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 32998 primary records. [2025-09-17T07:40:27.666275] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-17T07:40:27.683632] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-09-17T07:40:27.684050] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-17T07:40:27.688219] [INFO ] [MAIN ] Derivative Progress: 1570/2172 symbols completed. PNNT took 1.1s. Estimated remaining: 3m 46s. Rate: 160.2 symbols/min [2025-09-17T07:40:27.689515] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:27.703111] [DEBUG] [MAIN ] PNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:27.704202] [INFO ] [MAIN ] PNR: Generated 1794 derivative records from 48283 primary records. [2025-09-17T07:40:27.704453] [DEBUG] [LOCAL ] PNR: Saving derivative data. [2025-09-17T07:40:27.735916] [DEBUG] [MAIN ] PNW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:27.737127] [DEBUG] [LOCAL ] PNR: Derivative data saved (1794 records). [2025-09-17T07:40:27.737916] [INFO ] [MAIN ] PNW: Generated 1794 derivative records from 46144 primary records. [2025-09-17T07:40:27.738229] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-17T07:40:27.738081] [INFO ] [MAIN ] PNR: Successfully saved derivative data. [2025-09-17T07:40:27.740863] [INFO ] [MAIN ] Derivative Progress: 1571/2172 symbols completed. PNR took 1.1s. Estimated remaining: 3m 45s. Rate: 160.2 symbols/min [2025-09-17T07:40:27.741411] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:27.756853] [DEBUG] [LOCAL ] PNW: Derivative data saved (1794 records). [2025-09-17T07:40:27.766548] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-17T07:40:27.769262] [INFO ] [MAIN ] Derivative Progress: 1572/2172 symbols completed. PNW took 1.1s. Estimated remaining: 3m 45s. Rate: 160.3 symbols/min [2025-09-17T07:40:27.769671] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:27.788139] [DEBUG] [LOCAL ] POR: Loaded 46953 existing records from primary storage. [2025-09-17T07:40:27.788445] [INFO ] [MAIN ] POR: Loaded 46953 primary data records. [2025-09-17T07:40:27.975604] [DEBUG] [LOCAL ] POST: Loaded 38940 existing records from primary storage. [2025-09-17T07:40:27.992437] [INFO ] [MAIN ] POST: Loaded 38940 primary data records. [2025-09-17T07:40:28.239414] [DEBUG] [LOCAL ] PPG: Loaded 50772 existing records from primary storage. [2025-09-17T07:40:28.261157] [INFO ] [MAIN ] PPG: Loaded 50772 primary data records. [2025-09-17T07:40:28.744660] [DEBUG] [MAIN ] POR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:28.747530] [INFO ] [MAIN ] POR: Generated 1794 derivative records from 46953 primary records. [2025-09-17T07:40:28.748125] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-17T07:40:28.766189] [DEBUG] [LOCAL ] POR: Derivative data saved (1794 records). [2025-09-17T07:40:28.767731] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-17T07:40:28.770686] [INFO ] [MAIN ] Derivative Progress: 1573/2172 symbols completed. POR took 1.1s. Estimated remaining: 3m 44s. Rate: 160.2 symbols/min [2025-09-17T07:40:28.783901] [DEBUG] [MAIN ] POST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:28.784632] [INFO ] [MAIN ] POST: Generated 1794 derivative records from 38940 primary records. [2025-09-17T07:40:28.784855] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-17T07:40:28.814405] [DEBUG] [LOCAL ] POST: Derivative data saved (1794 records). [2025-09-17T07:40:28.814992] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-17T07:40:28.814935] [DEBUG] [MAIN ] PPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:28.817364] [INFO ] [MAIN ] Derivative Progress: 1574/2172 symbols completed. POST took 1.1s. Estimated remaining: 3m 44s. Rate: 160.3 symbols/min [2025-09-17T07:40:28.818085] [INFO ] [MAIN ] PPG: Generated 1794 derivative records from 50772 primary records. [2025-09-17T07:40:28.818273] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-17T07:40:28.833806] [DEBUG] [LOCAL ] PPG: Derivative data saved (1794 records). [2025-09-17T07:40:28.833880] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-17T07:40:28.836291] [INFO ] [MAIN ] Derivative Progress: 1575/2172 symbols completed. PPG took 1.1s. Estimated remaining: 3m 43s. Rate: 160.4 symbols/min [2025-09-17T07:40:28.836703] [INFO ] [MAIN ] PPL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:28.836992] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:28.837261] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:28.860504] [DEBUG] [LOCAL ] PPT: Loaded 20338 existing records from primary storage. [2025-09-17T07:40:28.860787] [INFO ] [MAIN ] PPT: Loaded 20338 primary data records. [2025-09-17T07:40:29.090950] [DEBUG] [LOCAL ] PPL: Loaded 53516 existing records from primary storage. [2025-09-17T07:40:29.235510] [INFO ] [MAIN ] PPL: Loaded 53516 primary data records. [2025-09-17T07:40:29.268953] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-17T07:40:29.304023] [INFO ] [MAIN ] PR: Loaded 53609 primary data records. [2025-09-17T07:40:29.904766] [DEBUG] [MAIN ] PPT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:29.905859] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 20338 primary records. [2025-09-17T07:40:29.906261] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-17T07:40:29.923219] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-09-17T07:40:29.925460] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-17T07:40:29.929099] [INFO ] [MAIN ] Derivative Progress: 1576/2172 symbols completed. PPT took 1.1s. Estimated remaining: 3m 43s. Rate: 160.2 symbols/min [2025-09-17T07:40:29.948147] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:29.948744] [DEBUG] [MAIN ] PPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:29.957159] [INFO ] [MAIN ] PPL: Generated 1794 derivative records from 53516 primary records. [2025-09-17T07:40:29.965027] [DEBUG] [MAIN ] PR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:29.965088] [DEBUG] [LOCAL ] PPL: Saving derivative data. [2025-09-17T07:40:29.966449] [INFO ] [MAIN ] PR: Generated 1794 derivative records from 53609 primary records. [2025-09-17T07:40:29.966715] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-17T07:40:30.001008] [DEBUG] [LOCAL ] PR: Derivative data saved (1794 records). [2025-09-17T07:40:30.001995] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-17T07:40:30.004665] [INFO ] [MAIN ] Derivative Progress: 1577/2172 symbols completed. PR took 1.2s. Estimated remaining: 3m 43s. Rate: 160.2 symbols/min [2025-09-17T07:40:30.007007] [DEBUG] [LOCAL ] PPL: Derivative data saved (1794 records). [2025-09-17T07:40:30.005897] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:30.021603] [INFO ] [MAIN ] PPL: Successfully saved derivative data. [2025-09-17T07:40:30.025448] [INFO ] [MAIN ] Derivative Progress: 1578/2172 symbols completed. PPL took 1.2s. Estimated remaining: 3m 42s. Rate: 160.3 symbols/min [2025-09-17T07:40:30.025973] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:30.041793] [DEBUG] [LOCAL ] PRA: Loaded 34724 existing records from primary storage. [2025-09-17T07:40:30.042043] [INFO ] [MAIN ] PRA: Loaded 34724 primary data records. [2025-09-17T07:40:30.267820] [DEBUG] [LOCAL ] PRG: Loaded 30591 existing records from primary storage. [2025-09-17T07:40:30.396936] [INFO ] [MAIN ] PRG: Loaded 30591 primary data records. [2025-09-17T07:40:30.409216] [DEBUG] [LOCAL ] PRGO: Loaded 46972 existing records from primary storage. [2025-09-17T07:40:30.441634] [INFO ] [MAIN ] PRGO: Loaded 46972 primary data records. [2025-09-17T07:40:31.036069] [DEBUG] [MAIN ] PRA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:31.037376] [INFO ] [MAIN ] PRA: Generated 1794 derivative records from 34724 primary records. [2025-09-17T07:40:31.038470] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-17T07:40:31.061338] [DEBUG] [LOCAL ] PRA: Derivative data saved (1794 records). [2025-09-17T07:40:31.075860] [DEBUG] [MAIN ] PRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:31.076879] [INFO ] [MAIN ] PRG: Generated 1794 derivative records from 30591 primary records. [2025-09-17T07:40:31.076111] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-17T07:40:31.080471] [INFO ] [MAIN ] Derivative Progress: 1579/2172 symbols completed. PRA took 1.1s. Estimated remaining: 3m 42s. Rate: 160.1 symbols/min [2025-09-17T07:40:31.080561] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-17T07:40:31.081362] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:31.101507] [DEBUG] [LOCAL ] PRG: Derivative data saved (1794 records). [2025-09-17T07:40:31.101898] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-17T07:40:31.104303] [INFO ] [MAIN ] Derivative Progress: 1580/2172 symbols completed. PRG took 1.1s. Estimated remaining: 3m 42s. Rate: 160.2 symbols/min [2025-09-17T07:40:31.104897] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:31.120605] [DEBUG] [MAIN ] PRGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:31.121846] [INFO ] [MAIN ] PRGO: Generated 1794 derivative records from 46972 primary records. [2025-09-17T07:40:31.122404] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-17T07:40:31.126481] [DEBUG] [LOCAL ] PRH: Loaded 4987 existing records from primary storage. [2025-09-17T07:40:31.127835] [INFO ] [MAIN ] PRH: Loaded 4987 primary data records. [2025-09-17T07:40:31.299355] [DEBUG] [LOCAL ] PRI: Loaded 18506 existing records from primary storage. [2025-09-17T07:40:31.308203] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1794 records). [2025-09-17T07:40:31.308534] [INFO ] [MAIN ] PRI: Loaded 18506 primary data records. [2025-09-17T07:40:31.335439] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-17T07:40:31.441120] [INFO ] [MAIN ] Derivative Progress: 1581/2172 symbols completed. PRGO took 1.4s. Estimated remaining: 3m 41s. Rate: 160.3 symbols/min [2025-09-17T07:40:31.479326] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:31.858837] [DEBUG] [LOCAL ] PRIM: Loaded 44570 existing records from primary storage. [2025-09-17T07:40:31.860183] [INFO ] [MAIN ] PRIM: Loaded 44570 primary data records. [2025-09-17T07:40:31.860610] [DEBUG] [MAIN ] PRH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:31.866722] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4987 primary records. [2025-09-17T07:40:31.866839] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-17T07:40:31.938115] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-09-17T07:40:31.952479] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-17T07:40:31.970992] [INFO ] [MAIN ] Derivative Progress: 1582/2172 symbols completed. PRH took 0.9s. Estimated remaining: 3m 41s. Rate: 160.2 symbols/min [2025-09-17T07:40:31.985874] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:32.204461] [DEBUG] [MAIN ] PRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:32.205317] [INFO ] [MAIN ] PRI: Generated 1794 derivative records from 18506 primary records. [2025-09-17T07:40:32.206328] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-17T07:40:32.234495] [DEBUG] [LOCAL ] PRI: Derivative data saved (1794 records). [2025-09-17T07:40:32.247040] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-17T07:40:32.250443] [INFO ] [MAIN ] Derivative Progress: 1583/2172 symbols completed. PRI took 1.1s. Estimated remaining: 3m 41s. Rate: 160.2 symbols/min [2025-09-17T07:40:32.251777] [DEBUG] [LOCAL ] PRKS: Loaded 42756 existing records from primary storage. [2025-09-17T07:40:32.251996] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:32.252296] [INFO ] [MAIN ] PRKS: Loaded 42756 primary data records. [2025-09-17T07:40:32.439625] [DEBUG] [LOCAL ] PRLB: Loaded 20950 existing records from primary storage. [2025-09-17T07:40:32.438335] [DEBUG] [MAIN ] PRIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:32.457545] [INFO ] [MAIN ] PRLB: Loaded 20950 primary data records. [2025-09-17T07:40:32.563441] [INFO ] [MAIN ] PRIM: Generated 1794 derivative records from 44570 primary records. [2025-09-17T07:40:32.616742] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-17T07:40:32.887872] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1794 records). [2025-09-17T07:40:32.888045] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-17T07:40:32.890226] [INFO ] [MAIN ] Derivative Progress: 1584/2172 symbols completed. PRIM took 1.4s. Estimated remaining: 3m 40s. Rate: 160.2 symbols/min [2025-09-17T07:40:32.890615] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:32.916602] [DEBUG] [MAIN ] PRKS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:32.917383] [INFO ] [MAIN ] PRKS: Generated 1794 derivative records from 42756 primary records. [2025-09-17T07:40:32.917990] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-17T07:40:32.948363] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1794 records). [2025-09-17T07:40:32.961331] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-17T07:40:32.961555] [DEBUG] [MAIN ] PRLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:32.964756] [INFO ] [MAIN ] Derivative Progress: 1585/2172 symbols completed. PRKS took 1.0s. Estimated remaining: 3m 40s. Rate: 160.2 symbols/min [2025-09-17T07:40:32.965569] [INFO ] [MAIN ] PRLB: Generated 1794 derivative records from 20950 primary records. [2025-09-17T07:40:32.965958] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:32.966222] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-17T07:40:32.996329] [DEBUG] [LOCAL ] PRM: Loaded 44761 existing records from primary storage. [2025-09-17T07:40:32.997442] [INFO ] [MAIN ] PRM: Loaded 44761 primary data records. [2025-09-17T07:40:33.031442] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1794 records). [2025-09-17T07:40:33.066138] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-17T07:40:33.092559] [INFO ] [MAIN ] Derivative Progress: 1586/2172 symbols completed. PRLB took 0.8s. Estimated remaining: 3m 39s. Rate: 160.3 symbols/min [2025-09-17T07:40:33.110547] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:33.353767] [DEBUG] [LOCAL ] PRMB: Loaded 53131 existing records from primary storage. [2025-09-17T07:40:33.355692] [INFO ] [MAIN ] PRMB: Loaded 53131 primary data records. [2025-09-17T07:40:33.453925] [DEBUG] [LOCAL ] PRO: Loaded 37111 existing records from primary storage. [2025-09-17T07:40:33.471866] [INFO ] [MAIN ] PRO: Loaded 37111 primary data records. [2025-09-17T07:40:34.032886] [DEBUG] [MAIN ] PRM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:34.034350] [INFO ] [MAIN ] PRM: Generated 1794 derivative records from 44761 primary records. [2025-09-17T07:40:34.034705] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-17T07:40:34.057844] [DEBUG] [LOCAL ] PRM: Derivative data saved (1794 records). [2025-09-17T07:40:34.058369] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-17T07:40:34.061438] [INFO ] [MAIN ] Derivative Progress: 1587/2172 symbols completed. PRM took 1.2s. Estimated remaining: 3m 39s. Rate: 160.2 symbols/min [2025-09-17T07:40:34.061924] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:34.078730] [DEBUG] [MAIN ] PRMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:34.079982] [INFO ] [MAIN ] PRMB: Generated 1794 derivative records from 53131 primary records. [2025-09-17T07:40:34.080137] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-17T07:40:34.100080] [DEBUG] [LOCAL ] PRT: Loaded 5446 existing records from primary storage. [2025-09-17T07:40:34.101083] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1794 records). [2025-09-17T07:40:34.101920] [INFO ] [MAIN ] PRT: Loaded 5446 primary data records. [2025-09-17T07:40:34.101955] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-17T07:40:34.126824] [INFO ] [MAIN ] Derivative Progress: 1588/2172 symbols completed. PRMB took 1.2s. Estimated remaining: 3m 39s. Rate: 160.2 symbols/min [2025-09-17T07:40:34.211808] [DEBUG] [MAIN ] PRO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:34.222734] [INFO ] [MAIN ] PRO: Generated 1794 derivative records from 37111 primary records. [2025-09-17T07:40:34.223110] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-17T07:40:34.319879] [DEBUG] [LOCAL ] PRO: Derivative data saved (1794 records). [2025-09-17T07:40:34.383025] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-17T07:40:34.432258] [INFO ] [MAIN ] Derivative Progress: 1589/2172 symbols completed. PRO took 1.3s. Estimated remaining: 3m 38s. Rate: 160.3 symbols/min [2025-09-17T07:40:34.455267] [DEBUG] [MAIN ] PRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:34.455924] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5446 primary records. [2025-09-17T07:40:34.456001] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-17T07:40:34.470184] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-09-17T07:40:34.470255] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-17T07:40:34.472339] [INFO ] [MAIN ] Derivative Progress: 1590/2172 symbols completed. PRT took 0.4s. Estimated remaining: 3m 38s. Rate: 160.3 symbols/min [2025-09-17T07:40:34.473495] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:34.473253] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:34.473617] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:34.484242] [DEBUG] [LOCAL ] PSBD: Loaded 6796 existing records from primary storage. [2025-09-17T07:40:34.484562] [INFO ] [MAIN ] PSBD: Loaded 6796 primary data records. [2025-09-17T07:40:34.820442] [DEBUG] [LOCAL ] PRU: Loaded 51578 existing records from primary storage. [2025-09-17T07:40:34.833496] [INFO ] [MAIN ] PRU: Loaded 51578 primary data records. [2025-09-17T07:40:34.868663] [DEBUG] [LOCAL ] PSA: Loaded 41934 existing records from primary storage. [2025-09-17T07:40:34.895680] [INFO ] [MAIN ] PSA: Loaded 41934 primary data records. [2025-09-17T07:40:35.514767] [DEBUG] [MAIN ] PSBD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:35.516972] [INFO ] [MAIN ] PSBD: Generated 1794 derivative records from 6796 primary records. [2025-09-17T07:40:35.517671] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-17T07:40:35.536373] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1794 records). [2025-09-17T07:40:35.536579] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-17T07:40:35.538983] [INFO ] [MAIN ] Derivative Progress: 1591/2172 symbols completed. PSBD took 1.1s. Estimated remaining: 3m 38s. Rate: 160.2 symbols/min [2025-09-17T07:40:35.539730] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:35.559021] [DEBUG] [MAIN ] PRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:35.562764] [INFO ] [MAIN ] PRU: Generated 1794 derivative records from 51578 primary records. [2025-09-17T07:40:35.566010] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-17T07:40:35.565783] [DEBUG] [LOCAL ] PSF: Loaded 6679 existing records from primary storage. [2025-09-17T07:40:35.566482] [INFO ] [MAIN ] PSF: Loaded 6679 primary data records. [2025-09-17T07:40:35.665446] [DEBUG] [MAIN ] PSA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:35.676573] [INFO ] [MAIN ] PSA: Generated 1794 derivative records from 41934 primary records. [2025-09-17T07:40:35.695442] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-17T07:40:35.695860] [DEBUG] [LOCAL ] PRU: Derivative data saved (1794 records). [2025-09-17T07:40:35.704443] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-17T07:40:35.763488] [DEBUG] [LOCAL ] PSA: Derivative data saved (1794 records). [2025-09-17T07:40:35.787258] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-17T07:40:35.734072] [INFO ] [MAIN ] Derivative Progress: 1592/2172 symbols completed. PRU took 1.3s. Estimated remaining: 3m 37s. Rate: 160.2 symbols/min [2025-09-17T07:40:35.795682] [INFO ] [MAIN ] Derivative Progress: 1593/2172 symbols completed. PSA took 1.3s. Estimated remaining: 3m 37s. Rate: 160.3 symbols/min [2025-09-17T07:40:35.790423] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:35.913545] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:35.947189] [DEBUG] [MAIN ] PSF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:35.947961] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6679 primary records. [2025-09-17T07:40:35.948121] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-17T07:40:35.978922] [DEBUG] [LOCAL ] PSFE: Loaded 30931 existing records from primary storage. [2025-09-17T07:40:35.981444] [INFO ] [MAIN ] PSFE: Loaded 30931 primary data records. [2025-09-17T07:40:35.982983] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-09-17T07:40:36.003383] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-17T07:40:36.027825] [INFO ] [MAIN ] Derivative Progress: 1594/2172 symbols completed. PSF took 0.5s. Estimated remaining: 3m 36s. Rate: 160.3 symbols/min [2025-09-17T07:40:36.034090] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:36.079363] [DEBUG] [LOCAL ] PSN: Loaded 46387 existing records from primary storage. [2025-09-17T07:40:36.101691] [INFO ] [MAIN ] PSN: Loaded 46387 primary data records. [2025-09-17T07:40:36.609937] [DEBUG] [LOCAL ] PSO: Loaded 37841 existing records from primary storage. [2025-09-17T07:40:36.619621] [INFO ] [MAIN ] PSO: Loaded 37841 primary data records. [2025-09-17T07:40:36.933944] [DEBUG] [MAIN ] PSFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:36.935228] [INFO ] [MAIN ] PSFE: Generated 1794 derivative records from 30931 primary records. [2025-09-17T07:40:36.936348] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-17T07:40:36.956383] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1794 records). [2025-09-17T07:40:36.970805] [DEBUG] [MAIN ] PSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:36.970477] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-17T07:40:36.973451] [INFO ] [MAIN ] Derivative Progress: 1595/2172 symbols completed. PSFE took 1.2s. Estimated remaining: 3m 36s. Rate: 160.2 symbols/min [2025-09-17T07:40:36.974218] [INFO ] [MAIN ] PSN: Generated 1794 derivative records from 46387 primary records. [2025-09-17T07:40:36.974754] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:36.975026] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-17T07:40:36.992897] [DEBUG] [LOCAL ] PSN: Derivative data saved (1794 records). [2025-09-17T07:40:36.992982] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-17T07:40:36.995172] [INFO ] [MAIN ] Derivative Progress: 1596/2172 symbols completed. PSN took 1.1s. Estimated remaining: 3m 36s. Rate: 160.3 symbols/min [2025-09-17T07:40:36.995598] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:37.013855] [DEBUG] [MAIN ] PSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:37.024689] [INFO ] [MAIN ] PSO: Generated 1794 derivative records from 37841 primary records. [2025-09-17T07:40:37.024827] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-17T07:40:37.043318] [DEBUG] [LOCAL ] PSO: Derivative data saved (1794 records). [2025-09-17T07:40:37.043484] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-17T07:40:37.047181] [INFO ] [MAIN ] Derivative Progress: 1597/2172 symbols completed. PSO took 1.0s. Estimated remaining: 3m 35s. Rate: 160.4 symbols/min [2025-09-17T07:40:37.047524] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:37.060493] [DEBUG] [LOCAL ] PSQH: Loaded 34432 existing records from primary storage. [2025-09-17T07:40:37.060886] [INFO ] [MAIN ] PSQH: Loaded 34432 primary data records. [2025-09-17T07:40:37.288404] [DEBUG] [LOCAL ] PSTL: Loaded 20679 existing records from primary storage. [2025-09-17T07:40:37.392406] [DEBUG] [LOCAL ] PSTG: Loaded 52858 existing records from primary storage. [2025-09-17T07:40:37.391033] [INFO ] [MAIN ] PSTL: Loaded 20679 primary data records. [2025-09-17T07:40:37.397696] [INFO ] [MAIN ] PSTG: Loaded 52858 primary data records. [2025-09-17T07:40:38.078900] [DEBUG] [MAIN ] PSQH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:38.080864] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 34432 primary records. [2025-09-17T07:40:38.081196] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-17T07:40:38.099892] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-09-17T07:40:38.100406] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-17T07:40:38.102554] [INFO ] [MAIN ] Derivative Progress: 1598/2172 symbols completed. PSQH took 1.1s. Estimated remaining: 3m 35s. Rate: 160.2 symbols/min [2025-09-17T07:40:38.103548] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:38.121035] [DEBUG] [MAIN ] PSTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:38.123762] [INFO ] [MAIN ] PSTL: Generated 1794 derivative records from 20679 primary records. [2025-09-17T07:40:38.124045] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-17T07:40:38.144966] [DEBUG] [MAIN ] PSTG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:38.150014] [INFO ] [MAIN ] PSTG: Generated 1794 derivative records from 52858 primary records. [2025-09-17T07:40:38.151025] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-17T07:40:38.153744] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1794 records). [2025-09-17T07:40:38.153938] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-17T07:40:38.157359] [INFO ] [MAIN ] Derivative Progress: 1599/2172 symbols completed. PSTL took 1.1s. Estimated remaining: 3m 35s. Rate: 160.3 symbols/min [2025-09-17T07:40:38.157887] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:38.173874] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1794 records). [2025-09-17T07:40:38.174126] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-17T07:40:38.177353] [INFO ] [MAIN ] Derivative Progress: 1600/2172 symbols completed. PSTG took 1.2s. Estimated remaining: 3m 34s. Rate: 160.4 symbols/min [2025-09-17T07:40:38.177630] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:38.203893] [DEBUG] [LOCAL ] PTA: Loaded 15067 existing records from primary storage. [2025-09-17T07:40:38.204185] [INFO ] [MAIN ] PTA: Loaded 15067 primary data records. [2025-09-17T07:40:38.321307] [DEBUG] [LOCAL ] PSX: Loaded 53144 existing records from primary storage. [2025-09-17T07:40:38.324851] [INFO ] [MAIN ] PSX: Loaded 53144 primary data records. [2025-09-17T07:40:38.669458] [DEBUG] [LOCAL ] PTY: Loaded 37375 existing records from primary storage. [2025-09-17T07:40:38.720545] [INFO ] [MAIN ] PTY: Loaded 37375 primary data records. [2025-09-17T07:40:39.172693] [DEBUG] [MAIN ] PTA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:39.174210] [INFO ] [MAIN ] PTA: Generated 1794 derivative records from 15067 primary records. [2025-09-17T07:40:39.174955] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-17T07:40:39.194010] [DEBUG] [LOCAL ] PTA: Derivative data saved (1794 records). [2025-09-17T07:40:39.196356] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-17T07:40:39.198537] [INFO ] [MAIN ] Derivative Progress: 1601/2172 symbols completed. PTA took 1.0s. Estimated remaining: 3m 34s. Rate: 160.2 symbols/min [2025-09-17T07:40:39.199340] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:39.215228] [DEBUG] [MAIN ] PSX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:39.216266] [INFO ] [MAIN ] PSX: Generated 1794 derivative records from 53144 primary records. [2025-09-17T07:40:39.216506] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-17T07:40:39.234304] [DEBUG] [LOCAL ] PSX: Derivative data saved (1794 records). [2025-09-17T07:40:39.235156] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-17T07:40:39.237262] [INFO ] [MAIN ] Derivative Progress: 1602/2172 symbols completed. PSX took 1.1s. Estimated remaining: 3m 33s. Rate: 160.3 symbols/min [2025-09-17T07:40:39.237703] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:39.250873] [DEBUG] [MAIN ] PTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:39.251710] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37375 primary records. [2025-09-17T07:40:39.251936] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-17T07:40:39.274292] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-09-17T07:40:39.286887] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-17T07:40:39.290196] [INFO ] [MAIN ] Derivative Progress: 1603/2172 symbols completed. PTY took 1.1s. Estimated remaining: 3m 33s. Rate: 160.4 symbols/min [2025-09-17T07:40:39.308690] [DEBUG] [LOCAL ] PUK: Loaded 45047 existing records from primary storage. [2025-09-17T07:40:39.308860] [INFO ] [MAIN ] PUK: Loaded 45047 primary data records. [2025-09-17T07:40:39.451331] [DEBUG] [LOCAL ] PUMP: Loaded 49500 existing records from primary storage. [2025-09-17T07:40:39.489321] [INFO ] [MAIN ] PUMP: Loaded 49500 primary data records. [2025-09-17T07:40:39.966444] [DEBUG] [MAIN ] PUK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:39.967200] [INFO ] [MAIN ] PUK: Generated 1794 derivative records from 45047 primary records. [2025-09-17T07:40:39.967419] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-17T07:40:39.986312] [DEBUG] [LOCAL ] PUK: Derivative data saved (1794 records). [2025-09-17T07:40:39.986481] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-17T07:40:39.988579] [INFO ] [MAIN ] Derivative Progress: 1604/2172 symbols completed. PUK took 0.8s. Estimated remaining: 3m 33s. Rate: 160.3 symbols/min [2025-09-17T07:40:40.001174] [DEBUG] [MAIN ] PUMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:40.001788] [INFO ] [MAIN ] PUMP: Generated 1794 derivative records from 49500 primary records. [2025-09-17T07:40:40.001861] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-17T07:40:40.016736] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1794 records). [2025-09-17T07:40:40.016807] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-17T07:40:40.018894] [INFO ] [MAIN ] Derivative Progress: 1605/2172 symbols completed. PUMP took 0.8s. Estimated remaining: 3m 32s. Rate: 160.4 symbols/min [2025-09-17T07:40:40.019398] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:40.019504] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:40.019594] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:40.027690] [DEBUG] [LOCAL ] PVL: Loaded 4696 existing records from primary storage. [2025-09-17T07:40:40.028055] [INFO ] [MAIN ] PVL: Loaded 4696 primary data records. [2025-09-17T07:40:40.359990] [DEBUG] [LOCAL ] PWR: Loaded 47691 existing records from primary storage. [2025-09-17T07:40:40.360376] [INFO ] [MAIN ] PWR: Loaded 47691 primary data records. [2025-09-17T07:40:40.481079] [DEBUG] [LOCAL ] PVH: Loaded 50376 existing records from primary storage. [2025-09-17T07:40:40.481701] [INFO ] [MAIN ] PVH: Loaded 50376 primary data records. [2025-09-17T07:40:40.880531] [DEBUG] [MAIN ] PVL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:40.885251] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4696 primary records. [2025-09-17T07:40:41.010172] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-17T07:40:41.029431] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-09-17T07:40:41.030492] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-17T07:40:41.032992] [INFO ] [MAIN ] Derivative Progress: 1606/2172 symbols completed. PVL took 1.0s. Estimated remaining: 3m 32s. Rate: 160.2 symbols/min [2025-09-17T07:40:41.033711] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:41.055599] [DEBUG] [MAIN ] PWR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:41.056515] [INFO ] [MAIN ] PWR: Generated 1794 derivative records from 47691 primary records. [2025-09-17T07:40:41.056695] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-17T07:40:41.097606] [DEBUG] [MAIN ] PVH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:41.099582] [INFO ] [MAIN ] PVH: Generated 1794 derivative records from 50376 primary records. [2025-09-17T07:40:41.100437] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-17T07:40:41.102285] [DEBUG] [LOCAL ] PWR: Derivative data saved (1794 records). [2025-09-17T07:40:41.111433] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-17T07:40:41.116720] [INFO ] [MAIN ] Derivative Progress: 1607/2172 symbols completed. PWR took 1.1s. Estimated remaining: 3m 32s. Rate: 160.3 symbols/min [2025-09-17T07:40:41.130917] [DEBUG] [LOCAL ] PVH: Derivative data saved (1794 records). [2025-09-17T07:40:41.132042] [INFO ] [MAIN ] QBTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:41.132377] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-17T07:40:41.136301] [INFO ] [MAIN ] Derivative Progress: 1608/2172 symbols completed. PVH took 1.1s. Estimated remaining: 3m 31s. Rate: 160.4 symbols/min [2025-09-17T07:40:41.137849] [DEBUG] [LOCAL ] PX: Loaded 34755 existing records from primary storage. [2025-09-17T07:40:41.138236] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:41.138334] [INFO ] [MAIN ] PX: Loaded 34755 primary data records. [2025-09-17T07:40:41.490113] [DEBUG] [LOCAL ] QD: Loaded 27951 existing records from primary storage. [2025-09-17T07:40:41.499306] [INFO ] [MAIN ] QD: Loaded 27951 primary data records. [2025-09-17T07:40:41.621765] [DEBUG] [LOCAL ] QBTS: Loaded 53743 existing records from primary storage. [2025-09-17T07:40:41.638031] [INFO ] [MAIN ] QBTS: Loaded 53743 primary data records. [2025-09-17T07:40:42.146808] [DEBUG] [MAIN ] PX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:42.148657] [INFO ] [MAIN ] PX: Generated 1794 derivative records from 34755 primary records. [2025-09-17T07:40:42.149087] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-17T07:40:42.167136] [DEBUG] [LOCAL ] PX: Derivative data saved (1794 records). [2025-09-17T07:40:42.167506] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-17T07:40:42.170680] [INFO ] [MAIN ] Derivative Progress: 1609/2172 symbols completed. PX took 1.1s. Estimated remaining: 3m 31s. Rate: 160.2 symbols/min [2025-09-17T07:40:42.172895] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:42.187887] [DEBUG] [MAIN ] QD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:42.188884] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 27951 primary records. [2025-09-17T07:40:42.189594] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-17T07:40:42.206851] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-09-17T07:40:42.208411] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-17T07:40:42.211106] [INFO ] [MAIN ] Derivative Progress: 1610/2172 symbols completed. QD took 1.1s. Estimated remaining: 3m 30s. Rate: 160.3 symbols/min [2025-09-17T07:40:42.219629] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:42.224891] [DEBUG] [MAIN ] QBTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:42.226062] [INFO ] [MAIN ] QBTS: Generated 1794 derivative records from 53743 primary records. [2025-09-17T07:40:42.226154] [DEBUG] [LOCAL ] QBTS: Saving derivative data. [2025-09-17T07:40:42.242156] [DEBUG] [LOCAL ] QBTS: Derivative data saved (1794 records). [2025-09-17T07:40:42.242431] [INFO ] [MAIN ] QBTS: Successfully saved derivative data. [2025-09-17T07:40:42.245087] [INFO ] [MAIN ] Derivative Progress: 1611/2172 symbols completed. QBTS took 1.1s. Estimated remaining: 3m 30s. Rate: 160.4 symbols/min [2025-09-17T07:40:42.245410] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:42.279436] [DEBUG] [LOCAL ] QGEN: Loaded 49187 existing records from primary storage. [2025-09-17T07:40:42.279979] [INFO ] [MAIN ] QGEN: Loaded 49187 primary data records. [2025-09-17T07:40:42.611364] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-17T07:40:42.625252] [INFO ] [MAIN ] QS: Loaded 53742 primary data records. [2025-09-17T07:40:42.639218] [DEBUG] [LOCAL ] QSR: Loaded 52412 existing records from primary storage. [2025-09-17T07:40:42.664940] [INFO ] [MAIN ] QSR: Loaded 52412 primary data records. [2025-09-17T07:40:43.257548] [DEBUG] [MAIN ] QGEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:43.259857] [INFO ] [MAIN ] QGEN: Generated 1794 derivative records from 49187 primary records. [2025-09-17T07:40:43.260158] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-17T07:40:43.279711] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1794 records). [2025-09-17T07:40:43.280114] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-17T07:40:43.282703] [INFO ] [MAIN ] Derivative Progress: 1612/2172 symbols completed. QGEN took 1.1s. Estimated remaining: 3m 30s. Rate: 160.2 symbols/min [2025-09-17T07:40:43.284049] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:43.306009] [DEBUG] [MAIN ] QS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:43.306864] [INFO ] [MAIN ] QS: Generated 1794 derivative records from 53742 primary records. [2025-09-17T07:40:43.319790] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-17T07:40:43.320071] [DEBUG] [MAIN ] QSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:43.321312] [INFO ] [MAIN ] QSR: Generated 1794 derivative records from 52412 primary records. [2025-09-17T07:40:43.321836] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-17T07:40:43.356464] [DEBUG] [LOCAL ] QS: Derivative data saved (1794 records). [2025-09-17T07:40:43.363082] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-17T07:40:43.363192] [DEBUG] [LOCAL ] QSR: Derivative data saved (1794 records). [2025-09-17T07:40:43.365717] [INFO ] [MAIN ] Derivative Progress: 1613/2172 symbols completed. QS took 1.2s. Estimated remaining: 3m 29s. Rate: 160.3 symbols/min [2025-09-17T07:40:43.366101] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:43.366277] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-17T07:40:43.370664] [INFO ] [MAIN ] Derivative Progress: 1614/2172 symbols completed. QSR took 1.1s. Estimated remaining: 3m 29s. Rate: 160.4 symbols/min [2025-09-17T07:40:43.371181] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:43.388776] [DEBUG] [LOCAL ] QTWO: Loaded 38982 existing records from primary storage. [2025-09-17T07:40:43.389067] [INFO ] [MAIN ] QTWO: Loaded 38982 primary data records. [2025-09-17T07:40:43.591400] [DEBUG] [LOCAL ] QVCC: Loaded 9092 existing records from primary storage. [2025-09-17T07:40:43.597939] [DEBUG] [LOCAL ] QUAD: Loaded 24268 existing records from primary storage. [2025-09-17T07:40:43.635175] [INFO ] [MAIN ] QVCC: Loaded 9092 primary data records. [2025-09-17T07:40:43.741973] [INFO ] [MAIN ] QUAD: Loaded 24268 primary data records. [2025-09-17T07:40:44.376995] [DEBUG] [MAIN ] QTWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:44.378603] [INFO ] [MAIN ] QTWO: Generated 1794 derivative records from 38982 primary records. [2025-09-17T07:40:44.378936] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-17T07:40:44.399243] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1794 records). [2025-09-17T07:40:44.401308] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-17T07:40:44.404207] [INFO ] [MAIN ] Derivative Progress: 1615/2172 symbols completed. QTWO took 1.1s. Estimated remaining: 3m 29s. Rate: 160.2 symbols/min [2025-09-17T07:40:44.407090] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:44.433329] [DEBUG] [MAIN ] QVCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:44.434811] [INFO ] [MAIN ] QVCC: Generated 1794 derivative records from 9092 primary records. [2025-09-17T07:40:44.435522] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-17T07:40:44.435446] [DEBUG] [MAIN ] QUAD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:44.437179] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 24268 primary records. [2025-09-17T07:40:44.438825] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-17T07:40:44.466877] [DEBUG] [LOCAL ] QVCD: Loaded 4664 existing records from primary storage. [2025-09-17T07:40:44.468992] [INFO ] [MAIN ] QVCD: Loaded 4664 primary data records. [2025-09-17T07:40:44.515627] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-09-17T07:40:44.528197] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-17T07:40:44.558559] [INFO ] [MAIN ] Derivative Progress: 1616/2172 symbols completed. QUAD took 1.2s. Estimated remaining: 3m 28s. Rate: 160.3 symbols/min [2025-09-17T07:40:44.558800] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1794 records). [2025-09-17T07:40:44.581834] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:44.581942] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-17T07:40:44.601724] [INFO ] [MAIN ] Derivative Progress: 1617/2172 symbols completed. QVCC took 1.2s. Estimated remaining: 3m 28s. Rate: 160.3 symbols/min [2025-09-17T07:40:44.664283] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:44.843017] [DEBUG] [MAIN ] QVCD: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:40:44.843823] [INFO ] [MAIN ] QVCD: Generated 1793 derivative records from 4664 primary records. [2025-09-17T07:40:44.844148] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-17T07:40:44.883395] [DEBUG] [LOCAL ] QXO: Loaded 53128 existing records from primary storage. [2025-09-17T07:40:44.884632] [DEBUG] [LOCAL ] R: Loaded 29854 existing records from primary storage. [2025-09-17T07:40:44.885788] [INFO ] [MAIN ] QXO: Loaded 53128 primary data records. [2025-09-17T07:40:44.886841] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1793 records). [2025-09-17T07:40:44.887057] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-17T07:40:44.889390] [INFO ] [MAIN ] Derivative Progress: 1618/2172 symbols completed. QVCD took 0.5s. Estimated remaining: 3m 27s. Rate: 160.4 symbols/min [2025-09-17T07:40:44.887287] [INFO ] [MAIN ] R: Loaded 29854 primary data records. [2025-09-17T07:40:45.618095] [DEBUG] [MAIN ] QXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:45.619276] [INFO ] [MAIN ] QXO: Generated 1794 derivative records from 53128 primary records. [2025-09-17T07:40:45.618430] [DEBUG] [MAIN ] R: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:45.619468] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-17T07:40:45.621114] [INFO ] [MAIN ] R: Generated 1794 derivative records from 29854 primary records. [2025-09-17T07:40:45.621721] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-17T07:40:45.659500] [DEBUG] [LOCAL ] QXO: Derivative data saved (1794 records). [2025-09-17T07:40:45.661883] [DEBUG] [LOCAL ] R: Derivative data saved (1794 records). [2025-09-17T07:40:45.661976] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-17T07:40:45.662196] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-17T07:40:45.664209] [INFO ] [MAIN ] Derivative Progress: 1619/2172 symbols completed. QXO took 1.1s. Estimated remaining: 3m 27s. Rate: 160.3 symbols/min [2025-09-17T07:40:45.666734] [INFO ] [MAIN ] Derivative Progress: 1620/2172 symbols completed. R took 1.0s. Estimated remaining: 3m 27s. Rate: 160.4 symbols/min [2025-09-17T07:40:45.667635] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:45.668035] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:45.667860] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:45.695563] [DEBUG] [LOCAL ] RA: Loaded 21816 existing records from primary storage. [2025-09-17T07:40:45.698159] [INFO ] [MAIN ] RA: Loaded 21816 primary data records. [2025-09-17T07:40:45.865077] [DEBUG] [LOCAL ] RAMP: Loaded 37720 existing records from primary storage. [2025-09-17T07:40:45.895895] [DEBUG] [LOCAL ] RACE: Loaded 33210 existing records from primary storage. [2025-09-17T07:40:45.896033] [INFO ] [MAIN ] RAMP: Loaded 37720 primary data records. [2025-09-17T07:40:45.916400] [INFO ] [MAIN ] RACE: Loaded 33210 primary data records. [2025-09-17T07:40:46.672753] [DEBUG] [MAIN ] RA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:46.674261] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21816 primary records. [2025-09-17T07:40:46.674812] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-17T07:40:46.707319] [DEBUG] [MAIN ] RAMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:46.721877] [INFO ] [MAIN ] RAMP: Generated 1794 derivative records from 37720 primary records. [2025-09-17T07:40:46.722459] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-17T07:40:46.723890] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-09-17T07:40:46.722807] [DEBUG] [MAIN ] RACE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:46.724590] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-17T07:40:46.727125] [INFO ] [MAIN ] Derivative Progress: 1621/2172 symbols completed. RA took 1.1s. Estimated remaining: 3m 26s. Rate: 160.2 symbols/min [2025-09-17T07:40:46.725106] [INFO ] [MAIN ] RACE: Generated 1794 derivative records from 33210 primary records. [2025-09-17T07:40:46.727268] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-17T07:40:46.735665] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:46.760903] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1794 records). [2025-09-17T07:40:46.762513] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-17T07:40:46.762594] [DEBUG] [LOCAL ] RACE: Derivative data saved (1794 records). [2025-09-17T07:40:46.764933] [INFO ] [MAIN ] Derivative Progress: 1622/2172 symbols completed. RAMP took 1.1s. Estimated remaining: 3m 26s. Rate: 160.3 symbols/min [2025-09-17T07:40:46.765198] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-17T07:40:46.768152] [INFO ] [MAIN ] Derivative Progress: 1623/2172 symbols completed. RACE took 1.1s. Estimated remaining: 3m 25s. Rate: 160.4 symbols/min [2025-09-17T07:40:46.768409] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:46.765398] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:46.795337] [DEBUG] [LOCAL ] RBC: Loaded 14994 existing records from primary storage. [2025-09-17T07:40:46.795609] [INFO ] [MAIN ] RBC: Loaded 14994 primary data records. [2025-09-17T07:40:46.926116] [DEBUG] [LOCAL ] RBA: Loaded 46158 existing records from primary storage. [2025-09-17T07:40:47.005414] [INFO ] [MAIN ] RBA: Loaded 46158 primary data records. [2025-09-17T07:40:47.261367] [DEBUG] [LOCAL ] RBLX: Loaded 53722 existing records from primary storage. [2025-09-17T07:40:47.301822] [INFO ] [MAIN ] RBLX: Loaded 53722 primary data records. [2025-09-17T07:40:47.804131] [DEBUG] [MAIN ] RBC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:47.805337] [INFO ] [MAIN ] RBC: Generated 1794 derivative records from 14994 primary records. [2025-09-17T07:40:47.806099] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-17T07:40:47.824757] [DEBUG] [LOCAL ] RBC: Derivative data saved (1794 records). [2025-09-17T07:40:47.824987] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-17T07:40:47.827201] [INFO ] [MAIN ] Derivative Progress: 1624/2172 symbols completed. RBC took 1.1s. Estimated remaining: 3m 25s. Rate: 160.2 symbols/min [2025-09-17T07:40:47.829010] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:47.846512] [DEBUG] [MAIN ] RBA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:47.847232] [INFO ] [MAIN ] RBA: Generated 1794 derivative records from 46158 primary records. [2025-09-17T07:40:47.850076] [DEBUG] [LOCAL ] RBOT: Loaded 5058 existing records from primary storage. [2025-09-17T07:40:47.850342] [INFO ] [MAIN ] RBOT: Loaded 5058 primary data records. [2025-09-17T07:40:47.850421] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-17T07:40:47.971836] [DEBUG] [LOCAL ] RBA: Derivative data saved (1794 records). [2025-09-17T07:40:47.999163] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-17T07:40:48.050628] [INFO ] [MAIN ] Derivative Progress: 1625/2172 symbols completed. RBA took 1.3s. Estimated remaining: 3m 25s. Rate: 160.2 symbols/min [2025-09-17T07:40:48.175837] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:48.176109] [DEBUG] [MAIN ] RBLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:48.177108] [INFO ] [MAIN ] RBLX: Generated 1794 derivative records from 53722 primary records. [2025-09-17T07:40:48.177378] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-17T07:40:48.197585] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1794 records). [2025-09-17T07:40:48.197892] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-17T07:40:48.202404] [INFO ] [MAIN ] Derivative Progress: 1626/2172 symbols completed. RBLX took 1.4s. Estimated remaining: 3m 24s. Rate: 160.3 symbols/min [2025-09-17T07:40:48.203124] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:48.240230] [DEBUG] [MAIN ] RBOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:48.242120] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 5058 primary records. [2025-09-17T07:40:48.242204] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-17T07:40:48.257039] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-09-17T07:40:48.258009] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-17T07:40:48.260223] [INFO ] [MAIN ] Derivative Progress: 1627/2172 symbols completed. RBOT took 0.4s. Estimated remaining: 3m 24s. Rate: 160.4 symbols/min [2025-09-17T07:40:48.273723] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:48.275997] [DEBUG] [LOCAL ] RBRK: Loaded 53056 existing records from primary storage. [2025-09-17T07:40:48.276387] [INFO ] [MAIN ] RBRK: Loaded 53056 primary data records. [2025-09-17T07:40:48.467121] [DEBUG] [LOCAL ] RC: Loaded 49154 existing records from primary storage. [2025-09-17T07:40:48.637122] [INFO ] [MAIN ] RC: Loaded 49154 primary data records. [2025-09-17T07:40:48.766467] [DEBUG] [LOCAL ] RCI: Loaded 48841 existing records from primary storage. [2025-09-17T07:40:48.789406] [INFO ] [MAIN ] RCI: Loaded 48841 primary data records. [2025-09-17T07:40:49.317071] [DEBUG] [MAIN ] RBRK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:49.319978] [INFO ] [MAIN ] RBRK: Generated 1794 derivative records from 53056 primary records. [2025-09-17T07:40:49.320357] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-17T07:40:49.340051] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1794 records). [2025-09-17T07:40:49.342283] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-17T07:40:49.346920] [INFO ] [MAIN ] Derivative Progress: 1628/2172 symbols completed. RBRK took 1.2s. Estimated remaining: 3m 24s. Rate: 160.2 symbols/min [2025-09-17T07:40:49.348388] [INFO ] [MAIN ] RCL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:49.364088] [DEBUG] [MAIN ] RC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:49.365217] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 49154 primary records. [2025-09-17T07:40:49.365726] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-17T07:40:49.382585] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-09-17T07:40:49.383014] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-17T07:40:49.385676] [INFO ] [MAIN ] Derivative Progress: 1629/2172 symbols completed. RC took 1.2s. Estimated remaining: 3m 23s. Rate: 160.3 symbols/min [2025-09-17T07:40:49.386129] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:49.413283] [DEBUG] [MAIN ] RCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:49.418424] [DEBUG] [LOCAL ] RCS: Loaded 11533 existing records from primary storage. [2025-09-17T07:40:49.419812] [INFO ] [MAIN ] RCI: Generated 1794 derivative records from 48841 primary records. [2025-09-17T07:40:49.420401] [INFO ] [MAIN ] RCS: Loaded 11533 primary data records. [2025-09-17T07:40:49.420660] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-17T07:40:49.555554] [DEBUG] [LOCAL ] RCI: Derivative data saved (1794 records). [2025-09-17T07:40:49.619065] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-17T07:40:49.666202] [INFO ] [MAIN ] Derivative Progress: 1630/2172 symbols completed. RCI took 1.4s. Estimated remaining: 3m 23s. Rate: 160.3 symbols/min [2025-09-17T07:40:49.683176] [DEBUG] [LOCAL ] RCL: Loaded 52254 existing records from primary storage. [2025-09-17T07:40:49.806203] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:49.791183] [INFO ] [MAIN ] RCL: Loaded 52254 primary data records. [2025-09-17T07:40:50.137457] [DEBUG] [LOCAL ] RCUS: Loaded 42981 existing records from primary storage. [2025-09-17T07:40:50.138445] [INFO ] [MAIN ] RCUS: Loaded 42981 primary data records. [2025-09-17T07:40:50.158291] [DEBUG] [MAIN ] RCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:50.211187] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 11533 primary records. [2025-09-17T07:40:50.260802] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-17T07:40:50.476636] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-09-17T07:40:50.481693] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-17T07:40:50.493445] [INFO ] [MAIN ] Derivative Progress: 1631/2172 symbols completed. RCS took 1.1s. Estimated remaining: 3m 23s. Rate: 160.2 symbols/min [2025-09-17T07:40:50.494033] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:50.494426] [DEBUG] [MAIN ] RCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:50.495831] [INFO ] [MAIN ] RCL: Generated 1794 derivative records from 52254 primary records. [2025-09-17T07:40:50.496037] [DEBUG] [LOCAL ] RCL: Saving derivative data. [2025-09-17T07:40:50.514148] [DEBUG] [LOCAL ] RCL: Derivative data saved (1794 records). [2025-09-17T07:40:50.514603] [INFO ] [MAIN ] RCL: Successfully saved derivative data. [2025-09-17T07:40:50.516979] [INFO ] [MAIN ] Derivative Progress: 1632/2172 symbols completed. RCL took 1.2s. Estimated remaining: 3m 22s. Rate: 160.3 symbols/min [2025-09-17T07:40:50.517690] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:50.540132] [DEBUG] [MAIN ] RCUS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:50.540829] [INFO ] [MAIN ] RCUS: Generated 1794 derivative records from 42981 primary records. [2025-09-17T07:40:50.540953] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-17T07:40:50.573437] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1794 records). [2025-09-17T07:40:50.573601] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-17T07:40:50.576081] [INFO ] [MAIN ] Derivative Progress: 1633/2172 symbols completed. RCUS took 0.8s. Estimated remaining: 3m 22s. Rate: 160.3 symbols/min [2025-09-17T07:40:50.619542] [DEBUG] [LOCAL ] RDDT: Loaded 53784 existing records from primary storage. [2025-09-17T07:40:50.620766] [INFO ] [MAIN ] RDDT: Loaded 53784 primary data records. [2025-09-17T07:40:50.621480] [DEBUG] [LOCAL ] RDN: Loaded 45192 existing records from primary storage. [2025-09-17T07:40:50.689966] [INFO ] [MAIN ] RDN: Loaded 45192 primary data records. [2025-09-17T07:40:51.239194] [DEBUG] [MAIN ] RDDT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:51.240123] [INFO ] [MAIN ] RDDT: Generated 1794 derivative records from 53784 primary records. [2025-09-17T07:40:51.240374] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-17T07:40:51.274909] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1794 records). [2025-09-17T07:40:51.275391] [DEBUG] [MAIN ] RDN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:51.275476] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-17T07:40:51.278356] [INFO ] [MAIN ] RDN: Generated 1794 derivative records from 45192 primary records. [2025-09-17T07:40:51.277587] [INFO ] [MAIN ] Derivative Progress: 1634/2172 symbols completed. RDDT took 0.8s. Estimated remaining: 3m 21s. Rate: 160.3 symbols/min [2025-09-17T07:40:51.278621] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-17T07:40:51.295089] [DEBUG] [LOCAL ] RDN: Derivative data saved (1794 records). [2025-09-17T07:40:51.295169] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-17T07:40:51.297493] [INFO ] [MAIN ] Derivative Progress: 1635/2172 symbols completed. RDN took 0.8s. Estimated remaining: 3m 21s. Rate: 160.3 symbols/min [2025-09-17T07:40:51.298123] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:51.298351] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:51.299003] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:51.371855] [DEBUG] [LOCAL ] RELX: Loaded 47809 existing records from primary storage. [2025-09-17T07:40:51.372069] [INFO ] [MAIN ] RELX: Loaded 47809 primary data records. [2025-09-17T07:40:51.503444] [DEBUG] [LOCAL ] RDY: Loaded 47089 existing records from primary storage. [2025-09-17T07:40:51.503772] [INFO ] [MAIN ] RDY: Loaded 47089 primary data records. [2025-09-17T07:40:51.515623] [DEBUG] [LOCAL ] RDW: Loaded 51968 existing records from primary storage. [2025-09-17T07:40:51.568963] [INFO ] [MAIN ] RDW: Loaded 51968 primary data records. [2025-09-17T07:40:52.373747] [DEBUG] [MAIN ] RELX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:52.377593] [INFO ] [MAIN ] RELX: Generated 1794 derivative records from 47809 primary records. [2025-09-17T07:40:52.378128] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-17T07:40:52.403981] [DEBUG] [MAIN ] RDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:52.410134] [INFO ] [MAIN ] RDW: Generated 1794 derivative records from 51968 primary records. [2025-09-17T07:40:52.422133] [DEBUG] [LOCAL ] RELX: Derivative data saved (1794 records). [2025-09-17T07:40:52.422448] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-17T07:40:52.422342] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-17T07:40:52.424463] [INFO ] [MAIN ] Derivative Progress: 1636/2172 symbols completed. RELX took 1.1s. Estimated remaining: 3m 21s. Rate: 160.2 symbols/min [2025-09-17T07:40:52.431742] [DEBUG] [MAIN ] RDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:52.430948] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:52.445326] [INFO ] [MAIN ] RDY: Generated 1794 derivative records from 47089 primary records. [2025-09-17T07:40:52.446549] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-17T07:40:52.451851] [DEBUG] [LOCAL ] RDW: Derivative data saved (1794 records). [2025-09-17T07:40:52.452394] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-17T07:40:52.455072] [INFO ] [MAIN ] Derivative Progress: 1637/2172 symbols completed. RDW took 1.2s. Estimated remaining: 3m 20s. Rate: 160.2 symbols/min [2025-09-17T07:40:52.465090] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:52.476190] [DEBUG] [LOCAL ] RDY: Derivative data saved (1794 records). [2025-09-17T07:40:52.476522] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-17T07:40:52.479349] [INFO ] [MAIN ] Derivative Progress: 1638/2172 symbols completed. RDY took 1.2s. Estimated remaining: 3m 20s. Rate: 160.3 symbols/min [2025-09-17T07:40:52.479999] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:52.512062] [DEBUG] [LOCAL ] RERE: Loaded 40806 existing records from primary storage. [2025-09-17T07:40:52.512386] [INFO ] [MAIN ] RERE: Loaded 40806 primary data records. [2025-09-17T07:40:52.717612] [DEBUG] [LOCAL ] RES: Loaded 47631 existing records from primary storage. [2025-09-17T07:40:52.763052] [INFO ] [MAIN ] RES: Loaded 47631 primary data records. [2025-09-17T07:40:52.872241] [DEBUG] [LOCAL ] REVG: Loaded 41330 existing records from primary storage. [2025-09-17T07:40:52.878247] [INFO ] [MAIN ] REVG: Loaded 41330 primary data records. [2025-09-17T07:40:53.545586] [DEBUG] [MAIN ] RERE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:53.547031] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 40806 primary records. [2025-09-17T07:40:53.547345] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-17T07:40:53.567392] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-09-17T07:40:53.567717] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-17T07:40:53.569607] [INFO ] [MAIN ] Derivative Progress: 1639/2172 symbols completed. RERE took 1.1s. Estimated remaining: 3m 20s. Rate: 160.1 symbols/min [2025-09-17T07:40:53.569990] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:53.587711] [DEBUG] [MAIN ] REVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:53.600820] [INFO ] [MAIN ] REVG: Generated 1794 derivative records from 41330 primary records. [2025-09-17T07:40:53.601179] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-17T07:40:53.601453] [DEBUG] [MAIN ] RES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:53.602512] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 47631 primary records. [2025-09-17T07:40:53.606791] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-17T07:40:53.639758] [DEBUG] [LOCAL ] REX: Loaded 13623 existing records from primary storage. [2025-09-17T07:40:53.642069] [INFO ] [MAIN ] REX: Loaded 13623 primary data records. [2025-09-17T07:40:53.665437] [DEBUG] [LOCAL ] REVG: Derivative data saved (1794 records). [2025-09-17T07:40:53.665800] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-17T07:40:53.679368] [INFO ] [MAIN ] Derivative Progress: 1640/2172 symbols completed. REVG took 1.2s. Estimated remaining: 3m 19s. Rate: 160.2 symbols/min [2025-09-17T07:40:53.690394] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:53.720509] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-09-17T07:40:53.739304] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-17T07:40:53.758863] [INFO ] [MAIN ] Derivative Progress: 1641/2172 symbols completed. RES took 1.3s. Estimated remaining: 3m 19s. Rate: 160.3 symbols/min [2025-09-17T07:40:53.759887] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:54.004309] [DEBUG] [LOCAL ] REXR: Loaded 52016 existing records from primary storage. [2025-09-17T07:40:54.004964] [INFO ] [MAIN ] REXR: Loaded 52016 primary data records. [2025-09-17T07:40:54.129433] [DEBUG] [LOCAL ] REZI: Loaded 46738 existing records from primary storage. [2025-09-17T07:40:54.167937] [INFO ] [MAIN ] REZI: Loaded 46738 primary data records. [2025-09-17T07:40:54.184589] [DEBUG] [MAIN ] REX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:54.215992] [INFO ] [MAIN ] REX: Generated 1794 derivative records from 13623 primary records. [2025-09-17T07:40:54.309785] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-17T07:40:54.617074] [DEBUG] [LOCAL ] REX: Derivative data saved (1794 records). [2025-09-17T07:40:54.651246] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-17T07:40:54.654099] [INFO ] [MAIN ] Derivative Progress: 1642/2172 symbols completed. REX took 1.1s. Estimated remaining: 3m 19s. Rate: 160.2 symbols/min [2025-09-17T07:40:54.846847] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:54.869568] [DEBUG] [MAIN ] REXR: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:40:54.870986] [INFO ] [MAIN ] REXR: Generated 1793 derivative records from 52016 primary records. [2025-09-17T07:40:54.871118] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-17T07:40:54.902573] [DEBUG] [LOCAL ] REXR: Derivative data saved (1793 records). [2025-09-17T07:40:54.903558] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-17T07:40:54.906406] [INFO ] [MAIN ] Derivative Progress: 1643/2172 symbols completed. REXR took 1.2s. Estimated remaining: 3m 18s. Rate: 160.2 symbols/min [2025-09-17T07:40:54.907328] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:54.947065] [DEBUG] [MAIN ] REZI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:54.948756] [INFO ] [MAIN ] REZI: Generated 1794 derivative records from 46738 primary records. [2025-09-17T07:40:54.967961] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-17T07:40:54.980413] [DEBUG] [LOCAL ] RFI: Loaded 10593 existing records from primary storage. [2025-09-17T07:40:54.995078] [INFO ] [MAIN ] RFI: Loaded 10593 primary data records. [2025-09-17T07:40:55.007994] [DEBUG] [LOCAL ] REZI: Derivative data saved (1794 records). [2025-09-17T07:40:55.033300] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-17T07:40:55.036249] [INFO ] [MAIN ] Derivative Progress: 1644/2172 symbols completed. REZI took 1.3s. Estimated remaining: 3m 18s. Rate: 160.3 symbols/min [2025-09-17T07:40:55.042021] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:55.073478] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-17T07:40:55.115585] [INFO ] [MAIN ] RF: Loaded 53630 primary data records. [2025-09-17T07:40:55.280743] [DEBUG] [LOCAL ] RFL: Loaded 10286 existing records from primary storage. [2025-09-17T07:40:55.291922] [INFO ] [MAIN ] RFL: Loaded 10286 primary data records. [2025-09-17T07:40:56.178470] [DEBUG] [MAIN ] RFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:56.179346] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10593 primary records. [2025-09-17T07:40:56.179869] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-17T07:40:56.215106] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-09-17T07:40:56.213984] [DEBUG] [MAIN ] RF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:56.215305] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-17T07:40:56.217504] [INFO ] [MAIN ] Derivative Progress: 1645/2172 symbols completed. RFI took 1.3s. Estimated remaining: 3m 18s. Rate: 160.0 symbols/min [2025-09-17T07:40:56.218252] [INFO ] [MAIN ] RF: Generated 1794 derivative records from 53630 primary records. [2025-09-17T07:40:56.230600] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-17T07:40:56.226092] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:56.231045] [DEBUG] [MAIN ] RFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:56.232217] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 10286 primary records. [2025-09-17T07:40:56.232724] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-17T07:40:56.260357] [DEBUG] [LOCAL ] RF: Derivative data saved (1794 records). [2025-09-17T07:40:56.264340] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-17T07:40:56.264508] [DEBUG] [LOCAL ] RFM: Loaded 3963 existing records from primary storage. [2025-09-17T07:40:56.266466] [INFO ] [MAIN ] Derivative Progress: 1646/2172 symbols completed. RF took 1.5s. Estimated remaining: 3m 17s. Rate: 160.1 symbols/min [2025-09-17T07:40:56.267331] [INFO ] [MAIN ] RFM: Loaded 3963 primary data records. [2025-09-17T07:40:56.268011] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:56.313309] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-09-17T07:40:56.377997] [DEBUG] [LOCAL ] RFMZ: Loaded 8442 existing records from primary storage. [2025-09-17T07:40:56.371142] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-17T07:40:56.380110] [INFO ] [MAIN ] Derivative Progress: 1647/2172 symbols completed. RFL took 1.3s. Estimated remaining: 3m 17s. Rate: 160.2 symbols/min [2025-09-17T07:40:56.385395] [INFO ] [MAIN ] RFMZ: Loaded 8442 primary data records. [2025-09-17T07:40:56.430783] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:56.893953] [DEBUG] [LOCAL ] RGA: Loaded 30127 existing records from primary storage. [2025-09-17T07:40:56.895301] [INFO ] [MAIN ] RGA: Loaded 30127 primary data records. [2025-09-17T07:40:57.091717] [DEBUG] [MAIN ] RFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:57.203708] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 3963 primary records. [2025-09-17T07:40:57.204972] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-17T07:40:57.234811] [DEBUG] [MAIN ] RFMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:57.237972] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 8442 primary records. [2025-09-17T07:40:57.239858] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-17T07:40:57.239776] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-09-17T07:40:57.241066] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-17T07:40:57.244045] [INFO ] [MAIN ] Derivative Progress: 1648/2172 symbols completed. RFM took 1.0s. Estimated remaining: 3m 16s. Rate: 160.1 symbols/min [2025-09-17T07:40:57.260520] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-09-17T07:40:57.260658] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-17T07:40:57.262799] [INFO ] [MAIN ] Derivative Progress: 1649/2172 symbols completed. RFMZ took 1.0s. Estimated remaining: 3m 16s. Rate: 160.2 symbols/min [2025-09-17T07:40:57.279173] [DEBUG] [MAIN ] RGA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:57.279839] [INFO ] [MAIN ] RGA: Generated 1794 derivative records from 30127 primary records. [2025-09-17T07:40:57.279916] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-17T07:40:57.299283] [DEBUG] [LOCAL ] RGA: Derivative data saved (1794 records). [2025-09-17T07:40:57.299418] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-17T07:40:57.301910] [INFO ] [MAIN ] Derivative Progress: 1650/2172 symbols completed. RGA took 0.9s. Estimated remaining: 3m 15s. Rate: 160.2 symbols/min [2025-09-17T07:40:57.302543] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:57.302372] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:57.302683] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:57.308587] [DEBUG] [LOCAL ] RGT: Loaded 2886 existing records from primary storage. [2025-09-17T07:40:57.308853] [INFO ] [MAIN ] RGT: Loaded 2886 primary data records. [2025-09-17T07:40:57.617937] [DEBUG] [LOCAL ] RGR: Loaded 19999 existing records from primary storage. [2025-09-17T07:40:57.619103] [INFO ] [MAIN ] RGR: Loaded 19999 primary data records. [2025-09-17T07:40:57.739590] [DEBUG] [LOCAL ] RH: Loaded 47702 existing records from primary storage. [2025-09-17T07:40:57.740356] [INFO ] [MAIN ] RH: Loaded 47702 primary data records. [2025-09-17T07:40:58.289044] [DEBUG] [MAIN ] RGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:58.289963] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2886 primary records. [2025-09-17T07:40:58.290918] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-17T07:40:58.309724] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-09-17T07:40:58.311550] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-17T07:40:58.315793] [INFO ] [MAIN ] Derivative Progress: 1651/2172 symbols completed. RGT took 1.0s. Estimated remaining: 3m 15s. Rate: 160.1 symbols/min [2025-09-17T07:40:58.316441] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:58.330097] [DEBUG] [MAIN ] RGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:58.331752] [INFO ] [MAIN ] RGR: Generated 1794 derivative records from 19999 primary records. [2025-09-17T07:40:58.332191] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-17T07:40:58.348699] [DEBUG] [LOCAL ] RGR: Derivative data saved (1794 records). [2025-09-17T07:40:58.349030] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-17T07:40:58.351845] [INFO ] [MAIN ] Derivative Progress: 1652/2172 symbols completed. RGR took 1.0s. Estimated remaining: 3m 15s. Rate: 160.2 symbols/min [2025-09-17T07:40:58.352172] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:58.367683] [DEBUG] [MAIN ] RH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:58.368488] [INFO ] [MAIN ] RH: Generated 1794 derivative records from 47702 primary records. [2025-09-17T07:40:58.368565] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-17T07:40:58.385342] [DEBUG] [LOCAL ] RH: Derivative data saved (1794 records). [2025-09-17T07:40:58.385667] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-17T07:40:58.387958] [INFO ] [MAIN ] Derivative Progress: 1653/2172 symbols completed. RH took 1.1s. Estimated remaining: 3m 14s. Rate: 160.3 symbols/min [2025-09-17T07:40:58.388270] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:58.437748] [DEBUG] [LOCAL ] RHI: Loaded 49251 existing records from primary storage. [2025-09-17T07:40:58.438183] [INFO ] [MAIN ] RHI: Loaded 49251 primary data records. [2025-09-17T07:40:58.572208] [DEBUG] [LOCAL ] RHP: Loaded 41774 existing records from primary storage. [2025-09-17T07:40:58.594064] [INFO ] [MAIN ] RHP: Loaded 41774 primary data records. [2025-09-17T07:40:58.750634] [DEBUG] [LOCAL ] RIG: Loaded 53673 existing records from primary storage. [2025-09-17T07:40:58.771389] [INFO ] [MAIN ] RIG: Loaded 53673 primary data records. [2025-09-17T07:40:59.466463] [DEBUG] [MAIN ] RHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:59.468720] [INFO ] [MAIN ] RHI: Generated 1794 derivative records from 49251 primary records. [2025-09-17T07:40:59.469122] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-17T07:40:59.484027] [DEBUG] [MAIN ] RHP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:59.496311] [INFO ] [MAIN ] RHP: Generated 1794 derivative records from 41774 primary records. [2025-09-17T07:40:59.497275] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-17T07:40:59.500098] [DEBUG] [LOCAL ] RHI: Derivative data saved (1794 records). [2025-09-17T07:40:59.500826] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-17T07:40:59.502977] [INFO ] [MAIN ] Derivative Progress: 1654/2172 symbols completed. RHI took 1.2s. Estimated remaining: 3m 14s. Rate: 160.1 symbols/min [2025-09-17T07:40:59.512004] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:59.521832] [DEBUG] [LOCAL ] RHP: Derivative data saved (1794 records). [2025-09-17T07:40:59.523769] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-17T07:40:59.526095] [INFO ] [MAIN ] Derivative Progress: 1655/2172 symbols completed. RHP took 1.2s. Estimated remaining: 3m 14s. Rate: 160.2 symbols/min [2025-09-17T07:40:59.526519] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:59.540846] [DEBUG] [MAIN ] RIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:40:59.541568] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53673 primary records. [2025-09-17T07:40:59.541781] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-17T07:40:59.560408] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-09-17T07:40:59.560682] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-17T07:40:59.563294] [INFO ] [MAIN ] Derivative Progress: 1656/2172 symbols completed. RIG took 1.2s. Estimated remaining: 3m 13s. Rate: 160.2 symbols/min [2025-09-17T07:40:59.563695] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:40:59.579948] [DEBUG] [LOCAL ] RIV: Loaded 11587 existing records from primary storage. [2025-09-17T07:40:59.580196] [INFO ] [MAIN ] RIV: Loaded 11587 primary data records. [2025-09-17T07:40:59.770281] [DEBUG] [LOCAL ] RIO: Loaded 53404 existing records from primary storage. [2025-09-17T07:40:59.787521] [INFO ] [MAIN ] RIO: Loaded 53404 primary data records. [2025-09-17T07:40:59.964760] [DEBUG] [LOCAL ] RITM: Loaded 52792 existing records from primary storage. [2025-09-17T07:41:00.002168] [INFO ] [MAIN ] RITM: Loaded 52792 primary data records. [2025-09-17T07:41:00.583694] [DEBUG] [MAIN ] RIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:00.585352] [INFO ] [MAIN ] RIV: Generated 1794 derivative records from 11587 primary records. [2025-09-17T07:41:00.586842] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-17T07:41:00.605446] [DEBUG] [LOCAL ] RIV: Derivative data saved (1794 records). [2025-09-17T07:41:00.618292] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-17T07:41:00.618576] [DEBUG] [MAIN ] RIO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:00.621031] [INFO ] [MAIN ] Derivative Progress: 1657/2172 symbols completed. RIV took 1.1s. Estimated remaining: 3m 13s. Rate: 160.1 symbols/min [2025-09-17T07:41:00.621322] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:00.622110] [INFO ] [MAIN ] RIO: Generated 1794 derivative records from 53404 primary records. [2025-09-17T07:41:00.622697] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-17T07:41:00.641299] [DEBUG] [LOCAL ] RIO: Derivative data saved (1794 records). [2025-09-17T07:41:00.641624] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-17T07:41:00.655913] [INFO ] [MAIN ] Derivative Progress: 1658/2172 symbols completed. RIO took 1.1s. Estimated remaining: 3m 13s. Rate: 160.2 symbols/min [2025-09-17T07:41:00.656826] [DEBUG] [MAIN ] RITM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:00.657146] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:00.657895] [INFO ] [MAIN ] RITM: Generated 1794 derivative records from 52792 primary records. [2025-09-17T07:41:00.658220] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-17T07:41:00.679538] [DEBUG] [LOCAL ] RITM: Derivative data saved (1794 records). [2025-09-17T07:41:00.679759] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-17T07:41:00.682358] [INFO ] [MAIN ] Derivative Progress: 1659/2172 symbols completed. RITM took 1.2s. Estimated remaining: 3m 12s. Rate: 160.2 symbols/min [2025-09-17T07:41:00.682832] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:00.734692] [DEBUG] [LOCAL ] RJF: Loaded 47105 existing records from primary storage. [2025-09-17T07:41:00.734863] [INFO ] [MAIN ] RJF: Loaded 47105 primary data records. [2025-09-17T07:41:00.862954] [DEBUG] [LOCAL ] RKT: Loaded 53720 existing records from primary storage. [2025-09-17T07:41:00.903347] [INFO ] [MAIN ] RKT: Loaded 53720 primary data records. [2025-09-17T07:41:01.061206] [DEBUG] [LOCAL ] RL: Loaded 42063 existing records from primary storage. [2025-09-17T07:41:01.081930] [INFO ] [MAIN ] RL: Loaded 42063 primary data records. [2025-09-17T07:41:01.756774] [DEBUG] [MAIN ] RJF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:01.759118] [INFO ] [MAIN ] RJF: Generated 1794 derivative records from 47105 primary records. [2025-09-17T07:41:01.759565] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-17T07:41:01.777726] [DEBUG] [LOCAL ] RJF: Derivative data saved (1794 records). [2025-09-17T07:41:01.778133] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-17T07:41:01.782397] [INFO ] [MAIN ] Derivative Progress: 1660/2172 symbols completed. RJF took 1.2s. Estimated remaining: 3m 12s. Rate: 160.1 symbols/min [2025-09-17T07:41:01.783299] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:01.804345] [DEBUG] [MAIN ] RL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:01.805337] [INFO ] [MAIN ] RL: Generated 1794 derivative records from 42063 primary records. [2025-09-17T07:41:01.805506] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-17T07:41:01.828837] [DEBUG] [MAIN ] RKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:01.847502] [DEBUG] [LOCAL ] RL: Derivative data saved (1794 records). [2025-09-17T07:41:01.846927] [INFO ] [MAIN ] RKT: Generated 1794 derivative records from 53720 primary records. [2025-09-17T07:41:01.847675] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-17T07:41:01.847754] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-17T07:41:01.850826] [INFO ] [MAIN ] Derivative Progress: 1661/2172 symbols completed. RL took 1.2s. Estimated remaining: 3m 11s. Rate: 160.1 symbols/min [2025-09-17T07:41:01.851620] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:01.868689] [DEBUG] [LOCAL ] RKT: Derivative data saved (1794 records). [2025-09-17T07:41:01.878487] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-17T07:41:01.880738] [INFO ] [MAIN ] Derivative Progress: 1662/2172 symbols completed. RKT took 1.2s. Estimated remaining: 3m 11s. Rate: 160.2 symbols/min [2025-09-17T07:41:01.881594] [DEBUG] [LOCAL ] RLI: Loaded 33303 existing records from primary storage. [2025-09-17T07:41:01.881922] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:01.882103] [INFO ] [MAIN ] RLI: Loaded 33303 primary data records. [2025-09-17T07:41:02.014303] [DEBUG] [LOCAL ] RLTY: Loaded 11238 existing records from primary storage. [2025-09-17T07:41:02.050587] [INFO ] [MAIN ] RLTY: Loaded 11238 primary data records. [2025-09-17T07:41:02.300338] [DEBUG] [LOCAL ] RLJ: Loaded 48337 existing records from primary storage. [2025-09-17T07:41:02.319218] [INFO ] [MAIN ] RLJ: Loaded 48337 primary data records. [2025-09-17T07:41:02.850014] [DEBUG] [MAIN ] RLI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:02.853041] [INFO ] [MAIN ] RLI: Generated 1794 derivative records from 33303 primary records. [2025-09-17T07:41:02.853625] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-17T07:41:02.884373] [DEBUG] [LOCAL ] RLI: Derivative data saved (1794 records). [2025-09-17T07:41:02.891995] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-17T07:41:02.892342] [DEBUG] [MAIN ] RLTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:02.895302] [INFO ] [MAIN ] Derivative Progress: 1663/2172 symbols completed. RLI took 1.1s. Estimated remaining: 3m 11s. Rate: 160.1 symbols/min [2025-09-17T07:41:02.897665] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11238 primary records. [2025-09-17T07:41:02.897998] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-17T07:41:02.931556] [DEBUG] [MAIN ] RLJ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:02.934277] [INFO ] [MAIN ] RLJ: Generated 1794 derivative records from 48337 primary records. [2025-09-17T07:41:02.935004] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-17T07:41:02.947389] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-09-17T07:41:02.953167] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-17T07:41:02.956441] [INFO ] [MAIN ] Derivative Progress: 1664/2172 symbols completed. RLTY took 1.1s. Estimated remaining: 3m 10s. Rate: 160.1 symbols/min [2025-09-17T07:41:02.957020] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1794 records). [2025-09-17T07:41:02.957277] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-17T07:41:02.960070] [INFO ] [MAIN ] Derivative Progress: 1665/2172 symbols completed. RLJ took 1.1s. Estimated remaining: 3m 10s. Rate: 160.2 symbols/min [2025-09-17T07:41:02.960633] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:02.960818] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:02.961010] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:02.978100] [DEBUG] [LOCAL ] RM: Loaded 7725 existing records from primary storage. [2025-09-17T07:41:02.978282] [INFO ] [MAIN ] RM: Loaded 7725 primary data records. [2025-09-17T07:41:03.074391] [DEBUG] [LOCAL ] RMAX: Loaded 21710 existing records from primary storage. [2025-09-17T07:41:03.107067] [INFO ] [MAIN ] RMAX: Loaded 21710 primary data records. [2025-09-17T07:41:03.417978] [DEBUG] [LOCAL ] RLX: Loaded 48166 existing records from primary storage. [2025-09-17T07:41:03.439548] [INFO ] [MAIN ] RLX: Loaded 48166 primary data records. [2025-09-17T07:41:04.008696] [DEBUG] [MAIN ] RM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:04.010270] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7725 primary records. [2025-09-17T07:41:04.010959] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-17T07:41:04.029811] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-09-17T07:41:04.030299] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-17T07:41:04.040415] [INFO ] [MAIN ] Derivative Progress: 1666/2172 symbols completed. RM took 1.1s. Estimated remaining: 3m 10s. Rate: 160.1 symbols/min [2025-09-17T07:41:04.046958] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:04.047373] [DEBUG] [MAIN ] RMAX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:04.048855] [INFO ] [MAIN ] RMAX: Generated 1794 derivative records from 21710 primary records. [2025-09-17T07:41:04.050080] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-17T07:41:04.062774] [DEBUG] [LOCAL ] RMI: Loaded 4502 existing records from primary storage. [2025-09-17T07:41:04.066807] [INFO ] [MAIN ] RMI: Loaded 4502 primary data records. [2025-09-17T07:41:04.103749] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1794 records). [2025-09-17T07:41:04.121117] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-17T07:41:04.137853] [INFO ] [MAIN ] Derivative Progress: 1667/2172 symbols completed. RMAX took 1.2s. Estimated remaining: 3m 9s. Rate: 160.1 symbols/min [2025-09-17T07:41:04.176833] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:04.280416] [DEBUG] [MAIN ] RLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:04.395912] [DEBUG] [LOCAL ] RMM: Loaded 10113 existing records from primary storage. [2025-09-17T07:41:04.406911] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48166 primary records. [2025-09-17T07:41:04.408193] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-17T07:41:04.408127] [INFO ] [MAIN ] RMM: Loaded 10113 primary data records. [2025-09-17T07:41:04.623006] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-09-17T07:41:04.626772] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-17T07:41:04.744511] [INFO ] [MAIN ] Derivative Progress: 1668/2172 symbols completed. RLX took 1.8s. Estimated remaining: 3m 9s. Rate: 160.1 symbols/min [2025-09-17T07:41:04.746081] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:04.758353] [DEBUG] [LOCAL ] RMMZ: Loaded 4796 existing records from primary storage. [2025-09-17T07:41:04.758955] [INFO ] [MAIN ] RMMZ: Loaded 4796 primary data records. [2025-09-17T07:41:04.778445] [DEBUG] [MAIN ] RMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:04.810158] [INFO ] [MAIN ] RMI: Generated 1794 derivative records from 4502 primary records. [2025-09-17T07:41:04.846522] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-17T07:41:05.115225] [DEBUG] [MAIN ] RMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:05.119174] [INFO ] [MAIN ] RMM: Generated 1794 derivative records from 10113 primary records. [2025-09-17T07:41:05.119370] [DEBUG] [LOCAL ] RMI: Derivative data saved (1794 records). [2025-09-17T07:41:05.119564] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-17T07:41:05.119632] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-17T07:41:05.123162] [INFO ] [MAIN ] Derivative Progress: 1669/2172 symbols completed. RMI took 1.1s. Estimated remaining: 3m 9s. Rate: 160.1 symbols/min [2025-09-17T07:41:05.137139] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:05.146344] [DEBUG] [LOCAL ] RMM: Derivative data saved (1794 records). [2025-09-17T07:41:05.146829] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-17T07:41:05.149177] [INFO ] [MAIN ] Derivative Progress: 1670/2172 symbols completed. RMM took 1.0s. Estimated remaining: 3m 8s. Rate: 160.2 symbols/min [2025-09-17T07:41:05.155525] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:05.169534] [DEBUG] [LOCAL ] RMT: Loaded 17795 existing records from primary storage. [2025-09-17T07:41:05.177564] [INFO ] [MAIN ] RMT: Loaded 17795 primary data records. [2025-09-17T07:41:05.182807] [DEBUG] [MAIN ] RMMZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:05.184006] [INFO ] [MAIN ] RMMZ: Generated 1794 derivative records from 4796 primary records. [2025-09-17T07:41:05.205136] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-17T07:41:05.393080] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1794 records). [2025-09-17T07:41:05.511920] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-17T07:41:05.526028] [INFO ] [MAIN ] Derivative Progress: 1671/2172 symbols completed. RMMZ took 0.8s. Estimated remaining: 3m 8s. Rate: 160.2 symbols/min [2025-09-17T07:41:05.526584] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:05.527837] [DEBUG] [LOCAL ] RNG: Loaded 48288 existing records from primary storage. [2025-09-17T07:41:05.528223] [INFO ] [MAIN ] RNG: Loaded 48288 primary data records. [2025-09-17T07:41:05.739497] [DEBUG] [LOCAL ] RNGR: Loaded 20302 existing records from primary storage. [2025-09-17T07:41:05.897615] [INFO ] [MAIN ] RNGR: Loaded 20302 primary data records. [2025-09-17T07:41:06.053377] [DEBUG] [MAIN ] RMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:06.087529] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17795 primary records. [2025-09-17T07:41:06.203681] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-17T07:41:06.265194] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-09-17T07:41:06.265868] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-17T07:41:06.268269] [INFO ] [MAIN ] Derivative Progress: 1672/2172 symbols completed. RMT took 1.1s. Estimated remaining: 3m 7s. Rate: 160.1 symbols/min [2025-09-17T07:41:06.268743] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:06.282297] [DEBUG] [MAIN ] RNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:06.284279] [INFO ] [MAIN ] RNG: Generated 1794 derivative records from 48288 primary records. [2025-09-17T07:41:06.284900] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-17T07:41:06.314030] [DEBUG] [LOCAL ] RNG: Derivative data saved (1794 records). [2025-09-17T07:41:06.312593] [DEBUG] [LOCAL ] RNP: Loaded 15896 existing records from primary storage. [2025-09-17T07:41:06.315184] [INFO ] [MAIN ] RNP: Loaded 15896 primary data records. [2025-09-17T07:41:06.315237] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-17T07:41:06.319399] [INFO ] [MAIN ] Derivative Progress: 1673/2172 symbols completed. RNG took 1.2s. Estimated remaining: 3m 7s. Rate: 160.1 symbols/min [2025-09-17T07:41:06.355145] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:06.411872] [DEBUG] [MAIN ] RNGR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:06.430478] [INFO ] [MAIN ] RNGR: Generated 1794 derivative records from 20302 primary records. [2025-09-17T07:41:06.452890] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-17T07:41:06.558954] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1794 records). [2025-09-17T07:41:06.681999] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-17T07:41:06.685394] [INFO ] [MAIN ] Derivative Progress: 1674/2172 symbols completed. RNGR took 1.2s. Estimated remaining: 3m 7s. Rate: 160.1 symbols/min [2025-09-17T07:41:06.701252] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:06.702516] [DEBUG] [LOCAL ] RNR: Loaded 34912 existing records from primary storage. [2025-09-17T07:41:06.704327] [INFO ] [MAIN ] RNR: Loaded 34912 primary data records. [2025-09-17T07:41:07.036262] [DEBUG] [LOCAL ] RNST: Loaded 37415 existing records from primary storage. [2025-09-17T07:41:07.047501] [INFO ] [MAIN ] RNST: Loaded 37415 primary data records. [2025-09-17T07:41:07.069123] [DEBUG] [MAIN ] RNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:07.102514] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 15896 primary records. [2025-09-17T07:41:07.140819] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-17T07:41:07.369669] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-09-17T07:41:07.369995] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-17T07:41:07.372362] [INFO ] [MAIN ] Derivative Progress: 1675/2172 symbols completed. RNP took 1.1s. Estimated remaining: 3m 6s. Rate: 160.1 symbols/min [2025-09-17T07:41:07.374252] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:07.392162] [DEBUG] [MAIN ] RNR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:07.392879] [INFO ] [MAIN ] RNR: Generated 1794 derivative records from 34912 primary records. [2025-09-17T07:41:07.393211] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-17T07:41:07.415404] [DEBUG] [LOCAL ] RNR: Derivative data saved (1794 records). [2025-09-17T07:41:07.422656] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-17T07:41:07.425911] [DEBUG] [LOCAL ] ROG: Loaded 23511 existing records from primary storage. [2025-09-17T07:41:07.425169] [INFO ] [MAIN ] Derivative Progress: 1676/2172 symbols completed. RNR took 1.1s. Estimated remaining: 3m 6s. Rate: 160.1 symbols/min [2025-09-17T07:41:07.426856] [INFO ] [MAIN ] ROG: Loaded 23511 primary data records. [2025-09-17T07:41:07.439446] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:07.531691] [DEBUG] [MAIN ] RNST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:07.542804] [INFO ] [MAIN ] RNST: Generated 1794 derivative records from 37415 primary records. [2025-09-17T07:41:07.553728] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-17T07:41:07.790084] [DEBUG] [LOCAL ] RNST: Derivative data saved (1794 records). [2025-09-17T07:41:07.790259] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-17T07:41:07.792863] [INFO ] [MAIN ] Derivative Progress: 1677/2172 symbols completed. RNST took 1.1s. Estimated remaining: 3m 5s. Rate: 160.2 symbols/min [2025-09-17T07:41:07.803406] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:07.823621] [DEBUG] [LOCAL ] ROK: Loaded 44181 existing records from primary storage. [2025-09-17T07:41:07.823984] [INFO ] [MAIN ] ROK: Loaded 44181 primary data records. [2025-09-17T07:41:08.047048] [DEBUG] [MAIN ] ROG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:08.163426] [INFO ] [MAIN ] ROG: Generated 1794 derivative records from 23511 primary records. [2025-09-17T07:41:08.178176] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-17T07:41:08.179860] [DEBUG] [LOCAL ] ROL: Loaded 50280 existing records from primary storage. [2025-09-17T07:41:08.180233] [INFO ] [MAIN ] ROL: Loaded 50280 primary data records. [2025-09-17T07:41:08.347975] [DEBUG] [LOCAL ] ROG: Derivative data saved (1794 records). [2025-09-17T07:41:08.375461] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-17T07:41:08.490896] [INFO ] [MAIN ] Derivative Progress: 1678/2172 symbols completed. ROG took 1.1s. Estimated remaining: 3m 5s. Rate: 160.1 symbols/min [2025-09-17T07:41:08.511077] [DEBUG] [MAIN ] ROK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:08.511999] [INFO ] [MAIN ] ROK: Generated 1794 derivative records from 44181 primary records. [2025-09-17T07:41:08.513010] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-17T07:41:08.531995] [DEBUG] [LOCAL ] ROK: Derivative data saved (1794 records). [2025-09-17T07:41:08.533828] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-17T07:41:08.536933] [INFO ] [MAIN ] Derivative Progress: 1679/2172 symbols completed. ROK took 1.1s. Estimated remaining: 3m 5s. Rate: 160.2 symbols/min [2025-09-17T07:41:08.550108] [DEBUG] [MAIN ] ROL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:08.550765] [INFO ] [MAIN ] ROL: Generated 1794 derivative records from 50280 primary records. [2025-09-17T07:41:08.550840] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-17T07:41:08.567281] [DEBUG] [LOCAL ] ROL: Derivative data saved (1794 records). [2025-09-17T07:41:08.567378] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-17T07:41:08.569727] [INFO ] [MAIN ] Derivative Progress: 1680/2172 symbols completed. ROL took 0.8s. Estimated remaining: 3m 4s. Rate: 160.2 symbols/min [2025-09-17T07:41:08.570204] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:08.570271] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:08.570490] [INFO ] [MAIN ] RQI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:08.628186] [DEBUG] [LOCAL ] RQI: Loaded 29102 existing records from primary storage. [2025-09-17T07:41:08.639736] [INFO ] [MAIN ] RQI: Loaded 29102 primary data records. [2025-09-17T07:41:08.651821] [DEBUG] [LOCAL ] RPM: Loaded 41100 existing records from primary storage. [2025-09-17T07:41:08.672150] [INFO ] [MAIN ] RPM: Loaded 41100 primary data records. [2025-09-17T07:41:08.824591] [DEBUG] [LOCAL ] RRC: Loaded 52781 existing records from primary storage. [2025-09-17T07:41:08.861101] [INFO ] [MAIN ] RRC: Loaded 52781 primary data records. [2025-09-17T07:41:09.602279] [DEBUG] [MAIN ] RPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:09.607234] [DEBUG] [MAIN ] RQI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:09.607917] [INFO ] [MAIN ] RPM: Generated 1794 derivative records from 41100 primary records. [2025-09-17T07:41:09.608423] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-17T07:41:09.608928] [INFO ] [MAIN ] RQI: Generated 1794 derivative records from 29102 primary records. [2025-09-17T07:41:09.609073] [DEBUG] [LOCAL ] RQI: Saving derivative data. [2025-09-17T07:41:09.641760] [DEBUG] [LOCAL ] RQI: Derivative data saved (1794 records). [2025-09-17T07:41:09.644065] [INFO ] [MAIN ] RQI: Successfully saved derivative data. [2025-09-17T07:41:09.646110] [DEBUG] [LOCAL ] RPM: Derivative data saved (1794 records). [2025-09-17T07:41:09.646033] [INFO ] [MAIN ] Derivative Progress: 1681/2172 symbols completed. RQI took 1.1s. Estimated remaining: 3m 4s. Rate: 160.1 symbols/min [2025-09-17T07:41:09.646457] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:09.646269] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-17T07:41:09.649236] [INFO ] [MAIN ] Derivative Progress: 1682/2172 symbols completed. RPM took 1.1s. Estimated remaining: 3m 4s. Rate: 160.2 symbols/min [2025-09-17T07:41:09.657585] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:09.663484] [DEBUG] [MAIN ] RRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:09.664432] [INFO ] [MAIN ] RRC: Generated 1794 derivative records from 52781 primary records. [2025-09-17T07:41:09.664838] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-17T07:41:09.681769] [DEBUG] [LOCAL ] RRC: Derivative data saved (1794 records). [2025-09-17T07:41:09.682001] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-17T07:41:09.684899] [INFO ] [MAIN ] Derivative Progress: 1683/2172 symbols completed. RRC took 1.1s. Estimated remaining: 3m 3s. Rate: 160.2 symbols/min [2025-09-17T07:41:09.685216] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:09.706469] [DEBUG] [LOCAL ] RS: Loaded 25931 existing records from primary storage. [2025-09-17T07:41:09.706702] [INFO ] [MAIN ] RS: Loaded 25931 primary data records. [2025-09-17T07:41:09.889408] [DEBUG] [LOCAL ] RRX: Loaded 41134 existing records from primary storage. [2025-09-17T07:41:09.916752] [INFO ] [MAIN ] RRX: Loaded 41134 primary data records. [2025-09-17T07:41:10.130106] [DEBUG] [LOCAL ] RSG: Loaded 47449 existing records from primary storage. [2025-09-17T07:41:10.165441] [INFO ] [MAIN ] RSG: Loaded 47449 primary data records. [2025-09-17T07:41:10.698309] [DEBUG] [MAIN ] RS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:10.699761] [INFO ] [MAIN ] RS: Generated 1794 derivative records from 25931 primary records. [2025-09-17T07:41:10.699996] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-17T07:41:10.720396] [DEBUG] [LOCAL ] RS: Derivative data saved (1794 records). [2025-09-17T07:41:10.720683] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-17T07:41:10.730926] [INFO ] [MAIN ] Derivative Progress: 1684/2172 symbols completed. RS took 1.1s. Estimated remaining: 3m 3s. Rate: 160.1 symbols/min [2025-09-17T07:41:10.736285] [DEBUG] [MAIN ] RRX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:10.736499] [INFO ] [MAIN ] RSI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:10.737136] [INFO ] [MAIN ] RRX: Generated 1794 derivative records from 41134 primary records. [2025-09-17T07:41:10.737881] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-17T07:41:10.767989] [DEBUG] [MAIN ] RSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:10.770097] [INFO ] [MAIN ] RSG: Generated 1794 derivative records from 47449 primary records. [2025-09-17T07:41:10.770215] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-17T07:41:10.772095] [DEBUG] [LOCAL ] RRX: Derivative data saved (1794 records). [2025-09-17T07:41:10.772381] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-17T07:41:10.782674] [INFO ] [MAIN ] Derivative Progress: 1685/2172 symbols completed. RRX took 1.1s. Estimated remaining: 3m 2s. Rate: 160.2 symbols/min [2025-09-17T07:41:10.788617] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:10.790262] [DEBUG] [LOCAL ] RSG: Derivative data saved (1794 records). [2025-09-17T07:41:10.790496] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-17T07:41:10.793188] [INFO ] [MAIN ] Derivative Progress: 1686/2172 symbols completed. RSG took 1.1s. Estimated remaining: 3m 2s. Rate: 160.2 symbols/min [2025-09-17T07:41:10.793699] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:10.827232] [DEBUG] [LOCAL ] RSI: Loaded 47306 existing records from primary storage. [2025-09-17T07:41:10.835278] [INFO ] [MAIN ] RSI: Loaded 47306 primary data records. [2025-09-17T07:41:10.955410] [DEBUG] [LOCAL ] RSKD: Loaded 34258 existing records from primary storage. [2025-09-17T07:41:10.981776] [INFO ] [MAIN ] RSKD: Loaded 34258 primary data records. [2025-09-17T07:41:11.084020] [DEBUG] [LOCAL ] RTO: Loaded 40747 existing records from primary storage. [2025-09-17T07:41:11.252973] [INFO ] [MAIN ] RTO: Loaded 40747 primary data records. [2025-09-17T07:41:11.827865] [DEBUG] [MAIN ] RSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:11.829220] [INFO ] [MAIN ] RSI: Generated 1794 derivative records from 47306 primary records. [2025-09-17T07:41:11.829409] [DEBUG] [LOCAL ] RSI: Saving derivative data. [2025-09-17T07:41:11.862167] [DEBUG] [LOCAL ] RSI: Derivative data saved (1794 records). [2025-09-17T07:41:11.862821] [DEBUG] [MAIN ] RSKD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:11.862882] [INFO ] [MAIN ] RSI: Successfully saved derivative data. [2025-09-17T07:41:11.865947] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 34258 primary records. [2025-09-17T07:41:11.865078] [INFO ] [MAIN ] Derivative Progress: 1687/2172 symbols completed. RSI took 1.1s. Estimated remaining: 3m 2s. Rate: 160.1 symbols/min [2025-09-17T07:41:11.866079] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-17T07:41:11.866383] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:11.893075] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-09-17T07:41:11.898101] [DEBUG] [MAIN ] RTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:11.898304] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-17T07:41:11.898929] [INFO ] [MAIN ] RTO: Generated 1794 derivative records from 40747 primary records. [2025-09-17T07:41:11.901255] [INFO ] [MAIN ] Derivative Progress: 1688/2172 symbols completed. RSKD took 1.1s. Estimated remaining: 3m 1s. Rate: 160.2 symbols/min [2025-09-17T07:41:11.901558] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:11.901379] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-17T07:41:11.923280] [DEBUG] [LOCAL ] RTO: Derivative data saved (1794 records). [2025-09-17T07:41:11.923440] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-17T07:41:11.926006] [INFO ] [MAIN ] Derivative Progress: 1689/2172 symbols completed. RTO took 1.1s. Estimated remaining: 3m 1s. Rate: 160.2 symbols/min [2025-09-17T07:41:11.926266] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:11.991035] [DEBUG] [LOCAL ] RTX: Loaded 53712 existing records from primary storage. [2025-09-17T07:41:12.004163] [INFO ] [MAIN ] RTX: Loaded 53712 primary data records. [2025-09-17T07:41:12.026238] [DEBUG] [LOCAL ] RVLV: Loaded 48038 existing records from primary storage. [2025-09-17T07:41:12.005083] [DEBUG] [LOCAL ] RVT: Loaded 27371 existing records from primary storage. [2025-09-17T07:41:12.059939] [INFO ] [MAIN ] RVLV: Loaded 48038 primary data records. [2025-09-17T07:41:12.092055] [INFO ] [MAIN ] RVT: Loaded 27371 primary data records. [2025-09-17T07:41:12.937732] [DEBUG] [MAIN ] RTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:12.941423] [INFO ] [MAIN ] RTX: Generated 1794 derivative records from 53712 primary records. [2025-09-17T07:41:12.942425] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-17T07:41:12.983595] [DEBUG] [MAIN ] RVLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:12.980886] [DEBUG] [MAIN ] RVT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:12.986210] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 27371 primary records. [2025-09-17T07:41:12.985259] [DEBUG] [LOCAL ] RTX: Derivative data saved (1794 records). [2025-09-17T07:41:12.986504] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-17T07:41:12.988828] [INFO ] [MAIN ] Derivative Progress: 1690/2172 symbols completed. RTX took 1.1s. Estimated remaining: 3m 1s. Rate: 160.1 symbols/min [2025-09-17T07:41:12.986432] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-17T07:41:12.989593] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:12.987040] [INFO ] [MAIN ] RVLV: Generated 1794 derivative records from 48038 primary records. [2025-09-17T07:41:12.990234] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-17T07:41:13.018573] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-09-17T07:41:13.022538] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1794 records). [2025-09-17T07:41:13.022758] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-17T07:41:13.022057] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-17T07:41:13.025239] [INFO ] [MAIN ] Derivative Progress: 1691/2172 symbols completed. RVLV took 1.1s. Estimated remaining: 3m 0s. Rate: 160.2 symbols/min [2025-09-17T07:41:13.028847] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:13.028984] [INFO ] [MAIN ] Derivative Progress: 1692/2172 symbols completed. RVT took 1.1s. Estimated remaining: 2m 60s. Rate: 160.2 symbols/min [2025-09-17T07:41:13.029769] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:13.069181] [DEBUG] [LOCAL ] RVTY: Loaded 47546 existing records from primary storage. [2025-09-17T07:41:13.069415] [INFO ] [MAIN ] RVTY: Loaded 47546 primary data records. [2025-09-17T07:41:13.291386] [DEBUG] [LOCAL ] RXO: Loaded 47716 existing records from primary storage. [2025-09-17T07:41:13.402700] [INFO ] [MAIN ] RXO: Loaded 47716 primary data records. [2025-09-17T07:41:13.393852] [DEBUG] [LOCAL ] RWT: Loaded 40497 existing records from primary storage. [2025-09-17T07:41:13.403452] [INFO ] [MAIN ] RWT: Loaded 40497 primary data records. [2025-09-17T07:41:14.076186] [DEBUG] [MAIN ] RVTY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:14.077726] [INFO ] [MAIN ] RVTY: Generated 1794 derivative records from 47546 primary records. [2025-09-17T07:41:14.077844] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-17T07:41:14.098111] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1794 records). [2025-09-17T07:41:14.098627] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-17T07:41:14.100915] [INFO ] [MAIN ] Derivative Progress: 1693/2172 symbols completed. RVTY took 1.1s. Estimated remaining: 2m 60s. Rate: 160.1 symbols/min [2025-09-17T07:41:14.121890] [DEBUG] [MAIN ] RXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:14.135190] [INFO ] [MAIN ] RXO: Generated 1794 derivative records from 47716 primary records. [2025-09-17T07:41:14.135718] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-17T07:41:14.136669] [DEBUG] [MAIN ] RWT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:14.145311] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40497 primary records. [2025-09-17T07:41:14.151484] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-17T07:41:14.162325] [DEBUG] [LOCAL ] RXO: Derivative data saved (1794 records). [2025-09-17T07:41:14.168347] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-17T07:41:14.171788] [INFO ] [MAIN ] Derivative Progress: 1694/2172 symbols completed. RXO took 1.1s. Estimated remaining: 2m 59s. Rate: 160.1 symbols/min [2025-09-17T07:41:14.169209] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-09-17T07:41:14.172125] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-17T07:41:14.174430] [INFO ] [MAIN ] Derivative Progress: 1695/2172 symbols completed. RWT took 1.1s. Estimated remaining: 2m 59s. Rate: 160.2 symbols/min [2025-09-17T07:41:14.175040] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:14.175227] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:14.175542] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:14.230819] [DEBUG] [LOCAL ] RYAM: Loaded 35181 existing records from primary storage. [2025-09-17T07:41:14.231042] [INFO ] [MAIN ] RYAM: Loaded 35181 primary data records. [2025-09-17T07:41:14.361058] [DEBUG] [LOCAL ] RYAN: Loaded 43877 existing records from primary storage. [2025-09-17T07:41:14.372478] [DEBUG] [LOCAL ] RY: Loaded 48093 existing records from primary storage. [2025-09-17T07:41:14.382937] [INFO ] [MAIN ] RYAN: Loaded 43877 primary data records. [2025-09-17T07:41:14.388116] [INFO ] [MAIN ] RY: Loaded 48093 primary data records. [2025-09-17T07:41:15.192164] [DEBUG] [MAIN ] RYAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:15.194741] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35181 primary records. [2025-09-17T07:41:15.195341] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-17T07:41:15.215090] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-09-17T07:41:15.215661] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-17T07:41:15.225667] [INFO ] [MAIN ] Derivative Progress: 1696/2172 symbols completed. RYAM took 1.1s. Estimated remaining: 2m 58s. Rate: 160.1 symbols/min [2025-09-17T07:41:15.231597] [DEBUG] [MAIN ] RY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:15.231326] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:15.232770] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 48093 primary records. [2025-09-17T07:41:15.235349] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-17T07:41:15.263361] [DEBUG] [MAIN ] RYAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:15.268230] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 43877 primary records. [2025-09-17T07:41:15.268358] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-17T07:41:15.267550] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-09-17T07:41:15.268484] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-17T07:41:15.271800] [INFO ] [MAIN ] Derivative Progress: 1697/2172 symbols completed. RY took 1.1s. Estimated remaining: 2m 58s. Rate: 160.2 symbols/min [2025-09-17T07:41:15.286141] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:15.293095] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-09-17T07:41:15.293240] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-17T07:41:15.296042] [INFO ] [MAIN ] Derivative Progress: 1698/2172 symbols completed. RYAN took 1.1s. Estimated remaining: 2m 57s. Rate: 160.2 symbols/min [2025-09-17T07:41:15.296452] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:15.305190] [DEBUG] [LOCAL ] RYI: Loaded 21534 existing records from primary storage. [2025-09-17T07:41:15.305382] [INFO ] [MAIN ] RYI: Loaded 21534 primary data records. [2025-09-17T07:41:15.385773] [DEBUG] [LOCAL ] RZB: Loaded 6241 existing records from primary storage. [2025-09-17T07:41:15.412239] [INFO ] [MAIN ] RZB: Loaded 6241 primary data records. [2025-09-17T07:41:15.952060] [DEBUG] [LOCAL ] RYN: Loaded 45815 existing records from primary storage. [2025-09-17T07:41:15.967664] [INFO ] [MAIN ] RYN: Loaded 45815 primary data records. [2025-09-17T07:41:16.303873] [DEBUG] [MAIN ] RYI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:16.305867] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21534 primary records. [2025-09-17T07:41:16.306750] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-17T07:41:16.327322] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-09-17T07:41:16.327450] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-17T07:41:16.329544] [INFO ] [MAIN ] Derivative Progress: 1699/2172 symbols completed. RYI took 1.1s. Estimated remaining: 2m 57s. Rate: 160.1 symbols/min [2025-09-17T07:41:16.330140] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:16.352781] [DEBUG] [MAIN ] RZB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:16.354256] [INFO ] [MAIN ] RZB: Generated 1794 derivative records from 6241 primary records. [2025-09-17T07:41:16.356976] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-17T07:41:16.361871] [DEBUG] [LOCAL ] RZC: Loaded 6928 existing records from primary storage. [2025-09-17T07:41:16.369491] [INFO ] [MAIN ] RZC: Loaded 6928 primary data records. [2025-09-17T07:41:16.481901] [DEBUG] [LOCAL ] RZB: Derivative data saved (1794 records). [2025-09-17T07:41:16.499698] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-17T07:41:16.515709] [DEBUG] [MAIN ] RYN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:16.550425] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45815 primary records. [2025-09-17T07:41:16.569968] [INFO ] [MAIN ] Derivative Progress: 1700/2172 symbols completed. RZB took 1.3s. Estimated remaining: 2m 57s. Rate: 160.1 symbols/min [2025-09-17T07:41:16.570926] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-17T07:41:16.685367] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:16.703846] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-09-17T07:41:16.704450] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-17T07:41:16.707543] [INFO ] [MAIN ] Derivative Progress: 1701/2172 symbols completed. RYN took 1.4s. Estimated remaining: 2m 56s. Rate: 160.2 symbols/min [2025-09-17T07:41:16.708007] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:16.732875] [DEBUG] [MAIN ] RZC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:16.747374] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6928 primary records. [2025-09-17T07:41:16.747615] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-17T07:41:16.765877] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-09-17T07:41:16.774323] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-17T07:41:16.791393] [INFO ] [MAIN ] Derivative Progress: 1702/2172 symbols completed. RZC took 0.5s. Estimated remaining: 2m 56s. Rate: 160.2 symbols/min [2025-09-17T07:41:16.791799] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:16.793077] [DEBUG] [LOCAL ] S: Loaded 53543 existing records from primary storage. [2025-09-17T07:41:16.793539] [INFO ] [MAIN ] S: Loaded 53543 primary data records. [2025-09-17T07:41:16.911418] [DEBUG] [LOCAL ] SA: Loaded 42890 existing records from primary storage. [2025-09-17T07:41:16.915805] [DEBUG] [LOCAL ] SABA: Loaded 9425 existing records from primary storage. [2025-09-17T07:41:16.931684] [INFO ] [MAIN ] SA: Loaded 42890 primary data records. [2025-09-17T07:41:16.990831] [INFO ] [MAIN ] SABA: Loaded 9425 primary data records. [2025-09-17T07:41:17.761777] [DEBUG] [MAIN ] S: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:17.763586] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53543 primary records. [2025-09-17T07:41:17.765035] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-17T07:41:17.783530] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-09-17T07:41:17.784044] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-17T07:41:17.786267] [INFO ] [MAIN ] Derivative Progress: 1703/2172 symbols completed. S took 1.1s. Estimated remaining: 2m 56s. Rate: 160.1 symbols/min [2025-09-17T07:41:17.787070] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:17.806842] [DEBUG] [MAIN ] SABA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:17.820292] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9425 primary records. [2025-09-17T07:41:17.820769] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-17T07:41:17.820731] [DEBUG] [MAIN ] SA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:17.822013] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 42890 primary records. [2025-09-17T07:41:17.822262] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-17T07:41:17.846157] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-09-17T07:41:17.854041] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-17T07:41:17.859866] [INFO ] [MAIN ] Derivative Progress: 1704/2172 symbols completed. SABA took 1.1s. Estimated remaining: 2m 55s. Rate: 160.2 symbols/min [2025-09-17T07:41:17.861311] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:17.875318] [DEBUG] [LOCAL ] SAFE: Loaded 30542 existing records from primary storage. [2025-09-17T07:41:17.875774] [INFO ] [MAIN ] SAFE: Loaded 30542 primary data records. [2025-09-17T07:41:17.876321] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-09-17T07:41:17.919799] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-17T07:41:17.965191] [INFO ] [MAIN ] Derivative Progress: 1705/2172 symbols completed. SA took 1.3s. Estimated remaining: 2m 55s. Rate: 160.2 symbols/min [2025-09-17T07:41:17.983858] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:18.053787] [DEBUG] [LOCAL ] SAH: Loaded 22358 existing records from primary storage. [2025-09-17T07:41:18.073077] [INFO ] [MAIN ] SAH: Loaded 22358 primary data records. [2025-09-17T07:41:18.276533] [DEBUG] [LOCAL ] SAM: Loaded 21690 existing records from primary storage. [2025-09-17T07:41:18.287792] [INFO ] [MAIN ] SAM: Loaded 21690 primary data records. [2025-09-17T07:41:18.818912] [DEBUG] [MAIN ] SAFE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:18.821284] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30542 primary records. [2025-09-17T07:41:18.822705] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-17T07:41:18.840387] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-09-17T07:41:18.841842] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-17T07:41:18.844562] [INFO ] [MAIN ] Derivative Progress: 1706/2172 symbols completed. SAFE took 1.1s. Estimated remaining: 2m 55s. Rate: 160.1 symbols/min [2025-09-17T07:41:18.845086] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:18.873224] [DEBUG] [MAIN ] SAH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:18.875730] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 22358 primary records. [2025-09-17T07:41:18.876085] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-17T07:41:18.891659] [DEBUG] [MAIN ] SAM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:18.904215] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21690 primary records. [2025-09-17T07:41:18.905106] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-17T07:41:18.924202] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-09-17T07:41:18.937216] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-17T07:41:18.939630] [INFO ] [MAIN ] Derivative Progress: 1707/2172 symbols completed. SAM took 1.0s. Estimated remaining: 2m 54s. Rate: 160.2 symbols/min [2025-09-17T07:41:18.940599] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:18.941431] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-09-17T07:41:18.941822] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-17T07:41:18.944010] [INFO ] [MAIN ] Derivative Progress: 1708/2172 symbols completed. SAH took 1.1s. Estimated remaining: 2m 54s. Rate: 160.3 symbols/min [2025-09-17T07:41:18.962267] [DEBUG] [LOCAL ] SAND: Loaded 51777 existing records from primary storage. [2025-09-17T07:41:18.962514] [INFO ] [MAIN ] SAND: Loaded 51777 primary data records. [2025-09-17T07:41:19.275202] [DEBUG] [LOCAL ] SAP: Loaded 50090 existing records from primary storage. [2025-09-17T07:41:19.275544] [INFO ] [MAIN ] SAP: Loaded 50090 primary data records. [2025-09-17T07:41:19.629524] [DEBUG] [MAIN ] SAND: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:19.630485] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51777 primary records. [2025-09-17T07:41:19.630658] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-17T07:41:19.647717] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-09-17T07:41:19.647835] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-17T07:41:19.650160] [INFO ] [MAIN ] Derivative Progress: 1709/2172 symbols completed. SAND took 0.8s. Estimated remaining: 2m 53s. Rate: 160.2 symbols/min [2025-09-17T07:41:19.665521] [DEBUG] [MAIN ] SAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:19.666107] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 50090 primary records. [2025-09-17T07:41:19.666182] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-17T07:41:19.682819] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-09-17T07:41:19.682928] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-17T07:41:19.685704] [INFO ] [MAIN ] Derivative Progress: 1710/2172 symbols completed. SAP took 0.7s. Estimated remaining: 2m 53s. Rate: 160.3 symbols/min [2025-09-17T07:41:19.686409] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:19.686288] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:19.686235] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:19.711186] [DEBUG] [LOCAL ] SAR: Loaded 16529 existing records from primary storage. [2025-09-17T07:41:19.711506] [INFO ] [MAIN ] SAR: Loaded 16529 primary data records. [2025-09-17T07:41:19.853778] [DEBUG] [LOCAL ] SB: Loaded 33778 existing records from primary storage. [2025-09-17T07:41:19.883475] [INFO ] [MAIN ] SB: Loaded 33778 primary data records. [2025-09-17T07:41:20.134420] [DEBUG] [LOCAL ] SARO: Loaded 48767 existing records from primary storage. [2025-09-17T07:41:20.152271] [INFO ] [MAIN ] SARO: Loaded 48767 primary data records. [2025-09-17T07:41:20.693432] [DEBUG] [MAIN ] SAR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:20.695220] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 16529 primary records. [2025-09-17T07:41:20.695605] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-17T07:41:20.729719] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-09-17T07:41:20.730166] [DEBUG] [MAIN ] SB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:20.731154] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33778 primary records. [2025-09-17T07:41:20.731347] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-17T07:41:20.731465] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-17T07:41:20.735301] [INFO ] [MAIN ] Derivative Progress: 1711/2172 symbols completed. SAR took 1.0s. Estimated remaining: 2m 53s. Rate: 160.1 symbols/min [2025-09-17T07:41:20.743047] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:20.753951] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-09-17T07:41:20.766762] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-17T07:41:20.767162] [DEBUG] [MAIN ] SARO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:20.767953] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48767 primary records. [2025-09-17T07:41:20.770225] [INFO ] [MAIN ] Derivative Progress: 1712/2172 symbols completed. SB took 1.1s. Estimated remaining: 2m 52s. Rate: 160.2 symbols/min [2025-09-17T07:41:20.770405] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-17T07:41:20.770608] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:20.793656] [DEBUG] [LOCAL ] SBI: Loaded 7698 existing records from primary storage. [2025-09-17T07:41:20.795956] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-09-17T07:41:20.796204] [INFO ] [MAIN ] SBI: Loaded 7698 primary data records. [2025-09-17T07:41:20.796491] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-17T07:41:20.799229] [INFO ] [MAIN ] Derivative Progress: 1713/2172 symbols completed. SARO took 1.1s. Estimated remaining: 2m 52s. Rate: 160.3 symbols/min [2025-09-17T07:41:20.804823] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:20.954609] [DEBUG] [LOCAL ] SBR: Loaded 7276 existing records from primary storage. [2025-09-17T07:41:20.960969] [DEBUG] [LOCAL ] SBH: Loaded 49788 existing records from primary storage. [2025-09-17T07:41:20.985691] [INFO ] [MAIN ] SBR: Loaded 7276 primary data records. [2025-09-17T07:41:20.985602] [INFO ] [MAIN ] SBH: Loaded 49788 primary data records. [2025-09-17T07:41:21.788408] [DEBUG] [MAIN ] SBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:21.789888] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7698 primary records. [2025-09-17T07:41:21.790343] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-17T07:41:21.810175] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-09-17T07:41:21.811105] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-17T07:41:21.814321] [INFO ] [MAIN ] Derivative Progress: 1714/2172 symbols completed. SBI took 1.0s. Estimated remaining: 2m 52s. Rate: 160.1 symbols/min [2025-09-17T07:41:21.830114] [DEBUG] [MAIN ] SBR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:21.829273] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:21.831261] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7276 primary records. [2025-09-17T07:41:21.832362] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-17T07:41:21.866211] [DEBUG] [MAIN ] SBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:21.867182] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-09-17T07:41:21.868027] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-17T07:41:21.869279] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49788 primary records. [2025-09-17T07:41:21.872125] [INFO ] [MAIN ] Derivative Progress: 1715/2172 symbols completed. SBR took 1.1s. Estimated remaining: 2m 51s. Rate: 160.2 symbols/min [2025-09-17T07:41:21.872418] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-17T07:41:21.872672] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:21.890675] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-09-17T07:41:21.890860] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-17T07:41:21.893662] [INFO ] [MAIN ] Derivative Progress: 1716/2172 symbols completed. SBH took 1.2s. Estimated remaining: 2m 51s. Rate: 160.3 symbols/min [2025-09-17T07:41:21.898806] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:21.917726] [DEBUG] [LOCAL ] SBSI: Loaded 14601 existing records from primary storage. [2025-09-17T07:41:21.918025] [INFO ] [MAIN ] SBSI: Loaded 14601 primary data records. [2025-09-17T07:41:22.039913] [DEBUG] [LOCAL ] SBS: Loaded 49352 existing records from primary storage. [2025-09-17T07:41:22.056723] [INFO ] [MAIN ] SBS: Loaded 49352 primary data records. [2025-09-17T07:41:22.383492] [DEBUG] [LOCAL ] SBSW: Loaded 52930 existing records from primary storage. [2025-09-17T07:41:22.422810] [INFO ] [MAIN ] SBSW: Loaded 52930 primary data records. [2025-09-17T07:41:22.904279] [DEBUG] [MAIN ] SBSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:22.907012] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14601 primary records. [2025-09-17T07:41:22.907141] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-17T07:41:22.938694] [DEBUG] [MAIN ] SBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:22.941801] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-09-17T07:41:22.942680] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49352 primary records. [2025-09-17T07:41:22.942829] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-17T07:41:22.942911] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-17T07:41:22.947104] [INFO ] [MAIN ] Derivative Progress: 1717/2172 symbols completed. SBSI took 1.1s. Estimated remaining: 2m 51s. Rate: 160.1 symbols/min [2025-09-17T07:41:22.948299] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:22.968254] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-09-17T07:41:22.968501] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-17T07:41:22.984633] [INFO ] [MAIN ] Derivative Progress: 1718/2172 symbols completed. SBS took 1.2s. Estimated remaining: 2m 50s. Rate: 160.2 symbols/min [2025-09-17T07:41:22.981217] [DEBUG] [MAIN ] SBSW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:22.984959] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:22.986016] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 52930 primary records. [2025-09-17T07:41:22.986196] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-17T07:41:23.008608] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-09-17T07:41:23.008880] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-17T07:41:23.012087] [INFO ] [MAIN ] Derivative Progress: 1719/2172 symbols completed. SBSW took 1.1s. Estimated remaining: 2m 50s. Rate: 160.3 symbols/min [2025-09-17T07:41:23.012785] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:23.020109] [DEBUG] [LOCAL ] SCD: Loaded 12537 existing records from primary storage. [2025-09-17T07:41:23.020256] [INFO ] [MAIN ] SCD: Loaded 12537 primary data records. [2025-09-17T07:41:23.189208] [DEBUG] [LOCAL ] SCCO: Loaded 49398 existing records from primary storage. [2025-09-17T07:41:23.198300] [INFO ] [MAIN ] SCCO: Loaded 49398 primary data records. [2025-09-17T07:41:23.550466] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-09-17T07:41:23.712582] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-09-17T07:41:24.047329] [DEBUG] [MAIN ] SCD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:24.050784] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 12537 primary records. [2025-09-17T07:41:24.051086] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-17T07:41:24.065380] [DEBUG] [MAIN ] SCCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:24.066814] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49398 primary records. [2025-09-17T07:41:24.067379] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-17T07:41:24.100035] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-09-17T07:41:24.101858] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-09-17T07:41:24.102048] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-17T07:41:24.105098] [INFO ] [MAIN ] Derivative Progress: 1720/2172 symbols completed. SCCO took 1.2s. Estimated remaining: 2m 49s. Rate: 160.1 symbols/min [2025-09-17T07:41:24.102281] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-17T07:41:24.108027] [INFO ] [MAIN ] Derivative Progress: 1721/2172 symbols completed. SCD took 1.1s. Estimated remaining: 2m 49s. Rate: 160.2 symbols/min [2025-09-17T07:41:24.108372] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:24.108799] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:24.128697] [DEBUG] [MAIN ] SCHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:24.133855] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-09-17T07:41:24.133980] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-17T07:41:24.155467] [DEBUG] [LOCAL ] SCL: Loaded 14755 existing records from primary storage. [2025-09-17T07:41:24.156911] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-09-17T07:41:24.157207] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-17T07:41:24.157323] [INFO ] [MAIN ] SCL: Loaded 14755 primary data records. [2025-09-17T07:41:24.159908] [INFO ] [MAIN ] Derivative Progress: 1722/2172 symbols completed. SCHW took 1.1s. Estimated remaining: 2m 48s. Rate: 160.3 symbols/min [2025-09-17T07:41:24.160483] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:24.354756] [DEBUG] [LOCAL ] SCI: Loaded 46821 existing records from primary storage. [2025-09-17T07:41:24.383531] [INFO ] [MAIN ] SCI: Loaded 46821 primary data records. [2025-09-17T07:41:24.537517] [DEBUG] [LOCAL ] SCM: Loaded 20156 existing records from primary storage. [2025-09-17T07:41:24.582998] [INFO ] [MAIN ] SCM: Loaded 20156 primary data records. [2025-09-17T07:41:25.165455] [DEBUG] [MAIN ] SCL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:25.166897] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14755 primary records. [2025-09-17T07:41:25.168384] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-17T07:41:25.189963] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-09-17T07:41:25.203349] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-17T07:41:25.206145] [INFO ] [MAIN ] Derivative Progress: 1723/2172 symbols completed. SCL took 1.1s. Estimated remaining: 2m 48s. Rate: 160.1 symbols/min [2025-09-17T07:41:25.207066] [DEBUG] [MAIN ] SCI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:25.207832] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46821 primary records. [2025-09-17T07:41:25.208104] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-17T07:41:25.227132] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-09-17T07:41:25.227365] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-17T07:41:25.230187] [INFO ] [MAIN ] Derivative Progress: 1724/2172 symbols completed. SCI took 1.1s. Estimated remaining: 2m 48s. Rate: 160.2 symbols/min [2025-09-17T07:41:25.242861] [DEBUG] [MAIN ] SCM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:25.243489] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 20156 primary records. [2025-09-17T07:41:25.243566] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-17T07:41:25.259305] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-09-17T07:41:25.259392] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-17T07:41:25.261716] [INFO ] [MAIN ] Derivative Progress: 1725/2172 symbols completed. SCM took 1.1s. Estimated remaining: 2m 47s. Rate: 160.3 symbols/min [2025-09-17T07:41:25.262270] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:25.262800] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:25.262841] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:25.279015] [DEBUG] [LOCAL ] SDHC: Loaded 10516 existing records from primary storage. [2025-09-17T07:41:25.279282] [INFO ] [MAIN ] SDHC: Loaded 10516 primary data records. [2025-09-17T07:41:25.414117] [DEBUG] [LOCAL ] SD: Loaded 29171 existing records from primary storage. [2025-09-17T07:41:25.435787] [INFO ] [MAIN ] SD: Loaded 29171 primary data records. [2025-09-17T07:41:25.544924] [DEBUG] [LOCAL ] SCS: Loaded 42722 existing records from primary storage. [2025-09-17T07:41:25.763821] [INFO ] [MAIN ] SCS: Loaded 42722 primary data records. [2025-09-17T07:41:26.315374] [DEBUG] [MAIN ] SDHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:26.317259] [INFO ] [MAIN ] SDHC: Generated 1794 derivative records from 10516 primary records. [2025-09-17T07:41:26.317547] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-17T07:41:26.348564] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1794 records). [2025-09-17T07:41:26.347695] [DEBUG] [MAIN ] SD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:26.349312] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 29171 primary records. [2025-09-17T07:41:26.348736] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-17T07:41:26.349569] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-17T07:41:26.352313] [INFO ] [MAIN ] Derivative Progress: 1726/2172 symbols completed. SDHC took 1.1s. Estimated remaining: 2m 47s. Rate: 160.1 symbols/min [2025-09-17T07:41:26.354699] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:26.380872] [DEBUG] [MAIN ] SCS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:26.382488] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 42722 primary records. [2025-09-17T07:41:26.384051] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-09-17T07:41:26.384101] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-17T07:41:26.386370] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-17T07:41:26.389370] [INFO ] [MAIN ] Derivative Progress: 1727/2172 symbols completed. SD took 1.1s. Estimated remaining: 2m 47s. Rate: 160.2 symbols/min [2025-09-17T07:41:26.397292] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:26.407377] [DEBUG] [LOCAL ] SDHY: Loaded 10765 existing records from primary storage. [2025-09-17T07:41:26.409966] [INFO ] [MAIN ] SDHY: Loaded 10765 primary data records. [2025-09-17T07:41:26.409890] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-09-17T07:41:26.421489] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-17T07:41:26.455099] [INFO ] [MAIN ] Derivative Progress: 1728/2172 symbols completed. SCS took 1.2s. Estimated remaining: 2m 46s. Rate: 160.3 symbols/min [2025-09-17T07:41:26.481204] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:26.738737] [DEBUG] [LOCAL ] SDRL: Loaded 42247 existing records from primary storage. [2025-09-17T07:41:26.739516] [INFO ] [MAIN ] SDRL: Loaded 42247 primary data records. [2025-09-17T07:41:26.921871] [DEBUG] [LOCAL ] SE: Loaded 53405 existing records from primary storage. [2025-09-17T07:41:26.956734] [INFO ] [MAIN ] SE: Loaded 53405 primary data records. [2025-09-17T07:41:27.249786] [DEBUG] [MAIN ] SDHY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:27.424991] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 10765 primary records. [2025-09-17T07:41:27.440048] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-17T07:41:27.457322] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-09-17T07:41:27.458234] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-17T07:41:27.460806] [INFO ] [MAIN ] Derivative Progress: 1729/2172 symbols completed. SDHY took 1.1s. Estimated remaining: 2m 46s. Rate: 160.1 symbols/min [2025-09-17T07:41:27.461500] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:27.484661] [DEBUG] [MAIN ] SDRL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:27.485808] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 42247 primary records. [2025-09-17T07:41:27.486111] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-17T07:41:27.517846] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-09-17T07:41:27.516726] [DEBUG] [MAIN ] SE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:27.518129] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-17T07:41:27.518608] [INFO ] [MAIN ] SE: Generated 1794 derivative records from 53405 primary records. [2025-09-17T07:41:27.531449] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-09-17T07:41:27.520729] [INFO ] [MAIN ] Derivative Progress: 1730/2172 symbols completed. SDRL took 1.1s. Estimated remaining: 2m 46s. Rate: 160.2 symbols/min [2025-09-17T07:41:27.532865] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:27.549843] [DEBUG] [LOCAL ] SE: Derivative data saved (1794 records). [2025-09-17T07:41:27.563249] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-09-17T07:41:27.566066] [INFO ] [MAIN ] Derivative Progress: 1731/2172 symbols completed. SE took 1.1s. Estimated remaining: 2m 45s. Rate: 160.3 symbols/min [2025-09-17T07:41:27.569636] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:27.570853] [DEBUG] [LOCAL ] SEE: Loaded 48491 existing records from primary storage. [2025-09-17T07:41:27.571350] [INFO ] [MAIN ] SEE: Loaded 48491 primary data records. [2025-09-17T07:41:27.657289] [DEBUG] [LOCAL ] SEG: Loaded 14006 existing records from primary storage. [2025-09-17T07:41:27.679301] [INFO ] [MAIN ] SEG: Loaded 14006 primary data records. [2025-09-17T07:41:28.205277] [DEBUG] [LOCAL ] SEI: Loaded 49547 existing records from primary storage. [2025-09-17T07:41:28.206058] [INFO ] [MAIN ] SEI: Loaded 49547 primary data records. [2025-09-17T07:41:28.532154] [DEBUG] [MAIN ] SEE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:28.533919] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48491 primary records. [2025-09-17T07:41:28.535192] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-17T07:41:28.572374] [DEBUG] [MAIN ] SEG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:28.572468] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-09-17T07:41:28.573477] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 14006 primary records. [2025-09-17T07:41:28.573861] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-17T07:41:28.576567] [INFO ] [MAIN ] Derivative Progress: 1732/2172 symbols completed. SEE took 1.1s. Estimated remaining: 2m 45s. Rate: 160.1 symbols/min [2025-09-17T07:41:28.573924] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-17T07:41:28.577052] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:28.595435] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-09-17T07:41:28.595561] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-17T07:41:28.598518] [INFO ] [MAIN ] Derivative Progress: 1733/2172 symbols completed. SEG took 1.1s. Estimated remaining: 2m 44s. Rate: 160.2 symbols/min [2025-09-17T07:41:28.598879] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:28.614753] [DEBUG] [MAIN ] SEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:28.615716] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49547 primary records. [2025-09-17T07:41:28.615882] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-17T07:41:28.632882] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-09-17T07:41:28.643051] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-17T07:41:28.645600] [INFO ] [MAIN ] Derivative Progress: 1734/2172 symbols completed. SEI took 1.1s. Estimated remaining: 2m 44s. Rate: 160.3 symbols/min [2025-09-17T07:41:28.646264] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:28.673791] [DEBUG] [LOCAL ] SEM: Loaded 43155 existing records from primary storage. [2025-09-17T07:41:28.673991] [INFO ] [MAIN ] SEM: Loaded 43155 primary data records. [2025-09-17T07:41:28.789478] [DEBUG] [LOCAL ] SEMR: Loaded 41787 existing records from primary storage. [2025-09-17T07:41:28.795491] [INFO ] [MAIN ] SEMR: Loaded 41787 primary data records. [2025-09-17T07:41:29.086558] [DEBUG] [LOCAL ] SES: Loaded 51522 existing records from primary storage. [2025-09-17T07:41:29.111586] [INFO ] [MAIN ] SES: Loaded 51522 primary data records. [2025-09-17T07:41:29.677239] [DEBUG] [MAIN ] SEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:29.678398] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 43155 primary records. [2025-09-17T07:41:29.678546] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-17T07:41:29.698404] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-09-17T07:41:29.698779] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-17T07:41:29.714629] [INFO ] [MAIN ] Derivative Progress: 1735/2172 symbols completed. SEM took 1.1s. Estimated remaining: 2m 44s. Rate: 160.1 symbols/min [2025-09-17T07:41:29.712469] [DEBUG] [MAIN ] SEMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:29.715211] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:29.716170] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41787 primary records. [2025-09-17T07:41:29.716674] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-17T07:41:29.735637] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-09-17T07:41:29.748828] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-17T07:41:29.751565] [INFO ] [MAIN ] Derivative Progress: 1736/2172 symbols completed. SEMR took 1.2s. Estimated remaining: 2m 43s. Rate: 160.2 symbols/min [2025-09-17T07:41:29.749107] [DEBUG] [MAIN ] SES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:29.753416] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51522 primary records. [2025-09-17T07:41:29.753594] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-17T07:41:29.752045] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:29.773259] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-09-17T07:41:29.785494] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-17T07:41:29.785801] [DEBUG] [LOCAL ] SFB: Loaded 4095 existing records from primary storage. [2025-09-17T07:41:29.788528] [INFO ] [MAIN ] Derivative Progress: 1737/2172 symbols completed. SES took 1.1s. Estimated remaining: 2m 43s. Rate: 160.3 symbols/min [2025-09-17T07:41:29.788631] [INFO ] [MAIN ] SFB: Loaded 4095 primary data records. [2025-09-17T07:41:29.788963] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:29.912065] [DEBUG] [LOCAL ] SF: Loaded 41950 existing records from primary storage. [2025-09-17T07:41:29.968029] [INFO ] [MAIN ] SF: Loaded 41950 primary data records. [2025-09-17T07:41:30.115316] [DEBUG] [LOCAL ] SFBS: Loaded 21394 existing records from primary storage. [2025-09-17T07:41:30.140472] [INFO ] [MAIN ] SFBS: Loaded 21394 primary data records. [2025-09-17T07:41:30.720125] [DEBUG] [MAIN ] SFB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:30.721561] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 4095 primary records. [2025-09-17T07:41:30.722371] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-17T07:41:30.739389] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-09-17T07:41:30.741029] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-17T07:41:30.743463] [INFO ] [MAIN ] Derivative Progress: 1738/2172 symbols completed. SFB took 1.0s. Estimated remaining: 2m 43s. Rate: 160.1 symbols/min [2025-09-17T07:41:30.756943] [DEBUG] [MAIN ] SF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:30.757679] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41950 primary records. [2025-09-17T07:41:30.757912] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-17T07:41:30.787885] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-09-17T07:41:30.787041] [DEBUG] [MAIN ] SFBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:30.788031] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-17T07:41:30.788727] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21394 primary records. [2025-09-17T07:41:30.791087] [INFO ] [MAIN ] Derivative Progress: 1739/2172 symbols completed. SF took 1.1s. Estimated remaining: 2m 42s. Rate: 160.2 symbols/min [2025-09-17T07:41:30.791185] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-17T07:41:30.806484] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-09-17T07:41:30.806561] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-17T07:41:30.808692] [INFO ] [MAIN ] Derivative Progress: 1740/2172 symbols completed. SFBS took 1.0s. Estimated remaining: 2m 42s. Rate: 160.3 symbols/min [2025-09-17T07:41:30.809194] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:30.809227] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:30.809327] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:30.874038] [DEBUG] [LOCAL ] SFL: Loaded 45538 existing records from primary storage. [2025-09-17T07:41:30.874862] [INFO ] [MAIN ] SFL: Loaded 45538 primary data records. [2025-09-17T07:41:31.002065] [DEBUG] [LOCAL ] SG: Loaded 53464 existing records from primary storage. [2025-09-17T07:41:31.005964] [DEBUG] [LOCAL ] SGHC: Loaded 45273 existing records from primary storage. [2025-09-17T07:41:31.006521] [INFO ] [MAIN ] SGHC: Loaded 45273 primary data records. [2025-09-17T07:41:31.006574] [INFO ] [MAIN ] SG: Loaded 53464 primary data records. [2025-09-17T07:41:31.835279] [DEBUG] [MAIN ] SFL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:31.835998] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45538 primary records. [2025-09-17T07:41:31.836515] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-17T07:41:31.856299] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-09-17T07:41:31.880114] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-17T07:41:31.881319] [DEBUG] [MAIN ] SGHC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:41:31.881054] [DEBUG] [MAIN ] SG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:31.884252] [INFO ] [MAIN ] Derivative Progress: 1741/2172 symbols completed. SFL took 1.1s. Estimated remaining: 2m 42s. Rate: 160.1 symbols/min [2025-09-17T07:41:31.885678] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:31.885149] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53464 primary records. [2025-09-17T07:41:31.886061] [INFO ] [MAIN ] SGHC: Generated 1793 derivative records from 45273 primary records. [2025-09-17T07:41:31.886462] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-17T07:41:31.886703] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-17T07:41:31.915806] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-09-17T07:41:31.916763] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-17T07:41:31.921324] [INFO ] [MAIN ] Derivative Progress: 1742/2172 symbols completed. SG took 1.1s. Estimated remaining: 2m 41s. Rate: 160.2 symbols/min [2025-09-17T07:41:31.922442] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1793 records). [2025-09-17T07:41:31.922809] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-17T07:41:31.922703] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:31.929232] [DEBUG] [LOCAL ] SGU: Loaded 6617 existing records from primary storage. [2025-09-17T07:41:31.928999] [INFO ] [MAIN ] Derivative Progress: 1743/2172 symbols completed. SGHC took 1.1s. Estimated remaining: 2m 41s. Rate: 160.3 symbols/min [2025-09-17T07:41:31.929560] [INFO ] [MAIN ] SGU: Loaded 6617 primary data records. [2025-09-17T07:41:31.930031] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:32.242214] [DEBUG] [LOCAL ] SHCO: Loaded 26419 existing records from primary storage. [2025-09-17T07:41:32.242716] [INFO ] [MAIN ] SHCO: Loaded 26419 primary data records. [2025-09-17T07:41:32.364695] [DEBUG] [LOCAL ] SHAK: Loaded 49228 existing records from primary storage. [2025-09-17T07:41:32.391294] [INFO ] [MAIN ] SHAK: Loaded 49228 primary data records. [2025-09-17T07:41:32.760000] [DEBUG] [MAIN ] SGU: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:41:32.873621] [INFO ] [MAIN ] SGU: Generated 1793 derivative records from 6617 primary records. [2025-09-17T07:41:32.873784] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-17T07:41:32.891204] [DEBUG] [LOCAL ] SGU: Derivative data saved (1793 records). [2025-09-17T07:41:32.892047] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-17T07:41:32.894446] [INFO ] [MAIN ] Derivative Progress: 1744/2172 symbols completed. SGU took 1.0s. Estimated remaining: 2m 40s. Rate: 160.2 symbols/min [2025-09-17T07:41:32.895092] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:32.915668] [DEBUG] [MAIN ] SHCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:32.916457] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 26419 primary records. [2025-09-17T07:41:32.916581] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-17T07:41:32.945955] [DEBUG] [MAIN ] SHAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:32.948491] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 49228 primary records. [2025-09-17T07:41:32.949581] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-17T07:41:32.949482] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-09-17T07:41:32.950374] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-17T07:41:32.952514] [INFO ] [MAIN ] Derivative Progress: 1745/2172 symbols completed. SHCO took 1.0s. Estimated remaining: 2m 40s. Rate: 160.2 symbols/min [2025-09-17T07:41:32.961167] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:32.983357] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-09-17T07:41:32.983545] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-17T07:41:32.985949] [INFO ] [MAIN ] Derivative Progress: 1746/2172 symbols completed. SHAK took 1.1s. Estimated remaining: 2m 39s. Rate: 160.3 symbols/min [2025-09-17T07:41:32.986418] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:33.016390] [DEBUG] [LOCAL ] SHEL: Loaded 53673 existing records from primary storage. [2025-09-17T07:41:33.016711] [INFO ] [MAIN ] SHEL: Loaded 53673 primary data records. [2025-09-17T07:41:33.116056] [DEBUG] [LOCAL ] SHG: Loaded 27707 existing records from primary storage. [2025-09-17T07:41:33.137123] [INFO ] [MAIN ] SHG: Loaded 27707 primary data records. [2025-09-17T07:41:33.440696] [DEBUG] [LOCAL ] SHO: Loaded 49830 existing records from primary storage. [2025-09-17T07:41:33.472961] [INFO ] [MAIN ] SHO: Loaded 49830 primary data records. [2025-09-17T07:41:33.973344] [DEBUG] [MAIN ] SHEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:33.978133] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53673 primary records. [2025-09-17T07:41:33.986131] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-17T07:41:33.991319] [DEBUG] [MAIN ] SHG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:34.000948] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 27707 primary records. [2025-09-17T07:41:34.005173] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-17T07:41:34.008229] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-09-17T07:41:34.008677] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-17T07:41:34.021449] [INFO ] [MAIN ] Derivative Progress: 1747/2172 symbols completed. SHEL took 1.1s. Estimated remaining: 2m 39s. Rate: 160.1 symbols/min [2025-09-17T07:41:34.023549] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:34.029430] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-09-17T07:41:34.042721] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-17T07:41:34.044978] [INFO ] [MAIN ] Derivative Progress: 1748/2172 symbols completed. SHG took 1.1s. Estimated remaining: 2m 39s. Rate: 160.2 symbols/min [2025-09-17T07:41:34.045306] [DEBUG] [MAIN ] SHO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:34.045658] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:34.046415] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49830 primary records. [2025-09-17T07:41:34.049260] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-17T07:41:34.049171] [DEBUG] [LOCAL ] SHOC: Loaded 4280 existing records from primary storage. [2025-09-17T07:41:34.049439] [INFO ] [MAIN ] SHOC: Loaded 4280 primary data records. [2025-09-17T07:41:34.207799] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-09-17T07:41:34.244628] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-17T07:41:34.361453] [INFO ] [MAIN ] Derivative Progress: 1749/2172 symbols completed. SHO took 1.4s. Estimated remaining: 2m 38s. Rate: 160.2 symbols/min [2025-09-17T07:41:34.362133] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:34.398121] [DEBUG] [LOCAL ] SHW: Loaded 50554 existing records from primary storage. [2025-09-17T07:41:34.399982] [INFO ] [MAIN ] SHW: Loaded 50554 primary data records. [2025-09-17T07:41:34.610449] [DEBUG] [MAIN ] SHOC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:41:34.633254] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 4280 primary records. [2025-09-17T07:41:34.712819] [DEBUG] [LOCAL ] SID: Loaded 42068 existing records from primary storage. [2025-09-17T07:41:34.727002] [INFO ] [MAIN ] SID: Loaded 42068 primary data records. [2025-09-17T07:41:34.726897] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-17T07:41:34.853204] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-09-17T07:41:34.869136] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-17T07:41:34.898622] [INFO ] [MAIN ] Derivative Progress: 1750/2172 symbols completed. SHOC took 0.9s. Estimated remaining: 2m 38s. Rate: 160.2 symbols/min [2025-09-17T07:41:34.898988] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:35.067441] [DEBUG] [MAIN ] SHW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:35.069243] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50554 primary records. [2025-09-17T07:41:35.069566] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-17T07:41:35.096112] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-09-17T07:41:35.096306] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-17T07:41:35.098658] [INFO ] [MAIN ] Derivative Progress: 1751/2172 symbols completed. SHW took 1.1s. Estimated remaining: 2m 38s. Rate: 160.3 symbols/min [2025-09-17T07:41:35.101537] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:35.128530] [DEBUG] [MAIN ] SID: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:35.129514] [DEBUG] [LOCAL ] SIG: Loaded 46812 existing records from primary storage. [2025-09-17T07:41:35.130585] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42068 primary records. [2025-09-17T07:41:35.130743] [INFO ] [MAIN ] SIG: Loaded 46812 primary data records. [2025-09-17T07:41:35.130886] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-17T07:41:35.216445] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-09-17T07:41:35.238635] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-17T07:41:35.257174] [INFO ] [MAIN ] Derivative Progress: 1752/2172 symbols completed. SID took 0.9s. Estimated remaining: 2m 37s. Rate: 160.3 symbols/min [2025-09-17T07:41:35.305019] [DEBUG] [LOCAL ] SII: Loaded 22885 existing records from primary storage. [2025-09-17T07:41:35.313741] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:35.336684] [INFO ] [MAIN ] SII: Loaded 22885 primary data records. [2025-09-17T07:41:35.798032] [DEBUG] [LOCAL ] SILA: Loaded 31315 existing records from primary storage. [2025-09-17T07:41:35.808140] [INFO ] [MAIN ] SILA: Loaded 31315 primary data records. [2025-09-17T07:41:36.020335] [DEBUG] [MAIN ] SIG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:36.134274] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 46812 primary records. [2025-09-17T07:41:36.134934] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-17T07:41:36.157971] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-09-17T07:41:36.170769] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-17T07:41:36.173810] [DEBUG] [MAIN ] SII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:36.173445] [INFO ] [MAIN ] Derivative Progress: 1753/2172 symbols completed. SIG took 1.3s. Estimated remaining: 2m 37s. Rate: 160.2 symbols/min [2025-09-17T07:41:36.174950] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 22885 primary records. [2025-09-17T07:41:36.175330] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-17T07:41:36.192278] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-09-17T07:41:36.192449] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-17T07:41:36.194922] [INFO ] [MAIN ] Derivative Progress: 1754/2172 symbols completed. SII took 1.1s. Estimated remaining: 2m 36s. Rate: 160.3 symbols/min [2025-09-17T07:41:36.211229] [DEBUG] [MAIN ] SILA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:36.211872] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 31315 primary records. [2025-09-17T07:41:36.211949] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-17T07:41:36.227299] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-09-17T07:41:36.227369] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-17T07:41:36.229703] [INFO ] [MAIN ] Derivative Progress: 1755/2172 symbols completed. SILA took 0.9s. Estimated remaining: 2m 36s. Rate: 160.3 symbols/min [2025-09-17T07:41:36.230311] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:36.230395] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:36.230479] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:36.304024] [DEBUG] [LOCAL ] SITC: Loaded 41687 existing records from primary storage. [2025-09-17T07:41:36.305233] [DEBUG] [LOCAL ] SITE: Loaded 35336 existing records from primary storage. [2025-09-17T07:41:36.318920] [INFO ] [MAIN ] SITE: Loaded 35336 primary data records. [2025-09-17T07:41:36.305365] [INFO ] [MAIN ] SITC: Loaded 41687 primary data records. [2025-09-17T07:41:36.350072] [DEBUG] [LOCAL ] SJM: Loaded 50109 existing records from primary storage. [2025-09-17T07:41:36.360522] [INFO ] [MAIN ] SJM: Loaded 50109 primary data records. [2025-09-17T07:41:37.312553] [DEBUG] [MAIN ] SITC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:37.313759] [DEBUG] [MAIN ] SITE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:37.316604] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41687 primary records. [2025-09-17T07:41:37.316112] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35336 primary records. [2025-09-17T07:41:37.317065] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-17T07:41:37.317875] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-17T07:41:37.360097] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-09-17T07:41:37.360025] [DEBUG] [MAIN ] SJM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:37.361543] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-17T07:41:37.363071] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50109 primary records. [2025-09-17T07:41:37.365225] [INFO ] [MAIN ] Derivative Progress: 1756/2172 symbols completed. SITE took 1.1s. Estimated remaining: 2m 36s. Rate: 160.2 symbols/min [2025-09-17T07:41:37.367943] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-09-17T07:41:37.368041] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-17T07:41:37.368308] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:37.368571] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-17T07:41:37.372422] [INFO ] [MAIN ] Derivative Progress: 1757/2172 symbols completed. SITC took 1.1s. Estimated remaining: 2m 35s. Rate: 160.2 symbols/min [2025-09-17T07:41:37.372953] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:37.389968] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-09-17T07:41:37.390218] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-17T07:41:37.392513] [INFO ] [MAIN ] Derivative Progress: 1758/2172 symbols completed. SJM took 1.2s. Estimated remaining: 2m 35s. Rate: 160.3 symbols/min [2025-09-17T07:41:37.392987] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:37.406496] [DEBUG] [LOCAL ] SKIL: Loaded 6295 existing records from primary storage. [2025-09-17T07:41:37.406873] [INFO ] [MAIN ] SKIL: Loaded 6295 primary data records. [2025-09-17T07:41:37.508549] [DEBUG] [LOCAL ] SJT: Loaded 22075 existing records from primary storage. [2025-09-17T07:41:37.524855] [INFO ] [MAIN ] SJT: Loaded 22075 primary data records. [2025-09-17T07:41:37.724078] [DEBUG] [LOCAL ] SKE: Loaded 35179 existing records from primary storage. [2025-09-17T07:41:37.843257] [INFO ] [MAIN ] SKE: Loaded 35179 primary data records. [2025-09-17T07:41:38.339157] [DEBUG] [MAIN ] SKIL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:38.340027] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6295 primary records. [2025-09-17T07:41:38.341420] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-17T07:41:38.366912] [DEBUG] [MAIN ] SJT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:38.370495] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22075 primary records. [2025-09-17T07:41:38.371522] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-17T07:41:38.371244] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-09-17T07:41:38.372016] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-17T07:41:38.374179] [INFO ] [MAIN ] Derivative Progress: 1759/2172 symbols completed. SKIL took 1.0s. Estimated remaining: 2m 35s. Rate: 160.2 symbols/min [2025-09-17T07:41:38.374694] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:38.389636] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-09-17T07:41:38.390030] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-17T07:41:38.393832] [INFO ] [MAIN ] Derivative Progress: 1760/2172 symbols completed. SJT took 1.0s. Estimated remaining: 2m 34s. Rate: 160.3 symbols/min [2025-09-17T07:41:38.394943] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:38.411785] [DEBUG] [MAIN ] SKE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:38.412686] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 35179 primary records. [2025-09-17T07:41:38.412815] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-17T07:41:38.418334] [DEBUG] [LOCAL ] SKLZ: Loaded 12028 existing records from primary storage. [2025-09-17T07:41:38.429359] [INFO ] [MAIN ] SKLZ: Loaded 12028 primary data records. [2025-09-17T07:41:38.543126] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-09-17T07:41:38.543262] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-17T07:41:38.545709] [INFO ] [MAIN ] Derivative Progress: 1761/2172 symbols completed. SKE took 1.2s. Estimated remaining: 2m 34s. Rate: 160.3 symbols/min [2025-09-17T07:41:38.546350] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:38.741996] [DEBUG] [LOCAL ] SKM: Loaded 35464 existing records from primary storage. [2025-09-17T07:41:38.742742] [INFO ] [MAIN ] SKM: Loaded 35464 primary data records. [2025-09-17T07:41:39.098068] [DEBUG] [LOCAL ] SKT: Loaded 42515 existing records from primary storage. [2025-09-17T07:41:39.098561] [INFO ] [MAIN ] SKT: Loaded 42515 primary data records. [2025-09-17T07:41:39.246435] [DEBUG] [MAIN ] SKLZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:39.292497] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 12028 primary records. [2025-09-17T07:41:39.411520] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-17T07:41:39.430678] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-09-17T07:41:39.433289] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-17T07:41:39.435410] [INFO ] [MAIN ] Derivative Progress: 1762/2172 symbols completed. SKLZ took 1.1s. Estimated remaining: 2m 34s. Rate: 160.2 symbols/min [2025-09-17T07:41:39.448941] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:39.449574] [DEBUG] [MAIN ] SKM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:39.450472] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 35464 primary records. [2025-09-17T07:41:39.451039] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-17T07:41:39.470675] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-09-17T07:41:39.470891] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-17T07:41:39.473284] [INFO ] [MAIN ] Derivative Progress: 1763/2172 symbols completed. SKM took 1.1s. Estimated remaining: 2m 33s. Rate: 160.3 symbols/min [2025-09-17T07:41:39.486913] [DEBUG] [MAIN ] SKT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:39.486973] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:39.487757] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42515 primary records. [2025-09-17T07:41:39.488150] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-17T07:41:39.512987] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-09-17T07:41:39.513161] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-17T07:41:39.519166] [INFO ] [MAIN ] Derivative Progress: 1764/2172 symbols completed. SKT took 1.0s. Estimated remaining: 2m 33s. Rate: 160.4 symbols/min [2025-09-17T07:41:39.519981] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:39.532180] [DEBUG] [LOCAL ] SKY: Loaded 37601 existing records from primary storage. [2025-09-17T07:41:39.538207] [DEBUG] [LOCAL ] SKYH: Loaded 16523 existing records from primary storage. [2025-09-17T07:41:39.538340] [INFO ] [MAIN ] SKY: Loaded 37601 primary data records. [2025-09-17T07:41:39.538447] [INFO ] [MAIN ] SKYH: Loaded 16523 primary data records. [2025-09-17T07:41:40.147160] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-17T07:41:40.148959] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-09-17T07:41:40.464387] [DEBUG] [MAIN ] SKY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:40.465817] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 37601 primary records. [2025-09-17T07:41:40.465984] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-17T07:41:40.480045] [DEBUG] [MAIN ] SKYH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:40.489399] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16523 primary records. [2025-09-17T07:41:40.495099] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-17T07:41:40.496053] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-09-17T07:41:40.496550] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-17T07:41:40.499256] [INFO ] [MAIN ] Derivative Progress: 1765/2172 symbols completed. SKY took 1.1s. Estimated remaining: 2m 32s. Rate: 160.2 symbols/min [2025-09-17T07:41:40.500013] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:40.516878] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-09-17T07:41:40.518429] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-17T07:41:40.520873] [INFO ] [MAIN ] Derivative Progress: 1766/2172 symbols completed. SKYH took 1.0s. Estimated remaining: 2m 32s. Rate: 160.3 symbols/min [2025-09-17T07:41:40.521274] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:40.533847] [DEBUG] [MAIN ] SLB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:40.534814] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-09-17T07:41:40.535087] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-17T07:41:40.551929] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-09-17T07:41:40.552085] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-17T07:41:40.554724] [INFO ] [MAIN ] Derivative Progress: 1767/2172 symbols completed. SLB took 1.0s. Estimated remaining: 2m 32s. Rate: 160.4 symbols/min [2025-09-17T07:41:40.555141] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:40.583791] [DEBUG] [LOCAL ] SLF: Loaded 39373 existing records from primary storage. [2025-09-17T07:41:40.584017] [INFO ] [MAIN ] SLF: Loaded 39373 primary data records. [2025-09-17T07:41:40.800334] [DEBUG] [LOCAL ] SLG: Loaded 45558 existing records from primary storage. [2025-09-17T07:41:40.807341] [INFO ] [MAIN ] SLG: Loaded 45558 primary data records. [2025-09-17T07:41:40.930165] [DEBUG] [LOCAL ] SLGN: Loaded 40234 existing records from primary storage. [2025-09-17T07:41:40.961574] [INFO ] [MAIN ] SLGN: Loaded 40234 primary data records. [2025-09-17T07:41:41.574917] [DEBUG] [MAIN ] SLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:41.576099] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 39373 primary records. [2025-09-17T07:41:41.577687] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-17T07:41:41.597351] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-09-17T07:41:41.597750] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-17T07:41:41.600085] [INFO ] [MAIN ] Derivative Progress: 1768/2172 symbols completed. SLF took 1.1s. Estimated remaining: 2m 31s. Rate: 160.2 symbols/min [2025-09-17T07:41:41.629275] [DEBUG] [MAIN ] SLG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:41.629476] [DEBUG] [MAIN ] SLGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:41.630504] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45558 primary records. [2025-09-17T07:41:41.631266] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40234 primary records. [2025-09-17T07:41:41.631325] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-17T07:41:41.631470] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-17T07:41:41.661207] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-09-17T07:41:41.662680] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-17T07:41:41.665802] [INFO ] [MAIN ] Derivative Progress: 1769/2172 symbols completed. SLG took 1.1s. Estimated remaining: 2m 31s. Rate: 160.3 symbols/min [2025-09-17T07:41:41.663465] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-09-17T07:41:41.666052] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-17T07:41:41.668784] [INFO ] [MAIN ] Derivative Progress: 1770/2172 symbols completed. SLGN took 1.1s. Estimated remaining: 2m 30s. Rate: 160.4 symbols/min [2025-09-17T07:41:41.669280] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:41.669377] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:41.669474] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:41.705096] [DEBUG] [LOCAL ] SLVM: Loaded 28030 existing records from primary storage. [2025-09-17T07:41:41.705317] [INFO ] [MAIN ] SLVM: Loaded 28030 primary data records. [2025-09-17T07:41:42.006950] [DEBUG] [LOCAL ] SM: Loaded 52323 existing records from primary storage. [2025-09-17T07:41:42.035809] [INFO ] [MAIN ] SM: Loaded 52323 primary data records. [2025-09-17T07:41:42.045673] [DEBUG] [LOCAL ] SLQT: Loaded 44443 existing records from primary storage. [2025-09-17T07:41:42.102422] [INFO ] [MAIN ] SLQT: Loaded 44443 primary data records. [2025-09-17T07:41:42.691101] [DEBUG] [MAIN ] SLVM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:42.693980] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 28030 primary records. [2025-09-17T07:41:42.694409] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-17T07:41:42.719782] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-09-17T07:41:42.720986] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-17T07:41:42.731041] [INFO ] [MAIN ] Derivative Progress: 1771/2172 symbols completed. SLVM took 1.1s. Estimated remaining: 2m 30s. Rate: 160.2 symbols/min [2025-09-17T07:41:42.744149] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:42.743744] [DEBUG] [MAIN ] SM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:42.750225] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52323 primary records. [2025-09-17T07:41:42.750755] [DEBUG] [MAIN ] SLQT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:42.750891] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-17T07:41:42.752342] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 44443 primary records. [2025-09-17T07:41:42.752941] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-17T07:41:42.787773] [DEBUG] [LOCAL ] SMBK: Loaded 8272 existing records from primary storage. [2025-09-17T07:41:42.782680] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-09-17T07:41:42.788406] [INFO ] [MAIN ] SMBK: Loaded 8272 primary data records. [2025-09-17T07:41:42.788885] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-17T07:41:42.792051] [INFO ] [MAIN ] Derivative Progress: 1772/2172 symbols completed. SM took 1.1s. Estimated remaining: 2m 30s. Rate: 160.3 symbols/min [2025-09-17T07:41:42.837514] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-09-17T07:41:42.869399] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-17T07:41:42.869324] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:42.900714] [INFO ] [MAIN ] Derivative Progress: 1773/2172 symbols completed. SLQT took 1.2s. Estimated remaining: 2m 29s. Rate: 160.4 symbols/min [2025-09-17T07:41:42.906861] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:43.129388] [DEBUG] [LOCAL ] SMC: Loaded 11502 existing records from primary storage. [2025-09-17T07:41:43.129623] [INFO ] [MAIN ] SMC: Loaded 11502 primary data records. [2025-09-17T07:41:43.461399] [DEBUG] [LOCAL ] SMFG: Loaded 48184 existing records from primary storage. [2025-09-17T07:41:43.462127] [INFO ] [MAIN ] SMFG: Loaded 48184 primary data records. [2025-09-17T07:41:43.776946] [DEBUG] [MAIN ] SMBK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:43.777957] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8272 primary records. [2025-09-17T07:41:43.778168] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-17T07:41:43.797981] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-09-17T07:41:43.799174] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-17T07:41:43.801842] [INFO ] [MAIN ] Derivative Progress: 1774/2172 symbols completed. SMBK took 1.1s. Estimated remaining: 2m 29s. Rate: 160.2 symbols/min [2025-09-17T07:41:43.814784] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:43.816528] [DEBUG] [MAIN ] SMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:43.817324] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11502 primary records. [2025-09-17T07:41:43.817549] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-17T07:41:43.837104] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-09-17T07:41:43.837577] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-17T07:41:43.840089] [INFO ] [MAIN ] Derivative Progress: 1775/2172 symbols completed. SMC took 1.0s. Estimated remaining: 2m 29s. Rate: 160.3 symbols/min [2025-09-17T07:41:43.841003] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:43.860013] [DEBUG] [MAIN ] SMFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:43.865376] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48184 primary records. [2025-09-17T07:41:43.865611] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-17T07:41:43.893094] [DEBUG] [LOCAL ] SMHI: Loaded 14649 existing records from primary storage. [2025-09-17T07:41:43.894563] [INFO ] [MAIN ] SMHI: Loaded 14649 primary data records. [2025-09-17T07:41:43.969143] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-09-17T07:41:44.016978] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-17T07:41:44.019633] [INFO ] [MAIN ] Derivative Progress: 1776/2172 symbols completed. SMFG took 1.1s. Estimated remaining: 2m 28s. Rate: 160.4 symbols/min [2025-09-17T07:41:44.016838] [DEBUG] [LOCAL ] SMG: Loaded 44376 existing records from primary storage. [2025-09-17T07:41:44.030590] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:44.071970] [INFO ] [MAIN ] SMG: Loaded 44376 primary data records. [2025-09-17T07:41:44.330883] [DEBUG] [LOCAL ] SMP: Loaded 20039 existing records from primary storage. [2025-09-17T07:41:44.388420] [INFO ] [MAIN ] SMP: Loaded 20039 primary data records. [2025-09-17T07:41:44.904857] [DEBUG] [MAIN ] SMHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:44.906459] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 14649 primary records. [2025-09-17T07:41:44.907684] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-17T07:41:44.926067] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-09-17T07:41:44.927052] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-17T07:41:44.929904] [INFO ] [MAIN ] Derivative Progress: 1777/2172 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 28s. Rate: 160.2 symbols/min [2025-09-17T07:41:44.930427] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:44.947844] [DEBUG] [MAIN ] SMG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:44.948589] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 44376 primary records. [2025-09-17T07:41:44.948957] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-17T07:41:44.965427] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-09-17T07:41:44.966120] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-17T07:41:44.968311] [INFO ] [MAIN ] Derivative Progress: 1778/2172 symbols completed. SMG took 1.2s. Estimated remaining: 2m 27s. Rate: 160.3 symbols/min [2025-09-17T07:41:44.969134] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:44.986477] [DEBUG] [MAIN ] SMP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:44.987236] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 20039 primary records. [2025-09-17T07:41:44.987377] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-17T07:41:45.003127] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-09-17T07:41:45.003256] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-17T07:41:45.005681] [INFO ] [MAIN ] Derivative Progress: 1779/2172 symbols completed. SMP took 1.0s. Estimated remaining: 2m 27s. Rate: 160.4 symbols/min [2025-09-17T07:41:45.006127] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:45.067182] [DEBUG] [LOCAL ] SMR: Loaded 53797 existing records from primary storage. [2025-09-17T07:41:45.067995] [DEBUG] [LOCAL ] SMRT: Loaded 44448 existing records from primary storage. [2025-09-17T07:41:45.077675] [INFO ] [MAIN ] SMRT: Loaded 44448 primary data records. [2025-09-17T07:41:45.068102] [INFO ] [MAIN ] SMR: Loaded 53797 primary data records. [2025-09-17T07:41:45.285361] [DEBUG] [LOCAL ] SMWB: Loaded 33445 existing records from primary storage. [2025-09-17T07:41:45.363401] [INFO ] [MAIN ] SMWB: Loaded 33445 primary data records. [2025-09-17T07:41:46.053887] [DEBUG] [MAIN ] SMR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:46.056254] [INFO ] [MAIN ] SMR: Generated 1794 derivative records from 53797 primary records. [2025-09-17T07:41:46.056359] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-09-17T07:41:46.055201] [DEBUG] [MAIN ] SMRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:46.059164] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 44448 primary records. [2025-09-17T07:41:46.072477] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-17T07:41:46.077968] [DEBUG] [LOCAL ] SMR: Derivative data saved (1794 records). [2025-09-17T07:41:46.096998] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-09-17T07:41:46.102613] [DEBUG] [MAIN ] SMWB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:46.105539] [INFO ] [MAIN ] Derivative Progress: 1780/2172 symbols completed. SMR took 1.2s. Estimated remaining: 2m 27s. Rate: 160.2 symbols/min [2025-09-17T07:41:46.108933] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 33445 primary records. [2025-09-17T07:41:46.110461] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-17T07:41:46.110037] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-09-17T07:41:46.110718] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:46.110854] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-17T07:41:46.114111] [INFO ] [MAIN ] Derivative Progress: 1781/2172 symbols completed. SMRT took 1.1s. Estimated remaining: 2m 26s. Rate: 160.3 symbols/min [2025-09-17T07:41:46.114869] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:46.130752] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-09-17T07:41:46.130915] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-17T07:41:46.133624] [INFO ] [MAIN ] Derivative Progress: 1782/2172 symbols completed. SMWB took 1.1s. Estimated remaining: 2m 26s. Rate: 160.4 symbols/min [2025-09-17T07:41:46.134062] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:46.175828] [DEBUG] [LOCAL ] SNA: Loaded 26389 existing records from primary storage. [2025-09-17T07:41:46.176210] [INFO ] [MAIN ] SNA: Loaded 26389 primary data records. [2025-09-17T07:41:46.318926] [DEBUG] [LOCAL ] SN: Loaded 49829 existing records from primary storage. [2025-09-17T07:41:46.319482] [INFO ] [MAIN ] SN: Loaded 49829 primary data records. [2025-09-17T07:41:46.535919] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-17T07:41:46.655184] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-09-17T07:41:47.257366] [DEBUG] [MAIN ] SNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:47.260362] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 26389 primary records. [2025-09-17T07:41:47.260959] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-17T07:41:47.285390] [DEBUG] [MAIN ] SN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:47.286992] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49829 primary records. [2025-09-17T07:41:47.287099] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-17T07:41:47.306517] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-09-17T07:41:47.310164] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-17T07:41:47.316825] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-09-17T07:41:47.320502] [INFO ] [MAIN ] Derivative Progress: 1783/2172 symbols completed. SNA took 1.2s. Estimated remaining: 2m 26s. Rate: 160.2 symbols/min [2025-09-17T07:41:47.321791] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-17T07:41:47.325102] [INFO ] [MAIN ] Derivative Progress: 1784/2172 symbols completed. SN took 1.2s. Estimated remaining: 2m 25s. Rate: 160.3 symbols/min [2025-09-17T07:41:47.338533] [DEBUG] [MAIN ] SNAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:47.339373] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-09-17T07:41:47.339456] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-17T07:41:47.355503] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-09-17T07:41:47.355590] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-17T07:41:47.358105] [INFO ] [MAIN ] Derivative Progress: 1785/2172 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 25s. Rate: 160.4 symbols/min [2025-09-17T07:41:47.359054] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:47.359238] [INFO ] [MAIN ] SNN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:47.359498] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:47.367970] [DEBUG] [LOCAL ] SNDA: Loaded 4759 existing records from primary storage. [2025-09-17T07:41:47.368787] [INFO ] [MAIN ] SNDA: Loaded 4759 primary data records. [2025-09-17T07:41:47.728215] [DEBUG] [LOCAL ] SNDR: Loaded 40411 existing records from primary storage. [2025-09-17T07:41:47.730752] [INFO ] [MAIN ] SNDR: Loaded 40411 primary data records. [2025-09-17T07:41:47.745459] [DEBUG] [LOCAL ] SNN: Loaded 44398 existing records from primary storage. [2025-09-17T07:41:47.793215] [INFO ] [MAIN ] SNN: Loaded 44398 primary data records. [2025-09-17T07:41:48.392683] [DEBUG] [MAIN ] SNDA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:48.394438] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4759 primary records. [2025-09-17T07:41:48.395000] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-17T07:41:48.414711] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-09-17T07:41:48.415269] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-17T07:41:48.417732] [INFO ] [MAIN ] Derivative Progress: 1786/2172 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 25s. Rate: 160.2 symbols/min [2025-09-17T07:41:48.418380] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:48.446574] [DEBUG] [MAIN ] SNDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:48.451455] [DEBUG] [MAIN ] SNN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:48.452142] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 40411 primary records. [2025-09-17T07:41:48.452724] [INFO ] [MAIN ] SNN: Generated 1794 derivative records from 44398 primary records. [2025-09-17T07:41:48.452831] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-17T07:41:48.452868] [DEBUG] [LOCAL ] SNN: Saving derivative data. [2025-09-17T07:41:48.482702] [DEBUG] [LOCAL ] SNN: Derivative data saved (1794 records). [2025-09-17T07:41:48.484157] [INFO ] [MAIN ] SNN: Successfully saved derivative data. [2025-09-17T07:41:48.488222] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-09-17T07:41:48.487584] [INFO ] [MAIN ] Derivative Progress: 1787/2172 symbols completed. SNN took 1.1s. Estimated remaining: 2m 24s. Rate: 160.3 symbols/min [2025-09-17T07:41:48.488507] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:48.488592] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-17T07:41:48.491014] [INFO ] [MAIN ] Derivative Progress: 1788/2172 symbols completed. SNDR took 1.1s. Estimated remaining: 2m 24s. Rate: 160.4 symbols/min [2025-09-17T07:41:48.491611] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:48.534263] [DEBUG] [LOCAL ] SNOW: Loaded 53570 existing records from primary storage. [2025-09-17T07:41:48.534751] [INFO ] [MAIN ] SNOW: Loaded 53570 primary data records. [2025-09-17T07:41:48.869707] [DEBUG] [LOCAL ] SNV: Loaded 48938 existing records from primary storage. [2025-09-17T07:41:48.870411] [DEBUG] [LOCAL ] SNX: Loaded 39615 existing records from primary storage. [2025-09-17T07:41:48.870629] [INFO ] [MAIN ] SNV: Loaded 48938 primary data records. [2025-09-17T07:41:48.870865] [INFO ] [MAIN ] SNX: Loaded 39615 primary data records. [2025-09-17T07:41:49.500605] [DEBUG] [MAIN ] SNOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:49.501736] [INFO ] [MAIN ] SNOW: Generated 1794 derivative records from 53570 primary records. [2025-09-17T07:41:49.501851] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-09-17T07:41:49.523670] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1794 records). [2025-09-17T07:41:49.524671] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-09-17T07:41:49.527140] [INFO ] [MAIN ] Derivative Progress: 1789/2172 symbols completed. SNOW took 1.1s. Estimated remaining: 2m 23s. Rate: 160.2 symbols/min [2025-09-17T07:41:49.528286] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:49.555670] [DEBUG] [MAIN ] SNX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:49.561429] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 39615 primary records. [2025-09-17T07:41:49.561824] [DEBUG] [MAIN ] SNV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:49.562118] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-17T07:41:49.562845] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48938 primary records. [2025-09-17T07:41:49.563033] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-17T07:41:49.596028] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-09-17T07:41:49.596160] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-17T07:41:49.596961] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-09-17T07:41:49.599696] [INFO ] [MAIN ] Derivative Progress: 1790/2172 symbols completed. SNV took 1.1s. Estimated remaining: 2m 23s. Rate: 160.3 symbols/min [2025-09-17T07:41:49.599919] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-17T07:41:49.602417] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:49.602486] [INFO ] [MAIN ] Derivative Progress: 1791/2172 symbols completed. SNX took 1.1s. Estimated remaining: 2m 23s. Rate: 160.4 symbols/min [2025-09-17T07:41:49.603278] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:49.642303] [DEBUG] [LOCAL ] SO: Loaded 53602 existing records from primary storage. [2025-09-17T07:41:49.642612] [INFO ] [MAIN ] SO: Loaded 53602 primary data records. [2025-09-17T07:41:49.817034] [DEBUG] [LOCAL ] SOBO: Loaded 40151 existing records from primary storage. [2025-09-17T07:41:49.848152] [INFO ] [MAIN ] SOBO: Loaded 40151 primary data records. [2025-09-17T07:41:49.861330] [DEBUG] [LOCAL ] SOC: Loaded 50117 existing records from primary storage. [2025-09-17T07:41:49.920600] [INFO ] [MAIN ] SOC: Loaded 50117 primary data records. [2025-09-17T07:41:50.627713] [DEBUG] [MAIN ] SO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:50.629554] [INFO ] [MAIN ] SO: Generated 1794 derivative records from 53602 primary records. [2025-09-17T07:41:50.630904] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-09-17T07:41:50.652578] [DEBUG] [LOCAL ] SO: Derivative data saved (1794 records). [2025-09-17T07:41:50.653162] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-09-17T07:41:50.669724] [INFO ] [MAIN ] Derivative Progress: 1792/2172 symbols completed. SO took 1.1s. Estimated remaining: 2m 22s. Rate: 160.2 symbols/min [2025-09-17T07:41:50.670711] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:50.671189] [DEBUG] [MAIN ] SOBO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:50.672853] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 40151 primary records. [2025-09-17T07:41:50.673050] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-17T07:41:50.694461] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-09-17T07:41:50.694845] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-17T07:41:50.698876] [INFO ] [MAIN ] Derivative Progress: 1793/2172 symbols completed. SOBO took 1.1s. Estimated remaining: 2m 22s. Rate: 160.3 symbols/min [2025-09-17T07:41:50.699470] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:50.719075] [DEBUG] [LOCAL ] SOJC: Loaded 5175 existing records from primary storage. [2025-09-17T07:41:50.719762] [DEBUG] [MAIN ] SOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:50.720030] [INFO ] [MAIN ] SOJC: Loaded 5175 primary data records. [2025-09-17T07:41:50.720947] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50117 primary records. [2025-09-17T07:41:50.721159] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-17T07:41:50.839690] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-09-17T07:41:50.866436] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-17T07:41:50.891758] [INFO ] [MAIN ] Derivative Progress: 1794/2172 symbols completed. SOC took 1.3s. Estimated remaining: 2m 21s. Rate: 160.3 symbols/min [2025-09-17T07:41:50.897161] [DEBUG] [LOCAL ] SOJD: Loaded 12980 existing records from primary storage. [2025-09-17T07:41:50.913416] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:50.930269] [INFO ] [MAIN ] SOJD: Loaded 12980 primary data records. [2025-09-17T07:41:51.215003] [DEBUG] [LOCAL ] SOJE: Loaded 9503 existing records from primary storage. [2025-09-17T07:41:51.228460] [INFO ] [MAIN ] SOJE: Loaded 9503 primary data records. [2025-09-17T07:41:51.761323] [DEBUG] [MAIN ] SOJC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:51.762308] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 5175 primary records. [2025-09-17T07:41:51.762546] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-17T07:41:51.784335] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-09-17T07:41:51.785104] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-17T07:41:51.801621] [DEBUG] [MAIN ] SOJD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:51.803504] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 12980 primary records. [2025-09-17T07:41:51.800075] [INFO ] [MAIN ] Derivative Progress: 1795/2172 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 21s. Rate: 160.2 symbols/min [2025-09-17T07:41:51.804613] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:51.805088] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-17T07:41:51.827355] [DEBUG] [MAIN ] SOJE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:51.832343] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 9503 primary records. [2025-09-17T07:41:51.836557] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-09-17T07:41:51.833219] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-17T07:41:51.836748] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-17T07:41:51.844256] [INFO ] [MAIN ] Derivative Progress: 1796/2172 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 21s. Rate: 160.3 symbols/min [2025-09-17T07:41:51.844604] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:51.862167] [DEBUG] [LOCAL ] SOL: Loaded 13753 existing records from primary storage. [2025-09-17T07:41:51.866175] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-09-17T07:41:51.864236] [INFO ] [MAIN ] SOL: Loaded 13753 primary data records. [2025-09-17T07:41:51.866394] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-17T07:41:51.889587] [INFO ] [MAIN ] Derivative Progress: 1797/2172 symbols completed. SOJE took 1.0s. Estimated remaining: 2m 20s. Rate: 160.4 symbols/min [2025-09-17T07:41:51.923691] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:52.207879] [DEBUG] [LOCAL ] SOLV: Loaded 44355 existing records from primary storage. [2025-09-17T07:41:52.208612] [INFO ] [MAIN ] SOLV: Loaded 44355 primary data records. [2025-09-17T07:41:52.301880] [DEBUG] [LOCAL ] SON: Loaded 42910 existing records from primary storage. [2025-09-17T07:41:52.325025] [INFO ] [MAIN ] SON: Loaded 42910 primary data records. [2025-09-17T07:41:52.908449] [DEBUG] [MAIN ] SOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:52.909360] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13753 primary records. [2025-09-17T07:41:52.910952] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-17T07:41:52.929701] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-09-17T07:41:52.929884] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-17T07:41:52.932103] [INFO ] [MAIN ] Derivative Progress: 1798/2172 symbols completed. SOL took 1.1s. Estimated remaining: 2m 20s. Rate: 160.2 symbols/min [2025-09-17T07:41:52.957574] [DEBUG] [MAIN ] SOLV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:52.971044] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 44355 primary records. [2025-09-17T07:41:52.971376] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-17T07:41:52.971268] [DEBUG] [MAIN ] SON: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:52.972275] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 42910 primary records. [2025-09-17T07:41:52.972572] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-17T07:41:53.003098] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-09-17T07:41:53.003152] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-09-17T07:41:53.003290] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-17T07:41:53.005716] [INFO ] [MAIN ] Derivative Progress: 1799/2172 symbols completed. SOLV took 1.2s. Estimated remaining: 2m 20s. Rate: 160.3 symbols/min [2025-09-17T07:41:53.003361] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-17T07:41:53.009106] [INFO ] [MAIN ] Derivative Progress: 1800/2172 symbols completed. SON took 1.1s. Estimated remaining: 2m 19s. Rate: 160.4 symbols/min [2025-09-17T07:41:53.009770] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:53.009959] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:53.010457] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:53.017243] [DEBUG] [LOCAL ] SOR: Loaded 2976 existing records from primary storage. [2025-09-17T07:41:53.017542] [INFO ] [MAIN ] SOR: Loaded 2976 primary data records. [2025-09-17T07:41:53.107703] [DEBUG] [LOCAL ] SOS: Loaded 7354 existing records from primary storage. [2025-09-17T07:41:53.133029] [INFO ] [MAIN ] SOS: Loaded 7354 primary data records. [2025-09-17T07:41:53.658311] [DEBUG] [LOCAL ] SONY: Loaded 53367 existing records from primary storage. [2025-09-17T07:41:53.675840] [INFO ] [MAIN ] SONY: Loaded 53367 primary data records. [2025-09-17T07:41:54.012717] [DEBUG] [MAIN ] SOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:54.014065] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2976 primary records. [2025-09-17T07:41:54.014189] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-17T07:41:54.046099] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-09-17T07:41:54.054181] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-17T07:41:54.054469] [DEBUG] [MAIN ] SOS: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:41:54.056400] [INFO ] [MAIN ] SOS: Generated 1792 derivative records from 7354 primary records. [2025-09-17T07:41:54.056714] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-17T07:41:54.059349] [INFO ] [MAIN ] Derivative Progress: 1801/2172 symbols completed. SOR took 1.0s. Estimated remaining: 2m 19s. Rate: 160.2 symbols/min [2025-09-17T07:41:54.060614] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:54.075977] [DEBUG] [LOCAL ] SOS: Derivative data saved (1792 records). [2025-09-17T07:41:54.076156] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-17T07:41:54.078847] [INFO ] [MAIN ] Derivative Progress: 1802/2172 symbols completed. SOS took 1.1s. Estimated remaining: 2m 19s. Rate: 160.3 symbols/min [2025-09-17T07:41:54.079672] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:54.101248] [DEBUG] [MAIN ] SONY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:54.102224] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53367 primary records. [2025-09-17T07:41:54.102628] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-17T07:41:54.131909] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-09-17T07:41:54.132417] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-17T07:41:54.136266] [INFO ] [MAIN ] Derivative Progress: 1803/2172 symbols completed. SONY took 1.1s. Estimated remaining: 2m 18s. Rate: 160.4 symbols/min [2025-09-17T07:41:54.136972] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:54.160984] [DEBUG] [LOCAL ] SPB: Loaded 34191 existing records from primary storage. [2025-09-17T07:41:54.163633] [INFO ] [MAIN ] SPB: Loaded 34191 primary data records. [2025-09-17T07:41:54.259671] [DEBUG] [LOCAL ] SPE: Loaded 6381 existing records from primary storage. [2025-09-17T07:41:54.289350] [DEBUG] [LOCAL ] SPCE: Loaded 49815 existing records from primary storage. [2025-09-17T07:41:54.289465] [INFO ] [MAIN ] SPE: Loaded 6381 primary data records. [2025-09-17T07:41:54.289730] [INFO ] [MAIN ] SPCE: Loaded 49815 primary data records. [2025-09-17T07:41:55.190593] [DEBUG] [MAIN ] SPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:55.191540] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34191 primary records. [2025-09-17T07:41:55.192085] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-17T07:41:55.221561] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-09-17T07:41:55.227568] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-17T07:41:55.228140] [DEBUG] [MAIN ] SPCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:55.228988] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49815 primary records. [2025-09-17T07:41:55.241833] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-17T07:41:55.243974] [INFO ] [MAIN ] Derivative Progress: 1804/2172 symbols completed. SPB took 1.2s. Estimated remaining: 2m 18s. Rate: 160.2 symbols/min [2025-09-17T07:41:55.246248] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:55.245810] [DEBUG] [MAIN ] SPE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:55.255945] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6381 primary records. [2025-09-17T07:41:55.258840] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-17T07:41:55.263841] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-09-17T07:41:55.271128] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-17T07:41:55.277429] [INFO ] [MAIN ] Derivative Progress: 1805/2172 symbols completed. SPCE took 1.2s. Estimated remaining: 2m 17s. Rate: 160.3 symbols/min [2025-09-17T07:41:55.281470] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-09-17T07:41:55.281738] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-17T07:41:55.284747] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:55.284827] [INFO ] [MAIN ] Derivative Progress: 1806/2172 symbols completed. SPE took 1.1s. Estimated remaining: 2m 17s. Rate: 160.3 symbols/min [2025-09-17T07:41:55.285421] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:55.316325] [DEBUG] [LOCAL ] SPH: Loaded 18605 existing records from primary storage. [2025-09-17T07:41:55.316753] [INFO ] [MAIN ] SPH: Loaded 18605 primary data records. [2025-09-17T07:41:55.458731] [DEBUG] [LOCAL ] SPG: Loaded 50452 existing records from primary storage. [2025-09-17T07:41:55.492971] [INFO ] [MAIN ] SPG: Loaded 50452 primary data records. [2025-09-17T07:41:55.587337] [DEBUG] [LOCAL ] SPGI: Loaded 45837 existing records from primary storage. [2025-09-17T07:41:55.629713] [INFO ] [MAIN ] SPGI: Loaded 45837 primary data records. [2025-09-17T07:41:56.269096] [DEBUG] [MAIN ] SPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:56.270164] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 18605 primary records. [2025-09-17T07:41:56.270357] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-17T07:41:56.303324] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-09-17T07:41:56.304241] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-17T07:41:56.304082] [DEBUG] [MAIN ] SPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:56.306764] [INFO ] [MAIN ] Derivative Progress: 1807/2172 symbols completed. SPH took 1.0s. Estimated remaining: 2m 17s. Rate: 160.2 symbols/min [2025-09-17T07:41:56.307059] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:56.308322] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50452 primary records. [2025-09-17T07:41:56.308483] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-17T07:41:56.335490] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-09-17T07:41:56.340481] [DEBUG] [MAIN ] SPGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:56.340612] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-17T07:41:56.343334] [INFO ] [MAIN ] Derivative Progress: 1808/2172 symbols completed. SPG took 1.1s. Estimated remaining: 2m 16s. Rate: 160.3 symbols/min [2025-09-17T07:41:56.344014] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45837 primary records. [2025-09-17T07:41:56.344466] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:56.344271] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-17T07:41:56.363152] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-09-17T07:41:56.373139] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-17T07:41:56.375884] [INFO ] [MAIN ] Derivative Progress: 1809/2172 symbols completed. SPGI took 1.1s. Estimated remaining: 2m 16s. Rate: 160.4 symbols/min [2025-09-17T07:41:56.376227] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:56.403980] [DEBUG] [LOCAL ] SPMC: Loaded 5764 existing records from primary storage. [2025-09-17T07:41:56.405225] [DEBUG] [LOCAL ] SPHR: Loaded 40044 existing records from primary storage. [2025-09-17T07:41:56.405672] [INFO ] [MAIN ] SPHR: Loaded 40044 primary data records. [2025-09-17T07:41:56.405567] [INFO ] [MAIN ] SPMC: Loaded 5764 primary data records. [2025-09-17T07:41:56.626611] [DEBUG] [LOCAL ] SPIR: Loaded 37514 existing records from primary storage. [2025-09-17T07:41:56.638073] [INFO ] [MAIN ] SPIR: Loaded 37514 primary data records. [2025-09-17T07:41:57.384246] [DEBUG] [MAIN ] SPMC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:41:57.398168] [INFO ] [MAIN ] SPMC: Generated 1793 derivative records from 5764 primary records. [2025-09-17T07:41:57.398676] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-17T07:41:57.399041] [DEBUG] [MAIN ] SPHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:57.400770] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40044 primary records. [2025-09-17T07:41:57.401447] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-17T07:41:57.432492] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1793 records). [2025-09-17T07:41:57.433055] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-17T07:41:57.435033] [INFO ] [MAIN ] Derivative Progress: 1810/2172 symbols completed. SPMC took 1.1s. Estimated remaining: 2m 16s. Rate: 160.2 symbols/min [2025-09-17T07:41:57.443833] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-09-17T07:41:57.449200] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:57.448914] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-17T07:41:57.451771] [INFO ] [MAIN ] Derivative Progress: 1811/2172 symbols completed. SPHR took 1.1s. Estimated remaining: 2m 15s. Rate: 160.3 symbols/min [2025-09-17T07:41:57.452398] [DEBUG] [MAIN ] SPIR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:57.452827] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:57.453610] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37514 primary records. [2025-09-17T07:41:57.454178] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-17T07:41:57.474227] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-09-17T07:41:57.474464] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-17T07:41:57.477042] [INFO ] [MAIN ] Derivative Progress: 1812/2172 symbols completed. SPIR took 1.1s. Estimated remaining: 2m 15s. Rate: 160.4 symbols/min [2025-09-17T07:41:57.477422] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:57.518774] [DEBUG] [LOCAL ] SPNT: Loaded 34707 existing records from primary storage. [2025-09-17T07:41:57.527600] [INFO ] [MAIN ] SPNT: Loaded 34707 primary data records. [2025-09-17T07:41:57.640031] [DEBUG] [LOCAL ] SPOT: Loaded 51116 existing records from primary storage. [2025-09-17T07:41:57.657011] [DEBUG] [LOCAL ] SPR: Loaded 41447 existing records from primary storage. [2025-09-17T07:41:57.657255] [INFO ] [MAIN ] SPR: Loaded 41447 primary data records. [2025-09-17T07:41:57.668256] [INFO ] [MAIN ] SPOT: Loaded 51116 primary data records. [2025-09-17T07:41:58.479411] [DEBUG] [MAIN ] SPNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:58.480258] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34707 primary records. [2025-09-17T07:41:58.480720] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-17T07:41:58.497141] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-09-17T07:41:58.497278] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-17T07:41:58.499175] [INFO ] [MAIN ] Derivative Progress: 1813/2172 symbols completed. SPNT took 1.1s. Estimated remaining: 2m 14s. Rate: 160.2 symbols/min [2025-09-17T07:41:58.515885] [DEBUG] [MAIN ] SPOT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:58.528628] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 51116 primary records. [2025-09-17T07:41:58.528074] [DEBUG] [MAIN ] SPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:58.529201] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41447 primary records. [2025-09-17T07:41:58.529254] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-17T07:41:58.529846] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-17T07:41:58.559525] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-09-17T07:41:58.559331] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-09-17T07:41:58.559659] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-17T07:41:58.559732] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-17T07:41:58.562134] [INFO ] [MAIN ] Derivative Progress: 1814/2172 symbols completed. SPR took 1.1s. Estimated remaining: 2m 14s. Rate: 160.3 symbols/min [2025-09-17T07:41:58.564766] [INFO ] [MAIN ] Derivative Progress: 1815/2172 symbols completed. SPOT took 1.1s. Estimated remaining: 2m 14s. Rate: 160.4 symbols/min [2025-09-17T07:41:58.565297] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:58.565390] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:58.565203] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:58.578493] [DEBUG] [LOCAL ] SPXX: Loaded 8978 existing records from primary storage. [2025-09-17T07:41:58.586835] [INFO ] [MAIN ] SPXX: Loaded 8978 primary data records. [2025-09-17T07:41:58.586749] [DEBUG] [LOCAL ] SPRU: Loaded 8280 existing records from primary storage. [2025-09-17T07:41:58.586980] [INFO ] [MAIN ] SPRU: Loaded 8280 primary data records. [2025-09-17T07:41:58.762007] [DEBUG] [LOCAL ] SPXC: Loaded 23501 existing records from primary storage. [2025-09-17T07:41:58.798264] [INFO ] [MAIN ] SPXC: Loaded 23501 primary data records. [2025-09-17T07:41:59.568488] [DEBUG] [MAIN ] SPXX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:59.569076] [DEBUG] [MAIN ] SPRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:59.569816] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 8978 primary records. [2025-09-17T07:41:59.570908] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-17T07:41:59.570707] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 8280 primary records. [2025-09-17T07:41:59.571952] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-17T07:41:59.593984] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-09-17T07:41:59.598859] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-17T07:41:59.603921] [INFO ] [MAIN ] Derivative Progress: 1816/2172 symbols completed. SPXX took 1.0s. Estimated remaining: 2m 13s. Rate: 160.2 symbols/min [2025-09-17T07:41:59.605449] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:59.605175] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-09-17T07:41:59.607712] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-17T07:41:59.610712] [INFO ] [MAIN ] Derivative Progress: 1817/2172 symbols completed. SPRU took 1.0s. Estimated remaining: 2m 13s. Rate: 160.3 symbols/min [2025-09-17T07:41:59.611215] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:59.625789] [DEBUG] [MAIN ] SPXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:41:59.626747] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23501 primary records. [2025-09-17T07:41:59.626972] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-17T07:41:59.646427] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-09-17T07:41:59.646622] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-17T07:41:59.649376] [INFO ] [MAIN ] Derivative Progress: 1818/2172 symbols completed. SPXC took 1.1s. Estimated remaining: 2m 12s. Rate: 160.4 symbols/min [2025-09-17T07:41:59.655892] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:41:59.678905] [DEBUG] [LOCAL ] SQNS: Loaded 24998 existing records from primary storage. [2025-09-17T07:41:59.679097] [INFO ] [MAIN ] SQNS: Loaded 24998 primary data records. [2025-09-17T07:41:59.807924] [DEBUG] [LOCAL ] SQM: Loaded 48657 existing records from primary storage. [2025-09-17T07:41:59.814198] [INFO ] [MAIN ] SQM: Loaded 48657 primary data records. [2025-09-17T07:41:59.903404] [DEBUG] [LOCAL ] SR: Loaded 32597 existing records from primary storage. [2025-09-17T07:41:59.977399] [INFO ] [MAIN ] SR: Loaded 32597 primary data records. [2025-09-17T07:42:00.641873] [DEBUG] [MAIN ] SQNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:00.642896] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 24998 primary records. [2025-09-17T07:42:00.643939] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-17T07:42:00.661054] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-09-17T07:42:00.661708] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-17T07:42:00.663890] [INFO ] [MAIN ] Derivative Progress: 1819/2172 symbols completed. SQNS took 1.1s. Estimated remaining: 2m 12s. Rate: 160.2 symbols/min [2025-09-17T07:42:00.664683] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:00.681504] [DEBUG] [MAIN ] SQM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:00.684243] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48657 primary records. [2025-09-17T07:42:00.685220] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-17T07:42:00.714068] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-09-17T07:42:00.714716] [DEBUG] [MAIN ] SR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:00.714871] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-17T07:42:00.718341] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32597 primary records. [2025-09-17T07:42:00.718242] [INFO ] [MAIN ] Derivative Progress: 1820/2172 symbols completed. SQM took 1.1s. Estimated remaining: 2m 12s. Rate: 160.3 symbols/min [2025-09-17T07:42:00.718554] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-17T07:42:00.718831] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:00.740538] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-09-17T07:42:00.745313] [DEBUG] [LOCAL ] SREA: Loaded 10434 existing records from primary storage. [2025-09-17T07:42:00.745528] [INFO ] [MAIN ] SREA: Loaded 10434 primary data records. [2025-09-17T07:42:00.745689] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-17T07:42:00.748561] [INFO ] [MAIN ] Derivative Progress: 1821/2172 symbols completed. SR took 1.1s. Estimated remaining: 2m 11s. Rate: 160.4 symbols/min [2025-09-17T07:42:00.778139] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:01.102365] [DEBUG] [LOCAL ] SRE: Loaded 53422 existing records from primary storage. [2025-09-17T07:42:01.103485] [INFO ] [MAIN ] SRE: Loaded 53422 primary data records. [2025-09-17T07:42:01.266578] [DEBUG] [LOCAL ] SRFM: Loaded 34615 existing records from primary storage. [2025-09-17T07:42:01.298629] [INFO ] [MAIN ] SRFM: Loaded 34615 primary data records. [2025-09-17T07:42:01.728311] [DEBUG] [MAIN ] SREA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:01.729741] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10434 primary records. [2025-09-17T07:42:01.730364] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-17T07:42:01.750811] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-09-17T07:42:01.763310] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-17T07:42:01.763701] [DEBUG] [MAIN ] SRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:01.767155] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53422 primary records. [2025-09-17T07:42:01.766125] [INFO ] [MAIN ] Derivative Progress: 1822/2172 symbols completed. SREA took 1.0s. Estimated remaining: 2m 11s. Rate: 160.2 symbols/min [2025-09-17T07:42:01.767746] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:01.767340] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-17T07:42:01.787145] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-09-17T07:42:01.787311] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-17T07:42:01.789519] [INFO ] [MAIN ] Derivative Progress: 1823/2172 symbols completed. SRE took 1.1s. Estimated remaining: 2m 11s. Rate: 160.3 symbols/min [2025-09-17T07:42:01.806564] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:01.807259] [DEBUG] [MAIN ] SRFM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:01.808430] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 34615 primary records. [2025-09-17T07:42:01.808947] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-17T07:42:01.815270] [DEBUG] [LOCAL ] SRG: Loaded 16138 existing records from primary storage. [2025-09-17T07:42:01.816021] [INFO ] [MAIN ] SRG: Loaded 16138 primary data records. [2025-09-17T07:42:02.018572] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-09-17T07:42:02.145009] [DEBUG] [LOCAL ] SRI: Loaded 28243 existing records from primary storage. [2025-09-17T07:42:02.144172] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-17T07:42:02.145203] [INFO ] [MAIN ] SRI: Loaded 28243 primary data records. [2025-09-17T07:42:02.148184] [INFO ] [MAIN ] Derivative Progress: 1824/2172 symbols completed. SRFM took 1.4s. Estimated remaining: 2m 10s. Rate: 160.3 symbols/min [2025-09-17T07:42:02.160885] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:02.365792] [DEBUG] [LOCAL ] SRV: Loaded 7807 existing records from primary storage. [2025-09-17T07:42:02.480547] [INFO ] [MAIN ] SRV: Loaded 7807 primary data records. [2025-09-17T07:42:02.791951] [DEBUG] [MAIN ] SRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:02.858937] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 16138 primary records. [2025-09-17T07:42:02.859795] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-17T07:42:02.877413] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-09-17T07:42:02.878387] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-17T07:42:02.881197] [INFO ] [MAIN ] Derivative Progress: 1825/2172 symbols completed. SRG took 1.1s. Estimated remaining: 2m 10s. Rate: 160.2 symbols/min [2025-09-17T07:42:02.882146] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:02.900367] [DEBUG] [MAIN ] SRI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:02.901675] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 28243 primary records. [2025-09-17T07:42:02.902271] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-17T07:42:02.919302] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-09-17T07:42:02.920430] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-17T07:42:02.923988] [INFO ] [MAIN ] Derivative Progress: 1826/2172 symbols completed. SRI took 1.1s. Estimated remaining: 2m 9s. Rate: 160.3 symbols/min [2025-09-17T07:42:02.925678] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:02.939793] [DEBUG] [MAIN ] SRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:02.940621] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7807 primary records. [2025-09-17T07:42:02.940737] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-17T07:42:02.967331] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-09-17T07:42:02.967526] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-17T07:42:02.970432] [INFO ] [MAIN ] Derivative Progress: 1827/2172 symbols completed. SRV took 0.8s. Estimated remaining: 2m 9s. Rate: 160.4 symbols/min [2025-09-17T07:42:02.970878] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:03.000933] [DEBUG] [LOCAL ] SSB: Loaded 42892 existing records from primary storage. [2025-09-17T07:42:03.001742] [INFO ] [MAIN ] SSB: Loaded 42892 primary data records. [2025-09-17T07:42:03.001474] [DEBUG] [LOCAL ] SSD: Loaded 22476 existing records from primary storage. [2025-09-17T07:42:03.035149] [INFO ] [MAIN ] SSD: Loaded 22476 primary data records. [2025-09-17T07:42:03.302489] [DEBUG] [LOCAL ] SSL: Loaded 41100 existing records from primary storage. [2025-09-17T07:42:03.333505] [INFO ] [MAIN ] SSL: Loaded 41100 primary data records. [2025-09-17T07:42:03.983175] [DEBUG] [MAIN ] SSB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:03.986161] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42892 primary records. [2025-09-17T07:42:03.986721] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-17T07:42:04.015945] [DEBUG] [MAIN ] SSD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:04.017430] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22476 primary records. [2025-09-17T07:42:04.018377] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-09-17T07:42:04.018485] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-17T07:42:04.018699] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-17T07:42:04.021686] [INFO ] [MAIN ] Derivative Progress: 1828/2172 symbols completed. SSB took 1.1s. Estimated remaining: 2m 9s. Rate: 160.2 symbols/min [2025-09-17T07:42:04.050969] [DEBUG] [MAIN ] SSL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:04.052738] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41100 primary records. [2025-09-17T07:42:04.052671] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-09-17T07:42:04.052820] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-17T07:42:04.052902] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-17T07:42:04.055813] [INFO ] [MAIN ] Derivative Progress: 1829/2172 symbols completed. SSD took 1.1s. Estimated remaining: 2m 8s. Rate: 160.3 symbols/min [2025-09-17T07:42:04.070229] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-09-17T07:42:04.070329] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-17T07:42:04.072835] [INFO ] [MAIN ] Derivative Progress: 1830/2172 symbols completed. SSL took 1.1s. Estimated remaining: 2m 8s. Rate: 160.4 symbols/min [2025-09-17T07:42:04.073303] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:04.073626] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:04.073913] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:04.088583] [DEBUG] [LOCAL ] SST: Loaded 12517 existing records from primary storage. [2025-09-17T07:42:04.088839] [INFO ] [MAIN ] SST: Loaded 12517 primary data records. [2025-09-17T07:42:04.241209] [DEBUG] [LOCAL ] SSTK: Loaded 27284 existing records from primary storage. [2025-09-17T07:42:04.295967] [INFO ] [MAIN ] SSTK: Loaded 27284 primary data records. [2025-09-17T07:42:04.441151] [DEBUG] [LOCAL ] ST: Loaded 49890 existing records from primary storage. [2025-09-17T07:42:04.468100] [INFO ] [MAIN ] ST: Loaded 49890 primary data records. [2025-09-17T07:42:05.107376] [DEBUG] [MAIN ] SST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:05.109917] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 12517 primary records. [2025-09-17T07:42:05.110617] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-17T07:42:05.128008] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-09-17T07:42:05.128629] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-17T07:42:05.131483] [INFO ] [MAIN ] Derivative Progress: 1831/2172 symbols completed. SST took 1.1s. Estimated remaining: 2m 8s. Rate: 160.2 symbols/min [2025-09-17T07:42:05.131975] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:05.152172] [DEBUG] [MAIN ] SSTK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:05.155044] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 27284 primary records. [2025-09-17T07:42:05.155929] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-17T07:42:05.182033] [DEBUG] [MAIN ] ST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:05.186294] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-09-17T07:42:05.187077] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49890 primary records. [2025-09-17T07:42:05.187587] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-17T07:42:05.187474] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-17T07:42:05.190111] [INFO ] [MAIN ] Derivative Progress: 1832/2172 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 7s. Rate: 160.3 symbols/min [2025-09-17T07:42:05.191334] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:05.207539] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-09-17T07:42:05.218679] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-17T07:42:05.221278] [INFO ] [MAIN ] Derivative Progress: 1833/2172 symbols completed. ST took 1.1s. Estimated remaining: 2m 7s. Rate: 160.4 symbols/min [2025-09-17T07:42:05.221779] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:05.246219] [DEBUG] [LOCAL ] STAG: Loaded 50011 existing records from primary storage. [2025-09-17T07:42:05.246447] [INFO ] [MAIN ] STAG: Loaded 50011 primary data records. [2025-09-17T07:42:05.339625] [DEBUG] [LOCAL ] STC: Loaded 17853 existing records from primary storage. [2025-09-17T07:42:05.363041] [INFO ] [MAIN ] STC: Loaded 17853 primary data records. [2025-09-17T07:42:05.457767] [DEBUG] [LOCAL ] STE: Loaded 35550 existing records from primary storage. [2025-09-17T07:42:05.497797] [INFO ] [MAIN ] STE: Loaded 35550 primary data records. [2025-09-17T07:42:06.216076] [DEBUG] [MAIN ] STAG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:06.220935] [DEBUG] [MAIN ] STC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:06.221930] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17853 primary records. [2025-09-17T07:42:06.222555] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50011 primary records. [2025-09-17T07:42:06.223472] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-17T07:42:06.224755] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-17T07:42:06.250884] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-09-17T07:42:06.254916] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-17T07:42:06.273451] [DEBUG] [MAIN ] STE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:06.272300] [INFO ] [MAIN ] Derivative Progress: 1834/2172 symbols completed. STAG took 1.1s. Estimated remaining: 2m 7s. Rate: 160.2 symbols/min [2025-09-17T07:42:06.274710] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:06.273658] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-09-17T07:42:06.274595] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35550 primary records. [2025-09-17T07:42:06.275514] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-17T07:42:06.275417] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-17T07:42:06.278783] [INFO ] [MAIN ] Derivative Progress: 1835/2172 symbols completed. STC took 1.1s. Estimated remaining: 2m 6s. Rate: 160.3 symbols/min [2025-09-17T07:42:06.279298] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:06.295633] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-09-17T07:42:06.295738] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-17T07:42:06.298341] [INFO ] [MAIN ] Derivative Progress: 1836/2172 symbols completed. STE took 1.1s. Estimated remaining: 2m 6s. Rate: 160.4 symbols/min [2025-09-17T07:42:06.298619] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:06.322344] [DEBUG] [LOCAL ] STEL: Loaded 23747 existing records from primary storage. [2025-09-17T07:42:06.322729] [INFO ] [MAIN ] STEL: Loaded 23747 primary data records. [2025-09-17T07:42:06.414548] [DEBUG] [LOCAL ] STEW: Loaded 16424 existing records from primary storage. [2025-09-17T07:42:06.449934] [INFO ] [MAIN ] STEW: Loaded 16424 primary data records. [2025-09-17T07:42:06.511966] [DEBUG] [LOCAL ] STEM: Loaded 40395 existing records from primary storage. [2025-09-17T07:42:06.578091] [INFO ] [MAIN ] STEM: Loaded 40395 primary data records. [2025-09-17T07:42:07.383118] [DEBUG] [MAIN ] STEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:07.383746] [DEBUG] [MAIN ] STEW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:07.384477] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 23747 primary records. [2025-09-17T07:42:07.385089] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 16424 primary records. [2025-09-17T07:42:07.385416] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-17T07:42:07.385466] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-17T07:42:07.418572] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-09-17T07:42:07.419109] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-09-17T07:42:07.426884] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-17T07:42:07.431937] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-17T07:42:07.431836] [DEBUG] [MAIN ] STEM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:07.434212] [INFO ] [MAIN ] Derivative Progress: 1837/2172 symbols completed. STEL took 1.2s. Estimated remaining: 2m 5s. Rate: 160.2 symbols/min [2025-09-17T07:42:07.435029] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 40395 primary records. [2025-09-17T07:42:07.438325] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:07.438204] [INFO ] [MAIN ] Derivative Progress: 1838/2172 symbols completed. STEW took 1.1s. Estimated remaining: 2m 5s. Rate: 160.3 symbols/min [2025-09-17T07:42:07.438809] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:07.438525] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-17T07:42:07.464955] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-09-17T07:42:07.465391] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-17T07:42:07.469046] [INFO ] [MAIN ] Derivative Progress: 1839/2172 symbols completed. STEM took 1.2s. Estimated remaining: 2m 5s. Rate: 160.4 symbols/min [2025-09-17T07:42:07.465197] [DEBUG] [LOCAL ] STK: Loaded 9356 existing records from primary storage. [2025-09-17T07:42:07.469398] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:07.469869] [INFO ] [MAIN ] STK: Loaded 9356 primary data records. [2025-09-17T07:42:07.664913] [DEBUG] [LOCAL ] STN: Loaded 23240 existing records from primary storage. [2025-09-17T07:42:07.742771] [INFO ] [MAIN ] STN: Loaded 23240 primary data records. [2025-09-17T07:42:07.913900] [DEBUG] [LOCAL ] STM: Loaded 53590 existing records from primary storage. [2025-09-17T07:42:07.958367] [INFO ] [MAIN ] STM: Loaded 53590 primary data records. [2025-09-17T07:42:08.431148] [DEBUG] [MAIN ] STK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:08.432430] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9356 primary records. [2025-09-17T07:42:08.432811] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-17T07:42:08.454545] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-09-17T07:42:08.456425] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-17T07:42:08.461502] [INFO ] [MAIN ] Derivative Progress: 1840/2172 symbols completed. STK took 1.0s. Estimated remaining: 2m 4s. Rate: 160.2 symbols/min [2025-09-17T07:42:08.463108] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:08.481723] [DEBUG] [MAIN ] STN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:08.483017] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 23240 primary records. [2025-09-17T07:42:08.483286] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-17T07:42:08.501829] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-09-17T07:42:08.502616] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-17T07:42:08.505450] [INFO ] [MAIN ] Derivative Progress: 1841/2172 symbols completed. STN took 1.0s. Estimated remaining: 2m 4s. Rate: 160.3 symbols/min [2025-09-17T07:42:08.505980] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:08.525444] [DEBUG] [MAIN ] STM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:08.526541] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53590 primary records. [2025-09-17T07:42:08.526708] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-17T07:42:08.557232] [DEBUG] [LOCAL ] STRV: Loaded 11753 existing records from primary storage. [2025-09-17T07:42:08.562341] [INFO ] [MAIN ] STRV: Loaded 11753 primary data records. [2025-09-17T07:42:08.562523] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-09-17T07:42:08.562673] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-17T07:42:08.582946] [INFO ] [MAIN ] Derivative Progress: 1842/2172 symbols completed. STM took 1.1s. Estimated remaining: 2m 3s. Rate: 160.4 symbols/min [2025-09-17T07:42:08.618988] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:08.613580] [DEBUG] [LOCAL ] STNG: Loaded 44153 existing records from primary storage. [2025-09-17T07:42:08.655929] [INFO ] [MAIN ] STNG: Loaded 44153 primary data records. [2025-09-17T07:42:09.261921] [DEBUG] [LOCAL ] STT: Loaded 51275 existing records from primary storage. [2025-09-17T07:42:09.263189] [INFO ] [MAIN ] STT: Loaded 51275 primary data records. [2025-09-17T07:42:09.441346] [DEBUG] [MAIN ] STRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:09.462101] [INFO ] [MAIN ] STRV: Generated 1794 derivative records from 11753 primary records. [2025-09-17T07:42:09.578898] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-17T07:42:09.600525] [DEBUG] [LOCAL ] STRV: Derivative data saved (1794 records). [2025-09-17T07:42:09.613820] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-17T07:42:09.614339] [DEBUG] [MAIN ] STNG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:09.617196] [INFO ] [MAIN ] Derivative Progress: 1843/2172 symbols completed. STRV took 1.1s. Estimated remaining: 2m 3s. Rate: 160.2 symbols/min [2025-09-17T07:42:09.618335] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 44153 primary records. [2025-09-17T07:42:09.618948] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-17T07:42:09.636772] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-09-17T07:42:09.637051] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-17T07:42:09.639537] [INFO ] [MAIN ] Derivative Progress: 1844/2172 symbols completed. STNG took 1.2s. Estimated remaining: 2m 3s. Rate: 160.3 symbols/min [2025-09-17T07:42:09.656396] [DEBUG] [MAIN ] STT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:09.657091] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 51275 primary records. [2025-09-17T07:42:09.657169] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-17T07:42:09.672733] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-09-17T07:42:09.672805] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-17T07:42:09.675291] [INFO ] [MAIN ] Derivative Progress: 1845/2172 symbols completed. STT took 1.1s. Estimated remaining: 2m 2s. Rate: 160.4 symbols/min [2025-09-17T07:42:09.676010] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:09.676162] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:09.676358] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:09.681617] [DEBUG] [LOCAL ] STXD: Loaded 1330 existing records from primary storage. [2025-09-17T07:42:09.681953] [INFO ] [MAIN ] STXD: Loaded 1330 primary data records. [2025-09-17T07:42:09.880049] [DEBUG] [LOCAL ] STVN: Loaded 26636 existing records from primary storage. [2025-09-17T07:42:10.006605] [INFO ] [MAIN ] STVN: Loaded 26636 primary data records. [2025-09-17T07:42:10.127525] [DEBUG] [LOCAL ] STWD: Loaded 51905 existing records from primary storage. [2025-09-17T07:42:10.143362] [INFO ] [MAIN ] STWD: Loaded 51905 primary data records. [2025-09-17T07:42:10.691991] [DEBUG] [MAIN ] STXD: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:42:10.693795] [INFO ] [MAIN ] STXD: Generated 1792 derivative records from 1330 primary records. [2025-09-17T07:42:10.694590] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-17T07:42:10.711016] [DEBUG] [LOCAL ] STXD: Derivative data saved (1792 records). [2025-09-17T07:42:10.711256] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-17T07:42:10.713522] [INFO ] [MAIN ] Derivative Progress: 1846/2172 symbols completed. STXD took 1.0s. Estimated remaining: 2m 2s. Rate: 160.2 symbols/min [2025-09-17T07:42:10.715343] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:10.722924] [DEBUG] [LOCAL ] STXE: Loaded 2282 existing records from primary storage. [2025-09-17T07:42:10.736132] [INFO ] [MAIN ] STXE: Loaded 2282 primary data records. [2025-09-17T07:42:10.737060] [DEBUG] [MAIN ] STVN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:10.765095] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26636 primary records. [2025-09-17T07:42:10.802360] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-17T07:42:10.899124] [DEBUG] [MAIN ] STWD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:10.937513] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-09-17T07:42:10.963684] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-17T07:42:11.070271] [INFO ] [MAIN ] Derivative Progress: 1847/2172 symbols completed. STVN took 1.4s. Estimated remaining: 2m 2s. Rate: 160.2 symbols/min [2025-09-17T07:42:11.062793] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51905 primary records. [2025-09-17T07:42:11.081421] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:11.081893] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-17T07:42:11.101800] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-09-17T07:42:11.104534] [DEBUG] [LOCAL ] STXG: Loaded 2663 existing records from primary storage. [2025-09-17T07:42:11.104886] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-17T07:42:11.105402] [INFO ] [MAIN ] STXG: Loaded 2663 primary data records. [2025-09-17T07:42:11.144242] [INFO ] [MAIN ] Derivative Progress: 1848/2172 symbols completed. STWD took 1.5s. Estimated remaining: 2m 1s. Rate: 160.3 symbols/min [2025-09-17T07:42:11.189843] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:11.290958] [DEBUG] [LOCAL ] STXK: Loaded 1518 existing records from primary storage. [2025-09-17T07:42:11.409003] [INFO ] [MAIN ] STXK: Loaded 1518 primary data records. [2025-09-17T07:42:11.481075] [DEBUG] [MAIN ] STXE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:11.504053] [INFO ] [MAIN ] STXE: Generated 1794 derivative records from 2282 primary records. [2025-09-17T07:42:11.532381] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-17T07:42:11.624789] [DEBUG] [LOCAL ] STXE: Derivative data saved (1794 records). [2025-09-17T07:42:11.631088] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-17T07:42:11.745890] [INFO ] [MAIN ] Derivative Progress: 1849/2172 symbols completed. STXE took 1.0s. Estimated remaining: 2m 1s. Rate: 160.3 symbols/min [2025-09-17T07:42:11.755791] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:11.765402] [DEBUG] [LOCAL ] STXT: Loaded 2625 existing records from primary storage. [2025-09-17T07:42:11.766006] [INFO ] [MAIN ] STXT: Loaded 2625 primary data records. [2025-09-17T07:42:11.835717] [DEBUG] [MAIN ] STXG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:42:11.882434] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2663 primary records. [2025-09-17T07:42:11.883184] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-17T07:42:12.088106] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-09-17T07:42:12.088719] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-17T07:42:12.091038] [INFO ] [MAIN ] Derivative Progress: 1850/2172 symbols completed. STXG took 1.0s. Estimated remaining: 2m 1s. Rate: 160.3 symbols/min [2025-09-17T07:42:12.091916] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:12.111266] [DEBUG] [MAIN ] STXK: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:42:12.112101] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1518 primary records. [2025-09-17T07:42:12.111332] [DEBUG] [LOCAL ] STXV: Loaded 1694 existing records from primary storage. [2025-09-17T07:42:12.112219] [INFO ] [MAIN ] STXV: Loaded 1694 primary data records. [2025-09-17T07:42:12.112281] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-17T07:42:12.269098] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-09-17T07:42:12.305885] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-17T07:42:12.407532] [INFO ] [MAIN ] Derivative Progress: 1851/2172 symbols completed. STXK took 1.2s. Estimated remaining: 2m 0s. Rate: 160.3 symbols/min [2025-09-17T07:42:12.425309] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:12.439782] [DEBUG] [MAIN ] STXT: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:42:12.441184] [INFO ] [MAIN ] STXT: Generated 1793 derivative records from 2625 primary records. [2025-09-17T07:42:12.441626] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-17T07:42:12.458993] [DEBUG] [LOCAL ] STXT: Derivative data saved (1793 records). [2025-09-17T07:42:12.459249] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-17T07:42:12.461711] [INFO ] [MAIN ] Derivative Progress: 1852/2172 symbols completed. STXT took 0.7s. Estimated remaining: 1m 60s. Rate: 160.4 symbols/min [2025-09-17T07:42:12.462106] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:12.491549] [DEBUG] [MAIN ] STXV: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:42:12.492322] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1694 primary records. [2025-09-17T07:42:12.492417] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-17T07:42:12.520161] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-09-17T07:42:12.520322] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-17T07:42:12.522684] [INFO ] [MAIN ] Derivative Progress: 1853/2172 symbols completed. STXV took 0.4s. Estimated remaining: 1m 59s. Rate: 160.4 symbols/min [2025-09-17T07:42:12.522966] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:12.557581] [DEBUG] [LOCAL ] STZ: Loaded 52271 existing records from primary storage. [2025-09-17T07:42:12.558426] [INFO ] [MAIN ] STZ: Loaded 52271 primary data records. [2025-09-17T07:42:12.643715] [DEBUG] [LOCAL ] SU: Loaded 53474 existing records from primary storage. [2025-09-17T07:42:12.685263] [INFO ] [MAIN ] SU: Loaded 53474 primary data records. [2025-09-17T07:42:13.022477] [DEBUG] [LOCAL ] SUI: Loaded 42301 existing records from primary storage. [2025-09-17T07:42:13.028611] [INFO ] [MAIN ] SUI: Loaded 42301 primary data records. [2025-09-17T07:42:13.571516] [DEBUG] [MAIN ] STZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:13.573339] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52271 primary records. [2025-09-17T07:42:13.574733] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-17T07:42:13.595628] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-09-17T07:42:13.596955] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-17T07:42:13.600117] [INFO ] [MAIN ] Derivative Progress: 1854/2172 symbols completed. STZ took 1.2s. Estimated remaining: 1m 59s. Rate: 160.3 symbols/min [2025-09-17T07:42:13.600607] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:13.614128] [DEBUG] [MAIN ] SU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:13.615163] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53474 primary records. [2025-09-17T07:42:13.615508] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-17T07:42:13.646904] [DEBUG] [MAIN ] SUI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:13.647831] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-09-17T07:42:13.649063] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 42301 primary records. [2025-09-17T07:42:13.649463] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-17T07:42:13.649306] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-17T07:42:13.654727] [INFO ] [MAIN ] Derivative Progress: 1855/2172 symbols completed. SU took 1.2s. Estimated remaining: 1m 59s. Rate: 160.3 symbols/min [2025-09-17T07:42:13.664783] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:13.680529] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-09-17T07:42:13.680654] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-17T07:42:13.683844] [INFO ] [MAIN ] Derivative Progress: 1856/2172 symbols completed. SUI took 1.2s. Estimated remaining: 1m 58s. Rate: 160.4 symbols/min [2025-09-17T07:42:13.684903] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:13.696945] [DEBUG] [LOCAL ] SUN: Loaded 37234 existing records from primary storage. [2025-09-17T07:42:13.697334] [INFO ] [MAIN ] SUN: Loaded 37234 primary data records. [2025-09-17T07:42:14.033726] [DEBUG] [LOCAL ] SUPV: Loaded 46933 existing records from primary storage. [2025-09-17T07:42:14.034399] [INFO ] [MAIN ] SUPV: Loaded 46933 primary data records. [2025-09-17T07:42:14.115244] [DEBUG] [LOCAL ] SUZ: Loaded 46060 existing records from primary storage. [2025-09-17T07:42:14.121292] [INFO ] [MAIN ] SUZ: Loaded 46060 primary data records. [2025-09-17T07:42:14.717318] [DEBUG] [MAIN ] SUN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:14.719703] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 37234 primary records. [2025-09-17T07:42:14.720926] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-17T07:42:14.737789] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-09-17T07:42:14.738813] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-17T07:42:14.742550] [INFO ] [MAIN ] Derivative Progress: 1857/2172 symbols completed. SUN took 1.1s. Estimated remaining: 1m 58s. Rate: 160.3 symbols/min [2025-09-17T07:42:14.744197] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:14.758982] [DEBUG] [MAIN ] SUPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:14.759974] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 46933 primary records. [2025-09-17T07:42:14.760806] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-17T07:42:14.793061] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-09-17T07:42:14.793304] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-17T07:42:14.792979] [DEBUG] [MAIN ] SUZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:14.796187] [INFO ] [MAIN ] Derivative Progress: 1858/2172 symbols completed. SUPV took 1.1s. Estimated remaining: 1m 58s. Rate: 160.3 symbols/min [2025-09-17T07:42:14.794229] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 46060 primary records. [2025-09-17T07:42:14.796451] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-17T07:42:14.823173] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-09-17T07:42:14.823390] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-17T07:42:14.826557] [INFO ] [MAIN ] Derivative Progress: 1859/2172 symbols completed. SUZ took 1.1s. Estimated remaining: 1m 57s. Rate: 160.4 symbols/min [2025-09-17T07:42:14.840102] [DEBUG] [LOCAL ] SVV: Loaded 39392 existing records from primary storage. [2025-09-17T07:42:14.840263] [INFO ] [MAIN ] SVV: Loaded 39392 primary data records. [2025-09-17T07:42:15.148314] [DEBUG] [MAIN ] SVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:15.149055] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 39392 primary records. [2025-09-17T07:42:15.149136] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-17T07:42:15.165018] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-09-17T07:42:15.165104] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-17T07:42:15.167207] [INFO ] [MAIN ] Derivative Progress: 1860/2172 symbols completed. SVV took 0.4s. Estimated remaining: 1m 57s. Rate: 160.4 symbols/min [2025-09-17T07:42:15.168013] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:15.168165] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:15.168286] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:15.200751] [DEBUG] [LOCAL ] SWX: Loaded 31321 existing records from primary storage. [2025-09-17T07:42:15.200934] [INFO ] [MAIN ] SWX: Loaded 31321 primary data records. [2025-09-17T07:42:15.382463] [DEBUG] [LOCAL ] SWK: Loaded 52524 existing records from primary storage. [2025-09-17T07:42:15.413219] [INFO ] [MAIN ] SWK: Loaded 52524 primary data records. [2025-09-17T07:42:15.404286] [DEBUG] [LOCAL ] SW: Loaded 53166 existing records from primary storage. [2025-09-17T07:42:15.438680] [INFO ] [MAIN ] SW: Loaded 53166 primary data records. [2025-09-17T07:42:16.204312] [DEBUG] [MAIN ] SWX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:16.205466] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31321 primary records. [2025-09-17T07:42:16.205944] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-17T07:42:16.224265] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-09-17T07:42:16.224548] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-17T07:42:16.226801] [INFO ] [MAIN ] Derivative Progress: 1861/2172 symbols completed. SWX took 1.1s. Estimated remaining: 1m 56s. Rate: 160.3 symbols/min [2025-09-17T07:42:16.227333] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:16.246080] [DEBUG] [MAIN ] SWK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:16.247153] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52524 primary records. [2025-09-17T07:42:16.252294] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-17T07:42:16.250754] [DEBUG] [LOCAL ] SWZ: Loaded 6209 existing records from primary storage. [2025-09-17T07:42:16.252817] [INFO ] [MAIN ] SWZ: Loaded 6209 primary data records. [2025-09-17T07:42:16.366751] [DEBUG] [MAIN ] SW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:16.386372] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53166 primary records. [2025-09-17T07:42:16.386582] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-17T07:42:16.386440] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-09-17T07:42:16.397902] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-17T07:42:16.422830] [INFO ] [MAIN ] Derivative Progress: 1862/2172 symbols completed. SWK took 1.3s. Estimated remaining: 1m 56s. Rate: 160.3 symbols/min [2025-09-17T07:42:16.446473] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:16.446566] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-09-17T07:42:16.487034] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-17T07:42:16.493313] [INFO ] [MAIN ] Derivative Progress: 1863/2172 symbols completed. SW took 1.3s. Estimated remaining: 1m 56s. Rate: 160.4 symbols/min [2025-09-17T07:42:16.627531] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:16.652513] [DEBUG] [LOCAL ] SXI: Loaded 11371 existing records from primary storage. [2025-09-17T07:42:16.652953] [INFO ] [MAIN ] SXI: Loaded 11371 primary data records. [2025-09-17T07:42:16.834637] [DEBUG] [LOCAL ] SXC: Loaded 41817 existing records from primary storage. [2025-09-17T07:42:16.858494] [INFO ] [MAIN ] SXC: Loaded 41817 primary data records. [2025-09-17T07:42:17.070947] [DEBUG] [MAIN ] SWZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:42:17.088341] [INFO ] [MAIN ] SWZ: Generated 1793 derivative records from 6209 primary records. [2025-09-17T07:42:17.100622] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-17T07:42:17.310139] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1793 records). [2025-09-17T07:42:17.311712] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-17T07:42:17.314024] [INFO ] [MAIN ] Derivative Progress: 1864/2172 symbols completed. SWZ took 1.1s. Estimated remaining: 1m 55s. Rate: 160.3 symbols/min [2025-09-17T07:42:17.314749] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:17.336737] [DEBUG] [MAIN ] SXI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:17.338408] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11371 primary records. [2025-09-17T07:42:17.338738] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-17T07:42:17.368023] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-09-17T07:42:17.368395] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-17T07:42:17.370717] [INFO ] [MAIN ] Derivative Progress: 1865/2172 symbols completed. SXI took 0.7s. Estimated remaining: 1m 55s. Rate: 160.3 symbols/min [2025-09-17T07:42:17.371245] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:17.399251] [DEBUG] [LOCAL ] SXT: Loaded 28811 existing records from primary storage. [2025-09-17T07:42:17.400102] [INFO ] [MAIN ] SXT: Loaded 28811 primary data records. [2025-09-17T07:42:17.399952] [DEBUG] [MAIN ] SXC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:17.401002] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41817 primary records. [2025-09-17T07:42:17.437862] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-17T07:42:17.597287] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-09-17T07:42:17.723347] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-17T07:42:17.726635] [INFO ] [MAIN ] Derivative Progress: 1866/2172 symbols completed. SXC took 1.3s. Estimated remaining: 1m 54s. Rate: 160.4 symbols/min [2025-09-17T07:42:17.727155] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:17.749577] [DEBUG] [LOCAL ] SYF: Loaded 53466 existing records from primary storage. [2025-09-17T07:42:17.750868] [INFO ] [MAIN ] SYF: Loaded 53466 primary data records. [2025-09-17T07:42:18.093911] [DEBUG] [MAIN ] SXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:18.095056] [DEBUG] [LOCAL ] SYK: Loaded 47201 existing records from primary storage. [2025-09-17T07:42:18.095228] [INFO ] [MAIN ] SYK: Loaded 47201 primary data records. [2025-09-17T07:42:18.095960] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 28811 primary records. [2025-09-17T07:42:18.096170] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-17T07:42:18.222881] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-09-17T07:42:18.258990] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-17T07:42:18.401599] [INFO ] [MAIN ] Derivative Progress: 1867/2172 symbols completed. SXT took 1.1s. Estimated remaining: 1m 54s. Rate: 160.3 symbols/min [2025-09-17T07:42:18.412209] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:18.436572] [DEBUG] [MAIN ] SYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:18.437628] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53466 primary records. [2025-09-17T07:42:18.438059] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-17T07:42:18.466043] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-09-17T07:42:18.466194] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-17T07:42:18.468561] [INFO ] [MAIN ] Derivative Progress: 1868/2172 symbols completed. SYF took 1.1s. Estimated remaining: 1m 54s. Rate: 160.4 symbols/min [2025-09-17T07:42:18.468973] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:18.500580] [DEBUG] [MAIN ] SYK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:18.501423] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 47201 primary records. [2025-09-17T07:42:18.501582] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-17T07:42:18.533311] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-09-17T07:42:18.533482] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-17T07:42:18.537434] [DEBUG] [LOCAL ] SYY: Loaded 53255 existing records from primary storage. [2025-09-17T07:42:18.536001] [INFO ] [MAIN ] Derivative Progress: 1869/2172 symbols completed. SYK took 0.8s. Estimated remaining: 1m 53s. Rate: 160.4 symbols/min [2025-09-17T07:42:18.537913] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:18.537760] [INFO ] [MAIN ] SYY: Loaded 53255 primary data records. [2025-09-17T07:42:18.893621] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-17T07:42:18.894430] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-09-17T07:42:19.024178] [DEBUG] [LOCAL ] TAC: Loaded 43006 existing records from primary storage. [2025-09-17T07:42:19.039937] [INFO ] [MAIN ] TAC: Loaded 43006 primary data records. [2025-09-17T07:42:19.532624] [DEBUG] [MAIN ] SYY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:19.534228] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53255 primary records. [2025-09-17T07:42:19.534839] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-17T07:42:19.556198] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-09-17T07:42:19.557782] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-17T07:42:19.560356] [INFO ] [MAIN ] Derivative Progress: 1870/2172 symbols completed. SYY took 1.1s. Estimated remaining: 1m 53s. Rate: 160.3 symbols/min [2025-09-17T07:42:19.560810] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:19.575191] [DEBUG] [MAIN ] T: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:19.575961] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-09-17T07:42:19.576422] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-17T07:42:19.607489] [DEBUG] [MAIN ] TAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:19.609784] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 43006 primary records. [2025-09-17T07:42:19.610627] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-17T07:42:19.612244] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-09-17T07:42:19.627661] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-17T07:42:19.627507] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-09-17T07:42:19.629667] [INFO ] [MAIN ] Derivative Progress: 1871/2172 symbols completed. T took 1.2s. Estimated remaining: 1m 53s. Rate: 160.3 symbols/min [2025-09-17T07:42:19.640302] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-17T07:42:19.640622] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:19.643479] [INFO ] [MAIN ] Derivative Progress: 1872/2172 symbols completed. TAC took 1.1s. Estimated remaining: 1m 52s. Rate: 160.4 symbols/min [2025-09-17T07:42:19.643905] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:19.665286] [DEBUG] [LOCAL ] TAK: Loaded 49933 existing records from primary storage. [2025-09-17T07:42:19.665551] [INFO ] [MAIN ] TAK: Loaded 49933 primary data records. [2025-09-17T07:42:20.027736] [DEBUG] [LOCAL ] TAL: Loaded 52199 existing records from primary storage. [2025-09-17T07:42:20.027094] [DEBUG] [LOCAL ] TALO: Loaded 50842 existing records from primary storage. [2025-09-17T07:42:20.028141] [INFO ] [MAIN ] TAL: Loaded 52199 primary data records. [2025-09-17T07:42:20.028085] [INFO ] [MAIN ] TALO: Loaded 50842 primary data records. [2025-09-17T07:42:20.699326] [DEBUG] [MAIN ] TAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:20.700636] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 49933 primary records. [2025-09-17T07:42:20.701151] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-17T07:42:20.721800] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-09-17T07:42:20.722125] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-17T07:42:20.724237] [INFO ] [MAIN ] Derivative Progress: 1873/2172 symbols completed. TAK took 1.2s. Estimated remaining: 1m 52s. Rate: 160.3 symbols/min [2025-09-17T07:42:20.741895] [DEBUG] [MAIN ] TALO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:20.754491] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50842 primary records. [2025-09-17T07:42:20.754838] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-17T07:42:20.755058] [DEBUG] [MAIN ] TAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:20.756108] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 52199 primary records. [2025-09-17T07:42:20.756349] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-17T07:42:20.784777] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-09-17T07:42:20.785968] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-17T07:42:20.788953] [INFO ] [MAIN ] Derivative Progress: 1874/2172 symbols completed. TALO took 1.1s. Estimated remaining: 1m 52s. Rate: 160.3 symbols/min [2025-09-17T07:42:20.789732] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-09-17T07:42:20.789957] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-17T07:42:20.792720] [INFO ] [MAIN ] Derivative Progress: 1875/2172 symbols completed. TAL took 1.2s. Estimated remaining: 1m 51s. Rate: 160.4 symbols/min [2025-09-17T07:42:20.793108] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:20.793525] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:20.793292] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:20.811801] [DEBUG] [LOCAL ] TBB: Loaded 11757 existing records from primary storage. [2025-09-17T07:42:20.811983] [INFO ] [MAIN ] TBB: Loaded 11757 primary data records. [2025-09-17T07:42:21.135364] [DEBUG] [LOCAL ] TBBB: Loaded 36156 existing records from primary storage. [2025-09-17T07:42:21.135810] [INFO ] [MAIN ] TBBB: Loaded 36156 primary data records. [2025-09-17T07:42:21.279346] [DEBUG] [LOCAL ] TAP: Loaded 52841 existing records from primary storage. [2025-09-17T07:42:21.332924] [INFO ] [MAIN ] TAP: Loaded 52841 primary data records. [2025-09-17T07:42:21.645131] [DEBUG] [MAIN ] TBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:21.760486] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11757 primary records. [2025-09-17T07:42:21.761133] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-17T07:42:21.780214] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-09-17T07:42:21.780968] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-17T07:42:21.783905] [INFO ] [MAIN ] Derivative Progress: 1876/2172 symbols completed. TBB took 1.0s. Estimated remaining: 1m 51s. Rate: 160.3 symbols/min [2025-09-17T07:42:21.784663] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:21.803449] [DEBUG] [MAIN ] TBBB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:21.804282] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 36156 primary records. [2025-09-17T07:42:21.804635] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-17T07:42:21.831985] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-09-17T07:42:21.832310] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-17T07:42:21.834455] [INFO ] [MAIN ] Derivative Progress: 1877/2172 symbols completed. TBBB took 1.0s. Estimated remaining: 1m 50s. Rate: 160.4 symbols/min [2025-09-17T07:42:21.834876] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:21.855617] [DEBUG] [LOCAL ] TBI: Loaded 22761 existing records from primary storage. [2025-09-17T07:42:21.856484] [DEBUG] [MAIN ] TAP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:21.856662] [INFO ] [MAIN ] TBI: Loaded 22761 primary data records. [2025-09-17T07:42:21.857409] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52841 primary records. [2025-09-17T07:42:21.893776] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-17T07:42:21.903960] [DEBUG] [LOCAL ] TBN: Loaded 2988 existing records from primary storage. [2025-09-17T07:42:21.930719] [INFO ] [MAIN ] TBN: Loaded 2988 primary data records. [2025-09-17T07:42:22.134993] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-09-17T07:42:22.158061] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-17T07:42:22.289493] [INFO ] [MAIN ] Derivative Progress: 1878/2172 symbols completed. TAP took 1.5s. Estimated remaining: 1m 50s. Rate: 160.3 symbols/min [2025-09-17T07:42:22.353573] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:22.539966] [DEBUG] [MAIN ] TBI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:22.540919] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22761 primary records. [2025-09-17T07:42:22.541898] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-17T07:42:22.582172] [DEBUG] [MAIN ] TBN: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:42:22.586222] [INFO ] [MAIN ] TBN: Generated 1792 derivative records from 2988 primary records. [2025-09-17T07:42:22.587432] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-09-17T07:42:22.587495] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-17T07:42:22.588428] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-17T07:42:22.590369] [INFO ] [MAIN ] Derivative Progress: 1879/2172 symbols completed. TBI took 0.8s. Estimated remaining: 1m 50s. Rate: 160.4 symbols/min [2025-09-17T07:42:22.591490] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:22.620184] [DEBUG] [LOCAL ] TD: Loaded 52304 existing records from primary storage. [2025-09-17T07:42:22.621198] [DEBUG] [LOCAL ] TBN: Derivative data saved (1792 records). [2025-09-17T07:42:22.621429] [INFO ] [MAIN ] TD: Loaded 52304 primary data records. [2025-09-17T07:42:22.621512] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-17T07:42:22.624300] [INFO ] [MAIN ] Derivative Progress: 1880/2172 symbols completed. TBN took 0.8s. Estimated remaining: 1m 49s. Rate: 160.4 symbols/min [2025-09-17T07:42:22.645690] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:22.821449] [DEBUG] [LOCAL ] TDF: Loaded 6480 existing records from primary storage. [2025-09-17T07:42:22.941960] [INFO ] [MAIN ] TDF: Loaded 6480 primary data records. [2025-09-17T07:42:23.001596] [DEBUG] [LOCAL ] TDC: Loaded 47071 existing records from primary storage. [2025-09-17T07:42:23.051720] [INFO ] [MAIN ] TDC: Loaded 47071 primary data records. [2025-09-17T07:42:23.575581] [DEBUG] [MAIN ] TD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:23.577958] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52304 primary records. [2025-09-17T07:42:23.578073] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-17T07:42:23.595689] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-09-17T07:42:23.595835] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-17T07:42:23.598024] [INFO ] [MAIN ] Derivative Progress: 1881/2172 symbols completed. TD took 1.3s. Estimated remaining: 1m 49s. Rate: 160.3 symbols/min [2025-09-17T07:42:23.598587] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:23.616269] [DEBUG] [MAIN ] TDF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:23.618422] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6480 primary records. [2025-09-17T07:42:23.619184] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-17T07:42:23.651568] [DEBUG] [MAIN ] TDC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:23.652165] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-09-17T07:42:23.652847] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 47071 primary records. [2025-09-17T07:42:23.652981] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-17T07:42:23.653071] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-17T07:42:23.655794] [INFO ] [MAIN ] Derivative Progress: 1882/2172 symbols completed. TDF took 1.0s. Estimated remaining: 1m 49s. Rate: 160.4 symbols/min [2025-09-17T07:42:23.663616] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:23.671076] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-09-17T07:42:23.671662] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-17T07:42:23.674489] [INFO ] [MAIN ] Derivative Progress: 1883/2172 symbols completed. TDC took 1.1s. Estimated remaining: 1m 48s. Rate: 160.4 symbols/min [2025-09-17T07:42:23.675007] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:23.682993] [DEBUG] [LOCAL ] TDG: Loaded 22147 existing records from primary storage. [2025-09-17T07:42:23.683159] [INFO ] [MAIN ] TDG: Loaded 22147 primary data records. [2025-09-17T07:42:24.034561] [DEBUG] [LOCAL ] TDS: Loaded 42884 existing records from primary storage. [2025-09-17T07:42:24.035937] [INFO ] [MAIN ] TDS: Loaded 42884 primary data records. [2025-09-17T07:42:24.036611] [DEBUG] [LOCAL ] TDOC: Loaded 53358 existing records from primary storage. [2025-09-17T07:42:24.057943] [INFO ] [MAIN ] TDOC: Loaded 53358 primary data records. [2025-09-17T07:42:24.741393] [DEBUG] [MAIN ] TDG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:24.742973] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22147 primary records. [2025-09-17T07:42:24.743437] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-17T07:42:24.761433] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-09-17T07:42:24.762348] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-17T07:42:24.764588] [INFO ] [MAIN ] Derivative Progress: 1884/2172 symbols completed. TDG took 1.2s. Estimated remaining: 1m 48s. Rate: 160.3 symbols/min [2025-09-17T07:42:24.765035] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:24.789356] [DEBUG] [MAIN ] TDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:24.790861] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42884 primary records. [2025-09-17T07:42:24.790974] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-17T07:42:24.815796] [DEBUG] [MAIN ] TDOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:24.817410] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53358 primary records. [2025-09-17T07:42:24.828918] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-17T07:42:24.830867] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-09-17T07:42:24.831070] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-17T07:42:24.833318] [INFO ] [MAIN ] Derivative Progress: 1885/2172 symbols completed. TDS took 1.2s. Estimated remaining: 1m 47s. Rate: 160.4 symbols/min [2025-09-17T07:42:24.834144] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:24.864177] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-09-17T07:42:24.865298] [DEBUG] [LOCAL ] TDW: Loaded 45810 existing records from primary storage. [2025-09-17T07:42:24.865583] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-17T07:42:24.865672] [INFO ] [MAIN ] TDW: Loaded 45810 primary data records. [2025-09-17T07:42:24.868112] [INFO ] [MAIN ] Derivative Progress: 1886/2172 symbols completed. TDOC took 1.2s. Estimated remaining: 1m 47s. Rate: 160.4 symbols/min [2025-09-17T07:42:24.888927] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:24.985245] [DEBUG] [LOCAL ] TDY: Loaded 23036 existing records from primary storage. [2025-09-17T07:42:25.029412] [DEBUG] [LOCAL ] TEAF: Loaded 7142 existing records from primary storage. [2025-09-17T07:42:25.029506] [INFO ] [MAIN ] TDY: Loaded 23036 primary data records. [2025-09-17T07:42:25.178973] [INFO ] [MAIN ] TEAF: Loaded 7142 primary data records. [2025-09-17T07:42:25.813562] [DEBUG] [MAIN ] TDW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:25.815101] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45810 primary records. [2025-09-17T07:42:25.815736] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-17T07:42:25.835465] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-09-17T07:42:25.848307] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-17T07:42:25.848616] [DEBUG] [MAIN ] TDY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:25.850563] [INFO ] [MAIN ] Derivative Progress: 1887/2172 symbols completed. TDW took 1.1s. Estimated remaining: 1m 47s. Rate: 160.3 symbols/min [2025-09-17T07:42:25.851918] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 23036 primary records. [2025-09-17T07:42:25.852182] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-17T07:42:25.851974] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:25.869405] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-09-17T07:42:25.869747] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-17T07:42:25.872729] [INFO ] [MAIN ] Derivative Progress: 1888/2172 symbols completed. TDY took 1.0s. Estimated remaining: 1m 46s. Rate: 160.4 symbols/min [2025-09-17T07:42:25.888090] [DEBUG] [MAIN ] TEAF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:25.889020] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7142 primary records. [2025-09-17T07:42:25.889116] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-17T07:42:25.908377] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-09-17T07:42:25.908529] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-17T07:42:25.911160] [INFO ] [MAIN ] Derivative Progress: 1889/2172 symbols completed. TEAF took 1.0s. Estimated remaining: 1m 46s. Rate: 160.4 symbols/min [2025-09-17T07:42:25.945772] [DEBUG] [LOCAL ] TECK: Loaded 53443 existing records from primary storage. [2025-09-17T07:42:25.945934] [INFO ] [MAIN ] TECK: Loaded 53443 primary data records. [2025-09-17T07:42:26.250138] [DEBUG] [MAIN ] TECK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:26.250918] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53443 primary records. [2025-09-17T07:42:26.251009] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-17T07:42:26.267017] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-09-17T07:42:26.267121] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-17T07:42:26.269179] [INFO ] [MAIN ] Derivative Progress: 1890/2172 symbols completed. TECK took 0.4s. Estimated remaining: 1m 45s. Rate: 160.5 symbols/min [2025-09-17T07:42:26.269658] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:26.269790] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:26.269929] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:26.292530] [DEBUG] [LOCAL ] TEI: Loaded 20309 existing records from primary storage. [2025-09-17T07:42:26.292726] [INFO ] [MAIN ] TEI: Loaded 20309 primary data records. [2025-09-17T07:42:26.478286] [DEBUG] [LOCAL ] TEF: Loaded 37615 existing records from primary storage. [2025-09-17T07:42:26.520102] [INFO ] [MAIN ] TEF: Loaded 37615 primary data records. [2025-09-17T07:42:26.756744] [DEBUG] [LOCAL ] TEL: Loaded 51197 existing records from primary storage. [2025-09-17T07:42:26.778232] [INFO ] [MAIN ] TEL: Loaded 51197 primary data records. [2025-09-17T07:42:27.332092] [DEBUG] [MAIN ] TEI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:27.334125] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 20309 primary records. [2025-09-17T07:42:27.334809] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-17T07:42:27.351683] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-09-17T07:42:27.351872] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-17T07:42:27.354177] [INFO ] [MAIN ] Derivative Progress: 1891/2172 symbols completed. TEI took 1.1s. Estimated remaining: 1m 45s. Rate: 160.3 symbols/min [2025-09-17T07:42:27.356318] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:27.374760] [DEBUG] [MAIN ] TEF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:27.375941] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37615 primary records. [2025-09-17T07:42:27.376184] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-17T07:42:27.415463] [DEBUG] [MAIN ] TEL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:27.417336] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51197 primary records. [2025-09-17T07:42:27.418114] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-09-17T07:42:27.418261] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-17T07:42:27.418838] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-17T07:42:27.420972] [INFO ] [MAIN ] Derivative Progress: 1892/2172 symbols completed. TEF took 1.2s. Estimated remaining: 1m 45s. Rate: 160.4 symbols/min [2025-09-17T07:42:27.450926] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:27.453795] [DEBUG] [LOCAL ] TEN: Loaded 31223 existing records from primary storage. [2025-09-17T07:42:27.454687] [INFO ] [MAIN ] TEN: Loaded 31223 primary data records. [2025-09-17T07:42:27.455435] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-09-17T07:42:27.511451] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-17T07:42:27.560173] [INFO ] [MAIN ] Derivative Progress: 1893/2172 symbols completed. TEL took 1.3s. Estimated remaining: 1m 44s. Rate: 160.4 symbols/min [2025-09-17T07:42:27.567465] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:27.670676] [DEBUG] [LOCAL ] TEO: Loaded 21560 existing records from primary storage. [2025-09-17T07:42:27.793042] [INFO ] [MAIN ] TEO: Loaded 21560 primary data records. [2025-09-17T07:42:27.999622] [DEBUG] [LOCAL ] TEVA: Loaded 53632 existing records from primary storage. [2025-09-17T07:42:28.123877] [INFO ] [MAIN ] TEVA: Loaded 53632 primary data records. [2025-09-17T07:42:28.503230] [DEBUG] [MAIN ] TEN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:28.504696] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 31223 primary records. [2025-09-17T07:42:28.504996] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-17T07:42:28.537147] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-09-17T07:42:28.545863] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-17T07:42:28.553151] [INFO ] [MAIN ] Derivative Progress: 1894/2172 symbols completed. TEN took 1.2s. Estimated remaining: 1m 44s. Rate: 160.3 symbols/min [2025-09-17T07:42:28.554351] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:28.553796] [DEBUG] [MAIN ] TEO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:28.555513] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 21560 primary records. [2025-09-17T07:42:28.555950] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-17T07:42:28.574210] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-09-17T07:42:28.574702] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-17T07:42:28.578971] [INFO ] [MAIN ] Derivative Progress: 1895/2172 symbols completed. TEO took 1.1s. Estimated remaining: 1m 44s. Rate: 160.4 symbols/min [2025-09-17T07:42:28.580411] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:28.595411] [DEBUG] [MAIN ] TEVA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:28.596331] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53632 primary records. [2025-09-17T07:42:28.596454] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-17T07:42:28.614408] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-09-17T07:42:28.614676] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-17T07:42:28.617037] [INFO ] [MAIN ] Derivative Progress: 1896/2172 symbols completed. TEVA took 1.0s. Estimated remaining: 1m 43s. Rate: 160.4 symbols/min [2025-09-17T07:42:28.617612] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:28.651471] [DEBUG] [LOCAL ] TEX: Loaded 45043 existing records from primary storage. [2025-09-17T07:42:28.651984] [INFO ] [MAIN ] TEX: Loaded 45043 primary data records. [2025-09-17T07:42:28.814051] [DEBUG] [LOCAL ] TFII: Loaded 34947 existing records from primary storage. [2025-09-17T07:42:28.829929] [INFO ] [MAIN ] TFII: Loaded 34947 primary data records. [2025-09-17T07:42:28.830843] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-17T07:42:28.878771] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-09-17T07:42:29.688412] [DEBUG] [MAIN ] TEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:29.690216] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 45043 primary records. [2025-09-17T07:42:29.690345] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-17T07:42:29.710692] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-09-17T07:42:29.711416] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-17T07:42:29.713614] [INFO ] [MAIN ] Derivative Progress: 1897/2172 symbols completed. TEX took 1.2s. Estimated remaining: 1m 43s. Rate: 160.3 symbols/min [2025-09-17T07:42:29.714863] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:29.735141] [DEBUG] [MAIN ] TFII: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:29.748900] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 34947 primary records. [2025-09-17T07:42:29.749452] [DEBUG] [MAIN ] TFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:29.749573] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-17T07:42:29.750346] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-09-17T07:42:29.750465] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-17T07:42:29.788727] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-09-17T07:42:29.786240] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-09-17T07:42:29.797489] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-17T07:42:29.797587] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-17T07:42:29.799955] [INFO ] [MAIN ] Derivative Progress: 1898/2172 symbols completed. TFC took 1.2s. Estimated remaining: 1m 43s. Rate: 160.3 symbols/min [2025-09-17T07:42:29.803452] [DEBUG] [LOCAL ] TFIN: Loaded 23538 existing records from primary storage. [2025-09-17T07:42:29.803725] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:29.803804] [INFO ] [MAIN ] Derivative Progress: 1899/2172 symbols completed. TFII took 1.2s. Estimated remaining: 1m 42s. Rate: 160.4 symbols/min [2025-09-17T07:42:29.804340] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:29.803983] [INFO ] [MAIN ] TFIN: Loaded 23538 primary data records. [2025-09-17T07:42:30.140555] [DEBUG] [LOCAL ] TFPM: Loaded 36910 existing records from primary storage. [2025-09-17T07:42:30.141554] [INFO ] [MAIN ] TFPM: Loaded 36910 primary data records. [2025-09-17T07:42:30.263767] [DEBUG] [LOCAL ] TFX: Loaded 37839 existing records from primary storage. [2025-09-17T07:42:30.305880] [INFO ] [MAIN ] TFX: Loaded 37839 primary data records. [2025-09-17T07:42:30.813041] [DEBUG] [MAIN ] TFIN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:30.813982] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23538 primary records. [2025-09-17T07:42:30.814777] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-17T07:42:30.836002] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-09-17T07:42:30.836634] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-17T07:42:30.849342] [DEBUG] [MAIN ] TFPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:30.852909] [INFO ] [MAIN ] Derivative Progress: 1900/2172 symbols completed. TFIN took 1.1s. Estimated remaining: 1m 42s. Rate: 160.3 symbols/min [2025-09-17T07:42:30.850835] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 36910 primary records. [2025-09-17T07:42:30.853298] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:30.853372] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-17T07:42:30.872618] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-09-17T07:42:30.873015] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-17T07:42:30.875086] [INFO ] [MAIN ] Derivative Progress: 1901/2172 symbols completed. TFPM took 1.1s. Estimated remaining: 1m 41s. Rate: 160.3 symbols/min [2025-09-17T07:42:30.875388] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:30.880513] [DEBUG] [LOCAL ] TG: Loaded 10281 existing records from primary storage. [2025-09-17T07:42:30.880661] [INFO ] [MAIN ] TG: Loaded 10281 primary data records. [2025-09-17T07:42:31.047820] [DEBUG] [MAIN ] TFX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:31.085250] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 37839 primary records. [2025-09-17T07:42:31.093875] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-17T07:42:31.208156] [DEBUG] [LOCAL ] TGLS: Loaded 28570 existing records from primary storage. [2025-09-17T07:42:31.209338] [INFO ] [MAIN ] TGLS: Loaded 28570 primary data records. [2025-09-17T07:42:31.407325] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-09-17T07:42:31.560321] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-17T07:42:31.563495] [INFO ] [MAIN ] Derivative Progress: 1902/2172 symbols completed. TFX took 1.8s. Estimated remaining: 1m 41s. Rate: 160.3 symbols/min [2025-09-17T07:42:31.564180] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:31.584181] [DEBUG] [MAIN ] TG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:31.585510] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10281 primary records. [2025-09-17T07:42:31.586189] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-17T07:42:31.607368] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-09-17T07:42:31.607538] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-17T07:42:31.610073] [INFO ] [MAIN ] Derivative Progress: 1903/2172 symbols completed. TG took 0.8s. Estimated remaining: 1m 41s. Rate: 160.3 symbols/min [2025-09-17T07:42:31.636193] [DEBUG] [MAIN ] TGLS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:31.636912] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 28570 primary records. [2025-09-17T07:42:31.636999] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-17T07:42:31.666079] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-09-17T07:42:31.666252] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-17T07:42:31.667016] [DEBUG] [LOCAL ] TGNA: Loaded 48714 existing records from primary storage. [2025-09-17T07:42:31.669007] [INFO ] [MAIN ] Derivative Progress: 1904/2172 symbols completed. TGLS took 0.8s. Estimated remaining: 1m 40s. Rate: 160.4 symbols/min [2025-09-17T07:42:31.669223] [INFO ] [MAIN ] TGNA: Loaded 48714 primary data records. [2025-09-17T07:42:31.973005] [DEBUG] [MAIN ] TGNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:31.973691] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48714 primary records. [2025-09-17T07:42:31.973766] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-17T07:42:31.989127] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-09-17T07:42:31.989215] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-17T07:42:31.991315] [INFO ] [MAIN ] Derivative Progress: 1905/2172 symbols completed. TGNA took 0.4s. Estimated remaining: 1m 40s. Rate: 160.4 symbols/min [2025-09-17T07:42:31.992173] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:31.992304] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:31.992465] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:32.036858] [DEBUG] [LOCAL ] TGS: Loaded 32080 existing records from primary storage. [2025-09-17T07:42:32.037020] [INFO ] [MAIN ] TGS: Loaded 32080 primary data records. [2025-09-17T07:42:32.169699] [DEBUG] [LOCAL ] THC: Loaded 48406 existing records from primary storage. [2025-09-17T07:42:32.185792] [INFO ] [MAIN ] THC: Loaded 48406 primary data records. [2025-09-17T07:42:32.460248] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-17T07:42:32.478518] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-09-17T07:42:33.038700] [DEBUG] [MAIN ] TGS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:33.042069] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 32080 primary records. [2025-09-17T07:42:33.042523] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-17T07:42:33.068333] [DEBUG] [MAIN ] THC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:33.070625] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 48406 primary records. [2025-09-17T07:42:33.071286] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-17T07:42:33.073961] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-09-17T07:42:33.087418] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-17T07:42:33.091089] [INFO ] [MAIN ] Derivative Progress: 1906/2172 symbols completed. TGS took 1.1s. Estimated remaining: 1m 40s. Rate: 160.3 symbols/min [2025-09-17T07:42:33.092028] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:33.106553] [DEBUG] [MAIN ] TGT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:33.108512] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-09-17T07:42:33.108863] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-17T07:42:33.110297] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-09-17T07:42:33.118081] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-17T07:42:33.123704] [INFO ] [MAIN ] Derivative Progress: 1907/2172 symbols completed. THC took 1.1s. Estimated remaining: 1m 39s. Rate: 160.3 symbols/min [2025-09-17T07:42:33.124533] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:33.136252] [DEBUG] [LOCAL ] THIR: Loaded 2128 existing records from primary storage. [2025-09-17T07:42:33.136981] [INFO ] [MAIN ] THIR: Loaded 2128 primary data records. [2025-09-17T07:42:33.136914] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-09-17T07:42:33.168045] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-17T07:42:33.203780] [INFO ] [MAIN ] Derivative Progress: 1908/2172 symbols completed. TGT took 1.2s. Estimated remaining: 1m 39s. Rate: 160.4 symbols/min [2025-09-17T07:42:33.246828] [DEBUG] [LOCAL ] THG: Loaded 22228 existing records from primary storage. [2025-09-17T07:42:33.250365] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:33.250527] [INFO ] [MAIN ] THG: Loaded 22228 primary data records. [2025-09-17T07:42:33.782541] [DEBUG] [LOCAL ] THO: Loaded 42393 existing records from primary storage. [2025-09-17T07:42:33.783431] [INFO ] [MAIN ] THO: Loaded 42393 primary data records. [2025-09-17T07:42:33.985561] [DEBUG] [MAIN ] THIR: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:42:34.092738] [INFO ] [MAIN ] THIR: Generated 1792 derivative records from 2128 primary records. [2025-09-17T07:42:34.102194] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-17T07:42:34.118293] [DEBUG] [LOCAL ] THIR: Derivative data saved (1792 records). [2025-09-17T07:42:34.118515] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-17T07:42:34.122505] [INFO ] [MAIN ] Derivative Progress: 1909/2172 symbols completed. THIR took 1.0s. Estimated remaining: 1m 38s. Rate: 160.3 symbols/min [2025-09-17T07:42:34.124144] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:34.138711] [DEBUG] [MAIN ] THG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:34.139704] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 22228 primary records. [2025-09-17T07:42:34.139795] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-17T07:42:34.157621] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-09-17T07:42:34.157961] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-17T07:42:34.160185] [INFO ] [MAIN ] Derivative Progress: 1910/2172 symbols completed. THG took 1.1s. Estimated remaining: 1m 38s. Rate: 160.4 symbols/min [2025-09-17T07:42:34.160691] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:34.184798] [DEBUG] [MAIN ] THO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:34.185541] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 42393 primary records. [2025-09-17T07:42:34.186052] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-17T07:42:34.200366] [DEBUG] [LOCAL ] THQ: Loaded 24343 existing records from primary storage. [2025-09-17T07:42:34.208189] [INFO ] [MAIN ] THQ: Loaded 24343 primary data records. [2025-09-17T07:42:34.288175] [DEBUG] [LOCAL ] THR: Loaded 20002 existing records from primary storage. [2025-09-17T07:42:34.305181] [INFO ] [MAIN ] THR: Loaded 20002 primary data records. [2025-09-17T07:42:34.324764] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-09-17T07:42:34.345794] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-17T07:42:34.394110] [INFO ] [MAIN ] Derivative Progress: 1911/2172 symbols completed. THO took 1.1s. Estimated remaining: 1m 38s. Rate: 160.4 symbols/min [2025-09-17T07:42:34.476456] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:34.917353] [DEBUG] [MAIN ] THQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:34.917033] [DEBUG] [LOCAL ] THS: Loaded 37914 existing records from primary storage. [2025-09-17T07:42:34.918497] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 24343 primary records. [2025-09-17T07:42:34.918706] [INFO ] [MAIN ] THS: Loaded 37914 primary data records. [2025-09-17T07:42:34.918764] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-17T07:42:35.077531] [DEBUG] [MAIN ] THR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:35.105980] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 20002 primary records. [2025-09-17T07:42:35.121687] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-17T07:42:35.155682] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-09-17T07:42:35.156721] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-17T07:42:35.270486] [INFO ] [MAIN ] Derivative Progress: 1912/2172 symbols completed. THQ took 1.1s. Estimated remaining: 1m 37s. Rate: 160.3 symbols/min [2025-09-17T07:42:35.277472] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:35.289392] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-09-17T07:42:35.290266] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-17T07:42:35.292862] [INFO ] [MAIN ] Derivative Progress: 1913/2172 symbols completed. THR took 1.1s. Estimated remaining: 1m 37s. Rate: 160.4 symbols/min [2025-09-17T07:42:35.293347] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:35.321302] [DEBUG] [LOCAL ] THW: Loaded 19191 existing records from primary storage. [2025-09-17T07:42:35.323451] [INFO ] [MAIN ] THW: Loaded 19191 primary data records. [2025-09-17T07:42:35.373911] [DEBUG] [MAIN ] THS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:35.418595] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 37914 primary records. [2025-09-17T07:42:35.452427] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-17T07:42:35.556342] [DEBUG] [LOCAL ] TIMB: Loaded 37199 existing records from primary storage. [2025-09-17T07:42:35.566726] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-09-17T07:42:35.565357] [INFO ] [MAIN ] TIMB: Loaded 37199 primary data records. [2025-09-17T07:42:35.566941] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-17T07:42:35.668986] [INFO ] [MAIN ] Derivative Progress: 1914/2172 symbols completed. THS took 1.2s. Estimated remaining: 1m 37s. Rate: 160.4 symbols/min [2025-09-17T07:42:35.757561] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:35.859948] [DEBUG] [LOCAL ] TISI: Loaded 3869 existing records from primary storage. [2025-09-17T07:42:35.995540] [INFO ] [MAIN ] TISI: Loaded 3869 primary data records. [2025-09-17T07:42:36.370809] [DEBUG] [MAIN ] THW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:36.371820] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19191 primary records. [2025-09-17T07:42:36.372124] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-17T07:42:36.405389] [DEBUG] [MAIN ] TIMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:36.406177] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-09-17T07:42:36.406955] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 37199 primary records. [2025-09-17T07:42:36.407114] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-17T07:42:36.407201] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-17T07:42:36.409578] [INFO ] [MAIN ] Derivative Progress: 1915/2172 symbols completed. THW took 1.1s. Estimated remaining: 1m 36s. Rate: 160.3 symbols/min [2025-09-17T07:42:36.418902] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:36.429120] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-09-17T07:42:36.429481] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-17T07:42:36.431759] [INFO ] [MAIN ] Derivative Progress: 1916/2172 symbols completed. TIMB took 1.1s. Estimated remaining: 1m 36s. Rate: 160.4 symbols/min [2025-09-17T07:42:36.432442] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:36.452107] [DEBUG] [MAIN ] TISI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:36.453092] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3869 primary records. [2025-09-17T07:42:36.462927] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-17T07:42:36.480127] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-09-17T07:42:36.489571] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-17T07:42:36.492281] [INFO ] [MAIN ] Derivative Progress: 1917/2172 symbols completed. TISI took 0.8s. Estimated remaining: 1m 35s. Rate: 160.4 symbols/min [2025-09-17T07:42:36.493510] [DEBUG] [LOCAL ] TIXT: Loaded 30994 existing records from primary storage. [2025-09-17T07:42:36.493988] [INFO ] [MAIN ] TIXT: Loaded 30994 primary data records. [2025-09-17T07:42:36.493935] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:36.824414] [DEBUG] [LOCAL ] TJX: Loaded 53676 existing records from primary storage. [2025-09-17T07:42:36.834849] [INFO ] [MAIN ] TJX: Loaded 53676 primary data records. [2025-09-17T07:42:36.944813] [DEBUG] [LOCAL ] TK: Loaded 39986 existing records from primary storage. [2025-09-17T07:42:36.956275] [INFO ] [MAIN ] TK: Loaded 39986 primary data records. [2025-09-17T07:42:37.479954] [DEBUG] [MAIN ] TIXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:37.482232] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 30994 primary records. [2025-09-17T07:42:37.483283] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-17T07:42:37.501747] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-09-17T07:42:37.501899] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-17T07:42:37.504627] [INFO ] [MAIN ] Derivative Progress: 1918/2172 symbols completed. TIXT took 1.1s. Estimated remaining: 1m 35s. Rate: 160.3 symbols/min [2025-09-17T07:42:37.523680] [DEBUG] [MAIN ] TJX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:37.524917] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53676 primary records. [2025-09-17T07:42:37.525181] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-17T07:42:37.544168] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-09-17T07:42:37.545356] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-17T07:42:37.548138] [INFO ] [MAIN ] Derivative Progress: 1919/2172 symbols completed. TJX took 1.1s. Estimated remaining: 1m 35s. Rate: 160.4 symbols/min [2025-09-17T07:42:37.566299] [DEBUG] [MAIN ] TK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:37.567292] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39986 primary records. [2025-09-17T07:42:37.567378] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-17T07:42:37.586695] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-09-17T07:42:37.586877] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-17T07:42:37.589683] [INFO ] [MAIN ] Derivative Progress: 1920/2172 symbols completed. TK took 1.1s. Estimated remaining: 1m 34s. Rate: 160.4 symbols/min [2025-09-17T07:42:37.590413] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:37.590524] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:37.590618] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:37.644612] [DEBUG] [LOCAL ] TKC: Loaded 37674 existing records from primary storage. [2025-09-17T07:42:37.654167] [INFO ] [MAIN ] TKC: Loaded 37674 primary data records. [2025-09-17T07:42:37.791571] [DEBUG] [LOCAL ] TKR: Loaded 40115 existing records from primary storage. [2025-09-17T07:42:37.790445] [DEBUG] [LOCAL ] TKO: Loaded 44448 existing records from primary storage. [2025-09-17T07:42:37.817992] [INFO ] [MAIN ] TKR: Loaded 40115 primary data records. [2025-09-17T07:42:37.866818] [INFO ] [MAIN ] TKO: Loaded 44448 primary data records. [2025-09-17T07:42:38.507469] [DEBUG] [MAIN ] TKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:38.548259] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 37674 primary records. [2025-09-17T07:42:38.585943] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-17T07:42:38.725359] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-09-17T07:42:38.725531] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-17T07:42:38.729093] [INFO ] [MAIN ] Derivative Progress: 1921/2172 symbols completed. TKC took 1.1s. Estimated remaining: 1m 34s. Rate: 160.3 symbols/min [2025-09-17T07:42:38.762044] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:39.048415] [DEBUG] [LOCAL ] TLYS: Loaded 17143 existing records from primary storage. [2025-09-17T07:42:39.050861] [INFO ] [MAIN ] TLYS: Loaded 17143 primary data records. [2025-09-17T07:42:39.470764] [DEBUG] [MAIN ] TKR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:39.473295] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 40115 primary records. [2025-09-17T07:42:39.471095] [DEBUG] [MAIN ] TKO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:39.474398] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 44448 primary records. [2025-09-17T07:42:39.474568] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-17T07:42:39.474629] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-17T07:42:39.512042] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-09-17T07:42:39.515854] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-09-17T07:42:39.516355] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-17T07:42:39.516433] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-17T07:42:39.519039] [INFO ] [MAIN ] Derivative Progress: 1922/2172 symbols completed. TKO took 1.9s. Estimated remaining: 1m 34s. Rate: 160.2 symbols/min [2025-09-17T07:42:39.522750] [INFO ] [MAIN ] Derivative Progress: 1923/2172 symbols completed. TKR took 1.9s. Estimated remaining: 1m 33s. Rate: 160.2 symbols/min [2025-09-17T07:42:39.519955] [INFO ] [MAIN ] TM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:39.523246] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:39.545768] [DEBUG] [MAIN ] TLYS: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:42:39.546870] [INFO ] [MAIN ] TLYS: Generated 1793 derivative records from 17143 primary records. [2025-09-17T07:42:39.547278] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-17T07:42:39.565575] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1793 records). [2025-09-17T07:42:39.566149] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-17T07:42:39.569391] [INFO ] [MAIN ] Derivative Progress: 1924/2172 symbols completed. TLYS took 0.8s. Estimated remaining: 1m 33s. Rate: 160.3 symbols/min [2025-09-17T07:42:39.570579] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:39.607477] [DEBUG] [LOCAL ] TM: Loaded 37137 existing records from primary storage. [2025-09-17T07:42:39.619480] [INFO ] [MAIN ] TM: Loaded 37137 primary data records. [2025-09-17T07:42:39.784555] [DEBUG] [LOCAL ] TMHC: Loaded 45641 existing records from primary storage. [2025-09-17T07:42:39.785427] [DEBUG] [LOCAL ] TME: Loaded 53201 existing records from primary storage. [2025-09-17T07:42:39.826587] [INFO ] [MAIN ] TMHC: Loaded 45641 primary data records. [2025-09-17T07:42:39.861817] [INFO ] [MAIN ] TME: Loaded 53201 primary data records. [2025-09-17T07:42:40.620112] [DEBUG] [MAIN ] TM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:40.621696] [INFO ] [MAIN ] TM: Generated 1794 derivative records from 37137 primary records. [2025-09-17T07:42:40.622257] [DEBUG] [LOCAL ] TM: Saving derivative data. [2025-09-17T07:42:40.641419] [DEBUG] [LOCAL ] TM: Derivative data saved (1794 records). [2025-09-17T07:42:40.642442] [INFO ] [MAIN ] TM: Successfully saved derivative data. [2025-09-17T07:42:40.645751] [INFO ] [MAIN ] Derivative Progress: 1925/2172 symbols completed. TM took 1.1s. Estimated remaining: 1m 33s. Rate: 160.2 symbols/min [2025-09-17T07:42:40.659291] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:40.660080] [DEBUG] [MAIN ] TMHC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:40.661508] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45641 primary records. [2025-09-17T07:42:40.669633] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-17T07:42:40.675728] [DEBUG] [MAIN ] TME: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:40.687504] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53201 primary records. [2025-09-17T07:42:40.688995] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-17T07:42:40.703320] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-09-17T07:42:40.704178] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-17T07:42:40.709021] [INFO ] [MAIN ] Derivative Progress: 1926/2172 symbols completed. TMHC took 1.1s. Estimated remaining: 1m 32s. Rate: 160.2 symbols/min [2025-09-17T07:42:40.710270] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:40.710656] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-09-17T07:42:40.711069] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-17T07:42:40.713439] [INFO ] [MAIN ] Derivative Progress: 1927/2172 symbols completed. TME took 1.2s. Estimated remaining: 1m 32s. Rate: 160.3 symbols/min [2025-09-17T07:42:40.714121] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:40.732382] [DEBUG] [LOCAL ] TNC: Loaded 15540 existing records from primary storage. [2025-09-17T07:42:40.732536] [INFO ] [MAIN ] TNC: Loaded 15540 primary data records. [2025-09-17T07:42:41.099949] [DEBUG] [LOCAL ] TNET: Loaded 29245 existing records from primary storage. [2025-09-17T07:42:41.100977] [DEBUG] [LOCAL ] TMO: Loaded 52386 existing records from primary storage. [2025-09-17T07:42:41.101352] [INFO ] [MAIN ] TNET: Loaded 29245 primary data records. [2025-09-17T07:42:41.101459] [INFO ] [MAIN ] TMO: Loaded 52386 primary data records. [2025-09-17T07:42:41.705218] [DEBUG] [MAIN ] TNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:41.706136] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 15540 primary records. [2025-09-17T07:42:41.708047] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-17T07:42:41.725172] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-09-17T07:42:41.725810] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-17T07:42:41.728165] [INFO ] [MAIN ] Derivative Progress: 1928/2172 symbols completed. TNC took 1.0s. Estimated remaining: 1m 31s. Rate: 160.2 symbols/min [2025-09-17T07:42:41.729080] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:41.747270] [DEBUG] [MAIN ] TNET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:41.760169] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 29245 primary records. [2025-09-17T07:42:41.760677] [DEBUG] [MAIN ] TMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:41.761447] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52386 primary records. [2025-09-17T07:42:41.760730] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-17T07:42:41.762287] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-17T07:42:41.789725] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-09-17T07:42:41.792216] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-17T07:42:41.794468] [INFO ] [MAIN ] Derivative Progress: 1929/2172 symbols completed. TNET took 1.1s. Estimated remaining: 1m 31s. Rate: 160.2 symbols/min [2025-09-17T07:42:41.795589] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:41.796035] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-09-17T07:42:41.796459] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-17T07:42:41.798886] [INFO ] [MAIN ] Derivative Progress: 1930/2172 symbols completed. TMO took 1.1s. Estimated remaining: 1m 31s. Rate: 160.3 symbols/min [2025-09-17T07:42:41.799145] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:41.825250] [DEBUG] [LOCAL ] TNK: Loaded 35484 existing records from primary storage. [2025-09-17T07:42:41.825577] [INFO ] [MAIN ] TNK: Loaded 35484 primary data records. [2025-09-17T07:42:42.070666] [DEBUG] [LOCAL ] TNL: Loaded 42031 existing records from primary storage. [2025-09-17T07:42:42.171575] [INFO ] [MAIN ] TNL: Loaded 42031 primary data records. [2025-09-17T07:42:42.203287] [DEBUG] [LOCAL ] TOL: Loaded 51126 existing records from primary storage. [2025-09-17T07:42:42.237361] [INFO ] [MAIN ] TOL: Loaded 51126 primary data records. [2025-09-17T07:42:42.849237] [DEBUG] [MAIN ] TNK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:42.850918] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35484 primary records. [2025-09-17T07:42:42.852554] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-17T07:42:42.872670] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-09-17T07:42:42.875337] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-17T07:42:42.878008] [INFO ] [MAIN ] Derivative Progress: 1931/2172 symbols completed. TNK took 1.1s. Estimated remaining: 1m 30s. Rate: 160.2 symbols/min [2025-09-17T07:42:42.878679] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:42.894751] [DEBUG] [MAIN ] TNL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:42.895938] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 42031 primary records. [2025-09-17T07:42:42.896318] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-17T07:42:42.912019] [DEBUG] [MAIN ] TOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:42.927165] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-09-17T07:42:42.928328] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 51126 primary records. [2025-09-17T07:42:42.927400] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-17T07:42:42.930927] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-17T07:42:42.930780] [INFO ] [MAIN ] Derivative Progress: 1932/2172 symbols completed. TNL took 1.1s. Estimated remaining: 1m 30s. Rate: 160.2 symbols/min [2025-09-17T07:42:42.932278] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:42.951470] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-09-17T07:42:42.951982] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-17T07:42:42.954900] [INFO ] [MAIN ] Derivative Progress: 1933/2172 symbols completed. TOL took 1.2s. Estimated remaining: 1m 29s. Rate: 160.3 symbols/min [2025-09-17T07:42:42.986432] [DEBUG] [LOCAL ] TPB: Loaded 24918 existing records from primary storage. [2025-09-17T07:42:42.987365] [INFO ] [MAIN ] TPB: Loaded 24918 primary data records. [2025-09-17T07:42:43.108970] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-17T07:42:43.109190] [INFO ] [MAIN ] TOST: Loaded 53681 primary data records. [2025-09-17T07:42:43.634875] [DEBUG] [MAIN ] TPB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:43.635806] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 24918 primary records. [2025-09-17T07:42:43.635966] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-17T07:42:43.653637] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-09-17T07:42:43.666102] [DEBUG] [MAIN ] TOST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:43.666150] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-17T07:42:43.668760] [INFO ] [MAIN ] Derivative Progress: 1934/2172 symbols completed. TPB took 0.7s. Estimated remaining: 1m 29s. Rate: 160.2 symbols/min [2025-09-17T07:42:43.666804] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53681 primary records. [2025-09-17T07:42:43.669096] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-17T07:42:43.684352] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-09-17T07:42:43.684427] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-17T07:42:43.686710] [INFO ] [MAIN ] Derivative Progress: 1935/2172 symbols completed. TOST took 0.8s. Estimated remaining: 1m 29s. Rate: 160.3 symbols/min [2025-09-17T07:42:43.687504] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:43.687567] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:43.687296] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:43.705533] [DEBUG] [LOCAL ] TPL: Loaded 12498 existing records from primary storage. [2025-09-17T07:42:43.705714] [INFO ] [MAIN ] TPL: Loaded 12498 primary data records. [2025-09-17T07:42:43.862554] [DEBUG] [LOCAL ] TPC: Loaded 39019 existing records from primary storage. [2025-09-17T07:42:43.912737] [INFO ] [MAIN ] TPC: Loaded 39019 primary data records. [2025-09-17T07:42:44.080773] [DEBUG] [LOCAL ] TPH: Loaded 45377 existing records from primary storage. [2025-09-17T07:42:44.106836] [INFO ] [MAIN ] TPH: Loaded 45377 primary data records. [2025-09-17T07:42:44.670839] [DEBUG] [MAIN ] TPL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:44.672623] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12498 primary records. [2025-09-17T07:42:44.673571] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-17T07:42:44.692143] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-09-17T07:42:44.692325] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-17T07:42:44.694568] [INFO ] [MAIN ] Derivative Progress: 1936/2172 symbols completed. TPL took 1.0s. Estimated remaining: 1m 28s. Rate: 160.2 symbols/min [2025-09-17T07:42:44.695122] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:44.712832] [DEBUG] [MAIN ] TPC: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:42:44.713622] [INFO ] [MAIN ] TPC: Generated 1793 derivative records from 39019 primary records. [2025-09-17T07:42:44.714261] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-17T07:42:44.740989] [DEBUG] [LOCAL ] TPC: Derivative data saved (1793 records). [2025-09-17T07:42:44.741545] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-17T07:42:44.743730] [INFO ] [MAIN ] Derivative Progress: 1937/2172 symbols completed. TPC took 1.1s. Estimated remaining: 1m 28s. Rate: 160.3 symbols/min [2025-09-17T07:42:44.757362] [DEBUG] [MAIN ] TPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:44.757569] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:44.758700] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 45377 primary records. [2025-09-17T07:42:44.759077] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-17T07:42:44.791152] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-09-17T07:42:44.791339] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-17T07:42:44.794166] [INFO ] [MAIN ] Derivative Progress: 1938/2172 symbols completed. TPH took 1.1s. Estimated remaining: 1m 28s. Rate: 160.3 symbols/min [2025-09-17T07:42:44.794920] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:44.821580] [DEBUG] [LOCAL ] TPR: Loaded 53489 existing records from primary storage. [2025-09-17T07:42:44.830609] [INFO ] [MAIN ] TPR: Loaded 53489 primary data records. [2025-09-17T07:42:44.867611] [DEBUG] [LOCAL ] TPYP: Loaded 8038 existing records from primary storage. [2025-09-17T07:42:44.846809] [DEBUG] [LOCAL ] TPVG: Loaded 27104 existing records from primary storage. [2025-09-17T07:42:44.885544] [INFO ] [MAIN ] TPYP: Loaded 8038 primary data records. [2025-09-17T07:42:44.912412] [INFO ] [MAIN ] TPVG: Loaded 27104 primary data records. [2025-09-17T07:42:45.808884] [DEBUG] [MAIN ] TPR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:45.809263] [DEBUG] [MAIN ] TPYP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:45.811323] [INFO ] [MAIN ] TPR: Generated 1794 derivative records from 53489 primary records. [2025-09-17T07:42:45.812013] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-17T07:42:45.811857] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 8038 primary records. [2025-09-17T07:42:45.812806] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-17T07:42:45.835153] [DEBUG] [MAIN ] TPVG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:45.853145] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-09-17T07:42:45.852634] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 27104 primary records. [2025-09-17T07:42:45.853580] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-17T07:42:45.855299] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-17T07:42:45.857985] [INFO ] [MAIN ] Derivative Progress: 1939/2172 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 27s. Rate: 160.2 symbols/min [2025-09-17T07:42:45.861568] [DEBUG] [LOCAL ] TPR: Derivative data saved (1794 records). [2025-09-17T07:42:45.869762] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-17T07:42:45.872345] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:45.876215] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-09-17T07:42:45.876323] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-17T07:42:45.878273] [INFO ] [MAIN ] Derivative Progress: 1940/2172 symbols completed. TPR took 1.2s. Estimated remaining: 1m 27s. Rate: 160.2 symbols/min [2025-09-17T07:42:45.881397] [INFO ] [MAIN ] Derivative Progress: 1941/2172 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 26s. Rate: 160.3 symbols/min [2025-09-17T07:42:45.881658] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:45.881718] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:45.888657] [DEBUG] [LOCAL ] TPZ: Loaded 5319 existing records from primary storage. [2025-09-17T07:42:45.888976] [INFO ] [MAIN ] TPZ: Loaded 5319 primary data records. [2025-09-17T07:42:46.001074] [DEBUG] [LOCAL ] TRAK: Loaded 9431 existing records from primary storage. [2025-09-17T07:42:46.027487] [INFO ] [MAIN ] TRAK: Loaded 9431 primary data records. [2025-09-17T07:42:46.223482] [DEBUG] [LOCAL ] TR: Loaded 18117 existing records from primary storage. [2025-09-17T07:42:46.246821] [INFO ] [MAIN ] TR: Loaded 18117 primary data records. [2025-09-17T07:42:46.863307] [DEBUG] [MAIN ] TPZ: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:42:46.865110] [INFO ] [MAIN ] TPZ: Generated 1793 derivative records from 5319 primary records. [2025-09-17T07:42:46.865272] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-17T07:42:46.883546] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1793 records). [2025-09-17T07:42:46.884176] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-17T07:42:46.886198] [INFO ] [MAIN ] Derivative Progress: 1942/2172 symbols completed. TPZ took 1.0s. Estimated remaining: 1m 26s. Rate: 160.2 symbols/min [2025-09-17T07:42:46.886771] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:46.903324] [DEBUG] [MAIN ] TRAK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:46.904827] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9431 primary records. [2025-09-17T07:42:46.905878] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-17T07:42:46.945163] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-09-17T07:42:46.944063] [DEBUG] [MAIN ] TR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:46.945394] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-17T07:42:46.946257] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18117 primary records. [2025-09-17T07:42:46.948568] [INFO ] [MAIN ] Derivative Progress: 1943/2172 symbols completed. TRAK took 1.1s. Estimated remaining: 1m 26s. Rate: 160.3 symbols/min [2025-09-17T07:42:46.949438] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:46.949141] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-17T07:42:46.955368] [DEBUG] [LOCAL ] TRC: Loaded 15940 existing records from primary storage. [2025-09-17T07:42:46.955769] [INFO ] [MAIN ] TRC: Loaded 15940 primary data records. [2025-09-17T07:42:47.075535] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-09-17T07:42:47.118320] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-17T07:42:47.147591] [INFO ] [MAIN ] Derivative Progress: 1944/2172 symbols completed. TR took 1.3s. Estimated remaining: 1m 25s. Rate: 160.3 symbols/min [2025-09-17T07:42:47.167081] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:47.309278] [DEBUG] [LOCAL ] TREX: Loaded 49979 existing records from primary storage. [2025-09-17T07:42:47.309770] [INFO ] [MAIN ] TREX: Loaded 49979 primary data records. [2025-09-17T07:42:47.671552] [DEBUG] [LOCAL ] TRGP: Loaded 50889 existing records from primary storage. [2025-09-17T07:42:47.671969] [DEBUG] [MAIN ] TRC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:47.672386] [INFO ] [MAIN ] TRGP: Loaded 50889 primary data records. [2025-09-17T07:42:47.673255] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15940 primary records. [2025-09-17T07:42:47.688599] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-17T07:42:47.766380] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-09-17T07:42:47.788547] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-17T07:42:47.808590] [INFO ] [MAIN ] Derivative Progress: 1945/2172 symbols completed. TRC took 0.9s. Estimated remaining: 1m 25s. Rate: 160.2 symbols/min [2025-09-17T07:42:47.809660] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:48.019858] [DEBUG] [MAIN ] TREX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:48.021809] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49979 primary records. [2025-09-17T07:42:48.022312] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-17T07:42:48.040048] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-09-17T07:42:48.041456] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-17T07:42:48.044067] [INFO ] [MAIN ] Derivative Progress: 1946/2172 symbols completed. TREX took 1.1s. Estimated remaining: 1m 25s. Rate: 160.3 symbols/min [2025-09-17T07:42:48.044502] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:48.074307] [DEBUG] [MAIN ] TRGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:48.086905] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50889 primary records. [2025-09-17T07:42:48.087006] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-17T07:42:48.087933] [DEBUG] [LOCAL ] TRNO: Loaded 44293 existing records from primary storage. [2025-09-17T07:42:48.088483] [INFO ] [MAIN ] TRNO: Loaded 44293 primary data records. [2025-09-17T07:42:48.158586] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-09-17T07:42:48.178826] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-17T07:42:48.200206] [INFO ] [MAIN ] Derivative Progress: 1947/2172 symbols completed. TRGP took 1.0s. Estimated remaining: 1m 24s. Rate: 160.3 symbols/min [2025-09-17T07:42:48.221435] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:48.429090] [DEBUG] [LOCAL ] TROX: Loaded 51715 existing records from primary storage. [2025-09-17T07:42:48.429476] [INFO ] [MAIN ] TROX: Loaded 51715 primary data records. [2025-09-17T07:42:48.802253] [DEBUG] [LOCAL ] TRP: Loaded 52181 existing records from primary storage. [2025-09-17T07:42:48.802682] [INFO ] [MAIN ] TRP: Loaded 52181 primary data records. [2025-09-17T07:42:49.124390] [DEBUG] [MAIN ] TRNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:49.125279] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 44293 primary records. [2025-09-17T07:42:49.125706] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-17T07:42:49.144987] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-09-17T07:42:49.146432] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-17T07:42:49.149042] [INFO ] [MAIN ] Derivative Progress: 1948/2172 symbols completed. TRNO took 1.3s. Estimated remaining: 1m 24s. Rate: 160.2 symbols/min [2025-09-17T07:42:49.165364] [DEBUG] [MAIN ] TROX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:49.166913] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 51715 primary records. [2025-09-17T07:42:49.167251] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-17T07:42:49.183789] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-09-17T07:42:49.184052] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-17T07:42:49.186706] [INFO ] [MAIN ] Derivative Progress: 1949/2172 symbols completed. TROX took 1.1s. Estimated remaining: 1m 23s. Rate: 160.3 symbols/min [2025-09-17T07:42:49.202181] [DEBUG] [MAIN ] TRP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:49.202936] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52181 primary records. [2025-09-17T07:42:49.203012] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-17T07:42:49.219142] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-09-17T07:42:49.219305] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-17T07:42:49.221358] [INFO ] [MAIN ] Derivative Progress: 1950/2172 symbols completed. TRP took 1.0s. Estimated remaining: 1m 23s. Rate: 160.3 symbols/min [2025-09-17T07:42:49.222247] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:49.222365] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:49.222036] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:49.275868] [DEBUG] [LOCAL ] TRTX: Loaded 37314 existing records from primary storage. [2025-09-17T07:42:49.276140] [INFO ] [MAIN ] TRTX: Loaded 37314 primary data records. [2025-09-17T07:42:49.415166] [DEBUG] [LOCAL ] TRU: Loaded 51160 existing records from primary storage. [2025-09-17T07:42:49.416071] [INFO ] [MAIN ] TRU: Loaded 51160 primary data records. [2025-09-17T07:42:49.563309] [DEBUG] [LOCAL ] TRV: Loaded 48449 existing records from primary storage. [2025-09-17T07:42:49.588943] [INFO ] [MAIN ] TRV: Loaded 48449 primary data records. [2025-09-17T07:42:50.259742] [DEBUG] [MAIN ] TRTX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:50.262415] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37314 primary records. [2025-09-17T07:42:50.263027] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-17T07:42:50.296081] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-09-17T07:42:50.298477] [DEBUG] [MAIN ] TRU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:50.298818] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-17T07:42:50.299685] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51160 primary records. [2025-09-17T07:42:50.299800] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-17T07:42:50.302070] [INFO ] [MAIN ] Derivative Progress: 1951/2172 symbols completed. TRTX took 1.1s. Estimated remaining: 1m 23s. Rate: 160.2 symbols/min [2025-09-17T07:42:50.315726] [INFO ] [MAIN ] TS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:50.316432] [DEBUG] [MAIN ] TRV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:50.328502] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 48449 primary records. [2025-09-17T07:42:50.328842] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-17T07:42:50.339322] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-09-17T07:42:50.355837] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-09-17T07:42:50.356011] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-17T07:42:50.356216] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-17T07:42:50.359581] [INFO ] [MAIN ] Derivative Progress: 1952/2172 symbols completed. TRU took 1.1s. Estimated remaining: 1m 22s. Rate: 160.3 symbols/min [2025-09-17T07:42:50.362867] [INFO ] [MAIN ] Derivative Progress: 1953/2172 symbols completed. TRV took 1.1s. Estimated remaining: 1m 22s. Rate: 160.3 symbols/min [2025-09-17T07:42:50.362782] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:50.363251] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:50.375676] [DEBUG] [LOCAL ] TSI: Loaded 8680 existing records from primary storage. [2025-09-17T07:42:50.375937] [INFO ] [MAIN ] TSI: Loaded 8680 primary data records. [2025-09-17T07:42:50.606946] [DEBUG] [LOCAL ] TSE: Loaded 29040 existing records from primary storage. [2025-09-17T07:42:50.610710] [INFO ] [MAIN ] TSE: Loaded 29040 primary data records. [2025-09-17T07:42:50.711377] [DEBUG] [LOCAL ] TS: Loaded 51706 existing records from primary storage. [2025-09-17T07:42:50.725967] [INFO ] [MAIN ] TS: Loaded 51706 primary data records. [2025-09-17T07:42:51.404239] [DEBUG] [MAIN ] TSI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:51.405552] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 8680 primary records. [2025-09-17T07:42:51.405744] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-17T07:42:51.422531] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-09-17T07:42:51.422906] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-17T07:42:51.425280] [INFO ] [MAIN ] Derivative Progress: 1954/2172 symbols completed. TSI took 1.1s. Estimated remaining: 1m 22s. Rate: 160.2 symbols/min [2025-09-17T07:42:51.426197] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:51.455168] [DEBUG] [MAIN ] TS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:51.462051] [INFO ] [MAIN ] TS: Generated 1794 derivative records from 51706 primary records. [2025-09-17T07:42:51.461205] [DEBUG] [MAIN ] TSE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:51.462205] [DEBUG] [LOCAL ] TS: Saving derivative data. [2025-09-17T07:42:51.462882] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 29040 primary records. [2025-09-17T07:42:51.463737] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-17T07:42:51.499593] [DEBUG] [LOCAL ] TS: Derivative data saved (1794 records). [2025-09-17T07:42:51.502574] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-09-17T07:42:51.501771] [INFO ] [MAIN ] TS: Successfully saved derivative data. [2025-09-17T07:42:51.502739] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-17T07:42:51.505262] [INFO ] [MAIN ] Derivative Progress: 1955/2172 symbols completed. TSE took 1.1s. Estimated remaining: 1m 21s. Rate: 160.2 symbols/min [2025-09-17T07:42:51.508929] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:51.509012] [INFO ] [MAIN ] Derivative Progress: 1956/2172 symbols completed. TS took 1.2s. Estimated remaining: 1m 21s. Rate: 160.3 symbols/min [2025-09-17T07:42:51.509394] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:51.521418] [DEBUG] [LOCAL ] TSLX: Loaded 35436 existing records from primary storage. [2025-09-17T07:42:51.521805] [INFO ] [MAIN ] TSLX: Loaded 35436 primary data records. [2025-09-17T07:42:51.906028] [DEBUG] [LOCAL ] TSN: Loaded 52836 existing records from primary storage. [2025-09-17T07:42:51.906124] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-17T07:42:51.907418] [INFO ] [MAIN ] TSN: Loaded 52836 primary data records. [2025-09-17T07:42:51.928451] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-09-17T07:42:52.401277] [DEBUG] [MAIN ] TSLX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:52.501594] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35436 primary records. [2025-09-17T07:42:52.516069] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-17T07:42:52.539607] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-09-17T07:42:52.539769] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-17T07:42:52.542042] [INFO ] [MAIN ] Derivative Progress: 1957/2172 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 21s. Rate: 160.2 symbols/min [2025-09-17T07:42:52.542849] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:52.560029] [DEBUG] [MAIN ] TSN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:52.564888] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 52836 primary records. [2025-09-17T07:42:52.565691] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-17T07:42:52.570794] [DEBUG] [LOCAL ] TSQ: Loaded 12055 existing records from primary storage. [2025-09-17T07:42:52.594384] [DEBUG] [MAIN ] TSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:52.594676] [INFO ] [MAIN ] TSQ: Loaded 12055 primary data records. [2025-09-17T07:42:52.596913] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-09-17T07:42:52.598849] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-09-17T07:42:52.609949] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-17T07:42:52.634288] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-17T07:42:52.698893] [INFO ] [MAIN ] Derivative Progress: 1958/2172 symbols completed. TSN took 1.2s. Estimated remaining: 1m 20s. Rate: 160.2 symbols/min [2025-09-17T07:42:52.714362] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:52.801131] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-09-17T07:42:52.941777] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-17T07:42:52.959682] [INFO ] [MAIN ] Derivative Progress: 1959/2172 symbols completed. TSM took 1.5s. Estimated remaining: 1m 20s. Rate: 160.3 symbols/min [2025-09-17T07:42:52.960253] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:53.004476] [DEBUG] [MAIN ] TSQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:53.014901] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 12055 primary records. [2025-09-17T07:42:53.015036] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-17T07:42:53.039465] [DEBUG] [LOCAL ] TT: Loaded 48061 existing records from primary storage. [2025-09-17T07:42:53.045856] [INFO ] [MAIN ] TT: Loaded 48061 primary data records. [2025-09-17T07:42:53.114808] [DEBUG] [LOCAL ] TTC: Loaded 43142 existing records from primary storage. [2025-09-17T07:42:53.116613] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-09-17T07:42:53.133049] [INFO ] [MAIN ] TTC: Loaded 43142 primary data records. [2025-09-17T07:42:53.155002] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-17T07:42:53.217925] [INFO ] [MAIN ] Derivative Progress: 1960/2172 symbols completed. TSQ took 0.7s. Estimated remaining: 1m 19s. Rate: 160.3 symbols/min [2025-09-17T07:42:53.282879] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:53.730450] [DEBUG] [MAIN ] TT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:53.744839] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 48061 primary records. [2025-09-17T07:42:53.746163] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-17T07:42:53.746083] [DEBUG] [LOCAL ] TTE: Loaded 51677 existing records from primary storage. [2025-09-17T07:42:53.747382] [INFO ] [MAIN ] TTE: Loaded 51677 primary data records. [2025-09-17T07:42:53.890441] [DEBUG] [MAIN ] TTC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:53.906049] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-09-17T07:42:53.920053] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-17T07:42:53.953107] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 43142 primary records. [2025-09-17T07:42:53.958122] [INFO ] [MAIN ] Derivative Progress: 1961/2172 symbols completed. TT took 1.2s. Estimated remaining: 1m 19s. Rate: 160.2 symbols/min [2025-09-17T07:42:54.070284] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:54.070371] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-17T07:42:54.090236] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-09-17T07:42:54.090944] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-17T07:42:54.093346] [INFO ] [MAIN ] Derivative Progress: 1962/2172 symbols completed. TTC took 1.1s. Estimated remaining: 1m 19s. Rate: 160.3 symbols/min [2025-09-17T07:42:54.093939] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:54.118545] [DEBUG] [MAIN ] TTE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:54.119473] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51677 primary records. [2025-09-17T07:42:54.119681] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-17T07:42:54.148705] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-09-17T07:42:54.161820] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-17T07:42:54.164155] [INFO ] [MAIN ] Derivative Progress: 1963/2172 symbols completed. TTE took 0.9s. Estimated remaining: 1m 18s. Rate: 160.3 symbols/min [2025-09-17T07:42:54.165526] [DEBUG] [LOCAL ] TTI: Loaded 45236 existing records from primary storage. [2025-09-17T07:42:54.165744] [INFO ] [MAIN ] TTI: Loaded 45236 primary data records. [2025-09-17T07:42:54.491612] [DEBUG] [LOCAL ] TU: Loaded 49987 existing records from primary storage. [2025-09-17T07:42:54.492167] [INFO ] [MAIN ] TU: Loaded 49987 primary data records. [2025-09-17T07:42:54.857754] [DEBUG] [MAIN ] TTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:54.858812] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 45236 primary records. [2025-09-17T07:42:54.859408] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-17T07:42:54.877585] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-09-17T07:42:54.877769] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-17T07:42:54.880295] [INFO ] [MAIN ] Derivative Progress: 1964/2172 symbols completed. TTI took 0.8s. Estimated remaining: 1m 18s. Rate: 160.2 symbols/min [2025-09-17T07:42:54.897144] [DEBUG] [MAIN ] TU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:54.897817] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49987 primary records. [2025-09-17T07:42:54.897895] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-17T07:42:54.913765] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-09-17T07:42:54.913857] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-17T07:42:54.915780] [INFO ] [MAIN ] Derivative Progress: 1965/2172 symbols completed. TU took 0.8s. Estimated remaining: 1m 17s. Rate: 160.3 symbols/min [2025-09-17T07:42:54.916418] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:54.916602] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:54.917037] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:54.923765] [DEBUG] [LOCAL ] TVC: Loaded 3570 existing records from primary storage. [2025-09-17T07:42:54.923941] [INFO ] [MAIN ] TVC: Loaded 3570 primary data records. [2025-09-17T07:42:55.267203] [DEBUG] [LOCAL ] TV: Loaded 43171 existing records from primary storage. [2025-09-17T07:42:55.268241] [DEBUG] [LOCAL ] TUYA: Loaded 46709 existing records from primary storage. [2025-09-17T07:42:55.268619] [INFO ] [MAIN ] TV: Loaded 43171 primary data records. [2025-09-17T07:42:55.268928] [INFO ] [MAIN ] TUYA: Loaded 46709 primary data records. [2025-09-17T07:42:55.914034] [DEBUG] [MAIN ] TVC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:55.916255] [INFO ] [MAIN ] TVC: Generated 1794 derivative records from 3570 primary records. [2025-09-17T07:42:55.916949] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-17T07:42:55.935431] [DEBUG] [LOCAL ] TVC: Derivative data saved (1794 records). [2025-09-17T07:42:55.936032] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-17T07:42:55.938018] [INFO ] [MAIN ] Derivative Progress: 1966/2172 symbols completed. TVC took 1.0s. Estimated remaining: 1m 17s. Rate: 160.2 symbols/min [2025-09-17T07:42:55.938572] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:55.945559] [DEBUG] [LOCAL ] TVE: Loaded 2870 existing records from primary storage. [2025-09-17T07:42:55.948003] [INFO ] [MAIN ] TVE: Loaded 2870 primary data records. [2025-09-17T07:42:56.034431] [DEBUG] [MAIN ] TV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:56.072845] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 43171 primary records. [2025-09-17T07:42:56.088802] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-17T07:42:56.088734] [DEBUG] [MAIN ] TUYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:56.100945] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 46709 primary records. [2025-09-17T07:42:56.144777] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-17T07:42:56.182782] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-09-17T07:42:56.182961] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-17T07:42:56.185343] [INFO ] [MAIN ] Derivative Progress: 1967/2172 symbols completed. TV took 1.3s. Estimated remaining: 1m 17s. Rate: 160.2 symbols/min [2025-09-17T07:42:56.298918] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:56.318847] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-09-17T07:42:56.319657] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-17T07:42:56.322450] [INFO ] [MAIN ] Derivative Progress: 1968/2172 symbols completed. TUYA took 1.4s. Estimated remaining: 1m 16s. Rate: 160.3 symbols/min [2025-09-17T07:42:56.322815] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:56.347723] [DEBUG] [MAIN ] TVE: Filtered 7001 bins outside market hours, 7826 incomplete bins [2025-09-17T07:42:56.360065] [INFO ] [MAIN ] TVE: Generated 1788 derivative records from 2870 primary records. [2025-09-17T07:42:56.360349] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-17T07:42:56.384295] [DEBUG] [LOCAL ] TWI: Loaded 35061 existing records from primary storage. [2025-09-17T07:42:56.385418] [INFO ] [MAIN ] TWI: Loaded 35061 primary data records. [2025-09-17T07:42:56.443152] [DEBUG] [LOCAL ] TVE: Derivative data saved (1788 records). [2025-09-17T07:42:56.481013] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-17T07:42:56.504702] [INFO ] [MAIN ] Derivative Progress: 1969/2172 symbols completed. TVE took 0.6s. Estimated remaining: 1m 16s. Rate: 160.3 symbols/min [2025-09-17T07:42:56.519231] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:56.540706] [DEBUG] [LOCAL ] TWLO: Loaded 52726 existing records from primary storage. [2025-09-17T07:42:56.575799] [INFO ] [MAIN ] TWLO: Loaded 52726 primary data records. [2025-09-17T07:42:56.775414] [DEBUG] [LOCAL ] TWN: Loaded 3344 existing records from primary storage. [2025-09-17T07:42:56.809743] [INFO ] [MAIN ] TWN: Loaded 3344 primary data records. [2025-09-17T07:42:57.368961] [DEBUG] [MAIN ] TWI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:57.370762] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 35061 primary records. [2025-09-17T07:42:57.372023] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-17T07:42:57.403181] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-09-17T07:42:57.403402] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-17T07:42:57.403098] [DEBUG] [MAIN ] TWLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:57.406132] [INFO ] [MAIN ] Derivative Progress: 1970/2172 symbols completed. TWI took 1.1s. Estimated remaining: 1m 16s. Rate: 160.2 symbols/min [2025-09-17T07:42:57.406988] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52726 primary records. [2025-09-17T07:42:57.407407] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:57.408806] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-17T07:42:57.435989] [DEBUG] [MAIN ] TWN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:57.438377] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3344 primary records. [2025-09-17T07:42:57.439678] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-17T07:42:57.440072] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-09-17T07:42:57.441008] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-17T07:42:57.443098] [INFO ] [MAIN ] Derivative Progress: 1971/2172 symbols completed. TWLO took 1.1s. Estimated remaining: 1m 15s. Rate: 160.3 symbols/min [2025-09-17T07:42:57.449306] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:57.456656] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-09-17T07:42:57.456784] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-17T07:42:57.459397] [INFO ] [MAIN ] Derivative Progress: 1972/2172 symbols completed. TWN took 0.9s. Estimated remaining: 1m 15s. Rate: 160.3 symbols/min [2025-09-17T07:42:57.460095] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:57.486220] [DEBUG] [LOCAL ] TX: Loaded 23964 existing records from primary storage. [2025-09-17T07:42:57.504308] [INFO ] [MAIN ] TX: Loaded 23964 primary data records. [2025-09-17T07:42:57.633128] [DEBUG] [LOCAL ] TWO: Loaded 48191 existing records from primary storage. [2025-09-17T07:42:57.634206] [DEBUG] [LOCAL ] TXNM: Loaded 44157 existing records from primary storage. [2025-09-17T07:42:57.649900] [INFO ] [MAIN ] TWO: Loaded 48191 primary data records. [2025-09-17T07:42:57.655130] [INFO ] [MAIN ] TXNM: Loaded 44157 primary data records. [2025-09-17T07:42:58.452187] [DEBUG] [MAIN ] TX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:58.453276] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23964 primary records. [2025-09-17T07:42:58.453416] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-17T07:42:58.471095] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-09-17T07:42:58.471390] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-17T07:42:58.473359] [INFO ] [MAIN ] Derivative Progress: 1973/2172 symbols completed. TX took 1.0s. Estimated remaining: 1m 15s. Rate: 160.2 symbols/min [2025-09-17T07:42:58.473888] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:58.501076] [DEBUG] [MAIN ] TWO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:58.506252] [DEBUG] [MAIN ] TXNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:58.511331] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48191 primary records. [2025-09-17T07:42:58.511926] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 44157 primary records. [2025-09-17T07:42:58.512046] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-17T07:42:58.512130] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-17T07:42:58.544237] [DEBUG] [LOCAL ] TXO: Loaded 18636 existing records from primary storage. [2025-09-17T07:42:58.547342] [INFO ] [MAIN ] TXO: Loaded 18636 primary data records. [2025-09-17T07:42:58.577837] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-09-17T07:42:58.595471] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-09-17T07:42:58.595553] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-17T07:42:58.595714] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-17T07:42:58.609554] [INFO ] [MAIN ] Derivative Progress: 1974/2172 symbols completed. TXNM took 1.1s. Estimated remaining: 1m 14s. Rate: 160.2 symbols/min [2025-09-17T07:42:58.632136] [INFO ] [MAIN ] Derivative Progress: 1975/2172 symbols completed. TWO took 1.2s. Estimated remaining: 1m 14s. Rate: 160.3 symbols/min [2025-09-17T07:42:58.626997] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:58.658754] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:58.876677] [DEBUG] [LOCAL ] TY: Loaded 7680 existing records from primary storage. [2025-09-17T07:42:58.876905] [INFO ] [MAIN ] TY: Loaded 7680 primary data records. [2025-09-17T07:42:59.195728] [DEBUG] [LOCAL ] TXT: Loaded 49827 existing records from primary storage. [2025-09-17T07:42:59.196968] [INFO ] [MAIN ] TXT: Loaded 49827 primary data records. [2025-09-17T07:42:59.361497] [DEBUG] [MAIN ] TXO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:59.396009] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 18636 primary records. [2025-09-17T07:42:59.511783] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-17T07:42:59.544546] [DEBUG] [MAIN ] TY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:59.544601] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-09-17T07:42:59.546073] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-17T07:42:59.548356] [INFO ] [MAIN ] Derivative Progress: 1976/2172 symbols completed. TXO took 1.1s. Estimated remaining: 1m 13s. Rate: 160.2 symbols/min [2025-09-17T07:42:59.548609] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:59.545882] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7680 primary records. [2025-09-17T07:42:59.548943] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-17T07:42:59.566153] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-09-17T07:42:59.566342] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-17T07:42:59.568305] [INFO ] [MAIN ] Derivative Progress: 1977/2172 symbols completed. TY took 0.9s. Estimated remaining: 1m 13s. Rate: 160.3 symbols/min [2025-09-17T07:42:59.569135] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:42:59.580066] [DEBUG] [LOCAL ] TYG: Loaded 14549 existing records from primary storage. [2025-09-17T07:42:59.580868] [INFO ] [MAIN ] TYG: Loaded 14549 primary data records. [2025-09-17T07:42:59.704277] [DEBUG] [MAIN ] TXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:42:59.731234] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49827 primary records. [2025-09-17T07:42:59.790358] [DEBUG] [LOCAL ] TYL: Loaded 22399 existing records from primary storage. [2025-09-17T07:42:59.770631] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-17T07:42:59.901010] [INFO ] [MAIN ] TYL: Loaded 22399 primary data records. [2025-09-17T07:43:00.099012] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-09-17T07:43:00.099256] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-17T07:43:00.197885] [INFO ] [MAIN ] Derivative Progress: 1978/2172 symbols completed. TXT took 1.6s. Estimated remaining: 1m 13s. Rate: 160.2 symbols/min [2025-09-17T07:43:00.232138] [DEBUG] [MAIN ] TYG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:00.232938] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 14549 primary records. [2025-09-17T07:43:00.233799] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-17T07:43:00.249424] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-09-17T07:43:00.249747] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-17T07:43:00.251844] [INFO ] [MAIN ] Derivative Progress: 1979/2172 symbols completed. TYG took 0.7s. Estimated remaining: 1m 12s. Rate: 160.3 symbols/min [2025-09-17T07:43:00.267424] [DEBUG] [MAIN ] TYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:00.268045] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22399 primary records. [2025-09-17T07:43:00.268136] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-17T07:43:00.283276] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-09-17T07:43:00.283353] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-17T07:43:00.285312] [INFO ] [MAIN ] Derivative Progress: 1980/2172 symbols completed. TYL took 0.7s. Estimated remaining: 1m 12s. Rate: 160.4 symbols/min [2025-09-17T07:43:00.285813] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:00.285886] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:00.286232] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:00.376085] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-17T07:43:00.389307] [DEBUG] [LOCAL ] UAA: Loaded 53514 existing records from primary storage. [2025-09-17T07:43:00.390420] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-09-17T07:43:00.391380] [DEBUG] [LOCAL ] UA: Loaded 50324 existing records from primary storage. [2025-09-17T07:43:00.390659] [INFO ] [MAIN ] UAA: Loaded 53514 primary data records. [2025-09-17T07:43:00.412714] [INFO ] [MAIN ] UA: Loaded 50324 primary data records. [2025-09-17T07:43:01.376274] [DEBUG] [MAIN ] UA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:01.386836] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50324 primary records. [2025-09-17T07:43:01.391691] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-17T07:43:01.398111] [DEBUG] [MAIN ] U: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:01.421912] [DEBUG] [MAIN ] UAA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:01.420435] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-09-17T07:43:01.426755] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-17T07:43:01.425384] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53514 primary records. [2025-09-17T07:43:01.430393] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-17T07:43:01.432566] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-09-17T07:43:01.440758] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-17T07:43:01.462479] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-09-17T07:43:01.464791] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-17T07:43:01.461556] [INFO ] [MAIN ] Derivative Progress: 1981/2172 symbols completed. UA took 1.2s. Estimated remaining: 1m 12s. Rate: 160.2 symbols/min [2025-09-17T07:43:01.469186] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:01.469071] [INFO ] [MAIN ] Derivative Progress: 1982/2172 symbols completed. U took 1.2s. Estimated remaining: 1m 11s. Rate: 160.3 symbols/min [2025-09-17T07:43:01.469720] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-09-17T07:43:01.470237] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:01.470835] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-17T07:43:01.473717] [INFO ] [MAIN ] Derivative Progress: 1983/2172 symbols completed. UAA took 1.2s. Estimated remaining: 1m 11s. Rate: 160.4 symbols/min [2025-09-17T07:43:01.474554] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:01.483727] [DEBUG] [LOCAL ] UAN: Loaded 5534 existing records from primary storage. [2025-09-17T07:43:01.484004] [INFO ] [MAIN ] UAN: Loaded 5534 primary data records. [2025-09-17T07:43:01.845300] [DEBUG] [LOCAL ] UBS: Loaded 52518 existing records from primary storage. [2025-09-17T07:43:01.845703] [INFO ] [MAIN ] UBS: Loaded 52518 primary data records. [2025-09-17T07:43:01.847153] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-17T07:43:01.853262] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-09-17T07:43:02.539789] [DEBUG] [MAIN ] UAN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:02.541143] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5534 primary records. [2025-09-17T07:43:02.541549] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-17T07:43:02.559427] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-09-17T07:43:02.559813] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-17T07:43:02.561915] [INFO ] [MAIN ] Derivative Progress: 1984/2172 symbols completed. UAN took 1.1s. Estimated remaining: 1m 10s. Rate: 160.2 symbols/min [2025-09-17T07:43:02.562843] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:02.583751] [DEBUG] [MAIN ] UBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:02.592552] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52518 primary records. [2025-09-17T07:43:02.598097] [DEBUG] [MAIN ] UBER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:02.598389] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-17T07:43:02.599144] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-09-17T07:43:02.599739] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-17T07:43:02.637130] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-09-17T07:43:02.639565] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-17T07:43:02.643278] [INFO ] [MAIN ] Derivative Progress: 1985/2172 symbols completed. UBER took 1.2s. Estimated remaining: 1m 10s. Rate: 160.3 symbols/min [2025-09-17T07:43:02.644549] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-09-17T07:43:02.644814] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:02.645042] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-17T07:43:02.658979] [INFO ] [MAIN ] Derivative Progress: 1986/2172 symbols completed. UBS took 1.2s. Estimated remaining: 1m 10s. Rate: 160.3 symbols/min [2025-09-17T07:43:02.659975] [DEBUG] [LOCAL ] UCB: Loaded 38163 existing records from primary storage. [2025-09-17T07:43:02.660177] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:02.660309] [INFO ] [MAIN ] UCB: Loaded 38163 primary data records. [2025-09-17T07:43:03.027421] [DEBUG] [LOCAL ] UDR: Loaded 51800 existing records from primary storage. [2025-09-17T07:43:03.028245] [INFO ] [MAIN ] UDR: Loaded 51800 primary data records. [2025-09-17T07:43:03.028872] [DEBUG] [LOCAL ] UE: Loaded 43085 existing records from primary storage. [2025-09-17T07:43:03.029194] [INFO ] [MAIN ] UE: Loaded 43085 primary data records. [2025-09-17T07:43:03.655935] [DEBUG] [MAIN ] UCB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:03.658116] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 38163 primary records. [2025-09-17T07:43:03.659086] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-17T07:43:03.676803] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-09-17T07:43:03.676949] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-17T07:43:03.679406] [INFO ] [MAIN ] Derivative Progress: 1987/2172 symbols completed. UCB took 1.1s. Estimated remaining: 1m 9s. Rate: 160.2 symbols/min [2025-09-17T07:43:03.680445] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:03.707878] [DEBUG] [LOCAL ] UFI: Loaded 8273 existing records from primary storage. [2025-09-17T07:43:03.716396] [INFO ] [MAIN ] UFI: Loaded 8273 primary data records. [2025-09-17T07:43:03.708402] [DEBUG] [MAIN ] UDR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:03.722227] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 51800 primary records. [2025-09-17T07:43:03.737548] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-17T07:43:03.737441] [DEBUG] [MAIN ] UE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:03.771243] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 43085 primary records. [2025-09-17T07:43:03.794683] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-17T07:43:03.885379] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-09-17T07:43:03.896559] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-17T07:43:03.898403] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-09-17T07:43:03.900905] [INFO ] [MAIN ] Derivative Progress: 1988/2172 symbols completed. UE took 1.2s. Estimated remaining: 1m 9s. Rate: 160.2 symbols/min [2025-09-17T07:43:03.936000] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-17T07:43:03.950220] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:03.957750] [INFO ] [MAIN ] Derivative Progress: 1989/2172 symbols completed. UDR took 1.3s. Estimated remaining: 1m 8s. Rate: 160.3 symbols/min [2025-09-17T07:43:03.958217] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:04.138195] [DEBUG] [MAIN ] UFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:04.140312] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8273 primary records. [2025-09-17T07:43:04.140677] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-17T07:43:04.191755] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-09-17T07:43:04.192137] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-17T07:43:04.194605] [INFO ] [MAIN ] Derivative Progress: 1990/2172 symbols completed. UFI took 0.5s. Estimated remaining: 1m 8s. Rate: 160.3 symbols/min [2025-09-17T07:43:04.195260] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:04.196899] [DEBUG] [LOCAL ] UGP: Loaded 42658 existing records from primary storage. [2025-09-17T07:43:04.197669] [INFO ] [MAIN ] UGP: Loaded 42658 primary data records. [2025-09-17T07:43:04.316441] [DEBUG] [LOCAL ] UGI: Loaded 50537 existing records from primary storage. [2025-09-17T07:43:04.353513] [DEBUG] [LOCAL ] UHAL: Loaded 16291 existing records from primary storage. [2025-09-17T07:43:04.354025] [INFO ] [MAIN ] UGI: Loaded 50537 primary data records. [2025-09-17T07:43:04.370064] [INFO ] [MAIN ] UHAL: Loaded 16291 primary data records. [2025-09-17T07:43:05.346941] [DEBUG] [MAIN ] UGP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:05.348217] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42658 primary records. [2025-09-17T07:43:05.348402] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-17T07:43:05.383920] [DEBUG] [MAIN ] UHAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:05.384480] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-09-17T07:43:05.385346] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16291 primary records. [2025-09-17T07:43:05.397958] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-17T07:43:05.398345] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-17T07:43:05.398296] [DEBUG] [MAIN ] UGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:05.402138] [INFO ] [MAIN ] Derivative Progress: 1991/2172 symbols completed. UGP took 1.4s. Estimated remaining: 1m 8s. Rate: 160.2 symbols/min [2025-09-17T07:43:05.403218] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50537 primary records. [2025-09-17T07:43:05.403414] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:05.414742] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-17T07:43:05.432633] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-09-17T07:43:05.434016] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-17T07:43:05.435862] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-09-17T07:43:05.437889] [INFO ] [MAIN ] Derivative Progress: 1992/2172 symbols completed. UHAL took 1.2s. Estimated remaining: 1m 7s. Rate: 160.2 symbols/min [2025-09-17T07:43:05.438225] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:05.438395] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-17T07:43:05.441008] [INFO ] [MAIN ] Derivative Progress: 1993/2172 symbols completed. UGI took 1.5s. Estimated remaining: 1m 7s. Rate: 160.3 symbols/min [2025-09-17T07:43:05.457814] [DEBUG] [LOCAL ] UHT: Loaded 10008 existing records from primary storage. [2025-09-17T07:43:05.458128] [INFO ] [MAIN ] UHT: Loaded 10008 primary data records. [2025-09-17T07:43:05.608220] [DEBUG] [LOCAL ] UHS: Loaded 41601 existing records from primary storage. [2025-09-17T07:43:05.637693] [INFO ] [MAIN ] UHS: Loaded 41601 primary data records. [2025-09-17T07:43:06.121423] [DEBUG] [MAIN ] UHT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:06.122238] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 10008 primary records. [2025-09-17T07:43:06.122533] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-17T07:43:06.139596] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-09-17T07:43:06.139785] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-17T07:43:06.142185] [INFO ] [MAIN ] Derivative Progress: 1994/2172 symbols completed. UHT took 0.7s. Estimated remaining: 1m 7s. Rate: 160.2 symbols/min [2025-09-17T07:43:06.157768] [DEBUG] [MAIN ] UHS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:06.158367] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 41601 primary records. [2025-09-17T07:43:06.158441] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-17T07:43:06.174558] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-09-17T07:43:06.174661] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-17T07:43:06.176683] [INFO ] [MAIN ] Derivative Progress: 1995/2172 symbols completed. UHS took 0.8s. Estimated remaining: 1m 6s. Rate: 160.3 symbols/min [2025-09-17T07:43:06.177561] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:06.177362] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:06.178207] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:06.195675] [DEBUG] [LOCAL ] UI: Loaded 12584 existing records from primary storage. [2025-09-17T07:43:06.195887] [INFO ] [MAIN ] UI: Loaded 12584 primary data records. [2025-09-17T07:43:06.379792] [DEBUG] [LOCAL ] UIS: Loaded 37298 existing records from primary storage. [2025-09-17T07:43:06.419025] [INFO ] [MAIN ] UIS: Loaded 37298 primary data records. [2025-09-17T07:43:06.602832] [DEBUG] [LOCAL ] UL: Loaded 53076 existing records from primary storage. [2025-09-17T07:43:06.644815] [INFO ] [MAIN ] UL: Loaded 53076 primary data records. [2025-09-17T07:43:07.261902] [DEBUG] [MAIN ] UI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:07.263378] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 12584 primary records. [2025-09-17T07:43:07.264355] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-17T07:43:07.283551] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-09-17T07:43:07.284001] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-17T07:43:07.286178] [INFO ] [MAIN ] Derivative Progress: 1996/2172 symbols completed. UI took 1.1s. Estimated remaining: 1m 6s. Rate: 160.2 symbols/min [2025-09-17T07:43:07.286849] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:07.320384] [DEBUG] [MAIN ] UL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:07.321688] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53076 primary records. [2025-09-17T07:43:07.321828] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-17T07:43:07.322115] [DEBUG] [MAIN ] UIS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:07.323127] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 37298 primary records. [2025-09-17T07:43:07.323710] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-17T07:43:07.355098] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-09-17T07:43:07.364750] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-17T07:43:07.369976] [INFO ] [MAIN ] Derivative Progress: 1997/2172 symbols completed. UIS took 1.2s. Estimated remaining: 1m 6s. Rate: 160.2 symbols/min [2025-09-17T07:43:07.370623] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-09-17T07:43:07.370971] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:07.371034] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-17T07:43:07.373679] [INFO ] [MAIN ] Derivative Progress: 1998/2172 symbols completed. UL took 1.2s. Estimated remaining: 1m 5s. Rate: 160.3 symbols/min [2025-09-17T07:43:07.374157] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:07.389417] [DEBUG] [LOCAL ] ULS: Loaded 39229 existing records from primary storage. [2025-09-17T07:43:07.389663] [INFO ] [MAIN ] ULS: Loaded 39229 primary data records. [2025-09-17T07:43:07.739922] [DEBUG] [LOCAL ] UMH: Loaded 32897 existing records from primary storage. [2025-09-17T07:43:07.740960] [DEBUG] [LOCAL ] UMC: Loaded 52736 existing records from primary storage. [2025-09-17T07:43:07.740230] [INFO ] [MAIN ] UMH: Loaded 32897 primary data records. [2025-09-17T07:43:07.741750] [INFO ] [MAIN ] UMC: Loaded 52736 primary data records. [2025-09-17T07:43:08.372693] [DEBUG] [MAIN ] ULS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:08.375079] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39229 primary records. [2025-09-17T07:43:08.375519] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-17T07:43:08.396150] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-09-17T07:43:08.409276] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-17T07:43:08.409616] [DEBUG] [MAIN ] UMH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:08.412148] [INFO ] [MAIN ] Derivative Progress: 1999/2172 symbols completed. ULS took 1.1s. Estimated remaining: 1m 5s. Rate: 160.2 symbols/min [2025-09-17T07:43:08.412985] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 32897 primary records. [2025-09-17T07:43:08.413670] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-17T07:43:08.413424] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:08.432158] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-09-17T07:43:08.434093] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-17T07:43:08.436291] [INFO ] [MAIN ] Derivative Progress: 2000/2172 symbols completed. UMH took 1.1s. Estimated remaining: 1m 4s. Rate: 160.2 symbols/min [2025-09-17T07:43:08.436893] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:08.453871] [DEBUG] [MAIN ] UMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:08.454792] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52736 primary records. [2025-09-17T07:43:08.455013] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-17T07:43:08.472289] [DEBUG] [LOCAL ] UNF: Loaded 11770 existing records from primary storage. [2025-09-17T07:43:08.477000] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-09-17T07:43:08.477521] [INFO ] [MAIN ] UNF: Loaded 11770 primary data records. [2025-09-17T07:43:08.477893] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-17T07:43:08.493554] [INFO ] [MAIN ] Derivative Progress: 2001/2172 symbols completed. UMC took 1.1s. Estimated remaining: 1m 4s. Rate: 160.3 symbols/min [2025-09-17T07:43:08.523374] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:08.690977] [DEBUG] [LOCAL ] UNFI: Loaded 41886 existing records from primary storage. [2025-09-17T07:43:08.719492] [INFO ] [MAIN ] UNFI: Loaded 41886 primary data records. [2025-09-17T07:43:09.097553] [DEBUG] [LOCAL ] UNH: Loaded 53793 existing records from primary storage. [2025-09-17T07:43:09.232557] [INFO ] [MAIN ] UNH: Loaded 53793 primary data records. [2025-09-17T07:43:09.553233] [DEBUG] [MAIN ] UNF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:09.569267] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 11770 primary records. [2025-09-17T07:43:09.570474] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-17T07:43:09.591029] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-09-17T07:43:09.604551] [DEBUG] [MAIN ] UNFI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:09.604663] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-17T07:43:09.605378] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 41886 primary records. [2025-09-17T07:43:09.607332] [INFO ] [MAIN ] Derivative Progress: 2002/2172 symbols completed. UNF took 1.2s. Estimated remaining: 1m 4s. Rate: 160.1 symbols/min [2025-09-17T07:43:09.607714] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-17T07:43:09.610509] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:09.628121] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-09-17T07:43:09.628311] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-17T07:43:09.630596] [INFO ] [MAIN ] Derivative Progress: 2003/2172 symbols completed. UNFI took 1.2s. Estimated remaining: 1m 3s. Rate: 160.2 symbols/min [2025-09-17T07:43:09.631563] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:09.642899] [DEBUG] [LOCAL ] UNMA: Loaded 3766 existing records from primary storage. [2025-09-17T07:43:09.643131] [INFO ] [MAIN ] UNMA: Loaded 3766 primary data records. [2025-09-17T07:43:09.698856] [DEBUG] [MAIN ] UNH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:09.735049] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53793 primary records. [2025-09-17T07:43:09.780823] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-17T07:43:09.893445] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-09-17T07:43:10.007943] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-17T07:43:10.009384] [DEBUG] [LOCAL ] UNM: Loaded 48832 existing records from primary storage. [2025-09-17T07:43:10.011986] [INFO ] [MAIN ] Derivative Progress: 2004/2172 symbols completed. UNH took 1.5s. Estimated remaining: 1m 3s. Rate: 160.2 symbols/min [2025-09-17T07:43:10.012422] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:10.012515] [INFO ] [MAIN ] UNM: Loaded 48832 primary data records. [2025-09-17T07:43:10.366333] [DEBUG] [MAIN ] UNMA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:10.367288] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3766 primary records. [2025-09-17T07:43:10.367749] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-17T07:43:10.384561] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-09-17T07:43:10.398959] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-17T07:43:10.402409] [DEBUG] [LOCAL ] UNP: Loaded 53215 existing records from primary storage. [2025-09-17T07:43:10.401312] [INFO ] [MAIN ] Derivative Progress: 2005/2172 symbols completed. UNMA took 0.8s. Estimated remaining: 1m 3s. Rate: 160.2 symbols/min [2025-09-17T07:43:10.402966] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:10.403027] [INFO ] [MAIN ] UNP: Loaded 53215 primary data records. [2025-09-17T07:43:10.719106] [DEBUG] [MAIN ] UNM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:10.734712] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48832 primary records. [2025-09-17T07:43:10.735090] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-17T07:43:10.753211] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-09-17T07:43:10.754773] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-17T07:43:10.761797] [INFO ] [MAIN ] Derivative Progress: 2006/2172 symbols completed. UNM took 1.2s. Estimated remaining: 1m 2s. Rate: 160.2 symbols/min [2025-09-17T07:43:10.762271] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:10.782058] [DEBUG] [LOCAL ] UPS: Loaded 53710 existing records from primary storage. [2025-09-17T07:43:10.782517] [INFO ] [MAIN ] UPS: Loaded 53710 primary data records. [2025-09-17T07:43:11.140719] [DEBUG] [MAIN ] UNP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:11.151686] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53215 primary records. [2025-09-17T07:43:11.151865] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-17T07:43:11.152504] [DEBUG] [LOCAL ] URI: Loaded 36877 existing records from primary storage. [2025-09-17T07:43:11.153367] [INFO ] [MAIN ] URI: Loaded 36877 primary data records. [2025-09-17T07:43:11.216110] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-09-17T07:43:11.228956] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-17T07:43:11.280227] [INFO ] [MAIN ] Derivative Progress: 2007/2172 symbols completed. UNP took 1.3s. Estimated remaining: 1m 2s. Rate: 160.2 symbols/min [2025-09-17T07:43:11.297588] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:11.505504] [DEBUG] [MAIN ] UPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:11.506544] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53710 primary records. [2025-09-17T07:43:11.507005] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-17T07:43:11.534850] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-09-17T07:43:11.535279] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-17T07:43:11.537255] [INFO ] [MAIN ] Derivative Progress: 2008/2172 symbols completed. UPS took 1.1s. Estimated remaining: 1m 1s. Rate: 160.2 symbols/min [2025-09-17T07:43:11.549675] [DEBUG] [LOCAL ] USA: Loaded 36134 existing records from primary storage. [2025-09-17T07:43:11.550112] [INFO ] [MAIN ] USA: Loaded 36134 primary data records. [2025-09-17T07:43:11.699443] [DEBUG] [MAIN ] URI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:11.756095] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 36877 primary records. [2025-09-17T07:43:11.762275] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-17T07:43:11.897880] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-09-17T07:43:11.898479] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-17T07:43:11.900827] [INFO ] [MAIN ] Derivative Progress: 2009/2172 symbols completed. URI took 1.1s. Estimated remaining: 1m 1s. Rate: 160.2 symbols/min [2025-09-17T07:43:11.920215] [DEBUG] [MAIN ] USA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:11.920995] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 36134 primary records. [2025-09-17T07:43:11.921081] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-17T07:43:11.936744] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-09-17T07:43:11.936832] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-17T07:43:11.938793] [INFO ] [MAIN ] Derivative Progress: 2010/2172 symbols completed. USA took 0.6s. Estimated remaining: 1m 1s. Rate: 160.3 symbols/min [2025-09-17T07:43:11.939337] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:11.939585] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:11.939517] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:11.963176] [DEBUG] [LOCAL ] USAC: Loaded 22930 existing records from primary storage. [2025-09-17T07:43:11.963418] [INFO ] [MAIN ] USAC: Loaded 22930 primary data records. [2025-09-17T07:43:12.205831] [DEBUG] [LOCAL ] USFD: Loaded 51317 existing records from primary storage. [2025-09-17T07:43:12.303472] [INFO ] [MAIN ] USFD: Loaded 51317 primary data records. [2025-09-17T07:43:12.319199] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-17T07:43:12.332350] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-09-17T07:43:12.988013] [DEBUG] [MAIN ] USAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:12.989963] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 22930 primary records. [2025-09-17T07:43:12.991338] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-17T07:43:13.009936] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-09-17T07:43:13.010976] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-17T07:43:13.012996] [INFO ] [MAIN ] Derivative Progress: 2011/2172 symbols completed. USAC took 1.1s. Estimated remaining: 1m 0s. Rate: 160.1 symbols/min [2025-09-17T07:43:13.013922] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:13.034995] [DEBUG] [MAIN ] USB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:13.053200] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-09-17T07:43:13.053329] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-17T07:43:13.054335] [DEBUG] [MAIN ] USFD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:13.055172] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51317 primary records. [2025-09-17T07:43:13.066937] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-17T07:43:13.077278] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-09-17T07:43:13.079272] [DEBUG] [LOCAL ] USNA: Loaded 18532 existing records from primary storage. [2025-09-17T07:43:13.079384] [INFO ] [MAIN ] USNA: Loaded 18532 primary data records. [2025-09-17T07:43:13.079635] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-17T07:43:13.102332] [INFO ] [MAIN ] Derivative Progress: 2012/2172 symbols completed. USB took 1.2s. Estimated remaining: 59.9s. Rate: 160.2 symbols/min [2025-09-17T07:43:13.144680] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:13.173697] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-09-17T07:43:13.184168] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-17T07:43:13.203714] [INFO ] [MAIN ] Derivative Progress: 2013/2172 symbols completed. USFD took 1.3s. Estimated remaining: 59.5s. Rate: 160.3 symbols/min [2025-09-17T07:43:13.204784] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:13.429934] [DEBUG] [LOCAL ] USPH: Loaded 16762 existing records from primary storage. [2025-09-17T07:43:13.430736] [INFO ] [MAIN ] USPH: Loaded 16762 primary data records. [2025-09-17T07:43:13.553944] [DEBUG] [LOCAL ] UTF: Loaded 28029 existing records from primary storage. [2025-09-17T07:43:13.554633] [INFO ] [MAIN ] UTF: Loaded 28029 primary data records. [2025-09-17T07:43:13.953602] [DEBUG] [MAIN ] USNA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:14.073113] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 18532 primary records. [2025-09-17T07:43:14.073380] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-17T07:43:14.097126] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-09-17T07:43:14.098456] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-17T07:43:14.101195] [INFO ] [MAIN ] Derivative Progress: 2014/2172 symbols completed. USNA took 1.1s. Estimated remaining: 59.2s. Rate: 160.1 symbols/min [2025-09-17T07:43:14.102575] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:14.118369] [DEBUG] [MAIN ] USPH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:14.119210] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 16762 primary records. [2025-09-17T07:43:14.119579] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-17T07:43:14.137682] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-09-17T07:43:14.137988] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-17T07:43:14.153512] [INFO ] [MAIN ] Derivative Progress: 2015/2172 symbols completed. USPH took 1.0s. Estimated remaining: 58.8s. Rate: 160.2 symbols/min [2025-09-17T07:43:14.151045] [DEBUG] [MAIN ] UTF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:14.154513] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 28029 primary records. [2025-09-17T07:43:14.154722] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:14.156304] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-17T07:43:14.173515] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-09-17T07:43:14.183722] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-17T07:43:14.186081] [INFO ] [MAIN ] Derivative Progress: 2016/2172 symbols completed. UTF took 1.0s. Estimated remaining: 58.4s. Rate: 160.3 symbols/min [2025-09-17T07:43:14.186505] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:14.194591] [DEBUG] [LOCAL ] UTL: Loaded 10762 existing records from primary storage. [2025-09-17T07:43:14.194781] [INFO ] [MAIN ] UTL: Loaded 10762 primary data records. [2025-09-17T07:43:14.316879] [DEBUG] [LOCAL ] UTI: Loaded 40724 existing records from primary storage. [2025-09-17T07:43:14.338241] [INFO ] [MAIN ] UTI: Loaded 40724 primary data records. [2025-09-17T07:43:14.411624] [DEBUG] [LOCAL ] UVE: Loaded 21898 existing records from primary storage. [2025-09-17T07:43:14.544799] [INFO ] [MAIN ] UVE: Loaded 21898 primary data records. [2025-09-17T07:43:15.165948] [DEBUG] [MAIN ] UTL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:15.167559] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 10762 primary records. [2025-09-17T07:43:15.167925] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-17T07:43:15.186987] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-09-17T07:43:15.187815] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-17T07:43:15.190056] [INFO ] [MAIN ] Derivative Progress: 2017/2172 symbols completed. UTL took 1.0s. Estimated remaining: 58.1s. Rate: 160.1 symbols/min [2025-09-17T07:43:15.190469] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:15.204184] [DEBUG] [MAIN ] UTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:15.204914] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40724 primary records. [2025-09-17T07:43:15.205280] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-17T07:43:15.229153] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-09-17T07:43:15.242126] [DEBUG] [MAIN ] UVE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:15.242211] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-17T07:43:15.242870] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21898 primary records. [2025-09-17T07:43:15.245276] [INFO ] [MAIN ] Derivative Progress: 2018/2172 symbols completed. UTI took 1.1s. Estimated remaining: 57.7s. Rate: 160.2 symbols/min [2025-09-17T07:43:15.243052] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-17T07:43:15.246040] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:15.253816] [DEBUG] [LOCAL ] UVV: Loaded 22132 existing records from primary storage. [2025-09-17T07:43:15.254483] [INFO ] [MAIN ] UVV: Loaded 22132 primary data records. [2025-09-17T07:43:15.373976] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-09-17T07:43:15.400589] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-17T07:43:15.417416] [INFO ] [MAIN ] Derivative Progress: 2019/2172 symbols completed. UVE took 1.2s. Estimated remaining: 57.3s. Rate: 160.3 symbols/min [2025-09-17T07:43:15.452396] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:15.589950] [DEBUG] [LOCAL ] UZD: Loaded 6403 existing records from primary storage. [2025-09-17T07:43:15.590224] [INFO ] [MAIN ] UZD: Loaded 6403 primary data records. [2025-09-17T07:43:15.716249] [DEBUG] [LOCAL ] UWMC: Loaded 52705 existing records from primary storage. [2025-09-17T07:43:15.722463] [INFO ] [MAIN ] UWMC: Loaded 52705 primary data records. [2025-09-17T07:43:16.041415] [DEBUG] [MAIN ] UVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:16.094986] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22132 primary records. [2025-09-17T07:43:16.100965] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-17T07:43:16.251804] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-09-17T07:43:16.252242] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-17T07:43:16.254303] [INFO ] [MAIN ] Derivative Progress: 2020/2172 symbols completed. UVV took 1.1s. Estimated remaining: 56.9s. Rate: 160.2 symbols/min [2025-09-17T07:43:16.255463] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:16.278666] [DEBUG] [MAIN ] UZD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:16.282233] [DEBUG] [LOCAL ] UZE: Loaded 7506 existing records from primary storage. [2025-09-17T07:43:16.283119] [INFO ] [MAIN ] UZD: Generated 1794 derivative records from 6403 primary records. [2025-09-17T07:43:16.283437] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-17T07:43:16.283184] [INFO ] [MAIN ] UZE: Loaded 7506 primary data records. [2025-09-17T07:43:16.401940] [DEBUG] [LOCAL ] UZD: Derivative data saved (1794 records). [2025-09-17T07:43:16.402233] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-17T07:43:16.432620] [INFO ] [MAIN ] Derivative Progress: 2021/2172 symbols completed. UZD took 1.0s. Estimated remaining: 56.6s. Rate: 160.2 symbols/min [2025-09-17T07:43:16.443799] [DEBUG] [MAIN ] UWMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:16.443367] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:16.460150] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52705 primary records. [2025-09-17T07:43:16.500246] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-17T07:43:16.683068] [DEBUG] [LOCAL ] UZF: Loaded 6559 existing records from primary storage. [2025-09-17T07:43:16.688883] [INFO ] [MAIN ] UZF: Loaded 6559 primary data records. [2025-09-17T07:43:16.690864] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-09-17T07:43:16.729783] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-17T07:43:16.766932] [INFO ] [MAIN ] Derivative Progress: 2022/2172 symbols completed. UWMC took 1.5s. Estimated remaining: 56.2s. Rate: 160.2 symbols/min [2025-09-17T07:43:16.792415] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:17.026620] [DEBUG] [MAIN ] UZE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:17.028262] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7506 primary records. [2025-09-17T07:43:17.029066] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-17T07:43:17.063426] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-09-17T07:43:17.063608] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-17T07:43:17.067333] [INFO ] [MAIN ] Derivative Progress: 2023/2172 symbols completed. UZE took 0.8s. Estimated remaining: 55.8s. Rate: 160.2 symbols/min [2025-09-17T07:43:17.085819] [DEBUG] [LOCAL ] V: Loaded 53763 existing records from primary storage. [2025-09-17T07:43:17.086231] [INFO ] [MAIN ] V: Loaded 53763 primary data records. [2025-09-17T07:43:17.226496] [DEBUG] [MAIN ] UZF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:17.256811] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6559 primary records. [2025-09-17T07:43:17.276148] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-17T07:43:17.405704] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-09-17T07:43:17.406260] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-17T07:43:17.409051] [INFO ] [MAIN ] Derivative Progress: 2024/2172 symbols completed. UZF took 1.0s. Estimated remaining: 55.4s. Rate: 160.2 symbols/min [2025-09-17T07:43:17.428981] [DEBUG] [MAIN ] V: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:17.429577] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53763 primary records. [2025-09-17T07:43:17.429671] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-17T07:43:17.445274] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-09-17T07:43:17.445359] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-17T07:43:17.447346] [INFO ] [MAIN ] Derivative Progress: 2025/2172 symbols completed. V took 0.7s. Estimated remaining: 55.0s. Rate: 160.3 symbols/min [2025-09-17T07:43:17.447949] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:17.448208] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:17.448143] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:17.457014] [DEBUG] [LOCAL ] VATE: Loaded 5853 existing records from primary storage. [2025-09-17T07:43:17.457253] [INFO ] [MAIN ] VATE: Loaded 5853 primary data records. [2025-09-17T07:43:17.801714] [DEBUG] [LOCAL ] VAC: Loaded 34869 existing records from primary storage. [2025-09-17T07:43:17.801977] [INFO ] [MAIN ] VAC: Loaded 34869 primary data records. [2025-09-17T07:43:17.909969] [DEBUG] [LOCAL ] VALE: Loaded 53695 existing records from primary storage. [2025-09-17T07:43:17.925492] [INFO ] [MAIN ] VALE: Loaded 53695 primary data records. [2025-09-17T07:43:18.450264] [DEBUG] [MAIN ] VATE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:18.451510] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5853 primary records. [2025-09-17T07:43:18.451814] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-17T07:43:18.468314] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-09-17T07:43:18.470019] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-17T07:43:18.472480] [INFO ] [MAIN ] Derivative Progress: 2026/2172 symbols completed. VATE took 1.0s. Estimated remaining: 54.7s. Rate: 160.2 symbols/min [2025-09-17T07:43:18.473624] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:18.487350] [DEBUG] [LOCAL ] VBF: Loaded 7160 existing records from primary storage. [2025-09-17T07:43:18.496032] [INFO ] [MAIN ] VBF: Loaded 7160 primary data records. [2025-09-17T07:43:18.502388] [DEBUG] [MAIN ] VAC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:18.514578] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34869 primary records. [2025-09-17T07:43:18.543465] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-17T07:43:18.553507] [DEBUG] [MAIN ] VALE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:18.587083] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53695 primary records. [2025-09-17T07:43:18.625962] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-17T07:43:18.673300] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-09-17T07:43:18.722107] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-17T07:43:18.727257] [INFO ] [MAIN ] Derivative Progress: 2027/2172 symbols completed. VAC took 1.3s. Estimated remaining: 54.3s. Rate: 160.2 symbols/min [2025-09-17T07:43:18.727523] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:18.874131] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-09-17T07:43:18.875089] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-17T07:43:18.877287] [INFO ] [MAIN ] Derivative Progress: 2028/2172 symbols completed. VALE took 1.4s. Estimated remaining: 53.9s. Rate: 160.2 symbols/min [2025-09-17T07:43:18.878244] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:18.895040] [DEBUG] [LOCAL ] VCV: Loaded 13449 existing records from primary storage. [2025-09-17T07:43:18.895375] [INFO ] [MAIN ] VCV: Loaded 13449 primary data records. [2025-09-17T07:43:19.100221] [DEBUG] [MAIN ] VBF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:19.216488] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 7160 primary records. [2025-09-17T07:43:19.217538] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-17T07:43:19.239801] [DEBUG] [LOCAL ] VEEV: Loaded 47556 existing records from primary storage. [2025-09-17T07:43:19.244795] [INFO ] [MAIN ] VEEV: Loaded 47556 primary data records. [2025-09-17T07:43:19.292246] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-09-17T07:43:19.318083] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-17T07:43:19.355068] [INFO ] [MAIN ] Derivative Progress: 2029/2172 symbols completed. VBF took 0.9s. Estimated remaining: 53.6s. Rate: 160.2 symbols/min [2025-09-17T07:43:19.361299] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:19.565910] [DEBUG] [LOCAL ] VEL: Loaded 12933 existing records from primary storage. [2025-09-17T07:43:19.574276] [INFO ] [MAIN ] VEL: Loaded 12933 primary data records. [2025-09-17T07:43:19.611461] [DEBUG] [MAIN ] VCV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:19.638665] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13449 primary records. [2025-09-17T07:43:19.683368] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-17T07:43:19.897451] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-09-17T07:43:19.897845] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-17T07:43:19.899895] [INFO ] [MAIN ] Derivative Progress: 2030/2172 symbols completed. VCV took 1.2s. Estimated remaining: 53.2s. Rate: 160.2 symbols/min [2025-09-17T07:43:19.900764] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:19.919844] [DEBUG] [MAIN ] VEEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:19.920576] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47556 primary records. [2025-09-17T07:43:19.920777] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-17T07:43:19.939236] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-09-17T07:43:19.939559] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-17T07:43:19.941626] [INFO ] [MAIN ] Derivative Progress: 2031/2172 symbols completed. VEEV took 1.1s. Estimated remaining: 52.8s. Rate: 160.3 symbols/min [2025-09-17T07:43:19.941950] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:19.971808] [DEBUG] [MAIN ] VEL: Filtered 7001 bins outside market hours, 7822 incomplete bins [2025-09-17T07:43:19.972483] [INFO ] [MAIN ] VEL: Generated 1792 derivative records from 12933 primary records. [2025-09-17T07:43:19.972661] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-17T07:43:20.003395] [DEBUG] [LOCAL ] VEL: Derivative data saved (1792 records). [2025-09-17T07:43:20.004251] [DEBUG] [LOCAL ] VET: Loaded 44421 existing records from primary storage. [2025-09-17T07:43:20.004568] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-17T07:43:20.007095] [INFO ] [MAIN ] Derivative Progress: 2032/2172 symbols completed. VEL took 0.7s. Estimated remaining: 52.4s. Rate: 160.3 symbols/min [2025-09-17T07:43:20.004519] [INFO ] [MAIN ] VET: Loaded 44421 primary data records. [2025-09-17T07:43:20.007617] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:20.225376] [DEBUG] [LOCAL ] VGI: Loaded 5227 existing records from primary storage. [2025-09-17T07:43:20.311108] [DEBUG] [LOCAL ] VFC: Loaded 53609 existing records from primary storage. [2025-09-17T07:43:20.325950] [INFO ] [MAIN ] VFC: Loaded 53609 primary data records. [2025-09-17T07:43:20.309754] [INFO ] [MAIN ] VGI: Loaded 5227 primary data records. [2025-09-17T07:43:20.985809] [DEBUG] [MAIN ] VET: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:20.987212] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 44421 primary records. [2025-09-17T07:43:20.987527] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-17T07:43:21.006504] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-09-17T07:43:21.008165] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-17T07:43:21.010373] [INFO ] [MAIN ] Derivative Progress: 2033/2172 symbols completed. VET took 1.1s. Estimated remaining: 52.1s. Rate: 160.2 symbols/min [2025-09-17T07:43:21.010892] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:21.028102] [DEBUG] [MAIN ] VGI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:21.030456] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5227 primary records. [2025-09-17T07:43:21.030793] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-17T07:43:21.058955] [DEBUG] [MAIN ] VFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:21.060230] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53609 primary records. [2025-09-17T07:43:21.066239] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-17T07:43:21.069553] [DEBUG] [LOCAL ] VGM: Loaded 18287 existing records from primary storage. [2025-09-17T07:43:21.071022] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-09-17T07:43:21.079025] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-17T07:43:21.078926] [INFO ] [MAIN ] VGM: Loaded 18287 primary data records. [2025-09-17T07:43:21.081141] [INFO ] [MAIN ] Derivative Progress: 2034/2172 symbols completed. VGI took 1.1s. Estimated remaining: 51.7s. Rate: 160.2 symbols/min [2025-09-17T07:43:21.096617] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:21.118723] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-09-17T07:43:21.172584] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-17T07:43:21.184263] [INFO ] [MAIN ] Derivative Progress: 2035/2172 symbols completed. VFC took 1.2s. Estimated remaining: 51.3s. Rate: 160.3 symbols/min [2025-09-17T07:43:21.184696] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:21.198294] [DEBUG] [LOCAL ] VHI: Loaded 2980 existing records from primary storage. [2025-09-17T07:43:21.204281] [INFO ] [MAIN ] VHI: Loaded 2980 primary data records. [2025-09-17T07:43:21.736633] [DEBUG] [LOCAL ] VICI: Loaded 53647 existing records from primary storage. [2025-09-17T07:43:21.737183] [INFO ] [MAIN ] VICI: Loaded 53647 primary data records. [2025-09-17T07:43:21.877351] [DEBUG] [MAIN ] VGM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:21.922454] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18287 primary records. [2025-09-17T07:43:21.951877] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-17T07:43:22.089585] [DEBUG] [MAIN ] VHI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:22.095281] [INFO ] [MAIN ] VHI: Generated 1794 derivative records from 2980 primary records. [2025-09-17T07:43:22.096558] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-17T07:43:22.111400] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-09-17T07:43:22.112966] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-17T07:43:22.115197] [INFO ] [MAIN ] Derivative Progress: 2036/2172 symbols completed. VGM took 1.1s. Estimated remaining: 50.9s. Rate: 160.2 symbols/min [2025-09-17T07:43:22.116390] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:22.119331] [DEBUG] [LOCAL ] VHI: Derivative data saved (1794 records). [2025-09-17T07:43:22.119501] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-17T07:43:22.122202] [INFO ] [MAIN ] Derivative Progress: 2037/2172 symbols completed. VHI took 1.0s. Estimated remaining: 50.5s. Rate: 160.3 symbols/min [2025-09-17T07:43:22.123861] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:22.148059] [DEBUG] [MAIN ] VICI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:22.148867] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53647 primary records. [2025-09-17T07:43:22.148982] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-17T07:43:22.167828] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-09-17T07:43:22.168197] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-17T07:43:22.170364] [INFO ] [MAIN ] Derivative Progress: 2038/2172 symbols completed. VICI took 1.0s. Estimated remaining: 50.1s. Rate: 160.3 symbols/min [2025-09-17T07:43:22.220743] [DEBUG] [LOCAL ] VIK: Loaded 52545 existing records from primary storage. [2025-09-17T07:43:22.220929] [INFO ] [MAIN ] VIK: Loaded 52545 primary data records. [2025-09-17T07:43:22.384539] [DEBUG] [LOCAL ] VIPS: Loaded 51406 existing records from primary storage. [2025-09-17T07:43:22.413854] [INFO ] [MAIN ] VIPS: Loaded 51406 primary data records. [2025-09-17T07:43:22.873009] [DEBUG] [MAIN ] VIK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:22.874109] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52545 primary records. [2025-09-17T07:43:22.875049] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-17T07:43:22.893289] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-09-17T07:43:22.894307] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-17T07:43:22.896575] [INFO ] [MAIN ] Derivative Progress: 2039/2172 symbols completed. VIK took 0.8s. Estimated remaining: 49.8s. Rate: 160.3 symbols/min [2025-09-17T07:43:22.909129] [DEBUG] [MAIN ] VIPS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:22.909749] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51406 primary records. [2025-09-17T07:43:22.909823] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-17T07:43:22.925687] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-09-17T07:43:22.925771] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-17T07:43:22.927830] [INFO ] [MAIN ] Derivative Progress: 2040/2172 symbols completed. VIPS took 0.8s. Estimated remaining: 49.4s. Rate: 160.3 symbols/min [2025-09-17T07:43:22.928352] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:22.928930] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:22.929016] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:22.986777] [DEBUG] [LOCAL ] VIST: Loaded 45918 existing records from primary storage. [2025-09-17T07:43:22.996682] [INFO ] [MAIN ] VIST: Loaded 45918 primary data records. [2025-09-17T07:43:23.125000] [DEBUG] [LOCAL ] VIRT: Loaded 47139 existing records from primary storage. [2025-09-17T07:43:23.140988] [INFO ] [MAIN ] VIRT: Loaded 47139 primary data records. [2025-09-17T07:43:23.140837] [DEBUG] [LOCAL ] VIV: Loaded 45523 existing records from primary storage. [2025-09-17T07:43:23.151667] [INFO ] [MAIN ] VIV: Loaded 45523 primary data records. [2025-09-17T07:43:23.963543] [DEBUG] [MAIN ] VIST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:23.964700] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 45918 primary records. [2025-09-17T07:43:23.966774] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-17T07:43:23.991006] [DEBUG] [MAIN ] VIRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:23.995554] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 47139 primary records. [2025-09-17T07:43:23.999240] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-09-17T07:43:24.000769] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-17T07:43:24.000054] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-17T07:43:24.003626] [INFO ] [MAIN ] Derivative Progress: 2041/2172 symbols completed. VIST took 1.1s. Estimated remaining: 49.1s. Rate: 160.2 symbols/min [2025-09-17T07:43:24.016893] [INFO ] [MAIN ] VKQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:24.025452] [DEBUG] [MAIN ] VIV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:24.030309] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 45523 primary records. [2025-09-17T07:43:24.031694] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-17T07:43:24.047548] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-09-17T07:43:24.050416] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-17T07:43:24.057389] [INFO ] [MAIN ] Derivative Progress: 2042/2172 symbols completed. VIRT took 1.1s. Estimated remaining: 48.7s. Rate: 160.3 symbols/min [2025-09-17T07:43:24.058117] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-09-17T07:43:24.058473] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-17T07:43:24.058349] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:24.060848] [INFO ] [MAIN ] Derivative Progress: 2043/2172 symbols completed. VIV took 1.1s. Estimated remaining: 48.3s. Rate: 160.3 symbols/min [2025-09-17T07:43:24.061149] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:24.069974] [DEBUG] [LOCAL ] VKQ: Loaded 17541 existing records from primary storage. [2025-09-17T07:43:24.070278] [INFO ] [MAIN ] VKQ: Loaded 17541 primary data records. [2025-09-17T07:43:24.393488] [DEBUG] [LOCAL ] VLN: Loaded 27959 existing records from primary storage. [2025-09-17T07:43:24.402751] [INFO ] [MAIN ] VLN: Loaded 27959 primary data records. [2025-09-17T07:43:24.518820] [DEBUG] [LOCAL ] VLO: Loaded 53110 existing records from primary storage. [2025-09-17T07:43:24.531756] [INFO ] [MAIN ] VLO: Loaded 53110 primary data records. [2025-09-17T07:43:24.959952] [DEBUG] [MAIN ] VKQ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:25.074416] [INFO ] [MAIN ] VKQ: Generated 1794 derivative records from 17541 primary records. [2025-09-17T07:43:25.075025] [DEBUG] [LOCAL ] VKQ: Saving derivative data. [2025-09-17T07:43:25.093110] [DEBUG] [LOCAL ] VKQ: Derivative data saved (1794 records). [2025-09-17T07:43:25.094629] [INFO ] [MAIN ] VKQ: Successfully saved derivative data. [2025-09-17T07:43:25.097949] [INFO ] [MAIN ] Derivative Progress: 2044/2172 symbols completed. VKQ took 1.1s. Estimated remaining: 47.9s. Rate: 160.2 symbols/min [2025-09-17T07:43:25.100139] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:25.114813] [DEBUG] [MAIN ] VLN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:25.116955] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 27959 primary records. [2025-09-17T07:43:25.117265] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-17T07:43:25.135347] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-09-17T07:43:25.135964] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-17T07:43:25.138272] [INFO ] [MAIN ] Derivative Progress: 2045/2172 symbols completed. VLN took 1.1s. Estimated remaining: 47.5s. Rate: 160.3 symbols/min [2025-09-17T07:43:25.138898] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:25.173708] [DEBUG] [LOCAL ] VLT: Loaded 4731 existing records from primary storage. [2025-09-17T07:43:25.174181] [DEBUG] [MAIN ] VLO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:25.175283] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53110 primary records. [2025-09-17T07:43:25.174466] [INFO ] [MAIN ] VLT: Loaded 4731 primary data records. [2025-09-17T07:43:25.233683] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-17T07:43:25.304308] [DEBUG] [LOCAL ] VLRS: Loaded 41064 existing records from primary storage. [2025-09-17T07:43:25.357674] [INFO ] [MAIN ] VLRS: Loaded 41064 primary data records. [2025-09-17T07:43:25.609315] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-09-17T07:43:25.620823] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-17T07:43:25.623869] [INFO ] [MAIN ] Derivative Progress: 2046/2172 symbols completed. VLO took 1.6s. Estimated remaining: 47.2s. Rate: 160.2 symbols/min [2025-09-17T07:43:25.644936] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:25.837593] [DEBUG] [MAIN ] VLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:25.838531] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4731 primary records. [2025-09-17T07:43:25.838819] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-17T07:43:25.865702] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-09-17T07:43:25.865933] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-17T07:43:25.868112] [INFO ] [MAIN ] Derivative Progress: 2047/2172 symbols completed. VLT took 0.7s. Estimated remaining: 46.8s. Rate: 160.3 symbols/min [2025-09-17T07:43:25.870080] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:25.884619] [DEBUG] [LOCAL ] VMC: Loaded 44136 existing records from primary storage. [2025-09-17T07:43:25.885032] [INFO ] [MAIN ] VMC: Loaded 44136 primary data records. [2025-09-17T07:43:26.012234] [DEBUG] [LOCAL ] VMI: Loaded 15524 existing records from primary storage. [2025-09-17T07:43:26.043575] [INFO ] [MAIN ] VMI: Loaded 15524 primary data records. [2025-09-17T07:43:26.127234] [DEBUG] [MAIN ] VLRS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:26.168201] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 41064 primary records. [2025-09-17T07:43:26.311720] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-17T07:43:26.413901] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-09-17T07:43:26.414358] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-17T07:43:26.565685] [INFO ] [MAIN ] Derivative Progress: 2048/2172 symbols completed. VLRS took 1.5s. Estimated remaining: 46.4s. Rate: 160.2 symbols/min [2025-09-17T07:43:26.576096] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:26.608012] [DEBUG] [MAIN ] VMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:26.609365] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 44136 primary records. [2025-09-17T07:43:26.609523] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-17T07:43:26.632096] [DEBUG] [LOCAL ] VMO: Loaded 20891 existing records from primary storage. [2025-09-17T07:43:26.633499] [INFO ] [MAIN ] VMO: Loaded 20891 primary data records. [2025-09-17T07:43:26.673795] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-09-17T07:43:26.731205] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-17T07:43:26.742249] [DEBUG] [MAIN ] VMI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:26.750600] [INFO ] [MAIN ] Derivative Progress: 2049/2172 symbols completed. VMC took 1.1s. Estimated remaining: 46.1s. Rate: 160.2 symbols/min [2025-09-17T07:43:26.769337] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:26.770464] [INFO ] [MAIN ] VMI: Generated 1794 derivative records from 15524 primary records. [2025-09-17T07:43:26.775626] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-17T07:43:26.850138] [DEBUG] [LOCAL ] VNCE: Loaded 6051 existing records from primary storage. [2025-09-17T07:43:26.892491] [INFO ] [MAIN ] VNCE: Loaded 6051 primary data records. [2025-09-17T07:43:27.084516] [DEBUG] [LOCAL ] VMI: Derivative data saved (1794 records). [2025-09-17T07:43:27.111816] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-17T07:43:27.114403] [INFO ] [MAIN ] Derivative Progress: 2050/2172 symbols completed. VMI took 1.2s. Estimated remaining: 45.7s. Rate: 160.2 symbols/min [2025-09-17T07:43:27.132304] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:27.329860] [DEBUG] [MAIN ] VMO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:27.330777] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 20891 primary records. [2025-09-17T07:43:27.331162] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-17T07:43:27.360587] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-09-17T07:43:27.368829] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-17T07:43:27.374709] [DEBUG] [MAIN ] VNCE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:27.377013] [INFO ] [MAIN ] Derivative Progress: 2051/2172 symbols completed. VMO took 0.8s. Estimated remaining: 45.3s. Rate: 160.3 symbols/min [2025-09-17T07:43:27.392199] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:27.391696] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 6051 primary records. [2025-09-17T07:43:27.392973] [DEBUG] [LOCAL ] VNO: Loaded 48987 existing records from primary storage. [2025-09-17T07:43:27.393275] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-17T07:43:27.394204] [INFO ] [MAIN ] VNO: Loaded 48987 primary data records. [2025-09-17T07:43:27.516851] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-09-17T07:43:27.517078] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-17T07:43:27.519769] [INFO ] [MAIN ] Derivative Progress: 2052/2172 symbols completed. VNCE took 0.8s. Estimated remaining: 44.9s. Rate: 160.3 symbols/min [2025-09-17T07:43:27.525831] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:27.743854] [DEBUG] [LOCAL ] VNT: Loaded 44405 existing records from primary storage. [2025-09-17T07:43:27.744271] [INFO ] [MAIN ] VNT: Loaded 44405 primary data records. [2025-09-17T07:43:27.748548] [DEBUG] [LOCAL ] VOC: Loaded 8980 existing records from primary storage. [2025-09-17T07:43:27.749075] [INFO ] [MAIN ] VOC: Loaded 8980 primary data records. [2025-09-17T07:43:28.435452] [DEBUG] [MAIN ] VNO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:28.436806] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48987 primary records. [2025-09-17T07:43:28.437031] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-17T07:43:28.456326] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-09-17T07:43:28.456842] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-17T07:43:28.459353] [INFO ] [MAIN ] Derivative Progress: 2053/2172 symbols completed. VNO took 1.3s. Estimated remaining: 44.6s. Rate: 160.2 symbols/min [2025-09-17T07:43:28.493246] [DEBUG] [MAIN ] VNT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:28.494616] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 44405 primary records. [2025-09-17T07:43:28.494783] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-17T07:43:28.493822] [DEBUG] [MAIN ] VOC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:28.496181] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 8980 primary records. [2025-09-17T07:43:28.496509] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-17T07:43:28.524446] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-09-17T07:43:28.525679] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-17T07:43:28.528181] [INFO ] [MAIN ] Derivative Progress: 2054/2172 symbols completed. VOC took 1.0s. Estimated remaining: 44.2s. Rate: 160.3 symbols/min [2025-09-17T07:43:28.530689] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-09-17T07:43:28.530798] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-17T07:43:28.533395] [INFO ] [MAIN ] Derivative Progress: 2055/2172 symbols completed. VNT took 1.1s. Estimated remaining: 43.8s. Rate: 160.3 symbols/min [2025-09-17T07:43:28.534035] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:28.534340] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:28.534161] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:28.548259] [DEBUG] [LOCAL ] VPV: Loaded 5391 existing records from primary storage. [2025-09-17T07:43:28.548661] [INFO ] [MAIN ] VPV: Loaded 5391 primary data records. [2025-09-17T07:43:28.673914] [DEBUG] [LOCAL ] VPG: Loaded 17220 existing records from primary storage. [2025-09-17T07:43:28.679864] [INFO ] [MAIN ] VPG: Loaded 17220 primary data records. [2025-09-17T07:43:28.851054] [DEBUG] [LOCAL ] VOYA: Loaded 43015 existing records from primary storage. [2025-09-17T07:43:28.873034] [INFO ] [MAIN ] VOYA: Loaded 43015 primary data records. [2025-09-17T07:43:29.505407] [DEBUG] [MAIN ] VPV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:29.506511] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5391 primary records. [2025-09-17T07:43:29.506838] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-17T07:43:29.538092] [DEBUG] [MAIN ] VPG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:29.539996] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17220 primary records. [2025-09-17T07:43:29.541301] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-17T07:43:29.544077] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-09-17T07:43:29.545294] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-17T07:43:29.568847] [INFO ] [MAIN ] Derivative Progress: 2056/2172 symbols completed. VPV took 1.0s. Estimated remaining: 43.4s. Rate: 160.2 symbols/min [2025-09-17T07:43:29.572359] [DEBUG] [MAIN ] VOYA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:29.575058] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:29.574855] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 43015 primary records. [2025-09-17T07:43:29.575694] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-17T07:43:29.596106] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-09-17T07:43:29.596437] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-09-17T07:43:29.596613] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-17T07:43:29.598872] [INFO ] [MAIN ] Derivative Progress: 2057/2172 symbols completed. VPG took 1.1s. Estimated remaining: 43.1s. Rate: 160.3 symbols/min [2025-09-17T07:43:29.596689] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-17T07:43:29.601805] [INFO ] [MAIN ] Derivative Progress: 2058/2172 symbols completed. VOYA took 1.1s. Estimated remaining: 42.7s. Rate: 160.3 symbols/min [2025-09-17T07:43:29.601948] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:29.602533] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:29.640169] [DEBUG] [LOCAL ] VRE: Loaded 34620 existing records from primary storage. [2025-09-17T07:43:29.640493] [INFO ] [MAIN ] VRE: Loaded 34620 primary data records. [2025-09-17T07:43:29.807722] [DEBUG] [LOCAL ] VSCO: Loaded 52905 existing records from primary storage. [2025-09-17T07:43:29.842330] [INFO ] [MAIN ] VSCO: Loaded 52905 primary data records. [2025-09-17T07:43:30.068440] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-17T07:43:30.089741] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-09-17T07:43:30.691749] [DEBUG] [MAIN ] VRE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:30.693883] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 34620 primary records. [2025-09-17T07:43:30.694136] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-17T07:43:30.729925] [DEBUG] [MAIN ] VSCO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:30.729474] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-09-17T07:43:30.730806] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52905 primary records. [2025-09-17T07:43:30.731599] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-17T07:43:30.735238] [INFO ] [MAIN ] Derivative Progress: 2059/2172 symbols completed. VRE took 1.2s. Estimated remaining: 42.3s. Rate: 160.2 symbols/min [2025-09-17T07:43:30.733006] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-17T07:43:30.735788] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:30.761874] [DEBUG] [MAIN ] VRT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:30.763921] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-09-17T07:43:30.764755] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-17T07:43:30.775734] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-09-17T07:43:30.776822] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-17T07:43:30.781975] [INFO ] [MAIN ] Derivative Progress: 2060/2172 symbols completed. VSCO took 1.2s. Estimated remaining: 41.9s. Rate: 160.3 symbols/min [2025-09-17T07:43:30.783037] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:30.786297] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-09-17T07:43:30.786622] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-17T07:43:30.789356] [INFO ] [MAIN ] Derivative Progress: 2061/2172 symbols completed. VRT took 1.2s. Estimated remaining: 41.5s. Rate: 160.3 symbols/min [2025-09-17T07:43:30.789844] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:30.875139] [DEBUG] [LOCAL ] VSTS: Loaded 48963 existing records from primary storage. [2025-09-17T07:43:30.875351] [INFO ] [MAIN ] VSTS: Loaded 48963 primary data records. [2025-09-17T07:43:30.887779] [DEBUG] [LOCAL ] VSH: Loaded 48836 existing records from primary storage. [2025-09-17T07:43:30.932685] [INFO ] [MAIN ] VSH: Loaded 48836 primary data records. [2025-09-17T07:43:31.068562] [DEBUG] [LOCAL ] VST: Loaded 53723 existing records from primary storage. [2025-09-17T07:43:31.138745] [INFO ] [MAIN ] VST: Loaded 53723 primary data records. [2025-09-17T07:43:31.831351] [DEBUG] [MAIN ] VSTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:31.833606] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 48963 primary records. [2025-09-17T07:43:31.834397] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-17T07:43:31.854820] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-09-17T07:43:31.855573] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-17T07:43:31.857660] [INFO ] [MAIN ] Derivative Progress: 2062/2172 symbols completed. VSTS took 1.1s. Estimated remaining: 41.2s. Rate: 160.2 symbols/min [2025-09-17T07:43:31.871294] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:31.871899] [DEBUG] [MAIN ] VSH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:31.873429] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48836 primary records. [2025-09-17T07:43:31.873693] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-17T07:43:31.895479] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-09-17T07:43:31.895874] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-17T07:43:31.898452] [INFO ] [MAIN ] Derivative Progress: 2063/2172 symbols completed. VSH took 1.2s. Estimated remaining: 40.8s. Rate: 160.3 symbols/min [2025-09-17T07:43:31.912524] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:31.912939] [DEBUG] [MAIN ] VST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:31.914301] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53723 primary records. [2025-09-17T07:43:31.914957] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-17T07:43:31.931757] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-09-17T07:43:31.931919] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-17T07:43:31.934878] [INFO ] [MAIN ] Derivative Progress: 2064/2172 symbols completed. VST took 1.2s. Estimated remaining: 40.4s. Rate: 160.3 symbols/min [2025-09-17T07:43:31.935206] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:31.977558] [DEBUG] [LOCAL ] VTEX: Loaded 43460 existing records from primary storage. [2025-09-17T07:43:31.977877] [INFO ] [MAIN ] VTEX: Loaded 43460 primary data records. [2025-09-17T07:43:32.067192] [DEBUG] [LOCAL ] VTMX: Loaded 17366 existing records from primary storage. [2025-09-17T07:43:32.085533] [INFO ] [MAIN ] VTMX: Loaded 17366 primary data records. [2025-09-17T07:43:32.158773] [DEBUG] [LOCAL ] VTLE: Loaded 48752 existing records from primary storage. [2025-09-17T07:43:32.188274] [INFO ] [MAIN ] VTLE: Loaded 48752 primary data records. [2025-09-17T07:43:33.007813] [DEBUG] [MAIN ] VTEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:33.008536] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 43460 primary records. [2025-09-17T07:43:33.008806] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-17T07:43:33.027370] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-09-17T07:43:33.027633] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-17T07:43:33.030547] [INFO ] [MAIN ] Derivative Progress: 2065/2172 symbols completed. VTEX took 1.2s. Estimated remaining: 40.1s. Rate: 160.2 symbols/min [2025-09-17T07:43:33.045439] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:33.045900] [DEBUG] [MAIN ] VTMX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:33.047225] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17366 primary records. [2025-09-17T07:43:33.047552] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-17T07:43:33.060849] [DEBUG] [MAIN ] VTLE: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:33.063726] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48752 primary records. [2025-09-17T07:43:33.064398] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-17T07:43:33.095900] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-09-17T07:43:33.096736] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-17T07:43:33.099998] [INFO ] [MAIN ] Derivative Progress: 2066/2172 symbols completed. VTLE took 1.2s. Estimated remaining: 39.7s. Rate: 160.2 symbols/min [2025-09-17T07:43:33.091679] [DEBUG] [LOCAL ] VTN: Loaded 7161 existing records from primary storage. [2025-09-17T07:43:33.101676] [INFO ] [MAIN ] VTN: Loaded 7161 primary data records. [2025-09-17T07:43:33.100941] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:33.103321] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-09-17T07:43:33.115000] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-17T07:43:33.137222] [INFO ] [MAIN ] Derivative Progress: 2067/2172 symbols completed. VTMX took 1.2s. Estimated remaining: 39.3s. Rate: 160.3 symbols/min [2025-09-17T07:43:33.168405] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:33.431496] [DEBUG] [LOCAL ] VTOL: Loaded 19916 existing records from primary storage. [2025-09-17T07:43:33.431980] [INFO ] [MAIN ] VTOL: Loaded 19916 primary data records. [2025-09-17T07:43:33.751332] [DEBUG] [LOCAL ] VTR: Loaded 52829 existing records from primary storage. [2025-09-17T07:43:33.766052] [INFO ] [MAIN ] VTR: Loaded 52829 primary data records. [2025-09-17T07:43:34.096097] [DEBUG] [MAIN ] VTN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:34.097181] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7161 primary records. [2025-09-17T07:43:34.098299] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-17T07:43:34.118614] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-09-17T07:43:34.121114] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-17T07:43:34.123535] [INFO ] [MAIN ] Derivative Progress: 2068/2172 symbols completed. VTN took 1.1s. Estimated remaining: 39.0s. Rate: 160.2 symbols/min [2025-09-17T07:43:34.138934] [DEBUG] [MAIN ] VTOL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:34.140351] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19916 primary records. [2025-09-17T07:43:34.140579] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-17T07:43:34.156806] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-09-17T07:43:34.157508] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-17T07:43:34.160485] [INFO ] [MAIN ] Derivative Progress: 2069/2172 symbols completed. VTOL took 1.1s. Estimated remaining: 38.6s. Rate: 160.3 symbols/min [2025-09-17T07:43:34.173951] [DEBUG] [MAIN ] VTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:34.174560] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52829 primary records. [2025-09-17T07:43:34.174633] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-17T07:43:34.189787] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-09-17T07:43:34.189863] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-17T07:43:34.192035] [INFO ] [MAIN ] Derivative Progress: 2070/2172 symbols completed. VTR took 1.0s. Estimated remaining: 38.2s. Rate: 160.3 symbols/min [2025-09-17T07:43:34.192485] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:34.192668] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:34.192746] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:34.252506] [DEBUG] [LOCAL ] VVR: Loaded 30198 existing records from primary storage. [2025-09-17T07:43:34.252802] [INFO ] [MAIN ] VVR: Loaded 30198 primary data records. [2025-09-17T07:43:34.253279] [DEBUG] [LOCAL ] VTS: Loaded 30206 existing records from primary storage. [2025-09-17T07:43:34.292696] [INFO ] [MAIN ] VTS: Loaded 30206 primary data records. [2025-09-17T07:43:34.492757] [DEBUG] [LOCAL ] VVV: Loaded 50151 existing records from primary storage. [2025-09-17T07:43:34.552778] [INFO ] [MAIN ] VVV: Loaded 50151 primary data records. [2025-09-17T07:43:35.234242] [DEBUG] [MAIN ] VVR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:35.235741] [DEBUG] [MAIN ] VTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:35.235445] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 30198 primary records. [2025-09-17T07:43:35.236261] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30206 primary records. [2025-09-17T07:43:35.236559] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-17T07:43:35.236453] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-17T07:43:35.267406] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-09-17T07:43:35.269330] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-17T07:43:35.269195] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-09-17T07:43:35.271904] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-17T07:43:35.271830] [INFO ] [MAIN ] Derivative Progress: 2071/2172 symbols completed. VTS took 1.1s. Estimated remaining: 37.8s. Rate: 160.2 symbols/min [2025-09-17T07:43:35.275749] [INFO ] [MAIN ] Derivative Progress: 2072/2172 symbols completed. VVR took 1.1s. Estimated remaining: 37.4s. Rate: 160.3 symbols/min [2025-09-17T07:43:35.275839] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:35.276251] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:35.289877] [DEBUG] [MAIN ] VVV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:35.290611] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50151 primary records. [2025-09-17T07:43:35.290728] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-17T07:43:35.307329] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-09-17T07:43:35.312523] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-17T07:43:35.314887] [INFO ] [MAIN ] Derivative Progress: 2073/2172 symbols completed. VVV took 1.1s. Estimated remaining: 37.1s. Rate: 160.3 symbols/min [2025-09-17T07:43:35.315289] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:35.326850] [DEBUG] [LOCAL ] VVX: Loaded 23239 existing records from primary storage. [2025-09-17T07:43:35.327105] [INFO ] [MAIN ] VVX: Loaded 23239 primary data records. [2025-09-17T07:43:35.658877] [DEBUG] [LOCAL ] VYX: Loaded 49292 existing records from primary storage. [2025-09-17T07:43:35.659359] [INFO ] [MAIN ] VYX: Loaded 49292 primary data records. [2025-09-17T07:43:35.783229] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-17T07:43:35.789441] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-09-17T07:43:36.303443] [DEBUG] [MAIN ] VVX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:36.305469] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 23239 primary records. [2025-09-17T07:43:36.306352] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-17T07:43:36.323991] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-09-17T07:43:36.324138] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-17T07:43:36.326553] [INFO ] [MAIN ] Derivative Progress: 2074/2172 symbols completed. VVX took 1.1s. Estimated remaining: 36.7s. Rate: 160.2 symbols/min [2025-09-17T07:43:36.326963] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:36.344948] [DEBUG] [MAIN ] VYX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:36.345802] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 49292 primary records. [2025-09-17T07:43:36.346288] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-17T07:43:36.364554] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-09-17T07:43:36.366251] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-17T07:43:36.368920] [INFO ] [MAIN ] Derivative Progress: 2075/2172 symbols completed. VYX took 1.1s. Estimated remaining: 36.3s. Rate: 160.3 symbols/min [2025-09-17T07:43:36.377288] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:36.382713] [DEBUG] [MAIN ] VZ: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:36.384149] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-09-17T07:43:36.384375] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-17T07:43:36.415316] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-09-17T07:43:36.415599] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-17T07:43:36.417996] [INFO ] [MAIN ] Derivative Progress: 2076/2172 symbols completed. VZ took 1.1s. Estimated remaining: 35.9s. Rate: 160.3 symbols/min [2025-09-17T07:43:36.418495] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:36.438175] [DEBUG] [LOCAL ] W: Loaded 53533 existing records from primary storage. [2025-09-17T07:43:36.438422] [INFO ] [MAIN ] W: Loaded 53533 primary data records. [2025-09-17T07:43:36.784565] [DEBUG] [LOCAL ] WAB: Loaded 44433 existing records from primary storage. [2025-09-17T07:43:36.807255] [INFO ] [MAIN ] WAB: Loaded 44433 primary data records. [2025-09-17T07:43:36.807924] [DEBUG] [LOCAL ] WAL: Loaded 45495 existing records from primary storage. [2025-09-17T07:43:36.808024] [INFO ] [MAIN ] WAL: Loaded 45495 primary data records. [2025-09-17T07:43:37.446470] [DEBUG] [MAIN ] W: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:37.447604] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53533 primary records. [2025-09-17T07:43:37.447908] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-17T07:43:37.469218] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-09-17T07:43:37.470237] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-17T07:43:37.474338] [INFO ] [MAIN ] Derivative Progress: 2077/2172 symbols completed. W took 1.1s. Estimated remaining: 35.6s. Rate: 160.2 symbols/min [2025-09-17T07:43:37.474763] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:37.489608] [DEBUG] [MAIN ] WAB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:37.490729] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44433 primary records. [2025-09-17T07:43:37.491021] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-17T07:43:37.508286] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-09-17T07:43:37.510269] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-17T07:43:37.513253] [INFO ] [MAIN ] Derivative Progress: 2078/2172 symbols completed. WAB took 1.1s. Estimated remaining: 35.2s. Rate: 160.3 symbols/min [2025-09-17T07:43:37.514172] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:37.538608] [DEBUG] [MAIN ] WAL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:37.539956] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45495 primary records. [2025-09-17T07:43:37.540331] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-17T07:43:37.567515] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-09-17T07:43:37.568762] [DEBUG] [LOCAL ] WAT: Loaded 35149 existing records from primary storage. [2025-09-17T07:43:37.569013] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-17T07:43:37.571522] [INFO ] [MAIN ] Derivative Progress: 2079/2172 symbols completed. WAL took 1.2s. Estimated remaining: 34.8s. Rate: 160.3 symbols/min [2025-09-17T07:43:37.571681] [INFO ] [MAIN ] WAT: Loaded 35149 primary data records. [2025-09-17T07:43:37.571965] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:37.751513] [DEBUG] [LOCAL ] WBX: Loaded 13601 existing records from primary storage. [2025-09-17T07:43:37.784118] [INFO ] [MAIN ] WBX: Loaded 13601 primary data records. [2025-09-17T07:43:37.892020] [DEBUG] [LOCAL ] WBS: Loaded 48884 existing records from primary storage. [2025-09-17T07:43:37.932759] [INFO ] [MAIN ] WBS: Loaded 48884 primary data records. [2025-09-17T07:43:38.650998] [DEBUG] [MAIN ] WAT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:38.652488] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35149 primary records. [2025-09-17T07:43:38.652708] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-17T07:43:38.673064] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-09-17T07:43:38.673853] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-17T07:43:38.676593] [INFO ] [MAIN ] Derivative Progress: 2080/2172 symbols completed. WAT took 1.2s. Estimated remaining: 34.5s. Rate: 160.2 symbols/min [2025-09-17T07:43:38.677308] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:38.710391] [DEBUG] [MAIN ] WBS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:38.710893] [DEBUG] [MAIN ] WBX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:38.711593] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48884 primary records. [2025-09-17T07:43:38.712235] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-17T07:43:38.712293] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 13601 primary records. [2025-09-17T07:43:38.712998] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-17T07:43:38.737115] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-09-17T07:43:38.739674] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-17T07:43:38.754568] [INFO ] [MAIN ] Derivative Progress: 2081/2172 symbols completed. WBS took 1.2s. Estimated remaining: 34.1s. Rate: 160.2 symbols/min [2025-09-17T07:43:38.757245] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:38.756837] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-09-17T07:43:38.757753] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-17T07:43:38.760223] [INFO ] [MAIN ] Derivative Progress: 2082/2172 symbols completed. WBX took 1.2s. Estimated remaining: 33.7s. Rate: 160.3 symbols/min [2025-09-17T07:43:38.760933] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:38.777176] [DEBUG] [LOCAL ] WCC: Loaded 40293 existing records from primary storage. [2025-09-17T07:43:38.777375] [INFO ] [MAIN ] WCC: Loaded 40293 primary data records. [2025-09-17T07:43:38.985597] [DEBUG] [LOCAL ] WD: Loaded 23478 existing records from primary storage. [2025-09-17T07:43:39.089962] [INFO ] [MAIN ] WD: Loaded 23478 primary data records. [2025-09-17T07:43:39.185879] [DEBUG] [LOCAL ] WCN: Loaded 48138 existing records from primary storage. [2025-09-17T07:43:39.198504] [INFO ] [MAIN ] WCN: Loaded 48138 primary data records. [2025-09-17T07:43:39.738540] [DEBUG] [MAIN ] WCC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:39.740135] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 40293 primary records. [2025-09-17T07:43:39.740558] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-17T07:43:39.759680] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-09-17T07:43:39.760304] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-17T07:43:39.762475] [INFO ] [MAIN ] Derivative Progress: 2083/2172 symbols completed. WCC took 1.1s. Estimated remaining: 33.3s. Rate: 160.2 symbols/min [2025-09-17T07:43:39.779271] [DEBUG] [MAIN ] WD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:39.780805] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23478 primary records. [2025-09-17T07:43:39.781422] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-17T07:43:39.805801] [DEBUG] [MAIN ] WCN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:39.807591] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 48138 primary records. [2025-09-17T07:43:39.808994] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-17T07:43:39.810372] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-09-17T07:43:39.810598] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-17T07:43:39.820999] [INFO ] [MAIN ] Derivative Progress: 2084/2172 symbols completed. WD took 1.1s. Estimated remaining: 32.9s. Rate: 160.2 symbols/min [2025-09-17T07:43:39.827462] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-09-17T07:43:39.827545] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-17T07:43:39.830394] [INFO ] [MAIN ] Derivative Progress: 2085/2172 symbols completed. WCN took 1.1s. Estimated remaining: 32.6s. Rate: 160.3 symbols/min [2025-09-17T07:43:39.830968] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:39.831045] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:39.830886] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:39.849113] [DEBUG] [LOCAL ] WEA: Loaded 7463 existing records from primary storage. [2025-09-17T07:43:39.849262] [INFO ] [MAIN ] WEA: Loaded 7463 primary data records. [2025-09-17T07:43:39.937518] [DEBUG] [LOCAL ] WDH: Loaded 16065 existing records from primary storage. [2025-09-17T07:43:39.968184] [INFO ] [MAIN ] WDH: Loaded 16065 primary data records. [2025-09-17T07:43:40.265295] [DEBUG] [LOCAL ] WDS: Loaded 43801 existing records from primary storage. [2025-09-17T07:43:40.280949] [INFO ] [MAIN ] WDS: Loaded 43801 primary data records. [2025-09-17T07:43:40.841033] [DEBUG] [MAIN ] WEA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:40.843543] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7463 primary records. [2025-09-17T07:43:40.843974] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-17T07:43:40.857166] [DEBUG] [MAIN ] WDH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:40.859075] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 16065 primary records. [2025-09-17T07:43:40.871905] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-17T07:43:40.875474] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-09-17T07:43:40.882669] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-17T07:43:40.885822] [INFO ] [MAIN ] Derivative Progress: 2086/2172 symbols completed. WEA took 1.1s. Estimated remaining: 32.2s. Rate: 160.2 symbols/min [2025-09-17T07:43:40.892995] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:40.895857] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-09-17T07:43:40.896213] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-17T07:43:40.898767] [INFO ] [MAIN ] Derivative Progress: 2087/2172 symbols completed. WDH took 1.1s. Estimated remaining: 31.8s. Rate: 160.3 symbols/min [2025-09-17T07:43:40.911906] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:40.912354] [DEBUG] [MAIN ] WDS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:40.913598] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43801 primary records. [2025-09-17T07:43:40.914105] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-17T07:43:40.931386] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-09-17T07:43:40.931682] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-17T07:43:40.934416] [INFO ] [MAIN ] Derivative Progress: 2088/2172 symbols completed. WDS took 1.1s. Estimated remaining: 31.4s. Rate: 160.3 symbols/min [2025-09-17T07:43:40.935003] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:40.990823] [DEBUG] [LOCAL ] WEAV: Loaded 42016 existing records from primary storage. [2025-09-17T07:43:40.991339] [INFO ] [MAIN ] WEAV: Loaded 42016 primary data records. [2025-09-17T07:43:41.212706] [DEBUG] [LOCAL ] WEC: Loaded 52248 existing records from primary storage. [2025-09-17T07:43:41.218442] [INFO ] [MAIN ] WEC: Loaded 52248 primary data records. [2025-09-17T07:43:41.218344] [DEBUG] [LOCAL ] WELL: Loaded 52362 existing records from primary storage. [2025-09-17T07:43:41.239728] [INFO ] [MAIN ] WELL: Loaded 52362 primary data records. [2025-09-17T07:43:41.970723] [DEBUG] [MAIN ] WEAV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:41.972830] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 42016 primary records. [2025-09-17T07:43:41.973186] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-17T07:43:41.992500] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-09-17T07:43:41.994475] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-17T07:43:41.997428] [INFO ] [MAIN ] Derivative Progress: 2089/2172 symbols completed. WEAV took 1.1s. Estimated remaining: 31.1s. Rate: 160.2 symbols/min [2025-09-17T07:43:42.011556] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:42.012123] [DEBUG] [MAIN ] WEC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:42.013563] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52248 primary records. [2025-09-17T07:43:42.026183] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-17T07:43:42.026368] [DEBUG] [MAIN ] WELL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:42.027905] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52362 primary records. [2025-09-17T07:43:42.028268] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-17T07:43:42.053756] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-09-17T07:43:42.057552] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-17T07:43:42.061694] [INFO ] [MAIN ] Derivative Progress: 2090/2172 symbols completed. WEC took 1.1s. Estimated remaining: 30.7s. Rate: 160.2 symbols/min [2025-09-17T07:43:42.062896] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:42.063257] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-09-17T07:43:42.063845] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-17T07:43:42.066580] [INFO ] [MAIN ] Derivative Progress: 2091/2172 symbols completed. WELL took 1.1s. Estimated remaining: 30.3s. Rate: 160.3 symbols/min [2025-09-17T07:43:42.067677] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:42.082553] [DEBUG] [LOCAL ] WF: Loaded 11170 existing records from primary storage. [2025-09-17T07:43:42.083003] [INFO ] [MAIN ] WF: Loaded 11170 primary data records. [2025-09-17T07:43:42.254076] [DEBUG] [LOCAL ] WEX: Loaded 35787 existing records from primary storage. [2025-09-17T07:43:42.243352] [DEBUG] [LOCAL ] WES: Loaded 48111 existing records from primary storage. [2025-09-17T07:43:42.289628] [INFO ] [MAIN ] WES: Loaded 48111 primary data records. [2025-09-17T07:43:42.289705] [INFO ] [MAIN ] WEX: Loaded 35787 primary data records. [2025-09-17T07:43:43.085595] [DEBUG] [MAIN ] WF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:43.086920] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 11170 primary records. [2025-09-17T07:43:43.087258] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-17T07:43:43.106422] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-09-17T07:43:43.106898] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-17T07:43:43.108925] [INFO ] [MAIN ] Derivative Progress: 2092/2172 symbols completed. WF took 1.0s. Estimated remaining: 30.0s. Rate: 160.2 symbols/min [2025-09-17T07:43:43.110815] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:43.129928] [DEBUG] [MAIN ] WES: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:43.130977] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48111 primary records. [2025-09-17T07:43:43.131317] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-17T07:43:43.144324] [DEBUG] [MAIN ] WEX: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:43.145672] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 35787 primary records. [2025-09-17T07:43:43.146029] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-17T07:43:43.174942] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-09-17T07:43:43.176723] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-17T07:43:43.180080] [INFO ] [MAIN ] Derivative Progress: 2093/2172 symbols completed. WES took 1.2s. Estimated remaining: 29.6s. Rate: 160.2 symbols/min [2025-09-17T07:43:43.181443] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:43.184790] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-09-17T07:43:43.185250] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-17T07:43:43.188356] [INFO ] [MAIN ] Derivative Progress: 2094/2172 symbols completed. WEX took 1.1s. Estimated remaining: 29.2s. Rate: 160.3 symbols/min [2025-09-17T07:43:43.188903] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:43.226297] [DEBUG] [LOCAL ] WFG: Loaded 25080 existing records from primary storage. [2025-09-17T07:43:43.226619] [INFO ] [MAIN ] WFG: Loaded 25080 primary data records. [2025-09-17T07:43:43.274252] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-17T07:43:43.313855] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-09-17T07:43:43.677370] [DEBUG] [LOCAL ] WGO: Loaded 39661 existing records from primary storage. [2025-09-17T07:43:43.704046] [INFO ] [MAIN ] WGO: Loaded 39661 primary data records. [2025-09-17T07:43:44.229098] [DEBUG] [MAIN ] WFG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:44.233079] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 25080 primary records. [2025-09-17T07:43:44.247184] [DEBUG] [MAIN ] WFC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:44.246920] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-17T07:43:44.248194] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-09-17T07:43:44.249813] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-17T07:43:44.273719] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-09-17T07:43:44.278948] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-17T07:43:44.285204] [INFO ] [MAIN ] Derivative Progress: 2095/2172 symbols completed. WFG took 1.1s. Estimated remaining: 28.8s. Rate: 160.2 symbols/min [2025-09-17T07:43:44.282235] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-09-17T07:43:44.286001] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-17T07:43:44.286200] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:44.289160] [INFO ] [MAIN ] Derivative Progress: 2096/2172 symbols completed. WFC took 1.2s. Estimated remaining: 28.5s. Rate: 160.2 symbols/min [2025-09-17T07:43:44.289979] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:44.309660] [DEBUG] [MAIN ] WGO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:44.310470] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 39661 primary records. [2025-09-17T07:43:44.310600] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-17T07:43:44.327295] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-09-17T07:43:44.327504] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-17T07:43:44.332688] [INFO ] [MAIN ] Derivative Progress: 2097/2172 symbols completed. WGO took 1.1s. Estimated remaining: 28.1s. Rate: 160.3 symbols/min [2025-09-17T07:43:44.333039] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:44.349377] [DEBUG] [LOCAL ] WHG: Loaded 3423 existing records from primary storage. [2025-09-17T07:43:44.349689] [INFO ] [MAIN ] WHG: Loaded 3423 primary data records. [2025-09-17T07:43:44.474714] [DEBUG] [LOCAL ] WHD: Loaded 40896 existing records from primary storage. [2025-09-17T07:43:44.501362] [INFO ] [MAIN ] WHD: Loaded 40896 primary data records. [2025-09-17T07:43:44.765330] [DEBUG] [LOCAL ] WH: Loaded 45949 existing records from primary storage. [2025-09-17T07:43:44.790406] [INFO ] [MAIN ] WH: Loaded 45949 primary data records. [2025-09-17T07:43:45.353622] [DEBUG] [MAIN ] WHG: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:43:45.355614] [INFO ] [MAIN ] WHG: Generated 1793 derivative records from 3423 primary records. [2025-09-17T07:43:45.356044] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-17T07:43:45.390404] [DEBUG] [MAIN ] WHD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:45.390486] [DEBUG] [LOCAL ] WHG: Derivative data saved (1793 records). [2025-09-17T07:43:45.391479] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40896 primary records. [2025-09-17T07:43:45.391828] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-17T07:43:45.391976] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-17T07:43:45.395252] [INFO ] [MAIN ] Derivative Progress: 2098/2172 symbols completed. WHG took 1.1s. Estimated remaining: 27.7s. Rate: 160.2 symbols/min [2025-09-17T07:43:45.410987] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-09-17T07:43:45.412334] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-17T07:43:45.415846] [INFO ] [MAIN ] Derivative Progress: 2099/2172 symbols completed. WHD took 1.1s. Estimated remaining: 27.3s. Rate: 160.2 symbols/min [2025-09-17T07:43:45.431629] [DEBUG] [MAIN ] WH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:45.432589] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45949 primary records. [2025-09-17T07:43:45.432696] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-17T07:43:45.455184] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-09-17T07:43:45.455415] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-17T07:43:45.458174] [INFO ] [MAIN ] Derivative Progress: 2100/2172 symbols completed. WH took 1.2s. Estimated remaining: 26.9s. Rate: 160.3 symbols/min [2025-09-17T07:43:45.458830] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:45.458896] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:45.459780] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:45.479676] [DEBUG] [LOCAL ] WIA: Loaded 4865 existing records from primary storage. [2025-09-17T07:43:45.479981] [INFO ] [MAIN ] WIA: Loaded 4865 primary data records. [2025-09-17T07:43:45.566502] [DEBUG] [LOCAL ] WINN: Loaded 11989 existing records from primary storage. [2025-09-17T07:43:45.595408] [INFO ] [MAIN ] WINN: Loaded 11989 primary data records. [2025-09-17T07:43:45.987475] [DEBUG] [LOCAL ] WHR: Loaded 48127 existing records from primary storage. [2025-09-17T07:43:46.097354] [INFO ] [MAIN ] WHR: Loaded 48127 primary data records. [2025-09-17T07:43:46.473142] [DEBUG] [MAIN ] WIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:46.475507] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4865 primary records. [2025-09-17T07:43:46.478144] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-17T07:43:46.492701] [DEBUG] [MAIN ] WINN: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:43:46.505666] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11989 primary records. [2025-09-17T07:43:46.506606] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-17T07:43:46.511224] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-09-17T07:43:46.518769] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-17T07:43:46.525104] [INFO ] [MAIN ] Derivative Progress: 2101/2172 symbols completed. WIA took 1.1s. Estimated remaining: 26.6s. Rate: 160.2 symbols/min [2025-09-17T07:43:46.528926] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:46.530733] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-09-17T07:43:46.530903] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-17T07:43:46.534083] [INFO ] [MAIN ] Derivative Progress: 2102/2172 symbols completed. WINN took 1.1s. Estimated remaining: 26.2s. Rate: 160.2 symbols/min [2025-09-17T07:43:46.534986] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:46.564153] [DEBUG] [MAIN ] WHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:46.565295] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48127 primary records. [2025-09-17T07:43:46.571242] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-17T07:43:46.594235] [DEBUG] [LOCAL ] WIW: Loaded 20830 existing records from primary storage. [2025-09-17T07:43:46.595592] [INFO ] [MAIN ] WIW: Loaded 20830 primary data records. [2025-09-17T07:43:46.617908] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-09-17T07:43:46.665297] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-17T07:43:46.714224] [INFO ] [MAIN ] Derivative Progress: 2103/2172 symbols completed. WHR took 1.3s. Estimated remaining: 25.8s. Rate: 160.3 symbols/min [2025-09-17T07:43:46.715599] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:46.771000] [DEBUG] [LOCAL ] WIT: Loaded 52254 existing records from primary storage. [2025-09-17T07:43:46.917970] [INFO ] [MAIN ] WIT: Loaded 52254 primary data records. [2025-09-17T07:43:47.239766] [DEBUG] [LOCAL ] WK: Loaded 36517 existing records from primary storage. [2025-09-17T07:43:47.240250] [INFO ] [MAIN ] WK: Loaded 36517 primary data records. [2025-09-17T07:43:47.438382] [DEBUG] [MAIN ] WIW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:47.558302] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20830 primary records. [2025-09-17T07:43:47.558756] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-17T07:43:47.577800] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-09-17T07:43:47.578535] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-17T07:43:47.582670] [INFO ] [MAIN ] Derivative Progress: 2104/2172 symbols completed. WIW took 1.0s. Estimated remaining: 25.5s. Rate: 160.2 symbols/min [2025-09-17T07:43:47.583327] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:47.598089] [DEBUG] [MAIN ] WIT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:47.598986] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52254 primary records. [2025-09-17T07:43:47.599544] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-17T07:43:47.616731] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-09-17T07:43:47.617937] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-17T07:43:47.621309] [INFO ] [MAIN ] Derivative Progress: 2105/2172 symbols completed. WIT took 1.1s. Estimated remaining: 25.1s. Rate: 160.3 symbols/min [2025-09-17T07:43:47.622376] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:47.636860] [DEBUG] [MAIN ] WK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:47.637600] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 36517 primary records. [2025-09-17T07:43:47.637784] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-17T07:43:47.663758] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-09-17T07:43:47.664546] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-17T07:43:47.667238] [INFO ] [MAIN ] Derivative Progress: 2106/2172 symbols completed. WK took 1.0s. Estimated remaining: 24.7s. Rate: 160.3 symbols/min [2025-09-17T07:43:47.678140] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:47.679856] [DEBUG] [LOCAL ] WKC: Loaded 35368 existing records from primary storage. [2025-09-17T07:43:47.680086] [INFO ] [MAIN ] WKC: Loaded 35368 primary data records. [2025-09-17T07:43:47.785814] [DEBUG] [LOCAL ] WLKP: Loaded 6539 existing records from primary storage. [2025-09-17T07:43:47.800670] [INFO ] [MAIN ] WLKP: Loaded 6539 primary data records. [2025-09-17T07:43:48.108318] [DEBUG] [LOCAL ] WLK: Loaded 45219 existing records from primary storage. [2025-09-17T07:43:48.181442] [INFO ] [MAIN ] WLK: Loaded 45219 primary data records. [2025-09-17T07:43:48.643840] [DEBUG] [MAIN ] WKC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:48.645729] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 35368 primary records. [2025-09-17T07:43:48.645900] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-17T07:43:48.677499] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-09-17T07:43:48.678319] [DEBUG] [MAIN ] WLKP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:48.678390] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-17T07:43:48.679351] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6539 primary records. [2025-09-17T07:43:48.681720] [INFO ] [MAIN ] Derivative Progress: 2107/2172 symbols completed. WKC took 1.1s. Estimated remaining: 24.3s. Rate: 160.2 symbols/min [2025-09-17T07:43:48.682031] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-17T07:43:48.682351] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:48.702821] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-09-17T07:43:48.710585] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-17T07:43:48.718252] [INFO ] [MAIN ] Derivative Progress: 2108/2172 symbols completed. WLKP took 1.0s. Estimated remaining: 24.0s. Rate: 160.3 symbols/min [2025-09-17T07:43:48.715569] [DEBUG] [MAIN ] WLK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:48.718547] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:48.719325] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45219 primary records. [2025-09-17T07:43:48.719744] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-17T07:43:48.744744] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-09-17T07:43:48.744922] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-17T07:43:48.747743] [INFO ] [MAIN ] Derivative Progress: 2109/2172 symbols completed. WLK took 1.1s. Estimated remaining: 23.6s. Rate: 160.3 symbols/min [2025-09-17T07:43:48.748130] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:48.760314] [DEBUG] [LOCAL ] WLY: Loaded 30570 existing records from primary storage. [2025-09-17T07:43:48.760494] [INFO ] [MAIN ] WLY: Loaded 30570 primary data records. [2025-09-17T07:43:49.104096] [DEBUG] [LOCAL ] WM: Loaded 51022 existing records from primary storage. [2025-09-17T07:43:49.105778] [INFO ] [MAIN ] WM: Loaded 51022 primary data records. [2025-09-17T07:43:49.225066] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-17T07:43:49.231272] [INFO ] [MAIN ] WMB: Loaded 53671 primary data records. [2025-09-17T07:43:49.716059] [DEBUG] [MAIN ] WLY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:49.717126] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 30570 primary records. [2025-09-17T07:43:49.718096] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-17T07:43:49.736249] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-09-17T07:43:49.736668] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-17T07:43:49.739016] [INFO ] [MAIN ] Derivative Progress: 2110/2172 symbols completed. WLY took 1.1s. Estimated remaining: 23.2s. Rate: 160.2 symbols/min [2025-09-17T07:43:49.739909] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:49.757249] [DEBUG] [MAIN ] WM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:49.757993] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 51022 primary records. [2025-09-17T07:43:49.758331] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-17T07:43:49.777857] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-09-17T07:43:49.783051] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-17T07:43:49.785997] [INFO ] [MAIN ] Derivative Progress: 2111/2172 symbols completed. WM took 1.1s. Estimated remaining: 22.8s. Rate: 160.3 symbols/min [2025-09-17T07:43:49.786369] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:49.786854] [DEBUG] [LOCAL ] WMK: Loaded 14403 existing records from primary storage. [2025-09-17T07:43:49.788170] [INFO ] [MAIN ] WMK: Loaded 14403 primary data records. [2025-09-17T07:43:49.904811] [DEBUG] [MAIN ] WMB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:49.932404] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53671 primary records. [2025-09-17T07:43:49.979546] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-17T07:43:50.127126] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-09-17T07:43:50.138556] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-17T07:43:50.142259] [INFO ] [MAIN ] Derivative Progress: 2112/2172 symbols completed. WMB took 1.4s. Estimated remaining: 22.5s. Rate: 160.3 symbols/min [2025-09-17T07:43:50.143694] [DEBUG] [LOCAL ] WMS: Loaded 39558 existing records from primary storage. [2025-09-17T07:43:50.145062] [INFO ] [MAIN ] WMS: Loaded 39558 primary data records. [2025-09-17T07:43:50.145510] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:50.489060] [DEBUG] [MAIN ] WMK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:50.490197] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14403 primary records. [2025-09-17T07:43:50.490401] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-17T07:43:50.523816] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-09-17T07:43:50.524576] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-17T07:43:50.526826] [INFO ] [MAIN ] Derivative Progress: 2113/2172 symbols completed. WMK took 0.8s. Estimated remaining: 22.1s. Rate: 160.3 symbols/min [2025-09-17T07:43:50.543920] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-09-17T07:43:50.544289] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-09-17T07:43:50.850343] [DEBUG] [MAIN ] WMS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:50.851165] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39558 primary records. [2025-09-17T07:43:50.851354] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-17T07:43:50.868930] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-09-17T07:43:50.869381] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-17T07:43:50.871612] [INFO ] [MAIN ] Derivative Progress: 2114/2172 symbols completed. WMS took 1.1s. Estimated remaining: 21.7s. Rate: 160.3 symbols/min [2025-09-17T07:43:50.890597] [DEBUG] [MAIN ] WMT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:50.891293] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-09-17T07:43:50.891369] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-17T07:43:50.906556] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-09-17T07:43:50.906627] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-17T07:43:50.908719] [INFO ] [MAIN ] Derivative Progress: 2115/2172 symbols completed. WMT took 0.8s. Estimated remaining: 21.3s. Rate: 160.3 symbols/min [2025-09-17T07:43:50.909359] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:50.909500] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:50.909446] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:50.955596] [DEBUG] [LOCAL ] WNS: Loaded 39684 existing records from primary storage. [2025-09-17T07:43:50.964008] [INFO ] [MAIN ] WNS: Loaded 39684 primary data records. [2025-09-17T07:43:51.116722] [DEBUG] [LOCAL ] WNC: Loaded 40771 existing records from primary storage. [2025-09-17T07:43:51.167243] [INFO ] [MAIN ] WNC: Loaded 40771 primary data records. [2025-09-17T07:43:51.189253] [DEBUG] [LOCAL ] WOLF: Loaded 53532 existing records from primary storage. [2025-09-17T07:43:51.189496] [INFO ] [MAIN ] WOLF: Loaded 53532 primary data records. [2025-09-17T07:43:51.925040] [DEBUG] [MAIN ] WNS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:51.926238] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 39684 primary records. [2025-09-17T07:43:51.926944] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-17T07:43:51.947806] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-09-17T07:43:51.948865] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-17T07:43:51.963103] [INFO ] [MAIN ] Derivative Progress: 2116/2172 symbols completed. WNS took 1.1s. Estimated remaining: 21.0s. Rate: 160.2 symbols/min [2025-09-17T07:43:51.963627] [DEBUG] [MAIN ] WOLF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:51.964670] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53532 primary records. [2025-09-17T07:43:51.964924] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-17T07:43:51.976743] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:51.986021] [DEBUG] [MAIN ] WNC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:51.986691] [INFO ] [MAIN ] WNC: Generated 1794 derivative records from 40771 primary records. [2025-09-17T07:43:51.990379] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-17T07:43:51.995598] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-09-17T07:43:51.996330] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-17T07:43:51.998796] [INFO ] [MAIN ] Derivative Progress: 2117/2172 symbols completed. WOLF took 1.1s. Estimated remaining: 20.6s. Rate: 160.3 symbols/min [2025-09-17T07:43:51.999054] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:52.015011] [DEBUG] [LOCAL ] WNC: Derivative data saved (1794 records). [2025-09-17T07:43:52.015375] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-17T07:43:52.018996] [INFO ] [MAIN ] Derivative Progress: 2118/2172 symbols completed. WNC took 1.1s. Estimated remaining: 20.2s. Rate: 160.4 symbols/min [2025-09-17T07:43:52.019338] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:52.040865] [DEBUG] [LOCAL ] WOR: Loaded 24797 existing records from primary storage. [2025-09-17T07:43:52.047600] [INFO ] [MAIN ] WOR: Loaded 24797 primary data records. [2025-09-17T07:43:52.161882] [DEBUG] [LOCAL ] WOW: Loaded 29596 existing records from primary storage. [2025-09-17T07:43:52.189069] [INFO ] [MAIN ] WOW: Loaded 29596 primary data records. [2025-09-17T07:43:52.494659] [DEBUG] [LOCAL ] WPC: Loaded 48812 existing records from primary storage. [2025-09-17T07:43:52.514112] [INFO ] [MAIN ] WPC: Loaded 48812 primary data records. [2025-09-17T07:43:53.059559] [DEBUG] [MAIN ] WOR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:53.060745] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24797 primary records. [2025-09-17T07:43:53.062408] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-17T07:43:53.094531] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-09-17T07:43:53.095171] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-17T07:43:53.095043] [DEBUG] [MAIN ] WOW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:53.097535] [INFO ] [MAIN ] Derivative Progress: 2119/2172 symbols completed. WOR took 1.1s. Estimated remaining: 19.8s. Rate: 160.2 symbols/min [2025-09-17T07:43:53.098693] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 29596 primary records. [2025-09-17T07:43:53.099034] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-17T07:43:53.099368] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:53.128438] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-09-17T07:43:53.133871] [DEBUG] [MAIN ] WPC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:53.133927] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-17T07:43:53.134692] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48812 primary records. [2025-09-17T07:43:53.136805] [INFO ] [MAIN ] Derivative Progress: 2120/2172 symbols completed. WOW took 1.1s. Estimated remaining: 19.5s. Rate: 160.3 symbols/min [2025-09-17T07:43:53.137055] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-17T07:43:53.137715] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:53.154867] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-09-17T07:43:53.155031] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-17T07:43:53.157560] [INFO ] [MAIN ] Derivative Progress: 2121/2172 symbols completed. WPC took 1.1s. Estimated remaining: 19.1s. Rate: 160.3 symbols/min [2025-09-17T07:43:53.157935] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:53.209001] [DEBUG] [LOCAL ] WPM: Loaded 52724 existing records from primary storage. [2025-09-17T07:43:53.209365] [INFO ] [MAIN ] WPM: Loaded 52724 primary data records. [2025-09-17T07:43:53.342591] [DEBUG] [LOCAL ] WPP: Loaded 33614 existing records from primary storage. [2025-09-17T07:43:53.353986] [INFO ] [MAIN ] WPP: Loaded 33614 primary data records. [2025-09-17T07:43:53.610249] [DEBUG] [LOCAL ] WRB: Loaded 50593 existing records from primary storage. [2025-09-17T07:43:53.643270] [INFO ] [MAIN ] WRB: Loaded 50593 primary data records. [2025-09-17T07:43:54.240460] [DEBUG] [MAIN ] WPM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:54.241725] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52724 primary records. [2025-09-17T07:43:54.241956] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-17T07:43:54.259616] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-09-17T07:43:54.261209] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-17T07:43:54.263365] [INFO ] [MAIN ] Derivative Progress: 2122/2172 symbols completed. WPM took 1.2s. Estimated remaining: 18.7s. Rate: 160.2 symbols/min [2025-09-17T07:43:54.263895] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:54.277272] [DEBUG] [MAIN ] WPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:54.278278] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 33614 primary records. [2025-09-17T07:43:54.278470] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-17T07:43:54.297331] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-09-17T07:43:54.309765] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-17T07:43:54.310133] [DEBUG] [MAIN ] WRB: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:54.312172] [INFO ] [MAIN ] Derivative Progress: 2123/2172 symbols completed. WPP took 1.2s. Estimated remaining: 18.3s. Rate: 160.3 symbols/min [2025-09-17T07:43:54.313157] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50593 primary records. [2025-09-17T07:43:54.313304] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-17T07:43:54.313464] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:54.330170] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-09-17T07:43:54.330360] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-17T07:43:54.332849] [INFO ] [MAIN ] Derivative Progress: 2124/2172 symbols completed. WRB took 1.2s. Estimated remaining: 18.0s. Rate: 160.3 symbols/min [2025-09-17T07:43:54.333306] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:54.365621] [DEBUG] [LOCAL ] WS: Loaded 23971 existing records from primary storage. [2025-09-17T07:43:54.365844] [INFO ] [MAIN ] WS: Loaded 23971 primary data records. [2025-09-17T07:43:54.451431] [DEBUG] [LOCAL ] WRBY: Loaded 50932 existing records from primary storage. [2025-09-17T07:43:54.483105] [INFO ] [MAIN ] WRBY: Loaded 50932 primary data records. [2025-09-17T07:43:54.836505] [DEBUG] [LOCAL ] WSM: Loaded 50190 existing records from primary storage. [2025-09-17T07:43:54.851975] [INFO ] [MAIN ] WSM: Loaded 50190 primary data records. [2025-09-17T07:43:55.398773] [DEBUG] [MAIN ] WS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:55.402186] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23971 primary records. [2025-09-17T07:43:55.402340] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-17T07:43:55.427172] [DEBUG] [MAIN ] WRBY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:55.430701] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50932 primary records. [2025-09-17T07:43:55.431657] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-09-17T07:43:55.431935] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-17T07:43:55.432010] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-17T07:43:55.434686] [INFO ] [MAIN ] Derivative Progress: 2125/2172 symbols completed. WS took 1.1s. Estimated remaining: 17.6s. Rate: 160.2 symbols/min [2025-09-17T07:43:55.435539] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:55.455924] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-09-17T07:43:55.456288] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-17T07:43:55.459063] [INFO ] [MAIN ] Derivative Progress: 2126/2172 symbols completed. WRBY took 1.2s. Estimated remaining: 17.2s. Rate: 160.3 symbols/min [2025-09-17T07:43:55.459919] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:55.496596] [DEBUG] [MAIN ] WSM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:55.499203] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 50190 primary records. [2025-09-17T07:43:55.500488] [DEBUG] [LOCAL ] WSO: Loaded 24633 existing records from primary storage. [2025-09-17T07:43:55.500612] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-17T07:43:55.500863] [INFO ] [MAIN ] WSO: Loaded 24633 primary data records. [2025-09-17T07:43:55.599976] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-09-17T07:43:55.644052] [DEBUG] [LOCAL ] WSR: Loaded 23492 existing records from primary storage. [2025-09-17T07:43:55.643072] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-17T07:43:55.649757] [INFO ] [MAIN ] WSR: Loaded 23492 primary data records. [2025-09-17T07:43:55.652104] [INFO ] [MAIN ] Derivative Progress: 2127/2172 symbols completed. WSM took 1.3s. Estimated remaining: 16.8s. Rate: 160.3 symbols/min [2025-09-17T07:43:55.740235] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:56.179268] [DEBUG] [LOCAL ] WST: Loaded 38122 existing records from primary storage. [2025-09-17T07:43:56.180942] [INFO ] [MAIN ] WST: Loaded 38122 primary data records. [2025-09-17T07:43:56.286931] [DEBUG] [MAIN ] WSO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:56.299715] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 24633 primary records. [2025-09-17T07:43:56.305468] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-17T07:43:56.577755] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-09-17T07:43:56.587372] [DEBUG] [MAIN ] WSR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:56.587619] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-17T07:43:56.590698] [INFO ] [MAIN ] Derivative Progress: 2128/2172 symbols completed. WSO took 1.2s. Estimated remaining: 16.5s. Rate: 160.2 symbols/min [2025-09-17T07:43:56.588336] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 23492 primary records. [2025-09-17T07:43:56.591179] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-17T07:43:56.609320] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-09-17T07:43:56.609461] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-17T07:43:56.611731] [INFO ] [MAIN ] Derivative Progress: 2129/2172 symbols completed. WSR took 1.2s. Estimated remaining: 16.1s. Rate: 160.3 symbols/min [2025-09-17T07:43:56.630677] [DEBUG] [MAIN ] WST: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:56.631285] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 38122 primary records. [2025-09-17T07:43:56.631359] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-17T07:43:56.646811] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-09-17T07:43:56.646885] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-17T07:43:56.648880] [INFO ] [MAIN ] Derivative Progress: 2130/2172 symbols completed. WST took 0.9s. Estimated remaining: 15.7s. Rate: 160.3 symbols/min [2025-09-17T07:43:56.649423] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:56.649518] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:56.649275] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:56.723065] [DEBUG] [LOCAL ] WTI: Loaded 43681 existing records from primary storage. [2025-09-17T07:43:56.754494] [INFO ] [MAIN ] WTI: Loaded 43681 primary data records. [2025-09-17T07:43:56.754327] [DEBUG] [LOCAL ] WTRG: Loaded 50955 existing records from primary storage. [2025-09-17T07:43:56.754996] [INFO ] [MAIN ] WTRG: Loaded 50955 primary data records. [2025-09-17T07:43:56.756059] [DEBUG] [LOCAL ] WT: Loaded 47538 existing records from primary storage. [2025-09-17T07:43:56.830832] [INFO ] [MAIN ] WT: Loaded 47538 primary data records. [2025-09-17T07:43:57.711000] [DEBUG] [MAIN ] WTI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:57.712197] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 43681 primary records. [2025-09-17T07:43:57.712798] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-17T07:43:57.730811] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-09-17T07:43:57.732561] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-17T07:43:57.736311] [INFO ] [MAIN ] Derivative Progress: 2131/2172 symbols completed. WTI took 1.1s. Estimated remaining: 15.4s. Rate: 160.2 symbols/min [2025-09-17T07:43:57.736877] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:57.752544] [DEBUG] [MAIN ] WTRG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:57.766171] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50955 primary records. [2025-09-17T07:43:57.766793] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-17T07:43:57.766472] [DEBUG] [MAIN ] WT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:57.767542] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47538 primary records. [2025-09-17T07:43:57.768138] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-17T07:43:57.807654] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-09-17T07:43:57.805627] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-09-17T07:43:57.808139] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-17T07:43:57.808231] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-17T07:43:57.810864] [INFO ] [MAIN ] Derivative Progress: 2132/2172 symbols completed. WT took 1.2s. Estimated remaining: 15.0s. Rate: 160.2 symbols/min [2025-09-17T07:43:57.820296] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:57.820388] [INFO ] [MAIN ] Derivative Progress: 2133/2172 symbols completed. WTRG took 1.2s. Estimated remaining: 14.6s. Rate: 160.3 symbols/min [2025-09-17T07:43:57.820756] [DEBUG] [LOCAL ] WTS: Loaded 18759 existing records from primary storage. [2025-09-17T07:43:57.821470] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:57.821598] [INFO ] [MAIN ] WTS: Loaded 18759 primary data records. [2025-09-17T07:43:58.165821] [DEBUG] [LOCAL ] WTTR: Loaded 45096 existing records from primary storage. [2025-09-17T07:43:58.166727] [INFO ] [MAIN ] WTTR: Loaded 45096 primary data records. [2025-09-17T07:43:58.236233] [DEBUG] [LOCAL ] WU: Loaded 53445 existing records from primary storage. [2025-09-17T07:43:58.259570] [INFO ] [MAIN ] WU: Loaded 53445 primary data records. [2025-09-17T07:43:58.732510] [DEBUG] [MAIN ] WTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:58.843319] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 18759 primary records. [2025-09-17T07:43:58.843581] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-17T07:43:58.864948] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-09-17T07:43:58.865700] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-17T07:43:58.867798] [INFO ] [MAIN ] Derivative Progress: 2134/2172 symbols completed. WTS took 1.1s. Estimated remaining: 14.2s. Rate: 160.2 symbols/min [2025-09-17T07:43:58.868152] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:58.887535] [DEBUG] [MAIN ] WTTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:58.888281] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 45096 primary records. [2025-09-17T07:43:58.888597] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-17T07:43:58.919633] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-09-17T07:43:58.920032] [DEBUG] [MAIN ] WU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:58.920194] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-17T07:43:58.922167] [INFO ] [MAIN ] Derivative Progress: 2135/2172 symbols completed. WTTR took 1.1s. Estimated remaining: 13.9s. Rate: 160.2 symbols/min [2025-09-17T07:43:58.922907] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53445 primary records. [2025-09-17T07:43:58.923185] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:58.923291] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-17T07:43:58.951125] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-09-17T07:43:58.951448] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-17T07:43:58.954712] [INFO ] [MAIN ] Derivative Progress: 2136/2172 symbols completed. WU took 1.1s. Estimated remaining: 13.5s. Rate: 160.3 symbols/min [2025-09-17T07:43:58.955261] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:58.974805] [DEBUG] [LOCAL ] WWW: Loaded 49115 existing records from primary storage. [2025-09-17T07:43:58.975023] [INFO ] [MAIN ] WWW: Loaded 49115 primary data records. [2025-09-17T07:43:59.316048] [DEBUG] [LOCAL ] WY: Loaded 53109 existing records from primary storage. [2025-09-17T07:43:59.317045] [DEBUG] [LOCAL ] XFLT: Loaded 29797 existing records from primary storage. [2025-09-17T07:43:59.317332] [INFO ] [MAIN ] XFLT: Loaded 29797 primary data records. [2025-09-17T07:43:59.317281] [INFO ] [MAIN ] WY: Loaded 53109 primary data records. [2025-09-17T07:43:59.934189] [DEBUG] [MAIN ] WWW: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:59.937291] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49115 primary records. [2025-09-17T07:43:59.937891] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-17T07:43:59.959223] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-09-17T07:43:59.959867] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-17T07:43:59.961920] [INFO ] [MAIN ] Derivative Progress: 2137/2172 symbols completed. WWW took 1.1s. Estimated remaining: 13.1s. Rate: 160.2 symbols/min [2025-09-17T07:43:59.962630] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:43:59.982234] [DEBUG] [MAIN ] XFLT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:43:59.986935] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29797 primary records. [2025-09-17T07:43:59.987437] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-17T07:44:00.014237] [DEBUG] [MAIN ] WY: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:00.020475] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53109 primary records. [2025-09-17T07:44:00.019166] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-09-17T07:44:00.020791] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-17T07:44:00.020834] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-17T07:44:00.024585] [INFO ] [MAIN ] Derivative Progress: 2138/2172 symbols completed. XFLT took 1.1s. Estimated remaining: 12.7s. Rate: 160.2 symbols/min [2025-09-17T07:44:00.050727] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-09-17T07:44:00.047979] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:00.051072] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-17T07:44:00.054123] [INFO ] [MAIN ] Derivative Progress: 2139/2172 symbols completed. WY took 1.1s. Estimated remaining: 12.4s. Rate: 160.3 symbols/min [2025-09-17T07:44:00.054964] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:00.071808] [DEBUG] [LOCAL ] XHR: Loaded 44490 existing records from primary storage. [2025-09-17T07:44:00.072415] [INFO ] [MAIN ] XHR: Loaded 44490 primary data records. [2025-09-17T07:44:00.276208] [DEBUG] [LOCAL ] XPER: Loaded 29576 existing records from primary storage. [2025-09-17T07:44:00.312365] [INFO ] [MAIN ] XPER: Loaded 29576 primary data records. [2025-09-17T07:44:00.619731] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-17T07:44:00.621225] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-09-17T07:44:01.169018] [DEBUG] [MAIN ] XHR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:01.171206] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 44490 primary records. [2025-09-17T07:44:01.172310] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-17T07:44:01.192969] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-09-17T07:44:01.196729] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-17T07:44:01.199630] [INFO ] [MAIN ] Derivative Progress: 2140/2172 symbols completed. XHR took 1.2s. Estimated remaining: 12.0s. Rate: 160.2 symbols/min [2025-09-17T07:44:01.213060] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:01.213964] [DEBUG] [MAIN ] XPER: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:01.216077] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 29576 primary records. [2025-09-17T07:44:01.216346] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-17T07:44:01.237802] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-09-17T07:44:01.237952] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-17T07:44:01.240569] [INFO ] [MAIN ] Derivative Progress: 2141/2172 symbols completed. XPER took 1.2s. Estimated remaining: 11.6s. Rate: 160.2 symbols/min [2025-09-17T07:44:01.241166] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:01.255219] [DEBUG] [MAIN ] XOM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:01.257856] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-09-17T07:44:01.258024] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-17T07:44:01.276257] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-09-17T07:44:01.277097] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-17T07:44:01.281226] [INFO ] [MAIN ] Derivative Progress: 2142/2172 symbols completed. XOM took 1.2s. Estimated remaining: 11.2s. Rate: 160.3 symbols/min [2025-09-17T07:44:01.281992] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:01.342306] [DEBUG] [LOCAL ] XPEV: Loaded 53647 existing records from primary storage. [2025-09-17T07:44:01.342629] [INFO ] [MAIN ] XPEV: Loaded 53647 primary data records. [2025-09-17T07:44:01.492614] [DEBUG] [LOCAL ] XPOF: Loaded 38918 existing records from primary storage. [2025-09-17T07:44:01.493358] [INFO ] [MAIN ] XPOF: Loaded 38918 primary data records. [2025-09-17T07:44:01.499977] [DEBUG] [LOCAL ] XPO: Loaded 48336 existing records from primary storage. [2025-09-17T07:44:01.567700] [INFO ] [MAIN ] XPO: Loaded 48336 primary data records. [2025-09-17T07:44:02.370666] [DEBUG] [MAIN ] XPEV: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:02.373071] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53647 primary records. [2025-09-17T07:44:02.373768] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-17T07:44:02.394770] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-09-17T07:44:02.396812] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-17T07:44:02.399211] [INFO ] [MAIN ] Derivative Progress: 2143/2172 symbols completed. XPEV took 1.2s. Estimated remaining: 10.9s. Rate: 160.1 symbols/min [2025-09-17T07:44:02.415892] [DEBUG] [MAIN ] XPOF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:02.428574] [DEBUG] [MAIN ] XPO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:02.430027] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 48336 primary records. [2025-09-17T07:44:02.429352] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 38918 primary records. [2025-09-17T07:44:02.430162] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-17T07:44:02.430225] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-17T07:44:02.459014] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-09-17T07:44:02.461885] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-17T07:44:02.462988] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-09-17T07:44:02.465651] [INFO ] [MAIN ] Derivative Progress: 2144/2172 symbols completed. XPOF took 1.2s. Estimated remaining: 10.5s. Rate: 160.2 symbols/min [2025-09-17T07:44:02.465805] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-17T07:44:02.468544] [INFO ] [MAIN ] Derivative Progress: 2145/2172 symbols completed. XPO took 1.2s. Estimated remaining: 10.1s. Rate: 160.3 symbols/min [2025-09-17T07:44:02.468991] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:02.469132] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:02.469567] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:02.504707] [DEBUG] [LOCAL ] XYF: Loaded 27636 existing records from primary storage. [2025-09-17T07:44:02.504885] [INFO ] [MAIN ] XYF: Loaded 27636 primary data records. [2025-09-17T07:44:02.627812] [DEBUG] [LOCAL ] YALA: Loaded 37282 existing records from primary storage. [2025-09-17T07:44:02.644009] [INFO ] [MAIN ] YALA: Loaded 37282 primary data records. [2025-09-17T07:44:02.773790] [DEBUG] [LOCAL ] XYL: Loaded 48228 existing records from primary storage. [2025-09-17T07:44:02.936776] [INFO ] [MAIN ] XYL: Loaded 48228 primary data records. [2025-09-17T07:44:03.454945] [DEBUG] [MAIN ] XYF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:03.458064] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 27636 primary records. [2025-09-17T07:44:03.470839] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-17T07:44:03.471734] [DEBUG] [MAIN ] YALA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:03.472583] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 37282 primary records. [2025-09-17T07:44:03.473736] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-17T07:44:03.504252] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-09-17T07:44:03.506315] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-09-17T07:44:03.514080] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-17T07:44:03.520752] [INFO ] [MAIN ] Derivative Progress: 2146/2172 symbols completed. XYF took 1.1s. Estimated remaining: 9.7s. Rate: 160.1 symbols/min [2025-09-17T07:44:03.520901] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-17T07:44:03.521180] [DEBUG] [MAIN ] XYL: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:03.521442] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:03.522142] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 48228 primary records. [2025-09-17T07:44:03.524629] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-17T07:44:03.524223] [INFO ] [MAIN ] Derivative Progress: 2147/2172 symbols completed. YALA took 1.1s. Estimated remaining: 9.4s. Rate: 160.2 symbols/min [2025-09-17T07:44:03.525006] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:03.541820] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-09-17T07:44:03.542060] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-17T07:44:03.544714] [INFO ] [MAIN ] Derivative Progress: 2148/2172 symbols completed. XYL took 1.1s. Estimated remaining: 9.0s. Rate: 160.3 symbols/min [2025-09-17T07:44:03.545017] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:03.621110] [DEBUG] [LOCAL ] YEXT: Loaded 43384 existing records from primary storage. [2025-09-17T07:44:03.621306] [INFO ] [MAIN ] YEXT: Loaded 43384 primary data records. [2025-09-17T07:44:03.622440] [DEBUG] [LOCAL ] YELP: Loaded 45380 existing records from primary storage. [2025-09-17T07:44:03.634407] [INFO ] [MAIN ] YELP: Loaded 45380 primary data records. [2025-09-17T07:44:03.779740] [DEBUG] [LOCAL ] YETI: Loaded 52519 existing records from primary storage. [2025-09-17T07:44:03.814950] [INFO ] [MAIN ] YETI: Loaded 52519 primary data records. [2025-09-17T07:44:04.582238] [DEBUG] [MAIN ] YEXT: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:04.583920] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43384 primary records. [2025-09-17T07:44:04.585011] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-17T07:44:04.599695] [DEBUG] [MAIN ] YELP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:04.607281] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45380 primary records. [2025-09-17T07:44:04.607571] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-17T07:44:04.616269] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-09-17T07:44:04.616484] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-17T07:44:04.626873] [INFO ] [MAIN ] Derivative Progress: 2149/2172 symbols completed. YEXT took 1.1s. Estimated remaining: 8.6s. Rate: 160.2 symbols/min [2025-09-17T07:44:04.628450] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:04.636364] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-09-17T07:44:04.636926] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-17T07:44:04.651718] [INFO ] [MAIN ] Derivative Progress: 2150/2172 symbols completed. YELP took 1.1s. Estimated remaining: 8.2s. Rate: 160.2 symbols/min [2025-09-17T07:44:04.652014] [DEBUG] [MAIN ] YETI: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:04.653102] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52519 primary records. [2025-09-17T07:44:04.652502] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:04.653279] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-17T07:44:04.669951] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-09-17T07:44:04.670191] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-17T07:44:04.672903] [INFO ] [MAIN ] Derivative Progress: 2151/2172 symbols completed. YETI took 1.1s. Estimated remaining: 7.9s. Rate: 160.3 symbols/min [2025-09-17T07:44:04.673157] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:04.737765] [DEBUG] [LOCAL ] YOU: Loaded 49976 existing records from primary storage. [2025-09-17T07:44:04.757856] [INFO ] [MAIN ] YOU: Loaded 49976 primary data records. [2025-09-17T07:44:04.780284] [DEBUG] [LOCAL ] YMM: Loaded 52714 existing records from primary storage. [2025-09-17T07:44:04.835032] [INFO ] [MAIN ] YMM: Loaded 52714 primary data records. [2025-09-17T07:44:04.881400] [DEBUG] [LOCAL ] YPF: Loaded 50473 existing records from primary storage. [2025-09-17T07:44:04.949830] [INFO ] [MAIN ] YPF: Loaded 50473 primary data records. [2025-09-17T07:44:05.749223] [DEBUG] [MAIN ] YOU: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:05.750308] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49976 primary records. [2025-09-17T07:44:05.750878] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-17T07:44:05.767712] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-09-17T07:44:05.769364] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-17T07:44:05.773247] [INFO ] [MAIN ] Derivative Progress: 2152/2172 symbols completed. YOU took 1.1s. Estimated remaining: 7.5s. Rate: 160.1 symbols/min [2025-09-17T07:44:05.774320] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:05.799623] [DEBUG] [MAIN ] YMM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:05.799859] [DEBUG] [MAIN ] YPF: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:05.800754] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52714 primary records. [2025-09-17T07:44:05.800864] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-17T07:44:05.801326] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50473 primary records. [2025-09-17T07:44:05.802071] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-17T07:44:05.839316] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-09-17T07:44:05.838901] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-09-17T07:44:05.844609] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-17T07:44:05.848718] [INFO ] [MAIN ] Derivative Progress: 2153/2172 symbols completed. YMM took 1.2s. Estimated remaining: 7.1s. Rate: 160.2 symbols/min [2025-09-17T07:44:05.844756] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-17T07:44:05.844456] [DEBUG] [LOCAL ] YRD: Loaded 12652 existing records from primary storage. [2025-09-17T07:44:05.851553] [INFO ] [MAIN ] Derivative Progress: 2154/2172 symbols completed. YPF took 1.2s. Estimated remaining: 6.7s. Rate: 160.3 symbols/min [2025-09-17T07:44:05.849019] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:05.851801] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:05.852504] [INFO ] [MAIN ] YRD: Loaded 12652 primary data records. [2025-09-17T07:44:06.153575] [DEBUG] [LOCAL ] YSG: Loaded 24539 existing records from primary storage. [2025-09-17T07:44:06.153832] [INFO ] [MAIN ] YSG: Loaded 24539 primary data records. [2025-09-17T07:44:06.365696] [DEBUG] [LOCAL ] YUM: Loaded 51307 existing records from primary storage. [2025-09-17T07:44:06.366137] [INFO ] [MAIN ] YUM: Loaded 51307 primary data records. [2025-09-17T07:44:06.893864] [DEBUG] [MAIN ] YRD: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:06.895333] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 12652 primary records. [2025-09-17T07:44:06.896111] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-17T07:44:06.913309] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-09-17T07:44:06.914292] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-17T07:44:06.916866] [INFO ] [MAIN ] Derivative Progress: 2155/2172 symbols completed. YRD took 1.1s. Estimated remaining: 6.4s. Rate: 160.1 symbols/min [2025-09-17T07:44:06.917592] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:06.935123] [DEBUG] [MAIN ] YSG: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:06.936304] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 24539 primary records. [2025-09-17T07:44:06.936508] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-17T07:44:06.954230] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-09-17T07:44:06.956088] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-17T07:44:06.958483] [INFO ] [MAIN ] Derivative Progress: 2156/2172 symbols completed. YSG took 1.1s. Estimated remaining: 6.0s. Rate: 160.2 symbols/min [2025-09-17T07:44:06.959177] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:06.972783] [DEBUG] [MAIN ] YUM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:06.973473] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51307 primary records. [2025-09-17T07:44:06.973677] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-17T07:44:06.990401] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-09-17T07:44:06.990525] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-17T07:44:06.993244] [INFO ] [MAIN ] Derivative Progress: 2157/2172 symbols completed. YUM took 1.1s. Estimated remaining: 5.6s. Rate: 160.3 symbols/min [2025-09-17T07:44:07.007294] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:07.031726] [DEBUG] [LOCAL ] YUMC: Loaded 52731 existing records from primary storage. [2025-09-17T07:44:07.038403] [INFO ] [MAIN ] YUMC: Loaded 52731 primary data records. [2025-09-17T07:44:07.038194] [DEBUG] [LOCAL ] ZEPP: Loaded 15909 existing records from primary storage. [2025-09-17T07:44:07.059821] [INFO ] [MAIN ] ZEPP: Loaded 15909 primary data records. [2025-09-17T07:44:07.379266] [DEBUG] [LOCAL ] ZBH: Loaded 51201 existing records from primary storage. [2025-09-17T07:44:07.494814] [INFO ] [MAIN ] ZBH: Loaded 51201 primary data records. [2025-09-17T07:44:07.978332] [DEBUG] [MAIN ] YUMC: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:07.979582] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52731 primary records. [2025-09-17T07:44:07.979711] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-17T07:44:08.005004] [DEBUG] [MAIN ] ZEPP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:08.009840] [INFO ] [MAIN ] ZEPP: Generated 1794 derivative records from 15909 primary records. [2025-09-17T07:44:08.010424] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-09-17T07:44:08.010691] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-17T07:44:08.010784] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-17T07:44:08.012790] [INFO ] [MAIN ] Derivative Progress: 2158/2172 symbols completed. YUMC took 1.1s. Estimated remaining: 5.2s. Rate: 160.1 symbols/min [2025-09-17T07:44:08.028985] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1794 records). [2025-09-17T07:44:08.029774] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-17T07:44:08.032379] [INFO ] [MAIN ] Derivative Progress: 2159/2172 symbols completed. ZEPP took 1.0s. Estimated remaining: 4.9s. Rate: 160.2 symbols/min [2025-09-17T07:44:08.045401] [DEBUG] [MAIN ] ZBH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:08.045995] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 51201 primary records. [2025-09-17T07:44:08.046069] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-17T07:44:08.061436] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-09-17T07:44:08.061535] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-17T07:44:08.063759] [INFO ] [MAIN ] Derivative Progress: 2160/2172 symbols completed. ZBH took 1.1s. Estimated remaining: 4.5s. Rate: 160.3 symbols/min [2025-09-17T07:44:08.064511] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:08.064786] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:08.064726] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:08.102635] [DEBUG] [LOCAL ] ZH: Loaded 27365 existing records from primary storage. [2025-09-17T07:44:08.102865] [INFO ] [MAIN ] ZH: Loaded 27365 primary data records. [2025-09-17T07:44:08.253123] [DEBUG] [LOCAL ] ZGN: Loaded 40934 existing records from primary storage. [2025-09-17T07:44:08.298236] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-17T07:44:08.325843] [INFO ] [MAIN ] ZGN: Loaded 40934 primary data records. [2025-09-17T07:44:08.329610] [INFO ] [MAIN ] ZETA: Loaded 53595 primary data records. [2025-09-17T07:44:09.130225] [DEBUG] [MAIN ] ZH: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:09.131423] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 27365 primary records. [2025-09-17T07:44:09.131755] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-17T07:44:09.150155] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-09-17T07:44:09.150808] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-17T07:44:09.152962] [INFO ] [MAIN ] Derivative Progress: 2161/2172 symbols completed. ZH took 1.1s. Estimated remaining: 4.1s. Rate: 160.1 symbols/min [2025-09-17T07:44:09.153582] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:09.173586] [DEBUG] [MAIN ] ZETA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:09.187007] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53595 primary records. [2025-09-17T07:44:09.187342] [DEBUG] [MAIN ] ZGN: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:09.187628] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-17T07:44:09.188245] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40934 primary records. [2025-09-17T07:44:09.189223] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-17T07:44:09.206793] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-09-17T07:44:09.214748] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-17T07:44:09.225224] [INFO ] [MAIN ] Derivative Progress: 2162/2172 symbols completed. ZETA took 1.2s. Estimated remaining: 3.7s. Rate: 160.2 symbols/min [2025-09-17T07:44:09.225593] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:09.225722] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-09-17T07:44:09.226311] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-17T07:44:09.228897] [INFO ] [MAIN ] Derivative Progress: 2163/2172 symbols completed. ZGN took 1.2s. Estimated remaining: 3.4s. Rate: 160.3 symbols/min [2025-09-17T07:44:09.229324] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:09.271454] [DEBUG] [LOCAL ] ZIM: Loaded 53554 existing records from primary storage. [2025-09-17T07:44:09.271684] [INFO ] [MAIN ] ZIM: Loaded 53554 primary data records. [2025-09-17T07:44:09.428423] [DEBUG] [LOCAL ] ZK: Loaded 40092 existing records from primary storage. [2025-09-17T07:44:09.441141] [INFO ] [MAIN ] ZK: Loaded 40092 primary data records. [2025-09-17T07:44:09.465873] [DEBUG] [LOCAL ] ZIP: Loaded 44671 existing records from primary storage. [2025-09-17T07:44:09.493842] [INFO ] [MAIN ] ZIP: Loaded 44671 primary data records. [2025-09-17T07:44:10.375026] [DEBUG] [MAIN ] ZIM: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:10.389606] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53554 primary records. [2025-09-17T07:44:10.389870] [DEBUG] [MAIN ] ZK: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:10.390247] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-17T07:44:10.390793] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 40092 primary records. [2025-09-17T07:44:10.391625] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-17T07:44:10.416703] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-09-17T07:44:10.424308] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-17T07:44:10.426919] [INFO ] [MAIN ] Derivative Progress: 2164/2172 symbols completed. ZIM took 1.3s. Estimated remaining: 3.0s. Rate: 160.1 symbols/min [2025-09-17T07:44:10.429289] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:10.445439] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-09-17T07:44:10.445810] [DEBUG] [MAIN ] ZIP: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:10.446117] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-17T07:44:10.451623] [INFO ] [MAIN ] Derivative Progress: 2165/2172 symbols completed. ZK took 1.2s. Estimated remaining: 2.6s. Rate: 160.2 symbols/min [2025-09-17T07:44:10.449009] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 44671 primary records. [2025-09-17T07:44:10.452082] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:10.452130] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-17T07:44:10.458490] [DEBUG] [LOCAL ] ZKH: Loaded 7984 existing records from primary storage. [2025-09-17T07:44:10.469944] [INFO ] [MAIN ] ZKH: Loaded 7984 primary data records. [2025-09-17T07:44:10.519468] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-09-17T07:44:10.546848] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-17T07:44:10.579596] [INFO ] [MAIN ] Derivative Progress: 2166/2172 symbols completed. ZIP took 1.4s. Estimated remaining: 2.2s. Rate: 160.2 symbols/min [2025-09-17T07:44:10.583765] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:10.853096] [DEBUG] [LOCAL ] ZTO: Loaded 50213 existing records from primary storage. [2025-09-17T07:44:10.859286] [INFO ] [MAIN ] ZTO: Loaded 50213 primary data records. [2025-09-17T07:44:10.881049] [DEBUG] [LOCAL ] ZTR: Loaded 16939 existing records from primary storage. [2025-09-17T07:44:10.941895] [INFO ] [MAIN ] ZTR: Loaded 16939 primary data records. [2025-09-17T07:44:11.483489] [DEBUG] [MAIN ] ZKH: Filtered 7001 bins outside market hours, 7821 incomplete bins [2025-09-17T07:44:11.485023] [INFO ] [MAIN ] ZKH: Generated 1793 derivative records from 7984 primary records. [2025-09-17T07:44:11.485735] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-17T07:44:11.524065] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1793 records). [2025-09-17T07:44:11.524882] [DEBUG] [MAIN ] ZTO: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:11.525216] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-17T07:44:11.526093] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 50213 primary records. [2025-09-17T07:44:11.526319] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-17T07:44:11.529496] [INFO ] [MAIN ] Derivative Progress: 2167/2172 symbols completed. ZKH took 1.1s. Estimated remaining: 1.9s. Rate: 160.1 symbols/min [2025-09-17T07:44:11.531110] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:11.552107] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-09-17T07:44:11.552484] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-17T07:44:11.555527] [INFO ] [MAIN ] Derivative Progress: 2168/2172 symbols completed. ZTO took 1.1s. Estimated remaining: 1.5s. Rate: 160.2 symbols/min [2025-09-17T07:44:11.556068] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:11.574531] [DEBUG] [MAIN ] ZTR: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:11.575793] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16939 primary records. [2025-09-17T07:44:11.576052] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-17T07:44:11.598864] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-09-17T07:44:11.599060] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-17T07:44:11.601779] [INFO ] [MAIN ] Derivative Progress: 2169/2172 symbols completed. ZTR took 1.0s. Estimated remaining: 1.1s. Rate: 160.3 symbols/min [2025-09-17T07:44:11.602110] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-17T07:44:11.643733] [DEBUG] [LOCAL ] ZVIA: Loaded 35478 existing records from primary storage. [2025-09-17T07:44:11.644143] [INFO ] [MAIN ] ZVIA: Loaded 35478 primary data records. [2025-09-17T07:44:11.778140] [DEBUG] [LOCAL ] ZTS: Loaded 52999 existing records from primary storage. [2025-09-17T07:44:11.805795] [INFO ] [MAIN ] ZTS: Loaded 52999 primary data records. [2025-09-17T07:44:12.060934] [DEBUG] [LOCAL ] ZWS: Loaded 42622 existing records from primary storage. [2025-09-17T07:44:12.083451] [INFO ] [MAIN ] ZWS: Loaded 42622 primary data records. [2025-09-17T07:44:12.781619] [DEBUG] [MAIN ] ZVIA: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:12.782589] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35478 primary records. [2025-09-17T07:44:12.783229] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-17T07:44:12.801994] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-09-17T07:44:12.802374] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-17T07:44:12.804510] [INFO ] [MAIN ] Derivative Progress: 2170/2172 symbols completed. ZVIA took 1.2s. Estimated remaining: 0.7s. Rate: 160.1 symbols/min [2025-09-17T07:44:12.820862] [DEBUG] [MAIN ] ZTS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:12.821705] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 52999 primary records. [2025-09-17T07:44:12.821781] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-17T07:44:12.840375] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-09-17T07:44:12.853237] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-17T07:44:12.853562] [DEBUG] [MAIN ] ZWS: Filtered 7001 bins outside market hours, 7820 incomplete bins [2025-09-17T07:44:12.856530] [INFO ] [MAIN ] Derivative Progress: 2171/2172 symbols completed. ZTS took 1.3s. Estimated remaining: 0.4s. Rate: 160.2 symbols/min [2025-09-17T07:44:12.857472] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42622 primary records. [2025-09-17T07:44:12.857693] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-17T07:44:12.874198] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-09-17T07:44:12.874273] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-17T07:44:12.876825] [INFO ] [MAIN ] Derivative Progress: 2172/2172 symbols completed. ZWS took 1.3s. Estimated remaining: 0.0s. Rate: 160.2 symbols/min [2025-09-17T07:44:12.878768] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 33s [2025-09-17T07:44:12.878875] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2172/2172 symbols) [2025-09-17T07:44:13.530935] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2172/2172 @ 100.00%)' [2025-09-17T07:44:13.531838] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-17T07:44:13.532008] [INFO ] [STATE ] Last completion updated: 2025-09-17T07:44:13.531905 [2025-09-17T17:00:00.986816] [INFO ] [MAIN ] Using last completed trading day: 2025-09-17 [2025-09-17T17:00:00.987160] [INFO ] [MAIN ] Starting TDM symbol refresh process. [2025-09-17T17:00:00.987250] [INFO ] [MAIN ] Fetching latest NYSE symbols list. [2025-09-17T17:00:00.987287] [DEBUG] [SYMBOL ] Starting fetch of NYSE Symbols. [2025-09-17T17:00:01.835719] [DEBUG] [SYMBOL ] Found 2423 valid NYSE symbols. [2025-09-17T17:00:01.836303] [INFO ] [SYMBOL ] Completed fetch of NYSE Symbols. [2025-09-17T17:00:01.836543] [INFO ] [MAIN ] Filtered out 54 blacklisted symbols. [2025-09-17T17:00:01.837359] [INFO ] [LOCAL ] Symbols cache updated with 2371 symbols. [2025-09-17T17:00:01.837410] [INFO ] [MAIN ] Successfully refreshed symbols list. [2025-09-17T17:00:01.837439] [INFO ] [MAIN ] Finished TDM symbol refresh process. [2025-09-17T17:00:01.837497] [INFO ] [MAIN ] Starting TDM stale symbol pruning process. [2025-09-17T17:00:01.837600] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-17T17:00:01.838123] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-17T17:00:01.838360] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-17T17:00:01.838579] [INFO ] [MAIN ] Including 54 blacklisted symbols for pruning. [2025-09-17T17:00:01.838634] [INFO ] [MAIN ] Pruning data for symbols not in current list of 2371 valid symbols. [2025-09-17T17:00:01.838704] [INFO ] [LOCAL ] Starting pruning of local symbol history data for inactive/invalid symbols. [2025-09-17T17:00:01.838749] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/primary_storage' [2025-09-17T17:00:01.865294] [DEBUG] [LOCAL ] Checking directory: '/opt/tdm/output/data/derivative_storage' [2025-09-17T17:00:01.891363] [INFO ] [LOCAL ] Deleted 0 obsolete data files. [2025-09-17T17:00:01.891419] [INFO ] [LOCAL ] Completed pruning of unlisted local symbol history data. [2025-09-17T17:00:01.891453] [INFO ] [MAIN ] Successfully pruned stale symbol data. [2025-09-17T17:00:01.891481] [INFO ] [MAIN ] Finished TDM stale symbol pruning process. [2025-09-17T17:00:01.891810] [WARN ] [STATE ] State set to: RUNNING [2025-09-17T17:00:01.891951] [INFO ] [LOCAL ] Reading cached symbols list. [2025-09-17T17:00:01.892332] [DEBUG] [LOCAL ] Found 2371 symbols in cached list. [2025-09-17T17:00:01.892371] [INFO ] [LOCAL ] Completed reading cached symbols list. [2025-09-17T17:00:01.892401] [INFO ] [MAIN ] Starting incremental update for 2371 symbols. [2025-09-17T17:00:01.892430] [INFO ] [MAIN ] Running in parallel mode [2025-09-17T17:00:01.892737] [INFO ] [MAIN ] Starting parallel primary update with 4 worker threads for 2371 symbols [2025-09-17T17:00:02.558258] [INFO ] [MAIN ] AA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:02.667558] [INFO ] [MAIN ] A: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:02.669243] [INFO ] [MAIN ] AACT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:02.673570] [DEBUG] [LOCAL ] AACT: No existing data file found in primary storage. [2025-09-17T17:00:02.692039] [INFO ] [MAIN ] AAM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:02.692602] [DEBUG] [LOCAL ] AAM: No existing data file found in primary storage. [2025-09-17T17:00:02.675359] [WARN ] [MAIN ] AACT: No existing data found, performing full refresh instead. [2025-09-17T17:00:02.692888] [WARN ] [MAIN ] AAM: No existing data found, performing full refresh instead. [2025-09-17T17:00:02.694558] [INFO ] [MAIN ] AACT: Wiping existing primary data before full refresh. [2025-09-17T17:00:02.694606] [INFO ] [MAIN ] AAM: Wiping existing primary data before full refresh. [2025-09-17T17:00:02.694743] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-17T17:00:02.694850] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-17T17:00:02.695915] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-17T17:00:02.696006] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-17T17:00:02.696081] [INFO ] [MAIN ] AACT: Starting full primary refresh. [2025-09-17T17:00:02.701294] [INFO ] [MAIN ] AAM: Starting full primary refresh. [2025-09-17T17:00:03.305092] [DEBUG] [LOCAL ] AA: Loaded 53585 existing records from primary storage. [2025-09-17T17:00:03.351962] [INFO ] [MAIN ] AA: Loaded 53585 existing records. [2025-09-17T17:00:03.351890] [DEBUG] [LOCAL ] A: Loaded 50850 existing records from primary storage. [2025-09-17T17:00:03.374926] [INFO ] [MAIN ] A: Loaded 50850 existing records. [2025-09-17T17:00:03.551591] [INFO ] [REMOTE ] AACT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:03.615668] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-11. [2025-09-17T17:00:03.650814] [INFO ] [REMOTE ] AAM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:03.720322] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-11. [2025-09-17T17:00:03.824441] [WARN ] [MAIN ] AA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:00:03.872513] [INFO ] [MAIN ] AA: Wiping existing primary data before full refresh. [2025-09-17T17:00:03.898984] [INFO ] [LOCAL ] AA: Starting deletion of primary data. [2025-09-17T17:00:03.899076] [WARN ] [MAIN ] A: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:00:03.899316] [INFO ] [MAIN ] A: Wiping existing primary data before full refresh. [2025-09-17T17:00:03.899362] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-17T17:00:03.900801] [DEBUG] [LOCAL ] AA: Deleted primary data file. [2025-09-17T17:00:03.900837] [DEBUG] [LOCAL ] A: Deleted primary data file. [2025-09-17T17:00:03.900918] [INFO ] [MAIN ] AA: Starting full primary refresh. [2025-09-17T17:00:03.900994] [INFO ] [MAIN ] A: Starting full primary refresh. [2025-09-17T17:00:04.354215] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T17:00:04.427107] [INFO ] [REMOTE ] AAM: Fetching primary data for 2024-12. [2025-09-17T17:00:04.613360] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T17:00:04.650998] [INFO ] [REMOTE ] AA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:04.654513] [INFO ] [REMOTE ] A: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:04.656452] [INFO ] [REMOTE ] A: Fetching primary data for 2024-11. [2025-09-17T17:00:04.656088] [INFO ] [REMOTE ] AACT: Fetching primary data for 2024-12. [2025-09-17T17:00:04.656714] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-11. [2025-09-17T17:00:04.852264] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T17:00:04.853805] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-01. [2025-09-17T17:00:05.088973] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T17:00:05.090079] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-01. [2025-09-17T17:00:05.190875] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T17:00:05.191914] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-02. [2025-09-17T17:00:05.487120] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-17T17:00:05.488239] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-02. [2025-09-17T17:00:05.616872] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T17:00:05.618112] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-03. [2025-09-17T17:00:05.909334] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T17:00:05.910440] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-04. [2025-09-17T17:00:06.004760] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T17:00:06.005792] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-03. [2025-09-17T17:00:06.284029] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T17:00:06.294050] [INFO ] [REMOTE ] A: Fetching primary data for 2024-12. [2025-09-17T17:00:06.418974] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T17:00:06.420175] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-05. [2025-09-17T17:00:06.423136] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T17:00:06.433735] [INFO ] [REMOTE ] AA: Fetching primary data for 2024-12. [2025-09-17T17:00:06.439238] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-17T17:00:06.440760] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-04. [2025-09-17T17:00:06.818028] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-17T17:00:06.818944] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-06. [2025-09-17T17:00:07.039935] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T17:00:07.042747] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-05. [2025-09-17T17:00:07.108255] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-17T17:00:07.109130] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-07. [2025-09-17T17:00:07.466297] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-17T17:00:07.468292] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-08. [2025-09-17T17:00:07.680074] [INFO ] [REMOTE ] A: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T17:00:07.691295] [INFO ] [REMOTE ] A: Fetching primary data for 2025-01. [2025-09-17T17:00:07.941048] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T17:00:07.960132] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-01. [2025-09-17T17:00:07.988934] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-17T17:00:07.990096] [INFO ] [REMOTE ] AAM: Fetching primary data for 2025-09. [2025-09-17T17:00:08.104827] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T17:00:08.107372] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-06. [2025-09-17T17:00:08.390876] [INFO ] [REMOTE ] AAM: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T17:00:08.391792] [INFO ] [REMOTE ] AAM: Full fetch complete (1040 records). [2025-09-17T17:00:08.391885] [DEBUG] [VALIDATOR ] AAM: Validating primary data. [2025-09-17T17:00:08.392403] [FATAL] [VALIDATOR ] AAM: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:00:08.392498] [FATAL] [MAIN ] AAM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:00:08.392556] [WARN ] [MAIN ] AAM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:00:08.392628] [INFO ] [LOCAL ] AAM: Starting deletion of primary data. [2025-09-17T17:00:08.392742] [DEBUG] [LOCAL ] AAM: No primary data file found to delete. [2025-09-17T17:00:08.392800] [INFO ] [LOCAL ] AAM: Starting deletion of derivative data. [2025-09-17T17:00:08.392859] [DEBUG] [LOCAL ] AAM: No derivative data file found to delete. [2025-09-17T17:00:08.392936] [INFO ] [MAIN ] Update Progress: 1/2371 symbols completed. AAM took 6.5s. Estimated remaining: 4h 16m 46s. Rate: 9.2 symbols/min [2025-09-17T17:00:08.587949] [INFO ] [MAIN ] AAMI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:08.588157] [DEBUG] [LOCAL ] AAMI: No existing data file found in primary storage. [2025-09-17T17:00:08.588194] [WARN ] [MAIN ] AAMI: No existing data found, performing full refresh instead. [2025-09-17T17:00:08.588353] [INFO ] [MAIN ] AAMI: Wiping existing primary data before full refresh. [2025-09-17T17:00:08.588405] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-17T17:00:08.588449] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-17T17:00:08.588481] [INFO ] [MAIN ] AAMI: Starting full primary refresh. [2025-09-17T17:00:08.944282] [INFO ] [REMOTE ] AAMI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:08.944598] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-11. [2025-09-17T17:00:09.143335] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:00:09.143744] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-11 [2025-09-17T17:00:09.144339] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2024-12. [2025-09-17T17:00:09.221380] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T17:00:09.224692] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-07. [2025-09-17T17:00:09.401115] [DEBUG] [REMOTE ] AAMI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:00:09.401409] [WARN ] [REMOTE ] AAMI: No data returned for month 2024-12 [2025-09-17T17:00:09.401897] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-01. [2025-09-17T17:00:09.967910] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-17T17:00:09.977909] [INFO ] [REMOTE ] A: Fetching primary data for 2025-02. [2025-09-17T17:00:10.015831] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T17:00:10.026917] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-02. [2025-09-17T17:00:10.080781] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T17:00:10.083735] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-08. [2025-09-17T17:00:10.191445] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T17:00:10.195193] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-02. [2025-09-17T17:00:10.953769] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T17:00:10.956768] [INFO ] [REMOTE ] AACT: Fetching primary data for 2025-09. [2025-09-17T17:00:10.978991] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T17:00:10.983029] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-03. [2025-09-17T17:00:11.778753] [INFO ] [REMOTE ] AACT: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T17:00:11.781080] [INFO ] [REMOTE ] AACT: Full fetch complete (10136 records). [2025-09-17T17:00:11.781164] [DEBUG] [VALIDATOR ] AACT: Validating primary data. [2025-09-17T17:00:11.781686] [FATAL] [VALIDATOR ] AACT: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:00:11.781782] [FATAL] [MAIN ] AACT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:00:11.781847] [WARN ] [MAIN ] AACT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:00:11.781914] [INFO ] [LOCAL ] AACT: Starting deletion of primary data. [2025-09-17T17:00:11.781981] [DEBUG] [LOCAL ] AACT: No primary data file found to delete. [2025-09-17T17:00:11.782039] [INFO ] [LOCAL ] AACT: Starting deletion of derivative data. [2025-09-17T17:00:11.782081] [DEBUG] [LOCAL ] AACT: No derivative data file found to delete. [2025-09-17T17:00:11.782139] [INFO ] [MAIN ] Update Progress: 2/2371 symbols completed. AACT took 9.9s. Estimated remaining: 3h 15m 14s. Rate: 12.1 symbols/min [2025-09-17T17:00:11.959708] [INFO ] [MAIN ] AAP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:11.988617] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T17:00:11.999845] [INFO ] [REMOTE ] A: Fetching primary data for 2025-03. [2025-09-17T17:00:12.054152] [DEBUG] [LOCAL ] AAP: Loaded 52202 existing records from primary storage. [2025-09-17T17:00:12.054308] [INFO ] [MAIN ] AAP: Loaded 52202 existing records. [2025-09-17T17:00:12.240745] [WARN ] [MAIN ] AAP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:00:12.258479] [INFO ] [MAIN ] AAP: Wiping existing primary data before full refresh. [2025-09-17T17:00:12.258842] [INFO ] [LOCAL ] AAP: Starting deletion of primary data. [2025-09-17T17:00:12.260207] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T17:00:12.266762] [DEBUG] [LOCAL ] AAP: Deleted primary data file. [2025-09-17T17:00:12.267054] [INFO ] [MAIN ] AAP: Starting full primary refresh. [2025-09-17T17:00:12.321345] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-04. [2025-09-17T17:00:12.397478] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-17T17:00:12.470542] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-03. [2025-09-17T17:00:12.671602] [INFO ] [REMOTE ] AAP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:12.671963] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-11. [2025-09-17T17:00:13.514771] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T17:00:13.526148] [INFO ] [REMOTE ] A: Fetching primary data for 2025-04. [2025-09-17T17:00:13.554089] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T17:00:13.564232] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-05. [2025-09-17T17:00:14.328560] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T17:00:14.338974] [INFO ] [REMOTE ] AAP: Fetching primary data for 2024-12. [2025-09-17T17:00:14.560338] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T17:00:14.572078] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-04. [2025-09-17T17:00:14.775164] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T17:00:14.781131] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-06. [2025-09-17T17:00:15.120819] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T17:00:15.131705] [INFO ] [REMOTE ] A: Fetching primary data for 2025-05. [2025-09-17T17:00:16.002129] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T17:00:16.007222] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-07. [2025-09-17T17:00:16.674873] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T17:00:16.686009] [INFO ] [REMOTE ] A: Fetching primary data for 2025-06. [2025-09-17T17:00:16.845074] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T17:00:16.851037] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-08. [2025-09-17T17:00:17.741185] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2024-12 (3.40 seconds). [2025-09-17T17:00:17.752176] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-01. [2025-09-17T17:00:17.992452] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T17:00:18.005168] [INFO ] [REMOTE ] A: Fetching primary data for 2025-07. [2025-09-17T17:00:18.775974] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-04 (4.20 seconds). [2025-09-17T17:00:18.787186] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-05. [2025-09-17T17:00:19.550020] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T17:00:19.563308] [INFO ] [REMOTE ] A: Fetching primary data for 2025-08. [2025-09-17T17:00:19.770900] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-17T17:00:19.781501] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-02. [2025-09-17T17:00:20.069572] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-08 (3.22 seconds). [2025-09-17T17:00:20.075219] [INFO ] [REMOTE ] AAMI: Fetching primary data for 2025-09. [2025-09-17T17:00:21.354020] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T17:00:21.364183] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-03. [2025-09-17T17:00:21.815130] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-09-17T17:00:21.826850] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-06. [2025-09-17T17:00:22.189207] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-17T17:00:22.202076] [INFO ] [REMOTE ] A: Fetching primary data for 2025-09. [2025-09-17T17:00:23.024287] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T17:00:23.035082] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-04. [2025-09-17T17:00:23.339131] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T17:00:23.349794] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-07. [2025-09-17T17:00:23.487432] [INFO ] [REMOTE ] AAMI: Incremental fetch complete for 2025-09 (3.41 seconds). [2025-09-17T17:00:23.491342] [INFO ] [REMOTE ] AAMI: Full fetch complete (29371 records). [2025-09-17T17:00:23.491428] [DEBUG] [VALIDATOR ] AAMI: Validating primary data. [2025-09-17T17:00:23.491927] [FATAL] [VALIDATOR ] AAMI: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:00:23.492002] [FATAL] [MAIN ] AAMI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:00:23.492039] [WARN ] [MAIN ] AAMI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:00:23.492084] [INFO ] [LOCAL ] AAMI: Starting deletion of primary data. [2025-09-17T17:00:23.492142] [DEBUG] [LOCAL ] AAMI: No primary data file found to delete. [2025-09-17T17:00:23.492177] [INFO ] [LOCAL ] AAMI: Starting deletion of derivative data. [2025-09-17T17:00:23.492216] [DEBUG] [LOCAL ] AAMI: No derivative data file found to delete. [2025-09-17T17:00:23.492272] [INFO ] [MAIN ] Update Progress: 3/2371 symbols completed. AAMI took 15.1s. Estimated remaining: 4h 44m 9s. Rate: 8.3 symbols/min [2025-09-17T17:00:23.666800] [INFO ] [MAIN ] AAT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:23.690865] [INFO ] [REMOTE ] A: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T17:00:23.701877] [INFO ] [REMOTE ] A: Full fetch complete (72589 records). [2025-09-17T17:00:23.702079] [DEBUG] [VALIDATOR ] A: Validating primary data. [2025-09-17T17:00:23.711001] [FATAL] [VALIDATOR ] A: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:00:23.711209] [FATAL] [MAIN ] A: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:00:23.711272] [WARN ] [MAIN ] A: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:00:23.711341] [INFO ] [LOCAL ] A: Starting deletion of primary data. [2025-09-17T17:00:23.711470] [DEBUG] [LOCAL ] A: No primary data file found to delete. [2025-09-17T17:00:23.711523] [INFO ] [LOCAL ] A: Starting deletion of derivative data. [2025-09-17T17:00:23.711830] [DEBUG] [LOCAL ] A: Deleted derivative data file. [2025-09-17T17:00:23.712574] [INFO ] [MAIN ] Update Progress: 4/2371 symbols completed. A took 21.8s. Estimated remaining: 3h 35m 12s. Rate: 11.0 symbols/min [2025-09-17T17:00:23.838396] [DEBUG] [LOCAL ] AAT: Loaded 30568 existing records from primary storage. [2025-09-17T17:00:23.858976] [INFO ] [MAIN ] AAT: Loaded 30568 existing records. [2025-09-17T17:00:23.973943] [INFO ] [MAIN ] AAUC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:23.991260] [DEBUG] [LOCAL ] AAUC: No existing data file found in primary storage. [2025-09-17T17:00:24.013574] [WARN ] [MAIN ] AAUC: No existing data found, performing full refresh instead. [2025-09-17T17:00:24.013913] [INFO ] [MAIN ] AAUC: Wiping existing primary data before full refresh. [2025-09-17T17:00:24.019510] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-17T17:00:24.034934] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-17T17:00:24.034997] [INFO ] [MAIN ] AAUC: Starting full primary refresh. [2025-09-17T17:00:24.181189] [WARN ] [MAIN ] AAT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:00:24.203751] [INFO ] [MAIN ] AAT: Wiping existing primary data before full refresh. [2025-09-17T17:00:24.204086] [INFO ] [LOCAL ] AAT: Starting deletion of primary data. [2025-09-17T17:00:24.225454] [DEBUG] [LOCAL ] AAT: Deleted primary data file. [2025-09-17T17:00:24.250201] [INFO ] [MAIN ] AAT: Starting full primary refresh. [2025-09-17T17:00:24.675687] [INFO ] [REMOTE ] AAUC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:24.698438] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-11. [2025-09-17T17:00:24.839094] [INFO ] [REMOTE ] AAT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:24.839527] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-11. [2025-09-17T17:00:24.873063] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T17:00:24.884498] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-05. [2025-09-17T17:00:24.948948] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:00:24.949460] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-11 [2025-09-17T17:00:24.950157] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2024-12. [2025-09-17T17:00:25.189914] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:00:25.190237] [WARN ] [REMOTE ] AAUC: No data returned for month 2024-12 [2025-09-17T17:00:25.190756] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-01. [2025-09-17T17:00:25.395433] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:00:25.395764] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-01 [2025-09-17T17:00:25.396256] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-02. [2025-09-17T17:00:25.443215] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T17:00:25.454999] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-08. [2025-09-17T17:00:25.660045] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:00:25.660354] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-02 [2025-09-17T17:00:25.660880] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-03. [2025-09-17T17:00:25.849608] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:00:25.849964] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-03 [2025-09-17T17:00:25.850400] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-04. [2025-09-17T17:00:26.000029] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T17:00:26.004928] [INFO ] [REMOTE ] AAT: Fetching primary data for 2024-12. [2025-09-17T17:00:26.084939] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:00:26.085235] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-04 [2025-09-17T17:00:26.085754] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-05. [2025-09-17T17:00:26.307028] [DEBUG] [REMOTE ] AAUC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:00:26.307393] [WARN ] [REMOTE ] AAUC: No data returned for month 2025-05 [2025-09-17T17:00:26.307897] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-06. [2025-09-17T17:00:26.652859] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T17:00:26.664726] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-06. [2025-09-17T17:00:26.912896] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T17:00:26.919192] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-01. [2025-09-17T17:00:27.437508] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T17:00:27.449489] [INFO ] [REMOTE ] AA: Fetching primary data for 2025-09. [2025-09-17T17:00:27.471910] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T17:00:27.474044] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-07. [2025-09-17T17:00:27.886321] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T17:00:27.891856] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-02. [2025-09-17T17:00:28.029495] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T17:00:28.032491] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-08. [2025-09-17T17:00:28.311423] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:00:28.322807] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-07. [2025-09-17T17:00:29.146893] [INFO ] [REMOTE ] AA: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T17:00:29.160436] [INFO ] [REMOTE ] AA: Full fetch complete (77368 records). [2025-09-17T17:00:29.160679] [DEBUG] [VALIDATOR ] AA: Validating primary data. [2025-09-17T17:00:29.529589] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T17:00:29.578000] [INFO ] [REMOTE ] AAUC: Fetching primary data for 2025-09. [2025-09-17T17:00:29.581691] [DEBUG] [VALIDATOR ] AA: All expected trading days are present. [2025-09-17T17:00:29.582534] [DEBUG] [VALIDATOR ] AA: Primary data validation passed. [2025-09-17T17:00:29.583514] [INFO ] [MAIN ] AA: Fetched primary data is valid. [2025-09-17T17:00:29.583664] [DEBUG] [LOCAL ] AA: Saving primary data. [2025-09-17T17:00:29.586589] [DEBUG] [LOCAL ] AA: Trimmed 77368 records to 53585 (keeping 200 days of data) [2025-09-17T17:00:29.935903] [DEBUG] [LOCAL ] AA: Primary data saved (53585 records). [2025-09-17T17:00:29.936086] [INFO ] [MAIN ] AA: Full history saved. [2025-09-17T17:00:29.936823] [INFO ] [MAIN ] Update Progress: 5/2371 symbols completed. AA took 28.0s. Estimated remaining: 3h 41m 11s. Rate: 10.7 symbols/min [2025-09-17T17:00:30.114299] [INFO ] [MAIN ] AB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:30.146063] [DEBUG] [LOCAL ] AB: Loaded 29296 existing records from primary storage. [2025-09-17T17:00:30.146237] [INFO ] [MAIN ] AB: Loaded 29296 existing records. [2025-09-17T17:00:30.332163] [WARN ] [MAIN ] AB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:00:30.332492] [INFO ] [MAIN ] AB: Wiping existing primary data before full refresh. [2025-09-17T17:00:30.332542] [INFO ] [LOCAL ] AB: Starting deletion of primary data. [2025-09-17T17:00:30.333185] [DEBUG] [LOCAL ] AB: Deleted primary data file. [2025-09-17T17:00:30.333243] [INFO ] [MAIN ] AB: Starting full primary refresh. [2025-09-17T17:00:30.616369] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-17T17:00:30.680768] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-08. [2025-09-17T17:00:30.759586] [INFO ] [REMOTE ] AB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:30.766373] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-11. [2025-09-17T17:00:30.760846] [INFO ] [REMOTE ] AAUC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T17:00:30.783602] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-02 (2.89 seconds). [2025-09-17T17:00:30.781312] [INFO ] [REMOTE ] AAUC: Full fetch complete (6672 records). [2025-09-17T17:00:30.789992] [DEBUG] [VALIDATOR ] AAUC: Validating primary data. [2025-09-17T17:00:30.822491] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-03. [2025-09-17T17:00:30.998681] [WARN ] [VALIDATOR ] AAUC: Validation failed - insufficient historical data. Have 70 unique days, need 200 days [2025-09-17T17:00:30.998961] [FATAL] [MAIN ] AAUC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:00:30.999012] [WARN ] [MAIN ] AAUC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:00:30.999061] [INFO ] [LOCAL ] AAUC: Starting deletion of primary data. [2025-09-17T17:00:30.999120] [DEBUG] [LOCAL ] AAUC: No primary data file found to delete. [2025-09-17T17:00:30.999156] [INFO ] [LOCAL ] AAUC: Starting deletion of derivative data. [2025-09-17T17:00:30.999194] [DEBUG] [LOCAL ] AAUC: No derivative data file found to delete. [2025-09-17T17:00:30.999261] [INFO ] [MAIN ] Update Progress: 6/2371 symbols completed. AAUC took 7.3s. Estimated remaining: 3h 11m 13s. Rate: 12.4 symbols/min [2025-09-17T17:00:31.185949] [INFO ] [MAIN ] ABBV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:31.245692] [DEBUG] [LOCAL ] ABBV: Loaded 53690 existing records from primary storage. [2025-09-17T17:00:31.245858] [INFO ] [MAIN ] ABBV: Loaded 53690 existing records. [2025-09-17T17:00:31.438195] [WARN ] [MAIN ] ABBV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:00:31.438470] [INFO ] [MAIN ] ABBV: Wiping existing primary data before full refresh. [2025-09-17T17:00:31.438518] [INFO ] [LOCAL ] ABBV: Starting deletion of primary data. [2025-09-17T17:00:31.439714] [DEBUG] [LOCAL ] ABBV: Deleted primary data file. [2025-09-17T17:00:31.439788] [INFO ] [MAIN ] ABBV: Starting full primary refresh. [2025-09-17T17:00:31.824951] [INFO ] [REMOTE ] ABBV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:31.825442] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-11. [2025-09-17T17:00:32.254198] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T17:00:32.261618] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-04. [2025-09-17T17:00:32.337179] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T17:00:32.345163] [INFO ] [REMOTE ] AB: Fetching primary data for 2024-12. [2025-09-17T17:00:32.664578] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T17:00:32.675891] [INFO ] [REMOTE ] AAP: Fetching primary data for 2025-09. [2025-09-17T17:00:33.359898] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T17:00:33.368882] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-05. [2025-09-17T17:00:33.644071] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T17:00:33.654630] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2024-12. [2025-09-17T17:00:34.236895] [INFO ] [REMOTE ] AAP: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T17:00:34.244074] [INFO ] [REMOTE ] AAP: Full fetch complete (75122 records). [2025-09-17T17:00:34.244232] [DEBUG] [VALIDATOR ] AAP: Validating primary data. [2025-09-17T17:00:34.671241] [DEBUG] [VALIDATOR ] AAP: All expected trading days are present. [2025-09-17T17:00:34.671470] [DEBUG] [VALIDATOR ] AAP: Primary data validation passed. [2025-09-17T17:00:34.672423] [INFO ] [MAIN ] AAP: Fetched primary data is valid. [2025-09-17T17:00:34.672602] [DEBUG] [LOCAL ] AAP: Saving primary data. [2025-09-17T17:00:34.703821] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-17T17:00:34.702746] [DEBUG] [LOCAL ] AAP: Trimmed 75122 records to 52189 (keeping 200 days of data) [2025-09-17T17:00:34.712613] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-01. [2025-09-17T17:00:34.843077] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T17:00:34.851764] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-06. [2025-09-17T17:00:35.073508] [DEBUG] [LOCAL ] AAP: Primary data saved (52189 records). [2025-09-17T17:00:35.073668] [INFO ] [MAIN ] AAP: Full history saved. [2025-09-17T17:00:35.073999] [INFO ] [MAIN ] Update Progress: 7/2371 symbols completed. AAP took 23.3s. Estimated remaining: 3h 6m 46s. Rate: 12.7 symbols/min [2025-09-17T17:00:35.255237] [INFO ] [MAIN ] ABCB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:35.290770] [DEBUG] [LOCAL ] ABCB: Loaded 30681 existing records from primary storage. [2025-09-17T17:00:35.290946] [INFO ] [MAIN ] ABCB: Loaded 30681 existing records. [2025-09-17T17:00:35.486964] [WARN ] [MAIN ] ABCB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:00:35.487345] [INFO ] [MAIN ] ABCB: Wiping existing primary data before full refresh. [2025-09-17T17:00:35.487447] [INFO ] [LOCAL ] ABCB: Starting deletion of primary data. [2025-09-17T17:00:35.498137] [DEBUG] [LOCAL ] ABCB: Deleted primary data file. [2025-09-17T17:00:35.515281] [INFO ] [MAIN ] ABCB: Starting full primary refresh. [2025-09-17T17:00:35.588366] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T17:00:35.633161] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-01. [2025-09-17T17:00:35.901004] [INFO ] [REMOTE ] ABCB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:35.901526] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-11. [2025-09-17T17:00:35.925409] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T17:00:35.934325] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-02. [2025-09-17T17:00:36.147380] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T17:00:36.154483] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-07. [2025-09-17T17:00:36.893849] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T17:00:36.899942] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2024-12. [2025-09-17T17:00:37.263271] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T17:00:37.271022] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-08. [2025-09-17T17:00:37.565950] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T17:00:37.575778] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-03. [2025-09-17T17:00:37.750635] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T17:00:37.762973] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-02. [2025-09-17T17:00:37.780552] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T17:00:37.786913] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-01. [2025-09-17T17:00:38.612268] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T17:00:38.620994] [INFO ] [REMOTE ] AAT: Fetching primary data for 2025-09. [2025-09-17T17:00:38.781563] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T17:00:38.788350] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-02. [2025-09-17T17:00:39.156840] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T17:00:39.167730] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-04. [2025-09-17T17:00:39.435271] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T17:00:39.446913] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-03. [2025-09-17T17:00:39.765317] [INFO ] [REMOTE ] AAT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T17:00:39.770746] [INFO ] [REMOTE ] AAT: Full fetch complete (42572 records). [2025-09-17T17:00:39.770970] [DEBUG] [VALIDATOR ] AAT: Validating primary data. [2025-09-17T17:00:40.183594] [DEBUG] [VALIDATOR ] AAT: All expected trading days are present. [2025-09-17T17:00:40.183763] [DEBUG] [VALIDATOR ] AAT: Primary data validation passed. [2025-09-17T17:00:40.184234] [INFO ] [MAIN ] AAT: Fetched primary data is valid. [2025-09-17T17:00:40.184287] [DEBUG] [LOCAL ] AAT: Saving primary data. [2025-09-17T17:00:40.208343] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T17:00:40.207512] [DEBUG] [LOCAL ] AAT: Trimmed 42572 records to 30591 (keeping 200 days of data) [2025-09-17T17:00:40.217604] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-03. [2025-09-17T17:00:40.434176] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T17:00:40.448614] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-05. [2025-09-17T17:00:40.452560] [DEBUG] [LOCAL ] AAT: Primary data saved (30591 records). [2025-09-17T17:00:40.453443] [INFO ] [MAIN ] AAT: Full history saved. [2025-09-17T17:00:40.453548] [INFO ] [MAIN ] Update Progress: 8/2371 symbols completed. AAT took 17.0s. Estimated remaining: 3h 9m 50s. Rate: 12.4 symbols/min [2025-09-17T17:00:40.637884] [INFO ] [MAIN ] ABEV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:40.688588] [DEBUG] [LOCAL ] ABEV: Loaded 53272 existing records from primary storage. [2025-09-17T17:00:40.688772] [INFO ] [MAIN ] ABEV: Loaded 53272 existing records. [2025-09-17T17:00:40.889756] [WARN ] [MAIN ] ABEV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:00:40.890046] [INFO ] [MAIN ] ABEV: Wiping existing primary data before full refresh. [2025-09-17T17:00:40.890135] [INFO ] [LOCAL ] ABEV: Starting deletion of primary data. [2025-09-17T17:00:40.891249] [DEBUG] [LOCAL ] ABEV: Deleted primary data file. [2025-09-17T17:00:40.891311] [INFO ] [MAIN ] ABEV: Starting full primary refresh. [2025-09-17T17:00:41.261878] [INFO ] [REMOTE ] ABEV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:41.262229] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-11. [2025-09-17T17:00:41.529429] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T17:00:41.542079] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-04. [2025-09-17T17:00:41.562949] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T17:00:41.571029] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-04. [2025-09-17T17:00:41.595455] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T17:00:41.601716] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-06. [2025-09-17T17:00:42.447527] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T17:00:42.453006] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-07. [2025-09-17T17:00:42.798614] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T17:00:42.808929] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2024-12. [2025-09-17T17:00:43.063838] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T17:00:43.071718] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-05. [2025-09-17T17:00:43.432027] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T17:00:43.444176] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-05. [2025-09-17T17:00:43.706761] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T17:00:43.715824] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-08. [2025-09-17T17:00:43.911898] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T17:00:43.922822] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-06. [2025-09-17T17:00:44.616384] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T17:00:44.624096] [INFO ] [REMOTE ] AB: Fetching primary data for 2025-09. [2025-09-17T17:00:44.779022] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T17:00:44.789905] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-01. [2025-09-17T17:00:44.881005] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T17:00:44.886721] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-07. [2025-09-17T17:00:45.322433] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T17:00:45.333871] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-06. [2025-09-17T17:00:46.093679] [INFO ] [REMOTE ] AB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T17:00:46.112637] [INFO ] [REMOTE ] AB: Full fetch complete (46182 records). [2025-09-17T17:00:46.115459] [DEBUG] [VALIDATOR ] AB: Validating primary data. [2025-09-17T17:00:46.116830] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T17:00:46.194344] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-08. [2025-09-17T17:00:46.515618] [DEBUG] [VALIDATOR ] AB: All expected trading days are present. [2025-09-17T17:00:46.515730] [DEBUG] [VALIDATOR ] AB: Primary data validation passed. [2025-09-17T17:00:46.516283] [INFO ] [MAIN ] AB: Fetched primary data is valid. [2025-09-17T17:00:46.516357] [DEBUG] [LOCAL ] AB: Saving primary data. [2025-09-17T17:00:46.517709] [DEBUG] [LOCAL ] AB: Trimmed 46182 records to 29113 (keeping 200 days of data) [2025-09-17T17:00:46.607845] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T17:00:46.655288] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-02. [2025-09-17T17:00:46.743658] [DEBUG] [LOCAL ] AB: Primary data saved (29113 records). [2025-09-17T17:00:46.743818] [INFO ] [MAIN ] AB: Full history saved. [2025-09-17T17:00:46.743934] [INFO ] [MAIN ] Update Progress: 9/2371 symbols completed. AB took 16.8s. Estimated remaining: 3h 16m 11s. Rate: 12.0 symbols/min [2025-09-17T17:00:46.915995] [INFO ] [MAIN ] ABG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:46.934265] [DEBUG] [LOCAL ] ABG: Loaded 18953 existing records from primary storage. [2025-09-17T17:00:46.934378] [INFO ] [MAIN ] ABG: Loaded 18953 existing records. [2025-09-17T17:00:47.116315] [WARN ] [MAIN ] ABG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:00:47.116586] [INFO ] [MAIN ] ABG: Wiping existing primary data before full refresh. [2025-09-17T17:00:47.116719] [INFO ] [LOCAL ] ABG: Starting deletion of primary data. [2025-09-17T17:00:47.117226] [DEBUG] [LOCAL ] ABG: Deleted primary data file. [2025-09-17T17:00:47.117380] [INFO ] [MAIN ] ABG: Starting full primary refresh. [2025-09-17T17:00:47.432812] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-17T17:00:47.521138] [INFO ] [REMOTE ] ABG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:47.521607] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-11. [2025-09-17T17:00:47.521947] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-07. [2025-09-17T17:00:47.542100] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T17:00:47.549687] [INFO ] [REMOTE ] ABCB: Fetching primary data for 2025-09. [2025-09-17T17:00:48.376879] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T17:00:48.387103] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-03. [2025-09-17T17:00:48.652235] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T17:00:48.655991] [INFO ] [REMOTE ] ABG: Fetching primary data for 2024-12. [2025-09-17T17:00:49.510582] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T17:00:49.523694] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-08. [2025-09-17T17:00:49.660094] [INFO ] [REMOTE ] ABCB: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-17T17:00:49.664551] [INFO ] [REMOTE ] ABCB: Full fetch complete (43896 records). [2025-09-17T17:00:49.664717] [DEBUG] [VALIDATOR ] ABCB: Validating primary data. [2025-09-17T17:00:50.007314] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T17:00:50.031612] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-01. [2025-09-17T17:00:50.099329] [DEBUG] [VALIDATOR ] ABCB: All expected trading days are present. [2025-09-17T17:00:50.099406] [DEBUG] [VALIDATOR ] ABCB: Primary data validation passed. [2025-09-17T17:00:50.099850] [INFO ] [MAIN ] ABCB: Fetched primary data is valid. [2025-09-17T17:00:50.099895] [DEBUG] [LOCAL ] ABCB: Saving primary data. [2025-09-17T17:00:50.100996] [DEBUG] [LOCAL ] ABCB: Trimmed 43896 records to 30743 (keeping 200 days of data) [2025-09-17T17:00:50.292810] [DEBUG] [LOCAL ] ABCB: Primary data saved (30743 records). [2025-09-17T17:00:50.292954] [INFO ] [MAIN ] ABCB: Full history saved. [2025-09-17T17:00:50.299243] [INFO ] [MAIN ] Update Progress: 10/2371 symbols completed. ABCB took 15.2s. Estimated remaining: 3h 10m 29s. Rate: 12.4 symbols/min [2025-09-17T17:00:50.473037] [INFO ] [MAIN ] ABM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:50.504980] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T17:00:50.516407] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-04. [2025-09-17T17:00:50.546267] [DEBUG] [LOCAL ] ABM: Loaded 32145 existing records from primary storage. [2025-09-17T17:00:50.546431] [INFO ] [MAIN ] ABM: Loaded 32145 existing records. [2025-09-17T17:00:50.725873] [WARN ] [MAIN ] ABM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:00:50.726109] [INFO ] [MAIN ] ABM: Wiping existing primary data before full refresh. [2025-09-17T17:00:50.726156] [INFO ] [LOCAL ] ABM: Starting deletion of primary data. [2025-09-17T17:00:50.726828] [DEBUG] [LOCAL ] ABM: Deleted primary data file. [2025-09-17T17:00:50.726875] [INFO ] [MAIN ] ABM: Starting full primary refresh. [2025-09-17T17:00:51.094466] [INFO ] [REMOTE ] ABM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:51.094915] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-11. [2025-09-17T17:00:51.109577] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T17:00:51.114012] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-02. [2025-09-17T17:00:51.227146] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T17:00:51.239729] [INFO ] [REMOTE ] ABBV: Fetching primary data for 2025-09. [2025-09-17T17:00:51.889754] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T17:00:51.893450] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-03. [2025-09-17T17:00:52.040935] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T17:00:52.052989] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-05. [2025-09-17T17:00:52.068535] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T17:00:52.073545] [INFO ] [REMOTE ] ABM: Fetching primary data for 2024-12. [2025-09-17T17:00:52.756661] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T17:00:52.761679] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-04. [2025-09-17T17:00:53.276120] [INFO ] [REMOTE ] ABBV: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-17T17:00:53.286102] [INFO ] [REMOTE ] ABBV: Full fetch complete (77602 records). [2025-09-17T17:00:53.286268] [DEBUG] [VALIDATOR ] ABBV: Validating primary data. [2025-09-17T17:00:53.692720] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T17:00:53.723371] [DEBUG] [VALIDATOR ] ABBV: All expected trading days are present. [2025-09-17T17:00:53.723128] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-01. [2025-09-17T17:00:53.723465] [DEBUG] [VALIDATOR ] ABBV: Primary data validation passed. [2025-09-17T17:00:53.724427] [INFO ] [MAIN ] ABBV: Fetched primary data is valid. [2025-09-17T17:00:53.724559] [DEBUG] [LOCAL ] ABBV: Saving primary data. [2025-09-17T17:00:53.727521] [DEBUG] [LOCAL ] ABBV: Trimmed 77602 records to 53689 (keeping 200 days of data) [2025-09-17T17:00:53.861947] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T17:00:54.015832] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-06. [2025-09-17T17:00:54.120189] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T17:00:54.148147] [DEBUG] [LOCAL ] ABBV: Primary data saved (53689 records). [2025-09-17T17:00:54.148290] [INFO ] [MAIN ] ABBV: Full history saved. [2025-09-17T17:00:54.150040] [INFO ] [MAIN ] Update Progress: 11/2371 symbols completed. ABBV took 23.2s. Estimated remaining: 3h 6m 52s. Rate: 12.6 symbols/min [2025-09-17T17:00:54.323981] [INFO ] [MAIN ] ABR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:00:54.380358] [DEBUG] [LOCAL ] ABR: Loaded 52177 existing records from primary storage. [2025-09-17T17:00:54.380537] [INFO ] [MAIN ] ABR: Loaded 52177 existing records. [2025-09-17T17:00:54.561613] [WARN ] [MAIN ] ABR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:00:54.561927] [INFO ] [MAIN ] ABR: Wiping existing primary data before full refresh. [2025-09-17T17:00:54.561978] [INFO ] [LOCAL ] ABR: Starting deletion of primary data. [2025-09-17T17:00:54.562923] [DEBUG] [LOCAL ] ABR: Deleted primary data file. [2025-09-17T17:00:54.562972] [INFO ] [MAIN ] ABR: Starting full primary refresh. [2025-09-17T17:00:54.825692] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-05. [2025-09-17T17:00:54.936462] [INFO ] [REMOTE ] ABR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:00:54.953209] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T17:00:55.615836] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-02. [2025-09-17T17:00:55.694683] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T17:00:55.795634] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T17:00:56.415804] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-07. [2025-09-17T17:00:56.725869] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T17:00:57.215805] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-03. [2025-09-17T17:00:58.015878] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-11. [2025-09-17T17:00:58.172550] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T17:00:58.454795] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T17:00:58.815782] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-04. [2025-09-17T17:00:59.615752] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-06. [2025-09-17T17:00:59.658389] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T17:01:00.415766] [INFO ] [REMOTE ] ABR: Fetching primary data for 2024-12. [2025-09-17T17:01:00.539616] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T17:01:00.785137] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T17:01:01.215789] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-05. [2025-09-17T17:01:02.015906] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-07. [2025-09-17T17:01:02.453603] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T17:01:02.815764] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-01. [2025-09-17T17:01:02.898199] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T17:01:03.407857] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T17:01:03.615786] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-08. [2025-09-17T17:01:04.171245] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T17:01:04.415782] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-02. [2025-09-17T17:01:05.068536] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T17:01:05.215850] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-06. [2025-09-17T17:01:06.015690] [INFO ] [REMOTE ] ABG: Fetching primary data for 2025-09. [2025-09-17T17:01:06.120761] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T17:01:06.720405] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T17:01:06.743576] [INFO ] [REMOTE ] ABG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T17:01:06.745865] [INFO ] [REMOTE ] ABG: Full fetch complete (26183 records). [2025-09-17T17:01:06.745962] [DEBUG] [VALIDATOR ] ABG: Validating primary data. [2025-09-17T17:01:06.820879] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-07. [2025-09-17T17:01:07.122504] [DEBUG] [VALIDATOR ] ABG: All expected trading days are present. [2025-09-17T17:01:07.122615] [DEBUG] [VALIDATOR ] ABG: Primary data validation passed. [2025-09-17T17:01:07.123020] [INFO ] [MAIN ] ABG: Fetched primary data is valid. [2025-09-17T17:01:07.123083] [DEBUG] [LOCAL ] ABG: Saving primary data. [2025-09-17T17:01:07.124029] [DEBUG] [LOCAL ] ABG: Trimmed 26183 records to 18939 (keeping 200 days of data) [2025-09-17T17:01:07.236782] [DEBUG] [LOCAL ] ABG: Primary data saved (18939 records). [2025-09-17T17:01:07.236933] [INFO ] [MAIN ] ABG: Full history saved. [2025-09-17T17:01:07.237028] [INFO ] [MAIN ] Update Progress: 12/2371 symbols completed. ABG took 20.5s. Estimated remaining: 3h 34m 6s. Rate: 11.0 symbols/min [2025-09-17T17:01:07.404610] [INFO ] [MAIN ] ABT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:01:07.462379] [DEBUG] [LOCAL ] ABT: Loaded 53621 existing records from primary storage. [2025-09-17T17:01:07.462531] [INFO ] [MAIN ] ABT: Loaded 53621 existing records. [2025-09-17T17:01:07.621692] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-08. [2025-09-17T17:01:07.644481] [WARN ] [MAIN ] ABT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:01:07.644752] [INFO ] [MAIN ] ABT: Wiping existing primary data before full refresh. [2025-09-17T17:01:07.644802] [INFO ] [LOCAL ] ABT: Starting deletion of primary data. [2025-09-17T17:01:07.646013] [DEBUG] [LOCAL ] ABT: Deleted primary data file. [2025-09-17T17:01:07.646063] [INFO ] [MAIN ] ABT: Starting full primary refresh. [2025-09-17T17:01:08.019123] [INFO ] [REMOTE ] ABT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:01:08.040276] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T17:01:08.415787] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-08. [2025-09-17T17:01:09.215751] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-03. [2025-09-17T17:01:09.407684] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T17:01:09.509092] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T17:01:10.015768] [INFO ] [REMOTE ] ABM: Fetching primary data for 2025-09. [2025-09-17T17:01:10.815768] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-11. [2025-09-17T17:01:11.244865] [INFO ] [REMOTE ] ABM: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T17:01:11.250598] [INFO ] [REMOTE ] ABM: Full fetch complete (44065 records). [2025-09-17T17:01:11.250757] [DEBUG] [VALIDATOR ] ABM: Validating primary data. [2025-09-17T17:01:11.597358] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-17T17:01:11.616191] [INFO ] [REMOTE ] ABEV: Fetching primary data for 2025-09. [2025-09-17T17:01:11.678829] [DEBUG] [VALIDATOR ] ABM: All expected trading days are present. [2025-09-17T17:01:11.678907] [DEBUG] [VALIDATOR ] ABM: Primary data validation passed. [2025-09-17T17:01:11.679352] [INFO ] [MAIN ] ABM: Fetched primary data is valid. [2025-09-17T17:01:11.679393] [DEBUG] [LOCAL ] ABM: Saving primary data. [2025-09-17T17:01:11.680337] [DEBUG] [LOCAL ] ABM: Trimmed 44065 records to 32236 (keeping 200 days of data) [2025-09-17T17:01:11.881871] [DEBUG] [LOCAL ] ABM: Primary data saved (32236 records). [2025-09-17T17:01:11.882010] [INFO ] [MAIN ] ABM: Full history saved. [2025-09-17T17:01:11.883740] [INFO ] [MAIN ] Update Progress: 13/2371 symbols completed. ABM took 21.6s. Estimated remaining: 3h 31m 35s. Rate: 11.1 symbols/min [2025-09-17T17:01:12.053226] [INFO ] [MAIN ] ACA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:01:12.078218] [DEBUG] [LOCAL ] ACA: Loaded 24455 existing records from primary storage. [2025-09-17T17:01:12.078356] [INFO ] [MAIN ] ACA: Loaded 24455 existing records. [2025-09-17T17:01:12.260501] [WARN ] [MAIN ] ACA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:01:12.260824] [INFO ] [MAIN ] ACA: Wiping existing primary data before full refresh. [2025-09-17T17:01:12.260877] [INFO ] [LOCAL ] ACA: Starting deletion of primary data. [2025-09-17T17:01:12.261414] [DEBUG] [LOCAL ] ACA: Deleted primary data file. [2025-09-17T17:01:12.261487] [INFO ] [MAIN ] ACA: Starting full primary refresh. [2025-09-17T17:01:12.422757] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-04. [2025-09-17T17:01:12.632794] [INFO ] [REMOTE ] ACA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:01:12.659893] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T17:01:13.215741] [INFO ] [REMOTE ] ABT: Fetching primary data for 2024-12. [2025-09-17T17:01:13.283283] [INFO ] [REMOTE ] ABEV: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T17:01:13.290387] [INFO ] [REMOTE ] ABEV: Full fetch complete (77063 records). [2025-09-17T17:01:13.290526] [DEBUG] [VALIDATOR ] ABEV: Validating primary data. [2025-09-17T17:01:13.698795] [DEBUG] [VALIDATOR ] ABEV: All expected trading days are present. [2025-09-17T17:01:13.698877] [DEBUG] [VALIDATOR ] ABEV: Primary data validation passed. [2025-09-17T17:01:13.699580] [INFO ] [MAIN ] ABEV: Fetched primary data is valid. [2025-09-17T17:01:13.699622] [DEBUG] [LOCAL ] ABEV: Saving primary data. [2025-09-17T17:01:13.701096] [DEBUG] [LOCAL ] ABEV: Trimmed 77063 records to 53272 (keeping 200 days of data) [2025-09-17T17:01:14.009864] [DEBUG] [LOCAL ] ABEV: Primary data saved (53272 records). [2025-09-17T17:01:14.010006] [INFO ] [MAIN ] ABEV: Full history saved. [2025-09-17T17:01:14.011414] [INFO ] [MAIN ] Update Progress: 14/2371 symbols completed. ABEV took 33.6s. Estimated remaining: 3h 22m 22s. Rate: 11.6 symbols/min [2025-09-17T17:01:14.023068] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-11. [2025-09-17T17:01:14.183871] [INFO ] [MAIN ] ACCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:01:14.225527] [DEBUG] [LOCAL ] ACCO: Loaded 38109 existing records from primary storage. [2025-09-17T17:01:14.225684] [INFO ] [MAIN ] ACCO: Loaded 38109 existing records. [2025-09-17T17:01:14.406848] [WARN ] [MAIN ] ACCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:01:14.407123] [INFO ] [MAIN ] ACCO: Wiping existing primary data before full refresh. [2025-09-17T17:01:14.407168] [INFO ] [LOCAL ] ACCO: Starting deletion of primary data. [2025-09-17T17:01:14.407923] [DEBUG] [LOCAL ] ACCO: Deleted primary data file. [2025-09-17T17:01:14.407972] [INFO ] [MAIN ] ACCO: Starting full primary refresh. [2025-09-17T17:01:14.771909] [INFO ] [REMOTE ] ACCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:01:14.804461] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-17T17:01:14.815745] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-11. [2025-09-17T17:01:15.163025] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T17:01:15.190827] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T17:01:15.615781] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-01. [2025-09-17T17:01:16.415774] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-05. [2025-09-17T17:01:16.642687] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T17:01:17.011601] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T17:01:17.215838] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2024-12. [2025-09-17T17:01:18.015793] [INFO ] [REMOTE ] ACA: Fetching primary data for 2024-12. [2025-09-17T17:01:18.315214] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T17:01:18.637058] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T17:01:18.815779] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-06. [2025-09-17T17:01:19.103673] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T17:01:19.615803] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-01. [2025-09-17T17:01:20.415789] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-01. [2025-09-17T17:01:20.455477] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T17:01:20.880870] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T17:01:21.215839] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-02. [2025-09-17T17:01:21.736366] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T17:01:22.015821] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-07. [2025-09-17T17:01:22.771915] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T17:01:22.815739] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-03. [2025-09-17T17:01:23.615753] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-02. [2025-09-17T17:01:23.871107] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T17:01:24.420862] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-02. [2025-09-17T17:01:24.440087] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T17:01:24.830896] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T17:01:25.215799] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-08. [2025-09-17T17:01:25.710512] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T17:01:26.015792] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-04. [2025-09-17T17:01:26.769276] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T17:01:26.815764] [INFO ] [REMOTE ] ABR: Fetching primary data for 2025-09. [2025-09-17T17:01:27.615815] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-03. [2025-09-17T17:01:28.415963] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-03. [2025-09-17T17:01:28.864791] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-04 (2.85 seconds). [2025-09-17T17:01:28.928716] [INFO ] [REMOTE ] ABR: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-17T17:01:28.935743] [INFO ] [REMOTE ] ABR: Full fetch complete (75052 records). [2025-09-17T17:01:28.935905] [DEBUG] [VALIDATOR ] ABR: Validating primary data. [2025-09-17T17:01:29.217766] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-05. [2025-09-17T17:01:29.404211] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T17:01:29.404622] [DEBUG] [VALIDATOR ] ABR: All expected trading days are present. [2025-09-17T17:01:29.414044] [DEBUG] [VALIDATOR ] ABR: Primary data validation passed. [2025-09-17T17:01:29.415709] [INFO ] [MAIN ] ABR: Fetched primary data is valid. [2025-09-17T17:01:29.415801] [DEBUG] [LOCAL ] ABR: Saving primary data. [2025-09-17T17:01:29.418372] [DEBUG] [LOCAL ] ABR: Trimmed 75052 records to 52166 (keeping 200 days of data) [2025-09-17T17:01:29.753339] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T17:01:29.799417] [DEBUG] [LOCAL ] ABR: Primary data saved (52166 records). [2025-09-17T17:01:29.799599] [INFO ] [MAIN ] ABR: Full history saved. [2025-09-17T17:01:29.799720] [INFO ] [MAIN ] Update Progress: 15/2371 symbols completed. ABR took 35.6s. Estimated remaining: 3h 50m 7s. Rate: 10.2 symbols/min [2025-09-17T17:01:29.978268] [INFO ] [MAIN ] ACEL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:01:30.006177] [DEBUG] [LOCAL ] ACEL: Loaded 27547 existing records from primary storage. [2025-09-17T17:01:30.006319] [INFO ] [MAIN ] ACEL: Loaded 27547 existing records. [2025-09-17T17:01:30.020958] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-04. [2025-09-17T17:01:30.191518] [WARN ] [MAIN ] ACEL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:01:30.191768] [INFO ] [MAIN ] ACEL: Wiping existing primary data before full refresh. [2025-09-17T17:01:30.191814] [INFO ] [LOCAL ] ACEL: Starting deletion of primary data. [2025-09-17T17:01:30.192389] [DEBUG] [LOCAL ] ACEL: Deleted primary data file. [2025-09-17T17:01:30.192444] [INFO ] [MAIN ] ACEL: Starting full primary refresh. [2025-09-17T17:01:30.555350] [INFO ] [REMOTE ] ACEL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:01:30.815800] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-04. [2025-09-17T17:01:31.232724] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T17:01:31.294024] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-17T17:01:31.615795] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-05. [2025-09-17T17:01:32.415765] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-06. [2025-09-17T17:01:32.517098] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T17:01:32.585630] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T17:01:33.215833] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-06. [2025-09-17T17:01:34.015787] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-05. [2025-09-17T17:01:34.280194] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T17:01:34.475257] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T17:01:34.815776] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-07. [2025-09-17T17:01:35.517325] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T17:01:35.615775] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-07. [2025-09-17T17:01:36.415830] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-11. [2025-09-17T17:01:36.719852] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T17:01:37.071072] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T17:01:37.215854] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-06. [2025-09-17T17:01:37.369845] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T17:01:38.015776] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-08. [2025-09-17T17:01:38.818338] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2024-12. [2025-09-17T17:01:38.821198] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T17:01:38.884984] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T17:01:39.615815] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-07. [2025-09-17T17:01:39.933109] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T17:01:40.415789] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-01. [2025-09-17T17:01:40.976277] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T17:01:41.215779] [INFO ] [REMOTE ] ACA: Fetching primary data for 2025-09. [2025-09-17T17:01:41.538891] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T17:01:41.878802] [INFO ] [REMOTE ] ACA: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T17:01:41.881564] [INFO ] [REMOTE ] ACA: Full fetch complete (34105 records). [2025-09-17T17:01:41.881799] [DEBUG] [VALIDATOR ] ACA: Validating primary data. [2025-09-17T17:01:42.024333] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-08. [2025-09-17T17:01:42.263238] [DEBUG] [VALIDATOR ] ACA: All expected trading days are present. [2025-09-17T17:01:42.263338] [DEBUG] [VALIDATOR ] ACA: Primary data validation passed. [2025-09-17T17:01:42.263855] [INFO ] [MAIN ] ACA: Fetched primary data is valid. [2025-09-17T17:01:42.263924] [DEBUG] [LOCAL ] ACA: Saving primary data. [2025-09-17T17:01:42.265098] [DEBUG] [LOCAL ] ACA: Trimmed 34105 records to 24269 (keeping 200 days of data) [2025-09-17T17:01:42.413973] [DEBUG] [LOCAL ] ACA: Primary data saved (24269 records). [2025-09-17T17:01:42.414108] [INFO ] [MAIN ] ACA: Full history saved. [2025-09-17T17:01:42.414195] [INFO ] [MAIN ] Update Progress: 16/2371 symbols completed. ACA took 30.5s. Estimated remaining: 4h 6m 36s. Rate: 9.6 symbols/min [2025-09-17T17:01:42.588622] [INFO ] [MAIN ] ACHR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:01:42.643225] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-09-17T17:01:42.643396] [INFO ] [MAIN ] ACHR: Loaded 53818 existing records. [2025-09-17T17:01:42.820921] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-02. [2025-09-17T17:01:42.825314] [WARN ] [MAIN ] ACHR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:01:42.826399] [INFO ] [MAIN ] ACHR: Wiping existing primary data before full refresh. [2025-09-17T17:01:42.826451] [INFO ] [LOCAL ] ACHR: Starting deletion of primary data. [2025-09-17T17:01:42.827393] [DEBUG] [LOCAL ] ACHR: Deleted primary data file. [2025-09-17T17:01:42.827446] [INFO ] [MAIN ] ACHR: Starting full primary refresh. [2025-09-17T17:01:43.207229] [INFO ] [REMOTE ] ACHR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:01:43.365582] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T17:01:43.615841] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-08. [2025-09-17T17:01:43.858698] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T17:01:44.415793] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-11. [2025-09-17T17:01:45.215754] [INFO ] [REMOTE ] ACCO: Fetching primary data for 2025-09. [2025-09-17T17:01:45.328004] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T17:01:46.015800] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-03. [2025-09-17T17:01:46.519310] [INFO ] [REMOTE ] ACCO: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T17:01:46.523844] [INFO ] [REMOTE ] ACCO: Full fetch complete (54175 records). [2025-09-17T17:01:46.523945] [DEBUG] [VALIDATOR ] ACCO: Validating primary data. [2025-09-17T17:01:46.819749] [INFO ] [REMOTE ] ABT: Fetching primary data for 2025-09. [2025-09-17T17:01:46.915348] [DEBUG] [VALIDATOR ] ACCO: All expected trading days are present. [2025-09-17T17:01:46.915497] [DEBUG] [VALIDATOR ] ACCO: Primary data validation passed. [2025-09-17T17:01:46.916084] [INFO ] [MAIN ] ACCO: Fetched primary data is valid. [2025-09-17T17:01:46.916163] [DEBUG] [LOCAL ] ACCO: Saving primary data. [2025-09-17T17:01:46.917624] [DEBUG] [LOCAL ] ACCO: Trimmed 54175 records to 38079 (keeping 200 days of data) [2025-09-17T17:01:47.170191] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-11 (2.75 seconds). [2025-09-17T17:01:47.194503] [DEBUG] [LOCAL ] ACCO: Primary data saved (38079 records). [2025-09-17T17:01:47.194771] [INFO ] [MAIN ] ACCO: Full history saved. [2025-09-17T17:01:47.194908] [INFO ] [MAIN ] Update Progress: 17/2371 symbols completed. ACCO took 33.2s. Estimated remaining: 4h 3m 1s. Rate: 9.7 symbols/min [2025-09-17T17:01:47.372283] [INFO ] [MAIN ] ACI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:01:47.392780] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T17:01:47.460357] [DEBUG] [LOCAL ] ACI: Loaded 53268 existing records from primary storage. [2025-09-17T17:01:47.460683] [INFO ] [MAIN ] ACI: Loaded 53268 existing records. [2025-09-17T17:01:47.620905] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2024-12. [2025-09-17T17:01:47.650203] [WARN ] [MAIN ] ACI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:01:47.650458] [INFO ] [MAIN ] ACI: Wiping existing primary data before full refresh. [2025-09-17T17:01:47.650506] [INFO ] [LOCAL ] ACI: Starting deletion of primary data. [2025-09-17T17:01:47.651510] [DEBUG] [LOCAL ] ACI: Deleted primary data file. [2025-09-17T17:01:47.651562] [INFO ] [MAIN ] ACI: Starting full primary refresh. [2025-09-17T17:01:48.043374] [INFO ] [REMOTE ] ACI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:01:48.420845] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-04. [2025-09-17T17:01:48.431503] [INFO ] [REMOTE ] ABT: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T17:01:48.440735] [INFO ] [REMOTE ] ABT: Full fetch complete (77429 records). [2025-09-17T17:01:48.440848] [DEBUG] [VALIDATOR ] ABT: Validating primary data. [2025-09-17T17:01:48.856007] [DEBUG] [VALIDATOR ] ABT: All expected trading days are present. [2025-09-17T17:01:48.856110] [DEBUG] [VALIDATOR ] ABT: Primary data validation passed. [2025-09-17T17:01:48.856849] [INFO ] [MAIN ] ABT: Fetched primary data is valid. [2025-09-17T17:01:48.856902] [DEBUG] [LOCAL ] ABT: Saving primary data. [2025-09-17T17:01:48.858461] [DEBUG] [LOCAL ] ABT: Trimmed 77429 records to 53621 (keeping 200 days of data) [2025-09-17T17:01:49.203616] [DEBUG] [LOCAL ] ABT: Primary data saved (53621 records). [2025-09-17T17:01:49.203807] [INFO ] [MAIN ] ABT: Full history saved. [2025-09-17T17:01:49.204778] [INFO ] [MAIN ] Update Progress: 18/2371 symbols completed. ABT took 42.0s. Estimated remaining: 3h 53m 48s. Rate: 10.1 symbols/min [2025-09-17T17:01:49.237266] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-11. [2025-09-17T17:01:49.382410] [INFO ] [MAIN ] ACM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:01:49.427772] [DEBUG] [LOCAL ] ACM: Loaded 43150 existing records from primary storage. [2025-09-17T17:01:49.427945] [INFO ] [MAIN ] ACM: Loaded 43150 existing records. [2025-09-17T17:01:49.606978] [WARN ] [MAIN ] ACM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:01:49.607242] [INFO ] [MAIN ] ACM: Wiping existing primary data before full refresh. [2025-09-17T17:01:49.607289] [INFO ] [LOCAL ] ACM: Starting deletion of primary data. [2025-09-17T17:01:49.608248] [DEBUG] [LOCAL ] ACM: Deleted primary data file. [2025-09-17T17:01:49.608303] [INFO ] [MAIN ] ACM: Starting full primary refresh. [2025-09-17T17:01:49.990436] [INFO ] [REMOTE ] ACM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:01:50.011412] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T17:01:50.018607] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-11. [2025-09-17T17:01:50.359254] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2024-12 (2.74 seconds). [2025-09-17T17:01:50.815807] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-01. [2025-09-17T17:01:51.161791] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T17:01:51.615817] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-05. [2025-09-17T17:01:51.721999] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T17:01:52.415827] [INFO ] [REMOTE ] ACI: Fetching primary data for 2024-12. [2025-09-17T17:01:52.572355] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T17:01:53.089306] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-17T17:01:53.215811] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-06. [2025-09-17T17:01:54.015800] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-02. [2025-09-17T17:01:54.317588] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T17:01:54.637196] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-17T17:01:54.815803] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-07. [2025-09-17T17:01:55.615779] [INFO ] [REMOTE ] ACM: Fetching primary data for 2024-12. [2025-09-17T17:01:55.845561] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T17:01:56.415796] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-08. [2025-09-17T17:01:56.457970] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-17T17:01:57.217462] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-03. [2025-09-17T17:01:57.219880] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T17:01:57.597736] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T17:01:58.015799] [INFO ] [REMOTE ] ACEL: Fetching primary data for 2025-09. [2025-09-17T17:01:58.815799] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-01. [2025-09-17T17:01:59.044198] [INFO ] [REMOTE ] ACEL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T17:01:59.047955] [INFO ] [REMOTE ] ACEL: Full fetch complete (39005 records). [2025-09-17T17:01:59.048095] [DEBUG] [VALIDATOR ] ACEL: Validating primary data. [2025-09-17T17:01:59.459236] [DEBUG] [VALIDATOR ] ACEL: All expected trading days are present. [2025-09-17T17:01:59.459350] [DEBUG] [VALIDATOR ] ACEL: Primary data validation passed. [2025-09-17T17:01:59.459881] [INFO ] [MAIN ] ACEL: Fetched primary data is valid. [2025-09-17T17:01:59.459996] [DEBUG] [LOCAL ] ACEL: Saving primary data. [2025-09-17T17:01:59.461303] [DEBUG] [LOCAL ] ACEL: Trimmed 39005 records to 27453 (keeping 200 days of data) [2025-09-17T17:01:59.605687] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-17T17:01:59.620402] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-01. [2025-09-17T17:01:59.670936] [DEBUG] [LOCAL ] ACEL: Primary data saved (27453 records). [2025-09-17T17:01:59.671098] [INFO ] [MAIN ] ACEL: Full history saved. [2025-09-17T17:01:59.671206] [INFO ] [MAIN ] Update Progress: 19/2371 symbols completed. ACEL took 29.9s. Estimated remaining: 4h 2m 60s. Rate: 9.7 symbols/min [2025-09-17T17:01:59.862491] [INFO ] [MAIN ] ACN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:01:59.920475] [DEBUG] [LOCAL ] ACN: Loaded 53419 existing records from primary storage. [2025-09-17T17:01:59.920683] [INFO ] [MAIN ] ACN: Loaded 53419 existing records. [2025-09-17T17:02:00.118014] [WARN ] [MAIN ] ACN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:02:00.118398] [INFO ] [MAIN ] ACN: Wiping existing primary data before full refresh. [2025-09-17T17:02:00.119353] [INFO ] [LOCAL ] ACN: Starting deletion of primary data. [2025-09-17T17:02:00.120485] [DEBUG] [LOCAL ] ACN: Deleted primary data file. [2025-09-17T17:02:00.120550] [INFO ] [MAIN ] ACN: Starting full primary refresh. [2025-09-17T17:02:00.416003] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-04. [2025-09-17T17:02:00.537610] [INFO ] [REMOTE ] ACN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:02:00.565766] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T17:02:01.215800] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-11. [2025-09-17T17:02:01.301759] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T17:02:02.015787] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-02. [2025-09-17T17:02:02.815832] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-02. [2025-09-17T17:02:03.121743] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-17T17:02:03.173450] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T17:02:03.615777] [INFO ] [REMOTE ] ACN: Fetching primary data for 2024-12. [2025-09-17T17:02:04.082177] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T17:02:04.288851] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T17:02:04.415799] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-03. [2025-09-17T17:02:05.215697] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-03. [2025-09-17T17:02:05.314448] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T17:02:06.015791] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-01. [2025-09-17T17:02:06.371145] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T17:02:06.815775] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-05. [2025-09-17T17:02:06.978968] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T17:02:07.615766] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-04. [2025-09-17T17:02:07.996168] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T17:02:08.415768] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-04. [2025-09-17T17:02:09.089458] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-17T17:02:09.215801] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-02. [2025-09-17T17:02:09.335003] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T17:02:09.703387] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T17:02:10.015757] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-05. [2025-09-17T17:02:10.632569] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T17:02:10.815769] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-03. [2025-09-17T17:02:11.615776] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-05. [2025-09-17T17:02:11.684203] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T17:02:12.405019] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T17:02:12.415814] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-06. [2025-09-17T17:02:13.215764] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-04. [2025-09-17T17:02:13.474707] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T17:02:14.015816] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-06. [2025-09-17T17:02:14.795539] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-17T17:02:14.815738] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-07. [2025-09-17T17:02:15.364930] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-17T17:02:15.615818] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-05. [2025-09-17T17:02:15.667738] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:02:16.415803] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-07. [2025-09-17T17:02:17.215808] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-06. [2025-09-17T17:02:17.258702] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-07 (2.44 seconds). [2025-09-17T17:02:17.588911] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T17:02:17.980701] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T17:02:18.015731] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-08. [2025-09-17T17:02:18.611832] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T17:02:18.815821] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-06. [2025-09-17T17:02:19.231758] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T17:02:19.615804] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-07. [2025-09-17T17:02:20.391502] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T17:02:20.415727] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-07. [2025-09-17T17:02:21.215781] [INFO ] [REMOTE ] ACM: Fetching primary data for 2025-09. [2025-09-17T17:02:21.582837] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T17:02:22.015771] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-08. [2025-09-17T17:02:22.131025] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T17:02:22.815758] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-08. [2025-09-17T17:02:22.888555] [INFO ] [REMOTE ] ACM: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T17:02:22.894731] [INFO ] [REMOTE ] ACM: Full fetch complete (62372 records). [2025-09-17T17:02:22.894875] [DEBUG] [VALIDATOR ] ACM: Validating primary data. [2025-09-17T17:02:23.310368] [DEBUG] [VALIDATOR ] ACM: All expected trading days are present. [2025-09-17T17:02:23.310448] [DEBUG] [VALIDATOR ] ACM: Primary data validation passed. [2025-09-17T17:02:23.311041] [INFO ] [MAIN ] ACM: Fetched primary data is valid. [2025-09-17T17:02:23.311086] [DEBUG] [LOCAL ] ACM: Saving primary data. [2025-09-17T17:02:23.312273] [DEBUG] [LOCAL ] ACM: Trimmed 62372 records to 43121 (keeping 200 days of data) [2025-09-17T17:02:23.590918] [DEBUG] [LOCAL ] ACM: Primary data saved (43121 records). [2025-09-17T17:02:23.591107] [INFO ] [MAIN ] ACM: Full history saved. [2025-09-17T17:02:23.592389] [INFO ] [MAIN ] Update Progress: 20/2371 symbols completed. ACM took 34.4s. Estimated remaining: 4h 37m 37s. Rate: 8.5 symbols/min [2025-09-17T17:02:23.632935] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-08. [2025-09-17T17:02:23.786045] [INFO ] [MAIN ] ACP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:02:23.819760] [DEBUG] [LOCAL ] ACP: Loaded 31437 existing records from primary storage. [2025-09-17T17:02:23.819924] [INFO ] [MAIN ] ACP: Loaded 31437 existing records. [2025-09-17T17:02:23.998782] [WARN ] [MAIN ] ACP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:02:23.999166] [INFO ] [MAIN ] ACP: Wiping existing primary data before full refresh. [2025-09-17T17:02:23.999231] [INFO ] [LOCAL ] ACP: Starting deletion of primary data. [2025-09-17T17:02:23.999912] [DEBUG] [LOCAL ] ACP: Deleted primary data file. [2025-09-17T17:02:23.999993] [INFO ] [MAIN ] ACP: Starting full primary refresh. [2025-09-17T17:02:24.198231] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T17:02:24.429430] [INFO ] [REMOTE ] ACP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:02:24.424119] [INFO ] [REMOTE ] ACI: Fetching primary data for 2025-09. [2025-09-17T17:02:24.899714] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T17:02:25.215793] [INFO ] [REMOTE ] ACN: Fetching primary data for 2025-09. [2025-09-17T17:02:26.015764] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-11. [2025-09-17T17:02:26.250782] [INFO ] [REMOTE ] ACI: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T17:02:26.257544] [INFO ] [REMOTE ] ACI: Full fetch complete (76871 records). [2025-09-17T17:02:26.257687] [DEBUG] [VALIDATOR ] ACI: Validating primary data. [2025-09-17T17:02:26.695813] [DEBUG] [VALIDATOR ] ACI: All expected trading days are present. [2025-09-17T17:02:26.696137] [DEBUG] [VALIDATOR ] ACI: Primary data validation passed. [2025-09-17T17:02:26.697099] [INFO ] [MAIN ] ACI: Fetched primary data is valid. [2025-09-17T17:02:26.697166] [DEBUG] [LOCAL ] ACI: Saving primary data. [2025-09-17T17:02:26.699509] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-08 (3.07 seconds). [2025-09-17T17:02:26.712278] [DEBUG] [LOCAL ] ACI: Trimmed 76871 records to 53274 (keeping 200 days of data) [2025-09-17T17:02:26.815814] [INFO ] [REMOTE ] ACHR: Fetching primary data for 2025-09. [2025-09-17T17:02:27.037863] [DEBUG] [LOCAL ] ACI: Primary data saved (53274 records). [2025-09-17T17:02:27.038000] [INFO ] [MAIN ] ACI: Full history saved. [2025-09-17T17:02:27.038847] [INFO ] [MAIN ] Update Progress: 21/2371 symbols completed. ACI took 39.8s. Estimated remaining: 4h 30m 43s. Rate: 8.7 symbols/min [2025-09-17T17:02:27.217832] [INFO ] [MAIN ] ACR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:02:27.228016] [DEBUG] [LOCAL ] ACR: Loaded 6495 existing records from primary storage. [2025-09-17T17:02:27.228166] [INFO ] [MAIN ] ACR: Loaded 6495 existing records. [2025-09-17T17:02:27.338392] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T17:02:27.450364] [WARN ] [MAIN ] ACR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:02:27.451867] [INFO ] [REMOTE ] ACN: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-17T17:02:27.458000] [INFO ] [MAIN ] ACR: Wiping existing primary data before full refresh. [2025-09-17T17:02:27.458351] [INFO ] [LOCAL ] ACR: Starting deletion of primary data. [2025-09-17T17:02:27.458753] [DEBUG] [LOCAL ] ACR: Deleted primary data file. [2025-09-17T17:02:27.458807] [INFO ] [MAIN ] ACR: Starting full primary refresh. [2025-09-17T17:02:27.490034] [INFO ] [REMOTE ] ACN: Full fetch complete (76937 records). [2025-09-17T17:02:27.522071] [DEBUG] [VALIDATOR ] ACN: Validating primary data. [2025-09-17T17:02:27.616845] [INFO ] [REMOTE ] ACP: Fetching primary data for 2024-12. [2025-09-17T17:02:28.192810] [INFO ] [REMOTE ] ACR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:02:28.231006] [DEBUG] [VALIDATOR ] ACN: All expected trading days are present. [2025-09-17T17:02:28.231079] [DEBUG] [VALIDATOR ] ACN: Primary data validation passed. [2025-09-17T17:02:28.231753] [INFO ] [MAIN ] ACN: Fetched primary data is valid. [2025-09-17T17:02:28.231799] [DEBUG] [LOCAL ] ACN: Saving primary data. [2025-09-17T17:02:28.233226] [DEBUG] [LOCAL ] ACN: Trimmed 76937 records to 53419 (keeping 200 days of data) [2025-09-17T17:02:28.418699] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-11. [2025-09-17T17:02:28.581430] [DEBUG] [LOCAL ] ACN: Primary data saved (53419 records). [2025-09-17T17:02:28.581665] [INFO ] [MAIN ] ACN: Full history saved. [2025-09-17T17:02:28.581770] [INFO ] [MAIN ] Update Progress: 22/2371 symbols completed. ACN took 28.9s. Estimated remaining: 4h 21m 2s. Rate: 9.0 symbols/min [2025-09-17T17:02:28.762584] [INFO ] [MAIN ] ACRE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:02:28.811297] [DEBUG] [LOCAL ] ACRE: Loaded 33740 existing records from primary storage. [2025-09-17T17:02:28.811521] [INFO ] [MAIN ] ACRE: Loaded 33740 existing records. [2025-09-17T17:02:29.122034] [WARN ] [MAIN ] ACRE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:02:29.124153] [INFO ] [MAIN ] ACRE: Wiping existing primary data before full refresh. [2025-09-17T17:02:29.125040] [INFO ] [LOCAL ] ACRE: Starting deletion of primary data. [2025-09-17T17:02:29.131815] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T17:02:29.135611] [DEBUG] [LOCAL ] ACRE: Deleted primary data file. [2025-09-17T17:02:29.135952] [INFO ] [MAIN ] ACRE: Starting full primary refresh. [2025-09-17T17:02:29.224108] [INFO ] [REMOTE ] ACR: Fetching primary data for 2024-12. [2025-09-17T17:02:29.354618] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T17:02:29.466701] [INFO ] [REMOTE ] ACHR: Incremental fetch complete for 2025-09 (2.65 seconds). [2025-09-17T17:02:29.489555] [INFO ] [REMOTE ] ACHR: Full fetch complete (77998 records). [2025-09-17T17:02:29.519195] [DEBUG] [VALIDATOR ] ACHR: Validating primary data. [2025-09-17T17:02:29.922786] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T17:02:30.038563] [INFO ] [REMOTE ] ACRE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:02:30.034734] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-01. [2025-09-17T17:02:30.271801] [DEBUG] [VALIDATOR ] ACHR: All expected trading days are present. [2025-09-17T17:02:30.271899] [DEBUG] [VALIDATOR ] ACHR: Primary data validation passed. [2025-09-17T17:02:30.273041] [INFO ] [MAIN ] ACHR: Fetched primary data is valid. [2025-09-17T17:02:30.273124] [DEBUG] [LOCAL ] ACHR: Saving primary data. [2025-09-17T17:02:30.274841] [DEBUG] [LOCAL ] ACHR: Trimmed 77998 records to 53818 (keeping 200 days of data) [2025-09-17T17:02:30.600214] [DEBUG] [LOCAL ] ACHR: Primary data saved (53818 records). [2025-09-17T17:02:30.600377] [INFO ] [MAIN ] ACHR: Full history saved. [2025-09-17T17:02:30.601169] [INFO ] [MAIN ] Update Progress: 23/2371 symbols completed. ACHR took 48.2s. Estimated remaining: 4h 13m 1s. Rate: 9.3 symbols/min [2025-09-17T17:02:30.774824] [INFO ] [MAIN ] ACV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:02:30.784399] [DEBUG] [LOCAL ] ACV: Loaded 6862 existing records from primary storage. [2025-09-17T17:02:30.784535] [INFO ] [MAIN ] ACV: Loaded 6862 existing records. [2025-09-17T17:02:30.820916] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-01. [2025-09-17T17:02:30.972737] [WARN ] [MAIN ] ACV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:02:30.973127] [INFO ] [MAIN ] ACV: Wiping existing primary data before full refresh. [2025-09-17T17:02:30.973205] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-17T17:02:30.973581] [DEBUG] [LOCAL ] ACV: Deleted primary data file. [2025-09-17T17:02:30.973683] [INFO ] [MAIN ] ACV: Starting full primary refresh. [2025-09-17T17:02:31.354618] [INFO ] [REMOTE ] ACV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:02:31.456939] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T17:02:31.562778] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T17:02:31.615801] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-02. [2025-09-17T17:02:32.415979] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-11. [2025-09-17T17:02:32.947801] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T17:02:33.215791] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-03. [2025-09-17T17:02:33.847356] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T17:02:34.015764] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2024-12. [2025-09-17T17:02:34.298223] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T17:02:34.815784] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-04. [2025-09-17T17:02:35.372902] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T17:02:35.615783] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-01. [2025-09-17T17:02:36.386462] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T17:02:36.415778] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-05. [2025-09-17T17:02:37.159216] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T17:02:37.215781] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-02. [2025-09-17T17:02:37.622010] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T17:02:38.015793] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-06. [2025-09-17T17:02:38.351933] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T17:02:38.815774] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-03. [2025-09-17T17:02:39.394097] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T17:02:39.615860] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-02. [2025-09-17T17:02:40.220565] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T17:02:40.242897] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T17:02:40.415806] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-07. [2025-09-17T17:02:41.215802] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-04. [2025-09-17T17:02:41.825756] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T17:02:42.015763] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-11. [2025-09-17T17:02:42.756609] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T17:02:42.784443] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T17:02:42.815949] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-05. [2025-09-17T17:02:43.615797] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-08. [2025-09-17T17:02:44.097818] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T17:02:44.415794] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-03. [2025-09-17T17:02:44.906161] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T17:02:45.215815] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-06. [2025-09-17T17:02:45.240627] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T17:02:46.015769] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-04. [2025-09-17T17:02:46.289275] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T17:02:46.490026] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T17:02:46.815791] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-05. [2025-09-17T17:02:47.596006] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T17:02:47.615738] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-06. [2025-09-17T17:02:48.418540] [INFO ] [REMOTE ] ACV: Fetching primary data for 2024-12. [2025-09-17T17:02:48.421132] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T17:02:48.907809] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-17T17:02:49.215791] [INFO ] [REMOTE ] ACP: Fetching primary data for 2025-09. [2025-09-17T17:02:50.015767] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-07. [2025-09-17T17:02:50.473215] [INFO ] [REMOTE ] ACP: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T17:02:50.477354] [INFO ] [REMOTE ] ACP: Full fetch complete (48081 records). [2025-09-17T17:02:50.477479] [DEBUG] [VALIDATOR ] ACP: Validating primary data. [2025-09-17T17:02:50.801356] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T17:02:50.834730] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-01. [2025-09-17T17:02:50.892805] [DEBUG] [VALIDATOR ] ACP: All expected trading days are present. [2025-09-17T17:02:50.892974] [DEBUG] [VALIDATOR ] ACP: Primary data validation passed. [2025-09-17T17:02:50.893508] [INFO ] [MAIN ] ACP: Fetched primary data is valid. [2025-09-17T17:02:50.893554] [DEBUG] [LOCAL ] ACP: Saving primary data. [2025-09-17T17:02:50.895028] [DEBUG] [LOCAL ] ACP: Trimmed 48081 records to 31453 (keeping 200 days of data) [2025-09-17T17:02:51.080987] [DEBUG] [LOCAL ] ACP: Primary data saved (31453 records). [2025-09-17T17:02:51.081147] [INFO ] [MAIN ] ACP: Full history saved. [2025-09-17T17:02:51.082664] [INFO ] [MAIN ] Update Progress: 24/2371 symbols completed. ACP took 27.5s. Estimated remaining: 4h 35m 45s. Rate: 8.5 symbols/min [2025-09-17T17:02:51.295320] [INFO ] [MAIN ] ACVA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:02:51.346687] [DEBUG] [LOCAL ] ACVA: Loaded 49402 existing records from primary storage. [2025-09-17T17:02:51.351064] [INFO ] [MAIN ] ACVA: Loaded 49402 existing records. [2025-09-17T17:02:51.351248] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T17:02:51.533441] [WARN ] [MAIN ] ACVA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:02:51.533760] [INFO ] [MAIN ] ACVA: Wiping existing primary data before full refresh. [2025-09-17T17:02:51.533810] [INFO ] [LOCAL ] ACVA: Starting deletion of primary data. [2025-09-17T17:02:51.534731] [DEBUG] [LOCAL ] ACVA: Deleted primary data file. [2025-09-17T17:02:51.534781] [INFO ] [MAIN ] ACVA: Starting full primary refresh. [2025-09-17T17:02:51.620996] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-02. [2025-09-17T17:02:51.899440] [INFO ] [REMOTE ] ACVA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:02:52.195296] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T17:02:52.415770] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-03. [2025-09-17T17:02:53.215774] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-08. [2025-09-17T17:02:53.324059] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T17:02:53.639060] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-17T17:02:54.015775] [INFO ] [REMOTE ] ACR: Fetching primary data for 2025-09. [2025-09-17T17:02:54.649392] [INFO ] [REMOTE ] ACR: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T17:02:54.650443] [INFO ] [REMOTE ] ACR: Full fetch complete (8556 records). [2025-09-17T17:02:54.650512] [DEBUG] [VALIDATOR ] ACR: Validating primary data. [2025-09-17T17:02:54.819292] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-11. [2025-09-17T17:02:55.034289] [DEBUG] [VALIDATOR ] ACR: All expected trading days are present. [2025-09-17T17:02:55.034380] [DEBUG] [VALIDATOR ] ACR: Primary data validation passed. [2025-09-17T17:02:55.034562] [INFO ] [MAIN ] ACR: Fetched primary data is valid. [2025-09-17T17:02:55.034615] [DEBUG] [LOCAL ] ACR: Saving primary data. [2025-09-17T17:02:55.035090] [DEBUG] [LOCAL ] ACR: Trimmed 8556 records to 6484 (keeping 200 days of data) [2025-09-17T17:02:55.074263] [DEBUG] [LOCAL ] ACR: Primary data saved (6484 records). [2025-09-17T17:02:55.074386] [INFO ] [MAIN ] ACR: Full history saved. [2025-09-17T17:02:55.074468] [INFO ] [MAIN ] Update Progress: 25/2371 symbols completed. ACR took 28.0s. Estimated remaining: 4h 30m 51s. Rate: 8.7 symbols/min [2025-09-17T17:02:55.246464] [INFO ] [MAIN ] AD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:02:55.246680] [DEBUG] [LOCAL ] AD: No existing data file found in primary storage. [2025-09-17T17:02:55.246720] [WARN ] [MAIN ] AD: No existing data found, performing full refresh instead. [2025-09-17T17:02:55.246839] [INFO ] [MAIN ] AD: Wiping existing primary data before full refresh. [2025-09-17T17:02:55.246878] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-17T17:02:55.246919] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-17T17:02:55.246951] [INFO ] [MAIN ] AD: Starting full primary refresh. [2025-09-17T17:02:55.618719] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-07. [2025-09-17T17:02:55.618585] [INFO ] [REMOTE ] AD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:02:56.319307] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T17:02:56.415848] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-04. [2025-09-17T17:02:57.061716] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T17:02:57.163167] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T17:02:57.215727] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-08. [2025-09-17T17:02:58.015772] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2024-12. [2025-09-17T17:02:58.353815] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T17:02:58.815780] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-11. [2025-09-17T17:02:59.009193] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:02:59.009500] [WARN ] [REMOTE ] AD: No data returned for month 2024-11 [2025-09-17T17:02:59.615783] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-05. [2025-09-17T17:02:59.729413] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T17:03:00.104162] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T17:03:00.415835] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-06. [2025-09-17T17:03:01.076582] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T17:03:01.215769] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-07. [2025-09-17T17:03:01.891156] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T17:03:02.015778] [INFO ] [REMOTE ] ACRE: Fetching primary data for 2025-09. [2025-09-17T17:03:02.815783] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-08. [2025-09-17T17:03:03.170070] [INFO ] [REMOTE ] ACRE: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T17:03:03.174059] [INFO ] [REMOTE ] ACRE: Full fetch complete (50404 records). [2025-09-17T17:03:03.174154] [DEBUG] [VALIDATOR ] ACRE: Validating primary data. [2025-09-17T17:03:03.504151] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T17:03:03.569787] [DEBUG] [VALIDATOR ] ACRE: All expected trading days are present. [2025-09-17T17:03:03.569874] [DEBUG] [VALIDATOR ] ACRE: Primary data validation passed. [2025-09-17T17:03:03.570409] [INFO ] [MAIN ] ACRE: Fetched primary data is valid. [2025-09-17T17:03:03.570451] [DEBUG] [LOCAL ] ACRE: Saving primary data. [2025-09-17T17:03:03.571486] [DEBUG] [LOCAL ] ACRE: Trimmed 50404 records to 33725 (keeping 200 days of data) [2025-09-17T17:03:03.626828] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-01. [2025-09-17T17:03:03.771415] [DEBUG] [LOCAL ] ACRE: Primary data saved (33725 records). [2025-09-17T17:03:03.771536] [INFO ] [MAIN ] ACRE: Full history saved. [2025-09-17T17:03:03.771616] [INFO ] [MAIN ] Update Progress: 26/2371 symbols completed. ACRE took 35.2s. Estimated remaining: 4h 33m 24s. Rate: 8.6 symbols/min [2025-09-17T17:03:03.948355] [INFO ] [MAIN ] ADC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:03:03.990616] [DEBUG] [LOCAL ] ADC: Loaded 46698 existing records from primary storage. [2025-09-17T17:03:03.990821] [INFO ] [MAIN ] ADC: Loaded 46698 existing records. [2025-09-17T17:03:04.178493] [WARN ] [MAIN ] ADC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:03:04.178826] [INFO ] [MAIN ] ADC: Wiping existing primary data before full refresh. [2025-09-17T17:03:04.178885] [INFO ] [LOCAL ] ADC: Starting deletion of primary data. [2025-09-17T17:03:04.179960] [DEBUG] [LOCAL ] ADC: Deleted primary data file. [2025-09-17T17:03:04.180022] [INFO ] [MAIN ] ADC: Starting full primary refresh. [2025-09-17T17:03:04.420842] [INFO ] [REMOTE ] AD: Fetching primary data for 2024-12. [2025-09-17T17:03:04.535237] [INFO ] [REMOTE ] ADC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:03:04.750307] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:03:04.750595] [WARN ] [REMOTE ] AD: No data returned for month 2024-12 [2025-09-17T17:03:04.907003] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T17:03:05.215785] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-11. [2025-09-17T17:03:06.015787] [INFO ] [REMOTE ] ACV: Fetching primary data for 2025-09. [2025-09-17T17:03:06.555817] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T17:03:06.815794] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-01. [2025-09-17T17:03:06.998332] [INFO ] [REMOTE ] ACV: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T17:03:07.000061] [INFO ] [REMOTE ] ACV: Full fetch complete (9490 records). [2025-09-17T17:03:07.000211] [DEBUG] [VALIDATOR ] ACV: Validating primary data. [2025-09-17T17:03:07.000888] [FATAL] [VALIDATOR ] ACV: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:03:07.000962] [FATAL] [MAIN ] ACV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:03:07.001008] [WARN ] [MAIN ] ACV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:03:07.001049] [INFO ] [LOCAL ] ACV: Starting deletion of primary data. [2025-09-17T17:03:07.001106] [DEBUG] [LOCAL ] ACV: No primary data file found to delete. [2025-09-17T17:03:07.001144] [INFO ] [LOCAL ] ACV: Starting deletion of derivative data. [2025-09-17T17:03:07.001707] [DEBUG] [LOCAL ] ACV: Deleted derivative data file. [2025-09-17T17:03:07.001797] [INFO ] [MAIN ] Update Progress: 27/2371 symbols completed. ACV took 36.4s. Estimated remaining: 4h 27m 50s. Rate: 8.8 symbols/min [2025-09-17T17:03:07.088251] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:03:07.114160] [WARN ] [REMOTE ] AD: No data returned for month 2025-01 [2025-09-17T17:03:07.186946] [INFO ] [MAIN ] ADCT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:03:07.224773] [DEBUG] [LOCAL ] ADCT: Loaded 33554 existing records from primary storage. [2025-09-17T17:03:07.224918] [INFO ] [MAIN ] ADCT: Loaded 33554 existing records. [2025-09-17T17:03:07.409509] [WARN ] [MAIN ] ADCT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:03:07.409790] [INFO ] [MAIN ] ADCT: Wiping existing primary data before full refresh. [2025-09-17T17:03:07.409835] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-17T17:03:07.410461] [DEBUG] [LOCAL ] ADCT: Deleted primary data file. [2025-09-17T17:03:07.410507] [INFO ] [MAIN ] ADCT: Starting full primary refresh. [2025-09-17T17:03:07.615740] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-02. [2025-09-17T17:03:07.779062] [INFO ] [REMOTE ] ADCT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:03:08.415791] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-11. [2025-09-17T17:03:09.215828] [INFO ] [REMOTE ] ADC: Fetching primary data for 2024-12. [2025-09-17T17:03:09.412846] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T17:03:09.884249] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T17:03:10.015744] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2024-12. [2025-09-17T17:03:10.485583] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T17:03:10.815774] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-02. [2025-09-17T17:03:11.019120] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:03:11.019487] [WARN ] [REMOTE ] AD: No data returned for month 2025-02 [2025-09-17T17:03:11.609578] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T17:03:11.620152] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-03. [2025-09-17T17:03:12.415909] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-01. [2025-09-17T17:03:13.216163] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T17:03:13.216242] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-03. [2025-09-17T17:03:13.646517] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:03:13.646951] [WARN ] [REMOTE ] AD: No data returned for month 2025-03 [2025-09-17T17:03:14.015762] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-04. [2025-09-17T17:03:14.181335] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T17:03:14.815785] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-01. [2025-09-17T17:03:15.374845] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T17:03:15.616022] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-05. [2025-09-17T17:03:16.058526] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T17:03:16.415818] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-02. [2025-09-17T17:03:16.851447] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T17:03:17.215770] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-04. [2025-09-17T17:03:17.405631] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:03:17.406124] [WARN ] [REMOTE ] AD: No data returned for month 2025-04 [2025-09-17T17:03:17.835292] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T17:03:18.015783] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-02. [2025-09-17T17:03:18.815802] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-06. [2025-09-17T17:03:19.347983] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T17:03:19.615811] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-03. [2025-09-17T17:03:20.127204] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T17:03:20.415788] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-05. [2025-09-17T17:03:20.632192] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:03:20.632508] [WARN ] [REMOTE ] AD: No data returned for month 2025-05 [2025-09-17T17:03:21.043783] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T17:03:21.215777] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-03. [2025-09-17T17:03:22.015799] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-07. [2025-09-17T17:03:22.815858] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-06. [2025-09-17T17:03:23.010409] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:03:23.011068] [WARN ] [REMOTE ] AD: No data returned for month 2025-06 [2025-09-17T17:03:23.042546] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T17:03:23.529400] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T17:03:23.615752] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-08. [2025-09-17T17:03:24.415822] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-04. [2025-09-17T17:03:25.126447] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T17:03:25.215809] [INFO ] [REMOTE ] ACVA: Fetching primary data for 2025-09. [2025-09-17T17:03:25.915006] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T17:03:26.015772] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-05. [2025-09-17T17:03:26.531789] [INFO ] [REMOTE ] ACVA: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T17:03:26.541780] [INFO ] [REMOTE ] ACVA: Full fetch complete (69908 records). [2025-09-17T17:03:26.541978] [DEBUG] [VALIDATOR ] ACVA: Validating primary data. [2025-09-17T17:03:26.824825] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-04. [2025-09-17T17:03:26.947974] [DEBUG] [VALIDATOR ] ACVA: All expected trading days are present. [2025-09-17T17:03:26.948278] [DEBUG] [VALIDATOR ] ACVA: Primary data validation passed. [2025-09-17T17:03:26.948992] [INFO ] [MAIN ] ACVA: Fetched primary data is valid. [2025-09-17T17:03:26.949044] [DEBUG] [LOCAL ] ACVA: Saving primary data. [2025-09-17T17:03:26.950605] [DEBUG] [LOCAL ] ACVA: Trimmed 69908 records to 49377 (keeping 200 days of data) [2025-09-17T17:03:27.243855] [DEBUG] [LOCAL ] ACVA: Primary data saved (49377 records). [2025-09-17T17:03:27.244020] [INFO ] [MAIN ] ACVA: Full history saved. [2025-09-17T17:03:27.246194] [INFO ] [MAIN ] Update Progress: 28/2371 symbols completed. ACVA took 36.2s. Estimated remaining: 4h 46m 24s. Rate: 8.2 symbols/min [2025-09-17T17:03:27.427468] [INFO ] [MAIN ] ADM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:03:27.482555] [DEBUG] [LOCAL ] ADM: Loaded 53399 existing records from primary storage. [2025-09-17T17:03:27.482751] [INFO ] [MAIN ] ADM: Loaded 53399 existing records. [2025-09-17T17:03:27.626377] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-07. [2025-09-17T17:03:27.665876] [WARN ] [MAIN ] ADM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:03:27.666231] [INFO ] [MAIN ] ADM: Wiping existing primary data before full refresh. [2025-09-17T17:03:27.666338] [INFO ] [LOCAL ] ADM: Starting deletion of primary data. [2025-09-17T17:03:27.676877] [DEBUG] [LOCAL ] ADM: Deleted primary data file. [2025-09-17T17:03:27.683156] [INFO ] [MAIN ] ADM: Starting full primary refresh. [2025-09-17T17:03:27.808784] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T17:03:27.957099] [DEBUG] [REMOTE ] AD: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:03:27.988931] [WARN ] [REMOTE ] AD: No data returned for month 2025-07 [2025-09-17T17:03:28.109214] [INFO ] [REMOTE ] ADM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:03:28.124378] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T17:03:28.415781] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-11. [2025-09-17T17:03:29.215795] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-08. [2025-09-17T17:03:30.015746] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-06. [2025-09-17T17:03:30.378396] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T17:03:30.401180] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T17:03:30.815790] [INFO ] [REMOTE ] ADM: Fetching primary data for 2024-12. [2025-09-17T17:03:31.481033] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T17:03:31.615787] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-05. [2025-09-17T17:03:32.415768] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-07. [2025-09-17T17:03:32.742562] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T17:03:33.065422] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T17:03:33.215840] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-01. [2025-09-17T17:03:34.022824] [INFO ] [REMOTE ] AD: Fetching primary data for 2025-09. [2025-09-17T17:03:34.042921] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T17:03:34.815751] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-06. [2025-09-17T17:03:34.875302] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T17:03:35.255258] [INFO ] [REMOTE ] AD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T17:03:35.258519] [INFO ] [REMOTE ] AD: Full fetch complete (5170 records). [2025-09-17T17:03:35.258604] [DEBUG] [VALIDATOR ] AD: Validating primary data. [2025-09-17T17:03:35.445076] [WARN ] [VALIDATOR ] AD: Validation failed - insufficient historical data. Have 26 unique days, need 200 days [2025-09-17T17:03:35.445338] [FATAL] [MAIN ] AD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:03:35.445411] [WARN ] [MAIN ] AD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:03:35.445478] [INFO ] [LOCAL ] AD: Starting deletion of primary data. [2025-09-17T17:03:35.445546] [DEBUG] [LOCAL ] AD: No primary data file found to delete. [2025-09-17T17:03:35.445602] [INFO ] [LOCAL ] AD: Starting deletion of derivative data. [2025-09-17T17:03:35.445667] [DEBUG] [LOCAL ] AD: No derivative data file found to delete. [2025-09-17T17:03:35.445746] [INFO ] [MAIN ] Update Progress: 29/2371 symbols completed. AD took 40.4s. Estimated remaining: 4h 47m 26s. Rate: 8.1 symbols/min [2025-09-17T17:03:35.622299] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-08. [2025-09-17T17:03:35.624787] [INFO ] [MAIN ] ADNT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:03:35.684808] [DEBUG] [LOCAL ] ADNT: Loaded 47668 existing records from primary storage. [2025-09-17T17:03:35.684978] [INFO ] [MAIN ] ADNT: Loaded 47668 existing records. [2025-09-17T17:03:35.872574] [WARN ] [MAIN ] ADNT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:03:35.872875] [INFO ] [MAIN ] ADNT: Wiping existing primary data before full refresh. [2025-09-17T17:03:35.872929] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-17T17:03:35.873870] [DEBUG] [LOCAL ] ADNT: Deleted primary data file. [2025-09-17T17:03:35.873932] [INFO ] [MAIN ] ADNT: Starting full primary refresh. [2025-09-17T17:03:36.232613] [INFO ] [REMOTE ] ADNT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:03:36.415883] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-02. [2025-09-17T17:03:36.469816] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:03:37.215804] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-07. [2025-09-17T17:03:37.259953] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T17:03:37.850212] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T17:03:38.015768] [INFO ] [REMOTE ] ADC: Fetching primary data for 2025-09. [2025-09-17T17:03:38.383292] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T17:03:38.815774] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-03. [2025-09-17T17:03:39.562426] [INFO ] [REMOTE ] ADC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T17:03:39.568419] [INFO ] [REMOTE ] ADC: Full fetch complete (65883 records). [2025-09-17T17:03:39.568566] [DEBUG] [VALIDATOR ] ADC: Validating primary data. [2025-09-17T17:03:39.625596] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-08. [2025-09-17T17:03:39.966187] [DEBUG] [VALIDATOR ] ADC: All expected trading days are present. [2025-09-17T17:03:39.966274] [DEBUG] [VALIDATOR ] ADC: Primary data validation passed. [2025-09-17T17:03:39.966912] [INFO ] [MAIN ] ADC: Fetched primary data is valid. [2025-09-17T17:03:39.966960] [DEBUG] [LOCAL ] ADC: Saving primary data. [2025-09-17T17:03:39.968328] [DEBUG] [LOCAL ] ADC: Trimmed 65883 records to 46645 (keeping 200 days of data) [2025-09-17T17:03:40.286204] [DEBUG] [LOCAL ] ADC: Primary data saved (46645 records). [2025-09-17T17:03:40.286474] [INFO ] [MAIN ] ADC: Full history saved. [2025-09-17T17:03:40.286745] [INFO ] [MAIN ] Update Progress: 30/2371 symbols completed. ADC took 36.5s. Estimated remaining: 4h 44m 2s. Rate: 8.2 symbols/min [2025-09-17T17:03:40.420962] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-11. [2025-09-17T17:03:40.473501] [INFO ] [MAIN ] ADT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:03:40.523843] [DEBUG] [LOCAL ] ADT: Loaded 53455 existing records from primary storage. [2025-09-17T17:03:40.524004] [INFO ] [MAIN ] ADT: Loaded 53455 existing records. [2025-09-17T17:03:40.721864] [WARN ] [MAIN ] ADT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:03:40.722102] [INFO ] [MAIN ] ADT: Wiping existing primary data before full refresh. [2025-09-17T17:03:40.722227] [INFO ] [LOCAL ] ADT: Starting deletion of primary data. [2025-09-17T17:03:40.723151] [DEBUG] [LOCAL ] ADT: Deleted primary data file. [2025-09-17T17:03:40.723201] [INFO ] [MAIN ] ADT: Starting full primary refresh. [2025-09-17T17:03:41.095603] [INFO ] [REMOTE ] ADT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:03:41.119976] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T17:03:41.215791] [INFO ] [REMOTE ] ADCT: Fetching primary data for 2025-09. [2025-09-17T17:03:41.730042] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T17:03:42.015766] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2024-12. [2025-09-17T17:03:42.662581] [INFO ] [REMOTE ] ADCT: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T17:03:42.668210] [INFO ] [REMOTE ] ADCT: Full fetch complete (51066 records). [2025-09-17T17:03:42.668343] [DEBUG] [VALIDATOR ] ADCT: Validating primary data. [2025-09-17T17:03:42.669025] [FATAL] [VALIDATOR ] ADCT: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:03:42.669106] [FATAL] [MAIN ] ADCT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:03:42.669155] [WARN ] [MAIN ] ADCT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:03:42.669202] [INFO ] [LOCAL ] ADCT: Starting deletion of primary data. [2025-09-17T17:03:42.669261] [DEBUG] [LOCAL ] ADCT: No primary data file found to delete. [2025-09-17T17:03:42.669304] [INFO ] [LOCAL ] ADCT: Starting deletion of derivative data. [2025-09-17T17:03:42.669614] [DEBUG] [LOCAL ] ADCT: Deleted derivative data file. [2025-09-17T17:03:42.669734] [INFO ] [MAIN ] Update Progress: 31/2371 symbols completed. ADCT took 35.7s. Estimated remaining: 4h 37m 45s. Rate: 8.4 symbols/min [2025-09-17T17:03:42.818411] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-11. [2025-09-17T17:03:42.851466] [INFO ] [MAIN ] ADX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:03:42.887183] [DEBUG] [LOCAL ] ADX: Loaded 28110 existing records from primary storage. [2025-09-17T17:03:42.887317] [INFO ] [MAIN ] ADX: Loaded 28110 existing records. [2025-09-17T17:03:43.071098] [WARN ] [MAIN ] ADX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:03:43.071365] [INFO ] [MAIN ] ADX: Wiping existing primary data before full refresh. [2025-09-17T17:03:43.071412] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-17T17:03:43.072130] [DEBUG] [LOCAL ] ADX: Deleted primary data file. [2025-09-17T17:03:43.072189] [INFO ] [MAIN ] ADX: Starting full primary refresh. [2025-09-17T17:03:43.432055] [INFO ] [REMOTE ] ADX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:03:43.460110] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T17:03:43.615784] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-11. [2025-09-17T17:03:44.376631] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T17:03:44.415766] [INFO ] [REMOTE ] ADT: Fetching primary data for 2024-12. [2025-09-17T17:03:44.700440] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-03 (5.88 seconds). [2025-09-17T17:03:44.767803] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T17:03:45.215867] [INFO ] [REMOTE ] ADX: Fetching primary data for 2024-12. [2025-09-17T17:03:46.015803] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-01. [2025-09-17T17:03:46.148513] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T17:03:46.353179] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T17:03:46.815814] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-04. [2025-09-17T17:03:47.598001] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T17:03:47.615747] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-02. [2025-09-17T17:03:48.415846] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-01. [2025-09-17T17:03:48.758533] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T17:03:49.040163] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T17:03:49.215801] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-01. [2025-09-17T17:03:49.809133] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T17:03:50.015755] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-02. [2025-09-17T17:03:50.761427] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T17:03:50.815763] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-03. [2025-09-17T17:03:51.243768] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T17:03:51.615779] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-05. [2025-09-17T17:03:52.303790] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T17:03:52.415757] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-04. [2025-09-17T17:03:53.215813] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-03. [2025-09-17T17:03:53.543575] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T17:03:53.898505] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T17:03:54.015785] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-02. [2025-09-17T17:03:54.149746] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T17:03:54.815797] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-05. [2025-09-17T17:03:55.456280] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T17:03:55.615767] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-03. [2025-09-17T17:03:56.383883] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T17:03:56.415719] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-06. [2025-09-17T17:03:56.963674] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T17:03:57.215841] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-04. [2025-09-17T17:03:57.575148] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T17:03:58.015803] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-07. [2025-09-17T17:03:58.206047] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T17:03:58.815787] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-05. [2025-09-17T17:03:59.288757] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T17:03:59.615787] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-04. [2025-09-17T17:04:00.209463] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T17:04:00.415804] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-06. [2025-09-17T17:04:01.215782] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-08. [2025-09-17T17:04:01.568673] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T17:04:02.015786] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-06. [2025-09-17T17:04:02.541483] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-17T17:04:02.815764] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-05. [2025-09-17T17:04:02.948472] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T17:04:03.615769] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-07. [2025-09-17T17:04:03.807449] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T17:04:04.415778] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-07. [2025-09-17T17:04:05.074946] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-17T17:04:05.182120] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T17:04:05.215733] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-08. [2025-09-17T17:04:05.764110] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T17:04:06.015778] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-06. [2025-09-17T17:04:06.815753] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-08. [2025-09-17T17:04:07.302437] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-17T17:04:07.620860] [INFO ] [REMOTE ] ADM: Fetching primary data for 2025-09. [2025-09-17T17:04:07.637611] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T17:04:07.982392] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T17:04:08.415774] [INFO ] [REMOTE ] ADX: Fetching primary data for 2025-09. [2025-09-17T17:04:09.215764] [INFO ] [REMOTE ] ADNT: Fetching primary data for 2025-09. [2025-09-17T17:04:09.445248] [INFO ] [REMOTE ] ADM: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T17:04:09.452072] [INFO ] [REMOTE ] ADM: Full fetch complete (77052 records). [2025-09-17T17:04:09.452217] [DEBUG] [VALIDATOR ] ADM: Validating primary data. [2025-09-17T17:04:09.743363] [INFO ] [REMOTE ] ADX: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T17:04:09.787556] [INFO ] [REMOTE ] ADX: Full fetch complete (41911 records). [2025-09-17T17:04:09.813226] [DEBUG] [VALIDATOR ] ADX: Validating primary data. [2025-09-17T17:04:09.871798] [DEBUG] [VALIDATOR ] ADM: All expected trading days are present. [2025-09-17T17:04:09.871581] [FATAL] [VALIDATOR ] ADX: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:04:09.871897] [DEBUG] [VALIDATOR ] ADM: Primary data validation passed. [2025-09-17T17:04:09.872757] [INFO ] [MAIN ] ADM: Fetched primary data is valid. [2025-09-17T17:04:09.872818] [DEBUG] [LOCAL ] ADM: Saving primary data. [2025-09-17T17:04:09.871974] [FATAL] [MAIN ] ADX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:04:09.872993] [WARN ] [MAIN ] ADX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:04:09.873047] [INFO ] [LOCAL ] ADX: Starting deletion of primary data. [2025-09-17T17:04:09.873108] [DEBUG] [LOCAL ] ADX: No primary data file found to delete. [2025-09-17T17:04:09.873157] [INFO ] [LOCAL ] ADX: Starting deletion of derivative data. [2025-09-17T17:04:09.873684] [DEBUG] [LOCAL ] ADX: Deleted derivative data file. [2025-09-17T17:04:09.874435] [INFO ] [MAIN ] Update Progress: 32/2371 symbols completed. ADX took 27.2s. Estimated remaining: 5h 2m 6s. Rate: 7.7 symbols/min [2025-09-17T17:04:09.978091] [DEBUG] [LOCAL ] ADM: Trimmed 77052 records to 53399 (keeping 200 days of data) [2025-09-17T17:04:10.056913] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-07. [2025-09-17T17:04:10.152464] [INFO ] [MAIN ] AEE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:04:10.327293] [DEBUG] [LOCAL ] AEE: Loaded 50355 existing records from primary storage. [2025-09-17T17:04:10.329089] [INFO ] [MAIN ] AEE: Loaded 50355 existing records. [2025-09-17T17:04:10.521218] [WARN ] [MAIN ] AEE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:04:10.523698] [INFO ] [MAIN ] AEE: Wiping existing primary data before full refresh. [2025-09-17T17:04:10.525149] [INFO ] [LOCAL ] AEE: Starting deletion of primary data. [2025-09-17T17:04:10.527685] [DEBUG] [LOCAL ] AEE: Deleted primary data file. [2025-09-17T17:04:10.528198] [INFO ] [MAIN ] AEE: Starting full primary refresh. [2025-09-17T17:04:10.967196] [INFO ] [REMOTE ] AEE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:04:10.968299] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-11. [2025-09-17T17:04:10.989699] [INFO ] [REMOTE ] ADNT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T17:04:10.996825] [INFO ] [REMOTE ] ADNT: Full fetch complete (67653 records). [2025-09-17T17:04:10.997629] [DEBUG] [VALIDATOR ] ADNT: Validating primary data. [2025-09-17T17:04:10.999191] [FATAL] [VALIDATOR ] ADNT: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:04:10.999906] [FATAL] [MAIN ] ADNT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:04:11.001014] [WARN ] [MAIN ] ADNT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:04:11.001396] [INFO ] [LOCAL ] ADNT: Starting deletion of primary data. [2025-09-17T17:04:11.002435] [DEBUG] [LOCAL ] ADNT: No primary data file found to delete. [2025-09-17T17:04:11.002773] [INFO ] [LOCAL ] ADNT: Starting deletion of derivative data. [2025-09-17T17:04:11.004850] [DEBUG] [LOCAL ] ADNT: Deleted derivative data file. [2025-09-17T17:04:11.005750] [INFO ] [MAIN ] Update Progress: 33/2371 symbols completed. ADNT took 35.6s. Estimated remaining: 4h 54m 9s. Rate: 7.9 symbols/min [2025-09-17T17:04:11.113520] [DEBUG] [LOCAL ] ADM: Primary data saved (53399 records). [2025-09-17T17:04:11.113673] [INFO ] [MAIN ] ADM: Full history saved. [2025-09-17T17:04:11.115852] [INFO ] [MAIN ] Update Progress: 34/2371 symbols completed. ADM took 43.9s. Estimated remaining: 4h 45m 30s. Rate: 8.2 symbols/min [2025-09-17T17:04:11.284344] [INFO ] [MAIN ] AEFC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:04:11.364493] [INFO ] [MAIN ] AEG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:04:11.368146] [DEBUG] [LOCAL ] AEFC: Loaded 8704 existing records from primary storage. [2025-09-17T17:04:11.368468] [INFO ] [MAIN ] AEFC: Loaded 8704 existing records. [2025-09-17T17:04:11.555443] [WARN ] [MAIN ] AEFC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:04:11.566482] [INFO ] [MAIN ] AEFC: Wiping existing primary data before full refresh. [2025-09-17T17:04:11.566601] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-17T17:04:11.567216] [DEBUG] [LOCAL ] AEFC: Deleted primary data file. [2025-09-17T17:04:11.567267] [INFO ] [MAIN ] AEFC: Starting full primary refresh. [2025-09-17T17:04:11.705539] [DEBUG] [LOCAL ] AEG: Loaded 49588 existing records from primary storage. [2025-09-17T17:04:11.716308] [INFO ] [MAIN ] AEG: Loaded 49588 existing records. [2025-09-17T17:04:12.116392] [WARN ] [MAIN ] AEG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:04:12.157510] [INFO ] [MAIN ] AEG: Wiping existing primary data before full refresh. [2025-09-17T17:04:12.188317] [INFO ] [LOCAL ] AEG: Starting deletion of primary data. [2025-09-17T17:04:12.188232] [INFO ] [REMOTE ] AEFC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:04:12.188845] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-11. [2025-09-17T17:04:12.189740] [DEBUG] [LOCAL ] AEG: Deleted primary data file. [2025-09-17T17:04:12.189844] [INFO ] [MAIN ] AEG: Starting full primary refresh. [2025-09-17T17:04:12.644755] [INFO ] [REMOTE ] AEG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:04:12.645431] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-11. [2025-09-17T17:04:12.650222] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-17T17:04:12.799813] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T17:04:13.065230] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T17:04:13.215804] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2024-12. [2025-09-17T17:04:14.015810] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-08. [2025-09-17T17:04:14.055937] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T17:04:14.337896] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T17:04:14.815788] [INFO ] [REMOTE ] AEG: Fetching primary data for 2024-12. [2025-09-17T17:04:15.615778] [INFO ] [REMOTE ] AEE: Fetching primary data for 2024-12. [2025-09-17T17:04:16.254418] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-17T17:04:16.415783] [INFO ] [REMOTE ] ADT: Fetching primary data for 2025-09. [2025-09-17T17:04:16.562832] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T17:04:17.215808] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-01. [2025-09-17T17:04:17.335182] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T17:04:18.015793] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-01. [2025-09-17T17:04:18.212198] [INFO ] [REMOTE ] ADT: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T17:04:18.219316] [INFO ] [REMOTE ] ADT: Full fetch complete (77045 records). [2025-09-17T17:04:18.219491] [DEBUG] [VALIDATOR ] ADT: Validating primary data. [2025-09-17T17:04:18.633995] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T17:04:18.634175] [DEBUG] [VALIDATOR ] ADT: All expected trading days are present. [2025-09-17T17:04:18.636803] [DEBUG] [VALIDATOR ] ADT: Primary data validation passed. [2025-09-17T17:04:18.637757] [INFO ] [MAIN ] ADT: Fetched primary data is valid. [2025-09-17T17:04:18.637919] [DEBUG] [LOCAL ] ADT: Saving primary data. [2025-09-17T17:04:18.639995] [DEBUG] [LOCAL ] ADT: Trimmed 77045 records to 53454 (keeping 200 days of data) [2025-09-17T17:04:18.753619] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T17:04:18.847763] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-02. [2025-09-17T17:04:18.996584] [DEBUG] [LOCAL ] ADT: Primary data saved (53454 records). [2025-09-17T17:04:18.996759] [INFO ] [MAIN ] ADT: Full history saved. [2025-09-17T17:04:18.996844] [INFO ] [MAIN ] Update Progress: 35/2371 symbols completed. ADT took 38.7s. Estimated remaining: 4h 45m 60s. Rate: 8.2 symbols/min [2025-09-17T17:04:19.166337] [INFO ] [MAIN ] AEM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:04:19.220342] [DEBUG] [LOCAL ] AEM: Loaded 53464 existing records from primary storage. [2025-09-17T17:04:19.220491] [INFO ] [MAIN ] AEM: Loaded 53464 existing records. [2025-09-17T17:04:19.409383] [WARN ] [MAIN ] AEM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:04:19.409618] [INFO ] [MAIN ] AEM: Wiping existing primary data before full refresh. [2025-09-17T17:04:19.409692] [INFO ] [LOCAL ] AEM: Starting deletion of primary data. [2025-09-17T17:04:19.410702] [DEBUG] [LOCAL ] AEM: Deleted primary data file. [2025-09-17T17:04:19.410764] [INFO ] [MAIN ] AEM: Starting full primary refresh. [2025-09-17T17:04:19.620884] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-01. [2025-09-17T17:04:19.736787] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T17:04:19.803485] [INFO ] [REMOTE ] AEM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:04:20.415798] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-03. [2025-09-17T17:04:21.056183] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T17:04:21.215737] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-11. [2025-09-17T17:04:21.787911] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-17T17:04:22.015770] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-04. [2025-09-17T17:04:22.815786] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-02. [2025-09-17T17:04:22.837998] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T17:04:23.077064] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T17:04:23.615863] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-02. [2025-09-17T17:04:24.415849] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-05. [2025-09-17T17:04:24.627450] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T17:04:25.020308] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T17:04:25.123168] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T17:04:25.215733] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-06. [2025-09-17T17:04:25.659540] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T17:04:26.015840] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-07. [2025-09-17T17:04:26.509336] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T17:04:26.815795] [INFO ] [REMOTE ] AEM: Fetching primary data for 2024-12. [2025-09-17T17:04:27.615821] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-03. [2025-09-17T17:04:28.415811] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-08. [2025-09-17T17:04:28.842814] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T17:04:28.909195] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T17:04:28.951155] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T17:04:29.215801] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-04. [2025-09-17T17:04:30.015833] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-03. [2025-09-17T17:04:30.608794] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T17:04:30.815796] [INFO ] [REMOTE ] AEFC: Fetching primary data for 2025-09. [2025-09-17T17:04:31.342410] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T17:04:31.546764] [INFO ] [REMOTE ] AEFC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T17:04:31.549038] [INFO ] [REMOTE ] AEFC: Full fetch complete (12445 records). [2025-09-17T17:04:31.549136] [DEBUG] [VALIDATOR ] AEFC: Validating primary data. [2025-09-17T17:04:31.550433] [FATAL] [VALIDATOR ] AEFC: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:04:31.550695] [FATAL] [MAIN ] AEFC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:04:31.550749] [WARN ] [MAIN ] AEFC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:04:31.550793] [INFO ] [LOCAL ] AEFC: Starting deletion of primary data. [2025-09-17T17:04:31.550885] [DEBUG] [LOCAL ] AEFC: No primary data file found to delete. [2025-09-17T17:04:31.550925] [INFO ] [LOCAL ] AEFC: Starting deletion of derivative data. [2025-09-17T17:04:31.551155] [DEBUG] [LOCAL ] AEFC: Deleted derivative data file. [2025-09-17T17:04:31.551274] [INFO ] [MAIN ] Update Progress: 36/2371 symbols completed. AEFC took 20.5s. Estimated remaining: 4h 51m 30s. Rate: 8.0 symbols/min [2025-09-17T17:04:31.620930] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-04. [2025-09-17T17:04:31.733347] [INFO ] [MAIN ] AEO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:04:31.789710] [DEBUG] [LOCAL ] AEO: Loaded 53556 existing records from primary storage. [2025-09-17T17:04:31.789920] [INFO ] [MAIN ] AEO: Loaded 53556 existing records. [2025-09-17T17:04:31.973164] [WARN ] [MAIN ] AEO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:04:31.973419] [INFO ] [MAIN ] AEO: Wiping existing primary data before full refresh. [2025-09-17T17:04:31.973465] [INFO ] [LOCAL ] AEO: Starting deletion of primary data. [2025-09-17T17:04:31.974389] [DEBUG] [LOCAL ] AEO: Deleted primary data file. [2025-09-17T17:04:31.974439] [INFO ] [MAIN ] AEO: Starting full primary refresh. [2025-09-17T17:04:32.331086] [INFO ] [REMOTE ] AEO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:04:32.415747] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-11. [2025-09-17T17:04:33.136598] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T17:04:33.215754] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-05. [2025-09-17T17:04:34.015850] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-01. [2025-09-17T17:04:34.460044] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-17T17:04:34.815892] [INFO ] [REMOTE ] AEO: Fetching primary data for 2024-12. [2025-09-17T17:04:35.018445] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T17:04:35.615824] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-06. [2025-09-17T17:04:36.023614] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T17:04:36.415800] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-05. [2025-09-17T17:04:36.696343] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T17:04:37.091604] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T17:04:37.215746] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-01. [2025-09-17T17:04:38.015833] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-02. [2025-09-17T17:04:38.301861] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T17:04:38.815795] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-07. [2025-09-17T17:04:38.904745] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T17:04:39.615751] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-02. [2025-09-17T17:04:40.038993] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T17:04:40.415757] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-03. [2025-09-17T17:04:40.488209] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T17:04:41.215790] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-08. [2025-09-17T17:04:41.378486] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T17:04:42.015789] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-06. [2025-09-17T17:04:42.381197] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T17:04:42.676733] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T17:04:42.815807] [INFO ] [REMOTE ] AEG: Fetching primary data for 2025-09. [2025-09-17T17:04:43.308235] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T17:04:43.615777] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-03. [2025-09-17T17:04:44.415788] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-07. [2025-09-17T17:04:44.546390] [INFO ] [REMOTE ] AEG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T17:04:44.553031] [INFO ] [REMOTE ] AEG: Full fetch complete (69966 records). [2025-09-17T17:04:44.553167] [DEBUG] [VALIDATOR ] AEG: Validating primary data. [2025-09-17T17:04:44.953851] [DEBUG] [VALIDATOR ] AEG: All expected trading days are present. [2025-09-17T17:04:44.953949] [DEBUG] [VALIDATOR ] AEG: Primary data validation passed. [2025-09-17T17:04:44.954597] [INFO ] [MAIN ] AEG: Fetched primary data is valid. [2025-09-17T17:04:44.954659] [DEBUG] [LOCAL ] AEG: Saving primary data. [2025-09-17T17:04:44.956226] [DEBUG] [LOCAL ] AEG: Trimmed 69966 records to 49607 (keeping 200 days of data) [2025-09-17T17:04:45.220161] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-04. [2025-09-17T17:04:45.254773] [DEBUG] [LOCAL ] AEG: Primary data saved (49607 records). [2025-09-17T17:04:45.254911] [INFO ] [MAIN ] AEG: Full history saved. [2025-09-17T17:04:45.255800] [INFO ] [MAIN ] Update Progress: 37/2371 symbols completed. AEG took 34.1s. Estimated remaining: 4h 57m 55s. Rate: 7.8 symbols/min [2025-09-17T17:04:45.417045] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T17:04:46.015770] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-04. [2025-09-17T17:04:46.249102] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T17:04:46.815799] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-08. [2025-09-17T17:04:47.465393] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-17T17:04:47.615879] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-05. [2025-09-17T17:04:48.212829] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T17:04:48.415821] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-05. [2025-09-17T17:04:48.663689] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T17:04:49.215805] [INFO ] [REMOTE ] AEE: Fetching primary data for 2025-09. [2025-09-17T17:04:49.773681] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T17:04:49.845088] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T17:04:50.015816] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-06. [2025-09-17T17:04:50.590710] [INFO ] [REMOTE ] AEE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T17:04:50.597259] [INFO ] [REMOTE ] AEE: Full fetch complete (72348 records). [2025-09-17T17:04:50.597386] [DEBUG] [VALIDATOR ] AEE: Validating primary data. [2025-09-17T17:04:50.826209] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-06. [2025-09-17T17:04:50.993101] [DEBUG] [VALIDATOR ] AEE: All expected trading days are present. [2025-09-17T17:04:50.993183] [DEBUG] [VALIDATOR ] AEE: Primary data validation passed. [2025-09-17T17:04:50.993929] [INFO ] [MAIN ] AEE: Fetched primary data is valid. [2025-09-17T17:04:50.993981] [DEBUG] [LOCAL ] AEE: Saving primary data. [2025-09-17T17:04:50.995512] [DEBUG] [LOCAL ] AEE: Trimmed 72348 records to 50329 (keeping 200 days of data) [2025-09-17T17:04:51.313097] [DEBUG] [LOCAL ] AEE: Primary data saved (50329 records). [2025-09-17T17:04:51.313267] [INFO ] [MAIN ] AEE: Full history saved. [2025-09-17T17:04:51.313349] [INFO ] [MAIN ] Update Progress: 38/2371 symbols completed. AEE took 41.4s. Estimated remaining: 4h 56m 9s. Rate: 7.9 symbols/min [2025-09-17T17:04:51.444319] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T17:04:51.615851] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-07. [2025-09-17T17:04:52.803558] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T17:04:52.814706] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-07. [2025-09-17T17:04:53.382850] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T17:04:53.395020] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-08. [2025-09-17T17:04:54.701106] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T17:04:54.713208] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-08. [2025-09-17T17:04:55.626062] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-17T17:04:55.637886] [INFO ] [REMOTE ] AEO: Fetching primary data for 2025-09. [2025-09-17T17:04:56.357349] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T17:04:56.369099] [INFO ] [REMOTE ] AEM: Fetching primary data for 2025-09. [2025-09-17T17:04:58.060760] [INFO ] [REMOTE ] AEO: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-17T17:04:58.068839] [INFO ] [REMOTE ] AEO: Full fetch complete (77288 records). [2025-09-17T17:04:58.068992] [DEBUG] [VALIDATOR ] AEO: Validating primary data. [2025-09-17T17:04:58.276535] [INFO ] [REMOTE ] AEM: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T17:04:58.376535] [INFO ] [REMOTE ] AEM: Full fetch complete (76944 records). [2025-09-17T17:04:58.406510] [DEBUG] [VALIDATOR ] AEM: Validating primary data. [2025-09-17T17:04:58.652110] [DEBUG] [VALIDATOR ] AEO: All expected trading days are present. [2025-09-17T17:04:58.662834] [DEBUG] [VALIDATOR ] AEO: Primary data validation passed. [2025-09-17T17:04:58.672066] [INFO ] [MAIN ] AEO: Fetched primary data is valid. [2025-09-17T17:04:58.672143] [DEBUG] [LOCAL ] AEO: Saving primary data. [2025-09-17T17:04:58.780845] [DEBUG] [LOCAL ] AEO: Trimmed 77288 records to 53557 (keeping 200 days of data) [2025-09-17T17:04:59.031585] [DEBUG] [VALIDATOR ] AEM: All expected trading days are present. [2025-09-17T17:04:59.031949] [DEBUG] [VALIDATOR ] AEM: Primary data validation passed. [2025-09-17T17:04:59.035277] [INFO ] [MAIN ] AEM: Fetched primary data is valid. [2025-09-17T17:04:59.035823] [DEBUG] [LOCAL ] AEM: Saving primary data. [2025-09-17T17:04:59.039886] [DEBUG] [LOCAL ] AEM: Trimmed 76944 records to 53464 (keeping 200 days of data) [2025-09-17T17:04:59.559100] [DEBUG] [LOCAL ] AEO: Primary data saved (53557 records). [2025-09-17T17:04:59.560120] [INFO ] [MAIN ] AEO: Full history saved. [2025-09-17T17:04:59.560491] [INFO ] [MAIN ] Update Progress: 39/2371 symbols completed. AEO took 28.0s. Estimated remaining: 4h 56m 39s. Rate: 7.9 symbols/min [2025-09-17T17:04:59.580864] [DEBUG] [LOCAL ] AEM: Primary data saved (53464 records). [2025-09-17T17:04:59.580934] [INFO ] [MAIN ] AEM: Full history saved. [2025-09-17T17:04:59.581014] [INFO ] [MAIN ] Update Progress: 40/2371 symbols completed. AEM took 40.6s. Estimated remaining: 4h 49m 8s. Rate: 8.1 symbols/min [2025-09-17T17:05:00.174167] [INFO ] [MAIN ] AFB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:05:00.207420] [INFO ] [MAIN ] AES: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:05:00.241899] [INFO ] [MAIN ] AESI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:05:00.300632] [INFO ] [MAIN ] AER: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:05:00.306999] [DEBUG] [LOCAL ] AFB: Loaded 11419 existing records from primary storage. [2025-09-17T17:05:00.307193] [INFO ] [MAIN ] AFB: Loaded 11419 existing records. [2025-09-17T17:05:00.512136] [WARN ] [MAIN ] AFB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:05:00.512551] [INFO ] [MAIN ] AFB: Wiping existing primary data before full refresh. [2025-09-17T17:05:00.512603] [INFO ] [LOCAL ] AFB: Starting deletion of primary data. [2025-09-17T17:05:00.522322] [DEBUG] [LOCAL ] AFB: Deleted primary data file. [2025-09-17T17:05:00.522587] [INFO ] [MAIN ] AFB: Starting full primary refresh. [2025-09-17T17:05:00.665604] [DEBUG] [LOCAL ] AESI: Loaded 49577 existing records from primary storage. [2025-09-17T17:05:00.670495] [DEBUG] [LOCAL ] AES: Loaded 53674 existing records from primary storage. [2025-09-17T17:05:00.671310] [INFO ] [MAIN ] AESI: Loaded 49577 existing records. [2025-09-17T17:05:00.671152] [DEBUG] [LOCAL ] AER: Loaded 48929 existing records from primary storage. [2025-09-17T17:05:00.671493] [INFO ] [MAIN ] AER: Loaded 48929 existing records. [2025-09-17T17:05:00.671578] [INFO ] [MAIN ] AES: Loaded 53674 existing records. [2025-09-17T17:05:01.346935] [WARN ] [MAIN ] AER: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:05:01.360726] [WARN ] [MAIN ] AES: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:05:01.411497] [INFO ] [MAIN ] AES: Wiping existing primary data before full refresh. [2025-09-17T17:05:01.411801] [INFO ] [LOCAL ] AES: Starting deletion of primary data. [2025-09-17T17:05:01.411581] [WARN ] [MAIN ] AESI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:05:01.411752] [INFO ] [MAIN ] AER: Wiping existing primary data before full refresh. [2025-09-17T17:05:01.412359] [INFO ] [LOCAL ] AER: Starting deletion of primary data. [2025-09-17T17:05:01.412412] [INFO ] [MAIN ] AESI: Wiping existing primary data before full refresh. [2025-09-17T17:05:01.438098] [DEBUG] [LOCAL ] AER: Deleted primary data file. [2025-09-17T17:05:01.455668] [DEBUG] [LOCAL ] AES: Deleted primary data file. [2025-09-17T17:05:01.455798] [INFO ] [MAIN ] AES: Starting full primary refresh. [2025-09-17T17:05:01.466751] [INFO ] [MAIN ] AER: Starting full primary refresh. [2025-09-17T17:05:01.438159] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-17T17:05:01.558425] [INFO ] [REMOTE ] AFB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:05:01.595622] [DEBUG] [LOCAL ] AESI: Deleted primary data file. [2025-09-17T17:05:01.595503] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-11. [2025-09-17T17:05:01.622769] [INFO ] [MAIN ] AESI: Starting full primary refresh. [2025-09-17T17:05:02.717246] [INFO ] [REMOTE ] AES: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:05:02.732082] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-11. [2025-09-17T17:05:02.759418] [INFO ] [REMOTE ] AER: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:05:02.777857] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-11. [2025-09-17T17:05:02.850883] [INFO ] [REMOTE ] AESI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:05:02.851566] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-11. [2025-09-17T17:05:02.863223] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T17:05:02.866125] [INFO ] [REMOTE ] AFB: Fetching primary data for 2024-12. [2025-09-17T17:05:03.756551] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T17:05:03.759528] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-01. [2025-09-17T17:05:04.321559] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T17:05:04.330587] [INFO ] [REMOTE ] AESI: Fetching primary data for 2024-12. [2025-09-17T17:05:04.357228] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T17:05:04.366431] [INFO ] [REMOTE ] AER: Fetching primary data for 2024-12. [2025-09-17T17:05:04.601752] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T17:05:04.604784] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-02. [2025-09-17T17:05:04.840043] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-17T17:05:04.850342] [INFO ] [REMOTE ] AES: Fetching primary data for 2024-12. [2025-09-17T17:05:05.168878] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T17:05:05.171607] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-03. [2025-09-17T17:05:05.873370] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T17:05:05.882512] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-01. [2025-09-17T17:05:06.021282] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T17:05:06.030491] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-01. [2025-09-17T17:05:06.070230] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T17:05:06.830858] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-04. [2025-09-17T17:05:06.833888] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T17:05:07.103444] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T17:05:07.349614] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T17:05:07.434180] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T17:05:07.615784] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-05. [2025-09-17T17:05:08.269346] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T17:05:08.415796] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-02. [2025-09-17T17:05:09.215798] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-06. [2025-09-17T17:05:09.847965] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T17:05:10.023108] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-01. [2025-09-17T17:05:10.041688] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T17:05:10.815794] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-03. [2025-09-17T17:05:11.615752] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-02. [2025-09-17T17:05:11.938889] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T17:05:12.415782] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-02. [2025-09-17T17:05:12.551125] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T17:05:13.215833] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-07. [2025-09-17T17:05:13.271012] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T17:05:14.015796] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-04. [2025-09-17T17:05:14.189193] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T17:05:14.602180] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-17T17:05:14.815777] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-03. [2025-09-17T17:05:15.615810] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-03. [2025-09-17T17:05:16.102091] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T17:05:16.415789] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-05. [2025-09-17T17:05:17.215814] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-08. [2025-09-17T17:05:17.256931] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-17T17:05:17.456360] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T17:05:17.848766] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T17:05:17.859628] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T17:05:18.015800] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-04. [2025-09-17T17:05:18.815818] [INFO ] [REMOTE ] AFB: Fetching primary data for 2025-09. [2025-09-17T17:05:19.619630] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-06. [2025-09-17T17:05:19.621249] [INFO ] [REMOTE ] AFB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T17:05:19.623312] [INFO ] [REMOTE ] AFB: Full fetch complete (16475 records). [2025-09-17T17:05:19.623393] [DEBUG] [VALIDATOR ] AFB: Validating primary data. [2025-09-17T17:05:20.009792] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T17:05:20.046016] [DEBUG] [VALIDATOR ] AFB: All expected trading days are present. [2025-09-17T17:05:20.046237] [DEBUG] [VALIDATOR ] AFB: Primary data validation passed. [2025-09-17T17:05:20.046635] [INFO ] [MAIN ] AFB: Fetched primary data is valid. [2025-09-17T17:05:20.046722] [DEBUG] [LOCAL ] AFB: Saving primary data. [2025-09-17T17:05:20.048273] [DEBUG] [LOCAL ] AFB: Trimmed 16475 records to 11493 (keeping 200 days of data) [2025-09-17T17:05:20.122559] [DEBUG] [LOCAL ] AFB: Primary data saved (11493 records). [2025-09-17T17:05:20.122722] [INFO ] [MAIN ] AFB: Full history saved. [2025-09-17T17:05:20.122812] [INFO ] [MAIN ] Update Progress: 41/2371 symbols completed. AFB took 20.5s. Estimated remaining: 5h 1m 25s. Rate: 7.7 symbols/min [2025-09-17T17:05:20.302839] [INFO ] [MAIN ] AFG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:05:20.339511] [DEBUG] [LOCAL ] AFG: Loaded 32732 existing records from primary storage. [2025-09-17T17:05:20.339695] [INFO ] [MAIN ] AFG: Loaded 32732 existing records. [2025-09-17T17:05:20.420974] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-04. [2025-09-17T17:05:20.530058] [WARN ] [MAIN ] AFG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:05:20.530351] [INFO ] [MAIN ] AFG: Wiping existing primary data before full refresh. [2025-09-17T17:05:20.530399] [INFO ] [LOCAL ] AFG: Starting deletion of primary data. [2025-09-17T17:05:20.531083] [DEBUG] [LOCAL ] AFG: Deleted primary data file. [2025-09-17T17:05:20.531135] [INFO ] [MAIN ] AFG: Starting full primary refresh. [2025-09-17T17:05:20.933253] [INFO ] [REMOTE ] AFG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:05:21.215841] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-05. [2025-09-17T17:05:21.299784] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T17:05:22.015802] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-11. [2025-09-17T17:05:22.281855] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T17:05:22.616007] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T17:05:22.815791] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-06. [2025-09-17T17:05:23.075884] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T17:05:23.615777] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-05. [2025-09-17T17:05:24.415785] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-07. [2025-09-17T17:05:24.544769] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T17:05:25.215754] [INFO ] [REMOTE ] AFG: Fetching primary data for 2024-12. [2025-09-17T17:05:25.314021] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T17:05:26.015817] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-07. [2025-09-17T17:05:26.325175] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T17:05:26.380822] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T17:05:26.815788] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-08. [2025-09-17T17:05:27.535541] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T17:05:27.615829] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-01. [2025-09-17T17:05:28.415855] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-06. [2025-09-17T17:05:28.485103] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T17:05:28.550684] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T17:05:29.215840] [INFO ] [REMOTE ] AER: Fetching primary data for 2025-09. [2025-09-17T17:05:30.003182] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T17:05:30.015738] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-07. [2025-09-17T17:05:30.814631] [INFO ] [REMOTE ] AER: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T17:05:30.820385] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-08. [2025-09-17T17:05:30.821794] [INFO ] [REMOTE ] AER: Full fetch complete (69304 records). [2025-09-17T17:05:30.821878] [DEBUG] [VALIDATOR ] AER: Validating primary data. [2025-09-17T17:05:31.213845] [DEBUG] [VALIDATOR ] AER: All expected trading days are present. [2025-09-17T17:05:31.213943] [DEBUG] [VALIDATOR ] AER: Primary data validation passed. [2025-09-17T17:05:31.214718] [INFO ] [MAIN ] AER: Fetched primary data is valid. [2025-09-17T17:05:31.214770] [DEBUG] [LOCAL ] AER: Saving primary data. [2025-09-17T17:05:31.216439] [DEBUG] [LOCAL ] AER: Trimmed 69304 records to 48860 (keeping 200 days of data) [2025-09-17T17:05:31.528585] [DEBUG] [LOCAL ] AER: Primary data saved (48860 records). [2025-09-17T17:05:31.528756] [INFO ] [MAIN ] AER: Full history saved. [2025-09-17T17:05:31.529967] [INFO ] [MAIN ] Update Progress: 42/2371 symbols completed. AER took 31.9s. Estimated remaining: 5h 4m 39s. Rate: 7.6 symbols/min [2025-09-17T17:05:31.620829] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-02. [2025-09-17T17:05:31.700298] [INFO ] [MAIN ] AFGB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:05:31.705329] [DEBUG] [LOCAL ] AFGB: Loaded 2539 existing records from primary storage. [2025-09-17T17:05:31.705429] [INFO ] [MAIN ] AFGB: Loaded 2539 existing records. [2025-09-17T17:05:31.887438] [WARN ] [MAIN ] AFGB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:05:31.887713] [INFO ] [MAIN ] AFGB: Wiping existing primary data before full refresh. [2025-09-17T17:05:31.887763] [INFO ] [LOCAL ] AFGB: Starting deletion of primary data. [2025-09-17T17:05:31.887990] [DEBUG] [LOCAL ] AFGB: Deleted primary data file. [2025-09-17T17:05:31.888036] [INFO ] [MAIN ] AFGB: Starting full primary refresh. [2025-09-17T17:05:32.248662] [INFO ] [REMOTE ] AFGB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:05:32.416492] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-11. [2025-09-17T17:05:32.419632] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-17T17:05:32.457563] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T17:05:32.781561] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T17:05:32.811002] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T17:05:33.215809] [INFO ] [REMOTE ] AESI: Fetching primary data for 2025-09. [2025-09-17T17:05:34.015798] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2024-12. [2025-09-17T17:05:34.542505] [INFO ] [REMOTE ] AESI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T17:05:34.549974] [INFO ] [REMOTE ] AESI: Full fetch complete (69656 records). [2025-09-17T17:05:34.550173] [DEBUG] [VALIDATOR ] AESI: Validating primary data. [2025-09-17T17:05:34.552836] [FATAL] [VALIDATOR ] AESI: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:05:34.552986] [FATAL] [MAIN ] AESI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:05:34.553043] [WARN ] [MAIN ] AESI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:05:34.553113] [INFO ] [LOCAL ] AESI: Starting deletion of primary data. [2025-09-17T17:05:34.553199] [DEBUG] [LOCAL ] AESI: No primary data file found to delete. [2025-09-17T17:05:34.553239] [INFO ] [LOCAL ] AESI: Starting deletion of derivative data. [2025-09-17T17:05:34.553533] [DEBUG] [LOCAL ] AESI: Deleted derivative data file. [2025-09-17T17:05:34.553627] [INFO ] [MAIN ] Update Progress: 43/2371 symbols completed. AESI took 35.0s. Estimated remaining: 5h 0m 10s. Rate: 7.8 symbols/min [2025-09-17T17:05:34.666049] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T17:05:34.738638] [INFO ] [MAIN ] AFGC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:05:34.743191] [DEBUG] [LOCAL ] AFGC: Loaded 2528 existing records from primary storage. [2025-09-17T17:05:34.743304] [INFO ] [MAIN ] AFGC: Loaded 2528 existing records. [2025-09-17T17:05:34.820847] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-08. [2025-09-17T17:05:34.922186] [WARN ] [MAIN ] AFGC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:05:34.922417] [INFO ] [MAIN ] AFGC: Wiping existing primary data before full refresh. [2025-09-17T17:05:34.922463] [INFO ] [LOCAL ] AFGC: Starting deletion of primary data. [2025-09-17T17:05:34.922681] [DEBUG] [LOCAL ] AFGC: Deleted primary data file. [2025-09-17T17:05:34.922727] [INFO ] [MAIN ] AFGC: Starting full primary refresh. [2025-09-17T17:05:35.288716] [INFO ] [REMOTE ] AFGC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:05:35.615784] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-03. [2025-09-17T17:05:36.415824] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-11. [2025-09-17T17:05:36.861271] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T17:05:36.864123] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T17:05:36.998092] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T17:05:37.215797] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-01. [2025-09-17T17:05:37.742032] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T17:05:38.015808] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-04. [2025-09-17T17:05:38.815799] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2024-12. [2025-09-17T17:05:39.167568] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T17:05:39.232824] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-17T17:05:39.615821] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-05. [2025-09-17T17:05:40.415805] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-01. [2025-09-17T17:05:40.834887] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T17:05:40.961947] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T17:05:41.215782] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-02. [2025-09-17T17:05:41.584296] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-17T17:05:42.015793] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-03. [2025-09-17T17:05:42.584844] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T17:05:42.815781] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-04. [2025-09-17T17:05:43.618352] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-06. [2025-09-17T17:05:43.619057] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T17:05:44.415813] [INFO ] [REMOTE ] AES: Fetching primary data for 2025-09. [2025-09-17T17:05:44.933444] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T17:05:45.215809] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-07. [2025-09-17T17:05:46.015820] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-05. [2025-09-17T17:05:46.528338] [INFO ] [REMOTE ] AES: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-17T17:05:46.538951] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T17:05:46.540436] [INFO ] [REMOTE ] AES: Full fetch complete (77586 records). [2025-09-17T17:05:46.540617] [DEBUG] [VALIDATOR ] AES: Validating primary data. [2025-09-17T17:05:46.816071] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-02. [2025-09-17T17:05:46.952923] [DEBUG] [VALIDATOR ] AES: All expected trading days are present. [2025-09-17T17:05:46.961864] [DEBUG] [VALIDATOR ] AES: Primary data validation passed. [2025-09-17T17:05:46.964224] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T17:05:46.963177] [INFO ] [MAIN ] AES: Fetched primary data is valid. [2025-09-17T17:05:46.971161] [DEBUG] [LOCAL ] AES: Saving primary data. [2025-09-17T17:05:46.973342] [DEBUG] [LOCAL ] AES: Trimmed 77586 records to 53674 (keeping 200 days of data) [2025-09-17T17:05:47.305094] [DEBUG] [LOCAL ] AES: Primary data saved (53674 records). [2025-09-17T17:05:47.305235] [INFO ] [MAIN ] AES: Full history saved. [2025-09-17T17:05:47.306923] [INFO ] [MAIN ] Update Progress: 44/2371 symbols completed. AES took 47.7s. Estimated remaining: 5h 4m 28s. Rate: 7.6 symbols/min [2025-09-17T17:05:47.481679] [INFO ] [MAIN ] AFGD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:05:47.486902] [DEBUG] [LOCAL ] AFGD: Loaded 1851 existing records from primary storage. [2025-09-17T17:05:47.486996] [INFO ] [MAIN ] AFGD: Loaded 1851 existing records. [2025-09-17T17:05:47.569352] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T17:05:47.620840] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-03. [2025-09-17T17:05:47.683144] [WARN ] [MAIN ] AFGD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:05:47.683360] [INFO ] [MAIN ] AFGD: Wiping existing primary data before full refresh. [2025-09-17T17:05:47.683404] [INFO ] [LOCAL ] AFGD: Starting deletion of primary data. [2025-09-17T17:05:47.683633] [DEBUG] [LOCAL ] AFGD: Deleted primary data file. [2025-09-17T17:05:47.683697] [INFO ] [MAIN ] AFGD: Starting full primary refresh. [2025-09-17T17:05:48.049049] [INFO ] [REMOTE ] AFGD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:05:48.316942] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T17:05:48.415809] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-06. [2025-09-17T17:05:48.783372] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T17:05:49.215821] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-07. [2025-09-17T17:05:49.621095] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-17T17:05:50.015780] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-08. [2025-09-17T17:05:50.452927] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T17:05:50.815809] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-04. [2025-09-17T17:05:51.304794] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-17T17:05:51.615787] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-08. [2025-09-17T17:05:52.415793] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-05. [2025-09-17T17:05:53.071601] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T17:05:53.075041] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T17:05:53.215776] [INFO ] [REMOTE ] AFG: Fetching primary data for 2025-09. [2025-09-17T17:05:54.015782] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-11. [2025-09-17T17:05:54.571128] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T17:05:54.620912] [INFO ] [REMOTE ] AFG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T17:05:54.625333] [INFO ] [REMOTE ] AFG: Full fetch complete (45509 records). [2025-09-17T17:05:54.625444] [DEBUG] [VALIDATOR ] AFG: Validating primary data. [2025-09-17T17:05:54.825742] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2024-12. [2025-09-17T17:05:55.003658] [DEBUG] [VALIDATOR ] AFG: All expected trading days are present. [2025-09-17T17:05:55.003769] [DEBUG] [VALIDATOR ] AFG: Primary data validation passed. [2025-09-17T17:05:55.004247] [INFO ] [MAIN ] AFG: Fetched primary data is valid. [2025-09-17T17:05:55.004287] [DEBUG] [LOCAL ] AFG: Saving primary data. [2025-09-17T17:05:55.005236] [DEBUG] [LOCAL ] AFG: Trimmed 45509 records to 32758 (keeping 200 days of data) [2025-09-17T17:05:55.213966] [DEBUG] [LOCAL ] AFG: Primary data saved (32758 records). [2025-09-17T17:05:55.214139] [INFO ] [MAIN ] AFG: Full history saved. [2025-09-17T17:05:55.214229] [INFO ] [MAIN ] Update Progress: 45/2371 symbols completed. AFG took 35.1s. Estimated remaining: 5h 4m 23s. Rate: 7.6 symbols/min [2025-09-17T17:05:55.387032] [INFO ] [MAIN ] AFGE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:05:55.391438] [DEBUG] [LOCAL ] AFGE: Loaded 2498 existing records from primary storage. [2025-09-17T17:05:55.391548] [INFO ] [MAIN ] AFGE: Loaded 2498 existing records. [2025-09-17T17:05:55.527118] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T17:05:55.584722] [WARN ] [MAIN ] AFGE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:05:55.584990] [INFO ] [MAIN ] AFGE: Wiping existing primary data before full refresh. [2025-09-17T17:05:55.585036] [INFO ] [LOCAL ] AFGE: Starting deletion of primary data. [2025-09-17T17:05:55.585273] [DEBUG] [LOCAL ] AFGE: Deleted primary data file. [2025-09-17T17:05:55.585318] [INFO ] [MAIN ] AFGE: Starting full primary refresh. [2025-09-17T17:05:55.620940] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-06. [2025-09-17T17:05:55.948747] [INFO ] [REMOTE ] AFGE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:05:56.028951] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-17T17:05:56.415764] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-11. [2025-09-17T17:05:56.999836] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T17:05:57.215785] [INFO ] [REMOTE ] AFGB: Fetching primary data for 2025-09. [2025-09-17T17:05:57.866473] [INFO ] [REMOTE ] AFGB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T17:05:57.867402] [INFO ] [REMOTE ] AFGB: Full fetch complete (3619 records). [2025-09-17T17:05:57.867473] [DEBUG] [VALIDATOR ] AFGB: Validating primary data. [2025-09-17T17:05:58.020881] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-07. [2025-09-17T17:05:58.246625] [DEBUG] [VALIDATOR ] AFGB: All expected trading days are present. [2025-09-17T17:05:58.246720] [DEBUG] [VALIDATOR ] AFGB: Primary data validation passed. [2025-09-17T17:05:58.246875] [INFO ] [MAIN ] AFGB: Fetched primary data is valid. [2025-09-17T17:05:58.246929] [DEBUG] [LOCAL ] AFGB: Saving primary data. [2025-09-17T17:05:58.247329] [DEBUG] [LOCAL ] AFGB: Trimmed 3619 records to 2510 (keeping 200 days of data) [2025-09-17T17:05:58.263994] [DEBUG] [LOCAL ] AFGB: Primary data saved (2510 records). [2025-09-17T17:05:58.264101] [INFO ] [MAIN ] AFGB: Full history saved. [2025-09-17T17:05:58.264200] [INFO ] [MAIN ] Update Progress: 46/2371 symbols completed. AFGB took 26.7s. Estimated remaining: 5h 0m 12s. Rate: 7.7 symbols/min [2025-09-17T17:05:58.435833] [INFO ] [MAIN ] AFL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:05:58.496139] [DEBUG] [LOCAL ] AFL: Loaded 53150 existing records from primary storage. [2025-09-17T17:05:58.496305] [INFO ] [MAIN ] AFL: Loaded 53150 existing records. [2025-09-17T17:05:58.664058] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T17:05:58.688087] [WARN ] [MAIN ] AFL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:05:58.688333] [INFO ] [MAIN ] AFL: Wiping existing primary data before full refresh. [2025-09-17T17:05:58.688383] [INFO ] [LOCAL ] AFL: Starting deletion of primary data. [2025-09-17T17:05:58.689593] [DEBUG] [LOCAL ] AFL: Deleted primary data file. [2025-09-17T17:05:58.689681] [INFO ] [MAIN ] AFL: Starting full primary refresh. [2025-09-17T17:05:58.820880] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2024-12. [2025-09-17T17:05:59.057713] [INFO ] [REMOTE ] AFL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:05:59.325680] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T17:05:59.615788] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-01. [2025-09-17T17:06:00.092221] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T17:06:00.415769] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-01. [2025-09-17T17:06:01.001730] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T17:06:01.215772] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-02. [2025-09-17T17:06:01.655963] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T17:06:02.015802] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-03. [2025-09-17T17:06:02.488724] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T17:06:02.815782] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-04. [2025-09-17T17:06:03.226784] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-17T17:06:03.615780] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-05. [2025-09-17T17:06:04.085093] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T17:06:04.415768] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-08. [2025-09-17T17:06:05.007620] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T17:06:05.215809] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-06. [2025-09-17T17:06:05.581011] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T17:06:06.015784] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-07. [2025-09-17T17:06:06.495453] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T17:06:06.815769] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-08. [2025-09-17T17:06:07.470383] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T17:06:07.615769] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-02. [2025-09-17T17:06:08.221412] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T17:06:08.415771] [INFO ] [REMOTE ] AFGE: Fetching primary data for 2025-09. [2025-09-17T17:06:08.988285] [INFO ] [REMOTE ] AFGE: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T17:06:08.989168] [INFO ] [REMOTE ] AFGE: Full fetch complete (3479 records). [2025-09-17T17:06:08.989258] [DEBUG] [VALIDATOR ] AFGE: Validating primary data. [2025-09-17T17:06:09.220854] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-03. [2025-09-17T17:06:09.361270] [DEBUG] [VALIDATOR ] AFGE: All expected trading days are present. [2025-09-17T17:06:09.361352] [DEBUG] [VALIDATOR ] AFGE: Primary data validation passed. [2025-09-17T17:06:09.361475] [INFO ] [MAIN ] AFGE: Fetched primary data is valid. [2025-09-17T17:06:09.361520] [DEBUG] [LOCAL ] AFGE: Saving primary data. [2025-09-17T17:06:09.361905] [DEBUG] [LOCAL ] AFGE: Trimmed 3479 records to 2507 (keeping 200 days of data) [2025-09-17T17:06:09.378176] [DEBUG] [LOCAL ] AFGE: Primary data saved (2507 records). [2025-09-17T17:06:09.378262] [INFO ] [MAIN ] AFGE: Full history saved. [2025-09-17T17:06:09.378369] [INFO ] [MAIN ] Update Progress: 47/2371 symbols completed. AFGE took 14.2s. Estimated remaining: 5h 2m 51s. Rate: 7.7 symbols/min [2025-09-17T17:06:09.552266] [INFO ] [MAIN ] AG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:06:09.610699] [DEBUG] [LOCAL ] AG: Loaded 53641 existing records from primary storage. [2025-09-17T17:06:09.610872] [INFO ] [MAIN ] AG: Loaded 53641 existing records. [2025-09-17T17:06:09.791051] [WARN ] [MAIN ] AG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:06:09.791288] [INFO ] [MAIN ] AG: Wiping existing primary data before full refresh. [2025-09-17T17:06:09.791332] [INFO ] [LOCAL ] AG: Starting deletion of primary data. [2025-09-17T17:06:09.792434] [DEBUG] [LOCAL ] AG: Deleted primary data file. [2025-09-17T17:06:09.792665] [INFO ] [MAIN ] AG: Starting full primary refresh. [2025-09-17T17:06:09.870395] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T17:06:10.020987] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-04. [2025-09-17T17:06:10.155134] [INFO ] [REMOTE ] AG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:06:10.522251] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T17:06:10.815792] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-05. [2025-09-17T17:06:11.355580] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T17:06:11.615811] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-11. [2025-09-17T17:06:12.415775] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-06. [2025-09-17T17:06:13.003602] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T17:06:13.075885] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T17:06:13.215764] [INFO ] [REMOTE ] AFL: Fetching primary data for 2024-12. [2025-09-17T17:06:14.015783] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-11. [2025-09-17T17:06:14.753162] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T17:06:14.815764] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-01. [2025-09-17T17:06:15.615746] [INFO ] [REMOTE ] AFGC: Fetching primary data for 2025-09. [2025-09-17T17:06:16.098199] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T17:06:16.339467] [INFO ] [REMOTE ] AFGC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T17:06:16.340462] [INFO ] [REMOTE ] AFGC: Full fetch complete (3672 records). [2025-09-17T17:06:16.340529] [DEBUG] [VALIDATOR ] AFGC: Validating primary data. [2025-09-17T17:06:16.420635] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-07. [2025-09-17T17:06:16.708575] [DEBUG] [VALIDATOR ] AFGC: All expected trading days are present. [2025-09-17T17:06:16.708674] [DEBUG] [VALIDATOR ] AFGC: Primary data validation passed. [2025-09-17T17:06:16.708923] [INFO ] [MAIN ] AFGC: Fetched primary data is valid. [2025-09-17T17:06:16.708993] [DEBUG] [LOCAL ] AFGC: Saving primary data. [2025-09-17T17:06:16.709619] [DEBUG] [LOCAL ] AFGC: Trimmed 3672 records to 2530 (keeping 200 days of data) [2025-09-17T17:06:16.753342] [DEBUG] [LOCAL ] AFGC: Primary data saved (2530 records). [2025-09-17T17:06:16.753738] [INFO ] [MAIN ] AFGC: Full history saved. [2025-09-17T17:06:16.754903] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T17:06:16.755032] [INFO ] [MAIN ] Update Progress: 48/2371 symbols completed. AFGC took 42.2s. Estimated remaining: 5h 2m 22s. Rate: 7.7 symbols/min [2025-09-17T17:06:16.946237] [INFO ] [MAIN ] AGCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:06:16.979103] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T17:06:16.997407] [DEBUG] [LOCAL ] AGCO: Loaded 42801 existing records from primary storage. [2025-09-17T17:06:16.997590] [INFO ] [MAIN ] AGCO: Loaded 42801 existing records. [2025-09-17T17:06:17.175882] [WARN ] [MAIN ] AGCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:06:17.176142] [INFO ] [MAIN ] AGCO: Wiping existing primary data before full refresh. [2025-09-17T17:06:17.176188] [INFO ] [LOCAL ] AGCO: Starting deletion of primary data. [2025-09-17T17:06:17.177505] [DEBUG] [LOCAL ] AGCO: Deleted primary data file. [2025-09-17T17:06:17.177562] [INFO ] [MAIN ] AGCO: Starting full primary refresh. [2025-09-17T17:06:17.221009] [INFO ] [REMOTE ] AG: Fetching primary data for 2024-12. [2025-09-17T17:06:17.537604] [INFO ] [REMOTE ] AGCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:06:18.015813] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-08. [2025-09-17T17:06:18.543112] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T17:06:18.815749] [INFO ] [REMOTE ] AFGD: Fetching primary data for 2025-09. [2025-09-17T17:06:18.960623] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T17:06:19.338576] [INFO ] [REMOTE ] AFGD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T17:06:19.340589] [INFO ] [REMOTE ] AFGD: Full fetch complete (3219 records). [2025-09-17T17:06:19.341006] [DEBUG] [VALIDATOR ] AFGD: Validating primary data. [2025-09-17T17:06:19.621373] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-02. [2025-09-17T17:06:19.928794] [DEBUG] [VALIDATOR ] AFGD: All expected trading days are present. [2025-09-17T17:06:19.928896] [DEBUG] [VALIDATOR ] AFGD: Primary data validation passed. [2025-09-17T17:06:19.929069] [INFO ] [MAIN ] AFGD: Fetched primary data is valid. [2025-09-17T17:06:19.929109] [DEBUG] [LOCAL ] AFGD: Saving primary data. [2025-09-17T17:06:19.929683] [DEBUG] [LOCAL ] AFGD: Trimmed 3219 records to 1882 (keeping 200 days of data) [2025-09-17T17:06:19.948683] [DEBUG] [LOCAL ] AFGD: Primary data saved (1882 records). [2025-09-17T17:06:19.948894] [INFO ] [MAIN ] AFGD: Full history saved. [2025-09-17T17:06:19.949037] [INFO ] [MAIN ] Update Progress: 49/2371 symbols completed. AFGD took 32.6s. Estimated remaining: 4h 58m 35s. Rate: 7.8 symbols/min [2025-09-17T17:06:20.202888] [INFO ] [MAIN ] AGD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:06:20.241202] [DEBUG] [LOCAL ] AGD: Loaded 17535 existing records from primary storage. [2025-09-17T17:06:20.241375] [INFO ] [MAIN ] AGD: Loaded 17535 existing records. [2025-09-17T17:06:20.422233] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-11. [2025-09-17T17:06:20.454693] [WARN ] [MAIN ] AGD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:06:20.454920] [INFO ] [MAIN ] AGD: Wiping existing primary data before full refresh. [2025-09-17T17:06:20.454967] [INFO ] [LOCAL ] AGD: Starting deletion of primary data. [2025-09-17T17:06:20.455470] [DEBUG] [LOCAL ] AGD: Deleted primary data file. [2025-09-17T17:06:20.455518] [INFO ] [MAIN ] AGD: Starting full primary refresh. [2025-09-17T17:06:20.819014] [INFO ] [REMOTE ] AGD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:06:21.215776] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-11. [2025-09-17T17:06:21.396407] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T17:06:21.811850] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T17:06:22.015822] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-01. [2025-09-17T17:06:22.304721] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T17:06:22.815814] [INFO ] [REMOTE ] AGD: Fetching primary data for 2024-12. [2025-09-17T17:06:23.615751] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2024-12. [2025-09-17T17:06:23.680830] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T17:06:23.805309] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T17:06:24.415777] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-03. [2025-09-17T17:06:25.150419] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T17:06:25.215765] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-01. [2025-09-17T17:06:26.015947] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-01. [2025-09-17T17:06:26.018388] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T17:06:26.525567] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T17:06:26.815762] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-04. [2025-09-17T17:06:27.120146] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T17:06:27.615828] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-02. [2025-09-17T17:06:28.255109] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T17:06:28.415808] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-02. [2025-09-17T17:06:29.113063] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T17:06:29.215774] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-03. [2025-09-17T17:06:30.015797] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-02. [2025-09-17T17:06:30.689231] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-17T17:06:30.815826] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-03. [2025-09-17T17:06:30.830329] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T17:06:30.873803] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T17:06:31.615777] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-03. [2025-09-17T17:06:32.415840] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-04. [2025-09-17T17:06:32.540361] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T17:06:33.144409] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-17T17:06:33.215780] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-04. [2025-09-17T17:06:34.015815] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-04. [2025-09-17T17:06:34.251783] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T17:06:34.289979] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T17:06:34.815795] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-05. [2025-09-17T17:06:35.571803] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T17:06:35.615758] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-05. [2025-09-17T17:06:35.839411] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T17:06:36.415774] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-05. [2025-09-17T17:06:37.215766] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-06. [2025-09-17T17:06:37.461329] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T17:06:38.015759] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-06. [2025-09-17T17:06:38.126269] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T17:06:38.486371] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T17:06:38.815789] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-07. [2025-09-17T17:06:39.615761] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-06. [2025-09-17T17:06:39.727846] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T17:06:39.757918] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T17:06:40.415778] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-08. [2025-09-17T17:06:41.215751] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-07. [2025-09-17T17:06:41.233071] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T17:06:41.407742] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T17:06:42.015783] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-05. [2025-09-17T17:06:42.815874] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-07. [2025-09-17T17:06:43.228404] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T17:06:43.606069] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T17:06:43.615840] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-08. [2025-09-17T17:06:44.415797] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-06. [2025-09-17T17:06:44.646727] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T17:06:45.215784] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-08. [2025-09-17T17:06:45.488882] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T17:06:46.015759] [INFO ] [REMOTE ] AFL: Fetching primary data for 2025-09. [2025-09-17T17:06:46.385635] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T17:06:46.815760] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-07. [2025-09-17T17:06:47.280865] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T17:06:47.615793] [INFO ] [REMOTE ] AG: Fetching primary data for 2025-09. [2025-09-17T17:06:47.791868] [INFO ] [REMOTE ] AFL: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T17:06:47.803116] [INFO ] [REMOTE ] AFL: Full fetch complete (76763 records). [2025-09-17T17:06:47.803285] [DEBUG] [VALIDATOR ] AFL: Validating primary data. [2025-09-17T17:06:48.194058] [DEBUG] [VALIDATOR ] AFL: All expected trading days are present. [2025-09-17T17:06:48.194221] [DEBUG] [VALIDATOR ] AFL: Primary data validation passed. [2025-09-17T17:06:48.195022] [INFO ] [MAIN ] AFL: Fetched primary data is valid. [2025-09-17T17:06:48.195138] [DEBUG] [LOCAL ] AFL: Saving primary data. [2025-09-17T17:06:48.196900] [DEBUG] [LOCAL ] AFL: Trimmed 76763 records to 53148 (keeping 200 days of data) [2025-09-17T17:06:48.420671] [INFO ] [REMOTE ] AGD: Fetching primary data for 2025-09. [2025-09-17T17:06:48.449213] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T17:06:48.580361] [DEBUG] [LOCAL ] AFL: Primary data saved (53148 records). [2025-09-17T17:06:48.580521] [INFO ] [MAIN ] AFL: Full history saved. [2025-09-17T17:06:48.582526] [INFO ] [MAIN ] Update Progress: 50/2371 symbols completed. AFL took 50.3s. Estimated remaining: 5h 14m 39s. Rate: 7.4 symbols/min [2025-09-17T17:06:48.751471] [INFO ] [MAIN ] AGI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:06:48.807168] [DEBUG] [LOCAL ] AGI: Loaded 53412 existing records from primary storage. [2025-09-17T17:06:48.807318] [INFO ] [MAIN ] AGI: Loaded 53412 existing records. [2025-09-17T17:06:48.982051] [WARN ] [MAIN ] AGI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:06:48.982339] [INFO ] [MAIN ] AGI: Wiping existing primary data before full refresh. [2025-09-17T17:06:48.982385] [INFO ] [LOCAL ] AGI: Starting deletion of primary data. [2025-09-17T17:06:48.983546] [DEBUG] [LOCAL ] AGI: Deleted primary data file. [2025-09-17T17:06:48.983594] [INFO ] [MAIN ] AGI: Starting full primary refresh. [2025-09-17T17:06:49.225300] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-08. [2025-09-17T17:06:49.344307] [INFO ] [REMOTE ] AGI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:06:49.649794] [INFO ] [REMOTE ] AGD: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T17:06:49.653311] [INFO ] [REMOTE ] AGD: Full fetch complete (25081 records). [2025-09-17T17:06:49.653394] [DEBUG] [VALIDATOR ] AGD: Validating primary data. [2025-09-17T17:06:50.002086] [INFO ] [REMOTE ] AG: Incremental fetch complete for 2025-09 (2.39 seconds). [2025-09-17T17:06:50.021741] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-11. [2025-09-17T17:06:50.043010] [INFO ] [REMOTE ] AG: Full fetch complete (77435 records). [2025-09-17T17:06:50.049864] [DEBUG] [VALIDATOR ] AG: Validating primary data. [2025-09-17T17:06:50.057166] [DEBUG] [VALIDATOR ] AGD: All expected trading days are present. [2025-09-17T17:06:50.057320] [DEBUG] [VALIDATOR ] AGD: Primary data validation passed. [2025-09-17T17:06:50.057874] [INFO ] [MAIN ] AGD: Fetched primary data is valid. [2025-09-17T17:06:50.090249] [DEBUG] [LOCAL ] AGD: Saving primary data. [2025-09-17T17:06:50.161168] [DEBUG] [LOCAL ] AGD: Trimmed 25081 records to 17614 (keeping 200 days of data) [2025-09-17T17:06:50.550321] [DEBUG] [VALIDATOR ] AG: All expected trading days are present. [2025-09-17T17:06:50.551022] [DEBUG] [VALIDATOR ] AG: Primary data validation passed. [2025-09-17T17:06:50.552089] [INFO ] [MAIN ] AG: Fetched primary data is valid. [2025-09-17T17:06:50.552414] [DEBUG] [LOCAL ] AG: Saving primary data. [2025-09-17T17:06:50.558977] [DEBUG] [LOCAL ] AG: Trimmed 77435 records to 53641 (keeping 200 days of data) [2025-09-17T17:06:50.658794] [DEBUG] [LOCAL ] AGD: Primary data saved (17614 records). [2025-09-17T17:06:50.662863] [INFO ] [MAIN ] AGD: Full history saved. [2025-09-17T17:06:50.664602] [INFO ] [MAIN ] Update Progress: 51/2371 symbols completed. AGD took 30.7s. Estimated remaining: 5h 9m 55s. Rate: 7.5 symbols/min [2025-09-17T17:06:50.848155] [INFO ] [MAIN ] AGL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:06:51.009490] [DEBUG] [LOCAL ] AGL: Loaded 52404 existing records from primary storage. [2025-09-17T17:06:51.010299] [INFO ] [MAIN ] AGL: Loaded 52404 existing records. [2025-09-17T17:06:51.138837] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T17:06:51.176329] [INFO ] [REMOTE ] AGCO: Fetching primary data for 2025-09. [2025-09-17T17:06:51.271844] [WARN ] [MAIN ] AGL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:06:51.296477] [INFO ] [MAIN ] AGL: Wiping existing primary data before full refresh. [2025-09-17T17:06:51.298363] [INFO ] [LOCAL ] AGL: Starting deletion of primary data. [2025-09-17T17:06:51.301755] [DEBUG] [LOCAL ] AGL: Deleted primary data file. [2025-09-17T17:06:51.302343] [INFO ] [MAIN ] AGL: Starting full primary refresh. [2025-09-17T17:06:51.685304] [INFO ] [REMOTE ] AGL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:06:51.687658] [DEBUG] [LOCAL ] AG: Primary data saved (53641 records). [2025-09-17T17:06:51.688186] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-11. [2025-09-17T17:06:51.688416] [INFO ] [MAIN ] AG: Full history saved. [2025-09-17T17:06:51.689433] [INFO ] [MAIN ] Update Progress: 52/2371 symbols completed. AG took 42.3s. Estimated remaining: 5h 4m 35s. Rate: 7.6 symbols/min [2025-09-17T17:06:51.859756] [INFO ] [MAIN ] AGM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:06:51.896502] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T17:06:51.911751] [DEBUG] [LOCAL ] AGM: Loaded 9795 existing records from primary storage. [2025-09-17T17:06:51.911850] [INFO ] [MAIN ] AGM: Loaded 9795 existing records. [2025-09-17T17:06:52.090445] [WARN ] [MAIN ] AGM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:06:52.090742] [INFO ] [MAIN ] AGM: Wiping existing primary data before full refresh. [2025-09-17T17:06:52.090790] [INFO ] [LOCAL ] AGM: Starting deletion of primary data. [2025-09-17T17:06:52.091160] [DEBUG] [LOCAL ] AGM: Deleted primary data file. [2025-09-17T17:06:52.091205] [INFO ] [MAIN ] AGM: Starting full primary refresh. [2025-09-17T17:06:52.433611] [INFO ] [REMOTE ] AGI: Fetching primary data for 2024-12. [2025-09-17T17:06:52.475238] [INFO ] [REMOTE ] AGM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:06:52.764078] [INFO ] [REMOTE ] AGCO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T17:06:52.769558] [INFO ] [REMOTE ] AGCO: Full fetch complete (62039 records). [2025-09-17T17:06:52.769726] [DEBUG] [VALIDATOR ] AGCO: Validating primary data. [2025-09-17T17:06:53.148851] [DEBUG] [VALIDATOR ] AGCO: All expected trading days are present. [2025-09-17T17:06:53.148980] [DEBUG] [VALIDATOR ] AGCO: Primary data validation passed. [2025-09-17T17:06:53.149685] [INFO ] [MAIN ] AGCO: Fetched primary data is valid. [2025-09-17T17:06:53.149803] [DEBUG] [LOCAL ] AGCO: Saving primary data. [2025-09-17T17:06:53.151302] [DEBUG] [LOCAL ] AGCO: Trimmed 62039 records to 42813 (keeping 200 days of data) [2025-09-17T17:06:53.219388] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-11. [2025-09-17T17:06:53.406337] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T17:06:53.468508] [DEBUG] [LOCAL ] AGCO: Primary data saved (42813 records). [2025-09-17T17:06:53.468656] [INFO ] [MAIN ] AGCO: Full history saved. [2025-09-17T17:06:53.468742] [INFO ] [MAIN ] Update Progress: 53/2371 symbols completed. AGCO took 36.7s. Estimated remaining: 5h 0m 1s. Rate: 7.7 symbols/min [2025-09-17T17:06:53.640184] [INFO ] [MAIN ] AGO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:06:53.668755] [DEBUG] [LOCAL ] AGO: Loaded 28268 existing records from primary storage. [2025-09-17T17:06:53.668908] [INFO ] [MAIN ] AGO: Loaded 28268 existing records. [2025-09-17T17:06:53.844089] [WARN ] [MAIN ] AGO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:06:53.844364] [INFO ] [MAIN ] AGO: Wiping existing primary data before full refresh. [2025-09-17T17:06:53.844416] [INFO ] [LOCAL ] AGO: Starting deletion of primary data. [2025-09-17T17:06:53.845259] [DEBUG] [LOCAL ] AGO: Deleted primary data file. [2025-09-17T17:06:53.845308] [INFO ] [MAIN ] AGO: Starting full primary refresh. [2025-09-17T17:06:54.019811] [INFO ] [REMOTE ] AGL: Fetching primary data for 2024-12. [2025-09-17T17:06:54.202963] [INFO ] [REMOTE ] AGO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:06:54.210538] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T17:06:54.244684] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T17:06:54.815792] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-01. [2025-09-17T17:06:55.615775] [INFO ] [REMOTE ] AGM: Fetching primary data for 2024-12. [2025-09-17T17:06:56.083291] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-17T17:06:56.415787] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-01. [2025-09-17T17:06:56.639436] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T17:06:56.649716] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T17:06:57.215786] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-02. [2025-09-17T17:06:58.015750] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-11. [2025-09-17T17:06:58.047837] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T17:06:58.815773] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-02. [2025-09-17T17:06:59.061471] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T17:06:59.371911] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T17:06:59.615832] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-01. [2025-09-17T17:07:00.059412] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T17:07:00.265493] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T17:07:00.415824] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-03. [2025-09-17T17:07:01.215795] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-03. [2025-09-17T17:07:01.890498] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T17:07:02.015831] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-02. [2025-09-17T17:07:02.667386] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T17:07:02.815775] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-04. [2025-09-17T17:07:03.233846] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T17:07:03.615778] [INFO ] [REMOTE ] AGO: Fetching primary data for 2024-12. [2025-09-17T17:07:04.415747] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-03. [2025-09-17T17:07:04.564426] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T17:07:04.969853] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-17T17:07:05.215778] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-01. [2025-09-17T17:07:05.294606] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T17:07:06.015832] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-04. [2025-09-17T17:07:06.586183] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T17:07:06.654705] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T17:07:06.815786] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-02. [2025-09-17T17:07:07.615816] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-05. [2025-09-17T17:07:07.977015] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T17:07:08.415763] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-05. [2025-09-17T17:07:09.179354] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T17:07:09.215777] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-06. [2025-09-17T17:07:09.443023] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T17:07:10.015750] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-03. [2025-09-17T17:07:10.356411] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T17:07:10.815790] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-06. [2025-09-17T17:07:11.460494] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T17:07:11.615781] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-04. [2025-09-17T17:07:12.415854] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-07. [2025-09-17T17:07:12.644328] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T17:07:13.215826] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-04. [2025-09-17T17:07:13.745603] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T17:07:13.845507] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T17:07:14.015780] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-05. [2025-09-17T17:07:14.798045] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T17:07:14.815730] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-08. [2025-09-17T17:07:15.615747] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-05. [2025-09-17T17:07:15.770444] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T17:07:16.004657] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T17:07:16.415787] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-06. [2025-09-17T17:07:16.874708] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T17:07:17.215774] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-06. [2025-09-17T17:07:18.021088] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-07. [2025-09-17T17:07:18.045559] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T17:07:18.154380] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T17:07:18.815804] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-07. [2025-09-17T17:07:19.615792] [INFO ] [REMOTE ] AGM: Fetching primary data for 2025-09. [2025-09-17T17:07:19.735018] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T17:07:20.150316] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T17:07:20.313060] [INFO ] [REMOTE ] AGM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T17:07:20.314859] [INFO ] [REMOTE ] AGM: Full fetch complete (12368 records). [2025-09-17T17:07:20.314940] [DEBUG] [VALIDATOR ] AGM: Validating primary data. [2025-09-17T17:07:20.418614] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-07. [2025-09-17T17:07:20.677888] [DEBUG] [VALIDATOR ] AGM: All expected trading days are present. [2025-09-17T17:07:20.677965] [DEBUG] [VALIDATOR ] AGM: Primary data validation passed. [2025-09-17T17:07:20.678186] [INFO ] [MAIN ] AGM: Fetched primary data is valid. [2025-09-17T17:07:20.678226] [DEBUG] [LOCAL ] AGM: Saving primary data. [2025-09-17T17:07:20.678712] [DEBUG] [LOCAL ] AGM: Trimmed 12368 records to 9839 (keeping 200 days of data) [2025-09-17T17:07:20.744429] [DEBUG] [LOCAL ] AGM: Primary data saved (9839 records). [2025-09-17T17:07:20.744555] [INFO ] [MAIN ] AGM: Full history saved. [2025-09-17T17:07:20.744637] [INFO ] [MAIN ] Update Progress: 54/2371 symbols completed. AGM took 29.1s. Estimated remaining: 5h 13m 50s. Rate: 7.4 symbols/min [2025-09-17T17:07:20.916447] [INFO ] [MAIN ] AGRO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:07:20.949078] [DEBUG] [LOCAL ] AGRO: Loaded 34178 existing records from primary storage. [2025-09-17T17:07:20.949220] [INFO ] [MAIN ] AGRO: Loaded 34178 existing records. [2025-09-17T17:07:21.125904] [WARN ] [MAIN ] AGRO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:07:21.126166] [INFO ] [MAIN ] AGRO: Wiping existing primary data before full refresh. [2025-09-17T17:07:21.126210] [INFO ] [LOCAL ] AGRO: Starting deletion of primary data. [2025-09-17T17:07:21.127110] [DEBUG] [LOCAL ] AGRO: Deleted primary data file. [2025-09-17T17:07:21.127168] [INFO ] [MAIN ] AGRO: Starting full primary refresh. [2025-09-17T17:07:21.224191] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-08. [2025-09-17T17:07:21.512036] [INFO ] [REMOTE ] AGRO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:07:22.015826] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-08. [2025-09-17T17:07:22.416293] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T17:07:22.569823] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T17:07:22.815818] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-08. [2025-09-17T17:07:23.615827] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-11. [2025-09-17T17:07:24.061935] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T17:07:24.415773] [INFO ] [REMOTE ] AGL: Fetching primary data for 2025-09. [2025-09-17T17:07:24.486490] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T17:07:25.215779] [INFO ] [REMOTE ] AGO: Fetching primary data for 2025-09. [2025-09-17T17:07:25.235755] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T17:07:26.015805] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2024-12. [2025-09-17T17:07:26.327151] [INFO ] [REMOTE ] AGL: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T17:07:26.334483] [INFO ] [REMOTE ] AGL: Full fetch complete (75241 records). [2025-09-17T17:07:26.334631] [DEBUG] [VALIDATOR ] AGL: Validating primary data. [2025-09-17T17:07:26.447895] [INFO ] [REMOTE ] AGO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T17:07:26.472862] [INFO ] [REMOTE ] AGO: Full fetch complete (39100 records). [2025-09-17T17:07:26.491788] [DEBUG] [VALIDATOR ] AGO: Validating primary data. [2025-09-17T17:07:26.820722] [INFO ] [REMOTE ] AGI: Fetching primary data for 2025-09. [2025-09-17T17:07:27.059986] [DEBUG] [VALIDATOR ] AGL: All expected trading days are present. [2025-09-17T17:07:27.086248] [DEBUG] [VALIDATOR ] AGL: Primary data validation passed. [2025-09-17T17:07:27.123128] [INFO ] [MAIN ] AGL: Fetched primary data is valid. [2025-09-17T17:07:27.139533] [DEBUG] [LOCAL ] AGL: Saving primary data. [2025-09-17T17:07:27.153236] [DEBUG] [VALIDATOR ] AGO: All expected trading days are present. [2025-09-17T17:07:27.153372] [DEBUG] [VALIDATOR ] AGO: Primary data validation passed. [2025-09-17T17:07:27.154059] [INFO ] [MAIN ] AGO: Fetched primary data is valid. [2025-09-17T17:07:27.154211] [DEBUG] [LOCAL ] AGO: Saving primary data. [2025-09-17T17:07:27.155339] [DEBUG] [LOCAL ] AGO: Trimmed 39100 records to 28188 (keeping 200 days of data) [2025-09-17T17:07:27.155595] [DEBUG] [LOCAL ] AGL: Trimmed 75241 records to 52408 (keeping 200 days of data) [2025-09-17T17:07:27.359243] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T17:07:27.585460] [DEBUG] [LOCAL ] AGO: Primary data saved (28188 records). [2025-09-17T17:07:27.586153] [INFO ] [MAIN ] AGO: Full history saved. [2025-09-17T17:07:27.586857] [INFO ] [MAIN ] Update Progress: 55/2371 symbols completed. AGO took 34.1s. Estimated remaining: 5h 12m 48s. Rate: 7.4 symbols/min [2025-09-17T17:07:27.621817] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-01. [2025-09-17T17:07:27.778034] [INFO ] [MAIN ] AGX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:07:27.872606] [DEBUG] [LOCAL ] AGX: Loaded 33599 existing records from primary storage. [2025-09-17T17:07:27.873502] [INFO ] [MAIN ] AGX: Loaded 33599 existing records. [2025-09-17T17:07:27.979149] [DEBUG] [LOCAL ] AGL: Primary data saved (52408 records). [2025-09-17T17:07:27.981442] [INFO ] [MAIN ] AGL: Full history saved. [2025-09-17T17:07:27.987973] [INFO ] [MAIN ] Update Progress: 56/2371 symbols completed. AGL took 37.3s. Estimated remaining: 5h 7m 21s. Rate: 7.5 symbols/min [2025-09-17T17:07:28.181302] [WARN ] [MAIN ] AGX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:07:28.192079] [INFO ] [MAIN ] AGX: Wiping existing primary data before full refresh. [2025-09-17T17:07:28.192342] [INFO ] [LOCAL ] AGX: Starting deletion of primary data. [2025-09-17T17:07:28.218756] [DEBUG] [LOCAL ] AGX: Deleted primary data file. [2025-09-17T17:07:28.244315] [INFO ] [MAIN ] AGX: Starting full primary refresh. [2025-09-17T17:07:28.262817] [INFO ] [MAIN ] AHH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:07:28.603329] [DEBUG] [LOCAL ] AHH: Loaded 41687 existing records from primary storage. [2025-09-17T17:07:28.622022] [INFO ] [MAIN ] AHH: Loaded 41687 existing records. [2025-09-17T17:07:28.658107] [INFO ] [REMOTE ] AGX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:07:28.729138] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-11. [2025-09-17T17:07:28.840081] [WARN ] [MAIN ] AHH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:07:28.840301] [INFO ] [MAIN ] AHH: Wiping existing primary data before full refresh. [2025-09-17T17:07:28.840347] [INFO ] [LOCAL ] AHH: Starting deletion of primary data. [2025-09-17T17:07:28.841205] [DEBUG] [LOCAL ] AHH: Deleted primary data file. [2025-09-17T17:07:28.841254] [INFO ] [MAIN ] AHH: Starting full primary refresh. [2025-09-17T17:07:29.205087] [INFO ] [REMOTE ] AHH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:07:29.223479] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-11. [2025-09-17T17:07:29.231734] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T17:07:29.251772] [INFO ] [REMOTE ] AGI: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-17T17:07:29.259797] [INFO ] [REMOTE ] AGI: Full fetch complete (76510 records). [2025-09-17T17:07:29.259979] [DEBUG] [VALIDATOR ] AGI: Validating primary data. [2025-09-17T17:07:29.666843] [DEBUG] [VALIDATOR ] AGI: All expected trading days are present. [2025-09-17T17:07:29.666936] [DEBUG] [VALIDATOR ] AGI: Primary data validation passed. [2025-09-17T17:07:29.667759] [INFO ] [MAIN ] AGI: Fetched primary data is valid. [2025-09-17T17:07:29.667810] [DEBUG] [LOCAL ] AGI: Saving primary data. [2025-09-17T17:07:29.669366] [DEBUG] [LOCAL ] AGI: Trimmed 76510 records to 53412 (keeping 200 days of data) [2025-09-17T17:07:29.997389] [DEBUG] [LOCAL ] AGI: Primary data saved (53412 records). [2025-09-17T17:07:29.997528] [INFO ] [MAIN ] AGI: Full history saved. [2025-09-17T17:07:29.998715] [INFO ] [MAIN ] Update Progress: 57/2371 symbols completed. AGI took 41.4s. Estimated remaining: 5h 3m 12s. Rate: 7.6 symbols/min [2025-09-17T17:07:30.030489] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-02. [2025-09-17T17:07:30.168870] [INFO ] [MAIN ] AHL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:07:30.169022] [DEBUG] [LOCAL ] AHL: No existing data file found in primary storage. [2025-09-17T17:07:30.169060] [WARN ] [MAIN ] AHL: No existing data found, performing full refresh instead. [2025-09-17T17:07:30.169174] [INFO ] [MAIN ] AHL: Wiping existing primary data before full refresh. [2025-09-17T17:07:30.169212] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-17T17:07:30.169255] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-17T17:07:30.169287] [INFO ] [MAIN ] AHL: Starting full primary refresh. [2025-09-17T17:07:30.527578] [INFO ] [REMOTE ] AHL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:07:30.544708] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T17:07:30.695008] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T17:07:30.815774] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-11. [2025-09-17T17:07:30.937109] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T17:07:31.094078] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:07:31.094395] [WARN ] [REMOTE ] AHL: No data returned for month 2024-11 [2025-09-17T17:07:31.615834] [INFO ] [REMOTE ] AHL: Fetching primary data for 2024-12. [2025-09-17T17:07:31.840783] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:07:31.841295] [WARN ] [REMOTE ] AHL: No data returned for month 2024-12 [2025-09-17T17:07:32.415786] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-03. [2025-09-17T17:07:33.215790] [INFO ] [REMOTE ] AHH: Fetching primary data for 2024-12. [2025-09-17T17:07:33.689138] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T17:07:34.015793] [INFO ] [REMOTE ] AGX: Fetching primary data for 2024-12. [2025-09-17T17:07:34.804263] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T17:07:34.815682] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-01. [2025-09-17T17:07:35.452915] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T17:07:35.615843] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-04. [2025-09-17T17:07:36.321552] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T17:07:36.415831] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-01. [2025-09-17T17:07:36.624519] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:07:36.624936] [WARN ] [REMOTE ] AHL: No data returned for month 2025-01 [2025-09-17T17:07:36.814679] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T17:07:37.215793] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-02. [2025-09-17T17:07:37.410234] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:07:37.410573] [WARN ] [REMOTE ] AHL: No data returned for month 2025-02 [2025-09-17T17:07:38.015801] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-01. [2025-09-17T17:07:38.815818] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-05. [2025-09-17T17:07:39.411470] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T17:07:39.615804] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-02. [2025-09-17T17:07:40.236088] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T17:07:40.415785] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-02. [2025-09-17T17:07:40.859200] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T17:07:41.215777] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-03. [2025-09-17T17:07:41.446353] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:07:41.446677] [WARN ] [REMOTE ] AHL: No data returned for month 2025-03 [2025-09-17T17:07:41.682971] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T17:07:42.015820] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-03. [2025-09-17T17:07:42.815830] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-03. [2025-09-17T17:07:43.580809] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T17:07:43.615726] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-04. [2025-09-17T17:07:44.415788] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-04. [2025-09-17T17:07:44.442125] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T17:07:44.641213] [DEBUG] [REMOTE ] AHL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:07:44.641508] [WARN ] [REMOTE ] AHL: No data returned for month 2025-04 [2025-09-17T17:07:45.191521] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T17:07:45.215739] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-05. [2025-09-17T17:07:46.015833] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-04. [2025-09-17T17:07:46.472434] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T17:07:46.815774] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-06. [2025-09-17T17:07:47.615811] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-05. [2025-09-17T17:07:47.723047] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T17:07:48.012013] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T17:07:48.415795] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-06. [2025-09-17T17:07:48.674907] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T17:07:49.215827] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-06. [2025-09-17T17:07:49.686804] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T17:07:50.015797] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-07. [2025-09-17T17:07:50.257838] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T17:07:50.815784] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-07. [2025-09-17T17:07:50.959578] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T17:07:51.615781] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-05. [2025-09-17T17:07:51.757829] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T17:07:52.415804] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-08. [2025-09-17T17:07:53.214754] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T17:07:53.223427] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-08. [2025-09-17T17:07:53.672958] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T17:07:54.015784] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-06. [2025-09-17T17:07:54.572461] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T17:07:54.815785] [INFO ] [REMOTE ] AGRO: Fetching primary data for 2025-09. [2025-09-17T17:07:55.497546] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T17:07:55.615855] [INFO ] [REMOTE ] AHL: Fetching primary data for 2025-09. [2025-09-17T17:07:55.828751] [INFO ] [REMOTE ] AGRO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T17:07:55.834160] [INFO ] [REMOTE ] AGRO: Full fetch complete (49949 records). [2025-09-17T17:07:55.834387] [DEBUG] [VALIDATOR ] AGRO: Validating primary data. [2025-09-17T17:07:56.235218] [DEBUG] [VALIDATOR ] AGRO: All expected trading days are present. [2025-09-17T17:07:56.235321] [DEBUG] [VALIDATOR ] AGRO: Primary data validation passed. [2025-09-17T17:07:56.236153] [INFO ] [MAIN ] AGRO: Fetched primary data is valid. [2025-09-17T17:07:56.236219] [DEBUG] [LOCAL ] AGRO: Saving primary data. [2025-09-17T17:07:56.237491] [DEBUG] [LOCAL ] AGRO: Trimmed 49949 records to 34065 (keeping 200 days of data) [2025-09-17T17:07:56.432828] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-07. [2025-09-17T17:07:56.458613] [DEBUG] [LOCAL ] AGRO: Primary data saved (34065 records). [2025-09-17T17:07:56.458775] [INFO ] [MAIN ] AGRO: Full history saved. [2025-09-17T17:07:56.458865] [INFO ] [MAIN ] Update Progress: 58/2371 symbols completed. AGRO took 35.7s. Estimated remaining: 5h 15m 25s. Rate: 7.3 symbols/min [2025-09-17T17:07:56.638345] [INFO ] [MAIN ] AHR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:07:56.685626] [DEBUG] [LOCAL ] AHR: Loaded 49406 existing records from primary storage. [2025-09-17T17:07:56.685800] [INFO ] [MAIN ] AHR: Loaded 49406 existing records. [2025-09-17T17:07:56.870711] [WARN ] [MAIN ] AHR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:07:56.870955] [INFO ] [MAIN ] AHR: Wiping existing primary data before full refresh. [2025-09-17T17:07:56.870999] [INFO ] [LOCAL ] AHR: Starting deletion of primary data. [2025-09-17T17:07:56.872008] [DEBUG] [LOCAL ] AHR: Deleted primary data file. [2025-09-17T17:07:56.872058] [INFO ] [MAIN ] AHR: Starting full primary refresh. [2025-09-17T17:07:57.201268] [INFO ] [REMOTE ] AHL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T17:07:57.223634] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-07. [2025-09-17T17:07:57.240441] [INFO ] [REMOTE ] AHL: Full fetch complete (16340 records). [2025-09-17T17:07:57.249351] [DEBUG] [VALIDATOR ] AHL: Validating primary data. [2025-09-17T17:07:57.308386] [INFO ] [REMOTE ] AHR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:07:57.454163] [WARN ] [VALIDATOR ] AHL: Validation failed - insufficient historical data. Have 91 unique days, need 200 days [2025-09-17T17:07:57.454446] [FATAL] [MAIN ] AHL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:07:57.454496] [WARN ] [MAIN ] AHL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:07:57.454535] [INFO ] [LOCAL ] AHL: Starting deletion of primary data. [2025-09-17T17:07:57.454592] [DEBUG] [LOCAL ] AHL: No primary data file found to delete. [2025-09-17T17:07:57.454627] [INFO ] [LOCAL ] AHL: Starting deletion of derivative data. [2025-09-17T17:07:57.454697] [DEBUG] [LOCAL ] AHL: No derivative data file found to delete. [2025-09-17T17:07:57.454757] [INFO ] [MAIN ] Update Progress: 59/2371 symbols completed. AHL took 27.5s. Estimated remaining: 5h 10m 36s. Rate: 7.4 symbols/min [2025-09-17T17:07:57.622515] [INFO ] [MAIN ] AHT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:07:57.647842] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T17:07:57.659190] [DEBUG] [LOCAL ] AHT: Loaded 5923 existing records from primary storage. [2025-09-17T17:07:57.659521] [INFO ] [MAIN ] AHT: Loaded 5923 existing records. [2025-09-17T17:07:57.833238] [WARN ] [MAIN ] AHT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:07:57.833466] [INFO ] [MAIN ] AHT: Wiping existing primary data before full refresh. [2025-09-17T17:07:57.833511] [INFO ] [LOCAL ] AHT: Starting deletion of primary data. [2025-09-17T17:07:57.833781] [DEBUG] [LOCAL ] AHT: Deleted primary data file. [2025-09-17T17:07:57.833827] [INFO ] [MAIN ] AHT: Starting full primary refresh. [2025-09-17T17:07:58.020993] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-08. [2025-09-17T17:07:58.194234] [INFO ] [REMOTE ] AHT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:07:58.815756] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-11. [2025-09-17T17:07:58.882257] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T17:07:59.528125] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T17:07:59.615758] [INFO ] [REMOTE ] AHH: Fetching primary data for 2025-09. [2025-09-17T17:07:59.681715] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T17:08:00.415839] [INFO ] [REMOTE ] AHT: Fetching primary data for 2024-12. [2025-09-17T17:08:00.764098] [INFO ] [REMOTE ] AHH: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T17:08:00.771269] [INFO ] [REMOTE ] AHH: Full fetch complete (60412 records). [2025-09-17T17:08:00.771400] [DEBUG] [VALIDATOR ] AHH: Validating primary data. [2025-09-17T17:08:01.162032] [DEBUG] [VALIDATOR ] AHH: All expected trading days are present. [2025-09-17T17:08:01.162140] [DEBUG] [VALIDATOR ] AHH: Primary data validation passed. [2025-09-17T17:08:01.162749] [INFO ] [MAIN ] AHH: Fetched primary data is valid. [2025-09-17T17:08:01.162792] [DEBUG] [LOCAL ] AHH: Saving primary data. [2025-09-17T17:08:01.164005] [DEBUG] [LOCAL ] AHH: Trimmed 60412 records to 41658 (keeping 200 days of data) [2025-09-17T17:08:01.220355] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-08. [2025-09-17T17:08:01.387388] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T17:08:01.427195] [DEBUG] [LOCAL ] AHH: Primary data saved (41658 records). [2025-09-17T17:08:01.427352] [INFO ] [MAIN ] AHH: Full history saved. [2025-09-17T17:08:01.428103] [INFO ] [MAIN ] Update Progress: 60/2371 symbols completed. AHH took 33.4s. Estimated remaining: 5h 7m 50s. Rate: 7.5 symbols/min [2025-09-17T17:08:01.598107] [INFO ] [MAIN ] AI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:08:01.659494] [DEBUG] [LOCAL ] AI: Loaded 53749 existing records from primary storage. [2025-09-17T17:08:01.659713] [INFO ] [MAIN ] AI: Loaded 53749 existing records. [2025-09-17T17:08:01.845347] [WARN ] [MAIN ] AI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:08:01.845697] [INFO ] [MAIN ] AI: Wiping existing primary data before full refresh. [2025-09-17T17:08:01.845749] [INFO ] [LOCAL ] AI: Starting deletion of primary data. [2025-09-17T17:08:01.846749] [DEBUG] [LOCAL ] AI: Deleted primary data file. [2025-09-17T17:08:01.846809] [INFO ] [MAIN ] AI: Starting full primary refresh. [2025-09-17T17:08:02.021451] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-11. [2025-09-17T17:08:02.222690] [INFO ] [REMOTE ] AI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:08:02.415392] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T17:08:02.815782] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-11. [2025-09-17T17:08:03.615761] [INFO ] [REMOTE ] AGX: Fetching primary data for 2025-09. [2025-09-17T17:08:04.039295] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T17:08:04.415787] [INFO ] [REMOTE ] AHR: Fetching primary data for 2024-12. [2025-09-17T17:08:05.048556] [INFO ] [REMOTE ] AGX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T17:08:05.053755] [INFO ] [REMOTE ] AGX: Full fetch complete (48771 records). [2025-09-17T17:08:05.053884] [DEBUG] [VALIDATOR ] AGX: Validating primary data. [2025-09-17T17:08:05.235172] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-01. [2025-09-17T17:08:05.278995] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-11 (2.46 seconds). [2025-09-17T17:08:05.495313] [DEBUG] [VALIDATOR ] AGX: All expected trading days are present. [2025-09-17T17:08:05.495404] [DEBUG] [VALIDATOR ] AGX: Primary data validation passed. [2025-09-17T17:08:05.495926] [INFO ] [MAIN ] AGX: Fetched primary data is valid. [2025-09-17T17:08:05.495970] [DEBUG] [LOCAL ] AGX: Saving primary data. [2025-09-17T17:08:05.497184] [DEBUG] [LOCAL ] AGX: Trimmed 48771 records to 33538 (keeping 200 days of data) [2025-09-17T17:08:05.708522] [DEBUG] [LOCAL ] AGX: Primary data saved (33538 records). [2025-09-17T17:08:05.708677] [INFO ] [MAIN ] AGX: Full history saved. [2025-09-17T17:08:05.708801] [INFO ] [MAIN ] Update Progress: 61/2371 symbols completed. AGX took 38.1s. Estimated remaining: 5h 5m 22s. Rate: 7.6 symbols/min [2025-09-17T17:08:05.886114] [INFO ] [MAIN ] AIG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:08:05.946570] [DEBUG] [LOCAL ] AIG: Loaded 53477 existing records from primary storage. [2025-09-17T17:08:05.952163] [INFO ] [MAIN ] AIG: Loaded 53477 existing records. [2025-09-17T17:08:05.958344] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T17:08:06.016583] [INFO ] [REMOTE ] AI: Fetching primary data for 2024-12. [2025-09-17T17:08:06.165484] [WARN ] [MAIN ] AIG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:08:06.166088] [INFO ] [MAIN ] AIG: Wiping existing primary data before full refresh. [2025-09-17T17:08:06.166208] [INFO ] [LOCAL ] AIG: Starting deletion of primary data. [2025-09-17T17:08:06.176326] [DEBUG] [LOCAL ] AIG: Deleted primary data file. [2025-09-17T17:08:06.190472] [INFO ] [MAIN ] AIG: Starting full primary refresh. [2025-09-17T17:08:06.280049] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T17:08:06.578209] [INFO ] [REMOTE ] AIG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:08:06.815774] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-11. [2025-09-17T17:08:07.615781] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-02. [2025-09-17T17:08:08.144459] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T17:08:08.402050] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-17T17:08:08.415722] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-01. [2025-09-17T17:08:08.723197] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T17:08:09.215799] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-01. [2025-09-17T17:08:10.015800] [INFO ] [REMOTE ] AIG: Fetching primary data for 2024-12. [2025-09-17T17:08:10.820836] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-03. [2025-09-17T17:08:10.833853] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T17:08:10.885150] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-17T17:08:11.460136] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T17:08:11.506783] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T17:08:11.615840] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-02. [2025-09-17T17:08:12.415790] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-02. [2025-09-17T17:08:12.905933] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T17:08:13.215830] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-03. [2025-09-17T17:08:14.015798] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-01. [2025-09-17T17:08:14.815744] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-04. [2025-09-17T17:08:14.918044] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-02 (2.50 seconds). [2025-09-17T17:08:15.005043] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T17:08:15.485449] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T17:08:15.514326] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T17:08:15.615748] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-03. [2025-09-17T17:08:16.415798] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-04. [2025-09-17T17:08:17.215813] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-02. [2025-09-17T17:08:18.015917] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-05. [2025-09-17T17:08:18.053188] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-17T17:08:18.210369] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T17:08:18.673139] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T17:08:18.815798] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-05. [2025-09-17T17:08:19.006994] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T17:08:19.615787] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-04. [2025-09-17T17:08:20.232293] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T17:08:20.415778] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-06. [2025-09-17T17:08:21.215774] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-03. [2025-09-17T17:08:21.841452] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T17:08:21.917395] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-17T17:08:22.015803] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-05. [2025-09-17T17:08:22.821072] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-06. [2025-09-17T17:08:22.829828] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T17:08:23.578053] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T17:08:23.615794] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-07. [2025-09-17T17:08:24.005858] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T17:08:24.285237] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T17:08:24.415872] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-07. [2025-09-17T17:08:25.215855] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-06. [2025-09-17T17:08:25.867900] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T17:08:26.015825] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-08. [2025-09-17T17:08:26.815871] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-04. [2025-09-17T17:08:27.615888] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-08. [2025-09-17T17:08:27.684912] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T17:08:27.771419] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-06 (2.56 seconds). [2025-09-17T17:08:28.052113] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T17:08:28.415857] [INFO ] [REMOTE ] AHR: Fetching primary data for 2025-09. [2025-09-17T17:08:28.681317] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T17:08:29.215826] [INFO ] [REMOTE ] AHT: Fetching primary data for 2025-09. [2025-09-17T17:08:29.981767] [INFO ] [REMOTE ] AHT: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T17:08:29.983504] [INFO ] [REMOTE ] AHT: Full fetch complete (9513 records). [2025-09-17T17:08:29.983615] [DEBUG] [VALIDATOR ] AHT: Validating primary data. [2025-09-17T17:08:30.020450] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-07. [2025-09-17T17:08:30.123222] [INFO ] [REMOTE ] AHR: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T17:08:30.176318] [INFO ] [REMOTE ] AHR: Full fetch complete (70919 records). [2025-09-17T17:08:30.198628] [DEBUG] [VALIDATOR ] AHR: Validating primary data. [2025-09-17T17:08:30.678993] [DEBUG] [VALIDATOR ] AHT: All expected trading days are present. [2025-09-17T17:08:30.719127] [DEBUG] [VALIDATOR ] AHT: Primary data validation passed. [2025-09-17T17:08:30.742784] [INFO ] [MAIN ] AHT: Fetched primary data is valid. [2025-09-17T17:08:30.756090] [DEBUG] [LOCAL ] AHT: Saving primary data. [2025-09-17T17:08:30.773839] [DEBUG] [LOCAL ] AHT: Trimmed 9513 records to 5934 (keeping 200 days of data) [2025-09-17T17:08:30.818585] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-05. [2025-09-17T17:08:30.899103] [DEBUG] [VALIDATOR ] AHR: All expected trading days are present. [2025-09-17T17:08:30.900813] [DEBUG] [VALIDATOR ] AHR: Primary data validation passed. [2025-09-17T17:08:30.901677] [INFO ] [MAIN ] AHR: Fetched primary data is valid. [2025-09-17T17:08:30.901750] [DEBUG] [LOCAL ] AHR: Saving primary data. [2025-09-17T17:08:30.900700] [DEBUG] [LOCAL ] AHT: Primary data saved (5934 records). [2025-09-17T17:08:30.902197] [INFO ] [MAIN ] AHT: Full history saved. [2025-09-17T17:08:30.903540] [INFO ] [MAIN ] Update Progress: 62/2371 symbols completed. AHT took 33.4s. Estimated remaining: 5h 15m 57s. Rate: 7.3 symbols/min [2025-09-17T17:08:30.999155] [DEBUG] [LOCAL ] AHR: Trimmed 70919 records to 49378 (keeping 200 days of data) [2025-09-17T17:08:31.184674] [INFO ] [MAIN ] AII: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:08:31.186830] [DEBUG] [LOCAL ] AII: No existing data file found in primary storage. [2025-09-17T17:08:31.190690] [WARN ] [MAIN ] AII: No existing data found, performing full refresh instead. [2025-09-17T17:08:31.201964] [INFO ] [MAIN ] AII: Wiping existing primary data before full refresh. [2025-09-17T17:08:31.202078] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-17T17:08:31.205440] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-17T17:08:31.209846] [INFO ] [MAIN ] AII: Starting full primary refresh. [2025-09-17T17:08:31.715158] [INFO ] [REMOTE ] AII: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:08:31.716102] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-11. [2025-09-17T17:08:31.809890] [DEBUG] [LOCAL ] AHR: Primary data saved (49378 records). [2025-09-17T17:08:31.810132] [INFO ] [MAIN ] AHR: Full history saved. [2025-09-17T17:08:31.810268] [INFO ] [MAIN ] Update Progress: 63/2371 symbols completed. AHR took 35.4s. Estimated remaining: 5h 11m 21s. Rate: 7.4 symbols/min [2025-09-17T17:08:31.920588] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:08:31.923575] [WARN ] [REMOTE ] AII: No data returned for month 2024-11 [2025-09-17T17:08:31.995700] [INFO ] [MAIN ] AIN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:08:32.021305] [DEBUG] [LOCAL ] AIN: Loaded 24660 existing records from primary storage. [2025-09-17T17:08:32.021460] [INFO ] [MAIN ] AIN: Loaded 24660 existing records. [2025-09-17T17:08:32.199377] [WARN ] [MAIN ] AIN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:08:32.199628] [INFO ] [MAIN ] AIN: Wiping existing primary data before full refresh. [2025-09-17T17:08:32.199693] [INFO ] [LOCAL ] AIN: Starting deletion of primary data. [2025-09-17T17:08:32.200505] [DEBUG] [LOCAL ] AIN: Deleted primary data file. [2025-09-17T17:08:32.200553] [INFO ] [MAIN ] AIN: Starting full primary refresh. [2025-09-17T17:08:32.436594] [INFO ] [REMOTE ] AII: Fetching primary data for 2024-12. [2025-09-17T17:08:32.554576] [INFO ] [REMOTE ] AIN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:08:32.673558] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:08:32.673976] [WARN ] [REMOTE ] AII: No data returned for month 2024-12 [2025-09-17T17:08:32.715511] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-17T17:08:32.761839] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T17:08:33.215822] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-11. [2025-09-17T17:08:34.015783] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-06. [2025-09-17T17:08:34.716896] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T17:08:34.815773] [INFO ] [REMOTE ] AIN: Fetching primary data for 2024-12. [2025-09-17T17:08:35.624377] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-08. [2025-09-17T17:08:35.627434] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T17:08:35.760518] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T17:08:36.415807] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-01. [2025-09-17T17:08:36.648387] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:08:36.648858] [WARN ] [REMOTE ] AII: No data returned for month 2025-01 [2025-09-17T17:08:37.215793] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-07. [2025-09-17T17:08:38.015875] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-02. [2025-09-17T17:08:38.259782] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:08:38.260210] [WARN ] [REMOTE ] AII: No data returned for month 2025-02 [2025-09-17T17:08:38.304561] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-17T17:08:38.635991] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T17:08:38.815839] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-03. [2025-09-17T17:08:39.011315] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:08:39.011615] [WARN ] [REMOTE ] AII: No data returned for month 2025-03 [2025-09-17T17:08:39.615800] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-04. [2025-09-17T17:08:39.825421] [DEBUG] [REMOTE ] AII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:08:39.825746] [WARN ] [REMOTE ] AII: No data returned for month 2025-04 [2025-09-17T17:08:40.415778] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-05. [2025-09-17T17:08:41.215771] [INFO ] [REMOTE ] AI: Fetching primary data for 2025-09. [2025-09-17T17:08:41.565600] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T17:08:42.015812] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-06. [2025-09-17T17:08:42.815783] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-01. [2025-09-17T17:08:43.066971] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T17:08:43.615830] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-07. [2025-09-17T17:08:43.848036] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T17:08:43.922377] [INFO ] [REMOTE ] AI: Incremental fetch complete for 2025-09 (2.71 seconds). [2025-09-17T17:08:43.930977] [INFO ] [REMOTE ] AI: Full fetch complete (77884 records). [2025-09-17T17:08:43.931140] [DEBUG] [VALIDATOR ] AI: Validating primary data. [2025-09-17T17:08:44.345351] [DEBUG] [VALIDATOR ] AI: All expected trading days are present. [2025-09-17T17:08:44.345467] [DEBUG] [VALIDATOR ] AI: Primary data validation passed. [2025-09-17T17:08:44.346215] [INFO ] [MAIN ] AI: Fetched primary data is valid. [2025-09-17T17:08:44.346262] [DEBUG] [LOCAL ] AI: Saving primary data. [2025-09-17T17:08:44.347824] [DEBUG] [LOCAL ] AI: Trimmed 77884 records to 53749 (keeping 200 days of data) [2025-09-17T17:08:44.438928] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-02. [2025-09-17T17:08:44.543131] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T17:08:44.696578] [DEBUG] [LOCAL ] AI: Primary data saved (53749 records). [2025-09-17T17:08:44.696768] [INFO ] [MAIN ] AI: Full history saved. [2025-09-17T17:08:44.698213] [INFO ] [MAIN ] Update Progress: 64/2371 symbols completed. AI took 43.3s. Estimated remaining: 5h 14m 6s. Rate: 7.3 symbols/min [2025-09-17T17:08:44.895800] [INFO ] [MAIN ] AIO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:08:44.910975] [DEBUG] [LOCAL ] AIO: Loaded 13435 existing records from primary storage. [2025-09-17T17:08:44.911105] [INFO ] [MAIN ] AIO: Loaded 13435 existing records. [2025-09-17T17:08:45.086743] [WARN ] [MAIN ] AIO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:08:45.086988] [INFO ] [MAIN ] AIO: Wiping existing primary data before full refresh. [2025-09-17T17:08:45.087032] [INFO ] [LOCAL ] AIO: Starting deletion of primary data. [2025-09-17T17:08:45.087472] [DEBUG] [LOCAL ] AIO: Deleted primary data file. [2025-09-17T17:08:45.087517] [INFO ] [MAIN ] AIO: Starting full primary refresh. [2025-09-17T17:08:45.227255] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-08. [2025-09-17T17:08:45.463395] [INFO ] [REMOTE ] AIO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:08:45.473247] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T17:08:46.015777] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-11. [2025-09-17T17:08:46.815786] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-08. [2025-09-17T17:08:46.926040] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T17:08:47.590215] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T17:08:47.603754] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T17:08:47.615738] [INFO ] [REMOTE ] AIG: Fetching primary data for 2025-09. [2025-09-17T17:08:48.415830] [INFO ] [REMOTE ] AII: Fetching primary data for 2025-09. [2025-09-17T17:08:49.215815] [INFO ] [REMOTE ] AIO: Fetching primary data for 2024-12. [2025-09-17T17:08:49.387697] [INFO ] [REMOTE ] AII: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T17:08:49.390189] [INFO ] [REMOTE ] AII: Full fetch complete (9788 records). [2025-09-17T17:08:49.390259] [DEBUG] [VALIDATOR ] AII: Validating primary data. [2025-09-17T17:08:49.569243] [WARN ] [VALIDATOR ] AII: Validation failed - insufficient historical data. Have 91 unique days, need 200 days [2025-09-17T17:08:49.569501] [FATAL] [MAIN ] AII: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:08:49.569658] [WARN ] [MAIN ] AII: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:08:49.569738] [INFO ] [LOCAL ] AII: Starting deletion of primary data. [2025-09-17T17:08:49.569841] [DEBUG] [LOCAL ] AII: No primary data file found to delete. [2025-09-17T17:08:49.569919] [INFO ] [LOCAL ] AII: Starting deletion of derivative data. [2025-09-17T17:08:49.570002] [DEBUG] [LOCAL ] AII: No derivative data file found to delete. [2025-09-17T17:08:49.570064] [INFO ] [MAIN ] Update Progress: 65/2371 symbols completed. AII took 18.7s. Estimated remaining: 5h 12m 0s. Rate: 7.4 symbols/min [2025-09-17T17:08:49.745403] [INFO ] [MAIN ] AIR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:08:49.764996] [INFO ] [REMOTE ] AIG: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-17T17:08:49.772206] [INFO ] [REMOTE ] AIG: Full fetch complete (77211 records). [2025-09-17T17:08:49.773736] [DEBUG] [VALIDATOR ] AIG: Validating primary data. [2025-09-17T17:08:49.932412] [DEBUG] [LOCAL ] AIR: Loaded 26867 existing records from primary storage. [2025-09-17T17:08:49.938080] [INFO ] [MAIN ] AIR: Loaded 26867 existing records. [2025-09-17T17:08:50.056908] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-03. [2025-09-17T17:08:50.311032] [WARN ] [MAIN ] AIR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:08:50.351258] [INFO ] [MAIN ] AIR: Wiping existing primary data before full refresh. [2025-09-17T17:08:50.356492] [INFO ] [LOCAL ] AIR: Starting deletion of primary data. [2025-09-17T17:08:50.409373] [DEBUG] [VALIDATOR ] AIG: All expected trading days are present. [2025-09-17T17:08:50.405733] [DEBUG] [LOCAL ] AIR: Deleted primary data file. [2025-09-17T17:08:50.409479] [DEBUG] [VALIDATOR ] AIG: Primary data validation passed. [2025-09-17T17:08:50.410541] [INFO ] [MAIN ] AIG: Fetched primary data is valid. [2025-09-17T17:08:50.410680] [DEBUG] [LOCAL ] AIG: Saving primary data. [2025-09-17T17:08:50.409826] [INFO ] [MAIN ] AIR: Starting full primary refresh. [2025-09-17T17:08:50.475422] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T17:08:50.526749] [DEBUG] [LOCAL ] AIG: Trimmed 77211 records to 53477 (keeping 200 days of data) [2025-09-17T17:08:50.816365] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-01. [2025-09-17T17:08:50.893123] [INFO ] [REMOTE ] AIR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:08:51.133654] [DEBUG] [LOCAL ] AIG: Primary data saved (53477 records). [2025-09-17T17:08:51.133848] [INFO ] [MAIN ] AIG: Full history saved. [2025-09-17T17:08:51.137009] [INFO ] [MAIN ] Update Progress: 66/2371 symbols completed. AIG took 45.4s. Estimated remaining: 5h 8m 3s. Rate: 7.5 symbols/min [2025-09-17T17:08:51.312023] [INFO ] [MAIN ] AIT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:08:51.327860] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T17:08:51.359655] [DEBUG] [LOCAL ] AIT: Loaded 28542 existing records from primary storage. [2025-09-17T17:08:51.359786] [INFO ] [MAIN ] AIT: Loaded 28542 existing records. [2025-09-17T17:08:51.537352] [WARN ] [MAIN ] AIT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:08:51.537606] [INFO ] [MAIN ] AIT: Wiping existing primary data before full refresh. [2025-09-17T17:08:51.537679] [INFO ] [LOCAL ] AIT: Starting deletion of primary data. [2025-09-17T17:08:51.538508] [DEBUG] [LOCAL ] AIT: Deleted primary data file. [2025-09-17T17:08:51.538612] [INFO ] [MAIN ] AIT: Starting full primary refresh. [2025-09-17T17:08:51.620965] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-11. [2025-09-17T17:08:51.896192] [INFO ] [REMOTE ] AIT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:08:51.906352] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T17:08:52.415805] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-11. [2025-09-17T17:08:52.758902] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T17:08:53.215863] [INFO ] [REMOTE ] AIR: Fetching primary data for 2024-12. [2025-09-17T17:08:53.603561] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T17:08:54.015744] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-04. [2025-09-17T17:08:54.299464] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T17:08:54.815828] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-02. [2025-09-17T17:08:55.039474] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T17:08:55.561619] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T17:08:55.615737] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-03. [2025-09-17T17:08:56.415797] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-01. [2025-09-17T17:08:56.564077] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T17:08:57.215838] [INFO ] [REMOTE ] AIT: Fetching primary data for 2024-12. [2025-09-17T17:08:57.779206] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T17:08:58.015780] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-02. [2025-09-17T17:08:58.152396] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T17:08:58.727471] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T17:08:58.815781] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-05. [2025-09-17T17:08:59.615773] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-04. [2025-09-17T17:08:59.684661] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T17:09:00.415802] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-01. [2025-09-17T17:09:00.814252] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T17:09:01.215778] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-05. [2025-09-17T17:09:01.806982] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T17:09:01.858838] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T17:09:02.015790] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-02. [2025-09-17T17:09:02.815763] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-06. [2025-09-17T17:09:03.198217] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T17:09:03.615774] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-03. [2025-09-17T17:09:03.826019] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T17:09:04.415771] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-03. [2025-09-17T17:09:05.087104] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T17:09:05.215768] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-04. [2025-09-17T17:09:05.778947] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T17:09:06.015790] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-07. [2025-09-17T17:09:06.700973] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T17:09:06.819235] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-04. [2025-09-17T17:09:06.822015] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T17:09:07.615762] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-06. [2025-09-17T17:09:08.257277] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T17:09:08.415839] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-05. [2025-09-17T17:09:08.776018] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T17:09:09.215853] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-08. [2025-09-17T17:09:09.776498] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T17:09:09.791018] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T17:09:10.015796] [INFO ] [REMOTE ] AIO: Fetching primary data for 2025-09. [2025-09-17T17:09:10.817906] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-06. [2025-09-17T17:09:11.015096] [INFO ] [REMOTE ] AIO: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T17:09:11.017126] [INFO ] [REMOTE ] AIO: Full fetch complete (20200 records). [2025-09-17T17:09:11.017202] [DEBUG] [VALIDATOR ] AIO: Validating primary data. [2025-09-17T17:09:11.380463] [DEBUG] [VALIDATOR ] AIO: All expected trading days are present. [2025-09-17T17:09:11.380545] [DEBUG] [VALIDATOR ] AIO: Primary data validation passed. [2025-09-17T17:09:11.380850] [INFO ] [MAIN ] AIO: Fetched primary data is valid. [2025-09-17T17:09:11.380894] [DEBUG] [LOCAL ] AIO: Saving primary data. [2025-09-17T17:09:11.381429] [DEBUG] [LOCAL ] AIO: Trimmed 20200 records to 13406 (keeping 200 days of data) [2025-09-17T17:09:11.464177] [DEBUG] [LOCAL ] AIO: Primary data saved (13406 records). [2025-09-17T17:09:11.464318] [INFO ] [MAIN ] AIO: Full history saved. [2025-09-17T17:09:11.464429] [INFO ] [MAIN ] Update Progress: 67/2371 symbols completed. AIO took 26.8s. Estimated remaining: 5h 14m 59s. Rate: 7.3 symbols/min [2025-09-17T17:09:11.630408] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-07. [2025-09-17T17:09:11.632924] [INFO ] [MAIN ] AIV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:09:11.633847] [DEBUG] [LOCAL ] AIV: No existing data file found in primary storage. [2025-09-17T17:09:11.633902] [WARN ] [MAIN ] AIV: No existing data found, performing full refresh instead. [2025-09-17T17:09:11.634070] [INFO ] [MAIN ] AIV: Wiping existing primary data before full refresh. [2025-09-17T17:09:11.634110] [INFO ] [LOCAL ] AIV: Starting deletion of primary data. [2025-09-17T17:09:11.634150] [DEBUG] [LOCAL ] AIV: No primary data file found to delete. [2025-09-17T17:09:11.634190] [INFO ] [MAIN ] AIV: Starting full primary refresh. [2025-09-17T17:09:11.996682] [INFO ] [REMOTE ] AIV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:09:12.313769] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T17:09:12.415736] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-11. [2025-09-17T17:09:12.922698] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T17:09:13.215815] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-07. [2025-09-17T17:09:13.971669] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T17:09:14.015729] [INFO ] [REMOTE ] AIV: Fetching primary data for 2024-12. [2025-09-17T17:09:14.587984] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T17:09:14.815757] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-05. [2025-09-17T17:09:15.517037] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T17:09:15.615787] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-08. [2025-09-17T17:09:15.912560] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T17:09:16.415828] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-08. [2025-09-17T17:09:16.889880] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T17:09:17.215786] [INFO ] [REMOTE ] AIN: Fetching primary data for 2025-09. [2025-09-17T17:09:17.745009] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T17:09:18.015817] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-01. [2025-09-17T17:09:18.245796] [INFO ] [REMOTE ] AIN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T17:09:18.249022] [INFO ] [REMOTE ] AIN: Full fetch complete (33117 records). [2025-09-17T17:09:18.249112] [DEBUG] [VALIDATOR ] AIN: Validating primary data. [2025-09-17T17:09:18.629237] [DEBUG] [VALIDATOR ] AIN: All expected trading days are present. [2025-09-17T17:09:18.629320] [DEBUG] [VALIDATOR ] AIN: Primary data validation passed. [2025-09-17T17:09:18.629751] [INFO ] [MAIN ] AIN: Fetched primary data is valid. [2025-09-17T17:09:18.629794] [DEBUG] [LOCAL ] AIN: Saving primary data. [2025-09-17T17:09:18.630521] [DEBUG] [LOCAL ] AIN: Trimmed 33117 records to 24588 (keeping 200 days of data) [2025-09-17T17:09:18.783033] [DEBUG] [LOCAL ] AIN: Primary data saved (24588 records). [2025-09-17T17:09:18.783167] [INFO ] [MAIN ] AIN: Full history saved. [2025-09-17T17:09:18.783261] [INFO ] [MAIN ] Update Progress: 68/2371 symbols completed. AIN took 47.0s. Estimated remaining: 5h 14m 21s. Rate: 7.3 symbols/min [2025-09-17T17:09:18.821557] [INFO ] [REMOTE ] AIT: Fetching primary data for 2025-09. [2025-09-17T17:09:18.964029] [INFO ] [MAIN ] AIZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:09:18.998745] [DEBUG] [LOCAL ] AIZ: Loaded 30481 existing records from primary storage. [2025-09-17T17:09:18.998922] [INFO ] [MAIN ] AIZ: Loaded 30481 existing records. [2025-09-17T17:09:19.176174] [WARN ] [MAIN ] AIZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:09:19.176459] [INFO ] [MAIN ] AIZ: Wiping existing primary data before full refresh. [2025-09-17T17:09:19.176506] [INFO ] [LOCAL ] AIZ: Starting deletion of primary data. [2025-09-17T17:09:19.177251] [DEBUG] [LOCAL ] AIZ: Deleted primary data file. [2025-09-17T17:09:19.177331] [INFO ] [MAIN ] AIZ: Starting full primary refresh. [2025-09-17T17:09:19.533981] [INFO ] [REMOTE ] AIZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:09:19.559633] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T17:09:19.615743] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-11. [2025-09-17T17:09:19.985681] [INFO ] [REMOTE ] AIT: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T17:09:19.989802] [INFO ] [REMOTE ] AIT: Full fetch complete (39626 records). [2025-09-17T17:09:19.989909] [DEBUG] [VALIDATOR ] AIT: Validating primary data. [2025-09-17T17:09:20.383906] [DEBUG] [VALIDATOR ] AIT: All expected trading days are present. [2025-09-17T17:09:20.384006] [DEBUG] [VALIDATOR ] AIT: Primary data validation passed. [2025-09-17T17:09:20.384524] [INFO ] [MAIN ] AIT: Fetched primary data is valid. [2025-09-17T17:09:20.384577] [DEBUG] [LOCAL ] AIT: Saving primary data. [2025-09-17T17:09:20.385915] [DEBUG] [LOCAL ] AIT: Trimmed 39626 records to 28515 (keeping 200 days of data) [2025-09-17T17:09:20.447515] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-06. [2025-09-17T17:09:20.572013] [DEBUG] [LOCAL ] AIT: Primary data saved (28515 records). [2025-09-17T17:09:20.572152] [INFO ] [MAIN ] AIT: Full history saved. [2025-09-17T17:09:20.572246] [INFO ] [MAIN ] Update Progress: 69/2371 symbols completed. AIT took 29.4s. Estimated remaining: 5h 10m 39s. Rate: 7.4 symbols/min [2025-09-17T17:09:20.745570] [INFO ] [MAIN ] AIZN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:09:20.752852] [DEBUG] [LOCAL ] AIZN: Loaded 3961 existing records from primary storage. [2025-09-17T17:09:20.752954] [INFO ] [MAIN ] AIZN: Loaded 3961 existing records. [2025-09-17T17:09:20.932797] [WARN ] [MAIN ] AIZN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:09:20.933079] [INFO ] [MAIN ] AIZN: Wiping existing primary data before full refresh. [2025-09-17T17:09:20.933127] [INFO ] [LOCAL ] AIZN: Starting deletion of primary data. [2025-09-17T17:09:20.933398] [DEBUG] [LOCAL ] AIZN: Deleted primary data file. [2025-09-17T17:09:20.933445] [INFO ] [MAIN ] AIZN: Starting full primary refresh. [2025-09-17T17:09:21.219188] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-02. [2025-09-17T17:09:21.302928] [INFO ] [REMOTE ] AIZN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:09:21.320728] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T17:09:21.357264] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T17:09:22.015782] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-11. [2025-09-17T17:09:22.581635] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T17:09:22.675428] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T17:09:22.815792] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-03. [2025-09-17T17:09:23.615786] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2024-12. [2025-09-17T17:09:24.359047] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T17:09:24.415743] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-04. [2025-09-17T17:09:25.042549] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T17:09:25.215810] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-01. [2025-09-17T17:09:25.994445] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T17:09:26.015736] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-05. [2025-09-17T17:09:26.567333] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T17:09:26.815805] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-02. [2025-09-17T17:09:27.117736] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T17:09:27.615775] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2024-12. [2025-09-17T17:09:28.036828] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-17T17:09:28.363518] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T17:09:28.415730] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-03. [2025-09-17T17:09:29.215813] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-06. [2025-09-17T17:09:30.015871] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-01. [2025-09-17T17:09:30.114350] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T17:09:30.568232] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T17:09:30.591702] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T17:09:30.815809] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-02. [2025-09-17T17:09:31.142244] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T17:09:31.615785] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-03. [2025-09-17T17:09:32.223866] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T17:09:32.415789] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-07. [2025-09-17T17:09:33.215786] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-04. [2025-09-17T17:09:33.812363] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T17:09:33.842965] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T17:09:34.015802] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-05. [2025-09-17T17:09:34.583808] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T17:09:34.815840] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-08. [2025-09-17T17:09:35.615789] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-06. [2025-09-17T17:09:36.185704] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T17:09:36.415757] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-07. [2025-09-17T17:09:36.443561] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T17:09:37.129501] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T17:09:37.215791] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-08. [2025-09-17T17:09:37.557015] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-17T17:09:38.015829] [INFO ] [REMOTE ] AIZN: Fetching primary data for 2025-09. [2025-09-17T17:09:38.580311] [INFO ] [REMOTE ] AIZN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T17:09:38.581287] [INFO ] [REMOTE ] AIZN: Full fetch complete (5714 records). [2025-09-17T17:09:38.581354] [DEBUG] [VALIDATOR ] AIZN: Validating primary data. [2025-09-17T17:09:38.820859] [INFO ] [REMOTE ] AIV: Fetching primary data for 2025-09. [2025-09-17T17:09:38.944581] [DEBUG] [VALIDATOR ] AIZN: All expected trading days are present. [2025-09-17T17:09:38.944689] [DEBUG] [VALIDATOR ] AIZN: Primary data validation passed. [2025-09-17T17:09:38.944896] [INFO ] [MAIN ] AIZN: Fetched primary data is valid. [2025-09-17T17:09:38.944936] [DEBUG] [LOCAL ] AIZN: Saving primary data. [2025-09-17T17:09:38.945329] [DEBUG] [LOCAL ] AIZN: Trimmed 5714 records to 3965 (keeping 200 days of data) [2025-09-17T17:09:38.970239] [DEBUG] [LOCAL ] AIZN: Primary data saved (3965 records). [2025-09-17T17:09:38.970308] [INFO ] [MAIN ] AIZN: Full history saved. [2025-09-17T17:09:38.970397] [INFO ] [MAIN ] Update Progress: 70/2371 symbols completed. AIZN took 18.4s. Estimated remaining: 5h 16m 9s. Rate: 7.3 symbols/min [2025-09-17T17:09:39.141036] [INFO ] [MAIN ] AJG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:09:39.186426] [DEBUG] [LOCAL ] AJG: Loaded 47178 existing records from primary storage. [2025-09-17T17:09:39.186591] [INFO ] [MAIN ] AJG: Loaded 47178 existing records. [2025-09-17T17:09:39.364756] [WARN ] [MAIN ] AJG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:09:39.365036] [INFO ] [MAIN ] AJG: Wiping existing primary data before full refresh. [2025-09-17T17:09:39.365099] [INFO ] [LOCAL ] AJG: Starting deletion of primary data. [2025-09-17T17:09:39.366217] [DEBUG] [LOCAL ] AJG: Deleted primary data file. [2025-09-17T17:09:39.366273] [INFO ] [MAIN ] AJG: Starting full primary refresh. [2025-09-17T17:09:39.620883] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-04. [2025-09-17T17:09:39.726939] [INFO ] [REMOTE ] AJG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:09:40.415805] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-07. [2025-09-17T17:09:40.465108] [INFO ] [REMOTE ] AIV: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T17:09:40.471188] [INFO ] [REMOTE ] AIV: Full fetch complete (58730 records). [2025-09-17T17:09:40.471297] [DEBUG] [VALIDATOR ] AIV: Validating primary data. [2025-09-17T17:09:40.856830] [DEBUG] [VALIDATOR ] AIV: All expected trading days are present. [2025-09-17T17:09:40.857045] [DEBUG] [VALIDATOR ] AIV: Primary data validation passed. [2025-09-17T17:09:40.857685] [INFO ] [MAIN ] AIV: Fetched primary data is valid. [2025-09-17T17:09:40.857772] [DEBUG] [LOCAL ] AIV: Saving primary data. [2025-09-17T17:09:40.859048] [DEBUG] [LOCAL ] AIV: Trimmed 58730 records to 40154 (keeping 200 days of data) [2025-09-17T17:09:40.877366] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T17:09:41.113072] [DEBUG] [LOCAL ] AIV: Primary data saved (40154 records). [2025-09-17T17:09:41.113195] [INFO ] [MAIN ] AIV: Full history saved. [2025-09-17T17:09:41.113267] [INFO ] [MAIN ] Update Progress: 71/2371 symbols completed. AIV took 29.6s. Estimated remaining: 5h 12m 43s. Rate: 7.4 symbols/min [2025-09-17T17:09:41.217397] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-05. [2025-09-17T17:09:41.287889] [INFO ] [MAIN ] AKA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:09:41.288047] [DEBUG] [LOCAL ] AKA: No existing data file found in primary storage. [2025-09-17T17:09:41.288086] [WARN ] [MAIN ] AKA: No existing data found, performing full refresh instead. [2025-09-17T17:09:41.288213] [INFO ] [MAIN ] AKA: Wiping existing primary data before full refresh. [2025-09-17T17:09:41.288253] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-17T17:09:41.288296] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-17T17:09:41.288329] [INFO ] [MAIN ] AKA: Starting full primary refresh. [2025-09-17T17:09:41.648735] [INFO ] [REMOTE ] AKA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:09:41.669702] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T17:09:42.015782] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-11. [2025-09-17T17:09:42.322198] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T17:09:42.601117] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T17:09:42.815769] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-06. [2025-09-17T17:09:43.615776] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-11. [2025-09-17T17:09:44.142616] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T17:09:44.415803] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-08. [2025-09-17T17:09:44.918220] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T17:09:45.215785] [INFO ] [REMOTE ] AJG: Fetching primary data for 2024-12. [2025-09-17T17:09:45.846140] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T17:09:46.015818] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-07. [2025-09-17T17:09:46.815780] [INFO ] [REMOTE ] AIR: Fetching primary data for 2025-09. [2025-09-17T17:09:47.022804] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T17:09:47.186166] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T17:09:47.615797] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-01. [2025-09-17T17:09:48.263934] [INFO ] [REMOTE ] AIR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T17:09:48.267809] [INFO ] [REMOTE ] AIR: Full fetch complete (37014 records). [2025-09-17T17:09:48.267929] [DEBUG] [VALIDATOR ] AIR: Validating primary data. [2025-09-17T17:09:48.420894] [INFO ] [REMOTE ] AKA: Fetching primary data for 2024-12. [2025-09-17T17:09:48.656908] [DEBUG] [VALIDATOR ] AIR: All expected trading days are present. [2025-09-17T17:09:48.657002] [DEBUG] [VALIDATOR ] AIR: Primary data validation passed. [2025-09-17T17:09:48.657672] [INFO ] [MAIN ] AIR: Fetched primary data is valid. [2025-09-17T17:09:48.657754] [DEBUG] [LOCAL ] AIR: Saving primary data. [2025-09-17T17:09:48.659156] [DEBUG] [LOCAL ] AIR: Trimmed 37014 records to 26996 (keeping 200 days of data) [2025-09-17T17:09:48.825323] [DEBUG] [LOCAL ] AIR: Primary data saved (26996 records). [2025-09-17T17:09:48.825457] [INFO ] [MAIN ] AIR: Full history saved. [2025-09-17T17:09:48.825540] [INFO ] [MAIN ] Update Progress: 72/2371 symbols completed. AIR took 59.3s. Estimated remaining: 5h 12m 21s. Rate: 7.4 symbols/min [2025-09-17T17:09:49.002617] [INFO ] [MAIN ] AKR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:09:49.002802] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T17:09:49.053801] [DEBUG] [LOCAL ] AKR: Loaded 45615 existing records from primary storage. [2025-09-17T17:09:49.053968] [INFO ] [MAIN ] AKR: Loaded 45615 existing records. [2025-09-17T17:09:49.221595] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-01. [2025-09-17T17:09:49.235043] [WARN ] [MAIN ] AKR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:09:49.236043] [INFO ] [MAIN ] AKR: Wiping existing primary data before full refresh. [2025-09-17T17:09:49.236094] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-17T17:09:49.237347] [DEBUG] [LOCAL ] AKR: Deleted primary data file. [2025-09-17T17:09:49.237397] [INFO ] [MAIN ] AKR: Starting full primary refresh. [2025-09-17T17:09:49.608084] [INFO ] [REMOTE ] AKR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:09:49.637229] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-17T17:09:49.734301] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T17:09:50.015835] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-02. [2025-09-17T17:09:50.579686] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T17:09:50.815775] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-03. [2025-09-17T17:09:51.125427] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-17T17:09:51.615788] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-02. [2025-09-17T17:09:52.415810] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-08. [2025-09-17T17:09:53.215760] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-11. [2025-09-17T17:09:53.320090] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T17:09:54.015774] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-03. [2025-09-17T17:09:54.131712] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T17:09:54.815775] [INFO ] [REMOTE ] AIZ: Fetching primary data for 2025-09. [2025-09-17T17:09:54.912448] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T17:09:55.615754] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-04. [2025-09-17T17:09:55.735588] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T17:09:56.049887] [INFO ] [REMOTE ] AIZ: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T17:09:56.053847] [INFO ] [REMOTE ] AIZ: Full fetch complete (43017 records). [2025-09-17T17:09:56.053949] [DEBUG] [VALIDATOR ] AIZ: Validating primary data. [2025-09-17T17:09:56.157664] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-17T17:09:56.420849] [INFO ] [REMOTE ] AKR: Fetching primary data for 2024-12. [2025-09-17T17:09:56.435860] [DEBUG] [VALIDATOR ] AIZ: All expected trading days are present. [2025-09-17T17:09:56.437097] [DEBUG] [VALIDATOR ] AIZ: Primary data validation passed. [2025-09-17T17:09:56.437569] [INFO ] [MAIN ] AIZ: Fetched primary data is valid. [2025-09-17T17:09:56.437611] [DEBUG] [LOCAL ] AIZ: Saving primary data. [2025-09-17T17:09:56.438660] [DEBUG] [LOCAL ] AIZ: Trimmed 43017 records to 30418 (keeping 200 days of data) [2025-09-17T17:09:56.630429] [DEBUG] [LOCAL ] AIZ: Primary data saved (30418 records). [2025-09-17T17:09:56.630563] [INFO ] [MAIN ] AIZ: Full history saved. [2025-09-17T17:09:56.630670] [INFO ] [MAIN ] Update Progress: 73/2371 symbols completed. AIZ took 37.8s. Estimated remaining: 5h 12m 2s. Rate: 7.4 symbols/min [2025-09-17T17:09:56.799218] [INFO ] [MAIN ] AL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:09:56.840563] [DEBUG] [LOCAL ] AL: Loaded 43858 existing records from primary storage. [2025-09-17T17:09:56.840733] [INFO ] [MAIN ] AL: Loaded 43858 existing records. [2025-09-17T17:09:57.020099] [WARN ] [MAIN ] AL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:09:57.020356] [INFO ] [MAIN ] AL: Wiping existing primary data before full refresh. [2025-09-17T17:09:57.020401] [INFO ] [LOCAL ] AL: Starting deletion of primary data. [2025-09-17T17:09:57.021838] [DEBUG] [LOCAL ] AL: Deleted primary data file. [2025-09-17T17:09:57.021889] [INFO ] [MAIN ] AL: Starting full primary refresh. [2025-09-17T17:09:57.224911] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-05. [2025-09-17T17:09:57.396791] [INFO ] [REMOTE ] AL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:09:57.925143] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T17:09:58.015756] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-04. [2025-09-17T17:09:58.106222] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T17:09:58.815791] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-01. [2025-09-17T17:09:59.615793] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-06. [2025-09-17T17:09:59.836304] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T17:10:00.107712] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T17:10:00.299866] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T17:10:00.415757] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-02. [2025-09-17T17:10:01.215769] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-11. [2025-09-17T17:10:01.992351] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T17:10:02.015852] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-05. [2025-09-17T17:10:02.782262] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T17:10:02.815723] [INFO ] [REMOTE ] AL: Fetching primary data for 2024-12. [2025-09-17T17:10:03.615813] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-07. [2025-09-17T17:10:03.790200] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T17:10:03.941850] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-17T17:10:04.308345] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T17:10:04.415823] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-08. [2025-09-17T17:10:04.708034] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-17T17:10:05.215784] [INFO ] [REMOTE ] AKA: Fetching primary data for 2025-09. [2025-09-17T17:10:05.622022] [INFO ] [REMOTE ] AKA: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T17:10:05.622961] [INFO ] [REMOTE ] AKA: Full fetch complete (2468 records). [2025-09-17T17:10:05.623046] [DEBUG] [VALIDATOR ] AKA: Validating primary data. [2025-09-17T17:10:05.827746] [WARN ] [VALIDATOR ] AKA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T17:10:05.828106] [FATAL] [MAIN ] AKA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:10:05.828198] [WARN ] [MAIN ] AKA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:10:05.828270] [INFO ] [LOCAL ] AKA: Starting deletion of primary data. [2025-09-17T17:10:05.828365] [DEBUG] [LOCAL ] AKA: No primary data file found to delete. [2025-09-17T17:10:05.828432] [INFO ] [LOCAL ] AKA: Starting deletion of derivative data. [2025-09-17T17:10:05.828502] [DEBUG] [LOCAL ] AKA: No derivative data file found to delete. [2025-09-17T17:10:05.828604] [INFO ] [MAIN ] Update Progress: 74/2371 symbols completed. AKA took 24.7s. Estimated remaining: 5h 12m 27s. Rate: 7.4 symbols/min [2025-09-17T17:10:06.020884] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-03. [2025-09-17T17:10:06.022695] [INFO ] [MAIN ] ALB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:10:06.078470] [DEBUG] [LOCAL ] ALB: Loaded 53258 existing records from primary storage. [2025-09-17T17:10:06.078620] [INFO ] [MAIN ] ALB: Loaded 53258 existing records. [2025-09-17T17:10:06.255046] [WARN ] [MAIN ] ALB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:10:06.255301] [INFO ] [MAIN ] ALB: Wiping existing primary data before full refresh. [2025-09-17T17:10:06.255346] [INFO ] [LOCAL ] ALB: Starting deletion of primary data. [2025-09-17T17:10:06.256433] [DEBUG] [LOCAL ] ALB: Deleted primary data file. [2025-09-17T17:10:06.256484] [INFO ] [MAIN ] ALB: Starting full primary refresh. [2025-09-17T17:10:06.616424] [INFO ] [REMOTE ] ALB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:10:06.815767] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-06. [2025-09-17T17:10:07.615820] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-01. [2025-09-17T17:10:07.753782] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T17:10:08.415826] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-11. [2025-09-17T17:10:08.517394] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T17:10:09.000141] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T17:10:09.215835] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-07. [2025-09-17T17:10:10.015799] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-04. [2025-09-17T17:10:10.631347] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T17:10:10.712463] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T17:10:10.815832] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-02. [2025-09-17T17:10:11.373347] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T17:10:11.615805] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-08. [2025-09-17T17:10:12.241087] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T17:10:12.415795] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-03. [2025-09-17T17:10:13.215785] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-05. [2025-09-17T17:10:13.316510] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T17:10:14.020858] [INFO ] [REMOTE ] ALB: Fetching primary data for 2024-12. [2025-09-17T17:10:14.031740] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T17:10:14.749175] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T17:10:14.815724] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-06. [2025-09-17T17:10:15.615795] [INFO ] [REMOTE ] AJG: Fetching primary data for 2025-09. [2025-09-17T17:10:15.982062] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T17:10:16.143533] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-17T17:10:16.415785] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-07. [2025-09-17T17:10:17.005600] [INFO ] [REMOTE ] AJG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T17:10:17.012058] [INFO ] [REMOTE ] AJG: Full fetch complete (69532 records). [2025-09-17T17:10:17.012224] [DEBUG] [VALIDATOR ] AJG: Validating primary data. [2025-09-17T17:10:17.220983] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-01. [2025-09-17T17:10:17.425026] [DEBUG] [VALIDATOR ] AJG: All expected trading days are present. [2025-09-17T17:10:17.425120] [DEBUG] [VALIDATOR ] AJG: Primary data validation passed. [2025-09-17T17:10:17.425854] [INFO ] [MAIN ] AJG: Fetched primary data is valid. [2025-09-17T17:10:17.425905] [DEBUG] [LOCAL ] AJG: Saving primary data. [2025-09-17T17:10:17.427397] [DEBUG] [LOCAL ] AJG: Trimmed 69532 records to 47156 (keeping 200 days of data) [2025-09-17T17:10:17.729549] [DEBUG] [LOCAL ] AJG: Primary data saved (47156 records). [2025-09-17T17:10:17.729729] [INFO ] [MAIN ] AJG: Full history saved. [2025-09-17T17:10:17.730603] [INFO ] [MAIN ] Update Progress: 75/2371 symbols completed. AJG took 38.8s. Estimated remaining: 5h 14m 13s. Rate: 7.3 symbols/min [2025-09-17T17:10:17.908364] [INFO ] [MAIN ] ALC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:10:17.964873] [DEBUG] [LOCAL ] ALC: Loaded 50818 existing records from primary storage. [2025-09-17T17:10:17.965044] [INFO ] [MAIN ] ALC: Loaded 50818 existing records. [2025-09-17T17:10:18.029368] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-04. [2025-09-17T17:10:18.145905] [WARN ] [MAIN ] ALC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:10:18.146159] [INFO ] [MAIN ] ALC: Wiping existing primary data before full refresh. [2025-09-17T17:10:18.146212] [INFO ] [LOCAL ] ALC: Starting deletion of primary data. [2025-09-17T17:10:18.147108] [DEBUG] [LOCAL ] ALC: Deleted primary data file. [2025-09-17T17:10:18.147166] [INFO ] [MAIN ] ALC: Starting full primary refresh. [2025-09-17T17:10:18.512821] [INFO ] [REMOTE ] ALC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:10:18.543465] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T17:10:18.815806] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-08. [2025-09-17T17:10:19.200301] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T17:10:19.615832] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-11. [2025-09-17T17:10:20.039166] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T17:10:20.293512] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T17:10:20.415812] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-05. [2025-09-17T17:10:21.123402] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T17:10:21.215750] [INFO ] [REMOTE ] ALC: Fetching primary data for 2024-12. [2025-09-17T17:10:22.015798] [INFO ] [REMOTE ] AKR: Fetching primary data for 2025-09. [2025-09-17T17:10:22.145842] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T17:10:22.815775] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-06. [2025-09-17T17:10:22.895746] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T17:10:23.447186] [INFO ] [REMOTE ] AKR: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T17:10:23.452818] [INFO ] [REMOTE ] AKR: Full fetch complete (64750 records). [2025-09-17T17:10:23.452965] [DEBUG] [VALIDATOR ] AKR: Validating primary data. [2025-09-17T17:10:23.453828] [FATAL] [VALIDATOR ] AKR: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:10:23.453934] [FATAL] [MAIN ] AKR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:10:23.453986] [WARN ] [MAIN ] AKR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:10:23.454049] [INFO ] [LOCAL ] AKR: Starting deletion of primary data. [2025-09-17T17:10:23.454139] [DEBUG] [LOCAL ] AKR: No primary data file found to delete. [2025-09-17T17:10:23.454194] [INFO ] [LOCAL ] AKR: Starting deletion of derivative data. [2025-09-17T17:10:23.454620] [DEBUG] [LOCAL ] AKR: Deleted derivative data file. [2025-09-17T17:10:23.456285] [INFO ] [MAIN ] Update Progress: 76/2371 symbols completed. AKR took 34.6s. Estimated remaining: 5h 12m 50s. Rate: 7.3 symbols/min [2025-09-17T17:10:23.619929] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-01. [2025-09-17T17:10:23.640956] [INFO ] [MAIN ] ALE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:10:23.681515] [DEBUG] [LOCAL ] ALE: Loaded 29897 existing records from primary storage. [2025-09-17T17:10:23.681711] [INFO ] [MAIN ] ALE: Loaded 29897 existing records. [2025-09-17T17:10:23.872020] [WARN ] [MAIN ] ALE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:10:23.872268] [INFO ] [MAIN ] ALE: Wiping existing primary data before full refresh. [2025-09-17T17:10:23.872315] [INFO ] [LOCAL ] ALE: Starting deletion of primary data. [2025-09-17T17:10:23.873118] [DEBUG] [LOCAL ] ALE: Deleted primary data file. [2025-09-17T17:10:23.873173] [INFO ] [MAIN ] ALE: Starting full primary refresh. [2025-09-17T17:10:24.256781] [INFO ] [REMOTE ] ALE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:10:24.415779] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-11. [2025-09-17T17:10:24.455415] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T17:10:25.047797] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T17:10:25.215806] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-02. [2025-09-17T17:10:25.588501] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T17:10:26.015797] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-02. [2025-09-17T17:10:26.815770] [INFO ] [REMOTE ] ALE: Fetching primary data for 2024-12. [2025-09-17T17:10:27.132537] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T17:10:27.615843] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-03. [2025-09-17T17:10:27.868827] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T17:10:27.945636] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T17:10:28.415821] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-03. [2025-09-17T17:10:29.215749] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-01. [2025-09-17T17:10:29.375134] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T17:10:30.015791] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-07. [2025-09-17T17:10:30.244019] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T17:10:30.392416] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T17:10:30.815850] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-02. [2025-09-17T17:10:31.240505] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T17:10:31.563051] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T17:10:31.615773] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-03. [2025-09-17T17:10:32.415817] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-04. [2025-09-17T17:10:32.977173] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T17:10:33.215829] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-04. [2025-09-17T17:10:34.015747] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-08. [2025-09-17T17:10:34.515828] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T17:10:34.641427] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T17:10:34.815771] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-05. [2025-09-17T17:10:35.615750] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-04. [2025-09-17T17:10:35.799588] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T17:10:36.415797] [INFO ] [REMOTE ] AL: Fetching primary data for 2025-09. [2025-09-17T17:10:36.624985] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T17:10:36.902074] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T17:10:37.215800] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-06. [2025-09-17T17:10:37.738754] [INFO ] [REMOTE ] AL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T17:10:37.745425] [INFO ] [REMOTE ] AL: Full fetch complete (61623 records). [2025-09-17T17:10:37.745569] [DEBUG] [VALIDATOR ] AL: Validating primary data. [2025-09-17T17:10:38.024372] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-05. [2025-09-17T17:10:38.166680] [DEBUG] [VALIDATOR ] AL: All expected trading days are present. [2025-09-17T17:10:38.166767] [DEBUG] [VALIDATOR ] AL: Primary data validation passed. [2025-09-17T17:10:38.167430] [INFO ] [MAIN ] AL: Fetched primary data is valid. [2025-09-17T17:10:38.167479] [DEBUG] [LOCAL ] AL: Saving primary data. [2025-09-17T17:10:38.168833] [DEBUG] [LOCAL ] AL: Trimmed 61623 records to 43915 (keeping 200 days of data) [2025-09-17T17:10:38.453857] [DEBUG] [LOCAL ] AL: Primary data saved (43915 records). [2025-09-17T17:10:38.454064] [INFO ] [MAIN ] AL: Full history saved. [2025-09-17T17:10:38.454222] [INFO ] [MAIN ] Update Progress: 77/2371 symbols completed. AL took 41.8s. Estimated remaining: 5h 16m 5s. Rate: 7.3 symbols/min [2025-09-17T17:10:38.532243] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T17:10:38.815805] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-07. [2025-09-17T17:10:38.916280] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T17:10:39.615784] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-06. [2025-09-17T17:10:40.415833] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-05. [2025-09-17T17:10:40.609711] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T17:10:40.785365] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T17:10:41.215793] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-07. [2025-09-17T17:10:42.015783] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-08. [2025-09-17T17:10:42.174527] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T17:10:42.530733] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T17:10:42.815838] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-08. [2025-09-17T17:10:43.615772] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-06. [2025-09-17T17:10:43.782148] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T17:10:44.415799] [INFO ] [REMOTE ] ALC: Fetching primary data for 2025-09. [2025-09-17T17:10:44.463878] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T17:10:45.215754] [INFO ] [REMOTE ] ALE: Fetching primary data for 2025-09. [2025-09-17T17:10:45.475949] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T17:10:45.807222] [INFO ] [REMOTE ] ALC: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T17:10:45.813991] [INFO ] [REMOTE ] ALC: Full fetch complete (72301 records). [2025-09-17T17:10:45.814135] [DEBUG] [VALIDATOR ] ALC: Validating primary data. [2025-09-17T17:10:46.021212] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-07. [2025-09-17T17:10:46.220508] [DEBUG] [VALIDATOR ] ALC: All expected trading days are present. [2025-09-17T17:10:46.220612] [DEBUG] [VALIDATOR ] ALC: Primary data validation passed. [2025-09-17T17:10:46.221548] [INFO ] [MAIN ] ALC: Fetched primary data is valid. [2025-09-17T17:10:46.221628] [DEBUG] [LOCAL ] ALC: Saving primary data. [2025-09-17T17:10:46.223246] [DEBUG] [LOCAL ] ALC: Trimmed 72301 records to 50811 (keeping 200 days of data) [2025-09-17T17:10:46.532305] [DEBUG] [LOCAL ] ALC: Primary data saved (50811 records). [2025-09-17T17:10:46.532464] [INFO ] [MAIN ] ALC: Full history saved. [2025-09-17T17:10:46.533258] [INFO ] [MAIN ] Update Progress: 78/2371 symbols completed. ALC took 28.8s. Estimated remaining: 5h 15m 51s. Rate: 7.3 symbols/min [2025-09-17T17:10:46.690221] [INFO ] [REMOTE ] ALE: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T17:10:46.695093] [INFO ] [REMOTE ] ALE: Full fetch complete (41688 records). [2025-09-17T17:10:46.695201] [DEBUG] [VALIDATOR ] ALE: Validating primary data. [2025-09-17T17:10:47.092452] [DEBUG] [VALIDATOR ] ALE: All expected trading days are present. [2025-09-17T17:10:47.092592] [DEBUG] [VALIDATOR ] ALE: Primary data validation passed. [2025-09-17T17:10:47.093117] [INFO ] [MAIN ] ALE: Fetched primary data is valid. [2025-09-17T17:10:47.093166] [DEBUG] [LOCAL ] ALE: Saving primary data. [2025-09-17T17:10:47.094847] [DEBUG] [LOCAL ] ALE: Trimmed 41688 records to 30063 (keeping 200 days of data) [2025-09-17T17:10:47.294862] [DEBUG] [LOCAL ] ALE: Primary data saved (30063 records). [2025-09-17T17:10:47.295023] [INFO ] [MAIN ] ALE: Full history saved. [2025-09-17T17:10:47.296497] [INFO ] [MAIN ] Update Progress: 79/2371 symbols completed. ALE took 23.8s. Estimated remaining: 5h 12m 5s. Rate: 7.3 symbols/min [2025-09-17T17:10:48.483949] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-17T17:10:48.498068] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-08. [2025-09-17T17:10:50.755460] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-17T17:10:50.766855] [INFO ] [REMOTE ] ALB: Fetching primary data for 2025-09. [2025-09-17T17:10:53.197321] [INFO ] [REMOTE ] ALB: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-17T17:10:53.204245] [INFO ] [REMOTE ] ALB: Full fetch complete (76631 records). [2025-09-17T17:10:53.204399] [DEBUG] [VALIDATOR ] ALB: Validating primary data. [2025-09-17T17:10:53.597214] [DEBUG] [VALIDATOR ] ALB: All expected trading days are present. [2025-09-17T17:10:53.597311] [DEBUG] [VALIDATOR ] ALB: Primary data validation passed. [2025-09-17T17:10:53.598123] [INFO ] [MAIN ] ALB: Fetched primary data is valid. [2025-09-17T17:10:53.598169] [DEBUG] [LOCAL ] ALB: Saving primary data. [2025-09-17T17:10:53.600060] [DEBUG] [LOCAL ] ALB: Trimmed 76631 records to 53252 (keeping 200 days of data) [2025-09-17T17:10:53.933221] [DEBUG] [LOCAL ] ALB: Primary data saved (53252 records). [2025-09-17T17:10:53.933375] [INFO ] [MAIN ] ALB: Full history saved. [2025-09-17T17:10:53.933460] [INFO ] [MAIN ] Update Progress: 80/2371 symbols completed. ALB took 48.1s. Estimated remaining: 5h 11m 13s. Rate: 7.4 symbols/min [2025-09-17T17:10:54.559058] [INFO ] [MAIN ] ALEX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:10:54.606376] [INFO ] [MAIN ] ALK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:10:54.605514] [INFO ] [MAIN ] ALIT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:10:54.625079] [INFO ] [MAIN ] ALG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:10:54.642125] [DEBUG] [LOCAL ] ALG: Loaded 10846 existing records from primary storage. [2025-09-17T17:10:54.642464] [INFO ] [MAIN ] ALG: Loaded 10846 existing records. [2025-09-17T17:10:54.823023] [DEBUG] [LOCAL ] ALEX: Loaded 31541 existing records from primary storage. [2025-09-17T17:10:54.833765] [INFO ] [MAIN ] ALEX: Loaded 31541 existing records. [2025-09-17T17:10:54.929139] [WARN ] [MAIN ] ALG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:10:55.006851] [INFO ] [MAIN ] ALG: Wiping existing primary data before full refresh. [2025-09-17T17:10:55.040435] [INFO ] [LOCAL ] ALG: Starting deletion of primary data. [2025-09-17T17:10:55.041223] [DEBUG] [LOCAL ] ALK: Loaded 53061 existing records from primary storage. [2025-09-17T17:10:55.041792] [INFO ] [MAIN ] ALK: Loaded 53061 existing records. [2025-09-17T17:10:55.062477] [DEBUG] [LOCAL ] ALG: Deleted primary data file. [2025-09-17T17:10:55.133581] [INFO ] [MAIN ] ALG: Starting full primary refresh. [2025-09-17T17:10:55.266954] [DEBUG] [LOCAL ] ALIT: Loaded 52733 existing records from primary storage. [2025-09-17T17:10:55.287209] [WARN ] [MAIN ] ALEX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:10:55.322631] [INFO ] [MAIN ] ALIT: Loaded 52733 existing records. [2025-09-17T17:10:55.370045] [INFO ] [MAIN ] ALEX: Wiping existing primary data before full refresh. [2025-09-17T17:10:55.454143] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-17T17:10:55.465146] [WARN ] [MAIN ] ALK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:10:55.527599] [INFO ] [MAIN ] ALK: Wiping existing primary data before full refresh. [2025-09-17T17:10:55.522254] [DEBUG] [LOCAL ] ALEX: Deleted primary data file. [2025-09-17T17:10:55.548831] [INFO ] [LOCAL ] ALK: Starting deletion of primary data. [2025-09-17T17:10:55.548882] [INFO ] [MAIN ] ALEX: Starting full primary refresh. [2025-09-17T17:10:55.575289] [DEBUG] [LOCAL ] ALK: Deleted primary data file. [2025-09-17T17:10:55.639981] [INFO ] [MAIN ] ALK: Starting full primary refresh. [2025-09-17T17:10:55.971086] [WARN ] [MAIN ] ALIT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:10:56.126011] [INFO ] [MAIN ] ALIT: Wiping existing primary data before full refresh. [2025-09-17T17:10:56.156569] [INFO ] [LOCAL ] ALIT: Starting deletion of primary data. [2025-09-17T17:10:56.304727] [DEBUG] [LOCAL ] ALIT: Deleted primary data file. [2025-09-17T17:10:56.379984] [INFO ] [MAIN ] ALIT: Starting full primary refresh. [2025-09-17T17:10:56.434228] [INFO ] [REMOTE ] ALG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:10:56.491609] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-11. [2025-09-17T17:10:56.738835] [INFO ] [REMOTE ] ALK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:10:56.753048] [INFO ] [REMOTE ] ALEX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:10:56.787918] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-11. [2025-09-17T17:10:56.819615] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-11. [2025-09-17T17:10:56.990023] [INFO ] [REMOTE ] ALIT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:10:56.990329] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-11. [2025-09-17T17:10:57.548000] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T17:10:57.550856] [INFO ] [REMOTE ] ALG: Fetching primary data for 2024-12. [2025-09-17T17:10:58.196442] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T17:10:58.202360] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2024-12. [2025-09-17T17:10:58.455544] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T17:10:58.458449] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-01. [2025-09-17T17:10:58.550580] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T17:10:58.561274] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2024-12. [2025-09-17T17:10:58.726255] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T17:10:58.736369] [INFO ] [REMOTE ] ALK: Fetching primary data for 2024-12. [2025-09-17T17:10:59.243019] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T17:10:59.246153] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-02. [2025-09-17T17:10:59.504977] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T17:10:59.511865] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-01. [2025-09-17T17:10:59.968967] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T17:10:59.972122] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-03. [2025-09-17T17:11:00.158157] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T17:11:00.186494] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-01. [2025-09-17T17:11:00.207874] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T17:11:00.219377] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-01. [2025-09-17T17:11:00.704851] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T17:11:00.708381] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-04. [2025-09-17T17:11:00.827148] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T17:11:00.833452] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-02. [2025-09-17T17:11:01.590148] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T17:11:01.610829] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-05. [2025-09-17T17:11:01.682192] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T17:11:02.022188] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-02. [2025-09-17T17:11:02.025907] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T17:11:02.213980] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T17:11:02.236859] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T17:11:02.815780] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-02. [2025-09-17T17:11:03.470478] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T17:11:03.615783] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-03. [2025-09-17T17:11:04.415810] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-03. [2025-09-17T17:11:04.649068] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T17:11:05.112325] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T17:11:05.215794] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-03. [2025-09-17T17:11:05.484171] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T17:11:06.015783] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-04. [2025-09-17T17:11:06.815789] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-06. [2025-09-17T17:11:07.009148] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T17:11:07.495347] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T17:11:07.516304] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T17:11:07.615800] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-04. [2025-09-17T17:11:08.415810] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-04. [2025-09-17T17:11:09.000631] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T17:11:09.216004] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-05. [2025-09-17T17:11:10.015814] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-07. [2025-09-17T17:11:10.361896] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T17:11:10.462696] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T17:11:10.806037] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T17:11:10.815678] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-08. [2025-09-17T17:11:11.381159] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T17:11:11.615835] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-06. [2025-09-17T17:11:12.415809] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-05. [2025-09-17T17:11:12.898773] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T17:11:13.215781] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-07. [2025-09-17T17:11:14.015760] [INFO ] [REMOTE ] ALG: Fetching primary data for 2025-09. [2025-09-17T17:11:14.110517] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T17:11:14.746291] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T17:11:14.815733] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-08. [2025-09-17T17:11:14.839271] [INFO ] [REMOTE ] ALG: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T17:11:14.840756] [INFO ] [REMOTE ] ALG: Full fetch complete (15773 records). [2025-09-17T17:11:14.840858] [DEBUG] [VALIDATOR ] ALG: Validating primary data. [2025-09-17T17:11:15.212047] [DEBUG] [VALIDATOR ] ALG: All expected trading days are present. [2025-09-17T17:11:15.212124] [DEBUG] [VALIDATOR ] ALG: Primary data validation passed. [2025-09-17T17:11:15.212381] [INFO ] [MAIN ] ALG: Fetched primary data is valid. [2025-09-17T17:11:15.212444] [DEBUG] [LOCAL ] ALG: Saving primary data. [2025-09-17T17:11:15.212982] [DEBUG] [LOCAL ] ALG: Trimmed 15773 records to 10693 (keeping 200 days of data) [2025-09-17T17:11:15.283422] [DEBUG] [LOCAL ] ALG: Primary data saved (10693 records). [2025-09-17T17:11:15.283628] [INFO ] [MAIN ] ALG: Full history saved. [2025-09-17T17:11:15.283767] [INFO ] [MAIN ] Update Progress: 81/2371 symbols completed. ALG took 21.3s. Estimated remaining: 5h 17m 18s. Rate: 7.2 symbols/min [2025-09-17T17:11:15.457258] [INFO ] [MAIN ] ALL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:11:15.517237] [DEBUG] [LOCAL ] ALL: Loaded 50196 existing records from primary storage. [2025-09-17T17:11:15.517420] [INFO ] [MAIN ] ALL: Loaded 50196 existing records. [2025-09-17T17:11:15.623397] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-05. [2025-09-17T17:11:15.717117] [WARN ] [MAIN ] ALL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:11:15.717428] [INFO ] [MAIN ] ALL: Wiping existing primary data before full refresh. [2025-09-17T17:11:15.717490] [INFO ] [LOCAL ] ALL: Starting deletion of primary data. [2025-09-17T17:11:15.718626] [DEBUG] [LOCAL ] ALL: Deleted primary data file. [2025-09-17T17:11:15.718720] [INFO ] [MAIN ] ALL: Starting full primary refresh. [2025-09-17T17:11:16.102682] [INFO ] [REMOTE ] ALL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:11:16.121004] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T17:11:16.415787] [INFO ] [REMOTE ] ALEX: Fetching primary data for 2025-09. [2025-09-17T17:11:17.215791] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-06. [2025-09-17T17:11:17.592473] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T17:11:17.687009] [INFO ] [REMOTE ] ALEX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T17:11:17.692518] [INFO ] [REMOTE ] ALEX: Full fetch complete (43985 records). [2025-09-17T17:11:17.692687] [DEBUG] [VALIDATOR ] ALEX: Validating primary data. [2025-09-17T17:11:17.693365] [FATAL] [VALIDATOR ] ALEX: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:11:17.693445] [FATAL] [MAIN ] ALEX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:11:17.693496] [WARN ] [MAIN ] ALEX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:11:17.693538] [INFO ] [LOCAL ] ALEX: Starting deletion of primary data. [2025-09-17T17:11:17.693598] [DEBUG] [LOCAL ] ALEX: No primary data file found to delete. [2025-09-17T17:11:17.693667] [INFO ] [LOCAL ] ALEX: Starting deletion of derivative data. [2025-09-17T17:11:17.694013] [DEBUG] [LOCAL ] ALEX: Deleted derivative data file. [2025-09-17T17:11:17.694118] [INFO ] [MAIN ] Update Progress: 82/2371 symbols completed. ALEX took 23.8s. Estimated remaining: 5h 14m 25s. Rate: 7.3 symbols/min [2025-09-17T17:11:17.895386] [INFO ] [MAIN ] ALLE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:11:17.946339] [DEBUG] [LOCAL ] ALLE: Loaded 45257 existing records from primary storage. [2025-09-17T17:11:17.946506] [INFO ] [MAIN ] ALLE: Loaded 45257 existing records. [2025-09-17T17:11:18.022792] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-06. [2025-09-17T17:11:18.132483] [WARN ] [MAIN ] ALLE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:11:18.132757] [INFO ] [MAIN ] ALLE: Wiping existing primary data before full refresh. [2025-09-17T17:11:18.132808] [INFO ] [LOCAL ] ALLE: Starting deletion of primary data. [2025-09-17T17:11:18.134254] [DEBUG] [LOCAL ] ALLE: Deleted primary data file. [2025-09-17T17:11:18.134311] [INFO ] [MAIN ] ALLE: Starting full primary refresh. [2025-09-17T17:11:18.499040] [INFO ] [REMOTE ] ALLE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:11:18.529929] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T17:11:18.815798] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-11. [2025-09-17T17:11:19.615801] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-11. [2025-09-17T17:11:19.852056] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T17:11:20.415767] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-07. [2025-09-17T17:11:20.500210] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T17:11:21.215816] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-07. [2025-09-17T17:11:21.363808] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T17:11:21.995837] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T17:11:22.015761] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-08. [2025-09-17T17:11:22.815809] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2024-12. [2025-09-17T17:11:22.864510] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T17:11:23.454028] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T17:11:23.615780] [INFO ] [REMOTE ] ALK: Fetching primary data for 2025-09. [2025-09-17T17:11:24.383964] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T17:11:24.415755] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-01. [2025-09-17T17:11:25.215804] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-08. [2025-09-17T17:11:25.424051] [INFO ] [REMOTE ] ALK: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T17:11:25.430879] [INFO ] [REMOTE ] ALK: Full fetch complete (76584 records). [2025-09-17T17:11:25.430999] [DEBUG] [VALIDATOR ] ALK: Validating primary data. [2025-09-17T17:11:25.828057] [DEBUG] [VALIDATOR ] ALK: All expected trading days are present. [2025-09-17T17:11:25.828214] [DEBUG] [VALIDATOR ] ALK: Primary data validation passed. [2025-09-17T17:11:25.828974] [INFO ] [MAIN ] ALK: Fetched primary data is valid. [2025-09-17T17:11:25.829023] [DEBUG] [LOCAL ] ALK: Saving primary data. [2025-09-17T17:11:25.830540] [DEBUG] [LOCAL ] ALK: Trimmed 76584 records to 53066 (keeping 200 days of data) [2025-09-17T17:11:26.038378] [INFO ] [REMOTE ] ALL: Fetching primary data for 2024-12. [2025-09-17T17:11:26.185402] [DEBUG] [LOCAL ] ALK: Primary data saved (53066 records). [2025-09-17T17:11:26.186275] [INFO ] [MAIN ] ALK: Full history saved. [2025-09-17T17:11:26.188968] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T17:11:26.187710] [INFO ] [MAIN ] Update Progress: 83/2371 symbols completed. ALK took 32.3s. Estimated remaining: 5h 14m 23s. Rate: 7.3 symbols/min [2025-09-17T17:11:26.374049] [INFO ] [MAIN ] ALLY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:11:26.431716] [DEBUG] [LOCAL ] ALLY: Loaded 53217 existing records from primary storage. [2025-09-17T17:11:26.431931] [INFO ] [MAIN ] ALLY: Loaded 53217 existing records. [2025-09-17T17:11:26.610215] [WARN ] [MAIN ] ALLY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:11:26.610505] [INFO ] [MAIN ] ALLY: Wiping existing primary data before full refresh. [2025-09-17T17:11:26.610553] [INFO ] [LOCAL ] ALLY: Starting deletion of primary data. [2025-09-17T17:11:26.611702] [DEBUG] [LOCAL ] ALLY: Deleted primary data file. [2025-09-17T17:11:26.611761] [INFO ] [MAIN ] ALLY: Starting full primary refresh. [2025-09-17T17:11:26.830134] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-02. [2025-09-17T17:11:26.976497] [INFO ] [REMOTE ] ALLY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:11:27.009285] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T17:11:27.546903] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T17:11:27.615775] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-11. [2025-09-17T17:11:28.415832] [INFO ] [REMOTE ] ALIT: Fetching primary data for 2025-09. [2025-09-17T17:11:28.469704] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T17:11:29.215770] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-03. [2025-09-17T17:11:29.453443] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T17:11:30.015789] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2024-12. [2025-09-17T17:11:30.131925] [INFO ] [REMOTE ] ALIT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T17:11:30.142461] [INFO ] [REMOTE ] ALIT: Full fetch complete (76239 records). [2025-09-17T17:11:30.142678] [DEBUG] [VALIDATOR ] ALIT: Validating primary data. [2025-09-17T17:11:30.545779] [DEBUG] [VALIDATOR ] ALIT: All expected trading days are present. [2025-09-17T17:11:30.545859] [DEBUG] [VALIDATOR ] ALIT: Primary data validation passed. [2025-09-17T17:11:30.546582] [INFO ] [MAIN ] ALIT: Fetched primary data is valid. [2025-09-17T17:11:30.546623] [DEBUG] [LOCAL ] ALIT: Saving primary data. [2025-09-17T17:11:30.548071] [DEBUG] [LOCAL ] ALIT: Trimmed 76239 records to 52727 (keeping 200 days of data) [2025-09-17T17:11:30.815860] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-01. [2025-09-17T17:11:30.858812] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T17:11:30.911744] [DEBUG] [LOCAL ] ALIT: Primary data saved (52727 records). [2025-09-17T17:11:30.911902] [INFO ] [MAIN ] ALIT: Full history saved. [2025-09-17T17:11:30.912895] [INFO ] [MAIN ] Update Progress: 84/2371 symbols completed. ALIT took 37.0s. Estimated remaining: 5h 12m 39s. Rate: 7.3 symbols/min [2025-09-17T17:11:31.083782] [INFO ] [MAIN ] ALSN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:11:31.127777] [DEBUG] [LOCAL ] ALSN: Loaded 43400 existing records from primary storage. [2025-09-17T17:11:31.127914] [INFO ] [MAIN ] ALSN: Loaded 43400 existing records. [2025-09-17T17:11:31.303058] [WARN ] [MAIN ] ALSN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:11:31.303313] [INFO ] [MAIN ] ALSN: Wiping existing primary data before full refresh. [2025-09-17T17:11:31.303356] [INFO ] [LOCAL ] ALSN: Starting deletion of primary data. [2025-09-17T17:11:31.304315] [DEBUG] [LOCAL ] ALSN: Deleted primary data file. [2025-09-17T17:11:31.304365] [INFO ] [MAIN ] ALSN: Starting full primary refresh. [2025-09-17T17:11:31.627342] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-04. [2025-09-17T17:11:31.660201] [INFO ] [REMOTE ] ALSN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:11:31.697203] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T17:11:32.415752] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-01. [2025-09-17T17:11:32.675526] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T17:11:33.215811] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-02. [2025-09-17T17:11:33.267873] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T17:11:34.015850] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-11. [2025-09-17T17:11:34.172566] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T17:11:34.616460] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T17:11:34.815827] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-05. [2025-09-17T17:11:35.555133] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T17:11:35.615801] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2024-12. [2025-09-17T17:11:36.392004] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T17:11:36.415721] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-06. [2025-09-17T17:11:37.099996] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T17:11:37.215778] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-01. [2025-09-17T17:11:37.936905] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T17:11:38.015790] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-07. [2025-09-17T17:11:38.528812] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T17:11:38.815822] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-02. [2025-09-17T17:11:39.615787] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-03. [2025-09-17T17:11:39.735522] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T17:11:40.415846] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-02. [2025-09-17T17:11:40.610676] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T17:11:41.093994] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T17:11:41.215779] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-04. [2025-09-17T17:11:42.015781] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-08. [2025-09-17T17:11:42.062321] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T17:11:42.815837] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-03. [2025-09-17T17:11:43.107206] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T17:11:43.615887] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-03. [2025-09-17T17:11:43.762557] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T17:11:44.226627] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T17:11:44.415814] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-04. [2025-09-17T17:11:45.032178] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T17:11:45.215814] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-04. [2025-09-17T17:11:45.913289] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T17:11:46.015802] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-05. [2025-09-17T17:11:46.543274] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T17:11:46.815780] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-05. [2025-09-17T17:11:47.615798] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-05. [2025-09-17T17:11:47.700843] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T17:11:48.303849] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T17:11:48.415785] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-06. [2025-09-17T17:11:49.215856] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-06. [2025-09-17T17:11:49.341717] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T17:11:50.015804] [INFO ] [REMOTE ] ALLE: Fetching primary data for 2025-09. [2025-09-17T17:11:50.640818] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-06 (2.23 seconds). [2025-09-17T17:11:50.815806] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-06. [2025-09-17T17:11:50.929511] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T17:11:51.615766] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-07. [2025-09-17T17:11:51.638231] [INFO ] [REMOTE ] ALLE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T17:11:51.644375] [INFO ] [REMOTE ] ALLE: Full fetch complete (64941 records). [2025-09-17T17:11:51.644504] [DEBUG] [VALIDATOR ] ALLE: Validating primary data. [2025-09-17T17:11:52.035029] [DEBUG] [VALIDATOR ] ALLE: All expected trading days are present. [2025-09-17T17:11:52.035119] [DEBUG] [VALIDATOR ] ALLE: Primary data validation passed. [2025-09-17T17:11:52.035852] [INFO ] [MAIN ] ALLE: Fetched primary data is valid. [2025-09-17T17:11:52.035899] [DEBUG] [LOCAL ] ALLE: Saving primary data. [2025-09-17T17:11:52.037323] [DEBUG] [LOCAL ] ALLE: Trimmed 64941 records to 45276 (keeping 200 days of data) [2025-09-17T17:11:52.354566] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T17:11:52.375313] [DEBUG] [LOCAL ] ALLE: Primary data saved (45276 records). [2025-09-17T17:11:52.375460] [INFO ] [MAIN ] ALLE: Full history saved. [2025-09-17T17:11:52.375554] [INFO ] [MAIN ] Update Progress: 85/2371 symbols completed. ALLE took 34.7s. Estimated remaining: 5h 18m 28s. Rate: 7.2 symbols/min [2025-09-17T17:11:52.420838] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-07. [2025-09-17T17:11:52.545851] [INFO ] [MAIN ] ALTG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:11:52.567870] [DEBUG] [LOCAL ] ALTG: Loaded 24291 existing records from primary storage. [2025-09-17T17:11:52.567996] [INFO ] [MAIN ] ALTG: Loaded 24291 existing records. [2025-09-17T17:11:52.745119] [WARN ] [MAIN ] ALTG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:11:52.745448] [INFO ] [MAIN ] ALTG: Wiping existing primary data before full refresh. [2025-09-17T17:11:52.745515] [INFO ] [LOCAL ] ALTG: Starting deletion of primary data. [2025-09-17T17:11:52.746171] [DEBUG] [LOCAL ] ALTG: Deleted primary data file. [2025-09-17T17:11:52.746225] [INFO ] [MAIN ] ALTG: Starting full primary refresh. [2025-09-17T17:11:53.084250] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T17:11:53.145892] [INFO ] [REMOTE ] ALTG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:11:53.215734] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-08. [2025-09-17T17:11:54.015805] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-11. [2025-09-17T17:11:54.375498] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T17:11:54.698812] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T17:11:54.815752] [INFO ] [REMOTE ] ALSN: Fetching primary data for 2025-09. [2025-09-17T17:11:55.412279] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T17:11:55.615789] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2024-12. [2025-09-17T17:11:56.345534] [INFO ] [REMOTE ] ALSN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T17:11:56.351738] [INFO ] [REMOTE ] ALSN: Full fetch complete (61697 records). [2025-09-17T17:11:56.351858] [DEBUG] [VALIDATOR ] ALSN: Validating primary data. [2025-09-17T17:11:56.420858] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-08. [2025-09-17T17:11:56.751700] [DEBUG] [VALIDATOR ] ALSN: All expected trading days are present. [2025-09-17T17:11:56.751791] [DEBUG] [VALIDATOR ] ALSN: Primary data validation passed. [2025-09-17T17:11:56.752398] [INFO ] [MAIN ] ALSN: Fetched primary data is valid. [2025-09-17T17:11:56.752451] [DEBUG] [LOCAL ] ALSN: Saving primary data. [2025-09-17T17:11:56.766994] [DEBUG] [LOCAL ] ALSN: Trimmed 61697 records to 43370 (keeping 200 days of data) [2025-09-17T17:11:56.767481] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T17:11:57.039637] [DEBUG] [LOCAL ] ALSN: Primary data saved (43370 records). [2025-09-17T17:11:57.039794] [INFO ] [MAIN ] ALSN: Full history saved. [2025-09-17T17:11:57.040657] [INFO ] [MAIN ] Update Progress: 86/2371 symbols completed. ALSN took 26.1s. Estimated remaining: 5h 16m 41s. Rate: 7.2 symbols/min [2025-09-17T17:11:57.210594] [INFO ] [MAIN ] ALUR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:11:57.217806] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-01. [2025-09-17T17:11:57.224822] [DEBUG] [LOCAL ] ALUR: Loaded 11175 existing records from primary storage. [2025-09-17T17:11:57.224978] [INFO ] [MAIN ] ALUR: Loaded 11175 existing records. [2025-09-17T17:11:57.414971] [WARN ] [MAIN ] ALUR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:11:57.415245] [INFO ] [MAIN ] ALUR: Wiping existing primary data before full refresh. [2025-09-17T17:11:57.415293] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-17T17:11:57.415706] [DEBUG] [LOCAL ] ALUR: Deleted primary data file. [2025-09-17T17:11:57.415758] [INFO ] [MAIN ] ALUR: Starting full primary refresh. [2025-09-17T17:11:57.782071] [INFO ] [REMOTE ] ALUR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:11:57.944975] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T17:11:58.015742] [INFO ] [REMOTE ] ALLY: Fetching primary data for 2025-09. [2025-09-17T17:11:58.255955] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T17:11:58.815794] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-02. [2025-09-17T17:11:59.615770] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-07. [2025-09-17T17:11:59.705021] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T17:11:59.824084] [INFO ] [REMOTE ] ALLY: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T17:11:59.831007] [INFO ] [REMOTE ] ALLY: Full fetch complete (76720 records). [2025-09-17T17:11:59.831159] [DEBUG] [VALIDATOR ] ALLY: Validating primary data. [2025-09-17T17:12:00.223683] [DEBUG] [VALIDATOR ] ALLY: All expected trading days are present. [2025-09-17T17:12:00.223792] [DEBUG] [VALIDATOR ] ALLY: Primary data validation passed. [2025-09-17T17:12:00.224555] [INFO ] [MAIN ] ALLY: Fetched primary data is valid. [2025-09-17T17:12:00.224602] [DEBUG] [LOCAL ] ALLY: Saving primary data. [2025-09-17T17:12:00.226185] [DEBUG] [LOCAL ] ALLY: Trimmed 76720 records to 53219 (keeping 200 days of data) [2025-09-17T17:12:00.416257] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-11. [2025-09-17T17:12:00.555798] [DEBUG] [LOCAL ] ALLY: Primary data saved (53219 records). [2025-09-17T17:12:00.555971] [INFO ] [MAIN ] ALLY: Full history saved. [2025-09-17T17:12:00.556689] [INFO ] [MAIN ] Update Progress: 87/2371 symbols completed. ALLY took 34.4s. Estimated remaining: 5h 14m 27s. Rate: 7.3 symbols/min [2025-09-17T17:12:00.722787] [INFO ] [MAIN ] ALV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:12:00.765562] [DEBUG] [LOCAL ] ALV: Loaded 42973 existing records from primary storage. [2025-09-17T17:12:00.765716] [INFO ] [MAIN ] ALV: Loaded 42973 existing records. [2025-09-17T17:12:00.941763] [WARN ] [MAIN ] ALV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:12:00.941986] [INFO ] [MAIN ] ALV: Wiping existing primary data before full refresh. [2025-09-17T17:12:00.942071] [INFO ] [LOCAL ] ALV: Starting deletion of primary data. [2025-09-17T17:12:00.943047] [DEBUG] [LOCAL ] ALV: Deleted primary data file. [2025-09-17T17:12:00.943103] [INFO ] [MAIN ] ALV: Starting full primary refresh. [2025-09-17T17:12:01.216595] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-03. [2025-09-17T17:12:01.340078] [INFO ] [REMOTE ] ALV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:12:01.431744] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T17:12:01.847760] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T17:12:02.015744] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-11. [2025-09-17T17:12:02.110739] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T17:12:02.815789] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-08. [2025-09-17T17:12:03.615790] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-04. [2025-09-17T17:12:03.718143] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T17:12:04.127404] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T17:12:04.415767] [INFO ] [REMOTE ] ALV: Fetching primary data for 2024-12. [2025-09-17T17:12:04.848203] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T17:12:05.215814] [INFO ] [REMOTE ] ALL: Fetching primary data for 2025-09. [2025-09-17T17:12:06.007768] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T17:12:06.015893] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2024-12. [2025-09-17T17:12:06.815798] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-01. [2025-09-17T17:12:07.068812] [INFO ] [REMOTE ] ALL: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T17:12:07.076222] [INFO ] [REMOTE ] ALL: Full fetch complete (72301 records). [2025-09-17T17:12:07.076428] [DEBUG] [VALIDATOR ] ALL: Validating primary data. [2025-09-17T17:12:07.477142] [DEBUG] [VALIDATOR ] ALL: All expected trading days are present. [2025-09-17T17:12:07.477356] [DEBUG] [VALIDATOR ] ALL: Primary data validation passed. [2025-09-17T17:12:07.478105] [INFO ] [MAIN ] ALL: Fetched primary data is valid. [2025-09-17T17:12:07.478165] [DEBUG] [LOCAL ] ALL: Saving primary data. [2025-09-17T17:12:07.493626] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T17:12:07.499608] [DEBUG] [LOCAL ] ALL: Trimmed 72301 records to 50203 (keeping 200 days of data) [2025-09-17T17:12:07.621063] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-01. [2025-09-17T17:12:07.825785] [DEBUG] [LOCAL ] ALL: Primary data saved (50203 records). [2025-09-17T17:12:07.825924] [INFO ] [MAIN ] ALL: Full history saved. [2025-09-17T17:12:07.826523] [INFO ] [MAIN ] Update Progress: 88/2371 symbols completed. ALL took 52.5s. Estimated remaining: 5h 13m 53s. Rate: 7.3 symbols/min [2025-09-17T17:12:07.995423] [INFO ] [MAIN ] ALX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:12:08.005749] [DEBUG] [LOCAL ] ALX: Loaded 5730 existing records from primary storage. [2025-09-17T17:12:08.005920] [INFO ] [MAIN ] ALX: Loaded 5730 existing records. [2025-09-17T17:12:08.188467] [WARN ] [MAIN ] ALX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:12:08.188747] [INFO ] [MAIN ] ALX: Wiping existing primary data before full refresh. [2025-09-17T17:12:08.188792] [INFO ] [LOCAL ] ALX: Starting deletion of primary data. [2025-09-17T17:12:08.189141] [DEBUG] [LOCAL ] ALX: Deleted primary data file. [2025-09-17T17:12:08.189186] [INFO ] [MAIN ] ALX: Starting full primary refresh. [2025-09-17T17:12:08.420862] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-05. [2025-09-17T17:12:08.547094] [INFO ] [REMOTE ] ALX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:12:08.574516] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T17:12:09.036553] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T17:12:09.215804] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-02. [2025-09-17T17:12:09.622243] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T17:12:10.015754] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-02. [2025-09-17T17:12:10.371413] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T17:12:10.815857] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-06. [2025-09-17T17:12:11.523039] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T17:12:11.615796] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-03. [2025-09-17T17:12:11.983045] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T17:12:12.415822] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-03. [2025-09-17T17:12:13.215805] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-07. [2025-09-17T17:12:13.387350] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T17:12:13.655736] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T17:12:14.015779] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-11. [2025-09-17T17:12:14.360563] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T17:12:14.568717] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T17:12:14.815811] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-04. [2025-09-17T17:12:15.615798] [INFO ] [REMOTE ] ALX: Fetching primary data for 2024-12. [2025-09-17T17:12:15.691137] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T17:12:16.198835] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T17:12:16.415857] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-05. [2025-09-17T17:12:17.215755] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-01. [2025-09-17T17:12:17.544682] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T17:12:17.820840] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T17:12:18.015904] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-02. [2025-09-17T17:12:18.525970] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T17:12:18.815808] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-06. [2025-09-17T17:12:19.615781] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-08. [2025-09-17T17:12:19.623172] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T17:12:20.415805] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-04. [2025-09-17T17:12:20.883530] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T17:12:21.215778] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-07. [2025-09-17T17:12:22.015795] [INFO ] [REMOTE ] ALTG: Fetching primary data for 2025-09. [2025-09-17T17:12:22.067562] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T17:12:22.147901] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T17:12:22.815810] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-08. [2025-09-17T17:12:23.232752] [INFO ] [REMOTE ] ALTG: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T17:12:23.236413] [INFO ] [REMOTE ] ALTG: Full fetch complete (33525 records). [2025-09-17T17:12:23.236496] [DEBUG] [VALIDATOR ] ALTG: Validating primary data. [2025-09-17T17:12:23.550940] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T17:12:23.626011] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-03. [2025-09-17T17:12:23.641597] [DEBUG] [VALIDATOR ] ALTG: All expected trading days are present. [2025-09-17T17:12:23.641671] [DEBUG] [VALIDATOR ] ALTG: Primary data validation passed. [2025-09-17T17:12:23.642072] [INFO ] [MAIN ] ALTG: Fetched primary data is valid. [2025-09-17T17:12:23.642113] [DEBUG] [LOCAL ] ALTG: Saving primary data. [2025-09-17T17:12:23.642983] [DEBUG] [LOCAL ] ALTG: Trimmed 33525 records to 24306 (keeping 200 days of data) [2025-09-17T17:12:23.779794] [DEBUG] [LOCAL ] ALTG: Primary data saved (24306 records). [2025-09-17T17:12:23.779924] [INFO ] [MAIN ] ALTG: Full history saved. [2025-09-17T17:12:23.780005] [INFO ] [MAIN ] Update Progress: 89/2371 symbols completed. ALTG took 31.4s. Estimated remaining: 5h 17m 2s. Rate: 7.2 symbols/min [2025-09-17T17:12:23.950929] [INFO ] [MAIN ] AM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:12:24.006974] [DEBUG] [LOCAL ] AM: Loaded 52184 existing records from primary storage. [2025-09-17T17:12:24.007088] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-17T17:12:24.008376] [INFO ] [MAIN ] AM: Loaded 52184 existing records. [2025-09-17T17:12:24.191532] [WARN ] [MAIN ] AM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:12:24.191829] [INFO ] [MAIN ] AM: Wiping existing primary data before full refresh. [2025-09-17T17:12:24.191893] [INFO ] [LOCAL ] AM: Starting deletion of primary data. [2025-09-17T17:12:24.193076] [DEBUG] [LOCAL ] AM: Deleted primary data file. [2025-09-17T17:12:24.193133] [INFO ] [MAIN ] AM: Starting full primary refresh. [2025-09-17T17:12:24.415845] [INFO ] [REMOTE ] ALUR: Fetching primary data for 2025-09. [2025-09-17T17:12:24.596195] [INFO ] [REMOTE ] AM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:12:25.142387] [INFO ] [REMOTE ] ALUR: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T17:12:25.144828] [INFO ] [REMOTE ] ALUR: Full fetch complete (21730 records). [2025-09-17T17:12:25.144920] [DEBUG] [VALIDATOR ] ALUR: Validating primary data. [2025-09-17T17:12:25.145430] [FATAL] [VALIDATOR ] ALUR: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:12:25.145545] [FATAL] [MAIN ] ALUR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:12:25.145596] [WARN ] [MAIN ] ALUR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:12:25.145692] [INFO ] [LOCAL ] ALUR: Starting deletion of primary data. [2025-09-17T17:12:25.145776] [DEBUG] [LOCAL ] ALUR: No primary data file found to delete. [2025-09-17T17:12:25.145823] [INFO ] [LOCAL ] ALUR: Starting deletion of derivative data. [2025-09-17T17:12:25.146180] [DEBUG] [LOCAL ] ALUR: Deleted derivative data file. [2025-09-17T17:12:25.146315] [INFO ] [MAIN ] Update Progress: 90/2371 symbols completed. ALUR took 28.1s. Estimated remaining: 5h 13m 57s. Rate: 7.3 symbols/min [2025-09-17T17:12:25.220867] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-04. [2025-09-17T17:12:25.331767] [INFO ] [MAIN ] AMBC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:12:25.371474] [DEBUG] [LOCAL ] AMBC: Loaded 37826 existing records from primary storage. [2025-09-17T17:12:25.371676] [INFO ] [MAIN ] AMBC: Loaded 37826 existing records. [2025-09-17T17:12:25.548683] [WARN ] [MAIN ] AMBC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:12:25.548932] [INFO ] [MAIN ] AMBC: Wiping existing primary data before full refresh. [2025-09-17T17:12:25.548976] [INFO ] [LOCAL ] AMBC: Starting deletion of primary data. [2025-09-17T17:12:25.549751] [DEBUG] [LOCAL ] AMBC: Deleted primary data file. [2025-09-17T17:12:25.549812] [INFO ] [MAIN ] AMBC: Starting full primary refresh. [2025-09-17T17:12:25.913069] [INFO ] [REMOTE ] AMBC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:12:25.922412] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T17:12:26.015791] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-05. [2025-09-17T17:12:26.623394] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T17:12:26.815800] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-06. [2025-09-17T17:12:27.615804] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-05. [2025-09-17T17:12:27.695026] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T17:12:28.415784] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-11. [2025-09-17T17:12:29.080554] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T17:12:29.215804] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-07. [2025-09-17T17:12:29.841979] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T17:12:29.857864] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T17:12:30.015792] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2024-12. [2025-09-17T17:12:30.815766] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-08. [2025-09-17T17:12:31.264585] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T17:12:31.453404] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T17:12:31.615782] [INFO ] [REMOTE ] ALX: Fetching primary data for 2025-09. [2025-09-17T17:12:32.415747] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-01. [2025-09-17T17:12:32.628035] [INFO ] [REMOTE ] ALX: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T17:12:32.629575] [INFO ] [REMOTE ] ALX: Full fetch complete (6636 records). [2025-09-17T17:12:32.629664] [DEBUG] [VALIDATOR ] ALX: Validating primary data. [2025-09-17T17:12:33.002403] [DEBUG] [VALIDATOR ] ALX: All expected trading days are present. [2025-09-17T17:12:33.002524] [DEBUG] [VALIDATOR ] ALX: Primary data validation passed. [2025-09-17T17:12:33.002729] [INFO ] [MAIN ] ALX: Fetched primary data is valid. [2025-09-17T17:12:33.002773] [DEBUG] [LOCAL ] ALX: Saving primary data. [2025-09-17T17:12:33.003203] [DEBUG] [LOCAL ] ALX: Trimmed 6636 records to 5780 (keeping 200 days of data) [2025-09-17T17:12:33.041387] [DEBUG] [LOCAL ] ALX: Primary data saved (5780 records). [2025-09-17T17:12:33.041523] [INFO ] [MAIN ] ALX: Full history saved. [2025-09-17T17:12:33.041608] [INFO ] [MAIN ] Update Progress: 91/2371 symbols completed. ALX took 25.2s. Estimated remaining: 5h 13m 40s. Rate: 7.3 symbols/min [2025-09-17T17:12:33.213894] [INFO ] [MAIN ] AMBP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:12:33.215764] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-06. [2025-09-17T17:12:33.262566] [DEBUG] [LOCAL ] AMBP: Loaded 45373 existing records from primary storage. [2025-09-17T17:12:33.262741] [INFO ] [MAIN ] AMBP: Loaded 45373 existing records. [2025-09-17T17:12:33.445225] [WARN ] [MAIN ] AMBP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:12:33.445574] [INFO ] [MAIN ] AMBP: Wiping existing primary data before full refresh. [2025-09-17T17:12:33.445670] [INFO ] [LOCAL ] AMBP: Starting deletion of primary data. [2025-09-17T17:12:33.451940] [DEBUG] [LOCAL ] AMBP: Deleted primary data file. [2025-09-17T17:12:33.462495] [INFO ] [MAIN ] AMBP: Starting full primary refresh. [2025-09-17T17:12:33.469672] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T17:12:33.846891] [INFO ] [REMOTE ] AMBP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:12:34.015814] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-11. [2025-09-17T17:12:34.815784] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-02. [2025-09-17T17:12:34.912213] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T17:12:35.387496] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T17:12:35.615798] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-11. [2025-09-17T17:12:36.039616] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T17:12:36.415786] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-03. [2025-09-17T17:12:37.221720] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2024-12. [2025-09-17T17:12:37.234666] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T17:12:38.015792] [INFO ] [REMOTE ] AM: Fetching primary data for 2024-12. [2025-09-17T17:12:38.056597] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T17:12:38.798272] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T17:12:38.815720] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-01. [2025-09-17T17:12:39.395663] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T17:12:39.615807] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-04. [2025-09-17T17:12:39.935556] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T17:12:40.415810] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-02. [2025-09-17T17:12:41.215869] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-01. [2025-09-17T17:12:41.344566] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T17:12:41.944301] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T17:12:42.015768] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-05. [2025-09-17T17:12:42.815838] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-07. [2025-09-17T17:12:42.963981] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T17:12:43.553461] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T17:12:43.615795] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-06. [2025-09-17T17:12:44.415791] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-03. [2025-09-17T17:12:44.509866] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T17:12:44.737274] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T17:12:45.215810] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-08. [2025-09-17T17:12:46.021330] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-07. [2025-09-17T17:12:46.038732] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T17:12:46.815807] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-02. [2025-09-17T17:12:47.084330] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T17:12:47.549105] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T17:12:47.615839] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-08. [2025-09-17T17:12:48.415781] [INFO ] [REMOTE ] ALV: Fetching primary data for 2025-09. [2025-09-17T17:12:48.660265] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T17:12:48.961171] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T17:12:49.215779] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-04. [2025-09-17T17:12:49.690486] [INFO ] [REMOTE ] ALV: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T17:12:49.697711] [INFO ] [REMOTE ] ALV: Full fetch complete (61885 records). [2025-09-17T17:12:49.697846] [DEBUG] [VALIDATOR ] ALV: Validating primary data. [2025-09-17T17:12:50.020858] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-03. [2025-09-17T17:12:50.087889] [DEBUG] [VALIDATOR ] ALV: All expected trading days are present. [2025-09-17T17:12:50.087976] [DEBUG] [VALIDATOR ] ALV: Primary data validation passed. [2025-09-17T17:12:50.088608] [INFO ] [MAIN ] ALV: Fetched primary data is valid. [2025-09-17T17:12:50.088669] [DEBUG] [LOCAL ] ALV: Saving primary data. [2025-09-17T17:12:50.090094] [DEBUG] [LOCAL ] ALV: Trimmed 61885 records to 42962 (keeping 200 days of data) [2025-09-17T17:12:50.366513] [DEBUG] [LOCAL ] ALV: Primary data saved (42962 records). [2025-09-17T17:12:50.366658] [INFO ] [MAIN ] ALV: Full history saved. [2025-09-17T17:12:50.367270] [INFO ] [MAIN ] Update Progress: 92/2371 symbols completed. ALV took 49.8s. Estimated remaining: 5h 17m 16s. Rate: 7.2 symbols/min [2025-09-17T17:12:50.536416] [INFO ] [MAIN ] AMBQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:12:50.536610] [DEBUG] [LOCAL ] AMBQ: No existing data file found in primary storage. [2025-09-17T17:12:50.536666] [WARN ] [MAIN ] AMBQ: No existing data found, performing full refresh instead. [2025-09-17T17:12:50.536798] [INFO ] [MAIN ] AMBQ: Wiping existing primary data before full refresh. [2025-09-17T17:12:50.536837] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-17T17:12:50.536875] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-17T17:12:50.536906] [INFO ] [MAIN ] AMBQ: Starting full primary refresh. [2025-09-17T17:12:50.817204] [INFO ] [REMOTE ] AMBC: Fetching primary data for 2025-09. [2025-09-17T17:12:50.898944] [INFO ] [REMOTE ] AMBQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:12:50.925207] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T17:12:51.615792] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-11. [2025-09-17T17:12:51.873305] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T17:12:51.976540] [INFO ] [REMOTE ] AMBC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T17:12:51.981426] [INFO ] [REMOTE ] AMBC: Full fetch complete (50973 records). [2025-09-17T17:12:51.981544] [DEBUG] [VALIDATOR ] AMBC: Validating primary data. [2025-09-17T17:12:52.026059] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:12:52.059535] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-11 [2025-09-17T17:12:52.379417] [DEBUG] [VALIDATOR ] AMBC: All expected trading days are present. [2025-09-17T17:12:52.379542] [DEBUG] [VALIDATOR ] AMBC: Primary data validation passed. [2025-09-17T17:12:52.380623] [INFO ] [MAIN ] AMBC: Fetched primary data is valid. [2025-09-17T17:12:52.380762] [DEBUG] [LOCAL ] AMBC: Saving primary data. [2025-09-17T17:12:52.382550] [DEBUG] [LOCAL ] AMBC: Trimmed 50973 records to 37673 (keeping 200 days of data) [2025-09-17T17:12:52.453570] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-05. [2025-09-17T17:12:52.646937] [DEBUG] [LOCAL ] AMBC: Primary data saved (37673 records). [2025-09-17T17:12:52.647096] [INFO ] [MAIN ] AMBC: Full history saved. [2025-09-17T17:12:52.648106] [INFO ] [MAIN ] Update Progress: 93/2371 symbols completed. AMBC took 27.5s. Estimated remaining: 5h 14m 39s. Rate: 7.2 symbols/min [2025-09-17T17:12:52.827657] [INFO ] [MAIN ] AMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:12:52.884911] [DEBUG] [LOCAL ] AMC: Loaded 53757 existing records from primary storage. [2025-09-17T17:12:52.885064] [INFO ] [MAIN ] AMC: Loaded 53757 existing records. [2025-09-17T17:12:53.065788] [WARN ] [MAIN ] AMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:12:53.066088] [INFO ] [MAIN ] AMC: Wiping existing primary data before full refresh. [2025-09-17T17:12:53.066141] [INFO ] [LOCAL ] AMC: Starting deletion of primary data. [2025-09-17T17:12:53.067220] [DEBUG] [LOCAL ] AMC: Deleted primary data file. [2025-09-17T17:12:53.067271] [INFO ] [MAIN ] AMC: Starting full primary refresh. [2025-09-17T17:12:53.221263] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-04. [2025-09-17T17:12:53.439821] [INFO ] [REMOTE ] AMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:12:54.015826] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-11. [2025-09-17T17:12:54.226223] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T17:12:54.815846] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2024-12. [2025-09-17T17:12:55.140395] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T17:12:55.226552] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:12:55.226933] [WARN ] [REMOTE ] AMBQ: No data returned for month 2024-12 [2025-09-17T17:12:55.615797] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-06. [2025-09-17T17:12:56.415788] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-01. [2025-09-17T17:12:56.612485] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:12:56.616786] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-01 [2025-09-17T17:12:56.619343] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-11 (2.60 seconds). [2025-09-17T17:12:56.802293] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T17:12:57.215824] [INFO ] [REMOTE ] AMC: Fetching primary data for 2024-12. [2025-09-17T17:12:58.015829] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-07. [2025-09-17T17:12:58.815833] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-02. [2025-09-17T17:12:59.012442] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:12:59.012762] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-02 [2025-09-17T17:12:59.260047] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T17:12:59.615775] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-08. [2025-09-17T17:12:59.700402] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-17T17:13:00.415790] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-03. [2025-09-17T17:13:00.710789] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:13:00.711100] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-03 [2025-09-17T17:13:01.215819] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-05. [2025-09-17T17:13:01.356215] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T17:13:02.015794] [INFO ] [REMOTE ] AMBP: Fetching primary data for 2025-09. [2025-09-17T17:13:02.815779] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-04. [2025-09-17T17:13:03.053607] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:13:03.054000] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-04 [2025-09-17T17:13:03.177774] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T17:13:03.566460] [INFO ] [REMOTE ] AMBP: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T17:13:03.572293] [INFO ] [REMOTE ] AMBP: Full fetch complete (65798 records). [2025-09-17T17:13:03.572457] [DEBUG] [VALIDATOR ] AMBP: Validating primary data. [2025-09-17T17:13:03.620981] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-06. [2025-09-17T17:13:03.990479] [DEBUG] [VALIDATOR ] AMBP: All expected trading days are present. [2025-09-17T17:13:03.990598] [DEBUG] [VALIDATOR ] AMBP: Primary data validation passed. [2025-09-17T17:13:03.991299] [INFO ] [MAIN ] AMBP: Fetched primary data is valid. [2025-09-17T17:13:03.991347] [DEBUG] [LOCAL ] AMBP: Saving primary data. [2025-09-17T17:13:03.992796] [DEBUG] [LOCAL ] AMBP: Trimmed 65798 records to 45300 (keeping 200 days of data) [2025-09-17T17:13:04.258869] [DEBUG] [LOCAL ] AMBP: Primary data saved (45300 records). [2025-09-17T17:13:04.258996] [INFO ] [MAIN ] AMBP: Full history saved. [2025-09-17T17:13:04.261028] [INFO ] [MAIN ] Update Progress: 94/2371 symbols completed. AMBP took 31.2s. Estimated remaining: 5h 15m 52s. Rate: 7.2 symbols/min [2025-09-17T17:13:04.427845] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-01. [2025-09-17T17:13:04.430184] [INFO ] [MAIN ] AMCR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:13:04.491623] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-09-17T17:13:04.491804] [INFO ] [MAIN ] AMCR: Loaded 53669 existing records. [2025-09-17T17:13:04.695311] [WARN ] [MAIN ] AMCR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:13:04.695566] [INFO ] [MAIN ] AMCR: Wiping existing primary data before full refresh. [2025-09-17T17:13:04.695618] [INFO ] [LOCAL ] AMCR: Starting deletion of primary data. [2025-09-17T17:13:04.696915] [DEBUG] [LOCAL ] AMCR: Deleted primary data file. [2025-09-17T17:13:04.696966] [INFO ] [MAIN ] AMCR: Starting full primary refresh. [2025-09-17T17:13:05.080250] [INFO ] [REMOTE ] AMCR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:13:05.215780] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-11. [2025-09-17T17:13:05.450042] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T17:13:06.015789] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-07. [2025-09-17T17:13:06.815969] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-05. [2025-09-17T17:13:06.930412] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-01 (2.50 seconds). [2025-09-17T17:13:06.968508] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T17:13:07.082703] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:13:07.083056] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-05 [2025-09-17T17:13:07.615748] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2024-12. [2025-09-17T17:13:07.833429] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T17:13:08.415821] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-02. [2025-09-17T17:13:08.959347] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T17:13:09.215917] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-06. [2025-09-17T17:13:09.471340] [DEBUG] [REMOTE ] AMBQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:13:09.471778] [WARN ] [REMOTE ] AMBQ: No data returned for month 2025-06 [2025-09-17T17:13:10.015783] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-08. [2025-09-17T17:13:10.719291] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-02 (2.30 seconds). [2025-09-17T17:13:10.815771] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-03. [2025-09-17T17:13:11.615800] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-07. [2025-09-17T17:13:11.759354] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T17:13:12.160894] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T17:13:12.415827] [INFO ] [REMOTE ] AM: Fetching primary data for 2025-09. [2025-09-17T17:13:13.040238] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-17T17:13:13.215774] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-04. [2025-09-17T17:13:14.015784] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-08. [2025-09-17T17:13:14.113772] [INFO ] [REMOTE ] AM: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T17:13:14.120836] [INFO ] [REMOTE ] AM: Full fetch complete (75456 records). [2025-09-17T17:13:14.121005] [DEBUG] [VALIDATOR ] AM: Validating primary data. [2025-09-17T17:13:14.540655] [DEBUG] [VALIDATOR ] AM: All expected trading days are present. [2025-09-17T17:13:14.540741] [DEBUG] [VALIDATOR ] AM: Primary data validation passed. [2025-09-17T17:13:14.541467] [INFO ] [MAIN ] AM: Fetched primary data is valid. [2025-09-17T17:13:14.541509] [DEBUG] [LOCAL ] AM: Saving primary data. [2025-09-17T17:13:14.543026] [DEBUG] [LOCAL ] AM: Trimmed 75456 records to 52178 (keeping 200 days of data) [2025-09-17T17:13:14.840408] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-01. [2025-09-17T17:13:14.886529] [DEBUG] [LOCAL ] AM: Primary data saved (52178 records). [2025-09-17T17:13:14.886690] [INFO ] [MAIN ] AM: Full history saved. [2025-09-17T17:13:14.886818] [INFO ] [MAIN ] Update Progress: 95/2371 symbols completed. AM took 51.1s. Estimated remaining: 5h 16m 38s. Rate: 7.2 symbols/min [2025-09-17T17:13:15.061792] [INFO ] [MAIN ] AME: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:13:15.115530] [DEBUG] [LOCAL ] AME: Loaded 48589 existing records from primary storage. [2025-09-17T17:13:15.115702] [INFO ] [MAIN ] AME: Loaded 48589 existing records. [2025-09-17T17:13:15.300488] [WARN ] [MAIN ] AME: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:13:15.300894] [INFO ] [MAIN ] AME: Wiping existing primary data before full refresh. [2025-09-17T17:13:15.301018] [INFO ] [LOCAL ] AME: Starting deletion of primary data. [2025-09-17T17:13:15.302305] [DEBUG] [LOCAL ] AME: Deleted primary data file. [2025-09-17T17:13:15.302374] [INFO ] [MAIN ] AME: Starting full primary refresh. [2025-09-17T17:13:15.671938] [INFO ] [REMOTE ] AME: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:13:15.672381] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-11. [2025-09-17T17:13:15.692602] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T17:13:15.731344] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-17T17:13:16.415778] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-05. [2025-09-17T17:13:16.642530] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T17:13:17.215783] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-02. [2025-09-17T17:13:17.382621] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T17:13:18.015789] [INFO ] [REMOTE ] AME: Fetching primary data for 2024-12. [2025-09-17T17:13:18.815838] [INFO ] [REMOTE ] AMBQ: Fetching primary data for 2025-09. [2025-09-17T17:13:18.913682] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-17T17:13:19.005300] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T17:13:19.615769] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-03. [2025-09-17T17:13:19.721274] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T17:13:19.763896] [INFO ] [REMOTE ] AMBQ: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T17:13:19.767428] [INFO ] [REMOTE ] AMBQ: Full fetch complete (7137 records). [2025-09-17T17:13:19.767512] [DEBUG] [VALIDATOR ] AMBQ: Validating primary data. [2025-09-17T17:13:19.951862] [WARN ] [VALIDATOR ] AMBQ: Validation failed - insufficient historical data. Have 35 unique days, need 200 days [2025-09-17T17:13:19.952085] [FATAL] [MAIN ] AMBQ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:13:19.952144] [WARN ] [MAIN ] AMBQ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:13:19.952203] [INFO ] [LOCAL ] AMBQ: Starting deletion of primary data. [2025-09-17T17:13:19.952271] [DEBUG] [LOCAL ] AMBQ: No primary data file found to delete. [2025-09-17T17:13:19.952316] [INFO ] [LOCAL ] AMBQ: Starting deletion of derivative data. [2025-09-17T17:13:19.952360] [DEBUG] [LOCAL ] AMBQ: No derivative data file found to delete. [2025-09-17T17:13:19.952443] [INFO ] [MAIN ] Update Progress: 96/2371 symbols completed. AMBQ took 29.6s. Estimated remaining: 5h 15m 12s. Rate: 7.2 symbols/min [2025-09-17T17:13:20.129096] [INFO ] [MAIN ] AMG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:13:20.156351] [DEBUG] [LOCAL ] AMG: Loaded 20806 existing records from primary storage. [2025-09-17T17:13:20.156486] [INFO ] [MAIN ] AMG: Loaded 20806 existing records. [2025-09-17T17:13:20.344562] [WARN ] [MAIN ] AMG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:13:20.344936] [INFO ] [MAIN ] AMG: Wiping existing primary data before full refresh. [2025-09-17T17:13:20.344993] [INFO ] [LOCAL ] AMG: Starting deletion of primary data. [2025-09-17T17:13:20.345669] [DEBUG] [LOCAL ] AMG: Deleted primary data file. [2025-09-17T17:13:20.345718] [INFO ] [MAIN ] AMG: Starting full primary refresh. [2025-09-17T17:13:20.422771] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-01. [2025-09-17T17:13:20.718599] [INFO ] [REMOTE ] AMG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:13:21.071382] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T17:13:21.215773] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-04. [2025-09-17T17:13:22.015799] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-11. [2025-09-17T17:13:22.200122] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T17:13:22.815813] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-06. [2025-09-17T17:13:23.061263] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T17:13:23.426940] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T17:13:23.615778] [INFO ] [REMOTE ] AMG: Fetching primary data for 2024-12. [2025-09-17T17:13:24.415825] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-02. [2025-09-17T17:13:24.823743] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T17:13:25.073520] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-17T17:13:25.215815] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-07. [2025-09-17T17:13:25.806731] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T17:13:26.015774] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-03. [2025-09-17T17:13:26.815781] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-01. [2025-09-17T17:13:27.513968] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-17T17:13:27.615798] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-05. [2025-09-17T17:13:27.881202] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T17:13:27.937008] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T17:13:28.415854] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-02. [2025-09-17T17:13:29.215786] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-08. [2025-09-17T17:13:29.521094] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T17:13:29.632528] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T17:13:30.015780] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-06. [2025-09-17T17:13:30.815781] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-03. [2025-09-17T17:13:31.426515] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-17T17:13:31.615772] [INFO ] [REMOTE ] AMC: Fetching primary data for 2025-09. [2025-09-17T17:13:31.911102] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T17:13:31.935856] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T17:13:32.415778] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-04. [2025-09-17T17:13:33.215772] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-04. [2025-09-17T17:13:33.939272] [INFO ] [REMOTE ] AMC: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-17T17:13:33.946330] [INFO ] [REMOTE ] AMC: Full fetch complete (77923 records). [2025-09-17T17:13:33.946473] [DEBUG] [VALIDATOR ] AMC: Validating primary data. [2025-09-17T17:13:34.016946] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-07. [2025-09-17T17:13:34.378840] [DEBUG] [VALIDATOR ] AMC: All expected trading days are present. [2025-09-17T17:13:34.378976] [DEBUG] [VALIDATOR ] AMC: Primary data validation passed. [2025-09-17T17:13:34.379774] [INFO ] [MAIN ] AMC: Fetched primary data is valid. [2025-09-17T17:13:34.379898] [DEBUG] [LOCAL ] AMC: Saving primary data. [2025-09-17T17:13:34.381884] [DEBUG] [LOCAL ] AMC: Trimmed 77923 records to 53757 (keeping 200 days of data) [2025-09-17T17:13:34.495010] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T17:13:34.729268] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T17:13:34.754510] [DEBUG] [LOCAL ] AMC: Primary data saved (53757 records). [2025-09-17T17:13:34.754715] [INFO ] [MAIN ] AMC: Full history saved. [2025-09-17T17:13:34.754830] [INFO ] [MAIN ] Update Progress: 97/2371 symbols completed. AMC took 42.1s. Estimated remaining: 5h 17m 36s. Rate: 7.2 symbols/min [2025-09-17T17:13:34.821095] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-05. [2025-09-17T17:13:34.929169] [INFO ] [MAIN ] AMH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:13:34.977301] [DEBUG] [LOCAL ] AMH: Loaded 51703 existing records from primary storage. [2025-09-17T17:13:34.977473] [INFO ] [MAIN ] AMH: Loaded 51703 existing records. [2025-09-17T17:13:35.153562] [WARN ] [MAIN ] AMH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:13:35.153851] [INFO ] [MAIN ] AMH: Wiping existing primary data before full refresh. [2025-09-17T17:13:35.153896] [INFO ] [LOCAL ] AMH: Starting deletion of primary data. [2025-09-17T17:13:35.155107] [DEBUG] [LOCAL ] AMH: Deleted primary data file. [2025-09-17T17:13:35.155164] [INFO ] [MAIN ] AMH: Starting full primary refresh. [2025-09-17T17:13:35.518987] [INFO ] [REMOTE ] AMH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:13:35.606120] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T17:13:35.617719] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-05. [2025-09-17T17:13:36.415742] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-08. [2025-09-17T17:13:36.560109] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T17:13:36.820337] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T17:13:37.215778] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-06. [2025-09-17T17:13:38.015816] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-11. [2025-09-17T17:13:38.281585] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T17:13:38.815791] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-06. [2025-09-17T17:13:39.214080] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T17:13:39.467042] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T17:13:39.615894] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-07. [2025-09-17T17:13:39.736357] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T17:13:40.415783] [INFO ] [REMOTE ] AMH: Fetching primary data for 2024-12. [2025-09-17T17:13:40.506180] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T17:13:41.215846] [INFO ] [REMOTE ] AMCR: Fetching primary data for 2025-09. [2025-09-17T17:13:42.015782] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-07. [2025-09-17T17:13:42.815836] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-08. [2025-09-17T17:13:43.034007] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-17T17:13:43.429188] [INFO ] [REMOTE ] AMCR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-17T17:13:43.436475] [INFO ] [REMOTE ] AMCR: Full fetch complete (77513 records). [2025-09-17T17:13:43.436758] [DEBUG] [VALIDATOR ] AMCR: Validating primary data. [2025-09-17T17:13:43.634736] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-01. [2025-09-17T17:13:43.749697] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T17:13:43.868803] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T17:13:43.904491] [DEBUG] [VALIDATOR ] AMCR: All expected trading days are present. [2025-09-17T17:13:43.904729] [DEBUG] [VALIDATOR ] AMCR: Primary data validation passed. [2025-09-17T17:13:43.905659] [INFO ] [MAIN ] AMCR: Fetched primary data is valid. [2025-09-17T17:13:43.906100] [DEBUG] [LOCAL ] AMCR: Saving primary data. [2025-09-17T17:13:43.907838] [DEBUG] [LOCAL ] AMCR: Trimmed 77513 records to 53669 (keeping 200 days of data) [2025-09-17T17:13:44.238835] [DEBUG] [LOCAL ] AMCR: Primary data saved (53669 records). [2025-09-17T17:13:44.238975] [INFO ] [MAIN ] AMCR: Full history saved. [2025-09-17T17:13:44.239518] [INFO ] [MAIN ] Update Progress: 98/2371 symbols completed. AMCR took 40.0s. Estimated remaining: 5h 17m 53s. Rate: 7.2 symbols/min [2025-09-17T17:13:44.408033] [INFO ] [MAIN ] AMN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:13:44.415855] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-08. [2025-09-17T17:13:44.455030] [DEBUG] [LOCAL ] AMN: Loaded 42235 existing records from primary storage. [2025-09-17T17:13:44.455275] [INFO ] [MAIN ] AMN: Loaded 42235 existing records. [2025-09-17T17:13:44.636755] [WARN ] [MAIN ] AMN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:13:44.637014] [INFO ] [MAIN ] AMN: Wiping existing primary data before full refresh. [2025-09-17T17:13:44.637058] [INFO ] [LOCAL ] AMN: Starting deletion of primary data. [2025-09-17T17:13:44.638028] [DEBUG] [LOCAL ] AMN: Deleted primary data file. [2025-09-17T17:13:44.638079] [INFO ] [MAIN ] AMN: Starting full primary refresh. [2025-09-17T17:13:44.987617] [INFO ] [REMOTE ] AMN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:13:45.215754] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-11. [2025-09-17T17:13:45.394769] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T17:13:46.015842] [INFO ] [REMOTE ] AMG: Fetching primary data for 2025-09. [2025-09-17T17:13:46.065611] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T17:13:46.682511] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T17:13:46.815779] [INFO ] [REMOTE ] AMN: Fetching primary data for 2024-12. [2025-09-17T17:13:47.277635] [INFO ] [REMOTE ] AMG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T17:13:47.280851] [INFO ] [REMOTE ] AMG: Full fetch complete (29561 records). [2025-09-17T17:13:47.280945] [DEBUG] [VALIDATOR ] AMG: Validating primary data. [2025-09-17T17:13:47.620001] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-02. [2025-09-17T17:13:47.661900] [DEBUG] [VALIDATOR ] AMG: All expected trading days are present. [2025-09-17T17:13:47.661979] [DEBUG] [VALIDATOR ] AMG: Primary data validation passed. [2025-09-17T17:13:47.662347] [INFO ] [MAIN ] AMG: Fetched primary data is valid. [2025-09-17T17:13:47.662387] [DEBUG] [LOCAL ] AMG: Saving primary data. [2025-09-17T17:13:47.664126] [DEBUG] [LOCAL ] AMG: Trimmed 29561 records to 20838 (keeping 200 days of data) [2025-09-17T17:13:47.798358] [DEBUG] [LOCAL ] AMG: Primary data saved (20838 records). [2025-09-17T17:13:47.798487] [INFO ] [MAIN ] AMG: Full history saved. [2025-09-17T17:13:47.798567] [INFO ] [MAIN ] Update Progress: 99/2371 symbols completed. AMG took 27.8s. Estimated remaining: 5h 15m 54s. Rate: 7.2 symbols/min [2025-09-17T17:13:47.967065] [INFO ] [MAIN ] AMP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:13:48.006847] [DEBUG] [LOCAL ] AMP: Loaded 32856 existing records from primary storage. [2025-09-17T17:13:48.006982] [INFO ] [MAIN ] AMP: Loaded 32856 existing records. [2025-09-17T17:13:48.190827] [WARN ] [MAIN ] AMP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:13:48.191187] [INFO ] [MAIN ] AMP: Wiping existing primary data before full refresh. [2025-09-17T17:13:48.191280] [INFO ] [LOCAL ] AMP: Starting deletion of primary data. [2025-09-17T17:13:48.192308] [DEBUG] [LOCAL ] AMP: Deleted primary data file. [2025-09-17T17:13:48.192361] [INFO ] [MAIN ] AMP: Starting full primary refresh. [2025-09-17T17:13:48.425949] [INFO ] [REMOTE ] AME: Fetching primary data for 2025-09. [2025-09-17T17:13:48.551455] [INFO ] [REMOTE ] AMP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:13:48.574441] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T17:13:49.215759] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-01. [2025-09-17T17:13:49.300566] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T17:13:50.015732] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-03. [2025-09-17T17:13:50.185743] [INFO ] [REMOTE ] AME: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T17:13:50.192511] [INFO ] [REMOTE ] AME: Full fetch complete (69446 records). [2025-09-17T17:13:50.192663] [DEBUG] [VALIDATOR ] AME: Validating primary data. [2025-09-17T17:13:50.617760] [DEBUG] [VALIDATOR ] AME: All expected trading days are present. [2025-09-17T17:13:50.617935] [DEBUG] [VALIDATOR ] AME: Primary data validation passed. [2025-09-17T17:13:50.618764] [INFO ] [MAIN ] AME: Fetched primary data is valid. [2025-09-17T17:13:50.618903] [DEBUG] [LOCAL ] AME: Saving primary data. [2025-09-17T17:13:50.639690] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T17:13:50.638844] [DEBUG] [LOCAL ] AME: Trimmed 69446 records to 48614 (keeping 200 days of data) [2025-09-17T17:13:50.841959] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-02. [2025-09-17T17:13:50.969893] [DEBUG] [LOCAL ] AME: Primary data saved (48614 records). [2025-09-17T17:13:50.970040] [INFO ] [MAIN ] AME: Full history saved. [2025-09-17T17:13:50.970123] [INFO ] [MAIN ] Update Progress: 100/2371 symbols completed. AME took 36.1s. Estimated remaining: 5h 13m 48s. Rate: 7.2 symbols/min [2025-09-17T17:13:51.142950] [INFO ] [MAIN ] AMPX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:13:51.192044] [DEBUG] [LOCAL ] AMPX: Loaded 52052 existing records from primary storage. [2025-09-17T17:13:51.192224] [INFO ] [MAIN ] AMPX: Loaded 52052 existing records. [2025-09-17T17:13:51.366554] [WARN ] [MAIN ] AMPX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:13:51.366843] [INFO ] [MAIN ] AMPX: Wiping existing primary data before full refresh. [2025-09-17T17:13:51.366915] [INFO ] [LOCAL ] AMPX: Starting deletion of primary data. [2025-09-17T17:13:51.368011] [DEBUG] [LOCAL ] AMPX: Deleted primary data file. [2025-09-17T17:13:51.368073] [INFO ] [MAIN ] AMPX: Starting full primary refresh. [2025-09-17T17:13:51.631881] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-11. [2025-09-17T17:13:51.733303] [INFO ] [REMOTE ] AMPX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:13:51.839278] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T17:13:52.396899] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T17:13:52.415733] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-03. [2025-09-17T17:13:52.818921] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T17:13:53.215771] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-04. [2025-09-17T17:13:54.015783] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-11. [2025-09-17T17:13:54.122189] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T17:13:54.815799] [INFO ] [REMOTE ] AMP: Fetching primary data for 2024-12. [2025-09-17T17:13:54.914220] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T17:13:55.615773] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-05. [2025-09-17T17:13:55.984916] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T17:13:56.012550] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T17:13:56.415767] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-04. [2025-09-17T17:13:57.215829] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2024-12. [2025-09-17T17:13:57.333365] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T17:13:58.015804] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-01. [2025-09-17T17:13:58.284472] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T17:13:58.703206] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T17:13:58.815774] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-01. [2025-09-17T17:13:59.593692] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T17:13:59.615737] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-02. [2025-09-17T17:14:00.415780] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-06. [2025-09-17T17:14:00.735733] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T17:14:01.165616] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T17:14:01.215800] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-02. [2025-09-17T17:14:02.015848] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-03. [2025-09-17T17:14:02.212014] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T17:14:02.815784] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-07. [2025-09-17T17:14:02.872928] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T17:14:03.615825] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-03. [2025-09-17T17:14:03.726305] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T17:14:04.218859] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T17:14:04.415796] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-05. [2025-09-17T17:14:05.195973] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T17:14:05.215762] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-04. [2025-09-17T17:14:05.565194] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T17:14:06.015812] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-06. [2025-09-17T17:14:06.815818] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-04. [2025-09-17T17:14:07.190857] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T17:14:07.354031] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T17:14:07.615793] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-08. [2025-09-17T17:14:08.212941] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T17:14:08.415775] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-05. [2025-09-17T17:14:09.215858] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-07. [2025-09-17T17:14:09.275082] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T17:14:09.443605] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T17:14:10.015815] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-05. [2025-09-17T17:14:10.815792] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-06. [2025-09-17T17:14:10.974243] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T17:14:11.489893] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T17:14:11.615792] [INFO ] [REMOTE ] AMH: Fetching primary data for 2025-09. [2025-09-17T17:14:11.894373] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T17:14:12.415794] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-08. [2025-09-17T17:14:13.215851] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-07. [2025-09-17T17:14:13.429164] [INFO ] [REMOTE ] AMH: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T17:14:13.436812] [INFO ] [REMOTE ] AMH: Full fetch complete (74478 records). [2025-09-17T17:14:13.437046] [DEBUG] [VALIDATOR ] AMH: Validating primary data. [2025-09-17T17:14:13.845260] [DEBUG] [VALIDATOR ] AMH: All expected trading days are present. [2025-09-17T17:14:13.845354] [DEBUG] [VALIDATOR ] AMH: Primary data validation passed. [2025-09-17T17:14:13.846176] [INFO ] [MAIN ] AMH: Fetched primary data is valid. [2025-09-17T17:14:13.846227] [DEBUG] [LOCAL ] AMH: Saving primary data. [2025-09-17T17:14:13.847776] [DEBUG] [LOCAL ] AMH: Trimmed 74478 records to 51699 (keeping 200 days of data) [2025-09-17T17:14:14.016436] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-06. [2025-09-17T17:14:14.086737] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T17:14:14.258262] [DEBUG] [LOCAL ] AMH: Primary data saved (51699 records). [2025-09-17T17:14:14.258498] [INFO ] [MAIN ] AMH: Full history saved. [2025-09-17T17:14:14.260896] [INFO ] [MAIN ] Update Progress: 101/2371 symbols completed. AMH took 39.5s. Estimated remaining: 5h 19m 17s. Rate: 7.1 symbols/min [2025-09-17T17:14:14.452009] [INFO ] [MAIN ] AMPY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:14:14.501173] [DEBUG] [LOCAL ] AMPY: Loaded 37324 existing records from primary storage. [2025-09-17T17:14:14.501435] [INFO ] [MAIN ] AMPY: Loaded 37324 existing records. [2025-09-17T17:14:14.694076] [WARN ] [MAIN ] AMPY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:14:14.694441] [INFO ] [MAIN ] AMPY: Wiping existing primary data before full refresh. [2025-09-17T17:14:14.694498] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-17T17:14:14.695459] [DEBUG] [LOCAL ] AMPY: Deleted primary data file. [2025-09-17T17:14:14.695521] [INFO ] [MAIN ] AMPY: Starting full primary refresh. [2025-09-17T17:14:14.819064] [INFO ] [REMOTE ] AMN: Fetching primary data for 2025-09. [2025-09-17T17:14:15.087256] [INFO ] [REMOTE ] AMPY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:14:15.111306] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T17:14:15.615778] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-08. [2025-09-17T17:14:15.664271] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:14:16.415801] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-11. [2025-09-17T17:14:16.439882] [INFO ] [REMOTE ] AMN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T17:14:16.446022] [INFO ] [REMOTE ] AMN: Full fetch complete (60478 records). [2025-09-17T17:14:16.446162] [DEBUG] [VALIDATOR ] AMN: Validating primary data. [2025-09-17T17:14:16.855310] [DEBUG] [VALIDATOR ] AMN: All expected trading days are present. [2025-09-17T17:14:16.855406] [DEBUG] [VALIDATOR ] AMN: Primary data validation passed. [2025-09-17T17:14:16.856034] [INFO ] [MAIN ] AMN: Fetched primary data is valid. [2025-09-17T17:14:16.856125] [DEBUG] [LOCAL ] AMN: Saving primary data. [2025-09-17T17:14:16.857546] [DEBUG] [LOCAL ] AMN: Trimmed 60478 records to 42222 (keeping 200 days of data) [2025-09-17T17:14:17.084615] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T17:14:17.132279] [DEBUG] [LOCAL ] AMN: Primary data saved (42222 records). [2025-09-17T17:14:17.132403] [INFO ] [MAIN ] AMN: Full history saved. [2025-09-17T17:14:17.132986] [INFO ] [MAIN ] Update Progress: 102/2371 symbols completed. AMN took 32.9s. Estimated remaining: 5h 17m 5s. Rate: 7.2 symbols/min [2025-09-17T17:14:17.223699] [INFO ] [REMOTE ] AMP: Fetching primary data for 2025-09. [2025-09-17T17:14:17.305704] [INFO ] [MAIN ] AMR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:14:17.339499] [DEBUG] [LOCAL ] AMR: Loaded 29397 existing records from primary storage. [2025-09-17T17:14:17.339630] [INFO ] [MAIN ] AMR: Loaded 29397 existing records. [2025-09-17T17:14:17.521100] [WARN ] [MAIN ] AMR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:14:17.521363] [INFO ] [MAIN ] AMR: Wiping existing primary data before full refresh. [2025-09-17T17:14:17.521408] [INFO ] [LOCAL ] AMR: Starting deletion of primary data. [2025-09-17T17:14:17.522345] [DEBUG] [LOCAL ] AMR: Deleted primary data file. [2025-09-17T17:14:17.522398] [INFO ] [MAIN ] AMR: Starting full primary refresh. [2025-09-17T17:14:17.884553] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T17:14:17.919112] [INFO ] [REMOTE ] AMR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:14:18.015768] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2024-12. [2025-09-17T17:14:18.272358] [INFO ] [REMOTE ] AMP: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T17:14:18.276928] [INFO ] [REMOTE ] AMP: Full fetch complete (47464 records). [2025-09-17T17:14:18.277052] [DEBUG] [VALIDATOR ] AMP: Validating primary data. [2025-09-17T17:14:18.655635] [DEBUG] [VALIDATOR ] AMP: All expected trading days are present. [2025-09-17T17:14:18.655734] [DEBUG] [VALIDATOR ] AMP: Primary data validation passed. [2025-09-17T17:14:18.656240] [INFO ] [MAIN ] AMP: Fetched primary data is valid. [2025-09-17T17:14:18.656280] [DEBUG] [LOCAL ] AMP: Saving primary data. [2025-09-17T17:14:18.657371] [DEBUG] [LOCAL ] AMP: Trimmed 47464 records to 32920 (keeping 200 days of data) [2025-09-17T17:14:18.830882] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-07. [2025-09-17T17:14:18.885158] [DEBUG] [LOCAL ] AMP: Primary data saved (32920 records). [2025-09-17T17:14:18.885333] [INFO ] [MAIN ] AMP: Full history saved. [2025-09-17T17:14:18.885426] [INFO ] [MAIN ] Update Progress: 103/2371 symbols completed. AMP took 31.1s. Estimated remaining: 5h 14m 30s. Rate: 7.2 symbols/min [2025-09-17T17:14:19.060956] [INFO ] [MAIN ] AMRC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:14:19.099193] [DEBUG] [LOCAL ] AMRC: Loaded 38785 existing records from primary storage. [2025-09-17T17:14:19.099355] [INFO ] [MAIN ] AMRC: Loaded 38785 existing records. [2025-09-17T17:14:19.270092] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T17:14:19.313688] [WARN ] [MAIN ] AMRC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:14:19.313987] [INFO ] [MAIN ] AMRC: Wiping existing primary data before full refresh. [2025-09-17T17:14:19.314038] [INFO ] [LOCAL ] AMRC: Starting deletion of primary data. [2025-09-17T17:14:19.315272] [DEBUG] [LOCAL ] AMRC: Deleted primary data file. [2025-09-17T17:14:19.315327] [INFO ] [MAIN ] AMRC: Starting full primary refresh. [2025-09-17T17:14:19.620998] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-01. [2025-09-17T17:14:19.676619] [INFO ] [REMOTE ] AMRC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:14:20.415782] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-11. [2025-09-17T17:14:20.837036] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T17:14:21.154280] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-17T17:14:21.215759] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-08. [2025-09-17T17:14:21.571404] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T17:14:22.015811] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-11. [2025-09-17T17:14:22.815813] [INFO ] [REMOTE ] AMR: Fetching primary data for 2024-12. [2025-09-17T17:14:23.364379] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-17T17:14:23.553487] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T17:14:23.615800] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-02. [2025-09-17T17:14:23.986768] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T17:14:24.415758] [INFO ] [REMOTE ] AMPX: Fetching primary data for 2025-09. [2025-09-17T17:14:24.651745] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T17:14:25.215777] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2024-12. [2025-09-17T17:14:26.015769] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-01. [2025-09-17T17:14:26.440430] [INFO ] [REMOTE ] AMPX: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-17T17:14:26.447834] [INFO ] [REMOTE ] AMPX: Full fetch complete (74335 records). [2025-09-17T17:14:26.448056] [DEBUG] [VALIDATOR ] AMPX: Validating primary data. [2025-09-17T17:14:26.607525] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T17:14:26.820868] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-03. [2025-09-17T17:14:26.904012] [DEBUG] [VALIDATOR ] AMPX: All expected trading days are present. [2025-09-17T17:14:26.904118] [DEBUG] [VALIDATOR ] AMPX: Primary data validation passed. [2025-09-17T17:14:26.905134] [INFO ] [MAIN ] AMPX: Fetched primary data is valid. [2025-09-17T17:14:26.905208] [DEBUG] [LOCAL ] AMPX: Saving primary data. [2025-09-17T17:14:26.906822] [DEBUG] [LOCAL ] AMPX: Trimmed 74335 records to 52068 (keeping 200 days of data) [2025-09-17T17:14:27.151151] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T17:14:27.238928] [DEBUG] [LOCAL ] AMPX: Primary data saved (52068 records). [2025-09-17T17:14:27.239089] [INFO ] [MAIN ] AMPX: Full history saved. [2025-09-17T17:14:27.239189] [INFO ] [MAIN ] Update Progress: 104/2371 symbols completed. AMPX took 36.3s. Estimated remaining: 5h 14m 23s. Rate: 7.2 symbols/min [2025-09-17T17:14:27.415551] [INFO ] [MAIN ] AMRZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:14:27.415762] [DEBUG] [LOCAL ] AMRZ: No existing data file found in primary storage. [2025-09-17T17:14:27.415803] [WARN ] [MAIN ] AMRZ: No existing data found, performing full refresh instead. [2025-09-17T17:14:27.415929] [INFO ] [MAIN ] AMRZ: Wiping existing primary data before full refresh. [2025-09-17T17:14:27.415969] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-17T17:14:27.416009] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-17T17:14:27.416042] [INFO ] [MAIN ] AMRZ: Starting full primary refresh. [2025-09-17T17:14:27.622949] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-01. [2025-09-17T17:14:27.807767] [INFO ] [REMOTE ] AMRZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:14:28.283181] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T17:14:28.415800] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-11. [2025-09-17T17:14:29.034504] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:14:29.034955] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-11 [2025-09-17T17:14:29.056356] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T17:14:29.215835] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-04. [2025-09-17T17:14:30.015816] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-02. [2025-09-17T17:14:30.807406] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T17:14:30.815761] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2024-12. [2025-09-17T17:14:31.191770] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:14:31.192265] [WARN ] [REMOTE ] AMRZ: No data returned for month 2024-12 [2025-09-17T17:14:31.247772] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T17:14:31.615775] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-02. [2025-09-17T17:14:32.415776] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-05. [2025-09-17T17:14:32.859213] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T17:14:33.215789] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-03. [2025-09-17T17:14:33.873051] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T17:14:34.015784] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-03. [2025-09-17T17:14:34.547906] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T17:14:34.815784] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-01. [2025-09-17T17:14:35.020407] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:14:35.020735] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-01 [2025-09-17T17:14:35.615748] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-02. [2025-09-17T17:14:35.809408] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:14:35.809772] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-02 [2025-09-17T17:14:35.940402] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T17:14:36.415785] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-04. [2025-09-17T17:14:37.215796] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-04. [2025-09-17T17:14:37.786507] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T17:14:38.015821] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-05. [2025-09-17T17:14:38.469888] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T17:14:38.815827] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-06. [2025-09-17T17:14:39.195179] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T17:14:39.615808] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-06. [2025-09-17T17:14:40.309790] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T17:14:40.415773] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-07. [2025-09-17T17:14:40.865820] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T17:14:41.215792] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-03. [2025-09-17T17:14:41.403263] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:14:41.403617] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-03 [2025-09-17T17:14:41.878061] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T17:14:42.015796] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-05. [2025-09-17T17:14:42.815790] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-08. [2025-09-17T17:14:43.383409] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T17:14:43.615845] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-04. [2025-09-17T17:14:43.816134] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:14:43.816458] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-04 [2025-09-17T17:14:44.193131] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T17:14:44.415785] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-06. [2025-09-17T17:14:45.215786] [INFO ] [REMOTE ] AMPY: Fetching primary data for 2025-09. [2025-09-17T17:14:45.628590] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T17:14:46.015799] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-05. [2025-09-17T17:14:46.224499] [DEBUG] [REMOTE ] AMRZ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:14:46.224849] [WARN ] [REMOTE ] AMRZ: No data returned for month 2025-05 [2025-09-17T17:14:46.520914] [INFO ] [REMOTE ] AMPY: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T17:14:46.524767] [INFO ] [REMOTE ] AMPY: Full fetch complete (49472 records). [2025-09-17T17:14:46.524871] [DEBUG] [VALIDATOR ] AMPY: Validating primary data. [2025-09-17T17:14:46.525491] [FATAL] [VALIDATOR ] AMPY: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:14:46.525570] [FATAL] [MAIN ] AMPY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:14:46.525607] [WARN ] [MAIN ] AMPY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:14:46.525663] [INFO ] [LOCAL ] AMPY: Starting deletion of primary data. [2025-09-17T17:14:46.525745] [DEBUG] [LOCAL ] AMPY: No primary data file found to delete. [2025-09-17T17:14:46.525782] [INFO ] [LOCAL ] AMPY: Starting deletion of derivative data. [2025-09-17T17:14:46.526145] [DEBUG] [LOCAL ] AMPY: Deleted derivative data file. [2025-09-17T17:14:46.527514] [INFO ] [MAIN ] Update Progress: 105/2371 symbols completed. AMPY took 32.3s. Estimated remaining: 5h 18m 11s. Rate: 7.1 symbols/min [2025-09-17T17:14:46.698426] [INFO ] [MAIN ] AMT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:14:46.760784] [DEBUG] [LOCAL ] AMT: Loaded 52460 existing records from primary storage. [2025-09-17T17:14:46.760996] [INFO ] [MAIN ] AMT: Loaded 52460 existing records. [2025-09-17T17:14:46.823339] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-07. [2025-09-17T17:14:46.945153] [WARN ] [MAIN ] AMT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:14:46.945425] [INFO ] [MAIN ] AMT: Wiping existing primary data before full refresh. [2025-09-17T17:14:46.945470] [INFO ] [LOCAL ] AMT: Starting deletion of primary data. [2025-09-17T17:14:46.946789] [DEBUG] [LOCAL ] AMT: Deleted primary data file. [2025-09-17T17:14:46.946866] [INFO ] [MAIN ] AMT: Starting full primary refresh. [2025-09-17T17:14:47.300131] [INFO ] [REMOTE ] AMT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:14:47.615765] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-06. [2025-09-17T17:14:48.415751] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-11. [2025-09-17T17:14:48.676009] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T17:14:48.695483] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T17:14:49.215823] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-08. [2025-09-17T17:14:50.015762] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-07. [2025-09-17T17:14:50.186875] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T17:14:50.705750] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T17:14:50.815731] [INFO ] [REMOTE ] AMRC: Fetching primary data for 2025-09. [2025-09-17T17:14:51.594486] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T17:14:51.615735] [INFO ] [REMOTE ] AMT: Fetching primary data for 2024-12. [2025-09-17T17:14:51.962912] [INFO ] [REMOTE ] AMRC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T17:14:51.968100] [INFO ] [REMOTE ] AMRC: Full fetch complete (51977 records). [2025-09-17T17:14:51.968193] [DEBUG] [VALIDATOR ] AMRC: Validating primary data. [2025-09-17T17:14:52.351764] [DEBUG] [VALIDATOR ] AMRC: All expected trading days are present. [2025-09-17T17:14:52.351851] [DEBUG] [VALIDATOR ] AMRC: Primary data validation passed. [2025-09-17T17:14:52.352395] [INFO ] [MAIN ] AMRC: Fetched primary data is valid. [2025-09-17T17:14:52.352438] [DEBUG] [LOCAL ] AMRC: Saving primary data. [2025-09-17T17:14:52.353687] [DEBUG] [LOCAL ] AMRC: Trimmed 51977 records to 38695 (keeping 200 days of data) [2025-09-17T17:14:52.441436] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-08. [2025-09-17T17:14:52.594633] [DEBUG] [LOCAL ] AMRC: Primary data saved (38695 records). [2025-09-17T17:14:52.594848] [INFO ] [MAIN ] AMRC: Full history saved. [2025-09-17T17:14:52.595632] [INFO ] [MAIN ] Update Progress: 106/2371 symbols completed. AMRC took 33.7s. Estimated remaining: 5h 17m 12s. Rate: 7.1 symbols/min [2025-09-17T17:14:52.768926] [INFO ] [MAIN ] AMTB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:14:52.792059] [DEBUG] [LOCAL ] AMTB: Loaded 20592 existing records from primary storage. [2025-09-17T17:14:52.792194] [INFO ] [MAIN ] AMTB: Loaded 20592 existing records. [2025-09-17T17:14:52.977861] [WARN ] [MAIN ] AMTB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:14:52.978108] [INFO ] [MAIN ] AMTB: Wiping existing primary data before full refresh. [2025-09-17T17:14:52.978152] [INFO ] [LOCAL ] AMTB: Starting deletion of primary data. [2025-09-17T17:14:52.978878] [DEBUG] [LOCAL ] AMTB: Deleted primary data file. [2025-09-17T17:14:52.978935] [INFO ] [MAIN ] AMTB: Starting full primary refresh. [2025-09-17T17:14:53.226941] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-07. [2025-09-17T17:14:53.356812] [INFO ] [REMOTE ] AMTB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:14:53.508982] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T17:14:53.572523] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T17:14:54.016020] [INFO ] [REMOTE ] AMR: Fetching primary data for 2025-09. [2025-09-17T17:14:54.815753] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-01. [2025-09-17T17:14:55.057663] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T17:14:55.119298] [INFO ] [REMOTE ] AMR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T17:14:55.123059] [INFO ] [REMOTE ] AMR: Full fetch complete (39185 records). [2025-09-17T17:14:55.123162] [DEBUG] [VALIDATOR ] AMR: Validating primary data. [2025-09-17T17:14:55.513487] [DEBUG] [VALIDATOR ] AMR: All expected trading days are present. [2025-09-17T17:14:55.513570] [DEBUG] [VALIDATOR ] AMR: Primary data validation passed. [2025-09-17T17:14:55.514034] [INFO ] [MAIN ] AMR: Fetched primary data is valid. [2025-09-17T17:14:55.514080] [DEBUG] [LOCAL ] AMR: Saving primary data. [2025-09-17T17:14:55.515338] [DEBUG] [LOCAL ] AMR: Trimmed 39185 records to 29290 (keeping 200 days of data) [2025-09-17T17:14:55.615778] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-08. [2025-09-17T17:14:55.703239] [DEBUG] [LOCAL ] AMR: Primary data saved (29290 records). [2025-09-17T17:14:55.703401] [INFO ] [MAIN ] AMR: Full history saved. [2025-09-17T17:14:55.704292] [INFO ] [MAIN ] Update Progress: 107/2371 symbols completed. AMR took 38.6s. Estimated remaining: 5h 15m 12s. Rate: 7.2 symbols/min [2025-09-17T17:14:55.874865] [INFO ] [MAIN ] AMTD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:14:55.880743] [DEBUG] [LOCAL ] AMTD: Loaded 3497 existing records from primary storage. [2025-09-17T17:14:55.880854] [INFO ] [MAIN ] AMTD: Loaded 3497 existing records. [2025-09-17T17:14:56.059600] [WARN ] [MAIN ] AMTD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:14:56.059888] [INFO ] [MAIN ] AMTD: Wiping existing primary data before full refresh. [2025-09-17T17:14:56.059932] [INFO ] [LOCAL ] AMTD: Starting deletion of primary data. [2025-09-17T17:14:56.060125] [DEBUG] [LOCAL ] AMTD: Deleted primary data file. [2025-09-17T17:14:56.060168] [INFO ] [MAIN ] AMTD: Starting full primary refresh. [2025-09-17T17:14:56.417091] [INFO ] [REMOTE ] AMTD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:14:56.417212] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-11. [2025-09-17T17:14:56.570671] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T17:14:57.215779] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-02. [2025-09-17T17:14:57.319401] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T17:14:57.488505] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T17:14:58.015760] [INFO ] [REMOTE ] AMRZ: Fetching primary data for 2025-09. [2025-09-17T17:14:58.770226] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T17:14:58.815731] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-03. [2025-09-17T17:14:59.508842] [INFO ] [REMOTE ] AMRZ: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T17:14:59.515399] [INFO ] [REMOTE ] AMRZ: Full fetch complete (23029 records). [2025-09-17T17:14:59.515481] [DEBUG] [VALIDATOR ] AMRZ: Validating primary data. [2025-09-17T17:14:59.620443] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-11. [2025-09-17T17:14:59.704588] [WARN ] [VALIDATOR ] AMRZ: Validation failed - insufficient historical data. Have 61 unique days, need 200 days [2025-09-17T17:14:59.704927] [FATAL] [MAIN ] AMRZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:14:59.704977] [WARN ] [MAIN ] AMRZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:14:59.705020] [INFO ] [LOCAL ] AMRZ: Starting deletion of primary data. [2025-09-17T17:14:59.705098] [DEBUG] [LOCAL ] AMRZ: No primary data file found to delete. [2025-09-17T17:14:59.705142] [INFO ] [LOCAL ] AMRZ: Starting deletion of derivative data. [2025-09-17T17:14:59.705209] [DEBUG] [LOCAL ] AMRZ: No derivative data file found to delete. [2025-09-17T17:14:59.705271] [INFO ] [MAIN ] Update Progress: 108/2371 symbols completed. AMRZ took 32.5s. Estimated remaining: 5h 13m 33s. Rate: 7.2 symbols/min [2025-09-17T17:14:59.890044] [INFO ] [MAIN ] AMTM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:14:59.944085] [DEBUG] [LOCAL ] AMTM: Loaded 50733 existing records from primary storage. [2025-09-17T17:14:59.944244] [INFO ] [MAIN ] AMTM: Loaded 50733 existing records. [2025-09-17T17:15:00.128105] [WARN ] [MAIN ] AMTM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:15:00.128559] [INFO ] [MAIN ] AMTM: Wiping existing primary data before full refresh. [2025-09-17T17:15:00.128606] [INFO ] [LOCAL ] AMTM: Starting deletion of primary data. [2025-09-17T17:15:00.130102] [DEBUG] [LOCAL ] AMTM: Deleted primary data file. [2025-09-17T17:15:00.130162] [INFO ] [MAIN ] AMTM: Starting full primary refresh. [2025-09-17T17:15:00.423569] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2024-12. [2025-09-17T17:15:00.504765] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T17:15:00.525524] [INFO ] [REMOTE ] AMTM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:15:00.741157] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T17:15:01.215810] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-11. [2025-09-17T17:15:01.582834] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T17:15:02.015886] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-04. [2025-09-17T17:15:02.815784] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2024-12. [2025-09-17T17:15:03.226445] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-17T17:15:03.497754] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T17:15:03.621031] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-01. [2025-09-17T17:15:03.650446] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T17:15:04.415758] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-01. [2025-09-17T17:15:04.741631] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T17:15:04.800321] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T17:15:05.215786] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-05. [2025-09-17T17:15:06.015794] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-02. [2025-09-17T17:15:06.686388] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T17:15:06.815800] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-03. [2025-09-17T17:15:06.951981] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T17:15:07.291932] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T17:15:07.615847] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2024-12. [2025-09-17T17:15:08.415833] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-02. [2025-09-17T17:15:09.215872] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-06. [2025-09-17T17:15:09.430754] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T17:15:09.645573] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T17:15:10.015905] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-04. [2025-09-17T17:15:10.463318] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T17:15:10.815760] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-03. [2025-09-17T17:15:10.870354] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:15:11.615825] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-07. [2025-09-17T17:15:11.824262] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T17:15:12.415842] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-04. [2025-09-17T17:15:13.216006] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-05. [2025-09-17T17:15:13.474947] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T17:15:13.520832] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T17:15:13.615299] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-17T17:15:14.015884] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-06. [2025-09-17T17:15:14.426030] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-17T17:15:14.815828] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-07. [2025-09-17T17:15:15.315583] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T17:15:15.615795] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-08. [2025-09-17T17:15:16.186027] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T17:15:16.415828] [INFO ] [REMOTE ] AMTD: Fetching primary data for 2025-09. [2025-09-17T17:15:17.147562] [INFO ] [REMOTE ] AMTD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T17:15:17.149508] [INFO ] [REMOTE ] AMTD: Full fetch complete (5533 records). [2025-09-17T17:15:17.149599] [DEBUG] [VALIDATOR ] AMTD: Validating primary data. [2025-09-17T17:15:17.223171] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-01. [2025-09-17T17:15:17.539288] [DEBUG] [VALIDATOR ] AMTD: All expected trading days are present. [2025-09-17T17:15:17.539373] [DEBUG] [VALIDATOR ] AMTD: Primary data validation passed. [2025-09-17T17:15:17.539567] [INFO ] [MAIN ] AMTD: Fetched primary data is valid. [2025-09-17T17:15:17.539623] [DEBUG] [LOCAL ] AMTD: Saving primary data. [2025-09-17T17:15:17.540082] [DEBUG] [LOCAL ] AMTD: Trimmed 5533 records to 3497 (keeping 200 days of data) [2025-09-17T17:15:17.561313] [DEBUG] [LOCAL ] AMTD: Primary data saved (3497 records). [2025-09-17T17:15:17.561452] [INFO ] [MAIN ] AMTD: Full history saved. [2025-09-17T17:15:17.561542] [INFO ] [MAIN ] Update Progress: 109/2371 symbols completed. AMTD took 21.9s. Estimated remaining: 5h 16m 42s. Rate: 7.1 symbols/min [2025-09-17T17:15:17.750524] [INFO ] [MAIN ] AMWL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:15:17.764303] [DEBUG] [LOCAL ] AMWL: Loaded 8606 existing records from primary storage. [2025-09-17T17:15:17.764441] [INFO ] [MAIN ] AMWL: Loaded 8606 existing records. [2025-09-17T17:15:17.975603] [WARN ] [MAIN ] AMWL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:15:17.975890] [INFO ] [MAIN ] AMWL: Wiping existing primary data before full refresh. [2025-09-17T17:15:17.975943] [INFO ] [LOCAL ] AMWL: Starting deletion of primary data. [2025-09-17T17:15:17.976373] [DEBUG] [LOCAL ] AMWL: Deleted primary data file. [2025-09-17T17:15:17.976420] [INFO ] [MAIN ] AMWL: Starting full primary refresh. [2025-09-17T17:15:18.020947] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-08. [2025-09-17T17:15:18.331835] [INFO ] [REMOTE ] AMWL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:15:18.815763] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-11. [2025-09-17T17:15:19.239710] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-17T17:15:19.615992] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-05. [2025-09-17T17:15:19.713964] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T17:15:19.977203] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T17:15:20.415794] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-02. [2025-09-17T17:15:20.572670] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T17:15:21.215797] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2024-12. [2025-09-17T17:15:22.015870] [INFO ] [REMOTE ] AMT: Fetching primary data for 2025-09. [2025-09-17T17:15:22.156403] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T17:15:22.185878] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T17:15:22.815812] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-06. [2025-09-17T17:15:23.615807] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-01. [2025-09-17T17:15:23.668310] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T17:15:23.948758] [INFO ] [REMOTE ] AMT: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T17:15:23.955887] [INFO ] [REMOTE ] AMT: Full fetch complete (75850 records). [2025-09-17T17:15:23.956048] [DEBUG] [VALIDATOR ] AMT: Validating primary data. [2025-09-17T17:15:24.394440] [DEBUG] [VALIDATOR ] AMT: All expected trading days are present. [2025-09-17T17:15:24.394542] [DEBUG] [VALIDATOR ] AMT: Primary data validation passed. [2025-09-17T17:15:24.395304] [INFO ] [MAIN ] AMT: Fetched primary data is valid. [2025-09-17T17:15:24.395351] [DEBUG] [LOCAL ] AMT: Saving primary data. [2025-09-17T17:15:24.396911] [DEBUG] [LOCAL ] AMT: Trimmed 75850 records to 52461 (keeping 200 days of data) [2025-09-17T17:15:24.460137] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-03. [2025-09-17T17:15:24.508800] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T17:15:24.751398] [DEBUG] [LOCAL ] AMT: Primary data saved (52461 records). [2025-09-17T17:15:24.751553] [INFO ] [MAIN ] AMT: Full history saved. [2025-09-17T17:15:24.751657] [INFO ] [MAIN ] Update Progress: 110/2371 symbols completed. AMT took 38.2s. Estimated remaining: 5h 16m 9s. Rate: 7.2 symbols/min [2025-09-17T17:15:24.924857] [INFO ] [MAIN ] AMX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:15:24.970504] [DEBUG] [LOCAL ] AMX: Loaded 49004 existing records from primary storage. [2025-09-17T17:15:24.970707] [INFO ] [MAIN ] AMX: Loaded 49004 existing records. [2025-09-17T17:15:25.148612] [WARN ] [MAIN ] AMX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:15:25.148869] [INFO ] [MAIN ] AMX: Wiping existing primary data before full refresh. [2025-09-17T17:15:25.148912] [INFO ] [LOCAL ] AMX: Starting deletion of primary data. [2025-09-17T17:15:25.150193] [DEBUG] [LOCAL ] AMX: Deleted primary data file. [2025-09-17T17:15:25.150245] [INFO ] [MAIN ] AMX: Starting full primary refresh. [2025-09-17T17:15:25.225153] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-07. [2025-09-17T17:15:25.508294] [INFO ] [REMOTE ] AMX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:15:26.015802] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-11. [2025-09-17T17:15:26.230590] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T17:15:26.434784] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T17:15:26.815782] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-02. [2025-09-17T17:15:27.548489] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T17:15:27.584133] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T17:15:27.615738] [INFO ] [REMOTE ] AMX: Fetching primary data for 2024-12. [2025-09-17T17:15:28.415784] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-03. [2025-09-17T17:15:29.017604] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T17:15:29.215772] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-08. [2025-09-17T17:15:29.323354] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T17:15:30.020885] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-01. [2025-09-17T17:15:30.030947] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T17:15:30.815812] [INFO ] [REMOTE ] AMTB: Fetching primary data for 2025-09. [2025-09-17T17:15:31.498879] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T17:15:31.615766] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-04. [2025-09-17T17:15:31.916660] [INFO ] [REMOTE ] AMTB: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T17:15:31.919281] [INFO ] [REMOTE ] AMTB: Full fetch complete (30339 records). [2025-09-17T17:15:31.919367] [DEBUG] [VALIDATOR ] AMTB: Validating primary data. [2025-09-17T17:15:32.302382] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T17:15:32.302161] [DEBUG] [VALIDATOR ] AMTB: All expected trading days are present. [2025-09-17T17:15:32.305054] [DEBUG] [VALIDATOR ] AMTB: Primary data validation passed. [2025-09-17T17:15:32.305436] [INFO ] [MAIN ] AMTB: Fetched primary data is valid. [2025-09-17T17:15:32.305477] [DEBUG] [LOCAL ] AMTB: Saving primary data. [2025-09-17T17:15:32.306566] [DEBUG] [LOCAL ] AMTB: Trimmed 30339 records to 20596 (keeping 200 days of data) [2025-09-17T17:15:32.416304] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-04. [2025-09-17T17:15:32.441141] [DEBUG] [LOCAL ] AMTB: Primary data saved (20596 records). [2025-09-17T17:15:32.441295] [INFO ] [MAIN ] AMTB: Full history saved. [2025-09-17T17:15:32.441468] [INFO ] [MAIN ] Update Progress: 111/2371 symbols completed. AMTB took 39.8s. Estimated remaining: 5h 15m 46s. Rate: 7.2 symbols/min [2025-09-17T17:15:32.636382] [INFO ] [MAIN ] AN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:15:32.681495] [DEBUG] [LOCAL ] AN: Loaded 32970 existing records from primary storage. [2025-09-17T17:15:32.681678] [INFO ] [MAIN ] AN: Loaded 32970 existing records. [2025-09-17T17:15:32.865884] [WARN ] [MAIN ] AN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:15:32.866115] [INFO ] [MAIN ] AN: Wiping existing primary data before full refresh. [2025-09-17T17:15:32.866159] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-17T17:15:32.867181] [DEBUG] [LOCAL ] AN: Deleted primary data file. [2025-09-17T17:15:32.867240] [INFO ] [MAIN ] AN: Starting full primary refresh. [2025-09-17T17:15:33.223292] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-05. [2025-09-17T17:15:33.227611] [INFO ] [REMOTE ] AN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:15:34.015820] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-02. [2025-09-17T17:15:34.028084] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T17:15:34.166470] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T17:15:34.815815] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-11. [2025-09-17T17:15:35.508009] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T17:15:35.615810] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-06. [2025-09-17T17:15:36.324538] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T17:15:36.368341] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T17:15:36.415787] [INFO ] [REMOTE ] AN: Fetching primary data for 2024-12. [2025-09-17T17:15:37.215770] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-03. [2025-09-17T17:15:37.849924] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T17:15:38.015791] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-05. [2025-09-17T17:15:38.815878] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-07. [2025-09-17T17:15:39.068831] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T17:15:39.615776] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-01. [2025-09-17T17:15:39.727201] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T17:15:39.769326] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T17:15:40.415790] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-08. [2025-09-17T17:15:40.729033] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T17:15:41.210052] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T17:15:41.215685] [INFO ] [REMOTE ] AMWL: Fetching primary data for 2025-09. [2025-09-17T17:15:42.015817] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-06. [2025-09-17T17:15:42.053076] [INFO ] [REMOTE ] AMWL: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T17:15:42.057102] [INFO ] [REMOTE ] AMWL: Full fetch complete (13926 records). [2025-09-17T17:15:42.057354] [DEBUG] [VALIDATOR ] AMWL: Validating primary data. [2025-09-17T17:15:42.449175] [DEBUG] [VALIDATOR ] AMWL: All expected trading days are present. [2025-09-17T17:15:42.449259] [DEBUG] [VALIDATOR ] AMWL: Primary data validation passed. [2025-09-17T17:15:42.449683] [INFO ] [MAIN ] AMWL: Fetched primary data is valid. [2025-09-17T17:15:42.449724] [DEBUG] [LOCAL ] AMWL: Saving primary data. [2025-09-17T17:15:42.450742] [DEBUG] [LOCAL ] AMWL: Trimmed 13926 records to 8625 (keeping 200 days of data) [2025-09-17T17:15:42.504515] [DEBUG] [LOCAL ] AMWL: Primary data saved (8625 records). [2025-09-17T17:15:42.504692] [INFO ] [MAIN ] AMWL: Full history saved. [2025-09-17T17:15:42.504822] [INFO ] [MAIN ] Update Progress: 112/2371 symbols completed. AMWL took 24.9s. Estimated remaining: 5h 16m 12s. Rate: 7.1 symbols/min [2025-09-17T17:15:42.684692] [INFO ] [MAIN ] ANET: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:15:42.753603] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-17T17:15:42.753814] [INFO ] [MAIN ] ANET: Loaded 53766 existing records. [2025-09-17T17:15:42.821024] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-02. [2025-09-17T17:15:42.942610] [WARN ] [MAIN ] ANET: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:15:42.942871] [INFO ] [MAIN ] ANET: Wiping existing primary data before full refresh. [2025-09-17T17:15:42.942916] [INFO ] [LOCAL ] ANET: Starting deletion of primary data. [2025-09-17T17:15:42.943955] [DEBUG] [LOCAL ] ANET: Deleted primary data file. [2025-09-17T17:15:42.944013] [INFO ] [MAIN ] ANET: Starting full primary refresh. [2025-09-17T17:15:43.313857] [INFO ] [REMOTE ] ANET: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:15:43.615784] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-04. [2025-09-17T17:15:43.751006] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T17:15:43.960426] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T17:15:44.415787] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-07. [2025-09-17T17:15:45.215801] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-11. [2025-09-17T17:15:45.425331] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T17:15:46.015803] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-03. [2025-09-17T17:15:46.309500] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T17:15:46.815763] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-05. [2025-09-17T17:15:46.925630] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T17:15:47.540828] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T17:15:47.615756] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-04. [2025-09-17T17:15:48.371449] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T17:15:48.415720] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-06. [2025-09-17T17:15:49.150129] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T17:15:49.215766] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-05. [2025-09-17T17:15:50.015746] [INFO ] [REMOTE ] ANET: Fetching primary data for 2024-12. [2025-09-17T17:15:50.361543] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T17:15:50.629340] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T17:15:50.815795] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-06. [2025-09-17T17:15:51.615780] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-07. [2025-09-17T17:15:52.137134] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-17T17:15:52.165013] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T17:15:52.415771] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-01. [2025-09-17T17:15:53.205050] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T17:15:53.215787] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-08. [2025-09-17T17:15:54.015782] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-07. [2025-09-17T17:15:54.815779] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-08. [2025-09-17T17:15:54.966813] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T17:15:54.992167] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-01 (2.58 seconds). [2025-09-17T17:15:55.406775] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T17:15:55.615773] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-08. [2025-09-17T17:15:56.281234] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T17:15:56.415796] [INFO ] [REMOTE ] AMX: Fetching primary data for 2025-09. [2025-09-17T17:15:56.715328] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T17:15:57.215791] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-02. [2025-09-17T17:15:58.015872] [INFO ] [REMOTE ] AN: Fetching primary data for 2025-09. [2025-09-17T17:15:58.037203] [INFO ] [REMOTE ] AMX: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T17:15:58.044482] [INFO ] [REMOTE ] AMX: Full fetch complete (70646 records). [2025-09-17T17:15:58.044667] [DEBUG] [VALIDATOR ] AMX: Validating primary data. [2025-09-17T17:15:58.443589] [DEBUG] [VALIDATOR ] AMX: All expected trading days are present. [2025-09-17T17:15:58.444039] [DEBUG] [VALIDATOR ] AMX: Primary data validation passed. [2025-09-17T17:15:58.445034] [INFO ] [MAIN ] AMX: Fetched primary data is valid. [2025-09-17T17:15:58.445089] [DEBUG] [LOCAL ] AMX: Saving primary data. [2025-09-17T17:15:58.447072] [DEBUG] [LOCAL ] AMX: Trimmed 70646 records to 49066 (keeping 200 days of data) [2025-09-17T17:15:58.755358] [DEBUG] [LOCAL ] AMX: Primary data saved (49066 records). [2025-09-17T17:15:58.755496] [INFO ] [MAIN ] AMX: Full history saved. [2025-09-17T17:15:58.755629] [INFO ] [MAIN ] Update Progress: 113/2371 symbols completed. AMX took 34.0s. Estimated remaining: 5h 18m 40s. Rate: 7.1 symbols/min [2025-09-17T17:15:58.825076] [INFO ] [REMOTE ] AMTM: Fetching primary data for 2025-09. [2025-09-17T17:15:58.934696] [INFO ] [MAIN ] ANF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:15:58.987154] [DEBUG] [LOCAL ] ANF: Loaded 52297 existing records from primary storage. [2025-09-17T17:15:58.987339] [INFO ] [MAIN ] ANF: Loaded 52297 existing records. [2025-09-17T17:15:59.201261] [WARN ] [MAIN ] ANF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:15:59.201536] [INFO ] [MAIN ] ANF: Wiping existing primary data before full refresh. [2025-09-17T17:15:59.201587] [INFO ] [LOCAL ] ANF: Starting deletion of primary data. [2025-09-17T17:15:59.202687] [DEBUG] [LOCAL ] ANF: Deleted primary data file. [2025-09-17T17:15:59.202746] [INFO ] [MAIN ] ANF: Starting full primary refresh. [2025-09-17T17:15:59.566747] [INFO ] [REMOTE ] ANF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:15:59.577259] [INFO ] [REMOTE ] AN: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T17:15:59.581906] [INFO ] [REMOTE ] AN: Full fetch complete (47589 records). [2025-09-17T17:15:59.582085] [DEBUG] [VALIDATOR ] AN: Validating primary data. [2025-09-17T17:15:59.583000] [FATAL] [VALIDATOR ] AN: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:15:59.583091] [FATAL] [MAIN ] AN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:15:59.583143] [WARN ] [MAIN ] AN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:15:59.583209] [INFO ] [LOCAL ] AN: Starting deletion of primary data. [2025-09-17T17:15:59.583279] [DEBUG] [LOCAL ] AN: No primary data file found to delete. [2025-09-17T17:15:59.583315] [INFO ] [LOCAL ] AN: Starting deletion of derivative data. [2025-09-17T17:15:59.583767] [DEBUG] [LOCAL ] AN: Deleted derivative data file. [2025-09-17T17:15:59.583874] [INFO ] [MAIN ] Update Progress: 114/2371 symbols completed. AN took 27.1s. Estimated remaining: 5h 16m 1s. Rate: 7.1 symbols/min [2025-09-17T17:15:59.628514] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-11. [2025-09-17T17:15:59.762907] [INFO ] [MAIN ] ANGX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:15:59.763202] [DEBUG] [LOCAL ] ANGX: No existing data file found in primary storage. [2025-09-17T17:15:59.763292] [WARN ] [MAIN ] ANGX: No existing data found, performing full refresh instead. [2025-09-17T17:15:59.763522] [INFO ] [MAIN ] ANGX: Wiping existing primary data before full refresh. [2025-09-17T17:15:59.763591] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-17T17:15:59.763686] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-17T17:15:59.763745] [INFO ] [MAIN ] ANGX: Starting full primary refresh. [2025-09-17T17:15:59.924492] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-09-17T17:16:00.186979] [INFO ] [REMOTE ] ANGX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:16:00.420852] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-11. [2025-09-17T17:16:00.431232] [INFO ] [REMOTE ] AMTM: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T17:16:00.437864] [INFO ] [REMOTE ] AMTM: Full fetch complete (73740 records). [2025-09-17T17:16:00.438036] [DEBUG] [VALIDATOR ] AMTM: Validating primary data. [2025-09-17T17:16:00.748383] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:00.749050] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-11 [2025-09-17T17:16:00.842961] [DEBUG] [VALIDATOR ] AMTM: All expected trading days are present. [2025-09-17T17:16:00.843044] [DEBUG] [VALIDATOR ] AMTM: Primary data validation passed. [2025-09-17T17:16:00.843797] [INFO ] [MAIN ] AMTM: Fetched primary data is valid. [2025-09-17T17:16:00.843844] [DEBUG] [LOCAL ] AMTM: Saving primary data. [2025-09-17T17:16:00.846566] [DEBUG] [LOCAL ] AMTM: Trimmed 73740 records to 50741 (keeping 200 days of data) [2025-09-17T17:16:01.148801] [DEBUG] [LOCAL ] AMTM: Primary data saved (50741 records). [2025-09-17T17:16:01.148939] [INFO ] [MAIN ] AMTM: Full history saved. [2025-09-17T17:16:01.149025] [INFO ] [MAIN ] Update Progress: 115/2371 symbols completed. AMTM took 1m 1s. Estimated remaining: 5h 13m 38s. Rate: 7.2 symbols/min [2025-09-17T17:16:01.224713] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-03. [2025-09-17T17:16:01.330612] [INFO ] [MAIN ] ANRO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:16:01.357511] [DEBUG] [LOCAL ] ANRO: Loaded 20465 existing records from primary storage. [2025-09-17T17:16:01.357769] [INFO ] [MAIN ] ANRO: Loaded 20465 existing records. [2025-09-17T17:16:01.575793] [WARN ] [MAIN ] ANRO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:16:01.576065] [INFO ] [MAIN ] ANRO: Wiping existing primary data before full refresh. [2025-09-17T17:16:01.576131] [INFO ] [LOCAL ] ANRO: Starting deletion of primary data. [2025-09-17T17:16:01.576848] [DEBUG] [LOCAL ] ANRO: Deleted primary data file. [2025-09-17T17:16:01.576911] [INFO ] [MAIN ] ANRO: Starting full primary refresh. [2025-09-17T17:16:01.972880] [INFO ] [REMOTE ] ANRO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:16:02.010724] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-11 (2.38 seconds). [2025-09-17T17:16:02.024161] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2024-12. [2025-09-17T17:16:02.217371] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:02.217697] [WARN ] [REMOTE ] ANGX: No data returned for month 2024-12 [2025-09-17T17:16:02.815827] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-01. [2025-09-17T17:16:03.030671] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:03.031139] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-01 [2025-09-17T17:16:03.615786] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-02. [2025-09-17T17:16:03.850887] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-17T17:16:03.864772] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:03.865233] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-02 [2025-09-17T17:16:04.415817] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-04. [2025-09-17T17:16:05.215794] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-03. [2025-09-17T17:16:05.683985] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:05.684346] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-03 [2025-09-17T17:16:06.015802] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-11. [2025-09-17T17:16:06.754147] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-17T17:16:06.815721] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-05. [2025-09-17T17:16:07.445157] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T17:16:07.615773] [INFO ] [REMOTE ] ANF: Fetching primary data for 2024-12. [2025-09-17T17:16:08.415852] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-04. [2025-09-17T17:16:08.615013] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:08.615434] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-04 [2025-09-17T17:16:09.215795] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2024-12. [2025-09-17T17:16:09.315626] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-17T17:16:09.528982] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T17:16:10.015786] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-06. [2025-09-17T17:16:10.518130] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T17:16:10.815877] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-01. [2025-09-17T17:16:11.592905] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T17:16:11.615756] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-02. [2025-09-17T17:16:12.362845] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-17T17:16:12.415770] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-07. [2025-09-17T17:16:12.730317] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T17:16:13.215797] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-03. [2025-09-17T17:16:14.015876] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-01. [2025-09-17T17:16:14.479358] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T17:16:14.657155] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-17T17:16:14.815833] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-05. [2025-09-17T17:16:15.032673] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:15.033245] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-05 [2025-09-17T17:16:15.615844] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-04. [2025-09-17T17:16:16.007253] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T17:16:16.415817] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-06. [2025-09-17T17:16:16.611037] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:16.611358] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-06 [2025-09-17T17:16:16.797300] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T17:16:17.215776] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-02. [2025-09-17T17:16:18.015827] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-08. [2025-09-17T17:16:18.815779] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-05. [2025-09-17T17:16:19.054743] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T17:16:19.615750] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-07. [2025-09-17T17:16:19.813442] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:19.813799] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-07 [2025-09-17T17:16:20.017323] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T17:16:20.390392] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-17T17:16:20.415781] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-08. [2025-09-17T17:16:20.609897] [DEBUG] [REMOTE ] ANGX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:20.610234] [WARN ] [REMOTE ] ANGX: No data returned for month 2025-08 [2025-09-17T17:16:21.215788] [INFO ] [REMOTE ] ANGX: Fetching primary data for 2025-09. [2025-09-17T17:16:22.015797] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-03. [2025-09-17T17:16:22.271522] [INFO ] [REMOTE ] ANGX: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T17:16:22.274484] [INFO ] [REMOTE ] ANGX: Full fetch complete (1706 records). [2025-09-17T17:16:22.274553] [DEBUG] [VALIDATOR ] ANGX: Validating primary data. [2025-09-17T17:16:22.483687] [WARN ] [VALIDATOR ] ANGX: Validation failed - insufficient historical data. Have 5 unique days, need 200 days [2025-09-17T17:16:22.483978] [FATAL] [MAIN ] ANGX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:16:22.484058] [WARN ] [MAIN ] ANGX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:16:22.484134] [INFO ] [LOCAL ] ANGX: Starting deletion of primary data. [2025-09-17T17:16:22.484231] [DEBUG] [LOCAL ] ANGX: No primary data file found to delete. [2025-09-17T17:16:22.484288] [INFO ] [LOCAL ] ANGX: Starting deletion of derivative data. [2025-09-17T17:16:22.484352] [DEBUG] [LOCAL ] ANGX: No derivative data file found to delete. [2025-09-17T17:16:22.484442] [INFO ] [MAIN ] Update Progress: 116/2371 symbols completed. ANGX took 22.9s. Estimated remaining: 5h 17m 42s. Rate: 7.1 symbols/min [2025-09-17T17:16:22.658907] [INFO ] [MAIN ] ANVS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:16:22.688818] [DEBUG] [LOCAL ] ANVS: Loaded 23544 existing records from primary storage. [2025-09-17T17:16:22.688984] [INFO ] [MAIN ] ANVS: Loaded 23544 existing records. [2025-09-17T17:16:22.828399] [INFO ] [REMOTE ] ANET: Fetching primary data for 2025-09. [2025-09-17T17:16:22.867351] [WARN ] [MAIN ] ANVS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:16:22.867580] [INFO ] [MAIN ] ANVS: Wiping existing primary data before full refresh. [2025-09-17T17:16:22.867623] [INFO ] [LOCAL ] ANVS: Starting deletion of primary data. [2025-09-17T17:16:22.868129] [DEBUG] [LOCAL ] ANVS: Deleted primary data file. [2025-09-17T17:16:22.868174] [INFO ] [MAIN ] ANVS: Starting full primary refresh. [2025-09-17T17:16:23.221227] [INFO ] [REMOTE ] ANVS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:16:23.615779] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-11. [2025-09-17T17:16:23.934793] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T17:16:24.415817] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-06. [2025-09-17T17:16:24.776234] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T17:16:25.056826] [INFO ] [REMOTE ] ANET: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-17T17:16:25.063977] [INFO ] [REMOTE ] ANET: Full fetch complete (77693 records). [2025-09-17T17:16:25.064140] [DEBUG] [VALIDATOR ] ANET: Validating primary data. [2025-09-17T17:16:25.221001] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2024-12. [2025-09-17T17:16:25.479079] [DEBUG] [VALIDATOR ] ANET: All expected trading days are present. [2025-09-17T17:16:25.479223] [DEBUG] [VALIDATOR ] ANET: Primary data validation passed. [2025-09-17T17:16:25.485718] [INFO ] [MAIN ] ANET: Fetched primary data is valid. [2025-09-17T17:16:25.494792] [DEBUG] [LOCAL ] ANET: Saving primary data. [2025-09-17T17:16:25.496383] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T17:16:25.503161] [DEBUG] [LOCAL ] ANET: Trimmed 77693 records to 53766 (keeping 200 days of data) [2025-09-17T17:16:25.837307] [DEBUG] [LOCAL ] ANET: Primary data saved (53766 records). [2025-09-17T17:16:25.837531] [INFO ] [MAIN ] ANET: Full history saved. [2025-09-17T17:16:25.838334] [INFO ] [MAIN ] Update Progress: 117/2371 symbols completed. ANET took 43.3s. Estimated remaining: 5h 15m 56s. Rate: 7.1 symbols/min [2025-09-17T17:16:26.015824] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-07. [2025-09-17T17:16:26.221314] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T17:16:26.815744] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-01. [2025-09-17T17:16:26.869791] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T17:16:27.615784] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-08. [2025-09-17T17:16:28.078592] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T17:16:28.415759] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-04. [2025-09-17T17:16:28.483258] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T17:16:29.215761] [INFO ] [REMOTE ] ANRO: Fetching primary data for 2025-09. [2025-09-17T17:16:30.015798] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-02. [2025-09-17T17:16:30.147898] [INFO ] [REMOTE ] ANRO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T17:16:30.149942] [INFO ] [REMOTE ] ANRO: Full fetch complete (30969 records). [2025-09-17T17:16:30.150016] [DEBUG] [VALIDATOR ] ANRO: Validating primary data. [2025-09-17T17:16:30.545800] [DEBUG] [VALIDATOR ] ANRO: All expected trading days are present. [2025-09-17T17:16:30.545941] [DEBUG] [VALIDATOR ] ANRO: Primary data validation passed. [2025-09-17T17:16:30.546431] [INFO ] [MAIN ] ANRO: Fetched primary data is valid. [2025-09-17T17:16:30.546517] [DEBUG] [LOCAL ] ANRO: Saving primary data. [2025-09-17T17:16:30.547625] [DEBUG] [LOCAL ] ANRO: Trimmed 30969 records to 20319 (keeping 200 days of data) [2025-09-17T17:16:30.660588] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-17T17:16:30.704179] [DEBUG] [LOCAL ] ANRO: Primary data saved (20319 records). [2025-09-17T17:16:30.704314] [INFO ] [MAIN ] ANRO: Full history saved. [2025-09-17T17:16:30.704420] [INFO ] [MAIN ] Update Progress: 118/2371 symbols completed. ANRO took 29.6s. Estimated remaining: 5h 14m 40s. Rate: 7.2 symbols/min [2025-09-17T17:16:30.815802] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-05. [2025-09-17T17:16:31.449056] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T17:16:31.615825] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-03. [2025-09-17T17:16:32.755850] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T17:16:32.767370] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-06. [2025-09-17T17:16:32.817861] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T17:16:33.215803] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-04. [2025-09-17T17:16:34.276781] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T17:16:34.284056] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-05. [2025-09-17T17:16:34.453772] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T17:16:34.815784] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-07. [2025-09-17T17:16:35.497549] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T17:16:35.615775] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-06. [2025-09-17T17:16:36.255726] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T17:16:36.415772] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-08. [2025-09-17T17:16:37.005186] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T17:16:37.215805] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-07. [2025-09-17T17:16:37.948204] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T17:16:38.015844] [INFO ] [REMOTE ] ANF: Fetching primary data for 2025-09. [2025-09-17T17:16:38.456944] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T17:16:38.815827] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-08. [2025-09-17T17:16:39.796533] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T17:16:39.801686] [INFO ] [REMOTE ] ANVS: Fetching primary data for 2025-09. [2025-09-17T17:16:40.036521] [INFO ] [REMOTE ] ANF: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-17T17:16:40.043492] [INFO ] [REMOTE ] ANF: Full fetch complete (75527 records). [2025-09-17T17:16:40.043736] [DEBUG] [VALIDATOR ] ANF: Validating primary data. [2025-09-17T17:16:40.471755] [DEBUG] [VALIDATOR ] ANF: All expected trading days are present. [2025-09-17T17:16:40.471861] [DEBUG] [VALIDATOR ] ANF: Primary data validation passed. [2025-09-17T17:16:40.472722] [INFO ] [MAIN ] ANF: Fetched primary data is valid. [2025-09-17T17:16:40.472774] [DEBUG] [LOCAL ] ANF: Saving primary data. [2025-09-17T17:16:40.474500] [DEBUG] [LOCAL ] ANF: Trimmed 75527 records to 52287 (keeping 200 days of data) [2025-09-17T17:16:40.778555] [INFO ] [REMOTE ] ANVS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T17:16:40.782753] [INFO ] [REMOTE ] ANVS: Full fetch complete (37090 records). [2025-09-17T17:16:40.783389] [DEBUG] [VALIDATOR ] ANVS: Validating primary data. [2025-09-17T17:16:41.187269] [DEBUG] [VALIDATOR ] ANVS: All expected trading days are present. [2025-09-17T17:16:41.187937] [DEBUG] [VALIDATOR ] ANVS: Primary data validation passed. [2025-09-17T17:16:41.188750] [INFO ] [MAIN ] ANVS: Fetched primary data is valid. [2025-09-17T17:16:41.189126] [DEBUG] [LOCAL ] ANVS: Saving primary data. [2025-09-17T17:16:41.192311] [DEBUG] [LOCAL ] ANF: Primary data saved (52287 records). [2025-09-17T17:16:41.192561] [INFO ] [MAIN ] ANF: Full history saved. [2025-09-17T17:16:41.192745] [INFO ] [MAIN ] Update Progress: 119/2371 symbols completed. ANF took 42.4s. Estimated remaining: 5h 15m 11s. Rate: 7.1 symbols/min [2025-09-17T17:16:41.193220] [DEBUG] [LOCAL ] ANVS: Trimmed 37090 records to 23443 (keeping 200 days of data) [2025-09-17T17:16:41.328890] [DEBUG] [LOCAL ] ANVS: Primary data saved (23443 records). [2025-09-17T17:16:41.329031] [INFO ] [MAIN ] ANVS: Full history saved. [2025-09-17T17:16:41.329117] [INFO ] [MAIN ] Update Progress: 120/2371 symbols completed. ANVS took 18.8s. Estimated remaining: 5h 12m 28s. Rate: 7.2 symbols/min [2025-09-17T17:16:41.952111] [INFO ] [MAIN ] AOMD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:16:41.932863] [INFO ] [MAIN ] AOMR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:16:42.031856] [INFO ] [MAIN ] AOD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:16:42.036908] [INFO ] [MAIN ] AON: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:16:42.036993] [DEBUG] [LOCAL ] AOMD: No existing data file found in primary storage. [2025-09-17T17:16:42.037557] [WARN ] [MAIN ] AOMD: No existing data found, performing full refresh instead. [2025-09-17T17:16:42.039022] [INFO ] [MAIN ] AOMD: Wiping existing primary data before full refresh. [2025-09-17T17:16:42.042774] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-17T17:16:42.042884] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-17T17:16:42.042927] [INFO ] [MAIN ] AOMD: Starting full primary refresh. [2025-09-17T17:16:42.179249] [DEBUG] [LOCAL ] AOMR: Loaded 17073 existing records from primary storage. [2025-09-17T17:16:42.185377] [INFO ] [MAIN ] AOMR: Loaded 17073 existing records. [2025-09-17T17:16:42.504856] [DEBUG] [LOCAL ] AOD: Loaded 30403 existing records from primary storage. [2025-09-17T17:16:42.505878] [DEBUG] [LOCAL ] AON: Loaded 45693 existing records from primary storage. [2025-09-17T17:16:42.506346] [INFO ] [MAIN ] AOD: Loaded 30403 existing records. [2025-09-17T17:16:42.516959] [INFO ] [MAIN ] AON: Loaded 45693 existing records. [2025-09-17T17:16:42.741334] [INFO ] [REMOTE ] AOMD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:16:42.819333] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-11. [2025-09-17T17:16:42.819046] [WARN ] [MAIN ] AOMR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:16:42.873746] [INFO ] [MAIN ] AOMR: Wiping existing primary data before full refresh. [2025-09-17T17:16:42.874084] [INFO ] [LOCAL ] AOMR: Starting deletion of primary data. [2025-09-17T17:16:42.916012] [DEBUG] [LOCAL ] AOMR: Deleted primary data file. [2025-09-17T17:16:42.992682] [INFO ] [MAIN ] AOMR: Starting full primary refresh. [2025-09-17T17:16:43.008377] [WARN ] [MAIN ] AOD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:16:43.058175] [WARN ] [MAIN ] AON: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:16:43.115629] [INFO ] [MAIN ] AON: Wiping existing primary data before full refresh. [2025-09-17T17:16:43.120868] [INFO ] [MAIN ] AOD: Wiping existing primary data before full refresh. [2025-09-17T17:16:43.132831] [INFO ] [LOCAL ] AON: Starting deletion of primary data. [2025-09-17T17:16:43.141214] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:43.144808] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-17T17:16:43.150835] [DEBUG] [LOCAL ] AOD: Deleted primary data file. [2025-09-17T17:16:43.150889] [DEBUG] [LOCAL ] AON: Deleted primary data file. [2025-09-17T17:16:43.161546] [INFO ] [MAIN ] AON: Starting full primary refresh. [2025-09-17T17:16:43.151003] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-11 [2025-09-17T17:16:43.161487] [INFO ] [MAIN ] AOD: Starting full primary refresh. [2025-09-17T17:16:43.222164] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2024-12. [2025-09-17T17:16:43.732226] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:43.955940] [WARN ] [REMOTE ] AOMD: No data returned for month 2024-12 [2025-09-17T17:16:44.028202] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-01. [2025-09-17T17:16:44.031464] [INFO ] [REMOTE ] AOMR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:16:44.115690] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-11. [2025-09-17T17:16:44.189771] [INFO ] [REMOTE ] AON: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:16:44.190210] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-11. [2025-09-17T17:16:44.275200] [INFO ] [REMOTE ] AOD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:16:44.415787] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-11. [2025-09-17T17:16:44.475383] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:44.476004] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-01 [2025-09-17T17:16:45.139280] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T17:16:45.215783] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-02. [2025-09-17T17:16:45.474178] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:45.474486] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-02 [2025-09-17T17:16:45.671357] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T17:16:45.879339] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T17:16:46.015771] [INFO ] [REMOTE ] AOD: Fetching primary data for 2024-12. [2025-09-17T17:16:46.815755] [INFO ] [REMOTE ] AON: Fetching primary data for 2024-12. [2025-09-17T17:16:47.141376] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T17:16:47.615783] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-01. [2025-09-17T17:16:48.301960] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T17:16:48.415747] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2024-12. [2025-09-17T17:16:48.937414] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T17:16:48.953309] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T17:16:49.215761] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-01. [2025-09-17T17:16:50.015776] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-02. [2025-09-17T17:16:50.815756] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-03. [2025-09-17T17:16:50.871602] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T17:16:51.132017] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T17:16:51.321711] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:51.322022] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-03 [2025-09-17T17:16:51.615772] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-03. [2025-09-17T17:16:52.415772] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-01. [2025-09-17T17:16:52.578838] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T17:16:52.947895] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T17:16:53.215797] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-02. [2025-09-17T17:16:54.015794] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-02. [2025-09-17T17:16:54.219589] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T17:16:54.815813] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-04. [2025-09-17T17:16:55.114403] [DEBUG] [REMOTE ] AOMD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:16:55.114750] [WARN ] [REMOTE ] AOMD: No data returned for month 2025-04 [2025-09-17T17:16:55.609939] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T17:16:55.618019] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-03. [2025-09-17T17:16:56.415756] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-03. [2025-09-17T17:16:56.753326] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T17:16:57.215824] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-05. [2025-09-17T17:16:57.733114] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T17:16:57.843279] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T17:16:58.015813] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-04. [2025-09-17T17:16:58.815789] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-06. [2025-09-17T17:16:59.087396] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T17:16:59.134276] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T17:16:59.615775] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-07. [2025-09-17T17:16:59.986812] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-17T17:17:00.415784] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-04. [2025-09-17T17:17:01.215854] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-08. [2025-09-17T17:17:01.566974] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-17T17:17:02.015919] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-05. [2025-09-17T17:17:02.099412] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T17:17:02.815844] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-04. [2025-09-17T17:17:03.004344] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T17:17:03.615795] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-06. [2025-09-17T17:17:04.212792] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T17:17:04.257696] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T17:17:04.415787] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-05. [2025-09-17T17:17:05.215788] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-07. [2025-09-17T17:17:05.641234] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T17:17:06.015802] [INFO ] [REMOTE ] AOMD: Fetching primary data for 2025-09. [2025-09-17T17:17:06.068918] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T17:17:06.522381] [INFO ] [REMOTE ] AOMD: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T17:17:06.523301] [INFO ] [REMOTE ] AOMD: Full fetch complete (1689 records). [2025-09-17T17:17:06.523379] [DEBUG] [VALIDATOR ] AOMD: Validating primary data. [2025-09-17T17:17:06.711250] [WARN ] [VALIDATOR ] AOMD: Validation failed - insufficient historical data. Have 79 unique days, need 200 days [2025-09-17T17:17:06.711455] [FATAL] [MAIN ] AOMD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:17:06.711499] [WARN ] [MAIN ] AOMD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:17:06.711548] [INFO ] [LOCAL ] AOMD: Starting deletion of primary data. [2025-09-17T17:17:06.711619] [DEBUG] [LOCAL ] AOMD: No primary data file found to delete. [2025-09-17T17:17:06.711680] [INFO ] [LOCAL ] AOMD: Starting deletion of derivative data. [2025-09-17T17:17:06.711778] [DEBUG] [LOCAL ] AOMD: No derivative data file found to delete. [2025-09-17T17:17:06.711847] [INFO ] [MAIN ] Update Progress: 121/2371 symbols completed. AOMD took 25.4s. Estimated remaining: 5h 17m 37s. Rate: 7.1 symbols/min [2025-09-17T17:17:06.818459] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-05. [2025-09-17T17:17:06.895595] [INFO ] [MAIN ] AORT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:17:06.924940] [DEBUG] [LOCAL ] AORT: Loaded 29976 existing records from primary storage. [2025-09-17T17:17:06.925112] [INFO ] [MAIN ] AORT: Loaded 29976 existing records. [2025-09-17T17:17:07.112590] [WARN ] [MAIN ] AORT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:17:07.112843] [INFO ] [MAIN ] AORT: Wiping existing primary data before full refresh. [2025-09-17T17:17:07.112896] [INFO ] [LOCAL ] AORT: Starting deletion of primary data. [2025-09-17T17:17:07.114077] [DEBUG] [LOCAL ] AORT: Deleted primary data file. [2025-09-17T17:17:07.114134] [INFO ] [MAIN ] AORT: Starting full primary refresh. [2025-09-17T17:17:07.490068] [INFO ] [REMOTE ] AORT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:17:07.615772] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-11. [2025-09-17T17:17:08.415796] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-06. [2025-09-17T17:17:08.607530] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T17:17:08.629990] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T17:17:09.215755] [INFO ] [REMOTE ] AORT: Fetching primary data for 2024-12. [2025-09-17T17:17:09.640753] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T17:17:10.015828] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-08. [2025-09-17T17:17:10.087262] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T17:17:10.815798] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-06. [2025-09-17T17:17:11.224620] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T17:17:11.615810] [INFO ] [REMOTE ] AOMR: Fetching primary data for 2025-09. [2025-09-17T17:17:12.293873] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T17:17:12.415805] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-07. [2025-09-17T17:17:12.776447] [INFO ] [REMOTE ] AOMR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T17:17:12.781022] [INFO ] [REMOTE ] AOMR: Full fetch complete (23044 records). [2025-09-17T17:17:12.781189] [DEBUG] [VALIDATOR ] AOMR: Validating primary data. [2025-09-17T17:17:13.178182] [DEBUG] [VALIDATOR ] AOMR: All expected trading days are present. [2025-09-17T17:17:13.178267] [DEBUG] [VALIDATOR ] AOMR: Primary data validation passed. [2025-09-17T17:17:13.178585] [INFO ] [MAIN ] AOMR: Fetched primary data is valid. [2025-09-17T17:17:13.178623] [DEBUG] [LOCAL ] AOMR: Saving primary data. [2025-09-17T17:17:13.179441] [DEBUG] [LOCAL ] AOMR: Trimmed 23044 records to 17076 (keeping 200 days of data) [2025-09-17T17:17:13.225344] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-01. [2025-09-17T17:17:13.291904] [DEBUG] [LOCAL ] AOMR: Primary data saved (17076 records). [2025-09-17T17:17:13.292173] [INFO ] [MAIN ] AOMR: Full history saved. [2025-09-17T17:17:13.292307] [INFO ] [MAIN ] Update Progress: 122/2371 symbols completed. AOMR took 32.0s. Estimated remaining: 5h 16m 53s. Rate: 7.1 symbols/min [2025-09-17T17:17:13.475257] [INFO ] [MAIN ] AOS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:17:13.521538] [DEBUG] [LOCAL ] AOS: Loaded 49470 existing records from primary storage. [2025-09-17T17:17:13.521736] [INFO ] [MAIN ] AOS: Loaded 49470 existing records. [2025-09-17T17:17:13.707878] [WARN ] [MAIN ] AOS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:17:13.708160] [INFO ] [MAIN ] AOS: Wiping existing primary data before full refresh. [2025-09-17T17:17:13.708220] [INFO ] [LOCAL ] AOS: Starting deletion of primary data. [2025-09-17T17:17:13.709929] [DEBUG] [LOCAL ] AOS: Deleted primary data file. [2025-09-17T17:17:13.709984] [INFO ] [MAIN ] AOS: Starting full primary refresh. [2025-09-17T17:17:14.019468] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-07. [2025-09-17T17:17:14.094516] [INFO ] [REMOTE ] AOS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:17:14.112099] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T17:17:14.144152] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T17:17:14.815803] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-02. [2025-09-17T17:17:15.490628] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T17:17:15.615781] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-08. [2025-09-17T17:17:16.152349] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T17:17:16.415800] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-08. [2025-09-17T17:17:16.814503] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T17:17:17.215777] [INFO ] [REMOTE ] AOD: Fetching primary data for 2025-09. [2025-09-17T17:17:17.667703] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T17:17:18.015789] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-11. [2025-09-17T17:17:18.571255] [INFO ] [REMOTE ] AOD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T17:17:18.575760] [INFO ] [REMOTE ] AOD: Full fetch complete (43858 records). [2025-09-17T17:17:18.575875] [DEBUG] [VALIDATOR ] AOD: Validating primary data. [2025-09-17T17:17:18.576849] [FATAL] [VALIDATOR ] AOD: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:17:18.576975] [FATAL] [MAIN ] AOD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:17:18.577036] [WARN ] [MAIN ] AOD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:17:18.577106] [INFO ] [LOCAL ] AOD: Starting deletion of primary data. [2025-09-17T17:17:18.577204] [DEBUG] [LOCAL ] AOD: No primary data file found to delete. [2025-09-17T17:17:18.577260] [INFO ] [LOCAL ] AOD: Starting deletion of derivative data. [2025-09-17T17:17:18.577611] [DEBUG] [LOCAL ] AOD: Deleted derivative data file. [2025-09-17T17:17:18.577766] [INFO ] [MAIN ] Update Progress: 123/2371 symbols completed. AOD took 37.2s. Estimated remaining: 5h 15m 47s. Rate: 7.1 symbols/min [2025-09-17T17:17:18.754781] [INFO ] [MAIN ] AP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:17:18.763451] [DEBUG] [LOCAL ] AP: Loaded 6759 existing records from primary storage. [2025-09-17T17:17:18.763571] [INFO ] [MAIN ] AP: Loaded 6759 existing records. [2025-09-17T17:17:18.825598] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-03. [2025-09-17T17:17:18.943282] [WARN ] [MAIN ] AP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:17:18.943549] [INFO ] [MAIN ] AP: Wiping existing primary data before full refresh. [2025-09-17T17:17:18.943598] [INFO ] [LOCAL ] AP: Starting deletion of primary data. [2025-09-17T17:17:18.944003] [DEBUG] [LOCAL ] AP: Deleted primary data file. [2025-09-17T17:17:18.944069] [INFO ] [MAIN ] AP: Starting full primary refresh. [2025-09-17T17:17:19.306684] [INFO ] [REMOTE ] AP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:17:19.615846] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-11. [2025-09-17T17:17:19.723931] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T17:17:20.415814] [INFO ] [REMOTE ] AON: Fetching primary data for 2025-09. [2025-09-17T17:17:20.439839] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T17:17:20.461306] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T17:17:21.215774] [INFO ] [REMOTE ] AOS: Fetching primary data for 2024-12. [2025-09-17T17:17:21.887465] [INFO ] [REMOTE ] AON: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T17:17:21.893511] [INFO ] [REMOTE ] AON: Full fetch complete (64686 records). [2025-09-17T17:17:21.893666] [DEBUG] [VALIDATOR ] AON: Validating primary data. [2025-09-17T17:17:22.020953] [INFO ] [REMOTE ] AP: Fetching primary data for 2024-12. [2025-09-17T17:17:22.306037] [DEBUG] [VALIDATOR ] AON: All expected trading days are present. [2025-09-17T17:17:22.306135] [DEBUG] [VALIDATOR ] AON: Primary data validation passed. [2025-09-17T17:17:22.306865] [INFO ] [MAIN ] AON: Fetched primary data is valid. [2025-09-17T17:17:22.306914] [DEBUG] [LOCAL ] AON: Saving primary data. [2025-09-17T17:17:22.308310] [DEBUG] [LOCAL ] AON: Trimmed 64686 records to 45682 (keeping 200 days of data) [2025-09-17T17:17:22.459383] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T17:17:22.485439] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T17:17:22.653816] [DEBUG] [LOCAL ] AON: Primary data saved (45682 records). [2025-09-17T17:17:22.653963] [INFO ] [MAIN ] AON: Full history saved. [2025-09-17T17:17:22.654574] [INFO ] [MAIN ] Update Progress: 124/2371 symbols completed. AON took 41.3s. Estimated remaining: 5h 14m 20s. Rate: 7.1 symbols/min [2025-09-17T17:17:22.824016] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-01. [2025-09-17T17:17:22.826755] [INFO ] [MAIN ] APAM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:17:22.869329] [DEBUG] [LOCAL ] APAM: Loaded 36872 existing records from primary storage. [2025-09-17T17:17:22.869475] [INFO ] [MAIN ] APAM: Loaded 36872 existing records. [2025-09-17T17:17:23.049937] [WARN ] [MAIN ] APAM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:17:23.050225] [INFO ] [MAIN ] APAM: Wiping existing primary data before full refresh. [2025-09-17T17:17:23.050271] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-17T17:17:23.051619] [DEBUG] [LOCAL ] APAM: Deleted primary data file. [2025-09-17T17:17:23.051692] [INFO ] [MAIN ] APAM: Starting full primary refresh. [2025-09-17T17:17:23.352046] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T17:17:23.426828] [INFO ] [REMOTE ] APAM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:17:23.615799] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-04. [2025-09-17T17:17:24.415779] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-02. [2025-09-17T17:17:24.727106] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T17:17:25.045708] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T17:17:25.215785] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-11. [2025-09-17T17:17:26.015778] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-05. [2025-09-17T17:17:26.704397] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T17:17:26.815803] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-01. [2025-09-17T17:17:27.320911] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T17:17:27.615785] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-06. [2025-09-17T17:17:28.415778] [INFO ] [REMOTE ] APAM: Fetching primary data for 2024-12. [2025-09-17T17:17:28.579293] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T17:17:28.827676] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T17:17:29.215833] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-07. [2025-09-17T17:17:29.387754] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T17:17:30.015792] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-02. [2025-09-17T17:17:30.332934] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T17:17:30.815766] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-03. [2025-09-17T17:17:31.367436] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T17:17:31.380007] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T17:17:31.615764] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-04. [2025-09-17T17:17:32.220883] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T17:17:32.415767] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-01. [2025-09-17T17:17:33.215766] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-05. [2025-09-17T17:17:33.848235] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T17:17:33.980540] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T17:17:34.015737] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-06. [2025-09-17T17:17:34.815755] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-03. [2025-09-17T17:17:34.866184] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T17:17:35.615772] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-08. [2025-09-17T17:17:36.415790] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-07. [2025-09-17T17:17:36.452218] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T17:17:36.520685] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T17:17:37.215791] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-04. [2025-09-17T17:17:37.245530] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T17:17:38.015848] [INFO ] [REMOTE ] AORT: Fetching primary data for 2025-09. [2025-09-17T17:17:38.468661] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T17:17:38.815805] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-05. [2025-09-17T17:17:39.412050] [INFO ] [REMOTE ] AORT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T17:17:39.416342] [INFO ] [REMOTE ] AORT: Full fetch complete (41431 records). [2025-09-17T17:17:39.416463] [DEBUG] [VALIDATOR ] AORT: Validating primary data. [2025-09-17T17:17:39.621112] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-02. [2025-09-17T17:17:39.802540] [DEBUG] [VALIDATOR ] AORT: All expected trading days are present. [2025-09-17T17:17:39.802636] [DEBUG] [VALIDATOR ] AORT: Primary data validation passed. [2025-09-17T17:17:39.803121] [INFO ] [MAIN ] AORT: Fetched primary data is valid. [2025-09-17T17:17:39.803183] [DEBUG] [LOCAL ] AORT: Saving primary data. [2025-09-17T17:17:39.804316] [DEBUG] [LOCAL ] AORT: Trimmed 41431 records to 29956 (keeping 200 days of data) [2025-09-17T17:17:39.987868] [DEBUG] [LOCAL ] AORT: Primary data saved (29956 records). [2025-09-17T17:17:39.988100] [INFO ] [MAIN ] AORT: Full history saved. [2025-09-17T17:17:39.988203] [INFO ] [MAIN ] Update Progress: 125/2371 symbols completed. AORT took 33.3s. Estimated remaining: 5h 16m 52s. Rate: 7.1 symbols/min [2025-09-17T17:17:40.164798] [INFO ] [MAIN ] APD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:17:40.214187] [DEBUG] [LOCAL ] APD: Loaded 45559 existing records from primary storage. [2025-09-17T17:17:40.230033] [INFO ] [MAIN ] APD: Loaded 45559 existing records. [2025-09-17T17:17:40.318116] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T17:17:40.431224] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-06. [2025-09-17T17:17:40.435710] [WARN ] [MAIN ] APD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:17:40.436812] [INFO ] [MAIN ] APD: Wiping existing primary data before full refresh. [2025-09-17T17:17:40.436860] [INFO ] [LOCAL ] APD: Starting deletion of primary data. [2025-09-17T17:17:40.438731] [DEBUG] [LOCAL ] APD: Deleted primary data file. [2025-09-17T17:17:40.438786] [INFO ] [MAIN ] APD: Starting full primary refresh. [2025-09-17T17:17:40.818010] [INFO ] [REMOTE ] APD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:17:41.215811] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-11. [2025-09-17T17:17:41.255827] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T17:17:41.809299] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T17:17:42.015774] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-03. [2025-09-17T17:17:42.815779] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-08. [2025-09-17T17:17:42.900698] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T17:17:43.292026] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T17:17:43.539028] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T17:17:43.615770] [INFO ] [REMOTE ] AP: Fetching primary data for 2025-09. [2025-09-17T17:17:44.332358] [INFO ] [REMOTE ] AP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T17:17:44.333759] [INFO ] [REMOTE ] AP: Full fetch complete (8624 records). [2025-09-17T17:17:44.333829] [DEBUG] [VALIDATOR ] AP: Validating primary data. [2025-09-17T17:17:44.420959] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-04. [2025-09-17T17:17:44.720600] [DEBUG] [VALIDATOR ] AP: All expected trading days are present. [2025-09-17T17:17:44.720696] [DEBUG] [VALIDATOR ] AP: Primary data validation passed. [2025-09-17T17:17:44.720906] [INFO ] [MAIN ] AP: Fetched primary data is valid. [2025-09-17T17:17:44.720943] [DEBUG] [LOCAL ] AP: Saving primary data. [2025-09-17T17:17:44.721367] [DEBUG] [LOCAL ] AP: Trimmed 8624 records to 6801 (keeping 200 days of data) [2025-09-17T17:17:44.761062] [DEBUG] [LOCAL ] AP: Primary data saved (6801 records). [2025-09-17T17:17:44.761206] [INFO ] [MAIN ] AP: Full history saved. [2025-09-17T17:17:44.761295] [INFO ] [MAIN ] Update Progress: 126/2371 symbols completed. AP took 26.2s. Estimated remaining: 5h 15m 38s. Rate: 7.1 symbols/min [2025-09-17T17:17:44.933247] [INFO ] [MAIN ] APG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:17:44.933406] [DEBUG] [LOCAL ] APG: No existing data file found in primary storage. [2025-09-17T17:17:44.933445] [WARN ] [MAIN ] APG: No existing data found, performing full refresh instead. [2025-09-17T17:17:44.933566] [INFO ] [MAIN ] APG: Wiping existing primary data before full refresh. [2025-09-17T17:17:44.933604] [INFO ] [LOCAL ] APG: Starting deletion of primary data. [2025-09-17T17:17:44.933696] [DEBUG] [LOCAL ] APG: No primary data file found to delete. [2025-09-17T17:17:44.933755] [INFO ] [MAIN ] APG: Starting full primary refresh. [2025-09-17T17:17:45.220921] [INFO ] [REMOTE ] APD: Fetching primary data for 2024-12. [2025-09-17T17:17:45.288828] [INFO ] [REMOTE ] APG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:17:45.866961] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T17:17:46.015731] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-05. [2025-09-17T17:17:46.815783] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-07. [2025-09-17T17:17:47.199474] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T17:17:47.281298] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T17:17:47.615767] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-11. [2025-09-17T17:17:48.415774] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-06. [2025-09-17T17:17:48.589707] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T17:17:49.123408] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T17:17:49.215768] [INFO ] [REMOTE ] APG: Fetching primary data for 2024-12. [2025-09-17T17:17:49.813004] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T17:17:50.015761] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-01. [2025-09-17T17:17:50.452592] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T17:17:50.815820] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-01. [2025-09-17T17:17:51.492316] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T17:17:51.615776] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-02. [2025-09-17T17:17:52.004239] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T17:17:52.415791] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-08. [2025-09-17T17:17:52.920249] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T17:17:53.215798] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-03. [2025-09-17T17:17:53.681191] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T17:17:54.015881] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-07. [2025-09-17T17:17:54.680787] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T17:17:54.815736] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-04. [2025-09-17T17:17:55.527937] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T17:17:55.615728] [INFO ] [REMOTE ] AOS: Fetching primary data for 2025-09. [2025-09-17T17:17:56.415768] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-02. [2025-09-17T17:17:56.517139] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T17:17:57.215822] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-08. [2025-09-17T17:17:57.319705] [INFO ] [REMOTE ] AOS: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T17:17:57.326837] [INFO ] [REMOTE ] AOS: Full fetch complete (70577 records). [2025-09-17T17:17:57.326992] [DEBUG] [VALIDATOR ] AOS: Validating primary data. [2025-09-17T17:17:57.730500] [DEBUG] [VALIDATOR ] AOS: All expected trading days are present. [2025-09-17T17:17:57.730629] [DEBUG] [VALIDATOR ] AOS: Primary data validation passed. [2025-09-17T17:17:57.731398] [INFO ] [MAIN ] AOS: Fetched primary data is valid. [2025-09-17T17:17:57.731501] [DEBUG] [LOCAL ] AOS: Saving primary data. [2025-09-17T17:17:57.733133] [DEBUG] [LOCAL ] AOS: Trimmed 70577 records to 49460 (keeping 200 days of data) [2025-09-17T17:17:57.758922] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T17:17:58.015819] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-03. [2025-09-17T17:17:58.078423] [DEBUG] [LOCAL ] AOS: Primary data saved (49460 records). [2025-09-17T17:17:58.078570] [INFO ] [MAIN ] AOS: Full history saved. [2025-09-17T17:17:58.078682] [INFO ] [MAIN ] Update Progress: 127/2371 symbols completed. AOS took 44.8s. Estimated remaining: 5h 16m 55s. Rate: 7.1 symbols/min [2025-09-17T17:17:58.257107] [INFO ] [MAIN ] APH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:17:58.310869] [DEBUG] [LOCAL ] APH: Loaded 53691 existing records from primary storage. [2025-09-17T17:17:58.311045] [INFO ] [MAIN ] APH: Loaded 53691 existing records. [2025-09-17T17:17:58.493124] [WARN ] [MAIN ] APH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:17:58.493562] [INFO ] [MAIN ] APH: Wiping existing primary data before full refresh. [2025-09-17T17:17:58.493621] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-17T17:17:58.501331] [DEBUG] [LOCAL ] APH: Deleted primary data file. [2025-09-17T17:17:58.510616] [INFO ] [MAIN ] APH: Starting full primary refresh. [2025-09-17T17:17:58.595339] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T17:17:58.820955] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-05. [2025-09-17T17:17:58.918572] [INFO ] [REMOTE ] APH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:17:59.615826] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-11. [2025-09-17T17:17:59.858403] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T17:18:00.415783] [INFO ] [REMOTE ] APAM: Fetching primary data for 2025-09. [2025-09-17T17:18:00.759203] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T17:18:01.215870] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-04. [2025-09-17T17:18:01.380005] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T17:18:01.613753] [INFO ] [REMOTE ] APAM: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T17:18:01.619252] [INFO ] [REMOTE ] APAM: Full fetch complete (51292 records). [2025-09-17T17:18:01.619408] [DEBUG] [VALIDATOR ] APAM: Validating primary data. [2025-09-17T17:18:01.620984] [FATAL] [VALIDATOR ] APAM: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:18:01.621068] [FATAL] [MAIN ] APAM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:18:01.621115] [WARN ] [MAIN ] APAM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:18:01.621167] [INFO ] [LOCAL ] APAM: Starting deletion of primary data. [2025-09-17T17:18:01.621235] [DEBUG] [LOCAL ] APAM: No primary data file found to delete. [2025-09-17T17:18:01.621272] [INFO ] [LOCAL ] APAM: Starting deletion of derivative data. [2025-09-17T17:18:01.621810] [DEBUG] [LOCAL ] APAM: Deleted derivative data file. [2025-09-17T17:18:01.622848] [INFO ] [MAIN ] Update Progress: 128/2371 symbols completed. APAM took 39.0s. Estimated remaining: 5h 15m 21s. Rate: 7.1 symbols/min [2025-09-17T17:18:01.796155] [INFO ] [MAIN ] APLE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:18:01.862084] [DEBUG] [LOCAL ] APLE: Loaded 52087 existing records from primary storage. [2025-09-17T17:18:01.862249] [INFO ] [MAIN ] APLE: Loaded 52087 existing records. [2025-09-17T17:18:02.022888] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-06. [2025-09-17T17:18:02.045236] [WARN ] [MAIN ] APLE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:18:02.045538] [INFO ] [MAIN ] APLE: Wiping existing primary data before full refresh. [2025-09-17T17:18:02.045585] [INFO ] [LOCAL ] APLE: Starting deletion of primary data. [2025-09-17T17:18:02.048322] [DEBUG] [LOCAL ] APLE: Deleted primary data file. [2025-09-17T17:18:02.048385] [INFO ] [MAIN ] APLE: Starting full primary refresh. [2025-09-17T17:18:02.420522] [INFO ] [REMOTE ] APLE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:18:02.545415] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T17:18:02.815777] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-05. [2025-09-17T17:18:03.615760] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-11. [2025-09-17T17:18:03.673730] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:18:04.415781] [INFO ] [REMOTE ] APH: Fetching primary data for 2024-12. [2025-09-17T17:18:04.632904] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T17:18:05.215773] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-06. [2025-09-17T17:18:05.350522] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T17:18:05.822387] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T17:18:06.015830] [INFO ] [REMOTE ] APLE: Fetching primary data for 2024-12. [2025-09-17T17:18:06.803001] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T17:18:06.815683] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-07. [2025-09-17T17:18:07.625772] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-01. [2025-09-17T17:18:07.631792] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T17:18:08.173286] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T17:18:08.415816] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-08. [2025-09-17T17:18:09.222930] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-01. [2025-09-17T17:18:09.244413] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T17:18:09.836939] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T17:18:10.015785] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-02. [2025-09-17T17:18:10.815828] [INFO ] [REMOTE ] APD: Fetching primary data for 2025-09. [2025-09-17T17:18:10.970174] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T17:18:11.615838] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-02. [2025-09-17T17:18:11.961852] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T17:18:12.282596] [INFO ] [REMOTE ] APD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T17:18:12.288150] [INFO ] [REMOTE ] APD: Full fetch complete (66425 records). [2025-09-17T17:18:12.288279] [DEBUG] [VALIDATOR ] APD: Validating primary data. [2025-09-17T17:18:12.431671] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-07. [2025-09-17T17:18:12.702475] [DEBUG] [VALIDATOR ] APD: All expected trading days are present. [2025-09-17T17:18:12.702562] [DEBUG] [VALIDATOR ] APD: Primary data validation passed. [2025-09-17T17:18:12.703227] [INFO ] [MAIN ] APD: Fetched primary data is valid. [2025-09-17T17:18:12.703275] [DEBUG] [LOCAL ] APD: Saving primary data. [2025-09-17T17:18:12.704621] [DEBUG] [LOCAL ] APD: Trimmed 66425 records to 45572 (keeping 200 days of data) [2025-09-17T17:18:12.999361] [DEBUG] [LOCAL ] APD: Primary data saved (45572 records). [2025-09-17T17:18:12.999528] [INFO ] [MAIN ] APD: Full history saved. [2025-09-17T17:18:12.999705] [INFO ] [MAIN ] Update Progress: 129/2371 symbols completed. APD took 33.0s. Estimated remaining: 5h 16m 3s. Rate: 7.1 symbols/min [2025-09-17T17:18:13.173612] [INFO ] [MAIN ] APO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:18:13.204427] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T17:18:13.215678] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-03. [2025-09-17T17:18:13.263551] [DEBUG] [LOCAL ] APO: Loaded 53385 existing records from primary storage. [2025-09-17T17:18:13.263760] [INFO ] [MAIN ] APO: Loaded 53385 existing records. [2025-09-17T17:18:13.454994] [WARN ] [MAIN ] APO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:18:13.455230] [INFO ] [MAIN ] APO: Wiping existing primary data before full refresh. [2025-09-17T17:18:13.455276] [INFO ] [LOCAL ] APO: Starting deletion of primary data. [2025-09-17T17:18:13.456885] [DEBUG] [LOCAL ] APO: Deleted primary data file. [2025-09-17T17:18:13.456963] [INFO ] [MAIN ] APO: Starting full primary refresh. [2025-09-17T17:18:13.843627] [INFO ] [REMOTE ] APO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:18:14.015775] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-11. [2025-09-17T17:18:14.622355] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-17T17:18:14.815790] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-03. [2025-09-17T17:18:15.021531] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T17:18:15.615771] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-08. [2025-09-17T17:18:16.042564] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-17T17:18:16.225185] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T17:18:16.415735] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-04. [2025-09-17T17:18:17.163518] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T17:18:17.215730] [INFO ] [REMOTE ] APG: Fetching primary data for 2025-09. [2025-09-17T17:18:17.972456] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T17:18:18.015774] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-05. [2025-09-17T17:18:18.815755] [INFO ] [REMOTE ] APO: Fetching primary data for 2024-12. [2025-09-17T17:18:18.850978] [INFO ] [REMOTE ] APG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T17:18:18.857483] [INFO ] [REMOTE ] APG: Full fetch complete (71154 records). [2025-09-17T17:18:18.857607] [DEBUG] [VALIDATOR ] APG: Validating primary data. [2025-09-17T17:18:19.255367] [DEBUG] [VALIDATOR ] APG: All expected trading days are present. [2025-09-17T17:18:19.255489] [DEBUG] [VALIDATOR ] APG: Primary data validation passed. [2025-09-17T17:18:19.256200] [INFO ] [MAIN ] APG: Fetched primary data is valid. [2025-09-17T17:18:19.256246] [DEBUG] [LOCAL ] APG: Saving primary data. [2025-09-17T17:18:19.257953] [DEBUG] [LOCAL ] APG: Trimmed 71154 records to 50240 (keeping 200 days of data) [2025-09-17T17:18:19.567049] [DEBUG] [LOCAL ] APG: Primary data saved (50240 records). [2025-09-17T17:18:19.567191] [INFO ] [MAIN ] APG: Full history saved. [2025-09-17T17:18:19.567297] [INFO ] [MAIN ] Update Progress: 130/2371 symbols completed. APG took 34.8s. Estimated remaining: 5h 15m 22s. Rate: 7.1 symbols/min [2025-09-17T17:18:19.632477] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-04. [2025-09-17T17:18:19.748928] [INFO ] [MAIN ] APOS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:18:19.757799] [DEBUG] [LOCAL ] APOS: Loaded 7511 existing records from primary storage. [2025-09-17T17:18:19.757896] [INFO ] [MAIN ] APOS: Loaded 7511 existing records. [2025-09-17T17:18:19.944506] [WARN ] [MAIN ] APOS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:18:19.944882] [INFO ] [MAIN ] APOS: Wiping existing primary data before full refresh. [2025-09-17T17:18:19.944992] [INFO ] [LOCAL ] APOS: Starting deletion of primary data. [2025-09-17T17:18:19.945476] [DEBUG] [LOCAL ] APOS: Deleted primary data file. [2025-09-17T17:18:19.945526] [INFO ] [MAIN ] APOS: Starting full primary refresh. [2025-09-17T17:18:20.273297] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-17T17:18:20.364480] [INFO ] [REMOTE ] APOS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:18:20.415748] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-11. [2025-09-17T17:18:20.780394] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T17:18:21.011222] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T17:18:21.220907] [INFO ] [REMOTE ] APOS: Fetching primary data for 2024-12. [2025-09-17T17:18:21.236826] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T17:18:21.959962] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T17:18:22.015819] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-01. [2025-09-17T17:18:22.815787] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-05. [2025-09-17T17:18:23.615794] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-01. [2025-09-17T17:18:23.867872] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T17:18:24.200655] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T17:18:24.262401] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T17:18:24.415780] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-02. [2025-09-17T17:18:24.886342] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T17:18:25.215772] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-03. [2025-09-17T17:18:25.949904] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T17:18:26.015785] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-04. [2025-09-17T17:18:26.799421] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T17:18:26.815730] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-05. [2025-09-17T17:18:27.615700] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-06. [2025-09-17T17:18:27.774955] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T17:18:28.415790] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-06. [2025-09-17T17:18:29.140045] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T17:18:29.215775] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-02. [2025-09-17T17:18:29.404492] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T17:18:30.015803] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-06. [2025-09-17T17:18:30.815784] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-07. [2025-09-17T17:18:31.106061] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T17:18:31.393944] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T17:18:31.615771] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-03. [2025-09-17T17:18:32.037346] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T17:18:32.415773] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-08. [2025-09-17T17:18:33.017250] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T17:18:33.215776] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-07. [2025-09-17T17:18:33.537948] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T17:18:34.015830] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-04. [2025-09-17T17:18:34.815848] [INFO ] [REMOTE ] APOS: Fetching primary data for 2025-09. [2025-09-17T17:18:35.014572] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T17:18:35.471563] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T17:18:35.505556] [INFO ] [REMOTE ] APOS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T17:18:35.507138] [INFO ] [REMOTE ] APOS: Full fetch complete (10420 records). [2025-09-17T17:18:35.507214] [DEBUG] [VALIDATOR ] APOS: Validating primary data. [2025-09-17T17:18:35.620824] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-07. [2025-09-17T17:18:35.877145] [DEBUG] [VALIDATOR ] APOS: All expected trading days are present. [2025-09-17T17:18:35.877225] [DEBUG] [VALIDATOR ] APOS: Primary data validation passed. [2025-09-17T17:18:35.877456] [INFO ] [MAIN ] APOS: Fetched primary data is valid. [2025-09-17T17:18:35.877498] [DEBUG] [LOCAL ] APOS: Saving primary data. [2025-09-17T17:18:35.877992] [DEBUG] [LOCAL ] APOS: Trimmed 10420 records to 7464 (keeping 200 days of data) [2025-09-17T17:18:35.924775] [DEBUG] [LOCAL ] APOS: Primary data saved (7464 records). [2025-09-17T17:18:35.924911] [INFO ] [MAIN ] APOS: Full history saved. [2025-09-17T17:18:35.924996] [INFO ] [MAIN ] Update Progress: 131/2371 symbols completed. APOS took 16.4s. Estimated remaining: 5h 17m 29s. Rate: 7.1 symbols/min [2025-09-17T17:18:36.096536] [INFO ] [MAIN ] APTV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:18:36.148030] [DEBUG] [LOCAL ] APTV: Loaded 52269 existing records from primary storage. [2025-09-17T17:18:36.148196] [INFO ] [MAIN ] APTV: Loaded 52269 existing records. [2025-09-17T17:18:36.328605] [WARN ] [MAIN ] APTV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:18:36.328867] [INFO ] [MAIN ] APTV: Wiping existing primary data before full refresh. [2025-09-17T17:18:36.328924] [INFO ] [LOCAL ] APTV: Starting deletion of primary data. [2025-09-17T17:18:36.330728] [DEBUG] [LOCAL ] APTV: Deleted primary data file. [2025-09-17T17:18:36.330782] [INFO ] [MAIN ] APTV: Starting full primary refresh. [2025-09-17T17:18:36.420851] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-08. [2025-09-17T17:18:36.703539] [INFO ] [REMOTE ] APTV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:18:37.215815] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-11. [2025-09-17T17:18:37.625045] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T17:18:37.864684] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T17:18:38.015758] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-05. [2025-09-17T17:18:38.815783] [INFO ] [REMOTE ] APLE: Fetching primary data for 2025-09. [2025-09-17T17:18:39.074374] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T17:18:39.615840] [INFO ] [REMOTE ] APTV: Fetching primary data for 2024-12. [2025-09-17T17:18:39.811687] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T17:18:40.415791] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-06. [2025-09-17T17:18:40.838188] [INFO ] [REMOTE ] APLE: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-17T17:18:40.844947] [INFO ] [REMOTE ] APLE: Full fetch complete (74049 records). [2025-09-17T17:18:40.845105] [DEBUG] [VALIDATOR ] APLE: Validating primary data. [2025-09-17T17:18:41.217754] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-08. [2025-09-17T17:18:41.240895] [DEBUG] [VALIDATOR ] APLE: All expected trading days are present. [2025-09-17T17:18:41.241021] [DEBUG] [VALIDATOR ] APLE: Primary data validation passed. [2025-09-17T17:18:41.241967] [INFO ] [MAIN ] APLE: Fetched primary data is valid. [2025-09-17T17:18:41.242186] [DEBUG] [LOCAL ] APLE: Saving primary data. [2025-09-17T17:18:41.244104] [DEBUG] [LOCAL ] APLE: Trimmed 74049 records to 52075 (keeping 200 days of data) [2025-09-17T17:18:41.368150] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T17:18:41.607477] [DEBUG] [LOCAL ] APLE: Primary data saved (52075 records). [2025-09-17T17:18:41.607631] [INFO ] [MAIN ] APLE: Full history saved. [2025-09-17T17:18:41.608343] [INFO ] [MAIN ] Update Progress: 132/2371 symbols completed. APLE took 40.0s. Estimated remaining: 5h 16m 33s. Rate: 7.1 symbols/min [2025-09-17T17:18:41.779018] [INFO ] [MAIN ] AQN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:18:41.832044] [DEBUG] [LOCAL ] AQN: Loaded 51986 existing records from primary storage. [2025-09-17T17:18:41.832204] [INFO ] [MAIN ] AQN: Loaded 51986 existing records. [2025-09-17T17:18:42.007563] [WARN ] [MAIN ] AQN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:18:42.007828] [INFO ] [MAIN ] AQN: Wiping existing primary data before full refresh. [2025-09-17T17:18:42.007872] [INFO ] [LOCAL ] AQN: Starting deletion of primary data. [2025-09-17T17:18:42.009101] [DEBUG] [LOCAL ] AQN: Deleted primary data file. [2025-09-17T17:18:42.009152] [INFO ] [MAIN ] AQN: Starting full primary refresh. [2025-09-17T17:18:42.040227] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-01. [2025-09-17T17:18:42.375974] [INFO ] [REMOTE ] AQN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:18:42.419729] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T17:18:42.815739] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-11. [2025-09-17T17:18:42.917918] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T17:18:43.615754] [INFO ] [REMOTE ] APH: Fetching primary data for 2025-09. [2025-09-17T17:18:43.994447] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T17:18:44.111780] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T17:18:44.415766] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-02. [2025-09-17T17:18:45.215776] [INFO ] [REMOTE ] AQN: Fetching primary data for 2024-12. [2025-09-17T17:18:45.635284] [INFO ] [REMOTE ] APH: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-17T17:18:45.641567] [INFO ] [REMOTE ] APH: Full fetch complete (77129 records). [2025-09-17T17:18:45.641704] [DEBUG] [VALIDATOR ] APH: Validating primary data. [2025-09-17T17:18:45.642495] [FATAL] [VALIDATOR ] APH: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:18:45.642580] [FATAL] [MAIN ] APH: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:18:45.642616] [WARN ] [MAIN ] APH: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:18:45.642677] [INFO ] [LOCAL ] APH: Starting deletion of primary data. [2025-09-17T17:18:45.642748] [DEBUG] [LOCAL ] APH: No primary data file found to delete. [2025-09-17T17:18:45.642784] [INFO ] [LOCAL ] APH: Starting deletion of derivative data. [2025-09-17T17:18:45.643057] [DEBUG] [LOCAL ] APH: Deleted derivative data file. [2025-09-17T17:18:45.643138] [INFO ] [MAIN ] Update Progress: 133/2371 symbols completed. APH took 47.6s. Estimated remaining: 5h 15m 9s. Rate: 7.1 symbols/min [2025-09-17T17:18:45.821223] [INFO ] [MAIN ] AQNB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:18:45.827470] [DEBUG] [LOCAL ] AQNB: Loaded 4213 existing records from primary storage. [2025-09-17T17:18:45.827571] [INFO ] [MAIN ] AQNB: Loaded 4213 existing records. [2025-09-17T17:18:46.016668] [WARN ] [MAIN ] AQNB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:18:46.016723] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-07. [2025-09-17T17:18:46.017907] [INFO ] [MAIN ] AQNB: Wiping existing primary data before full refresh. [2025-09-17T17:18:46.017968] [INFO ] [LOCAL ] AQNB: Starting deletion of primary data. [2025-09-17T17:18:46.018237] [DEBUG] [LOCAL ] AQNB: Deleted primary data file. [2025-09-17T17:18:46.018284] [INFO ] [MAIN ] AQNB: Starting full primary refresh. [2025-09-17T17:18:46.625819] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-17T17:18:46.652921] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T17:18:46.650832] [INFO ] [REMOTE ] AQNB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:18:46.815801] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-03. [2025-09-17T17:18:47.615857] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-11. [2025-09-17T17:18:47.978028] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T17:18:48.100445] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T17:18:48.415735] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2024-12. [2025-09-17T17:18:48.508630] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T17:18:49.027973] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T17:18:49.215768] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-01. [2025-09-17T17:18:49.608562] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-01 (0.39 seconds). [2025-09-17T17:18:50.015768] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-02. [2025-09-17T17:18:50.419422] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T17:18:50.815785] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-03. [2025-09-17T17:18:51.186760] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T17:18:51.615825] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-04. [2025-09-17T17:18:52.415820] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-04. [2025-09-17T17:18:53.002996] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T17:18:53.215766] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-01. [2025-09-17T17:18:53.340305] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T17:18:54.015801] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-05. [2025-09-17T17:18:54.601232] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T17:18:54.769426] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T17:18:54.815725] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-02. [2025-09-17T17:18:55.615766] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-08. [2025-09-17T17:18:56.415774] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-06. [2025-09-17T17:18:56.473300] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T17:18:57.169969] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T17:18:57.184845] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T17:18:57.215716] [INFO ] [REMOTE ] APO: Fetching primary data for 2025-09. [2025-09-17T17:18:58.015802] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-03. [2025-09-17T17:18:58.815745] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-07. [2025-09-17T17:18:59.013331] [INFO ] [REMOTE ] APO: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T17:18:59.020391] [INFO ] [REMOTE ] APO: Full fetch complete (77122 records). [2025-09-17T17:18:59.020577] [DEBUG] [VALIDATOR ] APO: Validating primary data. [2025-09-17T17:18:59.350469] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T17:18:59.436513] [DEBUG] [VALIDATOR ] APO: All expected trading days are present. [2025-09-17T17:18:59.436601] [DEBUG] [VALIDATOR ] APO: Primary data validation passed. [2025-09-17T17:18:59.437358] [INFO ] [MAIN ] APO: Fetched primary data is valid. [2025-09-17T17:18:59.437409] [DEBUG] [LOCAL ] APO: Saving primary data. [2025-09-17T17:18:59.438896] [DEBUG] [LOCAL ] APO: Trimmed 77122 records to 53385 (keeping 200 days of data) [2025-09-17T17:18:59.627204] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-08. [2025-09-17T17:18:59.820595] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T17:18:59.834549] [DEBUG] [LOCAL ] APO: Primary data saved (53385 records). [2025-09-17T17:18:59.835149] [INFO ] [MAIN ] APO: Full history saved. [2025-09-17T17:18:59.835355] [INFO ] [MAIN ] Update Progress: 134/2371 symbols completed. APO took 46.8s. Estimated remaining: 5h 16m 37s. Rate: 7.1 symbols/min [2025-09-17T17:19:00.014852] [INFO ] [MAIN ] AR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:19:00.067971] [DEBUG] [LOCAL ] AR: Loaded 53586 existing records from primary storage. [2025-09-17T17:19:00.068125] [INFO ] [MAIN ] AR: Loaded 53586 existing records. [2025-09-17T17:19:00.179003] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T17:19:00.264146] [WARN ] [MAIN ] AR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:19:00.264409] [INFO ] [MAIN ] AR: Wiping existing primary data before full refresh. [2025-09-17T17:19:00.264454] [INFO ] [LOCAL ] AR: Starting deletion of primary data. [2025-09-17T17:19:00.266006] [DEBUG] [LOCAL ] AR: Deleted primary data file. [2025-09-17T17:19:00.266059] [INFO ] [MAIN ] AR: Starting full primary refresh. [2025-09-17T17:19:00.419894] [INFO ] [REMOTE ] AQNB: Fetching primary data for 2025-09. [2025-09-17T17:19:00.634256] [INFO ] [REMOTE ] AR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:19:01.086335] [INFO ] [REMOTE ] AQNB: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T17:19:01.087424] [INFO ] [REMOTE ] AQNB: Full fetch complete (5977 records). [2025-09-17T17:19:01.087505] [DEBUG] [VALIDATOR ] AQNB: Validating primary data. [2025-09-17T17:19:01.228578] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-11. [2025-09-17T17:19:01.454791] [DEBUG] [VALIDATOR ] AQNB: All expected trading days are present. [2025-09-17T17:19:01.454874] [DEBUG] [VALIDATOR ] AQNB: Primary data validation passed. [2025-09-17T17:19:01.455058] [INFO ] [MAIN ] AQNB: Fetched primary data is valid. [2025-09-17T17:19:01.455094] [DEBUG] [LOCAL ] AQNB: Saving primary data. [2025-09-17T17:19:01.455477] [DEBUG] [LOCAL ] AQNB: Trimmed 5977 records to 4234 (keeping 200 days of data) [2025-09-17T17:19:01.483110] [DEBUG] [LOCAL ] AQNB: Primary data saved (4234 records). [2025-09-17T17:19:01.483251] [INFO ] [MAIN ] AQNB: Full history saved. [2025-09-17T17:19:01.483365] [INFO ] [MAIN ] Update Progress: 135/2371 symbols completed. AQNB took 15.8s. Estimated remaining: 5h 14m 35s. Rate: 7.1 symbols/min [2025-09-17T17:19:01.657658] [INFO ] [MAIN ] ARCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:19:01.699095] [DEBUG] [LOCAL ] ARCO: Loaded 44788 existing records from primary storage. [2025-09-17T17:19:01.699260] [INFO ] [MAIN ] ARCO: Loaded 44788 existing records. [2025-09-17T17:19:01.892843] [WARN ] [MAIN ] ARCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:19:01.893095] [INFO ] [MAIN ] ARCO: Wiping existing primary data before full refresh. [2025-09-17T17:19:01.893141] [INFO ] [LOCAL ] ARCO: Starting deletion of primary data. [2025-09-17T17:19:01.894707] [DEBUG] [LOCAL ] ARCO: Deleted primary data file. [2025-09-17T17:19:01.894767] [INFO ] [MAIN ] ARCO: Starting full primary refresh. [2025-09-17T17:19:02.020955] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-04. [2025-09-17T17:19:02.272575] [INFO ] [REMOTE ] ARCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:19:02.815901] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-11. [2025-09-17T17:19:03.144300] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T17:19:03.615819] [INFO ] [REMOTE ] AR: Fetching primary data for 2024-12. [2025-09-17T17:19:03.864611] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T17:19:04.415795] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-05. [2025-09-17T17:19:04.530356] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T17:19:05.032834] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T17:19:05.215798] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-05. [2025-09-17T17:19:05.890765] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T17:19:06.015800] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-06. [2025-09-17T17:19:06.815792] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2024-12. [2025-09-17T17:19:07.051250] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T17:19:07.615752] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-06. [2025-09-17T17:19:07.700280] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T17:19:08.415771] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-01. [2025-09-17T17:19:08.609738] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T17:19:09.215830] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-07. [2025-09-17T17:19:09.297355] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T17:19:09.746812] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T17:19:10.015870] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-07. [2025-09-17T17:19:10.815803] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-02. [2025-09-17T17:19:11.049793] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T17:19:11.615795] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-08. [2025-09-17T17:19:11.801983] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T17:19:12.190063] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T17:19:12.415790] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-03. [2025-09-17T17:19:13.215810] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-01. [2025-09-17T17:19:13.354210] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T17:19:14.015861] [INFO ] [REMOTE ] APTV: Fetching primary data for 2025-09. [2025-09-17T17:19:14.401123] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T17:19:14.731225] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T17:19:14.815789] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-02. [2025-09-17T17:19:15.591800] [INFO ] [REMOTE ] APTV: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T17:19:15.598704] [INFO ] [REMOTE ] APTV: Full fetch complete (75944 records). [2025-09-17T17:19:15.598833] [DEBUG] [VALIDATOR ] APTV: Validating primary data. [2025-09-17T17:19:15.621201] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-08. [2025-09-17T17:19:16.002263] [DEBUG] [VALIDATOR ] APTV: All expected trading days are present. [2025-09-17T17:19:16.002343] [DEBUG] [VALIDATOR ] APTV: Primary data validation passed. [2025-09-17T17:19:16.003141] [INFO ] [MAIN ] APTV: Fetched primary data is valid. [2025-09-17T17:19:16.003198] [DEBUG] [LOCAL ] APTV: Saving primary data. [2025-09-17T17:19:16.004726] [DEBUG] [LOCAL ] APTV: Trimmed 75944 records to 52265 (keeping 200 days of data) [2025-09-17T17:19:16.242069] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T17:19:16.351656] [DEBUG] [LOCAL ] APTV: Primary data saved (52265 records). [2025-09-17T17:19:16.351908] [INFO ] [MAIN ] APTV: Full history saved. [2025-09-17T17:19:16.352849] [INFO ] [MAIN ] Update Progress: 136/2371 symbols completed. APTV took 40.4s. Estimated remaining: 5h 16m 12s. Rate: 7.1 symbols/min [2025-09-17T17:19:16.420905] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-03. [2025-09-17T17:19:16.529703] [INFO ] [MAIN ] ARDC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:19:16.549177] [DEBUG] [LOCAL ] ARDC: Loaded 14850 existing records from primary storage. [2025-09-17T17:19:16.549310] [INFO ] [MAIN ] ARDC: Loaded 14850 existing records. [2025-09-17T17:19:16.729007] [WARN ] [MAIN ] ARDC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:19:16.729276] [INFO ] [MAIN ] ARDC: Wiping existing primary data before full refresh. [2025-09-17T17:19:16.729322] [INFO ] [LOCAL ] ARDC: Starting deletion of primary data. [2025-09-17T17:19:16.729968] [DEBUG] [LOCAL ] ARDC: Deleted primary data file. [2025-09-17T17:19:16.730018] [INFO ] [MAIN ] ARDC: Starting full primary refresh. [2025-09-17T17:19:17.108779] [INFO ] [REMOTE ] ARDC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:19:17.215787] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-11. [2025-09-17T17:19:17.586860] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T17:19:17.946488] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T17:19:17.973774] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T17:19:18.015728] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-04. [2025-09-17T17:19:18.815791] [INFO ] [REMOTE ] AQN: Fetching primary data for 2025-09. [2025-09-17T17:19:19.616922] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T17:19:19.615924] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2024-12. [2025-09-17T17:19:20.415783] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-04. [2025-09-17T17:19:20.472270] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T17:19:20.568869] [INFO ] [REMOTE ] AQN: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T17:19:20.575730] [INFO ] [REMOTE ] AQN: Full fetch complete (75098 records). [2025-09-17T17:19:20.575872] [DEBUG] [VALIDATOR ] AQN: Validating primary data. [2025-09-17T17:19:20.972036] [DEBUG] [VALIDATOR ] AQN: All expected trading days are present. [2025-09-17T17:19:20.972142] [DEBUG] [VALIDATOR ] AQN: Primary data validation passed. [2025-09-17T17:19:20.973063] [INFO ] [MAIN ] AQN: Fetched primary data is valid. [2025-09-17T17:19:20.973112] [DEBUG] [LOCAL ] AQN: Saving primary data. [2025-09-17T17:19:20.974664] [DEBUG] [LOCAL ] AQN: Trimmed 75098 records to 51981 (keeping 200 days of data) [2025-09-17T17:19:21.237186] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-05. [2025-09-17T17:19:21.280881] [DEBUG] [LOCAL ] AQN: Primary data saved (51981 records). [2025-09-17T17:19:21.281024] [INFO ] [MAIN ] AQN: Full history saved. [2025-09-17T17:19:21.281855] [INFO ] [MAIN ] Update Progress: 137/2371 symbols completed. AQN took 39.7s. Estimated remaining: 5h 15m 6s. Rate: 7.1 symbols/min [2025-09-17T17:19:21.453977] [INFO ] [MAIN ] ARDT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:19:21.485312] [DEBUG] [LOCAL ] ARDT: Loaded 28796 existing records from primary storage. [2025-09-17T17:19:21.485467] [INFO ] [MAIN ] ARDT: Loaded 28796 existing records. [2025-09-17T17:19:21.667345] [WARN ] [MAIN ] ARDT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:19:21.667574] [INFO ] [MAIN ] ARDT: Wiping existing primary data before full refresh. [2025-09-17T17:19:21.667626] [INFO ] [LOCAL ] ARDT: Starting deletion of primary data. [2025-09-17T17:19:21.668442] [DEBUG] [LOCAL ] ARDT: Deleted primary data file. [2025-09-17T17:19:21.668491] [INFO ] [MAIN ] ARDT: Starting full primary refresh. [2025-09-17T17:19:22.023746] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-01. [2025-09-17T17:19:22.027840] [INFO ] [REMOTE ] ARDT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:19:22.343385] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T17:19:22.820793] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-05. [2025-09-17T17:19:22.835198] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T17:19:22.975866] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T17:19:23.615792] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-02. [2025-09-17T17:19:24.415778] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-11. [2025-09-17T17:19:24.497769] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T17:19:24.708886] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T17:19:25.215767] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-03. [2025-09-17T17:19:25.834462] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T17:19:26.015752] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-06. [2025-09-17T17:19:26.084870] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T17:19:26.815808] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-06. [2025-09-17T17:19:27.615787] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-04. [2025-09-17T17:19:27.668945] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:19:28.216608] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T17:19:28.415771] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-07. [2025-09-17T17:19:28.909269] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T17:19:29.215765] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-05. [2025-09-17T17:19:30.015757] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2024-12. [2025-09-17T17:19:30.024490] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T17:19:30.127467] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T17:19:30.815801] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-07. [2025-09-17T17:19:31.248269] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T17:19:31.615800] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-06. [2025-09-17T17:19:32.420539] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-01. [2025-09-17T17:19:32.422178] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T17:19:32.852380] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T17:19:33.215753] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-08. [2025-09-17T17:19:33.645242] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T17:19:34.015779] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-07. [2025-09-17T17:19:34.815856] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-02. [2025-09-17T17:19:35.023101] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T17:19:35.245010] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T17:19:35.615778] [INFO ] [REMOTE ] AR: Fetching primary data for 2025-09. [2025-09-17T17:19:36.195338] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T17:19:36.415803] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-08. [2025-09-17T17:19:37.141602] [INFO ] [REMOTE ] AR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T17:19:37.149134] [INFO ] [REMOTE ] AR: Full fetch complete (77354 records). [2025-09-17T17:19:37.149318] [DEBUG] [VALIDATOR ] AR: Validating primary data. [2025-09-17T17:19:37.220883] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-08. [2025-09-17T17:19:37.281017] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T17:19:37.566435] [DEBUG] [VALIDATOR ] AR: All expected trading days are present. [2025-09-17T17:19:37.566533] [DEBUG] [VALIDATOR ] AR: Primary data validation passed. [2025-09-17T17:19:37.567350] [INFO ] [MAIN ] AR: Fetched primary data is valid. [2025-09-17T17:19:37.567401] [DEBUG] [LOCAL ] AR: Saving primary data. [2025-09-17T17:19:37.568950] [DEBUG] [LOCAL ] AR: Trimmed 77354 records to 53585 (keeping 200 days of data) [2025-09-17T17:19:37.903174] [DEBUG] [LOCAL ] AR: Primary data saved (53585 records). [2025-09-17T17:19:37.903388] [INFO ] [MAIN ] AR: Full history saved. [2025-09-17T17:19:37.903526] [INFO ] [MAIN ] Update Progress: 138/2371 symbols completed. AR took 38.1s. Estimated remaining: 5h 17m 9s. Rate: 7.0 symbols/min [2025-09-17T17:19:38.020866] [INFO ] [REMOTE ] ARDC: Fetching primary data for 2025-09. [2025-09-17T17:19:38.082909] [INFO ] [MAIN ] ARE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:19:38.133088] [DEBUG] [LOCAL ] ARE: Loaded 50602 existing records from primary storage. [2025-09-17T17:19:38.133255] [INFO ] [MAIN ] ARE: Loaded 50602 existing records. [2025-09-17T17:19:38.309413] [WARN ] [MAIN ] ARE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:19:38.309673] [INFO ] [MAIN ] ARE: Wiping existing primary data before full refresh. [2025-09-17T17:19:38.309723] [INFO ] [LOCAL ] ARE: Starting deletion of primary data. [2025-09-17T17:19:38.311345] [DEBUG] [LOCAL ] ARE: Deleted primary data file. [2025-09-17T17:19:38.311396] [INFO ] [MAIN ] ARE: Starting full primary refresh. [2025-09-17T17:19:38.684737] [INFO ] [REMOTE ] ARE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:19:38.818056] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-11. [2025-09-17T17:19:38.821415] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T17:19:39.076215] [INFO ] [REMOTE ] ARDC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T17:19:39.078569] [INFO ] [REMOTE ] ARDC: Full fetch complete (20185 records). [2025-09-17T17:19:39.078665] [DEBUG] [VALIDATOR ] ARDC: Validating primary data. [2025-09-17T17:19:39.438855] [DEBUG] [VALIDATOR ] ARDC: All expected trading days are present. [2025-09-17T17:19:39.438932] [DEBUG] [VALIDATOR ] ARDC: Primary data validation passed. [2025-09-17T17:19:39.439208] [INFO ] [MAIN ] ARDC: Fetched primary data is valid. [2025-09-17T17:19:39.439248] [DEBUG] [LOCAL ] ARDC: Saving primary data. [2025-09-17T17:19:39.440127] [DEBUG] [LOCAL ] ARDC: Trimmed 20185 records to 14669 (keeping 200 days of data) [2025-09-17T17:19:39.534040] [DEBUG] [LOCAL ] ARDC: Primary data saved (14669 records). [2025-09-17T17:19:39.534199] [INFO ] [MAIN ] ARDC: Full history saved. [2025-09-17T17:19:39.534284] [INFO ] [MAIN ] Update Progress: 139/2371 symbols completed. ARDC took 23.2s. Estimated remaining: 5h 15m 10s. Rate: 7.1 symbols/min [2025-09-17T17:19:39.623817] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-03. [2025-09-17T17:19:39.703480] [INFO ] [MAIN ] ARES: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:19:39.758879] [DEBUG] [LOCAL ] ARES: Loaded 49727 existing records from primary storage. [2025-09-17T17:19:39.759026] [INFO ] [MAIN ] ARES: Loaded 49727 existing records. [2025-09-17T17:19:39.935211] [WARN ] [MAIN ] ARES: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:19:39.935493] [INFO ] [MAIN ] ARES: Wiping existing primary data before full refresh. [2025-09-17T17:19:39.935539] [INFO ] [LOCAL ] ARES: Starting deletion of primary data. [2025-09-17T17:19:39.936779] [DEBUG] [LOCAL ] ARES: Deleted primary data file. [2025-09-17T17:19:39.936828] [INFO ] [MAIN ] ARES: Starting full primary refresh. [2025-09-17T17:19:40.325856] [INFO ] [REMOTE ] ARES: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:19:40.352447] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T17:19:40.415716] [INFO ] [REMOTE ] ARE: Fetching primary data for 2024-12. [2025-09-17T17:19:41.021902] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T17:19:41.215747] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-11. [2025-09-17T17:19:42.015780] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-04. [2025-09-17T17:19:42.166443] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T17:19:42.522566] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T17:19:42.815780] [INFO ] [REMOTE ] ARCO: Fetching primary data for 2025-09. [2025-09-17T17:19:43.296010] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T17:19:43.615774] [INFO ] [REMOTE ] ARES: Fetching primary data for 2024-12. [2025-09-17T17:19:44.269617] [INFO ] [REMOTE ] ARCO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T17:19:44.275897] [INFO ] [REMOTE ] ARCO: Full fetch complete (65776 records). [2025-09-17T17:19:44.276075] [DEBUG] [VALIDATOR ] ARCO: Validating primary data. [2025-09-17T17:19:44.422823] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-01. [2025-09-17T17:19:44.673066] [DEBUG] [VALIDATOR ] ARCO: All expected trading days are present. [2025-09-17T17:19:44.673153] [DEBUG] [VALIDATOR ] ARCO: Primary data validation passed. [2025-09-17T17:19:44.673839] [INFO ] [MAIN ] ARCO: Fetched primary data is valid. [2025-09-17T17:19:44.673919] [DEBUG] [LOCAL ] ARCO: Saving primary data. [2025-09-17T17:19:44.675213] [DEBUG] [LOCAL ] ARCO: Trimmed 65776 records to 44755 (keeping 200 days of data) [2025-09-17T17:19:44.942379] [DEBUG] [LOCAL ] ARCO: Primary data saved (44755 records). [2025-09-17T17:19:44.942522] [INFO ] [MAIN ] ARCO: Full history saved. [2025-09-17T17:19:44.942607] [INFO ] [MAIN ] Update Progress: 140/2371 symbols completed. ARCO took 43.5s. Estimated remaining: 5h 14m 13s. Rate: 7.1 symbols/min [2025-09-17T17:19:45.113437] [INFO ] [MAIN ] ARI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:19:45.154039] [DEBUG] [LOCAL ] ARI: Loaded 43268 existing records from primary storage. [2025-09-17T17:19:45.154190] [INFO ] [MAIN ] ARI: Loaded 43268 existing records. [2025-09-17T17:19:45.220965] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-05. [2025-09-17T17:19:45.340604] [WARN ] [MAIN ] ARI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:19:45.341064] [INFO ] [MAIN ] ARI: Wiping existing primary data before full refresh. [2025-09-17T17:19:45.341196] [INFO ] [LOCAL ] ARI: Starting deletion of primary data. [2025-09-17T17:19:45.342575] [DEBUG] [LOCAL ] ARI: Deleted primary data file. [2025-09-17T17:19:45.342631] [INFO ] [MAIN ] ARI: Starting full primary refresh. [2025-09-17T17:19:45.742240] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-17T17:19:45.776137] [INFO ] [REMOTE ] ARI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:19:46.015818] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-01. [2025-09-17T17:19:46.387949] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T17:19:46.459807] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T17:19:46.815772] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-06. [2025-09-17T17:19:47.615753] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-11. [2025-09-17T17:19:47.698284] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T17:19:48.020076] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T17:19:48.415784] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-07. [2025-09-17T17:19:49.215822] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-02. [2025-09-17T17:19:49.311719] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T17:19:49.707568] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T17:19:50.015770] [INFO ] [REMOTE ] ARI: Fetching primary data for 2024-12. [2025-09-17T17:19:50.656510] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T17:19:50.815753] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-03. [2025-09-17T17:19:51.615802] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-08. [2025-09-17T17:19:51.664429] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T17:19:52.415739] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-02. [2025-09-17T17:19:52.733842] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T17:19:52.882739] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T17:19:53.215752] [INFO ] [REMOTE ] ARDT: Fetching primary data for 2025-09. [2025-09-17T17:19:53.777540] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T17:19:54.015817] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-04. [2025-09-17T17:19:54.492780] [INFO ] [REMOTE ] ARDT: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T17:19:54.496460] [INFO ] [REMOTE ] ARDT: Full fetch complete (40994 records). [2025-09-17T17:19:54.496560] [DEBUG] [VALIDATOR ] ARDT: Validating primary data. [2025-09-17T17:19:54.823808] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-01. [2025-09-17T17:19:54.873669] [DEBUG] [VALIDATOR ] ARDT: All expected trading days are present. [2025-09-17T17:19:54.873904] [DEBUG] [VALIDATOR ] ARDT: Primary data validation passed. [2025-09-17T17:19:54.874474] [INFO ] [MAIN ] ARDT: Fetched primary data is valid. [2025-09-17T17:19:54.874529] [DEBUG] [LOCAL ] ARDT: Saving primary data. [2025-09-17T17:19:54.875765] [DEBUG] [LOCAL ] ARDT: Trimmed 40994 records to 28681 (keeping 200 days of data) [2025-09-17T17:19:55.042617] [DEBUG] [LOCAL ] ARDT: Primary data saved (28681 records). [2025-09-17T17:19:55.042774] [INFO ] [MAIN ] ARDT: Full history saved. [2025-09-17T17:19:55.042856] [INFO ] [MAIN ] Update Progress: 141/2371 symbols completed. ARDT took 33.8s. Estimated remaining: 5h 14m 30s. Rate: 7.1 symbols/min [2025-09-17T17:19:55.210148] [INFO ] [MAIN ] ARIS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:19:55.251365] [DEBUG] [LOCAL ] ARIS: Loaded 42003 existing records from primary storage. [2025-09-17T17:19:55.251503] [INFO ] [MAIN ] ARIS: Loaded 42003 existing records. [2025-09-17T17:19:55.429257] [WARN ] [MAIN ] ARIS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:19:55.429478] [INFO ] [MAIN ] ARIS: Wiping existing primary data before full refresh. [2025-09-17T17:19:55.429522] [INFO ] [LOCAL ] ARIS: Starting deletion of primary data. [2025-09-17T17:19:55.430892] [DEBUG] [LOCAL ] ARIS: Deleted primary data file. [2025-09-17T17:19:55.430941] [INFO ] [MAIN ] ARIS: Starting full primary refresh. [2025-09-17T17:19:55.641837] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-03. [2025-09-17T17:19:55.796099] [INFO ] [REMOTE ] ARIS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:19:55.826887] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T17:19:56.311441] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T17:19:56.415781] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-05. [2025-09-17T17:19:57.215791] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-02. [2025-09-17T17:19:57.866751] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-17T17:19:58.018367] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-11. [2025-09-17T17:19:58.245865] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T17:19:58.293347] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T17:19:58.815766] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-04. [2025-09-17T17:19:59.389095] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T17:19:59.615838] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-03. [2025-09-17T17:20:00.415832] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2024-12. [2025-09-17T17:20:00.676775] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T17:20:01.215786] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-06. [2025-09-17T17:20:01.386830] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T17:20:01.945972] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T17:20:02.015800] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-01. [2025-09-17T17:20:02.815799] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-04. [2025-09-17T17:20:03.218011] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T17:20:03.401367] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T17:20:03.615829] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-02. [2025-09-17T17:20:04.415890] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-05. [2025-09-17T17:20:04.503096] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T17:20:04.703152] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T17:20:05.215810] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-03. [2025-09-17T17:20:06.015825] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-05. [2025-09-17T17:20:06.419681] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T17:20:06.511496] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T17:20:06.815822] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-06. [2025-09-17T17:20:07.615920] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-04. [2025-09-17T17:20:07.675155] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T17:20:08.415789] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-06. [2025-09-17T17:20:08.634446] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T17:20:09.176578] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T17:20:09.215875] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-05. [2025-09-17T17:20:10.017971] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-07. [2025-09-17T17:20:10.022853] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T17:20:10.686400] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T17:20:10.815873] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-06. [2025-09-17T17:20:11.615831] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-07. [2025-09-17T17:20:11.880534] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T17:20:12.198616] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T17:20:12.415811] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-08. [2025-09-17T17:20:13.215803] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-07. [2025-09-17T17:20:13.523994] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T17:20:14.015789] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-07. [2025-09-17T17:20:14.257900] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T17:20:14.432726] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T17:20:14.815838] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-08. [2025-09-17T17:20:15.444190] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T17:20:15.615783] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-08. [2025-09-17T17:20:16.291729] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T17:20:16.415759] [INFO ] [REMOTE ] ARI: Fetching primary data for 2025-09. [2025-09-17T17:20:17.144930] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T17:20:17.215793] [INFO ] [REMOTE ] ARES: Fetching primary data for 2025-09. [2025-09-17T17:20:18.015787] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-08. [2025-09-17T17:20:18.162856] [INFO ] [REMOTE ] ARI: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T17:20:18.168036] [INFO ] [REMOTE ] ARI: Full fetch complete (62531 records). [2025-09-17T17:20:18.168157] [DEBUG] [VALIDATOR ] ARI: Validating primary data. [2025-09-17T17:20:18.571320] [DEBUG] [VALIDATOR ] ARI: All expected trading days are present. [2025-09-17T17:20:18.571408] [DEBUG] [VALIDATOR ] ARI: Primary data validation passed. [2025-09-17T17:20:18.572110] [INFO ] [MAIN ] ARI: Fetched primary data is valid. [2025-09-17T17:20:18.572192] [DEBUG] [LOCAL ] ARI: Saving primary data. [2025-09-17T17:20:18.573487] [DEBUG] [LOCAL ] ARI: Trimmed 62531 records to 43285 (keeping 200 days of data) [2025-09-17T17:20:18.817147] [INFO ] [REMOTE ] ARIS: Fetching primary data for 2025-09. [2025-09-17T17:20:18.827287] [DEBUG] [LOCAL ] ARI: Primary data saved (43285 records). [2025-09-17T17:20:18.827357] [INFO ] [MAIN ] ARI: Full history saved. [2025-09-17T17:20:18.827456] [INFO ] [MAIN ] Update Progress: 142/2371 symbols completed. ARI took 33.9s. Estimated remaining: 5h 18m 22s. Rate: 7.0 symbols/min [2025-09-17T17:20:19.007669] [INFO ] [MAIN ] ARLO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:20:19.025957] [INFO ] [REMOTE ] ARES: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T17:20:19.032660] [INFO ] [REMOTE ] ARES: Full fetch complete (70357 records). [2025-09-17T17:20:19.032790] [DEBUG] [VALIDATOR ] ARES: Validating primary data. [2025-09-17T17:20:19.352655] [DEBUG] [LOCAL ] ARLO: Loaded 44220 existing records from primary storage. [2025-09-17T17:20:19.354989] [INFO ] [MAIN ] ARLO: Loaded 44220 existing records. [2025-09-17T17:20:19.553242] [DEBUG] [VALIDATOR ] ARES: All expected trading days are present. [2025-09-17T17:20:19.563732] [DEBUG] [VALIDATOR ] ARES: Primary data validation passed. [2025-09-17T17:20:19.571161] [INFO ] [MAIN ] ARES: Fetched primary data is valid. [2025-09-17T17:20:19.630242] [DEBUG] [LOCAL ] ARES: Saving primary data. [2025-09-17T17:20:19.633682] [WARN ] [MAIN ] ARLO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:20:19.634117] [INFO ] [MAIN ] ARLO: Wiping existing primary data before full refresh. [2025-09-17T17:20:19.634216] [INFO ] [LOCAL ] ARLO: Starting deletion of primary data. [2025-09-17T17:20:19.635292] [DEBUG] [LOCAL ] ARES: Trimmed 70357 records to 49745 (keeping 200 days of data) [2025-09-17T17:20:19.636007] [DEBUG] [LOCAL ] ARLO: Deleted primary data file. [2025-09-17T17:20:19.636134] [INFO ] [MAIN ] ARLO: Starting full primary refresh. [2025-09-17T17:20:19.981993] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T17:20:20.058013] [INFO ] [REMOTE ] ARE: Fetching primary data for 2025-09. [2025-09-17T17:20:20.148256] [INFO ] [REMOTE ] ARLO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:20:20.361933] [DEBUG] [LOCAL ] ARES: Primary data saved (49745 records). [2025-09-17T17:20:20.362101] [INFO ] [MAIN ] ARES: Full history saved. [2025-09-17T17:20:20.363017] [INFO ] [MAIN ] Update Progress: 143/2371 symbols completed. ARES took 40.8s. Estimated remaining: 5h 16m 24s. Rate: 7.0 symbols/min [2025-09-17T17:20:20.427204] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-11. [2025-09-17T17:20:20.540397] [INFO ] [MAIN ] ARMK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:20:20.558662] [INFO ] [REMOTE ] ARIS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T17:20:20.568827] [INFO ] [REMOTE ] ARIS: Full fetch complete (59354 records). [2025-09-17T17:20:20.568957] [DEBUG] [VALIDATOR ] ARIS: Validating primary data. [2025-09-17T17:20:20.872388] [DEBUG] [LOCAL ] ARMK: Loaded 50341 existing records from primary storage. [2025-09-17T17:20:20.888302] [INFO ] [MAIN ] ARMK: Loaded 50341 existing records. [2025-09-17T17:20:21.148252] [DEBUG] [VALIDATOR ] ARIS: All expected trading days are present. [2025-09-17T17:20:21.176580] [WARN ] [MAIN ] ARMK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:20:21.176488] [DEBUG] [VALIDATOR ] ARIS: Primary data validation passed. [2025-09-17T17:20:21.177351] [INFO ] [MAIN ] ARIS: Fetched primary data is valid. [2025-09-17T17:20:21.177421] [DEBUG] [LOCAL ] ARIS: Saving primary data. [2025-09-17T17:20:21.177667] [INFO ] [MAIN ] ARMK: Wiping existing primary data before full refresh. [2025-09-17T17:20:21.177720] [INFO ] [LOCAL ] ARMK: Starting deletion of primary data. [2025-09-17T17:20:21.178979] [DEBUG] [LOCAL ] ARIS: Trimmed 59354 records to 42025 (keeping 200 days of data) [2025-09-17T17:20:21.179339] [DEBUG] [LOCAL ] ARMK: Deleted primary data file. [2025-09-17T17:20:21.179403] [INFO ] [MAIN ] ARMK: Starting full primary refresh. [2025-09-17T17:20:21.669420] [INFO ] [REMOTE ] ARMK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:20:21.672954] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-11. [2025-09-17T17:20:21.801553] [INFO ] [REMOTE ] ARE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T17:20:21.815034] [INFO ] [REMOTE ] ARE: Full fetch complete (72538 records). [2025-09-17T17:20:21.819821] [DEBUG] [VALIDATOR ] ARE: Validating primary data. [2025-09-17T17:20:22.263124] [DEBUG] [VALIDATOR ] ARE: All expected trading days are present. [2025-09-17T17:20:22.262863] [DEBUG] [LOCAL ] ARIS: Primary data saved (42025 records). [2025-09-17T17:20:22.263366] [INFO ] [MAIN ] ARIS: Full history saved. [2025-09-17T17:20:22.263400] [DEBUG] [VALIDATOR ] ARE: Primary data validation passed. [2025-09-17T17:20:22.264934] [INFO ] [MAIN ] Update Progress: 144/2371 symbols completed. ARIS took 27.2s. Estimated remaining: 5h 14m 33s. Rate: 7.1 symbols/min [2025-09-17T17:20:22.265931] [INFO ] [MAIN ] ARE: Fetched primary data is valid. [2025-09-17T17:20:22.266034] [DEBUG] [LOCAL ] ARE: Saving primary data. [2025-09-17T17:20:22.416218] [DEBUG] [LOCAL ] ARE: Trimmed 72538 records to 50585 (keeping 200 days of data) [2025-09-17T17:20:22.440186] [INFO ] [MAIN ] AROC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:20:22.561618] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-17T17:20:22.572154] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2024-12. [2025-09-17T17:20:22.631381] [DEBUG] [LOCAL ] AROC: Loaded 49022 existing records from primary storage. [2025-09-17T17:20:22.634862] [INFO ] [MAIN ] AROC: Loaded 49022 existing records. [2025-09-17T17:20:22.908364] [WARN ] [MAIN ] AROC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:20:22.912989] [INFO ] [MAIN ] AROC: Wiping existing primary data before full refresh. [2025-09-17T17:20:22.913982] [INFO ] [LOCAL ] AROC: Starting deletion of primary data. [2025-09-17T17:20:22.916337] [DEBUG] [LOCAL ] AROC: Deleted primary data file. [2025-09-17T17:20:22.917753] [INFO ] [MAIN ] AROC: Starting full primary refresh. [2025-09-17T17:20:23.297075] [INFO ] [REMOTE ] AROC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:20:23.300468] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-11. [2025-09-17T17:20:23.363449] [DEBUG] [LOCAL ] ARE: Primary data saved (50585 records). [2025-09-17T17:20:23.363584] [INFO ] [MAIN ] ARE: Full history saved. [2025-09-17T17:20:23.363737] [INFO ] [MAIN ] Update Progress: 145/2371 symbols completed. ARE took 45.5s. Estimated remaining: 5h 12m 32s. Rate: 7.1 symbols/min [2025-09-17T17:20:23.561772] [INFO ] [MAIN ] ARR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:20:23.596190] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T17:20:23.626405] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2024-12. [2025-09-17T17:20:23.644931] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T17:20:23.702488] [DEBUG] [LOCAL ] ARR: Loaded 52034 existing records from primary storage. [2025-09-17T17:20:23.702675] [INFO ] [MAIN ] ARR: Loaded 52034 existing records. [2025-09-17T17:20:23.887005] [WARN ] [MAIN ] ARR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:20:23.887323] [INFO ] [MAIN ] ARR: Wiping existing primary data before full refresh. [2025-09-17T17:20:23.887373] [INFO ] [LOCAL ] ARR: Starting deletion of primary data. [2025-09-17T17:20:23.889074] [DEBUG] [LOCAL ] ARR: Deleted primary data file. [2025-09-17T17:20:23.889129] [INFO ] [MAIN ] ARR: Starting full primary refresh. [2025-09-17T17:20:24.259371] [INFO ] [REMOTE ] ARR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:20:24.415757] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-11. [2025-09-17T17:20:25.116590] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T17:20:25.215773] [INFO ] [REMOTE ] AROC: Fetching primary data for 2024-12. [2025-09-17T17:20:25.316223] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T17:20:26.015787] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-01. [2025-09-17T17:20:26.150442] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T17:20:26.760883] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T17:20:26.815743] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-01. [2025-09-17T17:20:27.559472] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T17:20:27.615741] [INFO ] [REMOTE ] ARR: Fetching primary data for 2024-12. [2025-09-17T17:20:28.126065] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T17:20:28.415771] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-02. [2025-09-17T17:20:29.215771] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-02. [2025-09-17T17:20:29.501479] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T17:20:30.011940] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T17:20:30.021087] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-01. [2025-09-17T17:20:30.634927] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T17:20:30.815789] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-03. [2025-09-17T17:20:31.615809] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-03. [2025-09-17T17:20:32.079952] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T17:20:32.177550] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T17:20:32.415800] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-02. [2025-09-17T17:20:32.903113] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T17:20:33.215771] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-04. [2025-09-17T17:20:34.015793] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-01. [2025-09-17T17:20:34.289725] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T17:20:34.815842] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-03. [2025-09-17T17:20:34.992995] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T17:20:35.615771] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-04. [2025-09-17T17:20:35.651064] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T17:20:36.415756] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-05. [2025-09-17T17:20:36.846573] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T17:20:37.215914] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-02. [2025-09-17T17:20:37.377140] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T17:20:38.021000] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-05. [2025-09-17T17:20:38.033020] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T17:20:38.469139] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T17:20:38.815764] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-04. [2025-09-17T17:20:39.615767] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-03. [2025-09-17T17:20:39.682314] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T17:20:40.415760] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-06. [2025-09-17T17:20:40.891306] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T17:20:41.215824] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-05. [2025-09-17T17:20:41.309717] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T17:20:42.002698] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T17:20:42.015676] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-07. [2025-09-17T17:20:42.815847] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-06. [2025-09-17T17:20:42.954830] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T17:20:43.615746] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-06. [2025-09-17T17:20:43.749152] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T17:20:44.415786] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-04. [2025-09-17T17:20:44.564311] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T17:20:45.215751] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-07. [2025-09-17T17:20:45.356334] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T17:20:45.821166] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T17:20:46.015783] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-08. [2025-09-17T17:20:46.815779] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-07. [2025-09-17T17:20:46.994321] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T17:20:47.615784] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-08. [2025-09-17T17:20:47.703764] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T17:20:48.415781] [INFO ] [REMOTE ] AROC: Fetching primary data for 2025-09. [2025-09-17T17:20:48.665614] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T17:20:49.215755] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-08. [2025-09-17T17:20:49.406299] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T17:20:50.015811] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-05. [2025-09-17T17:20:50.274933] [INFO ] [REMOTE ] AROC: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T17:20:50.281382] [INFO ] [REMOTE ] AROC: Full fetch complete (70294 records). [2025-09-17T17:20:50.281513] [DEBUG] [VALIDATOR ] AROC: Validating primary data. [2025-09-17T17:20:50.678208] [DEBUG] [VALIDATOR ] AROC: All expected trading days are present. [2025-09-17T17:20:50.678308] [DEBUG] [VALIDATOR ] AROC: Primary data validation passed. [2025-09-17T17:20:50.679037] [INFO ] [MAIN ] AROC: Fetched primary data is valid. [2025-09-17T17:20:50.679093] [DEBUG] [LOCAL ] AROC: Saving primary data. [2025-09-17T17:20:50.680743] [DEBUG] [LOCAL ] AROC: Trimmed 70294 records to 49007 (keeping 200 days of data) [2025-09-17T17:20:50.861366] [INFO ] [REMOTE ] ARMK: Fetching primary data for 2025-09. [2025-09-17T17:20:50.933758] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T17:20:51.026948] [DEBUG] [LOCAL ] AROC: Primary data saved (49007 records). [2025-09-17T17:20:51.027098] [INFO ] [MAIN ] AROC: Full history saved. [2025-09-17T17:20:51.027870] [INFO ] [MAIN ] Update Progress: 146/2371 symbols completed. AROC took 28.8s. Estimated remaining: 5h 17m 16s. Rate: 7.0 symbols/min [2025-09-17T17:20:51.201078] [INFO ] [MAIN ] ARW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:20:51.227364] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T17:20:51.265335] [DEBUG] [LOCAL ] ARW: Loaded 33077 existing records from primary storage. [2025-09-17T17:20:51.265475] [INFO ] [MAIN ] ARW: Loaded 33077 existing records. [2025-09-17T17:20:51.524356] [WARN ] [MAIN ] ARW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:20:51.524727] [INFO ] [MAIN ] ARW: Wiping existing primary data before full refresh. [2025-09-17T17:20:51.524800] [INFO ] [LOCAL ] ARW: Starting deletion of primary data. [2025-09-17T17:20:51.525839] [DEBUG] [LOCAL ] ARW: Deleted primary data file. [2025-09-17T17:20:51.525917] [INFO ] [MAIN ] ARW: Starting full primary refresh. [2025-09-17T17:20:51.622778] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-06. [2025-09-17T17:20:52.090973] [INFO ] [REMOTE ] ARW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:20:52.247992] [INFO ] [REMOTE ] ARMK: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T17:20:52.258415] [INFO ] [REMOTE ] ARMK: Full fetch complete (72331 records). [2025-09-17T17:20:52.258684] [DEBUG] [VALIDATOR ] ARMK: Validating primary data. [2025-09-17T17:20:52.422024] [INFO ] [REMOTE ] ARR: Fetching primary data for 2025-09. [2025-09-17T17:20:52.764557] [DEBUG] [VALIDATOR ] ARMK: All expected trading days are present. [2025-09-17T17:20:52.764656] [DEBUG] [VALIDATOR ] ARMK: Primary data validation passed. [2025-09-17T17:20:52.765342] [INFO ] [MAIN ] ARMK: Fetched primary data is valid. [2025-09-17T17:20:52.765384] [DEBUG] [LOCAL ] ARMK: Saving primary data. [2025-09-17T17:20:52.766802] [DEBUG] [LOCAL ] ARMK: Trimmed 72331 records to 50320 (keeping 200 days of data) [2025-09-17T17:20:53.104307] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T17:20:53.125982] [DEBUG] [LOCAL ] ARMK: Primary data saved (50320 records). [2025-09-17T17:20:53.126133] [INFO ] [MAIN ] ARMK: Full history saved. [2025-09-17T17:20:53.126920] [INFO ] [MAIN ] Update Progress: 147/2371 symbols completed. ARMK took 32.8s. Estimated remaining: 5h 15m 30s. Rate: 7.0 symbols/min [2025-09-17T17:20:53.223059] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-11. [2025-09-17T17:20:53.308591] [INFO ] [MAIN ] ARX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:20:53.308799] [DEBUG] [LOCAL ] ARX: No existing data file found in primary storage. [2025-09-17T17:20:53.308837] [WARN ] [MAIN ] ARX: No existing data found, performing full refresh instead. [2025-09-17T17:20:53.308957] [INFO ] [MAIN ] ARX: Wiping existing primary data before full refresh. [2025-09-17T17:20:53.309011] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-17T17:20:53.309054] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-17T17:20:53.309085] [INFO ] [MAIN ] ARX: Starting full primary refresh. [2025-09-17T17:20:53.671566] [INFO ] [REMOTE ] ARX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:20:54.015789] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-11. [2025-09-17T17:20:54.227528] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:20:54.227908] [WARN ] [REMOTE ] ARX: No data returned for month 2024-11 [2025-09-17T17:20:54.552121] [INFO ] [REMOTE ] ARR: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-17T17:20:54.559765] [INFO ] [REMOTE ] ARR: Full fetch complete (74873 records). [2025-09-17T17:20:54.559964] [DEBUG] [VALIDATOR ] ARR: Validating primary data. [2025-09-17T17:20:54.689689] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T17:20:54.823959] [INFO ] [REMOTE ] ARX: Fetching primary data for 2024-12. [2025-09-17T17:20:55.021619] [DEBUG] [VALIDATOR ] ARR: All expected trading days are present. [2025-09-17T17:20:55.021733] [DEBUG] [VALIDATOR ] ARR: Primary data validation passed. [2025-09-17T17:20:55.022490] [INFO ] [MAIN ] ARR: Fetched primary data is valid. [2025-09-17T17:20:55.022533] [DEBUG] [LOCAL ] ARR: Saving primary data. [2025-09-17T17:20:55.024101] [DEBUG] [LOCAL ] ARR: Trimmed 74873 records to 52032 (keeping 200 days of data) [2025-09-17T17:20:55.207048] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:20:55.216082] [WARN ] [REMOTE ] ARX: No data returned for month 2024-12 [2025-09-17T17:20:55.352899] [DEBUG] [LOCAL ] ARR: Primary data saved (52032 records). [2025-09-17T17:20:55.353047] [INFO ] [MAIN ] ARR: Full history saved. [2025-09-17T17:20:55.353135] [INFO ] [MAIN ] Update Progress: 148/2371 symbols completed. ARR took 32.0s. Estimated remaining: 5h 13m 47s. Rate: 7.1 symbols/min [2025-09-17T17:20:55.525981] [INFO ] [MAIN ] AS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:20:55.577674] [DEBUG] [LOCAL ] AS: Loaded 53067 existing records from primary storage. [2025-09-17T17:20:55.577819] [INFO ] [MAIN ] AS: Loaded 53067 existing records. [2025-09-17T17:20:55.621019] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-01. [2025-09-17T17:20:55.761875] [WARN ] [MAIN ] AS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:20:55.762121] [INFO ] [MAIN ] AS: Wiping existing primary data before full refresh. [2025-09-17T17:20:55.762169] [INFO ] [LOCAL ] AS: Starting deletion of primary data. [2025-09-17T17:20:55.763791] [DEBUG] [LOCAL ] AS: Deleted primary data file. [2025-09-17T17:20:55.763848] [INFO ] [MAIN ] AS: Starting full primary refresh. [2025-09-17T17:20:55.896729] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:20:55.923865] [WARN ] [REMOTE ] ARX: No data returned for month 2025-01 [2025-09-17T17:20:56.147675] [INFO ] [REMOTE ] AS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:20:56.415796] [INFO ] [REMOTE ] ARW: Fetching primary data for 2024-12. [2025-09-17T17:20:57.215776] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-07. [2025-09-17T17:20:57.649169] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T17:20:58.015830] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-01. [2025-09-17T17:20:58.815781] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-11. [2025-09-17T17:20:58.972033] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T17:20:59.044079] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T17:20:59.615795] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-02. [2025-09-17T17:20:59.810770] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:20:59.811108] [WARN ] [REMOTE ] ARX: No data returned for month 2025-02 [2025-09-17T17:21:00.415761] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-03. [2025-09-17T17:21:00.498125] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T17:21:00.717305] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:21:00.717723] [WARN ] [REMOTE ] ARX: No data returned for month 2025-03 [2025-09-17T17:21:01.215770] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-08. [2025-09-17T17:21:02.015844] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-04. [2025-09-17T17:21:02.217294] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:21:02.217638] [WARN ] [REMOTE ] ARX: No data returned for month 2025-04 [2025-09-17T17:21:02.815746] [INFO ] [REMOTE ] AS: Fetching primary data for 2024-12. [2025-09-17T17:21:02.868199] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T17:21:03.615784] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-05. [2025-09-17T17:21:03.853676] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:21:03.854174] [WARN ] [REMOTE ] ARX: No data returned for month 2025-05 [2025-09-17T17:21:04.415789] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-06. [2025-09-17T17:21:04.562338] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T17:21:04.686377] [DEBUG] [REMOTE ] ARX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:21:04.686736] [WARN ] [REMOTE ] ARX: No data returned for month 2025-06 [2025-09-17T17:21:05.215772] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-01. [2025-09-17T17:21:06.015779] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-07. [2025-09-17T17:21:06.815813] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-02. [2025-09-17T17:21:06.953755] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T17:21:07.048123] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T17:21:07.615817] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-08. [2025-09-17T17:21:07.983589] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T17:21:08.415803] [INFO ] [REMOTE ] ARLO: Fetching primary data for 2025-09. [2025-09-17T17:21:09.215712] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-03. [2025-09-17T17:21:09.257434] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T17:21:09.826886] [INFO ] [REMOTE ] ARLO: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T17:21:09.834254] [INFO ] [REMOTE ] ARLO: Full fetch complete (62396 records). [2025-09-17T17:21:09.834429] [DEBUG] [VALIDATOR ] ARLO: Validating primary data. [2025-09-17T17:21:10.020732] [INFO ] [REMOTE ] ARX: Fetching primary data for 2025-09. [2025-09-17T17:21:10.240737] [DEBUG] [VALIDATOR ] ARLO: All expected trading days are present. [2025-09-17T17:21:10.240896] [DEBUG] [VALIDATOR ] ARLO: Primary data validation passed. [2025-09-17T17:21:10.241713] [INFO ] [MAIN ] ARLO: Fetched primary data is valid. [2025-09-17T17:21:10.241791] [DEBUG] [LOCAL ] ARLO: Saving primary data. [2025-09-17T17:21:10.243514] [DEBUG] [LOCAL ] ARLO: Trimmed 62396 records to 44192 (keeping 200 days of data) [2025-09-17T17:21:10.351870] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T17:21:10.532793] [DEBUG] [LOCAL ] ARLO: Primary data saved (44192 records). [2025-09-17T17:21:10.532938] [INFO ] [MAIN ] ARLO: Full history saved. [2025-09-17T17:21:10.533025] [INFO ] [MAIN ] Update Progress: 149/2371 symbols completed. ARLO took 51.7s. Estimated remaining: 5h 15m 19s. Rate: 7.0 symbols/min [2025-09-17T17:21:10.708579] [INFO ] [MAIN ] ASA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:21:10.724262] [DEBUG] [LOCAL ] ASA: Loaded 13358 existing records from primary storage. [2025-09-17T17:21:10.724401] [INFO ] [MAIN ] ASA: Loaded 13358 existing records. [2025-09-17T17:21:10.822489] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-04. [2025-09-17T17:21:10.918587] [WARN ] [MAIN ] ASA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:21:10.919100] [INFO ] [MAIN ] ASA: Wiping existing primary data before full refresh. [2025-09-17T17:21:10.919188] [INFO ] [LOCAL ] ASA: Starting deletion of primary data. [2025-09-17T17:21:10.919698] [DEBUG] [LOCAL ] ASA: Deleted primary data file. [2025-09-17T17:21:10.919751] [INFO ] [MAIN ] ASA: Starting full primary refresh. [2025-09-17T17:21:11.317852] [INFO ] [REMOTE ] ASA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:21:11.615779] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-02. [2025-09-17T17:21:11.779830] [INFO ] [REMOTE ] ARX: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T17:21:11.785289] [INFO ] [REMOTE ] ARX: Full fetch complete (12335 records). [2025-09-17T17:21:11.785364] [DEBUG] [VALIDATOR ] ARX: Validating primary data. [2025-09-17T17:21:11.981384] [WARN ] [VALIDATOR ] ARX: Validation failed - insufficient historical data. Have 39 unique days, need 200 days [2025-09-17T17:21:11.982361] [FATAL] [MAIN ] ARX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:21:11.982418] [WARN ] [MAIN ] ARX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:21:11.982466] [INFO ] [LOCAL ] ARX: Starting deletion of primary data. [2025-09-17T17:21:11.982528] [DEBUG] [LOCAL ] ARX: No primary data file found to delete. [2025-09-17T17:21:11.982566] [INFO ] [LOCAL ] ARX: Starting deletion of derivative data. [2025-09-17T17:21:11.982619] [DEBUG] [LOCAL ] ARX: No derivative data file found to delete. [2025-09-17T17:21:11.982715] [INFO ] [MAIN ] Update Progress: 150/2371 symbols completed. ARX took 18.9s. Estimated remaining: 5h 13m 26s. Rate: 7.1 symbols/min [2025-09-17T17:21:12.221756] [INFO ] [MAIN ] ASAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:21:12.279529] [DEBUG] [LOCAL ] ASAN: Loaded 52754 existing records from primary storage. [2025-09-17T17:21:12.279700] [INFO ] [MAIN ] ASAN: Loaded 52754 existing records. [2025-09-17T17:21:12.438727] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-11. [2025-09-17T17:21:12.481115] [WARN ] [MAIN ] ASAN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:21:12.490398] [INFO ] [MAIN ] ASAN: Wiping existing primary data before full refresh. [2025-09-17T17:21:12.490481] [INFO ] [LOCAL ] ASAN: Starting deletion of primary data. [2025-09-17T17:21:12.491894] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T17:21:12.491935] [DEBUG] [LOCAL ] ASAN: Deleted primary data file. [2025-09-17T17:21:12.494936] [INFO ] [MAIN ] ASAN: Starting full primary refresh. [2025-09-17T17:21:12.867758] [INFO ] [REMOTE ] ASAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:21:13.215792] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-11. [2025-09-17T17:21:13.345295] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T17:21:13.410362] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T17:21:14.015793] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-03. [2025-09-17T17:21:14.815782] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-05. [2025-09-17T17:21:14.895824] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T17:21:15.615808] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2024-12. [2025-09-17T17:21:15.822698] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T17:21:15.866295] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T17:21:16.415814] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-06. [2025-09-17T17:21:17.215686] [INFO ] [REMOTE ] ASA: Fetching primary data for 2024-12. [2025-09-17T17:21:17.277112] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T17:21:17.721029] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T17:21:17.924347] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T17:21:18.015802] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-07. [2025-09-17T17:21:18.815785] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-01. [2025-09-17T17:21:19.392932] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T17:21:19.615824] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-01. [2025-09-17T17:21:20.411957] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T17:21:20.415671] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-02. [2025-09-17T17:21:20.611842] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T17:21:20.941064] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T17:21:21.215762] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-08. [2025-09-17T17:21:22.015785] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-03. [2025-09-17T17:21:22.649129] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T17:21:22.815835] [INFO ] [REMOTE ] ARW: Fetching primary data for 2025-09. [2025-09-17T17:21:22.909138] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T17:21:23.615806] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-02. [2025-09-17T17:21:24.179902] [INFO ] [REMOTE ] ARW: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T17:21:24.185064] [INFO ] [REMOTE ] ARW: Full fetch complete (47489 records). [2025-09-17T17:21:24.185222] [DEBUG] [VALIDATOR ] ARW: Validating primary data. [2025-09-17T17:21:24.420962] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-04. [2025-09-17T17:21:24.594292] [DEBUG] [VALIDATOR ] ARW: All expected trading days are present. [2025-09-17T17:21:24.594415] [DEBUG] [VALIDATOR ] ARW: Primary data validation passed. [2025-09-17T17:21:24.594951] [INFO ] [MAIN ] ARW: Fetched primary data is valid. [2025-09-17T17:21:24.594997] [DEBUG] [LOCAL ] ARW: Saving primary data. [2025-09-17T17:21:24.596068] [DEBUG] [LOCAL ] ARW: Trimmed 47489 records to 33210 (keeping 200 days of data) [2025-09-17T17:21:24.808425] [DEBUG] [LOCAL ] ARW: Primary data saved (33210 records). [2025-09-17T17:21:24.808590] [INFO ] [MAIN ] ARW: Full history saved. [2025-09-17T17:21:24.808723] [INFO ] [MAIN ] Update Progress: 151/2371 symbols completed. ARW took 33.8s. Estimated remaining: 5h 14m 21s. Rate: 7.1 symbols/min [2025-09-17T17:21:24.992615] [INFO ] [MAIN ] ASB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:21:25.043032] [DEBUG] [LOCAL ] ASB: Loaded 49653 existing records from primary storage. [2025-09-17T17:21:25.043201] [INFO ] [MAIN ] ASB: Loaded 49653 existing records. [2025-09-17T17:21:25.231432] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-04. [2025-09-17T17:21:25.238318] [WARN ] [MAIN ] ASB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:21:25.239886] [INFO ] [MAIN ] ASB: Wiping existing primary data before full refresh. [2025-09-17T17:21:25.239952] [INFO ] [LOCAL ] ASB: Starting deletion of primary data. [2025-09-17T17:21:25.241467] [DEBUG] [LOCAL ] ASB: Deleted primary data file. [2025-09-17T17:21:25.241528] [INFO ] [MAIN ] ASB: Starting full primary refresh. [2025-09-17T17:21:25.622747] [INFO ] [REMOTE ] ASB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:21:25.650594] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-17T17:21:26.015817] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-11. [2025-09-17T17:21:26.315758] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T17:21:26.564110] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T17:21:26.815798] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-05. [2025-09-17T17:21:27.567014] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T17:21:27.615778] [INFO ] [REMOTE ] ASB: Fetching primary data for 2024-12. [2025-09-17T17:21:28.415821] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-03. [2025-09-17T17:21:28.786543] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T17:21:29.215820] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-05. [2025-09-17T17:21:29.258125] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T17:21:29.991685] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T17:21:30.015721] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-04. [2025-09-17T17:21:30.136256] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T17:21:30.815771] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-01. [2025-09-17T17:21:31.615823] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-06. [2025-09-17T17:21:31.832128] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T17:21:32.415866] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-05. [2025-09-17T17:21:32.480757] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T17:21:32.596240] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T17:21:33.215803] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-07. [2025-09-17T17:21:34.015810] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-02. [2025-09-17T17:21:34.136454] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T17:21:34.156235] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T17:21:34.815772] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-08. [2025-09-17T17:21:35.568547] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T17:21:35.615735] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-03. [2025-09-17T17:21:35.787918] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T17:21:36.415772] [INFO ] [REMOTE ] ASA: Fetching primary data for 2025-09. [2025-09-17T17:21:37.221098] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-06. [2025-09-17T17:21:37.235465] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T17:21:37.318530] [INFO ] [REMOTE ] ASA: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T17:21:37.321880] [INFO ] [REMOTE ] ASA: Full fetch complete (18166 records). [2025-09-17T17:21:37.321965] [DEBUG] [VALIDATOR ] ASA: Validating primary data. [2025-09-17T17:21:37.684553] [DEBUG] [VALIDATOR ] ASA: All expected trading days are present. [2025-09-17T17:21:37.684656] [DEBUG] [VALIDATOR ] ASA: Primary data validation passed. [2025-09-17T17:21:37.684932] [INFO ] [MAIN ] ASA: Fetched primary data is valid. [2025-09-17T17:21:37.684970] [DEBUG] [LOCAL ] ASA: Saving primary data. [2025-09-17T17:21:37.685497] [DEBUG] [LOCAL ] ASA: Trimmed 18166 records to 13428 (keeping 200 days of data) [2025-09-17T17:21:37.776253] [DEBUG] [LOCAL ] ASA: Primary data saved (13428 records). [2025-09-17T17:21:37.776398] [INFO ] [MAIN ] ASA: Full history saved. [2025-09-17T17:21:37.776489] [INFO ] [MAIN ] Update Progress: 152/2371 symbols completed. ASA took 27.2s. Estimated remaining: 5h 15m 18s. Rate: 7.0 symbols/min [2025-09-17T17:21:37.961041] [INFO ] [MAIN ] ASBA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:21:37.966477] [DEBUG] [LOCAL ] ASBA: Loaded 3437 existing records from primary storage. [2025-09-17T17:21:37.966561] [INFO ] [MAIN ] ASBA: Loaded 3437 existing records. [2025-09-17T17:21:38.020846] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-06. [2025-09-17T17:21:38.150451] [WARN ] [MAIN ] ASBA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:21:38.150794] [INFO ] [MAIN ] ASBA: Wiping existing primary data before full refresh. [2025-09-17T17:21:38.150845] [INFO ] [LOCAL ] ASBA: Starting deletion of primary data. [2025-09-17T17:21:38.151208] [DEBUG] [LOCAL ] ASBA: Deleted primary data file. [2025-09-17T17:21:38.151256] [INFO ] [MAIN ] ASBA: Starting full primary refresh. [2025-09-17T17:21:38.532159] [INFO ] [REMOTE ] ASBA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:21:38.815825] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-04. [2025-09-17T17:21:38.985481] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T17:21:39.615858] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-11. [2025-09-17T17:21:40.049737] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T17:21:40.132604] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T17:21:40.415698] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2024-12. [2025-09-17T17:21:40.494126] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T17:21:41.051760] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T17:21:41.215811] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-05. [2025-09-17T17:21:42.015786] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-01. [2025-09-17T17:21:42.610570] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T17:21:42.815767] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-02. [2025-09-17T17:21:42.887056] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T17:21:43.615773] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-06. [2025-09-17T17:21:43.627324] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T17:21:44.415845] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-07. [2025-09-17T17:21:45.189199] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T17:21:45.215792] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-07. [2025-09-17T17:21:45.802062] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T17:21:46.015763] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-08. [2025-09-17T17:21:46.815804] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-03. [2025-09-17T17:21:47.151485] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T17:21:47.369292] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T17:21:47.615836] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-07. [2025-09-17T17:21:47.757885] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T17:21:48.415800] [INFO ] [REMOTE ] AS: Fetching primary data for 2025-09. [2025-09-17T17:21:49.122006] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T17:21:49.215833] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-08. [2025-09-17T17:21:50.015835] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-08. [2025-09-17T17:21:50.302409] [INFO ] [REMOTE ] AS: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-17T17:21:50.309462] [INFO ] [REMOTE ] AS: Full fetch complete (76320 records). [2025-09-17T17:21:50.309621] [DEBUG] [VALIDATOR ] AS: Validating primary data. [2025-09-17T17:21:50.743095] [DEBUG] [VALIDATOR ] AS: All expected trading days are present. [2025-09-17T17:21:50.743191] [DEBUG] [VALIDATOR ] AS: Primary data validation passed. [2025-09-17T17:21:50.744035] [INFO ] [MAIN ] AS: Fetched primary data is valid. [2025-09-17T17:21:50.744095] [DEBUG] [LOCAL ] AS: Saving primary data. [2025-09-17T17:21:50.745656] [DEBUG] [LOCAL ] AS: Trimmed 76320 records to 53066 (keeping 200 days of data) [2025-09-17T17:21:50.838492] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-04. [2025-09-17T17:21:51.113138] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T17:21:51.111719] [DEBUG] [LOCAL ] AS: Primary data saved (53066 records). [2025-09-17T17:21:51.123120] [INFO ] [MAIN ] AS: Full history saved. [2025-09-17T17:21:51.123726] [INFO ] [MAIN ] Update Progress: 153/2371 symbols completed. AS took 55.8s. Estimated remaining: 5h 16m 20s. Rate: 7.0 symbols/min [2025-09-17T17:21:51.304116] [INFO ] [MAIN ] ASC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:21:51.342811] [DEBUG] [LOCAL ] ASC: Loaded 38179 existing records from primary storage. [2025-09-17T17:21:51.342975] [INFO ] [MAIN ] ASC: Loaded 38179 existing records. [2025-09-17T17:21:51.526167] [WARN ] [MAIN ] ASC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:21:51.531758] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T17:21:51.531885] [INFO ] [MAIN ] ASC: Wiping existing primary data before full refresh. [2025-09-17T17:21:51.534211] [INFO ] [LOCAL ] ASC: Starting deletion of primary data. [2025-09-17T17:21:51.535944] [DEBUG] [LOCAL ] ASC: Deleted primary data file. [2025-09-17T17:21:51.536011] [INFO ] [MAIN ] ASC: Starting full primary refresh. [2025-09-17T17:21:51.618667] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-05. [2025-09-17T17:21:51.941956] [INFO ] [REMOTE ] ASC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:21:51.976100] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T17:21:52.206163] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T17:21:52.415834] [INFO ] [REMOTE ] ASAN: Fetching primary data for 2025-09. [2025-09-17T17:21:53.215818] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-11. [2025-09-17T17:21:54.015800] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-06. [2025-09-17T17:21:54.294288] [INFO ] [REMOTE ] ASAN: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T17:21:54.302893] [INFO ] [REMOTE ] ASAN: Full fetch complete (76365 records). [2025-09-17T17:21:54.303027] [DEBUG] [VALIDATOR ] ASAN: Validating primary data. [2025-09-17T17:21:54.410249] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-17T17:21:54.705898] [DEBUG] [VALIDATOR ] ASAN: All expected trading days are present. [2025-09-17T17:21:54.705994] [DEBUG] [VALIDATOR ] ASAN: Primary data validation passed. [2025-09-17T17:21:54.706768] [INFO ] [MAIN ] ASAN: Fetched primary data is valid. [2025-09-17T17:21:54.706826] [DEBUG] [LOCAL ] ASAN: Saving primary data. [2025-09-17T17:21:54.708300] [DEBUG] [LOCAL ] ASAN: Trimmed 76365 records to 52762 (keeping 200 days of data) [2025-09-17T17:21:54.815916] [INFO ] [REMOTE ] ASB: Fetching primary data for 2025-09. [2025-09-17T17:21:54.954510] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T17:21:55.068633] [DEBUG] [LOCAL ] ASAN: Primary data saved (52762 records). [2025-09-17T17:21:55.068800] [INFO ] [MAIN ] ASAN: Full history saved. [2025-09-17T17:21:55.069361] [INFO ] [MAIN ] Update Progress: 154/2371 symbols completed. ASAN took 43.1s. Estimated remaining: 5h 15m 5s. Rate: 7.0 symbols/min [2025-09-17T17:21:55.242258] [INFO ] [MAIN ] ASG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:21:55.264906] [DEBUG] [LOCAL ] ASG: Loaded 21145 existing records from primary storage. [2025-09-17T17:21:55.265038] [INFO ] [MAIN ] ASG: Loaded 21145 existing records. [2025-09-17T17:21:55.446503] [WARN ] [MAIN ] ASG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:21:55.446847] [INFO ] [MAIN ] ASG: Wiping existing primary data before full refresh. [2025-09-17T17:21:55.446894] [INFO ] [LOCAL ] ASG: Starting deletion of primary data. [2025-09-17T17:21:55.447471] [DEBUG] [LOCAL ] ASG: Deleted primary data file. [2025-09-17T17:21:55.447519] [INFO ] [MAIN ] ASG: Starting full primary refresh. [2025-09-17T17:21:55.619963] [INFO ] [REMOTE ] ASC: Fetching primary data for 2024-12. [2025-09-17T17:21:55.804775] [INFO ] [REMOTE ] ASG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:21:56.415768] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-11. [2025-09-17T17:21:56.475846] [INFO ] [REMOTE ] ASB: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T17:21:56.482494] [INFO ] [REMOTE ] ASB: Full fetch complete (71430 records). [2025-09-17T17:21:56.482676] [DEBUG] [VALIDATOR ] ASB: Validating primary data. [2025-09-17T17:21:56.882259] [DEBUG] [VALIDATOR ] ASB: All expected trading days are present. [2025-09-17T17:21:56.882372] [DEBUG] [VALIDATOR ] ASB: Primary data validation passed. [2025-09-17T17:21:56.883117] [INFO ] [MAIN ] ASB: Fetched primary data is valid. [2025-09-17T17:21:56.883164] [DEBUG] [LOCAL ] ASB: Saving primary data. [2025-09-17T17:21:56.884799] [DEBUG] [LOCAL ] ASB: Trimmed 71430 records to 49645 (keeping 200 days of data) [2025-09-17T17:21:57.195317] [DEBUG] [LOCAL ] ASB: Primary data saved (49645 records). [2025-09-17T17:21:57.195459] [INFO ] [MAIN ] ASB: Full history saved. [2025-09-17T17:21:57.198489] [INFO ] [MAIN ] Update Progress: 155/2371 symbols completed. ASB took 32.4s. Estimated remaining: 5h 13m 25s. Rate: 7.1 symbols/min [2025-09-17T17:21:57.220940] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-07. [2025-09-17T17:21:57.379709] [INFO ] [MAIN ] ASGI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:21:57.405592] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T17:21:57.432960] [DEBUG] [LOCAL ] ASGI: Loaded 22154 existing records from primary storage. [2025-09-17T17:21:57.433091] [INFO ] [MAIN ] ASGI: Loaded 22154 existing records. [2025-09-17T17:21:57.615307] [WARN ] [MAIN ] ASGI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:21:57.615570] [INFO ] [MAIN ] ASGI: Wiping existing primary data before full refresh. [2025-09-17T17:21:57.615627] [INFO ] [LOCAL ] ASGI: Starting deletion of primary data. [2025-09-17T17:21:57.616211] [DEBUG] [LOCAL ] ASGI: Deleted primary data file. [2025-09-17T17:21:57.616259] [INFO ] [MAIN ] ASGI: Starting full primary refresh. [2025-09-17T17:21:57.872422] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T17:21:58.016542] [INFO ] [REMOTE ] ASG: Fetching primary data for 2024-12. [2025-09-17T17:21:58.019215] [INFO ] [REMOTE ] ASGI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:21:58.024328] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T17:21:58.815813] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-11. [2025-09-17T17:21:59.107356] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T17:21:59.615843] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-01. [2025-09-17T17:21:59.717636] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T17:22:00.415789] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2024-12. [2025-09-17T17:22:01.215793] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-08. [2025-09-17T17:22:01.307976] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T17:22:01.573151] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T17:22:01.926132] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T17:22:02.015782] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-02. [2025-09-17T17:22:02.815834] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-01. [2025-09-17T17:22:03.618400] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-01. [2025-09-17T17:22:03.620463] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T17:22:03.976911] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T17:22:04.415836] [INFO ] [REMOTE ] ASBA: Fetching primary data for 2025-09. [2025-09-17T17:22:04.490531] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T17:22:05.042073] [INFO ] [REMOTE ] ASBA: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T17:22:05.043469] [INFO ] [REMOTE ] ASBA: Full fetch complete (5315 records). [2025-09-17T17:22:05.043560] [DEBUG] [VALIDATOR ] ASBA: Validating primary data. [2025-09-17T17:22:05.221868] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-03. [2025-09-17T17:22:05.434296] [DEBUG] [VALIDATOR ] ASBA: All expected trading days are present. [2025-09-17T17:22:05.434376] [DEBUG] [VALIDATOR ] ASBA: Primary data validation passed. [2025-09-17T17:22:05.434530] [INFO ] [MAIN ] ASBA: Fetched primary data is valid. [2025-09-17T17:22:05.434568] [DEBUG] [LOCAL ] ASBA: Saving primary data. [2025-09-17T17:22:05.435002] [DEBUG] [LOCAL ] ASBA: Trimmed 5315 records to 3435 (keeping 200 days of data) [2025-09-17T17:22:05.460663] [DEBUG] [LOCAL ] ASBA: Primary data saved (3435 records). [2025-09-17T17:22:05.460814] [INFO ] [MAIN ] ASBA: Full history saved. [2025-09-17T17:22:05.460905] [INFO ] [MAIN ] Update Progress: 156/2371 symbols completed. ASBA took 27.7s. Estimated remaining: 5h 13m 13s. Rate: 7.1 symbols/min [2025-09-17T17:22:05.638895] [INFO ] [MAIN ] ASGN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:22:05.678273] [DEBUG] [LOCAL ] ASGN: Loaded 36021 existing records from primary storage. [2025-09-17T17:22:05.678420] [INFO ] [MAIN ] ASGN: Loaded 36021 existing records. [2025-09-17T17:22:05.866810] [WARN ] [MAIN ] ASGN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:22:05.867100] [INFO ] [MAIN ] ASGN: Wiping existing primary data before full refresh. [2025-09-17T17:22:05.867150] [INFO ] [LOCAL ] ASGN: Starting deletion of primary data. [2025-09-17T17:22:05.867840] [DEBUG] [LOCAL ] ASGN: Deleted primary data file. [2025-09-17T17:22:05.867893] [INFO ] [MAIN ] ASGN: Starting full primary refresh. [2025-09-17T17:22:06.020931] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-02. [2025-09-17T17:22:06.226180] [INFO ] [REMOTE ] ASGN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:22:06.486107] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T17:22:06.815893] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-11. [2025-09-17T17:22:07.163749] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T17:22:07.615828] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-03. [2025-09-17T17:22:08.231157] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T17:22:08.270952] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T17:22:08.415774] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-04. [2025-09-17T17:22:09.185217] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T17:22:09.215723] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-05. [2025-09-17T17:22:10.015806] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-02. [2025-09-17T17:22:10.646424] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T17:22:10.815814] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-06. [2025-09-17T17:22:10.990705] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T17:22:11.615765] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-03. [2025-09-17T17:22:11.931712] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T17:22:12.415787] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-07. [2025-09-17T17:22:12.487209] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T17:22:13.215829] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-04. [2025-09-17T17:22:13.517336] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T17:22:14.015828] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-08. [2025-09-17T17:22:14.683956] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T17:22:14.815791] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2024-12. [2025-09-17T17:22:15.197855] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T17:22:15.615787] [INFO ] [REMOTE ] ASGI: Fetching primary data for 2025-09. [2025-09-17T17:22:16.137580] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T17:22:16.415807] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-04. [2025-09-17T17:22:16.795073] [INFO ] [REMOTE ] ASGI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T17:22:16.798574] [INFO ] [REMOTE ] ASGI: Full fetch complete (33073 records). [2025-09-17T17:22:16.798676] [DEBUG] [VALIDATOR ] ASGI: Validating primary data. [2025-09-17T17:22:17.188949] [DEBUG] [VALIDATOR ] ASGI: All expected trading days are present. [2025-09-17T17:22:17.189040] [DEBUG] [VALIDATOR ] ASGI: Primary data validation passed. [2025-09-17T17:22:17.189473] [INFO ] [MAIN ] ASGI: Fetched primary data is valid. [2025-09-17T17:22:17.189517] [DEBUG] [LOCAL ] ASGI: Saving primary data. [2025-09-17T17:22:17.190917] [DEBUG] [LOCAL ] ASGI: Trimmed 33073 records to 22162 (keeping 200 days of data) [2025-09-17T17:22:17.244121] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-05. [2025-09-17T17:22:17.328968] [DEBUG] [LOCAL ] ASGI: Primary data saved (22162 records). [2025-09-17T17:22:17.329104] [INFO ] [MAIN ] ASGI: Full history saved. [2025-09-17T17:22:17.329187] [INFO ] [MAIN ] Update Progress: 157/2371 symbols completed. ASGI took 20.1s. Estimated remaining: 5h 13m 52s. Rate: 7.1 symbols/min [2025-09-17T17:22:17.554806] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T17:22:18.015854] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-01. [2025-09-17T17:22:18.815754] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-05. [2025-09-17T17:22:18.840455] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T17:22:19.112874] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T17:22:19.616001] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-06. [2025-09-17T17:22:19.960935] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T17:22:20.415796] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-06. [2025-09-17T17:22:21.121311] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T17:22:21.215797] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-02. [2025-09-17T17:22:21.359099] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T17:22:22.015995] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-07. [2025-09-17T17:22:22.702021] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T17:22:22.815780] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-07. [2025-09-17T17:22:23.122197] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T17:22:23.615822] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-08. [2025-09-17T17:22:24.349404] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T17:22:24.415854] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-03. [2025-09-17T17:22:24.615244] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T17:22:25.215809] [INFO ] [REMOTE ] ASG: Fetching primary data for 2025-09. [2025-09-17T17:22:25.873409] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T17:22:25.955804] [INFO ] [REMOTE ] ASG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T17:22:25.958708] [INFO ] [REMOTE ] ASG: Full fetch complete (31608 records). [2025-09-17T17:22:25.958816] [DEBUG] [VALIDATOR ] ASG: Validating primary data. [2025-09-17T17:22:26.025545] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-04. [2025-09-17T17:22:26.341882] [DEBUG] [VALIDATOR ] ASG: All expected trading days are present. [2025-09-17T17:22:26.341966] [DEBUG] [VALIDATOR ] ASG: Primary data validation passed. [2025-09-17T17:22:26.342343] [INFO ] [MAIN ] ASG: Fetched primary data is valid. [2025-09-17T17:22:26.342405] [DEBUG] [LOCAL ] ASG: Saving primary data. [2025-09-17T17:22:26.343360] [DEBUG] [LOCAL ] ASG: Trimmed 31608 records to 21091 (keeping 200 days of data) [2025-09-17T17:22:26.470231] [DEBUG] [LOCAL ] ASG: Primary data saved (21091 records). [2025-09-17T17:22:26.470370] [INFO ] [MAIN ] ASG: Full history saved. [2025-09-17T17:22:26.470506] [INFO ] [MAIN ] Update Progress: 158/2371 symbols completed. ASG took 31.4s. Estimated remaining: 5h 13m 53s. Rate: 7.1 symbols/min [2025-09-17T17:22:26.815794] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-08. [2025-09-17T17:22:27.559981] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T17:22:27.615731] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-05. [2025-09-17T17:22:28.181808] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T17:22:28.415974] [INFO ] [REMOTE ] ASC: Fetching primary data for 2025-09. [2025-09-17T17:22:29.050527] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T17:22:29.215820] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-06. [2025-09-17T17:22:29.876571] [INFO ] [REMOTE ] ASC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T17:22:29.883889] [INFO ] [REMOTE ] ASC: Full fetch complete (57457 records). [2025-09-17T17:22:29.884054] [DEBUG] [VALIDATOR ] ASC: Validating primary data. [2025-09-17T17:22:30.277832] [DEBUG] [VALIDATOR ] ASC: All expected trading days are present. [2025-09-17T17:22:30.277933] [DEBUG] [VALIDATOR ] ASC: Primary data validation passed. [2025-09-17T17:22:30.278512] [INFO ] [MAIN ] ASC: Fetched primary data is valid. [2025-09-17T17:22:30.278552] [DEBUG] [LOCAL ] ASC: Saving primary data. [2025-09-17T17:22:30.279688] [DEBUG] [LOCAL ] ASC: Trimmed 57457 records to 38150 (keeping 200 days of data) [2025-09-17T17:22:30.515200] [DEBUG] [LOCAL ] ASC: Primary data saved (38150 records). [2025-09-17T17:22:30.515340] [INFO ] [MAIN ] ASC: Full history saved. [2025-09-17T17:22:30.515427] [INFO ] [MAIN ] Update Progress: 159/2371 symbols completed. ASC took 39.4s. Estimated remaining: 5h 12m 42s. Rate: 7.1 symbols/min [2025-09-17T17:22:30.640330] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T17:22:30.647300] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-07. [2025-09-17T17:22:32.081565] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T17:22:32.090510] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-08. [2025-09-17T17:22:33.545922] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T17:22:33.554328] [INFO ] [REMOTE ] ASGN: Fetching primary data for 2025-09. [2025-09-17T17:22:34.900714] [INFO ] [REMOTE ] ASGN: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T17:22:34.905633] [INFO ] [REMOTE ] ASGN: Full fetch complete (51253 records). [2025-09-17T17:22:34.905807] [DEBUG] [VALIDATOR ] ASGN: Validating primary data. [2025-09-17T17:22:35.291509] [DEBUG] [VALIDATOR ] ASGN: All expected trading days are present. [2025-09-17T17:22:35.291598] [DEBUG] [VALIDATOR ] ASGN: Primary data validation passed. [2025-09-17T17:22:35.292160] [INFO ] [MAIN ] ASGN: Fetched primary data is valid. [2025-09-17T17:22:35.292203] [DEBUG] [LOCAL ] ASGN: Saving primary data. [2025-09-17T17:22:35.293386] [DEBUG] [LOCAL ] ASGN: Trimmed 51253 records to 35955 (keeping 200 days of data) [2025-09-17T17:22:35.506830] [DEBUG] [LOCAL ] ASGN: Primary data saved (35955 records). [2025-09-17T17:22:35.506972] [INFO ] [MAIN ] ASGN: Full history saved. [2025-09-17T17:22:35.507057] [INFO ] [MAIN ] Update Progress: 160/2371 symbols completed. ASGN took 30.0s. Estimated remaining: 5h 11m 45s. Rate: 7.1 symbols/min [2025-09-17T17:22:36.210540] [INFO ] [MAIN ] ASIX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:22:36.281763] [INFO ] [MAIN ] ASH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:22:36.299965] [INFO ] [MAIN ] ASR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:22:36.301072] [INFO ] [MAIN ] ASPN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:22:36.325720] [DEBUG] [LOCAL ] ASR: Loaded 9147 existing records from primary storage. [2025-09-17T17:22:36.325855] [INFO ] [MAIN ] ASR: Loaded 9147 existing records. [2025-09-17T17:22:36.418818] [DEBUG] [LOCAL ] ASIX: Loaded 22344 existing records from primary storage. [2025-09-17T17:22:36.489638] [INFO ] [MAIN ] ASIX: Loaded 22344 existing records. [2025-09-17T17:22:36.621328] [DEBUG] [LOCAL ] ASH: Loaded 38086 existing records from primary storage. [2025-09-17T17:22:36.700779] [INFO ] [MAIN ] ASH: Loaded 38086 existing records. [2025-09-17T17:22:36.741776] [DEBUG] [LOCAL ] ASPN: Loaded 49681 existing records from primary storage. [2025-09-17T17:22:36.742059] [INFO ] [MAIN ] ASPN: Loaded 49681 existing records. [2025-09-17T17:22:36.890470] [WARN ] [MAIN ] ASR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:22:36.947964] [INFO ] [MAIN ] ASR: Wiping existing primary data before full refresh. [2025-09-17T17:22:37.003624] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-17T17:22:37.045130] [DEBUG] [LOCAL ] ASR: Deleted primary data file. [2025-09-17T17:22:37.045239] [INFO ] [MAIN ] ASR: Starting full primary refresh. [2025-09-17T17:22:37.468560] [WARN ] [MAIN ] ASIX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:22:37.526916] [INFO ] [MAIN ] ASIX: Wiping existing primary data before full refresh. [2025-09-17T17:22:37.638167] [WARN ] [MAIN ] ASH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:22:37.628818] [INFO ] [LOCAL ] ASIX: Starting deletion of primary data. [2025-09-17T17:22:37.682702] [INFO ] [MAIN ] ASH: Wiping existing primary data before full refresh. [2025-09-17T17:22:37.717599] [INFO ] [LOCAL ] ASH: Starting deletion of primary data. [2025-09-17T17:22:37.722309] [WARN ] [MAIN ] ASPN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:22:37.722379] [DEBUG] [LOCAL ] ASIX: Deleted primary data file. [2025-09-17T17:22:37.729768] [DEBUG] [LOCAL ] ASH: Deleted primary data file. [2025-09-17T17:22:37.755511] [INFO ] [MAIN ] ASH: Starting full primary refresh. [2025-09-17T17:22:37.746596] [INFO ] [MAIN ] ASIX: Starting full primary refresh. [2025-09-17T17:22:37.755428] [INFO ] [MAIN ] ASPN: Wiping existing primary data before full refresh. [2025-09-17T17:22:37.886151] [INFO ] [LOCAL ] ASPN: Starting deletion of primary data. [2025-09-17T17:22:37.999845] [DEBUG] [LOCAL ] ASPN: Deleted primary data file. [2025-09-17T17:22:38.027220] [INFO ] [MAIN ] ASPN: Starting full primary refresh. [2025-09-17T17:22:38.295048] [INFO ] [REMOTE ] ASR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:22:38.389932] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-11. [2025-09-17T17:22:38.862390] [INFO ] [REMOTE ] ASH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:22:38.921901] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-11. [2025-09-17T17:22:38.986246] [INFO ] [REMOTE ] ASIX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:22:39.016123] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-11. [2025-09-17T17:22:39.046356] [INFO ] [REMOTE ] ASPN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:22:39.046676] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-11. [2025-09-17T17:22:39.423462] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T17:22:39.425378] [INFO ] [REMOTE ] ASR: Fetching primary data for 2024-12. [2025-09-17T17:22:39.754870] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T17:22:39.758683] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2024-12. [2025-09-17T17:22:40.253593] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T17:22:40.255845] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-01. [2025-09-17T17:22:40.311441] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T17:22:40.318174] [INFO ] [REMOTE ] ASH: Fetching primary data for 2024-12. [2025-09-17T17:22:40.414081] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T17:22:40.419107] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-01. [2025-09-17T17:22:40.838806] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T17:22:40.853188] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T17:22:40.853015] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2024-12. [2025-09-17T17:22:40.855937] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-02. [2025-09-17T17:22:41.233195] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T17:22:41.237434] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-02. [2025-09-17T17:22:41.308808] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T17:22:41.367929] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T17:22:42.015791] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-01. [2025-09-17T17:22:42.221866] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T17:22:42.373144] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T17:22:42.815778] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-01. [2025-09-17T17:22:43.235254] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T17:22:43.615779] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-03. [2025-09-17T17:22:44.329975] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T17:22:44.415775] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-02. [2025-09-17T17:22:44.513454] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T17:22:45.215775] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-02. [2025-09-17T17:22:45.819419] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T17:22:46.015823] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-04. [2025-09-17T17:22:46.815825] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-03. [2025-09-17T17:22:46.969941] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T17:22:47.301432] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-17T17:22:47.615782] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-05. [2025-09-17T17:22:48.401747] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T17:22:48.415753] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-03. [2025-09-17T17:22:48.495528] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T17:22:49.215793] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-04. [2025-09-17T17:22:49.499002] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T17:22:50.015794] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-04. [2025-09-17T17:22:50.775993] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T17:22:50.815797] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-06. [2025-09-17T17:22:51.227021] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T17:22:51.615781] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-05. [2025-09-17T17:22:51.689567] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T17:22:52.415817] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-03. [2025-09-17T17:22:52.572046] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T17:22:53.215790] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-06. [2025-09-17T17:22:54.015770] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-05. [2025-09-17T17:22:54.231244] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T17:22:54.268120] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T17:22:54.815848] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-07. [2025-09-17T17:22:55.418180] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T17:22:55.512112] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T17:22:55.615756] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-04. [2025-09-17T17:22:56.415771] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-06. [2025-09-17T17:22:57.215771] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-07. [2025-09-17T17:22:57.336085] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T17:22:57.721474] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T17:22:58.015745] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-05. [2025-09-17T17:22:58.407172] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T17:22:58.815836] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-08. [2025-09-17T17:22:59.615818] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-08. [2025-09-17T17:22:59.828322] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T17:22:59.883114] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T17:23:00.415785] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-07. [2025-09-17T17:23:01.215834] [INFO ] [REMOTE ] ASIX: Fetching primary data for 2025-09. [2025-09-17T17:23:02.015835] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-06. [2025-09-17T17:23:04.246454] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-08 (4.63 seconds). [2025-09-17T17:23:04.250963] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-07 (3.84 seconds). [2025-09-17T17:23:04.260045] [INFO ] [REMOTE ] ASR: Fetching primary data for 2025-09. [2025-09-17T17:23:04.261590] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-08. [2025-09-17T17:23:04.531251] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-17T17:23:04.541287] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-07. [2025-09-17T17:23:04.664131] [INFO ] [REMOTE ] ASIX: Incremental fetch complete for 2025-09 (3.45 seconds). [2025-09-17T17:23:04.667314] [INFO ] [REMOTE ] ASIX: Full fetch complete (29534 records). [2025-09-17T17:23:04.667396] [DEBUG] [VALIDATOR ] ASIX: Validating primary data. [2025-09-17T17:23:05.044452] [DEBUG] [VALIDATOR ] ASIX: All expected trading days are present. [2025-09-17T17:23:05.044660] [DEBUG] [VALIDATOR ] ASIX: Primary data validation passed. [2025-09-17T17:23:05.045025] [INFO ] [MAIN ] ASIX: Fetched primary data is valid. [2025-09-17T17:23:05.045065] [DEBUG] [LOCAL ] ASIX: Saving primary data. [2025-09-17T17:23:05.045853] [DEBUG] [LOCAL ] ASIX: Trimmed 29534 records to 22393 (keeping 200 days of data) [2025-09-17T17:23:05.169755] [INFO ] [REMOTE ] ASR: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T17:23:05.176956] [INFO ] [REMOTE ] ASR: Full fetch complete (12109 records). [2025-09-17T17:23:05.179288] [DEBUG] [VALIDATOR ] ASR: Validating primary data. [2025-09-17T17:23:05.194194] [DEBUG] [LOCAL ] ASIX: Primary data saved (22393 records). [2025-09-17T17:23:05.194786] [INFO ] [MAIN ] ASIX: Full history saved. [2025-09-17T17:23:05.194894] [INFO ] [MAIN ] Update Progress: 161/2371 symbols completed. ASIX took 29.7s. Estimated remaining: 5h 16m 28s. Rate: 7.0 symbols/min [2025-09-17T17:23:05.194596] [FATAL] [VALIDATOR ] ASR: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:23:05.195249] [FATAL] [MAIN ] ASR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:23:05.238738] [WARN ] [MAIN ] ASR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:23:05.260393] [INFO ] [LOCAL ] ASR: Starting deletion of primary data. [2025-09-17T17:23:05.288248] [DEBUG] [LOCAL ] ASR: No primary data file found to delete. [2025-09-17T17:23:05.298598] [INFO ] [LOCAL ] ASR: Starting deletion of derivative data. [2025-09-17T17:23:05.314625] [DEBUG] [LOCAL ] ASR: Deleted derivative data file. [2025-09-17T17:23:05.338337] [INFO ] [MAIN ] Update Progress: 162/2371 symbols completed. ASR took 29.8s. Estimated remaining: 5h 14m 24s. Rate: 7.0 symbols/min [2025-09-17T17:23:05.399508] [INFO ] [MAIN ] ASX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:23:05.542817] [INFO ] [MAIN ] ATEN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:23:05.590954] [DEBUG] [LOCAL ] ASX: Loaded 52931 existing records from primary storage. [2025-09-17T17:23:05.591156] [INFO ] [MAIN ] ASX: Loaded 52931 existing records. [2025-09-17T17:23:05.799760] [WARN ] [MAIN ] ASX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:23:05.800780] [DEBUG] [LOCAL ] ATEN: Loaded 40190 existing records from primary storage. [2025-09-17T17:23:05.801134] [INFO ] [MAIN ] ATEN: Loaded 40190 existing records. [2025-09-17T17:23:05.801210] [INFO ] [MAIN ] ASX: Wiping existing primary data before full refresh. [2025-09-17T17:23:05.849373] [INFO ] [LOCAL ] ASX: Starting deletion of primary data. [2025-09-17T17:23:05.893791] [DEBUG] [LOCAL ] ASX: Deleted primary data file. [2025-09-17T17:23:05.904241] [INFO ] [MAIN ] ASX: Starting full primary refresh. [2025-09-17T17:23:06.067151] [WARN ] [MAIN ] ATEN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:23:06.090560] [INFO ] [MAIN ] ATEN: Wiping existing primary data before full refresh. [2025-09-17T17:23:06.111673] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-17T17:23:06.158769] [DEBUG] [LOCAL ] ATEN: Deleted primary data file. [2025-09-17T17:23:06.181482] [INFO ] [MAIN ] ATEN: Starting full primary refresh. [2025-09-17T17:23:06.222140] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T17:23:06.346110] [INFO ] [REMOTE ] ASH: Fetching primary data for 2025-09. [2025-09-17T17:23:06.573620] [INFO ] [REMOTE ] ASX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:23:06.591823] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-11. [2025-09-17T17:23:06.783565] [INFO ] [REMOTE ] ATEN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:23:06.813847] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-17T17:23:06.823981] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-11. [2025-09-17T17:23:07.615805] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-08. [2025-09-17T17:23:07.741845] [INFO ] [REMOTE ] ASH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T17:23:07.746585] [INFO ] [REMOTE ] ASH: Full fetch complete (54251 records). [2025-09-17T17:23:07.746704] [DEBUG] [VALIDATOR ] ASH: Validating primary data. [2025-09-17T17:23:08.134392] [DEBUG] [VALIDATOR ] ASH: All expected trading days are present. [2025-09-17T17:23:08.134504] [DEBUG] [VALIDATOR ] ASH: Primary data validation passed. [2025-09-17T17:23:08.135116] [INFO ] [MAIN ] ASH: Fetched primary data is valid. [2025-09-17T17:23:08.135160] [DEBUG] [LOCAL ] ASH: Saving primary data. [2025-09-17T17:23:08.136462] [DEBUG] [LOCAL ] ASH: Trimmed 54251 records to 38062 (keeping 200 days of data) [2025-09-17T17:23:08.394411] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T17:23:08.418852] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2024-12. [2025-09-17T17:23:08.438800] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T17:23:08.457104] [DEBUG] [LOCAL ] ASH: Primary data saved (38062 records). [2025-09-17T17:23:08.457226] [INFO ] [MAIN ] ASH: Full history saved. [2025-09-17T17:23:08.458469] [INFO ] [MAIN ] Update Progress: 163/2371 symbols completed. ASH took 32.9s. Estimated remaining: 5h 13m 2s. Rate: 7.1 symbols/min [2025-09-17T17:23:08.632589] [INFO ] [MAIN ] ATGE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:23:08.668939] [DEBUG] [LOCAL ] ATGE: Loaded 32297 existing records from primary storage. [2025-09-17T17:23:08.669083] [INFO ] [MAIN ] ATGE: Loaded 32297 existing records. [2025-09-17T17:23:08.851492] [WARN ] [MAIN ] ATGE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:23:08.851792] [INFO ] [MAIN ] ATGE: Wiping existing primary data before full refresh. [2025-09-17T17:23:08.851841] [INFO ] [LOCAL ] ATGE: Starting deletion of primary data. [2025-09-17T17:23:08.852736] [DEBUG] [LOCAL ] ATGE: Deleted primary data file. [2025-09-17T17:23:08.852790] [INFO ] [MAIN ] ATGE: Starting full primary refresh. [2025-09-17T17:23:09.217615] [INFO ] [REMOTE ] ASX: Fetching primary data for 2024-12. [2025-09-17T17:23:09.217487] [INFO ] [REMOTE ] ATGE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:23:09.273594] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T17:23:09.465056] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T17:23:10.015783] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-01. [2025-09-17T17:23:10.600072] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T17:23:10.815804] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-11. [2025-09-17T17:23:11.376031] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T17:23:11.615767] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-02. [2025-09-17T17:23:12.189353] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T17:23:12.415820] [INFO ] [REMOTE ] ASPN: Fetching primary data for 2025-09. [2025-09-17T17:23:12.749865] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T17:23:13.215786] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-03. [2025-09-17T17:23:13.320920] [DEBUG] [REMOTE ] ATEN: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-17T17:23:13.321208] [WARN ] [REMOTE ] ATEN: No data returned for month 2025-03 [2025-09-17T17:23:14.015707] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-01. [2025-09-17T17:23:14.452984] [INFO ] [REMOTE ] ASPN: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-17T17:23:14.459365] [INFO ] [REMOTE ] ASPN: Full fetch complete (72228 records). [2025-09-17T17:23:14.459519] [DEBUG] [VALIDATOR ] ASPN: Validating primary data. [2025-09-17T17:23:14.815799] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2024-12. [2025-09-17T17:23:14.857167] [DEBUG] [VALIDATOR ] ASPN: All expected trading days are present. [2025-09-17T17:23:14.857257] [DEBUG] [VALIDATOR ] ASPN: Primary data validation passed. [2025-09-17T17:23:14.858119] [INFO ] [MAIN ] ASPN: Fetched primary data is valid. [2025-09-17T17:23:14.858171] [DEBUG] [LOCAL ] ASPN: Saving primary data. [2025-09-17T17:23:14.859816] [DEBUG] [LOCAL ] ASPN: Trimmed 72228 records to 49657 (keeping 200 days of data) [2025-09-17T17:23:15.148230] [DEBUG] [LOCAL ] ASPN: Primary data saved (49657 records). [2025-09-17T17:23:15.148381] [INFO ] [MAIN ] ASPN: Full history saved. [2025-09-17T17:23:15.148487] [INFO ] [MAIN ] Update Progress: 164/2371 symbols completed. ASPN took 39.6s. Estimated remaining: 5h 12m 29s. Rate: 7.1 symbols/min [2025-09-17T17:23:15.327691] [INFO ] [MAIN ] ATHM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:23:15.360193] [DEBUG] [LOCAL ] ATHM: Loaded 33265 existing records from primary storage. [2025-09-17T17:23:15.360335] [INFO ] [MAIN ] ATHM: Loaded 33265 existing records. [2025-09-17T17:23:15.549327] [WARN ] [MAIN ] ATHM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:23:15.549594] [INFO ] [MAIN ] ATHM: Wiping existing primary data before full refresh. [2025-09-17T17:23:15.549675] [INFO ] [LOCAL ] ATHM: Starting deletion of primary data. [2025-09-17T17:23:15.550307] [DEBUG] [LOCAL ] ATHM: Deleted primary data file. [2025-09-17T17:23:15.550354] [INFO ] [MAIN ] ATHM: Starting full primary refresh. [2025-09-17T17:23:15.620919] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-04. [2025-09-17T17:23:15.912263] [INFO ] [REMOTE ] ATHM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:23:15.943875] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T17:23:16.161398] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T17:23:16.415785] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-11. [2025-09-17T17:23:17.002457] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T17:23:17.215774] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-02. [2025-09-17T17:23:17.712267] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T17:23:18.015787] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-01. [2025-09-17T17:23:18.815777] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2024-12. [2025-09-17T17:23:19.064870] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T17:23:19.340524] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T17:23:19.615813] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-05. [2025-09-17T17:23:20.361756] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T17:23:20.415730] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-01. [2025-09-17T17:23:21.209676] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T17:23:21.217384] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-03. [2025-09-17T17:23:21.512052] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T17:23:22.015786] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-06. [2025-09-17T17:23:22.815791] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-02. [2025-09-17T17:23:23.047096] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T17:23:23.402245] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T17:23:23.615783] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-04. [2025-09-17T17:23:23.953185] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T17:23:24.415790] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-03. [2025-09-17T17:23:25.078580] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T17:23:25.215773] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-07. [2025-09-17T17:23:25.822226] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T17:23:26.015747] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-05. [2025-09-17T17:23:26.685063] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T17:23:26.815766] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-08. [2025-09-17T17:23:27.419741] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T17:23:27.615773] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-06. [2025-09-17T17:23:27.866623] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T17:23:28.415786] [INFO ] [REMOTE ] ATEN: Fetching primary data for 2025-09. [2025-09-17T17:23:29.215773] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-04. [2025-09-17T17:23:29.522903] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T17:23:29.738551] [INFO ] [REMOTE ] ATEN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T17:23:29.743628] [INFO ] [REMOTE ] ATEN: Full fetch complete (50486 records). [2025-09-17T17:23:29.743796] [DEBUG] [VALIDATOR ] ATEN: Validating primary data. [2025-09-17T17:23:29.947914] [WARN ] [VALIDATOR ] ATEN: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T17:23:29.948550] [FATAL] [MAIN ] ATEN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:23:29.948619] [WARN ] [MAIN ] ATEN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:23:29.948705] [INFO ] [LOCAL ] ATEN: Starting deletion of primary data. [2025-09-17T17:23:29.948795] [DEBUG] [LOCAL ] ATEN: No primary data file found to delete. [2025-09-17T17:23:29.948851] [INFO ] [LOCAL ] ATEN: Starting deletion of derivative data. [2025-09-17T17:23:29.949192] [DEBUG] [LOCAL ] ATEN: Deleted derivative data file. [2025-09-17T17:23:29.949312] [INFO ] [MAIN ] Update Progress: 165/2371 symbols completed. ATEN took 24.6s. Estimated remaining: 5h 13m 45s. Rate: 7.0 symbols/min [2025-09-17T17:23:30.020861] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-02. [2025-09-17T17:23:30.131770] [INFO ] [MAIN ] ATHS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:23:30.139908] [DEBUG] [LOCAL ] ATHS: Loaded 7197 existing records from primary storage. [2025-09-17T17:23:30.140021] [INFO ] [MAIN ] ATHS: Loaded 7197 existing records. [2025-09-17T17:23:30.334811] [WARN ] [MAIN ] ATHS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:23:30.335079] [INFO ] [MAIN ] ATHS: Wiping existing primary data before full refresh. [2025-09-17T17:23:30.335126] [INFO ] [LOCAL ] ATHS: Starting deletion of primary data. [2025-09-17T17:23:30.335490] [DEBUG] [LOCAL ] ATHS: Deleted primary data file. [2025-09-17T17:23:30.335537] [INFO ] [MAIN ] ATHS: Starting full primary refresh. [2025-09-17T17:23:30.700583] [INFO ] [REMOTE ] ATHS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:23:30.726918] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T17:23:30.815748] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-05. [2025-09-17T17:23:31.539543] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T17:23:31.615730] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-03. [2025-09-17T17:23:32.245076] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T17:23:32.415810] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-06. [2025-09-17T17:23:33.038513] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T17:23:33.215793] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-04. [2025-09-17T17:23:33.408434] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T17:23:34.015780] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-11. [2025-09-17T17:23:34.397754] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T17:23:34.485965] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T17:23:34.815816] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2024-12. [2025-09-17T17:23:35.408699] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T17:23:35.615794] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-05. [2025-09-17T17:23:36.415770] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-07. [2025-09-17T17:23:37.041678] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T17:23:37.215745] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-06. [2025-09-17T17:23:37.519344] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T17:23:38.015773] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-07. [2025-09-17T17:23:38.140596] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T17:23:38.815782] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-08. [2025-09-17T17:23:39.615798] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-07. [2025-09-17T17:23:39.860281] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T17:23:39.986393] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T17:23:40.415776] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-01. [2025-09-17T17:23:40.634160] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T17:23:41.013125] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T17:23:41.215781] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-02. [2025-09-17T17:23:41.828274] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T17:23:42.015751] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-03. [2025-09-17T17:23:42.806141] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T17:23:42.815670] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-08. [2025-09-17T17:23:43.615775] [INFO ] [REMOTE ] ATHM: Fetching primary data for 2025-09. [2025-09-17T17:23:44.415767] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-08. [2025-09-17T17:23:44.604907] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T17:23:44.823938] [INFO ] [REMOTE ] ATHM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T17:23:44.827330] [INFO ] [REMOTE ] ATHM: Full fetch complete (52409 records). [2025-09-17T17:23:44.827450] [DEBUG] [VALIDATOR ] ATHM: Validating primary data. [2025-09-17T17:23:45.220169] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-04. [2025-09-17T17:23:45.220449] [DEBUG] [VALIDATOR ] ATHM: All expected trading days are present. [2025-09-17T17:23:45.221315] [DEBUG] [VALIDATOR ] ATHM: Primary data validation passed. [2025-09-17T17:23:45.221907] [INFO ] [MAIN ] ATHM: Fetched primary data is valid. [2025-09-17T17:23:45.221973] [DEBUG] [LOCAL ] ATHM: Saving primary data. [2025-09-17T17:23:45.223215] [DEBUG] [LOCAL ] ATHM: Trimmed 52409 records to 33171 (keeping 200 days of data) [2025-09-17T17:23:45.418927] [DEBUG] [LOCAL ] ATHM: Primary data saved (33171 records). [2025-09-17T17:23:45.419075] [INFO ] [MAIN ] ATHM: Full history saved. [2025-09-17T17:23:45.419160] [INFO ] [MAIN ] Update Progress: 166/2371 symbols completed. ATHM took 30.3s. Estimated remaining: 5h 15m 9s. Rate: 7.0 symbols/min [2025-09-17T17:23:45.598329] [INFO ] [MAIN ] ATI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:23:45.645689] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T17:23:45.669323] [DEBUG] [LOCAL ] ATI: Loaded 51702 existing records from primary storage. [2025-09-17T17:23:45.669477] [INFO ] [MAIN ] ATI: Loaded 51702 existing records. [2025-09-17T17:23:45.880309] [WARN ] [MAIN ] ATI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:23:45.880580] [INFO ] [MAIN ] ATI: Wiping existing primary data before full refresh. [2025-09-17T17:23:45.880633] [INFO ] [LOCAL ] ATI: Starting deletion of primary data. [2025-09-17T17:23:45.882013] [DEBUG] [LOCAL ] ATI: Deleted primary data file. [2025-09-17T17:23:45.882070] [INFO ] [MAIN ] ATI: Starting full primary refresh. [2025-09-17T17:23:46.026464] [INFO ] [REMOTE ] ASX: Fetching primary data for 2025-09. [2025-09-17T17:23:46.182528] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T17:23:46.272146] [INFO ] [REMOTE ] ATI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:23:46.815830] [INFO ] [REMOTE ] ATGE: Fetching primary data for 2025-09. [2025-09-17T17:23:47.615803] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-11. [2025-09-17T17:23:47.950967] [INFO ] [REMOTE ] ASX: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T17:23:47.958388] [INFO ] [REMOTE ] ASX: Full fetch complete (76487 records). [2025-09-17T17:23:47.958534] [DEBUG] [VALIDATOR ] ASX: Validating primary data. [2025-09-17T17:23:48.077536] [INFO ] [REMOTE ] ATGE: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T17:23:48.116934] [INFO ] [REMOTE ] ATGE: Full fetch complete (46186 records). [2025-09-17T17:23:48.132582] [DEBUG] [VALIDATOR ] ATGE: Validating primary data. [2025-09-17T17:23:48.424507] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-05. [2025-09-17T17:23:48.993158] [DEBUG] [VALIDATOR ] ASX: All expected trading days are present. [2025-09-17T17:23:49.013350] [DEBUG] [VALIDATOR ] ASX: Primary data validation passed. [2025-09-17T17:23:49.025073] [INFO ] [MAIN ] ASX: Fetched primary data is valid. [2025-09-17T17:23:49.052383] [DEBUG] [LOCAL ] ASX: Saving primary data. [2025-09-17T17:23:49.091565] [DEBUG] [LOCAL ] ASX: Trimmed 76487 records to 52930 (keeping 200 days of data) [2025-09-17T17:23:49.273125] [DEBUG] [VALIDATOR ] ATGE: All expected trading days are present. [2025-09-17T17:23:49.273967] [DEBUG] [VALIDATOR ] ATGE: Primary data validation passed. [2025-09-17T17:23:49.280394] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T17:23:49.281493] [INFO ] [MAIN ] ATGE: Fetched primary data is valid. [2025-09-17T17:23:49.282385] [DEBUG] [LOCAL ] ATGE: Saving primary data. [2025-09-17T17:23:49.286258] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-06. [2025-09-17T17:23:49.291177] [DEBUG] [LOCAL ] ATGE: Trimmed 46186 records to 32168 (keeping 200 days of data) [2025-09-17T17:23:49.513485] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T17:23:49.548041] [DEBUG] [LOCAL ] ATGE: Primary data saved (32168 records). [2025-09-17T17:23:49.548751] [INFO ] [MAIN ] ATGE: Full history saved. [2025-09-17T17:23:49.549104] [INFO ] [MAIN ] Update Progress: 167/2371 symbols completed. ATGE took 41.1s. Estimated remaining: 5h 14m 2s. Rate: 7.0 symbols/min [2025-09-17T17:23:49.825967] [INFO ] [MAIN ] ATKR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:23:49.870546] [DEBUG] [LOCAL ] ATKR: Loaded 35889 existing records from primary storage. [2025-09-17T17:23:49.871543] [INFO ] [MAIN ] ATKR: Loaded 35889 existing records. [2025-09-17T17:23:50.021451] [INFO ] [REMOTE ] ATI: Fetching primary data for 2024-12. [2025-09-17T17:23:50.062403] [WARN ] [MAIN ] ATKR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:23:50.063518] [INFO ] [MAIN ] ATKR: Wiping existing primary data before full refresh. [2025-09-17T17:23:50.063604] [INFO ] [LOCAL ] ATKR: Starting deletion of primary data. [2025-09-17T17:23:50.068421] [DEBUG] [LOCAL ] ATKR: Deleted primary data file. [2025-09-17T17:23:50.071963] [INFO ] [MAIN ] ATKR: Starting full primary refresh. [2025-09-17T17:23:50.071910] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T17:23:50.509118] [INFO ] [REMOTE ] ATKR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:23:50.518578] [DEBUG] [LOCAL ] ASX: Primary data saved (52930 records). [2025-09-17T17:23:50.518689] [INFO ] [MAIN ] ASX: Full history saved. [2025-09-17T17:23:50.519559] [INFO ] [MAIN ] Update Progress: 168/2371 symbols completed. ASX took 45.3s. Estimated remaining: 5h 12m 14s. Rate: 7.1 symbols/min [2025-09-17T17:23:50.685472] [INFO ] [MAIN ] ATMU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:23:50.727832] [DEBUG] [LOCAL ] ATMU: Loaded 39756 existing records from primary storage. [2025-09-17T17:23:50.727973] [INFO ] [MAIN ] ATMU: Loaded 39756 existing records. [2025-09-17T17:23:50.824671] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-07. [2025-09-17T17:23:50.922937] [WARN ] [MAIN ] ATMU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:23:50.923183] [INFO ] [MAIN ] ATMU: Wiping existing primary data before full refresh. [2025-09-17T17:23:50.923229] [INFO ] [LOCAL ] ATMU: Starting deletion of primary data. [2025-09-17T17:23:50.924404] [DEBUG] [LOCAL ] ATMU: Deleted primary data file. [2025-09-17T17:23:50.924455] [INFO ] [MAIN ] ATMU: Starting full primary refresh. [2025-09-17T17:23:51.279417] [INFO ] [REMOTE ] ATMU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:23:51.560405] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T17:23:51.623361] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-11. [2025-09-17T17:23:51.646457] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T17:23:52.415799] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-01. [2025-09-17T17:23:53.084675] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T17:23:53.215821] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-08. [2025-09-17T17:23:53.594576] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T17:23:53.988516] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T17:23:54.015728] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-02. [2025-09-17T17:23:54.815819] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2024-12. [2025-09-17T17:23:55.492728] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T17:23:55.615769] [INFO ] [REMOTE ] ATHS: Fetching primary data for 2025-09. [2025-09-17T17:23:55.858765] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T17:23:56.415792] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-11. [2025-09-17T17:23:56.434444] [INFO ] [REMOTE ] ATHS: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T17:23:56.435832] [INFO ] [REMOTE ] ATHS: Full fetch complete (9974 records). [2025-09-17T17:23:56.435927] [DEBUG] [VALIDATOR ] ATHS: Validating primary data. [2025-09-17T17:23:56.791178] [DEBUG] [VALIDATOR ] ATHS: All expected trading days are present. [2025-09-17T17:23:56.791254] [DEBUG] [VALIDATOR ] ATHS: Primary data validation passed. [2025-09-17T17:23:56.791434] [INFO ] [MAIN ] ATHS: Fetched primary data is valid. [2025-09-17T17:23:56.791470] [DEBUG] [LOCAL ] ATHS: Saving primary data. [2025-09-17T17:23:56.791908] [DEBUG] [LOCAL ] ATHS: Trimmed 9974 records to 7178 (keeping 200 days of data) [2025-09-17T17:23:56.835826] [DEBUG] [LOCAL ] ATHS: Primary data saved (7178 records). [2025-09-17T17:23:56.835922] [INFO ] [MAIN ] ATHS: Full history saved. [2025-09-17T17:23:56.836005] [INFO ] [MAIN ] Update Progress: 169/2371 symbols completed. ATHS took 26.9s. Estimated remaining: 5h 11m 37s. Rate: 7.1 symbols/min [2025-09-17T17:23:57.009808] [INFO ] [MAIN ] ATO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:23:57.056212] [DEBUG] [LOCAL ] ATO: Loaded 42075 existing records from primary storage. [2025-09-17T17:23:57.056351] [INFO ] [MAIN ] ATO: Loaded 42075 existing records. [2025-09-17T17:23:57.228254] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-03. [2025-09-17T17:23:57.232634] [WARN ] [MAIN ] ATO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:23:57.233886] [INFO ] [MAIN ] ATO: Wiping existing primary data before full refresh. [2025-09-17T17:23:57.233961] [INFO ] [LOCAL ] ATO: Starting deletion of primary data. [2025-09-17T17:23:57.234892] [DEBUG] [LOCAL ] ATO: Deleted primary data file. [2025-09-17T17:23:57.234954] [INFO ] [MAIN ] ATO: Starting full primary refresh. [2025-09-17T17:23:57.590024] [INFO ] [REMOTE ] ATO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:23:57.985152] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T17:23:58.015727] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2024-12. [2025-09-17T17:23:58.815825] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-11. [2025-09-17T17:23:59.035587] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T17:23:59.492702] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T17:23:59.615779] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-01. [2025-09-17T17:24:00.391566] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T17:24:00.415739] [INFO ] [REMOTE ] ATO: Fetching primary data for 2024-12. [2025-09-17T17:24:01.058841] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T17:24:01.215788] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-02. [2025-09-17T17:24:02.015740] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-04. [2025-09-17T17:24:02.095604] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T17:24:02.532069] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T17:24:02.815792] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-03. [2025-09-17T17:24:03.615787] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-01. [2025-09-17T17:24:03.836141] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T17:24:04.004245] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T17:24:04.415770] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-04. [2025-09-17T17:24:05.207237] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T17:24:05.215765] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-02. [2025-09-17T17:24:05.592822] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T17:24:06.015779] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-05. [2025-09-17T17:24:06.445853] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T17:24:06.815785] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-05. [2025-09-17T17:24:07.494180] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T17:24:07.615786] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-01. [2025-09-17T17:24:08.415778] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-03. [2025-09-17T17:24:08.600178] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T17:24:09.199719] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T17:24:09.215731] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-02. [2025-09-17T17:24:09.655354] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T17:24:10.015779] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-06. [2025-09-17T17:24:10.724391] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T17:24:10.815778] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-03. [2025-09-17T17:24:11.414091] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T17:24:11.615767] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-04. [2025-09-17T17:24:12.421523] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-07. [2025-09-17T17:24:12.427885] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T17:24:12.952887] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T17:24:13.215782] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-06. [2025-09-17T17:24:13.584518] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T17:24:14.015789] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-05. [2025-09-17T17:24:14.815750] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-04. [2025-09-17T17:24:15.064120] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T17:24:15.301551] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T17:24:15.615779] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-08. [2025-09-17T17:24:16.415748] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-06. [2025-09-17T17:24:16.501079] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T17:24:17.157063] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T17:24:17.215730] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-05. [2025-09-17T17:24:17.666149] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T17:24:18.015880] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-07. [2025-09-17T17:24:18.510011] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T17:24:18.815803] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-06. [2025-09-17T17:24:19.615887] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-07. [2025-09-17T17:24:19.915894] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T17:24:20.250195] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T17:24:20.415851] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-07. [2025-09-17T17:24:21.127235] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T17:24:21.215749] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-08. [2025-09-17T17:24:22.015815] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-08. [2025-09-17T17:24:22.088877] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T17:24:22.429295] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T17:24:22.815812] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-08. [2025-09-17T17:24:23.622998] [INFO ] [REMOTE ] ATKR: Fetching primary data for 2025-09. [2025-09-17T17:24:23.626275] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T17:24:24.397099] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T17:24:24.415726] [INFO ] [REMOTE ] ATO: Fetching primary data for 2025-09. [2025-09-17T17:24:24.603198] [INFO ] [REMOTE ] ATKR: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T17:24:24.608052] [INFO ] [REMOTE ] ATKR: Full fetch complete (53572 records). [2025-09-17T17:24:24.608164] [DEBUG] [VALIDATOR ] ATKR: Validating primary data. [2025-09-17T17:24:24.996475] [DEBUG] [VALIDATOR ] ATKR: All expected trading days are present. [2025-09-17T17:24:24.996568] [DEBUG] [VALIDATOR ] ATKR: Primary data validation passed. [2025-09-17T17:24:24.997163] [INFO ] [MAIN ] ATKR: Fetched primary data is valid. [2025-09-17T17:24:24.997208] [DEBUG] [LOCAL ] ATKR: Saving primary data. [2025-09-17T17:24:24.998438] [DEBUG] [LOCAL ] ATKR: Trimmed 53572 records to 35859 (keeping 200 days of data) [2025-09-17T17:24:25.215948] [INFO ] [REMOTE ] ATI: Fetching primary data for 2025-09. [2025-09-17T17:24:25.232622] [DEBUG] [LOCAL ] ATKR: Primary data saved (35859 records). [2025-09-17T17:24:25.232738] [INFO ] [MAIN ] ATKR: Full history saved. [2025-09-17T17:24:25.233390] [INFO ] [MAIN ] Update Progress: 170/2371 symbols completed. ATKR took 35.7s. Estimated remaining: 5h 15m 46s. Rate: 7.0 symbols/min [2025-09-17T17:24:25.401991] [INFO ] [MAIN ] ATR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:24:25.435869] [DEBUG] [LOCAL ] ATR: Loaded 30540 existing records from primary storage. [2025-09-17T17:24:25.436018] [INFO ] [MAIN ] ATR: Loaded 30540 existing records. [2025-09-17T17:24:25.620812] [WARN ] [MAIN ] ATR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:24:25.621054] [INFO ] [MAIN ] ATR: Wiping existing primary data before full refresh. [2025-09-17T17:24:25.621100] [INFO ] [LOCAL ] ATR: Starting deletion of primary data. [2025-09-17T17:24:25.622183] [DEBUG] [LOCAL ] ATR: Deleted primary data file. [2025-09-17T17:24:25.622241] [INFO ] [MAIN ] ATR: Starting full primary refresh. [2025-09-17T17:24:25.980537] [INFO ] [REMOTE ] ATR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:24:25.996059] [INFO ] [REMOTE ] ATO: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T17:24:26.002273] [INFO ] [REMOTE ] ATO: Full fetch complete (60225 records). [2025-09-17T17:24:26.002381] [DEBUG] [VALIDATOR ] ATO: Validating primary data. [2025-09-17T17:24:26.024003] [INFO ] [REMOTE ] ATMU: Fetching primary data for 2025-09. [2025-09-17T17:24:26.410669] [DEBUG] [VALIDATOR ] ATO: All expected trading days are present. [2025-09-17T17:24:26.410752] [DEBUG] [VALIDATOR ] ATO: Primary data validation passed. [2025-09-17T17:24:26.411435] [INFO ] [MAIN ] ATO: Fetched primary data is valid. [2025-09-17T17:24:26.411509] [DEBUG] [LOCAL ] ATO: Saving primary data. [2025-09-17T17:24:26.413840] [DEBUG] [LOCAL ] ATO: Trimmed 60225 records to 42098 (keeping 200 days of data) [2025-09-17T17:24:26.688591] [DEBUG] [LOCAL ] ATO: Primary data saved (42098 records). [2025-09-17T17:24:26.688742] [INFO ] [MAIN ] ATO: Full history saved. [2025-09-17T17:24:26.689372] [INFO ] [MAIN ] Update Progress: 171/2371 symbols completed. ATO took 29.9s. Estimated remaining: 5h 14m 5s. Rate: 7.0 symbols/min [2025-09-17T17:24:26.820836] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-11. [2025-09-17T17:24:26.863266] [INFO ] [MAIN ] ATS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:24:26.884670] [DEBUG] [LOCAL ] ATS: Loaded 18304 existing records from primary storage. [2025-09-17T17:24:26.884792] [INFO ] [MAIN ] ATS: Loaded 18304 existing records. [2025-09-17T17:24:27.065074] [WARN ] [MAIN ] ATS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:24:27.065403] [INFO ] [MAIN ] ATS: Wiping existing primary data before full refresh. [2025-09-17T17:24:27.065499] [INFO ] [LOCAL ] ATS: Starting deletion of primary data. [2025-09-17T17:24:27.066305] [DEBUG] [LOCAL ] ATS: Deleted primary data file. [2025-09-17T17:24:27.066389] [INFO ] [MAIN ] ATS: Starting full primary refresh. [2025-09-17T17:24:27.377970] [INFO ] [REMOTE ] ATI: Incremental fetch complete for 2025-09 (2.16 seconds). [2025-09-17T17:24:27.423720] [INFO ] [REMOTE ] ATI: Full fetch complete (73553 records). [2025-09-17T17:24:27.461737] [INFO ] [REMOTE ] ATS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:24:27.458473] [DEBUG] [VALIDATOR ] ATI: Validating primary data. [2025-09-17T17:24:27.618432] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-11. [2025-09-17T17:24:27.854566] [DEBUG] [VALIDATOR ] ATI: All expected trading days are present. [2025-09-17T17:24:27.854711] [DEBUG] [VALIDATOR ] ATI: Primary data validation passed. [2025-09-17T17:24:27.855421] [INFO ] [MAIN ] ATI: Fetched primary data is valid. [2025-09-17T17:24:27.855552] [DEBUG] [LOCAL ] ATI: Saving primary data. [2025-09-17T17:24:27.870367] [INFO ] [REMOTE ] ATMU: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T17:24:27.876157] [DEBUG] [LOCAL ] ATI: Trimmed 73553 records to 51695 (keeping 200 days of data) [2025-09-17T17:24:27.877353] [INFO ] [REMOTE ] ATMU: Full fetch complete (56623 records). [2025-09-17T17:24:27.877436] [DEBUG] [VALIDATOR ] ATMU: Validating primary data. [2025-09-17T17:24:28.356346] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T17:24:28.407667] [DEBUG] [VALIDATOR ] ATMU: All expected trading days are present. [2025-09-17T17:24:28.409340] [DEBUG] [VALIDATOR ] ATMU: Primary data validation passed. [2025-09-17T17:24:28.414869] [INFO ] [MAIN ] ATMU: Fetched primary data is valid. [2025-09-17T17:24:28.414998] [DEBUG] [LOCAL ] ATMU: Saving primary data. [2025-09-17T17:24:28.415868] [INFO ] [REMOTE ] ATR: Fetching primary data for 2024-12. [2025-09-17T17:24:28.507236] [DEBUG] [LOCAL ] ATMU: Trimmed 56623 records to 39701 (keeping 200 days of data) [2025-09-17T17:24:28.706140] [DEBUG] [LOCAL ] ATI: Primary data saved (51695 records). [2025-09-17T17:24:28.707504] [INFO ] [MAIN ] ATI: Full history saved. [2025-09-17T17:24:28.707934] [INFO ] [MAIN ] Update Progress: 172/2371 symbols completed. ATI took 43.3s. Estimated remaining: 5h 12m 33s. Rate: 7.0 symbols/min [2025-09-17T17:24:28.914183] [INFO ] [MAIN ] ATUS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:24:29.019989] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T17:24:29.081316] [DEBUG] [LOCAL ] ATUS: Loaded 49193 existing records from primary storage. [2025-09-17T17:24:29.082223] [INFO ] [MAIN ] ATUS: Loaded 49193 existing records. [2025-09-17T17:24:29.184325] [DEBUG] [LOCAL ] ATMU: Primary data saved (39701 records). [2025-09-17T17:24:29.196015] [INFO ] [MAIN ] ATMU: Full history saved. [2025-09-17T17:24:29.197126] [INFO ] [MAIN ] Update Progress: 173/2371 symbols completed. ATMU took 38.7s. Estimated remaining: 5h 10m 42s. Rate: 7.1 symbols/min [2025-09-17T17:24:29.224402] [INFO ] [REMOTE ] ATS: Fetching primary data for 2024-12. [2025-09-17T17:24:29.351624] [WARN ] [MAIN ] ATUS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:24:29.384976] [INFO ] [MAIN ] ATUS: Wiping existing primary data before full refresh. [2025-09-17T17:24:29.385057] [INFO ] [LOCAL ] ATUS: Starting deletion of primary data. [2025-09-17T17:24:29.392044] [DEBUG] [LOCAL ] ATUS: Deleted primary data file. [2025-09-17T17:24:29.402305] [INFO ] [MAIN ] ATUS: Starting full primary refresh. [2025-09-17T17:24:29.546752] [INFO ] [MAIN ] AU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:24:29.834734] [INFO ] [REMOTE ] ATUS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:24:29.853272] [DEBUG] [LOCAL ] AU: Loaded 52895 existing records from primary storage. [2025-09-17T17:24:29.865864] [INFO ] [MAIN ] AU: Loaded 52895 existing records. [2025-09-17T17:24:29.936453] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T17:24:30.020833] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-01. [2025-09-17T17:24:30.087042] [WARN ] [MAIN ] AU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:24:30.087299] [INFO ] [MAIN ] AU: Wiping existing primary data before full refresh. [2025-09-17T17:24:30.087344] [INFO ] [LOCAL ] AU: Starting deletion of primary data. [2025-09-17T17:24:30.088360] [DEBUG] [LOCAL ] AU: Deleted primary data file. [2025-09-17T17:24:30.088409] [INFO ] [MAIN ] AU: Starting full primary refresh. [2025-09-17T17:24:30.450430] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T17:24:30.453783] [INFO ] [REMOTE ] AU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:24:30.815782] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-01. [2025-09-17T17:24:31.282787] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T17:24:31.615810] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-11. [2025-09-17T17:24:31.879439] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T17:24:32.415749] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-02. [2025-09-17T17:24:33.215809] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-11. [2025-09-17T17:24:33.260977] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T17:24:33.370227] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T17:24:34.015775] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-02. [2025-09-17T17:24:34.815783] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2024-12. [2025-09-17T17:24:35.211788] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T17:24:35.345883] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T17:24:35.615777] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-03. [2025-09-17T17:24:36.416575] [INFO ] [REMOTE ] AU: Fetching primary data for 2024-12. [2025-09-17T17:24:36.416494] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T17:24:36.467595] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T17:24:37.215773] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-04. [2025-09-17T17:24:38.015773] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-03. [2025-09-17T17:24:38.302922] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T17:24:38.361137] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T17:24:38.815776] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-01. [2025-09-17T17:24:39.435412] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T17:24:39.615775] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-04. [2025-09-17T17:24:40.415775] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-05. [2025-09-17T17:24:40.664490] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T17:24:40.935938] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T17:24:41.159499] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T17:24:41.215854] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-01. [2025-09-17T17:24:42.015786] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-02. [2025-09-17T17:24:42.815796] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-05. [2025-09-17T17:24:42.850837] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T17:24:43.488985] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T17:24:43.615768] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-02. [2025-09-17T17:24:43.778850] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T17:24:44.415780] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-03. [2025-09-17T17:24:45.139764] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T17:24:45.215718] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-03. [2025-09-17T17:24:46.015814] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-06. [2025-09-17T17:24:46.549246] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-17T17:24:46.763254] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T17:24:46.809894] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T17:24:46.815664] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-07. [2025-09-17T17:24:47.615798] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-06. [2025-09-17T17:24:47.877941] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T17:24:48.415789] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-04. [2025-09-17T17:24:48.931195] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T17:24:49.215786] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-07. [2025-09-17T17:24:50.015792] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-08. [2025-09-17T17:24:50.520838] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T17:24:50.631454] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T17:24:50.648591] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T17:24:50.815752] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-08. [2025-09-17T17:24:51.615774] [INFO ] [REMOTE ] ATS: Fetching primary data for 2025-09. [2025-09-17T17:24:52.165747] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T17:24:52.373470] [INFO ] [REMOTE ] ATS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T17:24:52.375995] [INFO ] [REMOTE ] ATS: Full fetch complete (25986 records). [2025-09-17T17:24:52.376106] [DEBUG] [VALIDATOR ] ATS: Validating primary data. [2025-09-17T17:24:52.420985] [INFO ] [REMOTE ] ATR: Fetching primary data for 2025-09. [2025-09-17T17:24:52.795664] [DEBUG] [VALIDATOR ] ATS: All expected trading days are present. [2025-09-17T17:24:52.795750] [DEBUG] [VALIDATOR ] ATS: Primary data validation passed. [2025-09-17T17:24:52.796174] [INFO ] [MAIN ] ATS: Fetched primary data is valid. [2025-09-17T17:24:52.796231] [DEBUG] [LOCAL ] ATS: Saving primary data. [2025-09-17T17:24:52.797031] [DEBUG] [LOCAL ] ATS: Trimmed 25986 records to 18287 (keeping 200 days of data) [2025-09-17T17:24:52.909020] [DEBUG] [LOCAL ] ATS: Primary data saved (18287 records). [2025-09-17T17:24:52.909158] [INFO ] [MAIN ] ATS: Full history saved. [2025-09-17T17:24:52.909243] [INFO ] [MAIN ] Update Progress: 174/2371 symbols completed. ATS took 26.2s. Estimated remaining: 5h 13m 46s. Rate: 7.0 symbols/min [2025-09-17T17:24:53.077025] [INFO ] [MAIN ] AUB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:24:53.119284] [DEBUG] [LOCAL ] AUB: Loaded 46562 existing records from primary storage. [2025-09-17T17:24:53.119420] [INFO ] [MAIN ] AUB: Loaded 46562 existing records. [2025-09-17T17:24:53.219689] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-05. [2025-09-17T17:24:53.298474] [WARN ] [MAIN ] AUB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:24:53.298742] [INFO ] [MAIN ] AUB: Wiping existing primary data before full refresh. [2025-09-17T17:24:53.298803] [INFO ] [LOCAL ] AUB: Starting deletion of primary data. [2025-09-17T17:24:53.299774] [DEBUG] [LOCAL ] AUB: Deleted primary data file. [2025-09-17T17:24:53.299835] [INFO ] [MAIN ] AUB: Starting full primary refresh. [2025-09-17T17:24:53.659232] [INFO ] [REMOTE ] AUB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:24:53.791233] [INFO ] [REMOTE ] ATR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T17:24:53.795698] [INFO ] [REMOTE ] ATR: Full fetch complete (43061 records). [2025-09-17T17:24:53.795819] [DEBUG] [VALIDATOR ] ATR: Validating primary data. [2025-09-17T17:24:54.020901] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-04. [2025-09-17T17:24:54.177597] [DEBUG] [VALIDATOR ] ATR: All expected trading days are present. [2025-09-17T17:24:54.177699] [DEBUG] [VALIDATOR ] ATR: Primary data validation passed. [2025-09-17T17:24:54.178175] [INFO ] [MAIN ] ATR: Fetched primary data is valid. [2025-09-17T17:24:54.178233] [DEBUG] [LOCAL ] ATR: Saving primary data. [2025-09-17T17:24:54.179260] [DEBUG] [LOCAL ] ATR: Trimmed 43061 records to 30528 (keeping 200 days of data) [2025-09-17T17:24:54.379357] [DEBUG] [LOCAL ] ATR: Primary data saved (30528 records). [2025-09-17T17:24:54.379499] [INFO ] [MAIN ] ATR: Full history saved. [2025-09-17T17:24:54.379598] [INFO ] [MAIN ] Update Progress: 175/2371 symbols completed. ATR took 29.1s. Estimated remaining: 5h 12m 9s. Rate: 7.0 symbols/min [2025-09-17T17:24:54.547533] [INFO ] [MAIN ] AUNA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:24:54.553553] [DEBUG] [LOCAL ] AUNA: Loaded 4611 existing records from primary storage. [2025-09-17T17:24:54.553668] [INFO ] [MAIN ] AUNA: Loaded 4611 existing records. [2025-09-17T17:24:54.734423] [WARN ] [MAIN ] AUNA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:24:54.734717] [INFO ] [MAIN ] AUNA: Wiping existing primary data before full refresh. [2025-09-17T17:24:54.734778] [INFO ] [LOCAL ] AUNA: Starting deletion of primary data. [2025-09-17T17:24:54.735066] [DEBUG] [LOCAL ] AUNA: Deleted primary data file. [2025-09-17T17:24:54.735126] [INFO ] [MAIN ] AUNA: Starting full primary refresh. [2025-09-17T17:24:54.828518] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-11. [2025-09-17T17:24:55.096783] [INFO ] [REMOTE ] AUNA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:24:55.379781] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T17:24:55.615837] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-11. [2025-09-17T17:24:55.802712] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T17:24:56.233210] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T17:24:56.415750] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-06. [2025-09-17T17:24:56.456091] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T17:24:57.215777] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2024-12. [2025-09-17T17:24:57.797997] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T17:24:58.015735] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-05. [2025-09-17T17:24:58.175143] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T17:24:58.815820] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-07. [2025-09-17T17:24:59.615799] [INFO ] [REMOTE ] AUB: Fetching primary data for 2024-12. [2025-09-17T17:24:59.682464] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T17:25:00.415764] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-01. [2025-09-17T17:25:00.889113] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T17:25:00.924896] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T17:25:01.120258] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T17:25:01.215775] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-01. [2025-09-17T17:25:02.015826] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-06. [2025-09-17T17:25:02.463061] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T17:25:02.815796] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-08. [2025-09-17T17:25:03.363227] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T17:25:03.615783] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-07. [2025-09-17T17:25:04.415816] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-02. [2025-09-17T17:25:04.835419] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T17:25:05.006235] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T17:25:05.215899] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-02. [2025-09-17T17:25:05.822576] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T17:25:05.849911] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T17:25:06.015775] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-03. [2025-09-17T17:25:06.500752] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T17:25:06.815777] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-04. [2025-09-17T17:25:07.356470] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-17T17:25:07.615805] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-08. [2025-09-17T17:25:08.415783] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-05. [2025-09-17T17:25:08.890586] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T17:25:09.215787] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-06. [2025-09-17T17:25:09.467442] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T17:25:09.895227] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T17:25:10.015807] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-07. [2025-09-17T17:25:10.667447] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T17:25:10.815792] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-03. [2025-09-17T17:25:11.615803] [INFO ] [REMOTE ] AU: Fetching primary data for 2025-09. [2025-09-17T17:25:12.415817] [INFO ] [REMOTE ] ATUS: Fetching primary data for 2025-09. [2025-09-17T17:25:12.636999] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T17:25:13.215829] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-04. [2025-09-17T17:25:13.490361] [INFO ] [REMOTE ] AU: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T17:25:13.497559] [INFO ] [REMOTE ] AU: Full fetch complete (76090 records). [2025-09-17T17:25:13.497807] [DEBUG] [VALIDATOR ] AU: Validating primary data. [2025-09-17T17:25:13.894917] [DEBUG] [VALIDATOR ] AU: All expected trading days are present. [2025-09-17T17:25:13.895033] [DEBUG] [VALIDATOR ] AU: Primary data validation passed. [2025-09-17T17:25:13.895797] [INFO ] [MAIN ] AU: Fetched primary data is valid. [2025-09-17T17:25:13.895845] [DEBUG] [LOCAL ] AU: Saving primary data. [2025-09-17T17:25:13.897365] [DEBUG] [LOCAL ] AU: Trimmed 76090 records to 52903 (keeping 200 days of data) [2025-09-17T17:25:14.016986] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-08. [2025-09-17T17:25:14.239310] [INFO ] [REMOTE ] ATUS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T17:25:14.247837] [INFO ] [REMOTE ] ATUS: Full fetch complete (70683 records). [2025-09-17T17:25:14.248661] [DEBUG] [VALIDATOR ] ATUS: Validating primary data. [2025-09-17T17:25:14.591881] [DEBUG] [LOCAL ] AU: Primary data saved (52903 records). [2025-09-17T17:25:14.612081] [INFO ] [MAIN ] AU: Full history saved. [2025-09-17T17:25:14.621786] [INFO ] [MAIN ] Update Progress: 176/2371 symbols completed. AU took 45.4s. Estimated remaining: 5h 14m 26s. Rate: 7.0 symbols/min [2025-09-17T17:25:14.597825] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T17:25:14.675262] [DEBUG] [VALIDATOR ] ATUS: All expected trading days are present. [2025-09-17T17:25:14.675381] [DEBUG] [VALIDATOR ] ATUS: Primary data validation passed. [2025-09-17T17:25:14.682267] [INFO ] [MAIN ] ATUS: Fetched primary data is valid. [2025-09-17T17:25:14.682387] [DEBUG] [LOCAL ] ATUS: Saving primary data. [2025-09-17T17:25:14.761903] [DEBUG] [LOCAL ] ATUS: Trimmed 70683 records to 49186 (keeping 200 days of data) [2025-09-17T17:25:14.840470] [INFO ] [REMOTE ] AUNA: Fetching primary data for 2025-09. [2025-09-17T17:25:14.948808] [INFO ] [MAIN ] AVA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:25:14.994139] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T17:25:15.039495] [DEBUG] [LOCAL ] AVA: Loaded 39688 existing records from primary storage. [2025-09-17T17:25:15.040418] [INFO ] [MAIN ] AVA: Loaded 39688 existing records. [2025-09-17T17:25:15.316540] [WARN ] [MAIN ] AVA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:25:15.318213] [INFO ] [MAIN ] AVA: Wiping existing primary data before full refresh. [2025-09-17T17:25:15.318848] [INFO ] [LOCAL ] AVA: Starting deletion of primary data. [2025-09-17T17:25:15.320672] [DEBUG] [LOCAL ] AVA: Deleted primary data file. [2025-09-17T17:25:15.321534] [INFO ] [MAIN ] AVA: Starting full primary refresh. [2025-09-17T17:25:15.624086] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-05. [2025-09-17T17:25:15.714574] [INFO ] [REMOTE ] AVA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:25:15.786737] [DEBUG] [LOCAL ] ATUS: Primary data saved (49186 records). [2025-09-17T17:25:15.786980] [INFO ] [MAIN ] ATUS: Full history saved. [2025-09-17T17:25:15.787138] [INFO ] [MAIN ] Update Progress: 177/2371 symbols completed. ATUS took 47.1s. Estimated remaining: 5h 12m 45s. Rate: 7.0 symbols/min [2025-09-17T17:25:15.910035] [INFO ] [REMOTE ] AUNA: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T17:25:15.911599] [INFO ] [REMOTE ] AUNA: Full fetch complete (7369 records). [2025-09-17T17:25:15.912160] [DEBUG] [VALIDATOR ] AUNA: Validating primary data. [2025-09-17T17:25:16.121243] [INFO ] [MAIN ] AVAL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:25:16.313067] [DEBUG] [LOCAL ] AVAL: Loaded 9704 existing records from primary storage. [2025-09-17T17:25:16.326345] [INFO ] [MAIN ] AVAL: Loaded 9704 existing records. [2025-09-17T17:25:16.416606] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-11. [2025-09-17T17:25:16.569224] [DEBUG] [VALIDATOR ] AUNA: All expected trading days are present. [2025-09-17T17:25:16.580655] [DEBUG] [VALIDATOR ] AUNA: Primary data validation passed. [2025-09-17T17:25:16.590412] [INFO ] [MAIN ] AUNA: Fetched primary data is valid. [2025-09-17T17:25:16.590498] [DEBUG] [LOCAL ] AUNA: Saving primary data. [2025-09-17T17:25:16.613111] [DEBUG] [LOCAL ] AUNA: Trimmed 7369 records to 4613 (keeping 200 days of data) [2025-09-17T17:25:16.619919] [WARN ] [MAIN ] AVAL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:25:16.621064] [INFO ] [MAIN ] AVAL: Wiping existing primary data before full refresh. [2025-09-17T17:25:16.630962] [INFO ] [LOCAL ] AVAL: Starting deletion of primary data. [2025-09-17T17:25:16.641825] [DEBUG] [LOCAL ] AVAL: Deleted primary data file. [2025-09-17T17:25:16.648243] [INFO ] [MAIN ] AVAL: Starting full primary refresh. [2025-09-17T17:25:16.648131] [DEBUG] [LOCAL ] AUNA: Primary data saved (4613 records). [2025-09-17T17:25:16.653575] [INFO ] [MAIN ] AUNA: Full history saved. [2025-09-17T17:25:16.697246] [INFO ] [MAIN ] Update Progress: 178/2371 symbols completed. AUNA took 22.3s. Estimated remaining: 5h 11m 3s. Rate: 7.1 symbols/min [2025-09-17T17:25:17.078559] [INFO ] [MAIN ] AVB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:25:17.219217] [INFO ] [REMOTE ] AVAL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:25:17.219670] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-11. [2025-09-17T17:25:17.259563] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T17:25:17.285652] [DEBUG] [LOCAL ] AVB: Loaded 41477 existing records from primary storage. [2025-09-17T17:25:17.285820] [INFO ] [MAIN ] AVB: Loaded 41477 existing records. [2025-09-17T17:25:17.471042] [WARN ] [MAIN ] AVB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:25:17.471303] [INFO ] [MAIN ] AVB: Wiping existing primary data before full refresh. [2025-09-17T17:25:17.471351] [INFO ] [LOCAL ] AVB: Starting deletion of primary data. [2025-09-17T17:25:17.472836] [DEBUG] [LOCAL ] AVB: Deleted primary data file. [2025-09-17T17:25:17.472889] [INFO ] [MAIN ] AVB: Starting full primary refresh. [2025-09-17T17:25:17.799451] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T17:25:17.876476] [INFO ] [REMOTE ] AVB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:25:17.902453] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T17:25:18.015820] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2024-12. [2025-09-17T17:25:18.625433] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T17:25:18.815772] [INFO ] [REMOTE ] AVA: Fetching primary data for 2024-12. [2025-09-17T17:25:19.615779] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-01. [2025-09-17T17:25:20.222073] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T17:25:20.415748] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-11. [2025-09-17T17:25:20.494443] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T17:25:21.215798] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-02. [2025-09-17T17:25:22.003897] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T17:25:22.015740] [INFO ] [REMOTE ] AVB: Fetching primary data for 2024-12. [2025-09-17T17:25:22.138124] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T17:25:22.815811] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-06. [2025-09-17T17:25:23.334454] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T17:25:23.615795] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-03. [2025-09-17T17:25:24.415748] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-01. [2025-09-17T17:25:24.505045] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T17:25:24.557106] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T17:25:25.215784] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-01. [2025-09-17T17:25:25.636802] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T17:25:26.015775] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-04. [2025-09-17T17:25:26.568149] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T17:25:26.585022] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T17:25:26.815800] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-02. [2025-09-17T17:25:27.615805] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-07. [2025-09-17T17:25:28.291116] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T17:25:28.415805] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-02. [2025-09-17T17:25:29.215787] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-05. [2025-09-17T17:25:29.351595] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T17:25:29.924866] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T17:25:30.015737] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-03. [2025-09-17T17:25:30.101169] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T17:25:30.815777] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-08. [2025-09-17T17:25:31.527194] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T17:25:31.615772] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-04. [2025-09-17T17:25:32.341003] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T17:25:32.415750] [INFO ] [REMOTE ] AUB: Fetching primary data for 2025-09. [2025-09-17T17:25:33.186558] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T17:25:33.215729] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-05. [2025-09-17T17:25:33.873390] [INFO ] [REMOTE ] AUB: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T17:25:33.882167] [INFO ] [REMOTE ] AUB: Full fetch complete (65165 records). [2025-09-17T17:25:33.882399] [DEBUG] [VALIDATOR ] AUB: Validating primary data. [2025-09-17T17:25:34.021062] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-03. [2025-09-17T17:25:34.510706] [DEBUG] [VALIDATOR ] AUB: All expected trading days are present. [2025-09-17T17:25:34.511073] [DEBUG] [VALIDATOR ] AUB: Primary data validation passed. [2025-09-17T17:25:34.512089] [INFO ] [MAIN ] AUB: Fetched primary data is valid. [2025-09-17T17:25:34.512185] [DEBUG] [LOCAL ] AUB: Saving primary data. [2025-09-17T17:25:34.513930] [DEBUG] [LOCAL ] AUB: Trimmed 65165 records to 46522 (keeping 200 days of data) [2025-09-17T17:25:34.811774] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T17:25:34.849504] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-06. [2025-09-17T17:25:34.943252] [DEBUG] [LOCAL ] AUB: Primary data saved (46522 records). [2025-09-17T17:25:34.943419] [INFO ] [MAIN ] AUB: Full history saved. [2025-09-17T17:25:34.944283] [INFO ] [MAIN ] Update Progress: 179/2371 symbols completed. AUB took 42.0s. Estimated remaining: 5h 12m 53s. Rate: 7.0 symbols/min [2025-09-17T17:25:35.121952] [INFO ] [MAIN ] AVBC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:25:35.122124] [DEBUG] [LOCAL ] AVBC: No existing data file found in primary storage. [2025-09-17T17:25:35.122161] [WARN ] [MAIN ] AVBC: No existing data found, performing full refresh instead. [2025-09-17T17:25:35.122279] [INFO ] [MAIN ] AVBC: Wiping existing primary data before full refresh. [2025-09-17T17:25:35.122316] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-17T17:25:35.122355] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-17T17:25:35.122387] [INFO ] [MAIN ] AVBC: Starting full primary refresh. [2025-09-17T17:25:35.480285] [INFO ] [REMOTE ] AVBC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:25:35.592758] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T17:25:35.615783] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-07. [2025-09-17T17:25:35.724868] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T17:25:36.079156] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T17:25:36.415780] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-11. [2025-09-17T17:25:36.604960] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:25:36.605301] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-11 [2025-09-17T17:25:37.215790] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-06. [2025-09-17T17:25:38.015788] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-08. [2025-09-17T17:25:38.668221] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T17:25:38.742585] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T17:25:38.815826] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-07. [2025-09-17T17:25:39.615807] [INFO ] [REMOTE ] AVAL: Fetching primary data for 2025-09. [2025-09-17T17:25:40.394420] [INFO ] [REMOTE ] AVAL: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T17:25:40.395884] [INFO ] [REMOTE ] AVAL: Full fetch complete (14643 records). [2025-09-17T17:25:40.395956] [DEBUG] [VALIDATOR ] AVAL: Validating primary data. [2025-09-17T17:25:40.425969] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-04. [2025-09-17T17:25:40.687039] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T17:25:40.807065] [DEBUG] [VALIDATOR ] AVAL: All expected trading days are present. [2025-09-17T17:25:40.807151] [DEBUG] [VALIDATOR ] AVAL: Primary data validation passed. [2025-09-17T17:25:40.807434] [INFO ] [MAIN ] AVAL: Fetched primary data is valid. [2025-09-17T17:25:40.807474] [DEBUG] [LOCAL ] AVAL: Saving primary data. [2025-09-17T17:25:40.808079] [DEBUG] [LOCAL ] AVAL: Trimmed 14643 records to 9561 (keeping 200 days of data) [2025-09-17T17:25:40.864928] [DEBUG] [LOCAL ] AVAL: Primary data saved (9561 records). [2025-09-17T17:25:40.865073] [INFO ] [MAIN ] AVAL: Full history saved. [2025-09-17T17:25:40.865162] [INFO ] [MAIN ] Update Progress: 180/2371 symbols completed. AVAL took 25.1s. Estimated remaining: 5h 12m 13s. Rate: 7.0 symbols/min [2025-09-17T17:25:41.048486] [INFO ] [MAIN ] AVD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:25:41.072522] [DEBUG] [LOCAL ] AVD: Loaded 23298 existing records from primary storage. [2025-09-17T17:25:41.072759] [INFO ] [MAIN ] AVD: Loaded 23298 existing records. [2025-09-17T17:25:41.215858] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-08. [2025-09-17T17:25:41.252790] [WARN ] [MAIN ] AVD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:25:41.253027] [INFO ] [MAIN ] AVD: Wiping existing primary data before full refresh. [2025-09-17T17:25:41.253082] [INFO ] [LOCAL ] AVD: Starting deletion of primary data. [2025-09-17T17:25:41.254243] [DEBUG] [LOCAL ] AVD: Deleted primary data file. [2025-09-17T17:25:41.254294] [INFO ] [MAIN ] AVD: Starting full primary refresh. [2025-09-17T17:25:41.612848] [INFO ] [REMOTE ] AVD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:25:42.015793] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2024-12. [2025-09-17T17:25:42.204942] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:25:42.205258] [WARN ] [REMOTE ] AVBC: No data returned for month 2024-12 [2025-09-17T17:25:42.253352] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T17:25:42.342833] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T17:25:42.815773] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-01. [2025-09-17T17:25:43.044625] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:25:43.045025] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-01 [2025-09-17T17:25:43.615786] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-05. [2025-09-17T17:25:44.415798] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-02. [2025-09-17T17:25:44.607983] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:25:44.608314] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-02 [2025-09-17T17:25:44.793839] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T17:25:45.215780] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-06. [2025-09-17T17:25:46.015842] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-11. [2025-09-17T17:25:46.765998] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T17:25:46.815725] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-07. [2025-09-17T17:25:47.387020] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T17:25:47.615785] [INFO ] [REMOTE ] AVA: Fetching primary data for 2025-09. [2025-09-17T17:25:48.402205] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T17:25:48.415729] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-08. [2025-09-17T17:25:48.988201] [INFO ] [REMOTE ] AVA: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T17:25:48.995266] [INFO ] [REMOTE ] AVA: Full fetch complete (55293 records). [2025-09-17T17:25:48.995423] [DEBUG] [VALIDATOR ] AVA: Validating primary data. [2025-09-17T17:25:49.220959] [INFO ] [REMOTE ] AVD: Fetching primary data for 2024-12. [2025-09-17T17:25:49.380806] [DEBUG] [VALIDATOR ] AVA: All expected trading days are present. [2025-09-17T17:25:49.380897] [DEBUG] [VALIDATOR ] AVA: Primary data validation passed. [2025-09-17T17:25:49.381509] [INFO ] [MAIN ] AVA: Fetched primary data is valid. [2025-09-17T17:25:49.381555] [DEBUG] [LOCAL ] AVA: Saving primary data. [2025-09-17T17:25:49.383179] [DEBUG] [LOCAL ] AVA: Trimmed 55293 records to 39697 (keeping 200 days of data) [2025-09-17T17:25:49.625567] [DEBUG] [LOCAL ] AVA: Primary data saved (39697 records). [2025-09-17T17:25:49.625717] [INFO ] [MAIN ] AVA: Full history saved. [2025-09-17T17:25:49.626274] [INFO ] [MAIN ] Update Progress: 181/2371 symbols completed. AVA took 35.0s. Estimated remaining: 5h 12m 7s. Rate: 7.0 symbols/min [2025-09-17T17:25:49.795234] [INFO ] [MAIN ] AVK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:25:49.814842] [DEBUG] [LOCAL ] AVK: Loaded 18256 existing records from primary storage. [2025-09-17T17:25:49.814989] [INFO ] [MAIN ] AVK: Loaded 18256 existing records. [2025-09-17T17:25:49.992660] [WARN ] [MAIN ] AVK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:25:49.993009] [INFO ] [MAIN ] AVK: Wiping existing primary data before full refresh. [2025-09-17T17:25:49.993113] [INFO ] [LOCAL ] AVK: Starting deletion of primary data. [2025-09-17T17:25:49.994043] [DEBUG] [LOCAL ] AVK: Deleted primary data file. [2025-09-17T17:25:49.994095] [INFO ] [MAIN ] AVK: Starting full primary refresh. [2025-09-17T17:25:50.025253] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-03. [2025-09-17T17:25:50.385205] [INFO ] [REMOTE ] AVK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:25:50.387123] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T17:25:50.442533] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T17:25:50.453905] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:25:50.454172] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-03 [2025-09-17T17:25:50.815783] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-01. [2025-09-17T17:25:51.615758] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-04. [2025-09-17T17:25:51.868856] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:25:51.869181] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-04 [2025-09-17T17:25:52.026630] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T17:25:52.415784] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-05. [2025-09-17T17:25:52.615444] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:25:52.615793] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-05 [2025-09-17T17:25:53.215774] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-06. [2025-09-17T17:25:53.408891] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:25:53.409135] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-06 [2025-09-17T17:25:54.015834] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-07. [2025-09-17T17:25:54.208152] [DEBUG] [REMOTE ] AVBC: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:25:54.208465] [WARN ] [REMOTE ] AVBC: No data returned for month 2025-07 [2025-09-17T17:25:54.815777] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-11. [2025-09-17T17:25:55.615785] [INFO ] [REMOTE ] AVB: Fetching primary data for 2025-09. [2025-09-17T17:25:56.021981] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T17:25:56.415777] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-08. [2025-09-17T17:25:57.215783] [INFO ] [REMOTE ] AVK: Fetching primary data for 2024-12. [2025-09-17T17:25:57.308828] [INFO ] [REMOTE ] AVB: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T17:25:57.314542] [INFO ] [REMOTE ] AVB: Full fetch complete (57789 records). [2025-09-17T17:25:57.314692] [DEBUG] [VALIDATOR ] AVB: Validating primary data. [2025-09-17T17:25:57.664278] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T17:25:57.735341] [DEBUG] [VALIDATOR ] AVB: All expected trading days are present. [2025-09-17T17:25:57.735423] [DEBUG] [VALIDATOR ] AVB: Primary data validation passed. [2025-09-17T17:25:57.736090] [INFO ] [MAIN ] AVB: Fetched primary data is valid. [2025-09-17T17:25:57.736137] [DEBUG] [LOCAL ] AVB: Saving primary data. [2025-09-17T17:25:57.737399] [DEBUG] [LOCAL ] AVB: Trimmed 57789 records to 41534 (keeping 200 days of data) [2025-09-17T17:25:58.005439] [DEBUG] [LOCAL ] AVB: Primary data saved (41534 records). [2025-09-17T17:25:58.005571] [INFO ] [MAIN ] AVB: Full history saved. [2025-09-17T17:25:58.006259] [INFO ] [MAIN ] Update Progress: 182/2371 symbols completed. AVB took 41.3s. Estimated remaining: 5h 11m 56s. Rate: 7.0 symbols/min [2025-09-17T17:25:58.020838] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-02. [2025-09-17T17:25:58.213482] [INFO ] [MAIN ] AVNS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:25:58.226367] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T17:25:58.260981] [DEBUG] [LOCAL ] AVNS: Loaded 33740 existing records from primary storage. [2025-09-17T17:25:58.261140] [INFO ] [MAIN ] AVNS: Loaded 33740 existing records. [2025-09-17T17:25:58.437746] [WARN ] [MAIN ] AVNS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:25:58.437989] [INFO ] [MAIN ] AVNS: Wiping existing primary data before full refresh. [2025-09-17T17:25:58.438034] [INFO ] [LOCAL ] AVNS: Starting deletion of primary data. [2025-09-17T17:25:58.439176] [DEBUG] [LOCAL ] AVNS: Deleted primary data file. [2025-09-17T17:25:58.439227] [INFO ] [MAIN ] AVNS: Starting full primary refresh. [2025-09-17T17:25:58.803391] [INFO ] [REMOTE ] AVNS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:25:58.815730] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-11. [2025-09-17T17:25:59.179339] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T17:25:59.615817] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-03. [2025-09-17T17:25:59.768546] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T17:26:00.415840] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-01. [2025-09-17T17:26:00.851972] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T17:26:01.215820] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-04. [2025-09-17T17:26:01.647297] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T17:26:02.015685] [INFO ] [REMOTE ] AVBC: Fetching primary data for 2025-09. [2025-09-17T17:26:02.238555] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T17:26:02.815758] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-05. [2025-09-17T17:26:03.615805] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2024-12. [2025-09-17T17:26:03.814850] [INFO ] [REMOTE ] AVBC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T17:26:03.816952] [INFO ] [REMOTE ] AVBC: Full fetch complete (4116 records). [2025-09-17T17:26:03.817104] [DEBUG] [VALIDATOR ] AVBC: Validating primary data. [2025-09-17T17:26:04.009734] [WARN ] [VALIDATOR ] AVBC: Validation failed - insufficient historical data. Have 33 unique days, need 200 days [2025-09-17T17:26:04.010113] [FATAL] [MAIN ] AVBC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:26:04.020925] [WARN ] [MAIN ] AVBC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:26:04.021782] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T17:26:04.021407] [INFO ] [LOCAL ] AVBC: Starting deletion of primary data. [2025-09-17T17:26:04.025886] [DEBUG] [LOCAL ] AVBC: No primary data file found to delete. [2025-09-17T17:26:04.026232] [INFO ] [LOCAL ] AVBC: Starting deletion of derivative data. [2025-09-17T17:26:04.026564] [DEBUG] [LOCAL ] AVBC: No derivative data file found to delete. [2025-09-17T17:26:04.026662] [INFO ] [MAIN ] Update Progress: 183/2371 symbols completed. AVBC took 29.1s. Estimated remaining: 5h 11m 17s. Rate: 7.0 symbols/min [2025-09-17T17:26:04.194974] [INFO ] [MAIN ] AVNT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:26:04.241328] [DEBUG] [LOCAL ] AVNT: Loaded 39625 existing records from primary storage. [2025-09-17T17:26:04.241537] [INFO ] [MAIN ] AVNT: Loaded 39625 existing records. [2025-09-17T17:26:04.420975] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-02. [2025-09-17T17:26:04.453239] [WARN ] [MAIN ] AVNT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:26:04.453634] [INFO ] [MAIN ] AVNT: Wiping existing primary data before full refresh. [2025-09-17T17:26:04.453829] [INFO ] [LOCAL ] AVNT: Starting deletion of primary data. [2025-09-17T17:26:04.455774] [DEBUG] [LOCAL ] AVNT: Deleted primary data file. [2025-09-17T17:26:04.455840] [INFO ] [MAIN ] AVNT: Starting full primary refresh. [2025-09-17T17:26:04.592951] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T17:26:04.861941] [INFO ] [REMOTE ] AVNT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:26:05.215775] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-06. [2025-09-17T17:26:05.416946] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T17:26:06.015784] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-03. [2025-09-17T17:26:06.354877] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T17:26:06.815762] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-07. [2025-09-17T17:26:07.615822] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-11. [2025-09-17T17:26:07.954330] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T17:26:08.321826] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-17T17:26:08.415740] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-04. [2025-09-17T17:26:08.872905] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T17:26:09.076558] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T17:26:09.215829] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-01. [2025-09-17T17:26:10.015787] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2024-12. [2025-09-17T17:26:10.648178] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T17:26:10.815778] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-05. [2025-09-17T17:26:11.097298] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T17:26:11.615761] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-02. [2025-09-17T17:26:11.879947] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T17:26:12.415803] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-01. [2025-09-17T17:26:13.215785] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-06. [2025-09-17T17:26:13.860790] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T17:26:14.015774] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-02. [2025-09-17T17:26:14.160021] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T17:26:14.187838] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-17T17:26:14.815791] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-08. [2025-09-17T17:26:15.359159] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T17:26:15.615778] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-03. [2025-09-17T17:26:16.086616] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T17:26:16.415823] [INFO ] [REMOTE ] AVD: Fetching primary data for 2025-09. [2025-09-17T17:26:17.085072] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T17:26:17.215857] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-04. [2025-09-17T17:26:17.496942] [INFO ] [REMOTE ] AVD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T17:26:17.500273] [INFO ] [REMOTE ] AVD: Full fetch complete (33917 records). [2025-09-17T17:26:17.500410] [DEBUG] [VALIDATOR ] AVD: Validating primary data. [2025-09-17T17:26:17.906461] [DEBUG] [VALIDATOR ] AVD: All expected trading days are present. [2025-09-17T17:26:17.906608] [DEBUG] [VALIDATOR ] AVD: Primary data validation passed. [2025-09-17T17:26:17.907319] [INFO ] [MAIN ] AVD: Fetched primary data is valid. [2025-09-17T17:26:17.907390] [DEBUG] [LOCAL ] AVD: Saving primary data. [2025-09-17T17:26:17.909081] [DEBUG] [LOCAL ] AVD: Trimmed 33917 records to 23294 (keeping 200 days of data) [2025-09-17T17:26:18.018353] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-03. [2025-09-17T17:26:18.048477] [DEBUG] [LOCAL ] AVD: Primary data saved (23294 records). [2025-09-17T17:26:18.048668] [INFO ] [MAIN ] AVD: Full history saved. [2025-09-17T17:26:18.048775] [INFO ] [MAIN ] Update Progress: 184/2371 symbols completed. AVD took 37.2s. Estimated remaining: 5h 12m 14s. Rate: 7.0 symbols/min [2025-09-17T17:26:18.219564] [INFO ] [MAIN ] AVTR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:26:18.278801] [DEBUG] [LOCAL ] AVTR: Loaded 53571 existing records from primary storage. [2025-09-17T17:26:18.278956] [INFO ] [MAIN ] AVTR: Loaded 53571 existing records. [2025-09-17T17:26:18.456184] [WARN ] [MAIN ] AVTR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:26:18.456443] [INFO ] [MAIN ] AVTR: Wiping existing primary data before full refresh. [2025-09-17T17:26:18.456488] [INFO ] [LOCAL ] AVTR: Starting deletion of primary data. [2025-09-17T17:26:18.458445] [DEBUG] [LOCAL ] AVTR: Deleted primary data file. [2025-09-17T17:26:18.458499] [INFO ] [MAIN ] AVTR: Starting full primary refresh. [2025-09-17T17:26:18.815326] [INFO ] [REMOTE ] AVTR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:26:18.815704] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-11. [2025-09-17T17:26:18.845173] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T17:26:19.615786] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-05. [2025-09-17T17:26:20.415830] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-07. [2025-09-17T17:26:20.485214] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-17T17:26:21.101986] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T17:26:21.215739] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-04. [2025-09-17T17:26:21.582678] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T17:26:22.015792] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-08. [2025-09-17T17:26:22.106629] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-11 (3.29 seconds). [2025-09-17T17:26:22.227977] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T17:26:22.815800] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2024-12. [2025-09-17T17:26:23.001348] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T17:26:23.615782] [INFO ] [REMOTE ] AVK: Fetching primary data for 2025-09. [2025-09-17T17:26:24.415768] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-05. [2025-09-17T17:26:24.643377] [INFO ] [REMOTE ] AVK: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T17:26:24.646519] [INFO ] [REMOTE ] AVK: Full fetch complete (26696 records). [2025-09-17T17:26:24.646609] [DEBUG] [VALIDATOR ] AVK: Validating primary data. [2025-09-17T17:26:24.976889] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-17T17:26:25.070040] [DEBUG] [VALIDATOR ] AVK: All expected trading days are present. [2025-09-17T17:26:25.070117] [DEBUG] [VALIDATOR ] AVK: Primary data validation passed. [2025-09-17T17:26:25.070457] [INFO ] [MAIN ] AVK: Fetched primary data is valid. [2025-09-17T17:26:25.070496] [DEBUG] [LOCAL ] AVK: Saving primary data. [2025-09-17T17:26:25.071212] [DEBUG] [LOCAL ] AVK: Trimmed 26696 records to 18237 (keeping 200 days of data) [2025-09-17T17:26:25.187665] [DEBUG] [LOCAL ] AVK: Primary data saved (18237 records). [2025-09-17T17:26:25.187817] [INFO ] [MAIN ] AVK: Full history saved. [2025-09-17T17:26:25.187901] [INFO ] [MAIN ] Update Progress: 185/2371 symbols completed. AVK took 35.6s. Estimated remaining: 5h 11m 49s. Rate: 7.0 symbols/min [2025-09-17T17:26:25.220852] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-06. [2025-09-17T17:26:25.361446] [INFO ] [MAIN ] AVY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:26:25.400693] [DEBUG] [LOCAL ] AVY: Loaded 37751 existing records from primary storage. [2025-09-17T17:26:25.400866] [INFO ] [MAIN ] AVY: Loaded 37751 existing records. [2025-09-17T17:26:25.583219] [WARN ] [MAIN ] AVY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:26:25.583585] [INFO ] [MAIN ] AVY: Wiping existing primary data before full refresh. [2025-09-17T17:26:25.583637] [INFO ] [LOCAL ] AVY: Starting deletion of primary data. [2025-09-17T17:26:25.585235] [DEBUG] [LOCAL ] AVY: Deleted primary data file. [2025-09-17T17:26:25.585289] [INFO ] [MAIN ] AVY: Starting full primary refresh. [2025-09-17T17:26:25.957786] [INFO ] [REMOTE ] AVY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:26:25.992372] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T17:26:26.015793] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-06. [2025-09-17T17:26:26.641475] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T17:26:26.815838] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-01. [2025-09-17T17:26:27.196887] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T17:26:27.615778] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-07. [2025-09-17T17:26:28.159772] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T17:26:28.415839] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-02. [2025-09-17T17:26:28.605152] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T17:26:29.215781] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-11. [2025-09-17T17:26:29.762232] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T17:26:30.015784] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-08. [2025-09-17T17:26:30.269347] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T17:26:30.815764] [INFO ] [REMOTE ] AVY: Fetching primary data for 2024-12. [2025-09-17T17:26:31.335600] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T17:26:31.615827] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-03. [2025-09-17T17:26:32.314489] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T17:26:32.415822] [INFO ] [REMOTE ] AVNS: Fetching primary data for 2025-09. [2025-09-17T17:26:33.173168] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T17:26:33.215740] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-04. [2025-09-17T17:26:33.970754] [INFO ] [REMOTE ] AVNS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T17:26:33.975733] [INFO ] [REMOTE ] AVNS: Full fetch complete (47517 records). [2025-09-17T17:26:33.975923] [DEBUG] [VALIDATOR ] AVNS: Validating primary data. [2025-09-17T17:26:34.023227] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-01. [2025-09-17T17:26:34.378545] [DEBUG] [VALIDATOR ] AVNS: All expected trading days are present. [2025-09-17T17:26:34.378669] [DEBUG] [VALIDATOR ] AVNS: Primary data validation passed. [2025-09-17T17:26:34.379359] [INFO ] [MAIN ] AVNS: Fetched primary data is valid. [2025-09-17T17:26:34.379416] [DEBUG] [LOCAL ] AVNS: Saving primary data. [2025-09-17T17:26:34.381004] [DEBUG] [LOCAL ] AVNS: Trimmed 47517 records to 33712 (keeping 200 days of data) [2025-09-17T17:26:34.609894] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T17:26:34.634746] [DEBUG] [LOCAL ] AVNS: Primary data saved (33712 records). [2025-09-17T17:26:34.634925] [INFO ] [MAIN ] AVNS: Full history saved. [2025-09-17T17:26:34.635064] [INFO ] [MAIN ] Update Progress: 186/2371 symbols completed. AVNS took 36.6s. Estimated remaining: 5h 11m 50s. Rate: 7.0 symbols/min [2025-09-17T17:26:34.814147] [INFO ] [MAIN ] AWF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:26:34.815826] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-05. [2025-09-17T17:26:34.839724] [DEBUG] [LOCAL ] AWF: Loaded 24095 existing records from primary storage. [2025-09-17T17:26:34.839856] [INFO ] [MAIN ] AWF: Loaded 24095 existing records. [2025-09-17T17:26:35.021072] [WARN ] [MAIN ] AWF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:26:35.021359] [INFO ] [MAIN ] AWF: Wiping existing primary data before full refresh. [2025-09-17T17:26:35.021968] [INFO ] [LOCAL ] AWF: Starting deletion of primary data. [2025-09-17T17:26:35.023103] [DEBUG] [LOCAL ] AWF: Deleted primary data file. [2025-09-17T17:26:35.023163] [INFO ] [MAIN ] AWF: Starting full primary refresh. [2025-09-17T17:26:35.389338] [INFO ] [REMOTE ] AWF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:26:35.609853] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T17:26:35.618538] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-11. [2025-09-17T17:26:36.048539] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T17:26:36.415779] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-06. [2025-09-17T17:26:36.732383] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T17:26:37.215851] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-07. [2025-09-17T17:26:37.698405] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T17:26:38.015802] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-02. [2025-09-17T17:26:38.815789] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-07. [2025-09-17T17:26:38.848155] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T17:26:39.263046] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T17:26:39.615786] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-03. [2025-09-17T17:26:40.415841] [INFO ] [REMOTE ] AWF: Fetching primary data for 2024-12. [2025-09-17T17:26:40.618267] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T17:26:41.215693] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-08. [2025-09-17T17:26:41.318391] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T17:26:41.355364] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T17:26:42.015778] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-01. [2025-09-17T17:26:42.815759] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-04. [2025-09-17T17:26:43.017657] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T17:26:43.279249] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T17:26:43.615770] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-08. [2025-09-17T17:26:44.271090] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T17:26:44.415768] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-05. [2025-09-17T17:26:45.040257] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T17:26:45.215779] [INFO ] [REMOTE ] AVTR: Fetching primary data for 2025-09. [2025-09-17T17:26:46.015803] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-02. [2025-09-17T17:26:46.134353] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T17:26:46.815802] [INFO ] [REMOTE ] AVNT: Fetching primary data for 2025-09. [2025-09-17T17:26:47.205083] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T17:26:47.418883] [INFO ] [REMOTE ] AVTR: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-17T17:26:47.425806] [INFO ] [REMOTE ] AVTR: Full fetch complete (77265 records). [2025-09-17T17:26:47.425995] [DEBUG] [VALIDATOR ] AVTR: Validating primary data. [2025-09-17T17:26:47.626557] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-03. [2025-09-17T17:26:47.827917] [DEBUG] [VALIDATOR ] AVTR: All expected trading days are present. [2025-09-17T17:26:47.828001] [DEBUG] [VALIDATOR ] AVTR: Primary data validation passed. [2025-09-17T17:26:47.828762] [INFO ] [MAIN ] AVTR: Fetched primary data is valid. [2025-09-17T17:26:47.828824] [DEBUG] [LOCAL ] AVTR: Saving primary data. [2025-09-17T17:26:47.830327] [DEBUG] [LOCAL ] AVTR: Trimmed 77265 records to 53571 (keeping 200 days of data) [2025-09-17T17:26:48.026636] [INFO ] [REMOTE ] AVNT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T17:26:48.056784] [INFO ] [REMOTE ] AVNT: Full fetch complete (55779 records). [2025-09-17T17:26:48.057401] [DEBUG] [VALIDATOR ] AVNT: Validating primary data. [2025-09-17T17:26:48.417413] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-06. [2025-09-17T17:26:48.464436] [DEBUG] [VALIDATOR ] AVNT: All expected trading days are present. [2025-09-17T17:26:48.464764] [DEBUG] [VALIDATOR ] AVNT: Primary data validation passed. [2025-09-17T17:26:48.465885] [INFO ] [MAIN ] AVNT: Fetched primary data is valid. [2025-09-17T17:26:48.466719] [DEBUG] [LOCAL ] AVNT: Saving primary data. [2025-09-17T17:26:48.471845] [DEBUG] [LOCAL ] AVNT: Trimmed 55779 records to 39593 (keeping 200 days of data) [2025-09-17T17:26:48.677615] [DEBUG] [LOCAL ] AVTR: Primary data saved (53571 records). [2025-09-17T17:26:48.677995] [INFO ] [MAIN ] AVTR: Full history saved. [2025-09-17T17:26:48.678310] [INFO ] [MAIN ] Update Progress: 187/2371 symbols completed. AVTR took 30.6s. Estimated remaining: 5h 12m 46s. Rate: 7.0 symbols/min [2025-09-17T17:26:48.857460] [INFO ] [MAIN ] AWI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:26:48.979167] [DEBUG] [LOCAL ] AWI: Loaded 26291 existing records from primary storage. [2025-09-17T17:26:48.980267] [INFO ] [MAIN ] AWI: Loaded 26291 existing records. [2025-09-17T17:26:49.170925] [WARN ] [MAIN ] AWI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:26:49.172815] [INFO ] [MAIN ] AWI: Wiping existing primary data before full refresh. [2025-09-17T17:26:49.173385] [INFO ] [LOCAL ] AWI: Starting deletion of primary data. [2025-09-17T17:26:49.175284] [DEBUG] [LOCAL ] AWI: Deleted primary data file. [2025-09-17T17:26:49.175614] [INFO ] [MAIN ] AWI: Starting full primary refresh. [2025-09-17T17:26:49.299730] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T17:26:49.328102] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-04. [2025-09-17T17:26:49.398867] [DEBUG] [LOCAL ] AVNT: Primary data saved (39593 records). [2025-09-17T17:26:49.458864] [INFO ] [MAIN ] AVNT: Full history saved. [2025-09-17T17:26:49.473202] [INFO ] [MAIN ] Update Progress: 188/2371 symbols completed. AVNT took 45.4s. Estimated remaining: 5h 11m 7s. Rate: 7.0 symbols/min [2025-09-17T17:26:49.679722] [INFO ] [REMOTE ] AWI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:26:49.748338] [INFO ] [MAIN ] AWK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:26:49.800052] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T17:26:49.850259] [DEBUG] [LOCAL ] AWK: Loaded 48881 existing records from primary storage. [2025-09-17T17:26:49.850451] [INFO ] [MAIN ] AWK: Loaded 48881 existing records. [2025-09-17T17:26:50.024200] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-07. [2025-09-17T17:26:50.028345] [WARN ] [MAIN ] AWK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:26:50.029463] [INFO ] [MAIN ] AWK: Wiping existing primary data before full refresh. [2025-09-17T17:26:50.029518] [INFO ] [LOCAL ] AWK: Starting deletion of primary data. [2025-09-17T17:26:50.031279] [DEBUG] [LOCAL ] AWK: Deleted primary data file. [2025-09-17T17:26:50.031333] [INFO ] [MAIN ] AWK: Starting full primary refresh. [2025-09-17T17:26:50.385539] [INFO ] [REMOTE ] AWK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:26:50.680957] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T17:26:50.815808] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-05. [2025-09-17T17:26:51.615783] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-11. [2025-09-17T17:26:51.682374] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T17:26:51.905907] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T17:26:52.415820] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-08. [2025-09-17T17:26:53.215787] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-06. [2025-09-17T17:26:53.366455] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T17:26:53.516604] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T17:26:53.902574] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T17:26:54.015777] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-07. [2025-09-17T17:26:54.815768] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-11. [2025-09-17T17:26:55.179255] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T17:26:55.615789] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-08. [2025-09-17T17:26:56.005934] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T17:26:56.415848] [INFO ] [REMOTE ] AWI: Fetching primary data for 2024-12. [2025-09-17T17:26:56.729235] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T17:26:57.215796] [INFO ] [REMOTE ] AWK: Fetching primary data for 2024-12. [2025-09-17T17:26:57.460023] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T17:26:58.015783] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-01. [2025-09-17T17:26:58.729289] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T17:26:58.815816] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-01. [2025-09-17T17:26:58.844903] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T17:26:59.615793] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-02. [2025-09-17T17:27:00.415805] [INFO ] [REMOTE ] AWF: Fetching primary data for 2025-09. [2025-09-17T17:27:00.481506] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T17:27:00.725397] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T17:27:01.215785] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-02. [2025-09-17T17:27:01.618489] [INFO ] [REMOTE ] AWF: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T17:27:01.622045] [INFO ] [REMOTE ] AWF: Full fetch complete (35872 records). [2025-09-17T17:27:01.622139] [DEBUG] [VALIDATOR ] AWF: Validating primary data. [2025-09-17T17:27:02.008447] [DEBUG] [VALIDATOR ] AWF: All expected trading days are present. [2025-09-17T17:27:02.008531] [DEBUG] [VALIDATOR ] AWF: Primary data validation passed. [2025-09-17T17:27:02.009010] [INFO ] [MAIN ] AWF: Fetched primary data is valid. [2025-09-17T17:27:02.009054] [DEBUG] [LOCAL ] AWF: Saving primary data. [2025-09-17T17:27:02.009882] [DEBUG] [LOCAL ] AWF: Trimmed 35872 records to 24198 (keeping 200 days of data) [2025-09-17T17:27:02.063371] [INFO ] [REMOTE ] AVY: Fetching primary data for 2025-09. [2025-09-17T17:27:02.162619] [DEBUG] [LOCAL ] AWF: Primary data saved (24198 records). [2025-09-17T17:27:02.162785] [INFO ] [MAIN ] AWF: Full history saved. [2025-09-17T17:27:02.162873] [INFO ] [MAIN ] Update Progress: 189/2371 symbols completed. AWF took 27.5s. Estimated remaining: 5h 11m 46s. Rate: 7.0 symbols/min [2025-09-17T17:27:02.332401] [INFO ] [MAIN ] AWP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:27:02.352508] [DEBUG] [LOCAL ] AWP: Loaded 22238 existing records from primary storage. [2025-09-17T17:27:02.352665] [INFO ] [MAIN ] AWP: Loaded 22238 existing records. [2025-09-17T17:27:02.532149] [WARN ] [MAIN ] AWP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:27:02.532535] [INFO ] [MAIN ] AWP: Wiping existing primary data before full refresh. [2025-09-17T17:27:02.532613] [INFO ] [LOCAL ] AWP: Starting deletion of primary data. [2025-09-17T17:27:02.533479] [DEBUG] [LOCAL ] AWP: Deleted primary data file. [2025-09-17T17:27:02.533533] [INFO ] [MAIN ] AWP: Starting full primary refresh. [2025-09-17T17:27:02.815863] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-03. [2025-09-17T17:27:02.850126] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T17:27:02.941815] [INFO ] [REMOTE ] AWP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:27:03.536821] [INFO ] [REMOTE ] AVY: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T17:27:03.542805] [INFO ] [REMOTE ] AVY: Full fetch complete (55769 records). [2025-09-17T17:27:03.542921] [DEBUG] [VALIDATOR ] AVY: Validating primary data. [2025-09-17T17:27:03.620874] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-03. [2025-09-17T17:27:03.935166] [DEBUG] [VALIDATOR ] AVY: All expected trading days are present. [2025-09-17T17:27:03.935253] [DEBUG] [VALIDATOR ] AVY: Primary data validation passed. [2025-09-17T17:27:03.935898] [INFO ] [MAIN ] AVY: Fetched primary data is valid. [2025-09-17T17:27:03.935962] [DEBUG] [LOCAL ] AVY: Saving primary data. [2025-09-17T17:27:03.937168] [DEBUG] [LOCAL ] AVY: Trimmed 55769 records to 37771 (keeping 200 days of data) [2025-09-17T17:27:04.170481] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T17:27:04.207861] [DEBUG] [LOCAL ] AVY: Primary data saved (37771 records). [2025-09-17T17:27:04.208034] [INFO ] [MAIN ] AVY: Full history saved. [2025-09-17T17:27:04.209936] [INFO ] [MAIN ] Update Progress: 190/2371 symbols completed. AVY took 39.0s. Estimated remaining: 5h 10m 22s. Rate: 7.0 symbols/min [2025-09-17T17:27:04.410056] [INFO ] [MAIN ] AWR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:27:04.415827] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-11. [2025-09-17T17:27:04.437769] [DEBUG] [LOCAL ] AWR: Loaded 22408 existing records from primary storage. [2025-09-17T17:27:04.437915] [INFO ] [MAIN ] AWR: Loaded 22408 existing records. [2025-09-17T17:27:04.639324] [WARN ] [MAIN ] AWR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:27:04.639578] [INFO ] [MAIN ] AWR: Wiping existing primary data before full refresh. [2025-09-17T17:27:04.639626] [INFO ] [LOCAL ] AWR: Starting deletion of primary data. [2025-09-17T17:27:04.640625] [DEBUG] [LOCAL ] AWR: Deleted primary data file. [2025-09-17T17:27:04.640713] [INFO ] [MAIN ] AWR: Starting full primary refresh. [2025-09-17T17:27:05.018809] [INFO ] [REMOTE ] AWR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:27:05.215775] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-11. [2025-09-17T17:27:05.401893] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T17:27:05.475087] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T17:27:06.015819] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-04. [2025-09-17T17:27:06.375799] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T17:27:06.815876] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-04. [2025-09-17T17:27:07.447724] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T17:27:07.615788] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-05. [2025-09-17T17:27:08.415795] [INFO ] [REMOTE ] AWP: Fetching primary data for 2024-12. [2025-09-17T17:27:08.581734] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T17:27:08.631391] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T17:27:09.198476] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T17:27:09.215744] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-01. [2025-09-17T17:27:10.015788] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-06. [2025-09-17T17:27:10.482151] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T17:27:10.769920] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T17:27:10.815836] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-07. [2025-09-17T17:27:11.615839] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-05. [2025-09-17T17:27:12.086133] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T17:27:12.415782] [INFO ] [REMOTE ] AWR: Fetching primary data for 2024-12. [2025-09-17T17:27:13.090546] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T17:27:13.215717] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-02. [2025-09-17T17:27:13.391180] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T17:27:14.015849] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-06. [2025-09-17T17:27:14.049877] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T17:27:14.815780] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-08. [2025-09-17T17:27:15.460713] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T17:27:15.615734] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-07. [2025-09-17T17:27:15.988911] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T17:27:16.415766] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-03. [2025-09-17T17:27:17.215702] [INFO ] [REMOTE ] AWI: Fetching primary data for 2025-09. [2025-09-17T17:27:17.308890] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T17:27:17.626246] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T17:27:18.015803] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-08. [2025-09-17T17:27:18.244921] [INFO ] [REMOTE ] AWI: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T17:27:18.248589] [INFO ] [REMOTE ] AWI: Full fetch complete (35382 records). [2025-09-17T17:27:18.248735] [DEBUG] [VALIDATOR ] AWI: Validating primary data. [2025-09-17T17:27:18.641194] [DEBUG] [VALIDATOR ] AWI: All expected trading days are present. [2025-09-17T17:27:18.641276] [DEBUG] [VALIDATOR ] AWI: Primary data validation passed. [2025-09-17T17:27:18.641716] [INFO ] [MAIN ] AWI: Fetched primary data is valid. [2025-09-17T17:27:18.641759] [DEBUG] [LOCAL ] AWI: Saving primary data. [2025-09-17T17:27:18.642600] [DEBUG] [LOCAL ] AWI: Trimmed 35382 records to 26270 (keeping 200 days of data) [2025-09-17T17:27:18.814353] [DEBUG] [LOCAL ] AWI: Primary data saved (26270 records). [2025-09-17T17:27:18.814517] [INFO ] [MAIN ] AWI: Full history saved. [2025-09-17T17:27:18.814659] [INFO ] [MAIN ] Update Progress: 191/2371 symbols completed. AWI took 30.1s. Estimated remaining: 5h 11m 23s. Rate: 7.0 symbols/min [2025-09-17T17:27:18.820199] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-01. [2025-09-17T17:27:18.990054] [INFO ] [MAIN ] AX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:27:19.018667] [DEBUG] [LOCAL ] AX: Loaded 28693 existing records from primary storage. [2025-09-17T17:27:19.018811] [INFO ] [MAIN ] AX: Loaded 28693 existing records. [2025-09-17T17:27:19.194565] [WARN ] [MAIN ] AX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:27:19.194827] [INFO ] [MAIN ] AX: Wiping existing primary data before full refresh. [2025-09-17T17:27:19.194874] [INFO ] [LOCAL ] AX: Starting deletion of primary data. [2025-09-17T17:27:19.196177] [DEBUG] [LOCAL ] AX: Deleted primary data file. [2025-09-17T17:27:19.196238] [INFO ] [MAIN ] AX: Starting full primary refresh. [2025-09-17T17:27:19.554307] [INFO ] [REMOTE ] AX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:27:19.615827] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-11. [2025-09-17T17:27:19.615768] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T17:27:20.130075] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T17:27:20.415859] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-04. [2025-09-17T17:27:21.183976] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T17:27:21.215777] [INFO ] [REMOTE ] AX: Fetching primary data for 2024-12. [2025-09-17T17:27:21.246517] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T17:27:22.015767] [INFO ] [REMOTE ] AWK: Fetching primary data for 2025-09. [2025-09-17T17:27:22.467322] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T17:27:22.815794] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-02. [2025-09-17T17:27:23.615828] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-05. [2025-09-17T17:27:23.749286] [INFO ] [REMOTE ] AWK: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T17:27:23.755840] [INFO ] [REMOTE ] AWK: Full fetch complete (70336 records). [2025-09-17T17:27:23.756024] [DEBUG] [VALIDATOR ] AWK: Validating primary data. [2025-09-17T17:27:23.849265] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T17:27:24.163760] [DEBUG] [VALIDATOR ] AWK: All expected trading days are present. [2025-09-17T17:27:24.163861] [DEBUG] [VALIDATOR ] AWK: Primary data validation passed. [2025-09-17T17:27:24.165078] [INFO ] [MAIN ] AWK: Fetched primary data is valid. [2025-09-17T17:27:24.165140] [DEBUG] [LOCAL ] AWK: Saving primary data. [2025-09-17T17:27:24.166555] [DEBUG] [LOCAL ] AWK: Trimmed 70336 records to 48887 (keeping 200 days of data) [2025-09-17T17:27:24.415821] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-01. [2025-09-17T17:27:24.494514] [DEBUG] [LOCAL ] AWK: Primary data saved (48887 records). [2025-09-17T17:27:24.494681] [INFO ] [MAIN ] AWK: Full history saved. [2025-09-17T17:27:24.494819] [INFO ] [MAIN ] Update Progress: 192/2371 symbols completed. AWK took 35.0s. Estimated remaining: 5h 10m 42s. Rate: 7.0 symbols/min [2025-09-17T17:27:24.680143] [INFO ] [MAIN ] AXL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:27:24.694069] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T17:27:24.746302] [DEBUG] [LOCAL ] AXL: Loaded 50534 existing records from primary storage. [2025-09-17T17:27:24.746457] [INFO ] [MAIN ] AXL: Loaded 50534 existing records. [2025-09-17T17:27:24.926467] [WARN ] [MAIN ] AXL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:27:24.926766] [INFO ] [MAIN ] AXL: Wiping existing primary data before full refresh. [2025-09-17T17:27:24.926813] [INFO ] [LOCAL ] AXL: Starting deletion of primary data. [2025-09-17T17:27:24.927746] [DEBUG] [LOCAL ] AXL: Deleted primary data file. [2025-09-17T17:27:24.927799] [INFO ] [MAIN ] AXL: Starting full primary refresh. [2025-09-17T17:27:25.220993] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-06. [2025-09-17T17:27:25.292773] [INFO ] [REMOTE ] AXL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:27:25.848398] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T17:27:26.015708] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-02. [2025-09-17T17:27:26.334539] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T17:27:26.815773] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-07. [2025-09-17T17:27:27.032260] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T17:27:27.615784] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-11. [2025-09-17T17:27:28.269323] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T17:27:28.415783] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-08. [2025-09-17T17:27:29.215805] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-03. [2025-09-17T17:27:29.314367] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T17:27:29.514956] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T17:27:30.015779] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-03. [2025-09-17T17:27:30.503611] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T17:27:30.815789] [INFO ] [REMOTE ] AXL: Fetching primary data for 2024-12. [2025-09-17T17:27:31.255760] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T17:27:31.615772] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-04. [2025-09-17T17:27:32.416952] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T17:27:32.415836] [INFO ] [REMOTE ] AWP: Fetching primary data for 2025-09. [2025-09-17T17:27:32.995678] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T17:27:33.118134] [INFO ] [REMOTE ] AWP: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T17:27:33.121050] [INFO ] [REMOTE ] AWP: Full fetch complete (32580 records). [2025-09-17T17:27:33.121129] [DEBUG] [VALIDATOR ] AWP: Validating primary data. [2025-09-17T17:27:33.220765] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-04. [2025-09-17T17:27:33.495970] [DEBUG] [VALIDATOR ] AWP: All expected trading days are present. [2025-09-17T17:27:33.496047] [DEBUG] [VALIDATOR ] AWP: Primary data validation passed. [2025-09-17T17:27:33.496462] [INFO ] [MAIN ] AWP: Fetched primary data is valid. [2025-09-17T17:27:33.496501] [DEBUG] [LOCAL ] AWP: Saving primary data. [2025-09-17T17:27:33.497586] [DEBUG] [LOCAL ] AWP: Trimmed 32580 records to 22217 (keeping 200 days of data) [2025-09-17T17:27:33.637283] [DEBUG] [LOCAL ] AWP: Primary data saved (22217 records). [2025-09-17T17:27:33.637417] [INFO ] [MAIN ] AWP: Full history saved. [2025-09-17T17:27:33.637552] [INFO ] [MAIN ] Update Progress: 193/2371 symbols completed. AWP took 31.5s. Estimated remaining: 5h 10m 40s. Rate: 7.0 symbols/min [2025-09-17T17:27:33.812711] [INFO ] [MAIN ] AXP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:27:33.868516] [DEBUG] [LOCAL ] AXP: Loaded 53258 existing records from primary storage. [2025-09-17T17:27:33.868699] [INFO ] [MAIN ] AXP: Loaded 53258 existing records. [2025-09-17T17:27:34.023525] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-05. [2025-09-17T17:27:34.058521] [WARN ] [MAIN ] AXP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:27:34.058783] [INFO ] [MAIN ] AXP: Wiping existing primary data before full refresh. [2025-09-17T17:27:34.058831] [INFO ] [LOCAL ] AXP: Starting deletion of primary data. [2025-09-17T17:27:34.059865] [DEBUG] [LOCAL ] AXP: Deleted primary data file. [2025-09-17T17:27:34.059924] [INFO ] [MAIN ] AXP: Starting full primary refresh. [2025-09-17T17:27:34.429911] [INFO ] [REMOTE ] AXP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:27:34.470721] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T17:27:34.815795] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-05. [2025-09-17T17:27:35.122349] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T17:27:35.615778] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-06. [2025-09-17T17:27:35.920206] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T17:27:36.415747] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-06. [2025-09-17T17:27:36.748276] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T17:27:37.200175] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T17:27:37.215721] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-11. [2025-09-17T17:27:38.015953] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-01. [2025-09-17T17:27:38.815772] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-07. [2025-09-17T17:27:39.233540] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T17:27:39.615779] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-07. [2025-09-17T17:27:39.687415] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T17:27:39.770081] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T17:27:40.415785] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-02. [2025-09-17T17:27:40.922697] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T17:27:41.215784] [INFO ] [REMOTE ] AXP: Fetching primary data for 2024-12. [2025-09-17T17:27:41.700963] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T17:27:42.015765] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-08. [2025-09-17T17:27:42.815762] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-08. [2025-09-17T17:27:43.160700] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T17:27:43.252456] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T17:27:43.615754] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-01. [2025-09-17T17:27:43.944413] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T17:27:44.415783] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-03. [2025-09-17T17:27:45.215810] [INFO ] [REMOTE ] AWR: Fetching primary data for 2025-09. [2025-09-17T17:27:45.693006] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-17T17:27:45.829241] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T17:27:46.015812] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-04. [2025-09-17T17:27:46.099926] [INFO ] [REMOTE ] AWR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T17:27:46.103768] [INFO ] [REMOTE ] AWR: Full fetch complete (31499 records). [2025-09-17T17:27:46.103912] [DEBUG] [VALIDATOR ] AWR: Validating primary data. [2025-09-17T17:27:46.489662] [DEBUG] [VALIDATOR ] AWR: All expected trading days are present. [2025-09-17T17:27:46.489817] [DEBUG] [VALIDATOR ] AWR: Primary data validation passed. [2025-09-17T17:27:46.490320] [INFO ] [MAIN ] AWR: Fetched primary data is valid. [2025-09-17T17:27:46.490397] [DEBUG] [LOCAL ] AWR: Saving primary data. [2025-09-17T17:27:46.491539] [DEBUG] [LOCAL ] AWR: Trimmed 31499 records to 22425 (keeping 200 days of data) [2025-09-17T17:27:46.631282] [DEBUG] [LOCAL ] AWR: Primary data saved (22425 records). [2025-09-17T17:27:46.631414] [INFO ] [MAIN ] AWR: Full history saved. [2025-09-17T17:27:46.631505] [INFO ] [MAIN ] Update Progress: 194/2371 symbols completed. AWR took 42.4s. Estimated remaining: 5h 11m 21s. Rate: 7.0 symbols/min [2025-09-17T17:27:46.805482] [INFO ] [MAIN ] AXR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:27:46.810417] [DEBUG] [LOCAL ] AXR: Loaded 3125 existing records from primary storage. [2025-09-17T17:27:46.810511] [INFO ] [MAIN ] AXR: Loaded 3125 existing records. [2025-09-17T17:27:46.821624] [INFO ] [REMOTE ] AX: Fetching primary data for 2025-09. [2025-09-17T17:27:47.001946] [WARN ] [MAIN ] AXR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:27:47.002271] [INFO ] [MAIN ] AXR: Wiping existing primary data before full refresh. [2025-09-17T17:27:47.002336] [INFO ] [LOCAL ] AXR: Starting deletion of primary data. [2025-09-17T17:27:47.002617] [DEBUG] [LOCAL ] AXR: Deleted primary data file. [2025-09-17T17:27:47.002704] [INFO ] [MAIN ] AXR: Starting full primary refresh. [2025-09-17T17:27:47.372420] [INFO ] [REMOTE ] AXR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:27:47.562838] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T17:27:47.615765] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-05. [2025-09-17T17:27:47.961325] [INFO ] [REMOTE ] AX: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T17:27:47.965497] [INFO ] [REMOTE ] AX: Full fetch complete (42534 records). [2025-09-17T17:27:47.965588] [DEBUG] [VALIDATOR ] AX: Validating primary data. [2025-09-17T17:27:48.343882] [DEBUG] [VALIDATOR ] AX: All expected trading days are present. [2025-09-17T17:27:48.343965] [DEBUG] [VALIDATOR ] AX: Primary data validation passed. [2025-09-17T17:27:48.344481] [INFO ] [MAIN ] AX: Fetched primary data is valid. [2025-09-17T17:27:48.344523] [DEBUG] [LOCAL ] AX: Saving primary data. [2025-09-17T17:27:48.345487] [DEBUG] [LOCAL ] AX: Trimmed 42534 records to 28759 (keeping 200 days of data) [2025-09-17T17:27:48.430255] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-11. [2025-09-17T17:27:48.518199] [DEBUG] [LOCAL ] AX: Primary data saved (28759 records). [2025-09-17T17:27:48.518339] [INFO ] [MAIN ] AX: Full history saved. [2025-09-17T17:27:48.518423] [INFO ] [MAIN ] Update Progress: 195/2371 symbols completed. AX took 29.7s. Estimated remaining: 5h 9m 58s. Rate: 7.0 symbols/min [2025-09-17T17:27:48.696109] [INFO ] [MAIN ] AXS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:27:48.737268] [DEBUG] [LOCAL ] AXS: Loaded 38288 existing records from primary storage. [2025-09-17T17:27:48.737449] [INFO ] [MAIN ] AXS: Loaded 38288 existing records. [2025-09-17T17:27:48.920625] [WARN ] [MAIN ] AXS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:27:48.920916] [INFO ] [MAIN ] AXS: Wiping existing primary data before full refresh. [2025-09-17T17:27:48.920963] [INFO ] [LOCAL ] AXS: Starting deletion of primary data. [2025-09-17T17:27:48.921815] [DEBUG] [LOCAL ] AXS: Deleted primary data file. [2025-09-17T17:27:48.921868] [INFO ] [MAIN ] AXS: Starting full primary refresh. [2025-09-17T17:27:49.220928] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-02. [2025-09-17T17:27:49.288266] [INFO ] [REMOTE ] AXS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:27:49.330693] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T17:27:49.384409] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T17:27:50.015777] [INFO ] [REMOTE ] AXR: Fetching primary data for 2024-12. [2025-09-17T17:27:50.729223] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T17:27:50.815759] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-06. [2025-09-17T17:27:51.247230] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-17T17:27:51.615785] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-11. [2025-09-17T17:27:52.415818] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-03. [2025-09-17T17:27:52.457500] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T17:27:52.666719] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T17:27:53.215867] [INFO ] [REMOTE ] AXS: Fetching primary data for 2024-12. [2025-09-17T17:27:54.015781] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-07. [2025-09-17T17:27:54.538907] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T17:27:54.624090] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T17:27:54.815797] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-01. [2025-09-17T17:27:55.482039] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T17:27:55.615797] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-02. [2025-09-17T17:27:55.781809] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T17:27:55.951925] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T17:27:56.415804] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-08. [2025-09-17T17:27:57.215794] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-01. [2025-09-17T17:27:57.765266] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T17:27:58.015820] [INFO ] [REMOTE ] AXL: Fetching primary data for 2025-09. [2025-09-17T17:27:58.646942] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T17:27:58.815778] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-02. [2025-09-17T17:27:59.473451] [INFO ] [REMOTE ] AXL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T17:27:59.479897] [INFO ] [REMOTE ] AXL: Full fetch complete (72146 records). [2025-09-17T17:27:59.480020] [DEBUG] [VALIDATOR ] AXL: Validating primary data. [2025-09-17T17:27:59.620909] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-03. [2025-09-17T17:27:59.875162] [DEBUG] [VALIDATOR ] AXL: All expected trading days are present. [2025-09-17T17:27:59.875245] [DEBUG] [VALIDATOR ] AXL: Primary data validation passed. [2025-09-17T17:27:59.875995] [INFO ] [MAIN ] AXL: Fetched primary data is valid. [2025-09-17T17:27:59.876041] [DEBUG] [LOCAL ] AXL: Saving primary data. [2025-09-17T17:27:59.877477] [DEBUG] [LOCAL ] AXL: Trimmed 72146 records to 50542 (keeping 200 days of data) [2025-09-17T17:28:00.186592] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T17:28:00.202815] [DEBUG] [LOCAL ] AXL: Primary data saved (50542 records). [2025-09-17T17:28:00.202969] [INFO ] [MAIN ] AXL: Full history saved. [2025-09-17T17:28:00.203729] [INFO ] [MAIN ] Update Progress: 196/2371 symbols completed. AXL took 35.7s. Estimated remaining: 5h 10m 24s. Rate: 7.0 symbols/min [2025-09-17T17:28:00.312713] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T17:28:00.385465] [INFO ] [MAIN ] AXTA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:28:00.418310] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-04. [2025-09-17T17:28:00.440875] [DEBUG] [LOCAL ] AXTA: Loaded 52032 existing records from primary storage. [2025-09-17T17:28:00.441023] [INFO ] [MAIN ] AXTA: Loaded 52032 existing records. [2025-09-17T17:28:00.658686] [WARN ] [MAIN ] AXTA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:28:00.658953] [INFO ] [MAIN ] AXTA: Wiping existing primary data before full refresh. [2025-09-17T17:28:00.659001] [INFO ] [LOCAL ] AXTA: Starting deletion of primary data. [2025-09-17T17:28:00.660015] [DEBUG] [LOCAL ] AXTA: Deleted primary data file. [2025-09-17T17:28:00.660069] [INFO ] [MAIN ] AXTA: Starting full primary refresh. [2025-09-17T17:28:01.017848] [INFO ] [REMOTE ] AXTA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:28:01.043735] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T17:28:01.215734] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-11. [2025-09-17T17:28:02.015773] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-04. [2025-09-17T17:28:02.720792] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T17:28:02.815738] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2024-12. [2025-09-17T17:28:03.615811] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-05. [2025-09-17T17:28:04.094074] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T17:28:04.261537] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-17T17:28:04.415777] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-05. [2025-09-17T17:28:04.456700] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T17:28:05.215776] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-01. [2025-09-17T17:28:06.015781] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-03. [2025-09-17T17:28:06.301225] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T17:28:06.379901] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T17:28:06.815775] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-02. [2025-09-17T17:28:07.167347] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T17:28:07.615999] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-06. [2025-09-17T17:28:08.200019] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T17:28:08.251805] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T17:28:08.415777] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-04. [2025-09-17T17:28:09.215803] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-06. [2025-09-17T17:28:09.741248] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T17:28:10.015806] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-05. [2025-09-17T17:28:10.815804] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-07. [2025-09-17T17:28:11.136491] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T17:28:11.548093] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T17:28:11.571905] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T17:28:11.615744] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-06. [2025-09-17T17:28:12.415793] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-07. [2025-09-17T17:28:13.129470] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T17:28:13.215740] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-07. [2025-09-17T17:28:14.015832] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-08. [2025-09-17T17:28:14.731703] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T17:28:14.766781] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-17T17:28:14.801328] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T17:28:14.815665] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-08. [2025-09-17T17:28:15.615786] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-08. [2025-09-17T17:28:16.415896] [INFO ] [REMOTE ] AXR: Fetching primary data for 2025-09. [2025-09-17T17:28:16.461960] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T17:28:17.029331] [INFO ] [REMOTE ] AXR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T17:28:17.030421] [INFO ] [REMOTE ] AXR: Full fetch complete (4937 records). [2025-09-17T17:28:17.030488] [DEBUG] [VALIDATOR ] AXR: Validating primary data. [2025-09-17T17:28:17.220997] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-03. [2025-09-17T17:28:17.392706] [DEBUG] [VALIDATOR ] AXR: All expected trading days are present. [2025-09-17T17:28:17.392878] [DEBUG] [VALIDATOR ] AXR: Primary data validation passed. [2025-09-17T17:28:17.393115] [INFO ] [MAIN ] AXR: Fetched primary data is valid. [2025-09-17T17:28:17.393171] [DEBUG] [LOCAL ] AXR: Saving primary data. [2025-09-17T17:28:17.393793] [DEBUG] [LOCAL ] AXR: Trimmed 4937 records to 3129 (keeping 200 days of data) [2025-09-17T17:28:17.414102] [DEBUG] [LOCAL ] AXR: Primary data saved (3129 records). [2025-09-17T17:28:17.414280] [INFO ] [MAIN ] AXR: Full history saved. [2025-09-17T17:28:17.414414] [INFO ] [MAIN ] Update Progress: 197/2371 symbols completed. AXR took 30.8s. Estimated remaining: 5h 11m 51s. Rate: 7.0 symbols/min [2025-09-17T17:28:17.481293] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T17:28:18.015841] [INFO ] [REMOTE ] AXP: Fetching primary data for 2025-09. [2025-09-17T17:28:18.669761] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T17:28:18.815785] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-04. [2025-09-17T17:28:19.615802] [INFO ] [REMOTE ] AXS: Fetching primary data for 2025-09. [2025-09-17T17:28:20.056252] [INFO ] [REMOTE ] AXP: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-17T17:28:20.064725] [INFO ] [REMOTE ] AXP: Full fetch complete (76799 records). [2025-09-17T17:28:20.064898] [DEBUG] [VALIDATOR ] AXP: Validating primary data. [2025-09-17T17:28:20.466507] [DEBUG] [VALIDATOR ] AXP: All expected trading days are present. [2025-09-17T17:28:20.466603] [DEBUG] [VALIDATOR ] AXP: Primary data validation passed. [2025-09-17T17:28:20.467448] [INFO ] [MAIN ] AXP: Fetched primary data is valid. [2025-09-17T17:28:20.467506] [DEBUG] [LOCAL ] AXP: Saving primary data. [2025-09-17T17:28:20.496474] [DEBUG] [LOCAL ] AXP: Trimmed 76799 records to 53266 (keeping 200 days of data) [2025-09-17T17:28:20.498126] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T17:28:20.510100] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-05. [2025-09-17T17:28:20.848784] [DEBUG] [LOCAL ] AXP: Primary data saved (53266 records). [2025-09-17T17:28:20.848936] [INFO ] [MAIN ] AXP: Full history saved. [2025-09-17T17:28:20.850166] [INFO ] [MAIN ] Update Progress: 198/2371 symbols completed. AXP took 47.2s. Estimated remaining: 5h 10m 46s. Rate: 7.0 symbols/min [2025-09-17T17:28:21.166952] [INFO ] [REMOTE ] AXS: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T17:28:21.171900] [INFO ] [REMOTE ] AXS: Full fetch complete (55186 records). [2025-09-17T17:28:21.171995] [DEBUG] [VALIDATOR ] AXS: Validating primary data. [2025-09-17T17:28:21.554434] [DEBUG] [VALIDATOR ] AXS: All expected trading days are present. [2025-09-17T17:28:21.554522] [DEBUG] [VALIDATOR ] AXS: Primary data validation passed. [2025-09-17T17:28:21.555196] [INFO ] [MAIN ] AXS: Fetched primary data is valid. [2025-09-17T17:28:21.555242] [DEBUG] [LOCAL ] AXS: Saving primary data. [2025-09-17T17:28:21.556375] [DEBUG] [LOCAL ] AXS: Trimmed 55186 records to 38300 (keeping 200 days of data) [2025-09-17T17:28:21.788500] [DEBUG] [LOCAL ] AXS: Primary data saved (38300 records). [2025-09-17T17:28:21.788625] [INFO ] [MAIN ] AXS: Full history saved. [2025-09-17T17:28:21.788736] [INFO ] [MAIN ] Update Progress: 199/2371 symbols completed. AXS took 33.3s. Estimated remaining: 5h 9m 14s. Rate: 7.0 symbols/min [2025-09-17T17:28:22.293736] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T17:28:22.304862] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-06. [2025-09-17T17:28:23.960816] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T17:28:23.971935] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-07. [2025-09-17T17:28:25.780861] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T17:28:25.792705] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-08. [2025-09-17T17:28:27.497678] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T17:28:27.509029] [INFO ] [REMOTE ] AXTA: Fetching primary data for 2025-09. [2025-09-17T17:28:29.254068] [INFO ] [REMOTE ] AXTA: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T17:28:29.261036] [INFO ] [REMOTE ] AXTA: Full fetch complete (74475 records). [2025-09-17T17:28:29.261160] [DEBUG] [VALIDATOR ] AXTA: Validating primary data. [2025-09-17T17:28:29.679542] [DEBUG] [VALIDATOR ] AXTA: All expected trading days are present. [2025-09-17T17:28:29.679663] [DEBUG] [VALIDATOR ] AXTA: Primary data validation passed. [2025-09-17T17:28:29.680467] [INFO ] [MAIN ] AXTA: Fetched primary data is valid. [2025-09-17T17:28:29.680513] [DEBUG] [LOCAL ] AXTA: Saving primary data. [2025-09-17T17:28:29.682292] [DEBUG] [LOCAL ] AXTA: Trimmed 74475 records to 52041 (keeping 200 days of data) [2025-09-17T17:28:30.006072] [DEBUG] [LOCAL ] AXTA: Primary data saved (52041 records). [2025-09-17T17:28:30.006209] [INFO ] [MAIN ] AXTA: Full history saved. [2025-09-17T17:28:30.006817] [INFO ] [MAIN ] Update Progress: 200/2371 symbols completed. AXTA took 29.8s. Estimated remaining: 5h 9m 2s. Rate: 7.0 symbols/min [2025-09-17T17:28:30.651063] [INFO ] [MAIN ] AZO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:28:30.796841] [INFO ] [MAIN ] AYI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:28:30.804748] [INFO ] [MAIN ] B: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:28:30.814286] [INFO ] [MAIN ] AZZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:28:30.814467] [DEBUG] [LOCAL ] B: No existing data file found in primary storage. [2025-09-17T17:28:30.815353] [WARN ] [MAIN ] B: No existing data found, performing full refresh instead. [2025-09-17T17:28:30.815723] [INFO ] [MAIN ] B: Wiping existing primary data before full refresh. [2025-09-17T17:28:30.820620] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-17T17:28:30.820888] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-17T17:28:30.821959] [INFO ] [MAIN ] B: Starting full primary refresh. [2025-09-17T17:28:30.854447] [DEBUG] [LOCAL ] AZO: Loaded 11621 existing records from primary storage. [2025-09-17T17:28:30.860545] [INFO ] [MAIN ] AZO: Loaded 11621 existing records. [2025-09-17T17:28:31.067436] [DEBUG] [LOCAL ] AYI: Loaded 25758 existing records from primary storage. [2025-09-17T17:28:31.109542] [INFO ] [MAIN ] AYI: Loaded 25758 existing records. [2025-09-17T17:28:31.098588] [DEBUG] [LOCAL ] AZZ: Loaded 22142 existing records from primary storage. [2025-09-17T17:28:31.185895] [INFO ] [MAIN ] AZZ: Loaded 22142 existing records. [2025-09-17T17:28:31.677364] [WARN ] [MAIN ] AZO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:28:31.813580] [INFO ] [MAIN ] AZO: Wiping existing primary data before full refresh. [2025-09-17T17:28:31.914377] [INFO ] [LOCAL ] AZO: Starting deletion of primary data. [2025-09-17T17:28:31.983055] [WARN ] [MAIN ] AYI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:28:31.998791] [DEBUG] [LOCAL ] AZO: Deleted primary data file. [2025-09-17T17:28:31.998748] [INFO ] [MAIN ] AYI: Wiping existing primary data before full refresh. [2025-09-17T17:28:32.029329] [INFO ] [MAIN ] AZO: Starting full primary refresh. [2025-09-17T17:28:32.042525] [INFO ] [LOCAL ] AYI: Starting deletion of primary data. [2025-09-17T17:28:32.113822] [WARN ] [MAIN ] AZZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:28:32.176575] [INFO ] [MAIN ] AZZ: Wiping existing primary data before full refresh. [2025-09-17T17:28:32.203208] [INFO ] [REMOTE ] B: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:28:32.208443] [DEBUG] [LOCAL ] AYI: Deleted primary data file. [2025-09-17T17:28:32.208810] [INFO ] [REMOTE ] B: Fetching primary data for 2024-11. [2025-09-17T17:28:32.208907] [INFO ] [LOCAL ] AZZ: Starting deletion of primary data. [2025-09-17T17:28:32.208973] [INFO ] [MAIN ] AYI: Starting full primary refresh. [2025-09-17T17:28:32.235063] [DEBUG] [LOCAL ] AZZ: Deleted primary data file. [2025-09-17T17:28:32.235595] [INFO ] [MAIN ] AZZ: Starting full primary refresh. [2025-09-17T17:28:32.900499] [INFO ] [REMOTE ] AZO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:28:32.971593] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-11. [2025-09-17T17:28:33.262695] [INFO ] [REMOTE ] AYI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:28:33.274696] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-11. [2025-09-17T17:28:33.274450] [INFO ] [REMOTE ] AZZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:28:33.274951] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-11. [2025-09-17T17:28:33.719291] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T17:28:33.726950] [INFO ] [REMOTE ] B: Fetching primary data for 2024-12. [2025-09-17T17:28:33.737117] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T17:28:33.740485] [INFO ] [REMOTE ] AZO: Fetching primary data for 2024-12. [2025-09-17T17:28:34.406257] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T17:28:34.410816] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2024-12. [2025-09-17T17:28:34.525842] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T17:28:34.530827] [INFO ] [REMOTE ] AYI: Fetching primary data for 2024-12. [2025-09-17T17:28:34.660547] [INFO ] [REMOTE ] B: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T17:28:34.668759] [INFO ] [REMOTE ] B: Fetching primary data for 2025-01. [2025-09-17T17:28:34.798681] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T17:28:34.802080] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-01. [2025-09-17T17:28:35.126811] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T17:28:35.131209] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-01. [2025-09-17T17:28:35.441112] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T17:28:35.446600] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-01. [2025-09-17T17:28:35.456145] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T17:28:35.460246] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-02. [2025-09-17T17:28:35.508095] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T17:28:35.514160] [INFO ] [REMOTE ] B: Fetching primary data for 2025-02. [2025-09-17T17:28:35.707096] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:28:35.707454] [WARN ] [REMOTE ] B: No data returned for month 2025-02 [2025-09-17T17:28:35.708523] [INFO ] [REMOTE ] B: Fetching primary data for 2025-03. [2025-09-17T17:28:35.909327] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:28:35.909638] [WARN ] [REMOTE ] B: No data returned for month 2025-03 [2025-09-17T17:28:36.024478] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T17:28:36.035926] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T17:28:36.415800] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-02. [2025-09-17T17:28:36.805871] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T17:28:37.215801] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-02. [2025-09-17T17:28:37.302928] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T17:28:38.015779] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-03. [2025-09-17T17:28:38.298171] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T17:28:38.815745] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-03. [2025-09-17T17:28:39.164558] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T17:28:39.615814] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-03. [2025-09-17T17:28:39.932330] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T17:28:40.415791] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-04. [2025-09-17T17:28:41.016980] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T17:28:41.215769] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-04. [2025-09-17T17:28:41.649259] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T17:28:42.015752] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-05. [2025-09-17T17:28:42.418702] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T17:28:42.815776] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-05. [2025-09-17T17:28:42.976216] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T17:28:43.615762] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-04. [2025-09-17T17:28:43.926085] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T17:28:44.415766] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-06. [2025-09-17T17:28:45.215818] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-06. [2025-09-17T17:28:45.350633] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T17:28:45.411602] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T17:28:45.985878] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T17:28:46.015778] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-07. [2025-09-17T17:28:46.815786] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-07. [2025-09-17T17:28:47.269914] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T17:28:47.401752] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T17:28:47.615828] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-08. [2025-09-17T17:28:48.415785] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-05. [2025-09-17T17:28:48.476313] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T17:28:49.215952] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-08. [2025-09-17T17:28:49.446537] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T17:28:50.015771] [INFO ] [REMOTE ] B: Fetching primary data for 2025-04. [2025-09-17T17:28:50.230635] [DEBUG] [REMOTE ] B: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:28:50.231037] [WARN ] [REMOTE ] B: No data returned for month 2025-04 [2025-09-17T17:28:50.341805] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T17:28:50.815840] [INFO ] [REMOTE ] AZO: Fetching primary data for 2025-09. [2025-09-17T17:28:51.615766] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-06. [2025-09-17T17:28:51.691518] [INFO ] [REMOTE ] AZO: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T17:28:51.693233] [INFO ] [REMOTE ] AZO: Full fetch complete (16414 records). [2025-09-17T17:28:51.693308] [DEBUG] [VALIDATOR ] AZO: Validating primary data. [2025-09-17T17:28:52.058904] [DEBUG] [VALIDATOR ] AZO: All expected trading days are present. [2025-09-17T17:28:52.058987] [DEBUG] [VALIDATOR ] AZO: Primary data validation passed. [2025-09-17T17:28:52.059280] [INFO ] [MAIN ] AZO: Fetched primary data is valid. [2025-09-17T17:28:52.059319] [DEBUG] [LOCAL ] AZO: Saving primary data. [2025-09-17T17:28:52.059878] [DEBUG] [LOCAL ] AZO: Trimmed 16414 records to 11607 (keeping 200 days of data) [2025-09-17T17:28:52.137581] [DEBUG] [LOCAL ] AZO: Primary data saved (11607 records). [2025-09-17T17:28:52.137749] [INFO ] [MAIN ] AZO: Full history saved. [2025-09-17T17:28:52.137836] [INFO ] [MAIN ] Update Progress: 201/2371 symbols completed. AZO took 22.1s. Estimated remaining: 5h 11m 20s. Rate: 7.0 symbols/min [2025-09-17T17:28:52.308681] [INFO ] [MAIN ] BA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:28:52.364175] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-17T17:28:52.364362] [INFO ] [MAIN ] BA: Loaded 53791 existing records. [2025-09-17T17:28:52.424311] [INFO ] [REMOTE ] B: Fetching primary data for 2025-05. [2025-09-17T17:28:52.553344] [WARN ] [MAIN ] BA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:28:52.553620] [INFO ] [MAIN ] BA: Wiping existing primary data before full refresh. [2025-09-17T17:28:52.553686] [INFO ] [LOCAL ] BA: Starting deletion of primary data. [2025-09-17T17:28:52.555279] [DEBUG] [LOCAL ] BA: Deleted primary data file. [2025-09-17T17:28:52.555343] [INFO ] [MAIN ] BA: Starting full primary refresh. [2025-09-17T17:28:52.919894] [INFO ] [REMOTE ] BA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:28:52.938876] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T17:28:53.215797] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-11. [2025-09-17T17:28:54.015852] [INFO ] [REMOTE ] AZZ: Fetching primary data for 2025-09. [2025-09-17T17:28:54.425108] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T17:28:54.806705] [INFO ] [REMOTE ] AZZ: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T17:28:54.809590] [INFO ] [REMOTE ] AZZ: Full fetch complete (30694 records). [2025-09-17T17:28:54.809701] [DEBUG] [VALIDATOR ] AZZ: Validating primary data. [2025-09-17T17:28:54.821461] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-07. [2025-09-17T17:28:55.195658] [DEBUG] [VALIDATOR ] AZZ: All expected trading days are present. [2025-09-17T17:28:55.195745] [DEBUG] [VALIDATOR ] AZZ: Primary data validation passed. [2025-09-17T17:28:55.196128] [INFO ] [MAIN ] AZZ: Fetched primary data is valid. [2025-09-17T17:28:55.196166] [DEBUG] [LOCAL ] AZZ: Saving primary data. [2025-09-17T17:28:55.196927] [DEBUG] [LOCAL ] AZZ: Trimmed 30694 records to 22182 (keeping 200 days of data) [2025-09-17T17:28:55.334625] [DEBUG] [LOCAL ] AZZ: Primary data saved (22182 records). [2025-09-17T17:28:55.334802] [INFO ] [MAIN ] AZZ: Full history saved. [2025-09-17T17:28:55.334899] [INFO ] [MAIN ] Update Progress: 202/2371 symbols completed. AZZ took 25.3s. Estimated remaining: 5h 10m 13s. Rate: 7.0 symbols/min [2025-09-17T17:28:55.504544] [INFO ] [MAIN ] BABA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:28:55.533766] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-11 (2.32 seconds). [2025-09-17T17:28:55.593455] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-17T17:28:55.593596] [INFO ] [MAIN ] BABA: Loaded 53820 existing records. [2025-09-17T17:28:55.625087] [INFO ] [REMOTE ] B: Fetching primary data for 2025-06. [2025-09-17T17:28:55.781093] [WARN ] [MAIN ] BABA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:28:55.781345] [INFO ] [MAIN ] BABA: Wiping existing primary data before full refresh. [2025-09-17T17:28:55.781399] [INFO ] [LOCAL ] BABA: Starting deletion of primary data. [2025-09-17T17:28:55.783590] [DEBUG] [LOCAL ] BABA: Deleted primary data file. [2025-09-17T17:28:55.783751] [INFO ] [MAIN ] BABA: Starting full primary refresh. [2025-09-17T17:28:56.074851] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T17:28:56.181897] [INFO ] [REMOTE ] BABA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:28:56.415744] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-11. [2025-09-17T17:28:57.215832] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-08. [2025-09-17T17:28:57.496291] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T17:28:58.015760] [INFO ] [REMOTE ] B: Fetching primary data for 2025-07. [2025-09-17T17:28:58.281307] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T17:28:58.815787] [INFO ] [REMOTE ] AYI: Fetching primary data for 2025-09. [2025-09-17T17:28:59.095282] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-11 (2.68 seconds). [2025-09-17T17:28:59.615698] [INFO ] [REMOTE ] BA: Fetching primary data for 2024-12. [2025-09-17T17:28:59.729736] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T17:28:59.981570] [INFO ] [REMOTE ] AYI: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T17:28:59.984539] [INFO ] [REMOTE ] AYI: Full fetch complete (36828 records). [2025-09-17T17:28:59.984629] [DEBUG] [VALIDATOR ] AYI: Validating primary data. [2025-09-17T17:29:00.399631] [DEBUG] [VALIDATOR ] AYI: All expected trading days are present. [2025-09-17T17:29:00.399757] [DEBUG] [VALIDATOR ] AYI: Primary data validation passed. [2025-09-17T17:29:00.400237] [INFO ] [MAIN ] AYI: Fetched primary data is valid. [2025-09-17T17:29:00.400278] [DEBUG] [LOCAL ] AYI: Saving primary data. [2025-09-17T17:29:00.401119] [DEBUG] [LOCAL ] AYI: Trimmed 36828 records to 25640 (keeping 200 days of data) [2025-09-17T17:29:00.463254] [INFO ] [REMOTE ] B: Fetching primary data for 2025-08. [2025-09-17T17:29:00.571708] [DEBUG] [LOCAL ] AYI: Primary data saved (25640 records). [2025-09-17T17:29:00.571838] [INFO ] [MAIN ] AYI: Full history saved. [2025-09-17T17:29:00.571938] [INFO ] [MAIN ] Update Progress: 203/2371 symbols completed. AYI took 30.6s. Estimated remaining: 5h 9m 29s. Rate: 7.0 symbols/min [2025-09-17T17:29:00.739575] [INFO ] [MAIN ] BAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:29:00.791180] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-17T17:29:00.791341] [INFO ] [MAIN ] BAC: Loaded 53808 existing records. [2025-09-17T17:29:00.969399] [WARN ] [MAIN ] BAC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:29:00.969693] [INFO ] [MAIN ] BAC: Wiping existing primary data before full refresh. [2025-09-17T17:29:00.969739] [INFO ] [LOCAL ] BAC: Starting deletion of primary data. [2025-09-17T17:29:00.970845] [DEBUG] [LOCAL ] BAC: Deleted primary data file. [2025-09-17T17:29:00.970893] [INFO ] [MAIN ] BAC: Starting full primary refresh. [2025-09-17T17:29:01.225967] [INFO ] [REMOTE ] BABA: Fetching primary data for 2024-12. [2025-09-17T17:29:01.333739] [INFO ] [REMOTE ] BAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:29:02.015762] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-11. [2025-09-17T17:29:02.096175] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2024-12 (2.48 seconds). [2025-09-17T17:29:02.747316] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-17T17:29:02.815737] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-01. [2025-09-17T17:29:03.462756] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-17T17:29:03.615831] [INFO ] [REMOTE ] B: Fetching primary data for 2025-09. [2025-09-17T17:29:04.423613] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-01. [2025-09-17T17:29:04.444301] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-11 (2.43 seconds). [2025-09-17T17:29:05.215786] [INFO ] [REMOTE ] BAC: Fetching primary data for 2024-12. [2025-09-17T17:29:05.271681] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-17T17:29:05.512561] [INFO ] [REMOTE ] B: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T17:29:05.520487] [INFO ] [REMOTE ] B: Full fetch complete (44169 records). [2025-09-17T17:29:05.520621] [DEBUG] [VALIDATOR ] B: Validating primary data. [2025-09-17T17:29:05.745950] [WARN ] [VALIDATOR ] B: Validation failed - insufficient historical data. Have 128 unique days, need 200 days [2025-09-17T17:29:05.746482] [FATAL] [MAIN ] B: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:29:05.746535] [WARN ] [MAIN ] B: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:29:05.746582] [INFO ] [LOCAL ] B: Starting deletion of primary data. [2025-09-17T17:29:05.746682] [DEBUG] [LOCAL ] B: No primary data file found to delete. [2025-09-17T17:29:05.746742] [INFO ] [LOCAL ] B: Starting deletion of derivative data. [2025-09-17T17:29:05.746813] [DEBUG] [LOCAL ] B: No derivative data file found to delete. [2025-09-17T17:29:05.746899] [INFO ] [MAIN ] Update Progress: 204/2371 symbols completed. B took 35.7s. Estimated remaining: 5h 8m 44s. Rate: 7.0 symbols/min [2025-09-17T17:29:05.919713] [INFO ] [MAIN ] BAH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:29:05.976793] [DEBUG] [LOCAL ] BAH: Loaded 51820 existing records from primary storage. [2025-09-17T17:29:05.976983] [INFO ] [MAIN ] BAH: Loaded 51820 existing records. [2025-09-17T17:29:06.039948] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-02. [2025-09-17T17:29:06.155231] [WARN ] [MAIN ] BAH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:29:06.155448] [INFO ] [MAIN ] BAH: Wiping existing primary data before full refresh. [2025-09-17T17:29:06.155500] [INFO ] [LOCAL ] BAH: Starting deletion of primary data. [2025-09-17T17:29:06.156820] [DEBUG] [LOCAL ] BAH: Deleted primary data file. [2025-09-17T17:29:06.156870] [INFO ] [MAIN ] BAH: Starting full primary refresh. [2025-09-17T17:29:06.517511] [INFO ] [REMOTE ] BAH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:29:06.815776] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-11. [2025-09-17T17:29:07.025688] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-01 (2.60 seconds). [2025-09-17T17:29:07.620887] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-02. [2025-09-17T17:29:07.644889] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-17T17:29:08.057536] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T17:29:08.407624] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T17:29:08.417540] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-01. [2025-09-17T17:29:09.215789] [INFO ] [REMOTE ] BAH: Fetching primary data for 2024-12. [2025-09-17T17:29:10.015805] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-03. [2025-09-17T17:29:10.191451] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-17T17:29:10.690158] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-17T17:29:10.815772] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-03. [2025-09-17T17:29:10.938244] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T17:29:11.615817] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-02. [2025-09-17T17:29:12.415817] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-01. [2025-09-17T17:29:12.454020] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-03 (2.44 seconds). [2025-09-17T17:29:13.215768] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-04. [2025-09-17T17:29:13.534206] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-17T17:29:13.582849] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T17:29:14.015818] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-04. [2025-09-17T17:29:14.232053] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T17:29:14.815778] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-02. [2025-09-17T17:29:15.615761] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-03. [2025-09-17T17:29:15.763926] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-17T17:29:16.379337] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T17:29:16.415730] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-03. [2025-09-17T17:29:16.924676] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-04 (2.91 seconds). [2025-09-17T17:29:17.215805] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-05. [2025-09-17T17:29:17.872425] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-17T17:29:18.015810] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-04. [2025-09-17T17:29:18.222870] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T17:29:18.815838] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-04. [2025-09-17T17:29:19.448593] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-17T17:29:19.615743] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-06. [2025-09-17T17:29:20.195702] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-17T17:29:20.385239] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T17:29:20.415770] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-05. [2025-09-17T17:29:21.215780] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-05. [2025-09-17T17:29:21.863592] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T17:29:22.015753] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-07. [2025-09-17T17:29:22.820858] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-05. [2025-09-17T17:29:22.837224] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-17T17:29:23.615882] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-06. [2025-09-17T17:29:23.728858] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-17T17:29:24.339503] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-17T17:29:24.415817] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-06. [2025-09-17T17:29:24.495627] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T17:29:25.215845] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-08. [2025-09-17T17:29:25.990597] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-17T17:29:26.015745] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-07. [2025-09-17T17:29:26.815807] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-06. [2025-09-17T17:29:26.920533] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-17T17:29:27.067681] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T17:29:27.615787] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-07. [2025-09-17T17:29:28.286421] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-17T17:29:28.326947] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T17:29:28.415798] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-07. [2025-09-17T17:29:29.215866] [INFO ] [REMOTE ] BA: Fetching primary data for 2025-09. [2025-09-17T17:29:30.015813] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-08. [2025-09-17T17:29:30.240005] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T17:29:30.370924] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-07 (2.76 seconds). [2025-09-17T17:29:30.815769] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-08. [2025-09-17T17:29:31.615844] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-08. [2025-09-17T17:29:31.668443] [INFO ] [REMOTE ] BA: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-17T17:29:31.675420] [INFO ] [REMOTE ] BA: Full fetch complete (77904 records). [2025-09-17T17:29:31.675551] [DEBUG] [VALIDATOR ] BA: Validating primary data. [2025-09-17T17:29:32.112259] [DEBUG] [VALIDATOR ] BA: All expected trading days are present. [2025-09-17T17:29:32.112399] [DEBUG] [VALIDATOR ] BA: Primary data validation passed. [2025-09-17T17:29:32.113297] [INFO ] [MAIN ] BA: Fetched primary data is valid. [2025-09-17T17:29:32.113374] [DEBUG] [LOCAL ] BA: Saving primary data. [2025-09-17T17:29:32.115176] [DEBUG] [LOCAL ] BA: Trimmed 77904 records to 53791 (keeping 200 days of data) [2025-09-17T17:29:32.374167] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T17:29:32.416740] [INFO ] [REMOTE ] BAC: Fetching primary data for 2025-09. [2025-09-17T17:29:32.510044] [DEBUG] [LOCAL ] BA: Primary data saved (53791 records). [2025-09-17T17:29:32.510257] [INFO ] [MAIN ] BA: Full history saved. [2025-09-17T17:29:32.511048] [INFO ] [MAIN ] Update Progress: 205/2371 symbols completed. BA took 40.4s. Estimated remaining: 5h 11m 48s. Rate: 6.9 symbols/min [2025-09-17T17:29:32.684741] [INFO ] [MAIN ] BAK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:29:32.726139] [DEBUG] [LOCAL ] BAK: Loaded 38907 existing records from primary storage. [2025-09-17T17:29:32.726294] [INFO ] [MAIN ] BAK: Loaded 38907 existing records. [2025-09-17T17:29:32.879162] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T17:29:32.952774] [WARN ] [MAIN ] BAK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:29:32.953039] [INFO ] [MAIN ] BAK: Wiping existing primary data before full refresh. [2025-09-17T17:29:32.953086] [INFO ] [LOCAL ] BAK: Starting deletion of primary data. [2025-09-17T17:29:32.954969] [DEBUG] [LOCAL ] BAK: Deleted primary data file. [2025-09-17T17:29:32.955022] [INFO ] [MAIN ] BAK: Starting full primary refresh. [2025-09-17T17:29:33.223931] [INFO ] [REMOTE ] BAH: Fetching primary data for 2025-09. [2025-09-17T17:29:33.313990] [INFO ] [REMOTE ] BAK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:29:34.015819] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-11. [2025-09-17T17:29:34.364896] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-08 (2.75 seconds). [2025-09-17T17:29:34.550848] [INFO ] [REMOTE ] BAH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T17:29:34.557738] [INFO ] [REMOTE ] BAH: Full fetch complete (74629 records). [2025-09-17T17:29:34.557883] [DEBUG] [VALIDATOR ] BAH: Validating primary data. [2025-09-17T17:29:34.820551] [INFO ] [REMOTE ] BABA: Fetching primary data for 2025-09. [2025-09-17T17:29:34.942516] [INFO ] [REMOTE ] BAC: Incremental fetch complete for 2025-09 (2.53 seconds). [2025-09-17T17:29:34.989039] [DEBUG] [VALIDATOR ] BAH: All expected trading days are present. [2025-09-17T17:29:34.989307] [DEBUG] [VALIDATOR ] BAH: Primary data validation passed. [2025-09-17T17:29:34.990077] [INFO ] [MAIN ] BAH: Fetched primary data is valid. [2025-09-17T17:29:34.990131] [DEBUG] [LOCAL ] BAH: Saving primary data. [2025-09-17T17:29:34.990322] [INFO ] [REMOTE ] BAC: Full fetch complete (77933 records). [2025-09-17T17:29:34.990715] [DEBUG] [VALIDATOR ] BAC: Validating primary data. [2025-09-17T17:29:34.992053] [DEBUG] [LOCAL ] BAH: Trimmed 74629 records to 51794 (keeping 200 days of data) [2025-09-17T17:29:35.557074] [DEBUG] [VALIDATOR ] BAC: All expected trading days are present. [2025-09-17T17:29:35.557433] [DEBUG] [VALIDATOR ] BAC: Primary data validation passed. [2025-09-17T17:29:35.558616] [INFO ] [MAIN ] BAC: Fetched primary data is valid. [2025-09-17T17:29:35.558956] [DEBUG] [LOCAL ] BAC: Saving primary data. [2025-09-17T17:29:35.563693] [DEBUG] [LOCAL ] BAC: Trimmed 77933 records to 53808 (keeping 200 days of data) [2025-09-17T17:29:35.586146] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T17:29:35.650783] [INFO ] [REMOTE ] BAK: Fetching primary data for 2024-12. [2025-09-17T17:29:36.048336] [DEBUG] [LOCAL ] BAH: Primary data saved (51794 records). [2025-09-17T17:29:36.049791] [INFO ] [MAIN ] BAH: Full history saved. [2025-09-17T17:29:36.051506] [INFO ] [MAIN ] Update Progress: 206/2371 symbols completed. BAH took 30.3s. Estimated remaining: 5h 10m 46s. Rate: 7.0 symbols/min [2025-09-17T17:29:36.289038] [INFO ] [MAIN ] BALL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:29:36.314460] [DEBUG] [LOCAL ] BAC: Primary data saved (53808 records). [2025-09-17T17:29:36.314606] [INFO ] [MAIN ] BAC: Full history saved. [2025-09-17T17:29:36.315812] [INFO ] [MAIN ] Update Progress: 207/2371 symbols completed. BAC took 35.7s. Estimated remaining: 5h 9m 10s. Rate: 7.0 symbols/min [2025-09-17T17:29:36.516014] [INFO ] [MAIN ] BALY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:29:36.517117] [DEBUG] [LOCAL ] BALY: No existing data file found in primary storage. [2025-09-17T17:29:36.517040] [DEBUG] [LOCAL ] BALL: Loaded 51856 existing records from primary storage. [2025-09-17T17:29:36.517263] [INFO ] [MAIN ] BALL: Loaded 51856 existing records. [2025-09-17T17:29:36.517199] [WARN ] [MAIN ] BALY: No existing data found, performing full refresh instead. [2025-09-17T17:29:36.580819] [INFO ] [MAIN ] BALY: Wiping existing primary data before full refresh. [2025-09-17T17:29:36.592287] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-17T17:29:36.615853] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-17T17:29:36.618014] [INFO ] [MAIN ] BALY: Starting full primary refresh. [2025-09-17T17:29:36.835884] [WARN ] [MAIN ] BALL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:29:36.936669] [INFO ] [MAIN ] BALL: Wiping existing primary data before full refresh. [2025-09-17T17:29:36.948404] [INFO ] [LOCAL ] BALL: Starting deletion of primary data. [2025-09-17T17:29:36.980668] [DEBUG] [LOCAL ] BALL: Deleted primary data file. [2025-09-17T17:29:36.985858] [INFO ] [MAIN ] BALL: Starting full primary refresh. [2025-09-17T17:29:37.096130] [INFO ] [REMOTE ] BALY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:29:37.117808] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-11. [2025-09-17T17:29:37.450915] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T17:29:37.449487] [INFO ] [REMOTE ] BALL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:29:37.451309] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-11. [2025-09-17T17:29:37.606706] [INFO ] [REMOTE ] BABA: Incremental fetch complete for 2025-09 (2.79 seconds). [2025-09-17T17:29:37.613523] [INFO ] [REMOTE ] BABA: Full fetch complete (77980 records). [2025-09-17T17:29:37.613636] [DEBUG] [VALIDATOR ] BABA: Validating primary data. [2025-09-17T17:29:38.001852] [DEBUG] [VALIDATOR ] BABA: All expected trading days are present. [2025-09-17T17:29:38.001940] [DEBUG] [VALIDATOR ] BABA: Primary data validation passed. [2025-09-17T17:29:38.002714] [INFO ] [MAIN ] BABA: Fetched primary data is valid. [2025-09-17T17:29:38.002814] [DEBUG] [LOCAL ] BABA: Saving primary data. [2025-09-17T17:29:38.004276] [DEBUG] [LOCAL ] BABA: Trimmed 77980 records to 53820 (keeping 200 days of data) [2025-09-17T17:29:38.066131] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-01. [2025-09-17T17:29:38.345671] [DEBUG] [LOCAL ] BABA: Primary data saved (53820 records). [2025-09-17T17:29:38.345812] [INFO ] [MAIN ] BABA: Full history saved. [2025-09-17T17:29:38.345906] [INFO ] [MAIN ] Update Progress: 208/2371 symbols completed. BABA took 43.0s. Estimated remaining: 5h 7m 53s. Rate: 7.0 symbols/min [2025-09-17T17:29:38.515782] [INFO ] [MAIN ] BAM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:29:38.537265] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T17:29:38.596123] [DEBUG] [LOCAL ] BAM: Loaded 52019 existing records from primary storage. [2025-09-17T17:29:38.596264] [INFO ] [MAIN ] BAM: Loaded 52019 existing records. [2025-09-17T17:29:38.772829] [WARN ] [MAIN ] BAM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:29:38.773148] [INFO ] [MAIN ] BAM: Wiping existing primary data before full refresh. [2025-09-17T17:29:38.773271] [INFO ] [LOCAL ] BAM: Starting deletion of primary data. [2025-09-17T17:29:38.774718] [DEBUG] [LOCAL ] BAM: Deleted primary data file. [2025-09-17T17:29:38.774772] [INFO ] [MAIN ] BAM: Starting full primary refresh. [2025-09-17T17:29:38.817499] [INFO ] [REMOTE ] BALY: Fetching primary data for 2024-12. [2025-09-17T17:29:39.157800] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T17:29:39.161732] [INFO ] [REMOTE ] BAM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:29:39.615699] [INFO ] [REMOTE ] BALL: Fetching primary data for 2024-12. [2025-09-17T17:29:39.869317] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T17:29:40.022938] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T17:29:40.415781] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-01. [2025-09-17T17:29:41.104254] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T17:29:41.215701] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-01. [2025-09-17T17:29:41.234308] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T17:29:42.015795] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-02. [2025-09-17T17:29:42.815801] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-02. [2025-09-17T17:29:42.950396] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T17:29:42.981597] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T17:29:43.431436] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T17:29:43.615771] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-03. [2025-09-17T17:29:44.415792] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-11. [2025-09-17T17:29:44.997334] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T17:29:45.215766] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-04. [2025-09-17T17:29:46.015739] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-02. [2025-09-17T17:29:46.123785] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T17:29:46.815799] [INFO ] [REMOTE ] BAM: Fetching primary data for 2024-12. [2025-09-17T17:29:46.843846] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T17:29:47.615738] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-05. [2025-09-17T17:29:47.733477] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T17:29:47.942227] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T17:29:48.415814] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-03. [2025-09-17T17:29:49.031191] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T17:29:49.194033] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T17:29:49.215761] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-04. [2025-09-17T17:29:49.715964] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T17:29:50.015779] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-05. [2025-09-17T17:29:50.705063] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T17:29:50.815784] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-03. [2025-09-17T17:29:51.615790] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-06. [2025-09-17T17:29:52.233837] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T17:29:52.415773] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-01. [2025-09-17T17:29:52.635724] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T17:29:53.215802] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-07. [2025-09-17T17:29:54.001310] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T17:29:54.020919] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-04. [2025-09-17T17:29:54.033352] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T17:29:54.815773] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-08. [2025-09-17T17:29:55.429745] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T17:29:55.615809] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-06. [2025-09-17T17:29:55.807197] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T17:29:56.415867] [INFO ] [REMOTE ] BALY: Fetching primary data for 2025-09. [2025-09-17T17:29:57.149680] [INFO ] [REMOTE ] BALY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T17:29:57.151541] [INFO ] [REMOTE ] BALY: Full fetch complete (17730 records). [2025-09-17T17:29:57.151829] [DEBUG] [VALIDATOR ] BALY: Validating primary data. [2025-09-17T17:29:57.220964] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-02. [2025-09-17T17:29:57.373417] [WARN ] [VALIDATOR ] BALY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T17:29:57.377934] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T17:29:57.379155] [FATAL] [MAIN ] BALY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:29:57.387406] [WARN ] [MAIN ] BALY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:29:57.388055] [INFO ] [LOCAL ] BALY: Starting deletion of primary data. [2025-09-17T17:29:57.388628] [DEBUG] [LOCAL ] BALY: No primary data file found to delete. [2025-09-17T17:29:57.388815] [INFO ] [LOCAL ] BALY: Starting deletion of derivative data. [2025-09-17T17:29:57.388881] [DEBUG] [LOCAL ] BALY: No derivative data file found to delete. [2025-09-17T17:29:57.388970] [INFO ] [MAIN ] Update Progress: 209/2371 symbols completed. BALY took 21.1s. Estimated remaining: 5h 9m 34s. Rate: 7.0 symbols/min [2025-09-17T17:29:57.588340] [INFO ] [MAIN ] BANC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:29:57.645279] [DEBUG] [LOCAL ] BANC: Loaded 51263 existing records from primary storage. [2025-09-17T17:29:57.645441] [INFO ] [MAIN ] BANC: Loaded 51263 existing records. [2025-09-17T17:29:57.826056] [WARN ] [MAIN ] BANC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:29:57.826395] [INFO ] [MAIN ] BANC: Wiping existing primary data before full refresh. [2025-09-17T17:29:57.826458] [INFO ] [LOCAL ] BANC: Starting deletion of primary data. [2025-09-17T17:29:57.828520] [DEBUG] [LOCAL ] BANC: Deleted primary data file. [2025-09-17T17:29:57.828596] [INFO ] [MAIN ] BANC: Starting full primary refresh. [2025-09-17T17:29:58.016700] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-05. [2025-09-17T17:29:58.201273] [INFO ] [REMOTE ] BANC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:29:58.746287] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T17:29:58.815730] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-03. [2025-09-17T17:29:59.615784] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-07. [2025-09-17T17:29:59.909824] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T17:30:00.415839] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-06. [2025-09-17T17:30:00.509052] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T17:30:01.167709] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T17:30:01.215747] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-08. [2025-09-17T17:30:02.015814] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-04. [2025-09-17T17:30:02.062475] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:30:02.457416] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T17:30:02.815829] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-11. [2025-09-17T17:30:03.446101] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T17:30:03.615791] [INFO ] [REMOTE ] BAK: Fetching primary data for 2025-09. [2025-09-17T17:30:04.415813] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-05. [2025-09-17T17:30:04.688200] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T17:30:05.137931] [INFO ] [REMOTE ] BAK: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T17:30:05.143098] [INFO ] [REMOTE ] BAK: Full fetch complete (57028 records). [2025-09-17T17:30:05.143303] [DEBUG] [VALIDATOR ] BAK: Validating primary data. [2025-09-17T17:30:05.221713] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-07. [2025-09-17T17:30:05.531811] [DEBUG] [VALIDATOR ] BAK: All expected trading days are present. [2025-09-17T17:30:05.531891] [DEBUG] [VALIDATOR ] BAK: Primary data validation passed. [2025-09-17T17:30:05.532485] [INFO ] [MAIN ] BAK: Fetched primary data is valid. [2025-09-17T17:30:05.532544] [DEBUG] [LOCAL ] BAK: Saving primary data. [2025-09-17T17:30:05.537412] [DEBUG] [LOCAL ] BAK: Trimmed 57028 records to 38862 (keeping 200 days of data) [2025-09-17T17:30:05.759089] [DEBUG] [LOCAL ] BAK: Primary data saved (38862 records). [2025-09-17T17:30:05.759297] [INFO ] [MAIN ] BAK: Full history saved. [2025-09-17T17:30:05.760114] [INFO ] [MAIN ] Update Progress: 210/2371 symbols completed. BAK took 33.2s. Estimated remaining: 5h 9m 23s. Rate: 7.0 symbols/min [2025-09-17T17:30:05.928892] [INFO ] [MAIN ] BAP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:30:05.957177] [DEBUG] [LOCAL ] BAP: Loaded 26418 existing records from primary storage. [2025-09-17T17:30:05.957321] [INFO ] [MAIN ] BAP: Loaded 26418 existing records. [2025-09-17T17:30:06.020976] [INFO ] [REMOTE ] BANC: Fetching primary data for 2024-12. [2025-09-17T17:30:06.141622] [WARN ] [MAIN ] BAP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:30:06.141924] [INFO ] [MAIN ] BAP: Wiping existing primary data before full refresh. [2025-09-17T17:30:06.141972] [INFO ] [LOCAL ] BAP: Starting deletion of primary data. [2025-09-17T17:30:06.142985] [DEBUG] [LOCAL ] BAP: Deleted primary data file. [2025-09-17T17:30:06.143052] [INFO ] [MAIN ] BAP: Starting full primary refresh. [2025-09-17T17:30:06.449048] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T17:30:06.547166] [INFO ] [REMOTE ] BAP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:30:06.815781] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-11. [2025-09-17T17:30:07.380055] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-17T17:30:07.615832] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-08. [2025-09-17T17:30:07.669268] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T17:30:07.990367] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T17:30:08.415734] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-01. [2025-09-17T17:30:09.215844] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-06. [2025-09-17T17:30:09.346441] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T17:30:09.781700] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T17:30:10.015830] [INFO ] [REMOTE ] BAP: Fetching primary data for 2024-12. [2025-09-17T17:30:10.630368] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T17:30:10.815812] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-02. [2025-09-17T17:30:11.314854] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T17:30:11.615858] [INFO ] [REMOTE ] BALL: Fetching primary data for 2025-09. [2025-09-17T17:30:11.975352] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T17:30:12.415779] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-03. [2025-09-17T17:30:13.215802] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-01. [2025-09-17T17:30:13.422300] [INFO ] [REMOTE ] BALL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T17:30:13.428913] [INFO ] [REMOTE ] BALL: Full fetch complete (75158 records). [2025-09-17T17:30:13.429020] [DEBUG] [VALIDATOR ] BALL: Validating primary data. [2025-09-17T17:30:13.820941] [DEBUG] [VALIDATOR ] BALL: All expected trading days are present. [2025-09-17T17:30:13.821018] [DEBUG] [VALIDATOR ] BALL: Primary data validation passed. [2025-09-17T17:30:13.822170] [INFO ] [MAIN ] BALL: Fetched primary data is valid. [2025-09-17T17:30:13.822217] [DEBUG] [LOCAL ] BALL: Saving primary data. [2025-09-17T17:30:13.824104] [DEBUG] [LOCAL ] BALL: Trimmed 75158 records to 51854 (keeping 200 days of data) [2025-09-17T17:30:14.015836] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-07. [2025-09-17T17:30:14.172563] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T17:30:14.190276] [DEBUG] [LOCAL ] BALL: Primary data saved (51854 records). [2025-09-17T17:30:14.190404] [INFO ] [MAIN ] BALL: Full history saved. [2025-09-17T17:30:14.191103] [INFO ] [MAIN ] Update Progress: 211/2371 symbols completed. BALL took 38.1s. Estimated remaining: 5h 9m 12s. Rate: 7.0 symbols/min [2025-09-17T17:30:14.362263] [INFO ] [MAIN ] BARK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:30:14.403483] [DEBUG] [LOCAL ] BARK: Loaded 38682 existing records from primary storage. [2025-09-17T17:30:14.403618] [INFO ] [MAIN ] BARK: Loaded 38682 existing records. [2025-09-17T17:30:14.602329] [WARN ] [MAIN ] BARK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:30:14.604427] [INFO ] [MAIN ] BARK: Wiping existing primary data before full refresh. [2025-09-17T17:30:14.605049] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-17T17:30:14.605546] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T17:30:14.610999] [DEBUG] [LOCAL ] BARK: Deleted primary data file. [2025-09-17T17:30:14.611548] [INFO ] [MAIN ] BARK: Starting full primary refresh. [2025-09-17T17:30:14.820966] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-02. [2025-09-17T17:30:14.967846] [INFO ] [REMOTE ] BARK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:30:15.615812] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-11. [2025-09-17T17:30:15.963063] [DEBUG] [REMOTE ] BARK: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-17T17:30:15.963470] [WARN ] [REMOTE ] BARK: No data returned for month 2024-11 [2025-09-17T17:30:16.043393] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T17:30:16.090717] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T17:30:16.415867] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-04. [2025-09-17T17:30:17.215830] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-03. [2025-09-17T17:30:18.015877] [INFO ] [REMOTE ] BARK: Fetching primary data for 2024-12. [2025-09-17T17:30:18.294982] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T17:30:18.668689] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T17:30:18.815791] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-04. [2025-09-17T17:30:19.615786] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-08. [2025-09-17T17:30:19.740555] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T17:30:20.182626] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T17:30:20.415788] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-01. [2025-09-17T17:30:21.215810] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-05. [2025-09-17T17:30:21.295867] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T17:30:21.875802] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T17:30:22.015798] [INFO ] [REMOTE ] BAM: Fetching primary data for 2025-09. [2025-09-17T17:30:22.815782] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-02. [2025-09-17T17:30:22.955864] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T17:30:23.615834] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-06. [2025-09-17T17:30:23.734423] [INFO ] [REMOTE ] BAM: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T17:30:23.741314] [INFO ] [REMOTE ] BAM: Full fetch complete (73680 records). [2025-09-17T17:30:23.741498] [DEBUG] [VALIDATOR ] BAM: Validating primary data. [2025-09-17T17:30:24.152274] [DEBUG] [VALIDATOR ] BAM: All expected trading days are present. [2025-09-17T17:30:24.152430] [DEBUG] [VALIDATOR ] BAM: Primary data validation passed. [2025-09-17T17:30:24.153233] [INFO ] [MAIN ] BAM: Fetched primary data is valid. [2025-09-17T17:30:24.153377] [DEBUG] [LOCAL ] BAM: Saving primary data. [2025-09-17T17:30:24.177985] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T17:30:24.185761] [DEBUG] [LOCAL ] BAM: Trimmed 73680 records to 52019 (keeping 200 days of data) [2025-09-17T17:30:24.424694] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-05. [2025-09-17T17:30:24.602141] [DEBUG] [LOCAL ] BAM: Primary data saved (52019 records). [2025-09-17T17:30:24.602333] [INFO ] [MAIN ] BAM: Full history saved. [2025-09-17T17:30:24.602472] [INFO ] [MAIN ] Update Progress: 212/2371 symbols completed. BAM took 46.3s. Estimated remaining: 5h 9m 22s. Rate: 7.0 symbols/min [2025-09-17T17:30:24.799550] [INFO ] [MAIN ] BAX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:30:24.853969] [DEBUG] [LOCAL ] BAX: Loaded 53491 existing records from primary storage. [2025-09-17T17:30:24.854175] [INFO ] [MAIN ] BAX: Loaded 53491 existing records. [2025-09-17T17:30:25.034846] [WARN ] [MAIN ] BAX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:30:25.035140] [INFO ] [MAIN ] BAX: Wiping existing primary data before full refresh. [2025-09-17T17:30:25.035187] [INFO ] [LOCAL ] BAX: Starting deletion of primary data. [2025-09-17T17:30:25.036629] [DEBUG] [LOCAL ] BAX: Deleted primary data file. [2025-09-17T17:30:25.036697] [INFO ] [MAIN ] BAX: Starting full primary refresh. [2025-09-17T17:30:25.221061] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-03. [2025-09-17T17:30:25.402784] [INFO ] [REMOTE ] BAX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:30:25.436316] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T17:30:25.696154] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T17:30:26.015780] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-06. [2025-09-17T17:30:26.815853] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-11. [2025-09-17T17:30:26.902965] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T17:30:27.236799] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T17:30:27.615788] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-04. [2025-09-17T17:30:28.415715] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-07. [2025-09-17T17:30:28.690048] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T17:30:29.015581] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T17:30:29.215768] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-07. [2025-09-17T17:30:29.633393] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T17:30:30.015783] [INFO ] [REMOTE ] BAX: Fetching primary data for 2024-12. [2025-09-17T17:30:30.815825] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-05. [2025-09-17T17:30:31.272293] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T17:30:31.615769] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-08. [2025-09-17T17:30:31.852781] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T17:30:32.083542] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-17T17:30:32.415770] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-01. [2025-09-17T17:30:33.162214] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T17:30:33.215773] [INFO ] [REMOTE ] BANC: Fetching primary data for 2025-09. [2025-09-17T17:30:33.759095] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T17:30:34.015774] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-08. [2025-09-17T17:30:34.815780] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-06. [2025-09-17T17:30:35.064076] [INFO ] [REMOTE ] BANC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T17:30:35.072407] [INFO ] [REMOTE ] BANC: Full fetch complete (73868 records). [2025-09-17T17:30:35.072570] [DEBUG] [VALIDATOR ] BANC: Validating primary data. [2025-09-17T17:30:35.231329] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T17:30:35.486745] [DEBUG] [VALIDATOR ] BANC: All expected trading days are present. [2025-09-17T17:30:35.486826] [DEBUG] [VALIDATOR ] BANC: Primary data validation passed. [2025-09-17T17:30:35.487554] [INFO ] [MAIN ] BANC: Fetched primary data is valid. [2025-09-17T17:30:35.487598] [DEBUG] [LOCAL ] BANC: Saving primary data. [2025-09-17T17:30:35.489002] [DEBUG] [LOCAL ] BANC: Trimmed 73868 records to 51275 (keeping 200 days of data) [2025-09-17T17:30:35.615970] [INFO ] [REMOTE ] BAP: Fetching primary data for 2025-09. [2025-09-17T17:30:35.815793] [DEBUG] [LOCAL ] BANC: Primary data saved (51275 records). [2025-09-17T17:30:35.815934] [INFO ] [MAIN ] BANC: Full history saved. [2025-09-17T17:30:35.816685] [INFO ] [MAIN ] Update Progress: 213/2371 symbols completed. BANC took 38.4s. Estimated remaining: 5h 9m 40s. Rate: 7.0 symbols/min [2025-09-17T17:30:35.987185] [INFO ] [MAIN ] BB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:30:36.039539] [DEBUG] [LOCAL ] BB: Loaded 52930 existing records from primary storage. [2025-09-17T17:30:36.039726] [INFO ] [MAIN ] BB: Loaded 52930 existing records. [2025-09-17T17:30:36.216426] [WARN ] [MAIN ] BB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:30:36.216708] [INFO ] [MAIN ] BB: Wiping existing primary data before full refresh. [2025-09-17T17:30:36.216759] [INFO ] [LOCAL ] BB: Starting deletion of primary data. [2025-09-17T17:30:36.218029] [DEBUG] [LOCAL ] BB: Deleted primary data file. [2025-09-17T17:30:36.218082] [INFO ] [MAIN ] BB: Starting full primary refresh. [2025-09-17T17:30:36.423734] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-02. [2025-09-17T17:30:36.585145] [INFO ] [REMOTE ] BB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:30:36.614668] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T17:30:37.084948] [INFO ] [REMOTE ] BAP: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T17:30:37.089698] [INFO ] [REMOTE ] BAP: Full fetch complete (38095 records). [2025-09-17T17:30:37.089804] [DEBUG] [VALIDATOR ] BAP: Validating primary data. [2025-09-17T17:30:37.220880] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-11. [2025-09-17T17:30:37.481136] [DEBUG] [VALIDATOR ] BAP: All expected trading days are present. [2025-09-17T17:30:37.481218] [DEBUG] [VALIDATOR ] BAP: Primary data validation passed. [2025-09-17T17:30:37.481691] [INFO ] [MAIN ] BAP: Fetched primary data is valid. [2025-09-17T17:30:37.481734] [DEBUG] [LOCAL ] BAP: Saving primary data. [2025-09-17T17:30:37.482687] [DEBUG] [LOCAL ] BAP: Trimmed 38095 records to 26470 (keeping 200 days of data) [2025-09-17T17:30:37.650534] [DEBUG] [LOCAL ] BAP: Primary data saved (26470 records). [2025-09-17T17:30:37.650682] [INFO ] [MAIN ] BAP: Full history saved. [2025-09-17T17:30:37.650779] [INFO ] [MAIN ] Update Progress: 214/2371 symbols completed. BAP took 31.9s. Estimated remaining: 5h 8m 23s. Rate: 7.0 symbols/min [2025-09-17T17:30:37.821356] [INFO ] [MAIN ] BBAI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:30:37.874663] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-17T17:30:37.874803] [INFO ] [MAIN ] BBAI: Loaded 53820 existing records. [2025-09-17T17:30:38.026329] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-07. [2025-09-17T17:30:38.067521] [WARN ] [MAIN ] BBAI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:30:38.068850] [INFO ] [MAIN ] BBAI: Wiping existing primary data before full refresh. [2025-09-17T17:30:38.068954] [INFO ] [LOCAL ] BBAI: Starting deletion of primary data. [2025-09-17T17:30:38.069824] [DEBUG] [LOCAL ] BBAI: Deleted primary data file. [2025-09-17T17:30:38.069872] [INFO ] [MAIN ] BBAI: Starting full primary refresh. [2025-09-17T17:30:38.434970] [INFO ] [REMOTE ] BBAI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:30:38.462564] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-17T17:30:38.815791] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-03. [2025-09-17T17:30:39.334555] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-17T17:30:39.591554] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T17:30:39.615742] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-08. [2025-09-17T17:30:40.415754] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-11. [2025-09-17T17:30:40.614125] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T17:30:41.053372] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T17:30:41.215775] [INFO ] [REMOTE ] BARK: Fetching primary data for 2025-09. [2025-09-17T17:30:42.015774] [INFO ] [REMOTE ] BB: Fetching primary data for 2024-12. [2025-09-17T17:30:42.488032] [INFO ] [REMOTE ] BARK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T17:30:42.492658] [INFO ] [REMOTE ] BARK: Full fetch complete (56720 records). [2025-09-17T17:30:42.492783] [DEBUG] [VALIDATOR ] BARK: Validating primary data. [2025-09-17T17:30:42.687066] [WARN ] [VALIDATOR ] BARK: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T17:30:42.687732] [FATAL] [MAIN ] BARK: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:30:42.687824] [WARN ] [MAIN ] BARK: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:30:42.687893] [INFO ] [LOCAL ] BARK: Starting deletion of primary data. [2025-09-17T17:30:42.687968] [DEBUG] [LOCAL ] BARK: No primary data file found to delete. [2025-09-17T17:30:42.688011] [INFO ] [LOCAL ] BARK: Starting deletion of derivative data. [2025-09-17T17:30:42.688399] [DEBUG] [LOCAL ] BARK: Deleted derivative data file. [2025-09-17T17:30:42.688925] [INFO ] [MAIN ] Update Progress: 215/2371 symbols completed. BARK took 28.5s. Estimated remaining: 5h 7m 39s. Rate: 7.0 symbols/min [2025-09-17T17:30:42.818088] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-04. [2025-09-17T17:30:42.866030] [INFO ] [MAIN ] BBAR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:30:42.899591] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-11 (2.48 seconds). [2025-09-17T17:30:42.947467] [DEBUG] [LOCAL ] BBAR: Loaded 40983 existing records from primary storage. [2025-09-17T17:30:42.947615] [INFO ] [MAIN ] BBAR: Loaded 40983 existing records. [2025-09-17T17:30:43.131483] [WARN ] [MAIN ] BBAR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:30:43.131746] [INFO ] [MAIN ] BBAR: Wiping existing primary data before full refresh. [2025-09-17T17:30:43.131793] [INFO ] [LOCAL ] BBAR: Starting deletion of primary data. [2025-09-17T17:30:43.132774] [DEBUG] [LOCAL ] BBAR: Deleted primary data file. [2025-09-17T17:30:43.132822] [INFO ] [MAIN ] BBAR: Starting full primary refresh. [2025-09-17T17:30:43.514747] [INFO ] [REMOTE ] BBAR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:30:43.615727] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-11. [2025-09-17T17:30:43.960477] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T17:30:44.415788] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-01. [2025-09-17T17:30:44.819034] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T17:30:44.897688] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T17:30:45.215805] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2024-12. [2025-09-17T17:30:46.015790] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2024-12. [2025-09-17T17:30:46.387533] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T17:30:46.787860] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T17:30:46.815729] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-01. [2025-09-17T17:30:47.615778] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-02. [2025-09-17T17:30:48.415789] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-05. [2025-09-17T17:30:48.647915] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T17:30:48.778733] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2024-12 (2.76 seconds). [2025-09-17T17:30:49.215810] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-02. [2025-09-17T17:30:49.850109] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-17T17:30:50.015805] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-03. [2025-09-17T17:30:50.292927] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T17:30:50.616920] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T17:30:50.815824] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-03. [2025-09-17T17:30:51.615791] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-06. [2025-09-17T17:30:51.812177] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T17:30:51.889254] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T17:30:52.415818] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-01. [2025-09-17T17:30:53.215884] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-04. [2025-09-17T17:30:53.393320] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T17:30:54.015832] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-04. [2025-09-17T17:30:54.510448] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T17:30:54.815822] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-07. [2025-09-17T17:30:55.117366] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-01 (2.70 seconds). [2025-09-17T17:30:55.615792] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-02. [2025-09-17T17:30:55.872139] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T17:30:56.415811] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-05. [2025-09-17T17:30:56.758250] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T17:30:57.215783] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-05. [2025-09-17T17:30:57.776405] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-17T17:30:58.015768] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-03. [2025-09-17T17:30:58.317724] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T17:30:58.815839] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-08. [2025-09-17T17:30:59.042052] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T17:30:59.615838] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-06. [2025-09-17T17:31:00.194528] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T17:31:00.253556] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T17:31:00.415778] [INFO ] [REMOTE ] BAX: Fetching primary data for 2025-09. [2025-09-17T17:31:00.779467] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T17:31:01.215816] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-04. [2025-09-17T17:31:02.015805] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-07. [2025-09-17T17:31:02.203338] [INFO ] [REMOTE ] BAX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T17:31:02.210196] [INFO ] [REMOTE ] BAX: Full fetch complete (77273 records). [2025-09-17T17:31:02.210320] [DEBUG] [VALIDATOR ] BAX: Validating primary data. [2025-09-17T17:31:02.635758] [DEBUG] [VALIDATOR ] BAX: All expected trading days are present. [2025-09-17T17:31:02.635851] [DEBUG] [VALIDATOR ] BAX: Primary data validation passed. [2025-09-17T17:31:02.636617] [INFO ] [MAIN ] BAX: Fetched primary data is valid. [2025-09-17T17:31:02.636682] [DEBUG] [LOCAL ] BAX: Saving primary data. [2025-09-17T17:31:02.638454] [DEBUG] [LOCAL ] BAX: Trimmed 77273 records to 53489 (keeping 200 days of data) [2025-09-17T17:31:02.820391] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-06. [2025-09-17T17:31:02.972877] [DEBUG] [LOCAL ] BAX: Primary data saved (53489 records). [2025-09-17T17:31:02.973038] [INFO ] [MAIN ] BAX: Full history saved. [2025-09-17T17:31:02.973123] [INFO ] [MAIN ] Update Progress: 216/2371 symbols completed. BAX took 38.4s. Estimated remaining: 5h 9m 28s. Rate: 7.0 symbols/min [2025-09-17T17:31:03.149192] [INFO ] [MAIN ] BBD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:31:03.202007] [DEBUG] [LOCAL ] BBD: Loaded 53176 existing records from primary storage. [2025-09-17T17:31:03.202157] [INFO ] [MAIN ] BBD: Loaded 53176 existing records. [2025-09-17T17:31:03.397855] [WARN ] [MAIN ] BBD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:31:03.398237] [INFO ] [MAIN ] BBD: Wiping existing primary data before full refresh. [2025-09-17T17:31:03.398317] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-17T17:31:03.399788] [DEBUG] [LOCAL ] BBD: Deleted primary data file. [2025-09-17T17:31:03.399842] [INFO ] [MAIN ] BBD: Starting full primary refresh. [2025-09-17T17:31:03.775305] [INFO ] [REMOTE ] BBD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:31:03.775840] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-11. [2025-09-17T17:31:03.852471] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T17:31:03.864614] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-04 (2.65 seconds). [2025-09-17T17:31:04.415783] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-05. [2025-09-17T17:31:04.866008] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-17T17:31:05.215823] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-08. [2025-09-17T17:31:05.601259] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T17:31:06.015835] [INFO ] [REMOTE ] BBD: Fetching primary data for 2024-12. [2025-09-17T17:31:06.392031] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T17:31:06.815805] [INFO ] [REMOTE ] BBAR: Fetching primary data for 2025-09. [2025-09-17T17:31:07.373238] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-05 (2.96 seconds). [2025-09-17T17:31:07.615841] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-06. [2025-09-17T17:31:07.831734] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T17:31:08.390477] [INFO ] [REMOTE ] BBAR: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T17:31:08.396499] [INFO ] [REMOTE ] BBAR: Full fetch complete (60174 records). [2025-09-17T17:31:08.396597] [DEBUG] [VALIDATOR ] BBAR: Validating primary data. [2025-09-17T17:31:08.427783] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-07. [2025-09-17T17:31:08.786770] [DEBUG] [VALIDATOR ] BBAR: All expected trading days are present. [2025-09-17T17:31:08.786848] [DEBUG] [VALIDATOR ] BBAR: Primary data validation passed. [2025-09-17T17:31:08.787470] [INFO ] [MAIN ] BBAR: Fetched primary data is valid. [2025-09-17T17:31:08.787511] [DEBUG] [LOCAL ] BBAR: Saving primary data. [2025-09-17T17:31:08.788679] [DEBUG] [LOCAL ] BBAR: Trimmed 60174 records to 40968 (keeping 200 days of data) [2025-09-17T17:31:09.038886] [DEBUG] [LOCAL ] BBAR: Primary data saved (40968 records). [2025-09-17T17:31:09.039016] [INFO ] [MAIN ] BBAR: Full history saved. [2025-09-17T17:31:09.039611] [INFO ] [MAIN ] Update Progress: 217/2371 symbols completed. BBAR took 26.4s. Estimated remaining: 5h 8m 54s. Rate: 7.0 symbols/min [2025-09-17T17:31:09.208354] [INFO ] [MAIN ] BBDC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:31:09.215776] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-01. [2025-09-17T17:31:09.243487] [DEBUG] [LOCAL ] BBDC: Loaded 33544 existing records from primary storage. [2025-09-17T17:31:09.243610] [INFO ] [MAIN ] BBDC: Loaded 33544 existing records. [2025-09-17T17:31:09.419829] [WARN ] [MAIN ] BBDC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:31:09.420069] [INFO ] [MAIN ] BBDC: Wiping existing primary data before full refresh. [2025-09-17T17:31:09.420114] [INFO ] [LOCAL ] BBDC: Starting deletion of primary data. [2025-09-17T17:31:09.420813] [DEBUG] [LOCAL ] BBDC: Deleted primary data file. [2025-09-17T17:31:09.420867] [INFO ] [MAIN ] BBDC: Starting full primary refresh. [2025-09-17T17:31:09.801687] [INFO ] [REMOTE ] BBDC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:31:09.885050] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-17T17:31:10.015776] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-07. [2025-09-17T17:31:10.319299] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T17:31:10.815820] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-11. [2025-09-17T17:31:10.972900] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T17:31:11.615807] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-08. [2025-09-17T17:31:12.235636] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T17:31:12.415739] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-02. [2025-09-17T17:31:12.506632] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-17T17:31:13.215806] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2024-12. [2025-09-17T17:31:13.693033] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T17:31:13.946539] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T17:31:14.015794] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-08. [2025-09-17T17:31:14.679515] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T17:31:14.815782] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-01. [2025-09-17T17:31:15.615784] [INFO ] [REMOTE ] BB: Fetching primary data for 2025-09. [2025-09-17T17:31:15.765346] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T17:31:16.328782] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-17T17:31:16.415817] [INFO ] [REMOTE ] BBAI: Fetching primary data for 2025-09. [2025-09-17T17:31:17.215776] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-02. [2025-09-17T17:31:17.829003] [INFO ] [REMOTE ] BB: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-17T17:31:17.835875] [INFO ] [REMOTE ] BB: Full fetch complete (76851 records). [2025-09-17T17:31:17.836009] [DEBUG] [VALIDATOR ] BB: Validating primary data. [2025-09-17T17:31:18.020919] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-03. [2025-09-17T17:31:18.255154] [DEBUG] [VALIDATOR ] BB: All expected trading days are present. [2025-09-17T17:31:18.255241] [DEBUG] [VALIDATOR ] BB: Primary data validation passed. [2025-09-17T17:31:18.256049] [INFO ] [MAIN ] BB: Fetched primary data is valid. [2025-09-17T17:31:18.256097] [DEBUG] [LOCAL ] BB: Saving primary data. [2025-09-17T17:31:18.257540] [DEBUG] [LOCAL ] BB: Trimmed 76851 records to 52925 (keeping 200 days of data) [2025-09-17T17:31:18.582877] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T17:31:18.601733] [DEBUG] [LOCAL ] BB: Primary data saved (52925 records). [2025-09-17T17:31:18.601858] [INFO ] [MAIN ] BB: Full history saved. [2025-09-17T17:31:18.603200] [INFO ] [MAIN ] Update Progress: 218/2371 symbols completed. BB took 42.8s. Estimated remaining: 5h 8m 55s. Rate: 7.0 symbols/min [2025-09-17T17:31:18.778805] [INFO ] [MAIN ] BBDO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:31:18.791618] [DEBUG] [LOCAL ] BBDO: Loaded 5109 existing records from primary storage. [2025-09-17T17:31:18.791760] [INFO ] [MAIN ] BBDO: Loaded 5109 existing records. [2025-09-17T17:31:18.822785] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-03. [2025-09-17T17:31:18.971936] [WARN ] [MAIN ] BBDO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:31:18.972225] [INFO ] [MAIN ] BBDO: Wiping existing primary data before full refresh. [2025-09-17T17:31:18.972295] [INFO ] [LOCAL ] BBDO: Starting deletion of primary data. [2025-09-17T17:31:18.972927] [DEBUG] [LOCAL ] BBDO: Deleted primary data file. [2025-09-17T17:31:18.972994] [INFO ] [MAIN ] BBDO: Starting full primary refresh. [2025-09-17T17:31:19.324984] [INFO ] [REMOTE ] BBDO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:31:19.362316] [INFO ] [REMOTE ] BBAI: Incremental fetch complete for 2025-09 (2.95 seconds). [2025-09-17T17:31:19.371181] [INFO ] [REMOTE ] BBAI: Full fetch complete (77974 records). [2025-09-17T17:31:19.371310] [DEBUG] [VALIDATOR ] BBAI: Validating primary data. [2025-09-17T17:31:19.630459] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-11. [2025-09-17T17:31:19.776926] [DEBUG] [VALIDATOR ] BBAI: All expected trading days are present. [2025-09-17T17:31:19.777011] [DEBUG] [VALIDATOR ] BBAI: Primary data validation passed. [2025-09-17T17:31:19.777871] [INFO ] [MAIN ] BBAI: Fetched primary data is valid. [2025-09-17T17:31:19.777937] [DEBUG] [LOCAL ] BBAI: Saving primary data. [2025-09-17T17:31:19.779490] [DEBUG] [LOCAL ] BBAI: Trimmed 77974 records to 53820 (keeping 200 days of data) [2025-09-17T17:31:20.026600] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T17:31:20.070225] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T17:31:20.171514] [DEBUG] [LOCAL ] BBAI: Primary data saved (53820 records). [2025-09-17T17:31:20.171706] [INFO ] [MAIN ] BBAI: Full history saved. [2025-09-17T17:31:20.172433] [INFO ] [MAIN ] Update Progress: 219/2371 symbols completed. BBAI took 42.5s. Estimated remaining: 5h 7m 37s. Rate: 7.0 symbols/min [2025-09-17T17:31:20.283603] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T17:31:20.361370] [INFO ] [MAIN ] BBN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:31:20.386283] [DEBUG] [LOCAL ] BBN: Loaded 18010 existing records from primary storage. [2025-09-17T17:31:20.386415] [INFO ] [MAIN ] BBN: Loaded 18010 existing records. [2025-09-17T17:31:20.420855] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2024-12. [2025-09-17T17:31:20.573022] [WARN ] [MAIN ] BBN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:31:20.573309] [INFO ] [MAIN ] BBN: Wiping existing primary data before full refresh. [2025-09-17T17:31:20.573355] [INFO ] [LOCAL ] BBN: Starting deletion of primary data. [2025-09-17T17:31:20.574035] [DEBUG] [LOCAL ] BBN: Deleted primary data file. [2025-09-17T17:31:20.574083] [INFO ] [MAIN ] BBN: Starting full primary refresh. [2025-09-17T17:31:20.937033] [INFO ] [REMOTE ] BBN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:31:21.212745] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T17:31:21.215681] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-01. [2025-09-17T17:31:21.757110] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T17:31:22.015773] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-04. [2025-09-17T17:31:22.815793] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-04. [2025-09-17T17:31:23.615793] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-02. [2025-09-17T17:31:23.791841] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T17:31:24.034020] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T17:31:24.391811] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T17:31:24.415731] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-05. [2025-09-17T17:31:25.215805] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-11. [2025-09-17T17:31:25.774950] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T17:31:26.015737] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-03. [2025-09-17T17:31:26.409803] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T17:31:26.654129] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T17:31:26.815803] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-05. [2025-09-17T17:31:27.615857] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-04. [2025-09-17T17:31:28.352258] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T17:31:28.415793] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-06. [2025-09-17T17:31:28.592810] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T17:31:29.215790] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-06. [2025-09-17T17:31:29.425036] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T17:31:30.015815] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-07. [2025-09-17T17:31:30.815860] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-05. [2025-09-17T17:31:31.082238] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T17:31:31.207424] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T17:31:31.542099] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T17:31:31.615802] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-08. [2025-09-17T17:31:32.415736] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-06. [2025-09-17T17:31:32.873605] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T17:31:32.901873] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T17:31:33.215776] [INFO ] [REMOTE ] BBDC: Fetching primary data for 2025-09. [2025-09-17T17:31:34.015775] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-07. [2025-09-17T17:31:34.511286] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T17:31:34.668056] [INFO ] [REMOTE ] BBDC: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T17:31:34.673599] [INFO ] [REMOTE ] BBDC: Full fetch complete (49043 records). [2025-09-17T17:31:34.673823] [DEBUG] [VALIDATOR ] BBDC: Validating primary data. [2025-09-17T17:31:34.828380] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-07. [2025-09-17T17:31:35.085897] [DEBUG] [VALIDATOR ] BBDC: All expected trading days are present. [2025-09-17T17:31:35.085999] [DEBUG] [VALIDATOR ] BBDC: Primary data validation passed. [2025-09-17T17:31:35.086608] [INFO ] [MAIN ] BBDC: Fetched primary data is valid. [2025-09-17T17:31:35.086678] [DEBUG] [LOCAL ] BBDC: Saving primary data. [2025-09-17T17:31:35.087953] [DEBUG] [LOCAL ] BBDC: Trimmed 49043 records to 33531 (keeping 200 days of data) [2025-09-17T17:31:35.300584] [DEBUG] [LOCAL ] BBDC: Primary data saved (33531 records). [2025-09-17T17:31:35.300784] [INFO ] [MAIN ] BBDC: Full history saved. [2025-09-17T17:31:35.301453] [INFO ] [MAIN ] Update Progress: 220/2371 symbols completed. BBDC took 26.3s. Estimated remaining: 5h 8m 32s. Rate: 7.0 symbols/min [2025-09-17T17:31:35.482561] [INFO ] [MAIN ] BBT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:31:35.482762] [DEBUG] [LOCAL ] BBT: No existing data file found in primary storage. [2025-09-17T17:31:35.482800] [WARN ] [MAIN ] BBT: No existing data found, performing full refresh instead. [2025-09-17T17:31:35.482934] [INFO ] [MAIN ] BBT: Wiping existing primary data before full refresh. [2025-09-17T17:31:35.482975] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-17T17:31:35.483017] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-17T17:31:35.483052] [INFO ] [MAIN ] BBT: Starting full primary refresh. [2025-09-17T17:31:35.624708] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-08. [2025-09-17T17:31:35.850600] [INFO ] [REMOTE ] BBT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:31:36.315110] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T17:31:36.415786] [INFO ] [REMOTE ] BBDO: Fetching primary data for 2025-09. [2025-09-17T17:31:36.759500] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T17:31:37.002969] [INFO ] [REMOTE ] BBDO: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T17:31:37.004388] [INFO ] [REMOTE ] BBDO: Full fetch complete (7942 records). [2025-09-17T17:31:37.004465] [DEBUG] [VALIDATOR ] BBDO: Validating primary data. [2025-09-17T17:31:37.220963] [INFO ] [REMOTE ] BBN: Fetching primary data for 2024-12. [2025-09-17T17:31:37.406217] [DEBUG] [VALIDATOR ] BBDO: All expected trading days are present. [2025-09-17T17:31:37.406339] [DEBUG] [VALIDATOR ] BBDO: Primary data validation passed. [2025-09-17T17:31:37.406571] [INFO ] [MAIN ] BBDO: Fetched primary data is valid. [2025-09-17T17:31:37.406624] [DEBUG] [LOCAL ] BBDO: Saving primary data. [2025-09-17T17:31:37.407059] [DEBUG] [LOCAL ] BBDO: Trimmed 7942 records to 5073 (keeping 200 days of data) [2025-09-17T17:31:37.437286] [DEBUG] [LOCAL ] BBDO: Primary data saved (5073 records). [2025-09-17T17:31:37.437380] [INFO ] [MAIN ] BBDO: Full history saved. [2025-09-17T17:31:37.437460] [INFO ] [MAIN ] Update Progress: 221/2371 symbols completed. BBDO took 18.8s. Estimated remaining: 5h 7m 21s. Rate: 7.0 symbols/min [2025-09-17T17:31:37.604755] [INFO ] [MAIN ] BBU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:31:37.611276] [DEBUG] [LOCAL ] BBU: Loaded 4015 existing records from primary storage. [2025-09-17T17:31:37.611371] [INFO ] [MAIN ] BBU: Loaded 4015 existing records. [2025-09-17T17:31:37.785506] [WARN ] [MAIN ] BBU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:31:37.785735] [INFO ] [MAIN ] BBU: Wiping existing primary data before full refresh. [2025-09-17T17:31:37.785780] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-17T17:31:37.786003] [DEBUG] [LOCAL ] BBU: Deleted primary data file. [2025-09-17T17:31:37.786046] [INFO ] [MAIN ] BBU: Starting full primary refresh. [2025-09-17T17:31:38.025630] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-08. [2025-09-17T17:31:38.142170] [INFO ] [REMOTE ] BBU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:31:38.319769] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T17:31:38.815783] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-01. [2025-09-17T17:31:39.448719] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T17:31:39.609907] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T17:31:39.620221] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-02. [2025-09-17T17:31:40.415782] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-11. [2025-09-17T17:31:40.549575] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T17:31:41.101607] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T17:31:41.215770] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-03. [2025-09-17T17:31:42.015769] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-11. [2025-09-17T17:31:42.139547] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T17:31:42.299542] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:31:42.299942] [WARN ] [REMOTE ] BBT: No data returned for month 2024-11 [2025-09-17T17:31:42.815772] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-04. [2025-09-17T17:31:43.615801] [INFO ] [REMOTE ] BBU: Fetching primary data for 2024-12. [2025-09-17T17:31:43.787381] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T17:31:44.187096] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T17:31:44.415777] [INFO ] [REMOTE ] BBD: Fetching primary data for 2025-09. [2025-09-17T17:31:45.215832] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-01. [2025-09-17T17:31:45.798076] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T17:31:46.015776] [INFO ] [REMOTE ] BBT: Fetching primary data for 2024-12. [2025-09-17T17:31:46.198331] [INFO ] [REMOTE ] BBD: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T17:31:46.204994] [INFO ] [REMOTE ] BBD: Full fetch complete (76618 records). [2025-09-17T17:31:46.205170] [DEBUG] [VALIDATOR ] BBD: Validating primary data. [2025-09-17T17:31:46.206943] [FATAL] [VALIDATOR ] BBD: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:31:46.207067] [FATAL] [MAIN ] BBD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:31:46.207106] [WARN ] [MAIN ] BBD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:31:46.207153] [INFO ] [LOCAL ] BBD: Starting deletion of primary data. [2025-09-17T17:31:46.207216] [DEBUG] [LOCAL ] BBD: No primary data file found to delete. [2025-09-17T17:31:46.207253] [INFO ] [LOCAL ] BBD: Starting deletion of derivative data. [2025-09-17T17:31:46.207597] [DEBUG] [LOCAL ] BBD: Deleted derivative data file. [2025-09-17T17:31:46.207734] [INFO ] [MAIN ] Update Progress: 222/2371 symbols completed. BBD took 43.2s. Estimated remaining: 5h 7m 14s. Rate: 7.0 symbols/min [2025-09-17T17:31:46.254098] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:31:46.304807] [WARN ] [REMOTE ] BBT: No data returned for month 2024-12 [2025-09-17T17:31:46.388786] [INFO ] [MAIN ] BBUC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:31:46.402968] [DEBUG] [LOCAL ] BBUC: Loaded 13185 existing records from primary storage. [2025-09-17T17:31:46.403110] [INFO ] [MAIN ] BBUC: Loaded 13185 existing records. [2025-09-17T17:31:46.583509] [WARN ] [MAIN ] BBUC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:31:46.583814] [INFO ] [MAIN ] BBUC: Wiping existing primary data before full refresh. [2025-09-17T17:31:46.583860] [INFO ] [LOCAL ] BBUC: Starting deletion of primary data. [2025-09-17T17:31:46.585503] [DEBUG] [LOCAL ] BBUC: Deleted primary data file. [2025-09-17T17:31:46.585560] [INFO ] [MAIN ] BBUC: Starting full primary refresh. [2025-09-17T17:31:46.823766] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-05. [2025-09-17T17:31:46.951039] [INFO ] [REMOTE ] BBUC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:31:47.615743] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-02. [2025-09-17T17:31:47.935666] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T17:31:48.169897] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T17:31:48.415802] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-01. [2025-09-17T17:31:48.611489] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:31:48.611824] [WARN ] [REMOTE ] BBT: No data returned for month 2025-01 [2025-09-17T17:31:49.215785] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-03. [2025-09-17T17:31:49.680635] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T17:31:50.015786] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-11. [2025-09-17T17:31:50.815786] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-02. [2025-09-17T17:31:50.876328] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T17:31:51.025125] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:31:51.025424] [WARN ] [REMOTE ] BBT: No data returned for month 2025-02 [2025-09-17T17:31:51.615810] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2024-12. [2025-09-17T17:31:52.284935] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T17:31:52.415750] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-01. [2025-09-17T17:31:52.892503] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T17:31:53.215794] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-03. [2025-09-17T17:31:53.415336] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:31:53.415706] [WARN ] [REMOTE ] BBT: No data returned for month 2025-03 [2025-09-17T17:31:54.015791] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-06. [2025-09-17T17:31:54.815834] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-04. [2025-09-17T17:31:55.223163] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T17:31:55.279821] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T17:31:55.615792] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-02. [2025-09-17T17:31:56.371615] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T17:31:56.415738] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-03. [2025-09-17T17:31:57.215805] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-07. [2025-09-17T17:31:57.455749] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T17:31:57.974927] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T17:31:58.015785] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-05. [2025-09-17T17:31:58.533114] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-05 (0.52 seconds). [2025-09-17T17:31:58.815773] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-06. [2025-09-17T17:31:59.123975] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-17T17:31:59.615826] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-08. [2025-09-17T17:32:00.415783] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-04. [2025-09-17T17:32:00.770997] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T17:32:01.215778] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-07. [2025-09-17T17:32:01.464849] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T17:32:01.684514] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T17:32:02.015788] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-05. [2025-09-17T17:32:02.815858] [INFO ] [REMOTE ] BBN: Fetching primary data for 2025-09. [2025-09-17T17:32:02.934737] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T17:32:03.615793] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-06. [2025-09-17T17:32:03.760627] [INFO ] [REMOTE ] BBN: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T17:32:03.763897] [INFO ] [REMOTE ] BBN: Full fetch complete (26994 records). [2025-09-17T17:32:03.764041] [DEBUG] [VALIDATOR ] BBN: Validating primary data. [2025-09-17T17:32:04.136189] [DEBUG] [VALIDATOR ] BBN: All expected trading days are present. [2025-09-17T17:32:04.136267] [DEBUG] [VALIDATOR ] BBN: Primary data validation passed. [2025-09-17T17:32:04.136632] [INFO ] [MAIN ] BBN: Fetched primary data is valid. [2025-09-17T17:32:04.136688] [DEBUG] [LOCAL ] BBN: Saving primary data. [2025-09-17T17:32:04.138145] [DEBUG] [LOCAL ] BBN: Trimmed 26994 records to 18050 (keeping 200 days of data) [2025-09-17T17:32:04.255497] [DEBUG] [LOCAL ] BBN: Primary data saved (18050 records). [2025-09-17T17:32:04.255667] [INFO ] [MAIN ] BBN: Full history saved. [2025-09-17T17:32:04.255755] [INFO ] [MAIN ] Update Progress: 223/2371 symbols completed. BBN took 44.1s. Estimated remaining: 5h 8m 37s. Rate: 7.0 symbols/min [2025-09-17T17:32:04.310255] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T17:32:04.420847] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-07. [2025-09-17T17:32:04.445708] [INFO ] [MAIN ] BBVA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:32:04.493267] [DEBUG] [LOCAL ] BBVA: Loaded 49642 existing records from primary storage. [2025-09-17T17:32:04.493409] [INFO ] [MAIN ] BBVA: Loaded 49642 existing records. [2025-09-17T17:32:04.677815] [WARN ] [MAIN ] BBVA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:32:04.678106] [INFO ] [MAIN ] BBVA: Wiping existing primary data before full refresh. [2025-09-17T17:32:04.678166] [INFO ] [LOCAL ] BBVA: Starting deletion of primary data. [2025-09-17T17:32:04.680618] [DEBUG] [LOCAL ] BBVA: Deleted primary data file. [2025-09-17T17:32:04.680700] [INFO ] [MAIN ] BBVA: Starting full primary refresh. [2025-09-17T17:32:05.051059] [INFO ] [REMOTE ] BBVA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:32:05.215798] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-04. [2025-09-17T17:32:05.334361] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T17:32:05.427152] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:32:05.427464] [WARN ] [REMOTE ] BBT: No data returned for month 2025-04 [2025-09-17T17:32:06.015820] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-11. [2025-09-17T17:32:06.815778] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-05. [2025-09-17T17:32:07.014537] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:32:07.014854] [WARN ] [REMOTE ] BBT: No data returned for month 2025-05 [2025-09-17T17:32:07.338994] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T17:32:07.615790] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2024-12. [2025-09-17T17:32:08.415810] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-08. [2025-09-17T17:32:09.088944] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T17:32:09.182927] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T17:32:09.215764] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-01. [2025-09-17T17:32:10.015805] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-06. [2025-09-17T17:32:10.261058] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:32:10.261390] [WARN ] [REMOTE ] BBT: No data returned for month 2025-06 [2025-09-17T17:32:10.815766] [INFO ] [REMOTE ] BBUC: Fetching primary data for 2025-09. [2025-09-17T17:32:11.302118] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-17T17:32:11.534486] [INFO ] [REMOTE ] BBUC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T17:32:11.536532] [INFO ] [REMOTE ] BBUC: Full fetch complete (17128 records). [2025-09-17T17:32:11.536605] [DEBUG] [VALIDATOR ] BBUC: Validating primary data. [2025-09-17T17:32:11.620927] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-02. [2025-09-17T17:32:11.937139] [DEBUG] [VALIDATOR ] BBUC: All expected trading days are present. [2025-09-17T17:32:11.937222] [DEBUG] [VALIDATOR ] BBUC: Primary data validation passed. [2025-09-17T17:32:11.937540] [INFO ] [MAIN ] BBUC: Fetched primary data is valid. [2025-09-17T17:32:11.937579] [DEBUG] [LOCAL ] BBUC: Saving primary data. [2025-09-17T17:32:11.938154] [DEBUG] [LOCAL ] BBUC: Trimmed 17128 records to 13228 (keeping 200 days of data) [2025-09-17T17:32:12.021765] [DEBUG] [LOCAL ] BBUC: Primary data saved (13228 records). [2025-09-17T17:32:12.021912] [INFO ] [MAIN ] BBUC: Full history saved. [2025-09-17T17:32:12.021998] [INFO ] [MAIN ] Update Progress: 224/2371 symbols completed. BBUC took 25.8s. Estimated remaining: 5h 8m 20s. Rate: 7.0 symbols/min [2025-09-17T17:32:12.189221] [INFO ] [MAIN ] BBW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:32:12.214924] [DEBUG] [LOCAL ] BBW: Loaded 26342 existing records from primary storage. [2025-09-17T17:32:12.215063] [INFO ] [MAIN ] BBW: Loaded 26342 existing records. [2025-09-17T17:32:12.390345] [WARN ] [MAIN ] BBW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:32:12.390613] [INFO ] [MAIN ] BBW: Wiping existing primary data before full refresh. [2025-09-17T17:32:12.390688] [INFO ] [LOCAL ] BBW: Starting deletion of primary data. [2025-09-17T17:32:12.392210] [DEBUG] [LOCAL ] BBW: Deleted primary data file. [2025-09-17T17:32:12.392264] [INFO ] [MAIN ] BBW: Starting full primary refresh. [2025-09-17T17:32:12.422628] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-08. [2025-09-17T17:32:12.769398] [INFO ] [REMOTE ] BBW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:32:13.221117] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-07. [2025-09-17T17:32:13.234273] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T17:32:13.366058] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T17:32:13.872947] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:32:13.873343] [WARN ] [REMOTE ] BBT: No data returned for month 2025-07 [2025-09-17T17:32:14.015781] [INFO ] [REMOTE ] BBU: Fetching primary data for 2025-09. [2025-09-17T17:32:14.692759] [INFO ] [REMOTE ] BBU: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T17:32:14.694003] [INFO ] [REMOTE ] BBU: Full fetch complete (5959 records). [2025-09-17T17:32:14.694101] [DEBUG] [VALIDATOR ] BBU: Validating primary data. [2025-09-17T17:32:14.694487] [FATAL] [VALIDATOR ] BBU: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:32:14.694561] [FATAL] [MAIN ] BBU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:32:14.694603] [WARN ] [MAIN ] BBU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:32:14.694685] [INFO ] [LOCAL ] BBU: Starting deletion of primary data. [2025-09-17T17:32:14.694760] [DEBUG] [LOCAL ] BBU: No primary data file found to delete. [2025-09-17T17:32:14.694846] [INFO ] [LOCAL ] BBU: Starting deletion of derivative data. [2025-09-17T17:32:14.695168] [DEBUG] [LOCAL ] BBU: Deleted derivative data file. [2025-09-17T17:32:14.695257] [INFO ] [MAIN ] Update Progress: 225/2371 symbols completed. BBU took 37.3s. Estimated remaining: 5h 7m 15s. Rate: 7.0 symbols/min [2025-09-17T17:32:14.820869] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-08. [2025-09-17T17:32:14.872952] [INFO ] [MAIN ] BBWI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:32:14.930633] [DEBUG] [LOCAL ] BBWI: Loaded 53573 existing records from primary storage. [2025-09-17T17:32:14.930823] [INFO ] [MAIN ] BBWI: Loaded 53573 existing records. [2025-09-17T17:32:15.070301] [DEBUG] [REMOTE ] BBT: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:32:15.119430] [WARN ] [REMOTE ] BBT: No data returned for month 2025-08 [2025-09-17T17:32:15.124797] [WARN ] [MAIN ] BBWI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:32:15.125615] [INFO ] [MAIN ] BBWI: Wiping existing primary data before full refresh. [2025-09-17T17:32:15.125694] [INFO ] [LOCAL ] BBWI: Starting deletion of primary data. [2025-09-17T17:32:15.128344] [DEBUG] [LOCAL ] BBWI: Deleted primary data file. [2025-09-17T17:32:15.128413] [INFO ] [MAIN ] BBWI: Starting full primary refresh. [2025-09-17T17:32:15.492605] [INFO ] [REMOTE ] BBWI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:32:15.615792] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-03. [2025-09-17T17:32:16.415821] [INFO ] [REMOTE ] BBT: Fetching primary data for 2025-09. [2025-09-17T17:32:17.215776] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-11. [2025-09-17T17:32:17.626345] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T17:32:17.762974] [INFO ] [REMOTE ] BBT: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T17:32:17.768250] [INFO ] [REMOTE ] BBT: Full fetch complete (3698 records). [2025-09-17T17:32:17.768320] [DEBUG] [VALIDATOR ] BBT: Validating primary data. [2025-09-17T17:32:17.949672] [WARN ] [VALIDATOR ] BBT: Validation failed - insufficient historical data. Have 12 unique days, need 200 days [2025-09-17T17:32:17.949894] [FATAL] [MAIN ] BBT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:32:17.949944] [WARN ] [MAIN ] BBT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:32:17.949987] [INFO ] [LOCAL ] BBT: Starting deletion of primary data. [2025-09-17T17:32:17.950057] [DEBUG] [LOCAL ] BBT: No primary data file found to delete. [2025-09-17T17:32:17.950096] [INFO ] [LOCAL ] BBT: Starting deletion of derivative data. [2025-09-17T17:32:17.950135] [DEBUG] [LOCAL ] BBT: No derivative data file found to delete. [2025-09-17T17:32:17.950209] [INFO ] [MAIN ] Update Progress: 226/2371 symbols completed. BBT took 42.6s. Estimated remaining: 5h 6m 15s. Rate: 7.0 symbols/min [2025-09-17T17:32:18.022188] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-04. [2025-09-17T17:32:18.130306] [INFO ] [MAIN ] BBY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:32:18.144782] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T17:32:18.201379] [DEBUG] [LOCAL ] BBY: Loaded 53485 existing records from primary storage. [2025-09-17T17:32:18.201527] [INFO ] [MAIN ] BBY: Loaded 53485 existing records. [2025-09-17T17:32:18.379609] [WARN ] [MAIN ] BBY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:32:18.379916] [INFO ] [MAIN ] BBY: Wiping existing primary data before full refresh. [2025-09-17T17:32:18.379964] [INFO ] [LOCAL ] BBY: Starting deletion of primary data. [2025-09-17T17:32:18.382071] [DEBUG] [LOCAL ] BBY: Deleted primary data file. [2025-09-17T17:32:18.382127] [INFO ] [MAIN ] BBY: Starting full primary refresh. [2025-09-17T17:32:18.738341] [INFO ] [REMOTE ] BBY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:32:18.815760] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-11. [2025-09-17T17:32:19.451085] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T17:32:19.615869] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-11. [2025-09-17T17:32:20.423680] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-05. [2025-09-17T17:32:20.445993] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T17:32:21.215790] [INFO ] [REMOTE ] BBY: Fetching primary data for 2024-12. [2025-09-17T17:32:21.472027] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T17:32:22.015816] [INFO ] [REMOTE ] BBW: Fetching primary data for 2024-12. [2025-09-17T17:32:22.056251] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T17:32:22.815766] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-06. [2025-09-17T17:32:23.153659] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T17:32:23.189287] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T17:32:23.615799] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-01. [2025-09-17T17:32:24.415796] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-01. [2025-09-17T17:32:24.530238] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T17:32:25.215767] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2024-12. [2025-09-17T17:32:25.344428] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T17:32:25.751519] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T17:32:26.015830] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-02. [2025-09-17T17:32:26.815830] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-02. [2025-09-17T17:32:26.964329] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T17:32:27.170760] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T17:32:27.615786] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-07. [2025-09-17T17:32:28.415780] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-03. [2025-09-17T17:32:28.490047] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T17:32:29.215819] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-03. [2025-09-17T17:32:29.381800] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T17:32:29.890412] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T17:32:30.015827] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-01. [2025-09-17T17:32:30.815766] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-08. [2025-09-17T17:32:31.108826] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T17:32:31.615788] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-04. [2025-09-17T17:32:31.766772] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T17:32:32.205433] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T17:32:32.415778] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-02. [2025-09-17T17:32:33.215743] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-04. [2025-09-17T17:32:33.312935] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T17:32:33.933010] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T17:32:34.015778] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-05. [2025-09-17T17:32:34.467250] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T17:32:34.815800] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-03. [2025-09-17T17:32:35.615769] [INFO ] [REMOTE ] BBVA: Fetching primary data for 2025-09. [2025-09-17T17:32:35.904856] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T17:32:36.233772] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T17:32:36.415783] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-04. [2025-09-17T17:32:37.104490] [INFO ] [REMOTE ] BBVA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T17:32:37.111036] [INFO ] [REMOTE ] BBVA: Full fetch complete (71464 records). [2025-09-17T17:32:37.111201] [DEBUG] [VALIDATOR ] BBVA: Validating primary data. [2025-09-17T17:32:37.215729] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-06. [2025-09-17T17:32:37.518358] [DEBUG] [VALIDATOR ] BBVA: All expected trading days are present. [2025-09-17T17:32:37.518459] [DEBUG] [VALIDATOR ] BBVA: Primary data validation passed. [2025-09-17T17:32:37.519272] [INFO ] [MAIN ] BBVA: Fetched primary data is valid. [2025-09-17T17:32:37.519332] [DEBUG] [LOCAL ] BBVA: Saving primary data. [2025-09-17T17:32:37.521007] [DEBUG] [LOCAL ] BBVA: Trimmed 71464 records to 49617 (keeping 200 days of data) [2025-09-17T17:32:37.840742] [DEBUG] [LOCAL ] BBVA: Primary data saved (49617 records). [2025-09-17T17:32:37.840946] [INFO ] [MAIN ] BBVA: Full history saved. [2025-09-17T17:32:37.841817] [INFO ] [MAIN ] Update Progress: 227/2371 symbols completed. BBVA took 33.6s. Estimated remaining: 5h 7m 54s. Rate: 7.0 symbols/min [2025-09-17T17:32:38.016033] [INFO ] [MAIN ] BC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:32:38.016242] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-05. [2025-09-17T17:32:38.061598] [DEBUG] [LOCAL ] BC: Loaded 44798 existing records from primary storage. [2025-09-17T17:32:38.061766] [INFO ] [MAIN ] BC: Loaded 44798 existing records. [2025-09-17T17:32:38.248040] [WARN ] [MAIN ] BC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:32:38.248460] [INFO ] [MAIN ] BC: Wiping existing primary data before full refresh. [2025-09-17T17:32:38.248517] [INFO ] [LOCAL ] BC: Starting deletion of primary data. [2025-09-17T17:32:38.249765] [DEBUG] [LOCAL ] BC: Deleted primary data file. [2025-09-17T17:32:38.249826] [INFO ] [MAIN ] BC: Starting full primary refresh. [2025-09-17T17:32:38.422364] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T17:32:38.682799] [INFO ] [REMOTE ] BC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:32:38.815741] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-05. [2025-09-17T17:32:38.847565] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T17:32:38.890897] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T17:32:39.615800] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-06. [2025-09-17T17:32:40.179698] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T17:32:40.415738] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-06. [2025-09-17T17:32:40.565050] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T17:32:41.215779] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-11. [2025-09-17T17:32:42.015775] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-07. [2025-09-17T17:32:42.476428] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T17:32:42.747154] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T17:32:42.815837] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-07. [2025-09-17T17:32:43.615779] [INFO ] [REMOTE ] BC: Fetching primary data for 2024-12. [2025-09-17T17:32:43.797086] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T17:32:43.841607] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T17:32:44.415875] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-07. [2025-09-17T17:32:44.941546] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T17:32:45.215811] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-08. [2025-09-17T17:32:46.015834] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-01. [2025-09-17T17:32:46.110780] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T17:32:46.250307] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T17:32:46.815813] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-08. [2025-09-17T17:32:47.461092] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T17:32:47.615820] [INFO ] [REMOTE ] BBW: Fetching primary data for 2025-09. [2025-09-17T17:32:48.415793] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-08. [2025-09-17T17:32:48.635896] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T17:32:48.831830] [INFO ] [REMOTE ] BBW: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T17:32:48.836833] [INFO ] [REMOTE ] BBW: Full fetch complete (38965 records). [2025-09-17T17:32:48.836922] [DEBUG] [VALIDATOR ] BBW: Validating primary data. [2025-09-17T17:32:49.217227] [INFO ] [REMOTE ] BBWI: Fetching primary data for 2025-09. [2025-09-17T17:32:49.217620] [DEBUG] [VALIDATOR ] BBW: All expected trading days are present. [2025-09-17T17:32:49.218794] [DEBUG] [VALIDATOR ] BBW: Primary data validation passed. [2025-09-17T17:32:49.219302] [INFO ] [MAIN ] BBW: Fetched primary data is valid. [2025-09-17T17:32:49.219344] [DEBUG] [LOCAL ] BBW: Saving primary data. [2025-09-17T17:32:49.220233] [DEBUG] [LOCAL ] BBW: Trimmed 38965 records to 26466 (keeping 200 days of data) [2025-09-17T17:32:49.386307] [DEBUG] [LOCAL ] BBW: Primary data saved (26466 records). [2025-09-17T17:32:49.386446] [INFO ] [MAIN ] BBW: Full history saved. [2025-09-17T17:32:49.386555] [INFO ] [MAIN ] Update Progress: 228/2371 symbols completed. BBW took 37.4s. Estimated remaining: 5h 8m 13s. Rate: 7.0 symbols/min [2025-09-17T17:32:49.556393] [INFO ] [MAIN ] BCAT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:32:49.593514] [DEBUG] [LOCAL ] BCAT: Loaded 34598 existing records from primary storage. [2025-09-17T17:32:49.593677] [INFO ] [MAIN ] BCAT: Loaded 34598 existing records. [2025-09-17T17:32:49.778350] [WARN ] [MAIN ] BCAT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:32:49.778627] [INFO ] [MAIN ] BCAT: Wiping existing primary data before full refresh. [2025-09-17T17:32:49.778693] [INFO ] [LOCAL ] BCAT: Starting deletion of primary data. [2025-09-17T17:32:49.779626] [DEBUG] [LOCAL ] BCAT: Deleted primary data file. [2025-09-17T17:32:49.779701] [INFO ] [MAIN ] BCAT: Starting full primary refresh. [2025-09-17T17:32:50.022888] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-02. [2025-09-17T17:32:50.142786] [INFO ] [REMOTE ] BCAT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:32:50.186896] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T17:32:50.815769] [INFO ] [REMOTE ] BBY: Fetching primary data for 2025-09. [2025-09-17T17:32:50.912201] [INFO ] [REMOTE ] BBWI: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T17:32:50.919206] [INFO ] [REMOTE ] BBWI: Full fetch complete (77249 records). [2025-09-17T17:32:50.919333] [DEBUG] [VALIDATOR ] BBWI: Validating primary data. [2025-09-17T17:32:51.339091] [DEBUG] [VALIDATOR ] BBWI: All expected trading days are present. [2025-09-17T17:32:51.339412] [DEBUG] [VALIDATOR ] BBWI: Primary data validation passed. [2025-09-17T17:32:51.340367] [INFO ] [MAIN ] BBWI: Fetched primary data is valid. [2025-09-17T17:32:51.358838] [DEBUG] [LOCAL ] BBWI: Saving primary data. [2025-09-17T17:32:51.363302] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T17:32:51.372624] [DEBUG] [LOCAL ] BBWI: Trimmed 77249 records to 53574 (keeping 200 days of data) [2025-09-17T17:32:51.615994] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-11. [2025-09-17T17:32:51.716138] [DEBUG] [LOCAL ] BBWI: Primary data saved (53574 records). [2025-09-17T17:32:51.716294] [INFO ] [MAIN ] BBWI: Full history saved. [2025-09-17T17:32:51.717196] [INFO ] [MAIN ] Update Progress: 229/2371 symbols completed. BBWI took 37.0s. Estimated remaining: 5h 7m 5s. Rate: 7.0 symbols/min [2025-09-17T17:32:51.892552] [INFO ] [MAIN ] BCC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:32:51.924120] [DEBUG] [LOCAL ] BCC: Loaded 28404 existing records from primary storage. [2025-09-17T17:32:51.924266] [INFO ] [MAIN ] BCC: Loaded 28404 existing records. [2025-09-17T17:32:52.110255] [WARN ] [MAIN ] BCC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:32:52.110515] [INFO ] [MAIN ] BCC: Wiping existing primary data before full refresh. [2025-09-17T17:32:52.110562] [INFO ] [LOCAL ] BCC: Starting deletion of primary data. [2025-09-17T17:32:52.112172] [DEBUG] [LOCAL ] BCC: Deleted primary data file. [2025-09-17T17:32:52.112231] [INFO ] [MAIN ] BCC: Starting full primary refresh. [2025-09-17T17:32:52.420886] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-03. [2025-09-17T17:32:52.479724] [INFO ] [REMOTE ] BCC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:32:52.553920] [INFO ] [REMOTE ] BBY: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T17:32:52.560968] [INFO ] [REMOTE ] BBY: Full fetch complete (77119 records). [2025-09-17T17:32:52.561105] [DEBUG] [VALIDATOR ] BBY: Validating primary data. [2025-09-17T17:32:52.974083] [DEBUG] [VALIDATOR ] BBY: All expected trading days are present. [2025-09-17T17:32:52.974429] [DEBUG] [VALIDATOR ] BBY: Primary data validation passed. [2025-09-17T17:32:52.975280] [INFO ] [MAIN ] BBY: Fetched primary data is valid. [2025-09-17T17:32:52.976297] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T17:32:52.976411] [DEBUG] [LOCAL ] BBY: Saving primary data. [2025-09-17T17:32:52.984042] [DEBUG] [LOCAL ] BBY: Trimmed 77119 records to 53487 (keeping 200 days of data) [2025-09-17T17:32:53.217862] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-11. [2025-09-17T17:32:53.315719] [DEBUG] [LOCAL ] BBY: Primary data saved (53487 records). [2025-09-17T17:32:53.315871] [INFO ] [MAIN ] BBY: Full history saved. [2025-09-17T17:32:53.316489] [INFO ] [MAIN ] Update Progress: 230/2371 symbols completed. BBY took 35.4s. Estimated remaining: 5h 5m 51s. Rate: 7.0 symbols/min [2025-09-17T17:32:53.483963] [INFO ] [MAIN ] BCE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:32:53.537148] [DEBUG] [LOCAL ] BCE: Loaded 52381 existing records from primary storage. [2025-09-17T17:32:53.537333] [INFO ] [MAIN ] BCE: Loaded 52381 existing records. [2025-09-17T17:32:53.720936] [WARN ] [MAIN ] BCE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:32:53.721784] [INFO ] [MAIN ] BCE: Wiping existing primary data before full refresh. [2025-09-17T17:32:53.721901] [INFO ] [LOCAL ] BCE: Starting deletion of primary data. [2025-09-17T17:32:53.722972] [DEBUG] [LOCAL ] BCE: Deleted primary data file. [2025-09-17T17:32:53.723086] [INFO ] [MAIN ] BCE: Starting full primary refresh. [2025-09-17T17:32:53.851168] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T17:32:54.021015] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2024-12. [2025-09-17T17:32:54.132209] [INFO ] [REMOTE ] BCE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:32:54.543782] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T17:32:54.815810] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-04. [2025-09-17T17:32:55.460182] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T17:32:55.615757] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-01. [2025-09-17T17:32:56.389118] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T17:32:56.415733] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-05. [2025-09-17T17:32:57.005075] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T17:32:57.215799] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-11. [2025-09-17T17:32:57.969901] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T17:32:58.015831] [INFO ] [REMOTE ] BCC: Fetching primary data for 2024-12. [2025-09-17T17:32:58.815773] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-02. [2025-09-17T17:32:59.026128] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T17:32:59.295322] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T17:32:59.615783] [INFO ] [REMOTE ] BCE: Fetching primary data for 2024-12. [2025-09-17T17:33:00.229814] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T17:33:00.415769] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-01. [2025-09-17T17:33:01.215855] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-06. [2025-09-17T17:33:01.280772] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T17:33:01.738662] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T17:33:02.015959] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-01. [2025-09-17T17:33:02.429666] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T17:33:02.815810] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-02. [2025-09-17T17:33:03.513340] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T17:33:03.615726] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-02. [2025-09-17T17:33:03.748097] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T17:33:04.415839] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-03. [2025-09-17T17:33:05.215784] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-07. [2025-09-17T17:33:05.246678] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T17:33:05.744263] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T17:33:06.015805] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-04. [2025-09-17T17:33:06.641562] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T17:33:06.815807] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-08. [2025-09-17T17:33:07.093947] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T17:33:07.615772] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-03. [2025-09-17T17:33:08.415816] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-03. [2025-09-17T17:33:08.488368] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T17:33:09.057389] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T17:33:09.215790] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-04. [2025-09-17T17:33:10.015815] [INFO ] [REMOTE ] BC: Fetching primary data for 2025-09. [2025-09-17T17:33:10.385153] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T17:33:10.572602] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T17:33:10.815787] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-05. [2025-09-17T17:33:11.545465] [INFO ] [REMOTE ] BC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T17:33:11.550752] [INFO ] [REMOTE ] BC: Full fetch complete (63411 records). [2025-09-17T17:33:11.550894] [DEBUG] [VALIDATOR ] BC: Validating primary data. [2025-09-17T17:33:11.620871] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-05. [2025-09-17T17:33:12.033148] [DEBUG] [VALIDATOR ] BC: All expected trading days are present. [2025-09-17T17:33:12.033352] [DEBUG] [VALIDATOR ] BC: Primary data validation passed. [2025-09-17T17:33:12.034623] [INFO ] [MAIN ] BC: Fetched primary data is valid. [2025-09-17T17:33:12.034844] [DEBUG] [LOCAL ] BC: Saving primary data. [2025-09-17T17:33:12.058820] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T17:33:12.069214] [DEBUG] [LOCAL ] BC: Trimmed 63411 records to 44725 (keeping 200 days of data) [2025-09-17T17:33:12.416400] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-04. [2025-09-17T17:33:12.501128] [DEBUG] [LOCAL ] BC: Primary data saved (44725 records). [2025-09-17T17:33:12.501302] [INFO ] [MAIN ] BC: Full history saved. [2025-09-17T17:33:12.501975] [INFO ] [MAIN ] Update Progress: 231/2371 symbols completed. BC took 34.7s. Estimated remaining: 5h 7m 21s. Rate: 7.0 symbols/min [2025-09-17T17:33:12.731567] [INFO ] [MAIN ] BCH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:33:12.763305] [DEBUG] [LOCAL ] BCH: Loaded 29507 existing records from primary storage. [2025-09-17T17:33:12.763479] [INFO ] [MAIN ] BCH: Loaded 29507 existing records. [2025-09-17T17:33:12.950733] [WARN ] [MAIN ] BCH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:33:12.951029] [INFO ] [MAIN ] BCH: Wiping existing primary data before full refresh. [2025-09-17T17:33:12.951077] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-17T17:33:12.951873] [DEBUG] [LOCAL ] BCH: Deleted primary data file. [2025-09-17T17:33:12.951944] [INFO ] [MAIN ] BCH: Starting full primary refresh. [2025-09-17T17:33:13.224069] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-06. [2025-09-17T17:33:13.372112] [INFO ] [REMOTE ] BCH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:33:13.395804] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T17:33:14.015778] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-06. [2025-09-17T17:33:14.285717] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T17:33:14.523981] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T17:33:14.815770] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-11. [2025-09-17T17:33:15.282318] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T17:33:15.615769] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-07. [2025-09-17T17:33:16.172125] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T17:33:16.415758] [INFO ] [REMOTE ] BCH: Fetching primary data for 2024-12. [2025-09-17T17:33:16.564839] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T17:33:17.215773] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-07. [2025-09-17T17:33:17.700923] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T17:33:18.015765] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-01. [2025-09-17T17:33:18.751170] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T17:33:18.802447] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T17:33:18.815678] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-02. [2025-09-17T17:33:19.615799] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-05. [2025-09-17T17:33:19.971713] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T17:33:20.415793] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-08. [2025-09-17T17:33:21.178171] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T17:33:21.215724] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-06. [2025-09-17T17:33:21.734528] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T17:33:22.015774] [INFO ] [REMOTE ] BCAT: Fetching primary data for 2025-09. [2025-09-17T17:33:22.815726] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-03. [2025-09-17T17:33:22.931517] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T17:33:23.428612] [INFO ] [REMOTE ] BCAT: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T17:33:23.433434] [INFO ] [REMOTE ] BCAT: Full fetch complete (49750 records). [2025-09-17T17:33:23.433529] [DEBUG] [VALIDATOR ] BCAT: Validating primary data. [2025-09-17T17:33:23.647808] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-07. [2025-09-17T17:33:23.853483] [DEBUG] [VALIDATOR ] BCAT: All expected trading days are present. [2025-09-17T17:33:23.853564] [DEBUG] [VALIDATOR ] BCAT: Primary data validation passed. [2025-09-17T17:33:23.854146] [INFO ] [MAIN ] BCAT: Fetched primary data is valid. [2025-09-17T17:33:23.854191] [DEBUG] [LOCAL ] BCAT: Saving primary data. [2025-09-17T17:33:23.855242] [DEBUG] [LOCAL ] BCAT: Trimmed 49750 records to 34660 (keeping 200 days of data) [2025-09-17T17:33:24.069836] [DEBUG] [LOCAL ] BCAT: Primary data saved (34660 records). [2025-09-17T17:33:24.069988] [INFO ] [MAIN ] BCAT: Full history saved. [2025-09-17T17:33:24.070075] [INFO ] [MAIN ] Update Progress: 232/2371 symbols completed. BCAT took 34.7s. Estimated remaining: 5h 7m 40s. Rate: 7.0 symbols/min [2025-09-17T17:33:24.242072] [INFO ] [MAIN ] BCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:33:24.270008] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T17:33:24.302376] [DEBUG] [LOCAL ] BCO: Loaded 26552 existing records from primary storage. [2025-09-17T17:33:24.302545] [INFO ] [MAIN ] BCO: Loaded 26552 existing records. [2025-09-17T17:33:24.418390] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-08. [2025-09-17T17:33:24.497582] [WARN ] [MAIN ] BCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:33:24.497887] [INFO ] [MAIN ] BCO: Wiping existing primary data before full refresh. [2025-09-17T17:33:24.497949] [INFO ] [LOCAL ] BCO: Starting deletion of primary data. [2025-09-17T17:33:24.498809] [DEBUG] [LOCAL ] BCO: Deleted primary data file. [2025-09-17T17:33:24.498869] [INFO ] [MAIN ] BCO: Starting full primary refresh. [2025-09-17T17:33:24.853753] [INFO ] [REMOTE ] BCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:33:25.215792] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-11. [2025-09-17T17:33:25.430771] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T17:33:25.789920] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T17:33:26.015786] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-04. [2025-09-17T17:33:26.449504] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T17:33:26.815777] [INFO ] [REMOTE ] BCO: Fetching primary data for 2024-12. [2025-09-17T17:33:27.456020] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T17:33:27.615766] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-05. [2025-09-17T17:33:27.863768] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T17:33:28.415871] [INFO ] [REMOTE ] BCC: Fetching primary data for 2025-09. [2025-09-17T17:33:28.956995] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T17:33:29.215778] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-08. [2025-09-17T17:33:29.507517] [INFO ] [REMOTE ] BCC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T17:33:29.511562] [INFO ] [REMOTE ] BCC: Full fetch complete (39738 records). [2025-09-17T17:33:29.511710] [DEBUG] [VALIDATOR ] BCC: Validating primary data. [2025-09-17T17:33:29.895271] [DEBUG] [VALIDATOR ] BCC: All expected trading days are present. [2025-09-17T17:33:29.895354] [DEBUG] [VALIDATOR ] BCC: Primary data validation passed. [2025-09-17T17:33:29.895849] [INFO ] [MAIN ] BCC: Fetched primary data is valid. [2025-09-17T17:33:29.895894] [DEBUG] [LOCAL ] BCC: Saving primary data. [2025-09-17T17:33:29.896831] [DEBUG] [LOCAL ] BCC: Trimmed 39738 records to 28375 (keeping 200 days of data) [2025-09-17T17:33:30.017850] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-01. [2025-09-17T17:33:30.082458] [DEBUG] [LOCAL ] BCC: Primary data saved (28375 records). [2025-09-17T17:33:30.082625] [INFO ] [MAIN ] BCC: Full history saved. [2025-09-17T17:33:30.082731] [INFO ] [MAIN ] Update Progress: 233/2371 symbols completed. BCC took 38.4s. Estimated remaining: 5h 7m 7s. Rate: 7.0 symbols/min [2025-09-17T17:33:30.253542] [INFO ] [MAIN ] BCS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:33:30.304597] [DEBUG] [LOCAL ] BCS: Loaded 53480 existing records from primary storage. [2025-09-17T17:33:30.304762] [INFO ] [MAIN ] BCS: Loaded 53480 existing records. [2025-09-17T17:33:30.481628] [WARN ] [MAIN ] BCS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:33:30.481890] [INFO ] [MAIN ] BCS: Wiping existing primary data before full refresh. [2025-09-17T17:33:30.481936] [INFO ] [LOCAL ] BCS: Starting deletion of primary data. [2025-09-17T17:33:30.483053] [DEBUG] [LOCAL ] BCS: Deleted primary data file. [2025-09-17T17:33:30.483104] [INFO ] [MAIN ] BCS: Starting full primary refresh. [2025-09-17T17:33:30.818852] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-06. [2025-09-17T17:33:30.838544] [INFO ] [REMOTE ] BCS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:33:31.000086] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T17:33:31.140678] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T17:33:31.615742] [INFO ] [REMOTE ] BCE: Fetching primary data for 2025-09. [2025-09-17T17:33:32.020554] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T17:33:32.415758] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-02. [2025-09-17T17:33:33.215751] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-07. [2025-09-17T17:33:33.560748] [INFO ] [REMOTE ] BCE: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-17T17:33:33.568137] [INFO ] [REMOTE ] BCE: Full fetch complete (76061 records). [2025-09-17T17:33:33.568350] [DEBUG] [VALIDATOR ] BCE: Validating primary data. [2025-09-17T17:33:33.691362] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T17:33:33.998310] [DEBUG] [VALIDATOR ] BCE: All expected trading days are present. [2025-09-17T17:33:33.998390] [DEBUG] [VALIDATOR ] BCE: Primary data validation passed. [2025-09-17T17:33:33.999209] [INFO ] [MAIN ] BCE: Fetched primary data is valid. [2025-09-17T17:33:33.999258] [DEBUG] [LOCAL ] BCE: Saving primary data. [2025-09-17T17:33:34.000718] [DEBUG] [LOCAL ] BCE: Trimmed 76061 records to 52372 (keeping 200 days of data) [2025-09-17T17:33:34.057043] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-03. [2025-09-17T17:33:34.257252] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T17:33:34.367987] [DEBUG] [LOCAL ] BCE: Primary data saved (52372 records). [2025-09-17T17:33:34.368152] [INFO ] [MAIN ] BCE: Full history saved. [2025-09-17T17:33:34.369037] [INFO ] [MAIN ] Update Progress: 234/2371 symbols completed. BCE took 41.1s. Estimated remaining: 5h 6m 19s. Rate: 7.0 symbols/min [2025-09-17T17:33:34.543936] [INFO ] [MAIN ] BCSF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:33:34.576509] [DEBUG] [LOCAL ] BCSF: Loaded 27938 existing records from primary storage. [2025-09-17T17:33:34.576682] [INFO ] [MAIN ] BCSF: Loaded 27938 existing records. [2025-09-17T17:33:34.771129] [WARN ] [MAIN ] BCSF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:33:34.771441] [INFO ] [MAIN ] BCSF: Wiping existing primary data before full refresh. [2025-09-17T17:33:34.771488] [INFO ] [LOCAL ] BCSF: Starting deletion of primary data. [2025-09-17T17:33:34.772206] [DEBUG] [LOCAL ] BCSF: Deleted primary data file. [2025-09-17T17:33:34.772259] [INFO ] [MAIN ] BCSF: Starting full primary refresh. [2025-09-17T17:33:34.821003] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-08. [2025-09-17T17:33:35.136715] [INFO ] [REMOTE ] BCSF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:33:35.312103] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T17:33:35.615780] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-11. [2025-09-17T17:33:35.712044] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T17:33:36.415823] [INFO ] [REMOTE ] BCH: Fetching primary data for 2025-09. [2025-09-17T17:33:36.997213] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T17:33:37.215773] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2024-12. [2025-09-17T17:33:37.655344] [INFO ] [REMOTE ] BCH: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T17:33:37.659294] [INFO ] [REMOTE ] BCH: Full fetch complete (40321 records). [2025-09-17T17:33:37.659398] [DEBUG] [VALIDATOR ] BCH: Validating primary data. [2025-09-17T17:33:37.660023] [FATAL] [VALIDATOR ] BCH: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:33:37.660104] [FATAL] [MAIN ] BCH: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:33:37.660139] [WARN ] [MAIN ] BCH: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:33:37.660196] [INFO ] [LOCAL ] BCH: Starting deletion of primary data. [2025-09-17T17:33:37.660255] [DEBUG] [LOCAL ] BCH: No primary data file found to delete. [2025-09-17T17:33:37.660289] [INFO ] [LOCAL ] BCH: Starting deletion of derivative data. [2025-09-17T17:33:37.660671] [DEBUG] [LOCAL ] BCH: Deleted derivative data file. [2025-09-17T17:33:37.660759] [INFO ] [MAIN ] Update Progress: 235/2371 symbols completed. BCH took 25.2s. Estimated remaining: 5h 5m 22s. Rate: 7.0 symbols/min [2025-09-17T17:33:37.834806] [INFO ] [MAIN ] BCX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:33:37.855744] [DEBUG] [LOCAL ] BCX: Loaded 22031 existing records from primary storage. [2025-09-17T17:33:37.855875] [INFO ] [MAIN ] BCX: Loaded 22031 existing records. [2025-09-17T17:33:38.033272] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-11. [2025-09-17T17:33:38.038303] [WARN ] [MAIN ] BCX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:33:38.039378] [INFO ] [MAIN ] BCX: Wiping existing primary data before full refresh. [2025-09-17T17:33:38.039518] [INFO ] [LOCAL ] BCX: Starting deletion of primary data. [2025-09-17T17:33:38.040283] [DEBUG] [LOCAL ] BCX: Deleted primary data file. [2025-09-17T17:33:38.040408] [INFO ] [MAIN ] BCX: Starting full primary refresh. [2025-09-17T17:33:38.196666] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T17:33:38.421003] [INFO ] [REMOTE ] BCX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:33:38.815783] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-01. [2025-09-17T17:33:39.615769] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-11. [2025-09-17T17:33:39.841897] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T17:33:39.889559] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T17:33:40.415764] [INFO ] [REMOTE ] BCS: Fetching primary data for 2024-12. [2025-09-17T17:33:40.743499] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T17:33:41.215781] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-02. [2025-09-17T17:33:41.830380] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T17:33:42.015751] [INFO ] [REMOTE ] BCX: Fetching primary data for 2024-12. [2025-09-17T17:33:42.220877] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T17:33:42.815774] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-01. [2025-09-17T17:33:43.291757] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T17:33:43.615780] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-04. [2025-09-17T17:33:44.415765] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-03. [2025-09-17T17:33:44.501620] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T17:33:45.008034] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T17:33:45.215771] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-05. [2025-09-17T17:33:45.504932] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T17:33:46.015756] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-01. [2025-09-17T17:33:46.432556] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T17:33:46.815831] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-04. [2025-09-17T17:33:47.229133] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T17:33:47.615840] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-02. [2025-09-17T17:33:48.385274] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T17:33:48.415749] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-05. [2025-09-17T17:33:49.215737] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-02. [2025-09-17T17:33:49.538024] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T17:33:49.614624] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T17:33:50.015800] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-06. [2025-09-17T17:33:50.031632] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T17:33:50.815828] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-03. [2025-09-17T17:33:50.896084] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T17:33:51.611410] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T17:33:51.616781] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-06. [2025-09-17T17:33:52.415825] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-04. [2025-09-17T17:33:52.801410] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T17:33:53.215795] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-03. [2025-09-17T17:33:53.742504] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T17:33:54.015814] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-05. [2025-09-17T17:33:54.815791] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-07. [2025-09-17T17:33:54.937311] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T17:33:55.048041] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T17:33:55.615814] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-07. [2025-09-17T17:33:55.804120] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T17:33:56.415810] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-08. [2025-09-17T17:33:56.604634] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T17:33:57.215803] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-06. [2025-09-17T17:33:57.658388] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T17:33:58.015802] [INFO ] [REMOTE ] BCO: Fetching primary data for 2025-09. [2025-09-17T17:33:58.356997] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T17:33:58.815760] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-08. [2025-09-17T17:33:59.121739] [INFO ] [REMOTE ] BCO: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T17:33:59.125206] [INFO ] [REMOTE ] BCO: Full fetch complete (36669 records). [2025-09-17T17:33:59.125310] [DEBUG] [VALIDATOR ] BCO: Validating primary data. [2025-09-17T17:33:59.503715] [DEBUG] [VALIDATOR ] BCO: All expected trading days are present. [2025-09-17T17:33:59.503800] [DEBUG] [VALIDATOR ] BCO: Primary data validation passed. [2025-09-17T17:33:59.504258] [INFO ] [MAIN ] BCO: Fetched primary data is valid. [2025-09-17T17:33:59.504300] [DEBUG] [LOCAL ] BCO: Saving primary data. [2025-09-17T17:33:59.505159] [DEBUG] [LOCAL ] BCO: Trimmed 36669 records to 26474 (keeping 200 days of data) [2025-09-17T17:33:59.615843] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-04. [2025-09-17T17:33:59.690859] [DEBUG] [LOCAL ] BCO: Primary data saved (26474 records). [2025-09-17T17:33:59.691003] [INFO ] [MAIN ] BCO: Full history saved. [2025-09-17T17:33:59.691107] [INFO ] [MAIN ] Update Progress: 236/2371 symbols completed. BCO took 35.6s. Estimated remaining: 5h 7m 15s. Rate: 6.9 symbols/min [2025-09-17T17:33:59.863897] [INFO ] [MAIN ] BDC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:33:59.880599] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T17:33:59.909402] [DEBUG] [LOCAL ] BDC: Loaded 25094 existing records from primary storage. [2025-09-17T17:33:59.909559] [INFO ] [MAIN ] BDC: Loaded 25094 existing records. [2025-09-17T17:34:00.097494] [WARN ] [MAIN ] BDC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:34:00.097791] [INFO ] [MAIN ] BDC: Wiping existing primary data before full refresh. [2025-09-17T17:34:00.097839] [INFO ] [LOCAL ] BDC: Starting deletion of primary data. [2025-09-17T17:34:00.098568] [DEBUG] [LOCAL ] BDC: Deleted primary data file. [2025-09-17T17:34:00.098623] [INFO ] [MAIN ] BDC: Starting full primary refresh. [2025-09-17T17:34:00.420932] [INFO ] [REMOTE ] BCSF: Fetching primary data for 2025-09. [2025-09-17T17:34:00.457760] [INFO ] [REMOTE ] BDC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:34:01.215778] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-11. [2025-09-17T17:34:01.874546] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-17T17:34:01.898046] [INFO ] [REMOTE ] BCSF: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T17:34:01.902101] [INFO ] [REMOTE ] BCSF: Full fetch complete (37509 records). [2025-09-17T17:34:01.902248] [DEBUG] [VALIDATOR ] BCSF: Validating primary data. [2025-09-17T17:34:02.020839] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-07. [2025-09-17T17:34:02.311452] [DEBUG] [VALIDATOR ] BCSF: All expected trading days are present. [2025-09-17T17:34:02.311617] [DEBUG] [VALIDATOR ] BCSF: Primary data validation passed. [2025-09-17T17:34:02.312340] [INFO ] [MAIN ] BCSF: Fetched primary data is valid. [2025-09-17T17:34:02.325797] [DEBUG] [LOCAL ] BCSF: Saving primary data. [2025-09-17T17:34:02.327368] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T17:34:02.333681] [DEBUG] [LOCAL ] BCSF: Trimmed 37509 records to 27950 (keeping 200 days of data) [2025-09-17T17:34:02.520766] [DEBUG] [LOCAL ] BCSF: Primary data saved (27950 records). [2025-09-17T17:34:02.520912] [INFO ] [MAIN ] BCSF: Full history saved. [2025-09-17T17:34:02.522106] [INFO ] [MAIN ] Update Progress: 237/2371 symbols completed. BCSF took 28.2s. Estimated remaining: 5h 6m 14s. Rate: 7.0 symbols/min [2025-09-17T17:34:02.815850] [INFO ] [REMOTE ] BDC: Fetching primary data for 2024-12. [2025-09-17T17:34:03.330226] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T17:34:03.615850] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-08. [2025-09-17T17:34:03.983291] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T17:34:04.232825] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T17:34:04.415815] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-01. [2025-09-17T17:34:05.215850] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-05. [2025-09-17T17:34:05.542431] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T17:34:06.015787] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-02. [2025-09-17T17:34:06.815804] [INFO ] [REMOTE ] BCX: Fetching primary data for 2025-09. [2025-09-17T17:34:07.144289] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T17:34:07.271292] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T17:34:07.615820] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-03. [2025-09-17T17:34:07.867162] [INFO ] [REMOTE ] BCX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T17:34:07.870122] [INFO ] [REMOTE ] BCX: Full fetch complete (34222 records). [2025-09-17T17:34:07.870287] [DEBUG] [VALIDATOR ] BCX: Validating primary data. [2025-09-17T17:34:08.266007] [DEBUG] [VALIDATOR ] BCX: All expected trading days are present. [2025-09-17T17:34:08.266093] [DEBUG] [VALIDATOR ] BCX: Primary data validation passed. [2025-09-17T17:34:08.266572] [INFO ] [MAIN ] BCX: Fetched primary data is valid. [2025-09-17T17:34:08.266637] [DEBUG] [LOCAL ] BCX: Saving primary data. [2025-09-17T17:34:08.267770] [DEBUG] [LOCAL ] BCX: Trimmed 34222 records to 22046 (keeping 200 days of data) [2025-09-17T17:34:08.409859] [DEBUG] [LOCAL ] BCX: Primary data saved (22046 records). [2025-09-17T17:34:08.409987] [INFO ] [MAIN ] BCX: Full history saved. [2025-09-17T17:34:08.410069] [INFO ] [MAIN ] Update Progress: 238/2371 symbols completed. BCX took 30.7s. Estimated remaining: 5h 5m 41s. Rate: 7.0 symbols/min [2025-09-17T17:34:08.415716] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-06. [2025-09-17T17:34:08.581363] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T17:34:09.215829] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-04. [2025-09-17T17:34:10.269161] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T17:34:10.280424] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-07. [2025-09-17T17:34:10.635866] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T17:34:10.815858] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-05. [2025-09-17T17:34:11.957132] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T17:34:11.963026] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-06. [2025-09-17T17:34:12.141072] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T17:34:12.415840] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-08. [2025-09-17T17:34:13.425060] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T17:34:13.430138] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-07. [2025-09-17T17:34:14.014470] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T17:34:14.026260] [INFO ] [REMOTE ] BCS: Fetching primary data for 2025-09. [2025-09-17T17:34:14.325867] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T17:34:14.815825] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-08. [2025-09-17T17:34:16.044063] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T17:34:16.056489] [INFO ] [REMOTE ] BDC: Fetching primary data for 2025-09. [2025-09-17T17:34:16.068595] [INFO ] [REMOTE ] BCS: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-17T17:34:16.075683] [INFO ] [REMOTE ] BCS: Full fetch complete (77086 records). [2025-09-17T17:34:16.075796] [DEBUG] [VALIDATOR ] BCS: Validating primary data. [2025-09-17T17:34:16.471160] [DEBUG] [VALIDATOR ] BCS: All expected trading days are present. [2025-09-17T17:34:16.471253] [DEBUG] [VALIDATOR ] BCS: Primary data validation passed. [2025-09-17T17:34:16.472025] [INFO ] [MAIN ] BCS: Fetched primary data is valid. [2025-09-17T17:34:16.472082] [DEBUG] [LOCAL ] BCS: Saving primary data. [2025-09-17T17:34:16.473551] [DEBUG] [LOCAL ] BCS: Trimmed 77086 records to 53479 (keeping 200 days of data) [2025-09-17T17:34:16.800122] [DEBUG] [LOCAL ] BCS: Primary data saved (53479 records). [2025-09-17T17:34:16.800253] [INFO ] [MAIN ] BCS: Full history saved. [2025-09-17T17:34:16.800748] [INFO ] [MAIN ] Update Progress: 239/2371 symbols completed. BCS took 46.7s. Estimated remaining: 5h 5m 31s. Rate: 7.0 symbols/min [2025-09-17T17:34:17.279822] [INFO ] [REMOTE ] BDC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T17:34:17.283317] [INFO ] [REMOTE ] BDC: Full fetch complete (35501 records). [2025-09-17T17:34:17.283402] [DEBUG] [VALIDATOR ] BDC: Validating primary data. [2025-09-17T17:34:17.650547] [DEBUG] [VALIDATOR ] BDC: All expected trading days are present. [2025-09-17T17:34:17.650622] [DEBUG] [VALIDATOR ] BDC: Primary data validation passed. [2025-09-17T17:34:17.651044] [INFO ] [MAIN ] BDC: Fetched primary data is valid. [2025-09-17T17:34:17.651084] [DEBUG] [LOCAL ] BDC: Saving primary data. [2025-09-17T17:34:17.651872] [DEBUG] [LOCAL ] BDC: Trimmed 35501 records to 25058 (keeping 200 days of data) [2025-09-17T17:34:17.811045] [DEBUG] [LOCAL ] BDC: Primary data saved (25058 records). [2025-09-17T17:34:17.811253] [INFO ] [MAIN ] BDC: Full history saved. [2025-09-17T17:34:17.811346] [INFO ] [MAIN ] Update Progress: 240/2371 symbols completed. BDC took 18.1s. Estimated remaining: 5h 4m 15s. Rate: 7.0 symbols/min [2025-09-17T17:34:18.347551] [INFO ] [MAIN ] BE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:34:18.466371] [INFO ] [MAIN ] BDN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:34:18.475383] [INFO ] [MAIN ] BDX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:34:18.500876] [INFO ] [MAIN ] BDJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:34:18.548127] [DEBUG] [LOCAL ] BDJ: Loaded 29272 existing records from primary storage. [2025-09-17T17:34:18.567605] [INFO ] [MAIN ] BDJ: Loaded 29272 existing records. [2025-09-17T17:34:18.617555] [DEBUG] [LOCAL ] BDN: Loaded 47698 existing records from primary storage. [2025-09-17T17:34:18.630309] [INFO ] [MAIN ] BDN: Loaded 47698 existing records. [2025-09-17T17:34:18.784164] [DEBUG] [LOCAL ] BE: Loaded 53653 existing records from primary storage. [2025-09-17T17:34:18.869631] [INFO ] [MAIN ] BE: Loaded 53653 existing records. [2025-09-17T17:34:18.947002] [DEBUG] [LOCAL ] BDX: Loaded 52531 existing records from primary storage. [2025-09-17T17:34:18.962492] [INFO ] [MAIN ] BDX: Loaded 52531 existing records. [2025-09-17T17:34:18.923097] [WARN ] [MAIN ] BDJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:34:19.078315] [INFO ] [MAIN ] BDJ: Wiping existing primary data before full refresh. [2025-09-17T17:34:19.129341] [WARN ] [MAIN ] BDN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:34:19.129257] [INFO ] [LOCAL ] BDJ: Starting deletion of primary data. [2025-09-17T17:34:19.151990] [DEBUG] [LOCAL ] BDJ: Deleted primary data file. [2025-09-17T17:34:19.162680] [INFO ] [MAIN ] BDN: Wiping existing primary data before full refresh. [2025-09-17T17:34:19.157536] [INFO ] [MAIN ] BDJ: Starting full primary refresh. [2025-09-17T17:34:19.191721] [INFO ] [LOCAL ] BDN: Starting deletion of primary data. [2025-09-17T17:34:19.295804] [DEBUG] [LOCAL ] BDN: Deleted primary data file. [2025-09-17T17:34:19.302528] [INFO ] [MAIN ] BDN: Starting full primary refresh. [2025-09-17T17:34:19.351770] [WARN ] [MAIN ] BE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:34:19.498887] [INFO ] [MAIN ] BE: Wiping existing primary data before full refresh. [2025-09-17T17:34:19.562014] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-17T17:34:19.570519] [WARN ] [MAIN ] BDX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:34:19.610331] [DEBUG] [LOCAL ] BE: Deleted primary data file. [2025-09-17T17:34:19.610461] [INFO ] [MAIN ] BE: Starting full primary refresh. [2025-09-17T17:34:19.656870] [INFO ] [MAIN ] BDX: Wiping existing primary data before full refresh. [2025-09-17T17:34:19.729989] [INFO ] [LOCAL ] BDX: Starting deletion of primary data. [2025-09-17T17:34:19.794958] [DEBUG] [LOCAL ] BDX: Deleted primary data file. [2025-09-17T17:34:19.826437] [INFO ] [MAIN ] BDX: Starting full primary refresh. [2025-09-17T17:34:20.389501] [INFO ] [REMOTE ] BDJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:34:20.428250] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-11. [2025-09-17T17:34:20.745980] [INFO ] [REMOTE ] BDN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:34:20.755792] [INFO ] [REMOTE ] BE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:34:20.777274] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-11. [2025-09-17T17:34:20.777065] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-11. [2025-09-17T17:34:20.856786] [INFO ] [REMOTE ] BDX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:34:20.857098] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-11. [2025-09-17T17:34:22.068345] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T17:34:22.075980] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2024-12. [2025-09-17T17:34:22.482267] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T17:34:22.492451] [INFO ] [REMOTE ] BDN: Fetching primary data for 2024-12. [2025-09-17T17:34:22.946591] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-17T17:34:22.957000] [INFO ] [REMOTE ] BE: Fetching primary data for 2024-12. [2025-09-17T17:34:22.985552] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-17T17:34:22.995895] [INFO ] [REMOTE ] BDX: Fetching primary data for 2024-12. [2025-09-17T17:34:23.228106] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T17:34:23.234899] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-01. [2025-09-17T17:34:23.882777] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T17:34:23.893066] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-01. [2025-09-17T17:34:24.467231] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T17:34:24.473821] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-02. [2025-09-17T17:34:24.785968] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T17:34:24.951153] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T17:34:25.215778] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-01. [2025-09-17T17:34:25.249609] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T17:34:25.384877] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T17:34:26.015823] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-02. [2025-09-17T17:34:26.815827] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-03. [2025-09-17T17:34:27.286284] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-17T17:34:27.423966] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T17:34:27.615782] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-03. [2025-09-17T17:34:27.675911] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T17:34:28.415775] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-01. [2025-09-17T17:34:29.215782] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-02. [2025-09-17T17:34:29.340507] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T17:34:29.719002] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T17:34:30.015771] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-02. [2025-09-17T17:34:30.815783] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-04. [2025-09-17T17:34:31.348811] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-17T17:34:31.615761] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-03. [2025-09-17T17:34:31.721260] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T17:34:32.398432] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T17:34:32.415673] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-05. [2025-09-17T17:34:33.215800] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-03. [2025-09-17T17:34:33.630135] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T17:34:33.881089] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T17:34:34.015792] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-06. [2025-09-17T17:34:34.815758] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-04. [2025-09-17T17:34:34.858371] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T17:34:35.311553] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T17:34:35.615776] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-04. [2025-09-17T17:34:36.416800] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-04. [2025-09-17T17:34:36.420661] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T17:34:37.215765] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-07. [2025-09-17T17:34:37.527531] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T17:34:37.784493] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T17:34:38.015773] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-05. [2025-09-17T17:34:38.579426] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T17:34:38.815785] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-08. [2025-09-17T17:34:39.615841] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-05. [2025-09-17T17:34:39.716325] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T17:34:40.087108] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T17:34:40.415786] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-06. [2025-09-17T17:34:40.956713] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T17:34:41.215761] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-06. [2025-09-17T17:34:42.015748] [INFO ] [REMOTE ] BDJ: Fetching primary data for 2025-09. [2025-09-17T17:34:42.354072] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T17:34:42.490633] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T17:34:42.815767] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-05. [2025-09-17T17:34:43.321084] [INFO ] [REMOTE ] BDJ: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T17:34:43.326337] [INFO ] [REMOTE ] BDJ: Full fetch complete (42859 records). [2025-09-17T17:34:43.326572] [DEBUG] [VALIDATOR ] BDJ: Validating primary data. [2025-09-17T17:34:43.620880] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-07. [2025-09-17T17:34:43.720922] [DEBUG] [VALIDATOR ] BDJ: All expected trading days are present. [2025-09-17T17:34:43.721014] [DEBUG] [VALIDATOR ] BDJ: Primary data validation passed. [2025-09-17T17:34:43.721605] [INFO ] [MAIN ] BDJ: Fetched primary data is valid. [2025-09-17T17:34:43.721704] [DEBUG] [LOCAL ] BDJ: Saving primary data. [2025-09-17T17:34:43.722861] [DEBUG] [LOCAL ] BDJ: Trimmed 42859 records to 29274 (keeping 200 days of data) [2025-09-17T17:34:43.903533] [DEBUG] [LOCAL ] BDJ: Primary data saved (29274 records). [2025-09-17T17:34:43.903736] [INFO ] [MAIN ] BDJ: Full history saved. [2025-09-17T17:34:43.904878] [INFO ] [MAIN ] Update Progress: 241/2371 symbols completed. BDJ took 26.1s. Estimated remaining: 5h 6m 41s. Rate: 6.9 symbols/min [2025-09-17T17:34:44.077751] [INFO ] [MAIN ] BEDU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:34:44.077998] [DEBUG] [LOCAL ] BEDU: No existing data file found in primary storage. [2025-09-17T17:34:44.078038] [WARN ] [MAIN ] BEDU: No existing data found, performing full refresh instead. [2025-09-17T17:34:44.078142] [INFO ] [MAIN ] BEDU: Wiping existing primary data before full refresh. [2025-09-17T17:34:44.078180] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-17T17:34:44.078220] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-17T17:34:44.078262] [INFO ] [MAIN ] BEDU: Starting full primary refresh. [2025-09-17T17:34:44.422953] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-07. [2025-09-17T17:34:44.454821] [INFO ] [REMOTE ] BEDU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:34:44.831125] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T17:34:45.215700] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-06. [2025-09-17T17:34:45.425078] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T17:34:46.015789] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-08. [2025-09-17T17:34:46.643788] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-17T17:34:46.815816] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-11. [2025-09-17T17:34:47.109916] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T17:34:47.377227] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T17:34:47.615798] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-07. [2025-09-17T17:34:47.824806] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T17:34:48.415777] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2024-12. [2025-09-17T17:34:48.700148] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-17T17:34:49.215780] [INFO ] [REMOTE ] BDN: Fetching primary data for 2025-09. [2025-09-17T17:34:49.914312] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-17T17:34:50.015758] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-08. [2025-09-17T17:34:50.815794] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-08. [2025-09-17T17:34:51.335891] [INFO ] [REMOTE ] BDN: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-17T17:34:51.342190] [INFO ] [REMOTE ] BDN: Full fetch complete (69177 records). [2025-09-17T17:34:51.342312] [DEBUG] [VALIDATOR ] BDN: Validating primary data. [2025-09-17T17:34:51.620902] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-01. [2025-09-17T17:34:51.740158] [DEBUG] [VALIDATOR ] BDN: All expected trading days are present. [2025-09-17T17:34:51.740255] [DEBUG] [VALIDATOR ] BDN: Primary data validation passed. [2025-09-17T17:34:51.741054] [INFO ] [MAIN ] BDN: Fetched primary data is valid. [2025-09-17T17:34:51.741107] [DEBUG] [LOCAL ] BDN: Saving primary data. [2025-09-17T17:34:51.742530] [DEBUG] [LOCAL ] BDN: Trimmed 69177 records to 47693 (keeping 200 days of data) [2025-09-17T17:34:51.971782] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-17T17:34:52.024134] [DEBUG] [LOCAL ] BDN: Primary data saved (47693 records). [2025-09-17T17:34:52.024266] [INFO ] [MAIN ] BDN: Full history saved. [2025-09-17T17:34:52.024357] [INFO ] [MAIN ] Update Progress: 242/2371 symbols completed. BDN took 34.2s. Estimated remaining: 5h 6m 28s. Rate: 6.9 symbols/min [2025-09-17T17:34:52.197471] [INFO ] [MAIN ] BEKE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:34:52.250809] [DEBUG] [LOCAL ] BEKE: Loaded 53268 existing records from primary storage. [2025-09-17T17:34:52.250953] [INFO ] [MAIN ] BEKE: Loaded 53268 existing records. [2025-09-17T17:34:52.428771] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-02. [2025-09-17T17:34:52.435324] [WARN ] [MAIN ] BEKE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:34:52.436425] [INFO ] [MAIN ] BEKE: Wiping existing primary data before full refresh. [2025-09-17T17:34:52.436492] [INFO ] [LOCAL ] BEKE: Starting deletion of primary data. [2025-09-17T17:34:52.437824] [DEBUG] [LOCAL ] BEKE: Deleted primary data file. [2025-09-17T17:34:52.437883] [INFO ] [MAIN ] BEKE: Starting full primary refresh. [2025-09-17T17:34:52.791356] [INFO ] [REMOTE ] BEKE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:34:52.961769] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T17:34:53.215752] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-11. [2025-09-17T17:34:53.428287] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-08 (2.61 seconds). [2025-09-17T17:34:53.512522] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-08 (3.50 seconds). [2025-09-17T17:34:54.015799] [INFO ] [REMOTE ] BDX: Fetching primary data for 2025-09. [2025-09-17T17:34:54.815829] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-03. [2025-09-17T17:34:55.394680] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T17:34:55.612126] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-11 (2.40 seconds). [2025-09-17T17:34:55.621995] [INFO ] [REMOTE ] BE: Fetching primary data for 2025-09. [2025-09-17T17:34:56.292154] [INFO ] [REMOTE ] BDX: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-17T17:34:56.301051] [INFO ] [REMOTE ] BDX: Full fetch complete (75781 records). [2025-09-17T17:34:56.301203] [DEBUG] [VALIDATOR ] BDX: Validating primary data. [2025-09-17T17:34:56.421064] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2024-12. [2025-09-17T17:34:56.704990] [DEBUG] [VALIDATOR ] BDX: All expected trading days are present. [2025-09-17T17:34:56.705081] [DEBUG] [VALIDATOR ] BDX: Primary data validation passed. [2025-09-17T17:34:56.705854] [INFO ] [MAIN ] BDX: Fetched primary data is valid. [2025-09-17T17:34:56.705902] [DEBUG] [LOCAL ] BDX: Saving primary data. [2025-09-17T17:34:56.707475] [DEBUG] [LOCAL ] BDX: Trimmed 75781 records to 52531 (keeping 200 days of data) [2025-09-17T17:34:57.042032] [DEBUG] [LOCAL ] BDX: Primary data saved (52531 records). [2025-09-17T17:34:57.042170] [INFO ] [MAIN ] BDX: Full history saved. [2025-09-17T17:34:57.043144] [INFO ] [MAIN ] Update Progress: 243/2371 symbols completed. BDX took 39.2s. Estimated remaining: 5h 5m 48s. Rate: 7.0 symbols/min [2025-09-17T17:34:57.216605] [INFO ] [MAIN ] BEN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:34:57.216716] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-04. [2025-09-17T17:34:57.275476] [DEBUG] [LOCAL ] BEN: Loaded 53087 existing records from primary storage. [2025-09-17T17:34:57.275665] [INFO ] [MAIN ] BEN: Loaded 53087 existing records. [2025-09-17T17:34:57.450222] [WARN ] [MAIN ] BEN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:34:57.450684] [INFO ] [MAIN ] BEN: Wiping existing primary data before full refresh. [2025-09-17T17:34:57.450731] [INFO ] [LOCAL ] BEN: Starting deletion of primary data. [2025-09-17T17:34:57.451929] [DEBUG] [LOCAL ] BEN: Deleted primary data file. [2025-09-17T17:34:57.451980] [INFO ] [MAIN ] BEN: Starting full primary refresh. [2025-09-17T17:34:57.786083] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T17:34:57.807859] [INFO ] [REMOTE ] BEN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:34:57.995357] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T17:34:58.015716] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-01. [2025-09-17T17:34:58.132909] [INFO ] [REMOTE ] BE: Incremental fetch complete for 2025-09 (2.51 seconds). [2025-09-17T17:34:58.139396] [INFO ] [REMOTE ] BE: Full fetch complete (77154 records). [2025-09-17T17:34:58.139535] [DEBUG] [VALIDATOR ] BE: Validating primary data. [2025-09-17T17:34:58.140329] [FATAL] [VALIDATOR ] BE: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:34:58.140411] [FATAL] [MAIN ] BE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:34:58.140457] [WARN ] [MAIN ] BE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:34:58.140504] [INFO ] [LOCAL ] BE: Starting deletion of primary data. [2025-09-17T17:34:58.140562] [DEBUG] [LOCAL ] BE: No primary data file found to delete. [2025-09-17T17:34:58.140604] [INFO ] [LOCAL ] BE: Starting deletion of derivative data. [2025-09-17T17:34:58.140989] [DEBUG] [LOCAL ] BE: Deleted derivative data file. [2025-09-17T17:34:58.141073] [INFO ] [MAIN ] Update Progress: 244/2371 symbols completed. BE took 40.3s. Estimated remaining: 5h 4m 33s. Rate: 7.0 symbols/min [2025-09-17T17:34:58.309228] [INFO ] [MAIN ] BEP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:34:58.352384] [DEBUG] [LOCAL ] BEP: Loaded 38899 existing records from primary storage. [2025-09-17T17:34:58.352860] [INFO ] [MAIN ] BEP: Loaded 38899 existing records. [2025-09-17T17:34:58.531128] [WARN ] [MAIN ] BEP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:34:58.531491] [INFO ] [MAIN ] BEP: Wiping existing primary data before full refresh. [2025-09-17T17:34:58.531538] [INFO ] [LOCAL ] BEP: Starting deletion of primary data. [2025-09-17T17:34:58.532861] [DEBUG] [LOCAL ] BEP: Deleted primary data file. [2025-09-17T17:34:58.532914] [INFO ] [MAIN ] BEP: Starting full primary refresh. [2025-09-17T17:34:58.820889] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-05. [2025-09-17T17:34:58.887981] [INFO ] [REMOTE ] BEP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:34:59.153273] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T17:34:59.608235] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T17:34:59.618537] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-11. [2025-09-17T17:35:00.415814] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-11. [2025-09-17T17:35:01.215816] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-02. [2025-09-17T17:35:01.257549] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T17:35:02.015816] [INFO ] [REMOTE ] BEP: Fetching primary data for 2024-12. [2025-09-17T17:35:02.580399] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-17T17:35:02.815826] [INFO ] [REMOTE ] BEN: Fetching primary data for 2024-12. [2025-09-17T17:35:02.999563] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T17:35:03.190978] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T17:35:03.615788] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-06. [2025-09-17T17:35:03.954210] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T17:35:04.415812] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-01. [2025-09-17T17:35:04.728630] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T17:35:05.215822] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-07. [2025-09-17T17:35:05.494350] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-17T17:35:06.015729] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-08. [2025-09-17T17:35:06.095037] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T17:35:06.464274] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T17:35:06.815791] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-01. [2025-09-17T17:35:07.615841] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-02. [2025-09-17T17:35:08.415771] [INFO ] [REMOTE ] BEDU: Fetching primary data for 2025-09. [2025-09-17T17:35:08.578136] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T17:35:08.957584] [INFO ] [REMOTE ] BEDU: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T17:35:08.958526] [INFO ] [REMOTE ] BEDU: Full fetch complete (1381 records). [2025-09-17T17:35:08.958595] [DEBUG] [VALIDATOR ] BEDU: Validating primary data. [2025-09-17T17:35:09.139463] [WARN ] [VALIDATOR ] BEDU: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-17T17:35:09.139806] [FATAL] [MAIN ] BEDU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:35:09.139932] [WARN ] [MAIN ] BEDU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:35:09.140009] [INFO ] [LOCAL ] BEDU: Starting deletion of primary data. [2025-09-17T17:35:09.140105] [DEBUG] [LOCAL ] BEDU: No primary data file found to delete. [2025-09-17T17:35:09.140231] [INFO ] [LOCAL ] BEDU: Starting deletion of derivative data. [2025-09-17T17:35:09.140287] [DEBUG] [LOCAL ] BEDU: No derivative data file found to delete. [2025-09-17T17:35:09.140357] [INFO ] [MAIN ] Update Progress: 245/2371 symbols completed. BEDU took 25.2s. Estimated remaining: 5h 4m 46s. Rate: 7.0 symbols/min [2025-09-17T17:35:09.219541] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-02. [2025-09-17T17:35:09.321735] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T17:35:09.352792] [INFO ] [MAIN ] BEPC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:35:09.404790] [DEBUG] [LOCAL ] BEPC: Loaded 46706 existing records from primary storage. [2025-09-17T17:35:09.404930] [INFO ] [MAIN ] BEPC: Loaded 46706 existing records. [2025-09-17T17:35:09.580780] [WARN ] [MAIN ] BEPC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:35:09.581050] [INFO ] [MAIN ] BEPC: Wiping existing primary data before full refresh. [2025-09-17T17:35:09.581100] [INFO ] [LOCAL ] BEPC: Starting deletion of primary data. [2025-09-17T17:35:09.582116] [DEBUG] [LOCAL ] BEPC: Deleted primary data file. [2025-09-17T17:35:09.582165] [INFO ] [MAIN ] BEPC: Starting full primary refresh. [2025-09-17T17:35:09.929012] [INFO ] [REMOTE ] BEPC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:35:10.015747] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-11. [2025-09-17T17:35:10.815785] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-03. [2025-09-17T17:35:11.098456] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T17:35:11.196123] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T17:35:11.615831] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-03. [2025-09-17T17:35:12.175358] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T17:35:12.415767] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-03. [2025-09-17T17:35:13.215817] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-04. [2025-09-17T17:35:13.460582] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T17:35:14.015745] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-04. [2025-09-17T17:35:14.529232] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-17T17:35:14.733945] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T17:35:14.815776] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-05. [2025-09-17T17:35:15.615783] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-04. [2025-09-17T17:35:15.677125] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T17:35:16.340599] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T17:35:16.415775] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-06. [2025-09-17T17:35:17.208322] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T17:35:17.222049] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-05. [2025-09-17T17:35:18.015855] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-05. [2025-09-17T17:35:18.062881] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:35:18.734006] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T17:35:18.815799] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-06. [2025-09-17T17:35:19.500175] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T17:35:19.615790] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2024-12. [2025-09-17T17:35:20.415782] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-06. [2025-09-17T17:35:20.479145] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T17:35:21.219752] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-07. [2025-09-17T17:35:21.221967] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T17:35:21.943238] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T17:35:22.015773] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-07. [2025-09-17T17:35:22.815807] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-01. [2025-09-17T17:35:22.873457] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T17:35:23.615816] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-07. [2025-09-17T17:35:23.928803] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T17:35:24.158229] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T17:35:24.415757] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-02. [2025-09-17T17:35:25.215785] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-08. [2025-09-17T17:35:25.605669] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T17:35:25.967116] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T17:35:26.015717] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-08. [2025-09-17T17:35:26.313412] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T17:35:26.815784] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-08. [2025-09-17T17:35:27.530096] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T17:35:27.615769] [INFO ] [REMOTE ] BEN: Fetching primary data for 2025-09. [2025-09-17T17:35:28.415773] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-03. [2025-09-17T17:35:28.698718] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T17:35:29.215818] [INFO ] [REMOTE ] BEKE: Fetching primary data for 2025-09. [2025-09-17T17:35:29.444566] [INFO ] [REMOTE ] BEN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T17:35:29.451552] [INFO ] [REMOTE ] BEN: Full fetch complete (76733 records). [2025-09-17T17:35:29.451746] [DEBUG] [VALIDATOR ] BEN: Validating primary data. [2025-09-17T17:35:29.850536] [DEBUG] [VALIDATOR ] BEN: All expected trading days are present. [2025-09-17T17:35:29.850635] [DEBUG] [VALIDATOR ] BEN: Primary data validation passed. [2025-09-17T17:35:29.851433] [INFO ] [MAIN ] BEN: Fetched primary data is valid. [2025-09-17T17:35:29.851481] [DEBUG] [LOCAL ] BEN: Saving primary data. [2025-09-17T17:35:29.853101] [DEBUG] [LOCAL ] BEN: Trimmed 76733 records to 53082 (keeping 200 days of data) [2025-09-17T17:35:30.037670] [INFO ] [REMOTE ] BEP: Fetching primary data for 2025-09. [2025-09-17T17:35:30.113131] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T17:35:30.228227] [DEBUG] [LOCAL ] BEN: Primary data saved (53082 records). [2025-09-17T17:35:30.228380] [INFO ] [MAIN ] BEN: Full history saved. [2025-09-17T17:35:30.228982] [INFO ] [MAIN ] Update Progress: 246/2371 symbols completed. BEN took 33.2s. Estimated remaining: 5h 6m 25s. Rate: 6.9 symbols/min [2025-09-17T17:35:30.401196] [INFO ] [MAIN ] BEPH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:35:30.409601] [DEBUG] [LOCAL ] BEPH: Loaded 5228 existing records from primary storage. [2025-09-17T17:35:30.409748] [INFO ] [MAIN ] BEPH: Loaded 5228 existing records. [2025-09-17T17:35:30.587845] [WARN ] [MAIN ] BEPH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:35:30.588117] [INFO ] [MAIN ] BEPH: Wiping existing primary data before full refresh. [2025-09-17T17:35:30.588166] [INFO ] [LOCAL ] BEPH: Starting deletion of primary data. [2025-09-17T17:35:30.588519] [DEBUG] [LOCAL ] BEPH: Deleted primary data file. [2025-09-17T17:35:30.588566] [INFO ] [MAIN ] BEPH: Starting full primary refresh. [2025-09-17T17:35:30.838595] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-04. [2025-09-17T17:35:30.960710] [INFO ] [REMOTE ] BEPH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:35:30.988108] [INFO ] [REMOTE ] BEKE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T17:35:30.996956] [INFO ] [REMOTE ] BEKE: Full fetch complete (77049 records). [2025-09-17T17:35:30.997120] [DEBUG] [VALIDATOR ] BEKE: Validating primary data. [2025-09-17T17:35:31.395993] [DEBUG] [VALIDATOR ] BEKE: All expected trading days are present. [2025-09-17T17:35:31.396187] [DEBUG] [VALIDATOR ] BEKE: Primary data validation passed. [2025-09-17T17:35:31.397106] [INFO ] [MAIN ] BEKE: Fetched primary data is valid. [2025-09-17T17:35:31.397230] [DEBUG] [LOCAL ] BEKE: Saving primary data. [2025-09-17T17:35:31.410134] [INFO ] [REMOTE ] BEP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T17:35:31.414980] [INFO ] [REMOTE ] BEP: Full fetch complete (58248 records). [2025-09-17T17:35:31.415090] [DEBUG] [LOCAL ] BEKE: Trimmed 77049 records to 53267 (keeping 200 days of data) [2025-09-17T17:35:31.415295] [DEBUG] [VALIDATOR ] BEP: Validating primary data. [2025-09-17T17:35:31.619960] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-11. [2025-09-17T17:35:31.921125] [DEBUG] [VALIDATOR ] BEP: All expected trading days are present. [2025-09-17T17:35:31.921760] [DEBUG] [VALIDATOR ] BEP: Primary data validation passed. [2025-09-17T17:35:31.922991] [INFO ] [MAIN ] BEP: Fetched primary data is valid. [2025-09-17T17:35:31.924089] [DEBUG] [LOCAL ] BEP: Saving primary data. [2025-09-17T17:35:31.928267] [DEBUG] [LOCAL ] BEP: Trimmed 58248 records to 38801 (keeping 200 days of data) [2025-09-17T17:35:32.278872] [DEBUG] [LOCAL ] BEP: Primary data saved (38801 records). [2025-09-17T17:35:32.280226] [INFO ] [MAIN ] BEP: Full history saved. [2025-09-17T17:35:32.280353] [INFO ] [MAIN ] Update Progress: 247/2371 symbols completed. BEP took 34.1s. Estimated remaining: 5h 5m 20s. Rate: 7.0 symbols/min [2025-09-17T17:35:32.471067] [INFO ] [MAIN ] BEPI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:35:32.537062] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T17:35:32.539628] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2024-12. [2025-09-17T17:35:32.543467] [DEBUG] [LOCAL ] BEPI: Loaded 3428 existing records from primary storage. [2025-09-17T17:35:32.544979] [INFO ] [MAIN ] BEPI: Loaded 3428 existing records. [2025-09-17T17:35:32.668325] [DEBUG] [LOCAL ] BEKE: Primary data saved (53267 records). [2025-09-17T17:35:32.668604] [INFO ] [MAIN ] BEKE: Full history saved. [2025-09-17T17:35:32.670295] [INFO ] [MAIN ] Update Progress: 248/2371 symbols completed. BEKE took 40.6s. Estimated remaining: 5h 4m 0s. Rate: 7.0 symbols/min [2025-09-17T17:35:32.830780] [WARN ] [MAIN ] BEPI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:35:32.852655] [INFO ] [MAIN ] BEPI: Wiping existing primary data before full refresh. [2025-09-17T17:35:32.863310] [INFO ] [LOCAL ] BEPI: Starting deletion of primary data. [2025-09-17T17:35:32.945948] [INFO ] [MAIN ] BEPJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:35:32.948992] [DEBUG] [LOCAL ] BEPI: Deleted primary data file. [2025-09-17T17:35:32.949381] [INFO ] [MAIN ] BEPI: Starting full primary refresh. [2025-09-17T17:35:32.963107] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T17:35:33.065124] [DEBUG] [LOCAL ] BEPJ: Loaded 3356 existing records from primary storage. [2025-09-17T17:35:33.068320] [INFO ] [MAIN ] BEPJ: Loaded 3356 existing records. [2025-09-17T17:35:33.230004] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-05. [2025-09-17T17:35:33.363911] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T17:35:33.385368] [WARN ] [MAIN ] BEPJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:35:33.418739] [INFO ] [MAIN ] BEPJ: Wiping existing primary data before full refresh. [2025-09-17T17:35:33.437487] [INFO ] [LOCAL ] BEPJ: Starting deletion of primary data. [2025-09-17T17:35:33.439998] [DEBUG] [LOCAL ] BEPJ: Deleted primary data file. [2025-09-17T17:35:33.445322] [INFO ] [MAIN ] BEPJ: Starting full primary refresh. [2025-09-17T17:35:33.608025] [INFO ] [REMOTE ] BEPI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:35:33.869111] [INFO ] [REMOTE ] BEPJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:35:34.015726] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-11. [2025-09-17T17:35:34.815830] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-11. [2025-09-17T17:35:35.053722] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T17:35:35.084306] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T17:35:35.398005] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T17:35:35.615773] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-01. [2025-09-17T17:35:36.201306] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T17:35:36.415819] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2024-12. [2025-09-17T17:35:37.007155] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T17:35:37.215728] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-01. [2025-09-17T17:35:37.683893] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T17:35:38.015790] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-02. [2025-09-17T17:35:38.528256] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T17:35:38.815787] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-06. [2025-09-17T17:35:39.615772] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-02. [2025-09-17T17:35:40.157905] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T17:35:40.415828] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-03. [2025-09-17T17:35:40.469197] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:35:41.163729] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T17:35:41.215744] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-03. [2025-09-17T17:35:41.665581] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T17:35:42.015766] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-04. [2025-09-17T17:35:42.796574] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T17:35:42.815763] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-05. [2025-09-17T17:35:43.465985] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T17:35:43.615763] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2024-12. [2025-09-17T17:35:44.084854] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T17:35:44.415764] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-07. [2025-09-17T17:35:45.215784] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-04. [2025-09-17T17:35:45.891175] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T17:35:46.015746] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-05. [2025-09-17T17:35:46.251475] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T17:35:46.393188] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T17:35:46.815813] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-06. [2025-09-17T17:35:47.406447] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T17:35:47.615793] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-06. [2025-09-17T17:35:48.170252] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T17:35:48.415778] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-07. [2025-09-17T17:35:48.968073] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T17:35:49.215800] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-08. [2025-09-17T17:35:49.665192] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T17:35:50.015803] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-01. [2025-09-17T17:35:50.648731] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T17:35:50.815835] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-02. [2025-09-17T17:35:51.267210] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T17:35:51.615815] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-07. [2025-09-17T17:35:52.160413] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-17T17:35:52.415826] [INFO ] [REMOTE ] BEPI: Fetching primary data for 2025-09. [2025-09-17T17:35:52.901199] [INFO ] [REMOTE ] BEPI: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T17:35:52.902404] [INFO ] [REMOTE ] BEPI: Full fetch complete (4974 records). [2025-09-17T17:35:52.902548] [DEBUG] [VALIDATOR ] BEPI: Validating primary data. [2025-09-17T17:35:53.220935] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-03. [2025-09-17T17:35:53.296529] [DEBUG] [VALIDATOR ] BEPI: All expected trading days are present. [2025-09-17T17:35:53.296609] [DEBUG] [VALIDATOR ] BEPI: Primary data validation passed. [2025-09-17T17:35:53.296803] [INFO ] [MAIN ] BEPI: Fetched primary data is valid. [2025-09-17T17:35:53.296845] [DEBUG] [LOCAL ] BEPI: Saving primary data. [2025-09-17T17:35:53.297210] [DEBUG] [LOCAL ] BEPI: Trimmed 4974 records to 3429 (keeping 200 days of data) [2025-09-17T17:35:53.319340] [DEBUG] [LOCAL ] BEPI: Primary data saved (3429 records). [2025-09-17T17:35:53.319415] [INFO ] [MAIN ] BEPI: Full history saved. [2025-09-17T17:35:53.319490] [INFO ] [MAIN ] Update Progress: 249/2371 symbols completed. BEPI took 21.0s. Estimated remaining: 5h 5m 35s. Rate: 6.9 symbols/min [2025-09-17T17:35:53.542805] [INFO ] [MAIN ] BFAM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:35:53.577701] [DEBUG] [LOCAL ] BFAM: Loaded 32885 existing records from primary storage. [2025-09-17T17:35:53.577857] [INFO ] [MAIN ] BFAM: Loaded 32885 existing records. [2025-09-17T17:35:53.760974] [WARN ] [MAIN ] BFAM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:35:53.765108] [INFO ] [MAIN ] BFAM: Wiping existing primary data before full refresh. [2025-09-17T17:35:53.765045] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T17:35:53.766734] [INFO ] [LOCAL ] BFAM: Starting deletion of primary data. [2025-09-17T17:35:53.767470] [DEBUG] [LOCAL ] BFAM: Deleted primary data file. [2025-09-17T17:35:53.767521] [INFO ] [MAIN ] BFAM: Starting full primary refresh. [2025-09-17T17:35:54.020911] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-08. [2025-09-17T17:35:54.142951] [INFO ] [REMOTE ] BFAM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:35:54.815780] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-11. [2025-09-17T17:35:55.615753] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-08. [2025-09-17T17:35:55.668572] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T17:35:56.389209] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T17:35:56.404014] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T17:35:56.415799] [INFO ] [REMOTE ] BEPH: Fetching primary data for 2025-09. [2025-09-17T17:35:57.022740] [INFO ] [REMOTE ] BEPH: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T17:35:57.023880] [INFO ] [REMOTE ] BEPH: Full fetch complete (7553 records). [2025-09-17T17:35:57.023976] [DEBUG] [VALIDATOR ] BEPH: Validating primary data. [2025-09-17T17:35:57.220979] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2024-12. [2025-09-17T17:35:57.399514] [DEBUG] [VALIDATOR ] BEPH: All expected trading days are present. [2025-09-17T17:35:57.399594] [DEBUG] [VALIDATOR ] BEPH: Primary data validation passed. [2025-09-17T17:35:57.399799] [INFO ] [MAIN ] BEPH: Fetched primary data is valid. [2025-09-17T17:35:57.399840] [DEBUG] [LOCAL ] BEPH: Saving primary data. [2025-09-17T17:35:57.400249] [DEBUG] [LOCAL ] BEPH: Trimmed 7553 records to 5228 (keeping 200 days of data) [2025-09-17T17:35:57.432534] [DEBUG] [LOCAL ] BEPH: Primary data saved (5228 records). [2025-09-17T17:35:57.432701] [INFO ] [MAIN ] BEPH: Full history saved. [2025-09-17T17:35:57.432790] [INFO ] [MAIN ] Update Progress: 250/2371 symbols completed. BEPH took 27.2s. Estimated remaining: 5h 4m 48s. Rate: 7.0 symbols/min [2025-09-17T17:35:57.605867] [INFO ] [MAIN ] BFH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:35:57.647006] [DEBUG] [LOCAL ] BFH: Loaded 42060 existing records from primary storage. [2025-09-17T17:35:57.647146] [INFO ] [MAIN ] BFH: Loaded 42060 existing records. [2025-09-17T17:35:57.826243] [WARN ] [MAIN ] BFH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:35:57.826526] [INFO ] [MAIN ] BFH: Wiping existing primary data before full refresh. [2025-09-17T17:35:57.826581] [INFO ] [LOCAL ] BFH: Starting deletion of primary data. [2025-09-17T17:35:57.827475] [DEBUG] [LOCAL ] BFH: Deleted primary data file. [2025-09-17T17:35:57.827533] [INFO ] [MAIN ] BFH: Starting full primary refresh. [2025-09-17T17:35:58.026125] [INFO ] [REMOTE ] BEPC: Fetching primary data for 2025-09. [2025-09-17T17:35:58.196132] [INFO ] [REMOTE ] BFH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:35:58.673666] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T17:35:58.815795] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-04. [2025-09-17T17:35:59.211174] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-17T17:35:59.575454] [INFO ] [REMOTE ] BEPC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T17:35:59.581995] [INFO ] [REMOTE ] BEPC: Full fetch complete (68301 records). [2025-09-17T17:35:59.582150] [DEBUG] [VALIDATOR ] BEPC: Validating primary data. [2025-09-17T17:35:59.620920] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-11. [2025-09-17T17:36:00.015592] [DEBUG] [VALIDATOR ] BEPC: All expected trading days are present. [2025-09-17T17:36:00.015721] [DEBUG] [VALIDATOR ] BEPC: Primary data validation passed. [2025-09-17T17:36:00.016453] [INFO ] [MAIN ] BEPC: Fetched primary data is valid. [2025-09-17T17:36:00.016499] [DEBUG] [LOCAL ] BEPC: Saving primary data. [2025-09-17T17:36:00.018071] [DEBUG] [LOCAL ] BEPC: Trimmed 68301 records to 46641 (keeping 200 days of data) [2025-09-17T17:36:00.313497] [DEBUG] [LOCAL ] BEPC: Primary data saved (46641 records). [2025-09-17T17:36:00.313758] [INFO ] [MAIN ] BEPC: Full history saved. [2025-09-17T17:36:00.314611] [INFO ] [MAIN ] Update Progress: 251/2371 symbols completed. BEPC took 51.2s. Estimated remaining: 5h 3m 50s. Rate: 7.0 symbols/min [2025-09-17T17:36:00.415851] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-05. [2025-09-17T17:36:00.486926] [INFO ] [MAIN ] BFK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:36:00.506228] [DEBUG] [LOCAL ] BFK: Loaded 13903 existing records from primary storage. [2025-09-17T17:36:00.506383] [INFO ] [MAIN ] BFK: Loaded 13903 existing records. [2025-09-17T17:36:00.685362] [WARN ] [MAIN ] BFK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:36:00.685607] [INFO ] [MAIN ] BFK: Wiping existing primary data before full refresh. [2025-09-17T17:36:00.685674] [INFO ] [LOCAL ] BFK: Starting deletion of primary data. [2025-09-17T17:36:00.686069] [DEBUG] [LOCAL ] BFK: Deleted primary data file. [2025-09-17T17:36:00.686116] [INFO ] [MAIN ] BFK: Starting full primary refresh. [2025-09-17T17:36:01.060593] [INFO ] [REMOTE ] BFK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:36:01.065107] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T17:36:01.215835] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-11. [2025-09-17T17:36:01.324250] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T17:36:02.015826] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-01. [2025-09-17T17:36:02.161578] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T17:36:02.815784] [INFO ] [REMOTE ] BFK: Fetching primary data for 2024-12. [2025-09-17T17:36:03.289381] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T17:36:03.364729] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T17:36:03.615829] [INFO ] [REMOTE ] BFH: Fetching primary data for 2024-12. [2025-09-17T17:36:04.415785] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-06. [2025-09-17T17:36:05.073618] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T17:36:05.215754] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-07. [2025-09-17T17:36:05.217279] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T17:36:06.002823] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T17:36:06.015672] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-08. [2025-09-17T17:36:06.467617] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T17:36:06.815824] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-01. [2025-09-17T17:36:07.615787] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-02. [2025-09-17T17:36:08.334072] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T17:36:08.415799] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-02. [2025-09-17T17:36:08.880858] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T17:36:09.215798] [INFO ] [REMOTE ] BEPJ: Fetching primary data for 2025-09. [2025-09-17T17:36:09.592257] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T17:36:09.839552] [INFO ] [REMOTE ] BEPJ: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T17:36:09.840634] [INFO ] [REMOTE ] BEPJ: Full fetch complete (4568 records). [2025-09-17T17:36:09.840744] [DEBUG] [VALIDATOR ] BEPJ: Validating primary data. [2025-09-17T17:36:10.034180] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-01. [2025-09-17T17:36:10.236989] [DEBUG] [VALIDATOR ] BEPJ: All expected trading days are present. [2025-09-17T17:36:10.237079] [DEBUG] [VALIDATOR ] BEPJ: Primary data validation passed. [2025-09-17T17:36:10.237443] [INFO ] [MAIN ] BEPJ: Fetched primary data is valid. [2025-09-17T17:36:10.237488] [DEBUG] [LOCAL ] BEPJ: Saving primary data. [2025-09-17T17:36:10.238038] [DEBUG] [LOCAL ] BEPJ: Trimmed 4568 records to 3292 (keeping 200 days of data) [2025-09-17T17:36:10.266023] [DEBUG] [LOCAL ] BEPJ: Primary data saved (3292 records). [2025-09-17T17:36:10.266219] [INFO ] [MAIN ] BEPJ: Full history saved. [2025-09-17T17:36:10.266369] [INFO ] [MAIN ] Update Progress: 252/2371 symbols completed. BEPJ took 37.6s. Estimated remaining: 5h 3m 53s. Rate: 7.0 symbols/min [2025-09-17T17:36:10.484137] [INFO ] [MAIN ] BFLY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:36:10.559795] [DEBUG] [LOCAL ] BFLY: Loaded 51856 existing records from primary storage. [2025-09-17T17:36:10.559996] [INFO ] [MAIN ] BFLY: Loaded 51856 existing records. [2025-09-17T17:36:10.826178] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-03. [2025-09-17T17:36:10.838757] [WARN ] [MAIN ] BFLY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:36:10.839105] [INFO ] [MAIN ] BFLY: Wiping existing primary data before full refresh. [2025-09-17T17:36:10.839177] [INFO ] [LOCAL ] BFLY: Starting deletion of primary data. [2025-09-17T17:36:10.840754] [DEBUG] [LOCAL ] BFLY: Deleted primary data file. [2025-09-17T17:36:10.840839] [INFO ] [MAIN ] BFLY: Starting full primary refresh. [2025-09-17T17:36:11.050558] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T17:36:11.444450] [INFO ] [REMOTE ] BFLY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:36:11.615817] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-11. [2025-09-17T17:36:12.366362] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T17:36:12.415802] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-04. [2025-09-17T17:36:13.145381] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T17:36:13.215804] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2024-12. [2025-09-17T17:36:14.015825] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-02. [2025-09-17T17:36:14.139515] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T17:36:14.625080] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T17:36:14.815751] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-03. [2025-09-17T17:36:14.865378] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T17:36:15.615790] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-05. [2025-09-17T17:36:15.814396] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T17:36:16.415814] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-03. [2025-09-17T17:36:17.029338] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T17:36:17.215825] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-06. [2025-09-17T17:36:17.739801] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T17:36:18.015821] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-04. [2025-09-17T17:36:18.820957] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-01. [2025-09-17T17:36:18.832270] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T17:36:19.056851] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T17:36:19.615789] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-04. [2025-09-17T17:36:20.415814] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-05. [2025-09-17T17:36:20.656320] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T17:36:20.702600] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T17:36:21.215788] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-02. [2025-09-17T17:36:21.848409] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T17:36:22.015769] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-06. [2025-09-17T17:36:22.768297] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T17:36:22.815762] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-03. [2025-09-17T17:36:23.327196] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T17:36:23.615793] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-07. [2025-09-17T17:36:24.415846] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-07. [2025-09-17T17:36:24.625632] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T17:36:24.830256] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T17:36:25.215871] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-05. [2025-09-17T17:36:26.015815] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-04. [2025-09-17T17:36:26.062819] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T17:36:26.152373] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T17:36:26.815810] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-08. [2025-09-17T17:36:27.559012] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T17:36:27.615781] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-08. [2025-09-17T17:36:28.204877] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T17:36:28.415776] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-05. [2025-09-17T17:36:28.998374] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T17:36:29.215786] [INFO ] [REMOTE ] BFH: Fetching primary data for 2025-09. [2025-09-17T17:36:30.015776] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-06. [2025-09-17T17:36:30.281837] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T17:36:30.593332] [INFO ] [REMOTE ] BFH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T17:36:30.598496] [INFO ] [REMOTE ] BFH: Full fetch complete (59503 records). [2025-09-17T17:36:30.598665] [DEBUG] [VALIDATOR ] BFH: Validating primary data. [2025-09-17T17:36:30.820928] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-06. [2025-09-17T17:36:30.993842] [DEBUG] [VALIDATOR ] BFH: All expected trading days are present. [2025-09-17T17:36:30.993940] [DEBUG] [VALIDATOR ] BFH: Primary data validation passed. [2025-09-17T17:36:30.994593] [INFO ] [MAIN ] BFH: Fetched primary data is valid. [2025-09-17T17:36:30.994670] [DEBUG] [LOCAL ] BFH: Saving primary data. [2025-09-17T17:36:30.995880] [DEBUG] [LOCAL ] BFH: Trimmed 59503 records to 42029 (keeping 200 days of data) [2025-09-17T17:36:31.097757] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T17:36:31.267053] [DEBUG] [LOCAL ] BFH: Primary data saved (42029 records). [2025-09-17T17:36:31.267184] [INFO ] [MAIN ] BFH: Full history saved. [2025-09-17T17:36:31.269256] [INFO ] [MAIN ] Update Progress: 253/2371 symbols completed. BFH took 33.8s. Estimated remaining: 5h 5m 28s. Rate: 6.9 symbols/min [2025-09-17T17:36:31.459086] [INFO ] [MAIN ] BFS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:36:31.473060] [DEBUG] [LOCAL ] BFS: Loaded 8999 existing records from primary storage. [2025-09-17T17:36:31.473219] [INFO ] [MAIN ] BFS: Loaded 8999 existing records. [2025-09-17T17:36:31.620980] [INFO ] [REMOTE ] BFAM: Fetching primary data for 2025-09. [2025-09-17T17:36:31.656181] [WARN ] [MAIN ] BFS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:36:31.656452] [INFO ] [MAIN ] BFS: Wiping existing primary data before full refresh. [2025-09-17T17:36:31.656503] [INFO ] [LOCAL ] BFS: Starting deletion of primary data. [2025-09-17T17:36:31.656895] [DEBUG] [LOCAL ] BFS: Deleted primary data file. [2025-09-17T17:36:31.656943] [INFO ] [MAIN ] BFS: Starting full primary refresh. [2025-09-17T17:36:32.014762] [INFO ] [REMOTE ] BFS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:36:32.172517] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T17:36:32.415785] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-11. [2025-09-17T17:36:33.003569] [INFO ] [REMOTE ] BFAM: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T17:36:33.008077] [INFO ] [REMOTE ] BFAM: Full fetch complete (46851 records). [2025-09-17T17:36:33.008186] [DEBUG] [VALIDATOR ] BFAM: Validating primary data. [2025-09-17T17:36:33.221264] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T17:36:33.220838] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-07. [2025-09-17T17:36:33.404072] [DEBUG] [VALIDATOR ] BFAM: All expected trading days are present. [2025-09-17T17:36:33.404157] [DEBUG] [VALIDATOR ] BFAM: Primary data validation passed. [2025-09-17T17:36:33.404726] [INFO ] [MAIN ] BFAM: Fetched primary data is valid. [2025-09-17T17:36:33.404771] [DEBUG] [LOCAL ] BFAM: Saving primary data. [2025-09-17T17:36:33.405842] [DEBUG] [LOCAL ] BFAM: Trimmed 46851 records to 32892 (keeping 200 days of data) [2025-09-17T17:36:33.608760] [DEBUG] [LOCAL ] BFAM: Primary data saved (32892 records). [2025-09-17T17:36:33.608911] [INFO ] [MAIN ] BFAM: Full history saved. [2025-09-17T17:36:33.608997] [INFO ] [MAIN ] Update Progress: 254/2371 symbols completed. BFAM took 40.3s. Estimated remaining: 5h 4m 27s. Rate: 7.0 symbols/min [2025-09-17T17:36:33.777707] [INFO ] [MAIN ] BFZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:36:33.789944] [DEBUG] [LOCAL ] BFZ: Loaded 11334 existing records from primary storage. [2025-09-17T17:36:33.790103] [INFO ] [MAIN ] BFZ: Loaded 11334 existing records. [2025-09-17T17:36:33.966891] [WARN ] [MAIN ] BFZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:36:33.967122] [INFO ] [MAIN ] BFZ: Wiping existing primary data before full refresh. [2025-09-17T17:36:33.967166] [INFO ] [LOCAL ] BFZ: Starting deletion of primary data. [2025-09-17T17:36:33.967605] [DEBUG] [LOCAL ] BFZ: Deleted primary data file. [2025-09-17T17:36:33.967681] [INFO ] [MAIN ] BFZ: Starting full primary refresh. [2025-09-17T17:36:34.021503] [INFO ] [REMOTE ] BFS: Fetching primary data for 2024-12. [2025-09-17T17:36:34.281863] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T17:36:34.338478] [INFO ] [REMOTE ] BFZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:36:34.816733] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T17:36:34.815802] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-08. [2025-09-17T17:36:35.615805] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-01. [2025-09-17T17:36:35.655203] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T17:36:36.391671] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T17:36:36.415782] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-07. [2025-09-17T17:36:37.215785] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-11. [2025-09-17T17:36:38.015809] [INFO ] [REMOTE ] BFK: Fetching primary data for 2025-09. [2025-09-17T17:36:38.421460] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T17:36:38.562884] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T17:36:38.712093] [INFO ] [REMOTE ] BFK: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T17:36:38.715268] [INFO ] [REMOTE ] BFK: Full fetch complete (19132 records). [2025-09-17T17:36:38.715373] [DEBUG] [VALIDATOR ] BFK: Validating primary data. [2025-09-17T17:36:38.820674] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-08. [2025-09-17T17:36:39.112125] [DEBUG] [VALIDATOR ] BFK: All expected trading days are present. [2025-09-17T17:36:39.112206] [DEBUG] [VALIDATOR ] BFK: Primary data validation passed. [2025-09-17T17:36:39.112584] [INFO ] [MAIN ] BFK: Fetched primary data is valid. [2025-09-17T17:36:39.112625] [DEBUG] [LOCAL ] BFK: Saving primary data. [2025-09-17T17:36:39.113266] [DEBUG] [LOCAL ] BFK: Trimmed 19132 records to 13965 (keeping 200 days of data) [2025-09-17T17:36:39.209362] [DEBUG] [LOCAL ] BFK: Primary data saved (13965 records). [2025-09-17T17:36:39.209534] [INFO ] [MAIN ] BFK: Full history saved. [2025-09-17T17:36:39.209680] [INFO ] [MAIN ] Update Progress: 255/2371 symbols completed. BFK took 38.9s. Estimated remaining: 5h 3m 53s. Rate: 7.0 symbols/min [2025-09-17T17:36:39.407740] [INFO ] [MAIN ] BG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:36:39.455820] [DEBUG] [LOCAL ] BG: Loaded 50385 existing records from primary storage. [2025-09-17T17:36:39.455968] [INFO ] [MAIN ] BG: Loaded 50385 existing records. [2025-09-17T17:36:39.639233] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-02. [2025-09-17T17:36:39.646038] [WARN ] [MAIN ] BG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:36:39.646311] [INFO ] [MAIN ] BG: Wiping existing primary data before full refresh. [2025-09-17T17:36:39.646358] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-17T17:36:39.647585] [DEBUG] [LOCAL ] BG: Deleted primary data file. [2025-09-17T17:36:39.647672] [INFO ] [MAIN ] BG: Starting full primary refresh. [2025-09-17T17:36:40.012120] [INFO ] [REMOTE ] BG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:36:40.292758] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T17:36:40.415787] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-11. [2025-09-17T17:36:40.686281] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T17:36:41.215787] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-03. [2025-09-17T17:36:41.783220] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T17:36:41.979664] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T17:36:42.015758] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-04. [2025-09-17T17:36:42.818086] [INFO ] [REMOTE ] BFLY: Fetching primary data for 2025-09. [2025-09-17T17:36:42.818973] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T17:36:43.615765] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2024-12. [2025-09-17T17:36:44.415758] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-05. [2025-09-17T17:36:44.585099] [INFO ] [REMOTE ] BFLY: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T17:36:44.591966] [INFO ] [REMOTE ] BFLY: Full fetch complete (75050 records). [2025-09-17T17:36:44.592147] [DEBUG] [VALIDATOR ] BFLY: Validating primary data. [2025-09-17T17:36:44.897463] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T17:36:45.033720] [DEBUG] [VALIDATOR ] BFLY: All expected trading days are present. [2025-09-17T17:36:45.033872] [DEBUG] [VALIDATOR ] BFLY: Primary data validation passed. [2025-09-17T17:36:45.034828] [INFO ] [MAIN ] BFLY: Fetched primary data is valid. [2025-09-17T17:36:45.034887] [DEBUG] [LOCAL ] BFLY: Saving primary data. [2025-09-17T17:36:45.036500] [DEBUG] [LOCAL ] BFLY: Trimmed 75050 records to 51833 (keeping 200 days of data) [2025-09-17T17:36:45.132372] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T17:36:45.220504] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-01. [2025-09-17T17:36:45.351622] [DEBUG] [LOCAL ] BFLY: Primary data saved (51833 records). [2025-09-17T17:36:45.351796] [INFO ] [MAIN ] BFLY: Full history saved. [2025-09-17T17:36:45.353313] [INFO ] [MAIN ] Update Progress: 256/2371 symbols completed. BFLY took 35.1s. Estimated remaining: 5h 3m 24s. Rate: 7.0 symbols/min [2025-09-17T17:36:45.526920] [INFO ] [MAIN ] BGB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:36:45.547204] [DEBUG] [LOCAL ] BGB: Loaded 17666 existing records from primary storage. [2025-09-17T17:36:45.547368] [INFO ] [MAIN ] BGB: Loaded 17666 existing records. [2025-09-17T17:36:45.724742] [WARN ] [MAIN ] BGB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:36:45.725001] [INFO ] [MAIN ] BGB: Wiping existing primary data before full refresh. [2025-09-17T17:36:45.725046] [INFO ] [LOCAL ] BGB: Starting deletion of primary data. [2025-09-17T17:36:45.725634] [DEBUG] [LOCAL ] BGB: Deleted primary data file. [2025-09-17T17:36:45.725706] [INFO ] [MAIN ] BGB: Starting full primary refresh. [2025-09-17T17:36:46.016831] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-06. [2025-09-17T17:36:46.017357] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T17:36:46.099593] [INFO ] [REMOTE ] BGB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:36:46.815795] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-11. [2025-09-17T17:36:46.824330] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T17:36:47.615826] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-02. [2025-09-17T17:36:47.992946] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T17:36:48.279539] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T17:36:48.415761] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-03. [2025-09-17T17:36:48.995508] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T17:36:49.215802] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-07. [2025-09-17T17:36:50.015778] [INFO ] [REMOTE ] BGB: Fetching primary data for 2024-12. [2025-09-17T17:36:50.081392] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T17:36:50.815795] [INFO ] [REMOTE ] BG: Fetching primary data for 2024-12. [2025-09-17T17:36:50.855434] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T17:36:51.615795] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-04. [2025-09-17T17:36:52.405002] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T17:36:52.415673] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-05. [2025-09-17T17:36:52.485196] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T17:36:53.215790] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-08. [2025-09-17T17:36:53.237360] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T17:36:54.015770] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-06. [2025-09-17T17:36:54.049154] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T17:36:54.815757] [INFO ] [REMOTE ] BFS: Fetching primary data for 2025-09. [2025-09-17T17:36:54.938666] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T17:36:55.364531] [INFO ] [REMOTE ] BFS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T17:36:55.367407] [INFO ] [REMOTE ] BFS: Full fetch complete (12324 records). [2025-09-17T17:36:55.367822] [DEBUG] [VALIDATOR ] BFS: Validating primary data. [2025-09-17T17:36:55.621015] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-07. [2025-09-17T17:36:55.772336] [DEBUG] [VALIDATOR ] BFS: All expected trading days are present. [2025-09-17T17:36:55.772440] [DEBUG] [VALIDATOR ] BFS: Primary data validation passed. [2025-09-17T17:36:55.772893] [INFO ] [MAIN ] BFS: Fetched primary data is valid. [2025-09-17T17:36:55.772956] [DEBUG] [LOCAL ] BFS: Saving primary data. [2025-09-17T17:36:55.773525] [DEBUG] [LOCAL ] BFS: Trimmed 12324 records to 9033 (keeping 200 days of data) [2025-09-17T17:36:55.835543] [DEBUG] [LOCAL ] BFS: Primary data saved (9033 records). [2025-09-17T17:36:55.835763] [INFO ] [MAIN ] BFS: Full history saved. [2025-09-17T17:36:55.835934] [INFO ] [MAIN ] Update Progress: 257/2371 symbols completed. BFS took 24.6s. Estimated remaining: 5h 3m 31s. Rate: 7.0 symbols/min [2025-09-17T17:36:56.025018] [INFO ] [MAIN ] BGH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:36:56.046361] [DEBUG] [LOCAL ] BGH: Loaded 16427 existing records from primary storage. [2025-09-17T17:36:56.046579] [INFO ] [MAIN ] BGH: Loaded 16427 existing records. [2025-09-17T17:36:56.234545] [WARN ] [MAIN ] BGH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:36:56.234930] [INFO ] [MAIN ] BGH: Wiping existing primary data before full refresh. [2025-09-17T17:36:56.234982] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-17T17:36:56.235664] [DEBUG] [LOCAL ] BGH: Deleted primary data file. [2025-09-17T17:36:56.235737] [INFO ] [MAIN ] BGH: Starting full primary refresh. [2025-09-17T17:36:56.426178] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-01. [2025-09-17T17:36:56.552760] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T17:36:56.628841] [INFO ] [REMOTE ] BGH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:36:57.215805] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-08. [2025-09-17T17:36:57.586445] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T17:36:58.015836] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-01. [2025-09-17T17:36:58.061629] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T17:36:58.815826] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-11. [2025-09-17T17:36:59.497871] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T17:36:59.615754] [INFO ] [REMOTE ] BFZ: Fetching primary data for 2025-09. [2025-09-17T17:36:59.883274] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T17:37:00.415785] [INFO ] [REMOTE ] BGH: Fetching primary data for 2024-12. [2025-09-17T17:37:00.870027] [INFO ] [REMOTE ] BFZ: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T17:37:00.872414] [INFO ] [REMOTE ] BFZ: Full fetch complete (17893 records). [2025-09-17T17:37:00.872495] [DEBUG] [VALIDATOR ] BFZ: Validating primary data. [2025-09-17T17:37:01.224920] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-02. [2025-09-17T17:37:01.234996] [DEBUG] [VALIDATOR ] BFZ: All expected trading days are present. [2025-09-17T17:37:01.235056] [DEBUG] [VALIDATOR ] BFZ: Primary data validation passed. [2025-09-17T17:37:01.235388] [INFO ] [MAIN ] BFZ: Fetched primary data is valid. [2025-09-17T17:37:01.235429] [DEBUG] [LOCAL ] BFZ: Saving primary data. [2025-09-17T17:37:01.236133] [DEBUG] [LOCAL ] BFZ: Trimmed 17893 records to 11444 (keeping 200 days of data) [2025-09-17T17:37:01.311580] [DEBUG] [LOCAL ] BFZ: Primary data saved (11444 records). [2025-09-17T17:37:01.311799] [INFO ] [MAIN ] BFZ: Full history saved. [2025-09-17T17:37:01.311966] [INFO ] [MAIN ] Update Progress: 258/2371 symbols completed. BFZ took 27.7s. Estimated remaining: 5h 2m 57s. Rate: 7.0 symbols/min [2025-09-17T17:37:01.417113] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T17:37:01.508619] [INFO ] [MAIN ] BGR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:37:01.508820] [DEBUG] [LOCAL ] BGR: No existing data file found in primary storage. [2025-09-17T17:37:01.508861] [WARN ] [MAIN ] BGR: No existing data found, performing full refresh instead. [2025-09-17T17:37:01.509016] [INFO ] [MAIN ] BGR: Wiping existing primary data before full refresh. [2025-09-17T17:37:01.509066] [INFO ] [LOCAL ] BGR: Starting deletion of primary data. [2025-09-17T17:37:01.509125] [DEBUG] [LOCAL ] BGR: No primary data file found to delete. [2025-09-17T17:37:01.509162] [INFO ] [MAIN ] BGR: Starting full primary refresh. [2025-09-17T17:37:01.881472] [INFO ] [REMOTE ] BGR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:37:02.015815] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-11. [2025-09-17T17:37:02.815850] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-02. [2025-09-17T17:37:03.059989] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T17:37:03.095398] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T17:37:03.615851] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-01. [2025-09-17T17:37:03.639090] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T17:37:04.397871] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T17:37:04.415732] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-02. [2025-09-17T17:37:05.215786] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-03. [2025-09-17T17:37:05.313059] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T17:37:06.015786] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-03. [2025-09-17T17:37:06.815833] [INFO ] [REMOTE ] BGR: Fetching primary data for 2024-12. [2025-09-17T17:37:06.959433] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T17:37:06.999571] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T17:37:07.386084] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T17:37:07.615935] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-01. [2025-09-17T17:37:08.255798] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T17:37:08.415827] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-02. [2025-09-17T17:37:09.215790] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-04. [2025-09-17T17:37:09.341551] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T17:37:10.015783] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-03. [2025-09-17T17:37:10.586540] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T17:37:10.611320] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T17:37:10.815796] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-04. [2025-09-17T17:37:11.615849] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-04. [2025-09-17T17:37:12.415786] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-03. [2025-09-17T17:37:12.486904] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T17:37:12.660528] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T17:37:13.079092] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T17:37:13.215773] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-05. [2025-09-17T17:37:14.015765] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-04. [2025-09-17T17:37:14.815773] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-05. [2025-09-17T17:37:14.995703] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T17:37:15.097684] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T17:37:15.576628] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T17:37:15.615771] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-06. [2025-09-17T17:37:16.415829] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-05. [2025-09-17T17:37:16.698897] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T17:37:17.153740] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T17:37:17.215738] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-06. [2025-09-17T17:37:18.015804] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-05. [2025-09-17T17:37:18.205977] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T17:37:18.815718] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-06. [2025-09-17T17:37:19.009234] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T17:37:19.615796] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-06. [2025-09-17T17:37:20.415765] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-07. [2025-09-17T17:37:20.493560] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T17:37:20.495510] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T17:37:21.215792] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-07. [2025-09-17T17:37:21.300434] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T17:37:22.015855] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-07. [2025-09-17T17:37:22.028108] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T17:37:22.815822] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-08. [2025-09-17T17:37:23.615761] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-07. [2025-09-17T17:37:23.734279] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T17:37:23.756206] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T17:37:24.415770] [INFO ] [REMOTE ] BGB: Fetching primary data for 2025-09. [2025-09-17T17:37:24.739040] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T17:37:25.215838] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-08. [2025-09-17T17:37:25.378387] [INFO ] [REMOTE ] BGB: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T17:37:25.381046] [INFO ] [REMOTE ] BGB: Full fetch complete (27063 records). [2025-09-17T17:37:25.381144] [DEBUG] [VALIDATOR ] BGB: Validating primary data. [2025-09-17T17:37:25.817820] [DEBUG] [VALIDATOR ] BGB: All expected trading days are present. [2025-09-17T17:37:25.817925] [DEBUG] [VALIDATOR ] BGB: Primary data validation passed. [2025-09-17T17:37:25.818540] [INFO ] [MAIN ] BGB: Fetched primary data is valid. [2025-09-17T17:37:25.818604] [DEBUG] [LOCAL ] BGB: Saving primary data. [2025-09-17T17:37:25.820622] [DEBUG] [LOCAL ] BGB: Trimmed 27063 records to 17659 (keeping 200 days of data) [2025-09-17T17:37:25.945167] [DEBUG] [LOCAL ] BGB: Primary data saved (17659 records). [2025-09-17T17:37:25.945330] [INFO ] [MAIN ] BGB: Full history saved. [2025-09-17T17:37:25.945453] [INFO ] [MAIN ] Update Progress: 259/2371 symbols completed. BGB took 40.6s. Estimated remaining: 5h 4m 59s. Rate: 6.9 symbols/min [2025-09-17T17:37:26.022922] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-08. [2025-09-17T17:37:26.127129] [INFO ] [MAIN ] BGS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:37:26.175301] [DEBUG] [LOCAL ] BGS: Loaded 50432 existing records from primary storage. [2025-09-17T17:37:26.175439] [INFO ] [MAIN ] BGS: Loaded 50432 existing records. [2025-09-17T17:37:26.356180] [WARN ] [MAIN ] BGS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:37:26.356437] [INFO ] [MAIN ] BGS: Wiping existing primary data before full refresh. [2025-09-17T17:37:26.356483] [INFO ] [LOCAL ] BGS: Starting deletion of primary data. [2025-09-17T17:37:26.357773] [DEBUG] [LOCAL ] BGS: Deleted primary data file. [2025-09-17T17:37:26.357840] [INFO ] [MAIN ] BGS: Starting full primary refresh. [2025-09-17T17:37:26.740098] [INFO ] [REMOTE ] BGS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:37:26.815751] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-11. [2025-09-17T17:37:27.094582] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T17:37:27.229357] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T17:37:27.615787] [INFO ] [REMOTE ] BG: Fetching primary data for 2025-09. [2025-09-17T17:37:28.415779] [INFO ] [REMOTE ] BGH: Fetching primary data for 2025-09. [2025-09-17T17:37:28.660471] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T17:37:29.215801] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-08. [2025-09-17T17:37:29.345474] [INFO ] [REMOTE ] BG: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T17:37:29.351973] [INFO ] [REMOTE ] BG: Full fetch complete (72178 records). [2025-09-17T17:37:29.352135] [DEBUG] [VALIDATOR ] BG: Validating primary data. [2025-09-17T17:37:29.353046] [FATAL] [VALIDATOR ] BG: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:37:29.353178] [FATAL] [MAIN ] BG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:37:29.353218] [WARN ] [MAIN ] BG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:37:29.353259] [INFO ] [LOCAL ] BG: Starting deletion of primary data. [2025-09-17T17:37:29.353319] [DEBUG] [LOCAL ] BG: No primary data file found to delete. [2025-09-17T17:37:29.353359] [INFO ] [LOCAL ] BG: Starting deletion of derivative data. [2025-09-17T17:37:29.353813] [DEBUG] [LOCAL ] BG: Deleted derivative data file. [2025-09-17T17:37:29.354453] [INFO ] [MAIN ] Update Progress: 260/2371 symbols completed. BG took 50.1s. Estimated remaining: 5h 4m 8s. Rate: 6.9 symbols/min [2025-09-17T17:37:29.499060] [INFO ] [REMOTE ] BGH: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T17:37:29.547670] [INFO ] [REMOTE ] BGH: Full fetch complete (21555 records). [2025-09-17T17:37:29.570395] [INFO ] [MAIN ] BGSF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:37:29.570586] [DEBUG] [VALIDATOR ] BGH: Validating primary data. [2025-09-17T17:37:29.571565] [FATAL] [VALIDATOR ] BGH: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:37:29.571784] [FATAL] [MAIN ] BGH: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:37:29.571854] [WARN ] [MAIN ] BGH: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:37:29.571915] [INFO ] [LOCAL ] BGH: Starting deletion of primary data. [2025-09-17T17:37:29.571990] [DEBUG] [LOCAL ] BGH: No primary data file found to delete. [2025-09-17T17:37:29.572045] [INFO ] [LOCAL ] BGH: Starting deletion of derivative data. [2025-09-17T17:37:29.572391] [DEBUG] [LOCAL ] BGH: Deleted derivative data file. [2025-09-17T17:37:29.572534] [INFO ] [MAIN ] Update Progress: 261/2371 symbols completed. BGH took 33.7s. Estimated remaining: 5h 2m 51s. Rate: 7.0 symbols/min [2025-09-17T17:37:29.681428] [DEBUG] [LOCAL ] BGSF: Loaded 5765 existing records from primary storage. [2025-09-17T17:37:29.687234] [INFO ] [MAIN ] BGSF: Loaded 5765 existing records. [2025-09-17T17:37:29.854920] [INFO ] [MAIN ] BGT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:37:29.941965] [WARN ] [MAIN ] BGSF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:37:29.942264] [INFO ] [MAIN ] BGSF: Wiping existing primary data before full refresh. [2025-09-17T17:37:29.942352] [INFO ] [LOCAL ] BGSF: Starting deletion of primary data. [2025-09-17T17:37:29.942673] [DEBUG] [LOCAL ] BGSF: Deleted primary data file. [2025-09-17T17:37:29.942792] [INFO ] [MAIN ] BGSF: Starting full primary refresh. [2025-09-17T17:37:30.019986] [INFO ] [REMOTE ] BGS: Fetching primary data for 2024-12. [2025-09-17T17:37:30.054386] [DEBUG] [LOCAL ] BGT: Loaded 16701 existing records from primary storage. [2025-09-17T17:37:30.072842] [INFO ] [MAIN ] BGT: Loaded 16701 existing records. [2025-09-17T17:37:30.496356] [INFO ] [REMOTE ] BGSF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:37:30.499180] [WARN ] [MAIN ] BGT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:37:30.508242] [INFO ] [MAIN ] BGT: Wiping existing primary data before full refresh. [2025-09-17T17:37:30.508544] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T17:37:30.509785] [INFO ] [LOCAL ] BGT: Starting deletion of primary data. [2025-09-17T17:37:30.512390] [DEBUG] [LOCAL ] BGT: Deleted primary data file. [2025-09-17T17:37:30.512440] [INFO ] [MAIN ] BGT: Starting full primary refresh. [2025-09-17T17:37:30.819090] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-11. [2025-09-17T17:37:30.897997] [INFO ] [REMOTE ] BGT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:37:31.577593] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T17:37:31.615774] [INFO ] [REMOTE ] BGR: Fetching primary data for 2025-09. [2025-09-17T17:37:31.766390] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T17:37:32.415756] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2024-12. [2025-09-17T17:37:32.634478] [INFO ] [REMOTE ] BGR: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T17:37:32.637518] [INFO ] [REMOTE ] BGR: Full fetch complete (20273 records). [2025-09-17T17:37:32.637618] [DEBUG] [VALIDATOR ] BGR: Validating primary data. [2025-09-17T17:37:33.035231] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T17:37:33.044663] [DEBUG] [VALIDATOR ] BGR: All expected trading days are present. [2025-09-17T17:37:33.046019] [DEBUG] [VALIDATOR ] BGR: Primary data validation passed. [2025-09-17T17:37:33.047119] [INFO ] [MAIN ] BGR: Fetched primary data is valid. [2025-09-17T17:37:33.047175] [DEBUG] [LOCAL ] BGR: Saving primary data. [2025-09-17T17:37:33.048051] [DEBUG] [LOCAL ] BGR: Trimmed 20273 records to 13572 (keeping 200 days of data) [2025-09-17T17:37:33.133853] [DEBUG] [LOCAL ] BGR: Primary data saved (13572 records). [2025-09-17T17:37:33.134002] [INFO ] [MAIN ] BGR: Full history saved. [2025-09-17T17:37:33.134081] [INFO ] [MAIN ] Update Progress: 262/2371 symbols completed. BGR took 31.8s. Estimated remaining: 5h 2m 2s. Rate: 7.0 symbols/min [2025-09-17T17:37:33.221001] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-01. [2025-09-17T17:37:33.307277] [INFO ] [MAIN ] BGX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:37:33.319552] [DEBUG] [LOCAL ] BGX: Loaded 10884 existing records from primary storage. [2025-09-17T17:37:33.319671] [INFO ] [MAIN ] BGX: Loaded 10884 existing records. [2025-09-17T17:37:33.499021] [WARN ] [MAIN ] BGX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:37:33.499304] [INFO ] [MAIN ] BGX: Wiping existing primary data before full refresh. [2025-09-17T17:37:33.499350] [INFO ] [LOCAL ] BGX: Starting deletion of primary data. [2025-09-17T17:37:33.499888] [DEBUG] [LOCAL ] BGX: Deleted primary data file. [2025-09-17T17:37:33.499939] [INFO ] [MAIN ] BGX: Starting full primary refresh. [2025-09-17T17:37:33.774343] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T17:37:33.889893] [INFO ] [REMOTE ] BGX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:37:34.015725] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-11. [2025-09-17T17:37:34.815792] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-02. [2025-09-17T17:37:34.907942] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T17:37:35.094588] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-17T17:37:35.615795] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-03. [2025-09-17T17:37:36.301533] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T17:37:36.415784] [INFO ] [REMOTE ] BGX: Fetching primary data for 2024-12. [2025-09-17T17:37:37.184734] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T17:37:37.215729] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-01. [2025-09-17T17:37:38.014210] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T17:37:38.016974] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-04. [2025-09-17T17:37:38.541270] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T17:37:38.815815] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-02. [2025-09-17T17:37:39.616125] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-05. [2025-09-17T17:37:39.617692] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T17:37:40.269863] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T17:37:40.415782] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-01. [2025-09-17T17:37:41.215828] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-11. [2025-09-17T17:37:42.015820] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-06. [2025-09-17T17:37:42.121182] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T17:37:42.238731] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T17:37:42.688291] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T17:37:42.815779] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-03. [2025-09-17T17:37:43.615808] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-07. [2025-09-17T17:37:43.739043] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T17:37:44.415776] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-04. [2025-09-17T17:37:44.435929] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T17:37:45.215817] [INFO ] [REMOTE ] BGT: Fetching primary data for 2024-12. [2025-09-17T17:37:45.666207] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T17:37:46.009610] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T17:37:46.015710] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-01. [2025-09-17T17:37:46.815818] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-05. [2025-09-17T17:37:47.095827] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T17:37:47.615771] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-02. [2025-09-17T17:37:47.691460] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T17:37:48.415813] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-02. [2025-09-17T17:37:48.967873] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T17:37:49.215814] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-08. [2025-09-17T17:37:49.314263] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T17:37:49.646461] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T17:37:50.015784] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-06. [2025-09-17T17:37:50.815828] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-03. [2025-09-17T17:37:50.841500] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T17:37:51.624378] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-07. [2025-09-17T17:37:51.626315] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T17:37:52.415754] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-03. [2025-09-17T17:37:52.600349] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T17:37:53.215793] [INFO ] [REMOTE ] BGSF: Fetching primary data for 2025-09. [2025-09-17T17:37:54.015843] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-08. [2025-09-17T17:37:54.280687] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T17:37:54.393036] [INFO ] [REMOTE ] BGSF: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T17:37:54.396432] [INFO ] [REMOTE ] BGSF: Full fetch complete (7420 records). [2025-09-17T17:37:54.396626] [DEBUG] [VALIDATOR ] BGSF: Validating primary data. [2025-09-17T17:37:54.777163] [DEBUG] [VALIDATOR ] BGSF: All expected trading days are present. [2025-09-17T17:37:54.777245] [DEBUG] [VALIDATOR ] BGSF: Primary data validation passed. [2025-09-17T17:37:54.777457] [INFO ] [MAIN ] BGSF: Fetched primary data is valid. [2025-09-17T17:37:54.777495] [DEBUG] [LOCAL ] BGSF: Saving primary data. [2025-09-17T17:37:54.777931] [DEBUG] [LOCAL ] BGSF: Trimmed 7420 records to 5983 (keeping 200 days of data) [2025-09-17T17:37:54.813392] [DEBUG] [LOCAL ] BGSF: Primary data saved (5983 records). [2025-09-17T17:37:54.813505] [INFO ] [MAIN ] BGSF: Full history saved. [2025-09-17T17:37:54.813597] [INFO ] [MAIN ] Update Progress: 263/2371 symbols completed. BGSF took 25.5s. Estimated remaining: 5h 3m 38s. Rate: 6.9 symbols/min [2025-09-17T17:37:54.824971] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-04. [2025-09-17T17:37:54.988236] [INFO ] [MAIN ] BGY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:37:55.010837] [DEBUG] [LOCAL ] BGY: Loaded 23194 existing records from primary storage. [2025-09-17T17:37:55.011036] [INFO ] [MAIN ] BGY: Loaded 23194 existing records. [2025-09-17T17:37:55.127048] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T17:37:55.210212] [WARN ] [MAIN ] BGY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:37:55.210474] [INFO ] [MAIN ] BGY: Wiping existing primary data before full refresh. [2025-09-17T17:37:55.210527] [INFO ] [LOCAL ] BGY: Starting deletion of primary data. [2025-09-17T17:37:55.211219] [DEBUG] [LOCAL ] BGY: Deleted primary data file. [2025-09-17T17:37:55.211266] [INFO ] [MAIN ] BGY: Starting full primary refresh. [2025-09-17T17:37:55.567740] [INFO ] [REMOTE ] BGY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:37:55.615785] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-11. [2025-09-17T17:37:56.415838] [INFO ] [REMOTE ] BGX: Fetching primary data for 2025-09. [2025-09-17T17:37:56.684071] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T17:37:56.896773] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T17:37:57.215850] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-05. [2025-09-17T17:37:57.503242] [INFO ] [REMOTE ] BGX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T17:37:57.506986] [INFO ] [REMOTE ] BGX: Full fetch complete (15723 records). [2025-09-17T17:37:57.507173] [DEBUG] [VALIDATOR ] BGX: Validating primary data. [2025-09-17T17:37:57.934591] [DEBUG] [VALIDATOR ] BGX: All expected trading days are present. [2025-09-17T17:37:57.934691] [DEBUG] [VALIDATOR ] BGX: Primary data validation passed. [2025-09-17T17:37:57.934989] [INFO ] [MAIN ] BGX: Fetched primary data is valid. [2025-09-17T17:37:57.935026] [DEBUG] [LOCAL ] BGX: Saving primary data. [2025-09-17T17:37:57.935512] [DEBUG] [LOCAL ] BGX: Trimmed 15723 records to 10883 (keeping 200 days of data) [2025-09-17T17:37:58.003231] [DEBUG] [LOCAL ] BGX: Primary data saved (10883 records). [2025-09-17T17:37:58.003364] [INFO ] [MAIN ] BGX: Full history saved. [2025-09-17T17:37:58.003447] [INFO ] [MAIN ] Update Progress: 264/2371 symbols completed. BGX took 24.9s. Estimated remaining: 5h 2m 46s. Rate: 7.0 symbols/min [2025-09-17T17:37:58.024348] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-04. [2025-09-17T17:37:58.175787] [INFO ] [MAIN ] BH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:37:58.191424] [DEBUG] [LOCAL ] BH: Loaded 15192 existing records from primary storage. [2025-09-17T17:37:58.191542] [INFO ] [MAIN ] BH: Loaded 15192 existing records. [2025-09-17T17:37:58.373804] [WARN ] [MAIN ] BH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:37:58.374077] [INFO ] [MAIN ] BH: Wiping existing primary data before full refresh. [2025-09-17T17:37:58.374125] [INFO ] [LOCAL ] BH: Starting deletion of primary data. [2025-09-17T17:37:58.374667] [DEBUG] [LOCAL ] BH: Deleted primary data file. [2025-09-17T17:37:58.374728] [INFO ] [MAIN ] BH: Starting full primary refresh. [2025-09-17T17:37:58.737118] [INFO ] [REMOTE ] BH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:37:58.815731] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-11. [2025-09-17T17:37:58.994811] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T17:37:59.103920] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T17:37:59.257223] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T17:37:59.615824] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-05. [2025-09-17T17:38:00.415757] [INFO ] [REMOTE ] BGY: Fetching primary data for 2024-12. [2025-09-17T17:38:00.530415] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T17:38:01.215808] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-06. [2025-09-17T17:38:01.431802] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T17:38:02.015785] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-06. [2025-09-17T17:38:02.138608] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T17:38:02.815817] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-07. [2025-09-17T17:38:03.346872] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T17:38:03.615782] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-01. [2025-09-17T17:38:03.962601] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T17:38:04.415784] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-08. [2025-09-17T17:38:04.744683] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T17:38:05.215792] [INFO ] [REMOTE ] BH: Fetching primary data for 2024-12. [2025-09-17T17:38:05.398303] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T17:38:06.015883] [INFO ] [REMOTE ] BGT: Fetching primary data for 2025-09. [2025-09-17T17:38:06.274420] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T17:38:06.815839] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-02. [2025-09-17T17:38:07.001138] [INFO ] [REMOTE ] BGT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T17:38:07.004325] [INFO ] [REMOTE ] BGT: Full fetch complete (24458 records). [2025-09-17T17:38:07.004505] [DEBUG] [VALIDATOR ] BGT: Validating primary data. [2025-09-17T17:38:07.379109] [DEBUG] [VALIDATOR ] BGT: All expected trading days are present. [2025-09-17T17:38:07.379192] [DEBUG] [VALIDATOR ] BGT: Primary data validation passed. [2025-09-17T17:38:07.379583] [INFO ] [MAIN ] BGT: Fetched primary data is valid. [2025-09-17T17:38:07.379624] [DEBUG] [LOCAL ] BGT: Saving primary data. [2025-09-17T17:38:07.380307] [DEBUG] [LOCAL ] BGT: Trimmed 24458 records to 16731 (keeping 200 days of data) [2025-09-17T17:38:07.485529] [DEBUG] [LOCAL ] BGT: Primary data saved (16731 records). [2025-09-17T17:38:07.485717] [INFO ] [MAIN ] BGT: Full history saved. [2025-09-17T17:38:07.485833] [INFO ] [MAIN ] Update Progress: 265/2371 symbols completed. BGT took 37.9s. Estimated remaining: 5h 2m 44s. Rate: 7.0 symbols/min [2025-09-17T17:38:07.632757] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-07. [2025-09-17T17:38:07.669621] [INFO ] [MAIN ] BHC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:38:07.715736] [DEBUG] [LOCAL ] BHC: Loaded 46774 existing records from primary storage. [2025-09-17T17:38:07.715912] [INFO ] [MAIN ] BHC: Loaded 46774 existing records. [2025-09-17T17:38:07.891909] [WARN ] [MAIN ] BHC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:38:07.892161] [INFO ] [MAIN ] BHC: Wiping existing primary data before full refresh. [2025-09-17T17:38:07.892207] [INFO ] [LOCAL ] BHC: Starting deletion of primary data. [2025-09-17T17:38:07.893157] [DEBUG] [LOCAL ] BHC: Deleted primary data file. [2025-09-17T17:38:07.893210] [INFO ] [MAIN ] BHC: Starting full primary refresh. [2025-09-17T17:38:08.189509] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T17:38:08.272220] [INFO ] [REMOTE ] BHC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:38:08.415739] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-11. [2025-09-17T17:38:09.215797] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-03. [2025-09-17T17:38:09.587023] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T17:38:10.015801] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-08. [2025-09-17T17:38:10.815769] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-01. [2025-09-17T17:38:10.863585] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T17:38:11.615786] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-04. [2025-09-17T17:38:11.662999] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-11 (3.25 seconds). [2025-09-17T17:38:11.663304] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T17:38:11.751559] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T17:38:12.415806] [INFO ] [REMOTE ] BHC: Fetching primary data for 2024-12. [2025-09-17T17:38:12.743335] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T17:38:13.215816] [INFO ] [REMOTE ] BGS: Fetching primary data for 2025-09. [2025-09-17T17:38:13.892929] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T17:38:14.015812] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-02. [2025-09-17T17:38:14.634707] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T17:38:14.819309] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-03. [2025-09-17T17:38:14.823221] [INFO ] [REMOTE ] BGS: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T17:38:14.830104] [INFO ] [REMOTE ] BGS: Full fetch complete (72245 records). [2025-09-17T17:38:14.830236] [DEBUG] [VALIDATOR ] BGS: Validating primary data. [2025-09-17T17:38:15.216865] [DEBUG] [VALIDATOR ] BGS: All expected trading days are present. [2025-09-17T17:38:15.216950] [DEBUG] [VALIDATOR ] BGS: Primary data validation passed. [2025-09-17T17:38:15.217696] [INFO ] [MAIN ] BGS: Fetched primary data is valid. [2025-09-17T17:38:15.217741] [DEBUG] [LOCAL ] BGS: Saving primary data. [2025-09-17T17:38:15.219157] [DEBUG] [LOCAL ] BGS: Trimmed 72245 records to 50410 (keeping 200 days of data) [2025-09-17T17:38:15.520292] [DEBUG] [LOCAL ] BGS: Primary data saved (50410 records). [2025-09-17T17:38:15.520460] [INFO ] [MAIN ] BGS: Full history saved. [2025-09-17T17:38:15.521221] [INFO ] [MAIN ] Update Progress: 266/2371 symbols completed. BGS took 49.6s. Estimated remaining: 5h 2m 31s. Rate: 7.0 symbols/min [2025-09-17T17:38:15.620826] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-05. [2025-09-17T17:38:15.693796] [INFO ] [MAIN ] BHE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:38:15.702480] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T17:38:15.732569] [DEBUG] [LOCAL ] BHE: Loaded 25454 existing records from primary storage. [2025-09-17T17:38:15.732759] [INFO ] [MAIN ] BHE: Loaded 25454 existing records. [2025-09-17T17:38:15.914627] [WARN ] [MAIN ] BHE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:38:15.914891] [INFO ] [MAIN ] BHE: Wiping existing primary data before full refresh. [2025-09-17T17:38:15.914938] [INFO ] [LOCAL ] BHE: Starting deletion of primary data. [2025-09-17T17:38:15.915747] [DEBUG] [LOCAL ] BHE: Deleted primary data file. [2025-09-17T17:38:15.915811] [INFO ] [MAIN ] BHE: Starting full primary refresh. [2025-09-17T17:38:16.285564] [INFO ] [REMOTE ] BHE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:38:16.415763] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-11. [2025-09-17T17:38:16.816022] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T17:38:17.215770] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-06. [2025-09-17T17:38:17.535954] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T17:38:18.015836] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-04. [2025-09-17T17:38:18.648807] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T17:38:18.815797] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-01. [2025-09-17T17:38:18.885092] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T17:38:19.615811] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-07. [2025-09-17T17:38:20.415770] [INFO ] [REMOTE ] BHE: Fetching primary data for 2024-12. [2025-09-17T17:38:20.452359] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T17:38:21.058621] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T17:38:21.215756] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-02. [2025-09-17T17:38:21.436182] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T17:38:22.015823] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-08. [2025-09-17T17:38:22.764851] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T17:38:22.815803] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-01. [2025-09-17T17:38:22.982528] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T17:38:23.615818] [INFO ] [REMOTE ] BGY: Fetching primary data for 2025-09. [2025-09-17T17:38:23.668945] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T17:38:24.415768] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-02. [2025-09-17T17:38:24.786420] [INFO ] [REMOTE ] BGY: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T17:38:24.789197] [INFO ] [REMOTE ] BGY: Full fetch complete (33783 records). [2025-09-17T17:38:24.789316] [DEBUG] [VALIDATOR ] BGY: Validating primary data. [2025-09-17T17:38:25.162302] [DEBUG] [VALIDATOR ] BGY: All expected trading days are present. [2025-09-17T17:38:25.162386] [DEBUG] [VALIDATOR ] BGY: Primary data validation passed. [2025-09-17T17:38:25.162836] [INFO ] [MAIN ] BGY: Fetched primary data is valid. [2025-09-17T17:38:25.162878] [DEBUG] [LOCAL ] BGY: Saving primary data. [2025-09-17T17:38:25.163914] [DEBUG] [LOCAL ] BGY: Trimmed 33783 records to 23166 (keeping 200 days of data) [2025-09-17T17:38:25.220950] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-05. [2025-09-17T17:38:25.301268] [DEBUG] [LOCAL ] BGY: Primary data saved (23166 records). [2025-09-17T17:38:25.301396] [INFO ] [MAIN ] BGY: Full history saved. [2025-09-17T17:38:25.301477] [INFO ] [MAIN ] Update Progress: 267/2371 symbols completed. BGY took 30.5s. Estimated remaining: 5h 2m 31s. Rate: 7.0 symbols/min [2025-09-17T17:38:25.504938] [INFO ] [MAIN ] BHK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:38:25.521283] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T17:38:25.543755] [DEBUG] [LOCAL ] BHK: Loaded 22400 existing records from primary storage. [2025-09-17T17:38:25.543878] [INFO ] [MAIN ] BHK: Loaded 22400 existing records. [2025-09-17T17:38:25.728244] [WARN ] [MAIN ] BHK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:38:25.728502] [INFO ] [MAIN ] BHK: Wiping existing primary data before full refresh. [2025-09-17T17:38:25.728550] [INFO ] [LOCAL ] BHK: Starting deletion of primary data. [2025-09-17T17:38:25.729050] [DEBUG] [LOCAL ] BHK: Deleted primary data file. [2025-09-17T17:38:25.729100] [INFO ] [MAIN ] BHK: Starting full primary refresh. [2025-09-17T17:38:26.020786] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-03. [2025-09-17T17:38:26.088734] [INFO ] [REMOTE ] BHK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:38:26.099613] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T17:38:26.815772] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-06. [2025-09-17T17:38:27.304448] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T17:38:27.532737] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T17:38:27.615826] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-03. [2025-09-17T17:38:28.415760] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-07. [2025-09-17T17:38:29.215751] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-04. [2025-09-17T17:38:29.243805] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T17:38:29.546069] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T17:38:30.015779] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-08. [2025-09-17T17:38:30.647213] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T17:38:30.815774] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-11. [2025-09-17T17:38:31.041592] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T17:38:31.524737] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T17:38:31.615836] [INFO ] [REMOTE ] BHK: Fetching primary data for 2024-12. [2025-09-17T17:38:32.415764] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-05. [2025-09-17T17:38:32.656275] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T17:38:33.215779] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-04. [2025-09-17T17:38:33.786630] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T17:38:34.015773] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-06. [2025-09-17T17:38:34.810596] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T17:38:34.820556] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-01. [2025-09-17T17:38:35.161801] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T17:38:35.615790] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-07. [2025-09-17T17:38:35.699222] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T17:38:36.415774] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-02. [2025-09-17T17:38:36.829480] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T17:38:37.215790] [INFO ] [REMOTE ] BH: Fetching primary data for 2025-09. [2025-09-17T17:38:37.389370] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T17:38:38.015755] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-05. [2025-09-17T17:38:38.273667] [INFO ] [REMOTE ] BH: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T17:38:38.276666] [INFO ] [REMOTE ] BH: Full fetch complete (19057 records). [2025-09-17T17:38:38.276738] [DEBUG] [VALIDATOR ] BH: Validating primary data. [2025-09-17T17:38:38.650426] [DEBUG] [VALIDATOR ] BH: All expected trading days are present. [2025-09-17T17:38:38.650535] [DEBUG] [VALIDATOR ] BH: Primary data validation passed. [2025-09-17T17:38:38.650873] [INFO ] [MAIN ] BH: Fetched primary data is valid. [2025-09-17T17:38:38.650916] [DEBUG] [LOCAL ] BH: Saving primary data. [2025-09-17T17:38:38.651606] [DEBUG] [LOCAL ] BH: Trimmed 19057 records to 15256 (keeping 200 days of data) [2025-09-17T17:38:38.746083] [DEBUG] [LOCAL ] BH: Primary data saved (15256 records). [2025-09-17T17:38:38.746246] [INFO ] [MAIN ] BH: Full history saved. [2025-09-17T17:38:38.746402] [INFO ] [MAIN ] Update Progress: 268/2371 symbols completed. BH took 40.7s. Estimated remaining: 5h 3m 0s. Rate: 6.9 symbols/min [2025-09-17T17:38:38.822555] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-08. [2025-09-17T17:38:38.918608] [INFO ] [MAIN ] BHP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:38:38.973726] [DEBUG] [LOCAL ] BHP: Loaded 53394 existing records from primary storage. [2025-09-17T17:38:38.973879] [INFO ] [MAIN ] BHP: Loaded 53394 existing records. [2025-09-17T17:38:39.153039] [WARN ] [MAIN ] BHP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:38:39.153276] [INFO ] [MAIN ] BHP: Wiping existing primary data before full refresh. [2025-09-17T17:38:39.153321] [INFO ] [LOCAL ] BHP: Starting deletion of primary data. [2025-09-17T17:38:39.154545] [DEBUG] [LOCAL ] BHP: Deleted primary data file. [2025-09-17T17:38:39.154596] [INFO ] [MAIN ] BHP: Starting full primary refresh. [2025-09-17T17:38:39.525239] [INFO ] [REMOTE ] BHP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:38:39.552932] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T17:38:39.615756] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-06. [2025-09-17T17:38:40.103473] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T17:38:40.415732] [INFO ] [REMOTE ] BHE: Fetching primary data for 2025-09. [2025-09-17T17:38:40.954840] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T17:38:41.215775] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-07. [2025-09-17T17:38:41.689856] [INFO ] [REMOTE ] BHE: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T17:38:41.692987] [INFO ] [REMOTE ] BHE: Full fetch complete (36363 records). [2025-09-17T17:38:41.693074] [DEBUG] [VALIDATOR ] BHE: Validating primary data. [2025-09-17T17:38:42.020874] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-11. [2025-09-17T17:38:42.066504] [DEBUG] [VALIDATOR ] BHE: All expected trading days are present. [2025-09-17T17:38:42.066580] [DEBUG] [VALIDATOR ] BHE: Primary data validation passed. [2025-09-17T17:38:42.067048] [INFO ] [MAIN ] BHE: Fetched primary data is valid. [2025-09-17T17:38:42.067092] [DEBUG] [LOCAL ] BHE: Saving primary data. [2025-09-17T17:38:42.067938] [DEBUG] [LOCAL ] BHE: Trimmed 36363 records to 25395 (keeping 200 days of data) [2025-09-17T17:38:42.221952] [DEBUG] [LOCAL ] BHE: Primary data saved (25395 records). [2025-09-17T17:38:42.222081] [INFO ] [MAIN ] BHE: Full history saved. [2025-09-17T17:38:42.222174] [INFO ] [MAIN ] Update Progress: 269/2371 symbols completed. BHE took 26.7s. Estimated remaining: 5h 2m 11s. Rate: 7.0 symbols/min [2025-09-17T17:38:42.396330] [INFO ] [MAIN ] BHR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:38:42.417332] [DEBUG] [LOCAL ] BHR: Loaded 21378 existing records from primary storage. [2025-09-17T17:38:42.417457] [INFO ] [MAIN ] BHR: Loaded 21378 existing records. [2025-09-17T17:38:42.596547] [WARN ] [MAIN ] BHR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:38:42.596879] [INFO ] [MAIN ] BHR: Wiping existing primary data before full refresh. [2025-09-17T17:38:42.596928] [INFO ] [LOCAL ] BHR: Starting deletion of primary data. [2025-09-17T17:38:42.597523] [DEBUG] [LOCAL ] BHR: Deleted primary data file. [2025-09-17T17:38:42.597573] [INFO ] [MAIN ] BHR: Starting full primary refresh. [2025-09-17T17:38:42.844129] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-03. [2025-09-17T17:38:42.965036] [INFO ] [REMOTE ] BHR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:38:42.991035] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T17:38:43.615845] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-11. [2025-09-17T17:38:44.058809] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T17:38:44.104315] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T17:38:44.415757] [INFO ] [REMOTE ] BHP: Fetching primary data for 2024-12. [2025-09-17T17:38:44.486913] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T17:38:45.215785] [INFO ] [REMOTE ] BHR: Fetching primary data for 2024-12. [2025-09-17T17:38:46.015880] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-04. [2025-09-17T17:38:46.255332] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T17:38:46.414040] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T17:38:46.659127] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T17:38:46.815787] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-01. [2025-09-17T17:38:47.615844] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-05. [2025-09-17T17:38:48.415801] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-08. [2025-09-17T17:38:48.705868] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T17:38:49.095841] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-17T17:38:49.215819] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-06. [2025-09-17T17:38:50.015768] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-02. [2025-09-17T17:38:50.083020] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T17:38:50.160446] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T17:38:50.815812] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-01. [2025-09-17T17:38:51.615757] [INFO ] [REMOTE ] BHC: Fetching primary data for 2025-09. [2025-09-17T17:38:51.792461] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T17:38:51.892143] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T17:38:52.415790] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-02. [2025-09-17T17:38:53.041152] [INFO ] [REMOTE ] BHC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T17:38:53.047556] [INFO ] [REMOTE ] BHC: Full fetch complete (66544 records). [2025-09-17T17:38:53.047715] [DEBUG] [VALIDATOR ] BHC: Validating primary data. [2025-09-17T17:38:53.226762] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-03. [2025-09-17T17:38:53.456978] [DEBUG] [VALIDATOR ] BHC: All expected trading days are present. [2025-09-17T17:38:53.458063] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T17:38:53.458233] [DEBUG] [VALIDATOR ] BHC: Primary data validation passed. [2025-09-17T17:38:53.463317] [INFO ] [MAIN ] BHC: Fetched primary data is valid. [2025-09-17T17:38:53.463398] [DEBUG] [LOCAL ] BHC: Saving primary data. [2025-09-17T17:38:53.465474] [DEBUG] [LOCAL ] BHC: Trimmed 66544 records to 46813 (keeping 200 days of data) [2025-09-17T17:38:53.751216] [DEBUG] [LOCAL ] BHC: Primary data saved (46813 records). [2025-09-17T17:38:53.751376] [INFO ] [MAIN ] BHC: Full history saved. [2025-09-17T17:38:53.752686] [INFO ] [MAIN ] Update Progress: 270/2371 symbols completed. BHC took 46.3s. Estimated remaining: 5h 2m 25s. Rate: 6.9 symbols/min [2025-09-17T17:38:53.934548] [INFO ] [MAIN ] BHV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:38:53.934798] [DEBUG] [LOCAL ] BHV: No existing data file found in primary storage. [2025-09-17T17:38:53.934841] [WARN ] [MAIN ] BHV: No existing data found, performing full refresh instead. [2025-09-17T17:38:53.934984] [INFO ] [MAIN ] BHV: Wiping existing primary data before full refresh. [2025-09-17T17:38:53.935025] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-17T17:38:53.935068] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-17T17:38:53.935101] [INFO ] [MAIN ] BHV: Starting full primary refresh. [2025-09-17T17:38:54.020946] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-07. [2025-09-17T17:38:54.315407] [INFO ] [REMOTE ] BHV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:38:54.815791] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-11. [2025-09-17T17:38:55.252470] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T17:38:55.446018] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T17:38:55.483426] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-17T17:38:55.615777] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-04. [2025-09-17T17:38:56.415775] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-03. [2025-09-17T17:38:57.215851] [INFO ] [REMOTE ] BHV: Fetching primary data for 2024-12. [2025-09-17T17:38:57.572553] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T17:38:57.615473] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T17:38:57.658062] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T17:38:58.015795] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-01. [2025-09-17T17:38:58.351780] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T17:38:58.815776] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-02. [2025-09-17T17:38:59.159303] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T17:38:59.615810] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-03. [2025-09-17T17:38:59.963124] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T17:39:00.415754] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-05. [2025-09-17T17:39:01.215791] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-04. [2025-09-17T17:39:02.015770] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-08. [2025-09-17T17:39:02.412409] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T17:39:02.689151] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-17T17:39:02.815775] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-06. [2025-09-17T17:39:03.227456] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T17:39:03.615822] [INFO ] [REMOTE ] BHK: Fetching primary data for 2025-09. [2025-09-17T17:39:04.415773] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-05. [2025-09-17T17:39:04.752406] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T17:39:04.846885] [INFO ] [REMOTE ] BHK: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T17:39:04.851610] [INFO ] [REMOTE ] BHK: Full fetch complete (29548 records). [2025-09-17T17:39:04.851803] [DEBUG] [VALIDATOR ] BHK: Validating primary data. [2025-09-17T17:39:05.224760] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-07. [2025-09-17T17:39:05.237712] [DEBUG] [VALIDATOR ] BHK: All expected trading days are present. [2025-09-17T17:39:05.238589] [DEBUG] [VALIDATOR ] BHK: Primary data validation passed. [2025-09-17T17:39:05.239131] [INFO ] [MAIN ] BHK: Fetched primary data is valid. [2025-09-17T17:39:05.239223] [DEBUG] [LOCAL ] BHK: Saving primary data. [2025-09-17T17:39:05.241347] [DEBUG] [LOCAL ] BHK: Trimmed 29548 records to 22454 (keeping 200 days of data) [2025-09-17T17:39:05.381540] [DEBUG] [LOCAL ] BHK: Primary data saved (22454 records). [2025-09-17T17:39:05.381684] [INFO ] [MAIN ] BHK: Full history saved. [2025-09-17T17:39:05.381776] [INFO ] [MAIN ] Update Progress: 271/2371 symbols completed. BHK took 40.1s. Estimated remaining: 5h 2m 40s. Rate: 6.9 symbols/min [2025-09-17T17:39:05.555019] [INFO ] [MAIN ] BHVN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:39:05.567955] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T17:39:05.617555] [DEBUG] [LOCAL ] BHVN: Loaded 49499 existing records from primary storage. [2025-09-17T17:39:05.617718] [INFO ] [MAIN ] BHVN: Loaded 49499 existing records. [2025-09-17T17:39:05.802547] [WARN ] [MAIN ] BHVN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:39:05.802857] [INFO ] [MAIN ] BHVN: Wiping existing primary data before full refresh. [2025-09-17T17:39:05.802905] [INFO ] [LOCAL ] BHVN: Starting deletion of primary data. [2025-09-17T17:39:05.804709] [DEBUG] [LOCAL ] BHVN: Deleted primary data file. [2025-09-17T17:39:05.804771] [INFO ] [MAIN ] BHVN: Starting full primary refresh. [2025-09-17T17:39:06.020969] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-04. [2025-09-17T17:39:06.176552] [INFO ] [REMOTE ] BHVN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:39:06.554652] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-17T17:39:06.815817] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-11. [2025-09-17T17:39:07.406371] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T17:39:07.615832] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-05. [2025-09-17T17:39:07.967750] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-17T17:39:08.364082] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T17:39:08.415866] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2024-12. [2025-09-17T17:39:09.215838] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-08. [2025-09-17T17:39:10.015746] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-06. [2025-09-17T17:39:10.189280] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T17:39:10.815863] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-06. [2025-09-17T17:39:10.943264] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T17:39:11.085133] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-17T17:39:11.173010] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T17:39:11.615793] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-07. [2025-09-17T17:39:12.415844] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-01. [2025-09-17T17:39:12.643424] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T17:39:13.215816] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-07. [2025-09-17T17:39:13.569395] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T17:39:13.681535] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T17:39:14.015810] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-08. [2025-09-17T17:39:14.815819] [INFO ] [REMOTE ] BHP: Fetching primary data for 2025-09. [2025-09-17T17:39:15.178977] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T17:39:15.615789] [INFO ] [REMOTE ] BHR: Fetching primary data for 2025-09. [2025-09-17T17:39:16.415814] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-08. [2025-09-17T17:39:16.728776] [INFO ] [REMOTE ] BHP: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T17:39:16.736554] [INFO ] [REMOTE ] BHP: Full fetch complete (77082 records). [2025-09-17T17:39:16.736788] [DEBUG] [VALIDATOR ] BHP: Validating primary data. [2025-09-17T17:39:16.921515] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T17:39:17.161138] [DEBUG] [VALIDATOR ] BHP: All expected trading days are present. [2025-09-17T17:39:17.161722] [DEBUG] [VALIDATOR ] BHP: Primary data validation passed. [2025-09-17T17:39:17.162493] [INFO ] [MAIN ] BHP: Fetched primary data is valid. [2025-09-17T17:39:17.162969] [INFO ] [REMOTE ] BHR: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T17:39:17.167244] [DEBUG] [LOCAL ] BHP: Saving primary data. [2025-09-17T17:39:17.167543] [INFO ] [REMOTE ] BHR: Full fetch complete (30347 records). [2025-09-17T17:39:17.167625] [DEBUG] [VALIDATOR ] BHR: Validating primary data. [2025-09-17T17:39:17.215868] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-02. [2025-09-17T17:39:17.259464] [DEBUG] [LOCAL ] BHP: Trimmed 77082 records to 53391 (keeping 200 days of data) [2025-09-17T17:39:17.651263] [DEBUG] [VALIDATOR ] BHR: All expected trading days are present. [2025-09-17T17:39:17.652034] [DEBUG] [VALIDATOR ] BHR: Primary data validation passed. [2025-09-17T17:39:17.652958] [INFO ] [MAIN ] BHR: Fetched primary data is valid. [2025-09-17T17:39:17.653504] [DEBUG] [LOCAL ] BHR: Saving primary data. [2025-09-17T17:39:17.658458] [DEBUG] [LOCAL ] BHR: Trimmed 30347 records to 21399 (keeping 200 days of data) [2025-09-17T17:39:17.896116] [DEBUG] [LOCAL ] BHR: Primary data saved (21399 records). [2025-09-17T17:39:17.896939] [INFO ] [MAIN ] BHR: Full history saved. [2025-09-17T17:39:17.897537] [INFO ] [MAIN ] Update Progress: 272/2371 symbols completed. BHR took 35.7s. Estimated remaining: 5h 3m 1s. Rate: 6.9 symbols/min [2025-09-17T17:39:18.017858] [INFO ] [REMOTE ] BHV: Fetching primary data for 2025-09. [2025-09-17T17:39:18.073465] [INFO ] [MAIN ] BILL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:39:18.198814] [DEBUG] [LOCAL ] BILL: Loaded 52322 existing records from primary storage. [2025-09-17T17:39:18.199522] [INFO ] [MAIN ] BILL: Loaded 52322 existing records. [2025-09-17T17:39:18.385446] [WARN ] [MAIN ] BILL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:39:18.387924] [INFO ] [MAIN ] BILL: Wiping existing primary data before full refresh. [2025-09-17T17:39:18.388225] [INFO ] [LOCAL ] BILL: Starting deletion of primary data. [2025-09-17T17:39:18.390534] [DEBUG] [LOCAL ] BILL: Deleted primary data file. [2025-09-17T17:39:18.391355] [INFO ] [MAIN ] BILL: Starting full primary refresh. [2025-09-17T17:39:18.544804] [DEBUG] [LOCAL ] BHP: Primary data saved (53391 records). [2025-09-17T17:39:18.555417] [INFO ] [MAIN ] BHP: Full history saved. [2025-09-17T17:39:18.561442] [INFO ] [MAIN ] Update Progress: 273/2371 symbols completed. BHP took 39.8s. Estimated remaining: 5h 1m 51s. Rate: 7.0 symbols/min [2025-09-17T17:39:18.922224] [INFO ] [MAIN ] BIO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:39:18.936416] [INFO ] [REMOTE ] BHV: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T17:39:18.959560] [INFO ] [REMOTE ] BILL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:39:18.960937] [INFO ] [REMOTE ] BHV: Full fetch complete (1391 records). [2025-09-17T17:39:18.961383] [DEBUG] [VALIDATOR ] BHV: Validating primary data. [2025-09-17T17:39:18.961853] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-11. [2025-09-17T17:39:19.178326] [WARN ] [VALIDATOR ] BHV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T17:39:19.187915] [FATAL] [MAIN ] BHV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:39:19.188212] [WARN ] [MAIN ] BHV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:39:19.188969] [INFO ] [LOCAL ] BHV: Starting deletion of primary data. [2025-09-17T17:39:19.191314] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T17:39:19.192497] [DEBUG] [LOCAL ] BIO: Loaded 25844 existing records from primary storage. [2025-09-17T17:39:19.200897] [INFO ] [MAIN ] BIO: Loaded 25844 existing records. [2025-09-17T17:39:19.200798] [DEBUG] [LOCAL ] BHV: No primary data file found to delete. [2025-09-17T17:39:19.231853] [INFO ] [LOCAL ] BHV: Starting deletion of derivative data. [2025-09-17T17:39:19.281249] [DEBUG] [LOCAL ] BHV: No derivative data file found to delete. [2025-09-17T17:39:19.302427] [INFO ] [MAIN ] Update Progress: 274/2371 symbols completed. BHV took 25.5s. Estimated remaining: 5h 0m 42s. Rate: 7.0 symbols/min [2025-09-17T17:39:19.493890] [WARN ] [MAIN ] BIO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:39:19.510029] [INFO ] [MAIN ] BIO: Wiping existing primary data before full refresh. [2025-09-17T17:39:19.520291] [INFO ] [LOCAL ] BIO: Starting deletion of primary data. [2025-09-17T17:39:19.562448] [DEBUG] [LOCAL ] BIO: Deleted primary data file. [2025-09-17T17:39:19.564992] [INFO ] [MAIN ] BIP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:39:19.565184] [INFO ] [MAIN ] BIO: Starting full primary refresh. [2025-09-17T17:39:19.621525] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-03. [2025-09-17T17:39:19.920973] [DEBUG] [LOCAL ] BIP: Loaded 39768 existing records from primary storage. [2025-09-17T17:39:19.955919] [INFO ] [MAIN ] BIP: Loaded 39768 existing records. [2025-09-17T17:39:19.959200] [INFO ] [REMOTE ] BIO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:39:20.133078] [WARN ] [MAIN ] BIP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:39:20.133355] [INFO ] [MAIN ] BIP: Wiping existing primary data before full refresh. [2025-09-17T17:39:20.133415] [INFO ] [LOCAL ] BIP: Starting deletion of primary data. [2025-09-17T17:39:20.134326] [DEBUG] [LOCAL ] BIP: Deleted primary data file. [2025-09-17T17:39:20.134384] [INFO ] [MAIN ] BIP: Starting full primary refresh. [2025-09-17T17:39:20.421015] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-11. [2025-09-17T17:39:20.494017] [INFO ] [REMOTE ] BIP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:39:20.791186] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T17:39:21.215699] [INFO ] [REMOTE ] BILL: Fetching primary data for 2024-12. [2025-09-17T17:39:21.373157] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T17:39:21.573285] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T17:39:22.015790] [INFO ] [REMOTE ] BIO: Fetching primary data for 2024-12. [2025-09-17T17:39:22.824542] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-11. [2025-09-17T17:39:22.835200] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T17:39:22.859766] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T17:39:23.615786] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-01. [2025-09-17T17:39:24.336986] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T17:39:24.415807] [INFO ] [REMOTE ] BIP: Fetching primary data for 2024-12. [2025-09-17T17:39:24.651557] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T17:39:25.215816] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-04. [2025-09-17T17:39:25.790546] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T17:39:26.015782] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-01. [2025-09-17T17:39:26.527830] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T17:39:26.815777] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-05. [2025-09-17T17:39:27.615780] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-02. [2025-09-17T17:39:27.653732] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T17:39:28.415840] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-02. [2025-09-17T17:39:28.636838] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T17:39:28.774732] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T17:39:29.215790] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-01. [2025-09-17T17:39:30.015772] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-03. [2025-09-17T17:39:30.452445] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-17T17:39:30.682369] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T17:39:30.815777] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-02. [2025-09-17T17:39:31.284050] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T17:39:31.615807] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-03. [2025-09-17T17:39:32.257672] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T17:39:32.415787] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-03. [2025-09-17T17:39:33.173928] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T17:39:33.215767] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-04. [2025-09-17T17:39:34.015821] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-06. [2025-09-17T17:39:34.059518] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T17:39:34.815815] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-04. [2025-09-17T17:39:35.022018] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T17:39:35.615789] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-05. [2025-09-17T17:39:35.799982] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T17:39:36.049991] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T17:39:36.415857] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-05. [2025-09-17T17:39:37.064298] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T17:39:37.215774] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-06. [2025-09-17T17:39:37.828204] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T17:39:38.015827] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-06. [2025-09-17T17:39:38.815815] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-04. [2025-09-17T17:39:38.972840] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T17:39:39.408545] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T17:39:39.615798] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-07. [2025-09-17T17:39:40.229311] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T17:39:40.415778] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-05. [2025-09-17T17:39:41.182255] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T17:39:41.215750] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-07. [2025-09-17T17:39:41.249254] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T17:39:42.015787] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-06. [2025-09-17T17:39:42.815773] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-07. [2025-09-17T17:39:42.969065] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T17:39:43.282593] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T17:39:43.615790] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-07. [2025-09-17T17:39:44.415755] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-08. [2025-09-17T17:39:44.494172] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T17:39:44.859888] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T17:39:45.215822] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-08. [2025-09-17T17:39:46.015792] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-08. [2025-09-17T17:39:46.354155] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T17:39:46.472506] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T17:39:46.815793] [INFO ] [REMOTE ] BIP: Fetching primary data for 2025-09. [2025-09-17T17:39:47.615840] [INFO ] [REMOTE ] BILL: Fetching primary data for 2025-09. [2025-09-17T17:39:47.948708] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T17:39:48.390223] [INFO ] [REMOTE ] BIP: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T17:39:48.399277] [INFO ] [REMOTE ] BIP: Full fetch complete (56040 records). [2025-09-17T17:39:48.399432] [DEBUG] [VALIDATOR ] BIP: Validating primary data. [2025-09-17T17:39:48.420940] [INFO ] [REMOTE ] BHVN: Fetching primary data for 2025-09. [2025-09-17T17:39:48.791024] [DEBUG] [VALIDATOR ] BIP: All expected trading days are present. [2025-09-17T17:39:48.791101] [DEBUG] [VALIDATOR ] BIP: Primary data validation passed. [2025-09-17T17:39:48.791701] [INFO ] [MAIN ] BIP: Fetched primary data is valid. [2025-09-17T17:39:48.791754] [DEBUG] [LOCAL ] BIP: Saving primary data. [2025-09-17T17:39:48.792865] [DEBUG] [LOCAL ] BIP: Trimmed 56040 records to 39777 (keeping 200 days of data) [2025-09-17T17:39:49.038412] [DEBUG] [LOCAL ] BIP: Primary data saved (39777 records). [2025-09-17T17:39:49.038564] [INFO ] [MAIN ] BIP: Full history saved. [2025-09-17T17:39:49.039113] [INFO ] [MAIN ] Update Progress: 275/2371 symbols completed. BIP took 29.7s. Estimated remaining: 5h 3m 14s. Rate: 6.9 symbols/min [2025-09-17T17:39:49.225516] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-08. [2025-09-17T17:39:49.251552] [INFO ] [MAIN ] BIPC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:39:49.301162] [DEBUG] [LOCAL ] BIPC: Loaded 41793 existing records from primary storage. [2025-09-17T17:39:49.301361] [INFO ] [MAIN ] BIPC: Loaded 41793 existing records. [2025-09-17T17:39:49.480843] [WARN ] [MAIN ] BIPC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:39:49.481145] [INFO ] [MAIN ] BIPC: Wiping existing primary data before full refresh. [2025-09-17T17:39:49.481205] [INFO ] [LOCAL ] BIPC: Starting deletion of primary data. [2025-09-17T17:39:49.482126] [DEBUG] [LOCAL ] BIPC: Deleted primary data file. [2025-09-17T17:39:49.482180] [INFO ] [MAIN ] BIPC: Starting full primary refresh. [2025-09-17T17:39:49.882494] [INFO ] [REMOTE ] BIPC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:39:49.884949] [INFO ] [REMOTE ] BILL: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-17T17:39:49.896440] [INFO ] [REMOTE ] BILL: Full fetch complete (75366 records). [2025-09-17T17:39:49.896615] [DEBUG] [VALIDATOR ] BILL: Validating primary data. [2025-09-17T17:39:50.020896] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-11. [2025-09-17T17:39:50.320067] [DEBUG] [VALIDATOR ] BILL: All expected trading days are present. [2025-09-17T17:39:50.320251] [DEBUG] [VALIDATOR ] BILL: Primary data validation passed. [2025-09-17T17:39:50.321157] [INFO ] [MAIN ] BILL: Fetched primary data is valid. [2025-09-17T17:39:50.321256] [DEBUG] [LOCAL ] BILL: Saving primary data. [2025-09-17T17:39:50.339584] [INFO ] [REMOTE ] BHVN: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T17:39:50.346287] [DEBUG] [LOCAL ] BILL: Trimmed 75366 records to 52319 (keeping 200 days of data) [2025-09-17T17:39:50.347331] [INFO ] [REMOTE ] BHVN: Full fetch complete (68894 records). [2025-09-17T17:39:50.347461] [DEBUG] [VALIDATOR ] BHVN: Validating primary data. [2025-09-17T17:39:50.980771] [DEBUG] [VALIDATOR ] BHVN: All expected trading days are present. [2025-09-17T17:39:50.987272] [DEBUG] [VALIDATOR ] BHVN: Primary data validation passed. [2025-09-17T17:39:50.990416] [INFO ] [MAIN ] BHVN: Fetched primary data is valid. [2025-09-17T17:39:50.991223] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T17:39:50.998312] [DEBUG] [LOCAL ] BHVN: Saving primary data. [2025-09-17T17:39:51.000947] [INFO ] [REMOTE ] BIO: Fetching primary data for 2025-09. [2025-09-17T17:39:51.013897] [DEBUG] [LOCAL ] BHVN: Trimmed 68894 records to 49553 (keeping 200 days of data) [2025-09-17T17:39:51.174098] [DEBUG] [LOCAL ] BILL: Primary data saved (52319 records). [2025-09-17T17:39:51.176558] [INFO ] [MAIN ] BILL: Full history saved. [2025-09-17T17:39:51.178173] [INFO ] [MAIN ] Update Progress: 276/2371 symbols completed. BILL took 33.3s. Estimated remaining: 5h 2m 16s. Rate: 6.9 symbols/min [2025-09-17T17:39:51.369585] [INFO ] [MAIN ] BIPH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:39:51.385284] [DEBUG] [LOCAL ] BIPH: Loaded 2628 existing records from primary storage. [2025-09-17T17:39:51.386326] [INFO ] [MAIN ] BIPH: Loaded 2628 existing records. [2025-09-17T17:39:51.676457] [WARN ] [MAIN ] BIPH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:39:51.679467] [INFO ] [MAIN ] BIPH: Wiping existing primary data before full refresh. [2025-09-17T17:39:51.680474] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-17T17:39:51.682372] [DEBUG] [LOCAL ] BIPH: Deleted primary data file. [2025-09-17T17:39:51.682770] [INFO ] [MAIN ] BIPH: Starting full primary refresh. [2025-09-17T17:39:51.811763] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T17:39:51.829850] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2024-12. [2025-09-17T17:39:52.125003] [INFO ] [REMOTE ] BIPH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:39:52.141110] [INFO ] [REMOTE ] BIO: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T17:39:52.145586] [INFO ] [REMOTE ] BIO: Full fetch complete (34088 records). [2025-09-17T17:39:52.146199] [DEBUG] [VALIDATOR ] BIO: Validating primary data. [2025-09-17T17:39:52.420980] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-11. [2025-09-17T17:39:52.525087] [DEBUG] [LOCAL ] BHVN: Primary data saved (49553 records). [2025-09-17T17:39:52.553747] [INFO ] [MAIN ] BHVN: Full history saved. [2025-09-17T17:39:52.563203] [INFO ] [MAIN ] Update Progress: 277/2371 symbols completed. BHVN took 47.2s. Estimated remaining: 5h 1m 12s. Rate: 7.0 symbols/min [2025-09-17T17:39:52.591218] [DEBUG] [VALIDATOR ] BIO: All expected trading days are present. [2025-09-17T17:39:52.591308] [DEBUG] [VALIDATOR ] BIO: Primary data validation passed. [2025-09-17T17:39:52.591855] [INFO ] [MAIN ] BIO: Fetched primary data is valid. [2025-09-17T17:39:52.591901] [DEBUG] [LOCAL ] BIO: Saving primary data. [2025-09-17T17:39:52.592859] [DEBUG] [LOCAL ] BIO: Trimmed 34088 records to 25809 (keeping 200 days of data) [2025-09-17T17:39:52.752024] [DEBUG] [LOCAL ] BIO: Primary data saved (25809 records). [2025-09-17T17:39:52.752181] [INFO ] [MAIN ] BIO: Full history saved. [2025-09-17T17:39:52.752284] [INFO ] [MAIN ] Update Progress: 278/2371 symbols completed. BIO took 34.2s. Estimated remaining: 5h 0m 0s. Rate: 7.0 symbols/min [2025-09-17T17:39:53.219499] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T17:39:53.220841] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2024-12. [2025-09-17T17:39:53.242543] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T17:39:53.704904] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T17:39:54.015849] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-01. [2025-09-17T17:39:54.394034] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T17:39:54.815890] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-01. [2025-09-17T17:39:55.615856] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-02. [2025-09-17T17:39:56.182930] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T17:39:56.252368] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T17:39:56.415746] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-02. [2025-09-17T17:39:57.215792] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-03. [2025-09-17T17:39:57.757497] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T17:39:57.858235] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T17:39:58.015806] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-04. [2025-09-17T17:39:58.616808] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T17:39:58.815807] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-05. [2025-09-17T17:39:59.287257] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T17:39:59.615835] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-06. [2025-09-17T17:40:00.059557] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T17:40:00.415856] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-07. [2025-09-17T17:40:01.065280] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T17:40:01.215863] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-08. [2025-09-17T17:40:01.715337] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T17:40:02.015842] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-03. [2025-09-17T17:40:02.815891] [INFO ] [REMOTE ] BIPH: Fetching primary data for 2025-09. [2025-09-17T17:40:03.486923] [INFO ] [REMOTE ] BIPH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T17:40:03.487955] [INFO ] [REMOTE ] BIPH: Full fetch complete (4338 records). [2025-09-17T17:40:03.488026] [DEBUG] [VALIDATOR ] BIPH: Validating primary data. [2025-09-17T17:40:03.488470] [FATAL] [VALIDATOR ] BIPH: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:40:03.488546] [FATAL] [MAIN ] BIPH: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:40:03.488583] [WARN ] [MAIN ] BIPH: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:40:03.488619] [INFO ] [LOCAL ] BIPH: Starting deletion of primary data. [2025-09-17T17:40:03.488696] [DEBUG] [LOCAL ] BIPH: No primary data file found to delete. [2025-09-17T17:40:03.488734] [INFO ] [LOCAL ] BIPH: Starting deletion of derivative data. [2025-09-17T17:40:03.489195] [DEBUG] [LOCAL ] BIPH: Deleted derivative data file. [2025-09-17T17:40:03.489289] [INFO ] [MAIN ] Update Progress: 279/2371 symbols completed. BIPH took 12.3s. Estimated remaining: 5h 0m 8s. Rate: 7.0 symbols/min [2025-09-17T17:40:03.845301] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T17:40:03.855830] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-04. [2025-09-17T17:40:05.434084] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T17:40:05.443845] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-05. [2025-09-17T17:40:07.062978] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T17:40:07.072624] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-06. [2025-09-17T17:40:08.489921] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T17:40:08.499087] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-07. [2025-09-17T17:40:10.038206] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T17:40:10.047556] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-08. [2025-09-17T17:40:11.500013] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T17:40:11.508815] [INFO ] [REMOTE ] BIPC: Fetching primary data for 2025-09. [2025-09-17T17:40:12.887663] [INFO ] [REMOTE ] BIPC: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T17:40:12.892852] [INFO ] [REMOTE ] BIPC: Full fetch complete (59373 records). [2025-09-17T17:40:12.892950] [DEBUG] [VALIDATOR ] BIPC: Validating primary data. [2025-09-17T17:40:13.286298] [DEBUG] [VALIDATOR ] BIPC: All expected trading days are present. [2025-09-17T17:40:13.286381] [DEBUG] [VALIDATOR ] BIPC: Primary data validation passed. [2025-09-17T17:40:13.287124] [INFO ] [MAIN ] BIPC: Fetched primary data is valid. [2025-09-17T17:40:13.287172] [DEBUG] [LOCAL ] BIPC: Saving primary data. [2025-09-17T17:40:13.288468] [DEBUG] [LOCAL ] BIPC: Trimmed 59373 records to 41820 (keeping 200 days of data) [2025-09-17T17:40:13.542237] [DEBUG] [LOCAL ] BIPC: Primary data saved (41820 records). [2025-09-17T17:40:13.542365] [INFO ] [MAIN ] BIPC: Full history saved. [2025-09-17T17:40:13.542880] [INFO ] [MAIN ] Update Progress: 280/2371 symbols completed. BIPC took 24.5s. Estimated remaining: 5h 0m 10s. Rate: 7.0 symbols/min [2025-09-17T17:40:14.152024] [INFO ] [MAIN ] BIT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:40:14.196657] [DEBUG] [LOCAL ] BIT: No existing data file found in primary storage. [2025-09-17T17:40:14.178204] [INFO ] [MAIN ] BIRK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:40:14.231747] [INFO ] [MAIN ] BIPJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:40:14.229123] [INFO ] [MAIN ] BIPI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:40:14.232304] [WARN ] [MAIN ] BIT: No existing data found, performing full refresh instead. [2025-09-17T17:40:14.233827] [INFO ] [MAIN ] BIT: Wiping existing primary data before full refresh. [2025-09-17T17:40:14.233879] [INFO ] [LOCAL ] BIT: Starting deletion of primary data. [2025-09-17T17:40:14.233923] [DEBUG] [LOCAL ] BIT: No primary data file found to delete. [2025-09-17T17:40:14.233955] [INFO ] [MAIN ] BIT: Starting full primary refresh. [2025-09-17T17:40:14.324348] [DEBUG] [LOCAL ] BIPJ: Loaded 2907 existing records from primary storage. [2025-09-17T17:40:14.326613] [DEBUG] [LOCAL ] BIPI: Loaded 3447 existing records from primary storage. [2025-09-17T17:40:14.344531] [INFO ] [MAIN ] BIPI: Loaded 3447 existing records. [2025-09-17T17:40:14.348236] [INFO ] [MAIN ] BIPJ: Loaded 2907 existing records. [2025-09-17T17:40:14.924102] [DEBUG] [LOCAL ] BIRK: Loaded 50829 existing records from primary storage. [2025-09-17T17:40:14.917752] [WARN ] [MAIN ] BIPJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:40:14.978557] [WARN ] [MAIN ] BIPI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:40:14.975608] [INFO ] [MAIN ] BIPJ: Wiping existing primary data before full refresh. [2025-09-17T17:40:14.959162] [INFO ] [MAIN ] BIRK: Loaded 50829 existing records. [2025-09-17T17:40:14.989476] [INFO ] [LOCAL ] BIPJ: Starting deletion of primary data. [2025-09-17T17:40:15.074398] [DEBUG] [LOCAL ] BIPJ: Deleted primary data file. [2025-09-17T17:40:15.074458] [INFO ] [MAIN ] BIPI: Wiping existing primary data before full refresh. [2025-09-17T17:40:15.121459] [INFO ] [LOCAL ] BIPI: Starting deletion of primary data. [2025-09-17T17:40:15.126413] [INFO ] [REMOTE ] BIT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:40:15.101947] [INFO ] [MAIN ] BIPJ: Starting full primary refresh. [2025-09-17T17:40:15.137032] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-11. [2025-09-17T17:40:15.206969] [DEBUG] [LOCAL ] BIPI: Deleted primary data file. [2025-09-17T17:40:15.230428] [INFO ] [MAIN ] BIPI: Starting full primary refresh. [2025-09-17T17:40:15.459403] [WARN ] [MAIN ] BIRK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:40:15.511002] [INFO ] [MAIN ] BIRK: Wiping existing primary data before full refresh. [2025-09-17T17:40:15.562474] [INFO ] [LOCAL ] BIRK: Starting deletion of primary data. [2025-09-17T17:40:15.662489] [DEBUG] [LOCAL ] BIRK: Deleted primary data file. [2025-09-17T17:40:15.722515] [INFO ] [MAIN ] BIRK: Starting full primary refresh. [2025-09-17T17:40:16.087949] [INFO ] [REMOTE ] BIPJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:40:16.104728] [INFO ] [REMOTE ] BIPI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:40:16.105154] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-11. [2025-09-17T17:40:16.110509] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-11. [2025-09-17T17:40:16.342224] [INFO ] [REMOTE ] BIRK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:40:16.342545] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-11. [2025-09-17T17:40:16.582701] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T17:40:16.587126] [INFO ] [REMOTE ] BIT: Fetching primary data for 2024-12. [2025-09-17T17:40:16.736495] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T17:40:16.737897] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2024-12. [2025-09-17T17:40:16.792245] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T17:40:16.794130] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2024-12. [2025-09-17T17:40:17.152847] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T17:40:17.154607] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-01. [2025-09-17T17:40:17.355775] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T17:40:17.357855] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-01. [2025-09-17T17:40:17.491146] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T17:40:17.496228] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-01. [2025-09-17T17:40:17.643212] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T17:40:17.644686] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-02. [2025-09-17T17:40:17.803396] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T17:40:17.805340] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-02. [2025-09-17T17:40:18.140730] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T17:40:18.142281] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-03. [2025-09-17T17:40:18.231871] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T17:40:18.243363] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T17:40:18.483212] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-17T17:40:18.498781] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T17:40:18.815775] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-02. [2025-09-17T17:40:19.615788] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-03. [2025-09-17T17:40:19.834380] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T17:40:20.217346] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T17:40:20.415780] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-04. [2025-09-17T17:40:20.985012] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T17:40:21.215778] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2024-12. [2025-09-17T17:40:22.015824] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-03. [2025-09-17T17:40:22.815809] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-04. [2025-09-17T17:40:22.866183] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T17:40:23.025582] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T17:40:23.432310] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T17:40:23.615718] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-01. [2025-09-17T17:40:24.415780] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-05. [2025-09-17T17:40:24.724224] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-17T17:40:25.162955] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T17:40:25.215739] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-02. [2025-09-17T17:40:26.015784] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-06. [2025-09-17T17:40:26.410466] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T17:40:26.584234] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T17:40:26.815778] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-07. [2025-09-17T17:40:27.587589] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T17:40:27.615859] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-08. [2025-09-17T17:40:28.052584] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T17:40:28.415795] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-05. [2025-09-17T17:40:29.044871] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T17:40:29.215795] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-03. [2025-09-17T17:40:30.015781] [INFO ] [REMOTE ] BIPJ: Fetching primary data for 2025-09. [2025-09-17T17:40:30.436520] [INFO ] [REMOTE ] BIPJ: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T17:40:30.437540] [INFO ] [REMOTE ] BIPJ: Full fetch complete (4259 records). [2025-09-17T17:40:30.437607] [DEBUG] [VALIDATOR ] BIPJ: Validating primary data. [2025-09-17T17:40:30.804178] [DEBUG] [VALIDATOR ] BIPJ: All expected trading days are present. [2025-09-17T17:40:30.804369] [DEBUG] [VALIDATOR ] BIPJ: Primary data validation passed. [2025-09-17T17:40:30.804707] [INFO ] [MAIN ] BIPJ: Fetched primary data is valid. [2025-09-17T17:40:30.804874] [DEBUG] [LOCAL ] BIPJ: Saving primary data. [2025-09-17T17:40:30.805674] [DEBUG] [LOCAL ] BIPJ: Trimmed 4259 records to 2883 (keeping 200 days of data) [2025-09-17T17:40:30.815746] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-04. [2025-09-17T17:40:30.827052] [DEBUG] [LOCAL ] BIPJ: Primary data saved (2883 records). [2025-09-17T17:40:30.827227] [INFO ] [MAIN ] BIPJ: Full history saved. [2025-09-17T17:40:30.827413] [INFO ] [MAIN ] Update Progress: 281/2371 symbols completed. BIPJ took 17.3s. Estimated remaining: 5h 1m 6s. Rate: 6.9 symbols/min [2025-09-17T17:40:31.035060] [INFO ] [MAIN ] BJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:40:31.031742] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T17:40:31.099893] [DEBUG] [LOCAL ] BJ: Loaded 51453 existing records from primary storage. [2025-09-17T17:40:31.100040] [INFO ] [MAIN ] BJ: Loaded 51453 existing records. [2025-09-17T17:40:31.279048] [WARN ] [MAIN ] BJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:40:31.279336] [INFO ] [MAIN ] BJ: Wiping existing primary data before full refresh. [2025-09-17T17:40:31.279399] [INFO ] [LOCAL ] BJ: Starting deletion of primary data. [2025-09-17T17:40:31.280792] [DEBUG] [LOCAL ] BJ: Deleted primary data file. [2025-09-17T17:40:31.280858] [INFO ] [MAIN ] BJ: Starting full primary refresh. [2025-09-17T17:40:31.620853] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-06. [2025-09-17T17:40:31.657058] [INFO ] [REMOTE ] BJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:40:31.994966] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T17:40:32.100435] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T17:40:32.415787] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-07. [2025-09-17T17:40:32.876091] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T17:40:33.215786] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-11. [2025-09-17T17:40:34.015831] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-05. [2025-09-17T17:40:34.815805] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-04. [2025-09-17T17:40:34.907412] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T17:40:34.953564] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T17:40:35.615800] [INFO ] [REMOTE ] BJ: Fetching primary data for 2024-12. [2025-09-17T17:40:36.415787] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-06. [2025-09-17T17:40:36.504544] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T17:40:36.930030] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T17:40:37.118548] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T17:40:37.215760] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-07. [2025-09-17T17:40:38.015788] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-05. [2025-09-17T17:40:38.302730] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T17:40:38.815770] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-08. [2025-09-17T17:40:39.615769] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-08. [2025-09-17T17:40:39.670696] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T17:40:40.201988] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T17:40:40.213932] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T17:40:40.415774] [INFO ] [REMOTE ] BIT: Fetching primary data for 2025-09. [2025-09-17T17:40:41.215774] [INFO ] [REMOTE ] BIPI: Fetching primary data for 2025-09. [2025-09-17T17:40:41.745884] [INFO ] [REMOTE ] BIT: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T17:40:41.753304] [INFO ] [REMOTE ] BIT: Full fetch complete (30603 records). [2025-09-17T17:40:41.753394] [DEBUG] [VALIDATOR ] BIT: Validating primary data. [2025-09-17T17:40:41.864899] [INFO ] [REMOTE ] BIPI: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T17:40:41.892111] [INFO ] [REMOTE ] BIPI: Full fetch complete (5319 records). [2025-09-17T17:40:41.924338] [DEBUG] [VALIDATOR ] BIPI: Validating primary data. [2025-09-17T17:40:42.016098] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-01. [2025-09-17T17:40:42.406002] [DEBUG] [VALIDATOR ] BIT: All expected trading days are present. [2025-09-17T17:40:42.421916] [DEBUG] [VALIDATOR ] BIT: Primary data validation passed. [2025-09-17T17:40:42.432890] [INFO ] [MAIN ] BIT: Fetched primary data is valid. [2025-09-17T17:40:42.438457] [DEBUG] [LOCAL ] BIT: Saving primary data. [2025-09-17T17:40:42.503368] [DEBUG] [LOCAL ] BIT: Trimmed 30603 records to 21819 (keeping 200 days of data) [2025-09-17T17:40:42.527520] [DEBUG] [VALIDATOR ] BIPI: All expected trading days are present. [2025-09-17T17:40:42.527891] [DEBUG] [VALIDATOR ] BIPI: Primary data validation passed. [2025-09-17T17:40:42.528007] [INFO ] [MAIN ] BIPI: Fetched primary data is valid. [2025-09-17T17:40:42.528075] [DEBUG] [LOCAL ] BIPI: Saving primary data. [2025-09-17T17:40:42.528623] [DEBUG] [LOCAL ] BIPI: Trimmed 5319 records to 3432 (keeping 200 days of data) [2025-09-17T17:40:42.654905] [DEBUG] [LOCAL ] BIPI: Primary data saved (3432 records). [2025-09-17T17:40:42.675844] [INFO ] [MAIN ] BIPI: Full history saved. [2025-09-17T17:40:42.681181] [INFO ] [MAIN ] Update Progress: 282/2371 symbols completed. BIPI took 29.1s. Estimated remaining: 5h 1m 21s. Rate: 6.9 symbols/min [2025-09-17T17:40:42.794032] [DEBUG] [LOCAL ] BIT: Primary data saved (21819 records). [2025-09-17T17:40:42.794455] [INFO ] [MAIN ] BIT: Full history saved. [2025-09-17T17:40:42.810106] [INFO ] [MAIN ] Update Progress: 283/2371 symbols completed. BIT took 29.2s. Estimated remaining: 5h 0m 9s. Rate: 7.0 symbols/min [2025-09-17T17:40:42.820388] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-06. [2025-09-17T17:40:42.896404] [INFO ] [MAIN ] BK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:40:43.045973] [INFO ] [MAIN ] BKD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:40:43.087783] [DEBUG] [LOCAL ] BK: Loaded 53569 existing records from primary storage. [2025-09-17T17:40:43.087966] [INFO ] [MAIN ] BK: Loaded 53569 existing records. [2025-09-17T17:40:43.297918] [WARN ] [MAIN ] BK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:40:43.298927] [DEBUG] [LOCAL ] BKD: Loaded 50081 existing records from primary storage. [2025-09-17T17:40:43.299167] [INFO ] [MAIN ] BK: Wiping existing primary data before full refresh. [2025-09-17T17:40:43.299313] [INFO ] [MAIN ] BKD: Loaded 50081 existing records. [2025-09-17T17:40:43.299358] [INFO ] [LOCAL ] BK: Starting deletion of primary data. [2025-09-17T17:40:43.319875] [DEBUG] [LOCAL ] BK: Deleted primary data file. [2025-09-17T17:40:43.353848] [INFO ] [MAIN ] BK: Starting full primary refresh. [2025-09-17T17:40:43.621361] [WARN ] [MAIN ] BKD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:40:43.690157] [INFO ] [MAIN ] BKD: Wiping existing primary data before full refresh. [2025-09-17T17:40:43.740053] [INFO ] [LOCAL ] BKD: Starting deletion of primary data. [2025-09-17T17:40:43.768073] [DEBUG] [LOCAL ] BKD: Deleted primary data file. [2025-09-17T17:40:43.768190] [INFO ] [MAIN ] BKD: Starting full primary refresh. [2025-09-17T17:40:43.954166] [INFO ] [REMOTE ] BK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:40:43.954585] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-11. [2025-09-17T17:40:44.225390] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-01 (2.21 seconds). [2025-09-17T17:40:44.244057] [INFO ] [REMOTE ] BKD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:40:44.415730] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-02. [2025-09-17T17:40:44.581592] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T17:40:45.215797] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-11. [2025-09-17T17:40:45.417109] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T17:40:46.015818] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-07. [2025-09-17T17:40:46.072542] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T17:40:46.815796] [INFO ] [REMOTE ] BK: Fetching primary data for 2024-12. [2025-09-17T17:40:46.952122] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T17:40:47.615795] [INFO ] [REMOTE ] BKD: Fetching primary data for 2024-12. [2025-09-17T17:40:47.653833] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T17:40:48.238999] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T17:40:48.415737] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-01. [2025-09-17T17:40:49.180763] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T17:40:49.215733] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-01. [2025-09-17T17:40:50.015779] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-03. [2025-09-17T17:40:50.158239] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T17:40:50.799017] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T17:40:50.815686] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-02. [2025-09-17T17:40:51.615782] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-08. [2025-09-17T17:40:51.704696] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T17:40:52.026103] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T17:40:52.415905] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-04. [2025-09-17T17:40:53.215772] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-02. [2025-09-17T17:40:53.332046] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T17:40:54.015920] [INFO ] [REMOTE ] BIRK: Fetching primary data for 2025-09. [2025-09-17T17:40:54.285956] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T17:40:54.815828] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-03. [2025-09-17T17:40:54.941348] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T17:40:55.615766] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-05. [2025-09-17T17:40:55.672683] [INFO ] [REMOTE ] BIRK: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T17:40:55.679234] [INFO ] [REMOTE ] BIRK: Full fetch complete (72443 records). [2025-09-17T17:40:55.679368] [DEBUG] [VALIDATOR ] BIRK: Validating primary data. [2025-09-17T17:40:56.079880] [DEBUG] [VALIDATOR ] BIRK: All expected trading days are present. [2025-09-17T17:40:56.079985] [DEBUG] [VALIDATOR ] BIRK: Primary data validation passed. [2025-09-17T17:40:56.080831] [INFO ] [MAIN ] BIRK: Fetched primary data is valid. [2025-09-17T17:40:56.080919] [DEBUG] [LOCAL ] BIRK: Saving primary data. [2025-09-17T17:40:56.082689] [DEBUG] [LOCAL ] BIRK: Trimmed 72443 records to 50805 (keeping 200 days of data) [2025-09-17T17:40:56.204418] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T17:40:56.415870] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-03. [2025-09-17T17:40:56.435235] [DEBUG] [LOCAL ] BIRK: Primary data saved (50805 records). [2025-09-17T17:40:56.435368] [INFO ] [MAIN ] BIRK: Full history saved. [2025-09-17T17:40:56.436161] [INFO ] [MAIN ] Update Progress: 284/2371 symbols completed. BIRK took 42.9s. Estimated remaining: 5h 0m 37s. Rate: 6.9 symbols/min [2025-09-17T17:40:56.606423] [INFO ] [MAIN ] BKE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:40:56.642859] [DEBUG] [LOCAL ] BKE: Loaded 35017 existing records from primary storage. [2025-09-17T17:40:56.643023] [INFO ] [MAIN ] BKE: Loaded 35017 existing records. [2025-09-17T17:40:56.820029] [WARN ] [MAIN ] BKE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:40:56.820381] [INFO ] [MAIN ] BKE: Wiping existing primary data before full refresh. [2025-09-17T17:40:56.820442] [INFO ] [LOCAL ] BKE: Starting deletion of primary data. [2025-09-17T17:40:56.821541] [DEBUG] [LOCAL ] BKE: Deleted primary data file. [2025-09-17T17:40:56.821617] [INFO ] [MAIN ] BKE: Starting full primary refresh. [2025-09-17T17:40:57.185164] [INFO ] [REMOTE ] BKE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:40:57.215814] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-11. [2025-09-17T17:40:57.575055] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T17:40:57.912558] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T17:40:58.015810] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-04. [2025-09-17T17:40:58.677052] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T17:40:58.815786] [INFO ] [REMOTE ] BKE: Fetching primary data for 2024-12. [2025-09-17T17:40:59.615785] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-06. [2025-09-17T17:40:59.789847] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T17:41:00.161430] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T17:41:00.415781] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-01. [2025-09-17T17:41:01.215748] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-05. [2025-09-17T17:41:01.325866] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T17:41:01.861572] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T17:41:02.015812] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-04. [2025-09-17T17:41:02.521592] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T17:41:02.815826] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-02. [2025-09-17T17:41:03.576164] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T17:41:03.615794] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-05. [2025-09-17T17:41:04.154225] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T17:41:04.415846] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-06. [2025-09-17T17:41:05.215810] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-03. [2025-09-17T17:41:05.465546] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T17:41:06.015794] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-06. [2025-09-17T17:41:06.069983] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:41:06.293686] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T17:41:06.815824] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-07. [2025-09-17T17:41:07.574695] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T17:41:07.615874] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-07. [2025-09-17T17:41:08.415906] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-07. [2025-09-17T17:41:08.483544] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T17:41:09.224429] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-08. [2025-09-17T17:41:09.264011] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T17:41:10.015792] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-08. [2025-09-17T17:41:10.572800] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-17T17:41:10.825167] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-08. [2025-09-17T17:41:10.830331] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T17:41:11.615755] [INFO ] [REMOTE ] BKD: Fetching primary data for 2025-09. [2025-09-17T17:41:11.783754] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T17:41:12.415774] [INFO ] [REMOTE ] BK: Fetching primary data for 2025-09. [2025-09-17T17:41:12.606692] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T17:41:13.174538] [INFO ] [REMOTE ] BKD: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T17:41:13.180849] [INFO ] [REMOTE ] BKD: Full fetch complete (71085 records). [2025-09-17T17:41:13.180963] [DEBUG] [VALIDATOR ] BKD: Validating primary data. [2025-09-17T17:41:13.220896] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-04. [2025-09-17T17:41:13.598262] [DEBUG] [VALIDATOR ] BKD: All expected trading days are present. [2025-09-17T17:41:13.598399] [DEBUG] [VALIDATOR ] BKD: Primary data validation passed. [2025-09-17T17:41:13.599481] [INFO ] [MAIN ] BKD: Fetched primary data is valid. [2025-09-17T17:41:13.599547] [DEBUG] [LOCAL ] BKD: Saving primary data. [2025-09-17T17:41:13.601686] [DEBUG] [LOCAL ] BKD: Trimmed 71085 records to 50107 (keeping 200 days of data) [2025-09-17T17:41:13.890877] [DEBUG] [LOCAL ] BKD: Primary data saved (50107 records). [2025-09-17T17:41:13.891016] [INFO ] [MAIN ] BKD: Full history saved. [2025-09-17T17:41:13.892249] [INFO ] [MAIN ] Update Progress: 285/2371 symbols completed. BKD took 31.1s. Estimated remaining: 5h 1m 33s. Rate: 6.9 symbols/min [2025-09-17T17:41:14.017942] [INFO ] [REMOTE ] BJ: Fetching primary data for 2025-09. [2025-09-17T17:41:14.069137] [INFO ] [MAIN ] BKH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:41:14.090025] [INFO ] [REMOTE ] BK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T17:41:14.097300] [INFO ] [REMOTE ] BK: Full fetch complete (77329 records). [2025-09-17T17:41:14.097457] [DEBUG] [VALIDATOR ] BK: Validating primary data. [2025-09-17T17:41:14.417102] [DEBUG] [LOCAL ] BKH: Loaded 36686 existing records from primary storage. [2025-09-17T17:41:14.439718] [INFO ] [MAIN ] BKH: Loaded 36686 existing records. [2025-09-17T17:41:14.688253] [DEBUG] [VALIDATOR ] BK: All expected trading days are present. [2025-09-17T17:41:14.693440] [DEBUG] [VALIDATOR ] BK: Primary data validation passed. [2025-09-17T17:41:14.730548] [INFO ] [MAIN ] BK: Fetched primary data is valid. [2025-09-17T17:41:14.731159] [DEBUG] [LOCAL ] BK: Saving primary data. [2025-09-17T17:41:14.753124] [WARN ] [MAIN ] BKH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:41:14.753763] [INFO ] [MAIN ] BKH: Wiping existing primary data before full refresh. [2025-09-17T17:41:14.753997] [INFO ] [LOCAL ] BKH: Starting deletion of primary data. [2025-09-17T17:41:14.754632] [DEBUG] [LOCAL ] BK: Trimmed 77329 records to 53566 (keeping 200 days of data) [2025-09-17T17:41:14.755401] [DEBUG] [LOCAL ] BKH: Deleted primary data file. [2025-09-17T17:41:14.755538] [INFO ] [MAIN ] BKH: Starting full primary refresh. [2025-09-17T17:41:15.172843] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T17:41:15.227593] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-05. [2025-09-17T17:41:15.269315] [INFO ] [REMOTE ] BKH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:41:15.492040] [DEBUG] [LOCAL ] BK: Primary data saved (53566 records). [2025-09-17T17:41:15.492206] [INFO ] [MAIN ] BK: Full history saved. [2025-09-17T17:41:15.492318] [INFO ] [MAIN ] Update Progress: 286/2371 symbols completed. BK took 32.8s. Estimated remaining: 5h 0m 33s. Rate: 6.9 symbols/min [2025-09-17T17:41:15.620820] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-11. [2025-09-17T17:41:15.671240] [INFO ] [MAIN ] BKKT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:41:15.703495] [DEBUG] [LOCAL ] BKKT: Loaded 33804 existing records from primary storage. [2025-09-17T17:41:15.703621] [INFO ] [MAIN ] BKKT: Loaded 33804 existing records. [2025-09-17T17:41:15.888579] [WARN ] [MAIN ] BKKT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:41:15.889022] [INFO ] [MAIN ] BKKT: Wiping existing primary data before full refresh. [2025-09-17T17:41:15.889073] [INFO ] [LOCAL ] BKKT: Starting deletion of primary data. [2025-09-17T17:41:15.889845] [DEBUG] [LOCAL ] BKKT: Deleted primary data file. [2025-09-17T17:41:15.889907] [INFO ] [MAIN ] BKKT: Starting full primary refresh. [2025-09-17T17:41:16.251166] [INFO ] [REMOTE ] BKKT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:41:16.270175] [INFO ] [REMOTE ] BJ: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-17T17:41:16.277616] [INFO ] [REMOTE ] BJ: Full fetch complete (73551 records). [2025-09-17T17:41:16.277747] [DEBUG] [VALIDATOR ] BJ: Validating primary data. [2025-09-17T17:41:16.420846] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-11. [2025-09-17T17:41:16.675306] [DEBUG] [VALIDATOR ] BJ: All expected trading days are present. [2025-09-17T17:41:16.675405] [DEBUG] [VALIDATOR ] BJ: Primary data validation passed. [2025-09-17T17:41:16.676192] [INFO ] [MAIN ] BJ: Fetched primary data is valid. [2025-09-17T17:41:16.676255] [DEBUG] [LOCAL ] BJ: Saving primary data. [2025-09-17T17:41:16.677918] [DEBUG] [LOCAL ] BJ: Trimmed 73551 records to 51438 (keeping 200 days of data) [2025-09-17T17:41:16.798839] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T17:41:17.030712] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T17:41:17.055911] [DEBUG] [LOCAL ] BJ: Primary data saved (51438 records). [2025-09-17T17:41:17.056055] [INFO ] [MAIN ] BJ: Full history saved. [2025-09-17T17:41:17.056150] [INFO ] [MAIN ] Update Progress: 287/2371 symbols completed. BJ took 46.2s. Estimated remaining: 4h 59m 33s. Rate: 7.0 symbols/min [2025-09-17T17:41:17.223440] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-06. [2025-09-17T17:41:17.232279] [INFO ] [MAIN ] BKN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:41:17.232430] [DEBUG] [LOCAL ] BKN: No existing data file found in primary storage. [2025-09-17T17:41:17.232465] [WARN ] [MAIN ] BKN: No existing data found, performing full refresh instead. [2025-09-17T17:41:17.232602] [INFO ] [MAIN ] BKN: Wiping existing primary data before full refresh. [2025-09-17T17:41:17.232659] [INFO ] [LOCAL ] BKN: Starting deletion of primary data. [2025-09-17T17:41:17.232712] [DEBUG] [LOCAL ] BKN: No primary data file found to delete. [2025-09-17T17:41:17.232751] [INFO ] [MAIN ] BKN: Starting full primary refresh. [2025-09-17T17:41:17.609513] [INFO ] [REMOTE ] BKN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:41:18.015782] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-11. [2025-09-17T17:41:18.308195] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T17:41:18.538523] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T17:41:18.815795] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2024-12. [2025-09-17T17:41:18.921358] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T17:41:19.615767] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-07. [2025-09-17T17:41:20.415767] [INFO ] [REMOTE ] BKH: Fetching primary data for 2024-12. [2025-09-17T17:41:20.791722] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T17:41:20.918911] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T17:41:21.215792] [INFO ] [REMOTE ] BKN: Fetching primary data for 2024-12. [2025-09-17T17:41:21.365437] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T17:41:22.015787] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-01. [2025-09-17T17:41:22.056808] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T17:41:22.815781] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-08. [2025-09-17T17:41:23.392718] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T17:41:23.615791] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-01. [2025-09-17T17:41:24.226071] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T17:41:24.241164] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T17:41:24.415786] [INFO ] [REMOTE ] BKE: Fetching primary data for 2025-09. [2025-09-17T17:41:25.215798] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-02. [2025-09-17T17:41:25.890085] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T17:41:26.015790] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-01. [2025-09-17T17:41:26.034948] [INFO ] [REMOTE ] BKE: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T17:41:26.041111] [INFO ] [REMOTE ] BKE: Full fetch complete (50223 records). [2025-09-17T17:41:26.041235] [DEBUG] [VALIDATOR ] BKE: Validating primary data. [2025-09-17T17:41:26.440655] [DEBUG] [VALIDATOR ] BKE: All expected trading days are present. [2025-09-17T17:41:26.440747] [DEBUG] [VALIDATOR ] BKE: Primary data validation passed. [2025-09-17T17:41:26.441346] [INFO ] [MAIN ] BKE: Fetched primary data is valid. [2025-09-17T17:41:26.441390] [DEBUG] [LOCAL ] BKE: Saving primary data. [2025-09-17T17:41:26.442756] [DEBUG] [LOCAL ] BKE: Trimmed 50223 records to 34983 (keeping 200 days of data) [2025-09-17T17:41:26.667045] [DEBUG] [LOCAL ] BKE: Primary data saved (34983 records). [2025-09-17T17:41:26.667198] [INFO ] [MAIN ] BKE: Full history saved. [2025-09-17T17:41:26.668272] [INFO ] [MAIN ] Update Progress: 288/2371 symbols completed. BKE took 30.2s. Estimated remaining: 4h 59m 31s. Rate: 7.0 symbols/min [2025-09-17T17:41:26.821019] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-02. [2025-09-17T17:41:26.844081] [INFO ] [MAIN ] BKSY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:41:26.895212] [DEBUG] [LOCAL ] BKSY: Loaded 48305 existing records from primary storage. [2025-09-17T17:41:26.895393] [INFO ] [MAIN ] BKSY: Loaded 48305 existing records. [2025-09-17T17:41:27.081760] [WARN ] [MAIN ] BKSY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:41:27.082042] [INFO ] [MAIN ] BKSY: Wiping existing primary data before full refresh. [2025-09-17T17:41:27.082087] [INFO ] [LOCAL ] BKSY: Starting deletion of primary data. [2025-09-17T17:41:27.083266] [DEBUG] [LOCAL ] BKSY: Deleted primary data file. [2025-09-17T17:41:27.083320] [INFO ] [MAIN ] BKSY: Starting full primary refresh. [2025-09-17T17:41:27.444067] [INFO ] [REMOTE ] BKSY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:41:27.587496] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T17:41:27.615722] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-02. [2025-09-17T17:41:28.252534] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T17:41:28.415770] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-03. [2025-09-17T17:41:28.744955] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T17:41:29.215779] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-03. [2025-09-17T17:41:29.793543] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T17:41:30.015795] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-04. [2025-09-17T17:41:30.553732] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T17:41:30.815777] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-04. [2025-09-17T17:41:31.210823] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T17:41:31.615786] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-11. [2025-09-17T17:41:32.031448] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T17:41:32.415851] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-05. [2025-09-17T17:41:33.147845] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T17:41:33.215747] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2024-12. [2025-09-17T17:41:33.789582] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T17:41:34.015796] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-05. [2025-09-17T17:41:34.815782] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-03. [2025-09-17T17:41:34.977122] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T17:41:35.142476] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T17:41:35.399138] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T17:41:35.615758] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-06. [2025-09-17T17:41:36.415770] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-06. [2025-09-17T17:41:37.012720] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T17:41:37.215802] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-01. [2025-09-17T17:41:37.839180] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T17:41:38.015773] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-07. [2025-09-17T17:41:38.789662] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T17:41:38.815723] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-02. [2025-09-17T17:41:39.615787] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-07. [2025-09-17T17:41:39.841199] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T17:41:40.415766] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-04. [2025-09-17T17:41:40.783180] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T17:41:40.982831] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T17:41:41.215756] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-03. [2025-09-17T17:41:41.696428] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T17:41:42.015815] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-08. [2025-09-17T17:41:42.815796] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-05. [2025-09-17T17:41:43.003808] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T17:41:43.597416] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T17:41:43.615672] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-06. [2025-09-17T17:41:43.768712] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T17:41:44.345981] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T17:41:44.415815] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-08. [2025-09-17T17:41:45.215813] [INFO ] [REMOTE ] BKKT: Fetching primary data for 2025-09. [2025-09-17T17:41:46.028710] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-07. [2025-09-17T17:41:46.031959] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T17:41:46.815853] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-04. [2025-09-17T17:41:46.975937] [INFO ] [REMOTE ] BKKT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T17:41:46.985108] [INFO ] [REMOTE ] BKKT: Full fetch complete (49361 records). [2025-09-17T17:41:46.985331] [DEBUG] [VALIDATOR ] BKKT: Validating primary data. [2025-09-17T17:41:47.147899] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T17:41:47.449946] [DEBUG] [VALIDATOR ] BKKT: All expected trading days are present. [2025-09-17T17:41:47.450042] [DEBUG] [VALIDATOR ] BKKT: Primary data validation passed. [2025-09-17T17:41:47.450624] [INFO ] [MAIN ] BKKT: Fetched primary data is valid. [2025-09-17T17:41:47.450706] [DEBUG] [LOCAL ] BKKT: Saving primary data. [2025-09-17T17:41:47.451918] [DEBUG] [LOCAL ] BKKT: Trimmed 49361 records to 33950 (keeping 200 days of data) [2025-09-17T17:41:47.630105] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-08. [2025-09-17T17:41:47.654665] [DEBUG] [LOCAL ] BKKT: Primary data saved (33950 records). [2025-09-17T17:41:47.654818] [INFO ] [MAIN ] BKKT: Full history saved. [2025-09-17T17:41:47.656387] [INFO ] [MAIN ] Update Progress: 289/2371 symbols completed. BKKT took 32.2s. Estimated remaining: 5h 0m 52s. Rate: 6.9 symbols/min [2025-09-17T17:41:47.823330] [INFO ] [MAIN ] BKT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:41:47.836592] [DEBUG] [LOCAL ] BKT: Loaded 10412 existing records from primary storage. [2025-09-17T17:41:47.836740] [INFO ] [MAIN ] BKT: Loaded 10412 existing records. [2025-09-17T17:41:48.014802] [WARN ] [MAIN ] BKT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:41:48.015074] [INFO ] [MAIN ] BKT: Wiping existing primary data before full refresh. [2025-09-17T17:41:48.015119] [INFO ] [LOCAL ] BKT: Starting deletion of primary data. [2025-09-17T17:41:48.015573] [DEBUG] [LOCAL ] BKT: Deleted primary data file. [2025-09-17T17:41:48.015622] [INFO ] [MAIN ] BKT: Starting full primary refresh. [2025-09-17T17:41:48.253227] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T17:41:48.392124] [INFO ] [REMOTE ] BKT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:41:48.415740] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-11. [2025-09-17T17:41:48.597520] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T17:41:48.974860] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T17:41:49.215803] [INFO ] [REMOTE ] BKT: Fetching primary data for 2024-12. [2025-09-17T17:41:49.968746] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T17:41:50.015784] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-01. [2025-09-17T17:41:50.701376] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T17:41:50.815759] [INFO ] [REMOTE ] BKH: Fetching primary data for 2025-09. [2025-09-17T17:41:51.615794] [INFO ] [REMOTE ] BKN: Fetching primary data for 2025-09. [2025-09-17T17:41:52.415335] [INFO ] [REMOTE ] BKN: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T17:41:52.416993] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-02. [2025-09-17T17:41:52.417990] [INFO ] [REMOTE ] BKN: Full fetch complete (12076 records). [2025-09-17T17:41:52.418126] [DEBUG] [VALIDATOR ] BKN: Validating primary data. [2025-09-17T17:41:52.719073] [INFO ] [REMOTE ] BKH: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T17:41:52.773619] [INFO ] [REMOTE ] BKH: Full fetch complete (51840 records). [2025-09-17T17:41:52.782317] [DEBUG] [VALIDATOR ] BKH: Validating primary data. [2025-09-17T17:41:52.882204] [DEBUG] [VALIDATOR ] BKN: All expected trading days are present. [2025-09-17T17:41:52.898279] [DEBUG] [VALIDATOR ] BKN: Primary data validation passed. [2025-09-17T17:41:52.909017] [INFO ] [MAIN ] BKN: Fetched primary data is valid. [2025-09-17T17:41:52.909137] [DEBUG] [LOCAL ] BKN: Saving primary data. [2025-09-17T17:41:52.930962] [DEBUG] [LOCAL ] BKN: Trimmed 12076 records to 7692 (keeping 200 days of data) [2025-09-17T17:41:53.224025] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-05. [2025-09-17T17:41:53.261230] [DEBUG] [LOCAL ] BKN: Primary data saved (7692 records). [2025-09-17T17:41:53.261436] [INFO ] [MAIN ] BKN: Full history saved. [2025-09-17T17:41:53.262614] [INFO ] [MAIN ] Update Progress: 290/2371 symbols completed. BKN took 36.2s. Estimated remaining: 5h 0m 21s. Rate: 6.9 symbols/min [2025-09-17T17:41:53.279262] [DEBUG] [VALIDATOR ] BKH: All expected trading days are present. [2025-09-17T17:41:53.279405] [DEBUG] [VALIDATOR ] BKH: Primary data validation passed. [2025-09-17T17:41:53.285353] [INFO ] [MAIN ] BKH: Fetched primary data is valid. [2025-09-17T17:41:53.317333] [DEBUG] [LOCAL ] BKH: Saving primary data. [2025-09-17T17:41:53.372231] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T17:41:53.397520] [DEBUG] [LOCAL ] BKH: Trimmed 51840 records to 36722 (keeping 200 days of data) [2025-09-17T17:41:53.524089] [INFO ] [MAIN ] BKU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:41:53.700418] [DEBUG] [LOCAL ] BKU: Loaded 42061 existing records from primary storage. [2025-09-17T17:41:53.705456] [INFO ] [MAIN ] BKU: Loaded 42061 existing records. [2025-09-17T17:41:53.890038] [DEBUG] [LOCAL ] BKH: Primary data saved (36722 records). [2025-09-17T17:41:53.910108] [INFO ] [MAIN ] BKH: Full history saved. [2025-09-17T17:41:53.910262] [WARN ] [MAIN ] BKU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:41:53.911592] [INFO ] [MAIN ] Update Progress: 291/2371 symbols completed. BKH took 40.0s. Estimated remaining: 4h 59m 15s. Rate: 7.0 symbols/min [2025-09-17T17:41:53.911830] [INFO ] [MAIN ] BKU: Wiping existing primary data before full refresh. [2025-09-17T17:41:53.977335] [INFO ] [LOCAL ] BKU: Starting deletion of primary data. [2025-09-17T17:41:54.012859] [DEBUG] [LOCAL ] BKU: Deleted primary data file. [2025-09-17T17:41:54.015426] [INFO ] [MAIN ] BKU: Starting full primary refresh. [2025-09-17T17:41:54.015769] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-03. [2025-09-17T17:41:54.146261] [INFO ] [MAIN ] BKV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:41:54.427603] [DEBUG] [LOCAL ] BKV: Loaded 30298 existing records from primary storage. [2025-09-17T17:41:54.457739] [INFO ] [MAIN ] BKV: Loaded 30298 existing records. [2025-09-17T17:41:54.567017] [INFO ] [REMOTE ] BKU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:41:54.677717] [WARN ] [MAIN ] BKV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:41:54.677998] [INFO ] [MAIN ] BKV: Wiping existing primary data before full refresh. [2025-09-17T17:41:54.678044] [INFO ] [LOCAL ] BKV: Starting deletion of primary data. [2025-09-17T17:41:54.678838] [DEBUG] [LOCAL ] BKV: Deleted primary data file. [2025-09-17T17:41:54.678893] [INFO ] [MAIN ] BKV: Starting full primary refresh. [2025-09-17T17:41:54.822951] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-11. [2025-09-17T17:41:55.047533] [INFO ] [REMOTE ] BKV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:41:55.079702] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T17:41:55.121709] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T17:41:55.615770] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-04. [2025-09-17T17:41:56.234508] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T17:41:56.414828] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T17:41:56.419695] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-05. [2025-09-17T17:41:56.869556] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T17:41:57.215800] [INFO ] [REMOTE ] BKU: Fetching primary data for 2024-12. [2025-09-17T17:41:58.015828] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-06. [2025-09-17T17:41:58.657268] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T17:41:58.781796] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T17:41:58.815780] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-06. [2025-09-17T17:41:59.615828] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-01. [2025-09-17T17:42:00.415815] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-07. [2025-09-17T17:42:00.920826] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T17:42:01.130885] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T17:42:01.158622] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T17:42:01.215831] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-07. [2025-09-17T17:42:02.015822] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-11. [2025-09-17T17:42:02.815801] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-02. [2025-09-17T17:42:03.121175] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T17:42:03.391579] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T17:42:03.615782] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-08. [2025-09-17T17:42:03.828131] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T17:42:04.415793] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-03. [2025-09-17T17:42:05.215793] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-08. [2025-09-17T17:42:05.577343] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T17:42:05.738810] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T17:42:06.015811] [INFO ] [REMOTE ] BKV: Fetching primary data for 2024-12. [2025-09-17T17:42:06.033561] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T17:42:06.815791] [INFO ] [REMOTE ] BKSY: Fetching primary data for 2025-09. [2025-09-17T17:42:07.147345] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T17:42:07.615804] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-01. [2025-09-17T17:42:08.280698] [INFO ] [REMOTE ] BKSY: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T17:42:08.287847] [INFO ] [REMOTE ] BKSY: Full fetch complete (69061 records). [2025-09-17T17:42:08.288044] [DEBUG] [VALIDATOR ] BKSY: Validating primary data. [2025-09-17T17:42:08.420845] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-04. [2025-09-17T17:42:08.733945] [DEBUG] [VALIDATOR ] BKSY: All expected trading days are present. [2025-09-17T17:42:08.734105] [DEBUG] [VALIDATOR ] BKSY: Primary data validation passed. [2025-09-17T17:42:08.734968] [INFO ] [MAIN ] BKSY: Fetched primary data is valid. [2025-09-17T17:42:08.735056] [DEBUG] [LOCAL ] BKSY: Saving primary data. [2025-09-17T17:42:08.736668] [DEBUG] [LOCAL ] BKSY: Trimmed 69061 records to 48297 (keeping 200 days of data) [2025-09-17T17:42:08.888807] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T17:42:09.074978] [DEBUG] [LOCAL ] BKSY: Primary data saved (48297 records). [2025-09-17T17:42:09.075158] [INFO ] [MAIN ] BKSY: Full history saved. [2025-09-17T17:42:09.076233] [INFO ] [MAIN ] Update Progress: 292/2371 symbols completed. BKSY took 42.4s. Estimated remaining: 4h 59m 53s. Rate: 6.9 symbols/min [2025-09-17T17:42:09.225983] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-02. [2025-09-17T17:42:09.261827] [INFO ] [MAIN ] BLCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:42:09.303015] [DEBUG] [LOCAL ] BLCO: Loaded 36497 existing records from primary storage. [2025-09-17T17:42:09.303191] [INFO ] [MAIN ] BLCO: Loaded 36497 existing records. [2025-09-17T17:42:09.489278] [WARN ] [MAIN ] BLCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:42:09.489515] [INFO ] [MAIN ] BLCO: Wiping existing primary data before full refresh. [2025-09-17T17:42:09.489561] [INFO ] [LOCAL ] BLCO: Starting deletion of primary data. [2025-09-17T17:42:09.490357] [DEBUG] [LOCAL ] BLCO: Deleted primary data file. [2025-09-17T17:42:09.490442] [INFO ] [MAIN ] BLCO: Starting full primary refresh. [2025-09-17T17:42:09.873972] [INFO ] [REMOTE ] BLCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:42:10.015834] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-11. [2025-09-17T17:42:10.239051] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T17:42:10.578827] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T17:42:10.815800] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-05. [2025-09-17T17:42:10.957973] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T17:42:11.615804] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2024-12. [2025-09-17T17:42:12.357426] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T17:42:12.415757] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-06. [2025-09-17T17:42:12.960310] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T17:42:13.215839] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-03. [2025-09-17T17:42:13.676102] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T17:42:14.015788] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-07. [2025-09-17T17:42:14.707774] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T17:42:14.815778] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-04. [2025-09-17T17:42:15.615803] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-01. [2025-09-17T17:42:15.911709] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T17:42:15.988234] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T17:42:16.415773] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-08. [2025-09-17T17:42:16.603386] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T17:42:17.215787] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-05. [2025-09-17T17:42:17.480033] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T17:42:18.015805] [INFO ] [REMOTE ] BKU: Fetching primary data for 2025-09. [2025-09-17T17:42:18.510907] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T17:42:18.815803] [INFO ] [REMOTE ] BKT: Fetching primary data for 2025-09. [2025-09-17T17:42:19.467455] [INFO ] [REMOTE ] BKU: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T17:42:19.472713] [INFO ] [REMOTE ] BKU: Full fetch complete (59480 records). [2025-09-17T17:42:19.472861] [DEBUG] [VALIDATOR ] BKU: Validating primary data. [2025-09-17T17:42:19.619013] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-06. [2025-09-17T17:42:19.874409] [DEBUG] [VALIDATOR ] BKU: All expected trading days are present. [2025-09-17T17:42:19.874501] [DEBUG] [VALIDATOR ] BKU: Primary data validation passed. [2025-09-17T17:42:19.875197] [INFO ] [MAIN ] BKU: Fetched primary data is valid. [2025-09-17T17:42:19.875246] [DEBUG] [LOCAL ] BKU: Saving primary data. [2025-09-17T17:42:19.876531] [DEBUG] [LOCAL ] BKU: Trimmed 59480 records to 42104 (keeping 200 days of data) [2025-09-17T17:42:19.987441] [INFO ] [REMOTE ] BKT: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T17:42:19.995214] [INFO ] [REMOTE ] BKT: Full fetch complete (14637 records). [2025-09-17T17:42:19.996463] [DEBUG] [VALIDATOR ] BKT: Validating primary data. [2025-09-17T17:42:20.409560] [DEBUG] [VALIDATOR ] BKT: All expected trading days are present. [2025-09-17T17:42:20.412235] [DEBUG] [VALIDATOR ] BKT: Primary data validation passed. [2025-09-17T17:42:20.412679] [INFO ] [MAIN ] BKT: Fetched primary data is valid. [2025-09-17T17:42:20.412725] [DEBUG] [LOCAL ] BKT: Saving primary data. [2025-09-17T17:42:20.472234] [DEBUG] [LOCAL ] BKT: Trimmed 14637 records to 10553 (keeping 200 days of data) [2025-09-17T17:42:20.471498] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-02. [2025-09-17T17:42:20.580375] [DEBUG] [LOCAL ] BKT: Primary data saved (10553 records). [2025-09-17T17:42:20.581615] [INFO ] [MAIN ] BKT: Full history saved. [2025-09-17T17:42:20.582489] [INFO ] [MAIN ] Update Progress: 293/2371 symbols completed. BKT took 32.9s. Estimated remaining: 5h 0m 5s. Rate: 6.9 symbols/min [2025-09-17T17:42:20.783815] [INFO ] [MAIN ] BLD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:42:20.809022] [DEBUG] [LOCAL ] BKU: Primary data saved (42104 records). [2025-09-17T17:42:20.809182] [INFO ] [MAIN ] BKU: Full history saved. [2025-09-17T17:42:20.809365] [INFO ] [MAIN ] Update Progress: 294/2371 symbols completed. BKU took 27.5s. Estimated remaining: 4h 58m 56s. Rate: 6.9 symbols/min [2025-09-17T17:42:21.011426] [INFO ] [MAIN ] BLDR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:42:21.012382] [DEBUG] [LOCAL ] BLD: Loaded 28206 existing records from primary storage. [2025-09-17T17:42:21.012583] [INFO ] [MAIN ] BLD: Loaded 28206 existing records. [2025-09-17T17:42:21.195418] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T17:42:21.246228] [WARN ] [MAIN ] BLD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:42:21.246597] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-07. [2025-09-17T17:42:21.247656] [INFO ] [MAIN ] BLD: Wiping existing primary data before full refresh. [2025-09-17T17:42:21.247755] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-17T17:42:21.248262] [DEBUG] [LOCAL ] BLD: Deleted primary data file. [2025-09-17T17:42:21.248394] [INFO ] [MAIN ] BLD: Starting full primary refresh. [2025-09-17T17:42:21.381692] [DEBUG] [LOCAL ] BLDR: Loaded 51613 existing records from primary storage. [2025-09-17T17:42:21.397132] [INFO ] [MAIN ] BLDR: Loaded 51613 existing records. [2025-09-17T17:42:21.814342] [INFO ] [REMOTE ] BLD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:42:21.822327] [WARN ] [MAIN ] BLDR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:42:21.822819] [INFO ] [MAIN ] BLDR: Wiping existing primary data before full refresh. [2025-09-17T17:42:21.822879] [INFO ] [LOCAL ] BLDR: Starting deletion of primary data. [2025-09-17T17:42:21.823885] [DEBUG] [LOCAL ] BLDR: Deleted primary data file. [2025-09-17T17:42:21.823946] [INFO ] [MAIN ] BLDR: Starting full primary refresh. [2025-09-17T17:42:22.034869] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-11. [2025-09-17T17:42:22.186250] [INFO ] [REMOTE ] BLDR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:42:22.223722] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T17:42:22.259729] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T17:42:22.815792] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-03. [2025-09-17T17:42:23.494827] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T17:42:23.615799] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-08. [2025-09-17T17:42:24.243255] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T17:42:24.415787] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-04. [2025-09-17T17:42:24.847999] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T17:42:25.215774] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-11. [2025-09-17T17:42:25.522112] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T17:42:26.015727] [INFO ] [REMOTE ] BKV: Fetching primary data for 2025-09. [2025-09-17T17:42:26.815789] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-05. [2025-09-17T17:42:27.011005] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T17:42:27.147712] [INFO ] [REMOTE ] BKV: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T17:42:27.153030] [INFO ] [REMOTE ] BKV: Full fetch complete (44983 records). [2025-09-17T17:42:27.153181] [DEBUG] [VALIDATOR ] BKV: Validating primary data. [2025-09-17T17:42:27.556342] [DEBUG] [VALIDATOR ] BKV: All expected trading days are present. [2025-09-17T17:42:27.556445] [DEBUG] [VALIDATOR ] BKV: Primary data validation passed. [2025-09-17T17:42:27.557149] [INFO ] [MAIN ] BKV: Fetched primary data is valid. [2025-09-17T17:42:27.557199] [DEBUG] [LOCAL ] BKV: Saving primary data. [2025-09-17T17:42:27.558449] [DEBUG] [LOCAL ] BKV: Trimmed 44983 records to 30233 (keeping 200 days of data) [2025-09-17T17:42:27.621467] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2024-12. [2025-09-17T17:42:27.751331] [DEBUG] [LOCAL ] BKV: Primary data saved (30233 records). [2025-09-17T17:42:27.751490] [INFO ] [MAIN ] BKV: Full history saved. [2025-09-17T17:42:27.751604] [INFO ] [MAIN ] Update Progress: 295/2371 symbols completed. BKV took 33.8s. Estimated remaining: 4h 58m 36s. Rate: 7.0 symbols/min [2025-09-17T17:42:27.929980] [INFO ] [MAIN ] BLE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:42:27.945505] [DEBUG] [LOCAL ] BLE: Loaded 14696 existing records from primary storage. [2025-09-17T17:42:27.945656] [INFO ] [MAIN ] BLE: Loaded 14696 existing records. [2025-09-17T17:42:28.132270] [WARN ] [MAIN ] BLE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:42:28.132694] [INFO ] [MAIN ] BLE: Wiping existing primary data before full refresh. [2025-09-17T17:42:28.132783] [INFO ] [LOCAL ] BLE: Starting deletion of primary data. [2025-09-17T17:42:28.133332] [DEBUG] [LOCAL ] BLE: Deleted primary data file. [2025-09-17T17:42:28.133415] [INFO ] [MAIN ] BLE: Starting full primary refresh. [2025-09-17T17:42:28.314946] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T17:42:28.420960] [INFO ] [REMOTE ] BLD: Fetching primary data for 2024-12. [2025-09-17T17:42:28.526772] [INFO ] [REMOTE ] BLE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:42:29.215802] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-06. [2025-09-17T17:42:29.316341] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T17:42:29.668383] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T17:42:30.015791] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-01. [2025-09-17T17:42:30.539747] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T17:42:30.815777] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-07. [2025-09-17T17:42:31.567957] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T17:42:31.615766] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-02. [2025-09-17T17:42:32.334047] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T17:42:32.415796] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-11. [2025-09-17T17:42:33.012514] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T17:42:33.215789] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-08. [2025-09-17T17:42:33.526916] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T17:42:34.015785] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-01. [2025-09-17T17:42:34.237565] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T17:42:34.815786] [INFO ] [REMOTE ] BLCO: Fetching primary data for 2025-09. [2025-09-17T17:42:35.311878] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T17:42:35.615783] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-03. [2025-09-17T17:42:35.999573] [INFO ] [REMOTE ] BLCO: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T17:42:36.004096] [INFO ] [REMOTE ] BLCO: Full fetch complete (52469 records). [2025-09-17T17:42:36.004225] [DEBUG] [VALIDATOR ] BLCO: Validating primary data. [2025-09-17T17:42:36.399535] [DEBUG] [VALIDATOR ] BLCO: All expected trading days are present. [2025-09-17T17:42:36.399690] [DEBUG] [VALIDATOR ] BLCO: Primary data validation passed. [2025-09-17T17:42:36.400309] [INFO ] [MAIN ] BLCO: Fetched primary data is valid. [2025-09-17T17:42:36.400354] [DEBUG] [LOCAL ] BLCO: Saving primary data. [2025-09-17T17:42:36.401803] [DEBUG] [LOCAL ] BLCO: Trimmed 52469 records to 36348 (keeping 200 days of data) [2025-09-17T17:42:36.451997] [INFO ] [REMOTE ] BLE: Fetching primary data for 2024-12. [2025-09-17T17:42:36.621537] [DEBUG] [LOCAL ] BLCO: Primary data saved (36348 records). [2025-09-17T17:42:36.621709] [INFO ] [MAIN ] BLCO: Full history saved. [2025-09-17T17:42:36.622358] [INFO ] [MAIN ] Update Progress: 296/2371 symbols completed. BLCO took 27.5s. Estimated remaining: 4h 58m 29s. Rate: 7.0 symbols/min [2025-09-17T17:42:36.795540] [INFO ] [MAIN ] BLK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:42:36.834532] [DEBUG] [LOCAL ] BLK: Loaded 35450 existing records from primary storage. [2025-09-17T17:42:36.834697] [INFO ] [MAIN ] BLK: Loaded 35450 existing records. [2025-09-17T17:42:37.010038] [WARN ] [MAIN ] BLK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:42:37.010308] [INFO ] [MAIN ] BLK: Wiping existing primary data before full refresh. [2025-09-17T17:42:37.010352] [INFO ] [LOCAL ] BLK: Starting deletion of primary data. [2025-09-17T17:42:37.011237] [DEBUG] [LOCAL ] BLK: Deleted primary data file. [2025-09-17T17:42:37.011286] [INFO ] [MAIN ] BLK: Starting full primary refresh. [2025-09-17T17:42:37.220368] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-02. [2025-09-17T17:42:37.367845] [INFO ] [REMOTE ] BLK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:42:37.492238] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T17:42:37.536155] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T17:42:38.015782] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-11. [2025-09-17T17:42:38.614161] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T17:42:38.815815] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-04. [2025-09-17T17:42:39.591026] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T17:42:39.615734] [INFO ] [REMOTE ] BLK: Fetching primary data for 2024-12. [2025-09-17T17:42:40.113103] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T17:42:40.415813] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-03. [2025-09-17T17:42:40.880337] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T17:42:41.215849] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-01. [2025-09-17T17:42:41.854182] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T17:42:42.015818] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-04. [2025-09-17T17:42:42.718283] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T17:42:42.815798] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-05. [2025-09-17T17:42:43.278277] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T17:42:43.615786] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-02. [2025-09-17T17:42:44.415805] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-01. [2025-09-17T17:42:44.548418] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T17:42:45.215783] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-06. [2025-09-17T17:42:45.451543] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T17:42:45.491320] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T17:42:46.015772] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-03. [2025-09-17T17:42:46.815857] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-02. [2025-09-17T17:42:47.010573] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T17:42:47.615840] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-07. [2025-09-17T17:42:47.738872] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T17:42:47.769050] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T17:42:48.415772] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-03. [2025-09-17T17:42:49.215745] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-04. [2025-09-17T17:42:49.392231] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T17:42:49.586284] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T17:42:50.015835] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-08. [2025-09-17T17:42:50.815786] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-04. [2025-09-17T17:42:51.148563] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T17:42:51.466359] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T17:42:51.508976] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T17:42:51.615813] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-05. [2025-09-17T17:42:52.415815] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-05. [2025-09-17T17:42:53.215772] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-05. [2025-09-17T17:42:53.266988] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T17:42:53.290871] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T17:42:54.015801] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-06. [2025-09-17T17:42:54.327672] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T17:42:54.685284] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T17:42:54.815827] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-06. [2025-09-17T17:42:55.615788] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-07. [2025-09-17T17:42:56.101361] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T17:42:56.227845] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T17:42:56.415793] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-07. [2025-09-17T17:42:57.215816] [INFO ] [REMOTE ] BLDR: Fetching primary data for 2025-09. [2025-09-17T17:42:57.531942] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T17:42:58.015856] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-06. [2025-09-17T17:42:58.815867] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-08. [2025-09-17T17:42:58.990724] [INFO ] [REMOTE ] BLDR: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T17:42:58.997762] [INFO ] [REMOTE ] BLDR: Full fetch complete (73861 records). [2025-09-17T17:42:58.997937] [DEBUG] [VALIDATOR ] BLDR: Validating primary data. [2025-09-17T17:42:59.456625] [DEBUG] [VALIDATOR ] BLDR: All expected trading days are present. [2025-09-17T17:42:59.456775] [DEBUG] [VALIDATOR ] BLDR: Primary data validation passed. [2025-09-17T17:42:59.457626] [INFO ] [MAIN ] BLDR: Fetched primary data is valid. [2025-09-17T17:42:59.457691] [DEBUG] [LOCAL ] BLDR: Saving primary data. [2025-09-17T17:42:59.459805] [DEBUG] [LOCAL ] BLDR: Trimmed 73861 records to 51629 (keeping 200 days of data) [2025-09-17T17:42:59.642572] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-08. [2025-09-17T17:42:59.710447] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T17:42:59.813686] [DEBUG] [LOCAL ] BLDR: Primary data saved (51629 records). [2025-09-17T17:42:59.813882] [INFO ] [MAIN ] BLDR: Full history saved. [2025-09-17T17:42:59.813972] [INFO ] [MAIN ] Update Progress: 297/2371 symbols completed. BLDR took 39.0s. Estimated remaining: 5h 0m 2s. Rate: 6.9 symbols/min [2025-09-17T17:42:59.987427] [INFO ] [MAIN ] BLND: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:43:00.031946] [DEBUG] [LOCAL ] BLND: Loaded 49537 existing records from primary storage. [2025-09-17T17:43:00.032095] [INFO ] [MAIN ] BLND: Loaded 49537 existing records. [2025-09-17T17:43:00.226452] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T17:43:00.247418] [WARN ] [MAIN ] BLND: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:43:00.254157] [INFO ] [MAIN ] BLND: Wiping existing primary data before full refresh. [2025-09-17T17:43:00.254271] [INFO ] [LOCAL ] BLND: Starting deletion of primary data. [2025-09-17T17:43:00.255408] [DEBUG] [LOCAL ] BLND: Deleted primary data file. [2025-09-17T17:43:00.255472] [INFO ] [MAIN ] BLND: Starting full primary refresh. [2025-09-17T17:43:00.418075] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-07. [2025-09-17T17:43:00.613391] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T17:43:00.664191] [INFO ] [REMOTE ] BLND: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:43:01.215831] [INFO ] [REMOTE ] BLD: Fetching primary data for 2025-09. [2025-09-17T17:43:02.015812] [INFO ] [REMOTE ] BLE: Fetching primary data for 2025-09. [2025-09-17T17:43:02.391579] [INFO ] [REMOTE ] BLD: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T17:43:02.395991] [INFO ] [REMOTE ] BLD: Full fetch complete (40038 records). [2025-09-17T17:43:02.396119] [DEBUG] [VALIDATOR ] BLD: Validating primary data. [2025-09-17T17:43:02.396900] [FATAL] [VALIDATOR ] BLD: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:43:02.396981] [FATAL] [MAIN ] BLD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:43:02.397028] [WARN ] [MAIN ] BLD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:43:02.397068] [INFO ] [LOCAL ] BLD: Starting deletion of primary data. [2025-09-17T17:43:02.397127] [DEBUG] [LOCAL ] BLD: No primary data file found to delete. [2025-09-17T17:43:02.397170] [INFO ] [LOCAL ] BLD: Starting deletion of derivative data. [2025-09-17T17:43:02.397494] [DEBUG] [LOCAL ] BLD: Deleted derivative data file. [2025-09-17T17:43:02.397577] [INFO ] [MAIN ] Update Progress: 298/2371 symbols completed. BLD took 41.8s. Estimated remaining: 4h 59m 11s. Rate: 6.9 symbols/min [2025-09-17T17:43:02.575152] [INFO ] [MAIN ] BLSH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:43:02.575540] [DEBUG] [LOCAL ] BLSH: No existing data file found in primary storage. [2025-09-17T17:43:02.575628] [WARN ] [MAIN ] BLSH: No existing data found, performing full refresh instead. [2025-09-17T17:43:02.575801] [INFO ] [MAIN ] BLSH: Wiping existing primary data before full refresh. [2025-09-17T17:43:02.575855] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-17T17:43:02.575913] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-17T17:43:02.575960] [INFO ] [MAIN ] BLSH: Starting full primary refresh. [2025-09-17T17:43:02.720352] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-17T17:43:02.822061] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-11. [2025-09-17T17:43:02.995910] [INFO ] [REMOTE ] BLSH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:43:02.996741] [INFO ] [REMOTE ] BLE: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T17:43:02.999334] [INFO ] [REMOTE ] BLE: Full fetch complete (20540 records). [2025-09-17T17:43:02.999405] [DEBUG] [VALIDATOR ] BLE: Validating primary data. [2025-09-17T17:43:03.363250] [DEBUG] [VALIDATOR ] BLE: All expected trading days are present. [2025-09-17T17:43:03.363326] [DEBUG] [VALIDATOR ] BLE: Primary data validation passed. [2025-09-17T17:43:03.363681] [INFO ] [MAIN ] BLE: Fetched primary data is valid. [2025-09-17T17:43:03.363752] [DEBUG] [LOCAL ] BLE: Saving primary data. [2025-09-17T17:43:03.364599] [DEBUG] [LOCAL ] BLE: Trimmed 20540 records to 14756 (keeping 200 days of data) [2025-09-17T17:43:03.452367] [DEBUG] [LOCAL ] BLE: Primary data saved (14756 records). [2025-09-17T17:43:03.452501] [INFO ] [MAIN ] BLE: Full history saved. [2025-09-17T17:43:03.452581] [INFO ] [MAIN ] Update Progress: 299/2371 symbols completed. BLE took 35.7s. Estimated remaining: 4h 58m 10s. Rate: 6.9 symbols/min [2025-09-17T17:43:03.620849] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-11. [2025-09-17T17:43:03.623316] [INFO ] [MAIN ] BLW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:43:03.638809] [DEBUG] [LOCAL ] BLW: Loaded 12961 existing records from primary storage. [2025-09-17T17:43:03.638948] [INFO ] [MAIN ] BLW: Loaded 12961 existing records. [2025-09-17T17:43:03.821663] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:43:03.824897] [WARN ] [MAIN ] BLW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:43:03.825317] [INFO ] [MAIN ] BLW: Wiping existing primary data before full refresh. [2025-09-17T17:43:03.825399] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-11 [2025-09-17T17:43:03.825526] [INFO ] [LOCAL ] BLW: Starting deletion of primary data. [2025-09-17T17:43:03.826182] [DEBUG] [LOCAL ] BLW: Deleted primary data file. [2025-09-17T17:43:03.826232] [INFO ] [MAIN ] BLW: Starting full primary refresh. [2025-09-17T17:43:04.184956] [INFO ] [REMOTE ] BLW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:43:04.415841] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2024-12. [2025-09-17T17:43:04.614744] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:43:04.615104] [WARN ] [REMOTE ] BLSH: No data returned for month 2024-12 [2025-09-17T17:43:04.707156] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T17:43:05.215780] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-01. [2025-09-17T17:43:05.450988] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:43:05.451299] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-01 [2025-09-17T17:43:06.015791] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-08. [2025-09-17T17:43:06.815794] [INFO ] [REMOTE ] BLND: Fetching primary data for 2024-12. [2025-09-17T17:43:07.486351] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T17:43:07.615779] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-02. [2025-09-17T17:43:07.804813] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:43:07.805131] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-02 [2025-09-17T17:43:08.415799] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-11. [2025-09-17T17:43:08.487984] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T17:43:09.215743] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-03. [2025-09-17T17:43:09.485914] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:43:09.486271] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-03 [2025-09-17T17:43:09.495248] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T17:43:10.015779] [INFO ] [REMOTE ] BLW: Fetching primary data for 2024-12. [2025-09-17T17:43:10.697337] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T17:43:10.815788] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-01. [2025-09-17T17:43:11.615761] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-04. [2025-09-17T17:43:11.839199] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:43:11.839553] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-04 [2025-09-17T17:43:11.887293] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T17:43:12.415786] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-02. [2025-09-17T17:43:13.215762] [INFO ] [REMOTE ] BLK: Fetching primary data for 2025-09. [2025-09-17T17:43:13.225540] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T17:43:14.015813] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-03. [2025-09-17T17:43:14.815793] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-05. [2025-09-17T17:43:14.933268] [INFO ] [REMOTE ] BLK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T17:43:14.937898] [INFO ] [REMOTE ] BLK: Full fetch complete (53196 records). [2025-09-17T17:43:14.938041] [DEBUG] [VALIDATOR ] BLK: Validating primary data. [2025-09-17T17:43:15.179921] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:43:15.214055] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-05 [2025-09-17T17:43:15.338999] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T17:43:15.415463] [DEBUG] [VALIDATOR ] BLK: All expected trading days are present. [2025-09-17T17:43:15.415585] [DEBUG] [VALIDATOR ] BLK: Primary data validation passed. [2025-09-17T17:43:15.416772] [INFO ] [MAIN ] BLK: Fetched primary data is valid. [2025-09-17T17:43:15.416845] [DEBUG] [LOCAL ] BLK: Saving primary data. [2025-09-17T17:43:15.418609] [DEBUG] [LOCAL ] BLK: Trimmed 53196 records to 35384 (keeping 200 days of data) [2025-09-17T17:43:15.625268] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-01. [2025-09-17T17:43:15.655897] [DEBUG] [LOCAL ] BLK: Primary data saved (35384 records). [2025-09-17T17:43:15.656047] [INFO ] [MAIN ] BLK: Full history saved. [2025-09-17T17:43:15.656983] [INFO ] [MAIN ] Update Progress: 300/2371 symbols completed. BLK took 39.0s. Estimated remaining: 4h 58m 26s. Rate: 6.9 symbols/min [2025-09-17T17:43:15.827023] [INFO ] [MAIN ] BLX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:43:15.844231] [DEBUG] [LOCAL ] BLX: Loaded 16056 existing records from primary storage. [2025-09-17T17:43:15.844362] [INFO ] [MAIN ] BLX: Loaded 16056 existing records. [2025-09-17T17:43:16.020996] [WARN ] [MAIN ] BLX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:43:16.021233] [INFO ] [MAIN ] BLX: Wiping existing primary data before full refresh. [2025-09-17T17:43:16.021280] [INFO ] [LOCAL ] BLX: Starting deletion of primary data. [2025-09-17T17:43:16.021810] [DEBUG] [LOCAL ] BLX: Deleted primary data file. [2025-09-17T17:43:16.021864] [INFO ] [MAIN ] BLX: Starting full primary refresh. [2025-09-17T17:43:16.379831] [INFO ] [REMOTE ] BLX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:43:16.415759] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-11. [2025-09-17T17:43:17.215787] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-04. [2025-09-17T17:43:17.497337] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T17:43:17.546729] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T17:43:17.915132] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T17:43:18.015810] [INFO ] [REMOTE ] BLX: Fetching primary data for 2024-12. [2025-09-17T17:43:18.815803] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-06. [2025-09-17T17:43:19.006389] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T17:43:19.515518] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:43:19.515861] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-06 [2025-09-17T17:43:19.615785] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-01. [2025-09-17T17:43:20.415778] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-05. [2025-09-17T17:43:20.601432] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T17:43:21.215769] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-02. [2025-09-17T17:43:21.279431] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T17:43:22.015797] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-07. [2025-09-17T17:43:22.208427] [DEBUG] [REMOTE ] BLSH: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:43:22.208830] [WARN ] [REMOTE ] BLSH: No data returned for month 2025-07 [2025-09-17T17:43:22.823404] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-06. [2025-09-17T17:43:22.825839] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T17:43:23.615789] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-03. [2025-09-17T17:43:23.658974] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T17:43:24.415807] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-07. [2025-09-17T17:43:25.143580] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T17:43:25.215783] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-08. [2025-09-17T17:43:25.337667] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T17:43:26.015791] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-04. [2025-09-17T17:43:26.815786] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-02. [2025-09-17T17:43:26.880332] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T17:43:27.325863] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T17:43:27.501165] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T17:43:27.615769] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-05. [2025-09-17T17:43:28.415832] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-03. [2025-09-17T17:43:29.160315] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T17:43:29.215773] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-06. [2025-09-17T17:43:29.495748] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T17:43:30.015784] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-08. [2025-09-17T17:43:30.764682] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T17:43:30.815785] [INFO ] [REMOTE ] BLSH: Fetching primary data for 2025-09. [2025-09-17T17:43:30.842365] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T17:43:31.615842] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-07. [2025-09-17T17:43:32.415769] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-04. [2025-09-17T17:43:32.912225] [INFO ] [REMOTE ] BLSH: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-17T17:43:32.918735] [INFO ] [REMOTE ] BLSH: Full fetch complete (9492 records). [2025-09-17T17:43:32.918839] [DEBUG] [VALIDATOR ] BLSH: Validating primary data. [2025-09-17T17:43:33.098912] [WARN ] [VALIDATOR ] BLSH: Validation failed - insufficient historical data. Have 25 unique days, need 200 days [2025-09-17T17:43:33.099236] [FATAL] [MAIN ] BLSH: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:43:33.099314] [WARN ] [MAIN ] BLSH: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:43:33.099370] [INFO ] [LOCAL ] BLSH: Starting deletion of primary data. [2025-09-17T17:43:33.099444] [DEBUG] [LOCAL ] BLSH: No primary data file found to delete. [2025-09-17T17:43:33.099494] [INFO ] [LOCAL ] BLSH: Starting deletion of derivative data. [2025-09-17T17:43:33.099554] [DEBUG] [LOCAL ] BLSH: No derivative data file found to delete. [2025-09-17T17:43:33.099631] [INFO ] [MAIN ] Update Progress: 301/2371 symbols completed. BLSH took 30.7s. Estimated remaining: 4h 59m 17s. Rate: 6.9 symbols/min [2025-09-17T17:43:33.220881] [INFO ] [REMOTE ] BLW: Fetching primary data for 2025-09. [2025-09-17T17:43:33.273134] [INFO ] [MAIN ] BMA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:43:33.305600] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T17:43:33.347005] [DEBUG] [LOCAL ] BMA: Loaded 34448 existing records from primary storage. [2025-09-17T17:43:33.347162] [INFO ] [MAIN ] BMA: Loaded 34448 existing records. [2025-09-17T17:43:33.535140] [WARN ] [MAIN ] BMA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:43:33.535473] [INFO ] [MAIN ] BMA: Wiping existing primary data before full refresh. [2025-09-17T17:43:33.535677] [INFO ] [LOCAL ] BMA: Starting deletion of primary data. [2025-09-17T17:43:33.541925] [DEBUG] [LOCAL ] BMA: Deleted primary data file. [2025-09-17T17:43:33.547568] [INFO ] [MAIN ] BMA: Starting full primary refresh. [2025-09-17T17:43:33.553531] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T17:43:33.918566] [INFO ] [REMOTE ] BMA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:43:34.015726] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-05. [2025-09-17T17:43:34.092435] [INFO ] [REMOTE ] BLW: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T17:43:34.095063] [INFO ] [REMOTE ] BLW: Full fetch complete (18900 records). [2025-09-17T17:43:34.095139] [DEBUG] [VALIDATOR ] BLW: Validating primary data. [2025-09-17T17:43:34.474348] [DEBUG] [VALIDATOR ] BLW: All expected trading days are present. [2025-09-17T17:43:34.474428] [DEBUG] [VALIDATOR ] BLW: Primary data validation passed. [2025-09-17T17:43:34.474797] [INFO ] [MAIN ] BLW: Fetched primary data is valid. [2025-09-17T17:43:34.474842] [DEBUG] [LOCAL ] BLW: Saving primary data. [2025-09-17T17:43:34.475558] [DEBUG] [LOCAL ] BLW: Trimmed 18900 records to 12955 (keeping 200 days of data) [2025-09-17T17:43:34.555033] [DEBUG] [LOCAL ] BLW: Primary data saved (12955 records). [2025-09-17T17:43:34.555187] [INFO ] [MAIN ] BLW: Full history saved. [2025-09-17T17:43:34.555274] [INFO ] [MAIN ] Update Progress: 302/2371 symbols completed. BLW took 31.1s. Estimated remaining: 4h 58m 19s. Rate: 6.9 symbols/min [2025-09-17T17:43:34.730897] [INFO ] [MAIN ] BME: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:43:34.742258] [DEBUG] [LOCAL ] BME: Loaded 10803 existing records from primary storage. [2025-09-17T17:43:34.742398] [INFO ] [MAIN ] BME: Loaded 10803 existing records. [2025-09-17T17:43:34.820914] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-11. [2025-09-17T17:43:34.923593] [WARN ] [MAIN ] BME: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:43:34.923859] [INFO ] [MAIN ] BME: Wiping existing primary data before full refresh. [2025-09-17T17:43:34.923904] [INFO ] [LOCAL ] BME: Starting deletion of primary data. [2025-09-17T17:43:34.924343] [DEBUG] [LOCAL ] BME: Deleted primary data file. [2025-09-17T17:43:34.924415] [INFO ] [MAIN ] BME: Starting full primary refresh. [2025-09-17T17:43:35.214923] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T17:43:35.298245] [INFO ] [REMOTE ] BME: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:43:35.615777] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-06. [2025-09-17T17:43:36.339396] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T17:43:36.355151] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T17:43:36.415753] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-07. [2025-09-17T17:43:37.215775] [INFO ] [REMOTE ] BMA: Fetching primary data for 2024-12. [2025-09-17T17:43:37.422256] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T17:43:38.015775] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-11. [2025-09-17T17:43:38.815823] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-08. [2025-09-17T17:43:38.895967] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T17:43:38.994142] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T17:43:39.615802] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-01. [2025-09-17T17:43:40.415773] [INFO ] [REMOTE ] BME: Fetching primary data for 2024-12. [2025-09-17T17:43:40.635970] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T17:43:41.057578] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T17:43:41.135475] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T17:43:41.215808] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-01. [2025-09-17T17:43:41.842233] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T17:43:42.015827] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-08. [2025-09-17T17:43:42.815691] [INFO ] [REMOTE ] BLND: Fetching primary data for 2025-09. [2025-09-17T17:43:42.900116] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T17:43:43.615767] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-02. [2025-09-17T17:43:44.415826] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-02. [2025-09-17T17:43:44.444145] [INFO ] [REMOTE ] BLND: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T17:43:44.450753] [INFO ] [REMOTE ] BLND: Full fetch complete (72180 records). [2025-09-17T17:43:44.450871] [DEBUG] [VALIDATOR ] BLND: Validating primary data. [2025-09-17T17:43:44.842216] [DEBUG] [VALIDATOR ] BLND: All expected trading days are present. [2025-09-17T17:43:44.842292] [DEBUG] [VALIDATOR ] BLND: Primary data validation passed. [2025-09-17T17:43:44.843044] [INFO ] [MAIN ] BLND: Fetched primary data is valid. [2025-09-17T17:43:44.843089] [DEBUG] [LOCAL ] BLND: Saving primary data. [2025-09-17T17:43:44.845115] [DEBUG] [LOCAL ] BLND: Trimmed 72180 records to 49533 (keeping 200 days of data) [2025-09-17T17:43:45.078368] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T17:43:45.166475] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T17:43:45.170735] [DEBUG] [LOCAL ] BLND: Primary data saved (49533 records). [2025-09-17T17:43:45.170812] [INFO ] [MAIN ] BLND: Full history saved. [2025-09-17T17:43:45.170882] [INFO ] [MAIN ] Update Progress: 303/2371 symbols completed. BLND took 45.4s. Estimated remaining: 4h 58m 24s. Rate: 6.9 symbols/min [2025-09-17T17:43:45.223381] [INFO ] [REMOTE ] BLX: Fetching primary data for 2025-09. [2025-09-17T17:43:45.347958] [INFO ] [MAIN ] BMEZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:43:45.375898] [DEBUG] [LOCAL ] BMEZ: Loaded 26034 existing records from primary storage. [2025-09-17T17:43:45.376038] [INFO ] [MAIN ] BMEZ: Loaded 26034 existing records. [2025-09-17T17:43:45.572285] [WARN ] [MAIN ] BMEZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:43:45.572539] [INFO ] [MAIN ] BMEZ: Wiping existing primary data before full refresh. [2025-09-17T17:43:45.572590] [INFO ] [LOCAL ] BMEZ: Starting deletion of primary data. [2025-09-17T17:43:45.573145] [DEBUG] [LOCAL ] BMEZ: Deleted primary data file. [2025-09-17T17:43:45.573193] [INFO ] [MAIN ] BMEZ: Starting full primary refresh. [2025-09-17T17:43:45.927631] [INFO ] [REMOTE ] BMEZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:43:46.015722] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-11. [2025-09-17T17:43:46.201518] [INFO ] [REMOTE ] BLX: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T17:43:46.204198] [INFO ] [REMOTE ] BLX: Full fetch complete (22673 records). [2025-09-17T17:43:46.204280] [DEBUG] [VALIDATOR ] BLX: Validating primary data. [2025-09-17T17:43:46.579128] [DEBUG] [VALIDATOR ] BLX: All expected trading days are present. [2025-09-17T17:43:46.579255] [DEBUG] [VALIDATOR ] BLX: Primary data validation passed. [2025-09-17T17:43:46.579705] [INFO ] [MAIN ] BLX: Fetched primary data is valid. [2025-09-17T17:43:46.579762] [DEBUG] [LOCAL ] BLX: Saving primary data. [2025-09-17T17:43:46.581979] [DEBUG] [LOCAL ] BLX: Trimmed 22673 records to 16000 (keeping 200 days of data) [2025-09-17T17:43:46.685446] [DEBUG] [LOCAL ] BLX: Primary data saved (16000 records). [2025-09-17T17:43:46.685583] [INFO ] [MAIN ] BLX: Full history saved. [2025-09-17T17:43:46.685698] [INFO ] [MAIN ] Update Progress: 304/2371 symbols completed. BLX took 31.0s. Estimated remaining: 4h 57m 27s. Rate: 6.9 symbols/min [2025-09-17T17:43:46.828028] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-03. [2025-09-17T17:43:46.859905] [INFO ] [MAIN ] BMI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:43:46.884571] [DEBUG] [LOCAL ] BMI: Loaded 23761 existing records from primary storage. [2025-09-17T17:43:46.884724] [INFO ] [MAIN ] BMI: Loaded 23761 existing records. [2025-09-17T17:43:47.069385] [WARN ] [MAIN ] BMI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:43:47.069715] [INFO ] [MAIN ] BMI: Wiping existing primary data before full refresh. [2025-09-17T17:43:47.069766] [INFO ] [LOCAL ] BMI: Starting deletion of primary data. [2025-09-17T17:43:47.070479] [DEBUG] [LOCAL ] BMI: Deleted primary data file. [2025-09-17T17:43:47.070534] [INFO ] [MAIN ] BMI: Starting full primary refresh. [2025-09-17T17:43:47.402391] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T17:43:47.458172] [INFO ] [REMOTE ] BMI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:43:47.615791] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2024-12. [2025-09-17T17:43:48.266140] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T17:43:48.415784] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-04. [2025-09-17T17:43:48.937868] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T17:43:49.215830] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-01. [2025-09-17T17:43:49.518099] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T17:43:50.015792] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-03. [2025-09-17T17:43:50.224870] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T17:43:50.815896] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-02. [2025-09-17T17:43:50.947779] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T17:43:51.615815] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-05. [2025-09-17T17:43:52.006340] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T17:43:52.415801] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-04. [2025-09-17T17:43:53.215786] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-11. [2025-09-17T17:43:53.256811] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T17:43:53.308068] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T17:43:54.015819] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-05. [2025-09-17T17:43:54.419783] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T17:43:54.530238] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T17:43:54.815775] [INFO ] [REMOTE ] BMI: Fetching primary data for 2024-12. [2025-09-17T17:43:55.621854] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-06. [2025-09-17T17:43:55.622923] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T17:43:56.415778] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-03. [2025-09-17T17:43:56.936404] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T17:43:57.215784] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-01. [2025-09-17T17:43:57.853016] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T17:43:58.015736] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-07. [2025-09-17T17:43:58.336914] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T17:43:58.815788] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-02. [2025-09-17T17:43:59.547489] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T17:43:59.615817] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-08. [2025-09-17T17:43:59.856184] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T17:44:00.415847] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-06. [2025-09-17T17:44:01.170477] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T17:44:01.200387] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T17:44:01.215726] [INFO ] [REMOTE ] BMA: Fetching primary data for 2025-09. [2025-09-17T17:44:02.015841] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-03. [2025-09-17T17:44:02.787613] [INFO ] [REMOTE ] BMA: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T17:44:02.793957] [INFO ] [REMOTE ] BMA: Full fetch complete (50617 records). [2025-09-17T17:44:02.794122] [DEBUG] [VALIDATOR ] BMA: Validating primary data. [2025-09-17T17:44:02.826357] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-07. [2025-09-17T17:44:03.155212] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T17:44:03.210096] [DEBUG] [VALIDATOR ] BMA: All expected trading days are present. [2025-09-17T17:44:03.210173] [DEBUG] [VALIDATOR ] BMA: Primary data validation passed. [2025-09-17T17:44:03.210838] [INFO ] [MAIN ] BMA: Fetched primary data is valid. [2025-09-17T17:44:03.211149] [DEBUG] [LOCAL ] BMA: Saving primary data. [2025-09-17T17:44:03.212253] [DEBUG] [LOCAL ] BMA: Trimmed 50617 records to 34425 (keeping 200 days of data) [2025-09-17T17:44:03.430537] [DEBUG] [LOCAL ] BMA: Primary data saved (34425 records). [2025-09-17T17:44:03.430709] [INFO ] [MAIN ] BMA: Full history saved. [2025-09-17T17:44:03.430796] [INFO ] [MAIN ] Update Progress: 305/2371 symbols completed. BMA took 30.3s. Estimated remaining: 4h 58m 13s. Rate: 6.9 symbols/min [2025-09-17T17:44:03.601239] [INFO ] [MAIN ] BMN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:44:03.605333] [DEBUG] [LOCAL ] BMN: Loaded 2573 existing records from primary storage. [2025-09-17T17:44:03.605414] [INFO ] [MAIN ] BMN: Loaded 2573 existing records. [2025-09-17T17:44:03.625722] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-04. [2025-09-17T17:44:03.786738] [WARN ] [MAIN ] BMN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:44:03.787019] [INFO ] [MAIN ] BMN: Wiping existing primary data before full refresh. [2025-09-17T17:44:03.787157] [INFO ] [LOCAL ] BMN: Starting deletion of primary data. [2025-09-17T17:44:03.793713] [DEBUG] [LOCAL ] BMN: Deleted primary data file. [2025-09-17T17:44:03.793986] [INFO ] [MAIN ] BMN: Starting full primary refresh. [2025-09-17T17:44:03.794229] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T17:44:04.157312] [INFO ] [REMOTE ] BMN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:44:04.415781] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-11. [2025-09-17T17:44:04.995801] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T17:44:05.126482] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T17:44:05.215814] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-05. [2025-09-17T17:44:05.937413] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T17:44:06.015742] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-06. [2025-09-17T17:44:06.815813] [INFO ] [REMOTE ] BMN: Fetching primary data for 2024-12. [2025-09-17T17:44:06.951899] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T17:44:07.326163] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T17:44:07.615832] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-07. [2025-09-17T17:44:08.415803] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-08. [2025-09-17T17:44:08.939714] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T17:44:08.960535] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T17:44:09.215803] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-08. [2025-09-17T17:44:09.986633] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T17:44:10.015740] [INFO ] [REMOTE ] BMI: Fetching primary data for 2025-09. [2025-09-17T17:44:10.815799] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-04. [2025-09-17T17:44:11.382714] [INFO ] [REMOTE ] BMI: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T17:44:11.386874] [INFO ] [REMOTE ] BMI: Full fetch complete (32230 records). [2025-09-17T17:44:11.386989] [DEBUG] [VALIDATOR ] BMI: Validating primary data. [2025-09-17T17:44:11.620918] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-01. [2025-09-17T17:44:11.792664] [DEBUG] [VALIDATOR ] BMI: All expected trading days are present. [2025-09-17T17:44:11.792811] [DEBUG] [VALIDATOR ] BMI: Primary data validation passed. [2025-09-17T17:44:11.793312] [INFO ] [MAIN ] BMI: Fetched primary data is valid. [2025-09-17T17:44:11.793371] [DEBUG] [LOCAL ] BMI: Saving primary data. [2025-09-17T17:44:11.794798] [DEBUG] [LOCAL ] BMI: Trimmed 32230 records to 23942 (keeping 200 days of data) [2025-09-17T17:44:11.951544] [DEBUG] [LOCAL ] BMI: Primary data saved (23942 records). [2025-09-17T17:44:11.951704] [INFO ] [MAIN ] BMI: Full history saved. [2025-09-17T17:44:11.951792] [INFO ] [MAIN ] Update Progress: 306/2371 symbols completed. BMI took 25.3s. Estimated remaining: 4h 58m 4s. Rate: 6.9 symbols/min [2025-09-17T17:44:12.132615] [INFO ] [MAIN ] BMO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:44:12.153433] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T17:44:12.154803] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T17:44:12.202844] [DEBUG] [LOCAL ] BMO: Loaded 41443 existing records from primary storage. [2025-09-17T17:44:12.203006] [INFO ] [MAIN ] BMO: Loaded 41443 existing records. [2025-09-17T17:44:12.382458] [WARN ] [MAIN ] BMO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:44:12.382791] [INFO ] [MAIN ] BMO: Wiping existing primary data before full refresh. [2025-09-17T17:44:12.382838] [INFO ] [LOCAL ] BMO: Starting deletion of primary data. [2025-09-17T17:44:12.383992] [DEBUG] [LOCAL ] BMO: Deleted primary data file. [2025-09-17T17:44:12.384044] [INFO ] [MAIN ] BMO: Starting full primary refresh. [2025-09-17T17:44:12.420963] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-05. [2025-09-17T17:44:12.775320] [INFO ] [REMOTE ] BMO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:44:13.215820] [INFO ] [REMOTE ] BME: Fetching primary data for 2025-09. [2025-09-17T17:44:13.259605] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T17:44:14.015747] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-02. [2025-09-17T17:44:14.169368] [INFO ] [REMOTE ] BME: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T17:44:14.171307] [INFO ] [REMOTE ] BME: Full fetch complete (16142 records). [2025-09-17T17:44:14.171374] [DEBUG] [VALIDATOR ] BME: Validating primary data. [2025-09-17T17:44:14.539297] [DEBUG] [VALIDATOR ] BME: All expected trading days are present. [2025-09-17T17:44:14.539372] [DEBUG] [VALIDATOR ] BME: Primary data validation passed. [2025-09-17T17:44:14.539721] [INFO ] [MAIN ] BME: Fetched primary data is valid. [2025-09-17T17:44:14.539764] [DEBUG] [LOCAL ] BME: Saving primary data. [2025-09-17T17:44:14.540274] [DEBUG] [LOCAL ] BME: Trimmed 16142 records to 10845 (keeping 200 days of data) [2025-09-17T17:44:14.606515] [DEBUG] [LOCAL ] BME: Primary data saved (10845 records). [2025-09-17T17:44:14.606660] [INFO ] [MAIN ] BME: Full history saved. [2025-09-17T17:44:14.606744] [INFO ] [MAIN ] Update Progress: 307/2371 symbols completed. BME took 40.1s. Estimated remaining: 4h 57m 15s. Rate: 6.9 symbols/min [2025-09-17T17:44:14.708557] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T17:44:14.780704] [INFO ] [MAIN ] BMY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:44:14.815763] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-03. [2025-09-17T17:44:14.836426] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-17T17:44:14.836566] [INFO ] [MAIN ] BMY: Loaded 53757 existing records. [2025-09-17T17:44:15.013551] [WARN ] [MAIN ] BMY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:44:15.013854] [INFO ] [MAIN ] BMY: Wiping existing primary data before full refresh. [2025-09-17T17:44:15.013908] [INFO ] [LOCAL ] BMY: Starting deletion of primary data. [2025-09-17T17:44:15.014962] [DEBUG] [LOCAL ] BMY: Deleted primary data file. [2025-09-17T17:44:15.015011] [INFO ] [MAIN ] BMY: Starting full primary refresh. [2025-09-17T17:44:15.367906] [INFO ] [REMOTE ] BMY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:44:15.440834] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T17:44:15.615774] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-04. [2025-09-17T17:44:16.230881] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T17:44:16.415814] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-06. [2025-09-17T17:44:17.215792] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-05. [2025-09-17T17:44:17.519582] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T17:44:17.571284] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-17T17:44:18.015784] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-11. [2025-09-17T17:44:18.815786] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-11. [2025-09-17T17:44:19.619950] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-06. [2025-09-17T17:44:19.625669] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T17:44:20.079255] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T17:44:20.415805] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-07. [2025-09-17T17:44:20.441998] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T17:44:20.890290] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T17:44:21.215799] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-07. [2025-09-17T17:44:22.015787] [INFO ] [REMOTE ] BMO: Fetching primary data for 2024-12. [2025-09-17T17:44:22.563857] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T17:44:22.815818] [INFO ] [REMOTE ] BMY: Fetching primary data for 2024-12. [2025-09-17T17:44:23.623839] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-08. [2025-09-17T17:44:23.630516] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T17:44:24.415789] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-01. [2025-09-17T17:44:24.707909] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T17:44:24.791906] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T17:44:25.215838] [INFO ] [REMOTE ] BMEZ: Fetching primary data for 2025-09. [2025-09-17T17:44:25.955490] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T17:44:26.015768] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-02. [2025-09-17T17:44:26.380603] [INFO ] [REMOTE ] BMEZ: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T17:44:26.385898] [INFO ] [REMOTE ] BMEZ: Full fetch complete (40995 records). [2025-09-17T17:44:26.386059] [DEBUG] [VALIDATOR ] BMEZ: Validating primary data. [2025-09-17T17:44:26.779288] [DEBUG] [VALIDATOR ] BMEZ: All expected trading days are present. [2025-09-17T17:44:26.779379] [DEBUG] [VALIDATOR ] BMEZ: Primary data validation passed. [2025-09-17T17:44:26.779926] [INFO ] [MAIN ] BMEZ: Fetched primary data is valid. [2025-09-17T17:44:26.779974] [DEBUG] [LOCAL ] BMEZ: Saving primary data. [2025-09-17T17:44:26.781077] [DEBUG] [LOCAL ] BMEZ: Trimmed 40995 records to 26163 (keeping 200 days of data) [2025-09-17T17:44:26.840270] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-01. [2025-09-17T17:44:26.958893] [DEBUG] [LOCAL ] BMEZ: Primary data saved (26163 records). [2025-09-17T17:44:26.959035] [INFO ] [MAIN ] BMEZ: Full history saved. [2025-09-17T17:44:26.959128] [INFO ] [MAIN ] Update Progress: 308/2371 symbols completed. BMEZ took 41.8s. Estimated remaining: 4h 57m 31s. Rate: 6.9 symbols/min [2025-09-17T17:44:27.139009] [INFO ] [MAIN ] BN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:44:27.194595] [DEBUG] [LOCAL ] BN: Loaded 53015 existing records from primary storage. [2025-09-17T17:44:27.194775] [INFO ] [MAIN ] BN: Loaded 53015 existing records. [2025-09-17T17:44:27.377447] [WARN ] [MAIN ] BN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:44:27.377707] [INFO ] [MAIN ] BN: Wiping existing primary data before full refresh. [2025-09-17T17:44:27.377754] [INFO ] [LOCAL ] BN: Starting deletion of primary data. [2025-09-17T17:44:27.379045] [DEBUG] [LOCAL ] BN: Deleted primary data file. [2025-09-17T17:44:27.379098] [INFO ] [MAIN ] BN: Starting full primary refresh. [2025-09-17T17:44:27.626029] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-08. [2025-09-17T17:44:27.744195] [INFO ] [REMOTE ] BN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:44:27.768344] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T17:44:28.415757] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-11. [2025-09-17T17:44:28.485286] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T17:44:28.528737] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T17:44:29.215819] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-02. [2025-09-17T17:44:30.015822] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-03. [2025-09-17T17:44:30.199257] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T17:44:30.815763] [INFO ] [REMOTE ] BN: Fetching primary data for 2024-12. [2025-09-17T17:44:31.158515] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T17:44:31.615779] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-03. [2025-09-17T17:44:31.698947] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T17:44:32.297347] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T17:44:32.415763] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-01. [2025-09-17T17:44:33.215759] [INFO ] [REMOTE ] BMN: Fetching primary data for 2025-09. [2025-09-17T17:44:33.633686] [INFO ] [REMOTE ] BMN: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T17:44:33.637051] [INFO ] [REMOTE ] BMN: Full fetch complete (3758 records). [2025-09-17T17:44:33.635863] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T17:44:33.637236] [DEBUG] [VALIDATOR ] BMN: Validating primary data. [2025-09-17T17:44:34.014108] [DEBUG] [VALIDATOR ] BMN: All expected trading days are present. [2025-09-17T17:44:34.014189] [DEBUG] [VALIDATOR ] BMN: Primary data validation passed. [2025-09-17T17:44:34.014360] [INFO ] [MAIN ] BMN: Fetched primary data is valid. [2025-09-17T17:44:34.014399] [DEBUG] [LOCAL ] BMN: Saving primary data. [2025-09-17T17:44:34.014800] [DEBUG] [LOCAL ] BMN: Trimmed 3758 records to 2576 (keeping 200 days of data) [2025-09-17T17:44:34.022282] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-04. [2025-09-17T17:44:34.033128] [DEBUG] [LOCAL ] BMN: Primary data saved (2576 records). [2025-09-17T17:44:34.033219] [INFO ] [MAIN ] BMN: Full history saved. [2025-09-17T17:44:34.033299] [INFO ] [MAIN ] Update Progress: 309/2371 symbols completed. BMN took 30.6s. Estimated remaining: 4h 57m 12s. Rate: 6.9 symbols/min [2025-09-17T17:44:34.209053] [INFO ] [MAIN ] BNED: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:44:34.241538] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T17:44:34.273498] [DEBUG] [LOCAL ] BNED: Loaded 30086 existing records from primary storage. [2025-09-17T17:44:34.273690] [INFO ] [MAIN ] BNED: Loaded 30086 existing records. [2025-09-17T17:44:34.456718] [WARN ] [MAIN ] BNED: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:44:34.456984] [INFO ] [MAIN ] BNED: Wiping existing primary data before full refresh. [2025-09-17T17:44:34.457032] [INFO ] [LOCAL ] BNED: Starting deletion of primary data. [2025-09-17T17:44:34.457609] [DEBUG] [LOCAL ] BNED: Deleted primary data file. [2025-09-17T17:44:34.457691] [INFO ] [MAIN ] BNED: Starting full primary refresh. [2025-09-17T17:44:34.821274] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-04. [2025-09-17T17:44:34.826159] [INFO ] [REMOTE ] BNED: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:44:35.615728] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-11. [2025-09-17T17:44:35.720943] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T17:44:36.415918] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-05. [2025-09-17T17:44:36.566268] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T17:44:36.974507] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T17:44:37.215803] [INFO ] [REMOTE ] BNED: Fetching primary data for 2024-12. [2025-09-17T17:44:37.900725] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T17:44:38.015803] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-02. [2025-09-17T17:44:38.709345] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T17:44:38.815801] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-06. [2025-09-17T17:44:39.615814] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-05. [2025-09-17T17:44:39.669530] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T17:44:40.248807] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T17:44:40.415760] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-07. [2025-09-17T17:44:41.215762] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-03. [2025-09-17T17:44:41.669351] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T17:44:41.767022] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T17:44:42.015758] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-06. [2025-09-17T17:44:42.815778] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-08. [2025-09-17T17:44:43.320487] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T17:44:43.615779] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-04. [2025-09-17T17:44:43.986301] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T17:44:44.092521] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T17:44:44.415858] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-07. [2025-09-17T17:44:45.215808] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-01. [2025-09-17T17:44:45.267965] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T17:44:46.015814] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-05. [2025-09-17T17:44:46.527469] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T17:44:46.588292] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T17:44:46.815820] [INFO ] [REMOTE ] BMO: Fetching primary data for 2025-09. [2025-09-17T17:44:47.463143] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T17:44:47.615768] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-06. [2025-09-17T17:44:48.376629] [INFO ] [REMOTE ] BMO: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T17:44:48.382322] [INFO ] [REMOTE ] BMO: Full fetch complete (59895 records). [2025-09-17T17:44:48.382447] [DEBUG] [VALIDATOR ] BMO: Validating primary data. [2025-09-17T17:44:48.421064] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-02. [2025-09-17T17:44:48.783450] [DEBUG] [VALIDATOR ] BMO: All expected trading days are present. [2025-09-17T17:44:48.783548] [DEBUG] [VALIDATOR ] BMO: Primary data validation passed. [2025-09-17T17:44:48.784269] [INFO ] [MAIN ] BMO: Fetched primary data is valid. [2025-09-17T17:44:48.784330] [DEBUG] [LOCAL ] BMO: Saving primary data. [2025-09-17T17:44:48.785847] [DEBUG] [LOCAL ] BMO: Trimmed 59895 records to 41463 (keeping 200 days of data) [2025-09-17T17:44:49.045256] [DEBUG] [LOCAL ] BMO: Primary data saved (41463 records). [2025-09-17T17:44:49.045384] [INFO ] [MAIN ] BMO: Full history saved. [2025-09-17T17:44:49.046307] [INFO ] [MAIN ] Update Progress: 310/2371 symbols completed. BMO took 37.1s. Estimated remaining: 4h 57m 45s. Rate: 6.9 symbols/min [2025-09-17T17:44:49.222072] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-08. [2025-09-17T17:44:49.247055] [INFO ] [MAIN ] BNH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:44:49.256091] [DEBUG] [LOCAL ] BNH: Loaded 4836 existing records from primary storage. [2025-09-17T17:44:49.256222] [INFO ] [MAIN ] BNH: Loaded 4836 existing records. [2025-09-17T17:44:49.455019] [WARN ] [MAIN ] BNH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:44:49.455465] [INFO ] [MAIN ] BNH: Wiping existing primary data before full refresh. [2025-09-17T17:44:49.455551] [INFO ] [LOCAL ] BNH: Starting deletion of primary data. [2025-09-17T17:44:49.455934] [DEBUG] [LOCAL ] BNH: Deleted primary data file. [2025-09-17T17:44:49.455985] [INFO ] [MAIN ] BNH: Starting full primary refresh. [2025-09-17T17:44:49.758311] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-17T17:44:49.886754] [INFO ] [REMOTE ] BNH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:44:49.901723] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T17:44:50.015774] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-03. [2025-09-17T17:44:50.815819] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-11. [2025-09-17T17:44:51.193907] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T17:44:51.250570] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T17:44:51.268251] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T17:44:51.615861] [INFO ] [REMOTE ] BMY: Fetching primary data for 2025-09. [2025-09-17T17:44:52.183037] [INFO ] [REMOTE ] BMY: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T17:44:52.191965] [INFO ] [REMOTE ] BMY: Full fetch complete (77647 records). [2025-09-17T17:44:52.192086] [DEBUG] [VALIDATOR ] BMY: Validating primary data. [2025-09-17T17:44:52.420928] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-07. [2025-09-17T17:44:52.590445] [DEBUG] [VALIDATOR ] BMY: All expected trading days are present. [2025-09-17T17:44:52.590544] [DEBUG] [VALIDATOR ] BMY: Primary data validation passed. [2025-09-17T17:44:52.591432] [INFO ] [MAIN ] BMY: Fetched primary data is valid. [2025-09-17T17:44:52.591509] [DEBUG] [LOCAL ] BMY: Saving primary data. [2025-09-17T17:44:52.593092] [DEBUG] [LOCAL ] BMY: Trimmed 77647 records to 53757 (keeping 200 days of data) [2025-09-17T17:44:52.928418] [DEBUG] [LOCAL ] BMY: Primary data saved (53757 records). [2025-09-17T17:44:52.928559] [INFO ] [MAIN ] BMY: Full history saved. [2025-09-17T17:44:52.929407] [INFO ] [MAIN ] Update Progress: 311/2371 symbols completed. BMY took 38.3s. Estimated remaining: 4h 57m 5s. Rate: 6.9 symbols/min [2025-09-17T17:44:53.110749] [INFO ] [MAIN ] BNJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:44:53.117287] [DEBUG] [LOCAL ] BNJ: Loaded 2609 existing records from primary storage. [2025-09-17T17:44:53.117415] [INFO ] [MAIN ] BNJ: Loaded 2609 existing records. [2025-09-17T17:44:53.220856] [INFO ] [REMOTE ] BNH: Fetching primary data for 2024-12. [2025-09-17T17:44:53.312423] [WARN ] [MAIN ] BNJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:44:53.312703] [INFO ] [MAIN ] BNJ: Wiping existing primary data before full refresh. [2025-09-17T17:44:53.312764] [INFO ] [LOCAL ] BNJ: Starting deletion of primary data. [2025-09-17T17:44:53.312958] [DEBUG] [LOCAL ] BNJ: Deleted primary data file. [2025-09-17T17:44:53.313007] [INFO ] [MAIN ] BNJ: Starting full primary refresh. [2025-09-17T17:44:53.678671] [INFO ] [REMOTE ] BNJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:44:53.873446] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T17:44:54.015801] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-01. [2025-09-17T17:44:54.373430] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T17:44:54.573832] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T17:44:54.815815] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-08. [2025-09-17T17:44:55.615843] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-02. [2025-09-17T17:44:55.977828] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-17T17:44:56.415870] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-11. [2025-09-17T17:44:56.672857] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T17:44:57.073305] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T17:44:57.215816] [INFO ] [REMOTE ] BN: Fetching primary data for 2025-09. [2025-09-17T17:44:58.015823] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-04. [2025-09-17T17:44:58.815801] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-03. [2025-09-17T17:44:59.059814] [INFO ] [REMOTE ] BN: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T17:44:59.069855] [INFO ] [REMOTE ] BN: Full fetch complete (76478 records). [2025-09-17T17:44:59.070053] [DEBUG] [VALIDATOR ] BN: Validating primary data. [2025-09-17T17:44:59.454825] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T17:44:59.539695] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T17:44:59.545291] [DEBUG] [VALIDATOR ] BN: All expected trading days are present. [2025-09-17T17:44:59.545860] [DEBUG] [VALIDATOR ] BN: Primary data validation passed. [2025-09-17T17:44:59.547209] [INFO ] [MAIN ] BN: Fetched primary data is valid. [2025-09-17T17:44:59.547292] [DEBUG] [LOCAL ] BN: Saving primary data. [2025-09-17T17:44:59.549316] [DEBUG] [LOCAL ] BN: Trimmed 76478 records to 53015 (keeping 200 days of data) [2025-09-17T17:44:59.619712] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2024-12. [2025-09-17T17:44:59.896933] [DEBUG] [LOCAL ] BN: Primary data saved (53015 records). [2025-09-17T17:44:59.897144] [INFO ] [MAIN ] BN: Full history saved. [2025-09-17T17:44:59.897256] [INFO ] [MAIN ] Update Progress: 312/2371 symbols completed. BN took 32.9s. Estimated remaining: 4h 56m 45s. Rate: 6.9 symbols/min [2025-09-17T17:45:00.073211] [INFO ] [MAIN ] BNL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:45:00.116898] [DEBUG] [LOCAL ] BNL: Loaded 46995 existing records from primary storage. [2025-09-17T17:45:00.117042] [INFO ] [MAIN ] BNL: Loaded 46995 existing records. [2025-09-17T17:45:00.293486] [WARN ] [MAIN ] BNL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:45:00.293852] [INFO ] [MAIN ] BNL: Wiping existing primary data before full refresh. [2025-09-17T17:45:00.293898] [INFO ] [LOCAL ] BNL: Starting deletion of primary data. [2025-09-17T17:45:00.294890] [DEBUG] [LOCAL ] BNL: Deleted primary data file. [2025-09-17T17:45:00.294940] [INFO ] [MAIN ] BNL: Starting full primary refresh. [2025-09-17T17:45:00.417163] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-04. [2025-09-17T17:45:00.423826] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T17:45:00.665303] [INFO ] [REMOTE ] BNL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:45:01.204531] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T17:45:01.215740] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-05. [2025-09-17T17:45:01.723199] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T17:45:02.015835] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-05. [2025-09-17T17:45:02.815811] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-01. [2025-09-17T17:45:03.367559] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T17:45:03.491565] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T17:45:03.615805] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-02. [2025-09-17T17:45:04.105479] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T17:45:04.415869] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-11. [2025-09-17T17:45:05.215818] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-03. [2025-09-17T17:45:05.694920] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T17:45:06.007982] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T17:45:06.018446] [INFO ] [REMOTE ] BNL: Fetching primary data for 2024-12. [2025-09-17T17:45:06.815811] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-06. [2025-09-17T17:45:07.615821] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-04. [2025-09-17T17:45:07.680623] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T17:45:07.709004] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T17:45:08.282008] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T17:45:08.415812] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-01. [2025-09-17T17:45:09.216132] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-05. [2025-09-17T17:45:09.820622] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T17:45:09.943174] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T17:45:10.015883] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-06. [2025-09-17T17:45:10.340045] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T17:45:10.815861] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-06. [2025-09-17T17:45:11.251991] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T17:45:11.615847] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-07. [2025-09-17T17:45:12.415794] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-07. [2025-09-17T17:45:12.573478] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T17:45:12.728086] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-17T17:45:13.215903] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-07. [2025-09-17T17:45:14.015864] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-08. [2025-09-17T17:45:14.604294] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T17:45:14.673362] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T17:45:14.815812] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-02. [2025-09-17T17:45:15.615841] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-08. [2025-09-17T17:45:16.420955] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-08. [2025-09-17T17:45:16.442693] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T17:45:16.981084] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T17:45:17.031110] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T17:45:17.215813] [INFO ] [REMOTE ] BNH: Fetching primary data for 2025-09. [2025-09-17T17:45:17.766774] [INFO ] [REMOTE ] BNH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T17:45:17.768200] [INFO ] [REMOTE ] BNH: Full fetch complete (6792 records). [2025-09-17T17:45:17.768270] [DEBUG] [VALIDATOR ] BNH: Validating primary data. [2025-09-17T17:45:18.020977] [INFO ] [REMOTE ] BNED: Fetching primary data for 2025-09. [2025-09-17T17:45:18.145129] [DEBUG] [VALIDATOR ] BNH: All expected trading days are present. [2025-09-17T17:45:18.145317] [DEBUG] [VALIDATOR ] BNH: Primary data validation passed. [2025-09-17T17:45:18.145542] [INFO ] [MAIN ] BNH: Fetched primary data is valid. [2025-09-17T17:45:18.145596] [DEBUG] [LOCAL ] BNH: Saving primary data. [2025-09-17T17:45:18.146142] [DEBUG] [LOCAL ] BNH: Trimmed 6792 records to 4836 (keeping 200 days of data) [2025-09-17T17:45:18.179282] [DEBUG] [LOCAL ] BNH: Primary data saved (4836 records). [2025-09-17T17:45:18.179429] [INFO ] [MAIN ] BNH: Full history saved. [2025-09-17T17:45:18.179540] [INFO ] [MAIN ] Update Progress: 313/2371 symbols completed. BNH took 29.1s. Estimated remaining: 4h 57m 40s. Rate: 6.9 symbols/min [2025-09-17T17:45:18.357920] [INFO ] [MAIN ] BNS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:45:18.412348] [DEBUG] [LOCAL ] BNS: Loaded 51521 existing records from primary storage. [2025-09-17T17:45:18.412534] [INFO ] [MAIN ] BNS: Loaded 51521 existing records. [2025-09-17T17:45:18.601586] [WARN ] [MAIN ] BNS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:45:18.601870] [INFO ] [MAIN ] BNS: Wiping existing primary data before full refresh. [2025-09-17T17:45:18.601920] [INFO ] [LOCAL ] BNS: Starting deletion of primary data. [2025-09-17T17:45:18.602982] [DEBUG] [LOCAL ] BNS: Deleted primary data file. [2025-09-17T17:45:18.603035] [INFO ] [MAIN ] BNS: Starting full primary refresh. [2025-09-17T17:45:18.820991] [INFO ] [REMOTE ] BNJ: Fetching primary data for 2025-09. [2025-09-17T17:45:18.972072] [INFO ] [REMOTE ] BNS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:45:19.342481] [INFO ] [REMOTE ] BNED: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T17:45:19.347844] [INFO ] [REMOTE ] BNED: Full fetch complete (44352 records). [2025-09-17T17:45:19.347959] [DEBUG] [VALIDATOR ] BNED: Validating primary data. [2025-09-17T17:45:19.452240] [INFO ] [REMOTE ] BNJ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T17:45:19.468935] [INFO ] [REMOTE ] BNJ: Full fetch complete (4435 records). [2025-09-17T17:45:19.511595] [DEBUG] [VALIDATOR ] BNJ: Validating primary data. [2025-09-17T17:45:19.624692] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-03. [2025-09-17T17:45:20.057975] [DEBUG] [VALIDATOR ] BNED: All expected trading days are present. [2025-09-17T17:45:20.081164] [DEBUG] [VALIDATOR ] BNED: Primary data validation passed. [2025-09-17T17:45:20.105856] [INFO ] [MAIN ] BNED: Fetched primary data is valid. [2025-09-17T17:45:20.111570] [DEBUG] [VALIDATOR ] BNJ: All expected trading days are present. [2025-09-17T17:45:20.111692] [DEBUG] [VALIDATOR ] BNJ: Primary data validation passed. [2025-09-17T17:45:20.111811] [INFO ] [MAIN ] BNJ: Fetched primary data is valid. [2025-09-17T17:45:20.111631] [DEBUG] [LOCAL ] BNED: Saving primary data. [2025-09-17T17:45:20.111999] [DEBUG] [LOCAL ] BNJ: Saving primary data. [2025-09-17T17:45:20.112619] [DEBUG] [LOCAL ] BNJ: Trimmed 4435 records to 2629 (keeping 200 days of data) [2025-09-17T17:45:20.113399] [DEBUG] [LOCAL ] BNED: Trimmed 44352 records to 30101 (keeping 200 days of data) [2025-09-17T17:45:20.130292] [DEBUG] [LOCAL ] BNJ: Primary data saved (2629 records). [2025-09-17T17:45:20.189306] [INFO ] [MAIN ] BNJ: Full history saved. [2025-09-17T17:45:20.189514] [INFO ] [MAIN ] Update Progress: 314/2371 symbols completed. BNJ took 27.3s. Estimated remaining: 4h 56m 47s. Rate: 6.9 symbols/min [2025-09-17T17:45:20.418561] [INFO ] [MAIN ] BNT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:45:20.416310] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-11. [2025-09-17T17:45:20.488022] [DEBUG] [LOCAL ] BNT: Loaded 3333 existing records from primary storage. [2025-09-17T17:45:20.496876] [DEBUG] [LOCAL ] BNED: Primary data saved (30101 records). [2025-09-17T17:45:20.497249] [INFO ] [MAIN ] BNED: Full history saved. [2025-09-17T17:45:20.497376] [INFO ] [MAIN ] Update Progress: 315/2371 symbols completed. BNED took 46.5s. Estimated remaining: 4h 55m 44s. Rate: 7.0 symbols/min [2025-09-17T17:45:20.497181] [INFO ] [MAIN ] BNT: Loaded 3333 existing records. [2025-09-17T17:45:20.835286] [INFO ] [MAIN ] BNY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:45:20.894587] [WARN ] [MAIN ] BNT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:45:20.897133] [INFO ] [MAIN ] BNT: Wiping existing primary data before full refresh. [2025-09-17T17:45:20.897194] [INFO ] [LOCAL ] BNT: Starting deletion of primary data. [2025-09-17T17:45:20.897490] [DEBUG] [LOCAL ] BNT: Deleted primary data file. [2025-09-17T17:45:20.897573] [INFO ] [MAIN ] BNT: Starting full primary refresh. [2025-09-17T17:45:20.981887] [DEBUG] [LOCAL ] BNY: Loaded 7359 existing records from primary storage. [2025-09-17T17:45:21.002921] [INFO ] [MAIN ] BNY: Loaded 7359 existing records. [2025-09-17T17:45:21.353392] [WARN ] [MAIN ] BNY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:45:21.377165] [INFO ] [MAIN ] BNY: Wiping existing primary data before full refresh. [2025-09-17T17:45:21.377409] [INFO ] [LOCAL ] BNY: Starting deletion of primary data. [2025-09-17T17:45:21.377935] [DEBUG] [LOCAL ] BNY: Deleted primary data file. [2025-09-17T17:45:21.393558] [INFO ] [MAIN ] BNY: Starting full primary refresh. [2025-09-17T17:45:21.482386] [INFO ] [REMOTE ] BNT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:45:21.522603] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-11. [2025-09-17T17:45:21.821766] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-17T17:45:21.916575] [INFO ] [REMOTE ] BNY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:45:21.979441] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T17:45:22.015757] [INFO ] [REMOTE ] BNS: Fetching primary data for 2024-12. [2025-09-17T17:45:22.110680] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T17:45:22.815772] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-04. [2025-09-17T17:45:23.615776] [INFO ] [REMOTE ] BNT: Fetching primary data for 2024-12. [2025-09-17T17:45:23.758489] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T17:45:24.126124] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T17:45:24.427307] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-01. [2025-09-17T17:45:24.433850] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T17:45:25.215769] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-01. [2025-09-17T17:45:25.720608] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T17:45:26.015764] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-05. [2025-09-17T17:45:26.069824] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T17:45:26.815767] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-02. [2025-09-17T17:45:27.615816] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-11. [2025-09-17T17:45:27.685365] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T17:45:28.415806] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-02. [2025-09-17T17:45:28.474863] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T17:45:28.539401] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T17:45:28.911658] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T17:45:29.215778] [INFO ] [REMOTE ] BNY: Fetching primary data for 2024-12. [2025-09-17T17:45:29.983682] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T17:45:30.015800] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-03. [2025-09-17T17:45:30.412192] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T17:45:30.815791] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-04. [2025-09-17T17:45:31.445938] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T17:45:31.615850] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-03. [2025-09-17T17:45:32.415805] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-06. [2025-09-17T17:45:33.215786] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-01. [2025-09-17T17:45:33.561315] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T17:45:33.630045] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T17:45:33.823341] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T17:45:34.015812] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-07. [2025-09-17T17:45:34.815789] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-04. [2025-09-17T17:45:35.592179] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T17:45:35.615719] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-08. [2025-09-17T17:45:36.201686] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T17:45:36.415738] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-05. [2025-09-17T17:45:36.821038] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T17:45:37.049253] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T17:45:37.215791] [INFO ] [REMOTE ] BNL: Fetching primary data for 2025-09. [2025-09-17T17:45:38.015832] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-05. [2025-09-17T17:45:38.815846] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-06. [2025-09-17T17:45:38.931351] [INFO ] [REMOTE ] BNL: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T17:45:38.941619] [INFO ] [REMOTE ] BNL: Full fetch complete (66434 records). [2025-09-17T17:45:38.941904] [DEBUG] [VALIDATOR ] BNL: Validating primary data. [2025-09-17T17:45:39.346112] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T17:45:39.469718] [DEBUG] [VALIDATOR ] BNL: All expected trading days are present. [2025-09-17T17:45:39.469821] [DEBUG] [VALIDATOR ] BNL: Primary data validation passed. [2025-09-17T17:45:39.470567] [INFO ] [MAIN ] BNL: Fetched primary data is valid. [2025-09-17T17:45:39.470619] [DEBUG] [LOCAL ] BNL: Saving primary data. [2025-09-17T17:45:39.472113] [DEBUG] [LOCAL ] BNL: Trimmed 66434 records to 46963 (keeping 200 days of data) [2025-09-17T17:45:39.650169] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-07. [2025-09-17T17:45:39.744700] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T17:45:39.810574] [DEBUG] [LOCAL ] BNL: Primary data saved (46963 records). [2025-09-17T17:45:39.810747] [INFO ] [MAIN ] BNL: Full history saved. [2025-09-17T17:45:39.810854] [INFO ] [MAIN ] Update Progress: 316/2371 symbols completed. BNL took 39.9s. Estimated remaining: 4h 56m 45s. Rate: 6.9 symbols/min [2025-09-17T17:45:39.983097] [INFO ] [MAIN ] BOC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:45:40.002046] [DEBUG] [LOCAL ] BOC: Loaded 18393 existing records from primary storage. [2025-09-17T17:45:40.002180] [INFO ] [MAIN ] BOC: Loaded 18393 existing records. [2025-09-17T17:45:40.181265] [WARN ] [MAIN ] BOC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:45:40.181502] [INFO ] [MAIN ] BOC: Wiping existing primary data before full refresh. [2025-09-17T17:45:40.181560] [INFO ] [LOCAL ] BOC: Starting deletion of primary data. [2025-09-17T17:45:40.182028] [DEBUG] [LOCAL ] BOC: Deleted primary data file. [2025-09-17T17:45:40.182077] [INFO ] [MAIN ] BOC: Starting full primary refresh. [2025-09-17T17:45:40.293567] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T17:45:40.420905] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-08. [2025-09-17T17:45:40.553164] [INFO ] [REMOTE ] BOC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:45:40.911201] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T17:45:41.215786] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-06. [2025-09-17T17:45:42.015804] [INFO ] [REMOTE ] BNT: Fetching primary data for 2025-09. [2025-09-17T17:45:42.815694] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-11. [2025-09-17T17:45:42.881413] [INFO ] [REMOTE ] BNT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T17:45:42.882600] [INFO ] [REMOTE ] BNT: Full fetch complete (4519 records). [2025-09-17T17:45:42.882689] [DEBUG] [VALIDATOR ] BNT: Validating primary data. [2025-09-17T17:45:43.219764] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T17:45:43.295083] [DEBUG] [VALIDATOR ] BNT: All expected trading days are present. [2025-09-17T17:45:43.295160] [DEBUG] [VALIDATOR ] BNT: Primary data validation passed. [2025-09-17T17:45:43.295293] [INFO ] [MAIN ] BNT: Fetched primary data is valid. [2025-09-17T17:45:43.295330] [DEBUG] [LOCAL ] BNT: Saving primary data. [2025-09-17T17:45:43.295721] [DEBUG] [LOCAL ] BNT: Trimmed 4519 records to 3356 (keeping 200 days of data) [2025-09-17T17:45:43.317310] [DEBUG] [LOCAL ] BNT: Primary data saved (3356 records). [2025-09-17T17:45:43.317450] [INFO ] [MAIN ] BNT: Full history saved. [2025-09-17T17:45:43.317539] [INFO ] [MAIN ] Update Progress: 317/2371 symbols completed. BNT took 23.1s. Estimated remaining: 4h 56m 3s. Rate: 6.9 symbols/min [2025-09-17T17:45:43.615840] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-07. [2025-09-17T17:45:43.905492] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T17:45:44.415824] [INFO ] [REMOTE ] BOC: Fetching primary data for 2024-12. [2025-09-17T17:45:45.215751] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-02. [2025-09-17T17:45:45.279985] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T17:45:45.456078] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T17:45:46.015824] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-01. [2025-09-17T17:45:46.226387] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T17:45:46.815825] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-03. [2025-09-17T17:45:46.865003] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T17:45:47.327710] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T17:45:47.615809] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-08. [2025-09-17T17:45:48.415851] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-02. [2025-09-17T17:45:49.215802] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-04. [2025-09-17T17:45:49.305972] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T17:45:49.355879] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T17:45:49.764295] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T17:45:50.015837] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-03. [2025-09-17T17:45:50.815813] [INFO ] [REMOTE ] BNS: Fetching primary data for 2025-09. [2025-09-17T17:45:50.968952] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T17:45:51.615764] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-04. [2025-09-17T17:45:52.415774] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-05. [2025-09-17T17:45:52.658491] [INFO ] [REMOTE ] BNS: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T17:45:52.669305] [INFO ] [REMOTE ] BNS: Full fetch complete (74067 records). [2025-09-17T17:45:52.669574] [DEBUG] [VALIDATOR ] BNS: Validating primary data. [2025-09-17T17:45:52.956770] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T17:45:52.996324] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T17:45:53.124481] [DEBUG] [VALIDATOR ] BNS: All expected trading days are present. [2025-09-17T17:45:53.124589] [DEBUG] [VALIDATOR ] BNS: Primary data validation passed. [2025-09-17T17:45:53.125491] [INFO ] [MAIN ] BNS: Fetched primary data is valid. [2025-09-17T17:45:53.125547] [DEBUG] [LOCAL ] BNS: Saving primary data. [2025-09-17T17:45:53.127136] [DEBUG] [LOCAL ] BNS: Trimmed 74067 records to 51515 (keeping 200 days of data) [2025-09-17T17:45:53.221891] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-05. [2025-09-17T17:45:53.453880] [DEBUG] [LOCAL ] BNS: Primary data saved (51515 records). [2025-09-17T17:45:53.454050] [INFO ] [MAIN ] BNS: Full history saved. [2025-09-17T17:45:53.454932] [INFO ] [MAIN ] Update Progress: 318/2371 symbols completed. BNS took 35.3s. Estimated remaining: 4h 56m 4s. Rate: 6.9 symbols/min [2025-09-17T17:45:54.015762] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-06. [2025-09-17T17:45:54.281398] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T17:45:54.674630] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T17:45:54.815823] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-06. [2025-09-17T17:45:55.615792] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-07. [2025-09-17T17:45:55.770290] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T17:45:56.415816] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-07. [2025-09-17T17:45:56.504341] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T17:45:57.215800] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-08. [2025-09-17T17:45:57.416280] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T17:45:57.635674] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-17T17:45:58.015805] [INFO ] [REMOTE ] BNY: Fetching primary data for 2025-09. [2025-09-17T17:45:58.606856] [INFO ] [REMOTE ] BNY: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T17:45:58.608431] [INFO ] [REMOTE ] BNY: Full fetch complete (10641 records). [2025-09-17T17:45:58.608502] [DEBUG] [VALIDATOR ] BNY: Validating primary data. [2025-09-17T17:45:58.823861] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-08. [2025-09-17T17:45:59.012882] [DEBUG] [VALIDATOR ] BNY: All expected trading days are present. [2025-09-17T17:45:59.012964] [DEBUG] [VALIDATOR ] BNY: Primary data validation passed. [2025-09-17T17:45:59.013236] [INFO ] [MAIN ] BNY: Fetched primary data is valid. [2025-09-17T17:45:59.013275] [DEBUG] [LOCAL ] BNY: Saving primary data. [2025-09-17T17:45:59.013821] [DEBUG] [LOCAL ] BNY: Trimmed 10641 records to 7432 (keeping 200 days of data) [2025-09-17T17:45:59.060319] [DEBUG] [LOCAL ] BNY: Primary data saved (7432 records). [2025-09-17T17:45:59.060470] [INFO ] [MAIN ] BNY: Full history saved. [2025-09-17T17:45:59.060560] [INFO ] [MAIN ] Update Progress: 319/2371 symbols completed. BNY took 38.6s. Estimated remaining: 4h 55m 36s. Rate: 6.9 symbols/min [2025-09-17T17:46:00.017810] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T17:46:00.025083] [INFO ] [REMOTE ] BOC: Fetching primary data for 2025-09. [2025-09-17T17:46:01.167785] [INFO ] [REMOTE ] BOC: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T17:46:01.171269] [INFO ] [REMOTE ] BOC: Full fetch complete (25741 records). [2025-09-17T17:46:01.171428] [DEBUG] [VALIDATOR ] BOC: Validating primary data. [2025-09-17T17:46:01.548831] [DEBUG] [VALIDATOR ] BOC: All expected trading days are present. [2025-09-17T17:46:01.548922] [DEBUG] [VALIDATOR ] BOC: Primary data validation passed. [2025-09-17T17:46:01.549328] [INFO ] [MAIN ] BOC: Fetched primary data is valid. [2025-09-17T17:46:01.549368] [DEBUG] [LOCAL ] BOC: Saving primary data. [2025-09-17T17:46:01.550253] [DEBUG] [LOCAL ] BOC: Trimmed 25741 records to 18429 (keeping 200 days of data) [2025-09-17T17:46:01.662580] [DEBUG] [LOCAL ] BOC: Primary data saved (18429 records). [2025-09-17T17:46:01.662775] [INFO ] [MAIN ] BOC: Full history saved. [2025-09-17T17:46:01.662866] [INFO ] [MAIN ] Update Progress: 320/2371 symbols completed. BOC took 21.9s. Estimated remaining: 4h 54m 48s. Rate: 7.0 symbols/min [2025-09-17T17:46:02.384503] [INFO ] [MAIN ] BOE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:46:02.328594] [INFO ] [MAIN ] BOND: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:46:02.453946] [INFO ] [MAIN ] BOOT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:46:02.456744] [INFO ] [MAIN ] BOH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:46:02.483666] [DEBUG] [LOCAL ] BOE: Loaded 17559 existing records from primary storage. [2025-09-17T17:46:02.492362] [INFO ] [MAIN ] BOE: Loaded 17559 existing records. [2025-09-17T17:46:02.668668] [DEBUG] [LOCAL ] BOND: Loaded 32137 existing records from primary storage. [2025-09-17T17:46:02.696691] [DEBUG] [LOCAL ] BOH: Loaded 31453 existing records from primary storage. [2025-09-17T17:46:02.701925] [INFO ] [MAIN ] BOND: Loaded 32137 existing records. [2025-09-17T17:46:02.707223] [INFO ] [MAIN ] BOH: Loaded 31453 existing records. [2025-09-17T17:46:02.727420] [DEBUG] [LOCAL ] BOOT: Loaded 41539 existing records from primary storage. [2025-09-17T17:46:02.876132] [INFO ] [MAIN ] BOOT: Loaded 41539 existing records. [2025-09-17T17:46:02.958301] [WARN ] [MAIN ] BOE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:46:03.184056] [INFO ] [MAIN ] BOE: Wiping existing primary data before full refresh. [2025-09-17T17:46:03.198127] [WARN ] [MAIN ] BOH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:46:03.277283] [WARN ] [MAIN ] BOND: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:46:03.293638] [INFO ] [MAIN ] BOND: Wiping existing primary data before full refresh. [2025-09-17T17:46:03.293543] [INFO ] [MAIN ] BOH: Wiping existing primary data before full refresh. [2025-09-17T17:46:03.274038] [INFO ] [LOCAL ] BOE: Starting deletion of primary data. [2025-09-17T17:46:03.304263] [INFO ] [LOCAL ] BOND: Starting deletion of primary data. [2025-09-17T17:46:03.304200] [INFO ] [LOCAL ] BOH: Starting deletion of primary data. [2025-09-17T17:46:03.323483] [DEBUG] [LOCAL ] BOE: Deleted primary data file. [2025-09-17T17:46:03.339680] [DEBUG] [LOCAL ] BOND: Deleted primary data file. [2025-09-17T17:46:03.355158] [INFO ] [MAIN ] BOE: Starting full primary refresh. [2025-09-17T17:46:03.355234] [DEBUG] [LOCAL ] BOH: Deleted primary data file. [2025-09-17T17:46:03.366504] [INFO ] [MAIN ] BOND: Starting full primary refresh. [2025-09-17T17:46:03.361156] [WARN ] [MAIN ] BOOT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:46:03.361313] [INFO ] [MAIN ] BOH: Starting full primary refresh. [2025-09-17T17:46:03.417446] [INFO ] [MAIN ] BOOT: Wiping existing primary data before full refresh. [2025-09-17T17:46:03.483494] [INFO ] [LOCAL ] BOOT: Starting deletion of primary data. [2025-09-17T17:46:03.577768] [DEBUG] [LOCAL ] BOOT: Deleted primary data file. [2025-09-17T17:46:03.636471] [INFO ] [MAIN ] BOOT: Starting full primary refresh. [2025-09-17T17:46:04.653122] [INFO ] [REMOTE ] BOND: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:46:04.715549] [INFO ] [REMOTE ] BOE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:46:04.763424] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-11. [2025-09-17T17:46:04.774194] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-11. [2025-09-17T17:46:04.957440] [INFO ] [REMOTE ] BOOT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:46:04.980296] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-11. [2025-09-17T17:46:04.980043] [INFO ] [REMOTE ] BOH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:46:04.980569] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-11. [2025-09-17T17:46:05.741876] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T17:46:05.746921] [INFO ] [REMOTE ] BOE: Fetching primary data for 2024-12. [2025-09-17T17:46:06.357510] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T17:46:06.364192] [INFO ] [REMOTE ] BOND: Fetching primary data for 2024-12. [2025-09-17T17:46:06.623884] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T17:46:06.630240] [INFO ] [REMOTE ] BOH: Fetching primary data for 2024-12. [2025-09-17T17:46:06.754973] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T17:46:06.763980] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2024-12. [2025-09-17T17:46:06.844013] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T17:46:06.848978] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-01. [2025-09-17T17:46:07.761755] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T17:46:07.768697] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-01. [2025-09-17T17:46:07.799294] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T17:46:07.871553] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T17:46:08.033297] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T17:46:08.415853] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-02. [2025-09-17T17:46:09.078701] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T17:46:09.099173] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T17:46:09.215828] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-03. [2025-09-17T17:46:10.015811] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-01. [2025-09-17T17:46:10.213436] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T17:46:10.815813] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-01. [2025-09-17T17:46:11.615799] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-02. [2025-09-17T17:46:11.692845] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T17:46:12.181190] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T17:46:12.415820] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-02. [2025-09-17T17:46:13.095865] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T17:46:13.215774] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-04. [2025-09-17T17:46:13.621786] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T17:46:13.982052] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T17:46:14.015802] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-02. [2025-09-17T17:46:14.815821] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-03. [2025-09-17T17:46:15.615765] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-03. [2025-09-17T17:46:15.844572] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T17:46:16.182708] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T17:46:16.415825] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-04. [2025-09-17T17:46:16.884504] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T17:46:17.215790] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-04. [2025-09-17T17:46:17.902137] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T17:46:18.015795] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-05. [2025-09-17T17:46:18.643403] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T17:46:18.815809] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-05. [2025-09-17T17:46:19.347872] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T17:46:19.498308] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T17:46:19.615765] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-06. [2025-09-17T17:46:20.415828] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-03. [2025-09-17T17:46:20.691928] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T17:46:21.215789] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-05. [2025-09-17T17:46:22.015813] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-06. [2025-09-17T17:46:22.179484] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T17:46:22.534410] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T17:46:22.815791] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-06. [2025-09-17T17:46:23.321730] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T17:46:23.615831] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-07. [2025-09-17T17:46:23.964146] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T17:46:24.415789] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-07. [2025-09-17T17:46:25.080280] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T17:46:25.099330] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T17:46:25.215771] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-08. [2025-09-17T17:46:26.015759] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-07. [2025-09-17T17:46:26.502084] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T17:46:26.815787] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-08. [2025-09-17T17:46:27.502476] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T17:46:27.534437] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T17:46:27.615768] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-08. [2025-09-17T17:46:28.415806] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-04. [2025-09-17T17:46:28.719389] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T17:46:29.215806] [INFO ] [REMOTE ] BOH: Fetching primary data for 2025-09. [2025-09-17T17:46:30.015822] [INFO ] [REMOTE ] BOND: Fetching primary data for 2025-09. [2025-09-17T17:46:30.100758] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T17:46:30.512977] [INFO ] [REMOTE ] BOH: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T17:46:30.517110] [INFO ] [REMOTE ] BOH: Full fetch complete (44497 records). [2025-09-17T17:46:30.517231] [DEBUG] [VALIDATOR ] BOH: Validating primary data. [2025-09-17T17:46:30.820937] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-05. [2025-09-17T17:46:30.903613] [DEBUG] [VALIDATOR ] BOH: All expected trading days are present. [2025-09-17T17:46:30.903734] [DEBUG] [VALIDATOR ] BOH: Primary data validation passed. [2025-09-17T17:46:30.904346] [INFO ] [MAIN ] BOH: Fetched primary data is valid. [2025-09-17T17:46:30.904397] [DEBUG] [LOCAL ] BOH: Saving primary data. [2025-09-17T17:46:30.906314] [DEBUG] [LOCAL ] BOH: Trimmed 44497 records to 31444 (keeping 200 days of data) [2025-09-17T17:46:31.105674] [DEBUG] [LOCAL ] BOH: Primary data saved (31444 records). [2025-09-17T17:46:31.105860] [INFO ] [MAIN ] BOH: Full history saved. [2025-09-17T17:46:31.105998] [INFO ] [MAIN ] Update Progress: 321/2371 symbols completed. BOH took 29.4s. Estimated remaining: 4h 56m 53s. Rate: 6.9 symbols/min [2025-09-17T17:46:31.290921] [INFO ] [MAIN ] BORR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:46:31.339758] [DEBUG] [LOCAL ] BORR: Loaded 51200 existing records from primary storage. [2025-09-17T17:46:31.339898] [INFO ] [MAIN ] BORR: Loaded 51200 existing records. [2025-09-17T17:46:31.517859] [WARN ] [MAIN ] BORR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:46:31.518191] [INFO ] [MAIN ] BORR: Wiping existing primary data before full refresh. [2025-09-17T17:46:31.518272] [INFO ] [LOCAL ] BORR: Starting deletion of primary data. [2025-09-17T17:46:31.524450] [DEBUG] [LOCAL ] BORR: Deleted primary data file. [2025-09-17T17:46:31.530510] [INFO ] [MAIN ] BORR: Starting full primary refresh. [2025-09-17T17:46:31.563328] [INFO ] [REMOTE ] BOND: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T17:46:31.623120] [INFO ] [REMOTE ] BOE: Fetching primary data for 2025-09. [2025-09-17T17:46:31.647483] [INFO ] [REMOTE ] BOND: Full fetch complete (46056 records). [2025-09-17T17:46:31.647718] [DEBUG] [VALIDATOR ] BOND: Validating primary data. [2025-09-17T17:46:32.245697] [INFO ] [REMOTE ] BORR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:46:32.363591] [DEBUG] [VALIDATOR ] BOND: All expected trading days are present. [2025-09-17T17:46:32.363720] [DEBUG] [VALIDATOR ] BOND: Primary data validation passed. [2025-09-17T17:46:32.364322] [INFO ] [MAIN ] BOND: Fetched primary data is valid. [2025-09-17T17:46:32.364384] [DEBUG] [LOCAL ] BOND: Saving primary data. [2025-09-17T17:46:32.365501] [DEBUG] [LOCAL ] BOND: Trimmed 46056 records to 32173 (keeping 200 days of data) [2025-09-17T17:46:32.426278] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-11. [2025-09-17T17:46:32.524003] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T17:46:32.615576] [DEBUG] [LOCAL ] BOND: Primary data saved (32173 records). [2025-09-17T17:46:32.615744] [INFO ] [MAIN ] BOND: Full history saved. [2025-09-17T17:46:32.615831] [INFO ] [MAIN ] Update Progress: 322/2371 symbols completed. BOND took 30.9s. Estimated remaining: 4h 55m 58s. Rate: 6.9 symbols/min [2025-09-17T17:46:32.797590] [INFO ] [MAIN ] BOW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:46:32.798481] [INFO ] [REMOTE ] BOE: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T17:46:32.802459] [INFO ] [REMOTE ] BOE: Full fetch complete (26749 records). [2025-09-17T17:46:32.802734] [DEBUG] [VALIDATOR ] BOE: Validating primary data. [2025-09-17T17:46:33.054185] [DEBUG] [LOCAL ] BOW: Loaded 23758 existing records from primary storage. [2025-09-17T17:46:33.092668] [INFO ] [MAIN ] BOW: Loaded 23758 existing records. [2025-09-17T17:46:33.216301] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-06. [2025-09-17T17:46:33.405494] [DEBUG] [VALIDATOR ] BOE: All expected trading days are present. [2025-09-17T17:46:33.405293] [WARN ] [MAIN ] BOW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:46:33.405628] [DEBUG] [VALIDATOR ] BOE: Primary data validation passed. [2025-09-17T17:46:33.405804] [INFO ] [MAIN ] BOW: Wiping existing primary data before full refresh. [2025-09-17T17:46:33.406410] [INFO ] [MAIN ] BOE: Fetched primary data is valid. [2025-09-17T17:46:33.406536] [DEBUG] [LOCAL ] BOE: Saving primary data. [2025-09-17T17:46:33.406608] [INFO ] [LOCAL ] BOW: Starting deletion of primary data. [2025-09-17T17:46:33.407297] [DEBUG] [LOCAL ] BOW: Deleted primary data file. [2025-09-17T17:46:33.407464] [INFO ] [MAIN ] BOW: Starting full primary refresh. [2025-09-17T17:46:33.439956] [DEBUG] [LOCAL ] BOE: Trimmed 26749 records to 17634 (keeping 200 days of data) [2025-09-17T17:46:33.882022] [INFO ] [REMOTE ] BOW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:46:33.899765] [DEBUG] [LOCAL ] BOE: Primary data saved (17634 records). [2025-09-17T17:46:33.899904] [INFO ] [MAIN ] BOE: Full history saved. [2025-09-17T17:46:33.899991] [INFO ] [MAIN ] Update Progress: 323/2371 symbols completed. BOE took 32.2s. Estimated remaining: 4h 55m 3s. Rate: 6.9 symbols/min [2025-09-17T17:46:34.020885] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-11. [2025-09-17T17:46:34.074954] [INFO ] [MAIN ] BOX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:46:34.123801] [DEBUG] [LOCAL ] BOX: Loaded 50349 existing records from primary storage. [2025-09-17T17:46:34.123955] [INFO ] [MAIN ] BOX: Loaded 50349 existing records. [2025-09-17T17:46:34.313004] [WARN ] [MAIN ] BOX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:46:34.313299] [INFO ] [MAIN ] BOX: Wiping existing primary data before full refresh. [2025-09-17T17:46:34.313346] [INFO ] [LOCAL ] BOX: Starting deletion of primary data. [2025-09-17T17:46:34.314391] [DEBUG] [LOCAL ] BOX: Deleted primary data file. [2025-09-17T17:46:34.314453] [INFO ] [MAIN ] BOX: Starting full primary refresh. [2025-09-17T17:46:34.679410] [INFO ] [REMOTE ] BOX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:46:34.711313] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-11 (2.29 seconds). [2025-09-17T17:46:34.743932] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T17:46:34.815729] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-07. [2025-09-17T17:46:35.241545] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T17:46:35.615839] [INFO ] [REMOTE ] BORR: Fetching primary data for 2024-12. [2025-09-17T17:46:36.220622] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T17:46:36.415807] [INFO ] [REMOTE ] BOW: Fetching primary data for 2024-12. [2025-09-17T17:46:37.061391] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T17:46:37.215839] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-08. [2025-09-17T17:46:37.433563] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T17:46:38.015793] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-11. [2025-09-17T17:46:38.731741] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T17:46:38.815748] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-01. [2025-09-17T17:46:39.615788] [INFO ] [REMOTE ] BOOT: Fetching primary data for 2025-09. [2025-09-17T17:46:39.674381] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T17:46:40.415800] [INFO ] [REMOTE ] BOX: Fetching primary data for 2024-12. [2025-09-17T17:46:40.608747] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T17:46:41.132807] [INFO ] [REMOTE ] BOOT: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T17:46:41.137868] [INFO ] [REMOTE ] BOOT: Full fetch complete (60437 records). [2025-09-17T17:46:41.137987] [DEBUG] [VALIDATOR ] BOOT: Validating primary data. [2025-09-17T17:46:41.220892] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-01. [2025-09-17T17:46:41.524217] [DEBUG] [VALIDATOR ] BOOT: All expected trading days are present. [2025-09-17T17:46:41.524297] [DEBUG] [VALIDATOR ] BOOT: Primary data validation passed. [2025-09-17T17:46:41.524981] [INFO ] [MAIN ] BOOT: Fetched primary data is valid. [2025-09-17T17:46:41.525039] [DEBUG] [LOCAL ] BOOT: Saving primary data. [2025-09-17T17:46:41.526251] [DEBUG] [LOCAL ] BOOT: Trimmed 60437 records to 41430 (keeping 200 days of data) [2025-09-17T17:46:41.780130] [DEBUG] [LOCAL ] BOOT: Primary data saved (41430 records). [2025-09-17T17:46:41.780256] [INFO ] [MAIN ] BOOT: Full history saved. [2025-09-17T17:46:41.780337] [INFO ] [MAIN ] Update Progress: 324/2371 symbols completed. BOOT took 40.1s. Estimated remaining: 4h 54m 49s. Rate: 6.9 symbols/min [2025-09-17T17:46:41.953268] [INFO ] [MAIN ] BP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:46:42.005087] [DEBUG] [LOCAL ] BP: Loaded 53711 existing records from primary storage. [2025-09-17T17:46:42.005353] [INFO ] [MAIN ] BP: Loaded 53711 existing records. [2025-09-17T17:46:42.026092] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-02. [2025-09-17T17:46:42.189746] [WARN ] [MAIN ] BP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:46:42.190075] [INFO ] [MAIN ] BP: Wiping existing primary data before full refresh. [2025-09-17T17:46:42.190218] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-17T17:46:42.199852] [DEBUG] [LOCAL ] BP: Deleted primary data file. [2025-09-17T17:46:42.213437] [INFO ] [MAIN ] BP: Starting full primary refresh. [2025-09-17T17:46:42.305212] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T17:46:42.400978] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T17:46:42.603276] [INFO ] [REMOTE ] BP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:46:42.815812] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-11. [2025-09-17T17:46:43.615782] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-01. [2025-09-17T17:46:43.694354] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T17:46:44.415821] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-02. [2025-09-17T17:46:44.790848] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-17T17:46:44.828934] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T17:46:45.215787] [INFO ] [REMOTE ] BP: Fetching primary data for 2024-12. [2025-09-17T17:46:45.417537] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T17:46:46.015815] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-02. [2025-09-17T17:46:46.815829] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-03. [2025-09-17T17:46:47.439077] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-17T17:46:47.582094] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T17:46:47.615815] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-01. [2025-09-17T17:46:47.781403] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T17:46:48.415814] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-03. [2025-09-17T17:46:49.215969] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-04. [2025-09-17T17:46:49.681897] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-17T17:46:49.804238] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T17:46:50.015712] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-02. [2025-09-17T17:46:50.158238] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T17:46:50.815794] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-05. [2025-09-17T17:46:51.615793] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-04. [2025-09-17T17:46:51.956244] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T17:46:52.016754] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T17:46:52.415787] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-03. [2025-09-17T17:46:52.957103] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T17:46:53.215835] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-03. [2025-09-17T17:46:54.015799] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-06. [2025-09-17T17:46:54.648276] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-17T17:46:54.815795] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-05. [2025-09-17T17:46:54.961524] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T17:46:55.045427] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T17:46:55.615801] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-04. [2025-09-17T17:46:56.415786] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-07. [2025-09-17T17:46:56.474474] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T17:46:57.215718] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-06. [2025-09-17T17:46:57.532952] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T17:46:57.721625] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T17:46:58.015780] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-05. [2025-09-17T17:46:58.549904] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T17:46:58.815788] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-07. [2025-09-17T17:46:59.615826] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-08. [2025-09-17T17:47:00.159008] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T17:47:00.413298] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T17:47:00.418772] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-04. [2025-09-17T17:47:00.701059] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T17:47:01.215823] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-06. [2025-09-17T17:47:02.015812] [INFO ] [REMOTE ] BOW: Fetching primary data for 2025-09. [2025-09-17T17:47:02.270797] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T17:47:02.815825] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-05. [2025-09-17T17:47:02.880369] [INFO ] [REMOTE ] BOW: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T17:47:02.884010] [INFO ] [REMOTE ] BOW: Full fetch complete (31048 records). [2025-09-17T17:47:02.884125] [DEBUG] [VALIDATOR ] BOW: Validating primary data. [2025-09-17T17:47:03.290702] [DEBUG] [VALIDATOR ] BOW: All expected trading days are present. [2025-09-17T17:47:03.290860] [DEBUG] [VALIDATOR ] BOW: Primary data validation passed. [2025-09-17T17:47:03.291465] [INFO ] [MAIN ] BOW: Fetched primary data is valid. [2025-09-17T17:47:03.291526] [DEBUG] [LOCAL ] BOW: Saving primary data. [2025-09-17T17:47:03.293103] [DEBUG] [LOCAL ] BOW: Trimmed 31048 records to 23746 (keeping 200 days of data) [2025-09-17T17:47:03.429942] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-17T17:47:03.483321] [DEBUG] [LOCAL ] BOW: Primary data saved (23746 records). [2025-09-17T17:47:03.483485] [INFO ] [MAIN ] BOW: Full history saved. [2025-09-17T17:47:03.483582] [INFO ] [MAIN ] Update Progress: 325/2371 symbols completed. BOW took 30.9s. Estimated remaining: 4h 56m 3s. Rate: 6.9 symbols/min [2025-09-17T17:47:03.625946] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-07. [2025-09-17T17:47:03.659120] [INFO ] [MAIN ] BR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:47:03.695821] [DEBUG] [LOCAL ] BR: Loaded 34763 existing records from primary storage. [2025-09-17T17:47:03.695970] [INFO ] [MAIN ] BR: Loaded 34763 existing records. [2025-09-17T17:47:03.878521] [WARN ] [MAIN ] BR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:47:03.878810] [INFO ] [MAIN ] BR: Wiping existing primary data before full refresh. [2025-09-17T17:47:03.878859] [INFO ] [LOCAL ] BR: Starting deletion of primary data. [2025-09-17T17:47:03.879760] [DEBUG] [LOCAL ] BR: Deleted primary data file. [2025-09-17T17:47:03.879818] [INFO ] [MAIN ] BR: Starting full primary refresh. [2025-09-17T17:47:04.249704] [INFO ] [REMOTE ] BR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:47:04.415769] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-11. [2025-09-17T17:47:04.564252] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T17:47:05.215794] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-06. [2025-09-17T17:47:05.940824] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-17T17:47:05.973393] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T17:47:06.015714] [INFO ] [REMOTE ] BR: Fetching primary data for 2024-12. [2025-09-17T17:47:06.815795] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-08. [2025-09-17T17:47:07.005086] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T17:47:07.475754] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T17:47:07.615780] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-08. [2025-09-17T17:47:08.415776] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-07. [2025-09-17T17:47:08.461941] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T17:47:09.215785] [INFO ] [REMOTE ] BOX: Fetching primary data for 2025-09. [2025-09-17T17:47:09.627097] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T17:47:09.756994] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T17:47:10.015797] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-08. [2025-09-17T17:47:10.815790] [INFO ] [REMOTE ] BP: Fetching primary data for 2025-09. [2025-09-17T17:47:11.338844] [INFO ] [REMOTE ] BOX: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-17T17:47:11.345610] [INFO ] [REMOTE ] BOX: Full fetch complete (71989 records). [2025-09-17T17:47:11.345802] [DEBUG] [VALIDATOR ] BOX: Validating primary data. [2025-09-17T17:47:11.620841] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-01. [2025-09-17T17:47:11.747556] [DEBUG] [VALIDATOR ] BOX: All expected trading days are present. [2025-09-17T17:47:11.747672] [DEBUG] [VALIDATOR ] BOX: Primary data validation passed. [2025-09-17T17:47:11.748533] [INFO ] [MAIN ] BOX: Fetched primary data is valid. [2025-09-17T17:47:11.748618] [DEBUG] [LOCAL ] BOX: Saving primary data. [2025-09-17T17:47:11.750602] [DEBUG] [LOCAL ] BOX: Trimmed 71989 records to 50373 (keeping 200 days of data) [2025-09-17T17:47:11.993259] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T17:47:12.094078] [DEBUG] [LOCAL ] BOX: Primary data saved (50373 records). [2025-09-17T17:47:12.094229] [INFO ] [MAIN ] BOX: Full history saved. [2025-09-17T17:47:12.095420] [INFO ] [MAIN ] Update Progress: 326/2371 symbols completed. BOX took 38.2s. Estimated remaining: 4h 55m 54s. Rate: 6.9 symbols/min [2025-09-17T17:47:12.263963] [INFO ] [MAIN ] BRBR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:47:12.315241] [DEBUG] [LOCAL ] BRBR: Loaded 51173 existing records from primary storage. [2025-09-17T17:47:12.315378] [INFO ] [MAIN ] BRBR: Loaded 51173 existing records. [2025-09-17T17:47:12.423099] [INFO ] [REMOTE ] BORR: Fetching primary data for 2025-09. [2025-09-17T17:47:12.519015] [WARN ] [MAIN ] BRBR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:47:12.519234] [INFO ] [MAIN ] BRBR: Wiping existing primary data before full refresh. [2025-09-17T17:47:12.519280] [INFO ] [LOCAL ] BRBR: Starting deletion of primary data. [2025-09-17T17:47:12.520344] [DEBUG] [LOCAL ] BRBR: Deleted primary data file. [2025-09-17T17:47:12.520405] [INFO ] [MAIN ] BRBR: Starting full primary refresh. [2025-09-17T17:47:12.887765] [INFO ] [REMOTE ] BRBR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:47:12.904525] [INFO ] [REMOTE ] BP: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-17T17:47:12.911008] [INFO ] [REMOTE ] BP: Full fetch complete (77260 records). [2025-09-17T17:47:12.911174] [DEBUG] [VALIDATOR ] BP: Validating primary data. [2025-09-17T17:47:12.911939] [FATAL] [VALIDATOR ] BP: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:47:12.912025] [FATAL] [MAIN ] BP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:47:12.912084] [WARN ] [MAIN ] BP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:47:12.912132] [INFO ] [LOCAL ] BP: Starting deletion of primary data. [2025-09-17T17:47:12.912239] [DEBUG] [LOCAL ] BP: No primary data file found to delete. [2025-09-17T17:47:12.912288] [INFO ] [LOCAL ] BP: Starting deletion of derivative data. [2025-09-17T17:47:12.912654] [DEBUG] [LOCAL ] BP: Deleted derivative data file. [2025-09-17T17:47:12.912757] [INFO ] [MAIN ] Update Progress: 327/2371 symbols completed. BP took 31.1s. Estimated remaining: 4h 54m 56s. Rate: 6.9 symbols/min [2025-09-17T17:47:13.091727] [INFO ] [MAIN ] BRC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:47:13.122472] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T17:47:13.148165] [DEBUG] [LOCAL ] BRC: Loaded 19870 existing records from primary storage. [2025-09-17T17:47:13.148323] [INFO ] [MAIN ] BRC: Loaded 19870 existing records. [2025-09-17T17:47:13.220898] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-02. [2025-09-17T17:47:13.346559] [WARN ] [MAIN ] BRC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:47:13.346845] [INFO ] [MAIN ] BRC: Wiping existing primary data before full refresh. [2025-09-17T17:47:13.346897] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-17T17:47:13.347425] [DEBUG] [LOCAL ] BRC: Deleted primary data file. [2025-09-17T17:47:13.347474] [INFO ] [MAIN ] BRC: Starting full primary refresh. [2025-09-17T17:47:13.711368] [INFO ] [REMOTE ] BRC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:47:14.015897] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-11. [2025-09-17T17:47:14.325546] [INFO ] [REMOTE ] BORR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T17:47:14.334327] [INFO ] [REMOTE ] BORR: Full fetch complete (74671 records). [2025-09-17T17:47:14.334501] [DEBUG] [VALIDATOR ] BORR: Validating primary data. [2025-09-17T17:47:14.636525] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T17:47:14.765944] [DEBUG] [VALIDATOR ] BORR: All expected trading days are present. [2025-09-17T17:47:14.766047] [DEBUG] [VALIDATOR ] BORR: Primary data validation passed. [2025-09-17T17:47:14.766884] [INFO ] [MAIN ] BORR: Fetched primary data is valid. [2025-09-17T17:47:14.766934] [DEBUG] [LOCAL ] BORR: Saving primary data. [2025-09-17T17:47:14.768829] [DEBUG] [LOCAL ] BORR: Trimmed 74671 records to 51196 (keeping 200 days of data) [2025-09-17T17:47:14.824028] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-11. [2025-09-17T17:47:15.074211] [DEBUG] [LOCAL ] BORR: Primary data saved (51196 records). [2025-09-17T17:47:15.074421] [INFO ] [MAIN ] BORR: Full history saved. [2025-09-17T17:47:15.075503] [INFO ] [MAIN ] Update Progress: 328/2371 symbols completed. BORR took 44.0s. Estimated remaining: 4h 54m 7s. Rate: 6.9 symbols/min [2025-09-17T17:47:15.259007] [INFO ] [MAIN ] BRCC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:47:15.299349] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T17:47:15.317699] [DEBUG] [LOCAL ] BRCC: Loaded 40368 existing records from primary storage. [2025-09-17T17:47:15.317839] [INFO ] [MAIN ] BRCC: Loaded 40368 existing records. [2025-09-17T17:47:15.493487] [WARN ] [MAIN ] BRCC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:47:15.493840] [INFO ] [MAIN ] BRCC: Wiping existing primary data before full refresh. [2025-09-17T17:47:15.493888] [INFO ] [LOCAL ] BRCC: Starting deletion of primary data. [2025-09-17T17:47:15.494822] [DEBUG] [LOCAL ] BRCC: Deleted primary data file. [2025-09-17T17:47:15.494880] [INFO ] [MAIN ] BRCC: Starting full primary refresh. [2025-09-17T17:47:15.620859] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-03. [2025-09-17T17:47:15.853105] [INFO ] [REMOTE ] BRCC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:47:16.262307] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T17:47:16.415785] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2024-12. [2025-09-17T17:47:16.828787] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T17:47:17.215765] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-04. [2025-09-17T17:47:18.003278] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T17:47:18.015724] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-01. [2025-09-17T17:47:18.823374] [INFO ] [REMOTE ] BRC: Fetching primary data for 2024-12. [2025-09-17T17:47:18.828121] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T17:47:19.568803] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T17:47:19.615743] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-05. [2025-09-17T17:47:19.834053] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T17:47:20.415800] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-11. [2025-09-17T17:47:20.702033] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T17:47:21.215783] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-06. [2025-09-17T17:47:22.015777] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-02. [2025-09-17T17:47:22.061591] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T17:47:22.155712] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T17:47:22.815774] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2024-12. [2025-09-17T17:47:23.389084] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T17:47:23.615768] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-03. [2025-09-17T17:47:24.097915] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T17:47:24.415773] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-01. [2025-09-17T17:47:25.215770] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-01. [2025-09-17T17:47:25.284189] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T17:47:25.336839] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T17:47:26.015811] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-07. [2025-09-17T17:47:26.395933] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T17:47:26.815813] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-02. [2025-09-17T17:47:27.466176] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T17:47:27.615813] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-08. [2025-09-17T17:47:28.277276] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T17:47:28.415873] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-04. [2025-09-17T17:47:29.215860] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-03. [2025-09-17T17:47:29.505247] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T17:47:29.730779] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T17:47:30.015799] [INFO ] [REMOTE ] BR: Fetching primary data for 2025-09. [2025-09-17T17:47:30.391632] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T17:47:30.815797] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-02. [2025-09-17T17:47:31.175318] [INFO ] [REMOTE ] BR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T17:47:31.180247] [INFO ] [REMOTE ] BR: Full fetch complete (48585 records). [2025-09-17T17:47:31.180369] [DEBUG] [VALIDATOR ] BR: Validating primary data. [2025-09-17T17:47:31.567627] [DEBUG] [VALIDATOR ] BR: All expected trading days are present. [2025-09-17T17:47:31.567730] [DEBUG] [VALIDATOR ] BR: Primary data validation passed. [2025-09-17T17:47:31.568316] [INFO ] [MAIN ] BR: Fetched primary data is valid. [2025-09-17T17:47:31.568359] [DEBUG] [LOCAL ] BR: Saving primary data. [2025-09-17T17:47:31.569678] [DEBUG] [LOCAL ] BR: Trimmed 48585 records to 34774 (keeping 200 days of data) [2025-09-17T17:47:31.627221] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-05. [2025-09-17T17:47:31.795299] [DEBUG] [LOCAL ] BR: Primary data saved (34774 records). [2025-09-17T17:47:31.795468] [INFO ] [MAIN ] BR: Full history saved. [2025-09-17T17:47:31.797222] [INFO ] [MAIN ] Update Progress: 329/2371 symbols completed. BR took 28.3s. Estimated remaining: 4h 54m 48s. Rate: 6.9 symbols/min [2025-09-17T17:47:31.974225] [INFO ] [MAIN ] BRFS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:47:31.988387] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T17:47:32.041206] [DEBUG] [LOCAL ] BRFS: Loaded 41078 existing records from primary storage. [2025-09-17T17:47:32.041800] [INFO ] [MAIN ] BRFS: Loaded 41078 existing records. [2025-09-17T17:47:32.221819] [WARN ] [MAIN ] BRFS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:47:32.222131] [INFO ] [MAIN ] BRFS: Wiping existing primary data before full refresh. [2025-09-17T17:47:32.222175] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-17T17:47:32.223380] [DEBUG] [LOCAL ] BRFS: Deleted primary data file. [2025-09-17T17:47:32.223430] [INFO ] [MAIN ] BRFS: Starting full primary refresh. [2025-09-17T17:47:32.420992] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-03. [2025-09-17T17:47:32.578959] [INFO ] [REMOTE ] BRFS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:47:33.215793] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-04. [2025-09-17T17:47:33.418834] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T17:47:33.639095] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T17:47:34.015816] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-06. [2025-09-17T17:47:34.544279] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T17:47:34.815831] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-04. [2025-09-17T17:47:35.615785] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-05. [2025-09-17T17:47:35.700705] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T17:47:36.035590] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T17:47:36.415803] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-05. [2025-09-17T17:47:36.854558] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T17:47:37.215748] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-06. [2025-09-17T17:47:37.443211] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T17:47:38.015844] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-07. [2025-09-17T17:47:38.451838] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T17:47:38.815815] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-07. [2025-09-17T17:47:39.615823] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-06. [2025-09-17T17:47:39.773454] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T17:47:39.901196] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T17:47:40.287185] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T17:47:40.415805] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-07. [2025-09-17T17:47:41.215820] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-08. [2025-09-17T17:47:41.458826] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T17:47:42.015845] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2024-11. [2025-09-17T17:47:42.830798] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-08. [2025-09-17T17:47:42.858486] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T17:47:43.624289] [INFO ] [REMOTE ] BRCC: Fetching primary data for 2025-09. [2025-09-17T17:47:43.649308] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T17:47:44.415791] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2024-12. [2025-09-17T17:47:44.741529] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T17:47:45.215818] [INFO ] [REMOTE ] BRBR: Fetching primary data for 2025-09. [2025-09-17T17:47:45.503779] [INFO ] [REMOTE ] BRCC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T17:47:45.509609] [INFO ] [REMOTE ] BRCC: Full fetch complete (57735 records). [2025-09-17T17:47:45.509743] [DEBUG] [VALIDATOR ] BRCC: Validating primary data. [2025-09-17T17:47:45.902746] [DEBUG] [VALIDATOR ] BRCC: All expected trading days are present. [2025-09-17T17:47:45.902868] [DEBUG] [VALIDATOR ] BRCC: Primary data validation passed. [2025-09-17T17:47:45.903574] [INFO ] [MAIN ] BRCC: Fetched primary data is valid. [2025-09-17T17:47:45.903787] [DEBUG] [LOCAL ] BRCC: Saving primary data. [2025-09-17T17:47:45.905527] [DEBUG] [LOCAL ] BRCC: Trimmed 57735 records to 40428 (keeping 200 days of data) [2025-09-17T17:47:46.023031] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-08. [2025-09-17T17:47:46.027723] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T17:47:46.181254] [DEBUG] [LOCAL ] BRCC: Primary data saved (40428 records). [2025-09-17T17:47:46.181386] [INFO ] [MAIN ] BRCC: Full history saved. [2025-09-17T17:47:46.182043] [INFO ] [MAIN ] Update Progress: 330/2371 symbols completed. BRCC took 31.1s. Estimated remaining: 4h 55m 15s. Rate: 6.9 symbols/min [2025-09-17T17:47:46.364429] [INFO ] [MAIN ] BRO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:47:46.418259] [DEBUG] [LOCAL ] BRO: Loaded 51909 existing records from primary storage. [2025-09-17T17:47:46.418401] [INFO ] [MAIN ] BRO: Loaded 51909 existing records. [2025-09-17T17:47:46.600478] [WARN ] [MAIN ] BRO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:47:46.600776] [INFO ] [MAIN ] BRO: Wiping existing primary data before full refresh. [2025-09-17T17:47:46.600832] [INFO ] [LOCAL ] BRO: Starting deletion of primary data. [2025-09-17T17:47:46.601914] [DEBUG] [LOCAL ] BRO: Deleted primary data file. [2025-09-17T17:47:46.601963] [INFO ] [MAIN ] BRO: Starting full primary refresh. [2025-09-17T17:47:46.822847] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-01. [2025-09-17T17:47:46.961116] [INFO ] [REMOTE ] BRO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:47:47.061927] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T17:47:47.317953] [INFO ] [REMOTE ] BRBR: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-17T17:47:47.325065] [INFO ] [REMOTE ] BRBR: Full fetch complete (71368 records). [2025-09-17T17:47:47.325236] [DEBUG] [VALIDATOR ] BRBR: Validating primary data. [2025-09-17T17:47:47.623572] [INFO ] [REMOTE ] BRC: Fetching primary data for 2025-09. [2025-09-17T17:47:47.731146] [DEBUG] [VALIDATOR ] BRBR: All expected trading days are present. [2025-09-17T17:47:47.731222] [DEBUG] [VALIDATOR ] BRBR: Primary data validation passed. [2025-09-17T17:47:47.732012] [INFO ] [MAIN ] BRBR: Fetched primary data is valid. [2025-09-17T17:47:47.732068] [DEBUG] [LOCAL ] BRBR: Saving primary data. [2025-09-17T17:47:47.733439] [DEBUG] [LOCAL ] BRBR: Trimmed 71368 records to 51205 (keeping 200 days of data) [2025-09-17T17:47:48.031036] [DEBUG] [LOCAL ] BRBR: Primary data saved (51205 records). [2025-09-17T17:47:48.031171] [INFO ] [MAIN ] BRBR: Full history saved. [2025-09-17T17:47:48.031852] [INFO ] [MAIN ] Update Progress: 331/2371 symbols completed. BRBR took 35.9s. Estimated remaining: 4h 54m 24s. Rate: 6.9 symbols/min [2025-09-17T17:47:48.201845] [INFO ] [MAIN ] BROS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:47:48.228992] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T17:47:48.286193] [DEBUG] [LOCAL ] BROS: Loaded 53282 existing records from primary storage. [2025-09-17T17:47:48.286375] [INFO ] [MAIN ] BROS: Loaded 53282 existing records. [2025-09-17T17:47:48.420975] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-11. [2025-09-17T17:47:48.473725] [WARN ] [MAIN ] BROS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:47:48.473956] [INFO ] [MAIN ] BROS: Wiping existing primary data before full refresh. [2025-09-17T17:47:48.474003] [INFO ] [LOCAL ] BROS: Starting deletion of primary data. [2025-09-17T17:47:48.474902] [DEBUG] [LOCAL ] BROS: Deleted primary data file. [2025-09-17T17:47:48.474952] [INFO ] [MAIN ] BROS: Starting full primary refresh. [2025-09-17T17:47:48.848727] [INFO ] [REMOTE ] BROS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:47:48.845738] [INFO ] [REMOTE ] BRC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T17:47:48.851465] [INFO ] [REMOTE ] BRC: Full fetch complete (29016 records). [2025-09-17T17:47:48.851536] [DEBUG] [VALIDATOR ] BRC: Validating primary data. [2025-09-17T17:47:48.852007] [FATAL] [VALIDATOR ] BRC: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:47:48.852083] [FATAL] [MAIN ] BRC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:47:48.852118] [WARN ] [MAIN ] BRC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:47:48.852161] [INFO ] [LOCAL ] BRC: Starting deletion of primary data. [2025-09-17T17:47:48.852214] [DEBUG] [LOCAL ] BRC: No primary data file found to delete. [2025-09-17T17:47:48.852249] [INFO ] [LOCAL ] BRC: Starting deletion of derivative data. [2025-09-17T17:47:48.852570] [DEBUG] [LOCAL ] BRC: Deleted derivative data file. [2025-09-17T17:47:48.852665] [INFO ] [MAIN ] Update Progress: 332/2371 symbols completed. BRC took 35.9s. Estimated remaining: 4h 53m 28s. Rate: 6.9 symbols/min [2025-09-17T17:47:49.023787] [INFO ] [MAIN ] BRSL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:47:49.024009] [DEBUG] [LOCAL ] BRSL: No existing data file found in primary storage. [2025-09-17T17:47:49.024050] [WARN ] [MAIN ] BRSL: No existing data found, performing full refresh instead. [2025-09-17T17:47:49.024177] [INFO ] [MAIN ] BRSL: Wiping existing primary data before full refresh. [2025-09-17T17:47:49.024218] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-17T17:47:49.024259] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-17T17:47:49.024290] [INFO ] [MAIN ] BRSL: Starting full primary refresh. [2025-09-17T17:47:49.224306] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-11. [2025-09-17T17:47:49.388204] [INFO ] [REMOTE ] BRSL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:47:50.015744] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-11. [2025-09-17T17:47:50.115046] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T17:47:50.214300] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:47:50.214667] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-11 [2025-09-17T17:47:50.815792] [INFO ] [REMOTE ] BRO: Fetching primary data for 2024-12. [2025-09-17T17:47:51.519633] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-11 (2.30 seconds). [2025-09-17T17:47:51.615819] [INFO ] [REMOTE ] BROS: Fetching primary data for 2024-12. [2025-09-17T17:47:52.347282] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T17:47:52.415731] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-01. [2025-09-17T17:47:53.215792] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2024-12. [2025-09-17T17:47:53.408664] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:47:53.409096] [WARN ] [REMOTE ] BRSL: No data returned for month 2024-12 [2025-09-17T17:47:53.493475] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T17:47:54.015869] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-01. [2025-09-17T17:47:54.275308] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T17:47:54.815838] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-01. [2025-09-17T17:47:55.015370] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:47:55.015747] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-01 [2025-09-17T17:47:55.591211] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T17:47:55.615728] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-02. [2025-09-17T17:47:56.415843] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-02. [2025-09-17T17:47:57.215800] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-02. [2025-09-17T17:47:57.645599] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-17T17:47:58.015807] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-03. [2025-09-17T17:47:58.114862] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T17:47:58.735212] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T17:47:58.815791] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-03. [2025-09-17T17:47:59.615817] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-02. [2025-09-17T17:47:59.809002] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:47:59.809329] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-02 [2025-09-17T17:47:59.943260] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T17:48:00.415817] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-03. [2025-09-17T17:48:00.612823] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T17:48:01.215811] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-03. [2025-09-17T17:48:01.487990] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:48:01.488324] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-03 [2025-09-17T17:48:02.015809] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-04. [2025-09-17T17:48:02.680432] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-17T17:48:02.815808] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-04. [2025-09-17T17:48:03.615797] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-04. [2025-09-17T17:48:03.843212] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T17:48:03.854730] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:48:03.855528] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-04 [2025-09-17T17:48:04.416171] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-05. [2025-09-17T17:48:04.938591] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T17:48:05.037331] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:48:05.037880] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-05 [2025-09-17T17:48:05.215832] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-05. [2025-09-17T17:48:06.015796] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-05. [2025-09-17T17:48:06.815815] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-06. [2025-09-17T17:48:07.014970] [DEBUG] [REMOTE ] BRSL: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:48:07.015307] [WARN ] [REMOTE ] BRSL: No data returned for month 2025-06 [2025-09-17T17:48:07.184804] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T17:48:07.615807] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-06. [2025-09-17T17:48:08.089254] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T17:48:08.415813] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-04. [2025-09-17T17:48:09.215766] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-07. [2025-09-17T17:48:09.613632] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T17:48:09.849114] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T17:48:10.015779] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-05. [2025-09-17T17:48:10.815791] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-06. [2025-09-17T17:48:11.077741] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T17:48:11.165192] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T17:48:11.615789] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-07. [2025-09-17T17:48:12.415779] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-06. [2025-09-17T17:48:12.622432] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T17:48:13.215782] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-07. [2025-09-17T17:48:13.737749] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-17T17:48:13.774544] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T17:48:14.015821] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-07. [2025-09-17T17:48:14.815742] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-08. [2025-09-17T17:48:15.031086] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T17:48:15.548566] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T17:48:15.615777] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-08. [2025-09-17T17:48:16.415786] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-08. [2025-09-17T17:48:16.777547] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T17:48:16.812280] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T17:48:17.215786] [INFO ] [REMOTE ] BROS: Fetching primary data for 2025-09. [2025-09-17T17:48:18.015778] [INFO ] [REMOTE ] BRFS: Fetching primary data for 2025-09. [2025-09-17T17:48:18.062564] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T17:48:18.815783] [INFO ] [REMOTE ] BRSL: Fetching primary data for 2025-09. [2025-09-17T17:48:19.323570] [INFO ] [REMOTE ] BRFS: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T17:48:19.328117] [INFO ] [REMOTE ] BRFS: Full fetch complete (60499 records). [2025-09-17T17:48:19.328249] [DEBUG] [VALIDATOR ] BRFS: Validating primary data. [2025-09-17T17:48:19.329002] [FATAL] [VALIDATOR ] BRFS: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:48:19.329096] [FATAL] [MAIN ] BRFS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:48:19.329148] [WARN ] [MAIN ] BRFS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:48:19.329212] [INFO ] [LOCAL ] BRFS: Starting deletion of primary data. [2025-09-17T17:48:19.329278] [DEBUG] [LOCAL ] BRFS: No primary data file found to delete. [2025-09-17T17:48:19.329314] [INFO ] [LOCAL ] BRFS: Starting deletion of derivative data. [2025-09-17T17:48:19.329750] [DEBUG] [LOCAL ] BRFS: Deleted derivative data file. [2025-09-17T17:48:19.329840] [INFO ] [MAIN ] Update Progress: 333/2371 symbols completed. BRFS took 47.5s. Estimated remaining: 4h 55m 33s. Rate: 6.9 symbols/min [2025-09-17T17:48:19.524831] [INFO ] [MAIN ] BRSP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:48:19.526728] [INFO ] [REMOTE ] BROS: Incremental fetch complete for 2025-09 (2.31 seconds). [2025-09-17T17:48:19.534041] [INFO ] [REMOTE ] BROS: Full fetch complete (76807 records). [2025-09-17T17:48:19.534205] [DEBUG] [VALIDATOR ] BROS: Validating primary data. [2025-09-17T17:48:19.619342] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-08. [2025-09-17T17:48:19.875317] [DEBUG] [LOCAL ] BRSP: Loaded 36992 existing records from primary storage. [2025-09-17T17:48:19.875519] [INFO ] [MAIN ] BRSP: Loaded 36992 existing records. [2025-09-17T17:48:20.138390] [DEBUG] [VALIDATOR ] BROS: All expected trading days are present. [2025-09-17T17:48:20.139059] [DEBUG] [VALIDATOR ] BROS: Primary data validation passed. [2025-09-17T17:48:20.153910] [INFO ] [MAIN ] BROS: Fetched primary data is valid. [2025-09-17T17:48:20.158930] [DEBUG] [LOCAL ] BROS: Saving primary data. [2025-09-17T17:48:20.159234] [WARN ] [MAIN ] BRSP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:48:20.159470] [INFO ] [MAIN ] BRSP: Wiping existing primary data before full refresh. [2025-09-17T17:48:20.159855] [INFO ] [LOCAL ] BRSP: Starting deletion of primary data. [2025-09-17T17:48:20.160812] [DEBUG] [LOCAL ] BRSP: Deleted primary data file. [2025-09-17T17:48:20.160894] [INFO ] [MAIN ] BRSP: Starting full primary refresh. [2025-09-17T17:48:20.160764] [DEBUG] [LOCAL ] BROS: Trimmed 76807 records to 53282 (keeping 200 days of data) [2025-09-17T17:48:20.755990] [INFO ] [REMOTE ] BRSP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:48:20.758344] [INFO ] [REMOTE ] BRSL: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T17:48:20.758575] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-11. [2025-09-17T17:48:20.767620] [INFO ] [REMOTE ] BRSL: Full fetch complete (19771 records). [2025-09-17T17:48:20.768033] [DEBUG] [VALIDATOR ] BRSL: Validating primary data. [2025-09-17T17:48:20.979749] [WARN ] [VALIDATOR ] BRSL: Validation failed - insufficient historical data. Have 54 unique days, need 200 days [2025-09-17T17:48:21.020087] [FATAL] [MAIN ] BRSL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:48:21.020445] [WARN ] [MAIN ] BRSL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:48:21.037659] [INFO ] [LOCAL ] BRSL: Starting deletion of primary data. [2025-09-17T17:48:21.038197] [DEBUG] [LOCAL ] BRSL: No primary data file found to delete. [2025-09-17T17:48:21.041734] [INFO ] [LOCAL ] BRSL: Starting deletion of derivative data. [2025-09-17T17:48:21.044723] [DEBUG] [LOCAL ] BRSL: No derivative data file found to delete. [2025-09-17T17:48:21.046956] [INFO ] [MAIN ] Update Progress: 334/2371 symbols completed. BRSL took 32.2s. Estimated remaining: 4h 54m 41s. Rate: 6.9 symbols/min [2025-09-17T17:48:21.231125] [INFO ] [MAIN ] BRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:48:21.234132] [DEBUG] [LOCAL ] BROS: Primary data saved (53282 records). [2025-09-17T17:48:21.234481] [INFO ] [MAIN ] BROS: Full history saved. [2025-09-17T17:48:21.235033] [INFO ] [MAIN ] Update Progress: 335/2371 symbols completed. BROS took 33.2s. Estimated remaining: 4h 53m 41s. Rate: 6.9 symbols/min [2025-09-17T17:48:21.341688] [DEBUG] [LOCAL ] BRT: Loaded 4783 existing records from primary storage. [2025-09-17T17:48:21.352203] [INFO ] [MAIN ] BRT: Loaded 4783 existing records. [2025-09-17T17:48:21.495852] [INFO ] [MAIN ] BRW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:48:21.605937] [WARN ] [MAIN ] BRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:48:21.606404] [INFO ] [MAIN ] BRT: Wiping existing primary data before full refresh. [2025-09-17T17:48:21.606575] [INFO ] [LOCAL ] BRT: Starting deletion of primary data. [2025-09-17T17:48:21.606980] [DEBUG] [LOCAL ] BRT: Deleted primary data file. [2025-09-17T17:48:21.607047] [INFO ] [MAIN ] BRT: Starting full primary refresh. [2025-09-17T17:48:21.700957] [DEBUG] [LOCAL ] BRW: Loaded 18882 existing records from primary storage. [2025-09-17T17:48:21.714966] [INFO ] [MAIN ] BRW: Loaded 18882 existing records. [2025-09-17T17:48:22.100534] [WARN ] [MAIN ] BRW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:48:22.132912] [INFO ] [MAIN ] BRW: Wiping existing primary data before full refresh. [2025-09-17T17:48:22.212124] [INFO ] [LOCAL ] BRW: Starting deletion of primary data. [2025-09-17T17:48:22.212033] [INFO ] [REMOTE ] BRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:48:22.216316] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-11. [2025-09-17T17:48:22.215982] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-17T17:48:22.228211] [DEBUG] [LOCAL ] BRW: Deleted primary data file. [2025-09-17T17:48:22.229050] [INFO ] [MAIN ] BRW: Starting full primary refresh. [2025-09-17T17:48:22.255072] [INFO ] [REMOTE ] BRO: Fetching primary data for 2025-09. [2025-09-17T17:48:22.575210] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T17:48:22.655292] [INFO ] [REMOTE ] BRW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:48:22.815766] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2024-12. [2025-09-17T17:48:23.166769] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T17:48:23.615833] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-11. [2025-09-17T17:48:23.876233] [INFO ] [REMOTE ] BRO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T17:48:23.882948] [INFO ] [REMOTE ] BRO: Full fetch complete (73821 records). [2025-09-17T17:48:23.883091] [DEBUG] [VALIDATOR ] BRO: Validating primary data. [2025-09-17T17:48:24.279137] [DEBUG] [VALIDATOR ] BRO: All expected trading days are present. [2025-09-17T17:48:24.279240] [DEBUG] [VALIDATOR ] BRO: Primary data validation passed. [2025-09-17T17:48:24.280223] [INFO ] [MAIN ] BRO: Fetched primary data is valid. [2025-09-17T17:48:24.280336] [DEBUG] [LOCAL ] BRO: Saving primary data. [2025-09-17T17:48:24.282200] [DEBUG] [LOCAL ] BRO: Trimmed 73821 records to 51917 (keeping 200 days of data) [2025-09-17T17:48:24.378072] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T17:48:24.422629] [INFO ] [REMOTE ] BRT: Fetching primary data for 2024-12. [2025-09-17T17:48:24.658403] [DEBUG] [LOCAL ] BRO: Primary data saved (51917 records). [2025-09-17T17:48:24.658546] [INFO ] [MAIN ] BRO: Full history saved. [2025-09-17T17:48:24.659443] [INFO ] [MAIN ] Update Progress: 336/2371 symbols completed. BRO took 38.5s. Estimated remaining: 4h 53m 1s. Rate: 6.9 symbols/min [2025-09-17T17:48:24.844326] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T17:48:24.846107] [INFO ] [MAIN ] BRX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:48:24.911715] [DEBUG] [LOCAL ] BRX: Loaded 51877 existing records from primary storage. [2025-09-17T17:48:24.911893] [INFO ] [MAIN ] BRX: Loaded 51877 existing records. [2025-09-17T17:48:25.091947] [WARN ] [MAIN ] BRX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:48:25.092202] [INFO ] [MAIN ] BRX: Wiping existing primary data before full refresh. [2025-09-17T17:48:25.092248] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-17T17:48:25.093278] [DEBUG] [LOCAL ] BRX: Deleted primary data file. [2025-09-17T17:48:25.093330] [INFO ] [MAIN ] BRX: Starting full primary refresh. [2025-09-17T17:48:25.239519] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T17:48:25.219909] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-01. [2025-09-17T17:48:25.457024] [INFO ] [REMOTE ] BRX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:48:26.015818] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-11. [2025-09-17T17:48:26.685388] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T17:48:26.815819] [INFO ] [REMOTE ] BRW: Fetching primary data for 2024-12. [2025-09-17T17:48:27.615815] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-02. [2025-09-17T17:48:27.773331] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T17:48:27.823714] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T17:48:28.415795] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-01. [2025-09-17T17:48:29.215825] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-01. [2025-09-17T17:48:29.482091] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T17:48:29.551205] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T17:48:29.828078] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T17:48:30.015771] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-02. [2025-09-17T17:48:30.815756] [INFO ] [REMOTE ] BRX: Fetching primary data for 2024-12. [2025-09-17T17:48:31.032951] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T17:48:31.615770] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-02. [2025-09-17T17:48:32.100858] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T17:48:32.420901] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-03. [2025-09-17T17:48:32.441494] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T17:48:33.049690] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T17:48:33.215777] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-03. [2025-09-17T17:48:34.015781] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-04. [2025-09-17T17:48:34.775905] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T17:48:34.791765] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T17:48:34.815839] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-04. [2025-09-17T17:48:35.616018] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-05. [2025-09-17T17:48:35.978710] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T17:48:36.329778] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T17:48:36.415730] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-06. [2025-09-17T17:48:37.008026] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T17:48:37.215807] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-07. [2025-09-17T17:48:37.852920] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T17:48:38.015796] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-08. [2025-09-17T17:48:38.684069] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T17:48:38.815827] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-01. [2025-09-17T17:48:39.615858] [INFO ] [REMOTE ] BRT: Fetching primary data for 2025-09. [2025-09-17T17:48:40.415866] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-05. [2025-09-17T17:48:40.444741] [INFO ] [REMOTE ] BRT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T17:48:40.445901] [INFO ] [REMOTE ] BRT: Full fetch complete (6724 records). [2025-09-17T17:48:40.445969] [DEBUG] [VALIDATOR ] BRT: Validating primary data. [2025-09-17T17:48:40.741855] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T17:48:40.854093] [DEBUG] [VALIDATOR ] BRT: All expected trading days are present. [2025-09-17T17:48:40.854174] [DEBUG] [VALIDATOR ] BRT: Primary data validation passed. [2025-09-17T17:48:40.854355] [INFO ] [MAIN ] BRT: Fetched primary data is valid. [2025-09-17T17:48:40.854400] [DEBUG] [LOCAL ] BRT: Saving primary data. [2025-09-17T17:48:40.854828] [DEBUG] [LOCAL ] BRT: Trimmed 6724 records to 4809 (keeping 200 days of data) [2025-09-17T17:48:40.883560] [DEBUG] [LOCAL ] BRT: Primary data saved (4809 records). [2025-09-17T17:48:40.883629] [INFO ] [MAIN ] BRT: Full history saved. [2025-09-17T17:48:40.883733] [INFO ] [MAIN ] Update Progress: 337/2371 symbols completed. BRT took 19.8s. Estimated remaining: 4h 53m 38s. Rate: 6.9 symbols/min [2025-09-17T17:48:41.051418] [INFO ] [MAIN ] BSAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:48:41.084684] [DEBUG] [LOCAL ] BSAC: Loaded 33089 existing records from primary storage. [2025-09-17T17:48:41.084846] [INFO ] [MAIN ] BSAC: Loaded 33089 existing records. [2025-09-17T17:48:41.228895] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-02. [2025-09-17T17:48:41.268349] [WARN ] [MAIN ] BSAC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:48:41.268672] [INFO ] [MAIN ] BSAC: Wiping existing primary data before full refresh. [2025-09-17T17:48:41.268722] [INFO ] [LOCAL ] BSAC: Starting deletion of primary data. [2025-09-17T17:48:41.269462] [DEBUG] [LOCAL ] BSAC: Deleted primary data file. [2025-09-17T17:48:41.269509] [INFO ] [MAIN ] BSAC: Starting full primary refresh. [2025-09-17T17:48:41.626195] [INFO ] [REMOTE ] BSAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:48:41.814074] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T17:48:42.015835] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-03. [2025-09-17T17:48:42.631839] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T17:48:42.815825] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-11. [2025-09-17T17:48:43.039924] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T17:48:43.615825] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-06. [2025-09-17T17:48:44.112220] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T17:48:44.415807] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-04. [2025-09-17T17:48:44.683483] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T17:48:45.215751] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-03. [2025-09-17T17:48:45.487597] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T17:48:46.015827] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-05. [2025-09-17T17:48:46.724418] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T17:48:46.815757] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-04. [2025-09-17T17:48:46.930514] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T17:48:47.615769] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-06. [2025-09-17T17:48:48.415798] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-07. [2025-09-17T17:48:48.555570] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T17:48:48.700798] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T17:48:49.215785] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2024-12. [2025-09-17T17:48:49.523856] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T17:48:50.015816] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-07. [2025-09-17T17:48:50.098289] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T17:48:50.815810] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-01. [2025-09-17T17:48:51.368389] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T17:48:51.512884] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T17:48:51.615796] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-08. [2025-09-17T17:48:52.415762] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-02. [2025-09-17T17:48:52.665614] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T17:48:53.215807] [INFO ] [REMOTE ] BRW: Fetching primary data for 2025-09. [2025-09-17T17:48:53.927867] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T17:48:54.015811] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-03. [2025-09-17T17:48:54.059660] [INFO ] [REMOTE ] BRW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T17:48:54.065130] [INFO ] [REMOTE ] BRW: Full fetch complete (29347 records). [2025-09-17T17:48:54.065227] [DEBUG] [VALIDATOR ] BRW: Validating primary data. [2025-09-17T17:48:54.481190] [DEBUG] [VALIDATOR ] BRW: All expected trading days are present. [2025-09-17T17:48:54.481273] [DEBUG] [VALIDATOR ] BRW: Primary data validation passed. [2025-09-17T17:48:54.481932] [INFO ] [MAIN ] BRW: Fetched primary data is valid. [2025-09-17T17:48:54.482008] [DEBUG] [LOCAL ] BRW: Saving primary data. [2025-09-17T17:48:54.482895] [DEBUG] [LOCAL ] BRW: Trimmed 29347 records to 19085 (keeping 200 days of data) [2025-09-17T17:48:54.609704] [DEBUG] [LOCAL ] BRW: Primary data saved (19085 records). [2025-09-17T17:48:54.609856] [INFO ] [MAIN ] BRW: Full history saved. [2025-09-17T17:48:54.609967] [INFO ] [MAIN ] Update Progress: 338/2371 symbols completed. BRW took 33.4s. Estimated remaining: 4h 53m 60s. Rate: 6.9 symbols/min [2025-09-17T17:48:54.792281] [INFO ] [MAIN ] BSBR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:48:54.815770] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-05. [2025-09-17T17:48:54.829381] [DEBUG] [LOCAL ] BSBR: Loaded 35023 existing records from primary storage. [2025-09-17T17:48:54.829512] [INFO ] [MAIN ] BSBR: Loaded 35023 existing records. [2025-09-17T17:48:55.014425] [WARN ] [MAIN ] BSBR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:48:55.014706] [INFO ] [MAIN ] BSBR: Wiping existing primary data before full refresh. [2025-09-17T17:48:55.014755] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-17T17:48:55.015471] [DEBUG] [LOCAL ] BSBR: Deleted primary data file. [2025-09-17T17:48:55.015520] [INFO ] [MAIN ] BSBR: Starting full primary refresh. [2025-09-17T17:48:55.383836] [INFO ] [REMOTE ] BSBR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:48:55.430309] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T17:48:55.615756] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-04. [2025-09-17T17:48:56.386703] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T17:48:56.415734] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-06. [2025-09-17T17:48:56.888794] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T17:48:57.215774] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-05. [2025-09-17T17:48:57.631592] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T17:48:58.015776] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-07. [2025-09-17T17:48:58.529697] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T17:48:58.815786] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-11. [2025-09-17T17:48:59.615720] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-08. [2025-09-17T17:48:59.674901] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T17:48:59.865823] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T17:49:00.415813] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2024-12. [2025-09-17T17:49:00.806782] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T17:49:01.215774] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-06. [2025-09-17T17:49:01.657803] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T17:49:02.015817] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-08. [2025-09-17T17:49:02.573183] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T17:49:02.815781] [INFO ] [REMOTE ] BRSP: Fetching primary data for 2025-09. [2025-09-17T17:49:03.449719] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T17:49:03.615759] [INFO ] [REMOTE ] BRX: Fetching primary data for 2025-09. [2025-09-17T17:49:03.753244] [INFO ] [REMOTE ] BRSP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T17:49:03.758154] [INFO ] [REMOTE ] BRSP: Full fetch complete (53764 records). [2025-09-17T17:49:03.758285] [DEBUG] [VALIDATOR ] BRSP: Validating primary data. [2025-09-17T17:49:04.143623] [DEBUG] [VALIDATOR ] BRSP: All expected trading days are present. [2025-09-17T17:49:04.143783] [DEBUG] [VALIDATOR ] BRSP: Primary data validation passed. [2025-09-17T17:49:04.145195] [INFO ] [MAIN ] BRSP: Fetched primary data is valid. [2025-09-17T17:49:04.145264] [DEBUG] [LOCAL ] BRSP: Saving primary data. [2025-09-17T17:49:04.146399] [DEBUG] [LOCAL ] BRSP: Trimmed 53764 records to 36975 (keeping 200 days of data) [2025-09-17T17:49:04.370009] [DEBUG] [LOCAL ] BRSP: Primary data saved (36975 records). [2025-09-17T17:49:04.370178] [INFO ] [MAIN ] BRSP: Full history saved. [2025-09-17T17:49:04.370276] [INFO ] [MAIN ] Update Progress: 339/2371 symbols completed. BRSP took 45.0s. Estimated remaining: 4h 53m 58s. Rate: 6.9 symbols/min [2025-09-17T17:49:04.426131] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-01. [2025-09-17T17:49:04.544221] [INFO ] [MAIN ] BSL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:49:04.554700] [DEBUG] [LOCAL ] BSL: Loaded 8201 existing records from primary storage. [2025-09-17T17:49:04.554804] [INFO ] [MAIN ] BSL: Loaded 8201 existing records. [2025-09-17T17:49:04.735913] [WARN ] [MAIN ] BSL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:49:04.736277] [INFO ] [MAIN ] BSL: Wiping existing primary data before full refresh. [2025-09-17T17:49:04.736326] [INFO ] [LOCAL ] BSL: Starting deletion of primary data. [2025-09-17T17:49:04.736825] [DEBUG] [LOCAL ] BSL: Deleted primary data file. [2025-09-17T17:49:04.736874] [INFO ] [MAIN ] BSL: Starting full primary refresh. [2025-09-17T17:49:05.103099] [INFO ] [REMOTE ] BSL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:49:05.215699] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-07. [2025-09-17T17:49:05.243108] [INFO ] [REMOTE ] BRX: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T17:49:05.249356] [INFO ] [REMOTE ] BRX: Full fetch complete (74452 records). [2025-09-17T17:49:05.249473] [DEBUG] [VALIDATOR ] BRX: Validating primary data. [2025-09-17T17:49:05.250352] [FATAL] [VALIDATOR ] BRX: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:49:05.250432] [FATAL] [MAIN ] BRX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:49:05.250468] [WARN ] [MAIN ] BRX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:49:05.250505] [INFO ] [LOCAL ] BRX: Starting deletion of primary data. [2025-09-17T17:49:05.250601] [DEBUG] [LOCAL ] BRX: No primary data file found to delete. [2025-09-17T17:49:05.250657] [INFO ] [LOCAL ] BRX: Starting deletion of derivative data. [2025-09-17T17:49:05.251003] [DEBUG] [LOCAL ] BRX: Deleted derivative data file. [2025-09-17T17:49:05.252139] [INFO ] [MAIN ] Update Progress: 340/2371 symbols completed. BRX took 40.6s. Estimated remaining: 4h 53m 2s. Rate: 6.9 symbols/min [2025-09-17T17:49:05.422050] [INFO ] [MAIN ] BSM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:49:05.460369] [DEBUG] [LOCAL ] BSM: Loaded 32621 existing records from primary storage. [2025-09-17T17:49:05.460502] [INFO ] [MAIN ] BSM: Loaded 32621 existing records. [2025-09-17T17:49:05.641011] [WARN ] [MAIN ] BSM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:49:05.641325] [INFO ] [MAIN ] BSM: Wiping existing primary data before full refresh. [2025-09-17T17:49:05.641389] [INFO ] [LOCAL ] BSM: Starting deletion of primary data. [2025-09-17T17:49:05.642217] [DEBUG] [LOCAL ] BSM: Deleted primary data file. [2025-09-17T17:49:05.642269] [INFO ] [MAIN ] BSM: Starting full primary refresh. [2025-09-17T17:49:06.047386] [INFO ] [REMOTE ] BSM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:49:06.036476] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-11. [2025-09-17T17:49:06.069735] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T17:49:06.334856] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T17:49:06.588586] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T17:49:06.815800] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-11. [2025-09-17T17:49:07.615829] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-02. [2025-09-17T17:49:08.287277] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T17:49:08.415825] [INFO ] [REMOTE ] BSL: Fetching primary data for 2024-12. [2025-09-17T17:49:09.024108] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T17:49:09.038378] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T17:49:09.215779] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-03. [2025-09-17T17:49:10.015824] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-08. [2025-09-17T17:49:10.549604] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T17:49:10.815773] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-04. [2025-09-17T17:49:11.294771] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T17:49:11.615779] [INFO ] [REMOTE ] BSAC: Fetching primary data for 2025-09. [2025-09-17T17:49:11.807593] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T17:49:12.415825] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-05. [2025-09-17T17:49:12.868261] [INFO ] [REMOTE ] BSAC: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T17:49:12.872681] [INFO ] [REMOTE ] BSAC: Full fetch complete (43414 records). [2025-09-17T17:49:12.872778] [DEBUG] [VALIDATOR ] BSAC: Validating primary data. [2025-09-17T17:49:13.216712] [INFO ] [REMOTE ] BSM: Fetching primary data for 2024-12. [2025-09-17T17:49:13.248845] [DEBUG] [VALIDATOR ] BSAC: All expected trading days are present. [2025-09-17T17:49:13.248988] [DEBUG] [VALIDATOR ] BSAC: Primary data validation passed. [2025-09-17T17:49:13.249538] [INFO ] [MAIN ] BSAC: Fetched primary data is valid. [2025-09-17T17:49:13.249581] [DEBUG] [LOCAL ] BSAC: Saving primary data. [2025-09-17T17:49:13.250735] [DEBUG] [LOCAL ] BSAC: Trimmed 43414 records to 33099 (keeping 200 days of data) [2025-09-17T17:49:13.462125] [DEBUG] [LOCAL ] BSAC: Primary data saved (33099 records). [2025-09-17T17:49:13.462291] [INFO ] [MAIN ] BSAC: Full history saved. [2025-09-17T17:49:13.462389] [INFO ] [MAIN ] Update Progress: 341/2371 symbols completed. BSAC took 32.6s. Estimated remaining: 4h 52m 51s. Rate: 6.9 symbols/min [2025-09-17T17:49:13.636627] [INFO ] [MAIN ] BST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:49:13.656298] [DEBUG] [LOCAL ] BST: Loaded 19513 existing records from primary storage. [2025-09-17T17:49:13.656439] [INFO ] [MAIN ] BST: Loaded 19513 existing records. [2025-09-17T17:49:13.844474] [WARN ] [MAIN ] BST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:49:13.844961] [INFO ] [MAIN ] BST: Wiping existing primary data before full refresh. [2025-09-17T17:49:13.845092] [INFO ] [LOCAL ] BST: Starting deletion of primary data. [2025-09-17T17:49:13.852721] [DEBUG] [LOCAL ] BST: Deleted primary data file. [2025-09-17T17:49:13.867220] [INFO ] [MAIN ] BST: Starting full primary refresh. [2025-09-17T17:49:13.932058] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T17:49:14.031811] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-06. [2025-09-17T17:49:14.266190] [INFO ] [REMOTE ] BST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:49:14.815789] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-11. [2025-09-17T17:49:14.853517] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T17:49:15.485064] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T17:49:15.615774] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-01. [2025-09-17T17:49:16.141279] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T17:49:16.415795] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-07. [2025-09-17T17:49:16.842877] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T17:49:17.215775] [INFO ] [REMOTE ] BST: Fetching primary data for 2024-12. [2025-09-17T17:49:18.015713] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-02. [2025-09-17T17:49:18.041558] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T17:49:18.101131] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T17:49:18.815783] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-08. [2025-09-17T17:49:19.441943] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T17:49:19.615817] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-03. [2025-09-17T17:49:20.229885] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T17:49:20.415820] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-01. [2025-09-17T17:49:20.745583] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T17:49:21.215782] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-04. [2025-09-17T17:49:21.333081] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T17:49:22.015830] [INFO ] [REMOTE ] BSBR: Fetching primary data for 2025-09. [2025-09-17T17:49:22.607436] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T17:49:22.815867] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-05. [2025-09-17T17:49:23.481751] [INFO ] [REMOTE ] BSBR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T17:49:23.486473] [INFO ] [REMOTE ] BSBR: Full fetch complete (50247 records). [2025-09-17T17:49:23.486569] [DEBUG] [VALIDATOR ] BSBR: Validating primary data. [2025-09-17T17:49:23.487278] [FATAL] [VALIDATOR ] BSBR: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:49:23.487391] [FATAL] [MAIN ] BSBR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:49:23.487430] [WARN ] [MAIN ] BSBR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:49:23.487468] [INFO ] [LOCAL ] BSBR: Starting deletion of primary data. [2025-09-17T17:49:23.487541] [DEBUG] [LOCAL ] BSBR: No primary data file found to delete. [2025-09-17T17:49:23.487582] [INFO ] [LOCAL ] BSBR: Starting deletion of derivative data. [2025-09-17T17:49:23.487952] [DEBUG] [LOCAL ] BSBR: Deleted derivative data file. [2025-09-17T17:49:23.489815] [INFO ] [MAIN ] Update Progress: 342/2371 symbols completed. BSBR took 28.9s. Estimated remaining: 4h 52m 50s. Rate: 6.9 symbols/min [2025-09-17T17:49:23.631697] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-01. [2025-09-17T17:49:23.663180] [INFO ] [MAIN ] BSTZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:49:23.689113] [DEBUG] [LOCAL ] BSTZ: Loaded 25114 existing records from primary storage. [2025-09-17T17:49:23.689257] [INFO ] [MAIN ] BSTZ: Loaded 25114 existing records. [2025-09-17T17:49:23.868168] [WARN ] [MAIN ] BSTZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:49:23.868443] [INFO ] [MAIN ] BSTZ: Wiping existing primary data before full refresh. [2025-09-17T17:49:23.868490] [INFO ] [LOCAL ] BSTZ: Starting deletion of primary data. [2025-09-17T17:49:23.869191] [DEBUG] [LOCAL ] BSTZ: Deleted primary data file. [2025-09-17T17:49:23.869243] [INFO ] [MAIN ] BSTZ: Starting full primary refresh. [2025-09-17T17:49:24.235596] [INFO ] [REMOTE ] BSTZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:49:24.260536] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T17:49:24.415782] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-11. [2025-09-17T17:49:24.499880] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T17:49:25.215824] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-02. [2025-09-17T17:49:25.655135] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T17:49:26.015840] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-06. [2025-09-17T17:49:26.075418] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T17:49:26.815909] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-03. [2025-09-17T17:49:27.331027] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T17:49:27.347332] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T17:49:27.615853] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-02. [2025-09-17T17:49:28.415828] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-07. [2025-09-17T17:49:28.909442] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T17:49:29.215802] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-03. [2025-09-17T17:49:29.989807] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T17:49:30.015675] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2024-12. [2025-09-17T17:49:30.334746] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T17:49:30.815805] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-04. [2025-09-17T17:49:31.306243] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T17:49:31.449807] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T17:49:31.615797] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-04. [2025-09-17T17:49:32.376592] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T17:49:32.415777] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-05. [2025-09-17T17:49:33.215785] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-01. [2025-09-17T17:49:33.504045] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T17:49:34.015761] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-08. [2025-09-17T17:49:34.166806] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T17:49:34.815777] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-02. [2025-09-17T17:49:35.417574] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T17:49:35.615782] [INFO ] [REMOTE ] BSM: Fetching primary data for 2025-09. [2025-09-17T17:49:36.058275] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T17:49:36.415783] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-06. [2025-09-17T17:49:36.665096] [INFO ] [REMOTE ] BSM: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T17:49:36.670126] [INFO ] [REMOTE ] BSM: Full fetch complete (47646 records). [2025-09-17T17:49:36.670304] [DEBUG] [VALIDATOR ] BSM: Validating primary data. [2025-09-17T17:49:37.059307] [DEBUG] [VALIDATOR ] BSM: All expected trading days are present. [2025-09-17T17:49:37.059413] [DEBUG] [VALIDATOR ] BSM: Primary data validation passed. [2025-09-17T17:49:37.060157] [INFO ] [MAIN ] BSM: Fetched primary data is valid. [2025-09-17T17:49:37.060237] [DEBUG] [LOCAL ] BSM: Saving primary data. [2025-09-17T17:49:37.061397] [DEBUG] [LOCAL ] BSM: Trimmed 47646 records to 32599 (keeping 200 days of data) [2025-09-17T17:49:37.227172] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-03. [2025-09-17T17:49:37.274999] [DEBUG] [LOCAL ] BSM: Primary data saved (32599 records). [2025-09-17T17:49:37.275168] [INFO ] [MAIN ] BSM: Full history saved. [2025-09-17T17:49:37.275329] [INFO ] [MAIN ] Update Progress: 343/2371 symbols completed. BSM took 32.0s. Estimated remaining: 4h 53m 12s. Rate: 6.9 symbols/min [2025-09-17T17:49:37.451403] [INFO ] [MAIN ] BSX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:49:37.470363] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T17:49:37.519429] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-17T17:49:37.519600] [INFO ] [MAIN ] BSX: Loaded 53688 existing records. [2025-09-17T17:49:37.709463] [WARN ] [MAIN ] BSX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:49:37.709768] [INFO ] [MAIN ] BSX: Wiping existing primary data before full refresh. [2025-09-17T17:49:37.709839] [INFO ] [LOCAL ] BSX: Starting deletion of primary data. [2025-09-17T17:49:37.711121] [DEBUG] [LOCAL ] BSX: Deleted primary data file. [2025-09-17T17:49:37.711186] [INFO ] [MAIN ] BSX: Starting full primary refresh. [2025-09-17T17:49:38.020966] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-05. [2025-09-17T17:49:38.091502] [INFO ] [REMOTE ] BSX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:49:38.525134] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T17:49:38.788937] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T17:49:38.815733] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-07. [2025-09-17T17:49:39.615802] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-06. [2025-09-17T17:49:39.985240] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T17:49:40.249271] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T17:49:40.415788] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-07. [2025-09-17T17:49:41.220960] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-11. [2025-09-17T17:49:41.223613] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T17:49:42.015780] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-08. [2025-09-17T17:49:42.697448] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T17:49:42.815801] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-04. [2025-09-17T17:49:43.029382] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T17:49:43.615770] [INFO ] [REMOTE ] BSL: Fetching primary data for 2025-09. [2025-09-17T17:49:43.730936] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T17:49:44.339252] [INFO ] [REMOTE ] BSL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T17:49:44.340708] [INFO ] [REMOTE ] BSL: Full fetch complete (12501 records). [2025-09-17T17:49:44.340778] [DEBUG] [VALIDATOR ] BSL: Validating primary data. [2025-09-17T17:49:44.420834] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-08. [2025-09-17T17:49:44.711045] [DEBUG] [VALIDATOR ] BSL: All expected trading days are present. [2025-09-17T17:49:44.711184] [DEBUG] [VALIDATOR ] BSL: Primary data validation passed. [2025-09-17T17:49:44.711476] [INFO ] [MAIN ] BSL: Fetched primary data is valid. [2025-09-17T17:49:44.711514] [DEBUG] [LOCAL ] BSL: Saving primary data. [2025-09-17T17:49:44.712032] [DEBUG] [LOCAL ] BSL: Trimmed 12501 records to 7950 (keeping 200 days of data) [2025-09-17T17:49:44.764512] [DEBUG] [LOCAL ] BSL: Primary data saved (7950 records). [2025-09-17T17:49:44.764669] [INFO ] [MAIN ] BSL: Full history saved. [2025-09-17T17:49:44.764770] [INFO ] [MAIN ] Update Progress: 344/2371 symbols completed. BSL took 40.4s. Estimated remaining: 4h 52m 56s. Rate: 6.9 symbols/min [2025-09-17T17:49:44.934070] [INFO ] [MAIN ] BTA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:49:44.942570] [DEBUG] [LOCAL ] BTA: Loaded 5233 existing records from primary storage. [2025-09-17T17:49:44.942725] [INFO ] [MAIN ] BTA: Loaded 5233 existing records. [2025-09-17T17:49:45.132959] [WARN ] [MAIN ] BTA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:49:45.133184] [INFO ] [MAIN ] BTA: Wiping existing primary data before full refresh. [2025-09-17T17:49:45.133228] [INFO ] [LOCAL ] BTA: Starting deletion of primary data. [2025-09-17T17:49:45.133468] [DEBUG] [LOCAL ] BTA: Deleted primary data file. [2025-09-17T17:49:45.133522] [INFO ] [MAIN ] BTA: Starting full primary refresh. [2025-09-17T17:49:45.220945] [INFO ] [REMOTE ] BSX: Fetching primary data for 2024-12. [2025-09-17T17:49:45.518834] [INFO ] [REMOTE ] BTA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:49:45.539791] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T17:49:46.015814] [INFO ] [REMOTE ] BST: Fetching primary data for 2025-09. [2025-09-17T17:49:46.815829] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-11. [2025-09-17T17:49:46.929523] [INFO ] [REMOTE ] BST: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T17:49:46.933585] [INFO ] [REMOTE ] BST: Full fetch complete (28726 records). [2025-09-17T17:49:46.934002] [DEBUG] [VALIDATOR ] BST: Validating primary data. [2025-09-17T17:49:47.087622] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T17:49:47.358372] [DEBUG] [VALIDATOR ] BST: All expected trading days are present. [2025-09-17T17:49:47.358476] [DEBUG] [VALIDATOR ] BST: Primary data validation passed. [2025-09-17T17:49:47.359076] [INFO ] [MAIN ] BST: Fetched primary data is valid. [2025-09-17T17:49:47.359126] [DEBUG] [LOCAL ] BST: Saving primary data. [2025-09-17T17:49:47.360257] [DEBUG] [LOCAL ] BST: Trimmed 28726 records to 19479 (keeping 200 days of data) [2025-09-17T17:49:47.464893] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T17:49:47.509087] [DEBUG] [LOCAL ] BST: Primary data saved (19479 records). [2025-09-17T17:49:47.509242] [INFO ] [MAIN ] BST: Full history saved. [2025-09-17T17:49:47.509342] [INFO ] [MAIN ] Update Progress: 345/2371 symbols completed. BST took 34.0s. Estimated remaining: 4h 52m 13s. Rate: 6.9 symbols/min [2025-09-17T17:49:47.621028] [INFO ] [REMOTE ] BTA: Fetching primary data for 2024-12. [2025-09-17T17:49:47.697413] [INFO ] [MAIN ] BTCM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:49:47.712409] [DEBUG] [LOCAL ] BTCM: Loaded 14034 existing records from primary storage. [2025-09-17T17:49:47.712542] [INFO ] [MAIN ] BTCM: Loaded 14034 existing records. [2025-09-17T17:49:47.889983] [WARN ] [MAIN ] BTCM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:49:47.890268] [INFO ] [MAIN ] BTCM: Wiping existing primary data before full refresh. [2025-09-17T17:49:47.890313] [INFO ] [LOCAL ] BTCM: Starting deletion of primary data. [2025-09-17T17:49:47.890852] [DEBUG] [LOCAL ] BTCM: Deleted primary data file. [2025-09-17T17:49:47.890903] [INFO ] [MAIN ] BTCM: Starting full primary refresh. [2025-09-17T17:49:48.254885] [INFO ] [REMOTE ] BTCM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:49:48.415797] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-11. [2025-09-17T17:49:48.440434] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T17:49:49.215747] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-01. [2025-09-17T17:49:49.620602] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T17:49:50.004982] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T17:49:50.015677] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-02. [2025-09-17T17:49:50.808955] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T17:49:50.815704] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-03. [2025-09-17T17:49:51.388867] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T17:49:51.615834] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-04. [2025-09-17T17:49:52.269540] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-17T17:49:52.415803] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-01. [2025-09-17T17:49:53.215795] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-05. [2025-09-17T17:49:54.015779] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-05. [2025-09-17T17:49:54.371183] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T17:49:54.398242] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T17:49:54.627483] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T17:49:54.815794] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2024-12. [2025-09-17T17:49:55.565629] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T17:49:55.615787] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-06. [2025-09-17T17:49:56.174811] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T17:49:56.415820] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-01. [2025-09-17T17:49:57.208808] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T17:49:57.215669] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-02. [2025-09-17T17:49:57.938099] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T17:49:58.015804] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-02. [2025-09-17T17:49:58.815859] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-03. [2025-09-17T17:49:59.560095] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T17:49:59.615827] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-04. [2025-09-17T17:49:59.861843] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T17:50:00.039105] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T17:50:00.415809] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-05. [2025-09-17T17:50:01.215862] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-06. [2025-09-17T17:50:01.227622] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T17:50:02.015793] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-06. [2025-09-17T17:50:02.068199] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T17:50:02.728412] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T17:50:02.815842] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-07. [2025-09-17T17:50:03.615786] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-07. [2025-09-17T17:50:04.083229] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T17:50:04.415771] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-08. [2025-09-17T17:50:05.215799] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-03. [2025-09-17T17:50:05.387672] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T17:50:05.490111] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T17:50:06.015808] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-08. [2025-09-17T17:50:06.815843] [INFO ] [REMOTE ] BSTZ: Fetching primary data for 2025-09. [2025-09-17T17:50:07.053883] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T17:50:07.108356] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T17:50:07.615790] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-04. [2025-09-17T17:50:07.933473] [INFO ] [REMOTE ] BSTZ: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T17:50:07.937091] [INFO ] [REMOTE ] BSTZ: Full fetch complete (36738 records). [2025-09-17T17:50:07.937275] [DEBUG] [VALIDATOR ] BSTZ: Validating primary data. [2025-09-17T17:50:08.330287] [DEBUG] [VALIDATOR ] BSTZ: All expected trading days are present. [2025-09-17T17:50:08.330372] [DEBUG] [VALIDATOR ] BSTZ: Primary data validation passed. [2025-09-17T17:50:08.330911] [INFO ] [MAIN ] BSTZ: Fetched primary data is valid. [2025-09-17T17:50:08.330958] [DEBUG] [LOCAL ] BSTZ: Saving primary data. [2025-09-17T17:50:08.331925] [DEBUG] [LOCAL ] BSTZ: Trimmed 36738 records to 25095 (keeping 200 days of data) [2025-09-17T17:50:08.428984] [INFO ] [REMOTE ] BTCM: Fetching primary data for 2025-09. [2025-09-17T17:50:08.500863] [DEBUG] [LOCAL ] BSTZ: Primary data saved (25095 records). [2025-09-17T17:50:08.501010] [INFO ] [MAIN ] BSTZ: Full history saved. [2025-09-17T17:50:08.501144] [INFO ] [MAIN ] Update Progress: 346/2371 symbols completed. BSTZ took 45.0s. Estimated remaining: 4h 53m 16s. Rate: 6.9 symbols/min [2025-09-17T17:50:08.677320] [INFO ] [MAIN ] BTE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:50:08.734927] [DEBUG] [LOCAL ] BTE: Loaded 52758 existing records from primary storage. [2025-09-17T17:50:08.735115] [INFO ] [MAIN ] BTE: Loaded 52758 existing records. [2025-09-17T17:50:08.919384] [WARN ] [MAIN ] BTE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:50:08.919698] [INFO ] [MAIN ] BTE: Wiping existing primary data before full refresh. [2025-09-17T17:50:08.919766] [INFO ] [LOCAL ] BTE: Starting deletion of primary data. [2025-09-17T17:50:08.920958] [DEBUG] [LOCAL ] BTE: Deleted primary data file. [2025-09-17T17:50:08.921023] [INFO ] [MAIN ] BTE: Starting full primary refresh. [2025-09-17T17:50:09.220902] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-07. [2025-09-17T17:50:09.294522] [INFO ] [REMOTE ] BTE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:50:09.606503] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T17:50:09.796155] [INFO ] [REMOTE ] BTCM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T17:50:09.803255] [INFO ] [REMOTE ] BTCM: Full fetch complete (19294 records). [2025-09-17T17:50:09.804054] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T17:50:09.803853] [DEBUG] [VALIDATOR ] BTCM: Validating primary data. [2025-09-17T17:50:10.025141] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-11. [2025-09-17T17:50:10.179442] [DEBUG] [VALIDATOR ] BTCM: All expected trading days are present. [2025-09-17T17:50:10.179517] [DEBUG] [VALIDATOR ] BTCM: Primary data validation passed. [2025-09-17T17:50:10.179898] [INFO ] [MAIN ] BTCM: Fetched primary data is valid. [2025-09-17T17:50:10.179940] [DEBUG] [LOCAL ] BTCM: Saving primary data. [2025-09-17T17:50:10.180493] [DEBUG] [LOCAL ] BTCM: Trimmed 19294 records to 14125 (keeping 200 days of data) [2025-09-17T17:50:10.261756] [DEBUG] [LOCAL ] BTCM: Primary data saved (14125 records). [2025-09-17T17:50:10.261889] [INFO ] [MAIN ] BTCM: Full history saved. [2025-09-17T17:50:10.261971] [INFO ] [MAIN ] Update Progress: 347/2371 symbols completed. BTCM took 22.8s. Estimated remaining: 4h 52m 27s. Rate: 6.9 symbols/min [2025-09-17T17:50:10.431412] [INFO ] [MAIN ] BTI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:50:10.481336] [DEBUG] [LOCAL ] BTI: Loaded 53552 existing records from primary storage. [2025-09-17T17:50:10.481482] [INFO ] [MAIN ] BTI: Loaded 53552 existing records. [2025-09-17T17:50:10.700915] [WARN ] [MAIN ] BTI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:50:10.701196] [INFO ] [MAIN ] BTI: Wiping existing primary data before full refresh. [2025-09-17T17:50:10.701245] [INFO ] [LOCAL ] BTI: Starting deletion of primary data. [2025-09-17T17:50:10.702425] [DEBUG] [LOCAL ] BTI: Deleted primary data file. [2025-09-17T17:50:10.702486] [INFO ] [MAIN ] BTI: Starting full primary refresh. [2025-09-17T17:50:10.820866] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-08. [2025-09-17T17:50:11.075486] [INFO ] [REMOTE ] BTI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:50:11.509938] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T17:50:11.615748] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-11. [2025-09-17T17:50:12.415798] [INFO ] [REMOTE ] BTA: Fetching primary data for 2025-09. [2025-09-17T17:50:12.966437] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-11 (2.94 seconds). [2025-09-17T17:50:13.215746] [INFO ] [REMOTE ] BTE: Fetching primary data for 2024-12. [2025-09-17T17:50:13.267702] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T17:50:13.402694] [INFO ] [REMOTE ] BTA: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T17:50:13.404121] [INFO ] [REMOTE ] BTA: Full fetch complete (9560 records). [2025-09-17T17:50:13.404192] [DEBUG] [VALIDATOR ] BTA: Validating primary data. [2025-09-17T17:50:13.771763] [DEBUG] [VALIDATOR ] BTA: All expected trading days are present. [2025-09-17T17:50:13.771842] [DEBUG] [VALIDATOR ] BTA: Primary data validation passed. [2025-09-17T17:50:13.772076] [INFO ] [MAIN ] BTA: Fetched primary data is valid. [2025-09-17T17:50:13.772117] [DEBUG] [LOCAL ] BTA: Saving primary data. [2025-09-17T17:50:13.772547] [DEBUG] [LOCAL ] BTA: Trimmed 9560 records to 5311 (keeping 200 days of data) [2025-09-17T17:50:13.805784] [DEBUG] [LOCAL ] BTA: Primary data saved (5311 records). [2025-09-17T17:50:13.805886] [INFO ] [MAIN ] BTA: Full history saved. [2025-09-17T17:50:13.805964] [INFO ] [MAIN ] Update Progress: 348/2371 symbols completed. BTA took 29.0s. Estimated remaining: 4h 51m 49s. Rate: 6.9 symbols/min [2025-09-17T17:50:13.979849] [INFO ] [MAIN ] BTO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:50:13.989998] [DEBUG] [LOCAL ] BTO: Loaded 9032 existing records from primary storage. [2025-09-17T17:50:13.990102] [INFO ] [MAIN ] BTO: Loaded 9032 existing records. [2025-09-17T17:50:14.022151] [INFO ] [REMOTE ] BTI: Fetching primary data for 2024-12. [2025-09-17T17:50:14.176459] [WARN ] [MAIN ] BTO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:50:14.176708] [INFO ] [MAIN ] BTO: Wiping existing primary data before full refresh. [2025-09-17T17:50:14.176770] [INFO ] [LOCAL ] BTO: Starting deletion of primary data. [2025-09-17T17:50:14.177099] [DEBUG] [LOCAL ] BTO: Deleted primary data file. [2025-09-17T17:50:14.177143] [INFO ] [MAIN ] BTO: Starting full primary refresh. [2025-09-17T17:50:14.545608] [INFO ] [REMOTE ] BTO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:50:14.815736] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-11. [2025-09-17T17:50:14.958871] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T17:50:15.592058] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T17:50:15.615737] [INFO ] [REMOTE ] BTO: Fetching primary data for 2024-12. [2025-09-17T17:50:15.979613] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T17:50:16.382385] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T17:50:16.415718] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-01. [2025-09-17T17:50:17.215771] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-05. [2025-09-17T17:50:17.243516] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T17:50:18.015771] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-01. [2025-09-17T17:50:18.815773] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-01. [2025-09-17T17:50:18.866546] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T17:50:19.615765] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-06. [2025-09-17T17:50:19.705348] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T17:50:20.415831] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-02. [2025-09-17T17:50:20.788049] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T17:50:21.177369] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T17:50:21.215782] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-02. [2025-09-17T17:50:21.261865] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:50:22.015800] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-02. [2025-09-17T17:50:22.815803] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-07. [2025-09-17T17:50:23.306183] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-17T17:50:23.385475] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T17:50:23.615823] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-03. [2025-09-17T17:50:24.415801] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-03. [2025-09-17T17:50:24.488554] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T17:50:24.992067] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T17:50:25.215791] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-08. [2025-09-17T17:50:26.015804] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-04. [2025-09-17T17:50:26.244992] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T17:50:26.815845] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-04. [2025-09-17T17:50:27.143792] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T17:50:27.625822] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-03. [2025-09-17T17:50:27.631391] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T17:50:28.415746] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-05. [2025-09-17T17:50:28.509159] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T17:50:28.933855] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T17:50:29.215785] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-04. [2025-09-17T17:50:30.015722] [INFO ] [REMOTE ] BSX: Fetching primary data for 2025-09. [2025-09-17T17:50:30.036488] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T17:50:30.169526] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T17:50:30.815782] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-05. [2025-09-17T17:50:31.615776] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-06. [2025-09-17T17:50:32.197424] [INFO ] [REMOTE ] BSX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-17T17:50:32.204303] [INFO ] [REMOTE ] BSX: Full fetch complete (77525 records). [2025-09-17T17:50:32.204449] [DEBUG] [VALIDATOR ] BSX: Validating primary data. [2025-09-17T17:50:32.432323] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-05. [2025-09-17T17:50:32.597959] [DEBUG] [VALIDATOR ] BSX: All expected trading days are present. [2025-09-17T17:50:32.598038] [DEBUG] [VALIDATOR ] BSX: Primary data validation passed. [2025-09-17T17:50:32.598858] [INFO ] [MAIN ] BSX: Fetched primary data is valid. [2025-09-17T17:50:32.598904] [DEBUG] [LOCAL ] BSX: Saving primary data. [2025-09-17T17:50:32.600320] [DEBUG] [LOCAL ] BSX: Trimmed 77525 records to 53688 (keeping 200 days of data) [2025-09-17T17:50:32.951546] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T17:50:33.001958] [DEBUG] [LOCAL ] BSX: Primary data saved (53688 records). [2025-09-17T17:50:33.002141] [INFO ] [MAIN ] BSX: Full history saved. [2025-09-17T17:50:33.002906] [INFO ] [MAIN ] Update Progress: 349/2371 symbols completed. BSX took 55.7s. Estimated remaining: 4h 52m 41s. Rate: 6.9 symbols/min [2025-09-17T17:50:33.011352] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T17:50:33.191502] [INFO ] [MAIN ] BTT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:50:33.209657] [DEBUG] [LOCAL ] BTT: Loaded 16117 existing records from primary storage. [2025-09-17T17:50:33.209787] [INFO ] [MAIN ] BTT: Loaded 16117 existing records. [2025-09-17T17:50:33.220899] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-07. [2025-09-17T17:50:33.359007] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-17T17:50:33.402970] [WARN ] [MAIN ] BTT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:50:33.403228] [INFO ] [MAIN ] BTT: Wiping existing primary data before full refresh. [2025-09-17T17:50:33.403276] [INFO ] [LOCAL ] BTT: Starting deletion of primary data. [2025-09-17T17:50:33.403719] [DEBUG] [LOCAL ] BTT: Deleted primary data file. [2025-09-17T17:50:33.403771] [INFO ] [MAIN ] BTT: Starting full primary refresh. [2025-09-17T17:50:33.760138] [INFO ] [REMOTE ] BTT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:50:34.015795] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-11. [2025-09-17T17:50:34.815832] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-06. [2025-09-17T17:50:35.200169] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T17:50:35.615754] [INFO ] [REMOTE ] BTT: Fetching primary data for 2024-12. [2025-09-17T17:50:35.904211] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-17T17:50:36.415844] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-08. [2025-09-17T17:50:36.968064] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-17T17:50:37.145689] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T17:50:37.215815] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-01. [2025-09-17T17:50:38.015896] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-07. [2025-09-17T17:50:38.224382] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T17:50:38.330756] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T17:50:38.815851] [INFO ] [REMOTE ] BTE: Fetching primary data for 2025-09. [2025-09-17T17:50:39.615839] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-06. [2025-09-17T17:50:40.342888] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-17T17:50:40.371680] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T17:50:40.415776] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-07. [2025-09-17T17:50:40.554570] [INFO ] [REMOTE ] BTE: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T17:50:40.561485] [INFO ] [REMOTE ] BTE: Full fetch complete (75806 records). [2025-09-17T17:50:40.561673] [DEBUG] [VALIDATOR ] BTE: Validating primary data. [2025-09-17T17:50:40.952678] [DEBUG] [VALIDATOR ] BTE: All expected trading days are present. [2025-09-17T17:50:40.952819] [DEBUG] [VALIDATOR ] BTE: Primary data validation passed. [2025-09-17T17:50:40.953749] [INFO ] [MAIN ] BTE: Fetched primary data is valid. [2025-09-17T17:50:40.953849] [DEBUG] [LOCAL ] BTE: Saving primary data. [2025-09-17T17:50:40.960107] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-17T17:50:40.963236] [DEBUG] [LOCAL ] BTE: Trimmed 75806 records to 52762 (keeping 200 days of data) [2025-09-17T17:50:41.239994] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-08. [2025-09-17T17:50:41.286477] [DEBUG] [LOCAL ] BTE: Primary data saved (52762 records). [2025-09-17T17:50:41.286613] [INFO ] [MAIN ] BTE: Full history saved. [2025-09-17T17:50:41.287162] [INFO ] [MAIN ] Update Progress: 350/2371 symbols completed. BTE took 32.8s. Estimated remaining: 4h 52m 30s. Rate: 6.9 symbols/min [2025-09-17T17:50:41.454817] [INFO ] [MAIN ] BTU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:50:41.509671] [DEBUG] [LOCAL ] BTU: Loaded 53303 existing records from primary storage. [2025-09-17T17:50:41.509877] [INFO ] [MAIN ] BTU: Loaded 53303 existing records. [2025-09-17T17:50:41.689082] [WARN ] [MAIN ] BTU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:50:41.689390] [INFO ] [MAIN ] BTU: Wiping existing primary data before full refresh. [2025-09-17T17:50:41.689440] [INFO ] [LOCAL ] BTU: Starting deletion of primary data. [2025-09-17T17:50:41.690375] [DEBUG] [LOCAL ] BTU: Deleted primary data file. [2025-09-17T17:50:41.690425] [INFO ] [MAIN ] BTU: Starting full primary refresh. [2025-09-17T17:50:42.021319] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-02. [2025-09-17T17:50:42.051184] [INFO ] [REMOTE ] BTU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:50:42.057757] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T17:50:42.815815] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-11. [2025-09-17T17:50:42.989590] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T17:50:43.615805] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-03. [2025-09-17T17:50:44.415816] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-08. [2025-09-17T17:50:44.571483] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T17:50:44.647566] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T17:50:45.215788] [INFO ] [REMOTE ] BTO: Fetching primary data for 2025-09. [2025-09-17T17:50:46.003528] [INFO ] [REMOTE ] BTO: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T17:50:46.005230] [INFO ] [REMOTE ] BTO: Full fetch complete (13317 records). [2025-09-17T17:50:46.005301] [DEBUG] [VALIDATOR ] BTO: Validating primary data. [2025-09-17T17:50:46.025845] [INFO ] [REMOTE ] BTU: Fetching primary data for 2024-12. [2025-09-17T17:50:46.371738] [DEBUG] [VALIDATOR ] BTO: All expected trading days are present. [2025-09-17T17:50:46.371841] [DEBUG] [VALIDATOR ] BTO: Primary data validation passed. [2025-09-17T17:50:46.372182] [INFO ] [MAIN ] BTO: Fetched primary data is valid. [2025-09-17T17:50:46.372236] [DEBUG] [LOCAL ] BTO: Saving primary data. [2025-09-17T17:50:46.372880] [DEBUG] [LOCAL ] BTO: Trimmed 13317 records to 9038 (keeping 200 days of data) [2025-09-17T17:50:46.432327] [DEBUG] [LOCAL ] BTO: Primary data saved (9038 records). [2025-09-17T17:50:46.432513] [INFO ] [MAIN ] BTO: Full history saved. [2025-09-17T17:50:46.432632] [INFO ] [MAIN ] Update Progress: 351/2371 symbols completed. BTO took 32.6s. Estimated remaining: 4h 52m 1s. Rate: 6.9 symbols/min [2025-09-17T17:50:46.605442] [INFO ] [MAIN ] BTX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:50:46.638939] [DEBUG] [LOCAL ] BTX: No existing data file found in primary storage. [2025-09-17T17:50:46.639126] [WARN ] [MAIN ] BTX: No existing data found, performing full refresh instead. [2025-09-17T17:50:46.641680] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-17T17:50:46.639915] [INFO ] [MAIN ] BTX: Wiping existing primary data before full refresh. [2025-09-17T17:50:46.641818] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-17T17:50:46.652928] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-17T17:50:46.653022] [INFO ] [MAIN ] BTX: Starting full primary refresh. [2025-09-17T17:50:46.829674] [INFO ] [REMOTE ] BTI: Fetching primary data for 2025-09. [2025-09-17T17:50:47.013018] [INFO ] [REMOTE ] BTX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:50:47.615793] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-11. [2025-09-17T17:50:47.831341] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:50:47.833418] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T17:50:47.833504] [WARN ] [REMOTE ] BTX: No data returned for month 2024-11 [2025-09-17T17:50:48.415791] [INFO ] [REMOTE ] BTX: Fetching primary data for 2024-12. [2025-09-17T17:50:48.637496] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:50:48.638016] [WARN ] [REMOTE ] BTX: No data returned for month 2024-12 [2025-09-17T17:50:49.049130] [INFO ] [REMOTE ] BTI: Incremental fetch complete for 2025-09 (2.22 seconds). [2025-09-17T17:50:49.056099] [INFO ] [REMOTE ] BTI: Full fetch complete (77266 records). [2025-09-17T17:50:49.056238] [DEBUG] [VALIDATOR ] BTI: Validating primary data. [2025-09-17T17:50:49.221226] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-01. [2025-09-17T17:50:49.466487] [DEBUG] [VALIDATOR ] BTI: All expected trading days are present. [2025-09-17T17:50:49.466582] [DEBUG] [VALIDATOR ] BTI: Primary data validation passed. [2025-09-17T17:50:49.467717] [INFO ] [MAIN ] BTI: Fetched primary data is valid. [2025-09-17T17:50:49.467799] [DEBUG] [LOCAL ] BTI: Saving primary data. [2025-09-17T17:50:49.469425] [DEBUG] [LOCAL ] BTI: Trimmed 77266 records to 53553 (keeping 200 days of data) [2025-09-17T17:50:49.529475] [DEBUG] [REMOTE ] BTX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:50:49.538617] [WARN ] [REMOTE ] BTX: No data returned for month 2025-01 [2025-09-17T17:50:49.819369] [DEBUG] [LOCAL ] BTI: Primary data saved (53553 records). [2025-09-17T17:50:49.819540] [INFO ] [MAIN ] BTI: Full history saved. [2025-09-17T17:50:49.819678] [INFO ] [MAIN ] Update Progress: 352/2371 symbols completed. BTI took 39.6s. Estimated remaining: 4h 51m 22s. Rate: 6.9 symbols/min [2025-09-17T17:50:49.993952] [INFO ] [MAIN ] BTZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:50:50.015785] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-04. [2025-09-17T17:50:50.016290] [DEBUG] [LOCAL ] BTZ: Loaded 23121 existing records from primary storage. [2025-09-17T17:50:50.017427] [INFO ] [MAIN ] BTZ: Loaded 23121 existing records. [2025-09-17T17:50:50.197381] [WARN ] [MAIN ] BTZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:50:50.197696] [INFO ] [MAIN ] BTZ: Wiping existing primary data before full refresh. [2025-09-17T17:50:50.197764] [INFO ] [LOCAL ] BTZ: Starting deletion of primary data. [2025-09-17T17:50:50.198286] [DEBUG] [LOCAL ] BTZ: Deleted primary data file. [2025-09-17T17:50:50.198340] [INFO ] [MAIN ] BTZ: Starting full primary refresh. [2025-09-17T17:50:50.555417] [INFO ] [REMOTE ] BTZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:50:50.815799] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-11. [2025-09-17T17:50:51.271330] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T17:50:51.615791] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-02. [2025-09-17T17:50:51.664181] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T17:50:52.415796] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-05. [2025-09-17T17:50:52.546961] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T17:50:53.129978] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T17:50:53.215789] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-06. [2025-09-17T17:50:54.015783] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-01. [2025-09-17T17:50:54.176297] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T17:50:54.815857] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2024-12. [2025-09-17T17:50:55.615799] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-03. [2025-09-17T17:50:55.850617] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T17:50:56.031985] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T17:50:56.415780] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-01. [2025-09-17T17:50:57.047252] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T17:50:57.215709] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-02. [2025-09-17T17:50:57.544831] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T17:50:58.015793] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-02. [2025-09-17T17:50:58.689713] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T17:50:58.815745] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-03. [2025-09-17T17:50:59.070797] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T17:50:59.615790] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-07. [2025-09-17T17:51:00.415790] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-03. [2025-09-17T17:51:00.597277] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T17:51:00.709043] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T17:51:01.215754] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-04. [2025-09-17T17:51:01.299734] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T17:51:02.015839] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-04. [2025-09-17T17:51:02.815806] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-04. [2025-09-17T17:51:03.324683] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T17:51:03.578325] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T17:51:03.615767] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-05. [2025-09-17T17:51:04.307796] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T17:51:04.415792] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-05. [2025-09-17T17:51:04.762332] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T17:51:05.217406] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-05. [2025-09-17T17:51:05.701949] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T17:51:06.015835] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-08. [2025-09-17T17:51:06.815845] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-06. [2025-09-17T17:51:07.135155] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T17:51:07.173896] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T17:51:07.615783] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-06. [2025-09-17T17:51:07.853528] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T17:51:08.415784] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-07. [2025-09-17T17:51:09.215804] [INFO ] [REMOTE ] BTT: Fetching primary data for 2025-09. [2025-09-17T17:51:09.286900] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T17:51:09.546231] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T17:51:09.859062] [INFO ] [REMOTE ] BTT: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T17:51:09.861828] [INFO ] [REMOTE ] BTT: Full fetch complete (24435 records). [2025-09-17T17:51:09.861979] [DEBUG] [VALIDATOR ] BTT: Validating primary data. [2025-09-17T17:51:10.023453] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-08. [2025-09-17T17:51:10.247533] [DEBUG] [VALIDATOR ] BTT: All expected trading days are present. [2025-09-17T17:51:10.247717] [DEBUG] [VALIDATOR ] BTT: Primary data validation passed. [2025-09-17T17:51:10.248177] [INFO ] [MAIN ] BTT: Fetched primary data is valid. [2025-09-17T17:51:10.248232] [DEBUG] [LOCAL ] BTT: Saving primary data. [2025-09-17T17:51:10.249522] [DEBUG] [LOCAL ] BTT: Trimmed 24435 records to 16123 (keeping 200 days of data) [2025-09-17T17:51:10.349549] [DEBUG] [LOCAL ] BTT: Primary data saved (16123 records). [2025-09-17T17:51:10.349727] [INFO ] [MAIN ] BTT: Full history saved. [2025-09-17T17:51:10.349873] [INFO ] [MAIN ] Update Progress: 353/2371 symbols completed. BTT took 37.3s. Estimated remaining: 4h 52m 21s. Rate: 6.9 symbols/min [2025-09-17T17:51:10.520209] [INFO ] [MAIN ] BUD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:51:10.568659] [DEBUG] [LOCAL ] BUD: Loaded 52767 existing records from primary storage. [2025-09-17T17:51:10.568827] [INFO ] [MAIN ] BUD: Loaded 52767 existing records. [2025-09-17T17:51:10.745305] [WARN ] [MAIN ] BUD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:51:10.745553] [INFO ] [MAIN ] BUD: Wiping existing primary data before full refresh. [2025-09-17T17:51:10.745597] [INFO ] [LOCAL ] BUD: Starting deletion of primary data. [2025-09-17T17:51:10.746513] [DEBUG] [LOCAL ] BUD: Deleted primary data file. [2025-09-17T17:51:10.746569] [INFO ] [MAIN ] BUD: Starting full primary refresh. [2025-09-17T17:51:10.820894] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-06. [2025-09-17T17:51:11.117213] [INFO ] [REMOTE ] BUD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:51:11.235972] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T17:51:11.615783] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-11. [2025-09-17T17:51:11.811048] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T17:51:12.415797] [INFO ] [REMOTE ] BTZ: Fetching primary data for 2025-09. [2025-09-17T17:51:13.215775] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-07. [2025-09-17T17:51:13.617885] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T17:51:13.790525] [INFO ] [REMOTE ] BTZ: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T17:51:13.798470] [INFO ] [REMOTE ] BTZ: Full fetch complete (34067 records). [2025-09-17T17:51:13.798586] [DEBUG] [VALIDATOR ] BTZ: Validating primary data. [2025-09-17T17:51:14.020879] [INFO ] [REMOTE ] BUD: Fetching primary data for 2024-12. [2025-09-17T17:51:14.176922] [DEBUG] [VALIDATOR ] BTZ: All expected trading days are present. [2025-09-17T17:51:14.177001] [DEBUG] [VALIDATOR ] BTZ: Primary data validation passed. [2025-09-17T17:51:14.177502] [INFO ] [MAIN ] BTZ: Fetched primary data is valid. [2025-09-17T17:51:14.177548] [DEBUG] [LOCAL ] BTZ: Saving primary data. [2025-09-17T17:51:14.178365] [DEBUG] [LOCAL ] BTZ: Trimmed 34067 records to 23132 (keeping 200 days of data) [2025-09-17T17:51:14.334583] [DEBUG] [LOCAL ] BTZ: Primary data saved (23132 records). [2025-09-17T17:51:14.334731] [INFO ] [MAIN ] BTZ: Full history saved. [2025-09-17T17:51:14.334823] [INFO ] [MAIN ] Update Progress: 354/2371 symbols completed. BTZ took 24.5s. Estimated remaining: 4h 51m 46s. Rate: 6.9 symbols/min [2025-09-17T17:51:14.514799] [INFO ] [MAIN ] BUI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:51:14.539128] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T17:51:14.553756] [DEBUG] [LOCAL ] BUI: Loaded 11424 existing records from primary storage. [2025-09-17T17:51:14.553866] [INFO ] [MAIN ] BUI: Loaded 11424 existing records. [2025-09-17T17:51:14.742132] [WARN ] [MAIN ] BUI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:51:14.742412] [INFO ] [MAIN ] BUI: Wiping existing primary data before full refresh. [2025-09-17T17:51:14.742459] [INFO ] [LOCAL ] BUI: Starting deletion of primary data. [2025-09-17T17:51:14.742890] [DEBUG] [LOCAL ] BUI: Deleted primary data file. [2025-09-17T17:51:14.742943] [INFO ] [MAIN ] BUI: Starting full primary refresh. [2025-09-17T17:51:14.820831] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-08. [2025-09-17T17:51:15.126099] [INFO ] [REMOTE ] BUI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:51:15.615787] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-11. [2025-09-17T17:51:16.007737] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T17:51:16.229334] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T17:51:16.230737] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T17:51:16.415776] [INFO ] [REMOTE ] BUI: Fetching primary data for 2024-12. [2025-09-17T17:51:17.215780] [INFO ] [REMOTE ] BTX: Fetching primary data for 2025-09. [2025-09-17T17:51:17.268187] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T17:51:18.015771] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-01. [2025-09-17T17:51:18.268761] [INFO ] [REMOTE ] BTX: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T17:51:18.272742] [INFO ] [REMOTE ] BTX: Full fetch complete (34672 records). [2025-09-17T17:51:18.272846] [DEBUG] [VALIDATOR ] BTX: Validating primary data. [2025-09-17T17:51:18.460115] [WARN ] [VALIDATOR ] BTX: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-17T17:51:18.460588] [FATAL] [MAIN ] BTX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:51:18.460659] [WARN ] [MAIN ] BTX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:51:18.460718] [INFO ] [LOCAL ] BTX: Starting deletion of primary data. [2025-09-17T17:51:18.460794] [DEBUG] [LOCAL ] BTX: No primary data file found to delete. [2025-09-17T17:51:18.460831] [INFO ] [LOCAL ] BTX: Starting deletion of derivative data. [2025-09-17T17:51:18.460879] [DEBUG] [LOCAL ] BTX: No derivative data file found to delete. [2025-09-17T17:51:18.460949] [INFO ] [MAIN ] Update Progress: 355/2371 symbols completed. BTX took 32.0s. Estimated remaining: 4h 51m 11s. Rate: 6.9 symbols/min [2025-09-17T17:51:18.633388] [INFO ] [MAIN ] BUR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:51:18.683966] [DEBUG] [LOCAL ] BUR: Loaded 45181 existing records from primary storage. [2025-09-17T17:51:18.684114] [INFO ] [MAIN ] BUR: Loaded 45181 existing records. [2025-09-17T17:51:18.829854] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-07. [2025-09-17T17:51:18.858565] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T17:51:18.881260] [WARN ] [MAIN ] BUR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:51:18.881478] [INFO ] [MAIN ] BUR: Wiping existing primary data before full refresh. [2025-09-17T17:51:18.881524] [INFO ] [LOCAL ] BUR: Starting deletion of primary data. [2025-09-17T17:51:18.882563] [DEBUG] [LOCAL ] BUR: Deleted primary data file. [2025-09-17T17:51:18.882611] [INFO ] [MAIN ] BUR: Starting full primary refresh. [2025-09-17T17:51:19.234115] [INFO ] [REMOTE ] BUR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:51:19.615804] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-02. [2025-09-17T17:51:20.354265] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T17:51:20.415759] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-03. [2025-09-17T17:51:20.923774] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T17:51:20.947426] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T17:51:21.215829] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-08. [2025-09-17T17:51:22.015822] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-01. [2025-09-17T17:51:22.815800] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-11. [2025-09-17T17:51:23.259201] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T17:51:23.615852] [INFO ] [REMOTE ] BTU: Fetching primary data for 2025-09. [2025-09-17T17:51:24.058252] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T17:51:24.125126] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T17:51:24.415763] [INFO ] [REMOTE ] BUR: Fetching primary data for 2024-12. [2025-09-17T17:51:25.215783] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-04. [2025-09-17T17:51:25.790704] [INFO ] [REMOTE ] BTU: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-17T17:51:25.798426] [INFO ] [REMOTE ] BTU: Full fetch complete (76663 records). [2025-09-17T17:51:25.798568] [DEBUG] [VALIDATOR ] BTU: Validating primary data. [2025-09-17T17:51:26.026746] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-02. [2025-09-17T17:51:26.008925] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T17:51:26.232973] [DEBUG] [VALIDATOR ] BTU: All expected trading days are present. [2025-09-17T17:51:26.233207] [DEBUG] [VALIDATOR ] BTU: Primary data validation passed. [2025-09-17T17:51:26.234437] [INFO ] [MAIN ] BTU: Fetched primary data is valid. [2025-09-17T17:51:26.235486] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T17:51:26.235553] [DEBUG] [LOCAL ] BTU: Saving primary data. [2025-09-17T17:51:26.245706] [DEBUG] [LOCAL ] BTU: Trimmed 76663 records to 53302 (keeping 200 days of data) [2025-09-17T17:51:26.582079] [DEBUG] [LOCAL ] BTU: Primary data saved (53302 records). [2025-09-17T17:51:26.582219] [INFO ] [MAIN ] BTU: Full history saved. [2025-09-17T17:51:26.582742] [INFO ] [MAIN ] Update Progress: 356/2371 symbols completed. BTU took 45.3s. Estimated remaining: 4h 50m 60s. Rate: 6.9 symbols/min [2025-09-17T17:51:26.751971] [INFO ] [MAIN ] BURL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:51:26.797193] [DEBUG] [LOCAL ] BURL: Loaded 46558 existing records from primary storage. [2025-09-17T17:51:26.797322] [INFO ] [MAIN ] BURL: Loaded 46558 existing records. [2025-09-17T17:51:26.827890] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-01. [2025-09-17T17:51:26.976037] [WARN ] [MAIN ] BURL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:51:26.976274] [INFO ] [MAIN ] BURL: Wiping existing primary data before full refresh. [2025-09-17T17:51:26.976321] [INFO ] [LOCAL ] BURL: Starting deletion of primary data. [2025-09-17T17:51:26.977144] [DEBUG] [LOCAL ] BURL: Deleted primary data file. [2025-09-17T17:51:26.977194] [INFO ] [MAIN ] BURL: Starting full primary refresh. [2025-09-17T17:51:27.333730] [INFO ] [REMOTE ] BURL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:51:27.615745] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-05. [2025-09-17T17:51:27.925144] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T17:51:28.415781] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-03. [2025-09-17T17:51:28.540500] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T17:51:28.556492] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T17:51:29.215840] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-02. [2025-09-17T17:51:30.015825] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-11. [2025-09-17T17:51:30.429776] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T17:51:30.728289] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T17:51:30.815810] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-04. [2025-09-17T17:51:31.615860] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-03. [2025-09-17T17:51:31.758359] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T17:51:32.415820] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-06. [2025-09-17T17:51:32.661938] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T17:51:33.215808] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-05. [2025-09-17T17:51:33.228901] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T17:51:33.416049] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T17:51:34.015813] [INFO ] [REMOTE ] BURL: Fetching primary data for 2024-12. [2025-09-17T17:51:34.815792] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-07. [2025-09-17T17:51:35.210519] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T17:51:35.315564] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T17:51:35.484662] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T17:51:35.615834] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-08. [2025-09-17T17:51:36.369970] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T17:51:36.415763] [INFO ] [REMOTE ] BUI: Fetching primary data for 2025-09. [2025-09-17T17:51:37.215792] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-01. [2025-09-17T17:51:37.381750] [INFO ] [REMOTE ] BUI: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T17:51:37.384137] [INFO ] [REMOTE ] BUI: Full fetch complete (16091 records). [2025-09-17T17:51:37.384216] [DEBUG] [VALIDATOR ] BUI: Validating primary data. [2025-09-17T17:51:37.748011] [DEBUG] [VALIDATOR ] BUI: All expected trading days are present. [2025-09-17T17:51:37.748092] [DEBUG] [VALIDATOR ] BUI: Primary data validation passed. [2025-09-17T17:51:37.748428] [INFO ] [MAIN ] BUI: Fetched primary data is valid. [2025-09-17T17:51:37.748470] [DEBUG] [LOCAL ] BUI: Saving primary data. [2025-09-17T17:51:37.749010] [DEBUG] [LOCAL ] BUI: Trimmed 16091 records to 11484 (keeping 200 days of data) [2025-09-17T17:51:37.821226] [DEBUG] [LOCAL ] BUI: Primary data saved (11484 records). [2025-09-17T17:51:37.821364] [INFO ] [MAIN ] BUI: Full history saved. [2025-09-17T17:51:37.821453] [INFO ] [MAIN ] Update Progress: 357/2371 symbols completed. BUI took 23.5s. Estimated remaining: 4h 51m 6s. Rate: 6.9 symbols/min [2025-09-17T17:51:38.015792] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-04. [2025-09-17T17:51:38.771061] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T17:51:38.815733] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-02. [2025-09-17T17:51:39.615780] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-06. [2025-09-17T17:51:39.677736] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T17:51:40.415696] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-05. [2025-09-17T17:51:40.442980] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T17:51:41.215852] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-03. [2025-09-17T17:51:41.371367] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T17:51:42.009088] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T17:51:42.017424] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-07. [2025-09-17T17:51:42.778836] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T17:51:42.815767] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-04. [2025-09-17T17:51:43.615810] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-06. [2025-09-17T17:51:44.005181] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T17:51:44.415839] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-08. [2025-09-17T17:51:44.597104] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T17:51:44.851059] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T17:51:45.215826] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-05. [2025-09-17T17:51:46.015820] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-07. [2025-09-17T17:51:46.419058] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T17:51:46.815836] [INFO ] [REMOTE ] BUD: Fetching primary data for 2025-09. [2025-09-17T17:51:46.957693] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T17:51:47.615843] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-06. [2025-09-17T17:51:47.682996] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T17:51:48.415840] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-08. [2025-09-17T17:51:48.488690] [INFO ] [REMOTE ] BUD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T17:51:48.497204] [INFO ] [REMOTE ] BUD: Full fetch complete (76343 records). [2025-09-17T17:51:48.497366] [DEBUG] [VALIDATOR ] BUD: Validating primary data. [2025-09-17T17:51:48.908777] [DEBUG] [VALIDATOR ] BUD: All expected trading days are present. [2025-09-17T17:51:48.908937] [DEBUG] [VALIDATOR ] BUD: Primary data validation passed. [2025-09-17T17:51:48.909815] [INFO ] [MAIN ] BUD: Fetched primary data is valid. [2025-09-17T17:51:48.909872] [DEBUG] [LOCAL ] BUD: Saving primary data. [2025-09-17T17:51:48.911616] [DEBUG] [LOCAL ] BUD: Trimmed 76343 records to 52766 (keeping 200 days of data) [2025-09-17T17:51:49.030317] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T17:51:49.230425] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-07. [2025-09-17T17:51:49.278204] [DEBUG] [LOCAL ] BUD: Primary data saved (52766 records). [2025-09-17T17:51:49.278358] [INFO ] [MAIN ] BUD: Full history saved. [2025-09-17T17:51:49.279281] [INFO ] [MAIN ] Update Progress: 358/2371 symbols completed. BUD took 38.9s. Estimated remaining: 4h 51m 13s. Rate: 6.9 symbols/min [2025-09-17T17:51:49.796838] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T17:51:50.015771] [INFO ] [REMOTE ] BUR: Fetching primary data for 2025-09. [2025-09-17T17:51:50.877728] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T17:51:50.887856] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-08. [2025-09-17T17:51:51.531979] [INFO ] [REMOTE ] BUR: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T17:51:51.537796] [INFO ] [REMOTE ] BUR: Full fetch complete (63009 records). [2025-09-17T17:51:51.537899] [DEBUG] [VALIDATOR ] BUR: Validating primary data. [2025-09-17T17:51:51.922317] [DEBUG] [VALIDATOR ] BUR: All expected trading days are present. [2025-09-17T17:51:51.922425] [DEBUG] [VALIDATOR ] BUR: Primary data validation passed. [2025-09-17T17:51:51.923131] [INFO ] [MAIN ] BUR: Fetched primary data is valid. [2025-09-17T17:51:51.923175] [DEBUG] [LOCAL ] BUR: Saving primary data. [2025-09-17T17:51:51.924394] [DEBUG] [LOCAL ] BUR: Trimmed 63009 records to 45131 (keeping 200 days of data) [2025-09-17T17:51:52.200609] [DEBUG] [LOCAL ] BUR: Primary data saved (45131 records). [2025-09-17T17:51:52.200762] [INFO ] [MAIN ] BUR: Full history saved. [2025-09-17T17:51:52.200845] [INFO ] [MAIN ] Update Progress: 359/2371 symbols completed. BUR took 33.7s. Estimated remaining: 4h 50m 32s. Rate: 6.9 symbols/min [2025-09-17T17:51:52.590723] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T17:51:52.600573] [INFO ] [REMOTE ] BURL: Fetching primary data for 2025-09. [2025-09-17T17:51:54.443219] [INFO ] [REMOTE ] BURL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T17:51:54.454180] [INFO ] [REMOTE ] BURL: Full fetch complete (65669 records). [2025-09-17T17:51:54.454367] [DEBUG] [VALIDATOR ] BURL: Validating primary data. [2025-09-17T17:51:54.858118] [DEBUG] [VALIDATOR ] BURL: All expected trading days are present. [2025-09-17T17:51:54.858212] [DEBUG] [VALIDATOR ] BURL: Primary data validation passed. [2025-09-17T17:51:54.858957] [INFO ] [MAIN ] BURL: Fetched primary data is valid. [2025-09-17T17:51:54.859023] [DEBUG] [LOCAL ] BURL: Saving primary data. [2025-09-17T17:51:54.860431] [DEBUG] [LOCAL ] BURL: Trimmed 65669 records to 46560 (keeping 200 days of data) [2025-09-17T17:51:55.147627] [DEBUG] [LOCAL ] BURL: Primary data saved (46560 records). [2025-09-17T17:51:55.147781] [INFO ] [MAIN ] BURL: Full history saved. [2025-09-17T17:51:55.149329] [INFO ] [MAIN ] Update Progress: 360/2371 symbols completed. BURL took 28.6s. Estimated remaining: 4h 49m 51s. Rate: 6.9 symbols/min [2025-09-17T17:51:55.638796] [INFO ] [MAIN ] BVN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:51:55.851349] [INFO ] [MAIN ] BW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:51:55.874068] [INFO ] [MAIN ] BUXX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:51:55.875743] [INFO ] [MAIN ] BV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:51:55.907717] [DEBUG] [LOCAL ] BUXX: Loaded 15255 existing records from primary storage. [2025-09-17T17:51:55.908058] [INFO ] [MAIN ] BUXX: Loaded 15255 existing records. [2025-09-17T17:51:56.053364] [DEBUG] [LOCAL ] BVN: Loaded 43450 existing records from primary storage. [2025-09-17T17:51:56.071008] [INFO ] [MAIN ] BVN: Loaded 43450 existing records. [2025-09-17T17:51:56.213866] [DEBUG] [LOCAL ] BW: Loaded 39416 existing records from primary storage. [2025-09-17T17:51:56.233096] [DEBUG] [LOCAL ] BV: Loaded 38711 existing records from primary storage. [2025-09-17T17:51:56.223352] [INFO ] [MAIN ] BW: Loaded 39416 existing records. [2025-09-17T17:51:56.233278] [INFO ] [MAIN ] BV: Loaded 38711 existing records. [2025-09-17T17:51:56.273247] [WARN ] [MAIN ] BUXX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:51:56.374563] [INFO ] [MAIN ] BUXX: Wiping existing primary data before full refresh. [2025-09-17T17:51:56.379941] [INFO ] [LOCAL ] BUXX: Starting deletion of primary data. [2025-09-17T17:51:56.438511] [DEBUG] [LOCAL ] BUXX: Deleted primary data file. [2025-09-17T17:51:56.473073] [INFO ] [MAIN ] BUXX: Starting full primary refresh. [2025-09-17T17:51:56.639744] [WARN ] [MAIN ] BVN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:51:56.717559] [WARN ] [MAIN ] BW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:51:56.757788] [INFO ] [MAIN ] BVN: Wiping existing primary data before full refresh. [2025-09-17T17:51:56.793593] [INFO ] [MAIN ] BW: Wiping existing primary data before full refresh. [2025-09-17T17:51:56.825178] [INFO ] [LOCAL ] BW: Starting deletion of primary data. [2025-09-17T17:51:56.793449] [INFO ] [LOCAL ] BVN: Starting deletion of primary data. [2025-09-17T17:51:56.844530] [WARN ] [MAIN ] BV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:51:56.845039] [INFO ] [MAIN ] BV: Wiping existing primary data before full refresh. [2025-09-17T17:51:56.855576] [DEBUG] [LOCAL ] BW: Deleted primary data file. [2025-09-17T17:51:56.845114] [INFO ] [LOCAL ] BV: Starting deletion of primary data. [2025-09-17T17:51:56.855637] [DEBUG] [LOCAL ] BVN: Deleted primary data file. [2025-09-17T17:51:56.866019] [INFO ] [MAIN ] BW: Starting full primary refresh. [2025-09-17T17:51:56.906974] [DEBUG] [LOCAL ] BV: Deleted primary data file. [2025-09-17T17:51:56.885327] [INFO ] [MAIN ] BVN: Starting full primary refresh. [2025-09-17T17:51:56.949942] [INFO ] [MAIN ] BV: Starting full primary refresh. [2025-09-17T17:51:57.927445] [INFO ] [REMOTE ] BUXX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:51:57.976828] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-11. [2025-09-17T17:51:58.084031] [INFO ] [REMOTE ] BW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:51:58.091196] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-11. [2025-09-17T17:51:58.260815] [INFO ] [REMOTE ] BVN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:51:58.265394] [INFO ] [REMOTE ] BV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:51:58.265987] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-11. [2025-09-17T17:51:58.266588] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-11. [2025-09-17T17:51:58.962386] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T17:51:58.965247] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2024-12. [2025-09-17T17:51:59.617696] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T17:51:59.626454] [INFO ] [REMOTE ] BVN: Fetching primary data for 2024-12. [2025-09-17T17:51:59.669035] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T17:51:59.676149] [INFO ] [REMOTE ] BV: Fetching primary data for 2024-12. [2025-09-17T17:51:59.686494] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T17:51:59.690964] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-01. [2025-09-17T17:51:59.723660] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T17:51:59.732461] [INFO ] [REMOTE ] BW: Fetching primary data for 2024-12. [2025-09-17T17:52:00.764610] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T17:52:00.767488] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-02. [2025-09-17T17:52:01.297902] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T17:52:01.307019] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-01. [2025-09-17T17:52:01.390325] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T17:52:01.400822] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-01. [2025-09-17T17:52:01.411265] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T17:52:02.015815] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-03. [2025-09-17T17:52:02.269223] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2024-12 (2.64 seconds). [2025-09-17T17:52:02.815809] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-01. [2025-09-17T17:52:02.844609] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T17:52:03.060981] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T17:52:03.520517] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T17:52:03.615766] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-02. [2025-09-17T17:52:04.415784] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-04. [2025-09-17T17:52:05.137382] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-17T17:52:05.195156] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T17:52:05.215773] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-05. [2025-09-17T17:52:06.015784] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-02. [2025-09-17T17:52:06.110198] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-02 (2.49 seconds). [2025-09-17T17:52:06.206660] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T17:52:06.815768] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-06. [2025-09-17T17:52:07.492836] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T17:52:07.603185] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T17:52:07.615715] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-02. [2025-09-17T17:52:08.415782] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-03. [2025-09-17T17:52:08.721619] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T17:52:09.215784] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-03. [2025-09-17T17:52:10.015826] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-03. [2025-09-17T17:52:10.149956] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T17:52:10.815834] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-04. [2025-09-17T17:52:11.287408] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-17T17:52:11.615838] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-04. [2025-09-17T17:52:11.696664] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T17:52:12.290090] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T17:52:12.415786] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-04. [2025-09-17T17:52:12.986241] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T17:52:13.215778] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-05. [2025-09-17T17:52:14.016015] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-05. [2025-09-17T17:52:14.152600] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T17:52:14.287239] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T17:52:14.815785] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-06. [2025-09-17T17:52:15.567346] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T17:52:15.615729] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-06. [2025-09-17T17:52:16.221912] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T17:52:16.415770] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-05. [2025-09-17T17:52:17.215745] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-07. [2025-09-17T17:52:17.359344] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T17:52:17.900950] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T17:52:18.015762] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-07. [2025-09-17T17:52:18.264365] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T17:52:18.815811] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-08. [2025-09-17T17:52:19.436170] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T17:52:19.510460] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T17:52:19.615808] [INFO ] [REMOTE ] BUXX: Fetching primary data for 2025-09. [2025-09-17T17:52:20.415789] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-08. [2025-09-17T17:52:20.488436] [INFO ] [REMOTE ] BUXX: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T17:52:20.491365] [INFO ] [REMOTE ] BUXX: Full fetch complete (20228 records). [2025-09-17T17:52:20.491464] [DEBUG] [VALIDATOR ] BUXX: Validating primary data. [2025-09-17T17:52:20.873113] [DEBUG] [VALIDATOR ] BUXX: All expected trading days are present. [2025-09-17T17:52:20.873192] [DEBUG] [VALIDATOR ] BUXX: Primary data validation passed. [2025-09-17T17:52:20.873555] [INFO ] [MAIN ] BUXX: Fetched primary data is valid. [2025-09-17T17:52:20.873594] [DEBUG] [LOCAL ] BUXX: Saving primary data. [2025-09-17T17:52:20.874189] [DEBUG] [LOCAL ] BUXX: Trimmed 20228 records to 15219 (keeping 200 days of data) [2025-09-17T17:52:20.968762] [DEBUG] [LOCAL ] BUXX: Primary data saved (15219 records). [2025-09-17T17:52:20.968906] [INFO ] [MAIN ] BUXX: Full history saved. [2025-09-17T17:52:20.969008] [INFO ] [MAIN ] Update Progress: 361/2371 symbols completed. BUXX took 25.8s. Estimated remaining: 4h 51m 18s. Rate: 6.9 symbols/min [2025-09-17T17:52:21.138372] [INFO ] [MAIN ] BWA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:52:21.190226] [DEBUG] [LOCAL ] BWA: Loaded 52277 existing records from primary storage. [2025-09-17T17:52:21.190362] [INFO ] [MAIN ] BWA: Loaded 52277 existing records. [2025-09-17T17:52:21.220947] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-06. [2025-09-17T17:52:21.368419] [WARN ] [MAIN ] BWA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:52:21.368704] [INFO ] [MAIN ] BWA: Wiping existing primary data before full refresh. [2025-09-17T17:52:21.368751] [INFO ] [LOCAL ] BWA: Starting deletion of primary data. [2025-09-17T17:52:21.369801] [DEBUG] [LOCAL ] BWA: Deleted primary data file. [2025-09-17T17:52:21.369861] [INFO ] [MAIN ] BWA: Starting full primary refresh. [2025-09-17T17:52:21.733936] [INFO ] [REMOTE ] BWA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:52:21.943148] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T17:52:22.015822] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-07. [2025-09-17T17:52:22.815794] [INFO ] [REMOTE ] BV: Fetching primary data for 2025-09. [2025-09-17T17:52:22.878627] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T17:52:23.200425] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T17:52:23.615815] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-07. [2025-09-17T17:52:24.407148] [INFO ] [REMOTE ] BV: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T17:52:24.416251] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-11. [2025-09-17T17:52:24.418312] [INFO ] [REMOTE ] BV: Full fetch complete (53462 records). [2025-09-17T17:52:24.418463] [DEBUG] [VALIDATOR ] BV: Validating primary data. [2025-09-17T17:52:24.729017] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T17:52:25.108546] [DEBUG] [VALIDATOR ] BV: All expected trading days are present. [2025-09-17T17:52:25.108709] [DEBUG] [VALIDATOR ] BV: Primary data validation passed. [2025-09-17T17:52:25.109856] [INFO ] [MAIN ] BV: Fetched primary data is valid. [2025-09-17T17:52:25.109925] [DEBUG] [LOCAL ] BV: Saving primary data. [2025-09-17T17:52:25.111398] [DEBUG] [LOCAL ] BV: Trimmed 53462 records to 38644 (keeping 200 days of data) [2025-09-17T17:52:25.218097] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-08. [2025-09-17T17:52:25.359177] [DEBUG] [LOCAL ] BV: Primary data saved (38644 records). [2025-09-17T17:52:25.359338] [INFO ] [MAIN ] BV: Full history saved. [2025-09-17T17:52:25.360077] [INFO ] [MAIN ] Update Progress: 362/2371 symbols completed. BV took 30.2s. Estimated remaining: 4h 50m 45s. Rate: 6.9 symbols/min [2025-09-17T17:52:25.538124] [INFO ] [MAIN ] BWG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:52:25.553751] [DEBUG] [LOCAL ] BWG: Loaded 12291 existing records from primary storage. [2025-09-17T17:52:25.553903] [INFO ] [MAIN ] BWG: Loaded 12291 existing records. [2025-09-17T17:52:25.742936] [WARN ] [MAIN ] BWG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:52:25.743232] [INFO ] [MAIN ] BWG: Wiping existing primary data before full refresh. [2025-09-17T17:52:25.743278] [INFO ] [LOCAL ] BWG: Starting deletion of primary data. [2025-09-17T17:52:25.743813] [DEBUG] [LOCAL ] BWG: Deleted primary data file. [2025-09-17T17:52:25.743874] [INFO ] [MAIN ] BWG: Starting full primary refresh. [2025-09-17T17:52:26.018546] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-08. [2025-09-17T17:52:26.129384] [INFO ] [REMOTE ] BWG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:52:26.160979] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T17:52:26.798115] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T17:52:26.815739] [INFO ] [REMOTE ] BW: Fetching primary data for 2025-09. [2025-09-17T17:52:27.615795] [INFO ] [REMOTE ] BWA: Fetching primary data for 2024-12. [2025-09-17T17:52:27.713537] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T17:52:28.415745] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-11. [2025-09-17T17:52:28.523474] [INFO ] [REMOTE ] BW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T17:52:28.529743] [INFO ] [REMOTE ] BW: Full fetch complete (58456 records). [2025-09-17T17:52:28.529840] [DEBUG] [VALIDATOR ] BW: Validating primary data. [2025-09-17T17:52:28.915867] [DEBUG] [VALIDATOR ] BW: All expected trading days are present. [2025-09-17T17:52:28.915995] [DEBUG] [VALIDATOR ] BW: Primary data validation passed. [2025-09-17T17:52:28.916753] [INFO ] [MAIN ] BW: Fetched primary data is valid. [2025-09-17T17:52:28.916861] [DEBUG] [LOCAL ] BW: Saving primary data. [2025-09-17T17:52:28.918346] [DEBUG] [LOCAL ] BW: Trimmed 58456 records to 39420 (keeping 200 days of data) [2025-09-17T17:52:29.145889] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T17:52:29.187627] [DEBUG] [LOCAL ] BW: Primary data saved (39420 records). [2025-09-17T17:52:29.187842] [INFO ] [MAIN ] BW: Full history saved. [2025-09-17T17:52:29.187929] [INFO ] [MAIN ] Update Progress: 363/2371 symbols completed. BW took 34.0s. Estimated remaining: 4h 50m 10s. Rate: 6.9 symbols/min [2025-09-17T17:52:29.219733] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-01. [2025-09-17T17:52:29.376012] [INFO ] [MAIN ] BWLP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:52:29.381895] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T17:52:29.417694] [DEBUG] [LOCAL ] BWLP: Loaded 33066 existing records from primary storage. [2025-09-17T17:52:29.417828] [INFO ] [MAIN ] BWLP: Loaded 33066 existing records. [2025-09-17T17:52:29.595300] [WARN ] [MAIN ] BWLP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:52:29.595565] [INFO ] [MAIN ] BWLP: Wiping existing primary data before full refresh. [2025-09-17T17:52:29.595613] [INFO ] [LOCAL ] BWLP: Starting deletion of primary data. [2025-09-17T17:52:29.596464] [DEBUG] [LOCAL ] BWLP: Deleted primary data file. [2025-09-17T17:52:29.596517] [INFO ] [MAIN ] BWLP: Starting full primary refresh. [2025-09-17T17:52:29.951694] [INFO ] [REMOTE ] BWLP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:52:30.015772] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-11. [2025-09-17T17:52:30.815793] [INFO ] [REMOTE ] BWG: Fetching primary data for 2024-12. [2025-09-17T17:52:30.983578] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T17:52:31.052914] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T17:52:31.590426] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T17:52:31.615740] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2024-12. [2025-09-17T17:52:32.415801] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-01. [2025-09-17T17:52:33.126787] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T17:52:33.215789] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-01. [2025-09-17T17:52:33.406384] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T17:52:34.015839] [INFO ] [REMOTE ] BVN: Fetching primary data for 2025-09. [2025-09-17T17:52:34.560477] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T17:52:34.815836] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-02. [2025-09-17T17:52:35.615846] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-02. [2025-09-17T17:52:35.688294] [INFO ] [REMOTE ] BVN: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T17:52:35.697055] [INFO ] [REMOTE ] BVN: Full fetch complete (62285 records). [2025-09-17T17:52:35.697267] [DEBUG] [VALIDATOR ] BVN: Validating primary data. [2025-09-17T17:52:36.109908] [DEBUG] [VALIDATOR ] BVN: All expected trading days are present. [2025-09-17T17:52:36.110018] [DEBUG] [VALIDATOR ] BVN: Primary data validation passed. [2025-09-17T17:52:36.111104] [INFO ] [MAIN ] BVN: Fetched primary data is valid. [2025-09-17T17:52:36.111160] [DEBUG] [LOCAL ] BVN: Saving primary data. [2025-09-17T17:52:36.112974] [DEBUG] [LOCAL ] BVN: Trimmed 62285 records to 43498 (keeping 200 days of data) [2025-09-17T17:52:36.376052] [DEBUG] [LOCAL ] BVN: Primary data saved (43498 records). [2025-09-17T17:52:36.376219] [INFO ] [MAIN ] BVN: Full history saved. [2025-09-17T17:52:36.382118] [INFO ] [MAIN ] Update Progress: 364/2371 symbols completed. BVN took 41.2s. Estimated remaining: 4h 49m 53s. Rate: 6.9 symbols/min [2025-09-17T17:52:36.383753] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T17:52:36.421026] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-02. [2025-09-17T17:52:36.574342] [INFO ] [MAIN ] BWMX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:52:36.612343] [DEBUG] [LOCAL ] BWMX: Loaded 7551 existing records from primary storage. [2025-09-17T17:52:36.612513] [INFO ] [MAIN ] BWMX: Loaded 7551 existing records. [2025-09-17T17:52:36.680459] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T17:52:36.810821] [WARN ] [MAIN ] BWMX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:52:36.811094] [INFO ] [MAIN ] BWMX: Wiping existing primary data before full refresh. [2025-09-17T17:52:36.811142] [INFO ] [LOCAL ] BWMX: Starting deletion of primary data. [2025-09-17T17:52:36.811427] [DEBUG] [LOCAL ] BWMX: Deleted primary data file. [2025-09-17T17:52:36.811472] [INFO ] [MAIN ] BWMX: Starting full primary refresh. [2025-09-17T17:52:37.186727] [INFO ] [REMOTE ] BWMX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:52:37.215750] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-11. [2025-09-17T17:52:37.839909] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T17:52:37.899004] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T17:52:38.015749] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-03. [2025-09-17T17:52:38.815816] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-03. [2025-09-17T17:52:39.247338] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T17:52:39.615805] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-03. [2025-09-17T17:52:40.166049] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T17:52:40.415833] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-04. [2025-09-17T17:52:40.435548] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T17:52:41.215820] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-04. [2025-09-17T17:52:41.967344] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T17:52:42.015792] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-05. [2025-09-17T17:52:42.815798] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2024-12. [2025-09-17T17:52:42.889478] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T17:52:43.425922] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T17:52:43.542535] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T17:52:43.615793] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-01. [2025-09-17T17:52:44.220315] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T17:52:44.415823] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-05. [2025-09-17T17:52:45.215803] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-04. [2025-09-17T17:52:46.015765] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-06. [2025-09-17T17:52:46.066442] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T17:52:46.110824] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T17:52:46.815810] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-05. [2025-09-17T17:52:47.049579] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T17:52:47.615781] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-07. [2025-09-17T17:52:47.762395] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T17:52:48.415818] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-06. [2025-09-17T17:52:48.778276] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T17:52:49.215814] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-02. [2025-09-17T17:52:49.772019] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T17:52:50.015757] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-06. [2025-09-17T17:52:50.235680] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T17:52:50.815809] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-07. [2025-09-17T17:52:50.896153] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T17:52:51.615966] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-07. [2025-09-17T17:52:52.301076] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T17:52:52.415792] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-08. [2025-09-17T17:52:52.535141] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T17:52:53.215774] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-08. [2025-09-17T17:52:53.821553] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T17:52:53.989223] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T17:52:54.015730] [INFO ] [REMOTE ] BWG: Fetching primary data for 2025-09. [2025-09-17T17:52:54.815760] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-03. [2025-09-17T17:52:54.986972] [INFO ] [REMOTE ] BWG: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T17:52:54.990591] [INFO ] [REMOTE ] BWG: Full fetch complete (17513 records). [2025-09-17T17:52:54.990745] [DEBUG] [VALIDATOR ] BWG: Validating primary data. [2025-09-17T17:52:55.381611] [DEBUG] [VALIDATOR ] BWG: All expected trading days are present. [2025-09-17T17:52:55.381729] [DEBUG] [VALIDATOR ] BWG: Primary data validation passed. [2025-09-17T17:52:55.382149] [INFO ] [MAIN ] BWG: Fetched primary data is valid. [2025-09-17T17:52:55.382191] [DEBUG] [LOCAL ] BWG: Saving primary data. [2025-09-17T17:52:55.382944] [DEBUG] [LOCAL ] BWG: Trimmed 17513 records to 12306 (keeping 200 days of data) [2025-09-17T17:52:55.457318] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T17:52:55.467707] [DEBUG] [LOCAL ] BWG: Primary data saved (12306 records). [2025-09-17T17:52:55.467843] [INFO ] [MAIN ] BWG: Full history saved. [2025-09-17T17:52:55.467926] [INFO ] [MAIN ] Update Progress: 365/2371 symbols completed. BWG took 30.1s. Estimated remaining: 4h 50m 42s. Rate: 6.9 symbols/min [2025-09-17T17:52:55.622510] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-04. [2025-09-17T17:52:55.643346] [INFO ] [MAIN ] BWNB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:52:55.649623] [DEBUG] [LOCAL ] BWNB: Loaded 4520 existing records from primary storage. [2025-09-17T17:52:55.649767] [INFO ] [MAIN ] BWNB: Loaded 4520 existing records. [2025-09-17T17:52:55.827248] [WARN ] [MAIN ] BWNB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:52:55.827499] [INFO ] [MAIN ] BWNB: Wiping existing primary data before full refresh. [2025-09-17T17:52:55.827556] [INFO ] [LOCAL ] BWNB: Starting deletion of primary data. [2025-09-17T17:52:55.827818] [DEBUG] [LOCAL ] BWNB: Deleted primary data file. [2025-09-17T17:52:55.827867] [INFO ] [MAIN ] BWNB: Starting full primary refresh. [2025-09-17T17:52:56.194904] [INFO ] [REMOTE ] BWNB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:52:56.399312] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T17:52:56.415673] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-05. [2025-09-17T17:52:57.186632] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T17:52:57.215791] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-08. [2025-09-17T17:52:58.015836] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-06. [2025-09-17T17:52:58.709830] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T17:52:58.811673] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T17:52:58.815677] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-07. [2025-09-17T17:52:59.615816] [INFO ] [REMOTE ] BWA: Fetching primary data for 2025-09. [2025-09-17T17:52:59.710437] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T17:53:00.415819] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-11. [2025-09-17T17:53:00.853138] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T17:53:01.215843] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2024-12. [2025-09-17T17:53:01.340748] [INFO ] [REMOTE ] BWA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T17:53:01.347804] [INFO ] [REMOTE ] BWA: Full fetch complete (75570 records). [2025-09-17T17:53:01.347991] [DEBUG] [VALIDATOR ] BWA: Validating primary data. [2025-09-17T17:53:01.754791] [DEBUG] [VALIDATOR ] BWA: All expected trading days are present. [2025-09-17T17:53:01.758779] [DEBUG] [VALIDATOR ] BWA: Primary data validation passed. [2025-09-17T17:53:01.759120] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T17:53:01.760116] [INFO ] [MAIN ] BWA: Fetched primary data is valid. [2025-09-17T17:53:01.760243] [DEBUG] [LOCAL ] BWA: Saving primary data. [2025-09-17T17:53:01.763954] [DEBUG] [LOCAL ] BWA: Trimmed 75570 records to 52274 (keeping 200 days of data) [2025-09-17T17:53:02.015838] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-01. [2025-09-17T17:53:02.113666] [DEBUG] [LOCAL ] BWA: Primary data saved (52274 records). [2025-09-17T17:53:02.113866] [INFO ] [MAIN ] BWA: Full history saved. [2025-09-17T17:53:02.113957] [INFO ] [MAIN ] Update Progress: 366/2371 symbols completed. BWA took 41.1s. Estimated remaining: 4h 50m 22s. Rate: 6.9 symbols/min [2025-09-17T17:53:02.291726] [INFO ] [MAIN ] BWSN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:53:02.298806] [DEBUG] [LOCAL ] BWSN: Loaded 5150 existing records from primary storage. [2025-09-17T17:53:02.298916] [INFO ] [MAIN ] BWSN: Loaded 5150 existing records. [2025-09-17T17:53:02.480545] [WARN ] [MAIN ] BWSN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:53:02.480831] [INFO ] [MAIN ] BWSN: Wiping existing primary data before full refresh. [2025-09-17T17:53:02.480889] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-17T17:53:02.481159] [DEBUG] [LOCAL ] BWSN: Deleted primary data file. [2025-09-17T17:53:02.481203] [INFO ] [MAIN ] BWSN: Starting full primary refresh. [2025-09-17T17:53:02.590722] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T17:53:02.821889] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-08. [2025-09-17T17:53:02.851162] [INFO ] [REMOTE ] BWSN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:53:03.615747] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-11. [2025-09-17T17:53:03.734142] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T17:53:04.110618] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T17:53:04.415786] [INFO ] [REMOTE ] BWMX: Fetching primary data for 2025-09. [2025-09-17T17:53:05.168929] [INFO ] [REMOTE ] BWMX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T17:53:05.170437] [INFO ] [REMOTE ] BWMX: Full fetch complete (10023 records). [2025-09-17T17:53:05.170512] [DEBUG] [VALIDATOR ] BWMX: Validating primary data. [2025-09-17T17:53:05.223757] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-02. [2025-09-17T17:53:05.567174] [DEBUG] [VALIDATOR ] BWMX: All expected trading days are present. [2025-09-17T17:53:05.567273] [DEBUG] [VALIDATOR ] BWMX: Primary data validation passed. [2025-09-17T17:53:05.567553] [INFO ] [MAIN ] BWMX: Fetched primary data is valid. [2025-09-17T17:53:05.567655] [DEBUG] [LOCAL ] BWMX: Saving primary data. [2025-09-17T17:53:05.568192] [DEBUG] [LOCAL ] BWMX: Trimmed 10023 records to 7579 (keeping 200 days of data) [2025-09-17T17:53:05.618166] [DEBUG] [LOCAL ] BWMX: Primary data saved (7579 records). [2025-09-17T17:53:05.619004] [INFO ] [MAIN ] BWMX: Full history saved. [2025-09-17T17:53:05.619119] [INFO ] [MAIN ] Update Progress: 367/2371 symbols completed. BWMX took 29.2s. Estimated remaining: 4h 49m 45s. Rate: 6.9 symbols/min [2025-09-17T17:53:05.804717] [INFO ] [MAIN ] BWXT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:53:05.855676] [DEBUG] [LOCAL ] BWXT: Loaded 46628 existing records from primary storage. [2025-09-17T17:53:05.855888] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-02 (0.63 seconds). [2025-09-17T17:53:05.856121] [INFO ] [MAIN ] BWXT: Loaded 46628 existing records. [2025-09-17T17:53:06.016871] [INFO ] [REMOTE ] BWLP: Fetching primary data for 2025-09. [2025-09-17T17:53:06.039309] [WARN ] [MAIN ] BWXT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:53:06.040535] [INFO ] [MAIN ] BWXT: Wiping existing primary data before full refresh. [2025-09-17T17:53:06.040602] [INFO ] [LOCAL ] BWXT: Starting deletion of primary data. [2025-09-17T17:53:06.041989] [DEBUG] [LOCAL ] BWXT: Deleted primary data file. [2025-09-17T17:53:06.042233] [INFO ] [MAIN ] BWXT: Starting full primary refresh. [2025-09-17T17:53:06.428680] [INFO ] [REMOTE ] BWXT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:53:06.815787] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-11. [2025-09-17T17:53:07.476508] [INFO ] [REMOTE ] BWLP: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T17:53:07.481381] [INFO ] [REMOTE ] BWLP: Full fetch complete (48773 records). [2025-09-17T17:53:07.481538] [DEBUG] [VALIDATOR ] BWLP: Validating primary data. [2025-09-17T17:53:07.628545] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2024-12. [2025-09-17T17:53:07.876632] [DEBUG] [VALIDATOR ] BWLP: All expected trading days are present. [2025-09-17T17:53:07.876745] [DEBUG] [VALIDATOR ] BWLP: Primary data validation passed. [2025-09-17T17:53:07.877329] [INFO ] [MAIN ] BWLP: Fetched primary data is valid. [2025-09-17T17:53:07.877374] [DEBUG] [LOCAL ] BWLP: Saving primary data. [2025-09-17T17:53:07.878631] [DEBUG] [LOCAL ] BWLP: Trimmed 48773 records to 33011 (keeping 200 days of data) [2025-09-17T17:53:08.093318] [DEBUG] [LOCAL ] BWLP: Primary data saved (33011 records). [2025-09-17T17:53:08.093462] [INFO ] [MAIN ] BWLP: Full history saved. [2025-09-17T17:53:08.093568] [INFO ] [MAIN ] Update Progress: 368/2371 symbols completed. BWLP took 38.9s. Estimated remaining: 4h 49m 2s. Rate: 6.9 symbols/min [2025-09-17T17:53:08.302076] [INFO ] [MAIN ] BX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:53:08.306882] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T17:53:08.363102] [DEBUG] [LOCAL ] BX: Loaded 53502 existing records from primary storage. [2025-09-17T17:53:08.363352] [INFO ] [MAIN ] BX: Loaded 53502 existing records. [2025-09-17T17:53:08.421031] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-01. [2025-09-17T17:53:08.552808] [WARN ] [MAIN ] BX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:53:08.553228] [INFO ] [MAIN ] BX: Wiping existing primary data before full refresh. [2025-09-17T17:53:08.553359] [INFO ] [LOCAL ] BX: Starting deletion of primary data. [2025-09-17T17:53:08.564322] [DEBUG] [LOCAL ] BX: Deleted primary data file. [2025-09-17T17:53:08.576025] [INFO ] [MAIN ] BX: Starting full primary refresh. [2025-09-17T17:53:08.639500] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T17:53:08.957396] [INFO ] [REMOTE ] BX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:53:09.134873] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T17:53:09.215772] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-11. [2025-09-17T17:53:10.015781] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2024-12. [2025-09-17T17:53:10.815773] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-02. [2025-09-17T17:53:10.867746] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T17:53:11.323344] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T17:53:11.615799] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-03. [2025-09-17T17:53:11.742089] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T17:53:12.320434] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T17:53:12.415762] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-04. [2025-09-17T17:53:13.035579] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T17:53:13.215792] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-01. [2025-09-17T17:53:14.015779] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-05. [2025-09-17T17:53:14.790820] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T17:53:14.815724] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-06. [2025-09-17T17:53:14.932701] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T17:53:15.506233] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T17:53:15.615721] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-07. [2025-09-17T17:53:16.065738] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T17:53:16.415829] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-08. [2025-09-17T17:53:17.061598] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T17:53:17.215862] [INFO ] [REMOTE ] BX: Fetching primary data for 2024-12. [2025-09-17T17:53:18.015832] [INFO ] [REMOTE ] BWNB: Fetching primary data for 2025-09. [2025-09-17T17:53:18.642468] [INFO ] [REMOTE ] BWNB: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T17:53:18.643591] [INFO ] [REMOTE ] BWNB: Full fetch complete (5709 records). [2025-09-17T17:53:18.643725] [DEBUG] [VALIDATOR ] BWNB: Validating primary data. [2025-09-17T17:53:18.817077] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-03. [2025-09-17T17:53:19.044929] [DEBUG] [VALIDATOR ] BWNB: All expected trading days are present. [2025-09-17T17:53:19.045140] [DEBUG] [VALIDATOR ] BWNB: Primary data validation passed. [2025-09-17T17:53:19.045386] [INFO ] [MAIN ] BWNB: Fetched primary data is valid. [2025-09-17T17:53:19.045458] [DEBUG] [LOCAL ] BWNB: Saving primary data. [2025-09-17T17:53:19.045982] [DEBUG] [LOCAL ] BWNB: Trimmed 5709 records to 4492 (keeping 200 days of data) [2025-09-17T17:53:19.076284] [DEBUG] [LOCAL ] BWNB: Primary data saved (4492 records). [2025-09-17T17:53:19.076420] [INFO ] [MAIN ] BWNB: Full history saved. [2025-09-17T17:53:19.076507] [INFO ] [MAIN ] Update Progress: 369/2371 symbols completed. BWNB took 23.6s. Estimated remaining: 4h 49m 6s. Rate: 6.9 symbols/min [2025-09-17T17:53:19.258824] [INFO ] [MAIN ] BXC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:53:19.295166] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T17:53:19.312194] [DEBUG] [LOCAL ] BXC: Loaded 13555 existing records from primary storage. [2025-09-17T17:53:19.312342] [INFO ] [MAIN ] BXC: Loaded 13555 existing records. [2025-09-17T17:53:19.500441] [WARN ] [MAIN ] BXC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:53:19.500712] [INFO ] [MAIN ] BXC: Wiping existing primary data before full refresh. [2025-09-17T17:53:19.500772] [INFO ] [LOCAL ] BXC: Starting deletion of primary data. [2025-09-17T17:53:19.501254] [DEBUG] [LOCAL ] BXC: Deleted primary data file. [2025-09-17T17:53:19.501302] [INFO ] [MAIN ] BXC: Starting full primary refresh. [2025-09-17T17:53:19.617731] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-02. [2025-09-17T17:53:19.629235] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T17:53:19.895904] [INFO ] [REMOTE ] BXC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:53:20.415787] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-11. [2025-09-17T17:53:21.215785] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-04. [2025-09-17T17:53:21.362334] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T17:53:21.544703] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-17T17:53:21.589320] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T17:53:22.015825] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-05. [2025-09-17T17:53:22.815777] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-01. [2025-09-17T17:53:22.825261] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T17:53:23.615792] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-06. [2025-09-17T17:53:24.313123] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T17:53:24.415793] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-03. [2025-09-17T17:53:24.572108] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T17:53:25.215794] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-02. [2025-09-17T17:53:26.015840] [INFO ] [REMOTE ] BXC: Fetching primary data for 2024-12. [2025-09-17T17:53:26.139119] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T17:53:26.777885] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T17:53:26.815800] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-01. [2025-09-17T17:53:26.979924] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T17:53:27.405267] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T17:53:27.615839] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-03. [2025-09-17T17:53:28.415887] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-02. [2025-09-17T17:53:29.199089] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T17:53:29.215718] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-03. [2025-09-17T17:53:29.511479] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T17:53:30.015857] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-07. [2025-09-17T17:53:30.070693] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T17:53:30.658257] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T17:53:30.815820] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-04. [2025-09-17T17:53:31.615722] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-04. [2025-09-17T17:53:31.934136] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T17:53:32.415803] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-05. [2025-09-17T17:53:33.215783] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-08. [2025-09-17T17:53:33.245415] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T17:53:33.318205] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T17:53:33.932071] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T17:53:34.015805] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-06. [2025-09-17T17:53:34.815810] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-05. [2025-09-17T17:53:34.837445] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T17:53:35.615822] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-04. [2025-09-17T17:53:36.415905] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-07. [2025-09-17T17:53:36.587750] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T17:53:37.009231] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T17:53:37.215818] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-06. [2025-09-17T17:53:37.838738] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-17T17:53:38.015778] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-05. [2025-09-17T17:53:38.815833] [INFO ] [REMOTE ] BWSN: Fetching primary data for 2025-09. [2025-09-17T17:53:39.615827] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-08. [2025-09-17T17:53:39.845303] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-17T17:53:39.997715] [INFO ] [REMOTE ] BWSN: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T17:53:39.998724] [INFO ] [REMOTE ] BWSN: Full fetch complete (6193 records). [2025-09-17T17:53:39.998792] [DEBUG] [VALIDATOR ] BWSN: Validating primary data. [2025-09-17T17:53:39.999181] [FATAL] [VALIDATOR ] BWSN: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:53:39.999263] [FATAL] [MAIN ] BWSN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:53:39.999299] [WARN ] [MAIN ] BWSN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:53:39.999340] [INFO ] [LOCAL ] BWSN: Starting deletion of primary data. [2025-09-17T17:53:39.999403] [DEBUG] [LOCAL ] BWSN: No primary data file found to delete. [2025-09-17T17:53:39.999441] [INFO ] [LOCAL ] BWSN: Starting deletion of derivative data. [2025-09-17T17:53:39.999773] [DEBUG] [LOCAL ] BWSN: Deleted derivative data file. [2025-09-17T17:53:39.999883] [INFO ] [MAIN ] Update Progress: 370/2371 symbols completed. BWSN took 37.9s. Estimated remaining: 4h 50m 4s. Rate: 6.9 symbols/min [2025-09-17T17:53:40.169018] [INFO ] [MAIN ] BXMT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:53:40.214701] [DEBUG] [LOCAL ] BXMT: Loaded 47249 existing records from primary storage. [2025-09-17T17:53:40.214840] [INFO ] [MAIN ] BXMT: Loaded 47249 existing records. [2025-09-17T17:53:40.400628] [WARN ] [MAIN ] BXMT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:53:40.401273] [INFO ] [MAIN ] BXMT: Wiping existing primary data before full refresh. [2025-09-17T17:53:40.401412] [INFO ] [LOCAL ] BXMT: Starting deletion of primary data. [2025-09-17T17:53:40.402706] [DEBUG] [LOCAL ] BXMT: Deleted primary data file. [2025-09-17T17:53:40.402785] [INFO ] [MAIN ] BXMT: Starting full primary refresh. [2025-09-17T17:53:40.435440] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-07. [2025-09-17T17:53:40.790025] [INFO ] [REMOTE ] BXMT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:53:40.791510] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T17:53:40.872234] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-17T17:53:41.215792] [INFO ] [REMOTE ] BXC: Fetching primary data for 2025-09. [2025-09-17T17:53:42.015808] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-06. [2025-09-17T17:53:42.179320] [INFO ] [REMOTE ] BXC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T17:53:42.182300] [INFO ] [REMOTE ] BXC: Full fetch complete (17414 records). [2025-09-17T17:53:42.182425] [DEBUG] [VALIDATOR ] BXC: Validating primary data. [2025-09-17T17:53:42.586234] [DEBUG] [VALIDATOR ] BXC: All expected trading days are present. [2025-09-17T17:53:42.586333] [DEBUG] [VALIDATOR ] BXC: Primary data validation passed. [2025-09-17T17:53:42.586875] [INFO ] [MAIN ] BXC: Fetched primary data is valid. [2025-09-17T17:53:42.586954] [DEBUG] [LOCAL ] BXC: Saving primary data. [2025-09-17T17:53:42.588012] [DEBUG] [LOCAL ] BXC: Trimmed 17414 records to 13601 (keeping 200 days of data) [2025-09-17T17:53:42.682263] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-17T17:53:42.715044] [DEBUG] [LOCAL ] BXC: Primary data saved (13601 records). [2025-09-17T17:53:42.715201] [INFO ] [MAIN ] BXC: Full history saved. [2025-09-17T17:53:42.715310] [INFO ] [MAIN ] Update Progress: 371/2371 symbols completed. BXC took 23.6s. Estimated remaining: 4h 49m 23s. Rate: 6.9 symbols/min [2025-09-17T17:53:42.819285] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-11. [2025-09-17T17:53:42.891988] [INFO ] [MAIN ] BXMX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:53:42.914036] [DEBUG] [LOCAL ] BXMX: Loaded 19672 existing records from primary storage. [2025-09-17T17:53:42.914179] [INFO ] [MAIN ] BXMX: Loaded 19672 existing records. [2025-09-17T17:53:43.095502] [WARN ] [MAIN ] BXMX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:53:43.095803] [INFO ] [MAIN ] BXMX: Wiping existing primary data before full refresh. [2025-09-17T17:53:43.095859] [INFO ] [LOCAL ] BXMX: Starting deletion of primary data. [2025-09-17T17:53:43.096482] [DEBUG] [LOCAL ] BXMX: Deleted primary data file. [2025-09-17T17:53:43.096529] [INFO ] [MAIN ] BXMX: Starting full primary refresh. [2025-09-17T17:53:43.464438] [INFO ] [REMOTE ] BXMX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:53:43.615794] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-11. [2025-09-17T17:53:44.144947] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-17T17:53:44.256460] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T17:53:44.420570] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-08. [2025-09-17T17:53:44.422559] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T17:53:45.215817] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-07. [2025-09-17T17:53:46.015806] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2024-12. [2025-09-17T17:53:46.476572] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T17:53:46.815742] [INFO ] [REMOTE ] BWXT: Fetching primary data for 2025-09. [2025-09-17T17:53:47.053218] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T17:53:47.365012] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-17T17:53:47.615776] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2024-12. [2025-09-17T17:53:48.375523] [INFO ] [REMOTE ] BWXT: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T17:53:48.381552] [INFO ] [REMOTE ] BWXT: Full fetch complete (66811 records). [2025-09-17T17:53:48.381736] [DEBUG] [VALIDATOR ] BWXT: Validating primary data. [2025-09-17T17:53:48.420971] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-01. [2025-09-17T17:53:48.768699] [DEBUG] [VALIDATOR ] BWXT: All expected trading days are present. [2025-09-17T17:53:48.768781] [DEBUG] [VALIDATOR ] BWXT: Primary data validation passed. [2025-09-17T17:53:48.769501] [INFO ] [MAIN ] BWXT: Fetched primary data is valid. [2025-09-17T17:53:48.769546] [DEBUG] [LOCAL ] BWXT: Saving primary data. [2025-09-17T17:53:48.770881] [DEBUG] [LOCAL ] BWXT: Trimmed 66811 records to 46675 (keeping 200 days of data) [2025-09-17T17:53:49.033543] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T17:53:49.119438] [DEBUG] [LOCAL ] BWXT: Primary data saved (46675 records). [2025-09-17T17:53:49.119575] [INFO ] [MAIN ] BWXT: Full history saved. [2025-09-17T17:53:49.119675] [INFO ] [MAIN ] Update Progress: 372/2371 symbols completed. BWXT took 43.5s. Estimated remaining: 4h 49m 2s. Rate: 6.9 symbols/min [2025-09-17T17:53:49.219154] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-01. [2025-09-17T17:53:49.292119] [INFO ] [MAIN ] BXP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:53:49.335659] [DEBUG] [LOCAL ] BXP: Loaded 49916 existing records from primary storage. [2025-09-17T17:53:49.335833] [INFO ] [MAIN ] BXP: Loaded 49916 existing records. [2025-09-17T17:53:49.511591] [WARN ] [MAIN ] BXP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:53:49.511879] [INFO ] [MAIN ] BXP: Wiping existing primary data before full refresh. [2025-09-17T17:53:49.511924] [INFO ] [LOCAL ] BXP: Starting deletion of primary data. [2025-09-17T17:53:49.512897] [DEBUG] [LOCAL ] BXP: Deleted primary data file. [2025-09-17T17:53:49.512947] [INFO ] [MAIN ] BXP: Starting full primary refresh. [2025-09-17T17:53:49.810284] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T17:53:49.891128] [INFO ] [REMOTE ] BXP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:53:50.015787] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-11. [2025-09-17T17:53:50.619521] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T17:53:50.815782] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-08. [2025-09-17T17:53:51.615804] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-02. [2025-09-17T17:53:51.708257] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T17:53:52.415798] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-02. [2025-09-17T17:53:52.586719] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T17:53:52.929364] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-17T17:53:53.215816] [INFO ] [REMOTE ] BX: Fetching primary data for 2025-09. [2025-09-17T17:53:54.015809] [INFO ] [REMOTE ] BXP: Fetching primary data for 2024-12. [2025-09-17T17:53:54.136536] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T17:53:54.815785] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-03. [2025-09-17T17:53:55.181769] [INFO ] [REMOTE ] BX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-17T17:53:55.189031] [INFO ] [REMOTE ] BX: Full fetch complete (77262 records). [2025-09-17T17:53:55.189194] [DEBUG] [VALIDATOR ] BX: Validating primary data. [2025-09-17T17:53:55.588436] [DEBUG] [VALIDATOR ] BX: All expected trading days are present. [2025-09-17T17:53:55.588536] [DEBUG] [VALIDATOR ] BX: Primary data validation passed. [2025-09-17T17:53:55.589459] [INFO ] [MAIN ] BX: Fetched primary data is valid. [2025-09-17T17:53:55.589624] [DEBUG] [LOCAL ] BX: Saving primary data. [2025-09-17T17:53:55.591271] [DEBUG] [LOCAL ] BX: Trimmed 77262 records to 53505 (keeping 200 days of data) [2025-09-17T17:53:55.663551] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-03. [2025-09-17T17:53:55.728500] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T17:53:55.984847] [DEBUG] [LOCAL ] BX: Primary data saved (53505 records). [2025-09-17T17:53:55.985004] [INFO ] [MAIN ] BX: Full history saved. [2025-09-17T17:53:55.987266] [INFO ] [MAIN ] Update Progress: 373/2371 symbols completed. BX took 47.9s. Estimated remaining: 4h 48m 44s. Rate: 6.9 symbols/min [2025-09-17T17:53:56.164390] [INFO ] [MAIN ] BXSL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:53:56.200489] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T17:53:56.251635] [DEBUG] [LOCAL ] BXSL: Loaded 47311 existing records from primary storage. [2025-09-17T17:53:56.251799] [INFO ] [MAIN ] BXSL: Loaded 47311 existing records. [2025-09-17T17:53:56.426049] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-01. [2025-09-17T17:53:56.431763] [WARN ] [MAIN ] BXSL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:53:56.432911] [INFO ] [MAIN ] BXSL: Wiping existing primary data before full refresh. [2025-09-17T17:53:56.432980] [INFO ] [LOCAL ] BXSL: Starting deletion of primary data. [2025-09-17T17:53:56.434124] [DEBUG] [LOCAL ] BXSL: Deleted primary data file. [2025-09-17T17:53:56.434177] [INFO ] [MAIN ] BXSL: Starting full primary refresh. [2025-09-17T17:53:56.808087] [INFO ] [REMOTE ] BXSL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:53:56.919245] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T17:53:57.215782] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-11. [2025-09-17T17:53:57.874160] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T17:53:58.015793] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-04. [2025-09-17T17:53:58.823459] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-04. [2025-09-17T17:53:58.825970] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T17:53:59.615833] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-02. [2025-09-17T17:53:59.762918] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T17:54:00.038991] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T17:54:00.415853] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2024-12. [2025-09-17T17:54:01.000501] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T17:54:01.215820] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-05. [2025-09-17T17:54:01.911609] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T17:54:02.015833] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-01. [2025-09-17T17:54:02.492134] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T17:54:02.815854] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-03. [2025-09-17T17:54:03.615868] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-06. [2025-09-17T17:54:03.684441] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T17:54:04.410484] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T17:54:04.415689] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-07. [2025-09-17T17:54:04.773793] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T17:54:05.070992] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T17:54:05.215777] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-08. [2025-09-17T17:54:06.015829] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-02. [2025-09-17T17:54:06.123310] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T17:54:06.815825] [INFO ] [REMOTE ] BXMX: Fetching primary data for 2025-09. [2025-09-17T17:54:07.623932] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-05. [2025-09-17T17:54:07.652559] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T17:54:07.845910] [INFO ] [REMOTE ] BXMX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T17:54:07.848878] [INFO ] [REMOTE ] BXMX: Full fetch complete (28498 records). [2025-09-17T17:54:07.849055] [DEBUG] [VALIDATOR ] BXMX: Validating primary data. [2025-09-17T17:54:08.253872] [DEBUG] [VALIDATOR ] BXMX: All expected trading days are present. [2025-09-17T17:54:08.253951] [DEBUG] [VALIDATOR ] BXMX: Primary data validation passed. [2025-09-17T17:54:08.254382] [INFO ] [MAIN ] BXMX: Fetched primary data is valid. [2025-09-17T17:54:08.254422] [DEBUG] [LOCAL ] BXMX: Saving primary data. [2025-09-17T17:54:08.255190] [DEBUG] [LOCAL ] BXMX: Trimmed 28498 records to 19632 (keeping 200 days of data) [2025-09-17T17:54:08.374277] [DEBUG] [LOCAL ] BXMX: Primary data saved (19632 records). [2025-09-17T17:54:08.374442] [INFO ] [MAIN ] BXMX: Full history saved. [2025-09-17T17:54:08.374542] [INFO ] [MAIN ] Update Progress: 374/2371 symbols completed. BXMX took 25.7s. Estimated remaining: 4h 48m 55s. Rate: 6.9 symbols/min [2025-09-17T17:54:08.421022] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-04. [2025-09-17T17:54:08.557082] [INFO ] [MAIN ] BY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:54:08.577603] [DEBUG] [LOCAL ] BY: Loaded 21379 existing records from primary storage. [2025-09-17T17:54:08.577795] [INFO ] [MAIN ] BY: Loaded 21379 existing records. [2025-09-17T17:54:08.758357] [WARN ] [MAIN ] BY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:54:08.758596] [INFO ] [MAIN ] BY: Wiping existing primary data before full refresh. [2025-09-17T17:54:08.758703] [INFO ] [LOCAL ] BY: Starting deletion of primary data. [2025-09-17T17:54:08.759256] [DEBUG] [LOCAL ] BY: Deleted primary data file. [2025-09-17T17:54:08.759301] [INFO ] [MAIN ] BY: Starting full primary refresh. [2025-09-17T17:54:09.117989] [INFO ] [REMOTE ] BY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:54:09.215793] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-03. [2025-09-17T17:54:09.285602] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T17:54:09.949164] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T17:54:10.015727] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-05. [2025-09-17T17:54:10.508856] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T17:54:10.815783] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-06. [2025-09-17T17:54:11.615864] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-04. [2025-09-17T17:54:11.772096] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T17:54:12.381565] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T17:54:12.415732] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-07. [2025-09-17T17:54:13.125281] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T17:54:13.215834] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-06. [2025-09-17T17:54:13.656508] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T17:54:14.015814] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-08. [2025-09-17T17:54:14.815795] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-11. [2025-09-17T17:54:14.955083] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T17:54:15.615739] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-05. [2025-09-17T17:54:15.684222] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T17:54:15.891798] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T17:54:16.415826] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-07. [2025-09-17T17:54:16.991882] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T17:54:17.215791] [INFO ] [REMOTE ] BXMT: Fetching primary data for 2025-09. [2025-09-17T17:54:18.015792] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-06. [2025-09-17T17:54:18.143301] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T17:54:18.815806] [INFO ] [REMOTE ] BY: Fetching primary data for 2024-12. [2025-09-17T17:54:19.052214] [INFO ] [REMOTE ] BXMT: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T17:54:19.058703] [INFO ] [REMOTE ] BXMT: Full fetch complete (69175 records). [2025-09-17T17:54:19.058902] [DEBUG] [VALIDATOR ] BXMT: Validating primary data. [2025-09-17T17:54:19.488681] [DEBUG] [VALIDATOR ] BXMT: All expected trading days are present. [2025-09-17T17:54:19.488942] [DEBUG] [VALIDATOR ] BXMT: Primary data validation passed. [2025-09-17T17:54:19.490376] [INFO ] [MAIN ] BXMT: Fetched primary data is valid. [2025-09-17T17:54:19.490540] [DEBUG] [LOCAL ] BXMT: Saving primary data. [2025-09-17T17:54:19.515606] [DEBUG] [LOCAL ] BXMT: Trimmed 69175 records to 47253 (keeping 200 days of data) [2025-09-17T17:54:19.517365] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T17:54:19.625995] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-08. [2025-09-17T17:54:19.782982] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T17:54:19.860975] [DEBUG] [LOCAL ] BXMT: Primary data saved (47253 records). [2025-09-17T17:54:19.861139] [INFO ] [MAIN ] BXMT: Full history saved. [2025-09-17T17:54:19.861231] [INFO ] [MAIN ] Update Progress: 375/2371 symbols completed. BXMT took 39.9s. Estimated remaining: 4h 49m 1s. Rate: 6.9 symbols/min [2025-09-17T17:54:20.033784] [INFO ] [MAIN ] BYD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:54:20.075323] [DEBUG] [LOCAL ] BYD: Loaded 45406 existing records from primary storage. [2025-09-17T17:54:20.075466] [INFO ] [MAIN ] BYD: Loaded 45406 existing records. [2025-09-17T17:54:20.253620] [WARN ] [MAIN ] BYD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:54:20.253953] [INFO ] [MAIN ] BYD: Wiping existing primary data before full refresh. [2025-09-17T17:54:20.254017] [INFO ] [LOCAL ] BYD: Starting deletion of primary data. [2025-09-17T17:54:20.255074] [DEBUG] [LOCAL ] BYD: Deleted primary data file. [2025-09-17T17:54:20.255136] [INFO ] [MAIN ] BYD: Starting full primary refresh. [2025-09-17T17:54:20.429217] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-07. [2025-09-17T17:54:20.613725] [INFO ] [REMOTE ] BYD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:54:21.206908] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T17:54:21.216490] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-11. [2025-09-17T17:54:22.015815] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-01. [2025-09-17T17:54:22.195761] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T17:54:22.651830] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T17:54:22.815843] [INFO ] [REMOTE ] BXP: Fetching primary data for 2025-09. [2025-09-17T17:54:22.907508] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T17:54:23.616004] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-02. [2025-09-17T17:54:24.415812] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-08. [2025-09-17T17:54:24.490455] [INFO ] [REMOTE ] BXP: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T17:54:24.497297] [INFO ] [REMOTE ] BXP: Full fetch complete (70999 records). [2025-09-17T17:54:24.505193] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T17:54:24.504898] [DEBUG] [VALIDATOR ] BXP: Validating primary data. [2025-09-17T17:54:24.895930] [DEBUG] [VALIDATOR ] BXP: All expected trading days are present. [2025-09-17T17:54:24.896010] [DEBUG] [VALIDATOR ] BXP: Primary data validation passed. [2025-09-17T17:54:24.896820] [INFO ] [MAIN ] BXP: Fetched primary data is valid. [2025-09-17T17:54:24.896901] [DEBUG] [LOCAL ] BXP: Saving primary data. [2025-09-17T17:54:24.898468] [DEBUG] [LOCAL ] BXP: Trimmed 70999 records to 49903 (keeping 200 days of data) [2025-09-17T17:54:25.214229] [DEBUG] [LOCAL ] BXP: Primary data saved (49903 records). [2025-09-17T17:54:25.214427] [INFO ] [MAIN ] BXP: Full history saved. [2025-09-17T17:54:25.214551] [INFO ] [MAIN ] Update Progress: 376/2371 symbols completed. BXP took 36.1s. Estimated remaining: 4h 48m 35s. Rate: 6.9 symbols/min [2025-09-17T17:54:25.227172] [INFO ] [REMOTE ] BYD: Fetching primary data for 2024-12. [2025-09-17T17:54:25.396141] [INFO ] [MAIN ] BYM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:54:25.413322] [DEBUG] [LOCAL ] BYM: Loaded 12284 existing records from primary storage. [2025-09-17T17:54:25.413456] [INFO ] [MAIN ] BYM: Loaded 12284 existing records. [2025-09-17T17:54:25.591121] [WARN ] [MAIN ] BYM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:54:25.591335] [INFO ] [MAIN ] BYM: Wiping existing primary data before full refresh. [2025-09-17T17:54:25.591379] [INFO ] [LOCAL ] BYM: Starting deletion of primary data. [2025-09-17T17:54:25.591782] [DEBUG] [LOCAL ] BYM: Deleted primary data file. [2025-09-17T17:54:25.591837] [INFO ] [MAIN ] BYM: Starting full primary refresh. [2025-09-17T17:54:25.955956] [INFO ] [REMOTE ] BYM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:54:26.015756] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-11. [2025-09-17T17:54:26.141603] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T17:54:26.815856] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-03. [2025-09-17T17:54:26.864949] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T17:54:26.882971] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T17:54:27.615766] [INFO ] [REMOTE ] BYM: Fetching primary data for 2024-12. [2025-09-17T17:54:27.747820] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T17:54:28.415807] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-04. [2025-09-17T17:54:28.552851] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T17:54:29.215729] [INFO ] [REMOTE ] BXSL: Fetching primary data for 2025-09. [2025-09-17T17:54:29.396909] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T17:54:30.015860] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-01. [2025-09-17T17:54:30.815807] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-01. [2025-09-17T17:54:30.874105] [INFO ] [REMOTE ] BXSL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T17:54:30.881639] [INFO ] [REMOTE ] BXSL: Full fetch complete (68928 records). [2025-09-17T17:54:30.881913] [DEBUG] [VALIDATOR ] BXSL: Validating primary data. [2025-09-17T17:54:31.004234] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T17:54:31.314635] [DEBUG] [VALIDATOR ] BXSL: All expected trading days are present. [2025-09-17T17:54:31.314741] [DEBUG] [VALIDATOR ] BXSL: Primary data validation passed. [2025-09-17T17:54:31.315493] [INFO ] [MAIN ] BXSL: Fetched primary data is valid. [2025-09-17T17:54:31.315534] [DEBUG] [LOCAL ] BXSL: Saving primary data. [2025-09-17T17:54:31.316872] [DEBUG] [LOCAL ] BXSL: Trimmed 68928 records to 47370 (keeping 200 days of data) [2025-09-17T17:54:31.609081] [DEBUG] [LOCAL ] BXSL: Primary data saved (47370 records). [2025-09-17T17:54:31.609215] [INFO ] [MAIN ] BXSL: Full history saved. [2025-09-17T17:54:31.609764] [INFO ] [MAIN ] Update Progress: 377/2371 symbols completed. BXSL took 35.6s. Estimated remaining: 4h 48m 14s. Rate: 6.9 symbols/min [2025-09-17T17:54:31.621319] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-05. [2025-09-17T17:54:31.780739] [INFO ] [MAIN ] BZH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:54:31.815730] [DEBUG] [LOCAL ] BZH: Loaded 32935 existing records from primary storage. [2025-09-17T17:54:31.815867] [INFO ] [MAIN ] BZH: Loaded 32935 existing records. [2025-09-17T17:54:31.994410] [WARN ] [MAIN ] BZH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:54:31.994673] [INFO ] [MAIN ] BZH: Wiping existing primary data before full refresh. [2025-09-17T17:54:31.994721] [INFO ] [LOCAL ] BZH: Starting deletion of primary data. [2025-09-17T17:54:31.995376] [DEBUG] [LOCAL ] BZH: Deleted primary data file. [2025-09-17T17:54:31.995425] [INFO ] [MAIN ] BZH: Starting full primary refresh. [2025-09-17T17:54:32.350804] [INFO ] [REMOTE ] BZH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:54:32.415751] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-02. [2025-09-17T17:54:32.458938] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T17:54:32.726995] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T17:54:33.151916] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T17:54:33.215806] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-11. [2025-09-17T17:54:34.015819] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-02. [2025-09-17T17:54:34.402164] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T17:54:34.815791] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-06. [2025-09-17T17:54:35.307331] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T17:54:35.615759] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-03. [2025-09-17T17:54:36.049861] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T17:54:36.415810] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-03. [2025-09-17T17:54:37.220787] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-07. [2025-09-17T17:54:37.236343] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T17:54:37.456481] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T17:54:38.015786] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-04. [2025-09-17T17:54:38.538787] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T17:54:38.815807] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-08. [2025-09-17T17:54:39.566476] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T17:54:39.615777] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-05. [2025-09-17T17:54:39.831884] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T17:54:40.415822] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-04. [2025-09-17T17:54:41.117273] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T17:54:41.215788] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-06. [2025-09-17T17:54:41.363536] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T17:54:42.015797] [INFO ] [REMOTE ] BZH: Fetching primary data for 2024-12. [2025-09-17T17:54:42.438863] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T17:54:42.815852] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-07. [2025-09-17T17:54:43.293624] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T17:54:43.615897] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-05. [2025-09-17T17:54:44.238278] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T17:54:44.415812] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-08. [2025-09-17T17:54:44.563147] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T17:54:45.215822] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-01. [2025-09-17T17:54:46.015782] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-06. [2025-09-17T17:54:46.135924] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T17:54:46.269218] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T17:54:46.521871] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T17:54:46.815833] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-02. [2025-09-17T17:54:47.615851] [INFO ] [REMOTE ] BY: Fetching primary data for 2025-09. [2025-09-17T17:54:48.281496] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T17:54:48.411487] [INFO ] [REMOTE ] BY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T17:54:48.414590] [INFO ] [REMOTE ] BY: Full fetch complete (28730 records). [2025-09-17T17:54:48.414720] [DEBUG] [VALIDATOR ] BY: Validating primary data. [2025-09-17T17:54:48.420858] [INFO ] [REMOTE ] BYD: Fetching primary data for 2025-09. [2025-09-17T17:54:48.805766] [DEBUG] [VALIDATOR ] BY: All expected trading days are present. [2025-09-17T17:54:48.805853] [DEBUG] [VALIDATOR ] BY: Primary data validation passed. [2025-09-17T17:54:48.806306] [INFO ] [MAIN ] BY: Fetched primary data is valid. [2025-09-17T17:54:48.806349] [DEBUG] [LOCAL ] BY: Saving primary data. [2025-09-17T17:54:48.807443] [DEBUG] [LOCAL ] BY: Trimmed 28730 records to 21446 (keeping 200 days of data) [2025-09-17T17:54:48.942741] [DEBUG] [LOCAL ] BY: Primary data saved (21446 records). [2025-09-17T17:54:48.942873] [INFO ] [MAIN ] BY: Full history saved. [2025-09-17T17:54:48.942998] [INFO ] [MAIN ] Update Progress: 378/2371 symbols completed. BY took 40.6s. Estimated remaining: 4h 48m 51s. Rate: 6.9 symbols/min [2025-09-17T17:54:49.112854] [INFO ] [MAIN ] C: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:54:49.166927] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-17T17:54:49.167090] [INFO ] [MAIN ] C: Loaded 53741 existing records. [2025-09-17T17:54:49.221262] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-03. [2025-09-17T17:54:49.349844] [WARN ] [MAIN ] C: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:54:49.350123] [INFO ] [MAIN ] C: Wiping existing primary data before full refresh. [2025-09-17T17:54:49.350167] [INFO ] [LOCAL ] C: Starting deletion of primary data. [2025-09-17T17:54:49.351252] [DEBUG] [LOCAL ] C: Deleted primary data file. [2025-09-17T17:54:49.351304] [INFO ] [MAIN ] C: Starting full primary refresh. [2025-09-17T17:54:49.719923] [INFO ] [REMOTE ] C: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:54:49.781351] [INFO ] [REMOTE ] BYD: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T17:54:49.787278] [INFO ] [REMOTE ] BYD: Full fetch complete (64843 records). [2025-09-17T17:54:49.787397] [DEBUG] [VALIDATOR ] BYD: Validating primary data. [2025-09-17T17:54:50.024615] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-07. [2025-09-17T17:54:50.203230] [DEBUG] [VALIDATOR ] BYD: All expected trading days are present. [2025-09-17T17:54:50.203369] [DEBUG] [VALIDATOR ] BYD: Primary data validation passed. [2025-09-17T17:54:50.204192] [INFO ] [MAIN ] BYD: Fetched primary data is valid. [2025-09-17T17:54:50.204256] [DEBUG] [LOCAL ] BYD: Saving primary data. [2025-09-17T17:54:50.206193] [DEBUG] [LOCAL ] BYD: Trimmed 64843 records to 45423 (keeping 200 days of data) [2025-09-17T17:54:50.323671] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T17:54:50.526237] [DEBUG] [LOCAL ] BYD: Primary data saved (45423 records). [2025-09-17T17:54:50.526400] [INFO ] [MAIN ] BYD: Full history saved. [2025-09-17T17:54:50.526495] [INFO ] [MAIN ] Update Progress: 379/2371 symbols completed. BYD took 30.7s. Estimated remaining: 4h 48m 5s. Rate: 6.9 symbols/min [2025-09-17T17:54:50.703277] [INFO ] [MAIN ] CAAP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:54:50.722915] [DEBUG] [LOCAL ] CAAP: Loaded 18993 existing records from primary storage. [2025-09-17T17:54:50.723057] [INFO ] [MAIN ] CAAP: Loaded 18993 existing records. [2025-09-17T17:54:50.822871] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-04. [2025-09-17T17:54:50.906690] [WARN ] [MAIN ] CAAP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:54:50.907005] [INFO ] [MAIN ] CAAP: Wiping existing primary data before full refresh. [2025-09-17T17:54:50.907054] [INFO ] [LOCAL ] CAAP: Starting deletion of primary data. [2025-09-17T17:54:50.907469] [DEBUG] [LOCAL ] CAAP: Deleted primary data file. [2025-09-17T17:54:50.907523] [INFO ] [MAIN ] CAAP: Starting full primary refresh. [2025-09-17T17:54:51.226933] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T17:54:51.287003] [INFO ] [REMOTE ] CAAP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:54:51.615774] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-11. [2025-09-17T17:54:52.368159] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T17:54:52.415760] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-05. [2025-09-17T17:54:52.804804] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T17:54:53.215797] [INFO ] [REMOTE ] C: Fetching primary data for 2024-11. [2025-09-17T17:54:53.791596] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T17:54:54.015815] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-08. [2025-09-17T17:54:54.774600] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T17:54:54.815800] [INFO ] [REMOTE ] BYM: Fetching primary data for 2025-09. [2025-09-17T17:54:55.443572] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-11 (2.23 seconds). [2025-09-17T17:54:55.470100] [INFO ] [REMOTE ] BYM: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T17:54:55.472388] [INFO ] [REMOTE ] BYM: Full fetch complete (17997 records). [2025-09-17T17:54:55.472458] [DEBUG] [VALIDATOR ] BYM: Validating primary data. [2025-09-17T17:54:55.619670] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2024-12. [2025-09-17T17:54:55.847654] [DEBUG] [VALIDATOR ] BYM: All expected trading days are present. [2025-09-17T17:54:55.847744] [DEBUG] [VALIDATOR ] BYM: Primary data validation passed. [2025-09-17T17:54:55.848143] [INFO ] [MAIN ] BYM: Fetched primary data is valid. [2025-09-17T17:54:55.848182] [DEBUG] [LOCAL ] BYM: Saving primary data. [2025-09-17T17:54:55.848877] [DEBUG] [LOCAL ] BYM: Trimmed 17997 records to 12343 (keeping 200 days of data) [2025-09-17T17:54:55.924608] [DEBUG] [LOCAL ] BYM: Primary data saved (12343 records). [2025-09-17T17:54:55.924775] [INFO ] [MAIN ] BYM: Full history saved. [2025-09-17T17:54:55.924860] [INFO ] [MAIN ] Update Progress: 380/2371 symbols completed. BYM took 30.7s. Estimated remaining: 4h 47m 39s. Rate: 6.9 symbols/min [2025-09-17T17:54:56.096990] [INFO ] [MAIN ] CABO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:54:56.116657] [DEBUG] [LOCAL ] CABO: Loaded 17848 existing records from primary storage. [2025-09-17T17:54:56.116810] [INFO ] [MAIN ] CABO: Loaded 17848 existing records. [2025-09-17T17:54:56.300587] [WARN ] [MAIN ] CABO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:54:56.300869] [INFO ] [MAIN ] CABO: Wiping existing primary data before full refresh. [2025-09-17T17:54:56.300924] [INFO ] [LOCAL ] CABO: Starting deletion of primary data. [2025-09-17T17:54:56.301498] [DEBUG] [LOCAL ] CABO: Deleted primary data file. [2025-09-17T17:54:56.301545] [INFO ] [MAIN ] CABO: Starting full primary refresh. [2025-09-17T17:54:56.420950] [INFO ] [REMOTE ] C: Fetching primary data for 2024-12. [2025-09-17T17:54:56.667384] [INFO ] [REMOTE ] CABO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:54:56.791524] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T17:54:57.215802] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-06. [2025-09-17T17:54:58.015848] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-11. [2025-09-17T17:54:58.573996] [INFO ] [REMOTE ] C: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-17T17:54:58.575072] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T17:54:58.658016] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T17:54:58.815779] [INFO ] [REMOTE ] C: Fetching primary data for 2025-01. [2025-09-17T17:54:59.615778] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-07. [2025-09-17T17:55:00.415784] [INFO ] [REMOTE ] CABO: Fetching primary data for 2024-12. [2025-09-17T17:55:00.945995] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T17:55:01.137929] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-17T17:55:01.215758] [INFO ] [REMOTE ] C: Fetching primary data for 2025-02. [2025-09-17T17:55:01.348131] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T17:55:02.015794] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-01. [2025-09-17T17:55:02.815809] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-08. [2025-09-17T17:55:02.865715] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T17:55:03.400782] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-17T17:55:03.616035] [INFO ] [REMOTE ] C: Fetching primary data for 2025-03. [2025-09-17T17:55:04.057428] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T17:55:04.415816] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-02. [2025-09-17T17:55:05.215774] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-01. [2025-09-17T17:55:05.412941] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T17:55:05.924683] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-17T17:55:06.015779] [INFO ] [REMOTE ] C: Fetching primary data for 2025-04. [2025-09-17T17:55:06.361968] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T17:55:06.815790] [INFO ] [REMOTE ] BZH: Fetching primary data for 2025-09. [2025-09-17T17:55:07.615792] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-03. [2025-09-17T17:55:07.982982] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T17:55:08.143342] [INFO ] [REMOTE ] BZH: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T17:55:08.148945] [INFO ] [REMOTE ] BZH: Full fetch complete (46885 records). [2025-09-17T17:55:08.149119] [DEBUG] [VALIDATOR ] BZH: Validating primary data. [2025-09-17T17:55:08.422121] [INFO ] [REMOTE ] C: Fetching primary data for 2025-05. [2025-09-17T17:55:08.567044] [DEBUG] [VALIDATOR ] BZH: All expected trading days are present. [2025-09-17T17:55:08.567191] [DEBUG] [VALIDATOR ] BZH: Primary data validation passed. [2025-09-17T17:55:08.568089] [INFO ] [MAIN ] BZH: Fetched primary data is valid. [2025-09-17T17:55:08.568183] [DEBUG] [LOCAL ] BZH: Saving primary data. [2025-09-17T17:55:08.582545] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T17:55:08.588251] [DEBUG] [LOCAL ] BZH: Trimmed 46885 records to 32957 (keeping 200 days of data) [2025-09-17T17:55:08.871200] [DEBUG] [LOCAL ] BZH: Primary data saved (32957 records). [2025-09-17T17:55:08.871367] [INFO ] [MAIN ] BZH: Full history saved. [2025-09-17T17:55:08.871477] [INFO ] [MAIN ] Update Progress: 381/2371 symbols completed. BZH took 37.3s. Estimated remaining: 4h 47m 53s. Rate: 6.9 symbols/min [2025-09-17T17:55:09.052872] [INFO ] [MAIN ] CACI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:55:09.080582] [DEBUG] [LOCAL ] CACI: Loaded 26198 existing records from primary storage. [2025-09-17T17:55:09.080752] [INFO ] [MAIN ] CACI: Loaded 26198 existing records. [2025-09-17T17:55:09.224185] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-04. [2025-09-17T17:55:09.265366] [WARN ] [MAIN ] CACI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:55:09.265660] [INFO ] [MAIN ] CACI: Wiping existing primary data before full refresh. [2025-09-17T17:55:09.265707] [INFO ] [LOCAL ] CACI: Starting deletion of primary data. [2025-09-17T17:55:09.266384] [DEBUG] [LOCAL ] CACI: Deleted primary data file. [2025-09-17T17:55:09.266432] [INFO ] [MAIN ] CACI: Starting full primary refresh. [2025-09-17T17:55:09.637510] [INFO ] [REMOTE ] CACI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:55:10.015775] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-02. [2025-09-17T17:55:10.337843] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T17:55:10.635564] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-17T17:55:10.656297] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T17:55:10.815813] [INFO ] [REMOTE ] C: Fetching primary data for 2025-06. [2025-09-17T17:55:11.615774] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-03. [2025-09-17T17:55:12.415797] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-05. [2025-09-17T17:55:12.664281] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T17:55:12.756476] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T17:55:13.215782] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-04. [2025-09-17T17:55:13.455087] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T17:55:13.893509] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T17:55:14.015734] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-05. [2025-09-17T17:55:14.815803] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-11. [2025-09-17T17:55:15.055186] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T17:55:15.615778] [INFO ] [REMOTE ] C: Fetching primary data for 2025-07. [2025-09-17T17:55:16.074090] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T17:55:16.415784] [INFO ] [REMOTE ] CACI: Fetching primary data for 2024-12. [2025-09-17T17:55:17.215806] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-06. [2025-09-17T17:55:17.545597] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T17:55:18.015751] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-01. [2025-09-17T17:55:18.076996] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-17T17:55:18.102519] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T17:55:18.815778] [INFO ] [REMOTE ] C: Fetching primary data for 2025-08. [2025-09-17T17:55:19.029183] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T17:55:19.615767] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-06. [2025-09-17T17:55:20.415842] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-07. [2025-09-17T17:55:20.642064] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T17:55:20.901689] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-17T17:55:21.215719] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-07. [2025-09-17T17:55:21.669870] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T17:55:22.015833] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-08. [2025-09-17T17:55:22.216442] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T17:55:22.815922] [INFO ] [REMOTE ] C: Fetching primary data for 2025-09. [2025-09-17T17:55:23.068425] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T17:55:23.615773] [INFO ] [REMOTE ] CABO: Fetching primary data for 2025-09. [2025-09-17T17:55:24.415795] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-08. [2025-09-17T17:55:24.534941] [INFO ] [REMOTE ] CABO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T17:55:24.537395] [INFO ] [REMOTE ] CABO: Full fetch complete (22897 records). [2025-09-17T17:55:24.537472] [DEBUG] [VALIDATOR ] CABO: Validating primary data. [2025-09-17T17:55:24.946370] [DEBUG] [VALIDATOR ] CABO: All expected trading days are present. [2025-09-17T17:55:24.946536] [DEBUG] [VALIDATOR ] CABO: Primary data validation passed. [2025-09-17T17:55:24.947300] [INFO ] [MAIN ] CABO: Fetched primary data is valid. [2025-09-17T17:55:24.947407] [DEBUG] [LOCAL ] CABO: Saving primary data. [2025-09-17T17:55:24.948543] [DEBUG] [LOCAL ] CABO: Trimmed 22897 records to 17771 (keeping 200 days of data) [2025-09-17T17:55:25.030751] [INFO ] [REMOTE ] C: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-17T17:55:25.083226] [INFO ] [REMOTE ] C: Full fetch complete (77676 records). [2025-09-17T17:55:25.087412] [DEBUG] [VALIDATOR ] C: Validating primary data. [2025-09-17T17:55:25.102519] [DEBUG] [LOCAL ] CABO: Primary data saved (17771 records). [2025-09-17T17:55:25.103159] [INFO ] [MAIN ] CABO: Full history saved. [2025-09-17T17:55:25.103398] [INFO ] [MAIN ] Update Progress: 382/2371 symbols completed. CABO took 29.2s. Estimated remaining: 4h 48m 23s. Rate: 6.9 symbols/min [2025-09-17T17:55:25.219787] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-02. [2025-09-17T17:55:25.429633] [INFO ] [MAIN ] CADE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:55:25.619163] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T17:55:25.798433] [DEBUG] [VALIDATOR ] C: All expected trading days are present. [2025-09-17T17:55:25.798562] [DEBUG] [VALIDATOR ] C: Primary data validation passed. [2025-09-17T17:55:25.800516] [DEBUG] [LOCAL ] CADE: Loaded 48730 existing records from primary storage. [2025-09-17T17:55:25.799630] [INFO ] [MAIN ] C: Fetched primary data is valid. [2025-09-17T17:55:25.800706] [INFO ] [MAIN ] CADE: Loaded 48730 existing records. [2025-09-17T17:55:25.800628] [DEBUG] [LOCAL ] C: Saving primary data. [2025-09-17T17:55:25.909310] [DEBUG] [LOCAL ] C: Trimmed 77676 records to 53741 (keeping 200 days of data) [2025-09-17T17:55:26.039285] [INFO ] [REMOTE ] CAAP: Fetching primary data for 2025-09. [2025-09-17T17:55:26.052135] [WARN ] [MAIN ] CADE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:55:26.081920] [INFO ] [MAIN ] CADE: Wiping existing primary data before full refresh. [2025-09-17T17:55:26.082705] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-17T17:55:26.085266] [DEBUG] [LOCAL ] CADE: Deleted primary data file. [2025-09-17T17:55:26.085536] [INFO ] [MAIN ] CADE: Starting full primary refresh. [2025-09-17T17:55:26.467949] [INFO ] [REMOTE ] CADE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:55:26.703072] [DEBUG] [LOCAL ] C: Primary data saved (53741 records). [2025-09-17T17:55:26.703237] [INFO ] [MAIN ] C: Full history saved. [2025-09-17T17:55:26.704397] [INFO ] [MAIN ] Update Progress: 383/2371 symbols completed. C took 37.8s. Estimated remaining: 4h 47m 38s. Rate: 6.9 symbols/min [2025-09-17T17:55:26.818402] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-11. [2025-09-17T17:55:26.897009] [INFO ] [MAIN ] CAE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:55:26.898726] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T17:55:26.949506] [DEBUG] [LOCAL ] CAE: Loaded 38936 existing records from primary storage. [2025-09-17T17:55:26.949677] [INFO ] [MAIN ] CAE: Loaded 38936 existing records. [2025-09-17T17:55:27.127789] [WARN ] [MAIN ] CAE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:55:27.128053] [INFO ] [MAIN ] CAE: Wiping existing primary data before full refresh. [2025-09-17T17:55:27.128096] [INFO ] [LOCAL ] CAE: Starting deletion of primary data. [2025-09-17T17:55:27.128983] [DEBUG] [LOCAL ] CAE: Deleted primary data file. [2025-09-17T17:55:27.129032] [INFO ] [MAIN ] CAE: Starting full primary refresh. [2025-09-17T17:55:27.456898] [INFO ] [REMOTE ] CAAP: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T17:55:27.495567] [INFO ] [REMOTE ] CAAP: Full fetch complete (27244 records). [2025-09-17T17:55:27.498820] [INFO ] [REMOTE ] CAE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:55:27.499067] [DEBUG] [VALIDATOR ] CAAP: Validating primary data. [2025-09-17T17:55:27.620813] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-03. [2025-09-17T17:55:27.894817] [DEBUG] [VALIDATOR ] CAAP: All expected trading days are present. [2025-09-17T17:55:27.894895] [DEBUG] [VALIDATOR ] CAAP: Primary data validation passed. [2025-09-17T17:55:27.895315] [INFO ] [MAIN ] CAAP: Fetched primary data is valid. [2025-09-17T17:55:27.895388] [DEBUG] [LOCAL ] CAAP: Saving primary data. [2025-09-17T17:55:27.896063] [DEBUG] [LOCAL ] CAAP: Trimmed 27244 records to 19057 (keeping 200 days of data) [2025-09-17T17:55:28.011204] [DEBUG] [LOCAL ] CAAP: Primary data saved (19057 records). [2025-09-17T17:55:28.011383] [INFO ] [MAIN ] CAAP: Full history saved. [2025-09-17T17:55:28.011520] [INFO ] [MAIN ] Update Progress: 384/2371 symbols completed. CAAP took 37.5s. Estimated remaining: 4h 46m 51s. Rate: 6.9 symbols/min [2025-09-17T17:55:28.194460] [INFO ] [MAIN ] CAF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:55:28.199761] [DEBUG] [LOCAL ] CAF: Loaded 3394 existing records from primary storage. [2025-09-17T17:55:28.199890] [INFO ] [MAIN ] CAF: Loaded 3394 existing records. [2025-09-17T17:55:28.394134] [WARN ] [MAIN ] CAF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:55:28.394669] [INFO ] [MAIN ] CAF: Wiping existing primary data before full refresh. [2025-09-17T17:55:28.394794] [INFO ] [LOCAL ] CAF: Starting deletion of primary data. [2025-09-17T17:55:28.395155] [DEBUG] [LOCAL ] CAF: Deleted primary data file. [2025-09-17T17:55:28.395272] [INFO ] [MAIN ] CAF: Starting full primary refresh. [2025-09-17T17:55:28.427358] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-11. [2025-09-17T17:55:28.614018] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T17:55:28.818720] [INFO ] [REMOTE ] CAF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:55:28.843279] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T17:55:29.215827] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-11. [2025-09-17T17:55:29.924329] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T17:55:30.015796] [INFO ] [REMOTE ] CADE: Fetching primary data for 2024-12. [2025-09-17T17:55:30.054582] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T17:55:30.110096] [DEBUG] [REMOTE ] CADE: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-17T17:55:30.110417] [WARN ] [REMOTE ] CADE: No data returned for month 2024-12 [2025-09-17T17:55:30.815825] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-01. [2025-09-17T17:55:31.615784] [INFO ] [REMOTE ] CAF: Fetching primary data for 2024-12. [2025-09-17T17:55:32.171626] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T17:55:32.237808] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T17:55:32.415780] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-02. [2025-09-17T17:55:33.215819] [INFO ] [REMOTE ] CAE: Fetching primary data for 2024-12. [2025-09-17T17:55:33.899761] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T17:55:34.015779] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-03. [2025-09-17T17:55:34.618958] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T17:55:34.815808] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-01. [2025-09-17T17:55:35.408513] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T17:55:35.615749] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-02. [2025-09-17T17:55:35.752973] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T17:55:36.206759] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T17:55:36.415759] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-04. [2025-09-17T17:55:37.215788] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-04. [2025-09-17T17:55:38.015790] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-01. [2025-09-17T17:55:38.192284] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T17:55:38.763332] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T17:55:38.815753] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-05. [2025-09-17T17:55:39.393598] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T17:55:39.615808] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-05. [2025-09-17T17:55:40.134974] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T17:55:40.415870] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-03. [2025-09-17T17:55:41.070692] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T17:55:41.215779] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-04. [2025-09-17T17:55:41.347160] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T17:55:41.802545] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T17:55:42.015783] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-05. [2025-09-17T17:55:42.620875] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T17:55:42.815831] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-06. [2025-09-17T17:55:43.421767] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T17:55:43.615779] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-06. [2025-09-17T17:55:44.415798] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-06. [2025-09-17T17:55:44.703087] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T17:55:45.215801] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-07. [2025-09-17T17:55:45.932637] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T17:55:45.969043] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T17:55:46.015823] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-08. [2025-09-17T17:55:46.496163] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T17:55:46.815797] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-07. [2025-09-17T17:55:47.615767] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-07. [2025-09-17T17:55:47.905901] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T17:55:48.415835] [INFO ] [REMOTE ] CAF: Fetching primary data for 2025-09. [2025-09-17T17:55:49.021544] [INFO ] [REMOTE ] CAF: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T17:55:49.022697] [INFO ] [REMOTE ] CAF: Full fetch complete (5925 records). [2025-09-17T17:55:49.022765] [DEBUG] [VALIDATOR ] CAF: Validating primary data. [2025-09-17T17:55:49.220884] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-02. [2025-09-17T17:55:49.387284] [DEBUG] [VALIDATOR ] CAF: All expected trading days are present. [2025-09-17T17:55:49.387388] [DEBUG] [VALIDATOR ] CAF: Primary data validation passed. [2025-09-17T17:55:49.387606] [INFO ] [MAIN ] CAF: Fetched primary data is valid. [2025-09-17T17:55:49.387715] [DEBUG] [LOCAL ] CAF: Saving primary data. [2025-09-17T17:55:49.388221] [DEBUG] [LOCAL ] CAF: Trimmed 5925 records to 3421 (keeping 200 days of data) [2025-09-17T17:55:49.433796] [DEBUG] [LOCAL ] CAF: Primary data saved (3421 records). [2025-09-17T17:55:49.436767] [INFO ] [MAIN ] CAF: Full history saved. [2025-09-17T17:55:49.436845] [INFO ] [MAIN ] Update Progress: 385/2371 symbols completed. CAF took 21.4s. Estimated remaining: 4h 47m 48s. Rate: 6.9 symbols/min [2025-09-17T17:55:49.481851] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T17:55:49.619629] [INFO ] [MAIN ] CAG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:55:49.670003] [DEBUG] [LOCAL ] CAG: Loaded 53658 existing records from primary storage. [2025-09-17T17:55:49.670164] [INFO ] [MAIN ] CAG: Loaded 53658 existing records. [2025-09-17T17:55:49.846214] [WARN ] [MAIN ] CAG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:55:49.846438] [INFO ] [MAIN ] CAG: Wiping existing primary data before full refresh. [2025-09-17T17:55:49.846505] [INFO ] [LOCAL ] CAG: Starting deletion of primary data. [2025-09-17T17:55:49.847701] [DEBUG] [LOCAL ] CAG: Deleted primary data file. [2025-09-17T17:55:49.847757] [INFO ] [MAIN ] CAG: Starting full primary refresh. [2025-09-17T17:55:50.016065] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-08. [2025-09-17T17:55:50.222918] [INFO ] [REMOTE ] CAG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:55:50.760071] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T17:55:50.815801] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-03. [2025-09-17T17:55:51.615771] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-08. [2025-09-17T17:55:51.933864] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T17:55:52.366259] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T17:55:52.415780] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-04. [2025-09-17T17:55:52.446620] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T17:55:53.215777] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-11. [2025-09-17T17:55:53.705214] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T17:55:54.015803] [INFO ] [REMOTE ] CADE: Fetching primary data for 2025-09. [2025-09-17T17:55:54.815781] [INFO ] [REMOTE ] CACI: Fetching primary data for 2025-09. [2025-09-17T17:55:55.332596] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-17T17:55:55.615755] [INFO ] [REMOTE ] CAG: Fetching primary data for 2024-12. [2025-09-17T17:55:55.897391] [INFO ] [REMOTE ] CADE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T17:55:55.904293] [INFO ] [REMOTE ] CADE: Full fetch complete (62593 records). [2025-09-17T17:55:55.904449] [DEBUG] [VALIDATOR ] CADE: Validating primary data. [2025-09-17T17:55:55.912316] [INFO ] [REMOTE ] CACI: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T17:55:55.985413] [INFO ] [REMOTE ] CACI: Full fetch complete (39209 records). [2025-09-17T17:55:55.996431] [DEBUG] [VALIDATOR ] CACI: Validating primary data. [2025-09-17T17:55:56.258890] [WARN ] [VALIDATOR ] CADE: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T17:55:56.278536] [FATAL] [MAIN ] CADE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:55:56.279451] [WARN ] [MAIN ] CADE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:55:56.306741] [INFO ] [LOCAL ] CADE: Starting deletion of primary data. [2025-09-17T17:55:56.376542] [DEBUG] [LOCAL ] CADE: No primary data file found to delete. [2025-09-17T17:55:56.398079] [INFO ] [LOCAL ] CADE: Starting deletion of derivative data. [2025-09-17T17:55:56.419981] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-05. [2025-09-17T17:55:56.419886] [DEBUG] [LOCAL ] CADE: Deleted derivative data file. [2025-09-17T17:55:56.426267] [INFO ] [MAIN ] Update Progress: 386/2371 symbols completed. CADE took 31.3s. Estimated remaining: 4h 47m 31s. Rate: 6.9 symbols/min [2025-09-17T17:55:56.584618] [DEBUG] [VALIDATOR ] CACI: All expected trading days are present. [2025-09-17T17:55:56.595870] [DEBUG] [VALIDATOR ] CACI: Primary data validation passed. [2025-09-17T17:55:56.607149] [INFO ] [MAIN ] CACI: Fetched primary data is valid. [2025-09-17T17:55:56.607224] [DEBUG] [LOCAL ] CACI: Saving primary data. [2025-09-17T17:55:56.660886] [DEBUG] [LOCAL ] CACI: Trimmed 39209 records to 26038 (keeping 200 days of data) [2025-09-17T17:55:56.680538] [INFO ] [MAIN ] CAH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:55:56.860513] [DEBUG] [LOCAL ] CACI: Primary data saved (26038 records). [2025-09-17T17:55:56.860719] [INFO ] [MAIN ] CACI: Full history saved. [2025-09-17T17:55:56.860825] [INFO ] [MAIN ] Update Progress: 387/2371 symbols completed. CACI took 48.0s. Estimated remaining: 4h 46m 40s. Rate: 6.9 symbols/min [2025-09-17T17:55:57.006045] [DEBUG] [LOCAL ] CAH: Loaded 51555 existing records from primary storage. [2025-09-17T17:55:57.025778] [INFO ] [MAIN ] CAH: Loaded 51555 existing records. [2025-09-17T17:55:57.091909] [INFO ] [MAIN ] CAL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:55:57.246966] [WARN ] [MAIN ] CAH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:55:57.247438] [INFO ] [MAIN ] CAH: Wiping existing primary data before full refresh. [2025-09-17T17:55:57.247507] [INFO ] [LOCAL ] CAH: Starting deletion of primary data. [2025-09-17T17:55:57.248533] [DEBUG] [LOCAL ] CAH: Deleted primary data file. [2025-09-17T17:55:57.248588] [INFO ] [MAIN ] CAH: Starting full primary refresh. [2025-09-17T17:55:57.474965] [DEBUG] [LOCAL ] CAL: Loaded 43386 existing records from primary storage. [2025-09-17T17:55:57.560959] [INFO ] [MAIN ] CAL: Loaded 43386 existing records. [2025-09-17T17:55:57.642750] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T17:55:57.716450] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-01. [2025-09-17T17:55:57.801338] [INFO ] [REMOTE ] CAH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:55:57.894228] [WARN ] [MAIN ] CAL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:55:57.894626] [INFO ] [MAIN ] CAL: Wiping existing primary data before full refresh. [2025-09-17T17:55:57.894717] [INFO ] [LOCAL ] CAL: Starting deletion of primary data. [2025-09-17T17:55:57.895842] [DEBUG] [LOCAL ] CAL: Deleted primary data file. [2025-09-17T17:55:57.896040] [INFO ] [MAIN ] CAL: Starting full primary refresh. [2025-09-17T17:55:58.002870] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T17:55:58.021021] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-11. [2025-09-17T17:55:58.296694] [INFO ] [REMOTE ] CAL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:55:58.815777] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-06. [2025-09-17T17:55:59.583400] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T17:55:59.615734] [INFO ] [REMOTE ] CAH: Fetching primary data for 2024-12. [2025-09-17T17:55:59.665431] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T17:56:00.329024] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T17:56:00.415769] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-07. [2025-09-17T17:56:00.916622] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T17:56:01.215779] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-01. [2025-09-17T17:56:01.732476] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T17:56:02.015768] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-08. [2025-09-17T17:56:02.815780] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-11. [2025-09-17T17:56:02.907481] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T17:56:03.598589] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T17:56:03.615679] [INFO ] [REMOTE ] CAE: Fetching primary data for 2025-09. [2025-09-17T17:56:04.056814] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T17:56:04.415765] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-02. [2025-09-17T17:56:04.644039] [INFO ] [REMOTE ] CAE: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T17:56:04.648904] [INFO ] [REMOTE ] CAE: Full fetch complete (55488 records). [2025-09-17T17:56:04.649028] [DEBUG] [VALIDATOR ] CAE: Validating primary data. [2025-09-17T17:56:05.041463] [DEBUG] [VALIDATOR ] CAE: All expected trading days are present. [2025-09-17T17:56:05.041546] [DEBUG] [VALIDATOR ] CAE: Primary data validation passed. [2025-09-17T17:56:05.042205] [INFO ] [MAIN ] CAE: Fetched primary data is valid. [2025-09-17T17:56:05.042251] [DEBUG] [LOCAL ] CAE: Saving primary data. [2025-09-17T17:56:05.043378] [DEBUG] [LOCAL ] CAE: Trimmed 55488 records to 38927 (keeping 200 days of data) [2025-09-17T17:56:05.216998] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-02. [2025-09-17T17:56:05.273395] [DEBUG] [LOCAL ] CAE: Primary data saved (38927 records). [2025-09-17T17:56:05.273530] [INFO ] [MAIN ] CAE: Full history saved. [2025-09-17T17:56:05.274206] [INFO ] [MAIN ] Update Progress: 388/2371 symbols completed. CAE took 38.6s. Estimated remaining: 4h 46m 30s. Rate: 6.9 symbols/min [2025-09-17T17:56:05.449317] [INFO ] [MAIN ] CALX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:56:05.491967] [DEBUG] [LOCAL ] CALX: Loaded 38851 existing records from primary storage. [2025-09-17T17:56:05.492142] [INFO ] [MAIN ] CALX: Loaded 38851 existing records. [2025-09-17T17:56:05.676245] [WARN ] [MAIN ] CALX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:56:05.676519] [INFO ] [MAIN ] CALX: Wiping existing primary data before full refresh. [2025-09-17T17:56:05.676570] [INFO ] [LOCAL ] CALX: Starting deletion of primary data. [2025-09-17T17:56:05.677433] [DEBUG] [LOCAL ] CALX: Deleted primary data file. [2025-09-17T17:56:05.677495] [INFO ] [MAIN ] CALX: Starting full primary refresh. [2025-09-17T17:56:06.022336] [INFO ] [REMOTE ] CAL: Fetching primary data for 2024-12. [2025-09-17T17:56:06.052713] [INFO ] [REMOTE ] CALX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:56:06.151679] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T17:56:06.816087] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-03. [2025-09-17T17:56:06.822092] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T17:56:07.615762] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-11. [2025-09-17T17:56:07.691704] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T17:56:08.415776] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-03. [2025-09-17T17:56:08.721557] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T17:56:09.204391] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T17:56:09.215670] [INFO ] [REMOTE ] CALX: Fetching primary data for 2024-12. [2025-09-17T17:56:10.015964] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-04. [2025-09-17T17:56:10.022600] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T17:56:10.646845] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T17:56:10.815765] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-01. [2025-09-17T17:56:11.529290] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T17:56:11.615755] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-01. [2025-09-17T17:56:12.178816] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T17:56:12.415821] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-02. [2025-09-17T17:56:13.137475] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T17:56:13.215785] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-02. [2025-09-17T17:56:13.798011] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T17:56:14.015768] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-04. [2025-09-17T17:56:14.459894] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T17:56:14.815843] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-03. [2025-09-17T17:56:15.615805] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-05. [2025-09-17T17:56:16.011225] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T17:56:16.381105] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T17:56:16.415795] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-04. [2025-09-17T17:56:17.215862] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-05. [2025-09-17T17:56:17.759618] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T17:56:18.015836] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-06. [2025-09-17T17:56:18.051866] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T17:56:18.815831] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-03. [2025-09-17T17:56:19.103304] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T17:56:19.615761] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-06. [2025-09-17T17:56:19.858070] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T17:56:20.415765] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-07. [2025-09-17T17:56:20.450787] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T17:56:21.216087] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-05. [2025-09-17T17:56:21.218918] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T17:56:22.015938] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-07. [2025-09-17T17:56:22.531653] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-17T17:56:22.815782] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-04. [2025-09-17T17:56:22.866943] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T17:56:23.615780] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-06. [2025-09-17T17:56:23.948710] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T17:56:24.144427] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T17:56:24.415791] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-08. [2025-09-17T17:56:24.870982] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T17:56:25.215854] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-07. [2025-09-17T17:56:26.015755] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-08. [2025-09-17T17:56:26.448418] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T17:56:26.765917] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T17:56:26.815801] [INFO ] [REMOTE ] CAG: Fetching primary data for 2025-09. [2025-09-17T17:56:27.615830] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-05. [2025-09-17T17:56:28.054664] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T17:56:28.415855] [INFO ] [REMOTE ] CAH: Fetching primary data for 2025-09. [2025-09-17T17:56:28.780033] [INFO ] [REMOTE ] CAG: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-17T17:56:28.786992] [INFO ] [REMOTE ] CAG: Full fetch complete (77491 records). [2025-09-17T17:56:28.787120] [DEBUG] [VALIDATOR ] CAG: Validating primary data. [2025-09-17T17:56:29.186353] [DEBUG] [VALIDATOR ] CAG: All expected trading days are present. [2025-09-17T17:56:29.186590] [DEBUG] [VALIDATOR ] CAG: Primary data validation passed. [2025-09-17T17:56:29.187453] [INFO ] [MAIN ] CAG: Fetched primary data is valid. [2025-09-17T17:56:29.187524] [DEBUG] [LOCAL ] CAG: Saving primary data. [2025-09-17T17:56:29.189309] [DEBUG] [LOCAL ] CAG: Trimmed 77491 records to 53658 (keeping 200 days of data) [2025-09-17T17:56:29.249411] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-08. [2025-09-17T17:56:29.327110] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T17:56:29.555743] [DEBUG] [LOCAL ] CAG: Primary data saved (53658 records). [2025-09-17T17:56:29.555884] [INFO ] [MAIN ] CAG: Full history saved. [2025-09-17T17:56:29.555966] [INFO ] [MAIN ] Update Progress: 389/2371 symbols completed. CAG took 40.1s. Estimated remaining: 4h 47m 41s. Rate: 6.9 symbols/min [2025-09-17T17:56:29.724793] [INFO ] [MAIN ] CANG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:56:29.749691] [DEBUG] [LOCAL ] CANG: Loaded 26623 existing records from primary storage. [2025-09-17T17:56:29.749819] [INFO ] [MAIN ] CANG: Loaded 26623 existing records. [2025-09-17T17:56:29.928626] [WARN ] [MAIN ] CANG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:56:29.929258] [INFO ] [MAIN ] CANG: Wiping existing primary data before full refresh. [2025-09-17T17:56:29.929482] [INFO ] [LOCAL ] CANG: Starting deletion of primary data. [2025-09-17T17:56:29.930232] [DEBUG] [LOCAL ] CANG: Deleted primary data file. [2025-09-17T17:56:29.930289] [INFO ] [MAIN ] CANG: Starting full primary refresh. [2025-09-17T17:56:30.028156] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-06. [2025-09-17T17:56:30.110405] [INFO ] [REMOTE ] CAH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T17:56:30.178989] [INFO ] [REMOTE ] CAH: Full fetch complete (74434 records). [2025-09-17T17:56:30.211237] [DEBUG] [VALIDATOR ] CAH: Validating primary data. [2025-09-17T17:56:30.445317] [INFO ] [REMOTE ] CANG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:56:30.718829] [DEBUG] [VALIDATOR ] CAH: All expected trading days are present. [2025-09-17T17:56:30.718927] [DEBUG] [VALIDATOR ] CAH: Primary data validation passed. [2025-09-17T17:56:30.719867] [INFO ] [MAIN ] CAH: Fetched primary data is valid. [2025-09-17T17:56:30.719933] [DEBUG] [LOCAL ] CAH: Saving primary data. [2025-09-17T17:56:30.721559] [DEBUG] [LOCAL ] CAH: Trimmed 74434 records to 51548 (keeping 200 days of data) [2025-09-17T17:56:30.816539] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-11. [2025-09-17T17:56:30.852886] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T17:56:31.079486] [DEBUG] [LOCAL ] CAH: Primary data saved (51548 records). [2025-09-17T17:56:31.079623] [INFO ] [MAIN ] CAH: Full history saved. [2025-09-17T17:56:31.081388] [INFO ] [MAIN ] Update Progress: 390/2371 symbols completed. CAH took 34.6s. Estimated remaining: 4h 46m 55s. Rate: 6.9 symbols/min [2025-09-17T17:56:31.250734] [INFO ] [MAIN ] CAPL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:56:31.261364] [DEBUG] [LOCAL ] CAPL: Loaded 5967 existing records from primary storage. [2025-09-17T17:56:31.261483] [INFO ] [MAIN ] CAPL: Loaded 5967 existing records. [2025-09-17T17:56:31.438163] [WARN ] [MAIN ] CAPL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:56:31.438397] [INFO ] [MAIN ] CAPL: Wiping existing primary data before full refresh. [2025-09-17T17:56:31.438442] [INFO ] [LOCAL ] CAPL: Starting deletion of primary data. [2025-09-17T17:56:31.438750] [DEBUG] [LOCAL ] CAPL: Deleted primary data file. [2025-09-17T17:56:31.438796] [INFO ] [MAIN ] CAPL: Starting full primary refresh. [2025-09-17T17:56:31.620871] [INFO ] [REMOTE ] CALX: Fetching primary data for 2025-09. [2025-09-17T17:56:31.811979] [INFO ] [REMOTE ] CAPL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:56:31.835369] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T17:56:31.846752] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T17:56:32.415775] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-07. [2025-09-17T17:56:33.202382] [INFO ] [REMOTE ] CALX: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T17:56:33.207240] [INFO ] [REMOTE ] CALX: Full fetch complete (54097 records). [2025-09-17T17:56:33.207373] [DEBUG] [VALIDATOR ] CALX: Validating primary data. [2025-09-17T17:56:33.220971] [INFO ] [REMOTE ] CANG: Fetching primary data for 2024-12. [2025-09-17T17:56:33.605538] [DEBUG] [VALIDATOR ] CALX: All expected trading days are present. [2025-09-17T17:56:33.605627] [DEBUG] [VALIDATOR ] CALX: Primary data validation passed. [2025-09-17T17:56:33.606358] [INFO ] [MAIN ] CALX: Fetched primary data is valid. [2025-09-17T17:56:33.606414] [DEBUG] [LOCAL ] CALX: Saving primary data. [2025-09-17T17:56:33.607759] [DEBUG] [LOCAL ] CALX: Trimmed 54097 records to 38843 (keeping 200 days of data) [2025-09-17T17:56:33.835018] [DEBUG] [LOCAL ] CALX: Primary data saved (38843 records). [2025-09-17T17:56:33.835156] [INFO ] [MAIN ] CALX: Full history saved. [2025-09-17T17:56:33.836504] [INFO ] [MAIN ] Update Progress: 391/2371 symbols completed. CALX took 28.6s. Estimated remaining: 4h 46m 17s. Rate: 6.9 symbols/min [2025-09-17T17:56:34.007238] [INFO ] [MAIN ] CARR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:56:34.015865] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-11. [2025-09-17T17:56:34.065790] [DEBUG] [LOCAL ] CARR: Loaded 53598 existing records from primary storage. [2025-09-17T17:56:34.066001] [INFO ] [MAIN ] CARR: Loaded 53598 existing records. [2025-09-17T17:56:34.249231] [WARN ] [MAIN ] CARR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:56:34.249776] [INFO ] [MAIN ] CARR: Wiping existing primary data before full refresh. [2025-09-17T17:56:34.249828] [INFO ] [LOCAL ] CARR: Starting deletion of primary data. [2025-09-17T17:56:34.277509] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T17:56:34.277584] [DEBUG] [LOCAL ] CARR: Deleted primary data file. [2025-09-17T17:56:34.287516] [INFO ] [MAIN ] CARR: Starting full primary refresh. [2025-09-17T17:56:34.690834] [INFO ] [REMOTE ] CARR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:56:34.695433] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T17:56:34.775221] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T17:56:34.815736] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2024-12. [2025-09-17T17:56:35.608061] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T17:56:35.615682] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-01. [2025-09-17T17:56:36.318304] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T17:56:36.415794] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-11. [2025-09-17T17:56:37.215793] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-02. [2025-09-17T17:56:37.839297] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T17:56:38.015822] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-03. [2025-09-17T17:56:38.191804] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T17:56:38.799748] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T17:56:38.815685] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-04. [2025-09-17T17:56:39.551010] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T17:56:39.615800] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-08. [2025-09-17T17:56:40.415831] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-01. [2025-09-17T17:56:41.137776] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T17:56:41.215855] [INFO ] [REMOTE ] CAL: Fetching primary data for 2025-09. [2025-09-17T17:56:41.730329] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T17:56:42.015774] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-02. [2025-09-17T17:56:42.408269] [INFO ] [REMOTE ] CAL: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T17:56:42.414711] [INFO ] [REMOTE ] CAL: Full fetch complete (61678 records). [2025-09-17T17:56:42.414880] [DEBUG] [VALIDATOR ] CAL: Validating primary data. [2025-09-17T17:56:42.808280] [DEBUG] [VALIDATOR ] CAL: All expected trading days are present. [2025-09-17T17:56:42.808367] [DEBUG] [VALIDATOR ] CAL: Primary data validation passed. [2025-09-17T17:56:42.809154] [INFO ] [MAIN ] CAL: Fetched primary data is valid. [2025-09-17T17:56:42.809218] [DEBUG] [LOCAL ] CAL: Saving primary data. [2025-09-17T17:56:42.810505] [DEBUG] [LOCAL ] CAL: Trimmed 61678 records to 43368 (keeping 200 days of data) [2025-09-17T17:56:42.868696] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-05. [2025-09-17T17:56:43.084726] [DEBUG] [LOCAL ] CAL: Primary data saved (43368 records). [2025-09-17T17:56:43.084873] [INFO ] [MAIN ] CAL: Full history saved. [2025-09-17T17:56:43.086423] [INFO ] [MAIN ] Update Progress: 392/2371 symbols completed. CAL took 46.2s. Estimated remaining: 4h 46m 11s. Rate: 6.9 symbols/min [2025-09-17T17:56:43.255436] [INFO ] [MAIN ] CARS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:56:43.298106] [DEBUG] [LOCAL ] CARS: Loaded 40574 existing records from primary storage. [2025-09-17T17:56:43.298253] [INFO ] [MAIN ] CARS: Loaded 40574 existing records. [2025-09-17T17:56:43.482382] [WARN ] [MAIN ] CARS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:56:43.482971] [INFO ] [MAIN ] CARS: Wiping existing primary data before full refresh. [2025-09-17T17:56:43.483071] [INFO ] [LOCAL ] CARS: Starting deletion of primary data. [2025-09-17T17:56:43.489885] [DEBUG] [LOCAL ] CARS: Deleted primary data file. [2025-09-17T17:56:43.499107] [INFO ] [MAIN ] CARS: Starting full primary refresh. [2025-09-17T17:56:43.587191] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T17:56:43.620213] [INFO ] [REMOTE ] CARR: Fetching primary data for 2024-12. [2025-09-17T17:56:43.620577] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T17:56:43.919382] [INFO ] [REMOTE ] CARS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:56:44.415784] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-03. [2025-09-17T17:56:45.215790] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-11. [2025-09-17T17:56:45.297310] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T17:56:45.678420] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T17:56:46.015778] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-01. [2025-09-17T17:56:46.721834] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T17:56:46.815817] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-06. [2025-09-17T17:56:47.490036] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T17:56:47.615773] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-07. [2025-09-17T17:56:47.811487] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T17:56:47.964098] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T17:56:48.415779] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-02. [2025-09-17T17:56:49.215791] [INFO ] [REMOTE ] CARS: Fetching primary data for 2024-12. [2025-09-17T17:56:49.914619] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T17:56:50.015804] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-08. [2025-09-17T17:56:50.528877] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T17:56:50.767493] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T17:56:50.815805] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-04. [2025-09-17T17:56:51.615808] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-01. [2025-09-17T17:56:51.912176] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T17:56:52.415806] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-05. [2025-09-17T17:56:52.864175] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T17:56:53.215792] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-02. [2025-09-17T17:56:53.687679] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T17:56:54.015816] [INFO ] [REMOTE ] CAPL: Fetching primary data for 2025-09. [2025-09-17T17:56:54.574148] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T17:56:54.722842] [INFO ] [REMOTE ] CAPL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T17:56:54.724281] [INFO ] [REMOTE ] CAPL: Full fetch complete (8968 records). [2025-09-17T17:56:54.724393] [DEBUG] [VALIDATOR ] CAPL: Validating primary data. [2025-09-17T17:56:54.820989] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-06. [2025-09-17T17:56:55.120166] [DEBUG] [VALIDATOR ] CAPL: All expected trading days are present. [2025-09-17T17:56:55.120260] [DEBUG] [VALIDATOR ] CAPL: Primary data validation passed. [2025-09-17T17:56:55.120498] [INFO ] [MAIN ] CAPL: Fetched primary data is valid. [2025-09-17T17:56:55.120563] [DEBUG] [LOCAL ] CAPL: Saving primary data. [2025-09-17T17:56:55.121503] [DEBUG] [LOCAL ] CAPL: Trimmed 8968 records to 5944 (keeping 200 days of data) [2025-09-17T17:56:55.161076] [DEBUG] [LOCAL ] CAPL: Primary data saved (5944 records). [2025-09-17T17:56:55.161241] [INFO ] [MAIN ] CAPL: Full history saved. [2025-09-17T17:56:55.161405] [INFO ] [MAIN ] Update Progress: 393/2371 symbols completed. CAPL took 24.1s. Estimated remaining: 4h 46m 19s. Rate: 6.9 symbols/min [2025-09-17T17:56:55.334962] [INFO ] [MAIN ] CAT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:56:55.391962] [DEBUG] [LOCAL ] CAT: Loaded 52929 existing records from primary storage. [2025-09-17T17:56:55.392118] [INFO ] [MAIN ] CAT: Loaded 52929 existing records. [2025-09-17T17:56:55.573231] [WARN ] [MAIN ] CAT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:56:55.573471] [INFO ] [MAIN ] CAT: Wiping existing primary data before full refresh. [2025-09-17T17:56:55.573517] [INFO ] [LOCAL ] CAT: Starting deletion of primary data. [2025-09-17T17:56:55.578521] [DEBUG] [LOCAL ] CAT: Deleted primary data file. [2025-09-17T17:56:55.578622] [INFO ] [MAIN ] CAT: Starting full primary refresh. [2025-09-17T17:56:55.622567] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-03. [2025-09-17T17:56:55.947259] [INFO ] [REMOTE ] CAT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:56:56.122693] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T17:56:56.415809] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-07. [2025-09-17T17:56:57.215811] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-03. [2025-09-17T17:56:57.334074] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T17:56:58.015824] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-04. [2025-09-17T17:56:58.076988] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T17:56:58.815784] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-08. [2025-09-17T17:56:59.137800] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T17:56:59.615777] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-04. [2025-09-17T17:56:59.754152] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T17:57:00.289039] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T17:57:00.415766] [INFO ] [REMOTE ] CANG: Fetching primary data for 2025-09. [2025-09-17T17:57:01.215849] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-05. [2025-09-17T17:57:01.473434] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T17:57:02.015787] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-11. [2025-09-17T17:57:02.815781] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-05. [2025-09-17T17:57:02.938560] [INFO ] [REMOTE ] CANG: Incremental fetch complete for 2025-09 (2.52 seconds). [2025-09-17T17:57:02.942935] [INFO ] [REMOTE ] CANG: Full fetch complete (40413 records). [2025-09-17T17:57:02.943019] [DEBUG] [VALIDATOR ] CANG: Validating primary data. [2025-09-17T17:57:03.329901] [DEBUG] [VALIDATOR ] CANG: All expected trading days are present. [2025-09-17T17:57:03.330001] [DEBUG] [VALIDATOR ] CANG: Primary data validation passed. [2025-09-17T17:57:03.330636] [INFO ] [MAIN ] CANG: Fetched primary data is valid. [2025-09-17T17:57:03.330716] [DEBUG] [LOCAL ] CANG: Saving primary data. [2025-09-17T17:57:03.331881] [DEBUG] [LOCAL ] CANG: Trimmed 40413 records to 26652 (keeping 200 days of data) [2025-09-17T17:57:03.443630] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-17T17:57:03.526797] [DEBUG] [LOCAL ] CANG: Primary data saved (26652 records). [2025-09-17T17:57:03.526951] [INFO ] [MAIN ] CANG: Full history saved. [2025-09-17T17:57:03.527076] [INFO ] [MAIN ] Update Progress: 394/2371 symbols completed. CANG took 34.0s. Estimated remaining: 4h 46m 9s. Rate: 6.9 symbols/min [2025-09-17T17:57:03.621572] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-06. [2025-09-17T17:57:03.702502] [INFO ] [MAIN ] CATO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:57:03.711036] [DEBUG] [LOCAL ] CATO: Loaded 7469 existing records from primary storage. [2025-09-17T17:57:03.711174] [INFO ] [MAIN ] CATO: Loaded 7469 existing records. [2025-09-17T17:57:03.900766] [WARN ] [MAIN ] CATO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:57:03.901039] [INFO ] [MAIN ] CATO: Wiping existing primary data before full refresh. [2025-09-17T17:57:03.901184] [INFO ] [LOCAL ] CATO: Starting deletion of primary data. [2025-09-17T17:57:03.901499] [DEBUG] [LOCAL ] CATO: Deleted primary data file. [2025-09-17T17:57:03.901558] [INFO ] [MAIN ] CATO: Starting full primary refresh. [2025-09-17T17:57:04.297898] [INFO ] [REMOTE ] CATO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:57:04.324707] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-11 (2.31 seconds). [2025-09-17T17:57:04.338720] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T17:57:04.415769] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-06. [2025-09-17T17:57:05.115100] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T17:57:05.215773] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-07. [2025-09-17T17:57:05.900419] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T17:57:06.015739] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-07. [2025-09-17T17:57:06.815750] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-11. [2025-09-17T17:57:07.075091] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T17:57:07.440150] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T17:57:07.615793] [INFO ] [REMOTE ] CAT: Fetching primary data for 2024-12. [2025-09-17T17:57:07.931204] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T17:57:08.415780] [INFO ] [REMOTE ] CATO: Fetching primary data for 2024-12. [2025-09-17T17:57:09.215874] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-08. [2025-09-17T17:57:09.433808] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T17:57:09.600531] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T17:57:10.015822] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-01. [2025-09-17T17:57:10.470273] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T17:57:10.738095] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T17:57:10.815757] [INFO ] [REMOTE ] CARR: Fetching primary data for 2025-09. [2025-09-17T17:57:11.615790] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-08. [2025-09-17T17:57:12.415905] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-02. [2025-09-17T17:57:12.714203] [INFO ] [REMOTE ] CARR: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T17:57:12.722382] [INFO ] [REMOTE ] CARR: Full fetch complete (77433 records). [2025-09-17T17:57:12.722553] [DEBUG] [VALIDATOR ] CARR: Validating primary data. [2025-09-17T17:57:13.137891] [DEBUG] [VALIDATOR ] CARR: All expected trading days are present. [2025-09-17T17:57:13.138339] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T17:57:13.138632] [DEBUG] [VALIDATOR ] CARR: Primary data validation passed. [2025-09-17T17:57:13.142368] [INFO ] [MAIN ] CARR: Fetched primary data is valid. [2025-09-17T17:57:13.143200] [DEBUG] [LOCAL ] CARR: Saving primary data. [2025-09-17T17:57:13.145261] [DEBUG] [LOCAL ] CARR: Trimmed 77433 records to 53598 (keeping 200 days of data) [2025-09-17T17:57:13.217572] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-01. [2025-09-17T17:57:13.398796] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T17:57:13.523493] [DEBUG] [LOCAL ] CARR: Primary data saved (53598 records). [2025-09-17T17:57:13.523666] [INFO ] [MAIN ] CARR: Full history saved. [2025-09-17T17:57:13.523785] [INFO ] [MAIN ] Update Progress: 395/2371 symbols completed. CARR took 39.7s. Estimated remaining: 4h 46m 7s. Rate: 6.9 symbols/min [2025-09-17T17:57:13.691578] [INFO ] [MAIN ] CAVA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:57:13.741734] [DEBUG] [LOCAL ] CAVA: Loaded 53553 existing records from primary storage. [2025-09-17T17:57:13.741899] [INFO ] [MAIN ] CAVA: Loaded 53553 existing records. [2025-09-17T17:57:13.918011] [WARN ] [MAIN ] CAVA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:57:13.918269] [INFO ] [MAIN ] CAVA: Wiping existing primary data before full refresh. [2025-09-17T17:57:13.918323] [INFO ] [LOCAL ] CAVA: Starting deletion of primary data. [2025-09-17T17:57:13.919271] [DEBUG] [LOCAL ] CAVA: Deleted primary data file. [2025-09-17T17:57:13.919320] [INFO ] [MAIN ] CAVA: Starting full primary refresh. [2025-09-17T17:57:14.018785] [INFO ] [REMOTE ] CARS: Fetching primary data for 2025-09. [2025-09-17T17:57:14.275753] [INFO ] [REMOTE ] CAVA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:57:14.815774] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-03. [2025-09-17T17:57:15.351084] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T17:57:15.426194] [INFO ] [REMOTE ] CARS: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T17:57:15.432850] [INFO ] [REMOTE ] CARS: Full fetch complete (55215 records). [2025-09-17T17:57:15.432958] [DEBUG] [VALIDATOR ] CARS: Validating primary data. [2025-09-17T17:57:15.629837] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T17:57:15.629916] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-02. [2025-09-17T17:57:15.825528] [DEBUG] [VALIDATOR ] CARS: All expected trading days are present. [2025-09-17T17:57:15.825613] [DEBUG] [VALIDATOR ] CARS: Primary data validation passed. [2025-09-17T17:57:15.826255] [INFO ] [MAIN ] CARS: Fetched primary data is valid. [2025-09-17T17:57:15.826298] [DEBUG] [LOCAL ] CARS: Saving primary data. [2025-09-17T17:57:15.827396] [DEBUG] [LOCAL ] CARS: Trimmed 55215 records to 40470 (keeping 200 days of data) [2025-09-17T17:57:16.074805] [DEBUG] [LOCAL ] CARS: Primary data saved (40470 records). [2025-09-17T17:57:16.074932] [INFO ] [MAIN ] CARS: Full history saved. [2025-09-17T17:57:16.075030] [INFO ] [MAIN ] Update Progress: 396/2371 symbols completed. CARS took 33.0s. Estimated remaining: 4h 45m 28s. Rate: 6.9 symbols/min [2025-09-17T17:57:16.254577] [INFO ] [MAIN ] CB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:57:16.311263] [DEBUG] [LOCAL ] CB: Loaded 50110 existing records from primary storage. [2025-09-17T17:57:16.311439] [INFO ] [MAIN ] CB: Loaded 50110 existing records. [2025-09-17T17:57:16.420862] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-04. [2025-09-17T17:57:16.491130] [WARN ] [MAIN ] CB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:57:16.491507] [INFO ] [MAIN ] CB: Wiping existing primary data before full refresh. [2025-09-17T17:57:16.491556] [INFO ] [LOCAL ] CB: Starting deletion of primary data. [2025-09-17T17:57:16.492609] [DEBUG] [LOCAL ] CB: Deleted primary data file. [2025-09-17T17:57:16.492694] [INFO ] [MAIN ] CB: Starting full primary refresh. [2025-09-17T17:57:16.859208] [INFO ] [REMOTE ] CB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:57:17.159607] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T17:57:17.215747] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-05. [2025-09-17T17:57:17.876106] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-17T17:57:17.904903] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T17:57:18.015744] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-06. [2025-09-17T17:57:18.722433] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T17:57:18.815781] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-11. [2025-09-17T17:57:19.615785] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-03. [2025-09-17T17:57:20.415788] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-07. [2025-09-17T17:57:20.707226] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T17:57:21.147209] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T17:57:21.215772] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-08. [2025-09-17T17:57:21.851179] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-17T17:57:22.015806] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-11. [2025-09-17T17:57:22.075670] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T17:57:22.815796] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-04. [2025-09-17T17:57:23.615788] [INFO ] [REMOTE ] CB: Fetching primary data for 2024-12. [2025-09-17T17:57:24.186095] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-17T17:57:24.415776] [INFO ] [REMOTE ] CATO: Fetching primary data for 2025-09. [2025-09-17T17:57:24.612953] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T17:57:25.215749] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-05. [2025-09-17T17:57:25.366510] [INFO ] [REMOTE ] CATO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T17:57:25.368351] [INFO ] [REMOTE ] CATO: Full fetch complete (12590 records). [2025-09-17T17:57:25.368438] [DEBUG] [VALIDATOR ] CATO: Validating primary data. [2025-09-17T17:57:25.748904] [DEBUG] [VALIDATOR ] CATO: All expected trading days are present. [2025-09-17T17:57:25.748997] [DEBUG] [VALIDATOR ] CATO: Primary data validation passed. [2025-09-17T17:57:25.749316] [INFO ] [MAIN ] CATO: Fetched primary data is valid. [2025-09-17T17:57:25.749369] [DEBUG] [LOCAL ] CATO: Saving primary data. [2025-09-17T17:57:25.750020] [DEBUG] [LOCAL ] CATO: Trimmed 12590 records to 7429 (keeping 200 days of data) [2025-09-17T17:57:25.813249] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-17T17:57:25.831700] [DEBUG] [LOCAL ] CATO: Primary data saved (7429 records). [2025-09-17T17:57:25.831801] [INFO ] [MAIN ] CATO: Full history saved. [2025-09-17T17:57:25.831888] [INFO ] [MAIN ] Update Progress: 397/2371 symbols completed. CATO took 22.3s. Estimated remaining: 4h 45m 24s. Rate: 6.9 symbols/min [2025-09-17T17:57:26.015773] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-01. [2025-09-17T17:57:26.815763] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2024-12. [2025-09-17T17:57:27.374873] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T17:57:27.615798] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-06. [2025-09-17T17:57:27.791003] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T17:57:28.415742] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-02. [2025-09-17T17:57:28.858012] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T17:57:29.215799] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-01. [2025-09-17T17:57:29.557986] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T17:57:30.015835] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-07. [2025-09-17T17:57:30.152875] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T17:57:30.815745] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-03. [2025-09-17T17:57:30.898805] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T17:57:31.615791] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-02. [2025-09-17T17:57:32.193519] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T17:57:32.415803] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-08. [2025-09-17T17:57:32.796334] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T17:57:33.215794] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-04. [2025-09-17T17:57:33.265442] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T17:57:34.015895] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-03. [2025-09-17T17:57:34.506299] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-17T17:57:34.805696] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T17:57:34.816052] [INFO ] [REMOTE ] CAT: Fetching primary data for 2025-09. [2025-09-17T17:57:35.615782] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-05. [2025-09-17T17:57:36.297262] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-17T17:57:36.415735] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-04. [2025-09-17T17:57:36.924756] [INFO ] [REMOTE ] CAT: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-17T17:57:36.931741] [INFO ] [REMOTE ] CAT: Full fetch complete (76389 records). [2025-09-17T17:57:36.931888] [DEBUG] [VALIDATOR ] CAT: Validating primary data. [2025-09-17T17:57:37.319450] [DEBUG] [VALIDATOR ] CAT: All expected trading days are present. [2025-09-17T17:57:37.319589] [DEBUG] [VALIDATOR ] CAT: Primary data validation passed. [2025-09-17T17:57:37.320448] [INFO ] [MAIN ] CAT: Fetched primary data is valid. [2025-09-17T17:57:37.320504] [DEBUG] [LOCAL ] CAT: Saving primary data. [2025-09-17T17:57:37.322111] [DEBUG] [LOCAL ] CAT: Trimmed 76389 records to 52932 (keeping 200 days of data) [2025-09-17T17:57:37.579038] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T17:57:37.611834] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-06. [2025-09-17T17:57:37.704076] [DEBUG] [LOCAL ] CAT: Primary data saved (52932 records). [2025-09-17T17:57:37.704230] [INFO ] [MAIN ] CAT: Full history saved. [2025-09-17T17:57:37.705072] [INFO ] [MAIN ] Update Progress: 398/2371 symbols completed. CAT took 42.5s. Estimated remaining: 4h 45m 31s. Rate: 6.9 symbols/min [2025-09-17T17:57:38.494500] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T17:57:38.505994] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-05. [2025-09-17T17:57:39.397601] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T17:57:39.408049] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-07. [2025-09-17T17:57:40.307071] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T17:57:40.318587] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-06. [2025-09-17T17:57:40.992614] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T17:57:41.005136] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-08. [2025-09-17T17:57:42.421783] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-17T17:57:42.432734] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-07. [2025-09-17T17:57:42.945585] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T17:57:42.956508] [INFO ] [REMOTE ] CB: Fetching primary data for 2025-09. [2025-09-17T17:57:44.623074] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-07 (2.19 seconds). [2025-09-17T17:57:44.635437] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-08. [2025-09-17T17:57:44.664027] [INFO ] [REMOTE ] CB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T17:57:44.670727] [INFO ] [REMOTE ] CB: Full fetch complete (72482 records). [2025-09-17T17:57:44.670871] [DEBUG] [VALIDATOR ] CB: Validating primary data. [2025-09-17T17:57:45.064544] [DEBUG] [VALIDATOR ] CB: All expected trading days are present. [2025-09-17T17:57:45.064658] [DEBUG] [VALIDATOR ] CB: Primary data validation passed. [2025-09-17T17:57:45.065439] [INFO ] [MAIN ] CB: Fetched primary data is valid. [2025-09-17T17:57:45.065483] [DEBUG] [LOCAL ] CB: Saving primary data. [2025-09-17T17:57:45.066932] [DEBUG] [LOCAL ] CB: Trimmed 72482 records to 50120 (keeping 200 days of data) [2025-09-17T17:57:45.384247] [DEBUG] [LOCAL ] CB: Primary data saved (50120 records). [2025-09-17T17:57:45.384386] [INFO ] [MAIN ] CB: Full history saved. [2025-09-17T17:57:45.385347] [INFO ] [MAIN ] Update Progress: 399/2371 symbols completed. CB took 29.3s. Estimated remaining: 4h 45m 18s. Rate: 6.9 symbols/min [2025-09-17T17:57:46.892404] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-08 (2.26 seconds). [2025-09-17T17:57:46.904369] [INFO ] [REMOTE ] CAVA: Fetching primary data for 2025-09. [2025-09-17T17:57:49.028376] [INFO ] [REMOTE ] CAVA: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-17T17:57:49.035584] [INFO ] [REMOTE ] CAVA: Full fetch complete (77178 records). [2025-09-17T17:57:49.035781] [DEBUG] [VALIDATOR ] CAVA: Validating primary data. [2025-09-17T17:57:49.435184] [DEBUG] [VALIDATOR ] CAVA: All expected trading days are present. [2025-09-17T17:57:49.435282] [DEBUG] [VALIDATOR ] CAVA: Primary data validation passed. [2025-09-17T17:57:49.436141] [INFO ] [MAIN ] CAVA: Fetched primary data is valid. [2025-09-17T17:57:49.436189] [DEBUG] [LOCAL ] CAVA: Saving primary data. [2025-09-17T17:57:49.437718] [DEBUG] [LOCAL ] CAVA: Trimmed 77178 records to 53553 (keeping 200 days of data) [2025-09-17T17:57:49.755986] [DEBUG] [LOCAL ] CAVA: Primary data saved (53553 records). [2025-09-17T17:57:49.756122] [INFO ] [MAIN ] CAVA: Full history saved. [2025-09-17T17:57:49.756206] [INFO ] [MAIN ] Update Progress: 400/2371 symbols completed. CAVA took 36.2s. Estimated remaining: 4h 44m 48s. Rate: 6.9 symbols/min [2025-09-17T17:57:50.354627] [INFO ] [MAIN ] CBAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:57:50.531760] [INFO ] [MAIN ] CBNA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:57:50.456719] [INFO ] [MAIN ] CBO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:57:50.538433] [INFO ] [MAIN ] CBL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:57:50.538951] [DEBUG] [LOCAL ] CBO: No existing data file found in primary storage. [2025-09-17T17:57:50.539698] [WARN ] [MAIN ] CBO: No existing data found, performing full refresh instead. [2025-09-17T17:57:50.540100] [INFO ] [MAIN ] CBO: Wiping existing primary data before full refresh. [2025-09-17T17:57:50.540168] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-17T17:57:50.540227] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-17T17:57:50.540378] [INFO ] [MAIN ] CBO: Starting full primary refresh. [2025-09-17T17:57:50.603602] [DEBUG] [LOCAL ] CBNA: Loaded 2964 existing records from primary storage. [2025-09-17T17:57:50.647969] [INFO ] [MAIN ] CBNA: Loaded 2964 existing records. [2025-09-17T17:57:50.690485] [DEBUG] [LOCAL ] CBL: Loaded 16900 existing records from primary storage. [2025-09-17T17:57:50.659990] [DEBUG] [LOCAL ] CBAN: Loaded 11184 existing records from primary storage. [2025-09-17T17:57:50.729784] [INFO ] [MAIN ] CBL: Loaded 16900 existing records. [2025-09-17T17:57:50.754205] [INFO ] [MAIN ] CBAN: Loaded 11184 existing records. [2025-09-17T17:57:51.413204] [WARN ] [MAIN ] CBNA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:57:51.409685] [WARN ] [MAIN ] CBAN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:57:51.487418] [INFO ] [MAIN ] CBAN: Wiping existing primary data before full refresh. [2025-09-17T17:57:51.482159] [INFO ] [MAIN ] CBNA: Wiping existing primary data before full refresh. [2025-09-17T17:57:51.519656] [INFO ] [LOCAL ] CBNA: Starting deletion of primary data. [2025-09-17T17:57:51.519579] [INFO ] [REMOTE ] CBO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:57:51.520075] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-11. [2025-09-17T17:57:51.497377] [WARN ] [MAIN ] CBL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:57:51.519778] [INFO ] [LOCAL ] CBAN: Starting deletion of primary data. [2025-09-17T17:57:51.520720] [INFO ] [MAIN ] CBL: Wiping existing primary data before full refresh. [2025-09-17T17:57:51.521452] [INFO ] [LOCAL ] CBL: Starting deletion of primary data. [2025-09-17T17:57:51.520628] [DEBUG] [LOCAL ] CBNA: Deleted primary data file. [2025-09-17T17:57:51.521515] [DEBUG] [LOCAL ] CBAN: Deleted primary data file. [2025-09-17T17:57:51.521755] [INFO ] [MAIN ] CBNA: Starting full primary refresh. [2025-09-17T17:57:51.521793] [INFO ] [MAIN ] CBAN: Starting full primary refresh. [2025-09-17T17:57:51.532632] [DEBUG] [LOCAL ] CBL: Deleted primary data file. [2025-09-17T17:57:51.553813] [INFO ] [MAIN ] CBL: Starting full primary refresh. [2025-09-17T17:57:51.943879] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T17:57:52.052444] [INFO ] [REMOTE ] CBO: Fetching primary data for 2024-12. [2025-09-17T17:57:52.403734] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:57:52.454209] [WARN ] [REMOTE ] CBO: No data returned for month 2024-12 [2025-09-17T17:57:52.544317] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-01. [2025-09-17T17:57:52.556884] [INFO ] [REMOTE ] CBAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:57:52.577453] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-11. [2025-09-17T17:57:52.577209] [INFO ] [REMOTE ] CBNA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:57:52.577871] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-11. [2025-09-17T17:57:52.660008] [INFO ] [REMOTE ] CBL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:57:52.660287] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-11. [2025-09-17T17:57:53.121945] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:57:53.122424] [WARN ] [REMOTE ] CBO: No data returned for month 2025-01 [2025-09-17T17:57:53.123062] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-02. [2025-09-17T17:57:53.313411] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T17:57:53.315149] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2024-12. [2025-09-17T17:57:53.342169] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:57:53.342664] [WARN ] [REMOTE ] CBO: No data returned for month 2025-02 [2025-09-17T17:57:53.343335] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-03. [2025-09-17T17:57:53.511004] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T17:57:53.513423] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2024-12. [2025-09-17T17:57:53.557246] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-03 (0.21 seconds). [2025-09-17T17:57:53.558808] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-04. [2025-09-17T17:57:53.840010] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-17T17:57:53.841404] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-05. [2025-09-17T17:57:53.855846] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T17:57:53.919503] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T17:57:53.970581] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T17:57:54.015795] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-01. [2025-09-17T17:57:54.815760] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-01. [2025-09-17T17:57:54.829990] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T17:57:54.890930] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T17:57:55.301603] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T17:57:55.615796] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-02. [2025-09-17T17:57:56.409445] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T17:57:56.415698] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-03. [2025-09-17T17:57:57.215818] [INFO ] [REMOTE ] CBL: Fetching primary data for 2024-12. [2025-09-17T17:57:57.342439] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T17:57:58.015830] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-06. [2025-09-17T17:57:58.191343] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T17:57:58.284025] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-17T17:57:58.815824] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-04. [2025-09-17T17:57:59.580896] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T17:57:59.615784] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-02. [2025-09-17T17:58:00.415825] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-05. [2025-09-17T17:58:00.428781] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T17:58:01.215753] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-01. [2025-09-17T17:58:01.232543] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T17:58:02.015778] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-07. [2025-09-17T17:58:02.245916] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T17:58:02.429175] [INFO ] [REMOTE ] CBO: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-17T17:58:02.815777] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-08. [2025-09-17T17:58:03.107735] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:58:03.108047] [WARN ] [REMOTE ] CBO: No data returned for month 2025-08 [2025-09-17T17:58:03.615778] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-02. [2025-09-17T17:58:04.415753] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-06. [2025-09-17T17:58:04.809104] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T17:58:05.215782] [INFO ] [REMOTE ] CBO: Fetching primary data for 2025-09. [2025-09-17T17:58:05.355857] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T17:58:05.741486] [DEBUG] [REMOTE ] CBO: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:58:05.741857] [WARN ] [REMOTE ] CBO: No data returned for month 2025-09 [2025-09-17T17:58:05.741943] [INFO ] [REMOTE ] CBO: Full fetch complete (1016 records). [2025-09-17T17:58:05.742006] [DEBUG] [VALIDATOR ] CBO: Validating primary data. [2025-09-17T17:58:05.742677] [FATAL] [VALIDATOR ] CBO: Data is stale - most recent date (2025-07-10) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:58:05.742753] [FATAL] [MAIN ] CBO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:58:05.742826] [WARN ] [MAIN ] CBO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:58:05.742881] [INFO ] [LOCAL ] CBO: Starting deletion of primary data. [2025-09-17T17:58:05.742940] [DEBUG] [LOCAL ] CBO: No primary data file found to delete. [2025-09-17T17:58:05.742976] [INFO ] [LOCAL ] CBO: Starting deletion of derivative data. [2025-09-17T17:58:05.743029] [DEBUG] [LOCAL ] CBO: No derivative data file found to delete. [2025-09-17T17:58:05.743097] [INFO ] [MAIN ] Update Progress: 401/2371 symbols completed. CBO took 16.0s. Estimated remaining: 4h 45m 15s. Rate: 6.9 symbols/min [2025-09-17T17:58:05.914302] [INFO ] [MAIN ] CBRE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:58:05.965696] [DEBUG] [LOCAL ] CBRE: Loaded 50758 existing records from primary storage. [2025-09-17T17:58:05.965845] [INFO ] [MAIN ] CBRE: Loaded 50758 existing records. [2025-09-17T17:58:06.020945] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-07. [2025-09-17T17:58:06.147407] [WARN ] [MAIN ] CBRE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:58:06.147670] [INFO ] [MAIN ] CBRE: Wiping existing primary data before full refresh. [2025-09-17T17:58:06.147721] [INFO ] [LOCAL ] CBRE: Starting deletion of primary data. [2025-09-17T17:58:06.148984] [DEBUG] [LOCAL ] CBRE: Deleted primary data file. [2025-09-17T17:58:06.149136] [INFO ] [MAIN ] CBRE: Starting full primary refresh. [2025-09-17T17:58:06.505094] [INFO ] [REMOTE ] CBRE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:58:06.815764] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-11. [2025-09-17T17:58:06.945891] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T17:58:07.615762] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-08. [2025-09-17T17:58:08.415838] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-03. [2025-09-17T17:58:08.424605] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T17:58:08.735165] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T17:58:09.000902] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T17:58:09.215785] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-04. [2025-09-17T17:58:09.757779] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-17T17:58:10.015844] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-03. [2025-09-17T17:58:10.815778] [INFO ] [REMOTE ] CBAN: Fetching primary data for 2025-09. [2025-09-17T17:58:11.102415] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T17:58:11.600791] [INFO ] [REMOTE ] CBAN: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T17:58:11.602722] [INFO ] [REMOTE ] CBAN: Full fetch complete (15853 records). [2025-09-17T17:58:11.602824] [DEBUG] [VALIDATOR ] CBAN: Validating primary data. [2025-09-17T17:58:11.623484] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2024-12. [2025-09-17T17:58:11.970762] [DEBUG] [VALIDATOR ] CBAN: All expected trading days are present. [2025-09-17T17:58:11.970864] [DEBUG] [VALIDATOR ] CBAN: Primary data validation passed. [2025-09-17T17:58:11.971212] [INFO ] [MAIN ] CBAN: Fetched primary data is valid. [2025-09-17T17:58:11.971249] [DEBUG] [LOCAL ] CBAN: Saving primary data. [2025-09-17T17:58:11.971761] [DEBUG] [LOCAL ] CBAN: Trimmed 15853 records to 11202 (keeping 200 days of data) [2025-09-17T17:58:12.039306] [DEBUG] [LOCAL ] CBAN: Primary data saved (11202 records). [2025-09-17T17:58:12.039441] [INFO ] [MAIN ] CBAN: Full history saved. [2025-09-17T17:58:12.039537] [INFO ] [MAIN ] Update Progress: 402/2371 symbols completed. CBAN took 22.3s. Estimated remaining: 4h 44m 55s. Rate: 6.9 symbols/min [2025-09-17T17:58:12.207677] [INFO ] [MAIN ] CBT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:58:12.238226] [DEBUG] [LOCAL ] CBT: Loaded 31500 existing records from primary storage. [2025-09-17T17:58:12.238342] [INFO ] [MAIN ] CBT: Loaded 31500 existing records. [2025-09-17T17:58:12.430715] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-05. [2025-09-17T17:58:12.435783] [WARN ] [MAIN ] CBT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:58:12.437054] [INFO ] [MAIN ] CBT: Wiping existing primary data before full refresh. [2025-09-17T17:58:12.437123] [INFO ] [LOCAL ] CBT: Starting deletion of primary data. [2025-09-17T17:58:12.438117] [DEBUG] [LOCAL ] CBT: Deleted primary data file. [2025-09-17T17:58:12.438186] [INFO ] [MAIN ] CBT: Starting full primary refresh. [2025-09-17T17:58:12.800532] [INFO ] [REMOTE ] CBT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:58:13.073286] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T17:58:13.215790] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-06. [2025-09-17T17:58:13.445967] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T17:58:13.788416] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T17:58:14.015790] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-07. [2025-09-17T17:58:14.460173] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T17:58:14.815774] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-08. [2025-09-17T17:58:15.282315] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T17:58:15.615786] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-11. [2025-09-17T17:58:16.415816] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-01. [2025-09-17T17:58:17.221470] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-04. [2025-09-17T17:58:17.224444] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T17:58:17.884264] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T17:58:18.015777] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-02. [2025-09-17T17:58:18.371089] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T17:58:18.815845] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-05. [2025-09-17T17:58:19.519023] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T17:58:19.615827] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-06. [2025-09-17T17:58:19.746930] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T17:58:20.237826] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T17:58:20.415776] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-03. [2025-09-17T17:58:21.215783] [INFO ] [REMOTE ] CBNA: Fetching primary data for 2025-09. [2025-09-17T17:58:21.939035] [INFO ] [REMOTE ] CBNA: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T17:58:21.940015] [INFO ] [REMOTE ] CBNA: Full fetch complete (4831 records). [2025-09-17T17:58:21.940082] [DEBUG] [VALIDATOR ] CBNA: Validating primary data. [2025-09-17T17:58:22.016268] [INFO ] [REMOTE ] CBT: Fetching primary data for 2024-12. [2025-09-17T17:58:22.316237] [DEBUG] [VALIDATOR ] CBNA: All expected trading days are present. [2025-09-17T17:58:22.316354] [DEBUG] [VALIDATOR ] CBNA: Primary data validation passed. [2025-09-17T17:58:22.316536] [INFO ] [MAIN ] CBNA: Fetched primary data is valid. [2025-09-17T17:58:22.316717] [DEBUG] [LOCAL ] CBNA: Saving primary data. [2025-09-17T17:58:22.317303] [DEBUG] [LOCAL ] CBNA: Trimmed 4831 records to 2963 (keeping 200 days of data) [2025-09-17T17:58:22.361518] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T17:58:22.374592] [DEBUG] [LOCAL ] CBNA: Primary data saved (2963 records). [2025-09-17T17:58:22.374786] [INFO ] [MAIN ] CBNA: Full history saved. [2025-09-17T17:58:22.374867] [INFO ] [MAIN ] Update Progress: 403/2371 symbols completed. CBNA took 32.6s. Estimated remaining: 4h 44m 54s. Rate: 6.9 symbols/min [2025-09-17T17:58:22.546930] [INFO ] [MAIN ] CBU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:58:22.568131] [DEBUG] [LOCAL ] CBU: Loaded 22732 existing records from primary storage. [2025-09-17T17:58:22.568256] [INFO ] [MAIN ] CBU: Loaded 22732 existing records. [2025-09-17T17:58:22.744460] [WARN ] [MAIN ] CBU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:58:22.744705] [INFO ] [MAIN ] CBU: Wiping existing primary data before full refresh. [2025-09-17T17:58:22.744752] [INFO ] [LOCAL ] CBU: Starting deletion of primary data. [2025-09-17T17:58:22.745365] [DEBUG] [LOCAL ] CBU: Deleted primary data file. [2025-09-17T17:58:22.745410] [INFO ] [MAIN ] CBU: Starting full primary refresh. [2025-09-17T17:58:22.821044] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-04. [2025-09-17T17:58:23.116461] [INFO ] [REMOTE ] CBU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:58:23.230869] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T17:58:23.615813] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-01. [2025-09-17T17:58:24.415818] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-11. [2025-09-17T17:58:24.620807] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T17:58:24.950174] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T17:58:25.215783] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-05. [2025-09-17T17:58:25.241699] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T17:58:26.015824] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-02. [2025-09-17T17:58:26.815801] [INFO ] [REMOTE ] CBU: Fetching primary data for 2024-12. [2025-09-17T17:58:26.999943] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T17:58:27.452969] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T17:58:27.615721] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-07. [2025-09-17T17:58:27.672722] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T17:58:28.415758] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-06. [2025-09-17T17:58:28.778952] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T17:58:29.215805] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-01. [2025-09-17T17:58:30.015689] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-08. [2025-09-17T17:58:30.064415] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T17:58:30.102264] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T17:58:30.815762] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-03. [2025-09-17T17:58:31.030130] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T17:58:31.615791] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-07. [2025-09-17T17:58:32.231940] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T17:58:32.415779] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-02. [2025-09-17T17:58:32.971235] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T17:58:33.215773] [INFO ] [REMOTE ] CBL: Fetching primary data for 2025-09. [2025-09-17T17:58:33.437865] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T17:58:33.827033] [INFO ] [REMOTE ] CBL: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T17:58:33.829363] [INFO ] [REMOTE ] CBL: Full fetch complete (25860 records). [2025-09-17T17:58:33.829435] [DEBUG] [VALIDATOR ] CBL: Validating primary data. [2025-09-17T17:58:34.024464] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-03. [2025-09-17T17:58:34.198088] [DEBUG] [VALIDATOR ] CBL: All expected trading days are present. [2025-09-17T17:58:34.198168] [DEBUG] [VALIDATOR ] CBL: Primary data validation passed. [2025-09-17T17:58:34.198635] [INFO ] [MAIN ] CBL: Fetched primary data is valid. [2025-09-17T17:58:34.198736] [DEBUG] [LOCAL ] CBL: Saving primary data. [2025-09-17T17:58:34.199387] [DEBUG] [LOCAL ] CBL: Trimmed 25860 records to 16876 (keeping 200 days of data) [2025-09-17T17:58:34.303230] [DEBUG] [LOCAL ] CBL: Primary data saved (16876 records). [2025-09-17T17:58:34.303371] [INFO ] [MAIN ] CBL: Full history saved. [2025-09-17T17:58:34.303455] [INFO ] [MAIN ] Update Progress: 404/2371 symbols completed. CBL took 44.5s. Estimated remaining: 4h 45m 1s. Rate: 6.9 symbols/min [2025-09-17T17:58:34.478746] [INFO ] [MAIN ] CBX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:58:34.479055] [DEBUG] [LOCAL ] CBX: No existing data file found in primary storage. [2025-09-17T17:58:34.479096] [WARN ] [MAIN ] CBX: No existing data found, performing full refresh instead. [2025-09-17T17:58:34.479237] [INFO ] [MAIN ] CBX: Wiping existing primary data before full refresh. [2025-09-17T17:58:34.479304] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-17T17:58:34.479348] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-17T17:58:34.479380] [INFO ] [MAIN ] CBX: Starting full primary refresh. [2025-09-17T17:58:34.826005] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-04. [2025-09-17T17:58:34.830166] [INFO ] [REMOTE ] CBX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:58:35.307906] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T17:58:35.615857] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-08. [2025-09-17T17:58:36.192572] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T17:58:36.415788] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-11. [2025-09-17T17:58:36.609366] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:58:36.609747] [WARN ] [REMOTE ] CBX: No data returned for month 2024-11 [2025-09-17T17:58:37.035249] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T17:58:37.215799] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-04. [2025-09-17T17:58:38.015828] [INFO ] [REMOTE ] CBX: Fetching primary data for 2024-12. [2025-09-17T17:58:38.483560] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:58:38.483930] [WARN ] [REMOTE ] CBX: No data returned for month 2024-12 [2025-09-17T17:58:38.512534] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T17:58:38.815791] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-05. [2025-09-17T17:58:39.615774] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-05. [2025-09-17T17:58:39.939992] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T17:58:40.415784] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-06. [2025-09-17T17:58:41.147883] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T17:58:41.215789] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-01. [2025-09-17T17:58:41.421833] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:58:41.422276] [WARN ] [REMOTE ] CBX: No data returned for month 2025-01 [2025-09-17T17:58:41.423832] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T17:58:42.015782] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-02. [2025-09-17T17:58:42.211293] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:58:42.211695] [WARN ] [REMOTE ] CBX: No data returned for month 2025-02 [2025-09-17T17:58:42.815827] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-06. [2025-09-17T17:58:43.615811] [INFO ] [REMOTE ] CBRE: Fetching primary data for 2025-09. [2025-09-17T17:58:44.043085] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T17:58:44.415812] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-07. [2025-09-17T17:58:45.215798] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-03. [2025-09-17T17:58:45.259791] [INFO ] [REMOTE ] CBRE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T17:58:45.269398] [INFO ] [REMOTE ] CBRE: Full fetch complete (73861 records). [2025-09-17T17:58:45.269593] [DEBUG] [VALIDATOR ] CBRE: Validating primary data. [2025-09-17T17:58:45.418546] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:58:45.454215] [WARN ] [REMOTE ] CBX: No data returned for month 2025-03 [2025-09-17T17:58:45.684001] [DEBUG] [VALIDATOR ] CBRE: All expected trading days are present. [2025-09-17T17:58:45.684210] [DEBUG] [VALIDATOR ] CBRE: Primary data validation passed. [2025-09-17T17:58:45.685053] [INFO ] [MAIN ] CBRE: Fetched primary data is valid. [2025-09-17T17:58:45.685168] [DEBUG] [LOCAL ] CBRE: Saving primary data. [2025-09-17T17:58:45.702895] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T17:58:45.708964] [DEBUG] [LOCAL ] CBRE: Trimmed 73861 records to 50749 (keeping 200 days of data) [2025-09-17T17:58:46.015817] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-07. [2025-09-17T17:58:46.020778] [DEBUG] [LOCAL ] CBRE: Primary data saved (50749 records). [2025-09-17T17:58:46.021794] [INFO ] [MAIN ] CBRE: Full history saved. [2025-09-17T17:58:46.021906] [INFO ] [MAIN ] Update Progress: 405/2371 symbols completed. CBRE took 40.3s. Estimated remaining: 4h 45m 7s. Rate: 6.9 symbols/min [2025-09-17T17:58:46.194968] [INFO ] [MAIN ] CBZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:58:46.228043] [DEBUG] [LOCAL ] CBZ: Loaded 33222 existing records from primary storage. [2025-09-17T17:58:46.228189] [INFO ] [MAIN ] CBZ: Loaded 33222 existing records. [2025-09-17T17:58:46.411797] [WARN ] [MAIN ] CBZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:58:46.412059] [INFO ] [MAIN ] CBZ: Wiping existing primary data before full refresh. [2025-09-17T17:58:46.412106] [INFO ] [LOCAL ] CBZ: Starting deletion of primary data. [2025-09-17T17:58:46.412839] [DEBUG] [LOCAL ] CBZ: Deleted primary data file. [2025-09-17T17:58:46.412891] [INFO ] [MAIN ] CBZ: Starting full primary refresh. [2025-09-17T17:58:46.771125] [INFO ] [REMOTE ] CBZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:58:46.815765] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-11. [2025-09-17T17:58:47.349183] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T17:58:47.615782] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-08. [2025-09-17T17:58:48.308803] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T17:58:48.415740] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2024-12. [2025-09-17T17:58:48.957305] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T17:58:49.184529] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T17:58:49.215726] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-01. [2025-09-17T17:58:50.015812] [INFO ] [REMOTE ] CBU: Fetching primary data for 2025-09. [2025-09-17T17:58:50.302029] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T17:58:50.815761] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-04. [2025-09-17T17:58:51.004336] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:58:51.004626] [WARN ] [REMOTE ] CBX: No data returned for month 2025-04 [2025-09-17T17:58:51.087240] [INFO ] [REMOTE ] CBU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T17:58:51.090594] [INFO ] [REMOTE ] CBU: Full fetch complete (31748 records). [2025-09-17T17:58:51.090695] [DEBUG] [VALIDATOR ] CBU: Validating primary data. [2025-09-17T17:58:51.469061] [DEBUG] [VALIDATOR ] CBU: All expected trading days are present. [2025-09-17T17:58:51.469137] [DEBUG] [VALIDATOR ] CBU: Primary data validation passed. [2025-09-17T17:58:51.469853] [INFO ] [MAIN ] CBU: Fetched primary data is valid. [2025-09-17T17:58:51.469917] [DEBUG] [LOCAL ] CBU: Saving primary data. [2025-09-17T17:58:51.471624] [DEBUG] [LOCAL ] CBU: Trimmed 31748 records to 22866 (keeping 200 days of data) [2025-09-17T17:58:51.616083] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-08. [2025-09-17T17:58:51.622594] [DEBUG] [LOCAL ] CBU: Primary data saved (22866 records). [2025-09-17T17:58:51.622695] [INFO ] [MAIN ] CBU: Full history saved. [2025-09-17T17:58:51.622780] [INFO ] [MAIN ] Update Progress: 406/2371 symbols completed. CBU took 29.2s. Estimated remaining: 4h 44m 44s. Rate: 6.9 symbols/min [2025-09-17T17:58:51.794808] [INFO ] [MAIN ] CC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:58:51.849757] [DEBUG] [LOCAL ] CC: Loaded 53027 existing records from primary storage. [2025-09-17T17:58:51.849897] [INFO ] [MAIN ] CC: Loaded 53027 existing records. [2025-09-17T17:58:52.029177] [WARN ] [MAIN ] CC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:58:52.029408] [INFO ] [MAIN ] CC: Wiping existing primary data before full refresh. [2025-09-17T17:58:52.029453] [INFO ] [LOCAL ] CC: Starting deletion of primary data. [2025-09-17T17:58:52.030882] [DEBUG] [LOCAL ] CC: Deleted primary data file. [2025-09-17T17:58:52.030931] [INFO ] [MAIN ] CC: Starting full primary refresh. [2025-09-17T17:58:52.385062] [INFO ] [REMOTE ] CC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:58:52.415730] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-11. [2025-09-17T17:58:53.055357] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T17:58:53.215831] [INFO ] [REMOTE ] CBT: Fetching primary data for 2025-09. [2025-09-17T17:58:54.006535] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T17:58:54.016631] [INFO ] [REMOTE ] CC: Fetching primary data for 2024-12. [2025-09-17T17:58:54.407490] [INFO ] [REMOTE ] CBT: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T17:58:54.411759] [INFO ] [REMOTE ] CBT: Full fetch complete (45828 records). [2025-09-17T17:58:54.411888] [DEBUG] [VALIDATOR ] CBT: Validating primary data. [2025-09-17T17:58:54.795056] [DEBUG] [VALIDATOR ] CBT: All expected trading days are present. [2025-09-17T17:58:54.795145] [DEBUG] [VALIDATOR ] CBT: Primary data validation passed. [2025-09-17T17:58:54.795736] [INFO ] [MAIN ] CBT: Fetched primary data is valid. [2025-09-17T17:58:54.795792] [DEBUG] [LOCAL ] CBT: Saving primary data. [2025-09-17T17:58:54.797396] [DEBUG] [LOCAL ] CBT: Trimmed 45828 records to 31409 (keeping 200 days of data) [2025-09-17T17:58:54.856765] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-05. [2025-09-17T17:58:54.999004] [DEBUG] [LOCAL ] CBT: Primary data saved (31409 records). [2025-09-17T17:58:54.999143] [INFO ] [MAIN ] CBT: Full history saved. [2025-09-17T17:58:54.999243] [INFO ] [MAIN ] Update Progress: 407/2371 symbols completed. CBT took 43.0s. Estimated remaining: 4h 44m 9s. Rate: 6.9 symbols/min [2025-09-17T17:58:55.168257] [INFO ] [MAIN ] CCI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:58:55.222976] [DEBUG] [LOCAL ] CCI: Loaded 53166 existing records from primary storage. [2025-09-17T17:58:55.223154] [INFO ] [MAIN ] CCI: Loaded 53166 existing records. [2025-09-17T17:58:55.404938] [WARN ] [MAIN ] CCI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:58:55.405173] [INFO ] [MAIN ] CCI: Wiping existing primary data before full refresh. [2025-09-17T17:58:55.405219] [INFO ] [LOCAL ] CCI: Starting deletion of primary data. [2025-09-17T17:58:55.406476] [DEBUG] [LOCAL ] CCI: Deleted primary data file. [2025-09-17T17:58:55.406529] [INFO ] [MAIN ] CCI: Starting full primary refresh. [2025-09-17T17:58:55.620907] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-02. [2025-09-17T17:58:55.794128] [INFO ] [REMOTE ] CCI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:58:55.824303] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T17:58:55.840810] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T17:58:56.415813] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-06. [2025-09-17T17:58:56.765216] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T17:58:56.850071] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T17:58:57.215782] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-07. [2025-09-17T17:58:57.421313] [INFO ] [REMOTE ] CBX: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-17T17:58:58.015774] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-08. [2025-09-17T17:58:58.222337] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:58:58.222665] [WARN ] [REMOTE ] CBX: No data returned for month 2025-08 [2025-09-17T17:58:58.815778] [INFO ] [REMOTE ] CBX: Fetching primary data for 2025-09. [2025-09-17T17:58:59.106491] [DEBUG] [REMOTE ] CBX: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T17:58:59.106838] [WARN ] [REMOTE ] CBX: No data returned for month 2025-09 [2025-09-17T17:58:59.106924] [INFO ] [REMOTE ] CBX: Full fetch complete (1040 records). [2025-09-17T17:58:59.107004] [DEBUG] [VALIDATOR ] CBX: Validating primary data. [2025-09-17T17:58:59.107614] [FATAL] [VALIDATOR ] CBX: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T17:58:59.107706] [FATAL] [MAIN ] CBX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:58:59.107750] [WARN ] [MAIN ] CBX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:58:59.107792] [INFO ] [LOCAL ] CBX: Starting deletion of primary data. [2025-09-17T17:58:59.107858] [DEBUG] [LOCAL ] CBX: No primary data file found to delete. [2025-09-17T17:58:59.107894] [INFO ] [LOCAL ] CBX: Starting deletion of derivative data. [2025-09-17T17:58:59.107943] [DEBUG] [LOCAL ] CBX: No derivative data file found to delete. [2025-09-17T17:58:59.108002] [INFO ] [MAIN ] Update Progress: 408/2371 symbols completed. CBX took 24.8s. Estimated remaining: 4h 43m 39s. Rate: 6.9 symbols/min [2025-09-17T17:58:59.281857] [INFO ] [MAIN ] CCIA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:58:59.282165] [DEBUG] [LOCAL ] CCIA: No existing data file found in primary storage. [2025-09-17T17:58:59.282220] [WARN ] [MAIN ] CCIA: No existing data found, performing full refresh instead. [2025-09-17T17:58:59.282380] [INFO ] [MAIN ] CCIA: Wiping existing primary data before full refresh. [2025-09-17T17:58:59.282438] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-17T17:58:59.282492] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-17T17:58:59.282537] [INFO ] [MAIN ] CCIA: Starting full primary refresh. [2025-09-17T17:58:59.621006] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-11. [2025-09-17T17:58:59.660906] [INFO ] [REMOTE ] CCIA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:59:00.415829] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-11. [2025-09-17T17:59:00.973571] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T17:59:01.215779] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-03. [2025-09-17T17:59:01.449430] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T17:59:02.015772] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2024-12. [2025-09-17T17:59:02.723780] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T17:59:02.746328] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T17:59:02.815768] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-04. [2025-09-17T17:59:03.615815] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-01. [2025-09-17T17:59:04.168470] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T17:59:04.199263] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T17:59:04.415763] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-01. [2025-09-17T17:59:05.215773] [INFO ] [REMOTE ] CCI: Fetching primary data for 2024-12. [2025-09-17T17:59:06.015817] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-02. [2025-09-17T17:59:06.365126] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T17:59:06.368382] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T17:59:06.815793] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-05. [2025-09-17T17:59:07.103219] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T17:59:07.615837] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-02. [2025-09-17T17:59:08.254147] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T17:59:08.415800] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-01. [2025-09-17T17:59:09.215764] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-03. [2025-09-17T17:59:09.306899] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T17:59:09.469957] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-17T17:59:09.867756] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T17:59:10.015795] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-06. [2025-09-17T17:59:10.815776] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-03. [2025-09-17T17:59:11.380460] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T17:59:11.615840] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-02. [2025-09-17T17:59:12.415855] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-07. [2025-09-17T17:59:12.730773] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T17:59:13.215834] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-04. [2025-09-17T17:59:13.468403] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T17:59:13.713111] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T17:59:14.015817] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-04. [2025-09-17T17:59:14.456145] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T17:59:14.815743] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-08. [2025-09-17T17:59:14.936497] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T17:59:15.615781] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-05. [2025-09-17T17:59:16.244916] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T17:59:16.415748] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-05. [2025-09-17T17:59:16.892151] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T17:59:17.215772] [INFO ] [REMOTE ] CBZ: Fetching primary data for 2025-09. [2025-09-17T17:59:17.382009] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T17:59:18.015776] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-06. [2025-09-17T17:59:18.700684] [INFO ] [REMOTE ] CBZ: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T17:59:18.705843] [INFO ] [REMOTE ] CBZ: Full fetch complete (44233 records). [2025-09-17T17:59:18.705959] [DEBUG] [VALIDATOR ] CBZ: Validating primary data. [2025-09-17T17:59:18.820948] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-03. [2025-09-17T17:59:19.089013] [DEBUG] [VALIDATOR ] CBZ: All expected trading days are present. [2025-09-17T17:59:19.089117] [DEBUG] [VALIDATOR ] CBZ: Primary data validation passed. [2025-09-17T17:59:19.089749] [INFO ] [MAIN ] CBZ: Fetched primary data is valid. [2025-09-17T17:59:19.089823] [DEBUG] [LOCAL ] CBZ: Saving primary data. [2025-09-17T17:59:19.090871] [DEBUG] [LOCAL ] CBZ: Trimmed 44233 records to 33282 (keeping 200 days of data) [2025-09-17T17:59:19.284692] [DEBUG] [LOCAL ] CBZ: Primary data saved (33282 records). [2025-09-17T17:59:19.284829] [INFO ] [MAIN ] CBZ: Full history saved. [2025-09-17T17:59:19.284920] [INFO ] [MAIN ] Update Progress: 409/2371 symbols completed. CBZ took 33.3s. Estimated remaining: 4h 44m 25s. Rate: 6.9 symbols/min [2025-09-17T17:59:19.456167] [INFO ] [MAIN ] CCIF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:59:19.471750] [DEBUG] [LOCAL ] CCIF: Loaded 15299 existing records from primary storage. [2025-09-17T17:59:19.471879] [INFO ] [MAIN ] CCIF: Loaded 15299 existing records. [2025-09-17T17:59:19.620916] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-06. [2025-09-17T17:59:19.662147] [WARN ] [MAIN ] CCIF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:59:19.662429] [INFO ] [MAIN ] CCIF: Wiping existing primary data before full refresh. [2025-09-17T17:59:19.662541] [INFO ] [LOCAL ] CCIF: Starting deletion of primary data. [2025-09-17T17:59:19.663067] [DEBUG] [LOCAL ] CCIF: Deleted primary data file. [2025-09-17T17:59:19.663132] [INFO ] [MAIN ] CCIF: Starting full primary refresh. [2025-09-17T17:59:20.032775] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T17:59:20.059398] [INFO ] [REMOTE ] CCIF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:59:20.059812] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T17:59:20.415742] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-07. [2025-09-17T17:59:20.518601] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T17:59:21.215795] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-11. [2025-09-17T17:59:22.015806] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-04. [2025-09-17T17:59:22.230141] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T17:59:22.295211] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T17:59:22.815811] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-08. [2025-09-17T17:59:23.615802] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-07. [2025-09-17T17:59:24.129096] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T17:59:24.415812] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2024-12. [2025-09-17T17:59:24.491699] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-17T17:59:24.805386] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T17:59:25.215786] [INFO ] [REMOTE ] CC: Fetching primary data for 2025-09. [2025-09-17T17:59:25.364829] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T17:59:26.015826] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-01. [2025-09-17T17:59:26.815798] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-05. [2025-09-17T17:59:26.918877] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T17:59:27.092458] [INFO ] [REMOTE ] CC: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T17:59:27.099454] [INFO ] [REMOTE ] CC: Full fetch complete (75191 records). [2025-09-17T17:59:27.099626] [DEBUG] [VALIDATOR ] CC: Validating primary data. [2025-09-17T17:59:27.501361] [DEBUG] [VALIDATOR ] CC: All expected trading days are present. [2025-09-17T17:59:27.501480] [DEBUG] [VALIDATOR ] CC: Primary data validation passed. [2025-09-17T17:59:27.502294] [INFO ] [MAIN ] CC: Fetched primary data is valid. [2025-09-17T17:59:27.502358] [DEBUG] [LOCAL ] CC: Saving primary data. [2025-09-17T17:59:27.503870] [DEBUG] [LOCAL ] CC: Trimmed 75191 records to 53037 (keeping 200 days of data) [2025-09-17T17:59:27.616121] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-08. [2025-09-17T17:59:27.833768] [DEBUG] [LOCAL ] CC: Primary data saved (53037 records). [2025-09-17T17:59:27.833925] [INFO ] [MAIN ] CC: Full history saved. [2025-09-17T17:59:27.834940] [INFO ] [MAIN ] Update Progress: 410/2371 symbols completed. CC took 36.2s. Estimated remaining: 4h 44m 16s. Rate: 6.9 symbols/min [2025-09-17T17:59:28.002326] [INFO ] [MAIN ] CCJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:59:28.056483] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-09-17T17:59:28.056629] [INFO ] [MAIN ] CCJ: Loaded 53675 existing records. [2025-09-17T17:59:28.240596] [WARN ] [MAIN ] CCJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:59:28.240887] [INFO ] [MAIN ] CCJ: Wiping existing primary data before full refresh. [2025-09-17T17:59:28.240942] [INFO ] [LOCAL ] CCJ: Starting deletion of primary data. [2025-09-17T17:59:28.242091] [DEBUG] [LOCAL ] CCJ: Deleted primary data file. [2025-09-17T17:59:28.242166] [INFO ] [MAIN ] CCJ: Starting full primary refresh. [2025-09-17T17:59:28.322225] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T17:59:28.419113] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-02. [2025-09-17T17:59:28.641817] [INFO ] [REMOTE ] CCJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:59:28.909492] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T17:59:29.215798] [INFO ] [REMOTE ] CCIA: Fetching primary data for 2025-09. [2025-09-17T17:59:29.425472] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T17:59:29.573614] [INFO ] [REMOTE ] CCIA: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T17:59:29.574440] [INFO ] [REMOTE ] CCIA: Full fetch complete (2019 records). [2025-09-17T17:59:29.574507] [DEBUG] [VALIDATOR ] CCIA: Validating primary data. [2025-09-17T17:59:29.759097] [WARN ] [VALIDATOR ] CCIA: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T17:59:29.759305] [FATAL] [MAIN ] CCIA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T17:59:29.759363] [WARN ] [MAIN ] CCIA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T17:59:29.759405] [INFO ] [LOCAL ] CCIA: Starting deletion of primary data. [2025-09-17T17:59:29.759476] [DEBUG] [LOCAL ] CCIA: No primary data file found to delete. [2025-09-17T17:59:29.759518] [INFO ] [LOCAL ] CCIA: Starting deletion of derivative data. [2025-09-17T17:59:29.759568] [DEBUG] [LOCAL ] CCIA: No derivative data file found to delete. [2025-09-17T17:59:29.759675] [INFO ] [MAIN ] Update Progress: 411/2371 symbols completed. CCIA took 30.7s. Estimated remaining: 4h 43m 35s. Rate: 6.9 symbols/min [2025-09-17T17:59:29.928151] [INFO ] [MAIN ] CCK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:59:29.979812] [DEBUG] [LOCAL ] CCK: Loaded 46625 existing records from primary storage. [2025-09-17T17:59:29.979972] [INFO ] [MAIN ] CCK: Loaded 46625 existing records. [2025-09-17T17:59:30.021024] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-11. [2025-09-17T17:59:30.159422] [WARN ] [MAIN ] CCK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:59:30.159721] [INFO ] [MAIN ] CCK: Wiping existing primary data before full refresh. [2025-09-17T17:59:30.159773] [INFO ] [LOCAL ] CCK: Starting deletion of primary data. [2025-09-17T17:59:30.160988] [DEBUG] [LOCAL ] CCK: Deleted primary data file. [2025-09-17T17:59:30.161039] [INFO ] [MAIN ] CCK: Starting full primary refresh. [2025-09-17T17:59:30.520031] [INFO ] [REMOTE ] CCK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:59:30.815783] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-03. [2025-09-17T17:59:31.615787] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-11. [2025-09-17T17:59:31.821906] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T17:59:32.000600] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-17T17:59:32.415821] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-04. [2025-09-17T17:59:32.928511] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T17:59:33.103335] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T17:59:33.215857] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2024-12. [2025-09-17T17:59:34.015804] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-05. [2025-09-17T17:59:34.815802] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-06. [2025-09-17T17:59:35.055586] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T17:59:35.249023] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T17:59:35.615835] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-01. [2025-09-17T17:59:36.384923] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T17:59:36.415727] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-07. [2025-09-17T17:59:37.215787] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-06. [2025-09-17T17:59:37.419392] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T17:59:38.015817] [INFO ] [REMOTE ] CCK: Fetching primary data for 2024-12. [2025-09-17T17:59:38.051300] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T17:59:38.287741] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T17:59:38.815796] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-07. [2025-09-17T17:59:39.578763] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T17:59:39.621499] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-08. [2025-09-17T17:59:39.641018] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T17:59:40.415822] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-01. [2025-09-17T17:59:40.600396] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T17:59:41.215796] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-08. [2025-09-17T17:59:41.971539] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T17:59:42.015760] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-02. [2025-09-17T17:59:42.815842] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-02. [2025-09-17T17:59:43.040289] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T17:59:43.615780] [INFO ] [REMOTE ] CCI: Fetching primary data for 2025-09. [2025-09-17T17:59:43.741583] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T17:59:44.415821] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-03. [2025-09-17T17:59:44.552097] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T17:59:45.215782] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-03. [2025-09-17T17:59:45.347069] [INFO ] [REMOTE ] CCI: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T17:59:45.354092] [INFO ] [REMOTE ] CCI: Full fetch complete (76834 records). [2025-09-17T17:59:45.354240] [DEBUG] [VALIDATOR ] CCI: Validating primary data. [2025-09-17T17:59:45.770307] [DEBUG] [VALIDATOR ] CCI: All expected trading days are present. [2025-09-17T17:59:45.770476] [DEBUG] [VALIDATOR ] CCI: Primary data validation passed. [2025-09-17T17:59:45.771422] [INFO ] [MAIN ] CCI: Fetched primary data is valid. [2025-09-17T17:59:45.771522] [DEBUG] [LOCAL ] CCI: Saving primary data. [2025-09-17T17:59:45.774424] [DEBUG] [LOCAL ] CCI: Trimmed 76834 records to 53166 (keeping 200 days of data) [2025-09-17T17:59:45.930888] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T17:59:46.019421] [INFO ] [REMOTE ] CCIF: Fetching primary data for 2025-09. [2025-09-17T17:59:46.166058] [DEBUG] [LOCAL ] CCI: Primary data saved (53166 records). [2025-09-17T17:59:46.166207] [INFO ] [MAIN ] CCI: Full history saved. [2025-09-17T17:59:46.166316] [INFO ] [MAIN ] Update Progress: 412/2371 symbols completed. CCI took 51.2s. Estimated remaining: 4h 44m 3s. Rate: 6.9 symbols/min [2025-09-17T17:59:46.334911] [INFO ] [MAIN ] CCL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:59:46.335095] [DEBUG] [LOCAL ] CCL: No existing data file found in primary storage. [2025-09-17T17:59:46.335135] [WARN ] [MAIN ] CCL: No existing data found, performing full refresh instead. [2025-09-17T17:59:46.335256] [INFO ] [MAIN ] CCL: Wiping existing primary data before full refresh. [2025-09-17T17:59:46.335295] [INFO ] [LOCAL ] CCL: Starting deletion of primary data. [2025-09-17T17:59:46.335335] [DEBUG] [LOCAL ] CCL: No primary data file found to delete. [2025-09-17T17:59:46.335382] [INFO ] [MAIN ] CCL: Starting full primary refresh. [2025-09-17T17:59:46.692477] [INFO ] [REMOTE ] CCL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:59:46.815757] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-11. [2025-09-17T17:59:47.137935] [INFO ] [REMOTE ] CCIF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T17:59:47.140333] [INFO ] [REMOTE ] CCIF: Full fetch complete (21496 records). [2025-09-17T17:59:47.140409] [DEBUG] [VALIDATOR ] CCIF: Validating primary data. [2025-09-17T17:59:47.421137] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-17T17:59:47.559767] [DEBUG] [VALIDATOR ] CCIF: All expected trading days are present. [2025-09-17T17:59:47.559847] [DEBUG] [VALIDATOR ] CCIF: Primary data validation passed. [2025-09-17T17:59:47.560251] [INFO ] [MAIN ] CCIF: Fetched primary data is valid. [2025-09-17T17:59:47.560290] [DEBUG] [LOCAL ] CCIF: Saving primary data. [2025-09-17T17:59:47.560918] [DEBUG] [LOCAL ] CCIF: Trimmed 21496 records to 15299 (keeping 200 days of data) [2025-09-17T17:59:47.630149] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-04. [2025-09-17T17:59:47.657339] [DEBUG] [LOCAL ] CCIF: Primary data saved (15299 records). [2025-09-17T17:59:47.657496] [INFO ] [MAIN ] CCIF: Full history saved. [2025-09-17T17:59:47.657610] [INFO ] [MAIN ] Update Progress: 413/2371 symbols completed. CCIF took 28.4s. Estimated remaining: 4h 43m 20s. Rate: 6.9 symbols/min [2025-09-17T17:59:47.831412] [INFO ] [MAIN ] CCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T17:59:47.880858] [DEBUG] [LOCAL ] CCO: Loaded 47470 existing records from primary storage. [2025-09-17T17:59:47.881012] [INFO ] [MAIN ] CCO: Loaded 47470 existing records. [2025-09-17T17:59:48.070494] [WARN ] [MAIN ] CCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T17:59:48.070858] [INFO ] [MAIN ] CCO: Wiping existing primary data before full refresh. [2025-09-17T17:59:48.070907] [INFO ] [LOCAL ] CCO: Starting deletion of primary data. [2025-09-17T17:59:48.071840] [DEBUG] [LOCAL ] CCO: Deleted primary data file. [2025-09-17T17:59:48.071902] [INFO ] [MAIN ] CCO: Starting full primary refresh. [2025-09-17T17:59:48.424846] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-04. [2025-09-17T17:59:48.447398] [INFO ] [REMOTE ] CCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T17:59:49.171168] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-11 (2.36 seconds). [2025-09-17T17:59:49.215803] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-11. [2025-09-17T17:59:49.644879] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T17:59:49.924526] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T17:59:50.015784] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-05. [2025-09-17T17:59:50.745231] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T17:59:50.815748] [INFO ] [REMOTE ] CCO: Fetching primary data for 2024-12. [2025-09-17T17:59:51.615791] [INFO ] [REMOTE ] CCL: Fetching primary data for 2024-12. [2025-09-17T17:59:52.048238] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T17:59:52.095967] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-17T17:59:52.415789] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-01. [2025-09-17T17:59:53.215817] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-06. [2025-09-17T17:59:53.568848] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T17:59:53.872515] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-17T17:59:54.015773] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-02. [2025-09-17T17:59:54.815786] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-01. [2025-09-17T17:59:55.465854] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T17:59:55.525588] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T17:59:55.615759] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-03. [2025-09-17T17:59:56.415798] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-07. [2025-09-17T17:59:56.819202] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T17:59:57.215809] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-02. [2025-09-17T17:59:57.340425] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T17:59:58.015789] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-04. [2025-09-17T17:59:58.720498] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-17T17:59:58.815779] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-05. [2025-09-17T17:59:59.242038] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T17:59:59.487193] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-17T17:59:59.615760] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-03. [2025-09-17T18:00:00.415782] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-08. [2025-09-17T18:00:00.579229] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T18:00:01.215785] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-06. [2025-09-17T18:00:02.015823] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-05. [2025-09-17T18:00:02.230605] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-03 (2.61 seconds). [2025-09-17T18:00:02.324026] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T18:00:02.742951] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T18:00:02.815775] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-07. [2025-09-17T18:00:03.614483] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T18:00:03.624051] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-04. [2025-09-17T18:00:04.140850] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T18:00:04.415786] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-06. [2025-09-17T18:00:05.215836] [INFO ] [REMOTE ] CCJ: Fetching primary data for 2025-09. [2025-09-17T18:00:06.015836] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-08. [2025-09-17T18:00:06.064690] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T18:00:06.192786] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-17T18:00:06.815821] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-05. [2025-09-17T18:00:07.340389] [INFO ] [REMOTE ] CCJ: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-17T18:00:07.347296] [INFO ] [REMOTE ] CCJ: Full fetch complete (77575 records). [2025-09-17T18:00:07.347437] [DEBUG] [VALIDATOR ] CCJ: Validating primary data. [2025-09-17T18:00:07.621119] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-07. [2025-09-17T18:00:07.792720] [DEBUG] [VALIDATOR ] CCJ: All expected trading days are present. [2025-09-17T18:00:07.792871] [DEBUG] [VALIDATOR ] CCJ: Primary data validation passed. [2025-09-17T18:00:07.793859] [INFO ] [MAIN ] CCJ: Fetched primary data is valid. [2025-09-17T18:00:07.793922] [DEBUG] [LOCAL ] CCJ: Saving primary data. [2025-09-17T18:00:07.809588] [DEBUG] [LOCAL ] CCJ: Trimmed 77575 records to 53675 (keeping 200 days of data) [2025-09-17T18:00:07.838795] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T18:00:08.220877] [DEBUG] [LOCAL ] CCJ: Primary data saved (53675 records). [2025-09-17T18:00:08.221462] [INFO ] [MAIN ] CCJ: Full history saved. [2025-09-17T18:00:08.222658] [INFO ] [MAIN ] Update Progress: 414/2371 symbols completed. CCJ took 40.4s. Estimated remaining: 4h 44m 7s. Rate: 6.9 symbols/min [2025-09-17T18:00:08.413054] [INFO ] [MAIN ] CCRD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:00:08.415832] [INFO ] [REMOTE ] CCK: Fetching primary data for 2025-09. [2025-09-17T18:00:08.426813] [DEBUG] [LOCAL ] CCRD: Loaded 8902 existing records from primary storage. [2025-09-17T18:00:08.426968] [INFO ] [MAIN ] CCRD: Loaded 8902 existing records. [2025-09-17T18:00:08.609436] [WARN ] [MAIN ] CCRD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:00:08.609730] [INFO ] [MAIN ] CCRD: Wiping existing primary data before full refresh. [2025-09-17T18:00:08.609780] [INFO ] [LOCAL ] CCRD: Starting deletion of primary data. [2025-09-17T18:00:08.610438] [DEBUG] [LOCAL ] CCRD: Deleted primary data file. [2025-09-17T18:00:08.610483] [INFO ] [MAIN ] CCRD: Starting full primary refresh. [2025-09-17T18:00:09.033522] [INFO ] [REMOTE ] CCRD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:00:09.215762] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-11. [2025-09-17T18:00:09.301849] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-05 (2.49 seconds). [2025-09-17T18:00:09.371380] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T18:00:10.015828] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-08. [2025-09-17T18:00:10.284512] [INFO ] [REMOTE ] CCK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T18:00:10.291168] [INFO ] [REMOTE ] CCK: Full fetch complete (67620 records). [2025-09-17T18:00:10.291297] [DEBUG] [VALIDATOR ] CCK: Validating primary data. [2025-09-17T18:00:10.716945] [DEBUG] [VALIDATOR ] CCK: All expected trading days are present. [2025-09-17T18:00:10.717030] [DEBUG] [VALIDATOR ] CCK: Primary data validation passed. [2025-09-17T18:00:10.717791] [INFO ] [MAIN ] CCK: Fetched primary data is valid. [2025-09-17T18:00:10.717835] [DEBUG] [LOCAL ] CCK: Saving primary data. [2025-09-17T18:00:10.719172] [DEBUG] [LOCAL ] CCK: Trimmed 67620 records to 46609 (keeping 200 days of data) [2025-09-17T18:00:10.815823] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-06. [2025-09-17T18:00:11.030848] [DEBUG] [LOCAL ] CCK: Primary data saved (46609 records). [2025-09-17T18:00:11.031015] [INFO ] [MAIN ] CCK: Full history saved. [2025-09-17T18:00:11.031291] [INFO ] [MAIN ] Update Progress: 415/2371 symbols completed. CCK took 41.3s. Estimated remaining: 4h 43m 31s. Rate: 6.9 symbols/min [2025-09-17T18:00:11.211405] [INFO ] [MAIN ] CCS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:00:11.244231] [DEBUG] [LOCAL ] CCS: Loaded 30631 existing records from primary storage. [2025-09-17T18:00:11.244410] [INFO ] [MAIN ] CCS: Loaded 30631 existing records. [2025-09-17T18:00:11.444396] [WARN ] [MAIN ] CCS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:00:11.444746] [INFO ] [MAIN ] CCS: Wiping existing primary data before full refresh. [2025-09-17T18:00:11.444821] [INFO ] [LOCAL ] CCS: Starting deletion of primary data. [2025-09-17T18:00:11.445783] [DEBUG] [LOCAL ] CCS: Deleted primary data file. [2025-09-17T18:00:11.445877] [INFO ] [MAIN ] CCS: Starting full primary refresh. [2025-09-17T18:00:11.727303] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T18:00:11.791066] [INFO ] [REMOTE ] CCO: Fetching primary data for 2025-09. [2025-09-17T18:00:11.880950] [INFO ] [REMOTE ] CCS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:00:12.211360] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-11 (3.00 seconds). [2025-09-17T18:00:12.415784] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2024-12. [2025-09-17T18:00:13.215807] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-11. [2025-09-17T18:00:13.287826] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T18:00:13.519381] [INFO ] [REMOTE ] CCO: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T18:00:13.525707] [INFO ] [REMOTE ] CCO: Full fetch complete (65666 records). [2025-09-17T18:00:13.525830] [DEBUG] [VALIDATOR ] CCO: Validating primary data. [2025-09-17T18:00:13.921150] [DEBUG] [VALIDATOR ] CCO: All expected trading days are present. [2025-09-17T18:00:13.921434] [DEBUG] [VALIDATOR ] CCO: Primary data validation passed. [2025-09-17T18:00:13.922229] [INFO ] [MAIN ] CCO: Fetched primary data is valid. [2025-09-17T18:00:13.922285] [DEBUG] [LOCAL ] CCO: Saving primary data. [2025-09-17T18:00:13.923864] [DEBUG] [LOCAL ] CCO: Trimmed 65666 records to 47506 (keeping 200 days of data) [2025-09-17T18:00:14.021841] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-01. [2025-09-17T18:00:14.075773] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-06 (3.26 seconds). [2025-09-17T18:00:14.240613] [DEBUG] [LOCAL ] CCO: Primary data saved (47506 records). [2025-09-17T18:00:14.240768] [INFO ] [MAIN ] CCO: Full history saved. [2025-09-17T18:00:14.240872] [INFO ] [MAIN ] Update Progress: 416/2371 symbols completed. CCO took 26.6s. Estimated remaining: 4h 42m 56s. Rate: 6.9 symbols/min [2025-09-17T18:00:14.414985] [INFO ] [MAIN ] CCU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:00:14.438394] [DEBUG] [LOCAL ] CCU: Loaded 24179 existing records from primary storage. [2025-09-17T18:00:14.438565] [INFO ] [MAIN ] CCU: Loaded 24179 existing records. [2025-09-17T18:00:14.619716] [WARN ] [MAIN ] CCU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:00:14.619950] [INFO ] [MAIN ] CCU: Wiping existing primary data before full refresh. [2025-09-17T18:00:14.619996] [INFO ] [LOCAL ] CCU: Starting deletion of primary data. [2025-09-17T18:00:14.620596] [DEBUG] [LOCAL ] CCU: Deleted primary data file. [2025-09-17T18:00:14.620672] [INFO ] [MAIN ] CCU: Starting full primary refresh. [2025-09-17T18:00:14.793581] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T18:00:14.820954] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-02. [2025-09-17T18:00:15.027771] [INFO ] [REMOTE ] CCU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:00:15.031518] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T18:00:15.558314] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T18:00:15.615760] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-07. [2025-09-17T18:00:16.415808] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-03. [2025-09-17T18:00:17.036753] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T18:00:17.215801] [INFO ] [REMOTE ] CCS: Fetching primary data for 2024-12. [2025-09-17T18:00:18.015774] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-04. [2025-09-17T18:00:18.248710] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-07 (2.63 seconds). [2025-09-17T18:00:18.518457] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T18:00:18.527264] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T18:00:18.815777] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-11. [2025-09-17T18:00:19.615760] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-01. [2025-09-17T18:00:19.937545] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T18:00:20.415829] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-05. [2025-09-17T18:00:21.074434] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T18:00:21.086048] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T18:00:21.215777] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-06. [2025-09-17T18:00:22.015771] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-02. [2025-09-17T18:00:22.077465] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T18:00:22.815859] [INFO ] [REMOTE ] CCU: Fetching primary data for 2024-12. [2025-09-17T18:00:23.509880] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T18:00:23.615792] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-03. [2025-09-17T18:00:23.957557] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T18:00:24.415785] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-07. [2025-09-17T18:00:25.003592] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T18:00:25.155704] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T18:00:25.215810] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-08. [2025-09-17T18:00:26.015830] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-01. [2025-09-17T18:00:26.119441] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T18:00:26.815827] [INFO ] [REMOTE ] CCRD: Fetching primary data for 2025-09. [2025-09-17T18:00:27.038946] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T18:00:27.615843] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-04. [2025-09-17T18:00:28.101788] [INFO ] [REMOTE ] CCRD: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T18:00:28.103522] [INFO ] [REMOTE ] CCRD: Full fetch complete (11987 records). [2025-09-17T18:00:28.103590] [DEBUG] [VALIDATOR ] CCRD: Validating primary data. [2025-09-17T18:00:28.426899] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-02. [2025-09-17T18:00:28.468383] [DEBUG] [VALIDATOR ] CCRD: All expected trading days are present. [2025-09-17T18:00:28.468457] [DEBUG] [VALIDATOR ] CCRD: Primary data validation passed. [2025-09-17T18:00:28.468748] [INFO ] [MAIN ] CCRD: Fetched primary data is valid. [2025-09-17T18:00:28.468790] [DEBUG] [LOCAL ] CCRD: Saving primary data. [2025-09-17T18:00:28.469231] [DEBUG] [LOCAL ] CCRD: Trimmed 11987 records to 8924 (keeping 200 days of data) [2025-09-17T18:00:28.527065] [DEBUG] [LOCAL ] CCRD: Primary data saved (8924 records). [2025-09-17T18:00:28.527189] [INFO ] [MAIN ] CCRD: Full history saved. [2025-09-17T18:00:28.527279] [INFO ] [MAIN ] Update Progress: 417/2371 symbols completed. CCRD took 20.3s. Estimated remaining: 4h 43m 14s. Rate: 6.9 symbols/min [2025-09-17T18:00:28.698917] [INFO ] [MAIN ] CCZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:00:28.699095] [DEBUG] [LOCAL ] CCZ: No existing data file found in primary storage. [2025-09-17T18:00:28.699131] [WARN ] [MAIN ] CCZ: No existing data found, performing full refresh instead. [2025-09-17T18:00:28.699261] [INFO ] [MAIN ] CCZ: Wiping existing primary data before full refresh. [2025-09-17T18:00:28.699300] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-17T18:00:28.699340] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-17T18:00:28.699371] [INFO ] [MAIN ] CCZ: Starting full primary refresh. [2025-09-17T18:00:29.058689] [INFO ] [REMOTE ] CCZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:00:29.215729] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-11. [2025-09-17T18:00:29.251016] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T18:00:29.546456] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T18:00:29.761758] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T18:00:30.015828] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-03. [2025-09-17T18:00:30.815847] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-05. [2025-09-17T18:00:31.438367] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T18:00:31.615781] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-04. [2025-09-17T18:00:32.162465] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T18:00:32.415791] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-06. [2025-09-17T18:00:32.908414] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T18:00:33.215697] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-05. [2025-09-17T18:00:33.440804] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T18:00:34.015859] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-08. [2025-09-17T18:00:34.334706] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T18:00:34.815898] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-07. [2025-09-17T18:00:35.615894] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2024-12. [2025-09-17T18:00:35.873171] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-17T18:00:36.083714] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T18:00:36.174260] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T18:00:36.415816] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-01. [2025-09-17T18:00:36.639324] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-01 (0.22 seconds). [2025-09-17T18:00:37.215807] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-02. [2025-09-17T18:00:37.439182] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-02 (0.22 seconds). [2025-09-17T18:00:38.015814] [INFO ] [REMOTE ] CCL: Fetching primary data for 2025-09. [2025-09-17T18:00:38.816001] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-08. [2025-09-17T18:00:39.615801] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-06. [2025-09-17T18:00:40.274174] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T18:00:40.304161] [INFO ] [REMOTE ] CCL: Incremental fetch complete for 2025-09 (2.29 seconds). [2025-09-17T18:00:40.312298] [INFO ] [REMOTE ] CCL: Full fetch complete (77867 records). [2025-09-17T18:00:40.312468] [DEBUG] [VALIDATOR ] CCL: Validating primary data. [2025-09-17T18:00:40.417747] [INFO ] [REMOTE ] CCS: Fetching primary data for 2025-09. [2025-09-17T18:00:40.717512] [DEBUG] [VALIDATOR ] CCL: All expected trading days are present. [2025-09-17T18:00:40.717615] [DEBUG] [VALIDATOR ] CCL: Primary data validation passed. [2025-09-17T18:00:40.718679] [INFO ] [MAIN ] CCL: Fetched primary data is valid. [2025-09-17T18:00:40.718761] [DEBUG] [LOCAL ] CCL: Saving primary data. [2025-09-17T18:00:40.732407] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T18:00:40.737864] [DEBUG] [LOCAL ] CCL: Trimmed 77867 records to 53800 (keeping 200 days of data) [2025-09-17T18:00:41.065685] [DEBUG] [LOCAL ] CCL: Primary data saved (53800 records). [2025-09-17T18:00:41.065831] [INFO ] [MAIN ] CCL: Full history saved. [2025-09-17T18:00:41.065918] [INFO ] [MAIN ] Update Progress: 418/2371 symbols completed. CCL took 54.9s. Estimated remaining: 4h 43m 23s. Rate: 6.9 symbols/min [2025-09-17T18:00:41.224534] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-03. [2025-09-17T18:00:41.234769] [INFO ] [MAIN ] CDE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:00:41.291086] [DEBUG] [LOCAL ] CDE: Loaded 53641 existing records from primary storage. [2025-09-17T18:00:41.291269] [INFO ] [MAIN ] CDE: Loaded 53641 existing records. [2025-09-17T18:00:41.479179] [WARN ] [MAIN ] CDE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:00:41.479426] [INFO ] [MAIN ] CDE: Wiping existing primary data before full refresh. [2025-09-17T18:00:41.479477] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-17T18:00:41.480418] [DEBUG] [LOCAL ] CDE: Deleted primary data file. [2025-09-17T18:00:41.480469] [INFO ] [MAIN ] CDE: Starting full primary refresh. [2025-09-17T18:00:41.591189] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T18:00:41.876632] [INFO ] [REMOTE ] CDE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:00:41.879525] [INFO ] [REMOTE ] CCS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T18:00:41.884912] [INFO ] [REMOTE ] CCS: Full fetch complete (44281 records). [2025-09-17T18:00:41.885022] [DEBUG] [VALIDATOR ] CCS: Validating primary data. [2025-09-17T18:00:42.032210] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-11. [2025-09-17T18:00:42.275067] [DEBUG] [VALIDATOR ] CCS: All expected trading days are present. [2025-09-17T18:00:42.275177] [DEBUG] [VALIDATOR ] CCS: Primary data validation passed. [2025-09-17T18:00:42.276206] [INFO ] [MAIN ] CCS: Fetched primary data is valid. [2025-09-17T18:00:42.276333] [DEBUG] [LOCAL ] CCS: Saving primary data. [2025-09-17T18:00:42.277565] [DEBUG] [LOCAL ] CCS: Trimmed 44281 records to 30629 (keeping 200 days of data) [2025-09-17T18:00:42.470114] [DEBUG] [LOCAL ] CCS: Primary data saved (30629 records). [2025-09-17T18:00:42.470252] [INFO ] [MAIN ] CCS: Full history saved. [2025-09-17T18:00:42.470345] [INFO ] [MAIN ] Update Progress: 419/2371 symbols completed. CCS took 31.4s. Estimated remaining: 4h 42m 40s. Rate: 6.9 symbols/min [2025-09-17T18:00:42.640905] [INFO ] [MAIN ] CDLR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:00:42.652627] [DEBUG] [LOCAL ] CDLR: Loaded 10291 existing records from primary storage. [2025-09-17T18:00:42.652779] [INFO ] [MAIN ] CDLR: Loaded 10291 existing records. [2025-09-17T18:00:42.815786] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-04. [2025-09-17T18:00:42.837396] [WARN ] [MAIN ] CDLR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:00:42.838601] [INFO ] [MAIN ] CDLR: Wiping existing primary data before full refresh. [2025-09-17T18:00:42.838692] [INFO ] [LOCAL ] CDLR: Starting deletion of primary data. [2025-09-17T18:00:42.839159] [DEBUG] [LOCAL ] CDLR: Deleted primary data file. [2025-09-17T18:00:42.839255] [INFO ] [MAIN ] CDLR: Starting full primary refresh. [2025-09-17T18:00:43.205366] [INFO ] [REMOTE ] CDLR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:00:43.224485] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-17T18:00:43.615796] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-11. [2025-09-17T18:00:43.980254] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-17T18:00:44.415750] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-05. [2025-09-17T18:00:44.468726] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T18:00:44.643733] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-17T18:00:45.215774] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2024-12. [2025-09-17T18:00:46.015794] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-06. [2025-09-17T18:00:46.068016] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T18:00:46.309859] [DEBUG] [REMOTE ] CCZ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:00:46.310286] [WARN ] [REMOTE ] CCZ: No data returned for month 2025-06 [2025-09-17T18:00:46.815772] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-07. [2025-09-17T18:00:47.080109] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-17T18:00:47.615782] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-01. [2025-09-17T18:00:48.245599] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T18:00:48.415861] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-07. [2025-09-17T18:00:49.215846] [INFO ] [REMOTE ] CDE: Fetching primary data for 2024-12. [2025-09-17T18:00:49.634688] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T18:00:50.015811] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-08. [2025-09-17T18:00:50.815822] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-02. [2025-09-17T18:00:51.104281] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T18:00:51.135882] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T18:00:51.418076] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T18:00:51.615789] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-03. [2025-09-17T18:00:52.415793] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-01. [2025-09-17T18:00:52.639138] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T18:00:53.215782] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-04. [2025-09-17T18:00:54.015828] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-08. [2025-09-17T18:00:54.284474] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-08 (0.27 seconds). [2025-09-17T18:00:54.384075] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T18:00:54.815794] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-02. [2025-09-17T18:00:55.615818] [INFO ] [REMOTE ] CCZ: Fetching primary data for 2025-09. [2025-09-17T18:00:55.977394] [INFO ] [REMOTE ] CCZ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T18:00:55.978194] [INFO ] [REMOTE ] CCZ: Full fetch complete (144 records). [2025-09-17T18:00:55.978265] [DEBUG] [VALIDATOR ] CCZ: Validating primary data. [2025-09-17T18:00:55.978612] [FATAL] [VALIDATOR ] CCZ: Data is stale - most recent date (2025-09-15) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:00:55.978710] [FATAL] [MAIN ] CCZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:00:55.978747] [WARN ] [MAIN ] CCZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:00:55.978792] [INFO ] [LOCAL ] CCZ: Starting deletion of primary data. [2025-09-17T18:00:55.978848] [DEBUG] [LOCAL ] CCZ: No primary data file found to delete. [2025-09-17T18:00:55.978883] [INFO ] [LOCAL ] CCZ: Starting deletion of derivative data. [2025-09-17T18:00:55.978936] [DEBUG] [LOCAL ] CCZ: No derivative data file found to delete. [2025-09-17T18:00:55.978995] [INFO ] [MAIN ] Update Progress: 420/2371 symbols completed. CCZ took 27.5s. Estimated remaining: 4h 42m 54s. Rate: 6.9 symbols/min [2025-09-17T18:00:56.160330] [INFO ] [MAIN ] CDP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:00:56.205744] [DEBUG] [LOCAL ] CDP: Loaded 42807 existing records from primary storage. [2025-09-17T18:00:56.205894] [INFO ] [MAIN ] CDP: Loaded 42807 existing records. [2025-09-17T18:00:56.409912] [WARN ] [MAIN ] CDP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:00:56.410184] [INFO ] [MAIN ] CDP: Wiping existing primary data before full refresh. [2025-09-17T18:00:56.410235] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-17T18:00:56.411366] [DEBUG] [LOCAL ] CDP: Deleted primary data file. [2025-09-17T18:00:56.411450] [INFO ] [MAIN ] CDP: Starting full primary refresh. [2025-09-17T18:00:56.435299] [INFO ] [REMOTE ] CCU: Fetching primary data for 2025-09. [2025-09-17T18:00:56.846494] [INFO ] [REMOTE ] CDP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:00:56.879258] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-17T18:00:57.104064] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-04 (3.89 seconds). [2025-09-17T18:00:57.181634] [INFO ] [REMOTE ] CCU: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T18:00:57.184965] [INFO ] [REMOTE ] CCU: Full fetch complete (33280 records). [2025-09-17T18:00:57.185129] [DEBUG] [VALIDATOR ] CCU: Validating primary data. [2025-09-17T18:00:57.220923] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-03. [2025-09-17T18:00:57.614980] [DEBUG] [VALIDATOR ] CCU: All expected trading days are present. [2025-09-17T18:00:57.615109] [DEBUG] [VALIDATOR ] CCU: Primary data validation passed. [2025-09-17T18:00:57.616152] [INFO ] [MAIN ] CCU: Fetched primary data is valid. [2025-09-17T18:00:57.616238] [DEBUG] [LOCAL ] CCU: Saving primary data. [2025-09-17T18:00:57.617794] [DEBUG] [LOCAL ] CCU: Trimmed 33280 records to 24062 (keeping 200 days of data) [2025-09-17T18:00:57.830989] [DEBUG] [LOCAL ] CCU: Primary data saved (24062 records). [2025-09-17T18:00:57.831195] [INFO ] [MAIN ] CCU: Full history saved. [2025-09-17T18:00:57.831331] [INFO ] [MAIN ] Update Progress: 421/2371 symbols completed. CCU took 43.6s. Estimated remaining: 4h 42m 14s. Rate: 6.9 symbols/min [2025-09-17T18:00:58.016535] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-11. [2025-09-17T18:00:58.127705] [INFO ] [MAIN ] CDRE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:00:58.163043] [DEBUG] [LOCAL ] CDRE: Loaded 25093 existing records from primary storage. [2025-09-17T18:00:58.163267] [INFO ] [MAIN ] CDRE: Loaded 25093 existing records. [2025-09-17T18:00:58.455228] [WARN ] [MAIN ] CDRE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:00:58.455535] [INFO ] [MAIN ] CDRE: Wiping existing primary data before full refresh. [2025-09-17T18:00:58.455586] [INFO ] [LOCAL ] CDRE: Starting deletion of primary data. [2025-09-17T18:00:58.456290] [DEBUG] [LOCAL ] CDRE: Deleted primary data file. [2025-09-17T18:00:58.456356] [INFO ] [MAIN ] CDRE: Starting full primary refresh. [2025-09-17T18:00:58.820903] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-05. [2025-09-17T18:00:58.923659] [INFO ] [REMOTE ] CDRE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:00:59.307274] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T18:00:59.615872] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-11. [2025-09-17T18:00:59.766757] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T18:00:59.777504] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T18:01:00.415766] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-06. [2025-09-17T18:01:00.798688] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T18:01:01.157113] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T18:01:01.215791] [INFO ] [REMOTE ] CDP: Fetching primary data for 2024-12. [2025-09-17T18:01:02.015786] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-07. [2025-09-17T18:01:02.815764] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-04. [2025-09-17T18:01:02.871870] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T18:01:02.888831] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T18:01:03.615827] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-01. [2025-09-17T18:01:04.415816] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2024-12. [2025-09-17T18:01:04.971124] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-17T18:01:05.024612] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T18:01:05.215767] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-02. [2025-09-17T18:01:05.702274] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T18:01:06.015792] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-01. [2025-09-17T18:01:06.414838] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T18:01:06.815775] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-05. [2025-09-17T18:01:07.230473] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T18:01:07.615824] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-08. [2025-09-17T18:01:08.415804] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-02. [2025-09-17T18:01:08.778768] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T18:01:08.779886] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T18:01:09.215833] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-06. [2025-09-17T18:01:09.432421] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T18:01:10.015835] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-03. [2025-09-17T18:01:10.815826] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-03. [2025-09-17T18:01:11.038127] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T18:01:11.615790] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-07. [2025-09-17T18:01:11.807152] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T18:01:12.415811] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-04. [2025-09-17T18:01:12.500852] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T18:01:13.215793] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-04. [2025-09-17T18:01:13.706585] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T18:01:14.015704] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-08. [2025-09-17T18:01:14.082199] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T18:01:14.132373] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T18:01:14.815840] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-05. [2025-09-17T18:01:15.615760] [INFO ] [REMOTE ] CDLR: Fetching primary data for 2025-09. [2025-09-17T18:01:16.124617] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-17T18:01:16.280749] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T18:01:16.295942] [INFO ] [REMOTE ] CDLR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T18:01:16.297674] [INFO ] [REMOTE ] CDLR: Full fetch complete (13262 records). [2025-09-17T18:01:16.297769] [DEBUG] [VALIDATOR ] CDLR: Validating primary data. [2025-09-17T18:01:16.420826] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-05. [2025-09-17T18:01:16.696331] [DEBUG] [VALIDATOR ] CDLR: All expected trading days are present. [2025-09-17T18:01:16.696416] [DEBUG] [VALIDATOR ] CDLR: Primary data validation passed. [2025-09-17T18:01:16.696826] [INFO ] [MAIN ] CDLR: Fetched primary data is valid. [2025-09-17T18:01:16.696884] [DEBUG] [LOCAL ] CDLR: Saving primary data. [2025-09-17T18:01:16.697554] [DEBUG] [LOCAL ] CDLR: Trimmed 13262 records to 10281 (keeping 200 days of data) [2025-09-17T18:01:16.760669] [DEBUG] [LOCAL ] CDLR: Primary data saved (10281 records). [2025-09-17T18:01:16.760817] [INFO ] [MAIN ] CDLR: Full history saved. [2025-09-17T18:01:16.760923] [INFO ] [MAIN ] Update Progress: 422/2371 symbols completed. CDLR took 34.3s. Estimated remaining: 4h 42m 52s. Rate: 6.9 symbols/min [2025-09-17T18:01:16.929054] [INFO ] [MAIN ] CE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:01:16.979540] [DEBUG] [LOCAL ] CE: Loaded 51604 existing records from primary storage. [2025-09-17T18:01:16.979730] [INFO ] [MAIN ] CE: Loaded 51604 existing records. [2025-09-17T18:01:17.201624] [WARN ] [MAIN ] CE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:01:17.201905] [INFO ] [MAIN ] CE: Wiping existing primary data before full refresh. [2025-09-17T18:01:17.201953] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-17T18:01:17.203033] [DEBUG] [LOCAL ] CE: Deleted primary data file. [2025-09-17T18:01:17.203097] [INFO ] [MAIN ] CE: Starting full primary refresh. [2025-09-17T18:01:17.225737] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-06. [2025-09-17T18:01:17.612181] [INFO ] [REMOTE ] CE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:01:17.630502] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T18:01:18.015886] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-11. [2025-09-17T18:01:18.815820] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-06. [2025-09-17T18:01:18.891287] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T18:01:19.615822] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-07. [2025-09-17T18:01:19.969444] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-17T18:01:20.023638] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T18:01:20.415909] [INFO ] [REMOTE ] CE: Fetching primary data for 2024-12. [2025-09-17T18:01:20.833105] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T18:01:21.215832] [INFO ] [REMOTE ] CDE: Fetching primary data for 2025-09. [2025-09-17T18:01:21.952975] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T18:01:22.015729] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-01. [2025-09-17T18:01:22.815862] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-08. [2025-09-17T18:01:23.265337] [INFO ] [REMOTE ] CDE: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-17T18:01:23.272124] [INFO ] [REMOTE ] CDE: Full fetch complete (77034 records). [2025-09-17T18:01:23.272261] [DEBUG] [VALIDATOR ] CDE: Validating primary data. [2025-09-17T18:01:23.273167] [FATAL] [VALIDATOR ] CDE: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:01:23.273254] [FATAL] [MAIN ] CDE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:01:23.273292] [WARN ] [MAIN ] CDE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:01:23.273354] [INFO ] [LOCAL ] CDE: Starting deletion of primary data. [2025-09-17T18:01:23.273426] [DEBUG] [LOCAL ] CDE: No primary data file found to delete. [2025-09-17T18:01:23.273463] [INFO ] [LOCAL ] CDE: Starting deletion of derivative data. [2025-09-17T18:01:23.273857] [DEBUG] [LOCAL ] CDE: Deleted derivative data file. [2025-09-17T18:01:23.273957] [INFO ] [MAIN ] Update Progress: 423/2371 symbols completed. CDE took 42.2s. Estimated remaining: 4h 42m 34s. Rate: 6.9 symbols/min [2025-09-17T18:01:23.452257] [INFO ] [MAIN ] CEE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:01:23.461120] [DEBUG] [LOCAL ] CEE: Loaded 7167 existing records from primary storage. [2025-09-17T18:01:23.461229] [INFO ] [MAIN ] CEE: Loaded 7167 existing records. [2025-09-17T18:01:23.636913] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-07. [2025-09-17T18:01:23.677458] [WARN ] [MAIN ] CEE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:01:23.678990] [INFO ] [MAIN ] CEE: Wiping existing primary data before full refresh. [2025-09-17T18:01:23.681466] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T18:01:23.679415] [INFO ] [LOCAL ] CEE: Starting deletion of primary data. [2025-09-17T18:01:23.692003] [DEBUG] [LOCAL ] CEE: Deleted primary data file. [2025-09-17T18:01:23.692321] [INFO ] [MAIN ] CEE: Starting full primary refresh. [2025-09-17T18:01:24.069089] [INFO ] [REMOTE ] CEE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:01:24.415800] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-02. [2025-09-17T18:01:24.606153] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T18:01:24.973207] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T18:01:25.215815] [INFO ] [REMOTE ] CDP: Fetching primary data for 2025-09. [2025-09-17T18:01:26.015848] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-08. [2025-09-17T18:01:26.155017] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T18:01:26.815824] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-03. [2025-09-17T18:01:27.017729] [INFO ] [REMOTE ] CDP: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T18:01:27.024965] [INFO ] [REMOTE ] CDP: Full fetch complete (61397 records). [2025-09-17T18:01:27.025149] [DEBUG] [VALIDATOR ] CDP: Validating primary data. [2025-09-17T18:01:27.026164] [FATAL] [VALIDATOR ] CDP: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:01:27.026384] [FATAL] [MAIN ] CDP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:01:27.026447] [WARN ] [MAIN ] CDP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:01:27.026509] [INFO ] [LOCAL ] CDP: Starting deletion of primary data. [2025-09-17T18:01:27.026607] [DEBUG] [LOCAL ] CDP: No primary data file found to delete. [2025-09-17T18:01:27.026678] [INFO ] [LOCAL ] CDP: Starting deletion of derivative data. [2025-09-17T18:01:27.027095] [DEBUG] [LOCAL ] CDP: Deleted derivative data file. [2025-09-17T18:01:27.027743] [INFO ] [MAIN ] Update Progress: 424/2371 symbols completed. CDP took 31.0s. Estimated remaining: 4h 42m 2s. Rate: 6.9 symbols/min [2025-09-17T18:01:27.227713] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T18:01:27.264799] [INFO ] [MAIN ] CEPU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:01:27.301216] [DEBUG] [LOCAL ] CEPU: Loaded 25572 existing records from primary storage. [2025-09-17T18:01:27.301371] [INFO ] [MAIN ] CEPU: Loaded 25572 existing records. [2025-09-17T18:01:27.504764] [WARN ] [MAIN ] CEPU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:01:27.505229] [INFO ] [MAIN ] CEPU: Wiping existing primary data before full refresh. [2025-09-17T18:01:27.505276] [INFO ] [LOCAL ] CEPU: Starting deletion of primary data. [2025-09-17T18:01:27.505939] [DEBUG] [LOCAL ] CEPU: Deleted primary data file. [2025-09-17T18:01:27.505988] [INFO ] [MAIN ] CEPU: Starting full primary refresh. [2025-09-17T18:01:27.620916] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-11. [2025-09-17T18:01:27.875792] [INFO ] [REMOTE ] CEPU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:01:28.415867] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-11. [2025-09-17T18:01:28.561114] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T18:01:28.729182] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T18:01:29.215878] [INFO ] [REMOTE ] CDRE: Fetching primary data for 2025-09. [2025-09-17T18:01:29.923677] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T18:01:30.015789] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2024-12. [2025-09-17T18:01:30.361192] [INFO ] [REMOTE ] CDRE: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T18:01:30.364488] [INFO ] [REMOTE ] CDRE: Full fetch complete (35613 records). [2025-09-17T18:01:30.364607] [DEBUG] [VALIDATOR ] CDRE: Validating primary data. [2025-09-17T18:01:30.775140] [DEBUG] [VALIDATOR ] CDRE: All expected trading days are present. [2025-09-17T18:01:30.775260] [DEBUG] [VALIDATOR ] CDRE: Primary data validation passed. [2025-09-17T18:01:30.775855] [INFO ] [MAIN ] CDRE: Fetched primary data is valid. [2025-09-17T18:01:30.775917] [DEBUG] [LOCAL ] CDRE: Saving primary data. [2025-09-17T18:01:30.777149] [DEBUG] [LOCAL ] CDRE: Trimmed 35613 records to 25156 (keeping 200 days of data) [2025-09-17T18:01:30.831834] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-04. [2025-09-17T18:01:30.943486] [DEBUG] [LOCAL ] CDRE: Primary data saved (25156 records). [2025-09-17T18:01:30.943671] [INFO ] [MAIN ] CDRE: Full history saved. [2025-09-17T18:01:30.943794] [INFO ] [MAIN ] Update Progress: 425/2371 symbols completed. CDRE took 33.1s. Estimated remaining: 4h 41m 32s. Rate: 6.9 symbols/min [2025-09-17T18:01:31.127202] [INFO ] [MAIN ] CF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:01:31.150009] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T18:01:31.207116] [DEBUG] [LOCAL ] CF: Loaded 52272 existing records from primary storage. [2025-09-17T18:01:31.207298] [INFO ] [MAIN ] CF: Loaded 52272 existing records. [2025-09-17T18:01:31.397051] [WARN ] [MAIN ] CF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:01:31.397349] [INFO ] [MAIN ] CF: Wiping existing primary data before full refresh. [2025-09-17T18:01:31.397398] [INFO ] [LOCAL ] CF: Starting deletion of primary data. [2025-09-17T18:01:31.398919] [DEBUG] [LOCAL ] CF: Deleted primary data file. [2025-09-17T18:01:31.398974] [INFO ] [MAIN ] CF: Starting full primary refresh. [2025-09-17T18:01:31.622280] [INFO ] [REMOTE ] CEE: Fetching primary data for 2024-12. [2025-09-17T18:01:31.762312] [INFO ] [REMOTE ] CF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:01:32.103747] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T18:01:32.341768] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T18:01:32.415787] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-01. [2025-09-17T18:01:33.208629] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T18:01:33.215688] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-02. [2025-09-17T18:01:34.015811] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-11. [2025-09-17T18:01:34.067591] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T18:01:34.815824] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-05. [2025-09-17T18:01:35.615838] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-01. [2025-09-17T18:01:35.750102] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T18:01:36.415828] [INFO ] [REMOTE ] CF: Fetching primary data for 2024-12. [2025-09-17T18:01:36.646499] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T18:01:36.993336] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T18:01:37.215776] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-06. [2025-09-17T18:01:38.015775] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-03. [2025-09-17T18:01:38.109049] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T18:01:38.657547] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T18:01:38.815809] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-02. [2025-09-17T18:01:39.065471] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T18:01:39.615809] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-01. [2025-09-17T18:01:40.139512] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T18:01:40.415797] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-07. [2025-09-17T18:01:41.111082] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T18:01:41.215801] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-04. [2025-09-17T18:01:41.982321] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T18:01:42.015776] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-03. [2025-09-17T18:01:42.338846] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T18:01:42.815826] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-05. [2025-09-17T18:01:43.177770] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T18:01:43.533264] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T18:01:43.615811] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-08. [2025-09-17T18:01:44.415791] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-02. [2025-09-17T18:01:45.215787] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-04. [2025-09-17T18:01:45.430830] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T18:01:46.015844] [INFO ] [REMOTE ] CE: Fetching primary data for 2025-09. [2025-09-17T18:01:46.101991] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T18:01:46.240442] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T18:01:46.815897] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-06. [2025-09-17T18:01:47.424428] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T18:01:47.615923] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-05. [2025-09-17T18:01:47.876993] [INFO ] [REMOTE ] CE: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T18:01:47.884278] [INFO ] [REMOTE ] CE: Full fetch complete (74373 records). [2025-09-17T18:01:47.884479] [DEBUG] [VALIDATOR ] CE: Validating primary data. [2025-09-17T18:01:47.885430] [FATAL] [VALIDATOR ] CE: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:01:47.885521] [FATAL] [MAIN ] CE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:01:47.885558] [WARN ] [MAIN ] CE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:01:47.885603] [INFO ] [LOCAL ] CE: Starting deletion of primary data. [2025-09-17T18:01:47.885702] [DEBUG] [LOCAL ] CE: No primary data file found to delete. [2025-09-17T18:01:47.885745] [INFO ] [LOCAL ] CE: Starting deletion of derivative data. [2025-09-17T18:01:47.886135] [DEBUG] [LOCAL ] CE: Deleted derivative data file. [2025-09-17T18:01:47.886227] [INFO ] [MAIN ] Update Progress: 426/2371 symbols completed. CE took 31.1s. Estimated remaining: 4h 42m 1s. Rate: 6.9 symbols/min [2025-09-17T18:01:48.069263] [INFO ] [MAIN ] CFG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:01:48.120656] [DEBUG] [LOCAL ] CFG: Loaded 53621 existing records from primary storage. [2025-09-17T18:01:48.120818] [INFO ] [MAIN ] CFG: Loaded 53621 existing records. [2025-09-17T18:01:48.319330] [WARN ] [MAIN ] CFG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:01:48.319602] [INFO ] [MAIN ] CFG: Wiping existing primary data before full refresh. [2025-09-17T18:01:48.319671] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-17T18:01:48.321220] [DEBUG] [LOCAL ] CFG: Deleted primary data file. [2025-09-17T18:01:48.321272] [INFO ] [MAIN ] CFG: Starting full primary refresh. [2025-09-17T18:01:48.423983] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-07. [2025-09-17T18:01:48.720150] [INFO ] [REMOTE ] CFG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:01:48.980959] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T18:01:49.162871] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T18:01:49.215806] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-11. [2025-09-17T18:01:50.015812] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-03. [2025-09-17T18:01:50.815769] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-08. [2025-09-17T18:01:50.994328] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T18:01:51.244387] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T18:01:51.615783] [INFO ] [REMOTE ] CFG: Fetching primary data for 2024-12. [2025-09-17T18:01:51.776533] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T18:01:52.415801] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-06. [2025-09-17T18:01:53.215817] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-04. [2025-09-17T18:01:53.296402] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T18:01:53.325011] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T18:01:54.015869] [INFO ] [REMOTE ] CEE: Fetching primary data for 2025-09. [2025-09-17T18:01:54.815773] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-07. [2025-09-17T18:01:54.918601] [INFO ] [REMOTE ] CEE: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T18:01:54.920359] [INFO ] [REMOTE ] CEE: Full fetch complete (10171 records). [2025-09-17T18:01:54.920499] [DEBUG] [VALIDATOR ] CEE: Validating primary data. [2025-09-17T18:01:55.368988] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-17T18:01:55.369413] [DEBUG] [VALIDATOR ] CEE: All expected trading days are present. [2025-09-17T18:01:55.382038] [DEBUG] [VALIDATOR ] CEE: Primary data validation passed. [2025-09-17T18:01:55.382945] [INFO ] [MAIN ] CEE: Fetched primary data is valid. [2025-09-17T18:01:55.383046] [DEBUG] [LOCAL ] CEE: Saving primary data. [2025-09-17T18:01:55.384977] [DEBUG] [LOCAL ] CEE: Trimmed 10171 records to 7025 (keeping 200 days of data) [2025-09-17T18:01:55.430527] [DEBUG] [LOCAL ] CEE: Primary data saved (7025 records). [2025-09-17T18:01:55.430715] [INFO ] [MAIN ] CEE: Full history saved. [2025-09-17T18:01:55.430829] [INFO ] [MAIN ] Update Progress: 427/2371 symbols completed. CEE took 32.2s. Estimated remaining: 4h 41m 47s. Rate: 6.9 symbols/min [2025-09-17T18:01:55.611683] [INFO ] [MAIN ] CFND: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:01:55.611878] [DEBUG] [LOCAL ] CFND: No existing data file found in primary storage. [2025-09-17T18:01:55.611917] [WARN ] [MAIN ] CFND: No existing data found, performing full refresh instead. [2025-09-17T18:01:55.612037] [INFO ] [MAIN ] CFND: Wiping existing primary data before full refresh. [2025-09-17T18:01:55.612099] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-17T18:01:55.612141] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-17T18:01:55.612183] [INFO ] [MAIN ] CFND: Starting full primary refresh. [2025-09-17T18:01:55.623360] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-01. [2025-09-17T18:01:55.990313] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T18:01:56.033015] [INFO ] [REMOTE ] CFND: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:01:56.415762] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-11. [2025-09-17T18:01:56.625771] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:01:56.626144] [WARN ] [REMOTE ] CFND: No data returned for month 2024-11 [2025-09-17T18:01:57.215880] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-05. [2025-09-17T18:01:57.746943] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T18:01:58.015773] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-08. [2025-09-17T18:01:58.815783] [INFO ] [REMOTE ] CFND: Fetching primary data for 2024-12. [2025-09-17T18:01:59.017358] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:01:59.017700] [WARN ] [REMOTE ] CFND: No data returned for month 2024-12 [2025-09-17T18:01:59.093562] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T18:01:59.180627] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T18:01:59.615815] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-06. [2025-09-17T18:02:00.415783] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-02. [2025-09-17T18:02:01.215822] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-01. [2025-09-17T18:02:01.433355] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T18:02:01.534493] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:02:01.534873] [WARN ] [REMOTE ] CFND: No data returned for month 2025-01 [2025-09-17T18:02:01.803181] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T18:02:02.015816] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-07. [2025-09-17T18:02:02.815831] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-02. [2025-09-17T18:02:03.013044] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:02:03.013358] [WARN ] [REMOTE ] CFND: No data returned for month 2025-02 [2025-09-17T18:02:03.615815] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-03. [2025-09-17T18:02:03.846789] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T18:02:04.415822] [INFO ] [REMOTE ] CEPU: Fetching primary data for 2025-09. [2025-09-17T18:02:05.215778] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-08. [2025-09-17T18:02:05.453458] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T18:02:05.873819] [INFO ] [REMOTE ] CEPU: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T18:02:05.878194] [INFO ] [REMOTE ] CEPU: Full fetch complete (39352 records). [2025-09-17T18:02:05.878351] [DEBUG] [VALIDATOR ] CEPU: Validating primary data. [2025-09-17T18:02:06.023486] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-03. [2025-09-17T18:02:06.267487] [DEBUG] [VALIDATOR ] CEPU: All expected trading days are present. [2025-09-17T18:02:06.267564] [DEBUG] [VALIDATOR ] CEPU: Primary data validation passed. [2025-09-17T18:02:06.268072] [INFO ] [MAIN ] CEPU: Fetched primary data is valid. [2025-09-17T18:02:06.268132] [DEBUG] [LOCAL ] CEPU: Saving primary data. [2025-09-17T18:02:06.269003] [DEBUG] [LOCAL ] CEPU: Trimmed 39352 records to 25568 (keeping 200 days of data) [2025-09-17T18:02:06.323114] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:02:06.360198] [WARN ] [REMOTE ] CFND: No data returned for month 2025-03 [2025-09-17T18:02:06.428309] [DEBUG] [LOCAL ] CEPU: Primary data saved (25568 records). [2025-09-17T18:02:06.428468] [INFO ] [MAIN ] CEPU: Full history saved. [2025-09-17T18:02:06.428581] [INFO ] [MAIN ] Update Progress: 428/2371 symbols completed. CEPU took 39.4s. Estimated remaining: 4h 41m 48s. Rate: 6.9 symbols/min [2025-09-17T18:02:06.610616] [INFO ] [MAIN ] CFR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:02:06.654172] [DEBUG] [LOCAL ] CFR: Loaded 33633 existing records from primary storage. [2025-09-17T18:02:06.654323] [INFO ] [MAIN ] CFR: Loaded 33633 existing records. [2025-09-17T18:02:06.824409] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-04. [2025-09-17T18:02:06.875034] [WARN ] [MAIN ] CFR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:02:06.876111] [INFO ] [MAIN ] CFR: Wiping existing primary data before full refresh. [2025-09-17T18:02:06.876174] [INFO ] [LOCAL ] CFR: Starting deletion of primary data. [2025-09-17T18:02:06.879342] [DEBUG] [LOCAL ] CFR: Deleted primary data file. [2025-09-17T18:02:06.879552] [INFO ] [MAIN ] CFR: Starting full primary refresh. [2025-09-17T18:02:06.955683] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T18:02:07.144690] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:02:07.171866] [WARN ] [REMOTE ] CFND: No data returned for month 2025-04 [2025-09-17T18:02:07.261873] [INFO ] [REMOTE ] CFR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:02:07.615786] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-04. [2025-09-17T18:02:08.415793] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-05. [2025-09-17T18:02:08.627680] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:02:08.628092] [WARN ] [REMOTE ] CFND: No data returned for month 2025-05 [2025-09-17T18:02:09.215843] [INFO ] [REMOTE ] CF: Fetching primary data for 2025-09. [2025-09-17T18:02:09.805871] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-17T18:02:10.015869] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-06. [2025-09-17T18:02:10.253263] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:02:10.253679] [WARN ] [REMOTE ] CFND: No data returned for month 2025-06 [2025-09-17T18:02:10.815806] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-05. [2025-09-17T18:02:11.112033] [INFO ] [REMOTE ] CF: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T18:02:11.122751] [INFO ] [REMOTE ] CF: Full fetch complete (74915 records). [2025-09-17T18:02:11.123159] [DEBUG] [VALIDATOR ] CF: Validating primary data. [2025-09-17T18:02:11.568759] [DEBUG] [VALIDATOR ] CF: All expected trading days are present. [2025-09-17T18:02:11.568851] [DEBUG] [VALIDATOR ] CF: Primary data validation passed. [2025-09-17T18:02:11.569736] [INFO ] [MAIN ] CF: Fetched primary data is valid. [2025-09-17T18:02:11.569836] [DEBUG] [LOCAL ] CF: Saving primary data. [2025-09-17T18:02:11.571415] [DEBUG] [LOCAL ] CF: Trimmed 74915 records to 52258 (keeping 200 days of data) [2025-09-17T18:02:11.639121] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-07. [2025-09-17T18:02:11.883856] [DEBUG] [REMOTE ] CFND: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:02:11.901785] [WARN ] [REMOTE ] CFND: No data returned for month 2025-07 [2025-09-17T18:02:11.923287] [DEBUG] [LOCAL ] CF: Primary data saved (52258 records). [2025-09-17T18:02:11.923440] [INFO ] [MAIN ] CF: Full history saved. [2025-09-17T18:02:11.923559] [INFO ] [MAIN ] Update Progress: 429/2371 symbols completed. CF took 41.0s. Estimated remaining: 4h 41m 25s. Rate: 6.9 symbols/min [2025-09-17T18:02:12.099433] [INFO ] [MAIN ] CGAU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:02:12.141564] [DEBUG] [LOCAL ] CGAU: Loaded 42404 existing records from primary storage. [2025-09-17T18:02:12.141726] [INFO ] [MAIN ] CGAU: Loaded 42404 existing records. [2025-09-17T18:02:12.325271] [WARN ] [MAIN ] CGAU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:02:12.325504] [INFO ] [MAIN ] CGAU: Wiping existing primary data before full refresh. [2025-09-17T18:02:12.325551] [INFO ] [LOCAL ] CGAU: Starting deletion of primary data. [2025-09-17T18:02:12.326260] [DEBUG] [LOCAL ] CGAU: Deleted primary data file. [2025-09-17T18:02:12.326311] [INFO ] [MAIN ] CGAU: Starting full primary refresh. [2025-09-17T18:02:12.420930] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-08. [2025-09-17T18:02:12.710895] [INFO ] [REMOTE ] CGAU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:02:12.745879] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T18:02:13.215774] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-11. [2025-09-17T18:02:13.439331] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T18:02:14.015832] [INFO ] [REMOTE ] CFND: Fetching primary data for 2025-09. [2025-09-17T18:02:14.634665] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T18:02:14.761622] [INFO ] [REMOTE ] CFND: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T18:02:14.763152] [INFO ] [REMOTE ] CFND: Full fetch complete (2339 records). [2025-09-17T18:02:14.763258] [DEBUG] [VALIDATOR ] CFND: Validating primary data. [2025-09-17T18:02:14.820981] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-11. [2025-09-17T18:02:14.958328] [WARN ] [VALIDATOR ] CFND: Validation failed - insufficient historical data. Have 29 unique days, need 200 days [2025-09-17T18:02:14.958606] [FATAL] [MAIN ] CFND: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:02:14.958685] [WARN ] [MAIN ] CFND: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:02:14.958735] [INFO ] [LOCAL ] CFND: Starting deletion of primary data. [2025-09-17T18:02:14.958794] [DEBUG] [LOCAL ] CFND: No primary data file found to delete. [2025-09-17T18:02:14.958844] [INFO ] [LOCAL ] CFND: Starting deletion of derivative data. [2025-09-17T18:02:14.958901] [DEBUG] [LOCAL ] CFND: No derivative data file found to delete. [2025-09-17T18:02:14.958961] [INFO ] [MAIN ] Update Progress: 430/2371 symbols completed. CFND took 19.5s. Estimated remaining: 4h 40m 51s. Rate: 6.9 symbols/min [2025-09-17T18:02:15.130780] [INFO ] [MAIN ] CGV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:02:15.134234] [DEBUG] [LOCAL ] CGV: Loaded 1441 existing records from primary storage. [2025-09-17T18:02:15.134306] [INFO ] [MAIN ] CGV: Loaded 1441 existing records. [2025-09-17T18:02:15.311202] [WARN ] [MAIN ] CGV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:02:15.311463] [INFO ] [MAIN ] CGV: Wiping existing primary data before full refresh. [2025-09-17T18:02:15.311508] [INFO ] [LOCAL ] CGV: Starting deletion of primary data. [2025-09-17T18:02:15.311802] [DEBUG] [LOCAL ] CGV: Deleted primary data file. [2025-09-17T18:02:15.311877] [INFO ] [MAIN ] CGV: Starting full primary refresh. [2025-09-17T18:02:15.621016] [INFO ] [REMOTE ] CFR: Fetching primary data for 2024-12. [2025-09-17T18:02:15.731999] [INFO ] [REMOTE ] CGV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:02:16.415838] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-06. [2025-09-17T18:02:16.741209] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T18:02:17.076409] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T18:02:17.215808] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-11. [2025-09-17T18:02:17.807097] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T18:02:17.940505] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T18:02:18.015789] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2024-12. [2025-09-17T18:02:18.815809] [INFO ] [REMOTE ] CGV: Fetching primary data for 2024-12. [2025-09-17T18:02:19.298815] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T18:02:19.503451] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T18:02:19.615813] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-01. [2025-09-17T18:02:20.415823] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-01. [2025-09-17T18:02:21.080953] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T18:02:21.110839] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T18:02:21.215798] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-07. [2025-09-17T18:02:22.015799] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-02. [2025-09-17T18:02:22.457886] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T18:02:22.815823] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-01. [2025-09-17T18:02:23.280063] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T18:02:23.615822] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-08. [2025-09-17T18:02:24.207708] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T18:02:24.415808] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-02. [2025-09-17T18:02:25.098953] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T18:02:25.215819] [INFO ] [REMOTE ] CFG: Fetching primary data for 2025-09. [2025-09-17T18:02:25.962630] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T18:02:26.015838] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-03. [2025-09-17T18:02:26.815835] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-02. [2025-09-17T18:02:26.917104] [INFO ] [REMOTE ] CFG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T18:02:26.924359] [INFO ] [REMOTE ] CFG: Full fetch complete (77008 records). [2025-09-17T18:02:26.924520] [DEBUG] [VALIDATOR ] CFG: Validating primary data. [2025-09-17T18:02:26.925755] [FATAL] [VALIDATOR ] CFG: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:02:26.925895] [FATAL] [MAIN ] CFG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:02:26.925945] [WARN ] [MAIN ] CFG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:02:26.926006] [INFO ] [LOCAL ] CFG: Starting deletion of primary data. [2025-09-17T18:02:26.926081] [DEBUG] [LOCAL ] CFG: No primary data file found to delete. [2025-09-17T18:02:26.926127] [INFO ] [LOCAL ] CFG: Starting deletion of derivative data. [2025-09-17T18:02:26.926709] [DEBUG] [LOCAL ] CFG: Deleted derivative data file. [2025-09-17T18:02:26.926883] [INFO ] [MAIN ] Update Progress: 431/2371 symbols completed. CFG took 39.0s. Estimated remaining: 4h 40m 57s. Rate: 6.9 symbols/min [2025-09-17T18:02:27.122199] [INFO ] [MAIN ] CHCT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:02:27.150967] [DEBUG] [LOCAL ] CHCT: Loaded 24153 existing records from primary storage. [2025-09-17T18:02:27.151202] [INFO ] [MAIN ] CHCT: Loaded 24153 existing records. [2025-09-17T18:02:27.350822] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T18:02:27.390283] [WARN ] [MAIN ] CHCT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:02:27.390518] [INFO ] [MAIN ] CHCT: Wiping existing primary data before full refresh. [2025-09-17T18:02:27.390563] [INFO ] [LOCAL ] CHCT: Starting deletion of primary data. [2025-09-17T18:02:27.391223] [DEBUG] [LOCAL ] CHCT: Deleted primary data file. [2025-09-17T18:02:27.391272] [INFO ] [MAIN ] CHCT: Starting full primary refresh. [2025-09-17T18:02:27.620979] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-03. [2025-09-17T18:02:27.816228] [INFO ] [REMOTE ] CHCT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:02:28.324035] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T18:02:28.348484] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T18:02:28.415722] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-04. [2025-09-17T18:02:28.891883] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-17T18:02:29.215802] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-11. [2025-09-17T18:02:30.015749] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-03. [2025-09-17T18:02:30.492713] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T18:02:30.815795] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2024-12. [2025-09-17T18:02:31.619982] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-05. [2025-09-17T18:02:31.626702] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T18:02:32.050194] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T18:02:32.062151] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T18:02:32.415788] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-04. [2025-09-17T18:02:33.215827] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-01. [2025-09-17T18:02:33.715736] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T18:02:34.015818] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-04. [2025-09-17T18:02:34.333948] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T18:02:34.815819] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-02. [2025-09-17T18:02:35.329846] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T18:02:35.615823] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-05. [2025-09-17T18:02:35.959528] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T18:02:36.415853] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-06. [2025-09-17T18:02:36.702921] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-17T18:02:37.215830] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-07. [2025-09-17T18:02:37.278979] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T18:02:37.634812] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-17T18:02:38.015834] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-06. [2025-09-17T18:02:38.815856] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-08. [2025-09-17T18:02:39.516746] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T18:02:39.612667] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T18:02:39.618423] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-05. [2025-09-17T18:02:40.415791] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-03. [2025-09-17T18:02:41.181353] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T18:02:41.215792] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-07. [2025-09-17T18:02:41.682122] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T18:02:42.015776] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-06. [2025-09-17T18:02:42.199825] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T18:02:42.815788] [INFO ] [REMOTE ] CGV: Fetching primary data for 2025-09. [2025-09-17T18:02:43.309227] [INFO ] [REMOTE ] CGV: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T18:02:43.309977] [INFO ] [REMOTE ] CGV: Full fetch complete (2277 records). [2025-09-17T18:02:43.310046] [DEBUG] [VALIDATOR ] CGV: Validating primary data. [2025-09-17T18:02:43.616482] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-08. [2025-09-17T18:02:43.671409] [DEBUG] [VALIDATOR ] CGV: All expected trading days are present. [2025-09-17T18:02:43.671535] [DEBUG] [VALIDATOR ] CGV: Primary data validation passed. [2025-09-17T18:02:43.671761] [INFO ] [MAIN ] CGV: Fetched primary data is valid. [2025-09-17T18:02:43.692810] [DEBUG] [LOCAL ] CGV: Saving primary data. [2025-09-17T18:02:43.693858] [DEBUG] [LOCAL ] CGV: Trimmed 2277 records to 1429 (keeping 200 days of data) [2025-09-17T18:02:43.696330] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T18:02:43.714206] [DEBUG] [LOCAL ] CGV: Primary data saved (1429 records). [2025-09-17T18:02:43.714338] [INFO ] [MAIN ] CGV: Full history saved. [2025-09-17T18:02:43.714484] [INFO ] [MAIN ] Update Progress: 432/2371 symbols completed. CGV took 28.8s. Estimated remaining: 4h 41m 25s. Rate: 6.9 symbols/min [2025-09-17T18:02:43.882721] [INFO ] [MAIN ] CHD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:02:43.946178] [DEBUG] [LOCAL ] CHD: Loaded 51984 existing records from primary storage. [2025-09-17T18:02:43.946341] [INFO ] [MAIN ] CHD: Loaded 51984 existing records. [2025-09-17T18:02:44.123550] [WARN ] [MAIN ] CHD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:02:44.123855] [INFO ] [MAIN ] CHD: Wiping existing primary data before full refresh. [2025-09-17T18:02:44.123901] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-17T18:02:44.125057] [DEBUG] [LOCAL ] CHD: Deleted primary data file. [2025-09-17T18:02:44.125110] [INFO ] [MAIN ] CHD: Starting full primary refresh. [2025-09-17T18:02:44.421050] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-07. [2025-09-17T18:02:44.485901] [INFO ] [REMOTE ] CHD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:02:45.154141] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T18:02:45.215746] [INFO ] [REMOTE ] CFR: Fetching primary data for 2025-09. [2025-09-17T18:02:46.015780] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-11. [2025-09-17T18:02:46.072844] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T18:02:46.745009] [INFO ] [REMOTE ] CFR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T18:02:46.750841] [INFO ] [REMOTE ] CFR: Full fetch complete (48299 records). [2025-09-17T18:02:46.751034] [DEBUG] [VALIDATOR ] CFR: Validating primary data. [2025-09-17T18:02:46.821018] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-08. [2025-09-17T18:02:47.151495] [DEBUG] [VALIDATOR ] CFR: All expected trading days are present. [2025-09-17T18:02:47.151596] [DEBUG] [VALIDATOR ] CFR: Primary data validation passed. [2025-09-17T18:02:47.152253] [INFO ] [MAIN ] CFR: Fetched primary data is valid. [2025-09-17T18:02:47.152303] [DEBUG] [LOCAL ] CFR: Saving primary data. [2025-09-17T18:02:47.153486] [DEBUG] [LOCAL ] CFR: Trimmed 48299 records to 33711 (keeping 200 days of data) [2025-09-17T18:02:47.387174] [DEBUG] [LOCAL ] CFR: Primary data saved (33711 records). [2025-09-17T18:02:47.387330] [INFO ] [MAIN ] CFR: Full history saved. [2025-09-17T18:02:47.387417] [INFO ] [MAIN ] Update Progress: 433/2371 symbols completed. CFR took 41.0s. Estimated remaining: 4h 40m 53s. Rate: 6.9 symbols/min [2025-09-17T18:02:47.564707] [INFO ] [MAIN ] CHE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:02:47.594266] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T18:02:47.616044] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-04. [2025-09-17T18:02:47.615982] [DEBUG] [LOCAL ] CHE: Loaded 14516 existing records from primary storage. [2025-09-17T18:02:47.616395] [INFO ] [MAIN ] CHE: Loaded 14516 existing records. [2025-09-17T18:02:47.803840] [WARN ] [MAIN ] CHE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:02:47.804132] [INFO ] [MAIN ] CHE: Wiping existing primary data before full refresh. [2025-09-17T18:02:47.804190] [INFO ] [LOCAL ] CHE: Starting deletion of primary data. [2025-09-17T18:02:47.804710] [DEBUG] [LOCAL ] CHE: Deleted primary data file. [2025-09-17T18:02:47.804767] [INFO ] [MAIN ] CHE: Starting full primary refresh. [2025-09-17T18:02:48.171319] [INFO ] [REMOTE ] CHE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:02:48.415768] [INFO ] [REMOTE ] CHD: Fetching primary data for 2024-12. [2025-09-17T18:02:48.493720] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T18:02:48.563397] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T18:02:49.215783] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-05. [2025-09-17T18:02:49.771416] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T18:02:50.015753] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-11. [2025-09-17T18:02:50.398794] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T18:02:50.797947] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T18:02:50.815764] [INFO ] [REMOTE ] CHE: Fetching primary data for 2024-12. [2025-09-17T18:02:51.615797] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-06. [2025-09-17T18:02:51.745388] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T18:02:52.415799] [INFO ] [REMOTE ] CGAU: Fetching primary data for 2025-09. [2025-09-17T18:02:52.903144] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T18:02:53.215968] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-07. [2025-09-17T18:02:54.015750] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-01. [2025-09-17T18:02:54.174063] [INFO ] [REMOTE ] CGAU: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T18:02:54.180464] [INFO ] [REMOTE ] CGAU: Full fetch complete (60047 records). [2025-09-17T18:02:54.180587] [DEBUG] [VALIDATOR ] CGAU: Validating primary data. [2025-09-17T18:02:54.590769] [DEBUG] [VALIDATOR ] CGAU: All expected trading days are present. [2025-09-17T18:02:54.590915] [DEBUG] [VALIDATOR ] CGAU: Primary data validation passed. [2025-09-17T18:02:54.591768] [INFO ] [MAIN ] CGAU: Fetched primary data is valid. [2025-09-17T18:02:54.591897] [DEBUG] [LOCAL ] CGAU: Saving primary data. [2025-09-17T18:02:54.610830] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T18:02:54.617186] [DEBUG] [LOCAL ] CGAU: Trimmed 60047 records to 42449 (keeping 200 days of data) [2025-09-17T18:02:54.726420] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T18:02:54.840131] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-02. [2025-09-17T18:02:54.887436] [DEBUG] [LOCAL ] CGAU: Primary data saved (42449 records). [2025-09-17T18:02:54.887561] [INFO ] [MAIN ] CGAU: Full history saved. [2025-09-17T18:02:54.887656] [INFO ] [MAIN ] Update Progress: 434/2371 symbols completed. CGAU took 43.0s. Estimated remaining: 4h 40m 39s. Rate: 6.9 symbols/min [2025-09-17T18:02:55.063179] [INFO ] [MAIN ] CHGG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:02:55.106466] [DEBUG] [LOCAL ] CHGG: Loaded 47838 existing records from primary storage. [2025-09-17T18:02:55.106608] [INFO ] [MAIN ] CHGG: Loaded 47838 existing records. [2025-09-17T18:02:55.285301] [WARN ] [MAIN ] CHGG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:02:55.285548] [INFO ] [MAIN ] CHGG: Wiping existing primary data before full refresh. [2025-09-17T18:02:55.285594] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-17T18:02:55.286623] [DEBUG] [LOCAL ] CHGG: Deleted primary data file. [2025-09-17T18:02:55.286702] [INFO ] [MAIN ] CHGG: Starting full primary refresh. [2025-09-17T18:02:55.620831] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-01. [2025-09-17T18:02:55.650296] [INFO ] [REMOTE ] CHGG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:02:55.700732] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T18:02:56.415827] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-08. [2025-09-17T18:02:57.215756] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-03. [2025-09-17T18:02:57.326042] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T18:02:57.525849] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T18:02:57.802634] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T18:02:58.015770] [INFO ] [REMOTE ] CHCT: Fetching primary data for 2025-09. [2025-09-17T18:02:58.807742] [INFO ] [REMOTE ] CHCT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T18:02:58.810891] [INFO ] [REMOTE ] CHCT: Full fetch complete (35017 records). [2025-09-17T18:02:58.810969] [DEBUG] [VALIDATOR ] CHCT: Validating primary data. [2025-09-17T18:02:58.822258] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-04. [2025-09-17T18:02:59.211355] [DEBUG] [VALIDATOR ] CHCT: All expected trading days are present. [2025-09-17T18:02:59.211457] [DEBUG] [VALIDATOR ] CHCT: Primary data validation passed. [2025-09-17T18:02:59.211974] [INFO ] [MAIN ] CHCT: Fetched primary data is valid. [2025-09-17T18:02:59.212019] [DEBUG] [LOCAL ] CHCT: Saving primary data. [2025-09-17T18:02:59.213125] [DEBUG] [LOCAL ] CHCT: Trimmed 35017 records to 24105 (keeping 200 days of data) [2025-09-17T18:02:59.365514] [DEBUG] [LOCAL ] CHCT: Primary data saved (24105 records). [2025-09-17T18:02:59.365715] [INFO ] [MAIN ] CHCT: Full history saved. [2025-09-17T18:02:59.365821] [INFO ] [MAIN ] Update Progress: 435/2371 symbols completed. CHCT took 32.4s. Estimated remaining: 4h 40m 12s. Rate: 6.9 symbols/min [2025-09-17T18:02:59.559558] [INFO ] [MAIN ] CHH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:02:59.599038] [DEBUG] [LOCAL ] CHH: Loaded 32484 existing records from primary storage. [2025-09-17T18:02:59.599203] [INFO ] [MAIN ] CHH: Loaded 32484 existing records. [2025-09-17T18:02:59.622582] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-02. [2025-09-17T18:02:59.798033] [WARN ] [MAIN ] CHH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:02:59.807381] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T18:02:59.807085] [INFO ] [MAIN ] CHH: Wiping existing primary data before full refresh. [2025-09-17T18:02:59.807517] [INFO ] [LOCAL ] CHH: Starting deletion of primary data. [2025-09-17T18:02:59.811660] [DEBUG] [LOCAL ] CHH: Deleted primary data file. [2025-09-17T18:02:59.811713] [INFO ] [MAIN ] CHH: Starting full primary refresh. [2025-09-17T18:03:00.194591] [INFO ] [REMOTE ] CHH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:03:00.415827] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-11. [2025-09-17T18:03:01.215798] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-05. [2025-09-17T18:03:01.757127] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-17T18:03:01.942529] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T18:03:02.015852] [INFO ] [REMOTE ] CHH: Fetching primary data for 2024-12. [2025-09-17T18:03:02.291291] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T18:03:02.815828] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-11. [2025-09-17T18:03:03.271377] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T18:03:03.615780] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-01. [2025-09-17T18:03:04.415780] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-03. [2025-09-17T18:03:04.562075] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T18:03:05.006602] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T18:03:05.215809] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-02. [2025-09-17T18:03:06.015823] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2024-12. [2025-09-17T18:03:06.290702] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T18:03:06.413606] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T18:03:06.815806] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-03. [2025-09-17T18:03:07.615804] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-04. [2025-09-17T18:03:07.884554] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T18:03:08.140982] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T18:03:08.415826] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-04. [2025-09-17T18:03:09.229488] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-06. [2025-09-17T18:03:09.237765] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T18:03:09.924949] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T18:03:10.015730] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-05. [2025-09-17T18:03:10.233927] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T18:03:10.815812] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-01. [2025-09-17T18:03:11.536556] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T18:03:11.615787] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-07. [2025-09-17T18:03:12.329286] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T18:03:12.415825] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-02. [2025-09-17T18:03:12.466158] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T18:03:13.215793] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-06. [2025-09-17T18:03:14.015750] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-05. [2025-09-17T18:03:14.055561] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T18:03:14.505442] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T18:03:14.815819] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-03. [2025-09-17T18:03:15.615829] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-08. [2025-09-17T18:03:15.801166] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T18:03:16.415787] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-07. [2025-09-17T18:03:16.612090] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T18:03:16.705675] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T18:03:17.215816] [INFO ] [REMOTE ] CHE: Fetching primary data for 2025-09. [2025-09-17T18:03:17.796242] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T18:03:18.015804] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-08. [2025-09-17T18:03:18.293516] [INFO ] [REMOTE ] CHE: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T18:03:18.297959] [INFO ] [REMOTE ] CHE: Full fetch complete (19263 records). [2025-09-17T18:03:18.298098] [DEBUG] [VALIDATOR ] CHE: Validating primary data. [2025-09-17T18:03:18.711281] [DEBUG] [VALIDATOR ] CHE: All expected trading days are present. [2025-09-17T18:03:18.711394] [DEBUG] [VALIDATOR ] CHE: Primary data validation passed. [2025-09-17T18:03:18.712111] [INFO ] [MAIN ] CHE: Fetched primary data is valid. [2025-09-17T18:03:18.712171] [DEBUG] [LOCAL ] CHE: Saving primary data. [2025-09-17T18:03:18.712950] [DEBUG] [LOCAL ] CHE: Trimmed 19263 records to 14583 (keeping 200 days of data) [2025-09-17T18:03:18.821888] [DEBUG] [LOCAL ] CHE: Primary data saved (14583 records). [2025-09-17T18:03:18.817980] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-04. [2025-09-17T18:03:18.822032] [INFO ] [MAIN ] CHE: Full history saved. [2025-09-17T18:03:18.822939] [INFO ] [MAIN ] Update Progress: 436/2371 symbols completed. CHE took 31.4s. Estimated remaining: 4h 40m 51s. Rate: 6.9 symbols/min [2025-09-17T18:03:19.013019] [INFO ] [MAIN ] CHMI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:03:19.034227] [DEBUG] [LOCAL ] CHMI: Loaded 22006 existing records from primary storage. [2025-09-17T18:03:19.034567] [INFO ] [MAIN ] CHMI: Loaded 22006 existing records. [2025-09-17T18:03:19.230019] [WARN ] [MAIN ] CHMI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:03:19.230372] [INFO ] [MAIN ] CHMI: Wiping existing primary data before full refresh. [2025-09-17T18:03:19.230505] [INFO ] [LOCAL ] CHMI: Starting deletion of primary data. [2025-09-17T18:03:19.231100] [DEBUG] [LOCAL ] CHMI: Deleted primary data file. [2025-09-17T18:03:19.231212] [INFO ] [MAIN ] CHMI: Starting full primary refresh. [2025-09-17T18:03:19.408347] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T18:03:19.615909] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-06. [2025-09-17T18:03:19.642094] [INFO ] [REMOTE ] CHMI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:03:20.353255] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T18:03:20.415776] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-05. [2025-09-17T18:03:21.215809] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-11. [2025-09-17T18:03:21.378328] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T18:03:21.822835] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T18:03:22.015764] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-06. [2025-09-17T18:03:22.230331] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T18:03:22.815913] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2024-12. [2025-09-17T18:03:23.615811] [INFO ] [REMOTE ] CHH: Fetching primary data for 2025-09. [2025-09-17T18:03:23.943716] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T18:03:23.994104] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T18:03:24.415826] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-07. [2025-09-17T18:03:25.084076] [INFO ] [REMOTE ] CHH: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T18:03:25.089995] [INFO ] [REMOTE ] CHH: Full fetch complete (46019 records). [2025-09-17T18:03:25.090150] [DEBUG] [VALIDATOR ] CHH: Validating primary data. [2025-09-17T18:03:25.220869] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-07. [2025-09-17T18:03:25.518415] [DEBUG] [VALIDATOR ] CHH: All expected trading days are present. [2025-09-17T18:03:25.518500] [DEBUG] [VALIDATOR ] CHH: Primary data validation passed. [2025-09-17T18:03:25.519107] [INFO ] [MAIN ] CHH: Fetched primary data is valid. [2025-09-17T18:03:25.519154] [DEBUG] [LOCAL ] CHH: Saving primary data. [2025-09-17T18:03:25.520235] [DEBUG] [LOCAL ] CHH: Trimmed 46019 records to 32453 (keeping 200 days of data) [2025-09-17T18:03:25.732318] [DEBUG] [LOCAL ] CHH: Primary data saved (32453 records). [2025-09-17T18:03:25.732466] [INFO ] [MAIN ] CHH: Full history saved. [2025-09-17T18:03:25.733893] [INFO ] [MAIN ] Update Progress: 437/2371 symbols completed. CHH took 26.4s. Estimated remaining: 4h 40m 34s. Rate: 6.9 symbols/min [2025-09-17T18:03:26.015784] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-01. [2025-09-17T18:03:26.089717] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T18:03:26.815775] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-08. [2025-09-17T18:03:27.154414] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T18:03:27.262555] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T18:03:27.615807] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-02. [2025-09-17T18:03:28.415773] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-08. [2025-09-17T18:03:28.661853] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T18:03:28.705955] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T18:03:29.215771] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-03. [2025-09-17T18:03:29.846690] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T18:03:30.015799] [INFO ] [REMOTE ] CHGG: Fetching primary data for 2025-09. [2025-09-17T18:03:30.476774] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T18:03:30.816055] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-04. [2025-09-17T18:03:31.615818] [INFO ] [REMOTE ] CHD: Fetching primary data for 2025-09. [2025-09-17T18:03:32.065435] [INFO ] [REMOTE ] CHGG: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-17T18:03:32.071607] [INFO ] [REMOTE ] CHGG: Full fetch complete (70327 records). [2025-09-17T18:03:32.071808] [DEBUG] [VALIDATOR ] CHGG: Validating primary data. [2025-09-17T18:03:32.072635] [FATAL] [VALIDATOR ] CHGG: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:03:32.072773] [FATAL] [MAIN ] CHGG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:03:32.072824] [WARN ] [MAIN ] CHGG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:03:32.072862] [INFO ] [LOCAL ] CHGG: Starting deletion of primary data. [2025-09-17T18:03:32.072922] [DEBUG] [LOCAL ] CHGG: No primary data file found to delete. [2025-09-17T18:03:32.072959] [INFO ] [LOCAL ] CHGG: Starting deletion of derivative data. [2025-09-17T18:03:32.073243] [DEBUG] [LOCAL ] CHGG: Deleted derivative data file. [2025-09-17T18:03:32.073341] [INFO ] [MAIN ] Update Progress: 438/2371 symbols completed. CHGG took 37.2s. Estimated remaining: 4h 40m 15s. Rate: 6.9 symbols/min [2025-09-17T18:03:32.374246] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T18:03:32.415810] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-05. [2025-09-17T18:03:33.644580] [INFO ] [REMOTE ] CHD: Incremental fetch complete for 2025-09 (2.03 seconds). [2025-09-17T18:03:33.651635] [INFO ] [REMOTE ] CHD: Full fetch complete (73774 records). [2025-09-17T18:03:33.651827] [DEBUG] [VALIDATOR ] CHD: Validating primary data. [2025-09-17T18:03:33.652569] [FATAL] [VALIDATOR ] CHD: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:03:33.652695] [FATAL] [MAIN ] CHD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:03:33.652748] [WARN ] [MAIN ] CHD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:03:33.652806] [INFO ] [LOCAL ] CHD: Starting deletion of primary data. [2025-09-17T18:03:33.652879] [DEBUG] [LOCAL ] CHD: No primary data file found to delete. [2025-09-17T18:03:33.652927] [INFO ] [LOCAL ] CHD: Starting deletion of derivative data. [2025-09-17T18:03:33.653269] [DEBUG] [LOCAL ] CHD: Deleted derivative data file. [2025-09-17T18:03:33.653387] [INFO ] [MAIN ] Update Progress: 439/2371 symbols completed. CHD took 49.9s. Estimated remaining: 4h 39m 35s. Rate: 6.9 symbols/min [2025-09-17T18:03:33.682569] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T18:03:33.687189] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-06. [2025-09-17T18:03:34.876419] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T18:03:34.881753] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-07. [2025-09-17T18:03:35.793777] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T18:03:35.799129] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-08. [2025-09-17T18:03:36.821353] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T18:03:36.826501] [INFO ] [REMOTE ] CHMI: Fetching primary data for 2025-09. [2025-09-17T18:03:37.946234] [INFO ] [REMOTE ] CHMI: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T18:03:37.950198] [INFO ] [REMOTE ] CHMI: Full fetch complete (31574 records). [2025-09-17T18:03:37.950335] [DEBUG] [VALIDATOR ] CHMI: Validating primary data. [2025-09-17T18:03:38.353600] [DEBUG] [VALIDATOR ] CHMI: All expected trading days are present. [2025-09-17T18:03:38.353757] [DEBUG] [VALIDATOR ] CHMI: Primary data validation passed. [2025-09-17T18:03:38.354293] [INFO ] [MAIN ] CHMI: Fetched primary data is valid. [2025-09-17T18:03:38.354384] [DEBUG] [LOCAL ] CHMI: Saving primary data. [2025-09-17T18:03:38.356444] [DEBUG] [LOCAL ] CHMI: Trimmed 31574 records to 22064 (keeping 200 days of data) [2025-09-17T18:03:38.490843] [DEBUG] [LOCAL ] CHMI: Primary data saved (22064 records). [2025-09-17T18:03:38.490978] [INFO ] [MAIN ] CHMI: Full history saved. [2025-09-17T18:03:38.491064] [INFO ] [MAIN ] Update Progress: 440/2371 symbols completed. CHMI took 19.7s. Estimated remaining: 4h 39m 10s. Rate: 6.9 symbols/min [2025-09-17T18:03:39.050144] [INFO ] [MAIN ] CHPT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:03:39.194417] [INFO ] [MAIN ] CHT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:03:39.256043] [INFO ] [MAIN ] CHN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:03:39.258285] [INFO ] [MAIN ] CHWY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:03:39.269003] [DEBUG] [LOCAL ] CHN: Loaded 4839 existing records from primary storage. [2025-09-17T18:03:39.269273] [INFO ] [MAIN ] CHN: Loaded 4839 existing records. [2025-09-17T18:03:39.422459] [DEBUG] [LOCAL ] CHT: Loaded 19821 existing records from primary storage. [2025-09-17T18:03:39.439181] [INFO ] [MAIN ] CHT: Loaded 19821 existing records. [2025-09-17T18:03:39.560525] [DEBUG] [LOCAL ] CHWY: Loaded 53626 existing records from primary storage. [2025-09-17T18:03:39.603401] [INFO ] [MAIN ] CHWY: Loaded 53626 existing records. [2025-09-17T18:03:39.564218] [WARN ] [MAIN ] CHN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:03:39.630620] [DEBUG] [LOCAL ] CHPT: Loaded 49915 existing records from primary storage. [2025-09-17T18:03:39.674735] [INFO ] [MAIN ] CHPT: Loaded 49915 existing records. [2025-09-17T18:03:39.694149] [INFO ] [MAIN ] CHN: Wiping existing primary data before full refresh. [2025-09-17T18:03:39.779503] [INFO ] [LOCAL ] CHN: Starting deletion of primary data. [2025-09-17T18:03:39.930590] [DEBUG] [LOCAL ] CHN: Deleted primary data file. [2025-09-17T18:03:39.955348] [WARN ] [MAIN ] CHT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:03:40.000481] [INFO ] [MAIN ] CHN: Starting full primary refresh. [2025-09-17T18:03:40.053532] [WARN ] [MAIN ] CHWY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:03:40.069530] [INFO ] [MAIN ] CHT: Wiping existing primary data before full refresh. [2025-09-17T18:03:40.125531] [INFO ] [LOCAL ] CHT: Starting deletion of primary data. [2025-09-17T18:03:40.131867] [INFO ] [MAIN ] CHWY: Wiping existing primary data before full refresh. [2025-09-17T18:03:40.172515] [DEBUG] [LOCAL ] CHT: Deleted primary data file. [2025-09-17T18:03:40.190258] [INFO ] [LOCAL ] CHWY: Starting deletion of primary data. [2025-09-17T18:03:40.190165] [WARN ] [MAIN ] CHPT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:03:40.202981] [INFO ] [MAIN ] CHT: Starting full primary refresh. [2025-09-17T18:03:40.232696] [DEBUG] [LOCAL ] CHWY: Deleted primary data file. [2025-09-17T18:03:40.232995] [INFO ] [MAIN ] CHWY: Starting full primary refresh. [2025-09-17T18:03:40.232854] [INFO ] [MAIN ] CHPT: Wiping existing primary data before full refresh. [2025-09-17T18:03:40.277545] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-17T18:03:40.386427] [DEBUG] [LOCAL ] CHPT: Deleted primary data file. [2025-09-17T18:03:40.466920] [INFO ] [MAIN ] CHPT: Starting full primary refresh. [2025-09-17T18:03:41.268539] [INFO ] [REMOTE ] CHN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:03:41.330260] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-11. [2025-09-17T18:03:41.418132] [INFO ] [REMOTE ] CHWY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:03:41.439126] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-11. [2025-09-17T18:03:41.548934] [INFO ] [REMOTE ] CHT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:03:41.555219] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-11. [2025-09-17T18:03:41.630475] [INFO ] [REMOTE ] CHPT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:03:41.630844] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-11. [2025-09-17T18:03:42.153573] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T18:03:42.155443] [INFO ] [REMOTE ] CHN: Fetching primary data for 2024-12. [2025-09-17T18:03:42.781331] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T18:03:42.783293] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-01. [2025-09-17T18:03:42.834691] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T18:03:42.839097] [INFO ] [REMOTE ] CHT: Fetching primary data for 2024-12. [2025-09-17T18:03:43.435182] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T18:03:43.437257] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-02. [2025-09-17T18:03:43.478067] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-17T18:03:43.489258] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2024-12. [2025-09-17T18:03:43.792673] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-11 (2.16 seconds). [2025-09-17T18:03:43.804973] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2024-12. [2025-09-17T18:03:44.000508] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T18:03:44.185634] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T18:03:44.415797] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-03. [2025-09-17T18:03:45.072704] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T18:03:45.215776] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-04. [2025-09-17T18:03:45.515020] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T18:03:45.593363] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-17T18:03:46.015789] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-05. [2025-09-17T18:03:46.209786] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2024-12 (2.40 seconds). [2025-09-17T18:03:46.635248] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T18:03:46.815806] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-06. [2025-09-17T18:03:47.503040] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T18:03:47.615780] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-07. [2025-09-17T18:03:48.183631] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T18:03:48.415762] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-08. [2025-09-17T18:03:49.078925] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T18:03:49.215802] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-01. [2025-09-17T18:03:50.015793] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-01. [2025-09-17T18:03:50.815815] [INFO ] [REMOTE ] CHN: Fetching primary data for 2025-09. [2025-09-17T18:03:50.972859] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T18:03:51.154428] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T18:03:51.615800] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-02. [2025-09-17T18:03:51.910442] [INFO ] [REMOTE ] CHN: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T18:03:51.911801] [INFO ] [REMOTE ] CHN: Full fetch complete (7591 records). [2025-09-17T18:03:51.911871] [DEBUG] [VALIDATOR ] CHN: Validating primary data. [2025-09-17T18:03:52.286956] [DEBUG] [VALIDATOR ] CHN: All expected trading days are present. [2025-09-17T18:03:52.287060] [DEBUG] [VALIDATOR ] CHN: Primary data validation passed. [2025-09-17T18:03:52.287299] [INFO ] [MAIN ] CHN: Fetched primary data is valid. [2025-09-17T18:03:52.287341] [DEBUG] [LOCAL ] CHN: Saving primary data. [2025-09-17T18:03:52.287864] [DEBUG] [LOCAL ] CHN: Trimmed 7591 records to 4806 (keeping 200 days of data) [2025-09-17T18:03:52.316806] [DEBUG] [LOCAL ] CHN: Primary data saved (4806 records). [2025-09-17T18:03:52.316879] [INFO ] [MAIN ] CHN: Full history saved. [2025-09-17T18:03:52.316958] [INFO ] [MAIN ] Update Progress: 441/2371 symbols completed. CHN took 13.8s. Estimated remaining: 4h 39m 24s. Rate: 6.9 symbols/min [2025-09-17T18:03:52.417910] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-02. [2025-09-17T18:03:52.488376] [INFO ] [MAIN ] CI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:03:52.540980] [DEBUG] [LOCAL ] CI: Loaded 49995 existing records from primary storage. [2025-09-17T18:03:52.541162] [INFO ] [MAIN ] CI: Loaded 49995 existing records. [2025-09-17T18:03:52.723231] [WARN ] [MAIN ] CI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:03:52.723505] [INFO ] [MAIN ] CI: Wiping existing primary data before full refresh. [2025-09-17T18:03:52.723551] [INFO ] [LOCAL ] CI: Starting deletion of primary data. [2025-09-17T18:03:52.724776] [DEBUG] [LOCAL ] CI: Deleted primary data file. [2025-09-17T18:03:52.724831] [INFO ] [MAIN ] CI: Starting full primary refresh. [2025-09-17T18:03:53.090151] [INFO ] [REMOTE ] CI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:03:53.215784] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-01. [2025-09-17T18:03:53.389278] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T18:03:53.515042] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T18:03:54.015779] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-03. [2025-09-17T18:03:54.815860] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-03. [2025-09-17T18:03:54.897214] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T18:03:55.580535] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-17T18:03:55.615808] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-02. [2025-09-17T18:03:56.415797] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-11. [2025-09-17T18:03:56.869335] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T18:03:57.215840] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-04. [2025-09-17T18:03:57.769736] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-17T18:03:58.015754] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-03. [2025-09-17T18:03:58.316821] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T18:03:58.469350] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T18:03:58.815768] [INFO ] [REMOTE ] CI: Fetching primary data for 2024-12. [2025-09-17T18:03:59.615797] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-05. [2025-09-17T18:04:00.189786] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-17T18:04:00.359672] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T18:04:00.415832] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-04. [2025-09-17T18:04:00.850308] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T18:04:01.215776] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-01. [2025-09-17T18:04:02.015806] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-04. [2025-09-17T18:04:02.658363] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-17T18:04:02.815819] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-05. [2025-09-17T18:04:03.046180] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T18:04:03.605776] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T18:04:03.616458] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-06. [2025-09-17T18:04:04.415769] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-05. [2025-09-17T18:04:04.765413] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T18:04:05.043200] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-17T18:04:05.215788] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-06. [2025-09-17T18:04:06.015816] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-07. [2025-09-17T18:04:06.617257] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-05 (2.20 seconds). [2025-09-17T18:04:06.815773] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-06. [2025-09-17T18:04:07.052088] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T18:04:07.229693] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T18:04:07.615775] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-08. [2025-09-17T18:04:08.415808] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-02. [2025-09-17T18:04:08.687715] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T18:04:08.845561] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T18:04:09.215804] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-07. [2025-09-17T18:04:10.015785] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-07. [2025-09-17T18:04:10.672933] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-17T18:04:10.815738] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-03. [2025-09-17T18:04:11.348696] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T18:04:11.615779] [INFO ] [REMOTE ] CHT: Fetching primary data for 2025-09. [2025-09-17T18:04:12.324658] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-17T18:04:12.415759] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-08. [2025-09-17T18:04:12.484208] [INFO ] [REMOTE ] CHT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T18:04:12.488279] [INFO ] [REMOTE ] CHT: Full fetch complete (27453 records). [2025-09-17T18:04:12.488415] [DEBUG] [VALIDATOR ] CHT: Validating primary data. [2025-09-17T18:04:12.874950] [DEBUG] [VALIDATOR ] CHT: All expected trading days are present. [2025-09-17T18:04:12.875037] [DEBUG] [VALIDATOR ] CHT: Primary data validation passed. [2025-09-17T18:04:12.875464] [INFO ] [MAIN ] CHT: Fetched primary data is valid. [2025-09-17T18:04:12.875570] [DEBUG] [LOCAL ] CHT: Saving primary data. [2025-09-17T18:04:12.876426] [DEBUG] [LOCAL ] CHT: Trimmed 27453 records to 19812 (keeping 200 days of data) [2025-09-17T18:04:12.999802] [DEBUG] [LOCAL ] CHT: Primary data saved (19812 records). [2025-09-17T18:04:12.999955] [INFO ] [MAIN ] CHT: Full history saved. [2025-09-17T18:04:13.000042] [INFO ] [MAIN ] Update Progress: 442/2371 symbols completed. CHT took 34.5s. Estimated remaining: 4h 40m 7s. Rate: 6.9 symbols/min [2025-09-17T18:04:13.178925] [INFO ] [MAIN ] CIA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:04:13.196300] [DEBUG] [LOCAL ] CIA: Loaded 16768 existing records from primary storage. [2025-09-17T18:04:13.196447] [INFO ] [MAIN ] CIA: Loaded 16768 existing records. [2025-09-17T18:04:13.226857] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-08. [2025-09-17T18:04:13.379423] [WARN ] [MAIN ] CIA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:04:13.379720] [INFO ] [MAIN ] CIA: Wiping existing primary data before full refresh. [2025-09-17T18:04:13.379770] [INFO ] [LOCAL ] CIA: Starting deletion of primary data. [2025-09-17T18:04:13.380299] [DEBUG] [LOCAL ] CIA: Deleted primary data file. [2025-09-17T18:04:13.380345] [INFO ] [MAIN ] CIA: Starting full primary refresh. [2025-09-17T18:04:13.746876] [INFO ] [REMOTE ] CIA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:04:13.822629] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-03 (3.01 seconds). [2025-09-17T18:04:14.015771] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-11. [2025-09-17T18:04:14.080074] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T18:04:14.729017] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T18:04:14.815728] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-04. [2025-09-17T18:04:15.220771] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T18:04:15.615792] [INFO ] [REMOTE ] CHPT: Fetching primary data for 2025-09. [2025-09-17T18:04:16.421132] [INFO ] [REMOTE ] CIA: Fetching primary data for 2024-12. [2025-09-17T18:04:16.423766] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T18:04:17.155995] [INFO ] [REMOTE ] CHPT: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T18:04:17.161015] [INFO ] [REMOTE ] CHPT: Full fetch complete (73608 records). [2025-09-17T18:04:17.161183] [DEBUG] [VALIDATOR ] CHPT: Validating primary data. [2025-09-17T18:04:17.162096] [FATAL] [VALIDATOR ] CHPT: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:04:17.162196] [FATAL] [MAIN ] CHPT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:04:17.162234] [WARN ] [MAIN ] CHPT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:04:17.162272] [INFO ] [LOCAL ] CHPT: Starting deletion of primary data. [2025-09-17T18:04:17.162332] [DEBUG] [LOCAL ] CHPT: No primary data file found to delete. [2025-09-17T18:04:17.162367] [INFO ] [LOCAL ] CHPT: Starting deletion of derivative data. [2025-09-17T18:04:17.162767] [DEBUG] [LOCAL ] CHPT: Deleted derivative data file. [2025-09-17T18:04:17.162859] [INFO ] [MAIN ] Update Progress: 443/2371 symbols completed. CHPT took 38.7s. Estimated remaining: 4h 39m 39s. Rate: 6.9 symbols/min [2025-09-17T18:04:17.227233] [INFO ] [REMOTE ] CHWY: Fetching primary data for 2025-09. [2025-09-17T18:04:17.340911] [INFO ] [MAIN ] CIB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:04:17.353143] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T18:04:17.382410] [DEBUG] [LOCAL ] CIB: Loaded 31191 existing records from primary storage. [2025-09-17T18:04:17.382564] [INFO ] [MAIN ] CIB: Loaded 31191 existing records. [2025-09-17T18:04:17.569917] [WARN ] [MAIN ] CIB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:04:17.570175] [INFO ] [MAIN ] CIB: Wiping existing primary data before full refresh. [2025-09-17T18:04:17.570222] [INFO ] [LOCAL ] CIB: Starting deletion of primary data. [2025-09-17T18:04:17.571013] [DEBUG] [LOCAL ] CIB: Deleted primary data file. [2025-09-17T18:04:17.571089] [INFO ] [MAIN ] CIB: Starting full primary refresh. [2025-09-17T18:04:17.929012] [INFO ] [REMOTE ] CIB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:04:18.015740] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-11. [2025-09-17T18:04:18.815791] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-01. [2025-09-17T18:04:19.312947] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T18:04:19.426322] [INFO ] [REMOTE ] CHWY: Incremental fetch complete for 2025-09 (2.20 seconds). [2025-09-17T18:04:19.433763] [INFO ] [REMOTE ] CHWY: Full fetch complete (77507 records). [2025-09-17T18:04:19.433925] [DEBUG] [VALIDATOR ] CHWY: Validating primary data. [2025-09-17T18:04:19.596518] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T18:04:19.617821] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-05. [2025-09-17T18:04:19.875319] [DEBUG] [VALIDATOR ] CHWY: All expected trading days are present. [2025-09-17T18:04:19.875408] [DEBUG] [VALIDATOR ] CHWY: Primary data validation passed. [2025-09-17T18:04:19.876403] [INFO ] [MAIN ] CHWY: Fetched primary data is valid. [2025-09-17T18:04:19.876467] [DEBUG] [LOCAL ] CHWY: Saving primary data. [2025-09-17T18:04:19.878060] [DEBUG] [LOCAL ] CHWY: Trimmed 77507 records to 53626 (keeping 200 days of data) [2025-09-17T18:04:20.216361] [DEBUG] [LOCAL ] CHWY: Primary data saved (53626 records). [2025-09-17T18:04:20.216526] [INFO ] [MAIN ] CHWY: Full history saved. [2025-09-17T18:04:20.217383] [INFO ] [MAIN ] Update Progress: 444/2371 symbols completed. CHWY took 41.7s. Estimated remaining: 4h 39m 5s. Rate: 6.9 symbols/min [2025-09-17T18:04:20.403166] [INFO ] [MAIN ] CICB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:04:20.403368] [DEBUG] [LOCAL ] CICB: No existing data file found in primary storage. [2025-09-17T18:04:20.403409] [WARN ] [MAIN ] CICB: No existing data found, performing full refresh instead. [2025-09-17T18:04:20.403533] [INFO ] [MAIN ] CICB: Wiping existing primary data before full refresh. [2025-09-17T18:04:20.403574] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-17T18:04:20.403627] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-17T18:04:20.403682] [INFO ] [MAIN ] CICB: Starting full primary refresh. [2025-09-17T18:04:20.425396] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-02. [2025-09-17T18:04:20.759796] [INFO ] [REMOTE ] CICB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:04:21.215846] [INFO ] [REMOTE ] CIB: Fetching primary data for 2024-12. [2025-09-17T18:04:21.449623] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T18:04:21.758087] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T18:04:22.015843] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-11. [2025-09-17T18:04:22.322435] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T18:04:22.545733] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T18:04:22.815801] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-06. [2025-09-17T18:04:23.615791] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-03. [2025-09-17T18:04:24.415807] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-01. [2025-09-17T18:04:24.482142] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T18:04:24.511696] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T18:04:25.215819] [INFO ] [REMOTE ] CICB: Fetching primary data for 2024-12. [2025-09-17T18:04:25.704911] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-17T18:04:25.783844] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T18:04:26.015843] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-02. [2025-09-17T18:04:26.815826] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-01. [2025-09-17T18:04:27.140896] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T18:04:27.378549] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T18:04:27.615836] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-02. [2025-09-17T18:04:28.011054] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T18:04:28.415821] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-04. [2025-09-17T18:04:29.215777] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-03. [2025-09-17T18:04:29.485027] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T18:04:30.015792] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-03. [2025-09-17T18:04:30.383416] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T18:04:30.700199] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T18:04:30.815766] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-04. [2025-09-17T18:04:31.615791] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-07. [2025-09-17T18:04:32.137240] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T18:04:32.415840] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-05. [2025-09-17T18:04:33.030968] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T18:04:33.215792] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-06. [2025-09-17T18:04:33.576739] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T18:04:34.015725] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-04. [2025-09-17T18:04:34.112627] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T18:04:34.563346] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T18:04:34.815793] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-08. [2025-09-17T18:04:35.615783] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-07. [2025-09-17T18:04:36.415795] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-05. [2025-09-17T18:04:36.637608] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T18:04:36.719596] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T18:04:36.742417] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T18:04:37.215833] [INFO ] [REMOTE ] CI: Fetching primary data for 2025-09. [2025-09-17T18:04:38.015792] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-06. [2025-09-17T18:04:38.470561] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T18:04:38.815772] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-07. [2025-09-17T18:04:38.854214] [INFO ] [REMOTE ] CI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T18:04:38.861551] [INFO ] [REMOTE ] CI: Full fetch complete (72414 records). [2025-09-17T18:04:38.861777] [DEBUG] [VALIDATOR ] CI: Validating primary data. [2025-09-17T18:04:39.182833] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-17T18:04:39.295409] [DEBUG] [VALIDATOR ] CI: All expected trading days are present. [2025-09-17T18:04:39.295513] [DEBUG] [VALIDATOR ] CI: Primary data validation passed. [2025-09-17T18:04:39.296514] [INFO ] [MAIN ] CI: Fetched primary data is valid. [2025-09-17T18:04:39.296607] [DEBUG] [LOCAL ] CI: Saving primary data. [2025-09-17T18:04:39.298209] [DEBUG] [LOCAL ] CI: Trimmed 72414 records to 50011 (keeping 200 days of data) [2025-09-17T18:04:39.619131] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-08. [2025-09-17T18:04:39.655080] [DEBUG] [LOCAL ] CI: Primary data saved (50011 records). [2025-09-17T18:04:39.655247] [INFO ] [MAIN ] CI: Full history saved. [2025-09-17T18:04:39.655373] [INFO ] [MAIN ] Update Progress: 445/2371 symbols completed. CI took 47.3s. Estimated remaining: 4h 39m 43s. Rate: 6.9 symbols/min [2025-09-17T18:04:39.832124] [INFO ] [MAIN ] CIEN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:04:39.884213] [DEBUG] [LOCAL ] CIEN: Loaded 52112 existing records from primary storage. [2025-09-17T18:04:39.884423] [INFO ] [MAIN ] CIEN: Loaded 52112 existing records. [2025-09-17T18:04:40.072940] [WARN ] [MAIN ] CIEN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:04:40.073219] [INFO ] [MAIN ] CIEN: Wiping existing primary data before full refresh. [2025-09-17T18:04:40.073270] [INFO ] [LOCAL ] CIEN: Starting deletion of primary data. [2025-09-17T18:04:40.074405] [DEBUG] [LOCAL ] CIEN: Deleted primary data file. [2025-09-17T18:04:40.074464] [INFO ] [MAIN ] CIEN: Starting full primary refresh. [2025-09-17T18:04:40.422046] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-05. [2025-09-17T18:04:40.443753] [INFO ] [REMOTE ] CIEN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:04:41.215779] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-11. [2025-09-17T18:04:41.293792] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T18:04:41.811052] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T18:04:42.015797] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-06. [2025-09-17T18:04:42.815741] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-08. [2025-09-17T18:04:42.915828] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T18:04:42.951332] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T18:04:43.155018] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-17T18:04:43.615772] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2024-12. [2025-09-17T18:04:44.415782] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-07. [2025-09-17T18:04:45.215775] [INFO ] [REMOTE ] CICB: Fetching primary data for 2025-09. [2025-09-17T18:04:45.422016] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T18:04:45.599036] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T18:04:45.683023] [INFO ] [REMOTE ] CICB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T18:04:45.683827] [INFO ] [REMOTE ] CICB: Full fetch complete (2158 records). [2025-09-17T18:04:45.683895] [DEBUG] [VALIDATOR ] CICB: Validating primary data. [2025-09-17T18:04:45.684360] [FATAL] [VALIDATOR ] CICB: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:04:45.684423] [FATAL] [MAIN ] CICB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:04:45.684468] [WARN ] [MAIN ] CICB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:04:45.684511] [INFO ] [LOCAL ] CICB: Starting deletion of primary data. [2025-09-17T18:04:45.684575] [DEBUG] [LOCAL ] CICB: No primary data file found to delete. [2025-09-17T18:04:45.684618] [INFO ] [LOCAL ] CICB: Starting deletion of derivative data. [2025-09-17T18:04:45.684679] [DEBUG] [LOCAL ] CICB: No derivative data file found to delete. [2025-09-17T18:04:45.684735] [INFO ] [MAIN ] Update Progress: 446/2371 symbols completed. CICB took 25.5s. Estimated remaining: 4h 39m 23s. Rate: 6.9 symbols/min [2025-09-17T18:04:45.853026] [INFO ] [MAIN ] CIF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:04:45.868636] [DEBUG] [LOCAL ] CIF: Loaded 4548 existing records from primary storage. [2025-09-17T18:04:45.868795] [INFO ] [MAIN ] CIF: Loaded 4548 existing records. [2025-09-17T18:04:46.021025] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-01. [2025-09-17T18:04:46.047525] [WARN ] [MAIN ] CIF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:04:46.047786] [INFO ] [MAIN ] CIF: Wiping existing primary data before full refresh. [2025-09-17T18:04:46.047832] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-17T18:04:46.048063] [DEBUG] [LOCAL ] CIF: Deleted primary data file. [2025-09-17T18:04:46.048106] [INFO ] [MAIN ] CIF: Starting full primary refresh. [2025-09-17T18:04:46.409036] [INFO ] [REMOTE ] CIF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:04:46.815804] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-11. [2025-09-17T18:04:47.602909] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T18:04:47.615745] [INFO ] [REMOTE ] CIF: Fetching primary data for 2024-12. [2025-09-17T18:04:47.828217] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T18:04:48.354534] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T18:04:48.415856] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-08. [2025-09-17T18:04:49.215845] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-02. [2025-09-17T18:04:49.728493] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T18:04:50.015803] [INFO ] [REMOTE ] CIB: Fetching primary data for 2025-09. [2025-09-17T18:04:50.769698] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T18:04:50.815730] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-03. [2025-09-17T18:04:51.215484] [INFO ] [REMOTE ] CIB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T18:04:51.221854] [INFO ] [REMOTE ] CIB: Full fetch complete (44053 records). [2025-09-17T18:04:51.222176] [DEBUG] [VALIDATOR ] CIB: Validating primary data. [2025-09-17T18:04:51.617333] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-01. [2025-09-17T18:04:51.619361] [DEBUG] [VALIDATOR ] CIB: All expected trading days are present. [2025-09-17T18:04:51.619460] [DEBUG] [VALIDATOR ] CIB: Primary data validation passed. [2025-09-17T18:04:51.620332] [INFO ] [MAIN ] CIB: Fetched primary data is valid. [2025-09-17T18:04:51.620382] [DEBUG] [LOCAL ] CIB: Saving primary data. [2025-09-17T18:04:51.621854] [DEBUG] [LOCAL ] CIB: Trimmed 44053 records to 31166 (keeping 200 days of data) [2025-09-17T18:04:51.824623] [DEBUG] [LOCAL ] CIB: Primary data saved (31166 records). [2025-09-17T18:04:51.824821] [INFO ] [MAIN ] CIB: Full history saved. [2025-09-17T18:04:51.824942] [INFO ] [MAIN ] Update Progress: 447/2371 symbols completed. CIB took 34.7s. Estimated remaining: 4h 39m 3s. Rate: 6.9 symbols/min [2025-09-17T18:04:51.999797] [INFO ] [MAIN ] CIG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:04:52.048171] [DEBUG] [LOCAL ] CIG: Loaded 43581 existing records from primary storage. [2025-09-17T18:04:52.048349] [INFO ] [MAIN ] CIG: Loaded 43581 existing records. [2025-09-17T18:04:52.226528] [WARN ] [MAIN ] CIG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:04:52.226840] [INFO ] [MAIN ] CIG: Wiping existing primary data before full refresh. [2025-09-17T18:04:52.226889] [INFO ] [LOCAL ] CIG: Starting deletion of primary data. [2025-09-17T18:04:52.227967] [DEBUG] [LOCAL ] CIG: Deleted primary data file. [2025-09-17T18:04:52.228022] [INFO ] [MAIN ] CIG: Starting full primary refresh. [2025-09-17T18:04:52.351447] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T18:04:52.420766] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-02. [2025-09-17T18:04:52.613196] [INFO ] [REMOTE ] CIG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:04:53.133216] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T18:04:53.177803] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-03 (2.36 seconds). [2025-09-17T18:04:53.215754] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-04. [2025-09-17T18:04:54.015830] [INFO ] [REMOTE ] CIA: Fetching primary data for 2025-09. [2025-09-17T18:04:54.815767] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-11. [2025-09-17T18:04:54.847010] [INFO ] [REMOTE ] CIA: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T18:04:54.849128] [INFO ] [REMOTE ] CIA: Full fetch complete (22989 records). [2025-09-17T18:04:54.849200] [DEBUG] [VALIDATOR ] CIA: Validating primary data. [2025-09-17T18:04:55.228009] [DEBUG] [VALIDATOR ] CIA: All expected trading days are present. [2025-09-17T18:04:55.228294] [DEBUG] [VALIDATOR ] CIA: Primary data validation passed. [2025-09-17T18:04:55.228811] [INFO ] [MAIN ] CIA: Fetched primary data is valid. [2025-09-17T18:04:55.228870] [DEBUG] [LOCAL ] CIA: Saving primary data. [2025-09-17T18:04:55.230099] [DEBUG] [LOCAL ] CIA: Trimmed 22989 records to 16809 (keeping 200 days of data) [2025-09-17T18:04:55.262391] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T18:04:55.367073] [DEBUG] [LOCAL ] CIA: Primary data saved (16809 records). [2025-09-17T18:04:55.367234] [INFO ] [MAIN ] CIA: Full history saved. [2025-09-17T18:04:55.367323] [INFO ] [MAIN ] Update Progress: 448/2371 symbols completed. CIA took 42.4s. Estimated remaining: 4h 38m 32s. Rate: 6.9 symbols/min [2025-09-17T18:04:55.539543] [INFO ] [MAIN ] CII: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:04:55.557655] [DEBUG] [LOCAL ] CII: Loaded 15733 existing records from primary storage. [2025-09-17T18:04:55.557793] [INFO ] [MAIN ] CII: Loaded 15733 existing records. [2025-09-17T18:04:55.621813] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-03. [2025-09-17T18:04:55.747694] [WARN ] [MAIN ] CII: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:04:55.747986] [INFO ] [MAIN ] CII: Wiping existing primary data before full refresh. [2025-09-17T18:04:55.748038] [INFO ] [LOCAL ] CII: Starting deletion of primary data. [2025-09-17T18:04:55.748688] [DEBUG] [LOCAL ] CII: Deleted primary data file. [2025-09-17T18:04:55.748738] [INFO ] [MAIN ] CII: Starting full primary refresh. [2025-09-17T18:04:56.113491] [INFO ] [REMOTE ] CII: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:04:56.139894] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T18:04:56.415809] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-11. [2025-09-17T18:04:56.426374] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T18:04:57.215810] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-04. [2025-09-17T18:04:57.448889] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T18:04:57.990193] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T18:04:58.015742] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-05. [2025-09-17T18:04:58.504569] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T18:04:58.815845] [INFO ] [REMOTE ] CII: Fetching primary data for 2024-12. [2025-09-17T18:04:59.615807] [INFO ] [REMOTE ] CIG: Fetching primary data for 2024-12. [2025-09-17T18:04:59.887170] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T18:05:00.415847] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-06. [2025-09-17T18:05:00.922434] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T18:05:01.160716] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T18:05:01.215832] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-01. [2025-09-17T18:05:02.015820] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-07. [2025-09-17T18:05:02.351905] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T18:05:02.787854] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T18:05:02.815740] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-08. [2025-09-17T18:05:03.412235] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T18:05:03.615768] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-02. [2025-09-17T18:05:04.415789] [INFO ] [REMOTE ] CIF: Fetching primary data for 2025-09. [2025-09-17T18:05:04.608370] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T18:05:04.879391] [INFO ] [REMOTE ] CIF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T18:05:04.880458] [INFO ] [REMOTE ] CIF: Full fetch complete (6626 records). [2025-09-17T18:05:04.880526] [DEBUG] [VALIDATOR ] CIF: Validating primary data. [2025-09-17T18:05:04.880915] [FATAL] [VALIDATOR ] CIF: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:05:04.881009] [FATAL] [MAIN ] CIF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:05:04.881067] [WARN ] [MAIN ] CIF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:05:04.881131] [INFO ] [LOCAL ] CIF: Starting deletion of primary data. [2025-09-17T18:05:04.881195] [DEBUG] [LOCAL ] CIF: No primary data file found to delete. [2025-09-17T18:05:04.881231] [INFO ] [LOCAL ] CIF: Starting deletion of derivative data. [2025-09-17T18:05:04.881604] [DEBUG] [LOCAL ] CIF: Deleted derivative data file. [2025-09-17T18:05:04.881701] [INFO ] [MAIN ] Update Progress: 449/2371 symbols completed. CIF took 19.2s. Estimated remaining: 4h 38m 27s. Rate: 6.9 symbols/min [2025-09-17T18:05:05.058548] [INFO ] [MAIN ] CIM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:05:05.104042] [DEBUG] [LOCAL ] CIM: Loaded 37164 existing records from primary storage. [2025-09-17T18:05:05.104185] [INFO ] [MAIN ] CIM: Loaded 37164 existing records. [2025-09-17T18:05:05.220887] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-03. [2025-09-17T18:05:05.293293] [WARN ] [MAIN ] CIM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:05:05.293532] [INFO ] [MAIN ] CIM: Wiping existing primary data before full refresh. [2025-09-17T18:05:05.293576] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-17T18:05:05.294451] [DEBUG] [LOCAL ] CIM: Deleted primary data file. [2025-09-17T18:05:05.294501] [INFO ] [MAIN ] CIM: Starting full primary refresh. [2025-09-17T18:05:05.658459] [INFO ] [REMOTE ] CIM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:05:06.015759] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-11. [2025-09-17T18:05:06.393410] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T18:05:06.815783] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-05. [2025-09-17T18:05:07.211081] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T18:05:07.615821] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-04. [2025-09-17T18:05:08.415860] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-01. [2025-09-17T18:05:08.552631] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T18:05:08.942545] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T18:05:09.215814] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-05. [2025-09-17T18:05:09.681043] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T18:05:09.774374] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T18:05:10.015777] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-06. [2025-09-17T18:05:10.815816] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-06. [2025-09-17T18:05:11.621383] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-02. [2025-09-17T18:05:11.624437] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T18:05:11.751546] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T18:05:12.415810] [INFO ] [REMOTE ] CIM: Fetching primary data for 2024-12. [2025-09-17T18:05:13.215820] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-07. [2025-09-17T18:05:13.947334] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T18:05:14.015740] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-01. [2025-09-17T18:05:14.188937] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-17T18:05:14.569967] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T18:05:14.815775] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-07. [2025-09-17T18:05:15.465335] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T18:05:15.615792] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-02. [2025-09-17T18:05:15.895819] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T18:05:16.415793] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-08. [2025-09-17T18:05:17.126452] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T18:05:17.215777] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-08. [2025-09-17T18:05:17.927180] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T18:05:18.015776] [INFO ] [REMOTE ] CIEN: Fetching primary data for 2025-09. [2025-09-17T18:05:18.035335] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T18:05:18.815778] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-03. [2025-09-17T18:05:19.615754] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-03. [2025-09-17T18:05:20.026191] [INFO ] [REMOTE ] CIEN: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-17T18:05:20.033148] [INFO ] [REMOTE ] CIEN: Full fetch complete (75346 records). [2025-09-17T18:05:20.033286] [DEBUG] [VALIDATOR ] CIEN: Validating primary data. [2025-09-17T18:05:20.428147] [INFO ] [REMOTE ] CII: Fetching primary data for 2025-09. [2025-09-17T18:05:20.453459] [DEBUG] [VALIDATOR ] CIEN: All expected trading days are present. [2025-09-17T18:05:20.453838] [DEBUG] [VALIDATOR ] CIEN: Primary data validation passed. [2025-09-17T18:05:20.455014] [INFO ] [MAIN ] CIEN: Fetched primary data is valid. [2025-09-17T18:05:20.455231] [DEBUG] [LOCAL ] CIEN: Saving primary data. [2025-09-17T18:05:20.457661] [DEBUG] [LOCAL ] CIEN: Trimmed 75346 records to 52111 (keeping 200 days of data) [2025-09-17T18:05:20.583909] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T18:05:20.810806] [DEBUG] [LOCAL ] CIEN: Primary data saved (52111 records). [2025-09-17T18:05:20.810954] [INFO ] [MAIN ] CIEN: Full history saved. [2025-09-17T18:05:20.811040] [INFO ] [MAIN ] Update Progress: 450/2371 symbols completed. CIEN took 41.2s. Estimated remaining: 4h 38m 49s. Rate: 6.9 symbols/min [2025-09-17T18:05:20.976857] [INFO ] [MAIN ] CIMN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:05:20.977045] [DEBUG] [LOCAL ] CIMN: No existing data file found in primary storage. [2025-09-17T18:05:20.977083] [WARN ] [MAIN ] CIMN: No existing data found, performing full refresh instead. [2025-09-17T18:05:20.977199] [INFO ] [MAIN ] CIMN: Wiping existing primary data before full refresh. [2025-09-17T18:05:20.977247] [INFO ] [LOCAL ] CIMN: Starting deletion of primary data. [2025-09-17T18:05:20.977289] [DEBUG] [LOCAL ] CIMN: No primary data file found to delete. [2025-09-17T18:05:20.977320] [INFO ] [MAIN ] CIMN: Starting full primary refresh. [2025-09-17T18:05:21.216318] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-04. [2025-09-17T18:05:21.343591] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T18:05:21.370946] [INFO ] [REMOTE ] CIMN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:05:21.412133] [INFO ] [REMOTE ] CII: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T18:05:21.414663] [INFO ] [REMOTE ] CII: Full fetch complete (23090 records). [2025-09-17T18:05:21.414736] [DEBUG] [VALIDATOR ] CII: Validating primary data. [2025-09-17T18:05:21.782689] [DEBUG] [VALIDATOR ] CII: All expected trading days are present. [2025-09-17T18:05:21.782769] [DEBUG] [VALIDATOR ] CII: Primary data validation passed. [2025-09-17T18:05:21.783160] [INFO ] [MAIN ] CII: Fetched primary data is valid. [2025-09-17T18:05:21.783199] [DEBUG] [LOCAL ] CII: Saving primary data. [2025-09-17T18:05:21.783840] [DEBUG] [LOCAL ] CII: Trimmed 23090 records to 15798 (keeping 200 days of data) [2025-09-17T18:05:21.880707] [DEBUG] [LOCAL ] CII: Primary data saved (15798 records). [2025-09-17T18:05:21.880862] [INFO ] [MAIN ] CII: Full history saved. [2025-09-17T18:05:21.880946] [INFO ] [MAIN ] Update Progress: 451/2371 symbols completed. CII took 26.5s. Estimated remaining: 4h 38m 8s. Rate: 6.9 symbols/min [2025-09-17T18:05:22.020879] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-04. [2025-09-17T18:05:22.051163] [INFO ] [MAIN ] CIMO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:05:22.052126] [DEBUG] [LOCAL ] CIMO: No existing data file found in primary storage. [2025-09-17T18:05:22.052168] [WARN ] [MAIN ] CIMO: No existing data found, performing full refresh instead. [2025-09-17T18:05:22.052294] [INFO ] [MAIN ] CIMO: Wiping existing primary data before full refresh. [2025-09-17T18:05:22.052333] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-17T18:05:22.052373] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-17T18:05:22.052404] [INFO ] [MAIN ] CIMO: Starting full primary refresh. [2025-09-17T18:05:22.412209] [INFO ] [REMOTE ] CIMO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:05:22.815778] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-11. [2025-09-17T18:05:22.849515] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T18:05:23.578443] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T18:05:23.615833] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2024-12. [2025-09-17T18:05:23.803620] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T18:05:24.415995] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-05. [2025-09-17T18:05:24.415931] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T18:05:25.215809] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-05. [2025-09-17T18:05:25.890685] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T18:05:26.015795] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-01. [2025-09-17T18:05:26.487884] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T18:05:26.561341] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T18:05:26.815850] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-06. [2025-09-17T18:05:27.615858] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-02. [2025-09-17T18:05:28.058207] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T18:05:28.415852] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-11. [2025-09-17T18:05:28.953611] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-17T18:05:29.075175] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T18:05:29.215841] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-03. [2025-09-17T18:05:29.600040] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-17T18:05:30.015875] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-06. [2025-09-17T18:05:30.815851] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-07. [2025-09-17T18:05:31.511698] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T18:05:31.615764] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-07. [2025-09-17T18:05:32.415871] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2024-12. [2025-09-17T18:05:32.694515] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T18:05:32.875174] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T18:05:33.001096] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T18:05:33.215813] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-01. [2025-09-17T18:05:33.672818] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T18:05:34.015864] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-04. [2025-09-17T18:05:34.570693] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T18:05:34.815849] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-05. [2025-09-17T18:05:35.437148] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T18:05:35.615857] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-08. [2025-09-17T18:05:36.415797] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-02. [2025-09-17T18:05:36.822335] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T18:05:37.215835] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-06. [2025-09-17T18:05:37.376005] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T18:05:37.500025] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-17T18:05:38.015784] [INFO ] [REMOTE ] CIG: Fetching primary data for 2025-09. [2025-09-17T18:05:38.815766] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-03. [2025-09-17T18:05:39.359510] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T18:05:39.601723] [INFO ] [REMOTE ] CIG: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T18:05:39.607283] [INFO ] [REMOTE ] CIG: Full fetch complete (60693 records). [2025-09-17T18:05:39.607384] [DEBUG] [VALIDATOR ] CIG: Validating primary data. [2025-09-17T18:05:39.620880] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-07. [2025-09-17T18:05:39.991993] [DEBUG] [VALIDATOR ] CIG: All expected trading days are present. [2025-09-17T18:05:39.992075] [DEBUG] [VALIDATOR ] CIG: Primary data validation passed. [2025-09-17T18:05:39.992766] [INFO ] [MAIN ] CIG: Fetched primary data is valid. [2025-09-17T18:05:39.992810] [DEBUG] [LOCAL ] CIG: Saving primary data. [2025-09-17T18:05:39.994061] [DEBUG] [LOCAL ] CIG: Trimmed 60693 records to 43706 (keeping 200 days of data) [2025-09-17T18:05:40.195414] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T18:05:40.251062] [DEBUG] [LOCAL ] CIG: Primary data saved (43706 records). [2025-09-17T18:05:40.251192] [INFO ] [MAIN ] CIG: Full history saved. [2025-09-17T18:05:40.251917] [INFO ] [MAIN ] Update Progress: 452/2371 symbols completed. CIG took 48.4s. Estimated remaining: 4h 38m 41s. Rate: 6.9 symbols/min [2025-09-17T18:05:40.423358] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-04. [2025-09-17T18:05:40.427485] [INFO ] [MAIN ] CINT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:05:40.450106] [DEBUG] [LOCAL ] CINT: Loaded 17895 existing records from primary storage. [2025-09-17T18:05:40.450248] [INFO ] [MAIN ] CINT: Loaded 17895 existing records. [2025-09-17T18:05:40.638927] [WARN ] [MAIN ] CINT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:05:40.639184] [INFO ] [MAIN ] CINT: Wiping existing primary data before full refresh. [2025-09-17T18:05:40.639231] [INFO ] [LOCAL ] CINT: Starting deletion of primary data. [2025-09-17T18:05:40.639751] [DEBUG] [LOCAL ] CINT: Deleted primary data file. [2025-09-17T18:05:40.639826] [INFO ] [MAIN ] CINT: Starting full primary refresh. [2025-09-17T18:05:41.019287] [INFO ] [REMOTE ] CINT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:05:41.019489] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T18:05:41.215777] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-11. [2025-09-17T18:05:42.015777] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-05. [2025-09-17T18:05:42.187086] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T18:05:42.586739] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T18:05:42.815777] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-06. [2025-09-17T18:05:43.276336] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T18:05:43.615768] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-08. [2025-09-17T18:05:44.415766] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-08. [2025-09-17T18:05:45.143628] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T18:05:45.215790] [INFO ] [REMOTE ] CIMO: Fetching primary data for 2025-09. [2025-09-17T18:05:45.281801] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T18:05:45.874453] [INFO ] [REMOTE ] CIMO: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T18:05:45.875610] [INFO ] [REMOTE ] CIMO: Full fetch complete (5411 records). [2025-09-17T18:05:45.875700] [DEBUG] [VALIDATOR ] CIMO: Validating primary data. [2025-09-17T18:05:46.020906] [INFO ] [REMOTE ] CIM: Fetching primary data for 2025-09. [2025-09-17T18:05:46.060597] [WARN ] [VALIDATOR ] CIMO: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T18:05:46.060916] [FATAL] [MAIN ] CIMO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:05:46.060992] [WARN ] [MAIN ] CIMO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:05:46.061059] [INFO ] [LOCAL ] CIMO: Starting deletion of primary data. [2025-09-17T18:05:46.061188] [DEBUG] [LOCAL ] CIMO: No primary data file found to delete. [2025-09-17T18:05:46.061247] [INFO ] [LOCAL ] CIMO: Starting deletion of derivative data. [2025-09-17T18:05:46.061307] [DEBUG] [LOCAL ] CIMO: No derivative data file found to delete. [2025-09-17T18:05:46.061396] [INFO ] [MAIN ] Update Progress: 453/2371 symbols completed. CIMO took 24.2s. Estimated remaining: 4h 38m 20s. Rate: 6.9 symbols/min [2025-09-17T18:05:46.237840] [INFO ] [MAIN ] CIO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:05:46.256515] [DEBUG] [LOCAL ] CIO: Loaded 19855 existing records from primary storage. [2025-09-17T18:05:46.256659] [INFO ] [MAIN ] CIO: Loaded 19855 existing records. [2025-09-17T18:05:46.437476] [WARN ] [MAIN ] CIO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:05:46.437753] [INFO ] [MAIN ] CIO: Wiping existing primary data before full refresh. [2025-09-17T18:05:46.437801] [INFO ] [LOCAL ] CIO: Starting deletion of primary data. [2025-09-17T18:05:46.438329] [DEBUG] [LOCAL ] CIO: Deleted primary data file. [2025-09-17T18:05:46.438375] [INFO ] [MAIN ] CIO: Starting full primary refresh. [2025-09-17T18:05:46.790861] [INFO ] [REMOTE ] CIO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:05:46.815828] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-11. [2025-09-17T18:05:47.614295] [INFO ] [REMOTE ] CIM: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T18:05:47.618467] [INFO ] [REMOTE ] CINT: Fetching primary data for 2024-12. [2025-09-17T18:05:47.620090] [INFO ] [REMOTE ] CIM: Full fetch complete (53979 records). [2025-09-17T18:05:47.620192] [DEBUG] [VALIDATOR ] CIM: Validating primary data. [2025-09-17T18:05:47.621100] [FATAL] [VALIDATOR ] CIM: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:05:47.621294] [FATAL] [MAIN ] CIM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:05:47.621364] [WARN ] [MAIN ] CIM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:05:47.621424] [INFO ] [LOCAL ] CIM: Starting deletion of primary data. [2025-09-17T18:05:47.621497] [DEBUG] [LOCAL ] CIM: No primary data file found to delete. [2025-09-17T18:05:47.621541] [INFO ] [LOCAL ] CIM: Starting deletion of derivative data. [2025-09-17T18:05:47.621835] [DEBUG] [LOCAL ] CIM: Deleted derivative data file. [2025-09-17T18:05:47.621929] [INFO ] [MAIN ] Update Progress: 454/2371 symbols completed. CIM took 42.7s. Estimated remaining: 4h 37m 41s. Rate: 6.9 symbols/min [2025-09-17T18:05:47.804933] [INFO ] [MAIN ] CION: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:05:47.836798] [DEBUG] [LOCAL ] CION: Loaded 29384 existing records from primary storage. [2025-09-17T18:05:47.836938] [INFO ] [MAIN ] CION: Loaded 29384 existing records. [2025-09-17T18:05:48.033829] [WARN ] [MAIN ] CION: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:05:48.034757] [INFO ] [MAIN ] CION: Wiping existing primary data before full refresh. [2025-09-17T18:05:48.034817] [INFO ] [LOCAL ] CION: Starting deletion of primary data. [2025-09-17T18:05:48.035572] [DEBUG] [LOCAL ] CION: Deleted primary data file. [2025-09-17T18:05:48.035629] [INFO ] [MAIN ] CION: Starting full primary refresh. [2025-09-17T18:05:48.419916] [INFO ] [REMOTE ] CION: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:05:48.416316] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-07. [2025-09-17T18:05:48.513162] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T18:05:48.528541] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T18:05:48.854391] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T18:05:49.215776] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-11. [2025-09-17T18:05:50.015790] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-01. [2025-09-17T18:05:50.574838] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T18:05:50.815763] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-08. [2025-09-17T18:05:50.916125] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T18:05:51.539064] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T18:05:51.615759] [INFO ] [REMOTE ] CIMN: Fetching primary data for 2025-09. [2025-09-17T18:05:52.067250] [INFO ] [REMOTE ] CIMN: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T18:05:52.068370] [INFO ] [REMOTE ] CIMN: Full fetch complete (3896 records). [2025-09-17T18:05:52.068459] [DEBUG] [VALIDATOR ] CIMN: Validating primary data. [2025-09-17T18:05:52.416489] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-02. [2025-09-17T18:05:52.446288] [DEBUG] [VALIDATOR ] CIMN: All expected trading days are present. [2025-09-17T18:05:52.446372] [DEBUG] [VALIDATOR ] CIMN: Primary data validation passed. [2025-09-17T18:05:52.446509] [INFO ] [MAIN ] CIMN: Fetched primary data is valid. [2025-09-17T18:05:52.446547] [DEBUG] [LOCAL ] CIMN: Saving primary data. [2025-09-17T18:05:52.446990] [DEBUG] [LOCAL ] CIMN: Trimmed 3896 records to 2658 (keeping 200 days of data) [2025-09-17T18:05:52.464502] [DEBUG] [LOCAL ] CIMN: Primary data saved (2658 records). [2025-09-17T18:05:52.464593] [INFO ] [MAIN ] CIMN: Full history saved. [2025-09-17T18:05:52.464681] [INFO ] [MAIN ] Update Progress: 455/2371 symbols completed. CIMN took 31.7s. Estimated remaining: 4h 37m 16s. Rate: 6.9 symbols/min [2025-09-17T18:05:52.641620] [INFO ] [MAIN ] CIVI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:05:52.693368] [DEBUG] [LOCAL ] CIVI: Loaded 52586 existing records from primary storage. [2025-09-17T18:05:52.693537] [INFO ] [MAIN ] CIVI: Loaded 52586 existing records. [2025-09-17T18:05:52.873609] [WARN ] [MAIN ] CIVI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:05:52.873907] [INFO ] [MAIN ] CIVI: Wiping existing primary data before full refresh. [2025-09-17T18:05:52.873954] [INFO ] [LOCAL ] CIVI: Starting deletion of primary data. [2025-09-17T18:05:52.875594] [DEBUG] [LOCAL ] CIVI: Deleted primary data file. [2025-09-17T18:05:52.875658] [INFO ] [MAIN ] CIVI: Starting full primary refresh. [2025-09-17T18:05:53.216569] [INFO ] [REMOTE ] CIO: Fetching primary data for 2024-12. [2025-09-17T18:05:53.240800] [INFO ] [REMOTE ] CIVI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:05:53.433801] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T18:05:54.015789] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-11. [2025-09-17T18:05:54.314235] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T18:05:54.815805] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-01. [2025-09-17T18:05:55.615763] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-03. [2025-09-17T18:05:55.742415] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T18:05:55.870938] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T18:05:56.273062] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T18:05:56.415811] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-02. [2025-09-17T18:05:57.215842] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2024-12. [2025-09-17T18:05:57.352219] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T18:05:58.015830] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-03. [2025-09-17T18:05:58.815907] [INFO ] [REMOTE ] CION: Fetching primary data for 2024-12. [2025-09-17T18:05:58.987792] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T18:05:59.164386] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T18:05:59.615823] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-04. [2025-09-17T18:05:59.863090] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T18:06:00.415760] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-04. [2025-09-17T18:06:00.729799] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T18:06:01.215786] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-05. [2025-09-17T18:06:01.454977] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T18:06:02.015684] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-01. [2025-09-17T18:06:02.411752] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T18:06:02.815830] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-06. [2025-09-17T18:06:03.583266] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T18:06:03.615716] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-07. [2025-09-17T18:06:03.857907] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T18:06:04.415784] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-02. [2025-09-17T18:06:04.851509] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T18:06:05.215807] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-05. [2025-09-17T18:06:06.015789] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-01. [2025-09-17T18:06:06.201485] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T18:06:06.391866] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T18:06:06.815796] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-08. [2025-09-17T18:06:07.188616] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T18:06:07.615739] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-02. [2025-09-17T18:06:07.741622] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T18:06:08.384780] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T18:06:08.415735] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-03. [2025-09-17T18:06:09.215779] [INFO ] [REMOTE ] CIO: Fetching primary data for 2025-09. [2025-09-17T18:06:09.790483] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T18:06:10.015814] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-03. [2025-09-17T18:06:10.678491] [INFO ] [REMOTE ] CIO: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T18:06:10.681813] [INFO ] [REMOTE ] CIO: Full fetch complete (29048 records). [2025-09-17T18:06:10.681925] [DEBUG] [VALIDATOR ] CIO: Validating primary data. [2025-09-17T18:06:10.825549] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-04. [2025-09-17T18:06:11.089085] [DEBUG] [VALIDATOR ] CIO: All expected trading days are present. [2025-09-17T18:06:11.089184] [DEBUG] [VALIDATOR ] CIO: Primary data validation passed. [2025-09-17T18:06:11.089710] [INFO ] [MAIN ] CIO: Fetched primary data is valid. [2025-09-17T18:06:11.089787] [DEBUG] [LOCAL ] CIO: Saving primary data. [2025-09-17T18:06:11.090790] [DEBUG] [LOCAL ] CIO: Trimmed 29048 records to 19929 (keeping 200 days of data) [2025-09-17T18:06:11.228093] [DEBUG] [LOCAL ] CIO: Primary data saved (19929 records). [2025-09-17T18:06:11.228327] [INFO ] [MAIN ] CIO: Full history saved. [2025-09-17T18:06:11.228443] [INFO ] [MAIN ] Update Progress: 456/2371 symbols completed. CIO took 25.2s. Estimated remaining: 4h 37m 49s. Rate: 6.9 symbols/min [2025-09-17T18:06:11.418073] [INFO ] [MAIN ] CL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:06:11.476024] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-17T18:06:11.476179] [INFO ] [MAIN ] CL: Loaded 53644 existing records. [2025-09-17T18:06:11.620871] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-06. [2025-09-17T18:06:11.679479] [WARN ] [MAIN ] CL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:06:11.679764] [INFO ] [MAIN ] CL: Wiping existing primary data before full refresh. [2025-09-17T18:06:11.679831] [INFO ] [LOCAL ] CL: Starting deletion of primary data. [2025-09-17T18:06:11.681094] [DEBUG] [LOCAL ] CL: Deleted primary data file. [2025-09-17T18:06:11.681158] [INFO ] [MAIN ] CL: Starting full primary refresh. [2025-09-17T18:06:12.079704] [INFO ] [REMOTE ] CL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:06:12.112481] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T18:06:12.415851] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-11. [2025-09-17T18:06:12.528368] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T18:06:12.748348] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T18:06:13.215816] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-04. [2025-09-17T18:06:14.015813] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-05. [2025-09-17T18:06:14.239615] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T18:06:14.815794] [INFO ] [REMOTE ] CL: Fetching primary data for 2024-12. [2025-09-17T18:06:14.977518] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T18:06:15.024291] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T18:06:15.615811] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-05. [2025-09-17T18:06:16.415863] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-07. [2025-09-17T18:06:16.645107] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T18:06:17.215764] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-01. [2025-09-17T18:06:17.305846] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T18:06:17.794566] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-17T18:06:18.015779] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-06. [2025-09-17T18:06:18.700513] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T18:06:18.815768] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-02. [2025-09-17T18:06:19.457408] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T18:06:19.615833] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-08. [2025-09-17T18:06:20.415793] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-07. [2025-09-17T18:06:20.509569] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T18:06:20.718096] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T18:06:21.215790] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-06. [2025-09-17T18:06:21.673097] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T18:06:22.015784] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-08. [2025-09-17T18:06:22.815796] [INFO ] [REMOTE ] CINT: Fetching primary data for 2025-09. [2025-09-17T18:06:23.051690] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T18:06:23.237470] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T18:06:23.615747] [INFO ] [REMOTE ] CION: Fetching primary data for 2025-09. [2025-09-17T18:06:23.926861] [INFO ] [REMOTE ] CINT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T18:06:23.930079] [INFO ] [REMOTE ] CINT: Full fetch complete (25553 records). [2025-09-17T18:06:23.930163] [DEBUG] [VALIDATOR ] CINT: Validating primary data. [2025-09-17T18:06:24.326087] [DEBUG] [VALIDATOR ] CINT: All expected trading days are present. [2025-09-17T18:06:24.326172] [DEBUG] [VALIDATOR ] CINT: Primary data validation passed. [2025-09-17T18:06:24.326713] [INFO ] [MAIN ] CINT: Fetched primary data is valid. [2025-09-17T18:06:24.326764] [DEBUG] [LOCAL ] CINT: Saving primary data. [2025-09-17T18:06:24.328019] [DEBUG] [LOCAL ] CINT: Trimmed 25553 records to 18038 (keeping 200 days of data) [2025-09-17T18:06:24.421158] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-03. [2025-09-17T18:06:24.439983] [DEBUG] [LOCAL ] CINT: Primary data saved (18038 records). [2025-09-17T18:06:24.440456] [INFO ] [MAIN ] CINT: Full history saved. [2025-09-17T18:06:24.440689] [INFO ] [MAIN ] Update Progress: 457/2371 symbols completed. CINT took 44.2s. Estimated remaining: 4h 37m 60s. Rate: 6.9 symbols/min [2025-09-17T18:06:24.618582] [INFO ] [MAIN ] CLB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:06:24.653989] [DEBUG] [LOCAL ] CLB: Loaded 33316 existing records from primary storage. [2025-09-17T18:06:24.654128] [INFO ] [MAIN ] CLB: Loaded 33316 existing records. [2025-09-17T18:06:24.849349] [WARN ] [MAIN ] CLB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:06:24.849582] [INFO ] [MAIN ] CLB: Wiping existing primary data before full refresh. [2025-09-17T18:06:24.849629] [INFO ] [LOCAL ] CLB: Starting deletion of primary data. [2025-09-17T18:06:24.850424] [DEBUG] [LOCAL ] CLB: Deleted primary data file. [2025-09-17T18:06:24.850479] [INFO ] [MAIN ] CLB: Starting full primary refresh. [2025-09-17T18:06:25.224583] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-07. [2025-09-17T18:06:25.249019] [INFO ] [REMOTE ] CLB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:06:25.260252] [INFO ] [REMOTE ] CION: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T18:06:25.264465] [INFO ] [REMOTE ] CION: Full fetch complete (41174 records). [2025-09-17T18:06:25.264674] [DEBUG] [VALIDATOR ] CION: Validating primary data. [2025-09-17T18:06:25.656480] [DEBUG] [VALIDATOR ] CION: All expected trading days are present. [2025-09-17T18:06:25.656579] [DEBUG] [VALIDATOR ] CION: Primary data validation passed. [2025-09-17T18:06:25.657254] [INFO ] [MAIN ] CION: Fetched primary data is valid. [2025-09-17T18:06:25.657306] [DEBUG] [LOCAL ] CION: Saving primary data. [2025-09-17T18:06:25.658515] [DEBUG] [LOCAL ] CION: Trimmed 41174 records to 29296 (keeping 200 days of data) [2025-09-17T18:06:25.841940] [DEBUG] [LOCAL ] CION: Primary data saved (29296 records). [2025-09-17T18:06:25.842079] [INFO ] [MAIN ] CION: Full history saved. [2025-09-17T18:06:25.842164] [INFO ] [MAIN ] Update Progress: 458/2371 symbols completed. CION took 38.2s. Estimated remaining: 4h 37m 20s. Rate: 6.9 symbols/min [2025-09-17T18:06:26.016791] [INFO ] [MAIN ] CLCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:06:26.016874] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-11. [2025-09-17T18:06:26.031907] [DEBUG] [LOCAL ] CLCO: Loaded 13763 existing records from primary storage. [2025-09-17T18:06:26.032004] [INFO ] [MAIN ] CLCO: Loaded 13763 existing records. [2025-09-17T18:06:26.210469] [WARN ] [MAIN ] CLCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:06:26.210739] [INFO ] [MAIN ] CLCO: Wiping existing primary data before full refresh. [2025-09-17T18:06:26.210785] [INFO ] [LOCAL ] CLCO: Starting deletion of primary data. [2025-09-17T18:06:26.211212] [DEBUG] [LOCAL ] CLCO: Deleted primary data file. [2025-09-17T18:06:26.211258] [INFO ] [MAIN ] CLCO: Starting full primary refresh. [2025-09-17T18:06:26.578065] [INFO ] [REMOTE ] CLCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:06:26.609807] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-17T18:06:26.815753] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-04. [2025-09-17T18:06:27.020716] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T18:06:27.229879] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T18:06:27.615800] [INFO ] [REMOTE ] CLB: Fetching primary data for 2024-12. [2025-09-17T18:06:28.415786] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-11. [2025-09-17T18:06:29.099432] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-17T18:06:29.114366] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T18:06:29.215732] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-05. [2025-09-17T18:06:29.904720] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T18:06:30.015778] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-08. [2025-09-17T18:06:30.815805] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-01. [2025-09-17T18:06:31.187799] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T18:06:31.615787] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2024-12. [2025-09-17T18:06:32.066603] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T18:06:32.143675] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T18:06:32.415752] [INFO ] [REMOTE ] CIVI: Fetching primary data for 2025-09. [2025-09-17T18:06:32.580629] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T18:06:33.215774] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-01. [2025-09-17T18:06:34.015715] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-02. [2025-09-17T18:06:34.298106] [INFO ] [REMOTE ] CIVI: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T18:06:34.315091] [INFO ] [REMOTE ] CIVI: Full fetch complete (75163 records). [2025-09-17T18:06:34.315252] [DEBUG] [VALIDATOR ] CIVI: Validating primary data. [2025-09-17T18:06:34.316100] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T18:06:34.711563] [DEBUG] [VALIDATOR ] CIVI: All expected trading days are present. [2025-09-17T18:06:34.711659] [DEBUG] [VALIDATOR ] CIVI: Primary data validation passed. [2025-09-17T18:06:34.712460] [INFO ] [MAIN ] CIVI: Fetched primary data is valid. [2025-09-17T18:06:34.712518] [DEBUG] [LOCAL ] CIVI: Saving primary data. [2025-09-17T18:06:34.714423] [DEBUG] [LOCAL ] CIVI: Trimmed 75163 records to 52586 (keeping 200 days of data) [2025-09-17T18:06:34.815937] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-02. [2025-09-17T18:06:35.058419] [DEBUG] [LOCAL ] CIVI: Primary data saved (52586 records). [2025-09-17T18:06:35.058664] [INFO ] [MAIN ] CIVI: Full history saved. [2025-09-17T18:06:35.058767] [INFO ] [MAIN ] Update Progress: 459/2371 symbols completed. CIVI took 42.6s. Estimated remaining: 4h 37m 14s. Rate: 6.9 symbols/min [2025-09-17T18:06:35.236459] [INFO ] [MAIN ] CLDT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:06:35.255824] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T18:06:35.283876] [DEBUG] [LOCAL ] CLDT: Loaded 26196 existing records from primary storage. [2025-09-17T18:06:35.284025] [INFO ] [MAIN ] CLDT: Loaded 26196 existing records. [2025-09-17T18:06:35.464332] [WARN ] [MAIN ] CLDT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:06:35.464571] [INFO ] [MAIN ] CLDT: Wiping existing primary data before full refresh. [2025-09-17T18:06:35.464617] [INFO ] [LOCAL ] CLDT: Starting deletion of primary data. [2025-09-17T18:06:35.465320] [DEBUG] [LOCAL ] CLDT: Deleted primary data file. [2025-09-17T18:06:35.465380] [INFO ] [MAIN ] CLDT: Starting full primary refresh. [2025-09-17T18:06:35.618056] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-06. [2025-09-17T18:06:35.786071] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T18:06:35.855293] [INFO ] [REMOTE ] CLDT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:06:36.415776] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-11. [2025-09-17T18:06:37.215787] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-03. [2025-09-17T18:06:37.795607] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-17T18:06:37.872540] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T18:06:38.015771] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2024-12. [2025-09-17T18:06:38.758876] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T18:06:38.783022] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T18:06:38.815768] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-04. [2025-09-17T18:06:39.615783] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-07. [2025-09-17T18:06:40.363073] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T18:06:40.415725] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-05. [2025-09-17T18:06:41.215758] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-01. [2025-09-17T18:06:41.287957] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T18:06:41.939381] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T18:06:42.015751] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-06. [2025-09-17T18:06:42.338303] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T18:06:42.815775] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-03. [2025-09-17T18:06:43.333237] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T18:06:43.615779] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-07. [2025-09-17T18:06:44.045179] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T18:06:44.415804] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-08. [2025-09-17T18:06:45.079843] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T18:06:45.215780] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-08. [2025-09-17T18:06:46.025708] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-04. [2025-09-17T18:06:46.032504] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T18:06:46.602089] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T18:06:46.777165] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T18:06:46.815790] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-05. [2025-09-17T18:06:47.615816] [INFO ] [REMOTE ] CLB: Fetching primary data for 2025-09. [2025-09-17T18:06:47.645702] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T18:06:48.415796] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-06. [2025-09-17T18:06:49.036609] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T18:06:49.143554] [INFO ] [REMOTE ] CLB: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T18:06:49.148405] [INFO ] [REMOTE ] CLB: Full fetch complete (45917 records). [2025-09-17T18:06:49.148514] [DEBUG] [VALIDATOR ] CLB: Validating primary data. [2025-09-17T18:06:49.220951] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-02. [2025-09-17T18:06:49.539436] [DEBUG] [VALIDATOR ] CLB: All expected trading days are present. [2025-09-17T18:06:49.539516] [DEBUG] [VALIDATOR ] CLB: Primary data validation passed. [2025-09-17T18:06:49.540106] [INFO ] [MAIN ] CLB: Fetched primary data is valid. [2025-09-17T18:06:49.540157] [DEBUG] [LOCAL ] CLB: Saving primary data. [2025-09-17T18:06:49.541108] [DEBUG] [LOCAL ] CLB: Trimmed 45917 records to 33294 (keeping 200 days of data) [2025-09-17T18:06:49.740161] [DEBUG] [LOCAL ] CLB: Primary data saved (33294 records). [2025-09-17T18:06:49.740297] [INFO ] [MAIN ] CLB: Full history saved. [2025-09-17T18:06:49.740379] [INFO ] [MAIN ] Update Progress: 460/2371 symbols completed. CLB took 25.3s. Estimated remaining: 4h 37m 30s. Rate: 6.9 symbols/min [2025-09-17T18:06:49.909464] [INFO ] [MAIN ] CLF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:06:49.966529] [DEBUG] [LOCAL ] CLF: Loaded 53742 existing records from primary storage. [2025-09-17T18:06:49.966718] [INFO ] [MAIN ] CLF: Loaded 53742 existing records. [2025-09-17T18:06:50.021940] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-07. [2025-09-17T18:06:50.150435] [WARN ] [MAIN ] CLF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:06:50.150719] [INFO ] [MAIN ] CLF: Wiping existing primary data before full refresh. [2025-09-17T18:06:50.150770] [INFO ] [LOCAL ] CLF: Starting deletion of primary data. [2025-09-17T18:06:50.151851] [DEBUG] [LOCAL ] CLF: Deleted primary data file. [2025-09-17T18:06:50.151909] [INFO ] [MAIN ] CLF: Starting full primary refresh. [2025-09-17T18:06:50.514129] [INFO ] [REMOTE ] CLF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:06:50.606752] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T18:06:50.707720] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T18:06:50.815792] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-11. [2025-09-17T18:06:51.615798] [INFO ] [REMOTE ] CL: Fetching primary data for 2025-09. [2025-09-17T18:06:52.415792] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-08. [2025-09-17T18:06:52.676103] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T18:06:53.215957] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-03. [2025-09-17T18:06:53.218926] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T18:06:53.660228] [INFO ] [REMOTE ] CL: Incremental fetch complete for 2025-09 (2.04 seconds). [2025-09-17T18:06:53.667828] [INFO ] [REMOTE ] CL: Full fetch complete (77454 records). [2025-09-17T18:06:53.667995] [DEBUG] [VALIDATOR ] CL: Validating primary data. [2025-09-17T18:06:54.022933] [INFO ] [REMOTE ] CLCO: Fetching primary data for 2025-09. [2025-09-17T18:06:54.071884] [DEBUG] [VALIDATOR ] CL: All expected trading days are present. [2025-09-17T18:06:54.071976] [DEBUG] [VALIDATOR ] CL: Primary data validation passed. [2025-09-17T18:06:54.072940] [INFO ] [MAIN ] CL: Fetched primary data is valid. [2025-09-17T18:06:54.073002] [DEBUG] [LOCAL ] CL: Saving primary data. [2025-09-17T18:06:54.075459] [DEBUG] [LOCAL ] CL: Trimmed 77454 records to 53644 (keeping 200 days of data) [2025-09-17T18:06:54.229783] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T18:06:54.481958] [DEBUG] [LOCAL ] CL: Primary data saved (53644 records). [2025-09-17T18:06:54.482110] [INFO ] [MAIN ] CL: Full history saved. [2025-09-17T18:06:54.482196] [INFO ] [MAIN ] Update Progress: 461/2371 symbols completed. CL took 43.3s. Estimated remaining: 4h 37m 5s. Rate: 6.9 symbols/min [2025-09-17T18:06:54.661011] [INFO ] [MAIN ] CLH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:06:54.691379] [DEBUG] [LOCAL ] CLH: Loaded 28607 existing records from primary storage. [2025-09-17T18:06:54.691524] [INFO ] [MAIN ] CLH: Loaded 28607 existing records. [2025-09-17T18:06:54.820890] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-04. [2025-09-17T18:06:54.878742] [WARN ] [MAIN ] CLH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:06:54.879051] [INFO ] [MAIN ] CLH: Wiping existing primary data before full refresh. [2025-09-17T18:06:54.879099] [INFO ] [LOCAL ] CLH: Starting deletion of primary data. [2025-09-17T18:06:54.879845] [DEBUG] [LOCAL ] CLH: Deleted primary data file. [2025-09-17T18:06:54.879896] [INFO ] [MAIN ] CLH: Starting full primary refresh. [2025-09-17T18:06:55.066827] [INFO ] [REMOTE ] CLCO: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T18:06:55.154365] [INFO ] [REMOTE ] CLCO: Full fetch complete (23792 records). [2025-09-17T18:06:55.171113] [DEBUG] [VALIDATOR ] CLCO: Validating primary data. [2025-09-17T18:06:55.367036] [INFO ] [REMOTE ] CLH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:06:55.620883] [INFO ] [REMOTE ] CLF: Fetching primary data for 2024-12. [2025-09-17T18:06:55.694095] [DEBUG] [VALIDATOR ] CLCO: All expected trading days are present. [2025-09-17T18:06:55.694198] [DEBUG] [VALIDATOR ] CLCO: Primary data validation passed. [2025-09-17T18:06:55.694894] [INFO ] [MAIN ] CLCO: Fetched primary data is valid. [2025-09-17T18:06:55.694964] [DEBUG] [LOCAL ] CLCO: Saving primary data. [2025-09-17T18:06:55.695834] [DEBUG] [LOCAL ] CLCO: Trimmed 23792 records to 13549 (keeping 200 days of data) [2025-09-17T18:06:55.772724] [DEBUG] [LOCAL ] CLCO: Primary data saved (13549 records). [2025-09-17T18:06:55.772884] [INFO ] [MAIN ] CLCO: Full history saved. [2025-09-17T18:06:55.772984] [INFO ] [MAIN ] Update Progress: 462/2371 symbols completed. CLCO took 29.9s. Estimated remaining: 4h 36m 25s. Rate: 6.9 symbols/min [2025-09-17T18:06:55.945589] [INFO ] [MAIN ] CLPR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:06:55.958710] [DEBUG] [LOCAL ] CLPR: Loaded 11659 existing records from primary storage. [2025-09-17T18:06:55.958844] [INFO ] [MAIN ] CLPR: Loaded 11659 existing records. [2025-09-17T18:06:56.145296] [WARN ] [MAIN ] CLPR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:06:56.145747] [INFO ] [MAIN ] CLPR: Wiping existing primary data before full refresh. [2025-09-17T18:06:56.145804] [INFO ] [LOCAL ] CLPR: Starting deletion of primary data. [2025-09-17T18:06:56.146250] [DEBUG] [LOCAL ] CLPR: Deleted primary data file. [2025-09-17T18:06:56.146318] [INFO ] [MAIN ] CLPR: Starting full primary refresh. [2025-09-17T18:06:56.281263] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T18:06:56.421042] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-05. [2025-09-17T18:06:56.567345] [INFO ] [REMOTE ] CLPR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:06:57.215787] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-11. [2025-09-17T18:06:57.516013] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T18:06:57.635883] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T18:06:58.015790] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-01. [2025-09-17T18:06:58.367032] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T18:06:58.815812] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-06. [2025-09-17T18:06:59.615684] [INFO ] [REMOTE ] CLH: Fetching primary data for 2024-12. [2025-09-17T18:06:59.976019] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T18:07:00.016440] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T18:07:00.415777] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-02. [2025-09-17T18:07:00.564560] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T18:07:01.215787] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-11. [2025-09-17T18:07:02.015803] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-01. [2025-09-17T18:07:02.332176] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T18:07:02.516234] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T18:07:02.815791] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2024-12. [2025-09-17T18:07:03.412855] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T18:07:03.617533] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-02. [2025-09-17T18:07:03.621653] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T18:07:04.415844] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-03. [2025-09-17T18:07:05.069429] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T18:07:05.215872] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-07. [2025-09-17T18:07:06.015865] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-01. [2025-09-17T18:07:06.405294] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T18:07:06.443322] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T18:07:06.689730] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T18:07:06.815802] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-08. [2025-09-17T18:07:07.615747] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-02. [2025-09-17T18:07:07.933130] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T18:07:08.111587] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T18:07:08.415763] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-04. [2025-09-17T18:07:09.215774] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-03. [2025-09-17T18:07:10.015780] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-03. [2025-09-17T18:07:10.582895] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-17T18:07:10.790191] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T18:07:10.815734] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-04. [2025-09-17T18:07:10.985196] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T18:07:11.615787] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-05. [2025-09-17T18:07:12.209830] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T18:07:12.415813] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-05. [2025-09-17T18:07:13.215837] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-04. [2025-09-17T18:07:13.701086] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T18:07:13.803406] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T18:07:14.015780] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-06. [2025-09-17T18:07:14.105195] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T18:07:14.815791] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-06. [2025-09-17T18:07:15.615779] [INFO ] [REMOTE ] CLDT: Fetching primary data for 2025-09. [2025-09-17T18:07:15.698078] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T18:07:16.197287] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-17T18:07:16.415776] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-05. [2025-09-17T18:07:16.872066] [INFO ] [REMOTE ] CLDT: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T18:07:16.877384] [INFO ] [REMOTE ] CLDT: Full fetch complete (37042 records). [2025-09-17T18:07:16.877548] [DEBUG] [VALIDATOR ] CLDT: Validating primary data. [2025-09-17T18:07:17.216902] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-07. [2025-09-17T18:07:17.303424] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T18:07:17.306718] [DEBUG] [VALIDATOR ] CLDT: All expected trading days are present. [2025-09-17T18:07:17.306811] [DEBUG] [VALIDATOR ] CLDT: Primary data validation passed. [2025-09-17T18:07:17.307494] [INFO ] [MAIN ] CLDT: Fetched primary data is valid. [2025-09-17T18:07:17.307954] [DEBUG] [LOCAL ] CLDT: Saving primary data. [2025-09-17T18:07:17.309671] [DEBUG] [LOCAL ] CLDT: Trimmed 37042 records to 26202 (keeping 200 days of data) [2025-09-17T18:07:17.467100] [DEBUG] [LOCAL ] CLDT: Primary data saved (26202 records). [2025-09-17T18:07:17.467258] [INFO ] [MAIN ] CLDT: Full history saved. [2025-09-17T18:07:17.467379] [INFO ] [MAIN ] Update Progress: 463/2371 symbols completed. CLDT took 42.4s. Estimated remaining: 4h 37m 10s. Rate: 6.9 symbols/min [2025-09-17T18:07:17.642369] [INFO ] [MAIN ] CLS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:07:17.695089] [DEBUG] [LOCAL ] CLS: Loaded 53648 existing records from primary storage. [2025-09-17T18:07:17.695240] [INFO ] [MAIN ] CLS: Loaded 53648 existing records. [2025-09-17T18:07:17.885098] [WARN ] [MAIN ] CLS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:07:17.885340] [INFO ] [MAIN ] CLS: Wiping existing primary data before full refresh. [2025-09-17T18:07:17.885386] [INFO ] [LOCAL ] CLS: Starting deletion of primary data. [2025-09-17T18:07:17.886473] [DEBUG] [LOCAL ] CLS: Deleted primary data file. [2025-09-17T18:07:17.886532] [INFO ] [MAIN ] CLS: Starting full primary refresh. [2025-09-17T18:07:18.026631] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-06. [2025-09-17T18:07:18.247990] [INFO ] [REMOTE ] CLS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:07:18.740877] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T18:07:18.815779] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-11. [2025-09-17T18:07:19.009948] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T18:07:19.615774] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-08. [2025-09-17T18:07:20.415782] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-07. [2025-09-17T18:07:20.897185] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T18:07:21.079173] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T18:07:21.215795] [INFO ] [REMOTE ] CLS: Fetching primary data for 2024-12. [2025-09-17T18:07:22.015791] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-07. [2025-09-17T18:07:22.726269] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-17T18:07:22.771465] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T18:07:22.815727] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-08. [2025-09-17T18:07:23.267611] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-17T18:07:23.617526] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-01. [2025-09-17T18:07:23.620583] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T18:07:24.415786] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-08. [2025-09-17T18:07:25.215783] [INFO ] [REMOTE ] CLPR: Fetching primary data for 2025-09. [2025-09-17T18:07:25.513739] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T18:07:26.015814] [INFO ] [REMOTE ] CLH: Fetching primary data for 2025-09. [2025-09-17T18:07:26.189574] [INFO ] [REMOTE ] CLPR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T18:07:26.191170] [INFO ] [REMOTE ] CLPR: Full fetch complete (17909 records). [2025-09-17T18:07:26.191365] [DEBUG] [VALIDATOR ] CLPR: Validating primary data. [2025-09-17T18:07:26.574258] [DEBUG] [VALIDATOR ] CLPR: All expected trading days are present. [2025-09-17T18:07:26.574469] [DEBUG] [VALIDATOR ] CLPR: Primary data validation passed. [2025-09-17T18:07:26.574897] [INFO ] [MAIN ] CLPR: Fetched primary data is valid. [2025-09-17T18:07:26.574952] [DEBUG] [LOCAL ] CLPR: Saving primary data. [2025-09-17T18:07:26.576075] [DEBUG] [LOCAL ] CLPR: Trimmed 17909 records to 11669 (keeping 200 days of data) [2025-09-17T18:07:26.665686] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-17T18:07:26.698744] [DEBUG] [LOCAL ] CLPR: Primary data saved (11669 records). [2025-09-17T18:07:26.698878] [INFO ] [MAIN ] CLPR: Full history saved. [2025-09-17T18:07:26.698973] [INFO ] [MAIN ] Update Progress: 464/2371 symbols completed. CLPR took 30.9s. Estimated remaining: 4h 37m 4s. Rate: 6.9 symbols/min [2025-09-17T18:07:26.826470] [INFO ] [REMOTE ] CLF: Fetching primary data for 2025-09. [2025-09-17T18:07:26.884025] [INFO ] [MAIN ] CLVT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:07:26.945387] [DEBUG] [LOCAL ] CLVT: Loaded 52056 existing records from primary storage. [2025-09-17T18:07:26.946373] [INFO ] [MAIN ] CLVT: Loaded 52056 existing records. [2025-09-17T18:07:26.946320] [INFO ] [REMOTE ] CLH: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T18:07:27.053272] [INFO ] [REMOTE ] CLH: Full fetch complete (41723 records). [2025-09-17T18:07:27.053466] [DEBUG] [VALIDATOR ] CLH: Validating primary data. [2025-09-17T18:07:27.260883] [WARN ] [MAIN ] CLVT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:07:27.307792] [INFO ] [MAIN ] CLVT: Wiping existing primary data before full refresh. [2025-09-17T18:07:27.339060] [INFO ] [LOCAL ] CLVT: Starting deletion of primary data. [2025-09-17T18:07:27.425043] [DEBUG] [LOCAL ] CLVT: Deleted primary data file. [2025-09-17T18:07:27.447312] [INFO ] [MAIN ] CLVT: Starting full primary refresh. [2025-09-17T18:07:27.639374] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-02. [2025-09-17T18:07:27.703527] [DEBUG] [VALIDATOR ] CLH: All expected trading days are present. [2025-09-17T18:07:27.715696] [DEBUG] [VALIDATOR ] CLH: Primary data validation passed. [2025-09-17T18:07:27.719870] [INFO ] [MAIN ] CLH: Fetched primary data is valid. [2025-09-17T18:07:27.745803] [DEBUG] [LOCAL ] CLH: Saving primary data. [2025-09-17T18:07:27.844589] [DEBUG] [LOCAL ] CLH: Trimmed 41723 records to 28629 (keeping 200 days of data) [2025-09-17T18:07:27.923633] [INFO ] [REMOTE ] CLVT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:07:28.100366] [DEBUG] [LOCAL ] CLH: Primary data saved (28629 records). [2025-09-17T18:07:28.100516] [INFO ] [MAIN ] CLH: Full history saved. [2025-09-17T18:07:28.100636] [INFO ] [MAIN ] Update Progress: 465/2371 symbols completed. CLH took 33.6s. Estimated remaining: 4h 36m 25s. Rate: 6.9 symbols/min [2025-09-17T18:07:28.272285] [INFO ] [MAIN ] CLW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:07:28.294275] [DEBUG] [LOCAL ] CLW: Loaded 22083 existing records from primary storage. [2025-09-17T18:07:28.294417] [INFO ] [MAIN ] CLW: Loaded 22083 existing records. [2025-09-17T18:07:28.420883] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-11. [2025-09-17T18:07:28.476535] [WARN ] [MAIN ] CLW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:07:28.476785] [INFO ] [MAIN ] CLW: Wiping existing primary data before full refresh. [2025-09-17T18:07:28.476830] [INFO ] [LOCAL ] CLW: Starting deletion of primary data. [2025-09-17T18:07:28.477474] [DEBUG] [LOCAL ] CLW: Deleted primary data file. [2025-09-17T18:07:28.477525] [INFO ] [MAIN ] CLW: Starting full primary refresh. [2025-09-17T18:07:28.837296] [INFO ] [REMOTE ] CLW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:07:28.886673] [INFO ] [REMOTE ] CLF: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-17T18:07:28.896285] [INFO ] [REMOTE ] CLF: Full fetch complete (77690 records). [2025-09-17T18:07:28.896452] [DEBUG] [VALIDATOR ] CLF: Validating primary data. [2025-09-17T18:07:29.221001] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-11. [2025-09-17T18:07:29.305229] [DEBUG] [VALIDATOR ] CLF: All expected trading days are present. [2025-09-17T18:07:29.305310] [DEBUG] [VALIDATOR ] CLF: Primary data validation passed. [2025-09-17T18:07:29.306149] [INFO ] [MAIN ] CLF: Fetched primary data is valid. [2025-09-17T18:07:29.306195] [DEBUG] [LOCAL ] CLF: Saving primary data. [2025-09-17T18:07:29.307742] [DEBUG] [LOCAL ] CLF: Trimmed 77690 records to 53741 (keeping 200 days of data) [2025-09-17T18:07:29.637127] [DEBUG] [LOCAL ] CLF: Primary data saved (53741 records). [2025-09-17T18:07:29.637293] [INFO ] [MAIN ] CLF: Full history saved. [2025-09-17T18:07:29.638084] [INFO ] [MAIN ] Update Progress: 466/2371 symbols completed. CLF took 39.9s. Estimated remaining: 4h 35m 47s. Rate: 6.9 symbols/min [2025-09-17T18:07:29.808675] [INFO ] [MAIN ] CLX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:07:29.866362] [DEBUG] [LOCAL ] CLX: Loaded 51381 existing records from primary storage. [2025-09-17T18:07:29.866513] [INFO ] [MAIN ] CLX: Loaded 51381 existing records. [2025-09-17T18:07:30.046179] [WARN ] [MAIN ] CLX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:07:30.046892] [INFO ] [MAIN ] CLX: Wiping existing primary data before full refresh. [2025-09-17T18:07:30.047030] [INFO ] [LOCAL ] CLX: Starting deletion of primary data. [2025-09-17T18:07:30.048282] [DEBUG] [LOCAL ] CLX: Deleted primary data file. [2025-09-17T18:07:30.048345] [INFO ] [MAIN ] CLX: Starting full primary refresh. [2025-09-17T18:07:30.211679] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-02 (2.57 seconds). [2025-09-17T18:07:30.233745] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T18:07:30.288060] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2024-12. [2025-09-17T18:07:30.501115] [INFO ] [REMOTE ] CLX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:07:30.597917] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T18:07:30.815783] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-11. [2025-09-17T18:07:31.615788] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-03. [2025-09-17T18:07:31.981454] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T18:07:32.347786] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T18:07:32.415734] [INFO ] [REMOTE ] CLX: Fetching primary data for 2024-12. [2025-09-17T18:07:33.215784] [INFO ] [REMOTE ] CLW: Fetching primary data for 2024-12. [2025-09-17T18:07:33.747576] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-17T18:07:34.015746] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-04. [2025-09-17T18:07:34.121446] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T18:07:34.591343] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T18:07:34.815791] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-01. [2025-09-17T18:07:35.615806] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-01. [2025-09-17T18:07:36.078533] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T18:07:36.156308] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T18:07:36.415797] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-05. [2025-09-17T18:07:37.215823] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-02. [2025-09-17T18:07:37.218448] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T18:07:38.015754] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-02. [2025-09-17T18:07:38.392037] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T18:07:38.594732] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-17T18:07:38.815772] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-06. [2025-09-17T18:07:39.624332] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-01. [2025-09-17T18:07:39.626751] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T18:07:40.415774] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-03. [2025-09-17T18:07:41.222116] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-03. [2025-09-17T18:07:41.241861] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-17T18:07:41.379801] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T18:07:42.015747] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-07. [2025-09-17T18:07:42.085066] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T18:07:42.524912] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T18:07:42.815781] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-04. [2025-09-17T18:07:43.615775] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-04. [2025-09-17T18:07:43.953302] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T18:07:44.149466] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T18:07:44.415830] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-02. [2025-09-17T18:07:44.922721] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T18:07:45.215862] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-05. [2025-09-17T18:07:46.015834] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-08. [2025-09-17T18:07:46.058409] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T18:07:46.330670] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T18:07:46.815847] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-03. [2025-09-17T18:07:47.615810] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-05. [2025-09-17T18:07:48.369108] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T18:07:48.417021] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-04. [2025-09-17T18:07:48.421276] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-17T18:07:49.215866] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-06. [2025-09-17T18:07:49.500069] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T18:07:49.888922] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T18:07:50.015744] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-05. [2025-09-17T18:07:50.268511] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T18:07:50.815811] [INFO ] [REMOTE ] CLS: Fetching primary data for 2025-09. [2025-09-17T18:07:51.615781] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-07. [2025-09-17T18:07:51.900350] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T18:07:52.415828] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-06. [2025-09-17T18:07:52.761955] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T18:07:52.935778] [INFO ] [REMOTE ] CLS: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-17T18:07:52.942995] [INFO ] [REMOTE ] CLS: Full fetch complete (77319 records). [2025-09-17T18:07:52.943136] [DEBUG] [VALIDATOR ] CLS: Validating primary data. [2025-09-17T18:07:53.222827] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-06. [2025-09-17T18:07:53.347337] [DEBUG] [VALIDATOR ] CLS: All expected trading days are present. [2025-09-17T18:07:53.347427] [DEBUG] [VALIDATOR ] CLS: Primary data validation passed. [2025-09-17T18:07:53.348335] [INFO ] [MAIN ] CLS: Fetched primary data is valid. [2025-09-17T18:07:53.348393] [DEBUG] [LOCAL ] CLS: Saving primary data. [2025-09-17T18:07:53.349997] [DEBUG] [LOCAL ] CLS: Trimmed 77319 records to 53646 (keeping 200 days of data) [2025-09-17T18:07:53.692134] [DEBUG] [LOCAL ] CLS: Primary data saved (53646 records). [2025-09-17T18:07:53.692305] [INFO ] [MAIN ] CLS: Full history saved. [2025-09-17T18:07:53.692402] [INFO ] [MAIN ] Update Progress: 467/2371 symbols completed. CLS took 36.2s. Estimated remaining: 4h 36m 41s. Rate: 6.9 symbols/min [2025-09-17T18:07:53.876050] [INFO ] [MAIN ] CM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:07:53.923379] [DEBUG] [LOCAL ] CM: Loaded 48670 existing records from primary storage. [2025-09-17T18:07:53.923581] [INFO ] [MAIN ] CM: Loaded 48670 existing records. [2025-09-17T18:07:54.017848] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-08. [2025-09-17T18:07:54.134199] [WARN ] [MAIN ] CM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:07:54.134564] [INFO ] [MAIN ] CM: Wiping existing primary data before full refresh. [2025-09-17T18:07:54.134728] [INFO ] [LOCAL ] CM: Starting deletion of primary data. [2025-09-17T18:07:54.135621] [DEBUG] [LOCAL ] CM: Deleted primary data file. [2025-09-17T18:07:54.135720] [INFO ] [MAIN ] CM: Starting full primary refresh. [2025-09-17T18:07:54.542414] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-17T18:07:54.540946] [INFO ] [REMOTE ] CM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:07:54.704088] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T18:07:54.815782] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-11. [2025-09-17T18:07:55.177961] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T18:07:55.615809] [INFO ] [REMOTE ] CLW: Fetching primary data for 2025-09. [2025-09-17T18:07:56.415827] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-07. [2025-09-17T18:07:56.604992] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T18:07:56.929935] [INFO ] [REMOTE ] CLW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T18:07:56.933109] [INFO ] [REMOTE ] CLW: Full fetch complete (35155 records). [2025-09-17T18:07:56.933203] [DEBUG] [VALIDATOR ] CLW: Validating primary data. [2025-09-17T18:07:57.220890] [INFO ] [REMOTE ] CM: Fetching primary data for 2024-12. [2025-09-17T18:07:57.309840] [DEBUG] [VALIDATOR ] CLW: All expected trading days are present. [2025-09-17T18:07:57.309921] [DEBUG] [VALIDATOR ] CLW: Primary data validation passed. [2025-09-17T18:07:57.310521] [INFO ] [MAIN ] CLW: Fetched primary data is valid. [2025-09-17T18:07:57.310563] [DEBUG] [LOCAL ] CLW: Saving primary data. [2025-09-17T18:07:57.311382] [DEBUG] [LOCAL ] CLW: Trimmed 35155 records to 22071 (keeping 200 days of data) [2025-09-17T18:07:57.437615] [DEBUG] [LOCAL ] CLW: Primary data saved (22071 records). [2025-09-17T18:07:57.437762] [INFO ] [MAIN ] CLW: Full history saved. [2025-09-17T18:07:57.437861] [INFO ] [MAIN ] Update Progress: 468/2371 symbols completed. CLW took 29.3s. Estimated remaining: 4h 36m 12s. Rate: 6.9 symbols/min [2025-09-17T18:07:57.605601] [INFO ] [MAIN ] CMA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:07:57.651984] [DEBUG] [LOCAL ] CMA: Loaded 50291 existing records from primary storage. [2025-09-17T18:07:57.652129] [INFO ] [MAIN ] CMA: Loaded 50291 existing records. [2025-09-17T18:07:57.829619] [WARN ] [MAIN ] CMA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:07:57.829863] [INFO ] [MAIN ] CMA: Wiping existing primary data before full refresh. [2025-09-17T18:07:57.829910] [INFO ] [LOCAL ] CMA: Starting deletion of primary data. [2025-09-17T18:07:57.831785] [DEBUG] [LOCAL ] CMA: Deleted primary data file. [2025-09-17T18:07:57.831839] [INFO ] [MAIN ] CMA: Starting full primary refresh. [2025-09-17T18:07:58.043975] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-07. [2025-09-17T18:07:58.192934] [INFO ] [REMOTE ] CMA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:07:58.240152] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T18:07:58.815755] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-08. [2025-09-17T18:07:58.867540] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T18:07:59.615777] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-01. [2025-09-17T18:07:59.847199] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T18:08:00.415753] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-11. [2025-09-17T18:08:00.499964] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T18:08:01.208317] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T18:08:01.217289] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-08. [2025-09-17T18:08:02.015849] [INFO ] [REMOTE ] CLVT: Fetching primary data for 2025-09. [2025-09-17T18:08:02.171503] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T18:08:02.692782] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T18:08:02.815733] [INFO ] [REMOTE ] CLX: Fetching primary data for 2025-09. [2025-09-17T18:08:03.615808] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-02. [2025-09-17T18:08:03.781217] [INFO ] [REMOTE ] CLVT: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T18:08:03.788075] [INFO ] [REMOTE ] CLVT: Full fetch complete (75103 records). [2025-09-17T18:08:03.788231] [DEBUG] [VALIDATOR ] CLVT: Validating primary data. [2025-09-17T18:08:04.193223] [DEBUG] [VALIDATOR ] CLVT: All expected trading days are present. [2025-09-17T18:08:04.193321] [DEBUG] [VALIDATOR ] CLVT: Primary data validation passed. [2025-09-17T18:08:04.194315] [INFO ] [MAIN ] CLVT: Fetched primary data is valid. [2025-09-17T18:08:04.194375] [DEBUG] [LOCAL ] CLVT: Saving primary data. [2025-09-17T18:08:04.196130] [DEBUG] [LOCAL ] CLVT: Trimmed 75103 records to 52026 (keeping 200 days of data) [2025-09-17T18:08:04.416925] [INFO ] [REMOTE ] CMA: Fetching primary data for 2024-12. [2025-09-17T18:08:04.498348] [DEBUG] [LOCAL ] CLVT: Primary data saved (52026 records). [2025-09-17T18:08:04.498501] [INFO ] [MAIN ] CLVT: Full history saved. [2025-09-17T18:08:04.499356] [INFO ] [MAIN ] Update Progress: 469/2371 symbols completed. CLVT took 37.8s. Estimated remaining: 4h 35m 57s. Rate: 6.9 symbols/min [2025-09-17T18:08:04.670002] [INFO ] [MAIN ] CMBT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:08:04.691268] [DEBUG] [LOCAL ] CMBT: Loaded 20842 existing records from primary storage. [2025-09-17T18:08:04.691407] [INFO ] [MAIN ] CMBT: Loaded 20842 existing records. [2025-09-17T18:08:04.873602] [WARN ] [MAIN ] CMBT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:08:04.893859] [INFO ] [MAIN ] CMBT: Wiping existing primary data before full refresh. [2025-09-17T18:08:04.893974] [INFO ] [LOCAL ] CMBT: Starting deletion of primary data. [2025-09-17T18:08:04.895428] [DEBUG] [LOCAL ] CMBT: Deleted primary data file. [2025-09-17T18:08:04.895365] [INFO ] [REMOTE ] CLX: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-17T18:08:04.895580] [INFO ] [MAIN ] CMBT: Starting full primary refresh. [2025-09-17T18:08:04.924493] [INFO ] [REMOTE ] CLX: Full fetch complete (72538 records). [2025-09-17T18:08:04.959756] [DEBUG] [VALIDATOR ] CLX: Validating primary data. [2025-09-17T18:08:05.583331] [INFO ] [REMOTE ] CMBT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:08:05.607987] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-11. [2025-09-17T18:08:05.668380] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-17T18:08:05.715275] [DEBUG] [VALIDATOR ] CLX: All expected trading days are present. [2025-09-17T18:08:05.715353] [DEBUG] [VALIDATOR ] CLX: Primary data validation passed. [2025-09-17T18:08:05.716207] [INFO ] [MAIN ] CLX: Fetched primary data is valid. [2025-09-17T18:08:05.716254] [DEBUG] [LOCAL ] CLX: Saving primary data. [2025-09-17T18:08:05.717602] [DEBUG] [LOCAL ] CLX: Trimmed 72538 records to 51407 (keeping 200 days of data) [2025-09-17T18:08:06.029405] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-03. [2025-09-17T18:08:06.055967] [DEBUG] [LOCAL ] CLX: Primary data saved (51407 records). [2025-09-17T18:08:06.056119] [INFO ] [MAIN ] CLX: Full history saved. [2025-09-17T18:08:06.057071] [INFO ] [MAIN ] Update Progress: 470/2371 symbols completed. CLX took 36.4s. Estimated remaining: 4h 35m 19s. Rate: 6.9 symbols/min [2025-09-17T18:08:06.233173] [INFO ] [MAIN ] CMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:08:06.278738] [DEBUG] [LOCAL ] CMC: Loaded 45782 existing records from primary storage. [2025-09-17T18:08:06.278882] [INFO ] [MAIN ] CMC: Loaded 45782 existing records. [2025-09-17T18:08:06.467917] [WARN ] [MAIN ] CMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:08:06.483270] [INFO ] [MAIN ] CMC: Wiping existing primary data before full refresh. [2025-09-17T18:08:06.495324] [INFO ] [LOCAL ] CMC: Starting deletion of primary data. [2025-09-17T18:08:06.497445] [DEBUG] [LOCAL ] CMC: Deleted primary data file. [2025-09-17T18:08:06.497395] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T18:08:06.507523] [INFO ] [MAIN ] CMC: Starting full primary refresh. [2025-09-17T18:08:06.821095] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-01. [2025-09-17T18:08:06.876475] [INFO ] [REMOTE ] CMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:08:06.889194] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T18:08:07.615832] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2024-12. [2025-09-17T18:08:07.931166] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T18:08:08.290257] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T18:08:08.415831] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-11. [2025-09-17T18:08:08.695272] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T18:08:09.215788] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-01. [2025-09-17T18:08:10.021293] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-04. [2025-09-17T18:08:10.037928] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T18:08:10.193945] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T18:08:10.815820] [INFO ] [REMOTE ] CMC: Fetching primary data for 2024-12. [2025-09-17T18:08:11.615756] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-02. [2025-09-17T18:08:11.650982] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T18:08:12.415804] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-02. [2025-09-17T18:08:12.451188] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T18:08:12.536267] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T18:08:13.215787] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-05. [2025-09-17T18:08:14.017549] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-01. [2025-09-17T18:08:14.020051] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T18:08:14.561491] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T18:08:14.815869] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-03. [2025-09-17T18:08:15.615854] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-03. [2025-09-17T18:08:15.745837] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T18:08:15.857908] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T18:08:16.415856] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-04. [2025-09-17T18:08:17.207185] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T18:08:17.217367] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-06. [2025-09-17T18:08:17.282518] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T18:08:18.015829] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-04. [2025-09-17T18:08:18.815809] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-02. [2025-09-17T18:08:18.899774] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T18:08:19.615857] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-07. [2025-09-17T18:08:19.819449] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T18:08:20.062498] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T18:08:20.415865] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-03. [2025-09-17T18:08:21.215842] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-05. [2025-09-17T18:08:21.336042] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T18:08:21.612017] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T18:08:22.015872] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-05. [2025-09-17T18:08:22.619889] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T18:08:22.815735] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-06. [2025-09-17T18:08:23.210016] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T18:08:23.615812] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-08. [2025-09-17T18:08:24.429120] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-06. [2025-09-17T18:08:24.444922] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T18:08:25.215809] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-07. [2025-09-17T18:08:25.350289] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T18:08:25.412948] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T18:08:26.015779] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-04. [2025-09-17T18:08:26.815824] [INFO ] [REMOTE ] CM: Fetching primary data for 2025-09. [2025-09-17T18:08:27.007408] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T18:08:27.615760] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-08. [2025-09-17T18:08:27.688394] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T18:08:28.415792] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-07. [2025-09-17T18:08:28.525269] [INFO ] [REMOTE ] CM: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T18:08:28.531841] [INFO ] [REMOTE ] CM: Full fetch complete (69231 records). [2025-09-17T18:08:28.531991] [DEBUG] [VALIDATOR ] CM: Validating primary data. [2025-09-17T18:08:28.967702] [DEBUG] [VALIDATOR ] CM: All expected trading days are present. [2025-09-17T18:08:28.967882] [DEBUG] [VALIDATOR ] CM: Primary data validation passed. [2025-09-17T18:08:28.968851] [INFO ] [MAIN ] CM: Fetched primary data is valid. [2025-09-17T18:08:28.968952] [DEBUG] [LOCAL ] CM: Saving primary data. [2025-09-17T18:08:28.970926] [DEBUG] [LOCAL ] CM: Trimmed 69231 records to 48663 (keeping 200 days of data) [2025-09-17T18:08:29.218216] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-05. [2025-09-17T18:08:29.271341] [DEBUG] [LOCAL ] CM: Primary data saved (48663 records). [2025-09-17T18:08:29.271480] [INFO ] [MAIN ] CM: Full history saved. [2025-09-17T18:08:29.271577] [INFO ] [MAIN ] Update Progress: 471/2371 symbols completed. CM took 35.6s. Estimated remaining: 4h 36m 9s. Rate: 6.9 symbols/min [2025-09-17T18:08:29.475088] [INFO ] [MAIN ] CMCM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:08:29.480978] [DEBUG] [LOCAL ] CMCM: Loaded 4621 existing records from primary storage. [2025-09-17T18:08:29.481177] [INFO ] [MAIN ] CMCM: Loaded 4621 existing records. [2025-09-17T18:08:29.703788] [WARN ] [MAIN ] CMCM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:08:29.708754] [INFO ] [MAIN ] CMCM: Wiping existing primary data before full refresh. [2025-09-17T18:08:29.709225] [INFO ] [LOCAL ] CMCM: Starting deletion of primary data. [2025-09-17T18:08:29.717138] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-17T18:08:29.737733] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T18:08:29.742920] [DEBUG] [LOCAL ] CMCM: Deleted primary data file. [2025-09-17T18:08:29.743515] [INFO ] [MAIN ] CMCM: Starting full primary refresh. [2025-09-17T18:08:30.020915] [INFO ] [REMOTE ] CMA: Fetching primary data for 2025-09. [2025-09-17T18:08:30.112392] [INFO ] [REMOTE ] CMCM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:08:30.815769] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-11. [2025-09-17T18:08:30.957954] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T18:08:31.254582] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T18:08:31.615782] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-06. [2025-09-17T18:08:31.815596] [INFO ] [REMOTE ] CMA: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T18:08:31.822163] [INFO ] [REMOTE ] CMA: Full fetch complete (73242 records). [2025-09-17T18:08:31.822304] [DEBUG] [VALIDATOR ] CMA: Validating primary data. [2025-09-17T18:08:32.217557] [DEBUG] [VALIDATOR ] CMA: All expected trading days are present. [2025-09-17T18:08:32.217693] [DEBUG] [VALIDATOR ] CMA: Primary data validation passed. [2025-09-17T18:08:32.218491] [INFO ] [MAIN ] CMA: Fetched primary data is valid. [2025-09-17T18:08:32.218534] [DEBUG] [LOCAL ] CMA: Saving primary data. [2025-09-17T18:08:32.220943] [DEBUG] [LOCAL ] CMA: Trimmed 73242 records to 50303 (keeping 200 days of data) [2025-09-17T18:08:32.436578] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2024-12. [2025-09-17T18:08:32.538228] [DEBUG] [LOCAL ] CMA: Primary data saved (50303 records). [2025-09-17T18:08:32.538367] [INFO ] [MAIN ] CMA: Full history saved. [2025-09-17T18:08:32.538452] [INFO ] [MAIN ] Update Progress: 472/2371 symbols completed. CMA took 35.1s. Estimated remaining: 4h 35m 38s. Rate: 6.9 symbols/min [2025-09-17T18:08:32.713767] [INFO ] [MAIN ] CMDB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:08:32.713969] [DEBUG] [LOCAL ] CMDB: No existing data file found in primary storage. [2025-09-17T18:08:32.714006] [WARN ] [MAIN ] CMDB: No existing data found, performing full refresh instead. [2025-09-17T18:08:32.714163] [INFO ] [MAIN ] CMDB: Wiping existing primary data before full refresh. [2025-09-17T18:08:32.714205] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-17T18:08:32.714254] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-17T18:08:32.714292] [INFO ] [MAIN ] CMDB: Starting full primary refresh. [2025-09-17T18:08:33.082520] [INFO ] [REMOTE ] CMDB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:08:33.111386] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T18:08:33.156507] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T18:08:33.215768] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-07. [2025-09-17T18:08:34.015780] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-08. [2025-09-17T18:08:34.785323] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T18:08:34.815784] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-08. [2025-09-17T18:08:35.149958] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T18:08:35.615780] [INFO ] [REMOTE ] CMBT: Fetching primary data for 2025-09. [2025-09-17T18:08:36.420947] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-11. [2025-09-17T18:08:36.437229] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T18:08:36.641764] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:08:36.642292] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-11 [2025-09-17T18:08:37.056020] [INFO ] [REMOTE ] CMBT: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T18:08:37.062552] [INFO ] [REMOTE ] CMBT: Full fetch complete (28159 records). [2025-09-17T18:08:37.062678] [DEBUG] [VALIDATOR ] CMBT: Validating primary data. [2025-09-17T18:08:37.223885] [INFO ] [REMOTE ] CMC: Fetching primary data for 2025-09. [2025-09-17T18:08:37.460861] [DEBUG] [VALIDATOR ] CMBT: All expected trading days are present. [2025-09-17T18:08:37.460947] [DEBUG] [VALIDATOR ] CMBT: Primary data validation passed. [2025-09-17T18:08:37.461493] [INFO ] [MAIN ] CMBT: Fetched primary data is valid. [2025-09-17T18:08:37.461537] [DEBUG] [LOCAL ] CMBT: Saving primary data. [2025-09-17T18:08:37.462427] [DEBUG] [LOCAL ] CMBT: Trimmed 28159 records to 21060 (keeping 200 days of data) [2025-09-17T18:08:37.601715] [DEBUG] [LOCAL ] CMBT: Primary data saved (21060 records). [2025-09-17T18:08:37.601866] [INFO ] [MAIN ] CMBT: Full history saved. [2025-09-17T18:08:37.601962] [INFO ] [MAIN ] Update Progress: 473/2371 symbols completed. CMBT took 33.1s. Estimated remaining: 4h 35m 15s. Rate: 6.9 symbols/min [2025-09-17T18:08:37.776533] [INFO ] [MAIN ] CMG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:08:37.832105] [DEBUG] [LOCAL ] CMG: Loaded 53720 existing records from primary storage. [2025-09-17T18:08:37.832281] [INFO ] [MAIN ] CMG: Loaded 53720 existing records. [2025-09-17T18:08:38.020907] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-01. [2025-09-17T18:08:38.028595] [WARN ] [MAIN ] CMG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:08:38.029998] [INFO ] [MAIN ] CMG: Wiping existing primary data before full refresh. [2025-09-17T18:08:38.030075] [INFO ] [LOCAL ] CMG: Starting deletion of primary data. [2025-09-17T18:08:38.031300] [DEBUG] [LOCAL ] CMG: Deleted primary data file. [2025-09-17T18:08:38.031379] [INFO ] [MAIN ] CMG: Starting full primary refresh. [2025-09-17T18:08:38.571923] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T18:08:38.642787] [INFO ] [REMOTE ] CMG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:08:38.815783] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-11. [2025-09-17T18:08:38.864782] [INFO ] [REMOTE ] CMC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T18:08:38.872845] [INFO ] [REMOTE ] CMC: Full fetch complete (66582 records). [2025-09-17T18:08:38.873044] [DEBUG] [VALIDATOR ] CMC: Validating primary data. [2025-09-17T18:08:39.393991] [DEBUG] [VALIDATOR ] CMC: All expected trading days are present. [2025-09-17T18:08:39.394102] [DEBUG] [VALIDATOR ] CMC: Primary data validation passed. [2025-09-17T18:08:39.394950] [INFO ] [MAIN ] CMC: Fetched primary data is valid. [2025-09-17T18:08:39.395012] [DEBUG] [LOCAL ] CMC: Saving primary data. [2025-09-17T18:08:39.397204] [DEBUG] [LOCAL ] CMC: Trimmed 66582 records to 45786 (keeping 200 days of data) [2025-09-17T18:08:39.625943] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2024-12. [2025-09-17T18:08:39.701539] [DEBUG] [LOCAL ] CMC: Primary data saved (45786 records). [2025-09-17T18:08:39.701735] [INFO ] [MAIN ] CMC: Full history saved. [2025-09-17T18:08:39.702459] [INFO ] [MAIN ] Update Progress: 474/2371 symbols completed. CMC took 33.6s. Estimated remaining: 4h 34m 40s. Rate: 6.9 symbols/min [2025-09-17T18:08:39.832328] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:08:39.865577] [WARN ] [REMOTE ] CMDB: No data returned for month 2024-12 [2025-09-17T18:08:39.898788] [INFO ] [MAIN ] CMI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:08:39.953976] [DEBUG] [LOCAL ] CMI: Loaded 41940 existing records from primary storage. [2025-09-17T18:08:39.954125] [INFO ] [MAIN ] CMI: Loaded 41940 existing records. [2025-09-17T18:08:40.137294] [WARN ] [MAIN ] CMI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:08:40.137622] [INFO ] [MAIN ] CMI: Wiping existing primary data before full refresh. [2025-09-17T18:08:40.137698] [INFO ] [LOCAL ] CMI: Starting deletion of primary data. [2025-09-17T18:08:40.138601] [DEBUG] [LOCAL ] CMI: Deleted primary data file. [2025-09-17T18:08:40.138702] [INFO ] [MAIN ] CMI: Starting full primary refresh. [2025-09-17T18:08:40.420968] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-01. [2025-09-17T18:08:40.519661] [INFO ] [REMOTE ] CMI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:08:40.664636] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:08:40.664991] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-01 [2025-09-17T18:08:41.079991] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-11 (2.26 seconds). [2025-09-17T18:08:41.215802] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-02. [2025-09-17T18:08:41.538543] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:08:41.538882] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-02 [2025-09-17T18:08:42.015773] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-11. [2025-09-17T18:08:42.815787] [INFO ] [REMOTE ] CMG: Fetching primary data for 2024-12. [2025-09-17T18:08:43.609626] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T18:08:43.617149] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-02. [2025-09-17T18:08:44.415767] [INFO ] [REMOTE ] CMI: Fetching primary data for 2024-12. [2025-09-17T18:08:44.445536] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T18:08:44.606554] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T18:08:45.215777] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-01. [2025-09-17T18:08:46.015789] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-03. [2025-09-17T18:08:46.073961] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T18:08:46.213727] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:08:46.214056] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-03 [2025-09-17T18:08:46.815823] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-03. [2025-09-17T18:08:47.290815] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-17T18:08:47.311409] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T18:08:47.615787] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-04. [2025-09-17T18:08:48.086227] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T18:08:48.415813] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-01. [2025-09-17T18:08:49.215816] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-05. [2025-09-17T18:08:49.616258] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-17T18:08:50.023314] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-04. [2025-09-17T18:08:50.026560] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T18:08:50.223818] [DEBUG] [REMOTE ] CMDB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:08:50.224154] [WARN ] [REMOTE ] CMDB: No data returned for month 2025-04 [2025-09-17T18:08:50.815781] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-05. [2025-09-17T18:08:51.615787] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-06. [2025-09-17T18:08:51.988207] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T18:08:52.022610] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-06 (0.41 seconds). [2025-09-17T18:08:52.415775] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-02. [2025-09-17T18:08:53.215777] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-06. [2025-09-17T18:08:53.924499] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T18:08:54.015822] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-03. [2025-09-17T18:08:54.234184] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T18:08:54.815807] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-07. [2025-09-17T18:08:55.367190] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T18:08:55.615763] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-07. [2025-09-17T18:08:55.645257] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T18:08:56.415781] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-04. [2025-09-17T18:08:56.545678] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T18:08:57.215774] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-08. [2025-09-17T18:08:57.851547] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T18:08:57.964694] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T18:08:58.015735] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-05. [2025-09-17T18:08:58.815785] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-08. [2025-09-17T18:08:59.615797] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-02. [2025-09-17T18:08:59.657250] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T18:08:59.689007] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T18:09:00.415841] [INFO ] [REMOTE ] CMCM: Fetching primary data for 2025-09. [2025-09-17T18:09:01.215822] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-06. [2025-09-17T18:09:01.279287] [INFO ] [REMOTE ] CMCM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T18:09:01.281169] [INFO ] [REMOTE ] CMCM: Full fetch complete (7049 records). [2025-09-17T18:09:01.281239] [DEBUG] [VALIDATOR ] CMCM: Validating primary data. [2025-09-17T18:09:01.662935] [DEBUG] [VALIDATOR ] CMCM: All expected trading days are present. [2025-09-17T18:09:01.663037] [DEBUG] [VALIDATOR ] CMCM: Primary data validation passed. [2025-09-17T18:09:01.663305] [INFO ] [MAIN ] CMCM: Fetched primary data is valid. [2025-09-17T18:09:01.663389] [DEBUG] [LOCAL ] CMCM: Saving primary data. [2025-09-17T18:09:01.664013] [DEBUG] [LOCAL ] CMCM: Trimmed 7049 records to 4637 (keeping 200 days of data) [2025-09-17T18:09:01.691903] [DEBUG] [LOCAL ] CMCM: Primary data saved (4637 records). [2025-09-17T18:09:01.692102] [INFO ] [MAIN ] CMCM: Full history saved. [2025-09-17T18:09:01.692203] [INFO ] [MAIN ] Update Progress: 475/2371 symbols completed. CMCM took 32.4s. Estimated remaining: 4h 35m 24s. Rate: 6.9 symbols/min [2025-09-17T18:09:01.907544] [INFO ] [MAIN ] CMP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:09:01.909857] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-17T18:09:01.958613] [DEBUG] [LOCAL ] CMP: Loaded 36718 existing records from primary storage. [2025-09-17T18:09:01.958793] [INFO ] [MAIN ] CMP: Loaded 36718 existing records. [2025-09-17T18:09:02.023574] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-03. [2025-09-17T18:09:02.145777] [WARN ] [MAIN ] CMP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:09:02.146016] [INFO ] [MAIN ] CMP: Wiping existing primary data before full refresh. [2025-09-17T18:09:02.146062] [INFO ] [LOCAL ] CMP: Starting deletion of primary data. [2025-09-17T18:09:02.147078] [DEBUG] [LOCAL ] CMP: Deleted primary data file. [2025-09-17T18:09:02.147147] [INFO ] [MAIN ] CMP: Starting full primary refresh. [2025-09-17T18:09:02.527417] [INFO ] [REMOTE ] CMP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:09:02.557379] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T18:09:02.815835] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-07. [2025-09-17T18:09:03.615775] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-11. [2025-09-17T18:09:04.176884] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-17T18:09:04.415747] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-04. [2025-09-17T18:09:04.452048] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T18:09:04.815174] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T18:09:05.215786] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-08. [2025-09-17T18:09:06.015776] [INFO ] [REMOTE ] CMP: Fetching primary data for 2024-12. [2025-09-17T18:09:06.730568] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-17T18:09:06.821554] [INFO ] [REMOTE ] CMDB: Fetching primary data for 2025-09. [2025-09-17T18:09:06.826935] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T18:09:07.081599] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T18:09:07.575906] [INFO ] [REMOTE ] CMDB: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T18:09:07.578213] [INFO ] [REMOTE ] CMDB: Full fetch complete (10414 records). [2025-09-17T18:09:07.578302] [DEBUG] [VALIDATOR ] CMDB: Validating primary data. [2025-09-17T18:09:07.620896] [INFO ] [REMOTE ] CMI: Fetching primary data for 2025-09. [2025-09-17T18:09:07.770227] [WARN ] [VALIDATOR ] CMDB: Validation failed - insufficient historical data. Have 92 unique days, need 200 days [2025-09-17T18:09:07.770525] [FATAL] [MAIN ] CMDB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:09:07.770576] [WARN ] [MAIN ] CMDB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:09:07.770619] [INFO ] [LOCAL ] CMDB: Starting deletion of primary data. [2025-09-17T18:09:07.770707] [DEBUG] [LOCAL ] CMDB: No primary data file found to delete. [2025-09-17T18:09:07.770746] [INFO ] [LOCAL ] CMDB: Starting deletion of derivative data. [2025-09-17T18:09:07.770806] [DEBUG] [LOCAL ] CMDB: No derivative data file found to delete. [2025-09-17T18:09:07.770875] [INFO ] [MAIN ] Update Progress: 476/2371 symbols completed. CMDB took 35.2s. Estimated remaining: 4h 35m 5s. Rate: 6.9 symbols/min [2025-09-17T18:09:07.954081] [INFO ] [MAIN ] CMRE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:09:07.990382] [DEBUG] [LOCAL ] CMRE: Loaded 35823 existing records from primary storage. [2025-09-17T18:09:07.990555] [INFO ] [MAIN ] CMRE: Loaded 35823 existing records. [2025-09-17T18:09:08.178175] [WARN ] [MAIN ] CMRE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:09:08.178416] [INFO ] [MAIN ] CMRE: Wiping existing primary data before full refresh. [2025-09-17T18:09:08.178463] [INFO ] [LOCAL ] CMRE: Starting deletion of primary data. [2025-09-17T18:09:08.179182] [DEBUG] [LOCAL ] CMRE: Deleted primary data file. [2025-09-17T18:09:08.179233] [INFO ] [MAIN ] CMRE: Starting full primary refresh. [2025-09-17T18:09:08.427703] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-05. [2025-09-17T18:09:08.552268] [INFO ] [REMOTE ] CMRE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:09:09.049674] [INFO ] [REMOTE ] CMI: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T18:09:09.055971] [INFO ] [REMOTE ] CMI: Full fetch complete (59561 records). [2025-09-17T18:09:09.056137] [DEBUG] [VALIDATOR ] CMI: Validating primary data. [2025-09-17T18:09:09.216758] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-01. [2025-09-17T18:09:09.452957] [DEBUG] [VALIDATOR ] CMI: All expected trading days are present. [2025-09-17T18:09:09.453039] [DEBUG] [VALIDATOR ] CMI: Primary data validation passed. [2025-09-17T18:09:09.454064] [INFO ] [MAIN ] CMI: Fetched primary data is valid. [2025-09-17T18:09:09.454128] [DEBUG] [LOCAL ] CMI: Saving primary data. [2025-09-17T18:09:09.455637] [DEBUG] [LOCAL ] CMI: Trimmed 59561 records to 41930 (keeping 200 days of data) [2025-09-17T18:09:09.722962] [DEBUG] [LOCAL ] CMI: Primary data saved (41930 records). [2025-09-17T18:09:09.723098] [INFO ] [MAIN ] CMI: Full history saved. [2025-09-17T18:09:09.724771] [INFO ] [MAIN ] Update Progress: 477/2371 symbols completed. CMI took 30.0s. Estimated remaining: 4h 34m 30s. Rate: 6.9 symbols/min [2025-09-17T18:09:10.015855] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-11. [2025-09-17T18:09:10.555920] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T18:09:10.620117] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T18:09:10.815894] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-06. [2025-09-17T18:09:11.290889] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T18:09:11.615793] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2024-12. [2025-09-17T18:09:12.415896] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-02. [2025-09-17T18:09:12.765172] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T18:09:13.005448] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-06 (2.19 seconds). [2025-09-17T18:09:13.215827] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-01. [2025-09-17T18:09:13.780814] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T18:09:14.015753] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-07. [2025-09-17T18:09:14.471142] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T18:09:14.815804] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-03. [2025-09-17T18:09:15.615867] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-02. [2025-09-17T18:09:16.156098] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T18:09:16.415859] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-08. [2025-09-17T18:09:16.645412] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T18:09:17.200143] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T18:09:17.215680] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-03. [2025-09-17T18:09:18.015773] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-04. [2025-09-17T18:09:18.647840] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T18:09:18.768205] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-17T18:09:18.815782] [INFO ] [REMOTE ] CMG: Fetching primary data for 2025-09. [2025-09-17T18:09:19.594702] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T18:09:19.615734] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-05. [2025-09-17T18:09:20.415799] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-04. [2025-09-17T18:09:20.962531] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T18:09:21.215794] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-06. [2025-09-17T18:09:21.246956] [INFO ] [REMOTE ] CMG: Incremental fetch complete for 2025-09 (2.43 seconds). [2025-09-17T18:09:21.254016] [INFO ] [REMOTE ] CMG: Full fetch complete (77722 records). [2025-09-17T18:09:21.254176] [DEBUG] [VALIDATOR ] CMG: Validating primary data. [2025-09-17T18:09:21.658400] [DEBUG] [VALIDATOR ] CMG: All expected trading days are present. [2025-09-17T18:09:21.658490] [DEBUG] [VALIDATOR ] CMG: Primary data validation passed. [2025-09-17T18:09:21.659445] [INFO ] [MAIN ] CMG: Fetched primary data is valid. [2025-09-17T18:09:21.659507] [DEBUG] [LOCAL ] CMG: Saving primary data. [2025-09-17T18:09:21.661082] [DEBUG] [LOCAL ] CMG: Trimmed 77722 records to 53720 (keeping 200 days of data) [2025-09-17T18:09:22.012336] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T18:09:22.023885] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-05. [2025-09-17T18:09:22.043239] [DEBUG] [LOCAL ] CMG: Primary data saved (53720 records). [2025-09-17T18:09:22.043399] [INFO ] [MAIN ] CMG: Full history saved. [2025-09-17T18:09:22.044380] [INFO ] [MAIN ] Update Progress: 478/2371 symbols completed. CMG took 44.4s. Estimated remaining: 4h 34m 35s. Rate: 6.9 symbols/min [2025-09-17T18:09:22.608127] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T18:09:22.815772] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-07. [2025-09-17T18:09:23.462858] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T18:09:23.615819] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-06. [2025-09-17T18:09:24.287317] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T18:09:24.415759] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-08. [2025-09-17T18:09:24.938936] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T18:09:25.215803] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-07. [2025-09-17T18:09:25.730847] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T18:09:26.015745] [INFO ] [REMOTE ] CMP: Fetching primary data for 2025-09. [2025-09-17T18:09:26.618632] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T18:09:26.815765] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-08. [2025-09-17T18:09:27.385548] [INFO ] [REMOTE ] CMP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T18:09:27.390800] [INFO ] [REMOTE ] CMP: Full fetch complete (53255 records). [2025-09-17T18:09:27.390903] [DEBUG] [VALIDATOR ] CMP: Validating primary data. [2025-09-17T18:09:27.782466] [DEBUG] [VALIDATOR ] CMP: All expected trading days are present. [2025-09-17T18:09:27.782556] [DEBUG] [VALIDATOR ] CMP: Primary data validation passed. [2025-09-17T18:09:27.783228] [INFO ] [MAIN ] CMP: Fetched primary data is valid. [2025-09-17T18:09:27.783282] [DEBUG] [LOCAL ] CMP: Saving primary data. [2025-09-17T18:09:27.784375] [DEBUG] [LOCAL ] CMP: Trimmed 53255 records to 36678 (keeping 200 days of data) [2025-09-17T18:09:27.994884] [DEBUG] [LOCAL ] CMP: Primary data saved (36678 records). [2025-09-17T18:09:27.995058] [INFO ] [MAIN ] CMP: Full history saved. [2025-09-17T18:09:27.995177] [INFO ] [MAIN ] Update Progress: 479/2371 symbols completed. CMP took 26.3s. Estimated remaining: 4h 34m 16s. Rate: 6.9 symbols/min [2025-09-17T18:09:28.246590] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T18:09:28.255388] [INFO ] [REMOTE ] CMRE: Fetching primary data for 2025-09. [2025-09-17T18:09:29.736737] [INFO ] [REMOTE ] CMRE: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T18:09:29.741161] [INFO ] [REMOTE ] CMRE: Full fetch complete (49243 records). [2025-09-17T18:09:29.741289] [DEBUG] [VALIDATOR ] CMRE: Validating primary data. [2025-09-17T18:09:30.130912] [DEBUG] [VALIDATOR ] CMRE: All expected trading days are present. [2025-09-17T18:09:30.130994] [DEBUG] [VALIDATOR ] CMRE: Primary data validation passed. [2025-09-17T18:09:30.131591] [INFO ] [MAIN ] CMRE: Fetched primary data is valid. [2025-09-17T18:09:30.131632] [DEBUG] [LOCAL ] CMRE: Saving primary data. [2025-09-17T18:09:30.132745] [DEBUG] [LOCAL ] CMRE: Trimmed 49243 records to 35727 (keeping 200 days of data) [2025-09-17T18:09:30.350149] [DEBUG] [LOCAL ] CMRE: Primary data saved (35727 records). [2025-09-17T18:09:30.350393] [INFO ] [MAIN ] CMRE: Full history saved. [2025-09-17T18:09:30.350499] [INFO ] [MAIN ] Update Progress: 480/2371 symbols completed. CMRE took 22.6s. Estimated remaining: 4h 33m 42s. Rate: 6.9 symbols/min [2025-09-17T18:09:30.881791] [INFO ] [MAIN ] CMSD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:09:30.946623] [INFO ] [MAIN ] CMSA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:09:31.043005] [INFO ] [MAIN ] CMSC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:09:31.053637] [INFO ] [MAIN ] CMS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:09:31.064338] [DEBUG] [LOCAL ] CMSA: Loaded 3350 existing records from primary storage. [2025-09-17T18:09:31.069851] [DEBUG] [LOCAL ] CMSD: Loaded 8150 existing records from primary storage. [2025-09-17T18:09:31.069608] [INFO ] [MAIN ] CMSA: Loaded 3350 existing records. [2025-09-17T18:09:31.070068] [INFO ] [MAIN ] CMSD: Loaded 8150 existing records. [2025-09-17T18:09:31.160260] [DEBUG] [LOCAL ] CMSC: Loaded 5117 existing records from primary storage. [2025-09-17T18:09:31.215000] [INFO ] [MAIN ] CMSC: Loaded 5117 existing records. [2025-09-17T18:09:31.574211] [WARN ] [MAIN ] CMSD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:09:31.579350] [WARN ] [MAIN ] CMSA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:09:31.610295] [INFO ] [MAIN ] CMSD: Wiping existing primary data before full refresh. [2025-09-17T18:09:31.610436] [INFO ] [LOCAL ] CMSD: Starting deletion of primary data. [2025-09-17T18:09:31.620935] [INFO ] [MAIN ] CMSA: Wiping existing primary data before full refresh. [2025-09-17T18:09:31.636442] [INFO ] [LOCAL ] CMSA: Starting deletion of primary data. [2025-09-17T18:09:31.636305] [DEBUG] [LOCAL ] CMS: Loaded 52662 existing records from primary storage. [2025-09-17T18:09:31.646803] [DEBUG] [LOCAL ] CMSD: Deleted primary data file. [2025-09-17T18:09:31.646732] [INFO ] [MAIN ] CMS: Loaded 52662 existing records. [2025-09-17T18:09:31.676216] [DEBUG] [LOCAL ] CMSA: Deleted primary data file. [2025-09-17T18:09:31.683265] [INFO ] [MAIN ] CMSD: Starting full primary refresh. [2025-09-17T18:09:31.692934] [INFO ] [MAIN ] CMSA: Starting full primary refresh. [2025-09-17T18:09:31.709845] [WARN ] [MAIN ] CMSC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:09:31.924528] [INFO ] [MAIN ] CMSC: Wiping existing primary data before full refresh. [2025-09-17T18:09:32.023451] [INFO ] [LOCAL ] CMSC: Starting deletion of primary data. [2025-09-17T18:09:32.070537] [DEBUG] [LOCAL ] CMSC: Deleted primary data file. [2025-09-17T18:09:32.070497] [WARN ] [MAIN ] CMS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:09:32.086339] [INFO ] [MAIN ] CMSC: Starting full primary refresh. [2025-09-17T18:09:32.107044] [INFO ] [MAIN ] CMS: Wiping existing primary data before full refresh. [2025-09-17T18:09:32.182042] [INFO ] [LOCAL ] CMS: Starting deletion of primary data. [2025-09-17T18:09:32.299547] [DEBUG] [LOCAL ] CMS: Deleted primary data file. [2025-09-17T18:09:32.306622] [INFO ] [MAIN ] CMS: Starting full primary refresh. [2025-09-17T18:09:32.863221] [INFO ] [REMOTE ] CMSD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:09:32.956121] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-11. [2025-09-17T18:09:33.053230] [INFO ] [REMOTE ] CMSA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:09:33.090942] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-11. [2025-09-17T18:09:33.273808] [INFO ] [REMOTE ] CMSC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:09:33.274125] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-11. [2025-09-17T18:09:33.350977] [INFO ] [REMOTE ] CMS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:09:33.351254] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-11. [2025-09-17T18:09:33.931722] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T18:09:33.933072] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2024-12. [2025-09-17T18:09:33.975134] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T18:09:33.976368] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2024-12. [2025-09-17T18:09:34.081428] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T18:09:34.083563] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2024-12. [2025-09-17T18:09:34.518934] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T18:09:34.520770] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-01. [2025-09-17T18:09:34.568201] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T18:09:34.812256] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T18:09:34.822067] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-01. [2025-09-17T18:09:34.903233] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T18:09:34.991987] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T18:09:35.163800] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T18:09:35.615786] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-01. [2025-09-17T18:09:36.414180] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T18:09:36.416473] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-02. [2025-09-17T18:09:36.876050] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T18:09:37.215773] [INFO ] [REMOTE ] CMS: Fetching primary data for 2024-12. [2025-09-17T18:09:38.015773] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-03. [2025-09-17T18:09:38.474803] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T18:09:38.815766] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-02. [2025-09-17T18:09:39.031606] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T18:09:39.198866] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-17T18:09:39.615773] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-01. [2025-09-17T18:09:40.415760] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-03. [2025-09-17T18:09:41.215782] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-04. [2025-09-17T18:09:41.232827] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T18:09:41.413588] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T18:09:41.657265] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T18:09:42.015842] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-04. [2025-09-17T18:09:42.815770] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-05. [2025-09-17T18:09:42.895175] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T18:09:43.380103] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T18:09:43.615778] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-02. [2025-09-17T18:09:44.415771] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-05. [2025-09-17T18:09:45.215778] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-06. [2025-09-17T18:09:45.269864] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T18:09:45.326471] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T18:09:45.960553] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T18:09:46.015751] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-02. [2025-09-17T18:09:46.640214] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T18:09:46.815787] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-03. [2025-09-17T18:09:47.615786] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-03. [2025-09-17T18:09:48.292857] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T18:09:48.415750] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-04. [2025-09-17T18:09:48.611566] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T18:09:48.853678] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T18:09:49.215892] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-06. [2025-09-17T18:09:49.999332] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T18:09:50.015812] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-07. [2025-09-17T18:09:50.785926] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T18:09:50.815772] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-05. [2025-09-17T18:09:51.576083] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T18:09:51.615770] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-06. [2025-09-17T18:09:52.228921] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T18:09:52.415818] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-04. [2025-09-17T18:09:53.215827] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-08. [2025-09-17T18:09:54.015790] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-07. [2025-09-17T18:09:54.032535] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T18:09:54.483481] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T18:09:54.816149] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-07. [2025-09-17T18:09:54.818860] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T18:09:55.476197] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T18:09:55.615755] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-08. [2025-09-17T18:09:56.411869] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T18:09:56.415674] [INFO ] [REMOTE ] CMSA: Fetching primary data for 2025-09. [2025-09-17T18:09:57.123386] [INFO ] [REMOTE ] CMSA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T18:09:57.124460] [INFO ] [REMOTE ] CMSA: Full fetch complete (4993 records). [2025-09-17T18:09:57.124536] [DEBUG] [VALIDATOR ] CMSA: Validating primary data. [2025-09-17T18:09:57.220927] [INFO ] [REMOTE ] CMSD: Fetching primary data for 2025-09. [2025-09-17T18:09:57.515884] [DEBUG] [VALIDATOR ] CMSA: All expected trading days are present. [2025-09-17T18:09:57.515975] [DEBUG] [VALIDATOR ] CMSA: Primary data validation passed. [2025-09-17T18:09:57.516155] [INFO ] [MAIN ] CMSA: Fetched primary data is valid. [2025-09-17T18:09:57.516195] [DEBUG] [LOCAL ] CMSA: Saving primary data. [2025-09-17T18:09:57.516583] [DEBUG] [LOCAL ] CMSA: Trimmed 4993 records to 3344 (keeping 200 days of data) [2025-09-17T18:09:57.537893] [DEBUG] [LOCAL ] CMSA: Primary data saved (3344 records). [2025-09-17T18:09:57.537990] [INFO ] [MAIN ] CMSA: Full history saved. [2025-09-17T18:09:57.538081] [INFO ] [MAIN ] Update Progress: 481/2371 symbols completed. CMSA took 27.2s. Estimated remaining: 4h 34m 46s. Rate: 6.9 symbols/min [2025-09-17T18:09:57.722882] [INFO ] [MAIN ] CMTG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:09:57.766059] [DEBUG] [LOCAL ] CMTG: Loaded 37899 existing records from primary storage. [2025-09-17T18:09:57.766227] [INFO ] [MAIN ] CMTG: Loaded 37899 existing records. [2025-09-17T18:09:57.945193] [WARN ] [MAIN ] CMTG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:09:57.945462] [INFO ] [MAIN ] CMTG: Wiping existing primary data before full refresh. [2025-09-17T18:09:57.945507] [INFO ] [LOCAL ] CMTG: Starting deletion of primary data. [2025-09-17T18:09:57.947009] [DEBUG] [LOCAL ] CMTG: Deleted primary data file. [2025-09-17T18:09:57.947060] [INFO ] [MAIN ] CMTG: Starting full primary refresh. [2025-09-17T18:09:58.021024] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-08. [2025-09-17T18:09:58.310765] [INFO ] [REMOTE ] CMTG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:09:58.315850] [INFO ] [REMOTE ] CMSD: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T18:09:58.317338] [INFO ] [REMOTE ] CMSD: Full fetch complete (12635 records). [2025-09-17T18:09:58.317408] [DEBUG] [VALIDATOR ] CMSD: Validating primary data. [2025-09-17T18:09:58.686410] [DEBUG] [VALIDATOR ] CMSD: All expected trading days are present. [2025-09-17T18:09:58.686496] [DEBUG] [VALIDATOR ] CMSD: Primary data validation passed. [2025-09-17T18:09:58.686806] [INFO ] [MAIN ] CMSD: Fetched primary data is valid. [2025-09-17T18:09:58.686850] [DEBUG] [LOCAL ] CMSD: Saving primary data. [2025-09-17T18:09:58.687446] [DEBUG] [LOCAL ] CMSD: Trimmed 12635 records to 8164 (keeping 200 days of data) [2025-09-17T18:09:58.738854] [DEBUG] [LOCAL ] CMSD: Primary data saved (8164 records). [2025-09-17T18:09:58.739006] [INFO ] [MAIN ] CMSD: Full history saved. [2025-09-17T18:09:58.739120] [INFO ] [MAIN ] Update Progress: 482/2371 symbols completed. CMSD took 28.4s. Estimated remaining: 4h 34m 8s. Rate: 6.9 symbols/min [2025-09-17T18:09:58.820921] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-11. [2025-09-17T18:09:58.914474] [INFO ] [MAIN ] CMU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:09:58.922974] [DEBUG] [LOCAL ] CMU: Loaded 7307 existing records from primary storage. [2025-09-17T18:09:58.923090] [INFO ] [MAIN ] CMU: Loaded 7307 existing records. [2025-09-17T18:09:59.030719] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T18:09:59.116789] [WARN ] [MAIN ] CMU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:09:59.117071] [INFO ] [MAIN ] CMU: Wiping existing primary data before full refresh. [2025-09-17T18:09:59.117125] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-17T18:09:59.117390] [DEBUG] [LOCAL ] CMU: Deleted primary data file. [2025-09-17T18:09:59.117436] [INFO ] [MAIN ] CMU: Starting full primary refresh. [2025-09-17T18:09:59.487865] [INFO ] [REMOTE ] CMU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:09:59.615840] [INFO ] [REMOTE ] CMSC: Fetching primary data for 2025-09. [2025-09-17T18:10:00.240977] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T18:10:00.263570] [INFO ] [REMOTE ] CMSC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T18:10:00.264733] [INFO ] [REMOTE ] CMSC: Full fetch complete (7138 records). [2025-09-17T18:10:00.264821] [DEBUG] [VALIDATOR ] CMSC: Validating primary data. [2025-09-17T18:10:00.420976] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-11. [2025-09-17T18:10:00.630132] [DEBUG] [VALIDATOR ] CMSC: All expected trading days are present. [2025-09-17T18:10:00.630208] [DEBUG] [VALIDATOR ] CMSC: Primary data validation passed. [2025-09-17T18:10:00.630383] [INFO ] [MAIN ] CMSC: Fetched primary data is valid. [2025-09-17T18:10:00.630420] [DEBUG] [LOCAL ] CMSC: Saving primary data. [2025-09-17T18:10:00.630829] [DEBUG] [LOCAL ] CMSC: Trimmed 7138 records to 5121 (keeping 200 days of data) [2025-09-17T18:10:00.662477] [DEBUG] [LOCAL ] CMSC: Primary data saved (5121 records). [2025-09-17T18:10:00.662618] [INFO ] [MAIN ] CMSC: Full history saved. [2025-09-17T18:10:00.662729] [INFO ] [MAIN ] Update Progress: 483/2371 symbols completed. CMSC took 30.3s. Estimated remaining: 4h 33m 33s. Rate: 6.9 symbols/min [2025-09-17T18:10:00.833604] [INFO ] [MAIN ] CNA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:10:00.866224] [DEBUG] [LOCAL ] CNA: Loaded 32891 existing records from primary storage. [2025-09-17T18:10:00.866369] [INFO ] [MAIN ] CNA: Loaded 32891 existing records. [2025-09-17T18:10:01.055233] [WARN ] [MAIN ] CNA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:10:01.055491] [INFO ] [MAIN ] CNA: Wiping existing primary data before full refresh. [2025-09-17T18:10:01.055539] [INFO ] [LOCAL ] CNA: Starting deletion of primary data. [2025-09-17T18:10:01.056530] [DEBUG] [LOCAL ] CNA: Deleted primary data file. [2025-09-17T18:10:01.056582] [INFO ] [MAIN ] CNA: Starting full primary refresh. [2025-09-17T18:10:01.221089] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-05. [2025-09-17T18:10:01.423202] [INFO ] [REMOTE ] CNA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:10:01.543465] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T18:10:02.015819] [INFO ] [REMOTE ] CMU: Fetching primary data for 2024-12. [2025-09-17T18:10:02.670470] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T18:10:02.815802] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-01. [2025-09-17T18:10:03.257260] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-17T18:10:03.440432] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T18:10:03.615822] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-11. [2025-09-17T18:10:04.415829] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-06. [2025-09-17T18:10:05.017107] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T18:10:05.215776] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-02. [2025-09-17T18:10:05.660353] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T18:10:05.848799] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T18:10:06.015779] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-03. [2025-09-17T18:10:06.815817] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2024-12. [2025-09-17T18:10:06.830942] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T18:10:07.615812] [INFO ] [REMOTE ] CNA: Fetching primary data for 2024-12. [2025-09-17T18:10:08.085203] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T18:10:08.415760] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-07. [2025-09-17T18:10:08.825717] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T18:10:09.215782] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-01. [2025-09-17T18:10:10.015819] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-04. [2025-09-17T18:10:10.199252] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T18:10:10.664555] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T18:10:10.697826] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T18:10:10.815757] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-05. [2025-09-17T18:10:11.615814] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-08. [2025-09-17T18:10:12.415766] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-02. [2025-09-17T18:10:13.215772] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-01. [2025-09-17T18:10:13.332244] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T18:10:13.725799] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-17T18:10:13.845494] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T18:10:14.015804] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-06. [2025-09-17T18:10:14.057981] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T18:10:14.620740] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T18:10:14.815779] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-02. [2025-09-17T18:10:15.615775] [INFO ] [REMOTE ] CMS: Fetching primary data for 2025-09. [2025-09-17T18:10:16.160869] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T18:10:16.415769] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-03. [2025-09-17T18:10:17.215816] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-03. [2025-09-17T18:10:17.358819] [INFO ] [REMOTE ] CMS: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T18:10:17.365860] [INFO ] [REMOTE ] CMS: Full fetch complete (75851 records). [2025-09-17T18:10:17.366008] [DEBUG] [VALIDATOR ] CMS: Validating primary data. [2025-09-17T18:10:17.761402] [DEBUG] [VALIDATOR ] CMS: All expected trading days are present. [2025-09-17T18:10:17.761532] [DEBUG] [VALIDATOR ] CMS: Primary data validation passed. [2025-09-17T18:10:17.762389] [INFO ] [MAIN ] CMS: Fetched primary data is valid. [2025-09-17T18:10:17.762489] [DEBUG] [LOCAL ] CMS: Saving primary data. [2025-09-17T18:10:17.764173] [DEBUG] [LOCAL ] CMS: Trimmed 75851 records to 52651 (keeping 200 days of data) [2025-09-17T18:10:17.881894] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T18:10:18.015759] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-04. [2025-09-17T18:10:18.117372] [DEBUG] [LOCAL ] CMS: Primary data saved (52651 records). [2025-09-17T18:10:18.117492] [INFO ] [MAIN ] CMS: Full history saved. [2025-09-17T18:10:18.117588] [INFO ] [MAIN ] Update Progress: 484/2371 symbols completed. CMS took 47.8s. Estimated remaining: 4h 33m 58s. Rate: 6.9 symbols/min [2025-09-17T18:10:18.290657] [INFO ] [MAIN ] CNC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:10:18.340611] [DEBUG] [LOCAL ] CNC: Loaded 53728 existing records from primary storage. [2025-09-17T18:10:18.340778] [INFO ] [MAIN ] CNC: Loaded 53728 existing records. [2025-09-17T18:10:18.517542] [WARN ] [MAIN ] CNC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:10:18.517821] [INFO ] [MAIN ] CNC: Wiping existing primary data before full refresh. [2025-09-17T18:10:18.517865] [INFO ] [LOCAL ] CNC: Starting deletion of primary data. [2025-09-17T18:10:18.519042] [DEBUG] [LOCAL ] CNC: Deleted primary data file. [2025-09-17T18:10:18.519096] [INFO ] [MAIN ] CNC: Starting full primary refresh. [2025-09-17T18:10:18.820830] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-07. [2025-09-17T18:10:18.889574] [INFO ] [REMOTE ] CNC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:10:19.093976] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T18:10:19.387266] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T18:10:19.615781] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-11. [2025-09-17T18:10:19.983387] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T18:10:20.415806] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-08. [2025-09-17T18:10:21.040948] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T18:10:21.214266] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T18:10:21.224124] [INFO ] [REMOTE ] CMU: Fetching primary data for 2025-09. [2025-09-17T18:10:21.878270] [INFO ] [REMOTE ] CMU: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T18:10:21.879426] [INFO ] [REMOTE ] CMU: Full fetch complete (9552 records). [2025-09-17T18:10:21.879496] [DEBUG] [VALIDATOR ] CMU: Validating primary data. [2025-09-17T18:10:21.879901] [FATAL] [VALIDATOR ] CMU: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:10:21.879977] [FATAL] [MAIN ] CMU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:10:21.880014] [WARN ] [MAIN ] CMU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:10:21.880051] [INFO ] [LOCAL ] CMU: Starting deletion of primary data. [2025-09-17T18:10:21.880105] [DEBUG] [LOCAL ] CMU: No primary data file found to delete. [2025-09-17T18:10:21.880139] [INFO ] [LOCAL ] CMU: Starting deletion of derivative data. [2025-09-17T18:10:21.880482] [DEBUG] [LOCAL ] CMU: Deleted derivative data file. [2025-09-17T18:10:21.880572] [INFO ] [MAIN ] Update Progress: 485/2371 symbols completed. CMU took 23.1s. Estimated remaining: 4h 33m 30s. Rate: 6.9 symbols/min [2025-09-17T18:10:22.029482] [INFO ] [REMOTE ] CNC: Fetching primary data for 2024-12. [2025-09-17T18:10:22.060625] [INFO ] [MAIN ] CNF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:10:22.071460] [DEBUG] [LOCAL ] CNF: Loaded 10664 existing records from primary storage. [2025-09-17T18:10:22.071581] [INFO ] [MAIN ] CNF: Loaded 10664 existing records. [2025-09-17T18:10:22.248888] [WARN ] [MAIN ] CNF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:10:22.249152] [INFO ] [MAIN ] CNF: Wiping existing primary data before full refresh. [2025-09-17T18:10:22.249198] [INFO ] [LOCAL ] CNF: Starting deletion of primary data. [2025-09-17T18:10:22.249540] [DEBUG] [LOCAL ] CNF: Deleted primary data file. [2025-09-17T18:10:22.249586] [INFO ] [MAIN ] CNF: Starting full primary refresh. [2025-09-17T18:10:22.602496] [INFO ] [REMOTE ] CNF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:10:22.815780] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-05. [2025-09-17T18:10:23.453313] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T18:10:23.615789] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-01. [2025-09-17T18:10:23.981067] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T18:10:24.415782] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-06. [2025-09-17T18:10:25.215756] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-11. [2025-09-17T18:10:25.358197] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T18:10:25.634482] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T18:10:25.933203] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T18:10:26.015760] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-07. [2025-09-17T18:10:26.815782] [INFO ] [REMOTE ] CNF: Fetching primary data for 2024-12. [2025-09-17T18:10:27.270693] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T18:10:27.615772] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-02. [2025-09-17T18:10:27.840030] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T18:10:28.415780] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-04. [2025-09-17T18:10:29.160948] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T18:10:29.215727] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-03. [2025-09-17T18:10:29.867095] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T18:10:30.015838] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-01. [2025-09-17T18:10:30.579370] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T18:10:30.697539] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T18:10:30.815725] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-04. [2025-09-17T18:10:31.615772] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-08. [2025-09-17T18:10:32.415797] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-02. [2025-09-17T18:10:32.771320] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T18:10:32.876575] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T18:10:32.972298] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T18:10:33.215771] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-05. [2025-09-17T18:10:34.015794] [INFO ] [REMOTE ] CNA: Fetching primary data for 2025-09. [2025-09-17T18:10:34.815772] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-05. [2025-09-17T18:10:35.068701] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T18:10:35.371445] [INFO ] [REMOTE ] CNA: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T18:10:35.375732] [INFO ] [REMOTE ] CNA: Full fetch complete (45235 records). [2025-09-17T18:10:35.375832] [DEBUG] [VALIDATOR ] CNA: Validating primary data. [2025-09-17T18:10:35.620890] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-06. [2025-09-17T18:10:35.763294] [DEBUG] [VALIDATOR ] CNA: All expected trading days are present. [2025-09-17T18:10:35.763394] [DEBUG] [VALIDATOR ] CNA: Primary data validation passed. [2025-09-17T18:10:35.764029] [INFO ] [MAIN ] CNA: Fetched primary data is valid. [2025-09-17T18:10:35.764080] [DEBUG] [LOCAL ] CNA: Saving primary data. [2025-09-17T18:10:35.765309] [DEBUG] [LOCAL ] CNA: Trimmed 45235 records to 32829 (keeping 200 days of data) [2025-09-17T18:10:35.942099] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T18:10:36.035191] [DEBUG] [LOCAL ] CNA: Primary data saved (32829 records). [2025-09-17T18:10:36.035359] [INFO ] [MAIN ] CNA: Full history saved. [2025-09-17T18:10:36.035465] [INFO ] [MAIN ] Update Progress: 486/2371 symbols completed. CNA took 35.4s. Estimated remaining: 4h 33m 43s. Rate: 6.9 symbols/min [2025-09-17T18:10:36.213395] [INFO ] [MAIN ] CNH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:10:36.268457] [DEBUG] [LOCAL ] CNH: Loaded 53563 existing records from primary storage. [2025-09-17T18:10:36.268605] [INFO ] [MAIN ] CNH: Loaded 53563 existing records. [2025-09-17T18:10:36.420852] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-03. [2025-09-17T18:10:36.457585] [WARN ] [MAIN ] CNH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:10:36.457836] [INFO ] [MAIN ] CNH: Wiping existing primary data before full refresh. [2025-09-17T18:10:36.457884] [INFO ] [LOCAL ] CNH: Starting deletion of primary data. [2025-09-17T18:10:36.458998] [DEBUG] [LOCAL ] CNH: Deleted primary data file. [2025-09-17T18:10:36.459050] [INFO ] [MAIN ] CNH: Starting full primary refresh. [2025-09-17T18:10:36.849047] [INFO ] [REMOTE ] CNH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:10:37.215746] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-11. [2025-09-17T18:10:37.334188] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T18:10:37.568163] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T18:10:38.015756] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-07. [2025-09-17T18:10:38.815770] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-04. [2025-09-17T18:10:39.023859] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T18:10:39.406827] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T18:10:39.615744] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-06. [2025-09-17T18:10:40.415843] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-05. [2025-09-17T18:10:40.611387] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-17T18:10:41.219763] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-08. [2025-09-17T18:10:41.221858] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T18:10:41.240688] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T18:10:42.015781] [INFO ] [REMOTE ] CNH: Fetching primary data for 2024-12. [2025-09-17T18:10:42.815836] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-07. [2025-09-17T18:10:43.565774] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-17T18:10:43.615738] [INFO ] [REMOTE ] CNC: Fetching primary data for 2025-09. [2025-09-17T18:10:43.797166] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T18:10:43.860186] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T18:10:44.415793] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-08. [2025-09-17T18:10:45.215825] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-01. [2025-09-17T18:10:45.549374] [INFO ] [REMOTE ] CNC: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T18:10:45.556324] [INFO ] [REMOTE ] CNC: Full fetch complete (77508 records). [2025-09-17T18:10:45.556442] [DEBUG] [VALIDATOR ] CNC: Validating primary data. [2025-09-17T18:10:45.975737] [DEBUG] [VALIDATOR ] CNC: All expected trading days are present. [2025-09-17T18:10:45.975870] [DEBUG] [VALIDATOR ] CNC: Primary data validation passed. [2025-09-17T18:10:45.983306] [INFO ] [MAIN ] CNC: Fetched primary data is valid. [2025-09-17T18:10:45.993921] [DEBUG] [LOCAL ] CNC: Saving primary data. [2025-09-17T18:10:45.995596] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T18:10:46.003128] [DEBUG] [LOCAL ] CNC: Trimmed 77508 records to 53729 (keeping 200 days of data) [2025-09-17T18:10:46.054341] [INFO ] [REMOTE ] CMTG: Fetching primary data for 2025-09. [2025-09-17T18:10:46.335808] [DEBUG] [LOCAL ] CNC: Primary data saved (53729 records). [2025-09-17T18:10:46.336051] [INFO ] [MAIN ] CNC: Full history saved. [2025-09-17T18:10:46.336799] [INFO ] [MAIN ] Update Progress: 487/2371 symbols completed. CNC took 28.2s. Estimated remaining: 4h 33m 40s. Rate: 6.9 symbols/min [2025-09-17T18:10:46.538560] [INFO ] [MAIN ] CNI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:10:46.594385] [DEBUG] [LOCAL ] CNI: Loaded 51669 existing records from primary storage. [2025-09-17T18:10:46.594533] [INFO ] [MAIN ] CNI: Loaded 51669 existing records. [2025-09-17T18:10:46.785035] [WARN ] [MAIN ] CNI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:10:46.785286] [INFO ] [MAIN ] CNI: Wiping existing primary data before full refresh. [2025-09-17T18:10:46.785338] [INFO ] [LOCAL ] CNI: Starting deletion of primary data. [2025-09-17T18:10:46.786521] [DEBUG] [LOCAL ] CNI: Deleted primary data file. [2025-09-17T18:10:46.786575] [INFO ] [MAIN ] CNI: Starting full primary refresh. [2025-09-17T18:10:46.829181] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-06. [2025-09-17T18:10:47.155316] [INFO ] [REMOTE ] CNI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:10:47.186951] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T18:10:47.296216] [INFO ] [REMOTE ] CMTG: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T18:10:47.300565] [INFO ] [REMOTE ] CMTG: Full fetch complete (52883 records). [2025-09-17T18:10:47.300734] [DEBUG] [VALIDATOR ] CMTG: Validating primary data. [2025-09-17T18:10:47.630858] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-02. [2025-09-17T18:10:47.689972] [DEBUG] [VALIDATOR ] CMTG: All expected trading days are present. [2025-09-17T18:10:47.690132] [DEBUG] [VALIDATOR ] CMTG: Primary data validation passed. [2025-09-17T18:10:47.700023] [INFO ] [MAIN ] CMTG: Fetched primary data is valid. [2025-09-17T18:10:47.701186] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T18:10:47.701273] [DEBUG] [LOCAL ] CMTG: Saving primary data. [2025-09-17T18:10:47.706580] [DEBUG] [LOCAL ] CMTG: Trimmed 52883 records to 37816 (keeping 200 days of data) [2025-09-17T18:10:47.935167] [DEBUG] [LOCAL ] CMTG: Primary data saved (37816 records). [2025-09-17T18:10:47.935309] [INFO ] [MAIN ] CMTG: Full history saved. [2025-09-17T18:10:47.935409] [INFO ] [MAIN ] Update Progress: 488/2371 symbols completed. CMTG took 50.4s. Estimated remaining: 4h 33m 4s. Rate: 6.9 symbols/min [2025-09-17T18:10:48.104577] [INFO ] [MAIN ] CNK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:10:48.163523] [DEBUG] [LOCAL ] CNK: Loaded 52898 existing records from primary storage. [2025-09-17T18:10:48.163725] [INFO ] [MAIN ] CNK: Loaded 52898 existing records. [2025-09-17T18:10:48.343558] [WARN ] [MAIN ] CNK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:10:48.343884] [INFO ] [MAIN ] CNK: Wiping existing primary data before full refresh. [2025-09-17T18:10:48.343935] [INFO ] [LOCAL ] CNK: Starting deletion of primary data. [2025-09-17T18:10:48.345018] [DEBUG] [LOCAL ] CNK: Deleted primary data file. [2025-09-17T18:10:48.345075] [INFO ] [MAIN ] CNK: Starting full primary refresh. [2025-09-17T18:10:48.420916] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-07. [2025-09-17T18:10:48.706480] [INFO ] [REMOTE ] CNK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:10:49.215799] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-11. [2025-09-17T18:10:49.323957] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T18:10:49.419588] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T18:10:50.015788] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-08. [2025-09-17T18:10:50.815775] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-03. [2025-09-17T18:10:50.973598] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T18:10:51.043963] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T18:10:51.615777] [INFO ] [REMOTE ] CNF: Fetching primary data for 2025-09. [2025-09-17T18:10:52.415759] [INFO ] [REMOTE ] CNI: Fetching primary data for 2024-12. [2025-09-17T18:10:52.437766] [INFO ] [REMOTE ] CNF: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T18:10:52.439923] [INFO ] [REMOTE ] CNF: Full fetch complete (12538 records). [2025-09-17T18:10:52.439992] [DEBUG] [VALIDATOR ] CNF: Validating primary data. [2025-09-17T18:10:52.814895] [DEBUG] [VALIDATOR ] CNF: All expected trading days are present. [2025-09-17T18:10:52.815004] [DEBUG] [VALIDATOR ] CNF: Primary data validation passed. [2025-09-17T18:10:52.815334] [INFO ] [MAIN ] CNF: Fetched primary data is valid. [2025-09-17T18:10:52.815385] [DEBUG] [LOCAL ] CNF: Saving primary data. [2025-09-17T18:10:52.816074] [DEBUG] [LOCAL ] CNF: Trimmed 12538 records to 10708 (keeping 200 days of data) [2025-09-17T18:10:52.895069] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T18:10:52.918809] [DEBUG] [LOCAL ] CNF: Primary data saved (10708 records). [2025-09-17T18:10:52.918911] [INFO ] [MAIN ] CNF: Full history saved. [2025-09-17T18:10:52.918990] [INFO ] [MAIN ] Update Progress: 489/2371 symbols completed. CNF took 31.0s. Estimated remaining: 4h 32m 41s. Rate: 6.9 symbols/min [2025-09-17T18:10:53.095593] [INFO ] [MAIN ] CNM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:10:53.150081] [DEBUG] [LOCAL ] CNM: Loaded 50935 existing records from primary storage. [2025-09-17T18:10:53.150251] [INFO ] [MAIN ] CNM: Loaded 50935 existing records. [2025-09-17T18:10:53.224718] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-11. [2025-09-17T18:10:53.330801] [WARN ] [MAIN ] CNM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:10:53.331053] [INFO ] [MAIN ] CNM: Wiping existing primary data before full refresh. [2025-09-17T18:10:53.331130] [INFO ] [LOCAL ] CNM: Starting deletion of primary data. [2025-09-17T18:10:53.332107] [DEBUG] [LOCAL ] CNM: Deleted primary data file. [2025-09-17T18:10:53.332159] [INFO ] [MAIN ] CNM: Starting full primary refresh. [2025-09-17T18:10:53.700949] [INFO ] [REMOTE ] CNM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:10:54.015752] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-04. [2025-09-17T18:10:54.106722] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T18:10:54.815795] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-11. [2025-09-17T18:10:55.090275] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T18:10:55.615817] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-01. [2025-09-17T18:10:55.802249] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T18:10:56.178615] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T18:10:56.415797] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-05. [2025-09-17T18:10:56.918051] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T18:10:57.215802] [INFO ] [REMOTE ] CNM: Fetching primary data for 2024-12. [2025-09-17T18:10:58.015756] [INFO ] [REMOTE ] CNK: Fetching primary data for 2024-12. [2025-09-17T18:10:58.480369] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T18:10:58.815852] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-06. [2025-09-17T18:10:58.947952] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T18:10:59.451692] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T18:10:59.615819] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-01. [2025-09-17T18:11:00.415755] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-01. [2025-09-17T18:11:00.508774] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T18:11:01.218228] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-07. [2025-09-17T18:11:01.222014] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T18:11:01.996119] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T18:11:02.015721] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-02. [2025-09-17T18:11:02.815754] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-02. [2025-09-17T18:11:03.278332] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T18:11:03.615900] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-08. [2025-09-17T18:11:03.860912] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T18:11:04.415858] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-03. [2025-09-17T18:11:04.555600] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T18:11:05.215897] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-02. [2025-09-17T18:11:05.401511] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T18:11:06.015852] [INFO ] [REMOTE ] CNH: Fetching primary data for 2025-09. [2025-09-17T18:11:06.164471] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T18:11:06.576225] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T18:11:06.815786] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-03. [2025-09-17T18:11:07.615829] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-04. [2025-09-17T18:11:07.902198] [INFO ] [REMOTE ] CNH: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-17T18:11:07.914043] [INFO ] [REMOTE ] CNH: Full fetch complete (77371 records). [2025-09-17T18:11:07.914267] [DEBUG] [VALIDATOR ] CNH: Validating primary data. [2025-09-17T18:11:08.335239] [DEBUG] [VALIDATOR ] CNH: All expected trading days are present. [2025-09-17T18:11:08.335337] [DEBUG] [VALIDATOR ] CNH: Primary data validation passed. [2025-09-17T18:11:08.336182] [INFO ] [MAIN ] CNH: Fetched primary data is valid. [2025-09-17T18:11:08.336254] [DEBUG] [LOCAL ] CNH: Saving primary data. [2025-09-17T18:11:08.338018] [DEBUG] [LOCAL ] CNH: Trimmed 77371 records to 53561 (keeping 200 days of data) [2025-09-17T18:11:08.433836] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-03. [2025-09-17T18:11:08.705950] [DEBUG] [LOCAL ] CNH: Primary data saved (53561 records). [2025-09-17T18:11:08.706488] [INFO ] [MAIN ] CNH: Full history saved. [2025-09-17T18:11:08.707620] [INFO ] [MAIN ] Update Progress: 490/2371 symbols completed. CNH took 32.7s. Estimated remaining: 4h 32m 59s. Rate: 6.9 symbols/min [2025-09-17T18:11:08.707491] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T18:11:08.897091] [INFO ] [MAIN ] CNMD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:11:08.928621] [DEBUG] [LOCAL ] CNMD: Loaded 32711 existing records from primary storage. [2025-09-17T18:11:08.928848] [INFO ] [MAIN ] CNMD: Loaded 32711 existing records. [2025-09-17T18:11:09.134811] [WARN ] [MAIN ] CNMD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:11:09.135168] [INFO ] [MAIN ] CNMD: Wiping existing primary data before full refresh. [2025-09-17T18:11:09.135240] [INFO ] [LOCAL ] CNMD: Starting deletion of primary data. [2025-09-17T18:11:09.136353] [DEBUG] [LOCAL ] CNMD: Deleted primary data file. [2025-09-17T18:11:09.136405] [INFO ] [MAIN ] CNMD: Starting full primary refresh. [2025-09-17T18:11:09.220910] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-04. [2025-09-17T18:11:09.479294] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T18:11:09.572127] [INFO ] [REMOTE ] CNMD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:11:10.015787] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-11. [2025-09-17T18:11:10.131524] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T18:11:10.815790] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-04. [2025-09-17T18:11:10.996720] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T18:11:11.165734] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T18:11:11.615885] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-05. [2025-09-17T18:11:12.415808] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-05. [2025-09-17T18:11:12.519050] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T18:11:13.172795] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T18:11:13.215815] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-06. [2025-09-17T18:11:13.859291] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T18:11:14.015809] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2024-12. [2025-09-17T18:11:14.748206] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T18:11:14.815812] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-05. [2025-09-17T18:11:15.286078] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T18:11:15.615815] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-07. [2025-09-17T18:11:16.415817] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-06. [2025-09-17T18:11:16.472721] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T18:11:17.215780] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-01. [2025-09-17T18:11:17.509985] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T18:11:18.015814] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-08. [2025-09-17T18:11:18.282739] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T18:11:18.558501] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T18:11:18.815784] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-06. [2025-09-17T18:11:19.615796] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-07. [2025-09-17T18:11:19.810276] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T18:11:20.415811] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-02. [2025-09-17T18:11:20.654064] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T18:11:21.215764] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-07. [2025-09-17T18:11:21.411110] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T18:11:21.662158] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T18:11:22.015822] [INFO ] [REMOTE ] CNI: Fetching primary data for 2025-09. [2025-09-17T18:11:22.624493] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T18:11:22.815894] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-03. [2025-09-17T18:11:23.615788] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-08. [2025-09-17T18:11:23.834472] [INFO ] [REMOTE ] CNI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T18:11:23.842674] [INFO ] [REMOTE ] CNI: Full fetch complete (74548 records). [2025-09-17T18:11:23.843129] [DEBUG] [VALIDATOR ] CNI: Validating primary data. [2025-09-17T18:11:24.278065] [DEBUG] [VALIDATOR ] CNI: All expected trading days are present. [2025-09-17T18:11:24.278210] [DEBUG] [VALIDATOR ] CNI: Primary data validation passed. [2025-09-17T18:11:24.279490] [INFO ] [MAIN ] CNI: Fetched primary data is valid. [2025-09-17T18:11:24.279627] [DEBUG] [LOCAL ] CNI: Saving primary data. [2025-09-17T18:11:24.281893] [DEBUG] [LOCAL ] CNI: Trimmed 74548 records to 51663 (keeping 200 days of data) [2025-09-17T18:11:24.406311] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T18:11:24.415848] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-08. [2025-09-17T18:11:24.670799] [DEBUG] [LOCAL ] CNI: Primary data saved (51663 records). [2025-09-17T18:11:24.670952] [INFO ] [MAIN ] CNI: Full history saved. [2025-09-17T18:11:24.671043] [INFO ] [MAIN ] Update Progress: 491/2371 symbols completed. CNI took 38.3s. Estimated remaining: 4h 33m 18s. Rate: 6.9 symbols/min [2025-09-17T18:11:24.841382] [INFO ] [MAIN ] CNNE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:11:24.876954] [DEBUG] [LOCAL ] CNNE: Loaded 36921 existing records from primary storage. [2025-09-17T18:11:24.877097] [INFO ] [MAIN ] CNNE: Loaded 36921 existing records. [2025-09-17T18:11:25.052658] [WARN ] [MAIN ] CNNE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:11:25.052910] [INFO ] [MAIN ] CNNE: Wiping existing primary data before full refresh. [2025-09-17T18:11:25.052955] [INFO ] [LOCAL ] CNNE: Starting deletion of primary data. [2025-09-17T18:11:25.053768] [DEBUG] [LOCAL ] CNNE: Deleted primary data file. [2025-09-17T18:11:25.053851] [INFO ] [MAIN ] CNNE: Starting full primary refresh. [2025-09-17T18:11:25.215984] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-04. [2025-09-17T18:11:25.415424] [INFO ] [REMOTE ] CNNE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:11:25.443355] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T18:11:26.015789] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-11. [2025-09-17T18:11:26.281671] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T18:11:26.768344] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T18:11:26.815808] [INFO ] [REMOTE ] CNK: Fetching primary data for 2025-09. [2025-09-17T18:11:27.365851] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T18:11:27.615781] [INFO ] [REMOTE ] CNM: Fetching primary data for 2025-09. [2025-09-17T18:11:28.415800] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-05. [2025-09-17T18:11:28.733175] [INFO ] [REMOTE ] CNK: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T18:11:28.740333] [INFO ] [REMOTE ] CNK: Full fetch complete (75453 records). [2025-09-17T18:11:28.740507] [DEBUG] [VALIDATOR ] CNK: Validating primary data. [2025-09-17T18:11:29.183799] [DEBUG] [VALIDATOR ] CNK: All expected trading days are present. [2025-09-17T18:11:29.183879] [DEBUG] [VALIDATOR ] CNK: Primary data validation passed. [2025-09-17T18:11:29.184701] [INFO ] [MAIN ] CNK: Fetched primary data is valid. [2025-09-17T18:11:29.184746] [DEBUG] [LOCAL ] CNK: Saving primary data. [2025-09-17T18:11:29.186177] [DEBUG] [LOCAL ] CNK: Trimmed 75453 records to 52910 (keeping 200 days of data) [2025-09-17T18:11:29.245143] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2024-12. [2025-09-17T18:11:29.426805] [INFO ] [REMOTE ] CNM: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T18:11:29.434755] [INFO ] [REMOTE ] CNM: Full fetch complete (73455 records). [2025-09-17T18:11:29.435355] [DEBUG] [VALIDATOR ] CNM: Validating primary data. [2025-09-17T18:11:29.846685] [DEBUG] [VALIDATOR ] CNM: All expected trading days are present. [2025-09-17T18:11:29.847288] [DEBUG] [VALIDATOR ] CNM: Primary data validation passed. [2025-09-17T18:11:29.848856] [INFO ] [MAIN ] CNM: Fetched primary data is valid. [2025-09-17T18:11:29.849255] [DEBUG] [LOCAL ] CNM: Saving primary data. [2025-09-17T18:11:29.853913] [DEBUG] [LOCAL ] CNM: Trimmed 73455 records to 50949 (keeping 200 days of data) [2025-09-17T18:11:29.965787] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T18:11:30.026575] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-06. [2025-09-17T18:11:30.103060] [DEBUG] [LOCAL ] CNK: Primary data saved (52910 records). [2025-09-17T18:11:30.103259] [INFO ] [MAIN ] CNK: Full history saved. [2025-09-17T18:11:30.104302] [INFO ] [MAIN ] Update Progress: 492/2371 symbols completed. CNK took 42.2s. Estimated remaining: 4h 32m 57s. Rate: 6.9 symbols/min [2025-09-17T18:11:30.384626] [INFO ] [MAIN ] CNO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:11:30.464031] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T18:11:30.487517] [DEBUG] [LOCAL ] CNM: Primary data saved (50949 records). [2025-09-17T18:11:30.487731] [INFO ] [MAIN ] CNM: Full history saved. [2025-09-17T18:11:30.487827] [INFO ] [MAIN ] Update Progress: 493/2371 symbols completed. CNM took 37.6s. Estimated remaining: 4h 32m 17s. Rate: 6.9 symbols/min [2025-09-17T18:11:30.690595] [INFO ] [MAIN ] CNP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:11:30.691423] [DEBUG] [LOCAL ] CNO: Loaded 41625 existing records from primary storage. [2025-09-17T18:11:30.691691] [INFO ] [MAIN ] CNO: Loaded 41625 existing records. [2025-09-17T18:11:30.816023] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-01. [2025-09-17T18:11:30.875130] [WARN ] [MAIN ] CNO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:11:30.875482] [INFO ] [MAIN ] CNO: Wiping existing primary data before full refresh. [2025-09-17T18:11:30.875532] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-17T18:11:30.876424] [DEBUG] [LOCAL ] CNO: Deleted primary data file. [2025-09-17T18:11:30.876478] [INFO ] [MAIN ] CNO: Starting full primary refresh. [2025-09-17T18:11:31.183284] [DEBUG] [LOCAL ] CNP: Loaded 53469 existing records from primary storage. [2025-09-17T18:11:31.212032] [INFO ] [MAIN ] CNP: Loaded 53469 existing records. [2025-09-17T18:11:31.381837] [INFO ] [REMOTE ] CNO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:11:31.470268] [WARN ] [MAIN ] CNP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:11:31.470578] [INFO ] [MAIN ] CNP: Wiping existing primary data before full refresh. [2025-09-17T18:11:31.470698] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-17T18:11:31.487533] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T18:11:31.493192] [DEBUG] [LOCAL ] CNP: Deleted primary data file. [2025-09-17T18:11:31.493539] [INFO ] [MAIN ] CNP: Starting full primary refresh. [2025-09-17T18:11:31.620815] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-11. [2025-09-17T18:11:31.864205] [INFO ] [REMOTE ] CNP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:11:31.879360] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T18:11:32.415779] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-02. [2025-09-17T18:11:33.215795] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-07. [2025-09-17T18:11:33.247023] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T18:11:33.373323] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T18:11:34.015780] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-03. [2025-09-17T18:11:34.809809] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T18:11:34.821034] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-11. [2025-09-17T18:11:35.219249] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T18:11:35.615787] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-04. [2025-09-17T18:11:36.415362] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T18:11:36.425703] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-08. [2025-09-17T18:11:37.050376] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T18:11:37.215799] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-05. [2025-09-17T18:11:37.302907] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T18:11:38.015820] [INFO ] [REMOTE ] CNO: Fetching primary data for 2024-12. [2025-09-17T18:11:38.120104] [DEBUG] [REMOTE ] CNO: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-17T18:11:38.120506] [WARN ] [REMOTE ] CNO: No data returned for month 2024-12 [2025-09-17T18:11:38.636922] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T18:11:38.815787] [INFO ] [REMOTE ] CNP: Fetching primary data for 2024-12. [2025-09-17T18:11:39.615797] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-01. [2025-09-17T18:11:40.415817] [INFO ] [REMOTE ] CNMD: Fetching primary data for 2025-09. [2025-09-17T18:11:40.519726] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T18:11:41.067360] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T18:11:41.215807] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-01. [2025-09-17T18:11:41.387936] [INFO ] [REMOTE ] CNMD: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T18:11:41.392112] [INFO ] [REMOTE ] CNMD: Full fetch complete (46785 records). [2025-09-17T18:11:41.392253] [DEBUG] [VALIDATOR ] CNMD: Validating primary data. [2025-09-17T18:11:41.772727] [DEBUG] [VALIDATOR ] CNMD: All expected trading days are present. [2025-09-17T18:11:41.772815] [DEBUG] [VALIDATOR ] CNMD: Primary data validation passed. [2025-09-17T18:11:41.773395] [INFO ] [MAIN ] CNMD: Fetched primary data is valid. [2025-09-17T18:11:41.773454] [DEBUG] [LOCAL ] CNMD: Saving primary data. [2025-09-17T18:11:41.774492] [DEBUG] [LOCAL ] CNMD: Trimmed 46785 records to 32668 (keeping 200 days of data) [2025-09-17T18:11:41.974494] [DEBUG] [LOCAL ] CNMD: Primary data saved (32668 records). [2025-09-17T18:11:41.974654] [INFO ] [MAIN ] CNMD: Full history saved. [2025-09-17T18:11:41.974782] [INFO ] [MAIN ] Update Progress: 494/2371 symbols completed. CNMD took 33.3s. Estimated remaining: 4h 32m 19s. Rate: 6.9 symbols/min [2025-09-17T18:11:42.020876] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-02. [2025-09-17T18:11:42.152250] [INFO ] [MAIN ] CNQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:11:42.201587] [DEBUG] [LOCAL ] CNQ: Loaded 53584 existing records from primary storage. [2025-09-17T18:11:42.201752] [INFO ] [MAIN ] CNQ: Loaded 53584 existing records. [2025-09-17T18:11:42.386051] [WARN ] [MAIN ] CNQ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:11:42.386311] [INFO ] [MAIN ] CNQ: Wiping existing primary data before full refresh. [2025-09-17T18:11:42.386358] [INFO ] [LOCAL ] CNQ: Starting deletion of primary data. [2025-09-17T18:11:42.387424] [DEBUG] [LOCAL ] CNQ: Deleted primary data file. [2025-09-17T18:11:42.387477] [INFO ] [MAIN ] CNQ: Starting full primary refresh. [2025-09-17T18:11:42.801673] [INFO ] [REMOTE ] CNQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:11:42.815732] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-11. [2025-09-17T18:11:43.032295] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T18:11:43.350579] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T18:11:43.615810] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-02. [2025-09-17T18:11:44.415801] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-06. [2025-09-17T18:11:44.716105] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T18:11:44.959896] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T18:11:45.215803] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-03. [2025-09-17T18:11:45.833784] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T18:11:46.015775] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2024-12. [2025-09-17T18:11:46.815765] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-03. [2025-09-17T18:11:47.185675] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T18:11:47.377958] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T18:11:47.615776] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-04. [2025-09-17T18:11:48.149938] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T18:11:48.415781] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-07. [2025-09-17T18:11:49.025838] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T18:11:49.215811] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-01. [2025-09-17T18:11:50.015804] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-05. [2025-09-17T18:11:50.172446] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T18:11:50.685485] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T18:11:50.815799] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-02. [2025-09-17T18:11:51.615813] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-08. [2025-09-17T18:11:51.908577] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T18:11:52.415775] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-06. [2025-09-17T18:11:52.660568] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T18:11:53.121785] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T18:11:53.215786] [INFO ] [REMOTE ] CNNE: Fetching primary data for 2025-09. [2025-09-17T18:11:54.021234] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-04. [2025-09-17T18:11:54.037500] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T18:11:54.611682] [INFO ] [REMOTE ] CNNE: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T18:11:54.617034] [INFO ] [REMOTE ] CNNE: Full fetch complete (48754 records). [2025-09-17T18:11:54.617205] [DEBUG] [VALIDATOR ] CNNE: Validating primary data. [2025-09-17T18:11:54.820844] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-03. [2025-09-17T18:11:54.997926] [DEBUG] [VALIDATOR ] CNNE: All expected trading days are present. [2025-09-17T18:11:54.998006] [DEBUG] [VALIDATOR ] CNNE: Primary data validation passed. [2025-09-17T18:11:54.998614] [INFO ] [MAIN ] CNNE: Fetched primary data is valid. [2025-09-17T18:11:54.998673] [DEBUG] [LOCAL ] CNNE: Saving primary data. [2025-09-17T18:11:55.000811] [DEBUG] [LOCAL ] CNNE: Trimmed 48754 records to 36931 (keeping 200 days of data) [2025-09-17T18:11:55.244616] [DEBUG] [LOCAL ] CNNE: Primary data saved (36931 records). [2025-09-17T18:11:55.245130] [INFO ] [MAIN ] CNNE: Full history saved. [2025-09-17T18:11:55.246519] [INFO ] [MAIN ] Update Progress: 495/2371 symbols completed. CNNE took 30.6s. Estimated remaining: 4h 32m 27s. Rate: 6.9 symbols/min [2025-09-17T18:11:55.449766] [INFO ] [MAIN ] CNR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:11:55.450600] [DEBUG] [LOCAL ] CNR: No existing data file found in primary storage. [2025-09-17T18:11:55.451691] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T18:11:55.450660] [WARN ] [MAIN ] CNR: No existing data found, performing full refresh instead. [2025-09-17T18:11:55.460852] [INFO ] [MAIN ] CNR: Wiping existing primary data before full refresh. [2025-09-17T18:11:55.460916] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-17T18:11:55.461273] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-17T18:11:55.461333] [INFO ] [MAIN ] CNR: Starting full primary refresh. [2025-09-17T18:11:55.617285] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-05. [2025-09-17T18:11:55.817148] [INFO ] [REMOTE ] CNR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:11:56.415829] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-07. [2025-09-17T18:11:57.003935] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T18:11:57.204700] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T18:11:57.215718] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-06. [2025-09-17T18:11:58.015756] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-11. [2025-09-17T18:11:58.521222] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T18:11:58.667756] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:11:58.668144] [WARN ] [REMOTE ] CNR: No data returned for month 2024-11 [2025-09-17T18:11:58.693346] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T18:11:58.815767] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-07. [2025-09-17T18:11:59.615818] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-04. [2025-09-17T18:12:00.415780] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-08. [2025-09-17T18:12:00.555508] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T18:12:01.215839] [INFO ] [REMOTE ] CNR: Fetching primary data for 2024-12. [2025-09-17T18:12:01.442414] [DEBUG] [REMOTE ] CNR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:12:01.443005] [WARN ] [REMOTE ] CNR: No data returned for month 2024-12 [2025-09-17T18:12:01.659038] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T18:12:01.812223] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T18:12:02.015784] [INFO ] [REMOTE ] CNP: Fetching primary data for 2025-09. [2025-09-17T18:12:02.815808] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-08. [2025-09-17T18:12:03.615737] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-05. [2025-09-17T18:12:03.741274] [INFO ] [REMOTE ] CNP: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T18:12:03.747955] [INFO ] [REMOTE ] CNP: Full fetch complete (76800 records). [2025-09-17T18:12:03.748085] [DEBUG] [VALIDATOR ] CNP: Validating primary data. [2025-09-17T18:12:03.749114] [FATAL] [VALIDATOR ] CNP: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:12:03.749211] [FATAL] [MAIN ] CNP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:12:03.749260] [WARN ] [MAIN ] CNP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:12:03.749321] [INFO ] [LOCAL ] CNP: Starting deletion of primary data. [2025-09-17T18:12:03.749396] [DEBUG] [LOCAL ] CNP: No primary data file found to delete. [2025-09-17T18:12:03.749445] [INFO ] [LOCAL ] CNP: Starting deletion of derivative data. [2025-09-17T18:12:03.749840] [DEBUG] [LOCAL ] CNP: Deleted derivative data file. [2025-09-17T18:12:03.749938] [INFO ] [MAIN ] Update Progress: 496/2371 symbols completed. CNP took 33.3s. Estimated remaining: 4h 32m 18s. Rate: 6.9 symbols/min [2025-09-17T18:12:03.921628] [INFO ] [MAIN ] CNS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:12:03.944111] [DEBUG] [LOCAL ] CNS: Loaded 21168 existing records from primary storage. [2025-09-17T18:12:03.944254] [INFO ] [MAIN ] CNS: Loaded 21168 existing records. [2025-09-17T18:12:04.124340] [WARN ] [MAIN ] CNS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:12:04.125166] [INFO ] [MAIN ] CNS: Wiping existing primary data before full refresh. [2025-09-17T18:12:04.125216] [INFO ] [LOCAL ] CNS: Starting deletion of primary data. [2025-09-17T18:12:04.126228] [DEBUG] [LOCAL ] CNS: Deleted primary data file. [2025-09-17T18:12:04.126277] [INFO ] [MAIN ] CNS: Starting full primary refresh. [2025-09-17T18:12:04.425066] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-01. [2025-09-17T18:12:04.498043] [INFO ] [REMOTE ] CNS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:12:04.525860] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T18:12:05.215735] [INFO ] [REMOTE ] CNO: Fetching primary data for 2025-09. [2025-09-17T18:12:05.297849] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T18:12:05.891684] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T18:12:06.015743] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-02. [2025-09-17T18:12:06.815753] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-11. [2025-09-17T18:12:07.168487] [INFO ] [REMOTE ] CNO: Incremental fetch complete for 2025-09 (1.95 seconds). [2025-09-17T18:12:07.174203] [INFO ] [REMOTE ] CNO: Full fetch complete (54573 records). [2025-09-17T18:12:07.174319] [DEBUG] [VALIDATOR ] CNO: Validating primary data. [2025-09-17T18:12:07.363863] [WARN ] [VALIDATOR ] CNO: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T18:12:07.364628] [FATAL] [MAIN ] CNO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:12:07.364724] [WARN ] [MAIN ] CNO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:12:07.364794] [INFO ] [LOCAL ] CNO: Starting deletion of primary data. [2025-09-17T18:12:07.364875] [DEBUG] [LOCAL ] CNO: No primary data file found to delete. [2025-09-17T18:12:07.364933] [INFO ] [LOCAL ] CNO: Starting deletion of derivative data. [2025-09-17T18:12:07.365292] [DEBUG] [LOCAL ] CNO: Deleted derivative data file. [2025-09-17T18:12:07.365391] [INFO ] [MAIN ] Update Progress: 497/2371 symbols completed. CNO took 37.2s. Estimated remaining: 4h 31m 50s. Rate: 6.9 symbols/min [2025-09-17T18:12:07.532855] [INFO ] [MAIN ] CNX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:12:07.585352] [DEBUG] [LOCAL ] CNX: Loaded 51387 existing records from primary storage. [2025-09-17T18:12:07.585514] [INFO ] [MAIN ] CNX: Loaded 51387 existing records. [2025-09-17T18:12:07.619389] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-06. [2025-09-17T18:12:07.774840] [WARN ] [MAIN ] CNX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:12:07.775245] [INFO ] [MAIN ] CNX: Wiping existing primary data before full refresh. [2025-09-17T18:12:07.775349] [INFO ] [LOCAL ] CNX: Starting deletion of primary data. [2025-09-17T18:12:07.776415] [DEBUG] [LOCAL ] CNX: Deleted primary data file. [2025-09-17T18:12:07.776469] [INFO ] [MAIN ] CNX: Starting full primary refresh. [2025-09-17T18:12:08.090309] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T18:12:08.175361] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T18:12:08.200203] [INFO ] [REMOTE ] CNX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:12:08.415810] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-11. [2025-09-17T18:12:09.215800] [INFO ] [REMOTE ] CNS: Fetching primary data for 2024-12. [2025-09-17T18:12:09.383919] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T18:12:10.015840] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-07. [2025-09-17T18:12:10.176620] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T18:12:10.263334] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T18:12:10.815784] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-03. [2025-09-17T18:12:11.615776] [INFO ] [REMOTE ] CNX: Fetching primary data for 2024-12. [2025-09-17T18:12:11.723901] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T18:12:12.415834] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-08. [2025-09-17T18:12:12.570486] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T18:12:12.830072] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T18:12:13.215817] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-01. [2025-09-17T18:12:14.015832] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-01. [2025-09-17T18:12:14.174385] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T18:12:14.496500] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T18:12:14.815762] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-02. [2025-09-17T18:12:15.615764] [INFO ] [REMOTE ] CNQ: Fetching primary data for 2025-09. [2025-09-17T18:12:15.707937] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T18:12:15.837137] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T18:12:16.415808] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-03. [2025-09-17T18:12:17.215753] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-04. [2025-09-17T18:12:17.602747] [INFO ] [REMOTE ] CNQ: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-17T18:12:17.609772] [INFO ] [REMOTE ] CNQ: Full fetch complete (77379 records). [2025-09-17T18:12:17.610050] [DEBUG] [VALIDATOR ] CNQ: Validating primary data. [2025-09-17T18:12:17.770090] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T18:12:18.026406] [DEBUG] [VALIDATOR ] CNQ: All expected trading days are present. [2025-09-17T18:12:18.022515] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-04. [2025-09-17T18:12:18.026545] [DEBUG] [VALIDATOR ] CNQ: Primary data validation passed. [2025-09-17T18:12:18.028304] [INFO ] [MAIN ] CNQ: Fetched primary data is valid. [2025-09-17T18:12:18.028437] [DEBUG] [LOCAL ] CNQ: Saving primary data. [2025-09-17T18:12:18.029938] [DEBUG] [LOCAL ] CNQ: Trimmed 77379 records to 53583 (keeping 200 days of data) [2025-09-17T18:12:18.382182] [DEBUG] [LOCAL ] CNQ: Primary data saved (53583 records). [2025-09-17T18:12:18.382318] [INFO ] [MAIN ] CNQ: Full history saved. [2025-09-17T18:12:18.382400] [INFO ] [MAIN ] Update Progress: 498/2371 symbols completed. CNQ took 36.4s. Estimated remaining: 4h 31m 50s. Rate: 6.9 symbols/min [2025-09-17T18:12:18.559189] [INFO ] [MAIN ] CODI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:12:18.594805] [DEBUG] [LOCAL ] CODI: Loaded 39540 existing records from primary storage. [2025-09-17T18:12:18.594947] [INFO ] [MAIN ] CODI: Loaded 39540 existing records. [2025-09-17T18:12:18.774689] [WARN ] [MAIN ] CODI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:12:18.774958] [INFO ] [MAIN ] CODI: Wiping existing primary data before full refresh. [2025-09-17T18:12:18.775028] [INFO ] [LOCAL ] CODI: Starting deletion of primary data. [2025-09-17T18:12:18.775774] [DEBUG] [LOCAL ] CODI: Deleted primary data file. [2025-09-17T18:12:18.775822] [INFO ] [MAIN ] CODI: Starting full primary refresh. [2025-09-17T18:12:18.823944] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-02. [2025-09-17T18:12:19.157341] [INFO ] [REMOTE ] CODI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:12:19.180632] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T18:12:19.201627] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T18:12:19.615784] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-05. [2025-09-17T18:12:20.415837] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-11. [2025-09-17T18:12:20.665716] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T18:12:21.220886] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-03. [2025-09-17T18:12:21.236068] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T18:12:21.522797] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T18:12:22.015775] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-05. [2025-09-17T18:12:22.815741] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-06. [2025-09-17T18:12:22.895295] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T18:12:23.039520] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T18:12:23.615774] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-06. [2025-09-17T18:12:24.415778] [INFO ] [REMOTE ] CODI: Fetching primary data for 2024-12. [2025-09-17T18:12:24.457597] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T18:12:24.571264] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T18:12:25.204343] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T18:12:25.215729] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-01. [2025-09-17T18:12:26.015745] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-07. [2025-09-17T18:12:26.318313] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T18:12:26.815814] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-04. [2025-09-17T18:12:26.925578] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T18:12:27.615831] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-02. [2025-09-17T18:12:28.251787] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T18:12:28.415791] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-05. [2025-09-17T18:12:28.739099] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T18:12:29.215849] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-08. [2025-09-17T18:12:30.015767] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-07. [2025-09-17T18:12:30.090972] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T18:12:30.289598] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T18:12:30.815762] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-06. [2025-09-17T18:12:31.615798] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-03. [2025-09-17T18:12:31.699164] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T18:12:32.415750] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-08. [2025-09-17T18:12:32.495199] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T18:12:32.781836] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T18:12:33.215780] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-07. [2025-09-17T18:12:33.954495] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T18:12:34.015770] [INFO ] [REMOTE ] CNR: Fetching primary data for 2025-09. [2025-09-17T18:12:34.721910] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T18:12:34.815799] [INFO ] [REMOTE ] CNS: Fetching primary data for 2025-09. [2025-09-17T18:12:35.488367] [INFO ] [REMOTE ] CNR: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T18:12:35.494280] [INFO ] [REMOTE ] CNR: Full fetch complete (54657 records). [2025-09-17T18:12:35.494422] [DEBUG] [VALIDATOR ] CNR: Validating primary data. [2025-09-17T18:12:35.620961] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-04. [2025-09-17T18:12:35.691793] [WARN ] [VALIDATOR ] CNR: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-17T18:12:35.692369] [FATAL] [MAIN ] CNR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:12:35.692450] [WARN ] [MAIN ] CNR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:12:35.692499] [INFO ] [LOCAL ] CNR: Starting deletion of primary data. [2025-09-17T18:12:35.692556] [DEBUG] [LOCAL ] CNR: No primary data file found to delete. [2025-09-17T18:12:35.692599] [INFO ] [LOCAL ] CNR: Starting deletion of derivative data. [2025-09-17T18:12:35.692655] [DEBUG] [LOCAL ] CNR: No derivative data file found to delete. [2025-09-17T18:12:35.692722] [INFO ] [MAIN ] Update Progress: 499/2371 symbols completed. CNR took 40.4s. Estimated remaining: 4h 32m 13s. Rate: 6.9 symbols/min [2025-09-17T18:12:35.865607] [INFO ] [MAIN ] COF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:12:35.881604] [INFO ] [REMOTE ] CNS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T18:12:35.885101] [INFO ] [REMOTE ] CNS: Full fetch complete (29615 records). [2025-09-17T18:12:35.885198] [DEBUG] [VALIDATOR ] CNS: Validating primary data. [2025-09-17T18:12:36.235126] [DEBUG] [LOCAL ] COF: Loaded 53612 existing records from primary storage. [2025-09-17T18:12:36.282253] [INFO ] [MAIN ] COF: Loaded 53612 existing records. [2025-09-17T18:12:36.364082] [DEBUG] [VALIDATOR ] CNS: All expected trading days are present. [2025-09-17T18:12:36.393926] [DEBUG] [VALIDATOR ] CNS: Primary data validation passed. [2025-09-17T18:12:36.397281] [INFO ] [MAIN ] CNS: Fetched primary data is valid. [2025-09-17T18:12:36.397719] [DEBUG] [LOCAL ] CNS: Saving primary data. [2025-09-17T18:12:36.418878] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-08. [2025-09-17T18:12:36.465205] [DEBUG] [LOCAL ] CNS: Trimmed 29615 records to 21185 (keeping 200 days of data) [2025-09-17T18:12:36.492682] [WARN ] [MAIN ] COF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:12:36.494258] [INFO ] [MAIN ] COF: Wiping existing primary data before full refresh. [2025-09-17T18:12:36.494328] [INFO ] [LOCAL ] COF: Starting deletion of primary data. [2025-09-17T18:12:36.550027] [DEBUG] [LOCAL ] COF: Deleted primary data file. [2025-09-17T18:12:36.558399] [INFO ] [MAIN ] COF: Starting full primary refresh. [2025-09-17T18:12:36.925671] [DEBUG] [LOCAL ] CNS: Primary data saved (21185 records). [2025-09-17T18:12:36.925987] [INFO ] [MAIN ] CNS: Full history saved. [2025-09-17T18:12:36.926211] [INFO ] [MAIN ] Update Progress: 500/2371 symbols completed. CNS took 33.2s. Estimated remaining: 4h 31m 37s. Rate: 6.9 symbols/min [2025-09-17T18:12:37.081939] [INFO ] [REMOTE ] COF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:12:37.206619] [INFO ] [MAIN ] COHR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:12:37.208406] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T18:12:37.215893] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-05. [2025-09-17T18:12:37.269672] [DEBUG] [LOCAL ] COHR: Loaded 53372 existing records from primary storage. [2025-09-17T18:12:37.269830] [INFO ] [MAIN ] COHR: Loaded 53372 existing records. [2025-09-17T18:12:37.448296] [WARN ] [MAIN ] COHR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:12:37.448560] [INFO ] [MAIN ] COHR: Wiping existing primary data before full refresh. [2025-09-17T18:12:37.448605] [INFO ] [LOCAL ] COHR: Starting deletion of primary data. [2025-09-17T18:12:37.449513] [DEBUG] [LOCAL ] COHR: Deleted primary data file. [2025-09-17T18:12:37.449571] [INFO ] [MAIN ] COHR: Starting full primary refresh. [2025-09-17T18:12:37.825885] [INFO ] [REMOTE ] COHR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:12:38.015773] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-11. [2025-09-17T18:12:38.170907] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T18:12:38.561947] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T18:12:38.815761] [INFO ] [REMOTE ] CNX: Fetching primary data for 2025-09. [2025-09-17T18:12:39.615769] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-11. [2025-09-17T18:12:40.050757] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-17T18:12:40.415752] [INFO ] [REMOTE ] COHR: Fetching primary data for 2024-12. [2025-09-17T18:12:40.459362] [INFO ] [REMOTE ] CNX: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T18:12:40.466136] [INFO ] [REMOTE ] CNX: Full fetch complete (74550 records). [2025-09-17T18:12:40.466258] [DEBUG] [VALIDATOR ] CNX: Validating primary data. [2025-09-17T18:12:40.864159] [DEBUG] [VALIDATOR ] CNX: All expected trading days are present. [2025-09-17T18:12:40.864240] [DEBUG] [VALIDATOR ] CNX: Primary data validation passed. [2025-09-17T18:12:40.865102] [INFO ] [MAIN ] CNX: Fetched primary data is valid. [2025-09-17T18:12:40.865163] [DEBUG] [LOCAL ] CNX: Saving primary data. [2025-09-17T18:12:40.866694] [DEBUG] [LOCAL ] CNX: Trimmed 74550 records to 51373 (keeping 200 days of data) [2025-09-17T18:12:41.130184] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T18:12:41.215866] [INFO ] [REMOTE ] COF: Fetching primary data for 2024-12. [2025-09-17T18:12:41.228768] [DEBUG] [LOCAL ] CNX: Primary data saved (51373 records). [2025-09-17T18:12:41.228860] [INFO ] [MAIN ] CNX: Full history saved. [2025-09-17T18:12:41.229403] [INFO ] [MAIN ] Update Progress: 501/2371 symbols completed. CNX took 33.9s. Estimated remaining: 4h 31m 11s. Rate: 6.9 symbols/min [2025-09-17T18:12:41.400786] [INFO ] [MAIN ] COLD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:12:41.454101] [DEBUG] [LOCAL ] COLD: Loaded 51879 existing records from primary storage. [2025-09-17T18:12:41.454255] [INFO ] [MAIN ] COLD: Loaded 51879 existing records. [2025-09-17T18:12:41.641548] [WARN ] [MAIN ] COLD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:12:41.641851] [INFO ] [MAIN ] COLD: Wiping existing primary data before full refresh. [2025-09-17T18:12:41.641914] [INFO ] [LOCAL ] COLD: Starting deletion of primary data. [2025-09-17T18:12:41.642920] [DEBUG] [LOCAL ] COLD: Deleted primary data file. [2025-09-17T18:12:41.642982] [INFO ] [MAIN ] COLD: Starting full primary refresh. [2025-09-17T18:12:42.021062] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-06. [2025-09-17T18:12:42.026948] [INFO ] [REMOTE ] COLD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:12:42.068890] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T18:12:42.815775] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-11. [2025-09-17T18:12:43.009876] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T18:12:43.615745] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-01. [2025-09-17T18:12:43.703255] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T18:12:44.298691] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T18:12:44.415757] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-01. [2025-09-17T18:12:45.215802] [INFO ] [REMOTE ] COLD: Fetching primary data for 2024-12. [2025-09-17T18:12:45.428832] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T18:12:45.986428] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T18:12:46.015750] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-02. [2025-09-17T18:12:46.733448] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T18:12:46.815749] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-02. [2025-09-17T18:12:47.615770] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-07. [2025-09-17T18:12:47.783765] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T18:12:48.415753] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-03. [2025-09-17T18:12:48.577697] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T18:12:49.215035] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T18:12:49.224179] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-01. [2025-09-17T18:12:50.015802] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-08. [2025-09-17T18:12:50.307623] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T18:12:50.815700] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-03. [2025-09-17T18:12:50.854235] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T18:12:51.560016] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T18:12:51.615782] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-04. [2025-09-17T18:12:52.415780] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-02. [2025-09-17T18:12:52.955333] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T18:12:53.215853] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-04. [2025-09-17T18:12:53.588459] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T18:12:54.022415] [INFO ] [REMOTE ] CODI: Fetching primary data for 2025-09. [2025-09-17T18:12:54.028398] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T18:12:54.815744] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-05. [2025-09-17T18:12:55.381911] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-17T18:12:55.597665] [INFO ] [REMOTE ] CODI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T18:12:55.602721] [INFO ] [REMOTE ] CODI: Full fetch complete (49802 records). [2025-09-17T18:12:55.602858] [DEBUG] [VALIDATOR ] CODI: Validating primary data. [2025-09-17T18:12:55.625185] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-05. [2025-09-17T18:12:56.002359] [DEBUG] [VALIDATOR ] CODI: All expected trading days are present. [2025-09-17T18:12:56.002451] [DEBUG] [VALIDATOR ] CODI: Primary data validation passed. [2025-09-17T18:12:56.003091] [INFO ] [MAIN ] CODI: Fetched primary data is valid. [2025-09-17T18:12:56.003138] [DEBUG] [LOCAL ] CODI: Saving primary data. [2025-09-17T18:12:56.004415] [DEBUG] [LOCAL ] CODI: Trimmed 49802 records to 39600 (keeping 200 days of data) [2025-09-17T18:12:56.243191] [DEBUG] [LOCAL ] CODI: Primary data saved (39600 records). [2025-09-17T18:12:56.243376] [INFO ] [MAIN ] CODI: Full history saved. [2025-09-17T18:12:56.243515] [INFO ] [MAIN ] Update Progress: 502/2371 symbols completed. CODI took 37.9s. Estimated remaining: 4h 31m 26s. Rate: 6.9 symbols/min [2025-09-17T18:12:56.416002] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-03. [2025-09-17T18:12:56.436232] [INFO ] [MAIN ] COMP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:12:56.499879] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T18:12:56.531554] [DEBUG] [LOCAL ] COMP: Loaded 53386 existing records from primary storage. [2025-09-17T18:12:56.531722] [INFO ] [MAIN ] COMP: Loaded 53386 existing records. [2025-09-17T18:12:56.722767] [WARN ] [MAIN ] COMP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:12:56.723027] [INFO ] [MAIN ] COMP: Wiping existing primary data before full refresh. [2025-09-17T18:12:56.723075] [INFO ] [LOCAL ] COMP: Starting deletion of primary data. [2025-09-17T18:12:56.724120] [DEBUG] [LOCAL ] COMP: Deleted primary data file. [2025-09-17T18:12:56.724174] [INFO ] [MAIN ] COMP: Starting full primary refresh. [2025-09-17T18:12:57.104543] [INFO ] [REMOTE ] COMP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:12:57.215687] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-06. [2025-09-17T18:12:57.407307] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T18:12:58.015785] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-11. [2025-09-17T18:12:58.266593] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T18:12:58.815762] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-06. [2025-09-17T18:12:59.090748] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T18:12:59.615835] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-07. [2025-09-17T18:12:59.838624] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T18:13:00.415757] [INFO ] [REMOTE ] COMP: Fetching primary data for 2024-12. [2025-09-17T18:13:00.486394] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T18:13:01.215791] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-04. [2025-09-17T18:13:02.005147] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-17T18:13:02.016012] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-07. [2025-09-17T18:13:02.239569] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T18:13:02.815758] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-08. [2025-09-17T18:13:02.921148] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T18:13:03.615816] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-05. [2025-09-17T18:13:04.303350] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-17T18:13:04.415805] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-08. [2025-09-17T18:13:04.956917] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T18:13:05.215803] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-01. [2025-09-17T18:13:05.282779] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T18:13:06.015827] [INFO ] [REMOTE ] COHR: Fetching primary data for 2025-09. [2025-09-17T18:13:06.337998] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T18:13:06.815764] [INFO ] [REMOTE ] COF: Fetching primary data for 2025-09. [2025-09-17T18:13:07.004509] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T18:13:07.615821] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-02. [2025-09-17T18:13:08.015364] [INFO ] [REMOTE ] COHR: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-17T18:13:08.023585] [INFO ] [REMOTE ] COHR: Full fetch complete (76933 records). [2025-09-17T18:13:08.023835] [DEBUG] [VALIDATOR ] COHR: Validating primary data. [2025-09-17T18:13:08.414321] [DEBUG] [VALIDATOR ] COHR: All expected trading days are present. [2025-09-17T18:13:08.414411] [DEBUG] [VALIDATOR ] COHR: Primary data validation passed. [2025-09-17T18:13:08.415247] [INFO ] [MAIN ] COHR: Fetched primary data is valid. [2025-09-17T18:13:08.415295] [DEBUG] [LOCAL ] COHR: Saving primary data. [2025-09-17T18:13:08.416042] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-06. [2025-09-17T18:13:08.417794] [DEBUG] [LOCAL ] COHR: Trimmed 76933 records to 53373 (keeping 200 days of data) [2025-09-17T18:13:08.748703] [INFO ] [REMOTE ] COF: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T18:13:08.758668] [INFO ] [REMOTE ] COF: Full fetch complete (77211 records). [2025-09-17T18:13:08.759596] [DEBUG] [VALIDATOR ] COF: Validating primary data. [2025-09-17T18:13:08.936418] [DEBUG] [LOCAL ] COHR: Primary data saved (53373 records). [2025-09-17T18:13:08.937831] [INFO ] [MAIN ] COHR: Full history saved. [2025-09-17T18:13:08.937957] [INFO ] [MAIN ] Update Progress: 503/2371 symbols completed. COHR took 32.0s. Estimated remaining: 4h 31m 32s. Rate: 6.9 symbols/min [2025-09-17T18:13:09.272104] [INFO ] [MAIN ] CON: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:13:09.371118] [DEBUG] [VALIDATOR ] COF: All expected trading days are present. [2025-09-17T18:13:09.371287] [DEBUG] [VALIDATOR ] COF: Primary data validation passed. [2025-09-17T18:13:09.372327] [INFO ] [MAIN ] COF: Fetched primary data is valid. [2025-09-17T18:13:09.372475] [DEBUG] [LOCAL ] COF: Saving primary data. [2025-09-17T18:13:09.375155] [DEBUG] [LOCAL ] COF: Trimmed 77211 records to 53610 (keeping 200 days of data) [2025-09-17T18:13:09.415161] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T18:13:09.500039] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-03. [2025-09-17T18:13:09.549439] [DEBUG] [LOCAL ] CON: Loaded 38860 existing records from primary storage. [2025-09-17T18:13:09.550691] [INFO ] [MAIN ] CON: Loaded 38860 existing records. [2025-09-17T18:13:09.742621] [WARN ] [MAIN ] CON: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:13:09.746058] [INFO ] [MAIN ] CON: Wiping existing primary data before full refresh. [2025-09-17T18:13:09.747696] [INFO ] [LOCAL ] CON: Starting deletion of primary data. [2025-09-17T18:13:09.749563] [DEBUG] [LOCAL ] CON: Deleted primary data file. [2025-09-17T18:13:09.750669] [INFO ] [MAIN ] CON: Starting full primary refresh. [2025-09-17T18:13:10.263577] [INFO ] [REMOTE ] CON: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:13:10.265077] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-11. [2025-09-17T18:13:10.333257] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T18:13:10.455202] [DEBUG] [LOCAL ] COF: Primary data saved (53610 records). [2025-09-17T18:13:10.455439] [INFO ] [MAIN ] COF: Full history saved. [2025-09-17T18:13:10.456558] [INFO ] [MAIN ] Update Progress: 504/2371 symbols completed. COF took 34.8s. Estimated remaining: 4h 30m 57s. Rate: 6.9 symbols/min [2025-09-17T18:13:10.648739] [INFO ] [MAIN ] COOK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:13:10.678688] [DEBUG] [LOCAL ] COOK: Loaded 24123 existing records from primary storage. [2025-09-17T18:13:10.678895] [INFO ] [MAIN ] COOK: Loaded 24123 existing records. [2025-09-17T18:13:10.825594] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-07. [2025-09-17T18:13:10.866941] [WARN ] [MAIN ] COOK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:13:10.867258] [INFO ] [MAIN ] COOK: Wiping existing primary data before full refresh. [2025-09-17T18:13:10.867309] [INFO ] [LOCAL ] COOK: Starting deletion of primary data. [2025-09-17T18:13:10.868227] [DEBUG] [LOCAL ] COOK: Deleted primary data file. [2025-09-17T18:13:10.868520] [INFO ] [MAIN ] COOK: Starting full primary refresh. [2025-09-17T18:13:11.249636] [INFO ] [REMOTE ] COOK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:13:11.615905] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-11. [2025-09-17T18:13:11.725081] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-03 (2.23 seconds). [2025-09-17T18:13:11.903379] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T18:13:12.415853] [INFO ] [REMOTE ] CON: Fetching primary data for 2024-12. [2025-09-17T18:13:12.704387] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T18:13:12.738684] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T18:13:13.215788] [INFO ] [REMOTE ] COOK: Fetching primary data for 2024-12. [2025-09-17T18:13:13.944995] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T18:13:14.015752] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-01. [2025-09-17T18:13:14.368702] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T18:13:14.815766] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-08. [2025-09-17T18:13:15.623041] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-04. [2025-09-17T18:13:15.647067] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T18:13:16.415696] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-01. [2025-09-17T18:13:16.499891] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T18:13:17.215817] [INFO ] [REMOTE ] COLD: Fetching primary data for 2025-09. [2025-09-17T18:13:17.501548] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T18:13:17.561515] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T18:13:18.015824] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-02. [2025-09-17T18:13:18.816592] [INFO ] [REMOTE ] COLD: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T18:13:18.815933] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-02. [2025-09-17T18:13:18.824328] [INFO ] [REMOTE ] COLD: Full fetch complete (73817 records). [2025-09-17T18:13:18.824520] [DEBUG] [VALIDATOR ] COLD: Validating primary data. [2025-09-17T18:13:19.228715] [DEBUG] [VALIDATOR ] COLD: All expected trading days are present. [2025-09-17T18:13:19.228918] [DEBUG] [VALIDATOR ] COLD: Primary data validation passed. [2025-09-17T18:13:19.230008] [INFO ] [MAIN ] COLD: Fetched primary data is valid. [2025-09-17T18:13:19.230102] [DEBUG] [LOCAL ] COLD: Saving primary data. [2025-09-17T18:13:19.251102] [DEBUG] [LOCAL ] COLD: Trimmed 73817 records to 51890 (keeping 200 days of data) [2025-09-17T18:13:19.251977] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T18:13:19.580321] [DEBUG] [LOCAL ] COLD: Primary data saved (51890 records). [2025-09-17T18:13:19.580485] [INFO ] [MAIN ] COLD: Full history saved. [2025-09-17T18:13:19.581065] [INFO ] [MAIN ] Update Progress: 505/2371 symbols completed. COLD took 38.4s. Estimated remaining: 4h 30m 50s. Rate: 6.9 symbols/min [2025-09-17T18:13:19.620913] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-03. [2025-09-17T18:13:19.767064] [INFO ] [MAIN ] COP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:13:19.822743] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-17T18:13:19.822885] [INFO ] [MAIN ] COP: Loaded 53727 existing records. [2025-09-17T18:13:19.999590] [WARN ] [MAIN ] COP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:13:19.999878] [INFO ] [MAIN ] COP: Wiping existing primary data before full refresh. [2025-09-17T18:13:19.999925] [INFO ] [LOCAL ] COP: Starting deletion of primary data. [2025-09-17T18:13:20.001129] [DEBUG] [LOCAL ] COP: Deleted primary data file. [2025-09-17T18:13:20.001209] [INFO ] [MAIN ] COP: Starting full primary refresh. [2025-09-17T18:13:20.351311] [INFO ] [REMOTE ] COP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:13:20.415735] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-11. [2025-09-17T18:13:21.215832] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-05. [2025-09-17T18:13:21.256347] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T18:13:22.015757] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-04. [2025-09-17T18:13:22.439615] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T18:13:22.815801] [INFO ] [REMOTE ] COP: Fetching primary data for 2024-12. [2025-09-17T18:13:22.981101] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T18:13:23.221542] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-02 (4.41 seconds). [2025-09-17T18:13:23.615812] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-03. [2025-09-17T18:13:23.667740] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T18:13:24.415745] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-06. [2025-09-17T18:13:24.693124] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T18:13:24.799303] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T18:13:25.215771] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-01. [2025-09-17T18:13:25.959326] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T18:13:26.015817] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-07. [2025-09-17T18:13:26.822078] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-04. [2025-09-17T18:13:26.841482] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T18:13:27.615781] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-05. [2025-09-17T18:13:27.830679] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T18:13:27.880716] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T18:13:28.415781] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-08. [2025-09-17T18:13:28.964054] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T18:13:29.215887] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-02. [2025-09-17T18:13:30.015786] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-05. [2025-09-17T18:13:30.104540] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T18:13:30.815774] [INFO ] [REMOTE ] COMP: Fetching primary data for 2025-09. [2025-09-17T18:13:31.063929] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T18:13:31.117531] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T18:13:31.615772] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-03. [2025-09-17T18:13:32.415768] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-06. [2025-09-17T18:13:32.605089] [INFO ] [REMOTE ] COMP: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T18:13:32.612945] [INFO ] [REMOTE ] COMP: Full fetch complete (76872 records). [2025-09-17T18:13:32.613099] [DEBUG] [VALIDATOR ] COMP: Validating primary data. [2025-09-17T18:13:33.008837] [DEBUG] [VALIDATOR ] COMP: All expected trading days are present. [2025-09-17T18:13:33.008950] [DEBUG] [VALIDATOR ] COMP: Primary data validation passed. [2025-09-17T18:13:33.009828] [INFO ] [MAIN ] COMP: Fetched primary data is valid. [2025-09-17T18:13:33.009902] [DEBUG] [LOCAL ] COMP: Saving primary data. [2025-09-17T18:13:33.011391] [DEBUG] [LOCAL ] COMP: Trimmed 76872 records to 53381 (keeping 200 days of data) [2025-09-17T18:13:33.222217] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-06. [2025-09-17T18:13:33.338244] [DEBUG] [LOCAL ] COMP: Primary data saved (53381 records). [2025-09-17T18:13:33.338389] [INFO ] [MAIN ] COMP: Full history saved. [2025-09-17T18:13:33.338475] [INFO ] [MAIN ] Update Progress: 506/2371 symbols completed. COMP took 37.1s. Estimated remaining: 4h 30m 60s. Rate: 6.9 symbols/min [2025-09-17T18:13:33.507433] [INFO ] [MAIN ] COR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:13:33.553738] [DEBUG] [LOCAL ] COR: Loaded 47345 existing records from primary storage. [2025-09-17T18:13:33.553883] [INFO ] [MAIN ] COR: Loaded 47345 existing records. [2025-09-17T18:13:33.740874] [WARN ] [MAIN ] COR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:13:33.741370] [INFO ] [MAIN ] COR: Wiping existing primary data before full refresh. [2025-09-17T18:13:33.741500] [INFO ] [LOCAL ] COR: Starting deletion of primary data. [2025-09-17T18:13:33.742737] [DEBUG] [LOCAL ] COR: Deleted primary data file. [2025-09-17T18:13:33.742800] [INFO ] [MAIN ] COR: Starting full primary refresh. [2025-09-17T18:13:34.126108] [INFO ] [REMOTE ] COR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:13:34.126681] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-11. [2025-09-17T18:13:34.183505] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T18:13:34.197112] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-03 (2.58 seconds). [2025-09-17T18:13:34.391038] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T18:13:34.815782] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-04. [2025-09-17T18:13:35.615791] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-07. [2025-09-17T18:13:35.886446] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T18:13:36.415791] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-07. [2025-09-17T18:13:36.751169] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T18:13:36.872001] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T18:13:37.215761] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-05. [2025-09-17T18:13:37.954930] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T18:13:38.015721] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-08. [2025-09-17T18:13:38.815747] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-08. [2025-09-17T18:13:39.182622] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T18:13:39.395078] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-17T18:13:39.615801] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-06. [2025-09-17T18:13:40.271154] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T18:13:40.415740] [INFO ] [REMOTE ] CON: Fetching primary data for 2025-09. [2025-09-17T18:13:41.215739] [INFO ] [REMOTE ] COOK: Fetching primary data for 2025-09. [2025-09-17T18:13:41.303251] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T18:13:41.543111] [INFO ] [REMOTE ] CON: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T18:13:41.549635] [INFO ] [REMOTE ] CON: Full fetch complete (57311 records). [2025-09-17T18:13:41.549801] [DEBUG] [VALIDATOR ] CON: Validating primary data. [2025-09-17T18:13:41.983989] [DEBUG] [VALIDATOR ] CON: All expected trading days are present. [2025-09-17T18:13:41.984098] [DEBUG] [VALIDATOR ] CON: Primary data validation passed. [2025-09-17T18:13:41.984947] [INFO ] [MAIN ] CON: Fetched primary data is valid. [2025-09-17T18:13:41.985071] [DEBUG] [LOCAL ] CON: Saving primary data. [2025-09-17T18:13:41.986960] [DEBUG] [LOCAL ] CON: Trimmed 57311 records to 38889 (keeping 200 days of data) [2025-09-17T18:13:42.074224] [INFO ] [REMOTE ] COR: Fetching primary data for 2024-12. [2025-09-17T18:13:42.374025] [DEBUG] [LOCAL ] CON: Primary data saved (38889 records). [2025-09-17T18:13:42.374245] [INFO ] [MAIN ] CON: Full history saved. [2025-09-17T18:13:42.374394] [INFO ] [MAIN ] Update Progress: 507/2371 symbols completed. CON took 33.4s. Estimated remaining: 4h 30m 52s. Rate: 6.9 symbols/min [2025-09-17T18:13:42.491442] [INFO ] [REMOTE ] COOK: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T18:13:42.548249] [INFO ] [REMOTE ] COOK: Full fetch complete (32693 records). [2025-09-17T18:13:42.554327] [DEBUG] [VALIDATOR ] COOK: Validating primary data. [2025-09-17T18:13:42.749995] [INFO ] [MAIN ] COTY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:13:42.775056] [DEBUG] [LOCAL ] COTY: No existing data file found in primary storage. [2025-09-17T18:13:42.780916] [WARN ] [MAIN ] COTY: No existing data found, performing full refresh instead. [2025-09-17T18:13:42.821351] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-07. [2025-09-17T18:13:42.826946] [INFO ] [MAIN ] COTY: Wiping existing primary data before full refresh. [2025-09-17T18:13:42.861260] [INFO ] [LOCAL ] COTY: Starting deletion of primary data. [2025-09-17T18:13:42.940805] [DEBUG] [LOCAL ] COTY: No primary data file found to delete. [2025-09-17T18:13:42.970879] [INFO ] [MAIN ] COTY: Starting full primary refresh. [2025-09-17T18:13:43.221400] [DEBUG] [VALIDATOR ] COOK: All expected trading days are present. [2025-09-17T18:13:43.237867] [DEBUG] [VALIDATOR ] COOK: Primary data validation passed. [2025-09-17T18:13:43.265593] [INFO ] [MAIN ] COOK: Fetched primary data is valid. [2025-09-17T18:13:43.334078] [DEBUG] [LOCAL ] COOK: Saving primary data. [2025-09-17T18:13:43.390487] [DEBUG] [LOCAL ] COOK: Trimmed 32693 records to 24122 (keeping 200 days of data) [2025-09-17T18:13:43.496679] [INFO ] [REMOTE ] COTY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:13:43.589780] [DEBUG] [LOCAL ] COOK: Primary data saved (24122 records). [2025-09-17T18:13:43.589918] [INFO ] [MAIN ] COOK: Full history saved. [2025-09-17T18:13:43.590004] [INFO ] [MAIN ] Update Progress: 508/2371 symbols completed. COOK took 33.1s. Estimated remaining: 4h 30m 16s. Rate: 6.9 symbols/min [2025-09-17T18:13:43.621585] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-11. [2025-09-17T18:13:43.764019] [INFO ] [MAIN ] COUR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:13:43.812281] [DEBUG] [LOCAL ] COUR: Loaded 48849 existing records from primary storage. [2025-09-17T18:13:43.812451] [INFO ] [MAIN ] COUR: Loaded 48849 existing records. [2025-09-17T18:13:43.989970] [WARN ] [MAIN ] COUR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:13:43.990258] [INFO ] [MAIN ] COUR: Wiping existing primary data before full refresh. [2025-09-17T18:13:43.990307] [INFO ] [LOCAL ] COUR: Starting deletion of primary data. [2025-09-17T18:13:43.991227] [DEBUG] [LOCAL ] COUR: Deleted primary data file. [2025-09-17T18:13:43.991277] [INFO ] [MAIN ] COUR: Starting full primary refresh. [2025-09-17T18:13:44.181344] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-17T18:13:44.389800] [INFO ] [REMOTE ] COUR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:13:44.415727] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-11. [2025-09-17T18:13:45.064179] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-17T18:13:45.107600] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T18:13:45.215773] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-01. [2025-09-17T18:13:46.015765] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-08. [2025-09-17T18:13:46.100971] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T18:13:46.725188] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T18:13:46.815804] [INFO ] [REMOTE ] COTY: Fetching primary data for 2024-12. [2025-09-17T18:13:47.615836] [INFO ] [REMOTE ] COUR: Fetching primary data for 2024-12. [2025-09-17T18:13:47.981869] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T18:13:48.415821] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-02. [2025-09-17T18:13:48.595400] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T18:13:49.215789] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-01. [2025-09-17T18:13:49.297041] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T18:13:49.790565] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T18:13:50.015812] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-03. [2025-09-17T18:13:50.815780] [INFO ] [REMOTE ] COP: Fetching primary data for 2025-09. [2025-09-17T18:13:50.956759] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T18:13:51.405541] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T18:13:51.615807] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-04. [2025-09-17T18:13:52.415809] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-02. [2025-09-17T18:13:52.447937] [INFO ] [REMOTE ] COP: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T18:13:52.455183] [INFO ] [REMOTE ] COP: Full fetch complete (77626 records). [2025-09-17T18:13:52.455316] [DEBUG] [VALIDATOR ] COP: Validating primary data. [2025-09-17T18:13:52.851363] [DEBUG] [VALIDATOR ] COP: All expected trading days are present. [2025-09-17T18:13:52.851447] [DEBUG] [VALIDATOR ] COP: Primary data validation passed. [2025-09-17T18:13:52.852293] [INFO ] [MAIN ] COP: Fetched primary data is valid. [2025-09-17T18:13:52.852359] [DEBUG] [LOCAL ] COP: Saving primary data. [2025-09-17T18:13:52.855469] [DEBUG] [LOCAL ] COP: Trimmed 77626 records to 53727 (keeping 200 days of data) [2025-09-17T18:13:53.197996] [DEBUG] [LOCAL ] COP: Primary data saved (53727 records). [2025-09-17T18:13:53.198156] [INFO ] [MAIN ] COP: Full history saved. [2025-09-17T18:13:53.199341] [INFO ] [MAIN ] Update Progress: 509/2371 symbols completed. COP took 33.6s. Estimated remaining: 4h 30m 10s. Rate: 6.9 symbols/min [2025-09-17T18:13:53.221066] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-01. [2025-09-17T18:13:53.380889] [INFO ] [MAIN ] CP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:13:53.447163] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T18:13:53.474408] [DEBUG] [LOCAL ] CP: Loaded 53294 existing records from primary storage. [2025-09-17T18:13:53.474574] [INFO ] [MAIN ] CP: Loaded 53294 existing records. [2025-09-17T18:13:53.658247] [WARN ] [MAIN ] CP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:13:53.658637] [INFO ] [MAIN ] CP: Wiping existing primary data before full refresh. [2025-09-17T18:13:53.658723] [INFO ] [LOCAL ] CP: Starting deletion of primary data. [2025-09-17T18:13:53.659725] [DEBUG] [LOCAL ] CP: Deleted primary data file. [2025-09-17T18:13:53.659783] [INFO ] [MAIN ] CP: Starting full primary refresh. [2025-09-17T18:13:53.817190] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T18:13:54.024029] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-03. [2025-09-17T18:13:54.063185] [INFO ] [REMOTE ] CP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:13:54.815836] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-11. [2025-09-17T18:13:55.043939] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T18:13:55.615818] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-02. [2025-09-17T18:13:55.973147] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T18:13:56.415813] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-04. [2025-09-17T18:13:56.592803] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T18:13:57.216148] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-05. [2025-09-17T18:13:57.262882] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T18:13:58.015773] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-03. [2025-09-17T18:13:58.067085] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T18:13:58.815807] [INFO ] [REMOTE ] CP: Fetching primary data for 2024-12. [2025-09-17T18:13:59.023607] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T18:13:59.583020] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T18:13:59.615768] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-04. [2025-09-17T18:14:00.415829] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-06. [2025-09-17T18:14:00.625769] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T18:14:01.215805] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-01. [2025-09-17T18:14:01.570369] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T18:14:02.015777] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-05. [2025-09-17T18:14:02.181576] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T18:14:02.815865] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-07. [2025-09-17T18:14:03.069466] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T18:14:03.511283] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T18:14:03.615807] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-05. [2025-09-17T18:14:04.415807] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-02. [2025-09-17T18:14:04.476729] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T18:14:05.085561] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T18:14:05.215738] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-06. [2025-09-17T18:14:06.015768] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-08. [2025-09-17T18:14:06.144564] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T18:14:06.718856] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T18:14:06.815749] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-07. [2025-09-17T18:14:07.594551] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T18:14:07.615731] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-06. [2025-09-17T18:14:08.415775] [INFO ] [REMOTE ] COR: Fetching primary data for 2025-09. [2025-09-17T18:14:09.119280] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T18:14:09.220867] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-07. [2025-09-17T18:14:09.233831] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-17T18:14:10.015775] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-03. [2025-09-17T18:14:10.068551] [INFO ] [REMOTE ] COR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T18:14:10.074753] [INFO ] [REMOTE ] COR: Full fetch complete (68716 records). [2025-09-17T18:14:10.074876] [DEBUG] [VALIDATOR ] COR: Validating primary data. [2025-09-17T18:14:10.463906] [DEBUG] [VALIDATOR ] COR: All expected trading days are present. [2025-09-17T18:14:10.463986] [DEBUG] [VALIDATOR ] COR: Primary data validation passed. [2025-09-17T18:14:10.464763] [INFO ] [MAIN ] COR: Fetched primary data is valid. [2025-09-17T18:14:10.464807] [DEBUG] [LOCAL ] COR: Saving primary data. [2025-09-17T18:14:10.466146] [DEBUG] [LOCAL ] COR: Trimmed 68716 records to 47343 (keeping 200 days of data) [2025-09-17T18:14:10.778167] [DEBUG] [LOCAL ] COR: Primary data saved (47343 records). [2025-09-17T18:14:10.778372] [INFO ] [MAIN ] COR: Full history saved. [2025-09-17T18:14:10.778556] [INFO ] [MAIN ] Update Progress: 510/2371 symbols completed. COR took 37.4s. Estimated remaining: 4h 30m 34s. Rate: 6.9 symbols/min [2025-09-17T18:14:10.821636] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-08. [2025-09-17T18:14:10.961401] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T18:14:10.993936] [INFO ] [MAIN ] CPA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:14:11.024505] [DEBUG] [LOCAL ] CPA: Loaded 29179 existing records from primary storage. [2025-09-17T18:14:11.024662] [INFO ] [MAIN ] CPA: Loaded 29179 existing records. [2025-09-17T18:14:11.201927] [WARN ] [MAIN ] CPA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:14:11.202180] [INFO ] [MAIN ] CPA: Wiping existing primary data before full refresh. [2025-09-17T18:14:11.202225] [INFO ] [LOCAL ] CPA: Starting deletion of primary data. [2025-09-17T18:14:11.202933] [DEBUG] [LOCAL ] CPA: Deleted primary data file. [2025-09-17T18:14:11.202980] [INFO ] [MAIN ] CPA: Starting full primary refresh. [2025-09-17T18:14:11.602230] [INFO ] [REMOTE ] CPA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:14:11.620853] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-11. [2025-09-17T18:14:11.637076] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T18:14:12.338265] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T18:14:12.415783] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-04. [2025-09-17T18:14:13.073967] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T18:14:13.215785] [INFO ] [REMOTE ] CPA: Fetching primary data for 2024-12. [2025-09-17T18:14:14.015856] [INFO ] [REMOTE ] COUR: Fetching primary data for 2025-09. [2025-09-17T18:14:14.379737] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T18:14:14.450579] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T18:14:14.815789] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-08. [2025-09-17T18:14:15.615797] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-01. [2025-09-17T18:14:15.749375] [INFO ] [REMOTE ] COUR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T18:14:15.759615] [INFO ] [REMOTE ] COUR: Full fetch complete (70783 records). [2025-09-17T18:14:15.759845] [DEBUG] [VALIDATOR ] COUR: Validating primary data. [2025-09-17T18:14:16.174636] [DEBUG] [VALIDATOR ] COUR: All expected trading days are present. [2025-09-17T18:14:16.174751] [DEBUG] [VALIDATOR ] COUR: Primary data validation passed. [2025-09-17T18:14:16.175544] [INFO ] [MAIN ] COUR: Fetched primary data is valid. [2025-09-17T18:14:16.175614] [DEBUG] [LOCAL ] COUR: Saving primary data. [2025-09-17T18:14:16.177183] [DEBUG] [LOCAL ] COUR: Trimmed 70783 records to 48861 (keeping 200 days of data) [2025-09-17T18:14:16.434584] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-05. [2025-09-17T18:14:16.468522] [DEBUG] [LOCAL ] COUR: Primary data saved (48861 records). [2025-09-17T18:14:16.468668] [INFO ] [MAIN ] COUR: Full history saved. [2025-09-17T18:14:16.469833] [INFO ] [MAIN ] Update Progress: 511/2371 symbols completed. COUR took 32.9s. Estimated remaining: 4h 30m 14s. Rate: 6.9 symbols/min [2025-09-17T18:14:16.644605] [INFO ] [MAIN ] CPAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:14:16.645066] [DEBUG] [LOCAL ] CPAC: No existing data file found in primary storage. [2025-09-17T18:14:16.645140] [WARN ] [MAIN ] CPAC: No existing data found, performing full refresh instead. [2025-09-17T18:14:16.645391] [INFO ] [MAIN ] CPAC: Wiping existing primary data before full refresh. [2025-09-17T18:14:16.645444] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-17T18:14:16.645487] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-17T18:14:16.645693] [INFO ] [MAIN ] CPAC: Starting full primary refresh. [2025-09-17T18:14:17.132508] [INFO ] [REMOTE ] CPAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:14:17.138983] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-17T18:14:17.169356] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T18:14:17.215772] [INFO ] [REMOTE ] COTY: Fetching primary data for 2025-09. [2025-09-17T18:14:17.988270] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T18:14:18.015756] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-02. [2025-09-17T18:14:18.815822] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-11. [2025-09-17T18:14:19.216094] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-17T18:14:19.236584] [INFO ] [REMOTE ] COTY: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-17T18:14:19.243804] [INFO ] [REMOTE ] COTY: Full fetch complete (76946 records). [2025-09-17T18:14:19.243995] [DEBUG] [VALIDATOR ] COTY: Validating primary data. [2025-09-17T18:14:19.445870] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T18:14:19.623268] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-06. [2025-09-17T18:14:19.672025] [DEBUG] [VALIDATOR ] COTY: All expected trading days are present. [2025-09-17T18:14:19.672116] [DEBUG] [VALIDATOR ] COTY: Primary data validation passed. [2025-09-17T18:14:19.673055] [INFO ] [MAIN ] COTY: Fetched primary data is valid. [2025-09-17T18:14:19.673113] [DEBUG] [LOCAL ] COTY: Saving primary data. [2025-09-17T18:14:19.675340] [DEBUG] [LOCAL ] COTY: Trimmed 76946 records to 53266 (keeping 200 days of data) [2025-09-17T18:14:19.983510] [DEBUG] [LOCAL ] COTY: Primary data saved (53266 records). [2025-09-17T18:14:19.983701] [INFO ] [MAIN ] COTY: Full history saved. [2025-09-17T18:14:19.983790] [INFO ] [MAIN ] Update Progress: 512/2371 symbols completed. COTY took 37.6s. Estimated remaining: 4h 29m 47s. Rate: 6.9 symbols/min [2025-09-17T18:14:20.155586] [INFO ] [MAIN ] CPAY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:14:20.187549] [DEBUG] [LOCAL ] CPAY: Loaded 31348 existing records from primary storage. [2025-09-17T18:14:20.187730] [INFO ] [MAIN ] CPAY: Loaded 31348 existing records. [2025-09-17T18:14:20.370016] [WARN ] [MAIN ] CPAY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:14:20.370805] [INFO ] [MAIN ] CPAY: Wiping existing primary data before full refresh. [2025-09-17T18:14:20.370976] [INFO ] [LOCAL ] CPAY: Starting deletion of primary data. [2025-09-17T18:14:20.371997] [DEBUG] [LOCAL ] CPAY: Deleted primary data file. [2025-09-17T18:14:20.372046] [INFO ] [MAIN ] CPAY: Starting full primary refresh. [2025-09-17T18:14:20.427157] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2024-12. [2025-09-17T18:14:20.729696] [INFO ] [REMOTE ] CPAY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:14:20.939390] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T18:14:21.215775] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-03. [2025-09-17T18:14:21.442398] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T18:14:22.015824] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-07. [2025-09-17T18:14:22.820881] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-01. [2025-09-17T18:14:22.838051] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T18:14:23.615809] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-11. [2025-09-17T18:14:23.801186] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T18:14:23.848040] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T18:14:24.415838] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-02. [2025-09-17T18:14:25.215807] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-08. [2025-09-17T18:14:26.015815] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-04. [2025-09-17T18:14:26.283233] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T18:14:26.303457] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-11 (2.69 seconds). [2025-09-17T18:14:26.815778] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-03. [2025-09-17T18:14:27.223916] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-17T18:14:27.615786] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2024-12. [2025-09-17T18:14:27.954718] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-17T18:14:28.415803] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-04. [2025-09-17T18:14:28.630134] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-17T18:14:28.858596] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T18:14:29.215802] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-05. [2025-09-17T18:14:29.546068] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T18:14:29.763110] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T18:14:30.015804] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-05. [2025-09-17T18:14:30.815788] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-01. [2025-09-17T18:14:31.559595] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T18:14:31.615797] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-06. [2025-09-17T18:14:31.985297] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T18:14:32.222944] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T18:14:32.415797] [INFO ] [REMOTE ] CP: Fetching primary data for 2025-09. [2025-09-17T18:14:33.215829] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-07. [2025-09-17T18:14:33.660515] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T18:14:34.015802] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-08. [2025-09-17T18:14:34.136972] [INFO ] [REMOTE ] CP: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T18:14:34.143826] [INFO ] [REMOTE ] CP: Full fetch complete (77010 records). [2025-09-17T18:14:34.144038] [DEBUG] [VALIDATOR ] CP: Validating primary data. [2025-09-17T18:14:34.328132] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-17T18:14:34.574552] [DEBUG] [VALIDATOR ] CP: All expected trading days are present. [2025-09-17T18:14:34.574686] [DEBUG] [VALIDATOR ] CP: Primary data validation passed. [2025-09-17T18:14:34.575676] [INFO ] [MAIN ] CP: Fetched primary data is valid. [2025-09-17T18:14:34.575734] [DEBUG] [LOCAL ] CP: Saving primary data. [2025-09-17T18:14:34.577453] [DEBUG] [LOCAL ] CP: Trimmed 77010 records to 53294 (keeping 200 days of data) [2025-09-17T18:14:34.841077] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-02. [2025-09-17T18:14:35.060392] [DEBUG] [LOCAL ] CP: Primary data saved (53294 records). [2025-09-17T18:14:35.060593] [INFO ] [MAIN ] CP: Full history saved. [2025-09-17T18:14:35.061796] [INFO ] [MAIN ] Update Progress: 513/2371 symbols completed. CP took 41.9s. Estimated remaining: 4h 30m 1s. Rate: 6.9 symbols/min [2025-09-17T18:14:35.311402] [INFO ] [MAIN ] CPF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:14:35.337406] [DEBUG] [LOCAL ] CPF: Loaded 15552 existing records from primary storage. [2025-09-17T18:14:35.337609] [INFO ] [MAIN ] CPF: Loaded 15552 existing records. [2025-09-17T18:14:35.570940] [WARN ] [MAIN ] CPF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:14:35.571197] [INFO ] [MAIN ] CPF: Wiping existing primary data before full refresh. [2025-09-17T18:14:35.571255] [INFO ] [LOCAL ] CPF: Starting deletion of primary data. [2025-09-17T18:14:35.571774] [DEBUG] [LOCAL ] CPF: Deleted primary data file. [2025-09-17T18:14:35.571835] [INFO ] [MAIN ] CPF: Starting full primary refresh. [2025-09-17T18:14:35.621022] [INFO ] [REMOTE ] CPAC: Fetching primary data for 2025-09. [2025-09-17T18:14:35.984029] [INFO ] [REMOTE ] CPF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:14:36.159743] [INFO ] [REMOTE ] CPAC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T18:14:36.160601] [INFO ] [REMOTE ] CPAC: Full fetch complete (1899 records). [2025-09-17T18:14:36.160690] [DEBUG] [VALIDATOR ] CPAC: Validating primary data. [2025-09-17T18:14:36.343043] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T18:14:36.372912] [WARN ] [VALIDATOR ] CPAC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T18:14:36.373790] [FATAL] [MAIN ] CPAC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:14:36.373861] [WARN ] [MAIN ] CPAC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:14:36.373904] [INFO ] [LOCAL ] CPAC: Starting deletion of primary data. [2025-09-17T18:14:36.373963] [DEBUG] [LOCAL ] CPAC: No primary data file found to delete. [2025-09-17T18:14:36.374001] [INFO ] [LOCAL ] CPAC: Starting deletion of derivative data. [2025-09-17T18:14:36.374039] [DEBUG] [LOCAL ] CPAC: No derivative data file found to delete. [2025-09-17T18:14:36.374100] [INFO ] [MAIN ] Update Progress: 514/2371 symbols completed. CPAC took 19.9s. Estimated remaining: 4h 29m 26s. Rate: 6.9 symbols/min [2025-09-17T18:14:36.420843] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-06. [2025-09-17T18:14:36.552918] [INFO ] [MAIN ] CPK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:14:36.571259] [DEBUG] [LOCAL ] CPK: Loaded 13129 existing records from primary storage. [2025-09-17T18:14:36.571392] [INFO ] [MAIN ] CPK: Loaded 13129 existing records. [2025-09-17T18:14:36.751126] [WARN ] [MAIN ] CPK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:14:36.751454] [INFO ] [MAIN ] CPK: Wiping existing primary data before full refresh. [2025-09-17T18:14:36.751510] [INFO ] [LOCAL ] CPK: Starting deletion of primary data. [2025-09-17T18:14:36.751945] [DEBUG] [LOCAL ] CPK: Deleted primary data file. [2025-09-17T18:14:36.751991] [INFO ] [MAIN ] CPK: Starting full primary refresh. [2025-09-17T18:14:37.126340] [INFO ] [REMOTE ] CPK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:14:37.215813] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-11. [2025-09-17T18:14:37.797827] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T18:14:38.015779] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-11. [2025-09-17T18:14:38.056240] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T18:14:38.815768] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-03. [2025-09-17T18:14:39.040086] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T18:14:39.615841] [INFO ] [REMOTE ] CPF: Fetching primary data for 2024-12. [2025-09-17T18:14:40.028506] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T18:14:40.415803] [INFO ] [REMOTE ] CPK: Fetching primary data for 2024-12. [2025-09-17T18:14:40.806070] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T18:14:41.219887] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-04. [2025-09-17T18:14:41.223122] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T18:14:42.015780] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-01. [2025-09-17T18:14:42.643180] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T18:14:42.815780] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-01. [2025-09-17T18:14:43.110508] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T18:14:43.615844] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-05. [2025-09-17T18:14:43.671970] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T18:14:44.415779] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-07. [2025-09-17T18:14:44.872364] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T18:14:45.215828] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-06. [2025-09-17T18:14:45.719695] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T18:14:46.015825] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-08. [2025-09-17T18:14:46.515092] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T18:14:46.815781] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-07. [2025-09-17T18:14:47.359750] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T18:14:47.615700] [INFO ] [REMOTE ] CPA: Fetching primary data for 2025-09. [2025-09-17T18:14:47.681702] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T18:14:48.415808] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-02. [2025-09-17T18:14:48.899567] [INFO ] [REMOTE ] CPA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T18:14:48.903405] [INFO ] [REMOTE ] CPA: Full fetch complete (42402 records). [2025-09-17T18:14:48.903501] [DEBUG] [VALIDATOR ] CPA: Validating primary data. [2025-09-17T18:14:49.220909] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-02. [2025-09-17T18:14:49.290196] [DEBUG] [VALIDATOR ] CPA: All expected trading days are present. [2025-09-17T18:14:49.290301] [DEBUG] [VALIDATOR ] CPA: Primary data validation passed. [2025-09-17T18:14:49.290965] [INFO ] [MAIN ] CPA: Fetched primary data is valid. [2025-09-17T18:14:49.291038] [DEBUG] [LOCAL ] CPA: Saving primary data. [2025-09-17T18:14:49.292415] [DEBUG] [LOCAL ] CPA: Trimmed 42402 records to 29179 (keeping 200 days of data) [2025-09-17T18:14:49.414260] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T18:14:49.492627] [DEBUG] [LOCAL ] CPA: Primary data saved (29179 records). [2025-09-17T18:14:49.492778] [INFO ] [MAIN ] CPA: Full history saved. [2025-09-17T18:14:49.492860] [INFO ] [MAIN ] Update Progress: 515/2371 symbols completed. CPA took 38.7s. Estimated remaining: 4h 29m 33s. Rate: 6.9 symbols/min [2025-09-17T18:14:49.671137] [INFO ] [MAIN ] CPNG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:14:49.723089] [DEBUG] [LOCAL ] CPNG: Loaded 53671 existing records from primary storage. [2025-09-17T18:14:49.723257] [INFO ] [MAIN ] CPNG: Loaded 53671 existing records. [2025-09-17T18:14:49.908166] [WARN ] [MAIN ] CPNG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:14:49.908405] [INFO ] [MAIN ] CPNG: Wiping existing primary data before full refresh. [2025-09-17T18:14:49.908452] [INFO ] [LOCAL ] CPNG: Starting deletion of primary data. [2025-09-17T18:14:49.909513] [DEBUG] [LOCAL ] CPNG: Deleted primary data file. [2025-09-17T18:14:49.909587] [INFO ] [MAIN ] CPNG: Starting full primary refresh. [2025-09-17T18:14:50.020952] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-03. [2025-09-17T18:14:50.245473] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T18:14:50.282685] [INFO ] [REMOTE ] CPNG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:14:50.815805] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-08. [2025-09-17T18:14:51.120326] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T18:14:51.615796] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-04. [2025-09-17T18:14:52.205922] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T18:14:52.415875] [INFO ] [REMOTE ] CPAY: Fetching primary data for 2025-09. [2025-09-17T18:14:52.643074] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T18:14:53.215833] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-03. [2025-09-17T18:14:53.359339] [INFO ] [REMOTE ] CPAY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T18:14:53.363321] [INFO ] [REMOTE ] CPAY: Full fetch complete (45290 records). [2025-09-17T18:14:53.363412] [DEBUG] [VALIDATOR ] CPAY: Validating primary data. [2025-09-17T18:14:53.765887] [DEBUG] [VALIDATOR ] CPAY: All expected trading days are present. [2025-09-17T18:14:53.765973] [DEBUG] [VALIDATOR ] CPAY: Primary data validation passed. [2025-09-17T18:14:53.766547] [INFO ] [MAIN ] CPAY: Fetched primary data is valid. [2025-09-17T18:14:53.766593] [DEBUG] [LOCAL ] CPAY: Saving primary data. [2025-09-17T18:14:53.767700] [DEBUG] [LOCAL ] CPAY: Trimmed 45290 records to 31370 (keeping 200 days of data) [2025-09-17T18:14:53.965970] [DEBUG] [LOCAL ] CPAY: Primary data saved (31370 records). [2025-09-17T18:14:53.966138] [INFO ] [MAIN ] CPAY: Full history saved. [2025-09-17T18:14:53.966242] [INFO ] [MAIN ] Update Progress: 516/2371 symbols completed. CPAY took 34.0s. Estimated remaining: 4h 29m 9s. Rate: 6.9 symbols/min [2025-09-17T18:14:54.023586] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-11. [2025-09-17T18:14:54.149005] [INFO ] [MAIN ] CPRI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:14:54.160394] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T18:14:54.217057] [DEBUG] [LOCAL ] CPRI: Loaded 52592 existing records from primary storage. [2025-09-17T18:14:54.217301] [INFO ] [MAIN ] CPRI: Loaded 52592 existing records. [2025-09-17T18:14:54.393340] [WARN ] [MAIN ] CPRI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:14:54.393608] [INFO ] [MAIN ] CPRI: Wiping existing primary data before full refresh. [2025-09-17T18:14:54.393672] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-17T18:14:54.394596] [DEBUG] [LOCAL ] CPRI: Deleted primary data file. [2025-09-17T18:14:54.394665] [INFO ] [MAIN ] CPRI: Starting full primary refresh. [2025-09-17T18:14:54.751817] [INFO ] [REMOTE ] CPRI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:14:54.815752] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-11. [2025-09-17T18:14:55.615820] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-04. [2025-09-17T18:14:56.424437] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-05. [2025-09-17T18:14:56.426897] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-11 (2.40 seconds). [2025-09-17T18:14:56.844729] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-17T18:14:56.867071] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T18:14:57.215781] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-05. [2025-09-17T18:14:57.334158] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T18:14:58.015824] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2024-12. [2025-09-17T18:14:58.071454] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T18:14:58.815835] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-06. [2025-09-17T18:14:59.615836] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-06. [2025-09-17T18:14:59.707354] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T18:14:59.737803] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T18:15:00.415834] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-07. [2025-09-17T18:15:00.570030] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T18:15:01.215822] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-01. [2025-09-17T18:15:01.312732] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T18:15:02.015801] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-08. [2025-09-17T18:15:02.815837] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-07. [2025-09-17T18:15:02.881068] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T18:15:02.997167] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T18:15:03.615803] [INFO ] [REMOTE ] CPK: Fetching primary data for 2025-09. [2025-09-17T18:15:03.661788] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T18:15:04.415818] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-02. [2025-09-17T18:15:04.675007] [INFO ] [REMOTE ] CPK: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T18:15:04.676858] [INFO ] [REMOTE ] CPK: Full fetch complete (17366 records). [2025-09-17T18:15:04.676934] [DEBUG] [VALIDATOR ] CPK: Validating primary data. [2025-09-17T18:15:05.048567] [DEBUG] [VALIDATOR ] CPK: All expected trading days are present. [2025-09-17T18:15:05.048668] [DEBUG] [VALIDATOR ] CPK: Primary data validation passed. [2025-09-17T18:15:05.049073] [INFO ] [MAIN ] CPK: Fetched primary data is valid. [2025-09-17T18:15:05.049114] [DEBUG] [LOCAL ] CPK: Saving primary data. [2025-09-17T18:15:05.049706] [DEBUG] [LOCAL ] CPK: Trimmed 17366 records to 13134 (keeping 200 days of data) [2025-09-17T18:15:05.134739] [DEBUG] [LOCAL ] CPK: Primary data saved (13134 records). [2025-09-17T18:15:05.134909] [INFO ] [MAIN ] CPK: Full history saved. [2025-09-17T18:15:05.134996] [INFO ] [MAIN ] Update Progress: 517/2371 symbols completed. CPK took 28.8s. Estimated remaining: 4h 29m 9s. Rate: 6.9 symbols/min [2025-09-17T18:15:05.215809] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2024-12. [2025-09-17T18:15:06.015826] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-08. [2025-09-17T18:15:06.131227] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T18:15:06.815824] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-03. [2025-09-17T18:15:06.972782] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T18:15:07.276958] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-17T18:15:07.615844] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-01. [2025-09-17T18:15:08.415949] [INFO ] [REMOTE ] CPF: Fetching primary data for 2025-09. [2025-09-17T18:15:08.725543] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T18:15:09.215826] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-04. [2025-09-17T18:15:09.457899] [INFO ] [REMOTE ] CPF: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T18:15:09.460488] [INFO ] [REMOTE ] CPF: Full fetch complete (24299 records). [2025-09-17T18:15:09.460596] [DEBUG] [VALIDATOR ] CPF: Validating primary data. [2025-09-17T18:15:09.854290] [DEBUG] [VALIDATOR ] CPF: All expected trading days are present. [2025-09-17T18:15:09.854391] [DEBUG] [VALIDATOR ] CPF: Primary data validation passed. [2025-09-17T18:15:09.854911] [INFO ] [MAIN ] CPF: Fetched primary data is valid. [2025-09-17T18:15:09.854990] [DEBUG] [LOCAL ] CPF: Saving primary data. [2025-09-17T18:15:09.855955] [DEBUG] [LOCAL ] CPF: Trimmed 24299 records to 15587 (keeping 200 days of data) [2025-09-17T18:15:09.961174] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-01 (2.35 seconds). [2025-09-17T18:15:09.998165] [DEBUG] [LOCAL ] CPF: Primary data saved (15587 records). [2025-09-17T18:15:09.998316] [INFO ] [MAIN ] CPF: Full history saved. [2025-09-17T18:15:09.998423] [INFO ] [MAIN ] Update Progress: 518/2371 symbols completed. CPF took 34.9s. Estimated remaining: 4h 28m 46s. Rate: 6.9 symbols/min [2025-09-17T18:15:10.015733] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-02. [2025-09-17T18:15:10.853398] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T18:15:10.865131] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-05. [2025-09-17T18:15:12.157465] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-02 (2.14 seconds). [2025-09-17T18:15:12.167935] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-03. [2025-09-17T18:15:12.654035] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T18:15:12.666361] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-06. [2025-09-17T18:15:14.250313] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T18:15:14.262810] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-04. [2025-09-17T18:15:14.303153] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T18:15:14.316569] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-07. [2025-09-17T18:15:16.147686] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T18:15:16.159997] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-08. [2025-09-17T18:15:16.551277] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-17T18:15:16.562953] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-05. [2025-09-17T18:15:17.695308] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T18:15:17.706844] [INFO ] [REMOTE ] CPRI: Fetching primary data for 2025-09. [2025-09-17T18:15:19.298663] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-09-17T18:15:19.311154] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-06. [2025-09-17T18:15:19.553947] [INFO ] [REMOTE ] CPRI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T18:15:19.560583] [INFO ] [REMOTE ] CPRI: Full fetch complete (75655 records). [2025-09-17T18:15:19.560751] [DEBUG] [VALIDATOR ] CPRI: Validating primary data. [2025-09-17T18:15:19.561508] [FATAL] [VALIDATOR ] CPRI: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:15:19.561593] [FATAL] [MAIN ] CPRI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:15:19.561630] [WARN ] [MAIN ] CPRI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:15:19.561724] [INFO ] [LOCAL ] CPRI: Starting deletion of primary data. [2025-09-17T18:15:19.561791] [DEBUG] [LOCAL ] CPRI: No primary data file found to delete. [2025-09-17T18:15:19.561827] [INFO ] [LOCAL ] CPRI: Starting deletion of derivative data. [2025-09-17T18:15:19.562205] [DEBUG] [LOCAL ] CPRI: Deleted derivative data file. [2025-09-17T18:15:19.562298] [INFO ] [MAIN ] Update Progress: 519/2371 symbols completed. CPRI took 25.6s. Estimated remaining: 4h 28m 41s. Rate: 6.9 symbols/min [2025-09-17T18:15:21.556231] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T18:15:21.567680] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-07. [2025-09-17T18:15:23.543445] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T18:15:23.557501] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-08. [2025-09-17T18:15:25.927126] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-08 (2.37 seconds). [2025-09-17T18:15:25.939380] [INFO ] [REMOTE ] CPNG: Fetching primary data for 2025-09. [2025-09-17T18:15:28.392522] [INFO ] [REMOTE ] CPNG: Incremental fetch complete for 2025-09 (2.45 seconds). [2025-09-17T18:15:28.399843] [INFO ] [REMOTE ] CPNG: Full fetch complete (77556 records). [2025-09-17T18:15:28.399984] [DEBUG] [VALIDATOR ] CPNG: Validating primary data. [2025-09-17T18:15:28.813969] [DEBUG] [VALIDATOR ] CPNG: All expected trading days are present. [2025-09-17T18:15:28.814101] [DEBUG] [VALIDATOR ] CPNG: Primary data validation passed. [2025-09-17T18:15:28.815094] [INFO ] [MAIN ] CPNG: Fetched primary data is valid. [2025-09-17T18:15:28.815150] [DEBUG] [LOCAL ] CPNG: Saving primary data. [2025-09-17T18:15:28.816930] [DEBUG] [LOCAL ] CPNG: Trimmed 77556 records to 53671 (keeping 200 days of data) [2025-09-17T18:15:29.140374] [DEBUG] [LOCAL ] CPNG: Primary data saved (53671 records). [2025-09-17T18:15:29.140515] [INFO ] [MAIN ] CPNG: Full history saved. [2025-09-17T18:15:29.140621] [INFO ] [MAIN ] Update Progress: 520/2371 symbols completed. CPNG took 39.6s. Estimated remaining: 4h 28m 35s. Rate: 6.9 symbols/min [2025-09-17T18:15:29.751933] [INFO ] [MAIN ] CPS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:15:29.751028] [INFO ] [MAIN ] CPT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:15:29.820471] [INFO ] [MAIN ] CR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:15:29.852278] [INFO ] [MAIN ] CQP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:15:29.919707] [DEBUG] [LOCAL ] CQP: Loaded 20155 existing records from primary storage. [2025-09-17T18:15:29.921296] [INFO ] [MAIN ] CQP: Loaded 20155 existing records. [2025-09-17T18:15:29.927339] [DEBUG] [LOCAL ] CR: Loaded 24734 existing records from primary storage. [2025-09-17T18:15:29.959065] [INFO ] [MAIN ] CR: Loaded 24734 existing records. [2025-09-17T18:15:30.063682] [DEBUG] [LOCAL ] CPS: Loaded 26379 existing records from primary storage. [2025-09-17T18:15:30.117387] [DEBUG] [LOCAL ] CPT: Loaded 44332 existing records from primary storage. [2025-09-17T18:15:30.146055] [INFO ] [MAIN ] CPS: Loaded 26379 existing records. [2025-09-17T18:15:30.151279] [INFO ] [MAIN ] CPT: Loaded 44332 existing records. [2025-09-17T18:15:30.501333] [WARN ] [MAIN ] CR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:15:30.556674] [INFO ] [MAIN ] CR: Wiping existing primary data before full refresh. [2025-09-17T18:15:30.575846] [INFO ] [LOCAL ] CR: Starting deletion of primary data. [2025-09-17T18:15:30.565554] [WARN ] [MAIN ] CQP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:15:30.592010] [DEBUG] [LOCAL ] CR: Deleted primary data file. [2025-09-17T18:15:30.592204] [INFO ] [MAIN ] CR: Starting full primary refresh. [2025-09-17T18:15:30.592084] [INFO ] [MAIN ] CQP: Wiping existing primary data before full refresh. [2025-09-17T18:15:30.634051] [INFO ] [LOCAL ] CQP: Starting deletion of primary data. [2025-09-17T18:15:30.727604] [DEBUG] [LOCAL ] CQP: Deleted primary data file. [2025-09-17T18:15:30.727747] [INFO ] [MAIN ] CQP: Starting full primary refresh. [2025-09-17T18:15:30.726782] [WARN ] [MAIN ] CPS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:15:30.826300] [INFO ] [MAIN ] CPS: Wiping existing primary data before full refresh. [2025-09-17T18:15:30.815098] [WARN ] [MAIN ] CPT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:15:30.861120] [INFO ] [MAIN ] CPT: Wiping existing primary data before full refresh. [2025-09-17T18:15:30.840327] [INFO ] [LOCAL ] CPS: Starting deletion of primary data. [2025-09-17T18:15:30.896046] [INFO ] [LOCAL ] CPT: Starting deletion of primary data. [2025-09-17T18:15:30.887516] [DEBUG] [LOCAL ] CPS: Deleted primary data file. [2025-09-17T18:15:30.922554] [DEBUG] [LOCAL ] CPT: Deleted primary data file. [2025-09-17T18:15:30.922625] [INFO ] [MAIN ] CPS: Starting full primary refresh. [2025-09-17T18:15:31.021987] [INFO ] [MAIN ] CPT: Starting full primary refresh. [2025-09-17T18:15:31.983263] [INFO ] [REMOTE ] CR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:15:32.095219] [INFO ] [REMOTE ] CQP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:15:32.050836] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-11. [2025-09-17T18:15:32.151366] [INFO ] [REMOTE ] CPS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:15:32.156470] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-11. [2025-09-17T18:15:32.147874] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-11. [2025-09-17T18:15:32.237868] [INFO ] [REMOTE ] CPT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:15:32.238446] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-11. [2025-09-17T18:15:33.285423] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T18:15:33.290543] [INFO ] [REMOTE ] CQP: Fetching primary data for 2024-12. [2025-09-17T18:15:33.342083] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T18:15:33.347779] [INFO ] [REMOTE ] CPS: Fetching primary data for 2024-12. [2025-09-17T18:15:33.418406] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T18:15:33.423948] [INFO ] [REMOTE ] CR: Fetching primary data for 2024-12. [2025-09-17T18:15:33.585768] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T18:15:33.595148] [INFO ] [REMOTE ] CPT: Fetching primary data for 2024-12. [2025-09-17T18:15:34.011842] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T18:15:34.016542] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-01. [2025-09-17T18:15:34.085615] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T18:15:34.092125] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-01. [2025-09-17T18:15:34.576615] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T18:15:34.583138] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-01. [2025-09-17T18:15:35.029061] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T18:15:35.037137] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-01. [2025-09-17T18:15:35.082324] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T18:15:35.088251] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-02. [2025-09-17T18:15:35.174537] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T18:15:35.181269] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-02. [2025-09-17T18:15:35.731354] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T18:15:35.736663] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-02. [2025-09-17T18:15:35.925823] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T18:15:35.931595] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-03. [2025-09-17T18:15:36.348338] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T18:15:36.354159] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-03. [2025-09-17T18:15:36.504729] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T18:15:36.515471] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-02. [2025-09-17T18:15:36.581044] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T18:15:36.586403] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-03. [2025-09-17T18:15:37.235883] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T18:15:37.242706] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-04. [2025-09-17T18:15:37.414421] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T18:15:37.420586] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-04. [2025-09-17T18:15:37.438233] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T18:15:37.443626] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-04. [2025-09-17T18:15:38.151064] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T18:15:38.164244] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-03. [2025-09-17T18:15:38.180219] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T18:15:38.229759] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T18:15:38.312162] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T18:15:38.815788] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-05. [2025-09-17T18:15:39.615890] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-05. [2025-09-17T18:15:39.844634] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T18:15:39.901883] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T18:15:40.415779] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-04. [2025-09-17T18:15:40.650406] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T18:15:41.215785] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-06. [2025-09-17T18:15:42.015869] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-05. [2025-09-17T18:15:42.208601] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T18:15:42.239101] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T18:15:42.815818] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-05. [2025-09-17T18:15:43.183600] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T18:15:43.615824] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-06. [2025-09-17T18:15:44.229828] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T18:15:44.415823] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-06. [2025-09-17T18:15:45.002604] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T18:15:45.215799] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-06. [2025-09-17T18:15:45.259441] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T18:15:46.015783] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-07. [2025-09-17T18:15:46.767693] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T18:15:46.815802] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-07. [2025-09-17T18:15:47.201249] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T18:15:47.615805] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-07. [2025-09-17T18:15:48.388037] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T18:15:48.415680] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-08. [2025-09-17T18:15:48.512012] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T18:15:49.215810] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-08. [2025-09-17T18:15:50.015813] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-08. [2025-09-17T18:15:50.251506] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T18:15:50.293310] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T18:15:50.815789] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-07. [2025-09-17T18:15:50.872536] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T18:15:51.615779] [INFO ] [REMOTE ] CQP: Fetching primary data for 2025-09. [2025-09-17T18:15:52.364026] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T18:15:52.415741] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-08. [2025-09-17T18:15:52.552199] [INFO ] [REMOTE ] CQP: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T18:15:52.554596] [INFO ] [REMOTE ] CQP: Full fetch complete (30986 records). [2025-09-17T18:15:52.554756] [DEBUG] [VALIDATOR ] CQP: Validating primary data. [2025-09-17T18:15:52.940506] [DEBUG] [VALIDATOR ] CQP: All expected trading days are present. [2025-09-17T18:15:52.940595] [DEBUG] [VALIDATOR ] CQP: Primary data validation passed. [2025-09-17T18:15:52.941106] [INFO ] [MAIN ] CQP: Fetched primary data is valid. [2025-09-17T18:15:52.941169] [DEBUG] [LOCAL ] CQP: Saving primary data. [2025-09-17T18:15:52.942003] [DEBUG] [LOCAL ] CQP: Trimmed 30986 records to 20089 (keeping 200 days of data) [2025-09-17T18:15:53.074981] [DEBUG] [LOCAL ] CQP: Primary data saved (20089 records). [2025-09-17T18:15:53.075109] [INFO ] [MAIN ] CQP: Full history saved. [2025-09-17T18:15:53.075191] [INFO ] [MAIN ] Update Progress: 521/2371 symbols completed. CQP took 23.9s. Estimated remaining: 4h 29m 21s. Rate: 6.9 symbols/min [2025-09-17T18:15:53.222593] [INFO ] [REMOTE ] CPT: Fetching primary data for 2025-09. [2025-09-17T18:15:53.254020] [INFO ] [MAIN ] CRBD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:15:53.254226] [DEBUG] [LOCAL ] CRBD: No existing data file found in primary storage. [2025-09-17T18:15:53.254263] [WARN ] [MAIN ] CRBD: No existing data found, performing full refresh instead. [2025-09-17T18:15:53.254395] [INFO ] [MAIN ] CRBD: Wiping existing primary data before full refresh. [2025-09-17T18:15:53.254434] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-17T18:15:53.254474] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-17T18:15:53.254505] [INFO ] [MAIN ] CRBD: Starting full primary refresh. [2025-09-17T18:15:53.618348] [INFO ] [REMOTE ] CRBD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:15:53.634291] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T18:15:54.015827] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-11. [2025-09-17T18:15:54.245591] [DEBUG] [REMOTE ] CRBD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:15:54.245938] [WARN ] [REMOTE ] CRBD: No data returned for month 2024-11 [2025-09-17T18:15:54.815834] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2024-12. [2025-09-17T18:15:54.863460] [INFO ] [REMOTE ] CPT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T18:15:54.869727] [INFO ] [REMOTE ] CPT: Full fetch complete (63276 records). [2025-09-17T18:15:54.869870] [DEBUG] [VALIDATOR ] CPT: Validating primary data. [2025-09-17T18:15:55.273097] [DEBUG] [VALIDATOR ] CPT: All expected trading days are present. [2025-09-17T18:15:55.273209] [DEBUG] [VALIDATOR ] CPT: Primary data validation passed. [2025-09-17T18:15:55.273988] [INFO ] [MAIN ] CPT: Fetched primary data is valid. [2025-09-17T18:15:55.274039] [DEBUG] [LOCAL ] CPT: Saving primary data. [2025-09-17T18:15:55.276801] [DEBUG] [LOCAL ] CPT: Trimmed 63276 records to 44362 (keeping 200 days of data) [2025-09-17T18:15:55.570009] [DEBUG] [LOCAL ] CPT: Primary data saved (44362 records). [2025-09-17T18:15:55.570150] [INFO ] [MAIN ] CPT: Full history saved. [2025-09-17T18:15:55.570415] [INFO ] [MAIN ] Update Progress: 522/2371 symbols completed. CPT took 26.4s. Estimated remaining: 4h 28m 50s. Rate: 6.9 symbols/min [2025-09-17T18:15:55.620889] [INFO ] [REMOTE ] CPS: Fetching primary data for 2025-09. [2025-09-17T18:15:55.755898] [INFO ] [MAIN ] CRBG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:15:55.808755] [DEBUG] [LOCAL ] CRBG: Loaded 52342 existing records from primary storage. [2025-09-17T18:15:55.808899] [INFO ] [MAIN ] CRBG: Loaded 52342 existing records. [2025-09-17T18:15:55.993496] [WARN ] [MAIN ] CRBG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:15:55.993795] [INFO ] [MAIN ] CRBG: Wiping existing primary data before full refresh. [2025-09-17T18:15:55.993845] [INFO ] [LOCAL ] CRBG: Starting deletion of primary data. [2025-09-17T18:15:55.995012] [DEBUG] [LOCAL ] CRBG: Deleted primary data file. [2025-09-17T18:15:55.995065] [INFO ] [MAIN ] CRBG: Starting full primary refresh. [2025-09-17T18:15:56.266875] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T18:15:56.388441] [INFO ] [REMOTE ] CRBG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:15:56.415781] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-11. [2025-09-17T18:15:56.680336] [INFO ] [REMOTE ] CPS: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T18:15:56.684764] [INFO ] [REMOTE ] CPS: Full fetch complete (36139 records). [2025-09-17T18:15:56.684936] [DEBUG] [VALIDATOR ] CPS: Validating primary data. [2025-09-17T18:15:57.072745] [DEBUG] [VALIDATOR ] CPS: All expected trading days are present. [2025-09-17T18:15:57.072842] [DEBUG] [VALIDATOR ] CPS: Primary data validation passed. [2025-09-17T18:15:57.073355] [INFO ] [MAIN ] CPS: Fetched primary data is valid. [2025-09-17T18:15:57.073400] [DEBUG] [LOCAL ] CPS: Saving primary data. [2025-09-17T18:15:57.074480] [DEBUG] [LOCAL ] CPS: Trimmed 36139 records to 26389 (keeping 200 days of data) [2025-09-17T18:15:57.223832] [INFO ] [REMOTE ] CR: Fetching primary data for 2025-09. [2025-09-17T18:15:57.237437] [DEBUG] [LOCAL ] CPS: Primary data saved (26389 records). [2025-09-17T18:15:57.237600] [INFO ] [MAIN ] CPS: Full history saved. [2025-09-17T18:15:57.237775] [INFO ] [MAIN ] Update Progress: 523/2371 symbols completed. CPS took 28.1s. Estimated remaining: 4h 28m 16s. Rate: 6.9 symbols/min [2025-09-17T18:15:57.409161] [INFO ] [MAIN ] CRC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:15:57.451615] [DEBUG] [LOCAL ] CRC: Loaded 44456 existing records from primary storage. [2025-09-17T18:15:57.451829] [INFO ] [MAIN ] CRC: Loaded 44456 existing records. [2025-09-17T18:15:57.628860] [WARN ] [MAIN ] CRC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:15:57.629098] [INFO ] [MAIN ] CRC: Wiping existing primary data before full refresh. [2025-09-17T18:15:57.629144] [INFO ] [LOCAL ] CRC: Starting deletion of primary data. [2025-09-17T18:15:57.630115] [DEBUG] [LOCAL ] CRC: Deleted primary data file. [2025-09-17T18:15:57.630164] [INFO ] [MAIN ] CRC: Starting full primary refresh. [2025-09-17T18:15:57.993361] [INFO ] [REMOTE ] CRC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:15:58.015757] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-11. [2025-09-17T18:15:58.177547] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T18:15:58.537518] [INFO ] [REMOTE ] CR: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T18:15:58.541816] [INFO ] [REMOTE ] CR: Full fetch complete (34776 records). [2025-09-17T18:15:58.541941] [DEBUG] [VALIDATOR ] CR: Validating primary data. [2025-09-17T18:15:58.820846] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-01. [2025-09-17T18:15:58.927219] [DEBUG] [VALIDATOR ] CR: All expected trading days are present. [2025-09-17T18:15:58.927299] [DEBUG] [VALIDATOR ] CR: Primary data validation passed. [2025-09-17T18:15:58.927875] [INFO ] [MAIN ] CR: Fetched primary data is valid. [2025-09-17T18:15:58.927919] [DEBUG] [LOCAL ] CR: Saving primary data. [2025-09-17T18:15:58.928748] [DEBUG] [LOCAL ] CR: Trimmed 34776 records to 24730 (keeping 200 days of data) [2025-09-17T18:15:59.083415] [DEBUG] [LOCAL ] CR: Primary data saved (24730 records). [2025-09-17T18:15:59.083548] [INFO ] [MAIN ] CR: Full history saved. [2025-09-17T18:15:59.083632] [INFO ] [MAIN ] Update Progress: 524/2371 symbols completed. CR took 29.9s. Estimated remaining: 4h 27m 43s. Rate: 6.9 symbols/min [2025-09-17T18:15:59.252582] [INFO ] [MAIN ] CRCL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:15:59.252770] [DEBUG] [LOCAL ] CRCL: No existing data file found in primary storage. [2025-09-17T18:15:59.252808] [WARN ] [MAIN ] CRCL: No existing data found, performing full refresh instead. [2025-09-17T18:15:59.252928] [INFO ] [MAIN ] CRCL: Wiping existing primary data before full refresh. [2025-09-17T18:15:59.252968] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-17T18:15:59.253009] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-17T18:15:59.253043] [INFO ] [MAIN ] CRCL: Starting full primary refresh. [2025-09-17T18:15:59.617058] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2024-12. [2025-09-17T18:15:59.616971] [INFO ] [REMOTE ] CRCL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:15:59.649002] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T18:15:59.675399] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T18:16:00.415786] [INFO ] [REMOTE ] CRC: Fetching primary data for 2024-12. [2025-09-17T18:16:01.215822] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-02. [2025-09-17T18:16:01.272065] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T18:16:01.761994] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T18:16:01.987365] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T18:16:02.015729] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-01. [2025-09-17T18:16:02.815816] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-01. [2025-09-17T18:16:03.414343] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T18:16:03.615792] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-11. [2025-09-17T18:16:03.831089] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:16:03.831492] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-11 [2025-09-17T18:16:04.226198] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T18:16:04.415802] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-03. [2025-09-17T18:16:05.007157] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T18:16:05.215750] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-04. [2025-09-17T18:16:06.015813] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-02. [2025-09-17T18:16:06.172950] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T18:16:06.815786] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-02. [2025-09-17T18:16:07.404421] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T18:16:07.615775] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2024-12. [2025-09-17T18:16:07.809784] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:16:07.810095] [WARN ] [REMOTE ] CRCL: No data returned for month 2024-12 [2025-09-17T18:16:08.415793] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-05. [2025-09-17T18:16:08.496317] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T18:16:09.159565] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T18:16:09.215734] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-06. [2025-09-17T18:16:10.005746] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T18:16:10.015734] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-03. [2025-09-17T18:16:10.815851] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-07. [2025-09-17T18:16:11.364376] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T18:16:11.615793] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-08. [2025-09-17T18:16:11.794024] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T18:16:12.408487] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T18:16:12.415690] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-04. [2025-09-17T18:16:13.215809] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-01. [2025-09-17T18:16:13.438744] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:16:13.439059] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-01 [2025-09-17T18:16:13.958245] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T18:16:14.015780] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-05. [2025-09-17T18:16:14.815822] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-03. [2025-09-17T18:16:15.555241] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T18:16:15.615723] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-06. [2025-09-17T18:16:16.415707] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-02. [2025-09-17T18:16:16.458695] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T18:16:16.753812] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:16:16.754328] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-02 [2025-09-17T18:16:17.208221] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T18:16:17.217388] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-04. [2025-09-17T18:16:18.015772] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-07. [2025-09-17T18:16:18.815783] [INFO ] [REMOTE ] CRBD: Fetching primary data for 2025-09. [2025-09-17T18:16:19.075045] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T18:16:19.621249] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-03. [2025-09-17T18:16:19.658124] [INFO ] [REMOTE ] CRBD: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T18:16:19.664030] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T18:16:19.661526] [INFO ] [REMOTE ] CRBD: Full fetch complete (15281 records). [2025-09-17T18:16:19.675234] [DEBUG] [VALIDATOR ] CRBD: Validating primary data. [2025-09-17T18:16:19.871746] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:16:19.892481] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-03 [2025-09-17T18:16:19.922207] [WARN ] [VALIDATOR ] CRBD: Validation failed - insufficient historical data. Have 194 unique days, need 200 days [2025-09-17T18:16:19.922699] [FATAL] [MAIN ] CRBD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:16:19.922768] [WARN ] [MAIN ] CRBD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:16:19.922826] [INFO ] [LOCAL ] CRBD: Starting deletion of primary data. [2025-09-17T18:16:19.922905] [DEBUG] [LOCAL ] CRBD: No primary data file found to delete. [2025-09-17T18:16:19.922952] [INFO ] [LOCAL ] CRBD: Starting deletion of derivative data. [2025-09-17T18:16:19.923001] [DEBUG] [LOCAL ] CRBD: No derivative data file found to delete. [2025-09-17T18:16:19.923096] [INFO ] [MAIN ] Update Progress: 525/2371 symbols completed. CRBD took 26.8s. Estimated remaining: 4h 28m 17s. Rate: 6.9 symbols/min [2025-09-17T18:16:20.205039] [INFO ] [MAIN ] CRGY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:16:20.281219] [DEBUG] [LOCAL ] CRGY: Loaded 52518 existing records from primary storage. [2025-09-17T18:16:20.281411] [INFO ] [MAIN ] CRGY: Loaded 52518 existing records. [2025-09-17T18:16:20.421018] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-08. [2025-09-17T18:16:20.580113] [WARN ] [MAIN ] CRGY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:16:20.580416] [INFO ] [MAIN ] CRGY: Wiping existing primary data before full refresh. [2025-09-17T18:16:20.580476] [INFO ] [LOCAL ] CRGY: Starting deletion of primary data. [2025-09-17T18:16:20.581501] [DEBUG] [LOCAL ] CRGY: Deleted primary data file. [2025-09-17T18:16:20.581566] [INFO ] [MAIN ] CRGY: Starting full primary refresh. [2025-09-17T18:16:21.056799] [INFO ] [REMOTE ] CRGY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:16:21.215800] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-04. [2025-09-17T18:16:21.468919] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:16:21.469264] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-04 [2025-09-17T18:16:22.015784] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-05. [2025-09-17T18:16:22.171802] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T18:16:22.205822] [DEBUG] [REMOTE ] CRCL: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:16:22.206121] [WARN ] [REMOTE ] CRCL: No data returned for month 2025-05 [2025-09-17T18:16:22.815829] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-06. [2025-09-17T18:16:23.615800] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-05. [2025-09-17T18:16:24.415792] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-11. [2025-09-17T18:16:25.215835] [INFO ] [REMOTE ] CRC: Fetching primary data for 2025-09. [2025-09-17T18:16:25.294799] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-17T18:16:25.397109] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T18:16:25.858291] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T18:16:26.015727] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-07. [2025-09-17T18:16:26.815774] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-06. [2025-09-17T18:16:26.851844] [INFO ] [REMOTE ] CRC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T18:16:26.858718] [INFO ] [REMOTE ] CRC: Full fetch complete (61859 records). [2025-09-17T18:16:26.858989] [DEBUG] [VALIDATOR ] CRC: Validating primary data. [2025-09-17T18:16:27.270204] [DEBUG] [VALIDATOR ] CRC: All expected trading days are present. [2025-09-17T18:16:27.270340] [DEBUG] [VALIDATOR ] CRC: Primary data validation passed. [2025-09-17T18:16:27.271553] [INFO ] [MAIN ] CRC: Fetched primary data is valid. [2025-09-17T18:16:27.271616] [DEBUG] [LOCAL ] CRC: Saving primary data. [2025-09-17T18:16:27.275534] [DEBUG] [LOCAL ] CRC: Trimmed 61859 records to 44532 (keeping 200 days of data) [2025-09-17T18:16:27.605263] [DEBUG] [LOCAL ] CRC: Primary data saved (44532 records). [2025-09-17T18:16:27.605544] [INFO ] [MAIN ] CRC: Full history saved. [2025-09-17T18:16:27.606920] [INFO ] [MAIN ] Update Progress: 526/2371 symbols completed. CRC took 30.4s. Estimated remaining: 4h 28m 5s. Rate: 6.9 symbols/min [2025-09-17T18:16:27.624802] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2024-12. [2025-09-17T18:16:27.820499] [INFO ] [MAIN ] CRH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:16:27.892063] [DEBUG] [LOCAL ] CRH: Loaded 53476 existing records from primary storage. [2025-09-17T18:16:27.892322] [INFO ] [MAIN ] CRH: Loaded 53476 existing records. [2025-09-17T18:16:28.096401] [WARN ] [MAIN ] CRH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:16:28.096838] [INFO ] [MAIN ] CRH: Wiping existing primary data before full refresh. [2025-09-17T18:16:28.096893] [INFO ] [LOCAL ] CRH: Starting deletion of primary data. [2025-09-17T18:16:28.098731] [DEBUG] [LOCAL ] CRH: Deleted primary data file. [2025-09-17T18:16:28.098799] [INFO ] [MAIN ] CRH: Starting full primary refresh. [2025-09-17T18:16:28.515361] [INFO ] [REMOTE ] CRH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:16:28.516007] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-11. [2025-09-17T18:16:28.550043] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T18:16:28.902753] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-07 (2.89 seconds). [2025-09-17T18:16:29.215796] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-08. [2025-09-17T18:16:29.428832] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T18:16:30.015799] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-07. [2025-09-17T18:16:30.052515] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T18:16:30.815783] [INFO ] [REMOTE ] CRH: Fetching primary data for 2024-12. [2025-09-17T18:16:31.615815] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-01. [2025-09-17T18:16:31.794347] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-08 (2.58 seconds). [2025-09-17T18:16:31.935920] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T18:16:32.415771] [INFO ] [REMOTE ] CRCL: Fetching primary data for 2025-09. [2025-09-17T18:16:32.687917] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T18:16:33.131217] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T18:16:33.215803] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-02. [2025-09-17T18:16:34.015840] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-01. [2025-09-17T18:16:34.815858] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-08. [2025-09-17T18:16:34.866602] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T18:16:35.011237] [INFO ] [REMOTE ] CRCL: Incremental fetch complete for 2025-09 (2.60 seconds). [2025-09-17T18:16:35.017850] [INFO ] [REMOTE ] CRCL: Full fetch complete (27879 records). [2025-09-17T18:16:35.017956] [DEBUG] [VALIDATOR ] CRCL: Validating primary data. [2025-09-17T18:16:35.242896] [WARN ] [VALIDATOR ] CRCL: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-17T18:16:35.243396] [FATAL] [MAIN ] CRCL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:16:35.243449] [WARN ] [MAIN ] CRCL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:16:35.243498] [INFO ] [LOCAL ] CRCL: Starting deletion of primary data. [2025-09-17T18:16:35.243584] [DEBUG] [LOCAL ] CRCL: No primary data file found to delete. [2025-09-17T18:16:35.243623] [INFO ] [LOCAL ] CRCL: Starting deletion of derivative data. [2025-09-17T18:16:35.243709] [DEBUG] [LOCAL ] CRCL: No derivative data file found to delete. [2025-09-17T18:16:35.243799] [INFO ] [MAIN ] Update Progress: 527/2371 symbols completed. CRCL took 36.2s. Estimated remaining: 4h 27m 52s. Rate: 6.9 symbols/min [2025-09-17T18:16:35.424327] [INFO ] [MAIN ] CRI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:16:35.472682] [DEBUG] [LOCAL ] CRI: Loaded 50019 existing records from primary storage. [2025-09-17T18:16:35.472832] [INFO ] [MAIN ] CRI: Loaded 50019 existing records. [2025-09-17T18:16:35.626182] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-03. [2025-09-17T18:16:35.679185] [WARN ] [MAIN ] CRI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:16:35.679682] [INFO ] [MAIN ] CRI: Wiping existing primary data before full refresh. [2025-09-17T18:16:35.679743] [INFO ] [LOCAL ] CRI: Starting deletion of primary data. [2025-09-17T18:16:35.681096] [DEBUG] [LOCAL ] CRI: Deleted primary data file. [2025-09-17T18:16:35.681164] [INFO ] [MAIN ] CRI: Starting full primary refresh. [2025-09-17T18:16:35.982043] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T18:16:36.104796] [INFO ] [REMOTE ] CRI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:16:36.415784] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-11. [2025-09-17T18:16:36.633324] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T18:16:37.215822] [INFO ] [REMOTE ] CRBG: Fetching primary data for 2025-09. [2025-09-17T18:16:37.511747] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T18:16:37.891448] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T18:16:38.015796] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-02. [2025-09-17T18:16:38.815793] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-04. [2025-09-17T18:16:38.899389] [INFO ] [REMOTE ] CRBG: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T18:16:38.909293] [INFO ] [REMOTE ] CRBG: Full fetch complete (75531 records). [2025-09-17T18:16:38.909491] [DEBUG] [VALIDATOR ] CRBG: Validating primary data. [2025-09-17T18:16:39.343862] [DEBUG] [VALIDATOR ] CRBG: All expected trading days are present. [2025-09-17T18:16:39.343960] [DEBUG] [VALIDATOR ] CRBG: Primary data validation passed. [2025-09-17T18:16:39.344808] [INFO ] [MAIN ] CRBG: Fetched primary data is valid. [2025-09-17T18:16:39.344861] [DEBUG] [LOCAL ] CRBG: Saving primary data. [2025-09-17T18:16:39.346684] [DEBUG] [LOCAL ] CRBG: Trimmed 75531 records to 52342 (keeping 200 days of data) [2025-09-17T18:16:39.641270] [INFO ] [REMOTE ] CRI: Fetching primary data for 2024-12. [2025-09-17T18:16:39.686592] [DEBUG] [LOCAL ] CRBG: Primary data saved (52342 records). [2025-09-17T18:16:39.686783] [INFO ] [MAIN ] CRBG: Full history saved. [2025-09-17T18:16:39.687491] [INFO ] [MAIN ] Update Progress: 528/2371 symbols completed. CRBG took 44.1s. Estimated remaining: 4h 27m 29s. Rate: 6.9 symbols/min [2025-09-17T18:16:39.860205] [INFO ] [MAIN ] CRK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:16:39.917551] [DEBUG] [LOCAL ] CRK: Loaded 52103 existing records from primary storage. [2025-09-17T18:16:39.917722] [INFO ] [MAIN ] CRK: Loaded 52103 existing records. [2025-09-17T18:16:40.111441] [WARN ] [MAIN ] CRK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:16:40.111979] [INFO ] [MAIN ] CRK: Wiping existing primary data before full refresh. [2025-09-17T18:16:40.112276] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-17T18:16:40.113371] [DEBUG] [LOCAL ] CRK: Deleted primary data file. [2025-09-17T18:16:40.113437] [INFO ] [MAIN ] CRK: Starting full primary refresh. [2025-09-17T18:16:40.288161] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-17T18:16:40.425226] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-03. [2025-09-17T18:16:40.563008] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T18:16:40.584514] [INFO ] [REMOTE ] CRK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:16:41.215753] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-05. [2025-09-17T18:16:41.281888] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T18:16:42.015819] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-11. [2025-09-17T18:16:42.516988] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T18:16:42.815788] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-04. [2025-09-17T18:16:42.944802] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T18:16:43.360659] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T18:16:43.615834] [INFO ] [REMOTE ] CRK: Fetching primary data for 2024-12. [2025-09-17T18:16:44.415839] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-06. [2025-09-17T18:16:44.777929] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T18:16:45.220925] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-01. [2025-09-17T18:16:45.237232] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T18:16:45.870874] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T18:16:46.015843] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-07. [2025-09-17T18:16:46.764270] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T18:16:46.815725] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-02. [2025-09-17T18:16:47.615786] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-01. [2025-09-17T18:16:47.978214] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T18:16:48.297932] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T18:16:48.415796] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-08. [2025-09-17T18:16:49.184103] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T18:16:49.215729] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-02. [2025-09-17T18:16:49.827976] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T18:16:50.015824] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-03. [2025-09-17T18:16:50.815750] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-05. [2025-09-17T18:16:51.107728] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T18:16:51.615774] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-03. [2025-09-17T18:16:51.764339] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T18:16:52.415820] [INFO ] [REMOTE ] CRGY: Fetching primary data for 2025-09. [2025-09-17T18:16:52.913307] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T18:16:53.215813] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-06. [2025-09-17T18:16:53.368222] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T18:16:54.015851] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-04. [2025-09-17T18:16:54.142777] [INFO ] [REMOTE ] CRGY: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T18:16:54.149581] [INFO ] [REMOTE ] CRGY: Full fetch complete (75727 records). [2025-09-17T18:16:54.149737] [DEBUG] [VALIDATOR ] CRGY: Validating primary data. [2025-09-17T18:16:54.546096] [DEBUG] [VALIDATOR ] CRGY: All expected trading days are present. [2025-09-17T18:16:54.546196] [DEBUG] [VALIDATOR ] CRGY: Primary data validation passed. [2025-09-17T18:16:54.547268] [INFO ] [MAIN ] CRGY: Fetched primary data is valid. [2025-09-17T18:16:54.547375] [DEBUG] [LOCAL ] CRGY: Saving primary data. [2025-09-17T18:16:54.549888] [DEBUG] [LOCAL ] CRGY: Trimmed 75727 records to 52521 (keeping 200 days of data) [2025-09-17T18:16:54.845588] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-04. [2025-09-17T18:16:54.889903] [DEBUG] [LOCAL ] CRGY: Primary data saved (52521 records). [2025-09-17T18:16:54.891411] [INFO ] [MAIN ] CRGY: Full history saved. [2025-09-17T18:16:54.891612] [INFO ] [MAIN ] Update Progress: 529/2371 symbols completed. CRGY took 35.0s. Estimated remaining: 4h 27m 43s. Rate: 6.9 symbols/min [2025-09-17T18:16:55.099899] [INFO ] [MAIN ] CRL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:16:55.102535] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T18:16:55.156538] [DEBUG] [LOCAL ] CRL: Loaded 43871 existing records from primary storage. [2025-09-17T18:16:55.156748] [INFO ] [MAIN ] CRL: Loaded 43871 existing records. [2025-09-17T18:16:55.336427] [WARN ] [MAIN ] CRL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:16:55.336724] [INFO ] [MAIN ] CRL: Wiping existing primary data before full refresh. [2025-09-17T18:16:55.336772] [INFO ] [LOCAL ] CRL: Starting deletion of primary data. [2025-09-17T18:16:55.337632] [DEBUG] [LOCAL ] CRL: Deleted primary data file. [2025-09-17T18:16:55.337716] [INFO ] [MAIN ] CRL: Starting full primary refresh. [2025-09-17T18:16:55.621324] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-07. [2025-09-17T18:16:55.700208] [INFO ] [REMOTE ] CRL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:16:55.828812] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T18:16:56.140272] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T18:16:56.415807] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-05. [2025-09-17T18:16:57.215838] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-11. [2025-09-17T18:16:57.298093] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T18:16:58.015847] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-05. [2025-09-17T18:16:58.155215] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T18:16:58.815810] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-06. [2025-09-17T18:16:58.887693] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T18:16:59.615822] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-08. [2025-09-17T18:16:59.654988] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T18:17:00.415792] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-06. [2025-09-17T18:17:00.499975] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T18:17:01.215817] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-07. [2025-09-17T18:17:01.523615] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T18:17:02.015798] [INFO ] [REMOTE ] CRL: Fetching primary data for 2024-12. [2025-09-17T18:17:02.250818] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T18:17:02.815790] [INFO ] [REMOTE ] CRH: Fetching primary data for 2025-09. [2025-09-17T18:17:03.060581] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T18:17:03.195380] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T18:17:03.615805] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-08. [2025-09-17T18:17:04.415796] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-07. [2025-09-17T18:17:04.811114] [INFO ] [REMOTE ] CRH: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-17T18:17:04.818161] [INFO ] [REMOTE ] CRH: Full fetch complete (77132 records). [2025-09-17T18:17:04.818340] [DEBUG] [VALIDATOR ] CRH: Validating primary data. [2025-09-17T18:17:05.224426] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-01. [2025-09-17T18:17:05.228724] [DEBUG] [VALIDATOR ] CRH: All expected trading days are present. [2025-09-17T18:17:05.230114] [DEBUG] [VALIDATOR ] CRH: Primary data validation passed. [2025-09-17T18:17:05.231748] [INFO ] [MAIN ] CRH: Fetched primary data is valid. [2025-09-17T18:17:05.232111] [DEBUG] [LOCAL ] CRH: Saving primary data. [2025-09-17T18:17:05.234589] [DEBUG] [LOCAL ] CRH: Trimmed 77132 records to 53472 (keeping 200 days of data) [2025-09-17T18:17:05.401632] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T18:17:05.642123] [DEBUG] [LOCAL ] CRH: Primary data saved (53472 records). [2025-09-17T18:17:05.642306] [INFO ] [MAIN ] CRH: Full history saved. [2025-09-17T18:17:05.643024] [INFO ] [MAIN ] Update Progress: 530/2371 symbols completed. CRH took 38.0s. Estimated remaining: 4h 27m 41s. Rate: 6.9 symbols/min [2025-09-17T18:17:05.820549] [INFO ] [MAIN ] CRM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:17:05.878399] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-17T18:17:05.878547] [INFO ] [MAIN ] CRM: Loaded 53770 existing records. [2025-09-17T18:17:06.027438] [INFO ] [REMOTE ] CRI: Fetching primary data for 2025-09. [2025-09-17T18:17:06.065103] [WARN ] [MAIN ] CRM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:17:06.065423] [INFO ] [MAIN ] CRM: Wiping existing primary data before full refresh. [2025-09-17T18:17:06.065671] [INFO ] [LOCAL ] CRM: Starting deletion of primary data. [2025-09-17T18:17:06.067078] [DEBUG] [LOCAL ] CRM: Deleted primary data file. [2025-09-17T18:17:06.067145] [INFO ] [MAIN ] CRM: Starting full primary refresh. [2025-09-17T18:17:06.292749] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T18:17:06.493361] [INFO ] [REMOTE ] CRM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:17:06.815831] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-08. [2025-09-17T18:17:06.990583] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T18:17:07.615759] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-02. [2025-09-17T18:17:07.664085] [INFO ] [REMOTE ] CRI: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T18:17:07.670554] [INFO ] [REMOTE ] CRI: Full fetch complete (70614 records). [2025-09-17T18:17:07.670730] [DEBUG] [VALIDATOR ] CRI: Validating primary data. [2025-09-17T18:17:08.066994] [DEBUG] [VALIDATOR ] CRI: All expected trading days are present. [2025-09-17T18:17:08.067088] [DEBUG] [VALIDATOR ] CRI: Primary data validation passed. [2025-09-17T18:17:08.067896] [INFO ] [MAIN ] CRI: Fetched primary data is valid. [2025-09-17T18:17:08.067945] [DEBUG] [LOCAL ] CRI: Saving primary data. [2025-09-17T18:17:08.069505] [DEBUG] [LOCAL ] CRI: Trimmed 70614 records to 49995 (keeping 200 days of data) [2025-09-17T18:17:08.384317] [DEBUG] [LOCAL ] CRI: Primary data saved (49995 records). [2025-09-17T18:17:08.384471] [INFO ] [MAIN ] CRI: Full history saved. [2025-09-17T18:17:08.384564] [INFO ] [MAIN ] Update Progress: 531/2371 symbols completed. CRI took 33.1s. Estimated remaining: 4h 27m 12s. Rate: 6.9 symbols/min [2025-09-17T18:17:08.428692] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-11. [2025-09-17T18:17:08.566779] [INFO ] [MAIN ] CRS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:17:08.602351] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T18:17:08.649767] [DEBUG] [LOCAL ] CRS: Loaded 43571 existing records from primary storage. [2025-09-17T18:17:08.649915] [INFO ] [MAIN ] CRS: Loaded 43571 existing records. [2025-09-17T18:17:08.829125] [WARN ] [MAIN ] CRS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:17:08.829408] [INFO ] [MAIN ] CRS: Wiping existing primary data before full refresh. [2025-09-17T18:17:08.829471] [INFO ] [LOCAL ] CRS: Starting deletion of primary data. [2025-09-17T18:17:08.830296] [DEBUG] [LOCAL ] CRS: Deleted primary data file. [2025-09-17T18:17:08.830343] [INFO ] [MAIN ] CRS: Starting full primary refresh. [2025-09-17T18:17:09.196604] [INFO ] [REMOTE ] CRS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:17:09.215741] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-11. [2025-09-17T18:17:09.365286] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T18:17:10.015816] [INFO ] [REMOTE ] CRK: Fetching primary data for 2025-09. [2025-09-17T18:17:10.367229] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T18:17:10.815805] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-03. [2025-09-17T18:17:10.866629] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T18:17:11.615786] [INFO ] [REMOTE ] CRS: Fetching primary data for 2024-12. [2025-09-17T18:17:11.754829] [INFO ] [REMOTE ] CRK: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T18:17:11.761559] [INFO ] [REMOTE ] CRK: Full fetch complete (74905 records). [2025-09-17T18:17:11.761738] [DEBUG] [VALIDATOR ] CRK: Validating primary data. [2025-09-17T18:17:11.762584] [FATAL] [VALIDATOR ] CRK: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:17:11.762714] [FATAL] [MAIN ] CRK: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:17:11.762752] [WARN ] [MAIN ] CRK: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:17:11.762795] [INFO ] [LOCAL ] CRK: Starting deletion of primary data. [2025-09-17T18:17:11.762889] [DEBUG] [LOCAL ] CRK: No primary data file found to delete. [2025-09-17T18:17:11.762932] [INFO ] [LOCAL ] CRK: Starting deletion of derivative data. [2025-09-17T18:17:11.763302] [DEBUG] [LOCAL ] CRK: Deleted derivative data file. [2025-09-17T18:17:11.764155] [INFO ] [MAIN ] Update Progress: 532/2371 symbols completed. CRK took 32.1s. Estimated remaining: 4h 26m 44s. Rate: 6.9 symbols/min [2025-09-17T18:17:11.939763] [INFO ] [MAIN ] CRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:17:11.948095] [DEBUG] [LOCAL ] CRT: Loaded 4909 existing records from primary storage. [2025-09-17T18:17:11.948221] [INFO ] [MAIN ] CRT: Loaded 4909 existing records. [2025-09-17T18:17:12.140323] [WARN ] [MAIN ] CRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:17:12.140727] [INFO ] [MAIN ] CRT: Wiping existing primary data before full refresh. [2025-09-17T18:17:12.140797] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-17T18:17:12.141089] [DEBUG] [LOCAL ] CRT: Deleted primary data file. [2025-09-17T18:17:12.141150] [INFO ] [MAIN ] CRT: Starting full primary refresh. [2025-09-17T18:17:12.429104] [INFO ] [REMOTE ] CRM: Fetching primary data for 2024-12. [2025-09-17T18:17:12.526341] [INFO ] [REMOTE ] CRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:17:12.556858] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T18:17:13.215788] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-04. [2025-09-17T18:17:13.262962] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T18:17:14.015788] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-01. [2025-09-17T18:17:14.748807] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T18:17:14.815851] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-11. [2025-09-17T18:17:14.969466] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2024-12 (2.54 seconds). [2025-09-17T18:17:15.224141] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T18:17:15.431405] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T18:17:15.615786] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-02. [2025-09-17T18:17:16.415815] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-01. [2025-09-17T18:17:17.215801] [INFO ] [REMOTE ] CRT: Fetching primary data for 2024-12. [2025-09-17T18:17:17.278107] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T18:17:17.892667] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T18:17:18.015806] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-05. [2025-09-17T18:17:18.539561] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T18:17:18.815831] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-03. [2025-09-17T18:17:19.615800] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-02. [2025-09-17T18:17:19.808358] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T18:17:20.133600] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T18:17:20.415780] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-04. [2025-09-17T18:17:21.215803] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-06. [2025-09-17T18:17:22.018464] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-01. [2025-09-17T18:17:22.021457] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-02 (2.41 seconds). [2025-09-17T18:17:22.231422] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T18:17:22.280672] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T18:17:22.656588] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T18:17:22.815775] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-02. [2025-09-17T18:17:23.237262] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T18:17:23.615789] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-03. [2025-09-17T18:17:24.415819] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-07. [2025-09-17T18:17:25.215768] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-03. [2025-09-17T18:17:25.961339] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T18:17:26.015785] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-04. [2025-09-17T18:17:26.043266] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T18:17:26.087215] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-17T18:17:26.657509] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T18:17:26.815780] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-05. [2025-09-17T18:17:27.615789] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-05. [2025-09-17T18:17:28.227060] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T18:17:28.415752] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-08. [2025-09-17T18:17:28.478677] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T18:17:29.215819] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-06. [2025-09-17T18:17:30.015802] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-04. [2025-09-17T18:17:30.065977] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T18:17:30.815715] [INFO ] [REMOTE ] CRL: Fetching primary data for 2025-09. [2025-09-17T18:17:30.893547] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T18:17:31.615822] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-06. [2025-09-17T18:17:32.335753] [INFO ] [REMOTE ] CRL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T18:17:32.345090] [INFO ] [REMOTE ] CRL: Full fetch complete (62621 records). [2025-09-17T18:17:32.345335] [DEBUG] [VALIDATOR ] CRL: Validating primary data. [2025-09-17T18:17:32.418778] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-07. [2025-09-17T18:17:32.502467] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T18:17:32.942506] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-17T18:17:33.045776] [DEBUG] [VALIDATOR ] CRL: All expected trading days are present. [2025-09-17T18:17:33.045870] [DEBUG] [VALIDATOR ] CRL: Primary data validation passed. [2025-09-17T18:17:33.046656] [INFO ] [MAIN ] CRL: Fetched primary data is valid. [2025-09-17T18:17:33.046706] [DEBUG] [LOCAL ] CRL: Saving primary data. [2025-09-17T18:17:33.048022] [DEBUG] [LOCAL ] CRL: Trimmed 62621 records to 43772 (keeping 200 days of data) [2025-09-17T18:17:33.224701] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-05. [2025-09-17T18:17:33.319467] [DEBUG] [LOCAL ] CRL: Primary data saved (43772 records). [2025-09-17T18:17:33.319627] [INFO ] [MAIN ] CRL: Full history saved. [2025-09-17T18:17:33.319739] [INFO ] [MAIN ] Update Progress: 533/2371 symbols completed. CRL took 38.4s. Estimated remaining: 4h 27m 20s. Rate: 6.9 symbols/min [2025-09-17T18:17:33.503135] [INFO ] [MAIN ] CSAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:17:33.549822] [DEBUG] [LOCAL ] CSAN: Loaded 42022 existing records from primary storage. [2025-09-17T18:17:33.550074] [INFO ] [MAIN ] CSAN: Loaded 42022 existing records. [2025-09-17T18:17:33.757923] [WARN ] [MAIN ] CSAN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:17:33.758214] [INFO ] [MAIN ] CSAN: Wiping existing primary data before full refresh. [2025-09-17T18:17:33.758262] [INFO ] [LOCAL ] CSAN: Starting deletion of primary data. [2025-09-17T18:17:33.759121] [DEBUG] [LOCAL ] CSAN: Deleted primary data file. [2025-09-17T18:17:33.759171] [INFO ] [MAIN ] CSAN: Starting full primary refresh. [2025-09-17T18:17:34.021103] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-07. [2025-09-17T18:17:34.126842] [INFO ] [REMOTE ] CSAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:17:34.360208] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T18:17:34.760281] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T18:17:34.815800] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-08. [2025-09-17T18:17:35.439160] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T18:17:35.615819] [INFO ] [REMOTE ] CRT: Fetching primary data for 2025-09. [2025-09-17T18:17:35.737274] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-05 (2.51 seconds). [2025-09-17T18:17:36.415791] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-08. [2025-09-17T18:17:36.477852] [INFO ] [REMOTE ] CRT: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T18:17:36.479151] [INFO ] [REMOTE ] CRT: Full fetch complete (7530 records). [2025-09-17T18:17:36.479220] [DEBUG] [VALIDATOR ] CRT: Validating primary data. [2025-09-17T18:17:36.479594] [FATAL] [VALIDATOR ] CRT: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:17:36.479687] [FATAL] [MAIN ] CRT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:17:36.479766] [WARN ] [MAIN ] CRT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:17:36.479824] [INFO ] [LOCAL ] CRT: Starting deletion of primary data. [2025-09-17T18:17:36.479892] [DEBUG] [LOCAL ] CRT: No primary data file found to delete. [2025-09-17T18:17:36.479928] [INFO ] [LOCAL ] CRT: Starting deletion of derivative data. [2025-09-17T18:17:36.480201] [DEBUG] [LOCAL ] CRT: Deleted derivative data file. [2025-09-17T18:17:36.480278] [INFO ] [MAIN ] Update Progress: 534/2371 symbols completed. CRT took 24.7s. Estimated remaining: 4h 26m 52s. Rate: 6.9 symbols/min [2025-09-17T18:17:36.650504] [INFO ] [MAIN ] CSL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:17:36.685028] [DEBUG] [LOCAL ] CSL: Loaded 31340 existing records from primary storage. [2025-09-17T18:17:36.685167] [INFO ] [MAIN ] CSL: Loaded 31340 existing records. [2025-09-17T18:17:36.867494] [WARN ] [MAIN ] CSL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:17:36.867737] [INFO ] [MAIN ] CSL: Wiping existing primary data before full refresh. [2025-09-17T18:17:36.867793] [INFO ] [LOCAL ] CSL: Starting deletion of primary data. [2025-09-17T18:17:36.868504] [DEBUG] [LOCAL ] CSL: Deleted primary data file. [2025-09-17T18:17:36.868554] [INFO ] [MAIN ] CSL: Starting full primary refresh. [2025-09-17T18:17:37.218546] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-06. [2025-09-17T18:17:37.221705] [INFO ] [REMOTE ] CSL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:17:38.015903] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-11. [2025-09-17T18:17:38.099625] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T18:17:38.815830] [INFO ] [REMOTE ] CRS: Fetching primary data for 2025-09. [2025-09-17T18:17:39.154224] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T18:17:39.572662] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-17T18:17:39.615773] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-07. [2025-09-17T18:17:40.319871] [INFO ] [REMOTE ] CRS: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T18:17:40.325419] [INFO ] [REMOTE ] CRS: Full fetch complete (62295 records). [2025-09-17T18:17:40.325516] [DEBUG] [VALIDATOR ] CRS: Validating primary data. [2025-09-17T18:17:40.425477] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-11. [2025-09-17T18:17:40.728618] [DEBUG] [VALIDATOR ] CRS: All expected trading days are present. [2025-09-17T18:17:40.728735] [DEBUG] [VALIDATOR ] CRS: Primary data validation passed. [2025-09-17T18:17:40.729467] [INFO ] [MAIN ] CRS: Fetched primary data is valid. [2025-09-17T18:17:40.729513] [DEBUG] [LOCAL ] CRS: Saving primary data. [2025-09-17T18:17:40.731025] [DEBUG] [LOCAL ] CRS: Trimmed 62295 records to 43581 (keeping 200 days of data) [2025-09-17T18:17:41.009223] [DEBUG] [LOCAL ] CRS: Primary data saved (43581 records). [2025-09-17T18:17:41.009377] [INFO ] [MAIN ] CRS: Full history saved. [2025-09-17T18:17:41.010521] [INFO ] [MAIN ] Update Progress: 535/2371 symbols completed. CRS took 32.6s. Estimated remaining: 4h 26m 29s. Rate: 6.9 symbols/min [2025-09-17T18:17:41.197278] [INFO ] [MAIN ] CSR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:17:41.214539] [DEBUG] [LOCAL ] CSR: Loaded 12356 existing records from primary storage. [2025-09-17T18:17:41.214699] [INFO ] [MAIN ] CSR: Loaded 12356 existing records. [2025-09-17T18:17:41.247703] [INFO ] [REMOTE ] CSL: Fetching primary data for 2024-12. [2025-09-17T18:17:41.400213] [WARN ] [MAIN ] CSR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:17:41.400461] [INFO ] [MAIN ] CSR: Wiping existing primary data before full refresh. [2025-09-17T18:17:41.400506] [INFO ] [LOCAL ] CSR: Starting deletion of primary data. [2025-09-17T18:17:41.400903] [DEBUG] [LOCAL ] CSR: Deleted primary data file. [2025-09-17T18:17:41.400952] [INFO ] [MAIN ] CSR: Starting full primary refresh. [2025-09-17T18:17:41.758390] [INFO ] [REMOTE ] CSR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:17:41.799603] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T18:17:41.837093] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T18:17:42.015841] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-08. [2025-09-17T18:17:42.657776] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T18:17:42.815836] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-01. [2025-09-17T18:17:43.615790] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-11. [2025-09-17T18:17:43.902137] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T18:17:44.427898] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2024-12. [2025-09-17T18:17:44.433499] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-17T18:17:44.463188] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T18:17:45.215779] [INFO ] [REMOTE ] CSR: Fetching primary data for 2024-12. [2025-09-17T18:17:45.969102] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T18:17:46.015751] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-01. [2025-09-17T18:17:46.127682] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T18:17:46.815792] [INFO ] [REMOTE ] CRM: Fetching primary data for 2025-09. [2025-09-17T18:17:47.228734] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T18:17:47.615818] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-01. [2025-09-17T18:17:48.415795] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-02. [2025-09-17T18:17:48.486201] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T18:17:49.215787] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-02. [2025-09-17T18:17:49.485213] [INFO ] [REMOTE ] CRM: Incremental fetch complete for 2025-09 (2.67 seconds). [2025-09-17T18:17:49.492283] [INFO ] [REMOTE ] CRM: Full fetch complete (77773 records). [2025-09-17T18:17:49.492451] [DEBUG] [VALIDATOR ] CRM: Validating primary data. [2025-09-17T18:17:49.910878] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T18:17:49.947041] [DEBUG] [VALIDATOR ] CRM: All expected trading days are present. [2025-09-17T18:17:49.951603] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T18:17:49.951672] [DEBUG] [VALIDATOR ] CRM: Primary data validation passed. [2025-09-17T18:17:49.955962] [INFO ] [MAIN ] CRM: Fetched primary data is valid. [2025-09-17T18:17:49.956050] [DEBUG] [LOCAL ] CRM: Saving primary data. [2025-09-17T18:17:49.957862] [DEBUG] [LOCAL ] CRM: Trimmed 77773 records to 53770 (keeping 200 days of data) [2025-09-17T18:17:50.017814] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-03. [2025-09-17T18:17:50.300056] [DEBUG] [LOCAL ] CRM: Primary data saved (53770 records). [2025-09-17T18:17:50.300203] [INFO ] [MAIN ] CRM: Full history saved. [2025-09-17T18:17:50.300907] [INFO ] [MAIN ] Update Progress: 536/2371 symbols completed. CRM took 44.7s. Estimated remaining: 4h 26m 22s. Rate: 6.9 symbols/min [2025-09-17T18:17:50.474561] [INFO ] [MAIN ] CSTM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:17:50.534088] [DEBUG] [LOCAL ] CSTM: Loaded 47878 existing records from primary storage. [2025-09-17T18:17:50.534302] [INFO ] [MAIN ] CSTM: Loaded 47878 existing records. [2025-09-17T18:17:50.714095] [WARN ] [MAIN ] CSTM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:17:50.714403] [INFO ] [MAIN ] CSTM: Wiping existing primary data before full refresh. [2025-09-17T18:17:50.714450] [INFO ] [LOCAL ] CSTM: Starting deletion of primary data. [2025-09-17T18:17:50.715268] [DEBUG] [LOCAL ] CSTM: Deleted primary data file. [2025-09-17T18:17:50.715317] [INFO ] [MAIN ] CSTM: Starting full primary refresh. [2025-09-17T18:17:50.820960] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-02. [2025-09-17T18:17:51.068625] [INFO ] [REMOTE ] CSTM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:17:51.615799] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-11. [2025-09-17T18:17:51.675948] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T18:17:52.415835] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-04. [2025-09-17T18:17:52.655405] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T18:17:52.882392] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T18:17:53.215777] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2024-12. [2025-09-17T18:17:53.856841] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T18:17:54.015801] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-03. [2025-09-17T18:17:54.210495] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T18:17:54.815819] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-05. [2025-09-17T18:17:55.569293] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T18:17:55.615784] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-03. [2025-09-17T18:17:56.394700] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T18:17:56.415742] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-06. [2025-09-17T18:17:56.723162] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T18:17:57.215789] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-01. [2025-09-17T18:17:58.015769] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-04. [2025-09-17T18:17:58.213380] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T18:17:58.790177] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T18:17:58.815721] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-02. [2025-09-17T18:17:59.146805] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T18:17:59.615781] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-04. [2025-09-17T18:18:00.410635] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T18:18:00.419493] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-05. [2025-09-17T18:18:01.215758] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-03. [2025-09-17T18:18:01.240819] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T18:18:01.258114] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T18:18:02.015815] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-06. [2025-09-17T18:18:02.797891] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T18:18:02.815729] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-04. [2025-09-17T18:18:02.919764] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T18:18:03.615785] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-05. [2025-09-17T18:18:04.415765] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-07. [2025-09-17T18:18:04.692039] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T18:18:04.880326] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T18:18:05.215777] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-05. [2025-09-17T18:18:05.318890] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T18:18:06.015787] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-08. [2025-09-17T18:18:06.616133] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T18:18:06.815734] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-06. [2025-09-17T18:18:07.061666] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T18:18:07.615796] [INFO ] [REMOTE ] CSR: Fetching primary data for 2025-09. [2025-09-17T18:18:07.771376] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T18:18:08.415786] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-07. [2025-09-17T18:18:08.496117] [INFO ] [REMOTE ] CSR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T18:18:08.498622] [INFO ] [REMOTE ] CSR: Full fetch complete (17366 records). [2025-09-17T18:18:08.498726] [DEBUG] [VALIDATOR ] CSR: Validating primary data. [2025-09-17T18:18:08.866788] [DEBUG] [VALIDATOR ] CSR: All expected trading days are present. [2025-09-17T18:18:08.866879] [DEBUG] [VALIDATOR ] CSR: Primary data validation passed. [2025-09-17T18:18:08.867266] [INFO ] [MAIN ] CSR: Fetched primary data is valid. [2025-09-17T18:18:08.867322] [DEBUG] [LOCAL ] CSR: Saving primary data. [2025-09-17T18:18:08.867963] [DEBUG] [LOCAL ] CSR: Trimmed 17366 records to 12384 (keeping 200 days of data) [2025-09-17T18:18:08.946821] [DEBUG] [LOCAL ] CSR: Primary data saved (12384 records). [2025-09-17T18:18:08.946955] [INFO ] [MAIN ] CSR: Full history saved. [2025-09-17T18:18:08.947048] [INFO ] [MAIN ] Update Progress: 537/2371 symbols completed. CSR took 27.9s. Estimated remaining: 4h 26m 48s. Rate: 6.9 symbols/min [2025-09-17T18:18:09.120902] [INFO ] [MAIN ] CSV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:18:09.139369] [DEBUG] [LOCAL ] CSV: Loaded 13134 existing records from primary storage. [2025-09-17T18:18:09.139549] [INFO ] [MAIN ] CSV: Loaded 13134 existing records. [2025-09-17T18:18:09.220849] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-06. [2025-09-17T18:18:09.323109] [WARN ] [MAIN ] CSV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:18:09.323406] [INFO ] [MAIN ] CSV: Wiping existing primary data before full refresh. [2025-09-17T18:18:09.323453] [INFO ] [LOCAL ] CSV: Starting deletion of primary data. [2025-09-17T18:18:09.323901] [DEBUG] [LOCAL ] CSV: Deleted primary data file. [2025-09-17T18:18:09.323952] [INFO ] [MAIN ] CSV: Starting full primary refresh. [2025-09-17T18:18:09.679782] [INFO ] [REMOTE ] CSV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:18:10.015800] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-07. [2025-09-17T18:18:10.069625] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T18:18:10.815779] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-11. [2025-09-17T18:18:10.853024] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T18:18:11.484594] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T18:18:11.615780] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-07. [2025-09-17T18:18:11.768220] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T18:18:12.415822] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-08. [2025-09-17T18:18:13.201260] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T18:18:13.215718] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-08. [2025-09-17T18:18:13.770798] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T18:18:14.015788] [INFO ] [REMOTE ] CSV: Fetching primary data for 2024-12. [2025-09-17T18:18:14.815814] [INFO ] [REMOTE ] CSL: Fetching primary data for 2025-09. [2025-09-17T18:18:14.867108] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T18:18:14.956923] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T18:18:15.615790] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-01. [2025-09-17T18:18:16.101099] [INFO ] [REMOTE ] CSL: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T18:18:16.105947] [INFO ] [REMOTE ] CSL: Full fetch complete (44474 records). [2025-09-17T18:18:16.106083] [DEBUG] [VALIDATOR ] CSL: Validating primary data. [2025-09-17T18:18:16.420904] [INFO ] [REMOTE ] CSTM: Fetching primary data for 2025-09. [2025-09-17T18:18:16.493761] [DEBUG] [VALIDATOR ] CSL: All expected trading days are present. [2025-09-17T18:18:16.493878] [DEBUG] [VALIDATOR ] CSL: Primary data validation passed. [2025-09-17T18:18:16.494515] [INFO ] [MAIN ] CSL: Fetched primary data is valid. [2025-09-17T18:18:16.494564] [DEBUG] [LOCAL ] CSL: Saving primary data. [2025-09-17T18:18:16.495804] [DEBUG] [LOCAL ] CSL: Trimmed 44474 records to 31435 (keeping 200 days of data) [2025-09-17T18:18:16.702259] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T18:18:16.721284] [DEBUG] [LOCAL ] CSL: Primary data saved (31435 records). [2025-09-17T18:18:16.721441] [INFO ] [MAIN ] CSL: Full history saved. [2025-09-17T18:18:16.721527] [INFO ] [MAIN ] Update Progress: 538/2371 symbols completed. CSL took 40.2s. Estimated remaining: 4h 26m 36s. Rate: 6.9 symbols/min [2025-09-17T18:18:16.896159] [INFO ] [MAIN ] CSW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:18:16.896409] [DEBUG] [LOCAL ] CSW: No existing data file found in primary storage. [2025-09-17T18:18:16.896448] [WARN ] [MAIN ] CSW: No existing data found, performing full refresh instead. [2025-09-17T18:18:16.896597] [INFO ] [MAIN ] CSW: Wiping existing primary data before full refresh. [2025-09-17T18:18:16.896661] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-17T18:18:16.896707] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-17T18:18:16.896739] [INFO ] [MAIN ] CSW: Starting full primary refresh. [2025-09-17T18:18:17.221577] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-08. [2025-09-17T18:18:17.250099] [INFO ] [REMOTE ] CSW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:18:18.015876] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-02. [2025-09-17T18:18:18.222964] [INFO ] [REMOTE ] CSTM: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T18:18:18.229331] [INFO ] [REMOTE ] CSTM: Full fetch complete (68669 records). [2025-09-17T18:18:18.229483] [DEBUG] [VALIDATOR ] CSTM: Validating primary data. [2025-09-17T18:18:18.640226] [DEBUG] [VALIDATOR ] CSTM: All expected trading days are present. [2025-09-17T18:18:18.640329] [DEBUG] [VALIDATOR ] CSTM: Primary data validation passed. [2025-09-17T18:18:18.641166] [INFO ] [MAIN ] CSTM: Fetched primary data is valid. [2025-09-17T18:18:18.641216] [DEBUG] [LOCAL ] CSTM: Saving primary data. [2025-09-17T18:18:18.642843] [DEBUG] [LOCAL ] CSTM: Trimmed 68669 records to 47803 (keeping 200 days of data) [2025-09-17T18:18:18.782099] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T18:18:18.852190] [INFO ] [REMOTE ] CSAN: Fetching primary data for 2025-09. [2025-09-17T18:18:18.970271] [DEBUG] [LOCAL ] CSTM: Primary data saved (47803 records). [2025-09-17T18:18:18.970424] [INFO ] [MAIN ] CSTM: Full history saved. [2025-09-17T18:18:18.972171] [INFO ] [MAIN ] Update Progress: 539/2371 symbols completed. CSTM took 28.7s. Estimated remaining: 4h 26m 5s. Rate: 6.9 symbols/min [2025-09-17T18:18:19.144798] [INFO ] [MAIN ] CTBB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:18:19.153998] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T18:18:19.165397] [DEBUG] [LOCAL ] CTBB: Loaded 7339 existing records from primary storage. [2025-09-17T18:18:19.165527] [INFO ] [MAIN ] CTBB: Loaded 7339 existing records. [2025-09-17T18:18:19.353073] [WARN ] [MAIN ] CTBB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:18:19.353320] [INFO ] [MAIN ] CTBB: Wiping existing primary data before full refresh. [2025-09-17T18:18:19.353368] [INFO ] [LOCAL ] CTBB: Starting deletion of primary data. [2025-09-17T18:18:19.353731] [DEBUG] [LOCAL ] CTBB: Deleted primary data file. [2025-09-17T18:18:19.353814] [INFO ] [MAIN ] CTBB: Starting full primary refresh. [2025-09-17T18:18:19.624188] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-03. [2025-09-17T18:18:19.716749] [INFO ] [REMOTE ] CTBB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:18:20.336605] [INFO ] [REMOTE ] CSAN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T18:18:20.342538] [INFO ] [REMOTE ] CSAN: Full fetch complete (60721 records). [2025-09-17T18:18:20.342699] [DEBUG] [VALIDATOR ] CSAN: Validating primary data. [2025-09-17T18:18:20.420853] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-11. [2025-09-17T18:18:20.724723] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:20.743890] [DEBUG] [VALIDATOR ] CSAN: All expected trading days are present. [2025-09-17T18:18:20.744089] [WARN ] [REMOTE ] CSW: No data returned for month 2024-11 [2025-09-17T18:18:20.744141] [DEBUG] [VALIDATOR ] CSAN: Primary data validation passed. [2025-09-17T18:18:20.745474] [INFO ] [MAIN ] CSAN: Fetched primary data is valid. [2025-09-17T18:18:20.745579] [DEBUG] [LOCAL ] CSAN: Saving primary data. [2025-09-17T18:18:20.759964] [DEBUG] [LOCAL ] CSAN: Trimmed 60721 records to 42065 (keeping 200 days of data) [2025-09-17T18:18:20.759852] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T18:18:21.020706] [DEBUG] [LOCAL ] CSAN: Primary data saved (42065 records). [2025-09-17T18:18:21.020837] [INFO ] [MAIN ] CSAN: Full history saved. [2025-09-17T18:18:21.020925] [INFO ] [MAIN ] Update Progress: 540/2371 symbols completed. CSAN took 47.7s. Estimated remaining: 4h 25m 34s. Rate: 6.9 symbols/min [2025-09-17T18:18:21.190452] [INFO ] [MAIN ] CTDD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:18:21.197405] [DEBUG] [LOCAL ] CTDD: Loaded 5902 existing records from primary storage. [2025-09-17T18:18:21.197502] [INFO ] [MAIN ] CTDD: Loaded 5902 existing records. [2025-09-17T18:18:21.220846] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-04. [2025-09-17T18:18:21.386603] [WARN ] [MAIN ] CTDD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:18:21.386927] [INFO ] [MAIN ] CTDD: Wiping existing primary data before full refresh. [2025-09-17T18:18:21.387009] [INFO ] [LOCAL ] CTDD: Starting deletion of primary data. [2025-09-17T18:18:21.387306] [DEBUG] [LOCAL ] CTDD: Deleted primary data file. [2025-09-17T18:18:21.387352] [INFO ] [MAIN ] CTDD: Starting full primary refresh. [2025-09-17T18:18:21.764507] [INFO ] [REMOTE ] CTDD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:18:22.015785] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-11. [2025-09-17T18:18:22.465936] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T18:18:22.648288] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T18:18:22.815784] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-05. [2025-09-17T18:18:23.615994] [INFO ] [REMOTE ] CSW: Fetching primary data for 2024-12. [2025-09-17T18:18:23.716812] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T18:18:23.820828] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:23.821182] [WARN ] [REMOTE ] CSW: No data returned for month 2024-12 [2025-09-17T18:18:24.415815] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2024-12. [2025-09-17T18:18:25.161387] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T18:18:25.215920] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-11. [2025-09-17T18:18:26.015792] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-06. [2025-09-17T18:18:26.130394] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T18:18:26.592799] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T18:18:26.815773] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2024-12. [2025-09-17T18:18:27.615771] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-07. [2025-09-17T18:18:28.051197] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T18:18:28.221945] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T18:18:28.415767] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-01. [2025-09-17T18:18:28.862915] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T18:18:29.215742] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-02. [2025-09-17T18:18:29.806656] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T18:18:30.015824] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-03. [2025-09-17T18:18:30.753126] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T18:18:30.815857] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-04. [2025-09-17T18:18:31.529495] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T18:18:31.615836] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-08. [2025-09-17T18:18:32.415880] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-05. [2025-09-17T18:18:32.708000] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T18:18:32.986936] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T18:18:33.215818] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-01. [2025-09-17T18:18:34.015792] [INFO ] [REMOTE ] CSV: Fetching primary data for 2025-09. [2025-09-17T18:18:34.112581] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T18:18:34.808441] [INFO ] [REMOTE ] CSV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T18:18:34.810507] [INFO ] [REMOTE ] CSV: Full fetch complete (19263 records). [2025-09-17T18:18:34.810577] [DEBUG] [VALIDATOR ] CSV: Validating primary data. [2025-09-17T18:18:34.822066] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-01. [2025-09-17T18:18:35.088260] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:35.105886] [WARN ] [REMOTE ] CSW: No data returned for month 2025-01 [2025-09-17T18:18:35.189216] [DEBUG] [VALIDATOR ] CSV: All expected trading days are present. [2025-09-17T18:18:35.189289] [DEBUG] [VALIDATOR ] CSV: Primary data validation passed. [2025-09-17T18:18:35.189678] [INFO ] [MAIN ] CSV: Fetched primary data is valid. [2025-09-17T18:18:35.189717] [DEBUG] [LOCAL ] CSV: Saving primary data. [2025-09-17T18:18:35.190275] [DEBUG] [LOCAL ] CSV: Trimmed 19263 records to 13078 (keeping 200 days of data) [2025-09-17T18:18:35.276269] [DEBUG] [LOCAL ] CSV: Primary data saved (13078 records). [2025-09-17T18:18:35.276427] [INFO ] [MAIN ] CSV: Full history saved. [2025-09-17T18:18:35.276513] [INFO ] [MAIN ] Update Progress: 541/2371 symbols completed. CSV took 26.3s. Estimated remaining: 4h 25m 44s. Rate: 6.9 symbols/min [2025-09-17T18:18:35.450984] [INFO ] [MAIN ] CTEST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:18:35.451213] [DEBUG] [LOCAL ] CTEST: No existing data file found in primary storage. [2025-09-17T18:18:35.451255] [WARN ] [MAIN ] CTEST: No existing data found, performing full refresh instead. [2025-09-17T18:18:35.451361] [INFO ] [MAIN ] CTEST: Wiping existing primary data before full refresh. [2025-09-17T18:18:35.451400] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-17T18:18:35.451441] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-17T18:18:35.451474] [INFO ] [MAIN ] CTEST: Starting full primary refresh. [2025-09-17T18:18:35.616730] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-02. [2025-09-17T18:18:35.824112] [INFO ] [REMOTE ] CTEST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:18:35.963627] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:35.964194] [WARN ] [REMOTE ] CSW: No data returned for month 2025-02 [2025-09-17T18:18:36.415775] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-06. [2025-09-17T18:18:37.036705] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T18:18:37.215859] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-02. [2025-09-17T18:18:37.945123] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T18:18:38.015802] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-03. [2025-09-17T18:18:38.801962] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T18:18:38.815674] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-04. [2025-09-17T18:18:39.570009] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T18:18:39.615821] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-03. [2025-09-17T18:18:39.808057] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:39.808419] [WARN ] [REMOTE ] CSW: No data returned for month 2025-03 [2025-09-17T18:18:40.415822] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-04. [2025-09-17T18:18:40.611835] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:40.612183] [WARN ] [REMOTE ] CSW: No data returned for month 2025-04 [2025-09-17T18:18:41.215808] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-05. [2025-09-17T18:18:41.837950] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T18:18:42.015786] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-05. [2025-09-17T18:18:42.227521] [DEBUG] [REMOTE ] CSW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:42.227895] [WARN ] [REMOTE ] CSW: No data returned for month 2025-05 [2025-09-17T18:18:42.815798] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-06. [2025-09-17T18:18:43.589734] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T18:18:43.615774] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-11. [2025-09-17T18:18:43.928141] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-17T18:18:44.415826] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-06. [2025-09-17T18:18:45.215790] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2024-12. [2025-09-17T18:18:45.249321] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T18:18:45.404837] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:45.405155] [WARN ] [REMOTE ] CTEST: No data returned for month 2024-12 [2025-09-17T18:18:46.015778] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-01. [2025-09-17T18:18:46.233885] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:46.234324] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-01 [2025-09-17T18:18:46.815813] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-07. [2025-09-17T18:18:47.383011] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T18:18:47.615815] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-07. [2025-09-17T18:18:48.297219] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T18:18:48.415748] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-08. [2025-09-17T18:18:49.215820] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-02. [2025-09-17T18:18:49.518396] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T18:18:49.638258] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:49.638592] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-02 [2025-09-17T18:18:50.015781] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-08. [2025-09-17T18:18:50.815792] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-07. [2025-09-17T18:18:50.862292] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T18:18:51.516686] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T18:18:51.615760] [INFO ] [REMOTE ] CTBB: Fetching primary data for 2025-09. [2025-09-17T18:18:52.306401] [INFO ] [REMOTE ] CTBB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T18:18:52.308111] [INFO ] [REMOTE ] CTBB: Full fetch complete (11216 records). [2025-09-17T18:18:52.308223] [DEBUG] [VALIDATOR ] CTBB: Validating primary data. [2025-09-17T18:18:52.416784] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-08. [2025-09-17T18:18:52.687458] [DEBUG] [VALIDATOR ] CTBB: All expected trading days are present. [2025-09-17T18:18:52.687545] [DEBUG] [VALIDATOR ] CTBB: Primary data validation passed. [2025-09-17T18:18:52.687891] [INFO ] [MAIN ] CTBB: Fetched primary data is valid. [2025-09-17T18:18:52.687960] [DEBUG] [LOCAL ] CTBB: Saving primary data. [2025-09-17T18:18:52.688590] [DEBUG] [LOCAL ] CTBB: Trimmed 11216 records to 7279 (keeping 200 days of data) [2025-09-17T18:18:52.736557] [DEBUG] [LOCAL ] CTBB: Primary data saved (7279 records). [2025-09-17T18:18:52.736773] [INFO ] [MAIN ] CTBB: Full history saved. [2025-09-17T18:18:52.736907] [INFO ] [MAIN ] Update Progress: 542/2371 symbols completed. CTBB took 33.8s. Estimated remaining: 4h 26m 4s. Rate: 6.9 symbols/min [2025-09-17T18:18:52.913241] [INFO ] [MAIN ] CTEV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:18:52.913448] [DEBUG] [LOCAL ] CTEV: No existing data file found in primary storage. [2025-09-17T18:18:52.913486] [WARN ] [MAIN ] CTEV: No existing data found, performing full refresh instead. [2025-09-17T18:18:52.913611] [INFO ] [MAIN ] CTEV: Wiping existing primary data before full refresh. [2025-09-17T18:18:52.913669] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-17T18:18:52.913733] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-17T18:18:52.913785] [INFO ] [MAIN ] CTEV: Starting full primary refresh. [2025-09-17T18:18:53.223957] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-03. [2025-09-17T18:18:53.277306] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T18:18:53.351686] [INFO ] [REMOTE ] CTEV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:18:53.480562] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:53.480880] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-03 [2025-09-17T18:18:54.015817] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-04. [2025-09-17T18:18:54.320055] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:54.320366] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-04 [2025-09-17T18:18:54.815778] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-05. [2025-09-17T18:18:55.615817] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-11. [2025-09-17T18:18:55.648552] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T18:18:55.810566] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:55.810935] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-11 [2025-09-17T18:18:56.415836] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-06. [2025-09-17T18:18:56.663576] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-06 (0.25 seconds). [2025-09-17T18:18:57.215832] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-07. [2025-09-17T18:18:57.422578] [INFO ] [REMOTE ] CTEST: Incremental fetch complete for 2025-07 (0.21 seconds). [2025-09-17T18:18:58.015770] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-08. [2025-09-17T18:18:58.248005] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:58.248396] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-08 [2025-09-17T18:18:58.815803] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2024-12. [2025-09-17T18:18:59.011076] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:18:59.011422] [WARN ] [REMOTE ] CTEV: No data returned for month 2024-12 [2025-09-17T18:18:59.615828] [INFO ] [REMOTE ] CTDD: Fetching primary data for 2025-09. [2025-09-17T18:19:00.199015] [INFO ] [REMOTE ] CTDD: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T18:19:00.200325] [INFO ] [REMOTE ] CTDD: Full fetch complete (8627 records). [2025-09-17T18:19:00.200399] [DEBUG] [VALIDATOR ] CTDD: Validating primary data. [2025-09-17T18:19:00.420901] [INFO ] [REMOTE ] CTEST: Fetching primary data for 2025-09. [2025-09-17T18:19:00.572233] [DEBUG] [VALIDATOR ] CTDD: All expected trading days are present. [2025-09-17T18:19:00.572318] [DEBUG] [VALIDATOR ] CTDD: Primary data validation passed. [2025-09-17T18:19:00.572540] [INFO ] [MAIN ] CTDD: Fetched primary data is valid. [2025-09-17T18:19:00.572579] [DEBUG] [LOCAL ] CTDD: Saving primary data. [2025-09-17T18:19:00.573012] [DEBUG] [LOCAL ] CTDD: Trimmed 8627 records to 5877 (keeping 200 days of data) [2025-09-17T18:19:00.610387] [DEBUG] [LOCAL ] CTDD: Primary data saved (5877 records). [2025-09-17T18:19:00.610489] [INFO ] [MAIN ] CTDD: Full history saved. [2025-09-17T18:19:00.610579] [INFO ] [MAIN ] Update Progress: 543/2371 symbols completed. CTDD took 39.6s. Estimated remaining: 4h 25m 53s. Rate: 6.9 symbols/min [2025-09-17T18:19:00.776413] [INFO ] [MAIN ] CTO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:19:00.813633] [DEBUG] [LOCAL ] CTO: Loaded 28582 existing records from primary storage. [2025-09-17T18:19:00.813822] [INFO ] [MAIN ] CTO: Loaded 28582 existing records. [2025-09-17T18:19:00.965101] [DEBUG] [REMOTE ] CTEST: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:19:00.974261] [WARN ] [REMOTE ] CTEST: No data returned for month 2025-09 [2025-09-17T18:19:00.990219] [INFO ] [REMOTE ] CTEST: Full fetch complete (1021 records). [2025-09-17T18:19:00.993427] [DEBUG] [VALIDATOR ] CTEST: Validating primary data. [2025-09-17T18:19:00.993536] [WARN ] [MAIN ] CTO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:19:00.994435] [FATAL] [VALIDATOR ] CTEST: Data is stale - most recent date (2025-07-02) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:19:00.994709] [INFO ] [MAIN ] CTO: Wiping existing primary data before full refresh. [2025-09-17T18:19:00.994603] [FATAL] [MAIN ] CTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:19:00.994831] [INFO ] [LOCAL ] CTO: Starting deletion of primary data. [2025-09-17T18:19:00.994870] [WARN ] [MAIN ] CTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:19:00.994998] [INFO ] [LOCAL ] CTEST: Starting deletion of primary data. [2025-09-17T18:19:00.995068] [DEBUG] [LOCAL ] CTEST: No primary data file found to delete. [2025-09-17T18:19:00.995116] [INFO ] [LOCAL ] CTEST: Starting deletion of derivative data. [2025-09-17T18:19:00.995166] [DEBUG] [LOCAL ] CTEST: No derivative data file found to delete. [2025-09-17T18:19:00.995231] [INFO ] [MAIN ] Update Progress: 544/2371 symbols completed. CTEST took 25.7s. Estimated remaining: 4h 25m 16s. Rate: 6.9 symbols/min [2025-09-17T18:19:01.027517] [DEBUG] [LOCAL ] CTO: Deleted primary data file. [2025-09-17T18:19:01.071679] [INFO ] [MAIN ] CTO: Starting full primary refresh. [2025-09-17T18:19:01.220944] [INFO ] [REMOTE ] CSW: Fetching primary data for 2025-09. [2025-09-17T18:19:01.284739] [INFO ] [MAIN ] CTOS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:19:01.596625] [INFO ] [REMOTE ] CTO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:19:01.598414] [DEBUG] [LOCAL ] CTOS: Loaded 37086 existing records from primary storage. [2025-09-17T18:19:01.598600] [INFO ] [MAIN ] CTOS: Loaded 37086 existing records. [2025-09-17T18:19:01.798116] [WARN ] [MAIN ] CTOS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:19:01.798424] [INFO ] [MAIN ] CTOS: Wiping existing primary data before full refresh. [2025-09-17T18:19:01.798492] [INFO ] [LOCAL ] CTOS: Starting deletion of primary data. [2025-09-17T18:19:01.799352] [DEBUG] [LOCAL ] CTOS: Deleted primary data file. [2025-09-17T18:19:01.799416] [INFO ] [MAIN ] CTOS: Starting full primary refresh. [2025-09-17T18:19:02.026732] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-01. [2025-09-17T18:19:02.192929] [INFO ] [REMOTE ] CTOS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:19:02.386352] [DEBUG] [REMOTE ] CTEV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:19:02.386742] [WARN ] [REMOTE ] CTEV: No data returned for month 2025-01 [2025-09-17T18:19:02.401599] [INFO ] [REMOTE ] CSW: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T18:19:02.404224] [INFO ] [REMOTE ] CSW: Full fetch complete (7445 records). [2025-09-17T18:19:02.404294] [DEBUG] [VALIDATOR ] CSW: Validating primary data. [2025-09-17T18:19:02.587766] [WARN ] [VALIDATOR ] CSW: Validation failed - insufficient historical data. Have 70 unique days, need 200 days [2025-09-17T18:19:02.587987] [FATAL] [MAIN ] CSW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:19:02.588034] [WARN ] [MAIN ] CSW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:19:02.588074] [INFO ] [LOCAL ] CSW: Starting deletion of primary data. [2025-09-17T18:19:02.588129] [DEBUG] [LOCAL ] CSW: No primary data file found to delete. [2025-09-17T18:19:02.588164] [INFO ] [LOCAL ] CSW: Starting deletion of derivative data. [2025-09-17T18:19:02.588212] [DEBUG] [LOCAL ] CSW: No derivative data file found to delete. [2025-09-17T18:19:02.588272] [INFO ] [MAIN ] Update Progress: 545/2371 symbols completed. CSW took 45.9s. Estimated remaining: 4h 24m 44s. Rate: 6.9 symbols/min [2025-09-17T18:19:02.761011] [INFO ] [MAIN ] CTRA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:19:02.817835] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-02. [2025-09-17T18:19:02.820974] [DEBUG] [LOCAL ] CTRA: Loaded 53650 existing records from primary storage. [2025-09-17T18:19:02.821066] [INFO ] [MAIN ] CTRA: Loaded 53650 existing records. [2025-09-17T18:19:02.999978] [WARN ] [MAIN ] CTRA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:19:03.000201] [INFO ] [MAIN ] CTRA: Wiping existing primary data before full refresh. [2025-09-17T18:19:03.000245] [INFO ] [LOCAL ] CTRA: Starting deletion of primary data. [2025-09-17T18:19:03.001547] [DEBUG] [LOCAL ] CTRA: Deleted primary data file. [2025-09-17T18:19:03.001597] [INFO ] [MAIN ] CTRA: Starting full primary refresh. [2025-09-17T18:19:03.332118] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T18:19:03.366858] [INFO ] [REMOTE ] CTRA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:19:03.615818] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-11. [2025-09-17T18:19:04.415785] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-03. [2025-09-17T18:19:05.133258] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T18:19:05.150471] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T18:19:05.215754] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2024-12. [2025-09-17T18:19:06.015775] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-11. [2025-09-17T18:19:06.628853] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T18:19:06.815763] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-04. [2025-09-17T18:19:07.580272] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T18:19:07.615725] [INFO ] [REMOTE ] CTO: Fetching primary data for 2024-12. [2025-09-17T18:19:07.674120] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T18:19:08.415774] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-01. [2025-09-17T18:19:09.051218] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T18:19:09.215771] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-01. [2025-09-17T18:19:09.867487] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T18:19:10.015751] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-02. [2025-09-17T18:19:10.497696] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T18:19:10.815797] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-05. [2025-09-17T18:19:11.615745] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-02. [2025-09-17T18:19:11.669694] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T18:19:11.736347] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T18:19:12.415793] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-03. [2025-09-17T18:19:12.905095] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T18:19:13.215842] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-06. [2025-09-17T18:19:13.831161] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T18:19:14.015757] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-04. [2025-09-17T18:19:14.273533] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T18:19:14.815788] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-07. [2025-09-17T18:19:15.615796] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-11. [2025-09-17T18:19:15.645684] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T18:19:15.672432] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T18:19:16.415826] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-08. [2025-09-17T18:19:17.215813] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-05. [2025-09-17T18:19:17.461039] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T18:19:17.516520] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T18:19:18.015777] [INFO ] [REMOTE ] CTEV: Fetching primary data for 2025-09. [2025-09-17T18:19:18.432590] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T18:19:18.815833] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-03. [2025-09-17T18:19:18.989874] [INFO ] [REMOTE ] CTEV: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T18:19:18.993244] [INFO ] [REMOTE ] CTEV: Full fetch complete (13113 records). [2025-09-17T18:19:18.993365] [DEBUG] [VALIDATOR ] CTEV: Validating primary data. [2025-09-17T18:19:19.278147] [WARN ] [VALIDATOR ] CTEV: Validation failed - insufficient historical data. Have 139 unique days, need 200 days [2025-09-17T18:19:19.278494] [FATAL] [MAIN ] CTEV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:19:19.278586] [WARN ] [MAIN ] CTEV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:19:19.278665] [INFO ] [LOCAL ] CTEV: Starting deletion of primary data. [2025-09-17T18:19:19.278762] [DEBUG] [LOCAL ] CTEV: No primary data file found to delete. [2025-09-17T18:19:19.278803] [INFO ] [LOCAL ] CTEV: Starting deletion of derivative data. [2025-09-17T18:19:19.278843] [DEBUG] [LOCAL ] CTEV: No derivative data file found to delete. [2025-09-17T18:19:19.278908] [INFO ] [MAIN ] Update Progress: 546/2371 symbols completed. CTEV took 26.5s. Estimated remaining: 4h 25m 2s. Rate: 6.9 symbols/min [2025-09-17T18:19:19.489282] [INFO ] [MAIN ] CTRE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:19:19.540188] [DEBUG] [LOCAL ] CTRE: Loaded 49196 existing records from primary storage. [2025-09-17T18:19:19.540370] [INFO ] [MAIN ] CTRE: Loaded 49196 existing records. [2025-09-17T18:19:19.620926] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-06. [2025-09-17T18:19:19.726311] [WARN ] [MAIN ] CTRE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:19:19.726585] [INFO ] [MAIN ] CTRE: Wiping existing primary data before full refresh. [2025-09-17T18:19:19.726633] [INFO ] [LOCAL ] CTRE: Starting deletion of primary data. [2025-09-17T18:19:19.727734] [DEBUG] [LOCAL ] CTRE: Deleted primary data file. [2025-09-17T18:19:19.727788] [INFO ] [MAIN ] CTRE: Starting full primary refresh. [2025-09-17T18:19:20.093562] [INFO ] [REMOTE ] CTRE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:19:20.344236] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T18:19:20.415794] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-04. [2025-09-17T18:19:20.623437] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T18:19:21.215754] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-11. [2025-09-17T18:19:21.399754] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T18:19:22.015812] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2024-12. [2025-09-17T18:19:22.815762] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-05. [2025-09-17T18:19:22.910161] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T18:19:23.615717] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2024-12. [2025-09-17T18:19:23.850041] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T18:19:23.908454] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T18:19:24.415771] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-06. [2025-09-17T18:19:25.215780] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-01. [2025-09-17T18:19:25.346586] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T18:19:25.599705] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T18:19:26.015790] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-07. [2025-09-17T18:19:26.815801] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-01. [2025-09-17T18:19:27.414217] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-17T18:19:27.587046] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T18:19:27.615764] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-08. [2025-09-17T18:19:28.415750] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-02. [2025-09-17T18:19:28.450650] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T18:19:29.014492] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T18:19:29.215892] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-02. [2025-09-17T18:19:30.015799] [INFO ] [REMOTE ] CTOS: Fetching primary data for 2025-09. [2025-09-17T18:19:30.056864] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T18:19:30.815795] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-03. [2025-09-17T18:19:30.907530] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T18:19:31.451925] [INFO ] [REMOTE ] CTOS: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T18:19:31.457010] [INFO ] [REMOTE ] CTOS: Full fetch complete (53327 records). [2025-09-17T18:19:31.457224] [DEBUG] [VALIDATOR ] CTOS: Validating primary data. [2025-09-17T18:19:31.620789] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-03. [2025-09-17T18:19:31.869445] [DEBUG] [VALIDATOR ] CTOS: All expected trading days are present. [2025-09-17T18:19:31.869527] [DEBUG] [VALIDATOR ] CTOS: Primary data validation passed. [2025-09-17T18:19:31.870242] [INFO ] [MAIN ] CTOS: Fetched primary data is valid. [2025-09-17T18:19:31.870288] [DEBUG] [LOCAL ] CTOS: Saving primary data. [2025-09-17T18:19:31.871433] [DEBUG] [LOCAL ] CTOS: Trimmed 53327 records to 37050 (keeping 200 days of data) [2025-09-17T18:19:32.087688] [DEBUG] [LOCAL ] CTOS: Primary data saved (37050 records). [2025-09-17T18:19:32.087873] [INFO ] [MAIN ] CTOS: Full history saved. [2025-09-17T18:19:32.087961] [INFO ] [MAIN ] Update Progress: 547/2371 symbols completed. CTOS took 31.1s. Estimated remaining: 4h 25m 6s. Rate: 6.9 symbols/min [2025-09-17T18:19:32.262486] [INFO ] [MAIN ] CTRI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:19:32.301328] [DEBUG] [LOCAL ] CTRI: Loaded 37167 existing records from primary storage. [2025-09-17T18:19:32.301478] [INFO ] [MAIN ] CTRI: Loaded 37167 existing records. [2025-09-17T18:19:32.421001] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-07. [2025-09-17T18:19:32.481802] [WARN ] [MAIN ] CTRI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:19:32.482104] [INFO ] [MAIN ] CTRI: Wiping existing primary data before full refresh. [2025-09-17T18:19:32.482163] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-17T18:19:32.482931] [DEBUG] [LOCAL ] CTRI: Deleted primary data file. [2025-09-17T18:19:32.482981] [INFO ] [MAIN ] CTRI: Starting full primary refresh. [2025-09-17T18:19:32.844107] [INFO ] [REMOTE ] CTRI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:19:32.875760] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T18:19:33.215843] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-11. [2025-09-17T18:19:33.456800] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T18:19:33.560215] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T18:19:34.015836] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-08. [2025-09-17T18:19:34.689086] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T18:19:34.815729] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2024-12. [2025-09-17T18:19:35.197675] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T18:19:35.615794] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-04. [2025-09-17T18:19:35.932605] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T18:19:36.415817] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-01. [2025-09-17T18:19:37.215757] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-04. [2025-09-17T18:19:37.332870] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T18:19:37.432379] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T18:19:38.015837] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-05. [2025-09-17T18:19:38.509455] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T18:19:38.815824] [INFO ] [REMOTE ] CTO: Fetching primary data for 2025-09. [2025-09-17T18:19:39.615826] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-05. [2025-09-17T18:19:39.939787] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T18:19:40.057041] [INFO ] [REMOTE ] CTO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T18:19:40.060996] [INFO ] [REMOTE ] CTO: Full fetch complete (41915 records). [2025-09-17T18:19:40.061109] [DEBUG] [VALIDATOR ] CTO: Validating primary data. [2025-09-17T18:19:40.417367] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-02. [2025-09-17T18:19:40.440548] [DEBUG] [VALIDATOR ] CTO: All expected trading days are present. [2025-09-17T18:19:40.440667] [DEBUG] [VALIDATOR ] CTO: Primary data validation passed. [2025-09-17T18:19:40.442460] [INFO ] [MAIN ] CTO: Fetched primary data is valid. [2025-09-17T18:19:40.442513] [DEBUG] [LOCAL ] CTO: Saving primary data. [2025-09-17T18:19:40.443702] [DEBUG] [LOCAL ] CTO: Trimmed 41915 records to 28505 (keeping 200 days of data) [2025-09-17T18:19:40.630252] [DEBUG] [LOCAL ] CTO: Primary data saved (28505 records). [2025-09-17T18:19:40.630422] [INFO ] [MAIN ] CTO: Full history saved. [2025-09-17T18:19:40.630514] [INFO ] [MAIN ] Update Progress: 548/2371 symbols completed. CTO took 40.0s. Estimated remaining: 4h 24m 57s. Rate: 6.9 symbols/min [2025-09-17T18:19:40.801476] [INFO ] [MAIN ] CTS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:19:40.819145] [DEBUG] [LOCAL ] CTS: Loaded 19337 existing records from primary storage. [2025-09-17T18:19:40.819292] [INFO ] [MAIN ] CTS: Loaded 19337 existing records. [2025-09-17T18:19:40.998941] [WARN ] [MAIN ] CTS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:19:40.999283] [INFO ] [MAIN ] CTS: Wiping existing primary data before full refresh. [2025-09-17T18:19:40.999370] [INFO ] [LOCAL ] CTS: Starting deletion of primary data. [2025-09-17T18:19:41.000049] [DEBUG] [LOCAL ] CTS: Deleted primary data file. [2025-09-17T18:19:41.000202] [INFO ] [MAIN ] CTS: Starting full primary refresh. [2025-09-17T18:19:41.226027] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-06. [2025-09-17T18:19:41.239015] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T18:19:41.410486] [INFO ] [REMOTE ] CTS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:19:41.732954] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T18:19:42.015808] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-06. [2025-09-17T18:19:42.815826] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-03. [2025-09-17T18:19:43.017820] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T18:19:43.615842] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-07. [2025-09-17T18:19:43.744950] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T18:19:44.037944] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T18:19:44.415792] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-07. [2025-09-17T18:19:45.215796] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-11. [2025-09-17T18:19:45.618081] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T18:19:45.847177] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T18:19:46.015738] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-08. [2025-09-17T18:19:46.364693] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T18:19:46.815886] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-08. [2025-09-17T18:19:47.615805] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-04. [2025-09-17T18:19:47.787664] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T18:19:48.415821] [INFO ] [REMOTE ] CTRE: Fetching primary data for 2025-09. [2025-09-17T18:19:48.668070] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T18:19:48.975949] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T18:19:49.215796] [INFO ] [REMOTE ] CTS: Fetching primary data for 2024-12. [2025-09-17T18:19:49.930136] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T18:19:50.015770] [INFO ] [REMOTE ] CTRA: Fetching primary data for 2025-09. [2025-09-17T18:19:50.181346] [INFO ] [REMOTE ] CTRE: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T18:19:50.188038] [INFO ] [REMOTE ] CTRE: Full fetch complete (70887 records). [2025-09-17T18:19:50.188158] [DEBUG] [VALIDATOR ] CTRE: Validating primary data. [2025-09-17T18:19:50.581058] [DEBUG] [VALIDATOR ] CTRE: All expected trading days are present. [2025-09-17T18:19:50.581143] [DEBUG] [VALIDATOR ] CTRE: Primary data validation passed. [2025-09-17T18:19:50.582030] [INFO ] [MAIN ] CTRE: Fetched primary data is valid. [2025-09-17T18:19:50.582078] [DEBUG] [LOCAL ] CTRE: Saving primary data. [2025-09-17T18:19:50.583489] [DEBUG] [LOCAL ] CTRE: Trimmed 70887 records to 49196 (keeping 200 days of data) [2025-09-17T18:19:50.816021] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-01. [2025-09-17T18:19:50.881066] [DEBUG] [LOCAL ] CTRE: Primary data saved (49196 records). [2025-09-17T18:19:50.881194] [INFO ] [MAIN ] CTRE: Full history saved. [2025-09-17T18:19:50.881916] [INFO ] [MAIN ] Update Progress: 549/2371 symbols completed. CTRE took 31.6s. Estimated remaining: 4h 24m 54s. Rate: 6.9 symbols/min [2025-09-17T18:19:51.049580] [INFO ] [MAIN ] CTVA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:19:51.100938] [DEBUG] [LOCAL ] CTVA: Loaded 53231 existing records from primary storage. [2025-09-17T18:19:51.101079] [INFO ] [MAIN ] CTVA: Loaded 53231 existing records. [2025-09-17T18:19:51.281981] [WARN ] [MAIN ] CTVA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:19:51.282197] [INFO ] [MAIN ] CTVA: Wiping existing primary data before full refresh. [2025-09-17T18:19:51.282249] [INFO ] [LOCAL ] CTVA: Starting deletion of primary data. [2025-09-17T18:19:51.283177] [DEBUG] [LOCAL ] CTVA: Deleted primary data file. [2025-09-17T18:19:51.283225] [INFO ] [MAIN ] CTVA: Starting full primary refresh. [2025-09-17T18:19:51.625322] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-05. [2025-09-17T18:19:51.647892] [INFO ] [REMOTE ] CTVA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:19:51.683332] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T18:19:51.870055] [INFO ] [REMOTE ] CTRA: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T18:19:51.877152] [INFO ] [REMOTE ] CTRA: Full fetch complete (77509 records). [2025-09-17T18:19:51.877296] [DEBUG] [VALIDATOR ] CTRA: Validating primary data. [2025-09-17T18:19:52.289343] [DEBUG] [VALIDATOR ] CTRA: All expected trading days are present. [2025-09-17T18:19:52.289458] [DEBUG] [VALIDATOR ] CTRA: Primary data validation passed. [2025-09-17T18:19:52.290406] [INFO ] [MAIN ] CTRA: Fetched primary data is valid. [2025-09-17T18:19:52.290485] [DEBUG] [LOCAL ] CTRA: Saving primary data. [2025-09-17T18:19:52.292112] [DEBUG] [LOCAL ] CTRA: Trimmed 77509 records to 53649 (keeping 200 days of data) [2025-09-17T18:19:52.415822] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-11. [2025-09-17T18:19:52.627684] [DEBUG] [LOCAL ] CTRA: Primary data saved (53649 records). [2025-09-17T18:19:52.627833] [INFO ] [MAIN ] CTRA: Full history saved. [2025-09-17T18:19:52.628874] [INFO ] [MAIN ] Update Progress: 550/2371 symbols completed. CTRA took 50.0s. Estimated remaining: 4h 24m 22s. Rate: 6.9 symbols/min [2025-09-17T18:19:52.798152] [INFO ] [MAIN ] CUBB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:19:52.798356] [DEBUG] [LOCAL ] CUBB: No existing data file found in primary storage. [2025-09-17T18:19:52.798394] [WARN ] [MAIN ] CUBB: No existing data found, performing full refresh instead. [2025-09-17T18:19:52.798511] [INFO ] [MAIN ] CUBB: Wiping existing primary data before full refresh. [2025-09-17T18:19:52.798548] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-17T18:19:52.798588] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-17T18:19:52.798622] [INFO ] [MAIN ] CUBB: Starting full primary refresh. [2025-09-17T18:19:53.163443] [INFO ] [REMOTE ] CUBB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:19:53.183708] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T18:19:53.215732] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-06. [2025-09-17T18:19:54.015767] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-11. [2025-09-17T18:19:54.231236] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T18:19:54.313460] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T18:19:54.459632] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T18:19:54.815784] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-07. [2025-09-17T18:19:55.615813] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2024-12. [2025-09-17T18:19:56.256496] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T18:19:56.415771] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2024-12. [2025-09-17T18:19:56.756432] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-17T18:19:57.215808] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-01. [2025-09-17T18:19:57.358781] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T18:19:57.590262] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-17T18:19:58.015805] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-01. [2025-09-17T18:19:58.815789] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-02. [2025-09-17T18:19:59.615783] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-08. [2025-09-17T18:19:59.653501] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T18:19:59.866849] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T18:20:00.415802] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-02. [2025-09-17T18:20:00.773638] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-17T18:20:01.224495] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-02. [2025-09-17T18:20:01.244872] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T18:20:02.015842] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-03. [2025-09-17T18:20:02.815786] [INFO ] [REMOTE ] CTRI: Fetching primary data for 2025-09. [2025-09-17T18:20:02.973839] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T18:20:03.009437] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T18:20:03.615793] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-04. [2025-09-17T18:20:04.262149] [INFO ] [REMOTE ] CTRI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T18:20:04.268948] [INFO ] [REMOTE ] CTRI: Full fetch complete (49899 records). [2025-09-17T18:20:04.269241] [DEBUG] [VALIDATOR ] CTRI: Validating primary data. [2025-09-17T18:20:04.270470] [FATAL] [VALIDATOR ] CTRI: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:20:04.270563] [FATAL] [MAIN ] CTRI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:20:04.270602] [WARN ] [MAIN ] CTRI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:20:04.270667] [INFO ] [LOCAL ] CTRI: Starting deletion of primary data. [2025-09-17T18:20:04.270738] [DEBUG] [LOCAL ] CTRI: No primary data file found to delete. [2025-09-17T18:20:04.270785] [INFO ] [LOCAL ] CTRI: Starting deletion of derivative data. [2025-09-17T18:20:04.271368] [DEBUG] [LOCAL ] CTRI: Deleted derivative data file. [2025-09-17T18:20:04.271478] [INFO ] [MAIN ] Update Progress: 551/2371 symbols completed. CTRI took 32.2s. Estimated remaining: 4h 24m 23s. Rate: 6.9 symbols/min [2025-09-17T18:20:04.421433] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-03. [2025-09-17T18:20:04.456954] [INFO ] [MAIN ] CUBE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:20:04.506064] [DEBUG] [LOCAL ] CUBE: Loaded 50775 existing records from primary storage. [2025-09-17T18:20:04.506222] [INFO ] [MAIN ] CUBE: Loaded 50775 existing records. [2025-09-17T18:20:04.704009] [WARN ] [MAIN ] CUBE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:20:04.704293] [INFO ] [MAIN ] CUBE: Wiping existing primary data before full refresh. [2025-09-17T18:20:04.704342] [INFO ] [LOCAL ] CUBE: Starting deletion of primary data. [2025-09-17T18:20:04.705368] [DEBUG] [LOCAL ] CUBE: Deleted primary data file. [2025-09-17T18:20:04.705423] [INFO ] [MAIN ] CUBE: Starting full primary refresh. [2025-09-17T18:20:05.099147] [INFO ] [REMOTE ] CUBE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:20:05.100816] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T18:20:05.215785] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-11. [2025-09-17T18:20:06.015772] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-05. [2025-09-17T18:20:06.439493] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T18:20:06.602510] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T18:20:06.815788] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2024-12. [2025-09-17T18:20:07.091018] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T18:20:07.615790] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-06. [2025-09-17T18:20:08.290865] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T18:20:08.415767] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-07. [2025-09-17T18:20:08.536803] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T18:20:09.215753] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-01. [2025-09-17T18:20:09.613886] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T18:20:10.015788] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-08. [2025-09-17T18:20:10.794413] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T18:20:10.815722] [INFO ] [REMOTE ] CTS: Fetching primary data for 2025-09. [2025-09-17T18:20:10.908574] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T18:20:11.615776] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-04. [2025-09-17T18:20:12.415788] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-02. [2025-09-17T18:20:12.449192] [INFO ] [REMOTE ] CTS: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T18:20:12.452026] [INFO ] [REMOTE ] CTS: Full fetch complete (26375 records). [2025-09-17T18:20:12.452122] [DEBUG] [VALIDATOR ] CTS: Validating primary data. [2025-09-17T18:20:12.833111] [DEBUG] [VALIDATOR ] CTS: All expected trading days are present. [2025-09-17T18:20:12.833196] [DEBUG] [VALIDATOR ] CTS: Primary data validation passed. [2025-09-17T18:20:12.833727] [INFO ] [MAIN ] CTS: Fetched primary data is valid. [2025-09-17T18:20:12.833776] [DEBUG] [LOCAL ] CTS: Saving primary data. [2025-09-17T18:20:12.834620] [DEBUG] [LOCAL ] CTS: Trimmed 26375 records to 19336 (keeping 200 days of data) [2025-09-17T18:20:12.957161] [DEBUG] [LOCAL ] CTS: Primary data saved (19336 records). [2025-09-17T18:20:12.957408] [INFO ] [MAIN ] CTS: Full history saved. [2025-09-17T18:20:12.957523] [INFO ] [MAIN ] Update Progress: 552/2371 symbols completed. CTS took 32.3s. Estimated remaining: 4h 24m 14s. Rate: 6.9 symbols/min [2025-09-17T18:20:13.169141] [INFO ] [MAIN ] CUBI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:20:13.228370] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-03. [2025-09-17T18:20:13.252200] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T18:20:13.249448] [DEBUG] [LOCAL ] CUBI: Loaded 27203 existing records from primary storage. [2025-09-17T18:20:13.269709] [INFO ] [MAIN ] CUBI: Loaded 27203 existing records. [2025-09-17T18:20:13.542705] [WARN ] [MAIN ] CUBI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:20:13.543052] [INFO ] [MAIN ] CUBI: Wiping existing primary data before full refresh. [2025-09-17T18:20:13.543124] [INFO ] [LOCAL ] CUBI: Starting deletion of primary data. [2025-09-17T18:20:13.543917] [DEBUG] [LOCAL ] CUBI: Deleted primary data file. [2025-09-17T18:20:13.543997] [INFO ] [MAIN ] CUBI: Starting full primary refresh. [2025-09-17T18:20:13.754163] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T18:20:14.027213] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-04. [2025-09-17T18:20:14.061667] [INFO ] [REMOTE ] CUBI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:20:14.095688] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T18:20:14.413610] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-17T18:20:14.815788] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-05. [2025-09-17T18:20:15.615786] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-05. [2025-09-17T18:20:15.968030] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-17T18:20:16.415818] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-03. [2025-09-17T18:20:16.781396] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T18:20:17.215770] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-06. [2025-09-17T18:20:18.015791] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-06. [2025-09-17T18:20:18.704846] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-17T18:20:18.778507] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T18:20:18.815738] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-07. [2025-09-17T18:20:19.152394] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-17T18:20:19.155506] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T18:20:19.615772] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-04. [2025-09-17T18:20:20.415784] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-11. [2025-09-17T18:20:21.215779] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-07. [2025-09-17T18:20:21.447222] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T18:20:21.571979] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T18:20:22.015777] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-05. [2025-09-17T18:20:22.815841] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-08. [2025-09-17T18:20:23.120697] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T18:20:23.171402] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-17T18:20:23.625858] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-08. [2025-09-17T18:20:23.649396] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T18:20:24.415785] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-06. [2025-09-17T18:20:25.215786] [INFO ] [REMOTE ] CUBB: Fetching primary data for 2025-09. [2025-09-17T18:20:25.463260] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T18:20:26.015768] [INFO ] [REMOTE ] CTVA: Fetching primary data for 2025-09. [2025-09-17T18:20:26.053777] [INFO ] [REMOTE ] CUBB: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T18:20:26.054505] [INFO ] [REMOTE ] CUBB: Full fetch complete (922 records). [2025-09-17T18:20:26.054574] [DEBUG] [VALIDATOR ] CUBB: Validating primary data. [2025-09-17T18:20:26.296710] [WARN ] [VALIDATOR ] CUBB: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T18:20:26.306631] [FATAL] [MAIN ] CUBB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:20:26.306709] [WARN ] [MAIN ] CUBB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:20:26.307204] [INFO ] [LOCAL ] CUBB: Starting deletion of primary data. [2025-09-17T18:20:26.307279] [DEBUG] [LOCAL ] CUBB: No primary data file found to delete. [2025-09-17T18:20:26.308222] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T18:20:26.308342] [INFO ] [LOCAL ] CUBB: Starting deletion of derivative data. [2025-09-17T18:20:26.317827] [DEBUG] [LOCAL ] CUBB: No derivative data file found to delete. [2025-09-17T18:20:26.318216] [INFO ] [MAIN ] Update Progress: 553/2371 symbols completed. CUBB took 33.7s. Estimated remaining: 4h 24m 20s. Rate: 6.9 symbols/min [2025-09-17T18:20:26.492545] [INFO ] [MAIN ] CUK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:20:26.548365] [DEBUG] [LOCAL ] CUK: Loaded 51034 existing records from primary storage. [2025-09-17T18:20:26.548509] [INFO ] [MAIN ] CUK: Loaded 51034 existing records. [2025-09-17T18:20:26.726230] [WARN ] [MAIN ] CUK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:20:26.726493] [INFO ] [MAIN ] CUK: Wiping existing primary data before full refresh. [2025-09-17T18:20:26.726546] [INFO ] [LOCAL ] CUK: Starting deletion of primary data. [2025-09-17T18:20:26.727404] [DEBUG] [LOCAL ] CUK: Deleted primary data file. [2025-09-17T18:20:26.727454] [INFO ] [MAIN ] CUK: Starting full primary refresh. [2025-09-17T18:20:26.820929] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2024-12. [2025-09-17T18:20:27.090846] [INFO ] [REMOTE ] CUK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:20:27.615773] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-11. [2025-09-17T18:20:27.736246] [INFO ] [REMOTE ] CTVA: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T18:20:27.742981] [INFO ] [REMOTE ] CTVA: Full fetch complete (76750 records). [2025-09-17T18:20:27.743109] [DEBUG] [VALIDATOR ] CTVA: Validating primary data. [2025-09-17T18:20:28.140552] [DEBUG] [VALIDATOR ] CTVA: All expected trading days are present. [2025-09-17T18:20:28.140758] [DEBUG] [VALIDATOR ] CTVA: Primary data validation passed. [2025-09-17T18:20:28.141740] [INFO ] [MAIN ] CTVA: Fetched primary data is valid. [2025-09-17T18:20:28.141799] [DEBUG] [LOCAL ] CTVA: Saving primary data. [2025-09-17T18:20:28.159052] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T18:20:28.164799] [DEBUG] [LOCAL ] CTVA: Trimmed 76750 records to 53231 (keeping 200 days of data) [2025-09-17T18:20:28.418344] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-01. [2025-09-17T18:20:28.501598] [DEBUG] [LOCAL ] CTVA: Primary data saved (53231 records). [2025-09-17T18:20:28.501752] [INFO ] [MAIN ] CTVA: Full history saved. [2025-09-17T18:20:28.502367] [INFO ] [MAIN ] Update Progress: 554/2371 symbols completed. CTVA took 37.6s. Estimated remaining: 4h 23m 50s. Rate: 6.9 symbols/min [2025-09-17T18:20:28.673067] [INFO ] [MAIN ] CULP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:20:28.679406] [DEBUG] [LOCAL ] CULP: Loaded 3102 existing records from primary storage. [2025-09-17T18:20:28.679524] [INFO ] [MAIN ] CULP: Loaded 3102 existing records. [2025-09-17T18:20:28.863064] [WARN ] [MAIN ] CULP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:20:28.863407] [INFO ] [MAIN ] CULP: Wiping existing primary data before full refresh. [2025-09-17T18:20:28.863462] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-17T18:20:28.863746] [DEBUG] [LOCAL ] CULP: Deleted primary data file. [2025-09-17T18:20:28.863826] [INFO ] [MAIN ] CULP: Starting full primary refresh. [2025-09-17T18:20:29.223465] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-07. [2025-09-17T18:20:29.227988] [INFO ] [REMOTE ] CULP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:20:29.475352] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T18:20:29.551067] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T18:20:30.015782] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-11. [2025-09-17T18:20:30.696469] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T18:20:30.815757] [INFO ] [REMOTE ] CUK: Fetching primary data for 2024-12. [2025-09-17T18:20:31.238415] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T18:20:31.615792] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-08. [2025-09-17T18:20:32.415812] [INFO ] [REMOTE ] CULP: Fetching primary data for 2024-12. [2025-09-17T18:20:32.797808] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T18:20:33.062690] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T18:20:33.218546] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-02. [2025-09-17T18:20:33.225405] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T18:20:34.015797] [INFO ] [REMOTE ] CUBE: Fetching primary data for 2025-09. [2025-09-17T18:20:34.430849] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T18:20:34.815857] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-03. [2025-09-17T18:20:35.388866] [INFO ] [REMOTE ] CUBE: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T18:20:35.396615] [INFO ] [REMOTE ] CUBE: Full fetch complete (72775 records). [2025-09-17T18:20:35.396810] [DEBUG] [VALIDATOR ] CUBE: Validating primary data. [2025-09-17T18:20:35.620884] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-01. [2025-09-17T18:20:35.818203] [DEBUG] [VALIDATOR ] CUBE: All expected trading days are present. [2025-09-17T18:20:35.818374] [DEBUG] [VALIDATOR ] CUBE: Primary data validation passed. [2025-09-17T18:20:35.819399] [INFO ] [MAIN ] CUBE: Fetched primary data is valid. [2025-09-17T18:20:35.819538] [DEBUG] [LOCAL ] CUBE: Saving primary data. [2025-09-17T18:20:35.836592] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T18:20:35.842549] [DEBUG] [LOCAL ] CUBE: Trimmed 72775 records to 50754 (keeping 200 days of data) [2025-09-17T18:20:36.151331] [DEBUG] [LOCAL ] CUBE: Primary data saved (50754 records). [2025-09-17T18:20:36.151475] [INFO ] [MAIN ] CUBE: Full history saved. [2025-09-17T18:20:36.151558] [INFO ] [MAIN ] Update Progress: 555/2371 symbols completed. CUBE took 31.9s. Estimated remaining: 4h 23m 38s. Rate: 6.9 symbols/min [2025-09-17T18:20:36.325689] [INFO ] [MAIN ] CURB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:20:36.357359] [DEBUG] [LOCAL ] CURB: Loaded 33001 existing records from primary storage. [2025-09-17T18:20:36.357531] [INFO ] [MAIN ] CURB: Loaded 33001 existing records. [2025-09-17T18:20:36.421710] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-04. [2025-09-17T18:20:36.553014] [WARN ] [MAIN ] CURB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:20:36.553316] [INFO ] [MAIN ] CURB: Wiping existing primary data before full refresh. [2025-09-17T18:20:36.553372] [INFO ] [LOCAL ] CURB: Starting deletion of primary data. [2025-09-17T18:20:36.554130] [DEBUG] [LOCAL ] CURB: Deleted primary data file. [2025-09-17T18:20:36.554186] [INFO ] [MAIN ] CURB: Starting full primary refresh. [2025-09-17T18:20:36.914150] [INFO ] [REMOTE ] CURB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:20:37.215811] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-01. [2025-09-17T18:20:37.626605] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T18:20:37.785488] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T18:20:37.826730] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T18:20:38.015799] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-02. [2025-09-17T18:20:38.425907] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T18:20:38.815831] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-05. [2025-09-17T18:20:39.615808] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-02. [2025-09-17T18:20:40.068980] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T18:20:40.415774] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-03. [2025-09-17T18:20:40.966530] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T18:20:41.215789] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-11. [2025-09-17T18:20:41.379975] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T18:20:42.015806] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-06. [2025-09-17T18:20:42.710016] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T18:20:42.815746] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-03. [2025-09-17T18:20:43.165574] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T18:20:43.615888] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-04. [2025-09-17T18:20:44.207702] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T18:20:44.415780] [INFO ] [REMOTE ] CURB: Fetching primary data for 2024-12. [2025-09-17T18:20:44.769607] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T18:20:45.215818] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-05. [2025-09-17T18:20:45.700613] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T18:20:45.727871] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T18:20:46.015777] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-06. [2025-09-17T18:20:46.487661] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T18:20:46.815810] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-07. [2025-09-17T18:20:47.364291] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T18:20:47.615820] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-08. [2025-09-17T18:20:48.069906] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T18:20:48.415790] [INFO ] [REMOTE ] CULP: Fetching primary data for 2025-09. [2025-09-17T18:20:48.997335] [INFO ] [REMOTE ] CULP: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T18:20:48.998339] [INFO ] [REMOTE ] CULP: Full fetch complete (4721 records). [2025-09-17T18:20:48.998408] [DEBUG] [VALIDATOR ] CULP: Validating primary data. [2025-09-17T18:20:48.998803] [FATAL] [VALIDATOR ] CULP: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:20:48.998880] [FATAL] [MAIN ] CULP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:20:48.998916] [WARN ] [MAIN ] CULP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:20:48.998953] [INFO ] [LOCAL ] CULP: Starting deletion of primary data. [2025-09-17T18:20:48.999009] [DEBUG] [LOCAL ] CULP: No primary data file found to delete. [2025-09-17T18:20:48.999043] [INFO ] [LOCAL ] CULP: Starting deletion of derivative data. [2025-09-17T18:20:48.999281] [DEBUG] [LOCAL ] CULP: Deleted derivative data file. [2025-09-17T18:20:48.999359] [INFO ] [MAIN ] Update Progress: 556/2371 symbols completed. CULP took 20.5s. Estimated remaining: 4h 23m 43s. Rate: 6.9 symbols/min [2025-09-17T18:20:49.175449] [INFO ] [MAIN ] CURV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:20:49.202882] [DEBUG] [LOCAL ] CURV: Loaded 26461 existing records from primary storage. [2025-09-17T18:20:49.203021] [INFO ] [MAIN ] CURV: Loaded 26461 existing records. [2025-09-17T18:20:49.223246] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-04. [2025-09-17T18:20:49.389417] [WARN ] [MAIN ] CURV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:20:49.389677] [INFO ] [MAIN ] CURV: Wiping existing primary data before full refresh. [2025-09-17T18:20:49.389728] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-17T18:20:49.390263] [DEBUG] [LOCAL ] CURV: Deleted primary data file. [2025-09-17T18:20:49.390318] [INFO ] [MAIN ] CURV: Starting full primary refresh. [2025-09-17T18:20:49.752036] [INFO ] [REMOTE ] CURV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:20:50.015810] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-07. [2025-09-17T18:20:50.815798] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-01. [2025-09-17T18:20:51.160801] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T18:20:51.271085] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T18:20:51.615787] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-08. [2025-09-17T18:20:52.322406] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T18:20:52.415797] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-11. [2025-09-17T18:20:52.803146] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T18:20:53.215791] [INFO ] [REMOTE ] CUBI: Fetching primary data for 2025-09. [2025-09-17T18:20:53.897493] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T18:20:54.015832] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-02. [2025-09-17T18:20:54.539510] [INFO ] [REMOTE ] CUBI: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T18:20:54.543873] [INFO ] [REMOTE ] CUBI: Full fetch complete (39039 records). [2025-09-17T18:20:54.543962] [DEBUG] [VALIDATOR ] CUBI: Validating primary data. [2025-09-17T18:20:54.820861] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-05. [2025-09-17T18:20:54.917475] [DEBUG] [VALIDATOR ] CUBI: All expected trading days are present. [2025-09-17T18:20:54.917554] [DEBUG] [VALIDATOR ] CUBI: Primary data validation passed. [2025-09-17T18:20:54.918106] [INFO ] [MAIN ] CUBI: Fetched primary data is valid. [2025-09-17T18:20:54.918165] [DEBUG] [LOCAL ] CUBI: Saving primary data. [2025-09-17T18:20:54.919072] [DEBUG] [LOCAL ] CUBI: Trimmed 39039 records to 27280 (keeping 200 days of data) [2025-09-17T18:20:55.078810] [DEBUG] [LOCAL ] CUBI: Primary data saved (27280 records). [2025-09-17T18:20:55.078955] [INFO ] [MAIN ] CUBI: Full history saved. [2025-09-17T18:20:55.079042] [INFO ] [MAIN ] Update Progress: 557/2371 symbols completed. CUBI took 42.1s. Estimated remaining: 4h 23m 26s. Rate: 6.9 symbols/min [2025-09-17T18:20:55.191844] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T18:20:55.615801] [INFO ] [REMOTE ] CURV: Fetching primary data for 2024-12. [2025-09-17T18:20:56.415832] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-03. [2025-09-17T18:20:56.825522] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T18:20:57.013221] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T18:20:57.215812] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-06. [2025-09-17T18:20:58.015752] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-01. [2025-09-17T18:20:58.039157] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T18:20:58.815847] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-04. [2025-09-17T18:20:59.257710] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T18:20:59.378188] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T18:20:59.615800] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-07. [2025-09-17T18:21:00.326313] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T18:21:00.415838] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-05. [2025-09-17T18:21:01.211598] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T18:21:01.222652] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-02. [2025-09-17T18:21:01.631983] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T18:21:02.015816] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-08. [2025-09-17T18:21:02.362862] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T18:21:02.815783] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-03. [2025-09-17T18:21:03.615823] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-06. [2025-09-17T18:21:03.861546] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T18:21:04.082280] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T18:21:04.415813] [INFO ] [REMOTE ] CUK: Fetching primary data for 2025-09. [2025-09-17T18:21:05.015195] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T18:21:05.215845] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-04. [2025-09-17T18:21:06.013458] [INFO ] [REMOTE ] CUK: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T18:21:06.019492] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-07. [2025-09-17T18:21:06.021072] [INFO ] [REMOTE ] CUK: Full fetch complete (73451 records). [2025-09-17T18:21:06.021158] [DEBUG] [VALIDATOR ] CUK: Validating primary data. [2025-09-17T18:21:06.417956] [DEBUG] [VALIDATOR ] CUK: All expected trading days are present. [2025-09-17T18:21:06.418083] [DEBUG] [VALIDATOR ] CUK: Primary data validation passed. [2025-09-17T18:21:06.419005] [INFO ] [MAIN ] CUK: Fetched primary data is valid. [2025-09-17T18:21:06.419084] [DEBUG] [LOCAL ] CUK: Saving primary data. [2025-09-17T18:21:06.435825] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T18:21:06.441540] [DEBUG] [LOCAL ] CUK: Trimmed 73451 records to 51042 (keeping 200 days of data) [2025-09-17T18:21:06.745677] [DEBUG] [LOCAL ] CUK: Primary data saved (51042 records). [2025-09-17T18:21:06.745814] [INFO ] [MAIN ] CUK: Full history saved. [2025-09-17T18:21:06.747140] [INFO ] [MAIN ] Update Progress: 558/2371 symbols completed. CUK took 40.4s. Estimated remaining: 4h 23m 26s. Rate: 6.9 symbols/min [2025-09-17T18:21:06.815820] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-05. [2025-09-17T18:21:07.569592] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T18:21:07.615715] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-08. [2025-09-17T18:21:07.911452] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T18:21:08.415832] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-06. [2025-09-17T18:21:09.008423] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T18:21:09.159993] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T18:21:09.215759] [INFO ] [REMOTE ] CURB: Fetching primary data for 2025-09. [2025-09-17T18:21:10.015798] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-07. [2025-09-17T18:21:10.511086] [INFO ] [REMOTE ] CURB: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T18:21:10.515560] [INFO ] [REMOTE ] CURB: Full fetch complete (47099 records). [2025-09-17T18:21:10.515678] [DEBUG] [VALIDATOR ] CURB: Validating primary data. [2025-09-17T18:21:10.915984] [DEBUG] [VALIDATOR ] CURB: All expected trading days are present. [2025-09-17T18:21:10.916070] [DEBUG] [VALIDATOR ] CURB: Primary data validation passed. [2025-09-17T18:21:10.916766] [INFO ] [MAIN ] CURB: Fetched primary data is valid. [2025-09-17T18:21:10.916819] [DEBUG] [LOCAL ] CURB: Saving primary data. [2025-09-17T18:21:10.917947] [DEBUG] [LOCAL ] CURB: Trimmed 47099 records to 33031 (keeping 200 days of data) [2025-09-17T18:21:11.131874] [DEBUG] [LOCAL ] CURB: Primary data saved (33031 records). [2025-09-17T18:21:11.132026] [INFO ] [MAIN ] CURB: Full history saved. [2025-09-17T18:21:11.132877] [INFO ] [MAIN ] Update Progress: 559/2371 symbols completed. CURB took 35.0s. Estimated remaining: 4h 23m 4s. Rate: 6.9 symbols/min [2025-09-17T18:21:11.474740] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T18:21:11.482823] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-08. [2025-09-17T18:21:12.789513] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T18:21:12.796426] [INFO ] [REMOTE ] CURV: Fetching primary data for 2025-09. [2025-09-17T18:21:14.268996] [INFO ] [REMOTE ] CURV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T18:21:14.273997] [INFO ] [REMOTE ] CURV: Full fetch complete (39575 records). [2025-09-17T18:21:14.274095] [DEBUG] [VALIDATOR ] CURV: Validating primary data. [2025-09-17T18:21:14.274765] [FATAL] [VALIDATOR ] CURV: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:21:14.274841] [FATAL] [MAIN ] CURV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:21:14.274876] [WARN ] [MAIN ] CURV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:21:14.274912] [INFO ] [LOCAL ] CURV: Starting deletion of primary data. [2025-09-17T18:21:14.274977] [DEBUG] [LOCAL ] CURV: No primary data file found to delete. [2025-09-17T18:21:14.275014] [INFO ] [LOCAL ] CURV: Starting deletion of derivative data. [2025-09-17T18:21:14.275356] [DEBUG] [LOCAL ] CURV: Deleted derivative data file. [2025-09-17T18:21:14.275437] [INFO ] [MAIN ] Update Progress: 560/2371 symbols completed. CURV took 25.3s. Estimated remaining: 4h 22m 37s. Rate: 6.9 symbols/min [2025-09-17T18:21:14.843047] [INFO ] [MAIN ] CVE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:21:14.871227] [INFO ] [MAIN ] CUZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:21:14.981811] [INFO ] [MAIN ] CVI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:21:15.002133] [INFO ] [MAIN ] CVEO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:21:15.032270] [DEBUG] [LOCAL ] CVEO: Loaded 15752 existing records from primary storage. [2025-09-17T18:21:15.032588] [INFO ] [MAIN ] CVEO: Loaded 15752 existing records. [2025-09-17T18:21:15.296539] [DEBUG] [LOCAL ] CVI: Loaded 46411 existing records from primary storage. [2025-09-17T18:21:15.310686] [INFO ] [MAIN ] CVI: Loaded 46411 existing records. [2025-09-17T18:21:15.281991] [WARN ] [MAIN ] CVEO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:21:15.332792] [DEBUG] [LOCAL ] CUZ: Loaded 49328 existing records from primary storage. [2025-09-17T18:21:15.322348] [DEBUG] [LOCAL ] CVE: Loaded 53560 existing records from primary storage. [2025-09-17T18:21:15.357165] [INFO ] [MAIN ] CVE: Loaded 53560 existing records. [2025-09-17T18:21:15.357067] [INFO ] [MAIN ] CUZ: Loaded 49328 existing records. [2025-09-17T18:21:15.351913] [INFO ] [MAIN ] CVEO: Wiping existing primary data before full refresh. [2025-09-17T18:21:15.423798] [INFO ] [LOCAL ] CVEO: Starting deletion of primary data. [2025-09-17T18:21:15.509150] [DEBUG] [LOCAL ] CVEO: Deleted primary data file. [2025-09-17T18:21:15.557325] [INFO ] [MAIN ] CVEO: Starting full primary refresh. [2025-09-17T18:21:15.948881] [WARN ] [MAIN ] CVI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:21:15.951803] [WARN ] [MAIN ] CVE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:21:15.957256] [INFO ] [MAIN ] CVI: Wiping existing primary data before full refresh. [2025-09-17T18:21:15.948779] [WARN ] [MAIN ] CUZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:21:15.972814] [INFO ] [MAIN ] CUZ: Wiping existing primary data before full refresh. [2025-09-17T18:21:15.957359] [INFO ] [MAIN ] CVE: Wiping existing primary data before full refresh. [2025-09-17T18:21:15.978047] [INFO ] [LOCAL ] CVE: Starting deletion of primary data. [2025-09-17T18:21:15.978083] [INFO ] [LOCAL ] CUZ: Starting deletion of primary data. [2025-09-17T18:21:16.006010] [DEBUG] [LOCAL ] CUZ: Deleted primary data file. [2025-09-17T18:21:15.993334] [INFO ] [LOCAL ] CVI: Starting deletion of primary data. [2025-09-17T18:21:16.006178] [INFO ] [MAIN ] CUZ: Starting full primary refresh. [2025-09-17T18:21:16.006085] [DEBUG] [LOCAL ] CVE: Deleted primary data file. [2025-09-17T18:21:16.037551] [INFO ] [MAIN ] CVE: Starting full primary refresh. [2025-09-17T18:21:16.012336] [DEBUG] [LOCAL ] CVI: Deleted primary data file. [2025-09-17T18:21:16.124045] [INFO ] [MAIN ] CVI: Starting full primary refresh. [2025-09-17T18:21:16.914565] [INFO ] [REMOTE ] CVEO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:21:16.963981] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-11. [2025-09-17T18:21:17.273750] [INFO ] [REMOTE ] CUZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:21:17.276830] [INFO ] [REMOTE ] CVE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:21:17.287042] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-11. [2025-09-17T18:21:17.296230] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-11. [2025-09-17T18:21:17.315707] [INFO ] [REMOTE ] CVI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:21:17.316670] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-11. [2025-09-17T18:21:18.020726] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T18:21:18.023805] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2024-12. [2025-09-17T18:21:18.793627] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T18:21:18.796327] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-01. [2025-09-17T18:21:18.940504] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T18:21:18.950216] [INFO ] [REMOTE ] CVI: Fetching primary data for 2024-12. [2025-09-17T18:21:19.018956] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T18:21:19.029489] [INFO ] [REMOTE ] CVE: Fetching primary data for 2024-12. [2025-09-17T18:21:19.125740] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T18:21:19.135527] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2024-12. [2025-09-17T18:21:19.242342] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T18:21:19.615787] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-02. [2025-09-17T18:21:20.482083] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T18:21:20.485593] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-03. [2025-09-17T18:21:20.574602] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T18:21:20.630313] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T18:21:20.716987] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T18:21:21.091012] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T18:21:21.215780] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-01. [2025-09-17T18:21:22.015797] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-01. [2025-09-17T18:21:22.806049] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T18:21:22.815672] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-02. [2025-09-17T18:21:23.207291] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T18:21:23.615777] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-04. [2025-09-17T18:21:24.375020] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T18:21:24.415783] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-03. [2025-09-17T18:21:24.556466] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T18:21:25.215811] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-01. [2025-09-17T18:21:26.015776] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-02. [2025-09-17T18:21:26.114810] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T18:21:26.815748] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-04. [2025-09-17T18:21:27.339912] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T18:21:27.615794] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-05. [2025-09-17T18:21:27.683573] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T18:21:28.415827] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-03. [2025-09-17T18:21:28.597131] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T18:21:28.804550] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T18:21:29.215834] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-06. [2025-09-17T18:21:30.015754] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-02. [2025-09-17T18:21:30.089457] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T18:21:30.176554] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T18:21:30.815800] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-07. [2025-09-17T18:21:31.615782] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-05. [2025-09-17T18:21:31.746331] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T18:21:31.790233] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T18:21:32.415769] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-04. [2025-09-17T18:21:33.215803] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-03. [2025-09-17T18:21:33.509307] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T18:21:33.665031] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T18:21:34.015788] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-06. [2025-09-17T18:21:34.815775] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-08. [2025-09-17T18:21:35.210885] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T18:21:35.375456] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T18:21:35.615842] [INFO ] [REMOTE ] CVEO: Fetching primary data for 2025-09. [2025-09-17T18:21:35.693940] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T18:21:36.415821] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-05. [2025-09-17T18:21:36.565027] [INFO ] [REMOTE ] CVEO: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T18:21:36.567394] [INFO ] [REMOTE ] CVEO: Full fetch complete (20141 records). [2025-09-17T18:21:36.567473] [DEBUG] [VALIDATOR ] CVEO: Validating primary data. [2025-09-17T18:21:36.949506] [DEBUG] [VALIDATOR ] CVEO: All expected trading days are present. [2025-09-17T18:21:36.949597] [DEBUG] [VALIDATOR ] CVEO: Primary data validation passed. [2025-09-17T18:21:36.950072] [INFO ] [MAIN ] CVEO: Fetched primary data is valid. [2025-09-17T18:21:36.950116] [DEBUG] [LOCAL ] CVEO: Saving primary data. [2025-09-17T18:21:36.950805] [DEBUG] [LOCAL ] CVEO: Trimmed 20141 records to 15638 (keeping 200 days of data) [2025-09-17T18:21:37.048451] [DEBUG] [LOCAL ] CVEO: Primary data saved (15638 records). [2025-09-17T18:21:37.048601] [INFO ] [MAIN ] CVEO: Full history saved. [2025-09-17T18:21:37.048772] [INFO ] [MAIN ] Update Progress: 561/2371 symbols completed. CVEO took 22.8s. Estimated remaining: 4h 23m 14s. Rate: 6.9 symbols/min [2025-09-17T18:21:37.220938] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-04. [2025-09-17T18:21:37.224785] [INFO ] [MAIN ] CVLG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:21:37.243564] [DEBUG] [LOCAL ] CVLG: Loaded 15371 existing records from primary storage. [2025-09-17T18:21:37.243738] [INFO ] [MAIN ] CVLG: Loaded 15371 existing records. [2025-09-17T18:21:37.431637] [WARN ] [MAIN ] CVLG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:21:37.432158] [INFO ] [MAIN ] CVLG: Wiping existing primary data before full refresh. [2025-09-17T18:21:37.432205] [INFO ] [LOCAL ] CVLG: Starting deletion of primary data. [2025-09-17T18:21:37.432846] [DEBUG] [LOCAL ] CVLG: Deleted primary data file. [2025-09-17T18:21:37.432908] [INFO ] [MAIN ] CVLG: Starting full primary refresh. [2025-09-17T18:21:37.802890] [INFO ] [REMOTE ] CVLG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:21:38.015783] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-07. [2025-09-17T18:21:38.210492] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T18:21:38.815816] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-11. [2025-09-17T18:21:39.075091] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T18:21:39.473041] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T18:21:39.615833] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-05. [2025-09-17T18:21:39.715868] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T18:21:40.415792] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-08. [2025-09-17T18:21:41.215801] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2024-12. [2025-09-17T18:21:41.481410] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T18:21:41.659610] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T18:21:41.937877] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T18:21:42.015808] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-06. [2025-09-17T18:21:42.815787] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-06. [2025-09-17T18:21:43.588342] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T18:21:43.615749] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-07. [2025-09-17T18:21:44.388171] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T18:21:44.415735] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-07. [2025-09-17T18:21:45.220909] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-01. [2025-09-17T18:21:45.244693] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T18:21:46.015793] [INFO ] [REMOTE ] CUZ: Fetching primary data for 2025-09. [2025-09-17T18:21:46.258721] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T18:21:46.309514] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T18:21:46.815807] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-08. [2025-09-17T18:21:47.615808] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-08. [2025-09-17T18:21:47.840849] [INFO ] [REMOTE ] CUZ: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T18:21:47.847793] [INFO ] [REMOTE ] CUZ: Full fetch complete (70509 records). [2025-09-17T18:21:47.847993] [DEBUG] [VALIDATOR ] CUZ: Validating primary data. [2025-09-17T18:21:48.246988] [DEBUG] [VALIDATOR ] CUZ: All expected trading days are present. [2025-09-17T18:21:48.247079] [DEBUG] [VALIDATOR ] CUZ: Primary data validation passed. [2025-09-17T18:21:48.247942] [INFO ] [MAIN ] CUZ: Fetched primary data is valid. [2025-09-17T18:21:48.247991] [DEBUG] [LOCAL ] CUZ: Saving primary data. [2025-09-17T18:21:48.249589] [DEBUG] [LOCAL ] CUZ: Trimmed 70509 records to 49356 (keeping 200 days of data) [2025-09-17T18:21:48.451140] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-02. [2025-09-17T18:21:48.589754] [DEBUG] [LOCAL ] CUZ: Primary data saved (49356 records). [2025-09-17T18:21:48.589919] [INFO ] [MAIN ] CUZ: Full history saved. [2025-09-17T18:21:48.590054] [INFO ] [MAIN ] Update Progress: 562/2371 symbols completed. CUZ took 34.3s. Estimated remaining: 4h 23m 14s. Rate: 6.9 symbols/min [2025-09-17T18:21:48.811596] [INFO ] [MAIN ] CVNA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:21:48.815963] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T18:21:48.883320] [DEBUG] [LOCAL ] CVNA: Loaded 53080 existing records from primary storage. [2025-09-17T18:21:48.883502] [INFO ] [MAIN ] CVNA: Loaded 53080 existing records. [2025-09-17T18:21:49.068139] [WARN ] [MAIN ] CVNA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:21:49.068422] [INFO ] [MAIN ] CVNA: Wiping existing primary data before full refresh. [2025-09-17T18:21:49.068468] [INFO ] [LOCAL ] CVNA: Starting deletion of primary data. [2025-09-17T18:21:49.069546] [DEBUG] [LOCAL ] CVNA: Deleted primary data file. [2025-09-17T18:21:49.069597] [INFO ] [MAIN ] CVNA: Starting full primary refresh. [2025-09-17T18:21:49.220783] [INFO ] [REMOTE ] CVE: Fetching primary data for 2025-09. [2025-09-17T18:21:49.445954] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T18:21:49.474949] [INFO ] [REMOTE ] CVNA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:21:49.505889] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T18:21:50.015767] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-03. [2025-09-17T18:21:50.815840] [INFO ] [REMOTE ] CVI: Fetching primary data for 2025-09. [2025-09-17T18:21:50.983431] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T18:21:51.371094] [INFO ] [REMOTE ] CVE: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-17T18:21:51.379179] [INFO ] [REMOTE ] CVE: Full fetch complete (77389 records). [2025-09-17T18:21:51.379342] [DEBUG] [VALIDATOR ] CVE: Validating primary data. [2025-09-17T18:21:51.621046] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-11. [2025-09-17T18:21:51.794245] [DEBUG] [VALIDATOR ] CVE: All expected trading days are present. [2025-09-17T18:21:51.794367] [DEBUG] [VALIDATOR ] CVE: Primary data validation passed. [2025-09-17T18:21:51.796155] [INFO ] [MAIN ] CVE: Fetched primary data is valid. [2025-09-17T18:21:51.796244] [DEBUG] [LOCAL ] CVE: Saving primary data. [2025-09-17T18:21:51.798809] [DEBUG] [LOCAL ] CVE: Trimmed 77389 records to 53558 (keeping 200 days of data) [2025-09-17T18:21:52.154371] [DEBUG] [LOCAL ] CVE: Primary data saved (53558 records). [2025-09-17T18:21:52.154530] [INFO ] [MAIN ] CVE: Full history saved. [2025-09-17T18:21:52.154655] [INFO ] [MAIN ] Update Progress: 563/2371 symbols completed. CVE took 37.9s. Estimated remaining: 4h 22m 49s. Rate: 6.9 symbols/min [2025-09-17T18:21:52.343737] [INFO ] [MAIN ] CVS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:21:52.398633] [DEBUG] [LOCAL ] CVS: Loaded 53698 existing records from primary storage. [2025-09-17T18:21:52.398897] [INFO ] [MAIN ] CVS: Loaded 53698 existing records. [2025-09-17T18:21:52.420869] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-04. [2025-09-17T18:21:52.602518] [WARN ] [MAIN ] CVS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:21:52.603869] [INFO ] [REMOTE ] CVI: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T18:21:52.604177] [INFO ] [MAIN ] CVS: Wiping existing primary data before full refresh. [2025-09-17T18:21:52.610274] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-17T18:21:52.610552] [INFO ] [REMOTE ] CVI: Full fetch complete (67045 records). [2025-09-17T18:21:52.610684] [DEBUG] [VALIDATOR ] CVI: Validating primary data. [2025-09-17T18:21:52.643159] [DEBUG] [LOCAL ] CVS: Deleted primary data file. [2025-09-17T18:21:52.680971] [INFO ] [MAIN ] CVS: Starting full primary refresh. [2025-09-17T18:21:53.394976] [INFO ] [REMOTE ] CVS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:21:53.398718] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-11. [2025-09-17T18:21:53.398348] [DEBUG] [VALIDATOR ] CVI: All expected trading days are present. [2025-09-17T18:21:53.398880] [DEBUG] [VALIDATOR ] CVI: Primary data validation passed. [2025-09-17T18:21:53.400408] [INFO ] [MAIN ] CVI: Fetched primary data is valid. [2025-09-17T18:21:53.400529] [DEBUG] [LOCAL ] CVI: Saving primary data. [2025-09-17T18:21:53.413311] [DEBUG] [LOCAL ] CVI: Trimmed 67045 records to 46415 (keeping 200 days of data) [2025-09-17T18:21:53.416668] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T18:21:53.756179] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-11 (2.14 seconds). [2025-09-17T18:21:53.776304] [DEBUG] [LOCAL ] CVI: Primary data saved (46415 records). [2025-09-17T18:21:53.776468] [INFO ] [MAIN ] CVI: Full history saved. [2025-09-17T18:21:53.776586] [INFO ] [MAIN ] Update Progress: 564/2371 symbols completed. CVI took 39.5s. Estimated remaining: 4h 22m 17s. Rate: 6.9 symbols/min [2025-09-17T18:21:53.953741] [INFO ] [MAIN ] CVX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:21:54.011725] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-17T18:21:54.011880] [INFO ] [MAIN ] CVX: Loaded 53760 existing records. [2025-09-17T18:21:54.023145] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2024-12. [2025-09-17T18:21:54.202323] [WARN ] [MAIN ] CVX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:21:54.202557] [INFO ] [MAIN ] CVX: Wiping existing primary data before full refresh. [2025-09-17T18:21:54.202613] [INFO ] [LOCAL ] CVX: Starting deletion of primary data. [2025-09-17T18:21:54.203776] [DEBUG] [LOCAL ] CVX: Deleted primary data file. [2025-09-17T18:21:54.203844] [INFO ] [MAIN ] CVX: Starting full primary refresh. [2025-09-17T18:21:54.607410] [INFO ] [REMOTE ] CVX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:21:54.815805] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-05. [2025-09-17T18:21:55.583045] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-11 (2.18 seconds). [2025-09-17T18:21:55.615779] [INFO ] [REMOTE ] CVS: Fetching primary data for 2024-12. [2025-09-17T18:21:55.904414] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T18:21:55.945963] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T18:21:56.415808] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-11. [2025-09-17T18:21:57.215837] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-06. [2025-09-17T18:21:58.015804] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-01. [2025-09-17T18:21:58.070183] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-17T18:21:58.238928] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T18:21:58.342749] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T18:21:58.815797] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-01. [2025-09-17T18:21:59.615751] [INFO ] [REMOTE ] CVX: Fetching primary data for 2024-12. [2025-09-17T18:22:00.026948] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T18:22:00.415785] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-07. [2025-09-17T18:22:00.699165] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T18:22:01.215822] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-02. [2025-09-17T18:22:01.455183] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T18:22:01.938212] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-17T18:22:02.015800] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-02. [2025-09-17T18:22:02.815768] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-01. [2025-09-17T18:22:02.947824] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T18:22:03.615762] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-08. [2025-09-17T18:22:04.132240] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-17T18:22:04.415811] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-03. [2025-09-17T18:22:04.436064] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T18:22:05.128585] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-17T18:22:05.215772] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-03. [2025-09-17T18:22:06.015783] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-02. [2025-09-17T18:22:06.675406] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-17T18:22:06.815837] [INFO ] [REMOTE ] CVLG: Fetching primary data for 2025-09. [2025-09-17T18:22:06.911019] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T18:22:07.615824] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-04. [2025-09-17T18:22:07.721863] [INFO ] [REMOTE ] CVLG: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T18:22:07.724837] [INFO ] [REMOTE ] CVLG: Full fetch complete (20294 records). [2025-09-17T18:22:07.724949] [DEBUG] [VALIDATOR ] CVLG: Validating primary data. [2025-09-17T18:22:08.118796] [DEBUG] [VALIDATOR ] CVLG: All expected trading days are present. [2025-09-17T18:22:08.118913] [DEBUG] [VALIDATOR ] CVLG: Primary data validation passed. [2025-09-17T18:22:08.119336] [INFO ] [MAIN ] CVLG: Fetched primary data is valid. [2025-09-17T18:22:08.119388] [DEBUG] [LOCAL ] CVLG: Saving primary data. [2025-09-17T18:22:08.120447] [DEBUG] [LOCAL ] CVLG: Trimmed 20294 records to 15413 (keeping 200 days of data) [2025-09-17T18:22:08.224207] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-02 (2.21 seconds). [2025-09-17T18:22:08.259526] [DEBUG] [LOCAL ] CVLG: Primary data saved (15413 records). [2025-09-17T18:22:08.259707] [INFO ] [MAIN ] CVLG: Full history saved. [2025-09-17T18:22:08.259803] [INFO ] [MAIN ] Update Progress: 565/2371 symbols completed. CVLG took 31.2s. Estimated remaining: 4h 22m 27s. Rate: 6.9 symbols/min [2025-09-17T18:22:08.421443] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-04. [2025-09-17T18:22:08.439927] [INFO ] [MAIN ] CW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:22:08.462171] [DEBUG] [LOCAL ] CW: Loaded 22793 existing records from primary storage. [2025-09-17T18:22:08.462314] [INFO ] [MAIN ] CW: Loaded 22793 existing records. [2025-09-17T18:22:08.640116] [WARN ] [MAIN ] CW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:22:08.640403] [INFO ] [MAIN ] CW: Wiping existing primary data before full refresh. [2025-09-17T18:22:08.640450] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-17T18:22:08.641053] [DEBUG] [LOCAL ] CW: Deleted primary data file. [2025-09-17T18:22:08.641103] [INFO ] [MAIN ] CW: Starting full primary refresh. [2025-09-17T18:22:09.003621] [INFO ] [REMOTE ] CW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:22:09.215807] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-11. [2025-09-17T18:22:09.555140] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T18:22:10.015794] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-03. [2025-09-17T18:22:10.034121] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T18:22:10.140153] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T18:22:10.815814] [INFO ] [REMOTE ] CW: Fetching primary data for 2024-12. [2025-09-17T18:22:11.615804] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-05. [2025-09-17T18:22:11.965888] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T18:22:12.304337] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-17T18:22:12.415783] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-04. [2025-09-17T18:22:13.215743] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-05. [2025-09-17T18:22:13.742556] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T18:22:14.015762] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-01. [2025-09-17T18:22:14.598101] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-17T18:22:14.815755] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-06. [2025-09-17T18:22:15.023340] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T18:22:15.309456] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T18:22:15.615829] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-06. [2025-09-17T18:22:16.415800] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-05. [2025-09-17T18:22:17.129569] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-17T18:22:17.215736] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-07. [2025-09-17T18:22:17.796330] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-17T18:22:18.015755] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-07. [2025-09-17T18:22:18.820899] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-02. [2025-09-17T18:22:18.856837] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-17T18:22:19.217252] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T18:22:19.615868] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-06. [2025-09-17T18:22:20.159831] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-07 (2.14 seconds). [2025-09-17T18:22:20.231685] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T18:22:20.415787] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-08. [2025-09-17T18:22:21.215776] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-08. [2025-09-17T18:22:21.960710] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-17T18:22:22.015761] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-07. [2025-09-17T18:22:22.059413] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T18:22:22.815791] [INFO ] [REMOTE ] CVS: Fetching primary data for 2025-09. [2025-09-17T18:22:23.573764] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T18:22:23.615804] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-03. [2025-09-17T18:22:24.367890] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-17T18:22:24.415751] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-08. [2025-09-17T18:22:24.609241] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T18:22:24.635924] [INFO ] [REMOTE ] CVS: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T18:22:24.642300] [INFO ] [REMOTE ] CVS: Full fetch complete (77311 records). [2025-09-17T18:22:24.642421] [DEBUG] [VALIDATOR ] CVS: Validating primary data. [2025-09-17T18:22:24.643309] [FATAL] [VALIDATOR ] CVS: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:22:24.643394] [FATAL] [MAIN ] CVS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:22:24.643429] [WARN ] [MAIN ] CVS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:22:24.643468] [INFO ] [LOCAL ] CVS: Starting deletion of primary data. [2025-09-17T18:22:24.643526] [DEBUG] [LOCAL ] CVS: No primary data file found to delete. [2025-09-17T18:22:24.643560] [INFO ] [LOCAL ] CVS: Starting deletion of derivative data. [2025-09-17T18:22:24.643942] [DEBUG] [LOCAL ] CVS: Deleted derivative data file. [2025-09-17T18:22:24.644582] [INFO ] [MAIN ] Update Progress: 566/2371 symbols completed. CVS took 32.5s. Estimated remaining: 4h 22m 43s. Rate: 6.9 symbols/min [2025-09-17T18:22:24.819104] [INFO ] [MAIN ] CWAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:22:24.878972] [DEBUG] [LOCAL ] CWAN: Loaded 52389 existing records from primary storage. [2025-09-17T18:22:24.879148] [INFO ] [MAIN ] CWAN: Loaded 52389 existing records. [2025-09-17T18:22:25.065445] [WARN ] [MAIN ] CWAN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:22:25.065757] [INFO ] [MAIN ] CWAN: Wiping existing primary data before full refresh. [2025-09-17T18:22:25.065822] [INFO ] [LOCAL ] CWAN: Starting deletion of primary data. [2025-09-17T18:22:25.066858] [DEBUG] [LOCAL ] CWAN: Deleted primary data file. [2025-09-17T18:22:25.066912] [INFO ] [MAIN ] CWAN: Starting full primary refresh. [2025-09-17T18:22:25.220971] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-04. [2025-09-17T18:22:25.443078] [INFO ] [REMOTE ] CWAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:22:26.015758] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-11. [2025-09-17T18:22:26.388667] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T18:22:26.425471] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T18:22:26.815773] [INFO ] [REMOTE ] CVX: Fetching primary data for 2025-09. [2025-09-17T18:22:27.615809] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-05. [2025-09-17T18:22:27.962323] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-17T18:22:28.415817] [INFO ] [REMOTE ] CVNA: Fetching primary data for 2025-09. [2025-09-17T18:22:28.945325] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T18:22:28.999895] [INFO ] [REMOTE ] CVX: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-17T18:22:29.007094] [INFO ] [REMOTE ] CVX: Full fetch complete (77768 records). [2025-09-17T18:22:29.007280] [DEBUG] [VALIDATOR ] CVX: Validating primary data. [2025-09-17T18:22:29.220967] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-06. [2025-09-17T18:22:29.418796] [DEBUG] [VALIDATOR ] CVX: All expected trading days are present. [2025-09-17T18:22:29.418911] [DEBUG] [VALIDATOR ] CVX: Primary data validation passed. [2025-09-17T18:22:29.420128] [INFO ] [MAIN ] CVX: Fetched primary data is valid. [2025-09-17T18:22:29.420220] [DEBUG] [LOCAL ] CVX: Saving primary data. [2025-09-17T18:22:29.422304] [DEBUG] [LOCAL ] CVX: Trimmed 77768 records to 53760 (keeping 200 days of data) [2025-09-17T18:22:29.772034] [DEBUG] [LOCAL ] CVX: Primary data saved (53760 records). [2025-09-17T18:22:29.772177] [INFO ] [MAIN ] CVX: Full history saved. [2025-09-17T18:22:29.773276] [INFO ] [MAIN ] Update Progress: 567/2371 symbols completed. CVX took 36.0s. Estimated remaining: 4h 22m 22s. Rate: 6.9 symbols/min [2025-09-17T18:22:29.943751] [INFO ] [MAIN ] CWEN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:22:29.988551] [DEBUG] [LOCAL ] CWEN: Loaded 45036 existing records from primary storage. [2025-09-17T18:22:29.988710] [INFO ] [MAIN ] CWEN: Loaded 45036 existing records. [2025-09-17T18:22:30.022170] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2024-12. [2025-09-17T18:22:30.182563] [WARN ] [MAIN ] CWEN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:22:30.182807] [INFO ] [MAIN ] CWEN: Wiping existing primary data before full refresh. [2025-09-17T18:22:30.182852] [INFO ] [LOCAL ] CWEN: Starting deletion of primary data. [2025-09-17T18:22:30.183886] [DEBUG] [LOCAL ] CWEN: Deleted primary data file. [2025-09-17T18:22:30.183936] [INFO ] [MAIN ] CWEN: Starting full primary refresh. [2025-09-17T18:22:30.544135] [INFO ] [REMOTE ] CWEN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:22:30.562925] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T18:22:30.596547] [INFO ] [REMOTE ] CVNA: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-17T18:22:30.603240] [INFO ] [REMOTE ] CVNA: Full fetch complete (76597 records). [2025-09-17T18:22:30.603368] [DEBUG] [VALIDATOR ] CVNA: Validating primary data. [2025-09-17T18:22:30.824847] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-07. [2025-09-17T18:22:31.032476] [DEBUG] [VALIDATOR ] CVNA: All expected trading days are present. [2025-09-17T18:22:31.032580] [DEBUG] [VALIDATOR ] CVNA: Primary data validation passed. [2025-09-17T18:22:31.033714] [INFO ] [MAIN ] CVNA: Fetched primary data is valid. [2025-09-17T18:22:31.033789] [DEBUG] [LOCAL ] CVNA: Saving primary data. [2025-09-17T18:22:31.035361] [DEBUG] [LOCAL ] CVNA: Trimmed 76597 records to 53072 (keeping 200 days of data) [2025-09-17T18:22:31.365701] [DEBUG] [LOCAL ] CVNA: Primary data saved (53072 records). [2025-09-17T18:22:31.365849] [INFO ] [MAIN ] CVNA: Full history saved. [2025-09-17T18:22:31.365934] [INFO ] [MAIN ] Update Progress: 568/2371 symbols completed. CVNA took 42.8s. Estimated remaining: 4h 21m 51s. Rate: 6.9 symbols/min [2025-09-17T18:22:31.540837] [INFO ] [MAIN ] CWH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:22:31.592684] [DEBUG] [LOCAL ] CWH: Loaded 51418 existing records from primary storage. [2025-09-17T18:22:31.592828] [INFO ] [MAIN ] CWH: Loaded 51418 existing records. [2025-09-17T18:22:31.623956] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-11. [2025-09-17T18:22:31.783909] [WARN ] [MAIN ] CWH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:22:31.784792] [INFO ] [MAIN ] CWH: Wiping existing primary data before full refresh. [2025-09-17T18:22:31.784924] [INFO ] [LOCAL ] CWH: Starting deletion of primary data. [2025-09-17T18:22:31.826913] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T18:22:31.827010] [DEBUG] [LOCAL ] CWH: Deleted primary data file. [2025-09-17T18:22:31.836843] [INFO ] [MAIN ] CWH: Starting full primary refresh. [2025-09-17T18:22:31.921585] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T18:22:32.245131] [INFO ] [REMOTE ] CWH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:22:32.415782] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-01. [2025-09-17T18:22:33.215815] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-08. [2025-09-17T18:22:33.374998] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T18:22:33.699111] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T18:22:34.015746] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-02. [2025-09-17T18:22:34.350333] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T18:22:34.815782] [INFO ] [REMOTE ] CW: Fetching primary data for 2025-09. [2025-09-17T18:22:35.615761] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-11. [2025-09-17T18:22:35.713221] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T18:22:36.023380] [INFO ] [REMOTE ] CW: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T18:22:36.026734] [INFO ] [REMOTE ] CW: Full fetch complete (33338 records). [2025-09-17T18:22:36.026849] [DEBUG] [VALIDATOR ] CW: Validating primary data. [2025-09-17T18:22:36.027526] [FATAL] [VALIDATOR ] CW: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:22:36.027613] [FATAL] [MAIN ] CW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:22:36.027672] [WARN ] [MAIN ] CW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:22:36.027903] [INFO ] [LOCAL ] CW: Starting deletion of primary data. [2025-09-17T18:22:36.027962] [DEBUG] [LOCAL ] CW: No primary data file found to delete. [2025-09-17T18:22:36.027998] [INFO ] [LOCAL ] CW: Starting deletion of derivative data. [2025-09-17T18:22:36.028328] [DEBUG] [LOCAL ] CW: Deleted derivative data file. [2025-09-17T18:22:36.028419] [INFO ] [MAIN ] Update Progress: 569/2371 symbols completed. CW took 27.8s. Estimated remaining: 4h 21m 30s. Rate: 6.9 symbols/min [2025-09-17T18:22:36.233222] [INFO ] [MAIN ] CWK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:22:36.284162] [DEBUG] [LOCAL ] CWK: Loaded 49395 existing records from primary storage. [2025-09-17T18:22:36.284356] [INFO ] [MAIN ] CWK: Loaded 49395 existing records. [2025-09-17T18:22:36.421130] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-03. [2025-09-17T18:22:36.495879] [WARN ] [MAIN ] CWK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:22:36.496188] [INFO ] [MAIN ] CWK: Wiping existing primary data before full refresh. [2025-09-17T18:22:36.496238] [INFO ] [LOCAL ] CWK: Starting deletion of primary data. [2025-09-17T18:22:36.497035] [DEBUG] [LOCAL ] CWK: Deleted primary data file. [2025-09-17T18:22:36.497089] [INFO ] [MAIN ] CWK: Starting full primary refresh. [2025-09-17T18:22:36.877112] [INFO ] [REMOTE ] CWK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:22:37.163106] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T18:22:37.215809] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-11. [2025-09-17T18:22:38.015791] [INFO ] [REMOTE ] CWH: Fetching primary data for 2024-12. [2025-09-17T18:22:38.368965] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T18:22:38.815829] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2024-12. [2025-09-17T18:22:38.896125] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T18:22:39.615792] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-04. [2025-09-17T18:22:39.698755] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T18:22:39.948857] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T18:22:40.415807] [INFO ] [REMOTE ] CWK: Fetching primary data for 2024-12. [2025-09-17T18:22:41.215785] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-01. [2025-09-17T18:22:41.385717] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T18:22:42.028335] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-05. [2025-09-17T18:22:42.034855] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T18:22:42.757856] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T18:22:42.815808] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-02. [2025-09-17T18:22:43.367496] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T18:22:43.615821] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-01. [2025-09-17T18:22:44.299973] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T18:22:44.415845] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-03. [2025-09-17T18:22:45.220855] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-01. [2025-09-17T18:22:45.237986] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T18:22:46.015793] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-02. [2025-09-17T18:22:46.146802] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T18:22:46.815730] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-04. [2025-09-17T18:22:46.908953] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T18:22:47.300825] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T18:22:47.615790] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-02. [2025-09-17T18:22:48.415818] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-06. [2025-09-17T18:22:48.585986] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T18:22:49.099233] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T18:22:49.215821] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-03. [2025-09-17T18:22:50.015821] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-03. [2025-09-17T18:22:50.354942] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T18:22:50.616480] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T18:22:50.815809] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-04. [2025-09-17T18:22:51.615779] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-05. [2025-09-17T18:22:51.737752] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T18:22:52.420883] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-04. [2025-09-17T18:22:52.449803] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T18:22:53.016107] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T18:22:53.215771] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-07. [2025-09-17T18:22:53.791636] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T18:22:54.015845] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-06. [2025-09-17T18:22:54.815831] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-05. [2025-09-17T18:22:55.001345] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T18:22:55.615863] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-05. [2025-09-17T18:22:55.676847] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T18:22:56.420997] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-08. [2025-09-17T18:22:56.444684] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T18:22:56.895659] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T18:22:57.215842] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-06. [2025-09-17T18:22:58.015793] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-06. [2025-09-17T18:22:58.238307] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T18:22:58.605456] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T18:22:58.815814] [INFO ] [REMOTE ] CWAN: Fetching primary data for 2025-09. [2025-09-17T18:22:59.259801] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T18:22:59.615844] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-07. [2025-09-17T18:23:00.415786] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-07. [2025-09-17T18:23:00.577844] [INFO ] [REMOTE ] CWAN: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T18:23:00.584798] [INFO ] [REMOTE ] CWAN: Full fetch complete (74891 records). [2025-09-17T18:23:00.584930] [DEBUG] [VALIDATOR ] CWAN: Validating primary data. [2025-09-17T18:23:00.993761] [DEBUG] [VALIDATOR ] CWAN: All expected trading days are present. [2025-09-17T18:23:00.993870] [DEBUG] [VALIDATOR ] CWAN: Primary data validation passed. [2025-09-17T18:23:00.994928] [INFO ] [MAIN ] CWAN: Fetched primary data is valid. [2025-09-17T18:23:00.994985] [DEBUG] [LOCAL ] CWAN: Saving primary data. [2025-09-17T18:23:00.996557] [DEBUG] [LOCAL ] CWAN: Trimmed 74891 records to 52384 (keeping 200 days of data) [2025-09-17T18:23:01.215908] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-07. [2025-09-17T18:23:01.322353] [DEBUG] [LOCAL ] CWAN: Primary data saved (52384 records). [2025-09-17T18:23:01.322504] [INFO ] [MAIN ] CWAN: Full history saved. [2025-09-17T18:23:01.323064] [INFO ] [MAIN ] Update Progress: 570/2371 symbols completed. CWAN took 36.7s. Estimated remaining: 4h 22m 13s. Rate: 6.9 symbols/min [2025-09-17T18:23:01.494407] [INFO ] [MAIN ] CWT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:23:01.528802] [DEBUG] [LOCAL ] CWT: Loaded 27984 existing records from primary storage. [2025-09-17T18:23:01.528938] [INFO ] [MAIN ] CWT: Loaded 27984 existing records. [2025-09-17T18:23:01.712921] [WARN ] [MAIN ] CWT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:23:01.713197] [INFO ] [MAIN ] CWT: Wiping existing primary data before full refresh. [2025-09-17T18:23:01.713246] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-17T18:23:01.714282] [DEBUG] [LOCAL ] CWT: Deleted primary data file. [2025-09-17T18:23:01.714347] [INFO ] [MAIN ] CWT: Starting full primary refresh. [2025-09-17T18:23:02.092714] [INFO ] [REMOTE ] CWT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:23:02.093125] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-11. [2025-09-17T18:23:02.949056] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T18:23:02.968545] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-08. [2025-09-17T18:23:03.283492] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T18:23:03.615981] [INFO ] [REMOTE ] CWT: Fetching primary data for 2024-12. [2025-09-17T18:23:05.006054] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T18:23:05.017992] [INFO ] [REMOTE ] CWH: Fetching primary data for 2025-09. [2025-09-17T18:23:05.211244] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T18:23:05.216524] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-01. [2025-09-17T18:23:05.275406] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-07 (4.86 seconds). [2025-09-17T18:23:05.327336] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-07 (5.71 seconds). [2025-09-17T18:23:06.015783] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-08. [2025-09-17T18:23:06.301947] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T18:23:06.803574] [INFO ] [REMOTE ] CWH: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T18:23:06.810611] [INFO ] [REMOTE ] CWH: Full fetch complete (72454 records). [2025-09-17T18:23:06.810801] [DEBUG] [VALIDATOR ] CWH: Validating primary data. [2025-09-17T18:23:06.823955] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-08. [2025-09-17T18:23:07.231770] [DEBUG] [VALIDATOR ] CWH: All expected trading days are present. [2025-09-17T18:23:07.231883] [DEBUG] [VALIDATOR ] CWH: Primary data validation passed. [2025-09-17T18:23:07.233006] [INFO ] [MAIN ] CWH: Fetched primary data is valid. [2025-09-17T18:23:07.233056] [DEBUG] [LOCAL ] CWH: Saving primary data. [2025-09-17T18:23:07.239942] [DEBUG] [LOCAL ] CWH: Trimmed 72454 records to 51416 (keeping 200 days of data) [2025-09-17T18:23:07.597508] [DEBUG] [LOCAL ] CWH: Primary data saved (51416 records). [2025-09-17T18:23:07.597840] [INFO ] [MAIN ] CWH: Full history saved. [2025-09-17T18:23:07.597966] [INFO ] [MAIN ] Update Progress: 571/2371 symbols completed. CWH took 36.2s. Estimated remaining: 4h 21m 57s. Rate: 6.9 symbols/min [2025-09-17T18:23:07.636812] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-02. [2025-09-17T18:23:07.799423] [INFO ] [MAIN ] CX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:23:07.840211] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T18:23:07.903861] [DEBUG] [LOCAL ] CX: Loaded 52846 existing records from primary storage. [2025-09-17T18:23:07.904196] [INFO ] [MAIN ] CX: Loaded 52846 existing records. [2025-09-17T18:23:08.109799] [WARN ] [MAIN ] CX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:23:08.110317] [INFO ] [MAIN ] CX: Wiping existing primary data before full refresh. [2025-09-17T18:23:08.110601] [INFO ] [LOCAL ] CX: Starting deletion of primary data. [2025-09-17T18:23:08.111794] [DEBUG] [LOCAL ] CX: Deleted primary data file. [2025-09-17T18:23:08.111854] [INFO ] [MAIN ] CX: Starting full primary refresh. [2025-09-17T18:23:08.420922] [INFO ] [REMOTE ] CWK: Fetching primary data for 2025-09. [2025-09-17T18:23:08.527952] [INFO ] [REMOTE ] CX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:23:08.564501] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T18:23:08.982561] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T18:23:09.215797] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-11. [2025-09-17T18:23:09.896047] [INFO ] [REMOTE ] CWK: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T18:23:09.902517] [INFO ] [REMOTE ] CWK: Full fetch complete (70657 records). [2025-09-17T18:23:09.902687] [DEBUG] [VALIDATOR ] CWK: Validating primary data. [2025-09-17T18:23:10.020867] [INFO ] [REMOTE ] CWEN: Fetching primary data for 2025-09. [2025-09-17T18:23:10.346201] [DEBUG] [VALIDATOR ] CWK: All expected trading days are present. [2025-09-17T18:23:10.346286] [DEBUG] [VALIDATOR ] CWK: Primary data validation passed. [2025-09-17T18:23:10.347110] [INFO ] [MAIN ] CWK: Fetched primary data is valid. [2025-09-17T18:23:10.347165] [DEBUG] [LOCAL ] CWK: Saving primary data. [2025-09-17T18:23:10.348547] [DEBUG] [LOCAL ] CWK: Trimmed 70657 records to 49420 (keeping 200 days of data) [2025-09-17T18:23:10.654457] [DEBUG] [LOCAL ] CWK: Primary data saved (49420 records). [2025-09-17T18:23:10.654655] [INFO ] [MAIN ] CWK: Full history saved. [2025-09-17T18:23:10.654746] [INFO ] [MAIN ] Update Progress: 572/2371 symbols completed. CWK took 34.6s. Estimated remaining: 4h 21m 30s. Rate: 6.9 symbols/min [2025-09-17T18:23:10.823544] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-03. [2025-09-17T18:23:10.826014] [INFO ] [MAIN ] CXE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:23:10.836103] [DEBUG] [LOCAL ] CXE: Loaded 7151 existing records from primary storage. [2025-09-17T18:23:10.836241] [INFO ] [MAIN ] CXE: Loaded 7151 existing records. [2025-09-17T18:23:11.016890] [WARN ] [MAIN ] CXE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:23:11.017319] [INFO ] [MAIN ] CXE: Wiping existing primary data before full refresh. [2025-09-17T18:23:11.017416] [INFO ] [LOCAL ] CXE: Starting deletion of primary data. [2025-09-17T18:23:11.017878] [DEBUG] [LOCAL ] CXE: Deleted primary data file. [2025-09-17T18:23:11.017934] [INFO ] [MAIN ] CXE: Starting full primary refresh. [2025-09-17T18:23:11.175816] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T18:23:11.423863] [INFO ] [REMOTE ] CXE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:23:11.615774] [INFO ] [REMOTE ] CX: Fetching primary data for 2024-12. [2025-09-17T18:23:11.856726] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T18:23:12.040560] [INFO ] [REMOTE ] CWEN: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-17T18:23:12.050663] [INFO ] [REMOTE ] CWEN: Full fetch complete (64137 records). [2025-09-17T18:23:12.050888] [DEBUG] [VALIDATOR ] CWEN: Validating primary data. [2025-09-17T18:23:12.421085] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-11. [2025-09-17T18:23:12.650531] [DEBUG] [VALIDATOR ] CWEN: All expected trading days are present. [2025-09-17T18:23:12.650672] [DEBUG] [VALIDATOR ] CWEN: Primary data validation passed. [2025-09-17T18:23:12.652294] [INFO ] [MAIN ] CWEN: Fetched primary data is valid. [2025-09-17T18:23:12.652373] [DEBUG] [LOCAL ] CWEN: Saving primary data. [2025-09-17T18:23:12.654276] [DEBUG] [LOCAL ] CWEN: Trimmed 64137 records to 45031 (keeping 200 days of data) [2025-09-17T18:23:13.010687] [DEBUG] [LOCAL ] CWEN: Primary data saved (45031 records). [2025-09-17T18:23:13.010854] [INFO ] [MAIN ] CWEN: Full history saved. [2025-09-17T18:23:13.013074] [INFO ] [MAIN ] Update Progress: 573/2371 symbols completed. CWEN took 43.2s. Estimated remaining: 4h 21m 1s. Rate: 6.9 symbols/min [2025-09-17T18:23:13.119408] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-17T18:23:13.211351] [INFO ] [MAIN ] CXH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:23:13.218673] [DEBUG] [LOCAL ] CXH: Loaded 4413 existing records from primary storage. [2025-09-17T18:23:13.218789] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-04. [2025-09-17T18:23:13.219153] [INFO ] [MAIN ] CXH: Loaded 4413 existing records. [2025-09-17T18:23:13.401163] [WARN ] [MAIN ] CXH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:23:13.401605] [INFO ] [MAIN ] CXH: Wiping existing primary data before full refresh. [2025-09-17T18:23:13.401696] [INFO ] [LOCAL ] CXH: Starting deletion of primary data. [2025-09-17T18:23:13.402011] [DEBUG] [LOCAL ] CXH: Deleted primary data file. [2025-09-17T18:23:13.402075] [INFO ] [MAIN ] CXH: Starting full primary refresh. [2025-09-17T18:23:13.539420] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T18:23:13.803365] [INFO ] [REMOTE ] CXH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:23:14.015766] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-01. [2025-09-17T18:23:14.470299] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T18:23:14.815778] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-05. [2025-09-17T18:23:15.615819] [INFO ] [REMOTE ] CXE: Fetching primary data for 2024-12. [2025-09-17T18:23:15.833860] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T18:23:15.905330] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T18:23:16.415756] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-06. [2025-09-17T18:23:16.500813] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T18:23:17.215775] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-01. [2025-09-17T18:23:17.701070] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T18:23:17.860997] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T18:23:18.015786] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-07. [2025-09-17T18:23:18.815794] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-11. [2025-09-17T18:23:19.268022] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T18:23:19.269652] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T18:23:19.615766] [INFO ] [REMOTE ] CXH: Fetching primary data for 2024-12. [2025-09-17T18:23:20.107300] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-17T18:23:20.415814] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-02. [2025-09-17T18:23:21.215773] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-08. [2025-09-17T18:23:22.018030] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-02. [2025-09-17T18:23:22.023552] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T18:23:22.122568] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T18:23:22.817664] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-03. [2025-09-17T18:23:22.819181] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T18:23:23.615973] [INFO ] [REMOTE ] CWT: Fetching primary data for 2025-09. [2025-09-17T18:23:24.415785] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-01. [2025-09-17T18:23:24.564975] [INFO ] [REMOTE ] CWT: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T18:23:24.568418] [INFO ] [REMOTE ] CWT: Full fetch complete (39936 records). [2025-09-17T18:23:24.568507] [DEBUG] [VALIDATOR ] CWT: Validating primary data. [2025-09-17T18:23:24.569136] [FATAL] [VALIDATOR ] CWT: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:23:24.569222] [FATAL] [MAIN ] CWT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:23:24.569272] [WARN ] [MAIN ] CWT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:23:24.569317] [INFO ] [LOCAL ] CWT: Starting deletion of primary data. [2025-09-17T18:23:24.569419] [DEBUG] [LOCAL ] CWT: No primary data file found to delete. [2025-09-17T18:23:24.569461] [INFO ] [LOCAL ] CWT: Starting deletion of derivative data. [2025-09-17T18:23:24.569798] [DEBUG] [LOCAL ] CWT: Deleted derivative data file. [2025-09-17T18:23:24.569888] [INFO ] [MAIN ] Update Progress: 574/2371 symbols completed. CWT took 23.2s. Estimated remaining: 4h 21m 2s. Rate: 6.9 symbols/min [2025-09-17T18:23:24.755395] [INFO ] [MAIN ] CXM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:23:24.758362] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T18:23:24.799223] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T18:23:24.852913] [DEBUG] [LOCAL ] CXM: Loaded 47979 existing records from primary storage. [2025-09-17T18:23:24.853100] [INFO ] [MAIN ] CXM: Loaded 47979 existing records. [2025-09-17T18:23:25.042456] [WARN ] [MAIN ] CXM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:23:25.042736] [INFO ] [MAIN ] CXM: Wiping existing primary data before full refresh. [2025-09-17T18:23:25.042785] [INFO ] [LOCAL ] CXM: Starting deletion of primary data. [2025-09-17T18:23:25.043706] [DEBUG] [LOCAL ] CXM: Deleted primary data file. [2025-09-17T18:23:25.044021] [INFO ] [MAIN ] CXM: Starting full primary refresh. [2025-09-17T18:23:25.225336] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-04. [2025-09-17T18:23:25.409905] [INFO ] [REMOTE ] CXM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:23:26.015852] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-03. [2025-09-17T18:23:26.815700] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-02. [2025-09-17T18:23:26.947159] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T18:23:27.107387] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-17T18:23:27.334165] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T18:23:27.615781] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-04. [2025-09-17T18:23:28.250422] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T18:23:28.415780] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-05. [2025-09-17T18:23:29.104278] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T18:23:29.215780] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-06. [2025-09-17T18:23:29.862901] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T18:23:30.015814] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-05. [2025-09-17T18:23:30.815813] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-11. [2025-09-17T18:23:31.615803] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-07. [2025-09-17T18:23:31.676073] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T18:23:32.042326] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T18:23:32.252168] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T18:23:32.415802] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-08. [2025-09-17T18:23:33.019409] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T18:23:33.215815] [INFO ] [REMOTE ] CXE: Fetching primary data for 2025-09. [2025-09-17T18:23:33.991479] [INFO ] [REMOTE ] CXE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T18:23:33.993295] [INFO ] [REMOTE ] CXE: Full fetch complete (11930 records). [2025-09-17T18:23:33.993364] [DEBUG] [VALIDATOR ] CXE: Validating primary data. [2025-09-17T18:23:34.022411] [INFO ] [REMOTE ] CXM: Fetching primary data for 2024-12. [2025-09-17T18:23:34.366161] [DEBUG] [VALIDATOR ] CXE: All expected trading days are present. [2025-09-17T18:23:34.366243] [DEBUG] [VALIDATOR ] CXE: Primary data validation passed. [2025-09-17T18:23:34.366531] [INFO ] [MAIN ] CXE: Fetched primary data is valid. [2025-09-17T18:23:34.366570] [DEBUG] [LOCAL ] CXE: Saving primary data. [2025-09-17T18:23:34.367052] [DEBUG] [LOCAL ] CXE: Trimmed 11930 records to 7257 (keeping 200 days of data) [2025-09-17T18:23:34.410350] [DEBUG] [LOCAL ] CXE: Primary data saved (7257 records). [2025-09-17T18:23:34.410489] [INFO ] [MAIN ] CXE: Full history saved. [2025-09-17T18:23:34.410575] [INFO ] [MAIN ] Update Progress: 575/2371 symbols completed. CXE took 23.8s. Estimated remaining: 4h 20m 56s. Rate: 6.9 symbols/min [2025-09-17T18:23:34.580488] [INFO ] [MAIN ] CXT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:23:34.612184] [DEBUG] [LOCAL ] CXT: Loaded 30981 existing records from primary storage. [2025-09-17T18:23:34.612365] [INFO ] [MAIN ] CXT: Loaded 30981 existing records. [2025-09-17T18:23:34.792423] [WARN ] [MAIN ] CXT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:23:34.792742] [INFO ] [MAIN ] CXT: Wiping existing primary data before full refresh. [2025-09-17T18:23:34.792791] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-17T18:23:34.793568] [DEBUG] [LOCAL ] CXT: Deleted primary data file. [2025-09-17T18:23:34.793615] [INFO ] [MAIN ] CXT: Starting full primary refresh. [2025-09-17T18:23:34.825788] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-06. [2025-09-17T18:23:35.183951] [INFO ] [REMOTE ] CXT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:23:35.615850] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-03. [2025-09-17T18:23:35.749174] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T18:23:36.158115] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T18:23:36.273348] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T18:23:36.415808] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-11. [2025-09-17T18:23:37.215783] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-07. [2025-09-17T18:23:37.803851] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T18:23:38.015825] [INFO ] [REMOTE ] CXT: Fetching primary data for 2024-12. [2025-09-17T18:23:38.741935] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T18:23:38.815797] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-01. [2025-09-17T18:23:39.244620] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T18:23:39.615787] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-01. [2025-09-17T18:23:40.355234] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T18:23:40.415783] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-02. [2025-09-17T18:23:40.873940] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T18:23:41.215815] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-02. [2025-09-17T18:23:42.021360] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-08. [2025-09-17T18:23:42.033301] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T18:23:42.599180] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T18:23:42.815827] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-03. [2025-09-17T18:23:43.615779] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-03. [2025-09-17T18:23:43.809730] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T18:23:44.415781] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-04. [2025-09-17T18:23:44.524694] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T18:23:44.891337] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-17T18:23:45.051614] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T18:23:45.215782] [INFO ] [REMOTE ] CX: Fetching primary data for 2025-09. [2025-09-17T18:23:46.015775] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-05. [2025-09-17T18:23:46.815811] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-04. [2025-09-17T18:23:47.008358] [INFO ] [REMOTE ] CX: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T18:23:47.015141] [INFO ] [REMOTE ] CX: Full fetch complete (76194 records). [2025-09-17T18:23:47.015301] [DEBUG] [VALIDATOR ] CX: Validating primary data. [2025-09-17T18:23:47.132723] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T18:23:47.416363] [DEBUG] [VALIDATOR ] CX: All expected trading days are present. [2025-09-17T18:23:47.416443] [DEBUG] [VALIDATOR ] CX: Primary data validation passed. [2025-09-17T18:23:47.417277] [INFO ] [MAIN ] CX: Fetched primary data is valid. [2025-09-17T18:23:47.417353] [DEBUG] [LOCAL ] CX: Saving primary data. [2025-09-17T18:23:47.419205] [DEBUG] [LOCAL ] CX: Trimmed 76194 records to 52839 (keeping 200 days of data) [2025-09-17T18:23:47.625427] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-06. [2025-09-17T18:23:47.737287] [DEBUG] [LOCAL ] CX: Primary data saved (52839 records). [2025-09-17T18:23:47.737434] [INFO ] [MAIN ] CX: Full history saved. [2025-09-17T18:23:47.737550] [INFO ] [MAIN ] Update Progress: 576/2371 symbols completed. CX took 40.1s. Estimated remaining: 4h 21m 2s. Rate: 6.9 symbols/min [2025-09-17T18:23:47.909756] [INFO ] [MAIN ] CXW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:23:47.954503] [DEBUG] [LOCAL ] CXW: Loaded 44708 existing records from primary storage. [2025-09-17T18:23:47.954665] [INFO ] [MAIN ] CXW: Loaded 44708 existing records. [2025-09-17T18:23:48.089324] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T18:23:48.142003] [WARN ] [MAIN ] CXW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:23:48.142219] [INFO ] [MAIN ] CXW: Wiping existing primary data before full refresh. [2025-09-17T18:23:48.142264] [INFO ] [LOCAL ] CXW: Starting deletion of primary data. [2025-09-17T18:23:48.143069] [DEBUG] [LOCAL ] CXW: Deleted primary data file. [2025-09-17T18:23:48.143126] [INFO ] [MAIN ] CXW: Starting full primary refresh. [2025-09-17T18:23:48.419569] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-04. [2025-09-17T18:23:48.501320] [INFO ] [REMOTE ] CXW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:23:48.528286] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T18:23:49.215773] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-05. [2025-09-17T18:23:49.962624] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T18:23:50.015772] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-05. [2025-09-17T18:23:50.772082] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T18:23:50.815732] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-06. [2025-09-17T18:23:51.224267] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T18:23:51.615790] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-11. [2025-09-17T18:23:52.415745] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-06. [2025-09-17T18:23:52.488387] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T18:23:53.215810] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-07. [2025-09-17T18:23:53.471500] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T18:23:53.713775] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T18:23:54.015782] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-07. [2025-09-17T18:23:54.828030] [INFO ] [REMOTE ] CXW: Fetching primary data for 2024-12. [2025-09-17T18:23:54.834692] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T18:23:54.925919] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T18:23:55.615847] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-07. [2025-09-17T18:23:56.382091] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T18:23:56.415759] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-08. [2025-09-17T18:23:56.462591] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T18:23:56.899123] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T18:23:57.215785] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-01. [2025-09-17T18:23:58.015784] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-08. [2025-09-17T18:23:58.815759] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-08. [2025-09-17T18:23:58.859951] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T18:23:59.615829] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-02. [2025-09-17T18:23:59.684326] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T18:24:00.352542] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T18:24:00.415772] [INFO ] [REMOTE ] CXT: Fetching primary data for 2025-09. [2025-09-17T18:24:01.215805] [INFO ] [REMOTE ] CXM: Fetching primary data for 2025-09. [2025-09-17T18:24:01.503169] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T18:24:01.634222] [INFO ] [REMOTE ] CXT: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T18:24:01.639506] [INFO ] [REMOTE ] CXT: Full fetch complete (44405 records). [2025-09-17T18:24:01.639604] [DEBUG] [VALIDATOR ] CXT: Validating primary data. [2025-09-17T18:24:01.640279] [FATAL] [VALIDATOR ] CXT: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:24:01.640358] [FATAL] [MAIN ] CXT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:24:01.640405] [WARN ] [MAIN ] CXT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:24:01.640449] [INFO ] [LOCAL ] CXT: Starting deletion of primary data. [2025-09-17T18:24:01.640506] [DEBUG] [LOCAL ] CXT: No primary data file found to delete. [2025-09-17T18:24:01.640553] [INFO ] [LOCAL ] CXT: Starting deletion of derivative data. [2025-09-17T18:24:01.640862] [DEBUG] [LOCAL ] CXT: Deleted derivative data file. [2025-09-17T18:24:01.640965] [INFO ] [MAIN ] Update Progress: 577/2371 symbols completed. CXT took 27.2s. Estimated remaining: 4h 21m 10s. Rate: 6.9 symbols/min [2025-09-17T18:24:01.856027] [INFO ] [MAIN ] CYD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:24:01.882389] [DEBUG] [LOCAL ] CYD: Loaded 26833 existing records from primary storage. [2025-09-17T18:24:01.882518] [INFO ] [MAIN ] CYD: Loaded 26833 existing records. [2025-09-17T18:24:02.023208] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-03. [2025-09-17T18:24:02.061859] [WARN ] [MAIN ] CYD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:24:02.062140] [INFO ] [MAIN ] CYD: Wiping existing primary data before full refresh. [2025-09-17T18:24:02.062200] [INFO ] [LOCAL ] CYD: Starting deletion of primary data. [2025-09-17T18:24:02.062863] [DEBUG] [LOCAL ] CYD: Deleted primary data file. [2025-09-17T18:24:02.062921] [INFO ] [MAIN ] CYD: Starting full primary refresh. [2025-09-17T18:24:02.430040] [INFO ] [REMOTE ] CYD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:24:02.815823] [INFO ] [REMOTE ] CXH: Fetching primary data for 2025-09. [2025-09-17T18:24:02.898452] [INFO ] [REMOTE ] CXM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T18:24:02.908268] [INFO ] [REMOTE ] CXM: Full fetch complete (68991 records). [2025-09-17T18:24:02.908493] [DEBUG] [VALIDATOR ] CXM: Validating primary data. [2025-09-17T18:24:03.302545] [DEBUG] [VALIDATOR ] CXM: All expected trading days are present. [2025-09-17T18:24:03.302628] [DEBUG] [VALIDATOR ] CXM: Primary data validation passed. [2025-09-17T18:24:03.303412] [INFO ] [MAIN ] CXM: Fetched primary data is valid. [2025-09-17T18:24:03.303455] [DEBUG] [LOCAL ] CXM: Saving primary data. [2025-09-17T18:24:03.304825] [DEBUG] [LOCAL ] CXM: Trimmed 68991 records to 47981 (keeping 200 days of data) [2025-09-17T18:24:03.587836] [DEBUG] [LOCAL ] CXM: Primary data saved (47981 records). [2025-09-17T18:24:03.587996] [INFO ] [MAIN ] CXM: Full history saved. [2025-09-17T18:24:03.589615] [INFO ] [MAIN ] Update Progress: 578/2371 symbols completed. CXM took 39.0s. Estimated remaining: 4h 20m 40s. Rate: 6.9 symbols/min [2025-09-17T18:24:03.626160] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-11. [2025-09-17T18:24:03.689071] [INFO ] [REMOTE ] CXH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T18:24:03.697860] [INFO ] [REMOTE ] CXH: Full fetch complete (5538 records). [2025-09-17T18:24:03.701768] [DEBUG] [VALIDATOR ] CXH: Validating primary data. [2025-09-17T18:24:03.841225] [INFO ] [MAIN ] CYH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:24:03.915310] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T18:24:04.219107] [DEBUG] [VALIDATOR ] CXH: All expected trading days are present. [2025-09-17T18:24:04.219207] [DEBUG] [VALIDATOR ] CXH: Primary data validation passed. [2025-09-17T18:24:04.220708] [INFO ] [MAIN ] CXH: Fetched primary data is valid. [2025-09-17T18:24:04.220409] [DEBUG] [LOCAL ] CYH: Loaded 48064 existing records from primary storage. [2025-09-17T18:24:04.220957] [INFO ] [MAIN ] CYH: Loaded 48064 existing records. [2025-09-17T18:24:04.220870] [DEBUG] [LOCAL ] CXH: Saving primary data. [2025-09-17T18:24:04.303571] [DEBUG] [LOCAL ] CXH: Trimmed 5538 records to 4420 (keeping 200 days of data) [2025-09-17T18:24:04.416286] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-04. [2025-09-17T18:24:04.452370] [WARN ] [MAIN ] CYH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:24:04.454077] [DEBUG] [LOCAL ] CXH: Primary data saved (4420 records). [2025-09-17T18:24:04.454874] [INFO ] [MAIN ] CYH: Wiping existing primary data before full refresh. [2025-09-17T18:24:04.454944] [INFO ] [MAIN ] CXH: Full history saved. [2025-09-17T18:24:04.455304] [INFO ] [MAIN ] Update Progress: 579/2371 symbols completed. CXH took 51.4s. Estimated remaining: 4h 20m 7s. Rate: 6.9 symbols/min [2025-09-17T18:24:04.455199] [INFO ] [LOCAL ] CYH: Starting deletion of primary data. [2025-09-17T18:24:04.497347] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T18:24:04.503180] [DEBUG] [LOCAL ] CYH: Deleted primary data file. [2025-09-17T18:24:04.522259] [INFO ] [MAIN ] CYH: Starting full primary refresh. [2025-09-17T18:24:04.950569] [INFO ] [MAIN ] D: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:24:05.216184] [INFO ] [REMOTE ] CYD: Fetching primary data for 2024-12. [2025-09-17T18:24:05.351212] [INFO ] [REMOTE ] CYH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:24:05.371154] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-09-17T18:24:05.371326] [INFO ] [MAIN ] D: Loaded 53647 existing records. [2025-09-17T18:24:05.562862] [WARN ] [MAIN ] D: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:24:05.563165] [INFO ] [MAIN ] D: Wiping existing primary data before full refresh. [2025-09-17T18:24:05.563217] [INFO ] [LOCAL ] D: Starting deletion of primary data. [2025-09-17T18:24:05.564524] [DEBUG] [LOCAL ] D: Deleted primary data file. [2025-09-17T18:24:05.564583] [INFO ] [MAIN ] D: Starting full primary refresh. [2025-09-17T18:24:05.923438] [INFO ] [REMOTE ] D: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:24:06.015740] [INFO ] [REMOTE ] D: Fetching primary data for 2024-11. [2025-09-17T18:24:06.230699] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T18:24:06.272033] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T18:24:06.815816] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-11. [2025-09-17T18:24:07.615805] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-01. [2025-09-17T18:24:08.015602] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T18:24:08.098488] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T18:24:08.289981] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T18:24:08.415771] [INFO ] [REMOTE ] CYH: Fetching primary data for 2024-12. [2025-09-17T18:24:09.215803] [INFO ] [REMOTE ] D: Fetching primary data for 2024-12. [2025-09-17T18:24:10.020982] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-05. [2025-09-17T18:24:10.033183] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T18:24:10.795155] [INFO ] [REMOTE ] D: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T18:24:10.815724] [INFO ] [REMOTE ] D: Fetching primary data for 2025-01. [2025-09-17T18:24:11.555882] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T18:24:11.615797] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-06. [2025-09-17T18:24:12.386161] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T18:24:12.415730] [INFO ] [REMOTE ] D: Fetching primary data for 2025-02. [2025-09-17T18:24:13.074695] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T18:24:13.215780] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-07. [2025-09-17T18:24:14.015814] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-01. [2025-09-17T18:24:14.115030] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T18:24:14.815768] [INFO ] [REMOTE ] D: Fetching primary data for 2025-03. [2025-09-17T18:24:15.194889] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T18:24:15.560201] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T18:24:15.615742] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-02. [2025-09-17T18:24:16.327384] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T18:24:16.415721] [INFO ] [REMOTE ] D: Fetching primary data for 2025-04. [2025-09-17T18:24:17.215781] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-08. [2025-09-17T18:24:17.255571] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T18:24:18.015789] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-03. [2025-09-17T18:24:18.475629] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T18:24:18.732465] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T18:24:18.815789] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-02. [2025-09-17T18:24:19.476015] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T18:24:19.615794] [INFO ] [REMOTE ] CXW: Fetching primary data for 2025-09. [2025-09-17T18:24:19.653216] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T18:24:20.415791] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-03. [2025-09-17T18:24:21.171135] [INFO ] [REMOTE ] CXW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T18:24:21.176785] [INFO ] [REMOTE ] CXW: Full fetch complete (65056 records). [2025-09-17T18:24:21.176893] [DEBUG] [VALIDATOR ] CXW: Validating primary data. [2025-09-17T18:24:21.220922] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-04. [2025-09-17T18:24:21.580637] [DEBUG] [VALIDATOR ] CXW: All expected trading days are present. [2025-09-17T18:24:21.580769] [DEBUG] [VALIDATOR ] CXW: Primary data validation passed. [2025-09-17T18:24:21.581559] [INFO ] [MAIN ] CXW: Fetched primary data is valid. [2025-09-17T18:24:21.581620] [DEBUG] [LOCAL ] CXW: Saving primary data. [2025-09-17T18:24:21.583055] [DEBUG] [LOCAL ] CXW: Trimmed 65056 records to 44602 (keeping 200 days of data) [2025-09-17T18:24:21.869601] [DEBUG] [LOCAL ] CXW: Primary data saved (44602 records). [2025-09-17T18:24:21.869750] [INFO ] [MAIN ] CXW: Full history saved. [2025-09-17T18:24:21.869850] [INFO ] [MAIN ] Update Progress: 580/2371 symbols completed. CXW took 34.1s. Estimated remaining: 4h 20m 25s. Rate: 6.9 symbols/min [2025-09-17T18:24:22.016167] [INFO ] [REMOTE ] D: Fetching primary data for 2025-05. [2025-09-17T18:24:22.065227] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T18:24:22.063419] [INFO ] [MAIN ] DAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:24:22.087298] [DEBUG] [LOCAL ] DAC: Loaded 12820 existing records from primary storage. [2025-09-17T18:24:22.087422] [INFO ] [MAIN ] DAC: Loaded 12820 existing records. [2025-09-17T18:24:22.274999] [WARN ] [MAIN ] DAC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:24:22.275251] [INFO ] [MAIN ] DAC: Wiping existing primary data before full refresh. [2025-09-17T18:24:22.275309] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-17T18:24:22.275780] [DEBUG] [LOCAL ] DAC: Deleted primary data file. [2025-09-17T18:24:22.275831] [INFO ] [MAIN ] DAC: Starting full primary refresh. [2025-09-17T18:24:22.630399] [INFO ] [REMOTE ] DAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:24:22.815780] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-11. [2025-09-17T18:24:22.987918] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T18:24:23.522093] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T18:24:23.615828] [INFO ] [REMOTE ] DAC: Fetching primary data for 2024-12. [2025-09-17T18:24:23.666039] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T18:24:24.415782] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-04. [2025-09-17T18:24:24.671405] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T18:24:25.215766] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-01. [2025-09-17T18:24:25.350542] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T18:24:26.015802] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-05. [2025-09-17T18:24:26.302054] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T18:24:26.815786] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-05. [2025-09-17T18:24:27.309080] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T18:24:27.615828] [INFO ] [REMOTE ] D: Fetching primary data for 2025-06. [2025-09-17T18:24:27.929519] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T18:24:28.415858] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-02. [2025-09-17T18:24:29.215751] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-06. [2025-09-17T18:24:29.320272] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T18:24:29.342933] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T18:24:30.015792] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-03. [2025-09-17T18:24:30.815767] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-06. [2025-09-17T18:24:30.863515] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T18:24:30.888951] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T18:24:31.615788] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-07. [2025-09-17T18:24:32.104382] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T18:24:32.415824] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-04. [2025-09-17T18:24:33.116611] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T18:24:33.142137] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T18:24:33.215798] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-05. [2025-09-17T18:24:33.906166] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T18:24:34.015803] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-06. [2025-09-17T18:24:34.815841] [INFO ] [REMOTE ] D: Fetching primary data for 2025-07. [2025-09-17T18:24:34.967407] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T18:24:35.615861] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-08. [2025-09-17T18:24:36.415702] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-07. [2025-09-17T18:24:36.521011] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T18:24:37.215832] [INFO ] [REMOTE ] D: Fetching primary data for 2025-08. [2025-09-17T18:24:37.255590] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T18:24:37.398476] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T18:24:38.015887] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-08. [2025-09-17T18:24:38.815850] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-07. [2025-09-17T18:24:39.145188] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T18:24:39.174753] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T18:24:39.615791] [INFO ] [REMOTE ] D: Fetching primary data for 2025-09. [2025-09-17T18:24:39.641758] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T18:24:40.415791] [INFO ] [REMOTE ] CYH: Fetching primary data for 2025-09. [2025-09-17T18:24:41.215808] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-08. [2025-09-17T18:24:41.546532] [INFO ] [REMOTE ] D: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T18:24:41.553569] [INFO ] [REMOTE ] D: Full fetch complete (77503 records). [2025-09-17T18:24:41.553788] [DEBUG] [VALIDATOR ] D: Validating primary data. [2025-09-17T18:24:41.984671] [DEBUG] [VALIDATOR ] D: All expected trading days are present. [2025-09-17T18:24:41.985231] [DEBUG] [VALIDATOR ] D: Primary data validation passed. [2025-09-17T18:24:41.986146] [INFO ] [MAIN ] D: Fetched primary data is valid. [2025-09-17T18:24:41.986870] [DEBUG] [LOCAL ] D: Saving primary data. [2025-09-17T18:24:41.986794] [INFO ] [REMOTE ] CYH: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T18:24:41.993987] [INFO ] [REMOTE ] CYH: Full fetch complete (70421 records). [2025-09-17T18:24:41.994110] [DEBUG] [VALIDATOR ] CYH: Validating primary data. [2025-09-17T18:24:41.994232] [DEBUG] [LOCAL ] D: Trimmed 77503 records to 53647 (keeping 200 days of data) [2025-09-17T18:24:42.026515] [INFO ] [REMOTE ] CYD: Fetching primary data for 2025-09. [2025-09-17T18:24:42.258753] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T18:24:42.586914] [DEBUG] [VALIDATOR ] CYH: All expected trading days are present. [2025-09-17T18:24:42.596938] [DEBUG] [VALIDATOR ] CYH: Primary data validation passed. [2025-09-17T18:24:42.598213] [INFO ] [MAIN ] CYH: Fetched primary data is valid. [2025-09-17T18:24:42.624614] [DEBUG] [LOCAL ] CYH: Saving primary data. [2025-09-17T18:24:42.631108] [DEBUG] [LOCAL ] CYH: Trimmed 70421 records to 48029 (keeping 200 days of data) [2025-09-17T18:24:42.840481] [INFO ] [REMOTE ] DAC: Fetching primary data for 2025-09. [2025-09-17T18:24:43.007112] [DEBUG] [LOCAL ] D: Primary data saved (53647 records). [2025-09-17T18:24:43.007822] [INFO ] [MAIN ] D: Full history saved. [2025-09-17T18:24:43.008157] [INFO ] [MAIN ] Update Progress: 581/2371 symbols completed. D took 38.5s. Estimated remaining: 4h 20m 54s. Rate: 6.9 symbols/min [2025-09-17T18:24:43.125430] [DEBUG] [LOCAL ] CYH: Primary data saved (48029 records). [2025-09-17T18:24:43.141196] [INFO ] [MAIN ] CYH: Full history saved. [2025-09-17T18:24:43.146423] [INFO ] [MAIN ] Update Progress: 582/2371 symbols completed. CYH took 39.6s. Estimated remaining: 4h 20m 19s. Rate: 6.9 symbols/min [2025-09-17T18:24:43.279627] [INFO ] [MAIN ] DAL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:24:43.372760] [INFO ] [MAIN ] DAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:24:43.424186] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-17T18:24:43.424364] [INFO ] [MAIN ] DAL: Loaded 53753 existing records. [2025-09-17T18:24:43.546518] [DEBUG] [LOCAL ] DAN: Loaded 49040 existing records from primary storage. [2025-09-17T18:24:43.552451] [INFO ] [MAIN ] DAN: Loaded 49040 existing records. [2025-09-17T18:24:43.754878] [WARN ] [MAIN ] DAL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:24:43.798798] [INFO ] [MAIN ] DAL: Wiping existing primary data before full refresh. [2025-09-17T18:24:43.816661] [INFO ] [LOCAL ] DAL: Starting deletion of primary data. [2025-09-17T18:24:43.799067] [INFO ] [REMOTE ] DAC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T18:24:43.819705] [WARN ] [MAIN ] DAN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:24:43.821743] [INFO ] [MAIN ] DAN: Wiping existing primary data before full refresh. [2025-09-17T18:24:43.821876] [INFO ] [REMOTE ] DAC: Full fetch complete (20010 records). [2025-09-17T18:24:43.832559] [INFO ] [LOCAL ] DAN: Starting deletion of primary data. [2025-09-17T18:24:43.827186] [DEBUG] [LOCAL ] DAL: Deleted primary data file. [2025-09-17T18:24:43.833202] [INFO ] [MAIN ] DAL: Starting full primary refresh. [2025-09-17T18:24:43.832761] [DEBUG] [VALIDATOR ] DAC: Validating primary data. [2025-09-17T18:24:43.845598] [DEBUG] [LOCAL ] DAN: Deleted primary data file. [2025-09-17T18:24:43.846437] [INFO ] [REMOTE ] CYD: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T18:24:43.857016] [INFO ] [MAIN ] DAN: Starting full primary refresh. [2025-09-17T18:24:43.875671] [FATAL] [VALIDATOR ] DAC: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:24:43.915497] [FATAL] [MAIN ] DAC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:24:43.955831] [WARN ] [MAIN ] DAC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:24:43.955765] [INFO ] [REMOTE ] CYD: Full fetch complete (31174 records). [2025-09-17T18:24:43.992351] [DEBUG] [VALIDATOR ] CYD: Validating primary data. [2025-09-17T18:24:44.015742] [INFO ] [LOCAL ] DAC: Starting deletion of primary data. [2025-09-17T18:24:44.079616] [DEBUG] [LOCAL ] DAC: No primary data file found to delete. [2025-09-17T18:24:44.117739] [INFO ] [LOCAL ] DAC: Starting deletion of derivative data. [2025-09-17T18:24:44.371135] [DEBUG] [LOCAL ] DAC: Deleted derivative data file. [2025-09-17T18:24:44.430146] [INFO ] [MAIN ] Update Progress: 583/2371 symbols completed. DAC took 22.6s. Estimated remaining: 4h 19m 48s. Rate: 6.9 symbols/min [2025-09-17T18:24:44.856853] [INFO ] [REMOTE ] DAL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:24:44.902534] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-11. [2025-09-17T18:24:44.949733] [INFO ] [REMOTE ] DAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:24:44.974809] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-11. [2025-09-17T18:24:45.107372] [INFO ] [MAIN ] DAO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:24:45.201874] [DEBUG] [VALIDATOR ] CYD: All expected trading days are present. [2025-09-17T18:24:45.201983] [DEBUG] [VALIDATOR ] CYD: Primary data validation passed. [2025-09-17T18:24:45.202913] [INFO ] [MAIN ] CYD: Fetched primary data is valid. [2025-09-17T18:24:45.202987] [DEBUG] [LOCAL ] CYD: Saving primary data. [2025-09-17T18:24:45.202347] [DEBUG] [LOCAL ] DAO: Loaded 21549 existing records from primary storage. [2025-09-17T18:24:45.203229] [INFO ] [MAIN ] DAO: Loaded 21549 existing records. [2025-09-17T18:24:45.304828] [DEBUG] [LOCAL ] CYD: Trimmed 31174 records to 26862 (keeping 200 days of data) [2025-09-17T18:24:45.442835] [WARN ] [MAIN ] DAO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:24:45.469236] [INFO ] [MAIN ] DAO: Wiping existing primary data before full refresh. [2025-09-17T18:24:45.469602] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-17T18:24:45.470665] [DEBUG] [LOCAL ] DAO: Deleted primary data file. [2025-09-17T18:24:45.471252] [INFO ] [MAIN ] DAO: Starting full primary refresh. [2025-09-17T18:24:45.846497] [INFO ] [REMOTE ] DAO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:24:45.847619] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-11. [2025-09-17T18:24:45.907354] [DEBUG] [LOCAL ] CYD: Primary data saved (26862 records). [2025-09-17T18:24:45.907507] [INFO ] [MAIN ] CYD: Full history saved. [2025-09-17T18:24:45.907596] [INFO ] [MAIN ] Update Progress: 584/2371 symbols completed. CYD took 44.3s. Estimated remaining: 4h 19m 17s. Rate: 6.9 symbols/min [2025-09-17T18:24:46.075298] [INFO ] [MAIN ] DAR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:24:46.123472] [DEBUG] [LOCAL ] DAR: Loaded 51810 existing records from primary storage. [2025-09-17T18:24:46.123619] [INFO ] [MAIN ] DAR: Loaded 51810 existing records. [2025-09-17T18:24:46.301363] [WARN ] [MAIN ] DAR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:24:46.301606] [INFO ] [MAIN ] DAR: Wiping existing primary data before full refresh. [2025-09-17T18:24:46.301669] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-17T18:24:46.302577] [DEBUG] [LOCAL ] DAR: Deleted primary data file. [2025-09-17T18:24:46.302622] [INFO ] [MAIN ] DAR: Starting full primary refresh. [2025-09-17T18:24:46.660149] [INFO ] [REMOTE ] DAR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:24:46.660569] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-11. [2025-09-17T18:24:46.688057] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T18:24:46.815735] [INFO ] [REMOTE ] DAN: Fetching primary data for 2024-12. [2025-09-17T18:24:46.904876] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T18:24:47.135351] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-11 (2.23 seconds). [2025-09-17T18:24:47.615790] [INFO ] [REMOTE ] DAO: Fetching primary data for 2024-12. [2025-09-17T18:24:48.096719] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T18:24:48.415764] [INFO ] [REMOTE ] DAL: Fetching primary data for 2024-12. [2025-09-17T18:24:48.731528] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T18:24:48.785107] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T18:24:49.215824] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-01. [2025-09-17T18:24:50.015759] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-01. [2025-09-17T18:24:50.373361] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T18:24:50.810557] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T18:24:50.819823] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-01. [2025-09-17T18:24:51.079610] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T18:24:51.615838] [INFO ] [REMOTE ] DAR: Fetching primary data for 2024-12. [2025-09-17T18:24:52.415855] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-02. [2025-09-17T18:24:52.912993] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-17T18:24:53.215825] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-02. [2025-09-17T18:24:53.342232] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T18:24:53.914632] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T18:24:54.015755] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-03. [2025-09-17T18:24:54.815822] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-01. [2025-09-17T18:24:55.002411] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T18:24:55.260686] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T18:24:55.615822] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-02. [2025-09-17T18:24:56.378390] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T18:24:56.415734] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-02. [2025-09-17T18:24:56.968205] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T18:24:57.215799] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-03. [2025-09-17T18:24:57.557264] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T18:24:58.015781] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-03. [2025-09-17T18:24:58.731789] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T18:24:58.815819] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-04. [2025-09-17T18:24:59.615755] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-04. [2025-09-17T18:24:59.685835] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T18:25:00.415749] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-04. [2025-09-17T18:25:00.581777] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T18:25:00.891939] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T18:25:01.215839] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-05. [2025-09-17T18:25:02.015792] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-03. [2025-09-17T18:25:02.272532] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T18:25:02.421628] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T18:25:02.815838] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-05. [2025-09-17T18:25:03.615798] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-05. [2025-09-17T18:25:04.250653] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T18:25:04.426760] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-06. [2025-09-17T18:25:04.429761] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-03 (2.41 seconds). [2025-09-17T18:25:05.215800] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-06. [2025-09-17T18:25:05.341205] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T18:25:05.544361] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T18:25:06.015866] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-06. [2025-09-17T18:25:06.126726] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T18:25:06.815836] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-07. [2025-09-17T18:25:07.479623] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T18:25:07.508821] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T18:25:07.615827] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-04. [2025-09-17T18:25:08.415815] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-07. [2025-09-17T18:25:09.215800] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-07. [2025-09-17T18:25:10.015768] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-08. [2025-09-17T18:25:10.064693] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-17T18:25:10.105480] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T18:25:10.815764] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-08. [2025-09-17T18:25:11.133852] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T18:25:11.158456] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T18:25:11.615791] [INFO ] [REMOTE ] DAO: Fetching primary data for 2025-09. [2025-09-17T18:25:12.415726] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-05. [2025-09-17T18:25:12.449269] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T18:25:12.650013] [INFO ] [REMOTE ] DAO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T18:25:12.653165] [INFO ] [REMOTE ] DAO: Full fetch complete (32264 records). [2025-09-17T18:25:12.653274] [DEBUG] [VALIDATOR ] DAO: Validating primary data. [2025-09-17T18:25:12.654833] [FATAL] [VALIDATOR ] DAO: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:25:12.655077] [FATAL] [MAIN ] DAO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:25:12.655209] [WARN ] [MAIN ] DAO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:25:12.655267] [INFO ] [LOCAL ] DAO: Starting deletion of primary data. [2025-09-17T18:25:12.655336] [DEBUG] [LOCAL ] DAO: No primary data file found to delete. [2025-09-17T18:25:12.655373] [INFO ] [LOCAL ] DAO: Starting deletion of derivative data. [2025-09-17T18:25:12.655683] [DEBUG] [LOCAL ] DAO: Deleted derivative data file. [2025-09-17T18:25:12.655807] [INFO ] [MAIN ] Update Progress: 585/2371 symbols completed. DAO took 28.1s. Estimated remaining: 4h 20m 3s. Rate: 6.9 symbols/min [2025-09-17T18:25:12.824836] [INFO ] [MAIN ] DAVA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:25:12.861549] [DEBUG] [LOCAL ] DAVA: Loaded 40301 existing records from primary storage. [2025-09-17T18:25:12.861714] [INFO ] [MAIN ] DAVA: Loaded 40301 existing records. [2025-09-17T18:25:13.042965] [WARN ] [MAIN ] DAVA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:25:13.043194] [INFO ] [MAIN ] DAVA: Wiping existing primary data before full refresh. [2025-09-17T18:25:13.043239] [INFO ] [LOCAL ] DAVA: Starting deletion of primary data. [2025-09-17T18:25:13.043918] [DEBUG] [LOCAL ] DAVA: Deleted primary data file. [2025-09-17T18:25:13.043969] [INFO ] [MAIN ] DAVA: Starting full primary refresh. [2025-09-17T18:25:13.223051] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-08. [2025-09-17T18:25:13.417875] [INFO ] [REMOTE ] DAVA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:25:14.015778] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-11. [2025-09-17T18:25:14.637631] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-17T18:25:14.815793] [INFO ] [REMOTE ] DAN: Fetching primary data for 2025-09. [2025-09-17T18:25:15.176222] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T18:25:15.617181] [INFO ] [REMOTE ] DAR: Fetching primary data for 2025-09. [2025-09-17T18:25:15.624757] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T18:25:16.272983] [INFO ] [REMOTE ] DAN: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T18:25:16.280452] [INFO ] [REMOTE ] DAN: Full fetch complete (70811 records). [2025-09-17T18:25:16.280714] [DEBUG] [VALIDATOR ] DAN: Validating primary data. [2025-09-17T18:25:16.421085] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2024-12. [2025-09-17T18:25:16.867966] [DEBUG] [VALIDATOR ] DAN: All expected trading days are present. [2025-09-17T18:25:16.868069] [DEBUG] [VALIDATOR ] DAN: Primary data validation passed. [2025-09-17T18:25:16.869097] [INFO ] [MAIN ] DAN: Fetched primary data is valid. [2025-09-17T18:25:16.869157] [DEBUG] [LOCAL ] DAN: Saving primary data. [2025-09-17T18:25:16.870813] [DEBUG] [LOCAL ] DAN: Trimmed 70811 records to 49034 (keeping 200 days of data) [2025-09-17T18:25:17.064737] [INFO ] [REMOTE ] DAR: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T18:25:17.167389] [INFO ] [REMOTE ] DAR: Full fetch complete (73955 records). [2025-09-17T18:25:17.167717] [DEBUG] [VALIDATOR ] DAR: Validating primary data. [2025-09-17T18:25:17.208145] [FATAL] [VALIDATOR ] DAR: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:25:17.210116] [FATAL] [MAIN ] DAR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:25:17.211260] [WARN ] [MAIN ] DAR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:25:17.213493] [INFO ] [LOCAL ] DAR: Starting deletion of primary data. [2025-09-17T18:25:17.217833] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-06. [2025-09-17T18:25:17.215032] [DEBUG] [LOCAL ] DAR: No primary data file found to delete. [2025-09-17T18:25:17.222330] [INFO ] [LOCAL ] DAR: Starting deletion of derivative data. [2025-09-17T18:25:17.227543] [DEBUG] [LOCAL ] DAR: Deleted derivative data file. [2025-09-17T18:25:17.231472] [INFO ] [MAIN ] Update Progress: 586/2371 symbols completed. DAR took 31.3s. Estimated remaining: 4h 19m 42s. Rate: 6.9 symbols/min [2025-09-17T18:25:17.484861] [INFO ] [MAIN ] DAY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:25:17.494107] [DEBUG] [LOCAL ] DAN: Primary data saved (49034 records). [2025-09-17T18:25:17.494297] [INFO ] [MAIN ] DAN: Full history saved. [2025-09-17T18:25:17.494394] [INFO ] [MAIN ] Update Progress: 587/2371 symbols completed. DAN took 34.3s. Estimated remaining: 4h 19m 7s. Rate: 6.9 symbols/min [2025-09-17T18:25:17.697952] [INFO ] [MAIN ] DB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:25:17.718670] [DEBUG] [LOCAL ] DAY: Loaded 50078 existing records from primary storage. [2025-09-17T18:25:17.718915] [INFO ] [MAIN ] DAY: Loaded 50078 existing records. [2025-09-17T18:25:17.915504] [WARN ] [MAIN ] DAY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:25:17.915881] [INFO ] [MAIN ] DAY: Wiping existing primary data before full refresh. [2025-09-17T18:25:17.916018] [INFO ] [LOCAL ] DAY: Starting deletion of primary data. [2025-09-17T18:25:17.923587] [DEBUG] [LOCAL ] DAY: Deleted primary data file. [2025-09-17T18:25:17.934084] [INFO ] [MAIN ] DAY: Starting full primary refresh. [2025-09-17T18:25:18.014845] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T18:25:18.065843] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-01. [2025-09-17T18:25:18.067032] [DEBUG] [LOCAL ] DB: Loaded 52651 existing records from primary storage. [2025-09-17T18:25:18.068288] [INFO ] [MAIN ] DB: Loaded 52651 existing records. [2025-09-17T18:25:18.454878] [WARN ] [MAIN ] DB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:25:18.470520] [INFO ] [MAIN ] DB: Wiping existing primary data before full refresh. [2025-09-17T18:25:18.494682] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-17T18:25:18.501072] [DEBUG] [LOCAL ] DB: Deleted primary data file. [2025-09-17T18:25:18.520305] [INFO ] [MAIN ] DB: Starting full primary refresh. [2025-09-17T18:25:18.523843] [INFO ] [REMOTE ] DAY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:25:18.824938] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-11. [2025-09-17T18:25:18.913447] [INFO ] [REMOTE ] DB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:25:19.477215] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-17T18:25:19.488829] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T18:25:19.615765] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-02. [2025-09-17T18:25:20.045267] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T18:25:20.415784] [INFO ] [REMOTE ] DAY: Fetching primary data for 2024-12. [2025-09-17T18:25:20.936484] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T18:25:21.215774] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-03. [2025-09-17T18:25:22.015784] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-07. [2025-09-17T18:25:22.131915] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T18:25:22.815816] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-11. [2025-09-17T18:25:22.963377] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T18:25:23.615846] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-04. [2025-09-17T18:25:24.267003] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-17T18:25:24.415750] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-08. [2025-09-17T18:25:24.630987] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T18:25:25.087810] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T18:25:25.215787] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-05. [2025-09-17T18:25:26.015780] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-01. [2025-09-17T18:25:26.601130] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T18:25:26.815795] [INFO ] [REMOTE ] DB: Fetching primary data for 2024-12. [2025-09-17T18:25:26.857251] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T18:25:27.410722] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T18:25:27.615859] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-02. [2025-09-17T18:25:28.415775] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-06. [2025-09-17T18:25:28.459032] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T18:25:29.186538] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T18:25:29.215726] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-03. [2025-09-17T18:25:29.842137] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T18:25:30.015824] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-01. [2025-09-17T18:25:30.688604] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T18:25:30.815749] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-07. [2025-09-17T18:25:31.615784] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-04. [2025-09-17T18:25:31.865128] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T18:25:32.373089] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T18:25:32.415733] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-08. [2025-09-17T18:25:33.191086] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T18:25:33.215723] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-02. [2025-09-17T18:25:33.716679] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T18:25:34.015795] [INFO ] [REMOTE ] DAVA: Fetching primary data for 2025-09. [2025-09-17T18:25:34.815894] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-05. [2025-09-17T18:25:35.000728] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T18:25:35.615797] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-03. [2025-09-17T18:25:35.709607] [INFO ] [REMOTE ] DAVA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T18:25:35.715923] [INFO ] [REMOTE ] DAVA: Full fetch complete (54811 records). [2025-09-17T18:25:35.716051] [DEBUG] [VALIDATOR ] DAVA: Validating primary data. [2025-09-17T18:25:36.106026] [DEBUG] [VALIDATOR ] DAVA: All expected trading days are present. [2025-09-17T18:25:36.106132] [DEBUG] [VALIDATOR ] DAVA: Primary data validation passed. [2025-09-17T18:25:36.106998] [INFO ] [MAIN ] DAVA: Fetched primary data is valid. [2025-09-17T18:25:36.107095] [DEBUG] [LOCAL ] DAVA: Saving primary data. [2025-09-17T18:25:36.108338] [DEBUG] [LOCAL ] DAVA: Trimmed 54811 records to 40308 (keeping 200 days of data) [2025-09-17T18:25:36.239712] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T18:25:36.389178] [DEBUG] [LOCAL ] DAVA: Primary data saved (40308 records). [2025-09-17T18:25:36.389308] [INFO ] [MAIN ] DAVA: Full history saved. [2025-09-17T18:25:36.389400] [INFO ] [MAIN ] Update Progress: 588/2371 symbols completed. DAVA took 23.7s. Estimated remaining: 4h 19m 29s. Rate: 6.9 symbols/min [2025-09-17T18:25:36.421034] [INFO ] [REMOTE ] DAL: Fetching primary data for 2025-09. [2025-09-17T18:25:36.564802] [INFO ] [MAIN ] DBD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:25:36.587737] [DEBUG] [LOCAL ] DBD: Loaded 23783 existing records from primary storage. [2025-09-17T18:25:36.588079] [INFO ] [MAIN ] DBD: Loaded 23783 existing records. [2025-09-17T18:25:36.769304] [WARN ] [MAIN ] DBD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:25:36.769568] [INFO ] [MAIN ] DBD: Wiping existing primary data before full refresh. [2025-09-17T18:25:36.769614] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-17T18:25:36.770203] [DEBUG] [LOCAL ] DBD: Deleted primary data file. [2025-09-17T18:25:36.770254] [INFO ] [MAIN ] DBD: Starting full primary refresh. [2025-09-17T18:25:37.144866] [INFO ] [REMOTE ] DBD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:25:37.215776] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-06. [2025-09-17T18:25:37.587417] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T18:25:38.015802] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-11. [2025-09-17T18:25:38.615260] [INFO ] [REMOTE ] DAL: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-17T18:25:38.623584] [INFO ] [REMOTE ] DAL: Full fetch complete (77714 records). [2025-09-17T18:25:38.623863] [DEBUG] [VALIDATOR ] DAL: Validating primary data. [2025-09-17T18:25:38.831447] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-04. [2025-09-17T18:25:39.037951] [DEBUG] [VALIDATOR ] DAL: All expected trading days are present. [2025-09-17T18:25:39.038211] [DEBUG] [VALIDATOR ] DAL: Primary data validation passed. [2025-09-17T18:25:39.039181] [INFO ] [MAIN ] DAL: Fetched primary data is valid. [2025-09-17T18:25:39.039365] [DEBUG] [LOCAL ] DAL: Saving primary data. [2025-09-17T18:25:39.065820] [DEBUG] [LOCAL ] DAL: Trimmed 77714 records to 53753 (keeping 200 days of data) [2025-09-17T18:25:39.081063] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T18:25:39.081860] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T18:25:39.431808] [DEBUG] [LOCAL ] DAL: Primary data saved (53753 records). [2025-09-17T18:25:39.431954] [INFO ] [MAIN ] DAL: Full history saved. [2025-09-17T18:25:39.432961] [INFO ] [MAIN ] Update Progress: 589/2371 symbols completed. DAL took 56.4s. Estimated remaining: 4h 19m 3s. Rate: 6.9 symbols/min [2025-09-17T18:25:39.605144] [INFO ] [MAIN ] DBI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:25:39.615801] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-07. [2025-09-17T18:25:39.651729] [DEBUG] [LOCAL ] DBI: Loaded 45312 existing records from primary storage. [2025-09-17T18:25:39.651885] [INFO ] [MAIN ] DBI: Loaded 45312 existing records. [2025-09-17T18:25:39.829822] [WARN ] [MAIN ] DBI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:25:39.830079] [INFO ] [MAIN ] DBI: Wiping existing primary data before full refresh. [2025-09-17T18:25:39.830123] [INFO ] [LOCAL ] DBI: Starting deletion of primary data. [2025-09-17T18:25:39.830926] [DEBUG] [LOCAL ] DBI: Deleted primary data file. [2025-09-17T18:25:39.830974] [INFO ] [MAIN ] DBI: Starting full primary refresh. [2025-09-17T18:25:40.189099] [INFO ] [REMOTE ] DBI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:25:40.415756] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-11. [2025-09-17T18:25:40.966110] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-17T18:25:41.202593] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T18:25:41.215776] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-05. [2025-09-17T18:25:42.015762] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-08. [2025-09-17T18:25:42.177296] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T18:25:42.815766] [INFO ] [REMOTE ] DBI: Fetching primary data for 2024-12. [2025-09-17T18:25:43.243986] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T18:25:43.615791] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-06. [2025-09-17T18:25:43.803250] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T18:25:44.104006] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T18:25:44.415787] [INFO ] [REMOTE ] DAY: Fetching primary data for 2025-09. [2025-09-17T18:25:45.215808] [INFO ] [REMOTE ] DBD: Fetching primary data for 2024-12. [2025-09-17T18:25:45.474417] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T18:25:45.877803] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T18:25:46.015770] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-01. [2025-09-17T18:25:46.253274] [INFO ] [REMOTE ] DAY: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T18:25:46.259555] [INFO ] [REMOTE ] DAY: Full fetch complete (71629 records). [2025-09-17T18:25:46.259697] [DEBUG] [VALIDATOR ] DAY: Validating primary data. [2025-09-17T18:25:46.667184] [DEBUG] [VALIDATOR ] DAY: All expected trading days are present. [2025-09-17T18:25:46.667281] [DEBUG] [VALIDATOR ] DAY: Primary data validation passed. [2025-09-17T18:25:46.668168] [INFO ] [MAIN ] DAY: Fetched primary data is valid. [2025-09-17T18:25:46.668224] [DEBUG] [LOCAL ] DAY: Saving primary data. [2025-09-17T18:25:46.669832] [DEBUG] [LOCAL ] DAY: Trimmed 71629 records to 50042 (keeping 200 days of data) [2025-09-17T18:25:46.845630] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-07. [2025-09-17T18:25:46.901882] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T18:25:46.985522] [DEBUG] [LOCAL ] DAY: Primary data saved (50042 records). [2025-09-17T18:25:46.985675] [INFO ] [MAIN ] DAY: Full history saved. [2025-09-17T18:25:46.985760] [INFO ] [MAIN ] Update Progress: 590/2371 symbols completed. DAY took 29.7s. Estimated remaining: 4h 18m 51s. Rate: 6.9 symbols/min [2025-09-17T18:25:47.153579] [INFO ] [MAIN ] DBL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:25:47.163927] [DEBUG] [LOCAL ] DBL: Loaded 9038 existing records from primary storage. [2025-09-17T18:25:47.164046] [INFO ] [MAIN ] DBL: Loaded 9038 existing records. [2025-09-17T18:25:47.341965] [WARN ] [MAIN ] DBL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:25:47.342242] [INFO ] [MAIN ] DBL: Wiping existing primary data before full refresh. [2025-09-17T18:25:47.342288] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-17T18:25:47.342618] [DEBUG] [LOCAL ] DBL: Deleted primary data file. [2025-09-17T18:25:47.342694] [INFO ] [MAIN ] DBL: Starting full primary refresh. [2025-09-17T18:25:47.620972] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-02. [2025-09-17T18:25:47.702734] [INFO ] [REMOTE ] DBL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:25:48.415779] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-01. [2025-09-17T18:25:48.575923] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T18:25:48.855703] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T18:25:49.215788] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-11. [2025-09-17T18:25:49.994657] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T18:25:50.003223] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T18:25:50.015716] [INFO ] [REMOTE ] DBL: Fetching primary data for 2024-12. [2025-09-17T18:25:50.760003] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T18:25:50.815737] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-01. [2025-09-17T18:25:51.473594] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T18:25:51.615785] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-08. [2025-09-17T18:25:52.415806] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-02. [2025-09-17T18:25:53.207938] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T18:25:53.215669] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-03. [2025-09-17T18:25:53.449673] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T18:25:53.856950] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T18:25:54.015775] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-03. [2025-09-17T18:25:54.815800] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-04. [2025-09-17T18:25:55.024173] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T18:25:55.592029] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T18:25:55.615747] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-05. [2025-09-17T18:25:56.119427] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T18:25:56.415786] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-06. [2025-09-17T18:25:57.086183] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T18:25:57.215783] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-07. [2025-09-17T18:25:58.015801] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-02. [2025-09-17T18:25:58.103171] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T18:25:58.815782] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-04. [2025-09-17T18:25:59.615845] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-08. [2025-09-17T18:25:59.666985] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T18:25:59.983726] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T18:26:00.415841] [INFO ] [REMOTE ] DB: Fetching primary data for 2025-09. [2025-09-17T18:26:00.629048] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T18:26:01.215830] [INFO ] [REMOTE ] DBL: Fetching primary data for 2025-09. [2025-09-17T18:26:01.839521] [INFO ] [REMOTE ] DBL: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T18:26:01.841747] [INFO ] [REMOTE ] DBL: Full fetch complete (12423 records). [2025-09-17T18:26:01.841840] [DEBUG] [VALIDATOR ] DBL: Validating primary data. [2025-09-17T18:26:01.842347] [FATAL] [VALIDATOR ] DBL: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:26:01.842443] [FATAL] [MAIN ] DBL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:26:01.842494] [WARN ] [MAIN ] DBL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:26:01.842566] [INFO ] [LOCAL ] DBL: Starting deletion of primary data. [2025-09-17T18:26:01.842682] [DEBUG] [LOCAL ] DBL: No primary data file found to delete. [2025-09-17T18:26:01.842747] [INFO ] [LOCAL ] DBL: Starting deletion of derivative data. [2025-09-17T18:26:01.843132] [DEBUG] [LOCAL ] DBL: Deleted derivative data file. [2025-09-17T18:26:01.843244] [INFO ] [MAIN ] Update Progress: 591/2371 symbols completed. DBL took 14.9s. Estimated remaining: 4h 19m 1s. Rate: 6.9 symbols/min [2025-09-17T18:26:02.019567] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-03. [2025-09-17T18:26:02.020943] [INFO ] [MAIN ] DBRG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:26:02.067937] [DEBUG] [LOCAL ] DBRG: Loaded 49842 existing records from primary storage. [2025-09-17T18:26:02.068083] [INFO ] [MAIN ] DBRG: Loaded 49842 existing records. [2025-09-17T18:26:02.254165] [WARN ] [MAIN ] DBRG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:26:02.254502] [INFO ] [MAIN ] DBRG: Wiping existing primary data before full refresh. [2025-09-17T18:26:02.254591] [INFO ] [LOCAL ] DBRG: Starting deletion of primary data. [2025-09-17T18:26:02.255819] [DEBUG] [LOCAL ] DBRG: Deleted primary data file. [2025-09-17T18:26:02.255879] [INFO ] [MAIN ] DBRG: Starting full primary refresh. [2025-09-17T18:26:02.396392] [INFO ] [REMOTE ] DB: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-17T18:26:02.458073] [INFO ] [REMOTE ] DB: Full fetch complete (73415 records). [2025-09-17T18:26:02.507699] [DEBUG] [VALIDATOR ] DB: Validating primary data. [2025-09-17T18:26:02.547361] [FATAL] [VALIDATOR ] DB: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:26:02.570552] [FATAL] [MAIN ] DB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:26:02.570621] [WARN ] [MAIN ] DB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:26:02.570935] [INFO ] [LOCAL ] DB: Starting deletion of primary data. [2025-09-17T18:26:02.576300] [DEBUG] [LOCAL ] DB: No primary data file found to delete. [2025-09-17T18:26:02.581455] [INFO ] [LOCAL ] DB: Starting deletion of derivative data. [2025-09-17T18:26:02.597020] [DEBUG] [LOCAL ] DB: Deleted derivative data file. [2025-09-17T18:26:02.622437] [INFO ] [MAIN ] Update Progress: 592/2371 symbols completed. DB took 45.1s. Estimated remaining: 4h 18m 28s. Rate: 6.9 symbols/min [2025-09-17T18:26:02.652257] [INFO ] [REMOTE ] DBRG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:26:02.816976] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-05. [2025-09-17T18:26:02.835189] [INFO ] [MAIN ] DCI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:26:02.876857] [DEBUG] [LOCAL ] DCI: Loaded 37761 existing records from primary storage. [2025-09-17T18:26:02.877000] [INFO ] [MAIN ] DCI: Loaded 37761 existing records. [2025-09-17T18:26:03.055636] [WARN ] [MAIN ] DCI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:26:03.055892] [INFO ] [MAIN ] DCI: Wiping existing primary data before full refresh. [2025-09-17T18:26:03.055936] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-17T18:26:03.056748] [DEBUG] [LOCAL ] DCI: Deleted primary data file. [2025-09-17T18:26:03.056797] [INFO ] [MAIN ] DCI: Starting full primary refresh. [2025-09-17T18:26:03.410742] [INFO ] [REMOTE ] DCI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:26:03.615745] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-11. [2025-09-17T18:26:03.760822] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T18:26:03.978090] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T18:26:04.415770] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-04. [2025-09-17T18:26:05.215784] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-06. [2025-09-17T18:26:05.369934] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T18:26:06.015775] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-11. [2025-09-17T18:26:06.079833] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T18:26:06.372007] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T18:26:06.815803] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2024-12. [2025-09-17T18:26:07.602890] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T18:26:07.615721] [INFO ] [REMOTE ] DCI: Fetching primary data for 2024-12. [2025-09-17T18:26:08.415759] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-07. [2025-09-17T18:26:08.521561] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T18:26:09.120501] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T18:26:09.215831] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-01. [2025-09-17T18:26:09.665241] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T18:26:10.015834] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-08. [2025-09-17T18:26:10.324779] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T18:26:10.815745] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-05. [2025-09-17T18:26:11.127535] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T18:26:11.615807] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-01. [2025-09-17T18:26:12.415834] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-02. [2025-09-17T18:26:12.573672] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T18:26:13.215786] [INFO ] [REMOTE ] DBD: Fetching primary data for 2025-09. [2025-09-17T18:26:13.247408] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T18:26:13.367597] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T18:26:14.015778] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-02. [2025-09-17T18:26:14.215155] [INFO ] [REMOTE ] DBD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T18:26:14.218581] [INFO ] [REMOTE ] DBD: Full fetch complete (30052 records). [2025-09-17T18:26:14.218705] [DEBUG] [VALIDATOR ] DBD: Validating primary data. [2025-09-17T18:26:14.219337] [FATAL] [VALIDATOR ] DBD: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:26:14.219431] [FATAL] [MAIN ] DBD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:26:14.219485] [WARN ] [MAIN ] DBD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:26:14.219535] [INFO ] [LOCAL ] DBD: Starting deletion of primary data. [2025-09-17T18:26:14.219616] [DEBUG] [LOCAL ] DBD: No primary data file found to delete. [2025-09-17T18:26:14.219677] [INFO ] [LOCAL ] DBD: Starting deletion of derivative data. [2025-09-17T18:26:14.220011] [DEBUG] [LOCAL ] DBD: Deleted derivative data file. [2025-09-17T18:26:14.220117] [INFO ] [MAIN ] Update Progress: 593/2371 symbols completed. DBD took 37.8s. Estimated remaining: 4h 18m 28s. Rate: 6.9 symbols/min [2025-09-17T18:26:14.410500] [INFO ] [MAIN ] DCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:26:14.427079] [DEBUG] [LOCAL ] DCO: Loaded 13446 existing records from primary storage. [2025-09-17T18:26:14.427238] [INFO ] [MAIN ] DCO: Loaded 13446 existing records. [2025-09-17T18:26:14.619915] [WARN ] [MAIN ] DCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:26:14.620185] [INFO ] [MAIN ] DCO: Wiping existing primary data before full refresh. [2025-09-17T18:26:14.620232] [INFO ] [LOCAL ] DCO: Starting deletion of primary data. [2025-09-17T18:26:14.620630] [DEBUG] [LOCAL ] DCO: Deleted primary data file. [2025-09-17T18:26:14.620711] [INFO ] [MAIN ] DCO: Starting full primary refresh. [2025-09-17T18:26:14.831553] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-03. [2025-09-17T18:26:15.015965] [INFO ] [REMOTE ] DCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:26:15.448034] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T18:26:15.615765] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-06. [2025-09-17T18:26:16.414915] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T18:26:16.422758] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-03. [2025-09-17T18:26:17.223734] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-11. [2025-09-17T18:26:17.250057] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T18:26:18.016460] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T18:26:18.015727] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-07. [2025-09-17T18:26:18.101253] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T18:26:18.815834] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-04. [2025-09-17T18:26:19.306827] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T18:26:19.615797] [INFO ] [REMOTE ] DCO: Fetching primary data for 2024-12. [2025-09-17T18:26:20.415798] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-04. [2025-09-17T18:26:20.547158] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T18:26:20.615578] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T18:26:21.215722] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-01. [2025-09-17T18:26:22.008533] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T18:26:22.016522] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-08. [2025-09-17T18:26:22.030525] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T18:26:22.815804] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-05. [2025-09-17T18:26:23.615780] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-02. [2025-09-17T18:26:23.651818] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T18:26:24.260878] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T18:26:24.415788] [INFO ] [REMOTE ] DBI: Fetching primary data for 2025-09. [2025-09-17T18:26:24.551726] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T18:26:25.215775] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-06. [2025-09-17T18:26:25.997033] [INFO ] [REMOTE ] DBI: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T18:26:26.004113] [INFO ] [REMOTE ] DBI: Full fetch complete (66616 records). [2025-09-17T18:26:26.004297] [DEBUG] [VALIDATOR ] DBI: Validating primary data. [2025-09-17T18:26:26.025631] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-05. [2025-09-17T18:26:26.408115] [DEBUG] [VALIDATOR ] DBI: All expected trading days are present. [2025-09-17T18:26:26.408259] [DEBUG] [VALIDATOR ] DBI: Primary data validation passed. [2025-09-17T18:26:26.409240] [INFO ] [MAIN ] DBI: Fetched primary data is valid. [2025-09-17T18:26:26.409460] [DEBUG] [LOCAL ] DBI: Saving primary data. [2025-09-17T18:26:26.411204] [DEBUG] [LOCAL ] DBI: Trimmed 66616 records to 45297 (keeping 200 days of data) [2025-09-17T18:26:26.674360] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T18:26:26.721266] [DEBUG] [LOCAL ] DBI: Primary data saved (45297 records). [2025-09-17T18:26:26.721447] [INFO ] [MAIN ] DBI: Full history saved. [2025-09-17T18:26:26.722809] [INFO ] [MAIN ] Update Progress: 594/2371 symbols completed. DBI took 47.3s. Estimated remaining: 4h 18m 31s. Rate: 6.9 symbols/min [2025-09-17T18:26:26.820928] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-07. [2025-09-17T18:26:26.894289] [INFO ] [MAIN ] DD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:26:26.945188] [DEBUG] [LOCAL ] DD: Loaded 52790 existing records from primary storage. [2025-09-17T18:26:26.945366] [INFO ] [MAIN ] DD: Loaded 52790 existing records. [2025-09-17T18:26:27.123966] [WARN ] [MAIN ] DD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:26:27.124198] [INFO ] [MAIN ] DD: Wiping existing primary data before full refresh. [2025-09-17T18:26:27.124244] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-17T18:26:27.125342] [DEBUG] [LOCAL ] DD: Deleted primary data file. [2025-09-17T18:26:27.125394] [INFO ] [MAIN ] DD: Starting full primary refresh. [2025-09-17T18:26:27.489310] [INFO ] [REMOTE ] DD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:26:27.615772] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-03. [2025-09-17T18:26:27.927826] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T18:26:28.290881] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T18:26:28.415716] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-08. [2025-09-17T18:26:28.543712] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T18:26:29.215774] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-06. [2025-09-17T18:26:30.015770] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-11. [2025-09-17T18:26:30.053718] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T18:26:30.815830] [INFO ] [REMOTE ] DCI: Fetching primary data for 2025-09. [2025-09-17T18:26:30.970921] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T18:26:31.615778] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-07. [2025-09-17T18:26:31.818241] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T18:26:32.320684] [INFO ] [REMOTE ] DCI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T18:26:32.329442] [INFO ] [REMOTE ] DCI: Full fetch complete (54037 records). [2025-09-17T18:26:32.329716] [DEBUG] [VALIDATOR ] DCI: Validating primary data. [2025-09-17T18:26:32.330338] [FATAL] [VALIDATOR ] DCI: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:26:32.330451] [FATAL] [MAIN ] DCI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:26:32.330488] [WARN ] [MAIN ] DCI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:26:32.330525] [INFO ] [LOCAL ] DCI: Starting deletion of primary data. [2025-09-17T18:26:32.330589] [DEBUG] [LOCAL ] DCI: No primary data file found to delete. [2025-09-17T18:26:32.330635] [INFO ] [LOCAL ] DCI: Starting deletion of derivative data. [2025-09-17T18:26:32.331022] [DEBUG] [LOCAL ] DCI: Deleted derivative data file. [2025-09-17T18:26:32.331126] [INFO ] [MAIN ] Update Progress: 595/2371 symbols completed. DCI took 29.7s. Estimated remaining: 4h 18m 13s. Rate: 6.9 symbols/min [2025-09-17T18:26:32.421672] [INFO ] [REMOTE ] DD: Fetching primary data for 2024-12. [2025-09-17T18:26:32.503267] [INFO ] [MAIN ] DDD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:26:32.503427] [DEBUG] [LOCAL ] DDD: No existing data file found in primary storage. [2025-09-17T18:26:32.503464] [WARN ] [MAIN ] DDD: No existing data found, performing full refresh instead. [2025-09-17T18:26:32.503579] [INFO ] [MAIN ] DDD: Wiping existing primary data before full refresh. [2025-09-17T18:26:32.503616] [INFO ] [LOCAL ] DDD: Starting deletion of primary data. [2025-09-17T18:26:32.503677] [DEBUG] [LOCAL ] DDD: No primary data file found to delete. [2025-09-17T18:26:32.503737] [INFO ] [MAIN ] DDD: Starting full primary refresh. [2025-09-17T18:26:32.858753] [INFO ] [REMOTE ] DDD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:26:33.215767] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-04. [2025-09-17T18:26:33.271731] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T18:26:34.015773] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-08. [2025-09-17T18:26:34.058493] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T18:26:34.239256] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T18:26:34.815771] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-01. [2025-09-17T18:26:35.427749] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T18:26:35.615752] [INFO ] [REMOTE ] DBRG: Fetching primary data for 2025-09. [2025-09-17T18:26:36.415860] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-05. [2025-09-17T18:26:36.551777] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T18:26:36.988915] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T18:26:37.215834] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-11. [2025-09-17T18:26:37.354719] [INFO ] [REMOTE ] DBRG: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T18:26:37.360906] [INFO ] [REMOTE ] DBRG: Full fetch complete (72073 records). [2025-09-17T18:26:37.361025] [DEBUG] [VALIDATOR ] DBRG: Validating primary data. [2025-09-17T18:26:37.747781] [DEBUG] [VALIDATOR ] DBRG: All expected trading days are present. [2025-09-17T18:26:37.747863] [DEBUG] [VALIDATOR ] DBRG: Primary data validation passed. [2025-09-17T18:26:37.748659] [INFO ] [MAIN ] DBRG: Fetched primary data is valid. [2025-09-17T18:26:37.748705] [DEBUG] [LOCAL ] DBRG: Saving primary data. [2025-09-17T18:26:37.750067] [DEBUG] [LOCAL ] DBRG: Trimmed 72073 records to 49831 (keeping 200 days of data) [2025-09-17T18:26:38.027032] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-06. [2025-09-17T18:26:38.063514] [DEBUG] [LOCAL ] DBRG: Primary data saved (49831 records). [2025-09-17T18:26:38.063664] [INFO ] [MAIN ] DBRG: Full history saved. [2025-09-17T18:26:38.063845] [INFO ] [MAIN ] Update Progress: 596/2371 symbols completed. DBRG took 36.2s. Estimated remaining: 4h 17m 55s. Rate: 6.9 symbols/min [2025-09-17T18:26:38.233268] [INFO ] [MAIN ] DDL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:26:38.268588] [DEBUG] [LOCAL ] DDL: Loaded 36243 existing records from primary storage. [2025-09-17T18:26:38.268747] [INFO ] [MAIN ] DDL: Loaded 36243 existing records. [2025-09-17T18:26:38.453285] [WARN ] [MAIN ] DDL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:26:38.453583] [INFO ] [MAIN ] DDL: Wiping existing primary data before full refresh. [2025-09-17T18:26:38.453628] [INFO ] [LOCAL ] DDL: Starting deletion of primary data. [2025-09-17T18:26:38.454287] [DEBUG] [LOCAL ] DDL: Deleted primary data file. [2025-09-17T18:26:38.454337] [INFO ] [MAIN ] DDL: Starting full primary refresh. [2025-09-17T18:26:38.826916] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-02. [2025-09-17T18:26:38.847094] [INFO ] [REMOTE ] DDL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:26:38.979901] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T18:26:39.117261] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T18:26:39.615795] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-07. [2025-09-17T18:26:40.240353] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T18:26:40.415812] [INFO ] [REMOTE ] DDD: Fetching primary data for 2024-12. [2025-09-17T18:26:40.515739] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T18:26:41.215782] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-08. [2025-09-17T18:26:42.015821] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-11. [2025-09-17T18:26:42.044009] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T18:26:42.293087] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T18:26:42.815826] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-03. [2025-09-17T18:26:43.554946] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T18:26:43.615775] [INFO ] [REMOTE ] DDL: Fetching primary data for 2024-12. [2025-09-17T18:26:44.415803] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-01. [2025-09-17T18:26:45.024087] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-17T18:26:45.101974] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T18:26:45.215725] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-01. [2025-09-17T18:26:46.015814] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-04. [2025-09-17T18:26:46.178158] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T18:26:46.562081] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T18:26:46.815834] [INFO ] [REMOTE ] DCO: Fetching primary data for 2025-09. [2025-09-17T18:26:47.615768] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-02. [2025-09-17T18:26:47.853802] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T18:26:47.887491] [INFO ] [REMOTE ] DCO: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T18:26:47.889927] [INFO ] [REMOTE ] DCO: Full fetch complete (19567 records). [2025-09-17T18:26:47.890002] [DEBUG] [VALIDATOR ] DCO: Validating primary data. [2025-09-17T18:26:48.255518] [DEBUG] [VALIDATOR ] DCO: All expected trading days are present. [2025-09-17T18:26:48.255744] [DEBUG] [VALIDATOR ] DCO: Primary data validation passed. [2025-09-17T18:26:48.256151] [INFO ] [MAIN ] DCO: Fetched primary data is valid. [2025-09-17T18:26:48.256191] [DEBUG] [LOCAL ] DCO: Saving primary data. [2025-09-17T18:26:48.256819] [DEBUG] [LOCAL ] DCO: Trimmed 19567 records to 13509 (keeping 200 days of data) [2025-09-17T18:26:48.340720] [DEBUG] [LOCAL ] DCO: Primary data saved (13509 records). [2025-09-17T18:26:48.340873] [INFO ] [MAIN ] DCO: Full history saved. [2025-09-17T18:26:48.340996] [INFO ] [MAIN ] Update Progress: 597/2371 symbols completed. DCO took 34.1s. Estimated remaining: 4h 17m 51s. Rate: 6.9 symbols/min [2025-09-17T18:26:48.415840] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-02. [2025-09-17T18:26:48.972423] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T18:26:49.215777] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-03. [2025-09-17T18:26:49.986266] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T18:26:50.015739] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-03. [2025-09-17T18:26:50.649074] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T18:26:50.815768] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-04. [2025-09-17T18:26:51.615778] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-05. [2025-09-17T18:26:51.814153] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T18:26:52.421057] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-04. [2025-09-17T18:26:52.434416] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T18:26:53.215793] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-05. [2025-09-17T18:26:53.506738] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T18:26:54.015763] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-06. [2025-09-17T18:26:54.531466] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T18:26:54.713318] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T18:26:54.815774] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-05. [2025-09-17T18:26:55.555327] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T18:26:55.615821] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-06. [2025-09-17T18:26:56.415750] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-07. [2025-09-17T18:26:56.597529] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T18:26:56.860036] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T18:26:57.215781] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-07. [2025-09-17T18:26:58.015798] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-06. [2025-09-17T18:26:58.174115] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T18:26:58.204597] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T18:26:58.815808] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-08. [2025-09-17T18:26:59.615718] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-08. [2025-09-17T18:26:59.684212] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T18:27:00.144981] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T18:27:00.415831] [INFO ] [REMOTE ] DDL: Fetching primary data for 2025-09. [2025-09-17T18:27:01.215773] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-07. [2025-09-17T18:27:01.556226] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T18:27:02.015935] [INFO ] [REMOTE ] DD: Fetching primary data for 2025-09. [2025-09-17T18:27:02.206246] [INFO ] [REMOTE ] DDL: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T18:27:02.216385] [INFO ] [REMOTE ] DDL: Full fetch complete (53267 records). [2025-09-17T18:27:02.216587] [DEBUG] [VALIDATOR ] DDL: Validating primary data. [2025-09-17T18:27:02.735808] [DEBUG] [VALIDATOR ] DDL: All expected trading days are present. [2025-09-17T18:27:02.735887] [DEBUG] [VALIDATOR ] DDL: Primary data validation passed. [2025-09-17T18:27:02.736526] [INFO ] [MAIN ] DDL: Fetched primary data is valid. [2025-09-17T18:27:02.736569] [DEBUG] [LOCAL ] DDL: Saving primary data. [2025-09-17T18:27:02.737617] [DEBUG] [LOCAL ] DDL: Trimmed 53267 records to 36306 (keeping 200 days of data) [2025-09-17T18:27:02.935739] [DEBUG] [LOCAL ] DDL: Primary data saved (36306 records). [2025-09-17T18:27:02.935894] [INFO ] [MAIN ] DDL: Full history saved. [2025-09-17T18:27:02.936739] [INFO ] [MAIN ] Update Progress: 598/2371 symbols completed. DDL took 24.9s. Estimated remaining: 4h 17m 60s. Rate: 6.9 symbols/min [2025-09-17T18:27:03.183128] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T18:27:03.194006] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-08. [2025-09-17T18:27:03.705519] [INFO ] [REMOTE ] DD: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T18:27:03.711848] [INFO ] [REMOTE ] DD: Full fetch complete (75673 records). [2025-09-17T18:27:03.711998] [DEBUG] [VALIDATOR ] DD: Validating primary data. [2025-09-17T18:27:03.712898] [FATAL] [VALIDATOR ] DD: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:27:03.713022] [FATAL] [MAIN ] DD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:27:03.713060] [WARN ] [MAIN ] DD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:27:03.713127] [INFO ] [LOCAL ] DD: Starting deletion of primary data. [2025-09-17T18:27:03.713219] [DEBUG] [LOCAL ] DD: No primary data file found to delete. [2025-09-17T18:27:03.713269] [INFO ] [LOCAL ] DD: Starting deletion of derivative data. [2025-09-17T18:27:03.713637] [DEBUG] [LOCAL ] DD: Deleted derivative data file. [2025-09-17T18:27:03.714209] [INFO ] [MAIN ] Update Progress: 599/2371 symbols completed. DD took 37.0s. Estimated remaining: 4h 17m 28s. Rate: 6.9 symbols/min [2025-09-17T18:27:05.056593] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T18:27:05.067790] [INFO ] [REMOTE ] DDD: Fetching primary data for 2025-09. [2025-09-17T18:27:06.554305] [INFO ] [REMOTE ] DDD: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T18:27:06.560996] [INFO ] [REMOTE ] DDD: Full fetch complete (73557 records). [2025-09-17T18:27:06.561159] [DEBUG] [VALIDATOR ] DDD: Validating primary data. [2025-09-17T18:27:06.954068] [DEBUG] [VALIDATOR ] DDD: All expected trading days are present. [2025-09-17T18:27:06.954161] [DEBUG] [VALIDATOR ] DDD: Primary data validation passed. [2025-09-17T18:27:06.955122] [INFO ] [MAIN ] DDD: Fetched primary data is valid. [2025-09-17T18:27:06.955179] [DEBUG] [LOCAL ] DDD: Saving primary data. [2025-09-17T18:27:06.956714] [DEBUG] [LOCAL ] DDD: Trimmed 73557 records to 50817 (keeping 200 days of data) [2025-09-17T18:27:07.245190] [DEBUG] [LOCAL ] DDD: Primary data saved (50817 records). [2025-09-17T18:27:07.245345] [INFO ] [MAIN ] DDD: Full history saved. [2025-09-17T18:27:07.245423] [INFO ] [MAIN ] Update Progress: 600/2371 symbols completed. DDD took 34.9s. Estimated remaining: 4h 17m 4s. Rate: 6.9 symbols/min [2025-09-17T18:27:07.873411] [INFO ] [MAIN ] DDS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:27:07.875950] [INFO ] [MAIN ] DEA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:27:07.942167] [INFO ] [MAIN ] DDT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:27:07.965485] [INFO ] [MAIN ] DE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:27:07.974310] [DEBUG] [LOCAL ] DDT: Loaded 2071 existing records from primary storage. [2025-09-17T18:27:07.974531] [INFO ] [MAIN ] DDT: Loaded 2071 existing records. [2025-09-17T18:27:08.065490] [DEBUG] [LOCAL ] DDS: Loaded 13640 existing records from primary storage. [2025-09-17T18:27:08.093126] [INFO ] [MAIN ] DDS: Loaded 13640 existing records. [2025-09-17T18:27:08.275117] [WARN ] [MAIN ] DDT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:27:08.314008] [INFO ] [MAIN ] DDT: Wiping existing primary data before full refresh. [2025-09-17T18:27:08.326191] [INFO ] [LOCAL ] DDT: Starting deletion of primary data. [2025-09-17T18:27:08.332813] [DEBUG] [LOCAL ] DDT: Deleted primary data file. [2025-09-17T18:27:08.344245] [DEBUG] [LOCAL ] DEA: Loaded 41800 existing records from primary storage. [2025-09-17T18:27:08.354624] [INFO ] [MAIN ] DEA: Loaded 41800 existing records. [2025-09-17T18:27:08.369144] [DEBUG] [LOCAL ] DE: Loaded 47823 existing records from primary storage. [2025-09-17T18:27:08.374343] [INFO ] [MAIN ] DDT: Starting full primary refresh. [2025-09-17T18:27:08.384928] [INFO ] [MAIN ] DE: Loaded 47823 existing records. [2025-09-17T18:27:08.605125] [WARN ] [MAIN ] DDS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:27:08.661315] [INFO ] [MAIN ] DDS: Wiping existing primary data before full refresh. [2025-09-17T18:27:08.715635] [INFO ] [LOCAL ] DDS: Starting deletion of primary data. [2025-09-17T18:27:08.779539] [DEBUG] [LOCAL ] DDS: Deleted primary data file. [2025-09-17T18:27:08.790408] [INFO ] [MAIN ] DDS: Starting full primary refresh. [2025-09-17T18:27:08.971963] [WARN ] [MAIN ] DEA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:27:09.092493] [WARN ] [MAIN ] DE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:27:09.111660] [INFO ] [MAIN ] DE: Wiping existing primary data before full refresh. [2025-09-17T18:27:09.121593] [INFO ] [MAIN ] DEA: Wiping existing primary data before full refresh. [2025-09-17T18:27:09.130858] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-17T18:27:09.146754] [DEBUG] [LOCAL ] DE: Deleted primary data file. [2025-09-17T18:27:09.141408] [INFO ] [LOCAL ] DEA: Starting deletion of primary data. [2025-09-17T18:27:09.156855] [INFO ] [MAIN ] DE: Starting full primary refresh. [2025-09-17T18:27:09.219322] [DEBUG] [LOCAL ] DEA: Deleted primary data file. [2025-09-17T18:27:09.260048] [INFO ] [MAIN ] DEA: Starting full primary refresh. [2025-09-17T18:27:09.805527] [INFO ] [REMOTE ] DDT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:27:09.883832] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-11. [2025-09-17T18:27:10.062501] [INFO ] [REMOTE ] DDS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:27:10.116480] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-11. [2025-09-17T18:27:10.262425] [INFO ] [REMOTE ] DE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:27:10.278108] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-11. [2025-09-17T18:27:10.363358] [INFO ] [REMOTE ] DEA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:27:10.363674] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-11. [2025-09-17T18:27:10.595237] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T18:27:10.596409] [INFO ] [REMOTE ] DDT: Fetching primary data for 2024-12. [2025-09-17T18:27:11.048579] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T18:27:11.049781] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-01. [2025-09-17T18:27:11.248782] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T18:27:11.252117] [INFO ] [REMOTE ] DDS: Fetching primary data for 2024-12. [2025-09-17T18:27:11.362670] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-01 (0.31 seconds). [2025-09-17T18:27:11.363774] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-02. [2025-09-17T18:27:11.919436] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T18:27:11.922875] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-01. [2025-09-17T18:27:12.109288] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T18:27:12.119075] [INFO ] [REMOTE ] DEA: Fetching primary data for 2024-12. [2025-09-17T18:27:12.159720] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T18:27:12.208112] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T18:27:12.415791] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-03. [2025-09-17T18:27:12.576874] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T18:27:12.886543] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T18:27:13.215794] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-04. [2025-09-17T18:27:13.560789] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T18:27:13.808963] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T18:27:14.015781] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-05. [2025-09-17T18:27:14.482615] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T18:27:14.815781] [INFO ] [REMOTE ] DE: Fetching primary data for 2024-12. [2025-09-17T18:27:15.615801] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-01. [2025-09-17T18:27:16.415769] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-02. [2025-09-17T18:27:16.650967] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T18:27:17.111233] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T18:27:17.215759] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-02. [2025-09-17T18:27:17.416448] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T18:27:18.015778] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-06. [2025-09-17T18:27:18.747909] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T18:27:18.779174] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T18:27:18.815731] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-03. [2025-09-17T18:27:19.615828] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-07. [2025-09-17T18:27:20.160322] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-17T18:27:20.415747] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-08. [2025-09-17T18:27:20.514635] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T18:27:20.922759] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T18:27:21.215776] [INFO ] [REMOTE ] DDT: Fetching primary data for 2025-09. [2025-09-17T18:27:21.954387] [INFO ] [REMOTE ] DDT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T18:27:21.955397] [INFO ] [REMOTE ] DDT: Full fetch complete (2886 records). [2025-09-17T18:27:21.955479] [DEBUG] [VALIDATOR ] DDT: Validating primary data. [2025-09-17T18:27:22.025215] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-03. [2025-09-17T18:27:22.345260] [DEBUG] [VALIDATOR ] DDT: All expected trading days are present. [2025-09-17T18:27:22.345339] [DEBUG] [VALIDATOR ] DDT: Primary data validation passed. [2025-09-17T18:27:22.345442] [INFO ] [MAIN ] DDT: Fetched primary data is valid. [2025-09-17T18:27:22.345479] [DEBUG] [LOCAL ] DDT: Saving primary data. [2025-09-17T18:27:22.345834] [DEBUG] [LOCAL ] DDT: Trimmed 2886 records to 2079 (keeping 200 days of data) [2025-09-17T18:27:22.358995] [DEBUG] [LOCAL ] DDT: Primary data saved (2079 records). [2025-09-17T18:27:22.359058] [INFO ] [MAIN ] DDT: Full history saved. [2025-09-17T18:27:22.359140] [INFO ] [MAIN ] Update Progress: 601/2371 symbols completed. DDT took 15.1s. Estimated remaining: 4h 17m 14s. Rate: 6.9 symbols/min [2025-09-17T18:27:22.543324] [INFO ] [MAIN ] DEC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:27:22.574913] [DEBUG] [LOCAL ] DEC: Loaded 30937 existing records from primary storage. [2025-09-17T18:27:22.575052] [INFO ] [MAIN ] DEC: Loaded 30937 existing records. [2025-09-17T18:27:22.752836] [WARN ] [MAIN ] DEC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:27:22.753071] [INFO ] [MAIN ] DEC: Wiping existing primary data before full refresh. [2025-09-17T18:27:22.753117] [INFO ] [LOCAL ] DEC: Starting deletion of primary data. [2025-09-17T18:27:22.753855] [DEBUG] [LOCAL ] DEC: Deleted primary data file. [2025-09-17T18:27:22.753905] [INFO ] [MAIN ] DEC: Starting full primary refresh. [2025-09-17T18:27:22.820893] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-01. [2025-09-17T18:27:23.111065] [INFO ] [REMOTE ] DEC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:27:23.123601] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T18:27:23.615774] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-04. [2025-09-17T18:27:24.415769] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-11. [2025-09-17T18:27:24.679708] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T18:27:24.792341] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-01 (1.97 seconds). [2025-09-17T18:27:25.215765] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-02. [2025-09-17T18:27:25.424253] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T18:27:26.015779] [INFO ] [REMOTE ] DEC: Fetching primary data for 2024-12. [2025-09-17T18:27:26.815780] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-04. [2025-09-17T18:27:26.958773] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T18:27:27.178963] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T18:27:27.615785] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-03. [2025-09-17T18:27:28.415831] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-01. [2025-09-17T18:27:28.637936] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T18:27:29.215808] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-05. [2025-09-17T18:27:29.532787] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T18:27:29.597159] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T18:27:30.015824] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-05. [2025-09-17T18:27:30.462900] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T18:27:30.815806] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-06. [2025-09-17T18:27:31.121975] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T18:27:31.615815] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-02. [2025-09-17T18:27:32.149635] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T18:27:32.416091] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-07. [2025-09-17T18:27:32.420839] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T18:27:33.215796] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-04. [2025-09-17T18:27:33.880559] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T18:27:34.015780] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-03. [2025-09-17T18:27:34.815762] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-08. [2025-09-17T18:27:35.194217] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T18:27:35.615790] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-06. [2025-09-17T18:27:35.900222] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T18:27:35.936250] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T18:27:36.415780] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-05. [2025-09-17T18:27:36.489824] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T18:27:37.215811] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-04. [2025-09-17T18:27:38.015787] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-07. [2025-09-17T18:27:38.261147] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T18:27:38.675528] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T18:27:38.751375] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T18:27:38.815727] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-08. [2025-09-17T18:27:39.615836] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-06. [2025-09-17T18:27:39.813402] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T18:27:40.415807] [INFO ] [REMOTE ] DDS: Fetching primary data for 2025-09. [2025-09-17T18:27:41.215685] [INFO ] [REMOTE ] DEA: Fetching primary data for 2025-09. [2025-09-17T18:27:41.325844] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T18:27:41.524177] [INFO ] [REMOTE ] DDS: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T18:27:41.526274] [INFO ] [REMOTE ] DDS: Full fetch complete (19332 records). [2025-09-17T18:27:41.526393] [DEBUG] [VALIDATOR ] DDS: Validating primary data. [2025-09-17T18:27:41.910279] [DEBUG] [VALIDATOR ] DDS: All expected trading days are present. [2025-09-17T18:27:41.910368] [DEBUG] [VALIDATOR ] DDS: Primary data validation passed. [2025-09-17T18:27:41.910851] [INFO ] [MAIN ] DDS: Fetched primary data is valid. [2025-09-17T18:27:41.910900] [DEBUG] [LOCAL ] DDS: Saving primary data. [2025-09-17T18:27:41.911530] [DEBUG] [LOCAL ] DDS: Trimmed 19332 records to 13559 (keeping 200 days of data) [2025-09-17T18:27:42.001786] [DEBUG] [LOCAL ] DDS: Primary data saved (13559 records). [2025-09-17T18:27:42.001974] [INFO ] [MAIN ] DDS: Full history saved. [2025-09-17T18:27:42.002092] [INFO ] [MAIN ] Update Progress: 602/2371 symbols completed. DDS took 34.8s. Estimated remaining: 4h 17m 37s. Rate: 6.9 symbols/min [2025-09-17T18:27:42.023133] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-07. [2025-09-17T18:27:42.184559] [INFO ] [MAIN ] DECK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:27:42.245588] [DEBUG] [LOCAL ] DECK: Loaded 53324 existing records from primary storage. [2025-09-17T18:27:42.245799] [INFO ] [MAIN ] DECK: Loaded 53324 existing records. [2025-09-17T18:27:42.439196] [WARN ] [MAIN ] DECK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:27:42.439461] [INFO ] [MAIN ] DECK: Wiping existing primary data before full refresh. [2025-09-17T18:27:42.439525] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-17T18:27:42.440567] [DEBUG] [LOCAL ] DECK: Deleted primary data file. [2025-09-17T18:27:42.440628] [INFO ] [MAIN ] DECK: Starting full primary refresh. [2025-09-17T18:27:42.811370] [INFO ] [REMOTE ] DECK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:27:42.815739] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-11. [2025-09-17T18:27:42.839451] [INFO ] [REMOTE ] DEA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T18:27:42.846317] [INFO ] [REMOTE ] DEA: Full fetch complete (63124 records). [2025-09-17T18:27:42.846477] [DEBUG] [VALIDATOR ] DEA: Validating primary data. [2025-09-17T18:27:43.232498] [DEBUG] [VALIDATOR ] DEA: All expected trading days are present. [2025-09-17T18:27:43.232593] [DEBUG] [VALIDATOR ] DEA: Primary data validation passed. [2025-09-17T18:27:43.233370] [INFO ] [MAIN ] DEA: Fetched primary data is valid. [2025-09-17T18:27:43.233419] [DEBUG] [LOCAL ] DEA: Saving primary data. [2025-09-17T18:27:43.235024] [DEBUG] [LOCAL ] DEA: Trimmed 63124 records to 41744 (keeping 200 days of data) [2025-09-17T18:27:43.490555] [DEBUG] [LOCAL ] DEA: Primary data saved (41744 records). [2025-09-17T18:27:43.490710] [INFO ] [MAIN ] DEA: Full history saved. [2025-09-17T18:27:43.491897] [INFO ] [MAIN ] Update Progress: 603/2371 symbols completed. DEA took 36.2s. Estimated remaining: 4h 17m 7s. Rate: 6.9 symbols/min [2025-09-17T18:27:43.617919] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-05. [2025-09-17T18:27:43.670880] [INFO ] [MAIN ] DEI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:27:43.708496] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T18:27:43.761335] [DEBUG] [LOCAL ] DEI: Loaded 48518 existing records from primary storage. [2025-09-17T18:27:43.761488] [INFO ] [MAIN ] DEI: Loaded 48518 existing records. [2025-09-17T18:27:43.941961] [WARN ] [MAIN ] DEI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:27:43.942267] [INFO ] [MAIN ] DEI: Wiping existing primary data before full refresh. [2025-09-17T18:27:43.942349] [INFO ] [LOCAL ] DEI: Starting deletion of primary data. [2025-09-17T18:27:43.943497] [DEBUG] [LOCAL ] DEI: Deleted primary data file. [2025-09-17T18:27:43.943559] [INFO ] [MAIN ] DEI: Starting full primary refresh. [2025-09-17T18:27:44.307460] [INFO ] [REMOTE ] DEI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:27:44.415751] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-11. [2025-09-17T18:27:44.502099] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T18:27:44.556960] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T18:27:45.215792] [INFO ] [REMOTE ] DECK: Fetching primary data for 2024-12. [2025-09-17T18:27:46.022620] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-06. [2025-09-17T18:27:46.040782] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T18:27:46.671032] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T18:27:46.815791] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-01. [2025-09-17T18:27:47.558413] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T18:27:47.615756] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-07. [2025-09-17T18:27:48.415825] [INFO ] [REMOTE ] DEI: Fetching primary data for 2024-12. [2025-09-17T18:27:48.832329] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-17T18:27:48.864774] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T18:27:49.215772] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-08. [2025-09-17T18:27:49.703181] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T18:27:50.015784] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-01. [2025-09-17T18:27:50.815796] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-02. [2025-09-17T18:27:51.225504] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T18:27:51.615801] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-08. [2025-09-17T18:27:51.663755] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T18:27:52.415835] [INFO ] [REMOTE ] DE: Fetching primary data for 2025-09. [2025-09-17T18:27:52.759087] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T18:27:52.783988] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T18:27:53.215813] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-03. [2025-09-17T18:27:54.015778] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-02. [2025-09-17T18:27:54.300612] [INFO ] [REMOTE ] DE: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T18:27:54.306450] [INFO ] [REMOTE ] DE: Full fetch complete (69148 records). [2025-09-17T18:27:54.306572] [DEBUG] [VALIDATOR ] DE: Validating primary data. [2025-09-17T18:27:54.307353] [FATAL] [VALIDATOR ] DE: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:27:54.307434] [FATAL] [MAIN ] DE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:27:54.307473] [WARN ] [MAIN ] DE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:27:54.307518] [INFO ] [LOCAL ] DE: Starting deletion of primary data. [2025-09-17T18:27:54.307578] [DEBUG] [LOCAL ] DE: No primary data file found to delete. [2025-09-17T18:27:54.307612] [INFO ] [LOCAL ] DE: Starting deletion of derivative data. [2025-09-17T18:27:54.307915] [DEBUG] [LOCAL ] DE: Deleted derivative data file. [2025-09-17T18:27:54.308002] [INFO ] [MAIN ] Update Progress: 604/2371 symbols completed. DE took 47.1s. Estimated remaining: 4h 17m 4s. Rate: 6.9 symbols/min [2025-09-17T18:27:54.475838] [INFO ] [MAIN ] DELL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:27:54.531330] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-09-17T18:27:54.531564] [INFO ] [MAIN ] DELL: Loaded 53736 existing records. [2025-09-17T18:27:54.713231] [WARN ] [MAIN ] DELL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:27:54.713622] [INFO ] [MAIN ] DELL: Wiping existing primary data before full refresh. [2025-09-17T18:27:54.713703] [INFO ] [LOCAL ] DELL: Starting deletion of primary data. [2025-09-17T18:27:54.714633] [DEBUG] [LOCAL ] DELL: Deleted primary data file. [2025-09-17T18:27:54.714709] [INFO ] [MAIN ] DELL: Starting full primary refresh. [2025-09-17T18:27:54.820949] [INFO ] [REMOTE ] DEC: Fetching primary data for 2025-09. [2025-09-17T18:27:55.118016] [INFO ] [REMOTE ] DELL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:27:55.312587] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T18:27:55.378772] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-17T18:27:55.615918] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-03. [2025-09-17T18:27:56.105869] [INFO ] [REMOTE ] DEC: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T18:27:56.111088] [INFO ] [REMOTE ] DEC: Full fetch complete (42587 records). [2025-09-17T18:27:56.111358] [DEBUG] [VALIDATOR ] DEC: Validating primary data. [2025-09-17T18:27:56.420869] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-04. [2025-09-17T18:27:56.490944] [DEBUG] [VALIDATOR ] DEC: All expected trading days are present. [2025-09-17T18:27:56.491026] [DEBUG] [VALIDATOR ] DEC: Primary data validation passed. [2025-09-17T18:27:56.491633] [INFO ] [MAIN ] DEC: Fetched primary data is valid. [2025-09-17T18:27:56.491712] [DEBUG] [LOCAL ] DEC: Saving primary data. [2025-09-17T18:27:56.492812] [DEBUG] [LOCAL ] DEC: Trimmed 42587 records to 31026 (keeping 200 days of data) [2025-09-17T18:27:56.691350] [DEBUG] [LOCAL ] DEC: Primary data saved (31026 records). [2025-09-17T18:27:56.691598] [INFO ] [MAIN ] DEC: Full history saved. [2025-09-17T18:27:56.691785] [INFO ] [MAIN ] Update Progress: 605/2371 symbols completed. DEC took 34.3s. Estimated remaining: 4h 16m 37s. Rate: 6.9 symbols/min [2025-09-17T18:27:56.869289] [INFO ] [MAIN ] DEO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:27:56.918564] [DEBUG] [LOCAL ] DEO: Loaded 48913 existing records from primary storage. [2025-09-17T18:27:56.918762] [INFO ] [MAIN ] DEO: Loaded 48913 existing records. [2025-09-17T18:27:57.097511] [WARN ] [MAIN ] DEO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:27:57.097792] [INFO ] [MAIN ] DEO: Wiping existing primary data before full refresh. [2025-09-17T18:27:57.097838] [INFO ] [LOCAL ] DEO: Starting deletion of primary data. [2025-09-17T18:27:57.098850] [DEBUG] [LOCAL ] DEO: Deleted primary data file. [2025-09-17T18:27:57.098902] [INFO ] [MAIN ] DEO: Starting full primary refresh. [2025-09-17T18:27:57.221022] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-11. [2025-09-17T18:27:57.455951] [INFO ] [REMOTE ] DEO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:27:57.488817] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T18:27:58.015844] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-04. [2025-09-17T18:27:58.815700] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-11. [2025-09-17T18:27:58.910828] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-17T18:27:59.615859] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-05. [2025-09-17T18:27:59.757910] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T18:27:59.799781] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-11 (2.58 seconds). [2025-09-17T18:28:00.415774] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-05. [2025-09-17T18:28:00.967528] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-17T18:28:01.215787] [INFO ] [REMOTE ] DELL: Fetching primary data for 2024-12. [2025-09-17T18:28:01.751633] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T18:28:02.015703] [INFO ] [REMOTE ] DEO: Fetching primary data for 2024-12. [2025-09-17T18:28:02.047696] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T18:28:02.815792] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-06. [2025-09-17T18:28:03.440734] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-17T18:28:03.615730] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-01. [2025-09-17T18:28:03.847472] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T18:28:04.414584] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T18:28:04.423534] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-06. [2025-09-17T18:28:05.215775] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-07. [2025-09-17T18:28:05.894536] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-17T18:28:06.015826] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-01. [2025-09-17T18:28:06.124874] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T18:28:06.577396] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T18:28:06.815829] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-08. [2025-09-17T18:28:07.615789] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-02. [2025-09-17T18:28:07.804491] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T18:28:08.415838] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-02. [2025-09-17T18:28:08.519399] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T18:28:09.215789] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-07. [2025-09-17T18:28:10.025356] [INFO ] [REMOTE ] DEI: Fetching primary data for 2025-09. [2025-09-17T18:28:10.030386] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T18:28:10.074012] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-17T18:28:10.815740] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-03. [2025-09-17T18:28:11.017141] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T18:28:11.189172] [INFO ] [REMOTE ] DEI: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T18:28:11.195378] [INFO ] [REMOTE ] DEI: Full fetch complete (69310 records). [2025-09-17T18:28:11.195491] [DEBUG] [VALIDATOR ] DEI: Validating primary data. [2025-09-17T18:28:11.588759] [DEBUG] [VALIDATOR ] DEI: All expected trading days are present. [2025-09-17T18:28:11.588848] [DEBUG] [VALIDATOR ] DEI: Primary data validation passed. [2025-09-17T18:28:11.589630] [INFO ] [MAIN ] DEI: Fetched primary data is valid. [2025-09-17T18:28:11.589690] [DEBUG] [LOCAL ] DEI: Saving primary data. [2025-09-17T18:28:11.591173] [DEBUG] [LOCAL ] DEI: Trimmed 69310 records to 48536 (keeping 200 days of data) [2025-09-17T18:28:11.650781] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-03. [2025-09-17T18:28:11.893113] [DEBUG] [LOCAL ] DEI: Primary data saved (48536 records). [2025-09-17T18:28:11.893309] [INFO ] [MAIN ] DEI: Full history saved. [2025-09-17T18:28:11.894370] [INFO ] [MAIN ] Update Progress: 606/2371 symbols completed. DEI took 28.4s. Estimated remaining: 4h 16m 47s. Rate: 6.9 symbols/min [2025-09-17T18:28:12.067792] [INFO ] [MAIN ] DFH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:28:12.105009] [DEBUG] [LOCAL ] DFH: Loaded 33205 existing records from primary storage. [2025-09-17T18:28:12.105165] [INFO ] [MAIN ] DFH: Loaded 33205 existing records. [2025-09-17T18:28:12.284626] [WARN ] [MAIN ] DFH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:28:12.284909] [INFO ] [MAIN ] DFH: Wiping existing primary data before full refresh. [2025-09-17T18:28:12.284956] [INFO ] [LOCAL ] DFH: Starting deletion of primary data. [2025-09-17T18:28:12.285748] [DEBUG] [LOCAL ] DFH: Deleted primary data file. [2025-09-17T18:28:12.285804] [INFO ] [MAIN ] DFH: Starting full primary refresh. [2025-09-17T18:28:12.427184] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-08. [2025-09-17T18:28:12.674874] [INFO ] [REMOTE ] DFH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:28:12.956216] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T18:28:13.215851] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-11. [2025-09-17T18:28:13.635239] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T18:28:14.015764] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-04. [2025-09-17T18:28:14.381180] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T18:28:14.471913] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T18:28:14.815776] [INFO ] [REMOTE ] DECK: Fetching primary data for 2025-09. [2025-09-17T18:28:15.615790] [INFO ] [REMOTE ] DFH: Fetching primary data for 2024-12. [2025-09-17T18:28:16.240071] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-17T18:28:16.415740] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-05. [2025-09-17T18:28:16.466308] [INFO ] [REMOTE ] DECK: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T18:28:16.472884] [INFO ] [REMOTE ] DECK: Full fetch complete (76018 records). [2025-09-17T18:28:16.473030] [DEBUG] [VALIDATOR ] DECK: Validating primary data. [2025-09-17T18:28:16.473798] [FATAL] [VALIDATOR ] DECK: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:28:16.473899] [FATAL] [MAIN ] DECK: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:28:16.473957] [WARN ] [MAIN ] DECK: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:28:16.474027] [INFO ] [LOCAL ] DECK: Starting deletion of primary data. [2025-09-17T18:28:16.474097] [DEBUG] [LOCAL ] DECK: No primary data file found to delete. [2025-09-17T18:28:16.474135] [INFO ] [LOCAL ] DECK: Starting deletion of derivative data. [2025-09-17T18:28:16.474417] [DEBUG] [LOCAL ] DECK: Deleted derivative data file. [2025-09-17T18:28:16.474505] [INFO ] [MAIN ] Update Progress: 607/2371 symbols completed. DECK took 34.5s. Estimated remaining: 4h 16m 27s. Rate: 6.9 symbols/min [2025-09-17T18:28:16.652247] [INFO ] [MAIN ] DFIN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:28:16.675138] [DEBUG] [LOCAL ] DFIN: Loaded 23614 existing records from primary storage. [2025-09-17T18:28:16.675265] [INFO ] [MAIN ] DFIN: Loaded 23614 existing records. [2025-09-17T18:28:16.859863] [WARN ] [MAIN ] DFIN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:28:16.860209] [INFO ] [MAIN ] DFIN: Wiping existing primary data before full refresh. [2025-09-17T18:28:16.860332] [INFO ] [LOCAL ] DFIN: Starting deletion of primary data. [2025-09-17T18:28:16.860948] [DEBUG] [LOCAL ] DFIN: Deleted primary data file. [2025-09-17T18:28:16.861051] [INFO ] [MAIN ] DFIN: Starting full primary refresh. [2025-09-17T18:28:17.044048] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T18:28:17.221408] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-04. [2025-09-17T18:28:17.251464] [INFO ] [REMOTE ] DFIN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:28:18.015763] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-01. [2025-09-17T18:28:18.682461] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-17T18:28:18.815734] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-06. [2025-09-17T18:28:19.132049] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T18:28:19.371619] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T18:28:19.615790] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-05. [2025-09-17T18:28:20.415789] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-02. [2025-09-17T18:28:21.063788] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T18:28:21.102846] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T18:28:21.215771] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-07. [2025-09-17T18:28:21.780245] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T18:28:22.015773] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-03. [2025-09-17T18:28:22.815781] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-06. [2025-09-17T18:28:23.457986] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T18:28:23.614878] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-17T18:28:23.619067] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-11. [2025-09-17T18:28:24.415761] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-08. [2025-09-17T18:28:24.640899] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T18:28:25.035470] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T18:28:25.215754] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2024-12. [2025-09-17T18:28:26.015858] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-07. [2025-09-17T18:28:26.273869] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T18:28:26.666284] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-17T18:28:26.815827] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-01. [2025-09-17T18:28:27.615824] [INFO ] [REMOTE ] DELL: Fetching primary data for 2025-09. [2025-09-17T18:28:27.841788] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T18:28:27.980176] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T18:28:28.415794] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-02. [2025-09-17T18:28:29.215868] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-08. [2025-09-17T18:28:29.620740] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T18:28:29.829352] [INFO ] [REMOTE ] DELL: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-17T18:28:29.837774] [INFO ] [REMOTE ] DELL: Full fetch complete (77812 records). [2025-09-17T18:28:29.837919] [DEBUG] [VALIDATOR ] DELL: Validating primary data. [2025-09-17T18:28:30.015787] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-04. [2025-09-17T18:28:30.232092] [DEBUG] [VALIDATOR ] DELL: All expected trading days are present. [2025-09-17T18:28:30.232211] [DEBUG] [VALIDATOR ] DELL: Primary data validation passed. [2025-09-17T18:28:30.233064] [INFO ] [MAIN ] DELL: Fetched primary data is valid. [2025-09-17T18:28:30.233112] [DEBUG] [LOCAL ] DELL: Saving primary data. [2025-09-17T18:28:30.234628] [DEBUG] [LOCAL ] DELL: Trimmed 77812 records to 53736 (keeping 200 days of data) [2025-09-17T18:28:30.574321] [DEBUG] [LOCAL ] DELL: Primary data saved (53736 records). [2025-09-17T18:28:30.574481] [INFO ] [MAIN ] DELL: Full history saved. [2025-09-17T18:28:30.575541] [INFO ] [MAIN ] Update Progress: 608/2371 symbols completed. DELL took 36.3s. Estimated remaining: 4h 16m 33s. Rate: 6.9 symbols/min [2025-09-17T18:28:30.743613] [INFO ] [MAIN ] DFP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:28:30.758822] [DEBUG] [LOCAL ] DFP: Loaded 11859 existing records from primary storage. [2025-09-17T18:28:30.758956] [INFO ] [MAIN ] DFP: Loaded 11859 existing records. [2025-09-17T18:28:30.826506] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-03. [2025-09-17T18:28:30.951522] [WARN ] [MAIN ] DFP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:28:30.951785] [INFO ] [MAIN ] DFP: Wiping existing primary data before full refresh. [2025-09-17T18:28:30.951832] [INFO ] [LOCAL ] DFP: Starting deletion of primary data. [2025-09-17T18:28:30.952351] [DEBUG] [LOCAL ] DFP: Deleted primary data file. [2025-09-17T18:28:30.952402] [INFO ] [MAIN ] DFP: Starting full primary refresh. [2025-09-17T18:28:31.315252] [INFO ] [REMOTE ] DFP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:28:31.343331] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T18:28:31.615766] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-11. [2025-09-17T18:28:31.694561] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T18:28:32.114026] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T18:28:32.415789] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-05. [2025-09-17T18:28:32.438703] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T18:28:33.215693] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-04. [2025-09-17T18:28:33.416147] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T18:28:34.015801] [INFO ] [REMOTE ] DFP: Fetching primary data for 2024-12. [2025-09-17T18:28:34.633303] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T18:28:34.815780] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-05. [2025-09-17T18:28:34.909784] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T18:28:35.615810] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-06. [2025-09-17T18:28:36.026770] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T18:28:36.415832] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-01. [2025-09-17T18:28:36.933430] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T18:28:36.946742] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T18:28:37.215832] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-02. [2025-09-17T18:28:38.015817] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-07. [2025-09-17T18:28:38.044198] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T18:28:38.815795] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-06. [2025-09-17T18:28:39.484921] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T18:28:39.615800] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-03. [2025-09-17T18:28:39.900955] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T18:28:40.415795] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-08. [2025-09-17T18:28:40.453401] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T18:28:41.215805] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-07. [2025-09-17T18:28:41.780403] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T18:28:42.015804] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-04. [2025-09-17T18:28:42.297812] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T18:28:42.717936] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T18:28:42.815806] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-05. [2025-09-17T18:28:43.615822] [INFO ] [REMOTE ] DFH: Fetching primary data for 2025-09. [2025-09-17T18:28:43.702339] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T18:28:44.415852] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-08. [2025-09-17T18:28:44.630959] [INFO ] [REMOTE ] DFH: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T18:28:44.637396] [INFO ] [REMOTE ] DFH: Full fetch complete (49157 records). [2025-09-17T18:28:44.637597] [DEBUG] [VALIDATOR ] DFH: Validating primary data. [2025-09-17T18:28:45.023930] [DEBUG] [VALIDATOR ] DFH: All expected trading days are present. [2025-09-17T18:28:45.024023] [DEBUG] [VALIDATOR ] DFH: Primary data validation passed. [2025-09-17T18:28:45.024676] [INFO ] [MAIN ] DFH: Fetched primary data is valid. [2025-09-17T18:28:45.024721] [DEBUG] [LOCAL ] DFH: Saving primary data. [2025-09-17T18:28:45.025734] [DEBUG] [LOCAL ] DFH: Trimmed 49157 records to 33130 (keeping 200 days of data) [2025-09-17T18:28:45.218631] [INFO ] [REMOTE ] DEO: Fetching primary data for 2025-09. [2025-09-17T18:28:45.231601] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T18:28:45.248042] [DEBUG] [LOCAL ] DFH: Primary data saved (33130 records). [2025-09-17T18:28:45.248233] [INFO ] [MAIN ] DFH: Full history saved. [2025-09-17T18:28:45.248329] [INFO ] [MAIN ] Update Progress: 609/2371 symbols completed. DFH took 33.4s. Estimated remaining: 4h 16m 42s. Rate: 6.9 symbols/min [2025-09-17T18:28:45.420206] [INFO ] [MAIN ] DG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:28:45.471615] [DEBUG] [LOCAL ] DG: Loaded 53312 existing records from primary storage. [2025-09-17T18:28:45.471808] [INFO ] [MAIN ] DG: Loaded 53312 existing records. [2025-09-17T18:28:45.654057] [WARN ] [MAIN ] DG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:28:45.654299] [INFO ] [MAIN ] DG: Wiping existing primary data before full refresh. [2025-09-17T18:28:45.654343] [INFO ] [LOCAL ] DG: Starting deletion of primary data. [2025-09-17T18:28:45.655550] [DEBUG] [LOCAL ] DG: Deleted primary data file. [2025-09-17T18:28:45.655602] [INFO ] [MAIN ] DG: Starting full primary refresh. [2025-09-17T18:28:46.012880] [INFO ] [REMOTE ] DG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:28:46.015732] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-11. [2025-09-17T18:28:46.815806] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-06. [2025-09-17T18:28:47.291048] [INFO ] [REMOTE ] DEO: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-17T18:28:47.297725] [INFO ] [REMOTE ] DEO: Full fetch complete (71286 records). [2025-09-17T18:28:47.297888] [DEBUG] [VALIDATOR ] DEO: Validating primary data. [2025-09-17T18:28:47.619581] [INFO ] [REMOTE ] DFIN: Fetching primary data for 2025-09. [2025-09-17T18:28:47.669734] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T18:28:47.712055] [DEBUG] [VALIDATOR ] DEO: All expected trading days are present. [2025-09-17T18:28:47.712185] [DEBUG] [VALIDATOR ] DEO: Primary data validation passed. [2025-09-17T18:28:47.713085] [INFO ] [MAIN ] DEO: Fetched primary data is valid. [2025-09-17T18:28:47.713197] [DEBUG] [LOCAL ] DEO: Saving primary data. [2025-09-17T18:28:47.715804] [DEBUG] [LOCAL ] DEO: Trimmed 71286 records to 48969 (keeping 200 days of data) [2025-09-17T18:28:48.059032] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-17T18:28:48.075300] [DEBUG] [LOCAL ] DEO: Primary data saved (48969 records). [2025-09-17T18:28:48.075473] [INFO ] [MAIN ] DEO: Full history saved. [2025-09-17T18:28:48.075586] [INFO ] [MAIN ] Update Progress: 610/2371 symbols completed. DEO took 51.4s. Estimated remaining: 4h 16m 16s. Rate: 6.9 symbols/min [2025-09-17T18:28:48.247296] [INFO ] [MAIN ] DGX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:28:48.291293] [DEBUG] [LOCAL ] DGX: Loaded 45571 existing records from primary storage. [2025-09-17T18:28:48.291468] [INFO ] [MAIN ] DGX: Loaded 45571 existing records. [2025-09-17T18:28:48.420991] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-07. [2025-09-17T18:28:48.483205] [WARN ] [MAIN ] DGX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:28:48.483498] [INFO ] [MAIN ] DGX: Wiping existing primary data before full refresh. [2025-09-17T18:28:48.483546] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-17T18:28:48.484774] [DEBUG] [LOCAL ] DGX: Deleted primary data file. [2025-09-17T18:28:48.484980] [INFO ] [MAIN ] DGX: Starting full primary refresh. [2025-09-17T18:28:48.737706] [INFO ] [REMOTE ] DFIN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T18:28:48.786336] [INFO ] [REMOTE ] DFIN: Full fetch complete (33094 records). [2025-09-17T18:28:48.788967] [DEBUG] [VALIDATOR ] DFIN: Validating primary data. [2025-09-17T18:28:48.980544] [INFO ] [REMOTE ] DGX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:28:49.223432] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-11. [2025-09-17T18:28:49.255945] [DEBUG] [VALIDATOR ] DFIN: All expected trading days are present. [2025-09-17T18:28:49.256025] [DEBUG] [VALIDATOR ] DFIN: Primary data validation passed. [2025-09-17T18:28:49.256619] [INFO ] [MAIN ] DFIN: Fetched primary data is valid. [2025-09-17T18:28:49.257291] [DEBUG] [LOCAL ] DFIN: Saving primary data. [2025-09-17T18:28:49.258196] [DEBUG] [LOCAL ] DFIN: Trimmed 33094 records to 23550 (keeping 200 days of data) [2025-09-17T18:28:49.393485] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T18:28:49.417362] [DEBUG] [LOCAL ] DFIN: Primary data saved (23550 records). [2025-09-17T18:28:49.417504] [INFO ] [MAIN ] DFIN: Full history saved. [2025-09-17T18:28:49.417661] [INFO ] [MAIN ] Update Progress: 611/2371 symbols completed. DFIN took 32.9s. Estimated remaining: 4h 15m 46s. Rate: 6.9 symbols/min [2025-09-17T18:28:49.585592] [INFO ] [MAIN ] DHF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:28:49.605297] [DEBUG] [LOCAL ] DHF: Loaded 21188 existing records from primary storage. [2025-09-17T18:28:49.605424] [INFO ] [MAIN ] DHF: Loaded 21188 existing records. [2025-09-17T18:28:49.782878] [WARN ] [MAIN ] DHF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:28:49.783134] [INFO ] [MAIN ] DHF: Wiping existing primary data before full refresh. [2025-09-17T18:28:49.783185] [INFO ] [LOCAL ] DHF: Starting deletion of primary data. [2025-09-17T18:28:49.783822] [DEBUG] [LOCAL ] DHF: Deleted primary data file. [2025-09-17T18:28:49.783877] [INFO ] [MAIN ] DHF: Starting full primary refresh. [2025-09-17T18:28:50.028778] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-08. [2025-09-17T18:28:50.147749] [INFO ] [REMOTE ] DHF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:28:50.685908] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T18:28:50.815768] [INFO ] [REMOTE ] DFP: Fetching primary data for 2025-09. [2025-09-17T18:28:50.896417] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T18:28:51.480548] [INFO ] [REMOTE ] DFP: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T18:28:51.483097] [INFO ] [REMOTE ] DFP: Full fetch complete (16231 records). [2025-09-17T18:28:51.483196] [DEBUG] [VALIDATOR ] DFP: Validating primary data. [2025-09-17T18:28:51.620902] [INFO ] [REMOTE ] DGX: Fetching primary data for 2024-12. [2025-09-17T18:28:51.876265] [DEBUG] [VALIDATOR ] DFP: All expected trading days are present. [2025-09-17T18:28:51.876345] [DEBUG] [VALIDATOR ] DFP: Primary data validation passed. [2025-09-17T18:28:51.876721] [INFO ] [MAIN ] DFP: Fetched primary data is valid. [2025-09-17T18:28:51.876765] [DEBUG] [LOCAL ] DFP: Saving primary data. [2025-09-17T18:28:51.877297] [DEBUG] [LOCAL ] DFP: Trimmed 16231 records to 11799 (keeping 200 days of data) [2025-09-17T18:28:51.949027] [DEBUG] [LOCAL ] DFP: Primary data saved (11799 records). [2025-09-17T18:28:51.949163] [INFO ] [MAIN ] DFP: Full history saved. [2025-09-17T18:28:51.949300] [INFO ] [MAIN ] Update Progress: 612/2371 symbols completed. DFP took 21.4s. Estimated remaining: 4h 15m 20s. Rate: 6.9 symbols/min [2025-09-17T18:28:52.122615] [INFO ] [MAIN ] DHI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:28:52.178214] [DEBUG] [LOCAL ] DHI: Loaded 53376 existing records from primary storage. [2025-09-17T18:28:52.178348] [INFO ] [MAIN ] DHI: Loaded 53376 existing records. [2025-09-17T18:28:52.363344] [WARN ] [MAIN ] DHI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:28:52.363586] [INFO ] [MAIN ] DHI: Wiping existing primary data before full refresh. [2025-09-17T18:28:52.363631] [INFO ] [LOCAL ] DHI: Starting deletion of primary data. [2025-09-17T18:28:52.364680] [DEBUG] [LOCAL ] DHI: Deleted primary data file. [2025-09-17T18:28:52.364728] [INFO ] [MAIN ] DHI: Starting full primary refresh. [2025-09-17T18:28:52.422704] [INFO ] [REMOTE ] DG: Fetching primary data for 2024-12. [2025-09-17T18:28:52.746741] [INFO ] [REMOTE ] DHI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:28:53.177605] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T18:28:53.215724] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-01. [2025-09-17T18:28:54.015757] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-11. [2025-09-17T18:28:54.527258] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-17T18:28:54.815815] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-11. [2025-09-17T18:28:54.851303] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T18:28:54.873327] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T18:28:55.615770] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-02. [2025-09-17T18:28:56.321152] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T18:28:56.415733] [INFO ] [REMOTE ] DHI: Fetching primary data for 2024-12. [2025-09-17T18:28:57.215753] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-01. [2025-09-17T18:28:57.403120] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T18:28:58.015792] [INFO ] [REMOTE ] DHF: Fetching primary data for 2024-12. [2025-09-17T18:28:58.367322] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T18:28:58.815842] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-01. [2025-09-17T18:28:59.229057] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T18:28:59.245867] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T18:28:59.615778] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-03. [2025-09-17T18:29:00.415898] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-02. [2025-09-17T18:29:00.934556] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T18:29:01.215817] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-01. [2025-09-17T18:29:01.771762] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-17T18:29:02.015867] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-04. [2025-09-17T18:29:02.294119] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T18:29:02.341414] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-17T18:29:02.815808] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-03. [2025-09-17T18:29:03.615793] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-02. [2025-09-17T18:29:03.841888] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T18:29:04.415775] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-05. [2025-09-17T18:29:04.849341] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T18:29:05.073594] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T18:29:05.215835] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-02. [2025-09-17T18:29:06.015781] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-04. [2025-09-17T18:29:06.066091] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T18:29:06.332733] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T18:29:06.815826] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-03. [2025-09-17T18:29:07.615827] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-03. [2025-09-17T18:29:07.948085] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T18:29:08.420771] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-05. [2025-09-17T18:29:08.428878] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T18:29:08.644533] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T18:29:09.215820] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-06. [2025-09-17T18:29:10.015796] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-04. [2025-09-17T18:29:10.575108] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T18:29:10.777323] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T18:29:10.818167] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-07. [2025-09-17T18:29:10.820089] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T18:29:11.615780] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-05. [2025-09-17T18:29:12.415801] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-06. [2025-09-17T18:29:12.636181] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T18:29:12.678367] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T18:29:13.215805] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-04. [2025-09-17T18:29:14.015821] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-08. [2025-09-17T18:29:14.383072] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T18:29:14.815787] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-07. [2025-09-17T18:29:15.256312] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T18:29:15.587838] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T18:29:15.615737] [INFO ] [REMOTE ] DGX: Fetching primary data for 2025-09. [2025-09-17T18:29:16.415775] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-05. [2025-09-17T18:29:16.891689] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T18:29:17.151329] [INFO ] [REMOTE ] DGX: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T18:29:17.156313] [INFO ] [REMOTE ] DGX: Full fetch complete (64843 records). [2025-09-17T18:29:17.156451] [DEBUG] [VALIDATOR ] DGX: Validating primary data. [2025-09-17T18:29:17.157359] [FATAL] [VALIDATOR ] DGX: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:29:17.157474] [FATAL] [MAIN ] DGX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:29:17.157525] [WARN ] [MAIN ] DGX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:29:17.157567] [INFO ] [LOCAL ] DGX: Starting deletion of primary data. [2025-09-17T18:29:17.157663] [DEBUG] [LOCAL ] DGX: No primary data file found to delete. [2025-09-17T18:29:17.157738] [INFO ] [LOCAL ] DGX: Starting deletion of derivative data. [2025-09-17T18:29:17.158078] [DEBUG] [LOCAL ] DGX: Deleted derivative data file. [2025-09-17T18:29:17.158218] [INFO ] [MAIN ] Update Progress: 613/2371 symbols completed. DGX took 29.1s. Estimated remaining: 4h 15m 58s. Rate: 6.9 symbols/min [2025-09-17T18:29:17.222137] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-06. [2025-09-17T18:29:17.330999] [INFO ] [MAIN ] DHR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:29:17.392235] [DEBUG] [LOCAL ] DHR: Loaded 53370 existing records from primary storage. [2025-09-17T18:29:17.392383] [INFO ] [MAIN ] DHR: Loaded 53370 existing records. [2025-09-17T18:29:17.573325] [WARN ] [MAIN ] DHR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:29:17.573551] [INFO ] [MAIN ] DHR: Wiping existing primary data before full refresh. [2025-09-17T18:29:17.573597] [INFO ] [LOCAL ] DHR: Starting deletion of primary data. [2025-09-17T18:29:17.574831] [DEBUG] [LOCAL ] DHR: Deleted primary data file. [2025-09-17T18:29:17.574884] [INFO ] [MAIN ] DHR: Starting full primary refresh. [2025-09-17T18:29:17.944112] [INFO ] [REMOTE ] DHR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:29:18.018897] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-11. [2025-09-17T18:29:18.025352] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T18:29:18.481219] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T18:29:18.815784] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-08. [2025-09-17T18:29:19.615754] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-06. [2025-09-17T18:29:19.920828] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T18:29:20.415784] [INFO ] [REMOTE ] DHR: Fetching primary data for 2024-12. [2025-09-17T18:29:21.030662] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-17T18:29:21.139305] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T18:29:21.215761] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-07. [2025-09-17T18:29:22.015778] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-07. [2025-09-17T18:29:22.395967] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T18:29:22.815735] [INFO ] [REMOTE ] DG: Fetching primary data for 2025-09. [2025-09-17T18:29:23.183707] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T18:29:23.266791] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T18:29:23.615767] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-08. [2025-09-17T18:29:24.415765] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-08. [2025-09-17T18:29:24.519064] [INFO ] [REMOTE ] DG: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T18:29:24.525897] [INFO ] [REMOTE ] DG: Full fetch complete (77118 records). [2025-09-17T18:29:24.526026] [DEBUG] [VALIDATOR ] DG: Validating primary data. [2025-09-17T18:29:24.904683] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T18:29:24.948828] [DEBUG] [VALIDATOR ] DG: All expected trading days are present. [2025-09-17T18:29:24.948917] [DEBUG] [VALIDATOR ] DG: Primary data validation passed. [2025-09-17T18:29:24.949804] [INFO ] [MAIN ] DG: Fetched primary data is valid. [2025-09-17T18:29:24.949850] [DEBUG] [LOCAL ] DG: Saving primary data. [2025-09-17T18:29:24.951310] [DEBUG] [LOCAL ] DG: Trimmed 77118 records to 53309 (keeping 200 days of data) [2025-09-17T18:29:25.246445] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-01. [2025-09-17T18:29:25.294303] [DEBUG] [LOCAL ] DG: Primary data saved (53309 records). [2025-09-17T18:29:25.294460] [INFO ] [MAIN ] DG: Full history saved. [2025-09-17T18:29:25.295363] [INFO ] [MAIN ] Update Progress: 614/2371 symbols completed. DG took 40.0s. Estimated remaining: 4h 15m 48s. Rate: 6.9 symbols/min [2025-09-17T18:29:25.467071] [INFO ] [MAIN ] DHT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:29:25.515246] [DEBUG] [LOCAL ] DHT: Loaded 48005 existing records from primary storage. [2025-09-17T18:29:25.515466] [INFO ] [MAIN ] DHT: Loaded 48005 existing records. [2025-09-17T18:29:25.693089] [WARN ] [MAIN ] DHT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:29:25.693372] [INFO ] [MAIN ] DHT: Wiping existing primary data before full refresh. [2025-09-17T18:29:25.693416] [INFO ] [LOCAL ] DHT: Starting deletion of primary data. [2025-09-17T18:29:25.694448] [DEBUG] [LOCAL ] DHT: Deleted primary data file. [2025-09-17T18:29:25.694497] [INFO ] [MAIN ] DHT: Starting full primary refresh. [2025-09-17T18:29:26.020955] [INFO ] [REMOTE ] DHF: Fetching primary data for 2025-09. [2025-09-17T18:29:26.059257] [INFO ] [REMOTE ] DHT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:29:26.689497] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-08 (2.27 seconds). [2025-09-17T18:29:26.815789] [INFO ] [REMOTE ] DHI: Fetching primary data for 2025-09. [2025-09-17T18:29:27.170764] [INFO ] [REMOTE ] DHF: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T18:29:27.175398] [INFO ] [REMOTE ] DHF: Full fetch complete (29567 records). [2025-09-17T18:29:27.175596] [DEBUG] [VALIDATOR ] DHF: Validating primary data. [2025-09-17T18:29:27.506719] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-17T18:29:27.619850] [DEBUG] [VALIDATOR ] DHF: All expected trading days are present. [2025-09-17T18:29:27.619511] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-11. [2025-09-17T18:29:27.620062] [DEBUG] [VALIDATOR ] DHF: Primary data validation passed. [2025-09-17T18:29:27.621690] [INFO ] [MAIN ] DHF: Fetched primary data is valid. [2025-09-17T18:29:27.621756] [DEBUG] [LOCAL ] DHF: Saving primary data. [2025-09-17T18:29:27.622546] [DEBUG] [LOCAL ] DHF: Trimmed 29567 records to 21199 (keeping 200 days of data) [2025-09-17T18:29:27.753991] [DEBUG] [LOCAL ] DHF: Primary data saved (21199 records). [2025-09-17T18:29:27.754185] [INFO ] [MAIN ] DHF: Full history saved. [2025-09-17T18:29:27.754332] [INFO ] [MAIN ] Update Progress: 615/2371 symbols completed. DHF took 38.3s. Estimated remaining: 4h 15m 21s. Rate: 6.9 symbols/min [2025-09-17T18:29:27.930720] [INFO ] [MAIN ] DHX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:29:27.944708] [DEBUG] [LOCAL ] DHX: Loaded 13256 existing records from primary storage. [2025-09-17T18:29:27.944827] [INFO ] [MAIN ] DHX: Loaded 13256 existing records. [2025-09-17T18:29:28.121039] [WARN ] [MAIN ] DHX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:29:28.121325] [INFO ] [MAIN ] DHX: Wiping existing primary data before full refresh. [2025-09-17T18:29:28.121381] [INFO ] [LOCAL ] DHX: Starting deletion of primary data. [2025-09-17T18:29:28.121858] [DEBUG] [LOCAL ] DHX: Deleted primary data file. [2025-09-17T18:29:28.121915] [INFO ] [MAIN ] DHX: Starting full primary refresh. [2025-09-17T18:29:28.420978] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-02. [2025-09-17T18:29:28.515507] [INFO ] [REMOTE ] DHX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:29:28.836368] [INFO ] [REMOTE ] DHI: Incremental fetch complete for 2025-09 (2.02 seconds). [2025-09-17T18:29:28.843493] [INFO ] [REMOTE ] DHI: Full fetch complete (77040 records). [2025-09-17T18:29:28.843634] [DEBUG] [VALIDATOR ] DHI: Validating primary data. [2025-09-17T18:29:29.217456] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-11. [2025-09-17T18:29:29.236496] [DEBUG] [VALIDATOR ] DHI: All expected trading days are present. [2025-09-17T18:29:29.237667] [DEBUG] [VALIDATOR ] DHI: Primary data validation passed. [2025-09-17T18:29:29.238552] [INFO ] [MAIN ] DHI: Fetched primary data is valid. [2025-09-17T18:29:29.238698] [DEBUG] [LOCAL ] DHI: Saving primary data. [2025-09-17T18:29:29.240177] [DEBUG] [LOCAL ] DHI: Trimmed 77040 records to 53375 (keeping 200 days of data) [2025-09-17T18:29:29.515770] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T18:29:29.632319] [DEBUG] [LOCAL ] DHI: Primary data saved (53375 records). [2025-09-17T18:29:29.632479] [INFO ] [MAIN ] DHI: Full history saved. [2025-09-17T18:29:29.633253] [INFO ] [MAIN ] Update Progress: 616/2371 symbols completed. DHI took 37.7s. Estimated remaining: 4h 14m 53s. Rate: 6.9 symbols/min [2025-09-17T18:29:29.812819] [INFO ] [MAIN ] DIAX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:29:29.827534] [DEBUG] [LOCAL ] DIAX: Loaded 12242 existing records from primary storage. [2025-09-17T18:29:29.827695] [INFO ] [MAIN ] DIAX: Loaded 12242 existing records. [2025-09-17T18:29:29.967425] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T18:29:30.025891] [INFO ] [REMOTE ] DHX: Fetching primary data for 2024-12. [2025-09-17T18:29:30.031427] [WARN ] [MAIN ] DIAX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:29:30.031687] [INFO ] [MAIN ] DIAX: Wiping existing primary data before full refresh. [2025-09-17T18:29:30.031788] [INFO ] [LOCAL ] DIAX: Starting deletion of primary data. [2025-09-17T18:29:30.032224] [DEBUG] [LOCAL ] DIAX: Deleted primary data file. [2025-09-17T18:29:30.032272] [INFO ] [MAIN ] DIAX: Starting full primary refresh. [2025-09-17T18:29:30.466886] [INFO ] [REMOTE ] DIAX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:29:30.496093] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T18:29:30.633906] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T18:29:30.815786] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-11. [2025-09-17T18:29:31.615777] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-01. [2025-09-17T18:29:31.714335] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T18:29:32.415791] [INFO ] [REMOTE ] DHT: Fetching primary data for 2024-12. [2025-09-17T18:29:32.657591] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T18:29:33.215811] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-03. [2025-09-17T18:29:34.018593] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2024-12. [2025-09-17T18:29:34.025387] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T18:29:34.815819] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-02. [2025-09-17T18:29:34.883472] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T18:29:34.931660] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T18:29:35.615763] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-04. [2025-09-17T18:29:35.749552] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T18:29:36.415807] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-03. [2025-09-17T18:29:37.215757] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-01. [2025-09-17T18:29:37.483151] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T18:29:37.545508] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T18:29:37.756098] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T18:29:38.015768] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-02. [2025-09-17T18:29:38.777307] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T18:29:38.815747] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-03. [2025-09-17T18:29:39.615799] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-04. [2025-09-17T18:29:39.677483] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T18:29:40.415806] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-04. [2025-09-17T18:29:40.726582] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T18:29:41.011250] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T18:29:41.215791] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-05. [2025-09-17T18:29:42.015772] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-05. [2025-09-17T18:29:42.815814] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-05. [2025-09-17T18:29:42.916466] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T18:29:43.197613] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T18:29:43.615769] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-06. [2025-09-17T18:29:43.769105] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T18:29:44.415778] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-06. [2025-09-17T18:29:45.215841] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-01. [2025-09-17T18:29:45.228975] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T18:29:45.492324] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T18:29:46.015769] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-07. [2025-09-17T18:29:46.815829] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-07. [2025-09-17T18:29:47.143092] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T18:29:47.587041] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T18:29:47.617357] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-06. [2025-09-17T18:29:47.623799] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T18:29:48.415811] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-08. [2025-09-17T18:29:48.473800] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T18:29:49.044328] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T18:29:49.215864] [INFO ] [REMOTE ] DHX: Fetching primary data for 2025-09. [2025-09-17T18:29:50.015798] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-07. [2025-09-17T18:29:50.212947] [INFO ] [REMOTE ] DHX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T18:29:50.216556] [INFO ] [REMOTE ] DHX: Full fetch complete (20861 records). [2025-09-17T18:29:50.216699] [DEBUG] [VALIDATOR ] DHX: Validating primary data. [2025-09-17T18:29:50.594569] [DEBUG] [VALIDATOR ] DHX: All expected trading days are present. [2025-09-17T18:29:50.594681] [DEBUG] [VALIDATOR ] DHX: Primary data validation passed. [2025-09-17T18:29:50.595209] [INFO ] [MAIN ] DHX: Fetched primary data is valid. [2025-09-17T18:29:50.595255] [DEBUG] [LOCAL ] DHX: Saving primary data. [2025-09-17T18:29:50.595986] [DEBUG] [LOCAL ] DHX: Trimmed 20861 records to 13221 (keeping 200 days of data) [2025-09-17T18:29:50.673406] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T18:29:50.684405] [DEBUG] [LOCAL ] DHX: Primary data saved (13221 records). [2025-09-17T18:29:50.688199] [INFO ] [MAIN ] DHX: Full history saved. [2025-09-17T18:29:50.688341] [INFO ] [MAIN ] Update Progress: 617/2371 symbols completed. DHX took 22.9s. Estimated remaining: 4h 15m 19s. Rate: 6.9 symbols/min [2025-09-17T18:29:50.830339] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-08. [2025-09-17T18:29:50.861667] [INFO ] [MAIN ] DIN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:29:50.898702] [DEBUG] [LOCAL ] DIN: Loaded 37412 existing records from primary storage. [2025-09-17T18:29:50.898838] [INFO ] [MAIN ] DIN: Loaded 37412 existing records. [2025-09-17T18:29:51.082723] [WARN ] [MAIN ] DIN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:29:51.083007] [INFO ] [MAIN ] DIN: Wiping existing primary data before full refresh. [2025-09-17T18:29:51.083055] [INFO ] [LOCAL ] DIN: Starting deletion of primary data. [2025-09-17T18:29:51.084030] [DEBUG] [LOCAL ] DIN: Deleted primary data file. [2025-09-17T18:29:51.084093] [INFO ] [MAIN ] DIN: Starting full primary refresh. [2025-09-17T18:29:51.443231] [INFO ] [REMOTE ] DIN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:29:51.615778] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-08. [2025-09-17T18:29:51.654755] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T18:29:52.415788] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-02. [2025-09-17T18:29:53.215837] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-11. [2025-09-17T18:29:53.758829] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T18:29:54.015786] [INFO ] [REMOTE ] DIAX: Fetching primary data for 2025-09. [2025-09-17T18:29:54.070993] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T18:29:54.344166] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T18:29:54.815800] [INFO ] [REMOTE ] DIN: Fetching primary data for 2024-12. [2025-09-17T18:29:54.990484] [INFO ] [REMOTE ] DIAX: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T18:29:54.992571] [INFO ] [REMOTE ] DIAX: Full fetch complete (16946 records). [2025-09-17T18:29:54.992659] [DEBUG] [VALIDATOR ] DIAX: Validating primary data. [2025-09-17T18:29:55.393572] [DEBUG] [VALIDATOR ] DIAX: All expected trading days are present. [2025-09-17T18:29:55.393725] [DEBUG] [VALIDATOR ] DIAX: Primary data validation passed. [2025-09-17T18:29:55.394206] [INFO ] [MAIN ] DIAX: Fetched primary data is valid. [2025-09-17T18:29:55.394285] [DEBUG] [LOCAL ] DIAX: Saving primary data. [2025-09-17T18:29:55.395334] [DEBUG] [LOCAL ] DIAX: Trimmed 16946 records to 12293 (keeping 200 days of data) [2025-09-17T18:29:55.470715] [DEBUG] [LOCAL ] DIAX: Primary data saved (12293 records). [2025-09-17T18:29:55.470854] [INFO ] [MAIN ] DIAX: Full history saved. [2025-09-17T18:29:55.470939] [INFO ] [MAIN ] Update Progress: 618/2371 symbols completed. DIAX took 25.8s. Estimated remaining: 4h 14m 59s. Rate: 6.9 symbols/min [2025-09-17T18:29:55.619317] [INFO ] [REMOTE ] DHR: Fetching primary data for 2025-09. [2025-09-17T18:29:55.640969] [INFO ] [MAIN ] DINO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:29:55.695982] [DEBUG] [LOCAL ] DINO: Loaded 52976 existing records from primary storage. [2025-09-17T18:29:55.696124] [INFO ] [MAIN ] DINO: Loaded 52976 existing records. [2025-09-17T18:29:55.873464] [WARN ] [MAIN ] DINO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:29:55.873731] [INFO ] [MAIN ] DINO: Wiping existing primary data before full refresh. [2025-09-17T18:29:55.873782] [INFO ] [LOCAL ] DINO: Starting deletion of primary data. [2025-09-17T18:29:55.874879] [DEBUG] [LOCAL ] DINO: Deleted primary data file. [2025-09-17T18:29:55.874951] [INFO ] [MAIN ] DINO: Starting full primary refresh. [2025-09-17T18:29:56.232134] [INFO ] [REMOTE ] DINO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:29:56.371022] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T18:29:56.415786] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-01. [2025-09-17T18:29:57.220932] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-11. [2025-09-17T18:29:57.231234] [INFO ] [REMOTE ] DHR: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T18:29:57.238517] [INFO ] [REMOTE ] DHR: Full fetch complete (77115 records). [2025-09-17T18:29:57.238660] [DEBUG] [VALIDATOR ] DHR: Validating primary data. [2025-09-17T18:29:57.653024] [DEBUG] [VALIDATOR ] DHR: All expected trading days are present. [2025-09-17T18:29:57.653105] [DEBUG] [VALIDATOR ] DHR: Primary data validation passed. [2025-09-17T18:29:57.653981] [INFO ] [MAIN ] DHR: Fetched primary data is valid. [2025-09-17T18:29:57.654028] [DEBUG] [LOCAL ] DHR: Saving primary data. [2025-09-17T18:29:57.655582] [DEBUG] [LOCAL ] DHR: Trimmed 77115 records to 53371 (keeping 200 days of data) [2025-09-17T18:29:57.990250] [DEBUG] [LOCAL ] DHR: Primary data saved (53371 records). [2025-09-17T18:29:57.990382] [INFO ] [MAIN ] DHR: Full history saved. [2025-09-17T18:29:57.991228] [INFO ] [MAIN ] Update Progress: 619/2371 symbols completed. DHR took 40.8s. Estimated remaining: 4h 14m 33s. Rate: 6.9 symbols/min [2025-09-17T18:29:58.022349] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-03. [2025-09-17T18:29:58.190200] [INFO ] [MAIN ] DIS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:29:58.192697] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T18:29:58.255617] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-17T18:29:58.255775] [INFO ] [MAIN ] DIS: Loaded 53788 existing records. [2025-09-17T18:29:58.444090] [WARN ] [MAIN ] DIS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:29:58.444319] [INFO ] [MAIN ] DIS: Wiping existing primary data before full refresh. [2025-09-17T18:29:58.444388] [INFO ] [LOCAL ] DIS: Starting deletion of primary data. [2025-09-17T18:29:58.445743] [DEBUG] [LOCAL ] DIS: Deleted primary data file. [2025-09-17T18:29:58.445809] [INFO ] [MAIN ] DIS: Starting full primary refresh. [2025-09-17T18:29:58.818222] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-02. [2025-09-17T18:29:58.818144] [INFO ] [REMOTE ] DIS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:29:59.097735] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T18:29:59.615718] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-11. [2025-09-17T18:29:59.794314] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T18:30:00.237884] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T18:30:00.415767] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-04. [2025-09-17T18:30:01.215835] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-03. [2025-09-17T18:30:02.016675] [INFO ] [REMOTE ] DINO: Fetching primary data for 2024-12. [2025-09-17T18:30:02.099076] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-11 (2.48 seconds). [2025-09-17T18:30:02.505789] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T18:30:02.815921] [INFO ] [REMOTE ] DIS: Fetching primary data for 2024-12. [2025-09-17T18:30:02.860034] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T18:30:03.597850] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T18:30:03.615765] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-01. [2025-09-17T18:30:04.415803] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-04. [2025-09-17T18:30:05.174217] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2024-12 (2.36 seconds). [2025-09-17T18:30:05.215785] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-01. [2025-09-17T18:30:05.514007] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T18:30:05.600883] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T18:30:06.015769] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-02. [2025-09-17T18:30:06.815827] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-05. [2025-09-17T18:30:07.365410] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T18:30:07.615752] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-05. [2025-09-17T18:30:07.653099] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T18:30:08.215270] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T18:30:08.415787] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-06. [2025-09-17T18:30:09.084327] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T18:30:09.215789] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-06. [2025-09-17T18:30:09.817020] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T18:30:10.015801] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-07. [2025-09-17T18:30:10.815817] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-03. [2025-09-17T18:30:11.058101] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T18:30:11.407272] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T18:30:11.615803] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-02. [2025-09-17T18:30:12.415753] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-07. [2025-09-17T18:30:12.671438] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T18:30:13.215774] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-04. [2025-09-17T18:30:14.015755] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-08. [2025-09-17T18:30:14.061539] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T18:30:14.099690] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-17T18:30:14.657375] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T18:30:14.815765] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-03. [2025-09-17T18:30:15.210232] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T18:30:15.615774] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-05. [2025-09-17T18:30:16.415789] [INFO ] [REMOTE ] DIN: Fetching primary data for 2025-09. [2025-09-17T18:30:17.201803] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-17T18:30:17.215732] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-04. [2025-09-17T18:30:17.297907] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T18:30:18.015829] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-06. [2025-09-17T18:30:18.037326] [INFO ] [REMOTE ] DIN: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T18:30:18.042484] [INFO ] [REMOTE ] DIN: Full fetch complete (54868 records). [2025-09-17T18:30:18.042605] [DEBUG] [VALIDATOR ] DIN: Validating primary data. [2025-09-17T18:30:18.422459] [DEBUG] [VALIDATOR ] DIN: All expected trading days are present. [2025-09-17T18:30:18.422549] [DEBUG] [VALIDATOR ] DIN: Primary data validation passed. [2025-09-17T18:30:18.423257] [INFO ] [MAIN ] DIN: Fetched primary data is valid. [2025-09-17T18:30:18.423313] [DEBUG] [LOCAL ] DIN: Saving primary data. [2025-09-17T18:30:18.424421] [DEBUG] [LOCAL ] DIN: Trimmed 54868 records to 37411 (keeping 200 days of data) [2025-09-17T18:30:18.651802] [DEBUG] [LOCAL ] DIN: Primary data saved (37411 records). [2025-09-17T18:30:18.651941] [INFO ] [MAIN ] DIN: Full history saved. [2025-09-17T18:30:18.652025] [INFO ] [MAIN ] Update Progress: 620/2371 symbols completed. DIN took 28.0s. Estimated remaining: 4h 14m 58s. Rate: 6.9 symbols/min [2025-09-17T18:30:18.823838] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-08. [2025-09-17T18:30:18.827895] [INFO ] [MAIN ] DIVY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:30:18.828139] [DEBUG] [LOCAL ] DIVY: No existing data file found in primary storage. [2025-09-17T18:30:18.828177] [WARN ] [MAIN ] DIVY: No existing data found, performing full refresh instead. [2025-09-17T18:30:18.828355] [INFO ] [MAIN ] DIVY: Wiping existing primary data before full refresh. [2025-09-17T18:30:18.828396] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-17T18:30:18.828435] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-17T18:30:18.828467] [INFO ] [MAIN ] DIVY: Starting full primary refresh. [2025-09-17T18:30:19.184832] [INFO ] [REMOTE ] DIVY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:30:19.615834] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-11. [2025-09-17T18:30:19.738708] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-04 (2.52 seconds). [2025-09-17T18:30:20.063739] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T18:30:20.232879] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T18:30:20.367247] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-17T18:30:20.415753] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-07. [2025-09-17T18:30:21.215785] [INFO ] [REMOTE ] DHT: Fetching primary data for 2025-09. [2025-09-17T18:30:22.015779] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2024-12. [2025-09-17T18:30:22.090773] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T18:30:22.384181] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2024-12 (0.37 seconds). [2025-09-17T18:30:22.815770] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-08. [2025-09-17T18:30:22.994694] [INFO ] [REMOTE ] DHT: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T18:30:23.003274] [INFO ] [REMOTE ] DHT: Full fetch complete (70061 records). [2025-09-17T18:30:23.003455] [DEBUG] [VALIDATOR ] DHT: Validating primary data. [2025-09-17T18:30:23.412111] [DEBUG] [VALIDATOR ] DHT: All expected trading days are present. [2025-09-17T18:30:23.412207] [DEBUG] [VALIDATOR ] DHT: Primary data validation passed. [2025-09-17T18:30:23.413283] [INFO ] [MAIN ] DHT: Fetched primary data is valid. [2025-09-17T18:30:23.413337] [DEBUG] [LOCAL ] DHT: Saving primary data. [2025-09-17T18:30:23.415541] [DEBUG] [LOCAL ] DHT: Trimmed 70061 records to 48062 (keeping 200 days of data) [2025-09-17T18:30:23.627320] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-05. [2025-09-17T18:30:23.709913] [DEBUG] [LOCAL ] DHT: Primary data saved (48062 records). [2025-09-17T18:30:23.710053] [INFO ] [MAIN ] DHT: Full history saved. [2025-09-17T18:30:23.710741] [INFO ] [MAIN ] Update Progress: 621/2371 symbols completed. DHT took 58.4s. Estimated remaining: 4h 14m 39s. Rate: 6.9 symbols/min [2025-09-17T18:30:23.880845] [INFO ] [MAIN ] DK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:30:23.930485] [DEBUG] [LOCAL ] DK: Loaded 49528 existing records from primary storage. [2025-09-17T18:30:23.930677] [INFO ] [MAIN ] DK: Loaded 49528 existing records. [2025-09-17T18:30:24.112948] [WARN ] [MAIN ] DK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:30:24.113181] [INFO ] [MAIN ] DK: Wiping existing primary data before full refresh. [2025-09-17T18:30:24.113233] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-17T18:30:24.114174] [DEBUG] [LOCAL ] DK: Deleted primary data file. [2025-09-17T18:30:24.114224] [INFO ] [MAIN ] DK: Starting full primary refresh. [2025-09-17T18:30:24.421026] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-01. [2025-09-17T18:30:24.487219] [INFO ] [REMOTE ] DK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:30:24.606998] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T18:30:24.899955] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T18:30:25.215783] [INFO ] [REMOTE ] DINO: Fetching primary data for 2025-09. [2025-09-17T18:30:26.015701] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-11. [2025-09-17T18:30:26.056403] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-17T18:30:26.815782] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-06. [2025-09-17T18:30:26.868301] [INFO ] [REMOTE ] DINO: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T18:30:26.876031] [INFO ] [REMOTE ] DINO: Full fetch complete (76475 records). [2025-09-17T18:30:26.876155] [DEBUG] [VALIDATOR ] DINO: Validating primary data. [2025-09-17T18:30:27.274237] [DEBUG] [VALIDATOR ] DINO: All expected trading days are present. [2025-09-17T18:30:27.274321] [DEBUG] [VALIDATOR ] DINO: Primary data validation passed. [2025-09-17T18:30:27.275159] [INFO ] [MAIN ] DINO: Fetched primary data is valid. [2025-09-17T18:30:27.275203] [DEBUG] [LOCAL ] DINO: Saving primary data. [2025-09-17T18:30:27.276629] [DEBUG] [LOCAL ] DINO: Trimmed 76475 records to 52974 (keeping 200 days of data) [2025-09-17T18:30:27.616893] [DEBUG] [LOCAL ] DINO: Primary data saved (52974 records). [2025-09-17T18:30:27.617091] [INFO ] [MAIN ] DINO: Full history saved. [2025-09-17T18:30:27.617816] [INFO ] [MAIN ] Update Progress: 622/2371 symbols completed. DINO took 32.1s. Estimated remaining: 4h 14m 17s. Rate: 6.9 symbols/min [2025-09-17T18:30:27.616734] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-02. [2025-09-17T18:30:27.799088] [INFO ] [MAIN ] DKL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:30:27.831684] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T18:30:27.855625] [DEBUG] [LOCAL ] DKL: Loaded 19633 existing records from primary storage. [2025-09-17T18:30:27.855775] [INFO ] [MAIN ] DKL: Loaded 19633 existing records. [2025-09-17T18:30:28.050877] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T18:30:28.054770] [WARN ] [MAIN ] DKL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:30:28.056270] [INFO ] [MAIN ] DKL: Wiping existing primary data before full refresh. [2025-09-17T18:30:28.056319] [INFO ] [LOCAL ] DKL: Starting deletion of primary data. [2025-09-17T18:30:28.056839] [DEBUG] [LOCAL ] DKL: Deleted primary data file. [2025-09-17T18:30:28.056887] [INFO ] [MAIN ] DKL: Starting full primary refresh. [2025-09-17T18:30:28.424326] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-03. [2025-09-17T18:30:28.436731] [INFO ] [REMOTE ] DKL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:30:28.874252] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T18:30:29.125061] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-17T18:30:29.215792] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-04. [2025-09-17T18:30:29.563581] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-17T18:30:30.015767] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-05. [2025-09-17T18:30:30.514935] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T18:30:30.815796] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-06. [2025-09-17T18:30:31.090820] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-06 (0.28 seconds). [2025-09-17T18:30:31.615777] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-07. [2025-09-17T18:30:32.415799] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-07. [2025-09-17T18:30:32.766523] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T18:30:33.215800] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-11. [2025-09-17T18:30:34.026587] [INFO ] [REMOTE ] DK: Fetching primary data for 2024-12. [2025-09-17T18:30:34.048098] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-17T18:30:34.476930] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T18:30:34.815780] [INFO ] [REMOTE ] DKL: Fetching primary data for 2024-12. [2025-09-17T18:30:35.615780] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-08. [2025-09-17T18:30:35.708246] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T18:30:35.923110] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-17T18:30:35.924436] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T18:30:36.415828] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-08. [2025-09-17T18:30:37.215835] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-01. [2025-09-17T18:30:38.015818] [INFO ] [REMOTE ] DIVY: Fetching primary data for 2025-09. [2025-09-17T18:30:38.446014] [INFO ] [REMOTE ] DIVY: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T18:30:38.446762] [INFO ] [REMOTE ] DIVY: Full fetch complete (1728 records). [2025-09-17T18:30:38.446829] [DEBUG] [VALIDATOR ] DIVY: Validating primary data. [2025-09-17T18:30:38.630041] [WARN ] [VALIDATOR ] DIVY: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T18:30:38.630464] [FATAL] [MAIN ] DIVY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:30:38.630691] [WARN ] [MAIN ] DIVY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:30:38.630867] [INFO ] [LOCAL ] DIVY: Starting deletion of primary data. [2025-09-17T18:30:38.631071] [DEBUG] [LOCAL ] DIVY: No primary data file found to delete. [2025-09-17T18:30:38.631125] [INFO ] [LOCAL ] DIVY: Starting deletion of derivative data. [2025-09-17T18:30:38.631174] [DEBUG] [LOCAL ] DIVY: No derivative data file found to delete. [2025-09-17T18:30:38.631238] [INFO ] [MAIN ] Update Progress: 623/2371 symbols completed. DIVY took 20.0s. Estimated remaining: 4h 14m 14s. Rate: 6.9 symbols/min [2025-09-17T18:30:38.810935] [INFO ] [MAIN ] DKS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:30:38.822071] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-01. [2025-09-17T18:30:38.841602] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T18:30:38.884157] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-17T18:30:38.940496] [DEBUG] [LOCAL ] DKS: Loaded 50024 existing records from primary storage. [2025-09-17T18:30:38.940761] [INFO ] [MAIN ] DKS: Loaded 50024 existing records. [2025-09-17T18:30:39.128224] [WARN ] [MAIN ] DKS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:30:39.128492] [INFO ] [MAIN ] DKS: Wiping existing primary data before full refresh. [2025-09-17T18:30:39.128539] [INFO ] [LOCAL ] DKS: Starting deletion of primary data. [2025-09-17T18:30:39.129637] [DEBUG] [LOCAL ] DKS: Deleted primary data file. [2025-09-17T18:30:39.129721] [INFO ] [MAIN ] DKS: Starting full primary refresh. [2025-09-17T18:30:39.534816] [INFO ] [REMOTE ] DKS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:30:39.615789] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-11. [2025-09-17T18:30:39.888495] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T18:30:40.415829] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-02. [2025-09-17T18:30:41.215805] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-02. [2025-09-17T18:30:41.463080] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T18:30:41.983712] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T18:30:42.015755] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-03. [2025-09-17T18:30:42.348533] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T18:30:42.815811] [INFO ] [REMOTE ] DIS: Fetching primary data for 2025-09. [2025-09-17T18:30:43.378897] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T18:30:43.615778] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-04. [2025-09-17T18:30:44.415843] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-03. [2025-09-17T18:30:44.748237] [INFO ] [REMOTE ] DIS: Incremental fetch complete for 2025-09 (1.93 seconds). [2025-09-17T18:30:44.755504] [INFO ] [REMOTE ] DIS: Full fetch complete (77937 records). [2025-09-17T18:30:44.755710] [DEBUG] [VALIDATOR ] DIS: Validating primary data. [2025-09-17T18:30:45.156306] [DEBUG] [VALIDATOR ] DIS: All expected trading days are present. [2025-09-17T18:30:45.156412] [DEBUG] [VALIDATOR ] DIS: Primary data validation passed. [2025-09-17T18:30:45.157501] [INFO ] [MAIN ] DIS: Fetched primary data is valid. [2025-09-17T18:30:45.167971] [DEBUG] [LOCAL ] DIS: Saving primary data. [2025-09-17T18:30:45.189001] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T18:30:45.199019] [DEBUG] [LOCAL ] DIS: Trimmed 77937 records to 53788 (keeping 200 days of data) [2025-09-17T18:30:45.258536] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-05. [2025-09-17T18:30:45.540801] [DEBUG] [LOCAL ] DIS: Primary data saved (53788 records). [2025-09-17T18:30:45.540959] [INFO ] [MAIN ] DIS: Full history saved. [2025-09-17T18:30:45.542938] [INFO ] [MAIN ] Update Progress: 624/2371 symbols completed. DIS took 47.6s. Estimated remaining: 4h 14m 0s. Rate: 6.9 symbols/min [2025-09-17T18:30:45.714102] [INFO ] [MAIN ] DLB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:30:45.731295] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T18:30:45.766199] [DEBUG] [LOCAL ] DLB: Loaded 32255 existing records from primary storage. [2025-09-17T18:30:45.766341] [INFO ] [MAIN ] DLB: Loaded 32255 existing records. [2025-09-17T18:30:45.946406] [WARN ] [MAIN ] DLB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:30:45.946691] [INFO ] [MAIN ] DLB: Wiping existing primary data before full refresh. [2025-09-17T18:30:45.946738] [INFO ] [LOCAL ] DLB: Starting deletion of primary data. [2025-09-17T18:30:45.947669] [DEBUG] [LOCAL ] DLB: Deleted primary data file. [2025-09-17T18:30:45.947720] [INFO ] [MAIN ] DLB: Starting full primary refresh. [2025-09-17T18:30:46.021581] [INFO ] [REMOTE ] DKS: Fetching primary data for 2024-12. [2025-09-17T18:30:46.310506] [INFO ] [REMOTE ] DLB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:30:46.815801] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-11. [2025-09-17T18:30:47.031334] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T18:30:47.615785] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-04. [2025-09-17T18:30:48.018388] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T18:30:48.076950] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-17T18:30:48.415808] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-06. [2025-09-17T18:30:48.604792] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T18:30:49.215842] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-01. [2025-09-17T18:30:50.015786] [INFO ] [REMOTE ] DLB: Fetching primary data for 2024-12. [2025-09-17T18:30:50.556451] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-17T18:30:50.815796] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-05. [2025-09-17T18:30:50.894447] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T18:30:51.483182] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T18:30:51.615775] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-07. [2025-09-17T18:30:51.949226] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T18:30:52.415780] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-06. [2025-09-17T18:30:53.215810] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-02. [2025-09-17T18:30:53.290849] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T18:30:53.331540] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T18:30:54.015773] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-07. [2025-09-17T18:30:54.815852] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-01. [2025-09-17T18:30:54.889726] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T18:30:54.950787] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T18:30:55.615775] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-08. [2025-09-17T18:30:56.247151] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T18:30:56.415796] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-02. [2025-09-17T18:30:56.909982] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T18:30:57.215785] [INFO ] [REMOTE ] DKL: Fetching primary data for 2025-09. [2025-09-17T18:30:57.485405] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T18:30:58.015763] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-03. [2025-09-17T18:30:58.213360] [INFO ] [REMOTE ] DKL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T18:30:58.215914] [INFO ] [REMOTE ] DKL: Full fetch complete (29757 records). [2025-09-17T18:30:58.216027] [DEBUG] [VALIDATOR ] DKL: Validating primary data. [2025-09-17T18:30:58.641469] [DEBUG] [VALIDATOR ] DKL: All expected trading days are present. [2025-09-17T18:30:58.641552] [DEBUG] [VALIDATOR ] DKL: Primary data validation passed. [2025-09-17T18:30:58.642043] [INFO ] [MAIN ] DKL: Fetched primary data is valid. [2025-09-17T18:30:58.642086] [DEBUG] [LOCAL ] DKL: Saving primary data. [2025-09-17T18:30:58.642867] [DEBUG] [LOCAL ] DKL: Trimmed 29757 records to 19568 (keeping 200 days of data) [2025-09-17T18:30:58.762540] [DEBUG] [LOCAL ] DKL: Primary data saved (19568 records). [2025-09-17T18:30:58.762703] [INFO ] [MAIN ] DKL: Full history saved. [2025-09-17T18:30:58.762870] [INFO ] [MAIN ] Update Progress: 625/2371 symbols completed. DKL took 31.1s. Estimated remaining: 4h 14m 4s. Rate: 6.9 symbols/min [2025-09-17T18:30:58.827158] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-08. [2025-09-17T18:30:58.949685] [INFO ] [MAIN ] DLNG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:30:58.957583] [DEBUG] [LOCAL ] DLNG: Loaded 6341 existing records from primary storage. [2025-09-17T18:30:58.957712] [INFO ] [MAIN ] DLNG: Loaded 6341 existing records. [2025-09-17T18:30:59.154378] [WARN ] [MAIN ] DLNG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:30:59.154628] [INFO ] [MAIN ] DLNG: Wiping existing primary data before full refresh. [2025-09-17T18:30:59.154694] [INFO ] [LOCAL ] DLNG: Starting deletion of primary data. [2025-09-17T18:30:59.154958] [DEBUG] [LOCAL ] DLNG: Deleted primary data file. [2025-09-17T18:30:59.155001] [INFO ] [MAIN ] DLNG: Starting full primary refresh. [2025-09-17T18:30:59.527783] [INFO ] [REMOTE ] DLNG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:30:59.615831] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-11. [2025-09-17T18:30:59.940639] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T18:31:00.415779] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-04. [2025-09-17T18:31:00.553218] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T18:31:00.598453] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T18:31:01.215778] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2024-12. [2025-09-17T18:31:02.016625] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-03. [2025-09-17T18:31:02.018279] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T18:31:02.289430] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T18:31:02.815809] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-05. [2025-09-17T18:31:03.615788] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-01. [2025-09-17T18:31:03.723768] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T18:31:04.415781] [INFO ] [REMOTE ] DK: Fetching primary data for 2025-09. [2025-09-17T18:31:04.715417] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T18:31:04.753509] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T18:31:05.215812] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-04. [2025-09-17T18:31:06.015800] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-02. [2025-09-17T18:31:06.408632] [INFO ] [REMOTE ] DK: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-17T18:31:06.415132] [INFO ] [REMOTE ] DK: Full fetch complete (70047 records). [2025-09-17T18:31:06.415247] [DEBUG] [VALIDATOR ] DK: Validating primary data. [2025-09-17T18:31:06.416040] [FATAL] [VALIDATOR ] DK: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:31:06.416123] [FATAL] [MAIN ] DK: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:31:06.416160] [WARN ] [MAIN ] DK: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:31:06.416203] [INFO ] [LOCAL ] DK: Starting deletion of primary data. [2025-09-17T18:31:06.416273] [DEBUG] [LOCAL ] DK: No primary data file found to delete. [2025-09-17T18:31:06.416310] [INFO ] [LOCAL ] DK: Starting deletion of derivative data. [2025-09-17T18:31:06.416629] [DEBUG] [LOCAL ] DK: Deleted derivative data file. [2025-09-17T18:31:06.417755] [INFO ] [MAIN ] Update Progress: 626/2371 symbols completed. DK took 42.7s. Estimated remaining: 4h 13m 53s. Rate: 6.9 symbols/min [2025-09-17T18:31:06.591344] [INFO ] [MAIN ] DLR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:31:06.650577] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T18:31:06.674354] [DEBUG] [LOCAL ] DLR: Loaded 51267 existing records from primary storage. [2025-09-17T18:31:06.674490] [INFO ] [MAIN ] DLR: Loaded 51267 existing records. [2025-09-17T18:31:06.820189] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-06. [2025-09-17T18:31:06.855208] [WARN ] [MAIN ] DLR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:31:06.855453] [INFO ] [MAIN ] DLR: Wiping existing primary data before full refresh. [2025-09-17T18:31:06.855498] [INFO ] [LOCAL ] DLR: Starting deletion of primary data. [2025-09-17T18:31:06.856635] [DEBUG] [LOCAL ] DLR: Deleted primary data file. [2025-09-17T18:31:06.856709] [INFO ] [MAIN ] DLR: Starting full primary refresh. [2025-09-17T18:31:07.020274] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T18:31:07.241905] [INFO ] [REMOTE ] DLR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:31:07.615790] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-11. [2025-09-17T18:31:08.415788] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-03. [2025-09-17T18:31:08.613337] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T18:31:09.215796] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-05. [2025-09-17T18:31:09.360768] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T18:31:09.388746] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T18:31:10.015773] [INFO ] [REMOTE ] DLR: Fetching primary data for 2024-12. [2025-09-17T18:31:10.815780] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-07. [2025-09-17T18:31:10.879758] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T18:31:11.615778] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-06. [2025-09-17T18:31:11.904028] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T18:31:12.415768] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-01. [2025-09-17T18:31:12.527715] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T18:31:12.686123] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T18:31:13.215845] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-07. [2025-09-17T18:31:13.873601] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T18:31:14.015772] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-08. [2025-09-17T18:31:14.743050] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T18:31:14.815762] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-02. [2025-09-17T18:31:15.615770] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-08. [2025-09-17T18:31:15.771887] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T18:31:16.341773] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T18:31:16.415761] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-03. [2025-09-17T18:31:17.071236] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T18:31:17.215801] [INFO ] [REMOTE ] DKS: Fetching primary data for 2025-09. [2025-09-17T18:31:17.876220] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T18:31:18.015764] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-04. [2025-09-17T18:31:18.815738] [INFO ] [REMOTE ] DLB: Fetching primary data for 2025-09. [2025-09-17T18:31:18.867915] [INFO ] [REMOTE ] DKS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T18:31:18.875870] [INFO ] [REMOTE ] DKS: Full fetch complete (71512 records). [2025-09-17T18:31:18.876067] [DEBUG] [VALIDATOR ] DKS: Validating primary data. [2025-09-17T18:31:19.261918] [DEBUG] [VALIDATOR ] DKS: All expected trading days are present. [2025-09-17T18:31:19.261998] [DEBUG] [VALIDATOR ] DKS: Primary data validation passed. [2025-09-17T18:31:19.262794] [INFO ] [MAIN ] DKS: Fetched primary data is valid. [2025-09-17T18:31:19.262843] [DEBUG] [LOCAL ] DKS: Saving primary data. [2025-09-17T18:31:19.264532] [DEBUG] [LOCAL ] DKS: Trimmed 71512 records to 49985 (keeping 200 days of data) [2025-09-17T18:31:19.596899] [DEBUG] [LOCAL ] DKS: Primary data saved (49985 records). [2025-09-17T18:31:19.597053] [INFO ] [MAIN ] DKS: Full history saved. [2025-09-17T18:31:19.597152] [INFO ] [MAIN ] Update Progress: 627/2371 symbols completed. DKS took 41.0s. Estimated remaining: 4h 13m 56s. Rate: 6.9 symbols/min [2025-09-17T18:31:19.630676] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-04. [2025-09-17T18:31:19.777485] [INFO ] [MAIN ] DLX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:31:19.807076] [DEBUG] [LOCAL ] DLX: Loaded 29367 existing records from primary storage. [2025-09-17T18:31:19.807237] [INFO ] [MAIN ] DLX: Loaded 29367 existing records. [2025-09-17T18:31:19.991934] [WARN ] [MAIN ] DLX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:31:19.992367] [INFO ] [MAIN ] DLX: Wiping existing primary data before full refresh. [2025-09-17T18:31:19.992453] [INFO ] [LOCAL ] DLX: Starting deletion of primary data. [2025-09-17T18:31:20.004931] [DEBUG] [LOCAL ] DLX: Deleted primary data file. [2025-09-17T18:31:20.005035] [INFO ] [MAIN ] DLX: Starting full primary refresh. [2025-09-17T18:31:20.004833] [INFO ] [REMOTE ] DLB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T18:31:20.048989] [INFO ] [REMOTE ] DLB: Full fetch complete (46901 records). [2025-09-17T18:31:20.078726] [DEBUG] [VALIDATOR ] DLB: Validating primary data. [2025-09-17T18:31:20.357972] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-04 (2.34 seconds). [2025-09-17T18:31:20.482535] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-05. [2025-09-17T18:31:20.492186] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T18:31:20.757155] [INFO ] [REMOTE ] DLX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:31:20.847959] [DEBUG] [VALIDATOR ] DLB: All expected trading days are present. [2025-09-17T18:31:20.848087] [DEBUG] [VALIDATOR ] DLB: Primary data validation passed. [2025-09-17T18:31:20.848810] [INFO ] [MAIN ] DLB: Fetched primary data is valid. [2025-09-17T18:31:20.848860] [DEBUG] [LOCAL ] DLB: Saving primary data. [2025-09-17T18:31:20.850149] [DEBUG] [LOCAL ] DLB: Trimmed 46901 records to 32282 (keeping 200 days of data) [2025-09-17T18:31:21.062906] [DEBUG] [LOCAL ] DLB: Primary data saved (32282 records). [2025-09-17T18:31:21.063193] [INFO ] [MAIN ] DLB: Full history saved. [2025-09-17T18:31:21.063295] [INFO ] [MAIN ] Update Progress: 628/2371 symbols completed. DLB took 35.5s. Estimated remaining: 4h 13m 27s. Rate: 6.9 symbols/min [2025-09-17T18:31:21.230227] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-11. [2025-09-17T18:31:21.232496] [INFO ] [MAIN ] DLY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:31:21.253169] [DEBUG] [LOCAL ] DLY: Loaded 19079 existing records from primary storage. [2025-09-17T18:31:21.253289] [INFO ] [MAIN ] DLY: Loaded 19079 existing records. [2025-09-17T18:31:21.431430] [WARN ] [MAIN ] DLY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:31:21.431700] [INFO ] [MAIN ] DLY: Wiping existing primary data before full refresh. [2025-09-17T18:31:21.431748] [INFO ] [LOCAL ] DLY: Starting deletion of primary data. [2025-09-17T18:31:21.432480] [DEBUG] [LOCAL ] DLY: Deleted primary data file. [2025-09-17T18:31:21.432545] [INFO ] [MAIN ] DLY: Starting full primary refresh. [2025-09-17T18:31:21.794417] [INFO ] [REMOTE ] DLY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:31:22.015762] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-05. [2025-09-17T18:31:22.521413] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-17T18:31:22.663409] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T18:31:22.724466] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T18:31:22.815744] [INFO ] [REMOTE ] DLX: Fetching primary data for 2024-12. [2025-09-17T18:31:23.615787] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-11. [2025-09-17T18:31:23.968799] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T18:31:24.415798] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-06. [2025-09-17T18:31:24.542426] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T18:31:25.013563] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T18:31:25.215784] [INFO ] [REMOTE ] DLY: Fetching primary data for 2024-12. [2025-09-17T18:31:26.015765] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-07. [2025-09-17T18:31:26.435709] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T18:31:26.442297] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T18:31:26.815778] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-08. [2025-09-17T18:31:27.391548] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T18:31:27.615779] [INFO ] [REMOTE ] DLNG: Fetching primary data for 2025-09. [2025-09-17T18:31:28.350961] [INFO ] [REMOTE ] DLNG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T18:31:28.352187] [INFO ] [REMOTE ] DLNG: Full fetch complete (12138 records). [2025-09-17T18:31:28.352255] [DEBUG] [VALIDATOR ] DLNG: Validating primary data. [2025-09-17T18:31:28.420918] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-01. [2025-09-17T18:31:28.712223] [DEBUG] [VALIDATOR ] DLNG: All expected trading days are present. [2025-09-17T18:31:28.712300] [DEBUG] [VALIDATOR ] DLNG: Primary data validation passed. [2025-09-17T18:31:28.712571] [INFO ] [MAIN ] DLNG: Fetched primary data is valid. [2025-09-17T18:31:28.712612] [DEBUG] [LOCAL ] DLNG: Saving primary data. [2025-09-17T18:31:28.713065] [DEBUG] [LOCAL ] DLNG: Trimmed 12138 records to 6311 (keeping 200 days of data) [2025-09-17T18:31:28.752864] [DEBUG] [LOCAL ] DLNG: Primary data saved (6311 records). [2025-09-17T18:31:28.752987] [INFO ] [MAIN ] DLNG: Full history saved. [2025-09-17T18:31:28.753087] [INFO ] [MAIN ] Update Progress: 629/2371 symbols completed. DLNG took 30.0s. Estimated remaining: 4h 13m 16s. Rate: 6.9 symbols/min [2025-09-17T18:31:28.925611] [INFO ] [MAIN ] DMA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:31:28.931347] [DEBUG] [LOCAL ] DMA: Loaded 4541 existing records from primary storage. [2025-09-17T18:31:28.931447] [INFO ] [MAIN ] DMA: Loaded 4541 existing records. [2025-09-17T18:31:29.108421] [WARN ] [MAIN ] DMA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:31:29.108694] [INFO ] [MAIN ] DMA: Wiping existing primary data before full refresh. [2025-09-17T18:31:29.108751] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-17T18:31:29.109000] [DEBUG] [LOCAL ] DMA: Deleted primary data file. [2025-09-17T18:31:29.109072] [INFO ] [MAIN ] DMA: Starting full primary refresh. [2025-09-17T18:31:29.220878] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-06. [2025-09-17T18:31:29.469907] [INFO ] [REMOTE ] DMA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:31:29.588804] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T18:31:30.015788] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-11. [2025-09-17T18:31:30.617970] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T18:31:30.815796] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-02. [2025-09-17T18:31:31.279168] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T18:31:31.615793] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-07. [2025-09-17T18:31:32.328704] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T18:31:32.415827] [INFO ] [REMOTE ] DMA: Fetching primary data for 2024-12. [2025-09-17T18:31:33.003381] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T18:31:33.215788] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-01. [2025-09-17T18:31:33.657364] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T18:31:33.762775] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T18:31:34.015784] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-03. [2025-09-17T18:31:34.815820] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-08. [2025-09-17T18:31:35.433189] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T18:31:35.615794] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-04. [2025-09-17T18:31:36.264549] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T18:31:36.415823] [INFO ] [REMOTE ] DLR: Fetching primary data for 2025-09. [2025-09-17T18:31:37.089327] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T18:31:37.215782] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-05. [2025-09-17T18:31:37.901391] [INFO ] [REMOTE ] DLR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T18:31:37.908453] [INFO ] [REMOTE ] DLR: Full fetch complete (74141 records). [2025-09-17T18:31:37.908630] [DEBUG] [VALIDATOR ] DLR: Validating primary data. [2025-09-17T18:31:38.020860] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-01. [2025-09-17T18:31:38.324229] [DEBUG] [VALIDATOR ] DLR: All expected trading days are present. [2025-09-17T18:31:38.324327] [DEBUG] [VALIDATOR ] DLR: Primary data validation passed. [2025-09-17T18:31:38.325184] [INFO ] [MAIN ] DLR: Fetched primary data is valid. [2025-09-17T18:31:38.325239] [DEBUG] [LOCAL ] DLR: Saving primary data. [2025-09-17T18:31:38.326799] [DEBUG] [LOCAL ] DLR: Trimmed 74141 records to 51265 (keeping 200 days of data) [2025-09-17T18:31:38.587380] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T18:31:38.702815] [DEBUG] [LOCAL ] DLR: Primary data saved (51265 records). [2025-09-17T18:31:38.702968] [INFO ] [MAIN ] DLR: Full history saved. [2025-09-17T18:31:38.707135] [INFO ] [MAIN ] Update Progress: 630/2371 symbols completed. DLR took 32.3s. Estimated remaining: 4h 13m 10s. Rate: 6.9 symbols/min [2025-09-17T18:31:38.820965] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-06. [2025-09-17T18:31:38.885264] [INFO ] [MAIN ] DMB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:31:38.900067] [DEBUG] [LOCAL ] DMB: Loaded 10037 existing records from primary storage. [2025-09-17T18:31:38.900213] [INFO ] [MAIN ] DMB: Loaded 10037 existing records. [2025-09-17T18:31:39.050916] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T18:31:39.108886] [WARN ] [MAIN ] DMB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:31:39.109126] [INFO ] [MAIN ] DMB: Wiping existing primary data before full refresh. [2025-09-17T18:31:39.109172] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-17T18:31:39.109504] [DEBUG] [LOCAL ] DMB: Deleted primary data file. [2025-09-17T18:31:39.109548] [INFO ] [MAIN ] DMB: Starting full primary refresh. [2025-09-17T18:31:39.460994] [INFO ] [REMOTE ] DMB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:31:39.615798] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-11. [2025-09-17T18:31:40.421015] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-02. [2025-09-17T18:31:40.424618] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T18:31:40.575848] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T18:31:41.215836] [INFO ] [REMOTE ] DMB: Fetching primary data for 2024-12. [2025-09-17T18:31:41.361771] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T18:31:42.008076] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T18:31:42.015726] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-07. [2025-09-17T18:31:42.815803] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-01. [2025-09-17T18:31:43.296107] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T18:31:43.615769] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-08. [2025-09-17T18:31:43.737559] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T18:31:44.415809] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-03. [2025-09-17T18:31:44.802099] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T18:31:45.215789] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-02. [2025-09-17T18:31:45.466730] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T18:31:45.915457] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T18:31:46.015787] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-04. [2025-09-17T18:31:46.815821] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-02. [2025-09-17T18:31:47.082224] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T18:31:47.576913] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T18:31:47.615935] [INFO ] [REMOTE ] DLX: Fetching primary data for 2025-09. [2025-09-17T18:31:48.415830] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-03. [2025-09-17T18:31:48.898585] [INFO ] [REMOTE ] DLX: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T18:31:48.902322] [INFO ] [REMOTE ] DLX: Full fetch complete (41016 records). [2025-09-17T18:31:48.902415] [DEBUG] [VALIDATOR ] DLX: Validating primary data. [2025-09-17T18:31:49.138272] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T18:31:49.220913] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-03. [2025-09-17T18:31:49.307455] [DEBUG] [VALIDATOR ] DLX: All expected trading days are present. [2025-09-17T18:31:49.307597] [DEBUG] [VALIDATOR ] DLX: Primary data validation passed. [2025-09-17T18:31:49.308191] [INFO ] [MAIN ] DLX: Fetched primary data is valid. [2025-09-17T18:31:49.308283] [DEBUG] [LOCAL ] DLX: Saving primary data. [2025-09-17T18:31:49.309353] [DEBUG] [LOCAL ] DLX: Trimmed 41016 records to 29317 (keeping 200 days of data) [2025-09-17T18:31:49.498000] [DEBUG] [LOCAL ] DLX: Primary data saved (29317 records). [2025-09-17T18:31:49.498155] [INFO ] [MAIN ] DLX: Full history saved. [2025-09-17T18:31:49.498252] [INFO ] [MAIN ] Update Progress: 631/2371 symbols completed. DLX took 29.9s. Estimated remaining: 4h 13m 7s. Rate: 6.9 symbols/min [2025-09-17T18:31:49.707142] [INFO ] [MAIN ] DMO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:31:49.707342] [DEBUG] [LOCAL ] DMO: No existing data file found in primary storage. [2025-09-17T18:31:49.707380] [WARN ] [MAIN ] DMO: No existing data found, performing full refresh instead. [2025-09-17T18:31:49.707503] [INFO ] [MAIN ] DMO: Wiping existing primary data before full refresh. [2025-09-17T18:31:49.707542] [INFO ] [LOCAL ] DMO: Starting deletion of primary data. [2025-09-17T18:31:49.707585] [DEBUG] [LOCAL ] DMO: No primary data file found to delete. [2025-09-17T18:31:49.707619] [INFO ] [MAIN ] DMO: Starting full primary refresh. [2025-09-17T18:31:50.020999] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-04. [2025-09-17T18:31:50.068463] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T18:31:50.128275] [INFO ] [REMOTE ] DMO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:31:50.680390] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T18:31:50.815885] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-04. [2025-09-17T18:31:51.420797] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T18:31:51.615815] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-11. [2025-09-17T18:31:52.244087] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T18:31:52.415782] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-05. [2025-09-17T18:31:53.215685] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-05. [2025-09-17T18:31:53.355130] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T18:31:54.015781] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-06. [2025-09-17T18:31:54.184412] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T18:31:54.815780] [INFO ] [REMOTE ] DMO: Fetching primary data for 2024-12. [2025-09-17T18:31:54.986139] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T18:31:55.615799] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-06. [2025-09-17T18:31:55.704867] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T18:31:56.143231] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T18:31:56.415777] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-07. [2025-09-17T18:31:57.215858] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-01. [2025-09-17T18:31:57.282819] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T18:31:58.014348] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T18:31:58.017092] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-08. [2025-09-17T18:31:58.815791] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-02. [2025-09-17T18:31:58.862867] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T18:31:59.604920] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T18:31:59.615720] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-03. [2025-09-17T18:32:00.415800] [INFO ] [REMOTE ] DMB: Fetching primary data for 2025-09. [2025-09-17T18:32:00.458821] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T18:32:01.215808] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-05. [2025-09-17T18:32:01.891447] [INFO ] [REMOTE ] DMB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T18:32:01.894432] [INFO ] [REMOTE ] DMB: Full fetch complete (14850 records). [2025-09-17T18:32:01.894530] [DEBUG] [VALIDATOR ] DMB: Validating primary data. [2025-09-17T18:32:01.895164] [FATAL] [VALIDATOR ] DMB: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:32:01.895260] [FATAL] [MAIN ] DMB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:32:01.895313] [WARN ] [MAIN ] DMB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:32:01.895388] [INFO ] [LOCAL ] DMB: Starting deletion of primary data. [2025-09-17T18:32:01.895466] [DEBUG] [LOCAL ] DMB: No primary data file found to delete. [2025-09-17T18:32:01.895516] [INFO ] [LOCAL ] DMB: Starting deletion of derivative data. [2025-09-17T18:32:01.895935] [DEBUG] [LOCAL ] DMB: Deleted derivative data file. [2025-09-17T18:32:01.896056] [INFO ] [MAIN ] Update Progress: 632/2371 symbols completed. DMB took 23.2s. Estimated remaining: 4h 13m 9s. Rate: 6.9 symbols/min [2025-09-17T18:32:02.020338] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-04. [2025-09-17T18:32:02.045368] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T18:32:02.079962] [INFO ] [MAIN ] DNA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:32:02.131411] [DEBUG] [LOCAL ] DNA: Loaded 48560 existing records from primary storage. [2025-09-17T18:32:02.131587] [INFO ] [MAIN ] DNA: Loaded 48560 existing records. [2025-09-17T18:32:02.324833] [WARN ] [MAIN ] DNA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:32:02.325099] [INFO ] [MAIN ] DNA: Wiping existing primary data before full refresh. [2025-09-17T18:32:02.325146] [INFO ] [LOCAL ] DNA: Starting deletion of primary data. [2025-09-17T18:32:02.326099] [DEBUG] [LOCAL ] DNA: Deleted primary data file. [2025-09-17T18:32:02.326156] [INFO ] [MAIN ] DNA: Starting full primary refresh. [2025-09-17T18:32:02.710986] [INFO ] [REMOTE ] DNA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:32:02.815797] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-06. [2025-09-17T18:32:03.209539] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T18:32:03.285906] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T18:32:03.615789] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-07. [2025-09-17T18:32:04.415792] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-05. [2025-09-17T18:32:04.783940] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T18:32:05.216405] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-11. [2025-09-17T18:32:05.218882] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T18:32:06.015801] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-08. [2025-09-17T18:32:06.790478] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T18:32:06.815720] [INFO ] [REMOTE ] DNA: Fetching primary data for 2024-12. [2025-09-17T18:32:06.860318] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T18:32:07.615833] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-06. [2025-09-17T18:32:08.418092] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-07. [2025-09-17T18:32:08.420619] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T18:32:08.700779] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T18:32:09.006734] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T18:32:09.215782] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-07. [2025-09-17T18:32:10.015780] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-01. [2025-09-17T18:32:10.041555] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T18:32:10.815782] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-08. [2025-09-17T18:32:11.615798] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-08. [2025-09-17T18:32:11.630794] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T18:32:11.866799] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T18:32:12.374187] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T18:32:12.415774] [INFO ] [REMOTE ] DMA: Fetching primary data for 2025-09. [2025-09-17T18:32:13.144325] [INFO ] [REMOTE ] DMA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T18:32:13.145700] [INFO ] [REMOTE ] DMA: Full fetch complete (6422 records). [2025-09-17T18:32:13.145777] [DEBUG] [VALIDATOR ] DMA: Validating primary data. [2025-09-17T18:32:13.146275] [FATAL] [VALIDATOR ] DMA: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:32:13.146356] [FATAL] [MAIN ] DMA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:32:13.146393] [WARN ] [MAIN ] DMA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:32:13.146431] [INFO ] [LOCAL ] DMA: Starting deletion of primary data. [2025-09-17T18:32:13.146488] [DEBUG] [LOCAL ] DMA: No primary data file found to delete. [2025-09-17T18:32:13.146523] [INFO ] [LOCAL ] DMA: Starting deletion of derivative data. [2025-09-17T18:32:13.146822] [DEBUG] [LOCAL ] DMA: Deleted derivative data file. [2025-09-17T18:32:13.146904] [INFO ] [MAIN ] Update Progress: 633/2371 symbols completed. DMA took 44.4s. Estimated remaining: 4h 13m 7s. Rate: 6.9 symbols/min [2025-09-17T18:32:13.220943] [INFO ] [REMOTE ] DMO: Fetching primary data for 2025-09. [2025-09-17T18:32:13.323865] [INFO ] [MAIN ] DNOW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:32:13.371466] [DEBUG] [LOCAL ] DNOW: Loaded 43432 existing records from primary storage. [2025-09-17T18:32:13.371668] [INFO ] [MAIN ] DNOW: Loaded 43432 existing records. [2025-09-17T18:32:13.548667] [WARN ] [MAIN ] DNOW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:32:13.548905] [INFO ] [MAIN ] DNOW: Wiping existing primary data before full refresh. [2025-09-17T18:32:13.548950] [INFO ] [LOCAL ] DNOW: Starting deletion of primary data. [2025-09-17T18:32:13.549912] [DEBUG] [LOCAL ] DNOW: Deleted primary data file. [2025-09-17T18:32:13.549963] [INFO ] [MAIN ] DNOW: Starting full primary refresh. [2025-09-17T18:32:13.915534] [INFO ] [REMOTE ] DNOW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:32:14.015780] [INFO ] [REMOTE ] DLY: Fetching primary data for 2025-09. [2025-09-17T18:32:14.137234] [INFO ] [REMOTE ] DMO: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T18:32:14.138886] [INFO ] [REMOTE ] DMO: Full fetch complete (14492 records). [2025-09-17T18:32:14.138956] [DEBUG] [VALIDATOR ] DMO: Validating primary data. [2025-09-17T18:32:14.509594] [DEBUG] [VALIDATOR ] DMO: All expected trading days are present. [2025-09-17T18:32:14.509693] [DEBUG] [VALIDATOR ] DMO: Primary data validation passed. [2025-09-17T18:32:14.510034] [INFO ] [MAIN ] DMO: Fetched primary data is valid. [2025-09-17T18:32:14.510075] [DEBUG] [LOCAL ] DMO: Saving primary data. [2025-09-17T18:32:14.510590] [DEBUG] [LOCAL ] DMO: Trimmed 14492 records to 9862 (keeping 200 days of data) [2025-09-17T18:32:14.573218] [DEBUG] [LOCAL ] DMO: Primary data saved (9862 records). [2025-09-17T18:32:14.573375] [INFO ] [MAIN ] DMO: Full history saved. [2025-09-17T18:32:14.573457] [INFO ] [MAIN ] Update Progress: 634/2371 symbols completed. DMO took 25.1s. Estimated remaining: 4h 12m 38s. Rate: 6.9 symbols/min [2025-09-17T18:32:14.749087] [INFO ] [MAIN ] DNP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:32:14.780558] [DEBUG] [LOCAL ] DNP: Loaded 33548 existing records from primary storage. [2025-09-17T18:32:14.780715] [INFO ] [MAIN ] DNP: Loaded 33548 existing records. [2025-09-17T18:32:14.820917] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-11. [2025-09-17T18:32:14.965484] [WARN ] [MAIN ] DNP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:32:14.965771] [INFO ] [MAIN ] DNP: Wiping existing primary data before full refresh. [2025-09-17T18:32:14.965819] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-17T18:32:14.966436] [DEBUG] [LOCAL ] DNP: Deleted primary data file. [2025-09-17T18:32:14.966483] [INFO ] [MAIN ] DNP: Starting full primary refresh. [2025-09-17T18:32:15.320553] [INFO ] [REMOTE ] DNP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:32:15.331111] [INFO ] [REMOTE ] DLY: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T18:32:15.334887] [INFO ] [REMOTE ] DLY: Full fetch complete (27966 records). [2025-09-17T18:32:15.334994] [DEBUG] [VALIDATOR ] DLY: Validating primary data. [2025-09-17T18:32:15.621177] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-11. [2025-09-17T18:32:15.730856] [DEBUG] [VALIDATOR ] DLY: All expected trading days are present. [2025-09-17T18:32:15.730936] [DEBUG] [VALIDATOR ] DLY: Primary data validation passed. [2025-09-17T18:32:15.731435] [INFO ] [MAIN ] DLY: Fetched primary data is valid. [2025-09-17T18:32:15.731478] [DEBUG] [LOCAL ] DLY: Saving primary data. [2025-09-17T18:32:15.732404] [DEBUG] [LOCAL ] DLY: Trimmed 27966 records to 19271 (keeping 200 days of data) [2025-09-17T18:32:15.850671] [DEBUG] [LOCAL ] DLY: Primary data saved (19271 records). [2025-09-17T18:32:15.850817] [INFO ] [MAIN ] DLY: Full history saved. [2025-09-17T18:32:15.850902] [INFO ] [MAIN ] Update Progress: 635/2371 symbols completed. DLY took 54.8s. Estimated remaining: 4h 12m 9s. Rate: 6.9 symbols/min [2025-09-17T18:32:16.032221] [INFO ] [MAIN ] DOC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:32:16.090204] [DEBUG] [LOCAL ] DOC: Loaded 53537 existing records from primary storage. [2025-09-17T18:32:16.090409] [INFO ] [MAIN ] DOC: Loaded 53537 existing records. [2025-09-17T18:32:16.274528] [WARN ] [MAIN ] DOC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:32:16.274802] [INFO ] [MAIN ] DOC: Wiping existing primary data before full refresh. [2025-09-17T18:32:16.274851] [INFO ] [LOCAL ] DOC: Starting deletion of primary data. [2025-09-17T18:32:16.275884] [DEBUG] [LOCAL ] DOC: Deleted primary data file. [2025-09-17T18:32:16.275936] [INFO ] [MAIN ] DOC: Starting full primary refresh. [2025-09-17T18:32:16.423778] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-02. [2025-09-17T18:32:16.645300] [INFO ] [REMOTE ] DOC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:32:16.718239] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T18:32:16.745925] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T18:32:17.215769] [INFO ] [REMOTE ] DNP: Fetching primary data for 2024-12. [2025-09-17T18:32:18.015816] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-11. [2025-09-17T18:32:18.649253] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-17T18:32:18.811150] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T18:32:18.818445] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2024-12. [2025-09-17T18:32:19.615777] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-03. [2025-09-17T18:32:20.161593] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-17T18:32:20.196092] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T18:32:20.415823] [INFO ] [REMOTE ] DOC: Fetching primary data for 2024-12. [2025-09-17T18:32:21.215813] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-01. [2025-09-17T18:32:21.392276] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T18:32:22.015784] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-04. [2025-09-17T18:32:22.229513] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T18:32:22.752016] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T18:32:22.815822] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-01. [2025-09-17T18:32:23.615803] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-02. [2025-09-17T18:32:23.655359] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T18:32:24.340843] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T18:32:24.415745] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-02. [2025-09-17T18:32:24.673714] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T18:32:25.215789] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-03. [2025-09-17T18:32:25.842398] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T18:32:26.015777] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-01. [2025-09-17T18:32:26.815784] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-03. [2025-09-17T18:32:26.975907] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T18:32:27.615767] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-04. [2025-09-17T18:32:28.026942] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T18:32:28.056425] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T18:32:28.415773] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-04. [2025-09-17T18:32:29.215789] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-02. [2025-09-17T18:32:29.527823] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T18:32:30.015697] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-05. [2025-09-17T18:32:30.105840] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T18:32:30.815868] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-05. [2025-09-17T18:32:31.032628] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T18:32:31.615702] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-03. [2025-09-17T18:32:31.685828] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T18:32:32.096950] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T18:32:32.415769] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-06. [2025-09-17T18:32:33.095128] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T18:32:33.215817] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-04. [2025-09-17T18:32:33.850324] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T18:32:34.015767] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-05. [2025-09-17T18:32:34.820954] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-07. [2025-09-17T18:32:34.841450] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T18:32:35.479084] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T18:32:35.615826] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-06. [2025-09-17T18:32:36.415806] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-06. [2025-09-17T18:32:36.670929] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T18:32:36.932452] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T18:32:37.215827] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-05. [2025-09-17T18:32:38.015788] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-08. [2025-09-17T18:32:38.200745] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T18:32:38.815818] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-07. [2025-09-17T18:32:39.089668] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T18:32:39.625200] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-07. [2025-09-17T18:32:39.630157] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T18:32:40.415785] [INFO ] [REMOTE ] DNOW: Fetching primary data for 2025-09. [2025-09-17T18:32:40.672299] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T18:32:41.215835] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-08. [2025-09-17T18:32:42.015828] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-06. [2025-09-17T18:32:42.129461] [INFO ] [REMOTE ] DNOW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T18:32:42.136197] [INFO ] [REMOTE ] DNOW: Full fetch complete (62025 records). [2025-09-17T18:32:42.136371] [DEBUG] [VALIDATOR ] DNOW: Validating primary data. [2025-09-17T18:32:42.529813] [DEBUG] [VALIDATOR ] DNOW: All expected trading days are present. [2025-09-17T18:32:42.529934] [DEBUG] [VALIDATOR ] DNOW: Primary data validation passed. [2025-09-17T18:32:42.531223] [INFO ] [MAIN ] DNOW: Fetched primary data is valid. [2025-09-17T18:32:42.531273] [DEBUG] [LOCAL ] DNOW: Saving primary data. [2025-09-17T18:32:42.535015] [DEBUG] [LOCAL ] DNOW: Trimmed 62025 records to 43483 (keeping 200 days of data) [2025-09-17T18:32:42.795086] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T18:32:42.821845] [INFO ] [REMOTE ] DNP: Fetching primary data for 2025-09. [2025-09-17T18:32:42.833175] [DEBUG] [LOCAL ] DNOW: Primary data saved (43483 records). [2025-09-17T18:32:42.833312] [INFO ] [MAIN ] DNOW: Full history saved. [2025-09-17T18:32:42.834032] [INFO ] [MAIN ] Update Progress: 636/2371 symbols completed. DNOW took 29.7s. Estimated remaining: 4h 12m 50s. Rate: 6.9 symbols/min [2025-09-17T18:32:43.003698] [INFO ] [MAIN ] DOCN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:32:43.053359] [DEBUG] [LOCAL ] DOCN: Loaded 50377 existing records from primary storage. [2025-09-17T18:32:43.053502] [INFO ] [MAIN ] DOCN: Loaded 50377 existing records. [2025-09-17T18:32:43.235917] [WARN ] [MAIN ] DOCN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:32:43.236223] [INFO ] [MAIN ] DOCN: Wiping existing primary data before full refresh. [2025-09-17T18:32:43.236296] [INFO ] [LOCAL ] DOCN: Starting deletion of primary data. [2025-09-17T18:32:43.237211] [DEBUG] [LOCAL ] DOCN: Deleted primary data file. [2025-09-17T18:32:43.237275] [INFO ] [MAIN ] DOCN: Starting full primary refresh. [2025-09-17T18:32:43.591252] [INFO ] [REMOTE ] DOCN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:32:43.615754] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-11. [2025-09-17T18:32:44.155043] [INFO ] [REMOTE ] DNP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T18:32:44.159373] [INFO ] [REMOTE ] DNP: Full fetch complete (49250 records). [2025-09-17T18:32:44.159475] [DEBUG] [VALIDATOR ] DNP: Validating primary data. [2025-09-17T18:32:44.160182] [FATAL] [VALIDATOR ] DNP: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:32:44.160280] [FATAL] [MAIN ] DNP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:32:44.160348] [WARN ] [MAIN ] DNP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:32:44.160413] [INFO ] [LOCAL ] DNP: Starting deletion of primary data. [2025-09-17T18:32:44.160480] [DEBUG] [LOCAL ] DNP: No primary data file found to delete. [2025-09-17T18:32:44.160519] [INFO ] [LOCAL ] DNP: Starting deletion of derivative data. [2025-09-17T18:32:44.160895] [DEBUG] [LOCAL ] DNP: Deleted derivative data file. [2025-09-17T18:32:44.161006] [INFO ] [MAIN ] Update Progress: 637/2371 symbols completed. DNP took 29.6s. Estimated remaining: 4h 12m 21s. Rate: 6.9 symbols/min [2025-09-17T18:32:45.170504] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-07 (5.55 seconds). [2025-09-17T18:32:45.182091] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-08. [2025-09-17T18:32:45.299543] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-06 (3.28 seconds). [2025-09-17T18:32:45.310813] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-07. [2025-09-17T18:32:45.973518] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-11 (2.36 seconds). [2025-09-17T18:32:46.015762] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2024-12. [2025-09-17T18:32:46.808739] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T18:32:46.819841] [INFO ] [REMOTE ] DNA: Fetching primary data for 2025-09. [2025-09-17T18:32:47.209141] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T18:32:47.569739] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T18:32:47.615805] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-01. [2025-09-17T18:32:48.415863] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-08. [2025-09-17T18:32:48.802888] [INFO ] [REMOTE ] DNA: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-17T18:32:48.809246] [INFO ] [REMOTE ] DNA: Full fetch complete (70836 records). [2025-09-17T18:32:48.809410] [DEBUG] [VALIDATOR ] DNA: Validating primary data. [2025-09-17T18:32:49.205834] [DEBUG] [VALIDATOR ] DNA: All expected trading days are present. [2025-09-17T18:32:49.205925] [DEBUG] [VALIDATOR ] DNA: Primary data validation passed. [2025-09-17T18:32:49.206743] [INFO ] [MAIN ] DNA: Fetched primary data is valid. [2025-09-17T18:32:49.206791] [DEBUG] [LOCAL ] DNA: Saving primary data. [2025-09-17T18:32:49.208203] [DEBUG] [LOCAL ] DNA: Trimmed 70836 records to 48544 (keeping 200 days of data) [2025-09-17T18:32:49.358732] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T18:32:49.452599] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-02. [2025-09-17T18:32:49.544600] [DEBUG] [LOCAL ] DNA: Primary data saved (48544 records). [2025-09-17T18:32:49.544776] [INFO ] [MAIN ] DNA: Full history saved. [2025-09-17T18:32:49.545376] [INFO ] [MAIN ] Update Progress: 638/2371 symbols completed. DNA took 47.6s. Estimated remaining: 4h 12m 3s. Rate: 6.9 symbols/min [2025-09-17T18:32:50.577047] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-08 (2.16 seconds). [2025-09-17T18:32:50.589204] [INFO ] [REMOTE ] DOC: Fetching primary data for 2025-09. [2025-09-17T18:32:51.278241] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T18:32:51.291758] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-03. [2025-09-17T18:32:52.204873] [INFO ] [REMOTE ] DOC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T18:32:52.211719] [INFO ] [REMOTE ] DOC: Full fetch complete (77206 records). [2025-09-17T18:32:52.211839] [DEBUG] [VALIDATOR ] DOC: Validating primary data. [2025-09-17T18:32:52.606922] [DEBUG] [VALIDATOR ] DOC: All expected trading days are present. [2025-09-17T18:32:52.607015] [DEBUG] [VALIDATOR ] DOC: Primary data validation passed. [2025-09-17T18:32:52.607883] [INFO ] [MAIN ] DOC: Fetched primary data is valid. [2025-09-17T18:32:52.607931] [DEBUG] [LOCAL ] DOC: Saving primary data. [2025-09-17T18:32:52.609496] [DEBUG] [LOCAL ] DOC: Trimmed 77206 records to 53537 (keeping 200 days of data) [2025-09-17T18:32:52.948770] [DEBUG] [LOCAL ] DOC: Primary data saved (53537 records). [2025-09-17T18:32:52.948988] [INFO ] [MAIN ] DOC: Full history saved. [2025-09-17T18:32:52.949106] [INFO ] [MAIN ] Update Progress: 639/2371 symbols completed. DOC took 37.1s. Estimated remaining: 4h 11m 40s. Rate: 6.9 symbols/min [2025-09-17T18:32:52.993581] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T18:32:53.004202] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-04. [2025-09-17T18:32:54.384999] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T18:32:54.395444] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-05. [2025-09-17T18:32:55.892369] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T18:32:55.903172] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-06. [2025-09-17T18:32:57.864400] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T18:32:57.874609] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-07. [2025-09-17T18:32:59.690179] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T18:32:59.707437] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-08. [2025-09-17T18:33:01.898148] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T18:33:01.909523] [INFO ] [REMOTE ] DOCN: Fetching primary data for 2025-09. [2025-09-17T18:33:03.814293] [INFO ] [REMOTE ] DOCN: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T18:33:03.821040] [INFO ] [REMOTE ] DOCN: Full fetch complete (70747 records). [2025-09-17T18:33:03.821196] [DEBUG] [VALIDATOR ] DOCN: Validating primary data. [2025-09-17T18:33:04.226872] [DEBUG] [VALIDATOR ] DOCN: All expected trading days are present. [2025-09-17T18:33:04.226991] [DEBUG] [VALIDATOR ] DOCN: Primary data validation passed. [2025-09-17T18:33:04.227893] [INFO ] [MAIN ] DOCN: Fetched primary data is valid. [2025-09-17T18:33:04.227939] [DEBUG] [LOCAL ] DOCN: Saving primary data. [2025-09-17T18:33:04.229529] [DEBUG] [LOCAL ] DOCN: Trimmed 70747 records to 50400 (keeping 200 days of data) [2025-09-17T18:33:04.534927] [DEBUG] [LOCAL ] DOCN: Primary data saved (50400 records). [2025-09-17T18:33:04.535092] [INFO ] [MAIN ] DOCN: Full history saved. [2025-09-17T18:33:04.535849] [INFO ] [MAIN ] Update Progress: 640/2371 symbols completed. DOCN took 21.7s. Estimated remaining: 4h 11m 39s. Rate: 6.9 symbols/min [2025-09-17T18:33:05.134830] [INFO ] [MAIN ] DOCS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:33:05.168283] [INFO ] [MAIN ] DOV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:33:05.175695] [INFO ] [MAIN ] DOLE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:33:05.245193] [INFO ] [MAIN ] DOUG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:33:05.334083] [DEBUG] [LOCAL ] DOCS: Loaded 51441 existing records from primary storage. [2025-09-17T18:33:05.335493] [INFO ] [MAIN ] DOCS: Loaded 51441 existing records. [2025-09-17T18:33:05.366231] [DEBUG] [LOCAL ] DOUG: Loaded 34879 existing records from primary storage. [2025-09-17T18:33:05.408937] [INFO ] [MAIN ] DOUG: Loaded 34879 existing records. [2025-09-17T18:33:05.440550] [DEBUG] [LOCAL ] DOLE: Loaded 37771 existing records from primary storage. [2025-09-17T18:33:05.486237] [INFO ] [MAIN ] DOLE: Loaded 37771 existing records. [2025-09-17T18:33:05.575755] [DEBUG] [LOCAL ] DOV: Loaded 45883 existing records from primary storage. [2025-09-17T18:33:05.668256] [INFO ] [MAIN ] DOV: Loaded 45883 existing records. [2025-09-17T18:33:05.922988] [WARN ] [MAIN ] DOCS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:33:05.967903] [WARN ] [MAIN ] DOUG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:33:06.001213] [WARN ] [MAIN ] DOLE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:33:06.012468] [INFO ] [MAIN ] DOUG: Wiping existing primary data before full refresh. [2025-09-17T18:33:06.015720] [INFO ] [LOCAL ] DOUG: Starting deletion of primary data. [2025-09-17T18:33:06.015961] [INFO ] [MAIN ] DOCS: Wiping existing primary data before full refresh. [2025-09-17T18:33:06.015919] [INFO ] [MAIN ] DOLE: Wiping existing primary data before full refresh. [2025-09-17T18:33:06.016070] [INFO ] [LOCAL ] DOCS: Starting deletion of primary data. [2025-09-17T18:33:06.016108] [INFO ] [LOCAL ] DOLE: Starting deletion of primary data. [2025-09-17T18:33:06.021722] [DEBUG] [LOCAL ] DOUG: Deleted primary data file. [2025-09-17T18:33:06.021686] [DEBUG] [LOCAL ] DOLE: Deleted primary data file. [2025-09-17T18:33:06.026959] [INFO ] [MAIN ] DOUG: Starting full primary refresh. [2025-09-17T18:33:06.032174] [INFO ] [MAIN ] DOLE: Starting full primary refresh. [2025-09-17T18:33:06.027006] [DEBUG] [LOCAL ] DOCS: Deleted primary data file. [2025-09-17T18:33:06.116707] [INFO ] [MAIN ] DOCS: Starting full primary refresh. [2025-09-17T18:33:06.185969] [WARN ] [MAIN ] DOV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:33:06.338522] [INFO ] [MAIN ] DOV: Wiping existing primary data before full refresh. [2025-09-17T18:33:06.370905] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-17T18:33:06.386855] [DEBUG] [LOCAL ] DOV: Deleted primary data file. [2025-09-17T18:33:06.412228] [INFO ] [MAIN ] DOV: Starting full primary refresh. [2025-09-17T18:33:07.342665] [INFO ] [REMOTE ] DOCS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:33:07.445198] [INFO ] [REMOTE ] DOLE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:33:07.363285] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-11. [2025-09-17T18:33:07.465335] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-11. [2025-09-17T18:33:07.509639] [INFO ] [REMOTE ] DOUG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:33:07.544344] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-11. [2025-09-17T18:33:07.549027] [INFO ] [REMOTE ] DOV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:33:07.550111] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-11. [2025-09-17T18:33:08.768762] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T18:33:08.779569] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2024-12. [2025-09-17T18:33:09.059920] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T18:33:09.067762] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2024-12. [2025-09-17T18:33:09.213285] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T18:33:09.221153] [INFO ] [REMOTE ] DOV: Fetching primary data for 2024-12. [2025-09-17T18:33:09.340591] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-17T18:33:09.350680] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2024-12. [2025-09-17T18:33:10.136114] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T18:33:10.143254] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-01. [2025-09-17T18:33:10.526978] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T18:33:10.535872] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-01. [2025-09-17T18:33:10.805265] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T18:33:10.813515] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-01. [2025-09-17T18:33:10.920526] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T18:33:10.931094] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-01. [2025-09-17T18:33:11.244949] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T18:33:11.252396] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-02. [2025-09-17T18:33:11.931892] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T18:33:11.939441] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-02. [2025-09-17T18:33:12.117948] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T18:33:12.124969] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-03. [2025-09-17T18:33:12.211000] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T18:33:12.220280] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-02. [2025-09-17T18:33:12.593499] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T18:33:12.603322] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-02. [2025-09-17T18:33:12.958490] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T18:33:12.965948] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-03. [2025-09-17T18:33:13.335715] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T18:33:13.343130] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-04. [2025-09-17T18:33:13.866071] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T18:33:13.874584] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-03. [2025-09-17T18:33:14.114166] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T18:33:14.124454] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-03. [2025-09-17T18:33:14.432113] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T18:33:14.440247] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-04. [2025-09-17T18:33:14.623592] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T18:33:14.631876] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-05. [2025-09-17T18:33:15.371174] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T18:33:15.381223] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-04. [2025-09-17T18:33:15.568103] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T18:33:15.615740] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-04. [2025-09-17T18:33:15.767789] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T18:33:15.843997] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T18:33:16.415770] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-05. [2025-09-17T18:33:17.145799] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T18:33:17.215737] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-05. [2025-09-17T18:33:17.480116] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T18:33:17.850982] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T18:33:18.015770] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-06. [2025-09-17T18:33:18.815743] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-06. [2025-09-17T18:33:18.887005] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T18:33:19.528050] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T18:33:19.615735] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-06. [2025-09-17T18:33:19.883221] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T18:33:20.415800] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-07. [2025-09-17T18:33:21.215759] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-07. [2025-09-17T18:33:21.271810] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T18:33:21.877603] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T18:33:22.015742] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-08. [2025-09-17T18:33:22.792321] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T18:33:22.815721] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-08. [2025-09-17T18:33:23.491810] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T18:33:23.615809] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-05. [2025-09-17T18:33:24.264321] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T18:33:24.415771] [INFO ] [REMOTE ] DOLE: Fetching primary data for 2025-09. [2025-09-17T18:33:25.215776] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-07. [2025-09-17T18:33:25.773714] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T18:33:25.967195] [INFO ] [REMOTE ] DOLE: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T18:33:25.973028] [INFO ] [REMOTE ] DOLE: Full fetch complete (52868 records). [2025-09-17T18:33:25.973126] [DEBUG] [VALIDATOR ] DOLE: Validating primary data. [2025-09-17T18:33:26.020969] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-06. [2025-09-17T18:33:26.390608] [DEBUG] [VALIDATOR ] DOLE: All expected trading days are present. [2025-09-17T18:33:26.390708] [DEBUG] [VALIDATOR ] DOLE: Primary data validation passed. [2025-09-17T18:33:26.391363] [INFO ] [MAIN ] DOLE: Fetched primary data is valid. [2025-09-17T18:33:26.391405] [DEBUG] [LOCAL ] DOLE: Saving primary data. [2025-09-17T18:33:26.392499] [DEBUG] [LOCAL ] DOLE: Trimmed 52868 records to 37792 (keeping 200 days of data) [2025-09-17T18:33:26.627199] [DEBUG] [LOCAL ] DOLE: Primary data saved (37792 records). [2025-09-17T18:33:26.627355] [INFO ] [MAIN ] DOLE: Full history saved. [2025-09-17T18:33:26.627452] [INFO ] [MAIN ] Update Progress: 641/2371 symbols completed. DOLE took 22.1s. Estimated remaining: 4h 12m 7s. Rate: 6.9 symbols/min [2025-09-17T18:33:26.799799] [INFO ] [MAIN ] DOW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:33:26.818857] [INFO ] [REMOTE ] DOUG: Fetching primary data for 2025-09. [2025-09-17T18:33:26.832788] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T18:33:26.891962] [DEBUG] [LOCAL ] DOW: Loaded 53733 existing records from primary storage. [2025-09-17T18:33:26.892144] [INFO ] [MAIN ] DOW: Loaded 53733 existing records. [2025-09-17T18:33:27.070475] [WARN ] [MAIN ] DOW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:33:27.070755] [INFO ] [MAIN ] DOW: Wiping existing primary data before full refresh. [2025-09-17T18:33:27.070803] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-17T18:33:27.071888] [DEBUG] [LOCAL ] DOW: Deleted primary data file. [2025-09-17T18:33:27.071944] [INFO ] [MAIN ] DOW: Starting full primary refresh. [2025-09-17T18:33:27.424478] [INFO ] [REMOTE ] DOW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:33:27.615802] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-08. [2025-09-17T18:33:27.777188] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T18:33:28.252694] [INFO ] [REMOTE ] DOUG: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T18:33:28.257476] [INFO ] [REMOTE ] DOUG: Full fetch complete (51819 records). [2025-09-17T18:33:28.257589] [DEBUG] [VALIDATOR ] DOUG: Validating primary data. [2025-09-17T18:33:28.417389] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-11. [2025-09-17T18:33:28.650377] [DEBUG] [VALIDATOR ] DOUG: All expected trading days are present. [2025-09-17T18:33:28.650481] [DEBUG] [VALIDATOR ] DOUG: Primary data validation passed. [2025-09-17T18:33:28.651285] [INFO ] [MAIN ] DOUG: Fetched primary data is valid. [2025-09-17T18:33:28.651349] [DEBUG] [LOCAL ] DOUG: Saving primary data. [2025-09-17T18:33:28.652943] [DEBUG] [LOCAL ] DOUG: Trimmed 51819 records to 34861 (keeping 200 days of data) [2025-09-17T18:33:28.860397] [DEBUG] [LOCAL ] DOUG: Primary data saved (34861 records). [2025-09-17T18:33:28.860795] [INFO ] [MAIN ] DOUG: Full history saved. [2025-09-17T18:33:28.861050] [INFO ] [MAIN ] Update Progress: 642/2371 symbols completed. DOUG took 24.3s. Estimated remaining: 4h 11m 40s. Rate: 6.9 symbols/min [2025-09-17T18:33:29.036219] [INFO ] [MAIN ] DPG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:33:29.062980] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T18:33:29.083554] [DEBUG] [LOCAL ] DPG: Loaded 13284 existing records from primary storage. [2025-09-17T18:33:29.083765] [INFO ] [MAIN ] DPG: Loaded 13284 existing records. [2025-09-17T18:33:29.224139] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-07. [2025-09-17T18:33:29.264964] [WARN ] [MAIN ] DPG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:33:29.265213] [INFO ] [MAIN ] DPG: Wiping existing primary data before full refresh. [2025-09-17T18:33:29.265261] [INFO ] [LOCAL ] DPG: Starting deletion of primary data. [2025-09-17T18:33:29.265777] [DEBUG] [LOCAL ] DPG: Deleted primary data file. [2025-09-17T18:33:29.265854] [INFO ] [MAIN ] DPG: Starting full primary refresh. [2025-09-17T18:33:29.630600] [INFO ] [REMOTE ] DPG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:33:30.015778] [INFO ] [REMOTE ] DOV: Fetching primary data for 2025-09. [2025-09-17T18:33:30.755418] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-17T18:33:30.815748] [INFO ] [REMOTE ] DOW: Fetching primary data for 2024-12. [2025-09-17T18:33:31.191245] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T18:33:31.615871] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-08. [2025-09-17T18:33:31.817517] [INFO ] [REMOTE ] DOV: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T18:33:31.823358] [INFO ] [REMOTE ] DOV: Full fetch complete (64220 records). [2025-09-17T18:33:31.823499] [DEBUG] [VALIDATOR ] DOV: Validating primary data. [2025-09-17T18:33:31.824323] [FATAL] [VALIDATOR ] DOV: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:33:31.824412] [FATAL] [MAIN ] DOV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:33:31.824462] [WARN ] [MAIN ] DOV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:33:31.824512] [INFO ] [LOCAL ] DOV: Starting deletion of primary data. [2025-09-17T18:33:31.824574] [DEBUG] [LOCAL ] DOV: No primary data file found to delete. [2025-09-17T18:33:31.824617] [INFO ] [LOCAL ] DOV: Starting deletion of derivative data. [2025-09-17T18:33:31.825025] [DEBUG] [LOCAL ] DOV: Deleted derivative data file. [2025-09-17T18:33:31.825655] [INFO ] [MAIN ] Update Progress: 643/2371 symbols completed. DOV took 27.3s. Estimated remaining: 4h 11m 16s. Rate: 6.9 symbols/min [2025-09-17T18:33:31.996070] [INFO ] [MAIN ] DQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:33:32.042844] [DEBUG] [LOCAL ] DQ: Loaded 43010 existing records from primary storage. [2025-09-17T18:33:32.042992] [INFO ] [MAIN ] DQ: Loaded 43010 existing records. [2025-09-17T18:33:32.226793] [WARN ] [MAIN ] DQ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:33:32.227025] [INFO ] [MAIN ] DQ: Wiping existing primary data before full refresh. [2025-09-17T18:33:32.227070] [INFO ] [LOCAL ] DQ: Starting deletion of primary data. [2025-09-17T18:33:32.227958] [DEBUG] [LOCAL ] DQ: Deleted primary data file. [2025-09-17T18:33:32.228013] [INFO ] [MAIN ] DQ: Starting full primary refresh. [2025-09-17T18:33:32.430431] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-11. [2025-09-17T18:33:32.593049] [INFO ] [REMOTE ] DQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:33:32.639607] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T18:33:33.215782] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-01. [2025-09-17T18:33:33.439145] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T18:33:33.440041] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T18:33:34.015778] [INFO ] [REMOTE ] DOCS: Fetching primary data for 2025-09. [2025-09-17T18:33:34.815770] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-11. [2025-09-17T18:33:35.052894] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T18:33:35.615826] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-02. [2025-09-17T18:33:35.810066] [INFO ] [REMOTE ] DOCS: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T18:33:35.816232] [INFO ] [REMOTE ] DOCS: Full fetch complete (74163 records). [2025-09-17T18:33:35.816374] [DEBUG] [VALIDATOR ] DOCS: Validating primary data. [2025-09-17T18:33:36.214929] [DEBUG] [VALIDATOR ] DOCS: All expected trading days are present. [2025-09-17T18:33:36.215056] [DEBUG] [VALIDATOR ] DOCS: Primary data validation passed. [2025-09-17T18:33:36.215977] [INFO ] [MAIN ] DOCS: Fetched primary data is valid. [2025-09-17T18:33:36.216027] [DEBUG] [LOCAL ] DOCS: Saving primary data. [2025-09-17T18:33:36.218005] [DEBUG] [LOCAL ] DOCS: Trimmed 74163 records to 51388 (keeping 200 days of data) [2025-09-17T18:33:36.437901] [INFO ] [REMOTE ] DPG: Fetching primary data for 2024-12. [2025-09-17T18:33:36.525915] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T18:33:36.574201] [DEBUG] [LOCAL ] DOCS: Primary data saved (51388 records). [2025-09-17T18:33:36.574345] [INFO ] [MAIN ] DOCS: Full history saved. [2025-09-17T18:33:36.574493] [INFO ] [MAIN ] Update Progress: 644/2371 symbols completed. DOCS took 32.0s. Estimated remaining: 4h 10m 57s. Rate: 6.9 symbols/min [2025-09-17T18:33:36.744061] [INFO ] [MAIN ] DRD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:33:36.781499] [DEBUG] [LOCAL ] DRD: Loaded 36102 existing records from primary storage. [2025-09-17T18:33:36.781681] [INFO ] [MAIN ] DRD: Loaded 36102 existing records. [2025-09-17T18:33:36.959086] [WARN ] [MAIN ] DRD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:33:36.959363] [INFO ] [MAIN ] DRD: Wiping existing primary data before full refresh. [2025-09-17T18:33:36.959410] [INFO ] [LOCAL ] DRD: Starting deletion of primary data. [2025-09-17T18:33:36.960343] [DEBUG] [LOCAL ] DRD: Deleted primary data file. [2025-09-17T18:33:36.960397] [INFO ] [MAIN ] DRD: Starting full primary refresh. [2025-09-17T18:33:37.220414] [INFO ] [REMOTE ] DQ: Fetching primary data for 2024-12. [2025-09-17T18:33:37.340410] [INFO ] [REMOTE ] DRD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:33:37.350704] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T18:33:37.383142] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T18:33:38.015806] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-03. [2025-09-17T18:33:38.815789] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-11. [2025-09-17T18:33:38.897371] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T18:33:39.615798] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-01. [2025-09-17T18:33:40.131558] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T18:33:40.289273] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T18:33:40.415766] [INFO ] [REMOTE ] DRD: Fetching primary data for 2024-12. [2025-09-17T18:33:40.751485] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T18:33:41.215744] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-02. [2025-09-17T18:33:41.537740] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T18:33:42.015785] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-01. [2025-09-17T18:33:42.561682] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T18:33:42.780405] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T18:33:42.815776] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-02. [2025-09-17T18:33:43.615815] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-01. [2025-09-17T18:33:44.119569] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T18:33:44.415822] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-03. [2025-09-17T18:33:44.527305] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T18:33:45.215801] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-03. [2025-09-17T18:33:46.015811] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-04. [2025-09-17T18:33:46.178765] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T18:33:46.815837] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-04. [2025-09-17T18:33:47.119675] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T18:33:47.615805] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-02. [2025-09-17T18:33:48.377950] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-17T18:33:48.415759] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-05. [2025-09-17T18:33:48.661468] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T18:33:48.720388] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T18:33:49.215832] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-03. [2025-09-17T18:33:50.015689] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-04. [2025-09-17T18:33:50.114629] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T18:33:50.530039] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-17T18:33:50.815794] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-04. [2025-09-17T18:33:51.615752] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-05. [2025-09-17T18:33:51.703668] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T18:33:51.720144] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T18:33:52.415896] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-05. [2025-09-17T18:33:53.095287] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T18:33:53.215893] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-06. [2025-09-17T18:33:53.603845] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T18:33:54.015774] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-06. [2025-09-17T18:33:54.400529] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T18:33:54.815784] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-07. [2025-09-17T18:33:55.513191] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T18:33:55.615736] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-07. [2025-09-17T18:33:56.415839] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-05. [2025-09-17T18:33:56.781011] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T18:33:56.814582] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T18:33:57.215803] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-08. [2025-09-17T18:33:57.418534] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T18:33:58.015828] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-06. [2025-09-17T18:33:58.810880] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T18:33:58.815664] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-07. [2025-09-17T18:33:58.962041] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T18:33:59.615784] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-08. [2025-09-17T18:33:59.777118] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T18:34:00.415773] [INFO ] [REMOTE ] DQ: Fetching primary data for 2025-09. [2025-09-17T18:34:01.215803] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-06. [2025-09-17T18:34:01.363357] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T18:34:02.015811] [INFO ] [REMOTE ] DRD: Fetching primary data for 2025-09. [2025-09-17T18:34:02.815845] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-08. [2025-09-17T18:34:02.856738] [INFO ] [REMOTE ] DQ: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-17T18:34:02.862991] [INFO ] [REMOTE ] DQ: Full fetch complete (62676 records). [2025-09-17T18:34:02.863110] [DEBUG] [VALIDATOR ] DQ: Validating primary data. [2025-09-17T18:34:03.246796] [DEBUG] [VALIDATOR ] DQ: All expected trading days are present. [2025-09-17T18:34:03.246876] [DEBUG] [VALIDATOR ] DQ: Primary data validation passed. [2025-09-17T18:34:03.247616] [INFO ] [MAIN ] DQ: Fetched primary data is valid. [2025-09-17T18:34:03.247681] [DEBUG] [LOCAL ] DQ: Saving primary data. [2025-09-17T18:34:03.248872] [DEBUG] [LOCAL ] DQ: Trimmed 62676 records to 43073 (keeping 200 days of data) [2025-09-17T18:34:03.497498] [INFO ] [REMOTE ] DRD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T18:34:03.510877] [INFO ] [REMOTE ] DRD: Full fetch complete (47886 records). [2025-09-17T18:34:03.511678] [DEBUG] [VALIDATOR ] DRD: Validating primary data. [2025-09-17T18:34:03.524606] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T18:34:03.629419] [INFO ] [REMOTE ] DPG: Fetching primary data for 2025-09. [2025-09-17T18:34:03.708432] [DEBUG] [LOCAL ] DQ: Primary data saved (43073 records). [2025-09-17T18:34:03.714101] [INFO ] [MAIN ] DQ: Full history saved. [2025-09-17T18:34:03.729438] [INFO ] [MAIN ] Update Progress: 645/2371 symbols completed. DQ took 31.9s. Estimated remaining: 4h 11m 37s. Rate: 6.9 symbols/min [2025-09-17T18:34:03.755972] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-17T18:34:04.083071] [INFO ] [MAIN ] DRH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:34:04.160468] [DEBUG] [VALIDATOR ] DRD: All expected trading days are present. [2025-09-17T18:34:04.160579] [DEBUG] [VALIDATOR ] DRD: Primary data validation passed. [2025-09-17T18:34:04.161343] [INFO ] [MAIN ] DRD: Fetched primary data is valid. [2025-09-17T18:34:04.161438] [DEBUG] [LOCAL ] DRD: Saving primary data. [2025-09-17T18:34:04.162865] [DEBUG] [LOCAL ] DRD: Trimmed 47886 records to 36296 (keeping 200 days of data) [2025-09-17T18:34:04.394679] [DEBUG] [LOCAL ] DRH: Loaded 50464 existing records from primary storage. [2025-09-17T18:34:04.399776] [INFO ] [MAIN ] DRH: Loaded 50464 existing records. [2025-09-17T18:34:04.429963] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-07. [2025-09-17T18:34:04.455944] [DEBUG] [LOCAL ] DRD: Primary data saved (36296 records). [2025-09-17T18:34:04.481406] [INFO ] [MAIN ] DRD: Full history saved. [2025-09-17T18:34:04.501863] [INFO ] [MAIN ] Update Progress: 646/2371 symbols completed. DRD took 27.9s. Estimated remaining: 4h 11m 7s. Rate: 6.9 symbols/min [2025-09-17T18:34:04.710397] [WARN ] [MAIN ] DRH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:34:04.721550] [INFO ] [MAIN ] DRH: Wiping existing primary data before full refresh. [2025-09-17T18:34:04.755892] [INFO ] [LOCAL ] DRH: Starting deletion of primary data. [2025-09-17T18:34:04.764955] [INFO ] [REMOTE ] DPG: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T18:34:04.788084] [INFO ] [MAIN ] DRI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:34:04.790538] [DEBUG] [LOCAL ] DRH: Deleted primary data file. [2025-09-17T18:34:04.790847] [INFO ] [MAIN ] DRH: Starting full primary refresh. [2025-09-17T18:34:04.827915] [INFO ] [REMOTE ] DPG: Full fetch complete (18783 records). [2025-09-17T18:34:04.860495] [DEBUG] [VALIDATOR ] DPG: Validating primary data. [2025-09-17T18:34:05.308072] [DEBUG] [LOCAL ] DRI: Loaded 47769 existing records from primary storage. [2025-09-17T18:34:05.373147] [INFO ] [MAIN ] DRI: Loaded 47769 existing records. [2025-09-17T18:34:05.451230] [INFO ] [REMOTE ] DRH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:34:05.474248] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-11. [2025-09-17T18:34:05.744784] [DEBUG] [VALIDATOR ] DPG: All expected trading days are present. [2025-09-17T18:34:05.749333] [DEBUG] [VALIDATOR ] DPG: Primary data validation passed. [2025-09-17T18:34:05.749966] [INFO ] [MAIN ] DPG: Fetched primary data is valid. [2025-09-17T18:34:05.750072] [DEBUG] [LOCAL ] DPG: Saving primary data. [2025-09-17T18:34:05.749419] [WARN ] [MAIN ] DRI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:34:05.750409] [INFO ] [MAIN ] DRI: Wiping existing primary data before full refresh. [2025-09-17T18:34:05.750692] [INFO ] [LOCAL ] DRI: Starting deletion of primary data. [2025-09-17T18:34:05.751146] [DEBUG] [LOCAL ] DPG: Trimmed 18783 records to 13284 (keeping 200 days of data) [2025-09-17T18:34:05.751976] [DEBUG] [LOCAL ] DRI: Deleted primary data file. [2025-09-17T18:34:05.752052] [INFO ] [MAIN ] DRI: Starting full primary refresh. [2025-09-17T18:34:06.122159] [DEBUG] [LOCAL ] DPG: Primary data saved (13284 records). [2025-09-17T18:34:06.137883] [INFO ] [MAIN ] DPG: Full history saved. [2025-09-17T18:34:06.143155] [INFO ] [MAIN ] Update Progress: 647/2371 symbols completed. DPG took 37.3s. Estimated remaining: 4h 10m 40s. Rate: 6.9 symbols/min [2025-09-17T18:34:06.281701] [INFO ] [REMOTE ] DRI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:34:06.308026] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-11. [2025-09-17T18:34:06.378794] [INFO ] [MAIN ] DRLL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:34:06.391379] [DEBUG] [LOCAL ] DRLL: Loaded 10058 existing records from primary storage. [2025-09-17T18:34:06.391631] [INFO ] [MAIN ] DRLL: Loaded 10058 existing records. [2025-09-17T18:34:06.575959] [WARN ] [MAIN ] DRLL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:34:06.576365] [INFO ] [MAIN ] DRLL: Wiping existing primary data before full refresh. [2025-09-17T18:34:06.576486] [INFO ] [LOCAL ] DRLL: Starting deletion of primary data. [2025-09-17T18:34:06.577020] [DEBUG] [LOCAL ] DRLL: Deleted primary data file. [2025-09-17T18:34:06.577134] [INFO ] [MAIN ] DRLL: Starting full primary refresh. [2025-09-17T18:34:06.772214] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-17T18:34:06.882711] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-08. [2025-09-17T18:34:06.993317] [INFO ] [REMOTE ] DRLL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:34:07.092616] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T18:34:07.615807] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-11. [2025-09-17T18:34:08.415783] [INFO ] [REMOTE ] DRH: Fetching primary data for 2024-12. [2025-09-17T18:34:08.455830] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-17T18:34:08.788261] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T18:34:09.068227] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T18:34:09.215754] [INFO ] [REMOTE ] DOW: Fetching primary data for 2025-09. [2025-09-17T18:34:09.774253] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T18:34:10.015778] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2024-12. [2025-09-17T18:34:10.815747] [INFO ] [REMOTE ] DRI: Fetching primary data for 2024-12. [2025-09-17T18:34:10.926775] [INFO ] [REMOTE ] DOW: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T18:34:10.933978] [INFO ] [REMOTE ] DOW: Full fetch complete (77271 records). [2025-09-17T18:34:10.934093] [DEBUG] [VALIDATOR ] DOW: Validating primary data. [2025-09-17T18:34:10.934918] [FATAL] [VALIDATOR ] DOW: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:34:10.935018] [FATAL] [MAIN ] DOW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:34:10.935056] [WARN ] [MAIN ] DOW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:34:10.935095] [INFO ] [LOCAL ] DOW: Starting deletion of primary data. [2025-09-17T18:34:10.935151] [DEBUG] [LOCAL ] DOW: No primary data file found to delete. [2025-09-17T18:34:10.935186] [INFO ] [LOCAL ] DOW: Starting deletion of derivative data. [2025-09-17T18:34:10.935452] [DEBUG] [LOCAL ] DOW: Deleted derivative data file. [2025-09-17T18:34:10.936007] [INFO ] [MAIN ] Update Progress: 648/2371 symbols completed. DOW took 44.3s. Estimated remaining: 4h 10m 21s. Rate: 6.9 symbols/min [2025-09-17T18:34:11.107202] [INFO ] [MAIN ] DSL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:34:11.127765] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T18:34:11.162359] [DEBUG] [LOCAL ] DSL: Loaded 28139 existing records from primary storage. [2025-09-17T18:34:11.162518] [INFO ] [MAIN ] DSL: Loaded 28139 existing records. [2025-09-17T18:34:11.341941] [WARN ] [MAIN ] DSL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:34:11.342174] [INFO ] [MAIN ] DSL: Wiping existing primary data before full refresh. [2025-09-17T18:34:11.342226] [INFO ] [LOCAL ] DSL: Starting deletion of primary data. [2025-09-17T18:34:11.342832] [DEBUG] [LOCAL ] DSL: Deleted primary data file. [2025-09-17T18:34:11.342891] [INFO ] [MAIN ] DSL: Starting full primary refresh. [2025-09-17T18:34:11.619814] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-01. [2025-09-17T18:34:11.735571] [INFO ] [REMOTE ] DSL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:34:12.415770] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-11. [2025-09-17T18:34:12.575672] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T18:34:13.215806] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-01. [2025-09-17T18:34:13.604822] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T18:34:13.780693] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T18:34:14.015766] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-01. [2025-09-17T18:34:14.095421] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T18:34:14.815815] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-02. [2025-09-17T18:34:15.615778] [INFO ] [REMOTE ] DSL: Fetching primary data for 2024-12. [2025-09-17T18:34:15.642905] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T18:34:15.760993] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T18:34:16.415779] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-02. [2025-09-17T18:34:17.067175] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T18:34:17.215795] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-03. [2025-09-17T18:34:17.699694] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T18:34:18.015776] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-03. [2025-09-17T18:34:18.200912] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T18:34:18.815784] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-04. [2025-09-17T18:34:19.615681] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-02. [2025-09-17T18:34:19.845501] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T18:34:19.908182] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T18:34:20.415734] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-05. [2025-09-17T18:34:20.897446] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T18:34:21.201332] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T18:34:21.215682] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-03. [2025-09-17T18:34:22.015800] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-06. [2025-09-17T18:34:22.772320] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T18:34:22.815796] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-01. [2025-09-17T18:34:23.050574] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T18:34:23.615779] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-07. [2025-09-17T18:34:23.887153] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T18:34:24.351079] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T18:34:24.415749] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-08. [2025-09-17T18:34:25.159604] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T18:34:25.215742] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-02. [2025-09-17T18:34:26.015831] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-04. [2025-09-17T18:34:26.440741] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T18:34:26.815797] [INFO ] [REMOTE ] DRLL: Fetching primary data for 2025-09. [2025-09-17T18:34:27.586421] [INFO ] [REMOTE ] DRLL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T18:34:27.588253] [INFO ] [REMOTE ] DRLL: Full fetch complete (16399 records). [2025-09-17T18:34:27.588335] [DEBUG] [VALIDATOR ] DRLL: Validating primary data. [2025-09-17T18:34:27.620900] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-03. [2025-09-17T18:34:27.965270] [DEBUG] [VALIDATOR ] DRLL: All expected trading days are present. [2025-09-17T18:34:27.965456] [DEBUG] [VALIDATOR ] DRLL: Primary data validation passed. [2025-09-17T18:34:27.965936] [INFO ] [MAIN ] DRLL: Fetched primary data is valid. [2025-09-17T18:34:27.965999] [DEBUG] [LOCAL ] DRLL: Saving primary data. [2025-09-17T18:34:27.966817] [DEBUG] [LOCAL ] DRLL: Trimmed 16399 records to 10062 (keeping 200 days of data) [2025-09-17T18:34:28.028881] [DEBUG] [LOCAL ] DRLL: Primary data saved (10062 records). [2025-09-17T18:34:28.029044] [INFO ] [MAIN ] DRLL: Full history saved. [2025-09-17T18:34:28.029158] [INFO ] [MAIN ] Update Progress: 649/2371 symbols completed. DRLL took 21.9s. Estimated remaining: 4h 10m 34s. Rate: 6.9 symbols/min [2025-09-17T18:34:28.205556] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-17T18:34:28.252235] [INFO ] [MAIN ] DSM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:34:28.269324] [DEBUG] [LOCAL ] DSM: Loaded 15831 existing records from primary storage. [2025-09-17T18:34:28.269442] [INFO ] [MAIN ] DSM: Loaded 15831 existing records. [2025-09-17T18:34:28.420974] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-05. [2025-09-17T18:34:28.460469] [WARN ] [MAIN ] DSM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:34:28.460807] [INFO ] [MAIN ] DSM: Wiping existing primary data before full refresh. [2025-09-17T18:34:28.460854] [INFO ] [LOCAL ] DSM: Starting deletion of primary data. [2025-09-17T18:34:28.461304] [DEBUG] [LOCAL ] DSM: Deleted primary data file. [2025-09-17T18:34:28.461349] [INFO ] [MAIN ] DSM: Starting full primary refresh. [2025-09-17T18:34:28.827929] [INFO ] [REMOTE ] DSM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:34:29.019121] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T18:34:29.215783] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-04. [2025-09-17T18:34:30.015738] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-04. [2025-09-17T18:34:30.549225] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T18:34:30.710486] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T18:34:30.815838] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-05. [2025-09-17T18:34:31.615769] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-06. [2025-09-17T18:34:31.868468] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T18:34:31.916908] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T18:34:32.415797] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-11. [2025-09-17T18:34:33.165292] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T18:34:33.215740] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-07. [2025-09-17T18:34:33.974756] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T18:34:34.015764] [INFO ] [REMOTE ] DSM: Fetching primary data for 2024-12. [2025-09-17T18:34:34.815795] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-05. [2025-09-17T18:34:34.941336] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T18:34:35.004355] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T18:34:35.615767] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-08. [2025-09-17T18:34:36.415778] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-06. [2025-09-17T18:34:36.499610] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T18:34:36.789182] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T18:34:37.215835] [INFO ] [REMOTE ] DRI: Fetching primary data for 2025-09. [2025-09-17T18:34:37.279571] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T18:34:38.015790] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-07. [2025-09-17T18:34:38.815875] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-01. [2025-09-17T18:34:38.879635] [INFO ] [REMOTE ] DRI: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T18:34:38.885798] [INFO ] [REMOTE ] DRI: Full fetch complete (69243 records). [2025-09-17T18:34:38.885927] [DEBUG] [VALIDATOR ] DRI: Validating primary data. [2025-09-17T18:34:39.279663] [DEBUG] [VALIDATOR ] DRI: All expected trading days are present. [2025-09-17T18:34:39.279769] [DEBUG] [VALIDATOR ] DRI: Primary data validation passed. [2025-09-17T18:34:39.280592] [INFO ] [MAIN ] DRI: Fetched primary data is valid. [2025-09-17T18:34:39.280665] [DEBUG] [LOCAL ] DRI: Saving primary data. [2025-09-17T18:34:39.299626] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T18:34:39.306667] [DEBUG] [LOCAL ] DRI: Trimmed 69243 records to 47796 (keeping 200 days of data) [2025-09-17T18:34:39.422526] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T18:34:39.617904] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-02. [2025-09-17T18:34:39.632319] [DEBUG] [LOCAL ] DRI: Primary data saved (47796 records). [2025-09-17T18:34:39.632414] [INFO ] [MAIN ] DRI: Full history saved. [2025-09-17T18:34:39.632507] [INFO ] [MAIN ] Update Progress: 650/2371 symbols completed. DRI took 35.1s. Estimated remaining: 4h 10m 33s. Rate: 6.9 symbols/min [2025-09-17T18:34:39.810064] [INFO ] [MAIN ] DSMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:34:39.813900] [DEBUG] [LOCAL ] DSMC: Loaded 1993 existing records from primary storage. [2025-09-17T18:34:39.813985] [INFO ] [MAIN ] DSMC: Loaded 1993 existing records. [2025-09-17T18:34:39.995291] [WARN ] [MAIN ] DSMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:34:39.995537] [INFO ] [MAIN ] DSMC: Wiping existing primary data before full refresh. [2025-09-17T18:34:39.995581] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-17T18:34:39.995829] [DEBUG] [LOCAL ] DSMC: Deleted primary data file. [2025-09-17T18:34:39.995879] [INFO ] [MAIN ] DSMC: Starting full primary refresh. [2025-09-17T18:34:40.352711] [INFO ] [REMOTE ] DSMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:34:40.415718] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-11. [2025-09-17T18:34:40.723821] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T18:34:40.935932] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T18:34:41.215829] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-06. [2025-09-17T18:34:42.015833] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-08. [2025-09-17T18:34:42.815797] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-03. [2025-09-17T18:34:43.092350] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T18:34:43.154747] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T18:34:43.615803] [INFO ] [REMOTE ] DSL: Fetching primary data for 2025-09. [2025-09-17T18:34:44.031251] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T18:34:44.415782] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2024-12. [2025-09-17T18:34:44.605976] [INFO ] [REMOTE ] DSL: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T18:34:44.609876] [INFO ] [REMOTE ] DSL: Full fetch complete (41297 records). [2025-09-17T18:34:44.609988] [DEBUG] [VALIDATOR ] DSL: Validating primary data. [2025-09-17T18:34:44.720913] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-17T18:34:44.992145] [DEBUG] [VALIDATOR ] DSL: All expected trading days are present. [2025-09-17T18:34:44.992232] [DEBUG] [VALIDATOR ] DSL: Primary data validation passed. [2025-09-17T18:34:44.992860] [INFO ] [MAIN ] DSL: Fetched primary data is valid. [2025-09-17T18:34:44.992921] [DEBUG] [LOCAL ] DSL: Saving primary data. [2025-09-17T18:34:44.994041] [DEBUG] [LOCAL ] DSL: Trimmed 41297 records to 28148 (keeping 200 days of data) [2025-09-17T18:34:45.181541] [DEBUG] [LOCAL ] DSL: Primary data saved (28148 records). [2025-09-17T18:34:45.181718] [INFO ] [MAIN ] DSL: Full history saved. [2025-09-17T18:34:45.181830] [INFO ] [MAIN ] Update Progress: 651/2371 symbols completed. DSL took 34.2s. Estimated remaining: 4h 10m 16s. Rate: 6.9 symbols/min [2025-09-17T18:34:45.220966] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-01. [2025-09-17T18:34:45.370229] [INFO ] [MAIN ] DSU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:34:45.393798] [DEBUG] [LOCAL ] DSU: Loaded 21420 existing records from primary storage. [2025-09-17T18:34:45.393969] [INFO ] [MAIN ] DSU: Loaded 21420 existing records. [2025-09-17T18:34:45.669570] [WARN ] [MAIN ] DSU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:34:45.669923] [INFO ] [MAIN ] DSU: Wiping existing primary data before full refresh. [2025-09-17T18:34:45.669991] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-17T18:34:45.670891] [DEBUG] [LOCAL ] DSU: Deleted primary data file. [2025-09-17T18:34:45.670990] [INFO ] [MAIN ] DSU: Starting full primary refresh. [2025-09-17T18:34:45.858024] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T18:34:46.021066] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-07. [2025-09-17T18:34:46.211427] [INFO ] [REMOTE ] DSU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:34:46.815815] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-02. [2025-09-17T18:34:47.320401] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T18:34:47.615820] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-04. [2025-09-17T18:34:47.676472] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T18:34:48.415835] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-08. [2025-09-17T18:34:48.820904] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T18:34:49.215814] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-11. [2025-09-17T18:34:49.821909] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T18:34:50.015778] [INFO ] [REMOTE ] DRH: Fetching primary data for 2025-09. [2025-09-17T18:34:50.622199] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T18:34:50.815767] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-05. [2025-09-17T18:34:51.441926] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T18:34:51.615794] [INFO ] [REMOTE ] DSU: Fetching primary data for 2024-12. [2025-09-17T18:34:51.758374] [INFO ] [REMOTE ] DRH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T18:34:51.765093] [INFO ] [REMOTE ] DRH: Full fetch complete (71686 records). [2025-09-17T18:34:51.765239] [DEBUG] [VALIDATOR ] DRH: Validating primary data. [2025-09-17T18:34:52.162046] [DEBUG] [VALIDATOR ] DRH: All expected trading days are present. [2025-09-17T18:34:52.162145] [DEBUG] [VALIDATOR ] DRH: Primary data validation passed. [2025-09-17T18:34:52.163034] [INFO ] [MAIN ] DRH: Fetched primary data is valid. [2025-09-17T18:34:52.163084] [DEBUG] [LOCAL ] DRH: Saving primary data. [2025-09-17T18:34:52.164515] [DEBUG] [LOCAL ] DRH: Trimmed 71686 records to 50435 (keeping 200 days of data) [2025-09-17T18:34:52.425386] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-03. [2025-09-17T18:34:52.468836] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T18:34:52.481312] [DEBUG] [LOCAL ] DRH: Primary data saved (50435 records). [2025-09-17T18:34:52.481409] [INFO ] [MAIN ] DRH: Full history saved. [2025-09-17T18:34:52.482065] [INFO ] [MAIN ] Update Progress: 652/2371 symbols completed. DRH took 48.8s. Estimated remaining: 4h 10m 3s. Rate: 6.9 symbols/min [2025-09-17T18:34:52.649437] [INFO ] [MAIN ] DSX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:34:52.674475] [DEBUG] [LOCAL ] DSX: Loaded 24732 existing records from primary storage. [2025-09-17T18:34:52.674671] [INFO ] [MAIN ] DSX: Loaded 24732 existing records. [2025-09-17T18:34:52.850898] [WARN ] [MAIN ] DSX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:34:52.851105] [INFO ] [MAIN ] DSX: Wiping existing primary data before full refresh. [2025-09-17T18:34:52.851149] [INFO ] [LOCAL ] DSX: Starting deletion of primary data. [2025-09-17T18:34:52.851810] [DEBUG] [LOCAL ] DSX: Deleted primary data file. [2025-09-17T18:34:52.851861] [INFO ] [MAIN ] DSX: Starting full primary refresh. [2025-09-17T18:34:53.087858] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T18:34:53.216177] [INFO ] [REMOTE ] DSX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:34:53.216229] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-04. [2025-09-17T18:34:53.687877] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T18:34:54.015793] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-05. [2025-09-17T18:34:54.469192] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T18:34:54.815791] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-06. [2025-09-17T18:34:55.615791] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-01. [2025-09-17T18:34:55.751671] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T18:34:56.415805] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-11. [2025-09-17T18:34:56.783283] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T18:34:57.215782] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-06. [2025-09-17T18:34:57.559615] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T18:34:58.015793] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-02. [2025-09-17T18:34:58.218041] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T18:34:58.815750] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-07. [2025-09-17T18:34:59.131586] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T18:34:59.322892] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T18:34:59.615794] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-08. [2025-09-17T18:34:59.931346] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-08 (0.32 seconds). [2025-09-17T18:35:00.415827] [INFO ] [REMOTE ] DSMC: Fetching primary data for 2025-09. [2025-09-17T18:35:01.215847] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-03. [2025-09-17T18:35:01.315737] [INFO ] [REMOTE ] DSMC: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T18:35:01.316859] [INFO ] [REMOTE ] DSMC: Full fetch complete (2819 records). [2025-09-17T18:35:01.316944] [DEBUG] [VALIDATOR ] DSMC: Validating primary data. [2025-09-17T18:35:01.317364] [FATAL] [VALIDATOR ] DSMC: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:35:01.317445] [FATAL] [MAIN ] DSMC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:35:01.317483] [WARN ] [MAIN ] DSMC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:35:01.317527] [INFO ] [LOCAL ] DSMC: Starting deletion of primary data. [2025-09-17T18:35:01.317600] [DEBUG] [LOCAL ] DSMC: No primary data file found to delete. [2025-09-17T18:35:01.317674] [INFO ] [LOCAL ] DSMC: Starting deletion of derivative data. [2025-09-17T18:35:01.318023] [DEBUG] [LOCAL ] DSMC: Deleted derivative data file. [2025-09-17T18:35:01.318128] [INFO ] [MAIN ] Update Progress: 653/2371 symbols completed. DSMC took 21.7s. Estimated remaining: 4h 9m 55s. Rate: 6.9 symbols/min [2025-09-17T18:35:01.517185] [INFO ] [MAIN ] DT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:35:01.569752] [DEBUG] [LOCAL ] DT: Loaded 52955 existing records from primary storage. [2025-09-17T18:35:01.569913] [INFO ] [MAIN ] DT: Loaded 52955 existing records. [2025-09-17T18:35:01.753460] [WARN ] [MAIN ] DT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:35:01.753830] [INFO ] [MAIN ] DT: Wiping existing primary data before full refresh. [2025-09-17T18:35:01.753886] [INFO ] [LOCAL ] DT: Starting deletion of primary data. [2025-09-17T18:35:01.755000] [DEBUG] [LOCAL ] DT: Deleted primary data file. [2025-09-17T18:35:01.755053] [INFO ] [MAIN ] DT: Starting full primary refresh. [2025-09-17T18:35:02.021014] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-07. [2025-09-17T18:35:02.153549] [INFO ] [REMOTE ] DT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:35:02.710135] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T18:35:02.815810] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-11. [2025-09-17T18:35:03.065184] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T18:35:03.615791] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-04. [2025-09-17T18:35:04.421271] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-08. [2025-09-17T18:35:04.435334] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T18:35:04.877140] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T18:35:05.215795] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-05. [2025-09-17T18:35:05.348890] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T18:35:06.015835] [INFO ] [REMOTE ] DSX: Fetching primary data for 2024-12. [2025-09-17T18:35:06.254886] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T18:35:06.815835] [INFO ] [REMOTE ] DT: Fetching primary data for 2024-12. [2025-09-17T18:35:07.523122] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T18:35:07.615829] [INFO ] [REMOTE ] DSM: Fetching primary data for 2025-09. [2025-09-17T18:35:08.325966] [INFO ] [REMOTE ] DSM: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T18:35:08.328805] [INFO ] [REMOTE ] DSM: Full fetch complete (24776 records). [2025-09-17T18:35:08.328903] [DEBUG] [VALIDATOR ] DSM: Validating primary data. [2025-09-17T18:35:08.422829] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-01. [2025-09-17T18:35:08.703218] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T18:35:08.774324] [DEBUG] [VALIDATOR ] DSM: All expected trading days are present. [2025-09-17T18:35:08.774410] [DEBUG] [VALIDATOR ] DSM: Primary data validation passed. [2025-09-17T18:35:08.774902] [INFO ] [MAIN ] DSM: Fetched primary data is valid. [2025-09-17T18:35:08.774961] [DEBUG] [LOCAL ] DSM: Saving primary data. [2025-09-17T18:35:08.775696] [DEBUG] [LOCAL ] DSM: Trimmed 24776 records to 15865 (keeping 200 days of data) [2025-09-17T18:35:08.869613] [DEBUG] [LOCAL ] DSM: Primary data saved (15865 records). [2025-09-17T18:35:08.869790] [INFO ] [MAIN ] DSM: Full history saved. [2025-09-17T18:35:08.869877] [INFO ] [MAIN ] Update Progress: 654/2371 symbols completed. DSM took 40.8s. Estimated remaining: 4h 9m 43s. Rate: 6.9 symbols/min [2025-09-17T18:35:09.038107] [INFO ] [MAIN ] DTB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:35:09.044170] [DEBUG] [LOCAL ] DTB: Loaded 4660 existing records from primary storage. [2025-09-17T18:35:09.044254] [INFO ] [MAIN ] DTB: Loaded 4660 existing records. [2025-09-17T18:35:09.220760] [WARN ] [MAIN ] DTB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:35:09.216951] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-01. [2025-09-17T18:35:09.221940] [INFO ] [MAIN ] DTB: Wiping existing primary data before full refresh. [2025-09-17T18:35:09.222009] [INFO ] [LOCAL ] DTB: Starting deletion of primary data. [2025-09-17T18:35:09.222283] [DEBUG] [LOCAL ] DTB: Deleted primary data file. [2025-09-17T18:35:09.222329] [INFO ] [MAIN ] DTB: Starting full primary refresh. [2025-09-17T18:35:09.583185] [INFO ] [REMOTE ] DTB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:35:09.705143] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T18:35:10.015792] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-11. [2025-09-17T18:35:10.815787] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-06. [2025-09-17T18:35:11.065985] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T18:35:11.112413] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T18:35:11.575341] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T18:35:11.615783] [INFO ] [REMOTE ] DTB: Fetching primary data for 2024-12. [2025-09-17T18:35:12.272222] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T18:35:12.415779] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-02. [2025-09-17T18:35:13.215780] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-01. [2025-09-17T18:35:13.735758] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T18:35:13.786979] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T18:35:14.015792] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-02. [2025-09-17T18:35:14.815766] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-03. [2025-09-17T18:35:15.420134] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T18:35:15.615770] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-03. [2025-09-17T18:35:16.415792] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-07. [2025-09-17T18:35:16.714937] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T18:35:17.057315] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T18:35:17.215777] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-04. [2025-09-17T18:35:17.759705] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T18:35:18.015774] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-08. [2025-09-17T18:35:18.438366] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T18:35:18.815763] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-05. [2025-09-17T18:35:19.147484] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T18:35:19.615782] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-02. [2025-09-17T18:35:19.889916] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T18:35:20.105738] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T18:35:20.415816] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-03. [2025-09-17T18:35:21.073019] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T18:35:21.215814] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-04. [2025-09-17T18:35:22.015806] [INFO ] [REMOTE ] DSU: Fetching primary data for 2025-09. [2025-09-17T18:35:22.815842] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-04. [2025-09-17T18:35:23.047057] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T18:35:23.082152] [INFO ] [REMOTE ] DSU: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T18:35:23.085271] [INFO ] [REMOTE ] DSU: Full fetch complete (31619 records). [2025-09-17T18:35:23.085349] [DEBUG] [VALIDATOR ] DSU: Validating primary data. [2025-09-17T18:35:23.085903] [FATAL] [VALIDATOR ] DSU: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:35:23.085997] [FATAL] [MAIN ] DSU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:35:23.086036] [WARN ] [MAIN ] DSU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:35:23.086112] [INFO ] [LOCAL ] DSU: Starting deletion of primary data. [2025-09-17T18:35:23.086178] [DEBUG] [LOCAL ] DSU: No primary data file found to delete. [2025-09-17T18:35:23.086214] [INFO ] [LOCAL ] DSU: Starting deletion of derivative data. [2025-09-17T18:35:23.086470] [DEBUG] [LOCAL ] DSU: Deleted derivative data file. [2025-09-17T18:35:23.086564] [INFO ] [MAIN ] Update Progress: 655/2371 symbols completed. DSU took 37.9s. Estimated remaining: 4h 9m 49s. Rate: 6.9 symbols/min [2025-09-17T18:35:23.210540] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-17T18:35:23.267811] [INFO ] [MAIN ] DTE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:35:23.314954] [DEBUG] [LOCAL ] DTE: Loaded 48037 existing records from primary storage. [2025-09-17T18:35:23.315119] [INFO ] [MAIN ] DTE: Loaded 48037 existing records. [2025-09-17T18:35:23.494539] [WARN ] [MAIN ] DTE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:35:23.494814] [INFO ] [MAIN ] DTE: Wiping existing primary data before full refresh. [2025-09-17T18:35:23.494860] [INFO ] [LOCAL ] DTE: Starting deletion of primary data. [2025-09-17T18:35:23.495988] [DEBUG] [LOCAL ] DTE: Deleted primary data file. [2025-09-17T18:35:23.496046] [INFO ] [MAIN ] DTE: Starting full primary refresh. [2025-09-17T18:35:23.620931] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-06. [2025-09-17T18:35:23.875841] [INFO ] [REMOTE ] DTE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:35:24.415825] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-05. [2025-09-17T18:35:24.923704] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T18:35:25.146521] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T18:35:25.215812] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-06. [2025-09-17T18:35:25.800959] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T18:35:26.015787] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-05. [2025-09-17T18:35:26.815821] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-07. [2025-09-17T18:35:27.493636] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T18:35:27.615693] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-08. [2025-09-17T18:35:27.683137] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T18:35:28.233441] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T18:35:28.415825] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-11. [2025-09-17T18:35:29.215794] [INFO ] [REMOTE ] DTB: Fetching primary data for 2025-09. [2025-09-17T18:35:30.015852] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-07. [2025-09-17T18:35:30.114579] [INFO ] [REMOTE ] DTB: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T18:35:30.116093] [INFO ] [REMOTE ] DTB: Full fetch complete (6741 records). [2025-09-17T18:35:30.116167] [DEBUG] [VALIDATOR ] DTB: Validating primary data. [2025-09-17T18:35:30.531084] [DEBUG] [VALIDATOR ] DTB: All expected trading days are present. [2025-09-17T18:35:30.531269] [DEBUG] [VALIDATOR ] DTB: Primary data validation passed. [2025-09-17T18:35:30.531474] [INFO ] [MAIN ] DTB: Fetched primary data is valid. [2025-09-17T18:35:30.531541] [DEBUG] [LOCAL ] DTB: Saving primary data. [2025-09-17T18:35:30.532199] [DEBUG] [LOCAL ] DTB: Trimmed 6741 records to 4684 (keeping 200 days of data) [2025-09-17T18:35:30.584838] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-17T18:35:30.599633] [DEBUG] [LOCAL ] DTB: Primary data saved (4684 records). [2025-09-17T18:35:30.599753] [INFO ] [MAIN ] DTB: Full history saved. [2025-09-17T18:35:30.599827] [INFO ] [MAIN ] Update Progress: 656/2371 symbols completed. DTB took 21.7s. Estimated remaining: 4h 9m 37s. Rate: 6.9 symbols/min [2025-09-17T18:35:30.767479] [INFO ] [MAIN ] DTF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:35:30.767731] [DEBUG] [LOCAL ] DTF: No existing data file found in primary storage. [2025-09-17T18:35:30.767772] [WARN ] [MAIN ] DTF: No existing data found, performing full refresh instead. [2025-09-17T18:35:30.767887] [INFO ] [MAIN ] DTF: Wiping existing primary data before full refresh. [2025-09-17T18:35:30.767925] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-17T18:35:30.767965] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-17T18:35:30.767996] [INFO ] [MAIN ] DTF: Starting full primary refresh. [2025-09-17T18:35:30.822082] [INFO ] [REMOTE ] DTE: Fetching primary data for 2024-12. [2025-09-17T18:35:31.124043] [INFO ] [REMOTE ] DTF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:35:31.441087] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T18:35:31.615774] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-08. [2025-09-17T18:35:32.415811] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-11. [2025-09-17T18:35:32.672332] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T18:35:32.777608] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T18:35:33.193521] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T18:35:33.215717] [INFO ] [REMOTE ] DTF: Fetching primary data for 2024-12. [2025-09-17T18:35:33.803061] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T18:35:34.015781] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-06. [2025-09-17T18:35:34.815806] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-01. [2025-09-17T18:35:35.615780] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-01. [2025-09-17T18:35:35.731586] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T18:35:36.004402] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T18:35:36.123519] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T18:35:36.415789] [INFO ] [REMOTE ] DSX: Fetching primary data for 2025-09. [2025-09-17T18:35:37.215813] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-02. [2025-09-17T18:35:37.683593] [INFO ] [REMOTE ] DSX: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T18:35:37.689945] [INFO ] [REMOTE ] DSX: Full fetch complete (37775 records). [2025-09-17T18:35:37.690219] [DEBUG] [VALIDATOR ] DSX: Validating primary data. [2025-09-17T18:35:37.819764] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T18:35:38.021531] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-03. [2025-09-17T18:35:38.269767] [DEBUG] [VALIDATOR ] DSX: All expected trading days are present. [2025-09-17T18:35:38.269876] [DEBUG] [VALIDATOR ] DSX: Primary data validation passed. [2025-09-17T18:35:38.270951] [INFO ] [MAIN ] DSX: Fetched primary data is valid. [2025-09-17T18:35:38.271039] [DEBUG] [LOCAL ] DSX: Saving primary data. [2025-09-17T18:35:38.272512] [DEBUG] [LOCAL ] DSX: Trimmed 37775 records to 24715 (keeping 200 days of data) [2025-09-17T18:35:38.400741] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-17T18:35:38.482540] [DEBUG] [LOCAL ] DSX: Primary data saved (24715 records). [2025-09-17T18:35:38.482760] [INFO ] [MAIN ] DSX: Full history saved. [2025-09-17T18:35:38.482892] [INFO ] [MAIN ] Update Progress: 657/2371 symbols completed. DSX took 46.0s. Estimated remaining: 4h 9m 26s. Rate: 6.9 symbols/min [2025-09-17T18:35:38.671097] [INFO ] [MAIN ] DTG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:35:38.678891] [DEBUG] [LOCAL ] DTG: Loaded 5874 existing records from primary storage. [2025-09-17T18:35:38.679013] [INFO ] [MAIN ] DTG: Loaded 5874 existing records. [2025-09-17T18:35:38.825507] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-04. [2025-09-17T18:35:38.869792] [WARN ] [MAIN ] DTG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:35:38.870074] [INFO ] [MAIN ] DTG: Wiping existing primary data before full refresh. [2025-09-17T18:35:38.870136] [INFO ] [LOCAL ] DTG: Starting deletion of primary data. [2025-09-17T18:35:38.870507] [DEBUG] [LOCAL ] DTG: Deleted primary data file. [2025-09-17T18:35:38.870561] [INFO ] [MAIN ] DTG: Starting full primary refresh. [2025-09-17T18:35:39.235165] [INFO ] [REMOTE ] DTG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:35:39.437703] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T18:35:39.615772] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-05. [2025-09-17T18:35:40.064562] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T18:35:40.415826] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-11. [2025-09-17T18:35:41.094028] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T18:35:41.215813] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-02. [2025-09-17T18:35:42.015795] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-06. [2025-09-17T18:35:42.368338] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T18:35:42.815796] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-07. [2025-09-17T18:35:42.951918] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T18:35:43.615782] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-03. [2025-09-17T18:35:44.415809] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-07. [2025-09-17T18:35:44.806157] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T18:35:44.864350] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T18:35:45.215791] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-08. [2025-09-17T18:35:45.417879] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T18:35:45.603039] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-17T18:35:46.015779] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-04. [2025-09-17T18:35:46.815782] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-08. [2025-09-17T18:35:47.615787] [INFO ] [REMOTE ] DTG: Fetching primary data for 2024-12. [2025-09-17T18:35:47.862138] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T18:35:48.097990] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T18:35:48.415883] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-01. [2025-09-17T18:35:48.635007] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T18:35:48.877993] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T18:35:49.215785] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-02. [2025-09-17T18:35:49.919672] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T18:35:50.015746] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-03. [2025-09-17T18:35:50.738531] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T18:35:50.815800] [INFO ] [REMOTE ] DTF: Fetching primary data for 2025-09. [2025-09-17T18:35:51.293400] [INFO ] [REMOTE ] DTF: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T18:35:51.294232] [INFO ] [REMOTE ] DTF: Full fetch complete (2208 records). [2025-09-17T18:35:51.294299] [DEBUG] [VALIDATOR ] DTF: Validating primary data. [2025-09-17T18:35:51.480436] [WARN ] [VALIDATOR ] DTF: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T18:35:51.480666] [FATAL] [MAIN ] DTF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:35:51.480718] [WARN ] [MAIN ] DTF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:35:51.480765] [INFO ] [LOCAL ] DTF: Starting deletion of primary data. [2025-09-17T18:35:51.480821] [DEBUG] [LOCAL ] DTF: No primary data file found to delete. [2025-09-17T18:35:51.480858] [INFO ] [LOCAL ] DTF: Starting deletion of derivative data. [2025-09-17T18:35:51.480919] [DEBUG] [LOCAL ] DTF: No derivative data file found to delete. [2025-09-17T18:35:51.480982] [INFO ] [MAIN ] Update Progress: 658/2371 symbols completed. DTF took 20.9s. Estimated remaining: 4h 9m 28s. Rate: 6.9 symbols/min [2025-09-17T18:35:51.624669] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-04. [2025-09-17T18:35:51.655298] [INFO ] [MAIN ] DTM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:35:51.697737] [DEBUG] [LOCAL ] DTM: Loaded 44706 existing records from primary storage. [2025-09-17T18:35:51.697881] [INFO ] [MAIN ] DTM: Loaded 44706 existing records. [2025-09-17T18:35:51.875684] [WARN ] [MAIN ] DTM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:35:51.875920] [INFO ] [MAIN ] DTM: Wiping existing primary data before full refresh. [2025-09-17T18:35:51.875965] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-17T18:35:51.877104] [DEBUG] [LOCAL ] DTM: Deleted primary data file. [2025-09-17T18:35:51.877161] [INFO ] [MAIN ] DTM: Starting full primary refresh. [2025-09-17T18:35:52.236467] [INFO ] [REMOTE ] DTM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:35:52.378324] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T18:35:52.415732] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-11. [2025-09-17T18:35:53.215811] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-05. [2025-09-17T18:35:54.015809] [INFO ] [REMOTE ] DT: Fetching primary data for 2025-09. [2025-09-17T18:35:54.303315] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T18:35:54.815833] [INFO ] [REMOTE ] DTM: Fetching primary data for 2024-12. [2025-09-17T18:35:55.026445] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T18:35:55.615782] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-05. [2025-09-17T18:35:55.930527] [INFO ] [REMOTE ] DT: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T18:35:55.937445] [INFO ] [REMOTE ] DT: Full fetch complete (76468 records). [2025-09-17T18:35:55.937565] [DEBUG] [VALIDATOR ] DT: Validating primary data. [2025-09-17T18:35:56.351800] [DEBUG] [VALIDATOR ] DT: All expected trading days are present. [2025-09-17T18:35:56.351970] [DEBUG] [VALIDATOR ] DT: Primary data validation passed. [2025-09-17T18:35:56.352177] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T18:35:56.353278] [INFO ] [MAIN ] DT: Fetched primary data is valid. [2025-09-17T18:35:56.355186] [DEBUG] [LOCAL ] DT: Saving primary data. [2025-09-17T18:35:56.359007] [DEBUG] [LOCAL ] DT: Trimmed 76468 records to 52956 (keeping 200 days of data) [2025-09-17T18:35:56.435560] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-06. [2025-09-17T18:35:56.477715] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T18:35:56.726954] [DEBUG] [LOCAL ] DT: Primary data saved (52956 records). [2025-09-17T18:35:56.727110] [INFO ] [MAIN ] DT: Full history saved. [2025-09-17T18:35:56.727194] [INFO ] [MAIN ] Update Progress: 659/2371 symbols completed. DT took 55.4s. Estimated remaining: 4h 9m 10s. Rate: 6.9 symbols/min [2025-09-17T18:35:56.903903] [INFO ] [MAIN ] DTW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:35:56.911367] [DEBUG] [LOCAL ] DTW: Loaded 4921 existing records from primary storage. [2025-09-17T18:35:56.911503] [INFO ] [MAIN ] DTW: Loaded 4921 existing records. [2025-09-17T18:35:57.103434] [WARN ] [MAIN ] DTW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:35:57.103739] [INFO ] [MAIN ] DTW: Wiping existing primary data before full refresh. [2025-09-17T18:35:57.103787] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-17T18:35:57.104068] [DEBUG] [LOCAL ] DTW: Deleted primary data file. [2025-09-17T18:35:57.104112] [INFO ] [MAIN ] DTW: Starting full primary refresh. [2025-09-17T18:35:57.220987] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-01. [2025-09-17T18:35:57.472062] [INFO ] [REMOTE ] DTW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:35:58.015781] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-06. [2025-09-17T18:35:58.206898] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T18:35:58.446207] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T18:35:58.622409] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T18:35:58.815787] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-07. [2025-09-17T18:35:59.407428] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T18:35:59.615796] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-02. [2025-09-17T18:36:00.415783] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-07. [2025-09-17T18:36:01.215784] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-11. [2025-09-17T18:36:01.357582] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T18:36:02.015783] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-03. [2025-09-17T18:36:02.239880] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T18:36:02.327286] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T18:36:02.815802] [INFO ] [REMOTE ] DTW: Fetching primary data for 2024-12. [2025-09-17T18:36:03.595018] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T18:36:03.615682] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-01. [2025-09-17T18:36:03.730720] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T18:36:04.281718] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T18:36:04.415822] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-08. [2025-09-17T18:36:05.215779] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-04. [2025-09-17T18:36:05.230457] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T18:36:06.015796] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-02. [2025-09-17T18:36:06.594230] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T18:36:06.820696] [INFO ] [REMOTE ] DTG: Fetching primary data for 2025-09. [2025-09-17T18:36:06.828215] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T18:36:07.402702] [INFO ] [REMOTE ] DTG: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T18:36:07.404101] [INFO ] [REMOTE ] DTG: Full fetch complete (8996 records). [2025-09-17T18:36:07.404195] [DEBUG] [VALIDATOR ] DTG: Validating primary data. [2025-09-17T18:36:07.625603] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-08. [2025-09-17T18:36:07.786893] [DEBUG] [VALIDATOR ] DTG: All expected trading days are present. [2025-09-17T18:36:07.786979] [DEBUG] [VALIDATOR ] DTG: Primary data validation passed. [2025-09-17T18:36:07.787208] [INFO ] [MAIN ] DTG: Fetched primary data is valid. [2025-09-17T18:36:07.787278] [DEBUG] [LOCAL ] DTG: Saving primary data. [2025-09-17T18:36:07.788359] [DEBUG] [LOCAL ] DTG: Trimmed 8996 records to 5889 (keeping 200 days of data) [2025-09-17T18:36:07.824413] [DEBUG] [LOCAL ] DTG: Primary data saved (5889 records). [2025-09-17T18:36:07.824548] [INFO ] [MAIN ] DTG: Full history saved. [2025-09-17T18:36:07.824745] [INFO ] [MAIN ] Update Progress: 660/2371 symbols completed. DTG took 29.3s. Estimated remaining: 4h 9m 8s. Rate: 6.9 symbols/min [2025-09-17T18:36:07.996557] [INFO ] [MAIN ] DUK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:36:08.051961] [DEBUG] [LOCAL ] DUK: Loaded 53479 existing records from primary storage. [2025-09-17T18:36:08.052102] [INFO ] [MAIN ] DUK: Loaded 53479 existing records. [2025-09-17T18:36:08.236012] [WARN ] [MAIN ] DUK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:36:08.236241] [INFO ] [MAIN ] DUK: Wiping existing primary data before full refresh. [2025-09-17T18:36:08.236295] [INFO ] [LOCAL ] DUK: Starting deletion of primary data. [2025-09-17T18:36:08.237475] [DEBUG] [LOCAL ] DUK: Deleted primary data file. [2025-09-17T18:36:08.237541] [INFO ] [MAIN ] DUK: Starting full primary refresh. [2025-09-17T18:36:08.420741] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-05. [2025-09-17T18:36:08.605993] [INFO ] [REMOTE ] DUK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:36:09.215780] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-03. [2025-09-17T18:36:09.469004] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T18:36:09.820746] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T18:36:10.015766] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-04. [2025-09-17T18:36:10.123241] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T18:36:10.747447] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T18:36:10.815780] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-11. [2025-09-17T18:36:11.615779] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-06. [2025-09-17T18:36:12.415778] [INFO ] [REMOTE ] DTE: Fetching primary data for 2025-09. [2025-09-17T18:36:12.703226] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T18:36:12.831117] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T18:36:13.215774] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-07. [2025-09-17T18:36:14.015772] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-05. [2025-09-17T18:36:14.107598] [INFO ] [REMOTE ] DTE: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T18:36:14.114358] [INFO ] [REMOTE ] DTE: Full fetch complete (69139 records). [2025-09-17T18:36:14.114522] [DEBUG] [VALIDATOR ] DTE: Validating primary data. [2025-09-17T18:36:14.528094] [DEBUG] [VALIDATOR ] DTE: All expected trading days are present. [2025-09-17T18:36:14.528247] [DEBUG] [VALIDATOR ] DTE: Primary data validation passed. [2025-09-17T18:36:14.529179] [INFO ] [MAIN ] DTE: Fetched primary data is valid. [2025-09-17T18:36:14.529284] [DEBUG] [LOCAL ] DTE: Saving primary data. [2025-09-17T18:36:14.532580] [DEBUG] [LOCAL ] DTE: Trimmed 69139 records to 47994 (keeping 200 days of data) [2025-09-17T18:36:14.693561] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T18:36:14.817492] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-08. [2025-09-17T18:36:14.822781] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T18:36:14.904602] [DEBUG] [LOCAL ] DTE: Primary data saved (47994 records). [2025-09-17T18:36:14.904797] [INFO ] [MAIN ] DTE: Full history saved. [2025-09-17T18:36:14.904909] [INFO ] [MAIN ] Update Progress: 661/2371 symbols completed. DTE took 51.8s. Estimated remaining: 4h 8m 55s. Rate: 6.9 symbols/min [2025-09-17T18:36:15.078368] [INFO ] [MAIN ] DUKB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:36:15.087009] [DEBUG] [LOCAL ] DUKB: Loaded 6446 existing records from primary storage. [2025-09-17T18:36:15.087124] [INFO ] [MAIN ] DUKB: Loaded 6446 existing records. [2025-09-17T18:36:15.288594] [WARN ] [MAIN ] DUKB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:36:15.289125] [INFO ] [MAIN ] DUKB: Wiping existing primary data before full refresh. [2025-09-17T18:36:15.289177] [INFO ] [LOCAL ] DUKB: Starting deletion of primary data. [2025-09-17T18:36:15.289562] [DEBUG] [LOCAL ] DUKB: Deleted primary data file. [2025-09-17T18:36:15.289620] [INFO ] [MAIN ] DUKB: Starting full primary refresh. [2025-09-17T18:36:15.620902] [INFO ] [REMOTE ] DUK: Fetching primary data for 2024-12. [2025-09-17T18:36:15.660637] [INFO ] [REMOTE ] DUKB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:36:16.416267] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-06. [2025-09-17T18:36:16.419711] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T18:36:16.979348] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T18:36:17.215788] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-07. [2025-09-17T18:36:17.264917] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T18:36:17.930474] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T18:36:18.015760] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-08. [2025-09-17T18:36:18.599862] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T18:36:18.815765] [INFO ] [REMOTE ] DTM: Fetching primary data for 2025-09. [2025-09-17T18:36:19.615787] [INFO ] [REMOTE ] DTW: Fetching primary data for 2025-09. [2025-09-17T18:36:20.269308] [INFO ] [REMOTE ] DTW: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T18:36:20.270918] [INFO ] [REMOTE ] DTW: Full fetch complete (7881 records). [2025-09-17T18:36:20.270993] [DEBUG] [VALIDATOR ] DTW: Validating primary data. [2025-09-17T18:36:20.271848] [FATAL] [VALIDATOR ] DTW: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:36:20.271922] [FATAL] [MAIN ] DTW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:36:20.271977] [WARN ] [MAIN ] DTW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:36:20.272023] [INFO ] [LOCAL ] DTW: Starting deletion of primary data. [2025-09-17T18:36:20.272079] [DEBUG] [LOCAL ] DTW: No primary data file found to delete. [2025-09-17T18:36:20.272123] [INFO ] [LOCAL ] DTW: Starting deletion of derivative data. [2025-09-17T18:36:20.272428] [DEBUG] [LOCAL ] DTW: Deleted derivative data file. [2025-09-17T18:36:20.272509] [INFO ] [MAIN ] Update Progress: 662/2371 symbols completed. DTW took 23.5s. Estimated remaining: 4h 8m 37s. Rate: 6.9 symbols/min [2025-09-17T18:36:20.425069] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-11. [2025-09-17T18:36:20.460453] [INFO ] [MAIN ] DV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:36:20.477198] [INFO ] [REMOTE ] DTM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T18:36:20.483302] [INFO ] [REMOTE ] DTM: Full fetch complete (64366 records). [2025-09-17T18:36:20.483461] [DEBUG] [VALIDATOR ] DTM: Validating primary data. [2025-09-17T18:36:20.484340] [FATAL] [VALIDATOR ] DTM: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:36:20.484439] [FATAL] [MAIN ] DTM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:36:20.484477] [WARN ] [MAIN ] DTM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:36:20.484525] [INFO ] [LOCAL ] DTM: Starting deletion of primary data. [2025-09-17T18:36:20.484587] [DEBUG] [LOCAL ] DTM: No primary data file found to delete. [2025-09-17T18:36:20.484626] [INFO ] [LOCAL ] DTM: Starting deletion of derivative data. [2025-09-17T18:36:20.484963] [DEBUG] [LOCAL ] DTM: Deleted derivative data file. [2025-09-17T18:36:20.485065] [INFO ] [MAIN ] Update Progress: 663/2371 symbols completed. DTM took 29.0s. Estimated remaining: 4h 8m 7s. Rate: 6.9 symbols/min [2025-09-17T18:36:20.704375] [INFO ] [MAIN ] DVA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:36:20.708311] [DEBUG] [LOCAL ] DV: Loaded 51294 existing records from primary storage. [2025-09-17T18:36:20.708488] [INFO ] [MAIN ] DV: Loaded 51294 existing records. [2025-09-17T18:36:20.912738] [WARN ] [MAIN ] DV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:36:20.913176] [INFO ] [MAIN ] DV: Wiping existing primary data before full refresh. [2025-09-17T18:36:20.913227] [INFO ] [LOCAL ] DV: Starting deletion of primary data. [2025-09-17T18:36:20.914220] [DEBUG] [LOCAL ] DV: Deleted primary data file. [2025-09-17T18:36:20.914292] [INFO ] [MAIN ] DV: Starting full primary refresh. [2025-09-17T18:36:21.020254] [DEBUG] [LOCAL ] DVA: Loaded 41816 existing records from primary storage. [2025-09-17T18:36:21.039385] [INFO ] [MAIN ] DVA: Loaded 41816 existing records. [2025-09-17T18:36:21.231466] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T18:36:21.228730] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-01. [2025-09-17T18:36:21.407111] [WARN ] [MAIN ] DVA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:36:21.431964] [INFO ] [MAIN ] DVA: Wiping existing primary data before full refresh. [2025-09-17T18:36:21.442589] [INFO ] [LOCAL ] DVA: Starting deletion of primary data. [2025-09-17T18:36:21.474030] [DEBUG] [LOCAL ] DVA: Deleted primary data file. [2025-09-17T18:36:21.474299] [INFO ] [MAIN ] DVA: Starting full primary refresh. [2025-09-17T18:36:21.595523] [INFO ] [REMOTE ] DV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:36:21.891257] [INFO ] [REMOTE ] DVA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:36:22.015811] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-11. [2025-09-17T18:36:22.815823] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-11. [2025-09-17T18:36:23.262315] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T18:36:23.615740] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-02. [2025-09-17T18:36:23.799013] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T18:36:24.415773] [INFO ] [REMOTE ] DVA: Fetching primary data for 2024-12. [2025-09-17T18:36:24.668444] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T18:36:25.215791] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2024-12. [2025-09-17T18:36:25.577206] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-17T18:36:25.679487] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T18:36:25.724020] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T18:36:26.015775] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-01. [2025-09-17T18:36:26.815757] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-01. [2025-09-17T18:36:26.857846] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T18:36:27.615789] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-03. [2025-09-17T18:36:28.247987] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T18:36:28.415746] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-02. [2025-09-17T18:36:29.215799] [INFO ] [REMOTE ] DV: Fetching primary data for 2024-12. [2025-09-17T18:36:29.519307] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T18:36:29.604681] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T18:36:30.015793] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-03. [2025-09-17T18:36:30.635696] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T18:36:30.815783] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-01. [2025-09-17T18:36:31.615814] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-04. [2025-09-17T18:36:31.754946] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T18:36:32.357614] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T18:36:32.415742] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-02. [2025-09-17T18:36:33.215783] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-04. [2025-09-17T18:36:33.435745] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T18:36:34.022170] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-05. [2025-09-17T18:36:34.027122] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T18:36:34.815746] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-02. [2025-09-17T18:36:35.015349] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T18:36:35.615828] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-03. [2025-09-17T18:36:35.623101] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T18:36:35.981923] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T18:36:36.415812] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-06. [2025-09-17T18:36:37.215810] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-05. [2025-09-17T18:36:37.581468] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T18:36:37.753451] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T18:36:38.015816] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-04. [2025-09-17T18:36:38.743902] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T18:36:38.815827] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-03. [2025-09-17T18:36:39.445059] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T18:36:39.615783] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-04. [2025-09-17T18:36:39.775898] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T18:36:40.352262] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T18:36:40.415822] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-05. [2025-09-17T18:36:41.215808] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-07. [2025-09-17T18:36:42.015829] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-06. [2025-09-17T18:36:42.156716] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T18:36:42.815809] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-06. [2025-09-17T18:36:43.134705] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T18:36:43.552201] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T18:36:43.615761] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-07. [2025-09-17T18:36:44.257402] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T18:36:44.415840] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-07. [2025-09-17T18:36:45.215834] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-08. [2025-09-17T18:36:45.252528] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T18:36:46.015792] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-05. [2025-09-17T18:36:46.189867] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T18:36:46.817060] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-08. [2025-09-17T18:36:46.820036] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T18:36:46.831778] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T18:36:47.615830] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-06. [2025-09-17T18:36:48.360011] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T18:36:48.415770] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-08. [2025-09-17T18:36:48.766481] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T18:36:49.215789] [INFO ] [REMOTE ] DV: Fetching primary data for 2025-09. [2025-09-17T18:36:49.709658] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T18:36:50.015845] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-07. [2025-09-17T18:36:50.815836] [INFO ] [REMOTE ] DUK: Fetching primary data for 2025-09. [2025-09-17T18:36:50.862106] [INFO ] [REMOTE ] DV: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T18:36:50.877952] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T18:36:50.880774] [INFO ] [REMOTE ] DV: Full fetch complete (72942 records). [2025-09-17T18:36:50.881237] [DEBUG] [VALIDATOR ] DV: Validating primary data. [2025-09-17T18:36:51.278210] [DEBUG] [VALIDATOR ] DV: All expected trading days are present. [2025-09-17T18:36:51.278299] [DEBUG] [VALIDATOR ] DV: Primary data validation passed. [2025-09-17T18:36:51.279142] [INFO ] [MAIN ] DV: Fetched primary data is valid. [2025-09-17T18:36:51.279191] [DEBUG] [LOCAL ] DV: Saving primary data. [2025-09-17T18:36:51.281157] [DEBUG] [LOCAL ] DV: Trimmed 72942 records to 51293 (keeping 200 days of data) [2025-09-17T18:36:51.587295] [DEBUG] [LOCAL ] DV: Primary data saved (51293 records). [2025-09-17T18:36:51.587445] [INFO ] [MAIN ] DV: Full history saved. [2025-09-17T18:36:51.587532] [INFO ] [MAIN ] Update Progress: 664/2371 symbols completed. DV took 31.3s. Estimated remaining: 4h 8m 55s. Rate: 6.9 symbols/min [2025-09-17T18:36:51.620957] [INFO ] [REMOTE ] DVA: Fetching primary data for 2025-09. [2025-09-17T18:36:51.756440] [INFO ] [MAIN ] DVN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:36:51.806493] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-17T18:36:51.806715] [INFO ] [MAIN ] DVN: Loaded 53699 existing records. [2025-09-17T18:36:51.981173] [WARN ] [MAIN ] DVN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:36:51.981407] [INFO ] [MAIN ] DVN: Wiping existing primary data before full refresh. [2025-09-17T18:36:51.981460] [INFO ] [LOCAL ] DVN: Starting deletion of primary data. [2025-09-17T18:36:51.982572] [DEBUG] [LOCAL ] DVN: Deleted primary data file. [2025-09-17T18:36:51.982633] [INFO ] [MAIN ] DVN: Starting full primary refresh. [2025-09-17T18:36:52.333014] [INFO ] [REMOTE ] DVN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:36:52.415790] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-11. [2025-09-17T18:36:52.966376] [INFO ] [REMOTE ] DUK: Incremental fetch complete for 2025-09 (2.15 seconds). [2025-09-17T18:36:52.974072] [INFO ] [REMOTE ] DUK: Full fetch complete (77263 records). [2025-09-17T18:36:52.974276] [DEBUG] [VALIDATOR ] DUK: Validating primary data. [2025-09-17T18:36:53.057670] [INFO ] [REMOTE ] DVA: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T18:36:53.104197] [INFO ] [REMOTE ] DVA: Full fetch complete (59571 records). [2025-09-17T18:36:53.119985] [DEBUG] [VALIDATOR ] DVA: Validating primary data. [2025-09-17T18:36:53.218464] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-08. [2025-09-17T18:36:53.724479] [DEBUG] [VALIDATOR ] DUK: All expected trading days are present. [2025-09-17T18:36:53.732822] [DEBUG] [VALIDATOR ] DUK: Primary data validation passed. [2025-09-17T18:36:53.736197] [INFO ] [MAIN ] DUK: Fetched primary data is valid. [2025-09-17T18:36:53.736542] [DEBUG] [LOCAL ] DUK: Saving primary data. [2025-09-17T18:36:53.792254] [DEBUG] [LOCAL ] DUK: Trimmed 77263 records to 53477 (keeping 200 days of data) [2025-09-17T18:36:53.899711] [DEBUG] [VALIDATOR ] DVA: All expected trading days are present. [2025-09-17T18:36:53.926631] [DEBUG] [VALIDATOR ] DVA: Primary data validation passed. [2025-09-17T18:36:53.930463] [INFO ] [MAIN ] DVA: Fetched primary data is valid. [2025-09-17T18:36:53.948353] [DEBUG] [LOCAL ] DVA: Saving primary data. [2025-09-17T18:36:53.949540] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T18:36:53.955662] [DEBUG] [LOCAL ] DVA: Trimmed 59571 records to 41749 (keeping 200 days of data) [2025-09-17T18:36:54.016630] [INFO ] [REMOTE ] DUKB: Fetching primary data for 2025-09. [2025-09-17T18:36:54.418904] [DEBUG] [LOCAL ] DVA: Primary data saved (41749 records). [2025-09-17T18:36:54.420160] [INFO ] [MAIN ] DVA: Full history saved. [2025-09-17T18:36:54.424819] [INFO ] [MAIN ] Update Progress: 665/2371 symbols completed. DVA took 33.9s. Estimated remaining: 4h 8m 32s. Rate: 6.9 symbols/min [2025-09-17T18:36:54.618888] [INFO ] [MAIN ] DX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:36:54.631177] [DEBUG] [LOCAL ] DUK: Primary data saved (53477 records). [2025-09-17T18:36:54.631437] [INFO ] [MAIN ] DUK: Full history saved. [2025-09-17T18:36:54.632380] [INFO ] [MAIN ] Update Progress: 666/2371 symbols completed. DUK took 46.8s. Estimated remaining: 4h 8m 1s. Rate: 6.9 symbols/min [2025-09-17T18:36:54.746577] [INFO ] [REMOTE ] DUKB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T18:36:54.808336] [INFO ] [REMOTE ] DUKB: Full fetch complete (9637 records). [2025-09-17T18:36:54.853732] [DEBUG] [VALIDATOR ] DUKB: Validating primary data. [2025-09-17T18:36:54.848434] [INFO ] [MAIN ] DXC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:36:54.962999] [DEBUG] [LOCAL ] DX: Loaded 52464 existing records from primary storage. [2025-09-17T18:36:54.961626] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-11 (2.55 seconds). [2025-09-17T18:36:54.968282] [INFO ] [MAIN ] DX: Loaded 52464 existing records. [2025-09-17T18:36:55.039773] [INFO ] [REMOTE ] DVN: Fetching primary data for 2024-12. [2025-09-17T18:36:55.408915] [WARN ] [MAIN ] DX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:36:55.436934] [DEBUG] [LOCAL ] DXC: Loaded 49444 existing records from primary storage. [2025-09-17T18:36:55.437217] [INFO ] [MAIN ] DX: Wiping existing primary data before full refresh. [2025-09-17T18:36:55.437267] [INFO ] [MAIN ] DXC: Loaded 49444 existing records. [2025-09-17T18:36:55.437411] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-17T18:36:55.468361] [DEBUG] [LOCAL ] DX: Deleted primary data file. [2025-09-17T18:36:55.493897] [INFO ] [MAIN ] DX: Starting full primary refresh. [2025-09-17T18:36:55.673184] [DEBUG] [VALIDATOR ] DUKB: All expected trading days are present. [2025-09-17T18:36:55.714529] [DEBUG] [VALIDATOR ] DUKB: Primary data validation passed. [2025-09-17T18:36:55.757567] [INFO ] [MAIN ] DUKB: Fetched primary data is valid. [2025-09-17T18:36:55.780378] [DEBUG] [LOCAL ] DUKB: Saving primary data. [2025-09-17T18:36:55.854875] [WARN ] [MAIN ] DXC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:36:55.854733] [DEBUG] [LOCAL ] DUKB: Trimmed 9637 records to 6452 (keeping 200 days of data) [2025-09-17T18:36:55.865897] [INFO ] [MAIN ] DXC: Wiping existing primary data before full refresh. [2025-09-17T18:36:55.899563] [INFO ] [LOCAL ] DXC: Starting deletion of primary data. [2025-09-17T18:36:55.938320] [DEBUG] [LOCAL ] DXC: Deleted primary data file. [2025-09-17T18:36:55.954201] [INFO ] [MAIN ] DXC: Starting full primary refresh. [2025-09-17T18:36:56.235021] [INFO ] [REMOTE ] DX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:36:56.269412] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-11. [2025-09-17T18:36:56.354360] [DEBUG] [LOCAL ] DUKB: Primary data saved (6452 records). [2025-09-17T18:36:56.378352] [INFO ] [MAIN ] DUKB: Full history saved. [2025-09-17T18:36:56.397131] [INFO ] [MAIN ] Update Progress: 667/2371 symbols completed. DUKB took 41.5s. Estimated remaining: 4h 7m 34s. Rate: 6.9 symbols/min [2025-09-17T18:36:56.604781] [INFO ] [REMOTE ] DXC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:36:56.629996] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-11. [2025-09-17T18:36:56.653918] [INFO ] [MAIN ] DXYZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:36:56.691312] [DEBUG] [LOCAL ] DXYZ: Loaded 36774 existing records from primary storage. [2025-09-17T18:36:56.691455] [INFO ] [MAIN ] DXYZ: Loaded 36774 existing records. [2025-09-17T18:36:56.870851] [WARN ] [MAIN ] DXYZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:36:56.871097] [INFO ] [MAIN ] DXYZ: Wiping existing primary data before full refresh. [2025-09-17T18:36:56.871142] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-17T18:36:56.871767] [DEBUG] [LOCAL ] DXYZ: Deleted primary data file. [2025-09-17T18:36:56.871814] [INFO ] [MAIN ] DXYZ: Starting full primary refresh. [2025-09-17T18:36:57.224724] [INFO ] [REMOTE ] DXYZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:36:57.225067] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-11. [2025-09-17T18:36:57.363808] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2024-12 (2.32 seconds). [2025-09-17T18:36:57.989701] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T18:36:58.015677] [INFO ] [REMOTE ] DXC: Fetching primary data for 2024-12. [2025-09-17T18:36:58.652508] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-11 (2.38 seconds). [2025-09-17T18:36:58.815801] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-01. [2025-09-17T18:36:59.465779] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T18:36:59.615820] [INFO ] [REMOTE ] DX: Fetching primary data for 2024-12. [2025-09-17T18:36:59.848067] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-11 (2.62 seconds). [2025-09-17T18:37:00.415773] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2024-12. [2025-09-17T18:37:00.973708] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-17T18:37:01.215781] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-02. [2025-09-17T18:37:01.432483] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T18:37:02.015816] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-01. [2025-09-17T18:37:02.815802] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-01. [2025-09-17T18:37:02.992878] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T18:37:03.206149] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2024-12 (2.79 seconds). [2025-09-17T18:37:03.532013] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T18:37:03.615785] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-02. [2025-09-17T18:37:04.415774] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-03. [2025-09-17T18:37:05.010448] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-17T18:37:05.131403] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T18:37:05.215782] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-02. [2025-09-17T18:37:06.015735] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-01. [2025-09-17T18:37:06.251739] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T18:37:06.467616] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T18:37:06.815802] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-04. [2025-09-17T18:37:07.615779] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-03. [2025-09-17T18:37:08.179508] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-17T18:37:08.415784] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-02. [2025-09-17T18:37:09.215765] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-03. [2025-09-17T18:37:09.265732] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-04 (2.45 seconds). [2025-09-17T18:37:09.470443] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T18:37:10.015765] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-05. [2025-09-17T18:37:10.475263] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-17T18:37:10.815745] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-03. [2025-09-17T18:37:11.249605] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T18:37:11.615758] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-04. [2025-09-17T18:37:12.029505] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T18:37:12.415773] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-04. [2025-09-17T18:37:12.758596] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T18:37:13.129691] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T18:37:13.215755] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-05. [2025-09-17T18:37:13.929393] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T18:37:14.015746] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-04. [2025-09-17T18:37:14.815786] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-06. [2025-09-17T18:37:14.965154] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T18:37:15.615762] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-05. [2025-09-17T18:37:16.053768] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T18:37:16.415772] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-05. [2025-09-17T18:37:17.102596] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T18:37:17.209255] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T18:37:17.219041] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-06. [2025-09-17T18:37:17.996330] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T18:37:18.015756] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-06. [2025-09-17T18:37:18.580441] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T18:37:18.815768] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-07. [2025-09-17T18:37:19.615784] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-06. [2025-09-17T18:37:19.727944] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T18:37:20.415806] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-07. [2025-09-17T18:37:20.812911] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T18:37:21.215818] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-08. [2025-09-17T18:37:21.620324] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T18:37:22.015815] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-07. [2025-09-17T18:37:22.164258] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T18:37:22.815765] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-07. [2025-09-17T18:37:23.114296] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T18:37:23.615758] [INFO ] [REMOTE ] DX: Fetching primary data for 2025-09. [2025-09-17T18:37:24.098945] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T18:37:24.415797] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-08. [2025-09-17T18:37:24.518149] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T18:37:25.082073] [INFO ] [REMOTE ] DX: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T18:37:25.088436] [INFO ] [REMOTE ] DX: Full fetch complete (74653 records). [2025-09-17T18:37:25.088577] [DEBUG] [VALIDATOR ] DX: Validating primary data. [2025-09-17T18:37:25.089495] [FATAL] [VALIDATOR ] DX: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:37:25.089582] [FATAL] [MAIN ] DX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:37:25.089619] [WARN ] [MAIN ] DX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:37:25.089699] [INFO ] [LOCAL ] DX: Starting deletion of primary data. [2025-09-17T18:37:25.089762] [DEBUG] [LOCAL ] DX: No primary data file found to delete. [2025-09-17T18:37:25.089797] [INFO ] [LOCAL ] DX: Starting deletion of derivative data. [2025-09-17T18:37:25.090133] [DEBUG] [LOCAL ] DX: Deleted derivative data file. [2025-09-17T18:37:25.090225] [INFO ] [MAIN ] Update Progress: 668/2371 symbols completed. DX took 30.7s. Estimated remaining: 4h 8m 17s. Rate: 6.9 symbols/min [2025-09-17T18:37:25.229016] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-08. [2025-09-17T18:37:25.260598] [INFO ] [MAIN ] DY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:37:25.291335] [DEBUG] [LOCAL ] DY: Loaded 30199 existing records from primary storage. [2025-09-17T18:37:25.291484] [INFO ] [MAIN ] DY: Loaded 30199 existing records. [2025-09-17T18:37:25.467675] [WARN ] [MAIN ] DY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:37:25.467949] [INFO ] [MAIN ] DY: Wiping existing primary data before full refresh. [2025-09-17T18:37:25.467996] [INFO ] [LOCAL ] DY: Starting deletion of primary data. [2025-09-17T18:37:25.468558] [DEBUG] [LOCAL ] DY: Deleted primary data file. [2025-09-17T18:37:25.468603] [INFO ] [MAIN ] DY: Starting full primary refresh. [2025-09-17T18:37:25.824674] [INFO ] [REMOTE ] DY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:37:26.015759] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-11. [2025-09-17T18:37:26.433805] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T18:37:26.815796] [INFO ] [REMOTE ] DVN: Fetching primary data for 2025-09. [2025-09-17T18:37:26.963310] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T18:37:27.615751] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-08. [2025-09-17T18:37:27.829387] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T18:37:28.415804] [INFO ] [REMOTE ] DY: Fetching primary data for 2024-12. [2025-09-17T18:37:28.991234] [INFO ] [REMOTE ] DVN: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-17T18:37:29.000375] [INFO ] [REMOTE ] DVN: Full fetch complete (77673 records). [2025-09-17T18:37:29.000576] [DEBUG] [VALIDATOR ] DVN: Validating primary data. [2025-09-17T18:37:29.247515] [INFO ] [REMOTE ] DXC: Fetching primary data for 2025-09. [2025-09-17T18:37:29.438571] [DEBUG] [VALIDATOR ] DVN: All expected trading days are present. [2025-09-17T18:37:29.438755] [DEBUG] [VALIDATOR ] DVN: Primary data validation passed. [2025-09-17T18:37:29.439995] [INFO ] [MAIN ] DVN: Fetched primary data is valid. [2025-09-17T18:37:29.440127] [DEBUG] [LOCAL ] DVN: Saving primary data. [2025-09-17T18:37:29.460802] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T18:37:29.460965] [DEBUG] [LOCAL ] DVN: Trimmed 77673 records to 53699 (keeping 200 days of data) [2025-09-17T18:37:29.712551] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T18:37:29.844380] [DEBUG] [LOCAL ] DVN: Primary data saved (53699 records). [2025-09-17T18:37:29.844546] [INFO ] [MAIN ] DVN: Full history saved. [2025-09-17T18:37:29.844638] [INFO ] [MAIN ] Update Progress: 669/2371 symbols completed. DVN took 38.3s. Estimated remaining: 4h 7m 58s. Rate: 6.9 symbols/min [2025-09-17T18:37:30.017731] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-01. [2025-09-17T18:37:30.017661] [INFO ] [MAIN ] E: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:37:30.052305] [DEBUG] [LOCAL ] E: Loaded 33761 existing records from primary storage. [2025-09-17T18:37:30.052481] [INFO ] [MAIN ] E: Loaded 33761 existing records. [2025-09-17T18:37:30.232630] [WARN ] [MAIN ] E: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:37:30.232884] [INFO ] [MAIN ] E: Wiping existing primary data before full refresh. [2025-09-17T18:37:30.232928] [INFO ] [LOCAL ] E: Starting deletion of primary data. [2025-09-17T18:37:30.233601] [DEBUG] [LOCAL ] E: Deleted primary data file. [2025-09-17T18:37:30.233684] [INFO ] [MAIN ] E: Starting full primary refresh. [2025-09-17T18:37:30.594718] [INFO ] [REMOTE ] E: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:37:30.704020] [INFO ] [REMOTE ] DXC: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T18:37:30.710553] [INFO ] [REMOTE ] DXC: Full fetch complete (68101 records). [2025-09-17T18:37:30.710691] [DEBUG] [VALIDATOR ] DXC: Validating primary data. [2025-09-17T18:37:30.820902] [INFO ] [REMOTE ] DXYZ: Fetching primary data for 2025-09. [2025-09-17T18:37:31.111039] [DEBUG] [VALIDATOR ] DXC: All expected trading days are present. [2025-09-17T18:37:31.111160] [DEBUG] [VALIDATOR ] DXC: Primary data validation passed. [2025-09-17T18:37:31.111959] [INFO ] [MAIN ] DXC: Fetched primary data is valid. [2025-09-17T18:37:31.112015] [DEBUG] [LOCAL ] DXC: Saving primary data. [2025-09-17T18:37:31.113493] [DEBUG] [LOCAL ] DXC: Trimmed 68101 records to 49456 (keeping 200 days of data) [2025-09-17T18:37:31.216444] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T18:37:31.427889] [DEBUG] [LOCAL ] DXC: Primary data saved (49456 records). [2025-09-17T18:37:31.428031] [INFO ] [MAIN ] DXC: Full history saved. [2025-09-17T18:37:31.428116] [INFO ] [MAIN ] Update Progress: 670/2371 symbols completed. DXC took 36.8s. Estimated remaining: 4h 7m 31s. Rate: 6.9 symbols/min [2025-09-17T18:37:31.599859] [INFO ] [MAIN ] EAF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:37:31.620862] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-02. [2025-09-17T18:37:31.640302] [DEBUG] [LOCAL ] EAF: Loaded 44408 existing records from primary storage. [2025-09-17T18:37:31.640432] [INFO ] [MAIN ] EAF: Loaded 44408 existing records. [2025-09-17T18:37:31.817233] [WARN ] [MAIN ] EAF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:37:31.817498] [INFO ] [MAIN ] EAF: Wiping existing primary data before full refresh. [2025-09-17T18:37:31.817542] [INFO ] [LOCAL ] EAF: Starting deletion of primary data. [2025-09-17T18:37:31.818414] [DEBUG] [LOCAL ] EAF: Deleted primary data file. [2025-09-17T18:37:31.818472] [INFO ] [MAIN ] EAF: Starting full primary refresh. [2025-09-17T18:37:32.178903] [INFO ] [REMOTE ] EAF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:37:32.415783] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-11. [2025-09-17T18:37:32.759518] [INFO ] [REMOTE ] DXYZ: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T18:37:32.763928] [INFO ] [REMOTE ] DXYZ: Full fetch complete (58151 records). [2025-09-17T18:37:32.764043] [DEBUG] [VALIDATOR ] DXYZ: Validating primary data. [2025-09-17T18:37:32.764793] [FATAL] [VALIDATOR ] DXYZ: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:37:32.764876] [FATAL] [MAIN ] DXYZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:37:32.764914] [WARN ] [MAIN ] DXYZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:37:32.764962] [INFO ] [LOCAL ] DXYZ: Starting deletion of primary data. [2025-09-17T18:37:32.765022] [DEBUG] [LOCAL ] DXYZ: No primary data file found to delete. [2025-09-17T18:37:32.765060] [INFO ] [LOCAL ] DXYZ: Starting deletion of derivative data. [2025-09-17T18:37:32.765314] [DEBUG] [LOCAL ] DXYZ: Deleted derivative data file. [2025-09-17T18:37:32.765396] [INFO ] [MAIN ] Update Progress: 671/2371 symbols completed. DXYZ took 36.4s. Estimated remaining: 4h 7m 3s. Rate: 6.9 symbols/min [2025-09-17T18:37:32.944200] [INFO ] [MAIN ] EAI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:37:32.967755] [DEBUG] [LOCAL ] EAI: Loaded 4019 existing records from primary storage. [2025-09-17T18:37:32.968368] [INFO ] [MAIN ] EAI: Loaded 4019 existing records. [2025-09-17T18:37:32.970863] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T18:37:33.157026] [WARN ] [MAIN ] EAI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:37:33.157261] [INFO ] [MAIN ] EAI: Wiping existing primary data before full refresh. [2025-09-17T18:37:33.157309] [INFO ] [LOCAL ] EAI: Starting deletion of primary data. [2025-09-17T18:37:33.157522] [DEBUG] [LOCAL ] EAI: Deleted primary data file. [2025-09-17T18:37:33.157567] [INFO ] [MAIN ] EAI: Starting full primary refresh. [2025-09-17T18:37:33.221194] [INFO ] [REMOTE ] E: Fetching primary data for 2024-11. [2025-09-17T18:37:33.522207] [INFO ] [REMOTE ] EAI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:37:34.015789] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-11. [2025-09-17T18:37:34.176533] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T18:37:34.815782] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-03. [2025-09-17T18:37:34.831399] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T18:37:34.878240] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T18:37:35.615822] [INFO ] [REMOTE ] E: Fetching primary data for 2024-12. [2025-09-17T18:37:36.363241] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T18:37:36.415742] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-04. [2025-09-17T18:37:37.100351] [INFO ] [REMOTE ] E: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T18:37:37.215779] [INFO ] [REMOTE ] EAI: Fetching primary data for 2024-12. [2025-09-17T18:37:37.819321] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T18:37:37.830682] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T18:37:38.015770] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-01. [2025-09-17T18:37:38.635295] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T18:37:38.815775] [INFO ] [REMOTE ] EAF: Fetching primary data for 2024-12. [2025-09-17T18:37:39.615829] [INFO ] [REMOTE ] E: Fetching primary data for 2025-01. [2025-09-17T18:37:40.415836] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-05. [2025-09-17T18:37:40.524479] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T18:37:40.591675] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T18:37:41.215779] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-02. [2025-09-17T18:37:41.632311] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T18:37:41.832483] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T18:37:42.015799] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-06. [2025-09-17T18:37:42.815845] [INFO ] [REMOTE ] E: Fetching primary data for 2025-02. [2025-09-17T18:37:43.252287] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T18:37:43.615875] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-03. [2025-09-17T18:37:44.081331] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T18:37:44.185211] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T18:37:44.415873] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-04. [2025-09-17T18:37:45.142392] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T18:37:45.215808] [INFO ] [REMOTE ] E: Fetching primary data for 2025-03. [2025-09-17T18:37:46.015810] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-01. [2025-09-17T18:37:46.720715] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T18:37:46.815792] [INFO ] [REMOTE ] E: Fetching primary data for 2025-04. [2025-09-17T18:37:47.615769] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-07. [2025-09-17T18:37:47.747725] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T18:37:48.423034] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-05. [2025-09-17T18:37:48.444357] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T18:37:48.509972] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T18:37:49.065810] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T18:37:49.215808] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-02. [2025-09-17T18:37:50.015794] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-08. [2025-09-17T18:37:50.808992] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T18:37:50.817474] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-06. [2025-09-17T18:37:51.404844] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T18:37:51.416779] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T18:37:51.615781] [INFO ] [REMOTE ] E: Fetching primary data for 2025-05. [2025-09-17T18:37:52.415781] [INFO ] [REMOTE ] DY: Fetching primary data for 2025-09. [2025-09-17T18:37:53.004024] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T18:37:53.215768] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-07. [2025-09-17T18:37:53.642788] [INFO ] [REMOTE ] DY: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T18:37:53.651012] [INFO ] [REMOTE ] DY: Full fetch complete (44836 records). [2025-09-17T18:37:53.651774] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T18:37:53.651904] [DEBUG] [VALIDATOR ] DY: Validating primary data. [2025-09-17T18:37:54.017039] [INFO ] [REMOTE ] E: Fetching primary data for 2025-06. [2025-09-17T18:37:54.039791] [DEBUG] [VALIDATOR ] DY: All expected trading days are present. [2025-09-17T18:37:54.039872] [DEBUG] [VALIDATOR ] DY: Primary data validation passed. [2025-09-17T18:37:54.040487] [INFO ] [MAIN ] DY: Fetched primary data is valid. [2025-09-17T18:37:54.040539] [DEBUG] [LOCAL ] DY: Saving primary data. [2025-09-17T18:37:54.041501] [DEBUG] [LOCAL ] DY: Trimmed 44836 records to 30174 (keeping 200 days of data) [2025-09-17T18:37:54.226392] [DEBUG] [LOCAL ] DY: Primary data saved (30174 records). [2025-09-17T18:37:54.226536] [INFO ] [MAIN ] DY: Full history saved. [2025-09-17T18:37:54.226636] [INFO ] [MAIN ] Update Progress: 672/2371 symbols completed. DY took 29.1s. Estimated remaining: 4h 7m 27s. Rate: 6.9 symbols/min [2025-09-17T18:37:54.396941] [INFO ] [MAIN ] EARN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:37:54.425887] [DEBUG] [LOCAL ] EARN: Loaded 30932 existing records from primary storage. [2025-09-17T18:37:54.426026] [INFO ] [MAIN ] EARN: Loaded 30932 existing records. [2025-09-17T18:37:54.638060] [WARN ] [MAIN ] EARN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:37:54.638339] [INFO ] [MAIN ] EARN: Wiping existing primary data before full refresh. [2025-09-17T18:37:54.638385] [INFO ] [LOCAL ] EARN: Starting deletion of primary data. [2025-09-17T18:37:54.639092] [DEBUG] [LOCAL ] EARN: Deleted primary data file. [2025-09-17T18:37:54.639145] [INFO ] [MAIN ] EARN: Starting full primary refresh. [2025-09-17T18:37:54.822629] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-08. [2025-09-17T18:37:54.998382] [INFO ] [REMOTE ] EARN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:37:55.498613] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T18:37:55.615785] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-11. [2025-09-17T18:37:55.634406] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T18:37:56.415793] [INFO ] [REMOTE ] E: Fetching primary data for 2025-07. [2025-09-17T18:37:57.215789] [INFO ] [REMOTE ] EAI: Fetching primary data for 2025-09. [2025-09-17T18:37:57.449678] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T18:37:58.015774] [INFO ] [REMOTE ] EARN: Fetching primary data for 2024-12. [2025-09-17T18:37:58.141332] [INFO ] [REMOTE ] EAI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T18:37:58.142506] [INFO ] [REMOTE ] EAI: Full fetch complete (6201 records). [2025-09-17T18:37:58.142577] [DEBUG] [VALIDATOR ] EAI: Validating primary data. [2025-09-17T18:37:58.308750] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T18:37:58.529964] [DEBUG] [VALIDATOR ] EAI: All expected trading days are present. [2025-09-17T18:37:58.530057] [DEBUG] [VALIDATOR ] EAI: Primary data validation passed. [2025-09-17T18:37:58.530280] [INFO ] [MAIN ] EAI: Fetched primary data is valid. [2025-09-17T18:37:58.530332] [DEBUG] [LOCAL ] EAI: Saving primary data. [2025-09-17T18:37:58.530756] [DEBUG] [LOCAL ] EAI: Trimmed 6201 records to 4011 (keeping 200 days of data) [2025-09-17T18:37:58.556183] [DEBUG] [LOCAL ] EAI: Primary data saved (4011 records). [2025-09-17T18:37:58.556260] [INFO ] [MAIN ] EAI: Full history saved. [2025-09-17T18:37:58.556509] [INFO ] [MAIN ] Update Progress: 673/2371 symbols completed. EAI took 25.8s. Estimated remaining: 4h 7m 7s. Rate: 6.9 symbols/min [2025-09-17T18:37:58.728973] [INFO ] [MAIN ] EAT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:37:58.780036] [DEBUG] [LOCAL ] EAT: Loaded 49816 existing records from primary storage. [2025-09-17T18:37:58.780211] [INFO ] [MAIN ] EAT: Loaded 49816 existing records. [2025-09-17T18:37:58.822881] [INFO ] [REMOTE ] E: Fetching primary data for 2025-08. [2025-09-17T18:37:58.962675] [WARN ] [MAIN ] EAT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:37:58.962931] [INFO ] [MAIN ] EAT: Wiping existing primary data before full refresh. [2025-09-17T18:37:58.962979] [INFO ] [LOCAL ] EAT: Starting deletion of primary data. [2025-09-17T18:37:58.964002] [DEBUG] [LOCAL ] EAT: Deleted primary data file. [2025-09-17T18:37:58.964054] [INFO ] [MAIN ] EAT: Starting full primary refresh. [2025-09-17T18:37:59.317305] [INFO ] [REMOTE ] EAT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:37:59.428806] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T18:37:59.615748] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-01. [2025-09-17T18:38:00.324476] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T18:38:00.415760] [INFO ] [REMOTE ] E: Fetching primary data for 2025-09. [2025-09-17T18:38:01.181989] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T18:38:01.215788] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-03. [2025-09-17T18:38:01.846133] [INFO ] [REMOTE ] E: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T18:38:01.850559] [INFO ] [REMOTE ] E: Full fetch complete (48513 records). [2025-09-17T18:38:01.850695] [DEBUG] [VALIDATOR ] E: Validating primary data. [2025-09-17T18:38:02.017971] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-02. [2025-09-17T18:38:02.243690] [DEBUG] [VALIDATOR ] E: All expected trading days are present. [2025-09-17T18:38:02.243837] [DEBUG] [VALIDATOR ] E: Primary data validation passed. [2025-09-17T18:38:02.244492] [INFO ] [MAIN ] E: Fetched primary data is valid. [2025-09-17T18:38:02.244549] [DEBUG] [LOCAL ] E: Saving primary data. [2025-09-17T18:38:02.245664] [DEBUG] [LOCAL ] E: Trimmed 48513 records to 33690 (keeping 200 days of data) [2025-09-17T18:38:02.450412] [DEBUG] [LOCAL ] E: Primary data saved (33690 records). [2025-09-17T18:38:02.450553] [INFO ] [MAIN ] E: Full history saved. [2025-09-17T18:38:02.450637] [INFO ] [MAIN ] Update Progress: 674/2371 symbols completed. E took 32.6s. Estimated remaining: 4h 6m 46s. Rate: 6.9 symbols/min [2025-09-17T18:38:02.621497] [INFO ] [MAIN ] EB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:38:02.650595] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T18:38:02.693045] [DEBUG] [LOCAL ] EB: Loaded 38243 existing records from primary storage. [2025-09-17T18:38:02.693190] [INFO ] [MAIN ] EB: Loaded 38243 existing records. [2025-09-17T18:38:02.832073] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-04. [2025-09-17T18:38:02.871099] [WARN ] [MAIN ] EB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:38:02.871328] [INFO ] [MAIN ] EB: Wiping existing primary data before full refresh. [2025-09-17T18:38:02.871374] [INFO ] [LOCAL ] EB: Starting deletion of primary data. [2025-09-17T18:38:02.872101] [DEBUG] [LOCAL ] EB: Deleted primary data file. [2025-09-17T18:38:02.872150] [INFO ] [MAIN ] EB: Starting full primary refresh. [2025-09-17T18:38:03.248363] [INFO ] [REMOTE ] EB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:38:03.615781] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-11. [2025-09-17T18:38:03.674722] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T18:38:04.144942] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T18:38:04.415775] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-05. [2025-09-17T18:38:05.215783] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-11. [2025-09-17T18:38:05.620137] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T18:38:05.782255] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T18:38:06.015808] [INFO ] [REMOTE ] EB: Fetching primary data for 2024-12. [2025-09-17T18:38:06.815799] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-03. [2025-09-17T18:38:07.059866] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T18:38:07.483861] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T18:38:07.615794] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-01. [2025-09-17T18:38:08.415834] [INFO ] [REMOTE ] EAT: Fetching primary data for 2024-12. [2025-09-17T18:38:08.541464] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T18:38:09.133087] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T18:38:09.215727] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-02. [2025-09-17T18:38:10.015781] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-04. [2025-09-17T18:38:10.146564] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T18:38:10.605606] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T18:38:10.815775] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-01. [2025-09-17T18:38:11.615750] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-06. [2025-09-17T18:38:11.823396] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T18:38:12.415828] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-05. [2025-09-17T18:38:12.667735] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T18:38:13.215866] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-02. [2025-09-17T18:38:13.345932] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T18:38:13.824883] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T18:38:14.015827] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-06. [2025-09-17T18:38:14.815708] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-03. [2025-09-17T18:38:14.935166] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T18:38:15.240813] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T18:38:15.615784] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-07. [2025-09-17T18:38:16.415781] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-07. [2025-09-17T18:38:16.447513] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T18:38:16.874554] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T18:38:17.215788] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-03. [2025-09-17T18:38:18.015790] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-08. [2025-09-17T18:38:18.209684] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T18:38:18.815782] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-04. [2025-09-17T18:38:19.246560] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T18:38:19.363560] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T18:38:19.615777] [INFO ] [REMOTE ] EARN: Fetching primary data for 2025-09. [2025-09-17T18:38:20.361804] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T18:38:20.415776] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-05. [2025-09-17T18:38:20.745364] [INFO ] [REMOTE ] EARN: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T18:38:20.750034] [INFO ] [REMOTE ] EARN: Full fetch complete (47002 records). [2025-09-17T18:38:20.750158] [DEBUG] [VALIDATOR ] EARN: Validating primary data. [2025-09-17T18:38:21.138669] [DEBUG] [VALIDATOR ] EARN: All expected trading days are present. [2025-09-17T18:38:21.138750] [DEBUG] [VALIDATOR ] EARN: Primary data validation passed. [2025-09-17T18:38:21.139364] [INFO ] [MAIN ] EARN: Fetched primary data is valid. [2025-09-17T18:38:21.139404] [DEBUG] [LOCAL ] EARN: Saving primary data. [2025-09-17T18:38:21.140427] [DEBUG] [LOCAL ] EARN: Trimmed 47002 records to 30842 (keeping 200 days of data) [2025-09-17T18:38:21.223710] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-08. [2025-09-17T18:38:21.322519] [DEBUG] [LOCAL ] EARN: Primary data saved (30842 records). [2025-09-17T18:38:21.322684] [INFO ] [MAIN ] EARN: Full history saved. [2025-09-17T18:38:21.322770] [INFO ] [MAIN ] Update Progress: 675/2371 symbols completed. EARN took 27.1s. Estimated remaining: 4h 7m 3s. Rate: 6.9 symbols/min [2025-09-17T18:38:21.499128] [INFO ] [MAIN ] EBF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:38:21.518460] [DEBUG] [LOCAL ] EBF: Loaded 19671 existing records from primary storage. [2025-09-17T18:38:21.518593] [INFO ] [MAIN ] EBF: Loaded 19671 existing records. [2025-09-17T18:38:21.697499] [WARN ] [MAIN ] EBF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:38:21.697779] [INFO ] [MAIN ] EBF: Wiping existing primary data before full refresh. [2025-09-17T18:38:21.697824] [INFO ] [LOCAL ] EBF: Starting deletion of primary data. [2025-09-17T18:38:21.698261] [DEBUG] [LOCAL ] EBF: Deleted primary data file. [2025-09-17T18:38:21.698328] [INFO ] [MAIN ] EBF: Starting full primary refresh. [2025-09-17T18:38:22.024070] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-04. [2025-09-17T18:38:22.098421] [INFO ] [REMOTE ] EBF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:38:22.104385] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T18:38:22.440071] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T18:38:22.815769] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-11. [2025-09-17T18:38:23.615777] [INFO ] [REMOTE ] EAF: Fetching primary data for 2025-09. [2025-09-17T18:38:23.941915] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T18:38:24.228776] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T18:38:24.415818] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-06. [2025-09-17T18:38:25.130704] [INFO ] [REMOTE ] EAF: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T18:38:25.136712] [INFO ] [REMOTE ] EAF: Full fetch complete (65300 records). [2025-09-17T18:38:25.136933] [DEBUG] [VALIDATOR ] EAF: Validating primary data. [2025-09-17T18:38:25.220938] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-05. [2025-09-17T18:38:25.532945] [DEBUG] [VALIDATOR ] EAF: All expected trading days are present. [2025-09-17T18:38:25.533038] [DEBUG] [VALIDATOR ] EAF: Primary data validation passed. [2025-09-17T18:38:25.533841] [INFO ] [MAIN ] EAF: Fetched primary data is valid. [2025-09-17T18:38:25.533922] [DEBUG] [LOCAL ] EAF: Saving primary data. [2025-09-17T18:38:25.535302] [DEBUG] [LOCAL ] EAF: Trimmed 65300 records to 44299 (keeping 200 days of data) [2025-09-17T18:38:25.793326] [DEBUG] [LOCAL ] EAF: Primary data saved (44299 records). [2025-09-17T18:38:25.793516] [INFO ] [MAIN ] EAF: Full history saved. [2025-09-17T18:38:25.795177] [INFO ] [MAIN ] Update Progress: 676/2371 symbols completed. EAF took 54.4s. Estimated remaining: 4h 6m 43s. Rate: 6.9 symbols/min [2025-09-17T18:38:25.926690] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T18:38:25.999199] [INFO ] [MAIN ] EBR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:38:26.025498] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-07. [2025-09-17T18:38:26.044081] [DEBUG] [LOCAL ] EBR: Loaded 43127 existing records from primary storage. [2025-09-17T18:38:26.044207] [INFO ] [MAIN ] EBR: Loaded 43127 existing records. [2025-09-17T18:38:26.228018] [WARN ] [MAIN ] EBR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:38:26.228266] [INFO ] [MAIN ] EBR: Wiping existing primary data before full refresh. [2025-09-17T18:38:26.228313] [INFO ] [LOCAL ] EBR: Starting deletion of primary data. [2025-09-17T18:38:26.229098] [DEBUG] [LOCAL ] EBR: Deleted primary data file. [2025-09-17T18:38:26.229161] [INFO ] [MAIN ] EBR: Starting full primary refresh. [2025-09-17T18:38:26.590873] [INFO ] [REMOTE ] EBR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:38:26.815743] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-11. [2025-09-17T18:38:27.097463] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T18:38:27.591049] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T18:38:27.615721] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-08. [2025-09-17T18:38:28.409533] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T18:38:28.418198] [INFO ] [REMOTE ] EBF: Fetching primary data for 2024-12. [2025-09-17T18:38:29.072311] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T18:38:29.215790] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-06. [2025-09-17T18:38:29.353418] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T18:38:30.015816] [INFO ] [REMOTE ] EB: Fetching primary data for 2025-09. [2025-09-17T18:38:30.815871] [INFO ] [REMOTE ] EBR: Fetching primary data for 2024-12. [2025-09-17T18:38:30.969311] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T18:38:31.490581] [INFO ] [REMOTE ] EB: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T18:38:31.495219] [INFO ] [REMOTE ] EB: Full fetch complete (57182 records). [2025-09-17T18:38:31.495326] [DEBUG] [VALIDATOR ] EB: Validating primary data. [2025-09-17T18:38:31.620844] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-07. [2025-09-17T18:38:31.892499] [DEBUG] [VALIDATOR ] EB: All expected trading days are present. [2025-09-17T18:38:31.892580] [DEBUG] [VALIDATOR ] EB: Primary data validation passed. [2025-09-17T18:38:31.893290] [INFO ] [MAIN ] EB: Fetched primary data is valid. [2025-09-17T18:38:31.893334] [DEBUG] [LOCAL ] EB: Saving primary data. [2025-09-17T18:38:31.894896] [DEBUG] [LOCAL ] EB: Trimmed 57182 records to 38136 (keeping 200 days of data) [2025-09-17T18:38:32.113713] [DEBUG] [LOCAL ] EB: Primary data saved (38136 records). [2025-09-17T18:38:32.113851] [INFO ] [MAIN ] EB: Full history saved. [2025-09-17T18:38:32.113964] [INFO ] [MAIN ] Update Progress: 677/2371 symbols completed. EB took 29.7s. Estimated remaining: 4h 6m 29s. Rate: 6.9 symbols/min [2025-09-17T18:38:32.239512] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T18:38:32.415805] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-01. [2025-09-17T18:38:33.215771] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-01. [2025-09-17T18:38:33.453846] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T18:38:33.518243] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T18:38:34.015778] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-02. [2025-09-17T18:38:34.710005] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T18:38:34.815754] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-02. [2025-09-17T18:38:35.142083] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T18:38:35.615818] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-08. [2025-09-17T18:38:36.324029] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T18:38:36.415930] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-03. [2025-09-17T18:38:37.215857] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-03. [2025-09-17T18:38:37.269726] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T18:38:37.316096] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T18:38:38.015828] [INFO ] [REMOTE ] EAT: Fetching primary data for 2025-09. [2025-09-17T18:38:38.815840] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-04. [2025-09-17T18:38:38.933131] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T18:38:39.615798] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-04. [2025-09-17T18:38:39.640680] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T18:38:39.773514] [INFO ] [REMOTE ] EAT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T18:38:39.780429] [INFO ] [REMOTE ] EAT: Full fetch complete (71465 records). [2025-09-17T18:38:39.780574] [DEBUG] [VALIDATOR ] EAT: Validating primary data. [2025-09-17T18:38:40.178023] [DEBUG] [VALIDATOR ] EAT: All expected trading days are present. [2025-09-17T18:38:40.178151] [DEBUG] [VALIDATOR ] EAT: Primary data validation passed. [2025-09-17T18:38:40.178976] [INFO ] [MAIN ] EAT: Fetched primary data is valid. [2025-09-17T18:38:40.179023] [DEBUG] [LOCAL ] EAT: Saving primary data. [2025-09-17T18:38:40.180433] [DEBUG] [LOCAL ] EAT: Trimmed 71465 records to 49826 (keeping 200 days of data) [2025-09-17T18:38:40.422848] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-05. [2025-09-17T18:38:40.489148] [DEBUG] [LOCAL ] EAT: Primary data saved (49826 records). [2025-09-17T18:38:40.489399] [INFO ] [MAIN ] EAT: Full history saved. [2025-09-17T18:38:40.490516] [INFO ] [MAIN ] Update Progress: 678/2371 symbols completed. EAT took 41.9s. Estimated remaining: 4h 6m 19s. Rate: 6.9 symbols/min [2025-09-17T18:38:40.885173] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T18:38:41.215789] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-05. [2025-09-17T18:38:41.538350] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T18:38:42.015797] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-06. [2025-09-17T18:38:42.606252] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T18:38:42.815777] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-06. [2025-09-17T18:38:43.170955] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T18:38:43.615823] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-07. [2025-09-17T18:38:44.217218] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T18:38:44.415782] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-07. [2025-09-17T18:38:44.761015] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T18:38:45.215819] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-08. [2025-09-17T18:38:46.237357] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T18:38:46.241838] [INFO ] [REMOTE ] EBF: Fetching primary data for 2025-09. [2025-09-17T18:38:46.275592] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T18:38:46.815833] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-08. [2025-09-17T18:38:47.253057] [INFO ] [REMOTE ] EBF: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T18:38:47.255509] [INFO ] [REMOTE ] EBF: Full fetch complete (27230 records). [2025-09-17T18:38:47.255604] [DEBUG] [VALIDATOR ] EBF: Validating primary data. [2025-09-17T18:38:47.628298] [DEBUG] [VALIDATOR ] EBF: All expected trading days are present. [2025-09-17T18:38:47.628389] [DEBUG] [VALIDATOR ] EBF: Primary data validation passed. [2025-09-17T18:38:47.629064] [INFO ] [MAIN ] EBF: Fetched primary data is valid. [2025-09-17T18:38:47.629129] [DEBUG] [LOCAL ] EBF: Saving primary data. [2025-09-17T18:38:47.630050] [DEBUG] [LOCAL ] EBF: Trimmed 27230 records to 19679 (keeping 200 days of data) [2025-09-17T18:38:47.761190] [DEBUG] [LOCAL ] EBF: Primary data saved (19679 records). [2025-09-17T18:38:47.761338] [INFO ] [MAIN ] EBF: Full history saved. [2025-09-17T18:38:47.761482] [INFO ] [MAIN ] Update Progress: 679/2371 symbols completed. EBF took 26.4s. Estimated remaining: 4h 6m 7s. Rate: 6.9 symbols/min [2025-09-17T18:38:48.414670] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T18:38:48.424280] [INFO ] [REMOTE ] EBR: Fetching primary data for 2025-09. [2025-09-17T18:38:50.071184] [INFO ] [REMOTE ] EBR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T18:38:50.077073] [INFO ] [REMOTE ] EBR: Full fetch complete (62717 records). [2025-09-17T18:38:50.077229] [DEBUG] [VALIDATOR ] EBR: Validating primary data. [2025-09-17T18:38:50.474754] [DEBUG] [VALIDATOR ] EBR: All expected trading days are present. [2025-09-17T18:38:50.474955] [DEBUG] [VALIDATOR ] EBR: Primary data validation passed. [2025-09-17T18:38:50.475858] [INFO ] [MAIN ] EBR: Fetched primary data is valid. [2025-09-17T18:38:50.475906] [DEBUG] [LOCAL ] EBR: Saving primary data. [2025-09-17T18:38:50.477174] [DEBUG] [LOCAL ] EBR: Trimmed 62717 records to 43136 (keeping 200 days of data) [2025-09-17T18:38:50.728873] [DEBUG] [LOCAL ] EBR: Primary data saved (43136 records). [2025-09-17T18:38:50.729005] [INFO ] [MAIN ] EBR: Full history saved. [2025-09-17T18:38:50.729692] [INFO ] [MAIN ] Update Progress: 680/2371 symbols completed. EBR took 24.9s. Estimated remaining: 4h 5m 44s. Rate: 6.9 symbols/min [2025-09-17T18:38:51.444588] [INFO ] [MAIN ] ECAT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:38:51.420316] [INFO ] [MAIN ] EBS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:38:51.443748] [INFO ] [MAIN ] EC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:38:51.477258] [INFO ] [MAIN ] ECC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:38:51.529033] [DEBUG] [LOCAL ] ECAT: Loaded 29887 existing records from primary storage. [2025-09-17T18:38:51.529347] [INFO ] [MAIN ] ECAT: Loaded 29887 existing records. [2025-09-17T18:38:51.681386] [DEBUG] [LOCAL ] EBS: Loaded 47015 existing records from primary storage. [2025-09-17T18:38:51.692973] [DEBUG] [LOCAL ] ECC: Loaded 43407 existing records from primary storage. [2025-09-17T18:38:51.703998] [INFO ] [MAIN ] EBS: Loaded 47015 existing records. [2025-09-17T18:38:51.724089] [INFO ] [MAIN ] ECC: Loaded 43407 existing records. [2025-09-17T18:38:51.847424] [DEBUG] [LOCAL ] EC: Loaded 49499 existing records from primary storage. [2025-09-17T18:38:51.895023] [INFO ] [MAIN ] EC: Loaded 49499 existing records. [2025-09-17T18:38:51.961131] [WARN ] [MAIN ] ECAT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:38:52.054443] [INFO ] [MAIN ] ECAT: Wiping existing primary data before full refresh. [2025-09-17T18:38:52.107495] [INFO ] [LOCAL ] ECAT: Starting deletion of primary data. [2025-09-17T18:38:52.198637] [DEBUG] [LOCAL ] ECAT: Deleted primary data file. [2025-09-17T18:38:52.224264] [WARN ] [MAIN ] ECC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:38:52.224474] [INFO ] [MAIN ] ECAT: Starting full primary refresh. [2025-09-17T18:38:52.261019] [INFO ] [MAIN ] ECC: Wiping existing primary data before full refresh. [2025-09-17T18:38:52.282791] [INFO ] [LOCAL ] ECC: Starting deletion of primary data. [2025-09-17T18:38:52.318900] [DEBUG] [LOCAL ] ECC: Deleted primary data file. [2025-09-17T18:38:52.336602] [WARN ] [MAIN ] EBS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:38:52.389100] [INFO ] [MAIN ] ECC: Starting full primary refresh. [2025-09-17T18:38:52.389246] [INFO ] [MAIN ] EBS: Wiping existing primary data before full refresh. [2025-09-17T18:38:52.492018] [INFO ] [LOCAL ] EBS: Starting deletion of primary data. [2025-09-17T18:38:52.526325] [WARN ] [MAIN ] EC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:38:52.547190] [DEBUG] [LOCAL ] EBS: Deleted primary data file. [2025-09-17T18:38:52.547286] [INFO ] [MAIN ] EC: Wiping existing primary data before full refresh. [2025-09-17T18:38:52.595466] [INFO ] [LOCAL ] EC: Starting deletion of primary data. [2025-09-17T18:38:52.586742] [INFO ] [MAIN ] EBS: Starting full primary refresh. [2025-09-17T18:38:52.662581] [DEBUG] [LOCAL ] EC: Deleted primary data file. [2025-09-17T18:38:52.682884] [INFO ] [MAIN ] EC: Starting full primary refresh. [2025-09-17T18:38:53.470155] [INFO ] [REMOTE ] ECAT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:38:53.479303] [INFO ] [REMOTE ] ECC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:38:53.534760] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-11. [2025-09-17T18:38:53.549261] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-11. [2025-09-17T18:38:53.816195] [INFO ] [REMOTE ] EBS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:38:53.826782] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-11. [2025-09-17T18:38:53.888749] [INFO ] [REMOTE ] EC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:38:53.889101] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-11. [2025-09-17T18:38:54.922281] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T18:38:54.926992] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2024-12. [2025-09-17T18:38:55.445422] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T18:38:55.453909] [INFO ] [REMOTE ] ECC: Fetching primary data for 2024-12. [2025-09-17T18:38:55.615732] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T18:38:55.625706] [INFO ] [REMOTE ] EC: Fetching primary data for 2024-12. [2025-09-17T18:38:55.652166] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T18:38:55.661797] [INFO ] [REMOTE ] EBS: Fetching primary data for 2024-12. [2025-09-17T18:38:56.079392] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T18:38:56.085172] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-01. [2025-09-17T18:38:56.738740] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T18:38:56.747725] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-01. [2025-09-17T18:38:57.239536] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T18:38:57.250139] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-01. [2025-09-17T18:38:57.279420] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T18:38:57.289667] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-01. [2025-09-17T18:38:57.311906] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T18:38:58.015832] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-02. [2025-09-17T18:38:58.214546] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T18:38:58.815735] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-02. [2025-09-17T18:38:59.004592] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T18:38:59.145019] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T18:38:59.178505] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T18:38:59.615836] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-02. [2025-09-17T18:39:00.236437] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T18:39:00.415823] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-03. [2025-09-17T18:39:01.215833] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-03. [2025-09-17T18:39:01.293149] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T18:39:02.015886] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-02. [2025-09-17T18:39:02.309747] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T18:39:02.395998] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T18:39:02.815797] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-04. [2025-09-17T18:39:03.615807] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-04. [2025-09-17T18:39:03.766988] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T18:39:03.820259] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T18:39:04.415837] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-03. [2025-09-17T18:39:05.215843] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-05. [2025-09-17T18:39:05.344426] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T18:39:06.015790] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-05. [2025-09-17T18:39:06.411581] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T18:39:06.497965] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T18:39:06.815772] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-06. [2025-09-17T18:39:07.615692] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-03. [2025-09-17T18:39:07.816011] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T18:39:07.857564] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T18:39:08.415811] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-04. [2025-09-17T18:39:09.215816] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-07. [2025-09-17T18:39:09.261206] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T18:39:09.976042] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T18:39:10.015747] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-05. [2025-09-17T18:39:10.658592] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T18:39:10.815788] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-06. [2025-09-17T18:39:11.615794] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-04. [2025-09-17T18:39:11.950091] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T18:39:12.031254] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T18:39:12.415789] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-07. [2025-09-17T18:39:12.793713] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T18:39:13.215784] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-08. [2025-09-17T18:39:13.807123] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T18:39:14.015808] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-05. [2025-09-17T18:39:14.719055] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T18:39:14.815780] [INFO ] [REMOTE ] ECAT: Fetching primary data for 2025-09. [2025-09-17T18:39:15.615772] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-08. [2025-09-17T18:39:15.721039] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T18:39:15.814165] [INFO ] [REMOTE ] ECAT: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T18:39:15.818620] [INFO ] [REMOTE ] ECAT: Full fetch complete (42174 records). [2025-09-17T18:39:15.818744] [DEBUG] [VALIDATOR ] ECAT: Validating primary data. [2025-09-17T18:39:16.198472] [DEBUG] [VALIDATOR ] ECAT: All expected trading days are present. [2025-09-17T18:39:16.198555] [DEBUG] [VALIDATOR ] ECAT: Primary data validation passed. [2025-09-17T18:39:16.199168] [INFO ] [MAIN ] ECAT: Fetched primary data is valid. [2025-09-17T18:39:16.199213] [DEBUG] [LOCAL ] ECAT: Saving primary data. [2025-09-17T18:39:16.200218] [DEBUG] [LOCAL ] ECAT: Trimmed 42174 records to 29877 (keeping 200 days of data) [2025-09-17T18:39:16.384389] [DEBUG] [LOCAL ] ECAT: Primary data saved (29877 records). [2025-09-17T18:39:16.384523] [INFO ] [MAIN ] ECAT: Full history saved. [2025-09-17T18:39:16.384606] [INFO ] [MAIN ] Update Progress: 681/2371 symbols completed. ECAT took 25.7s. Estimated remaining: 4h 6m 17s. Rate: 6.9 symbols/min [2025-09-17T18:39:16.420843] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-06. [2025-09-17T18:39:16.562289] [INFO ] [MAIN ] ECCC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:39:16.562476] [DEBUG] [LOCAL ] ECCC: No existing data file found in primary storage. [2025-09-17T18:39:16.562514] [WARN ] [MAIN ] ECCC: No existing data found, performing full refresh instead. [2025-09-17T18:39:16.562657] [INFO ] [MAIN ] ECCC: Wiping existing primary data before full refresh. [2025-09-17T18:39:16.562711] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-17T18:39:16.562754] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-17T18:39:16.562787] [INFO ] [MAIN ] ECCC: Starting full primary refresh. [2025-09-17T18:39:16.941270] [INFO ] [REMOTE ] ECCC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:39:17.215740] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-11. [2025-09-17T18:39:17.504033] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T18:39:18.015784] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-06. [2025-09-17T18:39:18.162869] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T18:39:18.206534] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T18:39:18.815768] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-07. [2025-09-17T18:39:19.615773] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2024-12. [2025-09-17T18:39:19.869338] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T18:39:19.887428] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-17T18:39:20.415690] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-01. [2025-09-17T18:39:20.506185] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T18:39:20.760125] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T18:39:21.215777] [INFO ] [REMOTE ] ECC: Fetching primary data for 2025-09. [2025-09-17T18:39:22.015835] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-07. [2025-09-17T18:39:22.815810] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-02. [2025-09-17T18:39:22.980016] [INFO ] [REMOTE ] ECC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T18:39:22.985715] [INFO ] [REMOTE ] ECC: Full fetch complete (60982 records). [2025-09-17T18:39:22.985852] [DEBUG] [VALIDATOR ] ECC: Validating primary data. [2025-09-17T18:39:23.168381] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T18:39:23.383957] [DEBUG] [VALIDATOR ] ECC: All expected trading days are present. [2025-09-17T18:39:23.384042] [DEBUG] [VALIDATOR ] ECC: Primary data validation passed. [2025-09-17T18:39:23.384777] [INFO ] [MAIN ] ECC: Fetched primary data is valid. [2025-09-17T18:39:23.384820] [DEBUG] [LOCAL ] ECC: Saving primary data. [2025-09-17T18:39:23.386036] [DEBUG] [LOCAL ] ECC: Trimmed 60982 records to 43441 (keeping 200 days of data) [2025-09-17T18:39:23.615889] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-03. [2025-09-17T18:39:23.673076] [DEBUG] [LOCAL ] ECC: Primary data saved (43441 records). [2025-09-17T18:39:23.673214] [INFO ] [MAIN ] ECC: Full history saved. [2025-09-17T18:39:23.674902] [INFO ] [MAIN ] Update Progress: 682/2371 symbols completed. ECC took 32.9s. Estimated remaining: 4h 6m 5s. Rate: 6.9 symbols/min [2025-09-17T18:39:23.848539] [INFO ] [MAIN ] ECCU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:39:23.848816] [DEBUG] [LOCAL ] ECCU: No existing data file found in primary storage. [2025-09-17T18:39:23.849001] [WARN ] [MAIN ] ECCU: No existing data found, performing full refresh instead. [2025-09-17T18:39:23.849146] [INFO ] [MAIN ] ECCU: Wiping existing primary data before full refresh. [2025-09-17T18:39:23.849272] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-17T18:39:23.849405] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-17T18:39:23.849455] [INFO ] [MAIN ] ECCU: Starting full primary refresh. [2025-09-17T18:39:23.938034] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-17T18:39:24.253948] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-17T18:39:24.257311] [INFO ] [REMOTE ] ECCU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:39:24.415774] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-08. [2025-09-17T18:39:25.215876] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-11. [2025-09-17T18:39:25.415671] [DEBUG] [REMOTE ] ECCU: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:39:25.415981] [WARN ] [REMOTE ] ECCU: No data returned for month 2024-11 [2025-09-17T18:39:25.791728] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T18:39:26.015775] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2024-12. [2025-09-17T18:39:26.761487] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T18:39:26.815807] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-04. [2025-09-17T18:39:27.142529] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-17T18:39:27.615778] [INFO ] [REMOTE ] EC: Fetching primary data for 2025-09. [2025-09-17T18:39:28.415857] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-01. [2025-09-17T18:39:29.024558] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T18:39:29.215815] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-02. [2025-09-17T18:39:29.238064] [INFO ] [REMOTE ] EC: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T18:39:29.245075] [INFO ] [REMOTE ] EC: Full fetch complete (71844 records). [2025-09-17T18:39:29.245260] [DEBUG] [VALIDATOR ] EC: Validating primary data. [2025-09-17T18:39:29.688468] [DEBUG] [VALIDATOR ] EC: All expected trading days are present. [2025-09-17T18:39:29.688713] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T18:39:29.689943] [DEBUG] [VALIDATOR ] EC: Primary data validation passed. [2025-09-17T18:39:29.691880] [INFO ] [MAIN ] EC: Fetched primary data is valid. [2025-09-17T18:39:29.691975] [DEBUG] [LOCAL ] EC: Saving primary data. [2025-09-17T18:39:29.693853] [DEBUG] [LOCAL ] EC: Trimmed 71844 records to 49474 (keeping 200 days of data) [2025-09-17T18:39:29.994805] [DEBUG] [LOCAL ] EC: Primary data saved (49474 records). [2025-09-17T18:39:29.994953] [INFO ] [MAIN ] EC: Full history saved. [2025-09-17T18:39:29.995062] [INFO ] [MAIN ] Update Progress: 683/2371 symbols completed. EC took 39.3s. Estimated remaining: 4h 5m 50s. Rate: 6.9 symbols/min [2025-09-17T18:39:30.021035] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-03. [2025-09-17T18:39:30.173194] [INFO ] [MAIN ] ECCW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:39:30.173412] [DEBUG] [LOCAL ] ECCW: No existing data file found in primary storage. [2025-09-17T18:39:30.173461] [WARN ] [MAIN ] ECCW: No existing data found, performing full refresh instead. [2025-09-17T18:39:30.173628] [INFO ] [MAIN ] ECCW: Wiping existing primary data before full refresh. [2025-09-17T18:39:30.173701] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-17T18:39:30.173746] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-17T18:39:30.173778] [INFO ] [MAIN ] ECCW: Starting full primary refresh. [2025-09-17T18:39:30.536515] [INFO ] [REMOTE ] ECCW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:39:30.818576] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-08. [2025-09-17T18:39:30.820175] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T18:39:31.615821] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-04. [2025-09-17T18:39:32.162057] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T18:39:32.415816] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-05. [2025-09-17T18:39:32.456350] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T18:39:32.887047] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T18:39:33.215774] [INFO ] [REMOTE ] EBS: Fetching primary data for 2025-09. [2025-09-17T18:39:34.015839] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-11. [2025-09-17T18:39:34.412953] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-17T18:39:34.815744] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-06. [2025-09-17T18:39:34.869278] [INFO ] [REMOTE ] EBS: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T18:39:34.875061] [INFO ] [REMOTE ] EBS: Full fetch complete (67266 records). [2025-09-17T18:39:34.875159] [DEBUG] [VALIDATOR ] EBS: Validating primary data. [2025-09-17T18:39:35.265413] [DEBUG] [VALIDATOR ] EBS: All expected trading days are present. [2025-09-17T18:39:35.265304] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T18:39:35.265555] [DEBUG] [VALIDATOR ] EBS: Primary data validation passed. [2025-09-17T18:39:35.267967] [INFO ] [MAIN ] EBS: Fetched primary data is valid. [2025-09-17T18:39:35.268038] [DEBUG] [LOCAL ] EBS: Saving primary data. [2025-09-17T18:39:35.269420] [DEBUG] [LOCAL ] EBS: Trimmed 67266 records to 47008 (keeping 200 days of data) [2025-09-17T18:39:35.527352] [DEBUG] [LOCAL ] EBS: Primary data saved (47008 records). [2025-09-17T18:39:35.527485] [INFO ] [MAIN ] EBS: Full history saved. [2025-09-17T18:39:35.527567] [INFO ] [MAIN ] Update Progress: 684/2371 symbols completed. EBS took 44.8s. Estimated remaining: 4h 5m 33s. Rate: 6.9 symbols/min [2025-09-17T18:39:35.624350] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-07. [2025-09-17T18:39:35.699635] [INFO ] [MAIN ] ECCX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:39:35.699828] [DEBUG] [LOCAL ] ECCX: No existing data file found in primary storage. [2025-09-17T18:39:35.699866] [WARN ] [MAIN ] ECCX: No existing data found, performing full refresh instead. [2025-09-17T18:39:35.699999] [INFO ] [MAIN ] ECCX: Wiping existing primary data before full refresh. [2025-09-17T18:39:35.700040] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-17T18:39:35.700084] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-17T18:39:35.700117] [INFO ] [MAIN ] ECCX: Starting full primary refresh. [2025-09-17T18:39:36.055147] [INFO ] [REMOTE ] ECCX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:39:36.116609] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T18:39:36.415791] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-05. [2025-09-17T18:39:36.959264] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T18:39:37.215771] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2024-12. [2025-09-17T18:39:37.598563] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-17T18:39:38.015829] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-01. [2025-09-17T18:39:38.336317] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-01 (0.32 seconds). [2025-09-17T18:39:38.815775] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-11. [2025-09-17T18:39:39.324905] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T18:39:39.615779] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-02. [2025-09-17T18:39:39.943151] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T18:39:40.415831] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-06. [2025-09-17T18:39:40.706720] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-17T18:39:41.215780] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-03. [2025-09-17T18:39:41.547678] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T18:39:42.015814] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2024-12. [2025-09-17T18:39:42.357866] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-17T18:39:42.815836] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-01. [2025-09-17T18:39:43.189101] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-17T18:39:43.615791] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-04. [2025-09-17T18:39:43.964914] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-17T18:39:44.415809] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-07. [2025-09-17T18:39:44.746982] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-17T18:39:45.215828] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-02. [2025-09-17T18:39:45.551351] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T18:39:46.015783] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-08. [2025-09-17T18:39:46.551572] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T18:39:46.815828] [INFO ] [REMOTE ] ECCU: Fetching primary data for 2025-09. [2025-09-17T18:39:47.299672] [INFO ] [REMOTE ] ECCU: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T18:39:47.300539] [INFO ] [REMOTE ] ECCU: Full fetch complete (4390 records). [2025-09-17T18:39:47.300605] [DEBUG] [VALIDATOR ] ECCU: Validating primary data. [2025-09-17T18:39:47.479577] [WARN ] [VALIDATOR ] ECCU: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-09-17T18:39:47.479789] [FATAL] [MAIN ] ECCU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:39:47.479836] [WARN ] [MAIN ] ECCU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:39:47.479880] [INFO ] [LOCAL ] ECCU: Starting deletion of primary data. [2025-09-17T18:39:47.479935] [DEBUG] [LOCAL ] ECCU: No primary data file found to delete. [2025-09-17T18:39:47.479969] [INFO ] [LOCAL ] ECCU: Starting deletion of derivative data. [2025-09-17T18:39:47.480017] [DEBUG] [LOCAL ] ECCU: No derivative data file found to delete. [2025-09-17T18:39:47.480074] [INFO ] [MAIN ] Update Progress: 685/2371 symbols completed. ECCU took 23.8s. Estimated remaining: 4h 5m 32s. Rate: 6.9 symbols/min [2025-09-17T18:39:47.620956] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-08. [2025-09-17T18:39:47.653276] [INFO ] [MAIN ] ECG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:39:47.694953] [DEBUG] [LOCAL ] ECG: Loaded 34791 existing records from primary storage. [2025-09-17T18:39:47.695096] [INFO ] [MAIN ] ECG: Loaded 34791 existing records. [2025-09-17T18:39:47.879127] [WARN ] [MAIN ] ECG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:39:47.879347] [INFO ] [MAIN ] ECG: Wiping existing primary data before full refresh. [2025-09-17T18:39:47.879393] [INFO ] [LOCAL ] ECG: Starting deletion of primary data. [2025-09-17T18:39:47.880290] [DEBUG] [LOCAL ] ECG: Deleted primary data file. [2025-09-17T18:39:47.880345] [INFO ] [MAIN ] ECG: Starting full primary refresh. [2025-09-17T18:39:48.210508] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T18:39:48.239332] [INFO ] [REMOTE ] ECG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:39:48.415754] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-11. [2025-09-17T18:39:49.215775] [INFO ] [REMOTE ] ECCC: Fetching primary data for 2025-09. [2025-09-17T18:39:49.818672] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T18:39:49.867532] [INFO ] [REMOTE ] ECCC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T18:39:49.868321] [INFO ] [REMOTE ] ECCC: Full fetch complete (1287 records). [2025-09-17T18:39:49.868390] [DEBUG] [VALIDATOR ] ECCC: Validating primary data. [2025-09-17T18:39:50.020881] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-05. [2025-09-17T18:39:50.057412] [WARN ] [VALIDATOR ] ECCC: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T18:39:50.058380] [FATAL] [MAIN ] ECCC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:39:50.058461] [WARN ] [MAIN ] ECCC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:39:50.058531] [INFO ] [LOCAL ] ECCC: Starting deletion of primary data. [2025-09-17T18:39:50.058589] [DEBUG] [LOCAL ] ECCC: No primary data file found to delete. [2025-09-17T18:39:50.058625] [INFO ] [LOCAL ] ECCC: Starting deletion of derivative data. [2025-09-17T18:39:50.058707] [DEBUG] [LOCAL ] ECCC: No derivative data file found to delete. [2025-09-17T18:39:50.058793] [INFO ] [MAIN ] Update Progress: 686/2371 symbols completed. ECCC took 33.7s. Estimated remaining: 4h 5m 9s. Rate: 6.9 symbols/min [2025-09-17T18:39:50.237140] [INFO ] [MAIN ] ECL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:39:50.290674] [DEBUG] [LOCAL ] ECL: Loaded 46722 existing records from primary storage. [2025-09-17T18:39:50.290879] [INFO ] [MAIN ] ECL: Loaded 46722 existing records. [2025-09-17T18:39:50.512542] [WARN ] [MAIN ] ECL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:39:50.512825] [INFO ] [MAIN ] ECL: Wiping existing primary data before full refresh. [2025-09-17T18:39:50.512870] [INFO ] [LOCAL ] ECL: Starting deletion of primary data. [2025-09-17T18:39:50.514024] [DEBUG] [LOCAL ] ECL: Deleted primary data file. [2025-09-17T18:39:50.514075] [INFO ] [MAIN ] ECL: Starting full primary refresh. [2025-09-17T18:39:50.732581] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T18:39:50.820831] [INFO ] [REMOTE ] ECG: Fetching primary data for 2024-12. [2025-09-17T18:39:50.885658] [INFO ] [REMOTE ] ECL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:39:51.615792] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-06. [2025-09-17T18:39:51.946955] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-17T18:39:52.410104] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T18:39:52.417472] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-03. [2025-09-17T18:39:52.920786] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T18:39:53.215804] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-01. [2025-09-17T18:39:54.015784] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-11. [2025-09-17T18:39:54.721401] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T18:39:54.815812] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-07. [2025-09-17T18:39:55.243493] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T18:39:55.346129] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T18:39:55.615801] [INFO ] [REMOTE ] ECL: Fetching primary data for 2024-12. [2025-09-17T18:39:56.415808] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-08. [2025-09-17T18:39:56.939079] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-17T18:39:57.220777] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-04. [2025-09-17T18:39:57.223586] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T18:39:57.498173] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-04 (0.28 seconds). [2025-09-17T18:39:58.015795] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-02. [2025-09-17T18:39:58.815786] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-05. [2025-09-17T18:39:59.171117] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-17T18:39:59.621469] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-06. [2025-09-17T18:39:59.637288] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T18:39:59.966001] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T18:40:00.415857] [INFO ] [REMOTE ] ECCW: Fetching primary data for 2025-09. [2025-09-17T18:40:01.059166] [INFO ] [REMOTE ] ECCW: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T18:40:01.059980] [INFO ] [REMOTE ] ECCW: Full fetch complete (1408 records). [2025-09-17T18:40:01.060051] [DEBUG] [VALIDATOR ] ECCW: Validating primary data. [2025-09-17T18:40:01.060412] [FATAL] [VALIDATOR ] ECCW: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:40:01.060490] [FATAL] [MAIN ] ECCW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:40:01.060528] [WARN ] [MAIN ] ECCW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:40:01.060567] [INFO ] [LOCAL ] ECCW: Starting deletion of primary data. [2025-09-17T18:40:01.060624] [DEBUG] [LOCAL ] ECCW: No primary data file found to delete. [2025-09-17T18:40:01.060683] [INFO ] [LOCAL ] ECCW: Starting deletion of derivative data. [2025-09-17T18:40:01.060728] [DEBUG] [LOCAL ] ECCW: No derivative data file found to delete. [2025-09-17T18:40:01.060784] [INFO ] [MAIN ] Update Progress: 687/2371 symbols completed. ECCW took 31.1s. Estimated remaining: 4h 5m 5s. Rate: 6.9 symbols/min [2025-09-17T18:40:01.221683] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-07. [2025-09-17T18:40:01.257293] [INFO ] [MAIN ] ECO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:40:01.279301] [DEBUG] [LOCAL ] ECO: Loaded 18701 existing records from primary storage. [2025-09-17T18:40:01.279478] [INFO ] [MAIN ] ECO: Loaded 18701 existing records. [2025-09-17T18:40:01.476791] [WARN ] [MAIN ] ECO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:40:01.477089] [INFO ] [MAIN ] ECO: Wiping existing primary data before full refresh. [2025-09-17T18:40:01.477138] [INFO ] [LOCAL ] ECO: Starting deletion of primary data. [2025-09-17T18:40:01.477743] [DEBUG] [LOCAL ] ECO: Deleted primary data file. [2025-09-17T18:40:01.477810] [INFO ] [MAIN ] ECO: Starting full primary refresh. [2025-09-17T18:40:01.774357] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T18:40:01.870392] [INFO ] [REMOTE ] ECO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:40:02.015847] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-01. [2025-09-17T18:40:02.815816] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-08. [2025-09-17T18:40:03.243284] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T18:40:03.615690] [INFO ] [REMOTE ] ECCX: Fetching primary data for 2025-09. [2025-09-17T18:40:03.734391] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T18:40:03.996719] [INFO ] [REMOTE ] ECCX: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T18:40:03.997548] [INFO ] [REMOTE ] ECCX: Full fetch complete (1487 records). [2025-09-17T18:40:03.997621] [DEBUG] [VALIDATOR ] ECCX: Validating primary data. [2025-09-17T18:40:04.178871] [WARN ] [VALIDATOR ] ECCX: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T18:40:04.179100] [FATAL] [MAIN ] ECCX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:40:04.179168] [WARN ] [MAIN ] ECCX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:40:04.179236] [INFO ] [LOCAL ] ECCX: Starting deletion of primary data. [2025-09-17T18:40:04.179500] [DEBUG] [LOCAL ] ECCX: No primary data file found to delete. [2025-09-17T18:40:04.179535] [INFO ] [LOCAL ] ECCX: Starting deletion of derivative data. [2025-09-17T18:40:04.179572] [DEBUG] [LOCAL ] ECCX: No derivative data file found to delete. [2025-09-17T18:40:04.179629] [INFO ] [MAIN ] Update Progress: 688/2371 symbols completed. ECCX took 28.7s. Estimated remaining: 4h 4m 43s. Rate: 6.9 symbols/min [2025-09-17T18:40:04.349245] [INFO ] [MAIN ] ECVT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:40:04.392285] [DEBUG] [LOCAL ] ECVT: Loaded 43110 existing records from primary storage. [2025-09-17T18:40:04.392465] [INFO ] [MAIN ] ECVT: Loaded 43110 existing records. [2025-09-17T18:40:04.421559] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-03. [2025-09-17T18:40:04.600036] [WARN ] [MAIN ] ECVT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:40:04.600312] [INFO ] [MAIN ] ECVT: Wiping existing primary data before full refresh. [2025-09-17T18:40:04.600358] [INFO ] [LOCAL ] ECVT: Starting deletion of primary data. [2025-09-17T18:40:04.601386] [DEBUG] [LOCAL ] ECVT: Deleted primary data file. [2025-09-17T18:40:04.601448] [INFO ] [MAIN ] ECVT: Starting full primary refresh. [2025-09-17T18:40:04.974498] [INFO ] [REMOTE ] ECVT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:40:05.215814] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-11. [2025-09-17T18:40:06.015786] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-11. [2025-09-17T18:40:06.058938] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T18:40:06.206307] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T18:40:06.815792] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-04. [2025-09-17T18:40:07.615746] [INFO ] [REMOTE ] ECO: Fetching primary data for 2024-12. [2025-09-17T18:40:08.054982] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-17T18:40:08.148253] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T18:40:08.415805] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-05. [2025-09-17T18:40:08.983554] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T18:40:09.215836] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-02. [2025-09-17T18:40:09.949079] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T18:40:10.015773] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-06. [2025-09-17T18:40:10.815785] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-01. [2025-09-17T18:40:11.080680] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T18:40:11.318880] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T18:40:11.615794] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-07. [2025-09-17T18:40:12.381596] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T18:40:12.415728] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-02. [2025-09-17T18:40:12.971914] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T18:40:13.215772] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2024-12. [2025-09-17T18:40:13.633830] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T18:40:14.015795] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-08. [2025-09-17T18:40:14.716360] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T18:40:14.815754] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-01. [2025-09-17T18:40:15.011024] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T18:40:15.615733] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-03. [2025-09-17T18:40:15.813794] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T18:40:16.415782] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-02. [2025-09-17T18:40:17.215780] [INFO ] [REMOTE ] ECG: Fetching primary data for 2025-09. [2025-09-17T18:40:17.618563] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T18:40:17.870405] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T18:40:18.015779] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-03. [2025-09-17T18:40:18.473806] [INFO ] [REMOTE ] ECG: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T18:40:18.479000] [INFO ] [REMOTE ] ECG: Full fetch complete (51765 records). [2025-09-17T18:40:18.479100] [DEBUG] [VALIDATOR ] ECG: Validating primary data. [2025-09-17T18:40:18.821599] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-04. [2025-09-17T18:40:18.857727] [DEBUG] [VALIDATOR ] ECG: All expected trading days are present. [2025-09-17T18:40:18.857802] [DEBUG] [VALIDATOR ] ECG: Primary data validation passed. [2025-09-17T18:40:18.858456] [INFO ] [MAIN ] ECG: Fetched primary data is valid. [2025-09-17T18:40:18.858496] [DEBUG] [LOCAL ] ECG: Saving primary data. [2025-09-17T18:40:18.859807] [DEBUG] [LOCAL ] ECG: Trimmed 51765 records to 34704 (keeping 200 days of data) [2025-09-17T18:40:19.070629] [DEBUG] [LOCAL ] ECG: Primary data saved (34704 records). [2025-09-17T18:40:19.070791] [INFO ] [MAIN ] ECG: Full history saved. [2025-09-17T18:40:19.070884] [INFO ] [MAIN ] Update Progress: 689/2371 symbols completed. ECG took 31.6s. Estimated remaining: 4h 4m 49s. Rate: 6.9 symbols/min [2025-09-17T18:40:19.239930] [INFO ] [MAIN ] ED: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:40:19.293197] [DEBUG] [LOCAL ] ED: Loaded 52817 existing records from primary storage. [2025-09-17T18:40:19.293337] [INFO ] [MAIN ] ED: Loaded 52817 existing records. [2025-09-17T18:40:19.469607] [WARN ] [MAIN ] ED: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:40:19.469901] [INFO ] [MAIN ] ED: Wiping existing primary data before full refresh. [2025-09-17T18:40:19.469946] [INFO ] [LOCAL ] ED: Starting deletion of primary data. [2025-09-17T18:40:19.470976] [DEBUG] [LOCAL ] ED: Deleted primary data file. [2025-09-17T18:40:19.471025] [INFO ] [MAIN ] ED: Starting full primary refresh. [2025-09-17T18:40:19.622711] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-03. [2025-09-17T18:40:19.837954] [INFO ] [REMOTE ] ED: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:40:19.861711] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T18:40:20.005884] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T18:40:20.415780] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-05. [2025-09-17T18:40:21.226224] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-11. [2025-09-17T18:40:21.229534] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T18:40:21.454788] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T18:40:22.015833] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-04. [2025-09-17T18:40:22.815833] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-06. [2025-09-17T18:40:23.021841] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T18:40:23.626361] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-04. [2025-09-17T18:40:23.632269] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T18:40:23.667876] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T18:40:24.415825] [INFO ] [REMOTE ] ED: Fetching primary data for 2024-12. [2025-09-17T18:40:25.216301] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T18:40:25.216446] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-07. [2025-09-17T18:40:26.015789] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-05. [2025-09-17T18:40:26.219801] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T18:40:26.276217] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T18:40:26.815799] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-08. [2025-09-17T18:40:27.577314] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T18:40:27.615769] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-01. [2025-09-17T18:40:28.050765] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T18:40:28.415781] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-06. [2025-09-17T18:40:29.215835] [INFO ] [REMOTE ] ECO: Fetching primary data for 2025-09. [2025-09-17T18:40:29.504974] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T18:40:29.724064] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T18:40:30.015807] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-05. [2025-09-17T18:40:30.301519] [INFO ] [REMOTE ] ECO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T18:40:30.305098] [INFO ] [REMOTE ] ECO: Full fetch complete (29631 records). [2025-09-17T18:40:30.305203] [DEBUG] [VALIDATOR ] ECO: Validating primary data. [2025-09-17T18:40:30.675003] [DEBUG] [VALIDATOR ] ECO: All expected trading days are present. [2025-09-17T18:40:30.675084] [DEBUG] [VALIDATOR ] ECO: Primary data validation passed. [2025-09-17T18:40:30.675553] [INFO ] [MAIN ] ECO: Fetched primary data is valid. [2025-09-17T18:40:30.675594] [DEBUG] [LOCAL ] ECO: Saving primary data. [2025-09-17T18:40:30.676310] [DEBUG] [LOCAL ] ECO: Trimmed 29631 records to 18677 (keeping 200 days of data) [2025-09-17T18:40:30.795132] [DEBUG] [LOCAL ] ECO: Primary data saved (18677 records). [2025-09-17T18:40:30.795298] [INFO ] [MAIN ] ECO: Full history saved. [2025-09-17T18:40:30.795389] [INFO ] [MAIN ] Update Progress: 690/2371 symbols completed. ECO took 29.7s. Estimated remaining: 4h 4m 48s. Rate: 6.9 symbols/min [2025-09-17T18:40:30.827757] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-07. [2025-09-17T18:40:30.977929] [INFO ] [MAIN ] EDD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:40:31.003983] [DEBUG] [LOCAL ] EDD: Loaded 27136 existing records from primary storage. [2025-09-17T18:40:31.004180] [INFO ] [MAIN ] EDD: Loaded 27136 existing records. [2025-09-17T18:40:31.184771] [WARN ] [MAIN ] EDD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:40:31.185006] [INFO ] [MAIN ] EDD: Wiping existing primary data before full refresh. [2025-09-17T18:40:31.185051] [INFO ] [LOCAL ] EDD: Starting deletion of primary data. [2025-09-17T18:40:31.185865] [DEBUG] [LOCAL ] EDD: Deleted primary data file. [2025-09-17T18:40:31.185914] [INFO ] [MAIN ] EDD: Starting full primary refresh. [2025-09-17T18:40:31.542552] [INFO ] [REMOTE ] EDD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:40:31.615753] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-11. [2025-09-17T18:40:31.772977] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T18:40:32.415843] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-02. [2025-09-17T18:40:32.723495] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T18:40:32.941670] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T18:40:33.215809] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-08. [2025-09-17T18:40:34.015756] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-06. [2025-09-17T18:40:34.063924] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T18:40:34.815790] [INFO ] [REMOTE ] EDD: Fetching primary data for 2024-12. [2025-09-17T18:40:34.929355] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T18:40:35.428114] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T18:40:35.615777] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-07. [2025-09-17T18:40:36.062513] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T18:40:36.415786] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-03. [2025-09-17T18:40:37.179529] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T18:40:37.215784] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-08. [2025-09-17T18:40:38.015778] [INFO ] [REMOTE ] ECL: Fetching primary data for 2025-09. [2025-09-17T18:40:38.210906] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T18:40:38.735174] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T18:40:38.815773] [INFO ] [REMOTE ] ECVT: Fetching primary data for 2025-09. [2025-09-17T18:40:39.615831] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-01. [2025-09-17T18:40:39.854622] [INFO ] [REMOTE ] ECL: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T18:40:39.865090] [INFO ] [REMOTE ] ECL: Full fetch complete (67283 records). [2025-09-17T18:40:39.865357] [DEBUG] [VALIDATOR ] ECL: Validating primary data. [2025-09-17T18:40:40.422123] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-04. [2025-09-17T18:40:40.423849] [DEBUG] [VALIDATOR ] ECL: All expected trading days are present. [2025-09-17T18:40:40.424026] [DEBUG] [VALIDATOR ] ECL: Primary data validation passed. [2025-09-17T18:40:40.424927] [INFO ] [MAIN ] ECL: Fetched primary data is valid. [2025-09-17T18:40:40.440730] [DEBUG] [LOCAL ] ECL: Saving primary data. [2025-09-17T18:40:40.443809] [INFO ] [REMOTE ] ECVT: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T18:40:40.450403] [INFO ] [REMOTE ] ECVT: Full fetch complete (59717 records). [2025-09-17T18:40:40.450578] [DEBUG] [LOCAL ] ECL: Trimmed 67283 records to 46721 (keeping 200 days of data) [2025-09-17T18:40:40.450880] [DEBUG] [VALIDATOR ] ECVT: Validating primary data. [2025-09-17T18:40:40.620773] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T18:40:41.013117] [DEBUG] [VALIDATOR ] ECVT: All expected trading days are present. [2025-09-17T18:40:41.014332] [DEBUG] [VALIDATOR ] ECVT: Primary data validation passed. [2025-09-17T18:40:41.015474] [INFO ] [MAIN ] ECVT: Fetched primary data is valid. [2025-09-17T18:40:41.015541] [DEBUG] [LOCAL ] ECVT: Saving primary data. [2025-09-17T18:40:41.019347] [DEBUG] [LOCAL ] ECVT: Trimmed 59717 records to 43123 (keeping 200 days of data) [2025-09-17T18:40:41.216040] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-02. [2025-09-17T18:40:41.394920] [DEBUG] [LOCAL ] ECVT: Primary data saved (43123 records). [2025-09-17T18:40:41.395579] [INFO ] [MAIN ] ECVT: Full history saved. [2025-09-17T18:40:41.395713] [INFO ] [MAIN ] Update Progress: 691/2371 symbols completed. ECVT took 37.2s. Estimated remaining: 4h 4m 44s. Rate: 6.9 symbols/min [2025-09-17T18:40:41.606567] [INFO ] [MAIN ] EDF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:40:41.624662] [DEBUG] [LOCAL ] EDF: Loaded 13446 existing records from primary storage. [2025-09-17T18:40:41.625390] [INFO ] [MAIN ] EDF: Loaded 13446 existing records. [2025-09-17T18:40:41.718577] [DEBUG] [LOCAL ] ECL: Primary data saved (46721 records). [2025-09-17T18:40:41.729026] [INFO ] [MAIN ] ECL: Full history saved. [2025-09-17T18:40:41.729204] [INFO ] [MAIN ] Update Progress: 692/2371 symbols completed. ECL took 51.7s. Estimated remaining: 4h 4m 14s. Rate: 6.9 symbols/min [2025-09-17T18:40:41.969264] [WARN ] [MAIN ] EDF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:40:41.975135] [INFO ] [MAIN ] EDF: Wiping existing primary data before full refresh. [2025-09-17T18:40:41.993194] [INFO ] [MAIN ] EDN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:40:41.993270] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-17T18:40:41.993984] [DEBUG] [LOCAL ] EDF: Deleted primary data file. [2025-09-17T18:40:41.994136] [INFO ] [MAIN ] EDF: Starting full primary refresh. [2025-09-17T18:40:42.185067] [DEBUG] [LOCAL ] EDN: Loaded 17603 existing records from primary storage. [2025-09-17T18:40:42.201363] [INFO ] [MAIN ] EDN: Loaded 17603 existing records. [2025-09-17T18:40:42.570176] [INFO ] [REMOTE ] EDF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:40:42.566180] [WARN ] [MAIN ] EDN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:40:42.570552] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-11. [2025-09-17T18:40:42.571778] [INFO ] [MAIN ] EDN: Wiping existing primary data before full refresh. [2025-09-17T18:40:42.577956] [INFO ] [LOCAL ] EDN: Starting deletion of primary data. [2025-09-17T18:40:42.587812] [DEBUG] [LOCAL ] EDN: Deleted primary data file. [2025-09-17T18:40:42.587908] [INFO ] [MAIN ] EDN: Starting full primary refresh. [2025-09-17T18:40:42.588431] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T18:40:42.820709] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-03. [2025-09-17T18:40:42.922242] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-04 (2.50 seconds). [2025-09-17T18:40:43.016670] [INFO ] [REMOTE ] EDN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:40:43.615756] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-11. [2025-09-17T18:40:43.738751] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T18:40:44.023385] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T18:40:44.415810] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-04. [2025-09-17T18:40:45.215811] [INFO ] [REMOTE ] EDF: Fetching primary data for 2024-12. [2025-09-17T18:40:45.351514] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T18:40:45.557265] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T18:40:45.814460] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T18:40:46.015809] [INFO ] [REMOTE ] EDN: Fetching primary data for 2024-12. [2025-09-17T18:40:46.815792] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-01. [2025-09-17T18:40:47.352904] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T18:40:47.615818] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-05. [2025-09-17T18:40:47.801957] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T18:40:48.415736] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-01. [2025-09-17T18:40:48.797126] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T18:40:49.215773] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-02. [2025-09-17T18:40:49.729112] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T18:40:50.015792] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-06. [2025-09-17T18:40:50.280133] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T18:40:50.815764] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-05. [2025-09-17T18:40:51.219581] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T18:40:51.615777] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-07. [2025-09-17T18:40:52.415829] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-03. [2025-09-17T18:40:52.644223] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T18:40:52.764930] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T18:40:53.215814] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-06. [2025-09-17T18:40:53.399012] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T18:40:54.015793] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-02. [2025-09-17T18:40:54.815708] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-04. [2025-09-17T18:40:54.927149] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T18:40:55.151393] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T18:40:55.608315] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T18:40:55.615728] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-05. [2025-09-17T18:40:56.253923] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T18:40:56.415776] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-07. [2025-09-17T18:40:57.215795] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-08. [2025-09-17T18:40:58.015877] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-06. [2025-09-17T18:40:58.228142] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T18:40:58.540551] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T18:40:58.553016] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T18:40:58.815775] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-07. [2025-09-17T18:40:59.615799] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-08. [2025-09-17T18:40:59.736708] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T18:41:00.415804] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-08. [2025-09-17T18:41:01.215839] [INFO ] [REMOTE ] EDD: Fetching primary data for 2025-09. [2025-09-17T18:41:01.258599] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T18:41:01.491926] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T18:41:02.015782] [INFO ] [REMOTE ] ED: Fetching primary data for 2025-09. [2025-09-17T18:41:02.115686] [INFO ] [REMOTE ] EDD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T18:41:02.119935] [INFO ] [REMOTE ] EDD: Full fetch complete (39035 records). [2025-09-17T18:41:02.120082] [DEBUG] [VALIDATOR ] EDD: Validating primary data. [2025-09-17T18:41:02.501309] [DEBUG] [VALIDATOR ] EDD: All expected trading days are present. [2025-09-17T18:41:02.501418] [DEBUG] [VALIDATOR ] EDD: Primary data validation passed. [2025-09-17T18:41:02.501986] [INFO ] [MAIN ] EDD: Fetched primary data is valid. [2025-09-17T18:41:02.502060] [DEBUG] [LOCAL ] EDD: Saving primary data. [2025-09-17T18:41:02.503073] [DEBUG] [LOCAL ] EDD: Trimmed 39035 records to 27235 (keeping 200 days of data) [2025-09-17T18:41:02.658386] [DEBUG] [LOCAL ] EDD: Primary data saved (27235 records). [2025-09-17T18:41:02.658528] [INFO ] [MAIN ] EDD: Full history saved. [2025-09-17T18:41:02.658705] [INFO ] [MAIN ] Update Progress: 693/2371 symbols completed. EDD took 31.9s. Estimated remaining: 4h 4m 35s. Rate: 6.9 symbols/min [2025-09-17T18:41:02.816479] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-03. [2025-09-17T18:41:02.837176] [INFO ] [MAIN ] EDU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:41:02.882628] [DEBUG] [LOCAL ] EDU: Loaded 45350 existing records from primary storage. [2025-09-17T18:41:02.882806] [INFO ] [MAIN ] EDU: Loaded 45350 existing records. [2025-09-17T18:41:03.073347] [WARN ] [MAIN ] EDU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:41:03.073618] [INFO ] [MAIN ] EDU: Wiping existing primary data before full refresh. [2025-09-17T18:41:03.073709] [INFO ] [LOCAL ] EDU: Starting deletion of primary data. [2025-09-17T18:41:03.074548] [DEBUG] [LOCAL ] EDU: Deleted primary data file. [2025-09-17T18:41:03.074611] [INFO ] [MAIN ] EDU: Starting full primary refresh. [2025-09-17T18:41:03.433361] [INFO ] [REMOTE ] EDU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:41:03.615789] [INFO ] [REMOTE ] EDF: Fetching primary data for 2025-09. [2025-09-17T18:41:04.283207] [INFO ] [REMOTE ] ED: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-17T18:41:04.290129] [INFO ] [REMOTE ] ED: Full fetch complete (76198 records). [2025-09-17T18:41:04.290295] [DEBUG] [VALIDATOR ] ED: Validating primary data. [2025-09-17T18:41:04.420977] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-11. [2025-09-17T18:41:04.690408] [DEBUG] [VALIDATOR ] ED: All expected trading days are present. [2025-09-17T18:41:04.690487] [DEBUG] [VALIDATOR ] ED: Primary data validation passed. [2025-09-17T18:41:04.691340] [INFO ] [MAIN ] ED: Fetched primary data is valid. [2025-09-17T18:41:04.691385] [DEBUG] [LOCAL ] ED: Saving primary data. [2025-09-17T18:41:04.693159] [DEBUG] [LOCAL ] ED: Trimmed 76198 records to 52827 (keeping 200 days of data) [2025-09-17T18:41:04.950285] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-17T18:41:05.047865] [DEBUG] [LOCAL ] ED: Primary data saved (52827 records). [2025-09-17T18:41:05.048000] [INFO ] [MAIN ] ED: Full history saved. [2025-09-17T18:41:05.049502] [INFO ] [MAIN ] Update Progress: 694/2371 symbols completed. ED took 46.0s. Estimated remaining: 4h 4m 11s. Rate: 6.9 symbols/min [2025-09-17T18:41:05.218288] [INFO ] [MAIN ] EE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:41:05.217061] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-04. [2025-09-17T18:41:05.255226] [DEBUG] [LOCAL ] EE: Loaded 32616 existing records from primary storage. [2025-09-17T18:41:05.255359] [INFO ] [MAIN ] EE: Loaded 32616 existing records. [2025-09-17T18:41:05.432884] [WARN ] [MAIN ] EE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:41:05.433121] [INFO ] [MAIN ] EE: Wiping existing primary data before full refresh. [2025-09-17T18:41:05.433164] [INFO ] [LOCAL ] EE: Starting deletion of primary data. [2025-09-17T18:41:05.433833] [DEBUG] [LOCAL ] EE: Deleted primary data file. [2025-09-17T18:41:05.433892] [INFO ] [MAIN ] EE: Starting full primary refresh. [2025-09-17T18:41:05.791202] [INFO ] [REMOTE ] EE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:41:06.015736] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-11. [2025-09-17T18:41:06.372167] [INFO ] [REMOTE ] EDF: Incremental fetch complete for 2025-09 (2.76 seconds). [2025-09-17T18:41:06.375200] [INFO ] [REMOTE ] EDF: Full fetch complete (20828 records). [2025-09-17T18:41:06.375433] [DEBUG] [VALIDATOR ] EDF: Validating primary data. [2025-09-17T18:41:06.376018] [FATAL] [VALIDATOR ] EDF: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:41:06.376093] [FATAL] [MAIN ] EDF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:41:06.376145] [WARN ] [MAIN ] EDF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:41:06.376192] [INFO ] [LOCAL ] EDF: Starting deletion of primary data. [2025-09-17T18:41:06.376260] [DEBUG] [LOCAL ] EDF: No primary data file found to delete. [2025-09-17T18:41:06.376306] [INFO ] [LOCAL ] EDF: Starting deletion of derivative data. [2025-09-17T18:41:06.376680] [DEBUG] [LOCAL ] EDF: Deleted derivative data file. [2025-09-17T18:41:06.376789] [INFO ] [MAIN ] Update Progress: 695/2371 symbols completed. EDF took 25.0s. Estimated remaining: 4h 3m 45s. Rate: 6.9 symbols/min [2025-09-17T18:41:06.554372] [INFO ] [MAIN ] EEA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:41:06.561052] [DEBUG] [LOCAL ] EEA: Loaded 2847 existing records from primary storage. [2025-09-17T18:41:06.561177] [INFO ] [MAIN ] EEA: Loaded 2847 existing records. [2025-09-17T18:41:06.743929] [WARN ] [MAIN ] EEA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:41:06.744182] [INFO ] [MAIN ] EEA: Wiping existing primary data before full refresh. [2025-09-17T18:41:06.744227] [INFO ] [LOCAL ] EEA: Starting deletion of primary data. [2025-09-17T18:41:06.744469] [DEBUG] [LOCAL ] EEA: Deleted primary data file. [2025-09-17T18:41:06.744514] [INFO ] [MAIN ] EEA: Starting full primary refresh. [2025-09-17T18:41:07.093196] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T18:41:07.128807] [INFO ] [REMOTE ] EEA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:41:07.134124] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-11. [2025-09-17T18:41:07.280365] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-11 (2.86 seconds). [2025-09-17T18:41:07.432831] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T18:41:07.615789] [INFO ] [REMOTE ] EE: Fetching primary data for 2024-12. [2025-09-17T18:41:07.678936] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T18:41:08.415769] [INFO ] [REMOTE ] EEA: Fetching primary data for 2024-12. [2025-09-17T18:41:08.884610] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T18:41:08.885476] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T18:41:09.215776] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-01. [2025-09-17T18:41:10.015695] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-01. [2025-09-17T18:41:10.341722] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T18:41:10.377534] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T18:41:10.815799] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-02. [2025-09-17T18:41:11.115295] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-17T18:41:11.615794] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-02. [2025-09-17T18:41:12.415779] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-05. [2025-09-17T18:41:12.746086] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T18:41:13.215783] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-03. [2025-09-17T18:41:13.477342] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T18:41:14.015828] [INFO ] [REMOTE ] EDU: Fetching primary data for 2024-12. [2025-09-17T18:41:14.271094] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T18:41:14.815790] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-04. [2025-09-17T18:41:15.616256] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-03. [2025-09-17T18:41:15.618924] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T18:41:16.208379] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T18:41:16.263013] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T18:41:16.415799] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-01. [2025-09-17T18:41:17.215787] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-04. [2025-09-17T18:41:17.910738] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T18:41:18.015788] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-05. [2025-09-17T18:41:18.267464] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T18:41:18.423017] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-17T18:41:18.815771] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-06. [2025-09-17T18:41:19.180131] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-17T18:41:19.615765] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-02. [2025-09-17T18:41:20.415781] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-05. [2025-09-17T18:41:21.215787] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-06. [2025-09-17T18:41:21.291853] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T18:41:21.361906] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T18:41:22.015802] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-06. [2025-09-17T18:41:22.287696] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T18:41:22.815789] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-07. [2025-09-17T18:41:23.615775] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-03. [2025-09-17T18:41:23.975735] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T18:41:24.128254] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T18:41:24.415837] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-08. [2025-09-17T18:41:24.950026] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T18:41:25.215825] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-07. [2025-09-17T18:41:25.556148] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T18:41:26.015829] [INFO ] [REMOTE ] EEA: Fetching primary data for 2025-09. [2025-09-17T18:41:26.360765] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T18:41:26.500721] [INFO ] [REMOTE ] EEA: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T18:41:26.501991] [INFO ] [REMOTE ] EEA: Full fetch complete (3977 records). [2025-09-17T18:41:26.502075] [DEBUG] [VALIDATOR ] EEA: Validating primary data. [2025-09-17T18:41:26.820870] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-07. [2025-09-17T18:41:26.883986] [DEBUG] [VALIDATOR ] EEA: All expected trading days are present. [2025-09-17T18:41:26.884056] [DEBUG] [VALIDATOR ] EEA: Primary data validation passed. [2025-09-17T18:41:26.884186] [INFO ] [MAIN ] EEA: Fetched primary data is valid. [2025-09-17T18:41:26.884224] [DEBUG] [LOCAL ] EEA: Saving primary data. [2025-09-17T18:41:26.884584] [DEBUG] [LOCAL ] EEA: Trimmed 3977 records to 2830 (keeping 200 days of data) [2025-09-17T18:41:26.902498] [DEBUG] [LOCAL ] EEA: Primary data saved (2830 records). [2025-09-17T18:41:26.902636] [INFO ] [MAIN ] EEA: Full history saved. [2025-09-17T18:41:26.902733] [INFO ] [MAIN ] Update Progress: 696/2371 symbols completed. EEA took 20.5s. Estimated remaining: 4h 4m 4s. Rate: 6.9 symbols/min [2025-09-17T18:41:27.076461] [INFO ] [MAIN ] EEX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:41:27.089600] [DEBUG] [LOCAL ] EEX: Loaded 12348 existing records from primary storage. [2025-09-17T18:41:27.089732] [INFO ] [MAIN ] EEX: Loaded 12348 existing records. [2025-09-17T18:41:27.266317] [WARN ] [MAIN ] EEX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:41:27.266572] [INFO ] [MAIN ] EEX: Wiping existing primary data before full refresh. [2025-09-17T18:41:27.266616] [INFO ] [LOCAL ] EEX: Starting deletion of primary data. [2025-09-17T18:41:27.267113] [DEBUG] [LOCAL ] EEX: Deleted primary data file. [2025-09-17T18:41:27.267161] [INFO ] [MAIN ] EEX: Starting full primary refresh. [2025-09-17T18:41:27.621159] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-08. [2025-09-17T18:41:27.625170] [INFO ] [REMOTE ] EEX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:41:27.952838] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T18:41:28.415776] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-08. [2025-09-17T18:41:29.059360] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T18:41:29.215759] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-11. [2025-09-17T18:41:29.612872] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T18:41:30.015750] [INFO ] [REMOTE ] EE: Fetching primary data for 2025-09. [2025-09-17T18:41:30.392469] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T18:41:30.815833] [INFO ] [REMOTE ] EEX: Fetching primary data for 2024-12. [2025-09-17T18:41:30.962805] [INFO ] [REMOTE ] EE: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T18:41:30.967040] [INFO ] [REMOTE ] EE: Full fetch complete (43342 records). [2025-09-17T18:41:30.967247] [DEBUG] [VALIDATOR ] EE: Validating primary data. [2025-09-17T18:41:31.359140] [DEBUG] [VALIDATOR ] EE: All expected trading days are present. [2025-09-17T18:41:31.359339] [DEBUG] [VALIDATOR ] EE: Primary data validation passed. [2025-09-17T18:41:31.359952] [INFO ] [MAIN ] EE: Fetched primary data is valid. [2025-09-17T18:41:31.359994] [DEBUG] [LOCAL ] EE: Saving primary data. [2025-09-17T18:41:31.360988] [DEBUG] [LOCAL ] EE: Trimmed 43342 records to 32569 (keeping 200 days of data) [2025-09-17T18:41:31.563620] [DEBUG] [LOCAL ] EE: Primary data saved (32569 records). [2025-09-17T18:41:31.563814] [INFO ] [MAIN ] EE: Full history saved. [2025-09-17T18:41:31.563919] [INFO ] [MAIN ] Update Progress: 697/2371 symbols completed. EE took 26.5s. Estimated remaining: 4h 3m 46s. Rate: 6.9 symbols/min [2025-09-17T18:41:31.624728] [INFO ] [REMOTE ] EDN: Fetching primary data for 2025-09. [2025-09-17T18:41:31.758553] [INFO ] [MAIN ] EFC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:41:31.812090] [DEBUG] [LOCAL ] EFC: Loaded 46276 existing records from primary storage. [2025-09-17T18:41:31.812291] [INFO ] [MAIN ] EFC: Loaded 46276 existing records. [2025-09-17T18:41:32.049185] [WARN ] [MAIN ] EFC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:41:32.049755] [INFO ] [MAIN ] EFC: Wiping existing primary data before full refresh. [2025-09-17T18:41:32.066860] [INFO ] [LOCAL ] EFC: Starting deletion of primary data. [2025-09-17T18:41:32.068700] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T18:41:32.071017] [DEBUG] [LOCAL ] EFC: Deleted primary data file. [2025-09-17T18:41:32.076179] [INFO ] [MAIN ] EFC: Starting full primary refresh. [2025-09-17T18:41:32.421556] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-01. [2025-09-17T18:41:32.639280] [INFO ] [REMOTE ] EFC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:41:32.840046] [INFO ] [REMOTE ] EDN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T18:41:32.844604] [INFO ] [REMOTE ] EDN: Full fetch complete (30349 records). [2025-09-17T18:41:32.844814] [DEBUG] [VALIDATOR ] EDN: Validating primary data. [2025-09-17T18:41:33.220864] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-04. [2025-09-17T18:41:33.270113] [DEBUG] [VALIDATOR ] EDN: All expected trading days are present. [2025-09-17T18:41:33.270245] [DEBUG] [VALIDATOR ] EDN: Primary data validation passed. [2025-09-17T18:41:33.270833] [INFO ] [MAIN ] EDN: Fetched primary data is valid. [2025-09-17T18:41:33.270879] [DEBUG] [LOCAL ] EDN: Saving primary data. [2025-09-17T18:41:33.272447] [DEBUG] [LOCAL ] EDN: Trimmed 30349 records to 17653 (keeping 200 days of data) [2025-09-17T18:41:33.388252] [DEBUG] [LOCAL ] EDN: Primary data saved (17653 records). [2025-09-17T18:41:33.388405] [INFO ] [MAIN ] EDN: Full history saved. [2025-09-17T18:41:33.388518] [INFO ] [MAIN ] Update Progress: 698/2371 symbols completed. EDN took 51.7s. Estimated remaining: 4h 3m 20s. Rate: 6.9 symbols/min [2025-09-17T18:41:33.563085] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T18:41:33.580582] [INFO ] [MAIN ] EFR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:41:33.601035] [DEBUG] [LOCAL ] EFR: Loaded 14030 existing records from primary storage. [2025-09-17T18:41:33.601150] [INFO ] [MAIN ] EFR: Loaded 14030 existing records. [2025-09-17T18:41:33.781981] [WARN ] [MAIN ] EFR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:41:33.782232] [INFO ] [MAIN ] EFR: Wiping existing primary data before full refresh. [2025-09-17T18:41:33.782290] [INFO ] [LOCAL ] EFR: Starting deletion of primary data. [2025-09-17T18:41:33.782811] [DEBUG] [LOCAL ] EFR: Deleted primary data file. [2025-09-17T18:41:33.782861] [INFO ] [MAIN ] EFR: Starting full primary refresh. [2025-09-17T18:41:34.026983] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-02. [2025-09-17T18:41:34.145935] [INFO ] [REMOTE ] EFR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:41:34.737868] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T18:41:34.815731] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-05. [2025-09-17T18:41:35.282391] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T18:41:35.615839] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-03. [2025-09-17T18:41:36.415891] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-11. [2025-09-17T18:41:36.543523] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T18:41:36.664911] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T18:41:37.215815] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-11. [2025-09-17T18:41:37.774072] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T18:41:38.015800] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-04. [2025-09-17T18:41:38.815854] [INFO ] [REMOTE ] EFR: Fetching primary data for 2024-12. [2025-09-17T18:41:39.043230] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T18:41:39.231931] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T18:41:39.516541] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T18:41:39.615789] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-01. [2025-09-17T18:41:40.415808] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-06. [2025-09-17T18:41:40.432419] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T18:41:41.215786] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-05. [2025-09-17T18:41:41.940258] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T18:41:42.015788] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-07. [2025-09-17T18:41:42.099210] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T18:41:42.815792] [INFO ] [REMOTE ] EFC: Fetching primary data for 2024-12. [2025-09-17T18:41:43.615834] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-06. [2025-09-17T18:41:43.910311] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T18:41:44.415773] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-02. [2025-09-17T18:41:44.433137] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T18:41:44.681959] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T18:41:45.172884] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T18:41:45.215810] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-01. [2025-09-17T18:41:46.015800] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-07. [2025-09-17T18:41:46.761522] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T18:41:46.815779] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-08. [2025-09-17T18:41:46.858745] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T18:41:47.348103] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T18:41:47.615816] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-08. [2025-09-17T18:41:48.415821] [INFO ] [REMOTE ] EEX: Fetching primary data for 2025-09. [2025-09-17T18:41:49.158509] [INFO ] [REMOTE ] EEX: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T18:41:49.160163] [INFO ] [REMOTE ] EEX: Full fetch complete (20173 records). [2025-09-17T18:41:49.160233] [DEBUG] [VALIDATOR ] EEX: Validating primary data. [2025-09-17T18:41:49.216142] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-03. [2025-09-17T18:41:49.478077] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T18:41:49.571206] [DEBUG] [VALIDATOR ] EEX: All expected trading days are present. [2025-09-17T18:41:49.571292] [DEBUG] [VALIDATOR ] EEX: Primary data validation passed. [2025-09-17T18:41:49.571762] [INFO ] [MAIN ] EEX: Fetched primary data is valid. [2025-09-17T18:41:49.571806] [DEBUG] [LOCAL ] EEX: Saving primary data. [2025-09-17T18:41:49.572508] [DEBUG] [LOCAL ] EEX: Trimmed 20173 records to 12320 (keeping 200 days of data) [2025-09-17T18:41:49.653405] [DEBUG] [LOCAL ] EEX: Primary data saved (12320 records). [2025-09-17T18:41:49.653582] [INFO ] [MAIN ] EEX: Full history saved. [2025-09-17T18:41:49.653736] [INFO ] [MAIN ] Update Progress: 699/2371 symbols completed. EEX took 22.8s. Estimated remaining: 4h 3m 30s. Rate: 6.9 symbols/min [2025-09-17T18:41:49.825099] [INFO ] [MAIN ] EFT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:41:49.837855] [DEBUG] [LOCAL ] EFT: Loaded 12466 existing records from primary storage. [2025-09-17T18:41:49.837981] [INFO ] [MAIN ] EFT: Loaded 12466 existing records. [2025-09-17T18:41:50.018007] [WARN ] [MAIN ] EFT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:41:50.018082] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-02. [2025-09-17T18:41:50.019103] [INFO ] [MAIN ] EFT: Wiping existing primary data before full refresh. [2025-09-17T18:41:50.019156] [INFO ] [LOCAL ] EFT: Starting deletion of primary data. [2025-09-17T18:41:50.019505] [DEBUG] [LOCAL ] EFT: Deleted primary data file. [2025-09-17T18:41:50.019549] [INFO ] [MAIN ] EFT: Starting full primary refresh. [2025-09-17T18:41:50.379914] [INFO ] [REMOTE ] EFT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:41:50.387682] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T18:41:50.816033] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-11. [2025-09-17T18:41:51.615784] [INFO ] [REMOTE ] EDU: Fetching primary data for 2025-09. [2025-09-17T18:41:51.765616] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T18:41:51.993992] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T18:41:52.415842] [INFO ] [REMOTE ] EFT: Fetching primary data for 2024-12. [2025-09-17T18:41:53.201369] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T18:41:53.215673] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-01. [2025-09-17T18:41:53.328752] [INFO ] [REMOTE ] EDU: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T18:41:53.335116] [INFO ] [REMOTE ] EDU: Full fetch complete (66536 records). [2025-09-17T18:41:53.335297] [DEBUG] [VALIDATOR ] EDU: Validating primary data. [2025-09-17T18:41:53.727000] [DEBUG] [VALIDATOR ] EDU: All expected trading days are present. [2025-09-17T18:41:53.727079] [DEBUG] [VALIDATOR ] EDU: Primary data validation passed. [2025-09-17T18:41:53.727854] [INFO ] [MAIN ] EDU: Fetched primary data is valid. [2025-09-17T18:41:53.727900] [DEBUG] [LOCAL ] EDU: Saving primary data. [2025-09-17T18:41:53.729216] [DEBUG] [LOCAL ] EDU: Trimmed 66536 records to 45331 (keeping 200 days of data) [2025-09-17T18:41:53.996767] [DEBUG] [LOCAL ] EDU: Primary data saved (45331 records). [2025-09-17T18:41:53.996915] [INFO ] [MAIN ] EDU: Full history saved. [2025-09-17T18:41:53.997790] [INFO ] [MAIN ] Update Progress: 700/2371 symbols completed. EDU took 51.3s. Estimated remaining: 4h 3m 10s. Rate: 6.9 symbols/min [2025-09-17T18:41:54.020898] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-04. [2025-09-17T18:41:54.167325] [INFO ] [MAIN ] EFX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:41:54.167700] [DEBUG] [LOCAL ] EFX: No existing data file found in primary storage. [2025-09-17T18:41:54.167772] [WARN ] [MAIN ] EFX: No existing data found, performing full refresh instead. [2025-09-17T18:41:54.167935] [INFO ] [MAIN ] EFX: Wiping existing primary data before full refresh. [2025-09-17T18:41:54.168017] [INFO ] [LOCAL ] EFX: Starting deletion of primary data. [2025-09-17T18:41:54.168169] [DEBUG] [LOCAL ] EFX: No primary data file found to delete. [2025-09-17T18:41:54.173820] [INFO ] [MAIN ] EFX: Starting full primary refresh. [2025-09-17T18:41:54.223613] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T18:41:54.538606] [INFO ] [REMOTE ] EFX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:41:54.815785] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-02. [2025-09-17T18:41:55.216320] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T18:41:55.542545] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T18:41:55.615815] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-03. [2025-09-17T18:41:56.415776] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-03. [2025-09-17T18:41:57.176580] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T18:41:57.215717] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-04. [2025-09-17T18:41:57.441399] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T18:41:58.015798] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-11. [2025-09-17T18:41:58.175950] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T18:41:58.815802] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-05. [2025-09-17T18:41:59.544015] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T18:41:59.615824] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-04. [2025-09-17T18:41:59.684737] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T18:42:00.415784] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-05. [2025-09-17T18:42:01.215857] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-06. [2025-09-17T18:42:01.403716] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T18:42:01.560335] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T18:42:02.015765] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-05. [2025-09-17T18:42:02.815800] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-06. [2025-09-17T18:42:03.152922] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T18:42:03.615776] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-07. [2025-09-17T18:42:04.415805] [INFO ] [REMOTE ] EFX: Fetching primary data for 2024-12. [2025-09-17T18:42:04.621068] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T18:42:04.720038] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T18:42:05.215774] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-07. [2025-09-17T18:42:05.503880] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-05 (3.49 seconds). [2025-09-17T18:42:05.780853] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T18:42:05.800599] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T18:42:06.015778] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-06. [2025-09-17T18:42:06.815780] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-01. [2025-09-17T18:42:07.615800] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-08. [2025-09-17T18:42:07.675462] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T18:42:07.987122] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T18:42:08.415813] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-07. [2025-09-17T18:42:08.643453] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T18:42:09.215772] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-08. [2025-09-17T18:42:09.864813] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T18:42:10.015776] [INFO ] [REMOTE ] EFR: Fetching primary data for 2025-09. [2025-09-17T18:42:10.267426] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T18:42:10.815779] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-08. [2025-09-17T18:42:11.177031] [INFO ] [REMOTE ] EFR: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T18:42:11.179479] [INFO ] [REMOTE ] EFR: Full fetch complete (18411 records). [2025-09-17T18:42:11.179557] [DEBUG] [VALIDATOR ] EFR: Validating primary data. [2025-09-17T18:42:11.545528] [DEBUG] [VALIDATOR ] EFR: All expected trading days are present. [2025-09-17T18:42:11.545618] [DEBUG] [VALIDATOR ] EFR: Primary data validation passed. [2025-09-17T18:42:11.546038] [INFO ] [MAIN ] EFR: Fetched primary data is valid. [2025-09-17T18:42:11.546082] [DEBUG] [LOCAL ] EFR: Saving primary data. [2025-09-17T18:42:11.546840] [DEBUG] [LOCAL ] EFR: Trimmed 18411 records to 14091 (keeping 200 days of data) [2025-09-17T18:42:11.618126] [INFO ] [REMOTE ] EFT: Fetching primary data for 2025-09. [2025-09-17T18:42:11.638999] [DEBUG] [LOCAL ] EFR: Primary data saved (14091 records). [2025-09-17T18:42:11.639163] [INFO ] [MAIN ] EFR: Full history saved. [2025-09-17T18:42:11.639250] [INFO ] [MAIN ] Update Progress: 701/2371 symbols completed. EFR took 38.3s. Estimated remaining: 4h 3m 23s. Rate: 6.9 symbols/min [2025-09-17T18:42:11.812098] [INFO ] [MAIN ] EFXT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:42:11.842975] [DEBUG] [LOCAL ] EFXT: Loaded 29735 existing records from primary storage. [2025-09-17T18:42:11.843116] [INFO ] [MAIN ] EFXT: Loaded 29735 existing records. [2025-09-17T18:42:12.022127] [WARN ] [MAIN ] EFXT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:42:12.022357] [INFO ] [MAIN ] EFXT: Wiping existing primary data before full refresh. [2025-09-17T18:42:12.022401] [INFO ] [LOCAL ] EFXT: Starting deletion of primary data. [2025-09-17T18:42:12.023087] [DEBUG] [LOCAL ] EFXT: Deleted primary data file. [2025-09-17T18:42:12.023134] [INFO ] [MAIN ] EFXT: Starting full primary refresh. [2025-09-17T18:42:12.378064] [INFO ] [REMOTE ] EFXT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:42:12.415748] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-11. [2025-09-17T18:42:12.713904] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T18:42:12.796327] [INFO ] [REMOTE ] EFT: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T18:42:12.798480] [INFO ] [REMOTE ] EFT: Full fetch complete (17452 records). [2025-09-17T18:42:12.798615] [DEBUG] [VALIDATOR ] EFT: Validating primary data. [2025-09-17T18:42:13.230253] [INFO ] [REMOTE ] EFC: Fetching primary data for 2025-09. [2025-09-17T18:42:13.241156] [DEBUG] [VALIDATOR ] EFT: All expected trading days are present. [2025-09-17T18:42:13.242544] [DEBUG] [VALIDATOR ] EFT: Primary data validation passed. [2025-09-17T18:42:13.242994] [INFO ] [MAIN ] EFT: Fetched primary data is valid. [2025-09-17T18:42:13.243039] [DEBUG] [LOCAL ] EFT: Saving primary data. [2025-09-17T18:42:13.243892] [DEBUG] [LOCAL ] EFT: Trimmed 17452 records to 12511 (keeping 200 days of data) [2025-09-17T18:42:13.323564] [DEBUG] [LOCAL ] EFT: Primary data saved (12511 records). [2025-09-17T18:42:13.323774] [INFO ] [MAIN ] EFT: Full history saved. [2025-09-17T18:42:13.323867] [INFO ] [MAIN ] Update Progress: 702/2371 symbols completed. EFT took 23.7s. Estimated remaining: 4h 2m 57s. Rate: 6.9 symbols/min [2025-09-17T18:42:13.499365] [INFO ] [MAIN ] EG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:42:13.518916] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T18:42:13.549422] [DEBUG] [LOCAL ] EG: Loaded 29036 existing records from primary storage. [2025-09-17T18:42:13.549562] [INFO ] [MAIN ] EG: Loaded 29036 existing records. [2025-09-17T18:42:13.723505] [WARN ] [MAIN ] EG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:42:13.723780] [INFO ] [MAIN ] EG: Wiping existing primary data before full refresh. [2025-09-17T18:42:13.723827] [INFO ] [LOCAL ] EG: Starting deletion of primary data. [2025-09-17T18:42:13.724601] [DEBUG] [LOCAL ] EG: Deleted primary data file. [2025-09-17T18:42:13.724675] [INFO ] [MAIN ] EG: Starting full primary refresh. [2025-09-17T18:42:14.020879] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-02. [2025-09-17T18:42:14.077678] [INFO ] [REMOTE ] EG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:42:14.815777] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2024-12. [2025-09-17T18:42:15.401860] [INFO ] [REMOTE ] EFC: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-17T18:42:15.408747] [INFO ] [REMOTE ] EFC: Full fetch complete (65895 records). [2025-09-17T18:42:15.408954] [DEBUG] [VALIDATOR ] EFC: Validating primary data. [2025-09-17T18:42:15.620927] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-11. [2025-09-17T18:42:15.832604] [DEBUG] [VALIDATOR ] EFC: All expected trading days are present. [2025-09-17T18:42:15.832744] [DEBUG] [VALIDATOR ] EFC: Primary data validation passed. [2025-09-17T18:42:15.833876] [INFO ] [MAIN ] EFC: Fetched primary data is valid. [2025-09-17T18:42:15.833942] [DEBUG] [LOCAL ] EFC: Saving primary data. [2025-09-17T18:42:15.835986] [DEBUG] [LOCAL ] EFC: Trimmed 65895 records to 46247 (keeping 200 days of data) [2025-09-17T18:42:16.147983] [DEBUG] [LOCAL ] EFC: Primary data saved (46247 records). [2025-09-17T18:42:16.148195] [INFO ] [MAIN ] EFC: Full history saved. [2025-09-17T18:42:16.149387] [INFO ] [MAIN ] Update Progress: 703/2371 symbols completed. EFC took 44.6s. Estimated remaining: 4h 2m 35s. Rate: 6.9 symbols/min [2025-09-17T18:42:16.345495] [INFO ] [MAIN ] EGO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:42:16.402546] [DEBUG] [LOCAL ] EGO: Loaded 51384 existing records from primary storage. [2025-09-17T18:42:16.402733] [INFO ] [MAIN ] EGO: Loaded 51384 existing records. [2025-09-17T18:42:16.592639] [WARN ] [MAIN ] EGO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:42:16.593057] [INFO ] [MAIN ] EGO: Wiping existing primary data before full refresh. [2025-09-17T18:42:16.593103] [INFO ] [LOCAL ] EGO: Starting deletion of primary data. [2025-09-17T18:42:16.594158] [DEBUG] [LOCAL ] EGO: Deleted primary data file. [2025-09-17T18:42:16.594209] [INFO ] [MAIN ] EGO: Starting full primary refresh. [2025-09-17T18:42:16.954006] [INFO ] [REMOTE ] EGO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:42:16.954392] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-11. [2025-09-17T18:42:17.306001] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-17T18:42:17.313260] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-01. [2025-09-17T18:42:17.348897] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-02 (3.33 seconds). [2025-09-17T18:42:18.015790] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-03. [2025-09-17T18:42:18.051097] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-11 (2.43 seconds). [2025-09-17T18:42:18.769309] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T18:42:18.815786] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-02. [2025-09-17T18:42:18.976465] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T18:42:19.615797] [INFO ] [REMOTE ] EG: Fetching primary data for 2024-12. [2025-09-17T18:42:19.799993] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T18:42:20.095414] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T18:42:20.415821] [INFO ] [REMOTE ] EGO: Fetching primary data for 2024-12. [2025-09-17T18:42:21.012391] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T18:42:21.215772] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-01. [2025-09-17T18:42:22.018951] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-03. [2025-09-17T18:42:22.024741] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T18:42:22.679169] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T18:42:22.815791] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-02. [2025-09-17T18:42:23.326053] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T18:42:23.615824] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-04. [2025-09-17T18:42:23.930932] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T18:42:24.415819] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-01. [2025-09-17T18:42:25.120418] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T18:42:25.215771] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-05. [2025-09-17T18:42:26.015886] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-03. [2025-09-17T18:42:26.455140] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T18:42:26.618772] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T18:42:26.815853] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-02. [2025-09-17T18:42:27.394394] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T18:42:27.615922] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-06. [2025-09-17T18:42:28.168055] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T18:42:28.415801] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-04. [2025-09-17T18:42:28.734152] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T18:42:29.215823] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-03. [2025-09-17T18:42:29.897517] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T18:42:30.015789] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-04. [2025-09-17T18:42:30.815801] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-05. [2025-09-17T18:42:31.141916] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T18:42:31.620842] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-04. [2025-09-17T18:42:31.640408] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T18:42:32.415780] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-07. [2025-09-17T18:42:32.728272] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T18:42:33.215800] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-06. [2025-09-17T18:42:33.587800] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T18:42:33.692496] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T18:42:34.015788] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-08. [2025-09-17T18:42:34.361766] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T18:42:34.815836] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-05. [2025-09-17T18:42:35.176596] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T18:42:35.615781] [INFO ] [REMOTE ] EFXT: Fetching primary data for 2025-09. [2025-09-17T18:42:36.415770] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-05. [2025-09-17T18:42:36.519699] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T18:42:37.033731] [INFO ] [REMOTE ] EFXT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T18:42:37.038115] [INFO ] [REMOTE ] EFXT: Full fetch complete (44110 records). [2025-09-17T18:42:37.038206] [DEBUG] [VALIDATOR ] EFXT: Validating primary data. [2025-09-17T18:42:37.218155] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-07. [2025-09-17T18:42:37.430839] [DEBUG] [VALIDATOR ] EFXT: All expected trading days are present. [2025-09-17T18:42:37.430944] [DEBUG] [VALIDATOR ] EFXT: Primary data validation passed. [2025-09-17T18:42:37.431593] [INFO ] [MAIN ] EFXT: Fetched primary data is valid. [2025-09-17T18:42:37.431655] [DEBUG] [LOCAL ] EFXT: Saving primary data. [2025-09-17T18:42:37.432699] [DEBUG] [LOCAL ] EFXT: Trimmed 44110 records to 29710 (keeping 200 days of data) [2025-09-17T18:42:37.609494] [DEBUG] [LOCAL ] EFXT: Primary data saved (29710 records). [2025-09-17T18:42:37.609633] [INFO ] [MAIN ] EFXT: Full history saved. [2025-09-17T18:42:37.609737] [INFO ] [MAIN ] Update Progress: 704/2371 symbols completed. EFXT took 26.0s. Estimated remaining: 4h 2m 56s. Rate: 6.9 symbols/min [2025-09-17T18:42:37.779163] [INFO ] [MAIN ] EGP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:42:37.779382] [DEBUG] [LOCAL ] EGP: No existing data file found in primary storage. [2025-09-17T18:42:37.779552] [WARN ] [MAIN ] EGP: No existing data found, performing full refresh instead. [2025-09-17T18:42:37.779798] [INFO ] [MAIN ] EGP: Wiping existing primary data before full refresh. [2025-09-17T18:42:37.779876] [INFO ] [LOCAL ] EGP: Starting deletion of primary data. [2025-09-17T18:42:37.779940] [DEBUG] [LOCAL ] EGP: No primary data file found to delete. [2025-09-17T18:42:37.779982] [INFO ] [MAIN ] EGP: Starting full primary refresh. [2025-09-17T18:42:38.018177] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-06. [2025-09-17T18:42:38.181178] [INFO ] [REMOTE ] EGP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:42:38.183296] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T18:42:38.626331] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T18:42:38.815774] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-11. [2025-09-17T18:42:39.389846] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T18:42:39.615810] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-08. [2025-09-17T18:42:40.197939] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T18:42:40.415809] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-06. [2025-09-17T18:42:40.637615] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T18:42:41.215829] [INFO ] [REMOTE ] EGP: Fetching primary data for 2024-12. [2025-09-17T18:42:41.887665] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T18:42:42.015778] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-07. [2025-09-17T18:42:42.461309] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T18:42:42.815808] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-01. [2025-09-17T18:42:43.615808] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-07. [2025-09-17T18:42:43.693409] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T18:42:44.140596] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T18:42:44.415836] [INFO ] [REMOTE ] EG: Fetching primary data for 2025-09. [2025-09-17T18:42:45.215774] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-02. [2025-09-17T18:42:45.418297] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T18:42:45.662153] [INFO ] [REMOTE ] EG: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T18:42:45.666023] [INFO ] [REMOTE ] EG: Full fetch complete (44002 records). [2025-09-17T18:42:45.666148] [DEBUG] [VALIDATOR ] EG: Validating primary data. [2025-09-17T18:42:46.027826] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-08. [2025-09-17T18:42:46.048080] [DEBUG] [VALIDATOR ] EG: All expected trading days are present. [2025-09-17T18:42:46.048222] [DEBUG] [VALIDATOR ] EG: Primary data validation passed. [2025-09-17T18:42:46.048958] [INFO ] [MAIN ] EG: Fetched primary data is valid. [2025-09-17T18:42:46.049006] [DEBUG] [LOCAL ] EG: Saving primary data. [2025-09-17T18:42:46.050173] [DEBUG] [LOCAL ] EG: Trimmed 44002 records to 29074 (keeping 200 days of data) [2025-09-17T18:42:46.246461] [DEBUG] [LOCAL ] EG: Primary data saved (29074 records). [2025-09-17T18:42:46.246613] [INFO ] [MAIN ] EG: Full history saved. [2025-09-17T18:42:46.246737] [INFO ] [MAIN ] Update Progress: 705/2371 symbols completed. EG took 32.9s. Estimated remaining: 4h 2m 47s. Rate: 6.9 symbols/min [2025-09-17T18:42:46.418964] [INFO ] [MAIN ] EGY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:42:46.459917] [DEBUG] [LOCAL ] EGY: Loaded 42423 existing records from primary storage. [2025-09-17T18:42:46.460061] [INFO ] [MAIN ] EGY: Loaded 42423 existing records. [2025-09-17T18:42:46.642123] [WARN ] [MAIN ] EGY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:42:46.642469] [INFO ] [MAIN ] EGY: Wiping existing primary data before full refresh. [2025-09-17T18:42:46.642532] [INFO ] [LOCAL ] EGY: Starting deletion of primary data. [2025-09-17T18:42:46.643483] [DEBUG] [LOCAL ] EGY: Deleted primary data file. [2025-09-17T18:42:46.643540] [INFO ] [MAIN ] EGY: Starting full primary refresh. [2025-09-17T18:42:46.790051] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T18:42:46.827527] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-08. [2025-09-17T18:42:47.040075] [INFO ] [REMOTE ] EGY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:42:47.615818] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-11. [2025-09-17T18:42:47.773926] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T18:42:48.415785] [INFO ] [REMOTE ] EFX: Fetching primary data for 2025-09. [2025-09-17T18:42:48.676461] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T18:42:49.215822] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-03. [2025-09-17T18:42:49.334461] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T18:42:50.015800] [INFO ] [REMOTE ] EGY: Fetching primary data for 2024-12. [2025-09-17T18:42:50.163896] [INFO ] [REMOTE ] EFX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T18:42:50.173257] [INFO ] [REMOTE ] EFX: Full fetch complete (64234 records). [2025-09-17T18:42:50.173393] [DEBUG] [VALIDATOR ] EFX: Validating primary data. [2025-09-17T18:42:50.579379] [DEBUG] [VALIDATOR ] EFX: All expected trading days are present. [2025-09-17T18:42:50.579539] [DEBUG] [VALIDATOR ] EFX: Primary data validation passed. [2025-09-17T18:42:50.580454] [INFO ] [MAIN ] EFX: Fetched primary data is valid. [2025-09-17T18:42:50.580513] [DEBUG] [LOCAL ] EFX: Saving primary data. [2025-09-17T18:42:50.602500] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T18:42:50.602628] [DEBUG] [LOCAL ] EFX: Trimmed 64234 records to 45022 (keeping 200 days of data) [2025-09-17T18:42:50.834739] [INFO ] [REMOTE ] EGO: Fetching primary data for 2025-09. [2025-09-17T18:42:50.902490] [DEBUG] [LOCAL ] EFX: Primary data saved (45022 records). [2025-09-17T18:42:50.902625] [INFO ] [MAIN ] EFX: Full history saved. [2025-09-17T18:42:50.902718] [INFO ] [MAIN ] Update Progress: 706/2371 symbols completed. EFX took 56.9s. Estimated remaining: 4h 2m 29s. Rate: 6.9 symbols/min [2025-09-17T18:42:51.075310] [INFO ] [MAIN ] EHAB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:42:51.102922] [DEBUG] [LOCAL ] EHAB: Loaded 30206 existing records from primary storage. [2025-09-17T18:42:51.103083] [INFO ] [MAIN ] EHAB: Loaded 30206 existing records. [2025-09-17T18:42:51.281136] [WARN ] [MAIN ] EHAB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:42:51.281407] [INFO ] [MAIN ] EHAB: Wiping existing primary data before full refresh. [2025-09-17T18:42:51.281455] [INFO ] [LOCAL ] EHAB: Starting deletion of primary data. [2025-09-17T18:42:51.282036] [DEBUG] [LOCAL ] EHAB: Deleted primary data file. [2025-09-17T18:42:51.282091] [INFO ] [MAIN ] EHAB: Starting full primary refresh. [2025-09-17T18:42:51.617761] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-04. [2025-09-17T18:42:51.643425] [INFO ] [REMOTE ] EHAB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:42:51.743870] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T18:42:52.415789] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-01. [2025-09-17T18:42:52.738331] [INFO ] [REMOTE ] EGO: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T18:42:52.745496] [INFO ] [REMOTE ] EGO: Full fetch complete (73029 records). [2025-09-17T18:42:52.745631] [DEBUG] [VALIDATOR ] EGO: Validating primary data. [2025-09-17T18:42:53.151504] [DEBUG] [VALIDATOR ] EGO: All expected trading days are present. [2025-09-17T18:42:53.151669] [DEBUG] [VALIDATOR ] EGO: Primary data validation passed. [2025-09-17T18:42:53.152686] [INFO ] [MAIN ] EGO: Fetched primary data is valid. [2025-09-17T18:42:53.152763] [DEBUG] [LOCAL ] EGO: Saving primary data. [2025-09-17T18:42:53.154577] [DEBUG] [LOCAL ] EGO: Trimmed 73029 records to 51404 (keeping 200 days of data) [2025-09-17T18:42:53.219097] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-11. [2025-09-17T18:42:53.279981] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T18:42:53.499328] [DEBUG] [LOCAL ] EGO: Primary data saved (51404 records). [2025-09-17T18:42:53.499479] [INFO ] [MAIN ] EGO: Full history saved. [2025-09-17T18:42:53.500357] [INFO ] [MAIN ] Update Progress: 707/2371 symbols completed. EGO took 37.4s. Estimated remaining: 4h 2m 6s. Rate: 6.9 symbols/min [2025-09-17T18:42:53.671063] [INFO ] [MAIN ] EHC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:42:53.715967] [DEBUG] [LOCAL ] EHC: Loaded 41727 existing records from primary storage. [2025-09-17T18:42:53.716167] [INFO ] [MAIN ] EHC: Loaded 41727 existing records. [2025-09-17T18:42:53.905460] [WARN ] [MAIN ] EHC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:42:53.905891] [INFO ] [MAIN ] EHC: Wiping existing primary data before full refresh. [2025-09-17T18:42:53.906007] [INFO ] [LOCAL ] EHC: Starting deletion of primary data. [2025-09-17T18:42:53.906961] [DEBUG] [LOCAL ] EHC: Deleted primary data file. [2025-09-17T18:42:53.907023] [INFO ] [MAIN ] EHC: Starting full primary refresh. [2025-09-17T18:42:54.016382] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-05. [2025-09-17T18:42:54.151575] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T18:42:54.328009] [INFO ] [REMOTE ] EHC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:42:54.348047] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T18:42:54.815826] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2024-12. [2025-09-17T18:42:55.421972] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T18:42:55.615813] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-02. [2025-09-17T18:42:56.015831] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T18:42:56.415857] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-06. [2025-09-17T18:42:57.045564] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T18:42:57.215682] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-01. [2025-09-17T18:42:57.623455] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T18:42:58.015767] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-11. [2025-09-17T18:42:58.365700] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T18:42:58.815790] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-02. [2025-09-17T18:42:59.615829] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-07. [2025-09-17T18:42:59.679419] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T18:42:59.824727] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T18:43:00.415807] [INFO ] [REMOTE ] EHC: Fetching primary data for 2024-12. [2025-09-17T18:43:01.151960] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T18:43:01.215767] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-08. [2025-09-17T18:43:02.003558] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T18:43:02.015725] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-01. [2025-09-17T18:43:02.303554] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T18:43:02.815802] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-03. [2025-09-17T18:43:02.983346] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T18:43:03.615775] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-02. [2025-09-17T18:43:04.415845] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-03. [2025-09-17T18:43:04.541150] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T18:43:05.109932] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T18:43:05.215766] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-03. [2025-09-17T18:43:05.531743] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T18:43:06.015784] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-04. [2025-09-17T18:43:06.800348] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T18:43:06.815676] [INFO ] [REMOTE ] EGP: Fetching primary data for 2025-09. [2025-09-17T18:43:07.344777] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T18:43:07.615793] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-05. [2025-09-17T18:43:08.296449] [INFO ] [REMOTE ] EGP: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T18:43:08.300924] [INFO ] [REMOTE ] EGP: Full fetch complete (45077 records). [2025-09-17T18:43:08.301027] [DEBUG] [VALIDATOR ] EGP: Validating primary data. [2025-09-17T18:43:08.420849] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-04. [2025-09-17T18:43:08.697720] [DEBUG] [VALIDATOR ] EGP: All expected trading days are present. [2025-09-17T18:43:08.697831] [DEBUG] [VALIDATOR ] EGP: Primary data validation passed. [2025-09-17T18:43:08.698774] [INFO ] [MAIN ] EGP: Fetched primary data is valid. [2025-09-17T18:43:08.698843] [DEBUG] [LOCAL ] EGP: Saving primary data. [2025-09-17T18:43:08.700262] [DEBUG] [LOCAL ] EGP: Trimmed 45077 records to 31484 (keeping 200 days of data) [2025-09-17T18:43:08.857591] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T18:43:08.945127] [DEBUG] [LOCAL ] EGP: Primary data saved (31484 records). [2025-09-17T18:43:08.945267] [INFO ] [MAIN ] EGP: Full history saved. [2025-09-17T18:43:08.945343] [INFO ] [MAIN ] Update Progress: 708/2371 symbols completed. EGP took 31.3s. Estimated remaining: 4h 2m 13s. Rate: 6.9 symbols/min [2025-09-17T18:43:09.114956] [INFO ] [MAIN ] EHI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:43:09.125524] [DEBUG] [LOCAL ] EHI: Loaded 10156 existing records from primary storage. [2025-09-17T18:43:09.125621] [INFO ] [MAIN ] EHI: Loaded 10156 existing records. [2025-09-17T18:43:09.223213] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-06. [2025-09-17T18:43:09.304978] [WARN ] [MAIN ] EHI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:43:09.305247] [INFO ] [MAIN ] EHI: Wiping existing primary data before full refresh. [2025-09-17T18:43:09.305292] [INFO ] [LOCAL ] EHI: Starting deletion of primary data. [2025-09-17T18:43:09.305706] [DEBUG] [LOCAL ] EHI: Deleted primary data file. [2025-09-17T18:43:09.305761] [INFO ] [MAIN ] EHI: Starting full primary refresh. [2025-09-17T18:43:09.664753] [INFO ] [REMOTE ] EHI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:43:10.015788] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-11. [2025-09-17T18:43:10.224528] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T18:43:10.513009] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T18:43:10.815805] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-07. [2025-09-17T18:43:10.991820] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T18:43:11.615807] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-04. [2025-09-17T18:43:12.046820] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T18:43:12.415782] [INFO ] [REMOTE ] EHI: Fetching primary data for 2024-12. [2025-09-17T18:43:13.215833] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-05. [2025-09-17T18:43:13.595296] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T18:43:13.654840] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T18:43:14.015778] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-05. [2025-09-17T18:43:14.815775] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-08. [2025-09-17T18:43:15.090137] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T18:43:15.616411] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-06. [2025-09-17T18:43:15.616345] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T18:43:15.868299] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T18:43:16.415786] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-01. [2025-09-17T18:43:17.166378] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T18:43:17.215716] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-07. [2025-09-17T18:43:17.374931] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T18:43:18.015776] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-02. [2025-09-17T18:43:18.695746] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T18:43:18.765103] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T18:43:18.815835] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-03. [2025-09-17T18:43:19.615831] [INFO ] [REMOTE ] EHAB: Fetching primary data for 2025-09. [2025-09-17T18:43:19.666700] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T18:43:20.415808] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-06. [2025-09-17T18:43:20.851029] [INFO ] [REMOTE ] EHAB: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T18:43:20.854624] [INFO ] [REMOTE ] EHAB: Full fetch complete (41705 records). [2025-09-17T18:43:20.854767] [DEBUG] [VALIDATOR ] EHAB: Validating primary data. [2025-09-17T18:43:21.221875] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-04. [2025-09-17T18:43:21.239907] [DEBUG] [VALIDATOR ] EHAB: All expected trading days are present. [2025-09-17T18:43:21.239995] [DEBUG] [VALIDATOR ] EHAB: Primary data validation passed. [2025-09-17T18:43:21.240707] [INFO ] [MAIN ] EHAB: Fetched primary data is valid. [2025-09-17T18:43:21.240789] [DEBUG] [LOCAL ] EHAB: Saving primary data. [2025-09-17T18:43:21.241828] [DEBUG] [LOCAL ] EHAB: Trimmed 41705 records to 30202 (keeping 200 days of data) [2025-09-17T18:43:21.422278] [DEBUG] [LOCAL ] EHAB: Primary data saved (30202 records). [2025-09-17T18:43:21.422432] [INFO ] [MAIN ] EHAB: Full history saved. [2025-09-17T18:43:21.422544] [INFO ] [MAIN ] Update Progress: 709/2371 symbols completed. EHAB took 30.5s. Estimated remaining: 4h 2m 13s. Rate: 6.9 symbols/min [2025-09-17T18:43:21.610617] [INFO ] [MAIN ] EIC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:43:21.638442] [DEBUG] [LOCAL ] EIC: Loaded 24807 existing records from primary storage. [2025-09-17T18:43:21.638616] [INFO ] [MAIN ] EIC: Loaded 24807 existing records. [2025-09-17T18:43:21.832136] [WARN ] [MAIN ] EIC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:43:21.832674] [INFO ] [MAIN ] EIC: Wiping existing primary data before full refresh. [2025-09-17T18:43:21.832753] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-17T18:43:21.833484] [DEBUG] [LOCAL ] EIC: Deleted primary data file. [2025-09-17T18:43:21.833548] [INFO ] [MAIN ] EIC: Starting full primary refresh. [2025-09-17T18:43:21.948252] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T18:43:22.036693] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-08. [2025-09-17T18:43:22.125372] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T18:43:22.249433] [INFO ] [REMOTE ] EIC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:43:22.815790] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-07. [2025-09-17T18:43:23.615822] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-11. [2025-09-17T18:43:23.849364] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T18:43:24.271557] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T18:43:24.415768] [INFO ] [REMOTE ] EGY: Fetching primary data for 2025-09. [2025-09-17T18:43:24.731160] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T18:43:25.215782] [INFO ] [REMOTE ] EIC: Fetching primary data for 2024-12. [2025-09-17T18:43:26.015780] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-08. [2025-09-17T18:43:26.220346] [INFO ] [REMOTE ] EGY: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T18:43:26.225594] [INFO ] [REMOTE ] EGY: Full fetch complete (61723 records). [2025-09-17T18:43:26.225734] [DEBUG] [VALIDATOR ] EGY: Validating primary data. [2025-09-17T18:43:26.656217] [DEBUG] [VALIDATOR ] EGY: All expected trading days are present. [2025-09-17T18:43:26.656328] [DEBUG] [VALIDATOR ] EGY: Primary data validation passed. [2025-09-17T18:43:26.657128] [INFO ] [MAIN ] EGY: Fetched primary data is valid. [2025-09-17T18:43:26.657183] [DEBUG] [LOCAL ] EGY: Saving primary data. [2025-09-17T18:43:26.672596] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T18:43:26.678055] [DEBUG] [LOCAL ] EGY: Trimmed 61723 records to 42412 (keeping 200 days of data) [2025-09-17T18:43:26.857004] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-01. [2025-09-17T18:43:26.939074] [DEBUG] [LOCAL ] EGY: Primary data saved (42412 records). [2025-09-17T18:43:26.939199] [INFO ] [MAIN ] EGY: Full history saved. [2025-09-17T18:43:26.939289] [INFO ] [MAIN ] Update Progress: 710/2371 symbols completed. EGY took 40.7s. Estimated remaining: 4h 1m 56s. Rate: 6.9 symbols/min [2025-09-17T18:43:27.107961] [INFO ] [MAIN ] EICA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:43:27.108098] [DEBUG] [LOCAL ] EICA: No existing data file found in primary storage. [2025-09-17T18:43:27.108133] [WARN ] [MAIN ] EICA: No existing data found, performing full refresh instead. [2025-09-17T18:43:27.108245] [INFO ] [MAIN ] EICA: Wiping existing primary data before full refresh. [2025-09-17T18:43:27.108283] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-17T18:43:27.108323] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-17T18:43:27.108354] [INFO ] [MAIN ] EICA: Starting full primary refresh. [2025-09-17T18:43:27.484012] [INFO ] [REMOTE ] EICA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:43:27.509793] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T18:43:27.615755] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-11. [2025-09-17T18:43:27.698056] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T18:43:28.087411] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T18:43:28.415816] [INFO ] [REMOTE ] EICA: Fetching primary data for 2024-12. [2025-09-17T18:43:28.660188] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2024-12 (0.24 seconds). [2025-09-17T18:43:29.215789] [INFO ] [REMOTE ] EHC: Fetching primary data for 2025-09. [2025-09-17T18:43:30.015790] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-05. [2025-09-17T18:43:30.446422] [INFO ] [REMOTE ] EHC: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T18:43:30.453271] [INFO ] [REMOTE ] EHC: Full fetch complete (58850 records). [2025-09-17T18:43:30.453416] [DEBUG] [VALIDATOR ] EHC: Validating primary data. [2025-09-17T18:43:30.818895] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-02. [2025-09-17T18:43:30.837600] [DEBUG] [VALIDATOR ] EHC: All expected trading days are present. [2025-09-17T18:43:30.837679] [DEBUG] [VALIDATOR ] EHC: Primary data validation passed. [2025-09-17T18:43:30.838403] [INFO ] [MAIN ] EHC: Fetched primary data is valid. [2025-09-17T18:43:30.838522] [DEBUG] [LOCAL ] EHC: Saving primary data. [2025-09-17T18:43:30.840219] [DEBUG] [LOCAL ] EHC: Trimmed 58850 records to 41624 (keeping 200 days of data) [2025-09-17T18:43:30.953629] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T18:43:31.122953] [DEBUG] [LOCAL ] EHC: Primary data saved (41624 records). [2025-09-17T18:43:31.123088] [INFO ] [MAIN ] EHC: Full history saved. [2025-09-17T18:43:31.124416] [INFO ] [MAIN ] Update Progress: 711/2371 symbols completed. EHC took 37.6s. Estimated remaining: 4h 1m 37s. Rate: 6.9 symbols/min [2025-09-17T18:43:31.292692] [INFO ] [MAIN ] EICB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:43:31.292856] [DEBUG] [LOCAL ] EICB: No existing data file found in primary storage. [2025-09-17T18:43:31.292893] [WARN ] [MAIN ] EICB: No existing data found, performing full refresh instead. [2025-09-17T18:43:31.293013] [INFO ] [MAIN ] EICB: Wiping existing primary data before full refresh. [2025-09-17T18:43:31.293068] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-17T18:43:31.293110] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-17T18:43:31.293153] [INFO ] [MAIN ] EICB: Starting full primary refresh. [2025-09-17T18:43:31.623242] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-01. [2025-09-17T18:43:31.652411] [INFO ] [REMOTE ] EICB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:43:32.018973] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T18:43:32.104968] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T18:43:32.415793] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-06. [2025-09-17T18:43:33.215770] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-02. [2025-09-17T18:43:33.384876] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T18:43:33.574839] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-17T18:43:34.015776] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-03. [2025-09-17T18:43:34.351267] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-17T18:43:34.815783] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-03. [2025-09-17T18:43:35.615788] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-04. [2025-09-17T18:43:35.960986] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T18:43:35.969008] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-17T18:43:36.415791] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-04. [2025-09-17T18:43:37.215744] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-05. [2025-09-17T18:43:37.612136] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T18:43:37.760691] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T18:43:38.015764] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-05. [2025-09-17T18:43:38.815857] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-07. [2025-09-17T18:43:39.435278] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T18:43:39.615854] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-11. [2025-09-17T18:43:39.642403] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T18:43:40.164403] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T18:43:40.415853] [INFO ] [REMOTE ] EICB: Fetching primary data for 2024-12. [2025-09-17T18:43:40.930697] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T18:43:41.215799] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-06. [2025-09-17T18:43:41.664170] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T18:43:42.015832] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-07. [2025-09-17T18:43:42.374712] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-17T18:43:42.815776] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-08. [2025-09-17T18:43:43.159453] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-17T18:43:43.615791] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-06. [2025-09-17T18:43:44.415804] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-01. [2025-09-17T18:43:44.839888] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T18:43:44.884599] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T18:43:45.215801] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-07. [2025-09-17T18:43:46.015818] [INFO ] [REMOTE ] EICA: Fetching primary data for 2025-09. [2025-09-17T18:43:46.560944] [INFO ] [REMOTE ] EICA: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T18:43:46.561845] [INFO ] [REMOTE ] EICA: Full fetch complete (1290 records). [2025-09-17T18:43:46.561932] [DEBUG] [VALIDATOR ] EICA: Validating primary data. [2025-09-17T18:43:46.766251] [WARN ] [VALIDATOR ] EICA: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-17T18:43:46.768082] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T18:43:46.768172] [FATAL] [MAIN ] EICA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:43:46.773921] [WARN ] [MAIN ] EICA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:43:46.774245] [INFO ] [LOCAL ] EICA: Starting deletion of primary data. [2025-09-17T18:43:46.774329] [DEBUG] [LOCAL ] EICA: No primary data file found to delete. [2025-09-17T18:43:46.774383] [INFO ] [LOCAL ] EICA: Starting deletion of derivative data. [2025-09-17T18:43:46.774721] [DEBUG] [LOCAL ] EICA: No derivative data file found to delete. [2025-09-17T18:43:46.774793] [INFO ] [MAIN ] Update Progress: 712/2371 symbols completed. EICA took 19.8s. Estimated remaining: 4h 1m 44s. Rate: 6.9 symbols/min [2025-09-17T18:43:46.820901] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-02. [2025-09-17T18:43:46.947272] [INFO ] [MAIN ] EICC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:43:46.956476] [DEBUG] [LOCAL ] EICC: Loaded 5979 existing records from primary storage. [2025-09-17T18:43:46.956599] [INFO ] [MAIN ] EICC: Loaded 5979 existing records. [2025-09-17T18:43:47.132996] [WARN ] [MAIN ] EICC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:43:47.133207] [INFO ] [MAIN ] EICC: Wiping existing primary data before full refresh. [2025-09-17T18:43:47.133249] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-17T18:43:47.133595] [DEBUG] [LOCAL ] EICC: Deleted primary data file. [2025-09-17T18:43:47.133638] [INFO ] [MAIN ] EICC: Starting full primary refresh. [2025-09-17T18:43:47.491588] [INFO ] [REMOTE ] EICC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:43:47.505600] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T18:43:47.615780] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-08. [2025-09-17T18:43:48.415824] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-11. [2025-09-17T18:43:48.897413] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T18:43:49.026667] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T18:43:49.215796] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-08. [2025-09-17T18:43:50.015758] [INFO ] [REMOTE ] EIC: Fetching primary data for 2025-09. [2025-09-17T18:43:50.246991] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T18:43:50.815785] [INFO ] [REMOTE ] EHI: Fetching primary data for 2025-09. [2025-09-17T18:43:51.071462] [INFO ] [REMOTE ] EIC: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T18:43:51.074363] [INFO ] [REMOTE ] EIC: Full fetch complete (35683 records). [2025-09-17T18:43:51.074471] [DEBUG] [VALIDATOR ] EIC: Validating primary data. [2025-09-17T18:43:51.075026] [FATAL] [VALIDATOR ] EIC: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:43:51.075123] [FATAL] [MAIN ] EIC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:43:51.075161] [WARN ] [MAIN ] EIC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:43:51.075200] [INFO ] [LOCAL ] EIC: Starting deletion of primary data. [2025-09-17T18:43:51.075257] [DEBUG] [LOCAL ] EIC: No primary data file found to delete. [2025-09-17T18:43:51.075293] [INFO ] [LOCAL ] EIC: Starting deletion of derivative data. [2025-09-17T18:43:51.075716] [DEBUG] [LOCAL ] EIC: Deleted derivative data file. [2025-09-17T18:43:51.075807] [INFO ] [MAIN ] Update Progress: 713/2371 symbols completed. EIC took 29.7s. Estimated remaining: 4h 1m 25s. Rate: 6.9 symbols/min [2025-09-17T18:43:51.259342] [INFO ] [MAIN ] EIG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:43:51.281928] [DEBUG] [LOCAL ] EIG: Loaded 20226 existing records from primary storage. [2025-09-17T18:43:51.282057] [INFO ] [MAIN ] EIG: Loaded 20226 existing records. [2025-09-17T18:43:51.467512] [WARN ] [MAIN ] EIG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:43:51.467832] [INFO ] [MAIN ] EIG: Wiping existing primary data before full refresh. [2025-09-17T18:43:51.467883] [INFO ] [LOCAL ] EIG: Starting deletion of primary data. [2025-09-17T18:43:51.468687] [DEBUG] [LOCAL ] EIG: Deleted primary data file. [2025-09-17T18:43:51.468742] [INFO ] [MAIN ] EIG: Starting full primary refresh. [2025-09-17T18:43:51.578488] [INFO ] [REMOTE ] EHI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T18:43:51.631727] [INFO ] [REMOTE ] EHI: Full fetch complete (16432 records). [2025-09-17T18:43:51.634672] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-03. [2025-09-17T18:43:51.635016] [DEBUG] [VALIDATOR ] EHI: Validating primary data. [2025-09-17T18:43:52.023528] [INFO ] [REMOTE ] EIG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:43:52.234227] [DEBUG] [VALIDATOR ] EHI: All expected trading days are present. [2025-09-17T18:43:52.234376] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T18:43:52.235744] [DEBUG] [VALIDATOR ] EHI: Primary data validation passed. [2025-09-17T18:43:52.236224] [INFO ] [MAIN ] EHI: Fetched primary data is valid. [2025-09-17T18:43:52.236269] [DEBUG] [LOCAL ] EHI: Saving primary data. [2025-09-17T18:43:52.237195] [DEBUG] [LOCAL ] EHI: Trimmed 16432 records to 10163 (keeping 200 days of data) [2025-09-17T18:43:52.300072] [DEBUG] [LOCAL ] EHI: Primary data saved (10163 records). [2025-09-17T18:43:52.300250] [INFO ] [MAIN ] EHI: Full history saved. [2025-09-17T18:43:52.300349] [INFO ] [MAIN ] Update Progress: 714/2371 symbols completed. EHI took 43.4s. Estimated remaining: 4h 0m 59s. Rate: 6.9 symbols/min [2025-09-17T18:43:52.420956] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-04. [2025-09-17T18:43:52.472177] [INFO ] [MAIN ] EIX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:43:52.536041] [DEBUG] [LOCAL ] EIX: Loaded 53361 existing records from primary storage. [2025-09-17T18:43:52.536220] [INFO ] [MAIN ] EIX: Loaded 53361 existing records. [2025-09-17T18:43:52.712154] [WARN ] [MAIN ] EIX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:43:52.712369] [INFO ] [MAIN ] EIX: Wiping existing primary data before full refresh. [2025-09-17T18:43:52.712419] [INFO ] [LOCAL ] EIX: Starting deletion of primary data. [2025-09-17T18:43:52.713414] [DEBUG] [LOCAL ] EIX: Deleted primary data file. [2025-09-17T18:43:52.713462] [INFO ] [MAIN ] EIX: Starting full primary refresh. [2025-09-17T18:43:52.991557] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T18:43:53.076923] [INFO ] [REMOTE ] EIX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:43:53.215735] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-11. [2025-09-17T18:43:54.015781] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-11. [2025-09-17T18:43:54.815807] [INFO ] [REMOTE ] EICC: Fetching primary data for 2024-12. [2025-09-17T18:43:54.922083] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T18:43:54.965145] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T18:43:55.375228] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T18:43:55.615785] [INFO ] [REMOTE ] EIG: Fetching primary data for 2024-12. [2025-09-17T18:43:56.415800] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-01. [2025-09-17T18:43:56.626903] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T18:43:56.955524] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T18:43:57.215789] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-02. [2025-09-17T18:43:57.792167] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T18:43:58.015803] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-03. [2025-09-17T18:43:58.676508] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T18:43:58.815814] [INFO ] [REMOTE ] EIX: Fetching primary data for 2024-12. [2025-09-17T18:43:59.615798] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-01. [2025-09-17T18:44:00.415774] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-04. [2025-09-17T18:44:00.681897] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T18:44:00.738430] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T18:44:00.870212] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T18:44:01.215823] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-05. [2025-09-17T18:44:01.718381] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T18:44:02.015779] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-06. [2025-09-17T18:44:02.600101] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T18:44:02.815812] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-07. [2025-09-17T18:44:03.502249] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T18:44:03.615765] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-08. [2025-09-17T18:44:04.323950] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T18:44:04.415767] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-05. [2025-09-17T18:44:04.966768] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T18:44:05.215777] [INFO ] [REMOTE ] EICC: Fetching primary data for 2025-09. [2025-09-17T18:44:05.902766] [INFO ] [REMOTE ] EICC: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T18:44:05.904131] [INFO ] [REMOTE ] EICC: Full fetch complete (7695 records). [2025-09-17T18:44:05.904198] [DEBUG] [VALIDATOR ] EICC: Validating primary data. [2025-09-17T18:44:05.904666] [FATAL] [VALIDATOR ] EICC: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:44:05.904749] [FATAL] [MAIN ] EICC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:44:05.904785] [WARN ] [MAIN ] EICC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:44:05.904830] [INFO ] [LOCAL ] EICC: Starting deletion of primary data. [2025-09-17T18:44:05.904886] [DEBUG] [LOCAL ] EICC: No primary data file found to delete. [2025-09-17T18:44:05.904921] [INFO ] [LOCAL ] EICC: Starting deletion of derivative data. [2025-09-17T18:44:05.905315] [DEBUG] [LOCAL ] EICC: Deleted derivative data file. [2025-09-17T18:44:05.905413] [INFO ] [MAIN ] Update Progress: 715/2371 symbols completed. EICC took 19.1s. Estimated remaining: 4h 1m 2s. Rate: 6.9 symbols/min [2025-09-17T18:44:06.016624] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-01. [2025-09-17T18:44:06.088382] [INFO ] [MAIN ] EL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:44:06.138775] [DEBUG] [LOCAL ] EL: Loaded 53472 existing records from primary storage. [2025-09-17T18:44:06.138928] [INFO ] [MAIN ] EL: Loaded 53472 existing records. [2025-09-17T18:44:06.316535] [WARN ] [MAIN ] EL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:44:06.316818] [INFO ] [MAIN ] EL: Wiping existing primary data before full refresh. [2025-09-17T18:44:06.316866] [INFO ] [LOCAL ] EL: Starting deletion of primary data. [2025-09-17T18:44:06.317876] [DEBUG] [LOCAL ] EL: Deleted primary data file. [2025-09-17T18:44:06.317930] [INFO ] [MAIN ] EL: Starting full primary refresh. [2025-09-17T18:44:06.679267] [INFO ] [REMOTE ] EL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:44:06.815765] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-11. [2025-09-17T18:44:07.615782] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-02. [2025-09-17T18:44:07.967714] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T18:44:08.415054] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T18:44:08.418344] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-06. [2025-09-17T18:44:08.836850] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T18:44:09.090514] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-11 (2.27 seconds). [2025-09-17T18:44:09.215782] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-02. [2025-09-17T18:44:10.015780] [INFO ] [REMOTE ] EL: Fetching primary data for 2024-12. [2025-09-17T18:44:10.815775] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-07. [2025-09-17T18:44:11.241986] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-17T18:44:11.262166] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T18:44:11.615782] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-08. [2025-09-17T18:44:12.077814] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-17T18:44:12.124419] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T18:44:12.415784] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-01. [2025-09-17T18:44:13.215791] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-03. [2025-09-17T18:44:14.015799] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-03. [2025-09-17T18:44:14.294071] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T18:44:14.815762] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-02. [2025-09-17T18:44:15.049488] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T18:44:15.135397] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T18:44:15.615781] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-04. [2025-09-17T18:44:16.415788] [INFO ] [REMOTE ] EICB: Fetching primary data for 2025-09. [2025-09-17T18:44:16.689883] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T18:44:16.878513] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-17T18:44:16.982403] [INFO ] [REMOTE ] EICB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T18:44:16.983292] [INFO ] [REMOTE ] EICB: Full fetch complete (2658 records). [2025-09-17T18:44:16.983359] [DEBUG] [VALIDATOR ] EICB: Validating primary data. [2025-09-17T18:44:17.161990] [WARN ] [VALIDATOR ] EICB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T18:44:17.162198] [FATAL] [MAIN ] EICB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:44:17.162247] [WARN ] [MAIN ] EICB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:44:17.162289] [INFO ] [LOCAL ] EICB: Starting deletion of primary data. [2025-09-17T18:44:17.162349] [DEBUG] [LOCAL ] EICB: No primary data file found to delete. [2025-09-17T18:44:17.162385] [INFO ] [LOCAL ] EICB: Starting deletion of derivative data. [2025-09-17T18:44:17.162422] [DEBUG] [LOCAL ] EICB: No derivative data file found to delete. [2025-09-17T18:44:17.162494] [INFO ] [MAIN ] Update Progress: 716/2371 symbols completed. EICB took 46.0s. Estimated remaining: 4h 0m 59s. Rate: 6.9 symbols/min [2025-09-17T18:44:17.224016] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-05. [2025-09-17T18:44:17.340736] [INFO ] [MAIN ] ELAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:44:17.399033] [DEBUG] [LOCAL ] ELAN: Loaded 53179 existing records from primary storage. [2025-09-17T18:44:17.399184] [INFO ] [MAIN ] ELAN: Loaded 53179 existing records. [2025-09-17T18:44:17.576294] [WARN ] [MAIN ] ELAN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:44:17.576513] [INFO ] [MAIN ] ELAN: Wiping existing primary data before full refresh. [2025-09-17T18:44:17.576556] [INFO ] [LOCAL ] ELAN: Starting deletion of primary data. [2025-09-17T18:44:17.577585] [DEBUG] [LOCAL ] ELAN: Deleted primary data file. [2025-09-17T18:44:17.577632] [INFO ] [MAIN ] ELAN: Starting full primary refresh. [2025-09-17T18:44:17.931164] [INFO ] [REMOTE ] ELAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:44:18.015761] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-04. [2025-09-17T18:44:18.350958] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T18:44:18.815763] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-06. [2025-09-17T18:44:19.615788] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-03. [2025-09-17T18:44:20.102752] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T18:44:20.290249] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T18:44:20.415786] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-07. [2025-09-17T18:44:21.215785] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-05. [2025-09-17T18:44:21.702040] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T18:44:22.015790] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-08. [2025-09-17T18:44:22.614532] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-03 (3.00 seconds). [2025-09-17T18:44:22.815834] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-11. [2025-09-17T18:44:23.615813] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-04. [2025-09-17T18:44:23.994469] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-17T18:44:24.264263] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-17T18:44:24.415761] [INFO ] [REMOTE ] EIG: Fetching primary data for 2025-09. [2025-09-17T18:44:24.480518] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T18:44:25.215717] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-06. [2025-09-17T18:44:25.292426] [INFO ] [REMOTE ] EIG: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T18:44:25.295526] [INFO ] [REMOTE ] EIG: Full fetch complete (26689 records). [2025-09-17T18:44:25.295602] [DEBUG] [VALIDATOR ] EIG: Validating primary data. [2025-09-17T18:44:25.675392] [DEBUG] [VALIDATOR ] EIG: All expected trading days are present. [2025-09-17T18:44:25.675502] [DEBUG] [VALIDATOR ] EIG: Primary data validation passed. [2025-09-17T18:44:25.676008] [INFO ] [MAIN ] EIG: Fetched primary data is valid. [2025-09-17T18:44:25.676099] [DEBUG] [LOCAL ] EIG: Saving primary data. [2025-09-17T18:44:25.677092] [DEBUG] [LOCAL ] EIG: Trimmed 26689 records to 20254 (keeping 200 days of data) [2025-09-17T18:44:25.810739] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-17T18:44:25.851620] [DEBUG] [LOCAL ] EIG: Primary data saved (20254 records). [2025-09-17T18:44:25.851776] [INFO ] [MAIN ] EIG: Full history saved. [2025-09-17T18:44:25.851871] [INFO ] [MAIN ] Update Progress: 717/2371 symbols completed. EIG took 34.8s. Estimated remaining: 4h 0m 50s. Rate: 6.9 symbols/min [2025-09-17T18:44:26.015783] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-05. [2025-09-17T18:44:26.805720] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T18:44:26.815850] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2024-12. [2025-09-17T18:44:27.615888] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-07. [2025-09-17T18:44:28.292626] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-17T18:44:28.415819] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-06. [2025-09-17T18:44:28.571949] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T18:44:29.215888] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-01. [2025-09-17T18:44:29.607210] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T18:44:30.015757] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-08. [2025-09-17T18:44:30.566011] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-06 (2.15 seconds). [2025-09-17T18:44:30.815878] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-07. [2025-09-17T18:44:30.938961] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T18:44:31.615833] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-02. [2025-09-17T18:44:31.664025] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T18:44:32.415844] [INFO ] [REMOTE ] EIX: Fetching primary data for 2025-09. [2025-09-17T18:44:32.990897] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T18:44:33.054975] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-17T18:44:33.215826] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-03. [2025-09-17T18:44:34.015830] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-08. [2025-09-17T18:44:34.329819] [INFO ] [REMOTE ] EIX: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T18:44:34.336674] [INFO ] [REMOTE ] EIX: Full fetch complete (76745 records). [2025-09-17T18:44:34.336799] [DEBUG] [VALIDATOR ] EIX: Validating primary data. [2025-09-17T18:44:34.734067] [DEBUG] [VALIDATOR ] EIX: All expected trading days are present. [2025-09-17T18:44:34.734223] [DEBUG] [VALIDATOR ] EIX: Primary data validation passed. [2025-09-17T18:44:34.735168] [INFO ] [MAIN ] EIX: Fetched primary data is valid. [2025-09-17T18:44:34.735229] [DEBUG] [LOCAL ] EIX: Saving primary data. [2025-09-17T18:44:34.766143] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T18:44:34.764573] [DEBUG] [LOCAL ] EIX: Trimmed 76745 records to 53359 (keeping 200 days of data) [2025-09-17T18:44:34.833747] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-04. [2025-09-17T18:44:35.101400] [DEBUG] [LOCAL ] EIX: Primary data saved (53359 records). [2025-09-17T18:44:35.101560] [INFO ] [MAIN ] EIX: Full history saved. [2025-09-17T18:44:35.101666] [INFO ] [MAIN ] Update Progress: 718/2371 symbols completed. EIX took 42.8s. Estimated remaining: 4h 0m 42s. Rate: 6.9 symbols/min [2025-09-17T18:44:36.001007] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T18:44:36.012692] [INFO ] [REMOTE ] EL: Fetching primary data for 2025-09. [2025-09-17T18:44:36.147479] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T18:44:36.415822] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-05. [2025-09-17T18:44:37.676030] [INFO ] [REMOTE ] EL: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T18:44:37.683709] [INFO ] [REMOTE ] EL: Full fetch complete (77318 records). [2025-09-17T18:44:37.683959] [DEBUG] [VALIDATOR ] EL: Validating primary data. [2025-09-17T18:44:38.092713] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T18:44:38.142893] [DEBUG] [VALIDATOR ] EL: All expected trading days are present. [2025-09-17T18:44:38.142991] [DEBUG] [VALIDATOR ] EL: Primary data validation passed. [2025-09-17T18:44:38.143966] [INFO ] [MAIN ] EL: Fetched primary data is valid. [2025-09-17T18:44:38.144422] [DEBUG] [LOCAL ] EL: Saving primary data. [2025-09-17T18:44:38.144352] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-06. [2025-09-17T18:44:38.146664] [DEBUG] [LOCAL ] EL: Trimmed 77318 records to 53462 (keeping 200 days of data) [2025-09-17T18:44:38.487375] [DEBUG] [LOCAL ] EL: Primary data saved (53462 records). [2025-09-17T18:44:38.487541] [INFO ] [MAIN ] EL: Full history saved. [2025-09-17T18:44:38.487665] [INFO ] [MAIN ] Update Progress: 719/2371 symbols completed. EL took 32.6s. Estimated remaining: 4h 0m 21s. Rate: 6.9 symbols/min [2025-09-17T18:44:39.856622] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T18:44:39.867413] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-07. [2025-09-17T18:44:41.546202] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T18:44:41.558596] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-08. [2025-09-17T18:44:43.437371] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T18:44:43.450286] [INFO ] [REMOTE ] ELAN: Fetching primary data for 2025-09. [2025-09-17T18:44:45.276585] [INFO ] [REMOTE ] ELAN: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T18:44:45.283545] [INFO ] [REMOTE ] ELAN: Full fetch complete (76679 records). [2025-09-17T18:44:45.284079] [DEBUG] [VALIDATOR ] ELAN: Validating primary data. [2025-09-17T18:44:45.702593] [DEBUG] [VALIDATOR ] ELAN: All expected trading days are present. [2025-09-17T18:44:45.702726] [DEBUG] [VALIDATOR ] ELAN: Primary data validation passed. [2025-09-17T18:44:45.703797] [INFO ] [MAIN ] ELAN: Fetched primary data is valid. [2025-09-17T18:44:45.703851] [DEBUG] [LOCAL ] ELAN: Saving primary data. [2025-09-17T18:44:45.705765] [DEBUG] [LOCAL ] ELAN: Trimmed 76679 records to 53180 (keeping 200 days of data) [2025-09-17T18:44:46.033207] [DEBUG] [LOCAL ] ELAN: Primary data saved (53180 records). [2025-09-17T18:44:46.033365] [INFO ] [MAIN ] ELAN: Full history saved. [2025-09-17T18:44:46.034603] [INFO ] [MAIN ] Update Progress: 720/2371 symbols completed. ELAN took 28.9s. Estimated remaining: 4h 0m 10s. Rate: 6.9 symbols/min [2025-09-17T18:44:46.653757] [INFO ] [MAIN ] ELC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:44:46.765623] [INFO ] [MAIN ] ELF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:44:46.772147] [INFO ] [MAIN ] ELP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:44:46.792321] [INFO ] [MAIN ] ELME: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:44:46.796527] [DEBUG] [LOCAL ] ELC: Loaded 3552 existing records from primary storage. [2025-09-17T18:44:46.796764] [INFO ] [MAIN ] ELC: Loaded 3552 existing records. [2025-09-17T18:44:47.025958] [WARN ] [MAIN ] ELC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:44:47.026359] [INFO ] [MAIN ] ELC: Wiping existing primary data before full refresh. [2025-09-17T18:44:47.026411] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-17T18:44:47.026733] [DEBUG] [LOCAL ] ELC: Deleted primary data file. [2025-09-17T18:44:47.026786] [INFO ] [MAIN ] ELC: Starting full primary refresh. [2025-09-17T18:44:47.065039] [DEBUG] [LOCAL ] ELP: Loaded 26074 existing records from primary storage. [2025-09-17T18:44:47.084941] [INFO ] [MAIN ] ELP: Loaded 26074 existing records. [2025-09-17T18:44:47.160475] [DEBUG] [LOCAL ] ELF: Loaded 52338 existing records from primary storage. [2025-09-17T18:44:47.178747] [DEBUG] [LOCAL ] ELME: Loaded 39208 existing records from primary storage. [2025-09-17T18:44:47.178828] [INFO ] [MAIN ] ELF: Loaded 52338 existing records. [2025-09-17T18:44:47.194597] [INFO ] [MAIN ] ELME: Loaded 39208 existing records. [2025-09-17T18:44:47.866298] [WARN ] [MAIN ] ELP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:44:47.922728] [INFO ] [MAIN ] ELP: Wiping existing primary data before full refresh. [2025-09-17T18:44:47.986579] [WARN ] [MAIN ] ELME: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:44:47.996431] [INFO ] [LOCAL ] ELP: Starting deletion of primary data. [2025-09-17T18:44:47.996582] [WARN ] [MAIN ] ELF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:44:48.058806] [INFO ] [REMOTE ] ELC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:44:48.055149] [DEBUG] [LOCAL ] ELP: Deleted primary data file. [2025-09-17T18:44:48.058943] [INFO ] [MAIN ] ELF: Wiping existing primary data before full refresh. [2025-09-17T18:44:48.059296] [INFO ] [MAIN ] ELP: Starting full primary refresh. [2025-09-17T18:44:48.055316] [INFO ] [MAIN ] ELME: Wiping existing primary data before full refresh. [2025-09-17T18:44:48.059551] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-11. [2025-09-17T18:44:48.059834] [INFO ] [LOCAL ] ELME: Starting deletion of primary data. [2025-09-17T18:44:48.081712] [INFO ] [LOCAL ] ELF: Starting deletion of primary data. [2025-09-17T18:44:48.093258] [DEBUG] [LOCAL ] ELF: Deleted primary data file. [2025-09-17T18:44:48.103914] [INFO ] [MAIN ] ELF: Starting full primary refresh. [2025-09-17T18:44:48.093183] [DEBUG] [LOCAL ] ELME: Deleted primary data file. [2025-09-17T18:44:48.172300] [INFO ] [MAIN ] ELME: Starting full primary refresh. [2025-09-17T18:44:49.009770] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T18:44:49.084311] [INFO ] [REMOTE ] ELC: Fetching primary data for 2024-12. [2025-09-17T18:44:49.192396] [INFO ] [REMOTE ] ELP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:44:49.257760] [INFO ] [REMOTE ] ELF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:44:49.234931] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-11. [2025-09-17T18:44:49.273115] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-11. [2025-09-17T18:44:49.367196] [INFO ] [REMOTE ] ELME: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:44:49.367746] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-11. [2025-09-17T18:44:49.898347] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T18:44:49.900029] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-01. [2025-09-17T18:44:50.276571] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T18:44:50.282195] [INFO ] [REMOTE ] ELP: Fetching primary data for 2024-12. [2025-09-17T18:44:50.488872] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T18:44:50.490373] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-02. [2025-09-17T18:44:50.985318] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T18:44:50.993820] [INFO ] [REMOTE ] ELME: Fetching primary data for 2024-12. [2025-09-17T18:44:51.054812] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T18:44:51.056243] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-03. [2025-09-17T18:44:51.269139] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T18:44:51.279447] [INFO ] [REMOTE ] ELF: Fetching primary data for 2024-12. [2025-09-17T18:44:51.331741] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T18:44:51.337808] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-01. [2025-09-17T18:44:51.683911] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T18:44:51.685334] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-04. [2025-09-17T18:44:52.203453] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T18:44:52.212183] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-01. [2025-09-17T18:44:52.262812] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T18:44:52.264466] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-05. [2025-09-17T18:44:52.507933] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T18:44:52.513968] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-02. [2025-09-17T18:44:52.833291] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T18:44:53.215792] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-06. [2025-09-17T18:44:53.289587] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T18:44:53.341430] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T18:44:53.864922] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T18:44:53.866220] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T18:44:54.015759] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-07. [2025-09-17T18:44:54.437888] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-17T18:44:54.815773] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-08. [2025-09-17T18:44:55.569320] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T18:44:55.615782] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-01. [2025-09-17T18:44:56.415798] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-03. [2025-09-17T18:44:57.215737] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-02. [2025-09-17T18:44:57.663176] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T18:44:57.712099] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-17T18:44:58.015811] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-04. [2025-09-17T18:44:58.717717] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T18:44:58.815743] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-03. [2025-09-17T18:44:59.212441] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T18:44:59.615806] [INFO ] [REMOTE ] ELC: Fetching primary data for 2025-09. [2025-09-17T18:45:00.332351] [INFO ] [REMOTE ] ELC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T18:45:00.333381] [INFO ] [REMOTE ] ELC: Full fetch complete (5185 records). [2025-09-17T18:45:00.333471] [DEBUG] [VALIDATOR ] ELC: Validating primary data. [2025-09-17T18:45:00.333884] [FATAL] [VALIDATOR ] ELC: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T18:45:00.333972] [FATAL] [MAIN ] ELC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:45:00.334007] [WARN ] [MAIN ] ELC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:45:00.334048] [INFO ] [LOCAL ] ELC: Starting deletion of primary data. [2025-09-17T18:45:00.334114] [DEBUG] [LOCAL ] ELC: No primary data file found to delete. [2025-09-17T18:45:00.334149] [INFO ] [LOCAL ] ELC: Starting deletion of derivative data. [2025-09-17T18:45:00.334454] [DEBUG] [LOCAL ] ELC: Deleted derivative data file. [2025-09-17T18:45:00.334533] [INFO ] [MAIN ] Update Progress: 721/2371 symbols completed. ELC took 14.3s. Estimated remaining: 4h 0m 14s. Rate: 6.9 symbols/min [2025-09-17T18:45:00.418092] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-02. [2025-09-17T18:45:00.519392] [INFO ] [MAIN ] ELPC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:45:00.520050] [DEBUG] [LOCAL ] ELPC: No existing data file found in primary storage. [2025-09-17T18:45:00.520173] [WARN ] [MAIN ] ELPC: No existing data found, performing full refresh instead. [2025-09-17T18:45:00.520360] [INFO ] [MAIN ] ELPC: Wiping existing primary data before full refresh. [2025-09-17T18:45:00.520480] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-17T18:45:00.520554] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-17T18:45:00.520624] [INFO ] [MAIN ] ELPC: Starting full primary refresh. [2025-09-17T18:45:00.686892] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T18:45:00.925884] [INFO ] [REMOTE ] ELPC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:45:01.215757] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-04. [2025-09-17T18:45:02.015794] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-11. [2025-09-17T18:45:02.815857] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-05. [2025-09-17T18:45:03.131937] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-02 (2.71 seconds). [2025-09-17T18:45:03.615831] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-03. [2025-09-17T18:45:04.429768] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-11 (2.41 seconds). [2025-09-17T18:45:04.430846] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2024-12. [2025-09-17T18:45:04.471895] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-04 (3.26 seconds). [2025-09-17T18:45:05.215833] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-05. [2025-09-17T18:45:05.569233] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T18:45:05.847678] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-05 (3.03 seconds). [2025-09-17T18:45:06.015773] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-06. [2025-09-17T18:45:06.697819] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T18:45:06.815777] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-06. [2025-09-17T18:45:06.973726] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-03 (3.36 seconds). [2025-09-17T18:45:07.273792] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T18:45:07.615843] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-07. [2025-09-17T18:45:08.321158] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T18:45:08.415816] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-07. [2025-09-17T18:45:08.576889] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T18:45:09.215828] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-01. [2025-09-17T18:45:09.750231] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T18:45:09.832662] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T18:45:10.015776] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-02. [2025-09-17T18:45:10.359398] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T18:45:10.815782] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-03. [2025-09-17T18:45:11.137599] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-17T18:45:11.615770] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-04. [2025-09-17T18:45:12.131194] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T18:45:12.415773] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-05. [2025-09-17T18:45:13.068782] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T18:45:13.215775] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-04. [2025-09-17T18:45:14.015773] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-08. [2025-09-17T18:45:14.815812] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-08. [2025-09-17T18:45:15.615841] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-06. [2025-09-17T18:45:15.877453] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T18:45:16.112422] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-17T18:45:16.187274] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-04 (2.97 seconds). [2025-09-17T18:45:16.415696] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-05. [2025-09-17T18:45:16.444403] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T18:45:17.215773] [INFO ] [REMOTE ] ELME: Fetching primary data for 2025-09. [2025-09-17T18:45:18.016195] [INFO ] [REMOTE ] ELP: Fetching primary data for 2025-09. [2025-09-17T18:45:18.256811] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T18:45:18.815735] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-07. [2025-09-17T18:45:18.886603] [INFO ] [REMOTE ] ELME: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T18:45:18.892811] [INFO ] [REMOTE ] ELME: Full fetch complete (55496 records). [2025-09-17T18:45:18.892964] [DEBUG] [VALIDATOR ] ELME: Validating primary data. [2025-09-17T18:45:19.083722] [INFO ] [REMOTE ] ELP: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T18:45:19.166313] [INFO ] [REMOTE ] ELP: Full fetch complete (37810 records). [2025-09-17T18:45:19.193290] [DEBUG] [VALIDATOR ] ELP: Validating primary data. [2025-09-17T18:45:19.206808] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-17T18:45:19.428572] [DEBUG] [VALIDATOR ] ELME: All expected trading days are present. [2025-09-17T18:45:19.452198] [DEBUG] [VALIDATOR ] ELME: Primary data validation passed. [2025-09-17T18:45:19.468400] [INFO ] [MAIN ] ELME: Fetched primary data is valid. [2025-09-17T18:45:19.480532] [DEBUG] [LOCAL ] ELME: Saving primary data. [2025-09-17T18:45:19.587601] [DEBUG] [LOCAL ] ELME: Trimmed 55496 records to 39237 (keeping 200 days of data) [2025-09-17T18:45:19.663481] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-08. [2025-09-17T18:45:19.770926] [DEBUG] [VALIDATOR ] ELP: All expected trading days are present. [2025-09-17T18:45:19.771514] [DEBUG] [VALIDATOR ] ELP: Primary data validation passed. [2025-09-17T18:45:19.772754] [INFO ] [MAIN ] ELP: Fetched primary data is valid. [2025-09-17T18:45:19.773571] [DEBUG] [LOCAL ] ELP: Saving primary data. [2025-09-17T18:45:19.777136] [DEBUG] [LOCAL ] ELP: Trimmed 37810 records to 26024 (keeping 200 days of data) [2025-09-17T18:45:20.016279] [DEBUG] [LOCAL ] ELP: Primary data saved (26024 records). [2025-09-17T18:45:20.025091] [INFO ] [MAIN ] ELP: Full history saved. [2025-09-17T18:45:20.025239] [INFO ] [MAIN ] Update Progress: 722/2371 symbols completed. ELP took 34.0s. Estimated remaining: 4h 0m 30s. Rate: 6.9 symbols/min [2025-09-17T18:45:20.123211] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T18:45:20.233124] [INFO ] [MAIN ] ELS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:45:20.288587] [DEBUG] [LOCAL ] ELS: Loaded 49335 existing records from primary storage. [2025-09-17T18:45:20.289215] [INFO ] [MAIN ] ELS: Loaded 49335 existing records. [2025-09-17T18:45:20.356426] [DEBUG] [LOCAL ] ELME: Primary data saved (39237 records). [2025-09-17T18:45:20.367950] [INFO ] [MAIN ] ELME: Full history saved. [2025-09-17T18:45:20.373146] [INFO ] [MAIN ] Update Progress: 723/2371 symbols completed. ELME took 34.3s. Estimated remaining: 4h 0m 2s. Rate: 6.9 symbols/min [2025-09-17T18:45:20.427317] [INFO ] [REMOTE ] ELPC: Fetching primary data for 2025-09. [2025-09-17T18:45:20.602505] [WARN ] [MAIN ] ELS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:45:20.652116] [INFO ] [MAIN ] ELV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:45:20.652238] [INFO ] [MAIN ] ELS: Wiping existing primary data before full refresh. [2025-09-17T18:45:20.652699] [INFO ] [LOCAL ] ELS: Starting deletion of primary data. [2025-09-17T18:45:20.654117] [DEBUG] [LOCAL ] ELS: Deleted primary data file. [2025-09-17T18:45:20.654197] [INFO ] [MAIN ] ELS: Starting full primary refresh. [2025-09-17T18:45:20.936549] [INFO ] [REMOTE ] ELPC: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T18:45:20.967147] [INFO ] [REMOTE ] ELPC: Full fetch complete (1518 records). [2025-09-17T18:45:20.967319] [DEBUG] [VALIDATOR ] ELPC: Validating primary data. [2025-09-17T18:45:21.028933] [DEBUG] [LOCAL ] ELV: Loaded 50445 existing records from primary storage. [2025-09-17T18:45:21.063259] [INFO ] [MAIN ] ELV: Loaded 50445 existing records. [2025-09-17T18:45:21.157169] [INFO ] [REMOTE ] ELS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:45:21.216612] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-11. [2025-09-17T18:45:21.398442] [WARN ] [VALIDATOR ] ELPC: Validation failed - insufficient historical data. Have 192 unique days, need 200 days [2025-09-17T18:45:21.417245] [FATAL] [MAIN ] ELPC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:45:21.420682] [WARN ] [MAIN ] ELV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:45:21.420569] [WARN ] [MAIN ] ELPC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:45:21.420899] [INFO ] [MAIN ] ELV: Wiping existing primary data before full refresh. [2025-09-17T18:45:21.420931] [INFO ] [LOCAL ] ELPC: Starting deletion of primary data. [2025-09-17T18:45:21.420998] [INFO ] [LOCAL ] ELV: Starting deletion of primary data. [2025-09-17T18:45:21.421101] [DEBUG] [LOCAL ] ELPC: No primary data file found to delete. [2025-09-17T18:45:21.421220] [INFO ] [LOCAL ] ELPC: Starting deletion of derivative data. [2025-09-17T18:45:21.421288] [DEBUG] [LOCAL ] ELPC: No derivative data file found to delete. [2025-09-17T18:45:21.421353] [INFO ] [MAIN ] Update Progress: 724/2371 symbols completed. ELPC took 21.1s. Estimated remaining: 3h 59m 36s. Rate: 6.9 symbols/min [2025-09-17T18:45:21.453280] [DEBUG] [LOCAL ] ELV: Deleted primary data file. [2025-09-17T18:45:21.490808] [INFO ] [MAIN ] ELV: Starting full primary refresh. [2025-09-17T18:45:21.747056] [INFO ] [MAIN ] EMA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:45:21.770273] [DEBUG] [LOCAL ] EMA: No existing data file found in primary storage. [2025-09-17T18:45:21.807811] [WARN ] [MAIN ] EMA: No existing data found, performing full refresh instead. [2025-09-17T18:45:21.844925] [INFO ] [MAIN ] EMA: Wiping existing primary data before full refresh. [2025-09-17T18:45:21.866373] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-17T18:45:21.866500] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-17T18:45:21.866541] [INFO ] [MAIN ] EMA: Starting full primary refresh. [2025-09-17T18:45:22.044833] [INFO ] [REMOTE ] ELV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:45:22.017454] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-06. [2025-09-17T18:45:22.299786] [INFO ] [REMOTE ] EMA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:45:22.815793] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-11. [2025-09-17T18:45:23.225067] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-17T18:45:23.615857] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-11. [2025-09-17T18:45:23.843431] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:45:23.843915] [WARN ] [REMOTE ] EMA: No data returned for month 2024-11 [2025-09-17T18:45:24.149529] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-17T18:45:24.415758] [INFO ] [REMOTE ] EMA: Fetching primary data for 2024-12. [2025-09-17T18:45:24.798849] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:45:24.799212] [WARN ] [REMOTE ] EMA: No data returned for month 2024-12 [2025-09-17T18:45:24.857204] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-17T18:45:25.215785] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-01. [2025-09-17T18:45:25.413063] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:45:25.413391] [WARN ] [REMOTE ] EMA: No data returned for month 2025-01 [2025-09-17T18:45:26.015805] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-02. [2025-09-17T18:45:26.269012] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:45:26.269325] [WARN ] [REMOTE ] EMA: No data returned for month 2025-02 [2025-09-17T18:45:26.815779] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-07. [2025-09-17T18:45:27.615880] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-03. [2025-09-17T18:45:27.835264] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:45:27.835626] [WARN ] [REMOTE ] EMA: No data returned for month 2025-03 [2025-09-17T18:45:28.415838] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-04. [2025-09-17T18:45:28.618415] [DEBUG] [REMOTE ] EMA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T18:45:28.618759] [WARN ] [REMOTE ] EMA: No data returned for month 2025-04 [2025-09-17T18:45:29.036830] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-07 (2.22 seconds). [2025-09-17T18:45:29.215778] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-08. [2025-09-17T18:45:30.015840] [INFO ] [REMOTE ] ELS: Fetching primary data for 2024-12. [2025-09-17T18:45:30.815814] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-05. [2025-09-17T18:45:31.328784] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-17T18:45:31.615765] [INFO ] [REMOTE ] ELV: Fetching primary data for 2024-12. [2025-09-17T18:45:31.630944] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T18:45:31.671759] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T18:45:32.415782] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-01. [2025-09-17T18:45:33.215817] [INFO ] [REMOTE ] ELF: Fetching primary data for 2025-09. [2025-09-17T18:45:33.575342] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T18:45:33.860735] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T18:45:34.015720] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-02. [2025-09-17T18:45:34.815776] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-01. [2025-09-17T18:45:35.197147] [INFO ] [REMOTE ] ELF: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-17T18:45:35.206501] [INFO ] [REMOTE ] ELF: Full fetch complete (75269 records). [2025-09-17T18:45:35.206738] [DEBUG] [VALIDATOR ] ELF: Validating primary data. [2025-09-17T18:45:35.626633] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-06. [2025-09-17T18:45:35.627155] [DEBUG] [VALIDATOR ] ELF: All expected trading days are present. [2025-09-17T18:45:35.628334] [DEBUG] [VALIDATOR ] ELF: Primary data validation passed. [2025-09-17T18:45:35.629303] [INFO ] [MAIN ] ELF: Fetched primary data is valid. [2025-09-17T18:45:35.629374] [DEBUG] [LOCAL ] ELF: Saving primary data. [2025-09-17T18:45:35.640440] [DEBUG] [LOCAL ] ELF: Trimmed 75269 records to 52337 (keeping 200 days of data) [2025-09-17T18:45:35.660392] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T18:45:35.992866] [DEBUG] [LOCAL ] ELF: Primary data saved (52337 records). [2025-09-17T18:45:35.993027] [INFO ] [MAIN ] ELF: Full history saved. [2025-09-17T18:45:35.998036] [INFO ] [MAIN ] Update Progress: 725/2371 symbols completed. ELF took 50.0s. Estimated remaining: 3h 59m 41s. Rate: 6.9 symbols/min [2025-09-17T18:45:36.182477] [INFO ] [MAIN ] EMD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:45:36.205700] [DEBUG] [LOCAL ] EMD: Loaded 21538 existing records from primary storage. [2025-09-17T18:45:36.205852] [INFO ] [MAIN ] EMD: Loaded 21538 existing records. [2025-09-17T18:45:36.399921] [WARN ] [MAIN ] EMD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:45:36.400233] [INFO ] [MAIN ] EMD: Wiping existing primary data before full refresh. [2025-09-17T18:45:36.400298] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-17T18:45:36.401002] [DEBUG] [LOCAL ] EMD: Deleted primary data file. [2025-09-17T18:45:36.401069] [INFO ] [MAIN ] EMD: Starting full primary refresh. [2025-09-17T18:45:36.437748] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-03. [2025-09-17T18:45:36.687465] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T18:45:36.823570] [INFO ] [REMOTE ] EMD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:45:36.855588] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T18:45:37.215823] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-02. [2025-09-17T18:45:38.015814] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-07. [2025-09-17T18:45:38.316869] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T18:45:38.815823] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-04. [2025-09-17T18:45:38.965209] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T18:45:38.996502] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T18:45:39.615799] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-08. [2025-09-17T18:45:40.415814] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-11. [2025-09-17T18:45:40.562373] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T18:45:40.663229] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T18:45:41.215820] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-05. [2025-09-17T18:45:41.388878] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T18:45:42.015796] [INFO ] [REMOTE ] EMA: Fetching primary data for 2025-09. [2025-09-17T18:45:42.815786] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-03. [2025-09-17T18:45:42.905375] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T18:45:43.325071] [INFO ] [REMOTE ] EMA: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T18:45:43.327415] [INFO ] [REMOTE ] EMA: Full fetch complete (7414 records). [2025-09-17T18:45:43.327519] [DEBUG] [VALIDATOR ] EMA: Validating primary data. [2025-09-17T18:45:43.509446] [WARN ] [VALIDATOR ] EMA: Validation failed - insufficient historical data. Have 78 unique days, need 200 days [2025-09-17T18:45:43.509702] [FATAL] [MAIN ] EMA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:45:43.509754] [WARN ] [MAIN ] EMA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:45:43.509797] [INFO ] [LOCAL ] EMA: Starting deletion of primary data. [2025-09-17T18:45:43.509861] [DEBUG] [LOCAL ] EMA: No primary data file found to delete. [2025-09-17T18:45:43.509898] [INFO ] [LOCAL ] EMA: Starting deletion of derivative data. [2025-09-17T18:45:43.509967] [DEBUG] [LOCAL ] EMA: No derivative data file found to delete. [2025-09-17T18:45:43.510025] [INFO ] [MAIN ] Update Progress: 726/2371 symbols completed. EMA took 22.1s. Estimated remaining: 3h 59m 29s. Rate: 6.9 symbols/min [2025-09-17T18:45:43.620939] [INFO ] [REMOTE ] EMD: Fetching primary data for 2024-12. [2025-09-17T18:45:43.682048] [INFO ] [MAIN ] EME: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:45:43.721295] [DEBUG] [LOCAL ] EME: Loaded 31886 existing records from primary storage. [2025-09-17T18:45:43.721429] [INFO ] [MAIN ] EME: Loaded 31886 existing records. [2025-09-17T18:45:43.910733] [WARN ] [MAIN ] EME: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:45:43.910995] [INFO ] [MAIN ] EME: Wiping existing primary data before full refresh. [2025-09-17T18:45:43.911054] [INFO ] [LOCAL ] EME: Starting deletion of primary data. [2025-09-17T18:45:43.911786] [DEBUG] [LOCAL ] EME: Deleted primary data file. [2025-09-17T18:45:43.911846] [INFO ] [MAIN ] EME: Starting full primary refresh. [2025-09-17T18:45:44.268637] [INFO ] [REMOTE ] EME: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:45:44.415827] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-11. [2025-09-17T18:45:44.595268] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T18:45:44.864397] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T18:45:45.215770] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-06. [2025-09-17T18:45:45.699270] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T18:45:46.015804] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-04. [2025-09-17T18:45:46.809964] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T18:45:46.819261] [INFO ] [REMOTE ] EME: Fetching primary data for 2024-12. [2025-09-17T18:45:47.615804] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-07. [2025-09-17T18:45:47.895857] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T18:45:48.214132] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T18:45:48.415803] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-01. [2025-09-17T18:45:49.131580] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T18:45:49.215810] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-08. [2025-09-17T18:45:49.547336] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T18:45:50.015789] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-02. [2025-09-17T18:45:50.815802] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-05. [2025-09-17T18:45:51.037352] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T18:45:51.111165] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T18:45:51.615832] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-03. [2025-09-17T18:45:52.415823] [INFO ] [REMOTE ] ELS: Fetching primary data for 2025-09. [2025-09-17T18:45:52.645420] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T18:45:52.759811] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T18:45:53.215772] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-01. [2025-09-17T18:45:54.015779] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-06. [2025-09-17T18:45:54.145162] [INFO ] [REMOTE ] ELS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T18:45:54.152604] [INFO ] [REMOTE ] ELS: Full fetch complete (70157 records). [2025-09-17T18:45:54.152813] [DEBUG] [VALIDATOR ] ELS: Validating primary data. [2025-09-17T18:45:54.563493] [DEBUG] [VALIDATOR ] ELS: All expected trading days are present. [2025-09-17T18:45:54.563588] [DEBUG] [VALIDATOR ] ELS: Primary data validation passed. [2025-09-17T18:45:54.564603] [INFO ] [MAIN ] ELS: Fetched primary data is valid. [2025-09-17T18:45:54.564715] [DEBUG] [LOCAL ] ELS: Saving primary data. [2025-09-17T18:45:54.566405] [DEBUG] [LOCAL ] ELS: Trimmed 70157 records to 49360 (keeping 200 days of data) [2025-09-17T18:45:54.816437] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-04. [2025-09-17T18:45:54.838103] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T18:45:54.917987] [DEBUG] [LOCAL ] ELS: Primary data saved (49360 records). [2025-09-17T18:45:54.918141] [INFO ] [MAIN ] ELS: Full history saved. [2025-09-17T18:45:54.919658] [INFO ] [MAIN ] Update Progress: 727/2371 symbols completed. ELS took 34.9s. Estimated remaining: 3h 59m 26s. Rate: 6.9 symbols/min [2025-09-17T18:45:55.090486] [INFO ] [MAIN ] EMF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:45:55.097930] [DEBUG] [LOCAL ] EMF: Loaded 3675 existing records from primary storage. [2025-09-17T18:45:55.098061] [INFO ] [MAIN ] EMF: Loaded 3675 existing records. [2025-09-17T18:45:55.278722] [WARN ] [MAIN ] EMF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:45:55.279005] [INFO ] [MAIN ] EMF: Wiping existing primary data before full refresh. [2025-09-17T18:45:55.279050] [INFO ] [LOCAL ] EMF: Starting deletion of primary data. [2025-09-17T18:45:55.279255] [DEBUG] [LOCAL ] EMF: Deleted primary data file. [2025-09-17T18:45:55.279300] [INFO ] [MAIN ] EMF: Starting full primary refresh. [2025-09-17T18:45:55.674380] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-02. [2025-09-17T18:45:55.679032] [INFO ] [REMOTE ] EMF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:45:55.714517] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T18:45:55.997167] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T18:45:56.415810] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-05. [2025-09-17T18:45:57.113316] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T18:45:57.177418] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T18:45:57.215721] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-06. [2025-09-17T18:45:57.321771] [DEBUG] [REMOTE ] EMD: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-17T18:45:57.322307] [WARN ] [REMOTE ] EMD: No data returned for month 2025-06 [2025-09-17T18:45:58.015910] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-11. [2025-09-17T18:45:58.752602] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T18:45:58.815780] [INFO ] [REMOTE ] EMF: Fetching primary data for 2024-12. [2025-09-17T18:45:59.615722] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-07. [2025-09-17T18:45:59.786323] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T18:46:00.415816] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-03. [2025-09-17T18:46:01.215872] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-07. [2025-09-17T18:46:02.015854] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-01. [2025-09-17T18:46:02.066931] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T18:46:02.125014] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-17T18:46:02.482877] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T18:46:02.743448] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T18:46:02.815843] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-02. [2025-09-17T18:46:03.507057] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T18:46:03.615806] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-04. [2025-09-17T18:46:04.415800] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-08. [2025-09-17T18:46:05.179943] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T18:46:05.215752] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-05. [2025-09-17T18:46:05.575041] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T18:46:06.015875] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-03. [2025-09-17T18:46:06.490462] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T18:46:06.643362] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T18:46:06.815794] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-04. [2025-09-17T18:46:07.231395] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T18:46:07.615817] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-08. [2025-09-17T18:46:08.415819] [INFO ] [REMOTE ] EMD: Fetching primary data for 2025-09. [2025-09-17T18:46:09.215847] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-05. [2025-09-17T18:46:09.410755] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T18:46:09.474062] [INFO ] [REMOTE ] EMD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T18:46:09.477615] [INFO ] [REMOTE ] EMD: Full fetch complete (29400 records). [2025-09-17T18:46:09.477777] [DEBUG] [VALIDATOR ] EMD: Validating primary data. [2025-09-17T18:46:09.672600] [WARN ] [VALIDATOR ] EMD: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T18:46:09.676394] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T18:46:09.676757] [FATAL] [MAIN ] EMD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:46:09.678260] [WARN ] [MAIN ] EMD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:46:09.678338] [INFO ] [LOCAL ] EMD: Starting deletion of primary data. [2025-09-17T18:46:09.678402] [DEBUG] [LOCAL ] EMD: No primary data file found to delete. [2025-09-17T18:46:09.678449] [INFO ] [LOCAL ] EMD: Starting deletion of derivative data. [2025-09-17T18:46:09.678836] [DEBUG] [LOCAL ] EMD: Deleted derivative data file. [2025-09-17T18:46:09.678931] [INFO ] [MAIN ] Update Progress: 728/2371 symbols completed. EMD took 33.7s. Estimated remaining: 3h 59m 31s. Rate: 6.9 symbols/min [2025-09-17T18:46:09.849021] [INFO ] [MAIN ] EMN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:46:09.903224] [DEBUG] [LOCAL ] EMN: Loaded 50214 existing records from primary storage. [2025-09-17T18:46:09.903398] [INFO ] [MAIN ] EMN: Loaded 50214 existing records. [2025-09-17T18:46:10.020927] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-06. [2025-09-17T18:46:10.100720] [WARN ] [MAIN ] EMN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:46:10.100981] [INFO ] [MAIN ] EMN: Wiping existing primary data before full refresh. [2025-09-17T18:46:10.101040] [INFO ] [LOCAL ] EMN: Starting deletion of primary data. [2025-09-17T18:46:10.102178] [DEBUG] [LOCAL ] EMN: Deleted primary data file. [2025-09-17T18:46:10.102230] [INFO ] [MAIN ] EMN: Starting full primary refresh. [2025-09-17T18:46:10.479224] [INFO ] [REMOTE ] EMN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:46:10.815796] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-11. [2025-09-17T18:46:11.380189] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T18:46:11.615755] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-07. [2025-09-17T18:46:12.415848] [INFO ] [REMOTE ] ELV: Fetching primary data for 2025-09. [2025-09-17T18:46:12.463680] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T18:46:13.120005] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T18:46:13.215793] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-08. [2025-09-17T18:46:14.015777] [INFO ] [REMOTE ] EMN: Fetching primary data for 2024-12. [2025-09-17T18:46:14.366304] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T18:46:14.397575] [INFO ] [REMOTE ] ELV: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-17T18:46:14.408051] [INFO ] [REMOTE ] ELV: Full fetch complete (73068 records). [2025-09-17T18:46:14.408291] [DEBUG] [VALIDATOR ] ELV: Validating primary data. [2025-09-17T18:46:14.820045] [DEBUG] [VALIDATOR ] ELV: All expected trading days are present. [2025-09-17T18:46:14.820177] [DEBUG] [VALIDATOR ] ELV: Primary data validation passed. [2025-09-17T18:46:14.819709] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-06. [2025-09-17T18:46:14.821398] [INFO ] [MAIN ] ELV: Fetched primary data is valid. [2025-09-17T18:46:14.822214] [DEBUG] [LOCAL ] ELV: Saving primary data. [2025-09-17T18:46:14.823812] [DEBUG] [LOCAL ] ELV: Trimmed 73068 records to 50472 (keeping 200 days of data) [2025-09-17T18:46:15.163801] [DEBUG] [LOCAL ] ELV: Primary data saved (50472 records). [2025-09-17T18:46:15.163968] [INFO ] [MAIN ] ELV: Full history saved. [2025-09-17T18:46:15.164072] [INFO ] [MAIN ] Update Progress: 729/2371 symbols completed. ELV took 54.8s. Estimated remaining: 3h 59m 15s. Rate: 6.9 symbols/min [2025-09-17T18:46:15.340820] [INFO ] [MAIN ] EMO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:46:15.345048] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T18:46:15.360508] [DEBUG] [LOCAL ] EMO: Loaded 12202 existing records from primary storage. [2025-09-17T18:46:15.360716] [INFO ] [MAIN ] EMO: Loaded 12202 existing records. [2025-09-17T18:46:15.539264] [WARN ] [MAIN ] EMO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:46:15.539541] [INFO ] [MAIN ] EMO: Wiping existing primary data before full refresh. [2025-09-17T18:46:15.539586] [INFO ] [LOCAL ] EMO: Starting deletion of primary data. [2025-09-17T18:46:15.540005] [DEBUG] [LOCAL ] EMO: Deleted primary data file. [2025-09-17T18:46:15.540051] [INFO ] [MAIN ] EMO: Starting full primary refresh. [2025-09-17T18:46:15.620938] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-07. [2025-09-17T18:46:15.920568] [INFO ] [REMOTE ] EMO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:46:15.951272] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T18:46:16.099957] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T18:46:16.415810] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-01. [2025-09-17T18:46:17.215848] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-11. [2025-09-17T18:46:18.015827] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-08. [2025-09-17T18:46:18.074884] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T18:46:18.115925] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T18:46:18.499471] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T18:46:18.815777] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-02. [2025-09-17T18:46:19.615793] [INFO ] [REMOTE ] EMF: Fetching primary data for 2025-09. [2025-09-17T18:46:20.040524] [INFO ] [REMOTE ] EMF: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T18:46:20.041530] [INFO ] [REMOTE ] EMF: Full fetch complete (7407 records). [2025-09-17T18:46:20.041601] [DEBUG] [VALIDATOR ] EMF: Validating primary data. [2025-09-17T18:46:20.421115] [INFO ] [REMOTE ] EMO: Fetching primary data for 2024-12. [2025-09-17T18:46:20.431937] [DEBUG] [VALIDATOR ] EMF: All expected trading days are present. [2025-09-17T18:46:20.432104] [DEBUG] [VALIDATOR ] EMF: Primary data validation passed. [2025-09-17T18:46:20.432439] [INFO ] [MAIN ] EMF: Fetched primary data is valid. [2025-09-17T18:46:20.432517] [DEBUG] [LOCAL ] EMF: Saving primary data. [2025-09-17T18:46:20.433073] [DEBUG] [LOCAL ] EMF: Trimmed 7407 records to 3676 (keeping 200 days of data) [2025-09-17T18:46:20.478724] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T18:46:20.492179] [DEBUG] [LOCAL ] EMF: Primary data saved (3676 records). [2025-09-17T18:46:20.492264] [INFO ] [MAIN ] EMF: Full history saved. [2025-09-17T18:46:20.492339] [INFO ] [MAIN ] Update Progress: 730/2371 symbols completed. EMF took 25.6s. Estimated remaining: 3h 58m 59s. Rate: 6.9 symbols/min [2025-09-17T18:46:20.676100] [INFO ] [MAIN ] EMP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:46:20.681923] [DEBUG] [LOCAL ] EMP: Loaded 2984 existing records from primary storage. [2025-09-17T18:46:20.682022] [INFO ] [MAIN ] EMP: Loaded 2984 existing records. [2025-09-17T18:46:20.862685] [WARN ] [MAIN ] EMP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:46:20.862991] [INFO ] [MAIN ] EMP: Wiping existing primary data before full refresh. [2025-09-17T18:46:20.863040] [INFO ] [LOCAL ] EMP: Starting deletion of primary data. [2025-09-17T18:46:20.863535] [DEBUG] [LOCAL ] EMP: Deleted primary data file. [2025-09-17T18:46:20.863584] [INFO ] [MAIN ] EMP: Starting full primary refresh. [2025-09-17T18:46:21.222390] [INFO ] [REMOTE ] EME: Fetching primary data for 2025-09. [2025-09-17T18:46:21.226721] [INFO ] [REMOTE ] EMP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:46:21.384142] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T18:46:22.015819] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-01. [2025-09-17T18:46:22.525941] [INFO ] [REMOTE ] EME: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T18:46:22.530523] [INFO ] [REMOTE ] EME: Full fetch complete (46553 records). [2025-09-17T18:46:22.530692] [DEBUG] [VALIDATOR ] EME: Validating primary data. [2025-09-17T18:46:22.816990] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-11. [2025-09-17T18:46:22.862590] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T18:46:22.930024] [DEBUG] [VALIDATOR ] EME: All expected trading days are present. [2025-09-17T18:46:22.930100] [DEBUG] [VALIDATOR ] EME: Primary data validation passed. [2025-09-17T18:46:22.930701] [INFO ] [MAIN ] EME: Fetched primary data is valid. [2025-09-17T18:46:22.930743] [DEBUG] [LOCAL ] EME: Saving primary data. [2025-09-17T18:46:22.932223] [DEBUG] [LOCAL ] EME: Trimmed 46553 records to 31825 (keeping 200 days of data) [2025-09-17T18:46:23.137510] [DEBUG] [LOCAL ] EME: Primary data saved (31825 records). [2025-09-17T18:46:23.137663] [INFO ] [MAIN ] EME: Full history saved. [2025-09-17T18:46:23.137767] [INFO ] [MAIN ] Update Progress: 731/2371 symbols completed. EME took 39.6s. Estimated remaining: 3h 58m 36s. Rate: 6.9 symbols/min [2025-09-17T18:46:23.312043] [INFO ] [MAIN ] EMR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:46:23.315103] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T18:46:23.377393] [DEBUG] [LOCAL ] EMR: Loaded 53256 existing records from primary storage. [2025-09-17T18:46:23.377560] [INFO ] [MAIN ] EMR: Loaded 53256 existing records. [2025-09-17T18:46:23.560300] [WARN ] [MAIN ] EMR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:46:23.560529] [INFO ] [MAIN ] EMR: Wiping existing primary data before full refresh. [2025-09-17T18:46:23.560575] [INFO ] [LOCAL ] EMR: Starting deletion of primary data. [2025-09-17T18:46:23.561595] [DEBUG] [LOCAL ] EMR: Deleted primary data file. [2025-09-17T18:46:23.561670] [INFO ] [MAIN ] EMR: Starting full primary refresh. [2025-09-17T18:46:23.624670] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-02. [2025-09-17T18:46:23.928713] [INFO ] [REMOTE ] EMR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:46:24.415766] [INFO ] [REMOTE ] EMP: Fetching primary data for 2024-12. [2025-09-17T18:46:24.669156] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T18:46:24.982439] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T18:46:25.215785] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-03. [2025-09-17T18:46:26.015810] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-01. [2025-09-17T18:46:26.486391] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T18:46:26.815705] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-11. [2025-09-17T18:46:26.849226] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T18:46:27.615802] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-02. [2025-09-17T18:46:28.059020] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T18:46:28.415697] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-04. [2025-09-17T18:46:28.502230] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T18:46:29.215813] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-03. [2025-09-17T18:46:30.015808] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-03. [2025-09-17T18:46:30.138570] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T18:46:30.174995] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T18:46:30.485208] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T18:46:30.815819] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-05. [2025-09-17T18:46:31.615829] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-04. [2025-09-17T18:46:32.415776] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-04. [2025-09-17T18:46:32.431445] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T18:46:32.546429] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T18:46:33.088556] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T18:46:33.215790] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-05. [2025-09-17T18:46:33.825305] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T18:46:34.015777] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-06. [2025-09-17T18:46:34.563544] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T18:46:34.815830] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-07. [2025-09-17T18:46:35.211290] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T18:46:35.615827] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-06. [2025-09-17T18:46:36.415817] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-05. [2025-09-17T18:46:37.125455] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T18:46:37.217854] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-07. [2025-09-17T18:46:37.221521] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T18:46:38.015796] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-08. [2025-09-17T18:46:38.495708] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T18:46:38.815828] [INFO ] [REMOTE ] EMP: Fetching primary data for 2025-09. [2025-09-17T18:46:39.107985] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T18:46:39.273737] [INFO ] [REMOTE ] EMP: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T18:46:39.274782] [INFO ] [REMOTE ] EMP: Full fetch complete (4290 records). [2025-09-17T18:46:39.274859] [DEBUG] [VALIDATOR ] EMP: Validating primary data. [2025-09-17T18:46:39.623966] [INFO ] [REMOTE ] EMR: Fetching primary data for 2024-12. [2025-09-17T18:46:39.651785] [DEBUG] [VALIDATOR ] EMP: All expected trading days are present. [2025-09-17T18:46:39.651868] [DEBUG] [VALIDATOR ] EMP: Primary data validation passed. [2025-09-17T18:46:39.652035] [INFO ] [MAIN ] EMP: Fetched primary data is valid. [2025-09-17T18:46:39.652100] [DEBUG] [LOCAL ] EMP: Saving primary data. [2025-09-17T18:46:39.652519] [DEBUG] [LOCAL ] EMP: Trimmed 4290 records to 3004 (keeping 200 days of data) [2025-09-17T18:46:39.671337] [DEBUG] [LOCAL ] EMP: Primary data saved (3004 records). [2025-09-17T18:46:39.671468] [INFO ] [MAIN ] EMP: Full history saved. [2025-09-17T18:46:39.671559] [INFO ] [MAIN ] Update Progress: 732/2371 symbols completed. EMP took 19.2s. Estimated remaining: 3h 58m 45s. Rate: 6.9 symbols/min [2025-09-17T18:46:39.846041] [INFO ] [MAIN ] ENB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:46:39.903907] [DEBUG] [LOCAL ] ENB: Loaded 53528 existing records from primary storage. [2025-09-17T18:46:39.904061] [INFO ] [MAIN ] ENB: Loaded 53528 existing records. [2025-09-17T18:46:40.088179] [WARN ] [MAIN ] ENB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:46:40.088464] [INFO ] [MAIN ] ENB: Wiping existing primary data before full refresh. [2025-09-17T18:46:40.088522] [INFO ] [LOCAL ] ENB: Starting deletion of primary data. [2025-09-17T18:46:40.089582] [DEBUG] [LOCAL ] ENB: Deleted primary data file. [2025-09-17T18:46:40.089639] [INFO ] [MAIN ] ENB: Starting full primary refresh. [2025-09-17T18:46:40.422863] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-08. [2025-09-17T18:46:40.452486] [INFO ] [REMOTE ] ENB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:46:41.215785] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-11. [2025-09-17T18:46:41.505798] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T18:46:41.803091] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T18:46:42.015776] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-06. [2025-09-17T18:46:42.762171] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T18:46:42.807848] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T18:46:42.817822] [INFO ] [REMOTE ] EMN: Fetching primary data for 2025-09. [2025-09-17T18:46:43.615793] [INFO ] [REMOTE ] ENB: Fetching primary data for 2024-12. [2025-09-17T18:46:44.415705] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-01. [2025-09-17T18:46:44.499382] [INFO ] [REMOTE ] EMN: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T18:46:44.506744] [INFO ] [REMOTE ] EMN: Full fetch complete (71691 records). [2025-09-17T18:46:44.506942] [DEBUG] [VALIDATOR ] EMN: Validating primary data. [2025-09-17T18:46:44.924161] [DEBUG] [VALIDATOR ] EMN: All expected trading days are present. [2025-09-17T18:46:44.924256] [DEBUG] [VALIDATOR ] EMN: Primary data validation passed. [2025-09-17T18:46:44.925393] [INFO ] [MAIN ] EMN: Fetched primary data is valid. [2025-09-17T18:46:44.925469] [DEBUG] [LOCAL ] EMN: Saving primary data. [2025-09-17T18:46:44.927085] [DEBUG] [LOCAL ] EMN: Trimmed 71691 records to 50259 (keeping 200 days of data) [2025-09-17T18:46:45.226761] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-07. [2025-09-17T18:46:45.268452] [DEBUG] [LOCAL ] EMN: Primary data saved (50259 records). [2025-09-17T18:46:45.268618] [INFO ] [MAIN ] EMN: Full history saved. [2025-09-17T18:46:45.268760] [INFO ] [MAIN ] Update Progress: 733/2371 symbols completed. EMN took 35.6s. Estimated remaining: 3h 58m 29s. Rate: 6.9 symbols/min [2025-09-17T18:46:45.448254] [INFO ] [MAIN ] ENFY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:46:45.482212] [DEBUG] [LOCAL ] ENFY: Loaded 3056 existing records from primary storage. [2025-09-17T18:46:45.482840] [INFO ] [MAIN ] ENFY: Loaded 3056 existing records. [2025-09-17T18:46:45.516867] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T18:46:45.674387] [WARN ] [MAIN ] ENFY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:46:45.674678] [INFO ] [MAIN ] ENFY: Wiping existing primary data before full refresh. [2025-09-17T18:46:45.674725] [INFO ] [LOCAL ] ENFY: Starting deletion of primary data. [2025-09-17T18:46:45.674962] [DEBUG] [LOCAL ] ENFY: Deleted primary data file. [2025-09-17T18:46:45.675005] [INFO ] [MAIN ] ENFY: Starting full primary refresh. [2025-09-17T18:46:46.019688] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-01. [2025-09-17T18:46:46.064102] [INFO ] [REMOTE ] ENFY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:46:46.122749] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T18:46:46.242701] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T18:46:46.815803] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-11. [2025-09-17T18:46:47.146209] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T18:46:47.615697] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-08. [2025-09-17T18:46:47.906591] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T18:46:48.415841] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-02. [2025-09-17T18:46:48.476984] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T18:46:49.215819] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2024-12. [2025-09-17T18:46:49.889879] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T18:46:50.015779] [INFO ] [REMOTE ] EMO: Fetching primary data for 2025-09. [2025-09-17T18:46:50.168886] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T18:46:50.815828] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-03. [2025-09-17T18:46:50.986578] [INFO ] [REMOTE ] EMO: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T18:46:50.989704] [INFO ] [REMOTE ] EMO: Full fetch complete (17206 records). [2025-09-17T18:46:50.989790] [DEBUG] [VALIDATOR ] EMO: Validating primary data. [2025-09-17T18:46:51.364611] [DEBUG] [VALIDATOR ] EMO: All expected trading days are present. [2025-09-17T18:46:51.364726] [DEBUG] [VALIDATOR ] EMO: Primary data validation passed. [2025-09-17T18:46:51.365197] [INFO ] [MAIN ] EMO: Fetched primary data is valid. [2025-09-17T18:46:51.365245] [DEBUG] [LOCAL ] EMO: Saving primary data. [2025-09-17T18:46:51.365885] [DEBUG] [LOCAL ] EMO: Trimmed 17206 records to 12281 (keeping 200 days of data) [2025-09-17T18:46:51.440018] [DEBUG] [LOCAL ] EMO: Primary data saved (12281 records). [2025-09-17T18:46:51.440154] [INFO ] [MAIN ] EMO: Full history saved. [2025-09-17T18:46:51.440238] [INFO ] [MAIN ] Update Progress: 734/2371 symbols completed. EMO took 36.3s. Estimated remaining: 3h 58m 15s. Rate: 6.9 symbols/min [2025-09-17T18:46:51.614162] [INFO ] [MAIN ] ENIC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:46:51.615746] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-01. [2025-09-17T18:46:51.650321] [DEBUG] [LOCAL ] ENIC: Loaded 36932 existing records from primary storage. [2025-09-17T18:46:51.650467] [INFO ] [MAIN ] ENIC: Loaded 36932 existing records. [2025-09-17T18:46:51.832901] [WARN ] [MAIN ] ENIC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:46:51.833139] [INFO ] [MAIN ] ENIC: Wiping existing primary data before full refresh. [2025-09-17T18:46:51.833185] [INFO ] [LOCAL ] ENIC: Starting deletion of primary data. [2025-09-17T18:46:51.833938] [DEBUG] [LOCAL ] ENIC: Deleted primary data file. [2025-09-17T18:46:51.833993] [INFO ] [MAIN ] ENIC: Starting full primary refresh. [2025-09-17T18:46:52.191987] [INFO ] [REMOTE ] ENIC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:46:52.329551] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T18:46:52.424352] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-11. [2025-09-17T18:46:52.431464] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T18:46:53.215804] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-02. [2025-09-17T18:46:53.519716] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T18:46:54.015807] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2024-12. [2025-09-17T18:46:54.754265] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T18:46:54.815822] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-03. [2025-09-17T18:46:55.330325] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T18:46:55.615779] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-02. [2025-09-17T18:46:56.182929] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T18:46:56.415794] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-03. [2025-09-17T18:46:56.608474] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T18:46:56.875814] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T18:46:57.215783] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-04. [2025-09-17T18:46:58.015798] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-01. [2025-09-17T18:46:58.815810] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-04. [2025-09-17T18:46:58.928215] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T18:46:59.324693] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T18:46:59.615789] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-02. [2025-09-17T18:47:00.286634] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T18:47:00.415815] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-05. [2025-09-17T18:47:00.937884] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T18:47:01.215807] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-04. [2025-09-17T18:47:01.567376] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-17T18:47:02.015799] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-05. [2025-09-17T18:47:02.150342] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T18:47:02.395599] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T18:47:02.815811] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-03. [2025-09-17T18:47:03.615826] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-06. [2025-09-17T18:47:04.237677] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T18:47:04.415766] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-04. [2025-09-17T18:47:05.092942] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T18:47:05.215736] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-07. [2025-09-17T18:47:05.862882] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T18:47:06.015736] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-05. [2025-09-17T18:47:06.815784] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-06. [2025-09-17T18:47:07.138958] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T18:47:07.447316] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T18:47:07.490715] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T18:47:07.615786] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-07. [2025-09-17T18:47:08.409379] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T18:47:08.415681] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-08. [2025-09-17T18:47:08.967931] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T18:47:09.215830] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-08. [2025-09-17T18:47:10.015807] [INFO ] [REMOTE ] ENFY: Fetching primary data for 2025-09. [2025-09-17T18:47:10.457502] [INFO ] [REMOTE ] ENFY: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T18:47:10.458523] [INFO ] [REMOTE ] ENFY: Full fetch complete (5708 records). [2025-09-17T18:47:10.458592] [DEBUG] [VALIDATOR ] ENFY: Validating primary data. [2025-09-17T18:47:10.817589] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-05. [2025-09-17T18:47:10.817973] [DEBUG] [VALIDATOR ] ENFY: All expected trading days are present. [2025-09-17T18:47:10.818808] [DEBUG] [VALIDATOR ] ENFY: Primary data validation passed. [2025-09-17T18:47:10.819030] [INFO ] [MAIN ] ENFY: Fetched primary data is valid. [2025-09-17T18:47:10.819131] [DEBUG] [LOCAL ] ENFY: Saving primary data. [2025-09-17T18:47:10.819818] [DEBUG] [LOCAL ] ENFY: Trimmed 5708 records to 3066 (keeping 200 days of data) [2025-09-17T18:47:10.838466] [DEBUG] [LOCAL ] ENFY: Primary data saved (3066 records). [2025-09-17T18:47:10.838681] [INFO ] [MAIN ] ENFY: Full history saved. [2025-09-17T18:47:10.838812] [INFO ] [MAIN ] Update Progress: 735/2371 symbols completed. ENFY took 25.6s. Estimated remaining: 3h 58m 30s. Rate: 6.9 symbols/min [2025-09-17T18:47:10.972513] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T18:47:11.053903] [INFO ] [MAIN ] ENO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:47:11.057519] [DEBUG] [LOCAL ] ENO: Loaded 2001 existing records from primary storage. [2025-09-17T18:47:11.057599] [INFO ] [MAIN ] ENO: Loaded 2001 existing records. [2025-09-17T18:47:11.239049] [WARN ] [MAIN ] ENO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:47:11.239335] [INFO ] [MAIN ] ENO: Wiping existing primary data before full refresh. [2025-09-17T18:47:11.239379] [INFO ] [LOCAL ] ENO: Starting deletion of primary data. [2025-09-17T18:47:11.239602] [DEBUG] [LOCAL ] ENO: Deleted primary data file. [2025-09-17T18:47:11.239672] [INFO ] [MAIN ] ENO: Starting full primary refresh. [2025-09-17T18:47:11.594422] [INFO ] [REMOTE ] ENO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:47:11.615759] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-06. [2025-09-17T18:47:12.415788] [INFO ] [REMOTE ] EMR: Fetching primary data for 2025-09. [2025-09-17T18:47:12.710548] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T18:47:13.105885] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T18:47:13.215786] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-07. [2025-09-17T18:47:13.952482] [INFO ] [REMOTE ] EMR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T18:47:13.959400] [INFO ] [REMOTE ] EMR: Full fetch complete (76938 records). [2025-09-17T18:47:13.959535] [DEBUG] [VALIDATOR ] EMR: Validating primary data. [2025-09-17T18:47:14.022937] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-11. [2025-09-17T18:47:14.370931] [DEBUG] [VALIDATOR ] EMR: All expected trading days are present. [2025-09-17T18:47:14.371031] [DEBUG] [VALIDATOR ] EMR: Primary data validation passed. [2025-09-17T18:47:14.371945] [INFO ] [MAIN ] EMR: Fetched primary data is valid. [2025-09-17T18:47:14.371992] [DEBUG] [LOCAL ] EMR: Saving primary data. [2025-09-17T18:47:14.373593] [DEBUG] [LOCAL ] EMR: Trimmed 76938 records to 53262 (keeping 200 days of data) [2025-09-17T18:47:14.723351] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T18:47:14.748377] [DEBUG] [LOCAL ] EMR: Primary data saved (53262 records). [2025-09-17T18:47:14.748503] [INFO ] [MAIN ] EMR: Full history saved. [2025-09-17T18:47:14.749661] [INFO ] [MAIN ] Update Progress: 736/2371 symbols completed. EMR took 51.6s. Estimated remaining: 3h 58m 10s. Rate: 6.9 symbols/min [2025-09-17T18:47:14.823763] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-08. [2025-09-17T18:47:14.831191] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T18:47:14.927335] [INFO ] [MAIN ] ENOV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:47:14.971403] [DEBUG] [LOCAL ] ENOV: Loaded 45347 existing records from primary storage. [2025-09-17T18:47:14.971569] [INFO ] [MAIN ] ENOV: Loaded 45347 existing records. [2025-09-17T18:47:15.148062] [WARN ] [MAIN ] ENOV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:47:15.148281] [INFO ] [MAIN ] ENOV: Wiping existing primary data before full refresh. [2025-09-17T18:47:15.148332] [INFO ] [LOCAL ] ENOV: Starting deletion of primary data. [2025-09-17T18:47:15.149169] [DEBUG] [LOCAL ] ENOV: Deleted primary data file. [2025-09-17T18:47:15.149221] [INFO ] [MAIN ] ENOV: Starting full primary refresh. [2025-09-17T18:47:15.505048] [INFO ] [REMOTE ] ENOV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:47:15.615750] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-11. [2025-09-17T18:47:16.145331] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T18:47:16.415814] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-06. [2025-09-17T18:47:17.156119] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T18:47:17.215802] [INFO ] [REMOTE ] ENO: Fetching primary data for 2024-12. [2025-09-17T18:47:17.686332] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T18:47:17.807068] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T18:47:18.015784] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-07. [2025-09-17T18:47:18.815804] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-01. [2025-09-17T18:47:19.308719] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T18:47:19.615810] [INFO ] [REMOTE ] ENIC: Fetching primary data for 2025-09. [2025-09-17T18:47:20.026953] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T18:47:20.415804] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-02. [2025-09-17T18:47:20.739452] [INFO ] [REMOTE ] ENIC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T18:47:20.744256] [INFO ] [REMOTE ] ENIC: Full fetch complete (51122 records). [2025-09-17T18:47:20.744377] [DEBUG] [VALIDATOR ] ENIC: Validating primary data. [2025-09-17T18:47:21.133286] [DEBUG] [VALIDATOR ] ENIC: All expected trading days are present. [2025-09-17T18:47:21.133425] [DEBUG] [VALIDATOR ] ENIC: Primary data validation passed. [2025-09-17T18:47:21.134151] [INFO ] [MAIN ] ENIC: Fetched primary data is valid. [2025-09-17T18:47:21.134208] [DEBUG] [LOCAL ] ENIC: Saving primary data. [2025-09-17T18:47:21.135446] [DEBUG] [LOCAL ] ENIC: Trimmed 51122 records to 36947 (keeping 200 days of data) [2025-09-17T18:47:21.198271] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T18:47:21.225623] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-03. [2025-09-17T18:47:21.359176] [DEBUG] [LOCAL ] ENIC: Primary data saved (36947 records). [2025-09-17T18:47:21.359336] [INFO ] [MAIN ] ENIC: Full history saved. [2025-09-17T18:47:21.359424] [INFO ] [MAIN ] Update Progress: 737/2371 symbols completed. ENIC took 29.9s. Estimated remaining: 3h 57m 57s. Rate: 6.9 symbols/min [2025-09-17T18:47:21.530381] [INFO ] [MAIN ] ENR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:47:21.572069] [DEBUG] [LOCAL ] ENR: Loaded 42493 existing records from primary storage. [2025-09-17T18:47:21.572230] [INFO ] [MAIN ] ENR: Loaded 42493 existing records. [2025-09-17T18:47:21.727945] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T18:47:21.764494] [WARN ] [MAIN ] ENR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:47:21.764801] [INFO ] [MAIN ] ENR: Wiping existing primary data before full refresh. [2025-09-17T18:47:21.764853] [INFO ] [LOCAL ] ENR: Starting deletion of primary data. [2025-09-17T18:47:21.765819] [DEBUG] [LOCAL ] ENR: Deleted primary data file. [2025-09-17T18:47:21.765881] [INFO ] [MAIN ] ENR: Starting full primary refresh. [2025-09-17T18:47:22.021022] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2024-12. [2025-09-17T18:47:22.159911] [INFO ] [REMOTE ] ENR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:47:22.815813] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-08. [2025-09-17T18:47:23.543758] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T18:47:23.615786] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-04. [2025-09-17T18:47:24.229610] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T18:47:24.415772] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-05. [2025-09-17T18:47:24.570357] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T18:47:24.845033] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T18:47:25.215786] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-06. [2025-09-17T18:47:25.717526] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-17T18:47:26.015785] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-11. [2025-09-17T18:47:26.815819] [INFO ] [REMOTE ] ENB: Fetching primary data for 2025-09. [2025-09-17T18:47:27.535428] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T18:47:27.615813] [INFO ] [REMOTE ] ENR: Fetching primary data for 2024-12. [2025-09-17T18:47:28.415749] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-01. [2025-09-17T18:47:28.522595] [INFO ] [REMOTE ] ENB: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T18:47:28.529976] [INFO ] [REMOTE ] ENB: Full fetch complete (77355 records). [2025-09-17T18:47:28.530147] [DEBUG] [VALIDATOR ] ENB: Validating primary data. [2025-09-17T18:47:28.925913] [DEBUG] [VALIDATOR ] ENB: All expected trading days are present. [2025-09-17T18:47:28.926022] [DEBUG] [VALIDATOR ] ENB: Primary data validation passed. [2025-09-17T18:47:28.926961] [INFO ] [MAIN ] ENB: Fetched primary data is valid. [2025-09-17T18:47:28.927044] [DEBUG] [LOCAL ] ENB: Saving primary data. [2025-09-17T18:47:28.928778] [DEBUG] [LOCAL ] ENB: Trimmed 77355 records to 53527 (keeping 200 days of data) [2025-09-17T18:47:29.047429] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T18:47:29.247472] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-01. [2025-09-17T18:47:29.297979] [DEBUG] [LOCAL ] ENB: Primary data saved (53527 records). [2025-09-17T18:47:29.298132] [INFO ] [MAIN ] ENB: Full history saved. [2025-09-17T18:47:29.298878] [INFO ] [MAIN ] Update Progress: 738/2371 symbols completed. ENB took 49.6s. Estimated remaining: 3h 57m 46s. Rate: 6.9 symbols/min [2025-09-17T18:47:29.471042] [INFO ] [MAIN ] ENS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:47:29.503719] [DEBUG] [LOCAL ] ENS: Loaded 29286 existing records from primary storage. [2025-09-17T18:47:29.503863] [INFO ] [MAIN ] ENS: Loaded 29286 existing records. [2025-09-17T18:47:29.681659] [WARN ] [MAIN ] ENS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:47:29.681896] [INFO ] [MAIN ] ENS: Wiping existing primary data before full refresh. [2025-09-17T18:47:29.681943] [INFO ] [LOCAL ] ENS: Starting deletion of primary data. [2025-09-17T18:47:29.682722] [DEBUG] [LOCAL ] ENS: Deleted primary data file. [2025-09-17T18:47:29.682772] [INFO ] [MAIN ] ENS: Starting full primary refresh. [2025-09-17T18:47:30.067768] [INFO ] [REMOTE ] ENS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:47:30.064766] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-07. [2025-09-17T18:47:30.092892] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T18:47:30.525731] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T18:47:30.599391] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T18:47:30.815791] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-02. [2025-09-17T18:47:31.615779] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-08. [2025-09-17T18:47:32.063520] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T18:47:32.388705] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T18:47:32.415753] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-03. [2025-09-17T18:47:33.215799] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-11. [2025-09-17T18:47:33.862295] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T18:47:34.015788] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-04. [2025-09-17T18:47:34.357189] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T18:47:34.815784] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-02. [2025-09-17T18:47:35.617920] [INFO ] [REMOTE ] ENO: Fetching primary data for 2025-09. [2025-09-17T18:47:35.620226] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T18:47:36.079393] [INFO ] [REMOTE ] ENO: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T18:47:36.080276] [INFO ] [REMOTE ] ENO: Full fetch complete (3244 records). [2025-09-17T18:47:36.080346] [DEBUG] [VALIDATOR ] ENO: Validating primary data. [2025-09-17T18:47:36.419521] [INFO ] [REMOTE ] ENS: Fetching primary data for 2024-12. [2025-09-17T18:47:36.451600] [DEBUG] [VALIDATOR ] ENO: All expected trading days are present. [2025-09-17T18:47:36.451817] [DEBUG] [VALIDATOR ] ENO: Primary data validation passed. [2025-09-17T18:47:36.452036] [INFO ] [MAIN ] ENO: Fetched primary data is valid. [2025-09-17T18:47:36.452136] [DEBUG] [LOCAL ] ENO: Saving primary data. [2025-09-17T18:47:36.452956] [DEBUG] [LOCAL ] ENO: Trimmed 3244 records to 2000 (keeping 200 days of data) [2025-09-17T18:47:36.466955] [DEBUG] [LOCAL ] ENO: Primary data saved (2000 records). [2025-09-17T18:47:36.467450] [INFO ] [MAIN ] ENO: Full history saved. [2025-09-17T18:47:36.467794] [INFO ] [MAIN ] Update Progress: 739/2371 symbols completed. ENO took 25.6s. Estimated remaining: 3h 57m 34s. Rate: 6.9 symbols/min [2025-09-17T18:47:36.594148] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T18:47:36.670358] [INFO ] [MAIN ] ENVA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:47:36.696466] [DEBUG] [LOCAL ] ENVA: Loaded 25610 existing records from primary storage. [2025-09-17T18:47:36.696601] [INFO ] [MAIN ] ENVA: Loaded 25610 existing records. [2025-09-17T18:47:36.872900] [WARN ] [MAIN ] ENVA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:47:36.873171] [INFO ] [MAIN ] ENVA: Wiping existing primary data before full refresh. [2025-09-17T18:47:36.873215] [INFO ] [LOCAL ] ENVA: Starting deletion of primary data. [2025-09-17T18:47:36.874027] [DEBUG] [LOCAL ] ENVA: Deleted primary data file. [2025-09-17T18:47:36.874082] [INFO ] [MAIN ] ENVA: Starting full primary refresh. [2025-09-17T18:47:37.234477] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-03. [2025-09-17T18:47:37.239137] [INFO ] [REMOTE ] ENVA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:47:37.759697] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T18:47:38.015818] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-05. [2025-09-17T18:47:38.793355] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T18:47:38.815738] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-04. [2025-09-17T18:47:39.300108] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T18:47:39.615796] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-06. [2025-09-17T18:47:40.415770] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-11. [2025-09-17T18:47:40.445713] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T18:47:41.175349] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T18:47:41.215732] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-07. [2025-09-17T18:47:41.239558] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T18:47:42.015773] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2024-12. [2025-09-17T18:47:42.815827] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-05. [2025-09-17T18:47:42.952270] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T18:47:43.118298] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T18:47:43.615818] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-01. [2025-09-17T18:47:44.423544] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-08. [2025-09-17T18:47:44.446443] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T18:47:44.698415] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T18:47:45.215780] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-06. [2025-09-17T18:47:46.015775] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-01. [2025-09-17T18:47:46.061466] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T18:47:46.820947] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-02. [2025-09-17T18:47:46.833264] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T18:47:47.180893] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T18:47:47.615786] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-07. [2025-09-17T18:47:47.841918] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T18:47:48.415829] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-03. [2025-09-17T18:47:49.215743] [INFO ] [REMOTE ] ENR: Fetching primary data for 2025-09. [2025-09-17T18:47:49.344805] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T18:47:49.614312] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T18:47:50.015786] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-04. [2025-09-17T18:47:50.454491] [INFO ] [REMOTE ] ENR: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T18:47:50.460058] [INFO ] [REMOTE ] ENR: Full fetch complete (57777 records). [2025-09-17T18:47:50.460156] [DEBUG] [VALIDATOR ] ENR: Validating primary data. [2025-09-17T18:47:50.826107] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-08. [2025-09-17T18:47:50.845614] [DEBUG] [VALIDATOR ] ENR: All expected trading days are present. [2025-09-17T18:47:50.845711] [DEBUG] [VALIDATOR ] ENR: Primary data validation passed. [2025-09-17T18:47:50.846444] [INFO ] [MAIN ] ENR: Fetched primary data is valid. [2025-09-17T18:47:50.846569] [DEBUG] [LOCAL ] ENR: Saving primary data. [2025-09-17T18:47:50.847928] [DEBUG] [LOCAL ] ENR: Trimmed 57777 records to 42554 (keeping 200 days of data) [2025-09-17T18:47:50.985824] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T18:47:51.144235] [DEBUG] [LOCAL ] ENR: Primary data saved (42554 records). [2025-09-17T18:47:51.144381] [INFO ] [MAIN ] ENR: Full history saved. [2025-09-17T18:47:51.144503] [INFO ] [MAIN ] Update Progress: 740/2371 symbols completed. ENR took 29.8s. Estimated remaining: 3h 57m 39s. Rate: 6.9 symbols/min [2025-09-17T18:47:51.314294] [INFO ] [MAIN ] EOD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:47:51.328890] [DEBUG] [LOCAL ] EOD: Loaded 14172 existing records from primary storage. [2025-09-17T18:47:51.329020] [INFO ] [MAIN ] EOD: Loaded 14172 existing records. [2025-09-17T18:47:51.508089] [WARN ] [MAIN ] EOD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:47:51.508332] [INFO ] [MAIN ] EOD: Wiping existing primary data before full refresh. [2025-09-17T18:47:51.508377] [INFO ] [LOCAL ] EOD: Starting deletion of primary data. [2025-09-17T18:47:51.508796] [DEBUG] [LOCAL ] EOD: Deleted primary data file. [2025-09-17T18:47:51.508843] [INFO ] [MAIN ] EOD: Starting full primary refresh. [2025-09-17T18:47:51.620948] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-05. [2025-09-17T18:47:51.883310] [INFO ] [REMOTE ] EOD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:47:52.415765] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-02. [2025-09-17T18:47:52.513751] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T18:47:52.774093] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T18:47:53.215842] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-11. [2025-09-17T18:47:53.720837] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T18:47:53.769112] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T18:47:54.015793] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-06. [2025-09-17T18:47:54.815783] [INFO ] [REMOTE ] ENOV: Fetching primary data for 2025-09. [2025-09-17T18:47:55.056371] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T18:47:55.615794] [INFO ] [REMOTE ] EOD: Fetching primary data for 2024-12. [2025-09-17T18:47:56.178943] [INFO ] [REMOTE ] ENOV: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T18:47:56.186715] [INFO ] [REMOTE ] ENOV: Full fetch complete (62829 records). [2025-09-17T18:47:56.186881] [DEBUG] [VALIDATOR ] ENOV: Validating primary data. [2025-09-17T18:47:56.304712] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T18:47:56.425173] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-01. [2025-09-17T18:47:56.593017] [DEBUG] [VALIDATOR ] ENOV: All expected trading days are present. [2025-09-17T18:47:56.593109] [DEBUG] [VALIDATOR ] ENOV: Primary data validation passed. [2025-09-17T18:47:56.593922] [INFO ] [MAIN ] ENOV: Fetched primary data is valid. [2025-09-17T18:47:56.593972] [DEBUG] [LOCAL ] ENOV: Saving primary data. [2025-09-17T18:47:56.595430] [DEBUG] [LOCAL ] ENOV: Trimmed 62829 records to 45339 (keeping 200 days of data) [2025-09-17T18:47:56.874777] [DEBUG] [LOCAL ] ENOV: Primary data saved (45339 records). [2025-09-17T18:47:56.874913] [INFO ] [MAIN ] ENOV: Full history saved. [2025-09-17T18:47:56.875000] [INFO ] [MAIN ] Update Progress: 741/2371 symbols completed. ENOV took 42.1s. Estimated remaining: 3h 57m 23s. Rate: 6.9 symbols/min [2025-09-17T18:47:57.048724] [INFO ] [MAIN ] EOG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:47:57.107827] [DEBUG] [LOCAL ] EOG: Loaded 53343 existing records from primary storage. [2025-09-17T18:47:57.107973] [INFO ] [MAIN ] EOG: Loaded 53343 existing records. [2025-09-17T18:47:57.220843] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-07. [2025-09-17T18:47:57.290222] [WARN ] [MAIN ] EOG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:47:57.290515] [INFO ] [MAIN ] EOG: Wiping existing primary data before full refresh. [2025-09-17T18:47:57.290563] [INFO ] [LOCAL ] EOG: Starting deletion of primary data. [2025-09-17T18:47:57.291718] [DEBUG] [LOCAL ] EOG: Deleted primary data file. [2025-09-17T18:47:57.291770] [INFO ] [MAIN ] EOG: Starting full primary refresh. [2025-09-17T18:47:57.606993] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T18:47:57.671999] [INFO ] [REMOTE ] EOG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:47:58.015811] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-11. [2025-09-17T18:47:58.545131] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T18:47:58.815775] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-02. [2025-09-17T18:47:59.615393] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T18:47:59.617995] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-08. [2025-09-17T18:47:59.776910] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T18:48:00.415739] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-03. [2025-09-17T18:48:00.697285] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T18:48:01.215802] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-03. [2025-09-17T18:48:01.253260] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T18:48:02.015811] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-04. [2025-09-17T18:48:02.815825] [INFO ] [REMOTE ] ENVA: Fetching primary data for 2025-09. [2025-09-17T18:48:02.995128] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T18:48:03.615857] [INFO ] [REMOTE ] EOG: Fetching primary data for 2024-12. [2025-09-17T18:48:03.959837] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T18:48:04.415772] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-05. [2025-09-17T18:48:05.100037] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T18:48:05.215789] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-06. [2025-09-17T18:48:05.742372] [INFO ] [REMOTE ] ENVA: Incremental fetch complete for 2025-09 (2.93 seconds). [2025-09-17T18:48:05.746287] [INFO ] [REMOTE ] ENVA: Full fetch complete (36302 records). [2025-09-17T18:48:05.746399] [DEBUG] [VALIDATOR ] ENVA: Validating primary data. [2025-09-17T18:48:06.021704] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-04. [2025-09-17T18:48:06.124050] [DEBUG] [VALIDATOR ] ENVA: All expected trading days are present. [2025-09-17T18:48:06.124159] [DEBUG] [VALIDATOR ] ENVA: Primary data validation passed. [2025-09-17T18:48:06.124765] [INFO ] [MAIN ] ENVA: Fetched primary data is valid. [2025-09-17T18:48:06.124855] [DEBUG] [LOCAL ] ENVA: Saving primary data. [2025-09-17T18:48:06.125777] [DEBUG] [LOCAL ] ENVA: Trimmed 36302 records to 25745 (keeping 200 days of data) [2025-09-17T18:48:06.226011] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T18:48:06.276391] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-17T18:48:06.335472] [DEBUG] [LOCAL ] ENVA: Primary data saved (25745 records). [2025-09-17T18:48:06.335608] [INFO ] [MAIN ] ENVA: Full history saved. [2025-09-17T18:48:06.335709] [INFO ] [MAIN ] Update Progress: 742/2371 symbols completed. ENVA took 29.9s. Estimated remaining: 3h 57m 16s. Rate: 6.9 symbols/min [2025-09-17T18:48:06.502960] [INFO ] [MAIN ] EOI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:48:06.514319] [DEBUG] [LOCAL ] EOI: Loaded 10634 existing records from primary storage. [2025-09-17T18:48:06.514431] [INFO ] [MAIN ] EOI: Loaded 10634 existing records. [2025-09-17T18:48:06.692545] [WARN ] [MAIN ] EOI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:48:06.692787] [INFO ] [MAIN ] EOI: Wiping existing primary data before full refresh. [2025-09-17T18:48:06.692833] [INFO ] [LOCAL ] EOI: Starting deletion of primary data. [2025-09-17T18:48:06.693185] [DEBUG] [LOCAL ] EOI: Deleted primary data file. [2025-09-17T18:48:06.693229] [INFO ] [MAIN ] EOI: Starting full primary refresh. [2025-09-17T18:48:06.820864] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-07. [2025-09-17T18:48:07.052823] [INFO ] [REMOTE ] EOI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:48:07.446886] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T18:48:07.615772] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-05. [2025-09-17T18:48:08.042968] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T18:48:08.415772] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-01. [2025-09-17T18:48:08.735473] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T18:48:09.215943] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-11. [2025-09-17T18:48:09.879827] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T18:48:10.015774] [INFO ] [REMOTE ] EOI: Fetching primary data for 2024-12. [2025-09-17T18:48:10.168301] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T18:48:10.815768] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-08. [2025-09-17T18:48:10.840982] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T18:48:11.615829] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-01. [2025-09-17T18:48:11.760343] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T18:48:12.415763] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-02. [2025-09-17T18:48:12.443106] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T18:48:13.215789] [INFO ] [REMOTE ] EOD: Fetching primary data for 2025-09. [2025-09-17T18:48:14.015686] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-06. [2025-09-17T18:48:14.321145] [INFO ] [REMOTE ] EOD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T18:48:14.323714] [INFO ] [REMOTE ] EOD: Full fetch complete (19661 records). [2025-09-17T18:48:14.323842] [DEBUG] [VALIDATOR ] EOD: Validating primary data. [2025-09-17T18:48:14.462249] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-17T18:48:14.755622] [DEBUG] [VALIDATOR ] EOD: All expected trading days are present. [2025-09-17T18:48:14.755731] [DEBUG] [VALIDATOR ] EOD: Primary data validation passed. [2025-09-17T18:48:14.756152] [INFO ] [MAIN ] EOD: Fetched primary data is valid. [2025-09-17T18:48:14.756194] [DEBUG] [LOCAL ] EOD: Saving primary data. [2025-09-17T18:48:14.757013] [DEBUG] [LOCAL ] EOD: Trimmed 19661 records to 14181 (keeping 200 days of data) [2025-09-17T18:48:14.818361] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-03. [2025-09-17T18:48:14.845419] [DEBUG] [LOCAL ] EOD: Primary data saved (14181 records). [2025-09-17T18:48:14.845573] [INFO ] [MAIN ] EOD: Full history saved. [2025-09-17T18:48:14.845682] [INFO ] [MAIN ] Update Progress: 743/2371 symbols completed. EOD took 23.7s. Estimated remaining: 3h 57m 7s. Rate: 6.9 symbols/min [2025-09-17T18:48:15.016600] [INFO ] [MAIN ] EOS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:48:15.032965] [DEBUG] [LOCAL ] EOS: Loaded 15587 existing records from primary storage. [2025-09-17T18:48:15.033099] [INFO ] [MAIN ] EOS: Loaded 15587 existing records. [2025-09-17T18:48:15.214574] [WARN ] [MAIN ] EOS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:48:15.214879] [INFO ] [MAIN ] EOS: Wiping existing primary data before full refresh. [2025-09-17T18:48:15.214939] [INFO ] [LOCAL ] EOS: Starting deletion of primary data. [2025-09-17T18:48:15.215737] [DEBUG] [LOCAL ] EOS: Deleted primary data file. [2025-09-17T18:48:15.215813] [INFO ] [MAIN ] EOS: Starting full primary refresh. [2025-09-17T18:48:15.575588] [INFO ] [REMOTE ] EOS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:48:15.615739] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-11. [2025-09-17T18:48:16.423891] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-02. [2025-09-17T18:48:16.428359] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-17T18:48:17.215810] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-07. [2025-09-17T18:48:17.310299] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T18:48:17.597015] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T18:48:18.015749] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-03. [2025-09-17T18:48:18.321759] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-03 (3.50 seconds). [2025-09-17T18:48:18.517128] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T18:48:18.815759] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-08. [2025-09-17T18:48:18.851038] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T18:48:19.615796] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-04. [2025-09-17T18:48:19.830012] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T18:48:20.415825] [INFO ] [REMOTE ] EOS: Fetching primary data for 2024-12. [2025-09-17T18:48:20.531957] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T18:48:21.215859] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-04. [2025-09-17T18:48:21.443501] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T18:48:22.015837] [INFO ] [REMOTE ] ENS: Fetching primary data for 2025-09. [2025-09-17T18:48:22.815837] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-01. [2025-09-17T18:48:23.019485] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T18:48:23.090737] [INFO ] [REMOTE ] ENS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T18:48:23.095185] [INFO ] [REMOTE ] ENS: Full fetch complete (41535 records). [2025-09-17T18:48:23.095321] [DEBUG] [VALIDATOR ] ENS: Validating primary data. [2025-09-17T18:48:23.480124] [DEBUG] [VALIDATOR ] ENS: All expected trading days are present. [2025-09-17T18:48:23.480313] [DEBUG] [VALIDATOR ] ENS: Primary data validation passed. [2025-09-17T18:48:23.481196] [INFO ] [MAIN ] ENS: Fetched primary data is valid. [2025-09-17T18:48:23.481274] [DEBUG] [LOCAL ] ENS: Saving primary data. [2025-09-17T18:48:23.493406] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T18:48:23.497413] [DEBUG] [LOCAL ] ENS: Trimmed 41535 records to 29302 (keeping 200 days of data) [2025-09-17T18:48:23.616111] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-05. [2025-09-17T18:48:23.697169] [DEBUG] [LOCAL ] ENS: Primary data saved (29302 records). [2025-09-17T18:48:23.697329] [INFO ] [MAIN ] ENS: Full history saved. [2025-09-17T18:48:23.697420] [INFO ] [MAIN ] Update Progress: 744/2371 symbols completed. ENS took 54.4s. Estimated remaining: 3h 56m 58s. Rate: 6.9 symbols/min [2025-09-17T18:48:23.887722] [INFO ] [MAIN ] EOT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:48:23.897846] [DEBUG] [LOCAL ] EOT: Loaded 6764 existing records from primary storage. [2025-09-17T18:48:23.897991] [INFO ] [MAIN ] EOT: Loaded 6764 existing records. [2025-09-17T18:48:24.103183] [WARN ] [MAIN ] EOT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:48:24.103462] [INFO ] [MAIN ] EOT: Wiping existing primary data before full refresh. [2025-09-17T18:48:24.103536] [INFO ] [LOCAL ] EOT: Starting deletion of primary data. [2025-09-17T18:48:24.103882] [DEBUG] [LOCAL ] EOT: Deleted primary data file. [2025-09-17T18:48:24.103949] [INFO ] [MAIN ] EOT: Starting full primary refresh. [2025-09-17T18:48:24.428532] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-02. [2025-09-17T18:48:24.468369] [INFO ] [REMOTE ] EOT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:48:24.478096] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T18:48:25.215778] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-06. [2025-09-17T18:48:25.466865] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T18:48:26.015795] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-03. [2025-09-17T18:48:26.072759] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T18:48:26.815771] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-11. [2025-09-17T18:48:26.831706] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T18:48:27.539391] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T18:48:27.615767] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-05. [2025-09-17T18:48:28.415799] [INFO ] [REMOTE ] EOT: Fetching primary data for 2024-12. [2025-09-17T18:48:29.208539] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T18:48:29.215679] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-01. [2025-09-17T18:48:29.525776] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T18:48:29.940963] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T18:48:30.015782] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-06. [2025-09-17T18:48:30.815772] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-07. [2025-09-17T18:48:31.554898] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T18:48:31.615732] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-08. [2025-09-17T18:48:31.917571] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T18:48:32.417920] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-04. [2025-09-17T18:48:32.418908] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T18:48:33.215751] [INFO ] [REMOTE ] EOI: Fetching primary data for 2025-09. [2025-09-17T18:48:33.579856] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T18:48:33.799515] [INFO ] [REMOTE ] EOI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T18:48:33.801309] [INFO ] [REMOTE ] EOI: Full fetch complete (15967 records). [2025-09-17T18:48:33.801379] [DEBUG] [VALIDATOR ] EOI: Validating primary data. [2025-09-17T18:48:34.020936] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-05. [2025-09-17T18:48:34.167233] [DEBUG] [VALIDATOR ] EOI: All expected trading days are present. [2025-09-17T18:48:34.167320] [DEBUG] [VALIDATOR ] EOI: Primary data validation passed. [2025-09-17T18:48:34.167695] [INFO ] [MAIN ] EOI: Fetched primary data is valid. [2025-09-17T18:48:34.167738] [DEBUG] [LOCAL ] EOI: Saving primary data. [2025-09-17T18:48:34.168381] [DEBUG] [LOCAL ] EOI: Trimmed 15967 records to 10674 (keeping 200 days of data) [2025-09-17T18:48:34.238165] [DEBUG] [LOCAL ] EOI: Primary data saved (10674 records). [2025-09-17T18:48:34.238316] [INFO ] [MAIN ] EOI: Full history saved. [2025-09-17T18:48:34.238437] [INFO ] [MAIN ] Update Progress: 745/2371 symbols completed. EOI took 27.9s. Estimated remaining: 3h 56m 54s. Rate: 6.9 symbols/min [2025-09-17T18:48:34.412631] [INFO ] [MAIN ] EPAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:48:34.439559] [DEBUG] [LOCAL ] EPAC: Loaded 26910 existing records from primary storage. [2025-09-17T18:48:34.439737] [INFO ] [MAIN ] EPAC: Loaded 26910 existing records. [2025-09-17T18:48:34.620325] [WARN ] [MAIN ] EPAC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:48:34.620555] [INFO ] [MAIN ] EPAC: Wiping existing primary data before full refresh. [2025-09-17T18:48:34.620601] [INFO ] [LOCAL ] EPAC: Starting deletion of primary data. [2025-09-17T18:48:34.621256] [DEBUG] [LOCAL ] EPAC: Deleted primary data file. [2025-09-17T18:48:34.621307] [INFO ] [MAIN ] EPAC: Starting full primary refresh. [2025-09-17T18:48:34.822965] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-07. [2025-09-17T18:48:34.987013] [INFO ] [REMOTE ] EPAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:48:34.996278] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T18:48:35.615835] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-06. [2025-09-17T18:48:36.415869] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-02. [2025-09-17T18:48:36.540626] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T18:48:36.780006] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T18:48:37.215817] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-08. [2025-09-17T18:48:37.239842] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T18:48:38.015853] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-07. [2025-09-17T18:48:38.815801] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-03. [2025-09-17T18:48:39.036419] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T18:48:39.063634] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T18:48:39.479714] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T18:48:39.615806] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-11. [2025-09-17T18:48:40.415814] [INFO ] [REMOTE ] EOG: Fetching primary data for 2025-09. [2025-09-17T18:48:40.560781] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T18:48:41.215764] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2024-12. [2025-09-17T18:48:41.917186] [INFO ] [REMOTE ] EOG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T18:48:41.924042] [INFO ] [REMOTE ] EOG: Full fetch complete (77109 records). [2025-09-17T18:48:41.924232] [DEBUG] [VALIDATOR ] EOG: Validating primary data. [2025-09-17T18:48:42.020835] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-04. [2025-09-17T18:48:42.320289] [DEBUG] [VALIDATOR ] EOG: All expected trading days are present. [2025-09-17T18:48:42.320368] [DEBUG] [VALIDATOR ] EOG: Primary data validation passed. [2025-09-17T18:48:42.321220] [INFO ] [MAIN ] EOG: Fetched primary data is valid. [2025-09-17T18:48:42.321294] [DEBUG] [LOCAL ] EOG: Saving primary data. [2025-09-17T18:48:42.322757] [DEBUG] [LOCAL ] EOG: Trimmed 77109 records to 53342 (keeping 200 days of data) [2025-09-17T18:48:42.453631] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T18:48:42.581317] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T18:48:42.704163] [DEBUG] [LOCAL ] EOG: Primary data saved (53342 records). [2025-09-17T18:48:42.704535] [INFO ] [MAIN ] EOG: Full history saved. [2025-09-17T18:48:42.705813] [INFO ] [MAIN ] Update Progress: 746/2371 symbols completed. EOG took 45.8s. Estimated remaining: 3h 56m 44s. Rate: 6.9 symbols/min [2025-09-17T18:48:42.820870] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-08. [2025-09-17T18:48:42.877437] [INFO ] [MAIN ] EPAM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:48:42.917902] [DEBUG] [LOCAL ] EPAM: Loaded 39770 existing records from primary storage. [2025-09-17T18:48:42.918045] [INFO ] [MAIN ] EPAM: Loaded 39770 existing records. [2025-09-17T18:48:43.094209] [WARN ] [MAIN ] EPAM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:48:43.094463] [INFO ] [MAIN ] EPAM: Wiping existing primary data before full refresh. [2025-09-17T18:48:43.094550] [INFO ] [LOCAL ] EPAM: Starting deletion of primary data. [2025-09-17T18:48:43.095459] [DEBUG] [LOCAL ] EPAM: Deleted primary data file. [2025-09-17T18:48:43.095517] [INFO ] [MAIN ] EPAM: Starting full primary refresh. [2025-09-17T18:48:43.456638] [INFO ] [REMOTE ] EPAM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:48:43.615778] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-11. [2025-09-17T18:48:43.760310] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T18:48:44.415792] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-01. [2025-09-17T18:48:45.001832] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T18:48:45.215816] [INFO ] [REMOTE ] EOS: Fetching primary data for 2025-09. [2025-09-17T18:48:45.257390] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T18:48:46.015785] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-02. [2025-09-17T18:48:46.188533] [INFO ] [REMOTE ] EOS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T18:48:46.191079] [INFO ] [REMOTE ] EOS: Full fetch complete (23055 records). [2025-09-17T18:48:46.191174] [DEBUG] [VALIDATOR ] EOS: Validating primary data. [2025-09-17T18:48:46.562528] [DEBUG] [VALIDATOR ] EOS: All expected trading days are present. [2025-09-17T18:48:46.562613] [DEBUG] [VALIDATOR ] EOS: Primary data validation passed. [2025-09-17T18:48:46.563093] [INFO ] [MAIN ] EOS: Fetched primary data is valid. [2025-09-17T18:48:46.563136] [DEBUG] [LOCAL ] EOS: Saving primary data. [2025-09-17T18:48:46.564352] [DEBUG] [LOCAL ] EOS: Trimmed 23055 records to 15560 (keeping 200 days of data) [2025-09-17T18:48:46.669210] [DEBUG] [LOCAL ] EOS: Primary data saved (15560 records). [2025-09-17T18:48:46.669394] [INFO ] [MAIN ] EOS: Full history saved. [2025-09-17T18:48:46.669495] [INFO ] [MAIN ] Update Progress: 747/2371 symbols completed. EOS took 31.8s. Estimated remaining: 3h 56m 25s. Rate: 6.9 symbols/min [2025-09-17T18:48:46.823017] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2024-12. [2025-09-17T18:48:46.841409] [INFO ] [MAIN ] EPC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:48:46.886986] [DEBUG] [LOCAL ] EPC: Loaded 39929 existing records from primary storage. [2025-09-17T18:48:46.887515] [INFO ] [MAIN ] EPC: Loaded 39929 existing records. [2025-09-17T18:48:47.072715] [WARN ] [MAIN ] EPC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:48:47.073029] [INFO ] [MAIN ] EPC: Wiping existing primary data before full refresh. [2025-09-17T18:48:47.073078] [INFO ] [LOCAL ] EPC: Starting deletion of primary data. [2025-09-17T18:48:47.074365] [DEBUG] [LOCAL ] EPC: Deleted primary data file. [2025-09-17T18:48:47.074420] [INFO ] [MAIN ] EPC: Starting full primary refresh. [2025-09-17T18:48:47.408730] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T18:48:47.476300] [INFO ] [REMOTE ] EPC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:48:47.615839] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-11. [2025-09-17T18:48:48.300619] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T18:48:48.415726] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-01. [2025-09-17T18:48:48.678099] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T18:48:49.215778] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-03. [2025-09-17T18:48:49.953733] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T18:48:50.015771] [INFO ] [REMOTE ] EPC: Fetching primary data for 2024-12. [2025-09-17T18:48:50.485072] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T18:48:50.815797] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-02. [2025-09-17T18:48:51.537788] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T18:48:51.615847] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-01. [2025-09-17T18:48:52.308743] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T18:48:52.415816] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-03. [2025-09-17T18:48:52.987005] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T18:48:53.215763] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-05. [2025-09-17T18:48:53.825027] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T18:48:54.015795] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-04. [2025-09-17T18:48:54.251508] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T18:48:54.815764] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-02. [2025-09-17T18:48:55.290201] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T18:48:55.615801] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-04. [2025-09-17T18:48:55.999608] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T18:48:56.415834] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-05. [2025-09-17T18:48:57.215782] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-03. [2025-09-17T18:48:57.370871] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T18:48:57.482357] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T18:48:58.015813] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-05. [2025-09-17T18:48:58.456187] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T18:48:58.815815] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-06. [2025-09-17T18:48:59.615819] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-04. [2025-09-17T18:48:59.725041] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T18:48:59.933839] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T18:49:00.415795] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-06. [2025-09-17T18:49:01.215778] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-07. [2025-09-17T18:49:01.277264] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T18:49:01.965469] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T18:49:02.015825] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-05. [2025-09-17T18:49:02.597404] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T18:49:02.815794] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-08. [2025-09-17T18:49:03.209039] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T18:49:03.615735] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-06. [2025-09-17T18:49:04.021574] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T18:49:04.415780] [INFO ] [REMOTE ] EPAC: Fetching primary data for 2025-09. [2025-09-17T18:49:05.117607] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T18:49:05.198479] [INFO ] [REMOTE ] EPAC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T18:49:05.202589] [INFO ] [REMOTE ] EPAC: Full fetch complete (38834 records). [2025-09-17T18:49:05.202694] [DEBUG] [VALIDATOR ] EPAC: Validating primary data. [2025-09-17T18:49:05.223490] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-07. [2025-09-17T18:49:05.583477] [DEBUG] [VALIDATOR ] EPAC: All expected trading days are present. [2025-09-17T18:49:05.583558] [DEBUG] [VALIDATOR ] EPAC: Primary data validation passed. [2025-09-17T18:49:05.584214] [INFO ] [MAIN ] EPAC: Fetched primary data is valid. [2025-09-17T18:49:05.584262] [DEBUG] [LOCAL ] EPAC: Saving primary data. [2025-09-17T18:49:05.586062] [DEBUG] [LOCAL ] EPAC: Trimmed 38834 records to 26971 (keeping 200 days of data) [2025-09-17T18:49:05.753401] [DEBUG] [LOCAL ] EPAC: Primary data saved (26971 records). [2025-09-17T18:49:05.753537] [INFO ] [MAIN ] EPAC: Full history saved. [2025-09-17T18:49:05.753621] [INFO ] [MAIN ] Update Progress: 748/2371 symbols completed. EPAC took 31.5s. Estimated remaining: 3h 56m 39s. Rate: 6.9 symbols/min [2025-09-17T18:49:05.932241] [INFO ] [MAIN ] EPD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:49:05.981508] [DEBUG] [LOCAL ] EPD: Loaded 53616 existing records from primary storage. [2025-09-17T18:49:05.981666] [INFO ] [MAIN ] EPD: Loaded 53616 existing records. [2025-09-17T18:49:06.024289] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-06. [2025-09-17T18:49:06.167975] [WARN ] [MAIN ] EPD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:49:06.168236] [INFO ] [MAIN ] EPD: Wiping existing primary data before full refresh. [2025-09-17T18:49:06.168293] [INFO ] [LOCAL ] EPD: Starting deletion of primary data. [2025-09-17T18:49:06.169527] [DEBUG] [LOCAL ] EPD: Deleted primary data file. [2025-09-17T18:49:06.169586] [INFO ] [MAIN ] EPD: Starting full primary refresh. [2025-09-17T18:49:06.527086] [INFO ] [REMOTE ] EPD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:49:06.806696] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T18:49:06.816087] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-07. [2025-09-17T18:49:06.820190] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T18:49:07.615770] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-08. [2025-09-17T18:49:08.392943] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T18:49:08.415776] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-11. [2025-09-17T18:49:08.888451] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T18:49:09.215772] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-07. [2025-09-17T18:49:09.987341] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T18:49:10.015743] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-08. [2025-09-17T18:49:10.304210] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T18:49:10.720165] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T18:49:10.815744] [INFO ] [REMOTE ] EPD: Fetching primary data for 2024-12. [2025-09-17T18:49:11.615770] [INFO ] [REMOTE ] EPAM: Fetching primary data for 2025-09. [2025-09-17T18:49:12.415757] [INFO ] [REMOTE ] EOT: Fetching primary data for 2025-09. [2025-09-17T18:49:12.701609] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T18:49:13.026911] [INFO ] [REMOTE ] EPAM: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T18:49:13.032460] [INFO ] [REMOTE ] EPAM: Full fetch complete (55781 records). [2025-09-17T18:49:13.032571] [DEBUG] [VALIDATOR ] EPAM: Validating primary data. [2025-09-17T18:49:13.215766] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-01. [2025-09-17T18:49:13.244538] [INFO ] [REMOTE ] EOT: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T18:49:13.327080] [INFO ] [REMOTE ] EOT: Full fetch complete (10892 records). [2025-09-17T18:49:13.356316] [DEBUG] [VALIDATOR ] EOT: Validating primary data. [2025-09-17T18:49:13.741569] [DEBUG] [VALIDATOR ] EPAM: All expected trading days are present. [2025-09-17T18:49:13.780566] [DEBUG] [VALIDATOR ] EPAM: Primary data validation passed. [2025-09-17T18:49:13.815387] [INFO ] [MAIN ] EPAM: Fetched primary data is valid. [2025-09-17T18:49:13.824622] [DEBUG] [LOCAL ] EPAM: Saving primary data. [2025-09-17T18:49:13.881599] [DEBUG] [LOCAL ] EPAM: Trimmed 55781 records to 39739 (keeping 200 days of data) [2025-09-17T18:49:14.058872] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-08. [2025-09-17T18:49:14.264869] [DEBUG] [VALIDATOR ] EOT: All expected trading days are present. [2025-09-17T18:49:14.265035] [DEBUG] [VALIDATOR ] EOT: Primary data validation passed. [2025-09-17T18:49:14.265786] [INFO ] [MAIN ] EOT: Fetched primary data is valid. [2025-09-17T18:49:14.265874] [DEBUG] [LOCAL ] EOT: Saving primary data. [2025-09-17T18:49:14.275133] [DEBUG] [LOCAL ] EOT: Trimmed 10892 records to 6861 (keeping 200 days of data) [2025-09-17T18:49:14.454629] [DEBUG] [LOCAL ] EOT: Primary data saved (6861 records). [2025-09-17T18:49:14.455973] [INFO ] [MAIN ] EOT: Full history saved. [2025-09-17T18:49:14.456125] [INFO ] [MAIN ] Update Progress: 749/2371 symbols completed. EOT took 50.8s. Estimated remaining: 3h 56m 30s. Rate: 6.9 symbols/min [2025-09-17T18:49:14.683132] [INFO ] [MAIN ] EPR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:49:14.683300] [DEBUG] [LOCAL ] EPAM: Primary data saved (39739 records). [2025-09-17T18:49:14.683756] [INFO ] [MAIN ] EPAM: Full history saved. [2025-09-17T18:49:14.684011] [INFO ] [MAIN ] Update Progress: 750/2371 symbols completed. EPAM took 32.0s. Estimated remaining: 3h 56m 3s. Rate: 6.9 symbols/min [2025-09-17T18:49:14.872392] [INFO ] [MAIN ] EPRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:49:14.908425] [DEBUG] [LOCAL ] EPR: Loaded 44485 existing records from primary storage. [2025-09-17T18:49:14.908658] [INFO ] [MAIN ] EPR: Loaded 44485 existing records. [2025-09-17T18:49:15.118692] [WARN ] [MAIN ] EPR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:49:15.136971] [INFO ] [MAIN ] EPR: Wiping existing primary data before full refresh. [2025-09-17T18:49:15.138423] [DEBUG] [LOCAL ] EPRT: Loaded 48707 existing records from primary storage. [2025-09-17T18:49:15.137150] [INFO ] [LOCAL ] EPR: Starting deletion of primary data. [2025-09-17T18:49:15.138730] [INFO ] [MAIN ] EPRT: Loaded 48707 existing records. [2025-09-17T18:49:15.144000] [DEBUG] [LOCAL ] EPR: Deleted primary data file. [2025-09-17T18:49:15.178207] [INFO ] [MAIN ] EPR: Starting full primary refresh. [2025-09-17T18:49:15.448347] [WARN ] [MAIN ] EPRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:49:15.454411] [INFO ] [MAIN ] EPRT: Wiping existing primary data before full refresh. [2025-09-17T18:49:15.469955] [INFO ] [LOCAL ] EPRT: Starting deletion of primary data. [2025-09-17T18:49:15.500984] [DEBUG] [LOCAL ] EPRT: Deleted primary data file. [2025-09-17T18:49:15.539147] [INFO ] [MAIN ] EPRT: Starting full primary refresh. [2025-09-17T18:49:15.873741] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-09-17T18:49:16.086498] [INFO ] [REMOTE ] EPR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:49:16.097846] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-02. [2025-09-17T18:49:16.108843] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-11. [2025-09-17T18:49:16.212182] [INFO ] [REMOTE ] EPRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:49:16.236340] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T18:49:16.415790] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-11. [2025-09-17T18:49:17.215923] [INFO ] [REMOTE ] EPC: Fetching primary data for 2025-09. [2025-09-17T18:49:17.500247] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T18:49:17.619088] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T18:49:18.054217] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-03. [2025-09-17T18:49:18.074182] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T18:49:18.285200] [INFO ] [REMOTE ] EPC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T18:49:18.290708] [INFO ] [REMOTE ] EPC: Full fetch complete (56509 records). [2025-09-17T18:49:18.290844] [DEBUG] [VALIDATOR ] EPC: Validating primary data. [2025-09-17T18:49:18.686508] [DEBUG] [VALIDATOR ] EPC: All expected trading days are present. [2025-09-17T18:49:18.686592] [DEBUG] [VALIDATOR ] EPC: Primary data validation passed. [2025-09-17T18:49:18.687300] [INFO ] [MAIN ] EPC: Fetched primary data is valid. [2025-09-17T18:49:18.687344] [DEBUG] [LOCAL ] EPC: Saving primary data. [2025-09-17T18:49:18.688467] [DEBUG] [LOCAL ] EPC: Trimmed 56509 records to 39929 (keeping 200 days of data) [2025-09-17T18:49:18.815790] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2024-12. [2025-09-17T18:49:18.943156] [DEBUG] [LOCAL ] EPC: Primary data saved (39929 records). [2025-09-17T18:49:18.943308] [INFO ] [MAIN ] EPC: Full history saved. [2025-09-17T18:49:18.943394] [INFO ] [MAIN ] Update Progress: 751/2371 symbols completed. EPC took 32.3s. Estimated remaining: 3h 55m 44s. Rate: 6.9 symbols/min [2025-09-17T18:49:19.122257] [INFO ] [MAIN ] EQBK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:49:19.134024] [DEBUG] [LOCAL ] EQBK: Loaded 10852 existing records from primary storage. [2025-09-17T18:49:19.134151] [INFO ] [MAIN ] EQBK: Loaded 10852 existing records. [2025-09-17T18:49:19.312982] [WARN ] [MAIN ] EQBK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:49:19.313213] [INFO ] [MAIN ] EQBK: Wiping existing primary data before full refresh. [2025-09-17T18:49:19.313258] [INFO ] [LOCAL ] EQBK: Starting deletion of primary data. [2025-09-17T18:49:19.313606] [DEBUG] [LOCAL ] EQBK: Deleted primary data file. [2025-09-17T18:49:19.313691] [INFO ] [MAIN ] EQBK: Starting full primary refresh. [2025-09-17T18:49:19.618292] [INFO ] [REMOTE ] EPR: Fetching primary data for 2024-12. [2025-09-17T18:49:19.725254] [INFO ] [REMOTE ] EQBK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:49:19.848775] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T18:49:20.416802] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-04. [2025-09-17T18:49:20.625404] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T18:49:21.153888] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T18:49:21.215734] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-01. [2025-09-17T18:49:22.015777] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-11. [2025-09-17T18:49:22.706317] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-17T18:49:22.774159] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T18:49:22.791866] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T18:49:22.815776] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-02. [2025-09-17T18:49:23.615797] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-01. [2025-09-17T18:49:24.304719] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T18:49:24.415786] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-03. [2025-09-17T18:49:25.105911] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T18:49:25.215728] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-02. [2025-09-17T18:49:26.015798] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2024-12. [2025-09-17T18:49:26.107308] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T18:49:26.736773] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T18:49:26.753164] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T18:49:26.815740] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-03. [2025-09-17T18:49:27.615816] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-01. [2025-09-17T18:49:28.380879] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T18:49:28.415694] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-05. [2025-09-17T18:49:28.482402] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T18:49:29.215838] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-02. [2025-09-17T18:49:30.015842] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-04. [2025-09-17T18:49:30.029149] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T18:49:30.392546] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T18:49:30.815840] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-03. [2025-09-17T18:49:31.437743] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T18:49:31.615790] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-04. [2025-09-17T18:49:31.796017] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T18:49:32.183222] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T18:49:32.415945] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-06. [2025-09-17T18:49:33.215782] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-04. [2025-09-17T18:49:33.947684] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T18:49:34.015766] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-05. [2025-09-17T18:49:34.430856] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T18:49:34.815814] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-07. [2025-09-17T18:49:35.601859] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T18:49:35.615725] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-06. [2025-09-17T18:49:36.415828] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-05. [2025-09-17T18:49:36.772187] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T18:49:37.221371] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-05. [2025-09-17T18:49:37.225667] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T18:49:38.007369] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T18:49:38.020777] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-06. [2025-09-17T18:49:38.036166] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T18:49:38.783474] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T18:49:38.815774] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-08. [2025-09-17T18:49:39.615828] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-07. [2025-09-17T18:49:40.415840] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-06. [2025-09-17T18:49:40.725179] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T18:49:40.848567] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T18:49:41.215793] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-08. [2025-09-17T18:49:41.938895] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T18:49:42.015826] [INFO ] [REMOTE ] EPD: Fetching primary data for 2025-09. [2025-09-17T18:49:42.780581] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T18:49:42.815806] [INFO ] [REMOTE ] EPRT: Fetching primary data for 2025-09. [2025-09-17T18:49:43.615825] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-07. [2025-09-17T18:49:44.150375] [INFO ] [REMOTE ] EPD: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-17T18:49:44.157501] [INFO ] [REMOTE ] EPD: Full fetch complete (77533 records). [2025-09-17T18:49:44.157699] [DEBUG] [VALIDATOR ] EPD: Validating primary data. [2025-09-17T18:49:44.425425] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-07. [2025-09-17T18:49:44.577199] [DEBUG] [VALIDATOR ] EPD: All expected trading days are present. [2025-09-17T18:49:44.578089] [DEBUG] [VALIDATOR ] EPD: Primary data validation passed. [2025-09-17T18:49:44.579875] [INFO ] [MAIN ] EPD: Fetched primary data is valid. [2025-09-17T18:49:44.579953] [DEBUG] [LOCAL ] EPD: Saving primary data. [2025-09-17T18:49:44.578781] [INFO ] [REMOTE ] EPRT: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T18:49:44.586901] [INFO ] [REMOTE ] EPRT: Full fetch complete (68417 records). [2025-09-17T18:49:44.587142] [DEBUG] [VALIDATOR ] EPRT: Validating primary data. [2025-09-17T18:49:44.601244] [DEBUG] [LOCAL ] EPD: Trimmed 77533 records to 53616 (keeping 200 days of data) [2025-09-17T18:49:44.608588] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T18:49:45.126166] [DEBUG] [VALIDATOR ] EPRT: All expected trading days are present. [2025-09-17T18:49:45.130485] [DEBUG] [VALIDATOR ] EPRT: Primary data validation passed. [2025-09-17T18:49:45.131781] [INFO ] [MAIN ] EPRT: Fetched primary data is valid. [2025-09-17T18:49:45.185857] [DEBUG] [LOCAL ] EPRT: Saving primary data. [2025-09-17T18:49:45.221450] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-08. [2025-09-17T18:49:45.241297] [DEBUG] [LOCAL ] EPRT: Trimmed 68417 records to 48708 (keeping 200 days of data) [2025-09-17T18:49:45.456834] [DEBUG] [LOCAL ] EPD: Primary data saved (53616 records). [2025-09-17T18:49:45.458063] [INFO ] [MAIN ] EPD: Full history saved. [2025-09-17T18:49:45.458416] [INFO ] [MAIN ] Update Progress: 752/2371 symbols completed. EPD took 39.7s. Estimated remaining: 3h 56m 14s. Rate: 6.9 symbols/min [2025-09-17T18:49:45.721842] [INFO ] [MAIN ] EQH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:49:45.843486] [DEBUG] [LOCAL ] EPRT: Primary data saved (48708 records). [2025-09-17T18:49:45.843414] [DEBUG] [LOCAL ] EQH: Loaded 52657 existing records from primary storage. [2025-09-17T18:49:45.843721] [INFO ] [MAIN ] EPRT: Full history saved. [2025-09-17T18:49:45.843673] [INFO ] [MAIN ] EQH: Loaded 52657 existing records. [2025-09-17T18:49:45.875355] [INFO ] [MAIN ] Update Progress: 753/2371 symbols completed. EPRT took 31.2s. Estimated remaining: 3h 55m 47s. Rate: 6.9 symbols/min [2025-09-17T18:49:46.194155] [INFO ] [MAIN ] EQNR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:49:46.190732] [WARN ] [MAIN ] EQH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:49:46.195105] [INFO ] [MAIN ] EQH: Wiping existing primary data before full refresh. [2025-09-17T18:49:46.195293] [INFO ] [LOCAL ] EQH: Starting deletion of primary data. [2025-09-17T18:49:46.201799] [DEBUG] [LOCAL ] EQH: Deleted primary data file. [2025-09-17T18:49:46.203825] [INFO ] [MAIN ] EQH: Starting full primary refresh. [2025-09-17T18:49:46.204159] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T18:49:46.218860] [INFO ] [REMOTE ] EQBK: Fetching primary data for 2025-09. [2025-09-17T18:49:46.569512] [DEBUG] [LOCAL ] EQNR: Loaded 53054 existing records from primary storage. [2025-09-17T18:49:46.602703] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T18:49:46.608551] [INFO ] [MAIN ] EQNR: Loaded 53054 existing records. [2025-09-17T18:49:46.627957] [INFO ] [REMOTE ] EQH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:49:46.815839] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-11. [2025-09-17T18:49:46.815783] [WARN ] [MAIN ] EQNR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:49:46.816822] [INFO ] [MAIN ] EQNR: Wiping existing primary data before full refresh. [2025-09-17T18:49:46.816867] [INFO ] [LOCAL ] EQNR: Starting deletion of primary data. [2025-09-17T18:49:46.818174] [DEBUG] [LOCAL ] EQNR: Deleted primary data file. [2025-09-17T18:49:46.818225] [INFO ] [MAIN ] EQNR: Starting full primary refresh. [2025-09-17T18:49:47.171766] [INFO ] [REMOTE ] EQNR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:49:47.217792] [INFO ] [REMOTE ] EQBK: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T18:49:47.219804] [INFO ] [REMOTE ] EQBK: Full fetch complete (15395 records). [2025-09-17T18:49:47.219891] [DEBUG] [VALIDATOR ] EQBK: Validating primary data. [2025-09-17T18:49:47.593607] [DEBUG] [VALIDATOR ] EQBK: All expected trading days are present. [2025-09-17T18:49:47.593719] [DEBUG] [VALIDATOR ] EQBK: Primary data validation passed. [2025-09-17T18:49:47.594029] [INFO ] [MAIN ] EQBK: Fetched primary data is valid. [2025-09-17T18:49:47.594067] [DEBUG] [LOCAL ] EQBK: Saving primary data. [2025-09-17T18:49:47.594549] [DEBUG] [LOCAL ] EQBK: Trimmed 15395 records to 10882 (keeping 200 days of data) [2025-09-17T18:49:47.622875] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-11. [2025-09-17T18:49:47.662243] [DEBUG] [LOCAL ] EQBK: Primary data saved (10882 records). [2025-09-17T18:49:47.662341] [INFO ] [MAIN ] EQBK: Full history saved. [2025-09-17T18:49:47.662419] [INFO ] [MAIN ] Update Progress: 754/2371 symbols completed. EQBK took 28.7s. Estimated remaining: 3h 55m 24s. Rate: 6.9 symbols/min [2025-09-17T18:49:47.839236] [INFO ] [MAIN ] EQR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:49:47.892019] [DEBUG] [LOCAL ] EQR: Loaded 51365 existing records from primary storage. [2025-09-17T18:49:47.892191] [INFO ] [MAIN ] EQR: Loaded 51365 existing records. [2025-09-17T18:49:48.077591] [WARN ] [MAIN ] EQR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:49:48.077826] [INFO ] [MAIN ] EQR: Wiping existing primary data before full refresh. [2025-09-17T18:49:48.077882] [INFO ] [LOCAL ] EQR: Starting deletion of primary data. [2025-09-17T18:49:48.078794] [DEBUG] [LOCAL ] EQR: Deleted primary data file. [2025-09-17T18:49:48.078849] [INFO ] [MAIN ] EQR: Starting full primary refresh. [2025-09-17T18:49:48.422039] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-08. [2025-09-17T18:49:48.450572] [INFO ] [REMOTE ] EQR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:49:48.480568] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T18:49:49.215761] [INFO ] [REMOTE ] EQH: Fetching primary data for 2024-12. [2025-09-17T18:49:49.467859] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T18:49:50.015795] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2024-12. [2025-09-17T18:49:50.162722] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T18:49:50.629541] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T18:49:50.815811] [INFO ] [REMOTE ] EPR: Fetching primary data for 2025-09. [2025-09-17T18:49:51.493300] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T18:49:51.615775] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-01. [2025-09-17T18:49:52.415825] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-11. [2025-09-17T18:49:52.497821] [INFO ] [REMOTE ] EPR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T18:49:52.504513] [INFO ] [REMOTE ] EPR: Full fetch complete (62708 records). [2025-09-17T18:49:52.504671] [DEBUG] [VALIDATOR ] EPR: Validating primary data. [2025-09-17T18:49:52.909003] [DEBUG] [VALIDATOR ] EPR: All expected trading days are present. [2025-09-17T18:49:52.909133] [DEBUG] [VALIDATOR ] EPR: Primary data validation passed. [2025-09-17T18:49:52.909973] [INFO ] [MAIN ] EPR: Fetched primary data is valid. [2025-09-17T18:49:52.910095] [DEBUG] [LOCAL ] EPR: Saving primary data. [2025-09-17T18:49:52.911623] [DEBUG] [LOCAL ] EPR: Trimmed 62708 records to 44439 (keeping 200 days of data) [2025-09-17T18:49:53.047588] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T18:49:53.226209] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-02. [2025-09-17T18:49:53.243990] [DEBUG] [LOCAL ] EPR: Primary data saved (44439 records). [2025-09-17T18:49:53.244093] [INFO ] [MAIN ] EPR: Full history saved. [2025-09-17T18:49:53.244987] [INFO ] [MAIN ] Update Progress: 755/2371 symbols completed. EPR took 38.8s. Estimated remaining: 3h 55m 8s. Rate: 6.9 symbols/min [2025-09-17T18:49:53.415096] [INFO ] [MAIN ] EQS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:49:53.415264] [DEBUG] [LOCAL ] EQS: No existing data file found in primary storage. [2025-09-17T18:49:53.415301] [WARN ] [MAIN ] EQS: No existing data found, performing full refresh instead. [2025-09-17T18:49:53.415440] [INFO ] [MAIN ] EQS: Wiping existing primary data before full refresh. [2025-09-17T18:49:53.415478] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-17T18:49:53.415518] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-17T18:49:53.415550] [INFO ] [MAIN ] EQS: Starting full primary refresh. [2025-09-17T18:49:53.773961] [INFO ] [REMOTE ] EQS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:49:54.015746] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-11. [2025-09-17T18:49:54.083077] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T18:49:54.334307] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-17T18:49:54.815781] [INFO ] [REMOTE ] EQR: Fetching primary data for 2024-12. [2025-09-17T18:49:54.978940] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T18:49:55.615777] [INFO ] [REMOTE ] EQS: Fetching primary data for 2024-12. [2025-09-17T18:49:55.974078] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T18:49:56.322757] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T18:49:56.415759] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-03. [2025-09-17T18:49:57.215776] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-01. [2025-09-17T18:49:58.015784] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-01. [2025-09-17T18:49:58.246877] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T18:49:58.681898] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T18:49:58.815779] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-02. [2025-09-17T18:49:59.615832] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-01. [2025-09-17T18:49:59.832097] [DEBUG] [REMOTE ] EQS: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T18:49:59.832408] [WARN ] [REMOTE ] EQS: No data returned for month 2025-01 [2025-09-17T18:49:59.891941] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T18:49:59.980915] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T18:50:00.415836] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-02. [2025-09-17T18:50:01.215866] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-04. [2025-09-17T18:50:01.924556] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T18:50:02.015812] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-03. [2025-09-17T18:50:02.815755] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-03. [2025-09-17T18:50:03.212004] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T18:50:03.475008] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T18:50:03.615721] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-05. [2025-09-17T18:50:04.415805] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-02. [2025-09-17T18:50:04.738047] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T18:50:04.786233] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-17T18:50:05.046257] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T18:50:05.215900] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-03. [2025-09-17T18:50:05.598679] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-03 (0.38 seconds). [2025-09-17T18:50:06.015803] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-04. [2025-09-17T18:50:06.815830] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-04. [2025-09-17T18:50:07.170623] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-17T18:50:07.615929] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-05. [2025-09-17T18:50:07.895727] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T18:50:07.917975] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-05 (0.30 seconds). [2025-09-17T18:50:08.415817] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-06. [2025-09-17T18:50:08.689451] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-06 (0.27 seconds). [2025-09-17T18:50:09.215785] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-05. [2025-09-17T18:50:10.015804] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-07. [2025-09-17T18:50:10.452899] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T18:50:10.815772] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-08. [2025-09-17T18:50:11.070071] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T18:50:11.267783] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T18:50:11.615777] [INFO ] [REMOTE ] EQS: Fetching primary data for 2025-09. [2025-09-17T18:50:12.193984] [INFO ] [REMOTE ] EQS: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T18:50:12.195211] [INFO ] [REMOTE ] EQS: Full fetch complete (2303 records). [2025-09-17T18:50:12.195292] [DEBUG] [VALIDATOR ] EQS: Validating primary data. [2025-09-17T18:50:12.376515] [WARN ] [VALIDATOR ] EQS: Validation failed - insufficient historical data. Have 169 unique days, need 200 days [2025-09-17T18:50:12.376763] [FATAL] [MAIN ] EQS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:50:12.376806] [WARN ] [MAIN ] EQS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:50:12.376844] [INFO ] [LOCAL ] EQS: Starting deletion of primary data. [2025-09-17T18:50:12.376923] [DEBUG] [LOCAL ] EQS: No primary data file found to delete. [2025-09-17T18:50:12.376960] [INFO ] [LOCAL ] EQS: Starting deletion of derivative data. [2025-09-17T18:50:12.377005] [DEBUG] [LOCAL ] EQS: No derivative data file found to delete. [2025-09-17T18:50:12.377070] [INFO ] [MAIN ] Update Progress: 756/2371 symbols completed. EQS took 19.1s. Estimated remaining: 3h 55m 22s. Rate: 6.9 symbols/min [2025-09-17T18:50:12.420887] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-06. [2025-09-17T18:50:12.577420] [INFO ] [MAIN ] EQT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:50:12.638448] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-17T18:50:12.638686] [INFO ] [MAIN ] EQT: Loaded 53682 existing records. [2025-09-17T18:50:12.831954] [WARN ] [MAIN ] EQT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:50:12.832199] [INFO ] [MAIN ] EQT: Wiping existing primary data before full refresh. [2025-09-17T18:50:12.832256] [INFO ] [LOCAL ] EQT: Starting deletion of primary data. [2025-09-17T18:50:12.833292] [DEBUG] [LOCAL ] EQT: Deleted primary data file. [2025-09-17T18:50:12.833347] [INFO ] [MAIN ] EQT: Starting full primary refresh. [2025-09-17T18:50:13.215121] [INFO ] [REMOTE ] EQT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:50:13.215728] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-11. [2025-09-17T18:50:14.015787] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-06. [2025-09-17T18:50:14.350163] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T18:50:14.815768] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-07. [2025-09-17T18:50:15.073210] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T18:50:15.499593] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T18:50:15.615803] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-07. [2025-09-17T18:50:16.415817] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-04. [2025-09-17T18:50:16.611495] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T18:50:17.215920] [INFO ] [REMOTE ] EQT: Fetching primary data for 2024-12. [2025-09-17T18:50:17.334361] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T18:50:17.725541] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T18:50:18.015792] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-08. [2025-09-17T18:50:18.815826] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-05. [2025-09-17T18:50:18.959728] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T18:50:19.616045] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-01. [2025-09-17T18:50:19.822221] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T18:50:20.372160] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T18:50:20.415766] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-06. [2025-09-17T18:50:21.215806] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-08. [2025-09-17T18:50:22.015902] [INFO ] [REMOTE ] EQNR: Fetching primary data for 2025-09. [2025-09-17T18:50:22.158783] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T18:50:22.238490] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-17T18:50:22.815868] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-07. [2025-09-17T18:50:23.055879] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T18:50:23.615702] [INFO ] [REMOTE ] EQH: Fetching primary data for 2025-09. [2025-09-17T18:50:23.694412] [INFO ] [REMOTE ] EQNR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T18:50:23.701603] [INFO ] [REMOTE ] EQNR: Full fetch complete (76585 records). [2025-09-17T18:50:23.701823] [DEBUG] [VALIDATOR ] EQNR: Validating primary data. [2025-09-17T18:50:24.095184] [DEBUG] [VALIDATOR ] EQNR: All expected trading days are present. [2025-09-17T18:50:24.095277] [DEBUG] [VALIDATOR ] EQNR: Primary data validation passed. [2025-09-17T18:50:24.096154] [INFO ] [MAIN ] EQNR: Fetched primary data is valid. [2025-09-17T18:50:24.096220] [DEBUG] [LOCAL ] EQNR: Saving primary data. [2025-09-17T18:50:24.097746] [DEBUG] [LOCAL ] EQNR: Trimmed 76585 records to 53049 (keeping 200 days of data) [2025-09-17T18:50:24.425559] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-02. [2025-09-17T18:50:24.453163] [DEBUG] [LOCAL ] EQNR: Primary data saved (53049 records). [2025-09-17T18:50:24.453322] [INFO ] [MAIN ] EQNR: Full history saved. [2025-09-17T18:50:24.453428] [INFO ] [MAIN ] Update Progress: 757/2371 symbols completed. EQNR took 38.5s. Estimated remaining: 3h 55m 20s. Rate: 6.9 symbols/min [2025-09-17T18:50:24.649183] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T18:50:25.219432] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-08. [2025-09-17T18:50:25.224173] [INFO ] [REMOTE ] EQH: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T18:50:25.231229] [INFO ] [REMOTE ] EQH: Full fetch complete (76117 records). [2025-09-17T18:50:25.231337] [DEBUG] [VALIDATOR ] EQH: Validating primary data. [2025-09-17T18:50:25.630803] [DEBUG] [VALIDATOR ] EQH: All expected trading days are present. [2025-09-17T18:50:25.630903] [DEBUG] [VALIDATOR ] EQH: Primary data validation passed. [2025-09-17T18:50:25.631780] [INFO ] [MAIN ] EQH: Fetched primary data is valid. [2025-09-17T18:50:25.631826] [DEBUG] [LOCAL ] EQH: Saving primary data. [2025-09-17T18:50:25.633296] [DEBUG] [LOCAL ] EQH: Trimmed 76117 records to 52667 (keeping 200 days of data) [2025-09-17T18:50:25.958734] [DEBUG] [LOCAL ] EQH: Primary data saved (52667 records). [2025-09-17T18:50:25.958865] [INFO ] [MAIN ] EQH: Full history saved. [2025-09-17T18:50:25.958948] [INFO ] [MAIN ] Update Progress: 758/2371 symbols completed. EQH took 40.5s. Estimated remaining: 3h 54m 56s. Rate: 6.9 symbols/min [2025-09-17T18:50:26.365369] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T18:50:26.375856] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-03. [2025-09-17T18:50:27.000895] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T18:50:27.013328] [INFO ] [REMOTE ] EQR: Fetching primary data for 2025-09. [2025-09-17T18:50:28.096971] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T18:50:28.108202] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-04. [2025-09-17T18:50:28.281242] [INFO ] [REMOTE ] EQR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T18:50:28.288918] [INFO ] [REMOTE ] EQR: Full fetch complete (73480 records). [2025-09-17T18:50:28.289098] [DEBUG] [VALIDATOR ] EQR: Validating primary data. [2025-09-17T18:50:28.694729] [DEBUG] [VALIDATOR ] EQR: All expected trading days are present. [2025-09-17T18:50:28.694808] [DEBUG] [VALIDATOR ] EQR: Primary data validation passed. [2025-09-17T18:50:28.695636] [INFO ] [MAIN ] EQR: Fetched primary data is valid. [2025-09-17T18:50:28.695745] [DEBUG] [LOCAL ] EQR: Saving primary data. [2025-09-17T18:50:28.697125] [DEBUG] [LOCAL ] EQR: Trimmed 73480 records to 51365 (keeping 200 days of data) [2025-09-17T18:50:29.025249] [DEBUG] [LOCAL ] EQR: Primary data saved (51365 records). [2025-09-17T18:50:29.025387] [INFO ] [MAIN ] EQR: Full history saved. [2025-09-17T18:50:29.025480] [INFO ] [MAIN ] Update Progress: 759/2371 symbols completed. EQR took 41.4s. Estimated remaining: 3h 54m 35s. Rate: 6.9 symbols/min [2025-09-17T18:50:30.103626] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T18:50:30.115370] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-05. [2025-09-17T18:50:32.003904] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T18:50:32.019191] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-06. [2025-09-17T18:50:33.886216] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T18:50:33.896991] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-07. [2025-09-17T18:50:35.971904] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T18:50:35.983880] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-08. [2025-09-17T18:50:38.025654] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T18:50:38.037355] [INFO ] [REMOTE ] EQT: Fetching primary data for 2025-09. [2025-09-17T18:50:39.603864] [INFO ] [REMOTE ] EQT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T18:50:39.610942] [INFO ] [REMOTE ] EQT: Full fetch complete (77542 records). [2025-09-17T18:50:39.611124] [DEBUG] [VALIDATOR ] EQT: Validating primary data. [2025-09-17T18:50:40.013142] [DEBUG] [VALIDATOR ] EQT: All expected trading days are present. [2025-09-17T18:50:40.013250] [DEBUG] [VALIDATOR ] EQT: Primary data validation passed. [2025-09-17T18:50:40.014208] [INFO ] [MAIN ] EQT: Fetched primary data is valid. [2025-09-17T18:50:40.014266] [DEBUG] [LOCAL ] EQT: Saving primary data. [2025-09-17T18:50:40.015950] [DEBUG] [LOCAL ] EQT: Trimmed 77542 records to 53682 (keeping 200 days of data) [2025-09-17T18:50:40.355821] [DEBUG] [LOCAL ] EQT: Primary data saved (53682 records). [2025-09-17T18:50:40.355974] [INFO ] [MAIN ] EQT: Full history saved. [2025-09-17T18:50:40.357277] [INFO ] [MAIN ] Update Progress: 760/2371 symbols completed. EQT took 28.0s. Estimated remaining: 3h 54m 32s. Rate: 6.9 symbols/min [2025-09-17T18:50:41.031767] [INFO ] [MAIN ] EQV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:50:41.022871] [INFO ] [MAIN ] ES: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:50:41.057052] [INFO ] [MAIN ] ERO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:50:41.076591] [INFO ] [MAIN ] ERJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:50:41.079877] [DEBUG] [LOCAL ] EQV: Loaded 2934 existing records from primary storage. [2025-09-17T18:50:41.080071] [INFO ] [MAIN ] EQV: Loaded 2934 existing records. [2025-09-17T18:50:41.300627] [WARN ] [MAIN ] EQV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:50:41.301032] [INFO ] [MAIN ] EQV: Wiping existing primary data before full refresh. [2025-09-17T18:50:41.301079] [INFO ] [LOCAL ] EQV: Starting deletion of primary data. [2025-09-17T18:50:41.301336] [DEBUG] [LOCAL ] EQV: Deleted primary data file. [2025-09-17T18:50:41.301379] [INFO ] [MAIN ] EQV: Starting full primary refresh. [2025-09-17T18:50:41.446579] [DEBUG] [LOCAL ] ERO: Loaded 41171 existing records from primary storage. [2025-09-17T18:50:41.462782] [DEBUG] [LOCAL ] ERJ: Loaded 51018 existing records from primary storage. [2025-09-17T18:50:41.487356] [INFO ] [MAIN ] ERJ: Loaded 51018 existing records. [2025-09-17T18:50:41.473760] [DEBUG] [LOCAL ] ES: Loaded 52512 existing records from primary storage. [2025-09-17T18:50:41.451944] [INFO ] [MAIN ] ERO: Loaded 41171 existing records. [2025-09-17T18:50:41.511355] [INFO ] [MAIN ] ES: Loaded 52512 existing records. [2025-09-17T18:50:42.179850] [INFO ] [REMOTE ] EQV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:50:42.174386] [WARN ] [MAIN ] ERO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:50:42.242466] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-11. [2025-09-17T18:50:42.260167] [INFO ] [MAIN ] ERO: Wiping existing primary data before full refresh. [2025-09-17T18:50:42.265324] [WARN ] [MAIN ] ES: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:50:42.265562] [INFO ] [LOCAL ] ERO: Starting deletion of primary data. [2025-09-17T18:50:42.242100] [WARN ] [MAIN ] ERJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:50:42.265861] [INFO ] [MAIN ] ES: Wiping existing primary data before full refresh. [2025-09-17T18:50:42.265974] [INFO ] [MAIN ] ERJ: Wiping existing primary data before full refresh. [2025-09-17T18:50:42.266056] [INFO ] [LOCAL ] ES: Starting deletion of primary data. [2025-09-17T18:50:42.266100] [INFO ] [LOCAL ] ERJ: Starting deletion of primary data. [2025-09-17T18:50:42.266707] [DEBUG] [LOCAL ] ERO: Deleted primary data file. [2025-09-17T18:50:42.266774] [INFO ] [MAIN ] ERO: Starting full primary refresh. [2025-09-17T18:50:42.278389] [DEBUG] [LOCAL ] ERJ: Deleted primary data file. [2025-09-17T18:50:42.278575] [INFO ] [MAIN ] ERJ: Starting full primary refresh. [2025-09-17T18:50:42.278445] [DEBUG] [LOCAL ] ES: Deleted primary data file. [2025-09-17T18:50:42.301893] [INFO ] [MAIN ] ES: Starting full primary refresh. [2025-09-17T18:50:42.757015] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T18:50:42.815669] [INFO ] [REMOTE ] EQV: Fetching primary data for 2024-12. [2025-09-17T18:50:43.286116] [INFO ] [REMOTE ] ERJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:50:43.315948] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-11. [2025-09-17T18:50:43.384786] [INFO ] [REMOTE ] ERO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:50:43.412713] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-11. [2025-09-17T18:50:43.416475] [INFO ] [REMOTE ] ES: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:50:43.416895] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-11. [2025-09-17T18:50:43.721746] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T18:50:43.723855] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-01. [2025-09-17T18:50:44.550521] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T18:50:44.553325] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-02. [2025-09-17T18:50:44.699608] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T18:50:44.707670] [INFO ] [REMOTE ] ERO: Fetching primary data for 2024-12. [2025-09-17T18:50:44.833183] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T18:50:44.843273] [INFO ] [REMOTE ] ES: Fetching primary data for 2024-12. [2025-09-17T18:50:44.973666] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T18:50:44.975298] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-03. [2025-09-17T18:50:45.067946] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T18:50:45.078497] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2024-12. [2025-09-17T18:50:45.417748] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T18:50:45.419156] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-04. [2025-09-17T18:50:45.787525] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T18:50:45.796959] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-01. [2025-09-17T18:50:45.800819] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-17T18:50:45.802447] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-05. [2025-09-17T18:50:46.156990] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-17T18:50:46.158510] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-06. [2025-09-17T18:50:46.568243] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T18:50:46.579507] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-01. [2025-09-17T18:50:46.706972] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T18:50:46.719102] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-01. [2025-09-17T18:50:46.730116] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T18:50:46.731572] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-07. [2025-09-17T18:50:46.849275] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T18:50:46.857281] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-02. [2025-09-17T18:50:47.212994] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T18:50:47.615876] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-08. [2025-09-17T18:50:48.161054] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T18:50:48.318090] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T18:50:48.368535] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T18:50:48.421403] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-02. [2025-09-17T18:50:48.437716] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T18:50:49.215781] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-03. [2025-09-17T18:50:49.923020] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T18:50:50.015811] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-02. [2025-09-17T18:50:50.705223] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T18:50:50.815805] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-03. [2025-09-17T18:50:51.615702] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-04. [2025-09-17T18:50:51.722367] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T18:50:52.208692] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T18:50:52.415803] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-04. [2025-09-17T18:50:52.779069] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T18:50:53.215830] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-05. [2025-09-17T18:50:54.015810] [INFO ] [REMOTE ] EQV: Fetching primary data for 2025-09. [2025-09-17T18:50:54.271539] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T18:50:54.315797] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T18:50:54.530032] [INFO ] [REMOTE ] EQV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T18:50:54.531065] [INFO ] [REMOTE ] EQV: Full fetch complete (5711 records). [2025-09-17T18:50:54.531145] [DEBUG] [VALIDATOR ] EQV: Validating primary data. [2025-09-17T18:50:54.822020] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-05. [2025-09-17T18:50:54.908382] [DEBUG] [VALIDATOR ] EQV: All expected trading days are present. [2025-09-17T18:50:54.908465] [DEBUG] [VALIDATOR ] EQV: Primary data validation passed. [2025-09-17T18:50:54.908677] [INFO ] [MAIN ] EQV: Fetched primary data is valid. [2025-09-17T18:50:54.908734] [DEBUG] [LOCAL ] EQV: Saving primary data. [2025-09-17T18:50:54.909564] [DEBUG] [LOCAL ] EQV: Trimmed 5711 records to 2920 (keeping 200 days of data) [2025-09-17T18:50:54.928594] [DEBUG] [LOCAL ] EQV: Primary data saved (2920 records). [2025-09-17T18:50:54.928870] [INFO ] [MAIN ] EQV: Full history saved. [2025-09-17T18:50:54.929037] [INFO ] [MAIN ] Update Progress: 761/2371 symbols completed. EQV took 14.6s. Estimated remaining: 3h 54m 35s. Rate: 6.9 symbols/min [2025-09-17T18:50:55.105817] [INFO ] [MAIN ] ESAB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:50:55.134311] [DEBUG] [LOCAL ] ESAB: Loaded 25485 existing records from primary storage. [2025-09-17T18:50:55.134462] [INFO ] [MAIN ] ESAB: Loaded 25485 existing records. [2025-09-17T18:50:55.311705] [WARN ] [MAIN ] ESAB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:50:55.311953] [INFO ] [MAIN ] ESAB: Wiping existing primary data before full refresh. [2025-09-17T18:50:55.312006] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-17T18:50:55.312814] [DEBUG] [LOCAL ] ESAB: Deleted primary data file. [2025-09-17T18:50:55.312863] [INFO ] [MAIN ] ESAB: Starting full primary refresh. [2025-09-17T18:50:55.620865] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-06. [2025-09-17T18:50:55.687339] [INFO ] [REMOTE ] ESAB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:50:56.415785] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-11. [2025-09-17T18:50:56.586959] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T18:50:57.075178] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T18:50:57.215777] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-07. [2025-09-17T18:50:57.526927] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T18:50:58.015814] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-06. [2025-09-17T18:50:58.723211] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T18:50:58.815798] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2024-12. [2025-09-17T18:50:59.545957] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T18:50:59.615801] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-03. [2025-09-17T18:50:59.721568] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T18:51:00.415775] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-01. [2025-09-17T18:51:00.528082] [DEBUG] [REMOTE ] ESAB: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T18:51:00.528407] [WARN ] [REMOTE ] ESAB: No data returned for month 2025-01 [2025-09-17T18:51:01.215821] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-07. [2025-09-17T18:51:01.364149] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T18:51:02.015868] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-08. [2025-09-17T18:51:02.815798] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-02. [2025-09-17T18:51:03.615803] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-04. [2025-09-17T18:51:04.065146] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-07 (2.85 seconds). [2025-09-17T18:51:04.415785] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-08. [2025-09-17T18:51:04.532212] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-17T18:51:04.627781] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T18:51:05.039715] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T18:51:05.215781] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-05. [2025-09-17T18:51:05.988515] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T18:51:06.015763] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-03. [2025-09-17T18:51:06.815791] [INFO ] [REMOTE ] ERO: Fetching primary data for 2025-09. [2025-09-17T18:51:07.116353] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T18:51:07.615779] [INFO ] [REMOTE ] ERJ: Fetching primary data for 2025-09. [2025-09-17T18:51:08.096740] [INFO ] [REMOTE ] ERO: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T18:51:08.104366] [INFO ] [REMOTE ] ERO: Full fetch complete (58708 records). [2025-09-17T18:51:08.104529] [DEBUG] [VALIDATOR ] ERO: Validating primary data. [2025-09-17T18:51:08.425440] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-06. [2025-09-17T18:51:08.536110] [DEBUG] [VALIDATOR ] ERO: All expected trading days are present. [2025-09-17T18:51:08.536303] [DEBUG] [VALIDATOR ] ERO: Primary data validation passed. [2025-09-17T18:51:08.537588] [INFO ] [MAIN ] ERO: Fetched primary data is valid. [2025-09-17T18:51:08.537775] [DEBUG] [LOCAL ] ERO: Saving primary data. [2025-09-17T18:51:08.557520] [DEBUG] [LOCAL ] ERO: Trimmed 58708 records to 41129 (keeping 200 days of data) [2025-09-17T18:51:08.560449] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-03 (2.54 seconds). [2025-09-17T18:51:08.832908] [DEBUG] [LOCAL ] ERO: Primary data saved (41129 records). [2025-09-17T18:51:08.833051] [INFO ] [MAIN ] ERO: Full history saved. [2025-09-17T18:51:08.833141] [INFO ] [MAIN ] Update Progress: 762/2371 symbols completed. ERO took 28.5s. Estimated remaining: 3h 54m 38s. Rate: 6.9 symbols/min [2025-09-17T18:51:09.019079] [INFO ] [MAIN ] ESE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:51:09.039265] [DEBUG] [LOCAL ] ESE: Loaded 16547 existing records from primary storage. [2025-09-17T18:51:09.039410] [INFO ] [MAIN ] ESE: Loaded 16547 existing records. [2025-09-17T18:51:09.219051] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-04. [2025-09-17T18:51:09.223719] [WARN ] [MAIN ] ESE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:51:09.225374] [INFO ] [MAIN ] ESE: Wiping existing primary data before full refresh. [2025-09-17T18:51:09.225588] [INFO ] [LOCAL ] ESE: Starting deletion of primary data. [2025-09-17T18:51:09.226337] [DEBUG] [LOCAL ] ESE: Deleted primary data file. [2025-09-17T18:51:09.226421] [INFO ] [MAIN ] ESE: Starting full primary refresh. [2025-09-17T18:51:09.376130] [INFO ] [REMOTE ] ERJ: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T18:51:09.442481] [INFO ] [REMOTE ] ERJ: Full fetch complete (72080 records). [2025-09-17T18:51:09.455704] [DEBUG] [VALIDATOR ] ERJ: Validating primary data. [2025-09-17T18:51:09.887762] [INFO ] [REMOTE ] ESE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:51:10.020856] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-11. [2025-09-17T18:51:10.144584] [DEBUG] [VALIDATOR ] ERJ: All expected trading days are present. [2025-09-17T18:51:10.144842] [DEBUG] [VALIDATOR ] ERJ: Primary data validation passed. [2025-09-17T18:51:10.146033] [INFO ] [MAIN ] ERJ: Fetched primary data is valid. [2025-09-17T18:51:10.146141] [DEBUG] [LOCAL ] ERJ: Saving primary data. [2025-09-17T18:51:10.148081] [DEBUG] [LOCAL ] ERJ: Trimmed 72080 records to 50957 (keeping 200 days of data) [2025-09-17T18:51:10.272945] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T18:51:10.507516] [DEBUG] [LOCAL ] ERJ: Primary data saved (50957 records). [2025-09-17T18:51:10.507805] [INFO ] [MAIN ] ERJ: Full history saved. [2025-09-17T18:51:10.507949] [INFO ] [MAIN ] Update Progress: 763/2371 symbols completed. ERJ took 30.1s. Estimated remaining: 3h 54m 14s. Rate: 6.9 symbols/min [2025-09-17T18:51:10.618010] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T18:51:10.724427] [INFO ] [MAIN ] ESI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:51:10.781420] [DEBUG] [LOCAL ] ESI: Loaded 50857 existing records from primary storage. [2025-09-17T18:51:10.781618] [INFO ] [MAIN ] ESI: Loaded 50857 existing records. [2025-09-17T18:51:10.820887] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-07. [2025-09-17T18:51:10.976957] [WARN ] [MAIN ] ESI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:51:10.977224] [INFO ] [MAIN ] ESI: Wiping existing primary data before full refresh. [2025-09-17T18:51:10.977270] [INFO ] [LOCAL ] ESI: Starting deletion of primary data. [2025-09-17T18:51:10.978487] [DEBUG] [LOCAL ] ESI: Deleted primary data file. [2025-09-17T18:51:10.978537] [INFO ] [MAIN ] ESI: Starting full primary refresh. [2025-09-17T18:51:11.311349] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T18:51:11.372540] [INFO ] [REMOTE ] ESI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:51:11.615778] [INFO ] [REMOTE ] ESE: Fetching primary data for 2024-12. [2025-09-17T18:51:12.415785] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-05. [2025-09-17T18:51:12.485218] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T18:51:12.503023] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T18:51:13.215784] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-08. [2025-09-17T18:51:14.015783] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-01. [2025-09-17T18:51:14.270008] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T18:51:14.815761] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-06. [2025-09-17T18:51:15.310132] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T18:51:15.615751] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-02. [2025-09-17T18:51:15.874483] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T18:51:16.091632] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-08 (2.88 seconds). [2025-09-17T18:51:16.415816] [INFO ] [REMOTE ] ES: Fetching primary data for 2025-09. [2025-09-17T18:51:16.583603] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T18:51:17.215776] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-03. [2025-09-17T18:51:18.015784] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-11. [2025-09-17T18:51:18.159527] [INFO ] [REMOTE ] ES: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T18:51:18.181341] [INFO ] [REMOTE ] ES: Full fetch complete (75944 records). [2025-09-17T18:51:18.181840] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T18:51:18.182132] [DEBUG] [VALIDATOR ] ES: Validating primary data. [2025-09-17T18:51:18.599291] [DEBUG] [VALIDATOR ] ES: All expected trading days are present. [2025-09-17T18:51:18.599440] [DEBUG] [VALIDATOR ] ES: Primary data validation passed. [2025-09-17T18:51:18.600605] [INFO ] [MAIN ] ES: Fetched primary data is valid. [2025-09-17T18:51:18.600704] [DEBUG] [LOCAL ] ES: Saving primary data. [2025-09-17T18:51:18.603065] [DEBUG] [LOCAL ] ES: Trimmed 75944 records to 52516 (keeping 200 days of data) [2025-09-17T18:51:18.824718] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-04. [2025-09-17T18:51:18.944362] [DEBUG] [LOCAL ] ES: Primary data saved (52516 records). [2025-09-17T18:51:18.944527] [INFO ] [MAIN ] ES: Full history saved. [2025-09-17T18:51:18.945611] [INFO ] [MAIN ] Update Progress: 764/2371 symbols completed. ES took 38.6s. Estimated remaining: 3h 54m 5s. Rate: 6.9 symbols/min [2025-09-17T18:51:19.122304] [INFO ] [MAIN ] ESNT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:51:19.168465] [DEBUG] [LOCAL ] ESNT: Loaded 38806 existing records from primary storage. [2025-09-17T18:51:19.168617] [INFO ] [MAIN ] ESNT: Loaded 38806 existing records. [2025-09-17T18:51:19.362916] [WARN ] [MAIN ] ESNT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:51:19.363999] [INFO ] [MAIN ] ESNT: Wiping existing primary data before full refresh. [2025-09-17T18:51:19.364106] [INFO ] [LOCAL ] ESNT: Starting deletion of primary data. [2025-09-17T18:51:19.373929] [DEBUG] [LOCAL ] ESNT: Deleted primary data file. [2025-09-17T18:51:19.386880] [INFO ] [MAIN ] ESNT: Starting full primary refresh. [2025-09-17T18:51:19.481836] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T18:51:19.623221] [INFO ] [REMOTE ] ESI: Fetching primary data for 2024-12. [2025-09-17T18:51:19.772239] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T18:51:19.796405] [INFO ] [REMOTE ] ESNT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:51:20.415787] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-05. [2025-09-17T18:51:20.991197] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T18:51:21.215823] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-07. [2025-09-17T18:51:21.511861] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T18:51:22.015830] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-01. [2025-09-17T18:51:22.371519] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T18:51:22.815781] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-11. [2025-09-17T18:51:23.557447] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T18:51:23.615748] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-06. [2025-09-17T18:51:24.415773] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-08. [2025-09-17T18:51:24.548558] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T18:51:24.853804] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-17T18:51:25.215782] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-02. [2025-09-17T18:51:25.751450] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T18:51:26.015819] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2024-12. [2025-09-17T18:51:26.724078] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T18:51:26.815834] [INFO ] [REMOTE ] ESAB: Fetching primary data for 2025-09. [2025-09-17T18:51:27.545225] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T18:51:27.615772] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-01. [2025-09-17T18:51:27.685787] [INFO ] [REMOTE ] ESAB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T18:51:27.689577] [INFO ] [REMOTE ] ESAB: Full fetch complete (32037 records). [2025-09-17T18:51:27.689694] [DEBUG] [VALIDATOR ] ESAB: Validating primary data. [2025-09-17T18:51:27.873623] [WARN ] [VALIDATOR ] ESAB: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T18:51:27.874037] [FATAL] [MAIN ] ESAB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:51:27.874085] [WARN ] [MAIN ] ESAB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:51:27.874123] [INFO ] [LOCAL ] ESAB: Starting deletion of primary data. [2025-09-17T18:51:27.874183] [DEBUG] [LOCAL ] ESAB: No primary data file found to delete. [2025-09-17T18:51:27.874217] [INFO ] [LOCAL ] ESAB: Starting deletion of derivative data. [2025-09-17T18:51:27.874590] [DEBUG] [LOCAL ] ESAB: Deleted derivative data file. [2025-09-17T18:51:27.874695] [INFO ] [MAIN ] Update Progress: 765/2371 symbols completed. ESAB took 32.9s. Estimated remaining: 3h 53m 56s. Rate: 6.9 symbols/min [2025-09-17T18:51:28.041823] [INFO ] [MAIN ] ESRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:51:28.088554] [DEBUG] [LOCAL ] ESRT: Loaded 46391 existing records from primary storage. [2025-09-17T18:51:28.088736] [INFO ] [MAIN ] ESRT: Loaded 46391 existing records. [2025-09-17T18:51:28.266926] [WARN ] [MAIN ] ESRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:51:28.267165] [INFO ] [MAIN ] ESRT: Wiping existing primary data before full refresh. [2025-09-17T18:51:28.267214] [INFO ] [LOCAL ] ESRT: Starting deletion of primary data. [2025-09-17T18:51:28.268056] [DEBUG] [LOCAL ] ESRT: Deleted primary data file. [2025-09-17T18:51:28.268105] [INFO ] [MAIN ] ESRT: Starting full primary refresh. [2025-09-17T18:51:28.423857] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-07. [2025-09-17T18:51:28.641432] [INFO ] [REMOTE ] ESRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:51:29.191777] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T18:51:29.215685] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-02. [2025-09-17T18:51:29.511967] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T18:51:30.015797] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-11. [2025-09-17T18:51:30.734629] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T18:51:30.815788] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-03. [2025-09-17T18:51:31.576004] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T18:51:31.615731] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2024-12. [2025-09-17T18:51:32.415765] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-03. [2025-09-17T18:51:32.474963] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T18:51:32.662373] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T18:51:33.215773] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-08. [2025-09-17T18:51:33.936020] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T18:51:34.015762] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-04. [2025-09-17T18:51:34.267163] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T18:51:34.815781] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-01. [2025-09-17T18:51:35.615839] [INFO ] [REMOTE ] ESE: Fetching primary data for 2025-09. [2025-09-17T18:51:35.692032] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T18:51:35.843110] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T18:51:36.415740] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-04. [2025-09-17T18:51:36.729487] [INFO ] [REMOTE ] ESE: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T18:51:36.732705] [INFO ] [REMOTE ] ESE: Full fetch complete (21642 records). [2025-09-17T18:51:36.732823] [DEBUG] [VALIDATOR ] ESE: Validating primary data. [2025-09-17T18:51:37.100940] [DEBUG] [VALIDATOR ] ESE: All expected trading days are present. [2025-09-17T18:51:37.101035] [DEBUG] [VALIDATOR ] ESE: Primary data validation passed. [2025-09-17T18:51:37.101541] [INFO ] [MAIN ] ESE: Fetched primary data is valid. [2025-09-17T18:51:37.101582] [DEBUG] [LOCAL ] ESE: Saving primary data. [2025-09-17T18:51:37.102241] [DEBUG] [LOCAL ] ESE: Trimmed 21642 records to 16612 (keeping 200 days of data) [2025-09-17T18:51:37.207628] [DEBUG] [LOCAL ] ESE: Primary data saved (16612 records). [2025-09-17T18:51:37.207793] [INFO ] [MAIN ] ESE: Full history saved. [2025-09-17T18:51:37.207878] [INFO ] [MAIN ] Update Progress: 766/2371 symbols completed. ESE took 28.4s. Estimated remaining: 3h 53m 49s. Rate: 6.9 symbols/min [2025-09-17T18:51:37.221120] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-05. [2025-09-17T18:51:37.380573] [INFO ] [MAIN ] ESS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:51:37.410978] [DEBUG] [LOCAL ] ESS: Loaded 30217 existing records from primary storage. [2025-09-17T18:51:37.411135] [INFO ] [MAIN ] ESS: Loaded 30217 existing records. [2025-09-17T18:51:37.589278] [WARN ] [MAIN ] ESS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:51:37.589514] [INFO ] [MAIN ] ESS: Wiping existing primary data before full refresh. [2025-09-17T18:51:37.589570] [INFO ] [LOCAL ] ESS: Starting deletion of primary data. [2025-09-17T18:51:37.590269] [DEBUG] [LOCAL ] ESS: Deleted primary data file. [2025-09-17T18:51:37.590315] [INFO ] [MAIN ] ESS: Starting full primary refresh. [2025-09-17T18:51:37.988601] [INFO ] [REMOTE ] ESS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:51:38.014506] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T18:51:38.022902] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-02. [2025-09-17T18:51:38.815842] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-05. [2025-09-17T18:51:39.000001] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T18:51:39.505800] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T18:51:39.615810] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-06. [2025-09-17T18:51:39.882477] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T18:51:40.415900] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-11. [2025-09-17T18:51:41.215843] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-03. [2025-09-17T18:51:41.276618] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T18:51:41.457332] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T18:51:42.015793] [INFO ] [REMOTE ] ESS: Fetching primary data for 2024-12. [2025-09-17T18:51:42.768428] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T18:51:42.815841] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-07. [2025-09-17T18:51:43.302707] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T18:51:43.615780] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-06. [2025-09-17T18:51:44.415839] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-04. [2025-09-17T18:51:44.536849] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T18:51:45.006582] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T18:51:45.215855] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-01. [2025-09-17T18:51:45.810239] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T18:51:46.015801] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-07. [2025-09-17T18:51:46.323491] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T18:51:46.815784] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-05. [2025-09-17T18:51:47.546669] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T18:51:47.615766] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-08. [2025-09-17T18:51:48.415793] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-08. [2025-09-17T18:51:48.479023] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T18:51:49.003866] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T18:51:49.215774] [INFO ] [REMOTE ] ESNT: Fetching primary data for 2025-09. [2025-09-17T18:51:49.818073] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T18:51:50.015807] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-02. [2025-09-17T18:51:50.533242] [INFO ] [REMOTE ] ESNT: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T18:51:50.538177] [INFO ] [REMOTE ] ESNT: Full fetch complete (57057 records). [2025-09-17T18:51:50.538308] [DEBUG] [VALIDATOR ] ESNT: Validating primary data. [2025-09-17T18:51:50.823616] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-06. [2025-09-17T18:51:50.926814] [DEBUG] [VALIDATOR ] ESNT: All expected trading days are present. [2025-09-17T18:51:50.926891] [DEBUG] [VALIDATOR ] ESNT: Primary data validation passed. [2025-09-17T18:51:50.927584] [INFO ] [MAIN ] ESNT: Fetched primary data is valid. [2025-09-17T18:51:50.927625] [DEBUG] [LOCAL ] ESNT: Saving primary data. [2025-09-17T18:51:50.928750] [DEBUG] [LOCAL ] ESNT: Trimmed 57057 records to 38756 (keeping 200 days of data) [2025-09-17T18:51:51.156054] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T18:51:51.190919] [DEBUG] [LOCAL ] ESNT: Primary data saved (38756 records). [2025-09-17T18:51:51.191047] [INFO ] [MAIN ] ESNT: Full history saved. [2025-09-17T18:51:51.191810] [INFO ] [MAIN ] Update Progress: 767/2371 symbols completed. ESNT took 32.2s. Estimated remaining: 3h 53m 51s. Rate: 6.9 symbols/min [2025-09-17T18:51:51.365292] [INFO ] [MAIN ] ESTC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:51:51.413175] [DEBUG] [LOCAL ] ESTC: Loaded 50254 existing records from primary storage. [2025-09-17T18:51:51.413339] [INFO ] [MAIN ] ESTC: Loaded 50254 existing records. [2025-09-17T18:51:51.631742] [INFO ] [REMOTE ] ESI: Fetching primary data for 2025-09. [2025-09-17T18:51:51.637124] [WARN ] [MAIN ] ESTC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:51:51.637912] [INFO ] [MAIN ] ESTC: Wiping existing primary data before full refresh. [2025-09-17T18:51:51.637962] [INFO ] [LOCAL ] ESTC: Starting deletion of primary data. [2025-09-17T18:51:51.638906] [DEBUG] [LOCAL ] ESTC: Deleted primary data file. [2025-09-17T18:51:51.638962] [INFO ] [MAIN ] ESTC: Starting full primary refresh. [2025-09-17T18:51:52.011109] [INFO ] [REMOTE ] ESTC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:51:52.075213] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T18:51:52.415888] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-11. [2025-09-17T18:51:53.079381] [INFO ] [REMOTE ] ESI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T18:51:53.085907] [INFO ] [REMOTE ] ESI: Full fetch complete (72018 records). [2025-09-17T18:51:53.086053] [DEBUG] [VALIDATOR ] ESI: Validating primary data. [2025-09-17T18:51:53.220894] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-07. [2025-09-17T18:51:53.509046] [DEBUG] [VALIDATOR ] ESI: All expected trading days are present. [2025-09-17T18:51:53.509133] [DEBUG] [VALIDATOR ] ESI: Primary data validation passed. [2025-09-17T18:51:53.509967] [INFO ] [MAIN ] ESI: Fetched primary data is valid. [2025-09-17T18:51:53.510014] [DEBUG] [LOCAL ] ESI: Saving primary data. [2025-09-17T18:51:53.511813] [DEBUG] [LOCAL ] ESI: Trimmed 72018 records to 50860 (keeping 200 days of data) [2025-09-17T18:51:53.850597] [DEBUG] [LOCAL ] ESI: Primary data saved (50860 records). [2025-09-17T18:51:53.850787] [INFO ] [MAIN ] ESI: Full history saved. [2025-09-17T18:51:53.850901] [INFO ] [MAIN ] Update Progress: 768/2371 symbols completed. ESI took 43.3s. Estimated remaining: 3h 53m 29s. Rate: 6.9 symbols/min [2025-09-17T18:51:54.025188] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-03. [2025-09-17T18:51:54.028128] [INFO ] [MAIN ] ET: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:51:54.084610] [DEBUG] [LOCAL ] ET: Loaded 53790 existing records from primary storage. [2025-09-17T18:51:54.084782] [INFO ] [MAIN ] ET: Loaded 53790 existing records. [2025-09-17T18:51:54.267940] [WARN ] [MAIN ] ET: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:51:54.268297] [INFO ] [MAIN ] ET: Wiping existing primary data before full refresh. [2025-09-17T18:51:54.268358] [INFO ] [LOCAL ] ET: Starting deletion of primary data. [2025-09-17T18:51:54.269752] [DEBUG] [LOCAL ] ET: Deleted primary data file. [2025-09-17T18:51:54.269814] [INFO ] [MAIN ] ET: Starting full primary refresh. [2025-09-17T18:51:54.481680] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T18:51:54.672546] [INFO ] [REMOTE ] ET: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:51:54.815744] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-11. [2025-09-17T18:51:54.883164] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T18:51:54.978852] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T18:51:55.615821] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2024-12. [2025-09-17T18:51:56.415813] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-04. [2025-09-17T18:51:56.800555] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-17T18:51:57.215775] [INFO ] [REMOTE ] ET: Fetching primary data for 2024-12. [2025-09-17T18:51:57.373528] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T18:51:57.572448] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T18:51:58.015796] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-01. [2025-09-17T18:51:58.815809] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-05. [2025-09-17T18:51:59.446433] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2024-12 (2.23 seconds). [2025-09-17T18:51:59.615754] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-01. [2025-09-17T18:51:59.951067] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T18:52:00.121160] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T18:52:00.415782] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-02. [2025-09-17T18:52:01.215805] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-08. [2025-09-17T18:52:01.289412] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T18:52:02.015750] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-06. [2025-09-17T18:52:02.082454] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T18:52:02.815776] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-03. [2025-09-17T18:52:02.880217] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T18:52:03.114940] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T18:52:03.615795] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-07. [2025-09-17T18:52:04.415780] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-02. [2025-09-17T18:52:04.605894] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T18:52:04.699019] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T18:52:05.215787] [INFO ] [REMOTE ] ESRT: Fetching primary data for 2025-09. [2025-09-17T18:52:06.015743] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-04. [2025-09-17T18:52:06.133863] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T18:52:06.747437] [INFO ] [REMOTE ] ESRT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T18:52:06.753412] [INFO ] [REMOTE ] ESRT: Full fetch complete (66281 records). [2025-09-17T18:52:06.753544] [DEBUG] [VALIDATOR ] ESRT: Validating primary data. [2025-09-17T18:52:06.820884] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-03. [2025-09-17T18:52:07.152191] [DEBUG] [VALIDATOR ] ESRT: All expected trading days are present. [2025-09-17T18:52:07.152281] [DEBUG] [VALIDATOR ] ESRT: Primary data validation passed. [2025-09-17T18:52:07.153077] [INFO ] [MAIN ] ESRT: Fetched primary data is valid. [2025-09-17T18:52:07.153122] [DEBUG] [LOCAL ] ESRT: Saving primary data. [2025-09-17T18:52:07.154475] [DEBUG] [LOCAL ] ESRT: Trimmed 66281 records to 46440 (keeping 200 days of data) [2025-09-17T18:52:07.430886] [DEBUG] [LOCAL ] ESRT: Primary data saved (46440 records). [2025-09-17T18:52:07.431045] [INFO ] [MAIN ] ESRT: Full history saved. [2025-09-17T18:52:07.431139] [INFO ] [MAIN ] Update Progress: 769/2371 symbols completed. ESRT took 39.6s. Estimated remaining: 3h 53m 31s. Rate: 6.9 symbols/min [2025-09-17T18:52:07.615728] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-08. [2025-09-17T18:52:07.616961] [INFO ] [MAIN ] ETB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:52:07.632800] [DEBUG] [LOCAL ] ETB: Loaded 12202 existing records from primary storage. [2025-09-17T18:52:07.633106] [INFO ] [MAIN ] ETB: Loaded 12202 existing records. [2025-09-17T18:52:07.858788] [WARN ] [MAIN ] ETB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:52:07.861222] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T18:52:07.861378] [INFO ] [MAIN ] ETB: Wiping existing primary data before full refresh. [2025-09-17T18:52:07.871690] [INFO ] [LOCAL ] ETB: Starting deletion of primary data. [2025-09-17T18:52:07.872570] [DEBUG] [LOCAL ] ETB: Deleted primary data file. [2025-09-17T18:52:07.872624] [INFO ] [MAIN ] ETB: Starting full primary refresh. [2025-09-17T18:52:08.239179] [INFO ] [REMOTE ] ETB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:52:08.415774] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-05. [2025-09-17T18:52:08.954229] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T18:52:09.078426] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-03 (2.26 seconds). [2025-09-17T18:52:09.215773] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-04. [2025-09-17T18:52:10.015775] [INFO ] [REMOTE ] ESS: Fetching primary data for 2025-09. [2025-09-17T18:52:10.278594] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T18:52:10.815773] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-06. [2025-09-17T18:52:11.126346] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T18:52:11.349768] [INFO ] [REMOTE ] ESS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T18:52:11.354268] [INFO ] [REMOTE ] ESS: Full fetch complete (43160 records). [2025-09-17T18:52:11.354405] [DEBUG] [VALIDATOR ] ESS: Validating primary data. [2025-09-17T18:52:11.622289] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-11. [2025-09-17T18:52:11.739066] [DEBUG] [VALIDATOR ] ESS: All expected trading days are present. [2025-09-17T18:52:11.739144] [DEBUG] [VALIDATOR ] ESS: Primary data validation passed. [2025-09-17T18:52:11.739749] [INFO ] [MAIN ] ESS: Fetched primary data is valid. [2025-09-17T18:52:11.739793] [DEBUG] [LOCAL ] ESS: Saving primary data. [2025-09-17T18:52:11.740702] [DEBUG] [LOCAL ] ESS: Trimmed 43160 records to 30078 (keeping 200 days of data) [2025-09-17T18:52:11.928333] [DEBUG] [LOCAL ] ESS: Primary data saved (30078 records). [2025-09-17T18:52:11.928463] [INFO ] [MAIN ] ESS: Full history saved. [2025-09-17T18:52:11.928543] [INFO ] [MAIN ] Update Progress: 770/2371 symbols completed. ESS took 34.7s. Estimated remaining: 3h 53m 13s. Rate: 6.9 symbols/min [2025-09-17T18:52:12.105443] [INFO ] [MAIN ] ETD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:52:12.132519] [DEBUG] [LOCAL ] ETD: Loaded 27390 existing records from primary storage. [2025-09-17T18:52:12.132777] [INFO ] [MAIN ] ETD: Loaded 27390 existing records. [2025-09-17T18:52:12.316525] [WARN ] [MAIN ] ETD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:52:12.316926] [INFO ] [MAIN ] ETD: Wiping existing primary data before full refresh. [2025-09-17T18:52:12.317026] [INFO ] [LOCAL ] ETD: Starting deletion of primary data. [2025-09-17T18:52:12.317743] [DEBUG] [LOCAL ] ETD: Deleted primary data file. [2025-09-17T18:52:12.317831] [INFO ] [MAIN ] ETD: Starting full primary refresh. [2025-09-17T18:52:12.418599] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-05. [2025-09-17T18:52:12.572897] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T18:52:12.606439] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T18:52:12.759180] [INFO ] [REMOTE ] ETD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:52:13.215813] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-11. [2025-09-17T18:52:14.015809] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-07. [2025-09-17T18:52:14.344272] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T18:52:14.815802] [INFO ] [REMOTE ] ETD: Fetching primary data for 2024-12. [2025-09-17T18:52:14.882116] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-05 (2.46 seconds). [2025-09-17T18:52:15.615769] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-06. [2025-09-17T18:52:15.811229] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T18:52:15.834029] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T18:52:16.415767] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-01. [2025-09-17T18:52:17.215749] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-08. [2025-09-17T18:52:17.456875] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T18:52:17.594298] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T18:52:18.015808] [INFO ] [REMOTE ] ETB: Fetching primary data for 2024-12. [2025-09-17T18:52:18.815761] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-02. [2025-09-17T18:52:18.862158] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T18:52:18.872967] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T18:52:19.615792] [INFO ] [REMOTE ] ESTC: Fetching primary data for 2025-09. [2025-09-17T18:52:19.902216] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T18:52:20.415787] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-01. [2025-09-17T18:52:21.161826] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T18:52:21.215801] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-07. [2025-09-17T18:52:21.352549] [INFO ] [REMOTE ] ESTC: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T18:52:21.359468] [INFO ] [REMOTE ] ESTC: Full fetch complete (72106 records). [2025-09-17T18:52:21.359594] [DEBUG] [VALIDATOR ] ESTC: Validating primary data. [2025-09-17T18:52:21.765580] [DEBUG] [VALIDATOR ] ESTC: All expected trading days are present. [2025-09-17T18:52:21.765739] [DEBUG] [VALIDATOR ] ESTC: Primary data validation passed. [2025-09-17T18:52:21.766706] [INFO ] [MAIN ] ESTC: Fetched primary data is valid. [2025-09-17T18:52:21.766761] [DEBUG] [LOCAL ] ESTC: Saving primary data. [2025-09-17T18:52:21.768684] [DEBUG] [LOCAL ] ESTC: Trimmed 72106 records to 50222 (keeping 200 days of data) [2025-09-17T18:52:22.035074] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-02. [2025-09-17T18:52:22.072795] [DEBUG] [LOCAL ] ESTC: Primary data saved (50222 records). [2025-09-17T18:52:22.072919] [INFO ] [MAIN ] ESTC: Full history saved. [2025-09-17T18:52:22.073557] [INFO ] [MAIN ] Update Progress: 771/2371 symbols completed. ESTC took 30.9s. Estimated remaining: 3h 53m 7s. Rate: 6.9 symbols/min [2025-09-17T18:52:22.242906] [INFO ] [MAIN ] ETG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:52:22.262746] [DEBUG] [LOCAL ] ETG: Loaded 17067 existing records from primary storage. [2025-09-17T18:52:22.262879] [INFO ] [MAIN ] ETG: Loaded 17067 existing records. [2025-09-17T18:52:22.439735] [WARN ] [MAIN ] ETG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:52:22.440003] [INFO ] [MAIN ] ETG: Wiping existing primary data before full refresh. [2025-09-17T18:52:22.440052] [INFO ] [LOCAL ] ETG: Starting deletion of primary data. [2025-09-17T18:52:22.440500] [DEBUG] [LOCAL ] ETG: Deleted primary data file. [2025-09-17T18:52:22.440545] [INFO ] [MAIN ] ETG: Starting full primary refresh. [2025-09-17T18:52:22.803549] [INFO ] [REMOTE ] ETG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:52:22.815793] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-11. [2025-09-17T18:52:23.032605] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T18:52:23.387954] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T18:52:23.544594] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T18:52:23.615822] [INFO ] [REMOTE ] ETG: Fetching primary data for 2024-12. [2025-09-17T18:52:24.415749] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-08. [2025-09-17T18:52:24.491908] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T18:52:25.215785] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-01. [2025-09-17T18:52:26.020887] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-03. [2025-09-17T18:52:26.027418] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T18:52:26.715620] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-17T18:52:26.815777] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-02. [2025-09-17T18:52:26.990181] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T18:52:27.615818] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-04. [2025-09-17T18:52:27.756727] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T18:52:28.415811] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-03. [2025-09-17T18:52:28.625249] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T18:52:29.215756] [INFO ] [REMOTE ] ET: Fetching primary data for 2025-09. [2025-09-17T18:52:29.296929] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T18:52:30.015807] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-03. [2025-09-17T18:52:30.815834] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-04. [2025-09-17T18:52:31.190506] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T18:52:31.346229] [INFO ] [REMOTE ] ET: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-17T18:52:31.353557] [INFO ] [REMOTE ] ET: Full fetch complete (77946 records). [2025-09-17T18:52:31.353777] [DEBUG] [VALIDATOR ] ET: Validating primary data. [2025-09-17T18:52:31.620934] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-05. [2025-09-17T18:52:31.758031] [DEBUG] [VALIDATOR ] ET: All expected trading days are present. [2025-09-17T18:52:31.758157] [DEBUG] [VALIDATOR ] ET: Primary data validation passed. [2025-09-17T18:52:31.759314] [INFO ] [MAIN ] ET: Fetched primary data is valid. [2025-09-17T18:52:31.759384] [DEBUG] [LOCAL ] ET: Saving primary data. [2025-09-17T18:52:31.761545] [DEBUG] [LOCAL ] ET: Trimmed 77946 records to 53789 (keeping 200 days of data) [2025-09-17T18:52:31.904360] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T18:52:32.126379] [DEBUG] [LOCAL ] ET: Primary data saved (53789 records). [2025-09-17T18:52:32.126527] [INFO ] [MAIN ] ET: Full history saved. [2025-09-17T18:52:32.126621] [INFO ] [MAIN ] Update Progress: 772/2371 symbols completed. ET took 38.3s. Estimated remaining: 3h 53m 1s. Rate: 6.9 symbols/min [2025-09-17T18:52:32.300319] [INFO ] [MAIN ] ETJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:52:32.317135] [DEBUG] [LOCAL ] ETJ: Loaded 16905 existing records from primary storage. [2025-09-17T18:52:32.317259] [INFO ] [MAIN ] ETJ: Loaded 16905 existing records. [2025-09-17T18:52:32.417193] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-05. [2025-09-17T18:52:32.448928] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T18:52:32.512001] [WARN ] [MAIN ] ETJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:52:32.512772] [INFO ] [MAIN ] ETJ: Wiping existing primary data before full refresh. [2025-09-17T18:52:32.512819] [INFO ] [LOCAL ] ETJ: Starting deletion of primary data. [2025-09-17T18:52:32.513458] [DEBUG] [LOCAL ] ETJ: Deleted primary data file. [2025-09-17T18:52:32.513505] [INFO ] [MAIN ] ETJ: Starting full primary refresh. [2025-09-17T18:52:32.882491] [INFO ] [REMOTE ] ETJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:52:33.215756] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-06. [2025-09-17T18:52:33.271854] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T18:52:34.020805] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-06. [2025-09-17T18:52:34.022413] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T18:52:34.813935] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T18:52:34.817781] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-07. [2025-09-17T18:52:35.615766] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-11. [2025-09-17T18:52:35.704088] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T18:52:36.292934] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T18:52:36.415844] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-04. [2025-09-17T18:52:37.215781] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-08. [2025-09-17T18:52:37.656074] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T18:52:37.991673] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T18:52:38.015737] [INFO ] [REMOTE ] ETB: Fetching primary data for 2025-09. [2025-09-17T18:52:38.747086] [INFO ] [REMOTE ] ETB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T18:52:38.749434] [INFO ] [REMOTE ] ETB: Full fetch complete (17801 records). [2025-09-17T18:52:38.749515] [DEBUG] [VALIDATOR ] ETB: Validating primary data. [2025-09-17T18:52:38.820933] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-05. [2025-09-17T18:52:39.120396] [DEBUG] [VALIDATOR ] ETB: All expected trading days are present. [2025-09-17T18:52:39.120474] [DEBUG] [VALIDATOR ] ETB: Primary data validation passed. [2025-09-17T18:52:39.120866] [INFO ] [MAIN ] ETB: Fetched primary data is valid. [2025-09-17T18:52:39.120952] [DEBUG] [LOCAL ] ETB: Saving primary data. [2025-09-17T18:52:39.121549] [DEBUG] [LOCAL ] ETB: Trimmed 17801 records to 12220 (keeping 200 days of data) [2025-09-17T18:52:39.197919] [DEBUG] [LOCAL ] ETB: Primary data saved (12220 records). [2025-09-17T18:52:39.198063] [INFO ] [MAIN ] ETB: Full history saved. [2025-09-17T18:52:39.198148] [INFO ] [MAIN ] Update Progress: 773/2371 symbols completed. ETB took 31.8s. Estimated remaining: 3h 52m 49s. Rate: 6.9 symbols/min [2025-09-17T18:52:39.372433] [INFO ] [MAIN ] ETN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:52:39.430300] [DEBUG] [LOCAL ] ETN: Loaded 52880 existing records from primary storage. [2025-09-17T18:52:39.430445] [INFO ] [MAIN ] ETN: Loaded 52880 existing records. [2025-09-17T18:52:39.616403] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-07. [2025-09-17T18:52:39.619934] [WARN ] [MAIN ] ETN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:52:39.620889] [INFO ] [MAIN ] ETN: Wiping existing primary data before full refresh. [2025-09-17T18:52:39.620934] [INFO ] [LOCAL ] ETN: Starting deletion of primary data. [2025-09-17T18:52:39.622488] [DEBUG] [LOCAL ] ETN: Deleted primary data file. [2025-09-17T18:52:39.622540] [INFO ] [MAIN ] ETN: Starting full primary refresh. [2025-09-17T18:52:39.982406] [INFO ] [REMOTE ] ETN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:52:40.181896] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T18:52:40.415748] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-11. [2025-09-17T18:52:40.721102] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T18:52:41.215776] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-08. [2025-09-17T18:52:42.015777] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2024-12. [2025-09-17T18:52:42.099373] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T18:52:42.128515] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T18:52:42.627095] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T18:52:42.815818] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-06. [2025-09-17T18:52:43.615751] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-01. [2025-09-17T18:52:43.835830] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T18:52:44.307226] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T18:52:44.415738] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-02. [2025-09-17T18:52:45.215814] [INFO ] [REMOTE ] ETN: Fetching primary data for 2024-12. [2025-09-17T18:52:45.306721] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T18:52:46.015773] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-03. [2025-09-17T18:52:46.812675] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T18:52:46.822680] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-07. [2025-09-17T18:52:47.070485] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T18:52:47.615732] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-04. [2025-09-17T18:52:48.074856] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T18:52:48.415783] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-01. [2025-09-17T18:52:48.722794] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T18:52:49.215789] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-05. [2025-09-17T18:52:49.869816] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T18:52:50.015779] [INFO ] [REMOTE ] ETG: Fetching primary data for 2025-09. [2025-09-17T18:52:50.369208] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T18:52:50.705881] [INFO ] [REMOTE ] ETG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T18:52:50.708546] [INFO ] [REMOTE ] ETG: Full fetch complete (25199 records). [2025-09-17T18:52:50.708627] [DEBUG] [VALIDATOR ] ETG: Validating primary data. [2025-09-17T18:52:50.819591] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-08. [2025-09-17T18:52:51.095504] [DEBUG] [VALIDATOR ] ETG: All expected trading days are present. [2025-09-17T18:52:51.095590] [DEBUG] [VALIDATOR ] ETG: Primary data validation passed. [2025-09-17T18:52:51.096255] [INFO ] [MAIN ] ETG: Fetched primary data is valid. [2025-09-17T18:52:51.096300] [DEBUG] [LOCAL ] ETG: Saving primary data. [2025-09-17T18:52:51.097511] [DEBUG] [LOCAL ] ETG: Trimmed 25199 records to 17040 (keeping 200 days of data) [2025-09-17T18:52:51.202431] [DEBUG] [LOCAL ] ETG: Primary data saved (17040 records). [2025-09-17T18:52:51.202577] [INFO ] [MAIN ] ETG: Full history saved. [2025-09-17T18:52:51.202719] [INFO ] [MAIN ] Update Progress: 774/2371 symbols completed. ETG took 29.1s. Estimated remaining: 3h 52m 47s. Rate: 6.9 symbols/min [2025-09-17T18:52:51.393410] [INFO ] [MAIN ] ETO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:52:51.404783] [DEBUG] [LOCAL ] ETO: Loaded 6670 existing records from primary storage. [2025-09-17T18:52:51.404985] [INFO ] [MAIN ] ETO: Loaded 6670 existing records. [2025-09-17T18:52:51.592239] [WARN ] [MAIN ] ETO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:52:51.592510] [INFO ] [MAIN ] ETO: Wiping existing primary data before full refresh. [2025-09-17T18:52:51.592555] [INFO ] [LOCAL ] ETO: Starting deletion of primary data. [2025-09-17T18:52:51.592858] [DEBUG] [LOCAL ] ETO: Deleted primary data file. [2025-09-17T18:52:51.592904] [INFO ] [MAIN ] ETO: Starting full primary refresh. [2025-09-17T18:52:51.624496] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-02. [2025-09-17T18:52:51.950289] [INFO ] [REMOTE ] ETO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:52:52.187314] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T18:52:52.415833] [INFO ] [REMOTE ] ETD: Fetching primary data for 2025-09. [2025-09-17T18:52:53.215862] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-06. [2025-09-17T18:52:53.500727] [INFO ] [REMOTE ] ETD: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T18:52:53.504706] [INFO ] [REMOTE ] ETD: Full fetch complete (37753 records). [2025-09-17T18:52:53.504791] [DEBUG] [VALIDATOR ] ETD: Validating primary data. [2025-09-17T18:52:53.883457] [DEBUG] [VALIDATOR ] ETD: All expected trading days are present. [2025-09-17T18:52:53.883554] [DEBUG] [VALIDATOR ] ETD: Primary data validation passed. [2025-09-17T18:52:53.884275] [INFO ] [MAIN ] ETD: Fetched primary data is valid. [2025-09-17T18:52:53.884390] [DEBUG] [LOCAL ] ETD: Saving primary data. [2025-09-17T18:52:53.885662] [DEBUG] [LOCAL ] ETD: Trimmed 37753 records to 27396 (keeping 200 days of data) [2025-09-17T18:52:54.009791] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-02 (2.39 seconds). [2025-09-17T18:52:54.020020] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-11. [2025-09-17T18:52:54.095824] [DEBUG] [LOCAL ] ETD: Primary data saved (27396 records). [2025-09-17T18:52:54.095959] [INFO ] [MAIN ] ETD: Full history saved. [2025-09-17T18:52:54.096040] [INFO ] [MAIN ] Update Progress: 775/2371 symbols completed. ETD took 42.2s. Estimated remaining: 3h 52m 26s. Rate: 6.9 symbols/min [2025-09-17T18:52:54.267348] [INFO ] [MAIN ] ETR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:52:54.278357] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T18:52:54.333184] [DEBUG] [LOCAL ] ETR: Loaded 53253 existing records from primary storage. [2025-09-17T18:52:54.333341] [INFO ] [MAIN ] ETR: Loaded 53253 existing records. [2025-09-17T18:52:54.509949] [WARN ] [MAIN ] ETR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:52:54.510180] [INFO ] [MAIN ] ETR: Wiping existing primary data before full refresh. [2025-09-17T18:52:54.510225] [INFO ] [LOCAL ] ETR: Starting deletion of primary data. [2025-09-17T18:52:54.511237] [DEBUG] [LOCAL ] ETR: Deleted primary data file. [2025-09-17T18:52:54.511287] [INFO ] [MAIN ] ETR: Starting full primary refresh. [2025-09-17T18:52:54.770099] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T18:52:54.820932] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-03. [2025-09-17T18:52:54.917685] [INFO ] [REMOTE ] ETR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:52:55.615786] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-11. [2025-09-17T18:52:56.415753] [INFO ] [REMOTE ] ETO: Fetching primary data for 2024-12. [2025-09-17T18:52:56.882822] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T18:52:56.882407] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T18:52:57.215753] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-01. [2025-09-17T18:52:57.325001] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T18:52:57.919267] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T18:52:58.015759] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-02. [2025-09-17T18:52:58.665514] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T18:52:58.815808] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-07. [2025-09-17T18:52:59.615782] [INFO ] [REMOTE ] ETR: Fetching primary data for 2024-12. [2025-09-17T18:52:59.787677] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T18:53:00.415777] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-08. [2025-09-17T18:53:01.096136] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T18:53:01.215746] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-01. [2025-09-17T18:53:01.404475] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T18:53:02.015843] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-03. [2025-09-17T18:53:02.538141] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-17T18:53:02.815784] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-04. [2025-09-17T18:53:02.997378] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T18:53:03.370749] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T18:53:03.615780] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-05. [2025-09-17T18:53:04.327471] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T18:53:04.415743] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-04. [2025-09-17T18:53:05.215832] [INFO ] [REMOTE ] ETJ: Fetching primary data for 2025-09. [2025-09-17T18:53:05.908868] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T18:53:06.015795] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-06. [2025-09-17T18:53:06.197798] [INFO ] [REMOTE ] ETJ: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T18:53:06.200554] [INFO ] [REMOTE ] ETJ: Full fetch complete (24769 records). [2025-09-17T18:53:06.200662] [DEBUG] [VALIDATOR ] ETJ: Validating primary data. [2025-09-17T18:53:06.687572] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T18:53:06.687991] [DEBUG] [VALIDATOR ] ETJ: All expected trading days are present. [2025-09-17T18:53:06.690216] [DEBUG] [VALIDATOR ] ETJ: Primary data validation passed. [2025-09-17T18:53:06.691328] [INFO ] [MAIN ] ETJ: Fetched primary data is valid. [2025-09-17T18:53:06.693110] [DEBUG] [LOCAL ] ETJ: Saving primary data. [2025-09-17T18:53:06.695895] [DEBUG] [LOCAL ] ETJ: Trimmed 24769 records to 16934 (keeping 200 days of data) [2025-09-17T18:53:06.815894] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-05. [2025-09-17T18:53:06.860416] [DEBUG] [LOCAL ] ETJ: Primary data saved (16934 records). [2025-09-17T18:53:06.860659] [INFO ] [MAIN ] ETJ: Full history saved. [2025-09-17T18:53:06.860800] [INFO ] [MAIN ] Update Progress: 776/2371 symbols completed. ETJ took 34.7s. Estimated remaining: 3h 52m 26s. Rate: 6.9 symbols/min [2025-09-17T18:53:07.134098] [INFO ] [MAIN ] ETV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:53:07.160339] [DEBUG] [LOCAL ] ETV: Loaded 21483 existing records from primary storage. [2025-09-17T18:53:07.160497] [INFO ] [MAIN ] ETV: Loaded 21483 existing records. [2025-09-17T18:53:07.384631] [WARN ] [MAIN ] ETV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:53:07.384962] [INFO ] [MAIN ] ETV: Wiping existing primary data before full refresh. [2025-09-17T18:53:07.385030] [INFO ] [LOCAL ] ETV: Starting deletion of primary data. [2025-09-17T18:53:07.385630] [DEBUG] [LOCAL ] ETV: Deleted primary data file. [2025-09-17T18:53:07.385723] [INFO ] [MAIN ] ETV: Starting full primary refresh. [2025-09-17T18:53:07.621106] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-07. [2025-09-17T18:53:07.776045] [INFO ] [REMOTE ] ETV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:53:08.403070] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T18:53:08.415784] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-11. [2025-09-17T18:53:08.797914] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T18:53:09.215787] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-02. [2025-09-17T18:53:09.813035] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T18:53:10.015810] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-08. [2025-09-17T18:53:10.475604] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T18:53:10.815772] [INFO ] [REMOTE ] ETO: Fetching primary data for 2025-09. [2025-09-17T18:53:11.006874] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T18:53:11.442532] [INFO ] [REMOTE ] ETO: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T18:53:11.443770] [INFO ] [REMOTE ] ETO: Full fetch complete (9290 records). [2025-09-17T18:53:11.443838] [DEBUG] [VALIDATOR ] ETO: Validating primary data. [2025-09-17T18:53:11.617403] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-06. [2025-09-17T18:53:11.808699] [DEBUG] [VALIDATOR ] ETO: All expected trading days are present. [2025-09-17T18:53:11.808800] [DEBUG] [VALIDATOR ] ETO: Primary data validation passed. [2025-09-17T18:53:11.809075] [INFO ] [MAIN ] ETO: Fetched primary data is valid. [2025-09-17T18:53:11.809129] [DEBUG] [LOCAL ] ETO: Saving primary data. [2025-09-17T18:53:11.810066] [DEBUG] [LOCAL ] ETO: Trimmed 9290 records to 6633 (keeping 200 days of data) [2025-09-17T18:53:11.854475] [DEBUG] [LOCAL ] ETO: Primary data saved (6633 records). [2025-09-17T18:53:11.854614] [INFO ] [MAIN ] ETO: Full history saved. [2025-09-17T18:53:11.854746] [INFO ] [MAIN ] Update Progress: 777/2371 symbols completed. ETO took 20.7s. Estimated remaining: 3h 52m 9s. Rate: 6.9 symbols/min [2025-09-17T18:53:12.028424] [INFO ] [MAIN ] ETW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:53:12.055908] [DEBUG] [LOCAL ] ETW: Loaded 25369 existing records from primary storage. [2025-09-17T18:53:12.056040] [INFO ] [MAIN ] ETW: Loaded 25369 existing records. [2025-09-17T18:53:12.232838] [WARN ] [MAIN ] ETW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:53:12.233059] [INFO ] [MAIN ] ETW: Wiping existing primary data before full refresh. [2025-09-17T18:53:12.233103] [INFO ] [LOCAL ] ETW: Starting deletion of primary data. [2025-09-17T18:53:12.233897] [DEBUG] [LOCAL ] ETW: Deleted primary data file. [2025-09-17T18:53:12.233949] [INFO ] [MAIN ] ETW: Starting full primary refresh. [2025-09-17T18:53:12.425445] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-03. [2025-09-17T18:53:12.597126] [INFO ] [REMOTE ] ETW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:53:13.222922] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-11. [2025-09-17T18:53:13.245301] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T18:53:14.015801] [INFO ] [REMOTE ] ETV: Fetching primary data for 2024-12. [2025-09-17T18:53:14.415783] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T18:53:14.564129] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T18:53:14.815758] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-07. [2025-09-17T18:53:15.122590] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T18:53:15.615762] [INFO ] [REMOTE ] ETW: Fetching primary data for 2024-12. [2025-09-17T18:53:16.415741] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-04. [2025-09-17T18:53:16.649065] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T18:53:16.712127] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T18:53:17.215764] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-01. [2025-09-17T18:53:18.015752] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-01. [2025-09-17T18:53:18.137710] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T18:53:18.372176] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T18:53:18.815821] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-02. [2025-09-17T18:53:19.473061] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T18:53:19.615765] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-02. [2025-09-17T18:53:19.876014] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T18:53:20.415779] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-05. [2025-09-17T18:53:20.490074] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T18:53:21.215780] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-03. [2025-09-17T18:53:22.015813] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-08. [2025-09-17T18:53:22.270258] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T18:53:22.365821] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T18:53:22.815794] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-04. [2025-09-17T18:53:23.615857] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-06. [2025-09-17T18:53:23.952906] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T18:53:24.272594] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T18:53:24.415823] [INFO ] [REMOTE ] ETN: Fetching primary data for 2025-09. [2025-09-17T18:53:25.215887] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-03. [2025-09-17T18:53:25.295735] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T18:53:26.015767] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-07. [2025-09-17T18:53:26.382322] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T18:53:26.628757] [INFO ] [REMOTE ] ETN: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-17T18:53:26.635681] [INFO ] [REMOTE ] ETN: Full fetch complete (76434 records). [2025-09-17T18:53:26.635811] [DEBUG] [VALIDATOR ] ETN: Validating primary data. [2025-09-17T18:53:26.830493] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-04. [2025-09-17T18:53:27.037432] [DEBUG] [VALIDATOR ] ETN: All expected trading days are present. [2025-09-17T18:53:27.037532] [DEBUG] [VALIDATOR ] ETN: Primary data validation passed. [2025-09-17T18:53:27.038531] [INFO ] [MAIN ] ETN: Fetched primary data is valid. [2025-09-17T18:53:27.038589] [DEBUG] [LOCAL ] ETN: Saving primary data. [2025-09-17T18:53:27.040971] [DEBUG] [LOCAL ] ETN: Trimmed 76434 records to 52875 (keeping 200 days of data) [2025-09-17T18:53:27.407334] [DEBUG] [LOCAL ] ETN: Primary data saved (52875 records). [2025-09-17T18:53:27.407475] [INFO ] [MAIN ] ETN: Full history saved. [2025-09-17T18:53:27.407576] [INFO ] [MAIN ] Update Progress: 778/2371 symbols completed. ETN took 48.2s. Estimated remaining: 3h 52m 15s. Rate: 6.9 symbols/min [2025-09-17T18:53:27.592534] [INFO ] [MAIN ] ETX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:53:27.603693] [DEBUG] [LOCAL ] ETX: Loaded 4939 existing records from primary storage. [2025-09-17T18:53:27.603998] [INFO ] [MAIN ] ETX: Loaded 4939 existing records. [2025-09-17T18:53:27.636365] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-05. [2025-09-17T18:53:27.836171] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T18:53:27.839147] [WARN ] [MAIN ] ETX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:53:27.850759] [INFO ] [MAIN ] ETX: Wiping existing primary data before full refresh. [2025-09-17T18:53:27.850892] [INFO ] [LOCAL ] ETX: Starting deletion of primary data. [2025-09-17T18:53:27.851401] [DEBUG] [LOCAL ] ETX: Deleted primary data file. [2025-09-17T18:53:27.851455] [INFO ] [MAIN ] ETX: Starting full primary refresh. [2025-09-17T18:53:28.212600] [INFO ] [REMOTE ] ETX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:53:28.259148] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T18:53:28.415772] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-08. [2025-09-17T18:53:28.888269] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T18:53:29.215797] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-11. [2025-09-17T18:53:29.782190] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T18:53:30.015824] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-05. [2025-09-17T18:53:30.121580] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T18:53:30.815754] [INFO ] [REMOTE ] ETR: Fetching primary data for 2025-09. [2025-09-17T18:53:31.042793] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T18:53:31.615788] [INFO ] [REMOTE ] ETX: Fetching primary data for 2024-12. [2025-09-17T18:53:32.090096] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T18:53:32.303019] [INFO ] [REMOTE ] ETR: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T18:53:32.315512] [INFO ] [REMOTE ] ETR: Full fetch complete (76781 records). [2025-09-17T18:53:32.315877] [DEBUG] [VALIDATOR ] ETR: Validating primary data. [2025-09-17T18:53:32.417329] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-06. [2025-09-17T18:53:32.712589] [DEBUG] [VALIDATOR ] ETR: All expected trading days are present. [2025-09-17T18:53:32.712692] [DEBUG] [VALIDATOR ] ETR: Primary data validation passed. [2025-09-17T18:53:32.713623] [INFO ] [MAIN ] ETR: Fetched primary data is valid. [2025-09-17T18:53:32.713714] [DEBUG] [LOCAL ] ETR: Saving primary data. [2025-09-17T18:53:32.715823] [DEBUG] [LOCAL ] ETR: Trimmed 76781 records to 53245 (keeping 200 days of data) [2025-09-17T18:53:33.058867] [DEBUG] [LOCAL ] ETR: Primary data saved (53245 records). [2025-09-17T18:53:33.059818] [INFO ] [MAIN ] ETR: Full history saved. [2025-09-17T18:53:33.059943] [INFO ] [MAIN ] Update Progress: 779/2371 symbols completed. ETR took 39.0s. Estimated remaining: 3h 51m 60s. Rate: 6.9 symbols/min [2025-09-17T18:53:33.215841] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-06. [2025-09-17T18:53:33.234158] [INFO ] [MAIN ] ETY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:53:33.258176] [DEBUG] [LOCAL ] ETY: Loaded 23207 existing records from primary storage. [2025-09-17T18:53:33.258301] [INFO ] [MAIN ] ETY: Loaded 23207 existing records. [2025-09-17T18:53:33.433784] [WARN ] [MAIN ] ETY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:53:33.434026] [INFO ] [MAIN ] ETY: Wiping existing primary data before full refresh. [2025-09-17T18:53:33.434075] [INFO ] [LOCAL ] ETY: Starting deletion of primary data. [2025-09-17T18:53:33.434904] [DEBUG] [LOCAL ] ETY: Deleted primary data file. [2025-09-17T18:53:33.434954] [INFO ] [MAIN ] ETY: Starting full primary refresh. [2025-09-17T18:53:33.662893] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T18:53:33.815214] [INFO ] [REMOTE ] ETY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:53:34.015802] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-11. [2025-09-17T18:53:34.341261] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T18:53:34.815771] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-01. [2025-09-17T18:53:35.244579] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-17T18:53:35.244432] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T18:53:35.615819] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-02. [2025-09-17T18:53:36.198686] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T18:53:36.415817] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-07. [2025-09-17T18:53:37.215756] [INFO ] [REMOTE ] ETY: Fetching primary data for 2024-12. [2025-09-17T18:53:37.480393] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T18:53:38.015799] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-07. [2025-09-17T18:53:38.082597] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T18:53:38.815823] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-08. [2025-09-17T18:53:38.852936] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T18:53:39.615754] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-01. [2025-09-17T18:53:39.887490] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T18:53:40.415796] [INFO ] [REMOTE ] ETV: Fetching primary data for 2025-09. [2025-09-17T18:53:40.574250] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T18:53:41.215781] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-03. [2025-09-17T18:53:41.284373] [INFO ] [REMOTE ] ETV: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T18:53:41.287635] [INFO ] [REMOTE ] ETV: Full fetch complete (31642 records). [2025-09-17T18:53:41.287740] [DEBUG] [VALIDATOR ] ETV: Validating primary data. [2025-09-17T18:53:41.679487] [DEBUG] [VALIDATOR ] ETV: All expected trading days are present. [2025-09-17T18:53:41.679690] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T18:53:41.681208] [DEBUG] [VALIDATOR ] ETV: Primary data validation passed. [2025-09-17T18:53:41.681883] [INFO ] [MAIN ] ETV: Fetched primary data is valid. [2025-09-17T18:53:41.681935] [DEBUG] [LOCAL ] ETV: Saving primary data. [2025-09-17T18:53:41.683847] [DEBUG] [LOCAL ] ETV: Trimmed 31642 records to 21538 (keeping 200 days of data) [2025-09-17T18:53:41.824326] [DEBUG] [LOCAL ] ETV: Primary data saved (21538 records). [2025-09-17T18:53:41.824470] [INFO ] [MAIN ] ETV: Full history saved. [2025-09-17T18:53:41.824593] [INFO ] [MAIN ] Update Progress: 780/2371 symbols completed. ETV took 35.0s. Estimated remaining: 3h 51m 51s. Rate: 6.9 symbols/min [2025-09-17T18:53:41.994974] [INFO ] [MAIN ] EVC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:53:42.015928] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-02. [2025-09-17T18:53:42.015832] [DEBUG] [LOCAL ] EVC: Loaded 20297 existing records from primary storage. [2025-09-17T18:53:42.017359] [INFO ] [MAIN ] EVC: Loaded 20297 existing records. [2025-09-17T18:53:42.197466] [WARN ] [MAIN ] EVC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:53:42.197717] [INFO ] [MAIN ] EVC: Wiping existing primary data before full refresh. [2025-09-17T18:53:42.197763] [INFO ] [LOCAL ] EVC: Starting deletion of primary data. [2025-09-17T18:53:42.198284] [DEBUG] [LOCAL ] EVC: Deleted primary data file. [2025-09-17T18:53:42.198329] [INFO ] [MAIN ] EVC: Starting full primary refresh. [2025-09-17T18:53:42.562529] [INFO ] [REMOTE ] EVC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:53:42.815773] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-11. [2025-09-17T18:53:43.025396] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T18:53:43.615775] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-04. [2025-09-17T18:53:43.798589] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T18:53:44.031954] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T18:53:44.415740] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-03. [2025-09-17T18:53:45.215784] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-05. [2025-09-17T18:53:45.521329] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T18:53:45.577184] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-17T18:53:46.015829] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-06. [2025-09-17T18:53:46.815758] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-08. [2025-09-17T18:53:46.860510] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T18:53:47.615799] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-07. [2025-09-17T18:53:47.957471] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T18:53:48.194483] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T18:53:48.415822] [INFO ] [REMOTE ] EVC: Fetching primary data for 2024-12. [2025-09-17T18:53:49.215872] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-08. [2025-09-17T18:53:49.786722] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T18:53:49.923067] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T18:53:50.015781] [INFO ] [REMOTE ] ETW: Fetching primary data for 2025-09. [2025-09-17T18:53:50.815753] [INFO ] [REMOTE ] ETX: Fetching primary data for 2025-09. [2025-09-17T18:53:51.088759] [INFO ] [REMOTE ] ETW: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T18:53:51.092054] [INFO ] [REMOTE ] ETW: Full fetch complete (36195 records). [2025-09-17T18:53:51.092139] [DEBUG] [VALIDATOR ] ETW: Validating primary data. [2025-09-17T18:53:51.444132] [INFO ] [REMOTE ] ETX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T18:53:51.477206] [DEBUG] [VALIDATOR ] ETW: All expected trading days are present. [2025-09-17T18:53:51.474522] [INFO ] [REMOTE ] ETX: Full fetch complete (6983 records). [2025-09-17T18:53:51.477593] [DEBUG] [VALIDATOR ] ETX: Validating primary data. [2025-09-17T18:53:51.477484] [DEBUG] [VALIDATOR ] ETW: Primary data validation passed. [2025-09-17T18:53:51.478731] [INFO ] [MAIN ] ETW: Fetched primary data is valid. [2025-09-17T18:53:51.478802] [DEBUG] [LOCAL ] ETW: Saving primary data. [2025-09-17T18:53:51.589771] [DEBUG] [LOCAL ] ETW: Trimmed 36195 records to 25306 (keeping 200 days of data) [2025-09-17T18:53:51.670262] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-01. [2025-09-17T18:53:51.979673] [DEBUG] [VALIDATOR ] ETX: All expected trading days are present. [2025-09-17T18:53:51.980333] [DEBUG] [VALIDATOR ] ETX: Primary data validation passed. [2025-09-17T18:53:51.981168] [INFO ] [MAIN ] ETX: Fetched primary data is valid. [2025-09-17T18:53:51.982748] [DEBUG] [LOCAL ] ETX: Saving primary data. [2025-09-17T18:53:51.987184] [DEBUG] [LOCAL ] ETX: Trimmed 6983 records to 4905 (keeping 200 days of data) [2025-09-17T18:53:52.023942] [DEBUG] [LOCAL ] ETX: Primary data saved (4905 records). [2025-09-17T18:53:52.024556] [INFO ] [MAIN ] ETX: Full history saved. [2025-09-17T18:53:52.025188] [INFO ] [MAIN ] Update Progress: 781/2371 symbols completed. ETX took 24.6s. Estimated remaining: 3h 51m 45s. Rate: 6.9 symbols/min [2025-09-17T18:53:52.221066] [INFO ] [MAIN ] EVEX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:53:52.237493] [DEBUG] [LOCAL ] ETW: Primary data saved (25306 records). [2025-09-17T18:53:52.237711] [INFO ] [MAIN ] ETW: Full history saved. [2025-09-17T18:53:52.237807] [INFO ] [MAIN ] Update Progress: 782/2371 symbols completed. ETW took 40.4s. Estimated remaining: 3h 51m 19s. Rate: 6.9 symbols/min [2025-09-17T18:53:52.424117] [DEBUG] [LOCAL ] EVEX: Loaded 28901 existing records from primary storage. [2025-09-17T18:53:52.423478] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-04. [2025-09-17T18:53:52.426945] [INFO ] [MAIN ] EVEX: Loaded 28901 existing records. [2025-09-17T18:53:52.426715] [INFO ] [MAIN ] EVF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:53:52.544788] [DEBUG] [LOCAL ] EVF: Loaded 9065 existing records from primary storage. [2025-09-17T18:53:52.590534] [INFO ] [MAIN ] EVF: Loaded 9065 existing records. [2025-09-17T18:53:52.688756] [WARN ] [MAIN ] EVEX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:53:52.700273] [INFO ] [MAIN ] EVEX: Wiping existing primary data before full refresh. [2025-09-17T18:53:52.716365] [INFO ] [LOCAL ] EVEX: Starting deletion of primary data. [2025-09-17T18:53:52.732610] [DEBUG] [LOCAL ] EVEX: Deleted primary data file. [2025-09-17T18:53:52.742905] [INFO ] [MAIN ] EVEX: Starting full primary refresh. [2025-09-17T18:53:52.935764] [WARN ] [MAIN ] EVF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:53:52.973736] [INFO ] [MAIN ] EVF: Wiping existing primary data before full refresh. [2025-09-17T18:53:53.025016] [INFO ] [LOCAL ] EVF: Starting deletion of primary data. [2025-09-17T18:53:53.049596] [DEBUG] [LOCAL ] EVF: Deleted primary data file. [2025-09-17T18:53:53.049922] [INFO ] [MAIN ] EVF: Starting full primary refresh. [2025-09-17T18:53:53.327921] [INFO ] [REMOTE ] EVEX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:53:53.355194] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-11. [2025-09-17T18:53:53.367784] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T18:53:53.580882] [INFO ] [REMOTE ] EVF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:53:53.758127] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T18:53:54.015835] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-11. [2025-09-17T18:53:54.328231] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T18:53:54.367933] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T18:53:54.815786] [INFO ] [REMOTE ] EVF: Fetching primary data for 2024-12. [2025-09-17T18:53:55.327550] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T18:53:55.615784] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-02. [2025-09-17T18:53:56.401519] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T18:53:56.415736] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-03. [2025-09-17T18:53:57.215788] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2024-12. [2025-09-17T18:53:57.702911] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T18:53:58.015833] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-04. [2025-09-17T18:53:58.521424] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T18:53:58.815786] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-05. [2025-09-17T18:53:58.898073] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T18:53:59.615902] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-01. [2025-09-17T18:53:59.948941] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T18:54:00.415777] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-05. [2025-09-17T18:54:00.525217] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T18:54:01.215825] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-02. [2025-09-17T18:54:01.708249] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T18:54:02.015848] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-06. [2025-09-17T18:54:02.815853] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-06. [2025-09-17T18:54:03.615944] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-01. [2025-09-17T18:54:03.636916] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-17T18:54:04.347734] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-06 (2.33 seconds). [2025-09-17T18:54:04.415802] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-03. [2025-09-17T18:54:04.912211] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T18:54:05.076440] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-06 (2.26 seconds). [2025-09-17T18:54:05.215827] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-07. [2025-09-17T18:54:05.923966] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T18:54:06.014104] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T18:54:06.018217] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-02. [2025-09-17T18:54:06.734580] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T18:54:06.815771] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-03. [2025-09-17T18:54:07.375852] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T18:54:07.615787] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-08. [2025-09-17T18:54:08.415772] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-04. [2025-09-17T18:54:08.605324] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T18:54:08.989951] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T18:54:09.215769] [INFO ] [REMOTE ] EVC: Fetching primary data for 2025-09. [2025-09-17T18:54:10.015765] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-04. [2025-09-17T18:54:10.298958] [INFO ] [REMOTE ] EVC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T18:54:10.301740] [INFO ] [REMOTE ] EVC: Full fetch complete (31264 records). [2025-09-17T18:54:10.301827] [DEBUG] [VALIDATOR ] EVC: Validating primary data. [2025-09-17T18:54:10.673867] [DEBUG] [VALIDATOR ] EVC: All expected trading days are present. [2025-09-17T18:54:10.673959] [DEBUG] [VALIDATOR ] EVC: Primary data validation passed. [2025-09-17T18:54:10.674491] [INFO ] [MAIN ] EVC: Fetched primary data is valid. [2025-09-17T18:54:10.674532] [DEBUG] [LOCAL ] EVC: Saving primary data. [2025-09-17T18:54:10.675436] [DEBUG] [LOCAL ] EVC: Trimmed 31264 records to 20341 (keeping 200 days of data) [2025-09-17T18:54:10.798301] [DEBUG] [LOCAL ] EVC: Primary data saved (20341 records). [2025-09-17T18:54:10.798443] [INFO ] [MAIN ] EVC: Full history saved. [2025-09-17T18:54:10.798561] [INFO ] [MAIN ] Update Progress: 783/2371 symbols completed. EVC took 29.0s. Estimated remaining: 3h 51m 30s. Rate: 6.9 symbols/min [2025-09-17T18:54:10.820928] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-05. [2025-09-17T18:54:10.969516] [INFO ] [MAIN ] EVG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:54:10.976901] [DEBUG] [LOCAL ] EVG: Loaded 5848 existing records from primary storage. [2025-09-17T18:54:10.977003] [INFO ] [MAIN ] EVG: Loaded 5848 existing records. [2025-09-17T18:54:11.154891] [WARN ] [MAIN ] EVG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:54:11.155236] [INFO ] [MAIN ] EVG: Wiping existing primary data before full refresh. [2025-09-17T18:54:11.155385] [INFO ] [LOCAL ] EVG: Starting deletion of primary data. [2025-09-17T18:54:11.160853] [DEBUG] [LOCAL ] EVG: Deleted primary data file. [2025-09-17T18:54:11.168352] [INFO ] [MAIN ] EVG: Starting full primary refresh. [2025-09-17T18:54:11.233769] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T18:54:11.534467] [INFO ] [REMOTE ] EVG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:54:11.539971] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T18:54:11.615725] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-11. [2025-09-17T18:54:12.208943] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T18:54:12.415771] [INFO ] [REMOTE ] EVG: Fetching primary data for 2024-12. [2025-09-17T18:54:13.215777] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-07. [2025-09-17T18:54:13.298323] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T18:54:14.015794] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-05. [2025-09-17T18:54:14.815801] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-06. [2025-09-17T18:54:15.136462] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T18:54:15.212053] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T18:54:15.523235] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T18:54:15.615807] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-08. [2025-09-17T18:54:16.415773] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-07. [2025-09-17T18:54:16.650296] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T18:54:17.215821] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-01. [2025-09-17T18:54:17.294010] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T18:54:17.803956] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T18:54:18.015780] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-06. [2025-09-17T18:54:18.815811] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-02. [2025-09-17T18:54:19.249930] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T18:54:19.303813] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T18:54:19.615786] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-07. [2025-09-17T18:54:20.415814] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-03. [2025-09-17T18:54:21.117470] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T18:54:21.130825] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T18:54:21.215803] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-08. [2025-09-17T18:54:22.015797] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-04. [2025-09-17T18:54:22.467347] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T18:54:22.637594] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T18:54:22.815794] [INFO ] [REMOTE ] ETY: Fetching primary data for 2025-09. [2025-09-17T18:54:23.615824] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-08. [2025-09-17T18:54:23.801975] [INFO ] [REMOTE ] ETY: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T18:54:23.806132] [INFO ] [REMOTE ] ETY: Full fetch complete (34471 records). [2025-09-17T18:54:23.806257] [DEBUG] [VALIDATOR ] ETY: Validating primary data. [2025-09-17T18:54:24.263766] [DEBUG] [VALIDATOR ] ETY: All expected trading days are present. [2025-09-17T18:54:24.263854] [DEBUG] [VALIDATOR ] ETY: Primary data validation passed. [2025-09-17T18:54:24.264385] [INFO ] [MAIN ] ETY: Fetched primary data is valid. [2025-09-17T18:54:24.264427] [DEBUG] [LOCAL ] ETY: Saving primary data. [2025-09-17T18:54:24.265374] [DEBUG] [LOCAL ] ETY: Trimmed 34471 records to 23047 (keeping 200 days of data) [2025-09-17T18:54:24.416383] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-05. [2025-09-17T18:54:24.419776] [DEBUG] [LOCAL ] ETY: Primary data saved (23047 records). [2025-09-17T18:54:24.419937] [INFO ] [MAIN ] ETY: Full history saved. [2025-09-17T18:54:24.420027] [INFO ] [MAIN ] Update Progress: 784/2371 symbols completed. ETY took 51.4s. Estimated remaining: 3h 51m 31s. Rate: 6.9 symbols/min [2025-09-17T18:54:24.544684] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T18:54:24.607283] [INFO ] [MAIN ] EVH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:54:24.653064] [DEBUG] [LOCAL ] EVH: Loaded 49360 existing records from primary storage. [2025-09-17T18:54:24.653220] [INFO ] [MAIN ] EVH: Loaded 49360 existing records. [2025-09-17T18:54:24.840065] [WARN ] [MAIN ] EVH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:54:24.840326] [INFO ] [MAIN ] EVH: Wiping existing primary data before full refresh. [2025-09-17T18:54:24.840370] [INFO ] [LOCAL ] EVH: Starting deletion of primary data. [2025-09-17T18:54:24.841485] [DEBUG] [LOCAL ] EVH: Deleted primary data file. [2025-09-17T18:54:24.841535] [INFO ] [MAIN ] EVH: Starting full primary refresh. [2025-09-17T18:54:25.206208] [INFO ] [REMOTE ] EVH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:54:25.215734] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-11. [2025-09-17T18:54:25.222949] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T18:54:26.015812] [INFO ] [REMOTE ] EVF: Fetching primary data for 2025-09. [2025-09-17T18:54:26.815785] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-06. [2025-09-17T18:54:27.071672] [INFO ] [REMOTE ] EVF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T18:54:27.073213] [INFO ] [REMOTE ] EVF: Full fetch complete (11618 records). [2025-09-17T18:54:27.073352] [DEBUG] [VALIDATOR ] EVF: Validating primary data. [2025-09-17T18:54:27.404364] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-11 (2.19 seconds). [2025-09-17T18:54:27.489022] [DEBUG] [VALIDATOR ] EVF: All expected trading days are present. [2025-09-17T18:54:27.492806] [DEBUG] [VALIDATOR ] EVF: Primary data validation passed. [2025-09-17T18:54:27.493169] [INFO ] [MAIN ] EVF: Fetched primary data is valid. [2025-09-17T18:54:27.493334] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T18:54:27.493425] [DEBUG] [LOCAL ] EVF: Saving primary data. [2025-09-17T18:54:27.495618] [DEBUG] [LOCAL ] EVF: Trimmed 11618 records to 9070 (keeping 200 days of data) [2025-09-17T18:54:27.550024] [DEBUG] [LOCAL ] EVF: Primary data saved (9070 records). [2025-09-17T18:54:27.550148] [INFO ] [MAIN ] EVF: Full history saved. [2025-09-17T18:54:27.550226] [INFO ] [MAIN ] Update Progress: 785/2371 symbols completed. EVF took 35.3s. Estimated remaining: 3h 51m 11s. Rate: 6.9 symbols/min [2025-09-17T18:54:27.620965] [INFO ] [REMOTE ] EVEX: Fetching primary data for 2025-09. [2025-09-17T18:54:27.728216] [INFO ] [MAIN ] EVN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:54:27.739527] [DEBUG] [LOCAL ] EVN: Loaded 10894 existing records from primary storage. [2025-09-17T18:54:27.739627] [INFO ] [MAIN ] EVN: Loaded 10894 existing records. [2025-09-17T18:54:27.915986] [WARN ] [MAIN ] EVN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:54:27.916228] [INFO ] [MAIN ] EVN: Wiping existing primary data before full refresh. [2025-09-17T18:54:27.916282] [INFO ] [LOCAL ] EVN: Starting deletion of primary data. [2025-09-17T18:54:27.916699] [DEBUG] [LOCAL ] EVN: Deleted primary data file. [2025-09-17T18:54:27.916746] [INFO ] [MAIN ] EVN: Starting full primary refresh. [2025-09-17T18:54:28.272344] [INFO ] [REMOTE ] EVN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:54:28.415775] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-11. [2025-09-17T18:54:29.215785] [INFO ] [REMOTE ] EVH: Fetching primary data for 2024-12. [2025-09-17T18:54:29.240523] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T18:54:29.328489] [INFO ] [REMOTE ] EVEX: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T18:54:29.334702] [INFO ] [REMOTE ] EVEX: Full fetch complete (40982 records). [2025-09-17T18:54:29.334797] [DEBUG] [VALIDATOR ] EVEX: Validating primary data. [2025-09-17T18:54:29.712916] [DEBUG] [VALIDATOR ] EVEX: All expected trading days are present. [2025-09-17T18:54:29.712995] [DEBUG] [VALIDATOR ] EVEX: Primary data validation passed. [2025-09-17T18:54:29.713607] [INFO ] [MAIN ] EVEX: Fetched primary data is valid. [2025-09-17T18:54:29.713679] [DEBUG] [LOCAL ] EVEX: Saving primary data. [2025-09-17T18:54:29.714670] [DEBUG] [LOCAL ] EVEX: Trimmed 40982 records to 29040 (keeping 200 days of data) [2025-09-17T18:54:29.874311] [DEBUG] [LOCAL ] EVEX: Primary data saved (29040 records). [2025-09-17T18:54:29.874445] [INFO ] [MAIN ] EVEX: Full history saved. [2025-09-17T18:54:29.874528] [INFO ] [MAIN ] Update Progress: 786/2371 symbols completed. EVEX took 37.8s. Estimated remaining: 3h 50m 50s. Rate: 6.9 symbols/min [2025-09-17T18:54:30.023896] [INFO ] [REMOTE ] EVN: Fetching primary data for 2024-12. [2025-09-17T18:54:30.049326] [INFO ] [MAIN ] EVR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:54:30.089912] [DEBUG] [LOCAL ] EVR: Loaded 35990 existing records from primary storage. [2025-09-17T18:54:30.090049] [INFO ] [MAIN ] EVR: Loaded 35990 existing records. [2025-09-17T18:54:30.273697] [WARN ] [MAIN ] EVR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:54:30.273958] [INFO ] [MAIN ] EVR: Wiping existing primary data before full refresh. [2025-09-17T18:54:30.274028] [INFO ] [LOCAL ] EVR: Starting deletion of primary data. [2025-09-17T18:54:30.274998] [DEBUG] [LOCAL ] EVR: Deleted primary data file. [2025-09-17T18:54:30.275060] [INFO ] [MAIN ] EVR: Starting full primary refresh. [2025-09-17T18:54:30.632807] [INFO ] [REMOTE ] EVR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:54:30.668856] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T18:54:30.815783] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-07. [2025-09-17T18:54:30.970440] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T18:54:31.508796] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T18:54:31.615808] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-11. [2025-09-17T18:54:32.415779] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-08. [2025-09-17T18:54:33.078151] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T18:54:33.147736] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T18:54:33.215795] [INFO ] [REMOTE ] EVR: Fetching primary data for 2024-12. [2025-09-17T18:54:34.015822] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-01. [2025-09-17T18:54:34.594925] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T18:54:34.815807] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-01. [2025-09-17T18:54:35.080579] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T18:54:35.615777] [INFO ] [REMOTE ] EVG: Fetching primary data for 2025-09. [2025-09-17T18:54:36.248874] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T18:54:36.370417] [INFO ] [REMOTE ] EVG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T18:54:36.371884] [INFO ] [REMOTE ] EVG: Full fetch complete (8086 records). [2025-09-17T18:54:36.371966] [DEBUG] [VALIDATOR ] EVG: Validating primary data. [2025-09-17T18:54:36.421019] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-02. [2025-09-17T18:54:36.742622] [DEBUG] [VALIDATOR ] EVG: All expected trading days are present. [2025-09-17T18:54:36.742724] [DEBUG] [VALIDATOR ] EVG: Primary data validation passed. [2025-09-17T18:54:36.742934] [INFO ] [MAIN ] EVG: Fetched primary data is valid. [2025-09-17T18:54:36.742974] [DEBUG] [LOCAL ] EVG: Saving primary data. [2025-09-17T18:54:36.743382] [DEBUG] [LOCAL ] EVG: Trimmed 8086 records to 5837 (keeping 200 days of data) [2025-09-17T18:54:36.780016] [DEBUG] [LOCAL ] EVG: Primary data saved (5837 records). [2025-09-17T18:54:36.780145] [INFO ] [MAIN ] EVG: Full history saved. [2025-09-17T18:54:36.780234] [INFO ] [MAIN ] Update Progress: 787/2371 symbols completed. EVG took 26.0s. Estimated remaining: 3h 50m 37s. Rate: 6.9 symbols/min [2025-09-17T18:54:36.947863] [INFO ] [MAIN ] EVT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:54:36.965775] [DEBUG] [LOCAL ] EVT: Loaded 17714 existing records from primary storage. [2025-09-17T18:54:36.965937] [INFO ] [MAIN ] EVT: Loaded 17714 existing records. [2025-09-17T18:54:37.142807] [WARN ] [MAIN ] EVT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:54:37.143049] [INFO ] [MAIN ] EVT: Wiping existing primary data before full refresh. [2025-09-17T18:54:37.143093] [INFO ] [LOCAL ] EVT: Starting deletion of primary data. [2025-09-17T18:54:37.143584] [DEBUG] [LOCAL ] EVT: Deleted primary data file. [2025-09-17T18:54:37.143628] [INFO ] [MAIN ] EVT: Starting full primary refresh. [2025-09-17T18:54:37.221042] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-01. [2025-09-17T18:54:37.500261] [INFO ] [REMOTE ] EVT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:54:38.025425] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-02. [2025-09-17T18:54:38.033531] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T18:54:38.388028] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T18:54:38.815790] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-11. [2025-09-17T18:54:38.847563] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T18:54:39.615840] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-03. [2025-09-17T18:54:39.657964] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T18:54:40.415848] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-03. [2025-09-17T18:54:41.215853] [INFO ] [REMOTE ] EVT: Fetching primary data for 2024-12. [2025-09-17T18:54:41.325940] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T18:54:41.369125] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T18:54:41.900899] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T18:54:42.015804] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-01. [2025-09-17T18:54:42.815766] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-04. [2025-09-17T18:54:43.083875] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T18:54:43.615816] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-02. [2025-09-17T18:54:43.673503] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T18:54:44.415834] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-02. [2025-09-17T18:54:44.740029] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T18:54:45.215797] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-04. [2025-09-17T18:54:45.870867] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T18:54:46.015791] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-03. [2025-09-17T18:54:46.601559] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T18:54:46.815842] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-03. [2025-09-17T18:54:47.559522] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T18:54:47.615786] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-04. [2025-09-17T18:54:47.839152] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T18:54:48.415781] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-05. [2025-09-17T18:54:49.121759] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T18:54:49.215822] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-04. [2025-09-17T18:54:49.702367] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T18:54:50.015781] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-05. [2025-09-17T18:54:50.305095] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T18:54:50.815751] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-05. [2025-09-17T18:54:50.862629] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T18:54:51.615830] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-06. [2025-09-17T18:54:51.869745] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T18:54:52.194686] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T18:54:52.415833] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-06. [2025-09-17T18:54:53.215783] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-05. [2025-09-17T18:54:54.015839] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-06. [2025-09-17T18:54:54.068860] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T18:54:54.298127] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T18:54:54.615422] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T18:54:54.815777] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-07. [2025-09-17T18:54:55.615794] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-06. [2025-09-17T18:54:55.811462] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T18:54:56.415773] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-08. [2025-09-17T18:54:56.772316] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T18:54:56.971502] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T18:54:57.215810] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-07. [2025-09-17T18:54:58.015819] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-07. [2025-09-17T18:54:58.476793] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T18:54:58.815832] [INFO ] [REMOTE ] EVT: Fetching primary data for 2025-09. [2025-09-17T18:54:59.452080] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T18:54:59.615838] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-07. [2025-09-17T18:54:59.736428] [INFO ] [REMOTE ] EVT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T18:54:59.738907] [INFO ] [REMOTE ] EVT: Full fetch complete (25688 records). [2025-09-17T18:54:59.738989] [DEBUG] [VALIDATOR ] EVT: Validating primary data. [2025-09-17T18:55:00.110863] [DEBUG] [VALIDATOR ] EVT: All expected trading days are present. [2025-09-17T18:55:00.110952] [DEBUG] [VALIDATOR ] EVT: Primary data validation passed. [2025-09-17T18:55:00.111508] [INFO ] [MAIN ] EVT: Fetched primary data is valid. [2025-09-17T18:55:00.111564] [DEBUG] [LOCAL ] EVT: Saving primary data. [2025-09-17T18:55:00.112400] [DEBUG] [LOCAL ] EVT: Trimmed 25688 records to 17711 (keeping 200 days of data) [2025-09-17T18:55:00.226705] [DEBUG] [LOCAL ] EVT: Primary data saved (17711 records). [2025-09-17T18:55:00.226862] [INFO ] [MAIN ] EVT: Full history saved. [2025-09-17T18:55:00.226964] [INFO ] [MAIN ] Update Progress: 788/2371 symbols completed. EVT took 23.4s. Estimated remaining: 3h 50m 58s. Rate: 6.9 symbols/min [2025-09-17T18:55:00.397756] [INFO ] [MAIN ] EVTC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:55:00.421891] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-08. [2025-09-17T18:55:00.424252] [DEBUG] [LOCAL ] EVTC: Loaded 26661 existing records from primary storage. [2025-09-17T18:55:00.424332] [INFO ] [MAIN ] EVTC: Loaded 26661 existing records. [2025-09-17T18:55:00.543733] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T18:55:00.612315] [WARN ] [MAIN ] EVTC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:55:00.612544] [INFO ] [MAIN ] EVTC: Wiping existing primary data before full refresh. [2025-09-17T18:55:00.612589] [INFO ] [LOCAL ] EVTC: Starting deletion of primary data. [2025-09-17T18:55:00.613325] [DEBUG] [LOCAL ] EVTC: Deleted primary data file. [2025-09-17T18:55:00.613374] [INFO ] [MAIN ] EVTC: Starting full primary refresh. [2025-09-17T18:55:00.970971] [INFO ] [REMOTE ] EVTC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:55:01.215789] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-11. [2025-09-17T18:55:01.914194] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T18:55:02.015832] [INFO ] [REMOTE ] EVR: Fetching primary data for 2025-09. [2025-09-17T18:55:02.080327] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T18:55:02.815866] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-08. [2025-09-17T18:55:03.407612] [INFO ] [REMOTE ] EVR: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T18:55:03.412341] [INFO ] [REMOTE ] EVR: Full fetch complete (50443 records). [2025-09-17T18:55:03.412506] [DEBUG] [VALIDATOR ] EVR: Validating primary data. [2025-09-17T18:55:03.620928] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-08. [2025-09-17T18:55:03.821727] [DEBUG] [VALIDATOR ] EVR: All expected trading days are present. [2025-09-17T18:55:03.821828] [DEBUG] [VALIDATOR ] EVR: Primary data validation passed. [2025-09-17T18:55:03.822503] [INFO ] [MAIN ] EVR: Fetched primary data is valid. [2025-09-17T18:55:03.822584] [DEBUG] [LOCAL ] EVR: Saving primary data. [2025-09-17T18:55:03.823935] [DEBUG] [LOCAL ] EVR: Trimmed 50443 records to 35950 (keeping 200 days of data) [2025-09-17T18:55:04.073242] [DEBUG] [LOCAL ] EVR: Primary data saved (35950 records). [2025-09-17T18:55:04.073424] [INFO ] [MAIN ] EVR: Full history saved. [2025-09-17T18:55:04.073528] [INFO ] [MAIN ] Update Progress: 789/2371 symbols completed. EVR took 34.2s. Estimated remaining: 3h 50m 39s. Rate: 6.9 symbols/min [2025-09-17T18:55:04.254940] [INFO ] [MAIN ] EVTL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:55:04.297991] [DEBUG] [LOCAL ] EVTL: Loaded 36188 existing records from primary storage. [2025-09-17T18:55:04.298188] [INFO ] [MAIN ] EVTL: Loaded 36188 existing records. [2025-09-17T18:55:04.419536] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2024-12. [2025-09-17T18:55:04.488596] [WARN ] [MAIN ] EVTL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:55:04.489261] [INFO ] [MAIN ] EVTL: Wiping existing primary data before full refresh. [2025-09-17T18:55:04.489346] [INFO ] [LOCAL ] EVTL: Starting deletion of primary data. [2025-09-17T18:55:04.490122] [DEBUG] [LOCAL ] EVTL: Deleted primary data file. [2025-09-17T18:55:04.490173] [INFO ] [MAIN ] EVTL: Starting full primary refresh. [2025-09-17T18:55:04.717158] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T18:55:04.812053] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T18:55:04.923558] [INFO ] [REMOTE ] EVTL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:55:05.215802] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-11. [2025-09-17T18:55:05.493957] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T18:55:06.015808] [INFO ] [REMOTE ] EVH: Fetching primary data for 2025-09. [2025-09-17T18:55:06.344086] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T18:55:06.815790] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-01. [2025-09-17T18:55:07.615773] [INFO ] [REMOTE ] EVN: Fetching primary data for 2025-09. [2025-09-17T18:55:07.704054] [INFO ] [REMOTE ] EVH: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T18:55:07.712237] [INFO ] [REMOTE ] EVH: Full fetch complete (71555 records). [2025-09-17T18:55:07.712409] [DEBUG] [VALIDATOR ] EVH: Validating primary data. [2025-09-17T18:55:08.128552] [DEBUG] [VALIDATOR ] EVH: All expected trading days are present. [2025-09-17T18:55:08.128688] [DEBUG] [VALIDATOR ] EVH: Primary data validation passed. [2025-09-17T18:55:08.134734] [INFO ] [MAIN ] EVH: Fetched primary data is valid. [2025-09-17T18:55:08.142380] [DEBUG] [LOCAL ] EVH: Saving primary data. [2025-09-17T18:55:08.143572] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T18:55:08.149903] [DEBUG] [LOCAL ] EVH: Trimmed 71555 records to 49333 (keeping 200 days of data) [2025-09-17T18:55:08.246636] [INFO ] [REMOTE ] EVN: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T18:55:08.250351] [INFO ] [REMOTE ] EVN: Full fetch complete (17447 records). [2025-09-17T18:55:08.251212] [DEBUG] [VALIDATOR ] EVN: Validating primary data. [2025-09-17T18:55:08.416974] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-02. [2025-09-17T18:55:08.712675] [DEBUG] [VALIDATOR ] EVN: All expected trading days are present. [2025-09-17T18:55:08.721700] [DEBUG] [VALIDATOR ] EVN: Primary data validation passed. [2025-09-17T18:55:08.722166] [INFO ] [MAIN ] EVN: Fetched primary data is valid. [2025-09-17T18:55:08.722224] [DEBUG] [LOCAL ] EVN: Saving primary data. [2025-09-17T18:55:08.752946] [DEBUG] [LOCAL ] EVN: Trimmed 17447 records to 10928 (keeping 200 days of data) [2025-09-17T18:55:08.838740] [DEBUG] [LOCAL ] EVN: Primary data saved (10928 records). [2025-09-17T18:55:08.841383] [INFO ] [MAIN ] EVN: Full history saved. [2025-09-17T18:55:08.842014] [INFO ] [MAIN ] Update Progress: 790/2371 symbols completed. EVN took 41.3s. Estimated remaining: 3h 50m 23s. Rate: 6.9 symbols/min [2025-09-17T18:55:09.074868] [INFO ] [MAIN ] EVTR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:55:09.097527] [DEBUG] [LOCAL ] EVH: Primary data saved (49333 records). [2025-09-17T18:55:09.097737] [INFO ] [MAIN ] EVH: Full history saved. [2025-09-17T18:55:09.097850] [INFO ] [MAIN ] Update Progress: 791/2371 symbols completed. EVH took 44.7s. Estimated remaining: 3h 49m 57s. Rate: 6.9 symbols/min [2025-09-17T18:55:09.211679] [DEBUG] [LOCAL ] EVTR: Loaded 22682 existing records from primary storage. [2025-09-17T18:55:09.222432] [INFO ] [MAIN ] EVTR: Loaded 22682 existing records. [2025-09-17T18:55:09.222528] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2024-12. [2025-09-17T18:55:09.357605] [INFO ] [MAIN ] EW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:55:09.471209] [WARN ] [MAIN ] EVTR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:55:09.471566] [INFO ] [MAIN ] EVTR: Wiping existing primary data before full refresh. [2025-09-17T18:55:09.471624] [INFO ] [LOCAL ] EVTR: Starting deletion of primary data. [2025-09-17T18:55:09.472418] [DEBUG] [LOCAL ] EVTR: Deleted primary data file. [2025-09-17T18:55:09.472489] [INFO ] [MAIN ] EVTR: Starting full primary refresh. [2025-09-17T18:55:09.769365] [DEBUG] [LOCAL ] EW: Loaded 53396 existing records from primary storage. [2025-09-17T18:55:09.779951] [INFO ] [MAIN ] EW: Loaded 53396 existing records. [2025-09-17T18:55:10.001933] [INFO ] [REMOTE ] EVTR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:55:10.068405] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-11. [2025-09-17T18:55:10.074161] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T18:55:10.074276] [WARN ] [MAIN ] EW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:55:10.080468] [INFO ] [MAIN ] EW: Wiping existing primary data before full refresh. [2025-09-17T18:55:10.080614] [INFO ] [LOCAL ] EW: Starting deletion of primary data. [2025-09-17T18:55:10.082022] [DEBUG] [LOCAL ] EW: Deleted primary data file. [2025-09-17T18:55:10.082078] [INFO ] [MAIN ] EW: Starting full primary refresh. [2025-09-17T18:55:10.485419] [INFO ] [REMOTE ] EW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:55:10.590315] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T18:55:10.815783] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-11. [2025-09-17T18:55:11.114130] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T18:55:11.615789] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-01. [2025-09-17T18:55:12.415915] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T18:55:12.416231] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2024-12. [2025-09-17T18:55:13.218116] [INFO ] [REMOTE ] EW: Fetching primary data for 2024-12. [2025-09-17T18:55:13.221293] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T18:55:13.533556] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T18:55:14.015771] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-03. [2025-09-17T18:55:14.815828] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-02. [2025-09-17T18:55:15.055071] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T18:55:15.084219] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T18:55:15.615776] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-01. [2025-09-17T18:55:16.336718] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T18:55:16.415790] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-03. [2025-09-17T18:55:17.215776] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-01. [2025-09-17T18:55:17.326393] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T18:55:17.430168] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T18:55:18.015806] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-02. [2025-09-17T18:55:18.177134] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T18:55:18.815881] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-04. [2025-09-17T18:55:19.615801] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-02. [2025-09-17T18:55:19.684225] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T18:55:19.786867] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T18:55:20.415795] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-05. [2025-09-17T18:55:20.606730] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T18:55:21.215834] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-04. [2025-09-17T18:55:21.723930] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T18:55:22.015775] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-06. [2025-09-17T18:55:22.178504] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T18:55:22.815843] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-05. [2025-09-17T18:55:23.101761] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T18:55:23.615813] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-03. [2025-09-17T18:55:24.323743] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T18:55:24.343001] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T18:55:24.415784] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-06. [2025-09-17T18:55:25.215795] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-07. [2025-09-17T18:55:25.830552] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T18:55:26.015800] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-03. [2025-09-17T18:55:26.398021] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T18:55:26.815852] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-08. [2025-09-17T18:55:27.615790] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-07. [2025-09-17T18:55:27.911696] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T18:55:28.151936] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T18:55:28.415852] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-04. [2025-09-17T18:55:29.215951] [INFO ] [REMOTE ] EVTC: Fetching primary data for 2025-09. [2025-09-17T18:55:29.683594] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T18:55:30.015839] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-08. [2025-09-17T18:55:30.289400] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T18:55:30.311204] [INFO ] [REMOTE ] EVTC: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T18:55:30.315107] [INFO ] [REMOTE ] EVTC: Full fetch complete (37706 records). [2025-09-17T18:55:30.315227] [DEBUG] [VALIDATOR ] EVTC: Validating primary data. [2025-09-17T18:55:30.684815] [DEBUG] [VALIDATOR ] EVTC: All expected trading days are present. [2025-09-17T18:55:30.684893] [DEBUG] [VALIDATOR ] EVTC: Primary data validation passed. [2025-09-17T18:55:30.685396] [INFO ] [MAIN ] EVTC: Fetched primary data is valid. [2025-09-17T18:55:30.685435] [DEBUG] [LOCAL ] EVTC: Saving primary data. [2025-09-17T18:55:30.686506] [DEBUG] [LOCAL ] EVTC: Trimmed 37706 records to 26671 (keeping 200 days of data) [2025-09-17T18:55:30.826962] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-05. [2025-09-17T18:55:30.850544] [DEBUG] [LOCAL ] EVTC: Primary data saved (26671 records). [2025-09-17T18:55:30.850946] [INFO ] [MAIN ] EVTC: Full history saved. [2025-09-17T18:55:30.851042] [INFO ] [MAIN ] Update Progress: 792/2371 symbols completed. EVTC took 30.6s. Estimated remaining: 3h 50m 14s. Rate: 6.9 symbols/min [2025-09-17T18:55:31.025992] [INFO ] [MAIN ] EXG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:55:31.064228] [DEBUG] [LOCAL ] EXG: Loaded 34986 existing records from primary storage. [2025-09-17T18:55:31.064399] [INFO ] [MAIN ] EXG: Loaded 34986 existing records. [2025-09-17T18:55:31.244102] [WARN ] [MAIN ] EXG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:55:31.244378] [INFO ] [MAIN ] EXG: Wiping existing primary data before full refresh. [2025-09-17T18:55:31.244431] [INFO ] [LOCAL ] EXG: Starting deletion of primary data. [2025-09-17T18:55:31.245200] [DEBUG] [LOCAL ] EXG: Deleted primary data file. [2025-09-17T18:55:31.245255] [INFO ] [MAIN ] EXG: Starting full primary refresh. [2025-09-17T18:55:31.618415] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-04. [2025-09-17T18:55:31.624028] [INFO ] [REMOTE ] EXG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:55:31.652553] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T18:55:32.415783] [INFO ] [REMOTE ] EVTL: Fetching primary data for 2025-09. [2025-09-17T18:55:32.692933] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T18:55:32.719223] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T18:55:33.215785] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-11. [2025-09-17T18:55:33.838244] [INFO ] [REMOTE ] EVTL: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T18:55:33.845075] [INFO ] [REMOTE ] EVTL: Full fetch complete (49729 records). [2025-09-17T18:55:33.845458] [DEBUG] [VALIDATOR ] EVTL: Validating primary data. [2025-09-17T18:55:34.036989] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-06. [2025-09-17T18:55:34.249275] [DEBUG] [VALIDATOR ] EVTL: All expected trading days are present. [2025-09-17T18:55:34.249358] [DEBUG] [VALIDATOR ] EVTL: Primary data validation passed. [2025-09-17T18:55:34.250017] [INFO ] [MAIN ] EVTL: Fetched primary data is valid. [2025-09-17T18:55:34.250083] [DEBUG] [LOCAL ] EVTL: Saving primary data. [2025-09-17T18:55:34.251410] [DEBUG] [LOCAL ] EVTL: Trimmed 49729 records to 36355 (keeping 200 days of data) [2025-09-17T18:55:34.458719] [DEBUG] [LOCAL ] EVTL: Primary data saved (36355 records). [2025-09-17T18:55:34.458896] [INFO ] [MAIN ] EVTL: Full history saved. [2025-09-17T18:55:34.459047] [INFO ] [MAIN ] Update Progress: 793/2371 symbols completed. EVTL took 30.4s. Estimated remaining: 3h 49m 55s. Rate: 6.9 symbols/min [2025-09-17T18:55:34.634508] [INFO ] [MAIN ] EXK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:55:34.656550] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T18:55:34.709224] [DEBUG] [LOCAL ] EXK: Loaded 53059 existing records from primary storage. [2025-09-17T18:55:34.709450] [INFO ] [MAIN ] EXK: Loaded 53059 existing records. [2025-09-17T18:55:34.820943] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-05. [2025-09-17T18:55:34.892588] [WARN ] [MAIN ] EXK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:55:34.892952] [INFO ] [MAIN ] EXK: Wiping existing primary data before full refresh. [2025-09-17T18:55:34.892998] [INFO ] [LOCAL ] EXK: Starting deletion of primary data. [2025-09-17T18:55:34.893950] [DEBUG] [LOCAL ] EXK: Deleted primary data file. [2025-09-17T18:55:34.894000] [INFO ] [MAIN ] EXK: Starting full primary refresh. [2025-09-17T18:55:35.257724] [INFO ] [REMOTE ] EXK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:55:35.615748] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-11. [2025-09-17T18:55:35.725302] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T18:55:35.855259] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T18:55:36.415785] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-06. [2025-09-17T18:55:37.099852] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T18:55:37.215761] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-07. [2025-09-17T18:55:37.470115] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T18:55:38.015787] [INFO ] [REMOTE ] EXG: Fetching primary data for 2024-12. [2025-09-17T18:55:38.645804] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T18:55:38.815812] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-07. [2025-09-17T18:55:39.379807] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T18:55:39.615792] [INFO ] [REMOTE ] EXK: Fetching primary data for 2024-12. [2025-09-17T18:55:39.890731] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T18:55:40.415789] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-01. [2025-09-17T18:55:41.215845] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-08. [2025-09-17T18:55:41.569044] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T18:55:41.760719] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T18:55:42.015829] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-02. [2025-09-17T18:55:42.686847] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T18:55:42.815822] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-08. [2025-09-17T18:55:43.312681] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T18:55:43.615779] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-03. [2025-09-17T18:55:43.672957] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T18:55:44.415777] [INFO ] [REMOTE ] EVTR: Fetching primary data for 2025-09. [2025-09-17T18:55:44.751522] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T18:55:45.215776] [INFO ] [REMOTE ] EW: Fetching primary data for 2025-09. [2025-09-17T18:55:45.776363] [INFO ] [REMOTE ] EVTR: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T18:55:45.781601] [INFO ] [REMOTE ] EVTR: Full fetch complete (30991 records). [2025-09-17T18:55:45.781748] [DEBUG] [VALIDATOR ] EVTR: Validating primary data. [2025-09-17T18:55:46.020876] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-01. [2025-09-17T18:55:46.168935] [DEBUG] [VALIDATOR ] EVTR: All expected trading days are present. [2025-09-17T18:55:46.169049] [DEBUG] [VALIDATOR ] EVTR: Primary data validation passed. [2025-09-17T18:55:46.169555] [INFO ] [MAIN ] EVTR: Fetched primary data is valid. [2025-09-17T18:55:46.169594] [DEBUG] [LOCAL ] EVTR: Saving primary data. [2025-09-17T18:55:46.170669] [DEBUG] [LOCAL ] EVTR: Trimmed 30991 records to 22776 (keeping 200 days of data) [2025-09-17T18:55:46.319667] [DEBUG] [LOCAL ] EVTR: Primary data saved (22776 records). [2025-09-17T18:55:46.319795] [INFO ] [MAIN ] EVTR: Full history saved. [2025-09-17T18:55:46.319915] [INFO ] [MAIN ] Update Progress: 794/2371 symbols completed. EVTR took 37.5s. Estimated remaining: 3h 49m 53s. Rate: 6.9 symbols/min [2025-09-17T18:55:46.504217] [INFO ] [MAIN ] EXP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:55:46.540445] [DEBUG] [LOCAL ] EXP: Loaded 30245 existing records from primary storage. [2025-09-17T18:55:46.540613] [INFO ] [MAIN ] EXP: Loaded 30245 existing records. [2025-09-17T18:55:46.729093] [WARN ] [MAIN ] EXP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:55:46.729365] [INFO ] [MAIN ] EXP: Wiping existing primary data before full refresh. [2025-09-17T18:55:46.729416] [INFO ] [LOCAL ] EXP: Starting deletion of primary data. [2025-09-17T18:55:46.730086] [DEBUG] [LOCAL ] EXP: Deleted primary data file. [2025-09-17T18:55:46.730140] [INFO ] [MAIN ] EXP: Starting full primary refresh. [2025-09-17T18:55:46.823390] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-04. [2025-09-17T18:55:47.104421] [INFO ] [REMOTE ] EXP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:55:47.124858] [INFO ] [REMOTE ] EW: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T18:55:47.133227] [INFO ] [REMOTE ] EW: Full fetch complete (77186 records). [2025-09-17T18:55:47.133373] [DEBUG] [VALIDATOR ] EW: Validating primary data. [2025-09-17T18:55:47.528234] [DEBUG] [VALIDATOR ] EW: All expected trading days are present. [2025-09-17T18:55:47.528330] [DEBUG] [VALIDATOR ] EW: Primary data validation passed. [2025-09-17T18:55:47.529231] [INFO ] [MAIN ] EW: Fetched primary data is valid. [2025-09-17T18:55:47.529284] [DEBUG] [LOCAL ] EW: Saving primary data. [2025-09-17T18:55:47.531241] [DEBUG] [LOCAL ] EW: Trimmed 77186 records to 53397 (keeping 200 days of data) [2025-09-17T18:55:47.627352] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-11. [2025-09-17T18:55:47.888465] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T18:55:47.911575] [DEBUG] [LOCAL ] EW: Primary data saved (53397 records). [2025-09-17T18:55:47.911727] [INFO ] [MAIN ] EW: Full history saved. [2025-09-17T18:55:47.911829] [INFO ] [MAIN ] Update Progress: 795/2371 symbols completed. EW took 38.8s. Estimated remaining: 3h 49m 30s. Rate: 6.9 symbols/min [2025-09-17T18:55:48.083925] [INFO ] [MAIN ] EXPD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:55:48.134710] [DEBUG] [LOCAL ] EXPD: Loaded 48243 existing records from primary storage. [2025-09-17T18:55:48.134885] [INFO ] [MAIN ] EXPD: Loaded 48243 existing records. [2025-09-17T18:55:48.313106] [WARN ] [MAIN ] EXPD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:55:48.313406] [INFO ] [MAIN ] EXPD: Wiping existing primary data before full refresh. [2025-09-17T18:55:48.313451] [INFO ] [LOCAL ] EXPD: Starting deletion of primary data. [2025-09-17T18:55:48.314500] [DEBUG] [LOCAL ] EXPD: Deleted primary data file. [2025-09-17T18:55:48.314550] [INFO ] [MAIN ] EXPD: Starting full primary refresh. [2025-09-17T18:55:48.416586] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-02. [2025-09-17T18:55:48.698783] [INFO ] [REMOTE ] EXPD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:55:48.722872] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T18:55:48.988425] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T18:55:49.215804] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-11. [2025-09-17T18:55:50.015799] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-05. [2025-09-17T18:55:50.169945] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T18:55:50.815767] [INFO ] [REMOTE ] EXP: Fetching primary data for 2024-12. [2025-09-17T18:55:50.880476] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T18:55:51.396300] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T18:55:51.615778] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-03. [2025-09-17T18:55:52.104330] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T18:55:52.415819] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-01. [2025-09-17T18:55:53.215745] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2024-12. [2025-09-17T18:55:53.454047] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T18:55:53.466577] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T18:55:54.015782] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-06. [2025-09-17T18:55:54.815794] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-02. [2025-09-17T18:55:54.858990] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T18:55:55.432480] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T18:55:55.615790] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-01. [2025-09-17T18:55:56.128392] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T18:55:56.415786] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-03. [2025-09-17T18:55:56.931055] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T18:55:57.215789] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-02. [2025-09-17T18:55:57.385895] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T18:55:58.015775] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-04. [2025-09-17T18:55:58.815809] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-07. [2025-09-17T18:55:58.827737] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T18:55:59.615832] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-04. [2025-09-17T18:55:59.899696] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T18:56:00.005037] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T18:56:00.415795] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-03. [2025-09-17T18:56:00.683249] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T18:56:01.215775] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-05. [2025-09-17T18:56:02.015774] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-05. [2025-09-17T18:56:02.159055] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T18:56:02.310180] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T18:56:02.815824] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-04. [2025-09-17T18:56:03.615836] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-06. [2025-09-17T18:56:04.118142] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T18:56:04.415783] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-06. [2025-09-17T18:56:04.640466] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T18:56:04.692364] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T18:56:05.215776] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-07. [2025-09-17T18:56:05.907383] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T18:56:06.015784] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-05. [2025-09-17T18:56:06.383514] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T18:56:06.815816] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-07. [2025-09-17T18:56:07.615795] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-08. [2025-09-17T18:56:07.693022] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T18:56:08.415777] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-06. [2025-09-17T18:56:08.810776] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T18:56:08.871745] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T18:56:09.215777] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-08. [2025-09-17T18:56:09.699938] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T18:56:10.015781] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-07. [2025-09-17T18:56:10.069121] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T18:56:10.815779] [INFO ] [REMOTE ] EXP: Fetching primary data for 2025-09. [2025-09-17T18:56:11.615788] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-08. [2025-09-17T18:56:11.661264] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T18:56:12.143243] [INFO ] [REMOTE ] EXP: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T18:56:12.147812] [INFO ] [REMOTE ] EXP: Full fetch complete (42950 records). [2025-09-17T18:56:12.147961] [DEBUG] [VALIDATOR ] EXP: Validating primary data. [2025-09-17T18:56:12.420897] [INFO ] [REMOTE ] EXG: Fetching primary data for 2025-09. [2025-09-17T18:56:12.532749] [DEBUG] [VALIDATOR ] EXP: All expected trading days are present. [2025-09-17T18:56:12.532830] [DEBUG] [VALIDATOR ] EXP: Primary data validation passed. [2025-09-17T18:56:12.533414] [INFO ] [MAIN ] EXP: Fetched primary data is valid. [2025-09-17T18:56:12.533455] [DEBUG] [LOCAL ] EXP: Saving primary data. [2025-09-17T18:56:12.534513] [DEBUG] [LOCAL ] EXP: Trimmed 42950 records to 30344 (keeping 200 days of data) [2025-09-17T18:56:12.726818] [DEBUG] [LOCAL ] EXP: Primary data saved (30344 records). [2025-09-17T18:56:12.726950] [INFO ] [MAIN ] EXP: Full history saved. [2025-09-17T18:56:12.727032] [INFO ] [MAIN ] Update Progress: 796/2371 symbols completed. EXP took 26.4s. Estimated remaining: 3h 49m 53s. Rate: 6.9 symbols/min [2025-09-17T18:56:12.900401] [INFO ] [MAIN ] EXR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:56:12.946732] [DEBUG] [LOCAL ] EXR: Loaded 45648 existing records from primary storage. [2025-09-17T18:56:12.946872] [INFO ] [MAIN ] EXR: Loaded 45648 existing records. [2025-09-17T18:56:13.123184] [WARN ] [MAIN ] EXR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:56:13.123424] [INFO ] [MAIN ] EXR: Wiping existing primary data before full refresh. [2025-09-17T18:56:13.123469] [INFO ] [LOCAL ] EXR: Starting deletion of primary data. [2025-09-17T18:56:13.124403] [DEBUG] [LOCAL ] EXR: Deleted primary data file. [2025-09-17T18:56:13.124452] [INFO ] [MAIN ] EXR: Starting full primary refresh. [2025-09-17T18:56:13.222816] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-08. [2025-09-17T18:56:13.493826] [INFO ] [REMOTE ] EXR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:56:13.577053] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T18:56:13.598254] [INFO ] [REMOTE ] EXG: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T18:56:13.602849] [INFO ] [REMOTE ] EXG: Full fetch complete (50118 records). [2025-09-17T18:56:13.602946] [DEBUG] [VALIDATOR ] EXG: Validating primary data. [2025-09-17T18:56:13.978292] [DEBUG] [VALIDATOR ] EXG: All expected trading days are present. [2025-09-17T18:56:13.978378] [DEBUG] [VALIDATOR ] EXG: Primary data validation passed. [2025-09-17T18:56:13.979048] [INFO ] [MAIN ] EXG: Fetched primary data is valid. [2025-09-17T18:56:13.979093] [DEBUG] [LOCAL ] EXG: Saving primary data. [2025-09-17T18:56:13.980238] [DEBUG] [LOCAL ] EXG: Trimmed 50118 records to 34879 (keeping 200 days of data) [2025-09-17T18:56:14.032967] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-11. [2025-09-17T18:56:14.189276] [DEBUG] [LOCAL ] EXG: Primary data saved (34879 records). [2025-09-17T18:56:14.189417] [INFO ] [MAIN ] EXG: Full history saved. [2025-09-17T18:56:14.189515] [INFO ] [MAIN ] Update Progress: 797/2371 symbols completed. EXG took 43.3s. Estimated remaining: 3h 49m 30s. Rate: 6.9 symbols/min [2025-09-17T18:56:14.815760] [INFO ] [REMOTE ] EXK: Fetching primary data for 2025-09. [2025-09-17T18:56:14.927492] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T18:56:15.615791] [INFO ] [REMOTE ] EXPD: Fetching primary data for 2025-09. [2025-09-17T18:56:15.980788] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-17T18:56:16.415747] [INFO ] [REMOTE ] EXR: Fetching primary data for 2024-12. [2025-09-17T18:56:16.862255] [INFO ] [REMOTE ] EXK: Incremental fetch complete for 2025-09 (2.05 seconds). [2025-09-17T18:56:16.869287] [INFO ] [REMOTE ] EXK: Full fetch complete (76253 records). [2025-09-17T18:56:16.869423] [DEBUG] [VALIDATOR ] EXK: Validating primary data. [2025-09-17T18:56:17.280521] [DEBUG] [VALIDATOR ] EXK: All expected trading days are present. [2025-09-17T18:56:17.280789] [DEBUG] [VALIDATOR ] EXK: Primary data validation passed. [2025-09-17T18:56:17.281865] [INFO ] [MAIN ] EXK: Fetched primary data is valid. [2025-09-17T18:56:17.281985] [DEBUG] [LOCAL ] EXK: Saving primary data. [2025-09-17T18:56:17.299122] [DEBUG] [LOCAL ] EXK: Trimmed 76253 records to 53075 (keeping 200 days of data) [2025-09-17T18:56:17.300769] [INFO ] [REMOTE ] EXPD: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T18:56:17.307513] [INFO ] [REMOTE ] EXPD: Full fetch complete (68913 records). [2025-09-17T18:56:17.307732] [DEBUG] [VALIDATOR ] EXPD: Validating primary data. [2025-09-17T18:56:17.838151] [DEBUG] [VALIDATOR ] EXPD: All expected trading days are present. [2025-09-17T18:56:17.838727] [DEBUG] [VALIDATOR ] EXPD: Primary data validation passed. [2025-09-17T18:56:17.840255] [INFO ] [MAIN ] EXPD: Fetched primary data is valid. [2025-09-17T18:56:17.840657] [DEBUG] [LOCAL ] EXPD: Saving primary data. [2025-09-17T18:56:17.847343] [DEBUG] [LOCAL ] EXPD: Trimmed 68913 records to 48206 (keeping 200 days of data) [2025-09-17T18:56:18.188266] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T18:56:18.203226] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-01. [2025-09-17T18:56:18.309010] [DEBUG] [LOCAL ] EXK: Primary data saved (53075 records). [2025-09-17T18:56:18.310479] [INFO ] [MAIN ] EXK: Full history saved. [2025-09-17T18:56:18.310980] [INFO ] [MAIN ] Update Progress: 798/2371 symbols completed. EXK took 43.9s. Estimated remaining: 3h 49m 12s. Rate: 6.9 symbols/min [2025-09-17T18:56:18.386153] [DEBUG] [LOCAL ] EXPD: Primary data saved (48206 records). [2025-09-17T18:56:18.386310] [INFO ] [MAIN ] EXPD: Full history saved. [2025-09-17T18:56:18.386422] [INFO ] [MAIN ] Update Progress: 799/2371 symbols completed. EXPD took 30.5s. Estimated remaining: 3h 48m 46s. Rate: 6.9 symbols/min [2025-09-17T18:56:19.823832] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T18:56:19.833444] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-02. [2025-09-17T18:56:21.105654] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T18:56:21.115911] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-03. [2025-09-17T18:56:22.772689] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T18:56:22.783132] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-04. [2025-09-17T18:56:24.311591] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T18:56:24.321838] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-05. [2025-09-17T18:56:25.934488] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T18:56:25.943918] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-06. [2025-09-17T18:56:27.511126] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T18:56:27.522147] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-07. [2025-09-17T18:56:29.216112] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T18:56:29.226533] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-08. [2025-09-17T18:56:30.594711] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T18:56:30.605365] [INFO ] [REMOTE ] EXR: Fetching primary data for 2025-09. [2025-09-17T18:56:32.274794] [INFO ] [REMOTE ] EXR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T18:56:32.280907] [INFO ] [REMOTE ] EXR: Full fetch complete (65554 records). [2025-09-17T18:56:32.281034] [DEBUG] [VALIDATOR ] EXR: Validating primary data. [2025-09-17T18:56:32.675474] [DEBUG] [VALIDATOR ] EXR: All expected trading days are present. [2025-09-17T18:56:32.675561] [DEBUG] [VALIDATOR ] EXR: Primary data validation passed. [2025-09-17T18:56:32.676379] [INFO ] [MAIN ] EXR: Fetched primary data is valid. [2025-09-17T18:56:32.676426] [DEBUG] [LOCAL ] EXR: Saving primary data. [2025-09-17T18:56:32.677740] [DEBUG] [LOCAL ] EXR: Trimmed 65554 records to 45616 (keeping 200 days of data) [2025-09-17T18:56:32.969237] [DEBUG] [LOCAL ] EXR: Primary data saved (45616 records). [2025-09-17T18:56:32.969368] [INFO ] [MAIN ] EXR: Full history saved. [2025-09-17T18:56:32.970009] [INFO ] [MAIN ] Update Progress: 800/2371 symbols completed. EXR took 20.2s. Estimated remaining: 3h 48m 49s. Rate: 6.9 symbols/min [2025-09-17T18:56:33.610402] [INFO ] [MAIN ] FBIN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:56:33.617268] [INFO ] [MAIN ] FAF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:56:33.771670] [INFO ] [MAIN ] F: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:56:33.775452] [INFO ] [MAIN ] FBK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:56:33.816901] [DEBUG] [LOCAL ] FBK: Loaded 25177 existing records from primary storage. [2025-09-17T18:56:33.830594] [INFO ] [MAIN ] FBK: Loaded 25177 existing records. [2025-09-17T18:56:33.977079] [DEBUG] [LOCAL ] FAF: Loaded 42029 existing records from primary storage. [2025-09-17T18:56:33.981941] [DEBUG] [LOCAL ] FBIN: Loaded 50474 existing records from primary storage. [2025-09-17T18:56:33.982321] [INFO ] [MAIN ] FBIN: Loaded 50474 existing records. [2025-09-17T18:56:33.982048] [INFO ] [MAIN ] FAF: Loaded 42029 existing records. [2025-09-17T18:56:34.114953] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-17T18:56:34.245504] [INFO ] [MAIN ] F: Loaded 53820 existing records. [2025-09-17T18:56:34.235174] [WARN ] [MAIN ] FBK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:56:34.312614] [INFO ] [MAIN ] FBK: Wiping existing primary data before full refresh. [2025-09-17T18:56:34.354518] [INFO ] [LOCAL ] FBK: Starting deletion of primary data. [2025-09-17T18:56:34.439366] [DEBUG] [LOCAL ] FBK: Deleted primary data file. [2025-09-17T18:56:34.535075] [INFO ] [MAIN ] FBK: Starting full primary refresh. [2025-09-17T18:56:34.540359] [WARN ] [MAIN ] FBIN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:56:34.604407] [INFO ] [MAIN ] FBIN: Wiping existing primary data before full refresh. [2025-09-17T18:56:34.637906] [INFO ] [LOCAL ] FBIN: Starting deletion of primary data. [2025-09-17T18:56:34.604521] [WARN ] [MAIN ] FAF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:56:34.674561] [DEBUG] [LOCAL ] FBIN: Deleted primary data file. [2025-09-17T18:56:34.713306] [INFO ] [MAIN ] FAF: Wiping existing primary data before full refresh. [2025-09-17T18:56:34.713207] [INFO ] [MAIN ] FBIN: Starting full primary refresh. [2025-09-17T18:56:34.746592] [INFO ] [LOCAL ] FAF: Starting deletion of primary data. [2025-09-17T18:56:34.788432] [DEBUG] [LOCAL ] FAF: Deleted primary data file. [2025-09-17T18:56:34.755362] [WARN ] [MAIN ] F: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:56:34.789159] [INFO ] [MAIN ] F: Wiping existing primary data before full refresh. [2025-09-17T18:56:34.809799] [INFO ] [LOCAL ] F: Starting deletion of primary data. [2025-09-17T18:56:34.788793] [INFO ] [MAIN ] FAF: Starting full primary refresh. [2025-09-17T18:56:34.985883] [DEBUG] [LOCAL ] F: Deleted primary data file. [2025-09-17T18:56:35.044390] [INFO ] [MAIN ] F: Starting full primary refresh. [2025-09-17T18:56:35.800700] [INFO ] [REMOTE ] FBK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:56:35.892792] [INFO ] [REMOTE ] FBIN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:56:35.922375] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-11. [2025-09-17T18:56:35.943516] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-11. [2025-09-17T18:56:36.093390] [INFO ] [REMOTE ] F: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:56:36.106039] [INFO ] [REMOTE ] F: Fetching primary data for 2024-11. [2025-09-17T18:56:36.105788] [INFO ] [REMOTE ] FAF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:56:36.107135] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-11. [2025-09-17T18:56:36.993225] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T18:56:36.997564] [INFO ] [REMOTE ] FBK: Fetching primary data for 2024-12. [2025-09-17T18:56:37.564372] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T18:56:37.574383] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2024-12. [2025-09-17T18:56:37.599273] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T18:56:37.607190] [INFO ] [REMOTE ] FAF: Fetching primary data for 2024-12. [2025-09-17T18:56:37.973425] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T18:56:37.977180] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-01. [2025-09-17T18:56:38.226943] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-17T18:56:38.238856] [INFO ] [REMOTE ] F: Fetching primary data for 2024-12. [2025-09-17T18:56:38.615711] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T18:56:38.620080] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-02. [2025-09-17T18:56:38.675322] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T18:56:38.685426] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-01. [2025-09-17T18:56:39.032156] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T18:56:39.039188] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-01. [2025-09-17T18:56:39.557953] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T18:56:39.561556] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-03. [2025-09-17T18:56:40.086595] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T18:56:40.094181] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-02. [2025-09-17T18:56:40.215135] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T18:56:40.219896] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-04. [2025-09-17T18:56:40.298431] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T18:56:40.312375] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-02. [2025-09-17T18:56:40.486435] [INFO ] [REMOTE ] F: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-17T18:56:40.497806] [INFO ] [REMOTE ] F: Fetching primary data for 2025-01. [2025-09-17T18:56:40.976180] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T18:56:40.983814] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-03. [2025-09-17T18:56:41.320351] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T18:56:41.327297] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-05. [2025-09-17T18:56:41.910036] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T18:56:41.920113] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-03. [2025-09-17T18:56:42.095957] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T18:56:42.105063] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-04. [2025-09-17T18:56:42.341840] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T18:56:42.348917] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-06. [2025-09-17T18:56:43.049151] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-01 (2.55 seconds). [2025-09-17T18:56:43.060693] [INFO ] [REMOTE ] F: Fetching primary data for 2025-02. [2025-09-17T18:56:43.107125] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T18:56:43.112485] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-07. [2025-09-17T18:56:43.336270] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T18:56:43.414105] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T18:56:43.615783] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-04. [2025-09-17T18:56:44.416349] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-05. [2025-09-17T18:56:44.418775] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T18:56:45.215804] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-08. [2025-09-17T18:56:45.325780] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T18:56:45.592470] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-02 (2.53 seconds). [2025-09-17T18:56:45.687246] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T18:56:46.015770] [INFO ] [REMOTE ] F: Fetching primary data for 2025-03. [2025-09-17T18:56:46.075207] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T18:56:46.815785] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-06. [2025-09-17T18:56:47.615825] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-05. [2025-09-17T18:56:48.375712] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T18:56:48.415726] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-07. [2025-09-17T18:56:48.525052] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-17T18:56:49.035228] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T18:56:49.215808] [INFO ] [REMOTE ] FBK: Fetching primary data for 2025-09. [2025-09-17T18:56:50.015771] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-06. [2025-09-17T18:56:50.078045] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T18:56:50.281045] [INFO ] [REMOTE ] FBK: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T18:56:50.284163] [INFO ] [REMOTE ] FBK: Full fetch complete (32391 records). [2025-09-17T18:56:50.284243] [DEBUG] [VALIDATOR ] FBK: Validating primary data. [2025-09-17T18:56:50.651130] [DEBUG] [VALIDATOR ] FBK: All expected trading days are present. [2025-09-17T18:56:50.651208] [DEBUG] [VALIDATOR ] FBK: Primary data validation passed. [2025-09-17T18:56:50.651719] [INFO ] [MAIN ] FBK: Fetched primary data is valid. [2025-09-17T18:56:50.651767] [DEBUG] [LOCAL ] FBK: Saving primary data. [2025-09-17T18:56:50.652504] [DEBUG] [LOCAL ] FBK: Trimmed 32391 records to 25283 (keeping 200 days of data) [2025-09-17T18:56:50.811659] [DEBUG] [LOCAL ] FBK: Primary data saved (25283 records). [2025-09-17T18:56:50.811798] [INFO ] [MAIN ] FBK: Full history saved. [2025-09-17T18:56:50.811889] [INFO ] [MAIN ] Update Progress: 801/2371 symbols completed. FBK took 17.8s. Estimated remaining: 3h 48m 58s. Rate: 6.9 symbols/min [2025-09-17T18:56:50.823486] [INFO ] [REMOTE ] F: Fetching primary data for 2025-04. [2025-09-17T18:56:50.986132] [INFO ] [MAIN ] FBP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:56:51.028926] [DEBUG] [LOCAL ] FBP: Loaded 46372 existing records from primary storage. [2025-09-17T18:56:51.029068] [INFO ] [MAIN ] FBP: Loaded 46372 existing records. [2025-09-17T18:56:51.207190] [WARN ] [MAIN ] FBP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:56:51.207426] [INFO ] [MAIN ] FBP: Wiping existing primary data before full refresh. [2025-09-17T18:56:51.207472] [INFO ] [LOCAL ] FBP: Starting deletion of primary data. [2025-09-17T18:56:51.208762] [DEBUG] [LOCAL ] FBP: Deleted primary data file. [2025-09-17T18:56:51.208815] [INFO ] [MAIN ] FBP: Starting full primary refresh. [2025-09-17T18:56:51.570709] [INFO ] [REMOTE ] FBP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:56:51.616941] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-08. [2025-09-17T18:56:51.623185] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T18:56:52.415836] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-07. [2025-09-17T18:56:53.094719] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T18:56:53.215782] [INFO ] [REMOTE ] FAF: Fetching primary data for 2025-09. [2025-09-17T18:56:53.537496] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-17T18:56:54.015785] [INFO ] [REMOTE ] F: Fetching primary data for 2025-05. [2025-09-17T18:56:54.172687] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T18:56:54.207000] [INFO ] [REMOTE ] FAF: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T18:56:54.212369] [INFO ] [REMOTE ] FAF: Full fetch complete (57377 records). [2025-09-17T18:56:54.212509] [DEBUG] [VALIDATOR ] FAF: Validating primary data. [2025-09-17T18:56:54.608526] [DEBUG] [VALIDATOR ] FAF: All expected trading days are present. [2025-09-17T18:56:54.608619] [DEBUG] [VALIDATOR ] FAF: Primary data validation passed. [2025-09-17T18:56:54.609329] [INFO ] [MAIN ] FAF: Fetched primary data is valid. [2025-09-17T18:56:54.609374] [DEBUG] [LOCAL ] FAF: Saving primary data. [2025-09-17T18:56:54.610685] [DEBUG] [LOCAL ] FAF: Trimmed 57377 records to 42079 (keeping 200 days of data) [2025-09-17T18:56:54.824832] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-11. [2025-09-17T18:56:54.877484] [DEBUG] [LOCAL ] FAF: Primary data saved (42079 records). [2025-09-17T18:56:54.877663] [INFO ] [MAIN ] FAF: Full history saved. [2025-09-17T18:56:54.877778] [INFO ] [MAIN ] Update Progress: 802/2371 symbols completed. FAF took 21.9s. Estimated remaining: 3h 48m 40s. Rate: 6.9 symbols/min [2025-09-17T18:56:55.047600] [INFO ] [MAIN ] FBRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:56:55.047800] [DEBUG] [LOCAL ] FBRT: No existing data file found in primary storage. [2025-09-17T18:56:55.047839] [WARN ] [MAIN ] FBRT: No existing data found, performing full refresh instead. [2025-09-17T18:56:55.047964] [INFO ] [MAIN ] FBRT: Wiping existing primary data before full refresh. [2025-09-17T18:56:55.048001] [INFO ] [LOCAL ] FBRT: Starting deletion of primary data. [2025-09-17T18:56:55.048040] [DEBUG] [LOCAL ] FBRT: No primary data file found to delete. [2025-09-17T18:56:55.048072] [INFO ] [MAIN ] FBRT: Starting full primary refresh. [2025-09-17T18:56:55.404611] [INFO ] [REMOTE ] FBRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:56:55.615836] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-08. [2025-09-17T18:56:56.225222] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T18:56:56.301982] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-17T18:56:56.415870] [INFO ] [REMOTE ] F: Fetching primary data for 2025-06. [2025-09-17T18:56:57.215725] [INFO ] [REMOTE ] FBP: Fetching primary data for 2024-12. [2025-09-17T18:56:57.336460] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T18:56:58.015797] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-11. [2025-09-17T18:56:58.494441] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T18:56:58.815859] [INFO ] [REMOTE ] FBIN: Fetching primary data for 2025-09. [2025-09-17T18:56:58.883210] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-17T18:56:58.988237] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T18:56:59.615788] [INFO ] [REMOTE ] F: Fetching primary data for 2025-07. [2025-09-17T18:57:00.415835] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2024-12. [2025-09-17T18:57:00.502933] [INFO ] [REMOTE ] FBIN: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T18:57:00.509876] [INFO ] [REMOTE ] FBIN: Full fetch complete (72379 records). [2025-09-17T18:57:00.510046] [DEBUG] [VALIDATOR ] FBIN: Validating primary data. [2025-09-17T18:57:00.908538] [DEBUG] [VALIDATOR ] FBIN: All expected trading days are present. [2025-09-17T18:57:00.908629] [DEBUG] [VALIDATOR ] FBIN: Primary data validation passed. [2025-09-17T18:57:00.909540] [INFO ] [MAIN ] FBIN: Fetched primary data is valid. [2025-09-17T18:57:00.909596] [DEBUG] [LOCAL ] FBIN: Saving primary data. [2025-09-17T18:57:00.911128] [DEBUG] [LOCAL ] FBIN: Trimmed 72379 records to 50468 (keeping 200 days of data) [2025-09-17T18:57:01.228059] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-01. [2025-09-17T18:57:01.258192] [DEBUG] [LOCAL ] FBIN: Primary data saved (50468 records). [2025-09-17T18:57:01.258428] [INFO ] [MAIN ] FBIN: Full history saved. [2025-09-17T18:57:01.258568] [INFO ] [MAIN ] Update Progress: 803/2371 symbols completed. FBIN took 28.3s. Estimated remaining: 3h 48m 27s. Rate: 6.9 symbols/min [2025-09-17T18:57:01.440677] [INFO ] [MAIN ] FC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:57:01.458173] [DEBUG] [LOCAL ] FC: Loaded 15411 existing records from primary storage. [2025-09-17T18:57:01.458528] [INFO ] [MAIN ] FC: Loaded 15411 existing records. [2025-09-17T18:57:01.658948] [WARN ] [MAIN ] FC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:57:01.659204] [INFO ] [MAIN ] FC: Wiping existing primary data before full refresh. [2025-09-17T18:57:01.659251] [INFO ] [LOCAL ] FC: Starting deletion of primary data. [2025-09-17T18:57:01.659723] [DEBUG] [LOCAL ] FC: Deleted primary data file. [2025-09-17T18:57:01.659806] [INFO ] [MAIN ] FC: Starting full primary refresh. [2025-09-17T18:57:02.033606] [INFO ] [REMOTE ] FC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:57:02.034104] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-11. [2025-09-17T18:57:02.229403] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T18:57:02.816744] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-07 (3.20 seconds). [2025-09-17T18:57:02.816956] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-01. [2025-09-17T18:57:03.615809] [INFO ] [REMOTE ] F: Fetching primary data for 2025-08. [2025-09-17T18:57:04.166455] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-01 (2.94 seconds). [2025-09-17T18:57:04.415795] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-02. [2025-09-17T18:57:04.572414] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-11 (2.54 seconds). [2025-09-17T18:57:05.215825] [INFO ] [REMOTE ] FC: Fetching primary data for 2024-12. [2025-09-17T18:57:06.096214] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T18:57:06.120661] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-01 (3.30 seconds). [2025-09-17T18:57:06.121913] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-03. [2025-09-17T18:57:06.130474] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T18:57:06.815772] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-02. [2025-09-17T18:57:07.012945] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-08 (3.40 seconds). [2025-09-17T18:57:07.615777] [INFO ] [REMOTE ] F: Fetching primary data for 2025-09. [2025-09-17T18:57:07.790299] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T18:57:07.914168] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T18:57:08.415782] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-03. [2025-09-17T18:57:09.215776] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-01. [2025-09-17T18:57:09.893011] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T18:57:09.900685] [INFO ] [REMOTE ] F: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-17T18:57:09.908364] [INFO ] [REMOTE ] F: Full fetch complete (77998 records). [2025-09-17T18:57:09.908548] [DEBUG] [VALIDATOR ] F: Validating primary data. [2025-09-17T18:57:09.994962] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T18:57:10.021052] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-04. [2025-09-17T18:57:10.318699] [DEBUG] [VALIDATOR ] F: All expected trading days are present. [2025-09-17T18:57:10.318782] [DEBUG] [VALIDATOR ] F: Primary data validation passed. [2025-09-17T18:57:10.319771] [INFO ] [MAIN ] F: Fetched primary data is valid. [2025-09-17T18:57:10.319827] [DEBUG] [LOCAL ] F: Saving primary data. [2025-09-17T18:57:10.321309] [DEBUG] [LOCAL ] F: Trimmed 77998 records to 53820 (keeping 200 days of data) [2025-09-17T18:57:10.656140] [DEBUG] [LOCAL ] F: Primary data saved (53820 records). [2025-09-17T18:57:10.656288] [INFO ] [MAIN ] F: Full history saved. [2025-09-17T18:57:10.656378] [INFO ] [MAIN ] Update Progress: 804/2371 symbols completed. F took 37.7s. Estimated remaining: 3h 48m 19s. Rate: 6.9 symbols/min [2025-09-17T18:57:10.822860] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-04. [2025-09-17T18:57:10.825336] [INFO ] [MAIN ] FCF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:57:10.865097] [DEBUG] [LOCAL ] FCF: Loaded 39936 existing records from primary storage. [2025-09-17T18:57:10.865242] [INFO ] [MAIN ] FCF: Loaded 39936 existing records. [2025-09-17T18:57:11.047052] [WARN ] [MAIN ] FCF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:57:11.047303] [INFO ] [MAIN ] FCF: Wiping existing primary data before full refresh. [2025-09-17T18:57:11.047348] [INFO ] [LOCAL ] FCF: Starting deletion of primary data. [2025-09-17T18:57:11.048276] [DEBUG] [LOCAL ] FCF: Deleted primary data file. [2025-09-17T18:57:11.048325] [INFO ] [MAIN ] FCF: Starting full primary refresh. [2025-09-17T18:57:11.416963] [INFO ] [REMOTE ] FCF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:57:11.523878] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T18:57:11.615752] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-11. [2025-09-17T18:57:12.333118] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T18:57:12.415754] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-05. [2025-09-17T18:57:13.038052] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T18:57:13.215807] [INFO ] [REMOTE ] FCF: Fetching primary data for 2024-12. [2025-09-17T18:57:13.562004] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T18:57:14.015781] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-02. [2025-09-17T18:57:14.302000] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T18:57:14.815776] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-05. [2025-09-17T18:57:15.209889] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T18:57:15.615834] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-01. [2025-09-17T18:57:16.415812] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-03. [2025-09-17T18:57:16.776958] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T18:57:17.215809] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-06. [2025-09-17T18:57:17.420797] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T18:57:17.754946] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-17T18:57:18.015783] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-02. [2025-09-17T18:57:18.483279] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T18:57:18.815782] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-07. [2025-09-17T18:57:19.509221] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T18:57:19.615839] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-03. [2025-09-17T18:57:20.415763] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-04. [2025-09-17T18:57:20.472485] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T18:57:21.215798] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-08. [2025-09-17T18:57:21.478706] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T18:57:21.581724] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T18:57:22.015783] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-04. [2025-09-17T18:57:22.568143] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T18:57:22.815822] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-06. [2025-09-17T18:57:23.296799] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T18:57:23.615842] [INFO ] [REMOTE ] FBP: Fetching primary data for 2025-09. [2025-09-17T18:57:24.241910] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T18:57:24.415795] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-07. [2025-09-17T18:57:25.064104] [INFO ] [REMOTE ] FBP: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T18:57:25.070629] [INFO ] [REMOTE ] FBP: Full fetch complete (66167 records). [2025-09-17T18:57:25.070814] [DEBUG] [VALIDATOR ] FBP: Validating primary data. [2025-09-17T18:57:25.220906] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-05. [2025-09-17T18:57:25.485435] [DEBUG] [VALIDATOR ] FBP: All expected trading days are present. [2025-09-17T18:57:25.485561] [DEBUG] [VALIDATOR ] FBP: Primary data validation passed. [2025-09-17T18:57:25.486369] [INFO ] [MAIN ] FBP: Fetched primary data is valid. [2025-09-17T18:57:25.486446] [DEBUG] [LOCAL ] FBP: Saving primary data. [2025-09-17T18:57:25.488150] [DEBUG] [LOCAL ] FBP: Trimmed 66167 records to 46391 (keeping 200 days of data) [2025-09-17T18:57:25.604509] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T18:57:25.808008] [DEBUG] [LOCAL ] FBP: Primary data saved (46391 records). [2025-09-17T18:57:25.808144] [INFO ] [MAIN ] FBP: Full history saved. [2025-09-17T18:57:25.808888] [INFO ] [MAIN ] Update Progress: 805/2371 symbols completed. FBP took 35.0s. Estimated remaining: 3h 48m 23s. Rate: 6.9 symbols/min [2025-09-17T18:57:25.980211] [INFO ] [MAIN ] FCN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:57:25.989331] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T18:57:26.018516] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-06. [2025-09-17T18:57:26.020339] [DEBUG] [LOCAL ] FCN: Loaded 26388 existing records from primary storage. [2025-09-17T18:57:26.020490] [INFO ] [MAIN ] FCN: Loaded 26388 existing records. [2025-09-17T18:57:26.199465] [WARN ] [MAIN ] FCN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:57:26.199784] [INFO ] [MAIN ] FCN: Wiping existing primary data before full refresh. [2025-09-17T18:57:26.199832] [INFO ] [LOCAL ] FCN: Starting deletion of primary data. [2025-09-17T18:57:26.200438] [DEBUG] [LOCAL ] FCN: Deleted primary data file. [2025-09-17T18:57:26.200484] [INFO ] [MAIN ] FCN: Starting full primary refresh. [2025-09-17T18:57:26.571622] [INFO ] [REMOTE ] FCN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:57:26.815792] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-11. [2025-09-17T18:57:27.010266] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T18:57:27.615777] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-07. [2025-09-17T18:57:27.785030] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T18:57:28.415828] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-08. [2025-09-17T18:57:28.686502] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T18:57:29.215818] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-05. [2025-09-17T18:57:29.748622] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T18:57:30.015803] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-08. [2025-09-17T18:57:30.608847] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T18:57:30.815781] [INFO ] [REMOTE ] FCN: Fetching primary data for 2024-12. [2025-09-17T18:57:30.942746] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T18:57:31.615788] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-06. [2025-09-17T18:57:31.874052] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T18:57:32.415820] [INFO ] [REMOTE ] FBRT: Fetching primary data for 2025-09. [2025-09-17T18:57:32.972154] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T18:57:33.215811] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-07. [2025-09-17T18:57:33.725742] [INFO ] [REMOTE ] FBRT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T18:57:33.729906] [INFO ] [REMOTE ] FBRT: Full fetch complete (47924 records). [2025-09-17T18:57:33.729999] [DEBUG] [VALIDATOR ] FBRT: Validating primary data. [2025-09-17T18:57:34.020869] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-01. [2025-09-17T18:57:34.112619] [DEBUG] [VALIDATOR ] FBRT: All expected trading days are present. [2025-09-17T18:57:34.112712] [DEBUG] [VALIDATOR ] FBRT: Primary data validation passed. [2025-09-17T18:57:34.113335] [INFO ] [MAIN ] FBRT: Fetched primary data is valid. [2025-09-17T18:57:34.113375] [DEBUG] [LOCAL ] FBRT: Saving primary data. [2025-09-17T18:57:34.114418] [DEBUG] [LOCAL ] FBRT: Trimmed 47924 records to 34325 (keeping 200 days of data) [2025-09-17T18:57:34.333124] [DEBUG] [LOCAL ] FBRT: Primary data saved (34325 records). [2025-09-17T18:57:34.333261] [INFO ] [MAIN ] FBRT: Full history saved. [2025-09-17T18:57:34.333334] [INFO ] [MAIN ] Update Progress: 806/2371 symbols completed. FBRT took 39.5s. Estimated remaining: 3h 48m 14s. Rate: 6.9 symbols/min [2025-09-17T18:57:34.516364] [INFO ] [MAIN ] FCPT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:57:34.555812] [DEBUG] [LOCAL ] FCPT: Loaded 37569 existing records from primary storage. [2025-09-17T18:57:34.555954] [INFO ] [MAIN ] FCPT: Loaded 37569 existing records. [2025-09-17T18:57:34.819411] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T18:57:34.816869] [INFO ] [REMOTE ] FC: Fetching primary data for 2025-09. [2025-09-17T18:57:34.828034] [WARN ] [MAIN ] FCPT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:57:34.835218] [INFO ] [MAIN ] FCPT: Wiping existing primary data before full refresh. [2025-09-17T18:57:34.835283] [INFO ] [LOCAL ] FCPT: Starting deletion of primary data. [2025-09-17T18:57:34.836923] [DEBUG] [LOCAL ] FCPT: Deleted primary data file. [2025-09-17T18:57:34.837009] [INFO ] [MAIN ] FCPT: Starting full primary refresh. [2025-09-17T18:57:35.192168] [INFO ] [REMOTE ] FCPT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:57:35.204031] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T18:57:35.615805] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-11. [2025-09-17T18:57:35.628792] [INFO ] [REMOTE ] FC: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T18:57:35.631239] [INFO ] [REMOTE ] FC: Full fetch complete (21394 records). [2025-09-17T18:57:35.631314] [DEBUG] [VALIDATOR ] FC: Validating primary data. [2025-09-17T18:57:36.011671] [DEBUG] [VALIDATOR ] FC: All expected trading days are present. [2025-09-17T18:57:36.011799] [DEBUG] [VALIDATOR ] FC: Primary data validation passed. [2025-09-17T18:57:36.012265] [INFO ] [MAIN ] FC: Fetched primary data is valid. [2025-09-17T18:57:36.012306] [DEBUG] [LOCAL ] FC: Saving primary data. [2025-09-17T18:57:36.012941] [DEBUG] [LOCAL ] FC: Trimmed 21394 records to 15420 (keeping 200 days of data) [2025-09-17T18:57:36.104656] [DEBUG] [LOCAL ] FC: Primary data saved (15420 records). [2025-09-17T18:57:36.104807] [INFO ] [MAIN ] FC: Full history saved. [2025-09-17T18:57:36.104907] [INFO ] [MAIN ] Update Progress: 807/2371 symbols completed. FC took 34.8s. Estimated remaining: 3h 47m 51s. Rate: 6.9 symbols/min [2025-09-17T18:57:36.287489] [INFO ] [MAIN ] FCRX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:57:36.287729] [DEBUG] [LOCAL ] FCRX: No existing data file found in primary storage. [2025-09-17T18:57:36.287770] [WARN ] [MAIN ] FCRX: No existing data found, performing full refresh instead. [2025-09-17T18:57:36.287902] [INFO ] [MAIN ] FCRX: Wiping existing primary data before full refresh. [2025-09-17T18:57:36.287942] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-17T18:57:36.287987] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-17T18:57:36.288020] [INFO ] [MAIN ] FCRX: Starting full primary refresh. [2025-09-17T18:57:36.420966] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-02. [2025-09-17T18:57:36.674230] [INFO ] [REMOTE ] FCRX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:57:37.101618] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T18:57:37.215799] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-11. [2025-09-17T18:57:37.546143] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T18:57:37.547041] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T18:57:38.015787] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-08. [2025-09-17T18:57:38.815832] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2024-12. [2025-09-17T18:57:39.072185] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2024-12 (0.26 seconds). [2025-09-17T18:57:39.372472] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T18:57:39.615749] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-01. [2025-09-17T18:57:39.987289] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-01 (0.37 seconds). [2025-09-17T18:57:40.415775] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-03. [2025-09-17T18:57:41.215794] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-02. [2025-09-17T18:57:41.753824] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T18:57:41.771233] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T18:57:42.015780] [INFO ] [REMOTE ] FCF: Fetching primary data for 2025-09. [2025-09-17T18:57:42.815812] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2024-12. [2025-09-17T18:57:43.449758] [INFO ] [REMOTE ] FCF: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T18:57:43.454853] [INFO ] [REMOTE ] FCF: Full fetch complete (57797 records). [2025-09-17T18:57:43.454980] [DEBUG] [VALIDATOR ] FCF: Validating primary data. [2025-09-17T18:57:43.617893] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-03. [2025-09-17T18:57:43.853227] [DEBUG] [VALIDATOR ] FCF: All expected trading days are present. [2025-09-17T18:57:43.853313] [DEBUG] [VALIDATOR ] FCF: Primary data validation passed. [2025-09-17T18:57:43.854136] [INFO ] [MAIN ] FCF: Fetched primary data is valid. [2025-09-17T18:57:43.854193] [DEBUG] [LOCAL ] FCF: Saving primary data. [2025-09-17T18:57:43.855511] [DEBUG] [LOCAL ] FCF: Trimmed 57797 records to 39938 (keeping 200 days of data) [2025-09-17T18:57:43.965766] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-03 (0.35 seconds). [2025-09-17T18:57:44.101713] [DEBUG] [LOCAL ] FCF: Primary data saved (39938 records). [2025-09-17T18:57:44.101853] [INFO ] [MAIN ] FCF: Full history saved. [2025-09-17T18:57:44.101935] [INFO ] [MAIN ] Update Progress: 808/2371 symbols completed. FCF took 33.4s. Estimated remaining: 3h 47m 41s. Rate: 6.9 symbols/min [2025-09-17T18:57:44.277684] [INFO ] [MAIN ] FCT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:57:44.298157] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T18:57:44.316131] [DEBUG] [LOCAL ] FCT: Loaded 14388 existing records from primary storage. [2025-09-17T18:57:44.316277] [INFO ] [MAIN ] FCT: Loaded 14388 existing records. [2025-09-17T18:57:44.419213] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-04. [2025-09-17T18:57:44.497680] [WARN ] [MAIN ] FCT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:57:44.497892] [INFO ] [MAIN ] FCT: Wiping existing primary data before full refresh. [2025-09-17T18:57:44.497936] [INFO ] [LOCAL ] FCT: Starting deletion of primary data. [2025-09-17T18:57:44.498362] [DEBUG] [LOCAL ] FCT: Deleted primary data file. [2025-09-17T18:57:44.498406] [INFO ] [MAIN ] FCT: Starting full primary refresh. [2025-09-17T18:57:44.856581] [INFO ] [REMOTE ] FCT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:57:45.215775] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-11. [2025-09-17T18:57:45.993181] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T18:57:46.015717] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-05. [2025-09-17T18:57:46.482014] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T18:57:46.815759] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-04. [2025-09-17T18:57:47.364864] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T18:57:47.443126] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T18:57:47.615802] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-05. [2025-09-17T18:57:47.935578] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T18:57:48.415804] [INFO ] [REMOTE ] FCT: Fetching primary data for 2024-12. [2025-09-17T18:57:49.215847] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-06. [2025-09-17T18:57:49.428073] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T18:57:49.475748] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-06 (0.26 seconds). [2025-09-17T18:57:50.015772] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-07. [2025-09-17T18:57:50.354795] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-17T18:57:50.815823] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-01. [2025-09-17T18:57:51.615776] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-06. [2025-09-17T18:57:52.123932] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T18:57:52.415791] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-01. [2025-09-17T18:57:52.516249] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T18:57:53.215851] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-02. [2025-09-17T18:57:53.435975] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T18:57:54.015807] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-07. [2025-09-17T18:57:54.518077] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T18:57:54.815813] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-08. [2025-09-17T18:57:55.279835] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T18:57:55.280859] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T18:57:55.615786] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-02. [2025-09-17T18:57:56.415784] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-08. [2025-09-17T18:57:56.429235] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T18:57:57.215835] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-03. [2025-09-17T18:57:57.359426] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T18:57:58.015784] [INFO ] [REMOTE ] FCN: Fetching primary data for 2025-09. [2025-09-17T18:57:58.768004] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T18:57:58.815807] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-04. [2025-09-17T18:57:59.153792] [INFO ] [REMOTE ] FCN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T18:57:59.157003] [INFO ] [REMOTE ] FCN: Full fetch complete (35305 records). [2025-09-17T18:57:59.157083] [DEBUG] [VALIDATOR ] FCN: Validating primary data. [2025-09-17T18:57:59.526245] [DEBUG] [VALIDATOR ] FCN: All expected trading days are present. [2025-09-17T18:57:59.526324] [DEBUG] [VALIDATOR ] FCN: Primary data validation passed. [2025-09-17T18:57:59.526915] [INFO ] [MAIN ] FCN: Fetched primary data is valid. [2025-09-17T18:57:59.526961] [DEBUG] [LOCAL ] FCN: Saving primary data. [2025-09-17T18:57:59.527780] [DEBUG] [LOCAL ] FCN: Trimmed 35305 records to 26361 (keeping 200 days of data) [2025-09-17T18:57:59.615814] [INFO ] [REMOTE ] FCRX: Fetching primary data for 2025-09. [2025-09-17T18:57:59.688301] [DEBUG] [LOCAL ] FCN: Primary data saved (26361 records). [2025-09-17T18:57:59.688447] [INFO ] [MAIN ] FCN: Full history saved. [2025-09-17T18:57:59.688533] [INFO ] [MAIN ] Update Progress: 809/2371 symbols completed. FCN took 33.9s. Estimated remaining: 3h 47m 46s. Rate: 6.9 symbols/min [2025-09-17T18:57:59.856939] [INFO ] [MAIN ] FCX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:57:59.909059] [DEBUG] [LOCAL ] FCX: Loaded 53699 existing records from primary storage. [2025-09-17T18:57:59.909199] [INFO ] [MAIN ] FCX: Loaded 53699 existing records. [2025-09-17T18:58:00.077253] [INFO ] [REMOTE ] FCRX: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T18:58:00.095868] [INFO ] [REMOTE ] FCRX: Full fetch complete (1652 records). [2025-09-17T18:58:00.096218] [DEBUG] [VALIDATOR ] FCRX: Validating primary data. [2025-09-17T18:58:00.118733] [WARN ] [MAIN ] FCX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:58:00.180245] [INFO ] [MAIN ] FCX: Wiping existing primary data before full refresh. [2025-09-17T18:58:00.214604] [INFO ] [LOCAL ] FCX: Starting deletion of primary data. [2025-09-17T18:58:00.225592] [DEBUG] [LOCAL ] FCX: Deleted primary data file. [2025-09-17T18:58:00.267216] [INFO ] [MAIN ] FCX: Starting full primary refresh. [2025-09-17T18:58:00.317020] [WARN ] [VALIDATOR ] FCRX: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-17T18:58:00.359568] [FATAL] [MAIN ] FCRX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:58:00.364822] [WARN ] [MAIN ] FCRX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:58:00.376326] [INFO ] [LOCAL ] FCRX: Starting deletion of primary data. [2025-09-17T18:58:00.376452] [DEBUG] [LOCAL ] FCRX: No primary data file found to delete. [2025-09-17T18:58:00.376526] [INFO ] [LOCAL ] FCRX: Starting deletion of derivative data. [2025-09-17T18:58:00.397761] [DEBUG] [LOCAL ] FCRX: No derivative data file found to delete. [2025-09-17T18:58:00.397913] [INFO ] [MAIN ] Update Progress: 810/2371 symbols completed. FCRX took 24.3s. Estimated remaining: 3h 47m 21s. Rate: 6.9 symbols/min [2025-09-17T18:58:00.424531] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-03. [2025-09-17T18:58:00.786068] [INFO ] [MAIN ] FDP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:58:00.840303] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T18:58:00.871752] [INFO ] [REMOTE ] FCX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:58:00.897990] [DEBUG] [LOCAL ] FDP: Loaded 30448 existing records from primary storage. [2025-09-17T18:58:00.898133] [INFO ] [MAIN ] FDP: Loaded 30448 existing records. [2025-09-17T18:58:01.074382] [WARN ] [MAIN ] FDP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:58:01.074708] [INFO ] [MAIN ] FDP: Wiping existing primary data before full refresh. [2025-09-17T18:58:01.074763] [INFO ] [LOCAL ] FDP: Starting deletion of primary data. [2025-09-17T18:58:01.075501] [DEBUG] [LOCAL ] FDP: Deleted primary data file. [2025-09-17T18:58:01.075546] [INFO ] [MAIN ] FDP: Starting full primary refresh. [2025-09-17T18:58:01.220937] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-11. [2025-09-17T18:58:01.439780] [INFO ] [REMOTE ] FDP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:58:01.586542] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T18:58:02.015779] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-04. [2025-09-17T18:58:02.656577] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T18:58:02.815735] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-05. [2025-09-17T18:58:03.004494] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T18:58:03.615817] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-11. [2025-09-17T18:58:03.634101] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T18:58:04.415687] [INFO ] [REMOTE ] FCX: Fetching primary data for 2024-12. [2025-09-17T18:58:04.583049] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T18:58:05.215775] [INFO ] [REMOTE ] FDP: Fetching primary data for 2024-12. [2025-09-17T18:58:06.001905] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T18:58:06.015721] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-01. [2025-09-17T18:58:06.412955] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T18:58:06.815778] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-05. [2025-09-17T18:58:07.615741] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-01. [2025-09-17T18:58:07.822565] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T18:58:08.213391] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T18:58:08.415744] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-02. [2025-09-17T18:58:08.826686] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T18:58:09.215788] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-02. [2025-09-17T18:58:10.015786] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-06. [2025-09-17T18:58:10.460401] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-17T18:58:10.517817] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T18:58:10.815786] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-03. [2025-09-17T18:58:11.413232] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T18:58:11.615767] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-07. [2025-09-17T18:58:12.153134] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T18:58:12.415773] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-03. [2025-09-17T18:58:12.643921] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T18:58:13.215777] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-08. [2025-09-17T18:58:14.015775] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-06. [2025-09-17T18:58:14.627011] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-17T18:58:14.649004] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T18:58:14.673320] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T18:58:14.815775] [INFO ] [REMOTE ] FCPT: Fetching primary data for 2025-09. [2025-09-17T18:58:15.615767] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-04. [2025-09-17T18:58:16.415089] [INFO ] [REMOTE ] FCPT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T18:58:16.419669] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-07. [2025-09-17T18:58:16.421185] [INFO ] [REMOTE ] FCPT: Full fetch complete (53092 records). [2025-09-17T18:58:16.421315] [DEBUG] [VALIDATOR ] FCPT: Validating primary data. [2025-09-17T18:58:16.805950] [DEBUG] [VALIDATOR ] FCPT: All expected trading days are present. [2025-09-17T18:58:16.806028] [DEBUG] [VALIDATOR ] FCPT: Primary data validation passed. [2025-09-17T18:58:16.806782] [INFO ] [MAIN ] FCPT: Fetched primary data is valid. [2025-09-17T18:58:16.806842] [DEBUG] [LOCAL ] FCPT: Saving primary data. [2025-09-17T18:58:16.807964] [DEBUG] [LOCAL ] FCPT: Trimmed 53092 records to 37547 (keeping 200 days of data) [2025-09-17T18:58:17.043939] [DEBUG] [LOCAL ] FCPT: Primary data saved (37547 records). [2025-09-17T18:58:17.044157] [INFO ] [MAIN ] FCPT: Full history saved. [2025-09-17T18:58:17.044425] [INFO ] [MAIN ] Update Progress: 811/2371 symbols completed. FCPT took 42.7s. Estimated remaining: 3h 47m 28s. Rate: 6.9 symbols/min [2025-09-17T18:58:17.221990] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-04. [2025-09-17T18:58:17.225754] [INFO ] [MAIN ] FDS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:58:17.238369] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T18:58:17.267454] [DEBUG] [LOCAL ] FDS: Loaded 25360 existing records from primary storage. [2025-09-17T18:58:17.267588] [INFO ] [MAIN ] FDS: Loaded 25360 existing records. [2025-09-17T18:58:17.448853] [WARN ] [MAIN ] FDS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:58:17.449106] [INFO ] [MAIN ] FDS: Wiping existing primary data before full refresh. [2025-09-17T18:58:17.449160] [INFO ] [LOCAL ] FDS: Starting deletion of primary data. [2025-09-17T18:58:17.449865] [DEBUG] [LOCAL ] FDS: Deleted primary data file. [2025-09-17T18:58:17.449932] [INFO ] [MAIN ] FDS: Starting full primary refresh. [2025-09-17T18:58:17.824507] [INFO ] [REMOTE ] FDS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:58:17.992631] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-17T18:58:18.015724] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-05. [2025-09-17T18:58:18.443372] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T18:58:18.815782] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-05. [2025-09-17T18:58:19.615768] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-11. [2025-09-17T18:58:19.894043] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T18:58:20.066503] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T18:58:20.382235] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T18:58:20.415740] [INFO ] [REMOTE ] FDS: Fetching primary data for 2024-12. [2025-09-17T18:58:21.215798] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-06. [2025-09-17T18:58:21.662327] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T18:58:22.015753] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-01. [2025-09-17T18:58:22.217472] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T18:58:22.815813] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-07. [2025-09-17T18:58:23.326445] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T18:58:23.615831] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-02. [2025-09-17T18:58:23.843927] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T18:58:24.415871] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-08. [2025-09-17T18:58:24.854699] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T18:58:25.215828] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-03. [2025-09-17T18:58:25.747921] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T18:58:26.015797] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-08. [2025-09-17T18:58:26.155440] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T18:58:26.815782] [INFO ] [REMOTE ] FDP: Fetching primary data for 2025-09. [2025-09-17T18:58:26.899682] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T18:58:27.615790] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-06. [2025-09-17T18:58:28.012687] [INFO ] [REMOTE ] FDP: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T18:58:28.016430] [INFO ] [REMOTE ] FDP: Full fetch complete (42558 records). [2025-09-17T18:58:28.016517] [DEBUG] [VALIDATOR ] FDP: Validating primary data. [2025-09-17T18:58:28.391239] [DEBUG] [VALIDATOR ] FDP: All expected trading days are present. [2025-09-17T18:58:28.391317] [DEBUG] [VALIDATOR ] FDP: Primary data validation passed. [2025-09-17T18:58:28.391920] [INFO ] [MAIN ] FDP: Fetched primary data is valid. [2025-09-17T18:58:28.391964] [DEBUG] [LOCAL ] FDP: Saving primary data. [2025-09-17T18:58:28.392889] [DEBUG] [LOCAL ] FDP: Trimmed 42558 records to 30436 (keeping 200 days of data) [2025-09-17T18:58:28.454726] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-04. [2025-09-17T18:58:28.592636] [DEBUG] [LOCAL ] FDP: Primary data saved (30436 records). [2025-09-17T18:58:28.592784] [INFO ] [MAIN ] FDP: Full history saved. [2025-09-17T18:58:28.592884] [INFO ] [MAIN ] Update Progress: 812/2371 symbols completed. FDP took 28.2s. Estimated remaining: 3h 47m 25s. Rate: 6.9 symbols/min [2025-09-17T18:58:28.759872] [INFO ] [MAIN ] FDX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:58:28.811301] [DEBUG] [LOCAL ] FDX: Loaded 51550 existing records from primary storage. [2025-09-17T18:58:28.811452] [INFO ] [MAIN ] FDX: Loaded 51550 existing records. [2025-09-17T18:58:28.989671] [WARN ] [MAIN ] FDX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:58:28.989940] [INFO ] [MAIN ] FDX: Wiping existing primary data before full refresh. [2025-09-17T18:58:28.989985] [INFO ] [LOCAL ] FDX: Starting deletion of primary data. [2025-09-17T18:58:28.990962] [DEBUG] [LOCAL ] FDX: Deleted primary data file. [2025-09-17T18:58:28.991011] [INFO ] [MAIN ] FDX: Starting full primary refresh. [2025-09-17T18:58:29.231118] [INFO ] [REMOTE ] FCT: Fetching primary data for 2025-09. [2025-09-17T18:58:29.352847] [INFO ] [REMOTE ] FDX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:58:29.523474] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T18:58:29.704941] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T18:58:30.015797] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-07. [2025-09-17T18:58:30.216949] [INFO ] [REMOTE ] FCT: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T18:58:30.219583] [INFO ] [REMOTE ] FCT: Full fetch complete (21257 records). [2025-09-17T18:58:30.219672] [DEBUG] [VALIDATOR ] FCT: Validating primary data. [2025-09-17T18:58:30.592262] [DEBUG] [VALIDATOR ] FCT: All expected trading days are present. [2025-09-17T18:58:30.592342] [DEBUG] [VALIDATOR ] FCT: Primary data validation passed. [2025-09-17T18:58:30.592865] [INFO ] [MAIN ] FCT: Fetched primary data is valid. [2025-09-17T18:58:30.592912] [DEBUG] [LOCAL ] FCT: Saving primary data. [2025-09-17T18:58:30.593782] [DEBUG] [LOCAL ] FCT: Trimmed 21257 records to 14380 (keeping 200 days of data) [2025-09-17T18:58:30.688449] [DEBUG] [LOCAL ] FCT: Primary data saved (14380 records). [2025-09-17T18:58:30.688666] [INFO ] [MAIN ] FCT: Full history saved. [2025-09-17T18:58:30.688766] [INFO ] [MAIN ] Update Progress: 813/2371 symbols completed. FCT took 46.6s. Estimated remaining: 3h 47m 3s. Rate: 6.9 symbols/min [2025-09-17T18:58:30.832371] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-05. [2025-09-17T18:58:30.863626] [INFO ] [MAIN ] FE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:58:30.917390] [DEBUG] [LOCAL ] FE: Loaded 53453 existing records from primary storage. [2025-09-17T18:58:30.917540] [INFO ] [MAIN ] FE: Loaded 53453 existing records. [2025-09-17T18:58:31.101105] [WARN ] [MAIN ] FE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:58:31.101395] [INFO ] [MAIN ] FE: Wiping existing primary data before full refresh. [2025-09-17T18:58:31.101442] [INFO ] [LOCAL ] FE: Starting deletion of primary data. [2025-09-17T18:58:31.102715] [DEBUG] [LOCAL ] FE: Deleted primary data file. [2025-09-17T18:58:31.102775] [INFO ] [MAIN ] FE: Starting full primary refresh. [2025-09-17T18:58:31.469075] [INFO ] [REMOTE ] FE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:58:31.615818] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-11. [2025-09-17T18:58:32.200622] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T18:58:32.347832] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-17T18:58:32.415790] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-11. [2025-09-17T18:58:33.215885] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-08. [2025-09-17T18:58:33.349279] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T18:58:33.834470] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T18:58:34.015778] [INFO ] [REMOTE ] FDX: Fetching primary data for 2024-12. [2025-09-17T18:58:34.815760] [INFO ] [REMOTE ] FE: Fetching primary data for 2024-12. [2025-09-17T18:58:35.221579] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T18:58:35.615881] [INFO ] [REMOTE ] FCX: Fetching primary data for 2025-09. [2025-09-17T18:58:36.013865] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T18:58:36.295553] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T18:58:36.415839] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-01. [2025-09-17T18:58:37.215797] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-01. [2025-09-17T18:58:37.350621] [INFO ] [REMOTE ] FCX: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T18:58:37.358722] [INFO ] [REMOTE ] FCX: Full fetch complete (77652 records). [2025-09-17T18:58:37.358870] [DEBUG] [VALIDATOR ] FCX: Validating primary data. [2025-09-17T18:58:37.754066] [DEBUG] [VALIDATOR ] FCX: All expected trading days are present. [2025-09-17T18:58:37.754167] [DEBUG] [VALIDATOR ] FCX: Primary data validation passed. [2025-09-17T18:58:37.755083] [INFO ] [MAIN ] FCX: Fetched primary data is valid. [2025-09-17T18:58:37.755138] [DEBUG] [LOCAL ] FCX: Saving primary data. [2025-09-17T18:58:37.756833] [DEBUG] [LOCAL ] FCX: Trimmed 77652 records to 53700 (keeping 200 days of data) [2025-09-17T18:58:38.016960] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-06. [2025-09-17T18:58:38.020996] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T18:58:38.151595] [DEBUG] [LOCAL ] FCX: Primary data saved (53700 records). [2025-09-17T18:58:38.151780] [INFO ] [MAIN ] FCX: Full history saved. [2025-09-17T18:58:38.152815] [INFO ] [MAIN ] Update Progress: 814/2371 symbols completed. FCX took 38.5s. Estimated remaining: 3h 46m 52s. Rate: 6.9 symbols/min [2025-09-17T18:58:38.330053] [INFO ] [MAIN ] FENG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:58:38.330365] [DEBUG] [LOCAL ] FENG: No existing data file found in primary storage. [2025-09-17T18:58:38.330414] [WARN ] [MAIN ] FENG: No existing data found, performing full refresh instead. [2025-09-17T18:58:38.330531] [INFO ] [MAIN ] FENG: Wiping existing primary data before full refresh. [2025-09-17T18:58:38.330572] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-17T18:58:38.330622] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-17T18:58:38.330678] [INFO ] [MAIN ] FENG: Starting full primary refresh. [2025-09-17T18:58:38.729324] [INFO ] [REMOTE ] FENG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:58:38.761653] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T18:58:38.815783] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-02. [2025-09-17T18:58:39.342073] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T18:58:39.615810] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-11. [2025-09-17T18:58:40.230932] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T18:58:40.280574] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T18:58:40.415821] [INFO ] [REMOTE ] FENG: Fetching primary data for 2024-12. [2025-09-17T18:58:40.822272] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-17T18:58:41.215873] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-07. [2025-09-17T18:58:42.015816] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-01. [2025-09-17T18:58:42.387758] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T18:58:42.454183] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T18:58:42.815804] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-08. [2025-09-17T18:58:43.615813] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-03. [2025-09-17T18:58:44.047198] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T18:58:44.415810] [INFO ] [REMOTE ] FDS: Fetching primary data for 2025-09. [2025-09-17T18:58:45.215754] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-02. [2025-09-17T18:58:45.624693] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T18:58:45.652192] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T18:58:45.668292] [INFO ] [REMOTE ] FDS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T18:58:45.672834] [INFO ] [REMOTE ] FDS: Full fetch complete (35814 records). [2025-09-17T18:58:45.672927] [DEBUG] [VALIDATOR ] FDS: Validating primary data. [2025-09-17T18:58:46.033350] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-02. [2025-09-17T18:58:46.048424] [DEBUG] [VALIDATOR ] FDS: All expected trading days are present. [2025-09-17T18:58:46.048503] [DEBUG] [VALIDATOR ] FDS: Primary data validation passed. [2025-09-17T18:58:46.049321] [INFO ] [MAIN ] FDS: Fetched primary data is valid. [2025-09-17T18:58:46.049470] [DEBUG] [LOCAL ] FDS: Saving primary data. [2025-09-17T18:58:46.050490] [DEBUG] [LOCAL ] FDS: Trimmed 35814 records to 25522 (keeping 200 days of data) [2025-09-17T18:58:46.213988] [DEBUG] [LOCAL ] FDS: Primary data saved (25522 records). [2025-09-17T18:58:46.214126] [INFO ] [MAIN ] FDS: Full history saved. [2025-09-17T18:58:46.214227] [INFO ] [MAIN ] Update Progress: 815/2371 symbols completed. FDS took 29.2s. Estimated remaining: 3h 46m 42s. Rate: 6.9 symbols/min [2025-09-17T18:58:46.388305] [INFO ] [MAIN ] FERG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:58:46.438118] [DEBUG] [LOCAL ] FERG: Loaded 49021 existing records from primary storage. [2025-09-17T18:58:46.438263] [INFO ] [MAIN ] FERG: Loaded 49021 existing records. [2025-09-17T18:58:46.618039] [WARN ] [MAIN ] FERG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:58:46.618315] [INFO ] [MAIN ] FERG: Wiping existing primary data before full refresh. [2025-09-17T18:58:46.618363] [INFO ] [LOCAL ] FERG: Starting deletion of primary data. [2025-09-17T18:58:46.619469] [DEBUG] [LOCAL ] FERG: Deleted primary data file. [2025-09-17T18:58:46.619536] [INFO ] [MAIN ] FERG: Starting full primary refresh. [2025-09-17T18:58:46.821975] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-04. [2025-09-17T18:58:46.984948] [INFO ] [REMOTE ] FERG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:58:47.557809] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T18:58:47.615783] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-11. [2025-09-17T18:58:48.415848] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-03. [2025-09-17T18:58:48.987009] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-17T18:58:49.215834] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-05. [2025-09-17T18:58:49.388132] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T18:58:50.015804] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-03. [2025-09-17T18:58:50.182926] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T18:58:50.435979] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T18:58:50.805461] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T18:58:50.819601] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-04. [2025-09-17T18:58:51.615807] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-06. [2025-09-17T18:58:52.247059] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T18:58:52.415796] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-05. [2025-09-17T18:58:53.215840] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-04. [2025-09-17T18:58:53.570955] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T18:58:53.599918] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-17T18:58:53.741242] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T18:58:54.015791] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-07. [2025-09-17T18:58:54.815789] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-06. [2025-09-17T18:58:55.615826] [INFO ] [REMOTE ] FERG: Fetching primary data for 2024-12. [2025-09-17T18:58:55.933934] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T18:58:56.415789] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-05. [2025-09-17T18:58:56.488762] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T18:58:56.847943] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T18:58:57.019731] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T18:58:57.215782] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-07. [2025-09-17T18:58:58.015786] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-06. [2025-09-17T18:58:58.351004] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T18:58:58.815801] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-08. [2025-09-17T18:58:59.070564] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T18:58:59.615843] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-01. [2025-09-17T18:59:00.353548] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T18:59:00.415816] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-07. [2025-09-17T18:59:00.722371] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-17T18:59:01.215816] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-08. [2025-09-17T18:59:01.360919] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T18:59:01.496170] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-17T18:59:02.015783] [INFO ] [REMOTE ] FENG: Fetching primary data for 2025-09. [2025-09-17T18:59:02.459949] [INFO ] [REMOTE ] FENG: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T18:59:02.460856] [INFO ] [REMOTE ] FENG: Full fetch complete (2137 records). [2025-09-17T18:59:02.460922] [DEBUG] [VALIDATOR ] FENG: Validating primary data. [2025-09-17T18:59:02.638482] [WARN ] [VALIDATOR ] FENG: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T18:59:02.638701] [FATAL] [MAIN ] FENG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T18:59:02.638764] [WARN ] [MAIN ] FENG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T18:59:02.638815] [INFO ] [LOCAL ] FENG: Starting deletion of primary data. [2025-09-17T18:59:02.638879] [DEBUG] [LOCAL ] FENG: No primary data file found to delete. [2025-09-17T18:59:02.638921] [INFO ] [LOCAL ] FENG: Starting deletion of derivative data. [2025-09-17T18:59:02.638965] [DEBUG] [LOCAL ] FENG: No derivative data file found to delete. [2025-09-17T18:59:02.639021] [INFO ] [MAIN ] Update Progress: 816/2371 symbols completed. FENG took 24.5s. Estimated remaining: 3h 46m 48s. Rate: 6.9 symbols/min [2025-09-17T18:59:02.808036] [INFO ] [MAIN ] FET: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:59:02.815791] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-08. [2025-09-17T18:59:02.829081] [DEBUG] [LOCAL ] FET: Loaded 12577 existing records from primary storage. [2025-09-17T18:59:02.829200] [INFO ] [MAIN ] FET: Loaded 12577 existing records. [2025-09-17T18:59:03.012566] [WARN ] [MAIN ] FET: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:59:03.012872] [INFO ] [MAIN ] FET: Wiping existing primary data before full refresh. [2025-09-17T18:59:03.012927] [INFO ] [LOCAL ] FET: Starting deletion of primary data. [2025-09-17T18:59:03.013277] [DEBUG] [LOCAL ] FET: Deleted primary data file. [2025-09-17T18:59:03.013321] [INFO ] [MAIN ] FET: Starting full primary refresh. [2025-09-17T18:59:03.374172] [INFO ] [REMOTE ] FET: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:59:03.615775] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-02. [2025-09-17T18:59:04.415791] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-11. [2025-09-17T18:59:04.648033] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T18:59:04.984781] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T18:59:05.221403] [INFO ] [REMOTE ] FE: Fetching primary data for 2025-09. [2025-09-17T18:59:05.224200] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T18:59:06.015805] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-03. [2025-09-17T18:59:06.815773] [INFO ] [REMOTE ] FET: Fetching primary data for 2024-12. [2025-09-17T18:59:07.225792] [INFO ] [REMOTE ] FE: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-17T18:59:07.233285] [INFO ] [REMOTE ] FE: Full fetch complete (77017 records). [2025-09-17T18:59:07.233443] [DEBUG] [VALIDATOR ] FE: Validating primary data. [2025-09-17T18:59:07.621155] [INFO ] [REMOTE ] FDX: Fetching primary data for 2025-09. [2025-09-17T18:59:07.623063] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T18:59:07.718170] [DEBUG] [VALIDATOR ] FE: All expected trading days are present. [2025-09-17T18:59:07.718322] [DEBUG] [VALIDATOR ] FE: Primary data validation passed. [2025-09-17T18:59:07.719355] [INFO ] [MAIN ] FE: Fetched primary data is valid. [2025-09-17T18:59:07.719435] [DEBUG] [LOCAL ] FE: Saving primary data. [2025-09-17T18:59:07.721197] [DEBUG] [LOCAL ] FE: Trimmed 77017 records to 53448 (keeping 200 days of data) [2025-09-17T18:59:07.989899] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T18:59:08.105404] [DEBUG] [LOCAL ] FE: Primary data saved (53448 records). [2025-09-17T18:59:08.105553] [INFO ] [MAIN ] FE: Full history saved. [2025-09-17T18:59:08.105653] [INFO ] [MAIN ] Update Progress: 817/2371 symbols completed. FE took 37.4s. Estimated remaining: 3h 46m 33s. Rate: 6.9 symbols/min [2025-09-17T18:59:08.275959] [INFO ] [MAIN ] FF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:59:08.300997] [DEBUG] [LOCAL ] FF: Loaded 25945 existing records from primary storage. [2025-09-17T18:59:08.301132] [INFO ] [MAIN ] FF: Loaded 25945 existing records. [2025-09-17T18:59:08.420889] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-04. [2025-09-17T18:59:08.481234] [WARN ] [MAIN ] FF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:59:08.481481] [INFO ] [MAIN ] FF: Wiping existing primary data before full refresh. [2025-09-17T18:59:08.481528] [INFO ] [LOCAL ] FF: Starting deletion of primary data. [2025-09-17T18:59:08.482157] [DEBUG] [LOCAL ] FF: Deleted primary data file. [2025-09-17T18:59:08.482208] [INFO ] [MAIN ] FF: Starting full primary refresh. [2025-09-17T18:59:08.843465] [INFO ] [REMOTE ] FF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:59:09.215800] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-11. [2025-09-17T18:59:09.591695] [INFO ] [REMOTE ] FDX: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-17T18:59:09.598458] [INFO ] [REMOTE ] FDX: Full fetch complete (74204 records). [2025-09-17T18:59:09.598629] [DEBUG] [VALIDATOR ] FDX: Validating primary data. [2025-09-17T18:59:09.998494] [DEBUG] [VALIDATOR ] FDX: All expected trading days are present. [2025-09-17T18:59:09.998701] [DEBUG] [VALIDATOR ] FDX: Primary data validation passed. [2025-09-17T18:59:09.999601] [INFO ] [MAIN ] FDX: Fetched primary data is valid. [2025-09-17T18:59:09.999679] [DEBUG] [LOCAL ] FDX: Saving primary data. [2025-09-17T18:59:10.001810] [DEBUG] [LOCAL ] FDX: Trimmed 74204 records to 51558 (keeping 200 days of data) [2025-09-17T18:59:10.112340] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-01. [2025-09-17T18:59:10.145089] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T18:59:10.408716] [DEBUG] [LOCAL ] FDX: Primary data saved (51558 records). [2025-09-17T18:59:10.408923] [INFO ] [MAIN ] FDX: Full history saved. [2025-09-17T18:59:10.409067] [INFO ] [MAIN ] Update Progress: 818/2371 symbols completed. FDX took 41.8s. Estimated remaining: 3h 46m 12s. Rate: 6.9 symbols/min [2025-09-17T18:59:10.583382] [INFO ] [MAIN ] FFA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:59:10.603322] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T18:59:10.613446] [DEBUG] [LOCAL ] FFA: Loaded 5581 existing records from primary storage. [2025-09-17T18:59:10.613615] [INFO ] [MAIN ] FFA: Loaded 5581 existing records. [2025-09-17T18:59:10.801433] [WARN ] [MAIN ] FFA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:59:10.802439] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T18:59:10.805744] [INFO ] [MAIN ] FFA: Wiping existing primary data before full refresh. [2025-09-17T18:59:10.806104] [INFO ] [LOCAL ] FFA: Starting deletion of primary data. [2025-09-17T18:59:10.806366] [DEBUG] [LOCAL ] FFA: Deleted primary data file. [2025-09-17T18:59:10.806410] [INFO ] [MAIN ] FFA: Starting full primary refresh. [2025-09-17T18:59:10.820895] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-05. [2025-09-17T18:59:11.168425] [INFO ] [REMOTE ] FFA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:59:11.615776] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-11. [2025-09-17T18:59:12.202534] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T18:59:12.415734] [INFO ] [REMOTE ] FFA: Fetching primary data for 2024-12. [2025-09-17T18:59:12.533684] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T18:59:12.908359] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-17T18:59:13.215775] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-06. [2025-09-17T18:59:14.015782] [INFO ] [REMOTE ] FF: Fetching primary data for 2024-12. [2025-09-17T18:59:14.697455] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T18:59:14.815735] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-01. [2025-09-17T18:59:15.193032] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T18:59:15.405191] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T18:59:15.615794] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-02. [2025-09-17T18:59:16.415821] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-02. [2025-09-17T18:59:16.498030] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T18:59:17.055199] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T18:59:17.215765] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-03. [2025-09-17T18:59:17.791753] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T18:59:18.015821] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-03. [2025-09-17T18:59:18.815800] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-04. [2025-09-17T18:59:19.003452] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T18:59:19.412082] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T18:59:19.615825] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-05. [2025-09-17T18:59:20.195333] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T18:59:20.415783] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-06. [2025-09-17T18:59:21.020113] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T18:59:21.215783] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-04. [2025-09-17T18:59:21.907696] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T18:59:22.015786] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-07. [2025-09-17T18:59:22.815823] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-07. [2025-09-17T18:59:23.462577] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T18:59:23.615840] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-08. [2025-09-17T18:59:23.713001] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T18:59:24.240491] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T18:59:24.415847] [INFO ] [REMOTE ] FFA: Fetching primary data for 2025-09. [2025-09-17T18:59:25.056937] [INFO ] [REMOTE ] FFA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T18:59:25.058178] [INFO ] [REMOTE ] FFA: Full fetch complete (8131 records). [2025-09-17T18:59:25.058247] [DEBUG] [VALIDATOR ] FFA: Validating primary data. [2025-09-17T18:59:25.220876] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-05. [2025-09-17T18:59:25.437453] [DEBUG] [VALIDATOR ] FFA: All expected trading days are present. [2025-09-17T18:59:25.437535] [DEBUG] [VALIDATOR ] FFA: Primary data validation passed. [2025-09-17T18:59:25.437738] [INFO ] [MAIN ] FFA: Fetched primary data is valid. [2025-09-17T18:59:25.437780] [DEBUG] [LOCAL ] FFA: Saving primary data. [2025-09-17T18:59:25.438299] [DEBUG] [LOCAL ] FFA: Trimmed 8131 records to 5597 (keeping 200 days of data) [2025-09-17T18:59:25.473286] [DEBUG] [LOCAL ] FFA: Primary data saved (5597 records). [2025-09-17T18:59:25.473446] [INFO ] [MAIN ] FFA: Full history saved. [2025-09-17T18:59:25.473559] [INFO ] [MAIN ] Update Progress: 819/2371 symbols completed. FFA took 15.1s. Estimated remaining: 3h 46m 15s. Rate: 6.9 symbols/min [2025-09-17T18:59:25.647685] [INFO ] [MAIN ] FFC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:59:25.665917] [DEBUG] [LOCAL ] FFC: Loaded 16522 existing records from primary storage. [2025-09-17T18:59:25.666067] [INFO ] [MAIN ] FFC: Loaded 16522 existing records. [2025-09-17T18:59:25.850414] [WARN ] [MAIN ] FFC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:59:25.850735] [INFO ] [MAIN ] FFC: Wiping existing primary data before full refresh. [2025-09-17T18:59:25.850799] [INFO ] [LOCAL ] FFC: Starting deletion of primary data. [2025-09-17T18:59:25.851287] [DEBUG] [LOCAL ] FFC: Deleted primary data file. [2025-09-17T18:59:25.851342] [INFO ] [MAIN ] FFC: Starting full primary refresh. [2025-09-17T18:59:26.029401] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-08. [2025-09-17T18:59:26.197741] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T18:59:26.226193] [INFO ] [REMOTE ] FFC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:59:26.815839] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-06. [2025-09-17T18:59:27.615791] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-11. [2025-09-17T18:59:27.811016] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T18:59:27.859469] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T18:59:28.415772] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-07. [2025-09-17T18:59:28.663847] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T18:59:29.215777] [INFO ] [REMOTE ] FFC: Fetching primary data for 2024-12. [2025-09-17T18:59:29.336246] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T18:59:30.015799] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-01. [2025-09-17T18:59:30.287661] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T18:59:30.815784] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-01. [2025-09-17T18:59:31.192788] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T18:59:31.615758] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-02. [2025-09-17T18:59:31.669215] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T18:59:32.415852] [INFO ] [REMOTE ] FERG: Fetching primary data for 2025-09. [2025-09-17T18:59:32.747016] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T18:59:33.215814] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-02. [2025-09-17T18:59:33.997915] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T18:59:34.015740] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-03. [2025-09-17T18:59:34.037634] [INFO ] [REMOTE ] FERG: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T18:59:34.049611] [INFO ] [REMOTE ] FERG: Full fetch complete (70834 records). [2025-09-17T18:59:34.049894] [DEBUG] [VALIDATOR ] FERG: Validating primary data. [2025-09-17T18:59:34.469291] [DEBUG] [VALIDATOR ] FERG: All expected trading days are present. [2025-09-17T18:59:34.469398] [DEBUG] [VALIDATOR ] FERG: Primary data validation passed. [2025-09-17T18:59:34.470559] [INFO ] [MAIN ] FERG: Fetched primary data is valid. [2025-09-17T18:59:34.470620] [DEBUG] [LOCAL ] FERG: Saving primary data. [2025-09-17T18:59:34.472168] [DEBUG] [LOCAL ] FERG: Trimmed 70834 records to 49048 (keeping 200 days of data) [2025-09-17T18:59:34.789630] [DEBUG] [LOCAL ] FERG: Primary data saved (49048 records). [2025-09-17T18:59:34.789865] [INFO ] [MAIN ] FERG: Full history saved. [2025-09-17T18:59:34.789972] [INFO ] [MAIN ] Update Progress: 820/2371 symbols completed. FERG took 48.6s. Estimated remaining: 3h 46m 7s. Rate: 6.9 symbols/min [2025-09-17T18:59:34.824863] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-03. [2025-09-17T18:59:34.978745] [INFO ] [MAIN ] FFWM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:59:35.014635] [DEBUG] [LOCAL ] FFWM: Loaded 36298 existing records from primary storage. [2025-09-17T18:59:35.014797] [INFO ] [MAIN ] FFWM: Loaded 36298 existing records. [2025-09-17T18:59:35.209087] [WARN ] [MAIN ] FFWM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:59:35.210580] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T18:59:35.214445] [INFO ] [MAIN ] FFWM: Wiping existing primary data before full refresh. [2025-09-17T18:59:35.214669] [INFO ] [LOCAL ] FFWM: Starting deletion of primary data. [2025-09-17T18:59:35.216157] [DEBUG] [LOCAL ] FFWM: Deleted primary data file. [2025-09-17T18:59:35.216214] [INFO ] [MAIN ] FFWM: Starting full primary refresh. [2025-09-17T18:59:35.588016] [INFO ] [REMOTE ] FFWM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:59:35.615780] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-04. [2025-09-17T18:59:35.908115] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T18:59:36.415789] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-11. [2025-09-17T18:59:36.712358] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T18:59:37.215886] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-08. [2025-09-17T18:59:37.724325] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T18:59:38.015806] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-05. [2025-09-17T18:59:38.125565] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T18:59:38.815775] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2024-12. [2025-09-17T18:59:39.041386] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T18:59:39.615749] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-06. [2025-09-17T18:59:40.015737] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T18:59:40.379905] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T18:59:40.415720] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-07. [2025-09-17T18:59:41.215799] [INFO ] [REMOTE ] FET: Fetching primary data for 2025-09. [2025-09-17T18:59:41.435763] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T18:59:42.015754] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-01. [2025-09-17T18:59:42.241169] [INFO ] [REMOTE ] FET: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T18:59:42.243613] [INFO ] [REMOTE ] FET: Full fetch complete (17927 records). [2025-09-17T18:59:42.243741] [DEBUG] [VALIDATOR ] FET: Validating primary data. [2025-09-17T18:59:42.635537] [DEBUG] [VALIDATOR ] FET: All expected trading days are present. [2025-09-17T18:59:42.635623] [DEBUG] [VALIDATOR ] FET: Primary data validation passed. [2025-09-17T18:59:42.636250] [INFO ] [MAIN ] FET: Fetched primary data is valid. [2025-09-17T18:59:42.636320] [DEBUG] [LOCAL ] FET: Saving primary data. [2025-09-17T18:59:42.637002] [DEBUG] [LOCAL ] FET: Trimmed 17927 records to 12646 (keeping 200 days of data) [2025-09-17T18:59:42.716131] [DEBUG] [LOCAL ] FET: Primary data saved (12646 records). [2025-09-17T18:59:42.716283] [INFO ] [MAIN ] FET: Full history saved. [2025-09-17T18:59:42.716395] [INFO ] [MAIN ] Update Progress: 821/2371 symbols completed. FET took 40.1s. Estimated remaining: 3h 45m 57s. Rate: 6.9 symbols/min [2025-09-17T18:59:42.824492] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-08. [2025-09-17T18:59:42.903681] [INFO ] [MAIN ] FG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:59:42.928246] [DEBUG] [LOCAL ] FG: Loaded 22162 existing records from primary storage. [2025-09-17T18:59:42.928384] [INFO ] [MAIN ] FG: Loaded 22162 existing records. [2025-09-17T18:59:43.109404] [WARN ] [MAIN ] FG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:59:43.109927] [INFO ] [MAIN ] FG: Wiping existing primary data before full refresh. [2025-09-17T18:59:43.110020] [INFO ] [LOCAL ] FG: Starting deletion of primary data. [2025-09-17T18:59:43.110760] [DEBUG] [LOCAL ] FG: Deleted primary data file. [2025-09-17T18:59:43.110880] [INFO ] [MAIN ] FG: Starting full primary refresh. [2025-09-17T18:59:43.225729] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T18:59:43.503090] [INFO ] [REMOTE ] FG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:59:43.528822] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T18:59:43.615758] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-11. [2025-09-17T18:59:44.375604] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T18:59:44.415746] [INFO ] [REMOTE ] FG: Fetching primary data for 2024-12. [2025-09-17T18:59:45.215819] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-04. [2025-09-17T18:59:45.243483] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T18:59:46.015825] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-01. [2025-09-17T18:59:46.606594] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T18:59:46.622217] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T18:59:46.815794] [INFO ] [REMOTE ] FFC: Fetching primary data for 2025-09. [2025-09-17T18:59:47.615784] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-05. [2025-09-17T18:59:47.854118] [INFO ] [REMOTE ] FFC: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T18:59:47.856787] [INFO ] [REMOTE ] FFC: Full fetch complete (24785 records). [2025-09-17T18:59:47.856865] [DEBUG] [VALIDATOR ] FFC: Validating primary data. [2025-09-17T18:59:48.238946] [DEBUG] [VALIDATOR ] FFC: All expected trading days are present. [2025-09-17T18:59:48.239063] [DEBUG] [VALIDATOR ] FFC: Primary data validation passed. [2025-09-17T18:59:48.239547] [INFO ] [MAIN ] FFC: Fetched primary data is valid. [2025-09-17T18:59:48.239594] [DEBUG] [LOCAL ] FFC: Saving primary data. [2025-09-17T18:59:48.240338] [DEBUG] [LOCAL ] FFC: Trimmed 24785 records to 16631 (keeping 200 days of data) [2025-09-17T18:59:48.344469] [DEBUG] [LOCAL ] FFC: Primary data saved (16631 records). [2025-09-17T18:59:48.344616] [INFO ] [MAIN ] FFC: Full history saved. [2025-09-17T18:59:48.344737] [INFO ] [MAIN ] Update Progress: 822/2371 symbols completed. FFC took 22.9s. Estimated remaining: 3h 45m 42s. Rate: 6.9 symbols/min [2025-09-17T18:59:48.421534] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-02. [2025-09-17T18:59:48.521176] [INFO ] [MAIN ] FGN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T18:59:48.527853] [DEBUG] [LOCAL ] FGN: Loaded 4076 existing records from primary storage. [2025-09-17T18:59:48.527960] [INFO ] [MAIN ] FGN: Loaded 4076 existing records. [2025-09-17T18:59:48.703240] [WARN ] [MAIN ] FGN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T18:59:48.703472] [INFO ] [MAIN ] FGN: Wiping existing primary data before full refresh. [2025-09-17T18:59:48.703516] [INFO ] [LOCAL ] FGN: Starting deletion of primary data. [2025-09-17T18:59:48.703772] [DEBUG] [LOCAL ] FGN: Deleted primary data file. [2025-09-17T18:59:48.703817] [INFO ] [MAIN ] FGN: Starting full primary refresh. [2025-09-17T18:59:49.026486] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T18:59:49.090686] [INFO ] [REMOTE ] FGN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T18:59:49.215759] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-11. [2025-09-17T18:59:49.435285] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T18:59:49.607052] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T18:59:50.015804] [INFO ] [REMOTE ] FGN: Fetching primary data for 2024-12. [2025-09-17T18:59:50.597981] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T18:59:50.815820] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-01. [2025-09-17T18:59:51.392092] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T18:59:51.615792] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-03. [2025-09-17T18:59:52.415795] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-02. [2025-09-17T18:59:52.699027] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T18:59:53.035053] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T18:59:53.215864] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-03. [2025-09-17T18:59:54.015822] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-02. [2025-09-17T18:59:54.400195] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T18:59:54.503702] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T18:59:54.815825] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-03. [2025-09-17T18:59:55.458092] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T18:59:55.615783] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-04. [2025-09-17T18:59:56.415787] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-04. [2025-09-17T18:59:56.948680] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T18:59:57.074106] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T18:59:57.215779] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-05. [2025-09-17T18:59:58.015803] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-05. [2025-09-17T18:59:58.335238] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T18:59:58.506586] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T18:59:58.815853] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-06. [2025-09-17T18:59:59.615799] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-06. [2025-09-17T18:59:59.703892] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T19:00:00.415788] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-07. [2025-09-17T19:00:00.661479] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T19:00:01.215806] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-07. [2025-09-17T19:00:01.305184] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T19:00:02.015828] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-06. [2025-09-17T19:00:02.815785] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-08. [2025-09-17T19:00:02.927148] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T19:00:03.615811] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-08. [2025-09-17T19:00:04.415793] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-04. [2025-09-17T19:00:04.848906] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T19:00:04.987358] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-06 (2.97 seconds). [2025-09-17T19:00:05.215825] [INFO ] [REMOTE ] FF: Fetching primary data for 2025-09. [2025-09-17T19:00:06.017456] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-07. [2025-09-17T19:00:06.018886] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-08 (2.40 seconds). [2025-09-17T19:00:06.396472] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T19:00:06.503859] [INFO ] [REMOTE ] FF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T19:00:06.507538] [INFO ] [REMOTE ] FF: Full fetch complete (37357 records). [2025-09-17T19:00:06.507721] [DEBUG] [VALIDATOR ] FF: Validating primary data. [2025-09-17T19:00:06.706386] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T19:00:06.820965] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-05. [2025-09-17T19:00:06.939734] [DEBUG] [VALIDATOR ] FF: All expected trading days are present. [2025-09-17T19:00:06.939865] [DEBUG] [VALIDATOR ] FF: Primary data validation passed. [2025-09-17T19:00:06.940533] [INFO ] [MAIN ] FF: Fetched primary data is valid. [2025-09-17T19:00:06.940588] [DEBUG] [LOCAL ] FF: Saving primary data. [2025-09-17T19:00:06.941734] [DEBUG] [LOCAL ] FF: Trimmed 37357 records to 25939 (keeping 200 days of data) [2025-09-17T19:00:07.101900] [DEBUG] [LOCAL ] FF: Primary data saved (25939 records). [2025-09-17T19:00:07.102077] [INFO ] [MAIN ] FF: Full history saved. [2025-09-17T19:00:07.102192] [INFO ] [MAIN ] Update Progress: 823/2371 symbols completed. FF took 59.0s. Estimated remaining: 3h 45m 52s. Rate: 6.9 symbols/min [2025-09-17T19:00:07.279911] [INFO ] [MAIN ] FGSN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:00:07.280105] [DEBUG] [LOCAL ] FGSN: No existing data file found in primary storage. [2025-09-17T19:00:07.280143] [WARN ] [MAIN ] FGSN: No existing data found, performing full refresh instead. [2025-09-17T19:00:07.280270] [INFO ] [MAIN ] FGSN: Wiping existing primary data before full refresh. [2025-09-17T19:00:07.280310] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-17T19:00:07.280352] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-17T19:00:07.280385] [INFO ] [MAIN ] FGSN: Starting full primary refresh. [2025-09-17T19:00:07.621006] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-08. [2025-09-17T19:00:07.661202] [INFO ] [REMOTE ] FGSN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:00:08.312170] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T19:00:08.415799] [INFO ] [REMOTE ] FG: Fetching primary data for 2025-09. [2025-09-17T19:00:08.724478] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T19:00:09.215783] [INFO ] [REMOTE ] FGN: Fetching primary data for 2025-09. [2025-09-17T19:00:09.252029] [INFO ] [REMOTE ] FG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T19:00:09.256745] [INFO ] [REMOTE ] FG: Full fetch complete (26745 records). [2025-09-17T19:00:09.256921] [DEBUG] [VALIDATOR ] FG: Validating primary data. [2025-09-17T19:00:09.668025] [DEBUG] [VALIDATOR ] FG: All expected trading days are present. [2025-09-17T19:00:09.668127] [DEBUG] [VALIDATOR ] FG: Primary data validation passed. [2025-09-17T19:00:09.668716] [INFO ] [MAIN ] FG: Fetched primary data is valid. [2025-09-17T19:00:09.668796] [DEBUG] [LOCAL ] FG: Saving primary data. [2025-09-17T19:00:09.670062] [DEBUG] [LOCAL ] FG: Trimmed 26745 records to 22201 (keeping 200 days of data) [2025-09-17T19:00:09.816286] [DEBUG] [LOCAL ] FG: Primary data saved (22201 records). [2025-09-17T19:00:09.816424] [INFO ] [MAIN ] FG: Full history saved. [2025-09-17T19:00:09.816510] [INFO ] [MAIN ] Update Progress: 824/2371 symbols completed. FG took 27.1s. Estimated remaining: 3h 45m 32s. Rate: 6.9 symbols/min [2025-09-17T19:00:09.927131] [INFO ] [REMOTE ] FGN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T19:00:09.955417] [INFO ] [REMOTE ] FGN: Full fetch complete (5800 records). [2025-09-17T19:00:09.985575] [DEBUG] [VALIDATOR ] FGN: Validating primary data. [2025-09-17T19:00:10.022481] [INFO ] [MAIN ] FHI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:00:10.021021] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-11. [2025-09-17T19:00:10.323770] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:00:10.376971] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-11 [2025-09-17T19:00:10.379806] [DEBUG] [LOCAL ] FHI: Loaded 40817 existing records from primary storage. [2025-09-17T19:00:10.380558] [INFO ] [MAIN ] FHI: Loaded 40817 existing records. [2025-09-17T19:00:10.580873] [DEBUG] [VALIDATOR ] FGN: All expected trading days are present. [2025-09-17T19:00:10.586477] [DEBUG] [VALIDATOR ] FGN: Primary data validation passed. [2025-09-17T19:00:10.586974] [INFO ] [MAIN ] FGN: Fetched primary data is valid. [2025-09-17T19:00:10.587044] [DEBUG] [LOCAL ] FGN: Saving primary data. [2025-09-17T19:00:10.629519] [DEBUG] [LOCAL ] FGN: Trimmed 5800 records to 4061 (keeping 200 days of data) [2025-09-17T19:00:10.683817] [WARN ] [MAIN ] FHI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:00:10.689789] [INFO ] [MAIN ] FHI: Wiping existing primary data before full refresh. [2025-09-17T19:00:10.690988] [INFO ] [LOCAL ] FHI: Starting deletion of primary data. [2025-09-17T19:00:10.692342] [DEBUG] [LOCAL ] FGN: Primary data saved (4061 records). [2025-09-17T19:00:10.692500] [INFO ] [MAIN ] FGN: Full history saved. [2025-09-17T19:00:10.692597] [INFO ] [MAIN ] Update Progress: 825/2371 symbols completed. FGN took 22.3s. Estimated remaining: 3h 45m 9s. Rate: 6.9 symbols/min [2025-09-17T19:00:10.692814] [DEBUG] [LOCAL ] FHI: Deleted primary data file. [2025-09-17T19:00:10.692990] [INFO ] [MAIN ] FHI: Starting full primary refresh. [2025-09-17T19:00:10.831084] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2024-12. [2025-09-17T19:00:11.086511] [INFO ] [MAIN ] FHN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:00:11.138607] [DEBUG] [REMOTE ] FGSN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:00:11.161096] [WARN ] [REMOTE ] FGSN: No data returned for month 2024-12 [2025-09-17T19:00:11.278981] [INFO ] [REMOTE ] FHI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:00:11.321631] [DEBUG] [LOCAL ] FHN: Loaded 53367 existing records from primary storage. [2025-09-17T19:00:11.321832] [INFO ] [MAIN ] FHN: Loaded 53367 existing records. [2025-09-17T19:00:11.513866] [WARN ] [MAIN ] FHN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:00:11.514123] [INFO ] [MAIN ] FHN: Wiping existing primary data before full refresh. [2025-09-17T19:00:11.514171] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-17T19:00:11.515444] [DEBUG] [LOCAL ] FHN: Deleted primary data file. [2025-09-17T19:00:11.515512] [INFO ] [MAIN ] FHN: Starting full primary refresh. [2025-09-17T19:00:11.621065] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-11. [2025-09-17T19:00:11.890567] [INFO ] [REMOTE ] FHN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:00:12.415768] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-06. [2025-09-17T19:00:12.702998] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T19:00:13.215773] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-01. [2025-09-17T19:00:13.741856] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T19:00:14.015853] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-07. [2025-09-17T19:00:14.190756] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T19:00:14.815831] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-02. [2025-09-17T19:00:15.615801] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-11. [2025-09-17T19:00:16.357361] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T19:00:16.416018] [INFO ] [REMOTE ] FHI: Fetching primary data for 2024-12. [2025-09-17T19:00:16.797231] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-17T19:00:17.215746] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-08. [2025-09-17T19:00:17.258655] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T19:00:17.505159] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T19:00:18.015786] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-03. [2025-09-17T19:00:18.561399] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T19:00:18.602847] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T19:00:18.815838] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-01. [2025-09-17T19:00:19.615832] [INFO ] [REMOTE ] FFWM: Fetching primary data for 2025-09. [2025-09-17T19:00:19.915081] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T19:00:20.415761] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-02. [2025-09-17T19:00:20.622782] [INFO ] [REMOTE ] FFWM: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T19:00:20.627106] [INFO ] [REMOTE ] FFWM: Full fetch complete (51486 records). [2025-09-17T19:00:20.627205] [DEBUG] [VALIDATOR ] FFWM: Validating primary data. [2025-09-17T19:00:21.041027] [DEBUG] [VALIDATOR ] FFWM: All expected trading days are present. [2025-09-17T19:00:21.041126] [DEBUG] [VALIDATOR ] FFWM: Primary data validation passed. [2025-09-17T19:00:21.041828] [INFO ] [MAIN ] FFWM: Fetched primary data is valid. [2025-09-17T19:00:21.041876] [DEBUG] [LOCAL ] FFWM: Saving primary data. [2025-09-17T19:00:21.043386] [DEBUG] [LOCAL ] FFWM: Trimmed 51486 records to 36246 (keeping 200 days of data) [2025-09-17T19:00:21.222667] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-04. [2025-09-17T19:00:21.250061] [DEBUG] [LOCAL ] FFWM: Primary data saved (36246 records). [2025-09-17T19:00:21.250181] [INFO ] [MAIN ] FFWM: Full history saved. [2025-09-17T19:00:21.250263] [INFO ] [MAIN ] Update Progress: 826/2371 symbols completed. FFWM took 46.5s. Estimated remaining: 3h 45m 4s. Rate: 6.9 symbols/min [2025-09-17T19:00:21.418559] [INFO ] [MAIN ] FI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:00:21.471493] [DEBUG] [LOCAL ] FI: Loaded 53496 existing records from primary storage. [2025-09-17T19:00:21.471636] [INFO ] [MAIN ] FI: Loaded 53496 existing records. [2025-09-17T19:00:21.649312] [WARN ] [MAIN ] FI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:00:21.649580] [INFO ] [MAIN ] FI: Wiping existing primary data before full refresh. [2025-09-17T19:00:21.649632] [INFO ] [LOCAL ] FI: Starting deletion of primary data. [2025-09-17T19:00:21.650792] [DEBUG] [LOCAL ] FI: Deleted primary data file. [2025-09-17T19:00:21.650841] [INFO ] [MAIN ] FI: Starting full primary refresh. [2025-09-17T19:00:22.015762] [INFO ] [REMOTE ] FHN: Fetching primary data for 2024-12. [2025-09-17T19:00:22.014728] [INFO ] [REMOTE ] FI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:00:22.015596] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T19:00:22.042856] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T19:00:22.815837] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-05. [2025-09-17T19:00:23.345185] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T19:00:23.487372] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T19:00:23.615785] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-03. [2025-09-17T19:00:24.415840] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-11. [2025-09-17T19:00:25.215964] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-06. [2025-09-17T19:00:25.215893] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T19:00:25.885811] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T19:00:25.931722] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T19:00:26.015745] [INFO ] [REMOTE ] FI: Fetching primary data for 2024-12. [2025-09-17T19:00:26.815835] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-07. [2025-09-17T19:00:27.334407] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T19:00:27.615734] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-01. [2025-09-17T19:00:27.660569] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T19:00:28.415811] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-01. [2025-09-17T19:00:29.215820] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-08. [2025-09-17T19:00:29.302481] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T19:00:29.727429] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T19:00:30.018872] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-02. [2025-09-17T19:00:30.023506] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T19:00:30.815790] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-04. [2025-09-17T19:00:31.504581] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T19:00:31.615769] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-03. [2025-09-17T19:00:32.242500] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T19:00:32.415805] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-05. [2025-09-17T19:00:33.218816] [INFO ] [REMOTE ] FGSN: Fetching primary data for 2025-09. [2025-09-17T19:00:33.225446] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T19:00:33.688516] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T19:00:33.808293] [INFO ] [REMOTE ] FGSN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T19:00:33.809457] [INFO ] [REMOTE ] FGSN: Full fetch complete (7427 records). [2025-09-17T19:00:33.809526] [DEBUG] [VALIDATOR ] FGSN: Validating primary data. [2025-09-17T19:00:34.023952] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-06. [2025-09-17T19:00:34.030166] [WARN ] [VALIDATOR ] FGSN: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-09-17T19:00:34.031081] [FATAL] [MAIN ] FGSN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:00:34.031136] [WARN ] [MAIN ] FGSN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:00:34.031177] [INFO ] [LOCAL ] FGSN: Starting deletion of primary data. [2025-09-17T19:00:34.031241] [DEBUG] [LOCAL ] FGSN: No primary data file found to delete. [2025-09-17T19:00:34.031277] [INFO ] [LOCAL ] FGSN: Starting deletion of derivative data. [2025-09-17T19:00:34.031327] [DEBUG] [LOCAL ] FGSN: No derivative data file found to delete. [2025-09-17T19:00:34.031386] [INFO ] [MAIN ] Update Progress: 827/2371 symbols completed. FGSN took 26.9s. Estimated remaining: 3h 45m 2s. Rate: 6.9 symbols/min [2025-09-17T19:00:34.200536] [INFO ] [MAIN ] FICO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:00:34.221450] [DEBUG] [LOCAL ] FICO: Loaded 20354 existing records from primary storage. [2025-09-17T19:00:34.221574] [INFO ] [MAIN ] FICO: Loaded 20354 existing records. [2025-09-17T19:00:34.398688] [WARN ] [MAIN ] FICO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:00:34.399036] [INFO ] [MAIN ] FICO: Wiping existing primary data before full refresh. [2025-09-17T19:00:34.399105] [INFO ] [LOCAL ] FICO: Starting deletion of primary data. [2025-09-17T19:00:34.399723] [DEBUG] [LOCAL ] FICO: Deleted primary data file. [2025-09-17T19:00:34.399778] [INFO ] [MAIN ] FICO: Starting full primary refresh. [2025-09-17T19:00:34.759782] [INFO ] [REMOTE ] FICO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:00:34.815735] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-11. [2025-09-17T19:00:35.241243] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T19:00:35.615779] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-04. [2025-09-17T19:00:35.773140] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T19:00:36.415774] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-07. [2025-09-17T19:00:37.215772] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-02. [2025-09-17T19:00:37.353597] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T19:00:37.893445] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T19:00:38.015839] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-08. [2025-09-17T19:00:38.815785] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-05. [2025-09-17T19:00:38.989586] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T19:00:39.547037] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T19:00:39.615817] [INFO ] [REMOTE ] FHI: Fetching primary data for 2025-09. [2025-09-17T19:00:40.409920] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T19:00:40.420954] [INFO ] [REMOTE ] FICO: Fetching primary data for 2024-12. [2025-09-17T19:00:41.054278] [INFO ] [REMOTE ] FHI: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T19:00:41.059723] [INFO ] [REMOTE ] FHI: Full fetch complete (57495 records). [2025-09-17T19:00:41.059898] [DEBUG] [VALIDATOR ] FHI: Validating primary data. [2025-09-17T19:00:41.217906] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-03. [2025-09-17T19:00:41.483512] [DEBUG] [VALIDATOR ] FHI: All expected trading days are present. [2025-09-17T19:00:41.483611] [DEBUG] [VALIDATOR ] FHI: Primary data validation passed. [2025-09-17T19:00:41.484426] [INFO ] [MAIN ] FHI: Fetched primary data is valid. [2025-09-17T19:00:41.484492] [DEBUG] [LOCAL ] FHI: Saving primary data. [2025-09-17T19:00:41.485876] [DEBUG] [LOCAL ] FHI: Trimmed 57495 records to 40835 (keeping 200 days of data) [2025-09-17T19:00:41.596174] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T19:00:41.752701] [DEBUG] [LOCAL ] FHI: Primary data saved (40835 records). [2025-09-17T19:00:41.752842] [INFO ] [MAIN ] FHI: Full history saved. [2025-09-17T19:00:41.752947] [INFO ] [MAIN ] Update Progress: 828/2371 symbols completed. FHI took 31.9s. Estimated remaining: 3h 44m 52s. Rate: 6.9 symbols/min [2025-09-17T19:00:41.928925] [INFO ] [MAIN ] FIG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:00:41.929142] [DEBUG] [LOCAL ] FIG: No existing data file found in primary storage. [2025-09-17T19:00:41.929194] [WARN ] [MAIN ] FIG: No existing data found, performing full refresh instead. [2025-09-17T19:00:41.929352] [INFO ] [MAIN ] FIG: Wiping existing primary data before full refresh. [2025-09-17T19:00:41.929394] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-17T19:00:41.929437] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-17T19:00:41.929482] [INFO ] [MAIN ] FIG: Starting full primary refresh. [2025-09-17T19:00:42.020896] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-01. [2025-09-17T19:00:42.294705] [INFO ] [REMOTE ] FIG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:00:42.799426] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T19:00:42.815751] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-11. [2025-09-17T19:00:43.163047] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T19:00:43.263998] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T19:00:43.615762] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-02. [2025-09-17T19:00:44.415764] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-06. [2025-09-17T19:00:44.731137] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T19:00:45.215849] [INFO ] [REMOTE ] FIG: Fetching primary data for 2024-12. [2025-09-17T19:00:45.460619] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2024-12 (0.24 seconds). [2025-09-17T19:00:46.015847] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-01. [2025-09-17T19:00:46.248084] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-01 (0.23 seconds). [2025-09-17T19:00:46.250809] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T19:00:46.815781] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-03. [2025-09-17T19:00:47.615818] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-04. [2025-09-17T19:00:47.712078] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T19:00:48.415797] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-04. [2025-09-17T19:00:49.215708] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-07. [2025-09-17T19:00:49.464560] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T19:00:49.616912] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T19:00:50.015798] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-05. [2025-09-17T19:00:50.723844] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T19:00:50.815829] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-05. [2025-09-17T19:00:51.591167] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T19:00:51.615751] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-06. [2025-09-17T19:00:52.081427] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T19:00:52.415778] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-06. [2025-09-17T19:00:53.218205] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-08. [2025-09-17T19:00:53.220976] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T19:00:53.405772] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T19:00:54.015813] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-02. [2025-09-17T19:00:54.265386] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-02 (0.25 seconds). [2025-09-17T19:00:54.656983] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T19:00:54.815797] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-03. [2025-09-17T19:00:55.060188] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-17T19:00:55.615771] [INFO ] [REMOTE ] FHN: Fetching primary data for 2025-09. [2025-09-17T19:00:56.415791] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-07. [2025-09-17T19:00:57.003320] [INFO ] [REMOTE ] FHN: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T19:00:57.009834] [INFO ] [REMOTE ] FHN: Full fetch complete (76712 records). [2025-09-17T19:00:57.009959] [DEBUG] [VALIDATOR ] FHN: Validating primary data. [2025-09-17T19:00:57.011814] [FATAL] [VALIDATOR ] FHN: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T19:00:57.011928] [FATAL] [MAIN ] FHN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:00:57.011983] [WARN ] [MAIN ] FHN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:00:57.012027] [INFO ] [LOCAL ] FHN: Starting deletion of primary data. [2025-09-17T19:00:57.012087] [DEBUG] [LOCAL ] FHN: No primary data file found to delete. [2025-09-17T19:00:57.012165] [INFO ] [LOCAL ] FHN: Starting deletion of derivative data. [2025-09-17T19:00:57.012491] [DEBUG] [LOCAL ] FHN: Deleted derivative data file. [2025-09-17T19:00:57.012597] [INFO ] [MAIN ] Update Progress: 829/2371 symbols completed. FHN took 46.3s. Estimated remaining: 3h 44m 55s. Rate: 6.9 symbols/min [2025-09-17T19:00:57.181430] [INFO ] [MAIN ] FIGS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:00:57.227366] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-04. [2025-09-17T19:00:57.230050] [DEBUG] [LOCAL ] FIGS: Loaded 49138 existing records from primary storage. [2025-09-17T19:00:57.230209] [INFO ] [MAIN ] FIGS: Loaded 49138 existing records. [2025-09-17T19:00:57.412308] [WARN ] [MAIN ] FIGS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:00:57.412578] [INFO ] [MAIN ] FIGS: Wiping existing primary data before full refresh. [2025-09-17T19:00:57.412623] [INFO ] [LOCAL ] FIGS: Starting deletion of primary data. [2025-09-17T19:00:57.413538] [DEBUG] [LOCAL ] FIGS: Deleted primary data file. [2025-09-17T19:00:57.413599] [INFO ] [MAIN ] FIGS: Starting full primary refresh. [2025-09-17T19:00:57.771095] [INFO ] [REMOTE ] FIGS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:00:57.793668] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T19:00:57.812636] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T19:00:58.015791] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-05. [2025-09-17T19:00:58.279029] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-17T19:00:58.815790] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-07. [2025-09-17T19:00:59.615790] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-06. [2025-09-17T19:00:59.826441] [DEBUG] [REMOTE ] FIG: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:00:59.826823] [WARN ] [REMOTE ] FIG: No data returned for month 2025-06 [2025-09-17T19:01:00.415850] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-11. [2025-09-17T19:01:01.215807] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-08. [2025-09-17T19:01:01.428411] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-17T19:01:02.015797] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-08. [2025-09-17T19:01:02.494381] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T19:01:02.611712] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-17T19:01:02.815787] [INFO ] [REMOTE ] FICO: Fetching primary data for 2025-09. [2025-09-17T19:01:03.615811] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-07. [2025-09-17T19:01:03.853141] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T19:01:03.873090] [INFO ] [REMOTE ] FICO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T19:01:03.875332] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-17T19:01:03.879214] [INFO ] [REMOTE ] FICO: Full fetch complete (28060 records). [2025-09-17T19:01:03.879289] [DEBUG] [VALIDATOR ] FICO: Validating primary data. [2025-09-17T19:01:04.253589] [DEBUG] [VALIDATOR ] FICO: All expected trading days are present. [2025-09-17T19:01:04.253733] [DEBUG] [VALIDATOR ] FICO: Primary data validation passed. [2025-09-17T19:01:04.254246] [INFO ] [MAIN ] FICO: Fetched primary data is valid. [2025-09-17T19:01:04.254287] [DEBUG] [LOCAL ] FICO: Saving primary data. [2025-09-17T19:01:04.255027] [DEBUG] [LOCAL ] FICO: Trimmed 28060 records to 20419 (keeping 200 days of data) [2025-09-17T19:01:04.389839] [DEBUG] [LOCAL ] FICO: Primary data saved (20419 records). [2025-09-17T19:01:04.389973] [INFO ] [MAIN ] FICO: Full history saved. [2025-09-17T19:01:04.390073] [INFO ] [MAIN ] Update Progress: 830/2371 symbols completed. FICO took 30.4s. Estimated remaining: 3h 44m 44s. Rate: 6.9 symbols/min [2025-09-17T19:01:04.420904] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2024-12. [2025-09-17T19:01:04.565694] [INFO ] [MAIN ] FIHL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:01:04.611368] [DEBUG] [LOCAL ] FIHL: Loaded 40510 existing records from primary storage. [2025-09-17T19:01:04.611549] [INFO ] [MAIN ] FIHL: Loaded 40510 existing records. [2025-09-17T19:01:04.798119] [WARN ] [MAIN ] FIHL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:01:04.798424] [INFO ] [MAIN ] FIHL: Wiping existing primary data before full refresh. [2025-09-17T19:01:04.798469] [INFO ] [LOCAL ] FIHL: Starting deletion of primary data. [2025-09-17T19:01:04.799444] [DEBUG] [LOCAL ] FIHL: Deleted primary data file. [2025-09-17T19:01:04.799504] [INFO ] [MAIN ] FIHL: Starting full primary refresh. [2025-09-17T19:01:05.149587] [INFO ] [REMOTE ] FIHL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:01:05.215741] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-11. [2025-09-17T19:01:06.015701] [INFO ] [REMOTE ] FI: Fetching primary data for 2025-09. [2025-09-17T19:01:06.128187] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T19:01:06.200480] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T19:01:06.815783] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-08. [2025-09-17T19:01:07.615777] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-01. [2025-09-17T19:01:07.861780] [INFO ] [REMOTE ] FI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T19:01:07.868722] [INFO ] [REMOTE ] FI: Full fetch complete (76980 records). [2025-09-17T19:01:07.868886] [DEBUG] [VALIDATOR ] FI: Validating primary data. [2025-09-17T19:01:08.261239] [DEBUG] [VALIDATOR ] FI: All expected trading days are present. [2025-09-17T19:01:08.261323] [DEBUG] [VALIDATOR ] FI: Primary data validation passed. [2025-09-17T19:01:08.262208] [INFO ] [MAIN ] FI: Fetched primary data is valid. [2025-09-17T19:01:08.262256] [DEBUG] [LOCAL ] FI: Saving primary data. [2025-09-17T19:01:08.263775] [DEBUG] [LOCAL ] FI: Trimmed 76980 records to 53498 (keeping 200 days of data) [2025-09-17T19:01:08.445618] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2024-12. [2025-09-17T19:01:08.602570] [DEBUG] [LOCAL ] FI: Primary data saved (53498 records). [2025-09-17T19:01:08.602745] [INFO ] [MAIN ] FI: Full history saved. [2025-09-17T19:01:08.602897] [INFO ] [MAIN ] Update Progress: 831/2371 symbols completed. FI took 47.4s. Estimated remaining: 3h 44m 27s. Rate: 6.9 symbols/min [2025-09-17T19:01:08.776811] [INFO ] [MAIN ] FINS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:01:08.789543] [DEBUG] [LOCAL ] FINS: Loaded 8211 existing records from primary storage. [2025-09-17T19:01:08.789698] [INFO ] [MAIN ] FINS: Loaded 8211 existing records. [2025-09-17T19:01:08.968826] [WARN ] [MAIN ] FINS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:01:08.969078] [INFO ] [MAIN ] FINS: Wiping existing primary data before full refresh. [2025-09-17T19:01:08.969130] [INFO ] [LOCAL ] FINS: Starting deletion of primary data. [2025-09-17T19:01:08.969523] [DEBUG] [LOCAL ] FINS: Deleted primary data file. [2025-09-17T19:01:08.969567] [INFO ] [MAIN ] FINS: Starting full primary refresh. [2025-09-17T19:01:09.341687] [INFO ] [REMOTE ] FINS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:01:09.342084] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-11. [2025-09-17T19:01:09.371402] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T19:01:09.414464] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-17T19:01:09.852190] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T19:01:09.885190] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T19:01:10.015775] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-02. [2025-09-17T19:01:10.815774] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-01. [2025-09-17T19:01:11.257770] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T19:01:11.615734] [INFO ] [REMOTE ] FIG: Fetching primary data for 2025-09. [2025-09-17T19:01:12.078560] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T19:01:12.415754] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-03. [2025-09-17T19:01:13.215783] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-02. [2025-09-17T19:01:14.015831] [INFO ] [REMOTE ] FINS: Fetching primary data for 2024-12. [2025-09-17T19:01:14.113312] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T19:01:14.191394] [INFO ] [REMOTE ] FIG: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-17T19:01:14.198560] [INFO ] [REMOTE ] FIG: Full fetch complete (13476 records). [2025-09-17T19:01:14.198668] [DEBUG] [VALIDATOR ] FIG: Validating primary data. [2025-09-17T19:01:14.383076] [WARN ] [VALIDATOR ] FIG: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-17T19:01:14.383405] [FATAL] [MAIN ] FIG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:01:14.383483] [WARN ] [MAIN ] FIG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:01:14.383533] [INFO ] [LOCAL ] FIG: Starting deletion of primary data. [2025-09-17T19:01:14.383595] [DEBUG] [LOCAL ] FIG: No primary data file found to delete. [2025-09-17T19:01:14.383676] [INFO ] [LOCAL ] FIG: Starting deletion of derivative data. [2025-09-17T19:01:14.387663] [DEBUG] [LOCAL ] FIG: No derivative data file found to delete. [2025-09-17T19:01:14.388056] [INFO ] [MAIN ] Update Progress: 832/2371 symbols completed. FIG took 32.6s. Estimated remaining: 3h 44m 12s. Rate: 6.9 symbols/min [2025-09-17T19:01:14.561334] [INFO ] [MAIN ] FINV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:01:14.607695] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T19:01:14.630078] [DEBUG] [LOCAL ] FINV: Loaded 44869 existing records from primary storage. [2025-09-17T19:01:14.630232] [INFO ] [MAIN ] FINV: Loaded 44869 existing records. [2025-09-17T19:01:14.816028] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-03. [2025-09-17T19:01:14.819899] [WARN ] [MAIN ] FINV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:01:14.830237] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T19:01:14.830405] [INFO ] [MAIN ] FINV: Wiping existing primary data before full refresh. [2025-09-17T19:01:14.834488] [INFO ] [LOCAL ] FINV: Starting deletion of primary data. [2025-09-17T19:01:14.835886] [DEBUG] [LOCAL ] FINV: Deleted primary data file. [2025-09-17T19:01:14.835947] [INFO ] [MAIN ] FINV: Starting full primary refresh. [2025-09-17T19:01:15.201110] [INFO ] [REMOTE ] FINV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:01:15.615786] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-11. [2025-09-17T19:01:16.314491] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T19:01:16.415791] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-01. [2025-09-17T19:01:16.554580] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T19:01:16.851983] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T19:01:17.215789] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-02. [2025-09-17T19:01:17.894872] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T19:01:18.015787] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-04. [2025-09-17T19:01:18.815811] [INFO ] [REMOTE ] FINV: Fetching primary data for 2024-12. [2025-09-17T19:01:19.615786] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-03. [2025-09-17T19:01:19.655724] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T19:01:20.284533] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T19:01:20.309848] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T19:01:20.415756] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-01. [2025-09-17T19:01:21.215792] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-04. [2025-09-17T19:01:21.889698] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T19:01:22.015819] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-02. [2025-09-17T19:01:22.710747] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T19:01:22.815747] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-05. [2025-09-17T19:01:23.220020] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T19:01:23.615762] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-04. [2025-09-17T19:01:24.161580] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T19:01:24.379041] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T19:01:24.415733] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-05. [2025-09-17T19:01:25.218875] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-05. [2025-09-17T19:01:25.221786] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T19:01:26.015815] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-03. [2025-09-17T19:01:26.805737] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T19:01:26.815752] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-06. [2025-09-17T19:01:27.279928] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T19:01:27.296972] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T19:01:27.615835] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-06. [2025-09-17T19:01:28.415786] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-04. [2025-09-17T19:01:29.215833] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-06. [2025-09-17T19:01:29.293735] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T19:01:30.013873] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T19:01:30.022910] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-07. [2025-09-17T19:01:30.586913] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T19:01:30.721842] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T19:01:30.815750] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-07. [2025-09-17T19:01:31.615784] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-05. [2025-09-17T19:01:32.365620] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T19:01:32.415819] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-07. [2025-09-17T19:01:32.774384] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T19:01:33.215823] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-08. [2025-09-17T19:01:33.765837] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T19:01:33.901486] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T19:01:34.015802] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-08. [2025-09-17T19:01:34.815784] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-08. [2025-09-17T19:01:35.615803] [INFO ] [REMOTE ] FINS: Fetching primary data for 2025-09. [2025-09-17T19:01:35.734271] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T19:01:36.269670] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T19:01:36.293953] [INFO ] [REMOTE ] FINS: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T19:01:36.295511] [INFO ] [REMOTE ] FINS: Full fetch complete (12865 records). [2025-09-17T19:01:36.295583] [DEBUG] [VALIDATOR ] FINS: Validating primary data. [2025-09-17T19:01:36.420867] [INFO ] [REMOTE ] FIHL: Fetching primary data for 2025-09. [2025-09-17T19:01:36.678178] [DEBUG] [VALIDATOR ] FINS: All expected trading days are present. [2025-09-17T19:01:36.678266] [DEBUG] [VALIDATOR ] FINS: Primary data validation passed. [2025-09-17T19:01:36.678564] [INFO ] [MAIN ] FINS: Fetched primary data is valid. [2025-09-17T19:01:36.678605] [DEBUG] [LOCAL ] FINS: Saving primary data. [2025-09-17T19:01:36.679116] [DEBUG] [LOCAL ] FINS: Trimmed 12865 records to 8196 (keeping 200 days of data) [2025-09-17T19:01:36.730282] [DEBUG] [LOCAL ] FINS: Primary data saved (8196 records). [2025-09-17T19:01:36.730419] [INFO ] [MAIN ] FINS: Full history saved. [2025-09-17T19:01:36.730506] [INFO ] [MAIN ] Update Progress: 833/2371 symbols completed. FINS took 28.1s. Estimated remaining: 3h 44m 29s. Rate: 6.9 symbols/min [2025-09-17T19:01:36.906905] [INFO ] [MAIN ] FIS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:01:36.957101] [DEBUG] [LOCAL ] FIS: Loaded 53373 existing records from primary storage. [2025-09-17T19:01:36.957269] [INFO ] [MAIN ] FIS: Loaded 53373 existing records. [2025-09-17T19:01:37.147977] [WARN ] [MAIN ] FIS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:01:37.148243] [INFO ] [MAIN ] FIS: Wiping existing primary data before full refresh. [2025-09-17T19:01:37.148301] [INFO ] [LOCAL ] FIS: Starting deletion of primary data. [2025-09-17T19:01:37.149450] [DEBUG] [LOCAL ] FIS: Deleted primary data file. [2025-09-17T19:01:37.149515] [INFO ] [MAIN ] FIS: Starting full primary refresh. [2025-09-17T19:01:37.220888] [INFO ] [REMOTE ] FIGS: Fetching primary data for 2025-09. [2025-09-17T19:01:37.527044] [INFO ] [REMOTE ] FIS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:01:37.937384] [INFO ] [REMOTE ] FIHL: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T19:01:37.944614] [INFO ] [REMOTE ] FIHL: Full fetch complete (55494 records). [2025-09-17T19:01:37.944797] [DEBUG] [VALIDATOR ] FIHL: Validating primary data. [2025-09-17T19:01:38.024625] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-11. [2025-09-17T19:01:38.390401] [DEBUG] [VALIDATOR ] FIHL: All expected trading days are present. [2025-09-17T19:01:38.390528] [DEBUG] [VALIDATOR ] FIHL: Primary data validation passed. [2025-09-17T19:01:38.392162] [INFO ] [MAIN ] FIHL: Fetched primary data is valid. [2025-09-17T19:01:38.392257] [DEBUG] [LOCAL ] FIHL: Saving primary data. [2025-09-17T19:01:38.394141] [DEBUG] [LOCAL ] FIHL: Trimmed 55494 records to 40536 (keeping 200 days of data) [2025-09-17T19:01:38.801534] [INFO ] [REMOTE ] FIGS: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T19:01:38.815810] [INFO ] [REMOTE ] FIGS: Full fetch complete (71014 records). [2025-09-17T19:01:38.815958] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-06. [2025-09-17T19:01:38.816953] [DEBUG] [VALIDATOR ] FIGS: Validating primary data. [2025-09-17T19:01:38.895721] [DEBUG] [LOCAL ] FIHL: Primary data saved (40536 records). [2025-09-17T19:01:38.895885] [INFO ] [MAIN ] FIHL: Full history saved. [2025-09-17T19:01:38.895984] [INFO ] [MAIN ] Update Progress: 834/2371 symbols completed. FIHL took 34.5s. Estimated remaining: 3h 44m 8s. Rate: 6.9 symbols/min [2025-09-17T19:01:39.466884] [INFO ] [MAIN ] FIX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:01:39.690175] [DEBUG] [VALIDATOR ] FIGS: All expected trading days are present. [2025-09-17T19:01:39.690349] [DEBUG] [VALIDATOR ] FIGS: Primary data validation passed. [2025-09-17T19:01:39.691167] [INFO ] [MAIN ] FIGS: Fetched primary data is valid. [2025-09-17T19:01:39.691301] [DEBUG] [LOCAL ] FIGS: Saving primary data. [2025-09-17T19:01:39.693105] [DEBUG] [LOCAL ] FIGS: Trimmed 71014 records to 49098 (keeping 200 days of data) [2025-09-17T19:01:39.764579] [DEBUG] [LOCAL ] FIX: Loaded 31072 existing records from primary storage. [2025-09-17T19:01:39.790878] [INFO ] [MAIN ] FIX: Loaded 31072 existing records. [2025-09-17T19:01:40.000570] [WARN ] [MAIN ] FIX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:01:40.001048] [INFO ] [MAIN ] FIX: Wiping existing primary data before full refresh. [2025-09-17T19:01:40.001112] [INFO ] [LOCAL ] FIX: Starting deletion of primary data. [2025-09-17T19:01:40.002091] [DEBUG] [LOCAL ] FIX: Deleted primary data file. [2025-09-17T19:01:40.019198] [INFO ] [MAIN ] FIX: Starting full primary refresh. [2025-09-17T19:01:40.109744] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-11 (2.09 seconds). [2025-09-17T19:01:40.157108] [INFO ] [REMOTE ] FIS: Fetching primary data for 2024-12. [2025-09-17T19:01:40.442533] [INFO ] [REMOTE ] FIX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:01:40.442965] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-11. [2025-09-17T19:01:40.567506] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T19:01:40.654008] [DEBUG] [LOCAL ] FIGS: Primary data saved (49098 records). [2025-09-17T19:01:40.654161] [INFO ] [MAIN ] FIGS: Full history saved. [2025-09-17T19:01:40.654263] [INFO ] [MAIN ] Update Progress: 835/2371 symbols completed. FIGS took 43.6s. Estimated remaining: 3h 43m 46s. Rate: 6.9 symbols/min [2025-09-17T19:01:40.822400] [INFO ] [MAIN ] FIXT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:01:40.822539] [DEBUG] [LOCAL ] FIXT: No existing data file found in primary storage. [2025-09-17T19:01:40.822574] [WARN ] [MAIN ] FIXT: No existing data found, performing full refresh instead. [2025-09-17T19:01:40.822756] [INFO ] [MAIN ] FIXT: Wiping existing primary data before full refresh. [2025-09-17T19:01:40.822798] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-17T19:01:40.822838] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-17T19:01:40.822870] [INFO ] [MAIN ] FIXT: Starting full primary refresh. [2025-09-17T19:01:41.200802] [INFO ] [REMOTE ] FIXT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:01:41.215746] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-11. [2025-09-17T19:01:41.405687] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:01:41.406047] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-11 [2025-09-17T19:01:41.687890] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T19:01:41.857613] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T19:01:42.015792] [INFO ] [REMOTE ] FIX: Fetching primary data for 2024-12. [2025-09-17T19:01:42.815879] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-07. [2025-09-17T19:01:43.026867] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T19:01:43.615810] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2024-12. [2025-09-17T19:01:43.815897] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:01:43.816222] [WARN ] [REMOTE ] FIXT: No data returned for month 2024-12 [2025-09-17T19:01:44.415771] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-01. [2025-09-17T19:01:44.623659] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T19:01:45.215834] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-01. [2025-09-17T19:01:45.431237] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:01:45.431580] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-01 [2025-09-17T19:01:46.015805] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-08. [2025-09-17T19:01:46.217193] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T19:01:46.815777] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-02. [2025-09-17T19:01:47.008593] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:01:47.009199] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-02 [2025-09-17T19:01:47.536570] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T19:01:47.615804] [INFO ] [REMOTE ] FINV: Fetching primary data for 2025-09. [2025-09-17T19:01:48.415784] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-02. [2025-09-17T19:01:49.050157] [INFO ] [REMOTE ] FINV: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T19:01:49.056434] [INFO ] [REMOTE ] FINV: Full fetch complete (63425 records). [2025-09-17T19:01:49.056532] [DEBUG] [VALIDATOR ] FINV: Validating primary data. [2025-09-17T19:01:49.229098] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-03. [2025-09-17T19:01:49.444657] [DEBUG] [VALIDATOR ] FINV: All expected trading days are present. [2025-09-17T19:01:49.444737] [DEBUG] [VALIDATOR ] FINV: Primary data validation passed. [2025-09-17T19:01:49.445532] [INFO ] [MAIN ] FINV: Fetched primary data is valid. [2025-09-17T19:01:49.445575] [DEBUG] [LOCAL ] FINV: Saving primary data. [2025-09-17T19:01:49.446948] [DEBUG] [LOCAL ] FINV: Trimmed 63425 records to 44930 (keeping 200 days of data) [2025-09-17T19:01:49.534684] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:01:49.537693] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-03 [2025-09-17T19:01:49.712330] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T19:01:49.753833] [DEBUG] [LOCAL ] FINV: Primary data saved (44930 records). [2025-09-17T19:01:49.753952] [INFO ] [MAIN ] FINV: Full history saved. [2025-09-17T19:01:49.754768] [INFO ] [MAIN ] Update Progress: 836/2371 symbols completed. FINV took 35.4s. Estimated remaining: 3h 43m 38s. Rate: 6.9 symbols/min [2025-09-17T19:01:49.935521] [INFO ] [MAIN ] FLC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:01:49.946330] [DEBUG] [LOCAL ] FLC: Loaded 5733 existing records from primary storage. [2025-09-17T19:01:49.946480] [INFO ] [MAIN ] FLC: Loaded 5733 existing records. [2025-09-17T19:01:50.020957] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-04. [2025-09-17T19:01:50.172529] [WARN ] [MAIN ] FLC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:01:50.172825] [INFO ] [MAIN ] FLC: Wiping existing primary data before full refresh. [2025-09-17T19:01:50.172870] [INFO ] [LOCAL ] FLC: Starting deletion of primary data. [2025-09-17T19:01:50.173333] [DEBUG] [LOCAL ] FLC: Deleted primary data file. [2025-09-17T19:01:50.173376] [INFO ] [MAIN ] FLC: Starting full primary refresh. [2025-09-17T19:01:50.272157] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:01:50.275703] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-04 [2025-09-17T19:01:50.532098] [INFO ] [REMOTE ] FLC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:01:50.815795] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-03. [2025-09-17T19:01:51.615801] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-05. [2025-09-17T19:01:51.812693] [DEBUG] [REMOTE ] FIXT: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:01:51.813033] [WARN ] [REMOTE ] FIXT: No data returned for month 2025-05 [2025-09-17T19:01:52.300670] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T19:01:52.415827] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-01. [2025-09-17T19:01:53.215785] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-04. [2025-09-17T19:01:53.599254] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T19:01:54.015834] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-02. [2025-09-17T19:01:54.815781] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-11. [2025-09-17T19:01:55.057333] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T19:01:55.272407] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T19:01:55.497504] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T19:01:55.615782] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-05. [2025-09-17T19:01:56.415789] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-03. [2025-09-17T19:01:57.215791] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-06. [2025-09-17T19:01:57.315545] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T19:01:57.534837] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T19:01:57.997396] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T19:01:58.015746] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-04. [2025-09-17T19:01:58.815788] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-06. [2025-09-17T19:01:59.615831] [INFO ] [REMOTE ] FLC: Fetching primary data for 2024-12. [2025-09-17T19:01:59.696846] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T19:02:00.177302] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T19:02:00.208707] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T19:02:00.415771] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-01. [2025-09-17T19:02:01.114174] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T19:02:01.215776] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-05. [2025-09-17T19:02:02.015802] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-07. [2025-09-17T19:02:02.526978] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T19:02:02.590270] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T19:02:02.815801] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-02. [2025-09-17T19:02:03.458822] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T19:02:03.615784] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-08. [2025-09-17T19:02:04.058244] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T19:02:04.415788] [INFO ] [REMOTE ] FIXT: Fetching primary data for 2025-09. [2025-09-17T19:02:05.215783] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-06. [2025-09-17T19:02:05.227220] [INFO ] [REMOTE ] FIXT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T19:02:05.228607] [INFO ] [REMOTE ] FIXT: Full fetch complete (1664 records). [2025-09-17T19:02:05.228786] [DEBUG] [VALIDATOR ] FIXT: Validating primary data. [2025-09-17T19:02:05.414205] [WARN ] [VALIDATOR ] FIXT: Validation failed - insufficient historical data. Have 65 unique days, need 200 days [2025-09-17T19:02:05.414394] [FATAL] [MAIN ] FIXT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:02:05.414444] [WARN ] [MAIN ] FIXT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:02:05.414492] [INFO ] [LOCAL ] FIXT: Starting deletion of primary data. [2025-09-17T19:02:05.414549] [DEBUG] [LOCAL ] FIXT: No primary data file found to delete. [2025-09-17T19:02:05.414586] [INFO ] [LOCAL ] FIXT: Starting deletion of derivative data. [2025-09-17T19:02:05.414627] [DEBUG] [LOCAL ] FIXT: No derivative data file found to delete. [2025-09-17T19:02:05.414709] [INFO ] [MAIN ] Update Progress: 837/2371 symbols completed. FIXT took 24.8s. Estimated remaining: 3h 43m 42s. Rate: 6.9 symbols/min [2025-09-17T19:02:06.015767] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-07. [2025-09-17T19:02:06.431708] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T19:02:06.815794] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-07. [2025-09-17T19:02:07.615853] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-03. [2025-09-17T19:02:07.982780] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T19:02:08.041881] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T19:02:08.263570] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T19:02:08.415749] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-08. [2025-09-17T19:02:09.215773] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-04. [2025-09-17T19:02:09.960686] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T19:02:09.968062] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T19:02:10.015753] [INFO ] [REMOTE ] FIS: Fetching primary data for 2025-09. [2025-09-17T19:02:10.815835] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-05. [2025-09-17T19:02:11.495951] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T19:02:11.615739] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-06. [2025-09-17T19:02:12.086815] [INFO ] [REMOTE ] FIS: Incremental fetch complete for 2025-09 (2.07 seconds). [2025-09-17T19:02:12.093606] [INFO ] [REMOTE ] FIS: Full fetch complete (76999 records). [2025-09-17T19:02:12.093790] [DEBUG] [VALIDATOR ] FIS: Validating primary data. [2025-09-17T19:02:12.421399] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-08. [2025-09-17T19:02:12.421304] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T19:02:12.533302] [DEBUG] [VALIDATOR ] FIS: All expected trading days are present. [2025-09-17T19:02:12.533407] [DEBUG] [VALIDATOR ] FIS: Primary data validation passed. [2025-09-17T19:02:12.534684] [INFO ] [MAIN ] FIS: Fetched primary data is valid. [2025-09-17T19:02:12.534759] [DEBUG] [LOCAL ] FIS: Saving primary data. [2025-09-17T19:02:12.536579] [DEBUG] [LOCAL ] FIS: Trimmed 76999 records to 53372 (keeping 200 days of data) [2025-09-17T19:02:12.903438] [DEBUG] [LOCAL ] FIS: Primary data saved (53372 records). [2025-09-17T19:02:12.903585] [INFO ] [MAIN ] FIS: Full history saved. [2025-09-17T19:02:12.903705] [INFO ] [MAIN ] Update Progress: 838/2371 symbols completed. FIS took 36.2s. Estimated remaining: 3h 43m 31s. Rate: 6.9 symbols/min [2025-09-17T19:02:13.215791] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-07. [2025-09-17T19:02:13.749075] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T19:02:13.821408] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T19:02:14.015812] [INFO ] [REMOTE ] FIX: Fetching primary data for 2025-09. [2025-09-17T19:02:14.815801] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-08. [2025-09-17T19:02:15.357706] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T19:02:15.567539] [INFO ] [REMOTE ] FIX: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T19:02:15.571706] [INFO ] [REMOTE ] FIX: Full fetch complete (45685 records). [2025-09-17T19:02:15.571801] [DEBUG] [VALIDATOR ] FIX: Validating primary data. [2025-09-17T19:02:15.621928] [INFO ] [REMOTE ] FLC: Fetching primary data for 2025-09. [2025-09-17T19:02:15.968755] [DEBUG] [VALIDATOR ] FIX: All expected trading days are present. [2025-09-17T19:02:15.968842] [DEBUG] [VALIDATOR ] FIX: Primary data validation passed. [2025-09-17T19:02:15.969529] [INFO ] [MAIN ] FIX: Fetched primary data is valid. [2025-09-17T19:02:15.969572] [DEBUG] [LOCAL ] FIX: Saving primary data. [2025-09-17T19:02:15.970619] [DEBUG] [LOCAL ] FIX: Trimmed 45685 records to 30992 (keeping 200 days of data) [2025-09-17T19:02:16.174039] [DEBUG] [LOCAL ] FIX: Primary data saved (30992 records). [2025-09-17T19:02:16.174188] [INFO ] [MAIN ] FIX: Full history saved. [2025-09-17T19:02:16.174274] [INFO ] [MAIN ] Update Progress: 839/2371 symbols completed. FIX took 37.3s. Estimated remaining: 3h 43m 12s. Rate: 6.9 symbols/min [2025-09-17T19:02:16.416739] [INFO ] [REMOTE ] FLC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T19:02:16.418006] [INFO ] [REMOTE ] FLC: Full fetch complete (8160 records). [2025-09-17T19:02:16.418075] [DEBUG] [VALIDATOR ] FLC: Validating primary data. [2025-09-17T19:02:16.785451] [DEBUG] [VALIDATOR ] FLC: All expected trading days are present. [2025-09-17T19:02:16.785528] [DEBUG] [VALIDATOR ] FLC: Primary data validation passed. [2025-09-17T19:02:16.785816] [INFO ] [MAIN ] FLC: Fetched primary data is valid. [2025-09-17T19:02:16.785868] [DEBUG] [LOCAL ] FLC: Saving primary data. [2025-09-17T19:02:16.786295] [DEBUG] [LOCAL ] FLC: Trimmed 8160 records to 5754 (keeping 200 days of data) [2025-09-17T19:02:16.822246] [DEBUG] [LOCAL ] FLC: Primary data saved (5754 records). [2025-09-17T19:02:16.822361] [INFO ] [MAIN ] FLC: Full history saved. [2025-09-17T19:02:16.822452] [INFO ] [MAIN ] Update Progress: 840/2371 symbols completed. FLC took 27.1s. Estimated remaining: 3h 42m 49s. Rate: 6.9 symbols/min [2025-09-17T19:02:17.536037] [INFO ] [MAIN ] FLOC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:02:17.569723] [INFO ] [MAIN ] FLO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:02:17.543105] [INFO ] [MAIN ] FLNG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:02:17.572098] [DEBUG] [LOCAL ] FLOC: No existing data file found in primary storage. [2025-09-17T19:02:17.586469] [WARN ] [MAIN ] FLOC: No existing data found, performing full refresh instead. [2025-09-17T19:02:17.590168] [INFO ] [MAIN ] FLG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:02:17.590759] [INFO ] [MAIN ] FLOC: Wiping existing primary data before full refresh. [2025-09-17T19:02:17.591563] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-17T19:02:17.591668] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-17T19:02:17.592115] [INFO ] [MAIN ] FLOC: Starting full primary refresh. [2025-09-17T19:02:17.973958] [DEBUG] [LOCAL ] FLNG: Loaded 34281 existing records from primary storage. [2025-09-17T19:02:18.000167] [INFO ] [MAIN ] FLNG: Loaded 34281 existing records. [2025-09-17T19:02:18.001143] [DEBUG] [LOCAL ] FLG: Loaded 53342 existing records from primary storage. [2025-09-17T19:02:18.020775] [INFO ] [MAIN ] FLG: Loaded 53342 existing records. [2025-09-17T19:02:18.136856] [DEBUG] [LOCAL ] FLO: Loaded 51831 existing records from primary storage. [2025-09-17T19:02:18.272367] [INFO ] [MAIN ] FLO: Loaded 51831 existing records. [2025-09-17T19:02:18.336848] [INFO ] [REMOTE ] FLOC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:02:18.353190] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-11. [2025-09-17T19:02:18.591944] [WARN ] [MAIN ] FLNG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:02:18.614555] [WARN ] [MAIN ] FLG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:02:18.615180] [INFO ] [MAIN ] FLNG: Wiping existing primary data before full refresh. [2025-09-17T19:02:18.637383] [INFO ] [LOCAL ] FLNG: Starting deletion of primary data. [2025-09-17T19:02:18.632103] [INFO ] [MAIN ] FLG: Wiping existing primary data before full refresh. [2025-09-17T19:02:18.662303] [DEBUG] [LOCAL ] FLNG: Deleted primary data file. [2025-09-17T19:02:18.674170] [INFO ] [LOCAL ] FLG: Starting deletion of primary data. [2025-09-17T19:02:18.696578] [WARN ] [MAIN ] FLO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:02:18.696951] [INFO ] [MAIN ] FLNG: Starting full primary refresh. [2025-09-17T19:02:18.697303] [INFO ] [MAIN ] FLO: Wiping existing primary data before full refresh. [2025-09-17T19:02:18.717908] [DEBUG] [LOCAL ] FLG: Deleted primary data file. [2025-09-17T19:02:18.718057] [INFO ] [MAIN ] FLG: Starting full primary refresh. [2025-09-17T19:02:18.718118] [INFO ] [LOCAL ] FLO: Starting deletion of primary data. [2025-09-17T19:02:18.758319] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:02:18.791078] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-11 [2025-09-17T19:02:18.850228] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2024-12. [2025-09-17T19:02:18.825989] [DEBUG] [LOCAL ] FLO: Deleted primary data file. [2025-09-17T19:02:18.867469] [INFO ] [MAIN ] FLO: Starting full primary refresh. [2025-09-17T19:02:19.170141] [DEBUG] [REMOTE ] FLOC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:02:19.277888] [WARN ] [REMOTE ] FLOC: No data returned for month 2024-12 [2025-09-17T19:02:19.352619] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-01. [2025-09-17T19:02:19.730546] [INFO ] [REMOTE ] FLG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:02:19.786884] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-11. [2025-09-17T19:02:19.825297] [INFO ] [REMOTE ] FLNG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:02:19.846076] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-11. [2025-09-17T19:02:19.931087] [INFO ] [REMOTE ] FLO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:02:20.415749] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-11. [2025-09-17T19:02:20.468210] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T19:02:20.954418] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T19:02:21.215789] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2024-12. [2025-09-17T19:02:21.627326] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T19:02:22.015847] [INFO ] [REMOTE ] FLG: Fetching primary data for 2024-12. [2025-09-17T19:02:22.110358] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T19:02:22.349581] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T19:02:22.815808] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-01. [2025-09-17T19:02:23.386013] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T19:02:23.615834] [INFO ] [REMOTE ] FLO: Fetching primary data for 2024-12. [2025-09-17T19:02:24.280442] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T19:02:24.415841] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-02. [2025-09-17T19:02:24.926371] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T19:02:25.216092] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-01. [2025-09-17T19:02:25.692226] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T19:02:26.015788] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-01. [2025-09-17T19:02:26.574524] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T19:02:26.815785] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-03. [2025-09-17T19:02:27.615815] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-02. [2025-09-17T19:02:27.828502] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T19:02:27.890816] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T19:02:28.415768] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-02. [2025-09-17T19:02:29.044824] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T19:02:29.215813] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-02. [2025-09-17T19:02:29.901955] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T19:02:30.015812] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-04. [2025-09-17T19:02:30.778982] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T19:02:30.815735] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-03. [2025-09-17T19:02:31.271208] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T19:02:31.615833] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-05. [2025-09-17T19:02:32.327471] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T19:02:32.415828] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-03. [2025-09-17T19:02:33.005454] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T19:02:33.217957] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-06. [2025-09-17T19:02:33.589863] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T19:02:34.015834] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-03. [2025-09-17T19:02:34.466126] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T19:02:34.815812] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-04. [2025-09-17T19:02:35.615786] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-04. [2025-09-17T19:02:36.020144] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T19:02:36.415800] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-04. [2025-09-17T19:02:36.513037] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T19:02:37.098915] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T19:02:37.215786] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-05. [2025-09-17T19:02:38.015716] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-07. [2025-09-17T19:02:38.049757] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T19:02:38.212431] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T19:02:38.815781] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-06. [2025-09-17T19:02:38.938426] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T19:02:39.615831] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-05. [2025-09-17T19:02:39.915853] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T19:02:40.415812] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-07. [2025-09-17T19:02:41.215833] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-08. [2025-09-17T19:02:41.429506] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T19:02:41.993136] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T19:02:42.015723] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-08. [2025-09-17T19:02:42.238853] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T19:02:42.815825] [INFO ] [REMOTE ] FLOC: Fetching primary data for 2025-09. [2025-09-17T19:02:43.499449] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T19:02:43.615820] [INFO ] [REMOTE ] FLNG: Fetching primary data for 2025-09. [2025-09-17T19:02:43.836524] [INFO ] [REMOTE ] FLOC: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T19:02:43.840204] [INFO ] [REMOTE ] FLOC: Full fetch complete (36373 records). [2025-09-17T19:02:43.840291] [DEBUG] [VALIDATOR ] FLOC: Validating primary data. [2025-09-17T19:02:44.027604] [WARN ] [VALIDATOR ] FLOC: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-17T19:02:44.028118] [FATAL] [MAIN ] FLOC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:02:44.028192] [WARN ] [MAIN ] FLOC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:02:44.028268] [INFO ] [LOCAL ] FLOC: Starting deletion of primary data. [2025-09-17T19:02:44.028343] [DEBUG] [LOCAL ] FLOC: No primary data file found to delete. [2025-09-17T19:02:44.028381] [INFO ] [LOCAL ] FLOC: Starting deletion of derivative data. [2025-09-17T19:02:44.028426] [DEBUG] [LOCAL ] FLOC: No derivative data file found to delete. [2025-09-17T19:02:44.028495] [INFO ] [MAIN ] Update Progress: 841/2371 symbols completed. FLOC took 27.2s. Estimated remaining: 3h 43m 14s. Rate: 6.9 symbols/min [2025-09-17T19:02:44.205677] [INFO ] [MAIN ] FLR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:02:44.269053] [DEBUG] [LOCAL ] FLR: Loaded 53122 existing records from primary storage. [2025-09-17T19:02:44.269245] [INFO ] [MAIN ] FLR: Loaded 53122 existing records. [2025-09-17T19:02:44.427882] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-05. [2025-09-17T19:02:44.469107] [WARN ] [MAIN ] FLR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:02:44.469350] [INFO ] [MAIN ] FLR: Wiping existing primary data before full refresh. [2025-09-17T19:02:44.469398] [INFO ] [LOCAL ] FLR: Starting deletion of primary data. [2025-09-17T19:02:44.470567] [DEBUG] [LOCAL ] FLR: Deleted primary data file. [2025-09-17T19:02:44.470619] [INFO ] [MAIN ] FLR: Starting full primary refresh. [2025-09-17T19:02:44.853975] [INFO ] [REMOTE ] FLR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:02:45.215775] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-11. [2025-09-17T19:02:45.252316] [INFO ] [REMOTE ] FLNG: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T19:02:45.258045] [INFO ] [REMOTE ] FLNG: Full fetch complete (50861 records). [2025-09-17T19:02:45.258171] [DEBUG] [VALIDATOR ] FLNG: Validating primary data. [2025-09-17T19:02:45.662362] [DEBUG] [VALIDATOR ] FLNG: All expected trading days are present. [2025-09-17T19:02:45.662495] [DEBUG] [VALIDATOR ] FLNG: Primary data validation passed. [2025-09-17T19:02:45.663363] [INFO ] [MAIN ] FLNG: Fetched primary data is valid. [2025-09-17T19:02:45.663428] [DEBUG] [LOCAL ] FLNG: Saving primary data. [2025-09-17T19:02:45.665477] [DEBUG] [LOCAL ] FLNG: Trimmed 50861 records to 34240 (keeping 200 days of data) [2025-09-17T19:02:45.908407] [DEBUG] [LOCAL ] FLNG: Primary data saved (34240 records). [2025-09-17T19:02:45.908604] [INFO ] [MAIN ] FLNG: Full history saved. [2025-09-17T19:02:45.908861] [INFO ] [MAIN ] Update Progress: 842/2371 symbols completed. FLNG took 29.1s. Estimated remaining: 3h 42m 52s. Rate: 6.9 symbols/min [2025-09-17T19:02:46.029798] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-06. [2025-09-17T19:02:46.092354] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T19:02:46.123525] [INFO ] [MAIN ] FLS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:02:46.188671] [DEBUG] [LOCAL ] FLS: Loaded 50083 existing records from primary storage. [2025-09-17T19:02:46.188859] [INFO ] [MAIN ] FLS: Loaded 50083 existing records. [2025-09-17T19:02:46.385003] [WARN ] [MAIN ] FLS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:02:46.385304] [INFO ] [MAIN ] FLS: Wiping existing primary data before full refresh. [2025-09-17T19:02:46.385350] [INFO ] [LOCAL ] FLS: Starting deletion of primary data. [2025-09-17T19:02:46.386539] [DEBUG] [LOCAL ] FLS: Deleted primary data file. [2025-09-17T19:02:46.386593] [INFO ] [MAIN ] FLS: Starting full primary refresh. [2025-09-17T19:02:46.757349] [INFO ] [REMOTE ] FLS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:02:46.815745] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-11. [2025-09-17T19:02:47.059585] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T19:02:47.615865] [INFO ] [REMOTE ] FLR: Fetching primary data for 2024-12. [2025-09-17T19:02:47.826781] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T19:02:48.353175] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T19:02:48.415818] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-07. [2025-09-17T19:02:48.983942] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T19:02:49.215777] [INFO ] [REMOTE ] FLS: Fetching primary data for 2024-12. [2025-09-17T19:02:50.015841] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-01. [2025-09-17T19:02:50.245781] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T19:02:50.768504] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T19:02:50.815783] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-01. [2025-09-17T19:02:51.433892] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T19:02:51.615779] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-08. [2025-09-17T19:02:52.415832] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-02. [2025-09-17T19:02:52.710666] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T19:02:53.215820] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-06. [2025-09-17T19:02:54.015840] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-02. [2025-09-17T19:02:54.351364] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-17T19:02:54.427178] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T19:02:54.815796] [INFO ] [REMOTE ] FLO: Fetching primary data for 2025-09. [2025-09-17T19:02:55.078157] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T19:02:55.615967] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-07. [2025-09-17T19:02:56.415805] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-03. [2025-09-17T19:02:56.677431] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-17T19:02:56.727044] [INFO ] [REMOTE ] FLO: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T19:02:56.734087] [INFO ] [REMOTE ] FLO: Full fetch complete (74571 records). [2025-09-17T19:02:56.734231] [DEBUG] [VALIDATOR ] FLO: Validating primary data. [2025-09-17T19:02:57.132286] [DEBUG] [VALIDATOR ] FLO: All expected trading days are present. [2025-09-17T19:02:57.132364] [DEBUG] [VALIDATOR ] FLO: Primary data validation passed. [2025-09-17T19:02:57.133412] [INFO ] [MAIN ] FLO: Fetched primary data is valid. [2025-09-17T19:02:57.133458] [DEBUG] [LOCAL ] FLO: Saving primary data. [2025-09-17T19:02:57.134842] [DEBUG] [LOCAL ] FLO: Trimmed 74571 records to 51858 (keeping 200 days of data) [2025-09-17T19:02:57.229330] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-03. [2025-09-17T19:02:57.463953] [DEBUG] [LOCAL ] FLO: Primary data saved (51858 records). [2025-09-17T19:02:57.464087] [INFO ] [MAIN ] FLO: Full history saved. [2025-09-17T19:02:57.464170] [INFO ] [MAIN ] Update Progress: 843/2371 symbols completed. FLO took 40.6s. Estimated remaining: 3h 42m 49s. Rate: 6.9 symbols/min [2025-09-17T19:02:57.634537] [INFO ] [MAIN ] FLUT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:02:57.685558] [DEBUG] [LOCAL ] FLUT: Loaded 51062 existing records from primary storage. [2025-09-17T19:02:57.685770] [INFO ] [MAIN ] FLUT: Loaded 51062 existing records. [2025-09-17T19:02:57.880459] [WARN ] [MAIN ] FLUT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:02:57.881101] [INFO ] [MAIN ] FLUT: Wiping existing primary data before full refresh. [2025-09-17T19:02:57.881220] [INFO ] [LOCAL ] FLUT: Starting deletion of primary data. [2025-09-17T19:02:57.882614] [DEBUG] [LOCAL ] FLUT: Deleted primary data file. [2025-09-17T19:02:57.882713] [INFO ] [MAIN ] FLUT: Starting full primary refresh. [2025-09-17T19:02:58.049207] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-07 (2.43 seconds). [2025-09-17T19:02:58.109451] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-08. [2025-09-17T19:02:58.276813] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T19:02:58.379905] [INFO ] [REMOTE ] FLUT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:02:58.815786] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-11. [2025-09-17T19:02:58.935015] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T19:02:59.615771] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-04. [2025-09-17T19:02:59.773417] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T19:03:00.415837] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-04. [2025-09-17T19:03:00.539155] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T19:03:01.127339] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T19:03:01.215746] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2024-12. [2025-09-17T19:03:02.015912] [INFO ] [REMOTE ] FLG: Fetching primary data for 2025-09. [2025-09-17T19:03:02.645428] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T19:03:02.815777] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-05. [2025-09-17T19:03:03.190435] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T19:03:03.615771] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-01. [2025-09-17T19:03:04.415805] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-05. [2025-09-17T19:03:05.122341] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-17T19:03:05.215734] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-06. [2025-09-17T19:03:05.898134] [INFO ] [REMOTE ] FLG: Incremental fetch complete for 2025-09 (3.88 seconds). [2025-09-17T19:03:05.908055] [INFO ] [REMOTE ] FLG: Full fetch complete (77149 records). [2025-09-17T19:03:05.908341] [DEBUG] [VALIDATOR ] FLG: Validating primary data. [2025-09-17T19:03:06.319500] [DEBUG] [VALIDATOR ] FLG: All expected trading days are present. [2025-09-17T19:03:06.319727] [DEBUG] [VALIDATOR ] FLG: Primary data validation passed. [2025-09-17T19:03:06.320818] [INFO ] [MAIN ] FLG: Fetched primary data is valid. [2025-09-17T19:03:06.320932] [DEBUG] [LOCAL ] FLG: Saving primary data. [2025-09-17T19:03:06.323095] [DEBUG] [LOCAL ] FLG: Trimmed 77149 records to 53341 (keeping 200 days of data) [2025-09-17T19:03:06.481118] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-01 (2.87 seconds). [2025-09-17T19:03:06.494757] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-17T19:03:06.517871] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-02. [2025-09-17T19:03:06.750455] [DEBUG] [LOCAL ] FLG: Primary data saved (53341 records). [2025-09-17T19:03:06.750682] [INFO ] [MAIN ] FLG: Full history saved. [2025-09-17T19:03:06.750875] [INFO ] [MAIN ] Update Progress: 844/2371 symbols completed. FLG took 49.9s. Estimated remaining: 3h 42m 41s. Rate: 6.9 symbols/min [2025-09-17T19:03:06.820851] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-06. [2025-09-17T19:03:06.953891] [INFO ] [MAIN ] FLXR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:03:06.957159] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T19:03:06.985488] [DEBUG] [LOCAL ] FLXR: Loaded 19502 existing records from primary storage. [2025-09-17T19:03:06.985683] [INFO ] [MAIN ] FLXR: Loaded 19502 existing records. [2025-09-17T19:03:07.162753] [WARN ] [MAIN ] FLXR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:03:07.163018] [INFO ] [MAIN ] FLXR: Wiping existing primary data before full refresh. [2025-09-17T19:03:07.163093] [INFO ] [LOCAL ] FLXR: Starting deletion of primary data. [2025-09-17T19:03:07.163724] [DEBUG] [LOCAL ] FLXR: Deleted primary data file. [2025-09-17T19:03:07.163778] [INFO ] [MAIN ] FLXR: Starting full primary refresh. [2025-09-17T19:03:07.520370] [INFO ] [REMOTE ] FLXR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:03:07.615817] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-07. [2025-09-17T19:03:07.987927] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T19:03:08.415783] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-11. [2025-09-17T19:03:08.624666] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T19:03:08.821279] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-11 (0.41 seconds). [2025-09-17T19:03:09.065372] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T19:03:09.215767] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-08. [2025-09-17T19:03:10.015767] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2024-12. [2025-09-17T19:03:10.745493] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T19:03:10.815722] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-01. [2025-09-17T19:03:11.001217] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T19:03:11.408394] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T19:03:11.615740] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-02. [2025-09-17T19:03:12.321463] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T19:03:12.415761] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-07. [2025-09-17T19:03:13.215828] [INFO ] [REMOTE ] FLS: Fetching primary data for 2025-09. [2025-09-17T19:03:13.973555] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T19:03:14.015734] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-08. [2025-09-17T19:03:14.544160] [INFO ] [REMOTE ] FLS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T19:03:14.551009] [INFO ] [REMOTE ] FLS: Full fetch complete (70975 records). [2025-09-17T19:03:14.551159] [DEBUG] [VALIDATOR ] FLS: Validating primary data. [2025-09-17T19:03:14.821518] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-03. [2025-09-17T19:03:14.972417] [DEBUG] [VALIDATOR ] FLS: All expected trading days are present. [2025-09-17T19:03:14.972501] [DEBUG] [VALIDATOR ] FLS: Primary data validation passed. [2025-09-17T19:03:14.973395] [INFO ] [MAIN ] FLS: Fetched primary data is valid. [2025-09-17T19:03:14.973470] [DEBUG] [LOCAL ] FLS: Saving primary data. [2025-09-17T19:03:14.974999] [DEBUG] [LOCAL ] FLS: Trimmed 70975 records to 50150 (keeping 200 days of data) [2025-09-17T19:03:15.298921] [DEBUG] [LOCAL ] FLS: Primary data saved (50150 records). [2025-09-17T19:03:15.299081] [INFO ] [MAIN ] FLS: Full history saved. [2025-09-17T19:03:15.299200] [INFO ] [MAIN ] Update Progress: 845/2371 symbols completed. FLS took 29.4s. Estimated remaining: 3h 42m 32s. Rate: 6.9 symbols/min [2025-09-17T19:03:15.481331] [INFO ] [MAIN ] FMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:03:15.535793] [DEBUG] [LOCAL ] FMC: Loaded 51840 existing records from primary storage. [2025-09-17T19:03:15.536011] [INFO ] [MAIN ] FMC: Loaded 51840 existing records. [2025-09-17T19:03:15.620933] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-03. [2025-09-17T19:03:15.727513] [WARN ] [MAIN ] FMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:03:15.728049] [INFO ] [MAIN ] FMC: Wiping existing primary data before full refresh. [2025-09-17T19:03:15.728190] [INFO ] [LOCAL ] FMC: Starting deletion of primary data. [2025-09-17T19:03:15.729594] [DEBUG] [LOCAL ] FMC: Deleted primary data file. [2025-09-17T19:03:15.729735] [INFO ] [MAIN ] FMC: Starting full primary refresh. [2025-09-17T19:03:15.883608] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T19:03:16.136807] [INFO ] [REMOTE ] FMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:03:16.415777] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-11. [2025-09-17T19:03:17.051766] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T19:03:17.215704] [INFO ] [REMOTE ] FLR: Fetching primary data for 2025-09. [2025-09-17T19:03:17.393023] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-17T19:03:18.015794] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-04. [2025-09-17T19:03:18.815817] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-04. [2025-09-17T19:03:19.046551] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-11 (2.63 seconds). [2025-09-17T19:03:19.615785] [INFO ] [REMOTE ] FMC: Fetching primary data for 2024-12. [2025-09-17T19:03:19.782977] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T19:03:20.257268] [INFO ] [REMOTE ] FLR: Incremental fetch complete for 2025-09 (3.04 seconds). [2025-09-17T19:03:20.265605] [INFO ] [REMOTE ] FLR: Full fetch complete (76048 records). [2025-09-17T19:03:20.265790] [DEBUG] [VALIDATOR ] FLR: Validating primary data. [2025-09-17T19:03:20.448325] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-05. [2025-09-17T19:03:20.676257] [DEBUG] [VALIDATOR ] FLR: All expected trading days are present. [2025-09-17T19:03:20.676361] [DEBUG] [VALIDATOR ] FLR: Primary data validation passed. [2025-09-17T19:03:20.677247] [INFO ] [MAIN ] FLR: Fetched primary data is valid. [2025-09-17T19:03:20.677399] [DEBUG] [LOCAL ] FLR: Saving primary data. [2025-09-17T19:03:20.709248] [DEBUG] [LOCAL ] FLR: Trimmed 76048 records to 53121 (keeping 200 days of data) [2025-09-17T19:03:20.710665] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-04 (2.69 seconds). [2025-09-17T19:03:21.037771] [DEBUG] [LOCAL ] FLR: Primary data saved (53121 records). [2025-09-17T19:03:21.037921] [INFO ] [MAIN ] FLR: Full history saved. [2025-09-17T19:03:21.038979] [INFO ] [MAIN ] Update Progress: 846/2371 symbols completed. FLR took 37.0s. Estimated remaining: 3h 42m 18s. Rate: 6.9 symbols/min [2025-09-17T19:03:21.209568] [INFO ] [MAIN ] FMN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:03:21.215807] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-05. [2025-09-17T19:03:21.219266] [DEBUG] [LOCAL ] FMN: Loaded 6157 existing records from primary storage. [2025-09-17T19:03:21.220370] [INFO ] [MAIN ] FMN: Loaded 6157 existing records. [2025-09-17T19:03:21.405961] [WARN ] [MAIN ] FMN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:03:21.406374] [INFO ] [MAIN ] FMN: Wiping existing primary data before full refresh. [2025-09-17T19:03:21.406472] [INFO ] [LOCAL ] FMN: Starting deletion of primary data. [2025-09-17T19:03:21.406767] [DEBUG] [LOCAL ] FMN: Deleted primary data file. [2025-09-17T19:03:21.406815] [INFO ] [MAIN ] FMN: Starting full primary refresh. [2025-09-17T19:03:21.642312] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T19:03:21.817914] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T19:03:21.830245] [INFO ] [REMOTE ] FMN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:03:22.015830] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-11. [2025-09-17T19:03:22.582261] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T19:03:22.815745] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-06. [2025-09-17T19:03:23.171483] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T19:03:23.552960] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T19:03:23.615825] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-07. [2025-09-17T19:03:24.415753] [INFO ] [REMOTE ] FMN: Fetching primary data for 2024-12. [2025-09-17T19:03:24.655926] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T19:03:25.217437] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-06. [2025-09-17T19:03:25.219185] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T19:03:26.015784] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-01. [2025-09-17T19:03:26.815828] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-01. [2025-09-17T19:03:27.012275] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T19:03:27.615690] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-07. [2025-09-17T19:03:27.630264] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T19:03:27.724206] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T19:03:28.415766] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-02. [2025-09-17T19:03:28.981779] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T19:03:29.215826] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-08. [2025-09-17T19:03:29.310406] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T19:03:30.015790] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-03. [2025-09-17T19:03:30.661035] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T19:03:30.726859] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T19:03:30.815774] [INFO ] [REMOTE ] FLXR: Fetching primary data for 2025-09. [2025-09-17T19:03:31.615813] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-04. [2025-09-17T19:03:32.069901] [INFO ] [REMOTE ] FLXR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T19:03:32.073522] [INFO ] [REMOTE ] FLXR: Full fetch complete (24187 records). [2025-09-17T19:03:32.073607] [DEBUG] [VALIDATOR ] FLXR: Validating primary data. [2025-09-17T19:03:32.238676] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T19:03:32.418252] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-05. [2025-09-17T19:03:32.459055] [DEBUG] [VALIDATOR ] FLXR: All expected trading days are present. [2025-09-17T19:03:32.459140] [DEBUG] [VALIDATOR ] FLXR: Primary data validation passed. [2025-09-17T19:03:32.459605] [INFO ] [MAIN ] FLXR: Fetched primary data is valid. [2025-09-17T19:03:32.459662] [DEBUG] [LOCAL ] FLXR: Saving primary data. [2025-09-17T19:03:32.461062] [DEBUG] [LOCAL ] FLXR: Trimmed 24187 records to 19568 (keeping 200 days of data) [2025-09-17T19:03:32.588871] [DEBUG] [LOCAL ] FLXR: Primary data saved (19568 records). [2025-09-17T19:03:32.589019] [INFO ] [MAIN ] FLXR: Full history saved. [2025-09-17T19:03:32.589121] [INFO ] [MAIN ] Update Progress: 847/2371 symbols completed. FLXR took 25.8s. Estimated remaining: 3h 42m 14s. Rate: 6.9 symbols/min [2025-09-17T19:03:32.764730] [INFO ] [MAIN ] FMS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:03:32.798314] [DEBUG] [LOCAL ] FMS: Loaded 30564 existing records from primary storage. [2025-09-17T19:03:32.798493] [INFO ] [MAIN ] FMS: Loaded 30564 existing records. [2025-09-17T19:03:32.911307] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T19:03:32.984401] [WARN ] [MAIN ] FMS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:03:32.984666] [INFO ] [MAIN ] FMS: Wiping existing primary data before full refresh. [2025-09-17T19:03:32.984770] [INFO ] [LOCAL ] FMS: Starting deletion of primary data. [2025-09-17T19:03:32.985664] [DEBUG] [LOCAL ] FMS: Deleted primary data file. [2025-09-17T19:03:32.985749] [INFO ] [MAIN ] FMS: Starting full primary refresh. [2025-09-17T19:03:33.224172] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-02. [2025-09-17T19:03:33.344534] [INFO ] [REMOTE ] FMS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:03:34.015814] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-06. [2025-09-17T19:03:34.607989] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T19:03:34.815804] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-08. [2025-09-17T19:03:35.126206] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T19:03:35.615847] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-11. [2025-09-17T19:03:36.303827] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T19:03:36.415786] [INFO ] [REMOTE ] FLUT: Fetching primary data for 2025-09. [2025-09-17T19:03:36.466476] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T19:03:37.215887] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-07. [2025-09-17T19:03:37.936998] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T19:03:37.988358] [INFO ] [REMOTE ] FLUT: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T19:03:37.996743] [INFO ] [REMOTE ] FLUT: Full fetch complete (72583 records). [2025-09-17T19:03:37.996871] [DEBUG] [VALIDATOR ] FLUT: Validating primary data. [2025-09-17T19:03:38.020951] [INFO ] [REMOTE ] FMS: Fetching primary data for 2024-12. [2025-09-17T19:03:38.394498] [DEBUG] [VALIDATOR ] FLUT: All expected trading days are present. [2025-09-17T19:03:38.394627] [DEBUG] [VALIDATOR ] FLUT: Primary data validation passed. [2025-09-17T19:03:38.395524] [INFO ] [MAIN ] FLUT: Fetched primary data is valid. [2025-09-17T19:03:38.395568] [DEBUG] [LOCAL ] FLUT: Saving primary data. [2025-09-17T19:03:38.396987] [DEBUG] [LOCAL ] FLUT: Trimmed 72583 records to 51037 (keeping 200 days of data) [2025-09-17T19:03:38.706911] [DEBUG] [LOCAL ] FLUT: Primary data saved (51037 records). [2025-09-17T19:03:38.707049] [INFO ] [MAIN ] FLUT: Full history saved. [2025-09-17T19:03:38.707168] [INFO ] [MAIN ] Update Progress: 848/2371 symbols completed. FLUT took 41.2s. Estimated remaining: 3h 42m 1s. Rate: 6.9 symbols/min [2025-09-17T19:03:38.820851] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-03. [2025-09-17T19:03:38.880419] [INFO ] [MAIN ] FMX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:03:38.918711] [DEBUG] [LOCAL ] FMX: Loaded 40671 existing records from primary storage. [2025-09-17T19:03:38.918926] [INFO ] [MAIN ] FMX: Loaded 40671 existing records. [2025-09-17T19:03:39.103527] [WARN ] [MAIN ] FMX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:03:39.103840] [INFO ] [MAIN ] FMX: Wiping existing primary data before full refresh. [2025-09-17T19:03:39.103886] [INFO ] [LOCAL ] FMX: Starting deletion of primary data. [2025-09-17T19:03:39.104775] [DEBUG] [LOCAL ] FMX: Deleted primary data file. [2025-09-17T19:03:39.104825] [INFO ] [MAIN ] FMX: Starting full primary refresh. [2025-09-17T19:03:39.462308] [INFO ] [REMOTE ] FMX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:03:39.480314] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T19:03:39.615797] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-11. [2025-09-17T19:03:40.415551] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T19:03:40.425622] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-08. [2025-09-17T19:03:40.920432] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T19:03:41.215773] [INFO ] [REMOTE ] FMN: Fetching primary data for 2025-09. [2025-09-17T19:03:41.395115] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T19:03:41.928278] [INFO ] [REMOTE ] FMN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T19:03:41.929796] [INFO ] [REMOTE ] FMN: Full fetch complete (10298 records). [2025-09-17T19:03:41.929903] [DEBUG] [VALIDATOR ] FMN: Validating primary data. [2025-09-17T19:03:42.020855] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-01. [2025-09-17T19:03:42.296250] [DEBUG] [VALIDATOR ] FMN: All expected trading days are present. [2025-09-17T19:03:42.296330] [DEBUG] [VALIDATOR ] FMN: Primary data validation passed. [2025-09-17T19:03:42.296575] [INFO ] [MAIN ] FMN: Fetched primary data is valid. [2025-09-17T19:03:42.296613] [DEBUG] [LOCAL ] FMN: Saving primary data. [2025-09-17T19:03:42.297098] [DEBUG] [LOCAL ] FMN: Trimmed 10298 records to 6213 (keeping 200 days of data) [2025-09-17T19:03:42.335440] [DEBUG] [LOCAL ] FMN: Primary data saved (6213 records). [2025-09-17T19:03:42.335537] [INFO ] [MAIN ] FMN: Full history saved. [2025-09-17T19:03:42.335614] [INFO ] [MAIN ] Update Progress: 849/2371 symbols completed. FMN took 21.3s. Estimated remaining: 3h 41m 43s. Rate: 6.9 symbols/min [2025-09-17T19:03:42.503740] [INFO ] [MAIN ] FMY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:03:42.506967] [DEBUG] [LOCAL ] FMY: Loaded 1347 existing records from primary storage. [2025-09-17T19:03:42.507050] [INFO ] [MAIN ] FMY: Loaded 1347 existing records. [2025-09-17T19:03:42.687709] [WARN ] [MAIN ] FMY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:03:42.687982] [INFO ] [MAIN ] FMY: Wiping existing primary data before full refresh. [2025-09-17T19:03:42.688027] [INFO ] [LOCAL ] FMY: Starting deletion of primary data. [2025-09-17T19:03:42.688348] [DEBUG] [LOCAL ] FMY: Deleted primary data file. [2025-09-17T19:03:42.688410] [INFO ] [MAIN ] FMY: Starting full primary refresh. [2025-09-17T19:03:42.829087] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-04. [2025-09-17T19:03:43.054012] [INFO ] [REMOTE ] FMY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:03:43.070057] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T19:03:43.615833] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-11. [2025-09-17T19:03:43.961068] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T19:03:44.415741] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-02. [2025-09-17T19:03:44.710570] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T19:03:45.215830] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-05. [2025-09-17T19:03:45.536730] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T19:03:46.015801] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-03. [2025-09-17T19:03:46.815836] [INFO ] [REMOTE ] FMY: Fetching primary data for 2024-12. [2025-09-17T19:03:47.053658] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T19:03:47.128611] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-17T19:03:47.131087] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T19:03:47.615831] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-01. [2025-09-17T19:03:48.053492] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T19:03:48.415830] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-02. [2025-09-17T19:03:48.744437] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T19:03:49.215816] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-03. [2025-09-17T19:03:49.645595] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-17T19:03:50.015816] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-06. [2025-09-17T19:03:50.815782] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-04. [2025-09-17T19:03:51.270097] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T19:03:51.615771] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-05. [2025-09-17T19:03:51.685670] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T19:03:51.933560] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-05 (0.32 seconds). [2025-09-17T19:03:52.415819] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-07. [2025-09-17T19:03:53.215793] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-06. [2025-09-17T19:03:53.566456] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T19:03:54.015815] [INFO ] [REMOTE ] FMX: Fetching primary data for 2024-12. [2025-09-17T19:03:54.082482] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T19:03:54.815832] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-07. [2025-09-17T19:03:55.232975] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T19:03:55.254605] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T19:03:55.615866] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-04. [2025-09-17T19:03:56.415831] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-08. [2025-09-17T19:03:56.745750] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T19:03:57.215793] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-01. [2025-09-17T19:03:58.015796] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-08. [2025-09-17T19:03:58.142791] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T19:03:58.306932] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T19:03:58.767255] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T19:03:58.815786] [INFO ] [REMOTE ] FMY: Fetching primary data for 2025-09. [2025-09-17T19:03:59.188500] [INFO ] [REMOTE ] FMY: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T19:03:59.189381] [INFO ] [REMOTE ] FMY: Full fetch complete (1911 records). [2025-09-17T19:03:59.189455] [DEBUG] [VALIDATOR ] FMY: Validating primary data. [2025-09-17T19:03:59.569153] [DEBUG] [VALIDATOR ] FMY: All expected trading days are present. [2025-09-17T19:03:59.569242] [DEBUG] [VALIDATOR ] FMY: Primary data validation passed. [2025-09-17T19:03:59.569336] [INFO ] [MAIN ] FMY: Fetched primary data is valid. [2025-09-17T19:03:59.569375] [DEBUG] [LOCAL ] FMY: Saving primary data. [2025-09-17T19:03:59.569814] [DEBUG] [LOCAL ] FMY: Trimmed 1911 records to 1348 (keeping 200 days of data) [2025-09-17T19:03:59.578922] [DEBUG] [LOCAL ] FMY: Primary data saved (1348 records). [2025-09-17T19:03:59.579055] [INFO ] [MAIN ] FMY: Full history saved. [2025-09-17T19:03:59.579143] [INFO ] [MAIN ] Update Progress: 850/2371 symbols completed. FMY took 17.2s. Estimated remaining: 3h 41m 49s. Rate: 6.9 symbols/min [2025-09-17T19:03:59.620897] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-02. [2025-09-17T19:03:59.756018] [INFO ] [MAIN ] FN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:03:59.795116] [DEBUG] [LOCAL ] FN: Loaded 39796 existing records from primary storage. [2025-09-17T19:03:59.795254] [INFO ] [MAIN ] FN: Loaded 39796 existing records. [2025-09-17T19:04:00.018432] [WARN ] [MAIN ] FN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:04:00.018700] [INFO ] [MAIN ] FN: Wiping existing primary data before full refresh. [2025-09-17T19:04:00.018749] [INFO ] [LOCAL ] FN: Starting deletion of primary data. [2025-09-17T19:04:00.019600] [DEBUG] [LOCAL ] FN: Deleted primary data file. [2025-09-17T19:04:00.019687] [INFO ] [MAIN ] FN: Starting full primary refresh. [2025-09-17T19:04:00.384324] [INFO ] [REMOTE ] FN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:04:00.415730] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-11. [2025-09-17T19:04:00.981569] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T19:04:01.215777] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-03. [2025-09-17T19:04:02.015786] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-05. [2025-09-17T19:04:02.098041] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T19:04:02.521957] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T19:04:02.815817] [INFO ] [REMOTE ] FMC: Fetching primary data for 2025-09. [2025-09-17T19:04:03.197577] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T19:04:03.615779] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-04. [2025-09-17T19:04:04.415780] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-06. [2025-09-17T19:04:04.620772] [INFO ] [REMOTE ] FMC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T19:04:04.627712] [INFO ] [REMOTE ] FMC: Full fetch complete (74635 records). [2025-09-17T19:04:04.627860] [DEBUG] [VALIDATOR ] FMC: Validating primary data. [2025-09-17T19:04:05.028155] [DEBUG] [VALIDATOR ] FMC: All expected trading days are present. [2025-09-17T19:04:05.028238] [DEBUG] [VALIDATOR ] FMC: Primary data validation passed. [2025-09-17T19:04:05.029202] [INFO ] [MAIN ] FMC: Fetched primary data is valid. [2025-09-17T19:04:05.029254] [DEBUG] [LOCAL ] FMC: Saving primary data. [2025-09-17T19:04:05.031182] [DEBUG] [LOCAL ] FMC: Trimmed 74635 records to 51832 (keeping 200 days of data) [2025-09-17T19:04:05.219045] [INFO ] [REMOTE ] FN: Fetching primary data for 2024-12. [2025-09-17T19:04:05.307310] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T19:04:05.387470] [DEBUG] [LOCAL ] FMC: Primary data saved (51832 records). [2025-09-17T19:04:05.387619] [INFO ] [MAIN ] FMC: Full history saved. [2025-09-17T19:04:05.387742] [INFO ] [MAIN ] Update Progress: 851/2371 symbols completed. FMC took 50.1s. Estimated remaining: 3h 41m 35s. Rate: 6.9 symbols/min [2025-09-17T19:04:05.570859] [INFO ] [MAIN ] FNB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:04:05.626860] [DEBUG] [LOCAL ] FNB: Loaded 52451 existing records from primary storage. [2025-09-17T19:04:05.627011] [INFO ] [MAIN ] FNB: Loaded 52451 existing records. [2025-09-17T19:04:05.807381] [WARN ] [MAIN ] FNB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:04:05.807686] [INFO ] [MAIN ] FNB: Wiping existing primary data before full refresh. [2025-09-17T19:04:05.807823] [INFO ] [LOCAL ] FNB: Starting deletion of primary data. [2025-09-17T19:04:05.814113] [DEBUG] [LOCAL ] FNB: Deleted primary data file. [2025-09-17T19:04:05.823516] [INFO ] [MAIN ] FNB: Starting full primary refresh. [2025-09-17T19:04:05.889696] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T19:04:06.022728] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-05. [2025-09-17T19:04:06.203839] [INFO ] [REMOTE ] FNB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:04:06.419197] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T19:04:06.815773] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-01. [2025-09-17T19:04:07.538673] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T19:04:07.615724] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-06. [2025-09-17T19:04:08.392881] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T19:04:08.415731] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-07. [2025-09-17T19:04:08.999208] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T19:04:09.215768] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-07. [2025-09-17T19:04:09.276392] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T19:04:10.015768] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-02. [2025-09-17T19:04:10.662419] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T19:04:10.815759] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-08. [2025-09-17T19:04:11.615758] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-11. [2025-09-17T19:04:11.646173] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T19:04:12.390736] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T19:04:12.415691] [INFO ] [REMOTE ] FMX: Fetching primary data for 2025-09. [2025-09-17T19:04:13.215822] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-08. [2025-09-17T19:04:13.464230] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T19:04:13.782120] [INFO ] [REMOTE ] FMX: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T19:04:13.788185] [INFO ] [REMOTE ] FMX: Full fetch complete (57561 records). [2025-09-17T19:04:13.788327] [DEBUG] [VALIDATOR ] FMX: Validating primary data. [2025-09-17T19:04:14.020948] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-03. [2025-09-17T19:04:14.180950] [DEBUG] [VALIDATOR ] FMX: All expected trading days are present. [2025-09-17T19:04:14.181028] [DEBUG] [VALIDATOR ] FMX: Primary data validation passed. [2025-09-17T19:04:14.181835] [INFO ] [MAIN ] FMX: Fetched primary data is valid. [2025-09-17T19:04:14.181882] [DEBUG] [LOCAL ] FMX: Saving primary data. [2025-09-17T19:04:14.183260] [DEBUG] [LOCAL ] FMX: Trimmed 57561 records to 40729 (keeping 200 days of data) [2025-09-17T19:04:14.440913] [DEBUG] [LOCAL ] FMX: Primary data saved (40729 records). [2025-09-17T19:04:14.441039] [INFO ] [MAIN ] FMX: Full history saved. [2025-09-17T19:04:14.441141] [INFO ] [MAIN ] Update Progress: 852/2371 symbols completed. FMX took 35.7s. Estimated remaining: 3h 41m 27s. Rate: 6.9 symbols/min [2025-09-17T19:04:14.609725] [INFO ] [MAIN ] FND: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:04:14.627080] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T19:04:14.677910] [DEBUG] [LOCAL ] FND: Loaded 52178 existing records from primary storage. [2025-09-17T19:04:14.678046] [INFO ] [MAIN ] FND: Loaded 52178 existing records. [2025-09-17T19:04:14.820843] [INFO ] [REMOTE ] FNB: Fetching primary data for 2024-12. [2025-09-17T19:04:14.856610] [WARN ] [MAIN ] FND: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:04:14.856834] [INFO ] [MAIN ] FND: Wiping existing primary data before full refresh. [2025-09-17T19:04:14.856878] [INFO ] [LOCAL ] FND: Starting deletion of primary data. [2025-09-17T19:04:14.857745] [DEBUG] [LOCAL ] FND: Deleted primary data file. [2025-09-17T19:04:14.857803] [INFO ] [MAIN ] FND: Starting full primary refresh. [2025-09-17T19:04:15.216565] [INFO ] [REMOTE ] FND: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:04:15.615791] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-11. [2025-09-17T19:04:15.882392] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T19:04:16.178609] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T19:04:16.415838] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-01. [2025-09-17T19:04:17.215826] [INFO ] [REMOTE ] FMS: Fetching primary data for 2025-09. [2025-09-17T19:04:17.340322] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T19:04:17.753683] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T19:04:18.015819] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-02. [2025-09-17T19:04:18.560770] [INFO ] [REMOTE ] FMS: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T19:04:18.565219] [INFO ] [REMOTE ] FMS: Full fetch complete (42396 records). [2025-09-17T19:04:18.565336] [DEBUG] [VALIDATOR ] FMS: Validating primary data. [2025-09-17T19:04:18.821242] [INFO ] [REMOTE ] FND: Fetching primary data for 2024-12. [2025-09-17T19:04:18.948392] [DEBUG] [VALIDATOR ] FMS: All expected trading days are present. [2025-09-17T19:04:18.948481] [DEBUG] [VALIDATOR ] FMS: Primary data validation passed. [2025-09-17T19:04:18.949142] [INFO ] [MAIN ] FMS: Fetched primary data is valid. [2025-09-17T19:04:18.949190] [DEBUG] [LOCAL ] FMS: Saving primary data. [2025-09-17T19:04:18.950216] [DEBUG] [LOCAL ] FMS: Trimmed 42396 records to 30559 (keeping 200 days of data) [2025-09-17T19:04:19.135391] [DEBUG] [LOCAL ] FMS: Primary data saved (30559 records). [2025-09-17T19:04:19.135535] [INFO ] [MAIN ] FMS: Full history saved. [2025-09-17T19:04:19.135623] [INFO ] [MAIN ] Update Progress: 853/2371 symbols completed. FMS took 46.5s. Estimated remaining: 3h 41m 11s. Rate: 6.9 symbols/min [2025-09-17T19:04:19.306815] [INFO ] [MAIN ] FNF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:04:19.352732] [DEBUG] [LOCAL ] FNF: Loaded 49340 existing records from primary storage. [2025-09-17T19:04:19.352897] [INFO ] [MAIN ] FNF: Loaded 49340 existing records. [2025-09-17T19:04:19.540270] [WARN ] [MAIN ] FNF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:04:19.540577] [INFO ] [MAIN ] FNF: Wiping existing primary data before full refresh. [2025-09-17T19:04:19.540730] [INFO ] [LOCAL ] FNF: Starting deletion of primary data. [2025-09-17T19:04:19.541755] [DEBUG] [LOCAL ] FNF: Deleted primary data file. [2025-09-17T19:04:19.541846] [INFO ] [MAIN ] FNF: Starting full primary refresh. [2025-09-17T19:04:19.616619] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-04. [2025-09-17T19:04:19.693571] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T19:04:19.967947] [INFO ] [REMOTE ] FNF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:04:20.415810] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-03. [2025-09-17T19:04:20.584855] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T19:04:21.215832] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-01. [2025-09-17T19:04:21.377843] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T19:04:21.803787] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T19:04:22.015809] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-04. [2025-09-17T19:04:22.659456] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T19:04:22.815741] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-02. [2025-09-17T19:04:23.615836] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-05. [2025-09-17T19:04:23.823934] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T19:04:24.415774] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-05. [2025-09-17T19:04:24.630661] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T19:04:24.852781] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T19:04:25.215827] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-06. [2025-09-17T19:04:26.015887] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-03. [2025-09-17T19:04:26.224356] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T19:04:26.669286] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T19:04:26.815805] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-06. [2025-09-17T19:04:27.333273] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T19:04:27.615821] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-11. [2025-09-17T19:04:28.125679] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T19:04:28.415782] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-04. [2025-09-17T19:04:29.215826] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-07. [2025-09-17T19:04:29.457124] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T19:04:30.015813] [INFO ] [REMOTE ] FNF: Fetching primary data for 2024-12. [2025-09-17T19:04:30.229378] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T19:04:30.323818] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T19:04:30.815782] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-08. [2025-09-17T19:04:31.603150] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T19:04:31.615677] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-05. [2025-09-17T19:04:32.415796] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-01. [2025-09-17T19:04:32.663454] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T19:04:33.215826] [INFO ] [REMOTE ] FN: Fetching primary data for 2025-09. [2025-09-17T19:04:33.526302] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T19:04:33.919893] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T19:04:34.015759] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-02. [2025-09-17T19:04:34.471425] [INFO ] [REMOTE ] FN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T19:04:34.478100] [INFO ] [REMOTE ] FN: Full fetch complete (56482 records). [2025-09-17T19:04:34.478338] [DEBUG] [VALIDATOR ] FN: Validating primary data. [2025-09-17T19:04:34.826739] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-06. [2025-09-17T19:04:34.880706] [DEBUG] [VALIDATOR ] FN: All expected trading days are present. [2025-09-17T19:04:34.881498] [DEBUG] [VALIDATOR ] FN: Primary data validation passed. [2025-09-17T19:04:34.882540] [INFO ] [MAIN ] FN: Fetched primary data is valid. [2025-09-17T19:04:34.882955] [DEBUG] [LOCAL ] FN: Saving primary data. [2025-09-17T19:04:34.884369] [DEBUG] [LOCAL ] FN: Trimmed 56482 records to 39736 (keeping 200 days of data) [2025-09-17T19:04:35.139993] [DEBUG] [LOCAL ] FN: Primary data saved (39736 records). [2025-09-17T19:04:35.140157] [INFO ] [MAIN ] FN: Full history saved. [2025-09-17T19:04:35.141034] [INFO ] [MAIN ] Update Progress: 854/2371 symbols completed. FN took 35.6s. Estimated remaining: 3h 41m 15s. Rate: 6.9 symbols/min [2025-09-17T19:04:35.315367] [INFO ] [MAIN ] FNV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:04:35.365166] [DEBUG] [LOCAL ] FNV: Loaded 46551 existing records from primary storage. [2025-09-17T19:04:35.365316] [INFO ] [MAIN ] FNV: Loaded 46551 existing records. [2025-09-17T19:04:35.544729] [WARN ] [MAIN ] FNV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:04:35.545075] [INFO ] [MAIN ] FNV: Wiping existing primary data before full refresh. [2025-09-17T19:04:35.545234] [INFO ] [LOCAL ] FNV: Starting deletion of primary data. [2025-09-17T19:04:35.546456] [DEBUG] [LOCAL ] FNV: Deleted primary data file. [2025-09-17T19:04:35.546576] [INFO ] [MAIN ] FNV: Starting full primary refresh. [2025-09-17T19:04:35.615931] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-07. [2025-09-17T19:04:35.761098] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T19:04:35.957771] [INFO ] [REMOTE ] FNV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:04:36.198130] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T19:04:36.415818] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-07. [2025-09-17T19:04:37.215833] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-11. [2025-09-17T19:04:37.605102] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T19:04:37.772273] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T19:04:38.015899] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-03. [2025-09-17T19:04:38.815760] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-08. [2025-09-17T19:04:38.918122] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T19:04:39.514818] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T19:04:39.615783] [INFO ] [REMOTE ] FNV: Fetching primary data for 2024-12. [2025-09-17T19:04:40.421081] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-04. [2025-09-17T19:04:40.426436] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T19:04:41.210225] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T19:04:41.218403] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-08. [2025-09-17T19:04:41.970420] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T19:04:42.015728] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-05. [2025-09-17T19:04:42.815801] [INFO ] [REMOTE ] FND: Fetching primary data for 2025-09. [2025-09-17T19:04:43.074762] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T19:04:43.615766] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-01. [2025-09-17T19:04:43.648199] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T19:04:44.124993] [INFO ] [REMOTE ] FND: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T19:04:44.132068] [INFO ] [REMOTE ] FND: Full fetch complete (74129 records). [2025-09-17T19:04:44.132274] [DEBUG] [VALIDATOR ] FND: Validating primary data. [2025-09-17T19:04:44.422706] [INFO ] [REMOTE ] FNB: Fetching primary data for 2025-09. [2025-09-17T19:04:44.533173] [DEBUG] [VALIDATOR ] FND: All expected trading days are present. [2025-09-17T19:04:44.533275] [DEBUG] [VALIDATOR ] FND: Primary data validation passed. [2025-09-17T19:04:44.538123] [INFO ] [MAIN ] FND: Fetched primary data is valid. [2025-09-17T19:04:44.538260] [DEBUG] [LOCAL ] FND: Saving primary data. [2025-09-17T19:04:44.540072] [DEBUG] [LOCAL ] FND: Trimmed 74129 records to 52174 (keeping 200 days of data) [2025-09-17T19:04:44.855458] [DEBUG] [LOCAL ] FND: Primary data saved (52174 records). [2025-09-17T19:04:44.855612] [INFO ] [MAIN ] FND: Full history saved. [2025-09-17T19:04:44.855750] [INFO ] [MAIN ] Update Progress: 855/2371 symbols completed. FND took 30.4s. Estimated remaining: 3h 41m 8s. Rate: 6.9 symbols/min [2025-09-17T19:04:45.024243] [INFO ] [MAIN ] FOA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:04:45.038340] [DEBUG] [LOCAL ] FOA: Loaded 13204 existing records from primary storage. [2025-09-17T19:04:45.038454] [INFO ] [MAIN ] FOA: Loaded 13204 existing records. [2025-09-17T19:04:45.216311] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-06. [2025-09-17T19:04:45.216173] [WARN ] [MAIN ] FOA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:04:45.217952] [INFO ] [MAIN ] FOA: Wiping existing primary data before full refresh. [2025-09-17T19:04:45.218015] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-17T19:04:45.218720] [DEBUG] [LOCAL ] FOA: Deleted primary data file. [2025-09-17T19:04:45.218784] [INFO ] [MAIN ] FOA: Starting full primary refresh. [2025-09-17T19:04:45.478216] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T19:04:45.611604] [INFO ] [REMOTE ] FOA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:04:45.925702] [INFO ] [REMOTE ] FNB: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T19:04:45.932811] [INFO ] [REMOTE ] FNB: Full fetch complete (75363 records). [2025-09-17T19:04:45.932979] [DEBUG] [VALIDATOR ] FNB: Validating primary data. [2025-09-17T19:04:46.024283] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-11. [2025-09-17T19:04:46.340883] [DEBUG] [VALIDATOR ] FNB: All expected trading days are present. [2025-09-17T19:04:46.341060] [DEBUG] [VALIDATOR ] FNB: Primary data validation passed. [2025-09-17T19:04:46.342183] [INFO ] [MAIN ] FNB: Fetched primary data is valid. [2025-09-17T19:04:46.342257] [DEBUG] [LOCAL ] FNB: Saving primary data. [2025-09-17T19:04:46.343924] [DEBUG] [LOCAL ] FNB: Trimmed 75363 records to 52454 (keeping 200 days of data) [2025-09-17T19:04:46.675711] [DEBUG] [LOCAL ] FNB: Primary data saved (52454 records). [2025-09-17T19:04:46.675868] [INFO ] [MAIN ] FNB: Full history saved. [2025-09-17T19:04:46.675976] [INFO ] [MAIN ] Update Progress: 856/2371 symbols completed. FNB took 41.3s. Estimated remaining: 3h 40m 47s. Rate: 6.9 symbols/min [2025-09-17T19:04:46.824078] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-02. [2025-09-17T19:04:46.848107] [INFO ] [MAIN ] FOF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:04:46.858759] [DEBUG] [LOCAL ] FOF: Loaded 8073 existing records from primary storage. [2025-09-17T19:04:46.858918] [INFO ] [MAIN ] FOF: Loaded 8073 existing records. [2025-09-17T19:04:47.046367] [WARN ] [MAIN ] FOF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:04:47.046994] [INFO ] [MAIN ] FOF: Wiping existing primary data before full refresh. [2025-09-17T19:04:47.047150] [INFO ] [LOCAL ] FOF: Starting deletion of primary data. [2025-09-17T19:04:47.047699] [DEBUG] [LOCAL ] FOF: Deleted primary data file. [2025-09-17T19:04:47.047792] [INFO ] [MAIN ] FOF: Starting full primary refresh. [2025-09-17T19:04:47.081592] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T19:04:47.374301] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-17T19:04:47.472870] [INFO ] [REMOTE ] FOF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:04:47.615760] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-11. [2025-09-17T19:04:48.158070] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T19:04:48.415764] [INFO ] [REMOTE ] FOF: Fetching primary data for 2024-12. [2025-09-17T19:04:48.491614] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T19:04:49.146432] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T19:04:49.215745] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-07. [2025-09-17T19:04:50.015861] [INFO ] [REMOTE ] FOA: Fetching primary data for 2024-12. [2025-09-17T19:04:50.815750] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-03. [2025-09-17T19:04:50.880203] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T19:04:50.940050] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T19:04:51.615781] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-08. [2025-09-17T19:04:52.415838] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-01. [2025-09-17T19:04:52.504284] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T19:04:53.141685] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T19:04:53.215778] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-02. [2025-09-17T19:04:53.305842] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T19:04:53.781740] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T19:04:54.015815] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-03. [2025-09-17T19:04:54.545918] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T19:04:54.815851] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-04. [2025-09-17T19:04:55.615820] [INFO ] [REMOTE ] FNF: Fetching primary data for 2025-09. [2025-09-17T19:04:55.750019] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T19:04:56.415792] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-01. [2025-09-17T19:04:57.223877] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-05. [2025-09-17T19:04:57.228320] [INFO ] [REMOTE ] FNF: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T19:04:57.235720] [INFO ] [REMOTE ] FNF: Full fetch complete (69244 records). [2025-09-17T19:04:57.235867] [DEBUG] [VALIDATOR ] FNF: Validating primary data. [2025-09-17T19:04:57.637817] [DEBUG] [VALIDATOR ] FNF: All expected trading days are present. [2025-09-17T19:04:57.637921] [DEBUG] [VALIDATOR ] FNF: Primary data validation passed. [2025-09-17T19:04:57.638863] [INFO ] [MAIN ] FNF: Fetched primary data is valid. [2025-09-17T19:04:57.638954] [DEBUG] [LOCAL ] FNF: Saving primary data. [2025-09-17T19:04:57.645527] [DEBUG] [LOCAL ] FNF: Trimmed 69244 records to 49332 (keeping 200 days of data) [2025-09-17T19:04:57.654201] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T19:04:57.975924] [DEBUG] [LOCAL ] FNF: Primary data saved (49332 records). [2025-09-17T19:04:57.976139] [INFO ] [MAIN ] FNF: Full history saved. [2025-09-17T19:04:57.976237] [INFO ] [MAIN ] Update Progress: 857/2371 symbols completed. FNF took 38.8s. Estimated remaining: 3h 40m 43s. Rate: 6.9 symbols/min [2025-09-17T19:04:58.020823] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-02. [2025-09-17T19:04:58.098470] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T19:04:58.162040] [INFO ] [MAIN ] FOR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:04:58.182713] [DEBUG] [LOCAL ] FOR: Loaded 20318 existing records from primary storage. [2025-09-17T19:04:58.182885] [INFO ] [MAIN ] FOR: Loaded 20318 existing records. [2025-09-17T19:04:58.359244] [WARN ] [MAIN ] FOR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:04:58.359536] [INFO ] [MAIN ] FOR: Wiping existing primary data before full refresh. [2025-09-17T19:04:58.359582] [INFO ] [LOCAL ] FOR: Starting deletion of primary data. [2025-09-17T19:04:58.360132] [DEBUG] [LOCAL ] FOR: Deleted primary data file. [2025-09-17T19:04:58.360181] [INFO ] [MAIN ] FOR: Starting full primary refresh. [2025-09-17T19:04:58.717345] [INFO ] [REMOTE ] FOR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:04:58.815781] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-04. [2025-09-17T19:04:58.860800] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T19:04:59.615840] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-03. [2025-09-17T19:05:00.356813] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T19:05:00.415787] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-05. [2025-09-17T19:05:00.711811] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T19:05:01.215817] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-04. [2025-09-17T19:05:02.000673] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T19:05:02.015729] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-06. [2025-09-17T19:05:02.201010] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T19:05:02.815792] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-05. [2025-09-17T19:05:03.448355] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T19:05:03.505010] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T19:05:03.615769] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-06. [2025-09-17T19:05:04.415787] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-11. [2025-09-17T19:05:04.469561] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T19:05:05.194387] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T19:05:05.215732] [INFO ] [REMOTE ] FOR: Fetching primary data for 2024-12. [2025-09-17T19:05:06.015796] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-06. [2025-09-17T19:05:06.220707] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T19:05:06.685868] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T19:05:06.815785] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-07. [2025-09-17T19:05:06.922910] [DEBUG] [REMOTE ] FOA: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-17T19:05:06.923271] [WARN ] [REMOTE ] FOA: No data returned for month 2025-07 [2025-09-17T19:05:07.615776] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-08. [2025-09-17T19:05:08.415762] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-07. [2025-09-17T19:05:08.634327] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T19:05:08.972571] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T19:05:09.215763] [INFO ] [REMOTE ] FOA: Fetching primary data for 2025-09. [2025-09-17T19:05:10.015831] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-07. [2025-09-17T19:05:10.164434] [INFO ] [REMOTE ] FOA: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T19:05:10.167188] [INFO ] [REMOTE ] FOA: Full fetch complete (20732 records). [2025-09-17T19:05:10.167275] [DEBUG] [VALIDATOR ] FOA: Validating primary data. [2025-09-17T19:05:10.357062] [WARN ] [VALIDATOR ] FOA: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-17T19:05:10.357434] [FATAL] [MAIN ] FOA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:05:10.357486] [WARN ] [MAIN ] FOA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:05:10.357526] [INFO ] [LOCAL ] FOA: Starting deletion of primary data. [2025-09-17T19:05:10.357590] [DEBUG] [LOCAL ] FOA: No primary data file found to delete. [2025-09-17T19:05:10.357628] [INFO ] [LOCAL ] FOA: Starting deletion of derivative data. [2025-09-17T19:05:10.357990] [DEBUG] [LOCAL ] FOA: Deleted derivative data file. [2025-09-17T19:05:10.358075] [INFO ] [MAIN ] Update Progress: 858/2371 symbols completed. FOA took 25.5s. Estimated remaining: 3h 40m 40s. Rate: 6.9 symbols/min [2025-09-17T19:05:10.537523] [INFO ] [MAIN ] FOUR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:05:10.583762] [DEBUG] [LOCAL ] FOUR: Loaded 49544 existing records from primary storage. [2025-09-17T19:05:10.583929] [INFO ] [MAIN ] FOUR: Loaded 49544 existing records. [2025-09-17T19:05:10.758836] [WARN ] [MAIN ] FOUR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:05:10.759091] [INFO ] [MAIN ] FOUR: Wiping existing primary data before full refresh. [2025-09-17T19:05:10.759135] [INFO ] [LOCAL ] FOUR: Starting deletion of primary data. [2025-09-17T19:05:10.760275] [DEBUG] [LOCAL ] FOUR: Deleted primary data file. [2025-09-17T19:05:10.760326] [INFO ] [MAIN ] FOUR: Starting full primary refresh. [2025-09-17T19:05:10.822769] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-01. [2025-09-17T19:05:11.115315] [INFO ] [REMOTE ] FOUR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:05:11.590599] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T19:05:11.615728] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-08. [2025-09-17T19:05:12.058044] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T19:05:12.415808] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-08. [2025-09-17T19:05:13.019669] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T19:05:13.046023] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T19:05:13.215815] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-02. [2025-09-17T19:05:14.015821] [INFO ] [REMOTE ] FNV: Fetching primary data for 2025-09. [2025-09-17T19:05:14.277450] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T19:05:14.815790] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-03. [2025-09-17T19:05:15.409352] [INFO ] [REMOTE ] FNV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T19:05:15.415535] [INFO ] [REMOTE ] FNV: Full fetch complete (65729 records). [2025-09-17T19:05:15.415724] [DEBUG] [VALIDATOR ] FNV: Validating primary data. [2025-09-17T19:05:15.651267] [INFO ] [REMOTE ] FOF: Fetching primary data for 2025-09. [2025-09-17T19:05:15.869676] [DEBUG] [VALIDATOR ] FNV: All expected trading days are present. [2025-09-17T19:05:15.869771] [DEBUG] [VALIDATOR ] FNV: Primary data validation passed. [2025-09-17T19:05:15.870718] [INFO ] [MAIN ] FNV: Fetched primary data is valid. [2025-09-17T19:05:15.870852] [DEBUG] [LOCAL ] FNV: Saving primary data. [2025-09-17T19:05:15.877536] [DEBUG] [LOCAL ] FNV: Trimmed 65729 records to 46493 (keeping 200 days of data) [2025-09-17T19:05:15.884572] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T19:05:16.190546] [DEBUG] [LOCAL ] FNV: Primary data saved (46493 records). [2025-09-17T19:05:16.190702] [INFO ] [MAIN ] FNV: Full history saved. [2025-09-17T19:05:16.191712] [INFO ] [MAIN ] Update Progress: 859/2371 symbols completed. FNV took 41.1s. Estimated remaining: 3h 40m 27s. Rate: 6.9 symbols/min [2025-09-17T19:05:16.364152] [INFO ] [MAIN ] FPF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:05:16.386442] [DEBUG] [LOCAL ] FPF: Loaded 17657 existing records from primary storage. [2025-09-17T19:05:16.386596] [INFO ] [MAIN ] FPF: Loaded 17657 existing records. [2025-09-17T19:05:16.420846] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-11. [2025-09-17T19:05:16.575324] [WARN ] [MAIN ] FPF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:05:16.575537] [INFO ] [MAIN ] FPF: Wiping existing primary data before full refresh. [2025-09-17T19:05:16.575582] [INFO ] [LOCAL ] FPF: Starting deletion of primary data. [2025-09-17T19:05:16.576243] [DEBUG] [LOCAL ] FPF: Deleted primary data file. [2025-09-17T19:05:16.576290] [INFO ] [MAIN ] FPF: Starting full primary refresh. [2025-09-17T19:05:16.861413] [INFO ] [REMOTE ] FOF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T19:05:16.912636] [INFO ] [REMOTE ] FOF: Full fetch complete (11804 records). [2025-09-17T19:05:16.921391] [DEBUG] [VALIDATOR ] FOF: Validating primary data. [2025-09-17T19:05:16.941389] [INFO ] [REMOTE ] FPF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:05:17.220850] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-04. [2025-09-17T19:05:17.305790] [DEBUG] [VALIDATOR ] FOF: All expected trading days are present. [2025-09-17T19:05:17.305873] [DEBUG] [VALIDATOR ] FOF: Primary data validation passed. [2025-09-17T19:05:17.306180] [INFO ] [MAIN ] FOF: Fetched primary data is valid. [2025-09-17T19:05:17.306230] [DEBUG] [LOCAL ] FOF: Saving primary data. [2025-09-17T19:05:17.306719] [DEBUG] [LOCAL ] FOF: Trimmed 11804 records to 8360 (keeping 200 days of data) [2025-09-17T19:05:17.359347] [DEBUG] [LOCAL ] FOF: Primary data saved (8360 records). [2025-09-17T19:05:17.359502] [INFO ] [MAIN ] FOF: Full history saved. [2025-09-17T19:05:17.359600] [INFO ] [MAIN ] Update Progress: 860/2371 symbols completed. FOF took 30.7s. Estimated remaining: 3h 40m 5s. Rate: 6.9 symbols/min [2025-09-17T19:05:17.540247] [INFO ] [MAIN ] FPH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:05:17.559282] [DEBUG] [LOCAL ] FPH: Loaded 19790 existing records from primary storage. [2025-09-17T19:05:17.559425] [INFO ] [MAIN ] FPH: Loaded 19790 existing records. [2025-09-17T19:05:17.751277] [WARN ] [MAIN ] FPH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:05:17.751565] [INFO ] [MAIN ] FPH: Wiping existing primary data before full refresh. [2025-09-17T19:05:17.751611] [INFO ] [LOCAL ] FPH: Starting deletion of primary data. [2025-09-17T19:05:17.752142] [DEBUG] [LOCAL ] FPH: Deleted primary data file. [2025-09-17T19:05:17.752189] [INFO ] [MAIN ] FPH: Starting full primary refresh. [2025-09-17T19:05:18.022693] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-11. [2025-09-17T19:05:18.114357] [INFO ] [REMOTE ] FPH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:05:18.210174] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T19:05:18.356936] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T19:05:18.705703] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T19:05:18.815793] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-05. [2025-09-17T19:05:19.615785] [INFO ] [REMOTE ] FPF: Fetching primary data for 2024-12. [2025-09-17T19:05:19.924262] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T19:05:20.403495] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T19:05:20.415682] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-06. [2025-09-17T19:05:21.210919] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T19:05:21.215672] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-07. [2025-09-17T19:05:22.015777] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-11. [2025-09-17T19:05:22.316716] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T19:05:22.815779] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2024-12. [2025-09-17T19:05:23.003977] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T19:05:23.615787] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-08. [2025-09-17T19:05:24.415743] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-01. [2025-09-17T19:05:24.537523] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T19:05:24.626849] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T19:05:25.101166] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T19:05:25.215781] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-02. [2025-09-17T19:05:26.015843] [INFO ] [REMOTE ] FOR: Fetching primary data for 2025-09. [2025-09-17T19:05:26.238371] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T19:05:26.766466] [INFO ] [REMOTE ] FOR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T19:05:26.769399] [INFO ] [REMOTE ] FOR: Full fetch complete (29569 records). [2025-09-17T19:05:26.769545] [DEBUG] [VALIDATOR ] FOR: Validating primary data. [2025-09-17T19:05:26.820866] [INFO ] [REMOTE ] FPH: Fetching primary data for 2024-12. [2025-09-17T19:05:27.151041] [DEBUG] [VALIDATOR ] FOR: All expected trading days are present. [2025-09-17T19:05:27.151125] [DEBUG] [VALIDATOR ] FOR: Primary data validation passed. [2025-09-17T19:05:27.151715] [INFO ] [MAIN ] FOR: Fetched primary data is valid. [2025-09-17T19:05:27.151786] [DEBUG] [LOCAL ] FOR: Saving primary data. [2025-09-17T19:05:27.153294] [DEBUG] [LOCAL ] FOR: Trimmed 29569 records to 20288 (keeping 200 days of data) [2025-09-17T19:05:27.279154] [DEBUG] [LOCAL ] FOR: Primary data saved (20288 records). [2025-09-17T19:05:27.279300] [INFO ] [MAIN ] FOR: Full history saved. [2025-09-17T19:05:27.279405] [INFO ] [MAIN ] Update Progress: 861/2371 symbols completed. FOR took 29.3s. Estimated remaining: 3h 39m 58s. Rate: 6.9 symbols/min [2025-09-17T19:05:27.452532] [INFO ] [MAIN ] FPI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:05:27.487463] [DEBUG] [LOCAL ] FPI: Loaded 31234 existing records from primary storage. [2025-09-17T19:05:27.487610] [INFO ] [MAIN ] FPI: Loaded 31234 existing records. [2025-09-17T19:05:27.627268] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-01. [2025-09-17T19:05:27.668395] [WARN ] [MAIN ] FPI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:05:27.668686] [INFO ] [MAIN ] FPI: Wiping existing primary data before full refresh. [2025-09-17T19:05:27.668750] [INFO ] [LOCAL ] FPI: Starting deletion of primary data. [2025-09-17T19:05:27.669868] [DEBUG] [LOCAL ] FPI: Deleted primary data file. [2025-09-17T19:05:27.669939] [INFO ] [MAIN ] FPI: Starting full primary refresh. [2025-09-17T19:05:28.043691] [INFO ] [REMOTE ] FPI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:05:28.058219] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T19:05:28.415767] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-03. [2025-09-17T19:05:29.186573] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T19:05:29.197978] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T19:05:29.215717] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-02. [2025-09-17T19:05:30.015841] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-11. [2025-09-17T19:05:30.815855] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-04. [2025-09-17T19:05:30.972713] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T19:05:31.046270] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T19:05:31.615775] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-03. [2025-09-17T19:05:31.844829] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T19:05:32.415775] [INFO ] [REMOTE ] FPI: Fetching primary data for 2024-12. [2025-09-17T19:05:33.215811] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-01. [2025-09-17T19:05:33.369851] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T19:05:33.901300] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T19:05:34.015801] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-04. [2025-09-17T19:05:34.441830] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T19:05:34.815838] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-02. [2025-09-17T19:05:35.613583] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T19:05:35.624068] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-01. [2025-09-17T19:05:35.810623] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T19:05:36.398205] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T19:05:36.415775] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-02. [2025-09-17T19:05:37.215848] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-03. [2025-09-17T19:05:37.680409] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T19:05:38.015796] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-03. [2025-09-17T19:05:38.390011] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T19:05:38.815808] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-04. [2025-09-17T19:05:39.207306] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T19:05:39.594602] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T19:05:39.615741] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-05. [2025-09-17T19:05:40.415768] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-05. [2025-09-17T19:05:40.602381] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T19:05:41.215848] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-04. [2025-09-17T19:05:41.328865] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T19:05:42.015781] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-06. [2025-09-17T19:05:42.669354] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T19:05:42.815694] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-05. [2025-09-17T19:05:42.854034] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T19:05:43.615828] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-05. [2025-09-17T19:05:44.411443] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T19:05:44.418331] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-07. [2025-09-17T19:05:45.215753] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-06. [2025-09-17T19:05:45.305535] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T19:05:45.342389] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T19:05:46.015814] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-06. [2025-09-17T19:05:46.169946] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T19:05:46.815808] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-07. [2025-09-17T19:05:47.399761] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T19:05:47.541217] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T19:05:47.615794] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-08. [2025-09-17T19:05:48.419971] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-06. [2025-09-17T19:05:48.421854] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T19:05:49.215776] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-07. [2025-09-17T19:05:50.015772] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-08. [2025-09-17T19:05:50.126771] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T19:05:50.232560] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T19:05:50.807612] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T19:05:50.815665] [INFO ] [REMOTE ] FPF: Fetching primary data for 2025-09. [2025-09-17T19:05:51.615787] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-08. [2025-09-17T19:05:51.738949] [INFO ] [REMOTE ] FPF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T19:05:51.741520] [INFO ] [REMOTE ] FPF: Full fetch complete (26330 records). [2025-09-17T19:05:51.741629] [DEBUG] [VALIDATOR ] FPF: Validating primary data. [2025-09-17T19:05:52.112213] [DEBUG] [VALIDATOR ] FPF: All expected trading days are present. [2025-09-17T19:05:52.112305] [DEBUG] [VALIDATOR ] FPF: Primary data validation passed. [2025-09-17T19:05:52.112933] [INFO ] [MAIN ] FPF: Fetched primary data is valid. [2025-09-17T19:05:52.112982] [DEBUG] [LOCAL ] FPF: Saving primary data. [2025-09-17T19:05:52.114091] [DEBUG] [LOCAL ] FPF: Trimmed 26330 records to 17669 (keeping 200 days of data) [2025-09-17T19:05:52.223701] [DEBUG] [LOCAL ] FPF: Primary data saved (17669 records). [2025-09-17T19:05:52.223874] [INFO ] [MAIN ] FPF: Full history saved. [2025-09-17T19:05:52.224015] [INFO ] [MAIN ] Update Progress: 862/2371 symbols completed. FPF took 36.0s. Estimated remaining: 3h 40m 17s. Rate: 6.9 symbols/min [2025-09-17T19:05:52.398205] [INFO ] [MAIN ] FR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:05:52.415790] [INFO ] [REMOTE ] FPH: Fetching primary data for 2025-09. [2025-09-17T19:05:52.449394] [DEBUG] [LOCAL ] FR: Loaded 46885 existing records from primary storage. [2025-09-17T19:05:52.449560] [INFO ] [MAIN ] FR: Loaded 46885 existing records. [2025-09-17T19:05:52.626871] [WARN ] [MAIN ] FR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:05:52.627176] [INFO ] [MAIN ] FR: Wiping existing primary data before full refresh. [2025-09-17T19:05:52.627222] [INFO ] [LOCAL ] FR: Starting deletion of primary data. [2025-09-17T19:05:52.628230] [DEBUG] [LOCAL ] FR: Deleted primary data file. [2025-09-17T19:05:52.628288] [INFO ] [MAIN ] FR: Starting full primary refresh. [2025-09-17T19:05:52.986160] [INFO ] [REMOTE ] FR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:05:53.001543] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T19:05:53.212766] [INFO ] [REMOTE ] FPH: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T19:05:53.215739] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-11. [2025-09-17T19:05:53.216912] [INFO ] [REMOTE ] FPH: Full fetch complete (31658 records). [2025-09-17T19:05:53.216994] [DEBUG] [VALIDATOR ] FPH: Validating primary data. [2025-09-17T19:05:53.594234] [DEBUG] [VALIDATOR ] FPH: All expected trading days are present. [2025-09-17T19:05:53.594322] [DEBUG] [VALIDATOR ] FPH: Primary data validation passed. [2025-09-17T19:05:53.594872] [INFO ] [MAIN ] FPH: Fetched primary data is valid. [2025-09-17T19:05:53.594916] [DEBUG] [LOCAL ] FPH: Saving primary data. [2025-09-17T19:05:53.596017] [DEBUG] [LOCAL ] FPH: Trimmed 31658 records to 19832 (keeping 200 days of data) [2025-09-17T19:05:53.711699] [DEBUG] [LOCAL ] FPH: Primary data saved (19832 records). [2025-09-17T19:05:53.711854] [INFO ] [MAIN ] FPH: Full history saved. [2025-09-17T19:05:53.711940] [INFO ] [MAIN ] Update Progress: 863/2371 symbols completed. FPH took 36.4s. Estimated remaining: 3h 39m 56s. Rate: 6.9 symbols/min [2025-09-17T19:05:53.894127] [INFO ] [MAIN ] FRA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:05:53.911781] [DEBUG] [LOCAL ] FRA: Loaded 14810 existing records from primary storage. [2025-09-17T19:05:53.911913] [INFO ] [MAIN ] FRA: Loaded 14810 existing records. [2025-09-17T19:05:54.020916] [INFO ] [REMOTE ] FPI: Fetching primary data for 2025-09. [2025-09-17T19:05:54.095004] [WARN ] [MAIN ] FRA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:05:54.095245] [INFO ] [MAIN ] FRA: Wiping existing primary data before full refresh. [2025-09-17T19:05:54.095291] [INFO ] [LOCAL ] FRA: Starting deletion of primary data. [2025-09-17T19:05:54.095988] [DEBUG] [LOCAL ] FRA: Deleted primary data file. [2025-09-17T19:05:54.096044] [INFO ] [MAIN ] FRA: Starting full primary refresh. [2025-09-17T19:05:54.460460] [INFO ] [REMOTE ] FRA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:05:54.826581] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-11. [2025-09-17T19:05:54.832566] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T19:05:55.302677] [INFO ] [REMOTE ] FPI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T19:05:55.306709] [INFO ] [REMOTE ] FPI: Full fetch complete (43939 records). [2025-09-17T19:05:55.306802] [DEBUG] [VALIDATOR ] FPI: Validating primary data. [2025-09-17T19:05:55.620838] [INFO ] [REMOTE ] FR: Fetching primary data for 2024-12. [2025-09-17T19:05:55.697511] [DEBUG] [VALIDATOR ] FPI: All expected trading days are present. [2025-09-17T19:05:55.697755] [DEBUG] [VALIDATOR ] FPI: Primary data validation passed. [2025-09-17T19:05:55.698490] [INFO ] [MAIN ] FPI: Fetched primary data is valid. [2025-09-17T19:05:55.698594] [DEBUG] [LOCAL ] FPI: Saving primary data. [2025-09-17T19:05:55.699772] [DEBUG] [LOCAL ] FPI: Trimmed 43939 records to 31251 (keeping 200 days of data) [2025-09-17T19:05:55.805177] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T19:05:55.906490] [DEBUG] [LOCAL ] FPI: Primary data saved (31251 records). [2025-09-17T19:05:55.906652] [INFO ] [MAIN ] FPI: Full history saved. [2025-09-17T19:05:55.906757] [INFO ] [MAIN ] Update Progress: 864/2371 symbols completed. FPI took 28.6s. Estimated remaining: 3h 39m 36s. Rate: 6.9 symbols/min [2025-09-17T19:05:56.079516] [INFO ] [MAIN ] FRGE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:05:56.098906] [DEBUG] [LOCAL ] FRGE: Loaded 19255 existing records from primary storage. [2025-09-17T19:05:56.099067] [INFO ] [MAIN ] FRGE: Loaded 19255 existing records. [2025-09-17T19:05:56.277354] [WARN ] [MAIN ] FRGE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:05:56.277666] [INFO ] [MAIN ] FRGE: Wiping existing primary data before full refresh. [2025-09-17T19:05:56.277715] [INFO ] [LOCAL ] FRGE: Starting deletion of primary data. [2025-09-17T19:05:56.278240] [DEBUG] [LOCAL ] FRGE: Deleted primary data file. [2025-09-17T19:05:56.278292] [INFO ] [MAIN ] FRGE: Starting full primary refresh. [2025-09-17T19:05:56.421379] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-07. [2025-09-17T19:05:56.636344] [INFO ] [REMOTE ] FRGE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:05:57.220930] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-11. [2025-09-17T19:05:57.239579] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T19:05:57.828428] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T19:05:58.015776] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-01. [2025-09-17T19:05:58.365877] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T19:05:58.815787] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-08. [2025-09-17T19:05:59.204105] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T19:05:59.615792] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-02. [2025-09-17T19:06:00.279902] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T19:06:00.415762] [INFO ] [REMOTE ] FOUR: Fetching primary data for 2025-09. [2025-09-17T19:06:00.712399] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T19:06:01.215794] [INFO ] [REMOTE ] FRA: Fetching primary data for 2024-12. [2025-09-17T19:06:02.015779] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-03. [2025-09-17T19:06:02.589122] [INFO ] [REMOTE ] FOUR: Incremental fetch complete for 2025-09 (2.17 seconds). [2025-09-17T19:06:02.611444] [INFO ] [REMOTE ] FOUR: Full fetch complete (71754 records). [2025-09-17T19:06:02.611888] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T19:06:02.616036] [DEBUG] [VALIDATOR ] FOUR: Validating primary data. [2025-09-17T19:06:02.821461] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2024-12. [2025-09-17T19:06:03.030053] [DEBUG] [VALIDATOR ] FOUR: All expected trading days are present. [2025-09-17T19:06:03.030151] [DEBUG] [VALIDATOR ] FOUR: Primary data validation passed. [2025-09-17T19:06:03.031027] [INFO ] [MAIN ] FOUR: Fetched primary data is valid. [2025-09-17T19:06:03.031074] [DEBUG] [LOCAL ] FOUR: Saving primary data. [2025-09-17T19:06:03.032558] [DEBUG] [LOCAL ] FOUR: Trimmed 71754 records to 49528 (keeping 200 days of data) [2025-09-17T19:06:03.338066] [DEBUG] [LOCAL ] FOUR: Primary data saved (49528 records). [2025-09-17T19:06:03.338226] [INFO ] [MAIN ] FOUR: Full history saved. [2025-09-17T19:06:03.338329] [INFO ] [MAIN ] Update Progress: 865/2371 symbols completed. FOUR took 53.0s. Estimated remaining: 3h 39m 25s. Rate: 6.9 symbols/min [2025-09-17T19:06:03.513143] [INFO ] [MAIN ] FRO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:06:03.564792] [DEBUG] [LOCAL ] FRO: Loaded 51942 existing records from primary storage. [2025-09-17T19:06:03.564954] [INFO ] [MAIN ] FRO: Loaded 51942 existing records. [2025-09-17T19:06:03.629332] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-01. [2025-09-17T19:06:03.746372] [WARN ] [MAIN ] FRO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:06:03.746663] [INFO ] [MAIN ] FRO: Wiping existing primary data before full refresh. [2025-09-17T19:06:03.746723] [INFO ] [LOCAL ] FRO: Starting deletion of primary data. [2025-09-17T19:06:03.747877] [DEBUG] [LOCAL ] FRO: Deleted primary data file. [2025-09-17T19:06:03.747929] [INFO ] [MAIN ] FRO: Starting full primary refresh. [2025-09-17T19:06:04.105136] [INFO ] [REMOTE ] FRO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:06:04.415800] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-11. [2025-09-17T19:06:04.803201] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T19:06:04.949217] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T19:06:05.150351] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-03 (3.13 seconds). [2025-09-17T19:06:05.215718] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-04. [2025-09-17T19:06:05.811796] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T19:06:06.015773] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-01. [2025-09-17T19:06:06.815778] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-02. [2025-09-17T19:06:06.964748] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T19:06:07.254977] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T19:06:07.575348] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T19:06:07.615775] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-02. [2025-09-17T19:06:08.415791] [INFO ] [REMOTE ] FRO: Fetching primary data for 2024-12. [2025-09-17T19:06:08.946072] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T19:06:09.215777] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-03. [2025-09-17T19:06:10.015792] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-03. [2025-09-17T19:06:10.252801] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T19:06:10.282682] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T19:06:10.653013] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T19:06:10.815853] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-01. [2025-09-17T19:06:11.615854] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-04. [2025-09-17T19:06:12.415775] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-05. [2025-09-17T19:06:12.955735] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-17T19:06:13.215750] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-04. [2025-09-17T19:06:13.561777] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T19:06:13.836808] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T19:06:13.933390] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T19:06:14.015792] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-06. [2025-09-17T19:06:14.815829] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-05. [2025-09-17T19:06:15.583208] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T19:06:15.603431] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T19:06:15.615683] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-07. [2025-09-17T19:06:16.415758] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-05. [2025-09-17T19:06:17.215822] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-06. [2025-09-17T19:06:17.873212] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T19:06:18.015768] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-08. [2025-09-17T19:06:18.095749] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T19:06:18.260199] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T19:06:18.815865] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-07. [2025-09-17T19:06:19.316087] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T19:06:19.461536] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T19:06:19.615789] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-08. [2025-09-17T19:06:20.415838] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-02. [2025-09-17T19:06:20.588891] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T19:06:21.215814] [INFO ] [REMOTE ] FR: Fetching primary data for 2025-09. [2025-09-17T19:06:21.999407] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T19:06:22.015673] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-03. [2025-09-17T19:06:22.409734] [INFO ] [REMOTE ] FR: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T19:06:22.418874] [INFO ] [REMOTE ] FR: Full fetch complete (66436 records). [2025-09-17T19:06:22.419067] [DEBUG] [VALIDATOR ] FR: Validating primary data. [2025-09-17T19:06:22.829464] [INFO ] [REMOTE ] FRGE: Fetching primary data for 2025-09. [2025-09-17T19:06:22.907138] [DEBUG] [VALIDATOR ] FR: All expected trading days are present. [2025-09-17T19:06:22.907268] [DEBUG] [VALIDATOR ] FR: Primary data validation passed. [2025-09-17T19:06:22.909053] [INFO ] [MAIN ] FR: Fetched primary data is valid. [2025-09-17T19:06:22.909517] [DEBUG] [LOCAL ] FR: Saving primary data. [2025-09-17T19:06:22.911535] [DEBUG] [LOCAL ] FR: Trimmed 66436 records to 46824 (keeping 200 days of data) [2025-09-17T19:06:23.343937] [DEBUG] [LOCAL ] FR: Primary data saved (46824 records). [2025-09-17T19:06:23.344146] [INFO ] [MAIN ] FR: Full history saved. [2025-09-17T19:06:23.345165] [INFO ] [MAIN ] Update Progress: 866/2371 symbols completed. FR took 31.1s. Estimated remaining: 3h 39m 36s. Rate: 6.9 symbols/min [2025-09-17T19:06:23.616598] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-06. [2025-09-17T19:06:23.625998] [INFO ] [MAIN ] FRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:06:23.688298] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T19:06:23.735742] [DEBUG] [LOCAL ] FRT: Loaded 42398 existing records from primary storage. [2025-09-17T19:06:23.735930] [INFO ] [MAIN ] FRT: Loaded 42398 existing records. [2025-09-17T19:06:23.953611] [WARN ] [MAIN ] FRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:06:23.955031] [INFO ] [REMOTE ] FRGE: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T19:06:23.955385] [INFO ] [MAIN ] FRT: Wiping existing primary data before full refresh. [2025-09-17T19:06:23.958007] [INFO ] [LOCAL ] FRT: Starting deletion of primary data. [2025-09-17T19:06:23.958246] [INFO ] [REMOTE ] FRGE: Full fetch complete (34719 records). [2025-09-17T19:06:23.958515] [DEBUG] [VALIDATOR ] FRGE: Validating primary data. [2025-09-17T19:06:23.964803] [DEBUG] [LOCAL ] FRT: Deleted primary data file. [2025-09-17T19:06:24.043667] [INFO ] [MAIN ] FRT: Starting full primary refresh. [2025-09-17T19:06:24.422994] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-04. [2025-09-17T19:06:24.750928] [INFO ] [REMOTE ] FRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:06:24.787453] [DEBUG] [VALIDATOR ] FRGE: All expected trading days are present. [2025-09-17T19:06:24.787694] [DEBUG] [VALIDATOR ] FRGE: Primary data validation passed. [2025-09-17T19:06:24.788363] [INFO ] [MAIN ] FRGE: Fetched primary data is valid. [2025-09-17T19:06:24.788445] [DEBUG] [LOCAL ] FRGE: Saving primary data. [2025-09-17T19:06:24.801754] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T19:06:24.806397] [DEBUG] [LOCAL ] FRGE: Trimmed 34719 records to 19024 (keeping 200 days of data) [2025-09-17T19:06:24.923298] [DEBUG] [LOCAL ] FRGE: Primary data saved (19024 records). [2025-09-17T19:06:24.923501] [INFO ] [MAIN ] FRGE: Full history saved. [2025-09-17T19:06:24.923605] [INFO ] [MAIN ] Update Progress: 867/2371 symbols completed. FRGE took 29.0s. Estimated remaining: 3h 39m 14s. Rate: 6.9 symbols/min [2025-09-17T19:06:25.120418] [INFO ] [MAIN ] FSCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:06:25.154350] [DEBUG] [LOCAL ] FSCO: Loaded 36874 existing records from primary storage. [2025-09-17T19:06:25.154493] [INFO ] [MAIN ] FSCO: Loaded 36874 existing records. [2025-09-17T19:06:25.221063] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-07. [2025-09-17T19:06:25.335076] [WARN ] [MAIN ] FSCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:06:25.335360] [INFO ] [MAIN ] FSCO: Wiping existing primary data before full refresh. [2025-09-17T19:06:25.335412] [INFO ] [LOCAL ] FSCO: Starting deletion of primary data. [2025-09-17T19:06:25.336224] [DEBUG] [LOCAL ] FSCO: Deleted primary data file. [2025-09-17T19:06:25.336275] [INFO ] [MAIN ] FSCO: Starting full primary refresh. [2025-09-17T19:06:25.712231] [INFO ] [REMOTE ] FSCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:06:26.015750] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-11. [2025-09-17T19:06:26.211041] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T19:06:26.458584] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T19:06:26.815794] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-05. [2025-09-17T19:06:27.217435] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T19:06:27.615844] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-11. [2025-09-17T19:06:28.399008] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T19:06:28.415688] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-06. [2025-09-17T19:06:28.893052] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T19:06:29.215778] [INFO ] [REMOTE ] FRT: Fetching primary data for 2024-12. [2025-09-17T19:06:30.015802] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2024-12. [2025-09-17T19:06:30.739513] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-17T19:06:30.815744] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-08. [2025-09-17T19:06:30.899253] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T19:06:31.476127] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T19:06:31.615782] [INFO ] [REMOTE ] FRA: Fetching primary data for 2025-09. [2025-09-17T19:06:31.659468] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T19:06:32.367434] [INFO ] [REMOTE ] FRA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T19:06:32.369737] [INFO ] [REMOTE ] FRA: Full fetch complete (24470 records). [2025-09-17T19:06:32.369807] [DEBUG] [VALIDATOR ] FRA: Validating primary data. [2025-09-17T19:06:32.422989] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-01. [2025-09-17T19:06:32.740274] [DEBUG] [VALIDATOR ] FRA: All expected trading days are present. [2025-09-17T19:06:32.740357] [DEBUG] [VALIDATOR ] FRA: Primary data validation passed. [2025-09-17T19:06:32.740814] [INFO ] [MAIN ] FRA: Fetched primary data is valid. [2025-09-17T19:06:32.740854] [DEBUG] [LOCAL ] FRA: Saving primary data. [2025-09-17T19:06:32.741473] [DEBUG] [LOCAL ] FRA: Trimmed 24470 records to 14810 (keeping 200 days of data) [2025-09-17T19:06:32.830807] [DEBUG] [LOCAL ] FRA: Primary data saved (14810 records). [2025-09-17T19:06:32.830948] [INFO ] [MAIN ] FRA: Full history saved. [2025-09-17T19:06:32.831052] [INFO ] [MAIN ] Update Progress: 868/2371 symbols completed. FRA took 39.1s. Estimated remaining: 3h 39m 4s. Rate: 6.9 symbols/min [2025-09-17T19:06:32.999062] [INFO ] [MAIN ] FSK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:06:33.049014] [DEBUG] [LOCAL ] FSK: Loaded 49332 existing records from primary storage. [2025-09-17T19:06:33.049180] [INFO ] [MAIN ] FSK: Loaded 49332 existing records. [2025-09-17T19:06:33.227110] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-01. [2025-09-17T19:06:33.231815] [WARN ] [MAIN ] FSK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:06:33.232842] [INFO ] [MAIN ] FSK: Wiping existing primary data before full refresh. [2025-09-17T19:06:33.232887] [INFO ] [LOCAL ] FSK: Starting deletion of primary data. [2025-09-17T19:06:33.233785] [DEBUG] [LOCAL ] FSK: Deleted primary data file. [2025-09-17T19:06:33.233833] [INFO ] [MAIN ] FSK: Starting full primary refresh. [2025-09-17T19:06:33.607394] [INFO ] [REMOTE ] FSK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:06:34.015857] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-11. [2025-09-17T19:06:34.060552] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T19:06:34.340829] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T19:06:34.815835] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-02. [2025-09-17T19:06:35.615720] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-02. [2025-09-17T19:06:35.707418] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T19:06:36.018720] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T19:06:36.415771] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-03. [2025-09-17T19:06:36.913533] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T19:06:37.215855] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-03. [2025-09-17T19:06:37.667609] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T19:06:38.015747] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-04. [2025-09-17T19:06:38.640098] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T19:06:38.815799] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-07. [2025-09-17T19:06:39.614691] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T19:06:39.623587] [INFO ] [REMOTE ] FSK: Fetching primary data for 2024-12. [2025-09-17T19:06:40.415777] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-04. [2025-09-17T19:06:40.734320] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T19:06:41.215865] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-08. [2025-09-17T19:06:41.399958] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T19:06:42.015818] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-01. [2025-09-17T19:06:42.061278] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T19:06:42.815724] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-05. [2025-09-17T19:06:43.559100] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-17T19:06:43.615785] [INFO ] [REMOTE ] FRO: Fetching primary data for 2025-09. [2025-09-17T19:06:43.662335] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T19:06:44.258133] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T19:06:44.415771] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-02. [2025-09-17T19:06:45.215765] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-05. [2025-09-17T19:06:45.247685] [INFO ] [REMOTE ] FRO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T19:06:45.255814] [INFO ] [REMOTE ] FRO: Full fetch complete (75398 records). [2025-09-17T19:06:45.255978] [DEBUG] [VALIDATOR ] FRO: Validating primary data. [2025-09-17T19:06:45.659633] [DEBUG] [VALIDATOR ] FRO: All expected trading days are present. [2025-09-17T19:06:45.659753] [DEBUG] [VALIDATOR ] FRO: Primary data validation passed. [2025-09-17T19:06:45.660634] [INFO ] [MAIN ] FRO: Fetched primary data is valid. [2025-09-17T19:06:45.660709] [DEBUG] [LOCAL ] FRO: Saving primary data. [2025-09-17T19:06:45.662205] [DEBUG] [LOCAL ] FRO: Trimmed 75398 records to 51944 (keeping 200 days of data) [2025-09-17T19:06:45.981288] [DEBUG] [LOCAL ] FRO: Primary data saved (51944 records). [2025-09-17T19:06:45.981426] [INFO ] [MAIN ] FRO: Full history saved. [2025-09-17T19:06:45.981508] [INFO ] [MAIN ] Update Progress: 869/2371 symbols completed. FRO took 42.6s. Estimated remaining: 3h 39m 3s. Rate: 6.9 symbols/min [2025-09-17T19:06:46.020863] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-06. [2025-09-17T19:06:46.170129] [INFO ] [MAIN ] FSLY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:06:46.199963] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T19:06:46.255294] [DEBUG] [LOCAL ] FSLY: Loaded 51270 existing records from primary storage. [2025-09-17T19:06:46.255474] [INFO ] [MAIN ] FSLY: Loaded 51270 existing records. [2025-09-17T19:06:46.435605] [WARN ] [MAIN ] FSLY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:06:46.435894] [INFO ] [MAIN ] FSLY: Wiping existing primary data before full refresh. [2025-09-17T19:06:46.435947] [INFO ] [LOCAL ] FSLY: Starting deletion of primary data. [2025-09-17T19:06:46.436751] [DEBUG] [LOCAL ] FSLY: Deleted primary data file. [2025-09-17T19:06:46.436800] [INFO ] [MAIN ] FSLY: Starting full primary refresh. [2025-09-17T19:06:46.793989] [INFO ] [REMOTE ] FSLY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:06:46.824364] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-03. [2025-09-17T19:06:46.829417] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T19:06:47.447193] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T19:06:47.615821] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-07. [2025-09-17T19:06:48.415772] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-11. [2025-09-17T19:06:48.708213] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T19:06:49.064565] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T19:06:49.215793] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-06. [2025-09-17T19:06:50.015783] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-08. [2025-09-17T19:06:50.209874] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T19:06:50.349706] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T19:06:50.815798] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-07. [2025-09-17T19:06:51.174195] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T19:06:51.615790] [INFO ] [REMOTE ] FSCO: Fetching primary data for 2025-09. [2025-09-17T19:06:52.356536] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T19:06:52.415755] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-08. [2025-09-17T19:06:53.108314] [INFO ] [REMOTE ] FSCO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T19:06:53.113331] [INFO ] [REMOTE ] FSCO: Full fetch complete (53848 records). [2025-09-17T19:06:53.113464] [DEBUG] [VALIDATOR ] FSCO: Validating primary data. [2025-09-17T19:06:53.220840] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-04. [2025-09-17T19:06:53.497568] [DEBUG] [VALIDATOR ] FSCO: All expected trading days are present. [2025-09-17T19:06:53.497684] [DEBUG] [VALIDATOR ] FSCO: Primary data validation passed. [2025-09-17T19:06:53.498441] [INFO ] [MAIN ] FSCO: Fetched primary data is valid. [2025-09-17T19:06:53.498486] [DEBUG] [LOCAL ] FSCO: Saving primary data. [2025-09-17T19:06:53.499666] [DEBUG] [LOCAL ] FSCO: Trimmed 53848 records to 36795 (keeping 200 days of data) [2025-09-17T19:06:53.719985] [DEBUG] [LOCAL ] FSCO: Primary data saved (36795 records). [2025-09-17T19:06:53.720213] [INFO ] [MAIN ] FSCO: Full history saved. [2025-09-17T19:06:53.720393] [INFO ] [MAIN ] Update Progress: 870/2371 symbols completed. FSCO took 28.8s. Estimated remaining: 3h 38m 53s. Rate: 6.9 symbols/min [2025-09-17T19:06:53.911762] [INFO ] [MAIN ] FSM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:06:53.924253] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T19:06:53.982762] [DEBUG] [LOCAL ] FSM: Loaded 53267 existing records from primary storage. [2025-09-17T19:06:53.982919] [INFO ] [MAIN ] FSM: Loaded 53267 existing records. [2025-09-17T19:06:54.025374] [INFO ] [REMOTE ] FRT: Fetching primary data for 2025-09. [2025-09-17T19:06:54.162908] [WARN ] [MAIN ] FSM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:06:54.163175] [INFO ] [MAIN ] FSM: Wiping existing primary data before full refresh. [2025-09-17T19:06:54.163230] [INFO ] [LOCAL ] FSM: Starting deletion of primary data. [2025-09-17T19:06:54.164320] [DEBUG] [LOCAL ] FSM: Deleted primary data file. [2025-09-17T19:06:54.164372] [INFO ] [MAIN ] FSM: Starting full primary refresh. [2025-09-17T19:06:54.535793] [INFO ] [REMOTE ] FSM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:06:54.714576] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T19:06:54.815782] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2024-12. [2025-09-17T19:06:55.607980] [INFO ] [REMOTE ] FRT: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T19:06:55.613429] [INFO ] [REMOTE ] FRT: Full fetch complete (60161 records). [2025-09-17T19:06:55.613530] [DEBUG] [VALIDATOR ] FRT: Validating primary data. [2025-09-17T19:06:55.625406] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-05. [2025-09-17T19:06:56.003952] [DEBUG] [VALIDATOR ] FRT: All expected trading days are present. [2025-09-17T19:06:56.004050] [DEBUG] [VALIDATOR ] FRT: Primary data validation passed. [2025-09-17T19:06:56.004846] [INFO ] [MAIN ] FRT: Fetched primary data is valid. [2025-09-17T19:06:56.004899] [DEBUG] [LOCAL ] FRT: Saving primary data. [2025-09-17T19:06:56.006256] [DEBUG] [LOCAL ] FRT: Trimmed 60161 records to 42429 (keeping 200 days of data) [2025-09-17T19:06:56.279777] [DEBUG] [LOCAL ] FRT: Primary data saved (42429 records). [2025-09-17T19:06:56.279957] [INFO ] [MAIN ] FRT: Full history saved. [2025-09-17T19:06:56.280605] [INFO ] [MAIN ] Update Progress: 871/2371 symbols completed. FRT took 32.9s. Estimated remaining: 3h 38m 33s. Rate: 6.9 symbols/min [2025-09-17T19:06:56.423003] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-11. [2025-09-17T19:06:56.455016] [INFO ] [MAIN ] FSS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:06:56.493937] [DEBUG] [LOCAL ] FSS: Loaded 35076 existing records from primary storage. [2025-09-17T19:06:56.494112] [INFO ] [MAIN ] FSS: Loaded 35076 existing records. [2025-09-17T19:06:56.672069] [WARN ] [MAIN ] FSS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:06:56.672500] [INFO ] [MAIN ] FSS: Wiping existing primary data before full refresh. [2025-09-17T19:06:56.672660] [INFO ] [LOCAL ] FSS: Starting deletion of primary data. [2025-09-17T19:06:56.673410] [DEBUG] [LOCAL ] FSS: Deleted primary data file. [2025-09-17T19:06:56.673456] [INFO ] [MAIN ] FSS: Starting full primary refresh. [2025-09-17T19:06:57.001386] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-17T19:06:57.089614] [INFO ] [REMOTE ] FSS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:06:57.215765] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-11. [2025-09-17T19:06:57.323176] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T19:06:58.015707] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-01. [2025-09-17T19:06:58.272322] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T19:06:58.674423] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T19:06:58.815774] [INFO ] [REMOTE ] FSM: Fetching primary data for 2024-12. [2025-09-17T19:06:59.553960] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T19:06:59.615787] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-02. [2025-09-17T19:07:00.415842] [INFO ] [REMOTE ] FSS: Fetching primary data for 2024-12. [2025-09-17T19:07:00.586426] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T19:07:01.215788] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-01. [2025-09-17T19:07:01.455817] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T19:07:01.646762] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T19:07:02.015828] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-01. [2025-09-17T19:07:02.815834] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-03. [2025-09-17T19:07:03.034966] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T19:07:03.060301] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T19:07:03.615767] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-02. [2025-09-17T19:07:04.415778] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-06. [2025-09-17T19:07:04.562196] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T19:07:05.166098] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T19:07:05.215779] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-03. [2025-09-17T19:07:06.015801] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-02. [2025-09-17T19:07:06.334661] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T19:07:06.815750] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-07. [2025-09-17T19:07:07.024129] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T19:07:07.615764] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-04. [2025-09-17T19:07:07.773757] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T19:07:08.415761] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-04. [2025-09-17T19:07:08.465860] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T19:07:08.727064] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T19:07:09.215785] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-03. [2025-09-17T19:07:09.844221] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T19:07:10.015767] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-08. [2025-09-17T19:07:10.815784] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-05. [2025-09-17T19:07:11.033035] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T19:07:11.615788] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-04. [2025-09-17T19:07:11.791311] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T19:07:12.317458] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T19:07:12.415791] [INFO ] [REMOTE ] FSK: Fetching primary data for 2025-09. [2025-09-17T19:07:13.215725] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-05. [2025-09-17T19:07:13.569364] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T19:07:14.015810] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-05. [2025-09-17T19:07:14.220123] [INFO ] [REMOTE ] FSK: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T19:07:14.226874] [INFO ] [REMOTE ] FSK: Full fetch complete (71156 records). [2025-09-17T19:07:14.226995] [DEBUG] [VALIDATOR ] FSK: Validating primary data. [2025-09-17T19:07:14.631537] [DEBUG] [VALIDATOR ] FSK: All expected trading days are present. [2025-09-17T19:07:14.643301] [DEBUG] [VALIDATOR ] FSK: Primary data validation passed. [2025-09-17T19:07:14.644369] [INFO ] [MAIN ] FSK: Fetched primary data is valid. [2025-09-17T19:07:14.644434] [DEBUG] [LOCAL ] FSK: Saving primary data. [2025-09-17T19:07:14.646338] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T19:07:14.654717] [DEBUG] [LOCAL ] FSK: Trimmed 71156 records to 49334 (keeping 200 days of data) [2025-09-17T19:07:14.836427] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-06. [2025-09-17T19:07:14.963872] [DEBUG] [LOCAL ] FSK: Primary data saved (49334 records). [2025-09-17T19:07:14.964020] [INFO ] [MAIN ] FSK: Full history saved. [2025-09-17T19:07:14.964104] [INFO ] [MAIN ] Update Progress: 872/2371 symbols completed. FSK took 42.1s. Estimated remaining: 3h 38m 42s. Rate: 6.9 symbols/min [2025-09-17T19:07:15.130909] [INFO ] [MAIN ] FT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:07:15.139247] [DEBUG] [LOCAL ] FT: Loaded 6306 existing records from primary storage. [2025-09-17T19:07:15.139398] [INFO ] [MAIN ] FT: Loaded 6306 existing records. [2025-09-17T19:07:15.314019] [WARN ] [MAIN ] FT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:07:15.314252] [INFO ] [MAIN ] FT: Wiping existing primary data before full refresh. [2025-09-17T19:07:15.314320] [INFO ] [LOCAL ] FT: Starting deletion of primary data. [2025-09-17T19:07:15.315113] [DEBUG] [LOCAL ] FT: Deleted primary data file. [2025-09-17T19:07:15.315162] [INFO ] [MAIN ] FT: Starting full primary refresh. [2025-09-17T19:07:15.619766] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-06. [2025-09-17T19:07:15.672532] [INFO ] [REMOTE ] FT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:07:15.707990] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T19:07:16.291795] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T19:07:16.415857] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-11. [2025-09-17T19:07:17.118969] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T19:07:17.160815] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T19:07:17.215845] [INFO ] [REMOTE ] FT: Fetching primary data for 2024-12. [2025-09-17T19:07:17.842090] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T19:07:18.015844] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-06. [2025-09-17T19:07:18.815794] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-07. [2025-09-17T19:07:19.615847] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-01. [2025-09-17T19:07:19.774484] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T19:07:20.222126] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T19:07:20.258249] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T19:07:20.415839] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-07. [2025-09-17T19:07:21.215882] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-07. [2025-09-17T19:07:22.015894] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-02. [2025-09-17T19:07:22.335245] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T19:07:22.673591] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T19:07:22.763309] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T19:07:22.815833] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-03. [2025-09-17T19:07:23.426691] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T19:07:23.615820] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-04. [2025-09-17T19:07:24.415849] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-08. [2025-09-17T19:07:24.467755] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T19:07:25.215833] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-08. [2025-09-17T19:07:26.015838] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-05. [2025-09-17T19:07:26.172613] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T19:07:26.733399] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T19:07:26.815732] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-06. [2025-09-17T19:07:27.109746] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T19:07:27.411443] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T19:07:27.615789] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-08. [2025-09-17T19:07:28.415821] [INFO ] [REMOTE ] FSLY: Fetching primary data for 2025-09. [2025-09-17T19:07:28.914099] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T19:07:29.215813] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-07. [2025-09-17T19:07:29.647257] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T19:07:30.015793] [INFO ] [REMOTE ] FSS: Fetching primary data for 2025-09. [2025-09-17T19:07:30.207333] [INFO ] [REMOTE ] FSLY: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T19:07:30.214113] [INFO ] [REMOTE ] FSLY: Full fetch complete (74848 records). [2025-09-17T19:07:30.214239] [DEBUG] [VALIDATOR ] FSLY: Validating primary data. [2025-09-17T19:07:30.606107] [DEBUG] [VALIDATOR ] FSLY: All expected trading days are present. [2025-09-17T19:07:30.606186] [DEBUG] [VALIDATOR ] FSLY: Primary data validation passed. [2025-09-17T19:07:30.607134] [INFO ] [MAIN ] FSLY: Fetched primary data is valid. [2025-09-17T19:07:30.607192] [DEBUG] [LOCAL ] FSLY: Saving primary data. [2025-09-17T19:07:30.608632] [DEBUG] [LOCAL ] FSLY: Trimmed 74848 records to 51273 (keeping 200 days of data) [2025-09-17T19:07:30.815861] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-08. [2025-09-17T19:07:30.913519] [DEBUG] [LOCAL ] FSLY: Primary data saved (51273 records). [2025-09-17T19:07:30.913740] [INFO ] [MAIN ] FSLY: Full history saved. [2025-09-17T19:07:30.913865] [INFO ] [MAIN ] Update Progress: 873/2371 symbols completed. FSLY took 44.9s. Estimated remaining: 3h 38m 45s. Rate: 6.8 symbols/min [2025-09-17T19:07:31.089924] [INFO ] [MAIN ] FTHY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:07:31.104659] [DEBUG] [LOCAL ] FTHY: Loaded 11685 existing records from primary storage. [2025-09-17T19:07:31.104785] [INFO ] [MAIN ] FTHY: Loaded 11685 existing records. [2025-09-17T19:07:31.302227] [WARN ] [MAIN ] FTHY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:07:31.304234] [INFO ] [REMOTE ] FSS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T19:07:31.304494] [INFO ] [MAIN ] FTHY: Wiping existing primary data before full refresh. [2025-09-17T19:07:31.308281] [INFO ] [LOCAL ] FTHY: Starting deletion of primary data. [2025-09-17T19:07:31.308531] [INFO ] [REMOTE ] FSS: Full fetch complete (47923 records). [2025-09-17T19:07:31.308669] [DEBUG] [VALIDATOR ] FSS: Validating primary data. [2025-09-17T19:07:31.314408] [DEBUG] [LOCAL ] FTHY: Deleted primary data file. [2025-09-17T19:07:31.326876] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T19:07:31.326958] [INFO ] [MAIN ] FTHY: Starting full primary refresh. [2025-09-17T19:07:31.619236] [INFO ] [REMOTE ] FT: Fetching primary data for 2025-09. [2025-09-17T19:07:32.066883] [INFO ] [REMOTE ] FTHY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:07:32.067044] [DEBUG] [VALIDATOR ] FSS: All expected trading days are present. [2025-09-17T19:07:32.067344] [DEBUG] [VALIDATOR ] FSS: Primary data validation passed. [2025-09-17T19:07:32.068026] [INFO ] [MAIN ] FSS: Fetched primary data is valid. [2025-09-17T19:07:32.068070] [DEBUG] [LOCAL ] FSS: Saving primary data. [2025-09-17T19:07:32.069200] [DEBUG] [LOCAL ] FSS: Trimmed 47923 records to 34976 (keeping 200 days of data) [2025-09-17T19:07:32.297023] [DEBUG] [LOCAL ] FSS: Primary data saved (34976 records). [2025-09-17T19:07:32.297183] [INFO ] [MAIN ] FSS: Full history saved. [2025-09-17T19:07:32.298365] [INFO ] [MAIN ] Update Progress: 874/2371 symbols completed. FSS took 36.0s. Estimated remaining: 3h 38m 24s. Rate: 6.9 symbols/min [2025-09-17T19:07:32.421115] [INFO ] [REMOTE ] FSM: Fetching primary data for 2025-09. [2025-09-17T19:07:32.476452] [INFO ] [MAIN ] FTI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:07:32.484831] [INFO ] [REMOTE ] FT: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T19:07:32.487475] [INFO ] [REMOTE ] FT: Full fetch complete (9041 records). [2025-09-17T19:07:32.487618] [DEBUG] [VALIDATOR ] FT: Validating primary data. [2025-09-17T19:07:32.830942] [DEBUG] [LOCAL ] FTI: Loaded 53311 existing records from primary storage. [2025-09-17T19:07:32.836760] [INFO ] [MAIN ] FTI: Loaded 53311 existing records. [2025-09-17T19:07:33.029146] [DEBUG] [VALIDATOR ] FT: All expected trading days are present. [2025-09-17T19:07:33.039497] [DEBUG] [VALIDATOR ] FT: Primary data validation passed. [2025-09-17T19:07:33.045300] [INFO ] [MAIN ] FT: Fetched primary data is valid. [2025-09-17T19:07:33.059680] [DEBUG] [LOCAL ] FT: Saving primary data. [2025-09-17T19:07:33.082355] [DEBUG] [LOCAL ] FT: Trimmed 9041 records to 6339 (keeping 200 days of data) [2025-09-17T19:07:33.104969] [WARN ] [MAIN ] FTI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:07:33.105546] [INFO ] [MAIN ] FTI: Wiping existing primary data before full refresh. [2025-09-17T19:07:33.120493] [INFO ] [LOCAL ] FTI: Starting deletion of primary data. [2025-09-17T19:07:33.132471] [DEBUG] [LOCAL ] FTI: Deleted primary data file. [2025-09-17T19:07:33.132912] [INFO ] [MAIN ] FTI: Starting full primary refresh. [2025-09-17T19:07:33.226486] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-11. [2025-09-17T19:07:33.323591] [DEBUG] [LOCAL ] FT: Primary data saved (6339 records). [2025-09-17T19:07:33.328933] [INFO ] [MAIN ] FT: Full history saved. [2025-09-17T19:07:33.339573] [INFO ] [MAIN ] Update Progress: 875/2371 symbols completed. FT took 18.4s. Estimated remaining: 3h 38m 2s. Rate: 6.9 symbols/min [2025-09-17T19:07:33.694083] [INFO ] [MAIN ] FTK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:07:33.697859] [INFO ] [REMOTE ] FTI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:07:33.728143] [DEBUG] [LOCAL ] FTK: Loaded 31793 existing records from primary storage. [2025-09-17T19:07:33.728284] [INFO ] [MAIN ] FTK: Loaded 31793 existing records. [2025-09-17T19:07:33.910535] [WARN ] [MAIN ] FTK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:07:33.910813] [INFO ] [MAIN ] FTK: Wiping existing primary data before full refresh. [2025-09-17T19:07:33.910864] [INFO ] [LOCAL ] FTK: Starting deletion of primary data. [2025-09-17T19:07:33.911503] [DEBUG] [LOCAL ] FTK: Deleted primary data file. [2025-09-17T19:07:33.911551] [INFO ] [MAIN ] FTK: Starting full primary refresh. [2025-09-17T19:07:34.017684] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-11. [2025-09-17T19:07:34.228265] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T19:07:34.358218] [INFO ] [REMOTE ] FTK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:07:34.387663] [INFO ] [REMOTE ] FSM: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-17T19:07:34.399142] [INFO ] [REMOTE ] FSM: Full fetch complete (76482 records). [2025-09-17T19:07:34.399376] [DEBUG] [VALIDATOR ] FSM: Validating primary data. [2025-09-17T19:07:34.820929] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-11. [2025-09-17T19:07:35.028194] [DEBUG] [VALIDATOR ] FSM: All expected trading days are present. [2025-09-17T19:07:35.028324] [DEBUG] [VALIDATOR ] FSM: Primary data validation passed. [2025-09-17T19:07:35.030122] [INFO ] [MAIN ] FSM: Fetched primary data is valid. [2025-09-17T19:07:35.030205] [DEBUG] [LOCAL ] FSM: Saving primary data. [2025-09-17T19:07:35.032356] [DEBUG] [LOCAL ] FSM: Trimmed 76482 records to 53281 (keeping 200 days of data) [2025-09-17T19:07:35.449358] [DEBUG] [LOCAL ] FSM: Primary data saved (53281 records). [2025-09-17T19:07:35.449545] [INFO ] [MAIN ] FSM: Full history saved. [2025-09-17T19:07:35.449715] [INFO ] [MAIN ] Update Progress: 876/2371 symbols completed. FSM took 41.7s. Estimated remaining: 3h 37m 42s. Rate: 6.9 symbols/min [2025-09-17T19:07:35.631232] [INFO ] [MAIN ] FTS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:07:35.628609] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2024-12. [2025-09-17T19:07:35.674938] [DEBUG] [LOCAL ] FTS: Loaded 42229 existing records from primary storage. [2025-09-17T19:07:35.675095] [INFO ] [MAIN ] FTS: Loaded 42229 existing records. [2025-09-17T19:07:35.859588] [WARN ] [MAIN ] FTS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:07:35.871762] [INFO ] [MAIN ] FTS: Wiping existing primary data before full refresh. [2025-09-17T19:07:35.871850] [INFO ] [LOCAL ] FTS: Starting deletion of primary data. [2025-09-17T19:07:35.874823] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T19:07:35.874903] [DEBUG] [LOCAL ] FTS: Deleted primary data file. [2025-09-17T19:07:35.875093] [INFO ] [MAIN ] FTS: Starting full primary refresh. [2025-09-17T19:07:36.147028] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-17T19:07:36.304903] [INFO ] [REMOTE ] FTS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:07:36.415799] [INFO ] [REMOTE ] FTK: Fetching primary data for 2024-12. [2025-09-17T19:07:36.624262] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T19:07:37.215815] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-01. [2025-09-17T19:07:37.355897] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T19:07:38.015817] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-01. [2025-09-17T19:07:38.163998] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T19:07:38.815793] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-02. [2025-09-17T19:07:39.309472] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T19:07:39.572215] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T19:07:39.615770] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-03. [2025-09-17T19:07:40.196005] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T19:07:40.415818] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-04. [2025-09-17T19:07:41.215826] [INFO ] [REMOTE ] FTI: Fetching primary data for 2024-12. [2025-09-17T19:07:41.414283] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T19:07:42.015832] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-02. [2025-09-17T19:07:42.815853] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-05. [2025-09-17T19:07:42.903542] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T19:07:42.950377] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T19:07:43.615809] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-03. [2025-09-17T19:07:43.679289] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T19:07:44.415802] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-06. [2025-09-17T19:07:44.938003] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T19:07:44.946576] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T19:07:45.215798] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-11. [2025-09-17T19:07:46.015781] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-01. [2025-09-17T19:07:46.750341] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T19:07:46.815762] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-04. [2025-09-17T19:07:47.396660] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T19:07:47.495827] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T19:07:47.615821] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-07. [2025-09-17T19:07:48.271617] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T19:07:48.415808] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-08. [2025-09-17T19:07:49.103572] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T19:07:49.215773] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-05. [2025-09-17T19:07:50.015790] [INFO ] [REMOTE ] FTHY: Fetching primary data for 2025-09. [2025-09-17T19:07:50.728812] [INFO ] [REMOTE ] FTHY: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T19:07:50.731509] [INFO ] [REMOTE ] FTHY: Full fetch complete (17645 records). [2025-09-17T19:07:50.731632] [DEBUG] [VALIDATOR ] FTHY: Validating primary data. [2025-09-17T19:07:50.820859] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-02. [2025-09-17T19:07:50.869702] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T19:07:51.186529] [DEBUG] [VALIDATOR ] FTHY: All expected trading days are present. [2025-09-17T19:07:51.186666] [DEBUG] [VALIDATOR ] FTHY: Primary data validation passed. [2025-09-17T19:07:51.187330] [INFO ] [MAIN ] FTHY: Fetched primary data is valid. [2025-09-17T19:07:51.187395] [DEBUG] [LOCAL ] FTHY: Saving primary data. [2025-09-17T19:07:51.188183] [DEBUG] [LOCAL ] FTHY: Trimmed 17645 records to 11739 (keeping 200 days of data) [2025-09-17T19:07:51.282715] [DEBUG] [LOCAL ] FTHY: Primary data saved (11739 records). [2025-09-17T19:07:51.283088] [INFO ] [MAIN ] FTHY: Full history saved. [2025-09-17T19:07:51.283258] [INFO ] [MAIN ] Update Progress: 877/2371 symbols completed. FTHY took 20.4s. Estimated remaining: 3h 37m 45s. Rate: 6.9 symbols/min [2025-09-17T19:07:51.615790] [INFO ] [REMOTE ] FTS: Fetching primary data for 2024-12. [2025-09-17T19:07:52.415779] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-06. [2025-09-17T19:07:53.007768] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-17T19:07:53.095757] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T19:07:53.215790] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-03. [2025-09-17T19:07:54.006971] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T19:07:54.015695] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-07. [2025-09-17T19:07:54.815790] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-01. [2025-09-17T19:07:55.170800] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T19:07:55.501448] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T19:07:55.615760] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-08. [2025-09-17T19:07:56.270959] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T19:07:56.415776] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-02. [2025-09-17T19:07:56.695112] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T19:07:57.215797] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-04. [2025-09-17T19:07:57.831553] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T19:07:58.015835] [INFO ] [REMOTE ] FTK: Fetching primary data for 2025-09. [2025-09-17T19:07:58.815804] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-03. [2025-09-17T19:07:59.100214] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T19:07:59.312986] [INFO ] [REMOTE ] FTK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T19:07:59.317402] [INFO ] [REMOTE ] FTK: Full fetch complete (41948 records). [2025-09-17T19:07:59.317520] [DEBUG] [VALIDATOR ] FTK: Validating primary data. [2025-09-17T19:07:59.620912] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-05. [2025-09-17T19:07:59.699915] [DEBUG] [VALIDATOR ] FTK: All expected trading days are present. [2025-09-17T19:07:59.700024] [DEBUG] [VALIDATOR ] FTK: Primary data validation passed. [2025-09-17T19:07:59.700816] [INFO ] [MAIN ] FTK: Fetched primary data is valid. [2025-09-17T19:07:59.700884] [DEBUG] [LOCAL ] FTK: Saving primary data. [2025-09-17T19:07:59.702194] [DEBUG] [LOCAL ] FTK: Trimmed 41948 records to 31916 (keeping 200 days of data) [2025-09-17T19:07:59.912073] [DEBUG] [LOCAL ] FTK: Primary data saved (31916 records). [2025-09-17T19:07:59.912239] [INFO ] [MAIN ] FTK: Full history saved. [2025-09-17T19:07:59.912353] [INFO ] [MAIN ] Update Progress: 878/2371 symbols completed. FTK took 26.5s. Estimated remaining: 3h 37m 36s. Rate: 6.9 symbols/min [2025-09-17T19:08:00.255087] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T19:08:00.415779] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-04. [2025-09-17T19:08:01.232690] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T19:08:01.246241] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-06. [2025-09-17T19:08:02.100678] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T19:08:02.111482] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-05. [2025-09-17T19:08:02.572091] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T19:08:02.815784] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-07. [2025-09-17T19:08:03.708891] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T19:08:03.718411] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-06. [2025-09-17T19:08:04.877895] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T19:08:04.890280] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-08. [2025-09-17T19:08:04.945782] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T19:08:05.215775] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-07. [2025-09-17T19:08:06.629829] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T19:08:06.639958] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-08. [2025-09-17T19:08:06.706329] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T19:08:06.815721] [INFO ] [REMOTE ] FTI: Fetching primary data for 2025-09. [2025-09-17T19:08:08.209285] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T19:08:08.218425] [INFO ] [REMOTE ] FTS: Fetching primary data for 2025-09. [2025-09-17T19:08:08.681000] [INFO ] [REMOTE ] FTI: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T19:08:08.687983] [INFO ] [REMOTE ] FTI: Full fetch complete (76953 records). [2025-09-17T19:08:08.688123] [DEBUG] [VALIDATOR ] FTI: Validating primary data. [2025-09-17T19:08:09.075628] [DEBUG] [VALIDATOR ] FTI: All expected trading days are present. [2025-09-17T19:08:09.075724] [DEBUG] [VALIDATOR ] FTI: Primary data validation passed. [2025-09-17T19:08:09.076586] [INFO ] [MAIN ] FTI: Fetched primary data is valid. [2025-09-17T19:08:09.076628] [DEBUG] [LOCAL ] FTI: Saving primary data. [2025-09-17T19:08:09.078064] [DEBUG] [LOCAL ] FTI: Trimmed 76953 records to 53305 (keeping 200 days of data) [2025-09-17T19:08:09.412390] [DEBUG] [LOCAL ] FTI: Primary data saved (53305 records). [2025-09-17T19:08:09.412697] [INFO ] [MAIN ] FTI: Full history saved. [2025-09-17T19:08:09.413526] [INFO ] [MAIN ] Update Progress: 879/2371 symbols completed. FTI took 37.1s. Estimated remaining: 3h 37m 29s. Rate: 6.9 symbols/min [2025-09-17T19:08:09.437740] [INFO ] [REMOTE ] FTS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T19:08:09.443489] [INFO ] [REMOTE ] FTS: Full fetch complete (59961 records). [2025-09-17T19:08:09.443592] [DEBUG] [VALIDATOR ] FTS: Validating primary data. [2025-09-17T19:08:09.830529] [DEBUG] [VALIDATOR ] FTS: All expected trading days are present. [2025-09-17T19:08:09.830611] [DEBUG] [VALIDATOR ] FTS: Primary data validation passed. [2025-09-17T19:08:09.831369] [INFO ] [MAIN ] FTS: Fetched primary data is valid. [2025-09-17T19:08:09.831412] [DEBUG] [LOCAL ] FTS: Saving primary data. [2025-09-17T19:08:09.832916] [DEBUG] [LOCAL ] FTS: Trimmed 59961 records to 42176 (keeping 200 days of data) [2025-09-17T19:08:10.093158] [DEBUG] [LOCAL ] FTS: Primary data saved (42176 records). [2025-09-17T19:08:10.093286] [INFO ] [MAIN ] FTS: Full history saved. [2025-09-17T19:08:10.093376] [INFO ] [MAIN ] Update Progress: 880/2371 symbols completed. FTS took 34.6s. Estimated remaining: 3h 37m 6s. Rate: 6.9 symbols/min [2025-09-17T19:08:10.714887] [INFO ] [MAIN ] FTV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:08:10.759571] [INFO ] [MAIN ] FUBO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:08:10.779249] [INFO ] [MAIN ] FTWO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:08:10.797721] [INFO ] [MAIN ] FUL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:08:10.805006] [DEBUG] [LOCAL ] FTWO: Loaded 1789 existing records from primary storage. [2025-09-17T19:08:10.805379] [INFO ] [MAIN ] FTWO: Loaded 1789 existing records. [2025-09-17T19:08:11.079242] [DEBUG] [LOCAL ] FUL: Loaded 32927 existing records from primary storage. [2025-09-17T19:08:11.079026] [WARN ] [MAIN ] FTWO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:08:11.079766] [INFO ] [MAIN ] FUL: Loaded 32927 existing records. [2025-09-17T19:08:11.085077] [INFO ] [MAIN ] FTWO: Wiping existing primary data before full refresh. [2025-09-17T19:08:11.116627] [INFO ] [LOCAL ] FTWO: Starting deletion of primary data. [2025-09-17T19:08:11.105879] [DEBUG] [LOCAL ] FUBO: Loaded 53700 existing records from primary storage. [2025-09-17T19:08:11.138557] [INFO ] [MAIN ] FUBO: Loaded 53700 existing records. [2025-09-17T19:08:11.138445] [DEBUG] [LOCAL ] FTWO: Deleted primary data file. [2025-09-17T19:08:11.166268] [DEBUG] [LOCAL ] FTV: Loaded 52888 existing records from primary storage. [2025-09-17T19:08:11.143859] [INFO ] [MAIN ] FTWO: Starting full primary refresh. [2025-09-17T19:08:11.206212] [INFO ] [MAIN ] FTV: Loaded 52888 existing records. [2025-09-17T19:08:11.737930] [WARN ] [MAIN ] FUL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:08:11.775430] [WARN ] [MAIN ] FUBO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:08:11.789928] [INFO ] [MAIN ] FUBO: Wiping existing primary data before full refresh. [2025-09-17T19:08:11.789867] [WARN ] [MAIN ] FTV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:08:11.810242] [INFO ] [MAIN ] FUL: Wiping existing primary data before full refresh. [2025-09-17T19:08:11.821600] [INFO ] [LOCAL ] FUBO: Starting deletion of primary data. [2025-09-17T19:08:11.821504] [INFO ] [LOCAL ] FUL: Starting deletion of primary data. [2025-09-17T19:08:11.829312] [INFO ] [MAIN ] FTV: Wiping existing primary data before full refresh. [2025-09-17T19:08:11.831255] [INFO ] [LOCAL ] FTV: Starting deletion of primary data. [2025-09-17T19:08:11.832480] [DEBUG] [LOCAL ] FUL: Deleted primary data file. [2025-09-17T19:08:11.832936] [DEBUG] [LOCAL ] FUBO: Deleted primary data file. [2025-09-17T19:08:11.833065] [INFO ] [MAIN ] FUL: Starting full primary refresh. [2025-09-17T19:08:11.848065] [INFO ] [MAIN ] FUBO: Starting full primary refresh. [2025-09-17T19:08:11.853235] [DEBUG] [LOCAL ] FTV: Deleted primary data file. [2025-09-17T19:08:11.908040] [INFO ] [MAIN ] FTV: Starting full primary refresh. [2025-09-17T19:08:12.593287] [INFO ] [REMOTE ] FTWO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:08:12.618851] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-11. [2025-09-17T19:08:13.046738] [INFO ] [REMOTE ] FUL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:08:13.062997] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-11. [2025-09-17T19:08:13.140170] [INFO ] [REMOTE ] FUBO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:08:13.174887] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-11. [2025-09-17T19:08:13.201896] [INFO ] [REMOTE ] FTV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:08:13.202442] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-11. [2025-09-17T19:08:13.282358] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T19:08:13.284132] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2024-12. [2025-09-17T19:08:13.851984] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T19:08:13.853607] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-01. [2025-09-17T19:08:14.101432] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T19:08:14.106775] [INFO ] [REMOTE ] FUL: Fetching primary data for 2024-12. [2025-09-17T19:08:14.508946] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T19:08:14.511402] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-02. [2025-09-17T19:08:14.881961] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T19:08:14.892318] [INFO ] [REMOTE ] FTV: Fetching primary data for 2024-12. [2025-09-17T19:08:14.902681] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-17T19:08:15.029958] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T19:08:15.249157] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T19:08:15.615784] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2024-12. [2025-09-17T19:08:16.415786] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-01. [2025-09-17T19:08:16.535342] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T19:08:17.215793] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-01. [2025-09-17T19:08:17.449712] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T19:08:17.770730] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-17T19:08:18.015822] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-03. [2025-09-17T19:08:18.511219] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T19:08:18.815794] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-01. [2025-09-17T19:08:19.047995] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T19:08:19.615777] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-04. [2025-09-17T19:08:20.038691] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T19:08:20.415807] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-02. [2025-09-17T19:08:21.215794] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-02. [2025-09-17T19:08:21.465147] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-17T19:08:22.015795] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-05. [2025-09-17T19:08:22.177246] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T19:08:22.278828] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-17T19:08:22.815840] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-03. [2025-09-17T19:08:22.873513] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T19:08:23.615822] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-06. [2025-09-17T19:08:23.932548] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T19:08:24.415779] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-07. [2025-09-17T19:08:24.858014] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T19:08:25.080851] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-17T19:08:25.215820] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-02. [2025-09-17T19:08:26.015768] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-08. [2025-09-17T19:08:26.455714] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T19:08:26.815852] [INFO ] [REMOTE ] FTWO: Fetching primary data for 2025-09. [2025-09-17T19:08:27.175954] [INFO ] [REMOTE ] FTWO: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T19:08:27.177289] [INFO ] [REMOTE ] FTWO: Full fetch complete (3513 records). [2025-09-17T19:08:27.177439] [DEBUG] [VALIDATOR ] FTWO: Validating primary data. [2025-09-17T19:08:27.295869] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T19:08:27.619165] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-03. [2025-09-17T19:08:27.647153] [DEBUG] [VALIDATOR ] FTWO: All expected trading days are present. [2025-09-17T19:08:27.647222] [DEBUG] [VALIDATOR ] FTWO: Primary data validation passed. [2025-09-17T19:08:27.647348] [INFO ] [MAIN ] FTWO: Fetched primary data is valid. [2025-09-17T19:08:27.647386] [DEBUG] [LOCAL ] FTWO: Saving primary data. [2025-09-17T19:08:27.647773] [DEBUG] [LOCAL ] FTWO: Trimmed 3513 records to 1788 (keeping 200 days of data) [2025-09-17T19:08:27.659940] [DEBUG] [LOCAL ] FTWO: Primary data saved (1788 records). [2025-09-17T19:08:27.660001] [INFO ] [MAIN ] FTWO: Full history saved. [2025-09-17T19:08:27.660072] [INFO ] [MAIN ] Update Progress: 881/2371 symbols completed. FTWO took 17.6s. Estimated remaining: 3h 37m 12s. Rate: 6.9 symbols/min [2025-09-17T19:08:27.833314] [INFO ] [MAIN ] FUN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:08:27.884505] [DEBUG] [LOCAL ] FUN: Loaded 51532 existing records from primary storage. [2025-09-17T19:08:27.884673] [INFO ] [MAIN ] FUN: Loaded 51532 existing records. [2025-09-17T19:08:28.060635] [WARN ] [MAIN ] FUN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:08:28.060889] [INFO ] [MAIN ] FUN: Wiping existing primary data before full refresh. [2025-09-17T19:08:28.060933] [INFO ] [LOCAL ] FUN: Starting deletion of primary data. [2025-09-17T19:08:28.062004] [DEBUG] [LOCAL ] FUN: Deleted primary data file. [2025-09-17T19:08:28.062054] [INFO ] [MAIN ] FUN: Starting full primary refresh. [2025-09-17T19:08:28.416953] [INFO ] [REMOTE ] FUN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:08:28.417118] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-04. [2025-09-17T19:08:29.189084] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T19:08:29.215721] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-04. [2025-09-17T19:08:30.015801] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-11. [2025-09-17T19:08:30.217025] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T19:08:30.734937] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T19:08:30.815735] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-05. [2025-09-17T19:08:31.215463] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T19:08:31.615752] [INFO ] [REMOTE ] FUN: Fetching primary data for 2024-12. [2025-09-17T19:08:31.781567] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T19:08:32.415796] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-06. [2025-09-17T19:08:32.909828] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T19:08:33.215829] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-03. [2025-09-17T19:08:33.388808] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T19:08:34.015808] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-07. [2025-09-17T19:08:34.815805] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-05. [2025-09-17T19:08:35.103230] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T19:08:35.406686] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-17T19:08:35.615798] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-01. [2025-09-17T19:08:36.415822] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-04. [2025-09-17T19:08:36.625547] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T19:08:36.665666] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T19:08:37.215810] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-02. [2025-09-17T19:08:38.015817] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-08. [2025-09-17T19:08:38.298601] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T19:08:38.782600] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T19:08:38.815732] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-03. [2025-09-17T19:08:39.066513] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T19:08:39.615785] [INFO ] [REMOTE ] FUL: Fetching primary data for 2025-09. [2025-09-17T19:08:40.415698] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-06. [2025-09-17T19:08:40.535471] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T19:08:40.701858] [INFO ] [REMOTE ] FUL: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T19:08:40.708807] [INFO ] [REMOTE ] FUL: Full fetch complete (46318 records). [2025-09-17T19:08:40.708960] [DEBUG] [VALIDATOR ] FUL: Validating primary data. [2025-09-17T19:08:41.103259] [DEBUG] [VALIDATOR ] FUL: All expected trading days are present. [2025-09-17T19:08:41.103351] [DEBUG] [VALIDATOR ] FUL: Primary data validation passed. [2025-09-17T19:08:41.104151] [INFO ] [MAIN ] FUL: Fetched primary data is valid. [2025-09-17T19:08:41.104207] [DEBUG] [LOCAL ] FUL: Saving primary data. [2025-09-17T19:08:41.105412] [DEBUG] [LOCAL ] FUL: Trimmed 46318 records to 33020 (keeping 200 days of data) [2025-09-17T19:08:41.220509] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-05. [2025-09-17T19:08:41.318615] [DEBUG] [LOCAL ] FUL: Primary data saved (33020 records). [2025-09-17T19:08:41.318792] [INFO ] [MAIN ] FUL: Full history saved. [2025-09-17T19:08:41.318909] [INFO ] [MAIN ] Update Progress: 882/2371 symbols completed. FUL took 31.2s. Estimated remaining: 3h 37m 12s. Rate: 6.9 symbols/min [2025-09-17T19:08:41.488330] [INFO ] [MAIN ] FVR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:08:41.510353] [DEBUG] [LOCAL ] FVR: Loaded 21906 existing records from primary storage. [2025-09-17T19:08:41.510494] [INFO ] [MAIN ] FVR: Loaded 21906 existing records. [2025-09-17T19:08:41.687228] [WARN ] [MAIN ] FVR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:08:41.687484] [INFO ] [MAIN ] FVR: Wiping existing primary data before full refresh. [2025-09-17T19:08:41.687528] [INFO ] [LOCAL ] FVR: Starting deletion of primary data. [2025-09-17T19:08:41.688050] [DEBUG] [LOCAL ] FVR: Deleted primary data file. [2025-09-17T19:08:41.688098] [INFO ] [MAIN ] FVR: Starting full primary refresh. [2025-09-17T19:08:42.025812] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-04. [2025-09-17T19:08:42.047522] [INFO ] [REMOTE ] FVR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:08:42.183826] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T19:08:42.815774] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-11. [2025-09-17T19:08:43.185329] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T19:08:43.274165] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T19:08:43.615775] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-05. [2025-09-17T19:08:43.758604] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T19:08:44.415780] [INFO ] [REMOTE ] FVR: Fetching primary data for 2024-12. [2025-09-17T19:08:45.215789] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-07. [2025-09-17T19:08:45.635431] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T19:08:45.687632] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T19:08:46.015799] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-01. [2025-09-17T19:08:46.790543] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T19:08:46.815674] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-02. [2025-09-17T19:08:47.036882] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T19:08:47.475084] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T19:08:47.615839] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-06. [2025-09-17T19:08:48.415789] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-08. [2025-09-17T19:08:49.215764] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-03. [2025-09-17T19:08:49.700410] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-06 (2.08 seconds). [2025-09-17T19:08:50.015741] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-07. [2025-09-17T19:08:50.129252] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T19:08:50.379240] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T19:08:50.815796] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-04. [2025-09-17T19:08:51.611049] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T19:08:51.615792] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-05. [2025-09-17T19:08:52.302186] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-17T19:08:52.415738] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-08. [2025-09-17T19:08:52.462823] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T19:08:53.215799] [INFO ] [REMOTE ] FTV: Fetching primary data for 2025-09. [2025-09-17T19:08:54.015772] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-06. [2025-09-17T19:08:54.331707] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T19:08:54.815827] [INFO ] [REMOTE ] FUBO: Fetching primary data for 2025-09. [2025-09-17T19:08:55.105458] [INFO ] [REMOTE ] FTV: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-17T19:08:55.112339] [INFO ] [REMOTE ] FTV: Full fetch complete (76042 records). [2025-09-17T19:08:55.112477] [DEBUG] [VALIDATOR ] FTV: Validating primary data. [2025-09-17T19:08:55.532000] [DEBUG] [VALIDATOR ] FTV: All expected trading days are present. [2025-09-17T19:08:55.532097] [DEBUG] [VALIDATOR ] FTV: Primary data validation passed. [2025-09-17T19:08:55.533044] [INFO ] [MAIN ] FTV: Fetched primary data is valid. [2025-09-17T19:08:55.533110] [DEBUG] [LOCAL ] FTV: Saving primary data. [2025-09-17T19:08:55.534877] [DEBUG] [LOCAL ] FTV: Trimmed 76042 records to 52896 (keeping 200 days of data) [2025-09-17T19:08:55.628139] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-06. [2025-09-17T19:08:55.696455] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T19:08:55.924346] [DEBUG] [LOCAL ] FTV: Primary data saved (52896 records). [2025-09-17T19:08:55.924506] [INFO ] [MAIN ] FTV: Full history saved. [2025-09-17T19:08:55.924597] [INFO ] [MAIN ] Update Progress: 883/2371 symbols completed. FTV took 45.8s. Estimated remaining: 3h 37m 13s. Rate: 6.9 symbols/min [2025-09-17T19:08:56.097577] [INFO ] [MAIN ] FVRR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:08:56.135497] [DEBUG] [LOCAL ] FVRR: Loaded 40162 existing records from primary storage. [2025-09-17T19:08:56.135689] [INFO ] [MAIN ] FVRR: Loaded 40162 existing records. [2025-09-17T19:08:56.312123] [WARN ] [MAIN ] FVRR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:08:56.312398] [INFO ] [MAIN ] FVRR: Wiping existing primary data before full refresh. [2025-09-17T19:08:56.312445] [INFO ] [LOCAL ] FVRR: Starting deletion of primary data. [2025-09-17T19:08:56.313251] [DEBUG] [LOCAL ] FVRR: Deleted primary data file. [2025-09-17T19:08:56.313299] [INFO ] [MAIN ] FVRR: Starting full primary refresh. [2025-09-17T19:08:56.420956] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-07. [2025-09-17T19:08:56.681580] [INFO ] [REMOTE ] FVRR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:08:56.700075] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T19:08:57.220853] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-11. [2025-09-17T19:08:57.232237] [INFO ] [REMOTE ] FUBO: Incremental fetch complete for 2025-09 (2.42 seconds). [2025-09-17T19:08:57.239407] [INFO ] [REMOTE ] FUBO: Full fetch complete (77690 records). [2025-09-17T19:08:57.239514] [DEBUG] [VALIDATOR ] FUBO: Validating primary data. [2025-09-17T19:08:57.636865] [DEBUG] [VALIDATOR ] FUBO: All expected trading days are present. [2025-09-17T19:08:57.636975] [DEBUG] [VALIDATOR ] FUBO: Primary data validation passed. [2025-09-17T19:08:57.637997] [INFO ] [MAIN ] FUBO: Fetched primary data is valid. [2025-09-17T19:08:57.638050] [DEBUG] [LOCAL ] FUBO: Saving primary data. [2025-09-17T19:08:57.639673] [DEBUG] [LOCAL ] FUBO: Trimmed 77690 records to 53699 (keeping 200 days of data) [2025-09-17T19:08:57.997031] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T19:08:58.012937] [DEBUG] [LOCAL ] FUBO: Primary data saved (53699 records). [2025-09-17T19:08:58.013503] [INFO ] [MAIN ] FUBO: Full history saved. [2025-09-17T19:08:58.014219] [INFO ] [MAIN ] Update Progress: 884/2371 symbols completed. FUBO took 47.9s. Estimated remaining: 3h 36m 53s. Rate: 6.9 symbols/min [2025-09-17T19:08:58.026437] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-07. [2025-09-17T19:08:58.226977] [INFO ] [MAIN ] FXED: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:08:58.230192] [DEBUG] [LOCAL ] FXED: Loaded 1193 existing records from primary storage. [2025-09-17T19:08:58.230266] [INFO ] [MAIN ] FXED: Loaded 1193 existing records. [2025-09-17T19:08:58.412672] [WARN ] [MAIN ] FXED: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:08:58.412954] [INFO ] [MAIN ] FXED: Wiping existing primary data before full refresh. [2025-09-17T19:08:58.413002] [INFO ] [LOCAL ] FXED: Starting deletion of primary data. [2025-09-17T19:08:58.413263] [DEBUG] [LOCAL ] FXED: Deleted primary data file. [2025-09-17T19:08:58.413308] [INFO ] [MAIN ] FXED: Starting full primary refresh. [2025-09-17T19:08:58.767500] [INFO ] [REMOTE ] FXED: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:08:58.795098] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T19:08:58.815734] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-11. [2025-09-17T19:08:59.182075] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T19:08:59.375783] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T19:08:59.615786] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2024-12. [2025-09-17T19:09:00.415784] [INFO ] [REMOTE ] FXED: Fetching primary data for 2024-12. [2025-09-17T19:09:00.730735] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2024-12 (0.31 seconds). [2025-09-17T19:09:01.181995] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T19:09:01.215728] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-01. [2025-09-17T19:09:02.015815] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-08. [2025-09-17T19:09:02.815882] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-01. [2025-09-17T19:09:03.615833] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-08. [2025-09-17T19:09:03.810436] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T19:09:03.877527] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-09-17T19:09:04.254877] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-17T19:09:04.415794] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-02. [2025-09-17T19:09:05.215804] [INFO ] [REMOTE ] FVR: Fetching primary data for 2025-09. [2025-09-17T19:09:05.552970] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T19:09:06.019041] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-02. [2025-09-17T19:09:06.024874] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T19:09:06.293776] [INFO ] [REMOTE ] FVR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T19:09:06.296603] [INFO ] [REMOTE ] FVR: Full fetch complete (30693 records). [2025-09-17T19:09:06.296731] [DEBUG] [VALIDATOR ] FVR: Validating primary data. [2025-09-17T19:09:06.421998] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T19:09:06.695970] [DEBUG] [VALIDATOR ] FVR: All expected trading days are present. [2025-09-17T19:09:06.696073] [DEBUG] [VALIDATOR ] FVR: Primary data validation passed. [2025-09-17T19:09:06.696683] [INFO ] [MAIN ] FVR: Fetched primary data is valid. [2025-09-17T19:09:06.696730] [DEBUG] [LOCAL ] FVR: Saving primary data. [2025-09-17T19:09:06.697730] [DEBUG] [LOCAL ] FVR: Trimmed 30693 records to 21936 (keeping 200 days of data) [2025-09-17T19:09:06.822032] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-03. [2025-09-17T19:09:06.834617] [DEBUG] [LOCAL ] FVR: Primary data saved (21936 records). [2025-09-17T19:09:06.834779] [INFO ] [MAIN ] FVR: Full history saved. [2025-09-17T19:09:06.834888] [INFO ] [MAIN ] Update Progress: 885/2371 symbols completed. FVR took 25.5s. Estimated remaining: 3h 36m 45s. Rate: 6.9 symbols/min [2025-09-17T19:09:07.006525] [INFO ] [MAIN ] G: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:09:07.053237] [DEBUG] [LOCAL ] G: Loaded 49760 existing records from primary storage. [2025-09-17T19:09:07.053423] [INFO ] [MAIN ] G: Loaded 49760 existing records. [2025-09-17T19:09:07.243114] [WARN ] [MAIN ] G: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:09:07.243337] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T19:09:07.245165] [INFO ] [MAIN ] G: Wiping existing primary data before full refresh. [2025-09-17T19:09:07.245280] [INFO ] [LOCAL ] G: Starting deletion of primary data. [2025-09-17T19:09:07.246359] [DEBUG] [LOCAL ] G: Deleted primary data file. [2025-09-17T19:09:07.246418] [INFO ] [MAIN ] G: Starting full primary refresh. [2025-09-17T19:09:07.614237] [INFO ] [REMOTE ] G: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:09:07.615733] [INFO ] [REMOTE ] G: Fetching primary data for 2024-11. [2025-09-17T19:09:08.415794] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-04. [2025-09-17T19:09:08.765524] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-17T19:09:09.177673] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T19:09:09.215733] [INFO ] [REMOTE ] G: Fetching primary data for 2024-12. [2025-09-17T19:09:10.015843] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-03. [2025-09-17T19:09:10.495236] [INFO ] [REMOTE ] G: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T19:09:10.815845] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-05. [2025-09-17T19:09:11.149277] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T19:09:11.615795] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-06. [2025-09-17T19:09:11.645873] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T19:09:11.913798] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-17T19:09:12.415795] [INFO ] [REMOTE ] G: Fetching primary data for 2025-01. [2025-09-17T19:09:13.215832] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-04. [2025-09-17T19:09:14.015782] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-07. [2025-09-17T19:09:14.272531] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T19:09:14.815901] [INFO ] [REMOTE ] FUN: Fetching primary data for 2025-09. [2025-09-17T19:09:15.320038] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T19:09:15.397532] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-17T19:09:15.615789] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-08. [2025-09-17T19:09:15.980367] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-17T19:09:16.415829] [INFO ] [REMOTE ] FXED: Fetching primary data for 2025-09. [2025-09-17T19:09:16.832213] [INFO ] [REMOTE ] FXED: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T19:09:16.832967] [INFO ] [REMOTE ] FXED: Full fetch complete (1754 records). [2025-09-17T19:09:16.833033] [DEBUG] [VALIDATOR ] FXED: Validating primary data. [2025-09-17T19:09:17.191121] [DEBUG] [VALIDATOR ] FXED: All expected trading days are present. [2025-09-17T19:09:17.191301] [DEBUG] [VALIDATOR ] FXED: Primary data validation passed. [2025-09-17T19:09:17.191515] [INFO ] [MAIN ] FXED: Fetched primary data is valid. [2025-09-17T19:09:17.191597] [DEBUG] [LOCAL ] FXED: Saving primary data. [2025-09-17T19:09:17.192013] [DEBUG] [LOCAL ] FXED: Trimmed 1754 records to 1206 (keeping 200 days of data) [2025-09-17T19:09:17.218168] [DEBUG] [LOCAL ] FXED: Primary data saved (1206 records). [2025-09-17T19:09:17.218401] [INFO ] [MAIN ] FXED: Full history saved. [2025-09-17T19:09:17.218268] [INFO ] [REMOTE ] G: Fetching primary data for 2025-02. [2025-09-17T19:09:17.218663] [INFO ] [MAIN ] Update Progress: 886/2371 symbols completed. FXED took 19.2s. Estimated remaining: 3h 36m 38s. Rate: 6.9 symbols/min [2025-09-17T19:09:17.259725] [INFO ] [REMOTE ] FUN: Incremental fetch complete for 2025-09 (2.44 seconds). [2025-09-17T19:09:17.336231] [INFO ] [REMOTE ] FUN: Full fetch complete (71940 records). [2025-09-17T19:09:17.341925] [DEBUG] [VALIDATOR ] FUN: Validating primary data. [2025-09-17T19:09:17.481150] [INFO ] [MAIN ] GAB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:09:17.756553] [DEBUG] [LOCAL ] GAB: Loaded 27670 existing records from primary storage. [2025-09-17T19:09:17.788145] [INFO ] [MAIN ] GAB: Loaded 27670 existing records. [2025-09-17T19:09:17.907269] [DEBUG] [VALIDATOR ] FUN: All expected trading days are present. [2025-09-17T19:09:17.928765] [DEBUG] [VALIDATOR ] FUN: Primary data validation passed. [2025-09-17T19:09:17.929777] [INFO ] [MAIN ] FUN: Fetched primary data is valid. [2025-09-17T19:09:17.935490] [DEBUG] [LOCAL ] FUN: Saving primary data. [2025-09-17T19:09:18.013462] [WARN ] [MAIN ] GAB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:09:18.013952] [INFO ] [MAIN ] GAB: Wiping existing primary data before full refresh. [2025-09-17T19:09:18.014042] [INFO ] [LOCAL ] GAB: Starting deletion of primary data. [2025-09-17T19:09:18.014132] [DEBUG] [LOCAL ] FUN: Trimmed 71940 records to 51534 (keeping 200 days of data) [2025-09-17T19:09:18.015123] [DEBUG] [LOCAL ] GAB: Deleted primary data file. [2025-09-17T19:09:18.015183] [INFO ] [MAIN ] GAB: Starting full primary refresh. [2025-09-17T19:09:18.026722] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-05. [2025-09-17T19:09:18.493884] [INFO ] [REMOTE ] GAB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:09:18.715491] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T19:09:18.738631] [DEBUG] [LOCAL ] FUN: Primary data saved (51534 records). [2025-09-17T19:09:18.739354] [INFO ] [MAIN ] FUN: Full history saved. [2025-09-17T19:09:18.739463] [INFO ] [MAIN ] Update Progress: 887/2371 symbols completed. FUN took 51.1s. Estimated remaining: 3h 36m 18s. Rate: 6.9 symbols/min [2025-09-17T19:09:18.821023] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-11. [2025-09-17T19:09:18.914333] [INFO ] [MAIN ] GAM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:09:18.920814] [DEBUG] [LOCAL ] GAM: Loaded 4400 existing records from primary storage. [2025-09-17T19:09:18.920942] [INFO ] [MAIN ] GAM: Loaded 4400 existing records. [2025-09-17T19:09:19.137442] [WARN ] [MAIN ] GAM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:09:19.137817] [INFO ] [MAIN ] GAM: Wiping existing primary data before full refresh. [2025-09-17T19:09:19.137887] [INFO ] [LOCAL ] GAM: Starting deletion of primary data. [2025-09-17T19:09:19.138196] [DEBUG] [LOCAL ] GAM: Deleted primary data file. [2025-09-17T19:09:19.138269] [INFO ] [MAIN ] GAM: Starting full primary refresh. [2025-09-17T19:09:19.621693] [INFO ] [REMOTE ] G: Fetching primary data for 2025-03. [2025-09-17T19:09:19.634394] [INFO ] [REMOTE ] GAM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:09:19.695242] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T19:09:19.979550] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T19:09:20.415783] [INFO ] [REMOTE ] GAB: Fetching primary data for 2024-12. [2025-09-17T19:09:21.215761] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-11. [2025-09-17T19:09:21.360813] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T19:09:21.529861] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T19:09:21.643450] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T19:09:22.015779] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-01. [2025-09-17T19:09:22.815836] [INFO ] [REMOTE ] GAM: Fetching primary data for 2024-12. [2025-09-17T19:09:23.239488] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T19:09:23.366124] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T19:09:23.615771] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-02. [2025-09-17T19:09:24.415778] [INFO ] [REMOTE ] G: Fetching primary data for 2025-04. [2025-09-17T19:09:24.645416] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T19:09:25.215788] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-03. [2025-09-17T19:09:26.015694] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-01. [2025-09-17T19:09:26.180575] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T19:09:26.681951] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T19:09:26.745276] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T19:09:26.815780] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-06. [2025-09-17T19:09:27.615776] [INFO ] [REMOTE ] G: Fetching primary data for 2025-05. [2025-09-17T19:09:28.185945] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T19:09:28.415848] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-02. [2025-09-17T19:09:29.082403] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T19:09:29.215773] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-07. [2025-09-17T19:09:29.318381] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T19:09:30.015807] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-04. [2025-09-17T19:09:30.575734] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T19:09:30.815775] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-08. [2025-09-17T19:09:31.414746] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T19:09:31.615822] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-05. [2025-09-17T19:09:32.415744] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-03. [2025-09-17T19:09:32.469575] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T19:09:32.584195] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T19:09:33.038319] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T19:09:33.215810] [INFO ] [REMOTE ] FVRR: Fetching primary data for 2025-09. [2025-09-17T19:09:34.015801] [INFO ] [REMOTE ] G: Fetching primary data for 2025-06. [2025-09-17T19:09:34.519349] [INFO ] [REMOTE ] FVRR: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T19:09:34.525269] [INFO ] [REMOTE ] FVRR: Full fetch complete (58726 records). [2025-09-17T19:09:34.525434] [DEBUG] [VALIDATOR ] FVRR: Validating primary data. [2025-09-17T19:09:34.820943] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-06. [2025-09-17T19:09:34.932447] [DEBUG] [VALIDATOR ] FVRR: All expected trading days are present. [2025-09-17T19:09:34.932546] [DEBUG] [VALIDATOR ] FVRR: Primary data validation passed. [2025-09-17T19:09:34.933372] [INFO ] [MAIN ] FVRR: Fetched primary data is valid. [2025-09-17T19:09:34.933434] [DEBUG] [LOCAL ] FVRR: Saving primary data. [2025-09-17T19:09:34.934973] [DEBUG] [LOCAL ] FVRR: Trimmed 58726 records to 40164 (keeping 200 days of data) [2025-09-17T19:09:35.172692] [DEBUG] [LOCAL ] FVRR: Primary data saved (40164 records). [2025-09-17T19:09:35.172819] [INFO ] [MAIN ] FVRR: Full history saved. [2025-09-17T19:09:35.172906] [INFO ] [MAIN ] Update Progress: 888/2371 symbols completed. FVRR took 39.2s. Estimated remaining: 3h 36m 22s. Rate: 6.9 symbols/min [2025-09-17T19:09:35.343342] [INFO ] [MAIN ] GAP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:09:35.394067] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-17T19:09:35.394214] [INFO ] [MAIN ] GAP: Loaded 53655 existing records. [2025-09-17T19:09:35.575715] [WARN ] [MAIN ] GAP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:09:35.575994] [INFO ] [MAIN ] GAP: Wiping existing primary data before full refresh. [2025-09-17T19:09:35.576053] [INFO ] [LOCAL ] GAP: Starting deletion of primary data. [2025-09-17T19:09:35.577491] [DEBUG] [LOCAL ] GAP: Deleted primary data file. [2025-09-17T19:09:35.577551] [INFO ] [MAIN ] GAP: Starting full primary refresh. [2025-09-17T19:09:35.620108] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-04. [2025-09-17T19:09:35.899630] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T19:09:35.982456] [INFO ] [REMOTE ] GAP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:09:36.127120] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T19:09:36.341978] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T19:09:36.415835] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-11. [2025-09-17T19:09:37.215785] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-05. [2025-09-17T19:09:37.797158] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T19:09:38.015782] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-06. [2025-09-17T19:09:38.376361] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T19:09:38.570430] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T19:09:38.815885] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-07. [2025-09-17T19:09:39.540817] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T19:09:39.615878] [INFO ] [REMOTE ] GAP: Fetching primary data for 2024-12. [2025-09-17T19:09:40.415880] [INFO ] [REMOTE ] G: Fetching primary data for 2025-07. [2025-09-17T19:09:41.215850] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-07. [2025-09-17T19:09:41.359780] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T19:09:42.015811] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-08. [2025-09-17T19:09:42.098167] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T19:09:42.390998] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T19:09:42.588722] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T19:09:42.815786] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-01. [2025-09-17T19:09:43.615828] [INFO ] [REMOTE ] G: Fetching primary data for 2025-08. [2025-09-17T19:09:44.415785] [INFO ] [REMOTE ] GAM: Fetching primary data for 2025-09. [2025-09-17T19:09:44.658363] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T19:09:45.177596] [INFO ] [REMOTE ] GAM: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T19:09:45.178592] [INFO ] [REMOTE ] GAM: Full fetch complete (6985 records). [2025-09-17T19:09:45.178692] [DEBUG] [VALIDATOR ] GAM: Validating primary data. [2025-09-17T19:09:45.221042] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-08. [2025-09-17T19:09:45.588224] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T19:09:45.586501] [DEBUG] [VALIDATOR ] GAM: All expected trading days are present. [2025-09-17T19:09:45.598124] [DEBUG] [VALIDATOR ] GAM: Primary data validation passed. [2025-09-17T19:09:45.598541] [INFO ] [MAIN ] GAM: Fetched primary data is valid. [2025-09-17T19:09:45.598829] [DEBUG] [LOCAL ] GAM: Saving primary data. [2025-09-17T19:09:45.599438] [DEBUG] [LOCAL ] GAM: Trimmed 6985 records to 4375 (keeping 200 days of data) [2025-09-17T19:09:45.626272] [DEBUG] [LOCAL ] GAM: Primary data saved (4375 records). [2025-09-17T19:09:45.626406] [INFO ] [MAIN ] GAM: Full history saved. [2025-09-17T19:09:45.626494] [INFO ] [MAIN ] Update Progress: 889/2371 symbols completed. GAM took 26.9s. Estimated remaining: 3h 36m 16s. Rate: 6.9 symbols/min [2025-09-17T19:09:45.797288] [INFO ] [MAIN ] GATX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:09:45.817178] [DEBUG] [LOCAL ] GATX: Loaded 17895 existing records from primary storage. [2025-09-17T19:09:45.817326] [INFO ] [MAIN ] GATX: Loaded 17895 existing records. [2025-09-17T19:09:45.999609] [WARN ] [MAIN ] GATX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:09:45.999925] [INFO ] [MAIN ] GATX: Wiping existing primary data before full refresh. [2025-09-17T19:09:45.999973] [INFO ] [LOCAL ] GATX: Starting deletion of primary data. [2025-09-17T19:09:46.000596] [DEBUG] [LOCAL ] GATX: Deleted primary data file. [2025-09-17T19:09:46.000694] [INFO ] [MAIN ] GATX: Starting full primary refresh. [2025-09-17T19:09:46.022173] [INFO ] [REMOTE ] G: Fetching primary data for 2025-09. [2025-09-17T19:09:46.369613] [INFO ] [REMOTE ] GATX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:09:46.389552] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T19:09:46.815845] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-02. [2025-09-17T19:09:47.624512] [INFO ] [REMOTE ] GAB: Fetching primary data for 2025-09. [2025-09-17T19:09:47.627691] [INFO ] [REMOTE ] G: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T19:09:47.636850] [INFO ] [REMOTE ] G: Full fetch complete (71352 records). [2025-09-17T19:09:47.637106] [DEBUG] [VALIDATOR ] G: Validating primary data. [2025-09-17T19:09:48.036463] [DEBUG] [VALIDATOR ] G: All expected trading days are present. [2025-09-17T19:09:48.036553] [DEBUG] [VALIDATOR ] G: Primary data validation passed. [2025-09-17T19:09:48.037449] [INFO ] [MAIN ] G: Fetched primary data is valid. [2025-09-17T19:09:48.037498] [DEBUG] [LOCAL ] G: Saving primary data. [2025-09-17T19:09:48.038971] [DEBUG] [LOCAL ] G: Trimmed 71352 records to 49757 (keeping 200 days of data) [2025-09-17T19:09:48.360036] [DEBUG] [LOCAL ] G: Primary data saved (49757 records). [2025-09-17T19:09:48.360197] [INFO ] [MAIN ] G: Full history saved. [2025-09-17T19:09:48.360334] [INFO ] [MAIN ] Update Progress: 890/2371 symbols completed. G took 41.5s. Estimated remaining: 3h 35m 57s. Rate: 6.9 symbols/min [2025-09-17T19:09:48.425388] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-11. [2025-09-17T19:09:48.537071] [INFO ] [MAIN ] GBAB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:09:48.537404] [DEBUG] [LOCAL ] GBAB: No existing data file found in primary storage. [2025-09-17T19:09:48.537529] [WARN ] [MAIN ] GBAB: No existing data found, performing full refresh instead. [2025-09-17T19:09:48.537805] [INFO ] [MAIN ] GBAB: Wiping existing primary data before full refresh. [2025-09-17T19:09:48.537921] [INFO ] [LOCAL ] GBAB: Starting deletion of primary data. [2025-09-17T19:09:48.538021] [DEBUG] [LOCAL ] GBAB: No primary data file found to delete. [2025-09-17T19:09:48.538103] [INFO ] [MAIN ] GBAB: Starting full primary refresh. [2025-09-17T19:09:48.825858] [INFO ] [REMOTE ] GAB: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T19:09:48.852982] [INFO ] [REMOTE ] GAB: Full fetch complete (39052 records). [2025-09-17T19:09:48.879912] [DEBUG] [VALIDATOR ] GAB: Validating primary data. [2025-09-17T19:09:48.967630] [INFO ] [REMOTE ] GBAB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:09:49.096521] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-02 (2.28 seconds). [2025-09-17T19:09:49.224230] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-03. [2025-09-17T19:09:49.400212] [DEBUG] [VALIDATOR ] GAB: All expected trading days are present. [2025-09-17T19:09:49.400327] [DEBUG] [VALIDATOR ] GAB: Primary data validation passed. [2025-09-17T19:09:49.401361] [INFO ] [MAIN ] GAB: Fetched primary data is valid. [2025-09-17T19:09:49.401424] [DEBUG] [LOCAL ] GAB: Saving primary data. [2025-09-17T19:09:49.402705] [DEBUG] [LOCAL ] GAB: Trimmed 39052 records to 27752 (keeping 200 days of data) [2025-09-17T19:09:49.593369] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T19:09:49.612704] [DEBUG] [LOCAL ] GAB: Primary data saved (27752 records). [2025-09-17T19:09:49.612836] [INFO ] [MAIN ] GAB: Full history saved. [2025-09-17T19:09:49.612959] [INFO ] [MAIN ] Update Progress: 891/2371 symbols completed. GAB took 32.4s. Estimated remaining: 3h 35m 36s. Rate: 6.9 symbols/min [2025-09-17T19:09:49.801594] [INFO ] [MAIN ] GBCI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:09:49.848024] [DEBUG] [LOCAL ] GBCI: Loaded 40052 existing records from primary storage. [2025-09-17T19:09:49.848284] [INFO ] [MAIN ] GBCI: Loaded 40052 existing records. [2025-09-17T19:09:50.032391] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-11. [2025-09-17T19:09:50.038709] [WARN ] [MAIN ] GBCI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:09:50.039040] [INFO ] [MAIN ] GBCI: Wiping existing primary data before full refresh. [2025-09-17T19:09:50.039089] [INFO ] [LOCAL ] GBCI: Starting deletion of primary data. [2025-09-17T19:09:50.040079] [DEBUG] [LOCAL ] GBCI: Deleted primary data file. [2025-09-17T19:09:50.040136] [INFO ] [MAIN ] GBCI: Starting full primary refresh. [2025-09-17T19:09:50.419556] [INFO ] [REMOTE ] GBCI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:09:50.701595] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T19:09:50.815769] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2024-12. [2025-09-17T19:09:51.286241] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T19:09:51.532528] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T19:09:51.615780] [INFO ] [REMOTE ] GATX: Fetching primary data for 2024-12. [2025-09-17T19:09:52.335817] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T19:09:52.415839] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-04. [2025-09-17T19:09:53.215830] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-01. [2025-09-17T19:09:54.020934] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-11. [2025-09-17T19:09:54.028182] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T19:09:54.311238] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T19:09:54.815730] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-05. [2025-09-17T19:09:55.509634] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T19:09:55.615772] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-01. [2025-09-17T19:09:56.400475] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T19:09:56.415669] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-06. [2025-09-17T19:09:56.503048] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T19:09:57.215765] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2024-12. [2025-09-17T19:09:57.922331] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T19:09:58.015736] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-07. [2025-09-17T19:09:58.724476] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T19:09:58.815813] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-02. [2025-09-17T19:09:59.615760] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-02. [2025-09-17T19:09:59.810480] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T19:10:00.044157] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T19:10:00.388428] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T19:10:00.415731] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-03. [2025-09-17T19:10:01.112394] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T19:10:01.215768] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-08. [2025-09-17T19:10:02.015794] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-01. [2025-09-17T19:10:02.815790] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-03. [2025-09-17T19:10:03.077011] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T19:10:03.348723] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T19:10:03.539103] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T19:10:03.615760] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-02. [2025-09-17T19:10:04.415835] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-04. [2025-09-17T19:10:04.920292] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T19:10:05.215738] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-03. [2025-09-17T19:10:05.353193] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T19:10:06.015788] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-05. [2025-09-17T19:10:06.747970] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T19:10:06.818047] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-04. [2025-09-17T19:10:06.821618] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T19:10:07.456145] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T19:10:07.615821] [INFO ] [REMOTE ] GAP: Fetching primary data for 2025-09. [2025-09-17T19:10:08.416001] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-05. [2025-09-17T19:10:09.215575] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T19:10:09.215729] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-06. [2025-09-17T19:10:10.015821] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-04. [2025-09-17T19:10:10.223313] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T19:10:10.346749] [INFO ] [REMOTE ] GAP: Incremental fetch complete for 2025-09 (2.73 seconds). [2025-09-17T19:10:10.360742] [INFO ] [REMOTE ] GAP: Full fetch complete (77493 records). [2025-09-17T19:10:10.360989] [DEBUG] [VALIDATOR ] GAP: Validating primary data. [2025-09-17T19:10:10.771906] [DEBUG] [VALIDATOR ] GAP: All expected trading days are present. [2025-09-17T19:10:10.771997] [DEBUG] [VALIDATOR ] GAP: Primary data validation passed. [2025-09-17T19:10:10.773091] [INFO ] [MAIN ] GAP: Fetched primary data is valid. [2025-09-17T19:10:10.773156] [DEBUG] [LOCAL ] GAP: Saving primary data. [2025-09-17T19:10:10.774923] [DEBUG] [LOCAL ] GAP: Trimmed 77493 records to 53655 (keeping 200 days of data) [2025-09-17T19:10:10.836038] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-07. [2025-09-17T19:10:11.140363] [DEBUG] [LOCAL ] GAP: Primary data saved (53655 records). [2025-09-17T19:10:11.140554] [INFO ] [MAIN ] GAP: Full history saved. [2025-09-17T19:10:11.140693] [INFO ] [MAIN ] Update Progress: 892/2371 symbols completed. GAP took 36.0s. Estimated remaining: 3h 35m 48s. Rate: 6.9 symbols/min [2025-09-17T19:10:11.337515] [INFO ] [MAIN ] GBLI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:10:11.337888] [DEBUG] [LOCAL ] GBLI: No existing data file found in primary storage. [2025-09-17T19:10:11.337968] [WARN ] [MAIN ] GBLI: No existing data found, performing full refresh instead. [2025-09-17T19:10:11.338297] [INFO ] [MAIN ] GBLI: Wiping existing primary data before full refresh. [2025-09-17T19:10:11.338367] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-17T19:10:11.338426] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-17T19:10:11.338483] [INFO ] [MAIN ] GBLI: Starting full primary refresh. [2025-09-17T19:10:11.621374] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-06. [2025-09-17T19:10:11.820571] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T19:10:11.845863] [INFO ] [REMOTE ] GBLI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:10:11.879818] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T19:10:12.415845] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-08. [2025-09-17T19:10:12.673206] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T19:10:13.215827] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-07. [2025-09-17T19:10:13.293879] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T19:10:13.964558] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T19:10:14.015823] [INFO ] [REMOTE ] GATX: Fetching primary data for 2025-09. [2025-09-17T19:10:14.815802] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-11. [2025-09-17T19:10:15.155365] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-17T19:10:15.190549] [INFO ] [REMOTE ] GATX: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T19:10:15.193622] [INFO ] [REMOTE ] GATX: Full fetch complete (25174 records). [2025-09-17T19:10:15.193783] [DEBUG] [VALIDATOR ] GATX: Validating primary data. [2025-09-17T19:10:15.618008] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2024-12. [2025-09-17T19:10:15.619577] [DEBUG] [VALIDATOR ] GATX: All expected trading days are present. [2025-09-17T19:10:15.619695] [DEBUG] [VALIDATOR ] GATX: Primary data validation passed. [2025-09-17T19:10:15.620165] [INFO ] [MAIN ] GATX: Fetched primary data is valid. [2025-09-17T19:10:15.620207] [DEBUG] [LOCAL ] GATX: Saving primary data. [2025-09-17T19:10:15.621696] [DEBUG] [LOCAL ] GATX: Trimmed 25174 records to 17983 (keeping 200 days of data) [2025-09-17T19:10:15.744454] [DEBUG] [LOCAL ] GATX: Primary data saved (17983 records). [2025-09-17T19:10:15.744607] [INFO ] [MAIN ] GATX: Full history saved. [2025-09-17T19:10:15.744734] [INFO ] [MAIN ] Update Progress: 893/2371 symbols completed. GATX took 30.1s. Estimated remaining: 3h 35m 33s. Rate: 6.9 symbols/min [2025-09-17T19:10:15.916716] [INFO ] [MAIN ] GBTG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:10:15.961037] [DEBUG] [LOCAL ] GBTG: Loaded 40681 existing records from primary storage. [2025-09-17T19:10:15.961182] [INFO ] [MAIN ] GBTG: Loaded 40681 existing records. [2025-09-17T19:10:16.129408] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T19:10:16.151926] [WARN ] [MAIN ] GBTG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:10:16.152209] [INFO ] [MAIN ] GBTG: Wiping existing primary data before full refresh. [2025-09-17T19:10:16.152255] [INFO ] [LOCAL ] GBTG: Starting deletion of primary data. [2025-09-17T19:10:16.153173] [DEBUG] [LOCAL ] GBTG: Deleted primary data file. [2025-09-17T19:10:16.153224] [INFO ] [MAIN ] GBTG: Starting full primary refresh. [2025-09-17T19:10:16.420981] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-01. [2025-09-17T19:10:16.525717] [INFO ] [REMOTE ] GBTG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:10:16.855069] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-17T19:10:17.215833] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-11. [2025-09-17T19:10:18.015828] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-05. [2025-09-17T19:10:18.628039] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T19:10:18.815802] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-08. [2025-09-17T19:10:19.143035] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T19:10:19.327110] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T19:10:19.615819] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-02. [2025-09-17T19:10:19.845186] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-02 (0.23 seconds). [2025-09-17T19:10:20.415791] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-06. [2025-09-17T19:10:21.215779] [INFO ] [REMOTE ] GBAB: Fetching primary data for 2025-09. [2025-09-17T19:10:21.869213] [INFO ] [REMOTE ] GBAB: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T19:10:21.871589] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T19:10:21.874263] [INFO ] [REMOTE ] GBAB: Full fetch complete (20744 records). [2025-09-17T19:10:21.885340] [DEBUG] [VALIDATOR ] GBAB: Validating primary data. [2025-09-17T19:10:22.030071] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-07. [2025-09-17T19:10:22.256208] [DEBUG] [VALIDATOR ] GBAB: All expected trading days are present. [2025-09-17T19:10:22.256291] [DEBUG] [VALIDATOR ] GBAB: Primary data validation passed. [2025-09-17T19:10:22.256749] [INFO ] [MAIN ] GBAB: Fetched primary data is valid. [2025-09-17T19:10:22.256793] [DEBUG] [LOCAL ] GBAB: Saving primary data. [2025-09-17T19:10:22.257469] [DEBUG] [LOCAL ] GBAB: Trimmed 20744 records to 13082 (keeping 200 days of data) [2025-09-17T19:10:22.342772] [DEBUG] [LOCAL ] GBAB: Primary data saved (13082 records). [2025-09-17T19:10:22.342928] [INFO ] [MAIN ] GBAB: Full history saved. [2025-09-17T19:10:22.343021] [INFO ] [MAIN ] Update Progress: 894/2371 symbols completed. GBAB took 34.0s. Estimated remaining: 3h 35m 20s. Rate: 6.9 symbols/min [2025-09-17T19:10:22.511030] [INFO ] [MAIN ] GBX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:10:22.543686] [DEBUG] [LOCAL ] GBX: Loaded 29493 existing records from primary storage. [2025-09-17T19:10:22.543829] [INFO ] [MAIN ] GBX: Loaded 29493 existing records. [2025-09-17T19:10:22.731184] [WARN ] [MAIN ] GBX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:10:22.731456] [INFO ] [MAIN ] GBX: Wiping existing primary data before full refresh. [2025-09-17T19:10:22.731501] [INFO ] [LOCAL ] GBX: Starting deletion of primary data. [2025-09-17T19:10:22.732289] [DEBUG] [LOCAL ] GBX: Deleted primary data file. [2025-09-17T19:10:22.732339] [INFO ] [MAIN ] GBX: Starting full primary refresh. [2025-09-17T19:10:22.823618] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-03. [2025-09-17T19:10:23.093770] [INFO ] [REMOTE ] GBX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:10:23.289366] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T19:10:23.293358] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T19:10:23.615813] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-11. [2025-09-17T19:10:24.415832] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2024-12. [2025-09-17T19:10:24.797396] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T19:10:25.215815] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-08. [2025-09-17T19:10:25.531028] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T19:10:26.015794] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-01. [2025-09-17T19:10:26.410110] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T19:10:26.815808] [INFO ] [REMOTE ] GBX: Fetching primary data for 2024-12. [2025-09-17T19:10:26.873964] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T19:10:27.615805] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-02. [2025-09-17T19:10:27.939707] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T19:10:28.415807] [INFO ] [REMOTE ] GBCI: Fetching primary data for 2025-09. [2025-09-17T19:10:28.928180] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T19:10:29.215794] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-03. [2025-09-17T19:10:29.669219] [INFO ] [REMOTE ] GBCI: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T19:10:29.674263] [INFO ] [REMOTE ] GBCI: Full fetch complete (57328 records). [2025-09-17T19:10:29.674360] [DEBUG] [VALIDATOR ] GBCI: Validating primary data. [2025-09-17T19:10:30.024243] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-01. [2025-09-17T19:10:30.068389] [DEBUG] [VALIDATOR ] GBCI: All expected trading days are present. [2025-09-17T19:10:30.068512] [DEBUG] [VALIDATOR ] GBCI: Primary data validation passed. [2025-09-17T19:10:30.069431] [INFO ] [MAIN ] GBCI: Fetched primary data is valid. [2025-09-17T19:10:30.069490] [DEBUG] [LOCAL ] GBCI: Saving primary data. [2025-09-17T19:10:30.070876] [DEBUG] [LOCAL ] GBCI: Trimmed 57328 records to 40027 (keeping 200 days of data) [2025-09-17T19:10:30.325925] [DEBUG] [LOCAL ] GBCI: Primary data saved (40027 records). [2025-09-17T19:10:30.326080] [INFO ] [MAIN ] GBCI: Full history saved. [2025-09-17T19:10:30.327189] [INFO ] [MAIN ] Update Progress: 895/2371 symbols completed. GBCI took 40.7s. Estimated remaining: 3h 35m 10s. Rate: 6.9 symbols/min [2025-09-17T19:10:30.498162] [INFO ] [MAIN ] GCI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:10:30.541801] [DEBUG] [LOCAL ] GCI: Loaded 44240 existing records from primary storage. [2025-09-17T19:10:30.541981] [INFO ] [MAIN ] GCI: Loaded 44240 existing records. [2025-09-17T19:10:30.721579] [WARN ] [MAIN ] GCI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:10:30.722007] [INFO ] [MAIN ] GCI: Wiping existing primary data before full refresh. [2025-09-17T19:10:30.722168] [INFO ] [LOCAL ] GCI: Starting deletion of primary data. [2025-09-17T19:10:30.723133] [DEBUG] [LOCAL ] GCI: Deleted primary data file. [2025-09-17T19:10:30.723192] [INFO ] [MAIN ] GCI: Starting full primary refresh. [2025-09-17T19:10:30.820566] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-04. [2025-09-17T19:10:30.871310] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T19:10:31.127017] [INFO ] [REMOTE ] GCI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:10:31.285017] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T19:10:31.445013] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T19:10:31.615791] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-05. [2025-09-17T19:10:31.961193] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-17T19:10:32.415780] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-11. [2025-09-17T19:10:33.215800] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-04. [2025-09-17T19:10:34.000224] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T19:10:34.015685] [INFO ] [REMOTE ] GCI: Fetching primary data for 2024-12. [2025-09-17T19:10:34.397369] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T19:10:34.815849] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-06. [2025-09-17T19:10:35.046943] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-06 (0.23 seconds). [2025-09-17T19:10:35.135925] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T19:10:35.615799] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-07. [2025-09-17T19:10:35.862233] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-17T19:10:36.415825] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-08. [2025-09-17T19:10:36.852128] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T19:10:37.215800] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-05. [2025-09-17T19:10:38.015775] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-02. [2025-09-17T19:10:38.799947] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T19:10:38.815729] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-06. [2025-09-17T19:10:39.019517] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T19:10:39.615811] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-01. [2025-09-17T19:10:40.368429] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T19:10:40.415792] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-07. [2025-09-17T19:10:41.215813] [INFO ] [REMOTE ] GBLI: Fetching primary data for 2025-09. [2025-09-17T19:10:41.334298] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T19:10:41.661166] [INFO ] [REMOTE ] GBLI: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T19:10:41.661899] [INFO ] [REMOTE ] GBLI: Full fetch complete (1443 records). [2025-09-17T19:10:41.661966] [DEBUG] [VALIDATOR ] GBLI: Validating primary data. [2025-09-17T19:10:41.854528] [WARN ] [VALIDATOR ] GBLI: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-17T19:10:41.854784] [FATAL] [MAIN ] GBLI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:10:41.854882] [WARN ] [MAIN ] GBLI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:10:41.854946] [INFO ] [LOCAL ] GBLI: Starting deletion of primary data. [2025-09-17T19:10:41.855022] [DEBUG] [LOCAL ] GBLI: No primary data file found to delete. [2025-09-17T19:10:41.855149] [INFO ] [LOCAL ] GBLI: Starting deletion of derivative data. [2025-09-17T19:10:41.855248] [DEBUG] [LOCAL ] GBLI: No derivative data file found to delete. [2025-09-17T19:10:41.855321] [INFO ] [MAIN ] Update Progress: 896/2371 symbols completed. GBLI took 30.7s. Estimated remaining: 3h 35m 6s. Rate: 6.9 symbols/min [2025-09-17T19:10:42.017468] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-02. [2025-09-17T19:10:42.053097] [INFO ] [MAIN ] GCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:10:42.056292] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T19:10:42.089628] [DEBUG] [LOCAL ] GCO: Loaded 25949 existing records from primary storage. [2025-09-17T19:10:42.089788] [INFO ] [MAIN ] GCO: Loaded 25949 existing records. [2025-09-17T19:10:42.266262] [WARN ] [MAIN ] GCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:10:42.266471] [INFO ] [MAIN ] GCO: Wiping existing primary data before full refresh. [2025-09-17T19:10:42.266523] [INFO ] [LOCAL ] GCO: Starting deletion of primary data. [2025-09-17T19:10:42.267066] [DEBUG] [LOCAL ] GCO: Deleted primary data file. [2025-09-17T19:10:42.267115] [INFO ] [MAIN ] GCO: Starting full primary refresh. [2025-09-17T19:10:42.619882] [INFO ] [REMOTE ] GCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:10:42.815747] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-11. [2025-09-17T19:10:43.580937] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T19:10:43.615736] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-03. [2025-09-17T19:10:43.916922] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T19:10:44.415794] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-08. [2025-09-17T19:10:44.827202] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T19:10:45.215825] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-03. [2025-09-17T19:10:45.889516] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T19:10:46.015798] [INFO ] [REMOTE ] GCO: Fetching primary data for 2024-12. [2025-09-17T19:10:46.525660] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T19:10:46.815778] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-04. [2025-09-17T19:10:46.964074] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T19:10:47.615843] [INFO ] [REMOTE ] GBTG: Fetching primary data for 2025-09. [2025-09-17T19:10:48.243022] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T19:10:48.415870] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-05. [2025-09-17T19:10:49.028794] [INFO ] [REMOTE ] GBTG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T19:10:49.034186] [INFO ] [REMOTE ] GBTG: Full fetch complete (56607 records). [2025-09-17T19:10:49.034292] [DEBUG] [VALIDATOR ] GBTG: Validating primary data. [2025-09-17T19:10:49.223569] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-04. [2025-09-17T19:10:49.421379] [DEBUG] [VALIDATOR ] GBTG: All expected trading days are present. [2025-09-17T19:10:49.421471] [DEBUG] [VALIDATOR ] GBTG: Primary data validation passed. [2025-09-17T19:10:49.422220] [INFO ] [MAIN ] GBTG: Fetched primary data is valid. [2025-09-17T19:10:49.422295] [DEBUG] [LOCAL ] GBTG: Saving primary data. [2025-09-17T19:10:49.423573] [DEBUG] [LOCAL ] GBTG: Trimmed 56607 records to 40710 (keeping 200 days of data) [2025-09-17T19:10:49.664308] [DEBUG] [LOCAL ] GBTG: Primary data saved (40710 records). [2025-09-17T19:10:49.664571] [INFO ] [MAIN ] GBTG: Full history saved. [2025-09-17T19:10:49.664869] [INFO ] [MAIN ] Update Progress: 897/2371 symbols completed. GBTG took 33.9s. Estimated remaining: 3h 34m 56s. Rate: 6.9 symbols/min [2025-09-17T19:10:49.831373] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T19:10:49.906935] [INFO ] [MAIN ] GCTS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:10:49.927379] [DEBUG] [LOCAL ] GCTS: Loaded 19249 existing records from primary storage. [2025-09-17T19:10:49.927508] [INFO ] [MAIN ] GCTS: Loaded 19249 existing records. [2025-09-17T19:10:50.020880] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-01. [2025-09-17T19:10:50.109594] [WARN ] [MAIN ] GCTS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:10:50.109869] [INFO ] [MAIN ] GCTS: Wiping existing primary data before full refresh. [2025-09-17T19:10:50.109914] [INFO ] [LOCAL ] GCTS: Starting deletion of primary data. [2025-09-17T19:10:50.110371] [DEBUG] [LOCAL ] GCTS: Deleted primary data file. [2025-09-17T19:10:50.110416] [INFO ] [MAIN ] GCTS: Starting full primary refresh. [2025-09-17T19:10:50.468063] [INFO ] [REMOTE ] GCTS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:10:50.815759] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-11. [2025-09-17T19:10:50.981798] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T19:10:51.142478] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T19:10:51.591102] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T19:10:51.615797] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2024-12. [2025-09-17T19:10:52.415813] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-05. [2025-09-17T19:10:52.732395] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T19:10:53.215797] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-01. [2025-09-17T19:10:53.340275] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T19:10:54.015805] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-02. [2025-09-17T19:10:54.265814] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T19:10:54.815741] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-02. [2025-09-17T19:10:55.139853] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T19:10:55.615780] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-06. [2025-09-17T19:10:55.694023] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T19:10:56.415801] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-06. [2025-09-17T19:10:57.021217] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T19:10:57.215795] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-07. [2025-09-17T19:10:57.451160] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T19:10:58.015800] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-03. [2025-09-17T19:10:58.823446] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-07. [2025-09-17T19:10:58.829370] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T19:10:58.925882] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T19:10:59.615776] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-04. [2025-09-17T19:11:00.354889] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T19:11:00.415725] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-08. [2025-09-17T19:11:00.731688] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T19:11:01.215752] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-05. [2025-09-17T19:11:01.541341] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T19:11:02.015758] [INFO ] [REMOTE ] GBX: Fetching primary data for 2025-09. [2025-09-17T19:11:02.402339] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T19:11:02.815777] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-08. [2025-09-17T19:11:03.101694] [INFO ] [REMOTE ] GBX: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T19:11:03.105306] [INFO ] [REMOTE ] GBX: Full fetch complete (42559 records). [2025-09-17T19:11:03.105443] [DEBUG] [VALIDATOR ] GBX: Validating primary data. [2025-09-17T19:11:03.480289] [DEBUG] [VALIDATOR ] GBX: All expected trading days are present. [2025-09-17T19:11:03.480388] [DEBUG] [VALIDATOR ] GBX: Primary data validation passed. [2025-09-17T19:11:03.481044] [INFO ] [MAIN ] GBX: Fetched primary data is valid. [2025-09-17T19:11:03.481090] [DEBUG] [LOCAL ] GBX: Saving primary data. [2025-09-17T19:11:03.482222] [DEBUG] [LOCAL ] GBX: Trimmed 42559 records to 29517 (keeping 200 days of data) [2025-09-17T19:11:03.632238] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-03. [2025-09-17T19:11:03.668103] [DEBUG] [LOCAL ] GBX: Primary data saved (29517 records). [2025-09-17T19:11:03.668239] [INFO ] [MAIN ] GBX: Full history saved. [2025-09-17T19:11:03.668337] [INFO ] [MAIN ] Update Progress: 898/2371 symbols completed. GBX took 41.3s. Estimated remaining: 3h 34m 56s. Rate: 6.9 symbols/min [2025-09-17T19:11:03.840817] [INFO ] [MAIN ] GCV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:11:03.849415] [DEBUG] [LOCAL ] GCV: Loaded 7027 existing records from primary storage. [2025-09-17T19:11:03.849541] [INFO ] [MAIN ] GCV: Loaded 7027 existing records. [2025-09-17T19:11:04.027273] [WARN ] [MAIN ] GCV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:11:04.027535] [INFO ] [MAIN ] GCV: Wiping existing primary data before full refresh. [2025-09-17T19:11:04.027581] [INFO ] [LOCAL ] GCV: Starting deletion of primary data. [2025-09-17T19:11:04.027957] [DEBUG] [LOCAL ] GCV: Deleted primary data file. [2025-09-17T19:11:04.028005] [INFO ] [MAIN ] GCV: Starting full primary refresh. [2025-09-17T19:11:04.386150] [INFO ] [REMOTE ] GCV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:11:04.415727] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-11. [2025-09-17T19:11:04.531817] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T19:11:04.550458] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T19:11:05.141507] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T19:11:05.215812] [INFO ] [REMOTE ] GCI: Fetching primary data for 2025-09. [2025-09-17T19:11:06.015820] [INFO ] [REMOTE ] GCV: Fetching primary data for 2024-12. [2025-09-17T19:11:06.710867] [INFO ] [REMOTE ] GCI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T19:11:06.717174] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T19:11:06.723286] [INFO ] [REMOTE ] GCI: Full fetch complete (62897 records). [2025-09-17T19:11:06.723400] [DEBUG] [VALIDATOR ] GCI: Validating primary data. [2025-09-17T19:11:06.824909] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-01. [2025-09-17T19:11:07.122727] [DEBUG] [VALIDATOR ] GCI: All expected trading days are present. [2025-09-17T19:11:07.122823] [DEBUG] [VALIDATOR ] GCI: Primary data validation passed. [2025-09-17T19:11:07.123794] [INFO ] [MAIN ] GCI: Fetched primary data is valid. [2025-09-17T19:11:07.123861] [DEBUG] [LOCAL ] GCI: Saving primary data. [2025-09-17T19:11:07.125371] [DEBUG] [LOCAL ] GCI: Trimmed 62897 records to 44264 (keeping 200 days of data) [2025-09-17T19:11:07.388847] [DEBUG] [LOCAL ] GCI: Primary data saved (44264 records). [2025-09-17T19:11:07.388992] [INFO ] [MAIN ] GCI: Full history saved. [2025-09-17T19:11:07.389583] [INFO ] [MAIN ] Update Progress: 899/2371 symbols completed. GCI took 37.1s. Estimated remaining: 3h 34m 39s. Rate: 6.9 symbols/min [2025-09-17T19:11:07.502547] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T19:11:07.571570] [INFO ] [MAIN ] GD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:11:07.616076] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-02. [2025-09-17T19:11:07.618206] [DEBUG] [LOCAL ] GD: Loaded 47545 existing records from primary storage. [2025-09-17T19:11:07.618372] [INFO ] [MAIN ] GD: Loaded 47545 existing records. [2025-09-17T19:11:07.808687] [WARN ] [MAIN ] GD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:11:07.808961] [INFO ] [MAIN ] GD: Wiping existing primary data before full refresh. [2025-09-17T19:11:07.809035] [INFO ] [LOCAL ] GD: Starting deletion of primary data. [2025-09-17T19:11:07.810307] [DEBUG] [LOCAL ] GD: Deleted primary data file. [2025-09-17T19:11:07.810362] [INFO ] [MAIN ] GD: Starting full primary refresh. [2025-09-17T19:11:08.182951] [INFO ] [REMOTE ] GD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:11:08.205238] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T19:11:08.415762] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-04. [2025-09-17T19:11:09.215770] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-06. [2025-09-17T19:11:09.234683] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T19:11:10.015796] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-05. [2025-09-17T19:11:10.545502] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T19:11:10.815780] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-07. [2025-09-17T19:11:10.925994] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T19:11:11.615825] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-03. [2025-09-17T19:11:11.856713] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T19:11:11.977423] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T19:11:12.415810] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-04. [2025-09-17T19:11:12.958683] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-17T19:11:13.215802] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-05. [2025-09-17T19:11:13.690680] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T19:11:14.015812] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-08. [2025-09-17T19:11:14.797854] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T19:11:14.815751] [INFO ] [REMOTE ] GCO: Fetching primary data for 2025-09. [2025-09-17T19:11:15.615794] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-06. [2025-09-17T19:11:15.747096] [INFO ] [REMOTE ] GCO: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T19:11:15.750764] [INFO ] [REMOTE ] GCO: Full fetch complete (36115 records). [2025-09-17T19:11:15.750863] [DEBUG] [VALIDATOR ] GCO: Validating primary data. [2025-09-17T19:11:16.159149] [DEBUG] [VALIDATOR ] GCO: All expected trading days are present. [2025-09-17T19:11:16.159233] [DEBUG] [VALIDATOR ] GCO: Primary data validation passed. [2025-09-17T19:11:16.159858] [INFO ] [MAIN ] GCO: Fetched primary data is valid. [2025-09-17T19:11:16.159905] [DEBUG] [LOCAL ] GCO: Saving primary data. [2025-09-17T19:11:16.160971] [DEBUG] [LOCAL ] GCO: Trimmed 36115 records to 25980 (keeping 200 days of data) [2025-09-17T19:11:16.258531] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T19:11:16.329218] [DEBUG] [LOCAL ] GCO: Primary data saved (25980 records). [2025-09-17T19:11:16.329371] [INFO ] [MAIN ] GCO: Full history saved. [2025-09-17T19:11:16.329461] [INFO ] [MAIN ] Update Progress: 900/2371 symbols completed. GCO took 34.5s. Estimated remaining: 3h 34m 30s. Rate: 6.9 symbols/min [2025-09-17T19:11:16.420874] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-11. [2025-09-17T19:11:16.499808] [INFO ] [MAIN ] GDDY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:11:16.545360] [DEBUG] [LOCAL ] GDDY: Loaded 49859 existing records from primary storage. [2025-09-17T19:11:16.545532] [INFO ] [MAIN ] GDDY: Loaded 49859 existing records. [2025-09-17T19:11:16.721888] [WARN ] [MAIN ] GDDY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:11:16.722115] [INFO ] [MAIN ] GDDY: Wiping existing primary data before full refresh. [2025-09-17T19:11:16.722160] [INFO ] [LOCAL ] GDDY: Starting deletion of primary data. [2025-09-17T19:11:16.723162] [DEBUG] [LOCAL ] GDDY: Deleted primary data file. [2025-09-17T19:11:16.723212] [INFO ] [MAIN ] GDDY: Starting full primary refresh. [2025-09-17T19:11:17.102906] [INFO ] [REMOTE ] GDDY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:11:17.215744] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-11. [2025-09-17T19:11:18.015781] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-07. [2025-09-17T19:11:18.230490] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T19:11:18.487236] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T19:11:18.804605] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T19:11:18.815667] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-08. [2025-09-17T19:11:19.540671] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T19:11:19.615799] [INFO ] [REMOTE ] GCV: Fetching primary data for 2025-09. [2025-09-17T19:11:20.246194] [INFO ] [REMOTE ] GCV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T19:11:20.248031] [INFO ] [REMOTE ] GCV: Full fetch complete (9288 records). [2025-09-17T19:11:20.248107] [DEBUG] [VALIDATOR ] GCV: Validating primary data. [2025-09-17T19:11:20.428744] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-06. [2025-09-17T19:11:20.618344] [DEBUG] [VALIDATOR ] GCV: All expected trading days are present. [2025-09-17T19:11:20.618420] [DEBUG] [VALIDATOR ] GCV: Primary data validation passed. [2025-09-17T19:11:20.618697] [INFO ] [MAIN ] GCV: Fetched primary data is valid. [2025-09-17T19:11:20.618738] [DEBUG] [LOCAL ] GCV: Saving primary data. [2025-09-17T19:11:20.619162] [DEBUG] [LOCAL ] GCV: Trimmed 9288 records to 7064 (keeping 200 days of data) [2025-09-17T19:11:20.660598] [DEBUG] [LOCAL ] GCV: Primary data saved (7064 records). [2025-09-17T19:11:20.660738] [INFO ] [MAIN ] GCV: Full history saved. [2025-09-17T19:11:20.660835] [INFO ] [MAIN ] Update Progress: 901/2371 symbols completed. GCV took 17.0s. Estimated remaining: 3h 34m 14s. Rate: 6.9 symbols/min [2025-09-17T19:11:20.834090] [INFO ] [MAIN ] GDIV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:11:20.840007] [DEBUG] [LOCAL ] GDIV: Loaded 3794 existing records from primary storage. [2025-09-17T19:11:20.840110] [INFO ] [MAIN ] GDIV: Loaded 3794 existing records. [2025-09-17T19:11:21.022874] [WARN ] [MAIN ] GDIV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:11:21.023148] [INFO ] [MAIN ] GDIV: Wiping existing primary data before full refresh. [2025-09-17T19:11:21.023201] [INFO ] [LOCAL ] GDIV: Starting deletion of primary data. [2025-09-17T19:11:21.023398] [DEBUG] [LOCAL ] GDIV: Deleted primary data file. [2025-09-17T19:11:21.023439] [INFO ] [MAIN ] GDIV: Starting full primary refresh. [2025-09-17T19:11:21.221015] [INFO ] [REMOTE ] GD: Fetching primary data for 2024-12. [2025-09-17T19:11:21.378079] [INFO ] [REMOTE ] GDIV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:11:21.960599] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T19:11:22.015793] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2024-12. [2025-09-17T19:11:22.794704] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T19:11:22.815728] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-01. [2025-09-17T19:11:23.397861] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T19:11:23.615775] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-07. [2025-09-17T19:11:24.412249] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T19:11:24.416553] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-11. [2025-09-17T19:11:24.648457] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T19:11:24.901005] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T19:11:25.215865] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-08. [2025-09-17T19:11:26.015809] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-02. [2025-09-17T19:11:26.222791] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T19:11:26.815838] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2024-12. [2025-09-17T19:11:27.358617] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T19:11:27.568583] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T19:11:27.615811] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-01. [2025-09-17T19:11:28.415809] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-03. [2025-09-17T19:11:29.215706] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-01. [2025-09-17T19:11:29.315224] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T19:11:29.627577] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-17T19:11:30.015812] [INFO ] [REMOTE ] GCTS: Fetching primary data for 2025-09. [2025-09-17T19:11:30.292790] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T19:11:30.820666] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-04. [2025-09-17T19:11:30.824380] [INFO ] [REMOTE ] GCTS: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T19:11:30.828017] [INFO ] [REMOTE ] GCTS: Full fetch complete (26624 records). [2025-09-17T19:11:30.828152] [DEBUG] [VALIDATOR ] GCTS: Validating primary data. [2025-09-17T19:11:31.245844] [DEBUG] [VALIDATOR ] GCTS: All expected trading days are present. [2025-09-17T19:11:31.246122] [DEBUG] [VALIDATOR ] GCTS: Primary data validation passed. [2025-09-17T19:11:31.246850] [INFO ] [MAIN ] GCTS: Fetched primary data is valid. [2025-09-17T19:11:31.246950] [DEBUG] [LOCAL ] GCTS: Saving primary data. [2025-09-17T19:11:31.248357] [DEBUG] [LOCAL ] GCTS: Trimmed 26624 records to 19389 (keeping 200 days of data) [2025-09-17T19:11:31.377007] [DEBUG] [LOCAL ] GCTS: Primary data saved (19389 records). [2025-09-17T19:11:31.377250] [INFO ] [MAIN ] GCTS: Full history saved. [2025-09-17T19:11:31.377378] [INFO ] [MAIN ] Update Progress: 902/2371 symbols completed. GCTS took 41.7s. Estimated remaining: 3h 34m 9s. Rate: 6.9 symbols/min [2025-09-17T19:11:31.571309] [INFO ] [MAIN ] GDL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:11:31.571530] [DEBUG] [LOCAL ] GDL: No existing data file found in primary storage. [2025-09-17T19:11:31.571568] [WARN ] [MAIN ] GDL: No existing data found, performing full refresh instead. [2025-09-17T19:11:31.571727] [INFO ] [MAIN ] GDL: Wiping existing primary data before full refresh. [2025-09-17T19:11:31.571767] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-17T19:11:31.571806] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-17T19:11:31.571841] [INFO ] [MAIN ] GDL: Starting full primary refresh. [2025-09-17T19:11:31.620953] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-02. [2025-09-17T19:11:32.028087] [INFO ] [REMOTE ] GDL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:11:32.415831] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-02. [2025-09-17T19:11:32.769032] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T19:11:32.981484] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T19:11:33.215829] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-05. [2025-09-17T19:11:33.449494] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T19:11:34.015784] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-03. [2025-09-17T19:11:34.815829] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-11. [2025-09-17T19:11:34.921704] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T19:11:35.258754] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T19:11:35.615808] [INFO ] [REMOTE ] GDL: Fetching primary data for 2024-12. [2025-09-17T19:11:35.821836] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T19:11:36.090468] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T19:11:36.415873] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-03. [2025-09-17T19:11:36.987691] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T19:11:37.215874] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-04. [2025-09-17T19:11:37.832626] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T19:11:38.015783] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-05. [2025-09-17T19:11:38.433482] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T19:11:38.815808] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-06. [2025-09-17T19:11:39.615781] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-04. [2025-09-17T19:11:40.415822] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-06. [2025-09-17T19:11:40.636896] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T19:11:41.008727] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T19:11:41.215823] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-07. [2025-09-17T19:11:41.310748] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T19:11:41.992279] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T19:11:42.015740] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-08. [2025-09-17T19:11:42.490006] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T19:11:42.815804] [INFO ] [REMOTE ] GDIV: Fetching primary data for 2025-09. [2025-09-17T19:11:43.367116] [INFO ] [REMOTE ] GDIV: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T19:11:43.368447] [INFO ] [REMOTE ] GDIV: Full fetch complete (5420 records). [2025-09-17T19:11:43.368532] [DEBUG] [VALIDATOR ] GDIV: Validating primary data. [2025-09-17T19:11:43.623905] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-05. [2025-09-17T19:11:43.752160] [DEBUG] [VALIDATOR ] GDIV: All expected trading days are present. [2025-09-17T19:11:43.752284] [DEBUG] [VALIDATOR ] GDIV: Primary data validation passed. [2025-09-17T19:11:43.752477] [INFO ] [MAIN ] GDIV: Fetched primary data is valid. [2025-09-17T19:11:43.752518] [DEBUG] [LOCAL ] GDIV: Saving primary data. [2025-09-17T19:11:43.752932] [DEBUG] [LOCAL ] GDIV: Trimmed 5420 records to 3778 (keeping 200 days of data) [2025-09-17T19:11:43.778203] [DEBUG] [LOCAL ] GDIV: Primary data saved (3778 records). [2025-09-17T19:11:43.778364] [INFO ] [MAIN ] GDIV: Full history saved. [2025-09-17T19:11:43.778497] [INFO ] [MAIN ] Update Progress: 903/2371 symbols completed. GDIV took 23.1s. Estimated remaining: 3h 34m 6s. Rate: 6.9 symbols/min [2025-09-17T19:11:43.949376] [INFO ] [MAIN ] GDO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:11:43.949580] [DEBUG] [LOCAL ] GDO: No existing data file found in primary storage. [2025-09-17T19:11:43.949617] [WARN ] [MAIN ] GDO: No existing data found, performing full refresh instead. [2025-09-17T19:11:43.949762] [INFO ] [MAIN ] GDO: Wiping existing primary data before full refresh. [2025-09-17T19:11:43.949800] [INFO ] [LOCAL ] GDO: Starting deletion of primary data. [2025-09-17T19:11:43.949839] [DEBUG] [LOCAL ] GDO: No primary data file found to delete. [2025-09-17T19:11:43.949870] [INFO ] [MAIN ] GDO: Starting full primary refresh. [2025-09-17T19:11:44.318666] [INFO ] [REMOTE ] GDO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:11:44.415824] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-11. [2025-09-17T19:11:45.215778] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-01. [2025-09-17T19:11:45.337556] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T19:11:45.366052] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T19:11:45.678413] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T19:11:46.015834] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-06. [2025-09-17T19:11:46.815839] [INFO ] [REMOTE ] GDO: Fetching primary data for 2024-12. [2025-09-17T19:11:47.326265] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T19:11:47.608614] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T19:11:47.615666] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-01. [2025-09-17T19:11:48.322086] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T19:11:48.415813] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-07. [2025-09-17T19:11:49.215824] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-02. [2025-09-17T19:11:49.566192] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T19:11:49.873155] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T19:11:50.015780] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-07. [2025-09-17T19:11:50.815779] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-08. [2025-09-17T19:11:51.615783] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-02. [2025-09-17T19:11:51.752879] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T19:11:51.966937] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T19:11:52.415800] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-03. [2025-09-17T19:11:52.524154] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T19:11:53.015698] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T19:11:53.215804] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-03. [2025-09-17T19:11:53.726479] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T19:11:54.015780] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-04. [2025-09-17T19:11:54.650900] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T19:11:54.815815] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-05. [2025-09-17T19:11:55.413468] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T19:11:55.615802] [INFO ] [REMOTE ] GD: Fetching primary data for 2025-09. [2025-09-17T19:11:56.415770] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-04. [2025-09-17T19:11:56.909972] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-17T19:11:57.221056] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-06. [2025-09-17T19:11:57.229463] [INFO ] [REMOTE ] GD: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T19:11:57.235909] [INFO ] [REMOTE ] GD: Full fetch complete (70503 records). [2025-09-17T19:11:57.236070] [DEBUG] [VALIDATOR ] GD: Validating primary data. [2025-09-17T19:11:57.629776] [DEBUG] [VALIDATOR ] GD: All expected trading days are present. [2025-09-17T19:11:57.629867] [DEBUG] [VALIDATOR ] GD: Primary data validation passed. [2025-09-17T19:11:57.630726] [INFO ] [MAIN ] GD: Fetched primary data is valid. [2025-09-17T19:11:57.630773] [DEBUG] [LOCAL ] GD: Saving primary data. [2025-09-17T19:11:57.632228] [DEBUG] [LOCAL ] GD: Trimmed 70503 records to 47504 (keeping 200 days of data) [2025-09-17T19:11:57.940844] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T19:11:57.951814] [DEBUG] [LOCAL ] GD: Primary data saved (47504 records). [2025-09-17T19:11:57.951981] [INFO ] [MAIN ] GD: Full history saved. [2025-09-17T19:11:57.952079] [INFO ] [MAIN ] Update Progress: 904/2371 symbols completed. GD took 50.6s. Estimated remaining: 3h 34m 6s. Rate: 6.9 symbols/min [2025-09-17T19:11:58.020905] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-08. [2025-09-17T19:11:58.125999] [INFO ] [MAIN ] GDOT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:11:58.161741] [DEBUG] [LOCAL ] GDOT: Loaded 38629 existing records from primary storage. [2025-09-17T19:11:58.161886] [INFO ] [MAIN ] GDOT: Loaded 38629 existing records. [2025-09-17T19:11:58.340717] [WARN ] [MAIN ] GDOT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:11:58.340995] [INFO ] [MAIN ] GDOT: Wiping existing primary data before full refresh. [2025-09-17T19:11:58.341047] [INFO ] [LOCAL ] GDOT: Starting deletion of primary data. [2025-09-17T19:11:58.342014] [DEBUG] [LOCAL ] GDOT: Deleted primary data file. [2025-09-17T19:11:58.342077] [INFO ] [MAIN ] GDOT: Starting full primary refresh. [2025-09-17T19:11:58.706994] [INFO ] [REMOTE ] GDOT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:11:58.815773] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-11. [2025-09-17T19:11:59.615801] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-05. [2025-09-17T19:11:59.928488] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-05 (0.31 seconds). [2025-09-17T19:11:59.963578] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T19:12:00.166297] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T19:12:00.415807] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-06. [2025-09-17T19:12:00.795052] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-17T19:12:01.215786] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-07. [2025-09-17T19:12:02.015789] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2024-12. [2025-09-17T19:12:02.286092] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T19:12:02.815800] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-08. [2025-09-17T19:12:03.615817] [INFO ] [REMOTE ] GDDY: Fetching primary data for 2025-09. [2025-09-17T19:12:04.272879] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T19:12:04.415817] [INFO ] [REMOTE ] GDL: Fetching primary data for 2025-09. [2025-09-17T19:12:04.936211] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2024-12 (2.92 seconds). [2025-09-17T19:12:05.102658] [INFO ] [REMOTE ] GDL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T19:12:05.103740] [INFO ] [REMOTE ] GDL: Full fetch complete (3536 records). [2025-09-17T19:12:05.103813] [DEBUG] [VALIDATOR ] GDL: Validating primary data. [2025-09-17T19:12:05.220875] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-01. [2025-09-17T19:12:05.299976] [WARN ] [VALIDATOR ] GDL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T19:12:05.300203] [FATAL] [MAIN ] GDL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:12:05.300255] [WARN ] [MAIN ] GDL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:12:05.300300] [INFO ] [LOCAL ] GDL: Starting deletion of primary data. [2025-09-17T19:12:05.300366] [DEBUG] [LOCAL ] GDL: No primary data file found to delete. [2025-09-17T19:12:05.300404] [INFO ] [LOCAL ] GDL: Starting deletion of derivative data. [2025-09-17T19:12:05.300445] [DEBUG] [LOCAL ] GDL: No derivative data file found to delete. [2025-09-17T19:12:05.300513] [INFO ] [MAIN ] Update Progress: 905/2371 symbols completed. GDL took 33.9s. Estimated remaining: 3h 33m 55s. Rate: 6.9 symbols/min [2025-09-17T19:12:05.469568] [INFO ] [MAIN ] GDV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:12:05.489817] [DEBUG] [LOCAL ] GDV: Loaded 20043 existing records from primary storage. [2025-09-17T19:12:05.489955] [INFO ] [MAIN ] GDV: Loaded 20043 existing records. [2025-09-17T19:12:05.671318] [WARN ] [MAIN ] GDV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:12:05.671597] [INFO ] [MAIN ] GDV: Wiping existing primary data before full refresh. [2025-09-17T19:12:05.671665] [INFO ] [LOCAL ] GDV: Starting deletion of primary data. [2025-09-17T19:12:05.672287] [DEBUG] [LOCAL ] GDV: Deleted primary data file. [2025-09-17T19:12:05.672342] [INFO ] [MAIN ] GDV: Starting full primary refresh. [2025-09-17T19:12:06.025671] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-07. [2025-09-17T19:12:06.029857] [INFO ] [REMOTE ] GDV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:12:06.118234] [INFO ] [REMOTE ] GDDY: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-17T19:12:06.126135] [INFO ] [REMOTE ] GDDY: Full fetch complete (71083 records). [2025-09-17T19:12:06.126341] [DEBUG] [VALIDATOR ] GDDY: Validating primary data. [2025-09-17T19:12:06.528303] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T19:12:06.552522] [DEBUG] [VALIDATOR ] GDDY: All expected trading days are present. [2025-09-17T19:12:06.552706] [DEBUG] [VALIDATOR ] GDDY: Primary data validation passed. [2025-09-17T19:12:06.553964] [INFO ] [MAIN ] GDDY: Fetched primary data is valid. [2025-09-17T19:12:06.554044] [DEBUG] [LOCAL ] GDDY: Saving primary data. [2025-09-17T19:12:06.572894] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T19:12:06.579779] [DEBUG] [LOCAL ] GDDY: Trimmed 71083 records to 49844 (keeping 200 days of data) [2025-09-17T19:12:06.822522] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-02. [2025-09-17T19:12:06.916633] [DEBUG] [LOCAL ] GDDY: Primary data saved (49844 records). [2025-09-17T19:12:06.916887] [INFO ] [MAIN ] GDDY: Full history saved. [2025-09-17T19:12:06.917022] [INFO ] [MAIN ] Update Progress: 906/2371 symbols completed. GDDY took 50.6s. Estimated remaining: 3h 33m 35s. Rate: 6.9 symbols/min [2025-09-17T19:12:07.095249] [INFO ] [MAIN ] GE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:12:07.159021] [DEBUG] [LOCAL ] GE: Loaded 53715 existing records from primary storage. [2025-09-17T19:12:07.159236] [INFO ] [MAIN ] GE: Loaded 53715 existing records. [2025-09-17T19:12:07.347100] [WARN ] [MAIN ] GE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:12:07.347536] [INFO ] [MAIN ] GE: Wiping existing primary data before full refresh. [2025-09-17T19:12:07.347588] [INFO ] [LOCAL ] GE: Starting deletion of primary data. [2025-09-17T19:12:07.349078] [DEBUG] [LOCAL ] GE: Deleted primary data file. [2025-09-17T19:12:07.349137] [INFO ] [MAIN ] GE: Starting full primary refresh. [2025-09-17T19:12:07.619031] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-08. [2025-09-17T19:12:07.734627] [INFO ] [REMOTE ] GE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:12:07.800762] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T19:12:08.371696] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T19:12:08.415863] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-03. [2025-09-17T19:12:09.215787] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-11. [2025-09-17T19:12:10.015761] [INFO ] [REMOTE ] GDO: Fetching primary data for 2025-09. [2025-09-17T19:12:10.114720] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T19:12:10.248750] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T19:12:10.815782] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-04. [2025-09-17T19:12:10.980122] [INFO ] [REMOTE ] GDO: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T19:12:10.981915] [INFO ] [REMOTE ] GDO: Full fetch complete (9653 records). [2025-09-17T19:12:10.981986] [DEBUG] [VALIDATOR ] GDO: Validating primary data. [2025-09-17T19:12:11.343434] [DEBUG] [VALIDATOR ] GDO: All expected trading days are present. [2025-09-17T19:12:11.343515] [DEBUG] [VALIDATOR ] GDO: Primary data validation passed. [2025-09-17T19:12:11.343777] [INFO ] [MAIN ] GDO: Fetched primary data is valid. [2025-09-17T19:12:11.343820] [DEBUG] [LOCAL ] GDO: Saving primary data. [2025-09-17T19:12:11.344284] [DEBUG] [LOCAL ] GDO: Trimmed 9653 records to 6050 (keeping 200 days of data) [2025-09-17T19:12:11.381922] [DEBUG] [LOCAL ] GDO: Primary data saved (6050 records). [2025-09-17T19:12:11.382071] [INFO ] [MAIN ] GDO: Full history saved. [2025-09-17T19:12:11.382152] [INFO ] [MAIN ] Update Progress: 907/2371 symbols completed. GDO took 27.6s. Estimated remaining: 3h 33m 19s. Rate: 6.9 symbols/min [2025-09-17T19:12:11.550974] [INFO ] [MAIN ] GEF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:12:11.571825] [DEBUG] [LOCAL ] GEF: Loaded 20730 existing records from primary storage. [2025-09-17T19:12:11.571951] [INFO ] [MAIN ] GEF: Loaded 20730 existing records. [2025-09-17T19:12:11.626266] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-11. [2025-09-17T19:12:11.751482] [WARN ] [MAIN ] GEF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:12:11.751775] [INFO ] [MAIN ] GEF: Wiping existing primary data before full refresh. [2025-09-17T19:12:11.751824] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-17T19:12:11.752468] [DEBUG] [LOCAL ] GEF: Deleted primary data file. [2025-09-17T19:12:11.752517] [INFO ] [MAIN ] GEF: Starting full primary refresh. [2025-09-17T19:12:12.107621] [INFO ] [REMOTE ] GEF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:12:12.128353] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T19:12:12.415785] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-05. [2025-09-17T19:12:13.215798] [INFO ] [REMOTE ] GDV: Fetching primary data for 2024-12. [2025-09-17T19:12:13.500262] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T19:12:13.707614] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T19:12:14.015837] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-11. [2025-09-17T19:12:14.121334] [DEBUG] [REMOTE ] GEF: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-17T19:12:14.121757] [WARN ] [REMOTE ] GEF: No data returned for month 2024-11 [2025-09-17T19:12:14.374107] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T19:12:14.815838] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-06. [2025-09-17T19:12:15.615783] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-01. [2025-09-17T19:12:16.415747] [INFO ] [REMOTE ] GEF: Fetching primary data for 2024-12. [2025-09-17T19:12:16.844736] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T19:12:17.195598] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T19:12:17.215782] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-02. [2025-09-17T19:12:17.956751] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T19:12:18.021138] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-01. [2025-09-17T19:12:18.036598] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T19:12:18.815825] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-03. [2025-09-17T19:12:19.085513] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T19:12:19.615765] [INFO ] [REMOTE ] GE: Fetching primary data for 2024-12. [2025-09-17T19:12:19.870550] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T19:12:20.415797] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-02. [2025-09-17T19:12:21.215776] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-04. [2025-09-17T19:12:21.448923] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T19:12:21.618856] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T19:12:21.969808] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T19:12:22.015732] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-05. [2025-09-17T19:12:22.815831] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-01. [2025-09-17T19:12:23.139926] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T19:12:23.615803] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-06. [2025-09-17T19:12:24.415787] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-03. [2025-09-17T19:12:24.446500] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T19:12:25.003301] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-17T19:12:25.215843] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-02. [2025-09-17T19:12:25.480771] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T19:12:26.015898] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-07. [2025-09-17T19:12:26.815827] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-07. [2025-09-17T19:12:27.193175] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T19:12:27.493190] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T19:12:27.615815] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-03. [2025-09-17T19:12:27.906396] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T19:12:28.415804] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-04. [2025-09-17T19:12:29.215818] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-08. [2025-09-17T19:12:29.744617] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T19:12:29.825481] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T19:12:29.862065] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-17T19:12:30.015807] [INFO ] [REMOTE ] GDV: Fetching primary data for 2025-09. [2025-09-17T19:12:30.815791] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-05. [2025-09-17T19:12:31.015717] [INFO ] [REMOTE ] GDV: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T19:12:31.018426] [INFO ] [REMOTE ] GDV: Full fetch complete (28908 records). [2025-09-17T19:12:31.018552] [DEBUG] [VALIDATOR ] GDV: Validating primary data. [2025-09-17T19:12:31.417921] [DEBUG] [VALIDATOR ] GDV: All expected trading days are present. [2025-09-17T19:12:31.418010] [DEBUG] [VALIDATOR ] GDV: Primary data validation passed. [2025-09-17T19:12:31.418749] [INFO ] [MAIN ] GDV: Fetched primary data is valid. [2025-09-17T19:12:31.418832] [DEBUG] [LOCAL ] GDV: Saving primary data. [2025-09-17T19:12:31.419623] [DEBUG] [LOCAL ] GDV: Trimmed 28908 records to 20008 (keeping 200 days of data) [2025-09-17T19:12:31.519850] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T19:12:31.560471] [DEBUG] [LOCAL ] GDV: Primary data saved (20008 records). [2025-09-17T19:12:31.560618] [INFO ] [MAIN ] GDV: Full history saved. [2025-09-17T19:12:31.560740] [INFO ] [MAIN ] Update Progress: 908/2371 symbols completed. GDV took 26.3s. Estimated remaining: 3h 33m 29s. Rate: 6.9 symbols/min [2025-09-17T19:12:31.623997] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-06. [2025-09-17T19:12:31.737202] [INFO ] [MAIN ] GEL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:12:31.775258] [DEBUG] [LOCAL ] GEL: Loaded 34694 existing records from primary storage. [2025-09-17T19:12:31.775412] [INFO ] [MAIN ] GEL: Loaded 34694 existing records. [2025-09-17T19:12:31.973014] [WARN ] [MAIN ] GEL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:12:31.973402] [INFO ] [MAIN ] GEL: Wiping existing primary data before full refresh. [2025-09-17T19:12:31.973483] [INFO ] [LOCAL ] GEL: Starting deletion of primary data. [2025-09-17T19:12:31.974673] [DEBUG] [LOCAL ] GEL: Deleted primary data file. [2025-09-17T19:12:31.974747] [INFO ] [MAIN ] GEL: Starting full primary refresh. [2025-09-17T19:12:32.332292] [INFO ] [REMOTE ] GEL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:12:32.415797] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-11. [2025-09-17T19:12:32.936705] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T19:12:33.215788] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-07. [2025-09-17T19:12:33.816623] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T19:12:34.015776] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-08. [2025-09-17T19:12:34.357794] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T19:12:34.815872] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-04. [2025-09-17T19:12:35.549809] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T19:12:35.615902] [INFO ] [REMOTE ] GEL: Fetching primary data for 2024-12. [2025-09-17T19:12:36.415802] [INFO ] [REMOTE ] GDOT: Fetching primary data for 2025-09. [2025-09-17T19:12:36.742154] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T19:12:36.854739] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T19:12:37.215816] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-08. [2025-09-17T19:12:38.015823] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-01. [2025-09-17T19:12:38.055098] [INFO ] [REMOTE ] GDOT: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T19:12:38.061110] [INFO ] [REMOTE ] GDOT: Full fetch complete (52045 records). [2025-09-17T19:12:38.061338] [DEBUG] [VALIDATOR ] GDOT: Validating primary data. [2025-09-17T19:12:38.502411] [DEBUG] [VALIDATOR ] GDOT: All expected trading days are present. [2025-09-17T19:12:38.502991] [DEBUG] [VALIDATOR ] GDOT: Primary data validation passed. [2025-09-17T19:12:38.503975] [INFO ] [MAIN ] GDOT: Fetched primary data is valid. [2025-09-17T19:12:38.504918] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T19:12:38.505019] [DEBUG] [LOCAL ] GDOT: Saving primary data. [2025-09-17T19:12:38.512330] [DEBUG] [LOCAL ] GDOT: Trimmed 52045 records to 38613 (keeping 200 days of data) [2025-09-17T19:12:38.753942] [DEBUG] [LOCAL ] GDOT: Primary data saved (38613 records). [2025-09-17T19:12:38.754108] [INFO ] [MAIN ] GDOT: Full history saved. [2025-09-17T19:12:38.755327] [INFO ] [MAIN ] Update Progress: 909/2371 symbols completed. GDOT took 40.8s. Estimated remaining: 3h 33m 18s. Rate: 6.9 symbols/min [2025-09-17T19:12:38.821850] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-05. [2025-09-17T19:12:38.960695] [INFO ] [MAIN ] GENI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:12:39.025836] [DEBUG] [LOCAL ] GENI: Loaded 52869 existing records from primary storage. [2025-09-17T19:12:39.026008] [INFO ] [MAIN ] GENI: Loaded 52869 existing records. [2025-09-17T19:12:39.205951] [WARN ] [MAIN ] GENI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:12:39.206207] [INFO ] [MAIN ] GENI: Wiping existing primary data before full refresh. [2025-09-17T19:12:39.206252] [INFO ] [LOCAL ] GENI: Starting deletion of primary data. [2025-09-17T19:12:39.207343] [DEBUG] [LOCAL ] GENI: Deleted primary data file. [2025-09-17T19:12:39.207394] [INFO ] [MAIN ] GENI: Starting full primary refresh. [2025-09-17T19:12:39.569680] [INFO ] [REMOTE ] GENI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:12:39.593508] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T19:12:39.615730] [INFO ] [REMOTE ] GEF: Fetching primary data for 2025-09. [2025-09-17T19:12:40.415790] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-11. [2025-09-17T19:12:40.555881] [INFO ] [REMOTE ] GEF: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T19:12:40.559874] [INFO ] [REMOTE ] GEF: Full fetch complete (29063 records). [2025-09-17T19:12:40.559990] [DEBUG] [VALIDATOR ] GEF: Validating primary data. [2025-09-17T19:12:40.761940] [WARN ] [VALIDATOR ] GEF: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T19:12:40.762468] [FATAL] [MAIN ] GEF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:12:40.762545] [WARN ] [MAIN ] GEF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:12:40.762602] [INFO ] [LOCAL ] GEF: Starting deletion of primary data. [2025-09-17T19:12:40.762706] [DEBUG] [LOCAL ] GEF: No primary data file found to delete. [2025-09-17T19:12:40.762758] [INFO ] [LOCAL ] GEF: Starting deletion of derivative data. [2025-09-17T19:12:40.763208] [DEBUG] [LOCAL ] GEF: Deleted derivative data file. [2025-09-17T19:12:40.763332] [INFO ] [MAIN ] Update Progress: 910/2371 symbols completed. GEF took 29.4s. Estimated remaining: 3h 32m 58s. Rate: 6.9 symbols/min [2025-09-17T19:12:40.950370] [INFO ] [MAIN ] GEO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:12:41.025023] [DEBUG] [LOCAL ] GEO: Loaded 52262 existing records from primary storage. [2025-09-17T19:12:41.025330] [INFO ] [MAIN ] GEO: Loaded 52262 existing records. [2025-09-17T19:12:41.219780] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-02. [2025-09-17T19:12:41.228159] [WARN ] [MAIN ] GEO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:12:41.229627] [INFO ] [MAIN ] GEO: Wiping existing primary data before full refresh. [2025-09-17T19:12:41.229794] [INFO ] [LOCAL ] GEO: Starting deletion of primary data. [2025-09-17T19:12:41.231032] [DEBUG] [LOCAL ] GEO: Deleted primary data file. [2025-09-17T19:12:41.231100] [INFO ] [MAIN ] GEO: Starting full primary refresh. [2025-09-17T19:12:41.716006] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-09-17T19:12:41.711500] [INFO ] [REMOTE ] GEO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:12:41.902742] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T19:12:42.015793] [INFO ] [REMOTE ] GENI: Fetching primary data for 2024-12. [2025-09-17T19:12:42.206098] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T19:12:42.815806] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-03. [2025-09-17T19:12:43.615746] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-06. [2025-09-17T19:12:43.662276] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T19:12:43.856141] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T19:12:44.415788] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-04. [2025-09-17T19:12:45.215802] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-01. [2025-09-17T19:12:45.656859] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T19:12:45.703701] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T19:12:46.015791] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-07. [2025-09-17T19:12:46.571168] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T19:12:46.815778] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-02. [2025-09-17T19:12:47.615782] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-11. [2025-09-17T19:12:48.023762] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T19:12:48.336229] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T19:12:48.415785] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-03. [2025-09-17T19:12:49.215815] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-05. [2025-09-17T19:12:49.836394] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T19:12:50.015778] [INFO ] [REMOTE ] GEO: Fetching primary data for 2024-12. [2025-09-17T19:12:50.249597] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T19:12:50.624722] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T19:12:50.815774] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-06. [2025-09-17T19:12:51.615770] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-04. [2025-09-17T19:12:51.817435] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T19:12:52.244354] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T19:12:52.415785] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-01. [2025-09-17T19:12:53.139683] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T19:12:53.215804] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-07. [2025-09-17T19:12:54.015810] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-05. [2025-09-17T19:12:54.456704] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T19:12:54.507789] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T19:12:54.815772] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-08. [2025-09-17T19:12:55.428497] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T19:12:55.615775] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-06. [2025-09-17T19:12:56.211312] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T19:12:56.415761] [INFO ] [REMOTE ] GEL: Fetching primary data for 2025-09. [2025-09-17T19:12:57.061204] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T19:12:57.215764] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-07. [2025-09-17T19:12:57.644312] [INFO ] [REMOTE ] GEL: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T19:12:57.648053] [INFO ] [REMOTE ] GEL: Full fetch complete (48612 records). [2025-09-17T19:12:57.648145] [DEBUG] [VALIDATOR ] GEL: Validating primary data. [2025-09-17T19:12:58.028329] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-08. [2025-09-17T19:12:58.031367] [DEBUG] [VALIDATOR ] GEL: All expected trading days are present. [2025-09-17T19:12:58.031441] [DEBUG] [VALIDATOR ] GEL: Primary data validation passed. [2025-09-17T19:12:58.033323] [INFO ] [MAIN ] GEL: Fetched primary data is valid. [2025-09-17T19:12:58.033376] [DEBUG] [LOCAL ] GEL: Saving primary data. [2025-09-17T19:12:58.034563] [DEBUG] [LOCAL ] GEL: Trimmed 48612 records to 34632 (keeping 200 days of data) [2025-09-17T19:12:58.257685] [DEBUG] [LOCAL ] GEL: Primary data saved (34632 records). [2025-09-17T19:12:58.257840] [INFO ] [MAIN ] GEL: Full history saved. [2025-09-17T19:12:58.257954] [INFO ] [MAIN ] Update Progress: 911/2371 symbols completed. GEL took 26.7s. Estimated remaining: 3h 33m 3s. Rate: 6.9 symbols/min [2025-09-17T19:12:58.427797] [INFO ] [MAIN ] GES: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:12:58.468882] [DEBUG] [LOCAL ] GES: Loaded 40748 existing records from primary storage. [2025-09-17T19:12:58.469051] [INFO ] [MAIN ] GES: Loaded 40748 existing records. [2025-09-17T19:12:58.646883] [WARN ] [MAIN ] GES: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:12:58.647102] [INFO ] [MAIN ] GES: Wiping existing primary data before full refresh. [2025-09-17T19:12:58.647147] [INFO ] [LOCAL ] GES: Starting deletion of primary data. [2025-09-17T19:12:58.648189] [DEBUG] [LOCAL ] GES: Deleted primary data file. [2025-09-17T19:12:58.648238] [INFO ] [MAIN ] GES: Starting full primary refresh. [2025-09-17T19:12:58.823568] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-02. [2025-09-17T19:12:59.012760] [INFO ] [REMOTE ] GES: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:12:59.055980] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T19:12:59.615764] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-08. [2025-09-17T19:13:00.239671] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-17T19:13:00.415918] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-11. [2025-09-17T19:13:00.713160] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T19:13:01.215881] [INFO ] [REMOTE ] GE: Fetching primary data for 2025-09. [2025-09-17T19:13:01.749666] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T19:13:01.792469] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T19:13:02.015830] [INFO ] [REMOTE ] GENI: Fetching primary data for 2025-09. [2025-09-17T19:13:02.815872] [INFO ] [REMOTE ] GES: Fetching primary data for 2024-12. [2025-09-17T19:13:03.452012] [INFO ] [REMOTE ] GE: Incremental fetch complete for 2025-09 (2.24 seconds). [2025-09-17T19:13:03.460960] [INFO ] [REMOTE ] GE: Full fetch complete (77671 records). [2025-09-17T19:13:03.461252] [DEBUG] [VALIDATOR ] GE: Validating primary data. [2025-09-17T19:13:03.625799] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-03. [2025-09-17T19:13:03.887930] [DEBUG] [VALIDATOR ] GE: All expected trading days are present. [2025-09-17T19:13:03.888198] [DEBUG] [VALIDATOR ] GE: Primary data validation passed. [2025-09-17T19:13:03.889599] [INFO ] [MAIN ] GE: Fetched primary data is valid. [2025-09-17T19:13:03.889713] [DEBUG] [LOCAL ] GE: Saving primary data. [2025-09-17T19:13:03.916060] [INFO ] [REMOTE ] GENI: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T19:13:03.916358] [DEBUG] [LOCAL ] GE: Trimmed 77671 records to 53715 (keeping 200 days of data) [2025-09-17T19:13:03.926671] [INFO ] [REMOTE ] GENI: Full fetch complete (75249 records). [2025-09-17T19:13:03.926930] [DEBUG] [VALIDATOR ] GENI: Validating primary data. [2025-09-17T19:13:04.647568] [DEBUG] [VALIDATOR ] GENI: All expected trading days are present. [2025-09-17T19:13:04.657314] [DEBUG] [VALIDATOR ] GENI: Primary data validation passed. [2025-09-17T19:13:04.658874] [INFO ] [MAIN ] GENI: Fetched primary data is valid. [2025-09-17T19:13:04.695851] [DEBUG] [LOCAL ] GENI: Saving primary data. [2025-09-17T19:13:04.741559] [DEBUG] [LOCAL ] GENI: Trimmed 75249 records to 52914 (keeping 200 days of data) [2025-09-17T19:13:04.759149] [DEBUG] [LOCAL ] GE: Primary data saved (53715 records). [2025-09-17T19:13:04.771009] [INFO ] [MAIN ] GE: Full history saved. [2025-09-17T19:13:04.776433] [INFO ] [MAIN ] Update Progress: 912/2371 symbols completed. GE took 57.9s. Estimated remaining: 3h 32m 51s. Rate: 6.9 symbols/min [2025-09-17T19:13:04.956392] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-17T19:13:05.010074] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-01. [2025-09-17T19:13:05.088074] [INFO ] [MAIN ] GETY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:13:05.259040] [DEBUG] [LOCAL ] GETY: Loaded 36507 existing records from primary storage. [2025-09-17T19:13:05.260573] [INFO ] [MAIN ] GETY: Loaded 36507 existing records. [2025-09-17T19:13:05.473498] [WARN ] [MAIN ] GETY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:13:05.476033] [INFO ] [MAIN ] GETY: Wiping existing primary data before full refresh. [2025-09-17T19:13:05.476496] [INFO ] [LOCAL ] GETY: Starting deletion of primary data. [2025-09-17T19:13:05.481055] [DEBUG] [LOCAL ] GETY: Deleted primary data file. [2025-09-17T19:13:05.481481] [INFO ] [MAIN ] GETY: Starting full primary refresh. [2025-09-17T19:13:05.900314] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-17T19:13:05.994422] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-04. [2025-09-17T19:13:05.999143] [INFO ] [REMOTE ] GETY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:13:06.012992] [DEBUG] [LOCAL ] GENI: Primary data saved (52914 records). [2025-09-17T19:13:06.013142] [INFO ] [MAIN ] GENI: Full history saved. [2025-09-17T19:13:06.014050] [INFO ] [MAIN ] Update Progress: 913/2371 symbols completed. GENI took 27.3s. Estimated remaining: 3h 32m 30s. Rate: 6.9 symbols/min [2025-09-17T19:13:06.026098] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-11. [2025-09-17T19:13:06.199191] [INFO ] [MAIN ] GEV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:13:06.261428] [DEBUG] [LOCAL ] GEV: Loaded 53182 existing records from primary storage. [2025-09-17T19:13:06.261722] [INFO ] [MAIN ] GEV: Loaded 53182 existing records. [2025-09-17T19:13:06.455292] [WARN ] [MAIN ] GEV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:13:06.455660] [INFO ] [MAIN ] GEV: Wiping existing primary data before full refresh. [2025-09-17T19:13:06.455727] [INFO ] [LOCAL ] GEV: Starting deletion of primary data. [2025-09-17T19:13:06.456960] [DEBUG] [LOCAL ] GEV: Deleted primary data file. [2025-09-17T19:13:06.457016] [INFO ] [MAIN ] GEV: Starting full primary refresh. [2025-09-17T19:13:06.879780] [INFO ] [REMOTE ] GEV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:13:06.882389] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-11. [2025-09-17T19:13:06.882005] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T19:13:07.516810] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T19:13:07.615855] [INFO ] [REMOTE ] GETY: Fetching primary data for 2024-12. [2025-09-17T19:13:07.918872] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T19:13:08.415853] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-02. [2025-09-17T19:13:08.795087] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T19:13:08.905939] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T19:13:09.215829] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-01. [2025-09-17T19:13:09.554556] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T19:13:10.015875] [INFO ] [REMOTE ] GEV: Fetching primary data for 2024-12. [2025-09-17T19:13:10.790720] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T19:13:10.815838] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-05. [2025-09-17T19:13:11.615815] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-02. [2025-09-17T19:13:12.216226] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2024-12 (2.20 seconds). [2025-09-17T19:13:12.343407] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T19:13:12.415822] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-01. [2025-09-17T19:13:13.077786] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T19:13:13.215787] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-03. [2025-09-17T19:13:14.015799] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-03. [2025-09-17T19:13:14.688111] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-17T19:13:14.815799] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-06. [2025-09-17T19:13:15.050666] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T19:13:15.278230] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T19:13:15.615788] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-04. [2025-09-17T19:13:16.415777] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-02. [2025-09-17T19:13:16.525020] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T19:13:17.140186] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T19:13:17.215739] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-05. [2025-09-17T19:13:18.015818] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-04. [2025-09-17T19:13:18.723298] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-17T19:13:18.755003] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T19:13:18.815801] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-06. [2025-09-17T19:13:19.134844] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T19:13:19.615786] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-03. [2025-09-17T19:13:20.373849] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T19:13:20.415766] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-07. [2025-09-17T19:13:21.215778] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-07. [2025-09-17T19:13:21.606571] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T19:13:21.764264] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T19:13:22.015802] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-05. [2025-09-17T19:13:22.805933] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T19:13:22.816791] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-04. [2025-09-17T19:13:23.417891] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T19:13:23.615800] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-08. [2025-09-17T19:13:24.415814] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-06. [2025-09-17T19:13:24.782856] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T19:13:24.821161] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T19:13:25.215786] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-08. [2025-09-17T19:13:25.868953] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T19:13:26.015774] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-07. [2025-09-17T19:13:26.815807] [INFO ] [REMOTE ] GES: Fetching primary data for 2025-09. [2025-09-17T19:13:27.076559] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T19:13:27.236109] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T19:13:27.615842] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-08. [2025-09-17T19:13:28.176927] [INFO ] [REMOTE ] GES: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T19:13:28.182319] [INFO ] [REMOTE ] GES: Full fetch complete (60453 records). [2025-09-17T19:13:28.182491] [DEBUG] [VALIDATOR ] GES: Validating primary data. [2025-09-17T19:13:28.422911] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-05. [2025-09-17T19:13:28.600139] [DEBUG] [VALIDATOR ] GES: All expected trading days are present. [2025-09-17T19:13:28.600246] [DEBUG] [VALIDATOR ] GES: Primary data validation passed. [2025-09-17T19:13:28.601100] [INFO ] [MAIN ] GES: Fetched primary data is valid. [2025-09-17T19:13:28.601149] [DEBUG] [LOCAL ] GES: Saving primary data. [2025-09-17T19:13:28.602348] [DEBUG] [LOCAL ] GES: Trimmed 60453 records to 40626 (keeping 200 days of data) [2025-09-17T19:13:28.840243] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T19:13:28.880418] [DEBUG] [LOCAL ] GES: Primary data saved (40626 records). [2025-09-17T19:13:28.880540] [INFO ] [MAIN ] GES: Full history saved. [2025-09-17T19:13:28.880632] [INFO ] [MAIN ] Update Progress: 914/2371 symbols completed. GES took 30.6s. Estimated remaining: 3h 32m 44s. Rate: 6.8 symbols/min [2025-09-17T19:13:29.049592] [INFO ] [MAIN ] GF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:13:29.055315] [DEBUG] [LOCAL ] GF: Loaded 3531 existing records from primary storage. [2025-09-17T19:13:29.055428] [INFO ] [MAIN ] GF: Loaded 3531 existing records. [2025-09-17T19:13:29.235405] [INFO ] [REMOTE ] GETY: Fetching primary data for 2025-09. [2025-09-17T19:13:29.240109] [WARN ] [MAIN ] GF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:13:29.241093] [INFO ] [MAIN ] GF: Wiping existing primary data before full refresh. [2025-09-17T19:13:29.241141] [INFO ] [LOCAL ] GF: Starting deletion of primary data. [2025-09-17T19:13:29.241369] [DEBUG] [LOCAL ] GF: Deleted primary data file. [2025-09-17T19:13:29.241411] [INFO ] [MAIN ] GF: Starting full primary refresh. [2025-09-17T19:13:29.600956] [INFO ] [REMOTE ] GF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:13:30.015787] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-11. [2025-09-17T19:13:30.414207] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-17T19:13:30.766534] [INFO ] [REMOTE ] GETY: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T19:13:30.771396] [INFO ] [REMOTE ] GETY: Full fetch complete (55710 records). [2025-09-17T19:13:30.771723] [DEBUG] [VALIDATOR ] GETY: Validating primary data. [2025-09-17T19:13:30.815758] [INFO ] [REMOTE ] GEO: Fetching primary data for 2025-09. [2025-09-17T19:13:31.173499] [DEBUG] [VALIDATOR ] GETY: All expected trading days are present. [2025-09-17T19:13:31.173637] [DEBUG] [VALIDATOR ] GETY: Primary data validation passed. [2025-09-17T19:13:31.174585] [INFO ] [MAIN ] GETY: Fetched primary data is valid. [2025-09-17T19:13:31.174635] [DEBUG] [LOCAL ] GETY: Saving primary data. [2025-09-17T19:13:31.193823] [DEBUG] [LOCAL ] GETY: Trimmed 55710 records to 36392 (keeping 200 days of data) [2025-09-17T19:13:31.213703] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-05 (2.79 seconds). [2025-09-17T19:13:31.434724] [DEBUG] [LOCAL ] GETY: Primary data saved (36392 records). [2025-09-17T19:13:31.434893] [INFO ] [MAIN ] GETY: Full history saved. [2025-09-17T19:13:31.434986] [INFO ] [MAIN ] Update Progress: 915/2371 symbols completed. GETY took 26.7s. Estimated remaining: 3h 32m 25s. Rate: 6.9 symbols/min [2025-09-17T19:13:31.608469] [INFO ] [MAIN ] GFF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:13:31.615921] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-06. [2025-09-17T19:13:31.645954] [DEBUG] [LOCAL ] GFF: Loaded 31300 existing records from primary storage. [2025-09-17T19:13:31.646130] [INFO ] [MAIN ] GFF: Loaded 31300 existing records. [2025-09-17T19:13:31.832337] [WARN ] [MAIN ] GFF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:13:31.832603] [INFO ] [MAIN ] GFF: Wiping existing primary data before full refresh. [2025-09-17T19:13:31.832671] [INFO ] [LOCAL ] GFF: Starting deletion of primary data. [2025-09-17T19:13:31.833424] [DEBUG] [LOCAL ] GFF: Deleted primary data file. [2025-09-17T19:13:31.833472] [INFO ] [MAIN ] GFF: Starting full primary refresh. [2025-09-17T19:13:32.185236] [INFO ] [REMOTE ] GFF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:13:32.415774] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-11. [2025-09-17T19:13:32.441591] [INFO ] [REMOTE ] GEO: Incremental fetch complete for 2025-09 (1.63 seconds). [2025-09-17T19:13:32.449806] [INFO ] [REMOTE ] GEO: Full fetch complete (75562 records). [2025-09-17T19:13:32.450110] [DEBUG] [VALIDATOR ] GEO: Validating primary data. [2025-09-17T19:13:32.898746] [DEBUG] [VALIDATOR ] GEO: All expected trading days are present. [2025-09-17T19:13:32.898878] [DEBUG] [VALIDATOR ] GEO: Primary data validation passed. [2025-09-17T19:13:32.900094] [INFO ] [MAIN ] GEO: Fetched primary data is valid. [2025-09-17T19:13:32.900164] [DEBUG] [LOCAL ] GEO: Saving primary data. [2025-09-17T19:13:32.902819] [DEBUG] [LOCAL ] GEO: Trimmed 75562 records to 52241 (keeping 200 days of data) [2025-09-17T19:13:33.218094] [INFO ] [REMOTE ] GF: Fetching primary data for 2024-12. [2025-09-17T19:13:33.243702] [DEBUG] [LOCAL ] GEO: Primary data saved (52241 records). [2025-09-17T19:13:33.243860] [INFO ] [MAIN ] GEO: Full history saved. [2025-09-17T19:13:33.243995] [INFO ] [MAIN ] Update Progress: 916/2371 symbols completed. GEO took 52.5s. Estimated remaining: 3h 32m 5s. Rate: 6.9 symbols/min [2025-09-17T19:13:33.425631] [INFO ] [MAIN ] GFI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:13:33.480206] [DEBUG] [LOCAL ] GFI: Loaded 53093 existing records from primary storage. [2025-09-17T19:13:33.480412] [INFO ] [MAIN ] GFI: Loaded 53093 existing records. [2025-09-17T19:13:33.667215] [WARN ] [MAIN ] GFI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:13:33.667533] [INFO ] [MAIN ] GFI: Wiping existing primary data before full refresh. [2025-09-17T19:13:33.667585] [INFO ] [LOCAL ] GFI: Starting deletion of primary data. [2025-09-17T19:13:33.668874] [DEBUG] [LOCAL ] GFI: Deleted primary data file. [2025-09-17T19:13:33.668934] [INFO ] [MAIN ] GFI: Starting full primary refresh. [2025-09-17T19:13:33.806963] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T19:13:34.060907] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-01. [2025-09-17T19:13:34.116841] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T19:13:34.113376] [INFO ] [REMOTE ] GFI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:13:34.168309] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-17T19:13:34.606708] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T19:13:34.815817] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-02. [2025-09-17T19:13:35.407063] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T19:13:35.615811] [INFO ] [REMOTE ] GFF: Fetching primary data for 2024-12. [2025-09-17T19:13:36.415888] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-07. [2025-09-17T19:13:36.892723] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T19:13:37.215838] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-03. [2025-09-17T19:13:37.800546] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T19:13:38.015895] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-01. [2025-09-17T19:13:38.725479] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-07 (2.31 seconds). [2025-09-17T19:13:38.815728] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-08. [2025-09-17T19:13:39.374569] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T19:13:39.615846] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-04. [2025-09-17T19:13:40.043753] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T19:13:40.415787] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-11. [2025-09-17T19:13:41.153576] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-17T19:13:41.215736] [INFO ] [REMOTE ] GEV: Fetching primary data for 2025-09. [2025-09-17T19:13:42.015748] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-02. [2025-09-17T19:13:42.058842] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T19:13:42.815843] [INFO ] [REMOTE ] GFI: Fetching primary data for 2024-12. [2025-09-17T19:13:43.351360] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T19:13:43.495147] [INFO ] [REMOTE ] GEV: Incremental fetch complete for 2025-09 (2.28 seconds). [2025-09-17T19:13:43.504741] [INFO ] [REMOTE ] GEV: Full fetch complete (76893 records). [2025-09-17T19:13:43.504932] [DEBUG] [VALIDATOR ] GEV: Validating primary data. [2025-09-17T19:13:43.620908] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-03. [2025-09-17T19:13:43.928287] [DEBUG] [VALIDATOR ] GEV: All expected trading days are present. [2025-09-17T19:13:43.928377] [DEBUG] [VALIDATOR ] GEV: Primary data validation passed. [2025-09-17T19:13:43.929326] [INFO ] [MAIN ] GEV: Fetched primary data is valid. [2025-09-17T19:13:43.929385] [DEBUG] [LOCAL ] GEV: Saving primary data. [2025-09-17T19:13:43.930984] [DEBUG] [LOCAL ] GEV: Trimmed 76893 records to 53169 (keeping 200 days of data) [2025-09-17T19:13:44.285209] [DEBUG] [LOCAL ] GEV: Primary data saved (53169 records). [2025-09-17T19:13:44.285403] [INFO ] [MAIN ] GEV: Full history saved. [2025-09-17T19:13:44.286260] [INFO ] [MAIN ] Update Progress: 917/2371 symbols completed. GEV took 38.3s. Estimated remaining: 3h 32m 0s. Rate: 6.9 symbols/min [2025-09-17T19:13:44.415785] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-05. [2025-09-17T19:13:44.541248] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T19:13:45.059007] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T19:13:45.155887] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T19:13:45.215731] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-04. [2025-09-17T19:13:46.015836] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-01. [2025-09-17T19:13:46.739680] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T19:13:46.815735] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-05. [2025-09-17T19:13:47.615830] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-06. [2025-09-17T19:13:47.823588] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T19:13:47.882670] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T19:13:48.019492] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-17T19:13:48.415848] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-06. [2025-09-17T19:13:49.215797] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-07. [2025-09-17T19:13:49.330977] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T19:13:49.611129] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T19:13:50.015779] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-08. [2025-09-17T19:13:50.566885] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T19:13:50.815773] [INFO ] [REMOTE ] GF: Fetching primary data for 2025-09. [2025-09-17T19:13:51.281329] [INFO ] [REMOTE ] GF: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T19:13:51.282139] [INFO ] [REMOTE ] GF: Full fetch complete (5431 records). [2025-09-17T19:13:51.282207] [DEBUG] [VALIDATOR ] GF: Validating primary data. [2025-09-17T19:13:51.620881] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-02. [2025-09-17T19:13:51.718611] [DEBUG] [VALIDATOR ] GF: All expected trading days are present. [2025-09-17T19:13:51.718719] [DEBUG] [VALIDATOR ] GF: Primary data validation passed. [2025-09-17T19:13:51.718903] [INFO ] [MAIN ] GF: Fetched primary data is valid. [2025-09-17T19:13:51.718943] [DEBUG] [LOCAL ] GF: Saving primary data. [2025-09-17T19:13:51.719338] [DEBUG] [LOCAL ] GF: Trimmed 5431 records to 3513 (keeping 200 days of data) [2025-09-17T19:13:51.744049] [DEBUG] [LOCAL ] GF: Primary data saved (3513 records). [2025-09-17T19:13:51.744148] [INFO ] [MAIN ] GF: Full history saved. [2025-09-17T19:13:51.744233] [INFO ] [MAIN ] Update Progress: 918/2371 symbols completed. GF took 22.9s. Estimated remaining: 3h 31m 50s. Rate: 6.9 symbols/min [2025-09-17T19:13:52.415792] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-07. [2025-09-17T19:13:53.502475] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T19:13:53.508831] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-08. [2025-09-17T19:13:53.573929] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T19:13:54.015777] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-03. [2025-09-17T19:13:54.553365] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T19:13:54.815795] [INFO ] [REMOTE ] GFF: Fetching primary data for 2025-09. [2025-09-17T19:13:55.880753] [INFO ] [REMOTE ] GFF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T19:13:55.884632] [INFO ] [REMOTE ] GFF: Full fetch complete (44245 records). [2025-09-17T19:13:55.884748] [DEBUG] [VALIDATOR ] GFF: Validating primary data. [2025-09-17T19:13:56.267147] [DEBUG] [VALIDATOR ] GFF: All expected trading days are present. [2025-09-17T19:13:56.267287] [DEBUG] [VALIDATOR ] GFF: Primary data validation passed. [2025-09-17T19:13:56.267980] [INFO ] [MAIN ] GFF: Fetched primary data is valid. [2025-09-17T19:13:56.268033] [DEBUG] [LOCAL ] GFF: Saving primary data. [2025-09-17T19:13:56.269309] [DEBUG] [LOCAL ] GFF: Trimmed 44245 records to 31214 (keeping 200 days of data) [2025-09-17T19:13:56.355793] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-17T19:13:56.402233] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-04. [2025-09-17T19:13:56.506682] [DEBUG] [LOCAL ] GFF: Primary data saved (31214 records). [2025-09-17T19:13:56.506828] [INFO ] [MAIN ] GFF: Full history saved. [2025-09-17T19:13:56.506939] [INFO ] [MAIN ] Update Progress: 919/2371 symbols completed. GFF took 25.1s. Estimated remaining: 3h 31m 35s. Rate: 6.9 symbols/min [2025-09-17T19:13:58.157527] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T19:13:58.169394] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-05. [2025-09-17T19:14:00.100724] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T19:14:00.113088] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-06. [2025-09-17T19:14:02.139527] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T19:14:02.153515] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-07. [2025-09-17T19:14:03.789979] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T19:14:03.801452] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-08. [2025-09-17T19:14:05.795725] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T19:14:05.809039] [INFO ] [REMOTE ] GFI: Fetching primary data for 2025-09. [2025-09-17T19:14:08.124341] [INFO ] [REMOTE ] GFI: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-17T19:14:08.133230] [INFO ] [REMOTE ] GFI: Full fetch complete (76067 records). [2025-09-17T19:14:08.133445] [DEBUG] [VALIDATOR ] GFI: Validating primary data. [2025-09-17T19:14:08.538112] [DEBUG] [VALIDATOR ] GFI: All expected trading days are present. [2025-09-17T19:14:08.538208] [DEBUG] [VALIDATOR ] GFI: Primary data validation passed. [2025-09-17T19:14:08.539132] [INFO ] [MAIN ] GFI: Fetched primary data is valid. [2025-09-17T19:14:08.539201] [DEBUG] [LOCAL ] GFI: Saving primary data. [2025-09-17T19:14:08.540762] [DEBUG] [LOCAL ] GFI: Trimmed 76067 records to 53094 (keeping 200 days of data) [2025-09-17T19:14:08.882379] [DEBUG] [LOCAL ] GFI: Primary data saved (53094 records). [2025-09-17T19:14:08.882607] [INFO ] [MAIN ] GFI: Full history saved. [2025-09-17T19:14:08.882746] [INFO ] [MAIN ] Update Progress: 920/2371 symbols completed. GFI took 35.6s. Estimated remaining: 3h 31m 32s. Rate: 6.9 symbols/min [2025-09-17T19:14:09.481419] [INFO ] [MAIN ] GGG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:14:09.466142] [INFO ] [MAIN ] GFR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:14:09.554128] [INFO ] [MAIN ] GGB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:14:09.557245] [INFO ] [MAIN ] GFL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:14:09.568153] [DEBUG] [LOCAL ] GFR: Loaded 8419 existing records from primary storage. [2025-09-17T19:14:09.568336] [INFO ] [MAIN ] GFR: Loaded 8419 existing records. [2025-09-17T19:14:09.801420] [WARN ] [MAIN ] GFR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:14:09.802579] [DEBUG] [LOCAL ] GGG: Loaded 41189 existing records from primary storage. [2025-09-17T19:14:09.802474] [INFO ] [MAIN ] GFR: Wiping existing primary data before full refresh. [2025-09-17T19:14:09.802775] [INFO ] [LOCAL ] GFR: Starting deletion of primary data. [2025-09-17T19:14:09.802839] [INFO ] [MAIN ] GGG: Loaded 41189 existing records. [2025-09-17T19:14:09.826921] [DEBUG] [LOCAL ] GFR: Deleted primary data file. [2025-09-17T19:14:09.851267] [INFO ] [MAIN ] GFR: Starting full primary refresh. [2025-09-17T19:14:09.901367] [DEBUG] [LOCAL ] GGB: Loaded 50999 existing records from primary storage. [2025-09-17T19:14:09.931067] [INFO ] [MAIN ] GGB: Loaded 50999 existing records. [2025-09-17T19:14:10.095164] [DEBUG] [LOCAL ] GFL: Loaded 48262 existing records from primary storage. [2025-09-17T19:14:10.197471] [INFO ] [MAIN ] GFL: Loaded 48262 existing records. [2025-09-17T19:14:10.334077] [WARN ] [MAIN ] GGG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:14:10.548733] [INFO ] [MAIN ] GGG: Wiping existing primary data before full refresh. [2025-09-17T19:14:10.586428] [INFO ] [LOCAL ] GGG: Starting deletion of primary data. [2025-09-17T19:14:10.589710] [WARN ] [MAIN ] GGB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:14:10.590379] [INFO ] [MAIN ] GGB: Wiping existing primary data before full refresh. [2025-09-17T19:14:10.595850] [DEBUG] [LOCAL ] GGG: Deleted primary data file. [2025-09-17T19:14:10.595928] [INFO ] [LOCAL ] GGB: Starting deletion of primary data. [2025-09-17T19:14:10.632215] [DEBUG] [LOCAL ] GGB: Deleted primary data file. [2025-09-17T19:14:10.601380] [INFO ] [MAIN ] GGG: Starting full primary refresh. [2025-09-17T19:14:10.642550] [INFO ] [MAIN ] GGB: Starting full primary refresh. [2025-09-17T19:14:10.821215] [WARN ] [MAIN ] GFL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:14:10.885777] [INFO ] [REMOTE ] GFR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:14:10.932909] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-11. [2025-09-17T19:14:10.948313] [INFO ] [MAIN ] GFL: Wiping existing primary data before full refresh. [2025-09-17T19:14:10.951985] [INFO ] [LOCAL ] GFL: Starting deletion of primary data. [2025-09-17T19:14:10.978387] [DEBUG] [LOCAL ] GFL: Deleted primary data file. [2025-09-17T19:14:11.013227] [INFO ] [MAIN ] GFL: Starting full primary refresh. [2025-09-17T19:14:11.717512] [INFO ] [REMOTE ] GGG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:14:11.731778] [INFO ] [REMOTE ] GGB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:14:11.737596] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-11. [2025-09-17T19:14:11.749015] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-11. [2025-09-17T19:14:11.832876] [INFO ] [REMOTE ] GFL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:14:11.833272] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-11. [2025-09-17T19:14:11.975127] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T19:14:11.979030] [INFO ] [REMOTE ] GFR: Fetching primary data for 2024-12. [2025-09-17T19:14:12.885501] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T19:14:12.889306] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-01. [2025-09-17T19:14:13.255044] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T19:14:13.265241] [INFO ] [REMOTE ] GGB: Fetching primary data for 2024-12. [2025-09-17T19:14:13.292977] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T19:14:13.301912] [INFO ] [REMOTE ] GGG: Fetching primary data for 2024-12. [2025-09-17T19:14:13.352555] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T19:14:13.355290] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-02. [2025-09-17T19:14:13.623160] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T19:14:13.632480] [INFO ] [REMOTE ] GFL: Fetching primary data for 2024-12. [2025-09-17T19:14:14.140237] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T19:14:14.142568] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-03. [2025-09-17T19:14:14.496759] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T19:14:14.505320] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-01. [2025-09-17T19:14:14.678880] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T19:14:14.681973] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-04. [2025-09-17T19:14:14.757725] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T19:14:14.768719] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-01. [2025-09-17T19:14:15.106337] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T19:14:15.119270] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-01. [2025-09-17T19:14:15.296061] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T19:14:15.300443] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-05. [2025-09-17T19:14:15.888881] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T19:14:15.897606] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-02. [2025-09-17T19:14:16.089990] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T19:14:16.092973] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-06. [2025-09-17T19:14:16.176547] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T19:14:16.187340] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-02. [2025-09-17T19:14:16.375525] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T19:14:16.385079] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-02. [2025-09-17T19:14:16.579666] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T19:14:16.581760] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-07. [2025-09-17T19:14:17.253326] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T19:14:17.255723] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-08. [2025-09-17T19:14:17.322242] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T19:14:17.737891] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T19:14:17.796389] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T19:14:17.868762] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T19:14:18.015797] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-03. [2025-09-17T19:14:18.815809] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-03. [2025-09-17T19:14:19.380378] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T19:14:19.615829] [INFO ] [REMOTE ] GFR: Fetching primary data for 2025-09. [2025-09-17T19:14:20.415788] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-03. [2025-09-17T19:14:20.589681] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T19:14:20.610106] [INFO ] [REMOTE ] GFR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T19:14:20.611636] [INFO ] [REMOTE ] GFR: Full fetch complete (13104 records). [2025-09-17T19:14:20.611726] [DEBUG] [VALIDATOR ] GFR: Validating primary data. [2025-09-17T19:14:20.965173] [DEBUG] [VALIDATOR ] GFR: All expected trading days are present. [2025-09-17T19:14:20.965252] [DEBUG] [VALIDATOR ] GFR: Primary data validation passed. [2025-09-17T19:14:20.965564] [INFO ] [MAIN ] GFR: Fetched primary data is valid. [2025-09-17T19:14:20.965603] [DEBUG] [LOCAL ] GFR: Saving primary data. [2025-09-17T19:14:20.966090] [DEBUG] [LOCAL ] GFR: Trimmed 13104 records to 8558 (keeping 200 days of data) [2025-09-17T19:14:21.017438] [DEBUG] [LOCAL ] GFR: Primary data saved (8558 records). [2025-09-17T19:14:21.017609] [INFO ] [MAIN ] GFR: Full history saved. [2025-09-17T19:14:21.017726] [INFO ] [MAIN ] Update Progress: 921/2371 symbols completed. GFR took 12.1s. Estimated remaining: 3h 31m 28s. Rate: 6.9 symbols/min [2025-09-17T19:14:21.187422] [INFO ] [MAIN ] GGT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:14:21.201961] [DEBUG] [LOCAL ] GGT: Loaded 14137 existing records from primary storage. [2025-09-17T19:14:21.202092] [INFO ] [MAIN ] GGT: Loaded 14137 existing records. [2025-09-17T19:14:21.222984] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-04. [2025-09-17T19:14:21.381347] [WARN ] [MAIN ] GGT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:14:21.381602] [INFO ] [MAIN ] GGT: Wiping existing primary data before full refresh. [2025-09-17T19:14:21.381665] [INFO ] [LOCAL ] GGT: Starting deletion of primary data. [2025-09-17T19:14:21.382093] [DEBUG] [LOCAL ] GGT: Deleted primary data file. [2025-09-17T19:14:21.382138] [INFO ] [MAIN ] GGT: Starting full primary refresh. [2025-09-17T19:14:21.736111] [INFO ] [REMOTE ] GGT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:14:22.015837] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-11. [2025-09-17T19:14:22.190513] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T19:14:22.621442] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T19:14:22.742408] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T19:14:22.815858] [INFO ] [REMOTE ] GGT: Fetching primary data for 2024-12. [2025-09-17T19:14:23.443594] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T19:14:23.615831] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-04. [2025-09-17T19:14:24.415823] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-05. [2025-09-17T19:14:25.215815] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-01. [2025-09-17T19:14:25.276135] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T19:14:25.950847] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T19:14:26.015833] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-04. [2025-09-17T19:14:26.047822] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T19:14:26.815781] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-05. [2025-09-17T19:14:27.615836] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-02. [2025-09-17T19:14:27.837357] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T19:14:28.179594] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T19:14:28.416674] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T19:14:28.416198] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-06. [2025-09-17T19:14:29.215842] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-06. [2025-09-17T19:14:29.527262] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T19:14:30.015797] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-07. [2025-09-17T19:14:30.286074] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T19:14:30.815772] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-03. [2025-09-17T19:14:31.453492] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T19:14:31.569136] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T19:14:31.615748] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-07. [2025-09-17T19:14:32.415792] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-08. [2025-09-17T19:14:33.017537] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T19:14:33.215758] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-08. [2025-09-17T19:14:33.822850] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T19:14:34.015800] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-05. [2025-09-17T19:14:34.715453] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T19:14:34.815763] [INFO ] [REMOTE ] GFL: Fetching primary data for 2025-09. [2025-09-17T19:14:35.441856] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T19:14:35.615819] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-04. [2025-09-17T19:14:36.375327] [INFO ] [REMOTE ] GFL: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T19:14:36.381704] [INFO ] [REMOTE ] GFL: Full fetch complete (68539 records). [2025-09-17T19:14:36.381865] [DEBUG] [VALIDATOR ] GFL: Validating primary data. [2025-09-17T19:14:36.420933] [INFO ] [REMOTE ] GGG: Fetching primary data for 2025-09. [2025-09-17T19:14:36.560400] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T19:14:36.811479] [DEBUG] [VALIDATOR ] GFL: All expected trading days are present. [2025-09-17T19:14:36.811584] [DEBUG] [VALIDATOR ] GFL: Primary data validation passed. [2025-09-17T19:14:36.812588] [INFO ] [MAIN ] GFL: Fetched primary data is valid. [2025-09-17T19:14:36.812714] [DEBUG] [LOCAL ] GFL: Saving primary data. [2025-09-17T19:14:36.817152] [DEBUG] [LOCAL ] GFL: Trimmed 68539 records to 48221 (keeping 200 days of data) [2025-09-17T19:14:37.127269] [DEBUG] [LOCAL ] GFL: Primary data saved (48221 records). [2025-09-17T19:14:37.127430] [INFO ] [MAIN ] GFL: Full history saved. [2025-09-17T19:14:37.127597] [INFO ] [MAIN ] Update Progress: 922/2371 symbols completed. GFL took 28.2s. Estimated remaining: 3h 31m 31s. Rate: 6.9 symbols/min [2025-09-17T19:14:37.220921] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-05. [2025-09-17T19:14:37.308262] [INFO ] [MAIN ] GGZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:14:37.312798] [DEBUG] [LOCAL ] GGZ: Loaded 2481 existing records from primary storage. [2025-09-17T19:14:37.312877] [INFO ] [MAIN ] GGZ: Loaded 2481 existing records. [2025-09-17T19:14:37.490765] [WARN ] [MAIN ] GGZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:14:37.491034] [INFO ] [MAIN ] GGZ: Wiping existing primary data before full refresh. [2025-09-17T19:14:37.491081] [INFO ] [LOCAL ] GGZ: Starting deletion of primary data. [2025-09-17T19:14:37.491285] [DEBUG] [LOCAL ] GGZ: Deleted primary data file. [2025-09-17T19:14:37.491337] [INFO ] [MAIN ] GGZ: Starting full primary refresh. [2025-09-17T19:14:37.879515] [INFO ] [REMOTE ] GGZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:14:37.921323] [INFO ] [REMOTE ] GGG: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T19:14:37.927004] [INFO ] [REMOTE ] GGG: Full fetch complete (59182 records). [2025-09-17T19:14:37.927113] [DEBUG] [VALIDATOR ] GGG: Validating primary data. [2025-09-17T19:14:38.020833] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-06. [2025-09-17T19:14:38.315691] [DEBUG] [VALIDATOR ] GGG: All expected trading days are present. [2025-09-17T19:14:38.315785] [DEBUG] [VALIDATOR ] GGG: Primary data validation passed. [2025-09-17T19:14:38.316928] [INFO ] [MAIN ] GGG: Fetched primary data is valid. [2025-09-17T19:14:38.316973] [DEBUG] [LOCAL ] GGG: Saving primary data. [2025-09-17T19:14:38.319092] [DEBUG] [LOCAL ] GGG: Trimmed 59182 records to 41146 (keeping 200 days of data) [2025-09-17T19:14:38.444378] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T19:14:38.598811] [DEBUG] [LOCAL ] GGG: Primary data saved (41146 records). [2025-09-17T19:14:38.598959] [INFO ] [MAIN ] GGG: Full history saved. [2025-09-17T19:14:38.599105] [INFO ] [MAIN ] Update Progress: 923/2371 symbols completed. GGG took 29.7s. Estimated remaining: 3h 31m 11s. Rate: 6.9 symbols/min [2025-09-17T19:14:38.775196] [INFO ] [MAIN ] GHC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:14:38.775397] [DEBUG] [LOCAL ] GHC: No existing data file found in primary storage. [2025-09-17T19:14:38.775437] [WARN ] [MAIN ] GHC: No existing data found, performing full refresh instead. [2025-09-17T19:14:38.775555] [INFO ] [MAIN ] GHC: Wiping existing primary data before full refresh. [2025-09-17T19:14:38.775595] [INFO ] [LOCAL ] GHC: Starting deletion of primary data. [2025-09-17T19:14:38.775637] [DEBUG] [LOCAL ] GHC: No primary data file found to delete. [2025-09-17T19:14:38.775702] [INFO ] [MAIN ] GHC: Starting full primary refresh. [2025-09-17T19:14:38.820858] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-06. [2025-09-17T19:14:39.140102] [INFO ] [REMOTE ] GHC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:14:39.541713] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T19:14:39.615814] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-11. [2025-09-17T19:14:39.833288] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T19:14:39.924465] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-17T19:14:40.415781] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-07. [2025-09-17T19:14:41.215790] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-11. [2025-09-17T19:14:41.743338] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T19:14:42.015812] [INFO ] [REMOTE ] GHC: Fetching primary data for 2024-12. [2025-09-17T19:14:42.362658] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-17T19:14:42.417494] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T19:14:42.815826] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-08. [2025-09-17T19:14:43.615876] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-01. [2025-09-17T19:14:44.201455] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T19:14:44.415811] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-07. [2025-09-17T19:14:44.525325] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T19:14:45.153421] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T19:14:45.215815] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2024-12. [2025-09-17T19:14:45.792765] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T19:14:46.015803] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-01. [2025-09-17T19:14:46.651745] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T19:14:46.815781] [INFO ] [REMOTE ] GGB: Fetching primary data for 2025-09. [2025-09-17T19:14:47.615819] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-02. [2025-09-17T19:14:48.067692] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T19:14:48.391470] [INFO ] [REMOTE ] GGB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T19:14:48.398150] [INFO ] [REMOTE ] GGB: Full fetch complete (73789 records). [2025-09-17T19:14:48.398351] [DEBUG] [VALIDATOR ] GGB: Validating primary data. [2025-09-17T19:14:48.420852] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-08. [2025-09-17T19:14:48.800732] [DEBUG] [VALIDATOR ] GGB: All expected trading days are present. [2025-09-17T19:14:48.800871] [DEBUG] [VALIDATOR ] GGB: Primary data validation passed. [2025-09-17T19:14:48.801755] [INFO ] [MAIN ] GGB: Fetched primary data is valid. [2025-09-17T19:14:48.801801] [DEBUG] [LOCAL ] GGB: Saving primary data. [2025-09-17T19:14:48.803378] [DEBUG] [LOCAL ] GGB: Trimmed 73789 records to 50997 (keeping 200 days of data) [2025-09-17T19:14:49.102012] [DEBUG] [LOCAL ] GGB: Primary data saved (50997 records). [2025-09-17T19:14:49.102142] [INFO ] [MAIN ] GGB: Full history saved. [2025-09-17T19:14:49.102264] [INFO ] [MAIN ] Update Progress: 924/2371 symbols completed. GGB took 40.2s. Estimated remaining: 3h 31m 5s. Rate: 6.9 symbols/min [2025-09-17T19:14:49.219147] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-03. [2025-09-17T19:14:49.274406] [INFO ] [MAIN ] GHG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:14:49.285168] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T19:14:49.288107] [DEBUG] [LOCAL ] GHG: Loaded 3131 existing records from primary storage. [2025-09-17T19:14:49.291701] [INFO ] [MAIN ] GHG: Loaded 3131 existing records. [2025-09-17T19:14:49.515074] [WARN ] [MAIN ] GHG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:14:49.515358] [INFO ] [MAIN ] GHG: Wiping existing primary data before full refresh. [2025-09-17T19:14:49.515405] [INFO ] [LOCAL ] GHG: Starting deletion of primary data. [2025-09-17T19:14:49.515670] [DEBUG] [LOCAL ] GHG: Deleted primary data file. [2025-09-17T19:14:49.515724] [INFO ] [MAIN ] GHG: Starting full primary refresh. [2025-09-17T19:14:49.800831] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T19:14:49.877567] [INFO ] [REMOTE ] GHG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:14:50.015740] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-11. [2025-09-17T19:14:50.371966] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T19:14:50.815765] [INFO ] [REMOTE ] GHG: Fetching primary data for 2024-12. [2025-09-17T19:14:51.259695] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-17T19:14:51.615764] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-04. [2025-09-17T19:14:52.167095] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T19:14:52.415768] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-05. [2025-09-17T19:14:52.792159] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T19:14:53.215778] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-01. [2025-09-17T19:14:53.598425] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T19:14:54.015764] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-02. [2025-09-17T19:14:54.468994] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T19:14:54.815784] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-03. [2025-09-17T19:14:55.179682] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T19:14:55.615777] [INFO ] [REMOTE ] GGT: Fetching primary data for 2025-09. [2025-09-17T19:14:56.415774] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-02. [2025-09-17T19:14:56.590584] [INFO ] [REMOTE ] GGT: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T19:14:56.593505] [INFO ] [REMOTE ] GGT: Full fetch complete (18614 records). [2025-09-17T19:14:56.593581] [DEBUG] [VALIDATOR ] GGT: Validating primary data. [2025-09-17T19:14:56.888304] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T19:14:56.973951] [DEBUG] [VALIDATOR ] GGT: All expected trading days are present. [2025-09-17T19:14:56.974042] [DEBUG] [VALIDATOR ] GGT: Primary data validation passed. [2025-09-17T19:14:56.974478] [INFO ] [MAIN ] GGT: Fetched primary data is valid. [2025-09-17T19:14:56.974523] [DEBUG] [LOCAL ] GGT: Saving primary data. [2025-09-17T19:14:56.975258] [DEBUG] [LOCAL ] GGT: Trimmed 18614 records to 14143 (keeping 200 days of data) [2025-09-17T19:14:57.065539] [DEBUG] [LOCAL ] GGT: Primary data saved (14143 records). [2025-09-17T19:14:57.065835] [INFO ] [MAIN ] GGT: Full history saved. [2025-09-17T19:14:57.065926] [INFO ] [MAIN ] Update Progress: 925/2371 symbols completed. GGT took 36.0s. Estimated remaining: 3h 30m 55s. Rate: 6.9 symbols/min [2025-09-17T19:14:57.219009] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-03. [2025-09-17T19:14:57.239116] [INFO ] [MAIN ] GHI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:14:57.253185] [DEBUG] [LOCAL ] GHI: Loaded 6996 existing records from primary storage. [2025-09-17T19:14:57.253383] [INFO ] [MAIN ] GHI: Loaded 6996 existing records. [2025-09-17T19:14:57.439033] [WARN ] [MAIN ] GHI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:14:57.439507] [INFO ] [MAIN ] GHI: Wiping existing primary data before full refresh. [2025-09-17T19:14:57.439563] [INFO ] [LOCAL ] GHI: Starting deletion of primary data. [2025-09-17T19:14:57.440809] [DEBUG] [LOCAL ] GHI: Deleted primary data file. [2025-09-17T19:14:57.440863] [INFO ] [MAIN ] GHI: Starting full primary refresh. [2025-09-17T19:14:57.733583] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T19:14:57.818668] [INFO ] [REMOTE ] GHI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:14:58.015824] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-04. [2025-09-17T19:14:58.419765] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-04 (0.40 seconds). [2025-09-17T19:14:58.815823] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-04. [2025-09-17T19:14:59.429249] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T19:14:59.615852] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-05. [2025-09-17T19:15:00.024107] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-17T19:15:00.415773] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-06. [2025-09-17T19:15:01.068575] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T19:15:01.215820] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-05. [2025-09-17T19:15:02.015819] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-07. [2025-09-17T19:15:02.815868] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-11. [2025-09-17T19:15:03.202770] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T19:15:03.615835] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-06. [2025-09-17T19:15:04.356563] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-07 (2.34 seconds). [2025-09-17T19:15:04.415758] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-08. [2025-09-17T19:15:04.797365] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T19:15:05.150733] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T19:15:05.215971] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-06. [2025-09-17T19:15:05.401075] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-11 (2.59 seconds). [2025-09-17T19:15:05.579329] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-17T19:15:06.015821] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-07. [2025-09-17T19:15:06.471739] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T19:15:06.815831] [INFO ] [REMOTE ] GHI: Fetching primary data for 2024-12. [2025-09-17T19:15:07.615792] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-07. [2025-09-17T19:15:07.717971] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T19:15:07.964210] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T19:15:08.415819] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-08. [2025-09-17T19:15:08.882638] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T19:15:09.215779] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-08. [2025-09-17T19:15:09.692483] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T19:15:10.015780] [INFO ] [REMOTE ] GHG: Fetching primary data for 2025-09. [2025-09-17T19:15:10.674669] [INFO ] [REMOTE ] GHG: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T19:15:10.675793] [INFO ] [REMOTE ] GHG: Full fetch complete (3931 records). [2025-09-17T19:15:10.675865] [DEBUG] [VALIDATOR ] GHG: Validating primary data. [2025-09-17T19:15:10.821001] [INFO ] [REMOTE ] GGZ: Fetching primary data for 2025-09. [2025-09-17T19:15:11.060986] [DEBUG] [VALIDATOR ] GHG: All expected trading days are present. [2025-09-17T19:15:11.061065] [DEBUG] [VALIDATOR ] GHG: Primary data validation passed. [2025-09-17T19:15:11.061192] [INFO ] [MAIN ] GHG: Fetched primary data is valid. [2025-09-17T19:15:11.061229] [DEBUG] [LOCAL ] GHG: Saving primary data. [2025-09-17T19:15:11.061605] [DEBUG] [LOCAL ] GHG: Trimmed 3931 records to 3138 (keeping 200 days of data) [2025-09-17T19:15:11.079669] [DEBUG] [LOCAL ] GHG: Primary data saved (3138 records). [2025-09-17T19:15:11.079775] [INFO ] [MAIN ] GHG: Full history saved. [2025-09-17T19:15:11.079870] [INFO ] [MAIN ] Update Progress: 926/2371 symbols completed. GHG took 22.0s. Estimated remaining: 3h 30m 54s. Rate: 6.9 symbols/min [2025-09-17T19:15:11.270614] [INFO ] [MAIN ] GHLD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:15:11.276965] [DEBUG] [LOCAL ] GHLD: Loaded 3990 existing records from primary storage. [2025-09-17T19:15:11.277078] [INFO ] [MAIN ] GHLD: Loaded 3990 existing records. [2025-09-17T19:15:11.467388] [WARN ] [MAIN ] GHLD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:15:11.467687] [INFO ] [MAIN ] GHLD: Wiping existing primary data before full refresh. [2025-09-17T19:15:11.467747] [INFO ] [LOCAL ] GHLD: Starting deletion of primary data. [2025-09-17T19:15:11.468031] [DEBUG] [LOCAL ] GHLD: Deleted primary data file. [2025-09-17T19:15:11.468077] [INFO ] [MAIN ] GHLD: Starting full primary refresh. [2025-09-17T19:15:11.552976] [INFO ] [REMOTE ] GGZ: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T19:15:11.576694] [INFO ] [REMOTE ] GGZ: Full fetch complete (4116 records). [2025-09-17T19:15:11.587609] [DEBUG] [VALIDATOR ] GGZ: Validating primary data. [2025-09-17T19:15:11.633454] [INFO ] [REMOTE ] GHC: Fetching primary data for 2025-09. [2025-09-17T19:15:12.048743] [INFO ] [REMOTE ] GHLD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:15:12.256254] [DEBUG] [VALIDATOR ] GGZ: All expected trading days are present. [2025-09-17T19:15:12.256340] [DEBUG] [VALIDATOR ] GGZ: Primary data validation passed. [2025-09-17T19:15:12.256489] [INFO ] [MAIN ] GGZ: Fetched primary data is valid. [2025-09-17T19:15:12.256528] [DEBUG] [LOCAL ] GGZ: Saving primary data. [2025-09-17T19:15:12.256952] [DEBUG] [LOCAL ] GGZ: Trimmed 4116 records to 2481 (keeping 200 days of data) [2025-09-17T19:15:12.273286] [DEBUG] [LOCAL ] GGZ: Primary data saved (2481 records). [2025-09-17T19:15:12.273429] [INFO ] [MAIN ] GGZ: Full history saved. [2025-09-17T19:15:12.273534] [INFO ] [MAIN ] Update Progress: 927/2371 symbols completed. GGZ took 35.1s. Estimated remaining: 3h 30m 34s. Rate: 6.9 symbols/min [2025-09-17T19:15:12.422581] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-11. [2025-09-17T19:15:12.446683] [INFO ] [MAIN ] GHM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:15:12.463266] [DEBUG] [LOCAL ] GHM: Loaded 14297 existing records from primary storage. [2025-09-17T19:15:12.463416] [INFO ] [MAIN ] GHM: Loaded 14297 existing records. [2025-09-17T19:15:12.518951] [INFO ] [REMOTE ] GHC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T19:15:12.552062] [INFO ] [REMOTE ] GHC: Full fetch complete (3183 records). [2025-09-17T19:15:12.579963] [DEBUG] [VALIDATOR ] GHC: Validating primary data. [2025-09-17T19:15:12.785981] [WARN ] [MAIN ] GHM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:15:12.825043] [INFO ] [MAIN ] GHM: Wiping existing primary data before full refresh. [2025-09-17T19:15:12.825496] [INFO ] [LOCAL ] GHM: Starting deletion of primary data. [2025-09-17T19:15:12.857999] [DEBUG] [LOCAL ] GHM: Deleted primary data file. [2025-09-17T19:15:12.911363] [INFO ] [MAIN ] GHM: Starting full primary refresh. [2025-09-17T19:15:12.949854] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T19:15:13.178066] [DEBUG] [VALIDATOR ] GHC: All expected trading days are present. [2025-09-17T19:15:13.201796] [DEBUG] [VALIDATOR ] GHC: Primary data validation passed. [2025-09-17T19:15:13.227659] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2024-12. [2025-09-17T19:15:13.262543] [INFO ] [MAIN ] GHC: Fetched primary data is valid. [2025-09-17T19:15:13.285376] [DEBUG] [LOCAL ] GHC: Saving primary data. [2025-09-17T19:15:13.313893] [DEBUG] [LOCAL ] GHC: Trimmed 3183 records to 2583 (keeping 200 days of data) [2025-09-17T19:15:13.451987] [INFO ] [REMOTE ] GHM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:15:13.452081] [DEBUG] [LOCAL ] GHC: Primary data saved (2583 records). [2025-09-17T19:15:13.452541] [INFO ] [MAIN ] GHC: Full history saved. [2025-09-17T19:15:13.452664] [INFO ] [MAIN ] Update Progress: 928/2371 symbols completed. GHC took 34.9s. Estimated remaining: 3h 30m 13s. Rate: 6.9 symbols/min [2025-09-17T19:15:13.624341] [INFO ] [MAIN ] GHY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:15:13.647325] [DEBUG] [LOCAL ] GHY: Loaded 21321 existing records from primary storage. [2025-09-17T19:15:13.647492] [INFO ] [MAIN ] GHY: Loaded 21321 existing records. [2025-09-17T19:15:13.749721] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T19:15:13.828865] [WARN ] [MAIN ] GHY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:15:13.829146] [INFO ] [MAIN ] GHY: Wiping existing primary data before full refresh. [2025-09-17T19:15:13.829192] [INFO ] [LOCAL ] GHY: Starting deletion of primary data. [2025-09-17T19:15:13.829824] [DEBUG] [LOCAL ] GHY: Deleted primary data file. [2025-09-17T19:15:13.829874] [INFO ] [MAIN ] GHY: Starting full primary refresh. [2025-09-17T19:15:14.025280] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-11. [2025-09-17T19:15:14.189352] [INFO ] [REMOTE ] GHY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:15:14.816324] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-01. [2025-09-17T19:15:15.615847] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-11. [2025-09-17T19:15:16.027066] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T19:15:16.359428] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T19:15:16.415904] [INFO ] [REMOTE ] GHM: Fetching primary data for 2024-12. [2025-09-17T19:15:16.774249] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T19:15:16.960971] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T19:15:17.215809] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-01. [2025-09-17T19:15:18.015809] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-01. [2025-09-17T19:15:18.114308] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T19:15:18.453452] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T19:15:18.815814] [INFO ] [REMOTE ] GHY: Fetching primary data for 2024-12. [2025-09-17T19:15:19.615831] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-02. [2025-09-17T19:15:19.823489] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T19:15:19.960171] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T19:15:20.415796] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-02. [2025-09-17T19:15:21.060915] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T19:15:21.215821] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-03. [2025-09-17T19:15:21.701198] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-17T19:15:22.015825] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-02. [2025-09-17T19:15:22.815791] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-01. [2025-09-17T19:15:23.168010] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T19:15:23.615786] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-03. [2025-09-17T19:15:24.158399] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T19:15:24.415826] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-04. [2025-09-17T19:15:24.611728] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T19:15:24.739284] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-17T19:15:25.215807] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-04. [2025-09-17T19:15:26.015820] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-02. [2025-09-17T19:15:26.066526] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T19:15:26.815821] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-05. [2025-09-17T19:15:27.007509] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T19:15:27.257834] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T19:15:27.615804] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-06. [2025-09-17T19:15:28.066756] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T19:15:28.415783] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-05. [2025-09-17T19:15:29.102857] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T19:15:29.215815] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-03. [2025-09-17T19:15:30.015776] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-03. [2025-09-17T19:15:30.416422] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T19:15:30.745602] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T19:15:30.815777] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-07. [2025-09-17T19:15:31.423777] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T19:15:31.615799] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-06. [2025-09-17T19:15:32.415805] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-04. [2025-09-17T19:15:32.588882] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T19:15:33.215818] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-07. [2025-09-17T19:15:33.601458] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T19:15:33.982362] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T19:15:34.015736] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-08. [2025-09-17T19:15:34.815834] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-08. [2025-09-17T19:15:35.020561] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T19:15:35.573485] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T19:15:35.615727] [INFO ] [REMOTE ] GHLD: Fetching primary data for 2025-09. [2025-09-17T19:15:36.182438] [INFO ] [REMOTE ] GHLD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:15:36.183728] [INFO ] [REMOTE ] GHLD: Full fetch complete (4633 records). [2025-09-17T19:15:36.183852] [DEBUG] [VALIDATOR ] GHLD: Validating primary data. [2025-09-17T19:15:36.420996] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-05. [2025-09-17T19:15:36.547882] [DEBUG] [VALIDATOR ] GHLD: All expected trading days are present. [2025-09-17T19:15:36.547961] [DEBUG] [VALIDATOR ] GHLD: Primary data validation passed. [2025-09-17T19:15:36.548136] [INFO ] [MAIN ] GHLD: Fetched primary data is valid. [2025-09-17T19:15:36.548184] [DEBUG] [LOCAL ] GHLD: Saving primary data. [2025-09-17T19:15:36.548575] [DEBUG] [LOCAL ] GHLD: Trimmed 4633 records to 4031 (keeping 200 days of data) [2025-09-17T19:15:36.573522] [DEBUG] [LOCAL ] GHLD: Primary data saved (4031 records). [2025-09-17T19:15:36.573608] [INFO ] [MAIN ] GHLD: Full history saved. [2025-09-17T19:15:36.573724] [INFO ] [MAIN ] Update Progress: 929/2371 symbols completed. GHLD took 25.5s. Estimated remaining: 3h 30m 27s. Rate: 6.9 symbols/min [2025-09-17T19:15:36.747819] [INFO ] [MAIN ] GIB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:15:36.783867] [DEBUG] [LOCAL ] GIB: Loaded 32607 existing records from primary storage. [2025-09-17T19:15:36.784014] [INFO ] [MAIN ] GIB: Loaded 32607 existing records. [2025-09-17T19:15:36.963012] [WARN ] [MAIN ] GIB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:15:36.963267] [INFO ] [MAIN ] GIB: Wiping existing primary data before full refresh. [2025-09-17T19:15:36.963312] [INFO ] [LOCAL ] GIB: Starting deletion of primary data. [2025-09-17T19:15:36.964358] [DEBUG] [LOCAL ] GIB: Deleted primary data file. [2025-09-17T19:15:36.964428] [INFO ] [MAIN ] GIB: Starting full primary refresh. [2025-09-17T19:15:37.220867] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-04. [2025-09-17T19:15:37.332924] [INFO ] [REMOTE ] GIB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:15:37.607971] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T19:15:38.015811] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-11. [2025-09-17T19:15:38.056431] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T19:15:38.815772] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-05. [2025-09-17T19:15:39.060444] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T19:15:39.454521] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T19:15:39.615795] [INFO ] [REMOTE ] GIB: Fetching primary data for 2024-12. [2025-09-17T19:15:40.415817] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-06. [2025-09-17T19:15:40.853768] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T19:15:41.215806] [INFO ] [REMOTE ] GHM: Fetching primary data for 2025-09. [2025-09-17T19:15:41.738097] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T19:15:41.811385] [INFO ] [REMOTE ] GHM: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T19:15:41.814221] [INFO ] [REMOTE ] GHM: Full fetch complete (21390 records). [2025-09-17T19:15:41.814315] [DEBUG] [VALIDATOR ] GHM: Validating primary data. [2025-09-17T19:15:42.021071] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-06. [2025-09-17T19:15:42.195949] [DEBUG] [VALIDATOR ] GHM: All expected trading days are present. [2025-09-17T19:15:42.196065] [DEBUG] [VALIDATOR ] GHM: Primary data validation passed. [2025-09-17T19:15:42.196588] [INFO ] [MAIN ] GHM: Fetched primary data is valid. [2025-09-17T19:15:42.196635] [DEBUG] [LOCAL ] GHM: Saving primary data. [2025-09-17T19:15:42.197633] [DEBUG] [LOCAL ] GHM: Trimmed 21390 records to 14280 (keeping 200 days of data) [2025-09-17T19:15:42.285400] [DEBUG] [LOCAL ] GHM: Primary data saved (14280 records). [2025-09-17T19:15:42.285562] [INFO ] [MAIN ] GHM: Full history saved. [2025-09-17T19:15:42.285665] [INFO ] [MAIN ] Update Progress: 930/2371 symbols completed. GHM took 30.0s. Estimated remaining: 3h 30m 13s. Rate: 6.9 symbols/min [2025-09-17T19:15:42.455726] [INFO ] [MAIN ] GIC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:15:42.470344] [DEBUG] [LOCAL ] GIC: Loaded 13894 existing records from primary storage. [2025-09-17T19:15:42.470465] [INFO ] [MAIN ] GIC: Loaded 13894 existing records. [2025-09-17T19:15:42.653478] [WARN ] [MAIN ] GIC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:15:42.653766] [INFO ] [MAIN ] GIC: Wiping existing primary data before full refresh. [2025-09-17T19:15:42.653814] [INFO ] [LOCAL ] GIC: Starting deletion of primary data. [2025-09-17T19:15:42.654339] [DEBUG] [LOCAL ] GIC: Deleted primary data file. [2025-09-17T19:15:42.654389] [INFO ] [MAIN ] GIC: Starting full primary refresh. [2025-09-17T19:15:42.787833] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T19:15:42.816964] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-01. [2025-09-17T19:15:43.022833] [INFO ] [REMOTE ] GIC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:15:43.615810] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-07. [2025-09-17T19:15:43.933957] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T19:15:44.399417] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T19:15:44.415732] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-08. [2025-09-17T19:15:45.177200] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T19:15:45.215747] [INFO ] [REMOTE ] GHI: Fetching primary data for 2025-09. [2025-09-17T19:15:46.015802] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-11. [2025-09-17T19:15:46.162613] [INFO ] [REMOTE ] GHI: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T19:15:46.164014] [INFO ] [REMOTE ] GHI: Full fetch complete (11835 records). [2025-09-17T19:15:46.164085] [DEBUG] [VALIDATOR ] GHI: Validating primary data. [2025-09-17T19:15:46.526508] [DEBUG] [VALIDATOR ] GHI: All expected trading days are present. [2025-09-17T19:15:46.526584] [DEBUG] [VALIDATOR ] GHI: Primary data validation passed. [2025-09-17T19:15:46.526875] [INFO ] [MAIN ] GHI: Fetched primary data is valid. [2025-09-17T19:15:46.526929] [DEBUG] [LOCAL ] GHI: Saving primary data. [2025-09-17T19:15:46.527380] [DEBUG] [LOCAL ] GHI: Trimmed 11835 records to 6993 (keeping 200 days of data) [2025-09-17T19:15:46.570564] [DEBUG] [LOCAL ] GHI: Primary data saved (6993 records). [2025-09-17T19:15:46.570717] [INFO ] [MAIN ] GHI: Full history saved. [2025-09-17T19:15:46.570798] [INFO ] [MAIN ] Update Progress: 931/2371 symbols completed. GHI took 49.5s. Estimated remaining: 3h 29m 58s. Rate: 6.9 symbols/min [2025-09-17T19:15:46.744388] [INFO ] [MAIN ] GIL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:15:46.788702] [DEBUG] [LOCAL ] GIL: Loaded 43031 existing records from primary storage. [2025-09-17T19:15:46.788852] [INFO ] [MAIN ] GIL: Loaded 43031 existing records. [2025-09-17T19:15:46.820941] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-02. [2025-09-17T19:15:46.988219] [WARN ] [MAIN ] GIL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:15:46.989789] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T19:15:46.989888] [INFO ] [MAIN ] GIL: Wiping existing primary data before full refresh. [2025-09-17T19:15:46.993888] [INFO ] [LOCAL ] GIL: Starting deletion of primary data. [2025-09-17T19:15:46.995032] [DEBUG] [LOCAL ] GIL: Deleted primary data file. [2025-09-17T19:15:46.995086] [INFO ] [MAIN ] GIL: Starting full primary refresh. [2025-09-17T19:15:47.365254] [INFO ] [REMOTE ] GIL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:15:47.615788] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-11. [2025-09-17T19:15:48.199549] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T19:15:48.415788] [INFO ] [REMOTE ] GIC: Fetching primary data for 2024-12. [2025-09-17T19:15:49.204666] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T19:15:49.215664] [INFO ] [REMOTE ] GIL: Fetching primary data for 2024-12. [2025-09-17T19:15:49.360408] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T19:15:50.015764] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-07. [2025-09-17T19:15:50.346841] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T19:15:50.815836] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-03. [2025-09-17T19:15:51.217245] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T19:15:51.615770] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-08. [2025-09-17T19:15:52.278678] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T19:15:52.415761] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-01. [2025-09-17T19:15:52.629981] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T19:15:53.215806] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-04. [2025-09-17T19:15:53.340272] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T19:15:54.015819] [INFO ] [REMOTE ] GHY: Fetching primary data for 2025-09. [2025-09-17T19:15:54.663224] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T19:15:54.815756] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-05. [2025-09-17T19:15:55.050788] [INFO ] [REMOTE ] GHY: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T19:15:55.053508] [INFO ] [REMOTE ] GHY: Full fetch complete (31958 records). [2025-09-17T19:15:55.053701] [DEBUG] [VALIDATOR ] GHY: Validating primary data. [2025-09-17T19:15:55.436521] [DEBUG] [VALIDATOR ] GHY: All expected trading days are present. [2025-09-17T19:15:55.436611] [DEBUG] [VALIDATOR ] GHY: Primary data validation passed. [2025-09-17T19:15:55.437193] [INFO ] [MAIN ] GHY: Fetched primary data is valid. [2025-09-17T19:15:55.437238] [DEBUG] [LOCAL ] GHY: Saving primary data. [2025-09-17T19:15:55.438159] [DEBUG] [LOCAL ] GHY: Trimmed 31958 records to 21197 (keeping 200 days of data) [2025-09-17T19:15:55.582706] [DEBUG] [LOCAL ] GHY: Primary data saved (21197 records). [2025-09-17T19:15:55.582889] [INFO ] [MAIN ] GHY: Full history saved. [2025-09-17T19:15:55.583027] [INFO ] [MAIN ] Update Progress: 932/2371 symbols completed. GHY took 42.1s. Estimated remaining: 3h 29m 49s. Rate: 6.9 symbols/min [2025-09-17T19:15:55.617337] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-02. [2025-09-17T19:15:55.773422] [INFO ] [MAIN ] GIS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:15:55.835448] [DEBUG] [LOCAL ] GIS: Loaded 53674 existing records from primary storage. [2025-09-17T19:15:55.835596] [INFO ] [MAIN ] GIS: Loaded 53674 existing records. [2025-09-17T19:15:56.014061] [WARN ] [MAIN ] GIS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:15:56.014837] [INFO ] [MAIN ] GIS: Wiping existing primary data before full refresh. [2025-09-17T19:15:56.015009] [INFO ] [LOCAL ] GIS: Starting deletion of primary data. [2025-09-17T19:15:56.016439] [DEBUG] [LOCAL ] GIS: Deleted primary data file. [2025-09-17T19:15:56.016518] [INFO ] [MAIN ] GIS: Starting full primary refresh. [2025-09-17T19:15:56.158134] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T19:15:56.423693] [INFO ] [REMOTE ] GIS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:15:56.423770] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-01. [2025-09-17T19:15:56.430181] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T19:15:57.215802] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-11. [2025-09-17T19:15:57.961372] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T19:15:58.015786] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-02. [2025-09-17T19:15:58.815751] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-03. [2025-09-17T19:15:58.933843] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T19:15:59.382271] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T19:15:59.435444] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T19:15:59.615809] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-06. [2025-09-17T19:16:00.415810] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-04. [2025-09-17T19:16:00.876229] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T19:16:01.215819] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-07. [2025-09-17T19:16:01.336317] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T19:16:02.015825] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-03. [2025-09-17T19:16:02.386471] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T19:16:02.815828] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-08. [2025-09-17T19:16:03.580036] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T19:16:03.615733] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-04. [2025-09-17T19:16:04.169367] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T19:16:04.415780] [INFO ] [REMOTE ] GIB: Fetching primary data for 2025-09. [2025-09-17T19:16:04.944554] [INFO ] [REMOTE ] GIB: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T19:16:04.948945] [INFO ] [REMOTE ] GIB: Full fetch complete (44755 records). [2025-09-17T19:16:04.949073] [DEBUG] [VALIDATOR ] GIB: Validating primary data. [2025-09-17T19:16:05.222736] [INFO ] [REMOTE ] GIS: Fetching primary data for 2024-12. [2025-09-17T19:16:05.411260] [DEBUG] [VALIDATOR ] GIB: All expected trading days are present. [2025-09-17T19:16:05.411431] [DEBUG] [VALIDATOR ] GIB: Primary data validation passed. [2025-09-17T19:16:05.412465] [INFO ] [MAIN ] GIB: Fetched primary data is valid. [2025-09-17T19:16:05.412593] [DEBUG] [LOCAL ] GIB: Saving primary data. [2025-09-17T19:16:05.414271] [DEBUG] [LOCAL ] GIB: Trimmed 44755 records to 32454 (keeping 200 days of data) [2025-09-17T19:16:05.556193] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T19:16:05.675128] [DEBUG] [LOCAL ] GIB: Primary data saved (32454 records). [2025-09-17T19:16:05.675290] [INFO ] [MAIN ] GIB: Full history saved. [2025-09-17T19:16:05.675378] [INFO ] [MAIN ] Update Progress: 933/2371 symbols completed. GIB took 29.1s. Estimated remaining: 3h 29m 43s. Rate: 6.9 symbols/min [2025-09-17T19:16:05.854885] [INFO ] [MAIN ] GKOS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:16:05.897306] [DEBUG] [LOCAL ] GKOS: Loaded 43083 existing records from primary storage. [2025-09-17T19:16:05.897484] [INFO ] [MAIN ] GKOS: Loaded 43083 existing records. [2025-09-17T19:16:06.021013] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-05. [2025-09-17T19:16:06.084273] [WARN ] [MAIN ] GKOS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:16:06.084546] [INFO ] [MAIN ] GKOS: Wiping existing primary data before full refresh. [2025-09-17T19:16:06.084594] [INFO ] [LOCAL ] GKOS: Starting deletion of primary data. [2025-09-17T19:16:06.085604] [DEBUG] [LOCAL ] GKOS: Deleted primary data file. [2025-09-17T19:16:06.085678] [INFO ] [MAIN ] GKOS: Starting full primary refresh. [2025-09-17T19:16:06.449312] [INFO ] [REMOTE ] GKOS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:16:06.815804] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-11. [2025-09-17T19:16:07.169184] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T19:16:07.192776] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T19:16:07.615863] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-01. [2025-09-17T19:16:07.834087] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T19:16:08.415845] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-05. [2025-09-17T19:16:09.215768] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2024-12. [2025-09-17T19:16:09.290737] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T19:16:10.013689] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T19:16:10.022316] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-02. [2025-09-17T19:16:10.697872] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T19:16:10.815789] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-01. [2025-09-17T19:16:11.615818] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-06. [2025-09-17T19:16:11.798388] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T19:16:12.341511] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T19:16:12.415780] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-02. [2025-09-17T19:16:13.143809] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T19:16:13.215798] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-06. [2025-09-17T19:16:13.419725] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T19:16:14.015832] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-07. [2025-09-17T19:16:14.101987] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T19:16:14.815789] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-03. [2025-09-17T19:16:15.514971] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T19:16:15.615854] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-03. [2025-09-17T19:16:16.074687] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T19:16:16.415815] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-07. [2025-09-17T19:16:17.044684] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T19:16:17.162319] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T19:16:17.215762] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-04. [2025-09-17T19:16:18.015805] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-04. [2025-09-17T19:16:18.815796] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-08. [2025-09-17T19:16:19.255001] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T19:16:19.620858] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-08. [2025-09-17T19:16:19.637082] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T19:16:20.178819] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T19:16:20.303539] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T19:16:20.415789] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-05. [2025-09-17T19:16:21.215791] [INFO ] [REMOTE ] GIL: Fetching primary data for 2025-09. [2025-09-17T19:16:21.934913] [INFO ] [REMOTE ] GIL: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T19:16:21.942082] [INFO ] [REMOTE ] GIL: Full fetch complete (60913 records). [2025-09-17T19:16:21.942353] [DEBUG] [VALIDATOR ] GIL: Validating primary data. [2025-09-17T19:16:22.018402] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-05. [2025-09-17T19:16:22.398185] [DEBUG] [VALIDATOR ] GIL: All expected trading days are present. [2025-09-17T19:16:22.398858] [DEBUG] [VALIDATOR ] GIL: Primary data validation passed. [2025-09-17T19:16:22.400733] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T19:16:22.401806] [INFO ] [MAIN ] GIL: Fetched primary data is valid. [2025-09-17T19:16:22.401941] [DEBUG] [LOCAL ] GIL: Saving primary data. [2025-09-17T19:16:22.414934] [DEBUG] [LOCAL ] GIL: Trimmed 60913 records to 43027 (keeping 200 days of data) [2025-09-17T19:16:22.691868] [DEBUG] [LOCAL ] GIL: Primary data saved (43027 records). [2025-09-17T19:16:22.692009] [INFO ] [MAIN ] GIL: Full history saved. [2025-09-17T19:16:22.692096] [INFO ] [MAIN ] Update Progress: 934/2371 symbols completed. GIL took 36.1s. Estimated remaining: 3h 29m 47s. Rate: 6.9 symbols/min [2025-09-17T19:16:22.820871] [INFO ] [REMOTE ] GIC: Fetching primary data for 2025-09. [2025-09-17T19:16:22.879332] [INFO ] [MAIN ] GL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:16:22.926279] [DEBUG] [LOCAL ] GL: Loaded 38346 existing records from primary storage. [2025-09-17T19:16:22.926479] [INFO ] [MAIN ] GL: Loaded 38346 existing records. [2025-09-17T19:16:23.114308] [WARN ] [MAIN ] GL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:16:23.114577] [INFO ] [MAIN ] GL: Wiping existing primary data before full refresh. [2025-09-17T19:16:23.114623] [INFO ] [LOCAL ] GL: Starting deletion of primary data. [2025-09-17T19:16:23.115480] [DEBUG] [LOCAL ] GL: Deleted primary data file. [2025-09-17T19:16:23.115527] [INFO ] [MAIN ] GL: Starting full primary refresh. [2025-09-17T19:16:23.479560] [INFO ] [REMOTE ] GL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:16:23.487018] [INFO ] [REMOTE ] GIC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T19:16:23.490027] [INFO ] [REMOTE ] GIC: Full fetch complete (20242 records). [2025-09-17T19:16:23.490144] [DEBUG] [VALIDATOR ] GIC: Validating primary data. [2025-09-17T19:16:23.617439] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-06. [2025-09-17T19:16:23.716793] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T19:16:23.927258] [DEBUG] [VALIDATOR ] GIC: All expected trading days are present. [2025-09-17T19:16:23.927335] [DEBUG] [VALIDATOR ] GIC: Primary data validation passed. [2025-09-17T19:16:23.927729] [INFO ] [MAIN ] GIC: Fetched primary data is valid. [2025-09-17T19:16:23.927772] [DEBUG] [LOCAL ] GIC: Saving primary data. [2025-09-17T19:16:23.928472] [DEBUG] [LOCAL ] GIC: Trimmed 20242 records to 13876 (keeping 200 days of data) [2025-09-17T19:16:24.021610] [DEBUG] [LOCAL ] GIC: Primary data saved (13876 records). [2025-09-17T19:16:24.021783] [INFO ] [MAIN ] GIC: Full history saved. [2025-09-17T19:16:24.021880] [INFO ] [MAIN ] Update Progress: 935/2371 symbols completed. GIC took 41.7s. Estimated remaining: 3h 29m 26s. Rate: 6.9 symbols/min [2025-09-17T19:16:24.219847] [INFO ] [MAIN ] GLOB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:16:24.275436] [DEBUG] [LOCAL ] GLOB: Loaded 47124 existing records from primary storage. [2025-09-17T19:16:24.275607] [INFO ] [MAIN ] GLOB: Loaded 47124 existing records. [2025-09-17T19:16:24.422773] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-06. [2025-09-17T19:16:24.463484] [WARN ] [MAIN ] GLOB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:16:24.463715] [INFO ] [MAIN ] GLOB: Wiping existing primary data before full refresh. [2025-09-17T19:16:24.463764] [INFO ] [LOCAL ] GLOB: Starting deletion of primary data. [2025-09-17T19:16:24.464824] [DEBUG] [LOCAL ] GLOB: Deleted primary data file. [2025-09-17T19:16:24.464875] [INFO ] [MAIN ] GLOB: Starting full primary refresh. [2025-09-17T19:16:24.839458] [INFO ] [REMOTE ] GLOB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:16:25.215799] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-11. [2025-09-17T19:16:25.583462] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T19:16:25.993698] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T19:16:26.015731] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-07. [2025-09-17T19:16:26.416360] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T19:16:26.815822] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-11. [2025-09-17T19:16:27.157768] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T19:16:27.615849] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-07. [2025-09-17T19:16:28.275149] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T19:16:28.415879] [INFO ] [REMOTE ] GL: Fetching primary data for 2024-12. [2025-09-17T19:16:29.215868] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-08. [2025-09-17T19:16:29.703288] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T19:16:30.015850] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-08. [2025-09-17T19:16:30.133295] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T19:16:30.717175] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T19:16:30.815740] [INFO ] [REMOTE ] GKOS: Fetching primary data for 2025-09. [2025-09-17T19:16:31.357213] [INFO ] [REMOTE ] GKOS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T19:16:31.364367] [INFO ] [REMOTE ] GKOS: Full fetch complete (59488 records). [2025-09-17T19:16:31.364553] [DEBUG] [VALIDATOR ] GKOS: Validating primary data. [2025-09-17T19:16:31.624713] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2024-12. [2025-09-17T19:16:31.798151] [DEBUG] [VALIDATOR ] GKOS: All expected trading days are present. [2025-09-17T19:16:31.798245] [DEBUG] [VALIDATOR ] GKOS: Primary data validation passed. [2025-09-17T19:16:31.799049] [INFO ] [MAIN ] GKOS: Fetched primary data is valid. [2025-09-17T19:16:31.799135] [DEBUG] [LOCAL ] GKOS: Saving primary data. [2025-09-17T19:16:31.800514] [DEBUG] [LOCAL ] GKOS: Trimmed 59488 records to 43146 (keeping 200 days of data) [2025-09-17T19:16:31.927629] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T19:16:32.108051] [DEBUG] [LOCAL ] GKOS: Primary data saved (43146 records). [2025-09-17T19:16:32.108191] [INFO ] [MAIN ] GKOS: Full history saved. [2025-09-17T19:16:32.108317] [INFO ] [MAIN ] Update Progress: 936/2371 symbols completed. GKOS took 26.4s. Estimated remaining: 3h 29m 17s. Rate: 6.9 symbols/min [2025-09-17T19:16:32.281929] [INFO ] [MAIN ] GLP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:16:32.293598] [DEBUG] [LOCAL ] GLP: Loaded 9587 existing records from primary storage. [2025-09-17T19:16:32.293779] [INFO ] [MAIN ] GLP: Loaded 9587 existing records. [2025-09-17T19:16:32.421002] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-01. [2025-09-17T19:16:32.498321] [WARN ] [MAIN ] GLP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:16:32.498720] [INFO ] [MAIN ] GLP: Wiping existing primary data before full refresh. [2025-09-17T19:16:32.498793] [INFO ] [LOCAL ] GLP: Starting deletion of primary data. [2025-09-17T19:16:32.499351] [DEBUG] [LOCAL ] GLP: Deleted primary data file. [2025-09-17T19:16:32.499433] [INFO ] [MAIN ] GLP: Starting full primary refresh. [2025-09-17T19:16:32.857796] [INFO ] [REMOTE ] GLP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:16:33.051319] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T19:16:33.215833] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-11. [2025-09-17T19:16:33.622943] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T19:16:33.842942] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T19:16:34.015830] [INFO ] [REMOTE ] GIS: Fetching primary data for 2025-09. [2025-09-17T19:16:34.815751] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-01. [2025-09-17T19:16:34.908596] [INFO ] [REMOTE ] GIS: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T19:16:34.916097] [INFO ] [REMOTE ] GIS: Full fetch complete (77495 records). [2025-09-17T19:16:34.916261] [DEBUG] [VALIDATOR ] GIS: Validating primary data. [2025-09-17T19:16:35.324907] [DEBUG] [VALIDATOR ] GIS: All expected trading days are present. [2025-09-17T19:16:35.325034] [DEBUG] [VALIDATOR ] GIS: Primary data validation passed. [2025-09-17T19:16:35.326002] [INFO ] [MAIN ] GIS: Fetched primary data is valid. [2025-09-17T19:16:35.326052] [DEBUG] [LOCAL ] GIS: Saving primary data. [2025-09-17T19:16:35.328546] [DEBUG] [LOCAL ] GIS: Trimmed 77495 records to 53674 (keeping 200 days of data) [2025-09-17T19:16:35.619331] [INFO ] [REMOTE ] GLP: Fetching primary data for 2024-12. [2025-09-17T19:16:35.662948] [DEBUG] [LOCAL ] GIS: Primary data saved (53674 records). [2025-09-17T19:16:35.663106] [INFO ] [MAIN ] GIS: Full history saved. [2025-09-17T19:16:35.663219] [INFO ] [MAIN ] Update Progress: 937/2371 symbols completed. GIS took 40.1s. Estimated remaining: 3h 28m 60s. Rate: 6.9 symbols/min [2025-09-17T19:16:35.857936] [INFO ] [MAIN ] GLW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:16:35.909888] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-17T19:16:35.910057] [INFO ] [MAIN ] GLW: Loaded 53635 existing records. [2025-09-17T19:16:36.116128] [WARN ] [MAIN ] GLW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:16:36.118332] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T19:16:36.126022] [INFO ] [MAIN ] GLW: Wiping existing primary data before full refresh. [2025-09-17T19:16:36.126410] [INFO ] [LOCAL ] GLW: Starting deletion of primary data. [2025-09-17T19:16:36.127583] [DEBUG] [LOCAL ] GLW: Deleted primary data file. [2025-09-17T19:16:36.127661] [INFO ] [MAIN ] GLW: Starting full primary refresh. [2025-09-17T19:16:36.417809] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-02. [2025-09-17T19:16:36.491629] [INFO ] [REMOTE ] GLW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:16:36.500109] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T19:16:37.215829] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-02. [2025-09-17T19:16:38.017743] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-01. [2025-09-17T19:16:38.022822] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T19:16:38.752568] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T19:16:38.753246] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T19:16:38.815790] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-03. [2025-09-17T19:16:39.615784] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-02. [2025-09-17T19:16:40.194880] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T19:16:40.415786] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-11. [2025-09-17T19:16:40.492069] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T19:16:41.215804] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-04. [2025-09-17T19:16:42.015810] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-03. [2025-09-17T19:16:42.335776] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T19:16:42.820897] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-03. [2025-09-17T19:16:42.836294] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T19:16:43.458331] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T19:16:43.615835] [INFO ] [REMOTE ] GLW: Fetching primary data for 2024-12. [2025-09-17T19:16:43.652076] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T19:16:44.415835] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-04. [2025-09-17T19:16:44.996784] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T19:16:45.215811] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-05. [2025-09-17T19:16:45.473048] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T19:16:45.879915] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T19:16:46.015779] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-06. [2025-09-17T19:16:46.596271] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T19:16:46.815784] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-04. [2025-09-17T19:16:47.615775] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-05. [2025-09-17T19:16:48.351698] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T19:16:48.415732] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-05. [2025-09-17T19:16:49.215774] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-01. [2025-09-17T19:16:49.364092] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T19:16:49.825303] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T19:16:50.015764] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-06. [2025-09-17T19:16:50.815742] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-07. [2025-09-17T19:16:50.869831] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T19:16:51.201085] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-17T19:16:51.321870] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T19:16:51.615773] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-02. [2025-09-17T19:16:52.415772] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-07. [2025-09-17T19:16:53.215789] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-08. [2025-09-17T19:16:53.437317] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T19:16:53.815342] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T19:16:53.984639] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T19:16:54.015776] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-06. [2025-09-17T19:16:54.815845] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-03. [2025-09-17T19:16:55.429285] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T19:16:55.615796] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-07. [2025-09-17T19:16:56.415750] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-08. [2025-09-17T19:16:56.490566] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T19:16:57.215757] [INFO ] [REMOTE ] GLP: Fetching primary data for 2025-09. [2025-09-17T19:16:57.266739] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T19:16:57.791852] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T19:16:57.984467] [INFO ] [REMOTE ] GLP: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T19:16:57.986882] [INFO ] [REMOTE ] GLP: Full fetch complete (14355 records). [2025-09-17T19:16:57.986953] [DEBUG] [VALIDATOR ] GLP: Validating primary data. [2025-09-17T19:16:58.021004] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-08. [2025-09-17T19:16:58.355195] [DEBUG] [VALIDATOR ] GLP: All expected trading days are present. [2025-09-17T19:16:58.355408] [DEBUG] [VALIDATOR ] GLP: Primary data validation passed. [2025-09-17T19:16:58.355807] [INFO ] [MAIN ] GLP: Fetched primary data is valid. [2025-09-17T19:16:58.355850] [DEBUG] [LOCAL ] GLP: Saving primary data. [2025-09-17T19:16:58.356390] [DEBUG] [LOCAL ] GLP: Trimmed 14355 records to 9580 (keeping 200 days of data) [2025-09-17T19:16:58.419629] [DEBUG] [LOCAL ] GLP: Primary data saved (9580 records). [2025-09-17T19:16:58.419784] [INFO ] [MAIN ] GLP: Full history saved. [2025-09-17T19:16:58.419891] [INFO ] [MAIN ] Update Progress: 938/2371 symbols completed. GLP took 26.3s. Estimated remaining: 3h 29m 13s. Rate: 6.8 symbols/min [2025-09-17T19:16:58.593530] [INFO ] [MAIN ] GM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:16:58.645543] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-17T19:16:58.645707] [INFO ] [MAIN ] GM: Loaded 53728 existing records. [2025-09-17T19:16:58.829422] [INFO ] [REMOTE ] GLOB: Fetching primary data for 2025-09. [2025-09-17T19:16:58.834786] [WARN ] [MAIN ] GM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:16:58.835950] [INFO ] [MAIN ] GM: Wiping existing primary data before full refresh. [2025-09-17T19:16:58.836024] [INFO ] [LOCAL ] GM: Starting deletion of primary data. [2025-09-17T19:16:58.837494] [DEBUG] [LOCAL ] GM: Deleted primary data file. [2025-09-17T19:16:58.837564] [INFO ] [MAIN ] GM: Starting full primary refresh. [2025-09-17T19:16:59.207471] [INFO ] [REMOTE ] GM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:16:59.418755] [INFO ] [REMOTE ] GLOB: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T19:16:59.427460] [INFO ] [REMOTE ] GLOB: Full fetch complete (62576 records). [2025-09-17T19:16:59.427629] [DEBUG] [VALIDATOR ] GLOB: Validating primary data. [2025-09-17T19:16:59.620682] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-11. [2025-09-17T19:16:59.851320] [DEBUG] [VALIDATOR ] GLOB: All expected trading days are present. [2025-09-17T19:16:59.851594] [DEBUG] [VALIDATOR ] GLOB: Primary data validation passed. [2025-09-17T19:16:59.853089] [INFO ] [MAIN ] GLOB: Fetched primary data is valid. [2025-09-17T19:16:59.854592] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T19:16:59.857866] [DEBUG] [LOCAL ] GLOB: Saving primary data. [2025-09-17T19:16:59.865158] [DEBUG] [LOCAL ] GLOB: Trimmed 62576 records to 47160 (keeping 200 days of data) [2025-09-17T19:17:00.180863] [DEBUG] [LOCAL ] GLOB: Primary data saved (47160 records). [2025-09-17T19:17:00.181037] [INFO ] [MAIN ] GLOB: Full history saved. [2025-09-17T19:17:00.182419] [INFO ] [MAIN ] Update Progress: 939/2371 symbols completed. GLOB took 36.2s. Estimated remaining: 3h 28m 53s. Rate: 6.9 symbols/min [2025-09-17T19:17:00.395936] [INFO ] [MAIN ] GME: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:17:00.415829] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-04. [2025-09-17T19:17:00.465208] [DEBUG] [LOCAL ] GME: Loaded 53759 existing records from primary storage. [2025-09-17T19:17:00.465369] [INFO ] [MAIN ] GME: Loaded 53759 existing records. [2025-09-17T19:17:00.679007] [WARN ] [MAIN ] GME: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:17:00.679373] [INFO ] [MAIN ] GME: Wiping existing primary data before full refresh. [2025-09-17T19:17:00.679436] [INFO ] [LOCAL ] GME: Starting deletion of primary data. [2025-09-17T19:17:00.680858] [DEBUG] [LOCAL ] GME: Deleted primary data file. [2025-09-17T19:17:00.680941] [INFO ] [MAIN ] GME: Starting full primary refresh. [2025-09-17T19:17:01.220999] [INFO ] [REMOTE ] GL: Fetching primary data for 2025-09. [2025-09-17T19:17:01.273088] [INFO ] [REMOTE ] GME: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:17:01.927990] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-11 (2.31 seconds). [2025-09-17T19:17:01.959297] [INFO ] [REMOTE ] GL: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T19:17:01.964595] [INFO ] [REMOTE ] GL: Full fetch complete (55636 records). [2025-09-17T19:17:01.964776] [DEBUG] [VALIDATOR ] GL: Validating primary data. [2025-09-17T19:17:02.020939] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-11. [2025-09-17T19:17:02.361419] [DEBUG] [VALIDATOR ] GL: All expected trading days are present. [2025-09-17T19:17:02.361534] [DEBUG] [VALIDATOR ] GL: Primary data validation passed. [2025-09-17T19:17:02.362383] [INFO ] [MAIN ] GL: Fetched primary data is valid. [2025-09-17T19:17:02.362444] [DEBUG] [LOCAL ] GL: Saving primary data. [2025-09-17T19:17:02.393142] [DEBUG] [LOCAL ] GL: Trimmed 55636 records to 38287 (keeping 200 days of data) [2025-09-17T19:17:02.395239] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T19:17:02.661299] [DEBUG] [LOCAL ] GL: Primary data saved (38287 records). [2025-09-17T19:17:02.661470] [INFO ] [MAIN ] GL: Full history saved. [2025-09-17T19:17:02.661558] [INFO ] [MAIN ] Update Progress: 940/2371 symbols completed. GL took 40.0s. Estimated remaining: 3h 28m 35s. Rate: 6.9 symbols/min [2025-09-17T19:17:02.819939] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-05. [2025-09-17T19:17:02.839844] [INFO ] [MAIN ] GMED: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:17:02.890133] [DEBUG] [LOCAL ] GMED: Loaded 48301 existing records from primary storage. [2025-09-17T19:17:02.890289] [INFO ] [MAIN ] GMED: Loaded 48301 existing records. [2025-09-17T19:17:03.075411] [WARN ] [MAIN ] GMED: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:17:03.075733] [INFO ] [MAIN ] GMED: Wiping existing primary data before full refresh. [2025-09-17T19:17:03.075831] [INFO ] [LOCAL ] GMED: Starting deletion of primary data. [2025-09-17T19:17:03.076724] [DEBUG] [LOCAL ] GMED: Deleted primary data file. [2025-09-17T19:17:03.076781] [INFO ] [MAIN ] GMED: Starting full primary refresh. [2025-09-17T19:17:03.501024] [INFO ] [REMOTE ] GMED: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:17:03.615811] [INFO ] [REMOTE ] GM: Fetching primary data for 2024-12. [2025-09-17T19:17:04.395286] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-11 (2.37 seconds). [2025-09-17T19:17:04.415723] [INFO ] [REMOTE ] GME: Fetching primary data for 2024-12. [2025-09-17T19:17:04.873027] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T19:17:05.215815] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-11. [2025-09-17T19:17:05.371084] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T19:17:06.015821] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-06. [2025-09-17T19:17:06.822111] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-01. [2025-09-17T19:17:06.825884] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T19:17:06.933038] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-17T19:17:07.495721] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T19:17:07.615800] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-07. [2025-09-17T19:17:08.415818] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-01. [2025-09-17T19:17:08.993491] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-01 (2.17 seconds). [2025-09-17T19:17:09.171495] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T19:17:09.215833] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-02. [2025-09-17T19:17:10.015852] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-08. [2025-09-17T19:17:10.815916] [INFO ] [REMOTE ] GMED: Fetching primary data for 2024-12. [2025-09-17T19:17:10.979397] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-01 (2.56 seconds). [2025-09-17T19:17:11.165491] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T19:17:11.615706] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-03. [2025-09-17T19:17:11.762028] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T19:17:12.422396] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-02. [2025-09-17T19:17:12.439498] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T19:17:13.215800] [INFO ] [REMOTE ] GLW: Fetching primary data for 2025-09. [2025-09-17T19:17:13.559462] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T19:17:14.015895] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-04. [2025-09-17T19:17:14.098408] [INFO ] [REMOTE ] GLW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T19:17:14.105491] [INFO ] [REMOTE ] GLW: Full fetch complete (77479 records). [2025-09-17T19:17:14.105661] [DEBUG] [VALIDATOR ] GLW: Validating primary data. [2025-09-17T19:17:14.508887] [DEBUG] [VALIDATOR ] GLW: All expected trading days are present. [2025-09-17T19:17:14.509046] [DEBUG] [VALIDATOR ] GLW: Primary data validation passed. [2025-09-17T19:17:14.510137] [INFO ] [MAIN ] GLW: Fetched primary data is valid. [2025-09-17T19:17:14.510241] [DEBUG] [LOCAL ] GLW: Saving primary data. [2025-09-17T19:17:14.511945] [DEBUG] [LOCAL ] GLW: Trimmed 77479 records to 53635 (keeping 200 days of data) [2025-09-17T19:17:14.756017] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-17T19:17:14.839293] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-03. [2025-09-17T19:17:14.889566] [DEBUG] [LOCAL ] GLW: Primary data saved (53635 records). [2025-09-17T19:17:14.889727] [INFO ] [MAIN ] GLW: Full history saved. [2025-09-17T19:17:14.889836] [INFO ] [MAIN ] Update Progress: 941/2371 symbols completed. GLW took 39.2s. Estimated remaining: 3h 28m 31s. Rate: 6.9 symbols/min [2025-09-17T19:17:15.058326] [INFO ] [MAIN ] GMRE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:17:15.092422] [DEBUG] [LOCAL ] GMRE: Loaded 37664 existing records from primary storage. [2025-09-17T19:17:15.092567] [INFO ] [MAIN ] GMRE: Loaded 37664 existing records. [2025-09-17T19:17:15.268518] [WARN ] [MAIN ] GMRE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:17:15.268772] [INFO ] [MAIN ] GMRE: Wiping existing primary data before full refresh. [2025-09-17T19:17:15.268817] [INFO ] [LOCAL ] GMRE: Starting deletion of primary data. [2025-09-17T19:17:15.269514] [DEBUG] [LOCAL ] GMRE: Deleted primary data file. [2025-09-17T19:17:15.269560] [INFO ] [MAIN ] GMRE: Starting full primary refresh. [2025-09-17T19:17:15.623090] [INFO ] [REMOTE ] GMRE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:17:15.623191] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-01. [2025-09-17T19:17:16.000896] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T19:17:16.415847] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-05. [2025-09-17T19:17:17.139772] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-17T19:17:17.215769] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-04. [2025-09-17T19:17:17.287453] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T19:17:18.015796] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-02. [2025-09-17T19:17:18.652115] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-17T19:17:18.815779] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-06. [2025-09-17T19:17:19.367007] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T19:17:19.432104] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-17T19:17:19.615773] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-05. [2025-09-17T19:17:20.416034] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T19:17:20.416113] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-11. [2025-09-17T19:17:21.215817] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-03. [2025-09-17T19:17:21.840203] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T19:17:22.016962] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-07. [2025-09-17T19:17:22.031297] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-17T19:17:22.815697] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-06. [2025-09-17T19:17:22.926124] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T19:17:23.615788] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-04. [2025-09-17T19:17:23.940198] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T19:17:24.415826] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-08. [2025-09-17T19:17:25.215818] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2024-12. [2025-09-17T19:17:25.336935] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T19:17:25.420844] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-17T19:17:26.015780] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-05. [2025-09-17T19:17:26.379123] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T19:17:26.415355] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T19:17:26.815778] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-01. [2025-09-17T19:17:27.615822] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-07. [2025-09-17T19:17:27.749776] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T19:17:28.199014] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T19:17:28.415804] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-02. [2025-09-17T19:17:29.215841] [INFO ] [REMOTE ] GM: Fetching primary data for 2025-09. [2025-09-17T19:17:29.511217] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T19:17:29.842685] [INFO ] [REMOTE ] GM: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T19:17:29.849774] [INFO ] [REMOTE ] GM: Full fetch complete (77793 records). [2025-09-17T19:17:29.849912] [DEBUG] [VALIDATOR ] GM: Validating primary data. [2025-09-17T19:17:30.026699] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-03. [2025-09-17T19:17:30.253936] [DEBUG] [VALIDATOR ] GM: All expected trading days are present. [2025-09-17T19:17:30.254105] [DEBUG] [VALIDATOR ] GM: Primary data validation passed. [2025-09-17T19:17:30.255124] [INFO ] [MAIN ] GM: Fetched primary data is valid. [2025-09-17T19:17:30.255205] [DEBUG] [LOCAL ] GM: Saving primary data. [2025-09-17T19:17:30.256909] [DEBUG] [LOCAL ] GM: Trimmed 77793 records to 53728 (keeping 200 days of data) [2025-09-17T19:17:30.386200] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-17T19:17:30.639489] [DEBUG] [LOCAL ] GM: Primary data saved (53728 records). [2025-09-17T19:17:30.639634] [INFO ] [MAIN ] GM: Full history saved. [2025-09-17T19:17:30.639752] [INFO ] [MAIN ] Update Progress: 942/2371 symbols completed. GM took 32.2s. Estimated remaining: 3h 28m 33s. Rate: 6.9 symbols/min [2025-09-17T19:17:30.820752] [INFO ] [MAIN ] GNE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:17:30.819405] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-06. [2025-09-17T19:17:30.839279] [DEBUG] [LOCAL ] GNE: Loaded 17366 existing records from primary storage. [2025-09-17T19:17:30.839408] [INFO ] [MAIN ] GNE: Loaded 17366 existing records. [2025-09-17T19:17:31.041317] [WARN ] [MAIN ] GNE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:17:31.041678] [INFO ] [MAIN ] GNE: Wiping existing primary data before full refresh. [2025-09-17T19:17:31.041745] [INFO ] [LOCAL ] GNE: Starting deletion of primary data. [2025-09-17T19:17:31.042286] [DEBUG] [LOCAL ] GNE: Deleted primary data file. [2025-09-17T19:17:31.042353] [INFO ] [MAIN ] GNE: Starting full primary refresh. [2025-09-17T19:17:31.402373] [INFO ] [REMOTE ] GNE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:17:31.543370] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T19:17:31.615739] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-04. [2025-09-17T19:17:32.359287] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T19:17:32.415725] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-07. [2025-09-17T19:17:33.138396] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T19:17:33.215776] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-05. [2025-09-17T19:17:34.022858] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-11. [2025-09-17T19:17:34.057661] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T19:17:34.380805] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T19:17:34.815796] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-08. [2025-09-17T19:17:34.838095] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T19:17:35.615792] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-06. [2025-09-17T19:17:36.415813] [INFO ] [REMOTE ] GNE: Fetching primary data for 2024-12. [2025-09-17T19:17:37.048156] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T19:17:37.050884] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T19:17:37.215766] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-07. [2025-09-17T19:17:37.361079] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-17T19:17:38.015798] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-08. [2025-09-17T19:17:38.444548] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T19:17:38.815818] [INFO ] [REMOTE ] GME: Fetching primary data for 2025-09. [2025-09-17T19:17:39.204062] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T19:17:39.620871] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-08. [2025-09-17T19:17:39.632792] [INFO ] [REMOTE ] GME: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T19:17:39.640125] [INFO ] [REMOTE ] GME: Full fetch complete (77920 records). [2025-09-17T19:17:39.640305] [DEBUG] [VALIDATOR ] GME: Validating primary data. [2025-09-17T19:17:40.038150] [DEBUG] [VALIDATOR ] GME: All expected trading days are present. [2025-09-17T19:17:40.038255] [DEBUG] [VALIDATOR ] GME: Primary data validation passed. [2025-09-17T19:17:40.039233] [INFO ] [MAIN ] GME: Fetched primary data is valid. [2025-09-17T19:17:40.039286] [DEBUG] [LOCAL ] GME: Saving primary data. [2025-09-17T19:17:40.043195] [DEBUG] [LOCAL ] GME: Trimmed 77920 records to 53761 (keeping 200 days of data) [2025-09-17T19:17:40.373903] [DEBUG] [LOCAL ] GME: Primary data saved (53761 records). [2025-09-17T19:17:40.374051] [INFO ] [MAIN ] GME: Full history saved. [2025-09-17T19:17:40.374686] [INFO ] [MAIN ] Update Progress: 943/2371 symbols completed. GME took 40.2s. Estimated remaining: 3h 28m 26s. Rate: 6.9 symbols/min [2025-09-17T19:17:40.421041] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-01. [2025-09-17T19:17:40.547768] [INFO ] [MAIN ] GNK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:17:40.589698] [DEBUG] [LOCAL ] GNK: Loaded 40999 existing records from primary storage. [2025-09-17T19:17:40.589866] [INFO ] [MAIN ] GNK: Loaded 40999 existing records. [2025-09-17T19:17:40.768470] [WARN ] [MAIN ] GNK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:17:40.768712] [INFO ] [MAIN ] GNK: Wiping existing primary data before full refresh. [2025-09-17T19:17:40.768765] [INFO ] [LOCAL ] GNK: Starting deletion of primary data. [2025-09-17T19:17:40.769670] [DEBUG] [LOCAL ] GNK: Deleted primary data file. [2025-09-17T19:17:40.769719] [INFO ] [MAIN ] GNK: Starting full primary refresh. [2025-09-17T19:17:41.154435] [INFO ] [REMOTE ] GNK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:17:41.165018] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T19:17:41.191851] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T19:17:41.215736] [INFO ] [REMOTE ] GMED: Fetching primary data for 2025-09. [2025-09-17T19:17:41.929304] [INFO ] [REMOTE ] GMED: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T19:17:41.935449] [INFO ] [REMOTE ] GMED: Full fetch complete (68770 records). [2025-09-17T19:17:41.935580] [DEBUG] [VALIDATOR ] GMED: Validating primary data. [2025-09-17T19:17:42.020913] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-11. [2025-09-17T19:17:42.337496] [DEBUG] [VALIDATOR ] GMED: All expected trading days are present. [2025-09-17T19:17:42.337656] [DEBUG] [VALIDATOR ] GMED: Primary data validation passed. [2025-09-17T19:17:42.338550] [INFO ] [MAIN ] GMED: Fetched primary data is valid. [2025-09-17T19:17:42.338612] [DEBUG] [LOCAL ] GMED: Saving primary data. [2025-09-17T19:17:42.340385] [DEBUG] [LOCAL ] GMED: Trimmed 68770 records to 48260 (keeping 200 days of data) [2025-09-17T19:17:42.622003] [DEBUG] [LOCAL ] GMED: Primary data saved (48260 records). [2025-09-17T19:17:42.622137] [INFO ] [MAIN ] GMED: Full history saved. [2025-09-17T19:17:42.622242] [INFO ] [MAIN ] Update Progress: 944/2371 symbols completed. GMED took 40.0s. Estimated remaining: 3h 28m 7s. Rate: 6.9 symbols/min [2025-09-17T19:17:42.793089] [INFO ] [MAIN ] GNL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:17:42.815953] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-02. [2025-09-17T19:17:42.835483] [DEBUG] [LOCAL ] GNL: Loaded 47603 existing records from primary storage. [2025-09-17T19:17:42.835626] [INFO ] [MAIN ] GNL: Loaded 47603 existing records. [2025-09-17T19:17:43.014572] [WARN ] [MAIN ] GNL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:17:43.014826] [INFO ] [MAIN ] GNL: Wiping existing primary data before full refresh. [2025-09-17T19:17:43.014872] [INFO ] [LOCAL ] GNL: Starting deletion of primary data. [2025-09-17T19:17:43.015798] [DEBUG] [LOCAL ] GNL: Deleted primary data file. [2025-09-17T19:17:43.015854] [INFO ] [MAIN ] GNL: Starting full primary refresh. [2025-09-17T19:17:43.372399] [INFO ] [REMOTE ] GNL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:17:43.501054] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T19:17:43.554545] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T19:17:43.615730] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-11. [2025-09-17T19:17:44.415768] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-03. [2025-09-17T19:17:45.070493] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T19:17:45.215778] [INFO ] [REMOTE ] GMRE: Fetching primary data for 2025-09. [2025-09-17T19:17:45.319549] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T19:17:45.883818] [INFO ] [REMOTE ] GMRE: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T19:17:45.889009] [INFO ] [REMOTE ] GMRE: Full fetch complete (53219 records). [2025-09-17T19:17:45.889115] [DEBUG] [VALIDATOR ] GMRE: Validating primary data. [2025-09-17T19:17:46.020948] [INFO ] [REMOTE ] GNK: Fetching primary data for 2024-12. [2025-09-17T19:17:46.276693] [DEBUG] [VALIDATOR ] GMRE: All expected trading days are present. [2025-09-17T19:17:46.276774] [DEBUG] [VALIDATOR ] GMRE: Primary data validation passed. [2025-09-17T19:17:46.277484] [INFO ] [MAIN ] GMRE: Fetched primary data is valid. [2025-09-17T19:17:46.277528] [DEBUG] [LOCAL ] GMRE: Saving primary data. [2025-09-17T19:17:46.278588] [DEBUG] [LOCAL ] GMRE: Trimmed 53219 records to 37641 (keeping 200 days of data) [2025-09-17T19:17:46.498429] [DEBUG] [LOCAL ] GMRE: Primary data saved (37641 records). [2025-09-17T19:17:46.498592] [INFO ] [MAIN ] GMRE: Full history saved. [2025-09-17T19:17:46.498722] [INFO ] [MAIN ] Update Progress: 945/2371 symbols completed. GMRE took 31.6s. Estimated remaining: 3h 27m 51s. Rate: 6.9 symbols/min [2025-09-17T19:17:46.670203] [INFO ] [MAIN ] GNRC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:17:46.713216] [DEBUG] [LOCAL ] GNRC: Loaded 45192 existing records from primary storage. [2025-09-17T19:17:46.713375] [INFO ] [MAIN ] GNRC: Loaded 45192 existing records. [2025-09-17T19:17:46.820847] [INFO ] [REMOTE ] GNL: Fetching primary data for 2024-12. [2025-09-17T19:17:46.892295] [WARN ] [MAIN ] GNRC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:17:46.892510] [INFO ] [MAIN ] GNRC: Wiping existing primary data before full refresh. [2025-09-17T19:17:46.892562] [INFO ] [LOCAL ] GNRC: Starting deletion of primary data. [2025-09-17T19:17:46.893438] [DEBUG] [LOCAL ] GNRC: Deleted primary data file. [2025-09-17T19:17:46.893485] [INFO ] [MAIN ] GNRC: Starting full primary refresh. [2025-09-17T19:17:47.252333] [INFO ] [REMOTE ] GNRC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:17:47.623390] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-11. [2025-09-17T19:17:47.628311] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T19:17:48.415787] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-01. [2025-09-17T19:17:48.523110] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T19:17:48.927824] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T19:17:49.215764] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-01. [2025-09-17T19:17:49.824807] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T19:17:50.015768] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-02. [2025-09-17T19:17:50.624054] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T19:17:50.815831] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2024-12. [2025-09-17T19:17:51.125742] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T19:17:51.615773] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-03. [2025-09-17T19:17:52.083048] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T19:17:52.415798] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-01. [2025-09-17T19:17:53.179772] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T19:17:53.215866] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-04. [2025-09-17T19:17:53.724321] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T19:17:54.014046] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T19:17:54.016400] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-04. [2025-09-17T19:17:54.815839] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-05. [2025-09-17T19:17:55.251515] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T19:17:55.532249] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T19:17:55.615815] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-02. [2025-09-17T19:17:56.415806] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-06. [2025-09-17T19:17:57.215741] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-02. [2025-09-17T19:17:57.261006] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T19:17:57.295706] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T19:17:58.015802] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-03. [2025-09-17T19:17:58.797227] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T19:17:58.815719] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-03. [2025-09-17T19:17:59.615752] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-07. [2025-09-17T19:17:59.704259] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T19:18:00.189768] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T19:18:00.415816] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-05. [2025-09-17T19:18:00.618010] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T19:18:01.215790] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-04. [2025-09-17T19:18:02.015815] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-08. [2025-09-17T19:18:02.566924] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T19:18:02.815792] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-06. [2025-09-17T19:18:03.615802] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-04. [2025-09-17T19:18:04.402949] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-17T19:18:04.415733] [INFO ] [REMOTE ] GNE: Fetching primary data for 2025-09. [2025-09-17T19:18:04.660704] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-04 (3.44 seconds). [2025-09-17T19:18:04.704599] [INFO ] [REMOTE ] GNE: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-17T19:18:04.707321] [INFO ] [REMOTE ] GNE: Full fetch complete (21970 records). [2025-09-17T19:18:04.707439] [DEBUG] [VALIDATOR ] GNE: Validating primary data. [2025-09-17T19:18:05.089610] [DEBUG] [VALIDATOR ] GNE: All expected trading days are present. [2025-09-17T19:18:05.089725] [DEBUG] [VALIDATOR ] GNE: Primary data validation passed. [2025-09-17T19:18:05.090393] [INFO ] [MAIN ] GNE: Fetched primary data is valid. [2025-09-17T19:18:05.090509] [DEBUG] [LOCAL ] GNE: Saving primary data. [2025-09-17T19:18:05.091346] [DEBUG] [LOCAL ] GNE: Trimmed 21970 records to 17363 (keeping 200 days of data) [2025-09-17T19:18:05.169820] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-17T19:18:05.216189] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-05. [2025-09-17T19:18:05.235540] [DEBUG] [LOCAL ] GNE: Primary data saved (17363 records). [2025-09-17T19:18:05.235688] [INFO ] [MAIN ] GNE: Full history saved. [2025-09-17T19:18:05.235779] [INFO ] [MAIN ] Update Progress: 946/2371 symbols completed. GNE took 34.6s. Estimated remaining: 3h 27m 58s. Rate: 6.9 symbols/min [2025-09-17T19:18:05.408127] [INFO ] [MAIN ] GNT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:18:05.418316] [DEBUG] [LOCAL ] GNT: Loaded 7773 existing records from primary storage. [2025-09-17T19:18:05.418439] [INFO ] [MAIN ] GNT: Loaded 7773 existing records. [2025-09-17T19:18:05.605552] [WARN ] [MAIN ] GNT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:18:05.606235] [INFO ] [MAIN ] GNT: Wiping existing primary data before full refresh. [2025-09-17T19:18:05.606362] [INFO ] [LOCAL ] GNT: Starting deletion of primary data. [2025-09-17T19:18:05.607173] [DEBUG] [LOCAL ] GNT: Deleted primary data file. [2025-09-17T19:18:05.607344] [INFO ] [MAIN ] GNT: Starting full primary refresh. [2025-09-17T19:18:06.016605] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-04 (2.40 seconds). [2025-09-17T19:18:06.022709] [INFO ] [REMOTE ] GNT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:18:06.023008] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-07. [2025-09-17T19:18:06.815790] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-05. [2025-09-17T19:18:06.898922] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T19:18:07.618840] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-06. [2025-09-17T19:18:07.624394] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T19:18:08.059088] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T19:18:08.415777] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-08. [2025-09-17T19:18:08.928588] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T19:18:09.215806] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-06. [2025-09-17T19:18:09.889092] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T19:18:10.015849] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-07. [2025-09-17T19:18:10.733966] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T19:18:10.815771] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-07. [2025-09-17T19:18:11.456882] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T19:18:11.615779] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-08. [2025-09-17T19:18:12.415765] [INFO ] [REMOTE ] GNK: Fetching primary data for 2025-09. [2025-09-17T19:18:12.448341] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T19:18:12.901139] [INFO ] [REMOTE ] GNK: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T19:18:12.906374] [INFO ] [REMOTE ] GNK: Full fetch complete (56964 records). [2025-09-17T19:18:12.906538] [DEBUG] [VALIDATOR ] GNK: Validating primary data. [2025-09-17T19:18:13.219030] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-08. [2025-09-17T19:18:13.311245] [DEBUG] [VALIDATOR ] GNK: All expected trading days are present. [2025-09-17T19:18:13.311414] [DEBUG] [VALIDATOR ] GNK: Primary data validation passed. [2025-09-17T19:18:13.312373] [INFO ] [MAIN ] GNK: Fetched primary data is valid. [2025-09-17T19:18:13.312485] [DEBUG] [LOCAL ] GNK: Saving primary data. [2025-09-17T19:18:13.314083] [DEBUG] [LOCAL ] GNK: Trimmed 56964 records to 40939 (keeping 200 days of data) [2025-09-17T19:18:13.439694] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T19:18:13.607708] [DEBUG] [LOCAL ] GNK: Primary data saved (40939 records). [2025-09-17T19:18:13.607837] [INFO ] [MAIN ] GNK: Full history saved. [2025-09-17T19:18:13.608986] [INFO ] [MAIN ] Update Progress: 947/2371 symbols completed. GNK took 33.2s. Estimated remaining: 3h 27m 48s. Rate: 6.9 symbols/min [2025-09-17T19:18:13.779481] [INFO ] [MAIN ] GNTY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:18:13.789064] [DEBUG] [LOCAL ] GNTY: Loaded 6938 existing records from primary storage. [2025-09-17T19:18:13.789191] [INFO ] [MAIN ] GNTY: Loaded 6938 existing records. [2025-09-17T19:18:13.966005] [WARN ] [MAIN ] GNTY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:18:13.966230] [INFO ] [MAIN ] GNTY: Wiping existing primary data before full refresh. [2025-09-17T19:18:13.966274] [INFO ] [LOCAL ] GNTY: Starting deletion of primary data. [2025-09-17T19:18:13.966556] [DEBUG] [LOCAL ] GNTY: Deleted primary data file. [2025-09-17T19:18:13.966599] [INFO ] [MAIN ] GNTY: Starting full primary refresh. [2025-09-17T19:18:14.020888] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-11. [2025-09-17T19:18:14.331982] [INFO ] [REMOTE ] GNTY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:18:14.815813] [INFO ] [REMOTE ] GNRC: Fetching primary data for 2025-09. [2025-09-17T19:18:15.300781] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T19:18:15.513730] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T19:18:15.615839] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-11. [2025-09-17T19:18:15.780365] [INFO ] [REMOTE ] GNRC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T19:18:15.787003] [INFO ] [REMOTE ] GNRC: Full fetch complete (64699 records). [2025-09-17T19:18:15.787153] [DEBUG] [VALIDATOR ] GNRC: Validating primary data. [2025-09-17T19:18:16.145788] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T19:18:16.183001] [DEBUG] [VALIDATOR ] GNRC: All expected trading days are present. [2025-09-17T19:18:16.183096] [DEBUG] [VALIDATOR ] GNRC: Primary data validation passed. [2025-09-17T19:18:16.184015] [INFO ] [MAIN ] GNRC: Fetched primary data is valid. [2025-09-17T19:18:16.184067] [DEBUG] [LOCAL ] GNRC: Saving primary data. [2025-09-17T19:18:16.185429] [DEBUG] [LOCAL ] GNRC: Trimmed 64699 records to 45119 (keeping 200 days of data) [2025-09-17T19:18:16.417271] [INFO ] [REMOTE ] GNT: Fetching primary data for 2024-12. [2025-09-17T19:18:16.460202] [DEBUG] [LOCAL ] GNRC: Primary data saved (45119 records). [2025-09-17T19:18:16.460340] [INFO ] [MAIN ] GNRC: Full history saved. [2025-09-17T19:18:16.460426] [INFO ] [MAIN ] Update Progress: 948/2371 symbols completed. GNRC took 30.0s. Estimated remaining: 3h 27m 31s. Rate: 6.9 symbols/min [2025-09-17T19:18:16.629637] [INFO ] [MAIN ] GNW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:18:16.676690] [DEBUG] [LOCAL ] GNW: Loaded 51318 existing records from primary storage. [2025-09-17T19:18:16.676832] [INFO ] [MAIN ] GNW: Loaded 51318 existing records. [2025-09-17T19:18:16.859317] [WARN ] [MAIN ] GNW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:18:16.859550] [INFO ] [MAIN ] GNW: Wiping existing primary data before full refresh. [2025-09-17T19:18:16.859594] [INFO ] [LOCAL ] GNW: Starting deletion of primary data. [2025-09-17T19:18:16.861029] [DEBUG] [LOCAL ] GNW: Deleted primary data file. [2025-09-17T19:18:16.861080] [INFO ] [MAIN ] GNW: Starting full primary refresh. [2025-09-17T19:18:17.098538] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T19:18:17.226523] [INFO ] [REMOTE ] GNL: Fetching primary data for 2025-09. [2025-09-17T19:18:17.238677] [INFO ] [REMOTE ] GNW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:18:17.996228] [INFO ] [REMOTE ] GNL: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T19:18:18.002170] [INFO ] [REMOTE ] GNL: Full fetch complete (68532 records). [2025-09-17T19:18:18.002305] [DEBUG] [VALIDATOR ] GNL: Validating primary data. [2025-09-17T19:18:18.023244] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-01. [2025-09-17T19:18:18.404191] [DEBUG] [VALIDATOR ] GNL: All expected trading days are present. [2025-09-17T19:18:18.404294] [DEBUG] [VALIDATOR ] GNL: Primary data validation passed. [2025-09-17T19:18:18.405275] [INFO ] [MAIN ] GNL: Fetched primary data is valid. [2025-09-17T19:18:18.405326] [DEBUG] [LOCAL ] GNL: Saving primary data. [2025-09-17T19:18:18.406887] [DEBUG] [LOCAL ] GNL: Trimmed 68532 records to 47570 (keeping 200 days of data) [2025-09-17T19:18:18.690604] [DEBUG] [LOCAL ] GNL: Primary data saved (47570 records). [2025-09-17T19:18:18.690789] [INFO ] [MAIN ] GNL: Full history saved. [2025-09-17T19:18:18.690912] [INFO ] [MAIN ] Update Progress: 949/2371 symbols completed. GNL took 36.1s. Estimated remaining: 3h 27m 12s. Rate: 6.9 symbols/min [2025-09-17T19:18:18.816472] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-11. [2025-09-17T19:18:18.822431] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T19:18:18.876771] [INFO ] [MAIN ] GOF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:18:18.918160] [DEBUG] [LOCAL ] GOF: Loaded 43094 existing records from primary storage. [2025-09-17T19:18:18.918313] [INFO ] [MAIN ] GOF: Loaded 43094 existing records. [2025-09-17T19:18:19.095763] [WARN ] [MAIN ] GOF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:18:19.096047] [INFO ] [MAIN ] GOF: Wiping existing primary data before full refresh. [2025-09-17T19:18:19.096090] [INFO ] [LOCAL ] GOF: Starting deletion of primary data. [2025-09-17T19:18:19.097236] [DEBUG] [LOCAL ] GOF: Deleted primary data file. [2025-09-17T19:18:19.097287] [INFO ] [MAIN ] GOF: Starting full primary refresh. [2025-09-17T19:18:19.486520] [INFO ] [REMOTE ] GOF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:18:19.615774] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-11. [2025-09-17T19:18:20.415822] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2024-12. [2025-09-17T19:18:20.486360] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T19:18:20.925988] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T19:18:21.176485] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T19:18:21.215829] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-01. [2025-09-17T19:18:22.012850] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T19:18:22.016580] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-02. [2025-09-17T19:18:22.674559] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T19:18:22.815776] [INFO ] [REMOTE ] GNW: Fetching primary data for 2024-12. [2025-09-17T19:18:23.615766] [INFO ] [REMOTE ] GOF: Fetching primary data for 2024-12. [2025-09-17T19:18:24.240203] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T19:18:24.415817] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-02. [2025-09-17T19:18:25.010756] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T19:18:25.215795] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-01. [2025-09-17T19:18:25.353097] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T19:18:26.015853] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-03. [2025-09-17T19:18:26.454869] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T19:18:26.825542] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-04. [2025-09-17T19:18:26.850869] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T19:18:27.351398] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-17T19:18:27.615803] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-01. [2025-09-17T19:18:28.415789] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-03. [2025-09-17T19:18:28.916040] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T19:18:29.215865] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-05. [2025-09-17T19:18:29.334854] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T19:18:29.817568] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T19:18:30.015787] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-02. [2025-09-17T19:18:30.815791] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-04. [2025-09-17T19:18:31.390533] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T19:18:31.615772] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-06. [2025-09-17T19:18:31.672670] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T19:18:32.365707] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T19:18:32.415793] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-03. [2025-09-17T19:18:33.215787] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-07. [2025-09-17T19:18:33.901936] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T19:18:33.902929] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T19:18:34.015793] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-08. [2025-09-17T19:18:34.739355] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T19:18:34.815791] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-02. [2025-09-17T19:18:35.615846] [INFO ] [REMOTE ] GNTY: Fetching primary data for 2025-09. [2025-09-17T19:18:36.035367] [INFO ] [REMOTE ] GNTY: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T19:18:36.037235] [INFO ] [REMOTE ] GNTY: Full fetch complete (10007 records). [2025-09-17T19:18:36.037334] [DEBUG] [VALIDATOR ] GNTY: Validating primary data. [2025-09-17T19:18:36.418052] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-04. [2025-09-17T19:18:36.447631] [DEBUG] [VALIDATOR ] GNTY: All expected trading days are present. [2025-09-17T19:18:36.448041] [DEBUG] [VALIDATOR ] GNTY: Primary data validation passed. [2025-09-17T19:18:36.448665] [INFO ] [MAIN ] GNTY: Fetched primary data is valid. [2025-09-17T19:18:36.448931] [DEBUG] [LOCAL ] GNTY: Saving primary data. [2025-09-17T19:18:36.450250] [DEBUG] [LOCAL ] GNTY: Trimmed 10007 records to 6954 (keeping 200 days of data) [2025-09-17T19:18:36.528452] [DEBUG] [LOCAL ] GNTY: Primary data saved (6954 records). [2025-09-17T19:18:36.529077] [INFO ] [MAIN ] GNTY: Full history saved. [2025-09-17T19:18:36.531167] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T19:18:36.529198] [INFO ] [MAIN ] Update Progress: 950/2371 symbols completed. GNTY took 22.9s. Estimated remaining: 3h 27m 17s. Rate: 6.9 symbols/min [2025-09-17T19:18:36.725282] [INFO ] [MAIN ] GOLF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:18:36.773004] [DEBUG] [LOCAL ] GOLF: Loaded 32174 existing records from primary storage. [2025-09-17T19:18:36.773202] [INFO ] [MAIN ] GOLF: Loaded 32174 existing records. [2025-09-17T19:18:36.955471] [WARN ] [MAIN ] GOLF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:18:36.955796] [INFO ] [MAIN ] GOLF: Wiping existing primary data before full refresh. [2025-09-17T19:18:36.955846] [INFO ] [LOCAL ] GOLF: Starting deletion of primary data. [2025-09-17T19:18:36.956598] [DEBUG] [LOCAL ] GOLF: Deleted primary data file. [2025-09-17T19:18:36.956693] [INFO ] [MAIN ] GOLF: Starting full primary refresh. [2025-09-17T19:18:37.220941] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-03. [2025-09-17T19:18:37.324861] [INFO ] [REMOTE ] GOLF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:18:38.015796] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-11. [2025-09-17T19:18:38.242916] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T19:18:38.769028] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T19:18:38.815775] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-04. [2025-09-17T19:18:38.939221] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T19:18:39.615806] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2024-12. [2025-09-17T19:18:40.415804] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-05. [2025-09-17T19:18:40.609472] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T19:18:40.717279] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T19:18:40.803586] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-17T19:18:41.215790] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-05. [2025-09-17T19:18:42.015783] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-06. [2025-09-17T19:18:42.815816] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-05. [2025-09-17T19:18:42.833109] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T19:18:42.921747] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T19:18:43.615762] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-06. [2025-09-17T19:18:44.415774] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-07. [2025-09-17T19:18:44.471684] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T19:18:45.129537] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T19:18:45.215753] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-06. [2025-09-17T19:18:45.464043] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T19:18:46.015790] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-08. [2025-09-17T19:18:46.772263] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T19:18:46.798853] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T19:18:46.815742] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-07. [2025-09-17T19:18:47.615766] [INFO ] [REMOTE ] GNT: Fetching primary data for 2025-09. [2025-09-17T19:18:48.135633] [INFO ] [REMOTE ] GNT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T19:18:48.137920] [INFO ] [REMOTE ] GNT: Full fetch complete (10290 records). [2025-09-17T19:18:48.138018] [DEBUG] [VALIDATOR ] GNT: Validating primary data. [2025-09-17T19:18:48.420849] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-07. [2025-09-17T19:18:48.512358] [DEBUG] [VALIDATOR ] GNT: All expected trading days are present. [2025-09-17T19:18:48.512440] [DEBUG] [VALIDATOR ] GNT: Primary data validation passed. [2025-09-17T19:18:48.512723] [INFO ] [MAIN ] GNT: Fetched primary data is valid. [2025-09-17T19:18:48.512785] [DEBUG] [LOCAL ] GNT: Saving primary data. [2025-09-17T19:18:48.513297] [DEBUG] [LOCAL ] GNT: Trimmed 10290 records to 7821 (keeping 200 days of data) [2025-09-17T19:18:48.586476] [DEBUG] [LOCAL ] GNT: Primary data saved (7821 records). [2025-09-17T19:18:48.587087] [INFO ] [MAIN ] GNT: Full history saved. [2025-09-17T19:18:48.588178] [INFO ] [MAIN ] Update Progress: 951/2371 symbols completed. GNT took 43.4s. Estimated remaining: 3h 27m 13s. Rate: 6.9 symbols/min [2025-09-17T19:18:48.588053] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T19:18:48.769583] [INFO ] [MAIN ] GOOS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:18:48.816998] [DEBUG] [LOCAL ] GOOS: Loaded 45921 existing records from primary storage. [2025-09-17T19:18:48.817177] [INFO ] [MAIN ] GOOS: Loaded 45921 existing records. [2025-09-17T19:18:48.998629] [WARN ] [MAIN ] GOOS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:18:48.999171] [INFO ] [MAIN ] GOOS: Wiping existing primary data before full refresh. [2025-09-17T19:18:48.999222] [INFO ] [LOCAL ] GOOS: Starting deletion of primary data. [2025-09-17T19:18:49.000284] [DEBUG] [LOCAL ] GOOS: Deleted primary data file. [2025-09-17T19:18:49.000345] [INFO ] [MAIN ] GOOS: Starting full primary refresh. [2025-09-17T19:18:49.220919] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-01. [2025-09-17T19:18:49.361933] [INFO ] [REMOTE ] GOOS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:18:50.015749] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-08. [2025-09-17T19:18:50.094526] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T19:18:50.195801] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T19:18:50.815791] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-11. [2025-09-17T19:18:51.516328] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T19:18:51.615801] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-08. [2025-09-17T19:18:52.007205] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T19:18:52.415823] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-02. [2025-09-17T19:18:53.215795] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2024-12. [2025-09-17T19:18:53.379782] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T19:18:53.740951] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T19:18:54.015814] [INFO ] [REMOTE ] GOF: Fetching primary data for 2025-09. [2025-09-17T19:18:54.516743] [INFO ] [REMOTE ] GOF: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T19:18:54.523867] [INFO ] [REMOTE ] GOF: Full fetch complete (62123 records). [2025-09-17T19:18:54.524009] [DEBUG] [VALIDATOR ] GOF: Validating primary data. [2025-09-17T19:18:54.821986] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-03. [2025-09-17T19:18:54.926987] [DEBUG] [VALIDATOR ] GOF: All expected trading days are present. [2025-09-17T19:18:54.927129] [DEBUG] [VALIDATOR ] GOF: Primary data validation passed. [2025-09-17T19:18:54.928117] [INFO ] [MAIN ] GOF: Fetched primary data is valid. [2025-09-17T19:18:54.928182] [DEBUG] [LOCAL ] GOF: Saving primary data. [2025-09-17T19:18:54.963167] [DEBUG] [LOCAL ] GOF: Trimmed 62123 records to 43087 (keeping 200 days of data) [2025-09-17T19:18:54.966343] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T19:18:55.254030] [DEBUG] [LOCAL ] GOF: Primary data saved (43087 records). [2025-09-17T19:18:55.254384] [INFO ] [MAIN ] GOF: Full history saved. [2025-09-17T19:18:55.254550] [INFO ] [MAIN ] Update Progress: 952/2371 symbols completed. GOF took 36.6s. Estimated remaining: 3h 27m 1s. Rate: 6.9 symbols/min [2025-09-17T19:18:55.428688] [INFO ] [MAIN ] GOTU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:18:55.469548] [DEBUG] [LOCAL ] GOTU: Loaded 39634 existing records from primary storage. [2025-09-17T19:18:55.469790] [INFO ] [MAIN ] GOTU: Loaded 39634 existing records. [2025-09-17T19:18:55.620904] [INFO ] [REMOTE ] GNW: Fetching primary data for 2025-09. [2025-09-17T19:18:55.649354] [WARN ] [MAIN ] GOTU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:18:55.649894] [INFO ] [MAIN ] GOTU: Wiping existing primary data before full refresh. [2025-09-17T19:18:55.649947] [INFO ] [LOCAL ] GOTU: Starting deletion of primary data. [2025-09-17T19:18:55.650823] [DEBUG] [LOCAL ] GOTU: Deleted primary data file. [2025-09-17T19:18:55.650884] [INFO ] [MAIN ] GOTU: Starting full primary refresh. [2025-09-17T19:18:56.017233] [INFO ] [REMOTE ] GOTU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:18:56.325410] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T19:18:56.415775] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-04. [2025-09-17T19:18:56.504428] [INFO ] [REMOTE ] GNW: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T19:18:56.515283] [INFO ] [REMOTE ] GNW: Full fetch complete (73170 records). [2025-09-17T19:18:56.515525] [DEBUG] [VALIDATOR ] GNW: Validating primary data. [2025-09-17T19:18:56.925883] [DEBUG] [VALIDATOR ] GNW: All expected trading days are present. [2025-09-17T19:18:56.926235] [DEBUG] [VALIDATOR ] GNW: Primary data validation passed. [2025-09-17T19:18:56.927165] [INFO ] [MAIN ] GNW: Fetched primary data is valid. [2025-09-17T19:18:56.927211] [DEBUG] [LOCAL ] GNW: Saving primary data. [2025-09-17T19:18:56.928629] [DEBUG] [LOCAL ] GNW: Trimmed 73170 records to 51331 (keeping 200 days of data) [2025-09-17T19:18:57.216457] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-11. [2025-09-17T19:18:57.226527] [DEBUG] [LOCAL ] GNW: Primary data saved (51331 records). [2025-09-17T19:18:57.226613] [INFO ] [MAIN ] GNW: Full history saved. [2025-09-17T19:18:57.226714] [INFO ] [MAIN ] Update Progress: 953/2371 symbols completed. GNW took 40.8s. Estimated remaining: 3h 26m 42s. Rate: 6.9 symbols/min [2025-09-17T19:18:57.395138] [INFO ] [MAIN ] GPC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:18:57.444333] [DEBUG] [LOCAL ] GPC: Loaded 46858 existing records from primary storage. [2025-09-17T19:18:57.444483] [INFO ] [MAIN ] GPC: Loaded 46858 existing records. [2025-09-17T19:18:57.625147] [WARN ] [MAIN ] GPC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:18:57.625409] [INFO ] [MAIN ] GPC: Wiping existing primary data before full refresh. [2025-09-17T19:18:57.625453] [INFO ] [LOCAL ] GPC: Starting deletion of primary data. [2025-09-17T19:18:57.626592] [DEBUG] [LOCAL ] GPC: Deleted primary data file. [2025-09-17T19:18:57.626665] [INFO ] [MAIN ] GPC: Starting full primary refresh. [2025-09-17T19:18:57.983873] [INFO ] [REMOTE ] GPC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:18:58.007144] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T19:18:58.015680] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-05. [2025-09-17T19:18:58.744281] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T19:18:58.815839] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-01. [2025-09-17T19:18:58.938588] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T19:18:59.615792] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2024-12. [2025-09-17T19:19:00.421210] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-06. [2025-09-17T19:19:00.440086] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T19:19:01.215837] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-02. [2025-09-17T19:19:01.322589] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T19:19:01.391034] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T19:19:02.015853] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-01. [2025-09-17T19:19:02.682054] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T19:19:02.815779] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-11. [2025-09-17T19:19:03.571058] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T19:19:03.615853] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-02. [2025-09-17T19:19:04.243631] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T19:19:04.415921] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-07. [2025-09-17T19:19:04.853659] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T19:19:05.215801] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-03. [2025-09-17T19:19:05.726909] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T19:19:06.015848] [INFO ] [REMOTE ] GPC: Fetching primary data for 2024-12. [2025-09-17T19:19:06.774043] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T19:19:06.815731] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-04. [2025-09-17T19:19:07.615806] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-08. [2025-09-17T19:19:07.779954] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T19:19:08.415742] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-01. [2025-09-17T19:19:08.505810] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T19:19:08.620610] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T19:19:09.215819] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-03. [2025-09-17T19:19:09.773153] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T19:19:10.015839] [INFO ] [REMOTE ] GOLF: Fetching primary data for 2025-09. [2025-09-17T19:19:10.585203] [INFO ] [REMOTE ] GOLF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:19:10.588980] [INFO ] [REMOTE ] GOLF: Full fetch complete (44676 records). [2025-09-17T19:19:10.589085] [DEBUG] [VALIDATOR ] GOLF: Validating primary data. [2025-09-17T19:19:10.821888] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-05. [2025-09-17T19:19:10.979934] [DEBUG] [VALIDATOR ] GOLF: All expected trading days are present. [2025-09-17T19:19:10.980071] [DEBUG] [VALIDATOR ] GOLF: Primary data validation passed. [2025-09-17T19:19:10.980900] [INFO ] [MAIN ] GOLF: Fetched primary data is valid. [2025-09-17T19:19:10.981052] [DEBUG] [LOCAL ] GOLF: Saving primary data. [2025-09-17T19:19:10.982503] [DEBUG] [LOCAL ] GOLF: Trimmed 44676 records to 32073 (keeping 200 days of data) [2025-09-17T19:19:11.104676] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T19:19:11.225156] [DEBUG] [LOCAL ] GOLF: Primary data saved (32073 records). [2025-09-17T19:19:11.225307] [INFO ] [MAIN ] GOLF: Full history saved. [2025-09-17T19:19:11.225416] [INFO ] [MAIN ] Update Progress: 954/2371 symbols completed. GOLF took 34.7s. Estimated remaining: 3h 26m 41s. Rate: 6.9 symbols/min [2025-09-17T19:19:11.393242] [INFO ] [MAIN ] GPI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:19:11.409051] [DEBUG] [LOCAL ] GPI: Loaded 15155 existing records from primary storage. [2025-09-17T19:19:11.409162] [INFO ] [MAIN ] GPI: Loaded 15155 existing records. [2025-09-17T19:19:11.589474] [WARN ] [MAIN ] GPI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:19:11.589757] [INFO ] [MAIN ] GPI: Wiping existing primary data before full refresh. [2025-09-17T19:19:11.589813] [INFO ] [LOCAL ] GPI: Starting deletion of primary data. [2025-09-17T19:19:11.590326] [DEBUG] [LOCAL ] GPI: Deleted primary data file. [2025-09-17T19:19:11.590370] [INFO ] [MAIN ] GPI: Starting full primary refresh. [2025-09-17T19:19:11.621747] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-02. [2025-09-17T19:19:11.969689] [INFO ] [REMOTE ] GPI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:19:12.415787] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-04. [2025-09-17T19:19:12.479588] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T19:19:13.215823] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-11. [2025-09-17T19:19:13.455909] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T19:19:13.748469] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T19:19:13.815486] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T19:19:14.015777] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-05. [2025-09-17T19:19:14.815802] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-06. [2025-09-17T19:19:15.615774] [INFO ] [REMOTE ] GPI: Fetching primary data for 2024-12. [2025-09-17T19:19:15.729037] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T19:19:16.278239] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T19:19:16.415769] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-06. [2025-09-17T19:19:16.465906] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T19:19:17.215782] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-01. [2025-09-17T19:19:17.877655] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T19:19:17.966724] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T19:19:18.015774] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-07. [2025-09-17T19:19:18.815823] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-07. [2025-09-17T19:19:19.615744] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-02. [2025-09-17T19:19:19.689748] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T19:19:20.260349] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T19:19:20.374846] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T19:19:20.415754] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-03. [2025-09-17T19:19:21.215775] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-08. [2025-09-17T19:19:21.546733] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T19:19:22.015811] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-03. [2025-09-17T19:19:22.712169] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T19:19:22.815767] [INFO ] [REMOTE ] GOTU: Fetching primary data for 2025-09. [2025-09-17T19:19:23.529761] [INFO ] [REMOTE ] GOTU: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T19:19:23.535720] [INFO ] [REMOTE ] GOTU: Full fetch complete (60033 records). [2025-09-17T19:19:23.535923] [DEBUG] [VALIDATOR ] GOTU: Validating primary data. [2025-09-17T19:19:23.620928] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-04. [2025-09-17T19:19:23.972671] [DEBUG] [VALIDATOR ] GOTU: All expected trading days are present. [2025-09-17T19:19:23.972835] [DEBUG] [VALIDATOR ] GOTU: Primary data validation passed. [2025-09-17T19:19:23.973914] [INFO ] [MAIN ] GOTU: Fetched primary data is valid. [2025-09-17T19:19:23.973983] [DEBUG] [LOCAL ] GOTU: Saving primary data. [2025-09-17T19:19:24.006813] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T19:19:24.005091] [DEBUG] [LOCAL ] GOTU: Trimmed 60033 records to 39534 (keeping 200 days of data) [2025-09-17T19:19:24.257128] [DEBUG] [LOCAL ] GOTU: Primary data saved (39534 records). [2025-09-17T19:19:24.257349] [INFO ] [MAIN ] GOTU: Full history saved. [2025-09-17T19:19:24.257460] [INFO ] [MAIN ] Update Progress: 955/2371 symbols completed. GOTU took 29.0s. Estimated remaining: 3h 26m 39s. Rate: 6.9 symbols/min [2025-09-17T19:19:24.425779] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-08. [2025-09-17T19:19:24.447848] [INFO ] [MAIN ] GPJA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:19:24.455322] [DEBUG] [LOCAL ] GPJA: Loaded 4018 existing records from primary storage. [2025-09-17T19:19:24.455461] [INFO ] [MAIN ] GPJA: Loaded 4018 existing records. [2025-09-17T19:19:24.643817] [WARN ] [MAIN ] GPJA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:19:24.644168] [INFO ] [MAIN ] GPJA: Wiping existing primary data before full refresh. [2025-09-17T19:19:24.644222] [INFO ] [LOCAL ] GPJA: Starting deletion of primary data. [2025-09-17T19:19:24.644505] [DEBUG] [LOCAL ] GPJA: Deleted primary data file. [2025-09-17T19:19:24.644553] [INFO ] [MAIN ] GPJA: Starting full primary refresh. [2025-09-17T19:19:25.015758] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T19:19:25.035117] [INFO ] [REMOTE ] GPJA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:19:25.215808] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-05. [2025-09-17T19:19:26.015793] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-11. [2025-09-17T19:19:26.350375] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T19:19:26.598569] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-08 (2.17 seconds). [2025-09-17T19:19:26.651757] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T19:19:26.815984] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-06. [2025-09-17T19:19:27.615822] [INFO ] [REMOTE ] GOOS: Fetching primary data for 2025-09. [2025-09-17T19:19:27.889000] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T19:19:28.368679] [INFO ] [REMOTE ] GOOS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T19:19:28.374728] [INFO ] [REMOTE ] GOOS: Full fetch complete (66167 records). [2025-09-17T19:19:28.374894] [DEBUG] [VALIDATOR ] GOOS: Validating primary data. [2025-09-17T19:19:28.420993] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-04. [2025-09-17T19:19:28.785306] [DEBUG] [VALIDATOR ] GOOS: All expected trading days are present. [2025-09-17T19:19:28.785420] [DEBUG] [VALIDATOR ] GOOS: Primary data validation passed. [2025-09-17T19:19:28.786316] [INFO ] [MAIN ] GOOS: Fetched primary data is valid. [2025-09-17T19:19:28.786372] [DEBUG] [LOCAL ] GOOS: Saving primary data. [2025-09-17T19:19:28.787875] [DEBUG] [LOCAL ] GOOS: Trimmed 66167 records to 45905 (keeping 200 days of data) [2025-09-17T19:19:29.057978] [DEBUG] [LOCAL ] GOOS: Primary data saved (45905 records). [2025-09-17T19:19:29.058114] [INFO ] [MAIN ] GOOS: Full history saved. [2025-09-17T19:19:29.058206] [INFO ] [MAIN ] Update Progress: 956/2371 symbols completed. GOOS took 40.5s. Estimated remaining: 3h 26m 24s. Rate: 6.9 symbols/min [2025-09-17T19:19:29.224381] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2024-12. [2025-09-17T19:19:29.226943] [INFO ] [MAIN ] GPK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:19:29.280138] [DEBUG] [LOCAL ] GPK: Loaded 52679 existing records from primary storage. [2025-09-17T19:19:29.280321] [INFO ] [MAIN ] GPK: Loaded 52679 existing records. [2025-09-17T19:19:29.456975] [WARN ] [MAIN ] GPK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:19:29.457231] [INFO ] [MAIN ] GPK: Wiping existing primary data before full refresh. [2025-09-17T19:19:29.457277] [INFO ] [LOCAL ] GPK: Starting deletion of primary data. [2025-09-17T19:19:29.458313] [DEBUG] [LOCAL ] GPK: Deleted primary data file. [2025-09-17T19:19:29.458361] [INFO ] [MAIN ] GPK: Starting full primary refresh. [2025-09-17T19:19:29.816581] [INFO ] [REMOTE ] GPK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:19:29.853209] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T19:19:29.891911] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T19:19:30.015797] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-07. [2025-09-17T19:19:30.815773] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-01. [2025-09-17T19:19:30.848173] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T19:19:31.393697] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-01 (0.58 seconds). [2025-09-17T19:19:31.615779] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-02. [2025-09-17T19:19:32.181586] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T19:19:32.415777] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-03. [2025-09-17T19:19:32.832355] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T19:19:33.215790] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-05. [2025-09-17T19:19:34.015878] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-11. [2025-09-17T19:19:34.527443] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T19:19:34.815821] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-06. [2025-09-17T19:19:35.615829] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-04. [2025-09-17T19:19:35.727951] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T19:19:36.169668] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T19:19:36.341537] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T19:19:36.415782] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-07. [2025-09-17T19:19:37.215786] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-05. [2025-09-17T19:19:37.682988] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T19:19:37.831582] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T19:19:38.015778] [INFO ] [REMOTE ] GPK: Fetching primary data for 2024-12. [2025-09-17T19:19:38.815775] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-08. [2025-09-17T19:19:39.615781] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-06. [2025-09-17T19:19:39.682986] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T19:19:39.744421] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T19:19:40.098883] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T19:19:40.415778] [INFO ] [REMOTE ] GPI: Fetching primary data for 2025-09. [2025-09-17T19:19:40.846734] [INFO ] [REMOTE ] GPI: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T19:19:40.849068] [INFO ] [REMOTE ] GPI: Full fetch complete (20798 records). [2025-09-17T19:19:40.849139] [DEBUG] [VALIDATOR ] GPI: Validating primary data. [2025-09-17T19:19:41.215252] [DEBUG] [VALIDATOR ] GPI: All expected trading days are present. [2025-09-17T19:19:41.215334] [DEBUG] [VALIDATOR ] GPI: Primary data validation passed. [2025-09-17T19:19:41.215867] [INFO ] [MAIN ] GPI: Fetched primary data is valid. [2025-09-17T19:19:41.216037] [DEBUG] [LOCAL ] GPI: Saving primary data. [2025-09-17T19:19:41.215958] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-01. [2025-09-17T19:19:41.217941] [DEBUG] [LOCAL ] GPI: Trimmed 20798 records to 15189 (keeping 200 days of data) [2025-09-17T19:19:41.315483] [DEBUG] [LOCAL ] GPI: Primary data saved (15189 records). [2025-09-17T19:19:41.315624] [INFO ] [MAIN ] GPI: Full history saved. [2025-09-17T19:19:41.315738] [INFO ] [MAIN ] Update Progress: 957/2371 symbols completed. GPI took 30.1s. Estimated remaining: 3h 26m 21s. Rate: 6.9 symbols/min [2025-09-17T19:19:42.015786] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-08. [2025-09-17T19:19:42.815768] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-07. [2025-09-17T19:19:43.060861] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T19:19:43.609818] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T19:19:43.615672] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-08. [2025-09-17T19:19:43.640900] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T19:19:44.245883] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T19:19:44.415774] [INFO ] [REMOTE ] GPJA: Fetching primary data for 2025-09. [2025-09-17T19:19:44.817293] [INFO ] [REMOTE ] GPJA: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T19:19:44.818575] [INFO ] [REMOTE ] GPJA: Full fetch complete (7286 records). [2025-09-17T19:19:44.818664] [DEBUG] [VALIDATOR ] GPJA: Validating primary data. [2025-09-17T19:19:45.194914] [DEBUG] [VALIDATOR ] GPJA: All expected trading days are present. [2025-09-17T19:19:45.195000] [DEBUG] [VALIDATOR ] GPJA: Primary data validation passed. [2025-09-17T19:19:45.195222] [INFO ] [MAIN ] GPJA: Fetched primary data is valid. [2025-09-17T19:19:45.195260] [DEBUG] [LOCAL ] GPJA: Saving primary data. [2025-09-17T19:19:45.195697] [DEBUG] [LOCAL ] GPJA: Trimmed 7286 records to 4030 (keeping 200 days of data) [2025-09-17T19:19:45.217090] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-02. [2025-09-17T19:19:45.222890] [DEBUG] [LOCAL ] GPJA: Primary data saved (4030 records). [2025-09-17T19:19:45.222982] [INFO ] [MAIN ] GPJA: Full history saved. [2025-09-17T19:19:45.223069] [INFO ] [MAIN ] Update Progress: 958/2371 symbols completed. GPJA took 21.0s. Estimated remaining: 3h 26m 5s. Rate: 6.9 symbols/min [2025-09-17T19:19:46.015786] [INFO ] [REMOTE ] GPC: Fetching primary data for 2025-09. [2025-09-17T19:19:46.590061] [INFO ] [REMOTE ] GPC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:19:46.596250] [INFO ] [REMOTE ] GPC: Full fetch complete (69070 records). [2025-09-17T19:19:46.596387] [DEBUG] [VALIDATOR ] GPC: Validating primary data. [2025-09-17T19:19:46.984934] [DEBUG] [VALIDATOR ] GPC: All expected trading days are present. [2025-09-17T19:19:46.985110] [DEBUG] [VALIDATOR ] GPC: Primary data validation passed. [2025-09-17T19:19:46.986030] [INFO ] [MAIN ] GPC: Fetched primary data is valid. [2025-09-17T19:19:46.986125] [DEBUG] [LOCAL ] GPC: Saving primary data. [2025-09-17T19:19:46.996810] [DEBUG] [LOCAL ] GPC: Trimmed 69070 records to 46846 (keeping 200 days of data) [2025-09-17T19:19:47.013947] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T19:19:47.120979] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-03. [2025-09-17T19:19:47.333113] [DEBUG] [LOCAL ] GPC: Primary data saved (46846 records). [2025-09-17T19:19:47.333293] [INFO ] [MAIN ] GPC: Full history saved. [2025-09-17T19:19:47.333384] [INFO ] [MAIN ] Update Progress: 959/2371 symbols completed. GPC took 50.1s. Estimated remaining: 3h 25m 46s. Rate: 6.9 symbols/min [2025-09-17T19:19:48.819285] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T19:19:48.830390] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-04. [2025-09-17T19:19:50.559288] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T19:19:50.570437] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-05. [2025-09-17T19:19:52.366142] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T19:19:52.378094] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-06. [2025-09-17T19:19:54.060893] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T19:19:54.071716] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-07. [2025-09-17T19:19:55.905618] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T19:19:55.918186] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-08. [2025-09-17T19:19:57.619980] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T19:19:57.631886] [INFO ] [REMOTE ] GPK: Fetching primary data for 2025-09. [2025-09-17T19:19:58.431333] [INFO ] [REMOTE ] GPK: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T19:19:58.441144] [INFO ] [REMOTE ] GPK: Full fetch complete (75186 records). [2025-09-17T19:19:58.441307] [DEBUG] [VALIDATOR ] GPK: Validating primary data. [2025-09-17T19:19:58.838555] [DEBUG] [VALIDATOR ] GPK: All expected trading days are present. [2025-09-17T19:19:58.838637] [DEBUG] [VALIDATOR ] GPK: Primary data validation passed. [2025-09-17T19:19:58.839529] [INFO ] [MAIN ] GPK: Fetched primary data is valid. [2025-09-17T19:19:58.839578] [DEBUG] [LOCAL ] GPK: Saving primary data. [2025-09-17T19:19:58.841164] [DEBUG] [LOCAL ] GPK: Trimmed 75186 records to 52677 (keeping 200 days of data) [2025-09-17T19:19:59.171411] [DEBUG] [LOCAL ] GPK: Primary data saved (52677 records). [2025-09-17T19:19:59.171561] [INFO ] [MAIN ] GPK: Full history saved. [2025-09-17T19:19:59.171670] [INFO ] [MAIN ] Update Progress: 960/2371 symbols completed. GPK took 30.1s. Estimated remaining: 3h 25m 42s. Rate: 6.9 symbols/min [2025-09-17T19:19:59.733343] [INFO ] [MAIN ] GPMT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:19:59.836896] [INFO ] [MAIN ] GPRK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:19:59.877541] [INFO ] [MAIN ] GPOR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:19:59.910238] [INFO ] [MAIN ] GPN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:19:59.943456] [DEBUG] [LOCAL ] GPMT: Loaded 26872 existing records from primary storage. [2025-09-17T19:19:59.948319] [INFO ] [MAIN ] GPMT: Loaded 26872 existing records. [2025-09-17T19:20:00.071284] [DEBUG] [LOCAL ] GPOR: Loaded 22934 existing records from primary storage. [2025-09-17T19:20:00.097511] [INFO ] [MAIN ] GPOR: Loaded 22934 existing records. [2025-09-17T19:20:00.155581] [DEBUG] [LOCAL ] GPRK: Loaded 39088 existing records from primary storage. [2025-09-17T19:20:00.219198] [INFO ] [MAIN ] GPRK: Loaded 39088 existing records. [2025-09-17T19:20:00.333473] [WARN ] [MAIN ] GPMT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:20:00.421407] [DEBUG] [LOCAL ] GPN: Loaded 52089 existing records from primary storage. [2025-09-17T19:20:00.470854] [INFO ] [MAIN ] GPMT: Wiping existing primary data before full refresh. [2025-09-17T19:20:00.470798] [INFO ] [MAIN ] GPN: Loaded 52089 existing records. [2025-09-17T19:20:00.484251] [INFO ] [LOCAL ] GPMT: Starting deletion of primary data. [2025-09-17T19:20:00.508332] [DEBUG] [LOCAL ] GPMT: Deleted primary data file. [2025-09-17T19:20:00.539191] [INFO ] [MAIN ] GPMT: Starting full primary refresh. [2025-09-17T19:20:00.579752] [WARN ] [MAIN ] GPOR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:20:00.731496] [INFO ] [MAIN ] GPOR: Wiping existing primary data before full refresh. [2025-09-17T19:20:00.801131] [INFO ] [LOCAL ] GPOR: Starting deletion of primary data. [2025-09-17T19:20:00.797498] [WARN ] [MAIN ] GPRK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:20:00.817808] [DEBUG] [LOCAL ] GPOR: Deleted primary data file. [2025-09-17T19:20:00.823610] [INFO ] [MAIN ] GPRK: Wiping existing primary data before full refresh. [2025-09-17T19:20:00.833986] [INFO ] [MAIN ] GPOR: Starting full primary refresh. [2025-09-17T19:20:00.844434] [INFO ] [LOCAL ] GPRK: Starting deletion of primary data. [2025-09-17T19:20:00.999084] [DEBUG] [LOCAL ] GPRK: Deleted primary data file. [2025-09-17T19:20:01.045433] [INFO ] [MAIN ] GPRK: Starting full primary refresh. [2025-09-17T19:20:01.040271] [WARN ] [MAIN ] GPN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:20:01.134366] [INFO ] [MAIN ] GPN: Wiping existing primary data before full refresh. [2025-09-17T19:20:01.193388] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-17T19:20:01.307350] [DEBUG] [LOCAL ] GPN: Deleted primary data file. [2025-09-17T19:20:01.361470] [INFO ] [MAIN ] GPN: Starting full primary refresh. [2025-09-17T19:20:01.795969] [INFO ] [REMOTE ] GPMT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:20:01.840736] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-11. [2025-09-17T19:20:02.113565] [INFO ] [REMOTE ] GPOR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:20:02.165519] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-11. [2025-09-17T19:20:02.393073] [INFO ] [REMOTE ] GPRK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:20:02.430159] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-11. [2025-09-17T19:20:02.462518] [INFO ] [REMOTE ] GPN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:20:02.463069] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-11. [2025-09-17T19:20:03.088300] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T19:20:03.094362] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2024-12. [2025-09-17T19:20:03.380156] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T19:20:03.387404] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2024-12. [2025-09-17T19:20:04.117692] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T19:20:04.124359] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2024-12. [2025-09-17T19:20:04.354078] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T19:20:04.365121] [INFO ] [REMOTE ] GPN: Fetching primary data for 2024-12. [2025-09-17T19:20:04.474098] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T19:20:04.480239] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-01. [2025-09-17T19:20:04.901960] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T19:20:04.908550] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-01. [2025-09-17T19:20:05.645833] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T19:20:05.654367] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-01. [2025-09-17T19:20:05.852811] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T19:20:05.872384] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-02. [2025-09-17T19:20:05.874260] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T19:20:05.880063] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-02. [2025-09-17T19:20:06.184220] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T19:20:06.194551] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-01. [2025-09-17T19:20:06.990899] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T19:20:06.995907] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-03. [2025-09-17T19:20:07.038695] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T19:20:07.045566] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-03. [2025-09-17T19:20:07.267671] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T19:20:07.277133] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-02. [2025-09-17T19:20:07.420940] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T19:20:07.431235] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-02. [2025-09-17T19:20:07.835824] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T19:20:07.841203] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-04. [2025-09-17T19:20:08.238922] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T19:20:08.245000] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-04. [2025-09-17T19:20:08.324864] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T19:20:08.415837] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-03. [2025-09-17T19:20:08.775489] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T19:20:08.816696] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T19:20:09.215793] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-05. [2025-09-17T19:20:09.434990] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T19:20:09.945322] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T19:20:10.015735] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-04. [2025-09-17T19:20:10.496840] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T19:20:10.815801] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-05. [2025-09-17T19:20:11.624824] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-06. [2025-09-17T19:20:11.630561] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T19:20:11.660589] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T19:20:12.415818] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-05. [2025-09-17T19:20:12.906523] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T19:20:13.215853] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-07. [2025-09-17T19:20:13.978054] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T19:20:14.015719] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-06. [2025-09-17T19:20:14.288330] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T19:20:14.815845] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-03. [2025-09-17T19:20:15.209684] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T19:20:15.615905] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-07. [2025-09-17T19:20:16.238803] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T19:20:16.415756] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-04. [2025-09-17T19:20:17.125806] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T19:20:17.215829] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-08. [2025-09-17T19:20:17.982448] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T19:20:18.015734] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-05. [2025-09-17T19:20:18.121527] [DEBUG] [REMOTE ] GPN: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-17T19:20:18.121901] [WARN ] [REMOTE ] GPN: No data returned for month 2025-05 [2025-09-17T19:20:18.241148] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T19:20:18.815775] [INFO ] [REMOTE ] GPMT: Fetching primary data for 2025-09. [2025-09-17T19:20:19.348265] [INFO ] [REMOTE ] GPMT: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T19:20:19.350779] [INFO ] [REMOTE ] GPMT: Full fetch complete (38035 records). [2025-09-17T19:20:19.350857] [DEBUG] [VALIDATOR ] GPMT: Validating primary data. [2025-09-17T19:20:19.620923] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-06. [2025-09-17T19:20:19.732389] [DEBUG] [VALIDATOR ] GPMT: All expected trading days are present. [2025-09-17T19:20:19.732472] [DEBUG] [VALIDATOR ] GPMT: Primary data validation passed. [2025-09-17T19:20:19.733119] [INFO ] [MAIN ] GPMT: Fetched primary data is valid. [2025-09-17T19:20:19.733165] [DEBUG] [LOCAL ] GPMT: Saving primary data. [2025-09-17T19:20:19.734013] [DEBUG] [LOCAL ] GPMT: Trimmed 38035 records to 26887 (keeping 200 days of data) [2025-09-17T19:20:19.902935] [DEBUG] [LOCAL ] GPMT: Primary data saved (26887 records). [2025-09-17T19:20:19.903089] [INFO ] [MAIN ] GPMT: Full history saved. [2025-09-17T19:20:19.903174] [INFO ] [MAIN ] Update Progress: 961/2371 symbols completed. GPMT took 20.7s. Estimated remaining: 3h 25m 51s. Rate: 6.8 symbols/min [2025-09-17T19:20:20.070097] [INFO ] [MAIN ] GRBK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:20:20.096473] [DEBUG] [LOCAL ] GRBK: Loaded 27437 existing records from primary storage. [2025-09-17T19:20:20.096599] [INFO ] [MAIN ] GRBK: Loaded 27437 existing records. [2025-09-17T19:20:20.271825] [WARN ] [MAIN ] GRBK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:20:20.272064] [INFO ] [MAIN ] GRBK: Wiping existing primary data before full refresh. [2025-09-17T19:20:20.272141] [INFO ] [LOCAL ] GRBK: Starting deletion of primary data. [2025-09-17T19:20:20.273131] [DEBUG] [LOCAL ] GRBK: Deleted primary data file. [2025-09-17T19:20:20.273179] [INFO ] [MAIN ] GRBK: Starting full primary refresh. [2025-09-17T19:20:20.421365] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-06. [2025-09-17T19:20:20.629471] [INFO ] [REMOTE ] GRBK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:20:21.215797] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-08. [2025-09-17T19:20:21.391178] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T19:20:21.640957] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T19:20:22.015825] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-07. [2025-09-17T19:20:22.644171] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T19:20:22.820902] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-07. [2025-09-17T19:20:22.829177] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T19:20:23.615840] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-08. [2025-09-17T19:20:24.415767] [INFO ] [REMOTE ] GPRK: Fetching primary data for 2025-09. [2025-09-17T19:20:24.560130] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T19:20:24.664155] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T19:20:24.749854] [INFO ] [REMOTE ] GPRK: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-17T19:20:24.754821] [INFO ] [REMOTE ] GPRK: Full fetch complete (57049 records). [2025-09-17T19:20:24.754941] [DEBUG] [VALIDATOR ] GPRK: Validating primary data. [2025-09-17T19:20:25.138764] [DEBUG] [VALIDATOR ] GPRK: All expected trading days are present. [2025-09-17T19:20:25.138859] [DEBUG] [VALIDATOR ] GPRK: Primary data validation passed. [2025-09-17T19:20:25.139604] [INFO ] [MAIN ] GPRK: Fetched primary data is valid. [2025-09-17T19:20:25.139685] [DEBUG] [LOCAL ] GPRK: Saving primary data. [2025-09-17T19:20:25.141095] [DEBUG] [LOCAL ] GPRK: Trimmed 57049 records to 39196 (keeping 200 days of data) [2025-09-17T19:20:25.228922] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-08. [2025-09-17T19:20:25.377710] [DEBUG] [LOCAL ] GPRK: Primary data saved (39196 records). [2025-09-17T19:20:25.377858] [INFO ] [MAIN ] GPRK: Full history saved. [2025-09-17T19:20:25.377963] [INFO ] [MAIN ] Update Progress: 962/2371 symbols completed. GPRK took 26.2s. Estimated remaining: 3h 25m 38s. Rate: 6.9 symbols/min [2025-09-17T19:20:25.549353] [INFO ] [MAIN ] GRC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:20:25.559089] [DEBUG] [LOCAL ] GRC: Loaded 8755 existing records from primary storage. [2025-09-17T19:20:25.559196] [INFO ] [MAIN ] GRC: Loaded 8755 existing records. [2025-09-17T19:20:25.737794] [WARN ] [MAIN ] GRC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:20:25.738102] [INFO ] [MAIN ] GRC: Wiping existing primary data before full refresh. [2025-09-17T19:20:25.738153] [INFO ] [LOCAL ] GRC: Starting deletion of primary data. [2025-09-17T19:20:25.738727] [DEBUG] [LOCAL ] GRC: Deleted primary data file. [2025-09-17T19:20:25.738777] [INFO ] [MAIN ] GRC: Starting full primary refresh. [2025-09-17T19:20:26.020994] [INFO ] [REMOTE ] GPOR: Fetching primary data for 2025-09. [2025-09-17T19:20:26.122719] [INFO ] [REMOTE ] GRC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:20:26.527232] [INFO ] [REMOTE ] GPOR: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T19:20:26.533283] [INFO ] [REMOTE ] GPOR: Full fetch complete (34720 records). [2025-09-17T19:20:26.533507] [DEBUG] [VALIDATOR ] GPOR: Validating primary data. [2025-09-17T19:20:26.822069] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-11. [2025-09-17T19:20:26.938437] [DEBUG] [VALIDATOR ] GPOR: All expected trading days are present. [2025-09-17T19:20:26.938674] [DEBUG] [VALIDATOR ] GPOR: Primary data validation passed. [2025-09-17T19:20:26.939440] [INFO ] [MAIN ] GPOR: Fetched primary data is valid. [2025-09-17T19:20:26.939605] [DEBUG] [LOCAL ] GPOR: Saving primary data. [2025-09-17T19:20:26.941070] [DEBUG] [LOCAL ] GPOR: Trimmed 34720 records to 23033 (keeping 200 days of data) [2025-09-17T19:20:27.098913] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T19:20:27.150225] [DEBUG] [LOCAL ] GPOR: Primary data saved (23033 records). [2025-09-17T19:20:27.150378] [INFO ] [MAIN ] GPOR: Full history saved. [2025-09-17T19:20:27.150464] [INFO ] [MAIN ] Update Progress: 963/2371 symbols completed. GPOR took 28.0s. Estimated remaining: 3h 25m 19s. Rate: 6.9 symbols/min [2025-09-17T19:20:27.323002] [INFO ] [MAIN ] GRDN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:20:27.342544] [DEBUG] [LOCAL ] GRDN: Loaded 18874 existing records from primary storage. [2025-09-17T19:20:27.342716] [INFO ] [MAIN ] GRDN: Loaded 18874 existing records. [2025-09-17T19:20:27.524090] [WARN ] [MAIN ] GRDN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:20:27.524390] [INFO ] [MAIN ] GRDN: Wiping existing primary data before full refresh. [2025-09-17T19:20:27.524437] [INFO ] [LOCAL ] GRDN: Starting deletion of primary data. [2025-09-17T19:20:27.525016] [DEBUG] [LOCAL ] GRDN: Deleted primary data file. [2025-09-17T19:20:27.525064] [INFO ] [MAIN ] GRDN: Starting full primary refresh. [2025-09-17T19:20:27.622930] [INFO ] [REMOTE ] GPN: Fetching primary data for 2025-09. [2025-09-17T19:20:27.825960] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T19:20:27.901582] [INFO ] [REMOTE ] GRDN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:20:28.415781] [INFO ] [REMOTE ] GRC: Fetching primary data for 2024-12. [2025-09-17T19:20:28.517565] [INFO ] [REMOTE ] GPN: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T19:20:28.524270] [INFO ] [REMOTE ] GPN: Full fetch complete (66533 records). [2025-09-17T19:20:28.524405] [DEBUG] [VALIDATOR ] GPN: Validating primary data. [2025-09-17T19:20:28.734078] [WARN ] [VALIDATOR ] GPN: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T19:20:28.734836] [FATAL] [MAIN ] GPN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:20:28.734892] [WARN ] [MAIN ] GPN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:20:28.734942] [INFO ] [LOCAL ] GPN: Starting deletion of primary data. [2025-09-17T19:20:28.735016] [DEBUG] [LOCAL ] GPN: No primary data file found to delete. [2025-09-17T19:20:28.735055] [INFO ] [LOCAL ] GPN: Starting deletion of derivative data. [2025-09-17T19:20:28.735433] [DEBUG] [LOCAL ] GPN: Deleted derivative data file. [2025-09-17T19:20:28.735521] [INFO ] [MAIN ] Update Progress: 964/2371 symbols completed. GPN took 29.6s. Estimated remaining: 3h 24m 59s. Rate: 6.9 symbols/min [2025-09-17T19:20:28.909253] [INFO ] [MAIN ] GRMN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:20:28.952997] [DEBUG] [LOCAL ] GRMN: Loaded 41810 existing records from primary storage. [2025-09-17T19:20:28.953162] [INFO ] [MAIN ] GRMN: Loaded 41810 existing records. [2025-09-17T19:20:29.134659] [WARN ] [MAIN ] GRMN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:20:29.134893] [INFO ] [MAIN ] GRMN: Wiping existing primary data before full refresh. [2025-09-17T19:20:29.134937] [INFO ] [LOCAL ] GRMN: Starting deletion of primary data. [2025-09-17T19:20:29.136258] [DEBUG] [LOCAL ] GRMN: Deleted primary data file. [2025-09-17T19:20:29.136336] [INFO ] [MAIN ] GRMN: Starting full primary refresh. [2025-09-17T19:20:29.217454] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-11. [2025-09-17T19:20:29.332189] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T19:20:29.519611] [INFO ] [REMOTE ] GRMN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:20:30.015801] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-01. [2025-09-17T19:20:30.656381] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T19:20:30.815808] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2024-12. [2025-09-17T19:20:30.827497] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T19:20:31.615759] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-11. [2025-09-17T19:20:32.322750] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T19:20:32.415735] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-01. [2025-09-17T19:20:32.697723] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T19:20:33.215782] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2024-12. [2025-09-17T19:20:33.463413] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T19:20:34.013043] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T19:20:34.017658] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-11. [2025-09-17T19:20:34.815794] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-02. [2025-09-17T19:20:35.615817] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-02. [2025-09-17T19:20:35.624030] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T19:20:35.659438] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T19:20:36.415784] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-03. [2025-09-17T19:20:36.807749] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T19:20:37.215812] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2024-12. [2025-09-17T19:20:37.259086] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T19:20:38.015820] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-03. [2025-09-17T19:20:38.563276] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T19:20:38.815775] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-04. [2025-09-17T19:20:39.489988] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T19:20:39.503862] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T19:20:39.615732] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-01. [2025-09-17T19:20:40.415782] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-04. [2025-09-17T19:20:40.480399] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T19:20:41.215776] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-02. [2025-09-17T19:20:41.736613] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T19:20:42.015775] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-05. [2025-09-17T19:20:42.035223] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T19:20:42.815786] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-01. [2025-09-17T19:20:43.237958] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T19:20:43.615795] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-06. [2025-09-17T19:20:44.382919] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T19:20:44.415748] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-05. [2025-09-17T19:20:44.741156] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T19:20:45.215775] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-02. [2025-09-17T19:20:45.248918] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T19:20:46.015871] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-07. [2025-09-17T19:20:46.793153] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T19:20:46.815767] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-03. [2025-09-17T19:20:47.097477] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T19:20:47.615790] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-06. [2025-09-17T19:20:48.116996] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T19:20:48.414323] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T19:20:48.416128] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-04. [2025-09-17T19:20:49.215785] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-07. [2025-09-17T19:20:50.015795] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-08. [2025-09-17T19:20:50.033995] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T19:20:50.200574] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T19:20:50.815756] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-08. [2025-09-17T19:20:50.916995] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T19:20:51.587580] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T19:20:51.615780] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-03. [2025-09-17T19:20:52.415835] [INFO ] [REMOTE ] GRBK: Fetching primary data for 2025-09. [2025-09-17T19:20:52.598244] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T19:20:53.085405] [INFO ] [REMOTE ] GRBK: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T19:20:53.091250] [INFO ] [REMOTE ] GRBK: Full fetch complete (40649 records). [2025-09-17T19:20:53.091468] [DEBUG] [VALIDATOR ] GRBK: Validating primary data. [2025-09-17T19:20:53.221061] [INFO ] [REMOTE ] GRC: Fetching primary data for 2025-09. [2025-09-17T19:20:53.682149] [DEBUG] [VALIDATOR ] GRBK: All expected trading days are present. [2025-09-17T19:20:53.682290] [DEBUG] [VALIDATOR ] GRBK: Primary data validation passed. [2025-09-17T19:20:53.683552] [INFO ] [MAIN ] GRBK: Fetched primary data is valid. [2025-09-17T19:20:53.683668] [DEBUG] [LOCAL ] GRBK: Saving primary data. [2025-09-17T19:20:53.685319] [DEBUG] [LOCAL ] GRBK: Trimmed 40649 records to 27273 (keeping 200 days of data) [2025-09-17T19:20:53.823878] [INFO ] [REMOTE ] GRC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T19:20:53.829370] [INFO ] [REMOTE ] GRC: Full fetch complete (12853 records). [2025-09-17T19:20:53.832142] [DEBUG] [VALIDATOR ] GRC: Validating primary data. [2025-09-17T19:20:54.026292] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-05. [2025-09-17T19:20:54.330283] [DEBUG] [VALIDATOR ] GRC: All expected trading days are present. [2025-09-17T19:20:54.331426] [DEBUG] [VALIDATOR ] GRC: Primary data validation passed. [2025-09-17T19:20:54.335907] [INFO ] [MAIN ] GRC: Fetched primary data is valid. [2025-09-17T19:20:54.335423] [DEBUG] [LOCAL ] GRBK: Primary data saved (27273 records). [2025-09-17T19:20:54.336027] [DEBUG] [LOCAL ] GRC: Saving primary data. [2025-09-17T19:20:54.336079] [INFO ] [MAIN ] GRBK: Full history saved. [2025-09-17T19:20:54.336390] [INFO ] [MAIN ] Update Progress: 965/2371 symbols completed. GRBK took 34.4s. Estimated remaining: 3h 25m 15s. Rate: 6.9 symbols/min [2025-09-17T19:20:54.413603] [DEBUG] [LOCAL ] GRC: Trimmed 12853 records to 8807 (keeping 200 days of data) [2025-09-17T19:20:54.551770] [INFO ] [MAIN ] GRND: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:20:54.565854] [DEBUG] [LOCAL ] GRC: Primary data saved (8807 records). [2025-09-17T19:20:54.566049] [INFO ] [MAIN ] GRC: Full history saved. [2025-09-17T19:20:54.566140] [INFO ] [MAIN ] Update Progress: 966/2371 symbols completed. GRC took 29.2s. Estimated remaining: 3h 24m 54s. Rate: 6.9 symbols/min [2025-09-17T19:20:54.763198] [INFO ] [MAIN ] GRNT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:20:54.765944] [DEBUG] [LOCAL ] GRND: Loaded 50159 existing records from primary storage. [2025-09-17T19:20:54.766213] [INFO ] [MAIN ] GRND: Loaded 50159 existing records. [2025-09-17T19:20:54.821441] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-04. [2025-09-17T19:20:54.962986] [WARN ] [MAIN ] GRND: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:20:54.963220] [INFO ] [MAIN ] GRND: Wiping existing primary data before full refresh. [2025-09-17T19:20:54.963264] [INFO ] [LOCAL ] GRND: Starting deletion of primary data. [2025-09-17T19:20:54.964412] [DEBUG] [LOCAL ] GRND: Deleted primary data file. [2025-09-17T19:20:54.964480] [INFO ] [MAIN ] GRND: Starting full primary refresh. [2025-09-17T19:20:55.076715] [DEBUG] [LOCAL ] GRNT: Loaded 33961 existing records from primary storage. [2025-09-17T19:20:55.076921] [INFO ] [MAIN ] GRNT: Loaded 33961 existing records. [2025-09-17T19:20:55.410254] [WARN ] [MAIN ] GRNT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:20:55.438524] [INFO ] [MAIN ] GRNT: Wiping existing primary data before full refresh. [2025-09-17T19:20:55.449087] [INFO ] [LOCAL ] GRNT: Starting deletion of primary data. [2025-09-17T19:20:55.454894] [DEBUG] [LOCAL ] GRNT: Deleted primary data file. [2025-09-17T19:20:55.455087] [INFO ] [MAIN ] GRNT: Starting full primary refresh. [2025-09-17T19:20:55.626190] [INFO ] [REMOTE ] GRND: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:20:55.638119] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-11. [2025-09-17T19:20:55.903450] [INFO ] [REMOTE ] GRNT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:20:55.934688] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T19:20:55.951903] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T19:20:56.415818] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-11. [2025-09-17T19:20:56.995290] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T19:20:57.215841] [INFO ] [REMOTE ] GRND: Fetching primary data for 2024-12. [2025-09-17T19:20:57.839407] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T19:20:58.015777] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2024-12. [2025-09-17T19:20:58.815793] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-06. [2025-09-17T19:20:58.906051] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T19:20:59.421267] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T19:20:59.615786] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-01. [2025-09-17T19:21:00.377921] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T19:21:00.415767] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-07. [2025-09-17T19:21:01.215792] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-05. [2025-09-17T19:21:01.283186] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T19:21:02.015814] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-02. [2025-09-17T19:21:02.624315] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T19:21:02.815791] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-08. [2025-09-17T19:21:03.381597] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T19:21:03.615807] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-01. [2025-09-17T19:21:04.415826] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-06. [2025-09-17T19:21:04.923572] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T19:21:04.953126] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T19:21:05.215803] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-02. [2025-09-17T19:21:05.448862] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T19:21:05.580470] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-02 (3.56 seconds). [2025-09-17T19:21:06.015799] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-07. [2025-09-17T19:21:06.209148] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T19:21:06.815795] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-03. [2025-09-17T19:21:07.026115] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T19:21:07.615832] [INFO ] [REMOTE ] GRMN: Fetching primary data for 2025-09. [2025-09-17T19:21:08.283636] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T19:21:08.341835] [INFO ] [REMOTE ] GRMN: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T19:21:08.347367] [INFO ] [REMOTE ] GRMN: Full fetch complete (60190 records). [2025-09-17T19:21:08.347506] [DEBUG] [VALIDATOR ] GRMN: Validating primary data. [2025-09-17T19:21:08.420861] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-04. [2025-09-17T19:21:08.738022] [DEBUG] [VALIDATOR ] GRMN: All expected trading days are present. [2025-09-17T19:21:08.738167] [DEBUG] [VALIDATOR ] GRMN: Primary data validation passed. [2025-09-17T19:21:08.739052] [INFO ] [MAIN ] GRMN: Fetched primary data is valid. [2025-09-17T19:21:08.739135] [DEBUG] [LOCAL ] GRMN: Saving primary data. [2025-09-17T19:21:08.740730] [DEBUG] [LOCAL ] GRMN: Trimmed 60190 records to 41725 (keeping 200 days of data) [2025-09-17T19:21:09.033819] [DEBUG] [LOCAL ] GRMN: Primary data saved (41725 records). [2025-09-17T19:21:09.033969] [INFO ] [MAIN ] GRMN: Full history saved. [2025-09-17T19:21:09.034099] [INFO ] [MAIN ] Update Progress: 967/2371 symbols completed. GRMN took 40.3s. Estimated remaining: 3h 24m 54s. Rate: 6.9 symbols/min [2025-09-17T19:21:09.202493] [INFO ] [MAIN ] GROV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:21:09.215688] [DEBUG] [LOCAL ] GROV: Loaded 9293 existing records from primary storage. [2025-09-17T19:21:09.215760] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-03. [2025-09-17T19:21:09.215990] [INFO ] [MAIN ] GROV: Loaded 9293 existing records. [2025-09-17T19:21:09.394680] [WARN ] [MAIN ] GROV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:21:09.394909] [INFO ] [MAIN ] GROV: Wiping existing primary data before full refresh. [2025-09-17T19:21:09.394961] [INFO ] [LOCAL ] GROV: Starting deletion of primary data. [2025-09-17T19:21:09.395266] [DEBUG] [LOCAL ] GROV: Deleted primary data file. [2025-09-17T19:21:09.395318] [INFO ] [MAIN ] GROV: Starting full primary refresh. [2025-09-17T19:21:09.751550] [INFO ] [REMOTE ] GROV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:21:09.914486] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T19:21:10.015740] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-11. [2025-09-17T19:21:10.630360] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T19:21:10.815698] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-05. [2025-09-17T19:21:10.865164] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T19:21:11.615749] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-08. [2025-09-17T19:21:12.076352] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T19:21:12.417560] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-04. [2025-09-17T19:21:12.420270] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T19:21:13.215809] [INFO ] [REMOTE ] GRDN: Fetching primary data for 2025-09. [2025-09-17T19:21:13.879551] [INFO ] [REMOTE ] GRDN: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T19:21:13.883617] [INFO ] [REMOTE ] GRDN: Full fetch complete (25501 records). [2025-09-17T19:21:13.883795] [DEBUG] [VALIDATOR ] GRDN: Validating primary data. [2025-09-17T19:21:14.026823] [INFO ] [REMOTE ] GROV: Fetching primary data for 2024-12. [2025-09-17T19:21:14.295333] [DEBUG] [VALIDATOR ] GRDN: All expected trading days are present. [2025-09-17T19:21:14.295453] [DEBUG] [VALIDATOR ] GRDN: Primary data validation passed. [2025-09-17T19:21:14.296007] [INFO ] [MAIN ] GRDN: Fetched primary data is valid. [2025-09-17T19:21:14.296052] [DEBUG] [LOCAL ] GRDN: Saving primary data. [2025-09-17T19:21:14.297043] [DEBUG] [LOCAL ] GRDN: Trimmed 25501 records to 19111 (keeping 200 days of data) [2025-09-17T19:21:14.410311] [DEBUG] [LOCAL ] GRDN: Primary data saved (19111 records). [2025-09-17T19:21:14.410520] [INFO ] [MAIN ] GRDN: Full history saved. [2025-09-17T19:21:14.410694] [INFO ] [MAIN ] Update Progress: 968/2371 symbols completed. GRDN took 47.3s. Estimated remaining: 3h 24m 40s. Rate: 6.9 symbols/min [2025-09-17T19:21:14.566388] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-17T19:21:14.641557] [INFO ] [MAIN ] GRX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:21:14.647962] [DEBUG] [LOCAL ] GRX: Loaded 4268 existing records from primary storage. [2025-09-17T19:21:14.648057] [INFO ] [MAIN ] GRX: Loaded 4268 existing records. [2025-09-17T19:21:14.820991] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-06. [2025-09-17T19:21:14.825555] [WARN ] [MAIN ] GRX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:21:14.826609] [INFO ] [MAIN ] GRX: Wiping existing primary data before full refresh. [2025-09-17T19:21:14.826703] [INFO ] [LOCAL ] GRX: Starting deletion of primary data. [2025-09-17T19:21:14.827022] [DEBUG] [LOCAL ] GRX: Deleted primary data file. [2025-09-17T19:21:14.827087] [INFO ] [MAIN ] GRX: Starting full primary refresh. [2025-09-17T19:21:15.182963] [INFO ] [REMOTE ] GRX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:21:15.615771] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-11. [2025-09-17T19:21:15.765243] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T19:21:16.310983] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-17T19:21:16.415820] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-05. [2025-09-17T19:21:16.741981] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T19:21:17.215845] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-07. [2025-09-17T19:21:18.015814] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-01. [2025-09-17T19:21:18.146018] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T19:21:18.280894] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T19:21:18.815813] [INFO ] [REMOTE ] GRX: Fetching primary data for 2024-12. [2025-09-17T19:21:18.919086] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T19:21:19.579339] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T19:21:19.615759] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-01. [2025-09-17T19:21:20.121288] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T19:21:20.415775] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-06. [2025-09-17T19:21:21.215844] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-02. [2025-09-17T19:21:21.787058] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T19:21:21.876993] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T19:21:22.015785] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-02. [2025-09-17T19:21:22.803408] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T19:21:22.815721] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-03. [2025-09-17T19:21:23.590397] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T19:21:23.615775] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-04. [2025-09-17T19:21:24.399619] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T19:21:24.415706] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-05. [2025-09-17T19:21:24.966096] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T19:21:25.215783] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-07. [2025-09-17T19:21:26.015867] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-03. [2025-09-17T19:21:26.458144] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T19:21:26.815766] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-08. [2025-09-17T19:21:26.881311] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T19:21:27.615799] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-08. [2025-09-17T19:21:28.241915] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T19:21:28.415799] [INFO ] [REMOTE ] GRNT: Fetching primary data for 2025-09. [2025-09-17T19:21:29.088473] [INFO ] [REMOTE ] GRNT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T19:21:29.093616] [INFO ] [REMOTE ] GRNT: Full fetch complete (48296 records). [2025-09-17T19:21:29.094009] [DEBUG] [VALIDATOR ] GRNT: Validating primary data. [2025-09-17T19:21:29.220904] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-06. [2025-09-17T19:21:29.510524] [DEBUG] [VALIDATOR ] GRNT: All expected trading days are present. [2025-09-17T19:21:29.510699] [DEBUG] [VALIDATOR ] GRNT: Primary data validation passed. [2025-09-17T19:21:29.511555] [INFO ] [MAIN ] GRNT: Fetched primary data is valid. [2025-09-17T19:21:29.511613] [DEBUG] [LOCAL ] GRNT: Saving primary data. [2025-09-17T19:21:29.512998] [DEBUG] [LOCAL ] GRNT: Trimmed 48296 records to 33999 (keeping 200 days of data) [2025-09-17T19:21:29.657918] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T19:21:29.771472] [DEBUG] [LOCAL ] GRNT: Primary data saved (33999 records). [2025-09-17T19:21:29.771630] [INFO ] [MAIN ] GRNT: Full history saved. [2025-09-17T19:21:29.771735] [INFO ] [MAIN ] Update Progress: 969/2371 symbols completed. GRNT took 35.2s. Estimated remaining: 3h 24m 41s. Rate: 6.8 symbols/min [2025-09-17T19:21:29.899137] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T19:21:29.951200] [INFO ] [MAIN ] GS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:21:30.006060] [DEBUG] [LOCAL ] GS: Loaded 52208 existing records from primary storage. [2025-09-17T19:21:30.006235] [INFO ] [MAIN ] GS: Loaded 52208 existing records. [2025-09-17T19:21:30.020897] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-07. [2025-09-17T19:21:30.193221] [WARN ] [MAIN ] GS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:21:30.193496] [INFO ] [MAIN ] GS: Wiping existing primary data before full refresh. [2025-09-17T19:21:30.193545] [INFO ] [LOCAL ] GS: Starting deletion of primary data. [2025-09-17T19:21:30.194924] [DEBUG] [LOCAL ] GS: Deleted primary data file. [2025-09-17T19:21:30.194980] [INFO ] [MAIN ] GS: Starting full primary refresh. [2025-09-17T19:21:30.555907] [INFO ] [REMOTE ] GS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:21:30.815739] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-11. [2025-09-17T19:21:31.117876] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T19:21:31.615771] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-08. [2025-09-17T19:21:32.402692] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T19:21:32.415693] [INFO ] [REMOTE ] GROV: Fetching primary data for 2025-09. [2025-09-17T19:21:32.892220] [INFO ] [REMOTE ] GROV: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T19:21:32.904112] [INFO ] [REMOTE ] GROV: Full fetch complete (15110 records). [2025-09-17T19:21:32.910148] [DEBUG] [VALIDATOR ] GROV: Validating primary data. [2025-09-17T19:21:32.992939] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-11 (2.18 seconds). [2025-09-17T19:21:33.220969] [INFO ] [REMOTE ] GRND: Fetching primary data for 2025-09. [2025-09-17T19:21:33.303827] [DEBUG] [VALIDATOR ] GROV: All expected trading days are present. [2025-09-17T19:21:33.303978] [DEBUG] [VALIDATOR ] GROV: Primary data validation passed. [2025-09-17T19:21:33.304358] [INFO ] [MAIN ] GROV: Fetched primary data is valid. [2025-09-17T19:21:33.304397] [DEBUG] [LOCAL ] GROV: Saving primary data. [2025-09-17T19:21:33.304952] [DEBUG] [LOCAL ] GROV: Trimmed 15110 records to 9217 (keeping 200 days of data) [2025-09-17T19:21:33.361860] [DEBUG] [LOCAL ] GROV: Primary data saved (9217 records). [2025-09-17T19:21:33.361995] [INFO ] [MAIN ] GROV: Full history saved. [2025-09-17T19:21:33.362080] [INFO ] [MAIN ] Update Progress: 970/2371 symbols completed. GROV took 24.3s. Estimated remaining: 3h 24m 24s. Rate: 6.9 symbols/min [2025-09-17T19:21:33.532073] [INFO ] [MAIN ] GSBD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:21:33.574991] [DEBUG] [LOCAL ] GSBD: Loaded 39330 existing records from primary storage. [2025-09-17T19:21:33.575132] [INFO ] [MAIN ] GSBD: Loaded 39330 existing records. [2025-09-17T19:21:33.763192] [WARN ] [MAIN ] GSBD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:21:33.763529] [INFO ] [MAIN ] GSBD: Wiping existing primary data before full refresh. [2025-09-17T19:21:33.763667] [INFO ] [LOCAL ] GSBD: Starting deletion of primary data. [2025-09-17T19:21:33.769887] [DEBUG] [LOCAL ] GSBD: Deleted primary data file. [2025-09-17T19:21:33.779430] [INFO ] [MAIN ] GSBD: Starting full primary refresh. [2025-09-17T19:21:33.812849] [INFO ] [REMOTE ] GRND: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T19:21:33.888360] [INFO ] [REMOTE ] GRND: Full fetch complete (69891 records). [2025-09-17T19:21:33.890964] [DEBUG] [VALIDATOR ] GRND: Validating primary data. [2025-09-17T19:21:34.018241] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-04. [2025-09-17T19:21:34.468275] [INFO ] [REMOTE ] GSBD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:21:34.562733] [DEBUG] [VALIDATOR ] GRND: All expected trading days are present. [2025-09-17T19:21:34.562824] [DEBUG] [VALIDATOR ] GRND: Primary data validation passed. [2025-09-17T19:21:34.563852] [INFO ] [MAIN ] GRND: Fetched primary data is valid. [2025-09-17T19:21:34.563907] [DEBUG] [LOCAL ] GRND: Saving primary data. [2025-09-17T19:21:34.565364] [DEBUG] [LOCAL ] GRND: Trimmed 69891 records to 50183 (keeping 200 days of data) [2025-09-17T19:21:34.777668] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T19:21:34.841982] [INFO ] [REMOTE ] GS: Fetching primary data for 2024-12. [2025-09-17T19:21:34.879990] [DEBUG] [LOCAL ] GRND: Primary data saved (50183 records). [2025-09-17T19:21:34.880122] [INFO ] [MAIN ] GRND: Full history saved. [2025-09-17T19:21:34.881406] [INFO ] [MAIN ] Update Progress: 971/2371 symbols completed. GRND took 40.5s. Estimated remaining: 3h 24m 5s. Rate: 6.9 symbols/min [2025-09-17T19:21:35.057150] [INFO ] [MAIN ] GSK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:21:35.116416] [DEBUG] [LOCAL ] GSK: Loaded 53504 existing records from primary storage. [2025-09-17T19:21:35.116615] [INFO ] [MAIN ] GSK: Loaded 53504 existing records. [2025-09-17T19:21:35.305395] [WARN ] [MAIN ] GSK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:21:35.305659] [INFO ] [MAIN ] GSK: Wiping existing primary data before full refresh. [2025-09-17T19:21:35.305720] [INFO ] [LOCAL ] GSK: Starting deletion of primary data. [2025-09-17T19:21:35.306829] [DEBUG] [LOCAL ] GSK: Deleted primary data file. [2025-09-17T19:21:35.306882] [INFO ] [MAIN ] GSK: Starting full primary refresh. [2025-09-17T19:21:35.620923] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-05. [2025-09-17T19:21:35.683155] [INFO ] [REMOTE ] GSK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:21:36.097331] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T19:21:36.415778] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-06. [2025-09-17T19:21:36.985688] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-17T19:21:37.001001] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T19:21:37.215770] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-07. [2025-09-17T19:21:37.859082] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T19:21:38.015785] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-08. [2025-09-17T19:21:38.689998] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T19:21:38.815807] [INFO ] [REMOTE ] GRX: Fetching primary data for 2025-09. [2025-09-17T19:21:39.286436] [INFO ] [REMOTE ] GRX: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T19:21:39.288006] [INFO ] [REMOTE ] GRX: Full fetch complete (6415 records). [2025-09-17T19:21:39.288075] [DEBUG] [VALIDATOR ] GRX: Validating primary data. [2025-09-17T19:21:39.620905] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-11. [2025-09-17T19:21:39.654397] [DEBUG] [VALIDATOR ] GRX: All expected trading days are present. [2025-09-17T19:21:39.654543] [DEBUG] [VALIDATOR ] GRX: Primary data validation passed. [2025-09-17T19:21:39.654840] [INFO ] [MAIN ] GRX: Fetched primary data is valid. [2025-09-17T19:21:39.654884] [DEBUG] [LOCAL ] GRX: Saving primary data. [2025-09-17T19:21:39.655294] [DEBUG] [LOCAL ] GRX: Trimmed 6415 records to 4339 (keeping 200 days of data) [2025-09-17T19:21:39.682906] [DEBUG] [LOCAL ] GRX: Primary data saved (4339 records). [2025-09-17T19:21:39.683029] [INFO ] [MAIN ] GRX: Full history saved. [2025-09-17T19:21:39.683131] [INFO ] [MAIN ] Update Progress: 972/2371 symbols completed. GRX took 25.3s. Estimated remaining: 3h 23m 51s. Rate: 6.9 symbols/min [2025-09-17T19:21:39.852687] [INFO ] [MAIN ] GSL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:21:39.889374] [DEBUG] [LOCAL ] GSL: Loaded 33934 existing records from primary storage. [2025-09-17T19:21:39.889523] [INFO ] [MAIN ] GSL: Loaded 33934 existing records. [2025-09-17T19:21:40.069718] [WARN ] [MAIN ] GSL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:21:40.069990] [INFO ] [MAIN ] GSL: Wiping existing primary data before full refresh. [2025-09-17T19:21:40.070036] [INFO ] [LOCAL ] GSL: Starting deletion of primary data. [2025-09-17T19:21:40.070852] [DEBUG] [LOCAL ] GSL: Deleted primary data file. [2025-09-17T19:21:40.070901] [INFO ] [MAIN ] GSL: Starting full primary refresh. [2025-09-17T19:21:40.418450] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-11. [2025-09-17T19:21:40.444855] [INFO ] [REMOTE ] GSL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:21:41.215779] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-11. [2025-09-17T19:21:41.592893] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T19:21:41.675959] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T19:21:42.015789] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-01. [2025-09-17T19:21:42.347969] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T19:21:42.815777] [INFO ] [REMOTE ] GSL: Fetching primary data for 2024-12. [2025-09-17T19:21:43.615782] [INFO ] [REMOTE ] GSK: Fetching primary data for 2024-12. [2025-09-17T19:21:44.129680] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T19:21:44.335971] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-17T19:21:44.415765] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-01. [2025-09-17T19:21:45.215748] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-02. [2025-09-17T19:21:45.296806] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T19:21:45.725617] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T19:21:46.015864] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-02. [2025-09-17T19:21:46.815808] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-01. [2025-09-17T19:21:47.075726] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T19:21:47.301817] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T19:21:47.615786] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2024-12. [2025-09-17T19:21:48.415838] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-03. [2025-09-17T19:21:48.693511] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T19:21:49.215830] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-02. [2025-09-17T19:21:49.267510] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T19:21:49.774389] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T19:21:50.015793] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-04. [2025-09-17T19:21:50.774102] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T19:21:50.815762] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-03. [2025-09-17T19:21:51.476164] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T19:21:51.615785] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-05. [2025-09-17T19:21:52.415836] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-01. [2025-09-17T19:21:53.085022] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T19:21:53.167446] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-17T19:21:53.215766] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-04. [2025-09-17T19:21:53.630033] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T19:21:54.015828] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-06. [2025-09-17T19:21:54.815833] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-02. [2025-09-17T19:21:55.472527] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T19:21:55.605286] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T19:21:55.616914] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-03. [2025-09-17T19:21:56.262681] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T19:21:56.415789] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-03. [2025-09-17T19:21:57.148558] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T19:21:57.215810] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-07. [2025-09-17T19:21:57.947410] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T19:21:58.015806] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-04. [2025-09-17T19:21:58.613783] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T19:21:58.815807] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-04. [2025-09-17T19:21:59.615866] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-05. [2025-09-17T19:22:00.029122] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T19:22:00.415773] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-05. [2025-09-17T19:22:00.595249] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T19:22:01.215834] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-08. [2025-09-17T19:22:01.599261] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T19:22:02.015705] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-06. [2025-09-17T19:22:02.094062] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T19:22:02.328756] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T19:22:02.815824] [INFO ] [REMOTE ] GSL: Fetching primary data for 2025-09. [2025-09-17T19:22:03.272052] [INFO ] [REMOTE ] GSL: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T19:22:03.276582] [INFO ] [REMOTE ] GSL: Full fetch complete (48344 records). [2025-09-17T19:22:03.276748] [DEBUG] [VALIDATOR ] GSL: Validating primary data. [2025-09-17T19:22:03.623717] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-05. [2025-09-17T19:22:03.667218] [DEBUG] [VALIDATOR ] GSL: All expected trading days are present. [2025-09-17T19:22:03.667306] [DEBUG] [VALIDATOR ] GSL: Primary data validation passed. [2025-09-17T19:22:03.668033] [INFO ] [MAIN ] GSL: Fetched primary data is valid. [2025-09-17T19:22:03.668085] [DEBUG] [LOCAL ] GSL: Saving primary data. [2025-09-17T19:22:03.669273] [DEBUG] [LOCAL ] GSL: Trimmed 48344 records to 33924 (keeping 200 days of data) [2025-09-17T19:22:03.883900] [DEBUG] [LOCAL ] GSL: Primary data saved (33924 records). [2025-09-17T19:22:03.884063] [INFO ] [MAIN ] GSL: Full history saved. [2025-09-17T19:22:03.884178] [INFO ] [MAIN ] Update Progress: 973/2371 symbols completed. GSL took 24.2s. Estimated remaining: 3h 24m 4s. Rate: 6.9 symbols/min [2025-09-17T19:22:04.068282] [INFO ] [MAIN ] GTES: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:22:04.120031] [DEBUG] [LOCAL ] GTES: Loaded 50740 existing records from primary storage. [2025-09-17T19:22:04.140985] [INFO ] [MAIN ] GTES: Loaded 50740 existing records. [2025-09-17T19:22:04.268821] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T19:22:04.366340] [WARN ] [MAIN ] GTES: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:22:04.366611] [INFO ] [MAIN ] GTES: Wiping existing primary data before full refresh. [2025-09-17T19:22:04.366675] [INFO ] [LOCAL ] GTES: Starting deletion of primary data. [2025-09-17T19:22:04.367714] [DEBUG] [LOCAL ] GTES: Deleted primary data file. [2025-09-17T19:22:04.367765] [INFO ] [MAIN ] GTES: Starting full primary refresh. [2025-09-17T19:22:04.426493] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-06. [2025-09-17T19:22:04.731776] [INFO ] [REMOTE ] GTES: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:22:05.194223] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T19:22:05.215724] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-06. [2025-09-17T19:22:06.015745] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-11. [2025-09-17T19:22:06.529763] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-17T19:22:06.590776] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T19:22:06.815831] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-07. [2025-09-17T19:22:07.311793] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T19:22:07.615792] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-07. [2025-09-17T19:22:08.416009] [INFO ] [REMOTE ] GTES: Fetching primary data for 2024-12. [2025-09-17T19:22:08.419083] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T19:22:09.215812] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-08. [2025-09-17T19:22:09.523363] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T19:22:10.015788] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-08. [2025-09-17T19:22:10.138619] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T19:22:10.311207] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T19:22:10.815804] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-07. [2025-09-17T19:22:11.615792] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-01. [2025-09-17T19:22:11.968686] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T19:22:12.415762] [INFO ] [REMOTE ] GSBD: Fetching primary data for 2025-09. [2025-09-17T19:22:12.889854] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T19:22:13.058810] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T19:22:13.102707] [INFO ] [REMOTE ] GSBD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T19:22:13.107692] [INFO ] [REMOTE ] GSBD: Full fetch complete (58247 records). [2025-09-17T19:22:13.107801] [DEBUG] [VALIDATOR ] GSBD: Validating primary data. [2025-09-17T19:22:13.218781] [INFO ] [REMOTE ] GS: Fetching primary data for 2025-09. [2025-09-17T19:22:13.512139] [DEBUG] [VALIDATOR ] GSBD: All expected trading days are present. [2025-09-17T19:22:13.512258] [DEBUG] [VALIDATOR ] GSBD: Primary data validation passed. [2025-09-17T19:22:13.513381] [INFO ] [MAIN ] GSBD: Fetched primary data is valid. [2025-09-17T19:22:13.513437] [DEBUG] [LOCAL ] GSBD: Saving primary data. [2025-09-17T19:22:13.515238] [DEBUG] [LOCAL ] GSBD: Trimmed 58247 records to 39249 (keeping 200 days of data) [2025-09-17T19:22:13.779111] [DEBUG] [LOCAL ] GSBD: Primary data saved (39249 records). [2025-09-17T19:22:13.779311] [INFO ] [MAIN ] GSBD: Full history saved. [2025-09-17T19:22:13.779407] [INFO ] [MAIN ] Update Progress: 974/2371 symbols completed. GSBD took 40.4s. Estimated remaining: 3h 23m 57s. Rate: 6.8 symbols/min [2025-09-17T19:22:13.957013] [INFO ] [MAIN ] GTLS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:22:14.000410] [DEBUG] [LOCAL ] GTLS: Loaded 43162 existing records from primary storage. [2025-09-17T19:22:14.000576] [INFO ] [MAIN ] GTLS: Loaded 43162 existing records. [2025-09-17T19:22:14.022225] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-08. [2025-09-17T19:22:14.222330] [WARN ] [MAIN ] GTLS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:22:14.222759] [INFO ] [MAIN ] GTLS: Wiping existing primary data before full refresh. [2025-09-17T19:22:14.222853] [INFO ] [LOCAL ] GTLS: Starting deletion of primary data. [2025-09-17T19:22:14.223762] [DEBUG] [LOCAL ] GTLS: Deleted primary data file. [2025-09-17T19:22:14.223816] [INFO ] [MAIN ] GTLS: Starting full primary refresh. [2025-09-17T19:22:14.350910] [INFO ] [REMOTE ] GS: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T19:22:14.416367] [INFO ] [REMOTE ] GS: Full fetch complete (75814 records). [2025-09-17T19:22:14.417990] [DEBUG] [VALIDATOR ] GS: Validating primary data. [2025-09-17T19:22:14.857213] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-02. [2025-09-17T19:22:14.860878] [INFO ] [REMOTE ] GTLS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:22:15.022414] [DEBUG] [VALIDATOR ] GS: All expected trading days are present. [2025-09-17T19:22:15.022512] [DEBUG] [VALIDATOR ] GS: Primary data validation passed. [2025-09-17T19:22:15.023431] [INFO ] [MAIN ] GS: Fetched primary data is valid. [2025-09-17T19:22:15.023513] [DEBUG] [LOCAL ] GS: Saving primary data. [2025-09-17T19:22:15.025516] [DEBUG] [LOCAL ] GS: Trimmed 75814 records to 52186 (keeping 200 days of data) [2025-09-17T19:22:15.372800] [DEBUG] [LOCAL ] GS: Primary data saved (52186 records). [2025-09-17T19:22:15.373022] [INFO ] [MAIN ] GS: Full history saved. [2025-09-17T19:22:15.373135] [INFO ] [MAIN ] Update Progress: 975/2371 symbols completed. GS took 45.6s. Estimated remaining: 3h 23m 38s. Rate: 6.9 symbols/min [2025-09-17T19:22:15.588530] [INFO ] [MAIN ] GTN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:22:15.615779] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-11. [2025-09-17T19:22:15.633735] [DEBUG] [LOCAL ] GTN: Loaded 45912 existing records from primary storage. [2025-09-17T19:22:15.633913] [INFO ] [MAIN ] GTN: Loaded 45912 existing records. [2025-09-17T19:22:15.823667] [WARN ] [MAIN ] GTN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:22:15.823952] [INFO ] [MAIN ] GTN: Wiping existing primary data before full refresh. [2025-09-17T19:22:15.824004] [INFO ] [LOCAL ] GTN: Starting deletion of primary data. [2025-09-17T19:22:15.825000] [DEBUG] [LOCAL ] GTN: Deleted primary data file. [2025-09-17T19:22:15.825076] [INFO ] [MAIN ] GTN: Starting full primary refresh. [2025-09-17T19:22:16.210188] [INFO ] [REMOTE ] GTN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:22:16.243125] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-17T19:22:16.415803] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-11. [2025-09-17T19:22:16.517333] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T19:22:17.215912] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-03. [2025-09-17T19:22:17.312696] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T19:22:18.007503] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T19:22:18.015988] [INFO ] [REMOTE ] GSK: Fetching primary data for 2025-09. [2025-09-17T19:22:18.517313] [INFO ] [REMOTE ] GSK: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T19:22:18.524447] [INFO ] [REMOTE ] GSK: Full fetch complete (77328 records). [2025-09-17T19:22:18.524623] [DEBUG] [VALIDATOR ] GSK: Validating primary data. [2025-09-17T19:22:18.816738] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2024-12. [2025-09-17T19:22:18.965718] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T19:22:19.003140] [DEBUG] [VALIDATOR ] GSK: All expected trading days are present. [2025-09-17T19:22:19.003263] [DEBUG] [VALIDATOR ] GSK: Primary data validation passed. [2025-09-17T19:22:19.004991] [INFO ] [MAIN ] GSK: Fetched primary data is valid. [2025-09-17T19:22:19.005059] [DEBUG] [LOCAL ] GSK: Saving primary data. [2025-09-17T19:22:19.006954] [DEBUG] [LOCAL ] GSK: Trimmed 77328 records to 53504 (keeping 200 days of data) [2025-09-17T19:22:19.362254] [DEBUG] [LOCAL ] GSK: Primary data saved (53504 records). [2025-09-17T19:22:19.362429] [INFO ] [MAIN ] GSK: Full history saved. [2025-09-17T19:22:19.363324] [INFO ] [MAIN ] Update Progress: 976/2371 symbols completed. GSK took 44.5s. Estimated remaining: 3h 23m 23s. Rate: 6.9 symbols/min [2025-09-17T19:22:19.540909] [INFO ] [MAIN ] GTY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:22:19.573744] [DEBUG] [LOCAL ] GTY: Loaded 30319 existing records from primary storage. [2025-09-17T19:22:19.573916] [INFO ] [MAIN ] GTY: Loaded 30319 existing records. [2025-09-17T19:22:19.620923] [INFO ] [REMOTE ] GTN: Fetching primary data for 2024-12. [2025-09-17T19:22:19.764493] [WARN ] [MAIN ] GTY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:22:19.764993] [INFO ] [MAIN ] GTY: Wiping existing primary data before full refresh. [2025-09-17T19:22:19.765086] [INFO ] [LOCAL ] GTY: Starting deletion of primary data. [2025-09-17T19:22:19.765895] [DEBUG] [LOCAL ] GTY: Deleted primary data file. [2025-09-17T19:22:19.765961] [INFO ] [MAIN ] GTY: Starting full primary refresh. [2025-09-17T19:22:20.150316] [INFO ] [REMOTE ] GTY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:22:20.178439] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T19:22:20.415839] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-01. [2025-09-17T19:22:21.181877] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T19:22:21.215753] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-01. [2025-09-17T19:22:21.744820] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T19:22:22.015817] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-11. [2025-09-17T19:22:22.806213] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T19:22:22.815723] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-02. [2025-09-17T19:22:23.193329] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T19:22:23.615800] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-04. [2025-09-17T19:22:24.409734] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T19:22:24.418790] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-02. [2025-09-17T19:22:25.215809] [INFO ] [REMOTE ] GTY: Fetching primary data for 2024-12. [2025-09-17T19:22:25.365712] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T19:22:25.675241] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T19:22:26.015801] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-05. [2025-09-17T19:22:26.750431] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T19:22:26.815754] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-01. [2025-09-17T19:22:27.615823] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-03. [2025-09-17T19:22:27.692689] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T19:22:28.153896] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T19:22:28.415810] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-02. [2025-09-17T19:22:29.062439] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T19:22:29.217042] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-06. [2025-09-17T19:22:29.221032] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T19:22:30.015799] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-04. [2025-09-17T19:22:30.752516] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T19:22:30.815728] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-07. [2025-09-17T19:22:31.478496] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T19:22:31.615773] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-03. [2025-09-17T19:22:32.415775] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-03. [2025-09-17T19:22:32.641032] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T19:22:32.976097] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T19:22:33.215785] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-04. [2025-09-17T19:22:33.768821] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T19:22:34.015772] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-05. [2025-09-17T19:22:34.815816] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-04. [2025-09-17T19:22:34.992903] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T19:22:35.615826] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-08. [2025-09-17T19:22:35.656947] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T19:22:36.218364] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T19:22:36.415842] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-05. [2025-09-17T19:22:37.215780] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-06. [2025-09-17T19:22:37.319835] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T19:22:37.706551] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T19:22:38.015964] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-06. [2025-09-17T19:22:38.506158] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T19:22:38.815815] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-05. [2025-09-17T19:22:39.183882] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T19:22:39.615803] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-07. [2025-09-17T19:22:40.230918] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T19:22:40.415813] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-07. [2025-09-17T19:22:41.045053] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T19:22:41.215844] [INFO ] [REMOTE ] GTES: Fetching primary data for 2025-09. [2025-09-17T19:22:41.999730] [INFO ] [REMOTE ] GTES: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T19:22:42.007672] [INFO ] [REMOTE ] GTES: Full fetch complete (73832 records). [2025-09-17T19:22:42.007847] [DEBUG] [VALIDATOR ] GTES: Validating primary data. [2025-09-17T19:22:42.021614] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-08. [2025-09-17T19:22:42.450427] [DEBUG] [VALIDATOR ] GTES: All expected trading days are present. [2025-09-17T19:22:42.450796] [DEBUG] [VALIDATOR ] GTES: Primary data validation passed. [2025-09-17T19:22:42.451831] [INFO ] [MAIN ] GTES: Fetched primary data is valid. [2025-09-17T19:22:42.468576] [DEBUG] [LOCAL ] GTES: Saving primary data. [2025-09-17T19:22:42.495588] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T19:22:42.507104] [DEBUG] [LOCAL ] GTES: Trimmed 73832 records to 50736 (keeping 200 days of data) [2025-09-17T19:22:42.815953] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-08. [2025-09-17T19:22:42.822757] [DEBUG] [LOCAL ] GTES: Primary data saved (50736 records). [2025-09-17T19:22:42.822928] [INFO ] [MAIN ] GTES: Full history saved. [2025-09-17T19:22:42.823049] [INFO ] [MAIN ] Update Progress: 977/2371 symbols completed. GTES took 38.9s. Estimated remaining: 3h 23m 35s. Rate: 6.8 symbols/min [2025-09-17T19:22:42.999662] [INFO ] [MAIN ] GUG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:22:43.013487] [DEBUG] [LOCAL ] GUG: Loaded 12308 existing records from primary storage. [2025-09-17T19:22:43.013622] [INFO ] [MAIN ] GUG: Loaded 12308 existing records. [2025-09-17T19:22:43.196412] [WARN ] [MAIN ] GUG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:22:43.196741] [INFO ] [MAIN ] GUG: Wiping existing primary data before full refresh. [2025-09-17T19:22:43.196793] [INFO ] [LOCAL ] GUG: Starting deletion of primary data. [2025-09-17T19:22:43.197258] [DEBUG] [LOCAL ] GUG: Deleted primary data file. [2025-09-17T19:22:43.197336] [INFO ] [MAIN ] GUG: Starting full primary refresh. [2025-09-17T19:22:43.583431] [INFO ] [REMOTE ] GUG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:22:43.609051] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T19:22:43.616041] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-11. [2025-09-17T19:22:44.415791] [INFO ] [REMOTE ] GTY: Fetching primary data for 2025-09. [2025-09-17T19:22:44.486453] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T19:22:44.487810] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T19:22:45.111957] [INFO ] [REMOTE ] GTY: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:22:45.115809] [INFO ] [REMOTE ] GTY: Full fetch complete (42914 records). [2025-09-17T19:22:45.115904] [DEBUG] [VALIDATOR ] GTY: Validating primary data. [2025-09-17T19:22:45.216291] [INFO ] [REMOTE ] GUG: Fetching primary data for 2024-12. [2025-09-17T19:22:45.499976] [DEBUG] [VALIDATOR ] GTY: All expected trading days are present. [2025-09-17T19:22:45.500078] [DEBUG] [VALIDATOR ] GTY: Primary data validation passed. [2025-09-17T19:22:45.500788] [INFO ] [MAIN ] GTY: Fetched primary data is valid. [2025-09-17T19:22:45.500849] [DEBUG] [LOCAL ] GTY: Saving primary data. [2025-09-17T19:22:45.501959] [DEBUG] [LOCAL ] GTY: Trimmed 42914 records to 30408 (keeping 200 days of data) [2025-09-17T19:22:45.690316] [DEBUG] [LOCAL ] GTY: Primary data saved (30408 records). [2025-09-17T19:22:45.690453] [INFO ] [MAIN ] GTY: Full history saved. [2025-09-17T19:22:45.690535] [INFO ] [MAIN ] Update Progress: 978/2371 symbols completed. GTY took 26.3s. Estimated remaining: 3h 23m 18s. Rate: 6.9 symbols/min [2025-09-17T19:22:45.864524] [INFO ] [MAIN ] GUT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:22:45.880571] [DEBUG] [LOCAL ] GUT: Loaded 15668 existing records from primary storage. [2025-09-17T19:22:45.880710] [INFO ] [MAIN ] GUT: Loaded 15668 existing records. [2025-09-17T19:22:46.024485] [INFO ] [REMOTE ] GTN: Fetching primary data for 2025-09. [2025-09-17T19:22:46.064802] [WARN ] [MAIN ] GUT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:22:46.065195] [INFO ] [MAIN ] GUT: Wiping existing primary data before full refresh. [2025-09-17T19:22:46.065261] [INFO ] [LOCAL ] GUT: Starting deletion of primary data. [2025-09-17T19:22:46.065854] [DEBUG] [LOCAL ] GUT: Deleted primary data file. [2025-09-17T19:22:46.065924] [INFO ] [MAIN ] GUT: Starting full primary refresh. [2025-09-17T19:22:46.429536] [INFO ] [REMOTE ] GUT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:22:46.441749] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T19:22:46.583746] [INFO ] [REMOTE ] GTN: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T19:22:46.590411] [INFO ] [REMOTE ] GTN: Full fetch complete (66262 records). [2025-09-17T19:22:46.590656] [DEBUG] [VALIDATOR ] GTN: Validating primary data. [2025-09-17T19:22:46.821113] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-11. [2025-09-17T19:22:46.998007] [DEBUG] [VALIDATOR ] GTN: All expected trading days are present. [2025-09-17T19:22:46.998170] [DEBUG] [VALIDATOR ] GTN: Primary data validation passed. [2025-09-17T19:22:46.999153] [INFO ] [MAIN ] GTN: Fetched primary data is valid. [2025-09-17T19:22:46.999203] [DEBUG] [LOCAL ] GTN: Saving primary data. [2025-09-17T19:22:47.000733] [DEBUG] [LOCAL ] GTN: Trimmed 66262 records to 45848 (keeping 200 days of data) [2025-09-17T19:22:47.284069] [DEBUG] [LOCAL ] GTN: Primary data saved (45848 records). [2025-09-17T19:22:47.284237] [INFO ] [MAIN ] GTN: Full history saved. [2025-09-17T19:22:47.284328] [INFO ] [MAIN ] Update Progress: 979/2371 symbols completed. GTN took 31.9s. Estimated remaining: 3h 22m 59s. Rate: 6.9 symbols/min [2025-09-17T19:22:47.459972] [INFO ] [MAIN ] GVA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:22:47.493901] [DEBUG] [LOCAL ] GVA: Loaded 34117 existing records from primary storage. [2025-09-17T19:22:47.494044] [INFO ] [MAIN ] GVA: Loaded 34117 existing records. [2025-09-17T19:22:47.620918] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-06. [2025-09-17T19:22:47.679939] [WARN ] [MAIN ] GVA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:22:47.680197] [INFO ] [MAIN ] GVA: Wiping existing primary data before full refresh. [2025-09-17T19:22:47.680243] [INFO ] [LOCAL ] GVA: Starting deletion of primary data. [2025-09-17T19:22:47.681091] [DEBUG] [LOCAL ] GVA: Deleted primary data file. [2025-09-17T19:22:47.681140] [INFO ] [MAIN ] GVA: Starting full primary refresh. [2025-09-17T19:22:48.048638] [INFO ] [REMOTE ] GVA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:22:48.062925] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T19:22:48.415819] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-11. [2025-09-17T19:22:49.215876] [INFO ] [REMOTE ] GUT: Fetching primary data for 2024-12. [2025-09-17T19:22:49.361589] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T19:22:49.472889] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T19:22:50.015818] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-07. [2025-09-17T19:22:50.228111] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T19:22:50.815833] [INFO ] [REMOTE ] GVA: Fetching primary data for 2024-12. [2025-09-17T19:22:51.265700] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T19:22:51.615853] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-01. [2025-09-17T19:22:52.068958] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T19:22:52.415803] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-08. [2025-09-17T19:22:52.693870] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T19:22:53.215812] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-01. [2025-09-17T19:22:54.015786] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-01. [2025-09-17T19:22:54.188236] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T19:22:54.262314] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T19:22:54.699537] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T19:22:54.815803] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-02. [2025-09-17T19:22:55.497734] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T19:22:55.615763] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-02. [2025-09-17T19:22:56.415817] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-03. [2025-09-17T19:22:57.075566] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T19:22:57.215864] [INFO ] [REMOTE ] GTLS: Fetching primary data for 2025-09. [2025-09-17T19:22:57.413567] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T19:22:57.755374] [INFO ] [REMOTE ] GTLS: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T19:22:57.764943] [INFO ] [REMOTE ] GTLS: Full fetch complete (61337 records). [2025-09-17T19:22:57.765175] [DEBUG] [VALIDATOR ] GTLS: Validating primary data. [2025-09-17T19:22:58.022957] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-04. [2025-09-17T19:22:58.249445] [DEBUG] [VALIDATOR ] GTLS: All expected trading days are present. [2025-09-17T19:22:58.249533] [DEBUG] [VALIDATOR ] GTLS: Primary data validation passed. [2025-09-17T19:22:58.250294] [INFO ] [MAIN ] GTLS: Fetched primary data is valid. [2025-09-17T19:22:58.250338] [DEBUG] [LOCAL ] GTLS: Saving primary data. [2025-09-17T19:22:58.251550] [DEBUG] [LOCAL ] GTLS: Trimmed 61337 records to 43187 (keeping 200 days of data) [2025-09-17T19:22:58.520376] [DEBUG] [LOCAL ] GTLS: Primary data saved (43187 records). [2025-09-17T19:22:58.520518] [INFO ] [MAIN ] GTLS: Full history saved. [2025-09-17T19:22:58.520610] [INFO ] [MAIN ] Update Progress: 980/2371 symbols completed. GTLS took 44.7s. Estimated remaining: 3h 22m 54s. Rate: 6.9 symbols/min [2025-09-17T19:22:58.694054] [INFO ] [MAIN ] GWH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:22:58.709678] [DEBUG] [LOCAL ] GWH: Loaded 15026 existing records from primary storage. [2025-09-17T19:22:58.709814] [INFO ] [MAIN ] GWH: Loaded 15026 existing records. [2025-09-17T19:22:58.820949] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-02. [2025-09-17T19:22:58.892494] [WARN ] [MAIN ] GWH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:22:58.892718] [INFO ] [MAIN ] GWH: Wiping existing primary data before full refresh. [2025-09-17T19:22:58.892765] [INFO ] [LOCAL ] GWH: Starting deletion of primary data. [2025-09-17T19:22:58.893301] [DEBUG] [LOCAL ] GWH: Deleted primary data file. [2025-09-17T19:22:58.893349] [INFO ] [MAIN ] GWH: Starting full primary refresh. [2025-09-17T19:22:59.251876] [INFO ] [REMOTE ] GWH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:22:59.267265] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T19:22:59.615775] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-05. [2025-09-17T19:23:00.415826] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-11. [2025-09-17T19:23:00.822152] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T19:23:01.215873] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-06. [2025-09-17T19:23:02.015839] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-03. [2025-09-17T19:23:02.183933] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T19:23:02.815889] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-07. [2025-09-17T19:23:03.485624] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T19:23:03.615777] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-04. [2025-09-17T19:23:03.776734] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-02 (4.96 seconds). [2025-09-17T19:23:03.914087] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T19:23:04.375520] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-11 (3.96 seconds). [2025-09-17T19:23:04.415772] [INFO ] [REMOTE ] GWH: Fetching primary data for 2024-12. [2025-09-17T19:23:05.215752] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-08. [2025-09-17T19:23:05.338146] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T19:23:05.369822] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T19:23:05.876403] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T19:23:06.015778] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-01. [2025-09-17T19:23:06.815782] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-05. [2025-09-17T19:23:06.837834] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T19:23:07.615792] [INFO ] [REMOTE ] GUT: Fetching primary data for 2025-09. [2025-09-17T19:23:08.328207] [INFO ] [REMOTE ] GUT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T19:23:08.337342] [INFO ] [REMOTE ] GUT: Full fetch complete (23158 records). [2025-09-17T19:23:08.348698] [DEBUG] [VALIDATOR ] GUT: Validating primary data. [2025-09-17T19:23:08.356296] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T19:23:08.415783] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-02. [2025-09-17T19:23:08.769746] [DEBUG] [VALIDATOR ] GUT: All expected trading days are present. [2025-09-17T19:23:08.769831] [DEBUG] [VALIDATOR ] GUT: Primary data validation passed. [2025-09-17T19:23:08.770372] [INFO ] [MAIN ] GUT: Fetched primary data is valid. [2025-09-17T19:23:08.770412] [DEBUG] [LOCAL ] GUT: Saving primary data. [2025-09-17T19:23:08.771120] [DEBUG] [LOCAL ] GUT: Trimmed 23158 records to 15620 (keeping 200 days of data) [2025-09-17T19:23:08.868454] [DEBUG] [LOCAL ] GUT: Primary data saved (15620 records). [2025-09-17T19:23:08.868615] [INFO ] [MAIN ] GUT: Full history saved. [2025-09-17T19:23:08.868724] [INFO ] [MAIN ] Update Progress: 981/2371 symbols completed. GUT took 23.2s. Estimated remaining: 3h 22m 47s. Rate: 6.9 symbols/min [2025-09-17T19:23:09.038250] [INFO ] [MAIN ] GWRE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:23:09.082947] [DEBUG] [LOCAL ] GWRE: Loaded 41517 existing records from primary storage. [2025-09-17T19:23:09.083100] [INFO ] [MAIN ] GWRE: Loaded 41517 existing records. [2025-09-17T19:23:09.220930] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-03. [2025-09-17T19:23:09.275581] [WARN ] [MAIN ] GWRE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:23:09.275837] [INFO ] [MAIN ] GWRE: Wiping existing primary data before full refresh. [2025-09-17T19:23:09.275882] [INFO ] [LOCAL ] GWRE: Starting deletion of primary data. [2025-09-17T19:23:09.276882] [DEBUG] [LOCAL ] GWRE: Deleted primary data file. [2025-09-17T19:23:09.276934] [INFO ] [MAIN ] GWRE: Starting full primary refresh. [2025-09-17T19:23:09.454397] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T19:23:09.659813] [INFO ] [REMOTE ] GWRE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:23:09.969022] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T19:23:10.015774] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-04. [2025-09-17T19:23:10.815791] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-11. [2025-09-17T19:23:10.989856] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T19:23:11.615775] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-03. [2025-09-17T19:23:12.333495] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T19:23:12.359910] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T19:23:12.415775] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-05. [2025-09-17T19:23:12.982720] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T19:23:13.215792] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-06. [2025-09-17T19:23:14.015831] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2024-12. [2025-09-17T19:23:14.144329] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T19:23:14.815785] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-06. [2025-09-17T19:23:15.615764] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-04. [2025-09-17T19:23:15.716817] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T19:23:15.791128] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T19:23:16.203085] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T19:23:16.415742] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-01. [2025-09-17T19:23:17.215800] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-07. [2025-09-17T19:23:18.020815] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-07. [2025-09-17T19:23:18.034814] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T19:23:18.102571] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T19:23:18.815765] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-08. [2025-09-17T19:23:19.078963] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T19:23:19.615760] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-08. [2025-09-17T19:23:19.627208] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T19:23:20.415777] [INFO ] [REMOTE ] GUG: Fetching primary data for 2025-09. [2025-09-17T19:23:20.978324] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T19:23:20.990168] [INFO ] [REMOTE ] GUG: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:23:20.992416] [INFO ] [REMOTE ] GUG: Full fetch complete (19983 records). [2025-09-17T19:23:20.992524] [DEBUG] [VALIDATOR ] GUG: Validating primary data. [2025-09-17T19:23:21.225983] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-05. [2025-09-17T19:23:21.360054] [DEBUG] [VALIDATOR ] GUG: All expected trading days are present. [2025-09-17T19:23:21.360133] [DEBUG] [VALIDATOR ] GUG: Primary data validation passed. [2025-09-17T19:23:21.360627] [INFO ] [MAIN ] GUG: Fetched primary data is valid. [2025-09-17T19:23:21.360720] [DEBUG] [LOCAL ] GUG: Saving primary data. [2025-09-17T19:23:21.361289] [DEBUG] [LOCAL ] GUG: Trimmed 19983 records to 12274 (keeping 200 days of data) [2025-09-17T19:23:21.441250] [DEBUG] [LOCAL ] GUG: Primary data saved (12274 records). [2025-09-17T19:23:21.441411] [INFO ] [MAIN ] GUG: Full history saved. [2025-09-17T19:23:21.441518] [INFO ] [MAIN ] Update Progress: 982/2371 symbols completed. GUG took 38.6s. Estimated remaining: 3h 22m 44s. Rate: 6.9 symbols/min [2025-09-17T19:23:21.614361] [INFO ] [MAIN ] GWW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:23:21.636439] [DEBUG] [LOCAL ] GWW: Loaded 20108 existing records from primary storage. [2025-09-17T19:23:21.636601] [INFO ] [MAIN ] GWW: Loaded 20108 existing records. [2025-09-17T19:23:21.838401] [WARN ] [MAIN ] GWW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:23:21.838725] [INFO ] [MAIN ] GWW: Wiping existing primary data before full refresh. [2025-09-17T19:23:21.838847] [INFO ] [LOCAL ] GWW: Starting deletion of primary data. [2025-09-17T19:23:21.839613] [DEBUG] [LOCAL ] GWW: Deleted primary data file. [2025-09-17T19:23:21.839697] [INFO ] [MAIN ] GWW: Starting full primary refresh. [2025-09-17T19:23:22.024197] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-02. [2025-09-17T19:23:22.216013] [INFO ] [REMOTE ] GWW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:23:22.310900] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T19:23:22.815771] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-11. [2025-09-17T19:23:23.615766] [INFO ] [REMOTE ] GVA: Fetching primary data for 2025-09. [2025-09-17T19:23:23.721876] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T19:23:23.769375] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T19:23:24.310481] [INFO ] [REMOTE ] GVA: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T19:23:24.314630] [INFO ] [REMOTE ] GVA: Full fetch complete (48766 records). [2025-09-17T19:23:24.314773] [DEBUG] [VALIDATOR ] GVA: Validating primary data. [2025-09-17T19:23:24.419908] [INFO ] [REMOTE ] GWW: Fetching primary data for 2024-12. [2025-09-17T19:23:24.697955] [DEBUG] [VALIDATOR ] GVA: All expected trading days are present. [2025-09-17T19:23:24.698033] [DEBUG] [VALIDATOR ] GVA: Primary data validation passed. [2025-09-17T19:23:24.698718] [INFO ] [MAIN ] GVA: Fetched primary data is valid. [2025-09-17T19:23:24.698761] [DEBUG] [LOCAL ] GVA: Saving primary data. [2025-09-17T19:23:24.699953] [DEBUG] [LOCAL ] GVA: Trimmed 48766 records to 34125 (keeping 200 days of data) [2025-09-17T19:23:24.909007] [DEBUG] [LOCAL ] GVA: Primary data saved (34125 records). [2025-09-17T19:23:24.909147] [INFO ] [MAIN ] GVA: Full history saved. [2025-09-17T19:23:24.909270] [INFO ] [MAIN ] Update Progress: 983/2371 symbols completed. GVA took 37.6s. Estimated remaining: 3h 22m 27s. Rate: 6.9 symbols/min [2025-09-17T19:23:25.088584] [INFO ] [MAIN ] GXO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:23:25.146162] [DEBUG] [LOCAL ] GXO: Loaded 47925 existing records from primary storage. [2025-09-17T19:23:25.146600] [INFO ] [MAIN ] GXO: Loaded 47925 existing records. [2025-09-17T19:23:25.220897] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-03. [2025-09-17T19:23:25.348195] [WARN ] [MAIN ] GXO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:23:25.348773] [INFO ] [MAIN ] GXO: Wiping existing primary data before full refresh. [2025-09-17T19:23:25.348833] [INFO ] [LOCAL ] GXO: Starting deletion of primary data. [2025-09-17T19:23:25.350169] [DEBUG] [LOCAL ] GXO: Deleted primary data file. [2025-09-17T19:23:25.350238] [INFO ] [MAIN ] GXO: Starting full primary refresh. [2025-09-17T19:23:25.756065] [INFO ] [REMOTE ] GXO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:23:25.757555] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T19:23:26.015786] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-06. [2025-09-17T19:23:26.815765] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-01. [2025-09-17T19:23:26.937673] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T19:23:27.203299] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T19:23:27.615780] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-07. [2025-09-17T19:23:27.722835] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T19:23:28.415800] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-11. [2025-09-17T19:23:28.883893] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T19:23:29.215813] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-02. [2025-09-17T19:23:29.841288] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T19:23:30.015790] [INFO ] [REMOTE ] GXO: Fetching primary data for 2024-12. [2025-09-17T19:23:30.335787] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T19:23:30.815829] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-04. [2025-09-17T19:23:31.611826] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T19:23:31.621382] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-03. [2025-09-17T19:23:32.048478] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T19:23:32.413605] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T19:23:32.418561] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-08. [2025-09-17T19:23:33.215747] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-05. [2025-09-17T19:23:33.484030] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T19:23:34.015792] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-04. [2025-09-17T19:23:34.556493] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T19:23:34.815787] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-06. [2025-09-17T19:23:35.219670] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T19:23:35.615768] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-01. [2025-09-17T19:23:36.137357] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T19:23:36.415829] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-07. [2025-09-17T19:23:37.148125] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T19:23:37.215742] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-02. [2025-09-17T19:23:38.015807] [INFO ] [REMOTE ] GWH: Fetching primary data for 2025-09. [2025-09-17T19:23:38.134314] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T19:23:38.585990] [INFO ] [REMOTE ] GWH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:23:38.588165] [INFO ] [REMOTE ] GWH: Full fetch complete (20344 records). [2025-09-17T19:23:38.588237] [DEBUG] [VALIDATOR ] GWH: Validating primary data. [2025-09-17T19:23:38.819086] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-08. [2025-09-17T19:23:38.965410] [DEBUG] [VALIDATOR ] GWH: All expected trading days are present. [2025-09-17T19:23:38.965495] [DEBUG] [VALIDATOR ] GWH: Primary data validation passed. [2025-09-17T19:23:38.965960] [INFO ] [MAIN ] GWH: Fetched primary data is valid. [2025-09-17T19:23:38.966063] [DEBUG] [LOCAL ] GWH: Saving primary data. [2025-09-17T19:23:38.976173] [DEBUG] [LOCAL ] GWH: Trimmed 20344 records to 15043 (keeping 200 days of data) [2025-09-17T19:23:38.993527] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T19:23:39.087405] [DEBUG] [LOCAL ] GWH: Primary data saved (15043 records). [2025-09-17T19:23:39.087563] [INFO ] [MAIN ] GWH: Full history saved. [2025-09-17T19:23:39.087698] [INFO ] [MAIN ] Update Progress: 984/2371 symbols completed. GWH took 40.6s. Estimated remaining: 3h 22m 26s. Rate: 6.9 symbols/min [2025-09-17T19:23:39.257496] [INFO ] [MAIN ] GYLD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:23:39.260932] [DEBUG] [LOCAL ] GYLD: Loaded 1521 existing records from primary storage. [2025-09-17T19:23:39.261001] [INFO ] [MAIN ] GYLD: Loaded 1521 existing records. [2025-09-17T19:23:39.459561] [WARN ] [MAIN ] GYLD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:23:39.459952] [INFO ] [MAIN ] GYLD: Wiping existing primary data before full refresh. [2025-09-17T19:23:39.460005] [INFO ] [LOCAL ] GYLD: Starting deletion of primary data. [2025-09-17T19:23:39.460308] [DEBUG] [LOCAL ] GYLD: Deleted primary data file. [2025-09-17T19:23:39.460366] [INFO ] [MAIN ] GYLD: Starting full primary refresh. [2025-09-17T19:23:39.622400] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-05. [2025-09-17T19:23:39.853446] [INFO ] [REMOTE ] GYLD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:23:40.277380] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T19:23:40.415698] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-03. [2025-09-17T19:23:40.452774] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T19:23:41.215790] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-06. [2025-09-17T19:23:42.015701] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-11. [2025-09-17T19:23:42.037138] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T19:23:42.135657] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T19:23:42.305332] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-11 (0.29 seconds). [2025-09-17T19:23:42.815807] [INFO ] [REMOTE ] GWRE: Fetching primary data for 2025-09. [2025-09-17T19:23:43.615803] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-04. [2025-09-17T19:23:43.639133] [INFO ] [REMOTE ] GWRE: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T19:23:43.647388] [INFO ] [REMOTE ] GWRE: Full fetch complete (61737 records). [2025-09-17T19:23:43.647535] [DEBUG] [VALIDATOR ] GWRE: Validating primary data. [2025-09-17T19:23:44.040885] [DEBUG] [VALIDATOR ] GWRE: All expected trading days are present. [2025-09-17T19:23:44.041087] [DEBUG] [VALIDATOR ] GWRE: Primary data validation passed. [2025-09-17T19:23:44.041896] [INFO ] [MAIN ] GWRE: Fetched primary data is valid. [2025-09-17T19:23:44.041940] [DEBUG] [LOCAL ] GWRE: Saving primary data. [2025-09-17T19:23:44.043205] [DEBUG] [LOCAL ] GWRE: Trimmed 61737 records to 41449 (keeping 200 days of data) [2025-09-17T19:23:44.302008] [DEBUG] [LOCAL ] GWRE: Primary data saved (41449 records). [2025-09-17T19:23:44.302137] [INFO ] [MAIN ] GWRE: Full history saved. [2025-09-17T19:23:44.303376] [INFO ] [MAIN ] Update Progress: 985/2371 symbols completed. GWRE took 35.4s. Estimated remaining: 3h 22m 13s. Rate: 6.9 symbols/min [2025-09-17T19:23:44.420970] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2024-12. [2025-09-17T19:23:44.473946] [INFO ] [MAIN ] H: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:23:44.524403] [DEBUG] [LOCAL ] H: Loaded 45105 existing records from primary storage. [2025-09-17T19:23:44.524575] [INFO ] [MAIN ] H: Loaded 45105 existing records. [2025-09-17T19:23:44.700125] [WARN ] [MAIN ] H: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:23:44.700410] [INFO ] [MAIN ] H: Wiping existing primary data before full refresh. [2025-09-17T19:23:44.700454] [INFO ] [LOCAL ] H: Starting deletion of primary data. [2025-09-17T19:23:44.702031] [DEBUG] [LOCAL ] H: Deleted primary data file. [2025-09-17T19:23:44.702084] [INFO ] [MAIN ] H: Starting full primary refresh. [2025-09-17T19:23:44.882164] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T19:23:45.062839] [INFO ] [REMOTE ] H: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:23:45.212093] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T19:23:45.223131] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-01. [2025-09-17T19:23:45.585129] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T19:23:46.015841] [INFO ] [REMOTE ] H: Fetching primary data for 2024-11. [2025-09-17T19:23:46.815829] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-05. [2025-09-17T19:23:47.304930] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T19:23:47.615786] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-02. [2025-09-17T19:23:47.970411] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T19:23:48.075714] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T19:23:48.415813] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-03. [2025-09-17T19:23:48.859316] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T19:23:49.215823] [INFO ] [REMOTE ] H: Fetching primary data for 2024-12. [2025-09-17T19:23:50.015959] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-06. [2025-09-17T19:23:50.687182] [INFO ] [REMOTE ] H: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T19:23:50.815822] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-04. [2025-09-17T19:23:51.255133] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T19:23:51.282507] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T19:23:51.615773] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-05. [2025-09-17T19:23:52.062145] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T19:23:52.415777] [INFO ] [REMOTE ] H: Fetching primary data for 2025-01. [2025-09-17T19:23:53.215839] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-07. [2025-09-17T19:23:53.769157] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T19:23:54.015810] [INFO ] [REMOTE ] H: Fetching primary data for 2025-02. [2025-09-17T19:23:54.047982] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T19:23:54.815799] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-08. [2025-09-17T19:23:55.282178] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T19:23:55.615800] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-06. [2025-09-17T19:23:55.937409] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T19:23:55.981962] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T19:23:56.415847] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-07. [2025-09-17T19:23:56.873751] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T19:23:57.215777] [INFO ] [REMOTE ] H: Fetching primary data for 2025-03. [2025-09-17T19:23:58.015789] [INFO ] [REMOTE ] GWW: Fetching primary data for 2025-09. [2025-09-17T19:23:58.427315] [INFO ] [REMOTE ] GWW: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T19:23:58.430551] [INFO ] [REMOTE ] GWW: Full fetch complete (29039 records). [2025-09-17T19:23:58.431163] [DEBUG] [VALIDATOR ] GWW: Validating primary data. [2025-09-17T19:23:58.819266] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-08. [2025-09-17T19:23:58.828824] [DEBUG] [VALIDATOR ] GWW: All expected trading days are present. [2025-09-17T19:23:58.829008] [DEBUG] [VALIDATOR ] GWW: Primary data validation passed. [2025-09-17T19:23:58.829980] [INFO ] [MAIN ] GWW: Fetched primary data is valid. [2025-09-17T19:23:58.830322] [DEBUG] [LOCAL ] GWW: Saving primary data. [2025-09-17T19:23:58.831919] [DEBUG] [LOCAL ] GWW: Trimmed 29039 records to 20089 (keeping 200 days of data) [2025-09-17T19:23:58.983839] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T19:23:59.012196] [DEBUG] [LOCAL ] GWW: Primary data saved (20089 records). [2025-09-17T19:23:59.012365] [INFO ] [MAIN ] GWW: Full history saved. [2025-09-17T19:23:59.012506] [INFO ] [MAIN ] Update Progress: 986/2371 symbols completed. GWW took 37.6s. Estimated remaining: 3h 22m 12s. Rate: 6.8 symbols/min [2025-09-17T19:23:59.187176] [INFO ] [MAIN ] HAE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:23:59.230835] [DEBUG] [LOCAL ] HAE: Loaded 39478 existing records from primary storage. [2025-09-17T19:23:59.231051] [INFO ] [MAIN ] HAE: Loaded 39478 existing records. [2025-09-17T19:23:59.317885] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T19:23:59.420100] [WARN ] [MAIN ] HAE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:23:59.420402] [INFO ] [MAIN ] HAE: Wiping existing primary data before full refresh. [2025-09-17T19:23:59.420468] [INFO ] [LOCAL ] HAE: Starting deletion of primary data. [2025-09-17T19:23:59.421179] [DEBUG] [LOCAL ] HAE: Deleted primary data file. [2025-09-17T19:23:59.421227] [INFO ] [MAIN ] HAE: Starting full primary refresh. [2025-09-17T19:23:59.623255] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-07. [2025-09-17T19:23:59.783600] [INFO ] [REMOTE ] HAE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:24:00.415775] [INFO ] [REMOTE ] GYLD: Fetching primary data for 2025-09. [2025-09-17T19:24:00.721461] [INFO ] [REMOTE ] GYLD: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-17T19:24:00.722356] [INFO ] [REMOTE ] GYLD: Full fetch complete (1997 records). [2025-09-17T19:24:00.722426] [DEBUG] [VALIDATOR ] GYLD: Validating primary data. [2025-09-17T19:24:01.110256] [DEBUG] [VALIDATOR ] GYLD: All expected trading days are present. [2025-09-17T19:24:01.110345] [DEBUG] [VALIDATOR ] GYLD: Primary data validation passed. [2025-09-17T19:24:01.110440] [INFO ] [MAIN ] GYLD: Fetched primary data is valid. [2025-09-17T19:24:01.110476] [DEBUG] [LOCAL ] GYLD: Saving primary data. [2025-09-17T19:24:01.110828] [DEBUG] [LOCAL ] GYLD: Trimmed 1997 records to 1528 (keeping 200 days of data) [2025-09-17T19:24:01.120558] [DEBUG] [LOCAL ] GYLD: Primary data saved (1528 records). [2025-09-17T19:24:01.120614] [INFO ] [MAIN ] GYLD: Full history saved. [2025-09-17T19:24:01.120842] [INFO ] [MAIN ] Update Progress: 987/2371 symbols completed. GYLD took 22.0s. Estimated remaining: 3h 21m 54s. Rate: 6.9 symbols/min [2025-09-17T19:24:01.221876] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-11. [2025-09-17T19:24:01.292132] [INFO ] [MAIN ] HAFN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:24:01.335857] [DEBUG] [LOCAL ] HAFN: Loaded 43988 existing records from primary storage. [2025-09-17T19:24:01.336004] [INFO ] [MAIN ] HAFN: Loaded 43988 existing records. [2025-09-17T19:24:01.513572] [WARN ] [MAIN ] HAFN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:24:01.513938] [INFO ] [MAIN ] HAFN: Wiping existing primary data before full refresh. [2025-09-17T19:24:01.514022] [INFO ] [LOCAL ] HAFN: Starting deletion of primary data. [2025-09-17T19:24:01.514942] [DEBUG] [LOCAL ] HAFN: Deleted primary data file. [2025-09-17T19:24:01.514999] [INFO ] [MAIN ] HAFN: Starting full primary refresh. [2025-09-17T19:24:01.646434] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T19:24:01.912483] [INFO ] [REMOTE ] HAFN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:24:02.015823] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-11. [2025-09-17T19:24:02.815794] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-08. [2025-09-17T19:24:03.615851] [INFO ] [REMOTE ] H: Fetching primary data for 2025-04. [2025-09-17T19:24:04.532745] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-11 (3.31 seconds). [2025-09-17T19:24:04.540752] [INFO ] [REMOTE ] HAE: Fetching primary data for 2024-12. [2025-09-17T19:24:04.874422] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-11 (2.86 seconds). [2025-09-17T19:24:05.094433] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-08 (2.28 seconds). [2025-09-17T19:24:05.215809] [INFO ] [REMOTE ] GXO: Fetching primary data for 2025-09. [2025-09-17T19:24:05.482763] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T19:24:05.626907] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T19:24:05.964473] [INFO ] [REMOTE ] GXO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T19:24:05.970998] [INFO ] [REMOTE ] GXO: Full fetch complete (69798 records). [2025-09-17T19:24:05.971172] [DEBUG] [VALIDATOR ] GXO: Validating primary data. [2025-09-17T19:24:06.020956] [INFO ] [REMOTE ] H: Fetching primary data for 2025-05. [2025-09-17T19:24:06.388873] [DEBUG] [VALIDATOR ] GXO: All expected trading days are present. [2025-09-17T19:24:06.389018] [DEBUG] [VALIDATOR ] GXO: Primary data validation passed. [2025-09-17T19:24:06.390814] [INFO ] [MAIN ] GXO: Fetched primary data is valid. [2025-09-17T19:24:06.390878] [DEBUG] [LOCAL ] GXO: Saving primary data. [2025-09-17T19:24:06.392928] [DEBUG] [LOCAL ] GXO: Trimmed 69798 records to 47860 (keeping 200 days of data) [2025-09-17T19:24:06.707060] [DEBUG] [LOCAL ] GXO: Primary data saved (47860 records). [2025-09-17T19:24:06.707276] [INFO ] [MAIN ] GXO: Full history saved. [2025-09-17T19:24:06.707424] [INFO ] [MAIN ] Update Progress: 988/2371 symbols completed. GXO took 41.8s. Estimated remaining: 3h 21m 41s. Rate: 6.9 symbols/min [2025-09-17T19:24:06.821047] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2024-12. [2025-09-17T19:24:06.887088] [INFO ] [MAIN ] HAL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:24:06.947362] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-17T19:24:06.947581] [INFO ] [MAIN ] HAL: Loaded 53718 existing records. [2025-09-17T19:24:07.139849] [WARN ] [MAIN ] HAL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:24:07.140212] [INFO ] [MAIN ] HAL: Wiping existing primary data before full refresh. [2025-09-17T19:24:07.140261] [INFO ] [LOCAL ] HAL: Starting deletion of primary data. [2025-09-17T19:24:07.141478] [DEBUG] [LOCAL ] HAL: Deleted primary data file. [2025-09-17T19:24:07.141537] [INFO ] [MAIN ] HAL: Starting full primary refresh. [2025-09-17T19:24:07.516890] [INFO ] [REMOTE ] HAL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:24:07.615785] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-01. [2025-09-17T19:24:07.760076] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T19:24:08.340430] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T19:24:08.415783] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-01. [2025-09-17T19:24:09.073270] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T19:24:09.215793] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-11. [2025-09-17T19:24:10.015771] [INFO ] [REMOTE ] H: Fetching primary data for 2025-06. [2025-09-17T19:24:10.547388] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T19:24:10.813212] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T19:24:10.824310] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-02. [2025-09-17T19:24:11.618029] [INFO ] [REMOTE ] HAL: Fetching primary data for 2024-12. [2025-09-17T19:24:11.620244] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T19:24:12.415826] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-02. [2025-09-17T19:24:12.595494] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T19:24:13.215753] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-03. [2025-09-17T19:24:13.659388] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T19:24:14.015848] [INFO ] [REMOTE ] H: Fetching primary data for 2025-07. [2025-09-17T19:24:14.485564] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-02 (2.07 seconds). [2025-09-17T19:24:14.815816] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-01. [2025-09-17T19:24:15.615835] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-03. [2025-09-17T19:24:16.602579] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-07 (2.59 seconds). [2025-09-17T19:24:16.612179] [INFO ] [REMOTE ] H: Fetching primary data for 2025-08. [2025-09-17T19:24:16.693840] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T19:24:17.215888] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-02. [2025-09-17T19:24:17.262882] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T19:24:18.015788] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-04. [2025-09-17T19:24:18.296540] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T19:24:18.514625] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-03 (5.30 seconds). [2025-09-17T19:24:18.815775] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-04. [2025-09-17T19:24:19.000205] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T19:24:19.259947] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T19:24:19.615777] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-05. [2025-09-17T19:24:20.150348] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T19:24:20.415842] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-05. [2025-09-17T19:24:21.143315] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T19:24:21.215780] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-06. [2025-09-17T19:24:21.679507] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T19:24:22.015820] [INFO ] [REMOTE ] H: Fetching primary data for 2025-09. [2025-09-17T19:24:22.530690] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T19:24:22.610080] [INFO ] [REMOTE ] H: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T19:24:22.616996] [INFO ] [REMOTE ] H: Full fetch complete (61420 records). [2025-09-17T19:24:22.617164] [DEBUG] [VALIDATOR ] H: Validating primary data. [2025-09-17T19:24:22.820919] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-03. [2025-09-17T19:24:23.027712] [DEBUG] [VALIDATOR ] H: All expected trading days are present. [2025-09-17T19:24:23.027848] [DEBUG] [VALIDATOR ] H: Primary data validation passed. [2025-09-17T19:24:23.028764] [INFO ] [MAIN ] H: Fetched primary data is valid. [2025-09-17T19:24:23.028818] [DEBUG] [LOCAL ] H: Saving primary data. [2025-09-17T19:24:23.030362] [DEBUG] [LOCAL ] H: Trimmed 61420 records to 45097 (keeping 200 days of data) [2025-09-17T19:24:23.328359] [DEBUG] [LOCAL ] H: Primary data saved (45097 records). [2025-09-17T19:24:23.328513] [INFO ] [MAIN ] H: Full history saved. [2025-09-17T19:24:23.329473] [INFO ] [MAIN ] Update Progress: 989/2371 symbols completed. H took 39.0s. Estimated remaining: 3h 21m 43s. Rate: 6.9 symbols/min [2025-09-17T19:24:23.536859] [INFO ] [MAIN ] HASI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:24:23.586662] [DEBUG] [LOCAL ] HASI: Loaded 47259 existing records from primary storage. [2025-09-17T19:24:23.586820] [INFO ] [MAIN ] HASI: Loaded 47259 existing records. [2025-09-17T19:24:23.621092] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-07. [2025-09-17T19:24:23.770916] [WARN ] [MAIN ] HASI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:24:23.771210] [INFO ] [MAIN ] HASI: Wiping existing primary data before full refresh. [2025-09-17T19:24:23.771257] [INFO ] [LOCAL ] HASI: Starting deletion of primary data. [2025-09-17T19:24:23.772307] [DEBUG] [LOCAL ] HASI: Deleted primary data file. [2025-09-17T19:24:23.772388] [INFO ] [MAIN ] HASI: Starting full primary refresh. [2025-09-17T19:24:24.128233] [INFO ] [REMOTE ] HASI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:24:24.415798] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-06. [2025-09-17T19:24:24.995054] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-17T19:24:25.215835] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-04. [2025-09-17T19:24:25.252423] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T19:24:26.015783] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-11. [2025-09-17T19:24:26.722910] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-17T19:24:26.815799] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-07. [2025-09-17T19:24:26.984180] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T19:24:27.264295] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T19:24:27.615788] [INFO ] [REMOTE ] HASI: Fetching primary data for 2024-12. [2025-09-17T19:24:28.415848] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-05. [2025-09-17T19:24:28.461132] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T19:24:29.143762] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T19:24:29.215775] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-01. [2025-09-17T19:24:30.015773] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-08. [2025-09-17T19:24:30.098809] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T19:24:30.815774] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-06. [2025-09-17T19:24:30.873109] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T19:24:31.615769] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-08. [2025-09-17T19:24:31.698632] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T19:24:32.415777] [INFO ] [REMOTE ] HAE: Fetching primary data for 2025-09. [2025-09-17T19:24:32.780219] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T19:24:32.857406] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T19:24:32.883880] [INFO ] [REMOTE ] HAE: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T19:24:32.890295] [INFO ] [REMOTE ] HAE: Full fetch complete (57183 records). [2025-09-17T19:24:32.890464] [DEBUG] [VALIDATOR ] HAE: Validating primary data. [2025-09-17T19:24:33.220889] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-02. [2025-09-17T19:24:33.320723] [DEBUG] [VALIDATOR ] HAE: All expected trading days are present. [2025-09-17T19:24:33.320832] [DEBUG] [VALIDATOR ] HAE: Primary data validation passed. [2025-09-17T19:24:33.321781] [INFO ] [MAIN ] HAE: Fetched primary data is valid. [2025-09-17T19:24:33.321832] [DEBUG] [LOCAL ] HAE: Saving primary data. [2025-09-17T19:24:33.323163] [DEBUG] [LOCAL ] HAE: Trimmed 57183 records to 39466 (keeping 200 days of data) [2025-09-17T19:24:33.560753] [DEBUG] [LOCAL ] HAE: Primary data saved (39466 records). [2025-09-17T19:24:33.560938] [INFO ] [MAIN ] HAE: Full history saved. [2025-09-17T19:24:33.561044] [INFO ] [MAIN ] Update Progress: 990/2371 symbols completed. HAE took 34.5s. Estimated remaining: 3h 21m 37s. Rate: 6.8 symbols/min [2025-09-17T19:24:33.741142] [INFO ] [MAIN ] HAYW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:24:33.788259] [DEBUG] [LOCAL ] HAYW: Loaded 48746 existing records from primary storage. [2025-09-17T19:24:33.788418] [INFO ] [MAIN ] HAYW: Loaded 48746 existing records. [2025-09-17T19:24:33.974023] [WARN ] [MAIN ] HAYW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:24:33.974347] [INFO ] [MAIN ] HAYW: Wiping existing primary data before full refresh. [2025-09-17T19:24:33.974406] [INFO ] [LOCAL ] HAYW: Starting deletion of primary data. [2025-09-17T19:24:33.975462] [DEBUG] [LOCAL ] HAYW: Deleted primary data file. [2025-09-17T19:24:33.975515] [INFO ] [MAIN ] HAYW: Starting full primary refresh. [2025-09-17T19:24:34.021016] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-07. [2025-09-17T19:24:34.359850] [INFO ] [REMOTE ] HAYW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:24:34.779362] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T19:24:34.815733] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-03. [2025-09-17T19:24:35.615785] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-11. [2025-09-17T19:24:36.268743] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-07 (2.25 seconds). [2025-09-17T19:24:36.362026] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T19:24:36.415725] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-04. [2025-09-17T19:24:36.927607] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T19:24:37.215778] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2024-12. [2025-09-17T19:24:38.008520] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T19:24:38.018440] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-08. [2025-09-17T19:24:38.815775] [INFO ] [REMOTE ] HAFN: Fetching primary data for 2025-09. [2025-09-17T19:24:38.955006] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T19:24:39.133771] [INFO ] [REMOTE ] HAFN: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T19:24:39.139420] [INFO ] [REMOTE ] HAFN: Full fetch complete (66203 records). [2025-09-17T19:24:39.139561] [DEBUG] [VALIDATOR ] HAFN: Validating primary data. [2025-09-17T19:24:39.539233] [DEBUG] [VALIDATOR ] HAFN: All expected trading days are present. [2025-09-17T19:24:39.539317] [DEBUG] [VALIDATOR ] HAFN: Primary data validation passed. [2025-09-17T19:24:39.540157] [INFO ] [MAIN ] HAFN: Fetched primary data is valid. [2025-09-17T19:24:39.540210] [DEBUG] [LOCAL ] HAFN: Saving primary data. [2025-09-17T19:24:39.541538] [DEBUG] [LOCAL ] HAFN: Trimmed 66203 records to 43919 (keeping 200 days of data) [2025-09-17T19:24:39.630859] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-05. [2025-09-17T19:24:39.810142] [DEBUG] [LOCAL ] HAFN: Primary data saved (43919 records). [2025-09-17T19:24:39.810315] [INFO ] [MAIN ] HAFN: Full history saved. [2025-09-17T19:24:39.810441] [INFO ] [MAIN ] Update Progress: 991/2371 symbols completed. HAFN took 38.7s. Estimated remaining: 3h 21m 24s. Rate: 6.9 symbols/min [2025-09-17T19:24:39.985794] [INFO ] [MAIN ] HBB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:24:40.023885] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T19:24:40.038628] [DEBUG] [LOCAL ] HBB: Loaded 6983 existing records from primary storage. [2025-09-17T19:24:40.039163] [INFO ] [MAIN ] HBB: Loaded 6983 existing records. [2025-09-17T19:24:40.218701] [WARN ] [MAIN ] HBB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:24:40.218962] [INFO ] [MAIN ] HBB: Wiping existing primary data before full refresh. [2025-09-17T19:24:40.219008] [INFO ] [LOCAL ] HBB: Starting deletion of primary data. [2025-09-17T19:24:40.219288] [DEBUG] [LOCAL ] HBB: Deleted primary data file. [2025-09-17T19:24:40.219341] [INFO ] [MAIN ] HBB: Starting full primary refresh. [2025-09-17T19:24:40.420975] [INFO ] [REMOTE ] HAL: Fetching primary data for 2025-09. [2025-09-17T19:24:40.588818] [INFO ] [REMOTE ] HBB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:24:41.215688] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-11. [2025-09-17T19:24:41.289361] [INFO ] [REMOTE ] HAL: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T19:24:41.296338] [INFO ] [REMOTE ] HAL: Full fetch complete (77631 records). [2025-09-17T19:24:41.296467] [DEBUG] [VALIDATOR ] HAL: Validating primary data. [2025-09-17T19:24:41.698063] [DEBUG] [VALIDATOR ] HAL: All expected trading days are present. [2025-09-17T19:24:41.698179] [DEBUG] [VALIDATOR ] HAL: Primary data validation passed. [2025-09-17T19:24:41.699155] [INFO ] [MAIN ] HAL: Fetched primary data is valid. [2025-09-17T19:24:41.699216] [DEBUG] [LOCAL ] HAL: Saving primary data. [2025-09-17T19:24:41.728844] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T19:24:41.728989] [DEBUG] [LOCAL ] HAL: Trimmed 77631 records to 53718 (keeping 200 days of data) [2025-09-17T19:24:42.035504] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-06. [2025-09-17T19:24:42.074162] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T19:24:42.097132] [DEBUG] [LOCAL ] HAL: Primary data saved (53718 records). [2025-09-17T19:24:42.097233] [INFO ] [MAIN ] HAL: Full history saved. [2025-09-17T19:24:42.097306] [INFO ] [MAIN ] Update Progress: 992/2371 symbols completed. HAL took 35.4s. Estimated remaining: 3h 21m 7s. Rate: 6.9 symbols/min [2025-09-17T19:24:42.267511] [INFO ] [MAIN ] HBI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:24:42.318065] [DEBUG] [LOCAL ] HBI: Loaded 53046 existing records from primary storage. [2025-09-17T19:24:42.318210] [INFO ] [MAIN ] HBI: Loaded 53046 existing records. [2025-09-17T19:24:42.498176] [WARN ] [MAIN ] HBI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:24:42.498475] [INFO ] [MAIN ] HBI: Wiping existing primary data before full refresh. [2025-09-17T19:24:42.498525] [INFO ] [LOCAL ] HBI: Starting deletion of primary data. [2025-09-17T19:24:42.499424] [DEBUG] [LOCAL ] HBI: Deleted primary data file. [2025-09-17T19:24:42.499479] [INFO ] [MAIN ] HBI: Starting full primary refresh. [2025-09-17T19:24:42.831013] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-01. [2025-09-17T19:24:42.870864] [INFO ] [REMOTE ] HBI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:24:43.615822] [INFO ] [REMOTE ] HBB: Fetching primary data for 2024-12. [2025-09-17T19:24:43.697361] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T19:24:44.113269] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T19:24:44.137734] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T19:24:44.415854] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-02. [2025-09-17T19:24:45.215791] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-07. [2025-09-17T19:24:45.905966] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T19:24:46.015807] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-03. [2025-09-17T19:24:46.815725] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-01. [2025-09-17T19:24:46.918761] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T19:24:47.615806] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-11. [2025-09-17T19:24:47.663467] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T19:24:47.669477] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T19:24:48.415825] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-02. [2025-09-17T19:24:49.017351] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T19:24:49.215793] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-04. [2025-09-17T19:24:49.340771] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T19:24:50.015793] [INFO ] [REMOTE ] HBI: Fetching primary data for 2024-12. [2025-09-17T19:24:50.819276] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-08. [2025-09-17T19:24:50.825589] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T19:24:51.615829] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-05. [2025-09-17T19:24:51.734709] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T19:24:52.103019] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T19:24:52.415819] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-03. [2025-09-17T19:24:52.772486] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T19:24:53.159146] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T19:24:53.215832] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-04. [2025-09-17T19:24:54.015867] [INFO ] [REMOTE ] HASI: Fetching primary data for 2025-09. [2025-09-17T19:24:54.118210] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T19:24:54.788864] [INFO ] [REMOTE ] HASI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T19:24:54.796293] [INFO ] [REMOTE ] HASI: Full fetch complete (67825 records). [2025-09-17T19:24:54.796471] [DEBUG] [VALIDATOR ] HASI: Validating primary data. [2025-09-17T19:24:54.821630] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-01. [2025-09-17T19:24:55.233270] [DEBUG] [VALIDATOR ] HASI: All expected trading days are present. [2025-09-17T19:24:55.233372] [DEBUG] [VALIDATOR ] HASI: Primary data validation passed. [2025-09-17T19:24:55.234249] [INFO ] [MAIN ] HASI: Fetched primary data is valid. [2025-09-17T19:24:55.234313] [DEBUG] [LOCAL ] HASI: Saving primary data. [2025-09-17T19:24:55.235705] [DEBUG] [LOCAL ] HASI: Trimmed 67825 records to 47267 (keeping 200 days of data) [2025-09-17T19:24:55.523483] [DEBUG] [LOCAL ] HASI: Primary data saved (47267 records). [2025-09-17T19:24:55.523622] [INFO ] [MAIN ] HASI: Full history saved. [2025-09-17T19:24:55.524925] [INFO ] [MAIN ] Update Progress: 993/2371 symbols completed. HASI took 32.2s. Estimated remaining: 3h 21m 4s. Rate: 6.9 symbols/min [2025-09-17T19:24:55.621005] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-05. [2025-09-17T19:24:55.704784] [INFO ] [MAIN ] HBM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:24:55.756314] [DEBUG] [LOCAL ] HBM: Loaded 52925 existing records from primary storage. [2025-09-17T19:24:55.756516] [INFO ] [MAIN ] HBM: Loaded 52925 existing records. [2025-09-17T19:24:55.935466] [WARN ] [MAIN ] HBM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:24:55.935863] [INFO ] [MAIN ] HBM: Wiping existing primary data before full refresh. [2025-09-17T19:24:55.935923] [INFO ] [LOCAL ] HBM: Starting deletion of primary data. [2025-09-17T19:24:55.937043] [DEBUG] [LOCAL ] HBM: Deleted primary data file. [2025-09-17T19:24:55.937108] [INFO ] [MAIN ] HBM: Starting full primary refresh. [2025-09-17T19:24:56.299524] [INFO ] [REMOTE ] HBM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:24:56.415784] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-06. [2025-09-17T19:24:56.586550] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T19:24:56.613798] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T19:24:57.215835] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-06. [2025-09-17T19:24:57.792024] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T19:24:57.902986] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T19:24:58.015799] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-07. [2025-09-17T19:24:58.511587] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T19:24:58.815824] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-07. [2025-09-17T19:24:59.615774] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-08. [2025-09-17T19:25:00.365429] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T19:25:00.415775] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-02. [2025-09-17T19:25:00.501252] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T19:25:01.215830] [INFO ] [REMOTE ] HBB: Fetching primary data for 2025-09. [2025-09-17T19:25:01.521957] [INFO ] [REMOTE ] HBB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-17T19:25:01.523312] [INFO ] [REMOTE ] HBB: Full fetch complete (10090 records). [2025-09-17T19:25:01.523417] [DEBUG] [VALIDATOR ] HBB: Validating primary data. [2025-09-17T19:25:01.902032] [DEBUG] [VALIDATOR ] HBB: All expected trading days are present. [2025-09-17T19:25:01.902152] [DEBUG] [VALIDATOR ] HBB: Primary data validation passed. [2025-09-17T19:25:01.902585] [INFO ] [MAIN ] HBB: Fetched primary data is valid. [2025-09-17T19:25:01.902701] [DEBUG] [LOCAL ] HBB: Saving primary data. [2025-09-17T19:25:01.903787] [DEBUG] [LOCAL ] HBB: Trimmed 10090 records to 6974 (keeping 200 days of data) [2025-09-17T19:25:01.979627] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T19:25:01.997837] [DEBUG] [LOCAL ] HBB: Primary data saved (6974 records). [2025-09-17T19:25:01.998425] [INFO ] [MAIN ] HBB: Full history saved. [2025-09-17T19:25:01.999016] [INFO ] [MAIN ] Update Progress: 994/2371 symbols completed. HBB took 22.2s. Estimated remaining: 3h 20m 52s. Rate: 6.9 symbols/min [2025-09-17T19:25:02.021193] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-08. [2025-09-17T19:25:02.190243] [INFO ] [MAIN ] HCA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:25:02.244946] [DEBUG] [LOCAL ] HCA: Loaded 47465 existing records from primary storage. [2025-09-17T19:25:02.245111] [INFO ] [MAIN ] HCA: Loaded 47465 existing records. [2025-09-17T19:25:02.434260] [WARN ] [MAIN ] HCA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:25:02.434632] [INFO ] [MAIN ] HCA: Wiping existing primary data before full refresh. [2025-09-17T19:25:02.434721] [INFO ] [LOCAL ] HCA: Starting deletion of primary data. [2025-09-17T19:25:02.435822] [DEBUG] [LOCAL ] HCA: Deleted primary data file. [2025-09-17T19:25:02.435885] [INFO ] [MAIN ] HCA: Starting full primary refresh. [2025-09-17T19:25:02.818121] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-11. [2025-09-17T19:25:02.822332] [INFO ] [REMOTE ] HCA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:25:03.615816] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-03. [2025-09-17T19:25:03.783166] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T19:25:04.163019] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T19:25:04.415768] [INFO ] [REMOTE ] HBM: Fetching primary data for 2024-12. [2025-09-17T19:25:05.215949] [INFO ] [REMOTE ] HAYW: Fetching primary data for 2025-09. [2025-09-17T19:25:05.307305] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T19:25:06.009954] [INFO ] [REMOTE ] HAYW: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T19:25:06.016077] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-11. [2025-09-17T19:25:06.018967] [INFO ] [REMOTE ] HAYW: Full fetch complete (70873 records). [2025-09-17T19:25:06.019148] [DEBUG] [VALIDATOR ] HAYW: Validating primary data. [2025-09-17T19:25:06.424687] [DEBUG] [VALIDATOR ] HAYW: All expected trading days are present. [2025-09-17T19:25:06.424825] [DEBUG] [VALIDATOR ] HAYW: Primary data validation passed. [2025-09-17T19:25:06.425839] [INFO ] [MAIN ] HAYW: Fetched primary data is valid. [2025-09-17T19:25:06.425965] [DEBUG] [LOCAL ] HAYW: Saving primary data. [2025-09-17T19:25:06.453814] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T19:25:06.453977] [DEBUG] [LOCAL ] HAYW: Trimmed 70873 records to 48738 (keeping 200 days of data) [2025-09-17T19:25:06.771291] [DEBUG] [LOCAL ] HAYW: Primary data saved (48738 records). [2025-09-17T19:25:06.771434] [INFO ] [MAIN ] HAYW: Full history saved. [2025-09-17T19:25:06.771530] [INFO ] [MAIN ] Update Progress: 995/2371 symbols completed. HAYW took 33.2s. Estimated remaining: 3h 20m 38s. Rate: 6.9 symbols/min [2025-09-17T19:25:06.827115] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-04. [2025-09-17T19:25:06.946554] [INFO ] [MAIN ] HCC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:25:06.991137] [DEBUG] [LOCAL ] HCC: Loaded 45429 existing records from primary storage. [2025-09-17T19:25:06.991318] [INFO ] [MAIN ] HCC: Loaded 45429 existing records. [2025-09-17T19:25:07.192061] [WARN ] [MAIN ] HCC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:25:07.192355] [INFO ] [MAIN ] HCC: Wiping existing primary data before full refresh. [2025-09-17T19:25:07.192407] [INFO ] [LOCAL ] HCC: Starting deletion of primary data. [2025-09-17T19:25:07.193521] [DEBUG] [LOCAL ] HCC: Deleted primary data file. [2025-09-17T19:25:07.193578] [INFO ] [MAIN ] HCC: Starting full primary refresh. [2025-09-17T19:25:07.557738] [INFO ] [REMOTE ] HCC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:25:07.615742] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-11. [2025-09-17T19:25:07.853534] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T19:25:08.249135] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T19:25:08.415821] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-01. [2025-09-17T19:25:09.173692] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T19:25:09.215773] [INFO ] [REMOTE ] HCC: Fetching primary data for 2024-12. [2025-09-17T19:25:09.642076] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T19:25:10.015818] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-05. [2025-09-17T19:25:10.498952] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T19:25:10.815768] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-02. [2025-09-17T19:25:11.615791] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-01. [2025-09-17T19:25:11.754690] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T19:25:12.415816] [INFO ] [REMOTE ] HCA: Fetching primary data for 2024-12. [2025-09-17T19:25:12.605257] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T19:25:13.215810] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-03. [2025-09-17T19:25:13.271254] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T19:25:14.015815] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-06. [2025-09-17T19:25:14.100519] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T19:25:14.815788] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-02. [2025-09-17T19:25:14.950170] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T19:25:15.615783] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-01. [2025-09-17T19:25:15.755831] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T19:25:15.910167] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T19:25:16.415778] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-03. [2025-09-17T19:25:17.100281] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T19:25:17.215772] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-02. [2025-09-17T19:25:18.015780] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-07. [2025-09-17T19:25:18.095449] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T19:25:18.598794] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T19:25:18.815786] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-03. [2025-09-17T19:25:19.376610] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T19:25:19.615809] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-04. [2025-09-17T19:25:20.415807] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-04. [2025-09-17T19:25:20.610486] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T19:25:21.215786] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-04. [2025-09-17T19:25:21.309048] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T19:25:21.854241] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T19:25:22.015775] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-05. [2025-09-17T19:25:22.815806] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-08. [2025-09-17T19:25:22.933320] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T19:25:23.615778] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-05. [2025-09-17T19:25:23.755745] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T19:25:24.323331] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T19:25:24.415818] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-06. [2025-09-17T19:25:24.850075] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T19:25:25.215814] [INFO ] [REMOTE ] HBI: Fetching primary data for 2025-09. [2025-09-17T19:25:26.015802] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-05. [2025-09-17T19:25:26.066263] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T19:25:26.094373] [INFO ] [REMOTE ] HBI: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T19:25:26.102636] [INFO ] [REMOTE ] HBI: Full fetch complete (76764 records). [2025-09-17T19:25:26.102798] [DEBUG] [VALIDATOR ] HBI: Validating primary data. [2025-09-17T19:25:26.487575] [DEBUG] [VALIDATOR ] HBI: All expected trading days are present. [2025-09-17T19:25:26.487673] [DEBUG] [VALIDATOR ] HBI: Primary data validation passed. [2025-09-17T19:25:26.488525] [INFO ] [MAIN ] HBI: Fetched primary data is valid. [2025-09-17T19:25:26.488566] [DEBUG] [LOCAL ] HBI: Saving primary data. [2025-09-17T19:25:26.489988] [DEBUG] [LOCAL ] HBI: Trimmed 76764 records to 53042 (keeping 200 days of data) [2025-09-17T19:25:26.795319] [DEBUG] [LOCAL ] HBI: Primary data saved (53042 records). [2025-09-17T19:25:26.795486] [INFO ] [MAIN ] HBI: Full history saved. [2025-09-17T19:25:26.795590] [INFO ] [MAIN ] Update Progress: 996/2371 symbols completed. HBI took 44.7s. Estimated remaining: 3h 20m 45s. Rate: 6.8 symbols/min [2025-09-17T19:25:26.826447] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-07. [2025-09-17T19:25:26.972754] [INFO ] [MAIN ] HCI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:25:26.990683] [DEBUG] [LOCAL ] HCI: Loaded 14074 existing records from primary storage. [2025-09-17T19:25:26.990816] [INFO ] [MAIN ] HCI: Loaded 14074 existing records. [2025-09-17T19:25:27.170365] [WARN ] [MAIN ] HCI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:25:27.170663] [INFO ] [MAIN ] HCI: Wiping existing primary data before full refresh. [2025-09-17T19:25:27.170711] [INFO ] [LOCAL ] HCI: Starting deletion of primary data. [2025-09-17T19:25:27.171197] [DEBUG] [LOCAL ] HCI: Deleted primary data file. [2025-09-17T19:25:27.171249] [INFO ] [MAIN ] HCI: Starting full primary refresh. [2025-09-17T19:25:27.526162] [INFO ] [REMOTE ] HCI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:25:27.615777] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-11. [2025-09-17T19:25:27.728400] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T19:25:28.354422] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T19:25:28.415786] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-06. [2025-09-17T19:25:28.767242] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T19:25:29.215777] [INFO ] [REMOTE ] HCI: Fetching primary data for 2024-12. [2025-09-17T19:25:29.859719] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T19:25:30.015729] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-07. [2025-09-17T19:25:30.183569] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T19:25:30.815810] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-08. [2025-09-17T19:25:31.615773] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-06. [2025-09-17T19:25:31.767183] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T19:25:32.415787] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-01. [2025-09-17T19:25:32.589708] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T19:25:33.215771] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-08. [2025-09-17T19:25:33.275895] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T19:25:33.299585] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T19:25:34.015786] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-02. [2025-09-17T19:25:34.826183] [INFO ] [REMOTE ] HBM: Fetching primary data for 2025-09. [2025-09-17T19:25:34.831502] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T19:25:34.850246] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T19:25:35.562348] [INFO ] [REMOTE ] HBM: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T19:25:35.570296] [INFO ] [REMOTE ] HBM: Full fetch complete (75857 records). [2025-09-17T19:25:35.570468] [DEBUG] [VALIDATOR ] HBM: Validating primary data. [2025-09-17T19:25:35.624462] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-07. [2025-09-17T19:25:35.972661] [DEBUG] [VALIDATOR ] HBM: All expected trading days are present. [2025-09-17T19:25:35.972820] [DEBUG] [VALIDATOR ] HBM: Primary data validation passed. [2025-09-17T19:25:35.973832] [INFO ] [MAIN ] HBM: Fetched primary data is valid. [2025-09-17T19:25:35.973905] [DEBUG] [LOCAL ] HBM: Saving primary data. [2025-09-17T19:25:35.975467] [DEBUG] [LOCAL ] HBM: Trimmed 75857 records to 52913 (keeping 200 days of data) [2025-09-17T19:25:36.325527] [DEBUG] [LOCAL ] HBM: Primary data saved (52913 records). [2025-09-17T19:25:36.325693] [INFO ] [MAIN ] HBM: Full history saved. [2025-09-17T19:25:36.326433] [INFO ] [MAIN ] Update Progress: 997/2371 symbols completed. HBM took 40.8s. Estimated remaining: 3h 20m 37s. Rate: 6.8 symbols/min [2025-09-17T19:25:36.415789] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-03. [2025-09-17T19:25:37.223933] [INFO ] [REMOTE ] HCA: Fetching primary data for 2025-09. [2025-09-17T19:25:37.426801] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T19:25:37.458499] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T19:25:37.710834] [INFO ] [REMOTE ] HCA: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T19:25:37.718017] [INFO ] [REMOTE ] HCA: Full fetch complete (69138 records). [2025-09-17T19:25:37.718203] [DEBUG] [VALIDATOR ] HCA: Validating primary data. [2025-09-17T19:25:38.020852] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-04. [2025-09-17T19:25:38.200331] [DEBUG] [VALIDATOR ] HCA: All expected trading days are present. [2025-09-17T19:25:38.200441] [DEBUG] [VALIDATOR ] HCA: Primary data validation passed. [2025-09-17T19:25:38.201451] [INFO ] [MAIN ] HCA: Fetched primary data is valid. [2025-09-17T19:25:38.201502] [DEBUG] [LOCAL ] HCA: Saving primary data. [2025-09-17T19:25:38.203035] [DEBUG] [LOCAL ] HCA: Trimmed 69138 records to 47402 (keeping 200 days of data) [2025-09-17T19:25:38.568055] [DEBUG] [LOCAL ] HCA: Primary data saved (47402 records). [2025-09-17T19:25:38.568223] [INFO ] [MAIN ] HCA: Full history saved. [2025-09-17T19:25:38.568362] [INFO ] [MAIN ] Update Progress: 998/2371 symbols completed. HCA took 36.6s. Estimated remaining: 3h 20m 19s. Rate: 6.9 symbols/min [2025-09-17T19:25:38.815789] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-08. [2025-09-17T19:25:39.077420] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T19:25:39.615817] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-05. [2025-09-17T19:25:40.074704] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T19:25:40.168919] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T19:25:40.415790] [INFO ] [REMOTE ] HCC: Fetching primary data for 2025-09. [2025-09-17T19:25:41.088936] [INFO ] [REMOTE ] HCC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T19:25:41.094904] [INFO ] [REMOTE ] HCC: Full fetch complete (63947 records). [2025-09-17T19:25:41.095012] [DEBUG] [VALIDATOR ] HCC: Validating primary data. [2025-09-17T19:25:41.221077] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-06. [2025-09-17T19:25:41.482694] [DEBUG] [VALIDATOR ] HCC: All expected trading days are present. [2025-09-17T19:25:41.482778] [DEBUG] [VALIDATOR ] HCC: Primary data validation passed. [2025-09-17T19:25:41.483579] [INFO ] [MAIN ] HCC: Fetched primary data is valid. [2025-09-17T19:25:41.483622] [DEBUG] [LOCAL ] HCC: Saving primary data. [2025-09-17T19:25:41.484917] [DEBUG] [LOCAL ] HCC: Trimmed 63947 records to 45426 (keeping 200 days of data) [2025-09-17T19:25:41.763240] [DEBUG] [LOCAL ] HCC: Primary data saved (45426 records). [2025-09-17T19:25:41.763372] [INFO ] [MAIN ] HCC: Full history saved. [2025-09-17T19:25:41.763477] [INFO ] [MAIN ] Update Progress: 999/2371 symbols completed. HCC took 35.0s. Estimated remaining: 3h 20m 3s. Rate: 6.9 symbols/min [2025-09-17T19:25:42.303004] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T19:25:42.307162] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-07. [2025-09-17T19:25:43.311474] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T19:25:43.315817] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-08. [2025-09-17T19:25:43.968535] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T19:25:43.972008] [INFO ] [REMOTE ] HCI: Fetching primary data for 2025-09. [2025-09-17T19:25:44.378461] [INFO ] [REMOTE ] HCI: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T19:25:44.380784] [INFO ] [REMOTE ] HCI: Full fetch complete (19527 records). [2025-09-17T19:25:44.380859] [DEBUG] [VALIDATOR ] HCI: Validating primary data. [2025-09-17T19:25:44.749534] [DEBUG] [VALIDATOR ] HCI: All expected trading days are present. [2025-09-17T19:25:44.749749] [DEBUG] [VALIDATOR ] HCI: Primary data validation passed. [2025-09-17T19:25:44.750165] [INFO ] [MAIN ] HCI: Fetched primary data is valid. [2025-09-17T19:25:44.750204] [DEBUG] [LOCAL ] HCI: Saving primary data. [2025-09-17T19:25:44.750853] [DEBUG] [LOCAL ] HCI: Trimmed 19527 records to 13942 (keeping 200 days of data) [2025-09-17T19:25:44.847674] [DEBUG] [LOCAL ] HCI: Primary data saved (13942 records). [2025-09-17T19:25:44.847843] [INFO ] [MAIN ] HCI: Full history saved. [2025-09-17T19:25:44.847963] [INFO ] [MAIN ] Update Progress: 1000/2371 symbols completed. HCI took 18.1s. Estimated remaining: 3h 19m 47s. Rate: 6.9 symbols/min [2025-09-17T19:25:45.447211] [INFO ] [MAIN ] HD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:25:45.467974] [INFO ] [MAIN ] HE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:25:45.545118] [INFO ] [MAIN ] HCXY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:25:45.526134] [INFO ] [MAIN ] HDB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:25:45.545432] [DEBUG] [LOCAL ] HCXY: No existing data file found in primary storage. [2025-09-17T19:25:45.545759] [WARN ] [MAIN ] HCXY: No existing data found, performing full refresh instead. [2025-09-17T19:25:45.547870] [INFO ] [MAIN ] HCXY: Wiping existing primary data before full refresh. [2025-09-17T19:25:45.548209] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-17T19:25:45.548380] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-17T19:25:45.548433] [INFO ] [MAIN ] HCXY: Starting full primary refresh. [2025-09-17T19:25:45.892460] [DEBUG] [LOCAL ] HE: Loaded 49341 existing records from primary storage. [2025-09-17T19:25:45.909629] [INFO ] [MAIN ] HE: Loaded 49341 existing records. [2025-09-17T19:25:45.932494] [DEBUG] [LOCAL ] HDB: Loaded 51918 existing records from primary storage. [2025-09-17T19:25:46.046200] [INFO ] [REMOTE ] HCXY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:25:46.030347] [INFO ] [MAIN ] HDB: Loaded 51918 existing records. [2025-09-17T19:25:46.036359] [DEBUG] [LOCAL ] HD: Loaded 53522 existing records from primary storage. [2025-09-17T19:25:46.051662] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-11. [2025-09-17T19:25:46.131069] [INFO ] [MAIN ] HD: Loaded 53522 existing records. [2025-09-17T19:25:46.579408] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T19:25:46.619592] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2024-12. [2025-09-17T19:25:46.643009] [WARN ] [MAIN ] HD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:25:46.641429] [WARN ] [MAIN ] HDB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:25:46.646907] [WARN ] [MAIN ] HE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:25:46.648131] [INFO ] [MAIN ] HDB: Wiping existing primary data before full refresh. [2025-09-17T19:25:46.648238] [INFO ] [LOCAL ] HDB: Starting deletion of primary data. [2025-09-17T19:25:46.648697] [INFO ] [MAIN ] HE: Wiping existing primary data before full refresh. [2025-09-17T19:25:46.648869] [INFO ] [LOCAL ] HE: Starting deletion of primary data. [2025-09-17T19:25:46.648955] [INFO ] [MAIN ] HD: Wiping existing primary data before full refresh. [2025-09-17T19:25:46.649279] [INFO ] [LOCAL ] HD: Starting deletion of primary data. [2025-09-17T19:25:46.649886] [DEBUG] [LOCAL ] HDB: Deleted primary data file. [2025-09-17T19:25:46.649963] [INFO ] [MAIN ] HDB: Starting full primary refresh. [2025-09-17T19:25:46.656050] [DEBUG] [LOCAL ] HE: Deleted primary data file. [2025-09-17T19:25:46.656351] [INFO ] [MAIN ] HE: Starting full primary refresh. [2025-09-17T19:25:46.661528] [DEBUG] [LOCAL ] HD: Deleted primary data file. [2025-09-17T19:25:46.722700] [INFO ] [MAIN ] HD: Starting full primary refresh. [2025-09-17T19:25:47.025117] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-17T19:25:47.088197] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-01. [2025-09-17T19:25:47.705052] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T19:25:47.779331] [INFO ] [REMOTE ] HDB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:25:47.805857] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-11. [2025-09-17T19:25:47.804905] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-02. [2025-09-17T19:25:47.836564] [INFO ] [REMOTE ] HE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:25:47.861545] [INFO ] [REMOTE ] HD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:25:48.318614] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T19:25:48.415837] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-11. [2025-09-17T19:25:49.215822] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-11. [2025-09-17T19:25:49.516213] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T19:25:50.015832] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-03. [2025-09-17T19:25:50.444985] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-17T19:25:50.485496] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T19:25:50.684523] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T19:25:50.815848] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-04. [2025-09-17T19:25:51.027732] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-04 (0.21 seconds). [2025-09-17T19:25:51.615822] [INFO ] [REMOTE ] HE: Fetching primary data for 2024-12. [2025-09-17T19:25:52.415868] [INFO ] [REMOTE ] HD: Fetching primary data for 2024-12. [2025-09-17T19:25:53.215771] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-05. [2025-09-17T19:25:53.358852] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T19:25:53.442162] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-05 (0.23 seconds). [2025-09-17T19:25:54.015756] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-06. [2025-09-17T19:25:54.306559] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-17T19:25:54.468319] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-17T19:25:54.815779] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-07. [2025-09-17T19:25:55.054742] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-07 (0.24 seconds). [2025-09-17T19:25:55.615768] [INFO ] [REMOTE ] HDB: Fetching primary data for 2024-12. [2025-09-17T19:25:56.415792] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-08. [2025-09-17T19:25:56.694948] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-17T19:25:57.215771] [INFO ] [REMOTE ] HCXY: Fetching primary data for 2025-09. [2025-09-17T19:25:57.247703] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T19:25:57.449129] [INFO ] [REMOTE ] HCXY: Incremental fetch complete for 2025-09 (0.23 seconds). [2025-09-17T19:25:57.449828] [INFO ] [REMOTE ] HCXY: Full fetch complete (605 records). [2025-09-17T19:25:57.449901] [DEBUG] [VALIDATOR ] HCXY: Validating primary data. [2025-09-17T19:25:57.625944] [WARN ] [VALIDATOR ] HCXY: Validation failed - insufficient historical data. Have 167 unique days, need 200 days [2025-09-17T19:25:57.626137] [FATAL] [MAIN ] HCXY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:25:57.626183] [WARN ] [MAIN ] HCXY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:25:57.626234] [INFO ] [LOCAL ] HCXY: Starting deletion of primary data. [2025-09-17T19:25:57.626292] [DEBUG] [LOCAL ] HCXY: No primary data file found to delete. [2025-09-17T19:25:57.626326] [INFO ] [LOCAL ] HCXY: Starting deletion of derivative data. [2025-09-17T19:25:57.626373] [DEBUG] [LOCAL ] HCXY: No derivative data file found to delete. [2025-09-17T19:25:57.626431] [INFO ] [MAIN ] Update Progress: 1001/2371 symbols completed. HCXY took 12.8s. Estimated remaining: 3h 19m 43s. Rate: 6.9 symbols/min [2025-09-17T19:25:57.798797] [INFO ] [MAIN ] HEI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:25:57.839678] [DEBUG] [LOCAL ] HEI: Loaded 33129 existing records from primary storage. [2025-09-17T19:25:57.839861] [INFO ] [MAIN ] HEI: Loaded 33129 existing records. [2025-09-17T19:25:58.017906] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-01. [2025-09-17T19:25:58.022424] [WARN ] [MAIN ] HEI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:25:58.022742] [INFO ] [MAIN ] HEI: Wiping existing primary data before full refresh. [2025-09-17T19:25:58.022795] [INFO ] [LOCAL ] HEI: Starting deletion of primary data. [2025-09-17T19:25:58.023506] [DEBUG] [LOCAL ] HEI: Deleted primary data file. [2025-09-17T19:25:58.023553] [INFO ] [MAIN ] HEI: Starting full primary refresh. [2025-09-17T19:25:58.377285] [INFO ] [REMOTE ] HEI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:25:58.815769] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-01. [2025-09-17T19:25:59.615773] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-01. [2025-09-17T19:26:00.415832] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-11. [2025-09-17T19:26:00.524823] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-17T19:26:00.611789] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T19:26:01.129769] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T19:26:01.215807] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-02. [2025-09-17T19:26:01.598427] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T19:26:02.015793] [INFO ] [REMOTE ] HEI: Fetching primary data for 2024-12. [2025-09-17T19:26:02.815737] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-02. [2025-09-17T19:26:03.212391] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T19:26:03.316438] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T19:26:03.615793] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-01. [2025-09-17T19:26:04.415793] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-02. [2025-09-17T19:26:04.474937] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T19:26:05.126967] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T19:26:05.215810] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-02. [2025-09-17T19:26:06.015812] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-03. [2025-09-17T19:26:06.166057] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T19:26:06.614227] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T19:26:06.815778] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-03. [2025-09-17T19:26:07.615772] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-03. [2025-09-17T19:26:08.101133] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T19:26:08.415791] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-03. [2025-09-17T19:26:08.654779] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T19:26:09.215777] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-04. [2025-09-17T19:26:09.358523] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T19:26:09.929367] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T19:26:10.015774] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-04. [2025-09-17T19:26:10.812968] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T19:26:10.815693] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-04. [2025-09-17T19:26:11.227815] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T19:26:11.615797] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-05. [2025-09-17T19:26:12.325473] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T19:26:12.415820] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-04. [2025-09-17T19:26:13.007747] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T19:26:13.215780] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-06. [2025-09-17T19:26:14.015796] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-05. [2025-09-17T19:26:14.523978] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-04 (2.11 seconds). [2025-09-17T19:26:14.815878] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-05. [2025-09-17T19:26:14.911687] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T19:26:15.615788] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-05. [2025-09-17T19:26:15.773613] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T19:26:16.276237] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T19:26:16.415794] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-06. [2025-09-17T19:26:17.215833] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-07. [2025-09-17T19:26:17.551857] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T19:26:17.857688] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T19:26:18.015784] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-06. [2025-09-17T19:26:18.815853] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-06. [2025-09-17T19:26:18.976252] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T19:26:19.608063] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T19:26:19.617684] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-08. [2025-09-17T19:26:20.415800] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-07. [2025-09-17T19:26:20.520438] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T19:26:21.215820] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-07. [2025-09-17T19:26:21.622236] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T19:26:22.015781] [INFO ] [REMOTE ] HE: Fetching primary data for 2025-09. [2025-09-17T19:26:22.141067] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T19:26:22.504815] [INFO ] [REMOTE ] HE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T19:26:22.511273] [INFO ] [REMOTE ] HE: Full fetch complete (72376 records). [2025-09-17T19:26:22.511427] [DEBUG] [VALIDATOR ] HE: Validating primary data. [2025-09-17T19:26:22.820843] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-07. [2025-09-17T19:26:22.907574] [DEBUG] [VALIDATOR ] HE: All expected trading days are present. [2025-09-17T19:26:22.907686] [DEBUG] [VALIDATOR ] HE: Primary data validation passed. [2025-09-17T19:26:22.908625] [INFO ] [MAIN ] HE: Fetched primary data is valid. [2025-09-17T19:26:22.908689] [DEBUG] [LOCAL ] HE: Saving primary data. [2025-09-17T19:26:22.910197] [DEBUG] [LOCAL ] HE: Trimmed 72376 records to 49328 (keeping 200 days of data) [2025-09-17T19:26:23.210421] [DEBUG] [LOCAL ] HE: Primary data saved (49328 records). [2025-09-17T19:26:23.210568] [INFO ] [MAIN ] HE: Full history saved. [2025-09-17T19:26:23.210670] [INFO ] [MAIN ] Update Progress: 1002/2371 symbols completed. HE took 38.4s. Estimated remaining: 3h 19m 58s. Rate: 6.8 symbols/min [2025-09-17T19:26:23.384301] [INFO ] [MAIN ] HEQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:26:23.392586] [DEBUG] [LOCAL ] HEQ: Loaded 6098 existing records from primary storage. [2025-09-17T19:26:23.392949] [INFO ] [MAIN ] HEQ: Loaded 6098 existing records. [2025-09-17T19:26:23.597550] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-17T19:26:23.616170] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-08. [2025-09-17T19:26:23.620039] [WARN ] [MAIN ] HEQ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:26:23.634263] [INFO ] [MAIN ] HEQ: Wiping existing primary data before full refresh. [2025-09-17T19:26:23.634500] [INFO ] [LOCAL ] HEQ: Starting deletion of primary data. [2025-09-17T19:26:23.635272] [DEBUG] [LOCAL ] HEQ: Deleted primary data file. [2025-09-17T19:26:23.635334] [INFO ] [MAIN ] HEQ: Starting full primary refresh. [2025-09-17T19:26:24.003115] [INFO ] [REMOTE ] HEQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:26:24.292286] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T19:26:24.415809] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-08. [2025-09-17T19:26:25.215796] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-11. [2025-09-17T19:26:25.673829] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T19:26:25.674116] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T19:26:26.015752] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2024-12. [2025-09-17T19:26:26.539228] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-17T19:26:26.659627] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T19:26:26.815796] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-01. [2025-09-17T19:26:27.433704] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T19:26:27.615779] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-08. [2025-09-17T19:26:28.415785] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-02. [2025-09-17T19:26:29.058926] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T19:26:29.101850] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T19:26:29.215780] [INFO ] [REMOTE ] HEI: Fetching primary data for 2025-09. [2025-09-17T19:26:29.877132] [INFO ] [REMOTE ] HEI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T19:26:29.881184] [INFO ] [REMOTE ] HEI: Full fetch complete (49268 records). [2025-09-17T19:26:29.881307] [DEBUG] [VALIDATOR ] HEI: Validating primary data. [2025-09-17T19:26:30.021927] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-03. [2025-09-17T19:26:30.261696] [DEBUG] [VALIDATOR ] HEI: All expected trading days are present. [2025-09-17T19:26:30.261801] [DEBUG] [VALIDATOR ] HEI: Primary data validation passed. [2025-09-17T19:26:30.262519] [INFO ] [MAIN ] HEI: Fetched primary data is valid. [2025-09-17T19:26:30.262563] [DEBUG] [LOCAL ] HEI: Saving primary data. [2025-09-17T19:26:30.263865] [DEBUG] [LOCAL ] HEI: Trimmed 49268 records to 33027 (keeping 200 days of data) [2025-09-17T19:26:30.478198] [DEBUG] [LOCAL ] HEI: Primary data saved (33027 records). [2025-09-17T19:26:30.478367] [INFO ] [MAIN ] HEI: Full history saved. [2025-09-17T19:26:30.479038] [INFO ] [MAIN ] Update Progress: 1003/2371 symbols completed. HEI took 32.9s. Estimated remaining: 3h 19m 47s. Rate: 6.8 symbols/min [2025-09-17T19:26:30.592410] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T19:26:30.658782] [INFO ] [MAIN ] HESM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:26:30.706137] [DEBUG] [LOCAL ] HESM: Loaded 48174 existing records from primary storage. [2025-09-17T19:26:30.706299] [INFO ] [MAIN ] HESM: Loaded 48174 existing records. [2025-09-17T19:26:30.820893] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-04. [2025-09-17T19:26:30.890752] [WARN ] [MAIN ] HESM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:26:30.891030] [INFO ] [MAIN ] HESM: Wiping existing primary data before full refresh. [2025-09-17T19:26:30.891093] [INFO ] [LOCAL ] HESM: Starting deletion of primary data. [2025-09-17T19:26:30.892038] [DEBUG] [LOCAL ] HESM: Deleted primary data file. [2025-09-17T19:26:30.892098] [INFO ] [MAIN ] HESM: Starting full primary refresh. [2025-09-17T19:26:31.249091] [INFO ] [REMOTE ] HESM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:26:31.615795] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-11. [2025-09-17T19:26:31.724958] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T19:26:32.415769] [INFO ] [REMOTE ] HDB: Fetching primary data for 2025-09. [2025-09-17T19:26:32.908866] [INFO ] [REMOTE ] HDB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T19:26:32.915942] [INFO ] [REMOTE ] HDB: Full fetch complete (75059 records). [2025-09-17T19:26:32.916121] [DEBUG] [VALIDATOR ] HDB: Validating primary data. [2025-09-17T19:26:33.221025] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-05. [2025-09-17T19:26:33.373338] [DEBUG] [VALIDATOR ] HDB: All expected trading days are present. [2025-09-17T19:26:33.373739] [DEBUG] [VALIDATOR ] HDB: Primary data validation passed. [2025-09-17T19:26:33.376578] [INFO ] [MAIN ] HDB: Fetched primary data is valid. [2025-09-17T19:26:33.377685] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T19:26:33.377970] [DEBUG] [LOCAL ] HDB: Saving primary data. [2025-09-17T19:26:33.389171] [DEBUG] [LOCAL ] HDB: Trimmed 75059 records to 51931 (keeping 200 days of data) [2025-09-17T19:26:33.721593] [DEBUG] [LOCAL ] HDB: Primary data saved (51931 records). [2025-09-17T19:26:33.721755] [INFO ] [MAIN ] HDB: Full history saved. [2025-09-17T19:26:33.721875] [INFO ] [MAIN ] Update Progress: 1004/2371 symbols completed. HDB took 48.9s. Estimated remaining: 3h 19m 31s. Rate: 6.9 symbols/min [2025-09-17T19:26:33.891482] [INFO ] [MAIN ] HF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:26:33.891661] [DEBUG] [LOCAL ] HF: No existing data file found in primary storage. [2025-09-17T19:26:33.891702] [WARN ] [MAIN ] HF: No existing data found, performing full refresh instead. [2025-09-17T19:26:33.891816] [INFO ] [MAIN ] HF: Wiping existing primary data before full refresh. [2025-09-17T19:26:33.891854] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-17T19:26:33.891893] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-17T19:26:33.891924] [INFO ] [MAIN ] HF: Starting full primary refresh. [2025-09-17T19:26:34.020936] [INFO ] [REMOTE ] HESM: Fetching primary data for 2024-12. [2025-09-17T19:26:34.064914] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T19:26:34.260601] [INFO ] [REMOTE ] HF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:26:34.815783] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-06. [2025-09-17T19:26:35.453906] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T19:26:35.584779] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T19:26:35.615727] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-01. [2025-09-17T19:26:36.415802] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-11. [2025-09-17T19:26:36.672726] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-11 (0.26 seconds). [2025-09-17T19:26:36.957292] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T19:26:37.215764] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-02. [2025-09-17T19:26:38.015793] [INFO ] [REMOTE ] HF: Fetching primary data for 2024-12. [2025-09-17T19:26:38.284731] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2024-12 (0.27 seconds). [2025-09-17T19:26:38.815768] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-07. [2025-09-17T19:26:38.869212] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T19:26:39.602061] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T19:26:39.615729] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-08. [2025-09-17T19:26:40.068491] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T19:26:40.415825] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-01. [2025-09-17T19:26:40.741108] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T19:26:41.215794] [INFO ] [REMOTE ] HEQ: Fetching primary data for 2025-09. [2025-09-17T19:26:41.673008] [INFO ] [REMOTE ] HEQ: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T19:26:41.674717] [INFO ] [REMOTE ] HEQ: Full fetch complete (8886 records). [2025-09-17T19:26:41.674786] [DEBUG] [VALIDATOR ] HEQ: Validating primary data. [2025-09-17T19:26:42.020875] [INFO ] [REMOTE ] HD: Fetching primary data for 2025-09. [2025-09-17T19:26:42.052792] [DEBUG] [VALIDATOR ] HEQ: All expected trading days are present. [2025-09-17T19:26:42.052882] [DEBUG] [VALIDATOR ] HEQ: Primary data validation passed. [2025-09-17T19:26:42.053138] [INFO ] [MAIN ] HEQ: Fetched primary data is valid. [2025-09-17T19:26:42.053187] [DEBUG] [LOCAL ] HEQ: Saving primary data. [2025-09-17T19:26:42.053624] [DEBUG] [LOCAL ] HEQ: Trimmed 8886 records to 6138 (keeping 200 days of data) [2025-09-17T19:26:42.094981] [DEBUG] [LOCAL ] HEQ: Primary data saved (6138 records). [2025-09-17T19:26:42.095114] [INFO ] [MAIN ] HEQ: Full history saved. [2025-09-17T19:26:42.095224] [INFO ] [MAIN ] Update Progress: 1005/2371 symbols completed. HEQ took 18.9s. Estimated remaining: 3h 19m 21s. Rate: 6.9 symbols/min [2025-09-17T19:26:42.270176] [INFO ] [MAIN ] HFND: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:26:42.270377] [DEBUG] [LOCAL ] HFND: No existing data file found in primary storage. [2025-09-17T19:26:42.270414] [WARN ] [MAIN ] HFND: No existing data found, performing full refresh instead. [2025-09-17T19:26:42.270544] [INFO ] [MAIN ] HFND: Wiping existing primary data before full refresh. [2025-09-17T19:26:42.270582] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-17T19:26:42.270623] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-17T19:26:42.270677] [INFO ] [MAIN ] HFND: Starting full primary refresh. [2025-09-17T19:26:42.649060] [INFO ] [REMOTE ] HFND: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:26:42.669546] [INFO ] [REMOTE ] HD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T19:26:42.678189] [INFO ] [REMOTE ] HD: Full fetch complete (77339 records). [2025-09-17T19:26:42.678340] [DEBUG] [VALIDATOR ] HD: Validating primary data. [2025-09-17T19:26:42.821252] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-11. [2025-09-17T19:26:43.089245] [DEBUG] [VALIDATOR ] HD: All expected trading days are present. [2025-09-17T19:26:43.089351] [DEBUG] [VALIDATOR ] HD: Primary data validation passed. [2025-09-17T19:26:43.090342] [INFO ] [MAIN ] HD: Fetched primary data is valid. [2025-09-17T19:26:43.090389] [DEBUG] [LOCAL ] HD: Saving primary data. [2025-09-17T19:26:43.092007] [DEBUG] [LOCAL ] HD: Trimmed 77339 records to 53521 (keeping 200 days of data) [2025-09-17T19:26:43.194627] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T19:26:43.444842] [DEBUG] [LOCAL ] HD: Primary data saved (53521 records). [2025-09-17T19:26:43.444999] [INFO ] [MAIN ] HD: Full history saved. [2025-09-17T19:26:43.445089] [INFO ] [MAIN ] Update Progress: 1006/2371 symbols completed. HD took 58.6s. Estimated remaining: 3h 19m 2s. Rate: 6.9 symbols/min [2025-09-17T19:26:43.613206] [INFO ] [MAIN ] HFRO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:26:43.615820] [INFO ] [REMOTE ] HFND: Fetching primary data for 2024-12. [2025-09-17T19:26:43.631246] [DEBUG] [LOCAL ] HFRO: Loaded 17567 existing records from primary storage. [2025-09-17T19:26:43.631446] [INFO ] [MAIN ] HFRO: Loaded 17567 existing records. [2025-09-17T19:26:43.807061] [WARN ] [MAIN ] HFRO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:26:43.807338] [INFO ] [MAIN ] HFRO: Wiping existing primary data before full refresh. [2025-09-17T19:26:43.807382] [INFO ] [LOCAL ] HFRO: Starting deletion of primary data. [2025-09-17T19:26:43.807915] [DEBUG] [LOCAL ] HFRO: Deleted primary data file. [2025-09-17T19:26:43.807964] [INFO ] [MAIN ] HFRO: Starting full primary refresh. [2025-09-17T19:26:44.092247] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T19:26:44.207252] [INFO ] [REMOTE ] HFRO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:26:44.415782] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-11. [2025-09-17T19:26:45.215740] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-02. [2025-09-17T19:26:45.451413] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T19:26:45.482958] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-02 (0.27 seconds). [2025-09-17T19:26:46.015810] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2024-12. [2025-09-17T19:26:46.815778] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-01. [2025-09-17T19:26:47.134618] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T19:26:47.354573] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T19:26:47.615847] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-02. [2025-09-17T19:26:48.038285] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T19:26:48.415811] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-03. [2025-09-17T19:26:48.831691] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T19:26:49.215841] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-03. [2025-09-17T19:26:49.450834] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-17T19:26:50.015855] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-04. [2025-09-17T19:26:50.464410] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T19:26:50.815795] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-05. [2025-09-17T19:26:51.084221] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-05 (0.27 seconds). [2025-09-17T19:26:51.615795] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-06. [2025-09-17T19:26:51.943835] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-17T19:26:52.415811] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-03. [2025-09-17T19:26:53.215800] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-04. [2025-09-17T19:26:53.452430] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-04 (0.24 seconds). [2025-09-17T19:26:53.861982] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T19:26:54.015789] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-05. [2025-09-17T19:26:54.260228] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-05 (0.24 seconds). [2025-09-17T19:26:54.815784] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-06. [2025-09-17T19:26:55.060676] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-06 (0.24 seconds). [2025-09-17T19:26:55.615805] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-07. [2025-09-17T19:26:56.042697] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T19:26:56.415811] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-04. [2025-09-17T19:26:57.215787] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-07. [2025-09-17T19:26:57.469375] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-07 (0.25 seconds). [2025-09-17T19:26:57.981286] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T19:26:58.015773] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-05. [2025-09-17T19:26:58.815830] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-08. [2025-09-17T19:26:59.244697] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T19:26:59.352595] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T19:26:59.615837] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-08. [2025-09-17T19:26:59.836601] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-17T19:27:00.415813] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-01. [2025-09-17T19:27:01.215806] [INFO ] [REMOTE ] HF: Fetching primary data for 2025-09. [2025-09-17T19:27:01.703369] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T19:27:02.015780] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-02. [2025-09-17T19:27:02.140479] [INFO ] [REMOTE ] HF: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T19:27:02.141206] [INFO ] [REMOTE ] HF: Full fetch complete (511 records). [2025-09-17T19:27:02.141274] [DEBUG] [VALIDATOR ] HF: Validating primary data. [2025-09-17T19:27:02.324678] [WARN ] [VALIDATOR ] HF: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-17T19:27:02.324893] [FATAL] [MAIN ] HF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:27:02.324943] [WARN ] [MAIN ] HF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:27:02.324988] [INFO ] [LOCAL ] HF: Starting deletion of primary data. [2025-09-17T19:27:02.325045] [DEBUG] [LOCAL ] HF: No primary data file found to delete. [2025-09-17T19:27:02.325080] [INFO ] [LOCAL ] HF: Starting deletion of derivative data. [2025-09-17T19:27:02.325131] [DEBUG] [LOCAL ] HF: No derivative data file found to delete. [2025-09-17T19:27:02.325190] [INFO ] [MAIN ] Update Progress: 1007/2371 symbols completed. HF took 28.6s. Estimated remaining: 3h 19m 7s. Rate: 6.9 symbols/min [2025-09-17T19:27:02.498818] [INFO ] [MAIN ] HGER: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:27:02.513351] [DEBUG] [LOCAL ] HGER: Loaded 12497 existing records from primary storage. [2025-09-17T19:27:02.513528] [INFO ] [MAIN ] HGER: Loaded 12497 existing records. [2025-09-17T19:27:02.704870] [WARN ] [MAIN ] HGER: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:27:02.705141] [INFO ] [MAIN ] HGER: Wiping existing primary data before full refresh. [2025-09-17T19:27:02.705189] [INFO ] [LOCAL ] HGER: Starting deletion of primary data. [2025-09-17T19:27:02.705713] [DEBUG] [LOCAL ] HGER: Deleted primary data file. [2025-09-17T19:27:02.705766] [INFO ] [MAIN ] HGER: Starting full primary refresh. [2025-09-17T19:27:02.820898] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-06. [2025-09-17T19:27:03.076157] [INFO ] [REMOTE ] HGER: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:27:03.615823] [INFO ] [REMOTE ] HFND: Fetching primary data for 2025-09. [2025-09-17T19:27:04.106865] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-02 (2.09 seconds). [2025-09-17T19:27:04.415794] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-11. [2025-09-17T19:27:05.082303] [INFO ] [REMOTE ] HFND: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T19:27:05.083216] [INFO ] [REMOTE ] HFND: Full fetch complete (1792 records). [2025-09-17T19:27:05.083295] [DEBUG] [VALIDATOR ] HFND: Validating primary data. [2025-09-17T19:27:05.151221] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T19:27:05.230551] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-03. [2025-09-17T19:27:05.270863] [WARN ] [VALIDATOR ] HFND: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-17T19:27:05.271111] [FATAL] [MAIN ] HFND: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:27:05.271193] [WARN ] [MAIN ] HFND: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:27:05.271261] [INFO ] [LOCAL ] HFND: Starting deletion of primary data. [2025-09-17T19:27:05.271330] [DEBUG] [LOCAL ] HFND: No primary data file found to delete. [2025-09-17T19:27:05.271369] [INFO ] [LOCAL ] HFND: Starting deletion of derivative data. [2025-09-17T19:27:05.271437] [DEBUG] [LOCAL ] HFND: No derivative data file found to delete. [2025-09-17T19:27:05.271511] [INFO ] [MAIN ] Update Progress: 1008/2371 symbols completed. HFND took 23.2s. Estimated remaining: 3h 18m 51s. Rate: 6.9 symbols/min [2025-09-17T19:27:05.442239] [INFO ] [MAIN ] HGLB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:27:05.453090] [DEBUG] [LOCAL ] HGLB: Loaded 9787 existing records from primary storage. [2025-09-17T19:27:05.454263] [INFO ] [MAIN ] HGLB: Loaded 9787 existing records. [2025-09-17T19:27:05.636481] [WARN ] [MAIN ] HGLB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:27:05.636776] [INFO ] [MAIN ] HGLB: Wiping existing primary data before full refresh. [2025-09-17T19:27:05.636828] [INFO ] [LOCAL ] HGLB: Starting deletion of primary data. [2025-09-17T19:27:05.637208] [DEBUG] [LOCAL ] HGLB: Deleted primary data file. [2025-09-17T19:27:05.637253] [INFO ] [MAIN ] HGLB: Starting full primary refresh. [2025-09-17T19:27:05.998135] [INFO ] [REMOTE ] HGLB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:27:06.018522] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-11. [2025-09-17T19:27:06.034349] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-06 (3.21 seconds). [2025-09-17T19:27:06.064175] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T19:27:06.641037] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T19:27:06.815831] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2024-12. [2025-09-17T19:27:07.415594] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T19:27:07.615798] [INFO ] [REMOTE ] HGER: Fetching primary data for 2024-12. [2025-09-17T19:27:08.309060] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T19:27:08.415837] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-01. [2025-09-17T19:27:09.215862] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-07. [2025-09-17T19:27:09.336505] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T19:27:10.015796] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-02. [2025-09-17T19:27:10.617234] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T19:27:10.789278] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T19:27:10.815729] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-03. [2025-09-17T19:27:11.615781] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-08. [2025-09-17T19:27:11.629939] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T19:27:12.415833] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-01. [2025-09-17T19:27:13.120708] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T19:27:13.215833] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-04. [2025-09-17T19:27:13.363321] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T19:27:13.935713] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T19:27:14.015747] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-05. [2025-09-17T19:27:14.816782] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-02. [2025-09-17T19:27:14.818528] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T19:27:15.591922] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T19:27:15.615734] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-03. [2025-09-17T19:27:16.415803] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-04. [2025-09-17T19:27:17.215833] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-06. [2025-09-17T19:27:17.352846] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T19:27:17.970230] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T19:27:18.015746] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-05. [2025-09-17T19:27:18.279079] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-06 (1.06 seconds). [2025-09-17T19:27:18.722245] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T19:27:18.815880] [INFO ] [REMOTE ] HESM: Fetching primary data for 2025-09. [2025-09-17T19:27:19.623318] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-04. [2025-09-17T19:27:19.627947] [INFO ] [REMOTE ] HESM: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T19:27:19.635482] [INFO ] [REMOTE ] HESM: Full fetch complete (68293 records). [2025-09-17T19:27:19.635705] [DEBUG] [VALIDATOR ] HESM: Validating primary data. [2025-09-17T19:27:20.044394] [DEBUG] [VALIDATOR ] HESM: All expected trading days are present. [2025-09-17T19:27:20.044531] [DEBUG] [VALIDATOR ] HESM: Primary data validation passed. [2025-09-17T19:27:20.045658] [INFO ] [MAIN ] HESM: Fetched primary data is valid. [2025-09-17T19:27:20.045728] [DEBUG] [LOCAL ] HESM: Saving primary data. [2025-09-17T19:27:20.047656] [DEBUG] [LOCAL ] HESM: Trimmed 68293 records to 48152 (keeping 200 days of data) [2025-09-17T19:27:20.366481] [DEBUG] [LOCAL ] HESM: Primary data saved (48152 records). [2025-09-17T19:27:20.366700] [INFO ] [MAIN ] HESM: Full history saved. [2025-09-17T19:27:20.367515] [INFO ] [MAIN ] Update Progress: 1009/2371 symbols completed. HESM took 49.9s. Estimated remaining: 3h 18m 51s. Rate: 6.8 symbols/min [2025-09-17T19:27:20.424231] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-06. [2025-09-17T19:27:20.557277] [INFO ] [MAIN ] HGTY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:27:20.569595] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T19:27:20.587631] [DEBUG] [LOCAL ] HGTY: Loaded 12626 existing records from primary storage. [2025-09-17T19:27:20.587840] [INFO ] [MAIN ] HGTY: Loaded 12626 existing records. [2025-09-17T19:27:20.772101] [WARN ] [MAIN ] HGTY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:27:20.772516] [INFO ] [MAIN ] HGTY: Wiping existing primary data before full refresh. [2025-09-17T19:27:20.772584] [INFO ] [LOCAL ] HGTY: Starting deletion of primary data. [2025-09-17T19:27:20.773175] [DEBUG] [LOCAL ] HGTY: Deleted primary data file. [2025-09-17T19:27:20.773246] [INFO ] [MAIN ] HGTY: Starting full primary refresh. [2025-09-17T19:27:21.147890] [INFO ] [REMOTE ] HGTY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:27:21.148741] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T19:27:21.215811] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-07. [2025-09-17T19:27:21.983245] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T19:27:22.015726] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-08. [2025-09-17T19:27:22.574883] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T19:27:22.815831] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-11. [2025-09-17T19:27:23.506138] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T19:27:23.615794] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2024-12. [2025-09-17T19:27:24.382320] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T19:27:24.415735] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-01. [2025-09-17T19:27:25.190567] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T19:27:25.215789] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-02. [2025-09-17T19:27:25.792209] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T19:27:26.015797] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-05. [2025-09-17T19:27:26.796120] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T19:27:26.815783] [INFO ] [REMOTE ] HGLB: Fetching primary data for 2025-09. [2025-09-17T19:27:27.330067] [INFO ] [REMOTE ] HGLB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T19:27:27.331982] [INFO ] [REMOTE ] HGLB: Full fetch complete (14237 records). [2025-09-17T19:27:27.332052] [DEBUG] [VALIDATOR ] HGLB: Validating primary data. [2025-09-17T19:27:27.620936] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-06. [2025-09-17T19:27:27.723593] [DEBUG] [VALIDATOR ] HGLB: All expected trading days are present. [2025-09-17T19:27:27.723748] [DEBUG] [VALIDATOR ] HGLB: Primary data validation passed. [2025-09-17T19:27:27.724361] [INFO ] [MAIN ] HGLB: Fetched primary data is valid. [2025-09-17T19:27:27.724404] [DEBUG] [LOCAL ] HGLB: Saving primary data. [2025-09-17T19:27:27.725364] [DEBUG] [LOCAL ] HGLB: Trimmed 14237 records to 9738 (keeping 200 days of data) [2025-09-17T19:27:27.790511] [DEBUG] [LOCAL ] HGLB: Primary data saved (9738 records). [2025-09-17T19:27:27.790735] [INFO ] [MAIN ] HGLB: Full history saved. [2025-09-17T19:27:27.790848] [INFO ] [MAIN ] Update Progress: 1010/2371 symbols completed. HGLB took 22.5s. Estimated remaining: 3h 18m 40s. Rate: 6.9 symbols/min [2025-09-17T19:27:27.971294] [INFO ] [MAIN ] HGV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:27:28.018268] [DEBUG] [LOCAL ] HGV: Loaded 47137 existing records from primary storage. [2025-09-17T19:27:28.018541] [INFO ] [MAIN ] HGV: Loaded 47137 existing records. [2025-09-17T19:27:28.219463] [WARN ] [MAIN ] HGV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:27:28.219940] [INFO ] [MAIN ] HGV: Wiping existing primary data before full refresh. [2025-09-17T19:27:28.219993] [INFO ] [LOCAL ] HGV: Starting deletion of primary data. [2025-09-17T19:27:28.221475] [DEBUG] [LOCAL ] HGV: Deleted primary data file. [2025-09-17T19:27:28.221537] [INFO ] [MAIN ] HGV: Starting full primary refresh. [2025-09-17T19:27:28.423371] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-07. [2025-09-17T19:27:28.528606] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T19:27:28.600892] [INFO ] [REMOTE ] HGV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:27:29.215782] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-11. [2025-09-17T19:27:29.645771] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T19:27:30.015789] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-08. [2025-09-17T19:27:30.713492] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T19:27:30.815784] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-03. [2025-09-17T19:27:31.106692] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T19:27:31.294154] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T19:27:31.615794] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-04. [2025-09-17T19:27:32.374180] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T19:27:32.415727] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-05. [2025-09-17T19:27:33.199321] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T19:27:33.215680] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-06. [2025-09-17T19:27:34.015805] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-07. [2025-09-17T19:27:34.027432] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T19:27:34.815792] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-07. [2025-09-17T19:27:35.024715] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T19:27:35.442871] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T19:27:35.615774] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-08. [2025-09-17T19:27:36.415770] [INFO ] [REMOTE ] HGV: Fetching primary data for 2024-12. [2025-09-17T19:27:36.654198] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T19:27:37.215795] [INFO ] [REMOTE ] HFRO: Fetching primary data for 2025-09. [2025-09-17T19:27:37.785913] [INFO ] [REMOTE ] HFRO: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:27:37.789303] [INFO ] [REMOTE ] HFRO: Full fetch complete (28894 records). [2025-09-17T19:27:37.809664] [DEBUG] [VALIDATOR ] HFRO: Validating primary data. [2025-09-17T19:27:37.816775] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T19:27:38.021680] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-08. [2025-09-17T19:27:38.197487] [DEBUG] [VALIDATOR ] HFRO: All expected trading days are present. [2025-09-17T19:27:38.197562] [DEBUG] [VALIDATOR ] HFRO: Primary data validation passed. [2025-09-17T19:27:38.198085] [INFO ] [MAIN ] HFRO: Fetched primary data is valid. [2025-09-17T19:27:38.198127] [DEBUG] [LOCAL ] HFRO: Saving primary data. [2025-09-17T19:27:38.198789] [DEBUG] [LOCAL ] HFRO: Trimmed 28894 records to 17516 (keeping 200 days of data) [2025-09-17T19:27:38.301178] [DEBUG] [LOCAL ] HFRO: Primary data saved (17516 records). [2025-09-17T19:27:38.301325] [INFO ] [MAIN ] HFRO: Full history saved. [2025-09-17T19:27:38.301418] [INFO ] [MAIN ] Update Progress: 1011/2371 symbols completed. HFRO took 54.9s. Estimated remaining: 3h 18m 34s. Rate: 6.8 symbols/min [2025-09-17T19:27:38.472036] [INFO ] [MAIN ] HHH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:27:38.509321] [DEBUG] [LOCAL ] HHH: Loaded 32988 existing records from primary storage. [2025-09-17T19:27:38.509459] [INFO ] [MAIN ] HHH: Loaded 32988 existing records. [2025-09-17T19:27:38.699128] [WARN ] [MAIN ] HHH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:27:38.699395] [INFO ] [MAIN ] HHH: Wiping existing primary data before full refresh. [2025-09-17T19:27:38.699442] [INFO ] [LOCAL ] HHH: Starting deletion of primary data. [2025-09-17T19:27:38.700335] [DEBUG] [LOCAL ] HHH: Deleted primary data file. [2025-09-17T19:27:38.700394] [INFO ] [MAIN ] HHH: Starting full primary refresh. [2025-09-17T19:27:38.815801] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-01. [2025-09-17T19:27:39.104799] [INFO ] [REMOTE ] HHH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:27:39.106856] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T19:27:39.615802] [INFO ] [REMOTE ] HGTY: Fetching primary data for 2025-09. [2025-09-17T19:27:40.086920] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T19:27:40.250784] [INFO ] [REMOTE ] HGTY: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T19:27:40.254231] [INFO ] [REMOTE ] HGTY: Full fetch complete (16929 records). [2025-09-17T19:27:40.254302] [DEBUG] [VALIDATOR ] HGTY: Validating primary data. [2025-09-17T19:27:40.427042] [INFO ] [REMOTE ] HGER: Fetching primary data for 2025-09. [2025-09-17T19:27:40.617682] [DEBUG] [VALIDATOR ] HGTY: All expected trading days are present. [2025-09-17T19:27:40.617758] [DEBUG] [VALIDATOR ] HGTY: Primary data validation passed. [2025-09-17T19:27:40.618113] [INFO ] [MAIN ] HGTY: Fetched primary data is valid. [2025-09-17T19:27:40.618151] [DEBUG] [LOCAL ] HGTY: Saving primary data. [2025-09-17T19:27:40.618684] [DEBUG] [LOCAL ] HGTY: Trimmed 16929 records to 12830 (keeping 200 days of data) [2025-09-17T19:27:40.694003] [DEBUG] [LOCAL ] HGTY: Primary data saved (12830 records). [2025-09-17T19:27:40.694162] [INFO ] [MAIN ] HGTY: Full history saved. [2025-09-17T19:27:40.694261] [INFO ] [MAIN ] Update Progress: 1012/2371 symbols completed. HGTY took 20.3s. Estimated remaining: 3h 18m 16s. Rate: 6.9 symbols/min [2025-09-17T19:27:40.877776] [INFO ] [MAIN ] HI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:27:40.915982] [DEBUG] [LOCAL ] HI: Loaded 35100 existing records from primary storage. [2025-09-17T19:27:40.916152] [INFO ] [MAIN ] HI: Loaded 35100 existing records. [2025-09-17T19:27:41.096175] [WARN ] [MAIN ] HI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:27:41.103167] [INFO ] [MAIN ] HI: Wiping existing primary data before full refresh. [2025-09-17T19:27:41.103932] [INFO ] [REMOTE ] HGER: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T19:27:41.103687] [INFO ] [LOCAL ] HI: Starting deletion of primary data. [2025-09-17T19:27:41.107007] [INFO ] [REMOTE ] HGER: Full fetch complete (15602 records). [2025-09-17T19:27:41.107075] [DEBUG] [VALIDATOR ] HGER: Validating primary data. [2025-09-17T19:27:41.138943] [DEBUG] [LOCAL ] HI: Deleted primary data file. [2025-09-17T19:27:41.177501] [INFO ] [MAIN ] HI: Starting full primary refresh. [2025-09-17T19:27:41.220803] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-02. [2025-09-17T19:27:41.874787] [DEBUG] [VALIDATOR ] HGER: All expected trading days are present. [2025-09-17T19:27:41.886388] [DEBUG] [VALIDATOR ] HGER: Primary data validation passed. [2025-09-17T19:27:41.887458] [INFO ] [MAIN ] HGER: Fetched primary data is valid. [2025-09-17T19:27:41.887550] [DEBUG] [LOCAL ] HGER: Saving primary data. [2025-09-17T19:27:41.899210] [DEBUG] [LOCAL ] HGER: Trimmed 15602 records to 12589 (keeping 200 days of data) [2025-09-17T19:27:41.979152] [INFO ] [REMOTE ] HI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:27:42.019131] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-11. [2025-09-17T19:27:42.095092] [DEBUG] [LOCAL ] HGER: Primary data saved (12589 records). [2025-09-17T19:27:42.095316] [INFO ] [MAIN ] HGER: Full history saved. [2025-09-17T19:27:42.095440] [INFO ] [MAIN ] Update Progress: 1013/2371 symbols completed. HGER took 39.8s. Estimated remaining: 3h 17m 58s. Rate: 6.9 symbols/min [2025-09-17T19:27:42.368920] [INFO ] [MAIN ] HIG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:27:42.458582] [DEBUG] [LOCAL ] HIG: Loaded 51311 existing records from primary storage. [2025-09-17T19:27:42.458846] [INFO ] [MAIN ] HIG: Loaded 51311 existing records. [2025-09-17T19:27:42.668626] [WARN ] [MAIN ] HIG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:27:42.669027] [INFO ] [MAIN ] HIG: Wiping existing primary data before full refresh. [2025-09-17T19:27:42.669227] [INFO ] [LOCAL ] HIG: Starting deletion of primary data. [2025-09-17T19:27:42.670752] [DEBUG] [LOCAL ] HIG: Deleted primary data file. [2025-09-17T19:27:42.670816] [INFO ] [MAIN ] HIG: Starting full primary refresh. [2025-09-17T19:27:42.826045] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-11. [2025-09-17T19:27:42.962075] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T19:27:43.088370] [INFO ] [REMOTE ] HIG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:27:43.157729] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T19:27:43.615780] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-11. [2025-09-17T19:27:43.939302] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T19:27:44.415817] [INFO ] [REMOTE ] HI: Fetching primary data for 2024-12. [2025-09-17T19:27:45.215811] [INFO ] [REMOTE ] HHH: Fetching primary data for 2024-12. [2025-09-17T19:27:45.270819] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T19:27:45.355794] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T19:27:46.015804] [INFO ] [REMOTE ] HIG: Fetching primary data for 2024-12. [2025-09-17T19:27:46.041234] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T19:27:46.815832] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-01. [2025-09-17T19:27:47.349958] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T19:27:47.615818] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-03. [2025-09-17T19:27:48.093250] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T19:27:48.415784] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-01. [2025-09-17T19:27:49.179376] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T19:27:49.215758] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-04. [2025-09-17T19:27:49.804665] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T19:27:50.015819] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-01. [2025-09-17T19:27:50.617527] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T19:27:50.815822] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-02. [2025-09-17T19:27:51.375394] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T19:27:51.615797] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-02. [2025-09-17T19:27:52.048906] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T19:27:52.415788] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-03. [2025-09-17T19:27:52.962026] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T19:27:53.215794] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-03. [2025-09-17T19:27:54.026233] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-02. [2025-09-17T19:27:54.032033] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T19:27:54.646436] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T19:27:54.815786] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-04. [2025-09-17T19:27:55.324926] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T19:27:55.615781] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-05. [2025-09-17T19:27:56.253159] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T19:27:56.415828] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-05. [2025-09-17T19:27:56.766723] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T19:27:57.215800] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-06. [2025-09-17T19:27:58.009427] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T19:27:58.020488] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-04. [2025-09-17T19:27:58.760262] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T19:27:58.815817] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-03. [2025-09-17T19:27:59.615816] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-06. [2025-09-17T19:27:59.843299] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T19:27:59.949810] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T19:28:00.415815] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-05. [2025-09-17T19:28:00.983849] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T19:28:01.215797] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-04. [2025-09-17T19:28:02.015817] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-07. [2025-09-17T19:28:02.324348] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T19:28:02.470905] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T19:28:02.815808] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-06. [2025-09-17T19:28:03.292209] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T19:28:03.615805] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-08. [2025-09-17T19:28:04.110163] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T19:28:04.415834] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-07. [2025-09-17T19:28:05.090320] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T19:28:05.215826] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-07. [2025-09-17T19:28:06.015792] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-05. [2025-09-17T19:28:06.138113] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T19:28:06.815798] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-08. [2025-09-17T19:28:07.127061] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T19:28:07.615836] [INFO ] [REMOTE ] HI: Fetching primary data for 2025-09. [2025-09-17T19:28:07.688511] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T19:28:08.299539] [INFO ] [REMOTE ] HI: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T19:28:08.303910] [INFO ] [REMOTE ] HI: Full fetch complete (49509 records). [2025-09-17T19:28:08.304065] [DEBUG] [VALIDATOR ] HI: Validating primary data. [2025-09-17T19:28:08.420156] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-08. [2025-09-17T19:28:08.651812] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T19:28:08.752793] [DEBUG] [VALIDATOR ] HI: All expected trading days are present. [2025-09-17T19:28:08.752887] [DEBUG] [VALIDATOR ] HI: Primary data validation passed. [2025-09-17T19:28:08.753598] [INFO ] [MAIN ] HI: Fetched primary data is valid. [2025-09-17T19:28:08.753694] [DEBUG] [LOCAL ] HI: Saving primary data. [2025-09-17T19:28:08.755363] [DEBUG] [LOCAL ] HI: Trimmed 49509 records to 35077 (keeping 200 days of data) [2025-09-17T19:28:08.987916] [DEBUG] [LOCAL ] HI: Primary data saved (35077 records). [2025-09-17T19:28:08.988076] [INFO ] [MAIN ] HI: Full history saved. [2025-09-17T19:28:08.988915] [INFO ] [MAIN ] Update Progress: 1014/2371 symbols completed. HI took 28.3s. Estimated remaining: 3h 18m 13s. Rate: 6.8 symbols/min [2025-09-17T19:28:09.160179] [INFO ] [MAIN ] HII: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:28:09.209699] [DEBUG] [LOCAL ] HII: Loaded 35819 existing records from primary storage. [2025-09-17T19:28:09.209866] [INFO ] [MAIN ] HII: Loaded 35819 existing records. [2025-09-17T19:28:09.221029] [INFO ] [REMOTE ] HGV: Fetching primary data for 2025-09. [2025-09-17T19:28:09.396350] [WARN ] [MAIN ] HII: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:28:09.396626] [INFO ] [MAIN ] HII: Wiping existing primary data before full refresh. [2025-09-17T19:28:09.396693] [INFO ] [LOCAL ] HII: Starting deletion of primary data. [2025-09-17T19:28:09.397517] [DEBUG] [LOCAL ] HII: Deleted primary data file. [2025-09-17T19:28:09.397575] [INFO ] [MAIN ] HII: Starting full primary refresh. [2025-09-17T19:28:09.764770] [INFO ] [REMOTE ] HII: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:28:10.012419] [INFO ] [REMOTE ] HGV: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T19:28:10.017840] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-06. [2025-09-17T19:28:10.020122] [INFO ] [REMOTE ] HGV: Full fetch complete (65645 records). [2025-09-17T19:28:10.020246] [DEBUG] [VALIDATOR ] HGV: Validating primary data. [2025-09-17T19:28:10.433663] [DEBUG] [VALIDATOR ] HGV: All expected trading days are present. [2025-09-17T19:28:10.433923] [DEBUG] [VALIDATOR ] HGV: Primary data validation passed. [2025-09-17T19:28:10.435009] [INFO ] [MAIN ] HGV: Fetched primary data is valid. [2025-09-17T19:28:10.435127] [DEBUG] [LOCAL ] HGV: Saving primary data. [2025-09-17T19:28:10.436988] [DEBUG] [LOCAL ] HGV: Trimmed 65645 records to 47129 (keeping 200 days of data) [2025-09-17T19:28:10.559103] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T19:28:10.765089] [DEBUG] [LOCAL ] HGV: Primary data saved (47129 records). [2025-09-17T19:28:10.765236] [INFO ] [MAIN ] HGV: Full history saved. [2025-09-17T19:28:10.765338] [INFO ] [MAIN ] Update Progress: 1015/2371 symbols completed. HGV took 43.0s. Estimated remaining: 3h 17m 55s. Rate: 6.9 symbols/min [2025-09-17T19:28:10.827728] [INFO ] [REMOTE ] HIG: Fetching primary data for 2025-09. [2025-09-17T19:28:10.937056] [INFO ] [MAIN ] HIMS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:28:10.989360] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-17T19:28:10.989513] [INFO ] [MAIN ] HIMS: Loaded 53817 existing records. [2025-09-17T19:28:11.166178] [WARN ] [MAIN ] HIMS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:28:11.166466] [INFO ] [MAIN ] HIMS: Wiping existing primary data before full refresh. [2025-09-17T19:28:11.166530] [INFO ] [LOCAL ] HIMS: Starting deletion of primary data. [2025-09-17T19:28:11.167553] [DEBUG] [LOCAL ] HIMS: Deleted primary data file. [2025-09-17T19:28:11.167620] [INFO ] [MAIN ] HIMS: Starting full primary refresh. [2025-09-17T19:28:11.534214] [INFO ] [REMOTE ] HIMS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:28:11.593968] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T19:28:11.615790] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-07. [2025-09-17T19:28:11.687028] [INFO ] [REMOTE ] HIG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T19:28:11.693964] [INFO ] [REMOTE ] HIG: Full fetch complete (73101 records). [2025-09-17T19:28:11.694087] [DEBUG] [VALIDATOR ] HIG: Validating primary data. [2025-09-17T19:28:12.086719] [DEBUG] [VALIDATOR ] HIG: All expected trading days are present. [2025-09-17T19:28:12.086839] [DEBUG] [VALIDATOR ] HIG: Primary data validation passed. [2025-09-17T19:28:12.088285] [INFO ] [MAIN ] HIG: Fetched primary data is valid. [2025-09-17T19:28:12.088342] [DEBUG] [LOCAL ] HIG: Saving primary data. [2025-09-17T19:28:12.090982] [DEBUG] [LOCAL ] HIG: Trimmed 73101 records to 51306 (keeping 200 days of data) [2025-09-17T19:28:12.420714] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-11. [2025-09-17T19:28:12.467116] [DEBUG] [LOCAL ] HIG: Primary data saved (51306 records). [2025-09-17T19:28:12.467371] [INFO ] [MAIN ] HIG: Full history saved. [2025-09-17T19:28:12.467563] [INFO ] [MAIN ] Update Progress: 1016/2371 symbols completed. HIG took 30.4s. Estimated remaining: 3h 17m 37s. Rate: 6.9 symbols/min [2025-09-17T19:28:12.669356] [INFO ] [MAIN ] HIO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:28:12.696048] [DEBUG] [LOCAL ] HIO: Loaded 24130 existing records from primary storage. [2025-09-17T19:28:12.696247] [INFO ] [MAIN ] HIO: Loaded 24130 existing records. [2025-09-17T19:28:12.890572] [WARN ] [MAIN ] HIO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:28:12.890988] [INFO ] [MAIN ] HIO: Wiping existing primary data before full refresh. [2025-09-17T19:28:12.891037] [INFO ] [LOCAL ] HIO: Starting deletion of primary data. [2025-09-17T19:28:12.891885] [DEBUG] [LOCAL ] HIO: Deleted primary data file. [2025-09-17T19:28:12.891938] [INFO ] [MAIN ] HIO: Starting full primary refresh. [2025-09-17T19:28:13.216917] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-11. [2025-09-17T19:28:13.286513] [INFO ] [REMOTE ] HIO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:28:13.309776] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T19:28:14.015781] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-08. [2025-09-17T19:28:14.784354] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-11 (2.36 seconds). [2025-09-17T19:28:14.815767] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2024-12. [2025-09-17T19:28:14.980207] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T19:28:15.011349] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T19:28:15.615814] [INFO ] [REMOTE ] HII: Fetching primary data for 2024-12. [2025-09-17T19:28:16.415826] [INFO ] [REMOTE ] HHH: Fetching primary data for 2025-09. [2025-09-17T19:28:17.158178] [INFO ] [REMOTE ] HHH: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T19:28:17.194023] [INFO ] [REMOTE ] HHH: Full fetch complete (44741 records). [2025-09-17T19:28:17.194292] [DEBUG] [VALIDATOR ] HHH: Validating primary data. [2025-09-17T19:28:17.203187] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T19:28:17.220705] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-11. [2025-09-17T19:28:17.618248] [DEBUG] [VALIDATOR ] HHH: All expected trading days are present. [2025-09-17T19:28:17.618384] [DEBUG] [VALIDATOR ] HHH: Primary data validation passed. [2025-09-17T19:28:17.619155] [INFO ] [MAIN ] HHH: Fetched primary data is valid. [2025-09-17T19:28:17.619235] [DEBUG] [LOCAL ] HHH: Saving primary data. [2025-09-17T19:28:17.651452] [DEBUG] [LOCAL ] HHH: Trimmed 44741 records to 32891 (keeping 200 days of data) [2025-09-17T19:28:17.653511] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2024-12 (2.84 seconds). [2025-09-17T19:28:17.876258] [DEBUG] [LOCAL ] HHH: Primary data saved (32891 records). [2025-09-17T19:28:17.876442] [INFO ] [MAIN ] HHH: Full history saved. [2025-09-17T19:28:17.876569] [INFO ] [MAIN ] Update Progress: 1017/2371 symbols completed. HHH took 39.6s. Estimated remaining: 3h 17m 24s. Rate: 6.9 symbols/min [2025-09-17T19:28:18.020894] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-01. [2025-09-17T19:28:18.051617] [INFO ] [MAIN ] HIPO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:28:18.074834] [DEBUG] [LOCAL ] HIPO: Loaded 22908 existing records from primary storage. [2025-09-17T19:28:18.075055] [INFO ] [MAIN ] HIPO: Loaded 22908 existing records. [2025-09-17T19:28:18.258169] [WARN ] [MAIN ] HIPO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:28:18.258663] [INFO ] [MAIN ] HIPO: Wiping existing primary data before full refresh. [2025-09-17T19:28:18.258740] [INFO ] [LOCAL ] HIPO: Starting deletion of primary data. [2025-09-17T19:28:18.264613] [DEBUG] [LOCAL ] HIPO: Deleted primary data file. [2025-09-17T19:28:18.272388] [INFO ] [MAIN ] HIPO: Starting full primary refresh. [2025-09-17T19:28:18.339350] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T19:28:18.633525] [INFO ] [REMOTE ] HIPO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:28:18.815790] [INFO ] [REMOTE ] HIO: Fetching primary data for 2024-12. [2025-09-17T19:28:19.615826] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-01. [2025-09-17T19:28:19.966998] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T19:28:20.313229] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-17T19:28:20.415782] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-02. [2025-09-17T19:28:21.114941] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T19:28:21.215780] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-02. [2025-09-17T19:28:22.015784] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-01. [2025-09-17T19:28:22.815764] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-11. [2025-09-17T19:28:22.886082] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T19:28:22.966842] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-17T19:28:22.994930] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T19:28:23.615751] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-03. [2025-09-17T19:28:23.786287] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T19:28:24.415779] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2024-12. [2025-09-17T19:28:25.215800] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-03. [2025-09-17T19:28:25.486812] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T19:28:26.015775] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-01. [2025-09-17T19:28:26.231092] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-17T19:28:26.696835] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T19:28:26.815787] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-02. [2025-09-17T19:28:26.844068] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T19:28:27.615763] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-02. [2025-09-17T19:28:28.036926] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T19:28:28.415780] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-04. [2025-09-17T19:28:28.673034] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T19:28:29.215805] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-03. [2025-09-17T19:28:30.015826] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-03. [2025-09-17T19:28:30.304415] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T19:28:30.815747] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-04. [2025-09-17T19:28:30.997959] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T19:28:31.119666] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-17T19:28:31.615744] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-04. [2025-09-17T19:28:31.990512] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T19:28:32.415778] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-05. [2025-09-17T19:28:33.111434] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T19:28:33.215846] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-04. [2025-09-17T19:28:34.015790] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-05. [2025-09-17T19:28:34.355292] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T19:28:34.752464] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-17T19:28:34.815779] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-05. [2025-09-17T19:28:35.531401] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T19:28:35.604681] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T19:28:35.615688] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-06. [2025-09-17T19:28:36.415791] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-06. [2025-09-17T19:28:37.136375] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T19:28:37.215842] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-07. [2025-09-17T19:28:38.015799] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-06. [2025-09-17T19:28:38.661573] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T19:28:38.815890] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-08. [2025-09-17T19:28:39.060112] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-06 (2.64 seconds). [2025-09-17T19:28:39.229452] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T19:28:39.615868] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-07. [2025-09-17T19:28:39.863125] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T19:28:40.338863] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T19:28:40.415851] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-07. [2025-09-17T19:28:41.215837] [INFO ] [REMOTE ] HII: Fetching primary data for 2025-09. [2025-09-17T19:28:41.920480] [INFO ] [REMOTE ] HII: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:28:41.927144] [INFO ] [REMOTE ] HII: Full fetch complete (53391 records). [2025-09-17T19:28:41.927348] [DEBUG] [VALIDATOR ] HII: Validating primary data. [2025-09-17T19:28:42.022684] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-05. [2025-09-17T19:28:42.322030] [DEBUG] [VALIDATOR ] HII: All expected trading days are present. [2025-09-17T19:28:42.322123] [DEBUG] [VALIDATOR ] HII: Primary data validation passed. [2025-09-17T19:28:42.322927] [INFO ] [MAIN ] HII: Fetched primary data is valid. [2025-09-17T19:28:42.322974] [DEBUG] [LOCAL ] HII: Saving primary data. [2025-09-17T19:28:42.324086] [DEBUG] [LOCAL ] HII: Trimmed 53391 records to 35736 (keeping 200 days of data) [2025-09-17T19:28:42.552492] [DEBUG] [LOCAL ] HII: Primary data saved (35736 records). [2025-09-17T19:28:42.552651] [INFO ] [MAIN ] HII: Full history saved. [2025-09-17T19:28:42.553514] [INFO ] [MAIN ] Update Progress: 1018/2371 symbols completed. HII took 33.6s. Estimated remaining: 3h 17m 36s. Rate: 6.8 symbols/min [2025-09-17T19:28:42.741694] [INFO ] [MAIN ] HIW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:28:42.789767] [DEBUG] [LOCAL ] HIW: Loaded 44891 existing records from primary storage. [2025-09-17T19:28:42.789922] [INFO ] [MAIN ] HIW: Loaded 44891 existing records. [2025-09-17T19:28:42.821056] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-08. [2025-09-17T19:28:42.972231] [WARN ] [MAIN ] HIW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:28:42.972555] [INFO ] [MAIN ] HIW: Wiping existing primary data before full refresh. [2025-09-17T19:28:42.972706] [INFO ] [LOCAL ] HIW: Starting deletion of primary data. [2025-09-17T19:28:42.979308] [DEBUG] [LOCAL ] HIW: Deleted primary data file. [2025-09-17T19:28:42.985901] [INFO ] [MAIN ] HIW: Starting full primary refresh. [2025-09-17T19:28:42.992353] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T19:28:43.372811] [INFO ] [REMOTE ] HIW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:28:43.424086] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-07 (3.01 seconds). [2025-09-17T19:28:43.615810] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-11. [2025-09-17T19:28:44.099879] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T19:28:44.415843] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-06. [2025-09-17T19:28:45.108022] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T19:28:45.215805] [INFO ] [REMOTE ] HIW: Fetching primary data for 2024-12. [2025-09-17T19:28:45.739403] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T19:28:46.015792] [INFO ] [REMOTE ] HIO: Fetching primary data for 2025-09. [2025-09-17T19:28:46.393797] [INFO ] [REMOTE ] HIO: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T19:28:46.397696] [INFO ] [REMOTE ] HIO: Full fetch complete (36886 records). [2025-09-17T19:28:46.397777] [DEBUG] [VALIDATOR ] HIO: Validating primary data. [2025-09-17T19:28:46.780521] [DEBUG] [VALIDATOR ] HIO: All expected trading days are present. [2025-09-17T19:28:46.780771] [DEBUG] [VALIDATOR ] HIO: Primary data validation passed. [2025-09-17T19:28:46.781560] [INFO ] [MAIN ] HIO: Fetched primary data is valid. [2025-09-17T19:28:46.781618] [DEBUG] [LOCAL ] HIO: Saving primary data. [2025-09-17T19:28:46.782622] [DEBUG] [LOCAL ] HIO: Trimmed 36886 records to 24117 (keeping 200 days of data) [2025-09-17T19:28:46.844058] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-08. [2025-09-17T19:28:46.903874] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T19:28:46.970433] [DEBUG] [LOCAL ] HIO: Primary data saved (24117 records). [2025-09-17T19:28:46.970597] [INFO ] [MAIN ] HIO: Full history saved. [2025-09-17T19:28:46.970723] [INFO ] [MAIN ] Update Progress: 1019/2371 symbols completed. HIO took 34.5s. Estimated remaining: 3h 17m 22s. Rate: 6.9 symbols/min [2025-09-17T19:28:47.141021] [INFO ] [MAIN ] HIX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:28:47.160471] [DEBUG] [LOCAL ] HIX: Loaded 20301 existing records from primary storage. [2025-09-17T19:28:47.160620] [INFO ] [MAIN ] HIX: Loaded 20301 existing records. [2025-09-17T19:28:47.337471] [WARN ] [MAIN ] HIX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:28:47.337737] [INFO ] [MAIN ] HIX: Wiping existing primary data before full refresh. [2025-09-17T19:28:47.337787] [INFO ] [LOCAL ] HIX: Starting deletion of primary data. [2025-09-17T19:28:47.338335] [DEBUG] [LOCAL ] HIX: Deleted primary data file. [2025-09-17T19:28:47.338382] [INFO ] [MAIN ] HIX: Starting full primary refresh. [2025-09-17T19:28:47.620929] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-07. [2025-09-17T19:28:47.706930] [INFO ] [REMOTE ] HIX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:28:48.415768] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-01. [2025-09-17T19:28:48.432497] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T19:28:49.215819] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-11. [2025-09-17T19:28:49.670510] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-08 (2.83 seconds). [2025-09-17T19:28:49.891696] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T19:28:49.991013] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T19:28:50.015803] [INFO ] [REMOTE ] HIMS: Fetching primary data for 2025-09. [2025-09-17T19:28:50.815879] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-08. [2025-09-17T19:28:50.819357] [INFO ] [REMOTE ] HIMS: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T19:28:50.826951] [INFO ] [REMOTE ] HIMS: Full fetch complete (77909 records). [2025-09-17T19:28:50.827169] [DEBUG] [VALIDATOR ] HIMS: Validating primary data. [2025-09-17T19:28:51.224978] [DEBUG] [VALIDATOR ] HIMS: All expected trading days are present. [2025-09-17T19:28:51.225061] [DEBUG] [VALIDATOR ] HIMS: Primary data validation passed. [2025-09-17T19:28:51.226072] [INFO ] [MAIN ] HIMS: Fetched primary data is valid. [2025-09-17T19:28:51.226119] [DEBUG] [LOCAL ] HIMS: Saving primary data. [2025-09-17T19:28:51.227672] [DEBUG] [LOCAL ] HIMS: Trimmed 77909 records to 53817 (keeping 200 days of data) [2025-09-17T19:28:51.555038] [DEBUG] [LOCAL ] HIMS: Primary data saved (53817 records). [2025-09-17T19:28:51.555197] [INFO ] [MAIN ] HIMS: Full history saved. [2025-09-17T19:28:51.555287] [INFO ] [MAIN ] Update Progress: 1020/2371 symbols completed. HIMS took 40.8s. Estimated remaining: 3h 17m 7s. Rate: 6.9 symbols/min [2025-09-17T19:28:51.621049] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-02. [2025-09-17T19:28:51.729408] [INFO ] [MAIN ] HKD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:28:51.729627] [DEBUG] [LOCAL ] HKD: No existing data file found in primary storage. [2025-09-17T19:28:51.729684] [WARN ] [MAIN ] HKD: No existing data found, performing full refresh instead. [2025-09-17T19:28:51.729809] [INFO ] [MAIN ] HKD: Wiping existing primary data before full refresh. [2025-09-17T19:28:51.729847] [INFO ] [LOCAL ] HKD: Starting deletion of primary data. [2025-09-17T19:28:51.729892] [DEBUG] [LOCAL ] HKD: No primary data file found to delete. [2025-09-17T19:28:51.729924] [INFO ] [MAIN ] HKD: Starting full primary refresh. [2025-09-17T19:28:52.093379] [INFO ] [REMOTE ] HKD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:28:52.110331] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T19:28:52.415831] [INFO ] [REMOTE ] HIX: Fetching primary data for 2024-12. [2025-09-17T19:28:53.215768] [INFO ] [REMOTE ] HIPO: Fetching primary data for 2025-09. [2025-09-17T19:28:53.310196] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T19:28:53.627891] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T19:28:53.917283] [INFO ] [REMOTE ] HIPO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:28:53.921504] [INFO ] [REMOTE ] HIPO: Full fetch complete (31787 records). [2025-09-17T19:28:53.921715] [DEBUG] [VALIDATOR ] HIPO: Validating primary data. [2025-09-17T19:28:54.020896] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-01. [2025-09-17T19:28:54.333230] [DEBUG] [VALIDATOR ] HIPO: All expected trading days are present. [2025-09-17T19:28:54.333353] [DEBUG] [VALIDATOR ] HIPO: Primary data validation passed. [2025-09-17T19:28:54.334219] [INFO ] [MAIN ] HIPO: Fetched primary data is valid. [2025-09-17T19:28:54.334277] [DEBUG] [LOCAL ] HIPO: Saving primary data. [2025-09-17T19:28:54.335677] [DEBUG] [LOCAL ] HIPO: Trimmed 31787 records to 22987 (keeping 200 days of data) [2025-09-17T19:28:54.505246] [DEBUG] [LOCAL ] HIPO: Primary data saved (22987 records). [2025-09-17T19:28:54.505549] [INFO ] [MAIN ] HIPO: Full history saved. [2025-09-17T19:28:54.505753] [INFO ] [MAIN ] Update Progress: 1021/2371 symbols completed. HIPO took 36.6s. Estimated remaining: 3h 16m 51s. Rate: 6.9 symbols/min [2025-09-17T19:28:54.699851] [INFO ] [MAIN ] HL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:28:54.758449] [DEBUG] [LOCAL ] HL: Loaded 53670 existing records from primary storage. [2025-09-17T19:28:54.758654] [INFO ] [MAIN ] HL: Loaded 53670 existing records. [2025-09-17T19:28:54.823094] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-03. [2025-09-17T19:28:54.947555] [WARN ] [MAIN ] HL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:28:54.947863] [INFO ] [MAIN ] HL: Wiping existing primary data before full refresh. [2025-09-17T19:28:54.947912] [INFO ] [LOCAL ] HL: Starting deletion of primary data. [2025-09-17T19:28:54.949229] [DEBUG] [LOCAL ] HL: Deleted primary data file. [2025-09-17T19:28:54.949289] [INFO ] [MAIN ] HL: Starting full primary refresh. [2025-09-17T19:28:55.326409] [INFO ] [REMOTE ] HL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:28:55.343822] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T19:28:55.615801] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-11. [2025-09-17T19:28:56.416875] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-02. [2025-09-17T19:28:56.416757] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T19:28:57.215785] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-04. [2025-09-17T19:28:57.408478] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T19:28:57.536272] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T19:28:58.015794] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-11. [2025-09-17T19:28:58.773393] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T19:28:58.815744] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-05. [2025-09-17T19:28:58.904526] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T19:28:59.615830] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-03. [2025-09-17T19:29:00.060488] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T19:29:00.415839] [INFO ] [REMOTE ] HL: Fetching primary data for 2024-12. [2025-09-17T19:29:00.710979] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T19:29:01.215832] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-04. [2025-09-17T19:29:02.015787] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-06. [2025-09-17T19:29:02.187295] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T19:29:02.266557] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T19:29:02.815820] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-05. [2025-09-17T19:29:03.550191] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T19:29:03.606936] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T19:29:03.615690] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-06. [2025-09-17T19:29:04.415796] [INFO ] [REMOTE ] HKD: Fetching primary data for 2024-12. [2025-09-17T19:29:04.609919] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T19:29:05.215784] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-01. [2025-09-17T19:29:05.798566] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T19:29:06.015779] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-07. [2025-09-17T19:29:06.815792] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-07. [2025-09-17T19:29:07.004779] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T19:29:07.621884] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-01. [2025-09-17T19:29:07.638604] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T19:29:07.698143] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T19:29:08.415701] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-08. [2025-09-17T19:29:08.812798] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T19:29:09.215785] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-02. [2025-09-17T19:29:09.528356] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T19:29:10.015785] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-08. [2025-09-17T19:29:10.753111] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T19:29:10.815772] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-03. [2025-09-17T19:29:11.535127] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T19:29:11.615781] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-02. [2025-09-17T19:29:12.420867] [INFO ] [REMOTE ] HIX: Fetching primary data for 2025-09. [2025-09-17T19:29:12.438575] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T19:29:12.513714] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T19:29:13.154255] [INFO ] [REMOTE ] HIX: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T19:29:13.158333] [INFO ] [REMOTE ] HIX: Full fetch complete (30828 records). [2025-09-17T19:29:13.158521] [DEBUG] [VALIDATOR ] HIX: Validating primary data. [2025-09-17T19:29:13.226230] [INFO ] [REMOTE ] HIW: Fetching primary data for 2025-09. [2025-09-17T19:29:13.552361] [DEBUG] [VALIDATOR ] HIX: All expected trading days are present. [2025-09-17T19:29:13.552442] [DEBUG] [VALIDATOR ] HIX: Primary data validation passed. [2025-09-17T19:29:13.553016] [INFO ] [MAIN ] HIX: Fetched primary data is valid. [2025-09-17T19:29:13.553084] [DEBUG] [LOCAL ] HIX: Saving primary data. [2025-09-17T19:29:13.553831] [DEBUG] [LOCAL ] HIX: Trimmed 30828 records to 20273 (keeping 200 days of data) [2025-09-17T19:29:13.675928] [DEBUG] [LOCAL ] HIX: Primary data saved (20273 records). [2025-09-17T19:29:13.676053] [INFO ] [MAIN ] HIX: Full history saved. [2025-09-17T19:29:13.676145] [INFO ] [MAIN ] Update Progress: 1022/2371 symbols completed. HIX took 26.7s. Estimated remaining: 3h 16m 56s. Rate: 6.9 symbols/min [2025-09-17T19:29:13.848249] [INFO ] [MAIN ] HLF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:29:13.895128] [DEBUG] [LOCAL ] HLF: Loaded 48961 existing records from primary storage. [2025-09-17T19:29:13.895301] [INFO ] [MAIN ] HLF: Loaded 48961 existing records. [2025-09-17T19:29:14.020959] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-03. [2025-09-17T19:29:14.094014] [WARN ] [MAIN ] HLF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:29:14.094417] [INFO ] [MAIN ] HLF: Wiping existing primary data before full refresh. [2025-09-17T19:29:14.094529] [INFO ] [LOCAL ] HLF: Starting deletion of primary data. [2025-09-17T19:29:14.101132] [DEBUG] [LOCAL ] HLF: Deleted primary data file. [2025-09-17T19:29:14.110962] [INFO ] [MAIN ] HLF: Starting full primary refresh. [2025-09-17T19:29:14.183149] [INFO ] [REMOTE ] HIW: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T19:29:14.227832] [INFO ] [REMOTE ] HIW: Full fetch complete (64503 records). [2025-09-17T19:29:14.253877] [DEBUG] [VALIDATOR ] HIW: Validating primary data. [2025-09-17T19:29:14.774036] [INFO ] [REMOTE ] HLF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:29:14.820816] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-04. [2025-09-17T19:29:14.912593] [DEBUG] [VALIDATOR ] HIW: All expected trading days are present. [2025-09-17T19:29:14.912686] [DEBUG] [VALIDATOR ] HIW: Primary data validation passed. [2025-09-17T19:29:14.913479] [INFO ] [MAIN ] HIW: Fetched primary data is valid. [2025-09-17T19:29:14.913530] [DEBUG] [LOCAL ] HIW: Saving primary data. [2025-09-17T19:29:14.914908] [DEBUG] [LOCAL ] HIW: Trimmed 64503 records to 44886 (keeping 200 days of data) [2025-09-17T19:29:15.148760] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T19:29:15.210107] [DEBUG] [LOCAL ] HIW: Primary data saved (44886 records). [2025-09-17T19:29:15.210334] [INFO ] [MAIN ] HIW: Full history saved. [2025-09-17T19:29:15.211409] [INFO ] [MAIN ] Update Progress: 1023/2371 symbols completed. HIW took 32.7s. Estimated remaining: 3h 16m 38s. Rate: 6.9 symbols/min [2025-09-17T19:29:15.402285] [INFO ] [MAIN ] HLI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:29:15.447041] [DEBUG] [LOCAL ] HLI: Loaded 31508 existing records from primary storage. [2025-09-17T19:29:15.447286] [INFO ] [MAIN ] HLI: Loaded 31508 existing records. [2025-09-17T19:29:15.620910] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-11. [2025-09-17T19:29:15.664381] [WARN ] [MAIN ] HLI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:29:15.664749] [INFO ] [MAIN ] HLI: Wiping existing primary data before full refresh. [2025-09-17T19:29:15.664809] [INFO ] [LOCAL ] HLI: Starting deletion of primary data. [2025-09-17T19:29:15.665708] [DEBUG] [LOCAL ] HLI: Deleted primary data file. [2025-09-17T19:29:15.665790] [INFO ] [MAIN ] HLI: Starting full primary refresh. [2025-09-17T19:29:16.049621] [INFO ] [REMOTE ] HLI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:29:16.415855] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-11. [2025-09-17T19:29:16.825543] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T19:29:17.215782] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-05. [2025-09-17T19:29:17.366226] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T19:29:17.862840] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T19:29:18.015830] [INFO ] [REMOTE ] HLF: Fetching primary data for 2024-12. [2025-09-17T19:29:18.815768] [INFO ] [REMOTE ] HLI: Fetching primary data for 2024-12. [2025-09-17T19:29:18.953384] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T19:29:19.615864] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-04. [2025-09-17T19:29:19.672152] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T19:29:20.021765] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T19:29:20.415809] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-01. [2025-09-17T19:29:20.669064] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T19:29:21.215791] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-01. [2025-09-17T19:29:22.015992] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-05. [2025-09-17T19:29:22.142984] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T19:29:22.690181] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T19:29:22.815835] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-02. [2025-09-17T19:29:23.033106] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T19:29:23.615859] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-02. [2025-09-17T19:29:24.415809] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-06. [2025-09-17T19:29:24.611633] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T19:29:24.921026] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T19:29:25.215838] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-03. [2025-09-17T19:29:25.956623] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T19:29:26.015810] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-03. [2025-09-17T19:29:26.674096] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T19:29:26.815741] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-04. [2025-09-17T19:29:27.615833] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-07. [2025-09-17T19:29:27.738041] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T19:29:28.214093] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T19:29:28.415838] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-05. [2025-09-17T19:29:28.776947] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T19:29:29.215831] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-06. [2025-09-17T19:29:29.446617] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T19:29:30.015813] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-08. [2025-09-17T19:29:30.815766] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-04. [2025-09-17T19:29:30.954636] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T19:29:31.014430] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T19:29:31.615837] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-07. [2025-09-17T19:29:32.415913] [INFO ] [REMOTE ] HKD: Fetching primary data for 2025-09. [2025-09-17T19:29:32.603319] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T19:29:32.842285] [INFO ] [REMOTE ] HKD: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T19:29:32.845998] [INFO ] [REMOTE ] HKD: Full fetch complete (28528 records). [2025-09-17T19:29:32.846117] [DEBUG] [VALIDATOR ] HKD: Validating primary data. [2025-09-17T19:29:33.221607] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-06. [2025-09-17T19:29:33.258436] [DEBUG] [VALIDATOR ] HKD: All expected trading days are present. [2025-09-17T19:29:33.258573] [DEBUG] [VALIDATOR ] HKD: Primary data validation passed. [2025-09-17T19:29:33.259718] [INFO ] [MAIN ] HKD: Fetched primary data is valid. [2025-09-17T19:29:33.259882] [DEBUG] [LOCAL ] HKD: Saving primary data. [2025-09-17T19:29:33.261298] [DEBUG] [LOCAL ] HKD: Trimmed 28528 records to 17934 (keeping 200 days of data) [2025-09-17T19:29:33.387856] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T19:29:33.428490] [DEBUG] [LOCAL ] HKD: Primary data saved (17934 records). [2025-09-17T19:29:33.428738] [INFO ] [MAIN ] HKD: Full history saved. [2025-09-17T19:29:33.428850] [INFO ] [MAIN ] Update Progress: 1024/2371 symbols completed. HKD took 41.9s. Estimated remaining: 3h 16m 41s. Rate: 6.8 symbols/min [2025-09-17T19:29:33.608183] [INFO ] [MAIN ] HLIO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:29:33.638894] [DEBUG] [LOCAL ] HLIO: Loaded 28192 existing records from primary storage. [2025-09-17T19:29:33.639134] [INFO ] [MAIN ] HLIO: Loaded 28192 existing records. [2025-09-17T19:29:33.832844] [WARN ] [MAIN ] HLIO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:29:33.833259] [INFO ] [MAIN ] HLIO: Wiping existing primary data before full refresh. [2025-09-17T19:29:33.833312] [INFO ] [LOCAL ] HLIO: Starting deletion of primary data. [2025-09-17T19:29:33.834308] [DEBUG] [LOCAL ] HLIO: Deleted primary data file. [2025-09-17T19:29:33.834372] [INFO ] [MAIN ] HLIO: Starting full primary refresh. [2025-09-17T19:29:34.017853] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-05. [2025-09-17T19:29:34.276193] [INFO ] [REMOTE ] HLIO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:29:34.595527] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T19:29:34.815885] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-11. [2025-09-17T19:29:35.615799] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-08. [2025-09-17T19:29:35.885455] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T19:29:35.887207] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T19:29:36.415877] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2024-12. [2025-09-17T19:29:37.215826] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-06. [2025-09-17T19:29:37.417223] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T19:29:37.706984] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-17T19:29:38.015836] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-01. [2025-09-17T19:29:38.555981] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T19:29:38.815913] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-07. [2025-09-17T19:29:39.101362] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T19:29:39.615985] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-02. [2025-09-17T19:29:40.020541] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T19:29:40.415852] [INFO ] [REMOTE ] HL: Fetching primary data for 2025-09. [2025-09-17T19:29:40.714876] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T19:29:41.215850] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-07. [2025-09-17T19:29:41.348509] [INFO ] [REMOTE ] HL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T19:29:41.357606] [INFO ] [REMOTE ] HL: Full fetch complete (77520 records). [2025-09-17T19:29:41.357857] [DEBUG] [VALIDATOR ] HL: Validating primary data. [2025-09-17T19:29:41.787732] [DEBUG] [VALIDATOR ] HL: All expected trading days are present. [2025-09-17T19:29:41.787863] [DEBUG] [VALIDATOR ] HL: Primary data validation passed. [2025-09-17T19:29:41.789016] [INFO ] [MAIN ] HL: Fetched primary data is valid. [2025-09-17T19:29:41.789114] [DEBUG] [LOCAL ] HL: Saving primary data. [2025-09-17T19:29:41.791325] [DEBUG] [LOCAL ] HL: Trimmed 77520 records to 53670 (keeping 200 days of data) [2025-09-17T19:29:42.016911] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-08. [2025-09-17T19:29:42.139250] [DEBUG] [LOCAL ] HL: Primary data saved (53670 records). [2025-09-17T19:29:42.139421] [INFO ] [MAIN ] HL: Full history saved. [2025-09-17T19:29:42.139511] [INFO ] [MAIN ] Update Progress: 1025/2371 symbols completed. HL took 47.6s. Estimated remaining: 3h 16m 33s. Rate: 6.8 symbols/min [2025-09-17T19:29:42.329577] [INFO ] [MAIN ] HLLY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:29:42.368553] [DEBUG] [LOCAL ] HLLY: Loaded 32988 existing records from primary storage. [2025-09-17T19:29:42.368820] [INFO ] [MAIN ] HLLY: Loaded 32988 existing records. [2025-09-17T19:29:42.547497] [WARN ] [MAIN ] HLLY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:29:42.547844] [INFO ] [MAIN ] HLLY: Wiping existing primary data before full refresh. [2025-09-17T19:29:42.547912] [INFO ] [LOCAL ] HLLY: Starting deletion of primary data. [2025-09-17T19:29:42.548709] [DEBUG] [LOCAL ] HLLY: Deleted primary data file. [2025-09-17T19:29:42.548766] [INFO ] [MAIN ] HLLY: Starting full primary refresh. [2025-09-17T19:29:42.822827] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-03. [2025-09-17T19:29:42.908430] [INFO ] [REMOTE ] HLLY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:29:42.946474] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T19:29:43.370966] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T19:29:43.615808] [INFO ] [REMOTE ] HLI: Fetching primary data for 2025-09. [2025-09-17T19:29:43.960373] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T19:29:44.166625] [INFO ] [REMOTE ] HLI: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T19:29:44.171190] [INFO ] [REMOTE ] HLI: Full fetch complete (44999 records). [2025-09-17T19:29:44.171294] [DEBUG] [VALIDATOR ] HLI: Validating primary data. [2025-09-17T19:29:44.421022] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-11. [2025-09-17T19:29:44.580753] [DEBUG] [VALIDATOR ] HLI: All expected trading days are present. [2025-09-17T19:29:44.580864] [DEBUG] [VALIDATOR ] HLI: Primary data validation passed. [2025-09-17T19:29:44.581722] [INFO ] [MAIN ] HLI: Fetched primary data is valid. [2025-09-17T19:29:44.581794] [DEBUG] [LOCAL ] HLI: Saving primary data. [2025-09-17T19:29:44.583011] [DEBUG] [LOCAL ] HLI: Trimmed 44999 records to 31485 (keeping 200 days of data) [2025-09-17T19:29:44.786681] [DEBUG] [LOCAL ] HLI: Primary data saved (31485 records). [2025-09-17T19:29:44.786838] [INFO ] [MAIN ] HLI: Full history saved. [2025-09-17T19:29:44.786924] [INFO ] [MAIN ] Update Progress: 1026/2371 symbols completed. HLI took 29.6s. Estimated remaining: 3h 16m 16s. Rate: 6.9 symbols/min [2025-09-17T19:29:44.958298] [INFO ] [MAIN ] HLN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:29:45.010162] [DEBUG] [LOCAL ] HLN: Loaded 53082 existing records from primary storage. [2025-09-17T19:29:45.010420] [INFO ] [MAIN ] HLN: Loaded 53082 existing records. [2025-09-17T19:29:45.188049] [WARN ] [MAIN ] HLN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:29:45.188325] [INFO ] [MAIN ] HLN: Wiping existing primary data before full refresh. [2025-09-17T19:29:45.188369] [INFO ] [LOCAL ] HLN: Starting deletion of primary data. [2025-09-17T19:29:45.189591] [DEBUG] [LOCAL ] HLN: Deleted primary data file. [2025-09-17T19:29:45.189640] [INFO ] [MAIN ] HLN: Starting full primary refresh. [2025-09-17T19:29:45.220943] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-04. [2025-09-17T19:29:45.547758] [INFO ] [REMOTE ] HLN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:29:45.898217] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T19:29:46.015881] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-11. [2025-09-17T19:29:46.265331] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T19:29:46.815784] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-05. [2025-09-17T19:29:47.399220] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T19:29:47.615787] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2024-12. [2025-09-17T19:29:48.195823] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T19:29:48.415857] [INFO ] [REMOTE ] HLN: Fetching primary data for 2024-12. [2025-09-17T19:29:48.982242] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T19:29:49.215870] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-06. [2025-09-17T19:29:50.015859] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-08. [2025-09-17T19:29:50.344996] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T19:29:50.559903] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T19:29:50.815799] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-07. [2025-09-17T19:29:51.615760] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-01. [2025-09-17T19:29:51.710292] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T19:29:52.258476] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T19:29:52.415773] [INFO ] [REMOTE ] HLF: Fetching primary data for 2025-09. [2025-09-17T19:29:52.857572] [INFO ] [REMOTE ] HLF: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T19:29:52.865474] [INFO ] [REMOTE ] HLF: Full fetch complete (71452 records). [2025-09-17T19:29:52.865609] [DEBUG] [VALIDATOR ] HLF: Validating primary data. [2025-09-17T19:29:53.230198] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-08. [2025-09-17T19:29:53.288678] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T19:29:53.302457] [DEBUG] [VALIDATOR ] HLF: All expected trading days are present. [2025-09-17T19:29:53.302906] [DEBUG] [VALIDATOR ] HLF: Primary data validation passed. [2025-09-17T19:29:53.304340] [INFO ] [MAIN ] HLF: Fetched primary data is valid. [2025-09-17T19:29:53.304420] [DEBUG] [LOCAL ] HLF: Saving primary data. [2025-09-17T19:29:53.306016] [DEBUG] [LOCAL ] HLF: Trimmed 71452 records to 48939 (keeping 200 days of data) [2025-09-17T19:29:53.600040] [DEBUG] [LOCAL ] HLF: Primary data saved (48939 records). [2025-09-17T19:29:53.600202] [INFO ] [MAIN ] HLF: Full history saved. [2025-09-17T19:29:53.600314] [INFO ] [MAIN ] Update Progress: 1027/2371 symbols completed. HLF took 39.9s. Estimated remaining: 3h 16m 7s. Rate: 6.9 symbols/min [2025-09-17T19:29:53.780220] [INFO ] [MAIN ] HLT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:29:53.829724] [DEBUG] [LOCAL ] HLT: Loaded 50770 existing records from primary storage. [2025-09-17T19:29:53.829892] [INFO ] [MAIN ] HLT: Loaded 50770 existing records. [2025-09-17T19:29:54.008893] [WARN ] [MAIN ] HLT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:29:54.009152] [INFO ] [MAIN ] HLT: Wiping existing primary data before full refresh. [2025-09-17T19:29:54.009206] [INFO ] [LOCAL ] HLT: Starting deletion of primary data. [2025-09-17T19:29:54.010259] [DEBUG] [LOCAL ] HLT: Deleted primary data file. [2025-09-17T19:29:54.010313] [INFO ] [MAIN ] HLT: Starting full primary refresh. [2025-09-17T19:29:54.021352] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-01. [2025-09-17T19:29:54.370609] [INFO ] [REMOTE ] HLT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:29:54.600336] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T19:29:54.815834] [INFO ] [REMOTE ] HLIO: Fetching primary data for 2025-09. [2025-09-17T19:29:55.338534] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T19:29:55.397860] [INFO ] [REMOTE ] HLIO: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T19:29:55.400899] [INFO ] [REMOTE ] HLIO: Full fetch complete (35953 records). [2025-09-17T19:29:55.400973] [DEBUG] [VALIDATOR ] HLIO: Validating primary data. [2025-09-17T19:29:55.621106] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-02. [2025-09-17T19:29:55.780100] [DEBUG] [VALIDATOR ] HLIO: All expected trading days are present. [2025-09-17T19:29:55.780181] [DEBUG] [VALIDATOR ] HLIO: Primary data validation passed. [2025-09-17T19:29:55.780805] [INFO ] [MAIN ] HLIO: Fetched primary data is valid. [2025-09-17T19:29:55.780853] [DEBUG] [LOCAL ] HLIO: Saving primary data. [2025-09-17T19:29:55.781736] [DEBUG] [LOCAL ] HLIO: Trimmed 35953 records to 28187 (keeping 200 days of data) [2025-09-17T19:29:55.955164] [DEBUG] [LOCAL ] HLIO: Primary data saved (28187 records). [2025-09-17T19:29:55.955302] [INFO ] [MAIN ] HLIO: Full history saved. [2025-09-17T19:29:55.955408] [INFO ] [MAIN ] Update Progress: 1028/2371 symbols completed. HLIO took 22.5s. Estimated remaining: 3h 15m 50s. Rate: 6.9 symbols/min [2025-09-17T19:29:56.124179] [INFO ] [MAIN ] HLX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:29:56.166750] [DEBUG] [LOCAL ] HLX: Loaded 48229 existing records from primary storage. [2025-09-17T19:29:56.166893] [INFO ] [MAIN ] HLX: Loaded 48229 existing records. [2025-09-17T19:29:56.345046] [WARN ] [MAIN ] HLX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:29:56.345282] [INFO ] [MAIN ] HLX: Wiping existing primary data before full refresh. [2025-09-17T19:29:56.345325] [INFO ] [LOCAL ] HLX: Starting deletion of primary data. [2025-09-17T19:29:56.346143] [DEBUG] [LOCAL ] HLX: Deleted primary data file. [2025-09-17T19:29:56.346192] [INFO ] [MAIN ] HLX: Starting full primary refresh. [2025-09-17T19:29:56.420867] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-11. [2025-09-17T19:29:56.702293] [INFO ] [REMOTE ] HLX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:29:56.750570] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T19:29:57.215792] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-03. [2025-09-17T19:29:57.935338] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T19:29:58.015776] [INFO ] [REMOTE ] HLT: Fetching primary data for 2024-12. [2025-09-17T19:29:58.534875] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T19:29:58.815811] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-02. [2025-09-17T19:29:59.370193] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T19:29:59.615785] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-01. [2025-09-17T19:30:00.044390] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T19:30:00.415797] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-04. [2025-09-17T19:30:00.950997] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T19:30:01.215824] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-03. [2025-09-17T19:30:01.666287] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T19:30:02.015795] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-05. [2025-09-17T19:30:02.815805] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-11. [2025-09-17T19:30:03.615781] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-02. [2025-09-17T19:30:04.606120] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-03 (3.39 seconds). [2025-09-17T19:30:04.622335] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-04. [2025-09-17T19:30:05.422584] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-05 (3.41 seconds). [2025-09-17T19:30:05.430267] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-06. [2025-09-17T19:30:05.850830] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-11 (3.04 seconds). [2025-09-17T19:30:06.015775] [INFO ] [REMOTE ] HLX: Fetching primary data for 2024-12. [2025-09-17T19:30:06.071763] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-17T19:30:06.548357] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T19:30:06.648450] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T19:30:06.815726] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-05. [2025-09-17T19:30:07.182701] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T19:30:07.615782] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-03. [2025-09-17T19:30:08.415822] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-01. [2025-09-17T19:30:08.780768] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T19:30:09.215823] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-06. [2025-09-17T19:30:09.550483] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T19:30:10.015793] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-07. [2025-09-17T19:30:10.053010] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T19:30:10.695714] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T19:30:10.815749] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-07. [2025-09-17T19:30:11.214194] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T19:30:11.615728] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-02. [2025-09-17T19:30:12.415777] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-08. [2025-09-17T19:30:12.663878] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T19:30:13.205832] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T19:30:13.215730] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-03. [2025-09-17T19:30:13.820804] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T19:30:14.015748] [INFO ] [REMOTE ] HLLY: Fetching primary data for 2025-09. [2025-09-17T19:30:14.670006] [INFO ] [REMOTE ] HLLY: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T19:30:14.675314] [INFO ] [REMOTE ] HLLY: Full fetch complete (45922 records). [2025-09-17T19:30:14.675463] [DEBUG] [VALIDATOR ] HLLY: Validating primary data. [2025-09-17T19:30:14.820990] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-08. [2025-09-17T19:30:15.079534] [DEBUG] [VALIDATOR ] HLLY: All expected trading days are present. [2025-09-17T19:30:15.079729] [DEBUG] [VALIDATOR ] HLLY: Primary data validation passed. [2025-09-17T19:30:15.080492] [INFO ] [MAIN ] HLLY: Fetched primary data is valid. [2025-09-17T19:30:15.080600] [DEBUG] [LOCAL ] HLLY: Saving primary data. [2025-09-17T19:30:15.082252] [DEBUG] [LOCAL ] HLLY: Trimmed 45922 records to 33095 (keeping 200 days of data) [2025-09-17T19:30:15.195812] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T19:30:15.312208] [DEBUG] [LOCAL ] HLLY: Primary data saved (33095 records). [2025-09-17T19:30:15.312391] [INFO ] [MAIN ] HLLY: Full history saved. [2025-09-17T19:30:15.312535] [INFO ] [MAIN ] Update Progress: 1029/2371 symbols completed. HLLY took 33.2s. Estimated remaining: 3h 15m 55s. Rate: 6.8 symbols/min [2025-09-17T19:30:15.486758] [INFO ] [MAIN ] HMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:30:15.530876] [DEBUG] [LOCAL ] HMC: Loaded 47068 existing records from primary storage. [2025-09-17T19:30:15.531018] [INFO ] [MAIN ] HMC: Loaded 47068 existing records. [2025-09-17T19:30:15.621137] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-04. [2025-09-17T19:30:15.712131] [WARN ] [MAIN ] HMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:30:15.712395] [INFO ] [MAIN ] HMC: Wiping existing primary data before full refresh. [2025-09-17T19:30:15.712456] [INFO ] [LOCAL ] HMC: Starting deletion of primary data. [2025-09-17T19:30:15.713514] [DEBUG] [LOCAL ] HMC: Deleted primary data file. [2025-09-17T19:30:15.713586] [INFO ] [MAIN ] HMC: Starting full primary refresh. [2025-09-17T19:30:16.073948] [INFO ] [REMOTE ] HMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:30:16.415849] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-11. [2025-09-17T19:30:17.215848] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-04. [2025-09-17T19:30:17.423825] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-17T19:30:18.002843] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T19:30:18.014133] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T19:30:18.024007] [INFO ] [REMOTE ] HMC: Fetching primary data for 2024-12. [2025-09-17T19:30:18.749044] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T19:30:18.815747] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-05. [2025-09-17T19:30:19.615756] [INFO ] [REMOTE ] HLN: Fetching primary data for 2025-09. [2025-09-17T19:30:20.142207] [INFO ] [REMOTE ] HLN: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T19:30:20.188122] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-17T19:30:20.199142] [INFO ] [REMOTE ] HLN: Full fetch complete (76569 records). [2025-09-17T19:30:20.200630] [DEBUG] [VALIDATOR ] HLN: Validating primary data. [2025-09-17T19:30:20.431352] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-05. [2025-09-17T19:30:20.537385] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T19:30:20.671293] [DEBUG] [VALIDATOR ] HLN: All expected trading days are present. [2025-09-17T19:30:20.671381] [DEBUG] [VALIDATOR ] HLN: Primary data validation passed. [2025-09-17T19:30:20.672341] [INFO ] [MAIN ] HLN: Fetched primary data is valid. [2025-09-17T19:30:20.672392] [DEBUG] [LOCAL ] HLN: Saving primary data. [2025-09-17T19:30:20.674077] [DEBUG] [LOCAL ] HLN: Trimmed 76569 records to 53084 (keeping 200 days of data) [2025-09-17T19:30:21.021378] [DEBUG] [LOCAL ] HLN: Primary data saved (53084 records). [2025-09-17T19:30:21.021530] [INFO ] [MAIN ] HLN: Full history saved. [2025-09-17T19:30:21.022323] [INFO ] [MAIN ] Update Progress: 1030/2371 symbols completed. HLN took 36.2s. Estimated remaining: 3h 15m 42s. Rate: 6.9 symbols/min [2025-09-17T19:30:21.196327] [INFO ] [MAIN ] HMN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:30:21.215760] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-06. [2025-09-17T19:30:21.225344] [DEBUG] [LOCAL ] HMN: Loaded 23184 existing records from primary storage. [2025-09-17T19:30:21.225484] [INFO ] [MAIN ] HMN: Loaded 23184 existing records. [2025-09-17T19:30:21.416201] [WARN ] [MAIN ] HMN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:30:21.416639] [INFO ] [MAIN ] HMN: Wiping existing primary data before full refresh. [2025-09-17T19:30:21.416708] [INFO ] [LOCAL ] HMN: Starting deletion of primary data. [2025-09-17T19:30:21.417411] [DEBUG] [LOCAL ] HMN: Deleted primary data file. [2025-09-17T19:30:21.417467] [INFO ] [MAIN ] HMN: Starting full primary refresh. [2025-09-17T19:30:21.773480] [INFO ] [REMOTE ] HMN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:30:22.015771] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-11. [2025-09-17T19:30:22.462798] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T19:30:22.506202] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T19:30:22.815758] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-06. [2025-09-17T19:30:23.183724] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T19:30:23.615835] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-07. [2025-09-17T19:30:24.415791] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-01. [2025-09-17T19:30:24.561743] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T19:30:25.215793] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-07. [2025-09-17T19:30:25.347408] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T19:30:26.015788] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-08. [2025-09-17T19:30:26.320441] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T19:30:26.815783] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-02. [2025-09-17T19:30:27.190951] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T19:30:27.615795] [INFO ] [REMOTE ] HMN: Fetching primary data for 2024-12. [2025-09-17T19:30:28.205285] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T19:30:28.415692] [INFO ] [REMOTE ] HLX: Fetching primary data for 2025-09. [2025-09-17T19:30:28.494138] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T19:30:28.554301] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T19:30:29.090565] [INFO ] [REMOTE ] HLX: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T19:30:29.098291] [INFO ] [REMOTE ] HLX: Full fetch complete (68936 records). [2025-09-17T19:30:29.098497] [DEBUG] [VALIDATOR ] HLX: Validating primary data. [2025-09-17T19:30:29.223486] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-03. [2025-09-17T19:30:29.551378] [DEBUG] [VALIDATOR ] HLX: All expected trading days are present. [2025-09-17T19:30:29.551465] [DEBUG] [VALIDATOR ] HLX: Primary data validation passed. [2025-09-17T19:30:29.552345] [INFO ] [MAIN ] HLX: Fetched primary data is valid. [2025-09-17T19:30:29.552392] [DEBUG] [LOCAL ] HLX: Saving primary data. [2025-09-17T19:30:29.553816] [DEBUG] [LOCAL ] HLX: Trimmed 68936 records to 48180 (keeping 200 days of data) [2025-09-17T19:30:29.839442] [DEBUG] [LOCAL ] HLX: Primary data saved (48180 records). [2025-09-17T19:30:29.839588] [INFO ] [MAIN ] HLX: Full history saved. [2025-09-17T19:30:29.839697] [INFO ] [MAIN ] Update Progress: 1031/2371 symbols completed. HLX took 33.9s. Estimated remaining: 3h 15m 34s. Rate: 6.9 symbols/min [2025-09-17T19:30:30.012403] [INFO ] [MAIN ] HMY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:30:30.015845] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-01. [2025-09-17T19:30:30.069131] [DEBUG] [LOCAL ] HMY: Loaded 53124 existing records from primary storage. [2025-09-17T19:30:30.069287] [INFO ] [MAIN ] HMY: Loaded 53124 existing records. [2025-09-17T19:30:30.247735] [WARN ] [MAIN ] HMY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:30:30.248055] [INFO ] [MAIN ] HMY: Wiping existing primary data before full refresh. [2025-09-17T19:30:30.248102] [INFO ] [LOCAL ] HMY: Starting deletion of primary data. [2025-09-17T19:30:30.249501] [DEBUG] [LOCAL ] HMY: Deleted primary data file. [2025-09-17T19:30:30.249553] [INFO ] [MAIN ] HMY: Starting full primary refresh. [2025-09-17T19:30:30.607081] [INFO ] [REMOTE ] HMY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:30:30.815813] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-08. [2025-09-17T19:30:31.052205] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T19:30:31.088493] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T19:30:31.615793] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-11. [2025-09-17T19:30:32.415814] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-02. [2025-09-17T19:30:32.584560] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T19:30:33.215804] [INFO ] [REMOTE ] HLT: Fetching primary data for 2025-09. [2025-09-17T19:30:33.487768] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T19:30:33.680021] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-11 (2.06 seconds). [2025-09-17T19:30:34.015816] [INFO ] [REMOTE ] HMY: Fetching primary data for 2024-12. [2025-09-17T19:30:34.115388] [INFO ] [REMOTE ] HLT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T19:30:34.122003] [INFO ] [REMOTE ] HLT: Full fetch complete (73284 records). [2025-09-17T19:30:34.122189] [DEBUG] [VALIDATOR ] HLT: Validating primary data. [2025-09-17T19:30:34.578800] [DEBUG] [VALIDATOR ] HLT: All expected trading days are present. [2025-09-17T19:30:34.578910] [DEBUG] [VALIDATOR ] HLT: Primary data validation passed. [2025-09-17T19:30:34.579954] [INFO ] [MAIN ] HLT: Fetched primary data is valid. [2025-09-17T19:30:34.580004] [DEBUG] [LOCAL ] HLT: Saving primary data. [2025-09-17T19:30:34.581530] [DEBUG] [LOCAL ] HLT: Trimmed 73284 records to 50795 (keeping 200 days of data) [2025-09-17T19:30:34.820076] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-03. [2025-09-17T19:30:34.942537] [DEBUG] [LOCAL ] HLT: Primary data saved (50795 records). [2025-09-17T19:30:34.942720] [INFO ] [MAIN ] HLT: Full history saved. [2025-09-17T19:30:34.942826] [INFO ] [MAIN ] Update Progress: 1032/2371 symbols completed. HLT took 41.3s. Estimated remaining: 3h 15m 20s. Rate: 6.9 symbols/min [2025-09-17T19:30:35.115114] [INFO ] [MAIN ] HNGE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:30:35.115307] [DEBUG] [LOCAL ] HNGE: No existing data file found in primary storage. [2025-09-17T19:30:35.115345] [WARN ] [MAIN ] HNGE: No existing data found, performing full refresh instead. [2025-09-17T19:30:35.115462] [INFO ] [MAIN ] HNGE: Wiping existing primary data before full refresh. [2025-09-17T19:30:35.115500] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-17T19:30:35.115540] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-17T19:30:35.115572] [INFO ] [MAIN ] HNGE: Starting full primary refresh. [2025-09-17T19:30:35.472238] [INFO ] [REMOTE ] HNGE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:30:35.615752] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-11. [2025-09-17T19:30:35.824710] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:30:35.825001] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-11 [2025-09-17T19:30:35.859331] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T19:30:35.913011] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T19:30:36.415886] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2024-12. [2025-09-17T19:30:36.605524] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:30:36.605904] [WARN ] [REMOTE ] HNGE: No data returned for month 2024-12 [2025-09-17T19:30:37.215827] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-04. [2025-09-17T19:30:38.015751] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-01. [2025-09-17T19:30:38.123161] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T19:30:38.815783] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-01. [2025-09-17T19:30:39.019006] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:30:39.019447] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-01 [2025-09-17T19:30:39.615845] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-02. [2025-09-17T19:30:39.791589] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:30:39.791851] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-02 [2025-09-17T19:30:39.962406] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T19:30:40.415796] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-02. [2025-09-17T19:30:41.215891] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-03. [2025-09-17T19:30:41.416517] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:30:41.416928] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-03 [2025-09-17T19:30:42.015858] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-04. [2025-09-17T19:30:42.234513] [DEBUG] [REMOTE ] HNGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:30:42.234976] [WARN ] [REMOTE ] HNGE: No data returned for month 2025-04 [2025-09-17T19:30:42.313620] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T19:30:42.815806] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-04. [2025-09-17T19:30:43.615784] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-03. [2025-09-17T19:30:44.415793] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-05. [2025-09-17T19:30:44.646246] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T19:30:45.215822] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-05. [2025-09-17T19:30:45.481167] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T19:30:45.927535] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T19:30:46.015785] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-06. [2025-09-17T19:30:46.058334] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T19:30:46.815845] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-06. [2025-09-17T19:30:47.116432] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T19:30:47.615832] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-05. [2025-09-17T19:30:48.424801] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-04. [2025-09-17T19:30:48.428013] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T19:30:49.220782] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-07. [2025-09-17T19:30:49.243559] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T19:30:50.015840] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-07. [2025-09-17T19:30:50.365410] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T19:30:50.624202] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T19:30:50.815799] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-08. [2025-09-17T19:30:51.612287] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T19:30:51.620368] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-05. [2025-09-17T19:30:51.895853] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T19:30:52.415782] [INFO ] [REMOTE ] HMN: Fetching primary data for 2025-09. [2025-09-17T19:30:53.007571] [INFO ] [REMOTE ] HMN: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T19:30:53.010889] [INFO ] [REMOTE ] HMN: Full fetch complete (31436 records). [2025-09-17T19:30:53.010990] [DEBUG] [VALIDATOR ] HMN: Validating primary data. [2025-09-17T19:30:53.220981] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-06. [2025-09-17T19:30:53.396303] [DEBUG] [VALIDATOR ] HMN: All expected trading days are present. [2025-09-17T19:30:53.396400] [DEBUG] [VALIDATOR ] HMN: Primary data validation passed. [2025-09-17T19:30:53.397073] [INFO ] [MAIN ] HMN: Fetched primary data is valid. [2025-09-17T19:30:53.397123] [DEBUG] [LOCAL ] HMN: Saving primary data. [2025-09-17T19:30:53.398101] [DEBUG] [LOCAL ] HMN: Trimmed 31436 records to 23228 (keeping 200 days of data) [2025-09-17T19:30:53.543688] [DEBUG] [LOCAL ] HMN: Primary data saved (23228 records). [2025-09-17T19:30:53.543850] [INFO ] [MAIN ] HMN: Full history saved. [2025-09-17T19:30:53.543936] [INFO ] [MAIN ] Update Progress: 1033/2371 symbols completed. HMN took 32.5s. Estimated remaining: 3h 15m 24s. Rate: 6.8 symbols/min [2025-09-17T19:30:53.717532] [INFO ] [MAIN ] HNI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:30:53.748519] [DEBUG] [LOCAL ] HNI: Loaded 28780 existing records from primary storage. [2025-09-17T19:30:53.748698] [INFO ] [MAIN ] HNI: Loaded 28780 existing records. [2025-09-17T19:30:53.934369] [WARN ] [MAIN ] HNI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:30:53.934844] [INFO ] [MAIN ] HNI: Wiping existing primary data before full refresh. [2025-09-17T19:30:53.934919] [INFO ] [LOCAL ] HNI: Starting deletion of primary data. [2025-09-17T19:30:53.967251] [DEBUG] [LOCAL ] HNI: Deleted primary data file. [2025-09-17T19:30:53.967386] [INFO ] [MAIN ] HNI: Starting full primary refresh. [2025-09-17T19:30:54.025816] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-08. [2025-09-17T19:30:54.028191] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-17T19:30:54.352910] [INFO ] [REMOTE ] HNI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:30:54.815856] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-06. [2025-09-17T19:30:54.943498] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T19:30:55.615800] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-07. [2025-09-17T19:30:55.663161] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T19:30:56.400375] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T19:30:56.415724] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-07. [2025-09-17T19:30:57.121547] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T19:30:57.215827] [INFO ] [REMOTE ] HNGE: Fetching primary data for 2025-09. [2025-09-17T19:30:57.708166] [INFO ] [REMOTE ] HNGE: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T19:30:57.713937] [INFO ] [REMOTE ] HNGE: Full fetch complete (24640 records). [2025-09-17T19:30:57.714062] [DEBUG] [VALIDATOR ] HNGE: Validating primary data. [2025-09-17T19:30:57.908800] [WARN ] [VALIDATOR ] HNGE: Validation failed - insufficient historical data. Have 81 unique days, need 200 days [2025-09-17T19:30:57.909206] [FATAL] [MAIN ] HNGE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:30:57.909285] [WARN ] [MAIN ] HNGE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:30:57.909443] [INFO ] [LOCAL ] HNGE: Starting deletion of primary data. [2025-09-17T19:30:57.909583] [DEBUG] [LOCAL ] HNGE: No primary data file found to delete. [2025-09-17T19:30:57.909628] [INFO ] [LOCAL ] HNGE: Starting deletion of derivative data. [2025-09-17T19:30:57.909787] [DEBUG] [LOCAL ] HNGE: No derivative data file found to delete. [2025-09-17T19:30:57.909873] [INFO ] [MAIN ] Update Progress: 1034/2371 symbols completed. HNGE took 23.0s. Estimated remaining: 3h 15m 10s. Rate: 6.9 symbols/min [2025-09-17T19:30:58.019573] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-11. [2025-09-17T19:30:58.087189] [INFO ] [MAIN ] HOG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:30:58.127220] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T19:30:58.181311] [DEBUG] [LOCAL ] HOG: Loaded 51307 existing records from primary storage. [2025-09-17T19:30:58.181488] [INFO ] [MAIN ] HOG: Loaded 51307 existing records. [2025-09-17T19:30:58.358747] [WARN ] [MAIN ] HOG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:30:58.359026] [INFO ] [MAIN ] HOG: Wiping existing primary data before full refresh. [2025-09-17T19:30:58.359072] [INFO ] [LOCAL ] HOG: Starting deletion of primary data. [2025-09-17T19:30:58.360375] [DEBUG] [LOCAL ] HOG: Deleted primary data file. [2025-09-17T19:30:58.360427] [INFO ] [MAIN ] HOG: Starting full primary refresh. [2025-09-17T19:30:58.727273] [INFO ] [REMOTE ] HOG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:30:58.815764] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-11. [2025-09-17T19:30:59.409514] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T19:30:59.615797] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-08. [2025-09-17T19:31:00.199112] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T19:31:00.415809] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-08. [2025-09-17T19:31:01.215784] [INFO ] [REMOTE ] HOG: Fetching primary data for 2024-12. [2025-09-17T19:31:01.676595] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T19:31:02.015808] [INFO ] [REMOTE ] HMY: Fetching primary data for 2025-09. [2025-09-17T19:31:02.177749] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T19:31:02.393034] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T19:31:02.820773] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-01. [2025-09-17T19:31:02.832583] [INFO ] [REMOTE ] HMY: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T19:31:02.839507] [INFO ] [REMOTE ] HMY: Full fetch complete (76440 records). [2025-09-17T19:31:02.839617] [DEBUG] [VALIDATOR ] HMY: Validating primary data. [2025-09-17T19:31:03.229255] [DEBUG] [VALIDATOR ] HMY: All expected trading days are present. [2025-09-17T19:31:03.229351] [DEBUG] [VALIDATOR ] HMY: Primary data validation passed. [2025-09-17T19:31:03.230336] [INFO ] [MAIN ] HMY: Fetched primary data is valid. [2025-09-17T19:31:03.230398] [DEBUG] [LOCAL ] HMY: Saving primary data. [2025-09-17T19:31:03.232027] [DEBUG] [LOCAL ] HMY: Trimmed 76440 records to 53125 (keeping 200 days of data) [2025-09-17T19:31:03.553137] [DEBUG] [LOCAL ] HMY: Primary data saved (53125 records). [2025-09-17T19:31:03.553318] [INFO ] [MAIN ] HMY: Full history saved. [2025-09-17T19:31:03.553421] [INFO ] [MAIN ] Update Progress: 1035/2371 symbols completed. HMY took 33.7s. Estimated remaining: 3h 14m 57s. Rate: 6.9 symbols/min [2025-09-17T19:31:03.620934] [INFO ] [REMOTE ] HMC: Fetching primary data for 2025-09. [2025-09-17T19:31:03.736361] [INFO ] [MAIN ] HOMB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:31:03.776491] [DEBUG] [LOCAL ] HOMB: Loaded 43713 existing records from primary storage. [2025-09-17T19:31:03.776785] [INFO ] [MAIN ] HOMB: Loaded 43713 existing records. [2025-09-17T19:31:03.951963] [WARN ] [MAIN ] HOMB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:31:03.952217] [INFO ] [MAIN ] HOMB: Wiping existing primary data before full refresh. [2025-09-17T19:31:03.952262] [INFO ] [LOCAL ] HOMB: Starting deletion of primary data. [2025-09-17T19:31:03.953112] [DEBUG] [LOCAL ] HOMB: Deleted primary data file. [2025-09-17T19:31:03.953174] [INFO ] [MAIN ] HOMB: Starting full primary refresh. [2025-09-17T19:31:04.320452] [INFO ] [REMOTE ] HOMB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:31:04.357980] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T19:31:04.415729] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-02. [2025-09-17T19:31:04.455259] [INFO ] [REMOTE ] HMC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T19:31:04.461166] [INFO ] [REMOTE ] HMC: Full fetch complete (69640 records). [2025-09-17T19:31:04.461276] [DEBUG] [VALIDATOR ] HMC: Validating primary data. [2025-09-17T19:31:04.878198] [DEBUG] [VALIDATOR ] HMC: All expected trading days are present. [2025-09-17T19:31:04.878279] [DEBUG] [VALIDATOR ] HMC: Primary data validation passed. [2025-09-17T19:31:04.879164] [INFO ] [MAIN ] HMC: Fetched primary data is valid. [2025-09-17T19:31:04.879212] [DEBUG] [LOCAL ] HMC: Saving primary data. [2025-09-17T19:31:04.880613] [DEBUG] [LOCAL ] HMC: Trimmed 69640 records to 47041 (keeping 200 days of data) [2025-09-17T19:31:05.160458] [DEBUG] [LOCAL ] HMC: Primary data saved (47041 records). [2025-09-17T19:31:05.160593] [INFO ] [MAIN ] HMC: Full history saved. [2025-09-17T19:31:05.160697] [INFO ] [MAIN ] Update Progress: 1036/2371 symbols completed. HMC took 49.8s. Estimated remaining: 3h 14m 39s. Rate: 6.9 symbols/min [2025-09-17T19:31:05.224217] [INFO ] [REMOTE ] HNI: Fetching primary data for 2024-12. [2025-09-17T19:31:05.336519] [INFO ] [MAIN ] HOUS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:31:05.377441] [DEBUG] [LOCAL ] HOUS: Loaded 43953 existing records from primary storage. [2025-09-17T19:31:05.377587] [INFO ] [MAIN ] HOUS: Loaded 43953 existing records. [2025-09-17T19:31:05.554035] [WARN ] [MAIN ] HOUS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:31:05.554307] [INFO ] [MAIN ] HOUS: Wiping existing primary data before full refresh. [2025-09-17T19:31:05.554352] [INFO ] [LOCAL ] HOUS: Starting deletion of primary data. [2025-09-17T19:31:05.555219] [DEBUG] [LOCAL ] HOUS: Deleted primary data file. [2025-09-17T19:31:05.555269] [INFO ] [MAIN ] HOUS: Starting full primary refresh. [2025-09-17T19:31:05.925869] [INFO ] [REMOTE ] HOUS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:31:06.015769] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-11. [2025-09-17T19:31:06.240549] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T19:31:06.465135] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T19:31:06.815803] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-03. [2025-09-17T19:31:07.506985] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T19:31:07.615814] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-01. [2025-09-17T19:31:08.271093] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T19:31:08.350812] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T19:31:08.415804] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-02. [2025-09-17T19:31:09.215731] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-11. [2025-09-17T19:31:09.555984] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T19:31:10.015820] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2024-12. [2025-09-17T19:31:10.456633] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T19:31:10.815813] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-04. [2025-09-17T19:31:11.454194] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T19:31:11.615779] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2024-12. [2025-09-17T19:31:12.415791] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-03. [2025-09-17T19:31:12.617204] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T19:31:13.060096] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T19:31:13.215689] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-05. [2025-09-17T19:31:13.690533] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T19:31:14.015807] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-01. [2025-09-17T19:31:14.815848] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-01. [2025-09-17T19:31:14.958879] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T19:31:15.621666] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-06. [2025-09-17T19:31:15.628244] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T19:31:16.375917] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T19:31:16.415742] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-02. [2025-09-17T19:31:16.990986] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T19:31:17.215771] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-07. [2025-09-17T19:31:17.976601] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T19:31:18.015731] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-03. [2025-09-17T19:31:18.568120] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T19:31:18.815781] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-04. [2025-09-17T19:31:19.452709] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T19:31:19.600897] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T19:31:19.615684] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-08. [2025-09-17T19:31:20.415776] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-04. [2025-09-17T19:31:21.081699] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T19:31:21.215773] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-02. [2025-09-17T19:31:22.015776] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-05. [2025-09-17T19:31:22.182545] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T19:31:22.253091] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T19:31:22.774002] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T19:31:22.815764] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-06. [2025-09-17T19:31:23.615743] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-05. [2025-09-17T19:31:24.023468] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T19:31:24.415766] [INFO ] [REMOTE ] HOG: Fetching primary data for 2025-09. [2025-09-17T19:31:24.747338] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T19:31:25.217622] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-03. [2025-09-17T19:31:25.222115] [INFO ] [REMOTE ] HOG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T19:31:25.232874] [INFO ] [REMOTE ] HOG: Full fetch complete (74080 records). [2025-09-17T19:31:25.233058] [DEBUG] [VALIDATOR ] HOG: Validating primary data. [2025-09-17T19:31:25.630341] [DEBUG] [VALIDATOR ] HOG: All expected trading days are present. [2025-09-17T19:31:25.630421] [DEBUG] [VALIDATOR ] HOG: Primary data validation passed. [2025-09-17T19:31:25.631342] [INFO ] [MAIN ] HOG: Fetched primary data is valid. [2025-09-17T19:31:25.631395] [DEBUG] [LOCAL ] HOG: Saving primary data. [2025-09-17T19:31:25.632852] [DEBUG] [LOCAL ] HOG: Trimmed 74080 records to 51295 (keeping 200 days of data) [2025-09-17T19:31:25.944735] [DEBUG] [LOCAL ] HOG: Primary data saved (51295 records). [2025-09-17T19:31:25.944909] [INFO ] [MAIN ] HOG: Full history saved. [2025-09-17T19:31:25.945005] [INFO ] [MAIN ] Update Progress: 1037/2371 symbols completed. HOG took 28.0s. Estimated remaining: 3h 14m 46s. Rate: 6.8 symbols/min [2025-09-17T19:31:26.015780] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-06. [2025-09-17T19:31:26.815759] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-07. [2025-09-17T19:31:26.841140] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T19:31:27.442431] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T19:31:27.615751] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-07. [2025-09-17T19:31:27.688520] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T19:31:28.415816] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-08. [2025-09-17T19:31:29.215784] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-04. [2025-09-17T19:31:29.369352] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T19:31:29.512945] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T19:31:30.015814] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-08. [2025-09-17T19:31:30.815843] [INFO ] [REMOTE ] HNI: Fetching primary data for 2025-09. [2025-09-17T19:31:30.897633] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T19:31:31.321323] [INFO ] [REMOTE ] HNI: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T19:31:31.326514] [INFO ] [REMOTE ] HNI: Full fetch complete (40592 records). [2025-09-17T19:31:31.326663] [DEBUG] [VALIDATOR ] HNI: Validating primary data. [2025-09-17T19:31:31.618428] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-05. [2025-09-17T19:31:31.716412] [DEBUG] [VALIDATOR ] HNI: All expected trading days are present. [2025-09-17T19:31:31.716604] [DEBUG] [VALIDATOR ] HNI: Primary data validation passed. [2025-09-17T19:31:31.717604] [INFO ] [MAIN ] HNI: Fetched primary data is valid. [2025-09-17T19:31:31.717701] [DEBUG] [LOCAL ] HNI: Saving primary data. [2025-09-17T19:31:31.719182] [DEBUG] [LOCAL ] HNI: Trimmed 40592 records to 28800 (keeping 200 days of data) [2025-09-17T19:31:31.838123] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T19:31:31.935044] [DEBUG] [LOCAL ] HNI: Primary data saved (28800 records). [2025-09-17T19:31:31.935196] [INFO ] [MAIN ] HNI: Full history saved. [2025-09-17T19:31:31.935284] [INFO ] [MAIN ] Update Progress: 1038/2371 symbols completed. HNI took 38.4s. Estimated remaining: 3h 14m 33s. Rate: 6.9 symbols/min [2025-09-17T19:31:32.415781] [INFO ] [REMOTE ] HOMB: Fetching primary data for 2025-09. [2025-09-17T19:31:33.154762] [INFO ] [REMOTE ] HOMB: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T19:31:33.164201] [INFO ] [REMOTE ] HOMB: Full fetch complete (63421 records). [2025-09-17T19:31:33.164408] [DEBUG] [VALIDATOR ] HOMB: Validating primary data. [2025-09-17T19:31:33.608154] [DEBUG] [VALIDATOR ] HOMB: All expected trading days are present. [2025-09-17T19:31:33.608521] [DEBUG] [VALIDATOR ] HOMB: Primary data validation passed. [2025-09-17T19:31:33.610168] [INFO ] [MAIN ] HOMB: Fetched primary data is valid. [2025-09-17T19:31:33.610244] [DEBUG] [LOCAL ] HOMB: Saving primary data. [2025-09-17T19:31:33.613136] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T19:31:33.626160] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-06. [2025-09-17T19:31:33.626357] [DEBUG] [LOCAL ] HOMB: Trimmed 63421 records to 43727 (keeping 200 days of data) [2025-09-17T19:31:33.910043] [DEBUG] [LOCAL ] HOMB: Primary data saved (43727 records). [2025-09-17T19:31:33.910267] [INFO ] [MAIN ] HOMB: Full history saved. [2025-09-17T19:31:33.910413] [INFO ] [MAIN ] Update Progress: 1039/2371 symbols completed. HOMB took 30.4s. Estimated remaining: 3h 14m 16s. Rate: 6.9 symbols/min [2025-09-17T19:31:35.183721] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T19:31:35.195320] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-07. [2025-09-17T19:31:36.756394] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T19:31:36.767478] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-08. [2025-09-17T19:31:38.031175] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T19:31:38.042705] [INFO ] [REMOTE ] HOUS: Fetching primary data for 2025-09. [2025-09-17T19:31:38.764924] [INFO ] [REMOTE ] HOUS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T19:31:38.771703] [INFO ] [REMOTE ] HOUS: Full fetch complete (62187 records). [2025-09-17T19:31:38.771906] [DEBUG] [VALIDATOR ] HOUS: Validating primary data. [2025-09-17T19:31:39.195691] [DEBUG] [VALIDATOR ] HOUS: All expected trading days are present. [2025-09-17T19:31:39.195864] [DEBUG] [VALIDATOR ] HOUS: Primary data validation passed. [2025-09-17T19:31:39.197127] [INFO ] [MAIN ] HOUS: Fetched primary data is valid. [2025-09-17T19:31:39.197191] [DEBUG] [LOCAL ] HOUS: Saving primary data. [2025-09-17T19:31:39.199113] [DEBUG] [LOCAL ] HOUS: Trimmed 62187 records to 43946 (keeping 200 days of data) [2025-09-17T19:31:39.465550] [DEBUG] [LOCAL ] HOUS: Primary data saved (43946 records). [2025-09-17T19:31:39.465762] [INFO ] [MAIN ] HOUS: Full history saved. [2025-09-17T19:31:39.465885] [INFO ] [MAIN ] Update Progress: 1040/2371 symbols completed. HOUS took 34.3s. Estimated remaining: 3h 14m 3s. Rate: 6.9 symbols/min [2025-09-17T19:31:40.180941] [INFO ] [MAIN ] HP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:31:40.182508] [INFO ] [MAIN ] HPE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:31:40.263006] [INFO ] [MAIN ] HPF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:31:40.286367] [INFO ] [MAIN ] HOV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:31:40.299783] [DEBUG] [LOCAL ] HPF: Loaded 7213 existing records from primary storage. [2025-09-17T19:31:40.300008] [INFO ] [MAIN ] HPF: Loaded 7213 existing records. [2025-09-17T19:31:40.382451] [DEBUG] [LOCAL ] HOV: Loaded 13734 existing records from primary storage. [2025-09-17T19:31:40.404010] [INFO ] [MAIN ] HOV: Loaded 13734 existing records. [2025-09-17T19:31:40.636919] [WARN ] [MAIN ] HPF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:31:40.637355] [INFO ] [MAIN ] HPF: Wiping existing primary data before full refresh. [2025-09-17T19:31:40.637615] [INFO ] [LOCAL ] HPF: Starting deletion of primary data. [2025-09-17T19:31:40.648546] [DEBUG] [LOCAL ] HPF: Deleted primary data file. [2025-09-17T19:31:40.694515] [INFO ] [MAIN ] HPF: Starting full primary refresh. [2025-09-17T19:31:40.778102] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-17T19:31:40.759271] [WARN ] [MAIN ] HOV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:31:40.794951] [INFO ] [MAIN ] HPE: Loaded 53697 existing records. [2025-09-17T19:31:40.784501] [DEBUG] [LOCAL ] HP: Loaded 51688 existing records from primary storage. [2025-09-17T19:31:40.832839] [INFO ] [MAIN ] HP: Loaded 51688 existing records. [2025-09-17T19:31:40.859126] [INFO ] [MAIN ] HOV: Wiping existing primary data before full refresh. [2025-09-17T19:31:40.963284] [INFO ] [LOCAL ] HOV: Starting deletion of primary data. [2025-09-17T19:31:41.144118] [DEBUG] [LOCAL ] HOV: Deleted primary data file. [2025-09-17T19:31:41.359625] [WARN ] [MAIN ] HPE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:31:41.357401] [INFO ] [MAIN ] HOV: Starting full primary refresh. [2025-09-17T19:31:41.372735] [WARN ] [MAIN ] HP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:31:41.412610] [INFO ] [MAIN ] HPE: Wiping existing primary data before full refresh. [2025-09-17T19:31:41.489875] [INFO ] [LOCAL ] HPE: Starting deletion of primary data. [2025-09-17T19:31:41.513636] [INFO ] [MAIN ] HP: Wiping existing primary data before full refresh. [2025-09-17T19:31:41.535482] [INFO ] [LOCAL ] HP: Starting deletion of primary data. [2025-09-17T19:31:41.535547] [DEBUG] [LOCAL ] HPE: Deleted primary data file. [2025-09-17T19:31:41.564863] [DEBUG] [LOCAL ] HP: Deleted primary data file. [2025-09-17T19:31:41.564923] [INFO ] [MAIN ] HPE: Starting full primary refresh. [2025-09-17T19:31:41.594534] [INFO ] [MAIN ] HP: Starting full primary refresh. [2025-09-17T19:31:41.718573] [INFO ] [REMOTE ] HPF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:31:41.790299] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-11. [2025-09-17T19:31:42.489599] [INFO ] [REMOTE ] HOV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:31:42.550115] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-11. [2025-09-17T19:31:42.624467] [INFO ] [REMOTE ] HPE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:31:42.625525] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-11. [2025-09-17T19:31:42.706889] [INFO ] [REMOTE ] HP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:31:42.707263] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-11. [2025-09-17T19:31:42.713626] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T19:31:42.715804] [INFO ] [REMOTE ] HPF: Fetching primary data for 2024-12. [2025-09-17T19:31:43.452696] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T19:31:43.455331] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-01. [2025-09-17T19:31:43.556895] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T19:31:43.559509] [INFO ] [REMOTE ] HOV: Fetching primary data for 2024-12. [2025-09-17T19:31:44.058942] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T19:31:44.061781] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-02. [2025-09-17T19:31:44.146819] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T19:31:44.157305] [INFO ] [REMOTE ] HP: Fetching primary data for 2024-12. [2025-09-17T19:31:44.205842] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T19:31:44.218283] [INFO ] [REMOTE ] HPE: Fetching primary data for 2024-12. [2025-09-17T19:31:44.406624] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T19:31:44.415743] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-01. [2025-09-17T19:31:44.769731] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T19:31:45.215815] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-03. [2025-09-17T19:31:45.232599] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T19:31:45.451887] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T19:31:45.830372] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T19:31:46.015780] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-02. [2025-09-17T19:31:46.379333] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-17T19:31:46.761220] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T19:31:46.815737] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-03. [2025-09-17T19:31:47.615790] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-04. [2025-09-17T19:31:47.748516] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T19:31:48.327618] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T19:31:48.415794] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-04. [2025-09-17T19:31:49.209092] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T19:31:49.215671] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-05. [2025-09-17T19:31:49.878448] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T19:31:50.015830] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-05. [2025-09-17T19:31:50.719837] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T19:31:50.815784] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-01. [2025-09-17T19:31:51.615778] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-01. [2025-09-17T19:31:52.415770] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-06. [2025-09-17T19:31:52.643946] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T19:31:53.215773] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-06. [2025-09-17T19:31:53.448496] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T19:31:53.482710] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T19:31:53.702332] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T19:31:54.015827] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-07. [2025-09-17T19:31:54.613196] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T19:31:54.815777] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-02. [2025-09-17T19:31:55.615814] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-02. [2025-09-17T19:31:56.415793] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-08. [2025-09-17T19:31:56.641429] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T19:31:57.215760] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-03. [2025-09-17T19:31:57.319039] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T19:31:57.345122] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T19:31:58.015820] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-07. [2025-09-17T19:31:58.815883] [INFO ] [REMOTE ] HPF: Fetching primary data for 2025-09. [2025-09-17T19:31:59.016881] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T19:31:59.156296] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T19:31:59.157043] [INFO ] [REMOTE ] HPF: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T19:31:59.170061] [INFO ] [REMOTE ] HPF: Full fetch complete (10740 records). [2025-09-17T19:31:59.170502] [DEBUG] [VALIDATOR ] HPF: Validating primary data. [2025-09-17T19:31:59.539055] [DEBUG] [VALIDATOR ] HPF: All expected trading days are present. [2025-09-17T19:31:59.539151] [DEBUG] [VALIDATOR ] HPF: Primary data validation passed. [2025-09-17T19:31:59.539469] [INFO ] [MAIN ] HPF: Fetched primary data is valid. [2025-09-17T19:31:59.539510] [DEBUG] [LOCAL ] HPF: Saving primary data. [2025-09-17T19:31:59.540072] [DEBUG] [LOCAL ] HPF: Trimmed 10740 records to 7238 (keeping 200 days of data) [2025-09-17T19:31:59.587576] [DEBUG] [LOCAL ] HPF: Primary data saved (7238 records). [2025-09-17T19:31:59.587755] [INFO ] [MAIN ] HPF: Full history saved. [2025-09-17T19:31:59.587848] [INFO ] [MAIN ] Update Progress: 1041/2371 symbols completed. HPF took 20.1s. Estimated remaining: 3h 14m 9s. Rate: 6.9 symbols/min [2025-09-17T19:31:59.620850] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-03. [2025-09-17T19:31:59.761155] [INFO ] [MAIN ] HPI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:31:59.772627] [DEBUG] [LOCAL ] HPI: Loaded 9802 existing records from primary storage. [2025-09-17T19:31:59.772786] [INFO ] [MAIN ] HPI: Loaded 9802 existing records. [2025-09-17T19:31:59.951379] [WARN ] [MAIN ] HPI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:31:59.951605] [INFO ] [MAIN ] HPI: Wiping existing primary data before full refresh. [2025-09-17T19:31:59.951678] [INFO ] [LOCAL ] HPI: Starting deletion of primary data. [2025-09-17T19:31:59.952091] [DEBUG] [LOCAL ] HPI: Deleted primary data file. [2025-09-17T19:31:59.952136] [INFO ] [MAIN ] HPI: Starting full primary refresh. [2025-09-17T19:32:00.313881] [INFO ] [REMOTE ] HPI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:32:00.415733] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-11. [2025-09-17T19:32:00.991452] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T19:32:01.215827] [INFO ] [REMOTE ] HPI: Fetching primary data for 2024-12. [2025-09-17T19:32:01.522910] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T19:32:02.015875] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-04. [2025-09-17T19:32:02.043917] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T19:32:02.815830] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-08. [2025-09-17T19:32:03.615778] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-04. [2025-09-17T19:32:03.788769] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T19:32:03.830803] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T19:32:04.415784] [INFO ] [REMOTE ] HOV: Fetching primary data for 2025-09. [2025-09-17T19:32:05.010912] [INFO ] [REMOTE ] HOV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T19:32:05.014154] [INFO ] [REMOTE ] HOV: Full fetch complete (19323 records). [2025-09-17T19:32:05.014258] [DEBUG] [VALIDATOR ] HOV: Validating primary data. [2025-09-17T19:32:05.221103] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-05. [2025-09-17T19:32:05.398000] [DEBUG] [VALIDATOR ] HOV: All expected trading days are present. [2025-09-17T19:32:05.398098] [DEBUG] [VALIDATOR ] HOV: Primary data validation passed. [2025-09-17T19:32:05.398711] [INFO ] [MAIN ] HOV: Fetched primary data is valid. [2025-09-17T19:32:05.398796] [DEBUG] [LOCAL ] HOV: Saving primary data. [2025-09-17T19:32:05.399605] [DEBUG] [LOCAL ] HOV: Trimmed 19323 records to 13751 (keeping 200 days of data) [2025-09-17T19:32:05.526194] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T19:32:05.549758] [DEBUG] [LOCAL ] HOV: Primary data saved (13751 records). [2025-09-17T19:32:05.549937] [INFO ] [MAIN ] HOV: Full history saved. [2025-09-17T19:32:05.550071] [INFO ] [MAIN ] Update Progress: 1042/2371 symbols completed. HOV took 26.1s. Estimated remaining: 3h 13m 57s. Rate: 6.9 symbols/min [2025-09-17T19:32:05.721243] [INFO ] [MAIN ] HPP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:32:05.774114] [DEBUG] [LOCAL ] HPP: Loaded 50711 existing records from primary storage. [2025-09-17T19:32:05.774271] [INFO ] [MAIN ] HPP: Loaded 50711 existing records. [2025-09-17T19:32:05.952009] [WARN ] [MAIN ] HPP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:32:05.952268] [INFO ] [MAIN ] HPP: Wiping existing primary data before full refresh. [2025-09-17T19:32:05.952313] [INFO ] [LOCAL ] HPP: Starting deletion of primary data. [2025-09-17T19:32:05.953278] [DEBUG] [LOCAL ] HPP: Deleted primary data file. [2025-09-17T19:32:05.953333] [INFO ] [MAIN ] HPP: Starting full primary refresh. [2025-09-17T19:32:06.020983] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-05. [2025-09-17T19:32:06.327986] [INFO ] [REMOTE ] HPP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:32:06.815782] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-11. [2025-09-17T19:32:07.208396] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T19:32:07.615868] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-06. [2025-09-17T19:32:08.004187] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T19:32:08.415761] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-06. [2025-09-17T19:32:08.506299] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T19:32:09.215777] [INFO ] [REMOTE ] HPP: Fetching primary data for 2024-12. [2025-09-17T19:32:09.353185] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T19:32:10.015806] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-07. [2025-09-17T19:32:10.139652] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T19:32:10.620381] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T19:32:10.815951] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-01. [2025-09-17T19:32:11.615796] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-07. [2025-09-17T19:32:11.837301] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T19:32:12.415788] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-08. [2025-09-17T19:32:12.589094] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T19:32:13.215847] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-01. [2025-09-17T19:32:13.794932] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T19:32:13.844961] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T19:32:14.015818] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-02. [2025-09-17T19:32:14.311447] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T19:32:14.627025] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T19:32:14.815782] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-08. [2025-09-17T19:32:15.615802] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-02. [2025-09-17T19:32:16.415767] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-03. [2025-09-17T19:32:16.815237] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T19:32:17.145931] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T19:32:17.182773] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T19:32:17.215780] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-04. [2025-09-17T19:32:18.018822] [INFO ] [REMOTE ] HPE: Fetching primary data for 2025-09. [2025-09-17T19:32:18.020323] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T19:32:18.815770] [INFO ] [REMOTE ] HP: Fetching primary data for 2025-09. [2025-09-17T19:32:18.870199] [INFO ] [REMOTE ] HPE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T19:32:18.878301] [INFO ] [REMOTE ] HPE: Full fetch complete (77587 records). [2025-09-17T19:32:18.878510] [DEBUG] [VALIDATOR ] HPE: Validating primary data. [2025-09-17T19:32:19.312282] [DEBUG] [VALIDATOR ] HPE: All expected trading days are present. [2025-09-17T19:32:19.312395] [DEBUG] [VALIDATOR ] HPE: Primary data validation passed. [2025-09-17T19:32:19.313391] [INFO ] [MAIN ] HPE: Fetched primary data is valid. [2025-09-17T19:32:19.313450] [DEBUG] [LOCAL ] HPE: Saving primary data. [2025-09-17T19:32:19.317926] [DEBUG] [LOCAL ] HPE: Trimmed 77587 records to 53697 (keeping 200 days of data) [2025-09-17T19:32:19.627879] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-05. [2025-09-17T19:32:19.674700] [INFO ] [REMOTE ] HP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T19:32:19.685824] [INFO ] [REMOTE ] HP: Full fetch complete (73746 records). [2025-09-17T19:32:19.687183] [DEBUG] [VALIDATOR ] HP: Validating primary data. [2025-09-17T19:32:20.114816] [DEBUG] [LOCAL ] HPE: Primary data saved (53697 records). [2025-09-17T19:32:20.134982] [INFO ] [MAIN ] HPE: Full history saved. [2025-09-17T19:32:20.139033] [INFO ] [MAIN ] Update Progress: 1043/2371 symbols completed. HPE took 40.7s. Estimated remaining: 3h 13m 55s. Rate: 6.8 symbols/min [2025-09-17T19:32:20.139526] [DEBUG] [VALIDATOR ] HP: All expected trading days are present. [2025-09-17T19:32:20.139726] [DEBUG] [VALIDATOR ] HP: Primary data validation passed. [2025-09-17T19:32:20.185795] [INFO ] [MAIN ] HP: Fetched primary data is valid. [2025-09-17T19:32:20.233942] [DEBUG] [LOCAL ] HP: Saving primary data. [2025-09-17T19:32:20.299120] [DEBUG] [LOCAL ] HP: Trimmed 73746 records to 51644 (keeping 200 days of data) [2025-09-17T19:32:20.320430] [INFO ] [MAIN ] HPQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:32:20.427712] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-03. [2025-09-17T19:32:20.469365] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T19:32:20.501075] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-09-17T19:32:20.501875] [INFO ] [MAIN ] HPQ: Loaded 53669 existing records. [2025-09-17T19:32:20.704482] [WARN ] [MAIN ] HPQ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:32:20.706952] [INFO ] [MAIN ] HPQ: Wiping existing primary data before full refresh. [2025-09-17T19:32:20.707974] [INFO ] [LOCAL ] HPQ: Starting deletion of primary data. [2025-09-17T19:32:20.709988] [DEBUG] [LOCAL ] HPQ: Deleted primary data file. [2025-09-17T19:32:20.710805] [INFO ] [MAIN ] HPQ: Starting full primary refresh. [2025-09-17T19:32:21.235737] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-06. [2025-09-17T19:32:21.240218] [INFO ] [REMOTE ] HPQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:32:21.340208] [DEBUG] [LOCAL ] HP: Primary data saved (51644 records). [2025-09-17T19:32:21.340355] [INFO ] [MAIN ] HP: Full history saved. [2025-09-17T19:32:21.340476] [INFO ] [MAIN ] Update Progress: 1044/2371 symbols completed. HP took 41.9s. Estimated remaining: 3h 13m 37s. Rate: 6.9 symbols/min [2025-09-17T19:32:21.510254] [INFO ] [MAIN ] HPS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:32:21.521951] [DEBUG] [LOCAL ] HPS: Loaded 10289 existing records from primary storage. [2025-09-17T19:32:21.522064] [INFO ] [MAIN ] HPS: Loaded 10289 existing records. [2025-09-17T19:32:21.700490] [WARN ] [MAIN ] HPS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:32:21.700774] [INFO ] [MAIN ] HPS: Wiping existing primary data before full refresh. [2025-09-17T19:32:21.700820] [INFO ] [LOCAL ] HPS: Starting deletion of primary data. [2025-09-17T19:32:21.701155] [DEBUG] [LOCAL ] HPS: Deleted primary data file. [2025-09-17T19:32:21.701199] [INFO ] [MAIN ] HPS: Starting full primary refresh. [2025-09-17T19:32:22.017949] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-11. [2025-09-17T19:32:22.071866] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T19:32:22.094122] [INFO ] [REMOTE ] HPS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:32:22.129554] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T19:32:22.815771] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-04. [2025-09-17T19:32:23.615774] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-07. [2025-09-17T19:32:23.886043] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T19:32:24.323579] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T19:32:24.415836] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2024-12. [2025-09-17T19:32:24.582581] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T19:32:25.215840] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-05. [2025-09-17T19:32:26.015865] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-08. [2025-09-17T19:32:26.216160] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T19:32:26.821150] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-11. [2025-09-17T19:32:26.859431] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T19:32:26.892443] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T19:32:27.615833] [INFO ] [REMOTE ] HPI: Fetching primary data for 2025-09. [2025-09-17T19:32:27.647293] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T19:32:28.205983] [INFO ] [REMOTE ] HPI: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T19:32:28.208800] [INFO ] [REMOTE ] HPI: Full fetch complete (13268 records). [2025-09-17T19:32:28.208872] [DEBUG] [VALIDATOR ] HPI: Validating primary data. [2025-09-17T19:32:28.420882] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-01. [2025-09-17T19:32:28.599867] [DEBUG] [VALIDATOR ] HPI: All expected trading days are present. [2025-09-17T19:32:28.599957] [DEBUG] [VALIDATOR ] HPI: Primary data validation passed. [2025-09-17T19:32:28.600313] [INFO ] [MAIN ] HPI: Fetched primary data is valid. [2025-09-17T19:32:28.600356] [DEBUG] [LOCAL ] HPI: Saving primary data. [2025-09-17T19:32:28.600927] [DEBUG] [LOCAL ] HPI: Trimmed 13268 records to 9976 (keeping 200 days of data) [2025-09-17T19:32:28.666485] [DEBUG] [LOCAL ] HPI: Primary data saved (9976 records). [2025-09-17T19:32:28.666658] [INFO ] [MAIN ] HPI: Full history saved. [2025-09-17T19:32:28.666775] [INFO ] [MAIN ] Update Progress: 1045/2371 symbols completed. HPI took 29.1s. Estimated remaining: 3h 13m 26s. Rate: 6.9 symbols/min [2025-09-17T19:32:28.841402] [INFO ] [MAIN ] HQH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:32:28.874075] [DEBUG] [LOCAL ] HQH: Loaded 24949 existing records from primary storage. [2025-09-17T19:32:28.874306] [INFO ] [MAIN ] HQH: Loaded 24949 existing records. [2025-09-17T19:32:29.094252] [WARN ] [MAIN ] HQH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:32:29.094571] [INFO ] [MAIN ] HQH: Wiping existing primary data before full refresh. [2025-09-17T19:32:29.094623] [INFO ] [LOCAL ] HQH: Starting deletion of primary data. [2025-09-17T19:32:29.095326] [DEBUG] [LOCAL ] HQH: Deleted primary data file. [2025-09-17T19:32:29.095385] [INFO ] [MAIN ] HQH: Starting full primary refresh. [2025-09-17T19:32:29.220928] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-06. [2025-09-17T19:32:29.472236] [INFO ] [REMOTE ] HQH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:32:30.015855] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-11. [2025-09-17T19:32:30.427563] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T19:32:30.815702] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-02. [2025-09-17T19:32:30.874548] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T19:32:31.067675] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T19:32:31.615776] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-07. [2025-09-17T19:32:32.415787] [INFO ] [REMOTE ] HQH: Fetching primary data for 2024-12. [2025-09-17T19:32:32.597354] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T19:32:32.920745] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T19:32:33.215823] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-08. [2025-09-17T19:32:33.751976] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T19:32:34.015830] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-01. [2025-09-17T19:32:34.815805] [INFO ] [REMOTE ] HPS: Fetching primary data for 2024-12. [2025-09-17T19:32:34.888004] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T19:32:35.167377] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T19:32:35.332239] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T19:32:35.615808] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-02. [2025-09-17T19:32:36.415790] [INFO ] [REMOTE ] HPP: Fetching primary data for 2025-09. [2025-09-17T19:32:36.817093] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T19:32:37.199865] [INFO ] [REMOTE ] HPP: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T19:32:37.206584] [INFO ] [REMOTE ] HPP: Full fetch complete (73173 records). [2025-09-17T19:32:37.206743] [DEBUG] [VALIDATOR ] HPP: Validating primary data. [2025-09-17T19:32:37.220916] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-01. [2025-09-17T19:32:37.628544] [DEBUG] [VALIDATOR ] HPP: All expected trading days are present. [2025-09-17T19:32:37.628721] [DEBUG] [VALIDATOR ] HPP: Primary data validation passed. [2025-09-17T19:32:37.629714] [INFO ] [MAIN ] HPP: Fetched primary data is valid. [2025-09-17T19:32:37.629762] [DEBUG] [LOCAL ] HPP: Saving primary data. [2025-09-17T19:32:37.631379] [DEBUG] [LOCAL ] HPP: Trimmed 73173 records to 50736 (keeping 200 days of data) [2025-09-17T19:32:37.937352] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T19:32:37.957589] [DEBUG] [LOCAL ] HPP: Primary data saved (50736 records). [2025-09-17T19:32:37.957799] [INFO ] [MAIN ] HPP: Full history saved. [2025-09-17T19:32:37.957931] [INFO ] [MAIN ] Update Progress: 1046/2371 symbols completed. HPP took 32.4s. Estimated remaining: 3h 13m 18s. Rate: 6.9 symbols/min [2025-09-17T19:32:38.021495] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-03. [2025-09-17T19:32:38.135163] [INFO ] [MAIN ] HQL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:32:38.152468] [DEBUG] [LOCAL ] HQL: Loaded 16177 existing records from primary storage. [2025-09-17T19:32:38.152608] [INFO ] [MAIN ] HQL: Loaded 16177 existing records. [2025-09-17T19:32:38.338167] [WARN ] [MAIN ] HQL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:32:38.338479] [INFO ] [MAIN ] HQL: Wiping existing primary data before full refresh. [2025-09-17T19:32:38.338541] [INFO ] [LOCAL ] HQL: Starting deletion of primary data. [2025-09-17T19:32:38.339182] [DEBUG] [LOCAL ] HQL: Deleted primary data file. [2025-09-17T19:32:38.339270] [INFO ] [MAIN ] HQL: Starting full primary refresh. [2025-09-17T19:32:38.704005] [INFO ] [REMOTE ] HQL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:32:38.815831] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-03. [2025-09-17T19:32:39.615839] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-02. [2025-09-17T19:32:39.923609] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T19:32:39.983515] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T19:32:40.415806] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-04. [2025-09-17T19:32:40.472842] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T19:32:41.215741] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-11. [2025-09-17T19:32:41.609171] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T19:32:41.913189] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-17T19:32:42.015820] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-04. [2025-09-17T19:32:42.815780] [INFO ] [REMOTE ] HQL: Fetching primary data for 2024-12. [2025-09-17T19:32:43.615828] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-05. [2025-09-17T19:32:43.856624] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T19:32:44.025010] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T19:32:44.415803] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-05. [2025-09-17T19:32:44.866880] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T19:32:45.215802] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-03. [2025-09-17T19:32:45.803699] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T19:32:46.015821] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-06. [2025-09-17T19:32:46.644749] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-17T19:32:46.815804] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-01. [2025-09-17T19:32:47.163912] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T19:32:47.615856] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-06. [2025-09-17T19:32:47.889989] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T19:32:48.415806] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-04. [2025-09-17T19:32:49.164388] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T19:32:49.215821] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-02. [2025-09-17T19:32:49.591262] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T19:32:50.015829] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-05. [2025-09-17T19:32:50.178037] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T19:32:50.471230] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T19:32:50.815831] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-07. [2025-09-17T19:32:51.615785] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-03. [2025-09-17T19:32:52.415833] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-06. [2025-09-17T19:32:52.679903] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T19:32:52.731324] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T19:32:52.907537] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T19:32:53.215826] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-04. [2025-09-17T19:32:54.015832] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-07. [2025-09-17T19:32:54.227608] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T19:32:54.815797] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-05. [2025-09-17T19:32:55.252559] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T19:32:55.426943] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T19:32:55.615815] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-08. [2025-09-17T19:32:56.415818] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-06. [2025-09-17T19:32:57.215887] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-08. [2025-09-17T19:32:57.357453] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T19:32:57.596153] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T19:32:58.015805] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-07. [2025-09-17T19:32:58.211259] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T19:32:58.815801] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-07. [2025-09-17T19:32:58.958473] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T19:32:59.615823] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-08. [2025-09-17T19:33:00.107092] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T19:33:00.415775] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-08. [2025-09-17T19:33:00.521774] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T19:33:01.215790] [INFO ] [REMOTE ] HQH: Fetching primary data for 2025-09. [2025-09-17T19:33:01.411432] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T19:33:01.663108] [INFO ] [REMOTE ] HQH: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T19:33:01.667159] [INFO ] [REMOTE ] HQH: Full fetch complete (37449 records). [2025-09-17T19:33:01.667468] [DEBUG] [VALIDATOR ] HQH: Validating primary data. [2025-09-17T19:33:02.029924] [INFO ] [REMOTE ] HQL: Fetching primary data for 2025-09. [2025-09-17T19:33:02.086300] [DEBUG] [VALIDATOR ] HQH: All expected trading days are present. [2025-09-17T19:33:02.086423] [DEBUG] [VALIDATOR ] HQH: Primary data validation passed. [2025-09-17T19:33:02.087489] [INFO ] [MAIN ] HQH: Fetched primary data is valid. [2025-09-17T19:33:02.087556] [DEBUG] [LOCAL ] HQH: Saving primary data. [2025-09-17T19:33:02.089037] [DEBUG] [LOCAL ] HQH: Trimmed 37449 records to 24920 (keeping 200 days of data) [2025-09-17T19:33:02.257296] [DEBUG] [LOCAL ] HQH: Primary data saved (24920 records). [2025-09-17T19:33:02.257439] [INFO ] [MAIN ] HQH: Full history saved. [2025-09-17T19:33:02.257549] [INFO ] [MAIN ] Update Progress: 1047/2371 symbols completed. HQH took 33.6s. Estimated remaining: 3h 13m 29s. Rate: 6.8 symbols/min [2025-09-17T19:33:02.435988] [INFO ] [MAIN ] HR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:33:02.502722] [DEBUG] [LOCAL ] HR: Loaded 51981 existing records from primary storage. [2025-09-17T19:33:02.502911] [INFO ] [MAIN ] HR: Loaded 51981 existing records. [2025-09-17T19:33:02.684109] [WARN ] [MAIN ] HR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:33:02.684398] [INFO ] [MAIN ] HR: Wiping existing primary data before full refresh. [2025-09-17T19:33:02.684444] [INFO ] [LOCAL ] HR: Starting deletion of primary data. [2025-09-17T19:33:02.685743] [DEBUG] [LOCAL ] HR: Deleted primary data file. [2025-09-17T19:33:02.685819] [INFO ] [MAIN ] HR: Starting full primary refresh. [2025-09-17T19:33:02.831486] [INFO ] [REMOTE ] HPQ: Fetching primary data for 2025-09. [2025-09-17T19:33:03.104064] [INFO ] [REMOTE ] HR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:33:03.532752] [INFO ] [REMOTE ] HQL: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T19:33:03.535197] [INFO ] [REMOTE ] HQL: Full fetch complete (24041 records). [2025-09-17T19:33:03.535274] [DEBUG] [VALIDATOR ] HQL: Validating primary data. [2025-09-17T19:33:03.620883] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-11. [2025-09-17T19:33:03.951084] [DEBUG] [VALIDATOR ] HQL: All expected trading days are present. [2025-09-17T19:33:03.951188] [DEBUG] [VALIDATOR ] HQL: Primary data validation passed. [2025-09-17T19:33:03.951822] [INFO ] [MAIN ] HQL: Fetched primary data is valid. [2025-09-17T19:33:03.951866] [DEBUG] [LOCAL ] HQL: Saving primary data. [2025-09-17T19:33:03.952955] [DEBUG] [LOCAL ] HQL: Trimmed 24041 records to 16166 (keeping 200 days of data) [2025-09-17T19:33:04.056522] [DEBUG] [LOCAL ] HQL: Primary data saved (16166 records). [2025-09-17T19:33:04.056683] [INFO ] [MAIN ] HQL: Full history saved. [2025-09-17T19:33:04.056778] [INFO ] [MAIN ] Update Progress: 1048/2371 symbols completed. HQL took 26.1s. Estimated remaining: 3h 13m 12s. Rate: 6.8 symbols/min [2025-09-17T19:33:04.229373] [INFO ] [MAIN ] HRB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:33:04.275911] [DEBUG] [LOCAL ] HRB: Loaded 48619 existing records from primary storage. [2025-09-17T19:33:04.276106] [INFO ] [MAIN ] HRB: Loaded 48619 existing records. [2025-09-17T19:33:04.420928] [INFO ] [REMOTE ] HPS: Fetching primary data for 2025-09. [2025-09-17T19:33:04.462295] [WARN ] [MAIN ] HRB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:33:04.462579] [INFO ] [MAIN ] HRB: Wiping existing primary data before full refresh. [2025-09-17T19:33:04.462664] [INFO ] [LOCAL ] HRB: Starting deletion of primary data. [2025-09-17T19:33:04.463705] [DEBUG] [LOCAL ] HRB: Deleted primary data file. [2025-09-17T19:33:04.463792] [INFO ] [MAIN ] HRB: Starting full primary refresh. [2025-09-17T19:33:04.852276] [INFO ] [REMOTE ] HRB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:33:05.020711] [INFO ] [REMOTE ] HPQ: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-17T19:33:05.029631] [INFO ] [REMOTE ] HPQ: Full fetch complete (77540 records). [2025-09-17T19:33:05.029964] [DEBUG] [VALIDATOR ] HPQ: Validating primary data. [2025-09-17T19:33:05.160613] [INFO ] [REMOTE ] HPS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T19:33:05.179738] [INFO ] [REMOTE ] HPS: Full fetch complete (15121 records). [2025-09-17T19:33:05.190570] [DEBUG] [VALIDATOR ] HPS: Validating primary data. [2025-09-17T19:33:05.217773] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-11. [2025-09-17T19:33:05.803975] [DEBUG] [VALIDATOR ] HPQ: All expected trading days are present. [2025-09-17T19:33:05.809728] [DEBUG] [VALIDATOR ] HPQ: Primary data validation passed. [2025-09-17T19:33:05.816432] [INFO ] [MAIN ] HPQ: Fetched primary data is valid. [2025-09-17T19:33:05.826845] [DEBUG] [LOCAL ] HPQ: Saving primary data. [2025-09-17T19:33:05.895225] [DEBUG] [VALIDATOR ] HPS: All expected trading days are present. [2025-09-17T19:33:05.895401] [DEBUG] [VALIDATOR ] HPS: Primary data validation passed. [2025-09-17T19:33:05.895674] [INFO ] [MAIN ] HPS: Fetched primary data is valid. [2025-09-17T19:33:05.895736] [DEBUG] [LOCAL ] HPS: Saving primary data. [2025-09-17T19:33:05.896815] [DEBUG] [LOCAL ] HPQ: Trimmed 77540 records to 53669 (keeping 200 days of data) [2025-09-17T19:33:05.897251] [DEBUG] [LOCAL ] HPS: Trimmed 15121 records to 10274 (keeping 200 days of data) [2025-09-17T19:33:06.094416] [DEBUG] [LOCAL ] HPS: Primary data saved (10274 records). [2025-09-17T19:33:06.095091] [INFO ] [MAIN ] HPS: Full history saved. [2025-09-17T19:33:06.095237] [INFO ] [MAIN ] Update Progress: 1049/2371 symbols completed. HPS took 44.8s. Estimated remaining: 3h 12m 54s. Rate: 6.9 symbols/min [2025-09-17T19:33:06.279898] [INFO ] [MAIN ] HRI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:33:06.421329] [DEBUG] [LOCAL ] HRI: Loaded 33312 existing records from primary storage. [2025-09-17T19:33:06.422154] [INFO ] [MAIN ] HRI: Loaded 33312 existing records. [2025-09-17T19:33:06.634656] [WARN ] [MAIN ] HRI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:33:06.636611] [INFO ] [MAIN ] HRI: Wiping existing primary data before full refresh. [2025-09-17T19:33:06.639708] [INFO ] [LOCAL ] HRI: Starting deletion of primary data. [2025-09-17T19:33:06.677972] [DEBUG] [LOCAL ] HRI: Deleted primary data file. [2025-09-17T19:33:06.712667] [INFO ] [MAIN ] HRI: Starting full primary refresh. [2025-09-17T19:33:06.757273] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-11 (3.14 seconds). [2025-09-17T19:33:06.775451] [INFO ] [REMOTE ] HR: Fetching primary data for 2024-12. [2025-09-17T19:33:07.170810] [INFO ] [REMOTE ] HRI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:33:07.174070] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-11. [2025-09-17T19:33:07.182594] [DEBUG] [LOCAL ] HPQ: Primary data saved (53669 records). [2025-09-17T19:33:07.182843] [INFO ] [MAIN ] HPQ: Full history saved. [2025-09-17T19:33:07.183009] [INFO ] [MAIN ] Update Progress: 1050/2371 symbols completed. HPQ took 47.0s. Estimated remaining: 3h 12m 36s. Rate: 6.9 symbols/min [2025-09-17T19:33:07.383688] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-17T19:33:07.405090] [INFO ] [MAIN ] HRL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:33:07.464876] [DEBUG] [LOCAL ] HRL: Loaded 53088 existing records from primary storage. [2025-09-17T19:33:07.465058] [INFO ] [MAIN ] HRL: Loaded 53088 existing records. [2025-09-17T19:33:07.620863] [INFO ] [REMOTE ] HRB: Fetching primary data for 2024-12. [2025-09-17T19:33:07.649865] [WARN ] [MAIN ] HRL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:33:07.650062] [INFO ] [MAIN ] HRL: Wiping existing primary data before full refresh. [2025-09-17T19:33:07.650107] [INFO ] [LOCAL ] HRL: Starting deletion of primary data. [2025-09-17T19:33:07.651361] [DEBUG] [LOCAL ] HRL: Deleted primary data file. [2025-09-17T19:33:07.651413] [INFO ] [MAIN ] HRL: Starting full primary refresh. [2025-09-17T19:33:08.010283] [INFO ] [REMOTE ] HRL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:33:08.252984] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T19:33:08.415773] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-11. [2025-09-17T19:33:08.466925] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T19:33:09.215774] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-01. [2025-09-17T19:33:09.338983] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T19:33:10.015794] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-01. [2025-09-17T19:33:10.197920] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T19:33:10.673575] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T19:33:10.815780] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-02. [2025-09-17T19:33:11.615777] [INFO ] [REMOTE ] HRI: Fetching primary data for 2024-12. [2025-09-17T19:33:11.649892] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T19:33:12.380543] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T19:33:12.415722] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-03. [2025-09-17T19:33:12.909747] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T19:33:13.215797] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-01. [2025-09-17T19:33:14.015785] [INFO ] [REMOTE ] HRL: Fetching primary data for 2024-12. [2025-09-17T19:33:14.120835] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T19:33:14.583726] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T19:33:14.815803] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-04. [2025-09-17T19:33:15.615860] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-02. [2025-09-17T19:33:16.415833] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-02. [2025-09-17T19:33:16.908329] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2024-12 (2.89 seconds). [2025-09-17T19:33:17.126970] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-17T19:33:17.215805] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-05. [2025-09-17T19:33:17.786111] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-17T19:33:17.857572] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T19:33:18.015822] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-03. [2025-09-17T19:33:18.815793] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-01. [2025-09-17T19:33:18.950348] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T19:33:19.533176] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T19:33:19.615805] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-06. [2025-09-17T19:33:20.415863] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-03. [2025-09-17T19:33:20.644108] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T19:33:21.215906] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-04. [2025-09-17T19:33:21.292235] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T19:33:21.828632] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T19:33:22.015881] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-02. [2025-09-17T19:33:22.763848] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T19:33:22.815859] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-07. [2025-09-17T19:33:23.506901] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T19:33:23.615801] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-03. [2025-09-17T19:33:24.415865] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-05. [2025-09-17T19:33:24.651559] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T19:33:25.215879] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-04. [2025-09-17T19:33:25.361672] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T19:33:25.946729] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T19:33:26.015836] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-04. [2025-09-17T19:33:26.815852] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-06. [2025-09-17T19:33:26.886558] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T19:33:27.615891] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-05. [2025-09-17T19:33:27.833270] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T19:33:28.415835] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-08. [2025-09-17T19:33:28.477469] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T19:33:29.215810] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-07. [2025-09-17T19:33:29.263875] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T19:33:30.015792] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-06. [2025-09-17T19:33:30.121984] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T19:33:30.677347] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T19:33:30.815768] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-05. [2025-09-17T19:33:31.615752] [INFO ] [REMOTE ] HR: Fetching primary data for 2025-09. [2025-09-17T19:33:31.834381] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T19:33:32.415760] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-07. [2025-09-17T19:33:32.479775] [INFO ] [REMOTE ] HR: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T19:33:32.486560] [INFO ] [REMOTE ] HR: Full fetch complete (74644 records). [2025-09-17T19:33:32.486728] [DEBUG] [VALIDATOR ] HR: Validating primary data. [2025-09-17T19:33:32.884016] [DEBUG] [VALIDATOR ] HR: All expected trading days are present. [2025-09-17T19:33:32.884345] [DEBUG] [VALIDATOR ] HR: Primary data validation passed. [2025-09-17T19:33:32.885389] [INFO ] [MAIN ] HR: Fetched primary data is valid. [2025-09-17T19:33:32.885445] [DEBUG] [LOCAL ] HR: Saving primary data. [2025-09-17T19:33:32.899370] [DEBUG] [LOCAL ] HR: Trimmed 74644 records to 51970 (keeping 200 days of data) [2025-09-17T19:33:32.981083] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T19:33:33.224207] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-06. [2025-09-17T19:33:33.264283] [DEBUG] [LOCAL ] HR: Primary data saved (51970 records). [2025-09-17T19:33:33.264393] [INFO ] [MAIN ] HR: Full history saved. [2025-09-17T19:33:33.264476] [INFO ] [MAIN ] Update Progress: 1051/2371 symbols completed. HR took 31.0s. Estimated remaining: 3h 12m 49s. Rate: 6.8 symbols/min [2025-09-17T19:33:33.432128] [INFO ] [MAIN ] HRTG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:33:33.462769] [DEBUG] [LOCAL ] HRTG: Loaded 32087 existing records from primary storage. [2025-09-17T19:33:33.462934] [INFO ] [MAIN ] HRTG: Loaded 32087 existing records. [2025-09-17T19:33:33.648030] [WARN ] [MAIN ] HRTG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:33:33.648388] [INFO ] [MAIN ] HRTG: Wiping existing primary data before full refresh. [2025-09-17T19:33:33.648482] [INFO ] [LOCAL ] HRTG: Starting deletion of primary data. [2025-09-17T19:33:33.649201] [DEBUG] [LOCAL ] HRTG: Deleted primary data file. [2025-09-17T19:33:33.649299] [INFO ] [MAIN ] HRTG: Starting full primary refresh. [2025-09-17T19:33:34.020154] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-08. [2025-09-17T19:33:34.039084] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T19:33:34.042253] [INFO ] [REMOTE ] HRTG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:33:34.811921] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T19:33:34.821779] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-08. [2025-09-17T19:33:35.194947] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T19:33:35.615827] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-07. [2025-09-17T19:33:36.415846] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-11. [2025-09-17T19:33:36.474404] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T19:33:37.215840] [INFO ] [REMOTE ] HRB: Fetching primary data for 2025-09. [2025-09-17T19:33:37.430863] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T19:33:37.459562] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T19:33:38.009790] [INFO ] [REMOTE ] HRB: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T19:33:38.015682] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2024-12. [2025-09-17T19:33:38.017328] [INFO ] [REMOTE ] HRB: Full fetch complete (69671 records). [2025-09-17T19:33:38.017432] [DEBUG] [VALIDATOR ] HRB: Validating primary data. [2025-09-17T19:33:38.412705] [DEBUG] [VALIDATOR ] HRB: All expected trading days are present. [2025-09-17T19:33:38.412797] [DEBUG] [VALIDATOR ] HRB: Primary data validation passed. [2025-09-17T19:33:38.413743] [INFO ] [MAIN ] HRB: Fetched primary data is valid. [2025-09-17T19:33:38.413815] [DEBUG] [LOCAL ] HRB: Saving primary data. [2025-09-17T19:33:38.415201] [DEBUG] [LOCAL ] HRB: Trimmed 69671 records to 48638 (keeping 200 days of data) [2025-09-17T19:33:38.770755] [DEBUG] [LOCAL ] HRB: Primary data saved (48638 records). [2025-09-17T19:33:38.770919] [INFO ] [MAIN ] HRB: Full history saved. [2025-09-17T19:33:38.771037] [INFO ] [MAIN ] Update Progress: 1052/2371 symbols completed. HRB took 34.7s. Estimated remaining: 3h 12m 36s. Rate: 6.8 symbols/min [2025-09-17T19:33:38.821035] [INFO ] [REMOTE ] HRI: Fetching primary data for 2025-09. [2025-09-17T19:33:38.956046] [INFO ] [MAIN ] HSBC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:33:39.005431] [DEBUG] [LOCAL ] HSBC: Loaded 51293 existing records from primary storage. [2025-09-17T19:33:39.005673] [INFO ] [MAIN ] HSBC: Loaded 51293 existing records. [2025-09-17T19:33:39.181868] [WARN ] [MAIN ] HSBC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:33:39.182103] [INFO ] [MAIN ] HSBC: Wiping existing primary data before full refresh. [2025-09-17T19:33:39.182148] [INFO ] [LOCAL ] HSBC: Starting deletion of primary data. [2025-09-17T19:33:39.183174] [DEBUG] [LOCAL ] HSBC: Deleted primary data file. [2025-09-17T19:33:39.183223] [INFO ] [MAIN ] HSBC: Starting full primary refresh. [2025-09-17T19:33:39.505029] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T19:33:39.516193] [INFO ] [REMOTE ] HRI: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:33:39.541241] [INFO ] [REMOTE ] HRI: Full fetch complete (45450 records). [2025-09-17T19:33:39.561591] [DEBUG] [VALIDATOR ] HRI: Validating primary data. [2025-09-17T19:33:39.620862] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-08. [2025-09-17T19:33:39.657588] [INFO ] [REMOTE ] HSBC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:33:40.003516] [DEBUG] [VALIDATOR ] HRI: All expected trading days are present. [2025-09-17T19:33:40.003613] [DEBUG] [VALIDATOR ] HRI: Primary data validation passed. [2025-09-17T19:33:40.004466] [INFO ] [MAIN ] HRI: Fetched primary data is valid. [2025-09-17T19:33:40.004517] [DEBUG] [LOCAL ] HRI: Saving primary data. [2025-09-17T19:33:40.005746] [DEBUG] [LOCAL ] HRI: Trimmed 45450 records to 33291 (keeping 200 days of data) [2025-09-17T19:33:40.222742] [DEBUG] [LOCAL ] HRI: Primary data saved (33291 records). [2025-09-17T19:33:40.222912] [INFO ] [MAIN ] HRI: Full history saved. [2025-09-17T19:33:40.224369] [INFO ] [MAIN ] Update Progress: 1053/2371 symbols completed. HRI took 34.1s. Estimated remaining: 3h 12m 18s. Rate: 6.9 symbols/min [2025-09-17T19:33:40.402105] [INFO ] [MAIN ] HSHP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:33:40.415882] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-01. [2025-09-17T19:33:40.429212] [DEBUG] [LOCAL ] HSHP: Loaded 15645 existing records from primary storage. [2025-09-17T19:33:40.429369] [INFO ] [MAIN ] HSHP: Loaded 15645 existing records. [2025-09-17T19:33:40.614410] [WARN ] [MAIN ] HSHP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:33:40.614718] [INFO ] [MAIN ] HSHP: Wiping existing primary data before full refresh. [2025-09-17T19:33:40.614765] [INFO ] [LOCAL ] HSHP: Starting deletion of primary data. [2025-09-17T19:33:40.615144] [DEBUG] [LOCAL ] HSHP: Deleted primary data file. [2025-09-17T19:33:40.615189] [INFO ] [MAIN ] HSHP: Starting full primary refresh. [2025-09-17T19:33:40.966153] [INFO ] [REMOTE ] HSHP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:33:41.215745] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-11. [2025-09-17T19:33:41.349268] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T19:33:41.651242] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T19:33:41.825575] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T19:33:42.015800] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2024-12. [2025-09-17T19:33:42.815816] [INFO ] [REMOTE ] HRL: Fetching primary data for 2025-09. [2025-09-17T19:33:43.071545] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T19:33:43.605252] [INFO ] [REMOTE ] HRL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T19:33:43.612318] [INFO ] [REMOTE ] HRL: Full fetch complete (76520 records). [2025-09-17T19:33:43.612451] [DEBUG] [VALIDATOR ] HRL: Validating primary data. [2025-09-17T19:33:43.624277] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-02. [2025-09-17T19:33:44.031935] [DEBUG] [VALIDATOR ] HRL: All expected trading days are present. [2025-09-17T19:33:44.032024] [DEBUG] [VALIDATOR ] HRL: Primary data validation passed. [2025-09-17T19:33:44.033216] [INFO ] [MAIN ] HRL: Fetched primary data is valid. [2025-09-17T19:33:44.033265] [DEBUG] [LOCAL ] HRL: Saving primary data. [2025-09-17T19:33:44.034914] [DEBUG] [LOCAL ] HRL: Trimmed 76520 records to 53082 (keeping 200 days of data) [2025-09-17T19:33:44.382321] [DEBUG] [LOCAL ] HRL: Primary data saved (53082 records). [2025-09-17T19:33:44.382478] [INFO ] [MAIN ] HRL: Full history saved. [2025-09-17T19:33:44.382594] [INFO ] [MAIN ] Update Progress: 1054/2371 symbols completed. HRL took 37.2s. Estimated remaining: 3h 12m 4s. Rate: 6.9 symbols/min [2025-09-17T19:33:44.420864] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-01. [2025-09-17T19:33:44.560951] [INFO ] [MAIN ] HSY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:33:44.577416] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T19:33:44.648125] [DEBUG] [LOCAL ] HSY: Loaded 50531 existing records from primary storage. [2025-09-17T19:33:44.648294] [INFO ] [MAIN ] HSY: Loaded 50531 existing records. [2025-09-17T19:33:44.854923] [WARN ] [MAIN ] HSY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:33:44.855177] [INFO ] [MAIN ] HSY: Wiping existing primary data before full refresh. [2025-09-17T19:33:44.855232] [INFO ] [LOCAL ] HSY: Starting deletion of primary data. [2025-09-17T19:33:44.856528] [DEBUG] [LOCAL ] HSY: Deleted primary data file. [2025-09-17T19:33:44.856591] [INFO ] [MAIN ] HSY: Starting full primary refresh. [2025-09-17T19:33:45.222800] [INFO ] [REMOTE ] HSY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:33:45.222940] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-11. [2025-09-17T19:33:45.558011] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T19:33:46.015780] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-11. [2025-09-17T19:33:46.815763] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-03. [2025-09-17T19:33:46.973358] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T19:33:47.615784] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2024-12. [2025-09-17T19:33:47.852258] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T19:33:48.238927] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T19:33:48.415829] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-04. [2025-09-17T19:33:49.215825] [INFO ] [REMOTE ] HSY: Fetching primary data for 2024-12. [2025-09-17T19:33:49.274389] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T19:33:49.840539] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T19:33:50.015811] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-02. [2025-09-17T19:33:50.815694] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-01. [2025-09-17T19:33:50.963368] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T19:33:51.117443] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T19:33:51.615776] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-01. [2025-09-17T19:33:52.415782] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-05. [2025-09-17T19:33:52.633427] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T19:33:53.216066] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-02. [2025-09-17T19:33:53.223204] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T19:33:53.777867] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T19:33:54.015782] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-06. [2025-09-17T19:33:54.815834] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-02. [2025-09-17T19:33:55.147287] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-17T19:33:55.441187] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T19:33:55.615781] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-07. [2025-09-17T19:33:56.329517] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T19:33:56.415832] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-03. [2025-09-17T19:33:56.960840] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T19:33:57.215813] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-08. [2025-09-17T19:33:57.540418] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T19:33:58.015783] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-04. [2025-09-17T19:33:58.597799] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T19:33:58.815787] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-03. [2025-09-17T19:33:58.850121] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T19:33:59.615807] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-05. [2025-09-17T19:34:00.278255] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T19:34:00.415835] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-06. [2025-09-17T19:34:00.596844] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T19:34:01.215800] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-03. [2025-09-17T19:34:01.469824] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T19:34:02.015796] [INFO ] [REMOTE ] HRTG: Fetching primary data for 2025-09. [2025-09-17T19:34:02.669579] [INFO ] [REMOTE ] HRTG: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T19:34:02.674195] [INFO ] [REMOTE ] HRTG: Full fetch complete (41456 records). [2025-09-17T19:34:02.674279] [DEBUG] [VALIDATOR ] HRTG: Validating primary data. [2025-09-17T19:34:02.820845] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-07. [2025-09-17T19:34:03.054096] [DEBUG] [VALIDATOR ] HRTG: All expected trading days are present. [2025-09-17T19:34:03.054185] [DEBUG] [VALIDATOR ] HRTG: Primary data validation passed. [2025-09-17T19:34:03.054906] [INFO ] [MAIN ] HRTG: Fetched primary data is valid. [2025-09-17T19:34:03.054969] [DEBUG] [LOCAL ] HRTG: Saving primary data. [2025-09-17T19:34:03.056895] [DEBUG] [LOCAL ] HRTG: Trimmed 41456 records to 32250 (keeping 200 days of data) [2025-09-17T19:34:03.269180] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T19:34:03.297925] [DEBUG] [LOCAL ] HRTG: Primary data saved (32250 records). [2025-09-17T19:34:03.298055] [INFO ] [MAIN ] HRTG: Full history saved. [2025-09-17T19:34:03.298166] [INFO ] [MAIN ] Update Progress: 1055/2371 symbols completed. HRTG took 30.0s. Estimated remaining: 3h 12m 8s. Rate: 6.8 symbols/min [2025-09-17T19:34:03.466150] [INFO ] [MAIN ] HTB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:34:03.466345] [DEBUG] [LOCAL ] HTB: No existing data file found in primary storage. [2025-09-17T19:34:03.466382] [WARN ] [MAIN ] HTB: No existing data found, performing full refresh instead. [2025-09-17T19:34:03.466500] [INFO ] [MAIN ] HTB: Wiping existing primary data before full refresh. [2025-09-17T19:34:03.466539] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-17T19:34:03.466578] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-17T19:34:03.466610] [INFO ] [MAIN ] HTB: Starting full primary refresh. [2025-09-17T19:34:03.622842] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-04. [2025-09-17T19:34:03.836017] [INFO ] [REMOTE ] HTB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:34:03.903283] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T19:34:04.415827] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-11. [2025-09-17T19:34:04.621705] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:34:04.622045] [WARN ] [REMOTE ] HTB: No data returned for month 2024-11 [2025-09-17T19:34:05.215836] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-04. [2025-09-17T19:34:05.538008] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T19:34:06.015793] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-08. [2025-09-17T19:34:06.815815] [INFO ] [REMOTE ] HTB: Fetching primary data for 2024-12. [2025-09-17T19:34:06.832413] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T19:34:07.023862] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:34:07.024209] [WARN ] [REMOTE ] HTB: No data returned for month 2024-12 [2025-09-17T19:34:07.193140] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T19:34:07.615772] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-05. [2025-09-17T19:34:08.415780] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-01. [2025-09-17T19:34:08.611880] [DEBUG] [REMOTE ] HTB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:34:08.612210] [WARN ] [REMOTE ] HTB: No data returned for month 2025-01 [2025-09-17T19:34:09.215804] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-05. [2025-09-17T19:34:09.661129] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T19:34:10.015774] [INFO ] [REMOTE ] HSHP: Fetching primary data for 2025-09. [2025-09-17T19:34:10.644031] [INFO ] [REMOTE ] HSHP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T19:34:10.646516] [INFO ] [REMOTE ] HSHP: Full fetch complete (23400 records). [2025-09-17T19:34:10.646620] [DEBUG] [VALIDATOR ] HSHP: Validating primary data. [2025-09-17T19:34:10.818449] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-06. [2025-09-17T19:34:11.041156] [DEBUG] [VALIDATOR ] HSHP: All expected trading days are present. [2025-09-17T19:34:11.041259] [DEBUG] [VALIDATOR ] HSHP: Primary data validation passed. [2025-09-17T19:34:11.042003] [INFO ] [MAIN ] HSHP: Fetched primary data is valid. [2025-09-17T19:34:11.042125] [DEBUG] [LOCAL ] HSHP: Saving primary data. [2025-09-17T19:34:11.043341] [DEBUG] [LOCAL ] HSHP: Trimmed 23400 records to 15651 (keeping 200 days of data) [2025-09-17T19:34:11.163574] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T19:34:11.179218] [DEBUG] [LOCAL ] HSHP: Primary data saved (15651 records). [2025-09-17T19:34:11.179676] [INFO ] [MAIN ] HSHP: Full history saved. [2025-09-17T19:34:11.179758] [INFO ] [MAIN ] Update Progress: 1056/2371 symbols completed. HSHP took 31.0s. Estimated remaining: 3h 11m 58s. Rate: 6.9 symbols/min [2025-09-17T19:34:11.348518] [INFO ] [MAIN ] HTD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:34:11.364048] [DEBUG] [LOCAL ] HTD: Loaded 13409 existing records from primary storage. [2025-09-17T19:34:11.364176] [INFO ] [MAIN ] HTD: Loaded 13409 existing records. [2025-09-17T19:34:11.540716] [WARN ] [MAIN ] HTD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:34:11.540992] [INFO ] [MAIN ] HTD: Wiping existing primary data before full refresh. [2025-09-17T19:34:11.541036] [INFO ] [LOCAL ] HTD: Starting deletion of primary data. [2025-09-17T19:34:11.541477] [DEBUG] [LOCAL ] HTD: Deleted primary data file. [2025-09-17T19:34:11.541528] [INFO ] [MAIN ] HTD: Starting full primary refresh. [2025-09-17T19:34:11.620899] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-06. [2025-09-17T19:34:11.901468] [INFO ] [REMOTE ] HTD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:34:12.415757] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-02. [2025-09-17T19:34:12.608865] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T19:34:12.822879] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T19:34:13.215775] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-03. [2025-09-17T19:34:13.486427] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T19:34:14.015796] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-11. [2025-09-17T19:34:14.067551] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T19:34:14.815775] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-07. [2025-09-17T19:34:15.075496] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T19:34:15.615788] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-07. [2025-09-17T19:34:16.415832] [INFO ] [REMOTE ] HTD: Fetching primary data for 2024-12. [2025-09-17T19:34:16.840408] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T19:34:17.215790] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-04. [2025-09-17T19:34:17.242911] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T19:34:17.388514] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T19:34:17.946371] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T19:34:18.015838] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-08. [2025-09-17T19:34:18.815778] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-08. [2025-09-17T19:34:19.615795] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-05. [2025-09-17T19:34:19.831152] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T19:34:20.011547] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-05 (0.40 seconds). [2025-09-17T19:34:20.415844] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-06. [2025-09-17T19:34:20.660829] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T19:34:21.112493] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T19:34:21.215824] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-01. [2025-09-17T19:34:22.015825] [INFO ] [REMOTE ] HSY: Fetching primary data for 2025-09. [2025-09-17T19:34:22.090586] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T19:34:22.815826] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-07. [2025-09-17T19:34:22.960370] [INFO ] [REMOTE ] HSY: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T19:34:22.967113] [INFO ] [REMOTE ] HSY: Full fetch complete (73753 records). [2025-09-17T19:34:22.967291] [DEBUG] [VALIDATOR ] HSY: Validating primary data. [2025-09-17T19:34:23.395475] [DEBUG] [VALIDATOR ] HSY: All expected trading days are present. [2025-09-17T19:34:23.395565] [DEBUG] [VALIDATOR ] HSY: Primary data validation passed. [2025-09-17T19:34:23.396544] [INFO ] [MAIN ] HSY: Fetched primary data is valid. [2025-09-17T19:34:23.396595] [DEBUG] [LOCAL ] HSY: Saving primary data. [2025-09-17T19:34:23.398025] [DEBUG] [LOCAL ] HSY: Trimmed 73753 records to 50499 (keeping 200 days of data) [2025-09-17T19:34:23.626562] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-02. [2025-09-17T19:34:23.635997] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T19:34:23.748000] [DEBUG] [LOCAL ] HSY: Primary data saved (50499 records). [2025-09-17T19:34:23.748170] [INFO ] [MAIN ] HSY: Full history saved. [2025-09-17T19:34:23.748264] [INFO ] [MAIN ] Update Progress: 1057/2371 symbols completed. HSY took 39.4s. Estimated remaining: 3h 11m 54s. Rate: 6.8 symbols/min [2025-09-17T19:34:23.920552] [INFO ] [MAIN ] HTFC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:34:23.920823] [DEBUG] [LOCAL ] HTFC: No existing data file found in primary storage. [2025-09-17T19:34:23.920863] [WARN ] [MAIN ] HTFC: No existing data found, performing full refresh instead. [2025-09-17T19:34:23.920983] [INFO ] [MAIN ] HTFC: Wiping existing primary data before full refresh. [2025-09-17T19:34:23.921022] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-17T19:34:23.921062] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-17T19:34:23.921094] [INFO ] [MAIN ] HTFC: Starting full primary refresh. [2025-09-17T19:34:24.285362] [INFO ] [REMOTE ] HTFC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:34:24.415742] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-11. [2025-09-17T19:34:24.460487] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T19:34:24.837477] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T19:34:25.215799] [INFO ] [REMOTE ] HSBC: Fetching primary data for 2025-09. [2025-09-17T19:34:26.003166] [INFO ] [REMOTE ] HSBC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T19:34:26.009692] [INFO ] [REMOTE ] HSBC: Full fetch complete (73390 records). [2025-09-17T19:34:26.009813] [DEBUG] [VALIDATOR ] HSBC: Validating primary data. [2025-09-17T19:34:26.016541] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2024-12. [2025-09-17T19:34:26.426919] [DEBUG] [VALIDATOR ] HSBC: All expected trading days are present. [2025-09-17T19:34:26.427017] [DEBUG] [VALIDATOR ] HSBC: Primary data validation passed. [2025-09-17T19:34:26.427967] [INFO ] [MAIN ] HSBC: Fetched primary data is valid. [2025-09-17T19:34:26.428018] [DEBUG] [LOCAL ] HSBC: Saving primary data. [2025-09-17T19:34:26.429523] [DEBUG] [LOCAL ] HSBC: Trimmed 73390 records to 51268 (keeping 200 days of data) [2025-09-17T19:34:26.632691] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T19:34:26.770453] [DEBUG] [LOCAL ] HSBC: Primary data saved (51268 records). [2025-09-17T19:34:26.770686] [INFO ] [MAIN ] HSBC: Full history saved. [2025-09-17T19:34:26.770788] [INFO ] [MAIN ] Update Progress: 1058/2371 symbols completed. HSBC took 48.0s. Estimated remaining: 3h 11m 38s. Rate: 6.9 symbols/min [2025-09-17T19:34:26.825043] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-01. [2025-09-17T19:34:26.944353] [INFO ] [MAIN ] HTGC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:34:26.991019] [DEBUG] [LOCAL ] HTGC: Loaded 47771 existing records from primary storage. [2025-09-17T19:34:26.991172] [INFO ] [MAIN ] HTGC: Loaded 47771 existing records. [2025-09-17T19:34:27.178508] [WARN ] [MAIN ] HTGC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:34:27.178858] [INFO ] [MAIN ] HTGC: Wiping existing primary data before full refresh. [2025-09-17T19:34:27.178913] [INFO ] [LOCAL ] HTGC: Starting deletion of primary data. [2025-09-17T19:34:27.180109] [DEBUG] [LOCAL ] HTGC: Deleted primary data file. [2025-09-17T19:34:27.180191] [INFO ] [MAIN ] HTGC: Starting full primary refresh. [2025-09-17T19:34:27.270940] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T19:34:27.554043] [INFO ] [REMOTE ] HTGC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:34:27.615784] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-03. [2025-09-17T19:34:28.415796] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-08. [2025-09-17T19:34:28.522667] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T19:34:28.981878] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T19:34:29.215782] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-02. [2025-09-17T19:34:29.563483] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T19:34:30.015782] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-03. [2025-09-17T19:34:30.576773] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T19:34:30.815771] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-04. [2025-09-17T19:34:31.615777] [INFO ] [REMOTE ] HTB: Fetching primary data for 2025-09. [2025-09-17T19:34:31.785726] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T19:34:32.083436] [INFO ] [REMOTE ] HTB: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T19:34:32.085672] [INFO ] [REMOTE ] HTB: Full fetch complete (7100 records). [2025-09-17T19:34:32.085767] [DEBUG] [VALIDATOR ] HTB: Validating primary data. [2025-09-17T19:34:32.352886] [WARN ] [VALIDATOR ] HTB: Validation failed - insufficient historical data. Have 139 unique days, need 200 days [2025-09-17T19:34:32.353290] [FATAL] [MAIN ] HTB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:34:32.353380] [WARN ] [MAIN ] HTB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:34:32.353452] [INFO ] [LOCAL ] HTB: Starting deletion of primary data. [2025-09-17T19:34:32.353569] [DEBUG] [LOCAL ] HTB: No primary data file found to delete. [2025-09-17T19:34:32.353637] [INFO ] [LOCAL ] HTB: Starting deletion of derivative data. [2025-09-17T19:34:32.353748] [DEBUG] [LOCAL ] HTB: No derivative data file found to delete. [2025-09-17T19:34:32.353888] [INFO ] [MAIN ] Update Progress: 1059/2371 symbols completed. HTB took 29.1s. Estimated remaining: 3h 11m 25s. Rate: 6.9 symbols/min [2025-09-17T19:34:32.421025] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-04. [2025-09-17T19:34:32.644455] [INFO ] [MAIN ] HTH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:34:32.699925] [DEBUG] [LOCAL ] HTH: Loaded 32999 existing records from primary storage. [2025-09-17T19:34:32.700136] [INFO ] [MAIN ] HTH: Loaded 32999 existing records. [2025-09-17T19:34:32.943419] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T19:34:32.985627] [WARN ] [MAIN ] HTH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:34:32.985938] [INFO ] [MAIN ] HTH: Wiping existing primary data before full refresh. [2025-09-17T19:34:32.986003] [INFO ] [LOCAL ] HTH: Starting deletion of primary data. [2025-09-17T19:34:32.986999] [DEBUG] [LOCAL ] HTH: Deleted primary data file. [2025-09-17T19:34:32.987079] [INFO ] [MAIN ] HTH: Starting full primary refresh. [2025-09-17T19:34:33.221040] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-11. [2025-09-17T19:34:33.374018] [INFO ] [REMOTE ] HTH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:34:34.015798] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-05. [2025-09-17T19:34:34.743602] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T19:34:34.815791] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-11. [2025-09-17T19:34:35.204751] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-17T19:34:35.615829] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-05. [2025-09-17T19:34:35.954983] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T19:34:36.162726] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T19:34:36.415768] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2024-12. [2025-09-17T19:34:37.215791] [INFO ] [REMOTE ] HTH: Fetching primary data for 2024-12. [2025-09-17T19:34:38.015693] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-06. [2025-09-17T19:34:38.123584] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T19:34:38.410671] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T19:34:38.569893] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T19:34:38.815795] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-07. [2025-09-17T19:34:39.615796] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-01. [2025-09-17T19:34:39.853183] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T19:34:40.415779] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-08. [2025-09-17T19:34:40.748244] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T19:34:41.215795] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-01. [2025-09-17T19:34:41.245481] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T19:34:42.015779] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-06. [2025-09-17T19:34:42.354992] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T19:34:42.815790] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-02. [2025-09-17T19:34:42.854355] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T19:34:43.615878] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-07. [2025-09-17T19:34:43.849692] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-07 (0.23 seconds). [2025-09-17T19:34:44.307229] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T19:34:44.415773] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-08. [2025-09-17T19:34:44.631179] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-08 (0.22 seconds). [2025-09-17T19:34:45.215774] [INFO ] [REMOTE ] HTD: Fetching primary data for 2025-09. [2025-09-17T19:34:46.005924] [INFO ] [REMOTE ] HTD: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T19:34:46.008400] [INFO ] [REMOTE ] HTD: Full fetch complete (18792 records). [2025-09-17T19:34:46.008575] [DEBUG] [VALIDATOR ] HTD: Validating primary data. [2025-09-17T19:34:46.020819] [INFO ] [REMOTE ] HTFC: Fetching primary data for 2025-09. [2025-09-17T19:34:46.353501] [INFO ] [REMOTE ] HTFC: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-17T19:34:46.378192] [INFO ] [REMOTE ] HTFC: Full fetch complete (854 records). [2025-09-17T19:34:46.387538] [DEBUG] [VALIDATOR ] HTFC: Validating primary data. [2025-09-17T19:34:46.479177] [DEBUG] [VALIDATOR ] HTD: All expected trading days are present. [2025-09-17T19:34:46.506414] [DEBUG] [VALIDATOR ] HTD: Primary data validation passed. [2025-09-17T19:34:46.517402] [INFO ] [MAIN ] HTD: Fetched primary data is valid. [2025-09-17T19:34:46.517555] [DEBUG] [LOCAL ] HTD: Saving primary data. [2025-09-17T19:34:46.564195] [DEBUG] [LOCAL ] HTD: Trimmed 18792 records to 13433 (keeping 200 days of data) [2025-09-17T19:34:46.598931] [WARN ] [VALIDATOR ] HTFC: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-17T19:34:46.641018] [FATAL] [MAIN ] HTFC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:34:46.641413] [WARN ] [MAIN ] HTFC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:34:46.641548] [INFO ] [LOCAL ] HTFC: Starting deletion of primary data. [2025-09-17T19:34:46.641664] [DEBUG] [LOCAL ] HTFC: No primary data file found to delete. [2025-09-17T19:34:46.659073] [INFO ] [LOCAL ] HTFC: Starting deletion of derivative data. [2025-09-17T19:34:46.659772] [DEBUG] [LOCAL ] HTFC: No derivative data file found to delete. [2025-09-17T19:34:46.660427] [INFO ] [MAIN ] Update Progress: 1060/2371 symbols completed. HTFC took 22.9s. Estimated remaining: 3h 11m 23s. Rate: 6.8 symbols/min [2025-09-17T19:34:46.818484] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-03. [2025-09-17T19:34:46.846396] [INFO ] [MAIN ] HUBB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:34:46.880577] [DEBUG] [LOCAL ] HTD: Primary data saved (13433 records). [2025-09-17T19:34:46.880824] [INFO ] [MAIN ] HTD: Full history saved. [2025-09-17T19:34:46.880964] [INFO ] [MAIN ] Update Progress: 1061/2371 symbols completed. HTD took 35.7s. Estimated remaining: 3h 11m 4s. Rate: 6.9 symbols/min [2025-09-17T19:34:47.074268] [DEBUG] [LOCAL ] HUBB: Loaded 37695 existing records from primary storage. [2025-09-17T19:34:47.075611] [INFO ] [MAIN ] HUBS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:34:47.075825] [INFO ] [MAIN ] HUBB: Loaded 37695 existing records. [2025-09-17T19:34:47.260525] [WARN ] [MAIN ] HUBB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:34:47.270580] [INFO ] [MAIN ] HUBB: Wiping existing primary data before full refresh. [2025-09-17T19:34:47.270697] [INFO ] [LOCAL ] HUBB: Starting deletion of primary data. [2025-09-17T19:34:47.271867] [DEBUG] [LOCAL ] HUBB: Deleted primary data file. [2025-09-17T19:34:47.271921] [INFO ] [MAIN ] HUBB: Starting full primary refresh. [2025-09-17T19:34:47.396899] [DEBUG] [LOCAL ] HUBS: Loaded 39811 existing records from primary storage. [2025-09-17T19:34:47.412771] [INFO ] [MAIN ] HUBS: Loaded 39811 existing records. [2025-09-17T19:34:47.620857] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-02. [2025-09-17T19:34:47.812734] [WARN ] [MAIN ] HUBS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:34:47.815386] [INFO ] [MAIN ] HUBS: Wiping existing primary data before full refresh. [2025-09-17T19:34:47.815751] [INFO ] [LOCAL ] HUBS: Starting deletion of primary data. [2025-09-17T19:34:47.842442] [DEBUG] [LOCAL ] HUBS: Deleted primary data file. [2025-09-17T19:34:47.865739] [INFO ] [MAIN ] HUBS: Starting full primary refresh. [2025-09-17T19:34:47.944156] [INFO ] [REMOTE ] HUBB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:34:48.267450] [INFO ] [REMOTE ] HUBS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:34:48.289170] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T19:34:48.415784] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-11. [2025-09-17T19:34:49.215768] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-11. [2025-09-17T19:34:49.321530] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T19:34:50.015770] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-03. [2025-09-17T19:34:50.106895] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T19:34:50.726039] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T19:34:50.815849] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2024-12. [2025-09-17T19:34:51.620818] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2024-12. [2025-09-17T19:34:51.640452] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T19:34:51.733968] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T19:34:52.415791] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-04. [2025-09-17T19:34:52.752297] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T19:34:53.215789] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-01. [2025-09-17T19:34:54.015777] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-01. [2025-09-17T19:34:54.194997] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T19:34:54.751956] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T19:34:54.815831] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-05. [2025-09-17T19:34:55.615782] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-02. [2025-09-17T19:34:55.690304] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T19:34:56.342842] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T19:34:56.415882] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-02. [2025-09-17T19:34:57.215792] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-06. [2025-09-17T19:34:58.015827] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-04. [2025-09-17T19:34:58.107534] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T19:34:58.773192] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T19:34:58.815874] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-03. [2025-09-17T19:34:59.330672] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T19:34:59.615867] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-07. [2025-09-17T19:35:00.219517] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-02 (4.60 seconds). [2025-09-17T19:35:00.380979] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T19:35:00.415819] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-03. [2025-09-17T19:35:01.215808] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-05. [2025-09-17T19:35:01.489199] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T19:35:02.015791] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-04. [2025-09-17T19:35:02.339237] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T19:35:02.653957] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T19:35:02.815790] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-04. [2025-09-17T19:35:03.615800] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-08. [2025-09-17T19:35:03.703999] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T19:35:04.415801] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-06. [2025-09-17T19:35:04.834172] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T19:35:05.174450] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T19:35:05.215844] [INFO ] [REMOTE ] HTGC: Fetching primary data for 2025-09. [2025-09-17T19:35:05.436754] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T19:35:05.990082] [INFO ] [REMOTE ] HTGC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T19:35:05.997541] [INFO ] [REMOTE ] HTGC: Full fetch complete (67997 records). [2025-09-17T19:35:05.997924] [DEBUG] [VALIDATOR ] HTGC: Validating primary data. [2025-09-17T19:35:06.021006] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-05. [2025-09-17T19:35:06.450178] [DEBUG] [VALIDATOR ] HTGC: All expected trading days are present. [2025-09-17T19:35:06.450340] [DEBUG] [VALIDATOR ] HTGC: Primary data validation passed. [2025-09-17T19:35:06.451762] [INFO ] [MAIN ] HTGC: Fetched primary data is valid. [2025-09-17T19:35:06.451822] [DEBUG] [LOCAL ] HTGC: Saving primary data. [2025-09-17T19:35:06.453991] [DEBUG] [LOCAL ] HTGC: Trimmed 67997 records to 47767 (keeping 200 days of data) [2025-09-17T19:35:06.789497] [DEBUG] [LOCAL ] HTGC: Primary data saved (47767 records). [2025-09-17T19:35:06.789751] [INFO ] [MAIN ] HTGC: Full history saved. [2025-09-17T19:35:06.789955] [INFO ] [MAIN ] Update Progress: 1062/2371 symbols completed. HTGC took 40.0s. Estimated remaining: 3h 11m 9s. Rate: 6.8 symbols/min [2025-09-17T19:35:06.822393] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-05. [2025-09-17T19:35:07.012531] [INFO ] [MAIN ] HUM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:35:07.068537] [DEBUG] [LOCAL ] HUM: Loaded 48832 existing records from primary storage. [2025-09-17T19:35:07.068739] [INFO ] [MAIN ] HUM: Loaded 48832 existing records. [2025-09-17T19:35:07.252064] [WARN ] [MAIN ] HUM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:35:07.252380] [INFO ] [MAIN ] HUM: Wiping existing primary data before full refresh. [2025-09-17T19:35:07.252429] [INFO ] [LOCAL ] HUM: Starting deletion of primary data. [2025-09-17T19:35:07.253623] [DEBUG] [LOCAL ] HUM: Deleted primary data file. [2025-09-17T19:35:07.253715] [INFO ] [MAIN ] HUM: Starting full primary refresh. [2025-09-17T19:35:07.617424] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-07. [2025-09-17T19:35:07.643186] [INFO ] [REMOTE ] HUM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:35:07.807594] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T19:35:08.415783] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-11. [2025-09-17T19:35:08.597177] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T19:35:08.830190] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T19:35:09.215850] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-06. [2025-09-17T19:35:10.015818] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-08. [2025-09-17T19:35:10.295956] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T19:35:10.678981] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T19:35:10.815737] [INFO ] [REMOTE ] HUM: Fetching primary data for 2024-12. [2025-09-17T19:35:11.615811] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-07. [2025-09-17T19:35:11.705079] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T19:35:12.243314] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T19:35:12.415764] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-01. [2025-09-17T19:35:12.743618] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T19:35:13.215775] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-06. [2025-09-17T19:35:14.015780] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-08. [2025-09-17T19:35:14.244980] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T19:35:14.325372] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T19:35:14.815770] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-02. [2025-09-17T19:35:15.382368] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T19:35:15.615753] [INFO ] [REMOTE ] HUBB: Fetching primary data for 2025-09. [2025-09-17T19:35:16.126161] [INFO ] [REMOTE ] HUBB: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T19:35:16.130910] [INFO ] [REMOTE ] HUBB: Full fetch complete (53303 records). [2025-09-17T19:35:16.131002] [DEBUG] [VALIDATOR ] HUBB: Validating primary data. [2025-09-17T19:35:16.419614] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-07. [2025-09-17T19:35:16.526825] [DEBUG] [VALIDATOR ] HUBB: All expected trading days are present. [2025-09-17T19:35:16.526932] [DEBUG] [VALIDATOR ] HUBB: Primary data validation passed. [2025-09-17T19:35:16.527871] [INFO ] [MAIN ] HUBB: Fetched primary data is valid. [2025-09-17T19:35:16.527924] [DEBUG] [LOCAL ] HUBB: Saving primary data. [2025-09-17T19:35:16.529367] [DEBUG] [LOCAL ] HUBB: Trimmed 53303 records to 37613 (keeping 200 days of data) [2025-09-17T19:35:16.655477] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T19:35:16.818873] [DEBUG] [LOCAL ] HUBB: Primary data saved (37613 records). [2025-09-17T19:35:16.819038] [INFO ] [MAIN ] HUBB: Full history saved. [2025-09-17T19:35:16.819152] [INFO ] [MAIN ] Update Progress: 1063/2371 symbols completed. HUBB took 30.2s. Estimated remaining: 3h 11m 2s. Rate: 6.8 symbols/min [2025-09-17T19:35:16.991509] [INFO ] [MAIN ] HUN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:35:17.065808] [DEBUG] [LOCAL ] HUN: Loaded 53188 existing records from primary storage. [2025-09-17T19:35:17.066029] [INFO ] [MAIN ] HUN: Loaded 53188 existing records. [2025-09-17T19:35:17.240869] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-03. [2025-09-17T19:35:17.245896] [WARN ] [MAIN ] HUN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:35:17.246086] [INFO ] [MAIN ] HUN: Wiping existing primary data before full refresh. [2025-09-17T19:35:17.246129] [INFO ] [LOCAL ] HUN: Starting deletion of primary data. [2025-09-17T19:35:17.247844] [DEBUG] [LOCAL ] HUN: Deleted primary data file. [2025-09-17T19:35:17.247895] [INFO ] [MAIN ] HUN: Starting full primary refresh. [2025-09-17T19:35:17.606601] [INFO ] [REMOTE ] HUN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:35:18.015756] [INFO ] [REMOTE ] HTH: Fetching primary data for 2025-09. [2025-09-17T19:35:18.052954] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T19:35:18.679246] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T19:35:18.701696] [INFO ] [REMOTE ] HTH: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T19:35:18.706391] [INFO ] [REMOTE ] HTH: Full fetch complete (46265 records). [2025-09-17T19:35:18.706514] [DEBUG] [VALIDATOR ] HTH: Validating primary data. [2025-09-17T19:35:18.820839] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-08. [2025-09-17T19:35:19.093346] [DEBUG] [VALIDATOR ] HTH: All expected trading days are present. [2025-09-17T19:35:19.093432] [DEBUG] [VALIDATOR ] HTH: Primary data validation passed. [2025-09-17T19:35:19.094132] [INFO ] [MAIN ] HTH: Fetched primary data is valid. [2025-09-17T19:35:19.094178] [DEBUG] [LOCAL ] HTH: Saving primary data. [2025-09-17T19:35:19.095192] [DEBUG] [LOCAL ] HTH: Trimmed 46265 records to 32885 (keeping 200 days of data) [2025-09-17T19:35:19.304692] [DEBUG] [LOCAL ] HTH: Primary data saved (32885 records). [2025-09-17T19:35:19.304846] [INFO ] [MAIN ] HTH: Full history saved. [2025-09-17T19:35:19.304948] [INFO ] [MAIN ] Update Progress: 1064/2371 symbols completed. HTH took 47.0s. Estimated remaining: 3h 10m 45s. Rate: 6.9 symbols/min [2025-09-17T19:35:19.473034] [INFO ] [MAIN ] HUYA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:35:19.517189] [DEBUG] [LOCAL ] HUYA: Loaded 44349 existing records from primary storage. [2025-09-17T19:35:19.517352] [INFO ] [MAIN ] HUYA: Loaded 44349 existing records. [2025-09-17T19:35:19.617540] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-11. [2025-09-17T19:35:19.700084] [WARN ] [MAIN ] HUYA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:35:19.700351] [INFO ] [MAIN ] HUYA: Wiping existing primary data before full refresh. [2025-09-17T19:35:19.700437] [INFO ] [LOCAL ] HUYA: Starting deletion of primary data. [2025-09-17T19:35:19.701239] [DEBUG] [LOCAL ] HUYA: Deleted primary data file. [2025-09-17T19:35:19.701289] [INFO ] [MAIN ] HUYA: Starting full primary refresh. [2025-09-17T19:35:20.072165] [INFO ] [REMOTE ] HUYA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:35:20.415795] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-11. [2025-09-17T19:35:20.544816] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T19:35:21.215830] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-04. [2025-09-17T19:35:21.544616] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T19:35:21.621628] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T19:35:22.015842] [INFO ] [REMOTE ] HUN: Fetching primary data for 2024-12. [2025-09-17T19:35:22.815924] [INFO ] [REMOTE ] HUBS: Fetching primary data for 2025-09. [2025-09-17T19:35:23.168826] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T19:35:23.570477] [INFO ] [REMOTE ] HUBS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T19:35:23.576448] [INFO ] [REMOTE ] HUBS: Full fetch complete (55243 records). [2025-09-17T19:35:23.576589] [DEBUG] [VALIDATOR ] HUBS: Validating primary data. [2025-09-17T19:35:23.622206] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2024-12. [2025-09-17T19:35:24.043978] [DEBUG] [VALIDATOR ] HUBS: All expected trading days are present. [2025-09-17T19:35:24.044176] [DEBUG] [VALIDATOR ] HUBS: Primary data validation passed. [2025-09-17T19:35:24.045060] [INFO ] [MAIN ] HUBS: Fetched primary data is valid. [2025-09-17T19:35:24.045228] [DEBUG] [LOCAL ] HUBS: Saving primary data. [2025-09-17T19:35:24.088527] [DEBUG] [LOCAL ] HUBS: Trimmed 55243 records to 39848 (keeping 200 days of data) [2025-09-17T19:35:24.090335] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-17T19:35:24.352823] [DEBUG] [LOCAL ] HUBS: Primary data saved (39848 records). [2025-09-17T19:35:24.352982] [INFO ] [MAIN ] HUBS: Full history saved. [2025-09-17T19:35:24.353945] [INFO ] [MAIN ] Update Progress: 1065/2371 symbols completed. HUBS took 37.5s. Estimated remaining: 3h 10m 32s. Rate: 6.9 symbols/min [2025-09-17T19:35:24.421002] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-01. [2025-09-17T19:35:24.529849] [INFO ] [MAIN ] HVT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:35:24.548965] [DEBUG] [LOCAL ] HVT: Loaded 16336 existing records from primary storage. [2025-09-17T19:35:24.549108] [INFO ] [MAIN ] HVT: Loaded 16336 existing records. [2025-09-17T19:35:24.743065] [WARN ] [MAIN ] HVT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:35:24.743358] [INFO ] [MAIN ] HVT: Wiping existing primary data before full refresh. [2025-09-17T19:35:24.743407] [INFO ] [LOCAL ] HVT: Starting deletion of primary data. [2025-09-17T19:35:24.743881] [DEBUG] [LOCAL ] HVT: Deleted primary data file. [2025-09-17T19:35:24.743937] [INFO ] [MAIN ] HVT: Starting full primary refresh. [2025-09-17T19:35:25.221169] [INFO ] [REMOTE ] HVT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:35:25.221715] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-11. [2025-09-17T19:35:25.374870] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T19:35:26.015869] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-01. [2025-09-17T19:35:26.105186] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T19:35:26.630743] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T19:35:26.815803] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-02. [2025-09-17T19:35:27.615799] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-05. [2025-09-17T19:35:27.649273] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T19:35:27.994955] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T19:35:28.415781] [INFO ] [REMOTE ] HVT: Fetching primary data for 2024-12. [2025-09-17T19:35:29.215871] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-02. [2025-09-17T19:35:29.470813] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T19:35:29.618231] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T19:35:30.015872] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-01. [2025-09-17T19:35:30.515002] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T19:35:30.815808] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-03. [2025-09-17T19:35:30.828956] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T19:35:31.615869] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-03. [2025-09-17T19:35:32.415850] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-06. [2025-09-17T19:35:32.584821] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T19:35:32.947883] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T19:35:33.215773] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-04. [2025-09-17T19:35:34.015821] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-04. [2025-09-17T19:35:34.106252] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T19:35:34.815795] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-02. [2025-09-17T19:35:34.969864] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T19:35:35.113676] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T19:35:35.621279] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-05. [2025-09-17T19:35:35.623222] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T19:35:36.415790] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-03. [2025-09-17T19:35:37.215778] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-07. [2025-09-17T19:35:37.469892] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T19:35:37.494220] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T19:35:38.015863] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-06. [2025-09-17T19:35:38.815817] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-04. [2025-09-17T19:35:38.864807] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T19:35:39.615826] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-08. [2025-09-17T19:35:39.708042] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T19:35:39.866986] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T19:35:40.415815] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-07. [2025-09-17T19:35:41.203585] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T19:35:41.215674] [INFO ] [REMOTE ] HUM: Fetching primary data for 2025-09. [2025-09-17T19:35:41.764387] [INFO ] [REMOTE ] HUM: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T19:35:41.771351] [INFO ] [REMOTE ] HUM: Full fetch complete (70754 records). [2025-09-17T19:35:41.771531] [DEBUG] [VALIDATOR ] HUM: Validating primary data. [2025-09-17T19:35:42.020957] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-05. [2025-09-17T19:35:42.197400] [DEBUG] [VALIDATOR ] HUM: All expected trading days are present. [2025-09-17T19:35:42.197558] [DEBUG] [VALIDATOR ] HUM: Primary data validation passed. [2025-09-17T19:35:42.198555] [INFO ] [MAIN ] HUM: Fetched primary data is valid. [2025-09-17T19:35:42.198655] [DEBUG] [LOCAL ] HUM: Saving primary data. [2025-09-17T19:35:42.200473] [DEBUG] [LOCAL ] HUM: Trimmed 70754 records to 48841 (keeping 200 days of data) [2025-09-17T19:35:42.351071] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T19:35:42.561371] [DEBUG] [LOCAL ] HUM: Primary data saved (48841 records). [2025-09-17T19:35:42.561522] [INFO ] [MAIN ] HUM: Full history saved. [2025-09-17T19:35:42.561622] [INFO ] [MAIN ] Update Progress: 1066/2371 symbols completed. HUM took 35.8s. Estimated remaining: 3h 10m 35s. Rate: 6.8 symbols/min [2025-09-17T19:35:42.734808] [INFO ] [MAIN ] HWM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:35:42.790408] [DEBUG] [LOCAL ] HWM: Loaded 53037 existing records from primary storage. [2025-09-17T19:35:42.790565] [INFO ] [MAIN ] HWM: Loaded 53037 existing records. [2025-09-17T19:35:42.821419] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-05. [2025-09-17T19:35:42.979149] [WARN ] [MAIN ] HWM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:35:42.979423] [INFO ] [MAIN ] HWM: Wiping existing primary data before full refresh. [2025-09-17T19:35:42.979470] [INFO ] [LOCAL ] HWM: Starting deletion of primary data. [2025-09-17T19:35:42.980687] [DEBUG] [LOCAL ] HWM: Deleted primary data file. [2025-09-17T19:35:42.980742] [INFO ] [MAIN ] HWM: Starting full primary refresh. [2025-09-17T19:35:43.325884] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T19:35:43.413493] [INFO ] [REMOTE ] HWM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:35:43.615784] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-06. [2025-09-17T19:35:44.206332] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T19:35:44.335855] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T19:35:44.415769] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-07. [2025-09-17T19:35:45.215847] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-08. [2025-09-17T19:35:45.350013] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T19:35:46.015834] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-06. [2025-09-17T19:35:46.815776] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-11. [2025-09-17T19:35:46.895834] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T19:35:47.349424] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T19:35:47.615787] [INFO ] [REMOTE ] HUN: Fetching primary data for 2025-09. [2025-09-17T19:35:48.396171] [INFO ] [REMOTE ] HUN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T19:35:48.403957] [INFO ] [REMOTE ] HUN: Full fetch complete (76312 records). [2025-09-17T19:35:48.404196] [DEBUG] [VALIDATOR ] HUN: Validating primary data. [2025-09-17T19:35:48.420854] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-07. [2025-09-17T19:35:48.751740] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T19:35:48.860062] [DEBUG] [VALIDATOR ] HUN: All expected trading days are present. [2025-09-17T19:35:48.860164] [DEBUG] [VALIDATOR ] HUN: Primary data validation passed. [2025-09-17T19:35:48.861219] [INFO ] [MAIN ] HUN: Fetched primary data is valid. [2025-09-17T19:35:48.861271] [DEBUG] [LOCAL ] HUN: Saving primary data. [2025-09-17T19:35:48.863333] [DEBUG] [LOCAL ] HUN: Trimmed 76312 records to 53201 (keeping 200 days of data) [2025-09-17T19:35:49.205094] [DEBUG] [LOCAL ] HUN: Primary data saved (53201 records). [2025-09-17T19:35:49.205262] [INFO ] [MAIN ] HUN: Full history saved. [2025-09-17T19:35:49.205380] [INFO ] [MAIN ] Update Progress: 1067/2371 symbols completed. HUN took 32.4s. Estimated remaining: 3h 10m 24s. Rate: 6.8 symbols/min [2025-09-17T19:35:49.226565] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-08. [2025-09-17T19:35:49.401377] [INFO ] [MAIN ] HXL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:35:49.447439] [DEBUG] [LOCAL ] HXL: Loaded 46295 existing records from primary storage. [2025-09-17T19:35:49.447603] [INFO ] [MAIN ] HXL: Loaded 46295 existing records. [2025-09-17T19:35:49.629489] [WARN ] [MAIN ] HXL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:35:49.629786] [INFO ] [MAIN ] HXL: Wiping existing primary data before full refresh. [2025-09-17T19:35:49.629837] [INFO ] [LOCAL ] HXL: Starting deletion of primary data. [2025-09-17T19:35:49.630865] [DEBUG] [LOCAL ] HXL: Deleted primary data file. [2025-09-17T19:35:49.630922] [INFO ] [MAIN ] HXL: Starting full primary refresh. [2025-09-17T19:35:50.000828] [INFO ] [REMOTE ] HXL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:35:50.015733] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-11. [2025-09-17T19:35:50.145220] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T19:35:50.337930] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T19:35:50.815781] [INFO ] [REMOTE ] HWM: Fetching primary data for 2024-12. [2025-09-17T19:35:51.500260] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T19:35:51.615791] [INFO ] [REMOTE ] HXL: Fetching primary data for 2024-12. [2025-09-17T19:35:52.415792] [INFO ] [REMOTE ] HVT: Fetching primary data for 2025-09. [2025-09-17T19:35:52.576672] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T19:35:52.868225] [INFO ] [REMOTE ] HVT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T19:35:52.870490] [INFO ] [REMOTE ] HVT: Full fetch complete (23830 records). [2025-09-17T19:35:52.870565] [DEBUG] [VALIDATOR ] HVT: Validating primary data. [2025-09-17T19:35:53.219793] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-01. [2025-09-17T19:35:53.255861] [DEBUG] [VALIDATOR ] HVT: All expected trading days are present. [2025-09-17T19:35:53.255970] [DEBUG] [VALIDATOR ] HVT: Primary data validation passed. [2025-09-17T19:35:53.256764] [INFO ] [MAIN ] HVT: Fetched primary data is valid. [2025-09-17T19:35:53.256947] [DEBUG] [LOCAL ] HVT: Saving primary data. [2025-09-17T19:35:53.259512] [DEBUG] [LOCAL ] HVT: Trimmed 23830 records to 16284 (keeping 200 days of data) [2025-09-17T19:35:53.365522] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T19:35:53.400385] [DEBUG] [LOCAL ] HVT: Primary data saved (16284 records). [2025-09-17T19:35:53.400553] [INFO ] [MAIN ] HVT: Full history saved. [2025-09-17T19:35:53.400665] [INFO ] [MAIN ] Update Progress: 1068/2371 symbols completed. HVT took 29.0s. Estimated remaining: 3h 10m 9s. Rate: 6.9 symbols/min [2025-09-17T19:35:53.573630] [INFO ] [MAIN ] HY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:35:53.585318] [DEBUG] [LOCAL ] HY: Loaded 10442 existing records from primary storage. [2025-09-17T19:35:53.585419] [INFO ] [MAIN ] HY: Loaded 10442 existing records. [2025-09-17T19:35:53.769295] [WARN ] [MAIN ] HY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:35:53.769625] [INFO ] [MAIN ] HY: Wiping existing primary data before full refresh. [2025-09-17T19:35:53.769695] [INFO ] [LOCAL ] HY: Starting deletion of primary data. [2025-09-17T19:35:53.770009] [DEBUG] [LOCAL ] HY: Deleted primary data file. [2025-09-17T19:35:53.770253] [INFO ] [MAIN ] HY: Starting full primary refresh. [2025-09-17T19:35:54.020984] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-08. [2025-09-17T19:35:54.125341] [INFO ] [REMOTE ] HY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:35:54.815765] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-11. [2025-09-17T19:35:55.302020] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-17T19:35:55.375026] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T19:35:55.615757] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-01. [2025-09-17T19:35:55.693669] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T19:35:56.415790] [INFO ] [REMOTE ] HY: Fetching primary data for 2024-12. [2025-09-17T19:35:57.021005] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T19:35:57.217532] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-02. [2025-09-17T19:35:57.219338] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T19:35:58.015795] [INFO ] [REMOTE ] HUYA: Fetching primary data for 2025-09. [2025-09-17T19:35:58.547582] [INFO ] [REMOTE ] HUYA: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T19:35:58.554084] [INFO ] [REMOTE ] HUYA: Full fetch complete (63668 records). [2025-09-17T19:35:58.554230] [DEBUG] [VALIDATOR ] HUYA: Validating primary data. [2025-09-17T19:35:58.822807] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-01. [2025-09-17T19:35:58.969047] [DEBUG] [VALIDATOR ] HUYA: All expected trading days are present. [2025-09-17T19:35:58.969149] [DEBUG] [VALIDATOR ] HUYA: Primary data validation passed. [2025-09-17T19:35:58.970038] [INFO ] [MAIN ] HUYA: Fetched primary data is valid. [2025-09-17T19:35:58.970105] [DEBUG] [LOCAL ] HUYA: Saving primary data. [2025-09-17T19:35:58.971727] [DEBUG] [LOCAL ] HUYA: Trimmed 63668 records to 44401 (keeping 200 days of data) [2025-09-17T19:35:59.115392] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T19:35:59.278979] [DEBUG] [LOCAL ] HUYA: Primary data saved (44401 records). [2025-09-17T19:35:59.279133] [INFO ] [MAIN ] HUYA: Full history saved. [2025-09-17T19:35:59.279249] [INFO ] [MAIN ] Update Progress: 1069/2371 symbols completed. HUYA took 40.0s. Estimated remaining: 3h 9m 57s. Rate: 6.9 symbols/min [2025-09-17T19:35:59.460042] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T19:35:59.462976] [INFO ] [MAIN ] HYAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:35:59.466328] [DEBUG] [LOCAL ] HYAC: No existing data file found in primary storage. [2025-09-17T19:35:59.466385] [WARN ] [MAIN ] HYAC: No existing data found, performing full refresh instead. [2025-09-17T19:35:59.466515] [INFO ] [MAIN ] HYAC: Wiping existing primary data before full refresh. [2025-09-17T19:35:59.466554] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-17T19:35:59.466596] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-17T19:35:59.466628] [INFO ] [MAIN ] HYAC: Starting full primary refresh. [2025-09-17T19:35:59.615842] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-02. [2025-09-17T19:35:59.837695] [INFO ] [REMOTE ] HYAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:36:00.415789] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-02. [2025-09-17T19:36:01.215740] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-03. [2025-09-17T19:36:01.245400] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T19:36:01.260967] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T19:36:02.015786] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-11. [2025-09-17T19:36:02.815810] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-03. [2025-09-17T19:36:03.142461] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T19:36:03.615780] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-03. [2025-09-17T19:36:03.785430] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-17T19:36:04.415783] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2024-12. [2025-09-17T19:36:05.188334] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T19:36:05.215759] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-01. [2025-09-17T19:36:05.253384] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T19:36:05.496130] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-17T19:36:05.499508] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-03 (2.68 seconds). [2025-09-17T19:36:06.015791] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-04. [2025-09-17T19:36:06.815790] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-04. [2025-09-17T19:36:07.615779] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-02. [2025-09-17T19:36:07.729526] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T19:36:07.933276] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-17T19:36:08.070298] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T19:36:08.415768] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-05. [2025-09-17T19:36:09.207814] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T19:36:09.215682] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-04. [2025-09-17T19:36:10.015779] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-05. [2025-09-17T19:36:10.815781] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-06. [2025-09-17T19:36:10.910321] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T19:36:11.552722] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T19:36:11.615780] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-05. [2025-09-17T19:36:12.002091] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T19:36:12.415764] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-06. [2025-09-17T19:36:13.215779] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-03. [2025-09-17T19:36:13.258024] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T19:36:13.450678] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-03 (0.23 seconds). [2025-09-17T19:36:14.015741] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-07. [2025-09-17T19:36:14.139619] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T19:36:14.783507] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T19:36:14.815744] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-08. [2025-09-17T19:36:15.615781] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-07. [2025-09-17T19:36:15.947868] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T19:36:16.415778] [INFO ] [REMOTE ] HY: Fetching primary data for 2025-09. [2025-09-17T19:36:17.215840] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-04. [2025-09-17T19:36:17.943102] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T19:36:18.015857] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-05. [2025-09-17T19:36:18.274673] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-05 (0.26 seconds). [2025-09-17T19:36:18.282293] [INFO ] [REMOTE ] HY: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T19:36:18.285016] [INFO ] [REMOTE ] HY: Full fetch complete (15136 records). [2025-09-17T19:36:18.285143] [DEBUG] [VALIDATOR ] HY: Validating primary data. [2025-09-17T19:36:18.766804] [DEBUG] [VALIDATOR ] HY: All expected trading days are present. [2025-09-17T19:36:18.767505] [DEBUG] [VALIDATOR ] HY: Primary data validation passed. [2025-09-17T19:36:18.769940] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-09-17T19:36:18.770507] [INFO ] [MAIN ] HY: Fetched primary data is valid. [2025-09-17T19:36:18.782252] [DEBUG] [LOCAL ] HY: Saving primary data. [2025-09-17T19:36:18.783671] [DEBUG] [LOCAL ] HY: Trimmed 15136 records to 10419 (keeping 200 days of data) [2025-09-17T19:36:18.818443] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-08. [2025-09-17T19:36:18.859478] [DEBUG] [LOCAL ] HY: Primary data saved (10419 records). [2025-09-17T19:36:18.859609] [INFO ] [MAIN ] HY: Full history saved. [2025-09-17T19:36:18.859744] [INFO ] [MAIN ] Update Progress: 1070/2371 symbols completed. HY took 25.5s. Estimated remaining: 3h 10m 1s. Rate: 6.8 symbols/min [2025-09-17T19:36:19.068015] [INFO ] [MAIN ] HYBX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:36:19.068249] [DEBUG] [LOCAL ] HYBX: No existing data file found in primary storage. [2025-09-17T19:36:19.068289] [WARN ] [MAIN ] HYBX: No existing data found, performing full refresh instead. [2025-09-17T19:36:19.068437] [INFO ] [MAIN ] HYBX: Wiping existing primary data before full refresh. [2025-09-17T19:36:19.068479] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-17T19:36:19.068518] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-17T19:36:19.068551] [INFO ] [MAIN ] HYBX: Starting full primary refresh. [2025-09-17T19:36:19.435014] [INFO ] [REMOTE ] HYBX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:36:19.615811] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-06. [2025-09-17T19:36:20.415844] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-11. [2025-09-17T19:36:20.765950] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T19:36:20.782232] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T19:36:21.221103] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2024-12. [2025-09-17T19:36:21.227224] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T19:36:21.565185] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-17T19:36:22.015831] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-07. [2025-09-17T19:36:22.815808] [INFO ] [REMOTE ] HWM: Fetching primary data for 2025-09. [2025-09-17T19:36:23.615819] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-06. [2025-09-17T19:36:23.716572] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T19:36:23.780560] [INFO ] [REMOTE ] HWM: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T19:36:23.787395] [INFO ] [REMOTE ] HWM: Full fetch complete (76530 records). [2025-09-17T19:36:23.787519] [DEBUG] [VALIDATOR ] HWM: Validating primary data. [2025-09-17T19:36:23.951795] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T19:36:24.186978] [DEBUG] [VALIDATOR ] HWM: All expected trading days are present. [2025-09-17T19:36:24.187062] [DEBUG] [VALIDATOR ] HWM: Primary data validation passed. [2025-09-17T19:36:24.188048] [INFO ] [MAIN ] HWM: Fetched primary data is valid. [2025-09-17T19:36:24.188097] [DEBUG] [LOCAL ] HWM: Saving primary data. [2025-09-17T19:36:24.189506] [DEBUG] [LOCAL ] HWM: Trimmed 76530 records to 53039 (keeping 200 days of data) [2025-09-17T19:36:24.415917] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-08. [2025-09-17T19:36:24.537846] [DEBUG] [LOCAL ] HWM: Primary data saved (53039 records). [2025-09-17T19:36:24.538045] [INFO ] [MAIN ] HWM: Full history saved. [2025-09-17T19:36:24.538148] [INFO ] [MAIN ] Update Progress: 1071/2371 symbols completed. HWM took 42.0s. Estimated remaining: 3h 9m 49s. Rate: 6.8 symbols/min [2025-09-17T19:36:24.707830] [INFO ] [MAIN ] HYI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:36:24.718087] [DEBUG] [LOCAL ] HYI: Loaded 8940 existing records from primary storage. [2025-09-17T19:36:24.718275] [INFO ] [MAIN ] HYI: Loaded 8940 existing records. [2025-09-17T19:36:24.897397] [WARN ] [MAIN ] HYI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:36:24.897718] [INFO ] [MAIN ] HYI: Wiping existing primary data before full refresh. [2025-09-17T19:36:24.897767] [INFO ] [LOCAL ] HYI: Starting deletion of primary data. [2025-09-17T19:36:24.898106] [DEBUG] [LOCAL ] HYI: Deleted primary data file. [2025-09-17T19:36:24.898153] [INFO ] [MAIN ] HYI: Starting full primary refresh. [2025-09-17T19:36:25.220955] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-01. [2025-09-17T19:36:25.258079] [INFO ] [REMOTE ] HYI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:36:25.760926] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T19:36:25.913039] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T19:36:26.015749] [INFO ] [REMOTE ] HXL: Fetching primary data for 2025-09. [2025-09-17T19:36:26.699065] [INFO ] [REMOTE ] HXL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T19:36:26.704885] [INFO ] [REMOTE ] HXL: Full fetch complete (65990 records). [2025-09-17T19:36:26.705001] [DEBUG] [VALIDATOR ] HXL: Validating primary data. [2025-09-17T19:36:26.820870] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-07. [2025-09-17T19:36:27.111035] [DEBUG] [VALIDATOR ] HXL: All expected trading days are present. [2025-09-17T19:36:27.111120] [DEBUG] [VALIDATOR ] HXL: Primary data validation passed. [2025-09-17T19:36:27.111978] [INFO ] [MAIN ] HXL: Fetched primary data is valid. [2025-09-17T19:36:27.112022] [DEBUG] [LOCAL ] HXL: Saving primary data. [2025-09-17T19:36:27.113343] [DEBUG] [LOCAL ] HXL: Trimmed 65990 records to 46239 (keeping 200 days of data) [2025-09-17T19:36:27.339027] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T19:36:27.410734] [DEBUG] [LOCAL ] HXL: Primary data saved (46239 records). [2025-09-17T19:36:27.410870] [INFO ] [MAIN ] HXL: Full history saved. [2025-09-17T19:36:27.410962] [INFO ] [MAIN ] Update Progress: 1072/2371 symbols completed. HXL took 38.2s. Estimated remaining: 3h 9m 33s. Rate: 6.9 symbols/min [2025-09-17T19:36:27.581048] [INFO ] [MAIN ] HYT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:36:27.615714] [DEBUG] [LOCAL ] HYT: Loaded 33193 existing records from primary storage. [2025-09-17T19:36:27.615913] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-08. [2025-09-17T19:36:27.616211] [INFO ] [MAIN ] HYT: Loaded 33193 existing records. [2025-09-17T19:36:27.798320] [WARN ] [MAIN ] HYT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:36:27.798601] [INFO ] [MAIN ] HYT: Wiping existing primary data before full refresh. [2025-09-17T19:36:27.798697] [INFO ] [LOCAL ] HYT: Starting deletion of primary data. [2025-09-17T19:36:27.799464] [DEBUG] [LOCAL ] HYT: Deleted primary data file. [2025-09-17T19:36:27.799520] [INFO ] [MAIN ] HYT: Starting full primary refresh. [2025-09-17T19:36:27.958827] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-08 (0.34 seconds). [2025-09-17T19:36:28.170373] [INFO ] [REMOTE ] HYT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:36:28.415803] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-11. [2025-09-17T19:36:29.215877] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-02. [2025-09-17T19:36:29.251801] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T19:36:29.548024] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T19:36:30.015811] [INFO ] [REMOTE ] HYAC: Fetching primary data for 2025-09. [2025-09-17T19:36:30.295513] [INFO ] [REMOTE ] HYAC: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-17T19:36:30.296516] [INFO ] [REMOTE ] HYAC: Full fetch complete (875 records). [2025-09-17T19:36:30.296592] [DEBUG] [VALIDATOR ] HYAC: Validating primary data. [2025-09-17T19:36:30.512153] [WARN ] [VALIDATOR ] HYAC: Validation failed - insufficient historical data. Have 173 unique days, need 200 days [2025-09-17T19:36:30.512476] [FATAL] [MAIN ] HYAC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:36:30.512528] [WARN ] [MAIN ] HYAC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:36:30.512570] [INFO ] [LOCAL ] HYAC: Starting deletion of primary data. [2025-09-17T19:36:30.512662] [DEBUG] [LOCAL ] HYAC: No primary data file found to delete. [2025-09-17T19:36:30.512703] [INFO ] [LOCAL ] HYAC: Starting deletion of derivative data. [2025-09-17T19:36:30.512754] [DEBUG] [LOCAL ] HYAC: No derivative data file found to delete. [2025-09-17T19:36:30.512825] [INFO ] [MAIN ] Update Progress: 1073/2371 symbols completed. HYAC took 31.2s. Estimated remaining: 3h 9m 17s. Rate: 6.9 symbols/min [2025-09-17T19:36:30.699060] [INFO ] [MAIN ] HYTR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:36:30.706074] [DEBUG] [LOCAL ] HYTR: Loaded 3222 existing records from primary storage. [2025-09-17T19:36:30.706271] [INFO ] [MAIN ] HYTR: Loaded 3222 existing records. [2025-09-17T19:36:30.815990] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-11. [2025-09-17T19:36:30.903393] [WARN ] [MAIN ] HYTR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:36:30.906577] [INFO ] [MAIN ] HYTR: Wiping existing primary data before full refresh. [2025-09-17T19:36:30.906679] [INFO ] [LOCAL ] HYTR: Starting deletion of primary data. [2025-09-17T19:36:30.907027] [DEBUG] [LOCAL ] HYTR: Deleted primary data file. [2025-09-17T19:36:30.907078] [INFO ] [MAIN ] HYTR: Starting full primary refresh. [2025-09-17T19:36:31.289093] [INFO ] [REMOTE ] HYTR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:36:31.615794] [INFO ] [REMOTE ] HYI: Fetching primary data for 2024-12. [2025-09-17T19:36:32.267961] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T19:36:32.348553] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T19:36:32.415778] [INFO ] [REMOTE ] HYT: Fetching primary data for 2024-12. [2025-09-17T19:36:33.215877] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-01. [2025-09-17T19:36:33.646178] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T19:36:34.015776] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-03. [2025-09-17T19:36:34.238417] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T19:36:34.265630] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-03 (0.25 seconds). [2025-09-17T19:36:34.815786] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-01. [2025-09-17T19:36:35.615777] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-11. [2025-09-17T19:36:36.117862] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T19:36:36.137552] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T19:36:36.415807] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2024-12. [2025-09-17T19:36:36.857538] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-17T19:36:37.215786] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-01. [2025-09-17T19:36:37.630707] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-17T19:36:38.015794] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-02. [2025-09-17T19:36:38.815795] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-04. [2025-09-17T19:36:38.949473] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T19:36:39.194214] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-17T19:36:39.615842] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-05. [2025-09-17T19:36:39.895963] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-17T19:36:40.415804] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-03. [2025-09-17T19:36:41.215809] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-02. [2025-09-17T19:36:41.247973] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T19:36:41.748582] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T19:36:42.015787] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-02. [2025-09-17T19:36:42.815823] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-04. [2025-09-17T19:36:43.337790] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T19:36:43.615793] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-03. [2025-09-17T19:36:43.687709] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T19:36:44.415791] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-05. [2025-09-17T19:36:44.790239] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T19:36:45.162234] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T19:36:45.215811] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-06. [2025-09-17T19:36:45.919201] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T19:36:46.015779] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-07. [2025-09-17T19:36:46.815822] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-03. [2025-09-17T19:36:46.841989] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T19:36:47.314404] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T19:36:47.615869] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-08. [2025-09-17T19:36:48.415829] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-06. [2025-09-17T19:36:48.476920] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T19:36:48.739024] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T19:36:49.215809] [INFO ] [REMOTE ] HYI: Fetching primary data for 2025-09. [2025-09-17T19:36:49.618924] [INFO ] [REMOTE ] HYI: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T19:36:49.620413] [INFO ] [REMOTE ] HYI: Full fetch complete (13002 records). [2025-09-17T19:36:49.620523] [DEBUG] [VALIDATOR ] HYI: Validating primary data. [2025-09-17T19:36:50.012993] [DEBUG] [VALIDATOR ] HYI: All expected trading days are present. [2025-09-17T19:36:50.013115] [DEBUG] [VALIDATOR ] HYI: Primary data validation passed. [2025-09-17T19:36:50.013755] [INFO ] [MAIN ] HYI: Fetched primary data is valid. [2025-09-17T19:36:50.013856] [DEBUG] [LOCAL ] HYI: Saving primary data. [2025-09-17T19:36:50.014597] [DEBUG] [LOCAL ] HYI: Trimmed 13002 records to 8918 (keeping 200 days of data) [2025-09-17T19:36:50.015891] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-07. [2025-09-17T19:36:50.080829] [DEBUG] [LOCAL ] HYI: Primary data saved (8918 records). [2025-09-17T19:36:50.081065] [INFO ] [MAIN ] HYI: Full history saved. [2025-09-17T19:36:50.081199] [INFO ] [MAIN ] Update Progress: 1074/2371 symbols completed. HYI took 25.5s. Estimated remaining: 3h 9m 22s. Rate: 6.8 symbols/min [2025-09-17T19:36:50.258565] [INFO ] [MAIN ] HZO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:36:50.294567] [DEBUG] [LOCAL ] HZO: Loaded 29369 existing records from primary storage. [2025-09-17T19:36:50.294788] [INFO ] [MAIN ] HZO: Loaded 29369 existing records. [2025-09-17T19:36:50.450437] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T19:36:50.492142] [WARN ] [MAIN ] HZO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:36:50.492465] [INFO ] [MAIN ] HZO: Wiping existing primary data before full refresh. [2025-09-17T19:36:50.492513] [INFO ] [LOCAL ] HZO: Starting deletion of primary data. [2025-09-17T19:36:50.493343] [DEBUG] [LOCAL ] HZO: Deleted primary data file. [2025-09-17T19:36:50.493403] [INFO ] [MAIN ] HZO: Starting full primary refresh. [2025-09-17T19:36:50.827343] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-08. [2025-09-17T19:36:50.872449] [INFO ] [REMOTE ] HZO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:36:51.186311] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-08 (0.36 seconds). [2025-09-17T19:36:51.615798] [INFO ] [REMOTE ] HYBX: Fetching primary data for 2025-09. [2025-09-17T19:36:51.871470] [INFO ] [REMOTE ] HYBX: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-17T19:36:51.872232] [INFO ] [REMOTE ] HYBX: Full fetch complete (833 records). [2025-09-17T19:36:51.872322] [DEBUG] [VALIDATOR ] HYBX: Validating primary data. [2025-09-17T19:36:52.057315] [WARN ] [VALIDATOR ] HYBX: Validation failed - insufficient historical data. Have 182 unique days, need 200 days [2025-09-17T19:36:52.057515] [FATAL] [MAIN ] HYBX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:36:52.057584] [WARN ] [MAIN ] HYBX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:36:52.057659] [INFO ] [LOCAL ] HYBX: Starting deletion of primary data. [2025-09-17T19:36:52.057751] [DEBUG] [LOCAL ] HYBX: No primary data file found to delete. [2025-09-17T19:36:52.057810] [INFO ] [LOCAL ] HYBX: Starting deletion of derivative data. [2025-09-17T19:36:52.057861] [DEBUG] [LOCAL ] HYBX: No derivative data file found to delete. [2025-09-17T19:36:52.057975] [INFO ] [MAIN ] Update Progress: 1075/2371 symbols completed. HYBX took 33.2s. Estimated remaining: 3h 9m 5s. Rate: 6.9 symbols/min [2025-09-17T19:36:52.265136] [INFO ] [MAIN ] IAE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:36:52.272921] [DEBUG] [LOCAL ] IAE: Loaded 5736 existing records from primary storage. [2025-09-17T19:36:52.273041] [INFO ] [MAIN ] IAE: Loaded 5736 existing records. [2025-09-17T19:36:52.421684] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-11. [2025-09-17T19:36:52.450860] [WARN ] [MAIN ] IAE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:36:52.451245] [INFO ] [MAIN ] IAE: Wiping existing primary data before full refresh. [2025-09-17T19:36:52.451295] [INFO ] [LOCAL ] IAE: Starting deletion of primary data. [2025-09-17T19:36:52.451571] [DEBUG] [LOCAL ] IAE: Deleted primary data file. [2025-09-17T19:36:52.451617] [INFO ] [MAIN ] IAE: Starting full primary refresh. [2025-09-17T19:36:52.823958] [INFO ] [REMOTE ] IAE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:36:53.215779] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-04. [2025-09-17T19:36:53.778658] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T19:36:53.808577] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T19:36:54.015779] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-04. [2025-09-17T19:36:54.815787] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-11. [2025-09-17T19:36:55.530619] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T19:36:55.571143] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T19:36:55.615812] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-05. [2025-09-17T19:36:56.415822] [INFO ] [REMOTE ] IAE: Fetching primary data for 2024-12. [2025-09-17T19:36:56.921271] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T19:36:56.943022] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T19:36:57.215788] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-01. [2025-09-17T19:36:57.855391] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T19:36:58.015785] [INFO ] [REMOTE ] HZO: Fetching primary data for 2024-12. [2025-09-17T19:36:58.815802] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-06. [2025-09-17T19:36:59.154752] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T19:36:59.615882] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-02. [2025-09-17T19:37:00.175721] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T19:37:00.184635] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T19:37:00.415804] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-07. [2025-09-17T19:37:01.215833] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-01. [2025-09-17T19:37:01.774926] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T19:37:02.003020] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T19:37:02.015737] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-08. [2025-09-17T19:37:02.815778] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-02. [2025-09-17T19:37:03.505283] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T19:37:03.568524] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T19:37:03.615763] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-03. [2025-09-17T19:37:04.415845] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-05. [2025-09-17T19:37:04.842075] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T19:37:04.943007] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T19:37:05.215833] [INFO ] [REMOTE ] HYT: Fetching primary data for 2025-09. [2025-09-17T19:37:05.915467] [INFO ] [REMOTE ] HYT: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:37:05.920859] [INFO ] [REMOTE ] HYT: Full fetch complete (46852 records). [2025-09-17T19:37:05.920948] [DEBUG] [VALIDATOR ] HYT: Validating primary data. [2025-09-17T19:37:06.020821] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-06. [2025-09-17T19:37:06.300591] [DEBUG] [VALIDATOR ] HYT: All expected trading days are present. [2025-09-17T19:37:06.300694] [DEBUG] [VALIDATOR ] HYT: Primary data validation passed. [2025-09-17T19:37:06.301359] [INFO ] [MAIN ] HYT: Fetched primary data is valid. [2025-09-17T19:37:06.301399] [DEBUG] [LOCAL ] HYT: Saving primary data. [2025-09-17T19:37:06.302395] [DEBUG] [LOCAL ] HYT: Trimmed 46852 records to 33259 (keeping 200 days of data) [2025-09-17T19:37:06.510486] [DEBUG] [LOCAL ] HYT: Primary data saved (33259 records). [2025-09-17T19:37:06.510627] [INFO ] [MAIN ] HYT: Full history saved. [2025-09-17T19:37:06.510738] [INFO ] [MAIN ] Update Progress: 1076/2371 symbols completed. HYT took 39.1s. Estimated remaining: 3h 9m 3s. Rate: 6.9 symbols/min [2025-09-17T19:37:06.625251] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T19:37:06.690237] [INFO ] [MAIN ] IAG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:37:06.750018] [DEBUG] [LOCAL ] IAG: Loaded 53432 existing records from primary storage. [2025-09-17T19:37:06.750168] [INFO ] [MAIN ] IAG: Loaded 53432 existing records. [2025-09-17T19:37:06.820915] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-04. [2025-09-17T19:37:06.934276] [WARN ] [MAIN ] IAG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:37:06.934491] [INFO ] [MAIN ] IAG: Wiping existing primary data before full refresh. [2025-09-17T19:37:06.934543] [INFO ] [LOCAL ] IAG: Starting deletion of primary data. [2025-09-17T19:37:06.935362] [DEBUG] [LOCAL ] IAG: Deleted primary data file. [2025-09-17T19:37:06.935415] [INFO ] [MAIN ] IAG: Starting full primary refresh. [2025-09-17T19:37:07.288102] [INFO ] [REMOTE ] IAG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:37:07.615832] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-07. [2025-09-17T19:37:08.174690] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T19:37:08.338268] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T19:37:08.415783] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-05. [2025-09-17T19:37:09.215824] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-11. [2025-09-17T19:37:09.620584] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T19:37:10.015850] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-03. [2025-09-17T19:37:10.709178] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T19:37:10.815716] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-06. [2025-09-17T19:37:11.071760] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T19:37:11.615764] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-08. [2025-09-17T19:37:11.995530] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T19:37:12.089801] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T19:37:12.415780] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-04. [2025-09-17T19:37:13.063336] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-17T19:37:13.215797] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-05. [2025-09-17T19:37:13.728214] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T19:37:14.015848] [INFO ] [REMOTE ] IAG: Fetching primary data for 2024-12. [2025-09-17T19:37:14.815826] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-07. [2025-09-17T19:37:15.615791] [INFO ] [REMOTE ] HYTR: Fetching primary data for 2025-09. [2025-09-17T19:37:15.840361] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T19:37:16.061606] [INFO ] [REMOTE ] HYTR: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T19:37:16.062602] [INFO ] [REMOTE ] HYTR: Full fetch complete (4349 records). [2025-09-17T19:37:16.062693] [DEBUG] [VALIDATOR ] HYTR: Validating primary data. [2025-09-17T19:37:16.417181] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-06. [2025-09-17T19:37:16.442856] [DEBUG] [VALIDATOR ] HYTR: All expected trading days are present. [2025-09-17T19:37:16.443195] [DEBUG] [VALIDATOR ] HYTR: Primary data validation passed. [2025-09-17T19:37:16.450072] [INFO ] [MAIN ] HYTR: Fetched primary data is valid. [2025-09-17T19:37:16.459705] [DEBUG] [LOCAL ] HYTR: Saving primary data. [2025-09-17T19:37:16.465630] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T19:37:16.464011] [DEBUG] [LOCAL ] HYTR: Trimmed 4349 records to 3209 (keeping 200 days of data) [2025-09-17T19:37:16.498530] [DEBUG] [LOCAL ] HYTR: Primary data saved (3209 records). [2025-09-17T19:37:16.498852] [INFO ] [MAIN ] HYTR: Full history saved. [2025-09-17T19:37:16.499014] [INFO ] [MAIN ] Update Progress: 1077/2371 symbols completed. HYTR took 46.0s. Estimated remaining: 3h 8m 56s. Rate: 6.8 symbols/min [2025-09-17T19:37:17.091983] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T19:37:17.215827] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-01. [2025-09-17T19:37:18.015817] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-07. [2025-09-17T19:37:18.704108] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T19:37:18.815846] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-08. [2025-09-17T19:37:18.989517] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T19:37:19.265914] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T19:37:19.615812] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-02. [2025-09-17T19:37:20.415858] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-08. [2025-09-17T19:37:21.215784] [INFO ] [REMOTE ] IAE: Fetching primary data for 2025-09. [2025-09-17T19:37:21.270385] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T19:37:21.575203] [INFO ] [REMOTE ] IAE: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T19:37:21.576930] [INFO ] [REMOTE ] IAE: Full fetch complete (8354 records). [2025-09-17T19:37:21.577032] [DEBUG] [VALIDATOR ] IAE: Validating primary data. [2025-09-17T19:37:21.926281] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T19:37:22.015790] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-03. [2025-09-17T19:37:22.022043] [DEBUG] [VALIDATOR ] IAE: All expected trading days are present. [2025-09-17T19:37:22.022109] [DEBUG] [VALIDATOR ] IAE: Primary data validation passed. [2025-09-17T19:37:22.023530] [INFO ] [MAIN ] IAE: Fetched primary data is valid. [2025-09-17T19:37:22.023582] [DEBUG] [LOCAL ] IAE: Saving primary data. [2025-09-17T19:37:22.024119] [DEBUG] [LOCAL ] IAE: Trimmed 8354 records to 5729 (keeping 200 days of data) [2025-09-17T19:37:22.060498] [DEBUG] [LOCAL ] IAE: Primary data saved (5729 records). [2025-09-17T19:37:22.060658] [INFO ] [MAIN ] IAE: Full history saved. [2025-09-17T19:37:22.060781] [INFO ] [MAIN ] Update Progress: 1078/2371 symbols completed. IAE took 30.0s. Estimated remaining: 3h 8m 43s. Rate: 6.9 symbols/min [2025-09-17T19:37:22.815887] [INFO ] [REMOTE ] HZO: Fetching primary data for 2025-09. [2025-09-17T19:37:23.489768] [INFO ] [REMOTE ] HZO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T19:37:23.493733] [INFO ] [REMOTE ] HZO: Full fetch complete (40292 records). [2025-09-17T19:37:23.493900] [DEBUG] [VALIDATOR ] HZO: Validating primary data. [2025-09-17T19:37:23.921004] [DEBUG] [VALIDATOR ] HZO: All expected trading days are present. [2025-09-17T19:37:23.921463] [DEBUG] [VALIDATOR ] HZO: Primary data validation passed. [2025-09-17T19:37:23.923061] [INFO ] [MAIN ] HZO: Fetched primary data is valid. [2025-09-17T19:37:23.923148] [DEBUG] [LOCAL ] HZO: Saving primary data. [2025-09-17T19:37:23.938340] [DEBUG] [LOCAL ] HZO: Trimmed 40292 records to 29399 (keeping 200 days of data) [2025-09-17T19:37:23.967130] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T19:37:24.067776] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-04. [2025-09-17T19:37:24.173432] [DEBUG] [LOCAL ] HZO: Primary data saved (29399 records). [2025-09-17T19:37:24.173666] [INFO ] [MAIN ] HZO: Full history saved. [2025-09-17T19:37:24.173827] [INFO ] [MAIN ] Update Progress: 1079/2371 symbols completed. HZO took 34.1s. Estimated remaining: 3h 8m 26s. Rate: 6.9 symbols/min [2025-09-17T19:37:26.189683] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T19:37:26.202217] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-05. [2025-09-17T19:37:28.288155] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T19:37:28.299958] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-06. [2025-09-17T19:37:30.085486] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T19:37:30.098844] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-07. [2025-09-17T19:37:31.690295] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T19:37:31.703750] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-08. [2025-09-17T19:37:33.396046] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T19:37:33.410928] [INFO ] [REMOTE ] IAG: Fetching primary data for 2025-09. [2025-09-17T19:37:34.245161] [INFO ] [REMOTE ] IAG: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T19:37:34.252702] [INFO ] [REMOTE ] IAG: Full fetch complete (77024 records). [2025-09-17T19:37:34.252919] [DEBUG] [VALIDATOR ] IAG: Validating primary data. [2025-09-17T19:37:34.683261] [DEBUG] [VALIDATOR ] IAG: All expected trading days are present. [2025-09-17T19:37:34.683387] [DEBUG] [VALIDATOR ] IAG: Primary data validation passed. [2025-09-17T19:37:34.684804] [INFO ] [MAIN ] IAG: Fetched primary data is valid. [2025-09-17T19:37:34.684871] [DEBUG] [LOCAL ] IAG: Saving primary data. [2025-09-17T19:37:34.687078] [DEBUG] [LOCAL ] IAG: Trimmed 77024 records to 53433 (keeping 200 days of data) [2025-09-17T19:37:35.027116] [DEBUG] [LOCAL ] IAG: Primary data saved (53433 records). [2025-09-17T19:37:35.027372] [INFO ] [MAIN ] IAG: Full history saved. [2025-09-17T19:37:35.027488] [INFO ] [MAIN ] Update Progress: 1080/2371 symbols completed. IAG took 28.5s. Estimated remaining: 3h 8m 20s. Rate: 6.9 symbols/min [2025-09-17T19:37:35.768103] [INFO ] [MAIN ] IBP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:37:35.775505] [INFO ] [MAIN ] IBN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:37:35.870875] [INFO ] [MAIN ] IBTA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:37:35.893104] [INFO ] [MAIN ] IBM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:37:35.939989] [DEBUG] [LOCAL ] IBP: Loaded 29528 existing records from primary storage. [2025-09-17T19:37:35.982626] [INFO ] [MAIN ] IBP: Loaded 29528 existing records. [2025-09-17T19:37:36.146349] [DEBUG] [LOCAL ] IBTA: Loaded 38340 existing records from primary storage. [2025-09-17T19:37:36.158247] [DEBUG] [LOCAL ] IBN: Loaded 52924 existing records from primary storage. [2025-09-17T19:37:36.158526] [INFO ] [MAIN ] IBTA: Loaded 38340 existing records. [2025-09-17T19:37:36.158652] [INFO ] [MAIN ] IBN: Loaded 52924 existing records. [2025-09-17T19:37:36.182531] [DEBUG] [LOCAL ] IBM: Loaded 53609 existing records from primary storage. [2025-09-17T19:37:36.251755] [INFO ] [MAIN ] IBM: Loaded 53609 existing records. [2025-09-17T19:37:36.574493] [WARN ] [MAIN ] IBP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:37:36.687721] [INFO ] [MAIN ] IBP: Wiping existing primary data before full refresh. [2025-09-17T19:37:36.824002] [WARN ] [MAIN ] IBTA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:37:36.802438] [INFO ] [LOCAL ] IBP: Starting deletion of primary data. [2025-09-17T19:37:36.821434] [WARN ] [MAIN ] IBM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:37:36.827497] [WARN ] [MAIN ] IBN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:37:36.827783] [INFO ] [MAIN ] IBTA: Wiping existing primary data before full refresh. [2025-09-17T19:37:36.827951] [INFO ] [MAIN ] IBN: Wiping existing primary data before full refresh. [2025-09-17T19:37:36.828074] [INFO ] [LOCAL ] IBN: Starting deletion of primary data. [2025-09-17T19:37:36.828320] [INFO ] [LOCAL ] IBTA: Starting deletion of primary data. [2025-09-17T19:37:36.828458] [DEBUG] [LOCAL ] IBP: Deleted primary data file. [2025-09-17T19:37:36.828248] [INFO ] [MAIN ] IBM: Wiping existing primary data before full refresh. [2025-09-17T19:37:36.828598] [INFO ] [MAIN ] IBP: Starting full primary refresh. [2025-09-17T19:37:36.840112] [DEBUG] [LOCAL ] IBN: Deleted primary data file. [2025-09-17T19:37:36.849843] [DEBUG] [LOCAL ] IBTA: Deleted primary data file. [2025-09-17T19:37:36.828632] [INFO ] [LOCAL ] IBM: Starting deletion of primary data. [2025-09-17T19:37:36.858736] [INFO ] [MAIN ] IBN: Starting full primary refresh. [2025-09-17T19:37:36.858776] [INFO ] [MAIN ] IBTA: Starting full primary refresh. [2025-09-17T19:37:36.945578] [DEBUG] [LOCAL ] IBM: Deleted primary data file. [2025-09-17T19:37:36.993344] [INFO ] [MAIN ] IBM: Starting full primary refresh. [2025-09-17T19:37:38.123339] [INFO ] [REMOTE ] IBP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:37:38.173129] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-11. [2025-09-17T19:37:38.197507] [INFO ] [REMOTE ] IBTA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:37:38.225101] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-11. [2025-09-17T19:37:38.314775] [INFO ] [REMOTE ] IBN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:37:38.326384] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-11. [2025-09-17T19:37:38.359934] [INFO ] [REMOTE ] IBM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:37:38.360573] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-11. [2025-09-17T19:37:39.565447] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T19:37:39.571380] [INFO ] [REMOTE ] IBP: Fetching primary data for 2024-12. [2025-09-17T19:37:39.614657] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T19:37:39.621471] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2024-12. [2025-09-17T19:37:39.858415] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T19:37:39.868892] [INFO ] [REMOTE ] IBN: Fetching primary data for 2024-12. [2025-09-17T19:37:40.528746] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-11 (2.17 seconds). [2025-09-17T19:37:40.540077] [INFO ] [REMOTE ] IBM: Fetching primary data for 2024-12. [2025-09-17T19:37:40.829557] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T19:37:40.836778] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-01. [2025-09-17T19:37:41.138756] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T19:37:41.145732] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-01. [2025-09-17T19:37:41.255371] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T19:37:41.267742] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-01. [2025-09-17T19:37:41.973003] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T19:37:41.978586] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-02. [2025-09-17T19:37:42.061481] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T19:37:42.067543] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-02. [2025-09-17T19:37:42.756467] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2024-12 (2.22 seconds). [2025-09-17T19:37:42.767784] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-01. [2025-09-17T19:37:42.942444] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T19:37:42.948522] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-03. [2025-09-17T19:37:42.987664] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T19:37:42.993274] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-03. [2025-09-17T19:37:43.245409] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T19:37:43.255984] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-02. [2025-09-17T19:37:44.411493] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T19:37:44.419002] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-04. [2025-09-17T19:37:44.529551] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T19:37:44.540818] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-02. [2025-09-17T19:37:44.612752] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T19:37:44.623270] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-04. [2025-09-17T19:37:44.937114] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T19:37:44.948033] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-03. [2025-09-17T19:37:45.613295] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T19:37:45.620131] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-05. [2025-09-17T19:37:46.241119] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T19:37:46.251570] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-05. [2025-09-17T19:37:46.349513] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T19:37:46.688964] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-02 (2.15 seconds). [2025-09-17T19:37:46.815849] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-03. [2025-09-17T19:37:46.850264] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T19:37:47.605383] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T19:37:47.615757] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-06. [2025-09-17T19:37:48.415853] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-04. [2025-09-17T19:37:48.730770] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T19:37:48.911151] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T19:37:49.215819] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-04. [2025-09-17T19:37:50.015854] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-07. [2025-09-17T19:37:50.164738] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T19:37:50.815851] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-06. [2025-09-17T19:37:51.326756] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T19:37:51.615789] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-05. [2025-09-17T19:37:51.661354] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T19:37:51.703222] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-04 (2.49 seconds). [2025-09-17T19:37:52.415843] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-05. [2025-09-17T19:37:53.215776] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-08. [2025-09-17T19:37:53.260685] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T19:37:54.015827] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-07. [2025-09-17T19:37:54.385626] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T19:37:54.670254] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-17T19:37:54.815771] [INFO ] [REMOTE ] IBP: Fetching primary data for 2025-09. [2025-09-17T19:37:54.935726] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T19:37:55.500534] [INFO ] [REMOTE ] IBP: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T19:37:55.504707] [INFO ] [REMOTE ] IBP: Full fetch complete (40885 records). [2025-09-17T19:37:55.504816] [DEBUG] [VALIDATOR ] IBP: Validating primary data. [2025-09-17T19:37:55.621010] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-06. [2025-09-17T19:37:55.921115] [DEBUG] [VALIDATOR ] IBP: All expected trading days are present. [2025-09-17T19:37:55.921200] [DEBUG] [VALIDATOR ] IBP: Primary data validation passed. [2025-09-17T19:37:55.921847] [INFO ] [MAIN ] IBP: Fetched primary data is valid. [2025-09-17T19:37:55.921890] [DEBUG] [LOCAL ] IBP: Saving primary data. [2025-09-17T19:37:55.922790] [DEBUG] [LOCAL ] IBP: Trimmed 40885 records to 29531 (keeping 200 days of data) [2025-09-17T19:37:56.110809] [DEBUG] [LOCAL ] IBP: Primary data saved (29531 records). [2025-09-17T19:37:56.110960] [INFO ] [MAIN ] IBP: Full history saved. [2025-09-17T19:37:56.111048] [INFO ] [MAIN ] Update Progress: 1081/2371 symbols completed. IBP took 21.1s. Estimated remaining: 3h 8m 26s. Rate: 6.8 symbols/min [2025-09-17T19:37:56.280918] [INFO ] [MAIN ] ICE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:37:56.339334] [DEBUG] [LOCAL ] ICE: Loaded 53026 existing records from primary storage. [2025-09-17T19:37:56.339484] [INFO ] [MAIN ] ICE: Loaded 53026 existing records. [2025-09-17T19:37:56.420952] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-06. [2025-09-17T19:37:56.521469] [WARN ] [MAIN ] ICE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:37:56.521737] [INFO ] [MAIN ] ICE: Wiping existing primary data before full refresh. [2025-09-17T19:37:56.521787] [INFO ] [LOCAL ] ICE: Starting deletion of primary data. [2025-09-17T19:37:56.523021] [DEBUG] [LOCAL ] ICE: Deleted primary data file. [2025-09-17T19:37:56.523073] [INFO ] [MAIN ] ICE: Starting full primary refresh. [2025-09-17T19:37:56.874933] [INFO ] [REMOTE ] ICE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:37:57.215842] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-11. [2025-09-17T19:37:57.843044] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-17T19:37:58.015839] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-07. [2025-09-17T19:37:58.226293] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T19:37:58.610689] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T19:37:58.815821] [INFO ] [REMOTE ] ICE: Fetching primary data for 2024-12. [2025-09-17T19:37:59.615826] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-07. [2025-09-17T19:37:59.924259] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T19:38:00.415797] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-08. [2025-09-17T19:38:00.586051] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T19:38:01.215790] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-08. [2025-09-17T19:38:01.482592] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T19:38:01.898860] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T19:38:02.015823] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-08. [2025-09-17T19:38:02.815816] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-01. [2025-09-17T19:38:03.461351] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-17T19:38:03.615815] [INFO ] [REMOTE ] IBTA: Fetching primary data for 2025-09. [2025-09-17T19:38:04.120255] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-08 (2.10 seconds). [2025-09-17T19:38:04.375516] [INFO ] [REMOTE ] IBTA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T19:38:04.381095] [INFO ] [REMOTE ] IBTA: Full fetch complete (50184 records). [2025-09-17T19:38:04.381197] [DEBUG] [VALIDATOR ] IBTA: Validating primary data. [2025-09-17T19:38:04.420982] [INFO ] [REMOTE ] IBM: Fetching primary data for 2025-09. [2025-09-17T19:38:04.777405] [DEBUG] [VALIDATOR ] IBTA: All expected trading days are present. [2025-09-17T19:38:04.777637] [DEBUG] [VALIDATOR ] IBTA: Primary data validation passed. [2025-09-17T19:38:04.778517] [INFO ] [MAIN ] IBTA: Fetched primary data is valid. [2025-09-17T19:38:04.778632] [DEBUG] [LOCAL ] IBTA: Saving primary data. [2025-09-17T19:38:04.780404] [DEBUG] [LOCAL ] IBTA: Trimmed 50184 records to 38303 (keeping 200 days of data) [2025-09-17T19:38:04.910576] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-17T19:38:05.061332] [DEBUG] [LOCAL ] IBTA: Primary data saved (38303 records). [2025-09-17T19:38:05.061551] [INFO ] [MAIN ] IBTA: Full history saved. [2025-09-17T19:38:05.061675] [INFO ] [MAIN ] Update Progress: 1082/2371 symbols completed. IBTA took 30.0s. Estimated remaining: 3h 8m 17s. Rate: 6.8 symbols/min [2025-09-17T19:38:05.221189] [INFO ] [REMOTE ] IBN: Fetching primary data for 2025-09. [2025-09-17T19:38:05.243268] [INFO ] [MAIN ] ICL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:38:05.285904] [DEBUG] [LOCAL ] ICL: Loaded 39049 existing records from primary storage. [2025-09-17T19:38:05.286105] [INFO ] [MAIN ] ICL: Loaded 39049 existing records. [2025-09-17T19:38:05.475867] [WARN ] [MAIN ] ICL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:38:05.476305] [INFO ] [MAIN ] ICL: Wiping existing primary data before full refresh. [2025-09-17T19:38:05.476432] [INFO ] [LOCAL ] ICL: Starting deletion of primary data. [2025-09-17T19:38:05.483810] [DEBUG] [LOCAL ] ICL: Deleted primary data file. [2025-09-17T19:38:05.495362] [INFO ] [MAIN ] ICL: Starting full primary refresh. [2025-09-17T19:38:05.501911] [INFO ] [REMOTE ] IBM: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T19:38:05.599818] [INFO ] [REMOTE ] IBM: Full fetch complete (77489 records). [2025-09-17T19:38:05.610774] [DEBUG] [VALIDATOR ] IBM: Validating primary data. [2025-09-17T19:38:06.019768] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-02. [2025-09-17T19:38:06.157542] [INFO ] [REMOTE ] ICL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:38:06.317919] [DEBUG] [VALIDATOR ] IBM: All expected trading days are present. [2025-09-17T19:38:06.318055] [DEBUG] [VALIDATOR ] IBM: Primary data validation passed. [2025-09-17T19:38:06.319048] [INFO ] [MAIN ] IBM: Fetched primary data is valid. [2025-09-17T19:38:06.319107] [DEBUG] [LOCAL ] IBM: Saving primary data. [2025-09-17T19:38:06.337781] [INFO ] [REMOTE ] IBN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T19:38:06.344299] [DEBUG] [LOCAL ] IBM: Trimmed 77489 records to 53609 (keeping 200 days of data) [2025-09-17T19:38:06.345512] [INFO ] [REMOTE ] IBN: Full fetch complete (76128 records). [2025-09-17T19:38:06.345597] [DEBUG] [VALIDATOR ] IBN: Validating primary data. [2025-09-17T19:38:06.850960] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-11. [2025-09-17T19:38:07.019552] [DEBUG] [VALIDATOR ] IBN: All expected trading days are present. [2025-09-17T19:38:07.035215] [DEBUG] [VALIDATOR ] IBN: Primary data validation passed. [2025-09-17T19:38:07.042335] [INFO ] [MAIN ] IBN: Fetched primary data is valid. [2025-09-17T19:38:07.057385] [DEBUG] [LOCAL ] IBN: Saving primary data. [2025-09-17T19:38:07.130521] [DEBUG] [LOCAL ] IBN: Trimmed 76128 records to 52931 (keeping 200 days of data) [2025-09-17T19:38:07.156076] [DEBUG] [LOCAL ] IBM: Primary data saved (53609 records). [2025-09-17T19:38:07.225972] [INFO ] [MAIN ] IBM: Full history saved. [2025-09-17T19:38:07.239015] [INFO ] [MAIN ] Update Progress: 1083/2371 symbols completed. IBM took 32.2s. Estimated remaining: 3h 8m 1s. Rate: 6.9 symbols/min [2025-09-17T19:38:07.481183] [INFO ] [MAIN ] IDA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:38:07.632820] [DEBUG] [LOCAL ] IDA: Loaded 32109 existing records from primary storage. [2025-09-17T19:38:07.636081] [INFO ] [MAIN ] IDA: Loaded 32109 existing records. [2025-09-17T19:38:07.915948] [WARN ] [MAIN ] IDA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:38:07.921143] [INFO ] [MAIN ] IDA: Wiping existing primary data before full refresh. [2025-09-17T19:38:07.922497] [INFO ] [LOCAL ] IDA: Starting deletion of primary data. [2025-09-17T19:38:07.926091] [DEBUG] [LOCAL ] IDA: Deleted primary data file. [2025-09-17T19:38:07.927883] [INFO ] [MAIN ] IDA: Starting full primary refresh. [2025-09-17T19:38:08.134509] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-17T19:38:08.224994] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-03. [2025-09-17T19:38:08.230301] [DEBUG] [LOCAL ] IBN: Primary data saved (52931 records). [2025-09-17T19:38:08.238064] [INFO ] [MAIN ] IBN: Full history saved. [2025-09-17T19:38:08.284792] [INFO ] [MAIN ] Update Progress: 1084/2371 symbols completed. IBN took 33.3s. Estimated remaining: 3h 7m 43s. Rate: 6.9 symbols/min [2025-09-17T19:38:08.484585] [INFO ] [REMOTE ] IDA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:38:08.513516] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-11. [2025-09-17T19:38:08.589205] [INFO ] [MAIN ] IDE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:38:08.617974] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T19:38:08.630488] [DEBUG] [LOCAL ] IDE: Loaded 8366 existing records from primary storage. [2025-09-17T19:38:08.630589] [INFO ] [MAIN ] IDE: Loaded 8366 existing records. [2025-09-17T19:38:08.810797] [WARN ] [MAIN ] IDE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:38:08.811135] [INFO ] [MAIN ] IDE: Wiping existing primary data before full refresh. [2025-09-17T19:38:08.811188] [INFO ] [LOCAL ] IDE: Starting deletion of primary data. [2025-09-17T19:38:08.811502] [DEBUG] [LOCAL ] IDE: Deleted primary data file. [2025-09-17T19:38:08.811550] [INFO ] [MAIN ] IDE: Starting full primary refresh. [2025-09-17T19:38:09.186952] [INFO ] [REMOTE ] IDE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:38:09.215818] [INFO ] [REMOTE ] ICL: Fetching primary data for 2024-12. [2025-09-17T19:38:10.020558] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-11. [2025-09-17T19:38:10.026539] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T19:38:10.140408] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T19:38:10.452977] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T19:38:10.815789] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-04. [2025-09-17T19:38:10.873848] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T19:38:11.615780] [INFO ] [REMOTE ] IDA: Fetching primary data for 2024-12. [2025-09-17T19:38:12.415827] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-01. [2025-09-17T19:38:12.748396] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T19:38:13.185616] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-17T19:38:13.215725] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-05. [2025-09-17T19:38:14.015789] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-01. [2025-09-17T19:38:14.567095] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T19:38:14.815684] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-02. [2025-09-17T19:38:15.344336] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T19:38:15.615797] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-06. [2025-09-17T19:38:16.179317] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-17T19:38:16.415810] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-02. [2025-09-17T19:38:16.634485] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T19:38:17.015490] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T19:38:17.215804] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-07. [2025-09-17T19:38:17.653340] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T19:38:18.015824] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-03. [2025-09-17T19:38:18.815868] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-03. [2025-09-17T19:38:19.290987] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T19:38:19.581078] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T19:38:19.615775] [INFO ] [REMOTE ] IDE: Fetching primary data for 2024-12. [2025-09-17T19:38:20.050770] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T19:38:20.415824] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-08. [2025-09-17T19:38:20.472790] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T19:38:21.215797] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-04. [2025-09-17T19:38:22.015863] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-01. [2025-09-17T19:38:22.191504] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T19:38:22.480790] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T19:38:22.797682] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T19:38:22.815735] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-05. [2025-09-17T19:38:23.615803] [INFO ] [REMOTE ] ICE: Fetching primary data for 2025-09. [2025-09-17T19:38:24.286767] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T19:38:24.415819] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-02. [2025-09-17T19:38:24.470189] [INFO ] [REMOTE ] ICE: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T19:38:24.477517] [INFO ] [REMOTE ] ICE: Full fetch complete (76589 records). [2025-09-17T19:38:24.477731] [DEBUG] [VALIDATOR ] ICE: Validating primary data. [2025-09-17T19:38:24.889504] [DEBUG] [VALIDATOR ] ICE: All expected trading days are present. [2025-09-17T19:38:24.889611] [DEBUG] [VALIDATOR ] ICE: Primary data validation passed. [2025-09-17T19:38:24.890674] [INFO ] [MAIN ] ICE: Fetched primary data is valid. [2025-09-17T19:38:24.890735] [DEBUG] [LOCAL ] ICE: Saving primary data. [2025-09-17T19:38:24.892364] [DEBUG] [LOCAL ] ICE: Trimmed 76589 records to 53026 (keeping 200 days of data) [2025-09-17T19:38:25.215761] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-04. [2025-09-17T19:38:25.216504] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T19:38:25.263484] [DEBUG] [LOCAL ] ICE: Primary data saved (53026 records). [2025-09-17T19:38:25.263669] [INFO ] [MAIN ] ICE: Full history saved. [2025-09-17T19:38:25.263787] [INFO ] [MAIN ] Update Progress: 1085/2371 symbols completed. ICE took 29.2s. Estimated remaining: 3h 7m 44s. Rate: 6.9 symbols/min [2025-09-17T19:38:25.444772] [INFO ] [MAIN ] IDT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:38:25.463621] [DEBUG] [LOCAL ] IDT: Loaded 17424 existing records from primary storage. [2025-09-17T19:38:25.463812] [INFO ] [MAIN ] IDT: Loaded 17424 existing records. [2025-09-17T19:38:25.651333] [WARN ] [MAIN ] IDT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:38:25.651631] [INFO ] [MAIN ] IDT: Wiping existing primary data before full refresh. [2025-09-17T19:38:25.651712] [INFO ] [LOCAL ] IDT: Starting deletion of primary data. [2025-09-17T19:38:25.652285] [DEBUG] [LOCAL ] IDT: Deleted primary data file. [2025-09-17T19:38:25.652347] [INFO ] [MAIN ] IDT: Starting full primary refresh. [2025-09-17T19:38:26.025938] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-06. [2025-09-17T19:38:26.030748] [INFO ] [REMOTE ] IDT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:38:26.672527] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T19:38:26.815789] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-03. [2025-09-17T19:38:27.428805] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T19:38:27.502677] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T19:38:27.615919] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-07. [2025-09-17T19:38:28.415826] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-11. [2025-09-17T19:38:29.015197] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T19:38:29.042224] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T19:38:29.215815] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-08. [2025-09-17T19:38:30.015832] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-05. [2025-09-17T19:38:30.653275] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T19:38:30.815791] [INFO ] [REMOTE ] ICL: Fetching primary data for 2025-09. [2025-09-17T19:38:31.302655] [INFO ] [REMOTE ] ICL: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T19:38:31.307585] [INFO ] [REMOTE ] ICL: Full fetch complete (56333 records). [2025-09-17T19:38:31.307756] [DEBUG] [VALIDATOR ] ICL: Validating primary data. [2025-09-17T19:38:31.619016] [INFO ] [REMOTE ] IDT: Fetching primary data for 2024-12. [2025-09-17T19:38:31.706432] [DEBUG] [VALIDATOR ] ICL: All expected trading days are present. [2025-09-17T19:38:31.706615] [DEBUG] [VALIDATOR ] ICL: Primary data validation passed. [2025-09-17T19:38:31.707710] [INFO ] [MAIN ] ICL: Fetched primary data is valid. [2025-09-17T19:38:31.728714] [DEBUG] [LOCAL ] ICL: Saving primary data. [2025-09-17T19:38:31.731126] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T19:38:31.740344] [DEBUG] [LOCAL ] ICL: Trimmed 56333 records to 39017 (keeping 200 days of data) [2025-09-17T19:38:31.965787] [DEBUG] [LOCAL ] ICL: Primary data saved (39017 records). [2025-09-17T19:38:31.965940] [INFO ] [MAIN ] ICL: Full history saved. [2025-09-17T19:38:31.966026] [INFO ] [MAIN ] Update Progress: 1086/2371 symbols completed. ICL took 26.9s. Estimated remaining: 3h 7m 33s. Rate: 6.9 symbols/min [2025-09-17T19:38:32.133603] [INFO ] [MAIN ] IEX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:38:32.171283] [DEBUG] [LOCAL ] IEX: Loaded 38334 existing records from primary storage. [2025-09-17T19:38:32.171454] [INFO ] [MAIN ] IEX: Loaded 38334 existing records. [2025-09-17T19:38:32.354104] [WARN ] [MAIN ] IEX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:38:32.354379] [INFO ] [MAIN ] IEX: Wiping existing primary data before full refresh. [2025-09-17T19:38:32.354427] [INFO ] [LOCAL ] IEX: Starting deletion of primary data. [2025-09-17T19:38:32.355219] [DEBUG] [LOCAL ] IEX: Deleted primary data file. [2025-09-17T19:38:32.355271] [INFO ] [MAIN ] IEX: Starting full primary refresh. [2025-09-17T19:38:32.420888] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-06. [2025-09-17T19:38:32.717277] [INFO ] [REMOTE ] IEX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:38:32.789327] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T19:38:33.215779] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-01. [2025-09-17T19:38:33.967117] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T19:38:34.015788] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-11. [2025-09-17T19:38:34.057223] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T19:38:34.815778] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-02. [2025-09-17T19:38:35.431486] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T19:38:35.561894] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T19:38:35.615750] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-03. [2025-09-17T19:38:36.415780] [INFO ] [REMOTE ] IEX: Fetching primary data for 2024-12. [2025-09-17T19:38:36.700776] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T19:38:37.216006] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-04. [2025-09-17T19:38:37.857790] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T19:38:38.015811] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-07. [2025-09-17T19:38:38.244087] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T19:38:38.815776] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-04. [2025-09-17T19:38:39.317330] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T19:38:39.538394] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T19:38:39.615833] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-05. [2025-09-17T19:38:40.367082] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T19:38:40.415777] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-06. [2025-09-17T19:38:41.132476] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T19:38:41.215763] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-07. [2025-09-17T19:38:41.998706] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T19:38:42.015744] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-08. [2025-09-17T19:38:42.815812] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-08. [2025-09-17T19:38:43.475922] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T19:38:43.601599] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T19:38:43.615693] [INFO ] [REMOTE ] IDE: Fetching primary data for 2025-09. [2025-09-17T19:38:43.958634] [INFO ] [REMOTE ] IDE: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T19:38:43.960899] [INFO ] [REMOTE ] IDE: Full fetch complete (12687 records). [2025-09-17T19:38:43.960974] [DEBUG] [VALIDATOR ] IDE: Validating primary data. [2025-09-17T19:38:44.354492] [DEBUG] [VALIDATOR ] IDE: All expected trading days are present. [2025-09-17T19:38:44.354626] [DEBUG] [VALIDATOR ] IDE: Primary data validation passed. [2025-09-17T19:38:44.355128] [INFO ] [MAIN ] IDE: Fetched primary data is valid. [2025-09-17T19:38:44.355184] [DEBUG] [LOCAL ] IDE: Saving primary data. [2025-09-17T19:38:44.355763] [DEBUG] [LOCAL ] IDE: Trimmed 12687 records to 8365 (keeping 200 days of data) [2025-09-17T19:38:44.416032] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-05. [2025-09-17T19:38:44.417625] [DEBUG] [LOCAL ] IDE: Primary data saved (8365 records). [2025-09-17T19:38:44.418818] [INFO ] [MAIN ] IDE: Full history saved. [2025-09-17T19:38:44.418931] [INFO ] [MAIN ] Update Progress: 1087/2371 symbols completed. IDE took 36.1s. Estimated remaining: 3h 7m 28s. Rate: 6.8 symbols/min [2025-09-17T19:38:44.608445] [INFO ] [MAIN ] IFF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:38:44.666015] [DEBUG] [LOCAL ] IFF: Loaded 50928 existing records from primary storage. [2025-09-17T19:38:44.666278] [INFO ] [MAIN ] IFF: Loaded 50928 existing records. [2025-09-17T19:38:44.855230] [WARN ] [MAIN ] IFF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:38:44.855674] [INFO ] [MAIN ] IFF: Wiping existing primary data before full refresh. [2025-09-17T19:38:44.855754] [INFO ] [LOCAL ] IFF: Starting deletion of primary data. [2025-09-17T19:38:44.856984] [DEBUG] [LOCAL ] IFF: Deleted primary data file. [2025-09-17T19:38:44.857051] [INFO ] [MAIN ] IFF: Starting full primary refresh. [2025-09-17T19:38:45.222733] [INFO ] [REMOTE ] IDA: Fetching primary data for 2025-09. [2025-09-17T19:38:45.228407] [INFO ] [REMOTE ] IFF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:38:45.464018] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T19:38:45.791754] [INFO ] [REMOTE ] IDA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:38:45.795605] [INFO ] [REMOTE ] IDA: Full fetch complete (44603 records). [2025-09-17T19:38:45.795742] [DEBUG] [VALIDATOR ] IDA: Validating primary data. [2025-09-17T19:38:46.020941] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-01. [2025-09-17T19:38:46.181175] [DEBUG] [VALIDATOR ] IDA: All expected trading days are present. [2025-09-17T19:38:46.181271] [DEBUG] [VALIDATOR ] IDA: Primary data validation passed. [2025-09-17T19:38:46.182036] [INFO ] [MAIN ] IDA: Fetched primary data is valid. [2025-09-17T19:38:46.182084] [DEBUG] [LOCAL ] IDA: Saving primary data. [2025-09-17T19:38:46.183412] [DEBUG] [LOCAL ] IDA: Trimmed 44603 records to 32074 (keeping 200 days of data) [2025-09-17T19:38:46.395601] [DEBUG] [LOCAL ] IDA: Primary data saved (32074 records). [2025-09-17T19:38:46.395776] [INFO ] [MAIN ] IDA: Full history saved. [2025-09-17T19:38:46.395866] [INFO ] [MAIN ] Update Progress: 1088/2371 symbols completed. IDA took 39.1s. Estimated remaining: 3h 7m 12s. Rate: 6.9 symbols/min [2025-09-17T19:38:46.566366] [INFO ] [MAIN ] IFN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:38:46.585880] [DEBUG] [LOCAL ] IFN: Loaded 18414 existing records from primary storage. [2025-09-17T19:38:46.586011] [INFO ] [MAIN ] IFN: Loaded 18414 existing records. [2025-09-17T19:38:46.767913] [WARN ] [MAIN ] IFN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:38:46.768221] [INFO ] [MAIN ] IFN: Wiping existing primary data before full refresh. [2025-09-17T19:38:46.768276] [INFO ] [LOCAL ] IFN: Starting deletion of primary data. [2025-09-17T19:38:46.768793] [DEBUG] [LOCAL ] IFN: Deleted primary data file. [2025-09-17T19:38:46.768850] [INFO ] [MAIN ] IFN: Starting full primary refresh. [2025-09-17T19:38:46.824245] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-11. [2025-09-17T19:38:47.130307] [INFO ] [REMOTE ] IFN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:38:47.502345] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T19:38:47.615776] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-02. [2025-09-17T19:38:48.415816] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-06. [2025-09-17T19:38:48.526354] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T19:38:49.064822] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T19:38:49.125945] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T19:38:49.215797] [INFO ] [REMOTE ] IFF: Fetching primary data for 2024-12. [2025-09-17T19:38:50.015820] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-11. [2025-09-17T19:38:50.815779] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-03. [2025-09-17T19:38:50.868286] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T19:38:51.072254] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T19:38:51.615792] [INFO ] [REMOTE ] IFN: Fetching primary data for 2024-12. [2025-09-17T19:38:52.066214] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T19:38:52.415783] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-07. [2025-09-17T19:38:52.527434] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T19:38:53.215797] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-04. [2025-09-17T19:38:53.488174] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T19:38:54.015797] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-01. [2025-09-17T19:38:54.690712] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T19:38:54.815794] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-05. [2025-09-17T19:38:55.320455] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T19:38:55.615812] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-08. [2025-09-17T19:38:56.307950] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T19:38:56.415832] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-02. [2025-09-17T19:38:56.542729] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T19:38:57.215802] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-06. [2025-09-17T19:38:57.468316] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T19:38:58.015799] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-03. [2025-09-17T19:38:58.730629] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T19:38:58.815735] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-07. [2025-09-17T19:38:58.853420] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T19:38:59.615821] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-01. [2025-09-17T19:39:00.320863] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T19:39:00.415729] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-08. [2025-09-17T19:39:00.966002] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T19:39:01.215787] [INFO ] [REMOTE ] IDT: Fetching primary data for 2025-09. [2025-09-17T19:39:02.015870] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-04. [2025-09-17T19:39:02.262913] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T19:39:02.449292] [INFO ] [REMOTE ] IDT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T19:39:02.453815] [INFO ] [REMOTE ] IDT: Full fetch complete (22192 records). [2025-09-17T19:39:02.454012] [DEBUG] [VALIDATOR ] IDT: Validating primary data. [2025-09-17T19:39:02.820880] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-02. [2025-09-17T19:39:02.862559] [DEBUG] [VALIDATOR ] IDT: All expected trading days are present. [2025-09-17T19:39:02.862669] [DEBUG] [VALIDATOR ] IDT: Primary data validation passed. [2025-09-17T19:39:02.863243] [INFO ] [MAIN ] IDT: Fetched primary data is valid. [2025-09-17T19:39:02.863405] [DEBUG] [LOCAL ] IDT: Saving primary data. [2025-09-17T19:39:02.864167] [DEBUG] [LOCAL ] IDT: Trimmed 22192 records to 17478 (keeping 200 days of data) [2025-09-17T19:39:02.975970] [DEBUG] [LOCAL ] IDT: Primary data saved (17478 records). [2025-09-17T19:39:02.976127] [INFO ] [MAIN ] IDT: Full history saved. [2025-09-17T19:39:02.976222] [INFO ] [MAIN ] Update Progress: 1089/2371 symbols completed. IDT took 37.7s. Estimated remaining: 3h 7m 12s. Rate: 6.8 symbols/min [2025-09-17T19:39:03.154061] [INFO ] [MAIN ] IFS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:39:03.180895] [DEBUG] [LOCAL ] IFS: Loaded 22964 existing records from primary storage. [2025-09-17T19:39:03.181019] [INFO ] [MAIN ] IFS: Loaded 22964 existing records. [2025-09-17T19:39:03.357937] [WARN ] [MAIN ] IFS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:39:03.358219] [INFO ] [MAIN ] IFS: Wiping existing primary data before full refresh. [2025-09-17T19:39:03.358266] [INFO ] [LOCAL ] IFS: Starting deletion of primary data. [2025-09-17T19:39:03.358890] [DEBUG] [LOCAL ] IFS: Deleted primary data file. [2025-09-17T19:39:03.358942] [INFO ] [MAIN ] IFS: Starting full primary refresh. [2025-09-17T19:39:03.622080] [INFO ] [REMOTE ] IEX: Fetching primary data for 2025-09. [2025-09-17T19:39:03.761841] [INFO ] [REMOTE ] IFS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:39:03.795629] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T19:39:04.415816] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-11. [2025-09-17T19:39:04.647590] [INFO ] [REMOTE ] IEX: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T19:39:04.652880] [INFO ] [REMOTE ] IEX: Full fetch complete (53039 records). [2025-09-17T19:39:04.652986] [DEBUG] [VALIDATOR ] IEX: Validating primary data. [2025-09-17T19:39:05.051495] [DEBUG] [VALIDATOR ] IEX: All expected trading days are present. [2025-09-17T19:39:05.051738] [DEBUG] [VALIDATOR ] IEX: Primary data validation passed. [2025-09-17T19:39:05.053149] [INFO ] [MAIN ] IEX: Fetched primary data is valid. [2025-09-17T19:39:05.053263] [DEBUG] [LOCAL ] IEX: Saving primary data. [2025-09-17T19:39:05.084892] [DEBUG] [LOCAL ] IEX: Trimmed 53039 records to 38392 (keeping 200 days of data) [2025-09-17T19:39:05.087347] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-17T19:39:05.217070] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-03. [2025-09-17T19:39:05.385697] [DEBUG] [LOCAL ] IEX: Primary data saved (38392 records). [2025-09-17T19:39:05.385960] [INFO ] [MAIN ] IEX: Full history saved. [2025-09-17T19:39:05.386116] [INFO ] [MAIN ] Update Progress: 1090/2371 symbols completed. IEX took 33.4s. Estimated remaining: 3h 6m 56s. Rate: 6.9 symbols/min [2025-09-17T19:39:05.578597] [INFO ] [MAIN ] IGA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:39:05.578834] [DEBUG] [LOCAL ] IGA: No existing data file found in primary storage. [2025-09-17T19:39:05.578876] [WARN ] [MAIN ] IGA: No existing data found, performing full refresh instead. [2025-09-17T19:39:05.579009] [INFO ] [MAIN ] IGA: Wiping existing primary data before full refresh. [2025-09-17T19:39:05.579049] [INFO ] [LOCAL ] IGA: Starting deletion of primary data. [2025-09-17T19:39:05.579091] [DEBUG] [LOCAL ] IGA: No primary data file found to delete. [2025-09-17T19:39:05.579134] [INFO ] [MAIN ] IGA: Starting full primary refresh. [2025-09-17T19:39:05.883463] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T19:39:05.980079] [INFO ] [REMOTE ] IGA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:39:06.015819] [INFO ] [REMOTE ] IFS: Fetching primary data for 2024-12. [2025-09-17T19:39:06.815824] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-05. [2025-09-17T19:39:06.837560] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T19:39:06.969090] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T19:39:07.615767] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-01. [2025-09-17T19:39:07.741667] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-17T19:39:08.415856] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-11. [2025-09-17T19:39:08.566461] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T19:39:08.854632] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T19:39:09.215804] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-02. [2025-09-17T19:39:10.015877] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-04. [2025-09-17T19:39:10.289214] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T19:39:10.815819] [INFO ] [REMOTE ] IGA: Fetching primary data for 2024-12. [2025-09-17T19:39:11.297479] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T19:39:11.615788] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-06. [2025-09-17T19:39:11.808242] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T19:39:12.158286] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T19:39:12.415789] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-07. [2025-09-17T19:39:13.215799] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-01. [2025-09-17T19:39:13.507617] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T19:39:13.747772] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T19:39:14.015840] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-08. [2025-09-17T19:39:14.815851] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-05. [2025-09-17T19:39:15.084461] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T19:39:15.615775] [INFO ] [REMOTE ] IFN: Fetching primary data for 2025-09. [2025-09-17T19:39:16.351943] [INFO ] [REMOTE ] IFN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T19:39:16.354544] [INFO ] [REMOTE ] IFN: Full fetch complete (28896 records). [2025-09-17T19:39:16.354636] [DEBUG] [VALIDATOR ] IFN: Validating primary data. [2025-09-17T19:39:16.420983] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-03. [2025-09-17T19:39:16.725244] [DEBUG] [VALIDATOR ] IFN: All expected trading days are present. [2025-09-17T19:39:16.725331] [DEBUG] [VALIDATOR ] IFN: Primary data validation passed. [2025-09-17T19:39:16.726085] [INFO ] [MAIN ] IFN: Fetched primary data is valid. [2025-09-17T19:39:16.726145] [DEBUG] [LOCAL ] IFN: Saving primary data. [2025-09-17T19:39:16.726912] [DEBUG] [LOCAL ] IFN: Trimmed 28896 records to 18298 (keeping 200 days of data) [2025-09-17T19:39:16.856611] [DEBUG] [LOCAL ] IFN: Primary data saved (18298 records). [2025-09-17T19:39:16.856770] [INFO ] [MAIN ] IFN: Full history saved. [2025-09-17T19:39:16.856903] [INFO ] [MAIN ] Update Progress: 1091/2371 symbols completed. IFN took 30.5s. Estimated remaining: 3h 6m 50s. Rate: 6.9 symbols/min [2025-09-17T19:39:17.029358] [INFO ] [MAIN ] IGD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:39:17.050696] [DEBUG] [LOCAL ] IGD: Loaded 19381 existing records from primary storage. [2025-09-17T19:39:17.050819] [INFO ] [MAIN ] IGD: Loaded 19381 existing records. [2025-09-17T19:39:17.231285] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-02. [2025-09-17T19:39:17.231556] [WARN ] [MAIN ] IGD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:39:17.232949] [INFO ] [MAIN ] IGD: Wiping existing primary data before full refresh. [2025-09-17T19:39:17.233042] [INFO ] [LOCAL ] IGD: Starting deletion of primary data. [2025-09-17T19:39:17.233591] [DEBUG] [LOCAL ] IGD: Deleted primary data file. [2025-09-17T19:39:17.233684] [INFO ] [MAIN ] IGD: Starting full primary refresh. [2025-09-17T19:39:17.609488] [INFO ] [REMOTE ] IGD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:39:17.636713] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-17T19:39:18.015785] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-06. [2025-09-17T19:39:18.078841] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T19:39:18.349371] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T19:39:18.815777] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-04. [2025-09-17T19:39:19.588769] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T19:39:19.615700] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-07. [2025-09-17T19:39:19.947924] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T19:39:20.415800] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-03. [2025-09-17T19:39:21.166808] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T19:39:21.215813] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-04. [2025-09-17T19:39:21.422862] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T19:39:22.015845] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-11. [2025-09-17T19:39:22.111707] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T19:39:22.815819] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-05. [2025-09-17T19:39:23.030660] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T19:39:23.615831] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-05. [2025-09-17T19:39:23.964233] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T19:39:24.324166] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T19:39:24.415794] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-06. [2025-09-17T19:39:25.215821] [INFO ] [REMOTE ] IGD: Fetching primary data for 2024-12. [2025-09-17T19:39:25.308121] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T19:39:26.015838] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-06. [2025-09-17T19:39:26.157103] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T19:39:26.750987] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T19:39:26.815772] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-07. [2025-09-17T19:39:27.596721] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T19:39:27.615749] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-08. [2025-09-17T19:39:28.362246] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T19:39:28.415780] [INFO ] [REMOTE ] IGA: Fetching primary data for 2025-09. [2025-09-17T19:39:29.015141] [INFO ] [REMOTE ] IGA: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T19:39:29.017319] [INFO ] [REMOTE ] IGA: Full fetch complete (13460 records). [2025-09-17T19:39:29.017421] [DEBUG] [VALIDATOR ] IGA: Validating primary data. [2025-09-17T19:39:29.225909] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-01. [2025-09-17T19:39:29.402152] [DEBUG] [VALIDATOR ] IGA: All expected trading days are present. [2025-09-17T19:39:29.402276] [DEBUG] [VALIDATOR ] IGA: Primary data validation passed. [2025-09-17T19:39:29.402579] [INFO ] [MAIN ] IGA: Fetched primary data is valid. [2025-09-17T19:39:29.402617] [DEBUG] [LOCAL ] IGA: Saving primary data. [2025-09-17T19:39:29.403183] [DEBUG] [LOCAL ] IGA: Trimmed 13460 records to 9709 (keeping 200 days of data) [2025-09-17T19:39:29.466271] [DEBUG] [LOCAL ] IGA: Primary data saved (9709 records). [2025-09-17T19:39:29.466408] [INFO ] [MAIN ] IGA: Full history saved. [2025-09-17T19:39:29.466493] [INFO ] [MAIN ] Update Progress: 1092/2371 symbols completed. IGA took 24.1s. Estimated remaining: 3h 6m 46s. Rate: 6.8 symbols/min [2025-09-17T19:39:29.641180] [INFO ] [MAIN ] IGI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:39:29.647085] [DEBUG] [LOCAL ] IGI: Loaded 3770 existing records from primary storage. [2025-09-17T19:39:29.647175] [INFO ] [MAIN ] IGI: Loaded 3770 existing records. [2025-09-17T19:39:29.829731] [WARN ] [MAIN ] IGI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:39:29.830019] [INFO ] [MAIN ] IGI: Wiping existing primary data before full refresh. [2025-09-17T19:39:29.830070] [INFO ] [LOCAL ] IGI: Starting deletion of primary data. [2025-09-17T19:39:29.830319] [DEBUG] [LOCAL ] IGI: Deleted primary data file. [2025-09-17T19:39:29.830373] [INFO ] [MAIN ] IGI: Starting full primary refresh. [2025-09-17T19:39:30.020990] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-07. [2025-09-17T19:39:30.211317] [INFO ] [REMOTE ] IGI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:39:30.699538] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T19:39:30.815783] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-02. [2025-09-17T19:39:31.248236] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T19:39:31.615826] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-08. [2025-09-17T19:39:32.076089] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T19:39:32.415717] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-11. [2025-09-17T19:39:32.433025] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T19:39:32.988633] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T19:39:33.215822] [INFO ] [REMOTE ] IGI: Fetching primary data for 2024-12. [2025-09-17T19:39:33.877392] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T19:39:34.015807] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-03. [2025-09-17T19:39:34.815768] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-01. [2025-09-17T19:39:35.075914] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T19:39:35.239477] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T19:39:35.615797] [INFO ] [REMOTE ] IFS: Fetching primary data for 2025-09. [2025-09-17T19:39:36.209239] [INFO ] [REMOTE ] IFS: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T19:39:36.212442] [INFO ] [REMOTE ] IFS: Full fetch complete (31149 records). [2025-09-17T19:39:36.212519] [DEBUG] [VALIDATOR ] IFS: Validating primary data. [2025-09-17T19:39:36.424074] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-02. [2025-09-17T19:39:36.594586] [DEBUG] [VALIDATOR ] IFS: All expected trading days are present. [2025-09-17T19:39:36.594687] [DEBUG] [VALIDATOR ] IFS: Primary data validation passed. [2025-09-17T19:39:36.595300] [INFO ] [MAIN ] IFS: Fetched primary data is valid. [2025-09-17T19:39:36.595339] [DEBUG] [LOCAL ] IFS: Saving primary data. [2025-09-17T19:39:36.596500] [DEBUG] [LOCAL ] IFS: Trimmed 31149 records to 22968 (keeping 200 days of data) [2025-09-17T19:39:36.731023] [DEBUG] [LOCAL ] IFS: Primary data saved (22968 records). [2025-09-17T19:39:36.731141] [INFO ] [MAIN ] IFS: Full history saved. [2025-09-17T19:39:36.731238] [INFO ] [MAIN ] Update Progress: 1093/2371 symbols completed. IFS took 33.8s. Estimated remaining: 3h 6m 35s. Rate: 6.8 symbols/min [2025-09-17T19:39:36.906718] [INFO ] [MAIN ] IGR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:39:36.939570] [DEBUG] [LOCAL ] IGR: Loaded 30578 existing records from primary storage. [2025-09-17T19:39:36.939768] [INFO ] [MAIN ] IGR: Loaded 30578 existing records. [2025-09-17T19:39:37.043828] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T19:39:37.126908] [WARN ] [MAIN ] IGR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:39:37.127156] [INFO ] [MAIN ] IGR: Wiping existing primary data before full refresh. [2025-09-17T19:39:37.127203] [INFO ] [LOCAL ] IGR: Starting deletion of primary data. [2025-09-17T19:39:37.128069] [DEBUG] [LOCAL ] IGR: Deleted primary data file. [2025-09-17T19:39:37.128122] [INFO ] [MAIN ] IGR: Starting full primary refresh. [2025-09-17T19:39:37.220888] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-04. [2025-09-17T19:39:37.486226] [INFO ] [REMOTE ] IGR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:39:38.015736] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-08. [2025-09-17T19:39:38.403730] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T19:39:38.815767] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-11. [2025-09-17T19:39:39.615814] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-05. [2025-09-17T19:39:39.803835] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T19:39:40.144063] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T19:39:40.415838] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-03. [2025-09-17T19:39:40.616712] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T19:39:41.040213] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T19:39:41.215796] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-04. [2025-09-17T19:39:41.676221] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T19:39:42.015788] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-05. [2025-09-17T19:39:42.384071] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-17T19:39:42.815804] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-06. [2025-09-17T19:39:43.393367] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T19:39:43.615810] [INFO ] [REMOTE ] IFF: Fetching primary data for 2025-09. [2025-09-17T19:39:44.414922] [INFO ] [REMOTE ] IFF: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T19:39:44.418053] [INFO ] [REMOTE ] IGR: Fetching primary data for 2024-12. [2025-09-17T19:39:44.424368] [INFO ] [REMOTE ] IFF: Full fetch complete (72485 records). [2025-09-17T19:39:44.424517] [DEBUG] [VALIDATOR ] IFF: Validating primary data. [2025-09-17T19:39:44.826068] [DEBUG] [VALIDATOR ] IFF: All expected trading days are present. [2025-09-17T19:39:44.826169] [DEBUG] [VALIDATOR ] IFF: Primary data validation passed. [2025-09-17T19:39:44.827117] [INFO ] [MAIN ] IFF: Fetched primary data is valid. [2025-09-17T19:39:44.827166] [DEBUG] [LOCAL ] IFF: Saving primary data. [2025-09-17T19:39:44.828792] [DEBUG] [LOCAL ] IFF: Trimmed 72485 records to 50946 (keeping 200 days of data) [2025-09-17T19:39:45.153362] [DEBUG] [LOCAL ] IFF: Primary data saved (50946 records). [2025-09-17T19:39:45.153521] [INFO ] [MAIN ] IFF: Full history saved. [2025-09-17T19:39:45.155215] [INFO ] [MAIN ] Update Progress: 1094/2371 symbols completed. IFF took 1m 1s. Estimated remaining: 3h 6m 26s. Rate: 6.8 symbols/min [2025-09-17T19:39:45.220874] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-07. [2025-09-17T19:39:45.333737] [INFO ] [MAIN ] IH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:39:45.340633] [DEBUG] [LOCAL ] IH: Loaded 3612 existing records from primary storage. [2025-09-17T19:39:45.340776] [INFO ] [MAIN ] IH: Loaded 3612 existing records. [2025-09-17T19:39:45.525575] [WARN ] [MAIN ] IH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:39:45.525910] [INFO ] [MAIN ] IH: Wiping existing primary data before full refresh. [2025-09-17T19:39:45.525956] [INFO ] [LOCAL ] IH: Starting deletion of primary data. [2025-09-17T19:39:45.526325] [DEBUG] [LOCAL ] IH: Deleted primary data file. [2025-09-17T19:39:45.526373] [INFO ] [MAIN ] IH: Starting full primary refresh. [2025-09-17T19:39:45.904702] [INFO ] [REMOTE ] IH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:39:45.910222] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T19:39:45.934903] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T19:39:46.015749] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-01. [2025-09-17T19:39:46.815785] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-08. [2025-09-17T19:39:47.368480] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T19:39:47.539082] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T19:39:47.615806] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-02. [2025-09-17T19:39:48.415782] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-06. [2025-09-17T19:39:48.912061] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T19:39:49.154718] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T19:39:49.215787] [INFO ] [REMOTE ] IGI: Fetching primary data for 2025-09. [2025-09-17T19:39:49.599709] [INFO ] [REMOTE ] IGI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T19:39:49.600709] [INFO ] [REMOTE ] IGI: Full fetch complete (5189 records). [2025-09-17T19:39:49.600787] [DEBUG] [VALIDATOR ] IGI: Validating primary data. [2025-09-17T19:39:49.982131] [DEBUG] [VALIDATOR ] IGI: All expected trading days are present. [2025-09-17T19:39:49.982216] [DEBUG] [VALIDATOR ] IGI: Primary data validation passed. [2025-09-17T19:39:49.982390] [INFO ] [MAIN ] IGI: Fetched primary data is valid. [2025-09-17T19:39:49.982437] [DEBUG] [LOCAL ] IGI: Saving primary data. [2025-09-17T19:39:49.982858] [DEBUG] [LOCAL ] IGI: Trimmed 5189 records to 3745 (keeping 200 days of data) [2025-09-17T19:39:50.007078] [DEBUG] [LOCAL ] IGI: Primary data saved (3745 records). [2025-09-17T19:39:50.007199] [INFO ] [MAIN ] IGI: Full history saved. [2025-09-17T19:39:50.007289] [INFO ] [MAIN ] Update Progress: 1095/2371 symbols completed. IGI took 20.5s. Estimated remaining: 3h 6m 13s. Rate: 6.9 symbols/min [2025-09-17T19:39:50.020951] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-03. [2025-09-17T19:39:50.192426] [INFO ] [MAIN ] IHD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:39:50.202855] [DEBUG] [LOCAL ] IHD: Loaded 7200 existing records from primary storage. [2025-09-17T19:39:50.202996] [INFO ] [MAIN ] IHD: Loaded 7200 existing records. [2025-09-17T19:39:50.389368] [WARN ] [MAIN ] IHD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:39:50.389667] [INFO ] [MAIN ] IHD: Wiping existing primary data before full refresh. [2025-09-17T19:39:50.389729] [INFO ] [LOCAL ] IHD: Starting deletion of primary data. [2025-09-17T19:39:50.390019] [DEBUG] [LOCAL ] IHD: Deleted primary data file. [2025-09-17T19:39:50.390066] [INFO ] [MAIN ] IHD: Starting full primary refresh. [2025-09-17T19:39:50.764072] [INFO ] [REMOTE ] IHD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:39:50.815773] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-07. [2025-09-17T19:39:51.326697] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T19:39:51.615771] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-04. [2025-09-17T19:39:51.912478] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T19:39:52.415777] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-11. [2025-09-17T19:39:52.682063] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T19:39:53.047663] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T19:39:53.215765] [INFO ] [REMOTE ] IHD: Fetching primary data for 2024-12. [2025-09-17T19:39:53.896954] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T19:39:54.015787] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-11. [2025-09-17T19:39:54.501163] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-11 (0.49 seconds). [2025-09-17T19:39:54.815772] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-01. [2025-09-17T19:39:55.533266] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T19:39:55.615760] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-02. [2025-09-17T19:39:56.370286] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T19:39:56.415777] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-03. [2025-09-17T19:39:57.127135] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T19:39:57.215770] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-04. [2025-09-17T19:39:58.015782] [INFO ] [REMOTE ] IH: Fetching primary data for 2024-12. [2025-09-17T19:39:58.055157] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T19:39:58.460829] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T19:39:58.815765] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-05. [2025-09-17T19:39:59.615778] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-05. [2025-09-17T19:39:59.638842] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T19:40:00.415787] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-01. [2025-09-17T19:40:00.867460] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T19:40:00.958493] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T19:40:01.215801] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-06. [2025-09-17T19:40:02.015962] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-08. [2025-09-17T19:40:02.414406] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T19:40:02.815861] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-07. [2025-09-17T19:40:03.048689] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T19:40:03.615794] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-06. [2025-09-17T19:40:04.408628] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T19:40:04.415685] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-07. [2025-09-17T19:40:04.596071] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T19:40:04.922762] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T19:40:05.215815] [INFO ] [REMOTE ] IGD: Fetching primary data for 2025-09. [2025-09-17T19:40:05.786763] [INFO ] [REMOTE ] IGD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:40:05.789592] [INFO ] [REMOTE ] IGD: Full fetch complete (29386 records). [2025-09-17T19:40:05.789726] [DEBUG] [VALIDATOR ] IGD: Validating primary data. [2025-09-17T19:40:06.021027] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-02. [2025-09-17T19:40:06.182958] [DEBUG] [VALIDATOR ] IGD: All expected trading days are present. [2025-09-17T19:40:06.183051] [DEBUG] [VALIDATOR ] IGD: Primary data validation passed. [2025-09-17T19:40:06.183629] [INFO ] [MAIN ] IGD: Fetched primary data is valid. [2025-09-17T19:40:06.183694] [DEBUG] [LOCAL ] IGD: Saving primary data. [2025-09-17T19:40:06.184807] [DEBUG] [LOCAL ] IGD: Trimmed 29386 records to 19315 (keeping 200 days of data) [2025-09-17T19:40:06.302202] [DEBUG] [LOCAL ] IGD: Primary data saved (19315 records). [2025-09-17T19:40:06.302371] [INFO ] [MAIN ] IGD: Full history saved. [2025-09-17T19:40:06.302480] [INFO ] [MAIN ] Update Progress: 1096/2371 symbols completed. IGD took 49.4s. Estimated remaining: 3h 6m 13s. Rate: 6.8 symbols/min [2025-09-17T19:40:06.477181] [INFO ] [MAIN ] IHG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:40:06.502389] [DEBUG] [LOCAL ] IHG: Loaded 24896 existing records from primary storage. [2025-09-17T19:40:06.502542] [INFO ] [MAIN ] IHG: Loaded 24896 existing records. [2025-09-17T19:40:06.687691] [WARN ] [MAIN ] IHG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:40:06.688043] [INFO ] [MAIN ] IHG: Wiping existing primary data before full refresh. [2025-09-17T19:40:06.688089] [INFO ] [LOCAL ] IHG: Starting deletion of primary data. [2025-09-17T19:40:06.688786] [DEBUG] [LOCAL ] IHG: Deleted primary data file. [2025-09-17T19:40:06.688843] [INFO ] [MAIN ] IHG: Starting full primary refresh. [2025-09-17T19:40:06.808601] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T19:40:06.824117] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-08. [2025-09-17T19:40:07.061810] [INFO ] [REMOTE ] IHG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:40:07.615915] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-03. [2025-09-17T19:40:08.315133] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T19:40:08.390273] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T19:40:08.415835] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-04. [2025-09-17T19:40:09.117683] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T19:40:09.215840] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-11. [2025-09-17T19:40:09.880078] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T19:40:10.015794] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-08. [2025-09-17T19:40:10.623303] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T19:40:10.815761] [INFO ] [REMOTE ] IGR: Fetching primary data for 2025-09. [2025-09-17T19:40:11.515401] [INFO ] [REMOTE ] IGR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:40:11.519758] [INFO ] [REMOTE ] IGR: Full fetch complete (45931 records). [2025-09-17T19:40:11.519877] [DEBUG] [VALIDATOR ] IGR: Validating primary data. [2025-09-17T19:40:11.623139] [INFO ] [REMOTE ] IHD: Fetching primary data for 2025-09. [2025-09-17T19:40:11.954024] [DEBUG] [VALIDATOR ] IGR: All expected trading days are present. [2025-09-17T19:40:11.954112] [DEBUG] [VALIDATOR ] IGR: Primary data validation passed. [2025-09-17T19:40:11.954811] [INFO ] [MAIN ] IGR: Fetched primary data is valid. [2025-09-17T19:40:11.954855] [DEBUG] [LOCAL ] IGR: Saving primary data. [2025-09-17T19:40:11.955826] [DEBUG] [LOCAL ] IGR: Trimmed 45931 records to 30557 (keeping 200 days of data) [2025-09-17T19:40:12.138831] [DEBUG] [LOCAL ] IGR: Primary data saved (30557 records). [2025-09-17T19:40:12.141730] [INFO ] [MAIN ] IGR: Full history saved. [2025-09-17T19:40:12.143038] [INFO ] [MAIN ] Update Progress: 1097/2371 symbols completed. IGR took 35.4s. Estimated remaining: 3h 6m 1s. Rate: 6.8 symbols/min [2025-09-17T19:40:12.143837] [INFO ] [REMOTE ] IHD: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T19:40:12.220906] [INFO ] [REMOTE ] IHD: Full fetch complete (12022 records). [2025-09-17T19:40:12.236752] [DEBUG] [VALIDATOR ] IHD: Validating primary data. [2025-09-17T19:40:12.416945] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-05. [2025-09-17T19:40:12.424190] [INFO ] [MAIN ] IHS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:40:12.731400] [DEBUG] [LOCAL ] IHS: Loaded 39153 existing records from primary storage. [2025-09-17T19:40:12.731777] [INFO ] [MAIN ] IHS: Loaded 39153 existing records. [2025-09-17T19:40:12.731683] [DEBUG] [VALIDATOR ] IHD: All expected trading days are present. [2025-09-17T19:40:12.737010] [DEBUG] [VALIDATOR ] IHD: Primary data validation passed. [2025-09-17T19:40:12.764468] [INFO ] [MAIN ] IHD: Fetched primary data is valid. [2025-09-17T19:40:12.776079] [DEBUG] [LOCAL ] IHD: Saving primary data. [2025-09-17T19:40:12.836960] [DEBUG] [LOCAL ] IHD: Trimmed 12022 records to 7223 (keeping 200 days of data) [2025-09-17T19:40:12.968845] [DEBUG] [LOCAL ] IHD: Primary data saved (7223 records). [2025-09-17T19:40:12.976767] [INFO ] [MAIN ] IHD: Full history saved. [2025-09-17T19:40:12.976926] [INFO ] [MAIN ] Update Progress: 1098/2371 symbols completed. IHD took 23.0s. Estimated remaining: 3h 5m 43s. Rate: 6.9 symbols/min [2025-09-17T19:40:12.976691] [WARN ] [MAIN ] IHS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:40:12.977210] [INFO ] [MAIN ] IHS: Wiping existing primary data before full refresh. [2025-09-17T19:40:12.977356] [INFO ] [LOCAL ] IHS: Starting deletion of primary data. [2025-09-17T19:40:13.023038] [DEBUG] [LOCAL ] IHS: Deleted primary data file. [2025-09-17T19:40:13.049417] [INFO ] [MAIN ] IHS: Starting full primary refresh. [2025-09-17T19:40:13.105566] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T19:40:13.220879] [INFO ] [REMOTE ] IHG: Fetching primary data for 2024-12. [2025-09-17T19:40:13.271205] [INFO ] [MAIN ] IIF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:40:13.481655] [DEBUG] [LOCAL ] IIF: Loaded 5891 existing records from primary storage. [2025-09-17T19:40:13.492481] [INFO ] [MAIN ] IIF: Loaded 5891 existing records. [2025-09-17T19:40:13.653842] [INFO ] [REMOTE ] IHS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:40:13.762066] [WARN ] [MAIN ] IIF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:40:13.762390] [INFO ] [MAIN ] IIF: Wiping existing primary data before full refresh. [2025-09-17T19:40:13.762442] [INFO ] [LOCAL ] IIF: Starting deletion of primary data. [2025-09-17T19:40:13.762715] [DEBUG] [LOCAL ] IIF: Deleted primary data file. [2025-09-17T19:40:13.762763] [INFO ] [MAIN ] IIF: Starting full primary refresh. [2025-09-17T19:40:14.023585] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-06. [2025-09-17T19:40:14.139663] [INFO ] [REMOTE ] IIF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:40:14.363617] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T19:40:14.554966] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T19:40:14.815772] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-07. [2025-09-17T19:40:15.507463] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T19:40:15.615817] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-11. [2025-09-17T19:40:16.415777] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-08. [2025-09-17T19:40:16.901983] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T19:40:16.924687] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T19:40:17.215808] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-11. [2025-09-17T19:40:18.015801] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-01. [2025-09-17T19:40:18.182506] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T19:40:18.815770] [INFO ] [REMOTE ] IHS: Fetching primary data for 2024-12. [2025-09-17T19:40:18.973625] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T19:40:19.615809] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-02. [2025-09-17T19:40:19.899844] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T19:40:20.415784] [INFO ] [REMOTE ] IIF: Fetching primary data for 2024-12. [2025-09-17T19:40:20.609667] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T19:40:21.170269] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T19:40:21.215724] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-01. [2025-09-17T19:40:22.015798] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-01. [2025-09-17T19:40:22.070329] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T19:40:22.815782] [INFO ] [REMOTE ] IH: Fetching primary data for 2025-09. [2025-09-17T19:40:23.000177] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T19:40:23.183446] [INFO ] [REMOTE ] IH: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T19:40:23.184454] [INFO ] [REMOTE ] IH: Full fetch complete (4898 records). [2025-09-17T19:40:23.184523] [DEBUG] [VALIDATOR ] IH: Validating primary data. [2025-09-17T19:40:23.543073] [DEBUG] [VALIDATOR ] IH: All expected trading days are present. [2025-09-17T19:40:23.543158] [DEBUG] [VALIDATOR ] IH: Primary data validation passed. [2025-09-17T19:40:23.543306] [INFO ] [MAIN ] IH: Fetched primary data is valid. [2025-09-17T19:40:23.543344] [DEBUG] [LOCAL ] IH: Saving primary data. [2025-09-17T19:40:23.543739] [DEBUG] [LOCAL ] IH: Trimmed 4898 records to 3585 (keeping 200 days of data) [2025-09-17T19:40:23.565981] [DEBUG] [LOCAL ] IH: Primary data saved (3585 records). [2025-09-17T19:40:23.566068] [INFO ] [MAIN ] IH: Full history saved. [2025-09-17T19:40:23.566150] [INFO ] [MAIN ] Update Progress: 1099/2371 symbols completed. IH took 38.4s. Estimated remaining: 3h 5m 36s. Rate: 6.9 symbols/min [2025-09-17T19:40:23.620926] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-02. [2025-09-17T19:40:23.735703] [INFO ] [MAIN ] IIIN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:40:23.753450] [DEBUG] [LOCAL ] IIIN: Loaded 16995 existing records from primary storage. [2025-09-17T19:40:23.753609] [INFO ] [MAIN ] IIIN: Loaded 16995 existing records. [2025-09-17T19:40:23.929622] [WARN ] [MAIN ] IIIN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:40:23.929876] [INFO ] [MAIN ] IIIN: Wiping existing primary data before full refresh. [2025-09-17T19:40:23.929920] [INFO ] [LOCAL ] IIIN: Starting deletion of primary data. [2025-09-17T19:40:23.930436] [DEBUG] [LOCAL ] IIIN: Deleted primary data file. [2025-09-17T19:40:23.930481] [INFO ] [MAIN ] IIIN: Starting full primary refresh. [2025-09-17T19:40:24.285043] [INFO ] [REMOTE ] IIIN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:40:24.379863] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T19:40:24.415799] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-11. [2025-09-17T19:40:25.215783] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-03. [2025-09-17T19:40:25.405604] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T19:40:26.015786] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-03. [2025-09-17T19:40:26.451125] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T19:40:26.619595] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T19:40:26.815761] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-04. [2025-09-17T19:40:27.467453] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-17T19:40:27.615791] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2024-12. [2025-09-17T19:40:28.415790] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-04. [2025-09-17T19:40:28.505365] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T19:40:29.215821] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-01. [2025-09-17T19:40:29.857023] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T19:40:30.015816] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-05. [2025-09-17T19:40:30.373606] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T19:40:30.815773] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-05. [2025-09-17T19:40:30.941448] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-17T19:40:31.403704] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T19:40:31.615784] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-06. [2025-09-17T19:40:32.415805] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-02. [2025-09-17T19:40:32.737162] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T19:40:33.215777] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-06. [2025-09-17T19:40:33.664605] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T19:40:33.803241] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T19:40:34.015792] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-03. [2025-09-17T19:40:34.815773] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-07. [2025-09-17T19:40:35.495824] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T19:40:35.521259] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T19:40:35.615769] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-04. [2025-09-17T19:40:36.415828] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-07. [2025-09-17T19:40:36.803220] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T19:40:37.215822] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-08. [2025-09-17T19:40:37.601487] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T19:40:37.883241] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T19:40:38.015898] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-08. [2025-09-17T19:40:38.815752] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-02. [2025-09-17T19:40:39.225169] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T19:40:39.411121] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T19:40:39.615824] [INFO ] [REMOTE ] IIF: Fetching primary data for 2025-09. [2025-09-17T19:40:39.983357] [INFO ] [REMOTE ] IIF: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T19:40:39.984455] [INFO ] [REMOTE ] IIF: Full fetch complete (9694 records). [2025-09-17T19:40:39.984527] [DEBUG] [VALIDATOR ] IIF: Validating primary data. [2025-09-17T19:40:40.359823] [DEBUG] [VALIDATOR ] IIF: All expected trading days are present. [2025-09-17T19:40:40.359910] [DEBUG] [VALIDATOR ] IIF: Primary data validation passed. [2025-09-17T19:40:40.360172] [INFO ] [MAIN ] IIF: Fetched primary data is valid. [2025-09-17T19:40:40.360213] [DEBUG] [LOCAL ] IIF: Saving primary data. [2025-09-17T19:40:40.360676] [DEBUG] [LOCAL ] IIF: Trimmed 9694 records to 5841 (keeping 200 days of data) [2025-09-17T19:40:40.396390] [DEBUG] [LOCAL ] IIF: Primary data saved (5841 records). [2025-09-17T19:40:40.396514] [INFO ] [MAIN ] IIF: Full history saved. [2025-09-17T19:40:40.396605] [INFO ] [MAIN ] Update Progress: 1100/2371 symbols completed. IIF took 27.4s. Estimated remaining: 3h 5m 37s. Rate: 6.8 symbols/min [2025-09-17T19:40:40.420936] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-05. [2025-09-17T19:40:40.582385] [INFO ] [MAIN ] IIM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:40:40.600076] [DEBUG] [LOCAL ] IIM: Loaded 15974 existing records from primary storage. [2025-09-17T19:40:40.600233] [INFO ] [MAIN ] IIM: Loaded 15974 existing records. [2025-09-17T19:40:40.780226] [WARN ] [MAIN ] IIM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:40:40.780484] [INFO ] [MAIN ] IIM: Wiping existing primary data before full refresh. [2025-09-17T19:40:40.780540] [INFO ] [LOCAL ] IIM: Starting deletion of primary data. [2025-09-17T19:40:40.781027] [DEBUG] [LOCAL ] IIM: Deleted primary data file. [2025-09-17T19:40:40.781084] [INFO ] [MAIN ] IIM: Starting full primary refresh. [2025-09-17T19:40:41.153127] [INFO ] [REMOTE ] IIM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:40:41.215744] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-11. [2025-09-17T19:40:41.807970] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T19:40:42.015857] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-03. [2025-09-17T19:40:42.248195] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T19:40:42.815768] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-06. [2025-09-17T19:40:43.113857] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T19:40:43.615796] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-04. [2025-09-17T19:40:44.328241] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T19:40:44.415732] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-07. [2025-09-17T19:40:44.790894] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T19:40:45.215812] [INFO ] [REMOTE ] IHG: Fetching primary data for 2025-09. [2025-09-17T19:40:45.843628] [INFO ] [REMOTE ] IHG: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T19:40:45.847362] [INFO ] [REMOTE ] IHG: Full fetch complete (33380 records). [2025-09-17T19:40:45.847545] [DEBUG] [VALIDATOR ] IHG: Validating primary data. [2025-09-17T19:40:46.016243] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-05. [2025-09-17T19:40:46.127994] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T19:40:46.258663] [DEBUG] [VALIDATOR ] IHG: All expected trading days are present. [2025-09-17T19:40:46.258741] [DEBUG] [VALIDATOR ] IHG: Primary data validation passed. [2025-09-17T19:40:46.259331] [INFO ] [MAIN ] IHG: Fetched primary data is valid. [2025-09-17T19:40:46.259372] [DEBUG] [LOCAL ] IHG: Saving primary data. [2025-09-17T19:40:46.260238] [DEBUG] [LOCAL ] IHG: Trimmed 33380 records to 24901 (keeping 200 days of data) [2025-09-17T19:40:46.418100] [DEBUG] [LOCAL ] IHG: Primary data saved (24901 records). [2025-09-17T19:40:46.418253] [INFO ] [MAIN ] IHG: Full history saved. [2025-09-17T19:40:46.418343] [INFO ] [MAIN ] Update Progress: 1101/2371 symbols completed. IHG took 40.1s. Estimated remaining: 3h 5m 25s. Rate: 6.8 symbols/min [2025-09-17T19:40:46.602926] [INFO ] [MAIN ] IIPR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:40:46.648470] [DEBUG] [LOCAL ] IIPR: Loaded 29629 existing records from primary storage. [2025-09-17T19:40:46.648745] [INFO ] [MAIN ] IIPR: Loaded 29629 existing records. [2025-09-17T19:40:46.819138] [INFO ] [REMOTE ] IIM: Fetching primary data for 2024-12. [2025-09-17T19:40:46.843112] [WARN ] [MAIN ] IIPR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:40:46.843428] [INFO ] [MAIN ] IIPR: Wiping existing primary data before full refresh. [2025-09-17T19:40:46.843481] [INFO ] [LOCAL ] IIPR: Starting deletion of primary data. [2025-09-17T19:40:46.844519] [DEBUG] [LOCAL ] IIPR: Deleted primary data file. [2025-09-17T19:40:46.844587] [INFO ] [MAIN ] IIPR: Starting full primary refresh. [2025-09-17T19:40:47.251807] [INFO ] [REMOTE ] IIPR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:40:47.266154] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T19:40:47.615828] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-06. [2025-09-17T19:40:47.673328] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T19:40:48.415834] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-01. [2025-09-17T19:40:48.600133] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T19:40:49.137529] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T19:40:49.215767] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-02. [2025-09-17T19:40:50.015843] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-07. [2025-09-17T19:40:50.298572] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T19:40:50.667956] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T19:40:50.815764] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-08. [2025-09-17T19:40:51.615803] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-03. [2025-09-17T19:40:52.381231] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T19:40:52.415827] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-08. [2025-09-17T19:40:52.512081] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T19:40:53.215814] [INFO ] [REMOTE ] IHS: Fetching primary data for 2025-09. [2025-09-17T19:40:53.252496] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T19:40:53.685919] [INFO ] [REMOTE ] IHS: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T19:40:53.690732] [INFO ] [REMOTE ] IHS: Full fetch complete (52535 records). [2025-09-17T19:40:53.690946] [DEBUG] [VALIDATOR ] IHS: Validating primary data. [2025-09-17T19:40:54.029756] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-11. [2025-09-17T19:40:54.082576] [DEBUG] [VALIDATOR ] IHS: All expected trading days are present. [2025-09-17T19:40:54.082709] [DEBUG] [VALIDATOR ] IHS: Primary data validation passed. [2025-09-17T19:40:54.083501] [INFO ] [MAIN ] IHS: Fetched primary data is valid. [2025-09-17T19:40:54.083552] [DEBUG] [LOCAL ] IHS: Saving primary data. [2025-09-17T19:40:54.085142] [DEBUG] [LOCAL ] IHS: Trimmed 52535 records to 39155 (keeping 200 days of data) [2025-09-17T19:40:54.323193] [DEBUG] [LOCAL ] IHS: Primary data saved (39155 records). [2025-09-17T19:40:54.323441] [INFO ] [MAIN ] IHS: Full history saved. [2025-09-17T19:40:54.323581] [INFO ] [MAIN ] Update Progress: 1102/2371 symbols completed. IHS took 42.2s. Estimated remaining: 3h 5m 15s. Rate: 6.9 symbols/min [2025-09-17T19:40:54.496955] [INFO ] [MAIN ] IMAX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:40:54.537748] [DEBUG] [LOCAL ] IMAX: Loaded 42625 existing records from primary storage. [2025-09-17T19:40:54.537940] [INFO ] [MAIN ] IMAX: Loaded 42625 existing records. [2025-09-17T19:40:54.717401] [WARN ] [MAIN ] IMAX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:40:54.717687] [INFO ] [MAIN ] IMAX: Wiping existing primary data before full refresh. [2025-09-17T19:40:54.717734] [INFO ] [LOCAL ] IMAX: Starting deletion of primary data. [2025-09-17T19:40:54.718744] [DEBUG] [LOCAL ] IMAX: Deleted primary data file. [2025-09-17T19:40:54.718795] [INFO ] [MAIN ] IMAX: Starting full primary refresh. [2025-09-17T19:40:54.820175] [INFO ] [REMOTE ] IIIN: Fetching primary data for 2025-09. [2025-09-17T19:40:55.100715] [INFO ] [REMOTE ] IMAX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:40:55.253512] [INFO ] [REMOTE ] IIIN: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T19:40:55.270386] [INFO ] [REMOTE ] IIIN: Full fetch complete (25248 records). [2025-09-17T19:40:55.280140] [DEBUG] [VALIDATOR ] IIIN: Validating primary data. [2025-09-17T19:40:55.281585] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T19:40:55.620860] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-04. [2025-09-17T19:40:55.666495] [DEBUG] [VALIDATOR ] IIIN: All expected trading days are present. [2025-09-17T19:40:55.666577] [DEBUG] [VALIDATOR ] IIIN: Primary data validation passed. [2025-09-17T19:40:55.667138] [INFO ] [MAIN ] IIIN: Fetched primary data is valid. [2025-09-17T19:40:55.667183] [DEBUG] [LOCAL ] IIIN: Saving primary data. [2025-09-17T19:40:55.667938] [DEBUG] [LOCAL ] IIIN: Trimmed 25248 records to 16975 (keeping 200 days of data) [2025-09-17T19:40:55.778158] [DEBUG] [LOCAL ] IIIN: Primary data saved (16975 records). [2025-09-17T19:40:55.778348] [INFO ] [MAIN ] IIIN: Full history saved. [2025-09-17T19:40:55.778468] [INFO ] [MAIN ] Update Progress: 1103/2371 symbols completed. IIIN took 32.2s. Estimated remaining: 3h 4m 58s. Rate: 6.9 symbols/min [2025-09-17T19:40:55.950792] [INFO ] [MAIN ] INFA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:40:56.004265] [DEBUG] [LOCAL ] INFA: Loaded 50208 existing records from primary storage. [2025-09-17T19:40:56.004457] [INFO ] [MAIN ] INFA: Loaded 50208 existing records. [2025-09-17T19:40:56.190588] [WARN ] [MAIN ] INFA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:40:56.190884] [INFO ] [MAIN ] INFA: Wiping existing primary data before full refresh. [2025-09-17T19:40:56.190940] [INFO ] [LOCAL ] INFA: Starting deletion of primary data. [2025-09-17T19:40:56.191966] [DEBUG] [LOCAL ] INFA: Deleted primary data file. [2025-09-17T19:40:56.192039] [INFO ] [MAIN ] INFA: Starting full primary refresh. [2025-09-17T19:40:56.426379] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-11. [2025-09-17T19:40:56.551562] [INFO ] [REMOTE ] INFA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:40:56.634005] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T19:40:57.215787] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-05. [2025-09-17T19:40:57.856390] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T19:40:57.997432] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T19:40:58.015716] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-06. [2025-09-17T19:40:58.815765] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-11. [2025-09-17T19:40:59.045470] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T19:40:59.615818] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2024-12. [2025-09-17T19:41:00.281356] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T19:41:00.415859] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2024-12. [2025-09-17T19:41:01.199709] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T19:41:01.215790] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-01. [2025-09-17T19:41:01.882073] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T19:41:02.015835] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-07. [2025-09-17T19:41:02.656565] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T19:41:02.815829] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-01. [2025-09-17T19:41:02.985246] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T19:41:03.615857] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-02. [2025-09-17T19:41:03.977359] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T19:41:04.415805] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-02. [2025-09-17T19:41:04.911033] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T19:41:05.215828] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-03. [2025-09-17T19:41:05.864416] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T19:41:06.015800] [INFO ] [REMOTE ] INFA: Fetching primary data for 2024-12. [2025-09-17T19:41:06.775964] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T19:41:06.815781] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-03. [2025-09-17T19:41:07.442032] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T19:41:07.615791] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-04. [2025-09-17T19:41:08.142112] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T19:41:08.415822] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-04. [2025-09-17T19:41:09.100989] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T19:41:09.215803] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-08. [2025-09-17T19:41:09.629176] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T19:41:10.015829] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-05. [2025-09-17T19:41:10.237503] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T19:41:10.815774] [INFO ] [REMOTE ] IIM: Fetching primary data for 2025-09. [2025-09-17T19:41:11.431383] [INFO ] [REMOTE ] IIM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T19:41:11.434806] [INFO ] [REMOTE ] IIM: Full fetch complete (25418 records). [2025-09-17T19:41:11.434982] [DEBUG] [VALIDATOR ] IIM: Validating primary data. [2025-09-17T19:41:11.583317] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T19:41:11.624122] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-05. [2025-09-17T19:41:11.860236] [DEBUG] [VALIDATOR ] IIM: All expected trading days are present. [2025-09-17T19:41:11.860323] [DEBUG] [VALIDATOR ] IIM: Primary data validation passed. [2025-09-17T19:41:11.860951] [INFO ] [MAIN ] IIM: Fetched primary data is valid. [2025-09-17T19:41:11.860994] [DEBUG] [LOCAL ] IIM: Saving primary data. [2025-09-17T19:41:11.861661] [DEBUG] [LOCAL ] IIM: Trimmed 25418 records to 15936 (keeping 200 days of data) [2025-09-17T19:41:11.963244] [DEBUG] [LOCAL ] IIM: Primary data saved (15936 records). [2025-09-17T19:41:11.963406] [INFO ] [MAIN ] IIM: Full history saved. [2025-09-17T19:41:11.963502] [INFO ] [MAIN ] Update Progress: 1104/2371 symbols completed. IIM took 31.6s. Estimated remaining: 3h 4m 58s. Rate: 6.9 symbols/min [2025-09-17T19:41:12.137991] [INFO ] [MAIN ] INFY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:41:12.201103] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-09-17T19:41:12.201311] [INFO ] [MAIN ] INFY: Loaded 53598 existing records. [2025-09-17T19:41:12.384904] [WARN ] [MAIN ] INFY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:41:12.385167] [INFO ] [MAIN ] INFY: Wiping existing primary data before full refresh. [2025-09-17T19:41:12.385213] [INFO ] [LOCAL ] INFY: Starting deletion of primary data. [2025-09-17T19:41:12.386241] [DEBUG] [LOCAL ] INFY: Deleted primary data file. [2025-09-17T19:41:12.386290] [INFO ] [MAIN ] INFY: Starting full primary refresh. [2025-09-17T19:41:12.420838] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-06. [2025-09-17T19:41:12.752944] [INFO ] [REMOTE ] INFY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:41:12.770240] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T19:41:13.215822] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-01. [2025-09-17T19:41:13.876901] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T19:41:14.015725] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-07. [2025-09-17T19:41:14.725454] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T19:41:14.815743] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-02. [2025-09-17T19:41:15.241846] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T19:41:15.615807] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-11. [2025-09-17T19:41:16.222908] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T19:41:16.415780] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-03. [2025-09-17T19:41:17.215785] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-08. [2025-09-17T19:41:17.347038] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T19:41:17.930690] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T19:41:18.015831] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-06. [2025-09-17T19:41:18.747726] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T19:41:18.815767] [INFO ] [REMOTE ] IMAX: Fetching primary data for 2025-09. [2025-09-17T19:41:19.329469] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T19:41:19.467770] [INFO ] [REMOTE ] IMAX: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T19:41:19.473568] [INFO ] [REMOTE ] IMAX: Full fetch complete (59315 records). [2025-09-17T19:41:19.473748] [DEBUG] [VALIDATOR ] IMAX: Validating primary data. [2025-09-17T19:41:19.625811] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-07. [2025-09-17T19:41:19.864554] [DEBUG] [VALIDATOR ] IMAX: All expected trading days are present. [2025-09-17T19:41:19.864653] [DEBUG] [VALIDATOR ] IMAX: Primary data validation passed. [2025-09-17T19:41:19.865451] [INFO ] [MAIN ] IMAX: Fetched primary data is valid. [2025-09-17T19:41:19.865507] [DEBUG] [LOCAL ] IMAX: Saving primary data. [2025-09-17T19:41:19.866684] [DEBUG] [LOCAL ] IMAX: Trimmed 59315 records to 42683 (keeping 200 days of data) [2025-09-17T19:41:20.120197] [DEBUG] [LOCAL ] IMAX: Primary data saved (42683 records). [2025-09-17T19:41:20.120335] [INFO ] [MAIN ] IMAX: Full history saved. [2025-09-17T19:41:20.120417] [INFO ] [MAIN ] Update Progress: 1105/2371 symbols completed. IMAX took 25.8s. Estimated remaining: 3h 4m 48s. Rate: 6.9 symbols/min [2025-09-17T19:41:20.288268] [INFO ] [MAIN ] ING: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:41:20.339967] [DEBUG] [LOCAL ] ING: Loaded 50913 existing records from primary storage. [2025-09-17T19:41:20.340156] [INFO ] [MAIN ] ING: Loaded 50913 existing records. [2025-09-17T19:41:20.420971] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-04. [2025-09-17T19:41:20.519851] [WARN ] [MAIN ] ING: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:41:20.520072] [INFO ] [MAIN ] ING: Wiping existing primary data before full refresh. [2025-09-17T19:41:20.520118] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-17T19:41:20.521521] [DEBUG] [LOCAL ] ING: Deleted primary data file. [2025-09-17T19:41:20.521577] [INFO ] [MAIN ] ING: Starting full primary refresh. [2025-09-17T19:41:20.873260] [INFO ] [REMOTE ] ING: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:41:21.007408] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T19:41:21.215756] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-11. [2025-09-17T19:41:21.997266] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T19:41:22.015719] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-05. [2025-09-17T19:41:22.564954] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T19:41:22.815789] [INFO ] [REMOTE ] ING: Fetching primary data for 2024-12. [2025-09-17T19:41:23.432374] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T19:41:23.615786] [INFO ] [REMOTE ] INFY: Fetching primary data for 2024-12. [2025-09-17T19:41:24.415835] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-08. [2025-09-17T19:41:24.671126] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T19:41:25.215782] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-01. [2025-09-17T19:41:25.538054] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T19:41:25.693622] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T19:41:26.015792] [INFO ] [REMOTE ] IIPR: Fetching primary data for 2025-09. [2025-09-17T19:41:26.712200] [INFO ] [REMOTE ] IIPR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:41:26.716065] [INFO ] [REMOTE ] IIPR: Full fetch complete (43727 records). [2025-09-17T19:41:26.716181] [DEBUG] [VALIDATOR ] IIPR: Validating primary data. [2025-09-17T19:41:26.823882] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-01. [2025-09-17T19:41:27.109801] [DEBUG] [VALIDATOR ] IIPR: All expected trading days are present. [2025-09-17T19:41:27.109916] [DEBUG] [VALIDATOR ] IIPR: Primary data validation passed. [2025-09-17T19:41:27.110785] [INFO ] [MAIN ] IIPR: Fetched primary data is valid. [2025-09-17T19:41:27.110922] [DEBUG] [LOCAL ] IIPR: Saving primary data. [2025-09-17T19:41:27.112303] [DEBUG] [LOCAL ] IIPR: Trimmed 43727 records to 29606 (keeping 200 days of data) [2025-09-17T19:41:27.281344] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-17T19:41:27.390152] [DEBUG] [LOCAL ] IIPR: Primary data saved (29606 records). [2025-09-17T19:41:27.390340] [INFO ] [MAIN ] IIPR: Full history saved. [2025-09-17T19:41:27.390438] [INFO ] [MAIN ] Update Progress: 1106/2371 symbols completed. IIPR took 41.0s. Estimated remaining: 3h 4m 38s. Rate: 6.9 symbols/min [2025-09-17T19:41:27.573415] [INFO ] [MAIN ] INGM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:41:27.607088] [DEBUG] [LOCAL ] INGM: Loaded 29364 existing records from primary storage. [2025-09-17T19:41:27.607268] [INFO ] [MAIN ] INGM: Loaded 29364 existing records. [2025-09-17T19:41:27.621077] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-02. [2025-09-17T19:41:27.803246] [WARN ] [MAIN ] INGM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:41:27.803527] [INFO ] [MAIN ] INGM: Wiping existing primary data before full refresh. [2025-09-17T19:41:27.803581] [INFO ] [LOCAL ] INGM: Starting deletion of primary data. [2025-09-17T19:41:27.804292] [DEBUG] [LOCAL ] INGM: Deleted primary data file. [2025-09-17T19:41:27.804343] [INFO ] [MAIN ] INGM: Starting full primary refresh. [2025-09-17T19:41:28.163434] [INFO ] [REMOTE ] INGM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:41:28.415778] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-06. [2025-09-17T19:41:28.838513] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T19:41:28.977824] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T19:41:29.215817] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-02. [2025-09-17T19:41:30.015805] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-03. [2025-09-17T19:41:30.123899] [DEBUG] [REMOTE ] ING: Error fetching primary data for 2025-03: 'API call returned an empty response.' [2025-09-17T19:41:30.124272] [WARN ] [REMOTE ] ING: No data returned for month 2025-03 [2025-09-17T19:41:30.126513] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T19:41:30.821924] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-07. [2025-09-17T19:41:30.842354] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T19:41:31.615832] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-04. [2025-09-17T19:41:32.415854] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-03. [2025-09-17T19:41:32.542667] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T19:41:33.215809] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-11. [2025-09-17T19:41:33.537851] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T19:41:34.015829] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-05. [2025-09-17T19:41:34.200623] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T19:41:34.241666] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T19:41:34.815823] [INFO ] [REMOTE ] INGM: Fetching primary data for 2024-12. [2025-09-17T19:41:35.576440] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T19:41:35.615697] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-04. [2025-09-17T19:41:35.656625] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T19:41:36.415820] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-08. [2025-09-17T19:41:37.215796] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-06. [2025-09-17T19:41:37.548963] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T19:41:38.015822] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-05. [2025-09-17T19:41:38.241318] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T19:41:38.815803] [INFO ] [REMOTE ] INFA: Fetching primary data for 2025-09. [2025-09-17T19:41:38.948547] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T19:41:39.578828] [INFO ] [REMOTE ] INFA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T19:41:39.587005] [INFO ] [REMOTE ] INFA: Full fetch complete (71851 records). [2025-09-17T19:41:39.587177] [DEBUG] [VALIDATOR ] INFA: Validating primary data. [2025-09-17T19:41:39.620914] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-01. [2025-09-17T19:41:39.997318] [DEBUG] [VALIDATOR ] INFA: All expected trading days are present. [2025-09-17T19:41:39.997507] [DEBUG] [VALIDATOR ] INFA: Primary data validation passed. [2025-09-17T19:41:39.998476] [INFO ] [MAIN ] INFA: Fetched primary data is valid. [2025-09-17T19:41:39.998546] [DEBUG] [LOCAL ] INFA: Saving primary data. [2025-09-17T19:41:40.000314] [DEBUG] [LOCAL ] INFA: Trimmed 71851 records to 50192 (keeping 200 days of data) [2025-09-17T19:41:40.127327] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-17T19:41:40.352519] [DEBUG] [LOCAL ] INFA: Primary data saved (50192 records). [2025-09-17T19:41:40.352707] [INFO ] [MAIN ] INFA: Full history saved. [2025-09-17T19:41:40.354396] [INFO ] [MAIN ] Update Progress: 1107/2371 symbols completed. INFA took 44.6s. Estimated remaining: 3h 4m 34s. Rate: 6.8 symbols/min [2025-09-17T19:41:40.420899] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-07. [2025-09-17T19:41:40.535005] [INFO ] [MAIN ] INGR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:41:40.579958] [DEBUG] [LOCAL ] INGR: Loaded 33338 existing records from primary storage. [2025-09-17T19:41:40.580119] [INFO ] [MAIN ] INGR: Loaded 33338 existing records. [2025-09-17T19:41:40.765163] [WARN ] [MAIN ] INGR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:41:40.765452] [INFO ] [MAIN ] INGR: Wiping existing primary data before full refresh. [2025-09-17T19:41:40.765623] [INFO ] [LOCAL ] INGR: Starting deletion of primary data. [2025-09-17T19:41:40.771635] [DEBUG] [LOCAL ] INGR: Deleted primary data file. [2025-09-17T19:41:40.781903] [INFO ] [MAIN ] INGR: Starting full primary refresh. [2025-09-17T19:41:40.865897] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T19:41:41.158774] [INFO ] [REMOTE ] INGR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:41:41.215768] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-11. [2025-09-17T19:41:42.020906] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-02. [2025-09-17T19:41:42.038844] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T19:41:42.562842] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T19:41:42.816109] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-06. [2025-09-17T19:41:43.231696] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T19:41:43.615782] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-08. [2025-09-17T19:41:44.415796] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-03. [2025-09-17T19:41:44.582119] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T19:41:45.215782] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-07. [2025-09-17T19:41:45.331261] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T19:41:45.803483] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T19:41:46.015778] [INFO ] [REMOTE ] INGR: Fetching primary data for 2024-12. [2025-09-17T19:41:46.815787] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-04. [2025-09-17T19:41:46.966678] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T19:41:47.465679] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T19:41:47.615775] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-01. [2025-09-17T19:41:48.193863] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T19:41:48.415835] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-05. [2025-09-17T19:41:49.117108] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T19:41:49.215764] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-02. [2025-09-17T19:41:49.722470] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T19:41:50.015788] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-06. [2025-09-17T19:41:50.821048] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-08. [2025-09-17T19:41:50.824067] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T19:41:51.130475] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T19:41:51.615791] [INFO ] [REMOTE ] ING: Fetching primary data for 2025-09. [2025-09-17T19:41:52.415902] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-03. [2025-09-17T19:41:52.617991] [INFO ] [REMOTE ] ING: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T19:41:52.627817] [INFO ] [REMOTE ] ING: Full fetch complete (65604 records). [2025-09-17T19:41:52.628043] [DEBUG] [VALIDATOR ] ING: Validating primary data. [2025-09-17T19:41:52.835255] [WARN ] [VALIDATOR ] ING: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T19:41:52.836150] [FATAL] [MAIN ] ING: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:41:52.836368] [WARN ] [MAIN ] ING: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:41:52.836468] [INFO ] [LOCAL ] ING: Starting deletion of primary data. [2025-09-17T19:41:52.871913] [DEBUG] [LOCAL ] ING: No primary data file found to delete. [2025-09-17T19:41:52.875963] [INFO ] [LOCAL ] ING: Starting deletion of derivative data. [2025-09-17T19:41:52.879204] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T19:41:52.879282] [DEBUG] [LOCAL ] ING: Deleted derivative data file. [2025-09-17T19:41:52.892721] [INFO ] [MAIN ] Update Progress: 1108/2371 symbols completed. ING took 32.8s. Estimated remaining: 3h 4m 29s. Rate: 6.8 symbols/min [2025-09-17T19:41:53.070944] [INFO ] [MAIN ] INN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:41:53.116036] [DEBUG] [LOCAL ] INN: Loaded 41964 existing records from primary storage. [2025-09-17T19:41:53.116189] [INFO ] [MAIN ] INN: Loaded 41964 existing records. [2025-09-17T19:41:53.216462] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-07. [2025-09-17T19:41:53.298852] [WARN ] [MAIN ] INN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:41:53.299155] [INFO ] [MAIN ] INN: Wiping existing primary data before full refresh. [2025-09-17T19:41:53.299211] [INFO ] [LOCAL ] INN: Starting deletion of primary data. [2025-09-17T19:41:53.300055] [DEBUG] [LOCAL ] INN: Deleted primary data file. [2025-09-17T19:41:53.300110] [INFO ] [MAIN ] INN: Starting full primary refresh. [2025-09-17T19:41:53.660311] [INFO ] [REMOTE ] INN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:41:53.684518] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T19:41:54.015772] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-11. [2025-09-17T19:41:54.523614] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T19:41:54.815776] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-04. [2025-09-17T19:41:55.468946] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T19:41:55.615746] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-08. [2025-09-17T19:41:55.956376] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T19:41:56.415736] [INFO ] [REMOTE ] INFY: Fetching primary data for 2025-09. [2025-09-17T19:41:56.874613] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T19:41:57.215766] [INFO ] [REMOTE ] INN: Fetching primary data for 2024-12. [2025-09-17T19:41:57.290486] [INFO ] [REMOTE ] INFY: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T19:41:57.297995] [INFO ] [REMOTE ] INFY: Full fetch complete (77373 records). [2025-09-17T19:41:57.298177] [DEBUG] [VALIDATOR ] INFY: Validating primary data. [2025-09-17T19:41:57.694556] [DEBUG] [VALIDATOR ] INFY: All expected trading days are present. [2025-09-17T19:41:57.694682] [DEBUG] [VALIDATOR ] INFY: Primary data validation passed. [2025-09-17T19:41:57.695757] [INFO ] [MAIN ] INFY: Fetched primary data is valid. [2025-09-17T19:41:57.695814] [DEBUG] [LOCAL ] INFY: Saving primary data. [2025-09-17T19:41:57.700529] [DEBUG] [LOCAL ] INFY: Trimmed 77373 records to 53598 (keeping 200 days of data) [2025-09-17T19:41:58.016028] [INFO ] [REMOTE ] INGM: Fetching primary data for 2025-09. [2025-09-17T19:41:58.039685] [DEBUG] [LOCAL ] INFY: Primary data saved (53598 records). [2025-09-17T19:41:58.039829] [INFO ] [MAIN ] INFY: Full history saved. [2025-09-17T19:41:58.039939] [INFO ] [MAIN ] Update Progress: 1109/2371 symbols completed. INFY took 46.1s. Estimated remaining: 3h 4m 17s. Rate: 6.8 symbols/min [2025-09-17T19:41:58.214434] [INFO ] [MAIN ] INR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:41:58.214599] [DEBUG] [LOCAL ] INR: No existing data file found in primary storage. [2025-09-17T19:41:58.214662] [WARN ] [MAIN ] INR: No existing data found, performing full refresh instead. [2025-09-17T19:41:58.214814] [INFO ] [MAIN ] INR: Wiping existing primary data before full refresh. [2025-09-17T19:41:58.214916] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-17T19:41:58.214979] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-17T19:41:58.215027] [INFO ] [MAIN ] INR: Starting full primary refresh. [2025-09-17T19:41:58.574774] [INFO ] [REMOTE ] INR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:41:58.686525] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T19:41:58.815787] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-11. [2025-09-17T19:41:58.873450] [INFO ] [REMOTE ] INGM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T19:41:58.878129] [INFO ] [REMOTE ] INGM: Full fetch complete (42221 records). [2025-09-17T19:41:58.878248] [DEBUG] [VALIDATOR ] INGM: Validating primary data. [2025-09-17T19:41:59.026436] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:41:59.059838] [WARN ] [REMOTE ] INR: No data returned for month 2024-11 [2025-09-17T19:41:59.267190] [DEBUG] [VALIDATOR ] INGM: All expected trading days are present. [2025-09-17T19:41:59.267285] [DEBUG] [VALIDATOR ] INGM: Primary data validation passed. [2025-09-17T19:41:59.268076] [INFO ] [MAIN ] INGM: Fetched primary data is valid. [2025-09-17T19:41:59.268135] [DEBUG] [LOCAL ] INGM: Saving primary data. [2025-09-17T19:41:59.271013] [DEBUG] [LOCAL ] INGM: Trimmed 42221 records to 29340 (keeping 200 days of data) [2025-09-17T19:41:59.458556] [DEBUG] [LOCAL ] INGM: Primary data saved (29340 records). [2025-09-17T19:41:59.458721] [INFO ] [MAIN ] INGM: Full history saved. [2025-09-17T19:41:59.458835] [INFO ] [MAIN ] Update Progress: 1110/2371 symbols completed. INGM took 32.1s. Estimated remaining: 3h 3m 60s. Rate: 6.9 symbols/min [2025-09-17T19:41:59.616573] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-05. [2025-09-17T19:41:59.634400] [INFO ] [MAIN ] INSP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:41:59.673859] [DEBUG] [LOCAL ] INSP: Loaded 36440 existing records from primary storage. [2025-09-17T19:41:59.674006] [INFO ] [MAIN ] INSP: Loaded 36440 existing records. [2025-09-17T19:41:59.864674] [WARN ] [MAIN ] INSP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:41:59.865223] [INFO ] [MAIN ] INSP: Wiping existing primary data before full refresh. [2025-09-17T19:41:59.865290] [INFO ] [LOCAL ] INSP: Starting deletion of primary data. [2025-09-17T19:41:59.866354] [DEBUG] [LOCAL ] INSP: Deleted primary data file. [2025-09-17T19:41:59.866432] [INFO ] [MAIN ] INSP: Starting full primary refresh. [2025-09-17T19:42:00.240683] [INFO ] [REMOTE ] INSP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:42:00.415785] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-01. [2025-09-17T19:42:00.884610] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T19:42:01.215817] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-06. [2025-09-17T19:42:01.922916] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T19:42:02.015829] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-11. [2025-09-17T19:42:02.815822] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-02. [2025-09-17T19:42:03.013200] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T19:42:03.615796] [INFO ] [REMOTE ] INR: Fetching primary data for 2024-12. [2025-09-17T19:42:04.415802] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-07. [2025-09-17T19:42:04.522258] [DEBUG] [REMOTE ] INR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:42:04.522734] [WARN ] [REMOTE ] INR: No data returned for month 2024-12 [2025-09-17T19:42:04.557634] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-11 (2.54 seconds). [2025-09-17T19:42:04.917899] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T19:42:05.215841] [INFO ] [REMOTE ] INSP: Fetching primary data for 2024-12. [2025-09-17T19:42:05.752318] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T19:42:06.015817] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-08. [2025-09-17T19:42:06.332261] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T19:42:06.815804] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-01. [2025-09-17T19:42:07.318359] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T19:42:07.353408] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T19:42:07.615819] [INFO ] [REMOTE ] INGR: Fetching primary data for 2025-09. [2025-09-17T19:42:08.213740] [INFO ] [REMOTE ] INGR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T19:42:08.219074] [INFO ] [REMOTE ] INGR: Full fetch complete (49415 records). [2025-09-17T19:42:08.219197] [DEBUG] [VALIDATOR ] INGR: Validating primary data. [2025-09-17T19:42:08.422093] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-01. [2025-09-17T19:42:08.634747] [DEBUG] [VALIDATOR ] INGR: All expected trading days are present. [2025-09-17T19:42:08.634858] [DEBUG] [VALIDATOR ] INGR: Primary data validation passed. [2025-09-17T19:42:08.636096] [INFO ] [MAIN ] INGR: Fetched primary data is valid. [2025-09-17T19:42:08.636149] [DEBUG] [LOCAL ] INGR: Saving primary data. [2025-09-17T19:42:08.637542] [DEBUG] [LOCAL ] INGR: Trimmed 49415 records to 33355 (keeping 200 days of data) [2025-09-17T19:42:08.865847] [DEBUG] [LOCAL ] INGR: Primary data saved (33355 records). [2025-09-17T19:42:08.866036] [INFO ] [MAIN ] INGR: Full history saved. [2025-09-17T19:42:08.866968] [INFO ] [MAIN ] Update Progress: 1111/2371 symbols completed. INGR took 28.5s. Estimated remaining: 3h 3m 51s. Rate: 6.9 symbols/min [2025-09-17T19:42:09.051232] [INFO ] [MAIN ] INSW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:42:09.097217] [DEBUG] [LOCAL ] INSW: Loaded 40774 existing records from primary storage. [2025-09-17T19:42:09.097393] [INFO ] [MAIN ] INSW: Loaded 40774 existing records. [2025-09-17T19:42:09.215982] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-02. [2025-09-17T19:42:09.312922] [WARN ] [MAIN ] INSW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:42:09.313236] [INFO ] [MAIN ] INSW: Wiping existing primary data before full refresh. [2025-09-17T19:42:09.313325] [INFO ] [LOCAL ] INSW: Starting deletion of primary data. [2025-09-17T19:42:09.314304] [DEBUG] [LOCAL ] INSW: Deleted primary data file. [2025-09-17T19:42:09.314365] [INFO ] [MAIN ] INSW: Starting full primary refresh. [2025-09-17T19:42:09.680463] [INFO ] [REMOTE ] INSW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:42:10.015792] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-03. [2025-09-17T19:42:10.061912] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T19:42:10.517596] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T19:42:10.815782] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-02. [2025-09-17T19:42:11.311318] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T19:42:11.615780] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-11. [2025-09-17T19:42:12.381958] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T19:42:12.415783] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-03. [2025-09-17T19:42:13.177921] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T19:42:13.215863] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-03. [2025-09-17T19:42:13.883354] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T19:42:14.015830] [INFO ] [REMOTE ] INSW: Fetching primary data for 2024-12. [2025-09-17T19:42:14.634076] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T19:42:14.815878] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-04. [2025-09-17T19:42:15.615870] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-04. [2025-09-17T19:42:16.415857] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-04. [2025-09-17T19:42:16.543402] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T19:42:16.647022] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-17T19:42:17.215790] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-01. [2025-09-17T19:42:17.735196] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T19:42:18.007003] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T19:42:18.016072] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-05. [2025-09-17T19:42:18.447239] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T19:42:18.815821] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-02. [2025-09-17T19:42:19.285664] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T19:42:19.615808] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-05. [2025-09-17T19:42:20.271601] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T19:42:20.380686] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T19:42:20.415777] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-06. [2025-09-17T19:42:21.215823] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-03. [2025-09-17T19:42:21.651538] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T19:42:22.015789] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-07. [2025-09-17T19:42:22.598292] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T19:42:22.815755] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-05. [2025-09-17T19:42:23.265935] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T19:42:23.615827] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-08. [2025-09-17T19:42:24.373257] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T19:42:24.415750] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-06. [2025-09-17T19:42:24.880830] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T19:42:25.215832] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-04. [2025-09-17T19:42:26.015817] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-06. [2025-09-17T19:42:26.077111] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T19:42:26.778668] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T19:42:26.815733] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-05. [2025-09-17T19:42:27.200548] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T19:42:27.615822] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-07. [2025-09-17T19:42:28.415770] [INFO ] [REMOTE ] INR: Fetching primary data for 2025-09. [2025-09-17T19:42:28.520415] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T19:42:28.716411] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T19:42:29.062076] [INFO ] [REMOTE ] INR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T19:42:29.065890] [INFO ] [REMOTE ] INR: Full fetch complete (32059 records). [2025-09-17T19:42:29.066013] [DEBUG] [VALIDATOR ] INR: Validating primary data. [2025-09-17T19:42:29.219053] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-08. [2025-09-17T19:42:29.254915] [WARN ] [VALIDATOR ] INR: Validation failed - insufficient historical data. Have 158 unique days, need 200 days [2025-09-17T19:42:29.256186] [FATAL] [MAIN ] INR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:42:29.256262] [WARN ] [MAIN ] INR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:42:29.256346] [INFO ] [LOCAL ] INR: Starting deletion of primary data. [2025-09-17T19:42:29.256432] [DEBUG] [LOCAL ] INR: No primary data file found to delete. [2025-09-17T19:42:29.256490] [INFO ] [LOCAL ] INR: Starting deletion of derivative data. [2025-09-17T19:42:29.256658] [DEBUG] [LOCAL ] INR: No derivative data file found to delete. [2025-09-17T19:42:29.256767] [INFO ] [MAIN ] Update Progress: 1112/2371 symbols completed. INR took 31.2s. Estimated remaining: 3h 3m 56s. Rate: 6.8 symbols/min [2025-09-17T19:42:29.430739] [INFO ] [MAIN ] INVH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:42:29.483193] [DEBUG] [LOCAL ] INVH: Loaded 53145 existing records from primary storage. [2025-09-17T19:42:29.483382] [INFO ] [MAIN ] INVH: Loaded 53145 existing records. [2025-09-17T19:42:29.665387] [WARN ] [MAIN ] INVH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:42:29.665708] [INFO ] [MAIN ] INVH: Wiping existing primary data before full refresh. [2025-09-17T19:42:29.665776] [INFO ] [LOCAL ] INVH: Starting deletion of primary data. [2025-09-17T19:42:29.666804] [DEBUG] [LOCAL ] INVH: Deleted primary data file. [2025-09-17T19:42:29.666860] [INFO ] [MAIN ] INVH: Starting full primary refresh. [2025-09-17T19:42:30.020864] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-07. [2025-09-17T19:42:30.024447] [INFO ] [REMOTE ] INVH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:42:30.826501] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-11. [2025-09-17T19:42:30.849081] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T19:42:31.523453] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T19:42:31.615735] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-06. [2025-09-17T19:42:32.415775] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-08. [2025-09-17T19:42:32.537860] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T19:42:32.833751] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T19:42:33.215775] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-07. [2025-09-17T19:42:34.015821] [INFO ] [REMOTE ] INN: Fetching primary data for 2025-09. [2025-09-17T19:42:34.180217] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T19:42:34.697599] [INFO ] [REMOTE ] INN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T19:42:34.702765] [INFO ] [REMOTE ] INN: Full fetch complete (57682 records). [2025-09-17T19:42:34.702921] [DEBUG] [VALIDATOR ] INN: Validating primary data. [2025-09-17T19:42:34.818239] [INFO ] [REMOTE ] INSP: Fetching primary data for 2025-09. [2025-09-17T19:42:35.042391] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T19:42:35.138624] [DEBUG] [VALIDATOR ] INN: All expected trading days are present. [2025-09-17T19:42:35.138730] [DEBUG] [VALIDATOR ] INN: Primary data validation passed. [2025-09-17T19:42:35.139604] [INFO ] [MAIN ] INN: Fetched primary data is valid. [2025-09-17T19:42:35.139683] [DEBUG] [LOCAL ] INN: Saving primary data. [2025-09-17T19:42:35.140930] [DEBUG] [LOCAL ] INN: Trimmed 57682 records to 41983 (keeping 200 days of data) [2025-09-17T19:42:35.394335] [DEBUG] [LOCAL ] INN: Primary data saved (41983 records). [2025-09-17T19:42:35.394498] [INFO ] [MAIN ] INN: Full history saved. [2025-09-17T19:42:35.394600] [INFO ] [MAIN ] Update Progress: 1113/2371 symbols completed. INN took 42.5s. Estimated remaining: 3h 3m 44s. Rate: 6.8 symbols/min [2025-09-17T19:42:35.569014] [INFO ] [MAIN ] INVX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:42:35.599206] [DEBUG] [LOCAL ] INVX: Loaded 29384 existing records from primary storage. [2025-09-17T19:42:35.599382] [INFO ] [MAIN ] INVX: Loaded 29384 existing records. [2025-09-17T19:42:35.621031] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-08. [2025-09-17T19:42:35.784040] [WARN ] [MAIN ] INVX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:42:35.784298] [INFO ] [MAIN ] INVX: Wiping existing primary data before full refresh. [2025-09-17T19:42:35.784345] [INFO ] [LOCAL ] INVX: Starting deletion of primary data. [2025-09-17T19:42:35.784941] [DEBUG] [LOCAL ] INVX: Deleted primary data file. [2025-09-17T19:42:35.784991] [INFO ] [MAIN ] INVX: Starting full primary refresh. [2025-09-17T19:42:36.165671] [INFO ] [REMOTE ] INVX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:42:36.183482] [INFO ] [REMOTE ] INSP: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T19:42:36.189833] [INFO ] [REMOTE ] INSP: Full fetch complete (51995 records). [2025-09-17T19:42:36.189996] [DEBUG] [VALIDATOR ] INSP: Validating primary data. [2025-09-17T19:42:36.423284] [INFO ] [REMOTE ] INVH: Fetching primary data for 2024-12. [2025-09-17T19:42:36.577295] [DEBUG] [VALIDATOR ] INSP: All expected trading days are present. [2025-09-17T19:42:36.577383] [DEBUG] [VALIDATOR ] INSP: Primary data validation passed. [2025-09-17T19:42:36.578350] [INFO ] [MAIN ] INSP: Fetched primary data is valid. [2025-09-17T19:42:36.578400] [DEBUG] [LOCAL ] INSP: Saving primary data. [2025-09-17T19:42:36.579713] [DEBUG] [LOCAL ] INSP: Trimmed 51995 records to 36566 (keeping 200 days of data) [2025-09-17T19:42:36.806219] [DEBUG] [LOCAL ] INSP: Primary data saved (36566 records). [2025-09-17T19:42:36.806365] [INFO ] [MAIN ] INSP: Full history saved. [2025-09-17T19:42:36.806461] [INFO ] [MAIN ] Update Progress: 1114/2371 symbols completed. INSP took 37.3s. Estimated remaining: 3h 3m 27s. Rate: 6.9 symbols/min [2025-09-17T19:42:36.989763] [INFO ] [MAIN ] IONQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:42:37.042723] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T19:42:37.072134] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-17T19:42:37.072296] [INFO ] [MAIN ] IONQ: Loaded 53788 existing records. [2025-09-17T19:42:37.229717] [INFO ] [REMOTE ] INSW: Fetching primary data for 2025-09. [2025-09-17T19:42:37.269558] [WARN ] [MAIN ] IONQ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:42:37.269801] [INFO ] [MAIN ] IONQ: Wiping existing primary data before full refresh. [2025-09-17T19:42:37.269846] [INFO ] [LOCAL ] IONQ: Starting deletion of primary data. [2025-09-17T19:42:37.270722] [DEBUG] [LOCAL ] IONQ: Deleted primary data file. [2025-09-17T19:42:37.270769] [INFO ] [MAIN ] IONQ: Starting full primary refresh. [2025-09-17T19:42:37.669766] [INFO ] [REMOTE ] IONQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:42:38.016559] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-11. [2025-09-17T19:42:38.020125] [INFO ] [REMOTE ] INSW: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T19:42:38.025503] [INFO ] [REMOTE ] INSW: Full fetch complete (60910 records). [2025-09-17T19:42:38.025604] [DEBUG] [VALIDATOR ] INSW: Validating primary data. [2025-09-17T19:42:38.424478] [DEBUG] [VALIDATOR ] INSW: All expected trading days are present. [2025-09-17T19:42:38.424605] [DEBUG] [VALIDATOR ] INSW: Primary data validation passed. [2025-09-17T19:42:38.425672] [INFO ] [MAIN ] INSW: Fetched primary data is valid. [2025-09-17T19:42:38.425732] [DEBUG] [LOCAL ] INSW: Saving primary data. [2025-09-17T19:42:38.457928] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T19:42:38.455777] [DEBUG] [LOCAL ] INSW: Trimmed 60910 records to 40716 (keeping 200 days of data) [2025-09-17T19:42:38.722892] [DEBUG] [LOCAL ] INSW: Primary data saved (40716 records). [2025-09-17T19:42:38.723027] [INFO ] [MAIN ] INSW: Full history saved. [2025-09-17T19:42:38.724038] [INFO ] [MAIN ] Update Progress: 1115/2371 symbols completed. INSW took 29.9s. Estimated remaining: 3h 3m 11s. Rate: 6.9 symbols/min [2025-09-17T19:42:38.821427] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-11. [2025-09-17T19:42:38.895676] [INFO ] [MAIN ] IOT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:42:38.947909] [DEBUG] [LOCAL ] IOT: Loaded 53473 existing records from primary storage. [2025-09-17T19:42:38.948089] [INFO ] [MAIN ] IOT: Loaded 53473 existing records. [2025-09-17T19:42:39.133066] [WARN ] [MAIN ] IOT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:42:39.133471] [INFO ] [MAIN ] IOT: Wiping existing primary data before full refresh. [2025-09-17T19:42:39.133526] [INFO ] [LOCAL ] IOT: Starting deletion of primary data. [2025-09-17T19:42:39.141308] [DEBUG] [LOCAL ] IOT: Deleted primary data file. [2025-09-17T19:42:39.153611] [INFO ] [MAIN ] IOT: Starting full primary refresh. [2025-09-17T19:42:39.188998] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T19:42:39.523637] [INFO ] [REMOTE ] IOT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:42:39.615733] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-11. [2025-09-17T19:42:40.415795] [INFO ] [REMOTE ] INVX: Fetching primary data for 2024-12. [2025-09-17T19:42:41.215825] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-01. [2025-09-17T19:42:41.451033] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T19:42:41.535477] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-11 (2.71 seconds). [2025-09-17T19:42:41.567172] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T19:42:42.015791] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-01. [2025-09-17T19:42:42.634945] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T19:42:42.815842] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-02. [2025-09-17T19:42:43.019850] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T19:42:43.615921] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2024-12. [2025-09-17T19:42:44.415845] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-02. [2025-09-17T19:42:44.535623] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T19:42:45.215785] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-03. [2025-09-17T19:42:46.015844] [INFO ] [REMOTE ] IOT: Fetching primary data for 2024-12. [2025-09-17T19:42:47.056571] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-02 (2.64 seconds). [2025-09-17T19:42:47.063234] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-03. [2025-09-17T19:42:47.193842] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T19:42:47.292313] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2024-12 (3.68 seconds). [2025-09-17T19:42:47.615825] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-04. [2025-09-17T19:42:48.143782] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-17T19:42:48.174050] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T19:42:48.415883] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-04. [2025-09-17T19:42:49.215807] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-01. [2025-09-17T19:42:49.823526] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-04 (2.21 seconds). [2025-09-17T19:42:50.015814] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-01. [2025-09-17T19:42:50.485759] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T19:42:50.815909] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-05. [2025-09-17T19:42:51.492530] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-01 (2.28 seconds). [2025-09-17T19:42:51.615737] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-02. [2025-09-17T19:42:51.649820] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T19:42:51.818968] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T19:42:52.415840] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-02. [2025-09-17T19:42:53.215837] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-06. [2025-09-17T19:42:53.817509] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-17T19:42:53.878523] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T19:42:54.015770] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-03. [2025-09-17T19:42:54.300121] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T19:42:54.815780] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-07. [2025-09-17T19:42:55.615758] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-05. [2025-09-17T19:42:55.889770] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T19:42:56.124635] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T19:42:56.415842] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-04. [2025-09-17T19:42:57.195326] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T19:42:57.215742] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-06. [2025-09-17T19:42:58.015792] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-08. [2025-09-17T19:42:58.251034] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T19:42:58.815786] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-03. [2025-09-17T19:42:59.020114] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T19:42:59.052046] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T19:42:59.615781] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-07. [2025-09-17T19:43:00.415796] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-05. [2025-09-17T19:43:01.082145] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-17T19:43:01.167974] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T19:43:01.215815] [INFO ] [REMOTE ] INVX: Fetching primary data for 2025-09. [2025-09-17T19:43:01.912920] [INFO ] [REMOTE ] INVX: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:43:01.917207] [INFO ] [REMOTE ] INVX: Full fetch complete (44555 records). [2025-09-17T19:43:01.917417] [DEBUG] [VALIDATOR ] INVX: Validating primary data. [2025-09-17T19:43:02.020958] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-04. [2025-09-17T19:43:02.341101] [DEBUG] [VALIDATOR ] INVX: All expected trading days are present. [2025-09-17T19:43:02.341306] [DEBUG] [VALIDATOR ] INVX: Primary data validation passed. [2025-09-17T19:43:02.342600] [INFO ] [MAIN ] INVX: Fetched primary data is valid. [2025-09-17T19:43:02.342701] [DEBUG] [LOCAL ] INVX: Saving primary data. [2025-09-17T19:43:02.344499] [DEBUG] [LOCAL ] INVX: Trimmed 44555 records to 29305 (keeping 200 days of data) [2025-09-17T19:43:02.493141] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-05 (2.08 seconds). [2025-09-17T19:43:02.585537] [DEBUG] [LOCAL ] INVX: Primary data saved (29305 records). [2025-09-17T19:43:02.585789] [INFO ] [MAIN ] INVX: Full history saved. [2025-09-17T19:43:02.585919] [INFO ] [MAIN ] Update Progress: 1116/2371 symbols completed. INVX took 27.2s. Estimated remaining: 3h 3m 19s. Rate: 6.8 symbols/min [2025-09-17T19:43:02.763205] [INFO ] [MAIN ] IP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:43:02.817507] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-08. [2025-09-17T19:43:02.820501] [DEBUG] [LOCAL ] IP: Loaded 53330 existing records from primary storage. [2025-09-17T19:43:02.820903] [INFO ] [MAIN ] IP: Loaded 53330 existing records. [2025-09-17T19:43:03.009153] [WARN ] [MAIN ] IP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:43:03.009495] [INFO ] [MAIN ] IP: Wiping existing primary data before full refresh. [2025-09-17T19:43:03.009546] [INFO ] [LOCAL ] IP: Starting deletion of primary data. [2025-09-17T19:43:03.010749] [DEBUG] [LOCAL ] IP: Deleted primary data file. [2025-09-17T19:43:03.011236] [INFO ] [MAIN ] IP: Starting full primary refresh. [2025-09-17T19:43:03.384121] [INFO ] [REMOTE ] IP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:43:03.615855] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-06. [2025-09-17T19:43:04.350658] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T19:43:04.415766] [INFO ] [REMOTE ] INVH: Fetching primary data for 2025-09. [2025-09-17T19:43:04.777546] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-04 (2.76 seconds). [2025-09-17T19:43:05.215801] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-05. [2025-09-17T19:43:05.291700] [INFO ] [REMOTE ] INVH: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T19:43:05.299850] [INFO ] [REMOTE ] INVH: Full fetch complete (76496 records). [2025-09-17T19:43:05.300114] [DEBUG] [VALIDATOR ] INVH: Validating primary data. [2025-09-17T19:43:05.771921] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-17T19:43:05.859996] [DEBUG] [VALIDATOR ] INVH: All expected trading days are present. [2025-09-17T19:43:05.860138] [DEBUG] [VALIDATOR ] INVH: Primary data validation passed. [2025-09-17T19:43:05.861477] [INFO ] [MAIN ] INVH: Fetched primary data is valid. [2025-09-17T19:43:05.861588] [DEBUG] [LOCAL ] INVH: Saving primary data. [2025-09-17T19:43:05.863976] [DEBUG] [LOCAL ] INVH: Trimmed 76496 records to 53144 (keeping 200 days of data) [2025-09-17T19:43:06.015955] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-07. [2025-09-17T19:43:06.329738] [DEBUG] [LOCAL ] INVH: Primary data saved (53144 records). [2025-09-17T19:43:06.329940] [INFO ] [MAIN ] INVH: Full history saved. [2025-09-17T19:43:06.330050] [INFO ] [MAIN ] Update Progress: 1117/2371 symbols completed. INVH took 37.1s. Estimated remaining: 3h 3m 4s. Rate: 6.8 symbols/min [2025-09-17T19:43:06.815937] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-11. [2025-09-17T19:43:07.406713] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T19:43:07.615764] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-06. [2025-09-17T19:43:08.057370] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T19:43:08.309199] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T19:43:08.415788] [INFO ] [REMOTE ] IP: Fetching primary data for 2024-12. [2025-09-17T19:43:09.215894] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-08. [2025-09-17T19:43:09.909440] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T19:43:10.015780] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-07. [2025-09-17T19:43:10.237464] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T19:43:10.815789] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-01. [2025-09-17T19:43:11.178062] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T19:43:11.615786] [INFO ] [REMOTE ] IOT: Fetching primary data for 2025-09. [2025-09-17T19:43:12.428143] [INFO ] [REMOTE ] IOT: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T19:43:12.436837] [INFO ] [REMOTE ] IOT: Full fetch complete (77217 records). [2025-09-17T19:43:12.437040] [DEBUG] [VALIDATOR ] IOT: Validating primary data. [2025-09-17T19:43:12.853499] [DEBUG] [VALIDATOR ] IOT: All expected trading days are present. [2025-09-17T19:43:12.853737] [DEBUG] [VALIDATOR ] IOT: Primary data validation passed. [2025-09-17T19:43:12.854838] [INFO ] [MAIN ] IOT: Fetched primary data is valid. [2025-09-17T19:43:12.854958] [DEBUG] [LOCAL ] IOT: Saving primary data. [2025-09-17T19:43:12.856887] [DEBUG] [LOCAL ] IOT: Trimmed 77217 records to 53473 (keeping 200 days of data) [2025-09-17T19:43:12.991152] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-17T19:43:13.053160] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-07 (3.04 seconds). [2025-09-17T19:43:13.050300] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-02. [2025-09-17T19:43:13.216064] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-08. [2025-09-17T19:43:13.317002] [DEBUG] [LOCAL ] IOT: Primary data saved (53473 records). [2025-09-17T19:43:13.317247] [INFO ] [MAIN ] IOT: Full history saved. [2025-09-17T19:43:13.318420] [INFO ] [MAIN ] Update Progress: 1118/2371 symbols completed. IOT took 34.6s. Estimated remaining: 3h 2m 54s. Rate: 6.9 symbols/min [2025-09-17T19:43:14.867328] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T19:43:14.879307] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-03. [2025-09-17T19:43:15.658359] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-08 (2.44 seconds). [2025-09-17T19:43:15.670286] [INFO ] [REMOTE ] IONQ: Fetching primary data for 2025-09. [2025-09-17T19:43:16.604669] [INFO ] [REMOTE ] IONQ: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T19:43:16.611987] [INFO ] [REMOTE ] IONQ: Full fetch complete (77968 records). [2025-09-17T19:43:16.612158] [DEBUG] [VALIDATOR ] IONQ: Validating primary data. [2025-09-17T19:43:17.037852] [DEBUG] [VALIDATOR ] IONQ: All expected trading days are present. [2025-09-17T19:43:17.051885] [DEBUG] [VALIDATOR ] IONQ: Primary data validation passed. [2025-09-17T19:43:17.056761] [INFO ] [MAIN ] IONQ: Fetched primary data is valid. [2025-09-17T19:43:17.056896] [DEBUG] [LOCAL ] IONQ: Saving primary data. [2025-09-17T19:43:17.059345] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T19:43:17.071384] [DEBUG] [LOCAL ] IONQ: Trimmed 77968 records to 53788 (keeping 200 days of data) [2025-09-17T19:43:17.071254] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-04. [2025-09-17T19:43:17.399074] [DEBUG] [LOCAL ] IONQ: Primary data saved (53788 records). [2025-09-17T19:43:17.399228] [INFO ] [MAIN ] IONQ: Full history saved. [2025-09-17T19:43:17.399324] [INFO ] [MAIN ] Update Progress: 1119/2371 symbols completed. IONQ took 40.6s. Estimated remaining: 3h 2m 40s. Rate: 6.9 symbols/min [2025-09-17T19:43:18.923362] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T19:43:18.935177] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-05. [2025-09-17T19:43:20.892156] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T19:43:20.904745] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-06. [2025-09-17T19:43:22.543873] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T19:43:22.556982] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-07. [2025-09-17T19:43:24.479209] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T19:43:24.492593] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-08. [2025-09-17T19:43:26.200984] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T19:43:26.218749] [INFO ] [REMOTE ] IP: Fetching primary data for 2025-09. [2025-09-17T19:43:27.027438] [INFO ] [REMOTE ] IP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T19:43:27.035185] [INFO ] [REMOTE ] IP: Full fetch complete (76860 records). [2025-09-17T19:43:27.035411] [DEBUG] [VALIDATOR ] IP: Validating primary data. [2025-09-17T19:43:27.455583] [DEBUG] [VALIDATOR ] IP: All expected trading days are present. [2025-09-17T19:43:27.455715] [DEBUG] [VALIDATOR ] IP: Primary data validation passed. [2025-09-17T19:43:27.457104] [INFO ] [MAIN ] IP: Fetched primary data is valid. [2025-09-17T19:43:27.457165] [DEBUG] [LOCAL ] IP: Saving primary data. [2025-09-17T19:43:27.459323] [DEBUG] [LOCAL ] IP: Trimmed 76860 records to 53330 (keeping 200 days of data) [2025-09-17T19:43:27.810568] [DEBUG] [LOCAL ] IP: Primary data saved (53330 records). [2025-09-17T19:43:27.810765] [INFO ] [MAIN ] IP: Full history saved. [2025-09-17T19:43:27.810861] [INFO ] [MAIN ] Update Progress: 1120/2371 symbols completed. IP took 25.2s. Estimated remaining: 3h 2m 33s. Rate: 6.9 symbols/min [2025-09-17T19:43:28.509399] [INFO ] [MAIN ] IQV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:43:28.497518] [INFO ] [MAIN ] IPG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:43:28.558915] [INFO ] [MAIN ] IPI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:43:28.581683] [INFO ] [MAIN ] IQI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:43:28.605919] [DEBUG] [LOCAL ] IQI: Loaded 18105 existing records from primary storage. [2025-09-17T19:43:28.606746] [INFO ] [MAIN ] IQI: Loaded 18105 existing records. [2025-09-17T19:43:28.833458] [DEBUG] [LOCAL ] IPI: Loaded 21385 existing records from primary storage. [2025-09-17T19:43:28.842658] [INFO ] [MAIN ] IPI: Loaded 21385 existing records. [2025-09-17T19:43:28.857443] [WARN ] [MAIN ] IQI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:43:28.892240] [INFO ] [MAIN ] IQI: Wiping existing primary data before full refresh. [2025-09-17T19:43:28.933313] [DEBUG] [LOCAL ] IPG: Loaded 53335 existing records from primary storage. [2025-09-17T19:43:28.939176] [INFO ] [LOCAL ] IQI: Starting deletion of primary data. [2025-09-17T19:43:28.954517] [INFO ] [MAIN ] IPG: Loaded 53335 existing records. [2025-09-17T19:43:28.985585] [DEBUG] [LOCAL ] IQV: Loaded 50594 existing records from primary storage. [2025-09-17T19:43:29.013448] [DEBUG] [LOCAL ] IQI: Deleted primary data file. [2025-09-17T19:43:29.046883] [INFO ] [MAIN ] IQI: Starting full primary refresh. [2025-09-17T19:43:29.052712] [INFO ] [MAIN ] IQV: Loaded 50594 existing records. [2025-09-17T19:43:29.376676] [WARN ] [MAIN ] IPI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:43:29.510312] [WARN ] [MAIN ] IPG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:43:29.518492] [INFO ] [MAIN ] IPI: Wiping existing primary data before full refresh. [2025-09-17T19:43:29.523312] [INFO ] [MAIN ] IPG: Wiping existing primary data before full refresh. [2025-09-17T19:43:29.534556] [INFO ] [LOCAL ] IPG: Starting deletion of primary data. [2025-09-17T19:43:29.545008] [DEBUG] [LOCAL ] IPG: Deleted primary data file. [2025-09-17T19:43:29.523389] [INFO ] [LOCAL ] IPI: Starting deletion of primary data. [2025-09-17T19:43:29.560575] [INFO ] [MAIN ] IPG: Starting full primary refresh. [2025-09-17T19:43:29.708798] [DEBUG] [LOCAL ] IPI: Deleted primary data file. [2025-09-17T19:43:29.719997] [WARN ] [MAIN ] IQV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:43:29.789580] [INFO ] [MAIN ] IPI: Starting full primary refresh. [2025-09-17T19:43:29.859948] [INFO ] [MAIN ] IQV: Wiping existing primary data before full refresh. [2025-09-17T19:43:29.969050] [INFO ] [LOCAL ] IQV: Starting deletion of primary data. [2025-09-17T19:43:30.082495] [DEBUG] [LOCAL ] IQV: Deleted primary data file. [2025-09-17T19:43:30.145503] [INFO ] [MAIN ] IQV: Starting full primary refresh. [2025-09-17T19:43:30.343792] [INFO ] [REMOTE ] IQI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:43:30.427776] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-11. [2025-09-17T19:43:30.761979] [INFO ] [REMOTE ] IPG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:43:30.793765] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-11. [2025-09-17T19:43:30.955070] [INFO ] [REMOTE ] IPI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:43:30.979775] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-11. [2025-09-17T19:43:31.062964] [INFO ] [REMOTE ] IQV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:43:31.063432] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-11. [2025-09-17T19:43:31.695752] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T19:43:31.701122] [INFO ] [REMOTE ] IQI: Fetching primary data for 2024-12. [2025-09-17T19:43:31.967678] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T19:43:31.971870] [INFO ] [REMOTE ] IPI: Fetching primary data for 2024-12. [2025-09-17T19:43:32.265582] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T19:43:32.276459] [INFO ] [REMOTE ] IPG: Fetching primary data for 2024-12. [2025-09-17T19:43:32.327346] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T19:43:32.337831] [INFO ] [REMOTE ] IQV: Fetching primary data for 2024-12. [2025-09-17T19:43:32.352862] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T19:43:32.359038] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-01. [2025-09-17T19:43:32.938569] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T19:43:32.942799] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-01. [2025-09-17T19:43:33.153889] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T19:43:33.158948] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-02. [2025-09-17T19:43:33.829945] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T19:43:33.841510] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-01. [2025-09-17T19:43:33.917968] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T19:43:33.922376] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-02. [2025-09-17T19:43:34.091334] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T19:43:34.101800] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-01. [2025-09-17T19:43:34.128511] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T19:43:34.134220] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-03. [2025-09-17T19:43:34.713576] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-03 (0.58 seconds). [2025-09-17T19:43:34.718932] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-04. [2025-09-17T19:43:34.868336] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T19:43:34.872605] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-03. [2025-09-17T19:43:35.234601] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T19:43:35.245706] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-02. [2025-09-17T19:43:35.396303] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T19:43:35.406320] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-02. [2025-09-17T19:43:35.587923] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T19:43:35.615746] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-04. [2025-09-17T19:43:35.646393] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T19:43:36.415801] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-05. [2025-09-17T19:43:36.735368] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T19:43:36.970337] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T19:43:36.993366] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T19:43:37.061584] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T19:43:37.215809] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-03. [2025-09-17T19:43:38.015858] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-03. [2025-09-17T19:43:38.815841] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-06. [2025-09-17T19:43:39.013091] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T19:43:39.615842] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-05. [2025-09-17T19:43:39.828249] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T19:43:39.855343] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T19:43:40.415812] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-04. [2025-09-17T19:43:40.469203] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T19:43:41.215829] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-06. [2025-09-17T19:43:42.015804] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-04. [2025-09-17T19:43:42.201354] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T19:43:42.234780] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T19:43:42.815818] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-07. [2025-09-17T19:43:43.615773] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-05. [2025-09-17T19:43:43.745111] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T19:43:43.841569] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T19:43:44.415802] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-07. [2025-09-17T19:43:45.215816] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-08. [2025-09-17T19:43:45.454318] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T19:43:45.533388] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T19:43:46.015780] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-08. [2025-09-17T19:43:46.178604] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T19:43:46.815806] [INFO ] [REMOTE ] IQI: Fetching primary data for 2025-09. [2025-09-17T19:43:47.074417] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T19:43:47.387836] [INFO ] [REMOTE ] IQI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:43:47.391260] [INFO ] [REMOTE ] IQI: Full fetch complete (27331 records). [2025-09-17T19:43:47.391350] [DEBUG] [VALIDATOR ] IQI: Validating primary data. [2025-09-17T19:43:47.622819] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-06. [2025-09-17T19:43:47.783656] [DEBUG] [VALIDATOR ] IQI: All expected trading days are present. [2025-09-17T19:43:47.783742] [DEBUG] [VALIDATOR ] IQI: Primary data validation passed. [2025-09-17T19:43:47.784331] [INFO ] [MAIN ] IQI: Fetched primary data is valid. [2025-09-17T19:43:47.784372] [DEBUG] [LOCAL ] IQI: Saving primary data. [2025-09-17T19:43:47.785140] [DEBUG] [LOCAL ] IQI: Trimmed 27331 records to 17965 (keeping 200 days of data) [2025-09-17T19:43:47.897499] [DEBUG] [LOCAL ] IQI: Primary data saved (17965 records). [2025-09-17T19:43:47.897688] [INFO ] [MAIN ] IQI: Full history saved. [2025-09-17T19:43:47.897780] [INFO ] [MAIN ] Update Progress: 1121/2371 symbols completed. IQI took 20.1s. Estimated remaining: 3h 2m 37s. Rate: 6.8 symbols/min [2025-09-17T19:43:48.066186] [INFO ] [MAIN ] IR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:43:48.119064] [DEBUG] [LOCAL ] IR: Loaded 52700 existing records from primary storage. [2025-09-17T19:43:48.119253] [INFO ] [MAIN ] IR: Loaded 52700 existing records. [2025-09-17T19:43:48.295089] [WARN ] [MAIN ] IR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:43:48.295365] [INFO ] [MAIN ] IR: Wiping existing primary data before full refresh. [2025-09-17T19:43:48.295413] [INFO ] [LOCAL ] IR: Starting deletion of primary data. [2025-09-17T19:43:48.296811] [DEBUG] [LOCAL ] IR: Deleted primary data file. [2025-09-17T19:43:48.296877] [INFO ] [MAIN ] IR: Starting full primary refresh. [2025-09-17T19:43:48.420990] [INFO ] [REMOTE ] IPI: Fetching primary data for 2025-09. [2025-09-17T19:43:48.672838] [INFO ] [REMOTE ] IR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:43:49.076612] [INFO ] [REMOTE ] IPI: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T19:43:49.080102] [INFO ] [REMOTE ] IPI: Full fetch complete (28824 records). [2025-09-17T19:43:49.080258] [DEBUG] [VALIDATOR ] IPI: Validating primary data. [2025-09-17T19:43:49.220965] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-11. [2025-09-17T19:43:49.479907] [DEBUG] [VALIDATOR ] IPI: All expected trading days are present. [2025-09-17T19:43:49.480090] [DEBUG] [VALIDATOR ] IPI: Primary data validation passed. [2025-09-17T19:43:49.481022] [INFO ] [MAIN ] IPI: Fetched primary data is valid. [2025-09-17T19:43:49.481085] [DEBUG] [LOCAL ] IPI: Saving primary data. [2025-09-17T19:43:49.493406] [DEBUG] [LOCAL ] IPI: Trimmed 28824 records to 21425 (keeping 200 days of data) [2025-09-17T19:43:49.514635] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T19:43:49.660551] [DEBUG] [LOCAL ] IPI: Primary data saved (21425 records). [2025-09-17T19:43:49.660751] [INFO ] [MAIN ] IPI: Full history saved. [2025-09-17T19:43:49.660876] [INFO ] [MAIN ] Update Progress: 1122/2371 symbols completed. IPI took 21.8s. Estimated remaining: 3h 2m 20s. Rate: 6.8 symbols/min [2025-09-17T19:43:49.831856] [INFO ] [MAIN ] IRM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:43:49.882372] [DEBUG] [LOCAL ] IRM: Loaded 49594 existing records from primary storage. [2025-09-17T19:43:49.882596] [INFO ] [MAIN ] IRM: Loaded 49594 existing records. [2025-09-17T19:43:50.031226] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-07. [2025-09-17T19:43:50.081297] [WARN ] [MAIN ] IRM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:43:50.081665] [INFO ] [MAIN ] IRM: Wiping existing primary data before full refresh. [2025-09-17T19:43:50.081735] [INFO ] [LOCAL ] IRM: Starting deletion of primary data. [2025-09-17T19:43:50.082972] [DEBUG] [LOCAL ] IRM: Deleted primary data file. [2025-09-17T19:43:50.083045] [INFO ] [MAIN ] IRM: Starting full primary refresh. [2025-09-17T19:43:50.451707] [INFO ] [REMOTE ] IRM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:43:50.815794] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-11. [2025-09-17T19:43:51.077860] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T19:43:51.615804] [INFO ] [REMOTE ] IR: Fetching primary data for 2024-12. [2025-09-17T19:43:51.909757] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T19:43:52.415876] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-05. [2025-09-17T19:43:52.495441] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T19:43:53.084992] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T19:43:53.215807] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-08. [2025-09-17T19:43:54.015821] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-01. [2025-09-17T19:43:54.216969] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T19:43:54.431473] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T19:43:54.815828] [INFO ] [REMOTE ] IRM: Fetching primary data for 2024-12. [2025-09-17T19:43:55.615827] [INFO ] [REMOTE ] IQV: Fetching primary data for 2025-09. [2025-09-17T19:43:55.754159] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T19:43:56.415817] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-06. [2025-09-17T19:43:56.529242] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T19:43:56.640321] [INFO ] [REMOTE ] IQV: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T19:43:56.647172] [INFO ] [REMOTE ] IQV: Full fetch complete (72453 records). [2025-09-17T19:43:56.647376] [DEBUG] [VALIDATOR ] IQV: Validating primary data. [2025-09-17T19:43:57.059244] [DEBUG] [VALIDATOR ] IQV: All expected trading days are present. [2025-09-17T19:43:57.059370] [DEBUG] [VALIDATOR ] IQV: Primary data validation passed. [2025-09-17T19:43:57.060720] [INFO ] [MAIN ] IQV: Fetched primary data is valid. [2025-09-17T19:43:57.060788] [DEBUG] [LOCAL ] IQV: Saving primary data. [2025-09-17T19:43:57.063560] [DEBUG] [LOCAL ] IQV: Trimmed 72453 records to 50554 (keeping 200 days of data) [2025-09-17T19:43:57.264114] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-02. [2025-09-17T19:43:57.414700] [DEBUG] [LOCAL ] IQV: Primary data saved (50554 records). [2025-09-17T19:43:57.414945] [INFO ] [MAIN ] IQV: Full history saved. [2025-09-17T19:43:57.415193] [INFO ] [MAIN ] Update Progress: 1123/2371 symbols completed. IQV took 29.6s. Estimated remaining: 3h 2m 10s. Rate: 6.9 symbols/min [2025-09-17T19:43:57.587042] [INFO ] [MAIN ] IRS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:43:57.610440] [DEBUG] [LOCAL ] IRS: Loaded 21041 existing records from primary storage. [2025-09-17T19:43:57.610615] [INFO ] [MAIN ] IRS: Loaded 21041 existing records. [2025-09-17T19:43:57.797258] [WARN ] [MAIN ] IRS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:43:57.797981] [INFO ] [MAIN ] IRS: Wiping existing primary data before full refresh. [2025-09-17T19:43:57.798064] [INFO ] [LOCAL ] IRS: Starting deletion of primary data. [2025-09-17T19:43:57.798985] [DEBUG] [LOCAL ] IRS: Deleted primary data file. [2025-09-17T19:43:57.799097] [INFO ] [MAIN ] IRS: Starting full primary refresh. [2025-09-17T19:43:58.029311] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-01. [2025-09-17T19:43:58.180389] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T19:43:58.224795] [INFO ] [REMOTE ] IRS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:43:58.815854] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-07. [2025-09-17T19:43:59.074206] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T19:43:59.615824] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-03. [2025-09-17T19:43:59.913834] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T19:44:00.229589] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T19:44:00.415820] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-08. [2025-09-17T19:44:01.080382] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T19:44:01.215728] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-04. [2025-09-17T19:44:02.015842] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-02. [2025-09-17T19:44:02.223828] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T19:44:02.641986] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T19:44:02.815814] [INFO ] [REMOTE ] IPG: Fetching primary data for 2025-09. [2025-09-17T19:44:03.435194] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T19:44:03.615786] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-05. [2025-09-17T19:44:03.672025] [INFO ] [REMOTE ] IPG: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T19:44:03.679811] [INFO ] [REMOTE ] IPG: Full fetch complete (77077 records). [2025-09-17T19:44:03.679980] [DEBUG] [VALIDATOR ] IPG: Validating primary data. [2025-09-17T19:44:04.112068] [DEBUG] [VALIDATOR ] IPG: All expected trading days are present. [2025-09-17T19:44:04.112157] [DEBUG] [VALIDATOR ] IPG: Primary data validation passed. [2025-09-17T19:44:04.113298] [INFO ] [MAIN ] IPG: Fetched primary data is valid. [2025-09-17T19:44:04.113376] [DEBUG] [LOCAL ] IPG: Saving primary data. [2025-09-17T19:44:04.116773] [DEBUG] [LOCAL ] IPG: Trimmed 77077 records to 53333 (keeping 200 days of data) [2025-09-17T19:44:04.428597] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-03. [2025-09-17T19:44:04.480254] [DEBUG] [LOCAL ] IPG: Primary data saved (53333 records). [2025-09-17T19:44:04.480395] [INFO ] [MAIN ] IPG: Full history saved. [2025-09-17T19:44:04.480486] [INFO ] [MAIN ] Update Progress: 1124/2371 symbols completed. IPG took 36.7s. Estimated remaining: 3h 1m 60s. Rate: 6.9 symbols/min [2025-09-17T19:44:04.665185] [INFO ] [MAIN ] IRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:44:04.716841] [DEBUG] [LOCAL ] IRT: Loaded 50449 existing records from primary storage. [2025-09-17T19:44:04.716995] [INFO ] [MAIN ] IRT: Loaded 50449 existing records. [2025-09-17T19:44:04.905105] [WARN ] [MAIN ] IRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:44:04.905415] [INFO ] [MAIN ] IRT: Wiping existing primary data before full refresh. [2025-09-17T19:44:04.905465] [INFO ] [LOCAL ] IRT: Starting deletion of primary data. [2025-09-17T19:44:04.906490] [DEBUG] [LOCAL ] IRT: Deleted primary data file. [2025-09-17T19:44:04.906556] [INFO ] [MAIN ] IRT: Starting full primary refresh. [2025-09-17T19:44:05.220909] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-11. [2025-09-17T19:44:05.287619] [INFO ] [REMOTE ] IRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:44:05.518959] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T19:44:06.015747] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-11. [2025-09-17T19:44:06.042175] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T19:44:06.232083] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T19:44:06.815818] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-06. [2025-09-17T19:44:07.417319] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T19:44:07.615793] [INFO ] [REMOTE ] IRS: Fetching primary data for 2024-12. [2025-09-17T19:44:08.415776] [INFO ] [REMOTE ] IRT: Fetching primary data for 2024-12. [2025-09-17T19:44:08.463262] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T19:44:08.493333] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T19:44:09.215793] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-04. [2025-09-17T19:44:09.954599] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T19:44:10.015769] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-01. [2025-09-17T19:44:10.815783] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-07. [2025-09-17T19:44:11.035616] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T19:44:11.615758] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-01. [2025-09-17T19:44:11.682900] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T19:44:12.297662] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T19:44:12.415821] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-02. [2025-09-17T19:44:12.757101] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T19:44:13.215839] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-02. [2025-09-17T19:44:13.688217] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T19:44:14.015819] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-08. [2025-09-17T19:44:14.230957] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T19:44:14.815802] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-05. [2025-09-17T19:44:15.618857] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-03. [2025-09-17T19:44:15.626384] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T19:44:16.415810] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-03. [2025-09-17T19:44:16.668290] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T19:44:17.061146] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T19:44:17.215855] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-04. [2025-09-17T19:44:17.399851] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T19:44:17.859941] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T19:44:18.015762] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-05. [2025-09-17T19:44:18.815750] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-06. [2025-09-17T19:44:18.959565] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T19:44:19.615877] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-04. [2025-09-17T19:44:20.415799] [INFO ] [REMOTE ] IR: Fetching primary data for 2025-09. [2025-09-17T19:44:20.527377] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T19:44:20.828258] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T19:44:21.215815] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-07. [2025-09-17T19:44:21.519556] [INFO ] [REMOTE ] IR: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T19:44:21.526991] [INFO ] [REMOTE ] IR: Full fetch complete (75859 records). [2025-09-17T19:44:21.527136] [DEBUG] [VALIDATOR ] IR: Validating primary data. [2025-09-17T19:44:21.918028] [DEBUG] [VALIDATOR ] IR: All expected trading days are present. [2025-09-17T19:44:21.918112] [DEBUG] [VALIDATOR ] IR: Primary data validation passed. [2025-09-17T19:44:21.919043] [INFO ] [MAIN ] IR: Fetched primary data is valid. [2025-09-17T19:44:21.919087] [DEBUG] [LOCAL ] IR: Saving primary data. [2025-09-17T19:44:21.921081] [DEBUG] [LOCAL ] IR: Trimmed 75859 records to 52699 (keeping 200 days of data) [2025-09-17T19:44:22.024693] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-06. [2025-09-17T19:44:22.261071] [DEBUG] [LOCAL ] IR: Primary data saved (52699 records). [2025-09-17T19:44:22.261228] [INFO ] [MAIN ] IR: Full history saved. [2025-09-17T19:44:22.261390] [INFO ] [MAIN ] Update Progress: 1125/2371 symbols completed. IR took 34.4s. Estimated remaining: 3h 2m 1s. Rate: 6.8 symbols/min [2025-09-17T19:44:22.435202] [INFO ] [MAIN ] ISD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:44:22.454496] [DEBUG] [LOCAL ] ISD: Loaded 15843 existing records from primary storage. [2025-09-17T19:44:22.454628] [INFO ] [MAIN ] ISD: Loaded 15843 existing records. [2025-09-17T19:44:22.633387] [WARN ] [MAIN ] ISD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:44:22.633886] [INFO ] [MAIN ] ISD: Wiping existing primary data before full refresh. [2025-09-17T19:44:22.633973] [INFO ] [LOCAL ] ISD: Starting deletion of primary data. [2025-09-17T19:44:22.634520] [DEBUG] [LOCAL ] ISD: Deleted primary data file. [2025-09-17T19:44:22.634568] [INFO ] [MAIN ] ISD: Starting full primary refresh. [2025-09-17T19:44:22.819051] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-05. [2025-09-17T19:44:22.990827] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T19:44:23.053743] [INFO ] [REMOTE ] ISD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:44:23.074055] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T19:44:23.615902] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-11. [2025-09-17T19:44:24.415796] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-07. [2025-09-17T19:44:24.470358] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T19:44:24.539454] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T19:44:25.215838] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-06. [2025-09-17T19:44:25.654680] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T19:44:26.015797] [INFO ] [REMOTE ] ISD: Fetching primary data for 2024-12. [2025-09-17T19:44:26.815800] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-08. [2025-09-17T19:44:26.931440] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T19:44:26.981914] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T19:44:27.615791] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-01. [2025-09-17T19:44:28.415791] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-08. [2025-09-17T19:44:28.665436] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T19:44:28.767388] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T19:44:29.215793] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-07. [2025-09-17T19:44:29.521264] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T19:44:30.015849] [INFO ] [REMOTE ] IRS: Fetching primary data for 2025-09. [2025-09-17T19:44:30.526113] [INFO ] [REMOTE ] IRS: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T19:44:30.530972] [INFO ] [REMOTE ] IRS: Full fetch complete (31887 records). [2025-09-17T19:44:30.531066] [DEBUG] [VALIDATOR ] IRS: Validating primary data. [2025-09-17T19:44:30.823942] [INFO ] [REMOTE ] IRM: Fetching primary data for 2025-09. [2025-09-17T19:44:30.924624] [DEBUG] [VALIDATOR ] IRS: All expected trading days are present. [2025-09-17T19:44:30.924784] [DEBUG] [VALIDATOR ] IRS: Primary data validation passed. [2025-09-17T19:44:30.925944] [INFO ] [MAIN ] IRS: Fetched primary data is valid. [2025-09-17T19:44:30.926024] [DEBUG] [LOCAL ] IRS: Saving primary data. [2025-09-17T19:44:30.927422] [DEBUG] [LOCAL ] IRS: Trimmed 31887 records to 21140 (keeping 200 days of data) [2025-09-17T19:44:31.065499] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T19:44:31.105267] [DEBUG] [LOCAL ] IRS: Primary data saved (21140 records). [2025-09-17T19:44:31.105467] [INFO ] [MAIN ] IRS: Full history saved. [2025-09-17T19:44:31.105620] [INFO ] [MAIN ] Update Progress: 1126/2371 symbols completed. IRS took 33.7s. Estimated remaining: 3h 1m 52s. Rate: 6.8 symbols/min [2025-09-17T19:44:31.342078] [INFO ] [MAIN ] IT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:44:31.385942] [DEBUG] [LOCAL ] IT: Loaded 40982 existing records from primary storage. [2025-09-17T19:44:31.386174] [INFO ] [MAIN ] IT: Loaded 40982 existing records. [2025-09-17T19:44:31.572362] [WARN ] [MAIN ] IT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:44:31.572695] [INFO ] [MAIN ] IT: Wiping existing primary data before full refresh. [2025-09-17T19:44:31.572743] [INFO ] [LOCAL ] IT: Starting deletion of primary data. [2025-09-17T19:44:31.574249] [DEBUG] [LOCAL ] IT: Deleted primary data file. [2025-09-17T19:44:31.574530] [INFO ] [MAIN ] IT: Starting full primary refresh. [2025-09-17T19:44:31.626121] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-02. [2025-09-17T19:44:31.967180] [INFO ] [REMOTE ] IRM: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T19:44:32.009306] [INFO ] [REMOTE ] IRM: Full fetch complete (72127 records). [2025-09-17T19:44:32.023783] [DEBUG] [VALIDATOR ] IRM: Validating primary data. [2025-09-17T19:44:32.030054] [INFO ] [REMOTE ] IT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:44:32.418380] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-08. [2025-09-17T19:44:32.440717] [DEBUG] [VALIDATOR ] IRM: All expected trading days are present. [2025-09-17T19:44:32.440822] [DEBUG] [VALIDATOR ] IRM: Primary data validation passed. [2025-09-17T19:44:32.441851] [INFO ] [MAIN ] IRM: Fetched primary data is valid. [2025-09-17T19:44:32.442003] [DEBUG] [LOCAL ] IRM: Saving primary data. [2025-09-17T19:44:32.443560] [DEBUG] [LOCAL ] IRM: Trimmed 72127 records to 49577 (keeping 200 days of data) [2025-09-17T19:44:32.688746] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T19:44:32.780994] [DEBUG] [LOCAL ] IRM: Primary data saved (49577 records). [2025-09-17T19:44:32.781154] [INFO ] [MAIN ] IRM: Full history saved. [2025-09-17T19:44:32.782042] [INFO ] [MAIN ] Update Progress: 1127/2371 symbols completed. IRM took 43.1s. Estimated remaining: 3h 1m 36s. Rate: 6.9 symbols/min [2025-09-17T19:44:32.948712] [INFO ] [MAIN ] ITGR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:44:32.986396] [DEBUG] [LOCAL ] ITGR: Loaded 31609 existing records from primary storage. [2025-09-17T19:44:32.986544] [INFO ] [MAIN ] ITGR: Loaded 31609 existing records. [2025-09-17T19:44:33.163127] [WARN ] [MAIN ] ITGR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:44:33.163395] [INFO ] [MAIN ] ITGR: Wiping existing primary data before full refresh. [2025-09-17T19:44:33.163449] [INFO ] [LOCAL ] ITGR: Starting deletion of primary data. [2025-09-17T19:44:33.167692] [DEBUG] [LOCAL ] ITGR: Deleted primary data file. [2025-09-17T19:44:33.167753] [INFO ] [MAIN ] ITGR: Starting full primary refresh. [2025-09-17T19:44:33.221889] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-11. [2025-09-17T19:44:33.545572] [INFO ] [REMOTE ] ITGR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:44:34.015794] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-03. [2025-09-17T19:44:34.216611] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T19:44:34.571220] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T19:44:34.815782] [INFO ] [REMOTE ] IT: Fetching primary data for 2024-12. [2025-09-17T19:44:35.009377] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T19:44:35.615788] [INFO ] [REMOTE ] IRT: Fetching primary data for 2025-09. [2025-09-17T19:44:36.128983] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T19:44:36.415827] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-01. [2025-09-17T19:44:36.670311] [INFO ] [REMOTE ] IRT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T19:44:36.677670] [INFO ] [REMOTE ] IRT: Full fetch complete (72156 records). [2025-09-17T19:44:36.677839] [DEBUG] [VALIDATOR ] IRT: Validating primary data. [2025-09-17T19:44:37.093053] [DEBUG] [VALIDATOR ] IRT: All expected trading days are present. [2025-09-17T19:44:37.093164] [DEBUG] [VALIDATOR ] IRT: Primary data validation passed. [2025-09-17T19:44:37.094240] [INFO ] [MAIN ] IRT: Fetched primary data is valid. [2025-09-17T19:44:37.094303] [DEBUG] [LOCAL ] IRT: Saving primary data. [2025-09-17T19:44:37.095945] [DEBUG] [LOCAL ] IRT: Trimmed 72156 records to 50419 (keeping 200 days of data) [2025-09-17T19:44:37.219701] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-04. [2025-09-17T19:44:37.413385] [DEBUG] [LOCAL ] IRT: Primary data saved (50419 records). [2025-09-17T19:44:37.413547] [INFO ] [MAIN ] IRT: Full history saved. [2025-09-17T19:44:37.413659] [INFO ] [MAIN ] Update Progress: 1128/2371 symbols completed. IRT took 32.9s. Estimated remaining: 3h 1m 22s. Rate: 6.9 symbols/min [2025-09-17T19:44:37.589149] [INFO ] [MAIN ] ITT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:44:37.611571] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T19:44:37.650257] [DEBUG] [LOCAL ] ITT: Loaded 33531 existing records from primary storage. [2025-09-17T19:44:37.650416] [INFO ] [MAIN ] ITT: Loaded 33531 existing records. [2025-09-17T19:44:37.839457] [WARN ] [MAIN ] ITT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:44:37.839786] [INFO ] [MAIN ] ITT: Wiping existing primary data before full refresh. [2025-09-17T19:44:37.839837] [INFO ] [LOCAL ] ITT: Starting deletion of primary data. [2025-09-17T19:44:37.840786] [DEBUG] [LOCAL ] ITT: Deleted primary data file. [2025-09-17T19:44:37.840851] [INFO ] [MAIN ] ITT: Starting full primary refresh. [2025-09-17T19:44:38.016691] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-02. [2025-09-17T19:44:38.223601] [INFO ] [REMOTE ] ITT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:44:38.369460] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T19:44:38.815781] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-05. [2025-09-17T19:44:39.622413] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-11. [2025-09-17T19:44:39.626821] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T19:44:39.811613] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T19:44:40.415799] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-03. [2025-09-17T19:44:40.807142] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T19:44:41.215817] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2024-12. [2025-09-17T19:44:41.974970] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T19:44:42.015853] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-06. [2025-09-17T19:44:42.031896] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T19:44:42.815791] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-04. [2025-09-17T19:44:42.988183] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T19:44:43.615822] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-07. [2025-09-17T19:44:44.415820] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-01. [2025-09-17T19:44:44.468494] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T19:44:44.569473] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T19:44:45.215775] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-05. [2025-09-17T19:44:45.442727] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T19:44:46.015812] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-11. [2025-09-17T19:44:46.735162] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T19:44:46.815804] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-06. [2025-09-17T19:44:46.910546] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T19:44:47.615807] [INFO ] [REMOTE ] ITT: Fetching primary data for 2024-12. [2025-09-17T19:44:48.005032] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T19:44:48.415811] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-07. [2025-09-17T19:44:48.951995] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T19:44:49.215805] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-01. [2025-09-17T19:44:49.991893] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T19:44:50.015727] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-08. [2025-09-17T19:44:50.214745] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T19:44:50.815832] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-08. [2025-09-17T19:44:51.378335] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T19:44:51.615900] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-02. [2025-09-17T19:44:51.750766] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T19:44:52.415789] [INFO ] [REMOTE ] ISD: Fetching primary data for 2025-09. [2025-09-17T19:44:52.625597] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T19:44:52.982329] [INFO ] [REMOTE ] ISD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:44:52.985176] [INFO ] [REMOTE ] ISD: Full fetch complete (23949 records). [2025-09-17T19:44:52.985329] [DEBUG] [VALIDATOR ] ISD: Validating primary data. [2025-09-17T19:44:53.221115] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-03. [2025-09-17T19:44:53.383422] [DEBUG] [VALIDATOR ] ISD: All expected trading days are present. [2025-09-17T19:44:53.383532] [DEBUG] [VALIDATOR ] ISD: Primary data validation passed. [2025-09-17T19:44:53.384928] [INFO ] [MAIN ] ISD: Fetched primary data is valid. [2025-09-17T19:44:53.385004] [DEBUG] [LOCAL ] ISD: Saving primary data. [2025-09-17T19:44:53.386360] [DEBUG] [LOCAL ] ISD: Trimmed 23949 records to 15835 (keeping 200 days of data) [2025-09-17T19:44:53.492039] [DEBUG] [LOCAL ] ISD: Primary data saved (15835 records). [2025-09-17T19:44:53.492242] [INFO ] [MAIN ] ISD: Full history saved. [2025-09-17T19:44:53.492377] [INFO ] [MAIN ] Update Progress: 1129/2371 symbols completed. ISD took 31.2s. Estimated remaining: 3h 1m 22s. Rate: 6.8 symbols/min [2025-09-17T19:44:53.668306] [INFO ] [MAIN ] ITUB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:44:53.728542] [DEBUG] [LOCAL ] ITUB: Loaded 53304 existing records from primary storage. [2025-09-17T19:44:53.728791] [INFO ] [MAIN ] ITUB: Loaded 53304 existing records. [2025-09-17T19:44:53.919263] [WARN ] [MAIN ] ITUB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:44:53.919580] [INFO ] [MAIN ] ITUB: Wiping existing primary data before full refresh. [2025-09-17T19:44:53.919630] [INFO ] [LOCAL ] ITUB: Starting deletion of primary data. [2025-09-17T19:44:53.920950] [DEBUG] [LOCAL ] ITUB: Deleted primary data file. [2025-09-17T19:44:53.921003] [INFO ] [MAIN ] ITUB: Starting full primary refresh. [2025-09-17T19:44:54.022763] [INFO ] [REMOTE ] IT: Fetching primary data for 2025-09. [2025-09-17T19:44:54.316216] [INFO ] [REMOTE ] ITUB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:44:54.472000] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T19:44:54.545124] [INFO ] [REMOTE ] IT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T19:44:54.552164] [INFO ] [REMOTE ] IT: Full fetch complete (54488 records). [2025-09-17T19:44:54.552399] [DEBUG] [VALIDATOR ] IT: Validating primary data. [2025-09-17T19:44:54.821224] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-02. [2025-09-17T19:44:54.959042] [DEBUG] [VALIDATOR ] IT: All expected trading days are present. [2025-09-17T19:44:54.959167] [DEBUG] [VALIDATOR ] IT: Primary data validation passed. [2025-09-17T19:44:54.960599] [INFO ] [MAIN ] IT: Fetched primary data is valid. [2025-09-17T19:44:54.960681] [DEBUG] [LOCAL ] IT: Saving primary data. [2025-09-17T19:44:54.962482] [DEBUG] [LOCAL ] IT: Trimmed 54488 records to 41079 (keeping 200 days of data) [2025-09-17T19:44:55.243241] [DEBUG] [LOCAL ] IT: Primary data saved (41079 records). [2025-09-17T19:44:55.243418] [INFO ] [MAIN ] IT: Full history saved. [2025-09-17T19:44:55.243519] [INFO ] [MAIN ] Update Progress: 1130/2371 symbols completed. IT took 24.1s. Estimated remaining: 3h 1m 5s. Rate: 6.9 symbols/min [2025-09-17T19:44:55.424985] [INFO ] [MAIN ] ITW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:44:55.475747] [DEBUG] [LOCAL ] ITW: Loaded 46545 existing records from primary storage. [2025-09-17T19:44:55.475936] [INFO ] [MAIN ] ITW: Loaded 46545 existing records. [2025-09-17T19:44:55.622300] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-11. [2025-09-17T19:44:55.669052] [WARN ] [MAIN ] ITW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:44:55.669364] [INFO ] [MAIN ] ITW: Wiping existing primary data before full refresh. [2025-09-17T19:44:55.669414] [INFO ] [LOCAL ] ITW: Starting deletion of primary data. [2025-09-17T19:44:55.670798] [DEBUG] [LOCAL ] ITW: Deleted primary data file. [2025-09-17T19:44:55.671011] [INFO ] [MAIN ] ITW: Starting full primary refresh. [2025-09-17T19:44:56.073216] [INFO ] [REMOTE ] ITW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:44:56.214573] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T19:44:56.415817] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-03. [2025-09-17T19:44:57.215894] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-04. [2025-09-17T19:44:57.338490] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T19:44:58.015850] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2024-12. [2025-09-17T19:44:58.172061] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T19:44:58.732084] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T19:44:58.815879] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-05. [2025-09-17T19:44:59.488808] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T19:44:59.615868] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-11. [2025-09-17T19:45:00.327048] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T19:45:00.415861] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-01. [2025-09-17T19:45:01.215810] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-06. [2025-09-17T19:45:01.332953] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T19:45:02.015886] [INFO ] [REMOTE ] ITW: Fetching primary data for 2024-12. [2025-09-17T19:45:02.815853] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-04. [2025-09-17T19:45:02.889392] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-01 (2.47 seconds). [2025-09-17T19:45:02.995307] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T19:45:03.615854] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-02. [2025-09-17T19:45:04.415888] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-07. [2025-09-17T19:45:05.099878] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2024-12 (3.08 seconds). [2025-09-17T19:45:05.201522] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-04 (2.39 seconds). [2025-09-17T19:45:05.215733] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-05. [2025-09-17T19:45:05.282846] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T19:45:06.015857] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-03. [2025-09-17T19:45:06.314549] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T19:45:06.815874] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-08. [2025-09-17T19:45:07.267464] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T19:45:07.615884] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-01. [2025-09-17T19:45:07.874399] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T19:45:07.962831] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T19:45:08.415879] [INFO ] [REMOTE ] ITGR: Fetching primary data for 2025-09. [2025-09-17T19:45:09.098861] [INFO ] [REMOTE ] ITGR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T19:45:09.103519] [INFO ] [REMOTE ] ITGR: Full fetch complete (40847 records). [2025-09-17T19:45:09.103711] [DEBUG] [VALIDATOR ] ITGR: Validating primary data. [2025-09-17T19:45:09.221190] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-06. [2025-09-17T19:45:09.534530] [DEBUG] [VALIDATOR ] ITGR: All expected trading days are present. [2025-09-17T19:45:09.534730] [DEBUG] [VALIDATOR ] ITGR: Primary data validation passed. [2025-09-17T19:45:09.536439] [INFO ] [MAIN ] ITGR: Fetched primary data is valid. [2025-09-17T19:45:09.536524] [DEBUG] [LOCAL ] ITGR: Saving primary data. [2025-09-17T19:45:09.548811] [DEBUG] [LOCAL ] ITGR: Trimmed 40847 records to 31638 (keeping 200 days of data) [2025-09-17T19:45:09.570633] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T19:45:09.802727] [DEBUG] [LOCAL ] ITGR: Primary data saved (31638 records). [2025-09-17T19:45:09.802950] [INFO ] [MAIN ] ITGR: Full history saved. [2025-09-17T19:45:09.803104] [INFO ] [MAIN ] Update Progress: 1131/2371 symbols completed. ITGR took 37.0s. Estimated remaining: 3h 1m 3s. Rate: 6.8 symbols/min [2025-09-17T19:45:10.012266] [INFO ] [MAIN ] IVR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:45:10.015795] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-04. [2025-09-17T19:45:10.065027] [DEBUG] [LOCAL ] IVR: Loaded 47725 existing records from primary storage. [2025-09-17T19:45:10.065296] [INFO ] [MAIN ] IVR: Loaded 47725 existing records. [2025-09-17T19:45:10.258035] [WARN ] [MAIN ] IVR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:45:10.258422] [INFO ] [MAIN ] IVR: Wiping existing primary data before full refresh. [2025-09-17T19:45:10.258492] [INFO ] [LOCAL ] IVR: Starting deletion of primary data. [2025-09-17T19:45:10.259710] [DEBUG] [LOCAL ] IVR: Deleted primary data file. [2025-09-17T19:45:10.259779] [INFO ] [MAIN ] IVR: Starting full primary refresh. [2025-09-17T19:45:10.635434] [INFO ] [REMOTE ] IVR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:45:10.659585] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T19:45:10.815816] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-11. [2025-09-17T19:45:11.615823] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-07. [2025-09-17T19:45:11.891911] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T19:45:12.111264] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T19:45:12.415831] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-05. [2025-09-17T19:45:12.963238] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T19:45:13.215852] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-02. [2025-09-17T19:45:14.015788] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-08. [2025-09-17T19:45:14.185477] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T19:45:14.769058] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T19:45:14.815792] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-03. [2025-09-17T19:45:15.004850] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T19:45:15.615842] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-06. [2025-09-17T19:45:16.415804] [INFO ] [REMOTE ] ITT: Fetching primary data for 2025-09. [2025-09-17T19:45:17.215775] [INFO ] [REMOTE ] IVR: Fetching primary data for 2024-12. [2025-09-17T19:45:17.439414] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-03 (2.62 seconds). [2025-09-17T19:45:18.015765] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-04. [2025-09-17T19:45:18.219783] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-17T19:45:18.248190] [INFO ] [REMOTE ] ITT: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T19:45:18.254323] [INFO ] [REMOTE ] ITT: Full fetch complete (46673 records). [2025-09-17T19:45:18.254526] [DEBUG] [VALIDATOR ] ITT: Validating primary data. [2025-09-17T19:45:18.651225] [DEBUG] [VALIDATOR ] ITT: All expected trading days are present. [2025-09-17T19:45:18.651373] [DEBUG] [VALIDATOR ] ITT: Primary data validation passed. [2025-09-17T19:45:18.652156] [INFO ] [MAIN ] ITT: Fetched primary data is valid. [2025-09-17T19:45:18.652210] [DEBUG] [LOCAL ] ITT: Saving primary data. [2025-09-17T19:45:18.653592] [DEBUG] [LOCAL ] ITT: Trimmed 46673 records to 33505 (keeping 200 days of data) [2025-09-17T19:45:18.822890] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-07. [2025-09-17T19:45:18.875507] [DEBUG] [LOCAL ] ITT: Primary data saved (33505 records). [2025-09-17T19:45:18.875695] [INFO ] [MAIN ] ITT: Full history saved. [2025-09-17T19:45:18.875790] [INFO ] [MAIN ] Update Progress: 1132/2371 symbols completed. ITT took 41.5s. Estimated remaining: 3h 0m 54s. Rate: 6.8 symbols/min [2025-09-17T19:45:19.048988] [INFO ] [MAIN ] IVT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:45:19.084363] [DEBUG] [LOCAL ] IVT: Loaded 31028 existing records from primary storage. [2025-09-17T19:45:19.084559] [INFO ] [MAIN ] IVT: Loaded 31028 existing records. [2025-09-17T19:45:19.263350] [WARN ] [MAIN ] IVT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:45:19.263718] [INFO ] [MAIN ] IVT: Wiping existing primary data before full refresh. [2025-09-17T19:45:19.263779] [INFO ] [LOCAL ] IVT: Starting deletion of primary data. [2025-09-17T19:45:19.264392] [DEBUG] [LOCAL ] IVT: Deleted primary data file. [2025-09-17T19:45:19.264437] [INFO ] [MAIN ] IVT: Starting full primary refresh. [2025-09-17T19:45:19.633771] [INFO ] [REMOTE ] IVT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:45:19.634450] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-11. [2025-09-17T19:45:19.663055] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-17T19:45:19.705184] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T19:45:20.415784] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-01. [2025-09-17T19:45:20.524618] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T19:45:20.676786] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T19:45:21.215798] [INFO ] [REMOTE ] IVT: Fetching primary data for 2024-12. [2025-09-17T19:45:21.820885] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T19:45:22.015774] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-02. [2025-09-17T19:45:22.518816] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T19:45:22.815792] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-01. [2025-09-17T19:45:23.276873] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T19:45:23.615788] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-03. [2025-09-17T19:45:23.773491] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T19:45:24.415833] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-08. [2025-09-17T19:45:25.215809] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-05. [2025-09-17T19:45:25.403954] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T19:45:25.920467] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T19:45:26.015785] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-04. [2025-09-17T19:45:26.815799] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-02. [2025-09-17T19:45:26.970419] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T19:45:27.615781] [INFO ] [REMOTE ] ITUB: Fetching primary data for 2025-09. [2025-09-17T19:45:27.912814] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T19:45:27.940978] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T19:45:28.250796] [INFO ] [REMOTE ] ITUB: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T19:45:28.257572] [INFO ] [REMOTE ] ITUB: Full fetch complete (77025 records). [2025-09-17T19:45:28.257719] [DEBUG] [VALIDATOR ] ITUB: Validating primary data. [2025-09-17T19:45:28.417015] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-05. [2025-09-17T19:45:28.661573] [DEBUG] [VALIDATOR ] ITUB: All expected trading days are present. [2025-09-17T19:45:28.661688] [DEBUG] [VALIDATOR ] ITUB: Primary data validation passed. [2025-09-17T19:45:28.662925] [INFO ] [MAIN ] ITUB: Fetched primary data is valid. [2025-09-17T19:45:28.662979] [DEBUG] [LOCAL ] ITUB: Saving primary data. [2025-09-17T19:45:28.664602] [DEBUG] [LOCAL ] ITUB: Trimmed 77025 records to 53303 (keeping 200 days of data) [2025-09-17T19:45:28.980378] [DEBUG] [LOCAL ] ITUB: Primary data saved (53303 records). [2025-09-17T19:45:28.980523] [INFO ] [MAIN ] ITUB: Full history saved. [2025-09-17T19:45:28.980630] [INFO ] [MAIN ] Update Progress: 1133/2371 symbols completed. ITUB took 35.5s. Estimated remaining: 3h 0m 47s. Rate: 6.8 symbols/min [2025-09-17T19:45:29.150516] [INFO ] [MAIN ] IVZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:45:29.201481] [DEBUG] [LOCAL ] IVZ: Loaded 53141 existing records from primary storage. [2025-09-17T19:45:29.201673] [INFO ] [MAIN ] IVZ: Loaded 53141 existing records. [2025-09-17T19:45:29.222321] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-03. [2025-09-17T19:45:29.419770] [WARN ] [MAIN ] IVZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:45:29.420042] [INFO ] [MAIN ] IVZ: Wiping existing primary data before full refresh. [2025-09-17T19:45:29.420087] [INFO ] [LOCAL ] IVZ: Starting deletion of primary data. [2025-09-17T19:45:29.421277] [DEBUG] [LOCAL ] IVZ: Deleted primary data file. [2025-09-17T19:45:29.421333] [INFO ] [MAIN ] IVZ: Starting full primary refresh. [2025-09-17T19:45:29.808194] [INFO ] [REMOTE ] IVZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:45:30.015835] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-11. [2025-09-17T19:45:30.342592] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T19:45:30.743192] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T19:45:30.815757] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-04. [2025-09-17T19:45:31.626118] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-06. [2025-09-17T19:45:31.631787] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T19:45:32.241532] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T19:45:32.415776] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2024-12. [2025-09-17T19:45:33.215753] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-05. [2025-09-17T19:45:33.241015] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T19:45:34.015725] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-07. [2025-09-17T19:45:34.172173] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T19:45:34.514474] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T19:45:34.815786] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-01. [2025-09-17T19:45:35.615805] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-06. [2025-09-17T19:45:35.748793] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T19:45:36.133996] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T19:45:36.415797] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-06. [2025-09-17T19:45:36.896693] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T19:45:37.215781] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-08. [2025-09-17T19:45:37.709615] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T19:45:38.015810] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-07. [2025-09-17T19:45:38.815792] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-02. [2025-09-17T19:45:38.852464] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T19:45:39.615775] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-07. [2025-09-17T19:45:39.726156] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T19:45:40.415683] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-08. [2025-09-17T19:45:40.543932] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T19:45:40.889673] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T19:45:41.215768] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-08. [2025-09-17T19:45:42.015780] [INFO ] [REMOTE ] ITW: Fetching primary data for 2025-09. [2025-09-17T19:45:42.159314] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T19:45:42.561517] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T19:45:42.621617] [INFO ] [REMOTE ] ITW: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T19:45:42.628635] [INFO ] [REMOTE ] ITW: Full fetch complete (66561 records). [2025-09-17T19:45:42.628840] [DEBUG] [VALIDATOR ] ITW: Validating primary data. [2025-09-17T19:45:42.817924] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-03. [2025-09-17T19:45:43.048012] [DEBUG] [VALIDATOR ] ITW: All expected trading days are present. [2025-09-17T19:45:43.048161] [DEBUG] [VALIDATOR ] ITW: Primary data validation passed. [2025-09-17T19:45:43.049109] [INFO ] [MAIN ] ITW: Fetched primary data is valid. [2025-09-17T19:45:43.049177] [DEBUG] [LOCAL ] ITW: Saving primary data. [2025-09-17T19:45:43.052172] [DEBUG] [LOCAL ] ITW: Trimmed 66561 records to 46540 (keeping 200 days of data) [2025-09-17T19:45:43.355042] [DEBUG] [LOCAL ] ITW: Primary data saved (46540 records). [2025-09-17T19:45:43.355211] [INFO ] [MAIN ] ITW: Full history saved. [2025-09-17T19:45:43.355326] [INFO ] [MAIN ] Update Progress: 1134/2371 symbols completed. ITW took 48.1s. Estimated remaining: 3h 0m 44s. Rate: 6.8 symbols/min [2025-09-17T19:45:43.537230] [INFO ] [MAIN ] IX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:45:43.559955] [DEBUG] [LOCAL ] IX: Loaded 22934 existing records from primary storage. [2025-09-17T19:45:43.560159] [INFO ] [MAIN ] IX: Loaded 22934 existing records. [2025-09-17T19:45:43.628853] [INFO ] [REMOTE ] IVT: Fetching primary data for 2025-09. [2025-09-17T19:45:43.754528] [WARN ] [MAIN ] IX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:45:43.754833] [INFO ] [MAIN ] IX: Wiping existing primary data before full refresh. [2025-09-17T19:45:43.754892] [INFO ] [LOCAL ] IX: Starting deletion of primary data. [2025-09-17T19:45:43.755573] [DEBUG] [LOCAL ] IX: Deleted primary data file. [2025-09-17T19:45:43.755638] [INFO ] [MAIN ] IX: Starting full primary refresh. [2025-09-17T19:45:44.125923] [INFO ] [REMOTE ] IX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:45:44.312387] [INFO ] [REMOTE ] IVT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T19:45:44.316750] [INFO ] [REMOTE ] IVT: Full fetch complete (45483 records). [2025-09-17T19:45:44.316875] [DEBUG] [VALIDATOR ] IVT: Validating primary data. [2025-09-17T19:45:44.421498] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-11. [2025-09-17T19:45:44.720309] [DEBUG] [VALIDATOR ] IVT: All expected trading days are present. [2025-09-17T19:45:44.720459] [DEBUG] [VALIDATOR ] IVT: Primary data validation passed. [2025-09-17T19:45:44.721225] [INFO ] [MAIN ] IVT: Fetched primary data is valid. [2025-09-17T19:45:44.721314] [DEBUG] [LOCAL ] IVT: Saving primary data. [2025-09-17T19:45:44.723108] [DEBUG] [LOCAL ] IVT: Trimmed 45483 records to 31017 (keeping 200 days of data) [2025-09-17T19:45:44.864162] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T19:45:44.985043] [DEBUG] [LOCAL ] IVT: Primary data saved (31017 records). [2025-09-17T19:45:44.985216] [INFO ] [MAIN ] IVT: Full history saved. [2025-09-17T19:45:44.985310] [INFO ] [MAIN ] Update Progress: 1135/2371 symbols completed. IVT took 26.1s. Estimated remaining: 3h 0m 28s. Rate: 6.8 symbols/min [2025-09-17T19:45:45.159200] [INFO ] [MAIN ] J: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:45:45.202178] [DEBUG] [LOCAL ] J: Loaded 40591 existing records from primary storage. [2025-09-17T19:45:45.202340] [INFO ] [MAIN ] J: Loaded 40591 existing records. [2025-09-17T19:45:45.223365] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-04. [2025-09-17T19:45:45.317112] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T19:45:45.400330] [WARN ] [MAIN ] J: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:45:45.400585] [INFO ] [MAIN ] J: Wiping existing primary data before full refresh. [2025-09-17T19:45:45.400635] [INFO ] [LOCAL ] J: Starting deletion of primary data. [2025-09-17T19:45:45.401596] [DEBUG] [LOCAL ] J: Deleted primary data file. [2025-09-17T19:45:45.401676] [INFO ] [MAIN ] J: Starting full primary refresh. [2025-09-17T19:45:45.759626] [INFO ] [REMOTE ] J: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:45:46.015782] [INFO ] [REMOTE ] J: Fetching primary data for 2024-11. [2025-09-17T19:45:46.815877] [INFO ] [REMOTE ] IX: Fetching primary data for 2024-12. [2025-09-17T19:45:47.213122] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T19:45:47.384131] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T19:45:47.596573] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T19:45:47.615785] [INFO ] [REMOTE ] IVR: Fetching primary data for 2025-09. [2025-09-17T19:45:48.307303] [INFO ] [REMOTE ] IVR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T19:45:48.313613] [INFO ] [REMOTE ] IVR: Full fetch complete (68687 records). [2025-09-17T19:45:48.313821] [DEBUG] [VALIDATOR ] IVR: Validating primary data. [2025-09-17T19:45:48.420848] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-01. [2025-09-17T19:45:48.705144] [DEBUG] [VALIDATOR ] IVR: All expected trading days are present. [2025-09-17T19:45:48.705233] [DEBUG] [VALIDATOR ] IVR: Primary data validation passed. [2025-09-17T19:45:48.706243] [INFO ] [MAIN ] IVR: Fetched primary data is valid. [2025-09-17T19:45:48.706312] [DEBUG] [LOCAL ] IVR: Saving primary data. [2025-09-17T19:45:48.707772] [DEBUG] [LOCAL ] IVR: Trimmed 68687 records to 47721 (keeping 200 days of data) [2025-09-17T19:45:49.000168] [DEBUG] [LOCAL ] IVR: Primary data saved (47721 records). [2025-09-17T19:45:49.000320] [INFO ] [MAIN ] IVR: Full history saved. [2025-09-17T19:45:49.001428] [INFO ] [MAIN ] Update Progress: 1136/2371 symbols completed. IVR took 39.2s. Estimated remaining: 3h 0m 14s. Rate: 6.9 symbols/min [2025-09-17T19:45:49.174815] [INFO ] [MAIN ] JBGS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:45:49.218387] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-05. [2025-09-17T19:45:49.220361] [DEBUG] [LOCAL ] JBGS: Loaded 42383 existing records from primary storage. [2025-09-17T19:45:49.220520] [INFO ] [MAIN ] JBGS: Loaded 42383 existing records. [2025-09-17T19:45:49.350484] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T19:45:49.410816] [WARN ] [MAIN ] JBGS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:45:49.411095] [INFO ] [MAIN ] JBGS: Wiping existing primary data before full refresh. [2025-09-17T19:45:49.411141] [INFO ] [LOCAL ] JBGS: Starting deletion of primary data. [2025-09-17T19:45:49.412042] [DEBUG] [LOCAL ] JBGS: Deleted primary data file. [2025-09-17T19:45:49.412093] [INFO ] [MAIN ] JBGS: Starting full primary refresh. [2025-09-17T19:45:49.773462] [INFO ] [REMOTE ] JBGS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:45:50.015788] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-02. [2025-09-17T19:45:50.764878] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T19:45:50.815790] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-03. [2025-09-17T19:45:51.130834] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T19:45:51.615810] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-06. [2025-09-17T19:45:52.027334] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T19:45:52.415830] [INFO ] [REMOTE ] J: Fetching primary data for 2024-12. [2025-09-17T19:45:53.073925] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T19:45:53.215851] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-11. [2025-09-17T19:45:53.992302] [INFO ] [REMOTE ] J: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T19:45:54.015733] [INFO ] [REMOTE ] J: Fetching primary data for 2025-01. [2025-09-17T19:45:54.523690] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T19:45:54.815783] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-07. [2025-09-17T19:45:55.631953] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-04. [2025-09-17T19:45:55.635791] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T19:45:56.415779] [INFO ] [REMOTE ] J: Fetching primary data for 2025-02. [2025-09-17T19:45:56.675860] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T19:45:57.028982] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T19:45:57.215846] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2024-12. [2025-09-17T19:45:57.774908] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T19:45:58.015792] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-08. [2025-09-17T19:45:58.729692] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T19:45:58.815720] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-01. [2025-09-17T19:45:59.565010] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T19:45:59.615732] [INFO ] [REMOTE ] IVZ: Fetching primary data for 2025-09. [2025-09-17T19:46:00.179512] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T19:46:00.415811] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-05. [2025-09-17T19:46:00.644964] [INFO ] [REMOTE ] IVZ: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T19:46:00.652613] [INFO ] [REMOTE ] IVZ: Full fetch complete (76534 records). [2025-09-17T19:46:00.652893] [DEBUG] [VALIDATOR ] IVZ: Validating primary data. [2025-09-17T19:46:01.080956] [DEBUG] [VALIDATOR ] IVZ: All expected trading days are present. [2025-09-17T19:46:01.081058] [DEBUG] [VALIDATOR ] IVZ: Primary data validation passed. [2025-09-17T19:46:01.082134] [INFO ] [MAIN ] IVZ: Fetched primary data is valid. [2025-09-17T19:46:01.082194] [DEBUG] [LOCAL ] IVZ: Saving primary data. [2025-09-17T19:46:01.083940] [DEBUG] [LOCAL ] IVZ: Trimmed 76534 records to 53146 (keeping 200 days of data) [2025-09-17T19:46:01.216278] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-02. [2025-09-17T19:46:01.454276] [DEBUG] [LOCAL ] IVZ: Primary data saved (53146 records). [2025-09-17T19:46:01.454448] [INFO ] [MAIN ] IVZ: Full history saved. [2025-09-17T19:46:01.454553] [INFO ] [MAIN ] Update Progress: 1137/2371 symbols completed. IVZ took 32.5s. Estimated remaining: 3h 0m 9s. Rate: 6.8 symbols/min [2025-09-17T19:46:01.635801] [INFO ] [MAIN ] JBI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:46:01.656600] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T19:46:01.699042] [DEBUG] [LOCAL ] JBI: Loaded 44256 existing records from primary storage. [2025-09-17T19:46:01.699204] [INFO ] [MAIN ] JBI: Loaded 44256 existing records. [2025-09-17T19:46:01.893984] [WARN ] [MAIN ] JBI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:46:01.894355] [INFO ] [MAIN ] JBI: Wiping existing primary data before full refresh. [2025-09-17T19:46:01.894436] [INFO ] [LOCAL ] JBI: Starting deletion of primary data. [2025-09-17T19:46:01.895205] [DEBUG] [LOCAL ] JBI: Deleted primary data file. [2025-09-17T19:46:01.895280] [INFO ] [MAIN ] JBI: Starting full primary refresh. [2025-09-17T19:46:02.021012] [INFO ] [REMOTE ] J: Fetching primary data for 2025-03. [2025-09-17T19:46:02.267897] [INFO ] [REMOTE ] JBI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:46:02.815801] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-06. [2025-09-17T19:46:02.869240] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T19:46:03.615839] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-03. [2025-09-17T19:46:03.711123] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T19:46:03.810255] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T19:46:04.415837] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-07. [2025-09-17T19:46:04.978011] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T19:46:05.215779] [INFO ] [REMOTE ] J: Fetching primary data for 2025-04. [2025-09-17T19:46:05.533336] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T19:46:06.015882] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-08. [2025-09-17T19:46:06.815882] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-04. [2025-09-17T19:46:06.940925] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T19:46:07.014986] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T19:46:07.615822] [INFO ] [REMOTE ] J: Fetching primary data for 2025-05. [2025-09-17T19:46:08.415843] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-11. [2025-09-17T19:46:08.492577] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T19:46:09.220873] [INFO ] [REMOTE ] IX: Fetching primary data for 2025-09. [2025-09-17T19:46:09.242702] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T19:46:09.812483] [INFO ] [REMOTE ] IX: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T19:46:09.815853] [INFO ] [REMOTE ] IX: Full fetch complete (26485 records). [2025-09-17T19:46:09.816161] [DEBUG] [VALIDATOR ] IX: Validating primary data. [2025-09-17T19:46:10.021879] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-05. [2025-09-17T19:46:10.198690] [DEBUG] [VALIDATOR ] IX: All expected trading days are present. [2025-09-17T19:46:10.198800] [DEBUG] [VALIDATOR ] IX: Primary data validation passed. [2025-09-17T19:46:10.199616] [INFO ] [MAIN ] IX: Fetched primary data is valid. [2025-09-17T19:46:10.199779] [DEBUG] [LOCAL ] IX: Saving primary data. [2025-09-17T19:46:10.201419] [DEBUG] [LOCAL ] IX: Trimmed 26485 records to 22870 (keeping 200 days of data) [2025-09-17T19:46:10.316946] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T19:46:10.378482] [DEBUG] [LOCAL ] IX: Primary data saved (22870 records). [2025-09-17T19:46:10.378632] [INFO ] [MAIN ] IX: Full history saved. [2025-09-17T19:46:10.378778] [INFO ] [MAIN ] Update Progress: 1138/2371 symbols completed. IX took 27.0s. Estimated remaining: 3h 0m 1s. Rate: 6.8 symbols/min [2025-09-17T19:46:10.549804] [INFO ] [MAIN ] JBL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:46:10.600104] [DEBUG] [LOCAL ] JBL: Loaded 48381 existing records from primary storage. [2025-09-17T19:46:10.600303] [INFO ] [MAIN ] JBL: Loaded 48381 existing records. [2025-09-17T19:46:10.783117] [WARN ] [MAIN ] JBL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:46:10.783416] [INFO ] [MAIN ] JBL: Wiping existing primary data before full refresh. [2025-09-17T19:46:10.783463] [INFO ] [LOCAL ] JBL: Starting deletion of primary data. [2025-09-17T19:46:10.784675] [DEBUG] [LOCAL ] JBL: Deleted primary data file. [2025-09-17T19:46:10.784736] [INFO ] [MAIN ] JBL: Starting full primary refresh. [2025-09-17T19:46:10.821019] [INFO ] [REMOTE ] JBI: Fetching primary data for 2024-12. [2025-09-17T19:46:11.147825] [INFO ] [REMOTE ] JBL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:46:11.615839] [INFO ] [REMOTE ] J: Fetching primary data for 2025-06. [2025-09-17T19:46:11.684573] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T19:46:12.415829] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-06. [2025-09-17T19:46:12.475516] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T19:46:12.866290] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T19:46:13.215802] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-01. [2025-09-17T19:46:13.971456] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T19:46:14.015746] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-07. [2025-09-17T19:46:14.775120] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T19:46:14.815730] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-02. [2025-09-17T19:46:15.617420] [INFO ] [REMOTE ] J: Fetching primary data for 2025-07. [2025-09-17T19:46:15.623231] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T19:46:16.222388] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T19:46:16.415831] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-11. [2025-09-17T19:46:17.215742] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-03. [2025-09-17T19:46:17.240803] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T19:46:18.000327] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T19:46:18.015696] [INFO ] [REMOTE ] J: Fetching primary data for 2025-08. [2025-09-17T19:46:18.815822] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-08. [2025-09-17T19:46:18.906504] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T19:46:19.139901] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T19:46:19.615841] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-04. [2025-09-17T19:46:20.386316] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T19:46:20.415733] [INFO ] [REMOTE ] JBGS: Fetching primary data for 2025-09. [2025-09-17T19:46:21.165528] [INFO ] [REMOTE ] JBGS: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T19:46:21.171173] [INFO ] [REMOTE ] JBGS: Full fetch complete (58617 records). [2025-09-17T19:46:21.171309] [DEBUG] [VALIDATOR ] JBGS: Validating primary data. [2025-09-17T19:46:21.234496] [INFO ] [REMOTE ] J: Fetching primary data for 2025-09. [2025-09-17T19:46:21.567201] [DEBUG] [VALIDATOR ] JBGS: All expected trading days are present. [2025-09-17T19:46:21.567483] [DEBUG] [VALIDATOR ] JBGS: Primary data validation passed. [2025-09-17T19:46:21.596001] [INFO ] [MAIN ] JBGS: Fetched primary data is valid. [2025-09-17T19:46:21.596203] [DEBUG] [LOCAL ] JBGS: Saving primary data. [2025-09-17T19:46:21.599410] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T19:46:21.610925] [DEBUG] [LOCAL ] JBGS: Trimmed 58617 records to 42400 (keeping 200 days of data) [2025-09-17T19:46:21.890584] [DEBUG] [LOCAL ] JBGS: Primary data saved (42400 records). [2025-09-17T19:46:21.890786] [INFO ] [MAIN ] JBGS: Full history saved. [2025-09-17T19:46:21.891862] [INFO ] [MAIN ] Update Progress: 1139/2371 symbols completed. JBGS took 32.9s. Estimated remaining: 2h 59m 55s. Rate: 6.8 symbols/min [2025-09-17T19:46:22.020078] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-05. [2025-09-17T19:46:22.028955] [INFO ] [REMOTE ] J: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T19:46:22.113675] [INFO ] [REMOTE ] J: Full fetch complete (59119 records). [2025-09-17T19:46:22.115264] [INFO ] [MAIN ] JBND: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:46:22.115528] [DEBUG] [VALIDATOR ] J: Validating primary data. [2025-09-17T19:46:22.437028] [DEBUG] [LOCAL ] JBND: Loaded 24961 existing records from primary storage. [2025-09-17T19:46:22.453850] [INFO ] [MAIN ] JBND: Loaded 24961 existing records. [2025-09-17T19:46:22.707075] [DEBUG] [VALIDATOR ] J: All expected trading days are present. [2025-09-17T19:46:22.722372] [DEBUG] [VALIDATOR ] J: Primary data validation passed. [2025-09-17T19:46:22.744321] [INFO ] [MAIN ] J: Fetched primary data is valid. [2025-09-17T19:46:22.744561] [DEBUG] [LOCAL ] J: Saving primary data. [2025-09-17T19:46:22.744452] [WARN ] [MAIN ] JBND: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:46:22.744918] [INFO ] [MAIN ] JBND: Wiping existing primary data before full refresh. [2025-09-17T19:46:22.744981] [INFO ] [LOCAL ] JBND: Starting deletion of primary data. [2025-09-17T19:46:22.746117] [DEBUG] [LOCAL ] JBND: Deleted primary data file. [2025-09-17T19:46:22.746068] [DEBUG] [LOCAL ] J: Trimmed 59119 records to 40617 (keeping 200 days of data) [2025-09-17T19:46:22.746273] [INFO ] [MAIN ] JBND: Starting full primary refresh. [2025-09-17T19:46:22.870422] [INFO ] [REMOTE ] JBL: Fetching primary data for 2024-12. [2025-09-17T19:46:23.231759] [INFO ] [REMOTE ] JBND: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:46:23.395595] [DEBUG] [LOCAL ] J: Primary data saved (40617 records). [2025-09-17T19:46:23.395767] [INFO ] [MAIN ] J: Full history saved. [2025-09-17T19:46:23.395897] [INFO ] [MAIN ] Update Progress: 1140/2371 symbols completed. J took 38.4s. Estimated remaining: 2h 59m 38s. Rate: 6.9 symbols/min [2025-09-17T19:46:23.578576] [INFO ] [MAIN ] JBS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:46:23.579101] [DEBUG] [LOCAL ] JBS: No existing data file found in primary storage. [2025-09-17T19:46:23.579143] [WARN ] [MAIN ] JBS: No existing data found, performing full refresh instead. [2025-09-17T19:46:23.579300] [INFO ] [MAIN ] JBS: Wiping existing primary data before full refresh. [2025-09-17T19:46:23.579341] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-17T19:46:23.579381] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-17T19:46:23.579414] [INFO ] [MAIN ] JBS: Starting full primary refresh. [2025-09-17T19:46:23.625105] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-11. [2025-09-17T19:46:23.963740] [INFO ] [REMOTE ] JBS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:46:24.015338] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T19:46:24.415821] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-11. [2025-09-17T19:46:24.460286] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T19:46:24.619096] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:46:24.619483] [WARN ] [REMOTE ] JBS: No data returned for month 2024-11 [2025-09-17T19:46:24.686577] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T19:46:25.215796] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-06. [2025-09-17T19:46:26.015795] [INFO ] [REMOTE ] JBND: Fetching primary data for 2024-12. [2025-09-17T19:46:26.498094] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T19:46:26.815814] [INFO ] [REMOTE ] JBS: Fetching primary data for 2024-12. [2025-09-17T19:46:27.028066] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T19:46:27.032561] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:46:27.033577] [WARN ] [REMOTE ] JBS: No data returned for month 2024-12 [2025-09-17T19:46:27.615789] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-01. [2025-09-17T19:46:27.814311] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:46:27.814667] [WARN ] [REMOTE ] JBS: No data returned for month 2025-01 [2025-09-17T19:46:28.415814] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-07. [2025-09-17T19:46:29.216035] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-01. [2025-09-17T19:46:30.015751] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-01. [2025-09-17T19:46:30.075350] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T19:46:30.115382] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T19:46:30.815790] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-02. [2025-09-17T19:46:31.615760] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-02. [2025-09-17T19:46:31.733367] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T19:46:31.804218] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:46:31.804562] [WARN ] [REMOTE ] JBS: No data returned for month 2025-02 [2025-09-17T19:46:32.266271] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-01 (2.25 seconds). [2025-09-17T19:46:32.415782] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-03. [2025-09-17T19:46:32.633687] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:46:32.634125] [WARN ] [REMOTE ] JBS: No data returned for month 2025-03 [2025-09-17T19:46:33.215773] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-08. [2025-09-17T19:46:34.015780] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-02. [2025-09-17T19:46:34.800933] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T19:46:34.815674] [INFO ] [REMOTE ] JBI: Fetching primary data for 2025-09. [2025-09-17T19:46:35.241475] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T19:46:35.598929] [INFO ] [REMOTE ] JBI: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T19:46:35.604585] [INFO ] [REMOTE ] JBI: Full fetch complete (64626 records). [2025-09-17T19:46:35.604791] [DEBUG] [VALIDATOR ] JBI: Validating primary data. [2025-09-17T19:46:35.620851] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-03. [2025-09-17T19:46:36.019433] [DEBUG] [VALIDATOR ] JBI: All expected trading days are present. [2025-09-17T19:46:36.019519] [DEBUG] [VALIDATOR ] JBI: Primary data validation passed. [2025-09-17T19:46:36.020583] [INFO ] [MAIN ] JBI: Fetched primary data is valid. [2025-09-17T19:46:36.020628] [DEBUG] [LOCAL ] JBI: Saving primary data. [2025-09-17T19:46:36.022573] [DEBUG] [LOCAL ] JBI: Trimmed 64626 records to 44221 (keeping 200 days of data) [2025-09-17T19:46:36.299634] [DEBUG] [LOCAL ] JBI: Primary data saved (44221 records). [2025-09-17T19:46:36.299803] [INFO ] [MAIN ] JBI: Full history saved. [2025-09-17T19:46:36.299929] [INFO ] [MAIN ] Update Progress: 1141/2371 symbols completed. JBI took 34.8s. Estimated remaining: 2h 59m 34s. Rate: 6.8 symbols/min [2025-09-17T19:46:36.420920] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-04. [2025-09-17T19:46:36.488633] [INFO ] [MAIN ] JBTM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:46:36.488948] [DEBUG] [LOCAL ] JBTM: No existing data file found in primary storage. [2025-09-17T19:46:36.488991] [WARN ] [MAIN ] JBTM: No existing data found, performing full refresh instead. [2025-09-17T19:46:36.489114] [INFO ] [MAIN ] JBTM: Wiping existing primary data before full refresh. [2025-09-17T19:46:36.489154] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-17T19:46:36.489210] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-17T19:46:36.489251] [INFO ] [MAIN ] JBTM: Starting full primary refresh. [2025-09-17T19:46:36.724229] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:46:36.764198] [WARN ] [REMOTE ] JBS: No data returned for month 2025-04 [2025-09-17T19:46:36.904418] [INFO ] [REMOTE ] JBTM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:46:37.215837] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-11. [2025-09-17T19:46:37.467857] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:46:37.468875] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-11 [2025-09-17T19:46:37.528920] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T19:46:38.015794] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2024-12. [2025-09-17T19:46:38.248944] [DEBUG] [REMOTE ] JBTM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:46:38.249268] [WARN ] [REMOTE ] JBTM: No data returned for month 2024-12 [2025-09-17T19:46:38.815791] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-05. [2025-09-17T19:46:39.023309] [DEBUG] [REMOTE ] JBS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:46:39.023677] [WARN ] [REMOTE ] JBS: No data returned for month 2025-05 [2025-09-17T19:46:39.615794] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-06. [2025-09-17T19:46:40.415742] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-03. [2025-09-17T19:46:40.824037] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T19:46:41.215758] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-07. [2025-09-17T19:46:41.539797] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T19:46:42.015789] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-04. [2025-09-17T19:46:42.815775] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-01. [2025-09-17T19:46:43.036958] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T19:46:43.615759] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-04. [2025-09-17T19:46:43.687457] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T19:46:44.228622] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T19:46:44.415785] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-02. [2025-09-17T19:46:44.711277] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T19:46:45.215814] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-08. [2025-09-17T19:46:45.289874] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T19:46:46.015843] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-03. [2025-09-17T19:46:46.815856] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-05. [2025-09-17T19:46:47.040631] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T19:46:47.445046] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T19:46:47.615830] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-05. [2025-09-17T19:46:48.210853] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T19:46:48.313727] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T19:46:48.415816] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-06. [2025-09-17T19:46:49.215818] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-04. [2025-09-17T19:46:50.015821] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-06. [2025-09-17T19:46:50.357015] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T19:46:50.400559] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T19:46:50.815820] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-07. [2025-09-17T19:46:50.856860] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T19:46:51.615772] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-07. [2025-09-17T19:46:52.415813] [INFO ] [REMOTE ] JBS: Fetching primary data for 2025-09. [2025-09-17T19:46:52.750599] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T19:46:52.804030] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T19:46:52.833460] [INFO ] [REMOTE ] JBS: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T19:46:52.840401] [INFO ] [REMOTE ] JBS: Full fetch complete (24834 records). [2025-09-17T19:46:52.840524] [DEBUG] [VALIDATOR ] JBS: Validating primary data. [2025-09-17T19:46:53.034141] [WARN ] [VALIDATOR ] JBS: Validation failed - insufficient historical data. Have 65 unique days, need 200 days [2025-09-17T19:46:53.034671] [FATAL] [MAIN ] JBS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:46:53.034753] [WARN ] [MAIN ] JBS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:46:53.034840] [INFO ] [LOCAL ] JBS: Starting deletion of primary data. [2025-09-17T19:46:53.034937] [DEBUG] [LOCAL ] JBS: No primary data file found to delete. [2025-09-17T19:46:53.034990] [INFO ] [LOCAL ] JBS: Starting deletion of derivative data. [2025-09-17T19:46:53.035062] [DEBUG] [LOCAL ] JBS: No derivative data file found to delete. [2025-09-17T19:46:53.035157] [INFO ] [MAIN ] Update Progress: 1142/2371 symbols completed. JBS took 29.6s. Estimated remaining: 2h 59m 34s. Rate: 6.8 symbols/min [2025-09-17T19:46:53.211891] [INFO ] [MAIN ] JCE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:46:53.217359] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-08. [2025-09-17T19:46:53.222754] [DEBUG] [LOCAL ] JCE: Loaded 6270 existing records from primary storage. [2025-09-17T19:46:53.222867] [INFO ] [MAIN ] JCE: Loaded 6270 existing records. [2025-09-17T19:46:53.414195] [WARN ] [MAIN ] JCE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:46:53.414446] [INFO ] [MAIN ] JCE: Wiping existing primary data before full refresh. [2025-09-17T19:46:53.414490] [INFO ] [LOCAL ] JCE: Starting deletion of primary data. [2025-09-17T19:46:53.414894] [DEBUG] [LOCAL ] JCE: Deleted primary data file. [2025-09-17T19:46:53.414941] [INFO ] [MAIN ] JCE: Starting full primary refresh. [2025-09-17T19:46:53.789699] [INFO ] [REMOTE ] JCE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:46:54.015791] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-08. [2025-09-17T19:46:54.405601] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T19:46:54.815806] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-05. [2025-09-17T19:46:55.615798] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-11. [2025-09-17T19:46:56.132121] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-17T19:46:56.132985] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T19:46:56.167582] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T19:46:56.415810] [INFO ] [REMOTE ] JCE: Fetching primary data for 2024-12. [2025-09-17T19:46:57.184139] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T19:46:57.215844] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-01. [2025-09-17T19:46:57.844816] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T19:46:58.015837] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-02. [2025-09-17T19:46:58.631683] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T19:46:58.815824] [INFO ] [REMOTE ] JBL: Fetching primary data for 2025-09. [2025-09-17T19:46:59.615806] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-06. [2025-09-17T19:46:59.644757] [INFO ] [REMOTE ] JBL: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T19:46:59.651386] [INFO ] [REMOTE ] JBL: Full fetch complete (69647 records). [2025-09-17T19:46:59.651586] [DEBUG] [VALIDATOR ] JBL: Validating primary data. [2025-09-17T19:47:00.079191] [DEBUG] [VALIDATOR ] JBL: All expected trading days are present. [2025-09-17T19:47:00.079335] [DEBUG] [VALIDATOR ] JBL: Primary data validation passed. [2025-09-17T19:47:00.080734] [INFO ] [MAIN ] JBL: Fetched primary data is valid. [2025-09-17T19:47:00.080799] [DEBUG] [LOCAL ] JBL: Saving primary data. [2025-09-17T19:47:00.082988] [DEBUG] [LOCAL ] JBL: Trimmed 69647 records to 48361 (keeping 200 days of data) [2025-09-17T19:47:00.410383] [DEBUG] [LOCAL ] JBL: Primary data saved (48361 records). [2025-09-17T19:47:00.410557] [INFO ] [MAIN ] JBL: Full history saved. [2025-09-17T19:47:00.410681] [INFO ] [MAIN ] Update Progress: 1143/2371 symbols completed. JBL took 50.0s. Estimated remaining: 2h 59m 24s. Rate: 6.8 symbols/min [2025-09-17T19:47:00.422466] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-03. [2025-09-17T19:47:00.588040] [INFO ] [MAIN ] JCI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:47:00.588323] [DEBUG] [LOCAL ] JCI: No existing data file found in primary storage. [2025-09-17T19:47:00.588364] [WARN ] [MAIN ] JCI: No existing data found, performing full refresh instead. [2025-09-17T19:47:00.588496] [INFO ] [MAIN ] JCI: Wiping existing primary data before full refresh. [2025-09-17T19:47:00.588535] [INFO ] [LOCAL ] JCI: Starting deletion of primary data. [2025-09-17T19:47:00.588574] [DEBUG] [LOCAL ] JCI: No primary data file found to delete. [2025-09-17T19:47:00.588608] [INFO ] [MAIN ] JCI: Starting full primary refresh. [2025-09-17T19:47:00.946336] [INFO ] [REMOTE ] JCI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:47:00.953190] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T19:47:01.215799] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-04. [2025-09-17T19:47:01.283665] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T19:47:01.645147] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T19:47:02.015810] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-07. [2025-09-17T19:47:02.815857] [INFO ] [REMOTE ] JBND: Fetching primary data for 2025-09. [2025-09-17T19:47:03.478326] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T19:47:03.497583] [INFO ] [REMOTE ] JBND: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T19:47:03.502195] [INFO ] [REMOTE ] JBND: Full fetch complete (32652 records). [2025-09-17T19:47:03.502271] [DEBUG] [VALIDATOR ] JBND: Validating primary data. [2025-09-17T19:47:03.620850] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-05. [2025-09-17T19:47:03.883829] [DEBUG] [VALIDATOR ] JBND: All expected trading days are present. [2025-09-17T19:47:03.883929] [DEBUG] [VALIDATOR ] JBND: Primary data validation passed. [2025-09-17T19:47:03.884560] [INFO ] [MAIN ] JBND: Fetched primary data is valid. [2025-09-17T19:47:03.884603] [DEBUG] [LOCAL ] JBND: Saving primary data. [2025-09-17T19:47:03.885677] [DEBUG] [LOCAL ] JBND: Trimmed 32652 records to 25102 (keeping 200 days of data) [2025-09-17T19:47:04.045615] [DEBUG] [LOCAL ] JBND: Primary data saved (25102 records). [2025-09-17T19:47:04.045804] [INFO ] [MAIN ] JBND: Full history saved. [2025-09-17T19:47:04.045904] [INFO ] [MAIN ] Update Progress: 1144/2371 symbols completed. JBND took 42.2s. Estimated remaining: 2h 59m 9s. Rate: 6.8 symbols/min [2025-09-17T19:47:04.220700] [INFO ] [MAIN ] JEF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:47:04.236167] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T19:47:04.273463] [DEBUG] [LOCAL ] JEF: Loaded 49988 existing records from primary storage. [2025-09-17T19:47:04.273683] [INFO ] [MAIN ] JEF: Loaded 49988 existing records. [2025-09-17T19:47:04.426864] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-11. [2025-09-17T19:47:04.471208] [WARN ] [MAIN ] JEF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:47:04.471476] [INFO ] [MAIN ] JEF: Wiping existing primary data before full refresh. [2025-09-17T19:47:04.471531] [INFO ] [LOCAL ] JEF: Starting deletion of primary data. [2025-09-17T19:47:04.472753] [DEBUG] [LOCAL ] JEF: Deleted primary data file. [2025-09-17T19:47:04.472817] [INFO ] [MAIN ] JEF: Starting full primary refresh. [2025-09-17T19:47:04.857515] [INFO ] [REMOTE ] JEF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:47:05.215783] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-06. [2025-09-17T19:47:05.754577] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T19:47:06.015785] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-08. [2025-09-17T19:47:06.414512] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T19:47:06.815792] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-07. [2025-09-17T19:47:07.125208] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T19:47:07.529752] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T19:47:07.615808] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-11. [2025-09-17T19:47:08.415815] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-08. [2025-09-17T19:47:09.059765] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T19:47:09.215783] [INFO ] [REMOTE ] JCI: Fetching primary data for 2024-12. [2025-09-17T19:47:09.374307] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T19:47:10.016050] [INFO ] [REMOTE ] JBTM: Fetching primary data for 2025-09. [2025-09-17T19:47:10.680633] [INFO ] [REMOTE ] JBTM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T19:47:10.685138] [INFO ] [REMOTE ] JBTM: Full fetch complete (40767 records). [2025-09-17T19:47:10.685295] [DEBUG] [VALIDATOR ] JBTM: Validating primary data. [2025-09-17T19:47:10.817759] [INFO ] [REMOTE ] JEF: Fetching primary data for 2024-12. [2025-09-17T19:47:10.888511] [WARN ] [VALIDATOR ] JBTM: Validation failed - insufficient historical data. Have 176 unique days, need 200 days [2025-09-17T19:47:10.889875] [FATAL] [MAIN ] JBTM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:47:10.890232] [WARN ] [MAIN ] JBTM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:47:10.890469] [INFO ] [LOCAL ] JBTM: Starting deletion of primary data. [2025-09-17T19:47:10.890621] [DEBUG] [LOCAL ] JBTM: No primary data file found to delete. [2025-09-17T19:47:10.890697] [INFO ] [LOCAL ] JBTM: Starting deletion of derivative data. [2025-09-17T19:47:10.890772] [DEBUG] [LOCAL ] JBTM: No derivative data file found to delete. [2025-09-17T19:47:10.890926] [INFO ] [MAIN ] Update Progress: 1145/2371 symbols completed. JBTM took 34.6s. Estimated remaining: 2h 58m 58s. Rate: 6.9 symbols/min [2025-09-17T19:47:11.067179] [INFO ] [MAIN ] JELD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:47:11.101804] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T19:47:11.150505] [DEBUG] [LOCAL ] JELD: Loaded 46260 existing records from primary storage. [2025-09-17T19:47:11.150715] [INFO ] [MAIN ] JELD: Loaded 46260 existing records. [2025-09-17T19:47:11.338011] [WARN ] [MAIN ] JELD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:47:11.338341] [INFO ] [MAIN ] JELD: Wiping existing primary data before full refresh. [2025-09-17T19:47:11.338390] [INFO ] [LOCAL ] JELD: Starting deletion of primary data. [2025-09-17T19:47:11.339294] [DEBUG] [LOCAL ] JELD: Deleted primary data file. [2025-09-17T19:47:11.339346] [INFO ] [MAIN ] JELD: Starting full primary refresh. [2025-09-17T19:47:11.624733] [INFO ] [REMOTE ] JCE: Fetching primary data for 2025-09. [2025-09-17T19:47:11.709464] [INFO ] [REMOTE ] JELD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:47:12.137389] [INFO ] [REMOTE ] JCE: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T19:47:12.139288] [INFO ] [REMOTE ] JCE: Full fetch complete (8867 records). [2025-09-17T19:47:12.139362] [DEBUG] [VALIDATOR ] JCE: Validating primary data. [2025-09-17T19:47:12.423581] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-01. [2025-09-17T19:47:12.510118] [DEBUG] [VALIDATOR ] JCE: All expected trading days are present. [2025-09-17T19:47:12.510287] [DEBUG] [VALIDATOR ] JCE: Primary data validation passed. [2025-09-17T19:47:12.510661] [INFO ] [MAIN ] JCE: Fetched primary data is valid. [2025-09-17T19:47:12.510722] [DEBUG] [LOCAL ] JCE: Saving primary data. [2025-09-17T19:47:12.511398] [DEBUG] [LOCAL ] JCE: Trimmed 8867 records to 6333 (keeping 200 days of data) [2025-09-17T19:47:12.553213] [DEBUG] [LOCAL ] JCE: Primary data saved (6333 records). [2025-09-17T19:47:12.553369] [INFO ] [MAIN ] JCE: Full history saved. [2025-09-17T19:47:12.553476] [INFO ] [MAIN ] Update Progress: 1146/2371 symbols completed. JCE took 19.5s. Estimated remaining: 2h 58m 42s. Rate: 6.9 symbols/min [2025-09-17T19:47:12.724684] [INFO ] [MAIN ] JEQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:47:12.755956] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T19:47:12.772636] [DEBUG] [LOCAL ] JEQ: Loaded 8973 existing records from primary storage. [2025-09-17T19:47:12.772857] [INFO ] [MAIN ] JEQ: Loaded 8973 existing records. [2025-09-17T19:47:12.960540] [WARN ] [MAIN ] JEQ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:47:12.960916] [INFO ] [MAIN ] JEQ: Wiping existing primary data before full refresh. [2025-09-17T19:47:12.960967] [INFO ] [LOCAL ] JEQ: Starting deletion of primary data. [2025-09-17T19:47:12.961307] [DEBUG] [LOCAL ] JEQ: Deleted primary data file. [2025-09-17T19:47:12.961353] [INFO ] [MAIN ] JEQ: Starting full primary refresh. [2025-09-17T19:47:13.220991] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-11. [2025-09-17T19:47:13.350873] [INFO ] [REMOTE ] JEQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:47:14.015755] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-11. [2025-09-17T19:47:14.059712] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T19:47:14.568731] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T19:47:14.802942] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T19:47:14.815666] [INFO ] [REMOTE ] JELD: Fetching primary data for 2024-12. [2025-09-17T19:47:15.615842] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-02. [2025-09-17T19:47:16.172060] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T19:47:16.415805] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2024-12. [2025-09-17T19:47:17.007022] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T19:47:17.009345] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T19:47:17.215824] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-01. [2025-09-17T19:47:18.015787] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-01. [2025-09-17T19:47:18.620364] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T19:47:18.687991] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T19:47:18.815816] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-01. [2025-09-17T19:47:19.615834] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-02. [2025-09-17T19:47:20.415764] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-02. [2025-09-17T19:47:20.570318] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T19:47:20.654379] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T19:47:20.810205] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-17T19:47:21.215831] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-03. [2025-09-17T19:47:22.015780] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-02. [2025-09-17T19:47:22.646517] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T19:47:22.815784] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-04. [2025-09-17T19:47:23.615809] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-03. [2025-09-17T19:47:23.686606] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T19:47:24.310839] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T19:47:24.415830] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-03. [2025-09-17T19:47:25.111012] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T19:47:25.215812] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-03. [2025-09-17T19:47:26.015824] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-04. [2025-09-17T19:47:26.207928] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T19:47:26.234930] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T19:47:26.815832] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-04. [2025-09-17T19:47:27.615821] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-04. [2025-09-17T19:47:27.618705] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T19:47:27.945599] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T19:47:28.415800] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-05. [2025-09-17T19:47:29.215777] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-05. [2025-09-17T19:47:29.380050] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T19:47:29.636432] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T19:47:29.959876] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T19:47:30.015782] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-05. [2025-09-17T19:47:30.815776] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-06. [2025-09-17T19:47:31.615776] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-05. [2025-09-17T19:47:31.945144] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T19:47:32.423703] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-06. [2025-09-17T19:47:32.429986] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T19:47:32.957157] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T19:47:33.043477] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T19:47:33.215790] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-07. [2025-09-17T19:47:33.697828] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T19:47:34.015751] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-08. [2025-09-17T19:47:34.807408] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T19:47:34.815674] [INFO ] [REMOTE ] JEQ: Fetching primary data for 2025-09. [2025-09-17T19:47:35.252103] [INFO ] [REMOTE ] JEQ: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T19:47:35.253601] [INFO ] [REMOTE ] JEQ: Full fetch complete (11250 records). [2025-09-17T19:47:35.253689] [DEBUG] [VALIDATOR ] JEQ: Validating primary data. [2025-09-17T19:47:35.614297] [DEBUG] [VALIDATOR ] JEQ: All expected trading days are present. [2025-09-17T19:47:35.614377] [DEBUG] [VALIDATOR ] JEQ: Primary data validation passed. [2025-09-17T19:47:35.614736] [INFO ] [MAIN ] JEQ: Fetched primary data is valid. [2025-09-17T19:47:35.614795] [DEBUG] [LOCAL ] JEQ: Saving primary data. [2025-09-17T19:47:35.615300] [DEBUG] [LOCAL ] JEQ: Trimmed 11250 records to 8997 (keeping 200 days of data) [2025-09-17T19:47:35.615798] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-07. [2025-09-17T19:47:35.669204] [DEBUG] [LOCAL ] JEQ: Primary data saved (8997 records). [2025-09-17T19:47:35.669337] [INFO ] [MAIN ] JEQ: Full history saved. [2025-09-17T19:47:35.669422] [INFO ] [MAIN ] Update Progress: 1147/2371 symbols completed. JEQ took 23.1s. Estimated remaining: 2h 58m 49s. Rate: 6.8 symbols/min [2025-09-17T19:47:35.842841] [INFO ] [MAIN ] JFR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:47:35.874023] [DEBUG] [LOCAL ] JFR: Loaded 30705 existing records from primary storage. [2025-09-17T19:47:35.874187] [INFO ] [MAIN ] JFR: Loaded 30705 existing records. [2025-09-17T19:47:36.050828] [WARN ] [MAIN ] JFR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:47:36.051176] [INFO ] [MAIN ] JFR: Wiping existing primary data before full refresh. [2025-09-17T19:47:36.051229] [INFO ] [LOCAL ] JFR: Starting deletion of primary data. [2025-09-17T19:47:36.051997] [DEBUG] [LOCAL ] JFR: Deleted primary data file. [2025-09-17T19:47:36.052054] [INFO ] [MAIN ] JFR: Starting full primary refresh. [2025-09-17T19:47:36.406475] [INFO ] [REMOTE ] JFR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:47:36.415722] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-11. [2025-09-17T19:47:37.215785] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-06. [2025-09-17T19:47:37.287867] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T19:47:37.346697] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T19:47:38.015767] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-08. [2025-09-17T19:47:38.710035] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T19:47:38.815773] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-06. [2025-09-17T19:47:39.615773] [INFO ] [REMOTE ] JFR: Fetching primary data for 2024-12. [2025-09-17T19:47:39.686000] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T19:47:40.415804] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-07. [2025-09-17T19:47:40.497050] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T19:47:41.100988] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T19:47:41.215849] [INFO ] [REMOTE ] JELD: Fetching primary data for 2025-09. [2025-09-17T19:47:41.915191] [INFO ] [REMOTE ] JELD: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:47:41.922557] [INFO ] [REMOTE ] JELD: Full fetch complete (63008 records). [2025-09-17T19:47:41.922865] [DEBUG] [VALIDATOR ] JELD: Validating primary data. [2025-09-17T19:47:42.027524] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-07. [2025-09-17T19:47:42.358233] [DEBUG] [VALIDATOR ] JELD: All expected trading days are present. [2025-09-17T19:47:42.358437] [DEBUG] [VALIDATOR ] JELD: Primary data validation passed. [2025-09-17T19:47:42.360200] [INFO ] [MAIN ] JELD: Fetched primary data is valid. [2025-09-17T19:47:42.372108] [DEBUG] [LOCAL ] JELD: Saving primary data. [2025-09-17T19:47:42.394949] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T19:47:42.395173] [DEBUG] [LOCAL ] JELD: Trimmed 63008 records to 46226 (keeping 200 days of data) [2025-09-17T19:47:42.704191] [DEBUG] [LOCAL ] JELD: Primary data saved (46226 records). [2025-09-17T19:47:42.704418] [INFO ] [MAIN ] JELD: Full history saved. [2025-09-17T19:47:42.704544] [INFO ] [MAIN ] Update Progress: 1148/2371 symbols completed. JELD took 31.8s. Estimated remaining: 2h 58m 38s. Rate: 6.8 symbols/min [2025-09-17T19:47:42.815940] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-01. [2025-09-17T19:47:42.893233] [INFO ] [MAIN ] JGH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:47:42.908761] [DEBUG] [LOCAL ] JGH: Loaded 10937 existing records from primary storage. [2025-09-17T19:47:42.908969] [INFO ] [MAIN ] JGH: Loaded 10937 existing records. [2025-09-17T19:47:43.094748] [WARN ] [MAIN ] JGH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:47:43.095087] [INFO ] [MAIN ] JGH: Wiping existing primary data before full refresh. [2025-09-17T19:47:43.095134] [INFO ] [LOCAL ] JGH: Starting deletion of primary data. [2025-09-17T19:47:43.095485] [DEBUG] [LOCAL ] JGH: Deleted primary data file. [2025-09-17T19:47:43.095531] [INFO ] [MAIN ] JGH: Starting full primary refresh. [2025-09-17T19:47:43.515687] [INFO ] [REMOTE ] JGH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:47:43.587158] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T19:47:43.615701] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-08. [2025-09-17T19:47:44.277540] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T19:47:44.415804] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-08. [2025-09-17T19:47:45.215918] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-02. [2025-09-17T19:47:45.311693] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T19:47:46.015865] [INFO ] [REMOTE ] JEF: Fetching primary data for 2025-09. [2025-09-17T19:47:46.292988] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T19:47:46.574120] [INFO ] [REMOTE ] JEF: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T19:47:46.584737] [INFO ] [REMOTE ] JEF: Full fetch complete (72602 records). [2025-09-17T19:47:46.585030] [DEBUG] [VALIDATOR ] JEF: Validating primary data. [2025-09-17T19:47:46.837400] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-11. [2025-09-17T19:47:47.048551] [DEBUG] [VALIDATOR ] JEF: All expected trading days are present. [2025-09-17T19:47:47.048910] [DEBUG] [VALIDATOR ] JEF: Primary data validation passed. [2025-09-17T19:47:47.050406] [INFO ] [MAIN ] JEF: Fetched primary data is valid. [2025-09-17T19:47:47.050912] [DEBUG] [LOCAL ] JEF: Saving primary data. [2025-09-17T19:47:47.052723] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T19:47:47.062939] [DEBUG] [LOCAL ] JEF: Trimmed 72602 records to 50005 (keeping 200 days of data) [2025-09-17T19:47:47.401521] [DEBUG] [LOCAL ] JEF: Primary data saved (50005 records). [2025-09-17T19:47:47.401758] [INFO ] [MAIN ] JEF: Full history saved. [2025-09-17T19:47:47.402573] [INFO ] [MAIN ] Update Progress: 1149/2371 symbols completed. JEF took 43.4s. Estimated remaining: 2h 58m 25s. Rate: 6.8 symbols/min [2025-09-17T19:47:47.596915] [INFO ] [MAIN ] JHG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:47:47.615857] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-03. [2025-09-17T19:47:47.656103] [DEBUG] [LOCAL ] JHG: Loaded 48272 existing records from primary storage. [2025-09-17T19:47:47.656362] [INFO ] [MAIN ] JHG: Loaded 48272 existing records. [2025-09-17T19:47:47.851050] [WARN ] [MAIN ] JHG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:47:47.861896] [INFO ] [MAIN ] JHG: Wiping existing primary data before full refresh. [2025-09-17T19:47:47.862794] [INFO ] [LOCAL ] JHG: Starting deletion of primary data. [2025-09-17T19:47:47.863273] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T19:47:47.867205] [DEBUG] [LOCAL ] JHG: Deleted primary data file. [2025-09-17T19:47:47.867371] [INFO ] [MAIN ] JHG: Starting full primary refresh. [2025-09-17T19:47:48.264397] [INFO ] [REMOTE ] JHG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:47:48.415840] [INFO ] [REMOTE ] JGH: Fetching primary data for 2024-12. [2025-09-17T19:47:48.743662] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T19:47:49.173957] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T19:47:49.215783] [INFO ] [REMOTE ] JCI: Fetching primary data for 2025-09. [2025-09-17T19:47:50.015871] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-01. [2025-09-17T19:47:50.602059] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T19:47:50.815823] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-11. [2025-09-17T19:47:51.067483] [INFO ] [REMOTE ] JCI: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T19:47:51.075889] [INFO ] [REMOTE ] JCI: Full fetch complete (77235 records). [2025-09-17T19:47:51.076042] [DEBUG] [VALIDATOR ] JCI: Validating primary data. [2025-09-17T19:47:51.540866] [DEBUG] [VALIDATOR ] JCI: All expected trading days are present. [2025-09-17T19:47:51.540985] [DEBUG] [VALIDATOR ] JCI: Primary data validation passed. [2025-09-17T19:47:51.542068] [INFO ] [MAIN ] JCI: Fetched primary data is valid. [2025-09-17T19:47:51.542120] [DEBUG] [LOCAL ] JCI: Saving primary data. [2025-09-17T19:47:51.543737] [DEBUG] [LOCAL ] JCI: Trimmed 77235 records to 53550 (keeping 200 days of data) [2025-09-17T19:47:51.617542] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-04. [2025-09-17T19:47:51.919369] [DEBUG] [LOCAL ] JCI: Primary data saved (53550 records). [2025-09-17T19:47:51.919562] [INFO ] [MAIN ] JCI: Full history saved. [2025-09-17T19:47:51.919666] [INFO ] [MAIN ] Update Progress: 1150/2371 symbols completed. JCI took 51.5s. Estimated remaining: 2h 58m 12s. Rate: 6.9 symbols/min [2025-09-17T19:47:52.105105] [INFO ] [MAIN ] JHI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:47:52.112448] [DEBUG] [LOCAL ] JHI: Loaded 3757 existing records from primary storage. [2025-09-17T19:47:52.112612] [INFO ] [MAIN ] JHI: Loaded 3757 existing records. [2025-09-17T19:47:52.307307] [WARN ] [MAIN ] JHI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:47:52.307996] [INFO ] [MAIN ] JHI: Wiping existing primary data before full refresh. [2025-09-17T19:47:52.308114] [INFO ] [LOCAL ] JHI: Starting deletion of primary data. [2025-09-17T19:47:52.308523] [DEBUG] [LOCAL ] JHI: Deleted primary data file. [2025-09-17T19:47:52.308710] [INFO ] [MAIN ] JHI: Starting full primary refresh. [2025-09-17T19:47:52.416866] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-02. [2025-09-17T19:47:52.642280] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T19:47:52.733769] [INFO ] [REMOTE ] JHI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:47:52.760833] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T19:47:53.061403] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T19:47:53.215791] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-11. [2025-09-17T19:47:53.673006] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T19:47:54.015805] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-03. [2025-09-17T19:47:54.746197] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T19:47:54.815827] [INFO ] [REMOTE ] JHG: Fetching primary data for 2024-12. [2025-09-17T19:47:55.615863] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-05. [2025-09-17T19:47:56.415834] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-04. [2025-09-17T19:47:56.449566] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T19:47:56.784549] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T19:47:57.223802] [INFO ] [REMOTE ] JHI: Fetching primary data for 2024-12. [2025-09-17T19:47:57.225884] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T19:47:57.702701] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T19:47:58.015831] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-05. [2025-09-17T19:47:58.805182] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T19:47:58.815704] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-06. [2025-09-17T19:47:59.567394] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T19:47:59.615776] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-07. [2025-09-17T19:48:00.415807] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-01. [2025-09-17T19:48:00.600442] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T19:48:01.011736] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T19:48:01.215800] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-02. [2025-09-17T19:48:02.015827] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-06. [2025-09-17T19:48:02.815793] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-01. [2025-09-17T19:48:03.311835] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T19:48:03.615791] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-03. [2025-09-17T19:48:04.415780] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-08. [2025-09-17T19:48:04.431564] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T19:48:05.119935] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-06 (3.10 seconds). [2025-09-17T19:48:05.215827] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-04. [2025-09-17T19:48:05.271845] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T19:48:05.438956] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-17T19:48:05.876135] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T19:48:06.015826] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-05. [2025-09-17T19:48:06.497406] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T19:48:06.815790] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-07. [2025-09-17T19:48:07.615829] [INFO ] [REMOTE ] JGH: Fetching primary data for 2025-09. [2025-09-17T19:48:08.164284] [INFO ] [REMOTE ] JGH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T19:48:08.166934] [INFO ] [REMOTE ] JGH: Full fetch complete (14608 records). [2025-09-17T19:48:08.167036] [DEBUG] [VALIDATOR ] JGH: Validating primary data. [2025-09-17T19:48:08.423054] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-02. [2025-09-17T19:48:08.569469] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T19:48:08.576025] [DEBUG] [VALIDATOR ] JGH: All expected trading days are present. [2025-09-17T19:48:08.576389] [DEBUG] [VALIDATOR ] JGH: Primary data validation passed. [2025-09-17T19:48:08.576871] [INFO ] [MAIN ] JGH: Fetched primary data is valid. [2025-09-17T19:48:08.576942] [DEBUG] [LOCAL ] JGH: Saving primary data. [2025-09-17T19:48:08.578006] [DEBUG] [LOCAL ] JGH: Trimmed 14608 records to 10962 (keeping 200 days of data) [2025-09-17T19:48:08.648956] [DEBUG] [LOCAL ] JGH: Primary data saved (10962 records). [2025-09-17T19:48:08.649121] [INFO ] [MAIN ] JGH: Full history saved. [2025-09-17T19:48:08.649209] [INFO ] [MAIN ] Update Progress: 1151/2371 symbols completed. JGH took 25.9s. Estimated remaining: 2h 58m 11s. Rate: 6.8 symbols/min [2025-09-17T19:48:08.826093] [INFO ] [MAIN ] JHS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:48:08.830849] [DEBUG] [LOCAL ] JHS: Loaded 2951 existing records from primary storage. [2025-09-17T19:48:08.830942] [INFO ] [MAIN ] JHS: Loaded 2951 existing records. [2025-09-17T19:48:09.009182] [WARN ] [MAIN ] JHS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:48:09.009450] [INFO ] [MAIN ] JHS: Wiping existing primary data before full refresh. [2025-09-17T19:48:09.009498] [INFO ] [LOCAL ] JHS: Starting deletion of primary data. [2025-09-17T19:48:09.009750] [DEBUG] [LOCAL ] JHS: Deleted primary data file. [2025-09-17T19:48:09.009800] [INFO ] [MAIN ] JHS: Starting full primary refresh. [2025-09-17T19:48:09.220853] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-06. [2025-09-17T19:48:09.368214] [INFO ] [REMOTE ] JHS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:48:09.640342] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T19:48:09.666017] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T19:48:10.015792] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-08. [2025-09-17T19:48:10.815837] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-07. [2025-09-17T19:48:11.281123] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T19:48:11.334220] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T19:48:11.615799] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-11. [2025-09-17T19:48:12.059220] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T19:48:12.415800] [INFO ] [REMOTE ] JHS: Fetching primary data for 2024-12. [2025-09-17T19:48:12.887716] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T19:48:13.215783] [INFO ] [REMOTE ] JFR: Fetching primary data for 2025-09. [2025-09-17T19:48:13.750413] [INFO ] [REMOTE ] JFR: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T19:48:13.754625] [INFO ] [REMOTE ] JFR: Full fetch complete (47898 records). [2025-09-17T19:48:13.754738] [DEBUG] [VALIDATOR ] JFR: Validating primary data. [2025-09-17T19:48:14.020923] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-01. [2025-09-17T19:48:14.133147] [DEBUG] [VALIDATOR ] JFR: All expected trading days are present. [2025-09-17T19:48:14.133229] [DEBUG] [VALIDATOR ] JFR: Primary data validation passed. [2025-09-17T19:48:14.134017] [INFO ] [MAIN ] JFR: Fetched primary data is valid. [2025-09-17T19:48:14.134064] [DEBUG] [LOCAL ] JFR: Saving primary data. [2025-09-17T19:48:14.135179] [DEBUG] [LOCAL ] JFR: Trimmed 47898 records to 30653 (keeping 200 days of data) [2025-09-17T19:48:14.323240] [DEBUG] [LOCAL ] JFR: Primary data saved (30653 records). [2025-09-17T19:48:14.323393] [INFO ] [MAIN ] JFR: Full history saved. [2025-09-17T19:48:14.323482] [INFO ] [MAIN ] Update Progress: 1152/2371 symbols completed. JFR took 38.7s. Estimated remaining: 2h 57m 59s. Rate: 6.8 symbols/min [2025-09-17T19:48:14.494069] [INFO ] [MAIN ] JHX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:48:14.539015] [DEBUG] [LOCAL ] JHX: Loaded 48640 existing records from primary storage. [2025-09-17T19:48:14.539166] [INFO ] [MAIN ] JHX: Loaded 48640 existing records. [2025-09-17T19:48:14.716185] [WARN ] [MAIN ] JHX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:48:14.716669] [INFO ] [MAIN ] JHX: Wiping existing primary data before full refresh. [2025-09-17T19:48:14.716727] [INFO ] [LOCAL ] JHX: Starting deletion of primary data. [2025-09-17T19:48:14.717696] [DEBUG] [LOCAL ] JHX: Deleted primary data file. [2025-09-17T19:48:14.717748] [INFO ] [MAIN ] JHX: Starting full primary refresh. [2025-09-17T19:48:14.818425] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-03. [2025-09-17T19:48:15.078027] [INFO ] [REMOTE ] JHX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:48:15.351048] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T19:48:15.615793] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-08. [2025-09-17T19:48:16.377074] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T19:48:16.415798] [INFO ] [REMOTE ] JHI: Fetching primary data for 2025-09. [2025-09-17T19:48:16.941383] [INFO ] [REMOTE ] JHI: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T19:48:16.943878] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-03 (2.13 seconds). [2025-09-17T19:48:16.957270] [INFO ] [REMOTE ] JHI: Full fetch complete (5276 records). [2025-09-17T19:48:16.958542] [DEBUG] [VALIDATOR ] JHI: Validating primary data. [2025-09-17T19:48:17.225006] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-11. [2025-09-17T19:48:17.355862] [DEBUG] [VALIDATOR ] JHI: All expected trading days are present. [2025-09-17T19:48:17.355951] [DEBUG] [VALIDATOR ] JHI: Primary data validation passed. [2025-09-17T19:48:17.356151] [INFO ] [MAIN ] JHI: Fetched primary data is valid. [2025-09-17T19:48:17.356212] [DEBUG] [LOCAL ] JHI: Saving primary data. [2025-09-17T19:48:17.356685] [DEBUG] [LOCAL ] JHI: Trimmed 5276 records to 3756 (keeping 200 days of data) [2025-09-17T19:48:17.383160] [DEBUG] [LOCAL ] JHI: Primary data saved (3756 records). [2025-09-17T19:48:17.383335] [INFO ] [MAIN ] JHI: Full history saved. [2025-09-17T19:48:17.383505] [INFO ] [MAIN ] Update Progress: 1153/2371 symbols completed. JHI took 25.5s. Estimated remaining: 2h 57m 45s. Rate: 6.9 symbols/min [2025-09-17T19:48:17.553817] [INFO ] [MAIN ] JILL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:48:17.571557] [DEBUG] [LOCAL ] JILL: Loaded 16699 existing records from primary storage. [2025-09-17T19:48:17.571712] [INFO ] [MAIN ] JILL: Loaded 16699 existing records. [2025-09-17T19:48:17.750533] [WARN ] [MAIN ] JILL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:48:17.750822] [INFO ] [MAIN ] JILL: Wiping existing primary data before full refresh. [2025-09-17T19:48:17.750868] [INFO ] [LOCAL ] JILL: Starting deletion of primary data. [2025-09-17T19:48:17.751342] [DEBUG] [LOCAL ] JILL: Deleted primary data file. [2025-09-17T19:48:17.751395] [INFO ] [MAIN ] JILL: Starting full primary refresh. [2025-09-17T19:48:18.023350] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-04. [2025-09-17T19:48:18.119246] [INFO ] [REMOTE ] JILL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:48:18.199222] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T19:48:18.815795] [INFO ] [REMOTE ] JHX: Fetching primary data for 2024-12. [2025-09-17T19:48:19.615784] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-11. [2025-09-17T19:48:19.816028] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T19:48:19.837822] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T19:48:20.415773] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-01. [2025-09-17T19:48:20.607941] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T19:48:21.215788] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-05. [2025-09-17T19:48:21.380815] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T19:48:22.015824] [INFO ] [REMOTE ] JILL: Fetching primary data for 2024-12. [2025-09-17T19:48:22.815992] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-02. [2025-09-17T19:48:23.004153] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T19:48:23.026137] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T19:48:23.461475] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T19:48:23.615790] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-01. [2025-09-17T19:48:24.415783] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-03. [2025-09-17T19:48:24.438954] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T19:48:24.868488] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T19:48:25.215804] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-06. [2025-09-17T19:48:26.015787] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-02. [2025-09-17T19:48:26.757709] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T19:48:26.815800] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-04. [2025-09-17T19:48:26.854447] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T19:48:27.448766] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T19:48:27.615800] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-02. [2025-09-17T19:48:28.283059] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T19:48:28.415783] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-03. [2025-09-17T19:48:29.215804] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-05. [2025-09-17T19:48:29.552042] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T19:48:29.707268] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T19:48:30.015785] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-04. [2025-09-17T19:48:30.797587] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T19:48:30.815773] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-05. [2025-09-17T19:48:31.442068] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T19:48:31.615774] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-06. [2025-09-17T19:48:31.979388] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-06 (0.36 seconds). [2025-09-17T19:48:32.415801] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-03. [2025-09-17T19:48:33.215752] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-06. [2025-09-17T19:48:33.590897] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T19:48:34.015760] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-07. [2025-09-17T19:48:34.334522] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T19:48:34.605260] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T19:48:34.815773] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-07. [2025-09-17T19:48:35.615792] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-04. [2025-09-17T19:48:35.732897] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T19:48:36.415807] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-08. [2025-09-17T19:48:36.936883] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-08 (0.52 seconds). [2025-09-17T19:48:37.215790] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-07. [2025-09-17T19:48:37.318372] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T19:48:38.015893] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-05. [2025-09-17T19:48:38.559334] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T19:48:38.815824] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-08. [2025-09-17T19:48:39.615797] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-08. [2025-09-17T19:48:39.831805] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T19:48:39.947628] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T19:48:40.264410] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T19:48:40.415804] [INFO ] [REMOTE ] JILL: Fetching primary data for 2025-09. [2025-09-17T19:48:41.170596] [INFO ] [REMOTE ] JILL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T19:48:41.173494] [INFO ] [REMOTE ] JILL: Full fetch complete (23068 records). [2025-09-17T19:48:41.173579] [DEBUG] [VALIDATOR ] JILL: Validating primary data. [2025-09-17T19:48:41.220878] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-06. [2025-09-17T19:48:41.545155] [DEBUG] [VALIDATOR ] JILL: All expected trading days are present. [2025-09-17T19:48:41.545234] [DEBUG] [VALIDATOR ] JILL: Primary data validation passed. [2025-09-17T19:48:41.545761] [INFO ] [MAIN ] JILL: Fetched primary data is valid. [2025-09-17T19:48:41.545818] [DEBUG] [LOCAL ] JILL: Saving primary data. [2025-09-17T19:48:41.546504] [DEBUG] [LOCAL ] JILL: Trimmed 23068 records to 16690 (keeping 200 days of data) [2025-09-17T19:48:41.648981] [DEBUG] [LOCAL ] JILL: Primary data saved (16690 records). [2025-09-17T19:48:41.649129] [INFO ] [MAIN ] JILL: Full history saved. [2025-09-17T19:48:41.649263] [INFO ] [MAIN ] Update Progress: 1154/2371 symbols completed. JILL took 24.3s. Estimated remaining: 2h 57m 52s. Rate: 6.8 symbols/min [2025-09-17T19:48:41.817692] [INFO ] [MAIN ] JKS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:48:41.857727] [DEBUG] [LOCAL ] JKS: Loaded 40291 existing records from primary storage. [2025-09-17T19:48:41.857880] [INFO ] [MAIN ] JKS: Loaded 40291 existing records. [2025-09-17T19:48:42.016943] [INFO ] [REMOTE ] JHG: Fetching primary data for 2025-09. [2025-09-17T19:48:42.038166] [WARN ] [MAIN ] JKS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:48:42.038420] [INFO ] [MAIN ] JKS: Wiping existing primary data before full refresh. [2025-09-17T19:48:42.038465] [INFO ] [LOCAL ] JKS: Starting deletion of primary data. [2025-09-17T19:48:42.039300] [DEBUG] [LOCAL ] JKS: Deleted primary data file. [2025-09-17T19:48:42.039352] [INFO ] [MAIN ] JKS: Starting full primary refresh. [2025-09-17T19:48:42.399883] [INFO ] [REMOTE ] JKS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:48:42.815778] [INFO ] [REMOTE ] JHS: Fetching primary data for 2025-09. [2025-09-17T19:48:42.853445] [INFO ] [REMOTE ] JHG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T19:48:42.859965] [INFO ] [REMOTE ] JHG: Full fetch complete (68519 records). [2025-09-17T19:48:42.860103] [DEBUG] [VALIDATOR ] JHG: Validating primary data. [2025-09-17T19:48:43.092376] [INFO ] [REMOTE ] JHS: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-17T19:48:43.140413] [INFO ] [REMOTE ] JHS: Full fetch complete (4470 records). [2025-09-17T19:48:43.176166] [DEBUG] [VALIDATOR ] JHS: Validating primary data. [2025-09-17T19:48:43.366991] [DEBUG] [VALIDATOR ] JHG: All expected trading days are present. [2025-09-17T19:48:43.390876] [DEBUG] [VALIDATOR ] JHG: Primary data validation passed. [2025-09-17T19:48:43.396205] [INFO ] [MAIN ] JHG: Fetched primary data is valid. [2025-09-17T19:48:43.401925] [DEBUG] [LOCAL ] JHG: Saving primary data. [2025-09-17T19:48:43.560368] [DEBUG] [LOCAL ] JHG: Trimmed 68519 records to 48220 (keeping 200 days of data) [2025-09-17T19:48:43.604443] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-06 (2.38 seconds). [2025-09-17T19:48:43.627878] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-11. [2025-09-17T19:48:43.858428] [DEBUG] [VALIDATOR ] JHS: All expected trading days are present. [2025-09-17T19:48:43.860105] [DEBUG] [VALIDATOR ] JHS: Primary data validation passed. [2025-09-17T19:48:43.869774] [INFO ] [MAIN ] JHS: Fetched primary data is valid. [2025-09-17T19:48:43.870420] [DEBUG] [LOCAL ] JHS: Saving primary data. [2025-09-17T19:48:43.872356] [DEBUG] [LOCAL ] JHS: Trimmed 4470 records to 2928 (keeping 200 days of data) [2025-09-17T19:48:43.897342] [DEBUG] [LOCAL ] JHS: Primary data saved (2928 records). [2025-09-17T19:48:43.910137] [INFO ] [MAIN ] JHS: Full history saved. [2025-09-17T19:48:43.910886] [INFO ] [MAIN ] Update Progress: 1155/2371 symbols completed. JHS took 35.3s. Estimated remaining: 2h 57m 37s. Rate: 6.8 symbols/min [2025-09-17T19:48:44.344967] [INFO ] [MAIN ] JLL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:48:44.412210] [DEBUG] [LOCAL ] JLL: Loaded 32308 existing records from primary storage. [2025-09-17T19:48:44.414819] [INFO ] [MAIN ] JLL: Loaded 32308 existing records. [2025-09-17T19:48:44.421622] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-07. [2025-09-17T19:48:44.714900] [WARN ] [MAIN ] JLL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:48:44.718180] [INFO ] [MAIN ] JLL: Wiping existing primary data before full refresh. [2025-09-17T19:48:44.718873] [INFO ] [LOCAL ] JLL: Starting deletion of primary data. [2025-09-17T19:48:44.721829] [DEBUG] [LOCAL ] JLL: Deleted primary data file. [2025-09-17T19:48:44.722885] [INFO ] [MAIN ] JLL: Starting full primary refresh. [2025-09-17T19:48:44.849522] [DEBUG] [LOCAL ] JHG: Primary data saved (48220 records). [2025-09-17T19:48:44.852437] [INFO ] [MAIN ] JHG: Full history saved. [2025-09-17T19:48:44.853774] [INFO ] [MAIN ] Update Progress: 1156/2371 symbols completed. JHG took 57.5s. Estimated remaining: 2h 57m 20s. Rate: 6.9 symbols/min [2025-09-17T19:48:45.210892] [INFO ] [MAIN ] JLS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:48:45.330193] [DEBUG] [LOCAL ] JLS: Loaded 4101 existing records from primary storage. [2025-09-17T19:48:45.344344] [INFO ] [MAIN ] JLS: Loaded 4101 existing records. [2025-09-17T19:48:45.344140] [INFO ] [REMOTE ] JLL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:48:45.388610] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-11. [2025-09-17T19:48:45.552770] [WARN ] [MAIN ] JLS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:48:45.553114] [INFO ] [MAIN ] JLS: Wiping existing primary data before full refresh. [2025-09-17T19:48:45.553176] [INFO ] [LOCAL ] JLS: Starting deletion of primary data. [2025-09-17T19:48:45.553552] [DEBUG] [LOCAL ] JLS: Deleted primary data file. [2025-09-17T19:48:45.553631] [INFO ] [MAIN ] JLS: Starting full primary refresh. [2025-09-17T19:48:45.701389] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T19:48:45.957762] [INFO ] [REMOTE ] JLS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:48:46.015734] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-11. [2025-09-17T19:48:46.309313] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T19:48:46.523011] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T19:48:46.754361] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T19:48:46.815787] [INFO ] [REMOTE ] JLL: Fetching primary data for 2024-12. [2025-09-17T19:48:47.615749] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-08. [2025-09-17T19:48:48.071019] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T19:48:48.415789] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-01. [2025-09-17T19:48:49.215773] [INFO ] [REMOTE ] JLS: Fetching primary data for 2024-12. [2025-09-17T19:48:49.519455] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T19:48:49.542442] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2024-12 (0.33 seconds). [2025-09-17T19:48:49.577126] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T19:48:50.015788] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-01. [2025-09-17T19:48:50.578270] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T19:48:50.815824] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-02. [2025-09-17T19:48:51.615776] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-02. [2025-09-17T19:48:51.954607] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T19:48:52.155566] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T19:48:52.415794] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-03. [2025-09-17T19:48:53.215808] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-03. [2025-09-17T19:48:53.722621] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T19:48:53.723284] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T19:48:54.015806] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-04. [2025-09-17T19:48:54.815796] [INFO ] [REMOTE ] JKS: Fetching primary data for 2024-12. [2025-09-17T19:48:55.442391] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T19:48:55.615746] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-05. [2025-09-17T19:48:56.218793] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T19:48:56.415824] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-01. [2025-09-17T19:48:57.028668] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T19:48:57.215796] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-06. [2025-09-17T19:48:58.015494] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T19:48:58.023589] [INFO ] [REMOTE ] JHX: Fetching primary data for 2025-09. [2025-09-17T19:48:58.349273] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T19:48:58.815780] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-02. [2025-09-17T19:48:59.015133] [INFO ] [REMOTE ] JHX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T19:48:59.022458] [INFO ] [REMOTE ] JHX: Full fetch complete (55421 records). [2025-09-17T19:48:59.022623] [DEBUG] [VALIDATOR ] JHX: Validating primary data. [2025-09-17T19:48:59.466428] [DEBUG] [VALIDATOR ] JHX: All expected trading days are present. [2025-09-17T19:48:59.466526] [DEBUG] [VALIDATOR ] JHX: Primary data validation passed. [2025-09-17T19:48:59.467480] [INFO ] [MAIN ] JHX: Fetched primary data is valid. [2025-09-17T19:48:59.467533] [DEBUG] [LOCAL ] JHX: Saving primary data. [2025-09-17T19:48:59.469290] [DEBUG] [LOCAL ] JHX: Trimmed 55421 records to 48946 (keeping 200 days of data) [2025-09-17T19:48:59.655999] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-04. [2025-09-17T19:48:59.793859] [DEBUG] [LOCAL ] JHX: Primary data saved (48946 records). [2025-09-17T19:48:59.794128] [INFO ] [MAIN ] JHX: Full history saved. [2025-09-17T19:48:59.794242] [INFO ] [MAIN ] Update Progress: 1157/2371 symbols completed. JHX took 45.5s. Estimated remaining: 2h 57m 17s. Rate: 6.8 symbols/min [2025-09-17T19:49:00.233498] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T19:49:00.348283] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T19:49:00.415799] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-05. [2025-09-17T19:49:01.116944] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T19:49:01.215744] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-06. [2025-09-17T19:49:01.834219] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T19:49:02.015796] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-07. [2025-09-17T19:49:02.815849] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-07. [2025-09-17T19:49:03.397800] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T19:49:03.465326] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T19:49:03.615797] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-03. [2025-09-17T19:49:04.415823] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-08. [2025-09-17T19:49:04.978690] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T19:49:05.215812] [INFO ] [REMOTE ] JLS: Fetching primary data for 2025-09. [2025-09-17T19:49:05.259257] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T19:49:05.658181] [INFO ] [REMOTE ] JLS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T19:49:05.659481] [INFO ] [REMOTE ] JLS: Full fetch complete (5745 records). [2025-09-17T19:49:05.659563] [DEBUG] [VALIDATOR ] JLS: Validating primary data. [2025-09-17T19:49:06.021317] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-08. [2025-09-17T19:49:06.029776] [DEBUG] [VALIDATOR ] JLS: All expected trading days are present. [2025-09-17T19:49:06.029849] [DEBUG] [VALIDATOR ] JLS: Primary data validation passed. [2025-09-17T19:49:06.030029] [INFO ] [MAIN ] JLS: Fetched primary data is valid. [2025-09-17T19:49:06.030068] [DEBUG] [LOCAL ] JLS: Saving primary data. [2025-09-17T19:49:06.030624] [DEBUG] [LOCAL ] JLS: Trimmed 5745 records to 4110 (keeping 200 days of data) [2025-09-17T19:49:06.060842] [DEBUG] [LOCAL ] JLS: Primary data saved (4110 records). [2025-09-17T19:49:06.061020] [INFO ] [MAIN ] JLS: Full history saved. [2025-09-17T19:49:06.061138] [INFO ] [MAIN ] Update Progress: 1158/2371 symbols completed. JLS took 21.2s. Estimated remaining: 2h 57m 6s. Rate: 6.8 symbols/min [2025-09-17T19:49:06.815854] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-04. [2025-09-17T19:49:07.438633] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T19:49:07.615776] [INFO ] [REMOTE ] JLL: Fetching primary data for 2025-09. [2025-09-17T19:49:08.312257] [INFO ] [REMOTE ] JLL: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:49:08.316487] [INFO ] [REMOTE ] JLL: Full fetch complete (44640 records). [2025-09-17T19:49:08.316581] [DEBUG] [VALIDATOR ] JLL: Validating primary data. [2025-09-17T19:49:08.768873] [DEBUG] [VALIDATOR ] JLL: All expected trading days are present. [2025-09-17T19:49:08.769107] [DEBUG] [VALIDATOR ] JLL: Primary data validation passed. [2025-09-17T19:49:08.770285] [INFO ] [MAIN ] JLL: Fetched primary data is valid. [2025-09-17T19:49:08.770370] [DEBUG] [LOCAL ] JLL: Saving primary data. [2025-09-17T19:49:08.800483] [DEBUG] [LOCAL ] JLL: Trimmed 44640 records to 32337 (keeping 200 days of data) [2025-09-17T19:49:08.802088] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T19:49:08.814923] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-05. [2025-09-17T19:49:09.039506] [DEBUG] [LOCAL ] JLL: Primary data saved (32337 records). [2025-09-17T19:49:09.039770] [INFO ] [MAIN ] JLL: Full history saved. [2025-09-17T19:49:09.039881] [INFO ] [MAIN ] Update Progress: 1159/2371 symbols completed. JLL took 25.1s. Estimated remaining: 2h 56m 51s. Rate: 6.9 symbols/min [2025-09-17T19:49:10.397221] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T19:49:10.405737] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-06. [2025-09-17T19:49:11.863554] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T19:49:11.871988] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-07. [2025-09-17T19:49:13.618516] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T19:49:13.627624] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-08. [2025-09-17T19:49:15.068022] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T19:49:15.076152] [INFO ] [REMOTE ] JKS: Fetching primary data for 2025-09. [2025-09-17T19:49:15.820009] [INFO ] [REMOTE ] JKS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T19:49:15.825910] [INFO ] [REMOTE ] JKS: Full fetch complete (59666 records). [2025-09-17T19:49:15.826039] [DEBUG] [VALIDATOR ] JKS: Validating primary data. [2025-09-17T19:49:16.219210] [DEBUG] [VALIDATOR ] JKS: All expected trading days are present. [2025-09-17T19:49:16.219308] [DEBUG] [VALIDATOR ] JKS: Primary data validation passed. [2025-09-17T19:49:16.220202] [INFO ] [MAIN ] JKS: Fetched primary data is valid. [2025-09-17T19:49:16.220249] [DEBUG] [LOCAL ] JKS: Saving primary data. [2025-09-17T19:49:16.221869] [DEBUG] [LOCAL ] JKS: Trimmed 59666 records to 40240 (keeping 200 days of data) [2025-09-17T19:49:16.474498] [DEBUG] [LOCAL ] JKS: Primary data saved (40240 records). [2025-09-17T19:49:16.474670] [INFO ] [MAIN ] JKS: Full history saved. [2025-09-17T19:49:16.474775] [INFO ] [MAIN ] Update Progress: 1160/2371 symbols completed. JKS took 34.8s. Estimated remaining: 2h 56m 41s. Rate: 6.9 symbols/min [2025-09-17T19:49:17.126625] [INFO ] [MAIN ] JMIA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:49:17.127491] [INFO ] [MAIN ] JNJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:49:17.149819] [INFO ] [MAIN ] JMM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:49:17.156593] [DEBUG] [LOCAL ] JMM: No existing data file found in primary storage. [2025-09-17T19:49:17.184044] [INFO ] [MAIN ] JOBY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:49:17.184312] [WARN ] [MAIN ] JMM: No existing data found, performing full refresh instead. [2025-09-17T19:49:17.185371] [INFO ] [MAIN ] JMM: Wiping existing primary data before full refresh. [2025-09-17T19:49:17.185434] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-17T19:49:17.185483] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-17T19:49:17.185517] [INFO ] [MAIN ] JMM: Starting full primary refresh. [2025-09-17T19:49:17.577707] [DEBUG] [LOCAL ] JMIA: Loaded 50420 existing records from primary storage. [2025-09-17T19:49:17.578968] [INFO ] [MAIN ] JMIA: Loaded 50420 existing records. [2025-09-17T19:49:17.600618] [DEBUG] [LOCAL ] JOBY: Loaded 53798 existing records from primary storage. [2025-09-17T19:49:17.700600] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-17T19:49:17.744354] [INFO ] [MAIN ] JOBY: Loaded 53798 existing records. [2025-09-17T19:49:17.763183] [INFO ] [REMOTE ] JMM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:49:17.767018] [INFO ] [MAIN ] JNJ: Loaded 53753 existing records. [2025-09-17T19:49:17.767265] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-11. [2025-09-17T19:49:18.061736] [WARN ] [MAIN ] JMIA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:49:18.140013] [INFO ] [MAIN ] JMIA: Wiping existing primary data before full refresh. [2025-09-17T19:49:18.202563] [INFO ] [LOCAL ] JMIA: Starting deletion of primary data. [2025-09-17T19:49:18.224847] [WARN ] [MAIN ] JNJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:49:18.224664] [WARN ] [MAIN ] JOBY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:49:18.225135] [INFO ] [MAIN ] JNJ: Wiping existing primary data before full refresh. [2025-09-17T19:49:18.225276] [INFO ] [MAIN ] JOBY: Wiping existing primary data before full refresh. [2025-09-17T19:49:18.225318] [INFO ] [LOCAL ] JNJ: Starting deletion of primary data. [2025-09-17T19:49:18.225403] [INFO ] [LOCAL ] JOBY: Starting deletion of primary data. [2025-09-17T19:49:18.226050] [DEBUG] [LOCAL ] JMIA: Deleted primary data file. [2025-09-17T19:49:18.226146] [INFO ] [MAIN ] JMIA: Starting full primary refresh. [2025-09-17T19:49:18.237235] [DEBUG] [LOCAL ] JOBY: Deleted primary data file. [2025-09-17T19:49:18.246690] [DEBUG] [LOCAL ] JNJ: Deleted primary data file. [2025-09-17T19:49:18.246741] [INFO ] [MAIN ] JOBY: Starting full primary refresh. [2025-09-17T19:49:18.275656] [INFO ] [MAIN ] JNJ: Starting full primary refresh. [2025-09-17T19:49:18.572664] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T19:49:18.663402] [INFO ] [REMOTE ] JMM: Fetching primary data for 2024-12. [2025-09-17T19:49:19.235718] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T19:49:19.270225] [INFO ] [REMOTE ] JMIA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:49:19.284377] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-01. [2025-09-17T19:49:19.300151] [INFO ] [REMOTE ] JOBY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:49:19.301801] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-11. [2025-09-17T19:49:19.337892] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-11. [2025-09-17T19:49:19.359971] [INFO ] [REMOTE ] JNJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:49:19.361437] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-11. [2025-09-17T19:49:19.694480] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-17T19:49:19.695740] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-02. [2025-09-17T19:49:20.118486] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T19:49:20.119570] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-03. [2025-09-17T19:49:20.459396] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-17T19:49:20.460385] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-04. [2025-09-17T19:49:21.126369] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T19:49:21.127485] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-05. [2025-09-17T19:49:21.324503] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T19:49:21.334881] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2024-12. [2025-09-17T19:49:21.406747] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T19:49:21.417266] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2024-12. [2025-09-17T19:49:21.545686] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T19:49:21.734064] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-11 (2.40 seconds). [2025-09-17T19:49:22.015809] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2024-12. [2025-09-17T19:49:22.815881] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-06. [2025-09-17T19:49:23.263378] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T19:49:23.265754] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T19:49:23.513534] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-17T19:49:23.615772] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-07. [2025-09-17T19:49:24.178863] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T19:49:24.415783] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-01. [2025-09-17T19:49:24.633896] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2024-12 (2.62 seconds). [2025-09-17T19:49:25.215836] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-01. [2025-09-17T19:49:26.015799] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-01. [2025-09-17T19:49:26.095970] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T19:49:26.815814] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-02. [2025-09-17T19:49:27.615828] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-08. [2025-09-17T19:49:27.746914] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-01 (2.53 seconds). [2025-09-17T19:49:27.901119] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-17T19:49:28.045977] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T19:49:28.224070] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T19:49:28.415808] [INFO ] [REMOTE ] JMM: Fetching primary data for 2025-09. [2025-09-17T19:49:28.694354] [INFO ] [REMOTE ] JMM: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-17T19:49:28.695194] [INFO ] [REMOTE ] JMM: Full fetch complete (2266 records). [2025-09-17T19:49:28.695261] [DEBUG] [VALIDATOR ] JMM: Validating primary data. [2025-09-17T19:49:28.875845] [WARN ] [VALIDATOR ] JMM: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-17T19:49:28.876073] [FATAL] [MAIN ] JMM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:49:28.876116] [WARN ] [MAIN ] JMM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:49:28.876175] [INFO ] [LOCAL ] JMM: Starting deletion of primary data. [2025-09-17T19:49:28.876235] [DEBUG] [LOCAL ] JMM: No primary data file found to delete. [2025-09-17T19:49:28.876272] [INFO ] [LOCAL ] JMM: Starting deletion of derivative data. [2025-09-17T19:49:28.876332] [DEBUG] [LOCAL ] JMM: No derivative data file found to delete. [2025-09-17T19:49:28.876394] [INFO ] [MAIN ] Update Progress: 1161/2371 symbols completed. JMM took 12.4s. Estimated remaining: 2h 56m 36s. Rate: 6.9 symbols/min [2025-09-17T19:49:29.048601] [INFO ] [MAIN ] JOE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:49:29.075184] [DEBUG] [LOCAL ] JOE: Loaded 24912 existing records from primary storage. [2025-09-17T19:49:29.075332] [INFO ] [MAIN ] JOE: Loaded 24912 existing records. [2025-09-17T19:49:29.228207] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-03. [2025-09-17T19:49:29.272616] [WARN ] [MAIN ] JOE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:49:29.272902] [INFO ] [MAIN ] JOE: Wiping existing primary data before full refresh. [2025-09-17T19:49:29.272952] [INFO ] [LOCAL ] JOE: Starting deletion of primary data. [2025-09-17T19:49:29.273608] [DEBUG] [LOCAL ] JOE: Deleted primary data file. [2025-09-17T19:49:29.273681] [INFO ] [MAIN ] JOE: Starting full primary refresh. [2025-09-17T19:49:29.655383] [INFO ] [REMOTE ] JOE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:49:30.015784] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-11. [2025-09-17T19:49:30.815812] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-02. [2025-09-17T19:49:31.072073] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T19:49:31.181415] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T19:49:31.615788] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-02. [2025-09-17T19:49:32.415794] [INFO ] [REMOTE ] JOE: Fetching primary data for 2024-12. [2025-09-17T19:49:33.067299] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-02 (2.25 seconds). [2025-09-17T19:49:33.215775] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-04. [2025-09-17T19:49:33.654823] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T19:49:33.963412] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-17T19:49:34.015775] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-01. [2025-09-17T19:49:34.815781] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-03. [2025-09-17T19:49:35.220277] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T19:49:35.269150] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T19:49:35.615772] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-02. [2025-09-17T19:49:36.415761] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-05. [2025-09-17T19:49:36.710577] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T19:49:37.215778] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-03. [2025-09-17T19:49:37.306473] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-17T19:49:37.815443] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T19:49:38.015790] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-03. [2025-09-17T19:49:38.815694] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-04. [2025-09-17T19:49:39.042943] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T19:49:39.313250] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T19:49:39.615813] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-04. [2025-09-17T19:49:40.415797] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-06. [2025-09-17T19:49:40.944521] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T19:49:41.073431] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-17T19:49:41.215802] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-04. [2025-09-17T19:49:42.015847] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-05. [2025-09-17T19:49:42.204802] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T19:49:42.815833] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-05. [2025-09-17T19:49:43.182618] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T19:49:43.615743] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-05. [2025-09-17T19:49:43.722555] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T19:49:44.170181] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T19:49:44.415814] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-06. [2025-09-17T19:49:45.215758] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-06. [2025-09-17T19:49:45.508442] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T19:49:45.981432] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-17T19:49:46.015737] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-06. [2025-09-17T19:49:46.815774] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-07. [2025-09-17T19:49:47.615806] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-07. [2025-09-17T19:49:48.093467] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T19:49:48.164542] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-06 (2.95 seconds). [2025-09-17T19:49:48.180201] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-17T19:49:48.415779] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-08. [2025-09-17T19:49:49.215800] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-07. [2025-09-17T19:49:49.425544] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T19:49:49.523351] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T19:49:50.015793] [INFO ] [REMOTE ] JOE: Fetching primary data for 2025-09. [2025-09-17T19:49:50.622275] [INFO ] [REMOTE ] JOE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T19:49:50.625834] [INFO ] [REMOTE ] JOE: Full fetch complete (36364 records). [2025-09-17T19:49:50.625941] [DEBUG] [VALIDATOR ] JOE: Validating primary data. [2025-09-17T19:49:50.826449] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-08. [2025-09-17T19:49:51.002237] [DEBUG] [VALIDATOR ] JOE: All expected trading days are present. [2025-09-17T19:49:51.002315] [DEBUG] [VALIDATOR ] JOE: Primary data validation passed. [2025-09-17T19:49:51.002915] [INFO ] [MAIN ] JOE: Fetched primary data is valid. [2025-09-17T19:49:51.002958] [DEBUG] [LOCAL ] JOE: Saving primary data. [2025-09-17T19:49:51.003868] [DEBUG] [LOCAL ] JOE: Trimmed 36364 records to 24848 (keeping 200 days of data) [2025-09-17T19:49:51.190904] [DEBUG] [LOCAL ] JOE: Primary data saved (24848 records). [2025-09-17T19:49:51.191121] [INFO ] [MAIN ] JOE: Full history saved. [2025-09-17T19:49:51.191234] [INFO ] [MAIN ] Update Progress: 1162/2371 symbols completed. JOE took 22.3s. Estimated remaining: 2h 56m 41s. Rate: 6.8 symbols/min [2025-09-17T19:49:51.372939] [INFO ] [MAIN ] JOF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:49:51.382327] [DEBUG] [LOCAL ] JOF: Loaded 7173 existing records from primary storage. [2025-09-17T19:49:51.382482] [INFO ] [MAIN ] JOF: Loaded 7173 existing records. [2025-09-17T19:49:51.571600] [WARN ] [MAIN ] JOF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:49:51.572175] [INFO ] [MAIN ] JOF: Wiping existing primary data before full refresh. [2025-09-17T19:49:51.572284] [INFO ] [LOCAL ] JOF: Starting deletion of primary data. [2025-09-17T19:49:51.572848] [DEBUG] [LOCAL ] JOF: Deleted primary data file. [2025-09-17T19:49:51.572956] [INFO ] [MAIN ] JOF: Starting full primary refresh. [2025-09-17T19:49:51.617435] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-07. [2025-09-17T19:49:51.964005] [INFO ] [REMOTE ] JOF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:49:52.008249] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-17T19:49:52.415756] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-08. [2025-09-17T19:49:52.943477] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-17T19:49:53.215842] [INFO ] [REMOTE ] JMIA: Fetching primary data for 2025-09. [2025-09-17T19:49:54.010886] [INFO ] [REMOTE ] JMIA: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T19:49:54.017196] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-11. [2025-09-17T19:49:54.019111] [INFO ] [REMOTE ] JMIA: Full fetch complete (73061 records). [2025-09-17T19:49:54.019216] [DEBUG] [VALIDATOR ] JMIA: Validating primary data. [2025-09-17T19:49:54.425707] [DEBUG] [VALIDATOR ] JMIA: All expected trading days are present. [2025-09-17T19:49:54.425891] [DEBUG] [VALIDATOR ] JMIA: Primary data validation passed. [2025-09-17T19:49:54.426989] [INFO ] [MAIN ] JMIA: Fetched primary data is valid. [2025-09-17T19:49:54.427077] [DEBUG] [LOCAL ] JMIA: Saving primary data. [2025-09-17T19:49:54.428623] [DEBUG] [LOCAL ] JMIA: Trimmed 73061 records to 50432 (keeping 200 days of data) [2025-09-17T19:49:54.672310] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-07 (3.05 seconds). [2025-09-17T19:49:54.719146] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-17T19:49:54.734423] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T19:49:54.815841] [INFO ] [REMOTE ] JNJ: Fetching primary data for 2025-09. [2025-09-17T19:49:54.818928] [DEBUG] [LOCAL ] JMIA: Primary data saved (50432 records). [2025-09-17T19:49:54.819023] [INFO ] [MAIN ] JMIA: Full history saved. [2025-09-17T19:49:54.819104] [INFO ] [MAIN ] Update Progress: 1163/2371 symbols completed. JMIA took 38.3s. Estimated remaining: 2h 56m 27s. Rate: 6.8 symbols/min [2025-09-17T19:49:54.987263] [INFO ] [MAIN ] JPC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:49:55.021577] [DEBUG] [LOCAL ] JPC: Loaded 37342 existing records from primary storage. [2025-09-17T19:49:55.021738] [INFO ] [MAIN ] JPC: Loaded 37342 existing records. [2025-09-17T19:49:55.197412] [WARN ] [MAIN ] JPC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:49:55.197679] [INFO ] [MAIN ] JPC: Wiping existing primary data before full refresh. [2025-09-17T19:49:55.197727] [INFO ] [LOCAL ] JPC: Starting deletion of primary data. [2025-09-17T19:49:55.198637] [DEBUG] [LOCAL ] JPC: Deleted primary data file. [2025-09-17T19:49:55.198713] [INFO ] [MAIN ] JPC: Starting full primary refresh. [2025-09-17T19:49:55.556607] [INFO ] [REMOTE ] JPC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:49:55.615736] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-11. [2025-09-17T19:49:56.355011] [INFO ] [REMOTE ] JNJ: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T19:49:56.362214] [INFO ] [REMOTE ] JNJ: Full fetch complete (77782 records). [2025-09-17T19:49:56.362387] [DEBUG] [VALIDATOR ] JNJ: Validating primary data. [2025-09-17T19:49:56.427705] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-08. [2025-09-17T19:49:56.776195] [DEBUG] [VALIDATOR ] JNJ: All expected trading days are present. [2025-09-17T19:49:56.776336] [DEBUG] [VALIDATOR ] JNJ: Primary data validation passed. [2025-09-17T19:49:56.777802] [INFO ] [MAIN ] JNJ: Fetched primary data is valid. [2025-09-17T19:49:56.777870] [DEBUG] [LOCAL ] JNJ: Saving primary data. [2025-09-17T19:49:56.779575] [DEBUG] [LOCAL ] JNJ: Trimmed 77782 records to 53753 (keeping 200 days of data) [2025-09-17T19:49:57.168775] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T19:49:57.216906] [DEBUG] [LOCAL ] JNJ: Primary data saved (53753 records). [2025-09-17T19:49:57.217073] [INFO ] [MAIN ] JNJ: Full history saved. [2025-09-17T19:49:57.217207] [INFO ] [MAIN ] Update Progress: 1164/2371 symbols completed. JNJ took 40.7s. Estimated remaining: 2h 56m 12s. Rate: 6.9 symbols/min [2025-09-17T19:49:57.216613] [INFO ] [REMOTE ] JOF: Fetching primary data for 2024-12. [2025-09-17T19:49:57.528082] [INFO ] [MAIN ] JPI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:49:57.537854] [DEBUG] [LOCAL ] JPI: Loaded 5442 existing records from primary storage. [2025-09-17T19:49:57.538026] [INFO ] [MAIN ] JPI: Loaded 5442 existing records. [2025-09-17T19:49:57.843913] [WARN ] [MAIN ] JPI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:49:57.844297] [INFO ] [MAIN ] JPI: Wiping existing primary data before full refresh. [2025-09-17T19:49:57.844369] [INFO ] [LOCAL ] JPI: Starting deletion of primary data. [2025-09-17T19:49:57.844826] [DEBUG] [LOCAL ] JPI: Deleted primary data file. [2025-09-17T19:49:57.844910] [INFO ] [MAIN ] JPI: Starting full primary refresh. [2025-09-17T19:49:57.968572] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T19:49:58.019189] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-01. [2025-09-17T19:49:58.328591] [INFO ] [REMOTE ] JPI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:49:58.749935] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T19:49:58.815844] [INFO ] [REMOTE ] JPI: Fetching primary data for 2024-11. [2025-09-17T19:49:59.275891] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-08 (2.85 seconds). [2025-09-17T19:49:59.276334] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T19:49:59.615838] [INFO ] [REMOTE ] JOBY: Fetching primary data for 2025-09. [2025-09-17T19:50:00.415810] [INFO ] [REMOTE ] JPC: Fetching primary data for 2024-12. [2025-09-17T19:50:00.451105] [INFO ] [REMOTE ] JOBY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T19:50:00.461885] [INFO ] [REMOTE ] JOBY: Full fetch complete (77971 records). [2025-09-17T19:50:00.462188] [DEBUG] [VALIDATOR ] JOBY: Validating primary data. [2025-09-17T19:50:00.862771] [DEBUG] [VALIDATOR ] JOBY: All expected trading days are present. [2025-09-17T19:50:00.862878] [DEBUG] [VALIDATOR ] JOBY: Primary data validation passed. [2025-09-17T19:50:00.863885] [INFO ] [MAIN ] JOBY: Fetched primary data is valid. [2025-09-17T19:50:00.863942] [DEBUG] [LOCAL ] JOBY: Saving primary data. [2025-09-17T19:50:00.865564] [DEBUG] [LOCAL ] JOBY: Trimmed 77971 records to 53798 (keeping 200 days of data) [2025-09-17T19:50:01.201006] [DEBUG] [LOCAL ] JOBY: Primary data saved (53798 records). [2025-09-17T19:50:01.201182] [INFO ] [MAIN ] JOBY: Full history saved. [2025-09-17T19:50:01.201921] [INFO ] [MAIN ] Update Progress: 1165/2371 symbols completed. JOBY took 44.7s. Estimated remaining: 2h 55m 58s. Rate: 6.9 symbols/min [2025-09-17T19:50:01.223102] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-02. [2025-09-17T19:50:01.387891] [INFO ] [MAIN ] JPM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:50:01.449912] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-17T19:50:01.450084] [INFO ] [MAIN ] JPM: Loaded 53794 existing records. [2025-09-17T19:50:01.645185] [WARN ] [MAIN ] JPM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:50:01.645753] [INFO ] [MAIN ] JPM: Wiping existing primary data before full refresh. [2025-09-17T19:50:01.645912] [INFO ] [LOCAL ] JPM: Starting deletion of primary data. [2025-09-17T19:50:01.647155] [DEBUG] [LOCAL ] JPM: Deleted primary data file. [2025-09-17T19:50:01.647229] [INFO ] [MAIN ] JPM: Starting full primary refresh. [2025-09-17T19:50:02.038056] [INFO ] [REMOTE ] JPI: Fetching primary data for 2024-12. [2025-09-17T19:50:02.069788] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T19:50:02.066127] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T19:50:02.216111] [INFO ] [REMOTE ] JPM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:50:02.782385] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T19:50:02.815890] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-01. [2025-09-17T19:50:03.515535] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T19:50:03.615874] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-11. [2025-09-17T19:50:04.415862] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-01. [2025-09-17T19:50:05.215902] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-03. [2025-09-17T19:50:05.828444] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-17T19:50:05.910597] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T19:50:06.015850] [INFO ] [REMOTE ] JPM: Fetching primary data for 2024-12. [2025-09-17T19:50:06.039206] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T19:50:06.815904] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-02. [2025-09-17T19:50:07.615827] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-04. [2025-09-17T19:50:08.148269] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-17T19:50:08.217603] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T19:50:08.236486] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T19:50:08.415831] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-05. [2025-09-17T19:50:08.845870] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-05 (0.43 seconds). [2025-09-17T19:50:09.215875] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-02. [2025-09-17T19:50:10.015912] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-01. [2025-09-17T19:50:10.044129] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T19:50:10.815895] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-03. [2025-09-17T19:50:11.436670] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T19:50:11.615833] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-04. [2025-09-17T19:50:12.320914] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-17T19:50:12.340753] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T19:50:12.415830] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-06. [2025-09-17T19:50:13.215871] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-05. [2025-09-17T19:50:13.269403] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T19:50:13.934766] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T19:50:14.015858] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-02. [2025-09-17T19:50:14.815837] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-06. [2025-09-17T19:50:15.615845] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-07. [2025-09-17T19:50:16.206066] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T19:50:16.375132] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-17T19:50:16.415860] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-03. [2025-09-17T19:50:17.215834] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-08. [2025-09-17T19:50:17.920394] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T19:50:18.015850] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-03. [2025-09-17T19:50:18.137730] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T19:50:18.796978] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-06 (3.98 seconds). [2025-09-17T19:50:18.815748] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-07. [2025-09-17T19:50:19.439393] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T19:50:19.615811] [INFO ] [REMOTE ] JOF: Fetching primary data for 2025-09. [2025-09-17T19:50:20.080095] [INFO ] [REMOTE ] JOF: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T19:50:20.082772] [INFO ] [REMOTE ] JOF: Full fetch complete (9447 records). [2025-09-17T19:50:20.082888] [DEBUG] [VALIDATOR ] JOF: Validating primary data. [2025-09-17T19:50:20.431156] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-08. [2025-09-17T19:50:20.472132] [DEBUG] [VALIDATOR ] JOF: All expected trading days are present. [2025-09-17T19:50:20.472265] [DEBUG] [VALIDATOR ] JOF: Primary data validation passed. [2025-09-17T19:50:20.472954] [INFO ] [MAIN ] JOF: Fetched primary data is valid. [2025-09-17T19:50:20.473036] [DEBUG] [LOCAL ] JOF: Saving primary data. [2025-09-17T19:50:20.474294] [DEBUG] [LOCAL ] JOF: Trimmed 9447 records to 7194 (keeping 200 days of data) [2025-09-17T19:50:20.565673] [DEBUG] [LOCAL ] JOF: Primary data saved (7194 records). [2025-09-17T19:50:20.566635] [INFO ] [MAIN ] JOF: Full history saved. [2025-09-17T19:50:20.566793] [INFO ] [MAIN ] Update Progress: 1166/2371 symbols completed. JOF took 29.4s. Estimated remaining: 2h 56m 0s. Rate: 6.8 symbols/min [2025-09-17T19:50:20.571230] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-17T19:50:20.766220] [INFO ] [MAIN ] JQC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:50:20.800693] [DEBUG] [LOCAL ] JQC: Loaded 33855 existing records from primary storage. [2025-09-17T19:50:20.800852] [INFO ] [MAIN ] JQC: Loaded 33855 existing records. [2025-09-17T19:50:20.987102] [WARN ] [MAIN ] JQC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:50:20.987542] [INFO ] [MAIN ] JQC: Wiping existing primary data before full refresh. [2025-09-17T19:50:20.987594] [INFO ] [LOCAL ] JQC: Starting deletion of primary data. [2025-09-17T19:50:20.988421] [DEBUG] [LOCAL ] JQC: Deleted primary data file. [2025-09-17T19:50:20.988473] [INFO ] [MAIN ] JQC: Starting full primary refresh. [2025-09-17T19:50:21.119027] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T19:50:21.221088] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-04. [2025-09-17T19:50:21.370127] [INFO ] [REMOTE ] JQC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:50:22.015789] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-11. [2025-09-17T19:50:22.815832] [INFO ] [REMOTE ] JPI: Fetching primary data for 2025-09. [2025-09-17T19:50:22.856977] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T19:50:23.196199] [INFO ] [REMOTE ] JPI: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T19:50:23.198381] [INFO ] [REMOTE ] JPI: Full fetch complete (7868 records). [2025-09-17T19:50:23.198487] [DEBUG] [VALIDATOR ] JPI: Validating primary data. [2025-09-17T19:50:23.443032] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T19:50:23.616601] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-04. [2025-09-17T19:50:23.644675] [DEBUG] [VALIDATOR ] JPI: All expected trading days are present. [2025-09-17T19:50:23.644789] [DEBUG] [VALIDATOR ] JPI: Primary data validation passed. [2025-09-17T19:50:23.645257] [INFO ] [MAIN ] JPI: Fetched primary data is valid. [2025-09-17T19:50:23.645312] [DEBUG] [LOCAL ] JPI: Saving primary data. [2025-09-17T19:50:23.646221] [DEBUG] [LOCAL ] JPI: Trimmed 7868 records to 5451 (keeping 200 days of data) [2025-09-17T19:50:23.685105] [DEBUG] [LOCAL ] JPI: Primary data saved (5451 records). [2025-09-17T19:50:23.685295] [INFO ] [MAIN ] JPI: Full history saved. [2025-09-17T19:50:23.685486] [INFO ] [MAIN ] Update Progress: 1167/2371 symbols completed. JPI took 26.5s. Estimated remaining: 2h 55m 46s. Rate: 6.9 symbols/min [2025-09-17T19:50:23.864877] [INFO ] [MAIN ] JRI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:50:23.865162] [DEBUG] [LOCAL ] JRI: No existing data file found in primary storage. [2025-09-17T19:50:23.865209] [WARN ] [MAIN ] JRI: No existing data found, performing full refresh instead. [2025-09-17T19:50:23.865351] [INFO ] [MAIN ] JRI: Wiping existing primary data before full refresh. [2025-09-17T19:50:23.865389] [INFO ] [LOCAL ] JRI: Starting deletion of primary data. [2025-09-17T19:50:23.865428] [DEBUG] [LOCAL ] JRI: No primary data file found to delete. [2025-09-17T19:50:23.865459] [INFO ] [MAIN ] JRI: Starting full primary refresh. [2025-09-17T19:50:24.223108] [INFO ] [REMOTE ] JRI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:50:24.415783] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-11. [2025-09-17T19:50:25.215824] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-05. [2025-09-17T19:50:25.363569] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T19:50:26.015817] [INFO ] [REMOTE ] JRI: Fetching primary data for 2024-12. [2025-09-17T19:50:26.334042] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-04 (2.72 seconds). [2025-09-17T19:50:26.619677] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T19:50:26.815781] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-06. [2025-09-17T19:50:26.966093] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T19:50:27.615782] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-01. [2025-09-17T19:50:28.219142] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T19:50:28.415783] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-05. [2025-09-17T19:50:28.657005] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T19:50:29.215785] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-07. [2025-09-17T19:50:30.015763] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-02. [2025-09-17T19:50:30.591383] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T19:50:30.707438] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-17T19:50:30.815711] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-08. [2025-09-17T19:50:30.976217] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T19:50:31.615757] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-06. [2025-09-17T19:50:32.267196] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T19:50:32.415794] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-03. [2025-09-17T19:50:33.215778] [INFO ] [REMOTE ] JPC: Fetching primary data for 2025-09. [2025-09-17T19:50:33.370164] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T19:50:33.591450] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T19:50:33.665410] [INFO ] [REMOTE ] JPC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T19:50:33.670830] [INFO ] [REMOTE ] JPC: Full fetch complete (55816 records). [2025-09-17T19:50:33.670973] [DEBUG] [VALIDATOR ] JPC: Validating primary data. [2025-09-17T19:50:34.020853] [INFO ] [REMOTE ] JQC: Fetching primary data for 2024-12. [2025-09-17T19:50:34.063712] [DEBUG] [VALIDATOR ] JPC: All expected trading days are present. [2025-09-17T19:50:34.063828] [DEBUG] [VALIDATOR ] JPC: Primary data validation passed. [2025-09-17T19:50:34.064792] [INFO ] [MAIN ] JPC: Fetched primary data is valid. [2025-09-17T19:50:34.064878] [DEBUG] [LOCAL ] JPC: Saving primary data. [2025-09-17T19:50:34.066273] [DEBUG] [LOCAL ] JPC: Trimmed 55816 records to 37319 (keeping 200 days of data) [2025-09-17T19:50:34.292984] [DEBUG] [LOCAL ] JPC: Primary data saved (37319 records). [2025-09-17T19:50:34.293154] [INFO ] [MAIN ] JPC: Full history saved. [2025-09-17T19:50:34.293248] [INFO ] [MAIN ] Update Progress: 1168/2371 symbols completed. JPC took 39.5s. Estimated remaining: 2h 55m 39s. Rate: 6.8 symbols/min [2025-09-17T19:50:34.465095] [INFO ] [MAIN ] JRS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:50:34.476781] [DEBUG] [LOCAL ] JRS: Loaded 10999 existing records from primary storage. [2025-09-17T19:50:34.476898] [INFO ] [MAIN ] JRS: Loaded 10999 existing records. [2025-09-17T19:50:34.653613] [WARN ] [MAIN ] JRS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:50:34.653935] [INFO ] [MAIN ] JRS: Wiping existing primary data before full refresh. [2025-09-17T19:50:34.654020] [INFO ] [LOCAL ] JRS: Starting deletion of primary data. [2025-09-17T19:50:34.654403] [DEBUG] [LOCAL ] JRS: Deleted primary data file. [2025-09-17T19:50:34.654448] [INFO ] [MAIN ] JRS: Starting full primary refresh. [2025-09-17T19:50:34.829484] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-07. [2025-09-17T19:50:35.021628] [INFO ] [REMOTE ] JRS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:50:35.171258] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T19:50:35.615799] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-01. [2025-09-17T19:50:36.415840] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-04. [2025-09-17T19:50:36.996865] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T19:50:37.215787] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-11. [2025-09-17T19:50:37.386019] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-17T19:50:37.436475] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T19:50:37.823090] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T19:50:38.015792] [INFO ] [REMOTE ] JRS: Fetching primary data for 2024-12. [2025-09-17T19:50:38.815824] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-05. [2025-09-17T19:50:38.886521] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T19:50:39.556198] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T19:50:39.615785] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-02. [2025-09-17T19:50:40.415800] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-06. [2025-09-17T19:50:40.976771] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T19:50:41.215830] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-01. [2025-09-17T19:50:41.300865] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T19:50:41.816051] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T19:50:42.015804] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-03. [2025-09-17T19:50:42.815819] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-08. [2025-09-17T19:50:43.395034] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T19:50:43.615798] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-02. [2025-09-17T19:50:44.363535] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T19:50:44.415798] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-04. [2025-09-17T19:50:45.007604] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T19:50:45.215869] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-03. [2025-09-17T19:50:45.849550] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T19:50:45.870597] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T19:50:46.015846] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-07. [2025-09-17T19:50:46.815841] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-05. [2025-09-17T19:50:47.069985] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T19:50:47.615845] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-08. [2025-09-17T19:50:48.125103] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T19:50:48.355994] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T19:50:48.415823] [INFO ] [REMOTE ] JRI: Fetching primary data for 2025-09. [2025-09-17T19:50:48.997974] [INFO ] [REMOTE ] JRI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T19:50:49.001339] [INFO ] [REMOTE ] JRI: Full fetch complete (23081 records). [2025-09-17T19:50:49.001508] [DEBUG] [VALIDATOR ] JRI: Validating primary data. [2025-09-17T19:50:49.225608] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-04. [2025-09-17T19:50:49.381577] [DEBUG] [VALIDATOR ] JRI: All expected trading days are present. [2025-09-17T19:50:49.381668] [DEBUG] [VALIDATOR ] JRI: Primary data validation passed. [2025-09-17T19:50:49.382123] [INFO ] [MAIN ] JRI: Fetched primary data is valid. [2025-09-17T19:50:49.382176] [DEBUG] [LOCAL ] JRI: Saving primary data. [2025-09-17T19:50:49.382793] [DEBUG] [LOCAL ] JRI: Trimmed 23081 records to 15147 (keeping 200 days of data) [2025-09-17T19:50:49.476784] [DEBUG] [LOCAL ] JRI: Primary data saved (15147 records). [2025-09-17T19:50:49.476936] [INFO ] [MAIN ] JRI: Full history saved. [2025-09-17T19:50:49.477031] [INFO ] [MAIN ] Update Progress: 1169/2371 symbols completed. JRI took 25.8s. Estimated remaining: 2h 55m 37s. Rate: 6.8 symbols/min [2025-09-17T19:50:49.646578] [INFO ] [MAIN ] JXN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:50:49.696603] [DEBUG] [LOCAL ] JXN: Loaded 46086 existing records from primary storage. [2025-09-17T19:50:49.696795] [INFO ] [MAIN ] JXN: Loaded 46086 existing records. [2025-09-17T19:50:49.876295] [WARN ] [MAIN ] JXN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:50:49.876892] [INFO ] [MAIN ] JXN: Wiping existing primary data before full refresh. [2025-09-17T19:50:49.877056] [INFO ] [LOCAL ] JXN: Starting deletion of primary data. [2025-09-17T19:50:49.884883] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T19:50:49.887275] [DEBUG] [LOCAL ] JXN: Deleted primary data file. [2025-09-17T19:50:49.887720] [INFO ] [MAIN ] JXN: Starting full primary refresh. [2025-09-17T19:50:50.020954] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-06. [2025-09-17T19:50:50.261105] [INFO ] [REMOTE ] JXN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:50:50.815797] [INFO ] [REMOTE ] JPM: Fetching primary data for 2025-09. [2025-09-17T19:50:51.332089] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T19:50:51.488088] [INFO ] [REMOTE ] JPM: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T19:50:51.495289] [INFO ] [REMOTE ] JPM: Full fetch complete (77826 records). [2025-09-17T19:50:51.495528] [DEBUG] [VALIDATOR ] JPM: Validating primary data. [2025-09-17T19:50:51.620848] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-07. [2025-09-17T19:50:51.901214] [DEBUG] [VALIDATOR ] JPM: All expected trading days are present. [2025-09-17T19:50:51.901336] [DEBUG] [VALIDATOR ] JPM: Primary data validation passed. [2025-09-17T19:50:51.902374] [INFO ] [MAIN ] JPM: Fetched primary data is valid. [2025-09-17T19:50:51.902428] [DEBUG] [LOCAL ] JPM: Saving primary data. [2025-09-17T19:50:51.904871] [DEBUG] [LOCAL ] JPM: Trimmed 77826 records to 53794 (keeping 200 days of data) [2025-09-17T19:50:52.271579] [DEBUG] [LOCAL ] JPM: Primary data saved (53794 records). [2025-09-17T19:50:52.271775] [INFO ] [MAIN ] JPM: Full history saved. [2025-09-17T19:50:52.271920] [INFO ] [MAIN ] Update Progress: 1170/2371 symbols completed. JPM took 51.1s. Estimated remaining: 2h 55m 22s. Rate: 6.8 symbols/min [2025-09-17T19:50:52.421062] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-05. [2025-09-17T19:50:52.538737] [INFO ] [MAIN ] K: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:50:52.601163] [DEBUG] [LOCAL ] K: Loaded 49749 existing records from primary storage. [2025-09-17T19:50:52.601343] [INFO ] [MAIN ] K: Loaded 49749 existing records. [2025-09-17T19:50:52.888440] [WARN ] [MAIN ] K: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:50:52.888826] [INFO ] [MAIN ] K: Wiping existing primary data before full refresh. [2025-09-17T19:50:52.888894] [INFO ] [LOCAL ] K: Starting deletion of primary data. [2025-09-17T19:50:52.890324] [DEBUG] [LOCAL ] K: Deleted primary data file. [2025-09-17T19:50:52.890402] [INFO ] [MAIN ] K: Starting full primary refresh. [2025-09-17T19:50:53.234795] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-11. [2025-09-17T19:50:53.457305] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T19:50:53.456763] [INFO ] [REMOTE ] K: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:50:53.492790] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T19:50:54.015842] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-08. [2025-09-17T19:50:54.627038] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T19:50:54.815779] [INFO ] [REMOTE ] K: Fetching primary data for 2024-11. [2025-09-17T19:50:55.384138] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T19:50:55.615789] [INFO ] [REMOTE ] JQC: Fetching primary data for 2025-09. [2025-09-17T19:50:56.311034] [INFO ] [REMOTE ] JQC: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:50:56.316025] [INFO ] [REMOTE ] JQC: Full fetch complete (48435 records). [2025-09-17T19:50:56.316189] [DEBUG] [VALIDATOR ] JQC: Validating primary data. [2025-09-17T19:50:56.417960] [INFO ] [REMOTE ] JXN: Fetching primary data for 2024-12. [2025-09-17T19:50:56.710635] [DEBUG] [VALIDATOR ] JQC: All expected trading days are present. [2025-09-17T19:50:56.710745] [DEBUG] [VALIDATOR ] JQC: Primary data validation passed. [2025-09-17T19:50:56.711497] [INFO ] [MAIN ] JQC: Fetched primary data is valid. [2025-09-17T19:50:56.711546] [DEBUG] [LOCAL ] JQC: Saving primary data. [2025-09-17T19:50:56.713320] [DEBUG] [LOCAL ] JQC: Trimmed 48435 records to 33859 (keeping 200 days of data) [2025-09-17T19:50:56.831612] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T19:50:56.955976] [DEBUG] [LOCAL ] JQC: Primary data saved (33859 records). [2025-09-17T19:50:56.956135] [INFO ] [MAIN ] JQC: Full history saved. [2025-09-17T19:50:56.956260] [INFO ] [MAIN ] Update Progress: 1171/2371 symbols completed. JQC took 36.4s. Estimated remaining: 2h 55m 9s. Rate: 6.9 symbols/min [2025-09-17T19:50:57.123140] [INFO ] [MAIN ] KAI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:50:57.137788] [DEBUG] [LOCAL ] KAI: Loaded 13670 existing records from primary storage. [2025-09-17T19:50:57.137898] [INFO ] [MAIN ] KAI: Loaded 13670 existing records. [2025-09-17T19:50:57.220993] [INFO ] [REMOTE ] K: Fetching primary data for 2024-12. [2025-09-17T19:50:57.315510] [WARN ] [MAIN ] KAI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:50:57.315757] [INFO ] [MAIN ] KAI: Wiping existing primary data before full refresh. [2025-09-17T19:50:57.315803] [INFO ] [LOCAL ] KAI: Starting deletion of primary data. [2025-09-17T19:50:57.316282] [DEBUG] [LOCAL ] KAI: Deleted primary data file. [2025-09-17T19:50:57.316338] [INFO ] [MAIN ] KAI: Starting full primary refresh. [2025-09-17T19:50:57.664360] [INFO ] [REMOTE ] KAI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:50:58.020843] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-06. [2025-09-17T19:50:58.035535] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T19:50:58.745397] [INFO ] [REMOTE ] K: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T19:50:58.815832] [INFO ] [REMOTE ] K: Fetching primary data for 2025-01. [2025-09-17T19:50:58.830575] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T19:50:59.615791] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-01. [2025-09-17T19:51:00.416070] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-07. [2025-09-17T19:51:00.558777] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T19:51:00.761112] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T19:51:00.982226] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T19:51:01.215789] [INFO ] [REMOTE ] K: Fetching primary data for 2025-02. [2025-09-17T19:51:02.015808] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-08. [2025-09-17T19:51:02.815801] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-11. [2025-09-17T19:51:03.573153] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-17T19:51:03.615756] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-02. [2025-09-17T19:51:03.641511] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T19:51:04.197886] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T19:51:04.415795] [INFO ] [REMOTE ] JRS: Fetching primary data for 2025-09. [2025-09-17T19:51:04.859308] [INFO ] [REMOTE ] JRS: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T19:51:04.861452] [INFO ] [REMOTE ] JRS: Full fetch complete (15874 records). [2025-09-17T19:51:04.861533] [DEBUG] [VALIDATOR ] JRS: Validating primary data. [2025-09-17T19:51:05.219540] [INFO ] [REMOTE ] K: Fetching primary data for 2025-03. [2025-09-17T19:51:05.286509] [DEBUG] [VALIDATOR ] JRS: All expected trading days are present. [2025-09-17T19:51:05.286668] [DEBUG] [VALIDATOR ] JRS: Primary data validation passed. [2025-09-17T19:51:05.287156] [INFO ] [MAIN ] JRS: Fetched primary data is valid. [2025-09-17T19:51:05.287222] [DEBUG] [LOCAL ] JRS: Saving primary data. [2025-09-17T19:51:05.288188] [DEBUG] [LOCAL ] JRS: Trimmed 15874 records to 11014 (keeping 200 days of data) [2025-09-17T19:51:05.365872] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T19:51:05.392502] [DEBUG] [LOCAL ] JRS: Primary data saved (11014 records). [2025-09-17T19:51:05.392621] [INFO ] [MAIN ] JRS: Full history saved. [2025-09-17T19:51:05.392741] [INFO ] [MAIN ] Update Progress: 1172/2371 symbols completed. JRS took 31.1s. Estimated remaining: 2h 54m 60s. Rate: 6.9 symbols/min [2025-09-17T19:51:05.570517] [INFO ] [MAIN ] KAR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:51:05.620011] [DEBUG] [LOCAL ] KAR: Loaded 40152 existing records from primary storage. [2025-09-17T19:51:05.620174] [INFO ] [MAIN ] KAR: Loaded 40152 existing records. [2025-09-17T19:51:05.797516] [WARN ] [MAIN ] KAR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:51:05.797796] [INFO ] [MAIN ] KAR: Wiping existing primary data before full refresh. [2025-09-17T19:51:05.797842] [INFO ] [LOCAL ] KAR: Starting deletion of primary data. [2025-09-17T19:51:05.798758] [DEBUG] [LOCAL ] KAR: Deleted primary data file. [2025-09-17T19:51:05.798807] [INFO ] [MAIN ] KAR: Starting full primary refresh. [2025-09-17T19:51:06.023725] [INFO ] [REMOTE ] KAI: Fetching primary data for 2024-12. [2025-09-17T19:51:06.159736] [INFO ] [REMOTE ] KAR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:51:06.815816] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-11. [2025-09-17T19:51:06.997560] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T19:51:07.045110] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T19:51:07.615817] [INFO ] [REMOTE ] K: Fetching primary data for 2025-04. [2025-09-17T19:51:08.362937] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T19:51:08.415840] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-01. [2025-09-17T19:51:09.022630] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T19:51:09.200799] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T19:51:09.215765] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-02. [2025-09-17T19:51:10.015806] [INFO ] [REMOTE ] K: Fetching primary data for 2025-05. [2025-09-17T19:51:10.199969] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T19:51:10.815790] [INFO ] [REMOTE ] KAR: Fetching primary data for 2024-12. [2025-09-17T19:51:11.615823] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-03. [2025-09-17T19:51:11.660267] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T19:51:12.202371] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T19:51:12.415788] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-01. [2025-09-17T19:51:13.215810] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-03. [2025-09-17T19:51:13.510226] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T19:51:13.564266] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T19:51:14.015742] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-04. [2025-09-17T19:51:14.351586] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T19:51:14.815773] [INFO ] [REMOTE ] K: Fetching primary data for 2025-06. [2025-09-17T19:51:15.615818] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-04. [2025-09-17T19:51:16.415829] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-02. [2025-09-17T19:51:16.606471] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-04 (2.59 seconds). [2025-09-17T19:51:17.102920] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T19:51:17.215791] [INFO ] [REMOTE ] K: Fetching primary data for 2025-07. [2025-09-17T19:51:17.986778] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T19:51:18.015729] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-03. [2025-09-17T19:51:18.053378] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-17T19:51:18.518610] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T19:51:18.815774] [INFO ] [REMOTE ] K: Fetching primary data for 2025-08. [2025-09-17T19:51:19.546130] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T19:51:19.615796] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-05. [2025-09-17T19:51:20.415781] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-04. [2025-09-17T19:51:20.529361] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T19:51:21.213086] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T19:51:21.222203] [INFO ] [REMOTE ] K: Fetching primary data for 2025-09. [2025-09-17T19:51:21.889198] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T19:51:22.002527] [INFO ] [REMOTE ] K: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T19:51:22.011073] [INFO ] [REMOTE ] K: Full fetch complete (71639 records). [2025-09-17T19:51:22.011256] [DEBUG] [VALIDATOR ] K: Validating primary data. [2025-09-17T19:51:22.025010] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-05. [2025-09-17T19:51:22.447898] [DEBUG] [VALIDATOR ] K: All expected trading days are present. [2025-09-17T19:51:22.448015] [DEBUG] [VALIDATOR ] K: Primary data validation passed. [2025-09-17T19:51:22.449078] [INFO ] [MAIN ] K: Fetched primary data is valid. [2025-09-17T19:51:22.449131] [DEBUG] [LOCAL ] K: Saving primary data. [2025-09-17T19:51:22.450797] [DEBUG] [LOCAL ] K: Trimmed 71639 records to 49762 (keeping 200 days of data) [2025-09-17T19:51:22.774570] [DEBUG] [LOCAL ] K: Primary data saved (49762 records). [2025-09-17T19:51:22.774739] [INFO ] [MAIN ] K: Full history saved. [2025-09-17T19:51:22.774843] [INFO ] [MAIN ] Update Progress: 1173/2371 symbols completed. K took 30.5s. Estimated remaining: 2h 54m 60s. Rate: 6.8 symbols/min [2025-09-17T19:51:22.820862] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-05. [2025-09-17T19:51:22.950128] [INFO ] [MAIN ] KB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:51:22.977326] [DEBUG] [LOCAL ] KB: Loaded 24566 existing records from primary storage. [2025-09-17T19:51:22.977471] [INFO ] [MAIN ] KB: Loaded 24566 existing records. [2025-09-17T19:51:23.155757] [WARN ] [MAIN ] KB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:51:23.156090] [INFO ] [MAIN ] KB: Wiping existing primary data before full refresh. [2025-09-17T19:51:23.156254] [INFO ] [LOCAL ] KB: Starting deletion of primary data. [2025-09-17T19:51:23.156988] [DEBUG] [LOCAL ] KB: Deleted primary data file. [2025-09-17T19:51:23.157044] [INFO ] [MAIN ] KB: Starting full primary refresh. [2025-09-17T19:51:23.517333] [INFO ] [REMOTE ] KB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:51:23.542506] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T19:51:23.615781] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-11. [2025-09-17T19:51:23.849548] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T19:51:24.338680] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T19:51:24.415763] [INFO ] [REMOTE ] KB: Fetching primary data for 2024-12. [2025-09-17T19:51:25.215786] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-06. [2025-09-17T19:51:25.715687] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T19:51:26.015774] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-01. [2025-09-17T19:51:26.701939] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T19:51:26.815792] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-06. [2025-09-17T19:51:27.180172] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T19:51:27.615784] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-06. [2025-09-17T19:51:27.776421] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T19:51:28.415781] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-07. [2025-09-17T19:51:29.215807] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-07. [2025-09-17T19:51:29.551502] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T19:51:29.586967] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T19:51:30.015794] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-02. [2025-09-17T19:51:30.525113] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T19:51:30.815807] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-08. [2025-09-17T19:51:31.189966] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T19:51:31.321149] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T19:51:31.615801] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-08. [2025-09-17T19:51:32.415834] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-03. [2025-09-17T19:51:32.875932] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T19:51:33.215813] [INFO ] [REMOTE ] KAI: Fetching primary data for 2025-09. [2025-09-17T19:51:33.388517] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T19:51:33.687781] [INFO ] [REMOTE ] KAI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T19:51:33.690049] [INFO ] [REMOTE ] KAI: Full fetch complete (18695 records). [2025-09-17T19:51:33.690270] [DEBUG] [VALIDATOR ] KAI: Validating primary data. [2025-09-17T19:51:34.029846] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-07. [2025-09-17T19:51:34.077152] [DEBUG] [VALIDATOR ] KAI: All expected trading days are present. [2025-09-17T19:51:34.077249] [DEBUG] [VALIDATOR ] KAI: Primary data validation passed. [2025-09-17T19:51:34.077904] [INFO ] [MAIN ] KAI: Fetched primary data is valid. [2025-09-17T19:51:34.077957] [DEBUG] [LOCAL ] KAI: Saving primary data. [2025-09-17T19:51:34.078831] [DEBUG] [LOCAL ] KAI: Trimmed 18695 records to 13671 (keeping 200 days of data) [2025-09-17T19:51:34.178783] [DEBUG] [LOCAL ] KAI: Primary data saved (13671 records). [2025-09-17T19:51:34.179002] [INFO ] [MAIN ] KAI: Full history saved. [2025-09-17T19:51:34.179117] [INFO ] [MAIN ] Update Progress: 1174/2371 symbols completed. KAI took 37.2s. Estimated remaining: 2h 54m 54s. Rate: 6.8 symbols/min [2025-09-17T19:51:34.367003] [INFO ] [MAIN ] KBDC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:51:34.392444] [DEBUG] [LOCAL ] KBDC: Loaded 20428 existing records from primary storage. [2025-09-17T19:51:34.392721] [INFO ] [MAIN ] KBDC: Loaded 20428 existing records. [2025-09-17T19:51:34.601907] [WARN ] [MAIN ] KBDC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:51:34.602279] [INFO ] [MAIN ] KBDC: Wiping existing primary data before full refresh. [2025-09-17T19:51:34.602330] [INFO ] [LOCAL ] KBDC: Starting deletion of primary data. [2025-09-17T19:51:34.603002] [DEBUG] [LOCAL ] KBDC: Deleted primary data file. [2025-09-17T19:51:34.603057] [INFO ] [MAIN ] KBDC: Starting full primary refresh. [2025-09-17T19:51:34.823903] [INFO ] [REMOTE ] KAR: Fetching primary data for 2025-09. [2025-09-17T19:51:34.999916] [INFO ] [REMOTE ] KBDC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:51:35.584891] [INFO ] [REMOTE ] KAR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T19:51:35.590814] [INFO ] [REMOTE ] KAR: Full fetch complete (56536 records). [2025-09-17T19:51:35.590953] [DEBUG] [VALIDATOR ] KAR: Validating primary data. [2025-09-17T19:51:35.625415] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-04. [2025-09-17T19:51:35.980071] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T19:51:36.071734] [DEBUG] [VALIDATOR ] KAR: All expected trading days are present. [2025-09-17T19:51:36.071863] [DEBUG] [VALIDATOR ] KAR: Primary data validation passed. [2025-09-17T19:51:36.072886] [INFO ] [MAIN ] KAR: Fetched primary data is valid. [2025-09-17T19:51:36.072945] [DEBUG] [LOCAL ] KAR: Saving primary data. [2025-09-17T19:51:36.074891] [DEBUG] [LOCAL ] KAR: Trimmed 56536 records to 40104 (keeping 200 days of data) [2025-09-17T19:51:36.332280] [DEBUG] [LOCAL ] KAR: Primary data saved (40104 records). [2025-09-17T19:51:36.332468] [INFO ] [MAIN ] KAR: Full history saved. [2025-09-17T19:51:36.332593] [INFO ] [MAIN ] Update Progress: 1175/2371 symbols completed. KAR took 30.9s. Estimated remaining: 2h 54m 38s. Rate: 6.8 symbols/min [2025-09-17T19:51:36.425956] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-08. [2025-09-17T19:51:36.511386] [INFO ] [MAIN ] KBH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:51:36.560595] [DEBUG] [LOCAL ] KBH: Loaded 48821 existing records from primary storage. [2025-09-17T19:51:36.561025] [INFO ] [MAIN ] KBH: Loaded 48821 existing records. [2025-09-17T19:51:36.751637] [WARN ] [MAIN ] KBH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:51:36.752146] [INFO ] [MAIN ] KBH: Wiping existing primary data before full refresh. [2025-09-17T19:51:36.752291] [INFO ] [LOCAL ] KBH: Starting deletion of primary data. [2025-09-17T19:51:36.758844] [DEBUG] [LOCAL ] KBH: Deleted primary data file. [2025-09-17T19:51:36.768102] [INFO ] [MAIN ] KBH: Starting full primary refresh. [2025-09-17T19:51:36.841872] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T19:51:37.172713] [INFO ] [REMOTE ] KBH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:51:37.215884] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-11. [2025-09-17T19:51:37.994383] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T19:51:38.015748] [INFO ] [REMOTE ] JXN: Fetching primary data for 2025-09. [2025-09-17T19:51:38.587763] [INFO ] [REMOTE ] JXN: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:51:38.594569] [INFO ] [REMOTE ] JXN: Full fetch complete (65008 records). [2025-09-17T19:51:38.594822] [DEBUG] [VALIDATOR ] JXN: Validating primary data. [2025-09-17T19:51:38.820236] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-05. [2025-09-17T19:51:39.043591] [DEBUG] [VALIDATOR ] JXN: All expected trading days are present. [2025-09-17T19:51:39.043932] [DEBUG] [VALIDATOR ] JXN: Primary data validation passed. [2025-09-17T19:51:39.045694] [INFO ] [MAIN ] JXN: Fetched primary data is valid. [2025-09-17T19:51:39.045832] [DEBUG] [LOCAL ] JXN: Saving primary data. [2025-09-17T19:51:39.058894] [DEBUG] [LOCAL ] JXN: Trimmed 65008 records to 46064 (keeping 200 days of data) [2025-09-17T19:51:39.080324] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-11 (1.86 seconds). [2025-09-17T19:51:39.405590] [DEBUG] [LOCAL ] JXN: Primary data saved (46064 records). [2025-09-17T19:51:39.405845] [INFO ] [MAIN ] JXN: Full history saved. [2025-09-17T19:51:39.405989] [INFO ] [MAIN ] Update Progress: 1176/2371 symbols completed. JXN took 49.9s. Estimated remaining: 2h 54m 24s. Rate: 6.9 symbols/min [2025-09-17T19:51:39.588913] [INFO ] [MAIN ] KBR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:51:39.617951] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-11. [2025-09-17T19:51:39.641771] [DEBUG] [LOCAL ] KBR: Loaded 48401 existing records from primary storage. [2025-09-17T19:51:39.641986] [INFO ] [MAIN ] KBR: Loaded 48401 existing records. [2025-09-17T19:51:39.833010] [WARN ] [MAIN ] KBR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:51:39.833326] [INFO ] [MAIN ] KBR: Wiping existing primary data before full refresh. [2025-09-17T19:51:39.833375] [INFO ] [LOCAL ] KBR: Starting deletion of primary data. [2025-09-17T19:51:39.834539] [DEBUG] [LOCAL ] KBR: Deleted primary data file. [2025-09-17T19:51:39.834595] [INFO ] [MAIN ] KBR: Starting full primary refresh. [2025-09-17T19:51:40.236569] [INFO ] [REMOTE ] KBR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:51:40.238398] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T19:51:40.261725] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T19:51:40.415807] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2024-12. [2025-09-17T19:51:41.123886] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T19:51:41.215866] [INFO ] [REMOTE ] KBH: Fetching primary data for 2024-12. [2025-09-17T19:51:42.015830] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-11. [2025-09-17T19:51:42.815890] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-06. [2025-09-17T19:51:42.854685] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T19:51:43.439849] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T19:51:43.615772] [INFO ] [REMOTE ] KBR: Fetching primary data for 2024-12. [2025-09-17T19:51:43.828238] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T19:51:44.415895] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-01. [2025-09-17T19:51:45.215924] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-01. [2025-09-17T19:51:45.301857] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T19:51:46.015908] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-01. [2025-09-17T19:51:46.182156] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T19:51:46.223591] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T19:51:46.815826] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-02. [2025-09-17T19:51:47.433345] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T19:51:47.615846] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-02. [2025-09-17T19:51:48.412954] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T19:51:48.421928] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-02. [2025-09-17T19:51:48.896548] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T19:51:49.215870] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-07. [2025-09-17T19:51:49.411285] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T19:51:50.015698] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-03. [2025-09-17T19:51:50.200109] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T19:51:50.815821] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-03. [2025-09-17T19:51:51.615847] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-08. [2025-09-17T19:51:51.754404] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T19:51:52.227881] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T19:51:52.415747] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-04. [2025-09-17T19:51:52.773544] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T19:51:53.215867] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-04. [2025-09-17T19:51:54.015783] [INFO ] [REMOTE ] KB: Fetching primary data for 2025-09. [2025-09-17T19:51:54.116273] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T19:51:54.587910] [INFO ] [REMOTE ] KB: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:51:54.592333] [INFO ] [REMOTE ] KB: Full fetch complete (34838 records). [2025-09-17T19:51:54.592678] [DEBUG] [VALIDATOR ] KB: Validating primary data. [2025-09-17T19:51:54.741746] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T19:51:54.823883] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-03. [2025-09-17T19:51:55.046797] [DEBUG] [VALIDATOR ] KB: All expected trading days are present. [2025-09-17T19:51:55.046912] [DEBUG] [VALIDATOR ] KB: Primary data validation passed. [2025-09-17T19:51:55.048090] [INFO ] [MAIN ] KB: Fetched primary data is valid. [2025-09-17T19:51:55.048176] [DEBUG] [LOCAL ] KB: Saving primary data. [2025-09-17T19:51:55.049430] [DEBUG] [LOCAL ] KB: Trimmed 34838 records to 24487 (keeping 200 days of data) [2025-09-17T19:51:55.208662] [DEBUG] [LOCAL ] KB: Primary data saved (24487 records). [2025-09-17T19:51:55.208864] [INFO ] [MAIN ] KB: Full history saved. [2025-09-17T19:51:55.208986] [INFO ] [MAIN ] Update Progress: 1177/2371 symbols completed. KB took 32.4s. Estimated remaining: 2h 54m 22s. Rate: 6.8 symbols/min [2025-09-17T19:51:55.395763] [INFO ] [MAIN ] KD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:51:55.453592] [DEBUG] [LOCAL ] KD: Loaded 52317 existing records from primary storage. [2025-09-17T19:51:55.453834] [INFO ] [MAIN ] KD: Loaded 52317 existing records. [2025-09-17T19:51:55.620913] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-05. [2025-09-17T19:51:55.653815] [WARN ] [MAIN ] KD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:51:55.654143] [INFO ] [MAIN ] KD: Wiping existing primary data before full refresh. [2025-09-17T19:51:55.654192] [INFO ] [LOCAL ] KD: Starting deletion of primary data. [2025-09-17T19:51:55.655294] [DEBUG] [LOCAL ] KD: Deleted primary data file. [2025-09-17T19:51:55.655348] [INFO ] [MAIN ] KD: Starting full primary refresh. [2025-09-17T19:51:56.026754] [INFO ] [REMOTE ] KD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:51:56.051303] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T19:51:56.415815] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-11. [2025-09-17T19:51:57.215900] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-04. [2025-09-17T19:51:57.402070] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T19:51:57.658791] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T19:51:58.015767] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-06. [2025-09-17T19:51:58.342823] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T19:51:58.815818] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-05. [2025-09-17T19:51:59.361659] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T19:51:59.615874] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-07. [2025-09-17T19:52:00.420954] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-05. [2025-09-17T19:52:00.436953] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T19:52:01.215772] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-06. [2025-09-17T19:52:01.353161] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T19:52:01.378609] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T19:52:02.015788] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-08. [2025-09-17T19:52:02.815791] [INFO ] [REMOTE ] KD: Fetching primary data for 2024-12. [2025-09-17T19:52:02.856640] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T19:52:03.291532] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T19:52:03.615830] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-07. [2025-09-17T19:52:04.068241] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T19:52:04.415795] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-06. [2025-09-17T19:52:05.215755] [INFO ] [REMOTE ] KBR: Fetching primary data for 2025-09. [2025-09-17T19:52:05.309739] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T19:52:05.450699] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T19:52:05.692596] [INFO ] [REMOTE ] KBR: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T19:52:05.701746] [INFO ] [REMOTE ] KBR: Full fetch complete (69705 records). [2025-09-17T19:52:05.701955] [DEBUG] [VALIDATOR ] KBR: Validating primary data. [2025-09-17T19:52:06.020885] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-01. [2025-09-17T19:52:06.123097] [DEBUG] [VALIDATOR ] KBR: All expected trading days are present. [2025-09-17T19:52:06.123204] [DEBUG] [VALIDATOR ] KBR: Primary data validation passed. [2025-09-17T19:52:06.124275] [INFO ] [MAIN ] KBR: Fetched primary data is valid. [2025-09-17T19:52:06.124329] [DEBUG] [LOCAL ] KBR: Saving primary data. [2025-09-17T19:52:06.125857] [DEBUG] [LOCAL ] KBR: Trimmed 69705 records to 48362 (keeping 200 days of data) [2025-09-17T19:52:06.454179] [DEBUG] [LOCAL ] KBR: Primary data saved (48362 records). [2025-09-17T19:52:06.454349] [INFO ] [MAIN ] KBR: Full history saved. [2025-09-17T19:52:06.454492] [INFO ] [MAIN ] Update Progress: 1178/2371 symbols completed. KBR took 27.0s. Estimated remaining: 2h 54m 16s. Rate: 6.8 symbols/min [2025-09-17T19:52:06.655687] [INFO ] [MAIN ] KEN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:52:06.661877] [DEBUG] [LOCAL ] KEN: Loaded 4689 existing records from primary storage. [2025-09-17T19:52:06.661963] [INFO ] [MAIN ] KEN: Loaded 4689 existing records. [2025-09-17T19:52:06.818911] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-08. [2025-09-17T19:52:06.838935] [WARN ] [MAIN ] KEN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:52:06.840278] [INFO ] [MAIN ] KEN: Wiping existing primary data before full refresh. [2025-09-17T19:52:06.840344] [INFO ] [LOCAL ] KEN: Starting deletion of primary data. [2025-09-17T19:52:06.840666] [DEBUG] [LOCAL ] KEN: Deleted primary data file. [2025-09-17T19:52:06.840713] [INFO ] [MAIN ] KEN: Starting full primary refresh. [2025-09-17T19:52:07.208847] [INFO ] [REMOTE ] KEN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:52:07.615809] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-11. [2025-09-17T19:52:07.822069] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T19:52:08.084055] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T19:52:08.363689] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T19:52:08.415806] [INFO ] [REMOTE ] KEN: Fetching primary data for 2024-12. [2025-09-17T19:52:08.947786] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-17T19:52:09.215821] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-07. [2025-09-17T19:52:10.015782] [INFO ] [REMOTE ] KBH: Fetching primary data for 2025-09. [2025-09-17T19:52:10.217014] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T19:52:10.404223] [INFO ] [REMOTE ] KBH: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T19:52:10.411608] [INFO ] [REMOTE ] KBH: Full fetch complete (70183 records). [2025-09-17T19:52:10.411833] [DEBUG] [VALIDATOR ] KBH: Validating primary data. [2025-09-17T19:52:10.827280] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-02. [2025-09-17T19:52:10.832231] [DEBUG] [VALIDATOR ] KBH: All expected trading days are present. [2025-09-17T19:52:10.832384] [DEBUG] [VALIDATOR ] KBH: Primary data validation passed. [2025-09-17T19:52:10.833792] [INFO ] [MAIN ] KBH: Fetched primary data is valid. [2025-09-17T19:52:10.833970] [DEBUG] [LOCAL ] KBH: Saving primary data. [2025-09-17T19:52:10.836386] [DEBUG] [LOCAL ] KBH: Trimmed 70183 records to 48842 (keeping 200 days of data) [2025-09-17T19:52:11.166366] [DEBUG] [LOCAL ] KBH: Primary data saved (48842 records). [2025-09-17T19:52:11.166562] [INFO ] [MAIN ] KBH: Full history saved. [2025-09-17T19:52:11.166697] [INFO ] [MAIN ] Update Progress: 1179/2371 symbols completed. KBH took 34.8s. Estimated remaining: 2h 54m 3s. Rate: 6.8 symbols/min [2025-09-17T19:52:11.351898] [INFO ] [MAIN ] KEP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:52:11.389585] [DEBUG] [LOCAL ] KEP: Loaded 30335 existing records from primary storage. [2025-09-17T19:52:11.389823] [INFO ] [MAIN ] KEP: Loaded 30335 existing records. [2025-09-17T19:52:11.576600] [WARN ] [MAIN ] KEP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:52:11.576922] [INFO ] [MAIN ] KEP: Wiping existing primary data before full refresh. [2025-09-17T19:52:11.576971] [INFO ] [LOCAL ] KEP: Starting deletion of primary data. [2025-09-17T19:52:11.577676] [DEBUG] [LOCAL ] KEP: Deleted primary data file. [2025-09-17T19:52:11.577738] [INFO ] [MAIN ] KEP: Starting full primary refresh. [2025-09-17T19:52:11.622445] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-08. [2025-09-17T19:52:11.934877] [INFO ] [REMOTE ] KEP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:52:12.415816] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-11. [2025-09-17T19:52:12.504126] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T19:52:12.627620] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T19:52:13.215780] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-03. [2025-09-17T19:52:13.324133] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T19:52:14.015836] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-01. [2025-09-17T19:52:14.580005] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T19:52:14.776093] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T19:52:14.815744] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-04. [2025-09-17T19:52:15.615775] [INFO ] [REMOTE ] KEP: Fetching primary data for 2024-12. [2025-09-17T19:52:16.415858] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-02. [2025-09-17T19:52:16.599326] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T19:52:16.803499] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T19:52:16.888312] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T19:52:17.215789] [INFO ] [REMOTE ] KBDC: Fetching primary data for 2025-09. [2025-09-17T19:52:17.814685] [INFO ] [REMOTE ] KBDC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T19:52:17.818933] [INFO ] [REMOTE ] KBDC: Full fetch complete (27259 records). [2025-09-17T19:52:17.819054] [DEBUG] [VALIDATOR ] KBDC: Validating primary data. [2025-09-17T19:52:18.020909] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-03. [2025-09-17T19:52:18.206808] [DEBUG] [VALIDATOR ] KBDC: All expected trading days are present. [2025-09-17T19:52:18.206893] [DEBUG] [VALIDATOR ] KBDC: Primary data validation passed. [2025-09-17T19:52:18.207530] [INFO ] [MAIN ] KBDC: Fetched primary data is valid. [2025-09-17T19:52:18.207589] [DEBUG] [LOCAL ] KBDC: Saving primary data. [2025-09-17T19:52:18.208537] [DEBUG] [LOCAL ] KBDC: Trimmed 27259 records to 20545 (keeping 200 days of data) [2025-09-17T19:52:18.337880] [DEBUG] [LOCAL ] KBDC: Primary data saved (20545 records). [2025-09-17T19:52:18.338018] [INFO ] [MAIN ] KBDC: Full history saved. [2025-09-17T19:52:18.338101] [INFO ] [MAIN ] Update Progress: 1180/2371 symbols completed. KBDC took 44.2s. Estimated remaining: 2h 53m 53s. Rate: 6.8 symbols/min [2025-09-17T19:52:18.508697] [INFO ] [MAIN ] KEX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:52:18.547222] [DEBUG] [LOCAL ] KEX: Loaded 37680 existing records from primary storage. [2025-09-17T19:52:18.547422] [INFO ] [MAIN ] KEX: Loaded 37680 existing records. [2025-09-17T19:52:18.728201] [WARN ] [MAIN ] KEX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:52:18.732836] [INFO ] [MAIN ] KEX: Wiping existing primary data before full refresh. [2025-09-17T19:52:18.732754] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T19:52:18.732940] [INFO ] [LOCAL ] KEX: Starting deletion of primary data. [2025-09-17T19:52:18.735598] [DEBUG] [LOCAL ] KEX: Deleted primary data file. [2025-09-17T19:52:18.735678] [INFO ] [MAIN ] KEX: Starting full primary refresh. [2025-09-17T19:52:18.820930] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-01. [2025-09-17T19:52:19.101516] [INFO ] [REMOTE ] KEX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:52:19.615778] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-05. [2025-09-17T19:52:19.844677] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T19:52:20.415792] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-02. [2025-09-17T19:52:21.215783] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-11. [2025-09-17T19:52:21.405014] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T19:52:21.505330] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T19:52:22.015775] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-03. [2025-09-17T19:52:22.562217] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T19:52:22.815778] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-06. [2025-09-17T19:52:22.919123] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T19:52:23.615791] [INFO ] [REMOTE ] KEX: Fetching primary data for 2024-12. [2025-09-17T19:52:24.415821] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-04. [2025-09-17T19:52:24.530801] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T19:52:25.115144] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T19:52:25.215765] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-07. [2025-09-17T19:52:25.764864] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T19:52:26.015812] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-04. [2025-09-17T19:52:26.789070] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T19:52:26.815724] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-05. [2025-09-17T19:52:27.054476] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T19:52:27.295275] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T19:52:27.615774] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-01. [2025-09-17T19:52:28.415790] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-05. [2025-09-17T19:52:29.119900] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T19:52:29.215828] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-02. [2025-09-17T19:52:29.732209] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T19:52:30.015828] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-06. [2025-09-17T19:52:30.625001] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T19:52:30.815797] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-06. [2025-09-17T19:52:31.129156] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T19:52:31.417271] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T19:52:31.615803] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-03. [2025-09-17T19:52:32.415803] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-07. [2025-09-17T19:52:32.820485] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T19:52:33.053957] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T19:52:33.215779] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-04. [2025-09-17T19:52:34.015823] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-07. [2025-09-17T19:52:34.720639] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T19:52:34.815806] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-08. [2025-09-17T19:52:35.263191] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T19:52:35.615810] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-08. [2025-09-17T19:52:36.415827] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-08. [2025-09-17T19:52:36.680550] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T19:52:36.985408] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T19:52:37.006619] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T19:52:37.215791] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-05. [2025-09-17T19:52:38.015844] [INFO ] [REMOTE ] KEN: Fetching primary data for 2025-09. [2025-09-17T19:52:38.487608] [INFO ] [REMOTE ] KEN: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T19:52:38.489107] [INFO ] [REMOTE ] KEN: Full fetch complete (5919 records). [2025-09-17T19:52:38.489193] [DEBUG] [VALIDATOR ] KEN: Validating primary data. [2025-09-17T19:52:38.685164] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T19:52:38.824992] [INFO ] [REMOTE ] KD: Fetching primary data for 2025-09. [2025-09-17T19:52:39.111360] [DEBUG] [VALIDATOR ] KEN: All expected trading days are present. [2025-09-17T19:52:39.111460] [DEBUG] [VALIDATOR ] KEN: Primary data validation passed. [2025-09-17T19:52:39.111726] [INFO ] [MAIN ] KEN: Fetched primary data is valid. [2025-09-17T19:52:39.111773] [DEBUG] [LOCAL ] KEN: Saving primary data. [2025-09-17T19:52:39.112447] [DEBUG] [LOCAL ] KEN: Trimmed 5919 records to 4724 (keeping 200 days of data) [2025-09-17T19:52:39.150959] [DEBUG] [LOCAL ] KEN: Primary data saved (4724 records). [2025-09-17T19:52:39.151167] [INFO ] [MAIN ] KEN: Full history saved. [2025-09-17T19:52:39.151306] [INFO ] [MAIN ] Update Progress: 1181/2371 symbols completed. KEN took 32.7s. Estimated remaining: 2h 53m 56s. Rate: 6.8 symbols/min [2025-09-17T19:52:39.422581] [INFO ] [MAIN ] KEY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:52:39.422815] [DEBUG] [LOCAL ] KEY: No existing data file found in primary storage. [2025-09-17T19:52:39.422874] [WARN ] [MAIN ] KEY: No existing data found, performing full refresh instead. [2025-09-17T19:52:39.423022] [INFO ] [MAIN ] KEY: Wiping existing primary data before full refresh. [2025-09-17T19:52:39.423063] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-17T19:52:39.423104] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-17T19:52:39.423138] [INFO ] [MAIN ] KEY: Starting full primary refresh. [2025-09-17T19:52:39.621219] [INFO ] [REMOTE ] KEP: Fetching primary data for 2025-09. [2025-09-17T19:52:39.818235] [INFO ] [REMOTE ] KEY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:52:39.842334] [INFO ] [REMOTE ] KD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T19:52:39.850282] [INFO ] [REMOTE ] KD: Full fetch complete (75420 records). [2025-09-17T19:52:39.850479] [DEBUG] [VALIDATOR ] KD: Validating primary data. [2025-09-17T19:52:40.259381] [DEBUG] [VALIDATOR ] KD: All expected trading days are present. [2025-09-17T19:52:40.259608] [DEBUG] [VALIDATOR ] KD: Primary data validation passed. [2025-09-17T19:52:40.261185] [INFO ] [MAIN ] KD: Fetched primary data is valid. [2025-09-17T19:52:40.261329] [DEBUG] [LOCAL ] KD: Saving primary data. [2025-09-17T19:52:40.273170] [INFO ] [REMOTE ] KEP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T19:52:40.277466] [INFO ] [REMOTE ] KEP: Full fetch complete (41400 records). [2025-09-17T19:52:40.277600] [DEBUG] [VALIDATOR ] KEP: Validating primary data. [2025-09-17T19:52:40.277932] [DEBUG] [LOCAL ] KD: Trimmed 75420 records to 52300 (keeping 200 days of data) [2025-09-17T19:52:40.424223] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-06. [2025-09-17T19:52:40.764843] [DEBUG] [VALIDATOR ] KEP: All expected trading days are present. [2025-09-17T19:52:40.767895] [DEBUG] [VALIDATOR ] KEP: Primary data validation passed. [2025-09-17T19:52:40.770384] [INFO ] [MAIN ] KEP: Fetched primary data is valid. [2025-09-17T19:52:40.771691] [DEBUG] [LOCAL ] KEP: Saving primary data. [2025-09-17T19:52:40.785930] [DEBUG] [LOCAL ] KEP: Trimmed 41400 records to 30243 (keeping 200 days of data) [2025-09-17T19:52:41.062175] [DEBUG] [LOCAL ] KEP: Primary data saved (30243 records). [2025-09-17T19:52:41.063512] [INFO ] [MAIN ] KEP: Full history saved. [2025-09-17T19:52:41.064189] [INFO ] [MAIN ] Update Progress: 1182/2371 symbols completed. KEP took 29.9s. Estimated remaining: 2h 53m 41s. Rate: 6.8 symbols/min [2025-09-17T19:52:41.216214] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-11. [2025-09-17T19:52:41.241342] [INFO ] [MAIN ] KEYS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:52:41.350291] [DEBUG] [LOCAL ] KEYS: Loaded 43478 existing records from primary storage. [2025-09-17T19:52:41.349592] [DEBUG] [LOCAL ] KD: Primary data saved (52300 records). [2025-09-17T19:52:41.350454] [INFO ] [MAIN ] KD: Full history saved. [2025-09-17T19:52:41.350502] [INFO ] [MAIN ] KEYS: Loaded 43478 existing records. [2025-09-17T19:52:41.350618] [INFO ] [MAIN ] Update Progress: 1183/2371 symbols completed. KD took 46.1s. Estimated remaining: 2h 53m 23s. Rate: 6.9 symbols/min [2025-09-17T19:52:41.728970] [WARN ] [MAIN ] KEYS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:52:41.731471] [INFO ] [MAIN ] KF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:52:41.731937] [INFO ] [MAIN ] KEYS: Wiping existing primary data before full refresh. [2025-09-17T19:52:41.732439] [INFO ] [LOCAL ] KEYS: Starting deletion of primary data. [2025-09-17T19:52:41.733453] [DEBUG] [LOCAL ] KEYS: Deleted primary data file. [2025-09-17T19:52:41.734380] [INFO ] [MAIN ] KEYS: Starting full primary refresh. [2025-09-17T19:52:41.810545] [DEBUG] [LOCAL ] KF: Loaded 2521 existing records from primary storage. [2025-09-17T19:52:41.828599] [INFO ] [MAIN ] KF: Loaded 2521 existing records. [2025-09-17T19:52:42.083699] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T19:52:42.214459] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-07. [2025-09-17T19:52:42.261060] [WARN ] [MAIN ] KF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:52:42.264790] [INFO ] [MAIN ] KF: Wiping existing primary data before full refresh. [2025-09-17T19:52:42.275751] [INFO ] [LOCAL ] KF: Starting deletion of primary data. [2025-09-17T19:52:42.327353] [DEBUG] [LOCAL ] KF: Deleted primary data file. [2025-09-17T19:52:42.346898] [INFO ] [REMOTE ] KEYS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:52:42.347024] [INFO ] [MAIN ] KF: Starting full primary refresh. [2025-09-17T19:52:42.733330] [INFO ] [REMOTE ] KF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:52:42.815835] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-11. [2025-09-17T19:52:43.003307] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T19:52:43.154527] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-17T19:52:43.290412] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T19:52:43.615816] [INFO ] [REMOTE ] KEY: Fetching primary data for 2024-12. [2025-09-17T19:52:44.415790] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-08. [2025-09-17T19:52:45.215781] [INFO ] [REMOTE ] KF: Fetching primary data for 2024-12. [2025-09-17T19:52:45.328262] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T19:52:45.818615] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T19:52:45.939443] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T19:52:46.015806] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-01. [2025-09-17T19:52:46.549892] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T19:52:46.815787] [INFO ] [REMOTE ] KEX: Fetching primary data for 2025-09. [2025-09-17T19:52:47.539244] [INFO ] [REMOTE ] KEX: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T19:52:47.545581] [INFO ] [REMOTE ] KEX: Full fetch complete (55026 records). [2025-09-17T19:52:47.545827] [DEBUG] [VALIDATOR ] KEX: Validating primary data. [2025-09-17T19:52:47.621028] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-01. [2025-09-17T19:52:47.957065] [DEBUG] [VALIDATOR ] KEX: All expected trading days are present. [2025-09-17T19:52:47.957170] [DEBUG] [VALIDATOR ] KEX: Primary data validation passed. [2025-09-17T19:52:47.958187] [INFO ] [MAIN ] KEX: Fetched primary data is valid. [2025-09-17T19:52:47.958254] [DEBUG] [LOCAL ] KEX: Saving primary data. [2025-09-17T19:52:47.959714] [DEBUG] [LOCAL ] KEX: Trimmed 55026 records to 37719 (keeping 200 days of data) [2025-09-17T19:52:48.198894] [DEBUG] [LOCAL ] KEX: Primary data saved (37719 records). [2025-09-17T19:52:48.199110] [INFO ] [MAIN ] KEX: Full history saved. [2025-09-17T19:52:48.200805] [INFO ] [MAIN ] Update Progress: 1184/2371 symbols completed. KEX took 29.9s. Estimated remaining: 2h 53m 13s. Rate: 6.9 symbols/min [2025-09-17T19:52:48.373294] [INFO ] [MAIN ] KFRC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:52:48.395252] [DEBUG] [LOCAL ] KFRC: Loaded 19076 existing records from primary storage. [2025-09-17T19:52:48.395413] [INFO ] [MAIN ] KFRC: Loaded 19076 existing records. [2025-09-17T19:52:48.427061] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-02. [2025-09-17T19:52:48.579983] [WARN ] [MAIN ] KFRC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:52:48.580241] [INFO ] [MAIN ] KFRC: Wiping existing primary data before full refresh. [2025-09-17T19:52:48.580294] [INFO ] [LOCAL ] KFRC: Starting deletion of primary data. [2025-09-17T19:52:48.580901] [DEBUG] [LOCAL ] KFRC: Deleted primary data file. [2025-09-17T19:52:48.580973] [INFO ] [MAIN ] KFRC: Starting full primary refresh. [2025-09-17T19:52:48.961801] [INFO ] [REMOTE ] KFRC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:52:48.962060] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T19:52:49.215857] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-03. [2025-09-17T19:52:49.530364] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T19:52:49.705258] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-17T19:52:50.015831] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-04. [2025-09-17T19:52:50.478314] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T19:52:50.815817] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-11. [2025-09-17T19:52:51.615785] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-11. [2025-09-17T19:52:51.742372] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T19:52:52.415794] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-05. [2025-09-17T19:52:52.975030] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T19:52:53.223042] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2024-12. [2025-09-17T19:52:53.242254] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T19:52:54.015790] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2024-12. [2025-09-17T19:52:54.071291] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T19:52:54.815789] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-01. [2025-09-17T19:52:55.523574] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T19:52:55.553086] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T19:52:55.615764] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-01. [2025-09-17T19:52:56.415981] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-02. [2025-09-17T19:52:57.211634] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T19:52:57.215678] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-03. [2025-09-17T19:52:57.337558] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T19:52:58.015817] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-06. [2025-09-17T19:52:58.173128] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T19:52:58.521240] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T19:52:58.815802] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-04. [2025-09-17T19:52:59.615777] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-02. [2025-09-17T19:52:59.850474] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T19:53:00.415818] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-02. [2025-09-17T19:53:01.032246] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T19:53:01.215777] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-07. [2025-09-17T19:53:01.774841] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T19:53:01.964890] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T19:53:02.015805] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-05. [2025-09-17T19:53:02.815833] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-03. [2025-09-17T19:53:03.011080] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T19:53:03.615785] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-06. [2025-09-17T19:53:04.308121] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T19:53:04.406874] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T19:53:04.416048] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-03. [2025-09-17T19:53:05.215796] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-04. [2025-09-17T19:53:06.015819] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-07. [2025-09-17T19:53:06.192758] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T19:53:06.771422] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T19:53:06.815692] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-08. [2025-09-17T19:53:06.946751] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T19:53:07.615779] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-08. [2025-09-17T19:53:07.965522] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T19:53:08.048582] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T19:53:08.415777] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-05. [2025-09-17T19:53:09.215791] [INFO ] [REMOTE ] KF: Fetching primary data for 2025-09. [2025-09-17T19:53:09.533571] [INFO ] [REMOTE ] KF: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T19:53:09.534456] [INFO ] [REMOTE ] KF: Full fetch complete (3940 records). [2025-09-17T19:53:09.534523] [DEBUG] [VALIDATOR ] KF: Validating primary data. [2025-09-17T19:53:09.922273] [DEBUG] [VALIDATOR ] KF: All expected trading days are present. [2025-09-17T19:53:09.922368] [DEBUG] [VALIDATOR ] KF: Primary data validation passed. [2025-09-17T19:53:09.922610] [INFO ] [MAIN ] KF: Fetched primary data is valid. [2025-09-17T19:53:09.922713] [DEBUG] [LOCAL ] KF: Saving primary data. [2025-09-17T19:53:09.923160] [DEBUG] [LOCAL ] KF: Trimmed 3940 records to 2507 (keeping 200 days of data) [2025-09-17T19:53:09.940128] [DEBUG] [LOCAL ] KF: Primary data saved (2507 records). [2025-09-17T19:53:09.940187] [INFO ] [MAIN ] KF: Full history saved. [2025-09-17T19:53:09.940270] [INFO ] [MAIN ] Update Progress: 1185/2371 symbols completed. KF took 28.5s. Estimated remaining: 2h 53m 17s. Rate: 6.8 symbols/min [2025-09-17T19:53:10.017471] [INFO ] [REMOTE ] KFRC: Fetching primary data for 2025-09. [2025-09-17T19:53:10.122009] [INFO ] [MAIN ] KFS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:53:10.153778] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T19:53:10.167750] [DEBUG] [LOCAL ] KFS: Loaded 8004 existing records from primary storage. [2025-09-17T19:53:10.168539] [INFO ] [MAIN ] KFS: Loaded 8004 existing records. [2025-09-17T19:53:10.364181] [WARN ] [MAIN ] KFS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:53:10.364500] [INFO ] [MAIN ] KFS: Wiping existing primary data before full refresh. [2025-09-17T19:53:10.364551] [INFO ] [LOCAL ] KFS: Starting deletion of primary data. [2025-09-17T19:53:10.364981] [DEBUG] [LOCAL ] KFS: Deleted primary data file. [2025-09-17T19:53:10.365060] [INFO ] [MAIN ] KFS: Starting full primary refresh. [2025-09-17T19:53:10.733456] [INFO ] [REMOTE ] KFS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:53:10.815795] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-06. [2025-09-17T19:53:10.934484] [INFO ] [REMOTE ] KFRC: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T19:53:10.938322] [INFO ] [REMOTE ] KFRC: Full fetch complete (24817 records). [2025-09-17T19:53:10.938476] [DEBUG] [VALIDATOR ] KFRC: Validating primary data. [2025-09-17T19:53:11.333314] [DEBUG] [VALIDATOR ] KFRC: All expected trading days are present. [2025-09-17T19:53:11.333449] [DEBUG] [VALIDATOR ] KFRC: Primary data validation passed. [2025-09-17T19:53:11.334126] [INFO ] [MAIN ] KFRC: Fetched primary data is valid. [2025-09-17T19:53:11.334215] [DEBUG] [LOCAL ] KFRC: Saving primary data. [2025-09-17T19:53:11.335351] [DEBUG] [LOCAL ] KFRC: Trimmed 24817 records to 19132 (keeping 200 days of data) [2025-09-17T19:53:11.458078] [DEBUG] [LOCAL ] KFRC: Primary data saved (19132 records). [2025-09-17T19:53:11.458249] [INFO ] [MAIN ] KFRC: Full history saved. [2025-09-17T19:53:11.458371] [INFO ] [MAIN ] Update Progress: 1186/2371 symbols completed. KFRC took 23.3s. Estimated remaining: 2h 53m 1s. Rate: 6.8 symbols/min [2025-09-17T19:53:11.616536] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-04. [2025-09-17T19:53:11.635528] [INFO ] [MAIN ] KFY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:53:11.671133] [DEBUG] [LOCAL ] KFY: Loaded 30758 existing records from primary storage. [2025-09-17T19:53:11.671294] [INFO ] [MAIN ] KFY: Loaded 30758 existing records. [2025-09-17T19:53:11.855970] [WARN ] [MAIN ] KFY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:53:11.856305] [INFO ] [MAIN ] KFY: Wiping existing primary data before full refresh. [2025-09-17T19:53:11.856364] [INFO ] [LOCAL ] KFY: Starting deletion of primary data. [2025-09-17T19:53:11.857278] [DEBUG] [LOCAL ] KFY: Deleted primary data file. [2025-09-17T19:53:11.857334] [INFO ] [MAIN ] KFY: Starting full primary refresh. [2025-09-17T19:53:12.231763] [INFO ] [REMOTE ] KFY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:53:12.417877] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-11. [2025-09-17T19:53:12.420606] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T19:53:13.157449] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T19:53:13.215789] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-07. [2025-09-17T19:53:13.277983] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T19:53:14.015784] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-11. [2025-09-17T19:53:14.757148] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T19:53:14.815746] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-08. [2025-09-17T19:53:15.119164] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T19:53:15.615789] [INFO ] [REMOTE ] KFS: Fetching primary data for 2024-12. [2025-09-17T19:53:16.110814] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T19:53:16.232049] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T19:53:16.415803] [INFO ] [REMOTE ] KEYS: Fetching primary data for 2025-09. [2025-09-17T19:53:17.160223] [INFO ] [REMOTE ] KEYS: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T19:53:17.166148] [INFO ] [REMOTE ] KEYS: Full fetch complete (62911 records). [2025-09-17T19:53:17.166251] [DEBUG] [VALIDATOR ] KEYS: Validating primary data. [2025-09-17T19:53:17.220930] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-05. [2025-09-17T19:53:17.554383] [DEBUG] [VALIDATOR ] KEYS: All expected trading days are present. [2025-09-17T19:53:17.554464] [DEBUG] [VALIDATOR ] KEYS: Primary data validation passed. [2025-09-17T19:53:17.555327] [INFO ] [MAIN ] KEYS: Fetched primary data is valid. [2025-09-17T19:53:17.555372] [DEBUG] [LOCAL ] KEYS: Saving primary data. [2025-09-17T19:53:17.557078] [DEBUG] [LOCAL ] KEYS: Trimmed 62911 records to 43452 (keeping 200 days of data) [2025-09-17T19:53:17.831195] [DEBUG] [LOCAL ] KEYS: Primary data saved (43452 records). [2025-09-17T19:53:17.831335] [INFO ] [MAIN ] KEYS: Full history saved. [2025-09-17T19:53:17.831446] [INFO ] [MAIN ] Update Progress: 1187/2371 symbols completed. KEYS took 36.8s. Estimated remaining: 2h 52m 50s. Rate: 6.9 symbols/min [2025-09-17T19:53:18.001657] [INFO ] [MAIN ] KGC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:53:18.015786] [INFO ] [REMOTE ] KFY: Fetching primary data for 2024-12. [2025-09-17T19:53:18.057043] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-17T19:53:18.057196] [INFO ] [MAIN ] KGC: Loaded 53699 existing records. [2025-09-17T19:53:18.234135] [WARN ] [MAIN ] KGC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:53:18.234359] [INFO ] [MAIN ] KGC: Wiping existing primary data before full refresh. [2025-09-17T19:53:18.234402] [INFO ] [LOCAL ] KGC: Starting deletion of primary data. [2025-09-17T19:53:18.235557] [DEBUG] [LOCAL ] KGC: Deleted primary data file. [2025-09-17T19:53:18.235605] [INFO ] [MAIN ] KGC: Starting full primary refresh. [2025-09-17T19:53:18.595830] [INFO ] [REMOTE ] KGC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:53:18.822043] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-11. [2025-09-17T19:53:18.842364] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T19:53:19.347543] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T19:53:19.615778] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-06. [2025-09-17T19:53:20.415843] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-01. [2025-09-17T19:53:20.879937] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-11 (2.06 seconds). [2025-09-17T19:53:21.215776] [INFO ] [REMOTE ] KGC: Fetching primary data for 2024-12. [2025-09-17T19:53:21.363446] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T19:53:21.393482] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T19:53:22.015774] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-02. [2025-09-17T19:53:22.591508] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T19:53:22.803318] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T19:53:22.815678] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-01. [2025-09-17T19:53:23.615831] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-01. [2025-09-17T19:53:24.415859] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-03. [2025-09-17T19:53:24.639212] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T19:53:24.666696] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T19:53:25.097504] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T19:53:25.215821] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-02. [2025-09-17T19:53:26.015798] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-02. [2025-09-17T19:53:26.815865] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-07. [2025-09-17T19:53:27.054566] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T19:53:27.260056] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T19:53:27.615832] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-03. [2025-09-17T19:53:28.342363] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T19:53:28.415738] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-08. [2025-09-17T19:53:29.106859] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T19:53:29.215769] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-04. [2025-09-17T19:53:30.015829] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-03. [2025-09-17T19:53:30.309857] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T19:53:30.655189] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T19:53:30.815811] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-05. [2025-09-17T19:53:31.615794] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-04. [2025-09-17T19:53:32.040067] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T19:53:32.097435] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T19:53:32.393458] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T19:53:32.415777] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-05. [2025-09-17T19:53:33.188143] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T19:53:33.215816] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-06. [2025-09-17T19:53:33.894630] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T19:53:34.015821] [INFO ] [REMOTE ] KEY: Fetching primary data for 2025-09. [2025-09-17T19:53:34.815783] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-06. [2025-09-17T19:53:34.864591] [INFO ] [REMOTE ] KEY: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T19:53:34.871700] [INFO ] [REMOTE ] KEY: Full fetch complete (77096 records). [2025-09-17T19:53:34.871904] [DEBUG] [VALIDATOR ] KEY: Validating primary data. [2025-09-17T19:53:35.088533] [WARN ] [VALIDATOR ] KEY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T19:53:35.089486] [FATAL] [MAIN ] KEY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:53:35.089551] [WARN ] [MAIN ] KEY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:53:35.089611] [INFO ] [LOCAL ] KEY: Starting deletion of primary data. [2025-09-17T19:53:35.089739] [DEBUG] [LOCAL ] KEY: No primary data file found to delete. [2025-09-17T19:53:35.089784] [INFO ] [LOCAL ] KEY: Starting deletion of derivative data. [2025-09-17T19:53:35.089835] [DEBUG] [LOCAL ] KEY: No derivative data file found to delete. [2025-09-17T19:53:35.089939] [INFO ] [MAIN ] Update Progress: 1188/2371 symbols completed. KEY took 55.9s. Estimated remaining: 2h 52m 49s. Rate: 6.8 symbols/min [2025-09-17T19:53:35.274023] [INFO ] [MAIN ] KGS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:53:35.327980] [DEBUG] [LOCAL ] KGS: Loaded 45743 existing records from primary storage. [2025-09-17T19:53:35.328228] [INFO ] [MAIN ] KGS: Loaded 45743 existing records. [2025-09-17T19:53:35.514358] [WARN ] [MAIN ] KGS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:53:35.514735] [INFO ] [MAIN ] KGS: Wiping existing primary data before full refresh. [2025-09-17T19:53:35.514790] [INFO ] [LOCAL ] KGS: Starting deletion of primary data. [2025-09-17T19:53:35.516209] [DEBUG] [LOCAL ] KGS: Deleted primary data file. [2025-09-17T19:53:35.516265] [INFO ] [MAIN ] KGS: Starting full primary refresh. [2025-09-17T19:53:35.619450] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-04. [2025-09-17T19:53:35.893409] [INFO ] [REMOTE ] KGS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:53:36.236790] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T19:53:36.415804] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-11. [2025-09-17T19:53:37.215829] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-07. [2025-09-17T19:53:37.855251] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-04 (2.24 seconds). [2025-09-17T19:53:37.922075] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T19:53:37.981360] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T19:53:38.015820] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-07. [2025-09-17T19:53:38.815826] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-05. [2025-09-17T19:53:39.346026] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T19:53:39.615764] [INFO ] [REMOTE ] KGS: Fetching primary data for 2024-12. [2025-09-17T19:53:40.415793] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-08. [2025-09-17T19:53:40.646185] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T19:53:40.903140] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T19:53:41.220799] [INFO ] [REMOTE ] KFS: Fetching primary data for 2025-09. [2025-09-17T19:53:41.236071] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T19:53:41.690399] [INFO ] [REMOTE ] KFS: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T19:53:41.692164] [INFO ] [REMOTE ] KFS: Full fetch complete (10268 records). [2025-09-17T19:53:41.692231] [DEBUG] [VALIDATOR ] KFS: Validating primary data. [2025-09-17T19:53:42.020934] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-06. [2025-09-17T19:53:42.050848] [DEBUG] [VALIDATOR ] KFS: All expected trading days are present. [2025-09-17T19:53:42.050917] [DEBUG] [VALIDATOR ] KFS: Primary data validation passed. [2025-09-17T19:53:42.051183] [INFO ] [MAIN ] KFS: Fetched primary data is valid. [2025-09-17T19:53:42.051220] [DEBUG] [LOCAL ] KFS: Saving primary data. [2025-09-17T19:53:42.051695] [DEBUG] [LOCAL ] KFS: Trimmed 10268 records to 8100 (keeping 200 days of data) [2025-09-17T19:53:42.099981] [DEBUG] [LOCAL ] KFS: Primary data saved (8100 records). [2025-09-17T19:53:42.100096] [INFO ] [MAIN ] KFS: Full history saved. [2025-09-17T19:53:42.100197] [INFO ] [MAIN ] Update Progress: 1189/2371 symbols completed. KFS took 32.2s. Estimated remaining: 2h 52m 39s. Rate: 6.8 symbols/min [2025-09-17T19:53:42.268927] [INFO ] [MAIN ] KIM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:53:42.337655] [DEBUG] [LOCAL ] KIM: Loaded 53076 existing records from primary storage. [2025-09-17T19:53:42.337933] [INFO ] [MAIN ] KIM: Loaded 53076 existing records. [2025-09-17T19:53:42.520168] [WARN ] [MAIN ] KIM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:53:42.520505] [INFO ] [MAIN ] KIM: Wiping existing primary data before full refresh. [2025-09-17T19:53:42.520585] [INFO ] [LOCAL ] KIM: Starting deletion of primary data. [2025-09-17T19:53:42.522219] [DEBUG] [LOCAL ] KIM: Deleted primary data file. [2025-09-17T19:53:42.522271] [INFO ] [MAIN ] KIM: Starting full primary refresh. [2025-09-17T19:53:42.821002] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-01. [2025-09-17T19:53:42.886569] [INFO ] [REMOTE ] KIM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:53:43.615766] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-08. [2025-09-17T19:53:43.953674] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T19:53:44.415847] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-11. [2025-09-17T19:53:44.458224] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T19:53:44.521260] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T19:53:45.215817] [INFO ] [REMOTE ] KFY: Fetching primary data for 2025-09. [2025-09-17T19:53:45.878046] [INFO ] [REMOTE ] KFY: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T19:53:45.882569] [INFO ] [REMOTE ] KFY: Full fetch complete (43657 records). [2025-09-17T19:53:45.882719] [DEBUG] [VALIDATOR ] KFY: Validating primary data. [2025-09-17T19:53:46.018363] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-02. [2025-09-17T19:53:46.297574] [DEBUG] [VALIDATOR ] KFY: All expected trading days are present. [2025-09-17T19:53:46.297689] [DEBUG] [VALIDATOR ] KFY: Primary data validation passed. [2025-09-17T19:53:46.298511] [INFO ] [MAIN ] KFY: Fetched primary data is valid. [2025-09-17T19:53:46.298669] [DEBUG] [LOCAL ] KFY: Saving primary data. [2025-09-17T19:53:46.331555] [DEBUG] [LOCAL ] KFY: Trimmed 43657 records to 30780 (keeping 200 days of data) [2025-09-17T19:53:46.334501] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T19:53:46.532017] [DEBUG] [LOCAL ] KFY: Primary data saved (30780 records). [2025-09-17T19:53:46.532160] [INFO ] [MAIN ] KFY: Full history saved. [2025-09-17T19:53:46.532267] [INFO ] [MAIN ] Update Progress: 1190/2371 symbols completed. KFY took 35.1s. Estimated remaining: 2h 52m 26s. Rate: 6.8 symbols/min [2025-09-17T19:53:46.700853] [INFO ] [MAIN ] KIO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:53:46.721541] [DEBUG] [LOCAL ] KIO: Loaded 21439 existing records from primary storage. [2025-09-17T19:53:46.721688] [INFO ] [MAIN ] KIO: Loaded 21439 existing records. [2025-09-17T19:53:46.821135] [INFO ] [REMOTE ] KIM: Fetching primary data for 2024-12. [2025-09-17T19:53:46.916945] [WARN ] [MAIN ] KIO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:53:46.917294] [INFO ] [MAIN ] KIO: Wiping existing primary data before full refresh. [2025-09-17T19:53:46.917347] [INFO ] [LOCAL ] KIO: Starting deletion of primary data. [2025-09-17T19:53:46.917975] [DEBUG] [LOCAL ] KIO: Deleted primary data file. [2025-09-17T19:53:46.918046] [INFO ] [MAIN ] KIO: Starting full primary refresh. [2025-09-17T19:53:47.293761] [INFO ] [REMOTE ] KIO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:53:47.610486] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T19:53:47.619634] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-11. [2025-09-17T19:53:48.145628] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T19:53:48.415840] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-07. [2025-09-17T19:53:48.786087] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T19:53:49.215793] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-01. [2025-09-17T19:53:50.015810] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-03. [2025-09-17T19:53:50.424072] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T19:53:50.785812] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T19:53:50.815817] [INFO ] [REMOTE ] KIO: Fetching primary data for 2024-12. [2025-09-17T19:53:51.498913] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T19:53:51.609411] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T19:53:51.623344] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-02. [2025-09-17T19:53:52.415846] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-01. [2025-09-17T19:53:53.215831] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-04. [2025-09-17T19:53:53.341231] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T19:53:53.475814] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T19:53:54.015808] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-02. [2025-09-17T19:53:54.647635] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T19:53:54.815749] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-08. [2025-09-17T19:53:55.217142] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T19:53:55.615811] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-03. [2025-09-17T19:53:56.415833] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-05. [2025-09-17T19:53:56.894685] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T19:53:56.993360] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T19:53:57.215803] [INFO ] [REMOTE ] KGC: Fetching primary data for 2025-09. [2025-09-17T19:53:57.876892] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T19:53:57.943118] [INFO ] [REMOTE ] KGC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T19:53:57.954536] [INFO ] [REMOTE ] KGC: Full fetch complete (77601 records). [2025-09-17T19:53:57.954931] [DEBUG] [VALIDATOR ] KGC: Validating primary data. [2025-09-17T19:53:58.021040] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-03. [2025-09-17T19:53:58.383043] [DEBUG] [VALIDATOR ] KGC: All expected trading days are present. [2025-09-17T19:53:58.383156] [DEBUG] [VALIDATOR ] KGC: Primary data validation passed. [2025-09-17T19:53:58.384374] [INFO ] [MAIN ] KGC: Fetched primary data is valid. [2025-09-17T19:53:58.384433] [DEBUG] [LOCAL ] KGC: Saving primary data. [2025-09-17T19:53:58.386432] [DEBUG] [LOCAL ] KGC: Trimmed 77601 records to 53699 (keeping 200 days of data) [2025-09-17T19:53:58.760708] [DEBUG] [LOCAL ] KGC: Primary data saved (53699 records). [2025-09-17T19:53:58.760930] [INFO ] [MAIN ] KGC: Full history saved. [2025-09-17T19:53:58.761043] [INFO ] [MAIN ] Update Progress: 1191/2371 symbols completed. KGC took 40.9s. Estimated remaining: 2h 52m 20s. Rate: 6.8 symbols/min [2025-09-17T19:53:58.825621] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-06. [2025-09-17T19:53:58.938539] [INFO ] [MAIN ] KKR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:53:58.995131] [DEBUG] [LOCAL ] KKR: Loaded 53517 existing records from primary storage. [2025-09-17T19:53:58.995337] [INFO ] [MAIN ] KKR: Loaded 53517 existing records. [2025-09-17T19:53:59.097020] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T19:53:59.200207] [WARN ] [MAIN ] KKR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:53:59.200494] [INFO ] [MAIN ] KKR: Wiping existing primary data before full refresh. [2025-09-17T19:53:59.200546] [INFO ] [LOCAL ] KKR: Starting deletion of primary data. [2025-09-17T19:53:59.201824] [DEBUG] [LOCAL ] KKR: Deleted primary data file. [2025-09-17T19:53:59.201881] [INFO ] [MAIN ] KKR: Starting full primary refresh. [2025-09-17T19:53:59.558981] [INFO ] [REMOTE ] KKR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:53:59.615743] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-11. [2025-09-17T19:54:00.333426] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T19:54:00.415770] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-07. [2025-09-17T19:54:01.193153] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T19:54:01.215727] [INFO ] [REMOTE ] KKR: Fetching primary data for 2024-12. [2025-09-17T19:54:02.015789] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-04. [2025-09-17T19:54:02.482891] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T19:54:02.815819] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-08. [2025-09-17T19:54:03.615811] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-04. [2025-09-17T19:54:04.592309] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2024-12 (3.38 seconds). [2025-09-17T19:54:04.604048] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-01. [2025-09-17T19:54:04.882280] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T19:54:05.052358] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-08 (2.24 seconds). [2025-09-17T19:54:05.215830] [INFO ] [REMOTE ] KGS: Fetching primary data for 2025-09. [2025-09-17T19:54:05.899219] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-04 (3.88 seconds). [2025-09-17T19:54:05.933520] [INFO ] [REMOTE ] KGS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T19:54:05.940261] [INFO ] [REMOTE ] KGS: Full fetch complete (65513 records). [2025-09-17T19:54:05.940384] [DEBUG] [VALIDATOR ] KGS: Validating primary data. [2025-09-17T19:54:06.020858] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-05. [2025-09-17T19:54:06.342850] [DEBUG] [VALIDATOR ] KGS: All expected trading days are present. [2025-09-17T19:54:06.343036] [DEBUG] [VALIDATOR ] KGS: Primary data validation passed. [2025-09-17T19:54:06.344274] [INFO ] [MAIN ] KGS: Fetched primary data is valid. [2025-09-17T19:54:06.344363] [DEBUG] [LOCAL ] KGS: Saving primary data. [2025-09-17T19:54:06.346149] [DEBUG] [LOCAL ] KGS: Trimmed 65513 records to 45768 (keeping 200 days of data) [2025-09-17T19:54:06.497296] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T19:54:06.674136] [DEBUG] [LOCAL ] KGS: Primary data saved (45768 records). [2025-09-17T19:54:06.674288] [INFO ] [MAIN ] KGS: Full history saved. [2025-09-17T19:54:06.674381] [INFO ] [MAIN ] Update Progress: 1192/2371 symbols completed. KGS took 31.6s. Estimated remaining: 2h 52m 11s. Rate: 6.8 symbols/min [2025-09-17T19:54:06.820926] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-05. [2025-09-17T19:54:06.846983] [INFO ] [MAIN ] KKRS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:54:06.855634] [DEBUG] [LOCAL ] KKRS: Loaded 5780 existing records from primary storage. [2025-09-17T19:54:06.856250] [INFO ] [MAIN ] KKRS: Loaded 5780 existing records. [2025-09-17T19:54:07.046268] [WARN ] [MAIN ] KKRS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:54:07.046580] [INFO ] [MAIN ] KKRS: Wiping existing primary data before full refresh. [2025-09-17T19:54:07.046659] [INFO ] [LOCAL ] KKRS: Starting deletion of primary data. [2025-09-17T19:54:07.046971] [DEBUG] [LOCAL ] KKRS: Deleted primary data file. [2025-09-17T19:54:07.047042] [INFO ] [MAIN ] KKRS: Starting full primary refresh. [2025-09-17T19:54:07.234364] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T19:54:07.451508] [INFO ] [REMOTE ] KKRS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:54:07.615803] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-02. [2025-09-17T19:54:08.415832] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-11. [2025-09-17T19:54:08.666956] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T19:54:08.861056] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-11 (0.45 seconds). [2025-09-17T19:54:09.161437] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T19:54:09.215769] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2024-12. [2025-09-17T19:54:09.915104] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T19:54:10.015804] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-06. [2025-09-17T19:54:10.815772] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-06. [2025-09-17T19:54:11.070197] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T19:54:11.615817] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-07. [2025-09-17T19:54:12.270321] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T19:54:12.415795] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-07. [2025-09-17T19:54:12.794719] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T19:54:13.215792] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-03. [2025-09-17T19:54:14.015844] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-01. [2025-09-17T19:54:14.250289] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T19:54:14.454257] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T19:54:14.815803] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-08. [2025-09-17T19:54:15.615841] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-08. [2025-09-17T19:54:16.077683] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-03 (2.86 seconds). [2025-09-17T19:54:16.415849] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-02. [2025-09-17T19:54:16.525984] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T19:54:17.152078] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-17T19:54:17.174051] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T19:54:17.215790] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-03. [2025-09-17T19:54:17.786113] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T19:54:18.015825] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-04. [2025-09-17T19:54:18.788699] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T19:54:18.815772] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-05. [2025-09-17T19:54:19.520748] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T19:54:19.615842] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-04. [2025-09-17T19:54:20.415884] [INFO ] [REMOTE ] KIO: Fetching primary data for 2025-09. [2025-09-17T19:54:20.841167] [INFO ] [REMOTE ] KIO: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T19:54:20.844377] [INFO ] [REMOTE ] KIO: Full fetch complete (30956 records). [2025-09-17T19:54:20.844500] [DEBUG] [VALIDATOR ] KIO: Validating primary data. [2025-09-17T19:54:21.226666] [DEBUG] [VALIDATOR ] KIO: All expected trading days are present. [2025-09-17T19:54:21.218303] [INFO ] [REMOTE ] KIM: Fetching primary data for 2025-09. [2025-09-17T19:54:21.226995] [DEBUG] [VALIDATOR ] KIO: Primary data validation passed. [2025-09-17T19:54:21.227807] [INFO ] [MAIN ] KIO: Fetched primary data is valid. [2025-09-17T19:54:21.228788] [DEBUG] [LOCAL ] KIO: Saving primary data. [2025-09-17T19:54:21.230101] [DEBUG] [LOCAL ] KIO: Trimmed 30956 records to 21432 (keeping 200 days of data) [2025-09-17T19:54:21.371837] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T19:54:21.426630] [DEBUG] [LOCAL ] KIO: Primary data saved (21432 records). [2025-09-17T19:54:21.426794] [INFO ] [MAIN ] KIO: Full history saved. [2025-09-17T19:54:21.426888] [INFO ] [MAIN ] Update Progress: 1193/2371 symbols completed. KIO took 34.9s. Estimated remaining: 2h 52m 8s. Rate: 6.8 symbols/min [2025-09-17T19:54:21.604398] [INFO ] [MAIN ] KKRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:54:21.604891] [DEBUG] [LOCAL ] KKRT: No existing data file found in primary storage. [2025-09-17T19:54:21.604930] [WARN ] [MAIN ] KKRT: No existing data found, performing full refresh instead. [2025-09-17T19:54:21.605098] [INFO ] [MAIN ] KKRT: Wiping existing primary data before full refresh. [2025-09-17T19:54:21.605143] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-17T19:54:21.605249] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-17T19:54:21.605298] [INFO ] [MAIN ] KKRT: Starting full primary refresh. [2025-09-17T19:54:21.980906] [INFO ] [REMOTE ] KKRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:54:22.000533] [INFO ] [REMOTE ] KIM: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T19:54:22.008003] [INFO ] [REMOTE ] KIM: Full fetch complete (76648 records). [2025-09-17T19:54:22.008176] [DEBUG] [VALIDATOR ] KIM: Validating primary data. [2025-09-17T19:54:22.021131] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-11. [2025-09-17T19:54:22.317595] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:22.318088] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-11 [2025-09-17T19:54:22.414860] [DEBUG] [VALIDATOR ] KIM: All expected trading days are present. [2025-09-17T19:54:22.414961] [DEBUG] [VALIDATOR ] KIM: Primary data validation passed. [2025-09-17T19:54:22.416045] [INFO ] [MAIN ] KIM: Fetched primary data is valid. [2025-09-17T19:54:22.416103] [DEBUG] [LOCAL ] KIM: Saving primary data. [2025-09-17T19:54:22.417851] [DEBUG] [LOCAL ] KIM: Trimmed 76648 records to 53074 (keeping 200 days of data) [2025-09-17T19:54:22.758278] [DEBUG] [LOCAL ] KIM: Primary data saved (53074 records). [2025-09-17T19:54:22.758439] [INFO ] [MAIN ] KIM: Full history saved. [2025-09-17T19:54:22.758530] [INFO ] [MAIN ] Update Progress: 1194/2371 symbols completed. KIM took 40.7s. Estimated remaining: 2h 51m 52s. Rate: 6.8 symbols/min [2025-09-17T19:54:22.826208] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-06. [2025-09-17T19:54:22.941758] [INFO ] [MAIN ] KLAR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:54:22.941987] [DEBUG] [LOCAL ] KLAR: No existing data file found in primary storage. [2025-09-17T19:54:22.942025] [WARN ] [MAIN ] KLAR: No existing data found, performing full refresh instead. [2025-09-17T19:54:22.942165] [INFO ] [MAIN ] KLAR: Wiping existing primary data before full refresh. [2025-09-17T19:54:22.942205] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-17T19:54:22.942252] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-17T19:54:22.942284] [INFO ] [MAIN ] KLAR: Starting full primary refresh. [2025-09-17T19:54:23.307450] [INFO ] [REMOTE ] KLAR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:54:23.502214] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T19:54:23.615884] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-11. [2025-09-17T19:54:23.837462] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:23.837817] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-11 [2025-09-17T19:54:24.415821] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2024-12. [2025-09-17T19:54:24.643043] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:24.643418] [WARN ] [REMOTE ] KKRT: No data returned for month 2024-12 [2025-09-17T19:54:25.215820] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-01. [2025-09-17T19:54:25.459524] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:25.459903] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-01 [2025-09-17T19:54:26.015819] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-07. [2025-09-17T19:54:26.663832] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T19:54:26.815828] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-02. [2025-09-17T19:54:27.129822] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:27.130312] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-02 [2025-09-17T19:54:27.615816] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-05. [2025-09-17T19:54:28.415818] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-03. [2025-09-17T19:54:28.626832] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:28.627390] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-03 [2025-09-17T19:54:29.215858] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-08. [2025-09-17T19:54:29.606369] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T19:54:29.806720] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T19:54:30.015773] [INFO ] [REMOTE ] KKRS: Fetching primary data for 2025-09. [2025-09-17T19:54:30.410040] [INFO ] [REMOTE ] KKRS: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T19:54:30.411299] [INFO ] [REMOTE ] KKRS: Full fetch complete (8061 records). [2025-09-17T19:54:30.411372] [DEBUG] [VALIDATOR ] KKRS: Validating primary data. [2025-09-17T19:54:30.772881] [DEBUG] [VALIDATOR ] KKRS: All expected trading days are present. [2025-09-17T19:54:30.772964] [DEBUG] [VALIDATOR ] KKRS: Primary data validation passed. [2025-09-17T19:54:30.773183] [INFO ] [MAIN ] KKRS: Fetched primary data is valid. [2025-09-17T19:54:30.773225] [DEBUG] [LOCAL ] KKRS: Saving primary data. [2025-09-17T19:54:30.773662] [DEBUG] [LOCAL ] KKRS: Trimmed 8061 records to 5742 (keeping 200 days of data) [2025-09-17T19:54:30.810940] [DEBUG] [LOCAL ] KKRS: Primary data saved (5742 records). [2025-09-17T19:54:30.811093] [INFO ] [MAIN ] KKRS: Full history saved. [2025-09-17T19:54:30.811212] [INFO ] [MAIN ] Update Progress: 1195/2371 symbols completed. KKRS took 24.1s. Estimated remaining: 2h 51m 42s. Rate: 6.8 symbols/min [2025-09-17T19:54:30.822585] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-06. [2025-09-17T19:54:31.026292] [INFO ] [MAIN ] KLC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:54:31.072485] [DEBUG] [LOCAL ] KLC: Loaded 36073 existing records from primary storage. [2025-09-17T19:54:31.072768] [INFO ] [MAIN ] KLC: Loaded 36073 existing records. [2025-09-17T19:54:31.266001] [WARN ] [MAIN ] KLC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:54:31.266383] [INFO ] [MAIN ] KLC: Wiping existing primary data before full refresh. [2025-09-17T19:54:31.266435] [INFO ] [LOCAL ] KLC: Starting deletion of primary data. [2025-09-17T19:54:31.267166] [DEBUG] [LOCAL ] KLC: Deleted primary data file. [2025-09-17T19:54:31.267220] [INFO ] [MAIN ] KLC: Starting full primary refresh. [2025-09-17T19:54:31.631779] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-04. [2025-09-17T19:54:31.637122] [INFO ] [REMOTE ] KLC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:54:31.885911] [DEBUG] [REMOTE ] KKRT: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:31.886471] [WARN ] [REMOTE ] KKRT: No data returned for month 2025-04 [2025-09-17T19:54:32.415836] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-11. [2025-09-17T19:54:32.755814] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T19:54:33.215811] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-07. [2025-09-17T19:54:33.421961] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T19:54:34.015876] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2024-12. [2025-09-17T19:54:34.205130] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:34.205680] [WARN ] [REMOTE ] KLAR: No data returned for month 2024-12 [2025-09-17T19:54:34.815837] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-05. [2025-09-17T19:54:34.972730] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T19:54:35.309438] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T19:54:35.615838] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-06. [2025-09-17T19:54:36.415785] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-01. [2025-09-17T19:54:36.610499] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:36.611016] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-01 [2025-09-17T19:54:36.822741] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T19:54:37.215809] [INFO ] [REMOTE ] KLC: Fetching primary data for 2024-12. [2025-09-17T19:54:38.015848] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-02. [2025-09-17T19:54:38.205111] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:38.205632] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-02 [2025-09-17T19:54:38.754186] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T19:54:38.815828] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-01. [2025-09-17T19:54:39.615772] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-07. [2025-09-17T19:54:39.639972] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T19:54:40.148536] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T19:54:40.415872] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-08. [2025-09-17T19:54:40.956427] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T19:54:41.215816] [INFO ] [REMOTE ] KKRT: Fetching primary data for 2025-09. [2025-09-17T19:54:41.692349] [INFO ] [REMOTE ] KKRT: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T19:54:41.694353] [INFO ] [REMOTE ] KKRT: Full fetch complete (8068 records). [2025-09-17T19:54:41.694435] [DEBUG] [VALIDATOR ] KKRT: Validating primary data. [2025-09-17T19:54:41.893893] [WARN ] [VALIDATOR ] KKRT: Validation failed - insufficient historical data. Have 76 unique days, need 200 days [2025-09-17T19:54:41.894250] [FATAL] [MAIN ] KKRT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:54:41.894330] [WARN ] [MAIN ] KKRT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:54:41.894383] [INFO ] [LOCAL ] KKRT: Starting deletion of primary data. [2025-09-17T19:54:41.894496] [DEBUG] [LOCAL ] KKRT: No primary data file found to delete. [2025-09-17T19:54:41.894550] [INFO ] [LOCAL ] KKRT: Starting deletion of derivative data. [2025-09-17T19:54:41.894599] [DEBUG] [LOCAL ] KKRT: No derivative data file found to delete. [2025-09-17T19:54:41.894749] [INFO ] [MAIN ] Update Progress: 1196/2371 symbols completed. KKRT took 20.5s. Estimated remaining: 2h 51m 36s. Rate: 6.8 symbols/min [2025-09-17T19:54:42.020963] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-02. [2025-09-17T19:54:42.082254] [INFO ] [MAIN ] KLG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:54:42.132145] [DEBUG] [LOCAL ] KLG: Loaded 41934 existing records from primary storage. [2025-09-17T19:54:42.132357] [INFO ] [MAIN ] KLG: Loaded 41934 existing records. [2025-09-17T19:54:42.315693] [WARN ] [MAIN ] KLG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:54:42.316045] [INFO ] [MAIN ] KLG: Wiping existing primary data before full refresh. [2025-09-17T19:54:42.316095] [INFO ] [LOCAL ] KLG: Starting deletion of primary data. [2025-09-17T19:54:42.317126] [DEBUG] [LOCAL ] KLG: Deleted primary data file. [2025-09-17T19:54:42.317180] [INFO ] [MAIN ] KLG: Starting full primary refresh. [2025-09-17T19:54:42.690404] [INFO ] [REMOTE ] KLG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:54:42.815809] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-11. [2025-09-17T19:54:43.268972] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T19:54:43.615845] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-03. [2025-09-17T19:54:43.827863] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:43.828411] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-03 [2025-09-17T19:54:44.439587] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-04. [2025-09-17T19:54:44.480751] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T19:54:44.686593] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:44.687613] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-04 [2025-09-17T19:54:45.215789] [INFO ] [REMOTE ] KLG: Fetching primary data for 2024-12. [2025-09-17T19:54:46.015817] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-03. [2025-09-17T19:54:46.719074] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T19:54:46.815826] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-08. [2025-09-17T19:54:46.953419] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T19:54:47.615834] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-04. [2025-09-17T19:54:48.421876] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-01. [2025-09-17T19:54:48.435828] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T19:54:48.855261] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T19:54:49.215826] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-05. [2025-09-17T19:54:50.015787] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-05. [2025-09-17T19:54:50.057076] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T19:54:50.207379] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:50.207752] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-05 [2025-09-17T19:54:50.327444] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T19:54:50.815801] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-06. [2025-09-17T19:54:51.015189] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:51.015504] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-06 [2025-09-17T19:54:51.615781] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-02. [2025-09-17T19:54:52.415817] [INFO ] [REMOTE ] KKR: Fetching primary data for 2025-09. [2025-09-17T19:54:53.065796] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T19:54:53.215764] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-03. [2025-09-17T19:54:53.239413] [INFO ] [REMOTE ] KKR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T19:54:53.246825] [INFO ] [REMOTE ] KKR: Full fetch complete (77304 records). [2025-09-17T19:54:53.246993] [DEBUG] [VALIDATOR ] KKR: Validating primary data. [2025-09-17T19:54:53.651596] [DEBUG] [VALIDATOR ] KKR: All expected trading days are present. [2025-09-17T19:54:53.651714] [DEBUG] [VALIDATOR ] KKR: Primary data validation passed. [2025-09-17T19:54:53.652854] [INFO ] [MAIN ] KKR: Fetched primary data is valid. [2025-09-17T19:54:53.652940] [DEBUG] [LOCAL ] KKR: Saving primary data. [2025-09-17T19:54:53.655013] [DEBUG] [LOCAL ] KKR: Trimmed 77304 records to 53514 (keeping 200 days of data) [2025-09-17T19:54:54.007367] [DEBUG] [LOCAL ] KKR: Primary data saved (53514 records). [2025-09-17T19:54:54.007519] [INFO ] [MAIN ] KKR: Full history saved. [2025-09-17T19:54:54.007605] [INFO ] [MAIN ] Update Progress: 1197/2371 symbols completed. KKR took 55.2s. Estimated remaining: 2h 51m 31s. Rate: 6.8 symbols/min [2025-09-17T19:54:54.015733] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-07. [2025-09-17T19:54:54.216443] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:54:54.216814] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-07 [2025-09-17T19:54:54.760770] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T19:54:54.815761] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-04. [2025-09-17T19:54:55.615784] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-06. [2025-09-17T19:54:56.164755] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T19:54:56.415798] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-05. [2025-09-17T19:54:56.931311] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T19:54:57.215844] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-07. [2025-09-17T19:54:57.877989] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T19:54:58.015760] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-06. [2025-09-17T19:54:58.500565] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T19:54:58.815767] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-08. [2025-09-17T19:54:59.484220] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T19:54:59.615778] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-07. [2025-09-17T19:55:00.118036] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T19:55:00.415798] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-08. [2025-09-17T19:55:00.619135] [DEBUG] [REMOTE ] KLAR: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:55:00.619502] [WARN ] [REMOTE ] KLAR: No data returned for month 2025-08 [2025-09-17T19:55:01.055139] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T19:55:01.215766] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-08. [2025-09-17T19:55:02.015812] [INFO ] [REMOTE ] KLAR: Fetching primary data for 2025-09. [2025-09-17T19:55:02.461654] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T19:55:02.812900] [INFO ] [REMOTE ] KLAR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T19:55:02.817111] [INFO ] [REMOTE ] KLAR: Full fetch complete (2122 records). [2025-09-17T19:55:02.816594] [INFO ] [REMOTE ] KLC: Fetching primary data for 2025-09. [2025-09-17T19:55:02.817256] [DEBUG] [VALIDATOR ] KLAR: Validating primary data. [2025-09-17T19:55:03.014270] [WARN ] [VALIDATOR ] KLAR: Validation failed - insufficient historical data. Have 6 unique days, need 200 days [2025-09-17T19:55:03.014477] [FATAL] [MAIN ] KLAR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:55:03.014527] [WARN ] [MAIN ] KLAR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:55:03.014572] [INFO ] [LOCAL ] KLAR: Starting deletion of primary data. [2025-09-17T19:55:03.014677] [DEBUG] [LOCAL ] KLAR: No primary data file found to delete. [2025-09-17T19:55:03.014720] [INFO ] [LOCAL ] KLAR: Starting deletion of derivative data. [2025-09-17T19:55:03.014777] [DEBUG] [LOCAL ] KLAR: No derivative data file found to delete. [2025-09-17T19:55:03.014842] [INFO ] [MAIN ] Update Progress: 1198/2371 symbols completed. KLAR took 40.3s. Estimated remaining: 2h 51m 22s. Rate: 6.8 symbols/min [2025-09-17T19:55:03.279835] [INFO ] [REMOTE ] KLC: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T19:55:03.284872] [INFO ] [REMOTE ] KLC: Full fetch complete (50624 records). [2025-09-17T19:55:03.284991] [DEBUG] [VALIDATOR ] KLC: Validating primary data. [2025-09-17T19:55:03.625028] [INFO ] [REMOTE ] KLG: Fetching primary data for 2025-09. [2025-09-17T19:55:03.682660] [DEBUG] [VALIDATOR ] KLC: All expected trading days are present. [2025-09-17T19:55:03.682753] [DEBUG] [VALIDATOR ] KLC: Primary data validation passed. [2025-09-17T19:55:03.683495] [INFO ] [MAIN ] KLC: Fetched primary data is valid. [2025-09-17T19:55:03.683537] [DEBUG] [LOCAL ] KLC: Saving primary data. [2025-09-17T19:55:03.684762] [DEBUG] [LOCAL ] KLC: Trimmed 50624 records to 36209 (keeping 200 days of data) [2025-09-17T19:55:03.904720] [DEBUG] [LOCAL ] KLC: Primary data saved (36209 records). [2025-09-17T19:55:03.904924] [INFO ] [MAIN ] KLC: Full history saved. [2025-09-17T19:55:03.905024] [INFO ] [MAIN ] Update Progress: 1199/2371 symbols completed. KLC took 33.1s. Estimated remaining: 2h 51m 6s. Rate: 6.9 symbols/min [2025-09-17T19:55:04.438471] [INFO ] [REMOTE ] KLG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T19:55:04.445119] [INFO ] [REMOTE ] KLG: Full fetch complete (61810 records). [2025-09-17T19:55:04.445323] [DEBUG] [VALIDATOR ] KLG: Validating primary data. [2025-09-17T19:55:04.886482] [DEBUG] [VALIDATOR ] KLG: All expected trading days are present. [2025-09-17T19:55:04.886603] [DEBUG] [VALIDATOR ] KLG: Primary data validation passed. [2025-09-17T19:55:04.887856] [INFO ] [MAIN ] KLG: Fetched primary data is valid. [2025-09-17T19:55:04.887917] [DEBUG] [LOCAL ] KLG: Saving primary data. [2025-09-17T19:55:04.889786] [DEBUG] [LOCAL ] KLG: Trimmed 61810 records to 41953 (keeping 200 days of data) [2025-09-17T19:55:05.172989] [DEBUG] [LOCAL ] KLG: Primary data saved (41953 records). [2025-09-17T19:55:05.173175] [INFO ] [MAIN ] KLG: Full history saved. [2025-09-17T19:55:05.174629] [INFO ] [MAIN ] Update Progress: 1200/2371 symbols completed. KLG took 23.3s. Estimated remaining: 2h 50m 49s. Rate: 6.9 symbols/min [2025-09-17T19:55:05.888672] [INFO ] [MAIN ] KMPB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:55:05.915113] [INFO ] [MAIN ] KMPR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:55:05.935348] [INFO ] [MAIN ] KMI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:55:05.955794] [INFO ] [MAIN ] KMT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:55:05.964870] [DEBUG] [LOCAL ] KMPB: Loaded 3647 existing records from primary storage. [2025-09-17T19:55:05.965141] [INFO ] [MAIN ] KMPB: Loaded 3647 existing records. [2025-09-17T19:55:06.227443] [WARN ] [MAIN ] KMPB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:55:06.230566] [DEBUG] [LOCAL ] KMPR: Loaded 37685 existing records from primary storage. [2025-09-17T19:55:06.231635] [INFO ] [MAIN ] KMPR: Loaded 37685 existing records. [2025-09-17T19:55:06.237003] [INFO ] [MAIN ] KMPB: Wiping existing primary data before full refresh. [2025-09-17T19:55:06.269940] [INFO ] [LOCAL ] KMPB: Starting deletion of primary data. [2025-09-17T19:55:06.322662] [DEBUG] [LOCAL ] KMPB: Deleted primary data file. [2025-09-17T19:55:06.310970] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-17T19:55:06.339188] [INFO ] [MAIN ] KMPB: Starting full primary refresh. [2025-09-17T19:55:06.377263] [DEBUG] [LOCAL ] KMT: Loaded 43199 existing records from primary storage. [2025-09-17T19:55:06.422042] [INFO ] [MAIN ] KMI: Loaded 53693 existing records. [2025-09-17T19:55:06.421936] [INFO ] [MAIN ] KMT: Loaded 43199 existing records. [2025-09-17T19:55:06.781825] [WARN ] [MAIN ] KMPR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:55:06.865497] [INFO ] [MAIN ] KMPR: Wiping existing primary data before full refresh. [2025-09-17T19:55:07.078864] [INFO ] [LOCAL ] KMPR: Starting deletion of primary data. [2025-09-17T19:55:07.131326] [WARN ] [MAIN ] KMI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:55:07.176285] [INFO ] [MAIN ] KMI: Wiping existing primary data before full refresh. [2025-09-17T19:55:07.181440] [DEBUG] [LOCAL ] KMPR: Deleted primary data file. [2025-09-17T19:55:07.176004] [WARN ] [MAIN ] KMT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:55:07.181657] [INFO ] [LOCAL ] KMI: Starting deletion of primary data. [2025-09-17T19:55:07.187225] [INFO ] [MAIN ] KMPR: Starting full primary refresh. [2025-09-17T19:55:07.187153] [INFO ] [MAIN ] KMT: Wiping existing primary data before full refresh. [2025-09-17T19:55:07.209314] [DEBUG] [LOCAL ] KMI: Deleted primary data file. [2025-09-17T19:55:07.218447] [INFO ] [MAIN ] KMI: Starting full primary refresh. [2025-09-17T19:55:07.218578] [INFO ] [LOCAL ] KMT: Starting deletion of primary data. [2025-09-17T19:55:07.245735] [DEBUG] [LOCAL ] KMT: Deleted primary data file. [2025-09-17T19:55:07.324636] [INFO ] [MAIN ] KMT: Starting full primary refresh. [2025-09-17T19:55:07.634175] [INFO ] [REMOTE ] KMPB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:55:07.657706] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-11. [2025-09-17T19:55:08.383820] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T19:55:08.428398] [INFO ] [REMOTE ] KMPR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:55:08.430399] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2024-12. [2025-09-17T19:55:08.529515] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-11. [2025-09-17T19:55:08.507803] [INFO ] [REMOTE ] KMI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:55:08.535538] [INFO ] [REMOTE ] KMT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:55:08.534794] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-11. [2025-09-17T19:55:08.535860] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-11. [2025-09-17T19:55:09.086847] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T19:55:09.088324] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-01. [2025-09-17T19:55:09.510988] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T19:55:09.517300] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2024-12. [2025-09-17T19:55:09.545987] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T19:55:09.648727] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T19:55:10.015774] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-02. [2025-09-17T19:55:10.458500] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T19:55:10.578524] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-17T19:55:10.715610] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T19:55:10.815805] [INFO ] [REMOTE ] KMI: Fetching primary data for 2024-12. [2025-09-17T19:55:11.615798] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-01. [2025-09-17T19:55:12.415770] [INFO ] [REMOTE ] KMT: Fetching primary data for 2024-12. [2025-09-17T19:55:12.665684] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T19:55:12.842721] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T19:55:13.215780] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-01. [2025-09-17T19:55:13.891282] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T19:55:14.015739] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-01. [2025-09-17T19:55:14.815803] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-02. [2025-09-17T19:55:15.431080] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-17T19:55:15.533505] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T19:55:15.616163] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-02. [2025-09-17T19:55:15.779455] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T19:55:16.415812] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-03. [2025-09-17T19:55:17.168968] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T19:55:17.215807] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-02. [2025-09-17T19:55:17.261540] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T19:55:18.015853] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-03. [2025-09-17T19:55:18.517106] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T19:55:18.815790] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-03. [2025-09-17T19:55:19.166779] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T19:55:19.615791] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-03. [2025-09-17T19:55:20.100035] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T19:55:20.415826] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-04. [2025-09-17T19:55:21.215778] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-04. [2025-09-17T19:55:21.491064] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T19:55:21.707877] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T19:55:22.015794] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-04. [2025-09-17T19:55:22.555624] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T19:55:22.815820] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-05. [2025-09-17T19:55:23.615766] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-04. [2025-09-17T19:55:23.928375] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T19:55:24.179303] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-17T19:55:24.300809] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T19:55:24.415864] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-06. [2025-09-17T19:55:25.215817] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-05. [2025-09-17T19:55:25.788396] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T19:55:26.015817] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-05. [2025-09-17T19:55:26.751252] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T19:55:26.815754] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-07. [2025-09-17T19:55:27.615805] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-06. [2025-09-17T19:55:28.004032] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T19:55:28.077805] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T19:55:28.415798] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-05. [2025-09-17T19:55:28.868084] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T19:55:29.067755] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T19:55:29.215795] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-06. [2025-09-17T19:55:29.838885] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T19:55:30.015803] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-07. [2025-09-17T19:55:30.480429] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T19:55:30.815788] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-07. [2025-09-17T19:55:31.615782] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-06. [2025-09-17T19:55:32.364092] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T19:55:32.415759] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-08. [2025-09-17T19:55:33.220993] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-08. [2025-09-17T19:55:33.228672] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T19:55:33.828510] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T19:55:33.961729] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T19:55:34.015756] [INFO ] [REMOTE ] KMT: Fetching primary data for 2025-09. [2025-09-17T19:55:34.726478] [INFO ] [REMOTE ] KMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T19:55:34.732197] [INFO ] [REMOTE ] KMT: Full fetch complete (61747 records). [2025-09-17T19:55:34.732339] [DEBUG] [VALIDATOR ] KMT: Validating primary data. [2025-09-17T19:55:34.820891] [INFO ] [REMOTE ] KMPB: Fetching primary data for 2025-09. [2025-09-17T19:55:35.118108] [DEBUG] [VALIDATOR ] KMT: All expected trading days are present. [2025-09-17T19:55:35.118195] [DEBUG] [VALIDATOR ] KMT: Primary data validation passed. [2025-09-17T19:55:35.119125] [INFO ] [MAIN ] KMT: Fetched primary data is valid. [2025-09-17T19:55:35.119190] [DEBUG] [LOCAL ] KMT: Saving primary data. [2025-09-17T19:55:35.120546] [DEBUG] [LOCAL ] KMT: Trimmed 61747 records to 43208 (keeping 200 days of data) [2025-09-17T19:55:35.239572] [INFO ] [REMOTE ] KMPB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T19:55:35.241423] [INFO ] [REMOTE ] KMPB: Full fetch complete (4840 records). [2025-09-17T19:55:35.241865] [DEBUG] [VALIDATOR ] KMPB: Validating primary data. [2025-09-17T19:55:35.643096] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-07. [2025-09-17T19:55:35.745721] [DEBUG] [VALIDATOR ] KMPB: All expected trading days are present. [2025-09-17T19:55:35.747293] [DEBUG] [VALIDATOR ] KMPB: Primary data validation passed. [2025-09-17T19:55:35.748467] [INFO ] [MAIN ] KMPB: Fetched primary data is valid. [2025-09-17T19:55:35.748745] [DEBUG] [LOCAL ] KMPB: Saving primary data. [2025-09-17T19:55:35.750724] [DEBUG] [LOCAL ] KMPB: Trimmed 4840 records to 3628 (keeping 200 days of data) [2025-09-17T19:55:35.799892] [DEBUG] [LOCAL ] KMPB: Primary data saved (3628 records). [2025-09-17T19:55:35.803352] [INFO ] [MAIN ] KMPB: Full history saved. [2025-09-17T19:55:35.809940] [INFO ] [MAIN ] Update Progress: 1201/2371 symbols completed. KMPB took 30.6s. Estimated remaining: 2h 51m 2s. Rate: 6.8 symbols/min [2025-09-17T19:55:35.940375] [DEBUG] [LOCAL ] KMT: Primary data saved (43208 records). [2025-09-17T19:55:35.955807] [INFO ] [MAIN ] KMT: Full history saved. [2025-09-17T19:55:35.977284] [INFO ] [MAIN ] Update Progress: 1202/2371 symbols completed. KMT took 30.8s. Estimated remaining: 2h 50m 45s. Rate: 6.8 symbols/min [2025-09-17T19:55:36.063291] [INFO ] [MAIN ] KMX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:55:36.178787] [INFO ] [MAIN ] KN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:55:36.223702] [DEBUG] [LOCAL ] KMX: Loaded 53084 existing records from primary storage. [2025-09-17T19:55:36.223941] [INFO ] [MAIN ] KMX: Loaded 53084 existing records. [2025-09-17T19:55:36.418807] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-08. [2025-09-17T19:55:36.426089] [DEBUG] [LOCAL ] KN: Loaded 39122 existing records from primary storage. [2025-09-17T19:55:36.426940] [WARN ] [MAIN ] KMX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:55:36.426997] [INFO ] [MAIN ] KN: Loaded 39122 existing records. [2025-09-17T19:55:36.427214] [INFO ] [MAIN ] KMX: Wiping existing primary data before full refresh. [2025-09-17T19:55:36.427276] [INFO ] [LOCAL ] KMX: Starting deletion of primary data. [2025-09-17T19:55:36.438618] [DEBUG] [LOCAL ] KMX: Deleted primary data file. [2025-09-17T19:55:36.463499] [INFO ] [MAIN ] KMX: Starting full primary refresh. [2025-09-17T19:55:36.783117] [WARN ] [MAIN ] KN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:55:36.845634] [INFO ] [MAIN ] KN: Wiping existing primary data before full refresh. [2025-09-17T19:55:36.872113] [INFO ] [LOCAL ] KN: Starting deletion of primary data. [2025-09-17T19:55:36.901297] [DEBUG] [LOCAL ] KN: Deleted primary data file. [2025-09-17T19:55:36.903450] [INFO ] [MAIN ] KN: Starting full primary refresh. [2025-09-17T19:55:37.087318] [INFO ] [REMOTE ] KMX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:55:37.222596] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-11. [2025-09-17T19:55:37.343265] [INFO ] [REMOTE ] KN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:55:37.905228] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T19:55:38.015852] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-11. [2025-09-17T19:55:38.141496] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T19:55:38.795677] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T19:55:38.815822] [INFO ] [REMOTE ] KMX: Fetching primary data for 2024-12. [2025-09-17T19:55:39.590483] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T19:55:39.615747] [INFO ] [REMOTE ] KN: Fetching primary data for 2024-12. [2025-09-17T19:55:40.352702] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T19:55:40.415783] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-08. [2025-09-17T19:55:41.033291] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T19:55:41.215795] [INFO ] [REMOTE ] KMPR: Fetching primary data for 2025-09. [2025-09-17T19:55:41.918620] [INFO ] [REMOTE ] KMPR: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T19:55:41.924703] [INFO ] [REMOTE ] KMPR: Full fetch complete (49736 records). [2025-09-17T19:55:41.924864] [DEBUG] [VALIDATOR ] KMPR: Validating primary data. [2025-09-17T19:55:42.023919] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-01. [2025-09-17T19:55:42.318237] [DEBUG] [VALIDATOR ] KMPR: All expected trading days are present. [2025-09-17T19:55:42.318396] [DEBUG] [VALIDATOR ] KMPR: Primary data validation passed. [2025-09-17T19:55:42.319342] [INFO ] [MAIN ] KMPR: Fetched primary data is valid. [2025-09-17T19:55:42.319429] [DEBUG] [LOCAL ] KMPR: Saving primary data. [2025-09-17T19:55:42.321325] [DEBUG] [LOCAL ] KMPR: Trimmed 49736 records to 37775 (keeping 200 days of data) [2025-09-17T19:55:42.474877] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T19:55:42.610652] [DEBUG] [LOCAL ] KMPR: Primary data saved (37775 records). [2025-09-17T19:55:42.610812] [INFO ] [MAIN ] KMPR: Full history saved. [2025-09-17T19:55:42.610913] [INFO ] [MAIN ] Update Progress: 1203/2371 symbols completed. KMPR took 37.4s. Estimated remaining: 2h 50m 34s. Rate: 6.8 symbols/min [2025-09-17T19:55:42.783442] [INFO ] [MAIN ] KNF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:55:42.820907] [DEBUG] [LOCAL ] KNF: Loaded 35622 existing records from primary storage. [2025-09-17T19:55:42.820274] [INFO ] [REMOTE ] KMI: Fetching primary data for 2025-09. [2025-09-17T19:55:42.821197] [INFO ] [MAIN ] KNF: Loaded 35622 existing records. [2025-09-17T19:55:43.007893] [WARN ] [MAIN ] KNF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:55:43.008133] [INFO ] [MAIN ] KNF: Wiping existing primary data before full refresh. [2025-09-17T19:55:43.008177] [INFO ] [LOCAL ] KNF: Starting deletion of primary data. [2025-09-17T19:55:43.008930] [DEBUG] [LOCAL ] KNF: Deleted primary data file. [2025-09-17T19:55:43.008981] [INFO ] [MAIN ] KNF: Starting full primary refresh. [2025-09-17T19:55:43.379710] [INFO ] [REMOTE ] KNF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:55:43.615747] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-01. [2025-09-17T19:55:43.708411] [INFO ] [REMOTE ] KMI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T19:55:43.717839] [INFO ] [REMOTE ] KMI: Full fetch complete (77658 records). [2025-09-17T19:55:43.718200] [DEBUG] [VALIDATOR ] KMI: Validating primary data. [2025-09-17T19:55:44.118106] [DEBUG] [VALIDATOR ] KMI: All expected trading days are present. [2025-09-17T19:55:44.118206] [DEBUG] [VALIDATOR ] KMI: Primary data validation passed. [2025-09-17T19:55:44.119228] [INFO ] [MAIN ] KMI: Fetched primary data is valid. [2025-09-17T19:55:44.119371] [DEBUG] [LOCAL ] KMI: Saving primary data. [2025-09-17T19:55:44.149388] [DEBUG] [LOCAL ] KMI: Trimmed 77658 records to 53693 (keeping 200 days of data) [2025-09-17T19:55:44.156808] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T19:55:44.416455] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-11. [2025-09-17T19:55:44.517333] [DEBUG] [LOCAL ] KMI: Primary data saved (53693 records). [2025-09-17T19:55:44.517502] [INFO ] [MAIN ] KMI: Full history saved. [2025-09-17T19:55:44.517593] [INFO ] [MAIN ] Update Progress: 1204/2371 symbols completed. KMI took 39.3s. Estimated remaining: 2h 50m 19s. Rate: 6.9 symbols/min [2025-09-17T19:55:44.696245] [INFO ] [MAIN ] KNOP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:55:44.707819] [DEBUG] [LOCAL ] KNOP: Loaded 9947 existing records from primary storage. [2025-09-17T19:55:44.707961] [INFO ] [MAIN ] KNOP: Loaded 9947 existing records. [2025-09-17T19:55:44.888095] [WARN ] [MAIN ] KNOP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:55:44.888370] [INFO ] [MAIN ] KNOP: Wiping existing primary data before full refresh. [2025-09-17T19:55:44.888427] [INFO ] [LOCAL ] KNOP: Starting deletion of primary data. [2025-09-17T19:55:44.888882] [DEBUG] [LOCAL ] KNOP: Deleted primary data file. [2025-09-17T19:55:44.888930] [INFO ] [MAIN ] KNOP: Starting full primary refresh. [2025-09-17T19:55:45.226128] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-02. [2025-09-17T19:55:45.248243] [INFO ] [REMOTE ] KNOP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:55:45.285094] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T19:55:45.575353] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T19:55:46.015782] [INFO ] [REMOTE ] KNF: Fetching primary data for 2024-12. [2025-09-17T19:55:46.815819] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-11. [2025-09-17T19:55:46.921183] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T19:55:47.348850] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T19:55:47.498826] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T19:55:47.615769] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2024-12. [2025-09-17T19:55:48.415782] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-02. [2025-09-17T19:55:48.527266] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T19:55:49.215784] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-01. [2025-09-17T19:55:49.865677] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T19:55:50.015784] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-03. [2025-09-17T19:55:50.521676] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T19:55:50.815776] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-02. [2025-09-17T19:55:51.086759] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T19:55:51.615790] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-04. [2025-09-17T19:55:52.201199] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T19:55:52.415788] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-01. [2025-09-17T19:55:53.182695] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T19:55:53.199473] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T19:55:53.215671] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-02. [2025-09-17T19:55:54.015758] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-05. [2025-09-17T19:55:54.264591] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T19:55:54.815786] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-03. [2025-09-17T19:55:55.242030] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T19:55:55.615795] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-03. [2025-09-17T19:55:56.415792] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-03. [2025-09-17T19:55:56.425724] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T19:55:56.624695] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T19:55:57.215792] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-04. [2025-09-17T19:55:57.594393] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T19:55:58.015775] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-06. [2025-09-17T19:55:58.173896] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T19:55:58.815823] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-04. [2025-09-17T19:55:59.311116] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T19:55:59.615790] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-05. [2025-09-17T19:56:00.415782] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-07. [2025-09-17T19:56:00.437153] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T19:56:00.821476] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T19:56:01.215796] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-05. [2025-09-17T19:56:01.846738] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T19:56:02.015823] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-06. [2025-09-17T19:56:02.801144] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T19:56:02.815799] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-07. [2025-09-17T19:56:03.063981] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T19:56:03.615774] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-08. [2025-09-17T19:56:03.639949] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T19:56:04.415789] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-06. [2025-09-17T19:56:04.827574] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T19:56:05.215767] [INFO ] [REMOTE ] KN: Fetching primary data for 2025-09. [2025-09-17T19:56:05.889726] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T19:56:05.930907] [INFO ] [REMOTE ] KN: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T19:56:05.936433] [INFO ] [REMOTE ] KN: Full fetch complete (56108 records). [2025-09-17T19:56:05.936573] [DEBUG] [VALIDATOR ] KN: Validating primary data. [2025-09-17T19:56:06.020869] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-08. [2025-09-17T19:56:06.328085] [DEBUG] [VALIDATOR ] KN: All expected trading days are present. [2025-09-17T19:56:06.328182] [DEBUG] [VALIDATOR ] KN: Primary data validation passed. [2025-09-17T19:56:06.329079] [INFO ] [MAIN ] KN: Fetched primary data is valid. [2025-09-17T19:56:06.329127] [DEBUG] [LOCAL ] KN: Saving primary data. [2025-09-17T19:56:06.330493] [DEBUG] [LOCAL ] KN: Trimmed 56108 records to 39090 (keeping 200 days of data) [2025-09-17T19:56:06.568851] [DEBUG] [LOCAL ] KN: Primary data saved (39090 records). [2025-09-17T19:56:06.569009] [INFO ] [MAIN ] KN: Full history saved. [2025-09-17T19:56:06.569847] [INFO ] [MAIN ] Update Progress: 1205/2371 symbols completed. KN took 30.6s. Estimated remaining: 2h 50m 23s. Rate: 6.8 symbols/min [2025-09-17T19:56:06.743629] [INFO ] [MAIN ] KNSL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:56:06.765833] [DEBUG] [LOCAL ] KNSL: Loaded 18049 existing records from primary storage. [2025-09-17T19:56:06.766060] [INFO ] [MAIN ] KNSL: Loaded 18049 existing records. [2025-09-17T19:56:06.821011] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-07. [2025-09-17T19:56:06.882497] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T19:56:06.975362] [WARN ] [MAIN ] KNSL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:56:06.975665] [INFO ] [MAIN ] KNSL: Wiping existing primary data before full refresh. [2025-09-17T19:56:06.975715] [INFO ] [LOCAL ] KNSL: Starting deletion of primary data. [2025-09-17T19:56:06.976274] [DEBUG] [LOCAL ] KNSL: Deleted primary data file. [2025-09-17T19:56:06.976322] [INFO ] [MAIN ] KNSL: Starting full primary refresh. [2025-09-17T19:56:07.371163] [INFO ] [REMOTE ] KNSL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:56:07.615829] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-11. [2025-09-17T19:56:08.415799] [INFO ] [REMOTE ] KNOP: Fetching primary data for 2025-09. [2025-09-17T19:56:08.551276] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T19:56:08.747149] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T19:56:08.985053] [INFO ] [REMOTE ] KNOP: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:56:08.986900] [INFO ] [REMOTE ] KNOP: Full fetch complete (14714 records). [2025-09-17T19:56:08.986975] [DEBUG] [VALIDATOR ] KNOP: Validating primary data. [2025-09-17T19:56:09.220941] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2024-12. [2025-09-17T19:56:09.372350] [DEBUG] [VALIDATOR ] KNOP: All expected trading days are present. [2025-09-17T19:56:09.372433] [DEBUG] [VALIDATOR ] KNOP: Primary data validation passed. [2025-09-17T19:56:09.372802] [INFO ] [MAIN ] KNOP: Fetched primary data is valid. [2025-09-17T19:56:09.372844] [DEBUG] [LOCAL ] KNOP: Saving primary data. [2025-09-17T19:56:09.373528] [DEBUG] [LOCAL ] KNOP: Trimmed 14714 records to 9935 (keeping 200 days of data) [2025-09-17T19:56:09.441284] [DEBUG] [LOCAL ] KNOP: Primary data saved (9935 records). [2025-09-17T19:56:09.441472] [INFO ] [MAIN ] KNOP: Full history saved. [2025-09-17T19:56:09.441576] [INFO ] [MAIN ] Update Progress: 1206/2371 symbols completed. KNOP took 24.9s. Estimated remaining: 2h 50m 8s. Rate: 6.8 symbols/min [2025-09-17T19:56:09.611006] [INFO ] [MAIN ] KNTK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:56:09.653986] [DEBUG] [LOCAL ] KNTK: Loaded 46120 existing records from primary storage. [2025-09-17T19:56:09.654158] [INFO ] [MAIN ] KNTK: Loaded 46120 existing records. [2025-09-17T19:56:09.830512] [WARN ] [MAIN ] KNTK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:56:09.830789] [INFO ] [MAIN ] KNTK: Wiping existing primary data before full refresh. [2025-09-17T19:56:09.830835] [INFO ] [LOCAL ] KNTK: Starting deletion of primary data. [2025-09-17T19:56:09.831858] [DEBUG] [LOCAL ] KNTK: Deleted primary data file. [2025-09-17T19:56:09.831907] [INFO ] [MAIN ] KNTK: Starting full primary refresh. [2025-09-17T19:56:10.020962] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-04. [2025-09-17T19:56:10.195176] [INFO ] [REMOTE ] KNTK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:56:10.253945] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T19:56:10.815809] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-01. [2025-09-17T19:56:11.224933] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T19:56:11.615802] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-08. [2025-09-17T19:56:12.101292] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T19:56:12.415784] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-11. [2025-09-17T19:56:13.215819] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-05. [2025-09-17T19:56:13.490169] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T19:56:13.846152] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T19:56:14.015809] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-02. [2025-09-17T19:56:14.391565] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T19:56:14.766969] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T19:56:14.815794] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-03. [2025-09-17T19:56:15.615832] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-06. [2025-09-17T19:56:15.842988] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T19:56:16.415801] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2024-12. [2025-09-17T19:56:16.995005] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T19:56:17.215799] [INFO ] [REMOTE ] KMX: Fetching primary data for 2025-09. [2025-09-17T19:56:17.567680] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T19:56:17.766388] [INFO ] [REMOTE ] KMX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T19:56:17.773518] [INFO ] [REMOTE ] KMX: Full fetch complete (75718 records). [2025-09-17T19:56:17.773744] [DEBUG] [VALIDATOR ] KMX: Validating primary data. [2025-09-17T19:56:18.020909] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-01. [2025-09-17T19:56:18.181345] [DEBUG] [VALIDATOR ] KMX: All expected trading days are present. [2025-09-17T19:56:18.181449] [DEBUG] [VALIDATOR ] KMX: Primary data validation passed. [2025-09-17T19:56:18.182486] [INFO ] [MAIN ] KMX: Fetched primary data is valid. [2025-09-17T19:56:18.182540] [DEBUG] [LOCAL ] KMX: Saving primary data. [2025-09-17T19:56:18.184285] [DEBUG] [LOCAL ] KMX: Trimmed 75718 records to 53095 (keeping 200 days of data) [2025-09-17T19:56:18.524504] [DEBUG] [LOCAL ] KMX: Primary data saved (53095 records). [2025-09-17T19:56:18.524682] [INFO ] [MAIN ] KMX: Full history saved. [2025-09-17T19:56:18.524785] [INFO ] [MAIN ] Update Progress: 1207/2371 symbols completed. KMX took 42.7s. Estimated remaining: 2h 49m 60s. Rate: 6.8 symbols/min [2025-09-17T19:56:18.715659] [INFO ] [MAIN ] KNX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:56:18.766075] [DEBUG] [LOCAL ] KNX: Loaded 52592 existing records from primary storage. [2025-09-17T19:56:18.766260] [INFO ] [MAIN ] KNX: Loaded 52592 existing records. [2025-09-17T19:56:18.823863] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-07. [2025-09-17T19:56:18.952110] [WARN ] [MAIN ] KNX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:56:18.952374] [INFO ] [MAIN ] KNX: Wiping existing primary data before full refresh. [2025-09-17T19:56:18.952420] [INFO ] [LOCAL ] KNX: Starting deletion of primary data. [2025-09-17T19:56:18.953592] [DEBUG] [LOCAL ] KNX: Deleted primary data file. [2025-09-17T19:56:18.953665] [INFO ] [MAIN ] KNX: Starting full primary refresh. [2025-09-17T19:56:19.314718] [INFO ] [REMOTE ] KNX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:56:19.577577] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T19:56:19.615775] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-02. [2025-09-17T19:56:20.296604] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T19:56:20.415816] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-08. [2025-09-17T19:56:21.215763] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-04. [2025-09-17T19:56:21.327775] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T19:56:21.809152] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T19:56:22.015766] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-03. [2025-09-17T19:56:22.381165] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T19:56:22.815797] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-05. [2025-09-17T19:56:23.597483] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T19:56:23.615731] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-06. [2025-09-17T19:56:23.666613] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T19:56:24.415801] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-11. [2025-09-17T19:56:24.722680] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T19:56:25.215829] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-04. [2025-09-17T19:56:26.015819] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-07. [2025-09-17T19:56:26.082539] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T19:56:26.558675] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T19:56:26.815786] [INFO ] [REMOTE ] KNX: Fetching primary data for 2024-12. [2025-09-17T19:56:27.264832] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T19:56:27.615815] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-05. [2025-09-17T19:56:28.415818] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-08. [2025-09-17T19:56:28.499042] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T19:56:29.144900] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T19:56:29.215796] [INFO ] [REMOTE ] KNF: Fetching primary data for 2025-09. [2025-09-17T19:56:29.279432] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T19:56:29.761426] [INFO ] [REMOTE ] KNF: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T19:56:29.766516] [INFO ] [REMOTE ] KNF: Full fetch complete (49866 records). [2025-09-17T19:56:29.766669] [DEBUG] [VALIDATOR ] KNF: Validating primary data. [2025-09-17T19:56:30.025000] [INFO ] [REMOTE ] KNSL: Fetching primary data for 2025-09. [2025-09-17T19:56:30.180611] [DEBUG] [VALIDATOR ] KNF: All expected trading days are present. [2025-09-17T19:56:30.180735] [DEBUG] [VALIDATOR ] KNF: Primary data validation passed. [2025-09-17T19:56:30.181626] [INFO ] [MAIN ] KNF: Fetched primary data is valid. [2025-09-17T19:56:30.181695] [DEBUG] [LOCAL ] KNF: Saving primary data. [2025-09-17T19:56:30.183058] [DEBUG] [LOCAL ] KNF: Trimmed 49866 records to 35717 (keeping 200 days of data) [2025-09-17T19:56:30.444576] [DEBUG] [LOCAL ] KNF: Primary data saved (35717 records). [2025-09-17T19:56:30.444823] [INFO ] [MAIN ] KNF: Full history saved. [2025-09-17T19:56:30.444966] [INFO ] [MAIN ] Update Progress: 1208/2371 symbols completed. KNF took 47.8s. Estimated remaining: 2h 49m 54s. Rate: 6.8 symbols/min [2025-09-17T19:56:30.712383] [INFO ] [REMOTE ] KNSL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T19:56:30.747509] [INFO ] [REMOTE ] KNSL: Full fetch complete (26513 records). [2025-09-17T19:56:30.747802] [DEBUG] [VALIDATOR ] KNSL: Validating primary data. [2025-09-17T19:56:30.797128] [INFO ] [MAIN ] KO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:56:30.821084] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-01. [2025-09-17T19:56:31.214065] [DEBUG] [LOCAL ] KO: Loaded 53818 existing records from primary storage. [2025-09-17T19:56:31.241017] [INFO ] [MAIN ] KO: Loaded 53818 existing records. [2025-09-17T19:56:31.507403] [DEBUG] [VALIDATOR ] KNSL: All expected trading days are present. [2025-09-17T19:56:31.526473] [DEBUG] [VALIDATOR ] KNSL: Primary data validation passed. [2025-09-17T19:56:31.527602] [INFO ] [MAIN ] KNSL: Fetched primary data is valid. [2025-09-17T19:56:31.543509] [DEBUG] [LOCAL ] KNSL: Saving primary data. [2025-09-17T19:56:31.618675] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-06. [2025-09-17T19:56:31.628189] [DEBUG] [LOCAL ] KNSL: Trimmed 26513 records to 18097 (keeping 200 days of data) [2025-09-17T19:56:31.629313] [WARN ] [MAIN ] KO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:56:31.629949] [INFO ] [MAIN ] KO: Wiping existing primary data before full refresh. [2025-09-17T19:56:31.630025] [INFO ] [LOCAL ] KO: Starting deletion of primary data. [2025-09-17T19:56:31.693612] [DEBUG] [LOCAL ] KO: Deleted primary data file. [2025-09-17T19:56:31.703227] [INFO ] [MAIN ] KO: Starting full primary refresh. [2025-09-17T19:56:32.164723] [DEBUG] [LOCAL ] KNSL: Primary data saved (18097 records). [2025-09-17T19:56:32.170966] [INFO ] [MAIN ] KNSL: Full history saved. [2025-09-17T19:56:32.171135] [INFO ] [MAIN ] Update Progress: 1209/2371 symbols completed. KNSL took 25.6s. Estimated remaining: 2h 49m 39s. Rate: 6.8 symbols/min [2025-09-17T19:56:32.170764] [INFO ] [REMOTE ] KO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:56:32.354056] [INFO ] [MAIN ] KODK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:56:32.396758] [DEBUG] [LOCAL ] KODK: Loaded 43444 existing records from primary storage. [2025-09-17T19:56:32.396920] [INFO ] [MAIN ] KODK: Loaded 43444 existing records. [2025-09-17T19:56:32.430859] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-11. [2025-09-17T19:56:32.589469] [WARN ] [MAIN ] KODK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:56:32.589908] [INFO ] [MAIN ] KODK: Wiping existing primary data before full refresh. [2025-09-17T19:56:32.589976] [INFO ] [LOCAL ] KODK: Starting deletion of primary data. [2025-09-17T19:56:32.590867] [DEBUG] [LOCAL ] KODK: Deleted primary data file. [2025-09-17T19:56:32.590926] [INFO ] [MAIN ] KODK: Starting full primary refresh. [2025-09-17T19:56:32.917891] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-17T19:56:33.014816] [INFO ] [REMOTE ] KODK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:56:33.215783] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-02. [2025-09-17T19:56:33.293551] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T19:56:34.015800] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-11. [2025-09-17T19:56:34.815840] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-07. [2025-09-17T19:56:34.874790] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T19:56:35.058028] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-11 (2.63 seconds). [2025-09-17T19:56:35.388679] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T19:56:35.615806] [INFO ] [REMOTE ] KODK: Fetching primary data for 2024-12. [2025-09-17T19:56:36.415830] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-03. [2025-09-17T19:56:36.666061] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T19:56:37.215835] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-08. [2025-09-17T19:56:37.287480] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T19:56:37.826334] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T19:56:38.015787] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-04. [2025-09-17T19:56:38.444005] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T19:56:38.815833] [INFO ] [REMOTE ] KNTK: Fetching primary data for 2025-09. [2025-09-17T19:56:39.358736] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T19:56:39.386797] [INFO ] [REMOTE ] KNTK: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:56:39.393281] [INFO ] [REMOTE ] KNTK: Full fetch complete (63478 records). [2025-09-17T19:56:39.393843] [DEBUG] [VALIDATOR ] KNTK: Validating primary data. [2025-09-17T19:56:39.621019] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-05. [2025-09-17T19:56:39.803237] [DEBUG] [VALIDATOR ] KNTK: All expected trading days are present. [2025-09-17T19:56:39.803365] [DEBUG] [VALIDATOR ] KNTK: Primary data validation passed. [2025-09-17T19:56:39.804806] [INFO ] [MAIN ] KNTK: Fetched primary data is valid. [2025-09-17T19:56:39.804874] [DEBUG] [LOCAL ] KNTK: Saving primary data. [2025-09-17T19:56:39.806701] [DEBUG] [LOCAL ] KNTK: Trimmed 63478 records to 46122 (keeping 200 days of data) [2025-09-17T19:56:40.122853] [DEBUG] [LOCAL ] KNTK: Primary data saved (46122 records). [2025-09-17T19:56:40.123136] [INFO ] [MAIN ] KNTK: Full history saved. [2025-09-17T19:56:40.123275] [INFO ] [MAIN ] Update Progress: 1210/2371 symbols completed. KNTK took 30.7s. Estimated remaining: 2h 49m 29s. Rate: 6.9 symbols/min [2025-09-17T19:56:40.302372] [INFO ] [MAIN ] KOF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:56:40.333126] [DEBUG] [LOCAL ] KOF: Loaded 26043 existing records from primary storage. [2025-09-17T19:56:40.333371] [INFO ] [MAIN ] KOF: Loaded 26043 existing records. [2025-09-17T19:56:40.421032] [INFO ] [REMOTE ] KO: Fetching primary data for 2024-12. [2025-09-17T19:56:40.525928] [WARN ] [MAIN ] KOF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:56:40.526330] [INFO ] [MAIN ] KOF: Wiping existing primary data before full refresh. [2025-09-17T19:56:40.526389] [INFO ] [LOCAL ] KOF: Starting deletion of primary data. [2025-09-17T19:56:40.527348] [DEBUG] [LOCAL ] KOF: Deleted primary data file. [2025-09-17T19:56:40.527408] [INFO ] [MAIN ] KOF: Starting full primary refresh. [2025-09-17T19:56:40.927607] [INFO ] [REMOTE ] KOF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:56:41.215849] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-01. [2025-09-17T19:56:41.354559] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T19:56:42.015811] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-06. [2025-09-17T19:56:42.576576] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T19:56:42.815756] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-02. [2025-09-17T19:56:43.192559] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2024-12 (2.77 seconds). [2025-09-17T19:56:43.615849] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-01. [2025-09-17T19:56:43.720399] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T19:56:44.415822] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-11. [2025-09-17T19:56:44.450249] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T19:56:45.215760] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-03. [2025-09-17T19:56:45.595147] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T19:56:46.019458] [INFO ] [REMOTE ] KOF: Fetching primary data for 2024-12. [2025-09-17T19:56:46.022258] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-17T19:56:46.312452] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T19:56:46.686954] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T19:56:46.815789] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-04. [2025-09-17T19:56:47.615799] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-01. [2025-09-17T19:56:48.404442] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T19:56:48.415750] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-02. [2025-09-17T19:56:48.820776] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T19:56:49.215814] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-05. [2025-09-17T19:56:50.015787] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-07. [2025-09-17T19:56:50.798392] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-02 (2.38 seconds). [2025-09-17T19:56:50.815739] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-03. [2025-09-17T19:56:50.880461] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T19:56:51.615797] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-06. [2025-09-17T19:56:51.932985] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T19:56:52.415806] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-02. [2025-09-17T19:56:53.079565] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T19:56:53.144381] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-17T19:56:53.215823] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-04. [2025-09-17T19:56:53.421421] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T19:56:54.015792] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-08. [2025-09-17T19:56:54.815796] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-07. [2025-09-17T19:56:55.588918] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-17T19:56:55.615736] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-05. [2025-09-17T19:56:55.767096] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T19:56:56.154832] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T19:56:56.415804] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-03. [2025-09-17T19:56:57.215778] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-08. [2025-09-17T19:56:57.383896] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T19:56:58.015776] [INFO ] [REMOTE ] KNX: Fetching primary data for 2025-09. [2025-09-17T19:56:58.328629] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-05 (2.71 seconds). [2025-09-17T19:56:58.815848] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-06. [2025-09-17T19:56:58.911123] [INFO ] [REMOTE ] KNX: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T19:56:58.918157] [INFO ] [REMOTE ] KNX: Full fetch complete (75408 records). [2025-09-17T19:56:58.918273] [DEBUG] [VALIDATOR ] KNX: Validating primary data. [2025-09-17T19:56:59.323282] [DEBUG] [VALIDATOR ] KNX: All expected trading days are present. [2025-09-17T19:56:59.323468] [DEBUG] [VALIDATOR ] KNX: Primary data validation passed. [2025-09-17T19:56:59.324688] [INFO ] [MAIN ] KNX: Fetched primary data is valid. [2025-09-17T19:56:59.324898] [DEBUG] [LOCAL ] KNX: Saving primary data. [2025-09-17T19:56:59.352242] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T19:56:59.361835] [DEBUG] [LOCAL ] KNX: Trimmed 75408 records to 52589 (keeping 200 days of data) [2025-09-17T19:56:59.616074] [INFO ] [REMOTE ] KODK: Fetching primary data for 2025-09. [2025-09-17T19:56:59.712249] [DEBUG] [LOCAL ] KNX: Primary data saved (52589 records). [2025-09-17T19:56:59.712418] [INFO ] [MAIN ] KNX: Full history saved. [2025-09-17T19:56:59.712514] [INFO ] [MAIN ] Update Progress: 1211/2371 symbols completed. KNX took 41.2s. Estimated remaining: 2h 49m 31s. Rate: 6.8 symbols/min [2025-09-17T19:56:59.908885] [INFO ] [MAIN ] KOP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:56:59.930460] [DEBUG] [LOCAL ] KOP: Loaded 18072 existing records from primary storage. [2025-09-17T19:56:59.930601] [INFO ] [MAIN ] KOP: Loaded 18072 existing records. [2025-09-17T19:57:00.139814] [WARN ] [MAIN ] KOP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:57:00.140151] [INFO ] [MAIN ] KOP: Wiping existing primary data before full refresh. [2025-09-17T19:57:00.140233] [INFO ] [LOCAL ] KOP: Starting deletion of primary data. [2025-09-17T19:57:00.145987] [DEBUG] [LOCAL ] KOP: Deleted primary data file. [2025-09-17T19:57:00.154144] [INFO ] [MAIN ] KOP: Starting full primary refresh. [2025-09-17T19:57:00.184546] [INFO ] [REMOTE ] KODK: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T19:57:00.262984] [INFO ] [REMOTE ] KODK: Full fetch complete (63751 records). [2025-09-17T19:57:00.273394] [DEBUG] [VALIDATOR ] KODK: Validating primary data. [2025-09-17T19:57:00.418738] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-04. [2025-09-17T19:57:00.904966] [INFO ] [REMOTE ] KOP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:57:00.978395] [DEBUG] [VALIDATOR ] KODK: All expected trading days are present. [2025-09-17T19:57:00.978519] [DEBUG] [VALIDATOR ] KODK: Primary data validation passed. [2025-09-17T19:57:00.979540] [INFO ] [MAIN ] KODK: Fetched primary data is valid. [2025-09-17T19:57:00.979613] [DEBUG] [LOCAL ] KODK: Saving primary data. [2025-09-17T19:57:00.981185] [DEBUG] [LOCAL ] KODK: Trimmed 63751 records to 43470 (keeping 200 days of data) [2025-09-17T19:57:01.099007] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-17T19:57:01.220127] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-07. [2025-09-17T19:57:01.273302] [DEBUG] [LOCAL ] KODK: Primary data saved (43470 records). [2025-09-17T19:57:01.273427] [INFO ] [MAIN ] KODK: Full history saved. [2025-09-17T19:57:01.274597] [INFO ] [MAIN ] Update Progress: 1212/2371 symbols completed. KODK took 29.1s. Estimated remaining: 2h 49m 15s. Rate: 6.8 symbols/min [2025-09-17T19:57:01.444933] [INFO ] [MAIN ] KORE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:57:01.448725] [DEBUG] [LOCAL ] KORE: Loaded 1956 existing records from primary storage. [2025-09-17T19:57:01.448805] [INFO ] [MAIN ] KORE: Loaded 1956 existing records. [2025-09-17T19:57:01.645526] [WARN ] [MAIN ] KORE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:57:01.645960] [INFO ] [MAIN ] KORE: Wiping existing primary data before full refresh. [2025-09-17T19:57:01.646016] [INFO ] [LOCAL ] KORE: Starting deletion of primary data. [2025-09-17T19:57:01.646293] [DEBUG] [LOCAL ] KORE: Deleted primary data file. [2025-09-17T19:57:01.646352] [INFO ] [MAIN ] KORE: Starting full primary refresh. [2025-09-17T19:57:02.017224] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-11. [2025-09-17T19:57:02.051698] [INFO ] [REMOTE ] KORE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:57:02.083706] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T19:57:02.815810] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-05. [2025-09-17T19:57:03.615822] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-11. [2025-09-17T19:57:04.252104] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-11 (2.23 seconds). [2025-09-17T19:57:04.415856] [INFO ] [REMOTE ] KOP: Fetching primary data for 2024-12. [2025-09-17T19:57:04.439978] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T19:57:04.848082] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-07 (3.63 seconds). [2025-09-17T19:57:04.912449] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T19:57:05.215813] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-08. [2025-09-17T19:57:05.532139] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T19:57:06.015817] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-01. [2025-09-17T19:57:06.823976] [INFO ] [REMOTE ] KORE: Fetching primary data for 2024-12. [2025-09-17T19:57:06.828371] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T19:57:07.553362] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T19:57:07.615779] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-01. [2025-09-17T19:57:07.896846] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-08 (2.68 seconds). [2025-09-17T19:57:08.312842] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T19:57:08.415849] [INFO ] [REMOTE ] KO: Fetching primary data for 2025-09. [2025-09-17T19:57:08.975095] [INFO ] [REMOTE ] KO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T19:57:08.982194] [INFO ] [REMOTE ] KO: Full fetch complete (77993 records). [2025-09-17T19:57:08.982339] [DEBUG] [VALIDATOR ] KO: Validating primary data. [2025-09-17T19:57:09.220995] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-02. [2025-09-17T19:57:09.388204] [DEBUG] [VALIDATOR ] KO: All expected trading days are present. [2025-09-17T19:57:09.388285] [DEBUG] [VALIDATOR ] KO: Primary data validation passed. [2025-09-17T19:57:09.389304] [INFO ] [MAIN ] KO: Fetched primary data is valid. [2025-09-17T19:57:09.389349] [DEBUG] [LOCAL ] KO: Saving primary data. [2025-09-17T19:57:09.390838] [DEBUG] [LOCAL ] KO: Trimmed 77993 records to 53818 (keeping 200 days of data) [2025-09-17T19:57:09.741456] [DEBUG] [LOCAL ] KO: Primary data saved (53818 records). [2025-09-17T19:57:09.741601] [INFO ] [MAIN ] KO: Full history saved. [2025-09-17T19:57:09.741705] [INFO ] [MAIN ] Update Progress: 1213/2371 symbols completed. KO took 39.3s. Estimated remaining: 2h 49m 6s. Rate: 6.8 symbols/min [2025-09-17T19:57:09.921351] [INFO ] [MAIN ] KOS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:57:09.925174] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T19:57:09.982849] [DEBUG] [LOCAL ] KOS: Loaded 53081 existing records from primary storage. [2025-09-17T19:57:09.983035] [INFO ] [MAIN ] KOS: Loaded 53081 existing records. [2025-09-17T19:57:10.020962] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-02. [2025-09-17T19:57:10.168130] [WARN ] [MAIN ] KOS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:57:10.168398] [INFO ] [MAIN ] KOS: Wiping existing primary data before full refresh. [2025-09-17T19:57:10.168444] [INFO ] [LOCAL ] KOS: Starting deletion of primary data. [2025-09-17T19:57:10.169399] [DEBUG] [LOCAL ] KOS: Deleted primary data file. [2025-09-17T19:57:10.169449] [INFO ] [MAIN ] KOS: Starting full primary refresh. [2025-09-17T19:57:10.573354] [INFO ] [REMOTE ] KOS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:57:10.815742] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-11. [2025-09-17T19:57:11.097801] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T19:57:11.615799] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-03. [2025-09-17T19:57:12.376285] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T19:57:12.415771] [INFO ] [REMOTE ] KOS: Fetching primary data for 2024-12. [2025-09-17T19:57:12.736265] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T19:57:13.215814] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-03. [2025-09-17T19:57:13.640384] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T19:57:14.015773] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-04. [2025-09-17T19:57:14.135353] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T19:57:14.537488] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T19:57:14.815799] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-05. [2025-09-17T19:57:15.615796] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-01. [2025-09-17T19:57:15.821761] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T19:57:16.415794] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-06. [2025-09-17T19:57:16.887182] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T19:57:17.215823] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-07. [2025-09-17T19:57:17.674099] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T19:57:18.015709] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-04. [2025-09-17T19:57:18.102377] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-01 (2.49 seconds). [2025-09-17T19:57:18.815842] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-08. [2025-09-17T19:57:19.109156] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-08 (0.29 seconds). [2025-09-17T19:57:19.126367] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T19:57:19.615909] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-06. [2025-09-17T19:57:20.415865] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-05. [2025-09-17T19:57:20.780311] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T19:57:21.215767] [INFO ] [REMOTE ] KORE: Fetching primary data for 2025-09. [2025-09-17T19:57:21.333328] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T19:57:21.512348] [INFO ] [REMOTE ] KORE: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-17T19:57:21.513534] [INFO ] [REMOTE ] KORE: Full fetch complete (6119 records). [2025-09-17T19:57:21.513618] [DEBUG] [VALIDATOR ] KORE: Validating primary data. [2025-09-17T19:57:21.919411] [DEBUG] [VALIDATOR ] KORE: All expected trading days are present. [2025-09-17T19:57:21.919499] [DEBUG] [VALIDATOR ] KORE: Primary data validation passed. [2025-09-17T19:57:21.919773] [INFO ] [MAIN ] KORE: Fetched primary data is valid. [2025-09-17T19:57:21.919838] [DEBUG] [LOCAL ] KORE: Saving primary data. [2025-09-17T19:57:21.920525] [DEBUG] [LOCAL ] KORE: Trimmed 6119 records to 1946 (keeping 200 days of data) [2025-09-17T19:57:21.932758] [DEBUG] [LOCAL ] KORE: Primary data saved (1946 records). [2025-09-17T19:57:21.932841] [INFO ] [MAIN ] KORE: Full history saved. [2025-09-17T19:57:21.932956] [INFO ] [MAIN ] Update Progress: 1214/2371 symbols completed. KORE took 20.7s. Estimated remaining: 2h 49m 0s. Rate: 6.8 symbols/min [2025-09-17T19:57:22.021055] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-07. [2025-09-17T19:57:22.109756] [INFO ] [MAIN ] KR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:57:22.165837] [DEBUG] [LOCAL ] KR: Loaded 53682 existing records from primary storage. [2025-09-17T19:57:22.166003] [INFO ] [MAIN ] KR: Loaded 53682 existing records. [2025-09-17T19:57:22.349077] [WARN ] [MAIN ] KR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:57:22.349395] [INFO ] [MAIN ] KR: Wiping existing primary data before full refresh. [2025-09-17T19:57:22.349452] [INFO ] [LOCAL ] KR: Starting deletion of primary data. [2025-09-17T19:57:22.350470] [DEBUG] [LOCAL ] KR: Deleted primary data file. [2025-09-17T19:57:22.350544] [INFO ] [MAIN ] KR: Starting full primary refresh. [2025-09-17T19:57:22.715702] [INFO ] [REMOTE ] KR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:57:22.815807] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-11. [2025-09-17T19:57:23.110976] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T19:57:23.615827] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-06. [2025-09-17T19:57:24.415822] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-08. [2025-09-17T19:57:24.509884] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T19:57:24.656825] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T19:57:25.215748] [INFO ] [REMOTE ] KR: Fetching primary data for 2024-12. [2025-09-17T19:57:25.452465] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T19:57:26.015774] [INFO ] [REMOTE ] KOF: Fetching primary data for 2025-09. [2025-09-17T19:57:26.654763] [INFO ] [REMOTE ] KOF: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T19:57:26.660089] [INFO ] [REMOTE ] KOF: Full fetch complete (36941 records). [2025-09-17T19:57:26.660253] [DEBUG] [VALIDATOR ] KOF: Validating primary data. [2025-09-17T19:57:26.817497] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-02. [2025-09-17T19:57:27.078282] [DEBUG] [VALIDATOR ] KOF: All expected trading days are present. [2025-09-17T19:57:27.078450] [DEBUG] [VALIDATOR ] KOF: Primary data validation passed. [2025-09-17T19:57:27.079427] [INFO ] [MAIN ] KOF: Fetched primary data is valid. [2025-09-17T19:57:27.079495] [DEBUG] [LOCAL ] KOF: Saving primary data. [2025-09-17T19:57:27.092625] [DEBUG] [LOCAL ] KOF: Trimmed 36941 records to 25967 (keeping 200 days of data) [2025-09-17T19:57:27.114108] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T19:57:27.298254] [DEBUG] [LOCAL ] KOF: Primary data saved (25967 records). [2025-09-17T19:57:27.298462] [INFO ] [MAIN ] KOF: Full history saved. [2025-09-17T19:57:27.298686] [INFO ] [MAIN ] Update Progress: 1215/2371 symbols completed. KOF took 47.2s. Estimated remaining: 2h 48m 48s. Rate: 6.8 symbols/min [2025-09-17T19:57:27.484216] [INFO ] [MAIN ] KRC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:57:27.532532] [DEBUG] [LOCAL ] KRC: Loaded 48450 existing records from primary storage. [2025-09-17T19:57:27.532780] [INFO ] [MAIN ] KRC: Loaded 48450 existing records. [2025-09-17T19:57:27.620971] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-07. [2025-09-17T19:57:27.726762] [WARN ] [MAIN ] KRC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:57:27.727077] [INFO ] [MAIN ] KRC: Wiping existing primary data before full refresh. [2025-09-17T19:57:27.727125] [INFO ] [LOCAL ] KRC: Starting deletion of primary data. [2025-09-17T19:57:27.728419] [DEBUG] [LOCAL ] KRC: Deleted primary data file. [2025-09-17T19:57:27.728483] [INFO ] [MAIN ] KRC: Starting full primary refresh. [2025-09-17T19:57:28.109136] [INFO ] [REMOTE ] KRC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:57:28.415861] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-11. [2025-09-17T19:57:28.505785] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T19:57:28.653846] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T19:57:29.215818] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-08. [2025-09-17T19:57:29.993054] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T19:57:30.015718] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-01. [2025-09-17T19:57:30.042771] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T19:57:30.815836] [INFO ] [REMOTE ] KOP: Fetching primary data for 2025-09. [2025-09-17T19:57:31.289522] [INFO ] [REMOTE ] KOP: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T19:57:31.293240] [INFO ] [REMOTE ] KOP: Full fetch complete (25161 records). [2025-09-17T19:57:31.293357] [DEBUG] [VALIDATOR ] KOP: Validating primary data. [2025-09-17T19:57:31.617329] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-03. [2025-09-17T19:57:31.723848] [DEBUG] [VALIDATOR ] KOP: All expected trading days are present. [2025-09-17T19:57:31.724031] [DEBUG] [VALIDATOR ] KOP: Primary data validation passed. [2025-09-17T19:57:31.724946] [INFO ] [MAIN ] KOP: Fetched primary data is valid. [2025-09-17T19:57:31.725015] [DEBUG] [LOCAL ] KOP: Saving primary data. [2025-09-17T19:57:31.726894] [DEBUG] [LOCAL ] KOP: Trimmed 25161 records to 18043 (keeping 200 days of data) [2025-09-17T19:57:31.870174] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T19:57:31.899459] [DEBUG] [LOCAL ] KOP: Primary data saved (18043 records). [2025-09-17T19:57:31.899712] [INFO ] [MAIN ] KOP: Full history saved. [2025-09-17T19:57:31.899853] [INFO ] [MAIN ] Update Progress: 1216/2371 symbols completed. KOP took 32.2s. Estimated remaining: 2h 48m 36s. Rate: 6.9 symbols/min [2025-09-17T19:57:32.075572] [INFO ] [MAIN ] KREF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:57:32.117368] [DEBUG] [LOCAL ] KREF: Loaded 36939 existing records from primary storage. [2025-09-17T19:57:32.117605] [INFO ] [MAIN ] KREF: Loaded 36939 existing records. [2025-09-17T19:57:32.306237] [WARN ] [MAIN ] KREF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:57:32.306659] [INFO ] [MAIN ] KREF: Wiping existing primary data before full refresh. [2025-09-17T19:57:32.306714] [INFO ] [LOCAL ] KREF: Starting deletion of primary data. [2025-09-17T19:57:32.307669] [DEBUG] [LOCAL ] KREF: Deleted primary data file. [2025-09-17T19:57:32.307733] [INFO ] [MAIN ] KREF: Starting full primary refresh. [2025-09-17T19:57:32.420905] [INFO ] [REMOTE ] KRC: Fetching primary data for 2024-12. [2025-09-17T19:57:32.692755] [INFO ] [REMOTE ] KREF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:57:33.215805] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-02. [2025-09-17T19:57:33.268396] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T19:57:34.015838] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-04. [2025-09-17T19:57:34.184714] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T19:57:34.815832] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-01. [2025-09-17T19:57:35.008370] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T19:57:35.500279] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T19:57:35.615792] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-05. [2025-09-17T19:57:35.972907] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T19:57:36.415884] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-03. [2025-09-17T19:57:37.215829] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-11. [2025-09-17T19:57:37.350032] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T19:57:37.944093] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T19:57:38.015873] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-02. [2025-09-17T19:57:38.073266] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T19:57:38.815821] [INFO ] [REMOTE ] KREF: Fetching primary data for 2024-12. [2025-09-17T19:57:39.615789] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-06. [2025-09-17T19:57:39.827627] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T19:57:40.157054] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T19:57:40.415831] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-03. [2025-09-17T19:57:41.215865] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-04. [2025-09-17T19:57:41.425987] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T19:57:42.015916] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-07. [2025-09-17T19:57:42.089678] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T19:57:42.815855] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-01. [2025-09-17T19:57:42.859814] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T19:57:43.615839] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-05. [2025-09-17T19:57:43.923518] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T19:57:44.023103] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T19:57:44.415862] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-02. [2025-09-17T19:57:45.215833] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-04. [2025-09-17T19:57:45.618490] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T19:57:45.709076] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T19:57:46.015821] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-03. [2025-09-17T19:57:46.815795] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-08. [2025-09-17T19:57:46.963796] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T19:57:47.361013] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T19:57:47.615868] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-04. [2025-09-17T19:57:48.379849] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T19:57:48.415757] [INFO ] [REMOTE ] KOS: Fetching primary data for 2025-09. [2025-09-17T19:57:49.112445] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T19:57:49.185573] [INFO ] [REMOTE ] KOS: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T19:57:49.195321] [INFO ] [REMOTE ] KOS: Full fetch complete (76686 records). [2025-09-17T19:57:49.195577] [DEBUG] [VALIDATOR ] KOS: Validating primary data. [2025-09-17T19:57:49.220967] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-05. [2025-09-17T19:57:49.639236] [DEBUG] [VALIDATOR ] KOS: All expected trading days are present. [2025-09-17T19:57:49.639357] [DEBUG] [VALIDATOR ] KOS: Primary data validation passed. [2025-09-17T19:57:49.640816] [INFO ] [MAIN ] KOS: Fetched primary data is valid. [2025-09-17T19:57:49.640874] [DEBUG] [LOCAL ] KOS: Saving primary data. [2025-09-17T19:57:49.642987] [DEBUG] [LOCAL ] KOS: Trimmed 76686 records to 53069 (keeping 200 days of data) [2025-09-17T19:57:49.977894] [DEBUG] [LOCAL ] KOS: Primary data saved (53069 records). [2025-09-17T19:57:49.978137] [INFO ] [MAIN ] KOS: Full history saved. [2025-09-17T19:57:49.978277] [INFO ] [MAIN ] Update Progress: 1217/2371 symbols completed. KOS took 40.2s. Estimated remaining: 2h 48m 36s. Rate: 6.8 symbols/min [2025-09-17T19:57:50.024769] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-05. [2025-09-17T19:57:50.183172] [INFO ] [MAIN ] KRG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:57:50.233634] [DEBUG] [LOCAL ] KRG: Loaded 49190 existing records from primary storage. [2025-09-17T19:57:50.233933] [INFO ] [MAIN ] KRG: Loaded 49190 existing records. [2025-09-17T19:57:50.425744] [WARN ] [MAIN ] KRG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:57:50.426139] [INFO ] [MAIN ] KRG: Wiping existing primary data before full refresh. [2025-09-17T19:57:50.426191] [INFO ] [LOCAL ] KRG: Starting deletion of primary data. [2025-09-17T19:57:50.427768] [DEBUG] [LOCAL ] KRG: Deleted primary data file. [2025-09-17T19:57:50.427838] [INFO ] [MAIN ] KRG: Starting full primary refresh. [2025-09-17T19:57:50.824524] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-06. [2025-09-17T19:57:50.830704] [INFO ] [REMOTE ] KRG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:57:50.908691] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T19:57:51.264256] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T19:57:51.615857] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-06. [2025-09-17T19:57:52.415815] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-06. [2025-09-17T19:57:52.774688] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T19:57:53.197465] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T19:57:53.215728] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-07. [2025-09-17T19:57:53.976786] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T19:57:54.015743] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-07. [2025-09-17T19:57:54.671750] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T19:57:54.815816] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-07. [2025-09-17T19:57:55.539763] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T19:57:55.615821] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-08. [2025-09-17T19:57:56.341213] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T19:57:56.415814] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-08. [2025-09-17T19:57:56.984074] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T19:57:57.215798] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-08. [2025-09-17T19:57:57.927457] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T19:57:58.015802] [INFO ] [REMOTE ] KR: Fetching primary data for 2025-09. [2025-09-17T19:57:58.822457] [INFO ] [REMOTE ] KREF: Fetching primary data for 2025-09. [2025-09-17T19:57:58.827529] [INFO ] [REMOTE ] KR: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T19:57:58.835393] [INFO ] [REMOTE ] KR: Full fetch complete (77523 records). [2025-09-17T19:57:58.835562] [DEBUG] [VALIDATOR ] KR: Validating primary data. [2025-09-17T19:57:59.254375] [DEBUG] [VALIDATOR ] KR: All expected trading days are present. [2025-09-17T19:57:59.254584] [DEBUG] [VALIDATOR ] KR: Primary data validation passed. [2025-09-17T19:57:59.255998] [INFO ] [MAIN ] KR: Fetched primary data is valid. [2025-09-17T19:57:59.256103] [DEBUG] [LOCAL ] KR: Saving primary data. [2025-09-17T19:57:59.269272] [DEBUG] [LOCAL ] KR: Trimmed 77523 records to 53682 (keeping 200 days of data) [2025-09-17T19:57:59.291597] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T19:57:59.555094] [INFO ] [REMOTE ] KREF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T19:57:59.565001] [INFO ] [REMOTE ] KREF: Full fetch complete (51426 records). [2025-09-17T19:57:59.566556] [DEBUG] [VALIDATOR ] KREF: Validating primary data. [2025-09-17T19:57:59.626521] [INFO ] [REMOTE ] KRC: Fetching primary data for 2025-09. [2025-09-17T19:57:59.990054] [DEBUG] [VALIDATOR ] KREF: All expected trading days are present. [2025-09-17T19:57:59.990408] [DEBUG] [VALIDATOR ] KREF: Primary data validation passed. [2025-09-17T19:57:59.991789] [INFO ] [MAIN ] KREF: Fetched primary data is valid. [2025-09-17T19:57:59.992115] [DEBUG] [LOCAL ] KREF: Saving primary data. [2025-09-17T19:57:59.998518] [DEBUG] [LOCAL ] KREF: Trimmed 51426 records to 36950 (keeping 200 days of data) [2025-09-17T19:58:00.328036] [DEBUG] [LOCAL ] KREF: Primary data saved (36950 records). [2025-09-17T19:58:00.329885] [INFO ] [MAIN ] KREF: Full history saved. [2025-09-17T19:58:00.330560] [INFO ] [MAIN ] Update Progress: 1218/2371 symbols completed. KREF took 28.4s. Estimated remaining: 2h 48m 29s. Rate: 6.8 symbols/min [2025-09-17T19:58:00.422096] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-11. [2025-09-17T19:58:00.444345] [DEBUG] [LOCAL ] KR: Primary data saved (53682 records). [2025-09-17T19:58:00.445274] [INFO ] [MAIN ] KR: Full history saved. [2025-09-17T19:58:00.451726] [INFO ] [MAIN ] Update Progress: 1219/2371 symbols completed. KR took 38.5s. Estimated remaining: 2h 48m 12s. Rate: 6.8 symbols/min [2025-09-17T19:58:00.571954] [INFO ] [MAIN ] KRMN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:58:00.624289] [DEBUG] [LOCAL ] KRMN: No existing data file found in primary storage. [2025-09-17T19:58:00.636798] [WARN ] [MAIN ] KRMN: No existing data found, performing full refresh instead. [2025-09-17T19:58:00.637178] [INFO ] [MAIN ] KRMN: Wiping existing primary data before full refresh. [2025-09-17T19:58:00.637268] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-17T19:58:00.716956] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-17T19:58:00.739205] [INFO ] [MAIN ] KRO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:58:00.741822] [INFO ] [REMOTE ] KRC: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T19:58:00.740370] [INFO ] [MAIN ] KRMN: Starting full primary refresh. [2025-09-17T19:58:00.784914] [INFO ] [REMOTE ] KRC: Full fetch complete (69351 records). [2025-09-17T19:58:00.812720] [DEBUG] [VALIDATOR ] KRC: Validating primary data. [2025-09-17T19:58:01.121732] [DEBUG] [LOCAL ] KRO: Loaded 25645 existing records from primary storage. [2025-09-17T19:58:01.181598] [INFO ] [MAIN ] KRO: Loaded 25645 existing records. [2025-09-17T19:58:01.704965] [WARN ] [MAIN ] KRO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:58:01.716479] [INFO ] [REMOTE ] KRMN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:58:01.717077] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-11. [2025-09-17T19:58:01.724331] [INFO ] [MAIN ] KRO: Wiping existing primary data before full refresh. [2025-09-17T19:58:01.762162] [INFO ] [LOCAL ] KRO: Starting deletion of primary data. [2025-09-17T19:58:01.784262] [DEBUG] [LOCAL ] KRO: Deleted primary data file. [2025-09-17T19:58:01.796611] [INFO ] [MAIN ] KRO: Starting full primary refresh. [2025-09-17T19:58:01.914723] [DEBUG] [VALIDATOR ] KRC: All expected trading days are present. [2025-09-17T19:58:01.938959] [DEBUG] [VALIDATOR ] KRC: Primary data validation passed. [2025-09-17T19:58:01.940919] [INFO ] [MAIN ] KRC: Fetched primary data is valid. [2025-09-17T19:58:01.946903] [DEBUG] [LOCAL ] KRC: Saving primary data. [2025-09-17T19:58:02.035938] [DEBUG] [LOCAL ] KRC: Trimmed 69351 records to 48440 (keeping 200 days of data) [2025-09-17T19:58:02.045760] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:58:02.081544] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-11 [2025-09-17T19:58:02.188291] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2024-12. [2025-09-17T19:58:02.368437] [INFO ] [REMOTE ] KRO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:58:02.407525] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T19:58:02.514205] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:58:02.517949] [WARN ] [REMOTE ] KRMN: No data returned for month 2024-12 [2025-09-17T19:58:02.610329] [DEBUG] [LOCAL ] KRC: Primary data saved (48440 records). [2025-09-17T19:58:02.610556] [INFO ] [MAIN ] KRC: Full history saved. [2025-09-17T19:58:02.610724] [INFO ] [MAIN ] Update Progress: 1220/2371 symbols completed. KRC took 35.3s. Estimated remaining: 2h 47m 57s. Rate: 6.9 symbols/min [2025-09-17T19:58:02.796994] [INFO ] [MAIN ] KRP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:58:02.821074] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-11. [2025-09-17T19:58:02.841694] [DEBUG] [LOCAL ] KRP: Loaded 38147 existing records from primary storage. [2025-09-17T19:58:02.841942] [INFO ] [MAIN ] KRP: Loaded 38147 existing records. [2025-09-17T19:58:03.037974] [WARN ] [MAIN ] KRP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:58:03.038328] [INFO ] [MAIN ] KRP: Wiping existing primary data before full refresh. [2025-09-17T19:58:03.038378] [INFO ] [LOCAL ] KRP: Starting deletion of primary data. [2025-09-17T19:58:03.039349] [DEBUG] [LOCAL ] KRP: Deleted primary data file. [2025-09-17T19:58:03.039402] [INFO ] [MAIN ] KRP: Starting full primary refresh. [2025-09-17T19:58:03.417913] [INFO ] [REMOTE ] KRP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:58:03.615805] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-11. [2025-09-17T19:58:03.671081] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T19:58:04.415864] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-01. [2025-09-17T19:58:04.628681] [DEBUG] [REMOTE ] KRMN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T19:58:04.629130] [WARN ] [REMOTE ] KRMN: No data returned for month 2025-01 [2025-09-17T19:58:04.950140] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T19:58:05.215928] [INFO ] [REMOTE ] KRG: Fetching primary data for 2024-12. [2025-09-17T19:58:06.015857] [INFO ] [REMOTE ] KRO: Fetching primary data for 2024-12. [2025-09-17T19:58:06.597420] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T19:58:06.815821] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-01. [2025-09-17T19:58:06.848817] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T19:58:07.615869] [INFO ] [REMOTE ] KRP: Fetching primary data for 2024-12. [2025-09-17T19:58:08.220905] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T19:58:08.415838] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-01. [2025-09-17T19:58:08.566756] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T19:58:09.215815] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-01. [2025-09-17T19:58:09.432526] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T19:58:10.015853] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-02. [2025-09-17T19:58:10.455823] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T19:58:10.798211] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T19:58:10.815755] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-03. [2025-09-17T19:58:11.615810] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-02. [2025-09-17T19:58:11.991314] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T19:58:12.415821] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-02. [2025-09-17T19:58:12.774787] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T19:58:13.215896] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-04. [2025-09-17T19:58:13.839730] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T19:58:14.015820] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-02. [2025-09-17T19:58:14.446564] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T19:58:14.815799] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-03. [2025-09-17T19:58:15.538161] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T19:58:15.615814] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-05. [2025-09-17T19:58:16.388053] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T19:58:16.415743] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-04. [2025-09-17T19:58:16.450569] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T19:58:17.215805] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-06. [2025-09-17T19:58:17.989219] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T19:58:18.015725] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-05. [2025-09-17T19:58:18.459976] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T19:58:18.815789] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-07. [2025-09-17T19:58:19.485666] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T19:58:19.615817] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-06. [2025-09-17T19:58:19.957761] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T19:58:20.415840] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-03. [2025-09-17T19:58:20.983436] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T19:58:21.215838] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-03. [2025-09-17T19:58:21.806336] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T19:58:22.015821] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-07. [2025-09-17T19:58:22.777061] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T19:58:22.815770] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-04. [2025-09-17T19:58:23.258873] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T19:58:23.615866] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-08. [2025-09-17T19:58:24.368188] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T19:58:24.415804] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-05. [2025-09-17T19:58:24.923807] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T19:58:25.215890] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-04. [2025-09-17T19:58:25.855705] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T19:58:26.015835] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-06. [2025-09-17T19:58:26.815846] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-08. [2025-09-17T19:58:26.929008] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T19:58:27.588098] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T19:58:27.615839] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-07. [2025-09-17T19:58:28.173290] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T19:58:28.415845] [INFO ] [REMOTE ] KRO: Fetching primary data for 2025-09. [2025-09-17T19:58:28.745388] [INFO ] [REMOTE ] KRO: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-17T19:58:28.749612] [INFO ] [REMOTE ] KRO: Full fetch complete (34555 records). [2025-09-17T19:58:28.749797] [DEBUG] [VALIDATOR ] KRO: Validating primary data. [2025-09-17T19:58:29.155881] [DEBUG] [VALIDATOR ] KRO: All expected trading days are present. [2025-09-17T19:58:29.156034] [DEBUG] [VALIDATOR ] KRO: Primary data validation passed. [2025-09-17T19:58:29.157224] [INFO ] [MAIN ] KRO: Fetched primary data is valid. [2025-09-17T19:58:29.157348] [DEBUG] [LOCAL ] KRO: Saving primary data. [2025-09-17T19:58:29.170294] [DEBUG] [LOCAL ] KRO: Trimmed 34555 records to 25757 (keeping 200 days of data) [2025-09-17T19:58:29.192406] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T19:58:29.253244] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-05. [2025-09-17T19:58:29.366999] [DEBUG] [LOCAL ] KRO: Primary data saved (25757 records). [2025-09-17T19:58:29.367209] [INFO ] [MAIN ] KRO: Full history saved. [2025-09-17T19:58:29.367321] [INFO ] [MAIN ] Update Progress: 1221/2371 symbols completed. KRO took 28.9s. Estimated remaining: 2h 48m 5s. Rate: 6.8 symbols/min [2025-09-17T19:58:29.542284] [INFO ] [MAIN ] KSS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:58:29.600525] [DEBUG] [LOCAL ] KSS: Loaded 53612 existing records from primary storage. [2025-09-17T19:58:29.600953] [INFO ] [MAIN ] KSS: Loaded 53612 existing records. [2025-09-17T19:58:29.785417] [WARN ] [MAIN ] KSS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:58:29.785805] [INFO ] [MAIN ] KSS: Wiping existing primary data before full refresh. [2025-09-17T19:58:29.785858] [INFO ] [LOCAL ] KSS: Starting deletion of primary data. [2025-09-17T19:58:29.787037] [DEBUG] [LOCAL ] KSS: Deleted primary data file. [2025-09-17T19:58:29.787091] [INFO ] [MAIN ] KSS: Starting full primary refresh. [2025-09-17T19:58:30.024769] [INFO ] [REMOTE ] KRP: Fetching primary data for 2025-09. [2025-09-17T19:58:30.238952] [INFO ] [REMOTE ] KSS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:58:30.742740] [INFO ] [REMOTE ] KRP: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T19:58:30.748261] [INFO ] [REMOTE ] KRP: Full fetch complete (54689 records). [2025-09-17T19:58:30.748528] [DEBUG] [VALIDATOR ] KRP: Validating primary data. [2025-09-17T19:58:30.821009] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-11. [2025-09-17T19:58:31.189735] [DEBUG] [VALIDATOR ] KRP: All expected trading days are present. [2025-09-17T19:58:31.190005] [DEBUG] [VALIDATOR ] KRP: Primary data validation passed. [2025-09-17T19:58:31.191192] [INFO ] [MAIN ] KRP: Fetched primary data is valid. [2025-09-17T19:58:31.191292] [DEBUG] [LOCAL ] KRP: Saving primary data. [2025-09-17T19:58:31.206164] [DEBUG] [LOCAL ] KRP: Trimmed 54689 records to 38029 (keeping 200 days of data) [2025-09-17T19:58:31.234469] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T19:58:31.496826] [DEBUG] [LOCAL ] KRP: Primary data saved (38029 records). [2025-09-17T19:58:31.497003] [INFO ] [MAIN ] KRP: Full history saved. [2025-09-17T19:58:31.497107] [INFO ] [MAIN ] Update Progress: 1222/2371 symbols completed. KRP took 28.9s. Estimated remaining: 2h 47m 50s. Rate: 6.8 symbols/min [2025-09-17T19:58:31.621068] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-08. [2025-09-17T19:58:31.687490] [INFO ] [MAIN ] KT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:58:31.733393] [DEBUG] [LOCAL ] KT: Loaded 45727 existing records from primary storage. [2025-09-17T19:58:31.733572] [INFO ] [MAIN ] KT: Loaded 45727 existing records. [2025-09-17T19:58:31.920605] [WARN ] [MAIN ] KT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:58:31.920892] [INFO ] [MAIN ] KT: Wiping existing primary data before full refresh. [2025-09-17T19:58:31.920938] [INFO ] [LOCAL ] KT: Starting deletion of primary data. [2025-09-17T19:58:31.921959] [DEBUG] [LOCAL ] KT: Deleted primary data file. [2025-09-17T19:58:31.922010] [INFO ] [MAIN ] KT: Starting full primary refresh. [2025-09-17T19:58:32.292894] [INFO ] [REMOTE ] KT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:58:32.415784] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-11. [2025-09-17T19:58:32.974274] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-17T19:58:33.215793] [INFO ] [REMOTE ] KSS: Fetching primary data for 2024-12. [2025-09-17T19:58:33.338159] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T19:58:33.591321] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T19:58:34.015849] [INFO ] [REMOTE ] KRMN: Fetching primary data for 2025-09. [2025-09-17T19:58:34.788081] [INFO ] [REMOTE ] KRMN: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T19:58:34.796412] [INFO ] [REMOTE ] KRMN: Full fetch complete (48116 records). [2025-09-17T19:58:34.796689] [DEBUG] [VALIDATOR ] KRMN: Validating primary data. [2025-09-17T19:58:34.820938] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-06. [2025-09-17T19:58:35.038559] [WARN ] [VALIDATOR ] KRMN: Validation failed - insufficient historical data. Have 149 unique days, need 200 days [2025-09-17T19:58:35.039199] [FATAL] [MAIN ] KRMN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:58:35.039255] [WARN ] [MAIN ] KRMN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:58:35.039297] [INFO ] [LOCAL ] KRMN: Starting deletion of primary data. [2025-09-17T19:58:35.039376] [DEBUG] [LOCAL ] KRMN: No primary data file found to delete. [2025-09-17T19:58:35.039419] [INFO ] [LOCAL ] KRMN: Starting deletion of derivative data. [2025-09-17T19:58:35.039484] [DEBUG] [LOCAL ] KRMN: No derivative data file found to delete. [2025-09-17T19:58:35.039571] [INFO ] [MAIN ] Update Progress: 1223/2371 symbols completed. KRMN took 34.7s. Estimated remaining: 2h 47m 36s. Rate: 6.8 symbols/min [2025-09-17T19:58:35.246923] [INFO ] [MAIN ] KTB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:58:35.287803] [DEBUG] [LOCAL ] KTB: Loaded 41355 existing records from primary storage. [2025-09-17T19:58:35.287962] [INFO ] [MAIN ] KTB: Loaded 41355 existing records. [2025-09-17T19:58:35.485018] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2024-12 (2.27 seconds). [2025-09-17T19:58:35.518336] [WARN ] [MAIN ] KTB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:58:35.519180] [INFO ] [MAIN ] KTB: Wiping existing primary data before full refresh. [2025-09-17T19:58:35.519241] [INFO ] [LOCAL ] KTB: Starting deletion of primary data. [2025-09-17T19:58:35.520582] [DEBUG] [LOCAL ] KTB: Deleted primary data file. [2025-09-17T19:58:35.520677] [INFO ] [MAIN ] KTB: Starting full primary refresh. [2025-09-17T19:58:35.619948] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-01. [2025-09-17T19:58:35.874212] [INFO ] [REMOTE ] KTB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:58:36.415843] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-11. [2025-09-17T19:58:36.486331] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T19:58:37.215775] [INFO ] [REMOTE ] KT: Fetching primary data for 2024-12. [2025-09-17T19:58:37.380873] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T19:58:37.721693] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T19:58:38.015817] [INFO ] [REMOTE ] KTB: Fetching primary data for 2024-12. [2025-09-17T19:58:38.815781] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-02. [2025-09-17T19:58:38.875262] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T19:58:39.287259] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T19:58:39.615793] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-01. [2025-09-17T19:58:40.415868] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-01. [2025-09-17T19:58:40.720766] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T19:58:40.798595] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T19:58:41.215817] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-03. [2025-09-17T19:58:41.919533] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T19:58:42.015764] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-07. [2025-09-17T19:58:42.815812] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-02. [2025-09-17T19:58:42.936971] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T19:58:43.615789] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-04. [2025-09-17T19:58:43.775914] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T19:58:44.426877] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-02. [2025-09-17T19:58:44.433742] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T19:58:45.215824] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-03. [2025-09-17T19:58:45.342384] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T19:58:45.452281] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T19:58:46.015800] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-03. [2025-09-17T19:58:46.522671] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T19:58:46.815814] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-08. [2025-09-17T19:58:47.333777] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T19:58:47.615780] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-04. [2025-09-17T19:58:48.408417] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T19:58:48.418373] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-05. [2025-09-17T19:58:49.012547] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T19:58:49.215783] [INFO ] [REMOTE ] KRG: Fetching primary data for 2025-09. [2025-09-17T19:58:49.958012] [INFO ] [REMOTE ] KRG: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T19:58:49.966388] [INFO ] [REMOTE ] KRG: Full fetch complete (70701 records). [2025-09-17T19:58:49.966674] [DEBUG] [VALIDATOR ] KRG: Validating primary data. [2025-09-17T19:58:50.026227] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-05. [2025-09-17T19:58:50.376309] [DEBUG] [VALIDATOR ] KRG: All expected trading days are present. [2025-09-17T19:58:50.376475] [DEBUG] [VALIDATOR ] KRG: Primary data validation passed. [2025-09-17T19:58:50.377605] [INFO ] [MAIN ] KRG: Fetched primary data is valid. [2025-09-17T19:58:50.377691] [DEBUG] [LOCAL ] KRG: Saving primary data. [2025-09-17T19:58:50.379579] [DEBUG] [LOCAL ] KRG: Trimmed 70701 records to 49169 (keeping 200 days of data) [2025-09-17T19:58:50.542953] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T19:58:50.750837] [DEBUG] [LOCAL ] KRG: Primary data saved (49169 records). [2025-09-17T19:58:50.750992] [INFO ] [MAIN ] KRG: Full history saved. [2025-09-17T19:58:50.751090] [INFO ] [MAIN ] Update Progress: 1224/2371 symbols completed. KRG took 1m 1s. Estimated remaining: 2h 47m 34s. Rate: 6.8 symbols/min [2025-09-17T19:58:50.822893] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-04. [2025-09-17T19:58:50.935845] [INFO ] [MAIN ] KTF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:58:50.950914] [DEBUG] [LOCAL ] KTF: Loaded 13188 existing records from primary storage. [2025-09-17T19:58:50.951089] [INFO ] [MAIN ] KTF: Loaded 13188 existing records. [2025-09-17T19:58:51.128866] [WARN ] [MAIN ] KTF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:58:51.129114] [INFO ] [MAIN ] KTF: Wiping existing primary data before full refresh. [2025-09-17T19:58:51.129160] [INFO ] [LOCAL ] KTF: Starting deletion of primary data. [2025-09-17T19:58:51.129619] [DEBUG] [LOCAL ] KTF: Deleted primary data file. [2025-09-17T19:58:51.129696] [INFO ] [MAIN ] KTF: Starting full primary refresh. [2025-09-17T19:58:51.502780] [INFO ] [REMOTE ] KTF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:58:51.533777] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T19:58:51.615779] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-06. [2025-09-17T19:58:52.415791] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-06. [2025-09-17T19:58:52.646442] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T19:58:52.971177] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T19:58:53.215787] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-07. [2025-09-17T19:58:54.015791] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-05. [2025-09-17T19:58:54.266001] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T19:58:54.458715] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T19:58:54.815815] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-07. [2025-09-17T19:58:55.616512] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-08. [2025-09-17T19:58:55.619227] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T19:58:56.415826] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-06. [2025-09-17T19:58:57.057789] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-17T19:58:57.209176] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T19:58:57.218341] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-11. [2025-09-17T19:58:57.534837] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T19:58:57.785151] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T19:58:58.015826] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-07. [2025-09-17T19:58:58.815841] [INFO ] [REMOTE ] KTF: Fetching primary data for 2024-12. [2025-09-17T19:58:59.508912] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T19:58:59.615746] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-08. [2025-09-17T19:58:59.663672] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T19:59:00.415778] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-01. [2025-09-17T19:59:01.019966] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T19:59:01.215841] [INFO ] [REMOTE ] KTB: Fetching primary data for 2025-09. [2025-09-17T19:59:01.234860] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T19:59:01.931013] [INFO ] [REMOTE ] KTB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T19:59:01.936460] [INFO ] [REMOTE ] KTB: Full fetch complete (57095 records). [2025-09-17T19:59:01.936633] [DEBUG] [VALIDATOR ] KTB: Validating primary data. [2025-09-17T19:59:02.020980] [INFO ] [REMOTE ] KT: Fetching primary data for 2025-09. [2025-09-17T19:59:02.357773] [DEBUG] [VALIDATOR ] KTB: All expected trading days are present. [2025-09-17T19:59:02.357915] [DEBUG] [VALIDATOR ] KTB: Primary data validation passed. [2025-09-17T19:59:02.359150] [INFO ] [MAIN ] KTB: Fetched primary data is valid. [2025-09-17T19:59:02.359235] [DEBUG] [LOCAL ] KTB: Saving primary data. [2025-09-17T19:59:02.361105] [DEBUG] [LOCAL ] KTB: Trimmed 57095 records to 41325 (keeping 200 days of data) [2025-09-17T19:59:02.652319] [DEBUG] [LOCAL ] KTB: Primary data saved (41325 records). [2025-09-17T19:59:02.652523] [INFO ] [MAIN ] KTB: Full history saved. [2025-09-17T19:59:02.652636] [INFO ] [MAIN ] Update Progress: 1225/2371 symbols completed. KTB took 27.6s. Estimated remaining: 2h 47m 28s. Rate: 6.8 symbols/min [2025-09-17T19:59:02.818969] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-08. [2025-09-17T19:59:02.841695] [INFO ] [MAIN ] KUKE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:59:02.842990] [DEBUG] [LOCAL ] KUKE: No existing data file found in primary storage. [2025-09-17T19:59:02.843041] [WARN ] [MAIN ] KUKE: No existing data found, performing full refresh instead. [2025-09-17T19:59:02.843218] [INFO ] [MAIN ] KUKE: Wiping existing primary data before full refresh. [2025-09-17T19:59:02.843263] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-17T19:59:02.843307] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-17T19:59:02.843346] [INFO ] [MAIN ] KUKE: Starting full primary refresh. [2025-09-17T19:59:03.173780] [INFO ] [REMOTE ] KT: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T19:59:03.246504] [INFO ] [REMOTE ] KT: Full fetch complete (66832 records). [2025-09-17T19:59:03.264721] [DEBUG] [VALIDATOR ] KT: Validating primary data. [2025-09-17T19:59:03.268543] [INFO ] [REMOTE ] KUKE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:59:03.621012] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-11. [2025-09-17T19:59:03.696932] [DEBUG] [VALIDATOR ] KT: All expected trading days are present. [2025-09-17T19:59:03.697044] [DEBUG] [VALIDATOR ] KT: Primary data validation passed. [2025-09-17T19:59:03.698333] [INFO ] [MAIN ] KT: Fetched primary data is valid. [2025-09-17T19:59:03.698406] [DEBUG] [LOCAL ] KT: Saving primary data. [2025-09-17T19:59:03.700308] [DEBUG] [LOCAL ] KT: Trimmed 66832 records to 45715 (keeping 200 days of data) [2025-09-17T19:59:04.002476] [DEBUG] [LOCAL ] KT: Primary data saved (45715 records). [2025-09-17T19:59:04.002694] [INFO ] [MAIN ] KT: Full history saved. [2025-09-17T19:59:04.002805] [INFO ] [MAIN ] Update Progress: 1226/2371 symbols completed. KT took 32.5s. Estimated remaining: 2h 47m 12s. Rate: 6.8 symbols/min [2025-09-17T19:59:04.182331] [INFO ] [MAIN ] KVUE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:59:04.235708] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-17T19:59:04.235921] [INFO ] [MAIN ] KVUE: Loaded 53667 existing records. [2025-09-17T19:59:04.427337] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-02. [2025-09-17T19:59:04.434003] [WARN ] [MAIN ] KVUE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:59:04.434321] [INFO ] [MAIN ] KVUE: Wiping existing primary data before full refresh. [2025-09-17T19:59:04.434368] [INFO ] [LOCAL ] KVUE: Starting deletion of primary data. [2025-09-17T19:59:04.436294] [DEBUG] [LOCAL ] KVUE: Deleted primary data file. [2025-09-17T19:59:04.436355] [INFO ] [MAIN ] KVUE: Starting full primary refresh. [2025-09-17T19:59:04.826361] [INFO ] [REMOTE ] KVUE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:59:04.930629] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-17T19:59:04.955468] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T19:59:05.013433] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T19:59:05.215847] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-11. [2025-09-17T19:59:06.015803] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2024-12. [2025-09-17T19:59:06.633046] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T19:59:06.815852] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-03. [2025-09-17T19:59:06.969690] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T19:59:07.467017] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T19:59:07.615839] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-04. [2025-09-17T19:59:08.415839] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-01. [2025-09-17T19:59:08.577008] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T19:59:09.215843] [INFO ] [REMOTE ] KSS: Fetching primary data for 2025-09. [2025-09-17T19:59:09.395735] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T19:59:09.705225] [INFO ] [REMOTE ] KSS: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T19:59:09.713739] [INFO ] [REMOTE ] KSS: Full fetch complete (77580 records). [2025-09-17T19:59:09.713965] [DEBUG] [VALIDATOR ] KSS: Validating primary data. [2025-09-17T19:59:10.021159] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2024-12. [2025-09-17T19:59:10.144411] [DEBUG] [VALIDATOR ] KSS: All expected trading days are present. [2025-09-17T19:59:10.144529] [DEBUG] [VALIDATOR ] KSS: Primary data validation passed. [2025-09-17T19:59:10.145921] [INFO ] [MAIN ] KSS: Fetched primary data is valid. [2025-09-17T19:59:10.145985] [DEBUG] [LOCAL ] KSS: Saving primary data. [2025-09-17T19:59:10.148054] [DEBUG] [LOCAL ] KSS: Trimmed 77580 records to 53612 (keeping 200 days of data) [2025-09-17T19:59:10.509515] [DEBUG] [LOCAL ] KSS: Primary data saved (53612 records). [2025-09-17T19:59:10.509761] [INFO ] [MAIN ] KSS: Full history saved. [2025-09-17T19:59:10.510970] [INFO ] [MAIN ] Update Progress: 1227/2371 symbols completed. KSS took 41.1s. Estimated remaining: 2h 47m 2s. Rate: 6.8 symbols/min [2025-09-17T19:59:10.693023] [INFO ] [MAIN ] KVYO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:59:10.752861] [DEBUG] [LOCAL ] KVYO: Loaded 49770 existing records from primary storage. [2025-09-17T19:59:10.753140] [INFO ] [MAIN ] KVYO: Loaded 49770 existing records. [2025-09-17T19:59:10.823954] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-05. [2025-09-17T19:59:10.953762] [WARN ] [MAIN ] KVYO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:59:10.954115] [INFO ] [MAIN ] KVYO: Wiping existing primary data before full refresh. [2025-09-17T19:59:10.954165] [INFO ] [LOCAL ] KVYO: Starting deletion of primary data. [2025-09-17T19:59:10.955796] [DEBUG] [LOCAL ] KVYO: Deleted primary data file. [2025-09-17T19:59:10.955851] [INFO ] [MAIN ] KVYO: Starting full primary refresh. [2025-09-17T19:59:11.345068] [INFO ] [REMOTE ] KVYO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:59:11.615842] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-02. [2025-09-17T19:59:11.728276] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T19:59:11.994922] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T19:59:12.030930] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T19:59:12.415883] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-11. [2025-09-17T19:59:13.215861] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-06. [2025-09-17T19:59:14.015822] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-01. [2025-09-17T19:59:14.073493] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T19:59:14.138248] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T19:59:14.815866] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-07. [2025-09-17T19:59:15.615856] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-03. [2025-09-17T19:59:15.666859] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T19:59:15.813122] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T19:59:16.281384] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T19:59:16.415875] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-08. [2025-09-17T19:59:17.215815] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-04. [2025-09-17T19:59:17.235560] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T19:59:17.836846] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T19:59:18.015806] [INFO ] [REMOTE ] KTF: Fetching primary data for 2025-09. [2025-09-17T19:59:18.368043] [INFO ] [REMOTE ] KTF: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T19:59:18.370125] [INFO ] [REMOTE ] KTF: Full fetch complete (18443 records). [2025-09-17T19:59:18.370835] [DEBUG] [VALIDATOR ] KTF: Validating primary data. [2025-09-17T19:59:18.763904] [DEBUG] [VALIDATOR ] KTF: All expected trading days are present. [2025-09-17T19:59:18.764026] [DEBUG] [VALIDATOR ] KTF: Primary data validation passed. [2025-09-17T19:59:18.764839] [INFO ] [MAIN ] KTF: Fetched primary data is valid. [2025-09-17T19:59:18.764933] [DEBUG] [LOCAL ] KTF: Saving primary data. [2025-09-17T19:59:18.765764] [DEBUG] [LOCAL ] KTF: Trimmed 18443 records to 13205 (keeping 200 days of data) [2025-09-17T19:59:18.832783] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-05. [2025-09-17T19:59:18.862775] [DEBUG] [LOCAL ] KTF: Primary data saved (13205 records). [2025-09-17T19:59:18.863000] [INFO ] [MAIN ] KTF: Full history saved. [2025-09-17T19:59:18.863234] [INFO ] [MAIN ] Update Progress: 1228/2371 symbols completed. KTF took 28.1s. Estimated remaining: 2h 46m 52s. Rate: 6.8 symbols/min [2025-09-17T19:59:19.039883] [INFO ] [MAIN ] KW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:59:19.089609] [DEBUG] [LOCAL ] KW: Loaded 40623 existing records from primary storage. [2025-09-17T19:59:19.089821] [INFO ] [MAIN ] KW: Loaded 40623 existing records. [2025-09-17T19:59:19.278683] [WARN ] [MAIN ] KW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:59:19.278991] [INFO ] [MAIN ] KW: Wiping existing primary data before full refresh. [2025-09-17T19:59:19.279042] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-17T19:59:19.280137] [DEBUG] [LOCAL ] KW: Deleted primary data file. [2025-09-17T19:59:19.280205] [INFO ] [MAIN ] KW: Starting full primary refresh. [2025-09-17T19:59:19.396010] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T19:59:19.620940] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-06. [2025-09-17T19:59:19.736636] [INFO ] [REMOTE ] KW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:59:20.166183] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T19:59:20.415846] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-07. [2025-09-17T19:59:20.869834] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T19:59:21.215805] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-08. [2025-09-17T19:59:21.874752] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T19:59:22.015831] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-02. [2025-09-17T19:59:22.815880] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-11. [2025-09-17T19:59:23.514327] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T19:59:23.615790] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-03. [2025-09-17T19:59:23.856572] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T19:59:24.415900] [INFO ] [REMOTE ] KUKE: Fetching primary data for 2025-09. [2025-09-17T19:59:24.827059] [INFO ] [REMOTE ] KUKE: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T19:59:24.828680] [INFO ] [REMOTE ] KUKE: Full fetch complete (7983 records). [2025-09-17T19:59:24.828806] [DEBUG] [VALIDATOR ] KUKE: Validating primary data. [2025-09-17T19:59:25.037154] [WARN ] [VALIDATOR ] KUKE: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T19:59:25.037449] [FATAL] [MAIN ] KUKE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:59:25.037506] [WARN ] [MAIN ] KUKE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:59:25.037552] [INFO ] [LOCAL ] KUKE: Starting deletion of primary data. [2025-09-17T19:59:25.037619] [DEBUG] [LOCAL ] KUKE: No primary data file found to delete. [2025-09-17T19:59:25.037678] [INFO ] [LOCAL ] KUKE: Starting deletion of derivative data. [2025-09-17T19:59:25.037745] [DEBUG] [LOCAL ] KUKE: No derivative data file found to delete. [2025-09-17T19:59:25.037819] [INFO ] [MAIN ] Update Progress: 1229/2371 symbols completed. KUKE took 22.4s. Estimated remaining: 2h 46m 41s. Rate: 6.9 symbols/min [2025-09-17T19:59:25.217190] [INFO ] [REMOTE ] KW: Fetching primary data for 2024-12. [2025-09-17T19:59:25.219207] [INFO ] [MAIN ] KWR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:59:25.246588] [DEBUG] [LOCAL ] KWR: Loaded 16974 existing records from primary storage. [2025-09-17T19:59:25.246832] [INFO ] [MAIN ] KWR: Loaded 16974 existing records. [2025-09-17T19:59:25.450918] [WARN ] [MAIN ] KWR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:59:25.451838] [INFO ] [MAIN ] KWR: Wiping existing primary data before full refresh. [2025-09-17T19:59:25.451981] [INFO ] [LOCAL ] KWR: Starting deletion of primary data. [2025-09-17T19:59:25.452887] [DEBUG] [LOCAL ] KWR: Deleted primary data file. [2025-09-17T19:59:25.452957] [INFO ] [MAIN ] KWR: Starting full primary refresh. [2025-09-17T19:59:25.612609] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T19:59:25.908875] [INFO ] [REMOTE ] KWR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:59:26.015814] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2024-12. [2025-09-17T19:59:26.592444] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T19:59:26.815897] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-01. [2025-09-17T19:59:27.528292] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T19:59:27.615911] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-04. [2025-09-17T19:59:28.211664] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T19:59:28.415813] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-02. [2025-09-17T19:59:29.215785] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-01. [2025-09-17T19:59:29.474000] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T19:59:29.554058] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T19:59:30.015805] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-05. [2025-09-17T19:59:30.788422] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T19:59:30.815761] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-02. [2025-09-17T19:59:31.607374] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T19:59:31.618622] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-11. [2025-09-17T19:59:32.420051] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-06. [2025-09-17T19:59:32.426456] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T19:59:32.521689] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T19:59:33.215808] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-03. [2025-09-17T19:59:34.015807] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-03. [2025-09-17T19:59:34.196508] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T19:59:34.377777] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T19:59:34.815859] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-04. [2025-09-17T19:59:35.085733] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T19:59:35.615822] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-07. [2025-09-17T19:59:36.420905] [INFO ] [REMOTE ] KWR: Fetching primary data for 2024-12. [2025-09-17T19:59:36.444728] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T19:59:37.215850] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-04. [2025-09-17T19:59:37.564141] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T19:59:37.590866] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T19:59:38.015834] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-05. [2025-09-17T19:59:38.492567] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T19:59:38.815832] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-05. [2025-09-17T19:59:38.922033] [DEBUG] [REMOTE ] KW: Error fetching primary data for 2025-05: 'API call returned an empty response.' [2025-09-17T19:59:38.922489] [WARN ] [REMOTE ] KW: No data returned for month 2025-05 [2025-09-17T19:59:39.615798] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-01. [2025-09-17T19:59:39.704065] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T19:59:40.415852] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-08. [2025-09-17T19:59:40.628747] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T19:59:41.215875] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-06. [2025-09-17T19:59:42.015784] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-02. [2025-09-17T19:59:42.311154] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T19:59:42.645980] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T19:59:42.815770] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-06. [2025-09-17T19:59:43.192241] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T19:59:43.615791] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-03. [2025-09-17T19:59:44.406904] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T19:59:44.416225] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-07. [2025-09-17T19:59:44.485604] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T19:59:45.215828] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-04. [2025-09-17T19:59:45.958764] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T19:59:46.016436] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-07. [2025-09-17T19:59:46.019144] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T19:59:46.815802] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-05. [2025-09-17T19:59:47.615804] [INFO ] [REMOTE ] KVUE: Fetching primary data for 2025-09. [2025-09-17T19:59:47.675934] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T19:59:47.821088] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T19:59:48.415777] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-06. [2025-09-17T19:59:48.446243] [INFO ] [REMOTE ] KVUE: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T19:59:48.453595] [INFO ] [REMOTE ] KVUE: Full fetch complete (77507 records). [2025-09-17T19:59:48.454212] [DEBUG] [VALIDATOR ] KVUE: Validating primary data. [2025-09-17T19:59:48.868815] [DEBUG] [VALIDATOR ] KVUE: All expected trading days are present. [2025-09-17T19:59:48.868911] [DEBUG] [VALIDATOR ] KVUE: Primary data validation passed. [2025-09-17T19:59:48.870058] [INFO ] [MAIN ] KVUE: Fetched primary data is valid. [2025-09-17T19:59:48.870109] [DEBUG] [LOCAL ] KVUE: Saving primary data. [2025-09-17T19:59:48.872054] [DEBUG] [LOCAL ] KVUE: Trimmed 77507 records to 53667 (keeping 200 days of data) [2025-09-17T19:59:49.225716] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-08. [2025-09-17T19:59:49.240665] [DEBUG] [LOCAL ] KVUE: Primary data saved (53667 records). [2025-09-17T19:59:49.240906] [INFO ] [MAIN ] KVUE: Full history saved. [2025-09-17T19:59:49.241118] [INFO ] [MAIN ] Update Progress: 1230/2371 symbols completed. KVUE took 45.2s. Estimated remaining: 2h 46m 47s. Rate: 6.8 symbols/min [2025-09-17T19:59:49.439326] [INFO ] [MAIN ] KYN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:59:49.455271] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T19:59:49.491506] [DEBUG] [LOCAL ] KYN: Loaded 30513 existing records from primary storage. [2025-09-17T19:59:49.491756] [INFO ] [MAIN ] KYN: Loaded 30513 existing records. [2025-09-17T19:59:49.696031] [WARN ] [MAIN ] KYN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:59:49.696396] [INFO ] [MAIN ] KYN: Wiping existing primary data before full refresh. [2025-09-17T19:59:49.696444] [INFO ] [LOCAL ] KYN: Starting deletion of primary data. [2025-09-17T19:59:49.697443] [DEBUG] [LOCAL ] KYN: Deleted primary data file. [2025-09-17T19:59:49.697513] [INFO ] [MAIN ] KYN: Starting full primary refresh. [2025-09-17T19:59:50.020974] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-07. [2025-09-17T19:59:50.100271] [INFO ] [REMOTE ] KYN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:59:50.815813] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-08. [2025-09-17T19:59:50.949461] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T19:59:51.182978] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T19:59:51.615781] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-08. [2025-09-17T19:59:52.277824] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T19:59:52.415749] [INFO ] [REMOTE ] KW: Fetching primary data for 2025-09. [2025-09-17T19:59:52.483809] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T19:59:53.101498] [INFO ] [REMOTE ] KW: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T19:59:53.106948] [INFO ] [REMOTE ] KW: Full fetch complete (50020 records). [2025-09-17T19:59:53.107050] [DEBUG] [VALIDATOR ] KW: Validating primary data. [2025-09-17T19:59:53.221030] [INFO ] [REMOTE ] KWR: Fetching primary data for 2025-09. [2025-09-17T19:59:53.299881] [WARN ] [VALIDATOR ] KW: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T19:59:53.300470] [FATAL] [MAIN ] KW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T19:59:53.300523] [WARN ] [MAIN ] KW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T19:59:53.300573] [INFO ] [LOCAL ] KW: Starting deletion of primary data. [2025-09-17T19:59:53.300664] [DEBUG] [LOCAL ] KW: No primary data file found to delete. [2025-09-17T19:59:53.300704] [INFO ] [LOCAL ] KW: Starting deletion of derivative data. [2025-09-17T19:59:53.301288] [DEBUG] [LOCAL ] KW: Deleted derivative data file. [2025-09-17T19:59:53.301385] [INFO ] [MAIN ] Update Progress: 1231/2371 symbols completed. KW took 34.4s. Estimated remaining: 2h 46m 34s. Rate: 6.8 symbols/min [2025-09-17T19:59:53.470569] [INFO ] [MAIN ] L: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:59:53.514661] [DEBUG] [LOCAL ] L: Loaded 40939 existing records from primary storage. [2025-09-17T19:59:53.514821] [INFO ] [MAIN ] L: Loaded 40939 existing records. [2025-09-17T19:59:53.704620] [WARN ] [MAIN ] L: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:59:53.704990] [INFO ] [MAIN ] L: Wiping existing primary data before full refresh. [2025-09-17T19:59:53.705055] [INFO ] [LOCAL ] L: Starting deletion of primary data. [2025-09-17T19:59:53.705976] [DEBUG] [LOCAL ] L: Deleted primary data file. [2025-09-17T19:59:53.706037] [INFO ] [MAIN ] L: Starting full primary refresh. [2025-09-17T19:59:53.835163] [INFO ] [REMOTE ] KWR: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T19:59:53.872284] [INFO ] [REMOTE ] KWR: Full fetch complete (24021 records). [2025-09-17T19:59:53.898315] [DEBUG] [VALIDATOR ] KWR: Validating primary data. [2025-09-17T19:59:54.032293] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-11. [2025-09-17T19:59:54.233773] [INFO ] [REMOTE ] L: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:59:54.469946] [DEBUG] [VALIDATOR ] KWR: All expected trading days are present. [2025-09-17T19:59:54.470046] [DEBUG] [VALIDATOR ] KWR: Primary data validation passed. [2025-09-17T19:59:54.470711] [INFO ] [MAIN ] KWR: Fetched primary data is valid. [2025-09-17T19:59:54.470766] [DEBUG] [LOCAL ] KWR: Saving primary data. [2025-09-17T19:59:54.471595] [DEBUG] [LOCAL ] KWR: Trimmed 24021 records to 16961 (keeping 200 days of data) [2025-09-17T19:59:54.583293] [DEBUG] [LOCAL ] KWR: Primary data saved (16961 records). [2025-09-17T19:59:54.583470] [INFO ] [MAIN ] KWR: Full history saved. [2025-09-17T19:59:54.583596] [INFO ] [MAIN ] Update Progress: 1232/2371 symbols completed. KWR took 29.5s. Estimated remaining: 2h 46m 18s. Rate: 6.8 symbols/min [2025-09-17T19:59:54.763629] [INFO ] [MAIN ] LAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T19:59:54.819858] [INFO ] [REMOTE ] L: Fetching primary data for 2024-11. [2025-09-17T19:59:54.822701] [DEBUG] [LOCAL ] LAC: Loaded 52277 existing records from primary storage. [2025-09-17T19:59:54.822937] [INFO ] [MAIN ] LAC: Loaded 52277 existing records. [2025-09-17T19:59:55.010310] [WARN ] [MAIN ] LAC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T19:59:55.010624] [INFO ] [MAIN ] LAC: Wiping existing primary data before full refresh. [2025-09-17T19:59:55.010713] [INFO ] [LOCAL ] LAC: Starting deletion of primary data. [2025-09-17T19:59:55.011748] [DEBUG] [LOCAL ] LAC: Deleted primary data file. [2025-09-17T19:59:55.011810] [INFO ] [MAIN ] LAC: Starting full primary refresh. [2025-09-17T19:59:55.375519] [INFO ] [REMOTE ] LAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T19:59:55.505015] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T19:59:55.615791] [INFO ] [REMOTE ] KYN: Fetching primary data for 2024-12. [2025-09-17T19:59:56.331292] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T19:59:56.415841] [INFO ] [REMOTE ] L: Fetching primary data for 2024-12. [2025-09-17T19:59:57.215778] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-11. [2025-09-17T19:59:57.336686] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T19:59:57.902054] [INFO ] [REMOTE ] L: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T19:59:58.015846] [INFO ] [REMOTE ] L: Fetching primary data for 2025-01. [2025-09-17T19:59:58.815825] [INFO ] [REMOTE ] KVYO: Fetching primary data for 2025-09. [2025-09-17T19:59:59.361307] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-17T19:59:59.393195] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T19:59:59.615755] [INFO ] [REMOTE ] L: Fetching primary data for 2025-02. [2025-09-17T19:59:59.639326] [INFO ] [REMOTE ] KVYO: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T19:59:59.646006] [INFO ] [REMOTE ] KVYO: Full fetch complete (71000 records). [2025-09-17T19:59:59.646128] [DEBUG] [VALIDATOR ] KVYO: Validating primary data. [2025-09-17T20:00:00.089676] [DEBUG] [VALIDATOR ] KVYO: All expected trading days are present. [2025-09-17T20:00:00.089824] [DEBUG] [VALIDATOR ] KVYO: Primary data validation passed. [2025-09-17T20:00:00.091633] [INFO ] [MAIN ] KVYO: Fetched primary data is valid. [2025-09-17T20:00:00.091734] [DEBUG] [LOCAL ] KVYO: Saving primary data. [2025-09-17T20:00:00.093549] [DEBUG] [LOCAL ] KVYO: Trimmed 71000 records to 49801 (keeping 200 days of data) [2025-09-17T20:00:00.420020] [DEBUG] [LOCAL ] KVYO: Primary data saved (49801 records). [2025-09-17T20:00:00.420312] [INFO ] [MAIN ] KVYO: Full history saved. [2025-09-17T20:00:00.421390] [INFO ] [MAIN ] Update Progress: 1233/2371 symbols completed. KVYO took 49.9s. Estimated remaining: 2h 46m 7s. Rate: 6.9 symbols/min [2025-09-17T20:00:00.419825] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-01. [2025-09-17T20:00:00.605704] [INFO ] [MAIN ] LAD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:00:00.631138] [DEBUG] [LOCAL ] LAD: Loaded 24197 existing records from primary storage. [2025-09-17T20:00:00.631303] [INFO ] [MAIN ] LAD: Loaded 24197 existing records. [2025-09-17T20:00:00.816803] [WARN ] [MAIN ] LAD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:00:00.817067] [INFO ] [MAIN ] LAD: Wiping existing primary data before full refresh. [2025-09-17T20:00:00.817130] [INFO ] [LOCAL ] LAD: Starting deletion of primary data. [2025-09-17T20:00:00.817828] [DEBUG] [LOCAL ] LAD: Deleted primary data file. [2025-09-17T20:00:00.817878] [INFO ] [MAIN ] LAD: Starting full primary refresh. [2025-09-17T20:00:01.189083] [INFO ] [REMOTE ] LAD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:00:01.212987] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T20:00:01.220925] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-11. [2025-09-17T20:00:01.980408] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T20:00:02.015761] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-02. [2025-09-17T20:00:02.261234] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T20:00:02.815819] [INFO ] [REMOTE ] LAD: Fetching primary data for 2024-12. [2025-09-17T20:00:03.335183] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T20:00:03.615866] [INFO ] [REMOTE ] LAC: Fetching primary data for 2024-12. [2025-09-17T20:00:04.081300] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T20:00:04.415848] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-01. [2025-09-17T20:00:05.215817] [INFO ] [REMOTE ] L: Fetching primary data for 2025-03. [2025-09-17T20:00:05.712818] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-17T20:00:05.867808] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T20:00:06.015855] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-03. [2025-09-17T20:00:06.748020] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T20:00:06.815818] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-01. [2025-09-17T20:00:06.989328] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T20:00:07.615865] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-04. [2025-09-17T20:00:08.415887] [INFO ] [REMOTE ] L: Fetching primary data for 2025-04. [2025-09-17T20:00:08.510999] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T20:00:08.792112] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T20:00:09.215862] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-02. [2025-09-17T20:00:09.766203] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T20:00:10.015867] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-05. [2025-09-17T20:00:10.748905] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T20:00:10.815809] [INFO ] [REMOTE ] L: Fetching primary data for 2025-05. [2025-09-17T20:00:11.308704] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T20:00:11.615842] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-03. [2025-09-17T20:00:11.953059] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T20:00:12.415803] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-06. [2025-09-17T20:00:13.215810] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-02. [2025-09-17T20:00:13.566222] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T20:00:13.746410] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T20:00:14.015764] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-07. [2025-09-17T20:00:14.381744] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T20:00:14.815798] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-03. [2025-09-17T20:00:15.380140] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T20:00:15.615798] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-08. [2025-09-17T20:00:16.181127] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T20:00:16.415819] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-04. [2025-09-17T20:00:16.611200] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T20:00:17.215839] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-04. [2025-09-17T20:00:17.785404] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T20:00:18.015799] [INFO ] [REMOTE ] L: Fetching primary data for 2025-06. [2025-09-17T20:00:18.815871] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-05. [2025-09-17T20:00:19.124282] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T20:00:19.623185] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-05. [2025-09-17T20:00:19.667981] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T20:00:20.001961] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T20:00:20.415858] [INFO ] [REMOTE ] L: Fetching primary data for 2025-07. [2025-09-17T20:00:21.215806] [INFO ] [REMOTE ] KYN: Fetching primary data for 2025-09. [2025-09-17T20:00:21.410839] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T20:00:22.015753] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-06. [2025-09-17T20:00:22.121122] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T20:00:22.214717] [INFO ] [REMOTE ] KYN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T20:00:22.218999] [INFO ] [REMOTE ] KYN: Full fetch complete (45262 records). [2025-09-17T20:00:22.219111] [DEBUG] [VALIDATOR ] KYN: Validating primary data. [2025-09-17T20:00:22.627783] [DEBUG] [VALIDATOR ] KYN: All expected trading days are present. [2025-09-17T20:00:22.627887] [DEBUG] [VALIDATOR ] KYN: Primary data validation passed. [2025-09-17T20:00:22.628957] [INFO ] [MAIN ] KYN: Fetched primary data is valid. [2025-09-17T20:00:22.629025] [DEBUG] [LOCAL ] KYN: Saving primary data. [2025-09-17T20:00:22.630663] [DEBUG] [LOCAL ] KYN: Trimmed 45262 records to 30453 (keeping 200 days of data) [2025-09-17T20:00:22.816711] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-06. [2025-09-17T20:00:22.844986] [DEBUG] [LOCAL ] KYN: Primary data saved (30453 records). [2025-09-17T20:00:22.845212] [INFO ] [MAIN ] KYN: Full history saved. [2025-09-17T20:00:22.845401] [INFO ] [MAIN ] Update Progress: 1234/2371 symbols completed. KYN took 33.6s. Estimated remaining: 2h 46m 10s. Rate: 6.8 symbols/min [2025-09-17T20:00:23.025661] [INFO ] [MAIN ] LADR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:00:23.065397] [DEBUG] [LOCAL ] LADR: Loaded 38529 existing records from primary storage. [2025-09-17T20:00:23.065559] [INFO ] [MAIN ] LADR: Loaded 38529 existing records. [2025-09-17T20:00:23.250340] [WARN ] [MAIN ] LADR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:00:23.250695] [INFO ] [MAIN ] LADR: Wiping existing primary data before full refresh. [2025-09-17T20:00:23.250744] [INFO ] [LOCAL ] LADR: Starting deletion of primary data. [2025-09-17T20:00:23.251465] [DEBUG] [LOCAL ] LADR: Deleted primary data file. [2025-09-17T20:00:23.251520] [INFO ] [MAIN ] LADR: Starting full primary refresh. [2025-09-17T20:00:23.622224] [INFO ] [REMOTE ] L: Fetching primary data for 2025-08. [2025-09-17T20:00:23.635500] [INFO ] [REMOTE ] LADR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:00:23.836708] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T20:00:23.891770] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T20:00:24.415805] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-07. [2025-09-17T20:00:25.012414] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T20:00:25.215790] [INFO ] [REMOTE ] L: Fetching primary data for 2025-09. [2025-09-17T20:00:25.910014] [INFO ] [REMOTE ] L: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T20:00:25.915688] [INFO ] [REMOTE ] L: Full fetch complete (59333 records). [2025-09-17T20:00:25.915815] [DEBUG] [VALIDATOR ] L: Validating primary data. [2025-09-17T20:00:26.020811] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-11. [2025-09-17T20:00:26.359969] [DEBUG] [VALIDATOR ] L: All expected trading days are present. [2025-09-17T20:00:26.360083] [DEBUG] [VALIDATOR ] L: Primary data validation passed. [2025-09-17T20:00:26.361015] [INFO ] [MAIN ] L: Fetched primary data is valid. [2025-09-17T20:00:26.361123] [DEBUG] [LOCAL ] L: Saving primary data. [2025-09-17T20:00:26.362798] [DEBUG] [LOCAL ] L: Trimmed 59333 records to 40964 (keeping 200 days of data) [2025-09-17T20:00:26.503289] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T20:00:26.693017] [DEBUG] [LOCAL ] L: Primary data saved (40964 records). [2025-09-17T20:00:26.693155] [INFO ] [MAIN ] L: Full history saved. [2025-09-17T20:00:26.693244] [INFO ] [MAIN ] Update Progress: 1235/2371 symbols completed. L took 33.4s. Estimated remaining: 2h 45m 57s. Rate: 6.8 symbols/min [2025-09-17T20:00:26.820845] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-07. [2025-09-17T20:00:26.888018] [INFO ] [MAIN ] LANV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:00:26.893386] [DEBUG] [LOCAL ] LANV: Loaded 2616 existing records from primary storage. [2025-09-17T20:00:26.893519] [INFO ] [MAIN ] LANV: Loaded 2616 existing records. [2025-09-17T20:00:27.076572] [WARN ] [MAIN ] LANV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:00:27.076857] [INFO ] [MAIN ] LANV: Wiping existing primary data before full refresh. [2025-09-17T20:00:27.076902] [INFO ] [LOCAL ] LANV: Starting deletion of primary data. [2025-09-17T20:00:27.077146] [DEBUG] [LOCAL ] LANV: Deleted primary data file. [2025-09-17T20:00:27.077193] [INFO ] [MAIN ] LANV: Starting full primary refresh. [2025-09-17T20:00:27.442129] [INFO ] [REMOTE ] LANV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:00:27.501404] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T20:00:27.615772] [INFO ] [REMOTE ] LADR: Fetching primary data for 2024-12. [2025-09-17T20:00:28.110257] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T20:00:28.415823] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-08. [2025-09-17T20:00:28.840104] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T20:00:29.215828] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-01. [2025-09-17T20:00:30.015829] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-08. [2025-09-17T20:00:30.359245] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T20:00:30.569275] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-17T20:00:30.824036] [INFO ] [REMOTE ] LAC: Fetching primary data for 2025-09. [2025-09-17T20:00:30.830834] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T20:00:31.615791] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-11. [2025-09-17T20:00:31.732270] [INFO ] [REMOTE ] LAC: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T20:00:31.740485] [INFO ] [REMOTE ] LAC: Full fetch complete (75856 records). [2025-09-17T20:00:31.740761] [DEBUG] [VALIDATOR ] LAC: Validating primary data. [2025-09-17T20:00:32.017112] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-17T20:00:32.178061] [DEBUG] [VALIDATOR ] LAC: All expected trading days are present. [2025-09-17T20:00:32.178147] [DEBUG] [VALIDATOR ] LAC: Primary data validation passed. [2025-09-17T20:00:32.179244] [INFO ] [MAIN ] LAC: Fetched primary data is valid. [2025-09-17T20:00:32.179304] [DEBUG] [LOCAL ] LAC: Saving primary data. [2025-09-17T20:00:32.180833] [DEBUG] [LOCAL ] LAC: Trimmed 75856 records to 52283 (keeping 200 days of data) [2025-09-17T20:00:32.446632] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-02. [2025-09-17T20:00:32.495390] [DEBUG] [LOCAL ] LAC: Primary data saved (52283 records). [2025-09-17T20:00:32.495529] [INFO ] [MAIN ] LAC: Full history saved. [2025-09-17T20:00:32.495634] [INFO ] [MAIN ] Update Progress: 1236/2371 symbols completed. LAC took 37.9s. Estimated remaining: 2h 45m 46s. Rate: 6.8 symbols/min [2025-09-17T20:00:32.666804] [INFO ] [MAIN ] LAR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:00:32.667011] [DEBUG] [LOCAL ] LAR: No existing data file found in primary storage. [2025-09-17T20:00:32.667049] [WARN ] [MAIN ] LAR: No existing data found, performing full refresh instead. [2025-09-17T20:00:32.667178] [INFO ] [MAIN ] LAR: Wiping existing primary data before full refresh. [2025-09-17T20:00:32.667217] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-17T20:00:32.667257] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-17T20:00:32.667289] [INFO ] [MAIN ] LAR: Starting full primary refresh. [2025-09-17T20:00:33.041004] [INFO ] [REMOTE ] LAR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:00:33.215817] [INFO ] [REMOTE ] LANV: Fetching primary data for 2024-12. [2025-09-17T20:00:33.806765] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T20:00:33.831895] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T20:00:34.015803] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-01. [2025-09-17T20:00:34.564887] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T20:00:34.815802] [INFO ] [REMOTE ] LAD: Fetching primary data for 2025-09. [2025-09-17T20:00:35.403915] [INFO ] [REMOTE ] LAD: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T20:00:35.408982] [INFO ] [REMOTE ] LAD: Full fetch complete (35302 records). [2025-09-17T20:00:35.409087] [DEBUG] [VALIDATOR ] LAD: Validating primary data. [2025-09-17T20:00:35.620880] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-03. [2025-09-17T20:00:35.792621] [DEBUG] [VALIDATOR ] LAD: All expected trading days are present. [2025-09-17T20:00:35.792731] [DEBUG] [VALIDATOR ] LAD: Primary data validation passed. [2025-09-17T20:00:35.793536] [INFO ] [MAIN ] LAD: Fetched primary data is valid. [2025-09-17T20:00:35.793616] [DEBUG] [LOCAL ] LAD: Saving primary data. [2025-09-17T20:00:35.794735] [DEBUG] [LOCAL ] LAD: Trimmed 35302 records to 24135 (keeping 200 days of data) [2025-09-17T20:00:35.954752] [DEBUG] [LOCAL ] LAD: Primary data saved (24135 records). [2025-09-17T20:00:35.954894] [INFO ] [MAIN ] LAD: Full history saved. [2025-09-17T20:00:35.955002] [INFO ] [MAIN ] Update Progress: 1237/2371 symbols completed. LAD took 35.5s. Estimated remaining: 2h 45m 32s. Rate: 6.9 symbols/min [2025-09-17T20:00:36.415825] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-11. [2025-09-17T20:00:36.677237] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:00:36.677597] [WARN ] [REMOTE ] LAR: No data returned for month 2024-11 [2025-09-17T20:00:37.090968] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T20:00:37.215796] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-04. [2025-09-17T20:00:38.015801] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-02. [2025-09-17T20:00:38.770066] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T20:00:38.809662] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T20:00:38.819305] [INFO ] [REMOTE ] LAR: Fetching primary data for 2024-12. [2025-09-17T20:00:39.015543] [DEBUG] [REMOTE ] LAR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:00:39.015932] [WARN ] [REMOTE ] LAR: No data returned for month 2024-12 [2025-09-17T20:00:39.615780] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-05. [2025-09-17T20:00:40.415830] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-03. [2025-09-17T20:00:41.023578] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T20:00:41.025049] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T20:00:41.215781] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-04. [2025-09-17T20:00:41.673847] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T20:00:42.015809] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-05. [2025-09-17T20:00:42.440362] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T20:00:42.815807] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-01. [2025-09-17T20:00:43.595155] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T20:00:43.615731] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-02. [2025-09-17T20:00:44.415839] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-06. [2025-09-17T20:00:45.215868] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-06. [2025-09-17T20:00:45.286518] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T20:00:45.868420] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T20:00:45.892769] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T20:00:46.015782] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-07. [2025-09-17T20:00:46.815821] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-07. [2025-09-17T20:00:47.282145] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T20:00:47.621904] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-03. [2025-09-17T20:00:47.628816] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T20:00:48.415802] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-08. [2025-09-17T20:00:49.053117] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T20:00:49.215734] [INFO ] [REMOTE ] LANV: Fetching primary data for 2025-09. [2025-09-17T20:00:49.329051] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T20:00:49.793147] [INFO ] [REMOTE ] LANV: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T20:00:49.794518] [INFO ] [REMOTE ] LANV: Full fetch complete (4283 records). [2025-09-17T20:00:49.794600] [DEBUG] [VALIDATOR ] LANV: Validating primary data. [2025-09-17T20:00:50.020882] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-08. [2025-09-17T20:00:50.171936] [DEBUG] [VALIDATOR ] LANV: All expected trading days are present. [2025-09-17T20:00:50.172095] [DEBUG] [VALIDATOR ] LANV: Primary data validation passed. [2025-09-17T20:00:50.172269] [INFO ] [MAIN ] LANV: Fetched primary data is valid. [2025-09-17T20:00:50.172312] [DEBUG] [LOCAL ] LANV: Saving primary data. [2025-09-17T20:00:50.172720] [DEBUG] [LOCAL ] LANV: Trimmed 4283 records to 2637 (keeping 200 days of data) [2025-09-17T20:00:50.187862] [DEBUG] [LOCAL ] LANV: Primary data saved (2637 records). [2025-09-17T20:00:50.187934] [INFO ] [MAIN ] LANV: Full history saved. [2025-09-17T20:00:50.188023] [INFO ] [MAIN ] Update Progress: 1238/2371 symbols completed. LANV took 23.5s. Estimated remaining: 2h 45m 28s. Rate: 6.8 symbols/min [2025-09-17T20:00:50.815790] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-04. [2025-09-17T20:00:51.735157] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T20:00:51.744879] [INFO ] [REMOTE ] LADR: Fetching primary data for 2025-09. [2025-09-17T20:00:52.508367] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T20:00:52.518523] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-05. [2025-09-17T20:00:52.541176] [INFO ] [REMOTE ] LADR: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T20:00:52.547636] [INFO ] [REMOTE ] LADR: Full fetch complete (54648 records). [2025-09-17T20:00:52.547847] [DEBUG] [VALIDATOR ] LADR: Validating primary data. [2025-09-17T20:00:52.968137] [DEBUG] [VALIDATOR ] LADR: All expected trading days are present. [2025-09-17T20:00:52.968257] [DEBUG] [VALIDATOR ] LADR: Primary data validation passed. [2025-09-17T20:00:52.969145] [INFO ] [MAIN ] LADR: Fetched primary data is valid. [2025-09-17T20:00:52.969206] [DEBUG] [LOCAL ] LADR: Saving primary data. [2025-09-17T20:00:52.970851] [DEBUG] [LOCAL ] LADR: Trimmed 54648 records to 38617 (keeping 200 days of data) [2025-09-17T20:00:53.213990] [DEBUG] [LOCAL ] LADR: Primary data saved (38617 records). [2025-09-17T20:00:53.214143] [INFO ] [MAIN ] LADR: Full history saved. [2025-09-17T20:00:53.214264] [INFO ] [MAIN ] Update Progress: 1239/2371 symbols completed. LADR took 30.4s. Estimated remaining: 2h 45m 14s. Rate: 6.9 symbols/min [2025-09-17T20:00:54.077423] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T20:00:54.088100] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-06. [2025-09-17T20:00:55.601938] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T20:00:55.611069] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-07. [2025-09-17T20:00:57.292913] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T20:00:57.305267] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-08. [2025-09-17T20:00:59.009030] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T20:00:59.019094] [INFO ] [REMOTE ] LAR: Fetching primary data for 2025-09. [2025-09-17T20:00:59.725212] [INFO ] [REMOTE ] LAR: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T20:00:59.731337] [INFO ] [REMOTE ] LAR: Full fetch complete (52951 records). [2025-09-17T20:00:59.731471] [DEBUG] [VALIDATOR ] LAR: Validating primary data. [2025-09-17T20:00:59.928975] [WARN ] [VALIDATOR ] LAR: Validation failed - insufficient historical data. Have 162 unique days, need 200 days [2025-09-17T20:00:59.929594] [FATAL] [MAIN ] LAR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:00:59.929665] [WARN ] [MAIN ] LAR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:00:59.929714] [INFO ] [LOCAL ] LAR: Starting deletion of primary data. [2025-09-17T20:00:59.929775] [DEBUG] [LOCAL ] LAR: No primary data file found to delete. [2025-09-17T20:00:59.929813] [INFO ] [LOCAL ] LAR: Starting deletion of derivative data. [2025-09-17T20:00:59.929865] [DEBUG] [LOCAL ] LAR: No derivative data file found to delete. [2025-09-17T20:00:59.929932] [INFO ] [MAIN ] Update Progress: 1240/2371 symbols completed. LAR took 27.4s. Estimated remaining: 2h 45m 4s. Rate: 6.9 symbols/min [2025-09-17T20:01:00.554775] [INFO ] [MAIN ] LAW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:01:00.538288] [INFO ] [MAIN ] LBRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:01:00.624042] [INFO ] [MAIN ] LAZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:01:00.643926] [INFO ] [MAIN ] LB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:01:00.662924] [DEBUG] [LOCAL ] LAW: Loaded 13798 existing records from primary storage. [2025-09-17T20:01:00.666731] [INFO ] [MAIN ] LAW: Loaded 13798 existing records. [2025-09-17T20:01:00.936578] [DEBUG] [LOCAL ] LB: Loaded 37949 existing records from primary storage. [2025-09-17T20:01:00.921861] [WARN ] [MAIN ] LAW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:01:00.938530] [DEBUG] [LOCAL ] LAZ: Loaded 45488 existing records from primary storage. [2025-09-17T20:01:00.938701] [INFO ] [MAIN ] LB: Loaded 37949 existing records. [2025-09-17T20:01:00.938816] [INFO ] [MAIN ] LAZ: Loaded 45488 existing records. [2025-09-17T20:01:00.970930] [DEBUG] [LOCAL ] LBRT: Loaded 52928 existing records from primary storage. [2025-09-17T20:01:00.950221] [INFO ] [MAIN ] LAW: Wiping existing primary data before full refresh. [2025-09-17T20:01:01.014624] [INFO ] [LOCAL ] LAW: Starting deletion of primary data. [2025-09-17T20:01:01.005967] [INFO ] [MAIN ] LBRT: Loaded 52928 existing records. [2025-09-17T20:01:01.079604] [DEBUG] [LOCAL ] LAW: Deleted primary data file. [2025-09-17T20:01:01.125352] [INFO ] [MAIN ] LAW: Starting full primary refresh. [2025-09-17T20:01:01.490934] [WARN ] [MAIN ] LAZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:01:01.503461] [WARN ] [MAIN ] LB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:01:01.507522] [INFO ] [MAIN ] LAZ: Wiping existing primary data before full refresh. [2025-09-17T20:01:01.518363] [INFO ] [MAIN ] LB: Wiping existing primary data before full refresh. [2025-09-17T20:01:01.513100] [INFO ] [LOCAL ] LAZ: Starting deletion of primary data. [2025-09-17T20:01:01.539016] [INFO ] [LOCAL ] LB: Starting deletion of primary data. [2025-09-17T20:01:01.602062] [DEBUG] [LOCAL ] LAZ: Deleted primary data file. [2025-09-17T20:01:01.614671] [DEBUG] [LOCAL ] LB: Deleted primary data file. [2025-09-17T20:01:01.642050] [WARN ] [MAIN ] LBRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:01:01.641940] [INFO ] [MAIN ] LB: Starting full primary refresh. [2025-09-17T20:01:01.649127] [INFO ] [MAIN ] LAZ: Starting full primary refresh. [2025-09-17T20:01:01.800558] [INFO ] [MAIN ] LBRT: Wiping existing primary data before full refresh. [2025-09-17T20:01:01.894794] [INFO ] [LOCAL ] LBRT: Starting deletion of primary data. [2025-09-17T20:01:01.968991] [DEBUG] [LOCAL ] LBRT: Deleted primary data file. [2025-09-17T20:01:01.990616] [INFO ] [MAIN ] LBRT: Starting full primary refresh. [2025-09-17T20:01:02.264123] [INFO ] [REMOTE ] LAW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:01:02.367001] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-11. [2025-09-17T20:01:02.764370] [INFO ] [REMOTE ] LAZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:01:02.801865] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-11. [2025-09-17T20:01:02.855027] [INFO ] [REMOTE ] LB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:01:02.867860] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-11. [2025-09-17T20:01:02.948593] [INFO ] [REMOTE ] LBRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:01:02.949056] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-11. [2025-09-17T20:01:03.458332] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T20:01:03.462058] [INFO ] [REMOTE ] LAW: Fetching primary data for 2024-12. [2025-09-17T20:01:04.204466] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T20:01:04.213469] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2024-12. [2025-09-17T20:01:04.250058] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T20:01:04.256923] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-01. [2025-09-17T20:01:04.353131] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T20:01:04.361285] [INFO ] [REMOTE ] LB: Fetching primary data for 2024-12. [2025-09-17T20:01:04.698551] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T20:01:04.709072] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2024-12. [2025-09-17T20:01:05.099939] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T20:01:05.104810] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-02. [2025-09-17T20:01:05.525055] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T20:01:05.535419] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-01. [2025-09-17T20:01:05.571723] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T20:01:05.580313] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-01. [2025-09-17T20:01:06.181970] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T20:01:06.185743] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-03. [2025-09-17T20:01:06.379457] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T20:01:06.815780] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-01. [2025-09-17T20:01:07.197581] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T20:01:07.232753] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T20:01:07.325898] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T20:01:07.615800] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-02. [2025-09-17T20:01:08.342298] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T20:01:08.415788] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-02. [2025-09-17T20:01:09.201981] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T20:01:09.215742] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-04. [2025-09-17T20:01:10.015838] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-03. [2025-09-17T20:01:10.046573] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T20:01:10.158633] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T20:01:10.815808] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-05. [2025-09-17T20:01:11.196108] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T20:01:11.564992] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T20:01:11.615749] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-06. [2025-09-17T20:01:12.415771] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-04. [2025-09-17T20:01:12.581484] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T20:01:13.215794] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-07. [2025-09-17T20:01:13.758488] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T20:01:14.015781] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-02. [2025-09-17T20:01:14.237468] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T20:01:14.815783] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-03. [2025-09-17T20:01:15.459696] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T20:01:15.615752] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-03. [2025-09-17T20:01:16.318947] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T20:01:16.415757] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-04. [2025-09-17T20:01:17.215816] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-08. [2025-09-17T20:01:17.391075] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T20:01:17.959509] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T20:01:17.982819] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T20:01:18.015763] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-05. [2025-09-17T20:01:18.815797] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-04. [2025-09-17T20:01:19.615829] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-05. [2025-09-17T20:01:19.802339] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T20:01:20.363288] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T20:01:20.415784] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-05. [2025-09-17T20:01:21.056549] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T20:01:21.215756] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-06. [2025-09-17T20:01:21.814587] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T20:01:22.015771] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-06. [2025-09-17T20:01:22.613074] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T20:01:22.815838] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-06. [2025-09-17T20:01:23.351375] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T20:01:23.615805] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-07. [2025-09-17T20:01:24.372295] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T20:01:24.415791] [INFO ] [REMOTE ] LAW: Fetching primary data for 2025-09. [2025-09-17T20:01:24.842984] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T20:01:24.891386] [INFO ] [REMOTE ] LAW: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T20:01:24.893952] [INFO ] [REMOTE ] LAW: Full fetch complete (20515 records). [2025-09-17T20:01:24.894057] [DEBUG] [VALIDATOR ] LAW: Validating primary data. [2025-09-17T20:01:25.226546] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-07. [2025-09-17T20:01:25.274511] [DEBUG] [VALIDATOR ] LAW: All expected trading days are present. [2025-09-17T20:01:25.274590] [DEBUG] [VALIDATOR ] LAW: Primary data validation passed. [2025-09-17T20:01:25.275100] [INFO ] [MAIN ] LAW: Fetched primary data is valid. [2025-09-17T20:01:25.275158] [DEBUG] [LOCAL ] LAW: Saving primary data. [2025-09-17T20:01:25.276180] [DEBUG] [LOCAL ] LAW: Trimmed 20515 records to 13850 (keeping 200 days of data) [2025-09-17T20:01:25.358918] [DEBUG] [LOCAL ] LAW: Primary data saved (13850 records). [2025-09-17T20:01:25.359105] [INFO ] [MAIN ] LAW: Full history saved. [2025-09-17T20:01:25.359247] [INFO ] [MAIN ] Update Progress: 1241/2371 symbols completed. LAW took 25.4s. Estimated remaining: 2h 45m 10s. Rate: 6.8 symbols/min [2025-09-17T20:01:25.527581] [INFO ] [MAIN ] LC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:01:25.575298] [DEBUG] [LOCAL ] LC: Loaded 48048 existing records from primary storage. [2025-09-17T20:01:25.575450] [INFO ] [MAIN ] LC: Loaded 48048 existing records. [2025-09-17T20:01:25.751577] [WARN ] [MAIN ] LC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:01:25.751896] [INFO ] [MAIN ] LC: Wiping existing primary data before full refresh. [2025-09-17T20:01:25.751946] [INFO ] [LOCAL ] LC: Starting deletion of primary data. [2025-09-17T20:01:25.752881] [DEBUG] [LOCAL ] LC: Deleted primary data file. [2025-09-17T20:01:25.752951] [INFO ] [MAIN ] LC: Starting full primary refresh. [2025-09-17T20:01:26.022858] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-08. [2025-09-17T20:01:26.117437] [INFO ] [REMOTE ] LC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:01:26.815793] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-07. [2025-09-17T20:01:27.255940] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T20:01:27.622302] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-08. [2025-09-17T20:01:27.625499] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T20:01:28.061345] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T20:01:28.415777] [INFO ] [REMOTE ] LB: Fetching primary data for 2025-09. [2025-09-17T20:01:29.100795] [INFO ] [REMOTE ] LB: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T20:01:29.105747] [INFO ] [REMOTE ] LB: Full fetch complete (56202 records). [2025-09-17T20:01:29.105861] [DEBUG] [VALIDATOR ] LB: Validating primary data. [2025-09-17T20:01:29.217678] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-08. [2025-09-17T20:01:29.498955] [DEBUG] [VALIDATOR ] LB: All expected trading days are present. [2025-09-17T20:01:29.499048] [DEBUG] [VALIDATOR ] LB: Primary data validation passed. [2025-09-17T20:01:29.499997] [INFO ] [MAIN ] LB: Fetched primary data is valid. [2025-09-17T20:01:29.500105] [DEBUG] [LOCAL ] LB: Saving primary data. [2025-09-17T20:01:29.527634] [DEBUG] [LOCAL ] LB: Trimmed 56202 records to 37916 (keeping 200 days of data) [2025-09-17T20:01:29.533463] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T20:01:29.787793] [DEBUG] [LOCAL ] LB: Primary data saved (37916 records). [2025-09-17T20:01:29.787950] [INFO ] [MAIN ] LB: Full history saved. [2025-09-17T20:01:29.788076] [INFO ] [MAIN ] Update Progress: 1242/2371 symbols completed. LB took 29.9s. Estimated remaining: 2h 44m 57s. Rate: 6.8 symbols/min [2025-09-17T20:01:29.964824] [INFO ] [MAIN ] LCII: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:01:29.998835] [DEBUG] [LOCAL ] LCII: Loaded 28819 existing records from primary storage. [2025-09-17T20:01:29.999019] [INFO ] [MAIN ] LCII: Loaded 28819 existing records. [2025-09-17T20:01:30.020911] [INFO ] [REMOTE ] LBRT: Fetching primary data for 2025-09. [2025-09-17T20:01:30.186003] [WARN ] [MAIN ] LCII: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:01:30.186288] [INFO ] [MAIN ] LCII: Wiping existing primary data before full refresh. [2025-09-17T20:01:30.186355] [INFO ] [LOCAL ] LCII: Starting deletion of primary data. [2025-09-17T20:01:30.187122] [DEBUG] [LOCAL ] LCII: Deleted primary data file. [2025-09-17T20:01:30.187185] [INFO ] [MAIN ] LCII: Starting full primary refresh. [2025-09-17T20:01:30.632569] [INFO ] [REMOTE ] LCII: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:01:30.815867] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-11. [2025-09-17T20:01:30.916864] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T20:01:31.030810] [INFO ] [REMOTE ] LBRT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T20:01:31.042575] [INFO ] [REMOTE ] LBRT: Full fetch complete (76308 records). [2025-09-17T20:01:31.042858] [DEBUG] [VALIDATOR ] LBRT: Validating primary data. [2025-09-17T20:01:31.626067] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-11. [2025-09-17T20:01:31.678095] [DEBUG] [VALIDATOR ] LBRT: All expected trading days are present. [2025-09-17T20:01:31.678284] [DEBUG] [VALIDATOR ] LBRT: Primary data validation passed. [2025-09-17T20:01:31.679672] [INFO ] [MAIN ] LBRT: Fetched primary data is valid. [2025-09-17T20:01:31.679735] [DEBUG] [LOCAL ] LBRT: Saving primary data. [2025-09-17T20:01:31.682245] [DEBUG] [LOCAL ] LBRT: Trimmed 76308 records to 52924 (keeping 200 days of data) [2025-09-17T20:01:32.084096] [DEBUG] [LOCAL ] LBRT: Primary data saved (52924 records). [2025-09-17T20:01:32.084318] [INFO ] [MAIN ] LBRT: Full history saved. [2025-09-17T20:01:32.084428] [INFO ] [MAIN ] Update Progress: 1243/2371 symbols completed. LBRT took 32.2s. Estimated remaining: 2h 44m 43s. Rate: 6.8 symbols/min [2025-09-17T20:01:32.255691] [INFO ] [MAIN ] LDI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:01:32.298758] [DEBUG] [LOCAL ] LDI: Loaded 43208 existing records from primary storage. [2025-09-17T20:01:32.298908] [INFO ] [MAIN ] LDI: Loaded 43208 existing records. [2025-09-17T20:01:32.418940] [INFO ] [REMOTE ] LAZ: Fetching primary data for 2025-09. [2025-09-17T20:01:32.483120] [WARN ] [MAIN ] LDI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:01:32.483510] [INFO ] [MAIN ] LDI: Wiping existing primary data before full refresh. [2025-09-17T20:01:32.483732] [INFO ] [LOCAL ] LDI: Starting deletion of primary data. [2025-09-17T20:01:32.484852] [DEBUG] [LOCAL ] LDI: Deleted primary data file. [2025-09-17T20:01:32.484919] [INFO ] [MAIN ] LDI: Starting full primary refresh. [2025-09-17T20:01:32.786655] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T20:01:32.910384] [INFO ] [REMOTE ] LDI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:01:32.927096] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T20:01:33.049550] [INFO ] [REMOTE ] LAZ: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T20:01:33.055785] [INFO ] [REMOTE ] LAZ: Full fetch complete (65513 records). [2025-09-17T20:01:33.055933] [DEBUG] [VALIDATOR ] LAZ: Validating primary data. [2025-09-17T20:01:33.217438] [INFO ] [REMOTE ] LC: Fetching primary data for 2024-12. [2025-09-17T20:01:33.459476] [DEBUG] [VALIDATOR ] LAZ: All expected trading days are present. [2025-09-17T20:01:33.459577] [DEBUG] [VALIDATOR ] LAZ: Primary data validation passed. [2025-09-17T20:01:33.460526] [INFO ] [MAIN ] LAZ: Fetched primary data is valid. [2025-09-17T20:01:33.460610] [DEBUG] [LOCAL ] LAZ: Saving primary data. [2025-09-17T20:01:33.462886] [DEBUG] [LOCAL ] LAZ: Trimmed 65513 records to 45461 (keeping 200 days of data) [2025-09-17T20:01:33.763107] [DEBUG] [LOCAL ] LAZ: Primary data saved (45461 records). [2025-09-17T20:01:33.763247] [INFO ] [MAIN ] LAZ: Full history saved. [2025-09-17T20:01:33.763350] [INFO ] [MAIN ] Update Progress: 1244/2371 symbols completed. LAZ took 33.8s. Estimated remaining: 2h 44m 27s. Rate: 6.9 symbols/min [2025-09-17T20:01:33.943132] [INFO ] [MAIN ] LDOS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:01:34.003024] [DEBUG] [LOCAL ] LDOS: Loaded 46101 existing records from primary storage. [2025-09-17T20:01:34.003192] [INFO ] [MAIN ] LDOS: Loaded 46101 existing records. [2025-09-17T20:01:34.025953] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-11. [2025-09-17T20:01:34.202520] [WARN ] [MAIN ] LDOS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:01:34.202842] [INFO ] [MAIN ] LDOS: Wiping existing primary data before full refresh. [2025-09-17T20:01:34.202897] [INFO ] [LOCAL ] LDOS: Starting deletion of primary data. [2025-09-17T20:01:34.203936] [DEBUG] [LOCAL ] LDOS: Deleted primary data file. [2025-09-17T20:01:34.204008] [INFO ] [MAIN ] LDOS: Starting full primary refresh. [2025-09-17T20:01:34.589703] [INFO ] [REMOTE ] LDOS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:01:34.815778] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-11. [2025-09-17T20:01:35.078512] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T20:01:35.383428] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T20:01:35.615793] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-01. [2025-09-17T20:01:36.415789] [INFO ] [REMOTE ] LDI: Fetching primary data for 2024-12. [2025-09-17T20:01:36.555379] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T20:01:37.215776] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2024-12. [2025-09-17T20:01:37.391334] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T20:01:37.515071] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T20:01:38.015772] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-02. [2025-09-17T20:01:38.707330] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T20:01:38.815772] [INFO ] [REMOTE ] LCII: Fetching primary data for 2024-12. [2025-09-17T20:01:39.534464] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T20:01:39.612209] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T20:01:39.621505] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-01. [2025-09-17T20:01:40.415744] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-01. [2025-09-17T20:01:40.727533] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T20:01:41.215770] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-02. [2025-09-17T20:01:41.302837] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T20:01:42.015778] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-01. [2025-09-17T20:01:42.204055] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T20:01:42.815828] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-03. [2025-09-17T20:01:43.615788] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-03. [2025-09-17T20:01:43.774975] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T20:01:44.175391] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T20:01:44.415789] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-04. [2025-09-17T20:01:45.054740] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T20:01:45.215788] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-04. [2025-09-17T20:01:45.677479] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T20:01:46.015836] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-02. [2025-09-17T20:01:46.815821] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-05. [2025-09-17T20:01:46.882751] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T20:01:47.615838] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-02. [2025-09-17T20:01:47.760358] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T20:01:47.821256] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T20:01:48.415841] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-03. [2025-09-17T20:01:48.614752] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T20:01:49.215796] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-05. [2025-09-17T20:01:49.903385] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T20:01:50.015811] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-03. [2025-09-17T20:01:50.663456] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T20:01:50.815885] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-06. [2025-09-17T20:01:51.589013] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T20:01:51.615732] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-04. [2025-09-17T20:01:52.407485] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T20:01:52.416014] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-06. [2025-09-17T20:01:53.108283] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T20:01:53.215772] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-04. [2025-09-17T20:01:53.666769] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T20:01:54.015799] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-05. [2025-09-17T20:01:54.815757] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-07. [2025-09-17T20:01:54.938714] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T20:01:55.487566] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T20:01:55.615770] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-06. [2025-09-17T20:01:56.161358] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T20:01:56.415931] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-07. [2025-09-17T20:01:57.088965] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T20:01:57.215837] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-07. [2025-09-17T20:01:58.015848] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-08. [2025-09-17T20:01:58.236837] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T20:01:58.820923] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-08. [2025-09-17T20:01:58.845583] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T20:01:58.932505] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T20:01:59.615784] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-08. [2025-09-17T20:02:00.296761] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T20:02:00.415779] [INFO ] [REMOTE ] LC: Fetching primary data for 2025-09. [2025-09-17T20:02:01.215806] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-05. [2025-09-17T20:02:01.252271] [INFO ] [REMOTE ] LC: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T20:02:01.259016] [INFO ] [REMOTE ] LC: Full fetch complete (70103 records). [2025-09-17T20:02:01.259220] [DEBUG] [VALIDATOR ] LC: Validating primary data. [2025-09-17T20:02:01.689659] [DEBUG] [VALIDATOR ] LC: All expected trading days are present. [2025-09-17T20:02:01.689760] [DEBUG] [VALIDATOR ] LC: Primary data validation passed. [2025-09-17T20:02:01.690854] [INFO ] [MAIN ] LC: Fetched primary data is valid. [2025-09-17T20:02:01.690975] [DEBUG] [LOCAL ] LC: Saving primary data. [2025-09-17T20:02:01.722229] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-17T20:02:01.732596] [DEBUG] [LOCAL ] LC: Trimmed 70103 records to 48027 (keeping 200 days of data) [2025-09-17T20:02:02.015841] [INFO ] [REMOTE ] LDI: Fetching primary data for 2025-09. [2025-09-17T20:02:02.031744] [DEBUG] [LOCAL ] LC: Primary data saved (48027 records). [2025-09-17T20:02:02.031926] [INFO ] [MAIN ] LC: Full history saved. [2025-09-17T20:02:02.032828] [INFO ] [MAIN ] Update Progress: 1245/2371 symbols completed. LC took 36.7s. Estimated remaining: 2h 44m 36s. Rate: 6.8 symbols/min [2025-09-17T20:02:02.202968] [INFO ] [MAIN ] LDP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:02:02.219003] [DEBUG] [LOCAL ] LDP: Loaded 13181 existing records from primary storage. [2025-09-17T20:02:02.219134] [INFO ] [MAIN ] LDP: Loaded 13181 existing records. [2025-09-17T20:02:02.412781] [WARN ] [MAIN ] LDP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:02:02.413167] [INFO ] [MAIN ] LDP: Wiping existing primary data before full refresh. [2025-09-17T20:02:02.413226] [INFO ] [LOCAL ] LDP: Starting deletion of primary data. [2025-09-17T20:02:02.413810] [DEBUG] [LOCAL ] LDP: Deleted primary data file. [2025-09-17T20:02:02.413871] [INFO ] [MAIN ] LDP: Starting full primary refresh. [2025-09-17T20:02:02.787289] [INFO ] [REMOTE ] LDP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:02:02.815684] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-11. [2025-09-17T20:02:02.885197] [INFO ] [REMOTE ] LDI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T20:02:02.892380] [INFO ] [REMOTE ] LDI: Full fetch complete (59610 records). [2025-09-17T20:02:02.892518] [DEBUG] [VALIDATOR ] LDI: Validating primary data. [2025-09-17T20:02:03.310146] [DEBUG] [VALIDATOR ] LDI: All expected trading days are present. [2025-09-17T20:02:03.310561] [DEBUG] [VALIDATOR ] LDI: Primary data validation passed. [2025-09-17T20:02:03.312007] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T20:02:03.312901] [INFO ] [MAIN ] LDI: Fetched primary data is valid. [2025-09-17T20:02:03.313024] [DEBUG] [LOCAL ] LDI: Saving primary data. [2025-09-17T20:02:03.324220] [DEBUG] [LOCAL ] LDI: Trimmed 59610 records to 43355 (keeping 200 days of data) [2025-09-17T20:02:03.576885] [DEBUG] [LOCAL ] LDI: Primary data saved (43355 records). [2025-09-17T20:02:03.577046] [INFO ] [MAIN ] LDI: Full history saved. [2025-09-17T20:02:03.577139] [INFO ] [MAIN ] Update Progress: 1246/2371 symbols completed. LDI took 31.5s. Estimated remaining: 2h 44m 21s. Rate: 6.8 symbols/min [2025-09-17T20:02:03.621427] [INFO ] [REMOTE ] LCII: Fetching primary data for 2025-09. [2025-09-17T20:02:03.772377] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T20:02:03.781022] [INFO ] [MAIN ] LEA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:02:03.824724] [DEBUG] [LOCAL ] LEA: Loaded 41857 existing records from primary storage. [2025-09-17T20:02:03.824876] [INFO ] [MAIN ] LEA: Loaded 41857 existing records. [2025-09-17T20:02:04.004604] [WARN ] [MAIN ] LEA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:02:04.004864] [INFO ] [MAIN ] LEA: Wiping existing primary data before full refresh. [2025-09-17T20:02:04.004910] [INFO ] [LOCAL ] LEA: Starting deletion of primary data. [2025-09-17T20:02:04.005823] [DEBUG] [LOCAL ] LEA: Deleted primary data file. [2025-09-17T20:02:04.005873] [INFO ] [MAIN ] LEA: Starting full primary refresh. [2025-09-17T20:02:04.363479] [INFO ] [REMOTE ] LEA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:02:04.373861] [INFO ] [REMOTE ] LCII: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T20:02:04.377500] [INFO ] [REMOTE ] LCII: Full fetch complete (38709 records). [2025-09-17T20:02:04.377659] [DEBUG] [VALIDATOR ] LCII: Validating primary data. [2025-09-17T20:02:04.420931] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-11. [2025-09-17T20:02:04.765989] [DEBUG] [VALIDATOR ] LCII: All expected trading days are present. [2025-09-17T20:02:04.766088] [DEBUG] [VALIDATOR ] LCII: Primary data validation passed. [2025-09-17T20:02:04.766904] [INFO ] [MAIN ] LCII: Fetched primary data is valid. [2025-09-17T20:02:04.766952] [DEBUG] [LOCAL ] LCII: Saving primary data. [2025-09-17T20:02:04.768213] [DEBUG] [LOCAL ] LCII: Trimmed 38709 records to 28782 (keeping 200 days of data) [2025-09-17T20:02:04.961270] [DEBUG] [LOCAL ] LCII: Primary data saved (28782 records). [2025-09-17T20:02:04.961449] [INFO ] [MAIN ] LCII: Full history saved. [2025-09-17T20:02:04.961555] [INFO ] [MAIN ] Update Progress: 1247/2371 symbols completed. LCII took 35.2s. Estimated remaining: 2h 44m 6s. Rate: 6.8 symbols/min [2025-09-17T20:02:05.150854] [INFO ] [MAIN ] LEG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:02:05.198247] [DEBUG] [LOCAL ] LEG: Loaded 50399 existing records from primary storage. [2025-09-17T20:02:05.198408] [INFO ] [MAIN ] LEG: Loaded 50399 existing records. [2025-09-17T20:02:05.220950] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-06. [2025-09-17T20:02:05.381333] [WARN ] [MAIN ] LEG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:02:05.381638] [INFO ] [MAIN ] LEG: Wiping existing primary data before full refresh. [2025-09-17T20:02:05.381735] [INFO ] [LOCAL ] LEG: Starting deletion of primary data. [2025-09-17T20:02:05.382849] [DEBUG] [LOCAL ] LEG: Deleted primary data file. [2025-09-17T20:02:05.382912] [INFO ] [MAIN ] LEG: Starting full primary refresh. [2025-09-17T20:02:05.803804] [INFO ] [REMOTE ] LEG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:02:06.015798] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-11. [2025-09-17T20:02:06.133036] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T20:02:06.815801] [INFO ] [REMOTE ] LEA: Fetching primary data for 2024-12. [2025-09-17T20:02:06.953485] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T20:02:07.615813] [INFO ] [REMOTE ] LDP: Fetching primary data for 2024-12. [2025-09-17T20:02:07.770623] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T20:02:08.394357] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T20:02:08.415792] [INFO ] [REMOTE ] LEG: Fetching primary data for 2024-12. [2025-09-17T20:02:08.600504] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T20:02:09.215802] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-01. [2025-09-17T20:02:10.015839] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-01. [2025-09-17T20:02:10.173531] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T20:02:10.249603] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T20:02:10.815820] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-02. [2025-09-17T20:02:11.277619] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T20:02:11.320317] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T20:02:11.615816] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-07. [2025-09-17T20:02:12.415823] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-03. [2025-09-17T20:02:13.215790] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-02. [2025-09-17T20:02:13.264113] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T20:02:13.325695] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T20:02:14.015817] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-04. [2025-09-17T20:02:14.563459] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T20:02:14.815795] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-03. [2025-09-17T20:02:14.934265] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T20:02:15.615790] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-05. [2025-09-17T20:02:16.415750] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-01. [2025-09-17T20:02:16.513598] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T20:02:16.602156] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T20:02:17.215794] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-04. [2025-09-17T20:02:18.015801] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-08. [2025-09-17T20:02:18.076360] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T20:02:18.759981] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T20:02:18.815735] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-05. [2025-09-17T20:02:19.615788] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-02. [2025-09-17T20:02:19.737468] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T20:02:19.844311] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T20:02:20.415782] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-06. [2025-09-17T20:02:21.194744] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T20:02:21.215762] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-07. [2025-09-17T20:02:21.334181] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T20:02:22.015821] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-03. [2025-09-17T20:02:22.168284] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T20:02:22.815834] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-06. [2025-09-17T20:02:23.514746] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T20:02:23.615876] [INFO ] [REMOTE ] LDOS: Fetching primary data for 2025-09. [2025-09-17T20:02:24.349610] [INFO ] [REMOTE ] LDOS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T20:02:24.357362] [INFO ] [REMOTE ] LDOS: Full fetch complete (67780 records). [2025-09-17T20:02:24.357624] [DEBUG] [VALIDATOR ] LDOS: Validating primary data. [2025-09-17T20:02:24.421214] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-08. [2025-09-17T20:02:24.753419] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T20:02:24.863793] [DEBUG] [VALIDATOR ] LDOS: All expected trading days are present. [2025-09-17T20:02:24.863920] [DEBUG] [VALIDATOR ] LDOS: Primary data validation passed. [2025-09-17T20:02:24.865179] [INFO ] [MAIN ] LDOS: Fetched primary data is valid. [2025-09-17T20:02:24.865245] [DEBUG] [LOCAL ] LDOS: Saving primary data. [2025-09-17T20:02:24.867681] [DEBUG] [LOCAL ] LDOS: Trimmed 67780 records to 46034 (keeping 200 days of data) [2025-09-17T20:02:25.223510] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-04. [2025-09-17T20:02:25.243393] [DEBUG] [LOCAL ] LDOS: Primary data saved (46034 records). [2025-09-17T20:02:25.243683] [INFO ] [MAIN ] LDOS: Full history saved. [2025-09-17T20:02:25.243856] [INFO ] [MAIN ] Update Progress: 1248/2371 symbols completed. LDOS took 51.5s. Estimated remaining: 2h 44m 7s. Rate: 6.8 symbols/min [2025-09-17T20:02:25.437750] [INFO ] [MAIN ] LEN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:02:25.448741] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T20:02:25.515161] [DEBUG] [LOCAL ] LEN: Loaded 53179 existing records from primary storage. [2025-09-17T20:02:25.515397] [INFO ] [MAIN ] LEN: Loaded 53179 existing records. [2025-09-17T20:02:25.713774] [WARN ] [MAIN ] LEN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:02:25.714117] [INFO ] [MAIN ] LEN: Wiping existing primary data before full refresh. [2025-09-17T20:02:25.714166] [INFO ] [LOCAL ] LEN: Starting deletion of primary data. [2025-09-17T20:02:25.715633] [DEBUG] [LOCAL ] LEN: Deleted primary data file. [2025-09-17T20:02:25.715709] [INFO ] [MAIN ] LEN: Starting full primary refresh. [2025-09-17T20:02:26.020932] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-07. [2025-09-17T20:02:26.130110] [INFO ] [REMOTE ] LEN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:02:26.815782] [INFO ] [REMOTE ] LDP: Fetching primary data for 2025-09. [2025-09-17T20:02:27.244677] [INFO ] [REMOTE ] LDP: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T20:02:27.246907] [INFO ] [REMOTE ] LDP: Full fetch complete (19538 records). [2025-09-17T20:02:27.246985] [DEBUG] [VALIDATOR ] LDP: Validating primary data. [2025-09-17T20:02:27.628193] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-11. [2025-09-17T20:02:27.637707] [DEBUG] [VALIDATOR ] LDP: All expected trading days are present. [2025-09-17T20:02:27.637874] [DEBUG] [VALIDATOR ] LDP: Primary data validation passed. [2025-09-17T20:02:27.639468] [INFO ] [MAIN ] LDP: Fetched primary data is valid. [2025-09-17T20:02:27.639812] [DEBUG] [LOCAL ] LDP: Saving primary data. [2025-09-17T20:02:27.641267] [DEBUG] [LOCAL ] LDP: Trimmed 19538 records to 13223 (keeping 200 days of data) [2025-09-17T20:02:27.759326] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-04 (2.54 seconds). [2025-09-17T20:02:27.767089] [DEBUG] [LOCAL ] LDP: Primary data saved (13223 records). [2025-09-17T20:02:27.778248] [INFO ] [MAIN ] LDP: Full history saved. [2025-09-17T20:02:27.778663] [INFO ] [MAIN ] Update Progress: 1249/2371 symbols completed. LDP took 25.7s. Estimated remaining: 2h 43m 53s. Rate: 6.8 symbols/min [2025-09-17T20:02:27.988540] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T20:02:27.990969] [INFO ] [MAIN ] LEO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:02:27.999953] [DEBUG] [LOCAL ] LEO: No existing data file found in primary storage. [2025-09-17T20:02:28.000175] [WARN ] [MAIN ] LEO: No existing data found, performing full refresh instead. [2025-09-17T20:02:28.000683] [INFO ] [MAIN ] LEO: Wiping existing primary data before full refresh. [2025-09-17T20:02:28.000875] [INFO ] [LOCAL ] LEO: Starting deletion of primary data. [2025-09-17T20:02:28.000924] [DEBUG] [LOCAL ] LEO: No primary data file found to delete. [2025-09-17T20:02:28.000959] [INFO ] [MAIN ] LEO: Starting full primary refresh. [2025-09-17T20:02:28.381248] [INFO ] [REMOTE ] LEO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:02:28.415731] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-11. [2025-09-17T20:02:29.215799] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-05. [2025-09-17T20:02:29.385216] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T20:02:29.652930] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-11 (2.02 seconds). [2025-09-17T20:02:30.015814] [INFO ] [REMOTE ] LEN: Fetching primary data for 2024-12. [2025-09-17T20:02:30.721185] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T20:02:30.815735] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-06. [2025-09-17T20:02:31.615783] [INFO ] [REMOTE ] LEO: Fetching primary data for 2024-12. [2025-09-17T20:02:31.914856] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T20:02:32.264768] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T20:02:32.416135] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-01. [2025-09-17T20:02:32.416065] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T20:02:33.215929] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-01. [2025-09-17T20:02:33.309155] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T20:02:34.015783] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-07. [2025-09-17T20:02:34.815828] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-02. [2025-09-17T20:02:35.038070] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T20:02:35.550809] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T20:02:35.615753] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-08. [2025-09-17T20:02:35.651339] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T20:02:36.415781] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-03. [2025-09-17T20:02:37.215759] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-08. [2025-09-17T20:02:37.300059] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T20:02:37.429727] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T20:02:38.015780] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-02. [2025-09-17T20:02:38.398911] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T20:02:38.815780] [INFO ] [REMOTE ] LEA: Fetching primary data for 2025-09. [2025-09-17T20:02:39.620781] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-04. [2025-09-17T20:02:39.632314] [INFO ] [REMOTE ] LEA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T20:02:39.638619] [INFO ] [REMOTE ] LEA: Full fetch complete (60783 records). [2025-09-17T20:02:39.638763] [DEBUG] [VALIDATOR ] LEA: Validating primary data. [2025-09-17T20:02:40.049683] [DEBUG] [VALIDATOR ] LEA: All expected trading days are present. [2025-09-17T20:02:40.049828] [DEBUG] [VALIDATOR ] LEA: Primary data validation passed. [2025-09-17T20:02:40.051073] [INFO ] [MAIN ] LEA: Fetched primary data is valid. [2025-09-17T20:02:40.051172] [DEBUG] [LOCAL ] LEA: Saving primary data. [2025-09-17T20:02:40.065834] [DEBUG] [LOCAL ] LEA: Trimmed 60783 records to 41916 (keeping 200 days of data) [2025-09-17T20:02:40.092811] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T20:02:40.370020] [DEBUG] [LOCAL ] LEA: Primary data saved (41916 records). [2025-09-17T20:02:40.370169] [INFO ] [MAIN ] LEA: Full history saved. [2025-09-17T20:02:40.370258] [INFO ] [MAIN ] Update Progress: 1250/2371 symbols completed. LEA took 36.8s. Estimated remaining: 2h 43m 48s. Rate: 6.8 symbols/min [2025-09-17T20:02:40.418699] [INFO ] [REMOTE ] LEG: Fetching primary data for 2025-09. [2025-09-17T20:02:40.588323] [INFO ] [MAIN ] LEVI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:02:40.642074] [DEBUG] [LOCAL ] LEVI: Loaded 51477 existing records from primary storage. [2025-09-17T20:02:40.642232] [INFO ] [MAIN ] LEVI: Loaded 51477 existing records. [2025-09-17T20:02:40.822866] [WARN ] [MAIN ] LEVI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:02:40.823691] [INFO ] [MAIN ] LEVI: Wiping existing primary data before full refresh. [2025-09-17T20:02:40.823906] [INFO ] [LOCAL ] LEVI: Starting deletion of primary data. [2025-09-17T20:02:40.834477] [DEBUG] [LOCAL ] LEVI: Deleted primary data file. [2025-09-17T20:02:40.845855] [INFO ] [MAIN ] LEVI: Starting full primary refresh. [2025-09-17T20:02:40.910879] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T20:02:41.228546] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-05. [2025-09-17T20:02:41.233779] [INFO ] [REMOTE ] LEVI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:02:41.307080] [INFO ] [REMOTE ] LEG: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T20:02:41.313975] [INFO ] [REMOTE ] LEG: Full fetch complete (73031 records). [2025-09-17T20:02:41.314111] [DEBUG] [VALIDATOR ] LEG: Validating primary data. [2025-09-17T20:02:41.744604] [DEBUG] [VALIDATOR ] LEG: All expected trading days are present. [2025-09-17T20:02:41.744719] [DEBUG] [VALIDATOR ] LEG: Primary data validation passed. [2025-09-17T20:02:41.745770] [INFO ] [MAIN ] LEG: Fetched primary data is valid. [2025-09-17T20:02:41.745822] [DEBUG] [LOCAL ] LEG: Saving primary data. [2025-09-17T20:02:41.747581] [DEBUG] [LOCAL ] LEG: Trimmed 73031 records to 50409 (keeping 200 days of data) [2025-09-17T20:02:42.025422] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-03. [2025-09-17T20:02:42.063573] [DEBUG] [LOCAL ] LEG: Primary data saved (50409 records). [2025-09-17T20:02:42.063705] [INFO ] [MAIN ] LEG: Full history saved. [2025-09-17T20:02:42.063816] [INFO ] [MAIN ] Update Progress: 1251/2371 symbols completed. LEG took 37.1s. Estimated remaining: 2h 43m 32s. Rate: 6.8 symbols/min [2025-09-17T20:02:42.228253] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T20:02:42.248179] [INFO ] [MAIN ] LFT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:02:42.267155] [DEBUG] [LOCAL ] LFT: Loaded 17802 existing records from primary storage. [2025-09-17T20:02:42.267289] [INFO ] [MAIN ] LFT: Loaded 17802 existing records. [2025-09-17T20:02:42.445517] [WARN ] [MAIN ] LFT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:02:42.445803] [INFO ] [MAIN ] LFT: Wiping existing primary data before full refresh. [2025-09-17T20:02:42.445848] [INFO ] [LOCAL ] LFT: Starting deletion of primary data. [2025-09-17T20:02:42.446362] [DEBUG] [LOCAL ] LFT: Deleted primary data file. [2025-09-17T20:02:42.446410] [INFO ] [MAIN ] LFT: Starting full primary refresh. [2025-09-17T20:02:42.803759] [INFO ] [REMOTE ] LFT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:02:42.815729] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-11. [2025-09-17T20:02:43.615765] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-11. [2025-09-17T20:02:43.697661] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T20:02:43.810633] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T20:02:44.415804] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-06. [2025-09-17T20:02:45.215822] [INFO ] [REMOTE ] LFT: Fetching primary data for 2024-12. [2025-09-17T20:02:45.389624] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T20:02:45.468046] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T20:02:46.015817] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2024-12. [2025-09-17T20:02:46.224112] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T20:02:46.815859] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-04. [2025-09-17T20:02:47.615779] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-07. [2025-09-17T20:02:47.653063] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T20:02:48.415843] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-01. [2025-09-17T20:02:48.621520] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T20:02:48.805926] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T20:02:49.215752] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-01. [2025-09-17T20:02:49.306467] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T20:02:50.015798] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-05. [2025-09-17T20:02:50.815696] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-02. [2025-09-17T20:02:50.934226] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T20:02:51.328361] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T20:02:51.615801] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-03. [2025-09-17T20:02:52.085580] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T20:02:52.415608] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T20:02:52.415885] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-08. [2025-09-17T20:02:53.034070] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T20:02:53.215806] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-04. [2025-09-17T20:02:54.015789] [INFO ] [REMOTE ] LEO: Fetching primary data for 2025-09. [2025-09-17T20:02:54.262774] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T20:02:54.428781] [INFO ] [REMOTE ] LEO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T20:02:54.431466] [INFO ] [REMOTE ] LEO: Full fetch complete (27285 records). [2025-09-17T20:02:54.431566] [DEBUG] [VALIDATOR ] LEO: Validating primary data. [2025-09-17T20:02:54.816388] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-05. [2025-09-17T20:02:54.828010] [DEBUG] [VALIDATOR ] LEO: All expected trading days are present. [2025-09-17T20:02:54.828146] [DEBUG] [VALIDATOR ] LEO: Primary data validation passed. [2025-09-17T20:02:54.828988] [INFO ] [MAIN ] LEO: Fetched primary data is valid. [2025-09-17T20:02:54.829192] [DEBUG] [LOCAL ] LEO: Saving primary data. [2025-09-17T20:02:54.830366] [DEBUG] [LOCAL ] LEO: Trimmed 27285 records to 17756 (keeping 200 days of data) [2025-09-17T20:02:54.953895] [DEBUG] [LOCAL ] LEO: Primary data saved (17756 records). [2025-09-17T20:02:54.954093] [INFO ] [MAIN ] LEO: Full history saved. [2025-09-17T20:02:54.954205] [INFO ] [MAIN ] Update Progress: 1252/2371 symbols completed. LEO took 27.2s. Estimated remaining: 2h 43m 27s. Rate: 6.8 symbols/min [2025-09-17T20:02:55.124062] [INFO ] [MAIN ] LGI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:02:55.135731] [DEBUG] [LOCAL ] LGI: Loaded 10277 existing records from primary storage. [2025-09-17T20:02:55.135872] [INFO ] [MAIN ] LGI: Loaded 10277 existing records. [2025-09-17T20:02:55.316711] [WARN ] [MAIN ] LGI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:02:55.316975] [INFO ] [MAIN ] LGI: Wiping existing primary data before full refresh. [2025-09-17T20:02:55.317021] [INFO ] [LOCAL ] LGI: Starting deletion of primary data. [2025-09-17T20:02:55.317499] [DEBUG] [LOCAL ] LGI: Deleted primary data file. [2025-09-17T20:02:55.317548] [INFO ] [MAIN ] LGI: Starting full primary refresh. [2025-09-17T20:02:55.620982] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-02. [2025-09-17T20:02:55.691662] [INFO ] [REMOTE ] LGI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:02:55.881248] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T20:02:56.415821] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-11. [2025-09-17T20:02:57.045069] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T20:02:57.182430] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T20:02:57.215727] [INFO ] [REMOTE ] LGI: Fetching primary data for 2024-12. [2025-09-17T20:02:58.015848] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-06. [2025-09-17T20:02:58.082562] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T20:02:58.815834] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-01. [2025-09-17T20:02:59.615869] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-03. [2025-09-17T20:02:59.632179] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T20:02:59.895259] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T20:03:00.415865] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-06. [2025-09-17T20:03:01.215839] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-07. [2025-09-17T20:03:01.512269] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T20:03:02.015836] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-04. [2025-09-17T20:03:02.037865] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T20:03:02.815833] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-02. [2025-09-17T20:03:03.004731] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T20:03:03.507626] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T20:03:03.615828] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-07. [2025-09-17T20:03:03.898860] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T20:03:04.415796] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-08. [2025-09-17T20:03:04.736810] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T20:03:05.215801] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-03. [2025-09-17T20:03:06.015804] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-05. [2025-09-17T20:03:06.073519] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T20:03:06.551411] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T20:03:06.815789] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-04. [2025-09-17T20:03:07.389969] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T20:03:07.615791] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-06. [2025-09-17T20:03:07.627817] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T20:03:08.415797] [INFO ] [REMOTE ] LEN: Fetching primary data for 2025-09. [2025-09-17T20:03:09.100905] [INFO ] [REMOTE ] LEN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T20:03:09.108988] [INFO ] [REMOTE ] LEN: Full fetch complete (76775 records). [2025-09-17T20:03:09.109193] [DEBUG] [VALIDATOR ] LEN: Validating primary data. [2025-09-17T20:03:09.219166] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-05. [2025-09-17T20:03:09.422119] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T20:03:09.555514] [DEBUG] [VALIDATOR ] LEN: All expected trading days are present. [2025-09-17T20:03:09.555609] [DEBUG] [VALIDATOR ] LEN: Primary data validation passed. [2025-09-17T20:03:09.556735] [INFO ] [MAIN ] LEN: Fetched primary data is valid. [2025-09-17T20:03:09.556793] [DEBUG] [LOCAL ] LEN: Saving primary data. [2025-09-17T20:03:09.558534] [DEBUG] [LOCAL ] LEN: Trimmed 76775 records to 53184 (keeping 200 days of data) [2025-09-17T20:03:09.907009] [DEBUG] [LOCAL ] LEN: Primary data saved (53184 records). [2025-09-17T20:03:09.907160] [INFO ] [MAIN ] LEN: Full history saved. [2025-09-17T20:03:09.910908] [INFO ] [MAIN ] Update Progress: 1253/2371 symbols completed. LEN took 44.7s. Estimated remaining: 2h 43m 24s. Rate: 6.8 symbols/min [2025-09-17T20:03:10.020712] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-08. [2025-09-17T20:03:10.095956] [INFO ] [MAIN ] LH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:03:10.140864] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T20:03:10.159209] [DEBUG] [LOCAL ] LH: Loaded 38865 existing records from primary storage. [2025-09-17T20:03:10.159422] [INFO ] [MAIN ] LH: Loaded 38865 existing records. [2025-09-17T20:03:10.343329] [WARN ] [MAIN ] LH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:03:10.343742] [INFO ] [MAIN ] LH: Wiping existing primary data before full refresh. [2025-09-17T20:03:10.343796] [INFO ] [LOCAL ] LH: Starting deletion of primary data. [2025-09-17T20:03:10.344851] [DEBUG] [LOCAL ] LH: Deleted primary data file. [2025-09-17T20:03:10.344917] [INFO ] [MAIN ] LH: Starting full primary refresh. [2025-09-17T20:03:10.721263] [INFO ] [REMOTE ] LH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:03:10.815832] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-06. [2025-09-17T20:03:11.049567] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T20:03:11.413820] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T20:03:11.615789] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-11. [2025-09-17T20:03:12.415783] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-07. [2025-09-17T20:03:12.978314] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T20:03:13.215777] [INFO ] [REMOTE ] LFT: Fetching primary data for 2025-09. [2025-09-17T20:03:13.508205] [INFO ] [REMOTE ] LFT: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-17T20:03:13.510450] [INFO ] [REMOTE ] LFT: Full fetch complete (23795 records). [2025-09-17T20:03:13.510527] [DEBUG] [VALIDATOR ] LFT: Validating primary data. [2025-09-17T20:03:13.882008] [DEBUG] [VALIDATOR ] LFT: All expected trading days are present. [2025-09-17T20:03:13.882157] [DEBUG] [VALIDATOR ] LFT: Primary data validation passed. [2025-09-17T20:03:13.882750] [INFO ] [MAIN ] LFT: Fetched primary data is valid. [2025-09-17T20:03:13.882843] [DEBUG] [LOCAL ] LFT: Saving primary data. [2025-09-17T20:03:13.883806] [DEBUG] [LOCAL ] LFT: Trimmed 23795 records to 17835 (keeping 200 days of data) [2025-09-17T20:03:14.002727] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T20:03:14.017664] [INFO ] [REMOTE ] LH: Fetching primary data for 2024-12. [2025-09-17T20:03:14.036244] [DEBUG] [LOCAL ] LFT: Primary data saved (17835 records). [2025-09-17T20:03:14.036390] [INFO ] [MAIN ] LFT: Full history saved. [2025-09-17T20:03:14.036483] [INFO ] [MAIN ] Update Progress: 1254/2371 symbols completed. LFT took 32.0s. Estimated remaining: 2h 43m 11s. Rate: 6.8 symbols/min [2025-09-17T20:03:14.217746] [INFO ] [MAIN ] LHX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:03:14.268514] [DEBUG] [LOCAL ] LHX: Loaded 49100 existing records from primary storage. [2025-09-17T20:03:14.268767] [INFO ] [MAIN ] LHX: Loaded 49100 existing records. [2025-09-17T20:03:14.454869] [WARN ] [MAIN ] LHX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:03:14.455144] [INFO ] [MAIN ] LHX: Wiping existing primary data before full refresh. [2025-09-17T20:03:14.455213] [INFO ] [LOCAL ] LHX: Starting deletion of primary data. [2025-09-17T20:03:14.456879] [DEBUG] [LOCAL ] LHX: Deleted primary data file. [2025-09-17T20:03:14.456942] [INFO ] [MAIN ] LHX: Starting full primary refresh. [2025-09-17T20:03:14.814810] [INFO ] [REMOTE ] LHX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:03:14.815728] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-11. [2025-09-17T20:03:15.488094] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T20:03:15.615762] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-08. [2025-09-17T20:03:16.415872] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-01. [2025-09-17T20:03:16.483574] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T20:03:17.215849] [INFO ] [REMOTE ] LHX: Fetching primary data for 2024-12. [2025-09-17T20:03:17.813885] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-17T20:03:18.015793] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-07. [2025-09-17T20:03:18.201280] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T20:03:18.524174] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T20:03:18.798543] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T20:03:18.815677] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-08. [2025-09-17T20:03:19.568431] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T20:03:19.615738] [INFO ] [REMOTE ] LGI: Fetching primary data for 2025-09. [2025-09-17T20:03:20.072006] [INFO ] [REMOTE ] LGI: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T20:03:20.073514] [INFO ] [REMOTE ] LGI: Full fetch complete (14245 records). [2025-09-17T20:03:20.073584] [DEBUG] [VALIDATOR ] LGI: Validating primary data. [2025-09-17T20:03:20.420945] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-01. [2025-09-17T20:03:20.497722] [DEBUG] [VALIDATOR ] LGI: All expected trading days are present. [2025-09-17T20:03:20.497804] [DEBUG] [VALIDATOR ] LGI: Primary data validation passed. [2025-09-17T20:03:20.498159] [INFO ] [MAIN ] LGI: Fetched primary data is valid. [2025-09-17T20:03:20.498219] [DEBUG] [LOCAL ] LGI: Saving primary data. [2025-09-17T20:03:20.499012] [DEBUG] [LOCAL ] LGI: Trimmed 14245 records to 10182 (keeping 200 days of data) [2025-09-17T20:03:20.567469] [DEBUG] [LOCAL ] LGI: Primary data saved (10182 records). [2025-09-17T20:03:20.567978] [INFO ] [MAIN ] LGI: Full history saved. [2025-09-17T20:03:20.568135] [INFO ] [MAIN ] Update Progress: 1255/2371 symbols completed. LGI took 25.6s. Estimated remaining: 2h 43m 0s. Rate: 6.8 symbols/min [2025-09-17T20:03:20.758780] [INFO ] [MAIN ] LII: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:03:20.795470] [DEBUG] [LOCAL ] LII: Loaded 28709 existing records from primary storage. [2025-09-17T20:03:20.795750] [INFO ] [MAIN ] LII: Loaded 28709 existing records. [2025-09-17T20:03:20.992415] [WARN ] [MAIN ] LII: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:03:20.992802] [INFO ] [MAIN ] LII: Wiping existing primary data before full refresh. [2025-09-17T20:03:20.992854] [INFO ] [LOCAL ] LII: Starting deletion of primary data. [2025-09-17T20:03:20.993949] [DEBUG] [LOCAL ] LII: Deleted primary data file. [2025-09-17T20:03:20.994015] [INFO ] [MAIN ] LII: Starting full primary refresh. [2025-09-17T20:03:21.221029] [INFO ] [REMOTE ] LEVI: Fetching primary data for 2025-09. [2025-09-17T20:03:21.409481] [INFO ] [REMOTE ] LII: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:03:22.015772] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-11. [2025-09-17T20:03:22.179495] [INFO ] [REMOTE ] LEVI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T20:03:22.186389] [INFO ] [REMOTE ] LEVI: Full fetch complete (74272 records). [2025-09-17T20:03:22.186536] [DEBUG] [VALIDATOR ] LEVI: Validating primary data. [2025-09-17T20:03:22.581145] [DEBUG] [VALIDATOR ] LEVI: All expected trading days are present. [2025-09-17T20:03:22.581302] [DEBUG] [VALIDATOR ] LEVI: Primary data validation passed. [2025-09-17T20:03:22.582360] [INFO ] [MAIN ] LEVI: Fetched primary data is valid. [2025-09-17T20:03:22.582437] [DEBUG] [LOCAL ] LEVI: Saving primary data. [2025-09-17T20:03:22.584597] [DEBUG] [LOCAL ] LEVI: Trimmed 74272 records to 51482 (keeping 200 days of data) [2025-09-17T20:03:22.714882] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-17T20:03:22.824189] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-02. [2025-09-17T20:03:22.965712] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T20:03:22.978455] [DEBUG] [LOCAL ] LEVI: Primary data saved (51482 records). [2025-09-17T20:03:22.978571] [INFO ] [MAIN ] LEVI: Full history saved. [2025-09-17T20:03:22.978726] [INFO ] [MAIN ] Update Progress: 1256/2371 symbols completed. LEVI took 42.6s. Estimated remaining: 2h 42m 46s. Rate: 6.9 symbols/min [2025-09-17T20:03:23.155142] [INFO ] [MAIN ] LION: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:03:23.196086] [DEBUG] [LOCAL ] LION: Loaded 42056 existing records from primary storage. [2025-09-17T20:03:23.196229] [INFO ] [MAIN ] LION: Loaded 42056 existing records. [2025-09-17T20:03:23.371840] [WARN ] [MAIN ] LION: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:03:23.372083] [INFO ] [MAIN ] LION: Wiping existing primary data before full refresh. [2025-09-17T20:03:23.372135] [INFO ] [LOCAL ] LION: Starting deletion of primary data. [2025-09-17T20:03:23.373001] [DEBUG] [LOCAL ] LION: Deleted primary data file. [2025-09-17T20:03:23.373051] [INFO ] [MAIN ] LION: Starting full primary refresh. [2025-09-17T20:03:23.621117] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-02. [2025-09-17T20:03:23.725432] [INFO ] [REMOTE ] LION: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:03:24.355908] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T20:03:24.415735] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-03. [2025-09-17T20:03:25.215782] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-11. [2025-09-17T20:03:25.430708] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T20:03:26.015688] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-03. [2025-09-17T20:03:26.125804] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T20:03:26.144705] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T20:03:26.815797] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-04. [2025-09-17T20:03:27.588856] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T20:03:27.615746] [INFO ] [REMOTE ] LION: Fetching primary data for 2024-12. [2025-09-17T20:03:28.415852] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-04. [2025-09-17T20:03:28.539120] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T20:03:28.704560] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T20:03:29.215786] [INFO ] [REMOTE ] LII: Fetching primary data for 2024-12. [2025-09-17T20:03:30.015793] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-01. [2025-09-17T20:03:30.308279] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T20:03:30.339376] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T20:03:30.815694] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-05. [2025-09-17T20:03:30.934394] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T20:03:31.615834] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-02. [2025-09-17T20:03:32.415755] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-05. [2025-09-17T20:03:32.612006] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T20:03:32.722915] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T20:03:33.215832] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-01. [2025-09-17T20:03:33.730452] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T20:03:34.015825] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-06. [2025-09-17T20:03:34.535210] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T20:03:34.815794] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-02. [2025-09-17T20:03:35.507520] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T20:03:35.615771] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-07. [2025-09-17T20:03:36.203120] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T20:03:36.415744] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-03. [2025-09-17T20:03:36.984500] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T20:03:37.215779] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-03. [2025-09-17T20:03:37.759903] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T20:03:38.015833] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-04. [2025-09-17T20:03:38.231614] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T20:03:38.815781] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-04. [2025-09-17T20:03:39.615752] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-08. [2025-09-17T20:03:39.709071] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T20:03:40.165245] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T20:03:40.415806] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-06. [2025-09-17T20:03:40.744911] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T20:03:41.215775] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-05. [2025-09-17T20:03:42.015763] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-05. [2025-09-17T20:03:42.392570] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T20:03:42.463472] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T20:03:42.815790] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-06. [2025-09-17T20:03:43.372344] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T20:03:43.615806] [INFO ] [REMOTE ] LH: Fetching primary data for 2025-09. [2025-09-17T20:03:43.837430] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T20:03:44.291998] [INFO ] [REMOTE ] LH: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T20:03:44.298267] [INFO ] [REMOTE ] LH: Full fetch complete (54877 records). [2025-09-17T20:03:44.298478] [DEBUG] [VALIDATOR ] LH: Validating primary data. [2025-09-17T20:03:44.421031] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-07. [2025-09-17T20:03:44.740032] [DEBUG] [VALIDATOR ] LH: All expected trading days are present. [2025-09-17T20:03:44.740173] [DEBUG] [VALIDATOR ] LH: Primary data validation passed. [2025-09-17T20:03:44.741305] [INFO ] [MAIN ] LH: Fetched primary data is valid. [2025-09-17T20:03:44.741355] [DEBUG] [LOCAL ] LH: Saving primary data. [2025-09-17T20:03:44.743038] [DEBUG] [LOCAL ] LH: Trimmed 54877 records to 38870 (keeping 200 days of data) [2025-09-17T20:03:45.006530] [DEBUG] [LOCAL ] LH: Primary data saved (38870 records). [2025-09-17T20:03:45.006706] [INFO ] [MAIN ] LH: Full history saved. [2025-09-17T20:03:45.006845] [INFO ] [MAIN ] Update Progress: 1257/2371 symbols completed. LH took 35.1s. Estimated remaining: 2h 42m 49s. Rate: 6.8 symbols/min [2025-09-17T20:03:45.179522] [INFO ] [MAIN ] LITB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:03:45.187948] [DEBUG] [LOCAL ] LITB: Loaded 4237 existing records from primary storage. [2025-09-17T20:03:45.188083] [INFO ] [MAIN ] LITB: Loaded 4237 existing records. [2025-09-17T20:03:45.220975] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-07. [2025-09-17T20:03:45.383571] [WARN ] [MAIN ] LITB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:03:45.384064] [INFO ] [MAIN ] LITB: Wiping existing primary data before full refresh. [2025-09-17T20:03:45.384117] [INFO ] [LOCAL ] LITB: Starting deletion of primary data. [2025-09-17T20:03:45.384540] [DEBUG] [LOCAL ] LITB: Deleted primary data file. [2025-09-17T20:03:45.384602] [INFO ] [MAIN ] LITB: Starting full primary refresh. [2025-09-17T20:03:45.754018] [INFO ] [REMOTE ] LITB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:03:45.861120] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T20:03:46.015871] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-08. [2025-09-17T20:03:46.815890] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-11. [2025-09-17T20:03:47.187053] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T20:03:47.232588] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T20:03:47.315474] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T20:03:47.615828] [INFO ] [REMOTE ] LII: Fetching primary data for 2025-09. [2025-09-17T20:03:48.274546] [INFO ] [REMOTE ] LII: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T20:03:48.279088] [INFO ] [REMOTE ] LII: Full fetch complete (40906 records). [2025-09-17T20:03:48.279349] [DEBUG] [VALIDATOR ] LII: Validating primary data. [2025-09-17T20:03:48.430373] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-06. [2025-09-17T20:03:48.686097] [DEBUG] [VALIDATOR ] LII: All expected trading days are present. [2025-09-17T20:03:48.686213] [DEBUG] [VALIDATOR ] LII: Primary data validation passed. [2025-09-17T20:03:48.687349] [INFO ] [MAIN ] LII: Fetched primary data is valid. [2025-09-17T20:03:48.687413] [DEBUG] [LOCAL ] LII: Saving primary data. [2025-09-17T20:03:48.688935] [DEBUG] [LOCAL ] LII: Trimmed 40906 records to 28705 (keeping 200 days of data) [2025-09-17T20:03:48.887497] [DEBUG] [LOCAL ] LII: Primary data saved (28705 records). [2025-09-17T20:03:48.887713] [INFO ] [MAIN ] LII: Full history saved. [2025-09-17T20:03:48.887871] [INFO ] [MAIN ] Update Progress: 1258/2371 symbols completed. LII took 28.3s. Estimated remaining: 2h 42m 36s. Rate: 6.8 symbols/min [2025-09-17T20:03:49.064611] [INFO ] [MAIN ] LLY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:03:49.123785] [DEBUG] [LOCAL ] LLY: Loaded 53301 existing records from primary storage. [2025-09-17T20:03:49.123968] [INFO ] [MAIN ] LLY: Loaded 53301 existing records. [2025-09-17T20:03:49.225274] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-08. [2025-09-17T20:03:49.310860] [WARN ] [MAIN ] LLY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:03:49.311184] [INFO ] [MAIN ] LLY: Wiping existing primary data before full refresh. [2025-09-17T20:03:49.311243] [INFO ] [LOCAL ] LLY: Starting deletion of primary data. [2025-09-17T20:03:49.312355] [DEBUG] [LOCAL ] LLY: Deleted primary data file. [2025-09-17T20:03:49.312413] [INFO ] [MAIN ] LLY: Starting full primary refresh. [2025-09-17T20:03:49.676322] [INFO ] [REMOTE ] LLY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:03:50.015803] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-11. [2025-09-17T20:03:50.200014] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T20:03:50.815853] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-07. [2025-09-17T20:03:51.017249] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T20:03:51.615787] [INFO ] [REMOTE ] LHX: Fetching primary data for 2025-09. [2025-09-17T20:03:52.290681] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T20:03:52.400973] [INFO ] [REMOTE ] LHX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T20:03:52.407265] [INFO ] [REMOTE ] LHX: Full fetch complete (70760 records). [2025-09-17T20:03:52.407386] [DEBUG] [VALIDATOR ] LHX: Validating primary data. [2025-09-17T20:03:52.421127] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-08. [2025-09-17T20:03:52.806456] [DEBUG] [VALIDATOR ] LHX: All expected trading days are present. [2025-09-17T20:03:52.806600] [DEBUG] [VALIDATOR ] LHX: Primary data validation passed. [2025-09-17T20:03:52.807632] [INFO ] [MAIN ] LHX: Fetched primary data is valid. [2025-09-17T20:03:52.807803] [DEBUG] [LOCAL ] LHX: Saving primary data. [2025-09-17T20:03:52.841896] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-11 (2.83 seconds). [2025-09-17T20:03:52.842059] [DEBUG] [LOCAL ] LHX: Trimmed 70760 records to 49075 (keeping 200 days of data) [2025-09-17T20:03:53.201914] [DEBUG] [LOCAL ] LHX: Primary data saved (49075 records). [2025-09-17T20:03:53.202148] [INFO ] [MAIN ] LHX: Full history saved. [2025-09-17T20:03:53.202266] [INFO ] [MAIN ] Update Progress: 1259/2371 symbols completed. LHX took 39.2s. Estimated remaining: 2h 42m 23s. Rate: 6.8 symbols/min [2025-09-17T20:03:53.224621] [INFO ] [REMOTE ] LITB: Fetching primary data for 2024-12. [2025-09-17T20:03:53.436346] [INFO ] [MAIN ] LMND: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:03:53.491787] [DEBUG] [LOCAL ] LMND: Loaded 51882 existing records from primary storage. [2025-09-17T20:03:53.492018] [INFO ] [MAIN ] LMND: Loaded 51882 existing records. [2025-09-17T20:03:53.686871] [WARN ] [MAIN ] LMND: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:03:53.687191] [INFO ] [MAIN ] LMND: Wiping existing primary data before full refresh. [2025-09-17T20:03:53.687244] [INFO ] [LOCAL ] LMND: Starting deletion of primary data. [2025-09-17T20:03:53.688470] [DEBUG] [LOCAL ] LMND: Deleted primary data file. [2025-09-17T20:03:53.688529] [INFO ] [MAIN ] LMND: Starting full primary refresh. [2025-09-17T20:03:53.800076] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T20:03:54.021092] [INFO ] [REMOTE ] LLY: Fetching primary data for 2024-12. [2025-09-17T20:03:54.088434] [INFO ] [REMOTE ] LMND: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:03:54.222994] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T20:03:54.815797] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-01. [2025-09-17T20:03:55.285386] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T20:03:55.615791] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-11. [2025-09-17T20:03:56.415832] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-02. [2025-09-17T20:03:56.738145] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-17T20:03:56.743203] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-17T20:03:57.215849] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-03. [2025-09-17T20:03:57.750020] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-17T20:03:57.750811] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T20:03:58.015873] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-04. [2025-09-17T20:03:58.815994] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-01. [2025-09-17T20:03:58.847084] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T20:03:59.615836] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-05. [2025-09-17T20:04:00.088147] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T20:04:00.415885] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-06. [2025-09-17T20:04:00.915459] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-06 (0.50 seconds). [2025-09-17T20:04:01.215839] [INFO ] [REMOTE ] LION: Fetching primary data for 2025-09. [2025-09-17T20:04:01.477977] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-01 (2.66 seconds). [2025-09-17T20:04:02.015816] [INFO ] [REMOTE ] LMND: Fetching primary data for 2024-12. [2025-09-17T20:04:02.112483] [INFO ] [REMOTE ] LION: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T20:04:02.119458] [INFO ] [REMOTE ] LION: Full fetch complete (52825 records). [2025-09-17T20:04:02.119615] [DEBUG] [VALIDATOR ] LION: Validating primary data. [2025-09-17T20:04:02.515393] [DEBUG] [VALIDATOR ] LION: All expected trading days are present. [2025-09-17T20:04:02.515517] [DEBUG] [VALIDATOR ] LION: Primary data validation passed. [2025-09-17T20:04:02.516685] [INFO ] [MAIN ] LION: Fetched primary data is valid. [2025-09-17T20:04:02.516737] [DEBUG] [LOCAL ] LION: Saving primary data. [2025-09-17T20:04:02.518343] [DEBUG] [LOCAL ] LION: Trimmed 52825 records to 42314 (keeping 200 days of data) [2025-09-17T20:04:02.776703] [DEBUG] [LOCAL ] LION: Primary data saved (42314 records). [2025-09-17T20:04:02.776900] [INFO ] [MAIN ] LION: Full history saved. [2025-09-17T20:04:02.777022] [INFO ] [MAIN ] Update Progress: 1260/2371 symbols completed. LION took 39.8s. Estimated remaining: 2h 42m 15s. Rate: 6.8 symbols/min [2025-09-17T20:04:02.821126] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-02. [2025-09-17T20:04:02.972774] [INFO ] [MAIN ] LMT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:04:03.025450] [DEBUG] [LOCAL ] LMT: Loaded 50019 existing records from primary storage. [2025-09-17T20:04:03.025740] [INFO ] [MAIN ] LMT: Loaded 50019 existing records. [2025-09-17T20:04:03.212046] [WARN ] [MAIN ] LMT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:04:03.212319] [INFO ] [MAIN ] LMT: Wiping existing primary data before full refresh. [2025-09-17T20:04:03.212376] [INFO ] [LOCAL ] LMT: Starting deletion of primary data. [2025-09-17T20:04:03.213558] [DEBUG] [LOCAL ] LMT: Deleted primary data file. [2025-09-17T20:04:03.213611] [INFO ] [MAIN ] LMT: Starting full primary refresh. [2025-09-17T20:04:03.574867] [INFO ] [REMOTE ] LMT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:04:03.615853] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-11. [2025-09-17T20:04:03.933667] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T20:04:04.415883] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-01. [2025-09-17T20:04:05.183179] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-02 (2.36 seconds). [2025-09-17T20:04:05.215759] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-03. [2025-09-17T20:04:05.265251] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T20:04:05.937914] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T20:04:06.015784] [INFO ] [REMOTE ] LMT: Fetching primary data for 2024-12. [2025-09-17T20:04:06.815812] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-02. [2025-09-17T20:04:07.615766] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-07. [2025-09-17T20:04:07.672272] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-17T20:04:08.116126] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T20:04:08.204154] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-17T20:04:08.415840] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-08. [2025-09-17T20:04:08.825363] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T20:04:08.852266] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T20:04:09.215870] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-01. [2025-09-17T20:04:10.015819] [INFO ] [REMOTE ] LITB: Fetching primary data for 2025-09. [2025-09-17T20:04:10.304338] [INFO ] [REMOTE ] LITB: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-17T20:04:10.305829] [INFO ] [REMOTE ] LITB: Full fetch complete (5517 records). [2025-09-17T20:04:10.305907] [DEBUG] [VALIDATOR ] LITB: Validating primary data. [2025-09-17T20:04:10.684885] [DEBUG] [VALIDATOR ] LITB: All expected trading days are present. [2025-09-17T20:04:10.684968] [DEBUG] [VALIDATOR ] LITB: Primary data validation passed. [2025-09-17T20:04:10.685166] [INFO ] [MAIN ] LITB: Fetched primary data is valid. [2025-09-17T20:04:10.685204] [DEBUG] [LOCAL ] LITB: Saving primary data. [2025-09-17T20:04:10.685599] [DEBUG] [LOCAL ] LITB: Trimmed 5517 records to 4260 (keeping 200 days of data) [2025-09-17T20:04:10.714424] [DEBUG] [LOCAL ] LITB: Primary data saved (4260 records). [2025-09-17T20:04:10.714546] [INFO ] [MAIN ] LITB: Full history saved. [2025-09-17T20:04:10.714699] [INFO ] [MAIN ] Update Progress: 1261/2371 symbols completed. LITB took 25.7s. Estimated remaining: 2h 42m 6s. Rate: 6.8 symbols/min [2025-09-17T20:04:10.820360] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-04. [2025-09-17T20:04:10.895382] [INFO ] [MAIN ] LNC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:04:10.951208] [DEBUG] [LOCAL ] LNC: Loaded 51622 existing records from primary storage. [2025-09-17T20:04:10.951403] [INFO ] [MAIN ] LNC: Loaded 51622 existing records. [2025-09-17T20:04:11.136284] [WARN ] [MAIN ] LNC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:04:11.136705] [INFO ] [MAIN ] LNC: Wiping existing primary data before full refresh. [2025-09-17T20:04:11.136806] [INFO ] [LOCAL ] LNC: Starting deletion of primary data. [2025-09-17T20:04:11.137859] [DEBUG] [LOCAL ] LNC: Deleted primary data file. [2025-09-17T20:04:11.137923] [INFO ] [MAIN ] LNC: Starting full primary refresh. [2025-09-17T20:04:11.505606] [INFO ] [REMOTE ] LNC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:04:11.537853] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-01 (2.32 seconds). [2025-09-17T20:04:11.615797] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-11. [2025-09-17T20:04:12.415816] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-02. [2025-09-17T20:04:13.220843] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-03. [2025-09-17T20:04:13.239001] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T20:04:13.448107] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-04 (2.63 seconds). [2025-09-17T20:04:14.015872] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-05. [2025-09-17T20:04:14.282505] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T20:04:14.815821] [INFO ] [REMOTE ] LNC: Fetching primary data for 2024-12. [2025-09-17T20:04:15.171829] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T20:04:15.615900] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-03. [2025-09-17T20:04:16.415763] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-04. [2025-09-17T20:04:16.444929] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T20:04:16.753482] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-05 (2.74 seconds). [2025-09-17T20:04:17.215798] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-01. [2025-09-17T20:04:17.861437] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-17T20:04:17.953323] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T20:04:18.015780] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-06. [2025-09-17T20:04:18.815841] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-05. [2025-09-17T20:04:18.870592] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T20:04:19.615833] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-04. [2025-09-17T20:04:20.415804] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-02. [2025-09-17T20:04:20.543490] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-06 (2.53 seconds). [2025-09-17T20:04:20.639255] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T20:04:21.215688] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-07. [2025-09-17T20:04:21.735830] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T20:04:22.015848] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-06. [2025-09-17T20:04:22.329069] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-17T20:04:22.815803] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-03. [2025-09-17T20:04:23.615769] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-05. [2025-09-17T20:04:23.720787] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-07 (2.51 seconds). [2025-09-17T20:04:23.922675] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T20:04:24.415792] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-07. [2025-09-17T20:04:24.769006] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T20:04:25.215777] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-04. [2025-09-17T20:04:25.546576] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T20:04:26.015766] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-08. [2025-09-17T20:04:26.525911] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T20:04:26.815814] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-08. [2025-09-17T20:04:26.997479] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T20:04:27.615784] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-05. [2025-09-17T20:04:28.415794] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-06. [2025-09-17T20:04:28.896197] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T20:04:28.934350] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-08 (2.92 seconds). [2025-09-17T20:04:29.215775] [INFO ] [REMOTE ] LLY: Fetching primary data for 2025-09. [2025-09-17T20:04:29.353083] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T20:04:30.015781] [INFO ] [REMOTE ] LMND: Fetching primary data for 2025-09. [2025-09-17T20:04:30.292687] [INFO ] [REMOTE ] LLY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T20:04:30.300779] [INFO ] [REMOTE ] LLY: Full fetch complete (77225 records). [2025-09-17T20:04:30.300940] [DEBUG] [VALIDATOR ] LLY: Validating primary data. [2025-09-17T20:04:30.727211] [DEBUG] [VALIDATOR ] LLY: All expected trading days are present. [2025-09-17T20:04:30.727528] [DEBUG] [VALIDATOR ] LLY: Primary data validation passed. [2025-09-17T20:04:30.729014] [INFO ] [MAIN ] LLY: Fetched primary data is valid. [2025-09-17T20:04:30.729177] [DEBUG] [LOCAL ] LLY: Saving primary data. [2025-09-17T20:04:30.731326] [DEBUG] [LOCAL ] LLY: Trimmed 77225 records to 53302 (keeping 200 days of data) [2025-09-17T20:04:30.820435] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-06. [2025-09-17T20:04:30.849304] [INFO ] [REMOTE ] LMND: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T20:04:30.896740] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-17T20:04:30.897338] [INFO ] [REMOTE ] LMND: Full fetch complete (75173 records). [2025-09-17T20:04:30.908517] [DEBUG] [VALIDATOR ] LMND: Validating primary data. [2025-09-17T20:04:31.473430] [DEBUG] [VALIDATOR ] LMND: All expected trading days are present. [2025-09-17T20:04:31.474056] [DEBUG] [VALIDATOR ] LMND: Primary data validation passed. [2025-09-17T20:04:31.477398] [INFO ] [MAIN ] LMND: Fetched primary data is valid. [2025-09-17T20:04:31.478570] [DEBUG] [LOCAL ] LMND: Saving primary data. [2025-09-17T20:04:31.488075] [DEBUG] [LOCAL ] LMND: Trimmed 75173 records to 51874 (keeping 200 days of data) [2025-09-17T20:04:31.616715] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-07. [2025-09-17T20:04:31.905779] [DEBUG] [LOCAL ] LLY: Primary data saved (53302 records). [2025-09-17T20:04:31.913890] [INFO ] [MAIN ] LLY: Full history saved. [2025-09-17T20:04:31.916749] [INFO ] [MAIN ] Update Progress: 1262/2371 symbols completed. LLY took 43.0s. Estimated remaining: 2h 42m 8s. Rate: 6.8 symbols/min [2025-09-17T20:04:31.925852] [DEBUG] [LOCAL ] LMND: Primary data saved (51874 records). [2025-09-17T20:04:31.960451] [INFO ] [MAIN ] LMND: Full history saved. [2025-09-17T20:04:31.994115] [INFO ] [MAIN ] Update Progress: 1263/2371 symbols completed. LMND took 38.8s. Estimated remaining: 2h 41m 52s. Rate: 6.8 symbols/min [2025-09-17T20:04:32.302775] [INFO ] [MAIN ] LND: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:04:32.305449] [INFO ] [MAIN ] LNG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:04:32.317172] [DEBUG] [LOCAL ] LND: Loaded 5274 existing records from primary storage. [2025-09-17T20:04:32.317360] [INFO ] [MAIN ] LND: Loaded 5274 existing records. [2025-09-17T20:04:32.523505] [WARN ] [MAIN ] LND: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:04:32.523897] [INFO ] [MAIN ] LND: Wiping existing primary data before full refresh. [2025-09-17T20:04:32.523947] [INFO ] [LOCAL ] LND: Starting deletion of primary data. [2025-09-17T20:04:32.524231] [DEBUG] [LOCAL ] LND: Deleted primary data file. [2025-09-17T20:04:32.524293] [INFO ] [MAIN ] LND: Starting full primary refresh. [2025-09-17T20:04:32.650222] [DEBUG] [LOCAL ] LNG: Loaded 51629 existing records from primary storage. [2025-09-17T20:04:32.650518] [INFO ] [MAIN ] LNG: Loaded 51629 existing records. [2025-09-17T20:04:33.117439] [WARN ] [MAIN ] LNG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:04:33.156043] [INFO ] [REMOTE ] LND: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:04:33.156932] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-11. [2025-09-17T20:04:33.156597] [INFO ] [MAIN ] LNG: Wiping existing primary data before full refresh. [2025-09-17T20:04:33.158132] [INFO ] [LOCAL ] LNG: Starting deletion of primary data. [2025-09-17T20:04:33.169669] [DEBUG] [LOCAL ] LNG: Deleted primary data file. [2025-09-17T20:04:33.187827] [INFO ] [MAIN ] LNG: Starting full primary refresh. [2025-09-17T20:04:33.237706] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-17T20:04:33.316858] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-07. [2025-09-17T20:04:33.581515] [INFO ] [REMOTE ] LNG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:04:33.942019] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T20:04:34.016171] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-11. [2025-09-17T20:04:34.017596] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-07 (2.40 seconds). [2025-09-17T20:04:34.815816] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-08. [2025-09-17T20:04:35.178548] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T20:04:35.440010] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T20:04:35.615778] [INFO ] [REMOTE ] LNG: Fetching primary data for 2024-12. [2025-09-17T20:04:36.415786] [INFO ] [REMOTE ] LND: Fetching primary data for 2024-12. [2025-09-17T20:04:36.668425] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T20:04:37.020187] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T20:04:37.215778] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-08. [2025-09-17T20:04:37.379002] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T20:04:38.015786] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-01. [2025-09-17T20:04:38.679975] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T20:04:38.815804] [INFO ] [REMOTE ] LMT: Fetching primary data for 2025-09. [2025-09-17T20:04:38.897003] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T20:04:39.526671] [INFO ] [REMOTE ] LMT: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T20:04:39.533175] [INFO ] [REMOTE ] LMT: Full fetch complete (72455 records). [2025-09-17T20:04:39.533324] [DEBUG] [VALIDATOR ] LMT: Validating primary data. [2025-09-17T20:04:39.620956] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-01. [2025-09-17T20:04:39.930324] [DEBUG] [VALIDATOR ] LMT: All expected trading days are present. [2025-09-17T20:04:39.930412] [DEBUG] [VALIDATOR ] LMT: Primary data validation passed. [2025-09-17T20:04:39.931753] [INFO ] [MAIN ] LMT: Fetched primary data is valid. [2025-09-17T20:04:39.931809] [DEBUG] [LOCAL ] LMT: Saving primary data. [2025-09-17T20:04:39.933356] [DEBUG] [LOCAL ] LMT: Trimmed 72455 records to 50008 (keeping 200 days of data) [2025-09-17T20:04:40.253041] [DEBUG] [LOCAL ] LMT: Primary data saved (50008 records). [2025-09-17T20:04:40.253195] [INFO ] [MAIN ] LMT: Full history saved. [2025-09-17T20:04:40.253288] [INFO ] [MAIN ] Update Progress: 1264/2371 symbols completed. LMT took 37.5s. Estimated remaining: 2h 41m 42s. Rate: 6.8 symbols/min [2025-09-17T20:04:40.422017] [INFO ] [MAIN ] LNN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:04:40.422105] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-02. [2025-09-17T20:04:40.437015] [DEBUG] [LOCAL ] LNN: Loaded 11221 existing records from primary storage. [2025-09-17T20:04:40.437250] [INFO ] [MAIN ] LNN: Loaded 11221 existing records. [2025-09-17T20:04:40.620977] [WARN ] [MAIN ] LNN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:04:40.621378] [INFO ] [MAIN ] LNN: Wiping existing primary data before full refresh. [2025-09-17T20:04:40.621432] [INFO ] [LOCAL ] LNN: Starting deletion of primary data. [2025-09-17T20:04:40.621790] [DEBUG] [LOCAL ] LNN: Deleted primary data file. [2025-09-17T20:04:40.621837] [INFO ] [MAIN ] LNN: Starting full primary refresh. [2025-09-17T20:04:40.979280] [INFO ] [REMOTE ] LNN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:04:41.186183] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T20:04:41.215759] [INFO ] [REMOTE ] LNC: Fetching primary data for 2025-09. [2025-09-17T20:04:41.550405] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T20:04:42.007889] [INFO ] [REMOTE ] LNC: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T20:04:42.015265] [INFO ] [REMOTE ] LNC: Full fetch complete (73637 records). [2025-09-17T20:04:42.015446] [DEBUG] [VALIDATOR ] LNC: Validating primary data. [2025-09-17T20:04:42.015719] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-03. [2025-09-17T20:04:42.440417] [DEBUG] [VALIDATOR ] LNC: All expected trading days are present. [2025-09-17T20:04:42.440576] [DEBUG] [VALIDATOR ] LNC: Primary data validation passed. [2025-09-17T20:04:42.442012] [INFO ] [MAIN ] LNC: Fetched primary data is valid. [2025-09-17T20:04:42.442082] [DEBUG] [LOCAL ] LNC: Saving primary data. [2025-09-17T20:04:42.444342] [DEBUG] [LOCAL ] LNC: Trimmed 73637 records to 51636 (keeping 200 days of data) [2025-09-17T20:04:42.779979] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T20:04:42.800624] [DEBUG] [LOCAL ] LNC: Primary data saved (51636 records). [2025-09-17T20:04:42.800901] [INFO ] [MAIN ] LNC: Full history saved. [2025-09-17T20:04:42.801050] [INFO ] [MAIN ] Update Progress: 1265/2371 symbols completed. LNC took 32.1s. Estimated remaining: 2h 41m 28s. Rate: 6.8 symbols/min [2025-09-17T20:04:42.823276] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-02. [2025-09-17T20:04:42.982145] [INFO ] [MAIN ] LOAR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:04:43.025635] [DEBUG] [LOCAL ] LOAR: Loaded 41564 existing records from primary storage. [2025-09-17T20:04:43.025863] [INFO ] [MAIN ] LOAR: Loaded 41564 existing records. [2025-09-17T20:04:43.214756] [WARN ] [MAIN ] LOAR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:04:43.215121] [INFO ] [MAIN ] LOAR: Wiping existing primary data before full refresh. [2025-09-17T20:04:43.215173] [INFO ] [LOCAL ] LOAR: Starting deletion of primary data. [2025-09-17T20:04:43.216190] [DEBUG] [LOCAL ] LOAR: Deleted primary data file. [2025-09-17T20:04:43.216245] [INFO ] [MAIN ] LOAR: Starting full primary refresh. [2025-09-17T20:04:43.606765] [INFO ] [REMOTE ] LOAR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:04:43.615744] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-11. [2025-09-17T20:04:44.415832] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-04. [2025-09-17T20:04:44.777432] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T20:04:44.834136] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T20:04:44.936829] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T20:04:45.215847] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2024-12. [2025-09-17T20:04:46.015836] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-05. [2025-09-17T20:04:46.544082] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T20:04:46.690900] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T20:04:46.815767] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-01. [2025-09-17T20:04:47.615790] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-06. [2025-09-17T20:04:47.825148] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T20:04:48.038145] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T20:04:48.415782] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-03. [2025-09-17T20:04:49.215793] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-11. [2025-09-17T20:04:50.015824] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-02. [2025-09-17T20:04:50.095176] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T20:04:50.357357] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T20:04:50.815799] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-07. [2025-09-17T20:04:51.008835] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T20:04:51.491089] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T20:04:51.615780] [INFO ] [REMOTE ] LNN: Fetching primary data for 2024-12. [2025-09-17T20:04:52.415840] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-08. [2025-09-17T20:04:52.426725] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T20:04:53.090547] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T20:04:53.215825] [INFO ] [REMOTE ] LND: Fetching primary data for 2025-09. [2025-09-17T20:04:53.573294] [INFO ] [REMOTE ] LND: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T20:04:53.577936] [INFO ] [REMOTE ] LND: Full fetch complete (8997 records). [2025-09-17T20:04:53.578044] [DEBUG] [VALIDATOR ] LND: Validating primary data. [2025-09-17T20:04:53.975943] [DEBUG] [VALIDATOR ] LND: All expected trading days are present. [2025-09-17T20:04:53.976026] [DEBUG] [VALIDATOR ] LND: Primary data validation passed. [2025-09-17T20:04:53.976304] [INFO ] [MAIN ] LND: Fetched primary data is valid. [2025-09-17T20:04:53.976365] [DEBUG] [LOCAL ] LND: Saving primary data. [2025-09-17T20:04:53.976832] [DEBUG] [LOCAL ] LND: Trimmed 8997 records to 5207 (keeping 200 days of data) [2025-09-17T20:04:54.007900] [DEBUG] [LOCAL ] LND: Primary data saved (5207 records). [2025-09-17T20:04:54.007999] [INFO ] [MAIN ] LND: Full history saved. [2025-09-17T20:04:54.008093] [INFO ] [MAIN ] Update Progress: 1266/2371 symbols completed. LND took 22.1s. Estimated remaining: 2h 41m 22s. Rate: 6.8 symbols/min [2025-09-17T20:04:54.020953] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-03. [2025-09-17T20:04:54.181625] [INFO ] [MAIN ] LOB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:04:54.210515] [DEBUG] [LOCAL ] LOB: Loaded 27355 existing records from primary storage. [2025-09-17T20:04:54.210692] [INFO ] [MAIN ] LOB: Loaded 27355 existing records. [2025-09-17T20:04:54.393960] [WARN ] [MAIN ] LOB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:04:54.394264] [INFO ] [MAIN ] LOB: Wiping existing primary data before full refresh. [2025-09-17T20:04:54.394335] [INFO ] [LOCAL ] LOB: Starting deletion of primary data. [2025-09-17T20:04:54.395114] [DEBUG] [LOCAL ] LOB: Deleted primary data file. [2025-09-17T20:04:54.395162] [INFO ] [MAIN ] LOB: Starting full primary refresh. [2025-09-17T20:04:54.752005] [INFO ] [REMOTE ] LOB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:04:54.815755] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-11. [2025-09-17T20:04:55.480738] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T20:04:55.615761] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-04. [2025-09-17T20:04:55.987325] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T20:04:56.415796] [INFO ] [REMOTE ] LOB: Fetching primary data for 2024-12. [2025-09-17T20:04:57.215794] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-01. [2025-09-17T20:04:57.404064] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T20:04:57.424882] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T20:04:58.015780] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-05. [2025-09-17T20:04:58.075421] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T20:04:58.815800] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-04. [2025-09-17T20:04:59.615806] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-01. [2025-09-17T20:04:59.810548] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T20:05:00.415754] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-02. [2025-09-17T20:05:00.654398] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T20:05:00.679770] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T20:05:01.215769] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-06. [2025-09-17T20:05:01.532218] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T20:05:02.015846] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-05. [2025-09-17T20:05:02.703679] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T20:05:02.815810] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-02. [2025-09-17T20:05:03.615814] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-07. [2025-09-17T20:05:03.661469] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T20:05:03.909960] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T20:05:04.415845] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-03. [2025-09-17T20:05:05.205805] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T20:05:05.215830] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-03. [2025-09-17T20:05:05.302586] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T20:05:06.015830] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-08. [2025-09-17T20:05:06.285451] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T20:05:06.815811] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-06. [2025-09-17T20:05:07.342186] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T20:05:07.615815] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-04. [2025-09-17T20:05:08.415829] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-04. [2025-09-17T20:05:08.615311] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T20:05:08.753175] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T20:05:09.042294] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T20:05:09.215829] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-07. [2025-09-17T20:05:10.015843] [INFO ] [REMOTE ] LOAR: Fetching primary data for 2025-09. [2025-09-17T20:05:10.776712] [INFO ] [REMOTE ] LOAR: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T20:05:10.782502] [INFO ] [REMOTE ] LOAR: Full fetch complete (56027 records). [2025-09-17T20:05:10.782690] [DEBUG] [VALIDATOR ] LOAR: Validating primary data. [2025-09-17T20:05:10.819468] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-05. [2025-09-17T20:05:11.203472] [DEBUG] [VALIDATOR ] LOAR: All expected trading days are present. [2025-09-17T20:05:11.203747] [DEBUG] [VALIDATOR ] LOAR: Primary data validation passed. [2025-09-17T20:05:11.205304] [INFO ] [MAIN ] LOAR: Fetched primary data is valid. [2025-09-17T20:05:11.205452] [DEBUG] [LOCAL ] LOAR: Saving primary data. [2025-09-17T20:05:11.238582] [DEBUG] [LOCAL ] LOAR: Trimmed 56027 records to 41556 (keeping 200 days of data) [2025-09-17T20:05:11.240862] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T20:05:11.498800] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T20:05:11.538056] [DEBUG] [LOCAL ] LOAR: Primary data saved (41556 records). [2025-09-17T20:05:11.538242] [INFO ] [MAIN ] LOAR: Full history saved. [2025-09-17T20:05:11.538354] [INFO ] [MAIN ] Update Progress: 1267/2371 symbols completed. LOAR took 28.7s. Estimated remaining: 2h 41m 20s. Rate: 6.8 symbols/min [2025-09-17T20:05:11.621134] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-06. [2025-09-17T20:05:11.736429] [INFO ] [MAIN ] LOCL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:05:11.741630] [DEBUG] [LOCAL ] LOCL: Loaded 3235 existing records from primary storage. [2025-09-17T20:05:11.741736] [INFO ] [MAIN ] LOCL: Loaded 3235 existing records. [2025-09-17T20:05:11.921570] [WARN ] [MAIN ] LOCL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:05:11.921947] [INFO ] [MAIN ] LOCL: Wiping existing primary data before full refresh. [2025-09-17T20:05:11.922010] [INFO ] [LOCAL ] LOCL: Starting deletion of primary data. [2025-09-17T20:05:11.922268] [DEBUG] [LOCAL ] LOCL: Deleted primary data file. [2025-09-17T20:05:11.922318] [INFO ] [MAIN ] LOCL: Starting full primary refresh. [2025-09-17T20:05:12.273787] [INFO ] [REMOTE ] LOCL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:05:12.415732] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-11. [2025-09-17T20:05:12.546176] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T20:05:12.854697] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T20:05:13.215790] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-07. [2025-09-17T20:05:13.906244] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T20:05:14.015789] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-08. [2025-09-17T20:05:14.815786] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-08. [2025-09-17T20:05:15.584077] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T20:05:15.615677] [INFO ] [REMOTE ] LNN: Fetching primary data for 2025-09. [2025-09-17T20:05:15.852756] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T20:05:16.199986] [INFO ] [REMOTE ] LNN: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T20:05:16.201806] [INFO ] [REMOTE ] LNN: Full fetch complete (15421 records). [2025-09-17T20:05:16.201875] [DEBUG] [VALIDATOR ] LNN: Validating primary data. [2025-09-17T20:05:16.420946] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-05. [2025-09-17T20:05:16.569952] [DEBUG] [VALIDATOR ] LNN: All expected trading days are present. [2025-09-17T20:05:16.570030] [DEBUG] [VALIDATOR ] LNN: Primary data validation passed. [2025-09-17T20:05:16.570375] [INFO ] [MAIN ] LNN: Fetched primary data is valid. [2025-09-17T20:05:16.570413] [DEBUG] [LOCAL ] LNN: Saving primary data. [2025-09-17T20:05:16.570956] [DEBUG] [LOCAL ] LNN: Trimmed 15421 records to 11224 (keeping 200 days of data) [2025-09-17T20:05:16.641572] [DEBUG] [LOCAL ] LNN: Primary data saved (11224 records). [2025-09-17T20:05:16.641730] [INFO ] [MAIN ] LNN: Full history saved. [2025-09-17T20:05:16.641817] [INFO ] [MAIN ] Update Progress: 1268/2371 symbols completed. LNN took 36.4s. Estimated remaining: 2h 41m 8s. Rate: 6.8 symbols/min [2025-09-17T20:05:16.810723] [INFO ] [MAIN ] LOMA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:05:16.846587] [DEBUG] [LOCAL ] LOMA: Loaded 31278 existing records from primary storage. [2025-09-17T20:05:16.846753] [INFO ] [MAIN ] LOMA: Loaded 31278 existing records. [2025-09-17T20:05:17.022819] [WARN ] [MAIN ] LOMA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:05:17.023077] [INFO ] [MAIN ] LOMA: Wiping existing primary data before full refresh. [2025-09-17T20:05:17.023120] [INFO ] [LOCAL ] LOMA: Starting deletion of primary data. [2025-09-17T20:05:17.024001] [DEBUG] [LOCAL ] LOMA: Deleted primary data file. [2025-09-17T20:05:17.024054] [INFO ] [MAIN ] LOMA: Starting full primary refresh. [2025-09-17T20:05:17.221381] [INFO ] [REMOTE ] LNG: Fetching primary data for 2025-09. [2025-09-17T20:05:17.390797] [INFO ] [REMOTE ] LOMA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:05:17.613132] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T20:05:17.844940] [INFO ] [REMOTE ] LNG: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T20:05:17.851534] [INFO ] [REMOTE ] LNG: Full fetch complete (74508 records). [2025-09-17T20:05:17.851687] [DEBUG] [VALIDATOR ] LNG: Validating primary data. [2025-09-17T20:05:18.025427] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-06. [2025-09-17T20:05:18.248106] [DEBUG] [VALIDATOR ] LNG: All expected trading days are present. [2025-09-17T20:05:18.248195] [DEBUG] [VALIDATOR ] LNG: Primary data validation passed. [2025-09-17T20:05:18.249181] [INFO ] [MAIN ] LNG: Fetched primary data is valid. [2025-09-17T20:05:18.249226] [DEBUG] [LOCAL ] LNG: Saving primary data. [2025-09-17T20:05:18.250921] [DEBUG] [LOCAL ] LNG: Trimmed 74508 records to 51576 (keeping 200 days of data) [2025-09-17T20:05:18.581789] [DEBUG] [LOCAL ] LNG: Primary data saved (51576 records). [2025-09-17T20:05:18.581937] [INFO ] [MAIN ] LNG: Full history saved. [2025-09-17T20:05:18.582034] [INFO ] [MAIN ] Update Progress: 1269/2371 symbols completed. LNG took 46.6s. Estimated remaining: 2h 40m 54s. Rate: 6.8 symbols/min [2025-09-17T20:05:18.751768] [INFO ] [MAIN ] LOW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:05:18.804519] [DEBUG] [LOCAL ] LOW: Loaded 52968 existing records from primary storage. [2025-09-17T20:05:18.804708] [INFO ] [MAIN ] LOW: Loaded 52968 existing records. [2025-09-17T20:05:18.825270] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-11. [2025-09-17T20:05:18.993681] [WARN ] [MAIN ] LOW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:05:18.993993] [INFO ] [MAIN ] LOW: Wiping existing primary data before full refresh. [2025-09-17T20:05:18.994675] [INFO ] [LOCAL ] LOW: Starting deletion of primary data. [2025-09-17T20:05:18.995868] [DEBUG] [LOCAL ] LOW: Deleted primary data file. [2025-09-17T20:05:18.995927] [INFO ] [MAIN ] LOW: Starting full primary refresh. [2025-09-17T20:05:19.357458] [INFO ] [REMOTE ] LOW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:05:19.371041] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T20:05:19.615773] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-11. [2025-09-17T20:05:20.147841] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T20:05:20.415792] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-07. [2025-09-17T20:05:21.215869] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2024-12. [2025-09-17T20:05:21.497044] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T20:05:21.698581] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T20:05:21.832559] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T20:05:22.015792] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-08. [2025-09-17T20:05:22.815807] [INFO ] [REMOTE ] LOW: Fetching primary data for 2024-12. [2025-09-17T20:05:23.251827] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T20:05:23.615790] [INFO ] [REMOTE ] LOB: Fetching primary data for 2025-09. [2025-09-17T20:05:24.170955] [INFO ] [REMOTE ] LOB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T20:05:24.174848] [INFO ] [REMOTE ] LOB: Full fetch complete (37175 records). [2025-09-17T20:05:24.174955] [DEBUG] [VALIDATOR ] LOB: Validating primary data. [2025-09-17T20:05:24.420883] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-01. [2025-09-17T20:05:24.563313] [DEBUG] [VALIDATOR ] LOB: All expected trading days are present. [2025-09-17T20:05:24.563398] [DEBUG] [VALIDATOR ] LOB: Primary data validation passed. [2025-09-17T20:05:24.564242] [INFO ] [MAIN ] LOB: Fetched primary data is valid. [2025-09-17T20:05:24.564292] [DEBUG] [LOCAL ] LOB: Saving primary data. [2025-09-17T20:05:24.565333] [DEBUG] [LOCAL ] LOB: Trimmed 37175 records to 27410 (keeping 200 days of data) [2025-09-17T20:05:24.738913] [DEBUG] [LOCAL ] LOB: Primary data saved (27410 records). [2025-09-17T20:05:24.739075] [INFO ] [MAIN ] LOB: Full history saved. [2025-09-17T20:05:24.739225] [INFO ] [MAIN ] Update Progress: 1270/2371 symbols completed. LOB took 30.7s. Estimated remaining: 2h 40m 43s. Rate: 6.9 symbols/min [2025-09-17T20:05:24.926902] [INFO ] [MAIN ] LPG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:05:24.930729] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T20:05:24.963905] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-17T20:05:25.016405] [DEBUG] [LOCAL ] LPG: Loaded 40564 existing records from primary storage. [2025-09-17T20:05:25.016587] [INFO ] [MAIN ] LPG: Loaded 40564 existing records. [2025-09-17T20:05:25.194604] [WARN ] [MAIN ] LPG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:05:25.194907] [INFO ] [MAIN ] LPG: Wiping existing primary data before full refresh. [2025-09-17T20:05:25.194959] [INFO ] [LOCAL ] LPG: Starting deletion of primary data. [2025-09-17T20:05:25.196002] [DEBUG] [LOCAL ] LPG: Deleted primary data file. [2025-09-17T20:05:25.196073] [INFO ] [MAIN ] LPG: Starting full primary refresh. [2025-09-17T20:05:25.225212] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2024-12. [2025-09-17T20:05:25.556864] [INFO ] [REMOTE ] LPG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:05:26.015834] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-11. [2025-09-17T20:05:26.778284] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T20:05:26.815741] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-01. [2025-09-17T20:05:27.391869] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T20:05:27.615802] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-01. [2025-09-17T20:05:28.232314] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T20:05:28.415768] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-02. [2025-09-17T20:05:28.760729] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T20:05:29.215816] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-02. [2025-09-17T20:05:29.426085] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T20:05:30.015792] [INFO ] [REMOTE ] LPG: Fetching primary data for 2024-12. [2025-09-17T20:05:30.258452] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T20:05:30.815762] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-03. [2025-09-17T20:05:31.235563] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-03 (0.42 seconds). [2025-09-17T20:05:31.576797] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T20:05:31.615732] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-01. [2025-09-17T20:05:32.415839] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-02. [2025-09-17T20:05:33.217217] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-03. [2025-09-17T20:05:33.219882] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T20:05:34.015773] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-04. [2025-09-17T20:05:34.078782] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T20:05:34.539376] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T20:05:34.795052] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T20:05:34.815738] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-05. [2025-09-17T20:05:35.253102] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T20:05:35.615801] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-03. [2025-09-17T20:05:36.415771] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-02. [2025-09-17T20:05:37.215884] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-04. [2025-09-17T20:05:37.543831] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T20:05:38.008509] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T20:05:38.016891] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-06. [2025-09-17T20:05:38.096770] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T20:05:38.509840] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T20:05:38.815775] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-03. [2025-09-17T20:05:39.615790] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-07. [2025-09-17T20:05:40.302131] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T20:05:40.340825] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T20:05:40.415744] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-04. [2025-09-17T20:05:41.215791] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-04. [2025-09-17T20:05:42.015771] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-05. [2025-09-17T20:05:42.315859] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T20:05:42.815787] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-05. [2025-09-17T20:05:42.961224] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T20:05:43.402066] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T20:05:43.615789] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-08. [2025-09-17T20:05:44.149031] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T20:05:44.394694] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T20:05:44.415741] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-06. [2025-09-17T20:05:45.215792] [INFO ] [REMOTE ] LOCL: Fetching primary data for 2025-09. [2025-09-17T20:05:45.758516] [INFO ] [REMOTE ] LOCL: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T20:05:45.759928] [INFO ] [REMOTE ] LOCL: Full fetch complete (4705 records). [2025-09-17T20:05:45.760019] [DEBUG] [VALIDATOR ] LOCL: Validating primary data. [2025-09-17T20:05:46.017672] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-05. [2025-09-17T20:05:46.156210] [DEBUG] [VALIDATOR ] LOCL: All expected trading days are present. [2025-09-17T20:05:46.169356] [DEBUG] [VALIDATOR ] LOCL: Primary data validation passed. [2025-09-17T20:05:46.177999] [INFO ] [MAIN ] LOCL: Fetched primary data is valid. [2025-09-17T20:05:46.178387] [DEBUG] [LOCAL ] LOCL: Saving primary data. [2025-09-17T20:05:46.180554] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T20:05:46.180833] [DEBUG] [LOCAL ] LOCL: Trimmed 4705 records to 3441 (keeping 200 days of data) [2025-09-17T20:05:46.212553] [DEBUG] [LOCAL ] LOCL: Primary data saved (3441 records). [2025-09-17T20:05:46.212746] [INFO ] [MAIN ] LOCL: Full history saved. [2025-09-17T20:05:46.212926] [INFO ] [MAIN ] Update Progress: 1271/2371 symbols completed. LOCL took 34.7s. Estimated remaining: 2h 40m 45s. Rate: 6.8 symbols/min [2025-09-17T20:05:46.381606] [INFO ] [MAIN ] LPL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:05:46.411580] [DEBUG] [LOCAL ] LPL: Loaded 24859 existing records from primary storage. [2025-09-17T20:05:46.411753] [INFO ] [MAIN ] LPL: Loaded 24859 existing records. [2025-09-17T20:05:46.589596] [WARN ] [MAIN ] LPL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:05:46.589894] [INFO ] [MAIN ] LPL: Wiping existing primary data before full refresh. [2025-09-17T20:05:46.589942] [INFO ] [LOCAL ] LPL: Starting deletion of primary data. [2025-09-17T20:05:46.590545] [DEBUG] [LOCAL ] LPL: Deleted primary data file. [2025-09-17T20:05:46.590601] [INFO ] [MAIN ] LPL: Starting full primary refresh. [2025-09-17T20:05:46.826504] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-06. [2025-09-17T20:05:46.956389] [INFO ] [REMOTE ] LPL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:05:47.615766] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-11. [2025-09-17T20:05:48.028112] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T20:05:48.060052] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T20:05:48.415776] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-07. [2025-09-17T20:05:48.627189] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T20:05:49.215806] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-07. [2025-09-17T20:05:49.631433] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T20:05:50.015788] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-06. [2025-09-17T20:05:50.492336] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T20:05:50.815804] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-08. [2025-09-17T20:05:51.622488] [INFO ] [REMOTE ] LPL: Fetching primary data for 2024-12. [2025-09-17T20:05:51.653268] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T20:05:52.361436] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T20:05:52.415746] [INFO ] [REMOTE ] LPG: Fetching primary data for 2025-09. [2025-09-17T20:05:52.494901] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T20:05:53.215844] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-08. [2025-09-17T20:05:53.257874] [INFO ] [REMOTE ] LPG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T20:05:53.263315] [INFO ] [REMOTE ] LPG: Full fetch complete (60089 records). [2025-09-17T20:05:53.263470] [DEBUG] [VALIDATOR ] LPG: Validating primary data. [2025-09-17T20:05:53.656152] [DEBUG] [VALIDATOR ] LPG: All expected trading days are present. [2025-09-17T20:05:53.656285] [DEBUG] [VALIDATOR ] LPG: Primary data validation passed. [2025-09-17T20:05:53.657171] [INFO ] [MAIN ] LPG: Fetched primary data is valid. [2025-09-17T20:05:53.657218] [DEBUG] [LOCAL ] LPG: Saving primary data. [2025-09-17T20:05:53.658590] [DEBUG] [LOCAL ] LPG: Trimmed 60089 records to 40417 (keeping 200 days of data) [2025-09-17T20:05:53.913431] [DEBUG] [LOCAL ] LPG: Primary data saved (40417 records). [2025-09-17T20:05:53.913562] [INFO ] [MAIN ] LPG: Full history saved. [2025-09-17T20:05:53.914816] [INFO ] [MAIN ] Update Progress: 1272/2371 symbols completed. LPG took 29.2s. Estimated remaining: 2h 40m 35s. Rate: 6.8 symbols/min [2025-09-17T20:05:54.017712] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-01. [2025-09-17T20:05:54.090310] [INFO ] [MAIN ] LPX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:05:54.136742] [DEBUG] [LOCAL ] LPX: Loaded 39706 existing records from primary storage. [2025-09-17T20:05:54.136904] [INFO ] [MAIN ] LPX: Loaded 39706 existing records. [2025-09-17T20:05:54.322993] [WARN ] [MAIN ] LPX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:05:54.323277] [INFO ] [MAIN ] LPX: Wiping existing primary data before full refresh. [2025-09-17T20:05:54.323323] [INFO ] [LOCAL ] LPX: Starting deletion of primary data. [2025-09-17T20:05:54.324220] [DEBUG] [LOCAL ] LPX: Deleted primary data file. [2025-09-17T20:05:54.324273] [INFO ] [MAIN ] LPX: Starting full primary refresh. [2025-09-17T20:05:54.694440] [INFO ] [REMOTE ] LPX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:05:54.718552] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T20:05:54.738452] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T20:05:54.815763] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-02. [2025-09-17T20:05:55.613736] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T20:05:55.617622] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-11. [2025-09-17T20:05:56.415794] [INFO ] [REMOTE ] LOMA: Fetching primary data for 2025-09. [2025-09-17T20:05:57.180034] [INFO ] [REMOTE ] LOMA: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T20:05:57.185610] [INFO ] [REMOTE ] LOMA: Full fetch complete (47934 records). [2025-09-17T20:05:57.185805] [DEBUG] [VALIDATOR ] LOMA: Validating primary data. [2025-09-17T20:05:57.220871] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-03. [2025-09-17T20:05:57.598417] [DEBUG] [VALIDATOR ] LOMA: All expected trading days are present. [2025-09-17T20:05:57.618966] [DEBUG] [VALIDATOR ] LOMA: Primary data validation passed. [2025-09-17T20:05:57.620174] [INFO ] [MAIN ] LOMA: Fetched primary data is valid. [2025-09-17T20:05:57.620452] [DEBUG] [LOCAL ] LOMA: Saving primary data. [2025-09-17T20:05:57.622423] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T20:05:57.631317] [DEBUG] [LOCAL ] LOMA: Trimmed 47934 records to 31289 (keeping 200 days of data) [2025-09-17T20:05:57.821780] [DEBUG] [LOCAL ] LOMA: Primary data saved (31289 records). [2025-09-17T20:05:57.821929] [INFO ] [MAIN ] LOMA: Full history saved. [2025-09-17T20:05:57.822046] [INFO ] [MAIN ] Update Progress: 1273/2371 symbols completed. LOMA took 41.2s. Estimated remaining: 2h 40m 22s. Rate: 6.8 symbols/min [2025-09-17T20:05:57.991848] [INFO ] [MAIN ] LRN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:05:58.015763] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-07. [2025-09-17T20:05:58.032917] [DEBUG] [LOCAL ] LRN: Loaded 40057 existing records from primary storage. [2025-09-17T20:05:58.033045] [INFO ] [MAIN ] LRN: Loaded 40057 existing records. [2025-09-17T20:05:58.217246] [WARN ] [MAIN ] LRN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:05:58.217525] [INFO ] [MAIN ] LRN: Wiping existing primary data before full refresh. [2025-09-17T20:05:58.217570] [INFO ] [LOCAL ] LRN: Starting deletion of primary data. [2025-09-17T20:05:58.218492] [DEBUG] [LOCAL ] LRN: Deleted primary data file. [2025-09-17T20:05:58.218542] [INFO ] [MAIN ] LRN: Starting full primary refresh. [2025-09-17T20:05:58.481956] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T20:05:58.588028] [INFO ] [REMOTE ] LRN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:05:58.815737] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-11. [2025-09-17T20:05:59.615831] [INFO ] [REMOTE ] LPX: Fetching primary data for 2024-12. [2025-09-17T20:06:00.011529] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T20:06:00.099292] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T20:06:00.415792] [INFO ] [REMOTE ] LRN: Fetching primary data for 2024-12. [2025-09-17T20:06:01.165728] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T20:06:01.215731] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-01. [2025-09-17T20:06:02.022567] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-08. [2025-09-17T20:06:02.028299] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T20:06:02.705560] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T20:06:02.815806] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-02. [2025-09-17T20:06:03.615784] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-04. [2025-09-17T20:06:03.985660] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T20:06:04.047916] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T20:06:04.415743] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-03. [2025-09-17T20:06:04.613233] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T20:06:05.215791] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-01. [2025-09-17T20:06:05.978090] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T20:06:06.015791] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-04. [2025-09-17T20:06:06.610347] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T20:06:06.815801] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-05. [2025-09-17T20:06:07.550225] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T20:06:07.615786] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-02. [2025-09-17T20:06:07.811060] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T20:06:08.415848] [INFO ] [REMOTE ] LOW: Fetching primary data for 2025-09. [2025-09-17T20:06:08.992549] [INFO ] [REMOTE ] LOW: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T20:06:08.999478] [INFO ] [REMOTE ] LOW: Full fetch complete (76317 records). [2025-09-17T20:06:08.999710] [DEBUG] [VALIDATOR ] LOW: Validating primary data. [2025-09-17T20:06:09.222466] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-05. [2025-09-17T20:06:09.402185] [DEBUG] [VALIDATOR ] LOW: All expected trading days are present. [2025-09-17T20:06:09.402357] [DEBUG] [VALIDATOR ] LOW: Primary data validation passed. [2025-09-17T20:06:09.403371] [INFO ] [MAIN ] LOW: Fetched primary data is valid. [2025-09-17T20:06:09.403529] [DEBUG] [LOCAL ] LOW: Saving primary data. [2025-09-17T20:06:09.426894] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T20:06:09.434742] [DEBUG] [LOCAL ] LOW: Trimmed 76317 records to 52965 (keeping 200 days of data) [2025-09-17T20:06:09.780598] [DEBUG] [LOCAL ] LOW: Primary data saved (52965 records). [2025-09-17T20:06:09.780761] [INFO ] [MAIN ] LOW: Full history saved. [2025-09-17T20:06:09.780867] [INFO ] [MAIN ] Update Progress: 1274/2371 symbols completed. LOW took 51.2s. Estimated remaining: 2h 40m 16s. Rate: 6.8 symbols/min [2025-09-17T20:06:09.953588] [INFO ] [MAIN ] LSPD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:06:09.997040] [DEBUG] [LOCAL ] LSPD: Loaded 43757 existing records from primary storage. [2025-09-17T20:06:09.997202] [INFO ] [MAIN ] LSPD: Loaded 43757 existing records. [2025-09-17T20:06:10.020875] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-06. [2025-09-17T20:06:10.181676] [WARN ] [MAIN ] LSPD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:06:10.181894] [INFO ] [MAIN ] LSPD: Wiping existing primary data before full refresh. [2025-09-17T20:06:10.181947] [INFO ] [LOCAL ] LSPD: Starting deletion of primary data. [2025-09-17T20:06:10.182683] [DEBUG] [LOCAL ] LSPD: Deleted primary data file. [2025-09-17T20:06:10.182732] [INFO ] [MAIN ] LSPD: Starting full primary refresh. [2025-09-17T20:06:10.537228] [INFO ] [REMOTE ] LSPD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:06:10.667888] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T20:06:10.815751] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-03. [2025-09-17T20:06:11.001484] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T20:06:11.615786] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-06. [2025-09-17T20:06:12.420984] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-07. [2025-09-17T20:06:12.429223] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T20:06:12.684254] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T20:06:13.215839] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-04. [2025-09-17T20:06:13.480311] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T20:06:14.015848] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-07. [2025-09-17T20:06:14.815811] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-11. [2025-09-17T20:06:14.947797] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T20:06:15.190119] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T20:06:15.615862] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-08. [2025-09-17T20:06:16.417925] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-05. [2025-09-17T20:06:16.421784] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T20:06:17.160093] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T20:06:17.215726] [INFO ] [REMOTE ] LPL: Fetching primary data for 2025-09. [2025-09-17T20:06:17.887017] [INFO ] [REMOTE ] LPL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T20:06:17.892218] [INFO ] [REMOTE ] LPL: Full fetch complete (33948 records). [2025-09-17T20:06:17.892321] [DEBUG] [VALIDATOR ] LPL: Validating primary data. [2025-09-17T20:06:18.015898] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-08. [2025-09-17T20:06:18.284191] [DEBUG] [VALIDATOR ] LPL: All expected trading days are present. [2025-09-17T20:06:18.284287] [DEBUG] [VALIDATOR ] LPL: Primary data validation passed. [2025-09-17T20:06:18.285033] [INFO ] [MAIN ] LPL: Fetched primary data is valid. [2025-09-17T20:06:18.285090] [DEBUG] [LOCAL ] LPL: Saving primary data. [2025-09-17T20:06:18.286286] [DEBUG] [LOCAL ] LPL: Trimmed 33948 records to 25017 (keeping 200 days of data) [2025-09-17T20:06:18.313542] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T20:06:18.462602] [DEBUG] [LOCAL ] LPL: Primary data saved (25017 records). [2025-09-17T20:06:18.462747] [INFO ] [MAIN ] LPL: Full history saved. [2025-09-17T20:06:18.462838] [INFO ] [MAIN ] Update Progress: 1275/2371 symbols completed. LPL took 32.2s. Estimated remaining: 2h 40m 7s. Rate: 6.8 symbols/min [2025-09-17T20:06:18.635870] [INFO ] [MAIN ] LTC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:06:18.668687] [DEBUG] [LOCAL ] LTC: Loaded 30020 existing records from primary storage. [2025-09-17T20:06:18.668845] [INFO ] [MAIN ] LTC: Loaded 30020 existing records. [2025-09-17T20:06:18.821132] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2024-12. [2025-09-17T20:06:18.850977] [WARN ] [MAIN ] LTC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:06:18.851179] [INFO ] [MAIN ] LTC: Wiping existing primary data before full refresh. [2025-09-17T20:06:18.851224] [INFO ] [LOCAL ] LTC: Starting deletion of primary data. [2025-09-17T20:06:18.851847] [DEBUG] [LOCAL ] LTC: Deleted primary data file. [2025-09-17T20:06:18.851894] [INFO ] [MAIN ] LTC: Starting full primary refresh. [2025-09-17T20:06:19.208515] [INFO ] [REMOTE ] LTC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:06:19.615830] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-06. [2025-09-17T20:06:19.746490] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T20:06:20.415709] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-11. [2025-09-17T20:06:20.444370] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T20:06:20.964576] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T20:06:21.215693] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-07. [2025-09-17T20:06:21.627218] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T20:06:22.015782] [INFO ] [REMOTE ] LTC: Fetching primary data for 2024-12. [2025-09-17T20:06:22.525040] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T20:06:22.815792] [INFO ] [REMOTE ] LPX: Fetching primary data for 2025-09. [2025-09-17T20:06:23.158037] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T20:06:23.615790] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-01. [2025-09-17T20:06:23.696326] [INFO ] [REMOTE ] LPX: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T20:06:23.701526] [INFO ] [REMOTE ] LPX: Full fetch complete (58027 records). [2025-09-17T20:06:23.701666] [DEBUG] [VALIDATOR ] LPX: Validating primary data. [2025-09-17T20:06:24.090026] [DEBUG] [VALIDATOR ] LPX: All expected trading days are present. [2025-09-17T20:06:24.090151] [DEBUG] [VALIDATOR ] LPX: Primary data validation passed. [2025-09-17T20:06:24.091017] [INFO ] [MAIN ] LPX: Fetched primary data is valid. [2025-09-17T20:06:24.091065] [DEBUG] [LOCAL ] LPX: Saving primary data. [2025-09-17T20:06:24.092470] [DEBUG] [LOCAL ] LPX: Trimmed 58027 records to 39725 (keeping 200 days of data) [2025-09-17T20:06:24.349946] [DEBUG] [LOCAL ] LPX: Primary data saved (39725 records). [2025-09-17T20:06:24.350106] [INFO ] [MAIN ] LPX: Full history saved. [2025-09-17T20:06:24.351362] [INFO ] [MAIN ] Update Progress: 1276/2371 symbols completed. LPX took 30.4s. Estimated remaining: 2h 39m 56s. Rate: 6.8 symbols/min [2025-09-17T20:06:24.420915] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-08. [2025-09-17T20:06:24.524481] [INFO ] [MAIN ] LTH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:06:24.579077] [DEBUG] [LOCAL ] LTH: Loaded 51948 existing records from primary storage. [2025-09-17T20:06:24.579239] [INFO ] [MAIN ] LTH: Loaded 51948 existing records. [2025-09-17T20:06:24.762029] [WARN ] [MAIN ] LTH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:06:24.762277] [INFO ] [MAIN ] LTH: Wiping existing primary data before full refresh. [2025-09-17T20:06:24.762323] [INFO ] [LOCAL ] LTH: Starting deletion of primary data. [2025-09-17T20:06:24.763292] [DEBUG] [LOCAL ] LTH: Deleted primary data file. [2025-09-17T20:06:24.763341] [INFO ] [MAIN ] LTH: Starting full primary refresh. [2025-09-17T20:06:25.138609] [INFO ] [REMOTE ] LTH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:06:25.157135] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T20:06:25.215778] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-02. [2025-09-17T20:06:25.727246] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T20:06:26.015778] [INFO ] [REMOTE ] LRN: Fetching primary data for 2025-09. [2025-09-17T20:06:26.518564] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T20:06:26.728699] [INFO ] [REMOTE ] LRN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T20:06:26.733974] [INFO ] [REMOTE ] LRN: Full fetch complete (58203 records). [2025-09-17T20:06:26.734088] [DEBUG] [VALIDATOR ] LRN: Validating primary data. [2025-09-17T20:06:26.820997] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-01. [2025-09-17T20:06:27.123535] [DEBUG] [VALIDATOR ] LRN: All expected trading days are present. [2025-09-17T20:06:27.123624] [DEBUG] [VALIDATOR ] LRN: Primary data validation passed. [2025-09-17T20:06:27.124570] [INFO ] [MAIN ] LRN: Fetched primary data is valid. [2025-09-17T20:06:27.124618] [DEBUG] [LOCAL ] LRN: Saving primary data. [2025-09-17T20:06:27.125865] [DEBUG] [LOCAL ] LRN: Trimmed 58203 records to 40094 (keeping 200 days of data) [2025-09-17T20:06:27.372213] [DEBUG] [LOCAL ] LRN: Primary data saved (40094 records). [2025-09-17T20:06:27.372346] [INFO ] [MAIN ] LRN: Full history saved. [2025-09-17T20:06:27.372430] [INFO ] [MAIN ] Update Progress: 1277/2371 symbols completed. LRN took 29.6s. Estimated remaining: 2h 39m 43s. Rate: 6.8 symbols/min [2025-09-17T20:06:27.615772] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-03. [2025-09-17T20:06:28.255696] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T20:06:28.415781] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-02. [2025-09-17T20:06:29.049846] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T20:06:29.215773] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-04. [2025-09-17T20:06:29.784766] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T20:06:30.015859] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-11. [2025-09-17T20:06:30.602426] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T20:06:30.815783] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-05. [2025-09-17T20:06:31.536015] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T20:06:31.615846] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-03. [2025-09-17T20:06:32.129061] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T20:06:32.415800] [INFO ] [REMOTE ] LTH: Fetching primary data for 2024-12. [2025-09-17T20:06:33.213564] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T20:06:33.223364] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-06. [2025-09-17T20:06:33.629557] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T20:06:34.015838] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-04. [2025-09-17T20:06:34.290030] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T20:06:34.815777] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-07. [2025-09-17T20:06:35.615753] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-01. [2025-09-17T20:06:35.669269] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T20:06:35.791782] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T20:06:36.415782] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-05. [2025-09-17T20:06:37.036608] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T20:06:37.215829] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-02. [2025-09-17T20:06:37.740543] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T20:06:38.015798] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-06. [2025-09-17T20:06:38.755840] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T20:06:38.815803] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-03. [2025-09-17T20:06:39.225357] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T20:06:39.615800] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-08. [2025-09-17T20:06:40.415817] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-07. [2025-09-17T20:06:40.482879] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T20:06:41.022280] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T20:06:41.215780] [INFO ] [REMOTE ] LTC: Fetching primary data for 2025-09. [2025-09-17T20:06:41.751117] [INFO ] [REMOTE ] LTC: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T20:06:41.754949] [INFO ] [REMOTE ] LTC: Full fetch complete (42633 records). [2025-09-17T20:06:41.755053] [DEBUG] [VALIDATOR ] LTC: Validating primary data. [2025-09-17T20:06:42.017541] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-04. [2025-09-17T20:06:42.144122] [DEBUG] [VALIDATOR ] LTC: All expected trading days are present. [2025-09-17T20:06:42.144223] [DEBUG] [VALIDATOR ] LTC: Primary data validation passed. [2025-09-17T20:06:42.145199] [INFO ] [MAIN ] LTC: Fetched primary data is valid. [2025-09-17T20:06:42.145265] [DEBUG] [LOCAL ] LTC: Saving primary data. [2025-09-17T20:06:42.155269] [DEBUG] [LOCAL ] LTC: Trimmed 42633 records to 29977 (keeping 200 days of data) [2025-09-17T20:06:42.173078] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T20:06:42.366783] [DEBUG] [LOCAL ] LTC: Primary data saved (29977 records). [2025-09-17T20:06:42.366925] [INFO ] [MAIN ] LTC: Full history saved. [2025-09-17T20:06:42.367013] [INFO ] [MAIN ] Update Progress: 1278/2371 symbols completed. LTC took 23.9s. Estimated remaining: 2h 39m 39s. Rate: 6.8 symbols/min [2025-09-17T20:06:42.815841] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-08. [2025-09-17T20:06:43.702658] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T20:06:43.714175] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-05. [2025-09-17T20:06:44.247759] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T20:06:44.415829] [INFO ] [REMOTE ] LSPD: Fetching primary data for 2025-09. [2025-09-17T20:06:45.088594] [INFO ] [REMOTE ] LSPD: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T20:06:45.094111] [INFO ] [REMOTE ] LSPD: Full fetch complete (61742 records). [2025-09-17T20:06:45.094229] [DEBUG] [VALIDATOR ] LSPD: Validating primary data. [2025-09-17T20:06:45.504205] [DEBUG] [VALIDATOR ] LSPD: All expected trading days are present. [2025-09-17T20:06:45.504459] [DEBUG] [VALIDATOR ] LSPD: Primary data validation passed. [2025-09-17T20:06:45.505598] [INFO ] [MAIN ] LSPD: Fetched primary data is valid. [2025-09-17T20:06:45.505793] [DEBUG] [LOCAL ] LSPD: Saving primary data. [2025-09-17T20:06:45.535320] [DEBUG] [LOCAL ] LSPD: Trimmed 61742 records to 43687 (keeping 200 days of data) [2025-09-17T20:06:45.536442] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T20:06:45.549257] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-06. [2025-09-17T20:06:45.817688] [DEBUG] [LOCAL ] LSPD: Primary data saved (43687 records). [2025-09-17T20:06:45.817844] [INFO ] [MAIN ] LSPD: Full history saved. [2025-09-17T20:06:45.817962] [INFO ] [MAIN ] Update Progress: 1279/2371 symbols completed. LSPD took 36.0s. Estimated remaining: 2h 39m 26s. Rate: 6.8 symbols/min [2025-09-17T20:06:47.263666] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T20:06:47.274441] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-07. [2025-09-17T20:06:49.022574] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T20:06:49.034248] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-08. [2025-09-17T20:06:50.550222] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T20:06:50.562719] [INFO ] [REMOTE ] LTH: Fetching primary data for 2025-09. [2025-09-17T20:06:51.136328] [INFO ] [REMOTE ] LTH: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T20:06:51.142962] [INFO ] [REMOTE ] LTH: Full fetch complete (73585 records). [2025-09-17T20:06:51.143142] [DEBUG] [VALIDATOR ] LTH: Validating primary data. [2025-09-17T20:06:51.545347] [DEBUG] [VALIDATOR ] LTH: All expected trading days are present. [2025-09-17T20:06:51.545474] [DEBUG] [VALIDATOR ] LTH: Primary data validation passed. [2025-09-17T20:06:51.547208] [INFO ] [MAIN ] LTH: Fetched primary data is valid. [2025-09-17T20:06:51.547258] [DEBUG] [LOCAL ] LTH: Saving primary data. [2025-09-17T20:06:51.549841] [DEBUG] [LOCAL ] LTH: Trimmed 73585 records to 51937 (keeping 200 days of data) [2025-09-17T20:06:51.861971] [DEBUG] [LOCAL ] LTH: Primary data saved (51937 records). [2025-09-17T20:06:51.862110] [INFO ] [MAIN ] LTH: Full history saved. [2025-09-17T20:06:51.862802] [INFO ] [MAIN ] Update Progress: 1280/2371 symbols completed. LTH took 27.5s. Estimated remaining: 2h 39m 15s. Rate: 6.9 symbols/min [2025-09-17T20:06:52.535470] [INFO ] [MAIN ] LUMN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:06:52.609109] [INFO ] [MAIN ] LU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:06:52.551442] [INFO ] [MAIN ] LUCK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:06:52.610722] [DEBUG] [LOCAL ] LUCK: No existing data file found in primary storage. [2025-09-17T20:06:52.612188] [INFO ] [MAIN ] LTM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:06:52.612715] [WARN ] [MAIN ] LUCK: No existing data found, performing full refresh instead. [2025-09-17T20:06:52.617959] [INFO ] [MAIN ] LUCK: Wiping existing primary data before full refresh. [2025-09-17T20:06:52.618035] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-17T20:06:52.618218] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-17T20:06:52.618266] [INFO ] [MAIN ] LUCK: Starting full primary refresh. [2025-09-17T20:06:52.952901] [DEBUG] [LOCAL ] LTM: Loaded 35408 existing records from primary storage. [2025-09-17T20:06:52.997560] [DEBUG] [LOCAL ] LU: Loaded 48945 existing records from primary storage. [2025-09-17T20:06:52.996830] [INFO ] [MAIN ] LTM: Loaded 35408 existing records. [2025-09-17T20:06:53.044520] [DEBUG] [LOCAL ] LUMN: Loaded 53633 existing records from primary storage. [2025-09-17T20:06:53.004117] [INFO ] [MAIN ] LU: Loaded 48945 existing records. [2025-09-17T20:06:53.076907] [INFO ] [MAIN ] LUMN: Loaded 53633 existing records. [2025-09-17T20:06:53.482542] [INFO ] [REMOTE ] LUCK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:06:53.529695] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-11. [2025-09-17T20:06:53.573128] [WARN ] [MAIN ] LTM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:06:53.632149] [INFO ] [MAIN ] LTM: Wiping existing primary data before full refresh. [2025-09-17T20:06:53.673576] [WARN ] [MAIN ] LUMN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:06:53.673455] [WARN ] [MAIN ] LU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:06:53.670632] [INFO ] [LOCAL ] LTM: Starting deletion of primary data. [2025-09-17T20:06:53.674020] [INFO ] [MAIN ] LU: Wiping existing primary data before full refresh. [2025-09-17T20:06:53.674129] [INFO ] [LOCAL ] LU: Starting deletion of primary data. [2025-09-17T20:06:53.674984] [INFO ] [MAIN ] LUMN: Wiping existing primary data before full refresh. [2025-09-17T20:06:53.675022] [DEBUG] [LOCAL ] LTM: Deleted primary data file. [2025-09-17T20:06:53.675325] [DEBUG] [LOCAL ] LU: Deleted primary data file. [2025-09-17T20:06:53.675403] [INFO ] [MAIN ] LTM: Starting full primary refresh. [2025-09-17T20:06:53.675484] [INFO ] [LOCAL ] LUMN: Starting deletion of primary data. [2025-09-17T20:06:53.675536] [INFO ] [MAIN ] LU: Starting full primary refresh. [2025-09-17T20:06:53.707296] [DEBUG] [LOCAL ] LUMN: Deleted primary data file. [2025-09-17T20:06:53.765636] [INFO ] [MAIN ] LUMN: Starting full primary refresh. [2025-09-17T20:06:53.924797] [DEBUG] [REMOTE ] LUCK: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:06:53.989054] [WARN ] [REMOTE ] LUCK: No data returned for month 2024-11 [2025-09-17T20:06:54.027429] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2024-12. [2025-09-17T20:06:54.652064] [INFO ] [REMOTE ] LU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:06:54.699159] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-11. [2025-09-17T20:06:54.822731] [INFO ] [REMOTE ] LTM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:06:54.817944] [INFO ] [REMOTE ] LUMN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:06:54.823402] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-11. [2025-09-17T20:06:54.823831] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-11. [2025-09-17T20:06:55.258836] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T20:06:55.263839] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-01. [2025-09-17T20:06:55.921304] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T20:06:55.926699] [INFO ] [REMOTE ] LTM: Fetching primary data for 2024-12. [2025-09-17T20:06:56.086463] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T20:06:56.095526] [INFO ] [REMOTE ] LU: Fetching primary data for 2024-12. [2025-09-17T20:06:56.265834] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T20:06:56.274236] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-02. [2025-09-17T20:06:56.484024] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T20:06:56.495077] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2024-12. [2025-09-17T20:06:57.059146] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T20:06:57.064221] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-01. [2025-09-17T20:06:57.406346] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T20:06:57.416313] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-01. [2025-09-17T20:06:57.440421] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T20:06:58.015815] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-03. [2025-09-17T20:06:58.148892] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T20:06:58.487615] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T20:06:58.716031] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T20:06:58.815814] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-02. [2025-09-17T20:06:59.116592] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T20:06:59.615841] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-01. [2025-09-17T20:07:00.398255] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T20:07:00.415681] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-03. [2025-09-17T20:07:01.213810] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T20:07:01.223544] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-02. [2025-09-17T20:07:02.015852] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-02. [2025-09-17T20:07:02.070242] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T20:07:02.452554] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T20:07:02.815844] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-04. [2025-09-17T20:07:03.615850] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-03. [2025-09-17T20:07:03.989948] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T20:07:04.123709] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T20:07:04.415785] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-03. [2025-09-17T20:07:05.031201] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T20:07:05.215843] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-04. [2025-09-17T20:07:06.018697] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-04. [2025-09-17T20:07:06.018428] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T20:07:06.526657] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T20:07:06.815819] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-04. [2025-09-17T20:07:07.615816] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-05. [2025-09-17T20:07:07.789081] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T20:07:08.415795] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-05. [2025-09-17T20:07:08.690396] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T20:07:08.817981] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T20:07:09.215797] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-05. [2025-09-17T20:07:10.015807] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-06. [2025-09-17T20:07:10.127750] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T20:07:10.481761] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T20:07:10.815787] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-06. [2025-09-17T20:07:11.088121] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T20:07:11.615774] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-07. [2025-09-17T20:07:12.420855] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-06. [2025-09-17T20:07:12.437796] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T20:07:13.071351] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T20:07:13.215788] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-08. [2025-09-17T20:07:13.357474] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T20:07:14.015777] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-07. [2025-09-17T20:07:14.791745] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T20:07:14.815727] [INFO ] [REMOTE ] LTM: Fetching primary data for 2025-09. [2025-09-17T20:07:15.113736] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T20:07:15.609129] [INFO ] [REMOTE ] LTM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T20:07:15.615431] [INFO ] [REMOTE ] LTM: Full fetch complete (46135 records). [2025-09-17T20:07:15.615523] [DEBUG] [VALIDATOR ] LTM: Validating primary data. [2025-09-17T20:07:15.615691] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-07. [2025-09-17T20:07:16.015404] [DEBUG] [VALIDATOR ] LTM: All expected trading days are present. [2025-09-17T20:07:16.015501] [DEBUG] [VALIDATOR ] LTM: Primary data validation passed. [2025-09-17T20:07:16.016330] [INFO ] [MAIN ] LTM: Fetched primary data is valid. [2025-09-17T20:07:16.016378] [DEBUG] [LOCAL ] LTM: Saving primary data. [2025-09-17T20:07:16.017394] [DEBUG] [LOCAL ] LTM: Trimmed 46135 records to 35608 (keeping 200 days of data) [2025-09-17T20:07:16.243738] [DEBUG] [LOCAL ] LTM: Primary data saved (35608 records). [2025-09-17T20:07:16.243900] [INFO ] [MAIN ] LTM: Full history saved. [2025-09-17T20:07:16.244005] [INFO ] [MAIN ] Update Progress: 1281/2371 symbols completed. LTM took 24.4s. Estimated remaining: 2h 39m 19s. Rate: 6.8 symbols/min [2025-09-17T20:07:16.412987] [INFO ] [MAIN ] LUV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:07:16.415831] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-08. [2025-09-17T20:07:16.463921] [DEBUG] [LOCAL ] LUV: Loaded 53688 existing records from primary storage. [2025-09-17T20:07:16.464077] [INFO ] [MAIN ] LUV: Loaded 53688 existing records. [2025-09-17T20:07:16.644360] [WARN ] [MAIN ] LUV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:07:16.644659] [INFO ] [MAIN ] LUV: Wiping existing primary data before full refresh. [2025-09-17T20:07:16.644710] [INFO ] [LOCAL ] LUV: Starting deletion of primary data. [2025-09-17T20:07:16.645984] [DEBUG] [LOCAL ] LUV: Deleted primary data file. [2025-09-17T20:07:16.646038] [INFO ] [MAIN ] LUV: Starting full primary refresh. [2025-09-17T20:07:17.004797] [INFO ] [REMOTE ] LUV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:07:17.215741] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-11. [2025-09-17T20:07:17.460860] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T20:07:17.482225] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T20:07:18.015794] [INFO ] [REMOTE ] LUCK: Fetching primary data for 2025-09. [2025-09-17T20:07:18.617690] [INFO ] [REMOTE ] LUCK: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T20:07:18.621237] [INFO ] [REMOTE ] LUCK: Full fetch complete (39437 records). [2025-09-17T20:07:18.621334] [DEBUG] [VALIDATOR ] LUCK: Validating primary data. [2025-09-17T20:07:18.815472] [WARN ] [VALIDATOR ] LUCK: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-17T20:07:18.816173] [FATAL] [MAIN ] LUCK: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:07:18.816321] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-05. [2025-09-17T20:07:18.816700] [WARN ] [MAIN ] LUCK: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:07:18.818000] [INFO ] [LOCAL ] LUCK: Starting deletion of primary data. [2025-09-17T20:07:18.818098] [DEBUG] [LOCAL ] LUCK: No primary data file found to delete. [2025-09-17T20:07:18.818142] [INFO ] [LOCAL ] LUCK: Starting deletion of derivative data. [2025-09-17T20:07:18.818205] [DEBUG] [LOCAL ] LUCK: No derivative data file found to delete. [2025-09-17T20:07:18.818304] [INFO ] [MAIN ] Update Progress: 1282/2371 symbols completed. LUCK took 27.0s. Estimated remaining: 2h 39m 5s. Rate: 6.8 symbols/min [2025-09-17T20:07:18.991357] [INFO ] [MAIN ] LUXE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:07:18.991571] [DEBUG] [LOCAL ] LUXE: No existing data file found in primary storage. [2025-09-17T20:07:18.991610] [WARN ] [MAIN ] LUXE: No existing data found, performing full refresh instead. [2025-09-17T20:07:18.991759] [INFO ] [MAIN ] LUXE: Wiping existing primary data before full refresh. [2025-09-17T20:07:18.991798] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-17T20:07:18.991836] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-17T20:07:18.991868] [INFO ] [MAIN ] LUXE: Starting full primary refresh. [2025-09-17T20:07:19.352905] [INFO ] [REMOTE ] LUXE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:07:19.415985] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-17T20:07:19.615804] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-08. [2025-09-17T20:07:20.415826] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-11. [2025-09-17T20:07:20.834558] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:07:20.834935] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-11 [2025-09-17T20:07:20.941575] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T20:07:21.171558] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T20:07:21.215736] [INFO ] [REMOTE ] LU: Fetching primary data for 2025-09. [2025-09-17T20:07:21.822070] [INFO ] [REMOTE ] LU: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T20:07:21.828766] [INFO ] [REMOTE ] LU: Full fetch complete (70286 records). [2025-09-17T20:07:21.828896] [DEBUG] [VALIDATOR ] LU: Validating primary data. [2025-09-17T20:07:22.023821] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2024-12. [2025-09-17T20:07:22.221581] [DEBUG] [VALIDATOR ] LU: All expected trading days are present. [2025-09-17T20:07:22.221685] [DEBUG] [VALIDATOR ] LU: Primary data validation passed. [2025-09-17T20:07:22.222615] [INFO ] [MAIN ] LU: Fetched primary data is valid. [2025-09-17T20:07:22.222677] [DEBUG] [LOCAL ] LU: Saving primary data. [2025-09-17T20:07:22.224200] [DEBUG] [LOCAL ] LU: Trimmed 70286 records to 48955 (keeping 200 days of data) [2025-09-17T20:07:22.326716] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:07:22.328312] [WARN ] [REMOTE ] LUXE: No data returned for month 2024-12 [2025-09-17T20:07:22.516738] [DEBUG] [LOCAL ] LU: Primary data saved (48955 records). [2025-09-17T20:07:22.516895] [INFO ] [MAIN ] LU: Full history saved. [2025-09-17T20:07:22.516999] [INFO ] [MAIN ] Update Progress: 1283/2371 symbols completed. LU took 30.7s. Estimated remaining: 2h 38m 52s. Rate: 6.8 symbols/min [2025-09-17T20:07:22.689513] [INFO ] [MAIN ] LVS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:07:22.741514] [DEBUG] [LOCAL ] LVS: Loaded 53565 existing records from primary storage. [2025-09-17T20:07:22.741729] [INFO ] [MAIN ] LVS: Loaded 53565 existing records. [2025-09-17T20:07:22.820925] [INFO ] [REMOTE ] LUV: Fetching primary data for 2024-12. [2025-09-17T20:07:22.924426] [WARN ] [MAIN ] LVS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:07:22.924684] [INFO ] [MAIN ] LVS: Wiping existing primary data before full refresh. [2025-09-17T20:07:22.924758] [INFO ] [LOCAL ] LVS: Starting deletion of primary data. [2025-09-17T20:07:22.926012] [DEBUG] [LOCAL ] LVS: Deleted primary data file. [2025-09-17T20:07:22.926064] [INFO ] [MAIN ] LVS: Starting full primary refresh. [2025-09-17T20:07:23.284686] [INFO ] [REMOTE ] LVS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:07:23.615784] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-01. [2025-09-17T20:07:23.864339] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:07:23.864700] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-01 [2025-09-17T20:07:24.415764] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-11. [2025-09-17T20:07:24.761385] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T20:07:25.215790] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-01. [2025-09-17T20:07:25.894430] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T20:07:26.015738] [INFO ] [REMOTE ] LVS: Fetching primary data for 2024-12. [2025-09-17T20:07:26.815772] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-02. [2025-09-17T20:07:26.995032] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T20:07:27.008538] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:07:27.008855] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-02 [2025-09-17T20:07:27.615771] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-06. [2025-09-17T20:07:27.880809] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T20:07:28.415776] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-03. [2025-09-17T20:07:28.607601] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:07:28.607952] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-03 [2025-09-17T20:07:29.215784] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-01. [2025-09-17T20:07:29.458309] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T20:07:30.015795] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-04. [2025-09-17T20:07:30.288878] [DEBUG] [REMOTE ] LUXE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:07:30.289276] [WARN ] [REMOTE ] LUXE: No data returned for month 2025-04 [2025-09-17T20:07:30.815791] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-05. [2025-09-17T20:07:31.012807] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T20:07:31.615792] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-02. [2025-09-17T20:07:31.898715] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T20:07:32.415852] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-07. [2025-09-17T20:07:33.215839] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-06. [2025-09-17T20:07:33.480792] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T20:07:34.015831] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-03. [2025-09-17T20:07:34.092298] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T20:07:34.328355] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T20:07:34.815808] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-07. [2025-09-17T20:07:35.481171] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T20:07:35.615815] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-08. [2025-09-17T20:07:36.000941] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T20:07:36.274535] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T20:07:36.415804] [INFO ] [REMOTE ] LUXE: Fetching primary data for 2025-09. [2025-09-17T20:07:36.979901] [INFO ] [REMOTE ] LUXE: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T20:07:36.982957] [INFO ] [REMOTE ] LUXE: Full fetch complete (12041 records). [2025-09-17T20:07:36.983054] [DEBUG] [VALIDATOR ] LUXE: Validating primary data. [2025-09-17T20:07:37.172222] [WARN ] [VALIDATOR ] LUXE: Validation failed - insufficient historical data. Have 96 unique days, need 200 days [2025-09-17T20:07:37.172486] [FATAL] [MAIN ] LUXE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:07:37.172534] [WARN ] [MAIN ] LUXE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:07:37.172578] [INFO ] [LOCAL ] LUXE: Starting deletion of primary data. [2025-09-17T20:07:37.172663] [DEBUG] [LOCAL ] LUXE: No primary data file found to delete. [2025-09-17T20:07:37.172702] [INFO ] [LOCAL ] LUXE: Starting deletion of derivative data. [2025-09-17T20:07:37.172742] [DEBUG] [LOCAL ] LUXE: No derivative data file found to delete. [2025-09-17T20:07:37.172801] [INFO ] [MAIN ] Update Progress: 1284/2371 symbols completed. LUXE took 18.4s. Estimated remaining: 2h 38m 48s. Rate: 6.8 symbols/min [2025-09-17T20:07:37.225620] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-04. [2025-09-17T20:07:37.343775] [INFO ] [MAIN ] LVWR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:07:37.360589] [DEBUG] [LOCAL ] LVWR: Loaded 16907 existing records from primary storage. [2025-09-17T20:07:37.360864] [INFO ] [MAIN ] LVWR: Loaded 16907 existing records. [2025-09-17T20:07:37.544453] [WARN ] [MAIN ] LVWR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:07:37.544775] [INFO ] [MAIN ] LVWR: Wiping existing primary data before full refresh. [2025-09-17T20:07:37.544832] [INFO ] [LOCAL ] LVWR: Starting deletion of primary data. [2025-09-17T20:07:37.545338] [DEBUG] [LOCAL ] LVWR: Deleted primary data file. [2025-09-17T20:07:37.545393] [INFO ] [MAIN ] LVWR: Starting full primary refresh. [2025-09-17T20:07:37.907882] [INFO ] [REMOTE ] LVWR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:07:38.015831] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-08. [2025-09-17T20:07:38.815802] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-02. [2025-09-17T20:07:39.240149] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T20:07:39.615758] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-11. [2025-09-17T20:07:39.699944] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T20:07:39.917417] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-11 (0.30 seconds). [2025-09-17T20:07:40.246808] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T20:07:40.415804] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2024-12. [2025-09-17T20:07:40.982363] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T20:07:41.215850] [INFO ] [REMOTE ] LUMN: Fetching primary data for 2025-09. [2025-09-17T20:07:42.015806] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-05. [2025-09-17T20:07:42.123091] [INFO ] [REMOTE ] LUMN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T20:07:42.130227] [INFO ] [REMOTE ] LUMN: Full fetch complete (77514 records). [2025-09-17T20:07:42.130417] [DEBUG] [VALIDATOR ] LUMN: Validating primary data. [2025-09-17T20:07:42.548686] [DEBUG] [VALIDATOR ] LUMN: All expected trading days are present. [2025-09-17T20:07:42.548800] [DEBUG] [VALIDATOR ] LUMN: Primary data validation passed. [2025-09-17T20:07:42.549905] [INFO ] [MAIN ] LUMN: Fetched primary data is valid. [2025-09-17T20:07:42.549966] [DEBUG] [LOCAL ] LUMN: Saving primary data. [2025-09-17T20:07:42.552742] [DEBUG] [LOCAL ] LUMN: Trimmed 77514 records to 53634 (keeping 200 days of data) [2025-09-17T20:07:42.815881] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-03. [2025-09-17T20:07:42.909253] [DEBUG] [LOCAL ] LUMN: Primary data saved (53634 records). [2025-09-17T20:07:42.909537] [INFO ] [MAIN ] LUMN: Full history saved. [2025-09-17T20:07:42.909758] [INFO ] [MAIN ] Update Progress: 1285/2371 symbols completed. LUMN took 51.0s. Estimated remaining: 2h 38m 37s. Rate: 6.8 symbols/min [2025-09-17T20:07:43.091703] [INFO ] [MAIN ] LW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:07:43.148473] [DEBUG] [LOCAL ] LW: Loaded 51336 existing records from primary storage. [2025-09-17T20:07:43.148754] [INFO ] [MAIN ] LW: Loaded 51336 existing records. [2025-09-17T20:07:43.347458] [WARN ] [MAIN ] LW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:07:43.347858] [INFO ] [MAIN ] LW: Wiping existing primary data before full refresh. [2025-09-17T20:07:43.347910] [INFO ] [LOCAL ] LW: Starting deletion of primary data. [2025-09-17T20:07:43.349274] [DEBUG] [LOCAL ] LW: Deleted primary data file. [2025-09-17T20:07:43.349335] [INFO ] [MAIN ] LW: Starting full primary refresh. [2025-09-17T20:07:43.618934] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-01. [2025-09-17T20:07:43.753918] [INFO ] [REMOTE ] LW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:07:43.801322] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T20:07:44.254518] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T20:07:44.415887] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-02. [2025-09-17T20:07:44.599951] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T20:07:44.756961] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T20:07:45.215885] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-06. [2025-09-17T20:07:46.015825] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-04. [2025-09-17T20:07:46.815774] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-03. [2025-09-17T20:07:46.882078] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T20:07:47.278427] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T20:07:47.621739] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-11. [2025-09-17T20:07:47.651035] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T20:07:48.415847] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-07. [2025-09-17T20:07:49.090868] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T20:07:49.215867] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-05. [2025-09-17T20:07:50.015868] [INFO ] [REMOTE ] LW: Fetching primary data for 2024-12. [2025-09-17T20:07:50.482321] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T20:07:50.824841] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-04. [2025-09-17T20:07:50.833207] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T20:07:51.506209] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T20:07:51.615823] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-06. [2025-09-17T20:07:51.711349] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T20:07:52.415883] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-01. [2025-09-17T20:07:53.215883] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-05. [2025-09-17T20:07:53.343104] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T20:07:53.974314] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T20:07:54.015878] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-07. [2025-09-17T20:07:54.112679] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T20:07:54.815843] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-06. [2025-09-17T20:07:55.615883] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-08. [2025-09-17T20:07:56.037684] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T20:07:56.415712] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-02. [2025-09-17T20:07:56.517859] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T20:07:57.215824] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-08. [2025-09-17T20:07:57.465623] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T20:07:57.756015] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T20:07:58.015873] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-03. [2025-09-17T20:07:58.773673] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T20:07:58.815886] [INFO ] [REMOTE ] LUV: Fetching primary data for 2025-09. [2025-09-17T20:07:59.411314] [INFO ] [REMOTE ] LUV: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T20:07:59.422004] [INFO ] [REMOTE ] LUV: Full fetch complete (77593 records). [2025-09-17T20:07:59.422270] [DEBUG] [VALIDATOR ] LUV: Validating primary data. [2025-09-17T20:07:59.622511] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-07. [2025-09-17T20:07:59.919196] [DEBUG] [VALIDATOR ] LUV: All expected trading days are present. [2025-09-17T20:07:59.919468] [DEBUG] [VALIDATOR ] LUV: Primary data validation passed. [2025-09-17T20:07:59.920927] [INFO ] [MAIN ] LUV: Fetched primary data is valid. [2025-09-17T20:07:59.921027] [DEBUG] [LOCAL ] LUV: Saving primary data. [2025-09-17T20:07:59.924676] [DEBUG] [LOCAL ] LUV: Trimmed 77593 records to 53689 (keeping 200 days of data) [2025-09-17T20:08:00.059033] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T20:08:00.332929] [DEBUG] [LOCAL ] LUV: Primary data saved (53689 records). [2025-09-17T20:08:00.333148] [INFO ] [MAIN ] LUV: Full history saved. [2025-09-17T20:08:00.333285] [INFO ] [MAIN ] Update Progress: 1286/2371 symbols completed. LUV took 44.1s. Estimated remaining: 2h 38m 36s. Rate: 6.8 symbols/min [2025-09-17T20:08:00.420940] [INFO ] [REMOTE ] LVS: Fetching primary data for 2025-09. [2025-09-17T20:08:00.520714] [INFO ] [MAIN ] LXFR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:08:00.540708] [DEBUG] [LOCAL ] LXFR: Loaded 17200 existing records from primary storage. [2025-09-17T20:08:00.540885] [INFO ] [MAIN ] LXFR: Loaded 17200 existing records. [2025-09-17T20:08:00.723113] [WARN ] [MAIN ] LXFR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:08:00.723491] [INFO ] [MAIN ] LXFR: Wiping existing primary data before full refresh. [2025-09-17T20:08:00.723541] [INFO ] [LOCAL ] LXFR: Starting deletion of primary data. [2025-09-17T20:08:00.724315] [DEBUG] [LOCAL ] LXFR: Deleted primary data file. [2025-09-17T20:08:00.724379] [INFO ] [MAIN ] LXFR: Starting full primary refresh. [2025-09-17T20:08:01.042740] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T20:08:01.119748] [INFO ] [REMOTE ] LXFR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:08:01.215696] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-08. [2025-09-17T20:08:01.701183] [INFO ] [REMOTE ] LVS: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T20:08:01.711329] [INFO ] [REMOTE ] LVS: Full fetch complete (77356 records). [2025-09-17T20:08:01.711580] [DEBUG] [VALIDATOR ] LVS: Validating primary data. [2025-09-17T20:08:02.021035] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-04. [2025-09-17T20:08:02.154038] [DEBUG] [VALIDATOR ] LVS: All expected trading days are present. [2025-09-17T20:08:02.154188] [DEBUG] [VALIDATOR ] LVS: Primary data validation passed. [2025-09-17T20:08:02.155587] [INFO ] [MAIN ] LVS: Fetched primary data is valid. [2025-09-17T20:08:02.164194] [DEBUG] [LOCAL ] LVS: Saving primary data. [2025-09-17T20:08:02.165916] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T20:08:02.170511] [DEBUG] [LOCAL ] LVS: Trimmed 77356 records to 53567 (keeping 200 days of data) [2025-09-17T20:08:02.526767] [DEBUG] [LOCAL ] LVS: Primary data saved (53567 records). [2025-09-17T20:08:02.527148] [INFO ] [MAIN ] LVS: Full history saved. [2025-09-17T20:08:02.527341] [INFO ] [MAIN ] Update Progress: 1287/2371 symbols completed. LVS took 40.0s. Estimated remaining: 2h 38m 21s. Rate: 6.8 symbols/min [2025-09-17T20:08:02.700464] [INFO ] [MAIN ] LXP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:08:02.750224] [DEBUG] [LOCAL ] LXP: Loaded 50599 existing records from primary storage. [2025-09-17T20:08:02.750382] [INFO ] [MAIN ] LXP: Loaded 50599 existing records. [2025-09-17T20:08:02.824847] [INFO ] [REMOTE ] LVWR: Fetching primary data for 2025-09. [2025-09-17T20:08:02.937313] [WARN ] [MAIN ] LXP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:08:02.937613] [INFO ] [MAIN ] LXP: Wiping existing primary data before full refresh. [2025-09-17T20:08:02.937682] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-17T20:08:02.938931] [DEBUG] [LOCAL ] LXP: Deleted primary data file. [2025-09-17T20:08:02.938984] [INFO ] [MAIN ] LXP: Starting full primary refresh. [2025-09-17T20:08:03.318751] [INFO ] [REMOTE ] LXP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:08:03.479266] [INFO ] [REMOTE ] LVWR: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T20:08:03.482574] [INFO ] [REMOTE ] LVWR: Full fetch complete (19279 records). [2025-09-17T20:08:03.482692] [DEBUG] [VALIDATOR ] LVWR: Validating primary data. [2025-09-17T20:08:03.630206] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-11. [2025-09-17T20:08:03.876319] [DEBUG] [VALIDATOR ] LVWR: All expected trading days are present. [2025-09-17T20:08:03.876445] [DEBUG] [VALIDATOR ] LVWR: Primary data validation passed. [2025-09-17T20:08:03.877165] [INFO ] [MAIN ] LVWR: Fetched primary data is valid. [2025-09-17T20:08:03.877275] [DEBUG] [LOCAL ] LVWR: Saving primary data. [2025-09-17T20:08:03.878183] [DEBUG] [LOCAL ] LVWR: Trimmed 19279 records to 17030 (keeping 200 days of data) [2025-09-17T20:08:04.020303] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T20:08:04.025790] [DEBUG] [LOCAL ] LVWR: Primary data saved (17030 records). [2025-09-17T20:08:04.037373] [INFO ] [MAIN ] LVWR: Full history saved. [2025-09-17T20:08:04.037930] [INFO ] [MAIN ] Update Progress: 1288/2371 symbols completed. LVWR took 26.9s. Estimated remaining: 2h 38m 6s. Rate: 6.8 symbols/min [2025-09-17T20:08:04.224982] [INFO ] [MAIN ] LXU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:08:04.262685] [DEBUG] [LOCAL ] LXU: Loaded 32310 existing records from primary storage. [2025-09-17T20:08:04.262831] [INFO ] [MAIN ] LXU: Loaded 32310 existing records. [2025-09-17T20:08:04.420896] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-11. [2025-09-17T20:08:04.445171] [WARN ] [MAIN ] LXU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:08:04.445458] [INFO ] [MAIN ] LXU: Wiping existing primary data before full refresh. [2025-09-17T20:08:04.445527] [INFO ] [LOCAL ] LXU: Starting deletion of primary data. [2025-09-17T20:08:04.446397] [DEBUG] [LOCAL ] LXU: Deleted primary data file. [2025-09-17T20:08:04.446449] [INFO ] [MAIN ] LXU: Starting full primary refresh. [2025-09-17T20:08:04.728659] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T20:08:04.837540] [INFO ] [REMOTE ] LXU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:08:05.215787] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-11. [2025-09-17T20:08:06.015820] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2024-12. [2025-09-17T20:08:06.050423] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T20:08:06.201319] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T20:08:06.815863] [INFO ] [REMOTE ] LXP: Fetching primary data for 2024-12. [2025-09-17T20:08:06.958442] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T20:08:07.615846] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-01. [2025-09-17T20:08:08.415787] [INFO ] [REMOTE ] LXU: Fetching primary data for 2024-12. [2025-09-17T20:08:08.485159] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T20:08:08.522110] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T20:08:09.215833] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-01. [2025-09-17T20:08:09.506426] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T20:08:10.015787] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-05. [2025-09-17T20:08:10.815815] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-01. [2025-09-17T20:08:10.879178] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T20:08:11.615770] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-02. [2025-09-17T20:08:11.776200] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T20:08:11.825762] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T20:08:12.415817] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-06. [2025-09-17T20:08:12.678899] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T20:08:13.215797] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-02. [2025-09-17T20:08:13.832752] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T20:08:14.015796] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-02. [2025-09-17T20:08:14.815806] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-03. [2025-09-17T20:08:14.849241] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T20:08:14.963238] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T20:08:15.615743] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-03. [2025-09-17T20:08:15.954946] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T20:08:16.415741] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-07. [2025-09-17T20:08:16.891826] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T20:08:17.215831] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-04. [2025-09-17T20:08:18.015689] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-04. [2025-09-17T20:08:18.272856] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T20:08:18.342277] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T20:08:18.815823] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-03. [2025-09-17T20:08:19.487983] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T20:08:19.615738] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-05. [2025-09-17T20:08:20.232820] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T20:08:20.415765] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-04. [2025-09-17T20:08:21.039033] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T20:08:21.215832] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-08. [2025-09-17T20:08:22.015748] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-05. [2025-09-17T20:08:22.122567] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T20:08:22.618860] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T20:08:22.815817] [INFO ] [REMOTE ] LW: Fetching primary data for 2025-09. [2025-09-17T20:08:23.086866] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T20:08:23.615759] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-05. [2025-09-17T20:08:23.663951] [INFO ] [REMOTE ] LW: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T20:08:23.670634] [INFO ] [REMOTE ] LW: Full fetch complete (74505 records). [2025-09-17T20:08:23.670801] [DEBUG] [VALIDATOR ] LW: Validating primary data. [2025-09-17T20:08:24.067147] [DEBUG] [VALIDATOR ] LW: All expected trading days are present. [2025-09-17T20:08:24.067359] [DEBUG] [VALIDATOR ] LW: Primary data validation passed. [2025-09-17T20:08:24.068373] [INFO ] [MAIN ] LW: Fetched primary data is valid. [2025-09-17T20:08:24.068419] [DEBUG] [LOCAL ] LW: Saving primary data. [2025-09-17T20:08:24.069909] [DEBUG] [LOCAL ] LW: Trimmed 74505 records to 51313 (keeping 200 days of data) [2025-09-17T20:08:24.383463] [DEBUG] [LOCAL ] LW: Primary data saved (51313 records). [2025-09-17T20:08:24.383607] [INFO ] [MAIN ] LW: Full history saved. [2025-09-17T20:08:24.385009] [INFO ] [MAIN ] Update Progress: 1289/2371 symbols completed. LW took 41.5s. Estimated remaining: 2h 38m 7s. Rate: 6.8 symbols/min [2025-09-17T20:08:24.416727] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-06. [2025-09-17T20:08:24.559326] [INFO ] [MAIN ] LYB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:08:24.618015] [DEBUG] [LOCAL ] LYB: Loaded 53600 existing records from primary storage. [2025-09-17T20:08:24.618168] [INFO ] [MAIN ] LYB: Loaded 53600 existing records. [2025-09-17T20:08:24.804445] [WARN ] [MAIN ] LYB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:08:24.804751] [INFO ] [MAIN ] LYB: Wiping existing primary data before full refresh. [2025-09-17T20:08:24.804799] [INFO ] [LOCAL ] LYB: Starting deletion of primary data. [2025-09-17T20:08:24.806412] [DEBUG] [LOCAL ] LYB: Deleted primary data file. [2025-09-17T20:08:24.806962] [INFO ] [MAIN ] LYB: Starting full primary refresh. [2025-09-17T20:08:25.191045] [INFO ] [REMOTE ] LYB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:08:25.215822] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-11. [2025-09-17T20:08:25.431934] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T20:08:25.906828] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T20:08:26.015766] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-07. [2025-09-17T20:08:26.815800] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-06. [2025-09-17T20:08:26.851103] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T20:08:27.121451] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T20:08:27.542279] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T20:08:27.615809] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-07. [2025-09-17T20:08:28.415810] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-08. [2025-09-17T20:08:28.674663] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T20:08:29.215784] [INFO ] [REMOTE ] LYB: Fetching primary data for 2024-12. [2025-09-17T20:08:29.467253] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T20:08:30.015787] [INFO ] [REMOTE ] LXU: Fetching primary data for 2025-09. [2025-09-17T20:08:30.511449] [INFO ] [REMOTE ] LXU: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T20:08:30.515381] [INFO ] [REMOTE ] LXU: Full fetch complete (44667 records). [2025-09-17T20:08:30.515476] [DEBUG] [VALIDATOR ] LXU: Validating primary data. [2025-09-17T20:08:30.820904] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-08. [2025-09-17T20:08:30.907566] [DEBUG] [VALIDATOR ] LXU: All expected trading days are present. [2025-09-17T20:08:30.907671] [DEBUG] [VALIDATOR ] LXU: Primary data validation passed. [2025-09-17T20:08:30.908484] [INFO ] [MAIN ] LXU: Fetched primary data is valid. [2025-09-17T20:08:30.908527] [DEBUG] [LOCAL ] LXU: Saving primary data. [2025-09-17T20:08:30.909810] [DEBUG] [LOCAL ] LXU: Trimmed 44667 records to 32285 (keeping 200 days of data) [2025-09-17T20:08:31.099631] [DEBUG] [LOCAL ] LXU: Primary data saved (32285 records). [2025-09-17T20:08:31.099796] [INFO ] [MAIN ] LXU: Full history saved. [2025-09-17T20:08:31.099886] [INFO ] [MAIN ] Update Progress: 1290/2371 symbols completed. LXU took 27.1s. Estimated remaining: 2h 37m 57s. Rate: 6.8 symbols/min [2025-09-17T20:08:31.340545] [INFO ] [MAIN ] LYG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:08:31.347042] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-17T20:08:31.412960] [DEBUG] [LOCAL ] LYG: Loaded 52953 existing records from primary storage. [2025-09-17T20:08:31.413149] [INFO ] [MAIN ] LYG: Loaded 52953 existing records. [2025-09-17T20:08:31.600436] [WARN ] [MAIN ] LYG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:08:31.601017] [INFO ] [MAIN ] LYG: Wiping existing primary data before full refresh. [2025-09-17T20:08:31.601182] [INFO ] [LOCAL ] LYG: Starting deletion of primary data. [2025-09-17T20:08:31.607395] [DEBUG] [LOCAL ] LYG: Deleted primary data file. [2025-09-17T20:08:31.613206] [INFO ] [MAIN ] LYG: Starting full primary refresh. [2025-09-17T20:08:31.625181] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-06. [2025-09-17T20:08:31.650722] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T20:08:31.983434] [INFO ] [REMOTE ] LYG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:08:32.415796] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-11. [2025-09-17T20:08:32.996015] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T20:08:33.215775] [INFO ] [REMOTE ] LXFR: Fetching primary data for 2025-09. [2025-09-17T20:08:33.772749] [INFO ] [REMOTE ] LXFR: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T20:08:33.775125] [INFO ] [REMOTE ] LXFR: Full fetch complete (25041 records). [2025-09-17T20:08:33.775204] [DEBUG] [VALIDATOR ] LXFR: Validating primary data. [2025-09-17T20:08:34.027837] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-01. [2025-09-17T20:08:34.161129] [DEBUG] [VALIDATOR ] LXFR: All expected trading days are present. [2025-09-17T20:08:34.161210] [DEBUG] [VALIDATOR ] LXFR: Primary data validation passed. [2025-09-17T20:08:34.161767] [INFO ] [MAIN ] LXFR: Fetched primary data is valid. [2025-09-17T20:08:34.161859] [DEBUG] [LOCAL ] LXFR: Saving primary data. [2025-09-17T20:08:34.162508] [DEBUG] [LOCAL ] LXFR: Trimmed 25041 records to 17168 (keeping 200 days of data) [2025-09-17T20:08:34.283456] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T20:08:34.312172] [DEBUG] [LOCAL ] LXFR: Primary data saved (17168 records). [2025-09-17T20:08:34.312296] [INFO ] [MAIN ] LXFR: Full history saved. [2025-09-17T20:08:34.312380] [INFO ] [MAIN ] Update Progress: 1291/2371 symbols completed. LXFR took 34.0s. Estimated remaining: 2h 37m 44s. Rate: 6.8 symbols/min [2025-09-17T20:08:34.481911] [INFO ] [MAIN ] LYV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:08:34.534740] [DEBUG] [LOCAL ] LYV: Loaded 51308 existing records from primary storage. [2025-09-17T20:08:34.534924] [INFO ] [MAIN ] LYV: Loaded 51308 existing records. [2025-09-17T20:08:34.717363] [WARN ] [MAIN ] LYV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:08:34.717660] [INFO ] [MAIN ] LYV: Wiping existing primary data before full refresh. [2025-09-17T20:08:34.717717] [INFO ] [LOCAL ] LYV: Starting deletion of primary data. [2025-09-17T20:08:34.719393] [DEBUG] [LOCAL ] LYV: Deleted primary data file. [2025-09-17T20:08:34.719444] [INFO ] [MAIN ] LYV: Starting full primary refresh. [2025-09-17T20:08:34.818957] [INFO ] [REMOTE ] LYG: Fetching primary data for 2024-12. [2025-09-17T20:08:35.077345] [INFO ] [REMOTE ] LYV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:08:35.615791] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-07. [2025-09-17T20:08:35.717603] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T20:08:36.342459] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T20:08:36.415806] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-02. [2025-09-17T20:08:37.215821] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-01. [2025-09-17T20:08:37.298176] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T20:08:37.691386] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T20:08:38.015833] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-03. [2025-09-17T20:08:38.815869] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-11. [2025-09-17T20:08:38.885284] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T20:08:39.626435] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-02. [2025-09-17T20:08:39.636729] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T20:08:40.415871] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-04. [2025-09-17T20:08:40.682260] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T20:08:41.030064] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T20:08:41.215843] [INFO ] [REMOTE ] LYV: Fetching primary data for 2024-12. [2025-09-17T20:08:42.015838] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-08. [2025-09-17T20:08:42.118330] [DEBUG] [REMOTE ] LXP: Error fetching primary data for 2025-08: 'API call returned an empty response.' [2025-09-17T20:08:42.118805] [WARN ] [REMOTE ] LXP: No data returned for month 2025-08 [2025-09-17T20:08:42.399304] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T20:08:42.672688] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T20:08:42.815827] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-03. [2025-09-17T20:08:43.615831] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-01. [2025-09-17T20:08:44.415843] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-05. [2025-09-17T20:08:44.689307] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T20:08:44.979672] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T20:08:45.215832] [INFO ] [REMOTE ] LXP: Fetching primary data for 2025-09. [2025-09-17T20:08:45.864635] [INFO ] [REMOTE ] LXP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T20:08:45.873774] [INFO ] [REMOTE ] LXP: Full fetch complete (64293 records). [2025-09-17T20:08:45.873976] [DEBUG] [VALIDATOR ] LXP: Validating primary data. [2025-09-17T20:08:46.019053] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-04. [2025-09-17T20:08:46.111393] [WARN ] [VALIDATOR ] LXP: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T20:08:46.113083] [FATAL] [MAIN ] LXP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:08:46.113238] [WARN ] [MAIN ] LXP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:08:46.113333] [INFO ] [LOCAL ] LXP: Starting deletion of primary data. [2025-09-17T20:08:46.113414] [DEBUG] [LOCAL ] LXP: No primary data file found to delete. [2025-09-17T20:08:46.113464] [INFO ] [LOCAL ] LXP: Starting deletion of derivative data. [2025-09-17T20:08:46.113961] [DEBUG] [LOCAL ] LXP: Deleted derivative data file. [2025-09-17T20:08:46.114110] [INFO ] [MAIN ] Update Progress: 1292/2371 symbols completed. LXP took 43.6s. Estimated remaining: 2h 37m 37s. Rate: 6.8 symbols/min [2025-09-17T20:08:46.289306] [INFO ] [MAIN ] LZB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:08:46.330799] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T20:08:46.372558] [DEBUG] [LOCAL ] LZB: Loaded 35468 existing records from primary storage. [2025-09-17T20:08:46.372758] [INFO ] [MAIN ] LZB: Loaded 35468 existing records. [2025-09-17T20:08:46.552183] [WARN ] [MAIN ] LZB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:08:46.552458] [INFO ] [MAIN ] LZB: Wiping existing primary data before full refresh. [2025-09-17T20:08:46.552505] [INFO ] [LOCAL ] LZB: Starting deletion of primary data. [2025-09-17T20:08:46.553379] [DEBUG] [LOCAL ] LZB: Deleted primary data file. [2025-09-17T20:08:46.553431] [INFO ] [MAIN ] LZB: Starting full primary refresh. [2025-09-17T20:08:46.821031] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-06. [2025-09-17T20:08:46.921791] [INFO ] [REMOTE ] LZB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:08:47.615885] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-11. [2025-09-17T20:08:48.019990] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T20:08:48.415846] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-05. [2025-09-17T20:08:48.584448] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T20:08:48.747186] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T20:08:49.215828] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-02. [2025-09-17T20:08:50.015781] [INFO ] [REMOTE ] LZB: Fetching primary data for 2024-12. [2025-09-17T20:08:50.202098] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T20:08:50.815770] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-06. [2025-09-17T20:08:50.930947] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T20:08:50.956942] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T20:08:51.615793] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-01. [2025-09-17T20:08:52.415832] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-07. [2025-09-17T20:08:52.483122] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T20:08:52.708230] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T20:08:53.215793] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-02. [2025-09-17T20:08:54.015814] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-07. [2025-09-17T20:08:54.431278] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T20:08:54.579909] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T20:08:54.815782] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-03. [2025-09-17T20:08:55.599842] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T20:08:55.615729] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-08. [2025-09-17T20:08:55.843009] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T20:08:56.415841] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-08. [2025-09-17T20:08:57.215773] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-03. [2025-09-17T20:08:57.256176] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T20:08:58.015768] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-04. [2025-09-17T20:08:58.488402] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T20:08:58.815813] [INFO ] [REMOTE ] LYB: Fetching primary data for 2025-09. [2025-09-17T20:08:59.089851] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T20:08:59.249737] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T20:08:59.616082] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-04. [2025-09-17T20:08:59.624588] [INFO ] [REMOTE ] LYB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T20:08:59.631938] [INFO ] [REMOTE ] LYB: Full fetch complete (77283 records). [2025-09-17T20:08:59.632075] [DEBUG] [VALIDATOR ] LYB: Validating primary data. [2025-09-17T20:09:00.032274] [DEBUG] [VALIDATOR ] LYB: All expected trading days are present. [2025-09-17T20:09:00.032364] [DEBUG] [VALIDATOR ] LYB: Primary data validation passed. [2025-09-17T20:09:00.033631] [INFO ] [MAIN ] LYB: Fetched primary data is valid. [2025-09-17T20:09:00.033709] [DEBUG] [LOCAL ] LYB: Saving primary data. [2025-09-17T20:09:00.035255] [DEBUG] [LOCAL ] LYB: Trimmed 77283 records to 53600 (keeping 200 days of data) [2025-09-17T20:09:00.391224] [DEBUG] [LOCAL ] LYB: Primary data saved (53600 records). [2025-09-17T20:09:00.391444] [INFO ] [MAIN ] LYB: Full history saved. [2025-09-17T20:09:00.392511] [INFO ] [MAIN ] Update Progress: 1293/2371 symbols completed. LYB took 36.0s. Estimated remaining: 2h 37m 33s. Rate: 6.8 symbols/min [2025-09-17T20:09:00.425101] [INFO ] [REMOTE ] LYG: Fetching primary data for 2025-09. [2025-09-17T20:09:00.573426] [INFO ] [MAIN ] LZM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:09:00.590822] [DEBUG] [LOCAL ] LZM: Loaded 13293 existing records from primary storage. [2025-09-17T20:09:00.591030] [INFO ] [MAIN ] LZM: Loaded 13293 existing records. [2025-09-17T20:09:00.780456] [WARN ] [MAIN ] LZM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:09:00.780824] [INFO ] [MAIN ] LZM: Wiping existing primary data before full refresh. [2025-09-17T20:09:00.780874] [INFO ] [LOCAL ] LZM: Starting deletion of primary data. [2025-09-17T20:09:00.781334] [DEBUG] [LOCAL ] LZM: Deleted primary data file. [2025-09-17T20:09:00.781383] [INFO ] [MAIN ] LZM: Starting full primary refresh. [2025-09-17T20:09:01.150767] [INFO ] [REMOTE ] LZM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:09:01.215780] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-11. [2025-09-17T20:09:01.444552] [INFO ] [REMOTE ] LYG: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T20:09:01.451836] [INFO ] [REMOTE ] LYG: Full fetch complete (75916 records). [2025-09-17T20:09:01.452005] [DEBUG] [VALIDATOR ] LYG: Validating primary data. [2025-09-17T20:09:01.888007] [DEBUG] [VALIDATOR ] LYG: All expected trading days are present. [2025-09-17T20:09:01.888255] [DEBUG] [VALIDATOR ] LYG: Primary data validation passed. [2025-09-17T20:09:01.889396] [INFO ] [MAIN ] LYG: Fetched primary data is valid. [2025-09-17T20:09:01.889480] [DEBUG] [LOCAL ] LYG: Saving primary data. [2025-09-17T20:09:01.898384] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T20:09:01.903385] [DEBUG] [LOCAL ] LYG: Trimmed 75916 records to 52937 (keeping 200 days of data) [2025-09-17T20:09:02.024123] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-05. [2025-09-17T20:09:02.051470] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-17T20:09:02.302302] [DEBUG] [LOCAL ] LYG: Primary data saved (52937 records). [2025-09-17T20:09:02.302530] [INFO ] [MAIN ] LYG: Full history saved. [2025-09-17T20:09:02.302661] [INFO ] [MAIN ] Update Progress: 1294/2371 symbols completed. LYG took 31.2s. Estimated remaining: 2h 37m 19s. Rate: 6.8 symbols/min [2025-09-17T20:09:02.492165] [INFO ] [MAIN ] M: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:09:02.551221] [DEBUG] [LOCAL ] M: Loaded 53536 existing records from primary storage. [2025-09-17T20:09:02.551432] [INFO ] [MAIN ] M: Loaded 53536 existing records. [2025-09-17T20:09:02.739253] [WARN ] [MAIN ] M: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:09:02.739635] [INFO ] [MAIN ] M: Wiping existing primary data before full refresh. [2025-09-17T20:09:02.739714] [INFO ] [LOCAL ] M: Starting deletion of primary data. [2025-09-17T20:09:02.740987] [DEBUG] [LOCAL ] M: Deleted primary data file. [2025-09-17T20:09:02.741052] [INFO ] [MAIN ] M: Starting full primary refresh. [2025-09-17T20:09:02.820969] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-05. [2025-09-17T20:09:03.118025] [INFO ] [REMOTE ] M: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:09:03.389636] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T20:09:03.615848] [INFO ] [REMOTE ] LZM: Fetching primary data for 2024-12. [2025-09-17T20:09:04.396099] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T20:09:04.415794] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-01. [2025-09-17T20:09:04.839342] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T20:09:05.156541] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T20:09:05.215865] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-06. [2025-09-17T20:09:06.015825] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-02. [2025-09-17T20:09:06.626264] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T20:09:06.629198] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T20:09:06.815830] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-03. [2025-09-17T20:09:07.615824] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-07. [2025-09-17T20:09:07.717428] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T20:09:08.415851] [INFO ] [REMOTE ] M: Fetching primary data for 2024-11. [2025-09-17T20:09:09.050102] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T20:09:09.215816] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-04. [2025-09-17T20:09:10.015808] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-08. [2025-09-17T20:09:10.209429] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T20:09:10.285337] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T20:09:10.815793] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-06. [2025-09-17T20:09:11.216867] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T20:09:11.615801] [INFO ] [REMOTE ] M: Fetching primary data for 2024-12. [2025-09-17T20:09:12.415915] [INFO ] [REMOTE ] LZB: Fetching primary data for 2025-09. [2025-09-17T20:09:12.687816] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T20:09:13.140674] [INFO ] [REMOTE ] LZB: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T20:09:13.145829] [INFO ] [REMOTE ] LZB: Full fetch complete (49935 records). [2025-09-17T20:09:13.145945] [DEBUG] [VALIDATOR ] LZB: Validating primary data. [2025-09-17T20:09:13.221994] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-07. [2025-09-17T20:09:13.559468] [DEBUG] [VALIDATOR ] LZB: All expected trading days are present. [2025-09-17T20:09:13.559727] [DEBUG] [VALIDATOR ] LZB: Primary data validation passed. [2025-09-17T20:09:13.561027] [INFO ] [MAIN ] LZB: Fetched primary data is valid. [2025-09-17T20:09:13.561106] [DEBUG] [LOCAL ] LZB: Saving primary data. [2025-09-17T20:09:13.562730] [DEBUG] [LOCAL ] LZB: Trimmed 49935 records to 35504 (keeping 200 days of data) [2025-09-17T20:09:13.693669] [INFO ] [REMOTE ] M: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T20:09:13.840968] [DEBUG] [LOCAL ] LZB: Primary data saved (35504 records). [2025-09-17T20:09:13.841183] [INFO ] [MAIN ] LZB: Full history saved. [2025-09-17T20:09:13.841291] [INFO ] [MAIN ] Update Progress: 1295/2371 symbols completed. LZB took 27.7s. Estimated remaining: 2h 37m 12s. Rate: 6.8 symbols/min [2025-09-17T20:09:14.015881] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-05. [2025-09-17T20:09:14.018024] [INFO ] [MAIN ] MA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:09:14.079439] [DEBUG] [LOCAL ] MA: Loaded 52594 existing records from primary storage. [2025-09-17T20:09:14.079660] [INFO ] [MAIN ] MA: Loaded 52594 existing records. [2025-09-17T20:09:14.275593] [WARN ] [MAIN ] MA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:09:14.276076] [INFO ] [MAIN ] MA: Wiping existing primary data before full refresh. [2025-09-17T20:09:14.276144] [INFO ] [LOCAL ] MA: Starting deletion of primary data. [2025-09-17T20:09:14.277713] [DEBUG] [LOCAL ] MA: Deleted primary data file. [2025-09-17T20:09:14.277793] [INFO ] [MAIN ] MA: Starting full primary refresh. [2025-09-17T20:09:14.657093] [INFO ] [REMOTE ] MA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:09:14.815790] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-11. [2025-09-17T20:09:14.852438] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T20:09:15.009869] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T20:09:15.615775] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-06. [2025-09-17T20:09:16.268386] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T20:09:16.415776] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-07. [2025-09-17T20:09:16.619701] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T20:09:16.977101] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T20:09:17.215763] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-08. [2025-09-17T20:09:18.015782] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-08. [2025-09-17T20:09:18.082278] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T20:09:18.815771] [INFO ] [REMOTE ] LZM: Fetching primary data for 2025-09. [2025-09-17T20:09:19.374057] [INFO ] [REMOTE ] LZM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T20:09:19.376797] [INFO ] [REMOTE ] LZM: Full fetch complete (17556 records). [2025-09-17T20:09:19.376869] [DEBUG] [VALIDATOR ] LZM: Validating primary data. [2025-09-17T20:09:19.622329] [INFO ] [REMOTE ] M: Fetching primary data for 2025-01. [2025-09-17T20:09:19.761769] [DEBUG] [VALIDATOR ] LZM: All expected trading days are present. [2025-09-17T20:09:19.761991] [DEBUG] [VALIDATOR ] LZM: Primary data validation passed. [2025-09-17T20:09:19.762708] [INFO ] [MAIN ] LZM: Fetched primary data is valid. [2025-09-17T20:09:19.762774] [DEBUG] [LOCAL ] LZM: Saving primary data. [2025-09-17T20:09:19.763597] [DEBUG] [LOCAL ] LZM: Trimmed 17556 records to 13420 (keeping 200 days of data) [2025-09-17T20:09:19.850477] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T20:09:19.881688] [DEBUG] [LOCAL ] LZM: Primary data saved (13420 records). [2025-09-17T20:09:19.881833] [INFO ] [MAIN ] LZM: Full history saved. [2025-09-17T20:09:19.881937] [INFO ] [MAIN ] Update Progress: 1296/2371 symbols completed. LZM took 19.5s. Estimated remaining: 2h 37m 1s. Rate: 6.8 symbols/min [2025-09-17T20:09:20.057988] [INFO ] [MAIN ] MAA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:09:20.103454] [DEBUG] [LOCAL ] MAA: Loaded 43055 existing records from primary storage. [2025-09-17T20:09:20.103619] [INFO ] [MAIN ] MAA: Loaded 43055 existing records. [2025-09-17T20:09:20.287057] [WARN ] [MAIN ] MAA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:09:20.287337] [INFO ] [MAIN ] MAA: Wiping existing primary data before full refresh. [2025-09-17T20:09:20.287383] [INFO ] [LOCAL ] MAA: Starting deletion of primary data. [2025-09-17T20:09:20.288262] [DEBUG] [LOCAL ] MAA: Deleted primary data file. [2025-09-17T20:09:20.288318] [INFO ] [MAIN ] MAA: Starting full primary refresh. [2025-09-17T20:09:20.420972] [INFO ] [REMOTE ] MA: Fetching primary data for 2024-12. [2025-09-17T20:09:20.661991] [INFO ] [REMOTE ] MAA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:09:21.215786] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-11. [2025-09-17T20:09:21.627097] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T20:09:22.015845] [INFO ] [REMOTE ] M: Fetching primary data for 2025-02. [2025-09-17T20:09:22.305373] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T20:09:22.471630] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-17T20:09:22.815768] [INFO ] [REMOTE ] MAA: Fetching primary data for 2024-12. [2025-09-17T20:09:23.615785] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-01. [2025-09-17T20:09:23.823524] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T20:09:24.295784] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T20:09:24.415836] [INFO ] [REMOTE ] M: Fetching primary data for 2025-03. [2025-09-17T20:09:25.215848] [INFO ] [REMOTE ] LYV: Fetching primary data for 2025-09. [2025-09-17T20:09:25.308983] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T20:09:25.939381] [INFO ] [REMOTE ] LYV: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T20:09:25.946450] [INFO ] [REMOTE ] LYV: Full fetch complete (73571 records). [2025-09-17T20:09:25.946731] [DEBUG] [VALIDATOR ] LYV: Validating primary data. [2025-09-17T20:09:26.023867] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-02. [2025-09-17T20:09:26.354149] [DEBUG] [VALIDATOR ] LYV: All expected trading days are present. [2025-09-17T20:09:26.354316] [DEBUG] [VALIDATOR ] LYV: Primary data validation passed. [2025-09-17T20:09:26.355427] [INFO ] [MAIN ] LYV: Fetched primary data is valid. [2025-09-17T20:09:26.355495] [DEBUG] [LOCAL ] LYV: Saving primary data. [2025-09-17T20:09:26.357134] [DEBUG] [LOCAL ] LYV: Trimmed 73571 records to 51304 (keeping 200 days of data) [2025-09-17T20:09:26.537132] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T20:09:26.751954] [DEBUG] [LOCAL ] LYV: Primary data saved (51304 records). [2025-09-17T20:09:26.752167] [INFO ] [MAIN ] LYV: Full history saved. [2025-09-17T20:09:26.752289] [INFO ] [MAIN ] Update Progress: 1297/2371 symbols completed. LYV took 52.4s. Estimated remaining: 2h 36m 51s. Rate: 6.8 symbols/min [2025-09-17T20:09:26.820943] [INFO ] [REMOTE ] M: Fetching primary data for 2025-04. [2025-09-17T20:09:26.930830] [INFO ] [MAIN ] MAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:09:26.981204] [DEBUG] [LOCAL ] MAC: Loaded 49787 existing records from primary storage. [2025-09-17T20:09:26.981394] [INFO ] [MAIN ] MAC: Loaded 49787 existing records. [2025-09-17T20:09:27.160710] [WARN ] [MAIN ] MAC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:09:27.161065] [INFO ] [MAIN ] MAC: Wiping existing primary data before full refresh. [2025-09-17T20:09:27.161114] [INFO ] [LOCAL ] MAC: Starting deletion of primary data. [2025-09-17T20:09:27.162141] [DEBUG] [LOCAL ] MAC: Deleted primary data file. [2025-09-17T20:09:27.162191] [INFO ] [MAIN ] MAC: Starting full primary refresh. [2025-09-17T20:09:27.534729] [INFO ] [REMOTE ] MAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:09:27.615741] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-11. [2025-09-17T20:09:27.917082] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T20:09:28.415892] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-03. [2025-09-17T20:09:28.815577] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T20:09:29.215873] [INFO ] [REMOTE ] M: Fetching primary data for 2025-05. [2025-09-17T20:09:29.377393] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T20:09:30.015801] [INFO ] [REMOTE ] MAC: Fetching primary data for 2024-12. [2025-09-17T20:09:30.243195] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T20:09:30.815842] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-04. [2025-09-17T20:09:31.191834] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T20:09:31.318298] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T20:09:31.615773] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-01. [2025-09-17T20:09:32.415759] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-01. [2025-09-17T20:09:32.980069] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-17T20:09:33.157372] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T20:09:33.215806] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-05. [2025-09-17T20:09:33.538559] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T20:09:34.015783] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-02. [2025-09-17T20:09:34.815785] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-02. [2025-09-17T20:09:35.247788] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T20:09:35.615833] [INFO ] [REMOTE ] M: Fetching primary data for 2025-06. [2025-09-17T20:09:35.651431] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T20:09:35.935983] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T20:09:36.415830] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-06. [2025-09-17T20:09:37.122804] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T20:09:37.215752] [INFO ] [REMOTE ] M: Fetching primary data for 2025-07. [2025-09-17T20:09:38.015800] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-03. [2025-09-17T20:09:38.480698] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T20:09:38.815900] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-07. [2025-09-17T20:09:39.075339] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T20:09:39.529505] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T20:09:39.615832] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-04. [2025-09-17T20:09:40.415869] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-03. [2025-09-17T20:09:40.669561] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T20:09:41.215834] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-08. [2025-09-17T20:09:41.433381] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T20:09:41.758087] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T20:09:42.015843] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-04. [2025-09-17T20:09:42.815825] [INFO ] [REMOTE ] M: Fetching primary data for 2025-08. [2025-09-17T20:09:42.956425] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T20:09:43.581109] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T20:09:43.615758] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-05. [2025-09-17T20:09:44.415827] [INFO ] [REMOTE ] MA: Fetching primary data for 2025-09. [2025-09-17T20:09:44.761445] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T20:09:45.157669] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T20:09:45.215728] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-06. [2025-09-17T20:09:45.235697] [INFO ] [REMOTE ] MA: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T20:09:45.242408] [INFO ] [REMOTE ] MA: Full fetch complete (76138 records). [2025-09-17T20:09:45.242536] [DEBUG] [VALIDATOR ] MA: Validating primary data. [2025-09-17T20:09:45.636506] [DEBUG] [VALIDATOR ] MA: All expected trading days are present. [2025-09-17T20:09:45.636596] [DEBUG] [VALIDATOR ] MA: Primary data validation passed. [2025-09-17T20:09:45.637631] [INFO ] [MAIN ] MA: Fetched primary data is valid. [2025-09-17T20:09:45.637691] [DEBUG] [LOCAL ] MA: Saving primary data. [2025-09-17T20:09:45.639282] [DEBUG] [LOCAL ] MA: Trimmed 76138 records to 52595 (keeping 200 days of data) [2025-09-17T20:09:45.992530] [DEBUG] [LOCAL ] MA: Primary data saved (52595 records). [2025-09-17T20:09:45.992703] [INFO ] [MAIN ] MA: Full history saved. [2025-09-17T20:09:45.992804] [INFO ] [MAIN ] Update Progress: 1298/2371 symbols completed. MA took 32.2s. Estimated remaining: 2h 36m 51s. Rate: 6.8 symbols/min [2025-09-17T20:09:46.022438] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-05. [2025-09-17T20:09:46.165404] [INFO ] [MAIN ] MAGN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:09:46.202715] [DEBUG] [LOCAL ] MAGN: Loaded 35005 existing records from primary storage. [2025-09-17T20:09:46.202904] [INFO ] [MAIN ] MAGN: Loaded 35005 existing records. [2025-09-17T20:09:46.384189] [WARN ] [MAIN ] MAGN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:09:46.384441] [INFO ] [MAIN ] MAGN: Wiping existing primary data before full refresh. [2025-09-17T20:09:46.384493] [INFO ] [LOCAL ] MAGN: Starting deletion of primary data. [2025-09-17T20:09:46.385383] [DEBUG] [LOCAL ] MAGN: Deleted primary data file. [2025-09-17T20:09:46.385442] [INFO ] [MAIN ] MAGN: Starting full primary refresh. [2025-09-17T20:09:46.761582] [INFO ] [REMOTE ] MAGN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:09:46.814744] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T20:09:46.823333] [INFO ] [REMOTE ] M: Fetching primary data for 2025-09. [2025-09-17T20:09:47.533830] [INFO ] [REMOTE ] M: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T20:09:47.542281] [INFO ] [REMOTE ] M: Full fetch complete (77368 records). [2025-09-17T20:09:47.542493] [DEBUG] [VALIDATOR ] M: Validating primary data. [2025-09-17T20:09:47.617066] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-07. [2025-09-17T20:09:47.909210] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T20:09:48.030876] [DEBUG] [VALIDATOR ] M: All expected trading days are present. [2025-09-17T20:09:48.031001] [DEBUG] [VALIDATOR ] M: Primary data validation passed. [2025-09-17T20:09:48.032408] [INFO ] [MAIN ] M: Fetched primary data is valid. [2025-09-17T20:09:48.032479] [DEBUG] [LOCAL ] M: Saving primary data. [2025-09-17T20:09:48.035005] [DEBUG] [LOCAL ] M: Trimmed 77368 records to 53536 (keeping 200 days of data) [2025-09-17T20:09:48.402531] [DEBUG] [LOCAL ] M: Primary data saved (53536 records). [2025-09-17T20:09:48.402985] [INFO ] [MAIN ] M: Full history saved. [2025-09-17T20:09:48.403380] [INFO ] [MAIN ] Update Progress: 1299/2371 symbols completed. M took 46.1s. Estimated remaining: 2h 36m 37s. Rate: 6.8 symbols/min [2025-09-17T20:09:48.421007] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-11. [2025-09-17T20:09:48.600358] [INFO ] [MAIN ] MAIN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:09:48.654445] [DEBUG] [LOCAL ] MAIN: Loaded 41397 existing records from primary storage. [2025-09-17T20:09:48.654712] [INFO ] [MAIN ] MAIN: Loaded 41397 existing records. [2025-09-17T20:09:48.844952] [WARN ] [MAIN ] MAIN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:09:48.845391] [INFO ] [MAIN ] MAIN: Wiping existing primary data before full refresh. [2025-09-17T20:09:48.845490] [INFO ] [LOCAL ] MAIN: Starting deletion of primary data. [2025-09-17T20:09:48.846490] [DEBUG] [LOCAL ] MAIN: Deleted primary data file. [2025-09-17T20:09:48.846562] [INFO ] [MAIN ] MAIN: Starting full primary refresh. [2025-09-17T20:09:49.217833] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-06. [2025-09-17T20:09:49.241348] [INFO ] [REMOTE ] MAIN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:09:49.314077] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T20:09:49.942724] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T20:09:50.015802] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-08. [2025-09-17T20:09:50.429600] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T20:09:50.815840] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-07. [2025-09-17T20:09:51.560049] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T20:09:51.615810] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2024-12. [2025-09-17T20:09:52.427382] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-11. [2025-09-17T20:09:52.467802] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T20:09:52.636934] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T20:09:53.215814] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-08. [2025-09-17T20:09:54.015850] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-01. [2025-09-17T20:09:54.153248] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T20:09:54.815821] [INFO ] [REMOTE ] MAA: Fetching primary data for 2025-09. [2025-09-17T20:09:54.856047] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T20:09:55.424876] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T20:09:55.528753] [INFO ] [REMOTE ] MAA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T20:09:55.535983] [INFO ] [REMOTE ] MAA: Full fetch complete (60979 records). [2025-09-17T20:09:55.536166] [DEBUG] [VALIDATOR ] MAA: Validating primary data. [2025-09-17T20:09:55.621045] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-02. [2025-09-17T20:09:55.949401] [DEBUG] [VALIDATOR ] MAA: All expected trading days are present. [2025-09-17T20:09:55.949536] [DEBUG] [VALIDATOR ] MAA: Primary data validation passed. [2025-09-17T20:09:55.950792] [INFO ] [MAIN ] MAA: Fetched primary data is valid. [2025-09-17T20:09:55.950857] [DEBUG] [LOCAL ] MAA: Saving primary data. [2025-09-17T20:09:55.952819] [DEBUG] [LOCAL ] MAA: Trimmed 60979 records to 43047 (keeping 200 days of data) [2025-09-17T20:09:56.252028] [DEBUG] [LOCAL ] MAA: Primary data saved (43047 records). [2025-09-17T20:09:56.252212] [INFO ] [MAIN ] MAA: Full history saved. [2025-09-17T20:09:56.253595] [INFO ] [MAIN ] Update Progress: 1300/2371 symbols completed. MAA took 36.4s. Estimated remaining: 2h 36m 27s. Rate: 6.8 symbols/min [2025-09-17T20:09:56.431088] [INFO ] [REMOTE ] MAC: Fetching primary data for 2025-09. [2025-09-17T20:09:56.435131] [INFO ] [MAIN ] MAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:09:56.493069] [DEBUG] [LOCAL ] MAN: Loaded 43736 existing records from primary storage. [2025-09-17T20:09:56.493269] [INFO ] [MAIN ] MAN: Loaded 43736 existing records. [2025-09-17T20:09:56.692520] [WARN ] [MAIN ] MAN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:09:56.692880] [INFO ] [MAIN ] MAN: Wiping existing primary data before full refresh. [2025-09-17T20:09:56.692930] [INFO ] [LOCAL ] MAN: Starting deletion of primary data. [2025-09-17T20:09:56.694034] [DEBUG] [LOCAL ] MAN: Deleted primary data file. [2025-09-17T20:09:56.694102] [INFO ] [MAIN ] MAN: Starting full primary refresh. [2025-09-17T20:09:57.157229] [INFO ] [REMOTE ] MAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:09:57.203525] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T20:09:57.210452] [INFO ] [REMOTE ] MAC: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T20:09:57.222521] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2024-12. [2025-09-17T20:09:57.225819] [INFO ] [REMOTE ] MAC: Full fetch complete (71400 records). [2025-09-17T20:09:57.226087] [DEBUG] [VALIDATOR ] MAC: Validating primary data. [2025-09-17T20:09:57.644416] [DEBUG] [VALIDATOR ] MAC: All expected trading days are present. [2025-09-17T20:09:57.644546] [DEBUG] [VALIDATOR ] MAC: Primary data validation passed. [2025-09-17T20:09:57.645710] [INFO ] [MAIN ] MAC: Fetched primary data is valid. [2025-09-17T20:09:57.645822] [DEBUG] [LOCAL ] MAC: Saving primary data. [2025-09-17T20:09:57.647755] [DEBUG] [LOCAL ] MAC: Trimmed 71400 records to 49752 (keeping 200 days of data) [2025-09-17T20:09:57.970390] [DEBUG] [LOCAL ] MAC: Primary data saved (49752 records). [2025-09-17T20:09:57.970544] [INFO ] [MAIN ] MAC: Full history saved. [2025-09-17T20:09:57.970686] [INFO ] [MAIN ] Update Progress: 1301/2371 symbols completed. MAC took 31.2s. Estimated remaining: 2h 36m 13s. Rate: 6.8 symbols/min [2025-09-17T20:09:58.025724] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-11. [2025-09-17T20:09:58.143821] [INFO ] [MAIN ] MANU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:09:58.174138] [DEBUG] [LOCAL ] MANU: Loaded 26936 existing records from primary storage. [2025-09-17T20:09:58.174304] [INFO ] [MAIN ] MANU: Loaded 26936 existing records. [2025-09-17T20:09:58.350925] [WARN ] [MAIN ] MANU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:09:58.351246] [INFO ] [MAIN ] MANU: Wiping existing primary data before full refresh. [2025-09-17T20:09:58.351291] [INFO ] [LOCAL ] MANU: Starting deletion of primary data. [2025-09-17T20:09:58.352144] [DEBUG] [LOCAL ] MANU: Deleted primary data file. [2025-09-17T20:09:58.352211] [INFO ] [MAIN ] MANU: Starting full primary refresh. [2025-09-17T20:09:58.741693] [INFO ] [REMOTE ] MANU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:09:58.815810] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-03. [2025-09-17T20:09:58.885189] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T20:09:59.510242] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T20:09:59.615854] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-11. [2025-09-17T20:09:59.948013] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T20:10:00.415808] [INFO ] [REMOTE ] MAN: Fetching primary data for 2024-12. [2025-09-17T20:10:01.160907] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T20:10:01.215762] [INFO ] [REMOTE ] MANU: Fetching primary data for 2024-12. [2025-09-17T20:10:01.919042] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T20:10:02.015790] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-01. [2025-09-17T20:10:02.398853] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T20:10:02.815846] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-01. [2025-09-17T20:10:03.615821] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-04. [2025-09-17T20:10:03.759985] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T20:10:04.075749] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T20:10:04.415867] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-02. [2025-09-17T20:10:05.037889] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T20:10:05.215851] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-05. [2025-09-17T20:10:05.407889] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T20:10:06.015786] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-03. [2025-09-17T20:10:06.630060] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T20:10:06.815810] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-02. [2025-09-17T20:10:07.326239] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T20:10:07.615807] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-01. [2025-09-17T20:10:08.034353] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T20:10:08.415815] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-03. [2025-09-17T20:10:09.215800] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-06. [2025-09-17T20:10:09.344832] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T20:10:09.610117] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T20:10:10.015818] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-04. [2025-09-17T20:10:10.416234] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T20:10:10.815813] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-02. [2025-09-17T20:10:11.616448] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-04. [2025-09-17T20:10:11.622830] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T20:10:12.239736] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T20:10:12.415754] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-05. [2025-09-17T20:10:12.865868] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T20:10:13.215785] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-05. [2025-09-17T20:10:13.982492] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T20:10:14.015723] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-06. [2025-09-17T20:10:14.032760] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T20:10:14.815773] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-06. [2025-09-17T20:10:15.376666] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T20:10:15.615823] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-07. [2025-09-17T20:10:16.408359] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T20:10:16.415800] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-07. [2025-09-17T20:10:17.215768] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-07. [2025-09-17T20:10:17.288780] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T20:10:17.912477] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T20:10:18.015778] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-08. [2025-09-17T20:10:18.519974] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T20:10:18.815766] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-03. [2025-09-17T20:10:19.586404] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T20:10:19.615729] [INFO ] [REMOTE ] MAN: Fetching primary data for 2025-09. [2025-09-17T20:10:20.322728] [INFO ] [REMOTE ] MAN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T20:10:20.328606] [INFO ] [REMOTE ] MAN: Full fetch complete (61412 records). [2025-09-17T20:10:20.328770] [DEBUG] [VALIDATOR ] MAN: Validating primary data. [2025-09-17T20:10:20.420949] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-08. [2025-09-17T20:10:20.744484] [DEBUG] [VALIDATOR ] MAN: All expected trading days are present. [2025-09-17T20:10:20.744794] [DEBUG] [VALIDATOR ] MAN: Primary data validation passed. [2025-09-17T20:10:20.745757] [INFO ] [MAIN ] MAN: Fetched primary data is valid. [2025-09-17T20:10:20.745847] [DEBUG] [LOCAL ] MAN: Saving primary data. [2025-09-17T20:10:20.784291] [DEBUG] [LOCAL ] MAN: Trimmed 61412 records to 43676 (keeping 200 days of data) [2025-09-17T20:10:20.787978] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T20:10:21.067448] [DEBUG] [LOCAL ] MAN: Primary data saved (43676 records). [2025-09-17T20:10:21.067593] [INFO ] [MAIN ] MAN: Full history saved. [2025-09-17T20:10:21.068620] [INFO ] [MAIN ] Update Progress: 1302/2371 symbols completed. MAN took 24.8s. Estimated remaining: 2h 36m 16s. Rate: 6.8 symbols/min [2025-09-17T20:10:21.220523] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-04. [2025-09-17T20:10:21.238945] [INFO ] [MAIN ] MAS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:10:21.296960] [DEBUG] [LOCAL ] MAS: Loaded 52368 existing records from primary storage. [2025-09-17T20:10:21.297164] [INFO ] [MAIN ] MAS: Loaded 52368 existing records. [2025-09-17T20:10:21.478457] [WARN ] [MAIN ] MAS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:10:21.478737] [INFO ] [MAIN ] MAS: Wiping existing primary data before full refresh. [2025-09-17T20:10:21.478785] [INFO ] [LOCAL ] MAS: Starting deletion of primary data. [2025-09-17T20:10:21.480052] [DEBUG] [LOCAL ] MAS: Deleted primary data file. [2025-09-17T20:10:21.480104] [INFO ] [MAIN ] MAS: Starting full primary refresh. [2025-09-17T20:10:21.841017] [INFO ] [REMOTE ] MAS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:10:21.862751] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T20:10:22.015820] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-08. [2025-09-17T20:10:22.689481] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T20:10:22.815798] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-05. [2025-09-17T20:10:23.060166] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T20:10:23.615834] [INFO ] [REMOTE ] MANU: Fetching primary data for 2025-09. [2025-09-17T20:10:24.138421] [INFO ] [REMOTE ] MANU: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T20:10:24.142599] [INFO ] [REMOTE ] MANU: Full fetch complete (38047 records). [2025-09-17T20:10:24.142714] [DEBUG] [VALIDATOR ] MANU: Validating primary data. [2025-09-17T20:10:24.420969] [INFO ] [REMOTE ] MAGN: Fetching primary data for 2025-09. [2025-09-17T20:10:24.529719] [DEBUG] [VALIDATOR ] MANU: All expected trading days are present. [2025-09-17T20:10:24.529802] [DEBUG] [VALIDATOR ] MANU: Primary data validation passed. [2025-09-17T20:10:24.530513] [INFO ] [MAIN ] MANU: Fetched primary data is valid. [2025-09-17T20:10:24.530557] [DEBUG] [LOCAL ] MANU: Saving primary data. [2025-09-17T20:10:24.531574] [DEBUG] [LOCAL ] MANU: Trimmed 38047 records to 27155 (keeping 200 days of data) [2025-09-17T20:10:24.701864] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T20:10:24.732703] [DEBUG] [LOCAL ] MANU: Primary data saved (27155 records). [2025-09-17T20:10:24.732798] [INFO ] [MAIN ] MANU: Full history saved. [2025-09-17T20:10:24.732880] [INFO ] [MAIN ] Update Progress: 1303/2371 symbols completed. MANU took 26.8s. Estimated remaining: 2h 36m 3s. Rate: 6.8 symbols/min [2025-09-17T20:10:24.901658] [INFO ] [MAIN ] MATV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:10:24.937368] [DEBUG] [LOCAL ] MATV: Loaded 38024 existing records from primary storage. [2025-09-17T20:10:24.937542] [INFO ] [MAIN ] MATV: Loaded 38024 existing records. [2025-09-17T20:10:25.113783] [WARN ] [MAIN ] MATV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:10:25.114074] [INFO ] [MAIN ] MATV: Wiping existing primary data before full refresh. [2025-09-17T20:10:25.114137] [INFO ] [LOCAL ] MATV: Starting deletion of primary data. [2025-09-17T20:10:25.115038] [DEBUG] [LOCAL ] MATV: Deleted primary data file. [2025-09-17T20:10:25.115089] [INFO ] [MAIN ] MATV: Starting full primary refresh. [2025-09-17T20:10:25.222909] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-06. [2025-09-17T20:10:25.446297] [INFO ] [REMOTE ] MAGN: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T20:10:25.513330] [INFO ] [REMOTE ] MAGN: Full fetch complete (51223 records). [2025-09-17T20:10:25.513238] [INFO ] [REMOTE ] MATV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:10:25.513723] [DEBUG] [VALIDATOR ] MAGN: Validating primary data. [2025-09-17T20:10:25.889713] [DEBUG] [VALIDATOR ] MAGN: All expected trading days are present. [2025-09-17T20:10:25.889792] [DEBUG] [VALIDATOR ] MAGN: Primary data validation passed. [2025-09-17T20:10:25.890552] [INFO ] [MAIN ] MAGN: Fetched primary data is valid. [2025-09-17T20:10:25.890592] [DEBUG] [LOCAL ] MAGN: Saving primary data. [2025-09-17T20:10:25.891730] [DEBUG] [LOCAL ] MAGN: Trimmed 51223 records to 35003 (keeping 200 days of data) [2025-09-17T20:10:26.015854] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-11. [2025-09-17T20:10:26.103767] [DEBUG] [LOCAL ] MAGN: Primary data saved (35003 records). [2025-09-17T20:10:26.103887] [INFO ] [MAIN ] MAGN: Full history saved. [2025-09-17T20:10:26.103989] [INFO ] [MAIN ] Update Progress: 1304/2371 symbols completed. MAGN took 40.1s. Estimated remaining: 2h 35m 48s. Rate: 6.8 symbols/min [2025-09-17T20:10:26.271995] [INFO ] [MAIN ] MATX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:10:26.310835] [DEBUG] [LOCAL ] MATX: Loaded 31574 existing records from primary storage. [2025-09-17T20:10:26.311001] [INFO ] [MAIN ] MATX: Loaded 31574 existing records. [2025-09-17T20:10:26.488427] [WARN ] [MAIN ] MATX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:10:26.488668] [INFO ] [MAIN ] MATX: Wiping existing primary data before full refresh. [2025-09-17T20:10:26.488713] [INFO ] [LOCAL ] MATX: Starting deletion of primary data. [2025-09-17T20:10:26.489502] [DEBUG] [LOCAL ] MATX: Deleted primary data file. [2025-09-17T20:10:26.489548] [INFO ] [MAIN ] MATX: Starting full primary refresh. [2025-09-17T20:10:26.819917] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-11. [2025-09-17T20:10:26.848531] [INFO ] [REMOTE ] MATX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:10:26.873071] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T20:10:27.432415] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T20:10:27.615802] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-11. [2025-09-17T20:10:28.316744] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T20:10:28.415812] [INFO ] [REMOTE ] MATV: Fetching primary data for 2024-12. [2025-09-17T20:10:28.814456] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T20:10:29.215828] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-07. [2025-09-17T20:10:29.484083] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T20:10:30.015775] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-01. [2025-09-17T20:10:30.815819] [INFO ] [REMOTE ] MAS: Fetching primary data for 2024-12. [2025-09-17T20:10:30.883516] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T20:10:31.161000] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T20:10:31.615836] [INFO ] [REMOTE ] MATX: Fetching primary data for 2024-12. [2025-09-17T20:10:32.297527] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T20:10:32.415730] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-01. [2025-09-17T20:10:32.628536] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T20:10:33.215783] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-08. [2025-09-17T20:10:33.954372] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T20:10:34.015795] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-02. [2025-09-17T20:10:34.653271] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T20:10:34.815825] [INFO ] [REMOTE ] MAIN: Fetching primary data for 2025-09. [2025-09-17T20:10:35.551479] [INFO ] [REMOTE ] MAIN: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T20:10:35.559230] [INFO ] [REMOTE ] MAIN: Full fetch complete (59289 records). [2025-09-17T20:10:35.559446] [DEBUG] [VALIDATOR ] MAIN: Validating primary data. [2025-09-17T20:10:35.625451] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-01. [2025-09-17T20:10:35.704186] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T20:10:36.000495] [DEBUG] [VALIDATOR ] MAIN: All expected trading days are present. [2025-09-17T20:10:36.000589] [DEBUG] [VALIDATOR ] MAIN: Primary data validation passed. [2025-09-17T20:10:36.001490] [INFO ] [MAIN ] MAIN: Fetched primary data is valid. [2025-09-17T20:10:36.001539] [DEBUG] [LOCAL ] MAIN: Saving primary data. [2025-09-17T20:10:36.003085] [DEBUG] [LOCAL ] MAIN: Trimmed 59289 records to 41395 (keeping 200 days of data) [2025-09-17T20:10:36.272668] [DEBUG] [LOCAL ] MAIN: Primary data saved (41395 records). [2025-09-17T20:10:36.272844] [INFO ] [MAIN ] MAIN: Full history saved. [2025-09-17T20:10:36.272941] [INFO ] [MAIN ] Update Progress: 1305/2371 symbols completed. MAIN took 47.9s. Estimated remaining: 2h 35m 40s. Rate: 6.8 symbols/min [2025-09-17T20:10:36.424061] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-03. [2025-09-17T20:10:36.441844] [INFO ] [MAIN ] MAX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:10:36.474473] [DEBUG] [LOCAL ] MAX: Loaded 31047 existing records from primary storage. [2025-09-17T20:10:36.474620] [INFO ] [MAIN ] MAX: Loaded 31047 existing records. [2025-09-17T20:10:36.658012] [WARN ] [MAIN ] MAX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:10:36.658411] [INFO ] [MAIN ] MAX: Wiping existing primary data before full refresh. [2025-09-17T20:10:36.658532] [INFO ] [LOCAL ] MAX: Starting deletion of primary data. [2025-09-17T20:10:36.664548] [DEBUG] [LOCAL ] MAX: Deleted primary data file. [2025-09-17T20:10:36.671379] [INFO ] [MAIN ] MAX: Starting full primary refresh. [2025-09-17T20:10:36.750483] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T20:10:37.036896] [INFO ] [REMOTE ] MAX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:10:37.215810] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-02. [2025-09-17T20:10:38.015824] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-11. [2025-09-17T20:10:38.155991] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T20:10:38.550152] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T20:10:38.815809] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-03. [2025-09-17T20:10:39.178603] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T20:10:39.615811] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-04. [2025-09-17T20:10:40.415803] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-02. [2025-09-17T20:10:40.535281] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T20:10:41.215755] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-04. [2025-09-17T20:10:41.503253] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T20:10:41.532775] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T20:10:42.015796] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-05. [2025-09-17T20:10:42.676446] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T20:10:42.815808] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-05. [2025-09-17T20:10:43.615806] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-03. [2025-09-17T20:10:43.745926] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T20:10:44.233585] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T20:10:44.415747] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-06. [2025-09-17T20:10:44.883243] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T20:10:45.215817] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-04. [2025-09-17T20:10:45.572582] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T20:10:46.015832] [INFO ] [REMOTE ] MAX: Fetching primary data for 2024-12. [2025-09-17T20:10:46.419207] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T20:10:46.815831] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-07. [2025-09-17T20:10:47.455537] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T20:10:47.615810] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-06. [2025-09-17T20:10:48.255078] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T20:10:48.415804] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-05. [2025-09-17T20:10:49.215800] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-01. [2025-09-17T20:10:49.285127] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T20:10:49.607549] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T20:10:50.015773] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-07. [2025-09-17T20:10:50.483273] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T20:10:50.815793] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-02. [2025-09-17T20:10:51.572250] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T20:10:51.615741] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-08. [2025-09-17T20:10:52.072828] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T20:10:52.415804] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-08. [2025-09-17T20:10:53.184174] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T20:10:53.215696] [INFO ] [REMOTE ] MAS: Fetching primary data for 2025-09. [2025-09-17T20:10:53.767848] [INFO ] [REMOTE ] MAS: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T20:10:53.774548] [INFO ] [REMOTE ] MAS: Full fetch complete (74472 records). [2025-09-17T20:10:53.774750] [DEBUG] [VALIDATOR ] MAS: Validating primary data. [2025-09-17T20:10:54.026321] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-03. [2025-09-17T20:10:54.184521] [DEBUG] [VALIDATOR ] MAS: All expected trading days are present. [2025-09-17T20:10:54.184731] [DEBUG] [VALIDATOR ] MAS: Primary data validation passed. [2025-09-17T20:10:54.185762] [INFO ] [MAIN ] MAS: Fetched primary data is valid. [2025-09-17T20:10:54.185816] [DEBUG] [LOCAL ] MAS: Saving primary data. [2025-09-17T20:10:54.209581] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T20:10:54.218215] [DEBUG] [LOCAL ] MAS: Trimmed 74472 records to 52371 (keeping 200 days of data) [2025-09-17T20:10:54.560614] [DEBUG] [LOCAL ] MAS: Primary data saved (52371 records). [2025-09-17T20:10:54.560827] [INFO ] [MAIN ] MAS: Full history saved. [2025-09-17T20:10:54.561448] [INFO ] [MAIN ] Update Progress: 1306/2371 symbols completed. MAS took 33.5s. Estimated remaining: 2h 35m 39s. Rate: 6.8 symbols/min [2025-09-17T20:10:54.732460] [INFO ] [MAIN ] MBC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:10:54.783866] [DEBUG] [LOCAL ] MBC: Loaded 43064 existing records from primary storage. [2025-09-17T20:10:54.784032] [INFO ] [MAIN ] MBC: Loaded 43064 existing records. [2025-09-17T20:10:54.820978] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-06. [2025-09-17T20:10:54.971173] [WARN ] [MAIN ] MBC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:10:54.971420] [INFO ] [MAIN ] MBC: Wiping existing primary data before full refresh. [2025-09-17T20:10:54.971465] [INFO ] [LOCAL ] MBC: Starting deletion of primary data. [2025-09-17T20:10:54.972260] [DEBUG] [LOCAL ] MBC: Deleted primary data file. [2025-09-17T20:10:54.972310] [INFO ] [MAIN ] MBC: Starting full primary refresh. [2025-09-17T20:10:55.329155] [INFO ] [REMOTE ] MBC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:10:55.430709] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T20:10:55.615781] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-04. [2025-09-17T20:10:56.209914] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T20:10:56.415830] [INFO ] [REMOTE ] MATV: Fetching primary data for 2025-09. [2025-09-17T20:10:56.567448] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T20:10:57.099068] [INFO ] [REMOTE ] MATV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T20:10:57.105830] [INFO ] [REMOTE ] MATV: Full fetch complete (52196 records). [2025-09-17T20:10:57.106058] [DEBUG] [VALIDATOR ] MATV: Validating primary data. [2025-09-17T20:10:57.221025] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-11. [2025-09-17T20:10:57.697368] [DEBUG] [VALIDATOR ] MATV: All expected trading days are present. [2025-09-17T20:10:57.697506] [DEBUG] [VALIDATOR ] MATV: Primary data validation passed. [2025-09-17T20:10:57.698702] [INFO ] [MAIN ] MATV: Fetched primary data is valid. [2025-09-17T20:10:57.698802] [DEBUG] [LOCAL ] MATV: Saving primary data. [2025-09-17T20:10:57.700504] [DEBUG] [LOCAL ] MATV: Trimmed 52196 records to 37940 (keeping 200 days of data) [2025-09-17T20:10:57.951895] [DEBUG] [LOCAL ] MATV: Primary data saved (37940 records). [2025-09-17T20:10:57.952075] [INFO ] [MAIN ] MATV: Full history saved. [2025-09-17T20:10:57.952175] [INFO ] [MAIN ] Update Progress: 1307/2371 symbols completed. MATV took 33.2s. Estimated remaining: 2h 35m 26s. Rate: 6.8 symbols/min [2025-09-17T20:10:58.020877] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-05. [2025-09-17T20:10:58.142263] [INFO ] [MAIN ] MBI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:10:58.165050] [DEBUG] [LOCAL ] MBI: Loaded 25156 existing records from primary storage. [2025-09-17T20:10:58.165200] [INFO ] [MAIN ] MBI: Loaded 25156 existing records. [2025-09-17T20:10:58.346465] [WARN ] [MAIN ] MBI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:10:58.346774] [INFO ] [MAIN ] MBI: Wiping existing primary data before full refresh. [2025-09-17T20:10:58.346826] [INFO ] [LOCAL ] MBI: Starting deletion of primary data. [2025-09-17T20:10:58.347368] [DEBUG] [LOCAL ] MBI: Deleted primary data file. [2025-09-17T20:10:58.347416] [INFO ] [MAIN ] MBI: Starting full primary refresh. [2025-09-17T20:10:58.711841] [INFO ] [REMOTE ] MBI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:10:58.752715] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T20:10:58.815723] [INFO ] [REMOTE ] MBC: Fetching primary data for 2024-12. [2025-09-17T20:10:59.398615] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T20:10:59.615817] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-11. [2025-09-17T20:11:00.076080] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T20:11:00.415787] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-01. [2025-09-17T20:11:01.215803] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-06. [2025-09-17T20:11:01.374862] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T20:11:02.015760] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-07. [2025-09-17T20:11:02.162521] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T20:11:02.342783] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T20:11:02.815775] [INFO ] [REMOTE ] MBI: Fetching primary data for 2024-12. [2025-09-17T20:11:03.087304] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T20:11:03.615780] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-02. [2025-09-17T20:11:04.101471] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T20:11:04.415783] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-08. [2025-09-17T20:11:05.051116] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T20:11:05.215792] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-03. [2025-09-17T20:11:05.350515] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T20:11:06.015782] [INFO ] [REMOTE ] MATX: Fetching primary data for 2025-09. [2025-09-17T20:11:06.721845] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T20:11:06.763395] [INFO ] [REMOTE ] MATX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T20:11:06.767353] [INFO ] [REMOTE ] MATX: Full fetch complete (42257 records). [2025-09-17T20:11:06.767504] [DEBUG] [VALIDATOR ] MATX: Validating primary data. [2025-09-17T20:11:06.822319] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-07. [2025-09-17T20:11:07.149583] [DEBUG] [VALIDATOR ] MATX: All expected trading days are present. [2025-09-17T20:11:07.149688] [DEBUG] [VALIDATOR ] MATX: Primary data validation passed. [2025-09-17T20:11:07.150405] [INFO ] [MAIN ] MATX: Fetched primary data is valid. [2025-09-17T20:11:07.150448] [DEBUG] [LOCAL ] MATX: Saving primary data. [2025-09-17T20:11:07.151530] [DEBUG] [LOCAL ] MATX: Trimmed 42257 records to 31582 (keeping 200 days of data) [2025-09-17T20:11:07.366860] [DEBUG] [LOCAL ] MATX: Primary data saved (31582 records). [2025-09-17T20:11:07.367048] [INFO ] [MAIN ] MATX: Full history saved. [2025-09-17T20:11:07.367163] [INFO ] [MAIN ] Update Progress: 1308/2371 symbols completed. MATX took 41.3s. Estimated remaining: 2h 35m 18s. Rate: 6.8 symbols/min [2025-09-17T20:11:07.541003] [INFO ] [MAIN ] MC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:11:07.583488] [DEBUG] [LOCAL ] MC: Loaded 44481 existing records from primary storage. [2025-09-17T20:11:07.583703] [INFO ] [MAIN ] MC: Loaded 44481 existing records. [2025-09-17T20:11:07.621104] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-04. [2025-09-17T20:11:07.774580] [WARN ] [MAIN ] MC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:11:07.774865] [INFO ] [MAIN ] MC: Wiping existing primary data before full refresh. [2025-09-17T20:11:07.774915] [INFO ] [LOCAL ] MC: Starting deletion of primary data. [2025-09-17T20:11:07.775995] [DEBUG] [LOCAL ] MC: Deleted primary data file. [2025-09-17T20:11:07.776050] [INFO ] [MAIN ] MC: Starting full primary refresh. [2025-09-17T20:11:08.141687] [INFO ] [REMOTE ] MC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:11:08.160229] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T20:11:08.415783] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-08. [2025-09-17T20:11:08.894696] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T20:11:09.215777] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-01. [2025-09-17T20:11:09.767846] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T20:11:10.015848] [INFO ] [REMOTE ] MAX: Fetching primary data for 2025-09. [2025-09-17T20:11:10.140524] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T20:11:10.815817] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-11. [2025-09-17T20:11:10.945226] [INFO ] [REMOTE ] MAX: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T20:11:10.950409] [INFO ] [REMOTE ] MAX: Full fetch complete (45456 records). [2025-09-17T20:11:10.950526] [DEBUG] [VALIDATOR ] MAX: Validating primary data. [2025-09-17T20:11:11.366070] [DEBUG] [VALIDATOR ] MAX: All expected trading days are present. [2025-09-17T20:11:11.366163] [DEBUG] [VALIDATOR ] MAX: Primary data validation passed. [2025-09-17T20:11:11.366956] [INFO ] [MAIN ] MAX: Fetched primary data is valid. [2025-09-17T20:11:11.367001] [DEBUG] [LOCAL ] MAX: Saving primary data. [2025-09-17T20:11:11.368092] [DEBUG] [LOCAL ] MAX: Trimmed 45456 records to 31090 (keeping 200 days of data) [2025-09-17T20:11:11.550270] [DEBUG] [LOCAL ] MAX: Primary data saved (31090 records). [2025-09-17T20:11:11.550422] [INFO ] [MAIN ] MAX: Full history saved. [2025-09-17T20:11:11.550511] [INFO ] [MAIN ] Update Progress: 1309/2371 symbols completed. MAX took 35.3s. Estimated remaining: 2h 35m 5s. Rate: 6.8 symbols/min [2025-09-17T20:11:11.625234] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-02. [2025-09-17T20:11:11.726127] [INFO ] [MAIN ] MCB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:11:11.739195] [DEBUG] [LOCAL ] MCB: Loaded 11776 existing records from primary storage. [2025-09-17T20:11:11.739366] [INFO ] [MAIN ] MCB: Loaded 11776 existing records. [2025-09-17T20:11:11.920883] [WARN ] [MAIN ] MCB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:11:11.921166] [INFO ] [MAIN ] MCB: Wiping existing primary data before full refresh. [2025-09-17T20:11:11.921213] [INFO ] [LOCAL ] MCB: Starting deletion of primary data. [2025-09-17T20:11:11.921538] [DEBUG] [LOCAL ] MCB: Deleted primary data file. [2025-09-17T20:11:11.921593] [INFO ] [MAIN ] MCB: Starting full primary refresh. [2025-09-17T20:11:12.287614] [INFO ] [REMOTE ] MCB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:11:12.311185] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T20:11:12.415780] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-11. [2025-09-17T20:11:12.853555] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T20:11:13.215773] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-05. [2025-09-17T20:11:13.254637] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T20:11:14.015802] [INFO ] [REMOTE ] MC: Fetching primary data for 2024-12. [2025-09-17T20:11:14.498664] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T20:11:14.815811] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-06. [2025-09-17T20:11:15.389435] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T20:11:15.615813] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-03. [2025-09-17T20:11:16.171513] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T20:11:16.415773] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-07. [2025-09-17T20:11:16.834246] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T20:11:17.215787] [INFO ] [REMOTE ] MCB: Fetching primary data for 2024-12. [2025-09-17T20:11:17.857353] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T20:11:18.015833] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-01. [2025-09-17T20:11:18.083629] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T20:11:18.815790] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-01. [2025-09-17T20:11:19.403491] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T20:11:19.520593] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T20:11:19.615809] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-02. [2025-09-17T20:11:20.415818] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-04. [2025-09-17T20:11:20.463721] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T20:11:21.215776] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-03. [2025-09-17T20:11:21.675134] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T20:11:22.015783] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-05. [2025-09-17T20:11:22.216354] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T20:11:22.815768] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-08. [2025-09-17T20:11:23.174624] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T20:11:23.615819] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-04. [2025-09-17T20:11:24.100364] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T20:11:24.415820] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-02. [2025-09-17T20:11:24.708595] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T20:11:25.215810] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-05. [2025-09-17T20:11:25.906227] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T20:11:25.932451] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T20:11:26.015816] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-06. [2025-09-17T20:11:26.815692] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-03. [2025-09-17T20:11:26.989933] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T20:11:27.615845] [INFO ] [REMOTE ] MBC: Fetching primary data for 2025-09. [2025-09-17T20:11:28.415830] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-07. [2025-09-17T20:11:28.505820] [INFO ] [REMOTE ] MBC: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T20:11:28.512366] [INFO ] [REMOTE ] MBC: Full fetch complete (62081 records). [2025-09-17T20:11:28.512504] [DEBUG] [VALIDATOR ] MBC: Validating primary data. [2025-09-17T20:11:28.694198] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T20:11:28.948504] [DEBUG] [VALIDATOR ] MBC: All expected trading days are present. [2025-09-17T20:11:28.948602] [DEBUG] [VALIDATOR ] MBC: Primary data validation passed. [2025-09-17T20:11:28.949552] [INFO ] [MAIN ] MBC: Fetched primary data is valid. [2025-09-17T20:11:28.949617] [DEBUG] [LOCAL ] MBC: Saving primary data. [2025-09-17T20:11:28.951094] [DEBUG] [LOCAL ] MBC: Trimmed 62081 records to 43058 (keeping 200 days of data) [2025-09-17T20:11:29.216043] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-04. [2025-09-17T20:11:29.217710] [DEBUG] [LOCAL ] MBC: Primary data saved (43058 records). [2025-09-17T20:11:29.217906] [INFO ] [MAIN ] MBC: Full history saved. [2025-09-17T20:11:29.218761] [INFO ] [MAIN ] Update Progress: 1310/2371 symbols completed. MBC took 34.7s. Estimated remaining: 2h 35m 4s. Rate: 6.8 symbols/min [2025-09-17T20:11:29.399330] [INFO ] [MAIN ] MCD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:11:29.412465] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T20:11:29.473711] [DEBUG] [LOCAL ] MCD: Loaded 53469 existing records from primary storage. [2025-09-17T20:11:29.473922] [INFO ] [MAIN ] MCD: Loaded 53469 existing records. [2025-09-17T20:11:29.654431] [WARN ] [MAIN ] MCD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:11:29.654726] [INFO ] [MAIN ] MCD: Wiping existing primary data before full refresh. [2025-09-17T20:11:29.654775] [INFO ] [LOCAL ] MCD: Starting deletion of primary data. [2025-09-17T20:11:29.656152] [DEBUG] [LOCAL ] MCD: Deleted primary data file. [2025-09-17T20:11:29.656207] [INFO ] [MAIN ] MCD: Starting full primary refresh. [2025-09-17T20:11:30.011772] [INFO ] [REMOTE ] MCD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:11:30.015726] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-11. [2025-09-17T20:11:30.815783] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-06. [2025-09-17T20:11:31.041258] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T20:11:31.601339] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T20:11:31.615682] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-07. [2025-09-17T20:11:32.071100] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-11 (2.06 seconds). [2025-09-17T20:11:32.235331] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T20:11:32.415801] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-08. [2025-09-17T20:11:33.142036] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T20:11:33.215809] [INFO ] [REMOTE ] MCB: Fetching primary data for 2025-09. [2025-09-17T20:11:33.701057] [INFO ] [REMOTE ] MCB: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T20:11:33.703041] [INFO ] [REMOTE ] MCB: Full fetch complete (16233 records). [2025-09-17T20:11:33.703219] [DEBUG] [VALIDATOR ] MCB: Validating primary data. [2025-09-17T20:11:34.030198] [INFO ] [REMOTE ] MCD: Fetching primary data for 2024-12. [2025-09-17T20:11:34.076285] [DEBUG] [VALIDATOR ] MCB: All expected trading days are present. [2025-09-17T20:11:34.076368] [DEBUG] [VALIDATOR ] MCB: Primary data validation passed. [2025-09-17T20:11:34.076790] [INFO ] [MAIN ] MCB: Fetched primary data is valid. [2025-09-17T20:11:34.076832] [DEBUG] [LOCAL ] MCB: Saving primary data. [2025-09-17T20:11:34.077426] [DEBUG] [LOCAL ] MCB: Trimmed 16233 records to 11743 (keeping 200 days of data) [2025-09-17T20:11:34.157519] [DEBUG] [LOCAL ] MCB: Primary data saved (11743 records). [2025-09-17T20:11:34.157696] [INFO ] [MAIN ] MCB: Full history saved. [2025-09-17T20:11:34.157803] [INFO ] [MAIN ] Update Progress: 1311/2371 symbols completed. MCB took 22.6s. Estimated remaining: 2h 34m 52s. Rate: 6.8 symbols/min [2025-09-17T20:11:34.330823] [INFO ] [MAIN ] MCI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:11:34.339225] [DEBUG] [LOCAL ] MCI: Loaded 6360 existing records from primary storage. [2025-09-17T20:11:34.339333] [INFO ] [MAIN ] MCI: Loaded 6360 existing records. [2025-09-17T20:11:34.516900] [WARN ] [MAIN ] MCI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:11:34.517190] [INFO ] [MAIN ] MCI: Wiping existing primary data before full refresh. [2025-09-17T20:11:34.517238] [INFO ] [LOCAL ] MCI: Starting deletion of primary data. [2025-09-17T20:11:34.517598] [DEBUG] [LOCAL ] MCI: Deleted primary data file. [2025-09-17T20:11:34.517668] [INFO ] [MAIN ] MCI: Starting full primary refresh. [2025-09-17T20:11:34.820946] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-05. [2025-09-17T20:11:34.876765] [INFO ] [REMOTE ] MCI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:11:35.615821] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-11. [2025-09-17T20:11:36.224307] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-17T20:11:36.371991] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T20:11:36.392284] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T20:11:36.415743] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-06. [2025-09-17T20:11:37.215799] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-01. [2025-09-17T20:11:37.946240] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T20:11:38.015763] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-07. [2025-09-17T20:11:38.815776] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-08. [2025-09-17T20:11:39.216431] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T20:11:39.463610] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T20:11:39.615744] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-08. [2025-09-17T20:11:40.140323] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T20:11:40.415829] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-02. [2025-09-17T20:11:41.210713] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T20:11:41.219188] [INFO ] [REMOTE ] MBI: Fetching primary data for 2025-09. [2025-09-17T20:11:41.539684] [INFO ] [REMOTE ] MBI: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T20:11:41.543045] [INFO ] [REMOTE ] MBI: Full fetch complete (36895 records). [2025-09-17T20:11:41.543126] [DEBUG] [VALIDATOR ] MBI: Validating primary data. [2025-09-17T20:11:41.918101] [DEBUG] [VALIDATOR ] MBI: All expected trading days are present. [2025-09-17T20:11:41.918191] [DEBUG] [VALIDATOR ] MBI: Primary data validation passed. [2025-09-17T20:11:41.918871] [INFO ] [MAIN ] MBI: Fetched primary data is valid. [2025-09-17T20:11:41.918915] [DEBUG] [LOCAL ] MBI: Saving primary data. [2025-09-17T20:11:41.919956] [DEBUG] [LOCAL ] MBI: Trimmed 36895 records to 25048 (keeping 200 days of data) [2025-09-17T20:11:42.015745] [INFO ] [REMOTE ] MC: Fetching primary data for 2025-09. [2025-09-17T20:11:42.071271] [DEBUG] [LOCAL ] MBI: Primary data saved (25048 records). [2025-09-17T20:11:42.071413] [INFO ] [MAIN ] MBI: Full history saved. [2025-09-17T20:11:42.071507] [INFO ] [MAIN ] Update Progress: 1312/2371 symbols completed. MBI took 44.1s. Estimated remaining: 2h 34m 43s. Rate: 6.8 symbols/min [2025-09-17T20:11:42.244574] [INFO ] [MAIN ] MCK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:11:42.273063] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T20:11:42.317337] [DEBUG] [LOCAL ] MCK: Loaded 39680 existing records from primary storage. [2025-09-17T20:11:42.317521] [INFO ] [MAIN ] MCK: Loaded 39680 existing records. [2025-09-17T20:11:42.502464] [WARN ] [MAIN ] MCK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:11:42.502870] [INFO ] [MAIN ] MCK: Wiping existing primary data before full refresh. [2025-09-17T20:11:42.502935] [INFO ] [LOCAL ] MCK: Starting deletion of primary data. [2025-09-17T20:11:42.508995] [DEBUG] [LOCAL ] MCK: Deleted primary data file. [2025-09-17T20:11:42.515422] [INFO ] [MAIN ] MCK: Starting full primary refresh. [2025-09-17T20:11:42.585387] [INFO ] [REMOTE ] MC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T20:11:42.637214] [INFO ] [REMOTE ] MC: Full fetch complete (61840 records). [2025-09-17T20:11:42.664867] [DEBUG] [VALIDATOR ] MC: Validating primary data. [2025-09-17T20:11:42.820509] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-03. [2025-09-17T20:11:43.154803] [INFO ] [REMOTE ] MCK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:11:43.298321] [DEBUG] [VALIDATOR ] MC: All expected trading days are present. [2025-09-17T20:11:43.298433] [DEBUG] [VALIDATOR ] MC: Primary data validation passed. [2025-09-17T20:11:43.299718] [INFO ] [MAIN ] MC: Fetched primary data is valid. [2025-09-17T20:11:43.299778] [DEBUG] [LOCAL ] MC: Saving primary data. [2025-09-17T20:11:43.301597] [DEBUG] [LOCAL ] MC: Trimmed 61840 records to 44467 (keeping 200 days of data) [2025-09-17T20:11:43.609118] [DEBUG] [LOCAL ] MC: Primary data saved (44467 records). [2025-09-17T20:11:43.609370] [INFO ] [MAIN ] MC: Full history saved. [2025-09-17T20:11:43.609557] [INFO ] [MAIN ] Update Progress: 1313/2371 symbols completed. MC took 36.2s. Estimated remaining: 2h 34m 28s. Rate: 6.8 symbols/min [2025-09-17T20:11:43.624009] [INFO ] [REMOTE ] MCI: Fetching primary data for 2024-12. [2025-09-17T20:11:43.799676] [INFO ] [MAIN ] MCN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:11:43.813882] [DEBUG] [LOCAL ] MCN: Loaded 8162 existing records from primary storage. [2025-09-17T20:11:43.814067] [INFO ] [MAIN ] MCN: Loaded 8162 existing records. [2025-09-17T20:11:44.000323] [WARN ] [MAIN ] MCN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:11:44.000752] [INFO ] [MAIN ] MCN: Wiping existing primary data before full refresh. [2025-09-17T20:11:44.000806] [INFO ] [LOCAL ] MCN: Starting deletion of primary data. [2025-09-17T20:11:44.001139] [DEBUG] [LOCAL ] MCN: Deleted primary data file. [2025-09-17T20:11:44.001269] [INFO ] [MAIN ] MCN: Starting full primary refresh. [2025-09-17T20:11:44.335984] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T20:11:44.419882] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-01. [2025-09-17T20:11:44.425714] [INFO ] [REMOTE ] MCN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:11:44.871577] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T20:11:45.173467] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T20:11:45.215798] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-11. [2025-09-17T20:11:46.015779] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-04. [2025-09-17T20:11:46.805870] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T20:11:46.816152] [INFO ] [REMOTE ] MCK: Fetching primary data for 2024-12. [2025-09-17T20:11:47.615832] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-11. [2025-09-17T20:11:47.901817] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T20:11:48.247427] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T20:11:48.415773] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-02. [2025-09-17T20:11:48.507864] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T20:11:49.215835] [INFO ] [REMOTE ] MCN: Fetching primary data for 2024-12. [2025-09-17T20:11:49.263274] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T20:11:49.847068] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T20:11:50.015861] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-03. [2025-09-17T20:11:50.751637] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T20:11:50.815811] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-04. [2025-09-17T20:11:51.460189] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T20:11:51.615834] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-01. [2025-09-17T20:11:52.415798] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-05. [2025-09-17T20:11:52.968825] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T20:11:53.215769] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-01. [2025-09-17T20:11:53.941341] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T20:11:54.015750] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-02. [2025-09-17T20:11:54.509260] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T20:11:54.590443] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T20:11:54.815777] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-05. [2025-09-17T20:11:55.573321] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T20:11:55.615748] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-06. [2025-09-17T20:11:56.340338] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T20:11:56.415790] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-07. [2025-09-17T20:11:57.011134] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T20:11:57.215800] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-08. [2025-09-17T20:11:57.717019] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T20:11:58.015850] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-03. [2025-09-17T20:11:58.763555] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T20:11:58.815835] [INFO ] [REMOTE ] MCI: Fetching primary data for 2025-09. [2025-09-17T20:11:59.201073] [INFO ] [REMOTE ] MCI: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T20:11:59.202566] [INFO ] [REMOTE ] MCI: Full fetch complete (9766 records). [2025-09-17T20:11:59.202710] [DEBUG] [VALIDATOR ] MCI: Validating primary data. [2025-09-17T20:11:59.620897] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-06. [2025-09-17T20:11:59.622725] [DEBUG] [VALIDATOR ] MCI: All expected trading days are present. [2025-09-17T20:11:59.622849] [DEBUG] [VALIDATOR ] MCI: Primary data validation passed. [2025-09-17T20:11:59.623233] [INFO ] [MAIN ] MCI: Fetched primary data is valid. [2025-09-17T20:11:59.623313] [DEBUG] [LOCAL ] MCI: Saving primary data. [2025-09-17T20:11:59.624161] [DEBUG] [LOCAL ] MCI: Trimmed 9766 records to 6336 (keeping 200 days of data) [2025-09-17T20:11:59.669855] [DEBUG] [LOCAL ] MCI: Primary data saved (6336 records). [2025-09-17T20:11:59.670049] [INFO ] [MAIN ] MCI: Full history saved. [2025-09-17T20:11:59.670201] [INFO ] [MAIN ] Update Progress: 1314/2371 symbols completed. MCI took 25.5s. Estimated remaining: 2h 34m 25s. Rate: 6.8 symbols/min [2025-09-17T20:11:59.862510] [INFO ] [MAIN ] MCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:11:59.924570] [DEBUG] [LOCAL ] MCO: Loaded 39613 existing records from primary storage. [2025-09-17T20:11:59.924857] [INFO ] [MAIN ] MCO: Loaded 39613 existing records. [2025-09-17T20:12:00.110404] [WARN ] [MAIN ] MCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:12:00.110763] [INFO ] [MAIN ] MCO: Wiping existing primary data before full refresh. [2025-09-17T20:12:00.110811] [INFO ] [LOCAL ] MCO: Starting deletion of primary data. [2025-09-17T20:12:00.111766] [DEBUG] [LOCAL ] MCO: Deleted primary data file. [2025-09-17T20:12:00.111826] [INFO ] [MAIN ] MCO: Starting full primary refresh. [2025-09-17T20:12:00.420960] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-02. [2025-09-17T20:12:00.492136] [INFO ] [REMOTE ] MCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:12:01.215783] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-04. [2025-09-17T20:12:01.913937] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T20:12:01.920707] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T20:12:01.981909] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-17T20:12:02.015808] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-05. [2025-09-17T20:12:02.721811] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T20:12:02.815787] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-11. [2025-09-17T20:12:03.615823] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-03. [2025-09-17T20:12:04.390537] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T20:12:04.415720] [INFO ] [REMOTE ] MCO: Fetching primary data for 2024-12. [2025-09-17T20:12:04.958604] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T20:12:05.215775] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-07. [2025-09-17T20:12:06.015727] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-06. [2025-09-17T20:12:06.089405] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T20:12:06.815800] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-04. [2025-09-17T20:12:06.860817] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T20:12:07.301150] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-07 (2.09 seconds). [2025-09-17T20:12:07.615794] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-07. [2025-09-17T20:12:08.379115] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T20:12:08.415774] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-08. [2025-09-17T20:12:08.637470] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T20:12:09.215809] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-01. [2025-09-17T20:12:10.015803] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-05. [2025-09-17T20:12:10.299846] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T20:12:10.738293] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T20:12:10.815769] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-02. [2025-09-17T20:12:11.400906] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T20:12:11.615776] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-06. [2025-09-17T20:12:12.060503] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T20:12:12.415772] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-08. [2025-09-17T20:12:12.839203] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T20:12:13.062300] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T20:12:13.215761] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-07. [2025-09-17T20:12:14.015813] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-03. [2025-09-17T20:12:14.627851] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T20:12:14.815822] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-08. [2025-09-17T20:12:15.429809] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T20:12:15.615780] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-04. [2025-09-17T20:12:16.222828] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T20:12:16.415778] [INFO ] [REMOTE ] MCK: Fetching primary data for 2025-09. [2025-09-17T20:12:17.090789] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T20:12:17.124708] [INFO ] [REMOTE ] MCK: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T20:12:17.131965] [INFO ] [REMOTE ] MCK: Full fetch complete (57471 records). [2025-09-17T20:12:17.132151] [DEBUG] [VALIDATOR ] MCK: Validating primary data. [2025-09-17T20:12:17.220887] [INFO ] [REMOTE ] MCN: Fetching primary data for 2025-09. [2025-09-17T20:12:17.549475] [DEBUG] [VALIDATOR ] MCK: All expected trading days are present. [2025-09-17T20:12:17.549637] [DEBUG] [VALIDATOR ] MCK: Primary data validation passed. [2025-09-17T20:12:17.551051] [INFO ] [MAIN ] MCK: Fetched primary data is valid. [2025-09-17T20:12:17.551101] [DEBUG] [LOCAL ] MCK: Saving primary data. [2025-09-17T20:12:17.552729] [DEBUG] [LOCAL ] MCK: Trimmed 57471 records to 39599 (keeping 200 days of data) [2025-09-17T20:12:17.833016] [INFO ] [REMOTE ] MCN: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T20:12:17.836608] [INFO ] [REMOTE ] MCN: Full fetch complete (11484 records). [2025-09-17T20:12:17.837610] [DEBUG] [VALIDATOR ] MCN: Validating primary data. [2025-09-17T20:12:17.841829] [DEBUG] [LOCAL ] MCK: Primary data saved (39599 records). [2025-09-17T20:12:17.847521] [INFO ] [MAIN ] MCK: Full history saved. [2025-09-17T20:12:17.895954] [INFO ] [MAIN ] Update Progress: 1315/2371 symbols completed. MCK took 35.8s. Estimated remaining: 2h 34m 24s. Rate: 6.8 symbols/min [2025-09-17T20:12:18.023812] [INFO ] [REMOTE ] MCD: Fetching primary data for 2025-09. [2025-09-17T20:12:18.406803] [INFO ] [MAIN ] MCR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:12:18.453948] [DEBUG] [VALIDATOR ] MCN: All expected trading days are present. [2025-09-17T20:12:18.454166] [DEBUG] [VALIDATOR ] MCN: Primary data validation passed. [2025-09-17T20:12:18.454540] [INFO ] [MAIN ] MCN: Fetched primary data is valid. [2025-09-17T20:12:18.454583] [DEBUG] [LOCAL ] MCN: Saving primary data. [2025-09-17T20:12:18.457993] [DEBUG] [LOCAL ] MCN: Trimmed 11484 records to 8222 (keeping 200 days of data) [2025-09-17T20:12:18.499980] [DEBUG] [LOCAL ] MCR: Loaded 9007 existing records from primary storage. [2025-09-17T20:12:18.501949] [INFO ] [MAIN ] MCR: Loaded 9007 existing records. [2025-09-17T20:12:18.716314] [WARN ] [MAIN ] MCR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:12:18.718757] [INFO ] [MAIN ] MCR: Wiping existing primary data before full refresh. [2025-09-17T20:12:18.719179] [INFO ] [LOCAL ] MCR: Starting deletion of primary data. [2025-09-17T20:12:18.724289] [DEBUG] [LOCAL ] MCN: Primary data saved (8222 records). [2025-09-17T20:12:18.724440] [INFO ] [MAIN ] MCN: Full history saved. [2025-09-17T20:12:18.724697] [INFO ] [MAIN ] Update Progress: 1316/2371 symbols completed. MCN took 35.1s. Estimated remaining: 2h 34m 9s. Rate: 6.8 symbols/min [2025-09-17T20:12:18.724727] [DEBUG] [LOCAL ] MCR: Deleted primary data file. [2025-09-17T20:12:18.724860] [INFO ] [MAIN ] MCR: Starting full primary refresh. [2025-09-17T20:12:18.829528] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-05. [2025-09-17T20:12:19.262303] [INFO ] [MAIN ] MCS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:12:19.365423] [INFO ] [REMOTE ] MCR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:12:19.391167] [INFO ] [REMOTE ] MCD: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T20:12:19.399835] [DEBUG] [LOCAL ] MCS: Loaded 21546 existing records from primary storage. [2025-09-17T20:12:19.399944] [INFO ] [REMOTE ] MCD: Full fetch complete (77310 records). [2025-09-17T20:12:19.400106] [DEBUG] [VALIDATOR ] MCD: Validating primary data. [2025-09-17T20:12:19.400154] [INFO ] [MAIN ] MCS: Loaded 21546 existing records. [2025-09-17T20:12:19.618746] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-11. [2025-09-17T20:12:19.744106] [WARN ] [MAIN ] MCS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:12:19.843958] [INFO ] [MAIN ] MCS: Wiping existing primary data before full refresh. [2025-09-17T20:12:19.860329] [INFO ] [LOCAL ] MCS: Starting deletion of primary data. [2025-09-17T20:12:19.886844] [DEBUG] [LOCAL ] MCS: Deleted primary data file. [2025-09-17T20:12:19.897081] [INFO ] [MAIN ] MCS: Starting full primary refresh. [2025-09-17T20:12:20.097245] [DEBUG] [VALIDATOR ] MCD: All expected trading days are present. [2025-09-17T20:12:20.102468] [DEBUG] [VALIDATOR ] MCD: Primary data validation passed. [2025-09-17T20:12:20.108811] [INFO ] [MAIN ] MCD: Fetched primary data is valid. [2025-09-17T20:12:20.124778] [DEBUG] [LOCAL ] MCD: Saving primary data. [2025-09-17T20:12:20.240951] [DEBUG] [LOCAL ] MCD: Trimmed 77310 records to 53467 (keeping 200 days of data) [2025-09-17T20:12:20.465475] [INFO ] [REMOTE ] MCS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:12:20.468229] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-11. [2025-09-17T20:12:20.606404] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T20:12:20.670243] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T20:12:20.787857] [DEBUG] [LOCAL ] MCD: Primary data saved (53467 records). [2025-09-17T20:12:20.788048] [INFO ] [MAIN ] MCD: Full history saved. [2025-09-17T20:12:20.789114] [INFO ] [MAIN ] Update Progress: 1317/2371 symbols completed. MCD took 51.6s. Estimated remaining: 2h 33m 55s. Rate: 6.8 symbols/min [2025-09-17T20:12:21.215794] [INFO ] [REMOTE ] MCR: Fetching primary data for 2024-12. [2025-09-17T20:12:21.622883] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T20:12:22.015822] [INFO ] [REMOTE ] MCS: Fetching primary data for 2024-12. [2025-09-17T20:12:22.122458] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T20:12:22.815790] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-01. [2025-09-17T20:12:23.116836] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T20:12:23.580809] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T20:12:23.615823] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-01. [2025-09-17T20:12:24.415826] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-02. [2025-09-17T20:12:24.654397] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T20:12:25.137668] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T20:12:25.215794] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-02. [2025-09-17T20:12:26.015771] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-06. [2025-09-17T20:12:26.408374] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T20:12:26.815898] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-03. [2025-09-17T20:12:27.304139] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T20:12:27.615825] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-07. [2025-09-17T20:12:28.025562] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T20:12:28.415857] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-04. [2025-09-17T20:12:28.868024] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T20:12:29.168634] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T20:12:29.215735] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-05. [2025-09-17T20:12:30.015747] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-03. [2025-09-17T20:12:30.337167] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T20:12:30.775529] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T20:12:30.815812] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-04. [2025-09-17T20:12:31.529253] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T20:12:31.615770] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-05. [2025-09-17T20:12:32.375080] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T20:12:32.415733] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-06. [2025-09-17T20:12:32.984245] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T20:12:33.215771] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-08. [2025-09-17T20:12:34.015792] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-07. [2025-09-17T20:12:34.720268] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T20:12:34.781675] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T20:12:34.815732] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-08. [2025-09-17T20:12:35.622504] [INFO ] [REMOTE ] MCO: Fetching primary data for 2025-09. [2025-09-17T20:12:35.628443] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T20:12:36.323154] [INFO ] [REMOTE ] MCO: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T20:12:36.328445] [INFO ] [REMOTE ] MCO: Full fetch complete (56087 records). [2025-09-17T20:12:36.328575] [DEBUG] [VALIDATOR ] MCO: Validating primary data. [2025-09-17T20:12:36.425923] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-06. [2025-09-17T20:12:36.707839] [DEBUG] [VALIDATOR ] MCO: All expected trading days are present. [2025-09-17T20:12:36.707925] [DEBUG] [VALIDATOR ] MCO: Primary data validation passed. [2025-09-17T20:12:36.708807] [INFO ] [MAIN ] MCO: Fetched primary data is valid. [2025-09-17T20:12:36.708852] [DEBUG] [LOCAL ] MCO: Saving primary data. [2025-09-17T20:12:36.710186] [DEBUG] [LOCAL ] MCO: Trimmed 56087 records to 39609 (keeping 200 days of data) [2025-09-17T20:12:36.991813] [DEBUG] [LOCAL ] MCO: Primary data saved (39609 records). [2025-09-17T20:12:36.992047] [INFO ] [MAIN ] MCO: Full history saved. [2025-09-17T20:12:36.992225] [INFO ] [MAIN ] Update Progress: 1318/2371 symbols completed. MCO took 37.3s. Estimated remaining: 2h 33m 52s. Rate: 6.8 symbols/min [2025-09-17T20:12:37.215845] [INFO ] [REMOTE ] MCR: Fetching primary data for 2025-09. [2025-09-17T20:12:37.422298] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T20:12:37.715004] [INFO ] [REMOTE ] MCR: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T20:12:37.716435] [INFO ] [REMOTE ] MCR: Full fetch complete (14254 records). [2025-09-17T20:12:37.716510] [DEBUG] [VALIDATOR ] MCR: Validating primary data. [2025-09-17T20:12:38.021008] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-07. [2025-09-17T20:12:38.090803] [DEBUG] [VALIDATOR ] MCR: All expected trading days are present. [2025-09-17T20:12:38.090918] [DEBUG] [VALIDATOR ] MCR: Primary data validation passed. [2025-09-17T20:12:38.091590] [INFO ] [MAIN ] MCR: Fetched primary data is valid. [2025-09-17T20:12:38.091638] [DEBUG] [LOCAL ] MCR: Saving primary data. [2025-09-17T20:12:38.092307] [DEBUG] [LOCAL ] MCR: Trimmed 14254 records to 8977 (keeping 200 days of data) [2025-09-17T20:12:38.155625] [DEBUG] [LOCAL ] MCR: Primary data saved (8977 records). [2025-09-17T20:12:38.155892] [INFO ] [MAIN ] MCR: Full history saved. [2025-09-17T20:12:38.156055] [INFO ] [MAIN ] Update Progress: 1319/2371 symbols completed. MCR took 20.2s. Estimated remaining: 2h 33m 37s. Rate: 6.8 symbols/min [2025-09-17T20:12:39.012524] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T20:12:39.017893] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-08. [2025-09-17T20:12:39.970345] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T20:12:39.975931] [INFO ] [REMOTE ] MCS: Fetching primary data for 2025-09. [2025-09-17T20:12:40.693255] [INFO ] [REMOTE ] MCS: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T20:12:40.696699] [INFO ] [REMOTE ] MCS: Full fetch complete (30237 records). [2025-09-17T20:12:40.696806] [DEBUG] [VALIDATOR ] MCS: Validating primary data. [2025-09-17T20:12:41.118702] [DEBUG] [VALIDATOR ] MCS: All expected trading days are present. [2025-09-17T20:12:41.118786] [DEBUG] [VALIDATOR ] MCS: Primary data validation passed. [2025-09-17T20:12:41.119433] [INFO ] [MAIN ] MCS: Fetched primary data is valid. [2025-09-17T20:12:41.119474] [DEBUG] [LOCAL ] MCS: Saving primary data. [2025-09-17T20:12:41.120622] [DEBUG] [LOCAL ] MCS: Trimmed 30237 records to 21471 (keeping 200 days of data) [2025-09-17T20:12:41.254988] [DEBUG] [LOCAL ] MCS: Primary data saved (21471 records). [2025-09-17T20:12:41.255127] [INFO ] [MAIN ] MCS: Full history saved. [2025-09-17T20:12:41.255221] [INFO ] [MAIN ] Update Progress: 1320/2371 symbols completed. MCS took 22.5s. Estimated remaining: 2h 33m 24s. Rate: 6.9 symbols/min [2025-09-17T20:12:41.949778] [INFO ] [MAIN ] MDST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:12:41.910663] [INFO ] [MAIN ] MCY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:12:41.953846] [INFO ] [MAIN ] MDT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:12:41.954330] [DEBUG] [LOCAL ] MCY: No existing data file found in primary storage. [2025-09-17T20:12:41.955524] [INFO ] [MAIN ] MD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:12:41.954764] [WARN ] [MAIN ] MCY: No existing data found, performing full refresh instead. [2025-09-17T20:12:41.963436] [INFO ] [MAIN ] MCY: Wiping existing primary data before full refresh. [2025-09-17T20:12:41.963386] [DEBUG] [LOCAL ] MDST: Loaded 5396 existing records from primary storage. [2025-09-17T20:12:41.963659] [INFO ] [MAIN ] MDST: Loaded 5396 existing records. [2025-09-17T20:12:41.975029] [INFO ] [LOCAL ] MCY: Starting deletion of primary data. [2025-09-17T20:12:41.997764] [DEBUG] [LOCAL ] MCY: No primary data file found to delete. [2025-09-17T20:12:42.021818] [INFO ] [MAIN ] MCY: Starting full primary refresh. [2025-09-17T20:12:42.306871] [WARN ] [MAIN ] MDST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:12:42.344119] [INFO ] [MAIN ] MDST: Wiping existing primary data before full refresh. [2025-09-17T20:12:42.349866] [INFO ] [LOCAL ] MDST: Starting deletion of primary data. [2025-09-17T20:12:42.354274] [DEBUG] [LOCAL ] MD: Loaded 38818 existing records from primary storage. [2025-09-17T20:12:42.376076] [DEBUG] [LOCAL ] MDST: Deleted primary data file. [2025-09-17T20:12:42.376197] [INFO ] [MAIN ] MDST: Starting full primary refresh. [2025-09-17T20:12:42.354922] [INFO ] [MAIN ] MD: Loaded 38818 existing records. [2025-09-17T20:12:42.611513] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-17T20:12:42.664992] [INFO ] [MAIN ] MDT: Loaded 53678 existing records. [2025-09-17T20:12:42.975485] [INFO ] [REMOTE ] MCY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:12:43.058486] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-11. [2025-09-17T20:12:43.091809] [WARN ] [MAIN ] MD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:12:43.180750] [INFO ] [MAIN ] MD: Wiping existing primary data before full refresh. [2025-09-17T20:12:43.209063] [INFO ] [LOCAL ] MD: Starting deletion of primary data. [2025-09-17T20:12:43.254064] [DEBUG] [LOCAL ] MD: Deleted primary data file. [2025-09-17T20:12:43.287754] [INFO ] [MAIN ] MD: Starting full primary refresh. [2025-09-17T20:12:43.274519] [WARN ] [MAIN ] MDT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:12:43.355778] [INFO ] [MAIN ] MDT: Wiping existing primary data before full refresh. [2025-09-17T20:12:43.374411] [INFO ] [LOCAL ] MDT: Starting deletion of primary data. [2025-09-17T20:12:43.393491] [INFO ] [REMOTE ] MDST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:12:43.400727] [DEBUG] [LOCAL ] MDT: Deleted primary data file. [2025-09-17T20:12:43.411244] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-11. [2025-09-17T20:12:43.418345] [INFO ] [MAIN ] MDT: Starting full primary refresh. [2025-09-17T20:12:44.053663] [INFO ] [REMOTE ] MD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:12:44.060799] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-11. [2025-09-17T20:12:44.060388] [INFO ] [REMOTE ] MDT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:12:44.062088] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-11. [2025-09-17T20:12:44.126852] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T20:12:44.128866] [INFO ] [REMOTE ] MDST: Fetching primary data for 2024-12. [2025-09-17T20:12:44.434440] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T20:12:44.440071] [INFO ] [REMOTE ] MCY: Fetching primary data for 2024-12. [2025-09-17T20:12:45.027061] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T20:12:45.215833] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-01. [2025-09-17T20:12:45.512081] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T20:12:45.689905] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T20:12:45.780095] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T20:12:45.780381] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T20:12:46.015780] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-01. [2025-09-17T20:12:46.815796] [INFO ] [REMOTE ] MD: Fetching primary data for 2024-12. [2025-09-17T20:12:47.549317] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T20:12:47.615782] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-02. [2025-09-17T20:12:48.011485] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T20:12:48.415794] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-01. [2025-09-17T20:12:49.151838] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T20:12:49.215735] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-03. [2025-09-17T20:12:49.669088] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T20:12:50.015792] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-02. [2025-09-17T20:12:50.590601] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T20:12:50.716536] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T20:12:50.815812] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-04. [2025-09-17T20:12:51.615783] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-02. [2025-09-17T20:12:52.102517] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T20:12:52.415777] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-03. [2025-09-17T20:12:52.654267] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T20:12:53.039288] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T20:12:53.215774] [INFO ] [REMOTE ] MDT: Fetching primary data for 2024-12. [2025-09-17T20:12:54.015787] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-05. [2025-09-17T20:12:54.815772] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-04. [2025-09-17T20:12:55.088806] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T20:12:55.145217] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T20:12:55.394358] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T20:12:55.615785] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-03. [2025-09-17T20:12:56.415784] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-05. [2025-09-17T20:12:57.001349] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T20:12:57.103387] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T20:12:57.215738] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-04. [2025-09-17T20:12:58.015790] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-06. [2025-09-17T20:12:58.518443] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T20:12:58.815787] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-06. [2025-09-17T20:12:59.102285] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T20:12:59.295046] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T20:12:59.615796] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-07. [2025-09-17T20:13:00.415826] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-07. [2025-09-17T20:13:01.204216] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T20:13:01.219350] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-01. [2025-09-17T20:13:01.225430] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T20:13:02.015819] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-05. [2025-09-17T20:13:02.815826] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-08. [2025-09-17T20:13:03.399170] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-01 (2.18 seconds). [2025-09-17T20:13:03.540398] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T20:13:03.615760] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-06. [2025-09-17T20:13:03.763545] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T20:13:04.415798] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-08. [2025-09-17T20:13:04.872467] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T20:13:04.926538] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T20:13:05.215764] [INFO ] [REMOTE ] MDST: Fetching primary data for 2025-09. [2025-09-17T20:13:05.683139] [INFO ] [REMOTE ] MDST: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T20:13:05.684770] [INFO ] [REMOTE ] MDST: Full fetch complete (8323 records). [2025-09-17T20:13:05.684849] [DEBUG] [VALIDATOR ] MDST: Validating primary data. [2025-09-17T20:13:06.025504] [INFO ] [REMOTE ] MCY: Fetching primary data for 2025-09. [2025-09-17T20:13:06.047968] [DEBUG] [VALIDATOR ] MDST: All expected trading days are present. [2025-09-17T20:13:06.048024] [DEBUG] [VALIDATOR ] MDST: Primary data validation passed. [2025-09-17T20:13:06.048249] [INFO ] [MAIN ] MDST: Fetched primary data is valid. [2025-09-17T20:13:06.048290] [DEBUG] [LOCAL ] MDST: Saving primary data. [2025-09-17T20:13:06.048777] [DEBUG] [LOCAL ] MDST: Trimmed 8323 records to 5430 (keeping 200 days of data) [2025-09-17T20:13:06.083406] [DEBUG] [LOCAL ] MDST: Primary data saved (5430 records). [2025-09-17T20:13:06.083508] [INFO ] [MAIN ] MDST: Full history saved. [2025-09-17T20:13:06.083608] [INFO ] [MAIN ] Update Progress: 1321/2371 symbols completed. MDST took 24.8s. Estimated remaining: 2h 33m 28s. Rate: 6.8 symbols/min [2025-09-17T20:13:06.255332] [INFO ] [MAIN ] MDU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:13:06.299109] [DEBUG] [LOCAL ] MDU: Loaded 47858 existing records from primary storage. [2025-09-17T20:13:06.299257] [INFO ] [MAIN ] MDU: Loaded 47858 existing records. [2025-09-17T20:13:06.476595] [WARN ] [MAIN ] MDU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:13:06.476863] [INFO ] [MAIN ] MDU: Wiping existing primary data before full refresh. [2025-09-17T20:13:06.476915] [INFO ] [LOCAL ] MDU: Starting deletion of primary data. [2025-09-17T20:13:06.478221] [DEBUG] [LOCAL ] MDU: Deleted primary data file. [2025-09-17T20:13:06.478274] [INFO ] [MAIN ] MDU: Starting full primary refresh. [2025-09-17T20:13:06.802759] [INFO ] [REMOTE ] MCY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T20:13:06.822122] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-02. [2025-09-17T20:13:06.845575] [INFO ] [REMOTE ] MDU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:13:06.846120] [INFO ] [REMOTE ] MCY: Full fetch complete (41820 records). [2025-09-17T20:13:06.846207] [DEBUG] [VALIDATOR ] MCY: Validating primary data. [2025-09-17T20:13:07.221521] [DEBUG] [VALIDATOR ] MCY: All expected trading days are present. [2025-09-17T20:13:07.221622] [DEBUG] [VALIDATOR ] MCY: Primary data validation passed. [2025-09-17T20:13:07.222292] [INFO ] [MAIN ] MCY: Fetched primary data is valid. [2025-09-17T20:13:07.222336] [DEBUG] [LOCAL ] MCY: Saving primary data. [2025-09-17T20:13:07.223248] [DEBUG] [LOCAL ] MCY: Trimmed 41820 records to 25667 (keeping 200 days of data) [2025-09-17T20:13:07.381415] [DEBUG] [LOCAL ] MCY: Primary data saved (25667 records). [2025-09-17T20:13:07.381551] [INFO ] [MAIN ] MCY: Full history saved. [2025-09-17T20:13:07.381629] [INFO ] [MAIN ] Update Progress: 1322/2371 symbols completed. MCY took 26.1s. Estimated remaining: 2h 33m 13s. Rate: 6.8 symbols/min [2025-09-17T20:13:07.548480] [INFO ] [MAIN ] MDV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:13:07.558212] [DEBUG] [LOCAL ] MDV: Loaded 8838 existing records from primary storage. [2025-09-17T20:13:07.558303] [INFO ] [MAIN ] MDV: Loaded 8838 existing records. [2025-09-17T20:13:07.621004] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-11. [2025-09-17T20:13:07.737406] [WARN ] [MAIN ] MDV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:13:07.737688] [INFO ] [MAIN ] MDV: Wiping existing primary data before full refresh. [2025-09-17T20:13:07.737740] [INFO ] [LOCAL ] MDV: Starting deletion of primary data. [2025-09-17T20:13:07.738139] [DEBUG] [LOCAL ] MDV: Deleted primary data file. [2025-09-17T20:13:07.738186] [INFO ] [MAIN ] MDV: Starting full primary refresh. [2025-09-17T20:13:08.093941] [INFO ] [REMOTE ] MDV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:13:08.371208] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T20:13:08.415720] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-03. [2025-09-17T20:13:09.215793] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-11. [2025-09-17T20:13:09.415091] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T20:13:09.956724] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T20:13:10.015753] [INFO ] [REMOTE ] MDV: Fetching primary data for 2024-12. [2025-09-17T20:13:10.087257] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T20:13:10.638699] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T20:13:10.815775] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-04. [2025-09-17T20:13:11.615789] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-07. [2025-09-17T20:13:12.415771] [INFO ] [REMOTE ] MDU: Fetching primary data for 2024-12. [2025-09-17T20:13:12.807029] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T20:13:13.068567] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T20:13:13.215755] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-08. [2025-09-17T20:13:14.021042] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-01. [2025-09-17T20:13:14.026589] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T20:13:14.651262] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T20:13:14.815746] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-02. [2025-09-17T20:13:14.845746] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T20:13:15.451058] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T20:13:15.615798] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-01. [2025-09-17T20:13:16.415788] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-03. [2025-09-17T20:13:17.001763] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T20:13:17.215764] [INFO ] [REMOTE ] MD: Fetching primary data for 2025-09. [2025-09-17T20:13:17.226259] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T20:13:17.907089] [INFO ] [REMOTE ] MD: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T20:13:17.912547] [INFO ] [REMOTE ] MD: Full fetch complete (55103 records). [2025-09-17T20:13:17.912752] [DEBUG] [VALIDATOR ] MD: Validating primary data. [2025-09-17T20:13:18.018881] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-04. [2025-09-17T20:13:18.314805] [DEBUG] [VALIDATOR ] MD: All expected trading days are present. [2025-09-17T20:13:18.314916] [DEBUG] [VALIDATOR ] MD: Primary data validation passed. [2025-09-17T20:13:18.316080] [INFO ] [MAIN ] MD: Fetched primary data is valid. [2025-09-17T20:13:18.316134] [DEBUG] [LOCAL ] MD: Saving primary data. [2025-09-17T20:13:18.317630] [DEBUG] [LOCAL ] MD: Trimmed 55103 records to 38815 (keeping 200 days of data) [2025-09-17T20:13:18.558584] [DEBUG] [LOCAL ] MD: Primary data saved (38815 records). [2025-09-17T20:13:18.558841] [INFO ] [MAIN ] MD: Full history saved. [2025-09-17T20:13:18.558964] [INFO ] [MAIN ] Update Progress: 1323/2371 symbols completed. MD took 37.3s. Estimated remaining: 2h 33m 6s. Rate: 6.8 symbols/min [2025-09-17T20:13:18.735147] [INFO ] [MAIN ] MEC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:13:18.753521] [DEBUG] [LOCAL ] MEC: Loaded 16612 existing records from primary storage. [2025-09-17T20:13:18.753734] [INFO ] [MAIN ] MEC: Loaded 16612 existing records. [2025-09-17T20:13:18.820963] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-05. [2025-09-17T20:13:18.950737] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T20:13:18.949528] [WARN ] [MAIN ] MEC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:13:18.954883] [INFO ] [MAIN ] MEC: Wiping existing primary data before full refresh. [2025-09-17T20:13:18.954962] [INFO ] [LOCAL ] MEC: Starting deletion of primary data. [2025-09-17T20:13:18.955575] [DEBUG] [LOCAL ] MEC: Deleted primary data file. [2025-09-17T20:13:18.955630] [INFO ] [MAIN ] MEC: Starting full primary refresh. [2025-09-17T20:13:19.340718] [INFO ] [REMOTE ] MEC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:13:19.615864] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-05. [2025-09-17T20:13:20.415847] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-02. [2025-09-17T20:13:20.530609] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T20:13:20.772592] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T20:13:21.215771] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-06. [2025-09-17T20:13:22.015820] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-11. [2025-09-17T20:13:22.043766] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T20:13:22.081078] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T20:13:22.815855] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-07. [2025-09-17T20:13:23.028715] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T20:13:23.576956] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T20:13:23.615889] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-08. [2025-09-17T20:13:24.217582] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T20:13:24.415849] [INFO ] [REMOTE ] MDV: Fetching primary data for 2025-09. [2025-09-17T20:13:24.804241] [INFO ] [REMOTE ] MDV: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T20:13:24.805534] [INFO ] [REMOTE ] MDV: Full fetch complete (11610 records). [2025-09-17T20:13:24.805624] [DEBUG] [VALIDATOR ] MDV: Validating primary data. [2025-09-17T20:13:25.168164] [DEBUG] [VALIDATOR ] MDV: All expected trading days are present. [2025-09-17T20:13:25.168253] [DEBUG] [VALIDATOR ] MDV: Primary data validation passed. [2025-09-17T20:13:25.168537] [INFO ] [MAIN ] MDV: Fetched primary data is valid. [2025-09-17T20:13:25.168580] [DEBUG] [LOCAL ] MDV: Saving primary data. [2025-09-17T20:13:25.169064] [DEBUG] [LOCAL ] MDV: Trimmed 11610 records to 8837 (keeping 200 days of data) [2025-09-17T20:13:25.218539] [INFO ] [REMOTE ] MEC: Fetching primary data for 2024-12. [2025-09-17T20:13:25.227134] [DEBUG] [LOCAL ] MDV: Primary data saved (8837 records). [2025-09-17T20:13:25.227351] [INFO ] [MAIN ] MDV: Full history saved. [2025-09-17T20:13:25.227453] [INFO ] [MAIN ] Update Progress: 1324/2371 symbols completed. MDV took 17.8s. Estimated remaining: 2h 32m 56s. Rate: 6.8 symbols/min [2025-09-17T20:13:25.396610] [INFO ] [MAIN ] MED: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:13:25.418582] [DEBUG] [LOCAL ] MED: Loaded 21964 existing records from primary storage. [2025-09-17T20:13:25.418735] [INFO ] [MAIN ] MED: Loaded 21964 existing records. [2025-09-17T20:13:25.615752] [WARN ] [MAIN ] MED: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:13:25.616166] [INFO ] [MAIN ] MED: Wiping existing primary data before full refresh. [2025-09-17T20:13:25.616222] [INFO ] [LOCAL ] MED: Starting deletion of primary data. [2025-09-17T20:13:25.617523] [DEBUG] [LOCAL ] MED: Deleted primary data file. [2025-09-17T20:13:25.617594] [INFO ] [MAIN ] MED: Starting full primary refresh. [2025-09-17T20:13:26.009217] [INFO ] [REMOTE ] MED: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:13:26.015846] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-03. [2025-09-17T20:13:26.397763] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T20:13:26.815810] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-06. [2025-09-17T20:13:27.424129] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T20:13:27.615835] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-04. [2025-09-17T20:13:28.415773] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-11. [2025-09-17T20:13:28.662903] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T20:13:28.861702] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T20:13:29.215784] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-05. [2025-09-17T20:13:29.623815] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T20:13:30.015813] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-01. [2025-09-17T20:13:30.815760] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-07. [2025-09-17T20:13:30.849705] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T20:13:31.012311] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T20:13:31.615800] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-02. [2025-09-17T20:13:32.271970] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T20:13:32.415806] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-03. [2025-09-17T20:13:32.720320] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T20:13:33.215780] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-06. [2025-09-17T20:13:33.317711] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T20:13:34.015894] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-04. [2025-09-17T20:13:34.768945] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T20:13:34.815812] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-08. [2025-09-17T20:13:35.029018] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T20:13:35.615790] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-05. [2025-09-17T20:13:36.415868] [INFO ] [REMOTE ] MED: Fetching primary data for 2024-12. [2025-09-17T20:13:36.660968] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T20:13:36.784362] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T20:13:37.215891] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-06. [2025-09-17T20:13:37.782927] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T20:13:38.015863] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-01. [2025-09-17T20:13:38.234048] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T20:13:38.815787] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-07. [2025-09-17T20:13:39.115461] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T20:13:39.615899] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-02. [2025-09-17T20:13:40.314991] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T20:13:40.374079] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T20:13:40.415736] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-08. [2025-09-17T20:13:41.215853] [INFO ] [REMOTE ] MDT: Fetching primary data for 2025-09. [2025-09-17T20:13:41.829697] [INFO ] [REMOTE ] MDT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T20:13:41.837063] [INFO ] [REMOTE ] MDT: Full fetch complete (77542 records). [2025-09-17T20:13:41.837252] [DEBUG] [VALIDATOR ] MDT: Validating primary data. [2025-09-17T20:13:42.023807] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-03. [2025-09-17T20:13:42.261041] [DEBUG] [VALIDATOR ] MDT: All expected trading days are present. [2025-09-17T20:13:42.261157] [DEBUG] [VALIDATOR ] MDT: Primary data validation passed. [2025-09-17T20:13:42.262427] [INFO ] [MAIN ] MDT: Fetched primary data is valid. [2025-09-17T20:13:42.262509] [DEBUG] [LOCAL ] MDT: Saving primary data. [2025-09-17T20:13:42.299968] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T20:13:42.300735] [DEBUG] [LOCAL ] MDT: Trimmed 77542 records to 53678 (keeping 200 days of data) [2025-09-17T20:13:42.690808] [DEBUG] [LOCAL ] MDT: Primary data saved (53678 records). [2025-09-17T20:13:42.691025] [INFO ] [MAIN ] MDT: Full history saved. [2025-09-17T20:13:42.692812] [INFO ] [MAIN ] Update Progress: 1325/2371 symbols completed. MDT took 1m 1s. Estimated remaining: 2h 32m 54s. Rate: 6.8 symbols/min [2025-09-17T20:13:42.820482] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-07. [2025-09-17T20:13:42.882433] [INFO ] [MAIN ] MEG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:13:42.924685] [DEBUG] [LOCAL ] MEG: Loaded 32157 existing records from primary storage. [2025-09-17T20:13:42.924896] [INFO ] [MAIN ] MEG: Loaded 32157 existing records. [2025-09-17T20:13:43.116067] [WARN ] [MAIN ] MEG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:13:43.116456] [INFO ] [MAIN ] MEG: Wiping existing primary data before full refresh. [2025-09-17T20:13:43.116508] [INFO ] [LOCAL ] MEG: Starting deletion of primary data. [2025-09-17T20:13:43.117437] [DEBUG] [LOCAL ] MEG: Deleted primary data file. [2025-09-17T20:13:43.117500] [INFO ] [MAIN ] MEG: Starting full primary refresh. [2025-09-17T20:13:43.509849] [INFO ] [REMOTE ] MEG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:13:43.526513] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T20:13:43.615773] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-11. [2025-09-17T20:13:43.767622] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T20:13:44.415827] [INFO ] [REMOTE ] MDU: Fetching primary data for 2025-09. [2025-09-17T20:13:45.066473] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T20:13:45.204069] [INFO ] [REMOTE ] MDU: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T20:13:45.212473] [INFO ] [REMOTE ] MDU: Full fetch complete (70039 records). [2025-09-17T20:13:45.212814] [DEBUG] [VALIDATOR ] MDU: Validating primary data. [2025-09-17T20:13:45.225541] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-04. [2025-09-17T20:13:45.630962] [DEBUG] [VALIDATOR ] MDU: All expected trading days are present. [2025-09-17T20:13:45.631079] [DEBUG] [VALIDATOR ] MDU: Primary data validation passed. [2025-09-17T20:13:45.632289] [INFO ] [MAIN ] MDU: Fetched primary data is valid. [2025-09-17T20:13:45.632359] [DEBUG] [LOCAL ] MDU: Saving primary data. [2025-09-17T20:13:45.634221] [DEBUG] [LOCAL ] MDU: Trimmed 70039 records to 47853 (keeping 200 days of data) [2025-09-17T20:13:45.957083] [DEBUG] [LOCAL ] MDU: Primary data saved (47853 records). [2025-09-17T20:13:45.957280] [INFO ] [MAIN ] MDU: Full history saved. [2025-09-17T20:13:45.957400] [INFO ] [MAIN ] Update Progress: 1326/2371 symbols completed. MDU took 39.9s. Estimated remaining: 2h 32m 41s. Rate: 6.8 symbols/min [2025-09-17T20:13:46.022667] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-08. [2025-09-17T20:13:46.134185] [INFO ] [MAIN ] MEGI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:13:46.157531] [DEBUG] [LOCAL ] MEGI: Loaded 20381 existing records from primary storage. [2025-09-17T20:13:46.157730] [INFO ] [MAIN ] MEGI: Loaded 20381 existing records. [2025-09-17T20:13:46.340307] [WARN ] [MAIN ] MEGI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:13:46.340687] [INFO ] [MAIN ] MEGI: Wiping existing primary data before full refresh. [2025-09-17T20:13:46.340776] [INFO ] [LOCAL ] MEGI: Starting deletion of primary data. [2025-09-17T20:13:46.341549] [DEBUG] [LOCAL ] MEGI: Deleted primary data file. [2025-09-17T20:13:46.341606] [INFO ] [MAIN ] MEGI: Starting full primary refresh. [2025-09-17T20:13:46.695143] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T20:13:46.746638] [INFO ] [REMOTE ] MEGI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:13:46.815835] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-05. [2025-09-17T20:13:47.135192] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T20:13:47.568018] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T20:13:47.615793] [INFO ] [REMOTE ] MEC: Fetching primary data for 2025-09. [2025-09-17T20:13:48.165123] [INFO ] [REMOTE ] MEC: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T20:13:48.167597] [INFO ] [REMOTE ] MEC: Full fetch complete (22540 records). [2025-09-17T20:13:48.167720] [DEBUG] [VALIDATOR ] MEC: Validating primary data. [2025-09-17T20:13:48.420911] [INFO ] [REMOTE ] MEG: Fetching primary data for 2024-12. [2025-09-17T20:13:48.547194] [DEBUG] [VALIDATOR ] MEC: All expected trading days are present. [2025-09-17T20:13:48.547290] [DEBUG] [VALIDATOR ] MEC: Primary data validation passed. [2025-09-17T20:13:48.547860] [INFO ] [MAIN ] MEC: Fetched primary data is valid. [2025-09-17T20:13:48.547905] [DEBUG] [LOCAL ] MEC: Saving primary data. [2025-09-17T20:13:48.548614] [DEBUG] [LOCAL ] MEC: Trimmed 22540 records to 16704 (keeping 200 days of data) [2025-09-17T20:13:48.648303] [DEBUG] [LOCAL ] MEC: Primary data saved (16704 records). [2025-09-17T20:13:48.648460] [INFO ] [MAIN ] MEC: Full history saved. [2025-09-17T20:13:48.648555] [INFO ] [MAIN ] Update Progress: 1327/2371 symbols completed. MEC took 30.1s. Estimated remaining: 2h 32m 27s. Rate: 6.8 symbols/min [2025-09-17T20:13:48.818945] [INFO ] [MAIN ] MEI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:13:48.850952] [DEBUG] [LOCAL ] MEI: Loaded 32583 existing records from primary storage. [2025-09-17T20:13:48.851099] [INFO ] [MAIN ] MEI: Loaded 32583 existing records. [2025-09-17T20:13:49.035784] [WARN ] [MAIN ] MEI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:13:49.036087] [INFO ] [MAIN ] MEI: Wiping existing primary data before full refresh. [2025-09-17T20:13:49.036170] [INFO ] [LOCAL ] MEI: Starting deletion of primary data. [2025-09-17T20:13:49.036934] [DEBUG] [LOCAL ] MEI: Deleted primary data file. [2025-09-17T20:13:49.036985] [INFO ] [MAIN ] MEI: Starting full primary refresh. [2025-09-17T20:13:49.221563] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-06. [2025-09-17T20:13:49.427584] [INFO ] [REMOTE ] MEI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:13:49.912045] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T20:13:50.015827] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-11. [2025-09-17T20:13:50.517862] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T20:13:50.815754] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-01. [2025-09-17T20:13:50.857440] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T20:13:51.615800] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-07. [2025-09-17T20:13:52.185328] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T20:13:52.354402] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T20:13:52.415764] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-08. [2025-09-17T20:13:53.215780] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2024-12. [2025-09-17T20:13:53.506069] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T20:13:54.015870] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-02. [2025-09-17T20:13:54.059049] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T20:13:54.815898] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-11. [2025-09-17T20:13:55.326254] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T20:13:55.615816] [INFO ] [REMOTE ] MED: Fetching primary data for 2025-09. [2025-09-17T20:13:55.905515] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T20:13:56.236830] [INFO ] [REMOTE ] MED: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T20:13:56.239752] [INFO ] [REMOTE ] MED: Full fetch complete (33163 records). [2025-09-17T20:13:56.239835] [DEBUG] [VALIDATOR ] MED: Validating primary data. [2025-09-17T20:13:56.429045] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-01. [2025-09-17T20:13:56.658126] [DEBUG] [VALIDATOR ] MED: All expected trading days are present. [2025-09-17T20:13:56.658230] [DEBUG] [VALIDATOR ] MED: Primary data validation passed. [2025-09-17T20:13:56.659223] [INFO ] [MAIN ] MED: Fetched primary data is valid. [2025-09-17T20:13:56.659278] [DEBUG] [LOCAL ] MED: Saving primary data. [2025-09-17T20:13:56.660302] [DEBUG] [LOCAL ] MED: Trimmed 33163 records to 21925 (keeping 200 days of data) [2025-09-17T20:13:56.800286] [DEBUG] [LOCAL ] MED: Primary data saved (21925 records). [2025-09-17T20:13:56.800462] [INFO ] [MAIN ] MED: Full history saved. [2025-09-17T20:13:56.800566] [INFO ] [MAIN ] Update Progress: 1328/2371 symbols completed. MED took 31.6s. Estimated remaining: 2h 32m 18s. Rate: 6.8 symbols/min [2025-09-17T20:13:56.975970] [INFO ] [MAIN ] MET: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:13:57.039739] [DEBUG] [LOCAL ] MET: Loaded 53314 existing records from primary storage. [2025-09-17T20:13:57.039973] [INFO ] [MAIN ] MET: Loaded 53314 existing records. [2025-09-17T20:13:57.223260] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-03. [2025-09-17T20:13:57.228922] [WARN ] [MAIN ] MET: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:13:57.230283] [INFO ] [MAIN ] MET: Wiping existing primary data before full refresh. [2025-09-17T20:13:57.230535] [INFO ] [LOCAL ] MET: Starting deletion of primary data. [2025-09-17T20:13:57.232026] [DEBUG] [LOCAL ] MET: Deleted primary data file. [2025-09-17T20:13:57.232092] [INFO ] [MAIN ] MET: Starting full primary refresh. [2025-09-17T20:13:57.613818] [INFO ] [REMOTE ] MET: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:13:57.628619] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T20:13:58.015802] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-02. [2025-09-17T20:13:58.503320] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T20:13:58.603345] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T20:13:58.815784] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-03. [2025-09-17T20:13:59.615808] [INFO ] [REMOTE ] MEI: Fetching primary data for 2024-12. [2025-09-17T20:13:59.900305] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T20:14:00.415771] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-04. [2025-09-17T20:14:01.086808] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T20:14:01.215931] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-04. [2025-09-17T20:14:01.657944] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T20:14:02.015813] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-11. [2025-09-17T20:14:02.599695] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T20:14:02.815813] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-01. [2025-09-17T20:14:03.479384] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T20:14:03.615815] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-05. [2025-09-17T20:14:03.853524] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T20:14:04.415819] [INFO ] [REMOTE ] MET: Fetching primary data for 2024-12. [2025-09-17T20:14:04.594454] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T20:14:05.215813] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-02. [2025-09-17T20:14:05.973523] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T20:14:06.015775] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-01. [2025-09-17T20:14:06.231770] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T20:14:06.815806] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-03. [2025-09-17T20:14:07.615830] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-06. [2025-09-17T20:14:07.903795] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T20:14:08.264299] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T20:14:08.415800] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-04. [2025-09-17T20:14:08.575766] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T20:14:09.215850] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-07. [2025-09-17T20:14:09.915944] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T20:14:10.015773] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-05. [2025-09-17T20:14:10.334516] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T20:14:10.815826] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-05. [2025-09-17T20:14:11.248200] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T20:14:11.615788] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-06. [2025-09-17T20:14:12.164477] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T20:14:12.376221] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T20:14:12.415726] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-07. [2025-09-17T20:14:13.215811] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-08. [2025-09-17T20:14:13.924469] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T20:14:13.986586] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T20:14:14.015758] [INFO ] [REMOTE ] MEGI: Fetching primary data for 2025-09. [2025-09-17T20:14:14.643409] [INFO ] [REMOTE ] MEGI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T20:14:14.650583] [INFO ] [REMOTE ] MEGI: Full fetch complete (30814 records). [2025-09-17T20:14:14.650738] [DEBUG] [VALIDATOR ] MEGI: Validating primary data. [2025-09-17T20:14:14.825834] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-08. [2025-09-17T20:14:15.025724] [DEBUG] [VALIDATOR ] MEGI: All expected trading days are present. [2025-09-17T20:14:15.025807] [DEBUG] [VALIDATOR ] MEGI: Primary data validation passed. [2025-09-17T20:14:15.026444] [INFO ] [MAIN ] MEGI: Fetched primary data is valid. [2025-09-17T20:14:15.026491] [DEBUG] [LOCAL ] MEGI: Saving primary data. [2025-09-17T20:14:15.027276] [DEBUG] [LOCAL ] MEGI: Trimmed 30814 records to 20616 (keeping 200 days of data) [2025-09-17T20:14:15.153766] [DEBUG] [LOCAL ] MEGI: Primary data saved (20616 records). [2025-09-17T20:14:15.153909] [INFO ] [MAIN ] MEGI: Full history saved. [2025-09-17T20:14:15.153994] [INFO ] [MAIN ] Update Progress: 1329/2371 symbols completed. MEGI took 29.2s. Estimated remaining: 2h 32m 17s. Rate: 6.8 symbols/min [2025-09-17T20:14:15.326421] [INFO ] [MAIN ] MFA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:14:15.391035] [DEBUG] [LOCAL ] MFA: Loaded 45125 existing records from primary storage. [2025-09-17T20:14:15.391282] [INFO ] [MAIN ] MFA: Loaded 45125 existing records. [2025-09-17T20:14:15.586182] [WARN ] [MAIN ] MFA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:14:15.586632] [INFO ] [MAIN ] MFA: Wiping existing primary data before full refresh. [2025-09-17T20:14:15.586724] [INFO ] [LOCAL ] MFA: Starting deletion of primary data. [2025-09-17T20:14:15.587992] [DEBUG] [LOCAL ] MFA: Deleted primary data file. [2025-09-17T20:14:15.588067] [INFO ] [MAIN ] MFA: Starting full primary refresh. [2025-09-17T20:14:15.621189] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-06. [2025-09-17T20:14:15.976104] [INFO ] [REMOTE ] MFA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:14:16.247550] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T20:14:16.415867] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-11. [2025-09-17T20:14:16.839190] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T20:14:17.215886] [INFO ] [REMOTE ] MEI: Fetching primary data for 2025-09. [2025-09-17T20:14:17.907848] [INFO ] [REMOTE ] MEI: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T20:14:17.914588] [INFO ] [REMOTE ] MEI: Full fetch complete (45560 records). [2025-09-17T20:14:17.914759] [DEBUG] [VALIDATOR ] MEI: Validating primary data. [2025-09-17T20:14:18.026818] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-07. [2025-09-17T20:14:18.344131] [DEBUG] [VALIDATOR ] MEI: All expected trading days are present. [2025-09-17T20:14:18.359141] [DEBUG] [VALIDATOR ] MEI: Primary data validation passed. [2025-09-17T20:14:18.371485] [INFO ] [MAIN ] MEI: Fetched primary data is valid. [2025-09-17T20:14:18.371997] [DEBUG] [LOCAL ] MEI: Saving primary data. [2025-09-17T20:14:18.374155] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T20:14:18.384580] [DEBUG] [LOCAL ] MEI: Trimmed 45560 records to 32663 (keeping 200 days of data) [2025-09-17T20:14:18.625828] [DEBUG] [LOCAL ] MEI: Primary data saved (32663 records). [2025-09-17T20:14:18.626065] [INFO ] [MAIN ] MEI: Full history saved. [2025-09-17T20:14:18.626219] [INFO ] [MAIN ] Update Progress: 1330/2371 symbols completed. MEI took 30.0s. Estimated remaining: 2h 32m 4s. Rate: 6.8 symbols/min [2025-09-17T20:14:18.804989] [INFO ] [MAIN ] MFAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:14:18.811711] [DEBUG] [LOCAL ] MFAN: Loaded 4293 existing records from primary storage. [2025-09-17T20:14:18.811836] [INFO ] [MAIN ] MFAN: Loaded 4293 existing records. [2025-09-17T20:14:18.823263] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-02. [2025-09-17T20:14:19.001404] [WARN ] [MAIN ] MFAN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:14:19.001766] [INFO ] [MAIN ] MFAN: Wiping existing primary data before full refresh. [2025-09-17T20:14:19.001833] [INFO ] [LOCAL ] MFAN: Starting deletion of primary data. [2025-09-17T20:14:19.002153] [DEBUG] [LOCAL ] MFAN: Deleted primary data file. [2025-09-17T20:14:19.002221] [INFO ] [MAIN ] MFAN: Starting full primary refresh. [2025-09-17T20:14:19.376694] [INFO ] [REMOTE ] MFAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:14:19.398589] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T20:14:19.615839] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-08. [2025-09-17T20:14:20.415807] [INFO ] [REMOTE ] MFA: Fetching primary data for 2024-12. [2025-09-17T20:14:20.794931] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T20:14:21.215873] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-03. [2025-09-17T20:14:21.249036] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T20:14:21.960975] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T20:14:22.015846] [INFO ] [REMOTE ] MEG: Fetching primary data for 2025-09. [2025-09-17T20:14:22.510329] [INFO ] [REMOTE ] MEG: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T20:14:22.515105] [INFO ] [REMOTE ] MEG: Full fetch complete (48175 records). [2025-09-17T20:14:22.515227] [DEBUG] [VALIDATOR ] MEG: Validating primary data. [2025-09-17T20:14:22.824261] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-01. [2025-09-17T20:14:22.932537] [DEBUG] [VALIDATOR ] MEG: All expected trading days are present. [2025-09-17T20:14:22.932709] [DEBUG] [VALIDATOR ] MEG: Primary data validation passed. [2025-09-17T20:14:22.933977] [INFO ] [MAIN ] MEG: Fetched primary data is valid. [2025-09-17T20:14:22.934056] [DEBUG] [LOCAL ] MEG: Saving primary data. [2025-09-17T20:14:22.935837] [DEBUG] [LOCAL ] MEG: Trimmed 48175 records to 32122 (keeping 200 days of data) [2025-09-17T20:14:23.168030] [DEBUG] [LOCAL ] MEG: Primary data saved (32122 records). [2025-09-17T20:14:23.168357] [INFO ] [MAIN ] MEG: Full history saved. [2025-09-17T20:14:23.168497] [INFO ] [MAIN ] Update Progress: 1331/2371 symbols completed. MEG took 40.5s. Estimated remaining: 2h 31m 52s. Rate: 6.8 symbols/min [2025-09-17T20:14:23.363351] [INFO ] [MAIN ] MFAO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:14:23.412347] [DEBUG] [LOCAL ] MFAO: Loaded 3844 existing records from primary storage. [2025-09-17T20:14:23.413375] [INFO ] [MAIN ] MFAO: Loaded 3844 existing records. [2025-09-17T20:14:23.421939] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-03 (2.21 seconds). [2025-09-17T20:14:23.617480] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-11. [2025-09-17T20:14:23.621773] [WARN ] [MAIN ] MFAO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:14:23.623199] [INFO ] [MAIN ] MFAO: Wiping existing primary data before full refresh. [2025-09-17T20:14:23.623250] [INFO ] [LOCAL ] MFAO: Starting deletion of primary data. [2025-09-17T20:14:23.623730] [DEBUG] [LOCAL ] MFAO: Deleted primary data file. [2025-09-17T20:14:23.623796] [INFO ] [MAIN ] MFAO: Starting full primary refresh. [2025-09-17T20:14:24.090815] [INFO ] [REMOTE ] MFAO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:14:24.119188] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-11 (0.50 seconds). [2025-09-17T20:14:24.415869] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-04. [2025-09-17T20:14:24.451594] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T20:14:25.215871] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-02. [2025-09-17T20:14:26.015871] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2024-12. [2025-09-17T20:14:26.314131] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T20:14:26.453561] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-17T20:14:26.815874] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-01. [2025-09-17T20:14:26.865012] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T20:14:27.372462] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-01 (0.56 seconds). [2025-09-17T20:14:27.615871] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-03. [2025-09-17T20:14:28.415892] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-05. [2025-09-17T20:14:29.215798] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-02. [2025-09-17T20:14:29.250240] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T20:14:29.680118] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T20:14:30.015714] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-04. [2025-09-17T20:14:30.101760] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T20:14:30.815791] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-11. [2025-09-17T20:14:31.392465] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T20:14:31.615780] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2024-12. [2025-09-17T20:14:31.731447] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T20:14:31.898628] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2024-12 (0.28 seconds). [2025-09-17T20:14:32.415780] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-01. [2025-09-17T20:14:32.962859] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T20:14:33.215847] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-06. [2025-09-17T20:14:34.015832] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-03. [2025-09-17T20:14:34.585939] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T20:14:34.815830] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-05. [2025-09-17T20:14:34.920077] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T20:14:35.615840] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-07. [2025-09-17T20:14:36.415822] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-02. [2025-09-17T20:14:36.580291] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T20:14:37.012348] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T20:14:37.166388] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T20:14:37.215760] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-08. [2025-09-17T20:14:38.015886] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-06. [2025-09-17T20:14:38.815799] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-03. [2025-09-17T20:14:39.030385] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T20:14:39.173254] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T20:14:39.505208] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T20:14:39.615797] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-07. [2025-09-17T20:14:40.415830] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-04. [2025-09-17T20:14:40.890045] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T20:14:41.215843] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-04. [2025-09-17T20:14:41.302059] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T20:14:41.891604] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T20:14:42.015801] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-05. [2025-09-17T20:14:42.665579] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T20:14:42.815813] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-08. [2025-09-17T20:14:43.615834] [INFO ] [REMOTE ] MET: Fetching primary data for 2025-09. [2025-09-17T20:14:44.414091] [INFO ] [REMOTE ] MET: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T20:14:44.420718] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-05. [2025-09-17T20:14:44.422749] [INFO ] [REMOTE ] MET: Full fetch complete (76945 records). [2025-09-17T20:14:44.422842] [DEBUG] [VALIDATOR ] MET: Validating primary data. [2025-09-17T20:14:44.849104] [DEBUG] [VALIDATOR ] MET: All expected trading days are present. [2025-09-17T20:14:44.852719] [DEBUG] [VALIDATOR ] MET: Primary data validation passed. [2025-09-17T20:14:44.853916] [INFO ] [MAIN ] MET: Fetched primary data is valid. [2025-09-17T20:14:44.853984] [DEBUG] [LOCAL ] MET: Saving primary data. [2025-09-17T20:14:44.856864] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T20:14:44.867500] [DEBUG] [LOCAL ] MET: Trimmed 76945 records to 53314 (keeping 200 days of data) [2025-09-17T20:14:45.116626] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T20:14:45.215914] [INFO ] [REMOTE ] MFA: Fetching primary data for 2025-09. [2025-09-17T20:14:45.243900] [DEBUG] [LOCAL ] MET: Primary data saved (53314 records). [2025-09-17T20:14:45.244091] [INFO ] [MAIN ] MET: Full history saved. [2025-09-17T20:14:45.245745] [INFO ] [MAIN ] Update Progress: 1332/2371 symbols completed. MET took 48.4s. Estimated remaining: 2h 31m 53s. Rate: 6.8 symbols/min [2025-09-17T20:14:45.426075] [INFO ] [MAIN ] MFC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:14:45.484836] [DEBUG] [LOCAL ] MFC: Loaded 51421 existing records from primary storage. [2025-09-17T20:14:45.485034] [INFO ] [MAIN ] MFC: Loaded 51421 existing records. [2025-09-17T20:14:45.678332] [WARN ] [MAIN ] MFC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:14:45.678714] [INFO ] [MAIN ] MFC: Wiping existing primary data before full refresh. [2025-09-17T20:14:45.678766] [INFO ] [LOCAL ] MFC: Starting deletion of primary data. [2025-09-17T20:14:45.680087] [DEBUG] [LOCAL ] MFC: Deleted primary data file. [2025-09-17T20:14:45.680147] [INFO ] [MAIN ] MFC: Starting full primary refresh. [2025-09-17T20:14:46.019723] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-06. [2025-09-17T20:14:46.050326] [INFO ] [REMOTE ] MFC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:14:46.066721] [INFO ] [REMOTE ] MFA: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T20:14:46.073370] [INFO ] [REMOTE ] MFA: Full fetch complete (64354 records). [2025-09-17T20:14:46.073921] [DEBUG] [VALIDATOR ] MFA: Validating primary data. [2025-09-17T20:14:46.497285] [DEBUG] [VALIDATOR ] MFA: All expected trading days are present. [2025-09-17T20:14:46.497404] [DEBUG] [VALIDATOR ] MFA: Primary data validation passed. [2025-09-17T20:14:46.498837] [INFO ] [MAIN ] MFA: Fetched primary data is valid. [2025-09-17T20:14:46.498923] [DEBUG] [LOCAL ] MFA: Saving primary data. [2025-09-17T20:14:46.500560] [DEBUG] [LOCAL ] MFA: Trimmed 64354 records to 45140 (keeping 200 days of data) [2025-09-17T20:14:46.607115] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T20:14:46.816248] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-11. [2025-09-17T20:14:46.896009] [DEBUG] [LOCAL ] MFA: Primary data saved (45140 records). [2025-09-17T20:14:46.896223] [INFO ] [MAIN ] MFA: Full history saved. [2025-09-17T20:14:46.896353] [INFO ] [MAIN ] Update Progress: 1333/2371 symbols completed. MFA took 31.7s. Estimated remaining: 2h 31m 39s. Rate: 6.8 symbols/min [2025-09-17T20:14:47.153377] [INFO ] [MAIN ] MFG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:14:47.217348] [DEBUG] [LOCAL ] MFG: Loaded 48915 existing records from primary storage. [2025-09-17T20:14:47.217587] [INFO ] [MAIN ] MFG: Loaded 48915 existing records. [2025-09-17T20:14:47.470317] [WARN ] [MAIN ] MFG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:14:47.470611] [INFO ] [MAIN ] MFG: Wiping existing primary data before full refresh. [2025-09-17T20:14:47.470687] [INFO ] [LOCAL ] MFG: Starting deletion of primary data. [2025-09-17T20:14:47.471530] [DEBUG] [LOCAL ] MFG: Deleted primary data file. [2025-09-17T20:14:47.471579] [INFO ] [MAIN ] MFG: Starting full primary refresh. [2025-09-17T20:14:47.626363] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-06. [2025-09-17T20:14:47.860548] [INFO ] [REMOTE ] MFG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:14:48.257186] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T20:14:48.415807] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-07. [2025-09-17T20:14:48.505748] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T20:14:48.980028] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T20:14:49.215785] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-11. [2025-09-17T20:14:50.015802] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-08. [2025-09-17T20:14:50.746707] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T20:14:50.789155] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T20:14:50.815745] [INFO ] [REMOTE ] MFAN: Fetching primary data for 2025-09. [2025-09-17T20:14:51.367129] [INFO ] [REMOTE ] MFAN: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T20:14:51.368350] [INFO ] [REMOTE ] MFAN: Full fetch complete (5500 records). [2025-09-17T20:14:51.368426] [DEBUG] [VALIDATOR ] MFAN: Validating primary data. [2025-09-17T20:14:51.620997] [INFO ] [REMOTE ] MFC: Fetching primary data for 2024-12. [2025-09-17T20:14:51.769243] [DEBUG] [VALIDATOR ] MFAN: All expected trading days are present. [2025-09-17T20:14:51.769352] [DEBUG] [VALIDATOR ] MFAN: Primary data validation passed. [2025-09-17T20:14:51.769680] [INFO ] [MAIN ] MFAN: Fetched primary data is valid. [2025-09-17T20:14:51.769731] [DEBUG] [LOCAL ] MFAN: Saving primary data. [2025-09-17T20:14:51.770339] [DEBUG] [LOCAL ] MFAN: Trimmed 5500 records to 4281 (keeping 200 days of data) [2025-09-17T20:14:51.803161] [DEBUG] [LOCAL ] MFAN: Primary data saved (4281 records). [2025-09-17T20:14:51.803377] [INFO ] [MAIN ] MFAN: Full history saved. [2025-09-17T20:14:51.803511] [INFO ] [MAIN ] Update Progress: 1334/2371 symbols completed. MFAN took 33.2s. Estimated remaining: 2h 31m 27s. Rate: 6.8 symbols/min [2025-09-17T20:14:52.001200] [INFO ] [MAIN ] MFM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:14:52.019614] [DEBUG] [LOCAL ] MFM: Loaded 14329 existing records from primary storage. [2025-09-17T20:14:52.019886] [INFO ] [MAIN ] MFM: Loaded 14329 existing records. [2025-09-17T20:14:52.222777] [WARN ] [MAIN ] MFM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:14:52.223150] [INFO ] [MAIN ] MFM: Wiping existing primary data before full refresh. [2025-09-17T20:14:52.223293] [INFO ] [LOCAL ] MFM: Starting deletion of primary data. [2025-09-17T20:14:52.223929] [DEBUG] [LOCAL ] MFM: Deleted primary data file. [2025-09-17T20:14:52.223988] [INFO ] [MAIN ] MFM: Starting full primary refresh. [2025-09-17T20:14:52.422165] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-07. [2025-09-17T20:14:52.598509] [INFO ] [REMOTE ] MFM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:14:53.084251] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T20:14:53.119850] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T20:14:53.215787] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-11. [2025-09-17T20:14:53.969944] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T20:14:54.015797] [INFO ] [REMOTE ] MFG: Fetching primary data for 2024-12. [2025-09-17T20:14:54.815786] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-08. [2025-09-17T20:14:55.285980] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T20:14:55.518512] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T20:14:55.615804] [INFO ] [REMOTE ] MFAO: Fetching primary data for 2025-09. [2025-09-17T20:14:56.027401] [INFO ] [REMOTE ] MFAO: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T20:14:56.028971] [INFO ] [REMOTE ] MFAO: Full fetch complete (5322 records). [2025-09-17T20:14:56.029065] [DEBUG] [VALIDATOR ] MFAO: Validating primary data. [2025-09-17T20:14:56.411065] [DEBUG] [VALIDATOR ] MFAO: All expected trading days are present. [2025-09-17T20:14:56.411166] [DEBUG] [VALIDATOR ] MFAO: Primary data validation passed. [2025-09-17T20:14:56.411380] [INFO ] [MAIN ] MFAO: Fetched primary data is valid. [2025-09-17T20:14:56.411424] [DEBUG] [LOCAL ] MFAO: Saving primary data. [2025-09-17T20:14:56.411983] [DEBUG] [LOCAL ] MFAO: Trimmed 5322 records to 3834 (keeping 200 days of data) [2025-09-17T20:14:56.423327] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-01. [2025-09-17T20:14:56.440369] [DEBUG] [LOCAL ] MFAO: Primary data saved (3834 records). [2025-09-17T20:14:56.440527] [INFO ] [MAIN ] MFAO: Full history saved. [2025-09-17T20:14:56.440673] [INFO ] [MAIN ] Update Progress: 1335/2371 symbols completed. MFAO took 33.3s. Estimated remaining: 2h 31m 15s. Rate: 6.8 symbols/min [2025-09-17T20:14:56.620206] [INFO ] [MAIN ] MFSB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:14:56.620423] [DEBUG] [LOCAL ] MFSB: No existing data file found in primary storage. [2025-09-17T20:14:56.620461] [WARN ] [MAIN ] MFSB: No existing data found, performing full refresh instead. [2025-09-17T20:14:56.620629] [INFO ] [MAIN ] MFSB: Wiping existing primary data before full refresh. [2025-09-17T20:14:56.620692] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-17T20:14:56.620764] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-17T20:14:56.620798] [INFO ] [MAIN ] MFSB: Starting full primary refresh. [2025-09-17T20:14:56.973145] [INFO ] [REMOTE ] MFSB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:14:57.215781] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-11. [2025-09-17T20:14:57.415544] [DEBUG] [REMOTE ] MFSB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:14:57.416074] [WARN ] [REMOTE ] MFSB: No data returned for month 2024-11 [2025-09-17T20:14:58.015817] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2024-12. [2025-09-17T20:14:58.168417] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T20:14:58.502556] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-17T20:14:58.815817] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-02. [2025-09-17T20:14:59.615830] [INFO ] [REMOTE ] MFM: Fetching primary data for 2024-12. [2025-09-17T20:15:00.258832] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T20:15:00.415810] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-01. [2025-09-17T20:15:00.442490] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T20:15:01.215808] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-03. [2025-09-17T20:15:02.015884] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-01. [2025-09-17T20:15:02.248872] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T20:15:02.262718] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-01 (0.25 seconds). [2025-09-17T20:15:02.815856] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-01. [2025-09-17T20:15:03.540051] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T20:15:03.615857] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-02. [2025-09-17T20:15:03.948824] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-03 (2.73 seconds). [2025-09-17T20:15:04.415757] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-02. [2025-09-17T20:15:04.498737] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T20:15:05.215823] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-02. [2025-09-17T20:15:05.608579] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-02 (0.39 seconds). [2025-09-17T20:15:05.941187] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T20:15:06.015778] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-03. [2025-09-17T20:15:06.815847] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-03. [2025-09-17T20:15:07.172555] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T20:15:07.458269] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T20:15:07.615780] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-04. [2025-09-17T20:15:08.415854] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-04. [2025-09-17T20:15:08.761515] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-17T20:15:09.215857] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-05. [2025-09-17T20:15:09.491008] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T20:15:09.505992] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-17T20:15:10.015827] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-04. [2025-09-17T20:15:10.815828] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-06. [2025-09-17T20:15:11.144233] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-06 (0.33 seconds). [2025-09-17T20:15:11.615809] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-05. [2025-09-17T20:15:11.773748] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T20:15:12.415866] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-03. [2025-09-17T20:15:13.215853] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-05. [2025-09-17T20:15:13.237999] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T20:15:13.735014] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T20:15:14.015873] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-06. [2025-09-17T20:15:14.815839] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-07. [2025-09-17T20:15:15.081010] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T20:15:15.098478] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-07 (0.28 seconds). [2025-09-17T20:15:15.549710] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T20:15:15.615858] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-07. [2025-09-17T20:15:16.415867] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-08. [2025-09-17T20:15:16.981774] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T20:15:17.136075] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T20:15:17.215836] [INFO ] [REMOTE ] MFSB: Fetching primary data for 2025-09. [2025-09-17T20:15:17.586726] [INFO ] [REMOTE ] MFSB: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T20:15:17.588164] [INFO ] [REMOTE ] MFSB: Full fetch complete (1443 records). [2025-09-17T20:15:17.588248] [DEBUG] [VALIDATOR ] MFSB: Validating primary data. [2025-09-17T20:15:17.775661] [WARN ] [VALIDATOR ] MFSB: Validation failed - insufficient historical data. Have 177 unique days, need 200 days [2025-09-17T20:15:17.775889] [FATAL] [MAIN ] MFSB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:15:17.775941] [WARN ] [MAIN ] MFSB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:15:17.775984] [INFO ] [LOCAL ] MFSB: Starting deletion of primary data. [2025-09-17T20:15:17.776041] [DEBUG] [LOCAL ] MFSB: No primary data file found to delete. [2025-09-17T20:15:17.776076] [INFO ] [LOCAL ] MFSB: Starting deletion of derivative data. [2025-09-17T20:15:17.776125] [DEBUG] [LOCAL ] MFSB: No derivative data file found to delete. [2025-09-17T20:15:17.776193] [INFO ] [MAIN ] Update Progress: 1336/2371 symbols completed. MFSB took 21.3s. Estimated remaining: 2h 31m 16s. Rate: 6.8 symbols/min [2025-09-17T20:15:17.942950] [INFO ] [MAIN ] MFSG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:15:17.943169] [DEBUG] [LOCAL ] MFSG: No existing data file found in primary storage. [2025-09-17T20:15:17.943210] [WARN ] [MAIN ] MFSG: No existing data found, performing full refresh instead. [2025-09-17T20:15:17.943334] [INFO ] [MAIN ] MFSG: Wiping existing primary data before full refresh. [2025-09-17T20:15:17.943375] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-17T20:15:17.943415] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-17T20:15:17.943448] [INFO ] [MAIN ] MFSG: Starting full primary refresh. [2025-09-17T20:15:18.020995] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-04. [2025-09-17T20:15:18.313330] [INFO ] [REMOTE ] MFSG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:15:18.815936] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-08. [2025-09-17T20:15:19.286260] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T20:15:19.615865] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-06. [2025-09-17T20:15:20.415905] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-11. [2025-09-17T20:15:20.615177] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T20:15:20.627327] [DEBUG] [REMOTE ] MFSG: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:15:20.628458] [WARN ] [REMOTE ] MFSG: No data returned for month 2024-11 [2025-09-17T20:15:21.215769] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2024-12. [2025-09-17T20:15:21.278841] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T20:15:21.558403] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-17T20:15:22.015797] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-05. [2025-09-17T20:15:22.688233] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T20:15:22.815887] [INFO ] [REMOTE ] MFC: Fetching primary data for 2025-09. [2025-09-17T20:15:23.623742] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-01. [2025-09-17T20:15:23.631056] [INFO ] [REMOTE ] MFC: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T20:15:23.638230] [INFO ] [REMOTE ] MFC: Full fetch complete (74190 records). [2025-09-17T20:15:23.638406] [DEBUG] [VALIDATOR ] MFC: Validating primary data. [2025-09-17T20:15:24.037604] [DEBUG] [VALIDATOR ] MFC: All expected trading days are present. [2025-09-17T20:15:24.037704] [DEBUG] [VALIDATOR ] MFC: Primary data validation passed. [2025-09-17T20:15:24.038653] [INFO ] [MAIN ] MFC: Fetched primary data is valid. [2025-09-17T20:15:24.038702] [DEBUG] [LOCAL ] MFC: Saving primary data. [2025-09-17T20:15:24.040155] [DEBUG] [LOCAL ] MFC: Trimmed 74190 records to 51406 (keeping 200 days of data) [2025-09-17T20:15:24.139143] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T20:15:24.388019] [DEBUG] [LOCAL ] MFC: Primary data saved (51406 records). [2025-09-17T20:15:24.388189] [INFO ] [MAIN ] MFC: Full history saved. [2025-09-17T20:15:24.388875] [INFO ] [MAIN ] Update Progress: 1337/2371 symbols completed. MFC took 39.1s. Estimated remaining: 2h 31m 6s. Rate: 6.8 symbols/min [2025-09-17T20:15:24.420883] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-02. [2025-09-17T20:15:24.561815] [INFO ] [MAIN ] MFSI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:15:24.561998] [DEBUG] [LOCAL ] MFSI: No existing data file found in primary storage. [2025-09-17T20:15:24.562036] [WARN ] [MAIN ] MFSI: No existing data found, performing full refresh instead. [2025-09-17T20:15:24.562154] [INFO ] [MAIN ] MFSI: Wiping existing primary data before full refresh. [2025-09-17T20:15:24.562192] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-17T20:15:24.562232] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-17T20:15:24.562271] [INFO ] [MAIN ] MFSI: Starting full primary refresh. [2025-09-17T20:15:24.923822] [INFO ] [REMOTE ] MFSI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:15:24.926606] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T20:15:25.215785] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-03. [2025-09-17T20:15:25.655329] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T20:15:26.015827] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-07. [2025-09-17T20:15:26.815832] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-04. [2025-09-17T20:15:27.455886] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T20:15:27.615799] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-05. [2025-09-17T20:15:27.797662] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T20:15:28.187304] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T20:15:28.415791] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-06. [2025-09-17T20:15:29.031990] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T20:15:29.215801] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-07. [2025-09-17T20:15:29.810734] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T20:15:30.015775] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-06. [2025-09-17T20:15:30.741750] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T20:15:30.815768] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-07. [2025-09-17T20:15:31.615790] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-11. [2025-09-17T20:15:31.786277] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T20:15:31.834258] [DEBUG] [REMOTE ] MFSI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:15:31.834702] [WARN ] [REMOTE ] MFSI: No data returned for month 2024-11 [2025-09-17T20:15:32.415873] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-08. [2025-09-17T20:15:33.048947] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T20:15:33.215800] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-08. [2025-09-17T20:15:34.015926] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-08. [2025-09-17T20:15:34.636364] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T20:15:34.815826] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2024-12. [2025-09-17T20:15:35.036528] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T20:15:35.382761] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T20:15:35.615777] [INFO ] [REMOTE ] MFG: Fetching primary data for 2025-09. [2025-09-17T20:15:36.392353] [INFO ] [REMOTE ] MFG: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T20:15:36.399162] [INFO ] [REMOTE ] MFG: Full fetch complete (68283 records). [2025-09-17T20:15:36.399335] [DEBUG] [VALIDATOR ] MFG: Validating primary data. [2025-09-17T20:15:36.420877] [INFO ] [REMOTE ] MFM: Fetching primary data for 2025-09. [2025-09-17T20:15:36.795862] [DEBUG] [VALIDATOR ] MFG: All expected trading days are present. [2025-09-17T20:15:36.795948] [DEBUG] [VALIDATOR ] MFG: Primary data validation passed. [2025-09-17T20:15:36.796997] [INFO ] [MAIN ] MFG: Fetched primary data is valid. [2025-09-17T20:15:36.797077] [DEBUG] [LOCAL ] MFG: Saving primary data. [2025-09-17T20:15:36.798582] [DEBUG] [LOCAL ] MFG: Trimmed 68283 records to 48945 (keeping 200 days of data) [2025-09-17T20:15:37.083655] [DEBUG] [LOCAL ] MFG: Primary data saved (48945 records). [2025-09-17T20:15:37.083945] [INFO ] [MAIN ] MFG: Full history saved. [2025-09-17T20:15:37.084129] [INFO ] [MAIN ] Update Progress: 1338/2371 symbols completed. MFG took 50.2s. Estimated remaining: 2h 31m 0s. Rate: 6.8 symbols/min [2025-09-17T20:15:37.209238] [INFO ] [REMOTE ] MFM: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T20:15:37.235263] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-01. [2025-09-17T20:15:37.264985] [INFO ] [MAIN ] MFSV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:15:37.266352] [DEBUG] [LOCAL ] MFSV: No existing data file found in primary storage. [2025-09-17T20:15:37.266484] [WARN ] [MAIN ] MFSV: No existing data found, performing full refresh instead. [2025-09-17T20:15:37.266616] [INFO ] [MAIN ] MFSV: Wiping existing primary data before full refresh. [2025-09-17T20:15:37.266676] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-17T20:15:37.266719] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-17T20:15:37.266757] [INFO ] [MAIN ] MFSV: Starting full primary refresh. [2025-09-17T20:15:37.272535] [INFO ] [REMOTE ] MFM: Full fetch complete (19075 records). [2025-09-17T20:15:37.287532] [DEBUG] [VALIDATOR ] MFM: Validating primary data. [2025-09-17T20:15:38.037466] [INFO ] [REMOTE ] MFSG: Fetching primary data for 2025-09. [2025-09-17T20:15:38.037341] [INFO ] [REMOTE ] MFSV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:15:38.054398] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T20:15:38.069009] [DEBUG] [VALIDATOR ] MFM: All expected trading days are present. [2025-09-17T20:15:38.069110] [DEBUG] [VALIDATOR ] MFM: Primary data validation passed. [2025-09-17T20:15:38.069757] [INFO ] [MAIN ] MFM: Fetched primary data is valid. [2025-09-17T20:15:38.069837] [DEBUG] [LOCAL ] MFM: Saving primary data. [2025-09-17T20:15:38.071253] [DEBUG] [LOCAL ] MFM: Trimmed 19075 records to 14344 (keeping 200 days of data) [2025-09-17T20:15:38.162045] [DEBUG] [LOCAL ] MFM: Primary data saved (14344 records). [2025-09-17T20:15:38.162209] [INFO ] [MAIN ] MFM: Full history saved. [2025-09-17T20:15:38.162305] [INFO ] [MAIN ] Update Progress: 1339/2371 symbols completed. MFM took 46.4s. Estimated remaining: 2h 30m 45s. Rate: 6.8 symbols/min [2025-09-17T20:15:38.333021] [INFO ] [MAIN ] MG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:15:38.350832] [DEBUG] [LOCAL ] MG: Loaded 16874 existing records from primary storage. [2025-09-17T20:15:38.350966] [INFO ] [MAIN ] MG: Loaded 16874 existing records. [2025-09-17T20:15:38.540913] [WARN ] [MAIN ] MG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:15:38.541731] [INFO ] [REMOTE ] MFSG: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T20:15:38.543559] [INFO ] [REMOTE ] MFSG: Full fetch complete (5533 records). [2025-09-17T20:15:38.543658] [DEBUG] [VALIDATOR ] MFSG: Validating primary data. [2025-09-17T20:15:38.543483] [INFO ] [MAIN ] MG: Wiping existing primary data before full refresh. [2025-09-17T20:15:38.587932] [INFO ] [LOCAL ] MG: Starting deletion of primary data. [2025-09-17T20:15:38.633510] [DEBUG] [LOCAL ] MG: Deleted primary data file. [2025-09-17T20:15:38.654797] [INFO ] [MAIN ] MG: Starting full primary refresh. [2025-09-17T20:15:38.826157] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-02. [2025-09-17T20:15:39.043303] [WARN ] [VALIDATOR ] MFSG: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T20:15:39.067101] [FATAL] [MAIN ] MFSG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:15:39.067283] [WARN ] [MAIN ] MFSG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:15:39.089720] [INFO ] [LOCAL ] MFSG: Starting deletion of primary data. [2025-09-17T20:15:39.095342] [DEBUG] [LOCAL ] MFSG: No primary data file found to delete. [2025-09-17T20:15:39.096251] [INFO ] [LOCAL ] MFSG: Starting deletion of derivative data. [2025-09-17T20:15:39.146165] [DEBUG] [LOCAL ] MFSG: No derivative data file found to delete. [2025-09-17T20:15:39.187612] [INFO ] [MAIN ] Update Progress: 1340/2371 symbols completed. MFSG took 21.4s. Estimated remaining: 2h 30m 31s. Rate: 6.8 symbols/min [2025-09-17T20:15:39.533085] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T20:15:39.626401] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-03. [2025-09-17T20:15:39.667778] [INFO ] [REMOTE ] MG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:15:39.691391] [INFO ] [MAIN ] MGA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:15:39.765454] [DEBUG] [LOCAL ] MGA: Loaded 50680 existing records from primary storage. [2025-09-17T20:15:39.765719] [INFO ] [MAIN ] MGA: Loaded 50680 existing records. [2025-09-17T20:15:40.003797] [WARN ] [MAIN ] MGA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:15:40.004091] [INFO ] [MAIN ] MGA: Wiping existing primary data before full refresh. [2025-09-17T20:15:40.004149] [INFO ] [LOCAL ] MGA: Starting deletion of primary data. [2025-09-17T20:15:40.005493] [DEBUG] [LOCAL ] MGA: Deleted primary data file. [2025-09-17T20:15:40.005548] [INFO ] [MAIN ] MGA: Starting full primary refresh. [2025-09-17T20:15:40.395839] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T20:15:40.417332] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-11. [2025-09-17T20:15:40.466040] [INFO ] [REMOTE ] MGA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:15:40.658128] [DEBUG] [REMOTE ] MFSV: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:15:40.658501] [WARN ] [REMOTE ] MFSV: No data returned for month 2024-11 [2025-09-17T20:15:41.215808] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-11. [2025-09-17T20:15:42.015812] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2024-12. [2025-09-17T20:15:42.374730] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T20:15:42.815794] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-11. [2025-09-17T20:15:42.939196] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T20:15:43.615762] [INFO ] [REMOTE ] MGA: Fetching primary data for 2024-12. [2025-09-17T20:15:43.881056] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T20:15:44.415789] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-04. [2025-09-17T20:15:45.131595] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T20:15:45.215793] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-01. [2025-09-17T20:15:45.313035] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T20:15:45.616547] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-17T20:15:46.015774] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-01. [2025-09-17T20:15:46.815777] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-05. [2025-09-17T20:15:47.609873] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T20:15:47.615671] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-06. [2025-09-17T20:15:47.731349] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T20:15:48.400855] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T20:15:48.415746] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-07. [2025-09-17T20:15:49.215816] [INFO ] [REMOTE ] MG: Fetching primary data for 2024-12. [2025-09-17T20:15:49.353416] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T20:15:50.015781] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-02. [2025-09-17T20:15:50.190275] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T20:15:50.815795] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-01. [2025-09-17T20:15:51.405223] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T20:15:51.530259] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T20:15:51.615790] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-02. [2025-09-17T20:15:52.046341] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T20:15:52.415797] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-02. [2025-09-17T20:15:53.221436] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-08. [2025-09-17T20:15:53.222396] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T20:15:54.015777] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-03. [2025-09-17T20:15:54.220994] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T20:15:54.287929] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-03 (0.27 seconds). [2025-09-17T20:15:54.815827] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-03. [2025-09-17T20:15:55.615842] [INFO ] [REMOTE ] MFSI: Fetching primary data for 2025-09. [2025-09-17T20:15:55.974107] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T20:15:56.220803] [INFO ] [REMOTE ] MFSI: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T20:15:56.223264] [INFO ] [REMOTE ] MFSI: Full fetch complete (12567 records). [2025-09-17T20:15:56.223343] [DEBUG] [VALIDATOR ] MFSI: Validating primary data. [2025-09-17T20:15:56.405711] [WARN ] [VALIDATOR ] MFSI: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T20:15:56.406023] [FATAL] [MAIN ] MFSI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:15:56.406073] [WARN ] [MAIN ] MFSI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:15:56.406115] [INFO ] [LOCAL ] MFSI: Starting deletion of primary data. [2025-09-17T20:15:56.406182] [DEBUG] [LOCAL ] MFSI: No primary data file found to delete. [2025-09-17T20:15:56.406218] [INFO ] [LOCAL ] MFSI: Starting deletion of derivative data. [2025-09-17T20:15:56.406268] [DEBUG] [LOCAL ] MFSI: No derivative data file found to delete. [2025-09-17T20:15:56.406335] [INFO ] [MAIN ] Update Progress: 1341/2371 symbols completed. MFSI took 32.0s. Estimated remaining: 2h 30m 28s. Rate: 6.8 symbols/min [2025-09-17T20:15:56.420840] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-04. [2025-09-17T20:15:56.580635] [INFO ] [MAIN ] MGF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:15:56.591613] [DEBUG] [LOCAL ] MGF: Loaded 4163 existing records from primary storage. [2025-09-17T20:15:56.591795] [INFO ] [MAIN ] MGF: Loaded 4163 existing records. [2025-09-17T20:15:56.775368] [WARN ] [MAIN ] MGF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:15:56.775634] [INFO ] [MAIN ] MGF: Wiping existing primary data before full refresh. [2025-09-17T20:15:56.775704] [INFO ] [LOCAL ] MGF: Starting deletion of primary data. [2025-09-17T20:15:56.775987] [DEBUG] [LOCAL ] MGF: Deleted primary data file. [2025-09-17T20:15:56.776034] [INFO ] [MAIN ] MGF: Starting full primary refresh. [2025-09-17T20:15:57.157896] [INFO ] [REMOTE ] MGF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:15:57.215779] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-03. [2025-09-17T20:15:57.554067] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T20:15:58.015780] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-05. [2025-09-17T20:15:58.815831] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-04. [2025-09-17T20:15:59.015570] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T20:15:59.056506] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T20:15:59.198035] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-17T20:15:59.615864] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-11. [2025-09-17T20:16:00.256954] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T20:16:00.415834] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-05. [2025-09-17T20:16:01.034828] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T20:16:01.215807] [INFO ] [REMOTE ] MGF: Fetching primary data for 2024-12. [2025-09-17T20:16:01.783149] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T20:16:02.015804] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-04. [2025-09-17T20:16:02.815794] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-06. [2025-09-17T20:16:03.246808] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T20:16:03.615752] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-01. [2025-09-17T20:16:03.781254] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T20:16:04.166887] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T20:16:04.415785] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-06. [2025-09-17T20:16:05.215832] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-07. [2025-09-17T20:16:05.554712] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T20:16:05.701961] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T20:16:06.015778] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-08. [2025-09-17T20:16:06.732134] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T20:16:06.815821] [INFO ] [REMOTE ] MFSV: Fetching primary data for 2025-09. [2025-09-17T20:16:07.387335] [INFO ] [REMOTE ] MFSV: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T20:16:07.388527] [INFO ] [REMOTE ] MFSV: Full fetch complete (2792 records). [2025-09-17T20:16:07.388602] [DEBUG] [VALIDATOR ] MFSV: Validating primary data. [2025-09-17T20:16:07.576196] [WARN ] [VALIDATOR ] MFSV: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T20:16:07.576429] [FATAL] [MAIN ] MFSV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:16:07.576479] [WARN ] [MAIN ] MFSV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:16:07.576525] [INFO ] [LOCAL ] MFSV: Starting deletion of primary data. [2025-09-17T20:16:07.576792] [DEBUG] [LOCAL ] MFSV: No primary data file found to delete. [2025-09-17T20:16:07.576832] [INFO ] [LOCAL ] MFSV: Starting deletion of derivative data. [2025-09-17T20:16:07.576872] [DEBUG] [LOCAL ] MFSV: No derivative data file found to delete. [2025-09-17T20:16:07.576955] [INFO ] [MAIN ] Update Progress: 1342/2371 symbols completed. MFSV took 30.5s. Estimated remaining: 2h 30m 22s. Rate: 6.8 symbols/min [2025-09-17T20:16:07.620966] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-05. [2025-09-17T20:16:07.766610] [INFO ] [MAIN ] MGM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:16:07.826484] [DEBUG] [LOCAL ] MGM: Loaded 53610 existing records from primary storage. [2025-09-17T20:16:07.826691] [INFO ] [MAIN ] MGM: Loaded 53610 existing records. [2025-09-17T20:16:08.015068] [WARN ] [MAIN ] MGM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:16:08.015432] [INFO ] [MAIN ] MGM: Wiping existing primary data before full refresh. [2025-09-17T20:16:08.015501] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-17T20:16:08.016959] [DEBUG] [LOCAL ] MGM: Deleted primary data file. [2025-09-17T20:16:08.017020] [INFO ] [MAIN ] MGM: Starting full primary refresh. [2025-09-17T20:16:08.400355] [INFO ] [REMOTE ] MGM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:16:08.415803] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-07. [2025-09-17T20:16:09.215769] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-11. [2025-09-17T20:16:09.286805] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T20:16:09.419984] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T20:16:10.015833] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-06. [2025-09-17T20:16:10.815848] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-08. [2025-09-17T20:16:11.101568] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-11 (1.89 seconds). [2025-09-17T20:16:11.615781] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-02. [2025-09-17T20:16:11.754496] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T20:16:11.783010] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T20:16:12.120242] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T20:16:12.415783] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-07. [2025-09-17T20:16:13.215797] [INFO ] [REMOTE ] MGM: Fetching primary data for 2024-12. [2025-09-17T20:16:14.015888] [INFO ] [REMOTE ] MG: Fetching primary data for 2025-09. [2025-09-17T20:16:14.281005] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T20:16:14.815756] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-08. [2025-09-17T20:16:14.856107] [INFO ] [REMOTE ] MG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T20:16:14.858624] [INFO ] [REMOTE ] MG: Full fetch complete (23981 records). [2025-09-17T20:16:14.858739] [DEBUG] [VALIDATOR ] MG: Validating primary data. [2025-09-17T20:16:15.228187] [DEBUG] [VALIDATOR ] MG: All expected trading days are present. [2025-09-17T20:16:15.243618] [DEBUG] [VALIDATOR ] MG: Primary data validation passed. [2025-09-17T20:16:15.256276] [INFO ] [MAIN ] MG: Fetched primary data is valid. [2025-09-17T20:16:15.256454] [DEBUG] [LOCAL ] MG: Saving primary data. [2025-09-17T20:16:15.258659] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T20:16:15.269738] [DEBUG] [LOCAL ] MG: Trimmed 23981 records to 16904 (keeping 200 days of data) [2025-09-17T20:16:15.370779] [DEBUG] [LOCAL ] MG: Primary data saved (16904 records). [2025-09-17T20:16:15.370939] [INFO ] [MAIN ] MG: Full history saved. [2025-09-17T20:16:15.371036] [INFO ] [MAIN ] Update Progress: 1343/2371 symbols completed. MG took 37.2s. Estimated remaining: 2h 30m 12s. Rate: 6.8 symbols/min [2025-09-17T20:16:15.561197] [INFO ] [MAIN ] MGR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:16:15.569607] [DEBUG] [LOCAL ] MGR: Loaded 5661 existing records from primary storage. [2025-09-17T20:16:15.569787] [INFO ] [MAIN ] MGR: Loaded 5661 existing records. [2025-09-17T20:16:15.624779] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-01. [2025-09-17T20:16:15.759959] [WARN ] [MAIN ] MGR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:16:15.760270] [INFO ] [MAIN ] MGR: Wiping existing primary data before full refresh. [2025-09-17T20:16:15.760324] [INFO ] [LOCAL ] MGR: Starting deletion of primary data. [2025-09-17T20:16:15.760873] [DEBUG] [LOCAL ] MGR: Deleted primary data file. [2025-09-17T20:16:15.760934] [INFO ] [MAIN ] MGR: Starting full primary refresh. [2025-09-17T20:16:16.137186] [INFO ] [REMOTE ] MGR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:16:16.416078] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-11. [2025-09-17T20:16:16.699727] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T20:16:17.093234] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T20:16:17.215786] [INFO ] [REMOTE ] MGA: Fetching primary data for 2025-09. [2025-09-17T20:16:17.633846] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T20:16:18.015805] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-02. [2025-09-17T20:16:18.815812] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-03. [2025-09-17T20:16:18.874045] [INFO ] [REMOTE ] MGA: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T20:16:18.881116] [INFO ] [REMOTE ] MGA: Full fetch complete (73554 records). [2025-09-17T20:16:18.881296] [DEBUG] [VALIDATOR ] MGA: Validating primary data. [2025-09-17T20:16:19.326977] [DEBUG] [VALIDATOR ] MGA: All expected trading days are present. [2025-09-17T20:16:19.327091] [DEBUG] [VALIDATOR ] MGA: Primary data validation passed. [2025-09-17T20:16:19.328217] [INFO ] [MAIN ] MGA: Fetched primary data is valid. [2025-09-17T20:16:19.328268] [DEBUG] [LOCAL ] MGA: Saving primary data. [2025-09-17T20:16:19.330300] [DEBUG] [LOCAL ] MGA: Trimmed 73554 records to 50683 (keeping 200 days of data) [2025-09-17T20:16:19.563931] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T20:16:19.629414] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-04. [2025-09-17T20:16:19.684815] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T20:16:19.710658] [DEBUG] [LOCAL ] MGA: Primary data saved (50683 records). [2025-09-17T20:16:19.710805] [INFO ] [MAIN ] MGA: Full history saved. [2025-09-17T20:16:19.710896] [INFO ] [MAIN ] Update Progress: 1344/2371 symbols completed. MGA took 40.5s. Estimated remaining: 2h 29m 60s. Rate: 6.8 symbols/min [2025-09-17T20:16:19.882153] [INFO ] [MAIN ] MGRB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:16:19.888622] [DEBUG] [LOCAL ] MGRB: Loaded 4128 existing records from primary storage. [2025-09-17T20:16:19.888751] [INFO ] [MAIN ] MGRB: Loaded 4128 existing records. [2025-09-17T20:16:20.065667] [WARN ] [MAIN ] MGRB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:16:20.065911] [INFO ] [MAIN ] MGRB: Wiping existing primary data before full refresh. [2025-09-17T20:16:20.065964] [INFO ] [LOCAL ] MGRB: Starting deletion of primary data. [2025-09-17T20:16:20.066215] [DEBUG] [LOCAL ] MGRB: Deleted primary data file. [2025-09-17T20:16:20.066259] [INFO ] [MAIN ] MGRB: Starting full primary refresh. [2025-09-17T20:16:20.427894] [INFO ] [REMOTE ] MGR: Fetching primary data for 2024-12. [2025-09-17T20:16:20.433770] [INFO ] [REMOTE ] MGRB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:16:20.471383] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T20:16:21.215826] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-11. [2025-09-17T20:16:21.297236] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T20:16:21.728340] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T20:16:22.015808] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-01. [2025-09-17T20:16:22.765519] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T20:16:22.815752] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-02. [2025-09-17T20:16:23.456972] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T20:16:23.615823] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-03. [2025-09-17T20:16:24.378583] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T20:16:24.415814] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2024-12. [2025-09-17T20:16:25.215802] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-05. [2025-09-17T20:16:25.320762] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T20:16:25.823276] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T20:16:26.015773] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-04. [2025-09-17T20:16:26.704182] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T20:16:26.815796] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-03. [2025-09-17T20:16:27.615784] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-05. [2025-09-17T20:16:28.240239] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T20:16:28.415798] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-01. [2025-09-17T20:16:28.577142] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T20:16:29.079146] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T20:16:29.215830] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-04. [2025-09-17T20:16:30.015793] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-06. [2025-09-17T20:16:30.404325] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-06 (0.39 seconds). [2025-09-17T20:16:30.815751] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-02. [2025-09-17T20:16:31.117752] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T20:16:31.440715] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T20:16:31.615804] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-03. [2025-09-17T20:16:32.275497] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T20:16:32.415784] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-04. [2025-09-17T20:16:33.215777] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-07. [2025-09-17T20:16:33.216573] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T20:16:33.850761] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T20:16:34.015792] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-08. [2025-09-17T20:16:34.681617] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T20:16:34.815819] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-05. [2025-09-17T20:16:35.615835] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-05. [2025-09-17T20:16:36.272102] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T20:16:36.415801] [INFO ] [REMOTE ] MGF: Fetching primary data for 2025-09. [2025-09-17T20:16:36.612913] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T20:16:36.982540] [INFO ] [REMOTE ] MGF: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T20:16:36.983876] [INFO ] [REMOTE ] MGF: Full fetch complete (6057 records). [2025-09-17T20:16:36.983971] [DEBUG] [VALIDATOR ] MGF: Validating primary data. [2025-09-17T20:16:37.220879] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-06. [2025-09-17T20:16:37.372460] [DEBUG] [VALIDATOR ] MGF: All expected trading days are present. [2025-09-17T20:16:37.372584] [DEBUG] [VALIDATOR ] MGF: Primary data validation passed. [2025-09-17T20:16:37.372782] [INFO ] [MAIN ] MGF: Fetched primary data is valid. [2025-09-17T20:16:37.372844] [DEBUG] [LOCAL ] MGF: Saving primary data. [2025-09-17T20:16:37.373264] [DEBUG] [LOCAL ] MGF: Trimmed 6057 records to 4157 (keeping 200 days of data) [2025-09-17T20:16:37.401100] [DEBUG] [LOCAL ] MGF: Primary data saved (4157 records). [2025-09-17T20:16:37.401252] [INFO ] [MAIN ] MGF: Full history saved. [2025-09-17T20:16:37.401384] [INFO ] [MAIN ] Update Progress: 1345/2371 symbols completed. MGF took 41.0s. Estimated remaining: 2h 29m 58s. Rate: 6.8 symbols/min [2025-09-17T20:16:37.576381] [INFO ] [MAIN ] MGRD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:16:37.581699] [DEBUG] [LOCAL ] MGRD: Loaded 2313 existing records from primary storage. [2025-09-17T20:16:37.581854] [INFO ] [MAIN ] MGRD: Loaded 2313 existing records. [2025-09-17T20:16:37.761512] [WARN ] [MAIN ] MGRD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:16:37.761794] [INFO ] [MAIN ] MGRD: Wiping existing primary data before full refresh. [2025-09-17T20:16:37.761843] [INFO ] [LOCAL ] MGRD: Starting deletion of primary data. [2025-09-17T20:16:37.762073] [DEBUG] [LOCAL ] MGRD: Deleted primary data file. [2025-09-17T20:16:37.762130] [INFO ] [MAIN ] MGRD: Starting full primary refresh. [2025-09-17T20:16:38.020973] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-06. [2025-09-17T20:16:38.058032] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T20:16:38.133892] [INFO ] [REMOTE ] MGRD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:16:38.738097] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T20:16:38.815756] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-07. [2025-09-17T20:16:39.615833] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-06. [2025-09-17T20:16:39.633270] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T20:16:40.415865] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-07. [2025-09-17T20:16:40.922729] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T20:16:41.215783] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-11. [2025-09-17T20:16:41.508636] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T20:16:41.735299] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T20:16:42.015778] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2024-12. [2025-09-17T20:16:42.644920] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T20:16:42.815787] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-08. [2025-09-17T20:16:43.418108] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T20:16:43.615776] [INFO ] [REMOTE ] MGR: Fetching primary data for 2025-09. [2025-09-17T20:16:44.184734] [INFO ] [REMOTE ] MGR: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T20:16:44.186027] [INFO ] [REMOTE ] MGR: Full fetch complete (8442 records). [2025-09-17T20:16:44.186100] [DEBUG] [VALIDATOR ] MGR: Validating primary data. [2025-09-17T20:16:44.421519] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-07. [2025-09-17T20:16:44.577165] [DEBUG] [VALIDATOR ] MGR: All expected trading days are present. [2025-09-17T20:16:44.577278] [DEBUG] [VALIDATOR ] MGR: Primary data validation passed. [2025-09-17T20:16:44.577541] [INFO ] [MAIN ] MGR: Fetched primary data is valid. [2025-09-17T20:16:44.577585] [DEBUG] [LOCAL ] MGR: Saving primary data. [2025-09-17T20:16:44.578112] [DEBUG] [LOCAL ] MGR: Trimmed 8442 records to 5656 (keeping 200 days of data) [2025-09-17T20:16:44.618267] [DEBUG] [LOCAL ] MGR: Primary data saved (5656 records). [2025-09-17T20:16:44.618469] [INFO ] [MAIN ] MGR: Full history saved. [2025-09-17T20:16:44.618631] [INFO ] [MAIN ] Update Progress: 1346/2371 symbols completed. MGR took 29.2s. Estimated remaining: 2h 29m 48s. Rate: 6.8 symbols/min [2025-09-17T20:16:44.800389] [INFO ] [MAIN ] MGRE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:16:44.819032] [DEBUG] [LOCAL ] MGRE: Loaded 6530 existing records from primary storage. [2025-09-17T20:16:44.819209] [INFO ] [MAIN ] MGRE: Loaded 6530 existing records. [2025-09-17T20:16:45.010595] [WARN ] [MAIN ] MGRE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:16:45.010866] [INFO ] [MAIN ] MGRE: Wiping existing primary data before full refresh. [2025-09-17T20:16:45.010912] [INFO ] [LOCAL ] MGRE: Starting deletion of primary data. [2025-09-17T20:16:45.012054] [DEBUG] [LOCAL ] MGRE: Deleted primary data file. [2025-09-17T20:16:45.012107] [INFO ] [MAIN ] MGRE: Starting full primary refresh. [2025-09-17T20:16:45.225177] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-01. [2025-09-17T20:16:45.378856] [INFO ] [REMOTE ] MGRE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:16:45.814994] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T20:16:46.015828] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-02. [2025-09-17T20:16:46.506410] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T20:16:46.540343] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T20:16:46.815782] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-08. [2025-09-17T20:16:47.615729] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-08. [2025-09-17T20:16:48.271111] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T20:16:48.415805] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-11. [2025-09-17T20:16:48.829682] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T20:16:48.973767] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-11 (0.56 seconds). [2025-09-17T20:16:49.215818] [INFO ] [REMOTE ] MGM: Fetching primary data for 2025-09. [2025-09-17T20:16:50.011988] [INFO ] [REMOTE ] MGM: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T20:16:50.017996] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-03. [2025-09-17T20:16:50.020109] [INFO ] [REMOTE ] MGM: Full fetch complete (77055 records). [2025-09-17T20:16:50.020263] [DEBUG] [VALIDATOR ] MGM: Validating primary data. [2025-09-17T20:16:50.021021] [FATAL] [VALIDATOR ] MGM: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:16:50.021155] [FATAL] [MAIN ] MGM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:16:50.021211] [WARN ] [MAIN ] MGM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:16:50.021260] [INFO ] [LOCAL ] MGM: Starting deletion of primary data. [2025-09-17T20:16:50.021321] [DEBUG] [LOCAL ] MGM: No primary data file found to delete. [2025-09-17T20:16:50.021364] [INFO ] [LOCAL ] MGM: Starting deletion of derivative data. [2025-09-17T20:16:50.021757] [DEBUG] [LOCAL ] MGM: Deleted derivative data file. [2025-09-17T20:16:50.021899] [INFO ] [MAIN ] Update Progress: 1347/2371 symbols completed. MGM took 42.4s. Estimated remaining: 2h 29m 37s. Rate: 6.8 symbols/min [2025-09-17T20:16:50.190462] [INFO ] [MAIN ] MGY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:16:50.241416] [DEBUG] [LOCAL ] MGY: Loaded 52438 existing records from primary storage. [2025-09-17T20:16:50.241627] [INFO ] [MAIN ] MGY: Loaded 52438 existing records. [2025-09-17T20:16:50.431512] [WARN ] [MAIN ] MGY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:16:50.431793] [INFO ] [MAIN ] MGY: Wiping existing primary data before full refresh. [2025-09-17T20:16:50.431844] [INFO ] [LOCAL ] MGY: Starting deletion of primary data. [2025-09-17T20:16:50.433278] [DEBUG] [LOCAL ] MGY: Deleted primary data file. [2025-09-17T20:16:50.433339] [INFO ] [MAIN ] MGY: Starting full primary refresh. [2025-09-17T20:16:50.660629] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T20:16:50.803215] [INFO ] [REMOTE ] MGY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:16:50.815817] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-11. [2025-09-17T20:16:51.615851] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-04. [2025-09-17T20:16:52.008243] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-17T20:16:52.183895] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T20:16:52.415769] [INFO ] [REMOTE ] MGRB: Fetching primary data for 2025-09. [2025-09-17T20:16:52.878690] [INFO ] [REMOTE ] MGRB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T20:16:52.879887] [INFO ] [REMOTE ] MGRB: Full fetch complete (6366 records). [2025-09-17T20:16:52.879958] [DEBUG] [VALIDATOR ] MGRB: Validating primary data. [2025-09-17T20:16:53.227934] [INFO ] [REMOTE ] MGY: Fetching primary data for 2024-12. [2025-09-17T20:16:53.235170] [DEBUG] [VALIDATOR ] MGRB: All expected trading days are present. [2025-09-17T20:16:53.235221] [DEBUG] [VALIDATOR ] MGRB: Primary data validation passed. [2025-09-17T20:16:53.235402] [INFO ] [MAIN ] MGRB: Fetched primary data is valid. [2025-09-17T20:16:53.235441] [DEBUG] [LOCAL ] MGRB: Saving primary data. [2025-09-17T20:16:53.235875] [DEBUG] [LOCAL ] MGRB: Trimmed 6366 records to 4119 (keeping 200 days of data) [2025-09-17T20:16:53.263562] [DEBUG] [LOCAL ] MGRB: Primary data saved (4119 records). [2025-09-17T20:16:53.263693] [INFO ] [MAIN ] MGRB: Full history saved. [2025-09-17T20:16:53.263808] [INFO ] [MAIN ] Update Progress: 1348/2371 symbols completed. MGRB took 33.6s. Estimated remaining: 2h 29m 24s. Rate: 6.8 symbols/min [2025-09-17T20:16:53.432283] [INFO ] [MAIN ] MH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:16:53.432508] [DEBUG] [LOCAL ] MH: No existing data file found in primary storage. [2025-09-17T20:16:53.432548] [WARN ] [MAIN ] MH: No existing data found, performing full refresh instead. [2025-09-17T20:16:53.432695] [INFO ] [MAIN ] MH: Wiping existing primary data before full refresh. [2025-09-17T20:16:53.432736] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-17T20:16:53.432776] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-17T20:16:53.432809] [INFO ] [MAIN ] MH: Starting full primary refresh. [2025-09-17T20:16:53.848633] [INFO ] [REMOTE ] MH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:16:54.015776] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-11. [2025-09-17T20:16:54.275080] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:16:54.275536] [WARN ] [REMOTE ] MH: No data returned for month 2024-11 [2025-09-17T20:16:54.815785] [INFO ] [REMOTE ] MH: Fetching primary data for 2024-12. [2025-09-17T20:16:55.039411] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T20:16:55.456343] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:16:55.456792] [WARN ] [REMOTE ] MH: No data returned for month 2024-12 [2025-09-17T20:16:55.615776] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-01. [2025-09-17T20:16:55.949358] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:16:55.949773] [WARN ] [REMOTE ] MH: No data returned for month 2025-01 [2025-09-17T20:16:56.415780] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-01. [2025-09-17T20:16:57.215819] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2024-12. [2025-09-17T20:16:57.947985] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T20:16:57.977661] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T20:16:58.015833] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-01. [2025-09-17T20:16:58.696939] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T20:16:58.815799] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-02. [2025-09-17T20:16:59.615850] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-05. [2025-09-17T20:16:59.965603] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-17T20:17:00.415798] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-06. [2025-09-17T20:17:00.962792] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T20:17:01.001594] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-17T20:17:01.215785] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-03. [2025-09-17T20:17:02.015840] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-02. [2025-09-17T20:17:02.304982] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:17:02.305371] [WARN ] [REMOTE ] MH: No data returned for month 2025-02 [2025-09-17T20:17:02.815842] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-03. [2025-09-17T20:17:03.036314] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T20:17:03.097726] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:17:03.098171] [WARN ] [REMOTE ] MH: No data returned for month 2025-03 [2025-09-17T20:17:03.615853] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-04. [2025-09-17T20:17:04.415881] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-04. [2025-09-17T20:17:04.668556] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:17:04.669051] [WARN ] [REMOTE ] MH: No data returned for month 2025-04 [2025-09-17T20:17:05.215775] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-07. [2025-09-17T20:17:05.270247] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T20:17:05.717691] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T20:17:06.015790] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-05. [2025-09-17T20:17:06.815784] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-05. [2025-09-17T20:17:07.089906] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:17:07.090328] [WARN ] [REMOTE ] MH: No data returned for month 2025-05 [2025-09-17T20:17:07.615792] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-06. [2025-09-17T20:17:07.761292] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T20:17:07.872187] [DEBUG] [REMOTE ] MH: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:17:07.872572] [WARN ] [REMOTE ] MH: No data returned for month 2025-06 [2025-09-17T20:17:08.415784] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-06. [2025-09-17T20:17:09.215796] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-07. [2025-09-17T20:17:09.814206] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T20:17:10.015788] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-08. [2025-09-17T20:17:10.162484] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T20:17:10.815825] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-08. [2025-09-17T20:17:11.363160] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T20:17:11.615768] [INFO ] [REMOTE ] MGRD: Fetching primary data for 2025-09. [2025-09-17T20:17:11.690319] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T20:17:11.938454] [INFO ] [REMOTE ] MGRD: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T20:17:11.939337] [INFO ] [REMOTE ] MGRD: Full fetch complete (3544 records). [2025-09-17T20:17:11.939405] [DEBUG] [VALIDATOR ] MGRD: Validating primary data. [2025-09-17T20:17:12.299120] [DEBUG] [VALIDATOR ] MGRD: All expected trading days are present. [2025-09-17T20:17:12.299226] [DEBUG] [VALIDATOR ] MGRD: Primary data validation passed. [2025-09-17T20:17:12.299368] [INFO ] [MAIN ] MGRD: Fetched primary data is valid. [2025-09-17T20:17:12.299407] [DEBUG] [LOCAL ] MGRD: Saving primary data. [2025-09-17T20:17:12.299778] [DEBUG] [LOCAL ] MGRD: Trimmed 3544 records to 2250 (keeping 200 days of data) [2025-09-17T20:17:12.314897] [DEBUG] [LOCAL ] MGRD: Primary data saved (2250 records). [2025-09-17T20:17:12.314962] [INFO ] [MAIN ] MGRD: Full history saved. [2025-09-17T20:17:12.315059] [INFO ] [MAIN ] Update Progress: 1349/2371 symbols completed. MGRD took 34.9s. Estimated remaining: 2h 29m 23s. Rate: 6.8 symbols/min [2025-09-17T20:17:12.417842] [INFO ] [REMOTE ] MH: Fetching primary data for 2025-09. [2025-09-17T20:17:12.489113] [INFO ] [MAIN ] MHD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:17:12.505110] [DEBUG] [LOCAL ] MHD: Loaded 12270 existing records from primary storage. [2025-09-17T20:17:12.505747] [INFO ] [MAIN ] MHD: Loaded 12270 existing records. [2025-09-17T20:17:12.681635] [WARN ] [MAIN ] MHD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:17:12.681939] [INFO ] [MAIN ] MHD: Wiping existing primary data before full refresh. [2025-09-17T20:17:12.681988] [INFO ] [LOCAL ] MHD: Starting deletion of primary data. [2025-09-17T20:17:12.682441] [DEBUG] [LOCAL ] MHD: Deleted primary data file. [2025-09-17T20:17:12.682497] [INFO ] [MAIN ] MHD: Starting full primary refresh. [2025-09-17T20:17:13.057510] [INFO ] [REMOTE ] MHD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:17:13.215805] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-07. [2025-09-17T20:17:13.609970] [INFO ] [REMOTE ] MH: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T20:17:13.614468] [INFO ] [REMOTE ] MH: Full fetch complete (10993 records). [2025-09-17T20:17:13.614549] [DEBUG] [VALIDATOR ] MH: Validating primary data. [2025-09-17T20:17:13.810536] [WARN ] [VALIDATOR ] MH: Validation failed - insufficient historical data. Have 39 unique days, need 200 days [2025-09-17T20:17:13.810951] [FATAL] [MAIN ] MH: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:17:13.811018] [WARN ] [MAIN ] MH: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:17:13.811112] [INFO ] [LOCAL ] MH: Starting deletion of primary data. [2025-09-17T20:17:13.811191] [DEBUG] [LOCAL ] MH: No primary data file found to delete. [2025-09-17T20:17:13.811230] [INFO ] [LOCAL ] MH: Starting deletion of derivative data. [2025-09-17T20:17:13.811271] [DEBUG] [LOCAL ] MH: No derivative data file found to delete. [2025-09-17T20:17:13.811361] [INFO ] [MAIN ] Update Progress: 1350/2371 symbols completed. MH took 20.5s. Estimated remaining: 2h 29m 8s. Rate: 6.8 symbols/min [2025-09-17T20:17:13.996959] [INFO ] [MAIN ] MHF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:17:14.012084] [DEBUG] [LOCAL ] MHF: Loaded 8507 existing records from primary storage. [2025-09-17T20:17:14.012277] [INFO ] [MAIN ] MHF: Loaded 8507 existing records. [2025-09-17T20:17:14.024028] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-02. [2025-09-17T20:17:14.208734] [WARN ] [MAIN ] MHF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:17:14.209134] [INFO ] [MAIN ] MHF: Wiping existing primary data before full refresh. [2025-09-17T20:17:14.209188] [INFO ] [LOCAL ] MHF: Starting deletion of primary data. [2025-09-17T20:17:14.209889] [DEBUG] [LOCAL ] MHF: Deleted primary data file. [2025-09-17T20:17:14.209941] [INFO ] [MAIN ] MHF: Starting full primary refresh. [2025-09-17T20:17:14.603499] [INFO ] [REMOTE ] MHF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:17:14.813327] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T20:17:14.815777] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-03. [2025-09-17T20:17:15.044989] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T20:17:15.265830] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T20:17:15.615782] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-04. [2025-09-17T20:17:16.403578] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T20:17:16.415681] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-05. [2025-09-17T20:17:17.215757] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-11. [2025-09-17T20:17:17.284438] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T20:17:17.945262] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T20:17:18.015842] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-11. [2025-09-17T20:17:18.815764] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-06. [2025-09-17T20:17:19.053730] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T20:17:19.436208] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T20:17:19.615758] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-07. [2025-09-17T20:17:20.415814] [INFO ] [REMOTE ] MHD: Fetching primary data for 2024-12. [2025-09-17T20:17:20.621719] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T20:17:21.215802] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-08. [2025-09-17T20:17:21.475972] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T20:17:21.699410] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T20:17:22.015825] [INFO ] [REMOTE ] MGRE: Fetching primary data for 2025-09. [2025-09-17T20:17:22.692410] [INFO ] [REMOTE ] MGRE: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T20:17:22.693991] [INFO ] [REMOTE ] MGRE: Full fetch complete (9316 records). [2025-09-17T20:17:22.697824] [DEBUG] [VALIDATOR ] MGRE: Validating primary data. [2025-09-17T20:17:22.820947] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-01. [2025-09-17T20:17:23.073684] [DEBUG] [VALIDATOR ] MGRE: All expected trading days are present. [2025-09-17T20:17:23.073804] [DEBUG] [VALIDATOR ] MGRE: Primary data validation passed. [2025-09-17T20:17:23.074419] [INFO ] [MAIN ] MGRE: Fetched primary data is valid. [2025-09-17T20:17:23.074467] [DEBUG] [LOCAL ] MGRE: Saving primary data. [2025-09-17T20:17:23.075029] [DEBUG] [LOCAL ] MGRE: Trimmed 9316 records to 6503 (keeping 200 days of data) [2025-09-17T20:17:23.118676] [DEBUG] [LOCAL ] MGRE: Primary data saved (6503 records). [2025-09-17T20:17:23.118879] [INFO ] [MAIN ] MGRE: Full history saved. [2025-09-17T20:17:23.119013] [INFO ] [MAIN ] Update Progress: 1351/2371 symbols completed. MGRE took 38.5s. Estimated remaining: 2h 29m 0s. Rate: 6.8 symbols/min [2025-09-17T20:17:23.296893] [INFO ] [MAIN ] MHK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:17:23.355578] [DEBUG] [LOCAL ] MHK: Loaded 42482 existing records from primary storage. [2025-09-17T20:17:23.355846] [INFO ] [MAIN ] MHK: Loaded 42482 existing records. [2025-09-17T20:17:23.543613] [WARN ] [MAIN ] MHK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:17:23.543992] [INFO ] [MAIN ] MHK: Wiping existing primary data before full refresh. [2025-09-17T20:17:23.544099] [INFO ] [LOCAL ] MHK: Starting deletion of primary data. [2025-09-17T20:17:23.545334] [DEBUG] [LOCAL ] MHK: Deleted primary data file. [2025-09-17T20:17:23.545388] [INFO ] [MAIN ] MHK: Starting full primary refresh. [2025-09-17T20:17:23.621721] [INFO ] [REMOTE ] MHF: Fetching primary data for 2024-12. [2025-09-17T20:17:23.834691] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T20:17:23.960374] [INFO ] [REMOTE ] MHK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:17:24.415867] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-08. [2025-09-17T20:17:24.606430] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T20:17:25.215793] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-01. [2025-09-17T20:17:26.015794] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-02. [2025-09-17T20:17:26.053625] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T20:17:26.202102] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T20:17:26.632671] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T20:17:26.815783] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-03. [2025-09-17T20:17:27.615788] [INFO ] [REMOTE ] MGY: Fetching primary data for 2025-09. [2025-09-17T20:17:27.747776] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T20:17:28.415855] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-04. [2025-09-17T20:17:29.214865] [INFO ] [REMOTE ] MGY: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T20:17:29.221079] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-02. [2025-09-17T20:17:29.222590] [INFO ] [REMOTE ] MGY: Full fetch complete (75313 records). [2025-09-17T20:17:29.222756] [DEBUG] [VALIDATOR ] MGY: Validating primary data. [2025-09-17T20:17:29.592192] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T20:17:29.633996] [DEBUG] [VALIDATOR ] MGY: All expected trading days are present. [2025-09-17T20:17:29.634096] [DEBUG] [VALIDATOR ] MGY: Primary data validation passed. [2025-09-17T20:17:29.635190] [INFO ] [MAIN ] MGY: Fetched primary data is valid. [2025-09-17T20:17:29.635245] [DEBUG] [LOCAL ] MGY: Saving primary data. [2025-09-17T20:17:29.636774] [DEBUG] [LOCAL ] MGY: Trimmed 75313 records to 52448 (keeping 200 days of data) [2025-09-17T20:17:29.967143] [DEBUG] [LOCAL ] MGY: Primary data saved (52448 records). [2025-09-17T20:17:29.974716] [INFO ] [MAIN ] MGY: Full history saved. [2025-09-17T20:17:29.974915] [INFO ] [MAIN ] Update Progress: 1352/2371 symbols completed. MGY took 40.0s. Estimated remaining: 2h 28m 50s. Rate: 6.8 symbols/min [2025-09-17T20:17:29.975989] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T20:17:30.020987] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-05. [2025-09-17T20:17:30.153620] [INFO ] [MAIN ] MHLA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:17:30.153869] [DEBUG] [LOCAL ] MHLA: No existing data file found in primary storage. [2025-09-17T20:17:30.153907] [WARN ] [MAIN ] MHLA: No existing data found, performing full refresh instead. [2025-09-17T20:17:30.154036] [INFO ] [MAIN ] MHLA: Wiping existing primary data before full refresh. [2025-09-17T20:17:30.154083] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-17T20:17:30.154125] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-17T20:17:30.154201] [INFO ] [MAIN ] MHLA: Starting full primary refresh. [2025-09-17T20:17:30.550107] [INFO ] [REMOTE ] MHLA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:17:30.815861] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-11. [2025-09-17T20:17:30.967451] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T20:17:31.141995] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-11 (0.33 seconds). [2025-09-17T20:17:31.615807] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2024-12. [2025-09-17T20:17:32.038973] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-17T20:17:32.415853] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-01. [2025-09-17T20:17:32.833535] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T20:17:33.215799] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-11. [2025-09-17T20:17:34.015868] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-06. [2025-09-17T20:17:34.597503] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T20:17:34.815811] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-03. [2025-09-17T20:17:34.956877] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T20:17:35.405729] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T20:17:35.615823] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-04. [2025-09-17T20:17:36.314279] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T20:17:36.415798] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-02. [2025-09-17T20:17:36.824741] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T20:17:37.215772] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-03. [2025-09-17T20:17:37.612845] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T20:17:38.015785] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-07. [2025-09-17T20:17:38.815790] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-05. [2025-09-17T20:17:38.872766] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T20:17:39.529177] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T20:17:39.615823] [INFO ] [REMOTE ] MHK: Fetching primary data for 2024-12. [2025-09-17T20:17:40.415794] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-04. [2025-09-17T20:17:40.897201] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-04 (0.48 seconds). [2025-09-17T20:17:41.048194] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T20:17:41.215814] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-05. [2025-09-17T20:17:41.766821] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T20:17:42.015789] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-06. [2025-09-17T20:17:42.450437] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T20:17:42.815803] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-01. [2025-09-17T20:17:43.615852] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-08. [2025-09-17T20:17:44.415851] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-06. [2025-09-17T20:17:44.520462] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T20:17:44.561927] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T20:17:45.215794] [INFO ] [REMOTE ] MHD: Fetching primary data for 2025-09. [2025-09-17T20:17:45.263589] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T20:17:46.015843] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-02. [2025-09-17T20:17:46.135427] [INFO ] [REMOTE ] MHD: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T20:17:46.138040] [INFO ] [REMOTE ] MHD: Full fetch complete (18826 records). [2025-09-17T20:17:46.138128] [DEBUG] [VALIDATOR ] MHD: Validating primary data. [2025-09-17T20:17:46.514063] [DEBUG] [VALIDATOR ] MHD: All expected trading days are present. [2025-09-17T20:17:46.514153] [DEBUG] [VALIDATOR ] MHD: Primary data validation passed. [2025-09-17T20:17:46.514668] [INFO ] [MAIN ] MHD: Fetched primary data is valid. [2025-09-17T20:17:46.514716] [DEBUG] [LOCAL ] MHD: Saving primary data. [2025-09-17T20:17:46.515336] [DEBUG] [LOCAL ] MHD: Trimmed 18826 records to 12269 (keeping 200 days of data) [2025-09-17T20:17:46.597192] [DEBUG] [LOCAL ] MHD: Primary data saved (12269 records). [2025-09-17T20:17:46.597355] [INFO ] [MAIN ] MHD: Full history saved. [2025-09-17T20:17:46.597455] [INFO ] [MAIN ] Update Progress: 1353/2371 symbols completed. MHD took 34.3s. Estimated remaining: 2h 28m 47s. Rate: 6.8 symbols/min [2025-09-17T20:17:46.768158] [INFO ] [MAIN ] MHN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:17:46.777344] [DEBUG] [LOCAL ] MHN: Loaded 7800 existing records from primary storage. [2025-09-17T20:17:46.777475] [INFO ] [MAIN ] MHN: Loaded 7800 existing records. [2025-09-17T20:17:46.821019] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-07. [2025-09-17T20:17:46.958115] [WARN ] [MAIN ] MHN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:17:46.958438] [INFO ] [MAIN ] MHN: Wiping existing primary data before full refresh. [2025-09-17T20:17:46.958487] [INFO ] [LOCAL ] MHN: Starting deletion of primary data. [2025-09-17T20:17:46.958805] [DEBUG] [LOCAL ] MHN: Deleted primary data file. [2025-09-17T20:17:46.958853] [INFO ] [MAIN ] MHN: Starting full primary refresh. [2025-09-17T20:17:47.245160] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-17T20:17:47.325687] [INFO ] [REMOTE ] MHN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:17:47.615781] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-08. [2025-09-17T20:17:47.694793] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T20:17:48.037515] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-17T20:17:48.415808] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-07. [2025-09-17T20:17:49.139247] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T20:17:49.215783] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-03. [2025-09-17T20:17:50.015786] [INFO ] [REMOTE ] MHLA: Fetching primary data for 2025-09. [2025-09-17T20:17:50.332317] [INFO ] [REMOTE ] MHLA: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T20:17:50.333060] [INFO ] [REMOTE ] MHLA: Full fetch complete (1496 records). [2025-09-17T20:17:50.333128] [DEBUG] [VALIDATOR ] MHLA: Validating primary data. [2025-09-17T20:17:50.523378] [WARN ] [VALIDATOR ] MHLA: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T20:17:50.523730] [FATAL] [MAIN ] MHLA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:17:50.523801] [WARN ] [MAIN ] MHLA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:17:50.523857] [INFO ] [LOCAL ] MHLA: Starting deletion of primary data. [2025-09-17T20:17:50.523926] [DEBUG] [LOCAL ] MHLA: No primary data file found to delete. [2025-09-17T20:17:50.523963] [INFO ] [LOCAL ] MHLA: Starting deletion of derivative data. [2025-09-17T20:17:50.524011] [DEBUG] [LOCAL ] MHLA: No derivative data file found to delete. [2025-09-17T20:17:50.524081] [INFO ] [MAIN ] Update Progress: 1354/2371 symbols completed. MHLA took 20.5s. Estimated remaining: 2h 28m 35s. Rate: 6.8 symbols/min [2025-09-17T20:17:50.702119] [INFO ] [MAIN ] MHO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:17:50.729462] [DEBUG] [LOCAL ] MHO: Loaded 24434 existing records from primary storage. [2025-09-17T20:17:50.729721] [INFO ] [MAIN ] MHO: Loaded 24434 existing records. [2025-09-17T20:17:50.824953] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-08. [2025-09-17T20:17:50.932481] [WARN ] [MAIN ] MHO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:17:50.933139] [INFO ] [MAIN ] MHO: Wiping existing primary data before full refresh. [2025-09-17T20:17:50.933235] [INFO ] [LOCAL ] MHO: Starting deletion of primary data. [2025-09-17T20:17:50.934136] [DEBUG] [LOCAL ] MHO: Deleted primary data file. [2025-09-17T20:17:50.934218] [INFO ] [MAIN ] MHO: Starting full primary refresh. [2025-09-17T20:17:51.280013] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T20:17:51.372778] [INFO ] [REMOTE ] MHO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:17:51.615828] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-11. [2025-09-17T20:17:51.740861] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T20:17:52.415815] [INFO ] [REMOTE ] MHF: Fetching primary data for 2025-09. [2025-09-17T20:17:52.787077] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T20:17:52.955781] [INFO ] [REMOTE ] MHF: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T20:17:52.958030] [INFO ] [REMOTE ] MHF: Full fetch complete (12854 records). [2025-09-17T20:17:52.958140] [DEBUG] [VALIDATOR ] MHF: Validating primary data. [2025-09-17T20:17:53.218696] [INFO ] [REMOTE ] MHO: Fetching primary data for 2024-12. [2025-09-17T20:17:53.377601] [DEBUG] [VALIDATOR ] MHF: All expected trading days are present. [2025-09-17T20:17:53.377747] [DEBUG] [VALIDATOR ] MHF: Primary data validation passed. [2025-09-17T20:17:53.378220] [INFO ] [MAIN ] MHF: Fetched primary data is valid. [2025-09-17T20:17:53.378265] [DEBUG] [LOCAL ] MHF: Saving primary data. [2025-09-17T20:17:53.379283] [DEBUG] [LOCAL ] MHF: Trimmed 12854 records to 8551 (keeping 200 days of data) [2025-09-17T20:17:53.442905] [DEBUG] [LOCAL ] MHF: Primary data saved (8551 records). [2025-09-17T20:17:53.443174] [INFO ] [MAIN ] MHF: Full history saved. [2025-09-17T20:17:53.443333] [INFO ] [MAIN ] Update Progress: 1355/2371 symbols completed. MHF took 39.6s. Estimated remaining: 2h 28m 21s. Rate: 6.8 symbols/min [2025-09-17T20:17:53.627962] [INFO ] [MAIN ] MIAX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:17:53.628211] [DEBUG] [LOCAL ] MIAX: No existing data file found in primary storage. [2025-09-17T20:17:53.628250] [WARN ] [MAIN ] MIAX: No existing data found, performing full refresh instead. [2025-09-17T20:17:53.628383] [INFO ] [MAIN ] MIAX: Wiping existing primary data before full refresh. [2025-09-17T20:17:53.628430] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-17T20:17:53.628475] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-17T20:17:53.628508] [INFO ] [MAIN ] MIAX: Starting full primary refresh. [2025-09-17T20:17:54.017048] [INFO ] [REMOTE ] MIAX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:17:54.017188] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-04. [2025-09-17T20:17:54.693207] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T20:17:54.815802] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-11. [2025-09-17T20:17:55.118887] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:17:55.119238] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-11 [2025-09-17T20:17:55.615806] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2024-12. [2025-09-17T20:17:55.759792] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T20:17:55.888921] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:17:55.889395] [WARN ] [REMOTE ] MIAX: No data returned for month 2024-12 [2025-09-17T20:17:56.415816] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-01. [2025-09-17T20:17:57.215832] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-11. [2025-09-17T20:17:57.862052] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T20:17:58.015777] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-01. [2025-09-17T20:17:58.183429] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T20:17:58.253433] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:17:58.253844] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-01 [2025-09-17T20:17:58.815831] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-02. [2025-09-17T20:17:59.084996] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:17:59.085400] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-02 [2025-09-17T20:17:59.615856] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-05. [2025-09-17T20:18:00.415810] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-03. [2025-09-17T20:18:00.720825] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:18:00.721244] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-03 [2025-09-17T20:18:01.215813] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-04. [2025-09-17T20:18:01.279164] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T20:18:01.496585] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:18:01.496994] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-04 [2025-09-17T20:18:02.015823] [INFO ] [REMOTE ] MHN: Fetching primary data for 2024-12. [2025-09-17T20:18:02.815834] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-02. [2025-09-17T20:18:02.890543] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T20:18:03.615779] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-01. [2025-09-17T20:18:04.259039] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T20:18:04.415835] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-03. [2025-09-17T20:18:04.473445] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T20:18:05.215850] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-06. [2025-09-17T20:18:05.736232] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T20:18:06.015837] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-04. [2025-09-17T20:18:06.747041] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T20:18:06.815741] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-07. [2025-09-17T20:18:07.333788] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T20:18:07.615798] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-02. [2025-09-17T20:18:08.415741] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-05. [2025-09-17T20:18:08.425856] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T20:18:08.520672] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T20:18:08.707276] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:18:08.707686] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-05 [2025-09-17T20:18:09.215794] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-08. [2025-09-17T20:18:10.015818] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-06. [2025-09-17T20:18:10.287585] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:18:10.288041] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-06 [2025-09-17T20:18:10.565108] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T20:18:10.815851] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-03. [2025-09-17T20:18:11.613989] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T20:18:11.615887] [INFO ] [REMOTE ] MHK: Fetching primary data for 2025-09. [2025-09-17T20:18:12.415836] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-04. [2025-09-17T20:18:12.881064] [INFO ] [REMOTE ] MHK: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T20:18:12.887078] [INFO ] [REMOTE ] MHK: Full fetch complete (60756 records). [2025-09-17T20:18:12.887207] [DEBUG] [VALIDATOR ] MHK: Validating primary data. [2025-09-17T20:18:13.203753] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T20:18:13.217564] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-07. [2025-09-17T20:18:13.313759] [DEBUG] [VALIDATOR ] MHK: All expected trading days are present. [2025-09-17T20:18:13.313985] [DEBUG] [VALIDATOR ] MHK: Primary data validation passed. [2025-09-17T20:18:13.315198] [INFO ] [MAIN ] MHK: Fetched primary data is valid. [2025-09-17T20:18:13.315260] [DEBUG] [LOCAL ] MHK: Saving primary data. [2025-09-17T20:18:13.317074] [DEBUG] [LOCAL ] MHK: Trimmed 60756 records to 42541 (keeping 200 days of data) [2025-09-17T20:18:13.573692] [DEBUG] [REMOTE ] MIAX: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:18:13.576261] [WARN ] [REMOTE ] MIAX: No data returned for month 2025-07 [2025-09-17T20:18:13.623719] [DEBUG] [LOCAL ] MHK: Primary data saved (42541 records). [2025-09-17T20:18:13.623888] [INFO ] [MAIN ] MHK: Full history saved. [2025-09-17T20:18:13.623987] [INFO ] [MAIN ] Update Progress: 1356/2371 symbols completed. MHK took 50.5s. Estimated remaining: 2h 28m 21s. Rate: 6.8 symbols/min [2025-09-17T20:18:13.792149] [INFO ] [MAIN ] MIN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:18:13.806935] [DEBUG] [LOCAL ] MIN: Loaded 13186 existing records from primary storage. [2025-09-17T20:18:13.807063] [INFO ] [MAIN ] MIN: Loaded 13186 existing records. [2025-09-17T20:18:13.983023] [WARN ] [MAIN ] MIN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:18:13.983291] [INFO ] [MAIN ] MIN: Wiping existing primary data before full refresh. [2025-09-17T20:18:13.983338] [INFO ] [LOCAL ] MIN: Starting deletion of primary data. [2025-09-17T20:18:13.983840] [DEBUG] [LOCAL ] MIN: Deleted primary data file. [2025-09-17T20:18:13.983893] [INFO ] [MAIN ] MIN: Starting full primary refresh. [2025-09-17T20:18:14.021928] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-05. [2025-09-17T20:18:14.341744] [INFO ] [REMOTE ] MIN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:18:14.815794] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-11. [2025-09-17T20:18:15.121320] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T20:18:15.493032] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T20:18:15.615751] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-08. [2025-09-17T20:18:16.415821] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-05. [2025-09-17T20:18:17.086482] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T20:18:17.101631] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T20:18:17.215808] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-06. [2025-09-17T20:18:17.811081] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T20:18:18.015816] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-06. [2025-09-17T20:18:18.815810] [INFO ] [REMOTE ] MIN: Fetching primary data for 2024-12. [2025-09-17T20:18:19.164666] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T20:18:19.467401] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T20:18:19.615789] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-01. [2025-09-17T20:18:20.416190] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-07. [2025-09-17T20:18:20.417032] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T20:18:21.215824] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-02. [2025-09-17T20:18:21.512760] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T20:18:22.018095] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-08. [2025-09-17T20:18:22.021041] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T20:18:22.815791] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-07. [2025-09-17T20:18:23.319666] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T20:18:23.615818] [INFO ] [REMOTE ] MHO: Fetching primary data for 2025-09. [2025-09-17T20:18:23.649847] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T20:18:24.415794] [INFO ] [REMOTE ] MIAX: Fetching primary data for 2025-09. [2025-09-17T20:18:24.837382] [INFO ] [REMOTE ] MHO: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T20:18:24.841068] [INFO ] [REMOTE ] MHO: Full fetch complete (37316 records). [2025-09-17T20:18:24.841171] [DEBUG] [VALIDATOR ] MHO: Validating primary data. [2025-09-17T20:18:25.215925] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-08. [2025-09-17T20:18:25.227064] [DEBUG] [VALIDATOR ] MHO: All expected trading days are present. [2025-09-17T20:18:25.227153] [DEBUG] [VALIDATOR ] MHO: Primary data validation passed. [2025-09-17T20:18:25.227904] [INFO ] [MAIN ] MHO: Fetched primary data is valid. [2025-09-17T20:18:25.228060] [DEBUG] [LOCAL ] MHO: Saving primary data. [2025-09-17T20:18:25.229075] [DEBUG] [LOCAL ] MHO: Trimmed 37316 records to 24450 (keeping 200 days of data) [2025-09-17T20:18:25.381934] [DEBUG] [LOCAL ] MHO: Primary data saved (24450 records). [2025-09-17T20:18:25.382080] [INFO ] [MAIN ] MHO: Full history saved. [2025-09-17T20:18:25.382172] [INFO ] [MAIN ] Update Progress: 1357/2371 symbols completed. MHO took 34.9s. Estimated remaining: 2h 28m 15s. Rate: 6.8 symbols/min [2025-09-17T20:18:25.846355] [INFO ] [REMOTE ] MIAX: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T20:18:25.851240] [INFO ] [REMOTE ] MIAX: Full fetch complete (7345 records). [2025-09-17T20:18:25.851311] [DEBUG] [VALIDATOR ] MIAX: Validating primary data. [2025-09-17T20:18:26.024489] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-03. [2025-09-17T20:18:26.031788] [WARN ] [VALIDATOR ] MIAX: Validation failed - insufficient historical data. Have 24 unique days, need 200 days [2025-09-17T20:18:26.032815] [FATAL] [MAIN ] MIAX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:18:26.032891] [WARN ] [MAIN ] MIAX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:18:26.032938] [INFO ] [LOCAL ] MIAX: Starting deletion of primary data. [2025-09-17T20:18:26.032990] [DEBUG] [LOCAL ] MIAX: No primary data file found to delete. [2025-09-17T20:18:26.033026] [INFO ] [LOCAL ] MIAX: Starting deletion of derivative data. [2025-09-17T20:18:26.033064] [DEBUG] [LOCAL ] MIAX: No derivative data file found to delete. [2025-09-17T20:18:26.033125] [INFO ] [MAIN ] Update Progress: 1358/2371 symbols completed. MIAX took 32.6s. Estimated remaining: 2h 27m 60s. Rate: 6.8 symbols/min [2025-09-17T20:18:26.077209] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T20:18:26.815789] [INFO ] [REMOTE ] MHN: Fetching primary data for 2025-09. [2025-09-17T20:18:26.837404] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T20:18:27.420243] [INFO ] [REMOTE ] MHN: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T20:18:27.422036] [INFO ] [REMOTE ] MHN: Full fetch complete (12005 records). [2025-09-17T20:18:27.422116] [DEBUG] [VALIDATOR ] MHN: Validating primary data. [2025-09-17T20:18:27.627365] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-04. [2025-09-17T20:18:27.793755] [DEBUG] [VALIDATOR ] MHN: All expected trading days are present. [2025-09-17T20:18:27.793842] [DEBUG] [VALIDATOR ] MHN: Primary data validation passed. [2025-09-17T20:18:27.794347] [INFO ] [MAIN ] MHN: Fetched primary data is valid. [2025-09-17T20:18:27.794396] [DEBUG] [LOCAL ] MHN: Saving primary data. [2025-09-17T20:18:27.795318] [DEBUG] [LOCAL ] MHN: Trimmed 12005 records to 7824 (keeping 200 days of data) [2025-09-17T20:18:27.842126] [DEBUG] [LOCAL ] MHN: Primary data saved (7824 records). [2025-09-17T20:18:27.842263] [INFO ] [MAIN ] MHN: Full history saved. [2025-09-17T20:18:27.842354] [INFO ] [MAIN ] Update Progress: 1359/2371 symbols completed. MHN took 41.2s. Estimated remaining: 2h 27m 46s. Rate: 6.8 symbols/min [2025-09-17T20:18:28.638073] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T20:18:28.641307] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-05. [2025-09-17T20:18:29.700040] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T20:18:29.703292] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-06. [2025-09-17T20:18:30.794745] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T20:18:30.798260] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-07. [2025-09-17T20:18:31.756521] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T20:18:31.762372] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-08. [2025-09-17T20:18:32.856396] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T20:18:32.860335] [INFO ] [REMOTE ] MIN: Fetching primary data for 2025-09. [2025-09-17T20:18:33.643394] [INFO ] [REMOTE ] MIN: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T20:18:33.645546] [INFO ] [REMOTE ] MIN: Full fetch complete (17933 records). [2025-09-17T20:18:33.645636] [DEBUG] [VALIDATOR ] MIN: Validating primary data. [2025-09-17T20:18:34.054750] [DEBUG] [VALIDATOR ] MIN: All expected trading days are present. [2025-09-17T20:18:34.054881] [DEBUG] [VALIDATOR ] MIN: Primary data validation passed. [2025-09-17T20:18:34.055626] [INFO ] [MAIN ] MIN: Fetched primary data is valid. [2025-09-17T20:18:34.055691] [DEBUG] [LOCAL ] MIN: Saving primary data. [2025-09-17T20:18:34.056531] [DEBUG] [LOCAL ] MIN: Trimmed 17933 records to 13207 (keeping 200 days of data) [2025-09-17T20:18:34.139164] [DEBUG] [LOCAL ] MIN: Primary data saved (13207 records). [2025-09-17T20:18:34.139325] [INFO ] [MAIN ] MIN: Full history saved. [2025-09-17T20:18:34.139441] [INFO ] [MAIN ] Update Progress: 1360/2371 symbols completed. MIN took 20.5s. Estimated remaining: 2h 27m 35s. Rate: 6.9 symbols/min [2025-09-17T20:18:34.826294] [INFO ] [MAIN ] MITP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:18:34.871581] [INFO ] [MAIN ] MITT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:18:34.884927] [INFO ] [MAIN ] MITN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:18:34.887667] [DEBUG] [LOCAL ] MITN: No existing data file found in primary storage. [2025-09-17T20:18:34.905866] [INFO ] [MAIN ] MIR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:18:34.906563] [DEBUG] [LOCAL ] MIR: No existing data file found in primary storage. [2025-09-17T20:18:34.905956] [WARN ] [MAIN ] MITN: No existing data found, performing full refresh instead. [2025-09-17T20:18:34.906815] [WARN ] [MAIN ] MIR: No existing data found, performing full refresh instead. [2025-09-17T20:18:34.910387] [INFO ] [MAIN ] MIR: Wiping existing primary data before full refresh. [2025-09-17T20:18:34.910464] [INFO ] [MAIN ] MITN: Wiping existing primary data before full refresh. [2025-09-17T20:18:34.910840] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-17T20:18:34.910941] [INFO ] [LOCAL ] MIR: Starting deletion of primary data. [2025-09-17T20:18:34.909919] [DEBUG] [LOCAL ] MITP: Loaded 2369 existing records from primary storage. [2025-09-17T20:18:34.911052] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-17T20:18:34.911226] [INFO ] [MAIN ] MITP: Loaded 2369 existing records. [2025-09-17T20:18:34.911399] [INFO ] [MAIN ] MITN: Starting full primary refresh. [2025-09-17T20:18:34.928008] [DEBUG] [LOCAL ] MIR: No primary data file found to delete. [2025-09-17T20:18:34.943862] [INFO ] [MAIN ] MIR: Starting full primary refresh. [2025-09-17T20:18:35.259734] [DEBUG] [LOCAL ] MITT: Loaded 23075 existing records from primary storage. [2025-09-17T20:18:35.296526] [INFO ] [MAIN ] MITT: Loaded 23075 existing records. [2025-09-17T20:18:35.428496] [WARN ] [MAIN ] MITP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:18:35.624989] [INFO ] [MAIN ] MITP: Wiping existing primary data before full refresh. [2025-09-17T20:18:35.707507] [INFO ] [LOCAL ] MITP: Starting deletion of primary data. [2025-09-17T20:18:35.763603] [DEBUG] [LOCAL ] MITP: Deleted primary data file. [2025-09-17T20:18:35.785710] [INFO ] [MAIN ] MITP: Starting full primary refresh. [2025-09-17T20:18:36.054773] [WARN ] [MAIN ] MITT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:18:36.227809] [INFO ] [MAIN ] MITT: Wiping existing primary data before full refresh. [2025-09-17T20:18:36.263581] [INFO ] [REMOTE ] MITN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:18:36.221761] [INFO ] [REMOTE ] MIR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:18:36.270733] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-11. [2025-09-17T20:18:36.271470] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-11. [2025-09-17T20:18:36.264679] [INFO ] [LOCAL ] MITT: Starting deletion of primary data. [2025-09-17T20:18:36.327831] [DEBUG] [LOCAL ] MITT: Deleted primary data file. [2025-09-17T20:18:36.377417] [INFO ] [MAIN ] MITT: Starting full primary refresh. [2025-09-17T20:18:36.877141] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T20:18:36.944380] [INFO ] [REMOTE ] MITN: Fetching primary data for 2024-12. [2025-09-17T20:18:36.929331] [INFO ] [REMOTE ] MITP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:18:36.983945] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-11. [2025-09-17T20:18:37.215398] [INFO ] [REMOTE ] MITT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:18:37.215964] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-11. [2025-09-17T20:18:37.483050] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T20:18:37.484190] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-01. [2025-09-17T20:18:37.660395] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T20:18:37.661988] [INFO ] [REMOTE ] MITP: Fetching primary data for 2024-12. [2025-09-17T20:18:37.882516] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-17T20:18:38.015747] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-02. [2025-09-17T20:18:38.053850] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2024-12 (0.39 seconds). [2025-09-17T20:18:38.057609] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T20:18:38.302586] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T20:18:38.497961] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T20:18:38.815782] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-01. [2025-09-17T20:18:39.322877] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T20:18:39.615784] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-03. [2025-09-17T20:18:40.236137] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T20:18:40.415791] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-04. [2025-09-17T20:18:41.099587] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T20:18:41.215840] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-05. [2025-09-17T20:18:41.698537] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T20:18:42.015817] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-02. [2025-09-17T20:18:42.548537] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T20:18:42.815780] [INFO ] [REMOTE ] MIR: Fetching primary data for 2024-12. [2025-09-17T20:18:43.615808] [INFO ] [REMOTE ] MITT: Fetching primary data for 2024-12. [2025-09-17T20:18:44.360134] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T20:18:44.415746] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-01. [2025-09-17T20:18:44.994745] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T20:18:45.215819] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-03. [2025-09-17T20:18:45.661595] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T20:18:46.015752] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-06. [2025-09-17T20:18:46.108099] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T20:18:46.319851] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-17T20:18:46.815794] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-07. [2025-09-17T20:18:47.241501] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T20:18:47.615780] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-08. [2025-09-17T20:18:48.123061] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-08 (0.51 seconds). [2025-09-17T20:18:48.415790] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-01. [2025-09-17T20:18:49.215774] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-02. [2025-09-17T20:18:49.713735] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T20:18:50.015770] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-02. [2025-09-17T20:18:50.682632] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T20:18:50.815720] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-03. [2025-09-17T20:18:51.169818] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T20:18:51.615779] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-03. [2025-09-17T20:18:52.411562] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T20:18:52.421347] [INFO ] [REMOTE ] MITN: Fetching primary data for 2025-09. [2025-09-17T20:18:52.796480] [INFO ] [REMOTE ] MITN: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T20:18:52.797221] [INFO ] [REMOTE ] MITN: Full fetch complete (2291 records). [2025-09-17T20:18:52.797290] [DEBUG] [VALIDATOR ] MITN: Validating primary data. [2025-09-17T20:18:52.976181] [WARN ] [VALIDATOR ] MITN: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T20:18:52.976417] [FATAL] [MAIN ] MITN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:18:52.976469] [WARN ] [MAIN ] MITN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:18:52.976629] [INFO ] [LOCAL ] MITN: Starting deletion of primary data. [2025-09-17T20:18:52.976798] [DEBUG] [LOCAL ] MITN: No primary data file found to delete. [2025-09-17T20:18:52.976914] [INFO ] [LOCAL ] MITN: Starting deletion of derivative data. [2025-09-17T20:18:52.976988] [DEBUG] [LOCAL ] MITN: No derivative data file found to delete. [2025-09-17T20:18:52.977117] [INFO ] [MAIN ] Update Progress: 1361/2371 symbols completed. MITN took 18.8s. Estimated remaining: 2h 27m 34s. Rate: 6.8 symbols/min [2025-09-17T20:18:53.111734] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T20:18:53.185399] [INFO ] [MAIN ] MIY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:18:53.194122] [DEBUG] [LOCAL ] MIY: Loaded 6029 existing records from primary storage. [2025-09-17T20:18:53.194266] [INFO ] [MAIN ] MIY: Loaded 6029 existing records. [2025-09-17T20:18:53.223258] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-04. [2025-09-17T20:18:53.411295] [WARN ] [MAIN ] MIY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:18:53.411658] [INFO ] [MAIN ] MIY: Wiping existing primary data before full refresh. [2025-09-17T20:18:53.411709] [INFO ] [LOCAL ] MIY: Starting deletion of primary data. [2025-09-17T20:18:53.412030] [DEBUG] [LOCAL ] MIY: Deleted primary data file. [2025-09-17T20:18:53.412075] [INFO ] [MAIN ] MIY: Starting full primary refresh. [2025-09-17T20:18:53.767416] [INFO ] [REMOTE ] MIY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:18:54.015788] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-11. [2025-09-17T20:18:54.791608] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T20:18:54.815752] [INFO ] [REMOTE ] MIY: Fetching primary data for 2024-12. [2025-09-17T20:18:54.869479] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T20:18:55.540938] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T20:18:55.615745] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-01. [2025-09-17T20:18:56.183009] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T20:18:56.415804] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-04. [2025-09-17T20:18:57.023509] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T20:18:57.215804] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-02. [2025-09-17T20:18:57.985218] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T20:18:58.015807] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-03. [2025-09-17T20:18:58.677670] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T20:18:58.815795] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-05. [2025-09-17T20:18:59.527225] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T20:18:59.615772] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-06. [2025-09-17T20:19:00.082862] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T20:19:00.415776] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-04. [2025-09-17T20:19:01.103782] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T20:19:01.215833] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-04. [2025-09-17T20:19:02.015820] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-07. [2025-09-17T20:19:02.527672] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T20:19:02.704410] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T20:19:02.815792] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-08. [2025-09-17T20:19:03.291215] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T20:19:03.615833] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-05. [2025-09-17T20:19:04.415789] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-05. [2025-09-17T20:19:04.603754] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T20:19:05.215797] [INFO ] [REMOTE ] MITP: Fetching primary data for 2025-09. [2025-09-17T20:19:05.518255] [INFO ] [REMOTE ] MITP: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-17T20:19:05.519035] [INFO ] [REMOTE ] MITP: Full fetch complete (3284 records). [2025-09-17T20:19:05.519102] [DEBUG] [VALIDATOR ] MITP: Validating primary data. [2025-09-17T20:19:05.884699] [DEBUG] [VALIDATOR ] MITP: All expected trading days are present. [2025-09-17T20:19:05.884783] [DEBUG] [VALIDATOR ] MITP: Primary data validation passed. [2025-09-17T20:19:05.884903] [INFO ] [MAIN ] MITP: Fetched primary data is valid. [2025-09-17T20:19:05.884952] [DEBUG] [LOCAL ] MITP: Saving primary data. [2025-09-17T20:19:05.885318] [DEBUG] [LOCAL ] MITP: Trimmed 3284 records to 2357 (keeping 200 days of data) [2025-09-17T20:19:05.899422] [DEBUG] [LOCAL ] MITP: Primary data saved (2357 records). [2025-09-17T20:19:05.899491] [INFO ] [MAIN ] MITP: Full history saved. [2025-09-17T20:19:05.899574] [INFO ] [MAIN ] Update Progress: 1362/2371 symbols completed. MITP took 31.8s. Estimated remaining: 2h 27m 28s. Rate: 6.8 symbols/min [2025-09-17T20:19:06.020945] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-06. [2025-09-17T20:19:06.071187] [INFO ] [MAIN ] MKC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:19:06.127870] [DEBUG] [LOCAL ] MKC: Loaded 52466 existing records from primary storage. [2025-09-17T20:19:06.128099] [INFO ] [MAIN ] MKC: Loaded 52466 existing records. [2025-09-17T20:19:06.310665] [WARN ] [MAIN ] MKC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:19:06.311056] [INFO ] [MAIN ] MKC: Wiping existing primary data before full refresh. [2025-09-17T20:19:06.311129] [INFO ] [LOCAL ] MKC: Starting deletion of primary data. [2025-09-17T20:19:06.312217] [DEBUG] [LOCAL ] MKC: Deleted primary data file. [2025-09-17T20:19:06.312270] [INFO ] [MAIN ] MKC: Starting full primary refresh. [2025-09-17T20:19:06.525161] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-17T20:19:06.715081] [INFO ] [REMOTE ] MKC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:19:06.815815] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-11. [2025-09-17T20:19:07.352101] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T20:19:07.616022] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-05. [2025-09-17T20:19:08.285405] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T20:19:08.415805] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-06. [2025-09-17T20:19:08.507822] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T20:19:09.190098] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T20:19:09.215798] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-07. [2025-09-17T20:19:09.860102] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T20:19:10.015805] [INFO ] [REMOTE ] MKC: Fetching primary data for 2024-12. [2025-09-17T20:19:10.815800] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-06. [2025-09-17T20:19:11.615820] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-07. [2025-09-17T20:19:11.712169] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T20:19:12.415800] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-08. [2025-09-17T20:19:12.614274] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T20:19:12.718626] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T20:19:12.833054] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-17T20:19:13.215803] [INFO ] [REMOTE ] MIY: Fetching primary data for 2025-09. [2025-09-17T20:19:13.943902] [INFO ] [REMOTE ] MIY: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T20:19:13.945465] [INFO ] [REMOTE ] MIY: Full fetch complete (9144 records). [2025-09-17T20:19:13.945563] [DEBUG] [VALIDATOR ] MIY: Validating primary data. [2025-09-17T20:19:14.020928] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-07. [2025-09-17T20:19:14.374379] [DEBUG] [VALIDATOR ] MIY: All expected trading days are present. [2025-09-17T20:19:14.374464] [DEBUG] [VALIDATOR ] MIY: Primary data validation passed. [2025-09-17T20:19:14.374722] [INFO ] [MAIN ] MIY: Fetched primary data is valid. [2025-09-17T20:19:14.374769] [DEBUG] [LOCAL ] MIY: Saving primary data. [2025-09-17T20:19:14.375301] [DEBUG] [LOCAL ] MIY: Trimmed 9144 records to 6046 (keeping 200 days of data) [2025-09-17T20:19:14.414862] [DEBUG] [LOCAL ] MIY: Primary data saved (6046 records). [2025-09-17T20:19:14.415011] [INFO ] [MAIN ] MIY: Full history saved. [2025-09-17T20:19:14.415108] [INFO ] [MAIN ] Update Progress: 1363/2371 symbols completed. MIY took 21.4s. Estimated remaining: 2h 27m 19s. Rate: 6.8 symbols/min [2025-09-17T20:19:14.595622] [INFO ] [MAIN ] MKL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:19:14.638721] [DEBUG] [LOCAL ] MKL: Loaded 34375 existing records from primary storage. [2025-09-17T20:19:14.638904] [INFO ] [MAIN ] MKL: Loaded 34375 existing records. [2025-09-17T20:19:14.816163] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-01. [2025-09-17T20:19:14.819494] [WARN ] [MAIN ] MKL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:19:14.819952] [INFO ] [MAIN ] MKL: Wiping existing primary data before full refresh. [2025-09-17T20:19:14.820296] [INFO ] [LOCAL ] MKL: Starting deletion of primary data. [2025-09-17T20:19:14.822138] [DEBUG] [LOCAL ] MKL: Deleted primary data file. [2025-09-17T20:19:14.822299] [INFO ] [MAIN ] MKL: Starting full primary refresh. [2025-09-17T20:19:15.240058] [INFO ] [REMOTE ] MKL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:19:15.615838] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-11. [2025-09-17T20:19:16.039268] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T20:19:16.369097] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T20:19:16.415811] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-02. [2025-09-17T20:19:17.106293] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T20:19:17.215755] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-08. [2025-09-17T20:19:18.015752] [INFO ] [REMOTE ] MKL: Fetching primary data for 2024-12. [2025-09-17T20:19:18.111554] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T20:19:18.401899] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T20:19:18.815799] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-08. [2025-09-17T20:19:19.551509] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T20:19:19.615754] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-01. [2025-09-17T20:19:20.415797] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-03. [2025-09-17T20:19:20.559277] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T20:19:20.664287] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T20:19:21.215820] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-02. [2025-09-17T20:19:22.015758] [INFO ] [REMOTE ] MITT: Fetching primary data for 2025-09. [2025-09-17T20:19:22.451456] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T20:19:22.820867] [INFO ] [REMOTE ] MIR: Fetching primary data for 2025-09. [2025-09-17T20:19:22.834778] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T20:19:22.957815] [INFO ] [REMOTE ] MITT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T20:19:22.961493] [INFO ] [REMOTE ] MITT: Full fetch complete (34757 records). [2025-09-17T20:19:22.961599] [DEBUG] [VALIDATOR ] MITT: Validating primary data. [2025-09-17T20:19:23.353205] [DEBUG] [VALIDATOR ] MITT: All expected trading days are present. [2025-09-17T20:19:23.353313] [DEBUG] [VALIDATOR ] MITT: Primary data validation passed. [2025-09-17T20:19:23.354127] [INFO ] [MAIN ] MITT: Fetched primary data is valid. [2025-09-17T20:19:23.354202] [DEBUG] [LOCAL ] MITT: Saving primary data. [2025-09-17T20:19:23.355346] [DEBUG] [LOCAL ] MITT: Trimmed 34757 records to 23028 (keeping 200 days of data) [2025-09-17T20:19:23.503084] [DEBUG] [LOCAL ] MITT: Primary data saved (23028 records). [2025-09-17T20:19:23.503254] [INFO ] [MAIN ] MITT: Full history saved. [2025-09-17T20:19:23.503505] [INFO ] [MAIN ] Update Progress: 1364/2371 symbols completed. MITT took 49.4s. Estimated remaining: 2h 27m 11s. Rate: 6.8 symbols/min [2025-09-17T20:19:23.620880] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-04. [2025-09-17T20:19:23.685703] [INFO ] [MAIN ] MLI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:19:23.729532] [DEBUG] [LOCAL ] MLI: Loaded 43923 existing records from primary storage. [2025-09-17T20:19:23.729713] [INFO ] [MAIN ] MLI: Loaded 43923 existing records. [2025-09-17T20:19:23.917283] [WARN ] [MAIN ] MLI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:19:23.917568] [INFO ] [MAIN ] MLI: Wiping existing primary data before full refresh. [2025-09-17T20:19:23.917617] [INFO ] [LOCAL ] MLI: Starting deletion of primary data. [2025-09-17T20:19:23.919171] [DEBUG] [LOCAL ] MLI: Deleted primary data file. [2025-09-17T20:19:23.919242] [INFO ] [MAIN ] MLI: Starting full primary refresh. [2025-09-17T20:19:24.279491] [INFO ] [REMOTE ] MLI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:19:24.415708] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-11. [2025-09-17T20:19:24.495599] [INFO ] [REMOTE ] MIR: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T20:19:24.505987] [INFO ] [REMOTE ] MIR: Full fetch complete (73194 records). [2025-09-17T20:19:24.506176] [DEBUG] [VALIDATOR ] MIR: Validating primary data. [2025-09-17T20:19:24.911860] [DEBUG] [VALIDATOR ] MIR: All expected trading days are present. [2025-09-17T20:19:24.911960] [DEBUG] [VALIDATOR ] MIR: Primary data validation passed. [2025-09-17T20:19:24.913025] [INFO ] [MAIN ] MIR: Fetched primary data is valid. [2025-09-17T20:19:24.913096] [DEBUG] [LOCAL ] MIR: Saving primary data. [2025-09-17T20:19:24.914751] [DEBUG] [LOCAL ] MIR: Trimmed 73194 records to 50776 (keeping 200 days of data) [2025-09-17T20:19:25.224633] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-03. [2025-09-17T20:19:25.250041] [DEBUG] [LOCAL ] MIR: Primary data saved (50776 records). [2025-09-17T20:19:25.250216] [INFO ] [MAIN ] MIR: Full history saved. [2025-09-17T20:19:25.250360] [INFO ] [MAIN ] Update Progress: 1365/2371 symbols completed. MIR took 51.1s. Estimated remaining: 2h 26m 57s. Rate: 6.8 symbols/min [2025-09-17T20:19:25.443719] [INFO ] [MAIN ] MLM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:19:25.477840] [DEBUG] [LOCAL ] MLM: Loaded 31606 existing records from primary storage. [2025-09-17T20:19:25.477990] [INFO ] [MAIN ] MLM: Loaded 31606 existing records. [2025-09-17T20:19:25.661986] [WARN ] [MAIN ] MLM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:19:25.662579] [INFO ] [MAIN ] MLM: Wiping existing primary data before full refresh. [2025-09-17T20:19:25.662728] [INFO ] [LOCAL ] MLM: Starting deletion of primary data. [2025-09-17T20:19:25.663824] [DEBUG] [LOCAL ] MLM: Deleted primary data file. [2025-09-17T20:19:25.663930] [INFO ] [MAIN ] MLM: Starting full primary refresh. [2025-09-17T20:19:25.986556] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-04 (2.37 seconds). [2025-09-17T20:19:26.041884] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-05. [2025-09-17T20:19:26.083855] [INFO ] [REMOTE ] MLM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:19:26.117490] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T20:19:26.293554] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T20:19:26.815810] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-11. [2025-09-17T20:19:27.615831] [INFO ] [REMOTE ] MLI: Fetching primary data for 2024-12. [2025-09-17T20:19:27.931580] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T20:19:28.060577] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T20:19:28.415776] [INFO ] [REMOTE ] MLM: Fetching primary data for 2024-12. [2025-09-17T20:19:29.215773] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-06. [2025-09-17T20:19:29.288216] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T20:19:29.513832] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T20:19:30.015794] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-01. [2025-09-17T20:19:30.815860] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-01. [2025-09-17T20:19:30.934065] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T20:19:31.186367] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T20:19:31.615821] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-02. [2025-09-17T20:19:32.415836] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-04. [2025-09-17T20:19:32.468213] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T20:19:33.215789] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-02. [2025-09-17T20:19:33.312687] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T20:19:33.983626] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T20:19:34.015735] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-05. [2025-09-17T20:19:34.508218] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T20:19:34.815802] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-07. [2025-09-17T20:19:35.548793] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T20:19:35.615834] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-06. [2025-09-17T20:19:36.415758] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-03. [2025-09-17T20:19:36.576946] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T20:19:37.123461] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T20:19:37.215777] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-08. [2025-09-17T20:19:38.015790] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-03. [2025-09-17T20:19:38.287828] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T20:19:38.779427] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T20:19:38.815806] [INFO ] [REMOTE ] MKC: Fetching primary data for 2025-09. [2025-09-17T20:19:39.456015] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T20:19:39.615778] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-04. [2025-09-17T20:19:40.236506] [INFO ] [REMOTE ] MKC: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T20:19:40.244357] [INFO ] [REMOTE ] MKC: Full fetch complete (75340 records). [2025-09-17T20:19:40.244487] [DEBUG] [VALIDATOR ] MKC: Validating primary data. [2025-09-17T20:19:40.418814] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-07. [2025-09-17T20:19:40.638513] [DEBUG] [VALIDATOR ] MKC: All expected trading days are present. [2025-09-17T20:19:40.638600] [DEBUG] [VALIDATOR ] MKC: Primary data validation passed. [2025-09-17T20:19:40.639623] [INFO ] [MAIN ] MKC: Fetched primary data is valid. [2025-09-17T20:19:40.639776] [DEBUG] [LOCAL ] MKC: Saving primary data. [2025-09-17T20:19:40.641356] [DEBUG] [LOCAL ] MKC: Trimmed 75340 records to 52467 (keeping 200 days of data) [2025-09-17T20:19:40.974588] [DEBUG] [LOCAL ] MKC: Primary data saved (52467 records). [2025-09-17T20:19:40.974871] [INFO ] [MAIN ] MKC: Full history saved. [2025-09-17T20:19:40.976380] [INFO ] [MAIN ] Update Progress: 1366/2371 symbols completed. MKC took 35.1s. Estimated remaining: 2h 26m 53s. Rate: 6.8 symbols/min [2025-09-17T20:19:41.155822] [INFO ] [MAIN ] MLNK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:19:41.185329] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T20:19:41.216286] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-05. [2025-09-17T20:19:41.216782] [DEBUG] [LOCAL ] MLNK: Loaded 25490 existing records from primary storage. [2025-09-17T20:19:41.216920] [INFO ] [MAIN ] MLNK: Loaded 25490 existing records. [2025-09-17T20:19:41.399818] [WARN ] [MAIN ] MLNK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:19:41.400113] [INFO ] [MAIN ] MLNK: Wiping existing primary data before full refresh. [2025-09-17T20:19:41.400161] [INFO ] [LOCAL ] MLNK: Starting deletion of primary data. [2025-09-17T20:19:41.400862] [DEBUG] [LOCAL ] MLNK: Deleted primary data file. [2025-09-17T20:19:41.400923] [INFO ] [MAIN ] MLNK: Starting full primary refresh. [2025-09-17T20:19:41.760023] [INFO ] [REMOTE ] MLNK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:19:41.954754] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T20:19:42.015830] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-11. [2025-09-17T20:19:42.815777] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-08. [2025-09-17T20:19:43.027501] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T20:19:43.344180] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T20:19:43.615801] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-06. [2025-09-17T20:19:44.253110] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T20:19:44.415831] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2024-12. [2025-09-17T20:19:45.075373] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T20:19:45.215783] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-04. [2025-09-17T20:19:45.562271] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T20:19:46.015797] [INFO ] [REMOTE ] MKL: Fetching primary data for 2025-09. [2025-09-17T20:19:46.623575] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T20:19:46.815827] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-01. [2025-09-17T20:19:47.336592] [INFO ] [REMOTE ] MKL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T20:19:47.341288] [INFO ] [REMOTE ] MKL: Full fetch complete (49832 records). [2025-09-17T20:19:47.341409] [DEBUG] [VALIDATOR ] MKL: Validating primary data. [2025-09-17T20:19:47.620836] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-07. [2025-09-17T20:19:47.743752] [DEBUG] [VALIDATOR ] MKL: All expected trading days are present. [2025-09-17T20:19:47.743872] [DEBUG] [VALIDATOR ] MKL: Primary data validation passed. [2025-09-17T20:19:47.745121] [INFO ] [MAIN ] MKL: Fetched primary data is valid. [2025-09-17T20:19:47.745186] [DEBUG] [LOCAL ] MKL: Saving primary data. [2025-09-17T20:19:47.746692] [DEBUG] [LOCAL ] MKL: Trimmed 49832 records to 34327 (keeping 200 days of data) [2025-09-17T20:19:48.000915] [DEBUG] [LOCAL ] MKL: Primary data saved (34327 records). [2025-09-17T20:19:48.001190] [INFO ] [MAIN ] MKL: Full history saved. [2025-09-17T20:19:48.001334] [INFO ] [MAIN ] Update Progress: 1367/2371 symbols completed. MKL took 33.6s. Estimated remaining: 2h 26m 43s. Rate: 6.8 symbols/min [2025-09-17T20:19:48.108109] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T20:19:48.218922] [INFO ] [MAIN ] MLP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:19:48.227099] [DEBUG] [LOCAL ] MLP: Loaded 3041 existing records from primary storage. [2025-09-17T20:19:48.227262] [INFO ] [MAIN ] MLP: Loaded 3041 existing records. [2025-09-17T20:19:48.417130] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-05. [2025-09-17T20:19:48.420109] [WARN ] [MAIN ] MLP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:19:48.421674] [INFO ] [MAIN ] MLP: Wiping existing primary data before full refresh. [2025-09-17T20:19:48.421733] [INFO ] [LOCAL ] MLP: Starting deletion of primary data. [2025-09-17T20:19:48.422185] [DEBUG] [LOCAL ] MLP: Deleted primary data file. [2025-09-17T20:19:48.422246] [INFO ] [MAIN ] MLP: Starting full primary refresh. [2025-09-17T20:19:48.825371] [INFO ] [REMOTE ] MLP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:19:49.215789] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-02. [2025-09-17T20:19:49.547032] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T20:19:49.968410] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T20:19:50.015791] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-03. [2025-09-17T20:19:50.059262] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T20:19:50.815752] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-06. [2025-09-17T20:19:50.893695] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T20:19:51.615812] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-08. [2025-09-17T20:19:51.729005] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T20:19:52.415849] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-04. [2025-09-17T20:19:52.981604] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T20:19:53.216860] [INFO ] [REMOTE ] MLI: Fetching primary data for 2025-09. [2025-09-17T20:19:53.218301] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T20:19:54.015840] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-05. [2025-09-17T20:19:54.523469] [INFO ] [REMOTE ] MLI: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T20:19:54.529563] [INFO ] [REMOTE ] MLI: Full fetch complete (63606 records). [2025-09-17T20:19:54.529716] [DEBUG] [VALIDATOR ] MLI: Validating primary data. [2025-09-17T20:19:54.819370] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-11. [2025-09-17T20:19:54.952722] [DEBUG] [VALIDATOR ] MLI: All expected trading days are present. [2025-09-17T20:19:54.952807] [DEBUG] [VALIDATOR ] MLI: Primary data validation passed. [2025-09-17T20:19:54.953772] [INFO ] [MAIN ] MLI: Fetched primary data is valid. [2025-09-17T20:19:54.953819] [DEBUG] [LOCAL ] MLI: Saving primary data. [2025-09-17T20:19:54.955272] [DEBUG] [LOCAL ] MLI: Trimmed 63606 records to 43959 (keeping 200 days of data) [2025-09-17T20:19:55.222993] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T20:19:55.255725] [DEBUG] [LOCAL ] MLI: Primary data saved (43959 records). [2025-09-17T20:19:55.255832] [INFO ] [MAIN ] MLI: Full history saved. [2025-09-17T20:19:55.255922] [INFO ] [MAIN ] Update Progress: 1368/2371 symbols completed. MLI took 31.8s. Estimated remaining: 2h 26m 33s. Rate: 6.8 symbols/min [2025-09-17T20:19:55.432196] [INFO ] [MAIN ] MLR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:19:55.447137] [DEBUG] [LOCAL ] MLR: Loaded 13173 existing records from primary storage. [2025-09-17T20:19:55.447270] [INFO ] [MAIN ] MLR: Loaded 13173 existing records. [2025-09-17T20:19:55.552164] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T20:19:55.625785] [INFO ] [REMOTE ] MLP: Fetching primary data for 2024-12. [2025-09-17T20:19:55.630297] [WARN ] [MAIN ] MLR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:19:55.631242] [INFO ] [MAIN ] MLR: Wiping existing primary data before full refresh. [2025-09-17T20:19:55.631301] [INFO ] [LOCAL ] MLR: Starting deletion of primary data. [2025-09-17T20:19:55.631786] [DEBUG] [LOCAL ] MLR: Deleted primary data file. [2025-09-17T20:19:55.631837] [INFO ] [MAIN ] MLR: Starting full primary refresh. [2025-09-17T20:19:56.010021] [INFO ] [REMOTE ] MLR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:19:56.401232] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T20:19:56.415760] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-01. [2025-09-17T20:19:56.959064] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T20:19:57.215825] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-06. [2025-09-17T20:19:58.015829] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-11. [2025-09-17T20:19:58.460210] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T20:19:58.815822] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-02. [2025-09-17T20:19:59.033298] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T20:19:59.358671] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T20:19:59.615853] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-07. [2025-09-17T20:20:00.415772] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-07. [2025-09-17T20:20:00.739618] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T20:20:01.215866] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-08. [2025-09-17T20:20:02.015906] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-03. [2025-09-17T20:20:02.815914] [INFO ] [REMOTE ] MLR: Fetching primary data for 2024-12. [2025-09-17T20:20:04.011962] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T20:20:04.013819] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-04. [2025-09-17T20:20:04.127290] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T20:20:04.214572] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-07 (3.80 seconds). [2025-09-17T20:20:04.415900] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-08. [2025-09-17T20:20:04.642564] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T20:20:04.680919] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-08 (3.47 seconds). [2025-09-17T20:20:05.215856] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-05. [2025-09-17T20:20:05.513034] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T20:20:05.976807] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T20:20:06.015888] [INFO ] [REMOTE ] MLNK: Fetching primary data for 2025-09. [2025-09-17T20:20:06.815795] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-01. [2025-09-17T20:20:07.197149] [INFO ] [REMOTE ] MLNK: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T20:20:07.202433] [INFO ] [REMOTE ] MLNK: Full fetch complete (35553 records). [2025-09-17T20:20:07.202634] [DEBUG] [VALIDATOR ] MLNK: Validating primary data. [2025-09-17T20:20:07.623580] [DEBUG] [VALIDATOR ] MLNK: All expected trading days are present. [2025-09-17T20:20:07.621362] [INFO ] [REMOTE ] MLM: Fetching primary data for 2025-09. [2025-09-17T20:20:07.624900] [DEBUG] [VALIDATOR ] MLNK: Primary data validation passed. [2025-09-17T20:20:07.626083] [INFO ] [MAIN ] MLNK: Fetched primary data is valid. [2025-09-17T20:20:07.626152] [DEBUG] [LOCAL ] MLNK: Saving primary data. [2025-09-17T20:20:07.638392] [DEBUG] [LOCAL ] MLNK: Trimmed 35553 records to 25665 (keeping 200 days of data) [2025-09-17T20:20:07.638970] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T20:20:07.805011] [DEBUG] [LOCAL ] MLNK: Primary data saved (25665 records). [2025-09-17T20:20:07.805215] [INFO ] [MAIN ] MLNK: Full history saved. [2025-09-17T20:20:07.805325] [INFO ] [MAIN ] Update Progress: 1369/2371 symbols completed. MLNK took 26.8s. Estimated remaining: 2h 26m 27s. Rate: 6.8 symbols/min [2025-09-17T20:20:07.994179] [INFO ] [MAIN ] MMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:20:08.057942] [DEBUG] [LOCAL ] MMC: Loaded 51806 existing records from primary storage. [2025-09-17T20:20:08.058148] [INFO ] [MAIN ] MMC: Loaded 51806 existing records. [2025-09-17T20:20:08.250638] [WARN ] [MAIN ] MMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:20:08.250996] [INFO ] [MAIN ] MMC: Wiping existing primary data before full refresh. [2025-09-17T20:20:08.251045] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-17T20:20:08.252376] [DEBUG] [LOCAL ] MMC: Deleted primary data file. [2025-09-17T20:20:08.252436] [INFO ] [MAIN ] MMC: Starting full primary refresh. [2025-09-17T20:20:08.426107] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-06. [2025-09-17T20:20:08.656610] [INFO ] [REMOTE ] MMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:20:08.927448] [INFO ] [REMOTE ] MLM: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T20:20:08.931851] [INFO ] [REMOTE ] MLM: Full fetch complete (45849 records). [2025-09-17T20:20:08.932046] [DEBUG] [VALIDATOR ] MLM: Validating primary data. [2025-09-17T20:20:09.151094] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T20:20:09.225215] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-07. [2025-09-17T20:20:09.377754] [DEBUG] [VALIDATOR ] MLM: All expected trading days are present. [2025-09-17T20:20:09.377871] [DEBUG] [VALIDATOR ] MLM: Primary data validation passed. [2025-09-17T20:20:09.379512] [INFO ] [MAIN ] MLM: Fetched primary data is valid. [2025-09-17T20:20:09.379593] [DEBUG] [LOCAL ] MLM: Saving primary data. [2025-09-17T20:20:09.381213] [DEBUG] [LOCAL ] MLM: Trimmed 45849 records to 31541 (keeping 200 days of data) [2025-09-17T20:20:09.619316] [DEBUG] [LOCAL ] MLM: Primary data saved (31541 records). [2025-09-17T20:20:09.619558] [INFO ] [MAIN ] MLM: Full history saved. [2025-09-17T20:20:09.619696] [INFO ] [MAIN ] Update Progress: 1370/2371 symbols completed. MLM took 44.4s. Estimated remaining: 2h 26m 14s. Rate: 6.8 symbols/min [2025-09-17T20:20:09.806460] [INFO ] [MAIN ] MMD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:20:09.811849] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T20:20:09.826130] [DEBUG] [LOCAL ] MMD: Loaded 11096 existing records from primary storage. [2025-09-17T20:20:09.826306] [INFO ] [MAIN ] MMD: Loaded 11096 existing records. [2025-09-17T20:20:10.012514] [WARN ] [MAIN ] MMD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:20:10.012838] [INFO ] [MAIN ] MMD: Wiping existing primary data before full refresh. [2025-09-17T20:20:10.012887] [INFO ] [LOCAL ] MMD: Starting deletion of primary data. [2025-09-17T20:20:10.013333] [DEBUG] [LOCAL ] MMD: Deleted primary data file. [2025-09-17T20:20:10.013391] [INFO ] [MAIN ] MMD: Starting full primary refresh. [2025-09-17T20:20:10.024563] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-11. [2025-09-17T20:20:10.449498] [INFO ] [REMOTE ] MMD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:20:10.815831] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-11. [2025-09-17T20:20:11.615812] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-08. [2025-09-17T20:20:11.685074] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T20:20:11.940217] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T20:20:12.028394] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T20:20:12.415842] [INFO ] [REMOTE ] MLP: Fetching primary data for 2025-09. [2025-09-17T20:20:13.025781] [INFO ] [REMOTE ] MLP: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T20:20:13.027135] [INFO ] [REMOTE ] MLP: Full fetch complete (4702 records). [2025-09-17T20:20:13.027226] [DEBUG] [VALIDATOR ] MLP: Validating primary data. [2025-09-17T20:20:13.224261] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-02. [2025-09-17T20:20:13.432359] [DEBUG] [VALIDATOR ] MLP: All expected trading days are present. [2025-09-17T20:20:13.432468] [DEBUG] [VALIDATOR ] MLP: Primary data validation passed. [2025-09-17T20:20:13.432773] [INFO ] [MAIN ] MLP: Fetched primary data is valid. [2025-09-17T20:20:13.432834] [DEBUG] [LOCAL ] MLP: Saving primary data. [2025-09-17T20:20:13.433296] [DEBUG] [LOCAL ] MLP: Trimmed 4702 records to 3015 (keeping 200 days of data) [2025-09-17T20:20:13.452866] [DEBUG] [LOCAL ] MLP: Primary data saved (3015 records). [2025-09-17T20:20:13.452966] [INFO ] [MAIN ] MLP: Full history saved. [2025-09-17T20:20:13.453055] [INFO ] [MAIN ] Update Progress: 1371/2371 symbols completed. MLP took 25.5s. Estimated remaining: 2h 26m 1s. Rate: 6.8 symbols/min [2025-09-17T20:20:13.642703] [INFO ] [MAIN ] MMI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:20:13.662849] [DEBUG] [LOCAL ] MMI: Loaded 15384 existing records from primary storage. [2025-09-17T20:20:13.663013] [INFO ] [MAIN ] MMI: Loaded 15384 existing records. [2025-09-17T20:20:13.851570] [WARN ] [MAIN ] MMI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:20:13.851928] [INFO ] [MAIN ] MMI: Wiping existing primary data before full refresh. [2025-09-17T20:20:13.851980] [INFO ] [LOCAL ] MMI: Starting deletion of primary data. [2025-09-17T20:20:13.852546] [DEBUG] [LOCAL ] MMI: Deleted primary data file. [2025-09-17T20:20:13.852604] [INFO ] [MAIN ] MMI: Starting full primary refresh. [2025-09-17T20:20:14.015908] [INFO ] [REMOTE ] MMC: Fetching primary data for 2024-12. [2025-09-17T20:20:14.228101] [INFO ] [REMOTE ] MMI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:20:14.607439] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T20:20:14.815895] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-11. [2025-09-17T20:20:15.615855] [INFO ] [REMOTE ] MMD: Fetching primary data for 2024-12. [2025-09-17T20:20:15.738411] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T20:20:16.046498] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T20:20:16.415841] [INFO ] [REMOTE ] MMI: Fetching primary data for 2024-12. [2025-09-17T20:20:16.748803] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T20:20:17.215861] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-03. [2025-09-17T20:20:17.282198] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T20:20:18.015776] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-01. [2025-09-17T20:20:18.245379] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T20:20:18.815808] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-04. [2025-09-17T20:20:19.615811] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-01. [2025-09-17T20:20:19.909654] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T20:20:19.937206] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T20:20:20.415823] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-02. [2025-09-17T20:20:20.601861] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T20:20:21.215785] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-02. [2025-09-17T20:20:22.015790] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-05. [2025-09-17T20:20:22.236125] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T20:20:22.264748] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T20:20:22.815798] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-03. [2025-09-17T20:20:22.948233] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-17T20:20:23.615801] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-01. [2025-09-17T20:20:23.666869] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T20:20:24.415779] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-04. [2025-09-17T20:20:24.522213] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T20:20:25.215797] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-06. [2025-09-17T20:20:25.485215] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T20:20:26.016042] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-03. [2025-09-17T20:20:26.092771] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T20:20:26.815797] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-05. [2025-09-17T20:20:27.615701] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-07. [2025-09-17T20:20:27.691579] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T20:20:27.972000] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T20:20:28.262406] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T20:20:28.415810] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-02. [2025-09-17T20:20:29.215770] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-04. [2025-09-17T20:20:29.412810] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T20:20:30.015792] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-03. [2025-09-17T20:20:30.815757] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-06. [2025-09-17T20:20:31.028834] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T20:20:31.136061] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T20:20:31.615792] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-04. [2025-09-17T20:20:31.623921] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T20:20:32.415797] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-05. [2025-09-17T20:20:32.722043] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T20:20:33.215781] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-05. [2025-09-17T20:20:34.015811] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-08. [2025-09-17T20:20:34.066466] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T20:20:34.098758] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T20:20:34.815852] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-06. [2025-09-17T20:20:35.118295] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T20:20:35.615797] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-07. [2025-09-17T20:20:36.415770] [INFO ] [REMOTE ] MLR: Fetching primary data for 2025-09. [2025-09-17T20:20:36.436735] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T20:20:36.757446] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T20:20:37.215771] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-08. [2025-09-17T20:20:37.294780] [INFO ] [REMOTE ] MLR: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T20:20:37.297216] [INFO ] [REMOTE ] MLR: Full fetch complete (18404 records). [2025-09-17T20:20:37.297295] [DEBUG] [VALIDATOR ] MLR: Validating primary data. [2025-09-17T20:20:37.677428] [DEBUG] [VALIDATOR ] MLR: All expected trading days are present. [2025-09-17T20:20:37.677510] [DEBUG] [VALIDATOR ] MLR: Primary data validation passed. [2025-09-17T20:20:37.677960] [INFO ] [MAIN ] MLR: Fetched primary data is valid. [2025-09-17T20:20:37.678012] [DEBUG] [LOCAL ] MLR: Saving primary data. [2025-09-17T20:20:37.678719] [DEBUG] [LOCAL ] MLR: Trimmed 18404 records to 13118 (keeping 200 days of data) [2025-09-17T20:20:37.770420] [DEBUG] [LOCAL ] MLR: Primary data saved (13118 records). [2025-09-17T20:20:37.770567] [INFO ] [MAIN ] MLR: Full history saved. [2025-09-17T20:20:37.770694] [INFO ] [MAIN ] Update Progress: 1372/2371 symbols completed. MLR took 42.5s. Estimated remaining: 2h 26m 4s. Rate: 6.8 symbols/min [2025-09-17T20:20:37.941486] [INFO ] [MAIN ] MMKT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:20:37.941702] [DEBUG] [LOCAL ] MMKT: No existing data file found in primary storage. [2025-09-17T20:20:37.941742] [WARN ] [MAIN ] MMKT: No existing data found, performing full refresh instead. [2025-09-17T20:20:37.941876] [INFO ] [MAIN ] MMKT: Wiping existing primary data before full refresh. [2025-09-17T20:20:37.941915] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-17T20:20:37.941954] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-17T20:20:37.941987] [INFO ] [MAIN ] MMKT: Starting full primary refresh. [2025-09-17T20:20:38.017289] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-07. [2025-09-17T20:20:38.113540] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T20:20:38.322822] [INFO ] [REMOTE ] MMKT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:20:38.815800] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-11. [2025-09-17T20:20:39.296608] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T20:20:39.615752] [INFO ] [REMOTE ] MMD: Fetching primary data for 2025-09. [2025-09-17T20:20:40.124454] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T20:20:40.377702] [INFO ] [REMOTE ] MMD: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T20:20:40.379778] [INFO ] [REMOTE ] MMD: Full fetch complete (18010 records). [2025-09-17T20:20:40.379857] [DEBUG] [VALIDATOR ] MMD: Validating primary data. [2025-09-17T20:20:40.420923] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-06. [2025-09-17T20:20:40.758249] [DEBUG] [VALIDATOR ] MMD: All expected trading days are present. [2025-09-17T20:20:40.758366] [DEBUG] [VALIDATOR ] MMD: Primary data validation passed. [2025-09-17T20:20:40.758913] [INFO ] [MAIN ] MMD: Fetched primary data is valid. [2025-09-17T20:20:40.758966] [DEBUG] [LOCAL ] MMD: Saving primary data. [2025-09-17T20:20:40.760582] [DEBUG] [LOCAL ] MMD: Trimmed 18010 records to 11157 (keeping 200 days of data) [2025-09-17T20:20:40.842384] [DEBUG] [LOCAL ] MMD: Primary data saved (11157 records). [2025-09-17T20:20:40.842549] [INFO ] [MAIN ] MMD: Full history saved. [2025-09-17T20:20:40.842677] [INFO ] [MAIN ] Update Progress: 1373/2371 symbols completed. MMD took 31.2s. Estimated remaining: 2h 25m 51s. Rate: 6.8 symbols/min [2025-09-17T20:20:41.018930] [INFO ] [MAIN ] MMM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:20:41.077280] [DEBUG] [LOCAL ] MMM: Loaded 53279 existing records from primary storage. [2025-09-17T20:20:41.077467] [INFO ] [MAIN ] MMM: Loaded 53279 existing records. [2025-09-17T20:20:41.227999] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2024-12. [2025-09-17T20:20:41.267897] [WARN ] [MAIN ] MMM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:20:41.268164] [INFO ] [MAIN ] MMM: Wiping existing primary data before full refresh. [2025-09-17T20:20:41.268211] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-17T20:20:41.269993] [DEBUG] [LOCAL ] MMM: Deleted primary data file. [2025-09-17T20:20:41.270046] [INFO ] [MAIN ] MMM: Starting full primary refresh. [2025-09-17T20:20:41.642775] [INFO ] [REMOTE ] MMM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:20:41.654038] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T20:20:41.768401] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T20:20:42.015795] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-11. [2025-09-17T20:20:42.815813] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-08. [2025-09-17T20:20:43.615775] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-07. [2025-09-17T20:20:43.826367] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T20:20:44.415157] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T20:20:44.427356] [INFO ] [REMOTE ] MMM: Fetching primary data for 2024-12. [2025-09-17T20:20:44.664382] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T20:20:45.215806] [INFO ] [REMOTE ] MMC: Fetching primary data for 2025-09. [2025-09-17T20:20:45.983008] [INFO ] [REMOTE ] MMC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T20:20:45.991179] [INFO ] [REMOTE ] MMC: Full fetch complete (74106 records). [2025-09-17T20:20:45.991324] [DEBUG] [VALIDATOR ] MMC: Validating primary data. [2025-09-17T20:20:45.992283] [FATAL] [VALIDATOR ] MMC: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:20:45.992380] [FATAL] [MAIN ] MMC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:20:45.992420] [WARN ] [MAIN ] MMC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:20:45.992475] [INFO ] [LOCAL ] MMC: Starting deletion of primary data. [2025-09-17T20:20:45.992547] [DEBUG] [LOCAL ] MMC: No primary data file found to delete. [2025-09-17T20:20:45.992585] [INFO ] [LOCAL ] MMC: Starting deletion of derivative data. [2025-09-17T20:20:45.992929] [DEBUG] [LOCAL ] MMC: Deleted derivative data file. [2025-09-17T20:20:45.993782] [INFO ] [MAIN ] Update Progress: 1374/2371 symbols completed. MMC took 38.2s. Estimated remaining: 2h 25m 39s. Rate: 6.8 symbols/min [2025-09-17T20:20:46.024710] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-01. [2025-09-17T20:20:46.171171] [INFO ] [MAIN ] MMS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:20:46.214970] [DEBUG] [LOCAL ] MMS: Loaded 34185 existing records from primary storage. [2025-09-17T20:20:46.215141] [INFO ] [MAIN ] MMS: Loaded 34185 existing records. [2025-09-17T20:20:46.409162] [WARN ] [MAIN ] MMS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:20:46.409485] [INFO ] [MAIN ] MMS: Wiping existing primary data before full refresh. [2025-09-17T20:20:46.409637] [INFO ] [LOCAL ] MMS: Starting deletion of primary data. [2025-09-17T20:20:46.410758] [DEBUG] [LOCAL ] MMS: Deleted primary data file. [2025-09-17T20:20:46.410809] [INFO ] [MAIN ] MMS: Starting full primary refresh. [2025-09-17T20:20:46.647062] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T20:20:46.817001] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-08. [2025-09-17T20:20:46.844216] [INFO ] [REMOTE ] MMS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:20:46.821792] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-17T20:20:47.615803] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-01. [2025-09-17T20:20:47.955182] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T20:20:48.415819] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-11. [2025-09-17T20:20:49.215829] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-02. [2025-09-17T20:20:49.550954] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T20:20:49.695858] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T20:20:50.015827] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-02. [2025-09-17T20:20:50.044423] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T20:20:50.815788] [INFO ] [REMOTE ] MMS: Fetching primary data for 2024-12. [2025-09-17T20:20:51.615787] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-03. [2025-09-17T20:20:51.944693] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T20:20:51.988808] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T20:20:52.415795] [INFO ] [REMOTE ] MMI: Fetching primary data for 2025-09. [2025-09-17T20:20:52.452488] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T20:20:53.215813] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-04. [2025-09-17T20:20:53.288767] [INFO ] [REMOTE ] MMI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T20:20:53.291577] [INFO ] [REMOTE ] MMI: Full fetch complete (20740 records). [2025-09-17T20:20:53.291795] [DEBUG] [VALIDATOR ] MMI: Validating primary data. [2025-09-17T20:20:53.761938] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T20:20:53.799157] [DEBUG] [VALIDATOR ] MMI: All expected trading days are present. [2025-09-17T20:20:53.799289] [DEBUG] [VALIDATOR ] MMI: Primary data validation passed. [2025-09-17T20:20:53.799934] [INFO ] [MAIN ] MMI: Fetched primary data is valid. [2025-09-17T20:20:53.800002] [DEBUG] [LOCAL ] MMI: Saving primary data. [2025-09-17T20:20:53.801007] [DEBUG] [LOCAL ] MMI: Trimmed 20740 records to 15362 (keeping 200 days of data) [2025-09-17T20:20:53.918677] [DEBUG] [LOCAL ] MMI: Primary data saved (15362 records). [2025-09-17T20:20:53.918873] [INFO ] [MAIN ] MMI: Full history saved. [2025-09-17T20:20:53.919000] [INFO ] [MAIN ] Update Progress: 1375/2371 symbols completed. MMI took 40.5s. Estimated remaining: 2h 25m 30s. Rate: 6.8 symbols/min [2025-09-17T20:20:54.021103] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-01. [2025-09-17T20:20:54.130545] [INFO ] [MAIN ] MMT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:20:54.144128] [DEBUG] [LOCAL ] MMT: Loaded 11481 existing records from primary storage. [2025-09-17T20:20:54.144291] [INFO ] [MAIN ] MMT: Loaded 11481 existing records. [2025-09-17T20:20:54.329324] [WARN ] [MAIN ] MMT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:20:54.329670] [INFO ] [MAIN ] MMT: Wiping existing primary data before full refresh. [2025-09-17T20:20:54.329720] [INFO ] [LOCAL ] MMT: Starting deletion of primary data. [2025-09-17T20:20:54.330099] [DEBUG] [LOCAL ] MMT: Deleted primary data file. [2025-09-17T20:20:54.330147] [INFO ] [MAIN ] MMT: Starting full primary refresh. [2025-09-17T20:20:54.715966] [INFO ] [REMOTE ] MMT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:20:54.815785] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-05. [2025-09-17T20:20:55.289778] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T20:20:55.615823] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-06. [2025-09-17T20:20:55.663478] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T20:20:56.016739] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-17T20:20:56.415798] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-11. [2025-09-17T20:20:57.132548] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T20:20:57.215821] [INFO ] [REMOTE ] MMT: Fetching primary data for 2024-12. [2025-09-17T20:20:58.015810] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-07. [2025-09-17T20:20:58.143143] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T20:20:58.398465] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-07 (0.38 seconds). [2025-09-17T20:20:58.815804] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-01. [2025-09-17T20:20:59.615808] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-02. [2025-09-17T20:20:59.774265] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T20:21:00.415769] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-08. [2025-09-17T20:21:00.862937] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T20:21:01.215843] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-02. [2025-09-17T20:21:01.319998] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T20:21:02.015880] [INFO ] [REMOTE ] MMKT: Fetching primary data for 2025-09. [2025-09-17T20:21:02.061770] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T20:21:02.512046] [INFO ] [REMOTE ] MMKT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T20:21:02.512917] [INFO ] [REMOTE ] MMKT: Full fetch complete (2143 records). [2025-09-17T20:21:02.512992] [DEBUG] [VALIDATOR ] MMKT: Validating primary data. [2025-09-17T20:21:02.697058] [WARN ] [VALIDATOR ] MMKT: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T20:21:02.697304] [FATAL] [MAIN ] MMKT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:21:02.697355] [WARN ] [MAIN ] MMKT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:21:02.697403] [INFO ] [LOCAL ] MMKT: Starting deletion of primary data. [2025-09-17T20:21:02.697462] [DEBUG] [LOCAL ] MMKT: No primary data file found to delete. [2025-09-17T20:21:02.697499] [INFO ] [LOCAL ] MMKT: Starting deletion of derivative data. [2025-09-17T20:21:02.697539] [DEBUG] [LOCAL ] MMKT: No derivative data file found to delete. [2025-09-17T20:21:02.697603] [INFO ] [MAIN ] Update Progress: 1376/2371 symbols completed. MMKT took 24.9s. Estimated remaining: 2h 25m 21s. Rate: 6.8 symbols/min [2025-09-17T20:21:02.820875] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-03. [2025-09-17T20:21:02.879207] [INFO ] [MAIN ] MMU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:21:02.899539] [DEBUG] [LOCAL ] MMU: Loaded 16989 existing records from primary storage. [2025-09-17T20:21:02.899711] [INFO ] [MAIN ] MMU: Loaded 16989 existing records. [2025-09-17T20:21:03.080947] [WARN ] [MAIN ] MMU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:21:03.081292] [INFO ] [MAIN ] MMU: Wiping existing primary data before full refresh. [2025-09-17T20:21:03.081349] [INFO ] [LOCAL ] MMU: Starting deletion of primary data. [2025-09-17T20:21:03.082110] [DEBUG] [LOCAL ] MMU: Deleted primary data file. [2025-09-17T20:21:03.082184] [INFO ] [MAIN ] MMU: Starting full primary refresh. [2025-09-17T20:21:03.452746] [INFO ] [REMOTE ] MMU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:21:03.615792] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-11. [2025-09-17T20:21:04.420879] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-03. [2025-09-17T20:21:04.434921] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T20:21:04.484383] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T20:21:05.215755] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-04. [2025-09-17T20:21:05.271212] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T20:21:06.015804] [INFO ] [REMOTE ] MMU: Fetching primary data for 2024-12. [2025-09-17T20:21:06.795904] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T20:21:06.815760] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-04. [2025-09-17T20:21:07.178366] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T20:21:07.615808] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-05. [2025-09-17T20:21:07.678046] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T20:21:08.415802] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-05. [2025-09-17T20:21:09.089935] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T20:21:09.099151] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T20:21:09.215753] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-06. [2025-09-17T20:21:10.015788] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-06. [2025-09-17T20:21:10.192071] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T20:21:10.815789] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-01. [2025-09-17T20:21:11.444152] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T20:21:11.615797] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-07. [2025-09-17T20:21:11.771050] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T20:21:12.415786] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-03. [2025-09-17T20:21:13.115057] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T20:21:13.215802] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-08. [2025-09-17T20:21:14.015800] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-07. [2025-09-17T20:21:14.598175] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T20:21:14.808390] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T20:21:14.815945] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-02. [2025-09-17T20:21:15.042335] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T20:21:15.615766] [INFO ] [REMOTE ] MMS: Fetching primary data for 2025-09. [2025-09-17T20:21:15.749412] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T20:21:16.415828] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-08. [2025-09-17T20:21:17.099983] [INFO ] [REMOTE ] MMS: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T20:21:17.105158] [INFO ] [REMOTE ] MMS: Full fetch complete (52437 records). [2025-09-17T20:21:17.105269] [DEBUG] [VALIDATOR ] MMS: Validating primary data. [2025-09-17T20:21:17.220956] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T20:21:17.220613] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-04. [2025-09-17T20:21:17.511257] [DEBUG] [VALIDATOR ] MMS: All expected trading days are present. [2025-09-17T20:21:17.511357] [DEBUG] [VALIDATOR ] MMS: Primary data validation passed. [2025-09-17T20:21:17.512460] [INFO ] [MAIN ] MMS: Fetched primary data is valid. [2025-09-17T20:21:17.512520] [DEBUG] [LOCAL ] MMS: Saving primary data. [2025-09-17T20:21:17.513916] [DEBUG] [LOCAL ] MMS: Trimmed 52437 records to 34156 (keeping 200 days of data) [2025-09-17T20:21:17.734368] [DEBUG] [LOCAL ] MMS: Primary data saved (34156 records). [2025-09-17T20:21:17.734529] [INFO ] [MAIN ] MMS: Full history saved. [2025-09-17T20:21:17.734627] [INFO ] [MAIN ] Update Progress: 1377/2371 symbols completed. MMS took 31.7s. Estimated remaining: 2h 25m 17s. Rate: 6.8 symbols/min [2025-09-17T20:21:17.923774] [INFO ] [MAIN ] MNR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:21:17.948902] [DEBUG] [LOCAL ] MNR: Loaded 24847 existing records from primary storage. [2025-09-17T20:21:17.949056] [INFO ] [MAIN ] MNR: Loaded 24847 existing records. [2025-09-17T20:21:18.020946] [INFO ] [REMOTE ] MMT: Fetching primary data for 2025-09. [2025-09-17T20:21:18.137373] [WARN ] [MAIN ] MNR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:21:18.137668] [INFO ] [MAIN ] MNR: Wiping existing primary data before full refresh. [2025-09-17T20:21:18.137718] [INFO ] [LOCAL ] MNR: Starting deletion of primary data. [2025-09-17T20:21:18.138520] [DEBUG] [LOCAL ] MNR: Deleted primary data file. [2025-09-17T20:21:18.138574] [INFO ] [MAIN ] MNR: Starting full primary refresh. [2025-09-17T20:21:18.512270] [INFO ] [REMOTE ] MNR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:21:18.809014] [INFO ] [REMOTE ] MMT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T20:21:18.810795] [INFO ] [REMOTE ] MMT: Full fetch complete (16584 records). [2025-09-17T20:21:18.810899] [DEBUG] [VALIDATOR ] MMT: Validating primary data. [2025-09-17T20:21:18.824806] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-11. [2025-09-17T20:21:19.196408] [DEBUG] [VALIDATOR ] MMT: All expected trading days are present. [2025-09-17T20:21:19.196524] [DEBUG] [VALIDATOR ] MMT: Primary data validation passed. [2025-09-17T20:21:19.196977] [INFO ] [MAIN ] MMT: Fetched primary data is valid. [2025-09-17T20:21:19.197072] [DEBUG] [LOCAL ] MMT: Saving primary data. [2025-09-17T20:21:19.197845] [DEBUG] [LOCAL ] MMT: Trimmed 16584 records to 11445 (keeping 200 days of data) [2025-09-17T20:21:19.277714] [DEBUG] [LOCAL ] MMT: Primary data saved (11445 records). [2025-09-17T20:21:19.277907] [INFO ] [MAIN ] MMT: Full history saved. [2025-09-17T20:21:19.278109] [INFO ] [MAIN ] Update Progress: 1378/2371 symbols completed. MMT took 25.4s. Estimated remaining: 2h 25m 3s. Rate: 6.8 symbols/min [2025-09-17T20:21:19.397236] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-17T20:21:19.507123] [INFO ] [MAIN ] MNSO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:21:19.559432] [DEBUG] [LOCAL ] MNSO: Loaded 44427 existing records from primary storage. [2025-09-17T20:21:19.559631] [INFO ] [MAIN ] MNSO: Loaded 44427 existing records. [2025-09-17T20:21:19.617941] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-03. [2025-09-17T20:21:19.753797] [WARN ] [MAIN ] MNSO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:21:19.754111] [INFO ] [MAIN ] MNSO: Wiping existing primary data before full refresh. [2025-09-17T20:21:19.754168] [INFO ] [LOCAL ] MNSO: Starting deletion of primary data. [2025-09-17T20:21:19.755329] [DEBUG] [LOCAL ] MNSO: Deleted primary data file. [2025-09-17T20:21:19.755392] [INFO ] [MAIN ] MNSO: Starting full primary refresh. [2025-09-17T20:21:20.159364] [INFO ] [REMOTE ] MNSO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:21:20.173033] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T20:21:20.415688] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-05. [2025-09-17T20:21:20.735715] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T20:21:21.215839] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-04. [2025-09-17T20:21:22.015758] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-11. [2025-09-17T20:21:22.125115] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T20:21:22.538886] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T20:21:22.815783] [INFO ] [REMOTE ] MNR: Fetching primary data for 2024-12. [2025-09-17T20:21:23.615795] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-05. [2025-09-17T20:21:23.785281] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T20:21:24.053922] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T20:21:24.415797] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2024-12. [2025-09-17T20:21:24.588870] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T20:21:25.215826] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-01. [2025-09-17T20:21:26.015773] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-06. [2025-09-17T20:21:26.053822] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T20:21:26.397921] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T20:21:26.815781] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-02. [2025-09-17T20:21:27.615782] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-06. [2025-09-17T20:21:27.794537] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T20:21:28.226378] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T20:21:28.298626] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T20:21:28.415818] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-03. [2025-09-17T20:21:29.215810] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-01. [2025-09-17T20:21:29.456781] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T20:21:30.015799] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-04. [2025-09-17T20:21:30.815799] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-07. [2025-09-17T20:21:30.945615] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T20:21:31.281591] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T20:21:31.615789] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-05. [2025-09-17T20:21:31.803201] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T20:21:32.415834] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-08. [2025-09-17T20:21:32.914091] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T20:21:33.215826] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-02. [2025-09-17T20:21:33.578263] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T20:21:34.015795] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-07. [2025-09-17T20:21:34.602610] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T20:21:34.815772] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-03. [2025-09-17T20:21:35.615811] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-06. [2025-09-17T20:21:36.282390] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-17T20:21:36.415866] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-08. [2025-09-17T20:21:36.761582] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T20:21:36.986456] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T20:21:37.215793] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-07. [2025-09-17T20:21:38.015784] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-04. [2025-09-17T20:21:38.330671] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T20:21:38.522132] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-17T20:21:38.815801] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-08. [2025-09-17T20:21:39.497848] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T20:21:39.615847] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-05. [2025-09-17T20:21:39.784956] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T20:21:40.415831] [INFO ] [REMOTE ] MMU: Fetching primary data for 2025-09. [2025-09-17T20:21:41.215795] [INFO ] [REMOTE ] MNR: Fetching primary data for 2025-09. [2025-09-17T20:21:41.618205] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T20:21:41.665938] [INFO ] [REMOTE ] MMU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T20:21:41.669480] [INFO ] [REMOTE ] MMU: Full fetch complete (25663 records). [2025-09-17T20:21:41.669612] [DEBUG] [VALIDATOR ] MMU: Validating primary data. [2025-09-17T20:21:42.020837] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-06. [2025-09-17T20:21:42.078410] [DEBUG] [VALIDATOR ] MMU: All expected trading days are present. [2025-09-17T20:21:42.078558] [DEBUG] [VALIDATOR ] MMU: Primary data validation passed. [2025-09-17T20:21:42.079628] [INFO ] [MAIN ] MMU: Fetched primary data is valid. [2025-09-17T20:21:42.079818] [DEBUG] [LOCAL ] MMU: Saving primary data. [2025-09-17T20:21:42.080898] [DEBUG] [LOCAL ] MMU: Trimmed 25663 records to 16992 (keeping 200 days of data) [2025-09-17T20:21:42.208265] [DEBUG] [LOCAL ] MMU: Primary data saved (16992 records). [2025-09-17T20:21:42.208435] [INFO ] [MAIN ] MMU: Full history saved. [2025-09-17T20:21:42.208611] [INFO ] [MAIN ] Update Progress: 1379/2371 symbols completed. MMU took 39.5s. Estimated remaining: 2h 25m 5s. Rate: 6.8 symbols/min [2025-09-17T20:21:42.362196] [INFO ] [REMOTE ] MNR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T20:21:42.411684] [INFO ] [REMOTE ] MNR: Full fetch complete (37103 records). [2025-09-17T20:21:42.432251] [INFO ] [MAIN ] MNTN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:21:42.430121] [DEBUG] [VALIDATOR ] MNR: Validating primary data. [2025-09-17T20:21:42.432503] [DEBUG] [LOCAL ] MNTN: No existing data file found in primary storage. [2025-09-17T20:21:42.432734] [WARN ] [MAIN ] MNTN: No existing data found, performing full refresh instead. [2025-09-17T20:21:42.432955] [INFO ] [MAIN ] MNTN: Wiping existing primary data before full refresh. [2025-09-17T20:21:42.488444] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-17T20:21:42.539929] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-17T20:21:42.559863] [INFO ] [MAIN ] MNTN: Starting full primary refresh. [2025-09-17T20:21:42.829830] [INFO ] [REMOTE ] MMM: Fetching primary data for 2025-09. [2025-09-17T20:21:43.270297] [INFO ] [REMOTE ] MNTN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:21:43.284421] [DEBUG] [VALIDATOR ] MNR: All expected trading days are present. [2025-09-17T20:21:43.284507] [DEBUG] [VALIDATOR ] MNR: Primary data validation passed. [2025-09-17T20:21:43.285250] [INFO ] [MAIN ] MNR: Fetched primary data is valid. [2025-09-17T20:21:43.285298] [DEBUG] [LOCAL ] MNR: Saving primary data. [2025-09-17T20:21:43.286380] [DEBUG] [LOCAL ] MNR: Trimmed 37103 records to 24820 (keeping 200 days of data) [2025-09-17T20:21:43.446918] [DEBUG] [LOCAL ] MNR: Primary data saved (24820 records). [2025-09-17T20:21:43.447067] [INFO ] [MAIN ] MNR: Full history saved. [2025-09-17T20:21:43.447186] [INFO ] [MAIN ] Update Progress: 1380/2371 symbols completed. MNR took 25.7s. Estimated remaining: 2h 24m 50s. Rate: 6.8 symbols/min [2025-09-17T20:21:43.630493] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-11. [2025-09-17T20:21:43.634039] [INFO ] [MAIN ] MO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:21:43.663108] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T20:21:43.691124] [INFO ] [REMOTE ] MMM: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T20:21:43.701148] [INFO ] [REMOTE ] MMM: Full fetch complete (76656 records). [2025-09-17T20:21:43.701363] [DEBUG] [VALIDATOR ] MMM: Validating primary data. [2025-09-17T20:21:43.702698] [FATAL] [VALIDATOR ] MMM: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:21:43.702795] [FATAL] [MAIN ] MMM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:21:43.702844] [WARN ] [MAIN ] MMM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:21:43.702896] [INFO ] [LOCAL ] MMM: Starting deletion of primary data. [2025-09-17T20:21:43.702968] [DEBUG] [LOCAL ] MMM: No primary data file found to delete. [2025-09-17T20:21:43.703032] [INFO ] [LOCAL ] MMM: Starting deletion of derivative data. [2025-09-17T20:21:43.703377] [DEBUG] [LOCAL ] MMM: Deleted derivative data file. [2025-09-17T20:21:43.703483] [INFO ] [MAIN ] Update Progress: 1381/2371 symbols completed. MMM took 1m 3s. Estimated remaining: 2h 24m 35s. Rate: 6.8 symbols/min [2025-09-17T20:21:43.914044] [INFO ] [MAIN ] MOD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:21:43.915245] [DEBUG] [LOCAL ] MO: Loaded 53754 existing records from primary storage. [2025-09-17T20:21:43.915617] [INFO ] [MAIN ] MO: Loaded 53754 existing records. [2025-09-17T20:21:44.073455] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T20:21:44.115674] [WARN ] [MAIN ] MO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:21:44.115994] [INFO ] [MAIN ] MO: Wiping existing primary data before full refresh. [2025-09-17T20:21:44.116058] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-17T20:21:44.127059] [DEBUG] [LOCAL ] MO: Deleted primary data file. [2025-09-17T20:21:44.127223] [INFO ] [MAIN ] MO: Starting full primary refresh. [2025-09-17T20:21:44.274879] [DEBUG] [LOCAL ] MOD: Loaded 45838 existing records from primary storage. [2025-09-17T20:21:44.300102] [INFO ] [MAIN ] MOD: Loaded 45838 existing records. [2025-09-17T20:21:44.422395] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2024-12. [2025-09-17T20:21:44.683167] [INFO ] [REMOTE ] MO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:21:44.710953] [WARN ] [MAIN ] MOD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:21:44.711429] [INFO ] [MAIN ] MOD: Wiping existing primary data before full refresh. [2025-09-17T20:21:44.711479] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-17T20:21:44.712565] [DEBUG] [LOCAL ] MOD: Deleted primary data file. [2025-09-17T20:21:44.712627] [INFO ] [MAIN ] MOD: Starting full primary refresh. [2025-09-17T20:21:44.825516] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:21:44.829447] [WARN ] [REMOTE ] MNTN: No data returned for month 2024-12 [2025-09-17T20:21:45.094086] [INFO ] [REMOTE ] MOD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:21:45.215790] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-01. [2025-09-17T20:21:45.467989] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:21:45.468374] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-01 [2025-09-17T20:21:46.015835] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-07. [2025-09-17T20:21:46.815815] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-11. [2025-09-17T20:21:47.617203] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T20:21:47.617430] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-11. [2025-09-17T20:21:48.415870] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-08. [2025-09-17T20:21:48.919793] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-11 (2.10 seconds). [2025-09-17T20:21:49.215778] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-02. [2025-09-17T20:21:49.357896] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T20:21:49.463165] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:21:49.463445] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-02 [2025-09-17T20:21:49.910563] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T20:21:50.015783] [INFO ] [REMOTE ] MNSO: Fetching primary data for 2025-09. [2025-09-17T20:21:50.815799] [INFO ] [REMOTE ] MOD: Fetching primary data for 2024-12. [2025-09-17T20:21:51.615810] [INFO ] [REMOTE ] MO: Fetching primary data for 2024-12. [2025-09-17T20:21:51.660316] [INFO ] [REMOTE ] MNSO: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T20:21:51.667043] [INFO ] [REMOTE ] MNSO: Full fetch complete (64342 records). [2025-09-17T20:21:51.667172] [DEBUG] [VALIDATOR ] MNSO: Validating primary data. [2025-09-17T20:21:52.069073] [DEBUG] [VALIDATOR ] MNSO: All expected trading days are present. [2025-09-17T20:21:52.069195] [DEBUG] [VALIDATOR ] MNSO: Primary data validation passed. [2025-09-17T20:21:52.070117] [INFO ] [MAIN ] MNSO: Fetched primary data is valid. [2025-09-17T20:21:52.070171] [DEBUG] [LOCAL ] MNSO: Saving primary data. [2025-09-17T20:21:52.072179] [DEBUG] [LOCAL ] MNSO: Trimmed 64342 records to 44426 (keeping 200 days of data) [2025-09-17T20:21:52.354881] [DEBUG] [LOCAL ] MNSO: Primary data saved (44426 records). [2025-09-17T20:21:52.355020] [INFO ] [MAIN ] MNSO: Full history saved. [2025-09-17T20:21:52.355150] [INFO ] [MAIN ] Update Progress: 1382/2371 symbols completed. MNSO took 33.1s. Estimated remaining: 2h 24m 27s. Rate: 6.8 symbols/min [2025-09-17T20:21:52.425114] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-03. [2025-09-17T20:21:52.543729] [INFO ] [MAIN ] MODG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:21:52.571316] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T20:21:52.625326] [DEBUG] [LOCAL ] MODG: Loaded 51634 existing records from primary storage. [2025-09-17T20:21:52.625499] [INFO ] [MAIN ] MODG: Loaded 51634 existing records. [2025-09-17T20:21:52.764797] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:21:52.784052] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-03 [2025-09-17T20:21:52.803631] [WARN ] [MAIN ] MODG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:21:52.803863] [INFO ] [MAIN ] MODG: Wiping existing primary data before full refresh. [2025-09-17T20:21:52.803913] [INFO ] [LOCAL ] MODG: Starting deletion of primary data. [2025-09-17T20:21:52.804883] [DEBUG] [LOCAL ] MODG: Deleted primary data file. [2025-09-17T20:21:52.804939] [INFO ] [MAIN ] MODG: Starting full primary refresh. [2025-09-17T20:21:53.164576] [INFO ] [REMOTE ] MODG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:21:53.215760] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-11. [2025-09-17T20:21:54.015831] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-01. [2025-09-17T20:21:54.125989] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-17T20:21:54.614121] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T20:21:54.815798] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-04. [2025-09-17T20:21:55.066730] [DEBUG] [REMOTE ] MNTN: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:21:55.067088] [WARN ] [REMOTE ] MNTN: No data returned for month 2025-04 [2025-09-17T20:21:55.615780] [INFO ] [REMOTE ] MODG: Fetching primary data for 2024-12. [2025-09-17T20:21:55.775527] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T20:21:56.415782] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-02. [2025-09-17T20:21:57.215844] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-05. [2025-09-17T20:21:57.340395] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T20:21:57.851921] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T20:21:58.024087] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-01. [2025-09-17T20:21:58.029820] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T20:21:58.815822] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-03. [2025-09-17T20:21:59.615763] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-01. [2025-09-17T20:21:59.934089] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T20:22:00.415853] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-02. [2025-09-17T20:22:00.782395] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T20:22:01.215812] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-04. [2025-09-17T20:22:02.015751] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-06. [2025-09-17T20:22:02.135221] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-01 (2.52 seconds). [2025-09-17T20:22:02.228757] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T20:22:02.703826] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T20:22:02.815735] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-05. [2025-09-17T20:22:03.237246] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T20:22:03.615811] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-03. [2025-09-17T20:22:04.415828] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-02. [2025-09-17T20:22:04.636514] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T20:22:05.215809] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-06. [2025-09-17T20:22:05.528131] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T20:22:06.015834] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-07. [2025-09-17T20:22:06.391925] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T20:22:06.815846] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-03. [2025-09-17T20:22:06.856054] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T20:22:07.511427] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T20:22:07.615780] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-07. [2025-09-17T20:22:08.415798] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-04. [2025-09-17T20:22:09.215760] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-08. [2025-09-17T20:22:09.352399] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T20:22:09.537179] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-17T20:22:10.015826] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-08. [2025-09-17T20:22:10.378197] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T20:22:10.815763] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-05. [2025-09-17T20:22:10.821036] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T20:22:11.560403] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T20:22:11.615739] [INFO ] [REMOTE ] MOD: Fetching primary data for 2025-09. [2025-09-17T20:22:12.327044] [INFO ] [REMOTE ] MOD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T20:22:12.332530] [INFO ] [REMOTE ] MOD: Full fetch complete (65654 records). [2025-09-17T20:22:12.332773] [DEBUG] [VALIDATOR ] MOD: Validating primary data. [2025-09-17T20:22:12.333659] [FATAL] [VALIDATOR ] MOD: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:22:12.333765] [FATAL] [MAIN ] MOD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:22:12.333809] [WARN ] [MAIN ] MOD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:22:12.333855] [INFO ] [LOCAL ] MOD: Starting deletion of primary data. [2025-09-17T20:22:12.333920] [DEBUG] [LOCAL ] MOD: No primary data file found to delete. [2025-09-17T20:22:12.333957] [INFO ] [LOCAL ] MOD: Starting deletion of derivative data. [2025-09-17T20:22:12.334727] [DEBUG] [LOCAL ] MOD: Deleted derivative data file. [2025-09-17T20:22:12.334817] [INFO ] [MAIN ] Update Progress: 1383/2371 symbols completed. MOD took 28.6s. Estimated remaining: 2h 24m 26s. Rate: 6.8 symbols/min [2025-09-17T20:22:12.420961] [INFO ] [REMOTE ] MNTN: Fetching primary data for 2025-09. [2025-09-17T20:22:12.514246] [INFO ] [MAIN ] MOH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:22:12.558986] [DEBUG] [LOCAL ] MOH: Loaded 41704 existing records from primary storage. [2025-09-17T20:22:12.559143] [INFO ] [MAIN ] MOH: Loaded 41704 existing records. [2025-09-17T20:22:12.746539] [WARN ] [MAIN ] MOH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:22:12.747019] [INFO ] [MAIN ] MOH: Wiping existing primary data before full refresh. [2025-09-17T20:22:12.747116] [INFO ] [LOCAL ] MOH: Starting deletion of primary data. [2025-09-17T20:22:12.748105] [DEBUG] [LOCAL ] MOH: Deleted primary data file. [2025-09-17T20:22:12.748161] [INFO ] [MAIN ] MOH: Starting full primary refresh. [2025-09-17T20:22:13.036277] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-17T20:22:13.189004] [INFO ] [REMOTE ] MOH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:22:13.215734] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-11. [2025-09-17T20:22:13.716546] [INFO ] [REMOTE ] MNTN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T20:22:13.722928] [INFO ] [REMOTE ] MNTN: Full fetch complete (23474 records). [2025-09-17T20:22:13.723105] [DEBUG] [VALIDATOR ] MNTN: Validating primary data. [2025-09-17T20:22:13.911011] [WARN ] [VALIDATOR ] MNTN: Validation failed - insufficient historical data. Have 82 unique days, need 200 days [2025-09-17T20:22:13.911378] [FATAL] [MAIN ] MNTN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:22:13.911444] [WARN ] [MAIN ] MNTN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:22:13.911511] [INFO ] [LOCAL ] MNTN: Starting deletion of primary data. [2025-09-17T20:22:13.911579] [DEBUG] [LOCAL ] MNTN: No primary data file found to delete. [2025-09-17T20:22:13.911615] [INFO ] [LOCAL ] MNTN: Starting deletion of derivative data. [2025-09-17T20:22:13.911685] [DEBUG] [LOCAL ] MNTN: No derivative data file found to delete. [2025-09-17T20:22:13.911748] [INFO ] [MAIN ] Update Progress: 1384/2371 symbols completed. MNTN took 31.7s. Estimated remaining: 2h 24m 12s. Rate: 6.8 symbols/min [2025-09-17T20:22:14.020015] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-06. [2025-09-17T20:22:14.094960] [INFO ] [MAIN ] MOS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:22:14.160179] [DEBUG] [LOCAL ] MOS: Loaded 53521 existing records from primary storage. [2025-09-17T20:22:14.160387] [INFO ] [MAIN ] MOS: Loaded 53521 existing records. [2025-09-17T20:22:14.340657] [WARN ] [MAIN ] MOS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:22:14.340930] [INFO ] [MAIN ] MOS: Wiping existing primary data before full refresh. [2025-09-17T20:22:14.340993] [INFO ] [LOCAL ] MOS: Starting deletion of primary data. [2025-09-17T20:22:14.342637] [DEBUG] [LOCAL ] MOS: Deleted primary data file. [2025-09-17T20:22:14.342707] [INFO ] [MAIN ] MOS: Starting full primary refresh. [2025-09-17T20:22:14.718032] [INFO ] [REMOTE ] MOS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:22:14.741771] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T20:22:14.815752] [INFO ] [REMOTE ] MOH: Fetching primary data for 2024-12. [2025-09-17T20:22:15.615825] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-04. [2025-09-17T20:22:15.890210] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T20:22:16.415832] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-11. [2025-09-17T20:22:16.710311] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T20:22:17.215784] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-01. [2025-09-17T20:22:17.892900] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-17T20:22:18.015844] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-05. [2025-09-17T20:22:18.404733] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T20:22:18.772708] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T20:22:18.815812] [INFO ] [REMOTE ] MOS: Fetching primary data for 2024-12. [2025-09-17T20:22:19.615834] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-02. [2025-09-17T20:22:20.120175] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T20:22:20.337102] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T20:22:20.415823] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-07. [2025-09-17T20:22:20.868308] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T20:22:21.215833] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-01. [2025-09-17T20:22:22.015831] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-06. [2025-09-17T20:22:22.291327] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T20:22:22.815810] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-03. [2025-09-17T20:22:23.125457] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T20:22:23.615811] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-02. [2025-09-17T20:22:24.211655] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-06 (2.20 seconds). [2025-09-17T20:22:24.249999] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T20:22:24.415785] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-04. [2025-09-17T20:22:25.145475] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T20:22:25.215767] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-03. [2025-09-17T20:22:26.015793] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-07. [2025-09-17T20:22:26.174663] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T20:22:26.795668] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T20:22:26.815721] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-04. [2025-09-17T20:22:27.615780] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-08. [2025-09-17T20:22:28.415838] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-05. [2025-09-17T20:22:28.500447] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-07 (2.48 seconds). [2025-09-17T20:22:28.894810] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T20:22:29.047614] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T20:22:29.215856] [INFO ] [REMOTE ] MODG: Fetching primary data for 2025-09. [2025-09-17T20:22:30.015702] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-05. [2025-09-17T20:22:30.106916] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T20:22:30.816006] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-08. [2025-09-17T20:22:30.862455] [INFO ] [REMOTE ] MODG: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T20:22:30.870004] [INFO ] [REMOTE ] MODG: Full fetch complete (74589 records). [2025-09-17T20:22:30.870181] [DEBUG] [VALIDATOR ] MODG: Validating primary data. [2025-09-17T20:22:31.282115] [DEBUG] [VALIDATOR ] MODG: All expected trading days are present. [2025-09-17T20:22:31.282212] [DEBUG] [VALIDATOR ] MODG: Primary data validation passed. [2025-09-17T20:22:31.283440] [INFO ] [MAIN ] MODG: Fetched primary data is valid. [2025-09-17T20:22:31.283493] [DEBUG] [LOCAL ] MODG: Saving primary data. [2025-09-17T20:22:31.285362] [DEBUG] [LOCAL ] MODG: Trimmed 74589 records to 51616 (keeping 200 days of data) [2025-09-17T20:22:31.604107] [DEBUG] [LOCAL ] MODG: Primary data saved (51616 records). [2025-09-17T20:22:31.604284] [INFO ] [MAIN ] MODG: Full history saved. [2025-09-17T20:22:31.604413] [INFO ] [MAIN ] Update Progress: 1385/2371 symbols completed. MODG took 39.2s. Estimated remaining: 2h 24m 10s. Rate: 6.8 symbols/min [2025-09-17T20:22:31.636717] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-06. [2025-09-17T20:22:31.779312] [INFO ] [MAIN ] MOV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:22:31.804015] [DEBUG] [LOCAL ] MOV: Loaded 22381 existing records from primary storage. [2025-09-17T20:22:31.804168] [INFO ] [MAIN ] MOV: Loaded 22381 existing records. [2025-09-17T20:22:31.992521] [WARN ] [MAIN ] MOV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:22:31.992991] [INFO ] [MAIN ] MOV: Wiping existing primary data before full refresh. [2025-09-17T20:22:31.993183] [INFO ] [LOCAL ] MOV: Starting deletion of primary data. [2025-09-17T20:22:31.993873] [DEBUG] [LOCAL ] MOV: Deleted primary data file. [2025-09-17T20:22:31.993974] [INFO ] [MAIN ] MOV: Starting full primary refresh. [2025-09-17T20:22:32.329730] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-17T20:22:32.409073] [INFO ] [REMOTE ] MOV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:22:32.415747] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-06. [2025-09-17T20:22:33.183664] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T20:22:33.220842] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-11. [2025-09-17T20:22:33.235613] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-17T20:22:34.027267] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-07. [2025-09-17T20:22:34.032634] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T20:22:34.362450] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T20:22:34.816002] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-07. [2025-09-17T20:22:35.615780] [INFO ] [REMOTE ] MO: Fetching primary data for 2025-09. [2025-09-17T20:22:36.355555] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-17T20:22:36.386076] [INFO ] [REMOTE ] MO: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T20:22:36.393266] [INFO ] [REMOTE ] MO: Full fetch complete (77434 records). [2025-09-17T20:22:36.393444] [DEBUG] [VALIDATOR ] MO: Validating primary data. [2025-09-17T20:22:36.394533] [FATAL] [VALIDATOR ] MO: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:22:36.394692] [FATAL] [MAIN ] MO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:22:36.394743] [WARN ] [MAIN ] MO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:22:36.394792] [INFO ] [LOCAL ] MO: Starting deletion of primary data. [2025-09-17T20:22:36.394854] [DEBUG] [LOCAL ] MO: No primary data file found to delete. [2025-09-17T20:22:36.394891] [INFO ] [LOCAL ] MO: Starting deletion of derivative data. [2025-09-17T20:22:36.395151] [DEBUG] [LOCAL ] MO: Deleted derivative data file. [2025-09-17T20:22:36.396623] [INFO ] [MAIN ] Update Progress: 1386/2371 symbols completed. MO took 52.9s. Estimated remaining: 2h 23m 58s. Rate: 6.8 symbols/min [2025-09-17T20:22:36.420861] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-08. [2025-09-17T20:22:36.576957] [INFO ] [MAIN ] MP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:22:36.635450] [DEBUG] [LOCAL ] MP: Loaded 53646 existing records from primary storage. [2025-09-17T20:22:36.635634] [INFO ] [MAIN ] MP: Loaded 53646 existing records. [2025-09-17T20:22:36.822264] [WARN ] [MAIN ] MP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:22:36.822738] [INFO ] [MAIN ] MP: Wiping existing primary data before full refresh. [2025-09-17T20:22:36.822827] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-17T20:22:36.823960] [DEBUG] [LOCAL ] MP: Deleted primary data file. [2025-09-17T20:22:36.824021] [INFO ] [MAIN ] MP: Starting full primary refresh. [2025-09-17T20:22:37.134289] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-07 (2.32 seconds). [2025-09-17T20:22:37.220873] [INFO ] [REMOTE ] MOV: Fetching primary data for 2024-12. [2025-09-17T20:22:37.303993] [INFO ] [REMOTE ] MP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:22:38.015778] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-08. [2025-09-17T20:22:38.108514] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T20:22:38.430180] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T20:22:38.815778] [INFO ] [REMOTE ] MOH: Fetching primary data for 2025-09. [2025-09-17T20:22:39.615785] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-01. [2025-09-17T20:22:39.992208] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T20:22:40.415843] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-11. [2025-09-17T20:22:40.560098] [INFO ] [REMOTE ] MOH: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T20:22:40.567086] [INFO ] [REMOTE ] MOH: Full fetch complete (57842 records). [2025-09-17T20:22:40.567260] [DEBUG] [VALIDATOR ] MOH: Validating primary data. [2025-09-17T20:22:40.640881] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T20:22:41.001942] [DEBUG] [VALIDATOR ] MOH: All expected trading days are present. [2025-09-17T20:22:41.002056] [DEBUG] [VALIDATOR ] MOH: Primary data validation passed. [2025-09-17T20:22:41.002999] [INFO ] [MAIN ] MOH: Fetched primary data is valid. [2025-09-17T20:22:41.003049] [DEBUG] [LOCAL ] MOH: Saving primary data. [2025-09-17T20:22:41.004803] [DEBUG] [LOCAL ] MOH: Trimmed 57842 records to 41783 (keeping 200 days of data) [2025-09-17T20:22:41.226576] [INFO ] [REMOTE ] MOS: Fetching primary data for 2025-09. [2025-09-17T20:22:41.278363] [DEBUG] [LOCAL ] MOH: Primary data saved (41783 records). [2025-09-17T20:22:41.278515] [INFO ] [MAIN ] MOH: Full history saved. [2025-09-17T20:22:41.278614] [INFO ] [MAIN ] Update Progress: 1387/2371 symbols completed. MOH took 28.9s. Estimated remaining: 2h 23m 46s. Rate: 6.8 symbols/min [2025-09-17T20:22:41.457669] [INFO ] [MAIN ] MPA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:22:41.457916] [DEBUG] [LOCAL ] MPA: No existing data file found in primary storage. [2025-09-17T20:22:41.457956] [WARN ] [MAIN ] MPA: No existing data found, performing full refresh instead. [2025-09-17T20:22:41.458090] [INFO ] [MAIN ] MPA: Wiping existing primary data before full refresh. [2025-09-17T20:22:41.458141] [INFO ] [LOCAL ] MPA: Starting deletion of primary data. [2025-09-17T20:22:41.458188] [DEBUG] [LOCAL ] MPA: No primary data file found to delete. [2025-09-17T20:22:41.458250] [INFO ] [MAIN ] MPA: Starting full primary refresh. [2025-09-17T20:22:41.840087] [INFO ] [REMOTE ] MPA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:22:42.015779] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-11. [2025-09-17T20:22:42.261181] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T20:22:42.540744] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T20:22:42.815847] [INFO ] [REMOTE ] MP: Fetching primary data for 2024-12. [2025-09-17T20:22:42.960811] [INFO ] [REMOTE ] MOS: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T20:22:42.967893] [INFO ] [REMOTE ] MOS: Full fetch complete (77312 records). [2025-09-17T20:22:42.968038] [DEBUG] [VALIDATOR ] MOS: Validating primary data. [2025-09-17T20:22:43.362598] [DEBUG] [VALIDATOR ] MOS: All expected trading days are present. [2025-09-17T20:22:43.362712] [DEBUG] [VALIDATOR ] MOS: Primary data validation passed. [2025-09-17T20:22:43.363747] [INFO ] [MAIN ] MOS: Fetched primary data is valid. [2025-09-17T20:22:43.363796] [DEBUG] [LOCAL ] MOS: Saving primary data. [2025-09-17T20:22:43.365508] [DEBUG] [LOCAL ] MOS: Trimmed 77312 records to 53521 (keeping 200 days of data) [2025-09-17T20:22:43.649358] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-02. [2025-09-17T20:22:43.699690] [DEBUG] [LOCAL ] MOS: Primary data saved (53521 records). [2025-09-17T20:22:43.699810] [INFO ] [MAIN ] MOS: Full history saved. [2025-09-17T20:22:43.699899] [INFO ] [MAIN ] Update Progress: 1388/2371 symbols completed. MOS took 29.8s. Estimated remaining: 2h 23m 33s. Rate: 6.8 symbols/min [2025-09-17T20:22:43.872981] [INFO ] [MAIN ] MPC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:22:43.927664] [DEBUG] [LOCAL ] MPC: Loaded 52148 existing records from primary storage. [2025-09-17T20:22:43.927809] [INFO ] [MAIN ] MPC: Loaded 52148 existing records. [2025-09-17T20:22:44.104582] [WARN ] [MAIN ] MPC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:22:44.104879] [INFO ] [MAIN ] MPC: Wiping existing primary data before full refresh. [2025-09-17T20:22:44.104929] [INFO ] [LOCAL ] MPC: Starting deletion of primary data. [2025-09-17T20:22:44.106102] [DEBUG] [LOCAL ] MPC: Deleted primary data file. [2025-09-17T20:22:44.106153] [INFO ] [MAIN ] MPC: Starting full primary refresh. [2025-09-17T20:22:44.428394] [INFO ] [REMOTE ] MPA: Fetching primary data for 2024-12. [2025-09-17T20:22:44.469930] [INFO ] [REMOTE ] MPC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:22:44.858688] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T20:22:44.880167] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T20:22:44.963951] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T20:22:45.215812] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-01. [2025-09-17T20:22:46.015844] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-11. [2025-09-17T20:22:46.815826] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-03. [2025-09-17T20:22:47.244417] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T20:22:47.615767] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-02. [2025-09-17T20:22:47.680031] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T20:22:48.033814] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T20:22:48.415779] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-01. [2025-09-17T20:22:48.928274] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T20:22:49.215763] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-02. [2025-09-17T20:22:49.642258] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-17T20:22:49.891715] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T20:22:50.015780] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-03. [2025-09-17T20:22:50.680160] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T20:22:50.815819] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-04. [2025-09-17T20:22:51.615780] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-03. [2025-09-17T20:22:52.261941] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T20:22:52.415785] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-04. [2025-09-17T20:22:53.215794] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-05. [2025-09-17T20:22:53.226733] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T20:22:53.582175] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T20:22:54.015768] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-05. [2025-09-17T20:22:54.420405] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T20:22:54.747074] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T20:22:54.815769] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-06. [2025-09-17T20:22:55.615781] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-06. [2025-09-17T20:22:55.974369] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T20:22:56.259940] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T20:22:56.415830] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-07. [2025-09-17T20:22:57.215811] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-04. [2025-09-17T20:22:57.486224] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T20:22:58.015822] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-07. [2025-09-17T20:22:58.746572] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T20:22:58.815787] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-08. [2025-09-17T20:22:59.366447] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-17T20:22:59.615826] [INFO ] [REMOTE ] MPC: Fetching primary data for 2024-12. [2025-09-17T20:22:59.728696] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T20:23:00.415817] [INFO ] [REMOTE ] MPA: Fetching primary data for 2025-09. [2025-09-17T20:23:00.987438] [INFO ] [REMOTE ] MPA: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T20:23:00.989004] [INFO ] [REMOTE ] MPA: Full fetch complete (7105 records). [2025-09-17T20:23:00.989136] [DEBUG] [VALIDATOR ] MPA: Validating primary data. [2025-09-17T20:23:01.220888] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-08. [2025-09-17T20:23:01.398049] [DEBUG] [VALIDATOR ] MPA: All expected trading days are present. [2025-09-17T20:23:01.398168] [DEBUG] [VALIDATOR ] MPA: Primary data validation passed. [2025-09-17T20:23:01.398499] [INFO ] [MAIN ] MPA: Fetched primary data is valid. [2025-09-17T20:23:01.398587] [DEBUG] [LOCAL ] MPA: Saving primary data. [2025-09-17T20:23:01.399695] [DEBUG] [LOCAL ] MPA: Trimmed 7105 records to 5255 (keeping 200 days of data) [2025-09-17T20:23:01.459700] [DEBUG] [LOCAL ] MPA: Primary data saved (5255 records). [2025-09-17T20:23:01.477352] [INFO ] [MAIN ] MPA: Full history saved. [2025-09-17T20:23:01.477683] [INFO ] [MAIN ] Update Progress: 1389/2371 symbols completed. MPA took 20.2s. Estimated remaining: 2h 23m 31s. Rate: 6.8 symbols/min [2025-09-17T20:23:01.480793] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T20:23:01.685953] [INFO ] [MAIN ] MPLX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:23:01.742611] [DEBUG] [LOCAL ] MPLX: Loaded 50820 existing records from primary storage. [2025-09-17T20:23:01.742815] [INFO ] [MAIN ] MPLX: Loaded 50820 existing records. [2025-09-17T20:23:01.941808] [WARN ] [MAIN ] MPLX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:23:01.942092] [INFO ] [MAIN ] MPLX: Wiping existing primary data before full refresh. [2025-09-17T20:23:01.942139] [INFO ] [LOCAL ] MPLX: Starting deletion of primary data. [2025-09-17T20:23:01.943275] [DEBUG] [LOCAL ] MPLX: Deleted primary data file. [2025-09-17T20:23:01.943328] [INFO ] [MAIN ] MPLX: Starting full primary refresh. [2025-09-17T20:23:02.021018] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-01. [2025-09-17T20:23:02.313423] [INFO ] [REMOTE ] MPLX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:23:02.815818] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-11. [2025-09-17T20:23:03.615797] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-05. [2025-09-17T20:23:03.984860] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T20:23:04.415837] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-02. [2025-09-17T20:23:05.635878] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-08 (4.42 seconds). [2025-09-17T20:23:05.640335] [INFO ] [REMOTE ] MOV: Fetching primary data for 2025-09. [2025-09-17T20:23:06.482489] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-11 (3.67 seconds). [2025-09-17T20:23:06.493197] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2024-12. [2025-09-17T20:23:06.699317] [INFO ] [REMOTE ] MOV: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T20:23:06.703333] [INFO ] [REMOTE ] MOV: Full fetch complete (30690 records). [2025-09-17T20:23:06.703504] [DEBUG] [VALIDATOR ] MOV: Validating primary data. [2025-09-17T20:23:07.087898] [DEBUG] [VALIDATOR ] MOV: All expected trading days are present. [2025-09-17T20:23:07.087991] [DEBUG] [VALIDATOR ] MOV: Primary data validation passed. [2025-09-17T20:23:07.088630] [INFO ] [MAIN ] MOV: Fetched primary data is valid. [2025-09-17T20:23:07.088784] [DEBUG] [LOCAL ] MOV: Saving primary data. [2025-09-17T20:23:07.089757] [DEBUG] [LOCAL ] MOV: Trimmed 30690 records to 22362 (keeping 200 days of data) [2025-09-17T20:23:07.216359] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-02 (2.80 seconds). [2025-09-17T20:23:07.232182] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-03. [2025-09-17T20:23:07.336719] [DEBUG] [LOCAL ] MOV: Primary data saved (22362 records). [2025-09-17T20:23:07.336914] [INFO ] [MAIN ] MOV: Full history saved. [2025-09-17T20:23:07.337290] [INFO ] [MAIN ] Update Progress: 1390/2371 symbols completed. MOV took 35.7s. Estimated remaining: 2h 23m 20s. Rate: 6.8 symbols/min [2025-09-17T20:23:07.375292] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-05 (3.76 seconds). [2025-09-17T20:23:07.524497] [INFO ] [MAIN ] MPV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:23:07.532135] [DEBUG] [LOCAL ] MPV: Loaded 5206 existing records from primary storage. [2025-09-17T20:23:07.532259] [INFO ] [MAIN ] MPV: Loaded 5206 existing records. [2025-09-17T20:23:07.623137] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-06. [2025-09-17T20:23:07.714190] [WARN ] [MAIN ] MPV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:23:07.714465] [INFO ] [MAIN ] MPV: Wiping existing primary data before full refresh. [2025-09-17T20:23:07.714511] [INFO ] [LOCAL ] MPV: Starting deletion of primary data. [2025-09-17T20:23:07.714768] [DEBUG] [LOCAL ] MPV: Deleted primary data file. [2025-09-17T20:23:07.714814] [INFO ] [MAIN ] MPV: Starting full primary refresh. [2025-09-17T20:23:08.079223] [INFO ] [REMOTE ] MPV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:23:08.114177] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T20:23:08.415828] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-01. [2025-09-17T20:23:09.187899] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T20:23:09.215756] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-04. [2025-09-17T20:23:09.889304] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T20:23:10.015753] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-02. [2025-09-17T20:23:10.052747] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-06 (2.43 seconds). [2025-09-17T20:23:10.815738] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-07. [2025-09-17T20:23:11.020540] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T20:23:11.615789] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-05. [2025-09-17T20:23:11.841525] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T20:23:12.415812] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-03. [2025-09-17T20:23:13.215903] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-11. [2025-09-17T20:23:13.325313] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T20:23:13.433776] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-07 (2.62 seconds). [2025-09-17T20:23:13.867208] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T20:23:13.984844] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T20:23:14.015735] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-04. [2025-09-17T20:23:14.815789] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-08. [2025-09-17T20:23:15.615780] [INFO ] [REMOTE ] MPV: Fetching primary data for 2024-12. [2025-09-17T20:23:16.023250] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T20:23:16.394328] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T20:23:16.415730] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-01. [2025-09-17T20:23:17.129287] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T20:23:17.215768] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-06. [2025-09-17T20:23:17.628221] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-08 (2.81 seconds). [2025-09-17T20:23:18.015822] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-02. [2025-09-17T20:23:18.727365] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T20:23:18.815779] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-03. [2025-09-17T20:23:18.853111] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T20:23:19.615821] [INFO ] [REMOTE ] MP: Fetching primary data for 2025-09. [2025-09-17T20:23:19.675281] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T20:23:20.154291] [INFO ] [REMOTE ] MP: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T20:23:20.161816] [INFO ] [REMOTE ] MP: Full fetch complete (76743 records). [2025-09-17T20:23:20.161947] [DEBUG] [VALIDATOR ] MP: Validating primary data. [2025-09-17T20:23:20.162873] [FATAL] [VALIDATOR ] MP: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:23:20.162957] [FATAL] [MAIN ] MP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:23:20.162993] [WARN ] [MAIN ] MP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:23:20.163031] [INFO ] [LOCAL ] MP: Starting deletion of primary data. [2025-09-17T20:23:20.163102] [DEBUG] [LOCAL ] MP: No primary data file found to delete. [2025-09-17T20:23:20.163156] [INFO ] [LOCAL ] MP: Starting deletion of derivative data. [2025-09-17T20:23:20.163530] [DEBUG] [LOCAL ] MP: Deleted derivative data file. [2025-09-17T20:23:20.164687] [INFO ] [MAIN ] Update Progress: 1391/2371 symbols completed. MP took 43.8s. Estimated remaining: 2h 23m 14s. Rate: 6.8 symbols/min [2025-09-17T20:23:20.338439] [INFO ] [MAIN ] MPW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:23:20.397902] [DEBUG] [LOCAL ] MPW: Loaded 53501 existing records from primary storage. [2025-09-17T20:23:20.398100] [INFO ] [MAIN ] MPW: Loaded 53501 existing records. [2025-09-17T20:23:20.420869] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-04. [2025-09-17T20:23:20.587738] [WARN ] [MAIN ] MPW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:23:20.588092] [INFO ] [MAIN ] MPW: Wiping existing primary data before full refresh. [2025-09-17T20:23:20.588163] [INFO ] [LOCAL ] MPW: Starting deletion of primary data. [2025-09-17T20:23:20.589440] [DEBUG] [LOCAL ] MPW: Deleted primary data file. [2025-09-17T20:23:20.589513] [INFO ] [MAIN ] MPW: Starting full primary refresh. [2025-09-17T20:23:20.951169] [INFO ] [REMOTE ] MPW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:23:21.215783] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-05. [2025-09-17T20:23:21.237728] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T20:23:22.015848] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-05. [2025-09-17T20:23:22.732927] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T20:23:22.815835] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-07. [2025-09-17T20:23:23.154730] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T20:23:23.615806] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-06. [2025-09-17T20:23:24.415782] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-06. [2025-09-17T20:23:24.751602] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T20:23:25.104663] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T20:23:25.215782] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-11. [2025-09-17T20:23:25.468690] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T20:23:26.015792] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-07. [2025-09-17T20:23:26.664879] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T20:23:26.815786] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-07. [2025-09-17T20:23:27.367118] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-17T20:23:27.615806] [INFO ] [REMOTE ] MPW: Fetching primary data for 2024-12. [2025-09-17T20:23:28.415777] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-08. [2025-09-17T20:23:28.672333] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T20:23:29.105043] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T20:23:29.215816] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-08. [2025-09-17T20:23:29.554300] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T20:23:30.015795] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-01. [2025-09-17T20:23:30.815799] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-08. [2025-09-17T20:23:31.360533] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-08 (2.14 seconds). [2025-09-17T20:23:31.615762] [INFO ] [REMOTE ] MPV: Fetching primary data for 2025-09. [2025-09-17T20:23:32.060442] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T20:23:32.227671] [INFO ] [REMOTE ] MPV: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T20:23:32.229674] [INFO ] [REMOTE ] MPV: Full fetch complete (8049 records). [2025-09-17T20:23:32.229758] [DEBUG] [VALIDATOR ] MPV: Validating primary data. [2025-09-17T20:23:32.422260] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-02. [2025-09-17T20:23:32.631266] [DEBUG] [VALIDATOR ] MPV: All expected trading days are present. [2025-09-17T20:23:32.631446] [DEBUG] [VALIDATOR ] MPV: Primary data validation passed. [2025-09-17T20:23:32.631776] [INFO ] [MAIN ] MPV: Fetched primary data is valid. [2025-09-17T20:23:32.631877] [DEBUG] [LOCAL ] MPV: Saving primary data. [2025-09-17T20:23:32.632982] [DEBUG] [LOCAL ] MPV: Trimmed 8049 records to 5203 (keeping 200 days of data) [2025-09-17T20:23:32.706772] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T20:23:32.720856] [DEBUG] [LOCAL ] MPV: Primary data saved (5203 records). [2025-09-17T20:23:32.721550] [INFO ] [MAIN ] MPV: Full history saved. [2025-09-17T20:23:32.721893] [INFO ] [MAIN ] Update Progress: 1392/2371 symbols completed. MPV took 25.4s. Estimated remaining: 2h 23m 8s. Rate: 6.8 symbols/min [2025-09-17T20:23:32.922079] [INFO ] [MAIN ] MPX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:23:32.929894] [DEBUG] [LOCAL ] MPX: Loaded 4315 existing records from primary storage. [2025-09-17T20:23:32.930083] [INFO ] [MAIN ] MPX: Loaded 4315 existing records. [2025-09-17T20:23:33.130181] [WARN ] [MAIN ] MPX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:23:33.130446] [INFO ] [MAIN ] MPX: Wiping existing primary data before full refresh. [2025-09-17T20:23:33.130493] [INFO ] [LOCAL ] MPX: Starting deletion of primary data. [2025-09-17T20:23:33.130831] [DEBUG] [LOCAL ] MPX: Deleted primary data file. [2025-09-17T20:23:33.130881] [INFO ] [MAIN ] MPX: Starting full primary refresh. [2025-09-17T20:23:33.220877] [INFO ] [REMOTE ] MPC: Fetching primary data for 2025-09. [2025-09-17T20:23:33.496790] [INFO ] [REMOTE ] MPX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:23:34.015793] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-11. [2025-09-17T20:23:34.531145] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-17T20:23:34.553508] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-11 (0.54 seconds). [2025-09-17T20:23:34.815790] [INFO ] [REMOTE ] MPLX: Fetching primary data for 2025-09. [2025-09-17T20:23:34.953539] [INFO ] [REMOTE ] MPC: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T20:23:34.960565] [INFO ] [REMOTE ] MPC: Full fetch complete (75723 records). [2025-09-17T20:23:34.960738] [DEBUG] [VALIDATOR ] MPC: Validating primary data. [2025-09-17T20:23:35.359894] [DEBUG] [VALIDATOR ] MPC: All expected trading days are present. [2025-09-17T20:23:35.359993] [DEBUG] [VALIDATOR ] MPC: Primary data validation passed. [2025-09-17T20:23:35.361016] [INFO ] [MAIN ] MPC: Fetched primary data is valid. [2025-09-17T20:23:35.361079] [DEBUG] [LOCAL ] MPC: Saving primary data. [2025-09-17T20:23:35.362909] [DEBUG] [LOCAL ] MPC: Trimmed 75723 records to 52150 (keeping 200 days of data) [2025-09-17T20:23:35.615841] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-03. [2025-09-17T20:23:35.707915] [DEBUG] [LOCAL ] MPC: Primary data saved (52150 records). [2025-09-17T20:23:35.708067] [INFO ] [MAIN ] MPC: Full history saved. [2025-09-17T20:23:35.708161] [INFO ] [MAIN ] Update Progress: 1393/2371 symbols completed. MPC took 52.0s. Estimated remaining: 2h 22m 55s. Rate: 6.8 symbols/min [2025-09-17T20:23:35.889405] [INFO ] [MAIN ] MQT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:23:35.900312] [DEBUG] [LOCAL ] MQT: Loaded 8473 existing records from primary storage. [2025-09-17T20:23:35.900454] [INFO ] [MAIN ] MQT: Loaded 8473 existing records. [2025-09-17T20:23:36.088534] [WARN ] [MAIN ] MQT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:23:36.088850] [INFO ] [MAIN ] MQT: Wiping existing primary data before full refresh. [2025-09-17T20:23:36.088901] [INFO ] [LOCAL ] MQT: Starting deletion of primary data. [2025-09-17T20:23:36.089236] [DEBUG] [LOCAL ] MQT: Deleted primary data file. [2025-09-17T20:23:36.089290] [INFO ] [MAIN ] MQT: Starting full primary refresh. [2025-09-17T20:23:36.420891] [INFO ] [REMOTE ] MPX: Fetching primary data for 2024-12. [2025-09-17T20:23:36.459770] [INFO ] [REMOTE ] MQT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:23:36.519988] [INFO ] [REMOTE ] MPLX: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T20:23:36.526705] [INFO ] [REMOTE ] MPLX: Full fetch complete (73841 records). [2025-09-17T20:23:36.526845] [DEBUG] [VALIDATOR ] MPLX: Validating primary data. [2025-09-17T20:23:36.914827] [DEBUG] [VALIDATOR ] MPLX: All expected trading days are present. [2025-09-17T20:23:36.914913] [DEBUG] [VALIDATOR ] MPLX: Primary data validation passed. [2025-09-17T20:23:36.916002] [INFO ] [MAIN ] MPLX: Fetched primary data is valid. [2025-09-17T20:23:36.916051] [DEBUG] [LOCAL ] MPLX: Saving primary data. [2025-09-17T20:23:36.917601] [DEBUG] [LOCAL ] MPLX: Trimmed 73841 records to 50795 (keeping 200 days of data) [2025-09-17T20:23:37.223168] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-11. [2025-09-17T20:23:37.234937] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T20:23:37.253145] [DEBUG] [LOCAL ] MPLX: Primary data saved (50795 records). [2025-09-17T20:23:37.253287] [INFO ] [MAIN ] MPLX: Full history saved. [2025-09-17T20:23:37.253433] [INFO ] [MAIN ] Update Progress: 1394/2371 symbols completed. MPLX took 35.8s. Estimated remaining: 2h 22m 41s. Rate: 6.8 symbols/min [2025-09-17T20:23:37.473097] [INFO ] [MAIN ] MQY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:23:37.492490] [DEBUG] [LOCAL ] MQY: Loaded 16732 existing records from primary storage. [2025-09-17T20:23:37.492622] [INFO ] [MAIN ] MQY: Loaded 16732 existing records. [2025-09-17T20:23:37.650923] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T20:23:37.722157] [WARN ] [MAIN ] MQY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:23:37.722392] [INFO ] [MAIN ] MQY: Wiping existing primary data before full refresh. [2025-09-17T20:23:37.722439] [INFO ] [LOCAL ] MQY: Starting deletion of primary data. [2025-09-17T20:23:37.722930] [DEBUG] [LOCAL ] MQY: Deleted primary data file. [2025-09-17T20:23:37.722985] [INFO ] [MAIN ] MQY: Starting full primary refresh. [2025-09-17T20:23:38.020925] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-04. [2025-09-17T20:23:38.090093] [INFO ] [REMOTE ] MQY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:23:38.098460] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T20:23:38.815788] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-01. [2025-09-17T20:23:39.537306] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T20:23:39.615807] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-11. [2025-09-17T20:23:40.156460] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T20:23:40.415702] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-05. [2025-09-17T20:23:40.733916] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T20:23:41.215856] [INFO ] [REMOTE ] MQT: Fetching primary data for 2024-12. [2025-09-17T20:23:41.895623] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T20:23:42.015726] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-01. [2025-09-17T20:23:42.510464] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T20:23:42.815793] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-06. [2025-09-17T20:23:42.965056] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T20:23:43.615833] [INFO ] [REMOTE ] MQY: Fetching primary data for 2024-12. [2025-09-17T20:23:44.415757] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-02. [2025-09-17T20:23:44.511698] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T20:23:44.828183] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T20:23:45.215793] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-01. [2025-09-17T20:23:45.266221] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T20:23:46.015802] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-03. [2025-09-17T20:23:46.457931] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T20:23:46.768355] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T20:23:46.815825] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-02. [2025-09-17T20:23:47.409328] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T20:23:47.615799] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-04. [2025-09-17T20:23:48.415863] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-07. [2025-09-17T20:23:48.619795] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T20:23:49.215788] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-03. [2025-09-17T20:23:49.900987] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T20:23:50.015783] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-05. [2025-09-17T20:23:50.344951] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T20:23:50.481364] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T20:23:50.815799] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-02. [2025-09-17T20:23:51.615794] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-08. [2025-09-17T20:23:51.890114] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T20:23:52.415824] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-04. [2025-09-17T20:23:53.194487] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T20:23:53.215739] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-05. [2025-09-17T20:23:53.538683] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T20:23:53.880376] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T20:23:54.015814] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-06. [2025-09-17T20:23:54.616468] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T20:23:54.815750] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-03. [2025-09-17T20:23:55.615765] [INFO ] [REMOTE ] MPW: Fetching primary data for 2025-09. [2025-09-17T20:23:55.928790] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T20:23:56.415807] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-07. [2025-09-17T20:23:57.152820] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T20:23:57.215765] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-08. [2025-09-17T20:23:57.372054] [INFO ] [REMOTE ] MPW: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T20:23:57.379283] [INFO ] [REMOTE ] MPW: Full fetch complete (77436 records). [2025-09-17T20:23:57.379425] [DEBUG] [VALIDATOR ] MPW: Validating primary data. [2025-09-17T20:23:57.792016] [DEBUG] [VALIDATOR ] MPW: All expected trading days are present. [2025-09-17T20:23:57.792109] [DEBUG] [VALIDATOR ] MPW: Primary data validation passed. [2025-09-17T20:23:57.793201] [INFO ] [MAIN ] MPW: Fetched primary data is valid. [2025-09-17T20:23:57.793263] [DEBUG] [LOCAL ] MPW: Saving primary data. [2025-09-17T20:23:57.794947] [DEBUG] [LOCAL ] MPW: Trimmed 77436 records to 53501 (keeping 200 days of data) [2025-09-17T20:23:57.896708] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T20:23:58.021705] [INFO ] [REMOTE ] MPX: Fetching primary data for 2025-09. [2025-09-17T20:23:58.149416] [DEBUG] [LOCAL ] MPW: Primary data saved (53501 records). [2025-09-17T20:23:58.149630] [INFO ] [MAIN ] MPW: Full history saved. [2025-09-17T20:23:58.150324] [INFO ] [MAIN ] Update Progress: 1395/2371 symbols completed. MPW took 38.0s. Estimated remaining: 2h 22m 41s. Rate: 6.8 symbols/min [2025-09-17T20:23:58.328110] [INFO ] [MAIN ] MRC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:23:58.370103] [DEBUG] [LOCAL ] MRC: Loaded 37489 existing records from primary storage. [2025-09-17T20:23:58.370289] [INFO ] [MAIN ] MRC: Loaded 37489 existing records. [2025-09-17T20:23:58.556664] [WARN ] [MAIN ] MRC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:23:58.556974] [INFO ] [MAIN ] MRC: Wiping existing primary data before full refresh. [2025-09-17T20:23:58.557023] [INFO ] [LOCAL ] MRC: Starting deletion of primary data. [2025-09-17T20:23:58.557895] [DEBUG] [LOCAL ] MRC: Deleted primary data file. [2025-09-17T20:23:58.557961] [INFO ] [MAIN ] MRC: Starting full primary refresh. [2025-09-17T20:23:58.656363] [INFO ] [REMOTE ] MPX: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T20:23:58.668575] [INFO ] [REMOTE ] MPX: Full fetch complete (6847 records). [2025-09-17T20:23:58.679052] [DEBUG] [VALIDATOR ] MPX: Validating primary data. [2025-09-17T20:23:58.819943] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-06. [2025-09-17T20:23:59.215671] [INFO ] [REMOTE ] MRC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:23:59.320422] [DEBUG] [VALIDATOR ] MPX: All expected trading days are present. [2025-09-17T20:23:59.320508] [DEBUG] [VALIDATOR ] MPX: Primary data validation passed. [2025-09-17T20:23:59.320751] [INFO ] [MAIN ] MPX: Fetched primary data is valid. [2025-09-17T20:23:59.320797] [DEBUG] [LOCAL ] MPX: Saving primary data. [2025-09-17T20:23:59.321229] [DEBUG] [LOCAL ] MPX: Trimmed 6847 records to 4290 (keeping 200 days of data) [2025-09-17T20:23:59.354524] [DEBUG] [LOCAL ] MPX: Primary data saved (4290 records). [2025-09-17T20:23:59.354672] [INFO ] [MAIN ] MPX: Full history saved. [2025-09-17T20:23:59.354808] [INFO ] [MAIN ] Update Progress: 1396/2371 symbols completed. MPX took 26.6s. Estimated remaining: 2h 22m 27s. Rate: 6.8 symbols/min [2025-09-17T20:23:59.536751] [INFO ] [MAIN ] MRK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:23:59.607159] [DEBUG] [LOCAL ] MRK: Loaded 53789 existing records from primary storage. [2025-09-17T20:23:59.607319] [INFO ] [MAIN ] MRK: Loaded 53789 existing records. [2025-09-17T20:23:59.621013] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-04. [2025-09-17T20:23:59.731952] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T20:23:59.806508] [WARN ] [MAIN ] MRK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:23:59.806856] [INFO ] [MAIN ] MRK: Wiping existing primary data before full refresh. [2025-09-17T20:23:59.806909] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-17T20:23:59.808032] [DEBUG] [LOCAL ] MRK: Deleted primary data file. [2025-09-17T20:23:59.808089] [INFO ] [MAIN ] MRK: Starting full primary refresh. [2025-09-17T20:24:00.171079] [INFO ] [REMOTE ] MRK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:24:00.415919] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-11. [2025-09-17T20:24:00.902488] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T20:24:01.216050] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-11. [2025-09-17T20:24:01.807137] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T20:24:02.015812] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-05. [2025-09-17T20:24:02.810825] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T20:24:02.815667] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-06. [2025-09-17T20:24:03.016534] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T20:24:03.465271] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T20:24:03.615781] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-07. [2025-09-17T20:24:04.415873] [INFO ] [REMOTE ] MRC: Fetching primary data for 2024-12. [2025-09-17T20:24:04.439685] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T20:24:05.215785] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-08. [2025-09-17T20:24:05.946006] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T20:24:05.984836] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T20:24:06.015730] [INFO ] [REMOTE ] MQT: Fetching primary data for 2025-09. [2025-09-17T20:24:06.740489] [INFO ] [REMOTE ] MQT: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T20:24:06.742375] [INFO ] [REMOTE ] MQT: Full fetch complete (13365 records). [2025-09-17T20:24:06.742478] [DEBUG] [VALIDATOR ] MQT: Validating primary data. [2025-09-17T20:24:06.820841] [INFO ] [REMOTE ] MRK: Fetching primary data for 2024-12. [2025-09-17T20:24:07.112263] [DEBUG] [VALIDATOR ] MQT: All expected trading days are present. [2025-09-17T20:24:07.112343] [DEBUG] [VALIDATOR ] MQT: Primary data validation passed. [2025-09-17T20:24:07.112749] [INFO ] [MAIN ] MQT: Fetched primary data is valid. [2025-09-17T20:24:07.112795] [DEBUG] [LOCAL ] MQT: Saving primary data. [2025-09-17T20:24:07.113290] [DEBUG] [LOCAL ] MQT: Trimmed 13365 records to 8445 (keeping 200 days of data) [2025-09-17T20:24:07.169534] [DEBUG] [LOCAL ] MQT: Primary data saved (8445 records). [2025-09-17T20:24:07.169697] [INFO ] [MAIN ] MQT: Full history saved. [2025-09-17T20:24:07.169802] [INFO ] [MAIN ] Update Progress: 1397/2371 symbols completed. MQT took 31.5s. Estimated remaining: 2h 22m 18s. Rate: 6.8 symbols/min [2025-09-17T20:24:07.615785] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-07. [2025-09-17T20:24:08.415804] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-01. [2025-09-17T20:24:08.685094] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T20:24:09.147068] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-17T20:24:09.215823] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-01. [2025-09-17T20:24:09.520635] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T20:24:10.015806] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-08. [2025-09-17T20:24:10.815790] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-02. [2025-09-17T20:24:11.148911] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T20:24:11.583740] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-17T20:24:11.615746] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-02. [2025-09-17T20:24:12.131551] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T20:24:12.415775] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-03. [2025-09-17T20:24:13.215786] [INFO ] [REMOTE ] MQY: Fetching primary data for 2025-09. [2025-09-17T20:24:13.957625] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T20:24:14.015790] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-04. [2025-09-17T20:24:14.073930] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-17T20:24:14.815797] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-03. [2025-09-17T20:24:15.472456] [INFO ] [REMOTE ] MQY: Incremental fetch complete for 2025-09 (2.26 seconds). [2025-09-17T20:24:15.475775] [INFO ] [REMOTE ] MQY: Full fetch complete (27336 records). [2025-09-17T20:24:15.475881] [DEBUG] [VALIDATOR ] MQY: Validating primary data. [2025-09-17T20:24:15.895924] [DEBUG] [VALIDATOR ] MQY: All expected trading days are present. [2025-09-17T20:24:15.896467] [DEBUG] [VALIDATOR ] MQY: Primary data validation passed. [2025-09-17T20:24:15.897096] [INFO ] [MAIN ] MQY: Fetched primary data is valid. [2025-09-17T20:24:15.897952] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T20:24:15.906284] [DEBUG] [LOCAL ] MQY: Saving primary data. [2025-09-17T20:24:15.907368] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-05. [2025-09-17T20:24:15.908558] [DEBUG] [LOCAL ] MQY: Trimmed 27336 records to 16811 (keeping 200 days of data) [2025-09-17T20:24:16.013631] [DEBUG] [LOCAL ] MQY: Primary data saved (16811 records). [2025-09-17T20:24:16.013813] [INFO ] [MAIN ] MQY: Full history saved. [2025-09-17T20:24:16.013917] [INFO ] [MAIN ] Update Progress: 1398/2371 symbols completed. MQY took 38.8s. Estimated remaining: 2h 22m 9s. Rate: 6.8 symbols/min [2025-09-17T20:24:17.416927] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T20:24:17.424861] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-06. [2025-09-17T20:24:18.898289] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T20:24:18.905932] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-07. [2025-09-17T20:24:20.485216] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T20:24:20.496202] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-08. [2025-09-17T20:24:20.567517] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-03 (5.75 seconds). [2025-09-17T20:24:20.579118] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-04. [2025-09-17T20:24:21.939352] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T20:24:21.947031] [INFO ] [REMOTE ] MRC: Fetching primary data for 2025-09. [2025-09-17T20:24:23.020691] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-17T20:24:23.032956] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-05. [2025-09-17T20:24:23.218878] [INFO ] [REMOTE ] MRC: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T20:24:23.223804] [INFO ] [REMOTE ] MRC: Full fetch complete (53934 records). [2025-09-17T20:24:23.223940] [DEBUG] [VALIDATOR ] MRC: Validating primary data. [2025-09-17T20:24:23.610815] [DEBUG] [VALIDATOR ] MRC: All expected trading days are present. [2025-09-17T20:24:23.610914] [DEBUG] [VALIDATOR ] MRC: Primary data validation passed. [2025-09-17T20:24:23.611784] [INFO ] [MAIN ] MRC: Fetched primary data is valid. [2025-09-17T20:24:23.611829] [DEBUG] [LOCAL ] MRC: Saving primary data. [2025-09-17T20:24:23.613019] [DEBUG] [LOCAL ] MRC: Trimmed 53934 records to 37525 (keeping 200 days of data) [2025-09-17T20:24:23.829686] [DEBUG] [LOCAL ] MRC: Primary data saved (37525 records). [2025-09-17T20:24:23.829835] [INFO ] [MAIN ] MRC: Full history saved. [2025-09-17T20:24:23.830477] [INFO ] [MAIN ] Update Progress: 1399/2371 symbols completed. MRC took 25.7s. Estimated remaining: 2h 21m 59s. Rate: 6.8 symbols/min [2025-09-17T20:24:25.517411] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-05 (2.48 seconds). [2025-09-17T20:24:25.530311] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-06. [2025-09-17T20:24:27.639383] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T20:24:27.650547] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-07. [2025-09-17T20:24:30.107141] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-17T20:24:30.119221] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-08. [2025-09-17T20:24:32.541491] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-17T20:24:32.553339] [INFO ] [REMOTE ] MRK: Fetching primary data for 2025-09. [2025-09-17T20:24:33.494787] [INFO ] [REMOTE ] MRK: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T20:24:33.502397] [INFO ] [REMOTE ] MRK: Full fetch complete (77377 records). [2025-09-17T20:24:33.502576] [DEBUG] [VALIDATOR ] MRK: Validating primary data. [2025-09-17T20:24:33.503569] [FATAL] [VALIDATOR ] MRK: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:24:33.503733] [FATAL] [MAIN ] MRK: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:24:33.503788] [WARN ] [MAIN ] MRK: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:24:33.503834] [INFO ] [LOCAL ] MRK: Starting deletion of primary data. [2025-09-17T20:24:33.503899] [DEBUG] [LOCAL ] MRK: No primary data file found to delete. [2025-09-17T20:24:33.503973] [INFO ] [LOCAL ] MRK: Starting deletion of derivative data. [2025-09-17T20:24:33.504374] [DEBUG] [LOCAL ] MRK: Deleted derivative data file. [2025-09-17T20:24:33.504504] [INFO ] [MAIN ] Update Progress: 1400/2371 symbols completed. MRK took 34.1s. Estimated remaining: 2h 21m 51s. Rate: 6.8 symbols/min [2025-09-17T20:24:34.231273] [INFO ] [MAIN ] MSA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:24:34.225601] [INFO ] [MAIN ] MSB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:24:34.255726] [INFO ] [MAIN ] MRP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:24:34.283274] [INFO ] [MAIN ] MS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:24:34.284455] [DEBUG] [LOCAL ] MRP: No existing data file found in primary storage. [2025-09-17T20:24:34.285015] [WARN ] [MAIN ] MRP: No existing data found, performing full refresh instead. [2025-09-17T20:24:34.285870] [INFO ] [MAIN ] MRP: Wiping existing primary data before full refresh. [2025-09-17T20:24:34.285944] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-17T20:24:34.286047] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-17T20:24:34.286215] [INFO ] [MAIN ] MRP: Starting full primary refresh. [2025-09-17T20:24:34.399563] [DEBUG] [LOCAL ] MSB: Loaded 7945 existing records from primary storage. [2025-09-17T20:24:34.415955] [INFO ] [MAIN ] MSB: Loaded 7945 existing records. [2025-09-17T20:24:34.513681] [DEBUG] [LOCAL ] MSA: Loaded 18785 existing records from primary storage. [2025-09-17T20:24:34.531868] [INFO ] [MAIN ] MSA: Loaded 18785 existing records. [2025-09-17T20:24:34.998734] [DEBUG] [LOCAL ] MS: Loaded 53696 existing records from primary storage. [2025-09-17T20:24:35.069213] [INFO ] [MAIN ] MS: Loaded 53696 existing records. [2025-09-17T20:24:35.294236] [WARN ] [MAIN ] MSB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:24:35.452031] [WARN ] [MAIN ] MSA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:24:35.478268] [INFO ] [MAIN ] MSB: Wiping existing primary data before full refresh. [2025-09-17T20:24:35.515135] [INFO ] [MAIN ] MSA: Wiping existing primary data before full refresh. [2025-09-17T20:24:35.515223] [INFO ] [LOCAL ] MSB: Starting deletion of primary data. [2025-09-17T20:24:35.531016] [INFO ] [LOCAL ] MSA: Starting deletion of primary data. [2025-09-17T20:24:35.626322] [DEBUG] [LOCAL ] MSB: Deleted primary data file. [2025-09-17T20:24:35.624908] [DEBUG] [LOCAL ] MSA: Deleted primary data file. [2025-09-17T20:24:35.656699] [INFO ] [MAIN ] MSA: Starting full primary refresh. [2025-09-17T20:24:35.635012] [WARN ] [MAIN ] MS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:24:35.656801] [INFO ] [MAIN ] MSB: Starting full primary refresh. [2025-09-17T20:24:35.693744] [INFO ] [MAIN ] MS: Wiping existing primary data before full refresh. [2025-09-17T20:24:35.717837] [INFO ] [REMOTE ] MRP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:24:35.776344] [INFO ] [LOCAL ] MS: Starting deletion of primary data. [2025-09-17T20:24:35.816070] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-11. [2025-09-17T20:24:35.831484] [DEBUG] [LOCAL ] MS: Deleted primary data file. [2025-09-17T20:24:35.869690] [INFO ] [MAIN ] MS: Starting full primary refresh. [2025-09-17T20:24:36.313432] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:24:36.378412] [WARN ] [REMOTE ] MRP: No data returned for month 2024-11 [2025-09-17T20:24:36.491371] [INFO ] [REMOTE ] MRP: Fetching primary data for 2024-12. [2025-09-17T20:24:36.686750] [INFO ] [REMOTE ] MSB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:24:36.728070] [INFO ] [REMOTE ] MSA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:24:36.755262] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-11. [2025-09-17T20:24:36.755628] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-11. [2025-09-17T20:24:36.816851] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:24:36.839114] [INFO ] [REMOTE ] MS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:24:36.839397] [WARN ] [REMOTE ] MRP: No data returned for month 2024-12 [2025-09-17T20:24:36.839613] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-11. [2025-09-17T20:24:36.839928] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-01. [2025-09-17T20:24:37.113330] [DEBUG] [REMOTE ] MRP: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:24:37.113760] [WARN ] [REMOTE ] MRP: No data returned for month 2025-01 [2025-09-17T20:24:37.114230] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-02. [2025-09-17T20:24:37.484452] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T20:24:37.486230] [INFO ] [REMOTE ] MSB: Fetching primary data for 2024-12. [2025-09-17T20:24:37.896253] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T20:24:37.900093] [INFO ] [REMOTE ] MSA: Fetching primary data for 2024-12. [2025-09-17T20:24:38.204592] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T20:24:38.206519] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-01. [2025-09-17T20:24:38.666516] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T20:24:38.674882] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-03. [2025-09-17T20:24:38.728421] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T20:24:38.732525] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-01. [2025-09-17T20:24:38.789079] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-17T20:24:38.800419] [INFO ] [REMOTE ] MS: Fetching primary data for 2024-12. [2025-09-17T20:24:38.913355] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T20:24:38.917203] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-02. [2025-09-17T20:24:39.432145] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T20:24:39.435623] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-02. [2025-09-17T20:24:39.504934] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T20:24:39.507990] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-03. [2025-09-17T20:24:40.405382] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T20:24:40.407947] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-04. [2025-09-17T20:24:40.496831] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T20:24:40.508307] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-04. [2025-09-17T20:24:41.061137] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T20:24:41.065483] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-03. [2025-09-17T20:24:41.087882] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T20:24:41.090687] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-05. [2025-09-17T20:24:41.960912] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T20:24:41.964230] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-06. [2025-09-17T20:24:42.213918] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T20:24:42.223999] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-05. [2025-09-17T20:24:43.527380] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2024-12 (4.73 seconds). [2025-09-17T20:24:43.538624] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-01. [2025-09-17T20:24:43.928584] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T20:24:43.938890] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-06. [2025-09-17T20:24:44.122141] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-03 (3.06 seconds). [2025-09-17T20:24:44.126420] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-04. [2025-09-17T20:24:44.382330] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-17T20:24:44.415797] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-07. [2025-09-17T20:24:45.222271] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T20:24:45.225232] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-08. [2025-09-17T20:24:45.478531] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T20:24:45.523507] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T20:24:45.849625] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T20:24:45.927160] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T20:24:46.015826] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-07. [2025-09-17T20:24:46.815841] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-05. [2025-09-17T20:24:47.615791] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-02. [2025-09-17T20:24:47.705964] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T20:24:48.005383] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T20:24:48.415837] [INFO ] [REMOTE ] MSB: Fetching primary data for 2025-09. [2025-09-17T20:24:49.098895] [INFO ] [REMOTE ] MSB: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T20:24:49.100406] [INFO ] [REMOTE ] MSB: Full fetch complete (12835 records). [2025-09-17T20:24:49.100476] [DEBUG] [VALIDATOR ] MSB: Validating primary data. [2025-09-17T20:24:49.217357] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-08. [2025-09-17T20:24:49.501051] [DEBUG] [VALIDATOR ] MSB: All expected trading days are present. [2025-09-17T20:24:49.501187] [DEBUG] [VALIDATOR ] MSB: Primary data validation passed. [2025-09-17T20:24:49.501613] [INFO ] [MAIN ] MSB: Fetched primary data is valid. [2025-09-17T20:24:49.501786] [DEBUG] [LOCAL ] MSB: Saving primary data. [2025-09-17T20:24:49.502871] [DEBUG] [LOCAL ] MSB: Trimmed 12835 records to 7917 (keeping 200 days of data) [2025-09-17T20:24:49.560149] [DEBUG] [LOCAL ] MSB: Primary data saved (7917 records). [2025-09-17T20:24:49.560511] [INFO ] [MAIN ] MSB: Full history saved. [2025-09-17T20:24:49.560665] [INFO ] [MAIN ] Update Progress: 1401/2371 symbols completed. MSB took 16.1s. Estimated remaining: 2h 21m 48s. Rate: 6.8 symbols/min [2025-09-17T20:24:49.670196] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-17T20:24:49.791670] [INFO ] [MAIN ] MSC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:24:49.791947] [DEBUG] [LOCAL ] MSC: No existing data file found in primary storage. [2025-09-17T20:24:49.791989] [WARN ] [MAIN ] MSC: No existing data found, performing full refresh instead. [2025-09-17T20:24:49.792132] [INFO ] [MAIN ] MSC: Wiping existing primary data before full refresh. [2025-09-17T20:24:49.792202] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-17T20:24:49.792246] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-17T20:24:49.792282] [INFO ] [MAIN ] MSC: Starting full primary refresh. [2025-09-17T20:24:50.020991] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-03. [2025-09-17T20:24:50.172667] [INFO ] [REMOTE ] MSC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:24:50.815989] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-11. [2025-09-17T20:24:51.043828] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T20:24:51.135739] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-17T20:24:51.615860] [INFO ] [REMOTE ] MSC: Fetching primary data for 2024-12. [2025-09-17T20:24:51.838414] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T20:24:52.022955] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2024-12 (0.41 seconds). [2025-09-17T20:24:52.415860] [INFO ] [REMOTE ] MRP: Fetching primary data for 2025-09. [2025-09-17T20:24:53.215797] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-04. [2025-09-17T20:24:54.015790] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-01. [2025-09-17T20:24:54.125459] [INFO ] [REMOTE ] MRP: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T20:24:54.131812] [INFO ] [REMOTE ] MRP: Full fetch complete (52847 records). [2025-09-17T20:24:54.131921] [DEBUG] [VALIDATOR ] MRP: Validating primary data. [2025-09-17T20:24:54.328661] [WARN ] [VALIDATOR ] MRP: Validation failed - insufficient historical data. Have 153 unique days, need 200 days [2025-09-17T20:24:54.329283] [FATAL] [MAIN ] MRP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:24:54.329342] [WARN ] [MAIN ] MRP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:24:54.329386] [INFO ] [LOCAL ] MRP: Starting deletion of primary data. [2025-09-17T20:24:54.329448] [DEBUG] [LOCAL ] MRP: No primary data file found to delete. [2025-09-17T20:24:54.329487] [INFO ] [LOCAL ] MRP: Starting deletion of derivative data. [2025-09-17T20:24:54.329538] [DEBUG] [LOCAL ] MRP: No derivative data file found to delete. [2025-09-17T20:24:54.329622] [INFO ] [MAIN ] Update Progress: 1402/2371 symbols completed. MRP took 20.8s. Estimated remaining: 2h 21m 36s. Rate: 6.8 symbols/min [2025-09-17T20:24:54.524827] [INFO ] [MAIN ] MSCI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:24:54.530322] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T20:24:54.574290] [DEBUG] [LOCAL ] MSCI: Loaded 34729 existing records from primary storage. [2025-09-17T20:24:54.574457] [INFO ] [MAIN ] MSCI: Loaded 34729 existing records. [2025-09-17T20:24:54.764004] [WARN ] [MAIN ] MSCI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:24:54.764285] [INFO ] [MAIN ] MSCI: Wiping existing primary data before full refresh. [2025-09-17T20:24:54.764334] [INFO ] [LOCAL ] MSCI: Starting deletion of primary data. [2025-09-17T20:24:54.765511] [DEBUG] [LOCAL ] MSCI: Deleted primary data file. [2025-09-17T20:24:54.765564] [INFO ] [MAIN ] MSCI: Starting full primary refresh. [2025-09-17T20:24:54.828231] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-06. [2025-09-17T20:24:55.141103] [INFO ] [REMOTE ] MSCI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:24:55.409925] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-17T20:24:55.615824] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-05. [2025-09-17T20:24:55.670320] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T20:24:56.415844] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-11. [2025-09-17T20:24:57.215802] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-07. [2025-09-17T20:24:58.017173] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-02. [2025-09-17T20:24:58.022927] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T20:24:58.295317] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T20:24:58.654601] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T20:24:58.737345] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-05 (3.12 seconds). [2025-09-17T20:24:58.815776] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-06. [2025-09-17T20:24:59.615843] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2024-12. [2025-09-17T20:25:00.415844] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-08. [2025-09-17T20:25:00.821319] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T20:25:01.050058] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T20:25:01.215858] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-03. [2025-09-17T20:25:01.424887] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T20:25:01.734698] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-03 (0.52 seconds). [2025-09-17T20:25:02.015875] [INFO ] [REMOTE ] MSA: Fetching primary data for 2025-09. [2025-09-17T20:25:02.815829] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-01. [2025-09-17T20:25:03.074775] [INFO ] [REMOTE ] MSA: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T20:25:03.080130] [INFO ] [REMOTE ] MSA: Full fetch complete (25492 records). [2025-09-17T20:25:03.080385] [DEBUG] [VALIDATOR ] MSA: Validating primary data. [2025-09-17T20:25:03.514120] [DEBUG] [VALIDATOR ] MSA: All expected trading days are present. [2025-09-17T20:25:03.514249] [DEBUG] [VALIDATOR ] MSA: Primary data validation passed. [2025-09-17T20:25:03.515145] [INFO ] [MAIN ] MSA: Fetched primary data is valid. [2025-09-17T20:25:03.515199] [DEBUG] [LOCAL ] MSA: Saving primary data. [2025-09-17T20:25:03.517124] [DEBUG] [LOCAL ] MSA: Trimmed 25492 records to 18774 (keeping 200 days of data) [2025-09-17T20:25:03.618115] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-07. [2025-09-17T20:25:03.653470] [DEBUG] [LOCAL ] MSA: Primary data saved (18774 records). [2025-09-17T20:25:03.653757] [INFO ] [MAIN ] MSA: Full history saved. [2025-09-17T20:25:03.653890] [INFO ] [MAIN ] Update Progress: 1403/2371 symbols completed. MSA took 30.1s. Estimated remaining: 2h 21m 28s. Rate: 6.8 symbols/min [2025-09-17T20:25:03.833809] [INFO ] [MAIN ] MSD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:25:03.850884] [DEBUG] [LOCAL ] MSD: Loaded 15571 existing records from primary storage. [2025-09-17T20:25:03.851062] [INFO ] [MAIN ] MSD: Loaded 15571 existing records. [2025-09-17T20:25:04.059553] [WARN ] [MAIN ] MSD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:25:04.060018] [INFO ] [MAIN ] MSD: Wiping existing primary data before full refresh. [2025-09-17T20:25:04.060181] [INFO ] [LOCAL ] MSD: Starting deletion of primary data. [2025-09-17T20:25:04.061088] [DEBUG] [LOCAL ] MSD: Deleted primary data file. [2025-09-17T20:25:04.061163] [INFO ] [MAIN ] MSD: Starting full primary refresh. [2025-09-17T20:25:04.362898] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T20:25:04.416176] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-04. [2025-09-17T20:25:04.520118] [INFO ] [REMOTE ] MSD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:25:04.902837] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-17T20:25:05.215845] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-11. [2025-09-17T20:25:05.899087] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T20:25:06.017806] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-02. [2025-09-17T20:25:06.022488] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T20:25:06.815872] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-05. [2025-09-17T20:25:07.257472] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T20:25:07.611031] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T20:25:07.619370] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-08. [2025-09-17T20:25:08.415892] [INFO ] [REMOTE ] MSD: Fetching primary data for 2024-12. [2025-09-17T20:25:09.215836] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-03. [2025-09-17T20:25:09.269163] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T20:25:09.401790] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T20:25:10.015866] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-01. [2025-09-17T20:25:10.665548] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T20:25:10.815824] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-02. [2025-09-17T20:25:10.980618] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T20:25:11.615748] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-06. [2025-09-17T20:25:11.629285] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T20:25:12.041249] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T20:25:12.415816] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-03. [2025-09-17T20:25:13.215865] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-07. [2025-09-17T20:25:13.431046] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T20:25:13.696529] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T20:25:14.015848] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-08. [2025-09-17T20:25:14.417851] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-08 (0.40 seconds). [2025-09-17T20:25:14.815813] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-04. [2025-09-17T20:25:15.615786] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-04. [2025-09-17T20:25:16.413061] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T20:25:16.416349] [INFO ] [REMOTE ] MS: Fetching primary data for 2025-09. [2025-09-17T20:25:16.525531] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T20:25:17.215796] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-05. [2025-09-17T20:25:18.015805] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-05. [2025-09-17T20:25:18.221698] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T20:25:18.248137] [INFO ] [REMOTE ] MS: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T20:25:18.257368] [INFO ] [REMOTE ] MS: Full fetch complete (77585 records). [2025-09-17T20:25:18.257741] [DEBUG] [VALIDATOR ] MS: Validating primary data. [2025-09-17T20:25:18.693507] [DEBUG] [VALIDATOR ] MS: All expected trading days are present. [2025-09-17T20:25:18.693692] [DEBUG] [VALIDATOR ] MS: Primary data validation passed. [2025-09-17T20:25:18.695269] [INFO ] [MAIN ] MS: Fetched primary data is valid. [2025-09-17T20:25:18.695330] [DEBUG] [LOCAL ] MS: Saving primary data. [2025-09-17T20:25:18.697601] [DEBUG] [LOCAL ] MS: Trimmed 77585 records to 53696 (keeping 200 days of data) [2025-09-17T20:25:18.816720] [INFO ] [REMOTE ] MSC: Fetching primary data for 2025-09. [2025-09-17T20:25:19.066987] [DEBUG] [LOCAL ] MS: Primary data saved (53696 records). [2025-09-17T20:25:19.067194] [INFO ] [MAIN ] MS: Full history saved. [2025-09-17T20:25:19.067325] [INFO ] [MAIN ] Update Progress: 1404/2371 symbols completed. MS took 45.6s. Estimated remaining: 2h 21m 23s. Rate: 6.8 symbols/min [2025-09-17T20:25:19.298108] [INFO ] [MAIN ] MSDL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:25:19.342930] [DEBUG] [LOCAL ] MSDL: Loaded 38189 existing records from primary storage. [2025-09-17T20:25:19.343126] [INFO ] [MAIN ] MSDL: Loaded 38189 existing records. [2025-09-17T20:25:19.560361] [INFO ] [REMOTE ] MSC: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T20:25:19.559767] [WARN ] [MAIN ] MSDL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:25:19.564892] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T20:25:19.565000] [INFO ] [MAIN ] MSDL: Wiping existing primary data before full refresh. [2025-09-17T20:25:19.571268] [INFO ] [LOCAL ] MSDL: Starting deletion of primary data. [2025-09-17T20:25:19.572112] [INFO ] [REMOTE ] MSC: Full fetch complete (2506 records). [2025-09-17T20:25:19.572793] [DEBUG] [VALIDATOR ] MSC: Validating primary data. [2025-09-17T20:25:19.606509] [DEBUG] [LOCAL ] MSDL: Deleted primary data file. [2025-09-17T20:25:19.618273] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-06. [2025-09-17T20:25:19.618577] [INFO ] [MAIN ] MSDL: Starting full primary refresh. [2025-09-17T20:25:19.966498] [WARN ] [VALIDATOR ] MSC: Validation failed - insufficient historical data. Have 193 unique days, need 200 days [2025-09-17T20:25:20.025396] [FATAL] [MAIN ] MSC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:25:20.048525] [WARN ] [MAIN ] MSC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:25:20.087092] [INFO ] [LOCAL ] MSC: Starting deletion of primary data. [2025-09-17T20:25:20.108959] [DEBUG] [LOCAL ] MSC: No primary data file found to delete. [2025-09-17T20:25:20.109093] [INFO ] [LOCAL ] MSC: Starting deletion of derivative data. [2025-09-17T20:25:20.109511] [DEBUG] [LOCAL ] MSC: No derivative data file found to delete. [2025-09-17T20:25:20.115075] [INFO ] [MAIN ] Update Progress: 1405/2371 symbols completed. MSC took 30.5s. Estimated remaining: 2h 21m 9s. Rate: 6.8 symbols/min [2025-09-17T20:25:20.327320] [INFO ] [REMOTE ] MSDL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:25:20.403064] [INFO ] [MAIN ] MSGE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:25:20.418639] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-11. [2025-09-17T20:25:20.433571] [DEBUG] [LOCAL ] MSGE: Loaded 26955 existing records from primary storage. [2025-09-17T20:25:20.433756] [INFO ] [MAIN ] MSGE: Loaded 26955 existing records. [2025-09-17T20:25:20.603052] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T20:25:20.640027] [WARN ] [MAIN ] MSGE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:25:20.640301] [INFO ] [MAIN ] MSGE: Wiping existing primary data before full refresh. [2025-09-17T20:25:20.640352] [INFO ] [LOCAL ] MSGE: Starting deletion of primary data. [2025-09-17T20:25:20.641354] [DEBUG] [LOCAL ] MSGE: Deleted primary data file. [2025-09-17T20:25:20.641412] [INFO ] [MAIN ] MSGE: Starting full primary refresh. [2025-09-17T20:25:20.997202] [INFO ] [REMOTE ] MSGE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:25:21.215795] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-07. [2025-09-17T20:25:21.987464] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T20:25:22.015774] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2024-12. [2025-09-17T20:25:22.265311] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T20:25:22.815784] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-06. [2025-09-17T20:25:23.529291] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T20:25:23.615780] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-08. [2025-09-17T20:25:24.288487] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T20:25:24.415741] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-11. [2025-09-17T20:25:24.741805] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T20:25:25.215787] [INFO ] [REMOTE ] MSD: Fetching primary data for 2025-09. [2025-09-17T20:25:26.015921] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-01. [2025-09-17T20:25:26.091424] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T20:25:26.206903] [INFO ] [REMOTE ] MSD: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T20:25:26.209970] [INFO ] [REMOTE ] MSD: Full fetch complete (21903 records). [2025-09-17T20:25:26.210076] [DEBUG] [VALIDATOR ] MSD: Validating primary data. [2025-09-17T20:25:26.616637] [DEBUG] [VALIDATOR ] MSD: All expected trading days are present. [2025-09-17T20:25:26.616892] [DEBUG] [VALIDATOR ] MSD: Primary data validation passed. [2025-09-17T20:25:26.618019] [INFO ] [MAIN ] MSD: Fetched primary data is valid. [2025-09-17T20:25:26.618117] [DEBUG] [LOCAL ] MSD: Saving primary data. [2025-09-17T20:25:26.619909] [DEBUG] [LOCAL ] MSD: Trimmed 21903 records to 15677 (keeping 200 days of data) [2025-09-17T20:25:26.749413] [DEBUG] [LOCAL ] MSD: Primary data saved (15677 records). [2025-09-17T20:25:26.749584] [INFO ] [MAIN ] MSD: Full history saved. [2025-09-17T20:25:26.749721] [INFO ] [MAIN ] Update Progress: 1406/2371 symbols completed. MSD took 23.1s. Estimated remaining: 2h 20m 59s. Rate: 6.8 symbols/min [2025-09-17T20:25:26.820915] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2024-12. [2025-09-17T20:25:26.995829] [INFO ] [MAIN ] MSGS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:25:27.023911] [DEBUG] [LOCAL ] MSGS: Loaded 16715 existing records from primary storage. [2025-09-17T20:25:27.024119] [INFO ] [MAIN ] MSGS: Loaded 16715 existing records. [2025-09-17T20:25:27.322906] [WARN ] [MAIN ] MSGS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:25:27.323252] [INFO ] [MAIN ] MSGS: Wiping existing primary data before full refresh. [2025-09-17T20:25:27.323312] [INFO ] [LOCAL ] MSGS: Starting deletion of primary data. [2025-09-17T20:25:27.323981] [DEBUG] [LOCAL ] MSGS: Deleted primary data file. [2025-09-17T20:25:27.324047] [INFO ] [MAIN ] MSGS: Starting full primary refresh. [2025-09-17T20:25:27.539685] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T20:25:27.620915] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-07. [2025-09-17T20:25:27.933628] [INFO ] [REMOTE ] MSGS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:25:27.954056] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T20:25:28.415762] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-01. [2025-09-17T20:25:29.215786] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-02. [2025-09-17T20:25:29.438721] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T20:25:29.592225] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T20:25:30.015788] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-02. [2025-09-17T20:25:30.665284] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T20:25:30.815754] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-08. [2025-09-17T20:25:31.271909] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T20:25:31.615787] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-03. [2025-09-17T20:25:32.416826] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T20:25:32.415904] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-11. [2025-09-17T20:25:33.033563] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T20:25:33.215807] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-03. [2025-09-17T20:25:33.321679] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T20:25:34.015800] [INFO ] [REMOTE ] MSCI: Fetching primary data for 2025-09. [2025-09-17T20:25:34.815747] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2024-12. [2025-09-17T20:25:34.850230] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T20:25:35.467430] [INFO ] [REMOTE ] MSCI: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T20:25:35.472764] [INFO ] [REMOTE ] MSCI: Full fetch complete (49804 records). [2025-09-17T20:25:35.472875] [DEBUG] [VALIDATOR ] MSCI: Validating primary data. [2025-09-17T20:25:35.625727] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-04. [2025-09-17T20:25:35.849609] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T20:25:35.887849] [DEBUG] [VALIDATOR ] MSCI: All expected trading days are present. [2025-09-17T20:25:35.887950] [DEBUG] [VALIDATOR ] MSCI: Primary data validation passed. [2025-09-17T20:25:35.888921] [INFO ] [MAIN ] MSCI: Fetched primary data is valid. [2025-09-17T20:25:35.888975] [DEBUG] [LOCAL ] MSCI: Saving primary data. [2025-09-17T20:25:35.890545] [DEBUG] [LOCAL ] MSCI: Trimmed 49804 records to 34787 (keeping 200 days of data) [2025-09-17T20:25:36.127612] [DEBUG] [LOCAL ] MSCI: Primary data saved (34787 records). [2025-09-17T20:25:36.127772] [INFO ] [MAIN ] MSCI: Full history saved. [2025-09-17T20:25:36.127868] [INFO ] [MAIN ] Update Progress: 1407/2371 symbols completed. MSCI took 41.8s. Estimated remaining: 2h 20m 51s. Rate: 6.8 symbols/min [2025-09-17T20:25:36.297664] [INFO ] [MAIN ] MSI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:25:36.340352] [DEBUG] [LOCAL ] MSI: Loaded 40754 existing records from primary storage. [2025-09-17T20:25:36.340513] [INFO ] [MAIN ] MSI: Loaded 40754 existing records. [2025-09-17T20:25:36.420875] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-01. [2025-09-17T20:25:36.524767] [WARN ] [MAIN ] MSI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:25:36.524986] [INFO ] [MAIN ] MSI: Wiping existing primary data before full refresh. [2025-09-17T20:25:36.525032] [INFO ] [LOCAL ] MSI: Starting deletion of primary data. [2025-09-17T20:25:36.526070] [DEBUG] [LOCAL ] MSI: Deleted primary data file. [2025-09-17T20:25:36.526122] [INFO ] [MAIN ] MSI: Starting full primary refresh. [2025-09-17T20:25:36.888237] [INFO ] [REMOTE ] MSI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:25:37.215700] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-11. [2025-09-17T20:25:37.305332] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T20:25:37.367380] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T20:25:38.015780] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-05. [2025-09-17T20:25:38.567525] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T20:25:38.815805] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-04. [2025-09-17T20:25:39.107519] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T20:25:39.615829] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-02. [2025-09-17T20:25:40.313460] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T20:25:40.415786] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-05. [2025-09-17T20:25:40.660023] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T20:25:41.215777] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-06. [2025-09-17T20:25:41.331121] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-05 (0.92 seconds). [2025-09-17T20:25:42.015794] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-03. [2025-09-17T20:25:42.470597] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T20:25:42.815777] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-07. [2025-09-17T20:25:43.125401] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T20:25:43.615806] [INFO ] [REMOTE ] MSI: Fetching primary data for 2024-12. [2025-09-17T20:25:44.342543] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T20:25:44.415771] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-04. [2025-09-17T20:25:45.215790] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-06. [2025-09-17T20:25:45.377543] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T20:25:45.488115] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T20:25:46.015792] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-01. [2025-09-17T20:25:46.473239] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T20:25:46.815801] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-07. [2025-09-17T20:25:47.344089] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T20:25:47.615763] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-08. [2025-09-17T20:25:48.175898] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T20:25:48.415748] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-05. [2025-09-17T20:25:49.216708] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-02. [2025-09-17T20:25:49.222806] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T20:25:49.316663] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T20:25:50.015816] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-08. [2025-09-17T20:25:50.815761] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-06. [2025-09-17T20:25:50.904310] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T20:25:51.317727] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T20:25:51.615693] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-03. [2025-09-17T20:25:51.790946] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T20:25:52.415784] [INFO ] [REMOTE ] MSGE: Fetching primary data for 2025-09. [2025-09-17T20:25:53.215748] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-07. [2025-09-17T20:25:53.405742] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T20:25:53.616413] [INFO ] [REMOTE ] MSGE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T20:25:53.621121] [INFO ] [REMOTE ] MSGE: Full fetch complete (40029 records). [2025-09-17T20:25:53.621247] [DEBUG] [VALIDATOR ] MSGE: Validating primary data. [2025-09-17T20:25:54.027169] [INFO ] [REMOTE ] MSDL: Fetching primary data for 2025-09. [2025-09-17T20:25:54.051560] [DEBUG] [VALIDATOR ] MSGE: All expected trading days are present. [2025-09-17T20:25:54.051681] [DEBUG] [VALIDATOR ] MSGE: Primary data validation passed. [2025-09-17T20:25:54.052539] [INFO ] [MAIN ] MSGE: Fetched primary data is valid. [2025-09-17T20:25:54.052733] [DEBUG] [LOCAL ] MSGE: Saving primary data. [2025-09-17T20:25:54.053995] [DEBUG] [LOCAL ] MSGE: Trimmed 40029 records to 27040 (keeping 200 days of data) [2025-09-17T20:25:54.216155] [DEBUG] [LOCAL ] MSGE: Primary data saved (27040 records). [2025-09-17T20:25:54.216327] [INFO ] [MAIN ] MSGE: Full history saved. [2025-09-17T20:25:54.216534] [INFO ] [MAIN ] Update Progress: 1408/2371 symbols completed. MSGE took 34.1s. Estimated remaining: 2h 20m 48s. Rate: 6.8 symbols/min [2025-09-17T20:25:54.400175] [INFO ] [MAIN ] MSIF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:25:54.400391] [DEBUG] [LOCAL ] MSIF: No existing data file found in primary storage. [2025-09-17T20:25:54.400874] [WARN ] [MAIN ] MSIF: No existing data found, performing full refresh instead. [2025-09-17T20:25:54.401470] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T20:25:54.405056] [INFO ] [MAIN ] MSIF: Wiping existing primary data before full refresh. [2025-09-17T20:25:54.405516] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-17T20:25:54.405570] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-17T20:25:54.405881] [INFO ] [MAIN ] MSIF: Starting full primary refresh. [2025-09-17T20:25:54.760321] [INFO ] [REMOTE ] MSIF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:25:54.815738] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-11. [2025-09-17T20:25:55.081843] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:25:55.082215] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-11 [2025-09-17T20:25:55.468067] [INFO ] [REMOTE ] MSDL: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T20:25:55.473603] [INFO ] [REMOTE ] MSDL: Full fetch complete (53998 records). [2025-09-17T20:25:55.473738] [DEBUG] [VALIDATOR ] MSDL: Validating primary data. [2025-09-17T20:25:55.625456] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-04. [2025-09-17T20:25:55.855467] [DEBUG] [VALIDATOR ] MSDL: All expected trading days are present. [2025-09-17T20:25:55.855548] [DEBUG] [VALIDATOR ] MSDL: Primary data validation passed. [2025-09-17T20:25:55.856329] [INFO ] [MAIN ] MSDL: Fetched primary data is valid. [2025-09-17T20:25:55.856376] [DEBUG] [LOCAL ] MSDL: Saving primary data. [2025-09-17T20:25:55.857719] [DEBUG] [LOCAL ] MSDL: Trimmed 53998 records to 38113 (keeping 200 days of data) [2025-09-17T20:25:56.098247] [DEBUG] [LOCAL ] MSDL: Primary data saved (38113 records). [2025-09-17T20:25:56.098415] [INFO ] [MAIN ] MSDL: Full history saved. [2025-09-17T20:25:56.098515] [INFO ] [MAIN ] Update Progress: 1409/2371 symbols completed. MSDL took 37.0s. Estimated remaining: 2h 20m 35s. Rate: 6.8 symbols/min [2025-09-17T20:25:56.266909] [INFO ] [MAIN ] MSM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:25:56.300708] [DEBUG] [LOCAL ] MSM: Loaded 35253 existing records from primary storage. [2025-09-17T20:25:56.300926] [INFO ] [MAIN ] MSM: Loaded 35253 existing records. [2025-09-17T20:25:56.420996] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2024-12. [2025-09-17T20:25:56.481345] [WARN ] [MAIN ] MSM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:25:56.481535] [INFO ] [MAIN ] MSM: Wiping existing primary data before full refresh. [2025-09-17T20:25:56.481580] [INFO ] [LOCAL ] MSM: Starting deletion of primary data. [2025-09-17T20:25:56.482531] [DEBUG] [LOCAL ] MSM: Deleted primary data file. [2025-09-17T20:25:56.482583] [INFO ] [MAIN ] MSM: Starting full primary refresh. [2025-09-17T20:25:56.758966] [DEBUG] [REMOTE ] MSIF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:25:56.759475] [WARN ] [REMOTE ] MSIF: No data returned for month 2024-12 [2025-09-17T20:25:56.836202] [INFO ] [REMOTE ] MSM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:25:57.215791] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-08. [2025-09-17T20:25:57.429906] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T20:25:58.015791] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-05. [2025-09-17T20:25:58.227219] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T20:25:58.815832] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-11. [2025-09-17T20:25:59.537992] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T20:25:59.615754] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-01. [2025-09-17T20:26:00.121712] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T20:26:00.377236] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T20:26:00.415726] [INFO ] [REMOTE ] MSM: Fetching primary data for 2024-12. [2025-09-17T20:26:01.215792] [INFO ] [REMOTE ] MSGS: Fetching primary data for 2025-09. [2025-09-17T20:26:01.679670] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T20:26:01.976416] [INFO ] [REMOTE ] MSGS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T20:26:01.979553] [INFO ] [REMOTE ] MSGS: Full fetch complete (21919 records). [2025-09-17T20:26:01.979672] [DEBUG] [VALIDATOR ] MSGS: Validating primary data. [2025-09-17T20:26:02.020988] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-06. [2025-09-17T20:26:02.355192] [DEBUG] [VALIDATOR ] MSGS: All expected trading days are present. [2025-09-17T20:26:02.355291] [DEBUG] [VALIDATOR ] MSGS: Primary data validation passed. [2025-09-17T20:26:02.355804] [INFO ] [MAIN ] MSGS: Fetched primary data is valid. [2025-09-17T20:26:02.355849] [DEBUG] [LOCAL ] MSGS: Saving primary data. [2025-09-17T20:26:02.356868] [DEBUG] [LOCAL ] MSGS: Trimmed 21919 records to 16784 (keeping 200 days of data) [2025-09-17T20:26:02.466738] [DEBUG] [LOCAL ] MSGS: Primary data saved (16784 records). [2025-09-17T20:26:02.466901] [INFO ] [MAIN ] MSGS: Full history saved. [2025-09-17T20:26:02.466995] [INFO ] [MAIN ] Update Progress: 1410/2371 symbols completed. MSGS took 35.7s. Estimated remaining: 2h 20m 24s. Rate: 6.8 symbols/min [2025-09-17T20:26:02.639485] [INFO ] [MAIN ] MT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:26:02.691499] [DEBUG] [LOCAL ] MT: Loaded 50934 existing records from primary storage. [2025-09-17T20:26:02.691727] [INFO ] [MAIN ] MT: Loaded 50934 existing records. [2025-09-17T20:26:02.820944] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-02. [2025-09-17T20:26:02.874838] [WARN ] [MAIN ] MT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:26:02.875071] [INFO ] [MAIN ] MT: Wiping existing primary data before full refresh. [2025-09-17T20:26:02.875158] [INFO ] [LOCAL ] MT: Starting deletion of primary data. [2025-09-17T20:26:02.876251] [DEBUG] [LOCAL ] MT: Deleted primary data file. [2025-09-17T20:26:02.876302] [INFO ] [MAIN ] MT: Starting full primary refresh. [2025-09-17T20:26:03.258738] [INFO ] [REMOTE ] MT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:26:03.393414] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T20:26:03.550240] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T20:26:03.615791] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-07. [2025-09-17T20:26:04.415773] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-03. [2025-09-17T20:26:05.144446] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T20:26:05.215759] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-04. [2025-09-17T20:26:05.309326] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T20:26:05.983381] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T20:26:06.015736] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-05. [2025-09-17T20:26:06.682181] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T20:26:06.815817] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-06. [2025-09-17T20:26:07.615824] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-11. [2025-09-17T20:26:07.833762] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T20:26:08.415822] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-01. [2025-09-17T20:26:09.215726] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-08. [2025-09-17T20:26:09.266719] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T20:26:10.015799] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-07. [2025-09-17T20:26:10.054158] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T20:26:10.815703] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-02. [2025-09-17T20:26:10.845161] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T20:26:10.956910] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T20:26:11.615784] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-08. [2025-09-17T20:26:12.290309] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T20:26:12.415763] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-03. [2025-09-17T20:26:12.931576] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T20:26:13.215854] [INFO ] [REMOTE ] MT: Fetching primary data for 2024-12. [2025-09-17T20:26:13.968304] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T20:26:14.015806] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-04. [2025-09-17T20:26:14.815815] [INFO ] [REMOTE ] MSIF: Fetching primary data for 2025-09. [2025-09-17T20:26:14.995136] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T20:26:15.460882] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T20:26:15.605047] [INFO ] [REMOTE ] MSIF: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T20:26:15.608199] [INFO ] [REMOTE ] MSIF: Full fetch complete (15545 records). [2025-09-17T20:26:15.608275] [DEBUG] [VALIDATOR ] MSIF: Validating primary data. [2025-09-17T20:26:15.620889] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-05. [2025-09-17T20:26:15.792760] [WARN ] [VALIDATOR ] MSIF: Validation failed - insufficient historical data. Have 159 unique days, need 200 days [2025-09-17T20:26:15.793081] [FATAL] [MAIN ] MSIF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:26:15.793150] [WARN ] [MAIN ] MSIF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:26:15.793217] [INFO ] [LOCAL ] MSIF: Starting deletion of primary data. [2025-09-17T20:26:15.793303] [DEBUG] [LOCAL ] MSIF: No primary data file found to delete. [2025-09-17T20:26:15.793341] [INFO ] [LOCAL ] MSIF: Starting deletion of derivative data. [2025-09-17T20:26:15.793393] [DEBUG] [LOCAL ] MSIF: No derivative data file found to delete. [2025-09-17T20:26:15.793463] [INFO ] [MAIN ] Update Progress: 1411/2371 symbols completed. MSIF took 21.6s. Estimated remaining: 2h 20m 19s. Rate: 6.8 symbols/min [2025-09-17T20:26:15.992058] [INFO ] [MAIN ] MTAL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:26:16.029881] [DEBUG] [LOCAL ] MTAL: Loaded 36102 existing records from primary storage. [2025-09-17T20:26:16.030020] [INFO ] [MAIN ] MTAL: Loaded 36102 existing records. [2025-09-17T20:26:16.206741] [WARN ] [MAIN ] MTAL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:26:16.206997] [INFO ] [MAIN ] MTAL: Wiping existing primary data before full refresh. [2025-09-17T20:26:16.207047] [INFO ] [LOCAL ] MTAL: Starting deletion of primary data. [2025-09-17T20:26:16.208277] [DEBUG] [LOCAL ] MTAL: Deleted primary data file. [2025-09-17T20:26:16.208328] [INFO ] [MAIN ] MTAL: Starting full primary refresh. [2025-09-17T20:26:16.420858] [INFO ] [REMOTE ] MSI: Fetching primary data for 2025-09. [2025-09-17T20:26:16.569572] [INFO ] [REMOTE ] MTAL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:26:16.881673] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T20:26:17.215821] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-01. [2025-09-17T20:26:17.947781] [INFO ] [REMOTE ] MSI: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T20:26:17.952807] [INFO ] [REMOTE ] MSI: Full fetch complete (58390 records). [2025-09-17T20:26:17.952932] [DEBUG] [VALIDATOR ] MSI: Validating primary data. [2025-09-17T20:26:18.020859] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-06. [2025-09-17T20:26:18.337123] [DEBUG] [VALIDATOR ] MSI: All expected trading days are present. [2025-09-17T20:26:18.337206] [DEBUG] [VALIDATOR ] MSI: Primary data validation passed. [2025-09-17T20:26:18.338070] [INFO ] [MAIN ] MSI: Fetched primary data is valid. [2025-09-17T20:26:18.338118] [DEBUG] [LOCAL ] MSI: Saving primary data. [2025-09-17T20:26:18.339434] [DEBUG] [LOCAL ] MSI: Trimmed 58390 records to 40671 (keeping 200 days of data) [2025-09-17T20:26:18.615814] [DEBUG] [LOCAL ] MSI: Primary data saved (40671 records). [2025-09-17T20:26:18.616005] [INFO ] [MAIN ] MSI: Full history saved. [2025-09-17T20:26:18.616158] [INFO ] [MAIN ] Update Progress: 1412/2371 symbols completed. MSI took 42.5s. Estimated remaining: 2h 20m 6s. Rate: 6.8 symbols/min [2025-09-17T20:26:18.787233] [INFO ] [MAIN ] MTB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:26:18.815813] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-11. [2025-09-17T20:26:18.837061] [DEBUG] [LOCAL ] MTB: Loaded 47268 existing records from primary storage. [2025-09-17T20:26:18.837211] [INFO ] [MAIN ] MTB: Loaded 47268 existing records. [2025-09-17T20:26:19.015739] [WARN ] [MAIN ] MTB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:26:19.015987] [INFO ] [MAIN ] MTB: Wiping existing primary data before full refresh. [2025-09-17T20:26:19.016061] [INFO ] [LOCAL ] MTB: Starting deletion of primary data. [2025-09-17T20:26:19.017262] [DEBUG] [LOCAL ] MTB: Deleted primary data file. [2025-09-17T20:26:19.017347] [INFO ] [MAIN ] MTB: Starting full primary refresh. [2025-09-17T20:26:19.396919] [INFO ] [REMOTE ] MTB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:26:19.451200] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-17T20:26:19.502674] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T20:26:19.615845] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-11. [2025-09-17T20:26:19.991851] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T20:26:20.415844] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-02. [2025-09-17T20:26:21.150576] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T20:26:21.215726] [INFO ] [REMOTE ] MTB: Fetching primary data for 2024-12. [2025-09-17T20:26:22.015795] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2024-12. [2025-09-17T20:26:22.265771] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T20:26:22.804493] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T20:26:22.815731] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-01. [2025-09-17T20:26:23.248031] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T20:26:23.615788] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-01. [2025-09-17T20:26:24.415744] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-03. [2025-09-17T20:26:24.449731] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T20:26:24.559771] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T20:26:25.215770] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-07. [2025-09-17T20:26:26.015781] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-02. [2025-09-17T20:26:26.398492] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T20:26:26.558293] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T20:26:26.756131] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T20:26:26.815779] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-08. [2025-09-17T20:26:27.615778] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-04. [2025-09-17T20:26:28.241759] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T20:26:28.415743] [INFO ] [REMOTE ] MSM: Fetching primary data for 2025-09. [2025-09-17T20:26:29.215766] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-03. [2025-09-17T20:26:29.612599] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T20:26:29.776159] [INFO ] [REMOTE ] MSM: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T20:26:29.780966] [INFO ] [REMOTE ] MSM: Full fetch complete (51663 records). [2025-09-17T20:26:29.781111] [DEBUG] [VALIDATOR ] MSM: Validating primary data. [2025-09-17T20:26:30.020962] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-02. [2025-09-17T20:26:30.172010] [DEBUG] [VALIDATOR ] MSM: All expected trading days are present. [2025-09-17T20:26:30.172095] [DEBUG] [VALIDATOR ] MSM: Primary data validation passed. [2025-09-17T20:26:30.172996] [INFO ] [MAIN ] MSM: Fetched primary data is valid. [2025-09-17T20:26:30.173060] [DEBUG] [LOCAL ] MSM: Saving primary data. [2025-09-17T20:26:30.174247] [DEBUG] [LOCAL ] MSM: Trimmed 51663 records to 35320 (keeping 200 days of data) [2025-09-17T20:26:30.393161] [DEBUG] [LOCAL ] MSM: Primary data saved (35320 records). [2025-09-17T20:26:30.393312] [INFO ] [MAIN ] MSM: Full history saved. [2025-09-17T20:26:30.393443] [INFO ] [MAIN ] Update Progress: 1413/2371 symbols completed. MSM took 34.3s. Estimated remaining: 2h 19m 59s. Rate: 6.8 symbols/min [2025-09-17T20:26:30.574351] [INFO ] [MAIN ] MTD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:26:30.597687] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T20:26:30.618402] [DEBUG] [LOCAL ] MTD: Loaded 15407 existing records from primary storage. [2025-09-17T20:26:30.618572] [INFO ] [MAIN ] MTD: Loaded 15407 existing records. [2025-09-17T20:26:30.801749] [WARN ] [MAIN ] MTD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:26:30.801995] [INFO ] [MAIN ] MTD: Wiping existing primary data before full refresh. [2025-09-17T20:26:30.802044] [INFO ] [LOCAL ] MTD: Starting deletion of primary data. [2025-09-17T20:26:30.802476] [DEBUG] [LOCAL ] MTD: Deleted primary data file. [2025-09-17T20:26:30.802525] [INFO ] [MAIN ] MTD: Starting full primary refresh. [2025-09-17T20:26:30.823267] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-04. [2025-09-17T20:26:31.169472] [INFO ] [REMOTE ] MTD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:26:31.615795] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-11. [2025-09-17T20:26:31.708828] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T20:26:32.427330] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-03. [2025-09-17T20:26:32.430057] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T20:26:32.506594] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T20:26:33.215797] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-05. [2025-09-17T20:26:34.015821] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-05. [2025-09-17T20:26:34.250894] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T20:26:34.687244] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T20:26:34.815752] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-06. [2025-09-17T20:26:35.615792] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-04. [2025-09-17T20:26:35.731665] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T20:26:35.841783] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T20:26:36.415850] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-06. [2025-09-17T20:26:37.215790] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-07. [2025-09-17T20:26:37.450737] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T20:26:37.678250] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T20:26:38.015795] [INFO ] [REMOTE ] MTD: Fetching primary data for 2024-12. [2025-09-17T20:26:38.544129] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T20:26:38.698864] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T20:26:38.815784] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-08. [2025-09-17T20:26:39.615844] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-07. [2025-09-17T20:26:40.345827] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T20:26:40.415741] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-01. [2025-09-17T20:26:41.215835] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-05. [2025-09-17T20:26:41.500878] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T20:26:41.548083] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T20:26:42.015847] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-08. [2025-09-17T20:26:42.815818] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-02. [2025-09-17T20:26:42.900088] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T20:26:43.616556] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-06. [2025-09-17T20:26:43.616470] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T20:26:43.926252] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T20:26:44.415851] [INFO ] [REMOTE ] MTAL: Fetching primary data for 2025-09. [2025-09-17T20:26:45.100124] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T20:26:45.215869] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-07. [2025-09-17T20:26:45.741329] [INFO ] [REMOTE ] MTAL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T20:26:45.746712] [INFO ] [REMOTE ] MTAL: Full fetch complete (46185 records). [2025-09-17T20:26:45.746863] [DEBUG] [VALIDATOR ] MTAL: Validating primary data. [2025-09-17T20:26:46.028061] [INFO ] [REMOTE ] MT: Fetching primary data for 2025-09. [2025-09-17T20:26:46.163227] [DEBUG] [VALIDATOR ] MTAL: All expected trading days are present. [2025-09-17T20:26:46.163339] [DEBUG] [VALIDATOR ] MTAL: Primary data validation passed. [2025-09-17T20:26:46.164303] [INFO ] [MAIN ] MTAL: Fetched primary data is valid. [2025-09-17T20:26:46.164352] [DEBUG] [LOCAL ] MTAL: Saving primary data. [2025-09-17T20:26:46.166019] [DEBUG] [LOCAL ] MTAL: Trimmed 46185 records to 36124 (keeping 200 days of data) [2025-09-17T20:26:46.397125] [DEBUG] [LOCAL ] MTAL: Primary data saved (36124 records). [2025-09-17T20:26:46.397343] [INFO ] [MAIN ] MTAL: Full history saved. [2025-09-17T20:26:46.397526] [INFO ] [MAIN ] Update Progress: 1414/2371 symbols completed. MTAL took 30.6s. Estimated remaining: 2h 19m 55s. Rate: 6.8 symbols/min [2025-09-17T20:26:46.577304] [INFO ] [MAIN ] MTDR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:26:46.633873] [DEBUG] [LOCAL ] MTDR: Loaded 51570 existing records from primary storage. [2025-09-17T20:26:46.634114] [INFO ] [MAIN ] MTDR: Loaded 51570 existing records. [2025-09-17T20:26:46.817585] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-03. [2025-09-17T20:26:46.821259] [WARN ] [MAIN ] MTDR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:26:46.822362] [INFO ] [MAIN ] MTDR: Wiping existing primary data before full refresh. [2025-09-17T20:26:46.822412] [INFO ] [LOCAL ] MTDR: Starting deletion of primary data. [2025-09-17T20:26:46.823618] [DEBUG] [LOCAL ] MTDR: Deleted primary data file. [2025-09-17T20:26:46.823704] [INFO ] [MAIN ] MTDR: Starting full primary refresh. [2025-09-17T20:26:47.202802] [INFO ] [REMOTE ] MTDR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:26:47.238673] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T20:26:47.615825] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-11. [2025-09-17T20:26:47.753329] [INFO ] [REMOTE ] MT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T20:26:47.760903] [INFO ] [REMOTE ] MT: Full fetch complete (73370 records). [2025-09-17T20:26:47.761147] [DEBUG] [VALIDATOR ] MT: Validating primary data. [2025-09-17T20:26:48.058685] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T20:26:48.196881] [DEBUG] [VALIDATOR ] MT: All expected trading days are present. [2025-09-17T20:26:48.196974] [DEBUG] [VALIDATOR ] MT: Primary data validation passed. [2025-09-17T20:26:48.198155] [INFO ] [MAIN ] MT: Fetched primary data is valid. [2025-09-17T20:26:48.198219] [DEBUG] [LOCAL ] MT: Saving primary data. [2025-09-17T20:26:48.199855] [DEBUG] [LOCAL ] MT: Trimmed 73370 records to 50868 (keeping 200 days of data) [2025-09-17T20:26:48.427688] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-04. [2025-09-17T20:26:48.532047] [DEBUG] [LOCAL ] MT: Primary data saved (50868 records). [2025-09-17T20:26:48.532214] [INFO ] [MAIN ] MT: Full history saved. [2025-09-17T20:26:48.533510] [INFO ] [MAIN ] Update Progress: 1415/2371 symbols completed. MT took 46.1s. Estimated remaining: 2h 19m 42s. Rate: 6.8 symbols/min [2025-09-17T20:26:48.710302] [INFO ] [MAIN ] MTG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:26:48.765042] [DEBUG] [LOCAL ] MTG: Loaded 51338 existing records from primary storage. [2025-09-17T20:26:48.765210] [INFO ] [MAIN ] MTG: Loaded 51338 existing records. [2025-09-17T20:26:48.943680] [WARN ] [MAIN ] MTG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:26:48.943972] [INFO ] [MAIN ] MTG: Wiping existing primary data before full refresh. [2025-09-17T20:26:48.944021] [INFO ] [LOCAL ] MTG: Starting deletion of primary data. [2025-09-17T20:26:48.945285] [DEBUG] [LOCAL ] MTG: Deleted primary data file. [2025-09-17T20:26:48.945338] [INFO ] [MAIN ] MTG: Starting full primary refresh. [2025-09-17T20:26:49.221001] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-08. [2025-09-17T20:26:49.318993] [INFO ] [REMOTE ] MTG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:26:49.354840] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T20:26:50.000231] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T20:26:50.015735] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-05. [2025-09-17T20:26:50.707661] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T20:26:50.815785] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2024-12. [2025-09-17T20:26:51.189429] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T20:26:51.615811] [INFO ] [REMOTE ] MTB: Fetching primary data for 2025-09. [2025-09-17T20:26:52.415861] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-06. [2025-09-17T20:26:52.644538] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T20:26:52.796227] [INFO ] [REMOTE ] MTB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T20:26:52.803236] [INFO ] [REMOTE ] MTB: Full fetch complete (68277 records). [2025-09-17T20:26:52.803449] [DEBUG] [VALIDATOR ] MTB: Validating primary data. [2025-09-17T20:26:53.220294] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-01. [2025-09-17T20:26:53.239194] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T20:26:53.239492] [DEBUG] [VALIDATOR ] MTB: All expected trading days are present. [2025-09-17T20:26:53.239735] [DEBUG] [VALIDATOR ] MTB: Primary data validation passed. [2025-09-17T20:26:53.244337] [INFO ] [MAIN ] MTB: Fetched primary data is valid. [2025-09-17T20:26:53.244927] [DEBUG] [LOCAL ] MTB: Saving primary data. [2025-09-17T20:26:53.247099] [DEBUG] [LOCAL ] MTB: Trimmed 68277 records to 47240 (keeping 200 days of data) [2025-09-17T20:26:53.581257] [DEBUG] [LOCAL ] MTB: Primary data saved (47240 records). [2025-09-17T20:26:53.581449] [INFO ] [MAIN ] MTB: Full history saved. [2025-09-17T20:26:53.581563] [INFO ] [MAIN ] Update Progress: 1416/2371 symbols completed. MTB took 35.0s. Estimated remaining: 2h 19m 31s. Rate: 6.8 symbols/min [2025-09-17T20:26:53.756472] [INFO ] [MAIN ] MTH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:26:53.803336] [DEBUG] [LOCAL ] MTH: Loaded 43964 existing records from primary storage. [2025-09-17T20:26:53.803572] [INFO ] [MAIN ] MTH: Loaded 43964 existing records. [2025-09-17T20:26:53.992362] [WARN ] [MAIN ] MTH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:26:53.992746] [INFO ] [MAIN ] MTH: Wiping existing primary data before full refresh. [2025-09-17T20:26:53.992922] [INFO ] [LOCAL ] MTH: Starting deletion of primary data. [2025-09-17T20:26:53.994456] [DEBUG] [LOCAL ] MTH: Deleted primary data file. [2025-09-17T20:26:53.994534] [INFO ] [MAIN ] MTH: Starting full primary refresh. [2025-09-17T20:26:54.022398] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-11. [2025-09-17T20:26:54.371241] [INFO ] [REMOTE ] MTH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:26:54.824771] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-11. [2025-09-17T20:26:54.831584] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T20:26:55.435127] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T20:26:55.615782] [INFO ] [REMOTE ] MTG: Fetching primary data for 2024-12. [2025-09-17T20:26:56.408799] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T20:26:56.415674] [INFO ] [REMOTE ] MTH: Fetching primary data for 2024-12. [2025-09-17T20:26:57.215788] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-02. [2025-09-17T20:26:57.391294] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T20:26:57.964344] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T20:26:58.015740] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-01. [2025-09-17T20:26:58.815776] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-01. [2025-09-17T20:26:59.083078] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T20:26:59.622635] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-03. [2025-09-17T20:26:59.627910] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T20:27:00.423317] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-02. [2025-09-17T20:27:00.428304] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T20:27:01.215797] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-07. [2025-09-17T20:27:01.445187] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T20:27:02.015815] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-02. [2025-09-17T20:27:02.205153] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T20:27:02.251394] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T20:27:02.815846] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-03. [2025-09-17T20:27:03.622268] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-04. [2025-09-17T20:27:03.645297] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T20:27:04.415794] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-08. [2025-09-17T20:27:04.624472] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T20:27:05.182623] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T20:27:05.215721] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-05. [2025-09-17T20:27:05.325976] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T20:27:06.015856] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-03. [2025-09-17T20:27:06.815788] [INFO ] [REMOTE ] MTD: Fetching primary data for 2025-09. [2025-09-17T20:27:07.233390] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T20:27:07.615797] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-04. [2025-09-17T20:27:07.641116] [INFO ] [REMOTE ] MTD: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T20:27:07.643509] [INFO ] [REMOTE ] MTD: Full fetch complete (21031 records). [2025-09-17T20:27:07.643606] [DEBUG] [VALIDATOR ] MTD: Validating primary data. [2025-09-17T20:27:08.022450] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T20:27:08.065179] [DEBUG] [VALIDATOR ] MTD: All expected trading days are present. [2025-09-17T20:27:08.065258] [DEBUG] [VALIDATOR ] MTD: Primary data validation passed. [2025-09-17T20:27:08.065712] [INFO ] [MAIN ] MTD: Fetched primary data is valid. [2025-09-17T20:27:08.065761] [DEBUG] [LOCAL ] MTD: Saving primary data. [2025-09-17T20:27:08.066330] [DEBUG] [LOCAL ] MTD: Trimmed 21031 records to 15361 (keeping 200 days of data) [2025-09-17T20:27:08.163368] [DEBUG] [LOCAL ] MTD: Primary data saved (15361 records). [2025-09-17T20:27:08.163507] [INFO ] [MAIN ] MTD: Full history saved. [2025-09-17T20:27:08.163619] [INFO ] [MAIN ] Update Progress: 1417/2371 symbols completed. MTD took 37.8s. Estimated remaining: 2h 19m 26s. Rate: 6.8 symbols/min [2025-09-17T20:27:08.334737] [INFO ] [MAIN ] MTN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:27:08.379289] [DEBUG] [LOCAL ] MTN: Loaded 39017 existing records from primary storage. [2025-09-17T20:27:08.379462] [INFO ] [MAIN ] MTN: Loaded 39017 existing records. [2025-09-17T20:27:08.422558] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-06. [2025-09-17T20:27:08.563226] [WARN ] [MAIN ] MTN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:27:08.563485] [INFO ] [MAIN ] MTN: Wiping existing primary data before full refresh. [2025-09-17T20:27:08.563535] [INFO ] [LOCAL ] MTN: Starting deletion of primary data. [2025-09-17T20:27:08.564673] [DEBUG] [LOCAL ] MTN: Deleted primary data file. [2025-09-17T20:27:08.564728] [INFO ] [MAIN ] MTN: Starting full primary refresh. [2025-09-17T20:27:08.919733] [INFO ] [REMOTE ] MTN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:27:09.215802] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-11. [2025-09-17T20:27:09.685374] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T20:27:10.015754] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-05. [2025-09-17T20:27:10.138339] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T20:27:10.724904] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T20:27:10.815755] [INFO ] [REMOTE ] MTN: Fetching primary data for 2024-12. [2025-09-17T20:27:11.615803] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-07. [2025-09-17T20:27:11.833396] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T20:27:12.175429] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T20:27:12.415856] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-04. [2025-09-17T20:27:13.215779] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-01. [2025-09-17T20:27:13.354563] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T20:27:14.015797] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-08. [2025-09-17T20:27:14.095078] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T20:27:14.514034] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T20:27:14.815793] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-06. [2025-09-17T20:27:15.615793] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-05. [2025-09-17T20:27:15.929827] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T20:27:16.075504] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T20:27:16.415784] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-07. [2025-09-17T20:27:16.875152] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T20:27:17.215778] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-02. [2025-09-17T20:27:18.015793] [INFO ] [REMOTE ] MTDR: Fetching primary data for 2025-09. [2025-09-17T20:27:18.153571] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T20:27:18.736870] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T20:27:18.815739] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-03. [2025-09-17T20:27:19.263170] [INFO ] [REMOTE ] MTDR: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T20:27:19.269752] [INFO ] [REMOTE ] MTDR: Full fetch complete (73187 records). [2025-09-17T20:27:19.269897] [DEBUG] [VALIDATOR ] MTDR: Validating primary data. [2025-09-17T20:27:19.620614] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-08. [2025-09-17T20:27:19.665281] [DEBUG] [VALIDATOR ] MTDR: All expected trading days are present. [2025-09-17T20:27:19.665372] [DEBUG] [VALIDATOR ] MTDR: Primary data validation passed. [2025-09-17T20:27:19.666439] [INFO ] [MAIN ] MTDR: Fetched primary data is valid. [2025-09-17T20:27:19.666489] [DEBUG] [LOCAL ] MTDR: Saving primary data. [2025-09-17T20:27:19.668154] [DEBUG] [LOCAL ] MTDR: Trimmed 73187 records to 51586 (keeping 200 days of data) [2025-09-17T20:27:19.993306] [DEBUG] [LOCAL ] MTDR: Primary data saved (51586 records). [2025-09-17T20:27:19.993463] [INFO ] [MAIN ] MTDR: Full history saved. [2025-09-17T20:27:19.993580] [INFO ] [MAIN ] Update Progress: 1418/2371 symbols completed. MTDR took 33.6s. Estimated remaining: 2h 19m 19s. Rate: 6.8 symbols/min [2025-09-17T20:27:20.169199] [INFO ] [MAIN ] MTR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:27:20.169449] [DEBUG] [LOCAL ] MTR: No existing data file found in primary storage. [2025-09-17T20:27:20.169586] [WARN ] [MAIN ] MTR: No existing data found, performing full refresh instead. [2025-09-17T20:27:20.169876] [INFO ] [MAIN ] MTR: Wiping existing primary data before full refresh. [2025-09-17T20:27:20.170056] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-17T20:27:20.170163] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-17T20:27:20.170271] [INFO ] [MAIN ] MTR: Starting full primary refresh. [2025-09-17T20:27:20.417176] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-06. [2025-09-17T20:27:20.539128] [INFO ] [REMOTE ] MTR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:27:20.560816] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T20:27:21.215848] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-11. [2025-09-17T20:27:21.403974] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T20:27:21.811116] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T20:27:22.015765] [INFO ] [REMOTE ] MTG: Fetching primary data for 2025-09. [2025-09-17T20:27:22.098155] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T20:27:22.815791] [INFO ] [REMOTE ] MTR: Fetching primary data for 2024-12. [2025-09-17T20:27:23.303748] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2024-12 (0.49 seconds). [2025-09-17T20:27:23.543639] [INFO ] [REMOTE ] MTG: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T20:27:23.552933] [INFO ] [REMOTE ] MTG: Full fetch complete (73679 records). [2025-09-17T20:27:23.553238] [DEBUG] [VALIDATOR ] MTG: Validating primary data. [2025-09-17T20:27:23.620965] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-01. [2025-09-17T20:27:23.983030] [DEBUG] [VALIDATOR ] MTG: All expected trading days are present. [2025-09-17T20:27:23.983125] [DEBUG] [VALIDATOR ] MTG: Primary data validation passed. [2025-09-17T20:27:23.984189] [INFO ] [MAIN ] MTG: Fetched primary data is valid. [2025-09-17T20:27:23.984249] [DEBUG] [LOCAL ] MTG: Saving primary data. [2025-09-17T20:27:23.985831] [DEBUG] [LOCAL ] MTG: Trimmed 73679 records to 51357 (keeping 200 days of data) [2025-09-17T20:27:24.186050] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T20:27:24.321977] [DEBUG] [LOCAL ] MTG: Primary data saved (51357 records). [2025-09-17T20:27:24.322149] [INFO ] [MAIN ] MTG: Full history saved. [2025-09-17T20:27:24.322771] [INFO ] [MAIN ] Update Progress: 1419/2371 symbols completed. MTG took 35.8s. Estimated remaining: 2h 19m 8s. Rate: 6.8 symbols/min [2025-09-17T20:27:24.423681] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-04. [2025-09-17T20:27:24.509536] [INFO ] [MAIN ] MTRN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:27:24.529775] [DEBUG] [LOCAL ] MTRN: Loaded 17790 existing records from primary storage. [2025-09-17T20:27:24.529917] [INFO ] [MAIN ] MTRN: Loaded 17790 existing records. [2025-09-17T20:27:24.709115] [WARN ] [MAIN ] MTRN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:27:24.709398] [INFO ] [MAIN ] MTRN: Wiping existing primary data before full refresh. [2025-09-17T20:27:24.709444] [INFO ] [LOCAL ] MTRN: Starting deletion of primary data. [2025-09-17T20:27:24.710166] [DEBUG] [LOCAL ] MTRN: Deleted primary data file. [2025-09-17T20:27:24.710218] [INFO ] [MAIN ] MTRN: Starting full primary refresh. [2025-09-17T20:27:25.072403] [INFO ] [REMOTE ] MTRN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:27:25.215887] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-07. [2025-09-17T20:27:26.015887] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-02. [2025-09-17T20:27:26.140753] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T20:27:26.450186] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T20:27:26.815807] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-05. [2025-09-17T20:27:26.972962] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T20:27:27.615788] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-11. [2025-09-17T20:27:28.394282] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T20:27:28.415723] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-06. [2025-09-17T20:27:28.594620] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T20:27:29.215832] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-03. [2025-09-17T20:27:29.621771] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-17T20:27:30.020868] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2024-12. [2025-09-17T20:27:30.036314] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T20:27:30.815840] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-08. [2025-09-17T20:27:30.946524] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T20:27:31.615831] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-01. [2025-09-17T20:27:32.415765] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-07. [2025-09-17T20:27:32.443562] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T20:27:32.555579] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T20:27:33.215841] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-04. [2025-09-17T20:27:33.661890] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T20:27:34.015849] [INFO ] [REMOTE ] MTH: Fetching primary data for 2025-09. [2025-09-17T20:27:34.096151] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T20:27:34.815816] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-08. [2025-09-17T20:27:35.324311] [INFO ] [REMOTE ] MTH: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T20:27:35.330265] [INFO ] [REMOTE ] MTH: Full fetch complete (61993 records). [2025-09-17T20:27:35.330387] [DEBUG] [VALIDATOR ] MTH: Validating primary data. [2025-09-17T20:27:35.622120] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-05. [2025-09-17T20:27:35.728545] [DEBUG] [VALIDATOR ] MTH: All expected trading days are present. [2025-09-17T20:27:35.728686] [DEBUG] [VALIDATOR ] MTH: Primary data validation passed. [2025-09-17T20:27:35.729796] [INFO ] [MAIN ] MTH: Fetched primary data is valid. [2025-09-17T20:27:35.729849] [DEBUG] [LOCAL ] MTH: Saving primary data. [2025-09-17T20:27:35.731456] [DEBUG] [LOCAL ] MTH: Trimmed 61993 records to 43964 (keeping 200 days of data) [2025-09-17T20:27:36.011163] [DEBUG] [LOCAL ] MTH: Primary data saved (43964 records). [2025-09-17T20:27:36.011291] [INFO ] [MAIN ] MTH: Full history saved. [2025-09-17T20:27:36.011383] [INFO ] [MAIN ] Update Progress: 1420/2371 symbols completed. MTH took 42.4s. Estimated remaining: 2h 19m 1s. Rate: 6.8 symbols/min [2025-09-17T20:27:36.115960] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T20:27:36.224460] [INFO ] [MAIN ] MTUS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:27:36.256306] [DEBUG] [LOCAL ] MTUS: Loaded 29113 existing records from primary storage. [2025-09-17T20:27:36.256470] [INFO ] [MAIN ] MTUS: Loaded 29113 existing records. [2025-09-17T20:27:36.431882] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-06. [2025-09-17T20:27:36.481027] [WARN ] [MAIN ] MTUS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:27:36.483212] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T20:27:36.490675] [INFO ] [MAIN ] MTUS: Wiping existing primary data before full refresh. [2025-09-17T20:27:36.491198] [INFO ] [LOCAL ] MTUS: Starting deletion of primary data. [2025-09-17T20:27:36.491828] [DEBUG] [LOCAL ] MTUS: Deleted primary data file. [2025-09-17T20:27:36.491879] [INFO ] [MAIN ] MTUS: Starting full primary refresh. [2025-09-17T20:27:36.851885] [INFO ] [REMOTE ] MTUS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:27:37.215813] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-02. [2025-09-17T20:27:37.346966] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T20:27:38.015779] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-07. [2025-09-17T20:27:38.196110] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T20:27:38.539207] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T20:27:38.815818] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-11. [2025-09-17T20:27:39.615790] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-03. [2025-09-17T20:27:40.158226] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T20:27:40.415798] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2024-12. [2025-09-17T20:27:40.725689] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T20:27:41.215800] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-04. [2025-09-17T20:27:41.680554] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T20:27:42.015746] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-01. [2025-09-17T20:27:42.385070] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T20:27:42.815795] [INFO ] [REMOTE ] MTN: Fetching primary data for 2025-09. [2025-09-17T20:27:43.377059] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T20:27:43.615829] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-08. [2025-09-17T20:27:43.811866] [INFO ] [REMOTE ] MTN: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T20:27:43.817252] [INFO ] [REMOTE ] MTN: Full fetch complete (56149 records). [2025-09-17T20:27:43.817393] [DEBUG] [VALIDATOR ] MTN: Validating primary data. [2025-09-17T20:27:44.118694] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T20:27:44.238310] [DEBUG] [VALIDATOR ] MTN: All expected trading days are present. [2025-09-17T20:27:44.238425] [DEBUG] [VALIDATOR ] MTN: Primary data validation passed. [2025-09-17T20:27:44.239737] [INFO ] [MAIN ] MTN: Fetched primary data is valid. [2025-09-17T20:27:44.239820] [DEBUG] [LOCAL ] MTN: Saving primary data. [2025-09-17T20:27:44.241362] [DEBUG] [LOCAL ] MTN: Trimmed 56149 records to 39038 (keeping 200 days of data) [2025-09-17T20:27:44.421154] [INFO ] [REMOTE ] MTR: Fetching primary data for 2025-09. [2025-09-17T20:27:44.494261] [DEBUG] [LOCAL ] MTN: Primary data saved (39038 records). [2025-09-17T20:27:44.494436] [INFO ] [MAIN ] MTN: Full history saved. [2025-09-17T20:27:44.494544] [INFO ] [MAIN ] Update Progress: 1421/2371 symbols completed. MTN took 36.3s. Estimated remaining: 2h 18m 52s. Rate: 6.8 symbols/min [2025-09-17T20:27:44.663477] [INFO ] [MAIN ] MTW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:27:44.689707] [DEBUG] [LOCAL ] MTW: Loaded 26679 existing records from primary storage. [2025-09-17T20:27:44.689863] [INFO ] [MAIN ] MTW: Loaded 26679 existing records. [2025-09-17T20:27:44.857497] [INFO ] [REMOTE ] MTR: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T20:27:44.881067] [INFO ] [REMOTE ] MTR: Full fetch complete (2611 records). [2025-09-17T20:27:44.881258] [WARN ] [MAIN ] MTW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:27:44.881561] [DEBUG] [VALIDATOR ] MTR: Validating primary data. [2025-09-17T20:27:44.926988] [INFO ] [MAIN ] MTW: Wiping existing primary data before full refresh. [2025-09-17T20:27:44.959374] [INFO ] [LOCAL ] MTW: Starting deletion of primary data. [2025-09-17T20:27:44.985423] [DEBUG] [LOCAL ] MTW: Deleted primary data file. [2025-09-17T20:27:44.985595] [INFO ] [MAIN ] MTW: Starting full primary refresh. [2025-09-17T20:27:45.189485] [WARN ] [VALIDATOR ] MTR: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T20:27:45.218279] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-02. [2025-09-17T20:27:45.218449] [FATAL] [MAIN ] MTR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:27:45.259270] [WARN ] [MAIN ] MTR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:27:45.318047] [INFO ] [LOCAL ] MTR: Starting deletion of primary data. [2025-09-17T20:27:45.323852] [DEBUG] [LOCAL ] MTR: No primary data file found to delete. [2025-09-17T20:27:45.334728] [INFO ] [LOCAL ] MTR: Starting deletion of derivative data. [2025-09-17T20:27:45.353365] [DEBUG] [LOCAL ] MTR: No derivative data file found to delete. [2025-09-17T20:27:45.355728] [INFO ] [MAIN ] Update Progress: 1422/2371 symbols completed. MTR took 25.4s. Estimated remaining: 2h 18m 38s. Rate: 6.8 symbols/min [2025-09-17T20:27:45.545615] [INFO ] [REMOTE ] MTW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:27:45.609908] [INFO ] [MAIN ] MTX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:27:45.632873] [DEBUG] [LOCAL ] MTX: Loaded 22887 existing records from primary storage. [2025-09-17T20:27:45.633029] [INFO ] [MAIN ] MTX: Loaded 22887 existing records. [2025-09-17T20:27:45.807666] [WARN ] [MAIN ] MTX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:27:45.807936] [INFO ] [MAIN ] MTX: Wiping existing primary data before full refresh. [2025-09-17T20:27:45.807983] [INFO ] [LOCAL ] MTX: Starting deletion of primary data. [2025-09-17T20:27:45.808535] [DEBUG] [LOCAL ] MTX: Deleted primary data file. [2025-09-17T20:27:45.808583] [INFO ] [MAIN ] MTX: Starting full primary refresh. [2025-09-17T20:27:46.021359] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-11. [2025-09-17T20:27:46.171184] [INFO ] [REMOTE ] MTX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:27:46.446277] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T20:27:46.815798] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-11. [2025-09-17T20:27:47.500496] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T20:27:47.615734] [INFO ] [REMOTE ] MTW: Fetching primary data for 2024-12. [2025-09-17T20:27:47.865342] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T20:27:48.415803] [INFO ] [REMOTE ] MTX: Fetching primary data for 2024-12. [2025-09-17T20:27:48.914012] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T20:27:49.215818] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-05. [2025-09-17T20:27:49.467167] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T20:27:50.015777] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-01. [2025-09-17T20:27:50.450995] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T20:27:50.815756] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-03. [2025-09-17T20:27:51.085401] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T20:27:51.615781] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-06. [2025-09-17T20:27:52.307445] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T20:27:52.415777] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-04. [2025-09-17T20:27:52.630034] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T20:27:53.215783] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-07. [2025-09-17T20:27:53.813015] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T20:27:54.023587] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-01. [2025-09-17T20:27:54.027543] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T20:27:54.815756] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-05. [2025-09-17T20:27:55.210013] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T20:27:55.615825] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-08. [2025-09-17T20:27:56.294883] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T20:27:56.415770] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-06. [2025-09-17T20:27:56.724504] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T20:27:57.215828] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-02. [2025-09-17T20:27:57.561207] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T20:27:58.015795] [INFO ] [REMOTE ] MTRN: Fetching primary data for 2025-09. [2025-09-17T20:27:58.280043] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T20:27:58.815814] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-07. [2025-09-17T20:27:58.923255] [INFO ] [REMOTE ] MTRN: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T20:27:58.925607] [INFO ] [REMOTE ] MTRN: Full fetch complete (22959 records). [2025-09-17T20:27:58.925778] [DEBUG] [VALIDATOR ] MTRN: Validating primary data. [2025-09-17T20:27:59.300221] [DEBUG] [VALIDATOR ] MTRN: All expected trading days are present. [2025-09-17T20:27:59.300304] [DEBUG] [VALIDATOR ] MTRN: Primary data validation passed. [2025-09-17T20:27:59.301005] [INFO ] [MAIN ] MTRN: Fetched primary data is valid. [2025-09-17T20:27:59.301059] [DEBUG] [LOCAL ] MTRN: Saving primary data. [2025-09-17T20:27:59.302089] [DEBUG] [LOCAL ] MTRN: Trimmed 22959 records to 17880 (keeping 200 days of data) [2025-09-17T20:27:59.422343] [DEBUG] [LOCAL ] MTRN: Primary data saved (17880 records). [2025-09-17T20:27:59.422488] [INFO ] [MAIN ] MTRN: Full history saved. [2025-09-17T20:27:59.422595] [INFO ] [MAIN ] Update Progress: 1423/2371 symbols completed. MTRN took 35.1s. Estimated remaining: 2h 18m 33s. Rate: 6.8 symbols/min [2025-09-17T20:27:59.596749] [INFO ] [MAIN ] MTZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:27:59.624042] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-02. [2025-09-17T20:27:59.645224] [DEBUG] [LOCAL ] MTZ: Loaded 43668 existing records from primary storage. [2025-09-17T20:27:59.645417] [INFO ] [MAIN ] MTZ: Loaded 43668 existing records. [2025-09-17T20:27:59.826451] [WARN ] [MAIN ] MTZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:27:59.826758] [INFO ] [MAIN ] MTZ: Wiping existing primary data before full refresh. [2025-09-17T20:27:59.826806] [INFO ] [LOCAL ] MTZ: Starting deletion of primary data. [2025-09-17T20:27:59.827609] [DEBUG] [LOCAL ] MTZ: Deleted primary data file. [2025-09-17T20:27:59.827685] [INFO ] [MAIN ] MTZ: Starting full primary refresh. [2025-09-17T20:28:00.209515] [INFO ] [REMOTE ] MTZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:28:00.211475] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T20:28:00.415792] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-08. [2025-09-17T20:28:00.791422] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T20:28:01.215816] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-03. [2025-09-17T20:28:01.526402] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T20:28:02.015814] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-03. [2025-09-17T20:28:02.575168] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T20:28:02.815694] [INFO ] [REMOTE ] MTUS: Fetching primary data for 2025-09. [2025-09-17T20:28:03.216637] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T20:28:03.615783] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-04. [2025-09-17T20:28:03.883306] [INFO ] [REMOTE ] MTUS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T20:28:03.887364] [INFO ] [REMOTE ] MTUS: Full fetch complete (42934 records). [2025-09-17T20:28:03.887475] [DEBUG] [VALIDATOR ] MTUS: Validating primary data. [2025-09-17T20:28:04.283326] [DEBUG] [VALIDATOR ] MTUS: All expected trading days are present. [2025-09-17T20:28:04.283430] [DEBUG] [VALIDATOR ] MTUS: Primary data validation passed. [2025-09-17T20:28:04.284371] [INFO ] [MAIN ] MTUS: Fetched primary data is valid. [2025-09-17T20:28:04.284462] [DEBUG] [LOCAL ] MTUS: Saving primary data. [2025-09-17T20:28:04.285635] [DEBUG] [LOCAL ] MTUS: Trimmed 42934 records to 29010 (keeping 200 days of data) [2025-09-17T20:28:04.425008] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-11. [2025-09-17T20:28:04.457303] [DEBUG] [LOCAL ] MTUS: Primary data saved (29010 records). [2025-09-17T20:28:04.457467] [INFO ] [MAIN ] MTUS: Full history saved. [2025-09-17T20:28:04.457563] [INFO ] [MAIN ] Update Progress: 1424/2371 symbols completed. MTUS took 28.4s. Estimated remaining: 2h 18m 21s. Rate: 6.8 symbols/min [2025-09-17T20:28:04.628755] [INFO ] [MAIN ] MUA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:28:04.642397] [DEBUG] [LOCAL ] MUA: Loaded 12349 existing records from primary storage. [2025-09-17T20:28:04.642523] [INFO ] [MAIN ] MUA: Loaded 12349 existing records. [2025-09-17T20:28:04.825759] [WARN ] [MAIN ] MUA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:28:04.826273] [INFO ] [MAIN ] MUA: Wiping existing primary data before full refresh. [2025-09-17T20:28:04.826437] [INFO ] [LOCAL ] MUA: Starting deletion of primary data. [2025-09-17T20:28:04.826927] [DEBUG] [LOCAL ] MUA: Deleted primary data file. [2025-09-17T20:28:04.827045] [INFO ] [MAIN ] MUA: Starting full primary refresh. [2025-09-17T20:28:04.955148] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T20:28:05.219725] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-05. [2025-09-17T20:28:05.245040] [INFO ] [REMOTE ] MUA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:28:05.841764] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T20:28:06.015828] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-11. [2025-09-17T20:28:06.601191] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T20:28:06.815813] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-04. [2025-09-17T20:28:06.865528] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T20:28:07.615832] [INFO ] [REMOTE ] MUA: Fetching primary data for 2024-12. [2025-09-17T20:28:08.136105] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T20:28:08.415810] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2024-12. [2025-09-17T20:28:08.505413] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T20:28:09.215831] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-01. [2025-09-17T20:28:10.021478] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-05. [2025-09-17T20:28:10.046916] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T20:28:10.056924] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T20:28:10.815845] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-06. [2025-09-17T20:28:11.342348] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T20:28:11.615817] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-06. [2025-09-17T20:28:12.038624] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T20:28:12.415807] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-02. [2025-09-17T20:28:12.809007] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T20:28:13.215800] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-07. [2025-09-17T20:28:13.435834] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T20:28:14.015782] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-07. [2025-09-17T20:28:14.375591] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T20:28:14.815784] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-01. [2025-09-17T20:28:15.353766] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T20:28:15.615807] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-03. [2025-09-17T20:28:16.415771] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-08. [2025-09-17T20:28:16.496860] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T20:28:16.586126] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T20:28:17.215795] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-02. [2025-09-17T20:28:17.487195] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T20:28:18.015783] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-04. [2025-09-17T20:28:18.823369] [INFO ] [REMOTE ] MTX: Fetching primary data for 2025-09. [2025-09-17T20:28:18.828669] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T20:28:19.074473] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T20:28:19.615778] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-03. [2025-09-17T20:28:19.819583] [INFO ] [REMOTE ] MTX: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T20:28:19.822657] [INFO ] [REMOTE ] MTX: Full fetch complete (30886 records). [2025-09-17T20:28:19.822737] [DEBUG] [VALIDATOR ] MTX: Validating primary data. [2025-09-17T20:28:20.206169] [DEBUG] [VALIDATOR ] MTX: All expected trading days are present. [2025-09-17T20:28:20.206264] [DEBUG] [VALIDATOR ] MTX: Primary data validation passed. [2025-09-17T20:28:20.207043] [INFO ] [MAIN ] MTX: Fetched primary data is valid. [2025-09-17T20:28:20.207126] [DEBUG] [LOCAL ] MTX: Saving primary data. [2025-09-17T20:28:20.208161] [DEBUG] [LOCAL ] MTX: Trimmed 30886 records to 22852 (keeping 200 days of data) [2025-09-17T20:28:20.353795] [DEBUG] [LOCAL ] MTX: Primary data saved (22852 records). [2025-09-17T20:28:20.353975] [INFO ] [MAIN ] MTX: Full history saved. [2025-09-17T20:28:20.354075] [INFO ] [MAIN ] Update Progress: 1425/2371 symbols completed. MTX took 35.0s. Estimated remaining: 2h 18m 17s. Rate: 6.8 symbols/min [2025-09-17T20:28:20.420851] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-05. [2025-09-17T20:28:20.531624] [INFO ] [MAIN ] MUC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:28:20.552129] [DEBUG] [LOCAL ] MUC: Loaded 20044 existing records from primary storage. [2025-09-17T20:28:20.552303] [INFO ] [MAIN ] MUC: Loaded 20044 existing records. [2025-09-17T20:28:20.730712] [WARN ] [MAIN ] MUC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:28:20.731022] [INFO ] [MAIN ] MUC: Wiping existing primary data before full refresh. [2025-09-17T20:28:20.731070] [INFO ] [LOCAL ] MUC: Starting deletion of primary data. [2025-09-17T20:28:20.731791] [DEBUG] [LOCAL ] MUC: Deleted primary data file. [2025-09-17T20:28:20.731842] [INFO ] [MAIN ] MUC: Starting full primary refresh. [2025-09-17T20:28:21.097555] [INFO ] [REMOTE ] MUC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:28:21.160365] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T20:28:21.215789] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-04. [2025-09-17T20:28:21.325099] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T20:28:22.015790] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-08. [2025-09-17T20:28:22.815791] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-06. [2025-09-17T20:28:23.035068] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T20:28:23.355079] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T20:28:23.615775] [INFO ] [REMOTE ] MTW: Fetching primary data for 2025-09. [2025-09-17T20:28:23.663773] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T20:28:24.415790] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-05. [2025-09-17T20:28:24.695725] [INFO ] [REMOTE ] MTW: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T20:28:24.699781] [INFO ] [REMOTE ] MTW: Full fetch complete (38348 records). [2025-09-17T20:28:24.699958] [DEBUG] [VALIDATOR ] MTW: Validating primary data. [2025-09-17T20:28:25.177530] [DEBUG] [VALIDATOR ] MTW: All expected trading days are present. [2025-09-17T20:28:25.177698] [DEBUG] [VALIDATOR ] MTW: Primary data validation passed. [2025-09-17T20:28:25.179315] [INFO ] [MAIN ] MTW: Fetched primary data is valid. [2025-09-17T20:28:25.179403] [DEBUG] [LOCAL ] MTW: Saving primary data. [2025-09-17T20:28:25.180963] [DEBUG] [LOCAL ] MTW: Trimmed 38348 records to 26664 (keeping 200 days of data) [2025-09-17T20:28:25.259977] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-07. [2025-09-17T20:28:25.435428] [DEBUG] [LOCAL ] MTW: Primary data saved (26664 records). [2025-09-17T20:28:25.435663] [INFO ] [MAIN ] MTW: Full history saved. [2025-09-17T20:28:25.435818] [INFO ] [MAIN ] Update Progress: 1426/2371 symbols completed. MTW took 40.9s. Estimated remaining: 2h 18m 6s. Rate: 6.8 symbols/min [2025-09-17T20:28:25.696104] [INFO ] [MAIN ] MUE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:28:25.710294] [DEBUG] [LOCAL ] MUE: Loaded 11893 existing records from primary storage. [2025-09-17T20:28:25.710466] [INFO ] [MAIN ] MUE: Loaded 11893 existing records. [2025-09-17T20:28:25.928889] [WARN ] [MAIN ] MUE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:28:25.929211] [INFO ] [MAIN ] MUE: Wiping existing primary data before full refresh. [2025-09-17T20:28:25.929272] [INFO ] [LOCAL ] MUE: Starting deletion of primary data. [2025-09-17T20:28:25.929723] [DEBUG] [LOCAL ] MUE: Deleted primary data file. [2025-09-17T20:28:25.929775] [INFO ] [MAIN ] MUE: Starting full primary refresh. [2025-09-17T20:28:26.021940] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-11. [2025-09-17T20:28:26.230559] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T20:28:26.300455] [INFO ] [REMOTE ] MUE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:28:26.330515] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T20:28:26.815797] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-08. [2025-09-17T20:28:27.279794] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T20:28:27.615780] [INFO ] [REMOTE ] MUC: Fetching primary data for 2024-12. [2025-09-17T20:28:27.763506] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T20:28:28.415769] [INFO ] [REMOTE ] MUA: Fetching primary data for 2025-09. [2025-09-17T20:28:28.761219] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T20:28:29.215863] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-11. [2025-09-17T20:28:29.292739] [INFO ] [REMOTE ] MUA: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T20:28:29.294920] [INFO ] [REMOTE ] MUA: Full fetch complete (18767 records). [2025-09-17T20:28:29.295012] [DEBUG] [VALIDATOR ] MUA: Validating primary data. [2025-09-17T20:28:29.703223] [DEBUG] [VALIDATOR ] MUA: All expected trading days are present. [2025-09-17T20:28:29.703344] [DEBUG] [VALIDATOR ] MUA: Primary data validation passed. [2025-09-17T20:28:29.703935] [INFO ] [MAIN ] MUA: Fetched primary data is valid. [2025-09-17T20:28:29.704007] [DEBUG] [LOCAL ] MUA: Saving primary data. [2025-09-17T20:28:29.704754] [DEBUG] [LOCAL ] MUA: Trimmed 18767 records to 12449 (keeping 200 days of data) [2025-09-17T20:28:29.790198] [DEBUG] [LOCAL ] MUA: Primary data saved (12449 records). [2025-09-17T20:28:29.790367] [INFO ] [MAIN ] MUA: Full history saved. [2025-09-17T20:28:29.790468] [INFO ] [MAIN ] Update Progress: 1427/2371 symbols completed. MUA took 25.3s. Estimated remaining: 2h 17m 54s. Rate: 6.8 symbols/min [2025-09-17T20:28:29.955125] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T20:28:29.988489] [INFO ] [MAIN ] MUFG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:28:30.026077] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-01. [2025-09-17T20:28:30.056782] [DEBUG] [LOCAL ] MUFG: Loaded 52681 existing records from primary storage. [2025-09-17T20:28:30.057023] [INFO ] [MAIN ] MUFG: Loaded 52681 existing records. [2025-09-17T20:28:30.263500] [WARN ] [MAIN ] MUFG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:28:30.263881] [INFO ] [MAIN ] MUFG: Wiping existing primary data before full refresh. [2025-09-17T20:28:30.263937] [INFO ] [LOCAL ] MUFG: Starting deletion of primary data. [2025-09-17T20:28:30.265305] [DEBUG] [LOCAL ] MUFG: Deleted primary data file. [2025-09-17T20:28:30.265370] [INFO ] [MAIN ] MUFG: Starting full primary refresh. [2025-09-17T20:28:30.640284] [INFO ] [REMOTE ] MUFG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:28:30.815808] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-06. [2025-09-17T20:28:31.252687] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T20:28:31.615838] [INFO ] [REMOTE ] MUE: Fetching primary data for 2024-12. [2025-09-17T20:28:32.170717] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T20:28:32.415773] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-07. [2025-09-17T20:28:32.662454] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T20:28:33.215821] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-01. [2025-09-17T20:28:34.016819] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-11. [2025-09-17T20:28:34.019599] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T20:28:34.070860] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T20:28:34.815827] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-02. [2025-09-17T20:28:35.615857] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-02. [2025-09-17T20:28:35.741174] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T20:28:35.775684] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T20:28:36.415780] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-08. [2025-09-17T20:28:36.442437] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T20:28:37.215826] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2024-12. [2025-09-17T20:28:38.015802] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-03. [2025-09-17T20:28:38.289085] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T20:28:38.815832] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-03. [2025-09-17T20:28:38.888001] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T20:28:39.062434] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T20:28:39.615762] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-04. [2025-09-17T20:28:39.936837] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T20:28:40.415769] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-04. [2025-09-17T20:28:40.485460] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T20:28:41.215757] [INFO ] [REMOTE ] MTZ: Fetching primary data for 2025-09. [2025-09-17T20:28:41.413766] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T20:28:42.015779] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-01. [2025-09-17T20:28:42.720702] [INFO ] [REMOTE ] MTZ: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T20:28:42.726488] [INFO ] [REMOTE ] MTZ: Full fetch complete (63224 records). [2025-09-17T20:28:42.726707] [DEBUG] [VALIDATOR ] MTZ: Validating primary data. [2025-09-17T20:28:42.825211] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-05. [2025-09-17T20:28:43.147149] [DEBUG] [VALIDATOR ] MTZ: All expected trading days are present. [2025-09-17T20:28:43.147277] [DEBUG] [VALIDATOR ] MTZ: Primary data validation passed. [2025-09-17T20:28:43.148598] [INFO ] [MAIN ] MTZ: Fetched primary data is valid. [2025-09-17T20:28:43.148728] [DEBUG] [LOCAL ] MTZ: Saving primary data. [2025-09-17T20:28:43.150859] [DEBUG] [LOCAL ] MTZ: Trimmed 63224 records to 43609 (keeping 200 days of data) [2025-09-17T20:28:43.440299] [DEBUG] [LOCAL ] MTZ: Primary data saved (43609 records). [2025-09-17T20:28:43.440508] [INFO ] [MAIN ] MTZ: Full history saved. [2025-09-17T20:28:43.441432] [INFO ] [MAIN ] Update Progress: 1428/2371 symbols completed. MTZ took 44.0s. Estimated remaining: 2h 17m 49s. Rate: 6.8 symbols/min [2025-09-17T20:28:43.629054] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-05. [2025-09-17T20:28:43.685528] [INFO ] [MAIN ] MUJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:28:43.705661] [DEBUG] [LOCAL ] MUJ: Loaded 13133 existing records from primary storage. [2025-09-17T20:28:43.705814] [INFO ] [MAIN ] MUJ: Loaded 13133 existing records. [2025-09-17T20:28:43.871326] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T20:28:43.945068] [WARN ] [MAIN ] MUJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:28:43.946963] [INFO ] [MAIN ] MUJ: Wiping existing primary data before full refresh. [2025-09-17T20:28:43.946802] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T20:28:43.950185] [INFO ] [LOCAL ] MUJ: Starting deletion of primary data. [2025-09-17T20:28:43.951038] [DEBUG] [LOCAL ] MUJ: Deleted primary data file. [2025-09-17T20:28:43.951103] [INFO ] [MAIN ] MUJ: Starting full primary refresh. [2025-09-17T20:28:44.326263] [INFO ] [REMOTE ] MUJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:28:44.415778] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-11. [2025-09-17T20:28:44.700082] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T20:28:45.215803] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-02. [2025-09-17T20:28:45.412947] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T20:28:46.015787] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2024-12. [2025-09-17T20:28:46.773947] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T20:28:46.815804] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-06. [2025-09-17T20:28:47.185774] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T20:28:47.615818] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-06. [2025-09-17T20:28:47.817868] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T20:28:48.415769] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-03. [2025-09-17T20:28:48.689272] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T20:28:49.215819] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-07. [2025-09-17T20:28:50.015796] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-01. [2025-09-17T20:28:50.393827] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T20:28:50.439816] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T20:28:50.693062] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T20:28:50.815788] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-02. [2025-09-17T20:28:51.615781] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-08. [2025-09-17T20:28:51.647995] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T20:28:52.415689] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-03. [2025-09-17T20:28:52.598128] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T20:28:53.215802] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-04. [2025-09-17T20:28:53.249773] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T20:28:54.015778] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-04. [2025-09-17T20:28:54.815813] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-07. [2025-09-17T20:28:54.905255] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T20:28:55.256285] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T20:28:55.615795] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-05. [2025-09-17T20:28:55.739635] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T20:28:56.415785] [INFO ] [REMOTE ] MUC: Fetching primary data for 2025-09. [2025-09-17T20:28:56.491558] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T20:28:57.215830] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-05. [2025-09-17T20:28:57.278374] [INFO ] [REMOTE ] MUC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T20:28:57.281535] [INFO ] [REMOTE ] MUC: Full fetch complete (30044 records). [2025-09-17T20:28:57.281667] [DEBUG] [VALIDATOR ] MUC: Validating primary data. [2025-09-17T20:28:57.659053] [DEBUG] [VALIDATOR ] MUC: All expected trading days are present. [2025-09-17T20:28:57.659132] [DEBUG] [VALIDATOR ] MUC: Primary data validation passed. [2025-09-17T20:28:57.659746] [INFO ] [MAIN ] MUC: Fetched primary data is valid. [2025-09-17T20:28:57.659790] [DEBUG] [LOCAL ] MUC: Saving primary data. [2025-09-17T20:28:57.661351] [DEBUG] [LOCAL ] MUC: Trimmed 30044 records to 20141 (keeping 200 days of data) [2025-09-17T20:28:57.795427] [DEBUG] [LOCAL ] MUC: Primary data saved (20141 records). [2025-09-17T20:28:57.795570] [INFO ] [MAIN ] MUC: Full history saved. [2025-09-17T20:28:57.795697] [INFO ] [MAIN ] Update Progress: 1429/2371 symbols completed. MUC took 37.4s. Estimated remaining: 2h 17m 44s. Rate: 6.8 symbols/min [2025-09-17T20:28:57.964790] [INFO ] [MAIN ] MUR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:28:58.026742] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-06. [2025-09-17T20:28:58.031734] [DEBUG] [LOCAL ] MUR: Loaded 52946 existing records from primary storage. [2025-09-17T20:28:58.031969] [INFO ] [MAIN ] MUR: Loaded 52946 existing records. [2025-09-17T20:28:58.218417] [WARN ] [MAIN ] MUR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:28:58.218953] [INFO ] [MAIN ] MUR: Wiping existing primary data before full refresh. [2025-09-17T20:28:58.219038] [INFO ] [LOCAL ] MUR: Starting deletion of primary data. [2025-09-17T20:28:58.220176] [DEBUG] [LOCAL ] MUR: Deleted primary data file. [2025-09-17T20:28:58.220244] [INFO ] [MAIN ] MUR: Starting full primary refresh. [2025-09-17T20:28:58.574709] [INFO ] [REMOTE ] MUR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:28:58.815750] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-08. [2025-09-17T20:28:59.158507] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T20:28:59.177732] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T20:28:59.615821] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-07. [2025-09-17T20:28:59.819196] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T20:29:00.415783] [INFO ] [REMOTE ] MUE: Fetching primary data for 2025-09. [2025-09-17T20:29:00.457261] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T20:29:01.130502] [INFO ] [REMOTE ] MUE: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T20:29:01.132799] [INFO ] [REMOTE ] MUE: Full fetch complete (16290 records). [2025-09-17T20:29:01.132885] [DEBUG] [VALIDATOR ] MUE: Validating primary data. [2025-09-17T20:29:01.220867] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-06. [2025-09-17T20:29:01.500890] [DEBUG] [VALIDATOR ] MUE: All expected trading days are present. [2025-09-17T20:29:01.500970] [DEBUG] [VALIDATOR ] MUE: Primary data validation passed. [2025-09-17T20:29:01.501332] [INFO ] [MAIN ] MUE: Fetched primary data is valid. [2025-09-17T20:29:01.501371] [DEBUG] [LOCAL ] MUE: Saving primary data. [2025-09-17T20:29:01.501894] [DEBUG] [LOCAL ] MUE: Trimmed 16290 records to 11938 (keeping 200 days of data) [2025-09-17T20:29:01.576726] [DEBUG] [LOCAL ] MUE: Primary data saved (11938 records). [2025-09-17T20:29:01.576887] [INFO ] [MAIN ] MUE: Full history saved. [2025-09-17T20:29:01.576997] [INFO ] [MAIN ] Update Progress: 1430/2371 symbols completed. MUE took 36.1s. Estimated remaining: 2h 17m 32s. Rate: 6.8 symbols/min [2025-09-17T20:29:01.753938] [INFO ] [MAIN ] MUSA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:29:01.781032] [DEBUG] [LOCAL ] MUSA: Loaded 25138 existing records from primary storage. [2025-09-17T20:29:01.781163] [INFO ] [MAIN ] MUSA: Loaded 25138 existing records. [2025-09-17T20:29:01.960983] [WARN ] [MAIN ] MUSA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:29:01.961341] [INFO ] [MAIN ] MUSA: Wiping existing primary data before full refresh. [2025-09-17T20:29:01.961411] [INFO ] [LOCAL ] MUSA: Starting deletion of primary data. [2025-09-17T20:29:01.962179] [DEBUG] [LOCAL ] MUSA: Deleted primary data file. [2025-09-17T20:29:01.962255] [INFO ] [MAIN ] MUSA: Starting full primary refresh. [2025-09-17T20:29:02.028180] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-11. [2025-09-17T20:29:02.326376] [INFO ] [REMOTE ] MUSA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:29:02.815788] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-11. [2025-09-17T20:29:02.980302] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T20:29:03.615747] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-07. [2025-09-17T20:29:03.716411] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T20:29:03.899688] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T20:29:04.415766] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-08. [2025-09-17T20:29:05.082687] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T20:29:05.215794] [INFO ] [REMOTE ] MUR: Fetching primary data for 2024-12. [2025-09-17T20:29:05.556075] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T20:29:06.015798] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2024-12. [2025-09-17T20:29:06.818155] [INFO ] [REMOTE ] MUJ: Fetching primary data for 2025-09. [2025-09-17T20:29:06.823593] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T20:29:07.154460] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T20:29:07.615774] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-08. [2025-09-17T20:29:07.716076] [INFO ] [REMOTE ] MUJ: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T20:29:07.718815] [INFO ] [REMOTE ] MUJ: Full fetch complete (20339 records). [2025-09-17T20:29:07.718893] [DEBUG] [VALIDATOR ] MUJ: Validating primary data. [2025-09-17T20:29:08.088543] [DEBUG] [VALIDATOR ] MUJ: All expected trading days are present. [2025-09-17T20:29:08.088628] [DEBUG] [VALIDATOR ] MUJ: Primary data validation passed. [2025-09-17T20:29:08.089136] [INFO ] [MAIN ] MUJ: Fetched primary data is valid. [2025-09-17T20:29:08.089197] [DEBUG] [LOCAL ] MUJ: Saving primary data. [2025-09-17T20:29:08.089827] [DEBUG] [LOCAL ] MUJ: Trimmed 20339 records to 13165 (keeping 200 days of data) [2025-09-17T20:29:08.171260] [DEBUG] [LOCAL ] MUJ: Primary data saved (13165 records). [2025-09-17T20:29:08.171408] [INFO ] [MAIN ] MUJ: Full history saved. [2025-09-17T20:29:08.171500] [INFO ] [MAIN ] Update Progress: 1431/2371 symbols completed. MUJ took 24.7s. Estimated remaining: 2h 17m 21s. Rate: 6.8 symbols/min [2025-09-17T20:29:08.346824] [INFO ] [MAIN ] MUSE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:29:08.347036] [DEBUG] [LOCAL ] MUSE: No existing data file found in primary storage. [2025-09-17T20:29:08.347076] [WARN ] [MAIN ] MUSE: No existing data found, performing full refresh instead. [2025-09-17T20:29:08.347203] [INFO ] [MAIN ] MUSE: Wiping existing primary data before full refresh. [2025-09-17T20:29:08.347242] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-17T20:29:08.347284] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-17T20:29:08.347318] [INFO ] [MAIN ] MUSE: Starting full primary refresh. [2025-09-17T20:29:08.420856] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-01. [2025-09-17T20:29:08.717677] [INFO ] [REMOTE ] MUSE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:29:09.097103] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T20:29:09.215779] [INFO ] [REMOTE ] MUFG: Fetching primary data for 2025-09. [2025-09-17T20:29:10.015802] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-01. [2025-09-17T20:29:10.261376] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T20:29:10.815778] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-11. [2025-09-17T20:29:11.016543] [INFO ] [REMOTE ] MUFG: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T20:29:11.024045] [INFO ] [REMOTE ] MUFG: Full fetch complete (75227 records). [2025-09-17T20:29:11.024207] [DEBUG] [VALIDATOR ] MUFG: Validating primary data. [2025-09-17T20:29:11.216464] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-17T20:29:11.350046] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T20:29:11.449444] [DEBUG] [VALIDATOR ] MUFG: All expected trading days are present. [2025-09-17T20:29:11.449531] [DEBUG] [VALIDATOR ] MUFG: Primary data validation passed. [2025-09-17T20:29:11.450542] [INFO ] [MAIN ] MUFG: Fetched primary data is valid. [2025-09-17T20:29:11.450660] [DEBUG] [LOCAL ] MUFG: Saving primary data. [2025-09-17T20:29:11.452219] [DEBUG] [LOCAL ] MUFG: Trimmed 75227 records to 52665 (keeping 200 days of data) [2025-09-17T20:29:11.634379] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-02. [2025-09-17T20:29:11.786119] [DEBUG] [LOCAL ] MUFG: Primary data saved (52665 records). [2025-09-17T20:29:11.786314] [INFO ] [MAIN ] MUFG: Full history saved. [2025-09-17T20:29:11.786430] [INFO ] [MAIN ] Update Progress: 1432/2371 symbols completed. MUFG took 42.0s. Estimated remaining: 2h 17m 9s. Rate: 6.8 symbols/min [2025-09-17T20:29:11.969671] [INFO ] [MAIN ] MUX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:29:12.010262] [DEBUG] [LOCAL ] MUX: Loaded 42149 existing records from primary storage. [2025-09-17T20:29:12.010419] [INFO ] [MAIN ] MUX: Loaded 42149 existing records. [2025-09-17T20:29:12.187763] [WARN ] [MAIN ] MUX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:29:12.188029] [INFO ] [MAIN ] MUX: Wiping existing primary data before full refresh. [2025-09-17T20:29:12.188084] [INFO ] [LOCAL ] MUX: Starting deletion of primary data. [2025-09-17T20:29:12.188931] [DEBUG] [LOCAL ] MUX: Deleted primary data file. [2025-09-17T20:29:12.188982] [INFO ] [MAIN ] MUX: Starting full primary refresh. [2025-09-17T20:29:12.420927] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-02. [2025-09-17T20:29:12.571305] [INFO ] [REMOTE ] MUX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:29:12.953176] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T20:29:13.215778] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-03. [2025-09-17T20:29:14.015756] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2024-12. [2025-09-17T20:29:14.111553] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T20:29:14.315389] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-17T20:29:14.320118] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T20:29:14.815823] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-04. [2025-09-17T20:29:15.615779] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-01. [2025-09-17T20:29:15.931068] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:29:15.931401] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-01 [2025-09-17T20:29:16.108045] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T20:29:16.415779] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-03. [2025-09-17T20:29:17.215843] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-05. [2025-09-17T20:29:18.015859] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-11. [2025-09-17T20:29:18.392103] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T20:29:18.607674] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T20:29:18.815764] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-06. [2025-09-17T20:29:19.325744] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T20:29:19.615775] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-02. [2025-09-17T20:29:19.931635] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:29:19.932024] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-02 [2025-09-17T20:29:20.136130] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T20:29:20.415787] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-07. [2025-09-17T20:29:21.215783] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-04. [2025-09-17T20:29:21.653529] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T20:29:22.015797] [INFO ] [REMOTE ] MUX: Fetching primary data for 2024-12. [2025-09-17T20:29:22.815744] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-03. [2025-09-17T20:29:22.965975] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T20:29:23.125376] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-17T20:29:23.498360] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T20:29:23.615810] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-08. [2025-09-17T20:29:24.415775] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-01. [2025-09-17T20:29:24.892365] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T20:29:25.215822] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-05. [2025-09-17T20:29:25.811402] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T20:29:26.015776] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-02. [2025-09-17T20:29:26.815791] [INFO ] [REMOTE ] MUSA: Fetching primary data for 2025-09. [2025-09-17T20:29:27.131478] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T20:29:27.196816] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T20:29:27.615804] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-03. [2025-09-17T20:29:27.982975] [INFO ] [REMOTE ] MUSA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T20:29:27.986578] [INFO ] [REMOTE ] MUSA: Full fetch complete (34926 records). [2025-09-17T20:29:27.986675] [DEBUG] [VALIDATOR ] MUSA: Validating primary data. [2025-09-17T20:29:28.358125] [DEBUG] [VALIDATOR ] MUSA: All expected trading days are present. [2025-09-17T20:29:28.358207] [DEBUG] [VALIDATOR ] MUSA: Primary data validation passed. [2025-09-17T20:29:28.358957] [INFO ] [MAIN ] MUSA: Fetched primary data is valid. [2025-09-17T20:29:28.359003] [DEBUG] [LOCAL ] MUSA: Saving primary data. [2025-09-17T20:29:28.360176] [DEBUG] [LOCAL ] MUSA: Trimmed 34926 records to 25119 (keeping 200 days of data) [2025-09-17T20:29:28.419180] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-06. [2025-09-17T20:29:28.529723] [DEBUG] [LOCAL ] MUSA: Primary data saved (25119 records). [2025-09-17T20:29:28.529877] [INFO ] [MAIN ] MUSA: Full history saved. [2025-09-17T20:29:28.529987] [INFO ] [MAIN ] Update Progress: 1433/2371 symbols completed. MUSA took 27.0s. Estimated remaining: 2h 17m 6s. Rate: 6.8 symbols/min [2025-09-17T20:29:28.703736] [INFO ] [MAIN ] MVF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:29:28.718189] [DEBUG] [LOCAL ] MVF: Loaded 12821 existing records from primary storage. [2025-09-17T20:29:28.718312] [INFO ] [MAIN ] MVF: Loaded 12821 existing records. [2025-09-17T20:29:28.902530] [WARN ] [MAIN ] MVF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:29:28.902853] [INFO ] [MAIN ] MVF: Wiping existing primary data before full refresh. [2025-09-17T20:29:28.902906] [INFO ] [LOCAL ] MVF: Starting deletion of primary data. [2025-09-17T20:29:28.903255] [DEBUG] [LOCAL ] MVF: Deleted primary data file. [2025-09-17T20:29:28.903300] [INFO ] [MAIN ] MVF: Starting full primary refresh. [2025-09-17T20:29:29.231942] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-04. [2025-09-17T20:29:29.272739] [INFO ] [REMOTE ] MVF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:29:29.329076] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T20:29:29.561459] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-04 (0.33 seconds). [2025-09-17T20:29:30.015788] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-04. [2025-09-17T20:29:30.396631] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T20:29:30.815798] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-11. [2025-09-17T20:29:31.402782] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T20:29:31.615783] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-05. [2025-09-17T20:29:31.792244] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T20:29:31.898068] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-05 (0.28 seconds). [2025-09-17T20:29:32.415790] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-06. [2025-09-17T20:29:32.719690] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-06 (0.30 seconds). [2025-09-17T20:29:33.215792] [INFO ] [REMOTE ] MVF: Fetching primary data for 2024-12. [2025-09-17T20:29:34.015794] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-07. [2025-09-17T20:29:34.089198] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T20:29:34.815799] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-01. [2025-09-17T20:29:35.615796] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-07. [2025-09-17T20:29:35.699726] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T20:29:35.793668] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T20:29:35.924710] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-07 (0.31 seconds). [2025-09-17T20:29:36.415769] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-08. [2025-09-17T20:29:37.215797] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-05. [2025-09-17T20:29:38.015768] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-08. [2025-09-17T20:29:38.297142] [INFO ] [REMOTE ] MUSE: Incremental fetch complete for 2025-08 (0.28 seconds). [2025-09-17T20:29:38.477949] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T20:29:38.755769] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T20:29:38.815797] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-02. [2025-09-17T20:29:39.615833] [INFO ] [REMOTE ] MUSE: Fetching primary data for 2025-09. [2025-09-17T20:29:39.660156] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T20:29:39.880937] [DEBUG] [REMOTE ] MUSE: Error fetching primary data for 2025-09: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:29:39.881280] [WARN ] [REMOTE ] MUSE: No data returned for month 2025-09 [2025-09-17T20:29:39.881377] [INFO ] [REMOTE ] MUSE: Full fetch complete (107 records). [2025-09-17T20:29:39.881449] [DEBUG] [VALIDATOR ] MUSE: Validating primary data. [2025-09-17T20:29:39.882129] [FATAL] [VALIDATOR ] MUSE: Data is stale - most recent date (2025-08-05) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:29:39.882211] [FATAL] [MAIN ] MUSE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:29:39.882251] [WARN ] [MAIN ] MUSE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:29:39.882296] [INFO ] [LOCAL ] MUSE: Starting deletion of primary data. [2025-09-17T20:29:39.882359] [DEBUG] [LOCAL ] MUSE: No primary data file found to delete. [2025-09-17T20:29:39.882397] [INFO ] [LOCAL ] MUSE: Starting deletion of derivative data. [2025-09-17T20:29:39.882478] [DEBUG] [LOCAL ] MUSE: No derivative data file found to delete. [2025-09-17T20:29:39.882543] [INFO ] [MAIN ] Update Progress: 1434/2371 symbols completed. MUSE took 31.7s. Estimated remaining: 2h 16m 59s. Rate: 6.8 symbols/min [2025-09-17T20:29:40.057420] [INFO ] [MAIN ] MVO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:29:40.067372] [DEBUG] [LOCAL ] MVO: Loaded 9083 existing records from primary storage. [2025-09-17T20:29:40.067493] [INFO ] [MAIN ] MVO: Loaded 9083 existing records. [2025-09-17T20:29:40.254516] [WARN ] [MAIN ] MVO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:29:40.254796] [INFO ] [MAIN ] MVO: Wiping existing primary data before full refresh. [2025-09-17T20:29:40.254844] [INFO ] [LOCAL ] MVO: Starting deletion of primary data. [2025-09-17T20:29:40.255184] [DEBUG] [LOCAL ] MVO: Deleted primary data file. [2025-09-17T20:29:40.255232] [INFO ] [MAIN ] MVO: Starting full primary refresh. [2025-09-17T20:29:40.429853] [INFO ] [REMOTE ] MUR: Fetching primary data for 2025-09. [2025-09-17T20:29:40.622462] [INFO ] [REMOTE ] MVO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:29:41.215829] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-06. [2025-09-17T20:29:41.965697] [INFO ] [REMOTE ] MUR: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T20:29:41.972934] [INFO ] [REMOTE ] MUR: Full fetch complete (76101 records). [2025-09-17T20:29:41.973186] [DEBUG] [VALIDATOR ] MUR: Validating primary data. [2025-09-17T20:29:42.020988] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-11. [2025-09-17T20:29:42.399184] [DEBUG] [VALIDATOR ] MUR: All expected trading days are present. [2025-09-17T20:29:42.399300] [DEBUG] [VALIDATOR ] MUR: Primary data validation passed. [2025-09-17T20:29:42.400588] [INFO ] [MAIN ] MUR: Fetched primary data is valid. [2025-09-17T20:29:42.400692] [DEBUG] [LOCAL ] MUR: Saving primary data. [2025-09-17T20:29:42.402554] [DEBUG] [LOCAL ] MUR: Trimmed 76101 records to 52946 (keeping 200 days of data) [2025-09-17T20:29:42.747986] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T20:29:42.783799] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T20:29:42.797143] [DEBUG] [LOCAL ] MUR: Primary data saved (52946 records). [2025-09-17T20:29:42.797445] [INFO ] [MAIN ] MUR: Full history saved. [2025-09-17T20:29:42.797593] [INFO ] [MAIN ] Update Progress: 1435/2371 symbols completed. MUR took 45.0s. Estimated remaining: 2h 16m 46s. Rate: 6.8 symbols/min [2025-09-17T20:29:42.820963] [INFO ] [REMOTE ] MVO: Fetching primary data for 2024-12. [2025-09-17T20:29:42.981384] [INFO ] [MAIN ] MVT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:29:42.993298] [DEBUG] [LOCAL ] MVT: Loaded 10021 existing records from primary storage. [2025-09-17T20:29:42.993435] [INFO ] [MAIN ] MVT: Loaded 10021 existing records. [2025-09-17T20:29:43.173681] [WARN ] [MAIN ] MVT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:29:43.174031] [INFO ] [MAIN ] MVT: Wiping existing primary data before full refresh. [2025-09-17T20:29:43.174082] [INFO ] [LOCAL ] MVT: Starting deletion of primary data. [2025-09-17T20:29:43.174497] [DEBUG] [LOCAL ] MVT: Deleted primary data file. [2025-09-17T20:29:43.174546] [INFO ] [MAIN ] MVT: Starting full primary refresh. [2025-09-17T20:29:43.528984] [INFO ] [REMOTE ] MVT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:29:43.615755] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-07. [2025-09-17T20:29:43.734065] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T20:29:44.415796] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-11. [2025-09-17T20:29:45.200366] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T20:29:45.215671] [INFO ] [REMOTE ] MVT: Fetching primary data for 2024-12. [2025-09-17T20:29:45.295545] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T20:29:46.015818] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-01. [2025-09-17T20:29:46.227129] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T20:29:46.815786] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-01. [2025-09-17T20:29:47.063201] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T20:29:47.615815] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-02. [2025-09-17T20:29:47.672057] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T20:29:48.306407] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T20:29:48.415811] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-02. [2025-09-17T20:29:49.215792] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-03. [2025-09-17T20:29:49.306001] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T20:29:50.015704] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-03. [2025-09-17T20:29:50.047168] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T20:29:50.815769] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-08. [2025-09-17T20:29:50.963558] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T20:29:51.615776] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-04. [2025-09-17T20:29:52.393205] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T20:29:52.418678] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-03. [2025-09-17T20:29:52.423708] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T20:29:53.215786] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-04. [2025-09-17T20:29:53.260205] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T20:29:54.015791] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-04. [2025-09-17T20:29:54.268106] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T20:29:54.815767] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-05. [2025-09-17T20:29:55.042970] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T20:29:55.585308] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T20:29:55.615765] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-06. [2025-09-17T20:29:56.415776] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-05. [2025-09-17T20:29:56.532637] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T20:29:57.215776] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-07. [2025-09-17T20:29:57.249601] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T20:29:58.015823] [INFO ] [REMOTE ] MUX: Fetching primary data for 2025-09. [2025-09-17T20:29:58.209077] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T20:29:58.815790] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-08. [2025-09-17T20:29:59.500077] [INFO ] [REMOTE ] MUX: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T20:29:59.506497] [INFO ] [REMOTE ] MUX: Full fetch complete (58160 records). [2025-09-17T20:29:59.506596] [DEBUG] [VALIDATOR ] MUX: Validating primary data. [2025-09-17T20:29:59.618230] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-06. [2025-09-17T20:29:59.647167] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T20:29:59.915473] [DEBUG] [VALIDATOR ] MUX: All expected trading days are present. [2025-09-17T20:29:59.915564] [DEBUG] [VALIDATOR ] MUX: Primary data validation passed. [2025-09-17T20:29:59.916422] [INFO ] [MAIN ] MUX: Fetched primary data is valid. [2025-09-17T20:29:59.916468] [DEBUG] [LOCAL ] MUX: Saving primary data. [2025-09-17T20:29:59.917693] [DEBUG] [LOCAL ] MUX: Trimmed 58160 records to 42198 (keeping 200 days of data) [2025-09-17T20:30:00.178578] [DEBUG] [LOCAL ] MUX: Primary data saved (42198 records). [2025-09-17T20:30:00.178773] [INFO ] [MAIN ] MUX: Full history saved. [2025-09-17T20:30:00.178895] [INFO ] [MAIN ] Update Progress: 1436/2371 symbols completed. MUX took 48.4s. Estimated remaining: 2h 16m 43s. Rate: 6.8 symbols/min [2025-09-17T20:30:00.354713] [INFO ] [MAIN ] MWA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:30:00.407810] [DEBUG] [LOCAL ] MWA: Loaded 47255 existing records from primary storage. [2025-09-17T20:30:00.408053] [INFO ] [MAIN ] MWA: Loaded 47255 existing records. [2025-09-17T20:30:00.421836] [INFO ] [REMOTE ] MVO: Fetching primary data for 2025-09. [2025-09-17T20:30:00.600425] [WARN ] [MAIN ] MWA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:30:00.600742] [INFO ] [MAIN ] MWA: Wiping existing primary data before full refresh. [2025-09-17T20:30:00.600792] [INFO ] [LOCAL ] MWA: Starting deletion of primary data. [2025-09-17T20:30:00.601911] [DEBUG] [LOCAL ] MWA: Deleted primary data file. [2025-09-17T20:30:00.602003] [INFO ] [MAIN ] MWA: Starting full primary refresh. [2025-09-17T20:30:00.860051] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T20:30:00.988909] [INFO ] [REMOTE ] MWA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:30:01.215698] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-07. [2025-09-17T20:30:01.247919] [INFO ] [REMOTE ] MVO: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T20:30:01.249562] [INFO ] [REMOTE ] MVO: Full fetch complete (14617 records). [2025-09-17T20:30:01.249636] [DEBUG] [VALIDATOR ] MVO: Validating primary data. [2025-09-17T20:30:01.691144] [DEBUG] [VALIDATOR ] MVO: All expected trading days are present. [2025-09-17T20:30:01.691279] [DEBUG] [VALIDATOR ] MVO: Primary data validation passed. [2025-09-17T20:30:01.692104] [INFO ] [MAIN ] MVO: Fetched primary data is valid. [2025-09-17T20:30:01.692191] [DEBUG] [LOCAL ] MVO: Saving primary data. [2025-09-17T20:30:01.693480] [DEBUG] [LOCAL ] MVO: Trimmed 14617 records to 9104 (keeping 200 days of data) [2025-09-17T20:30:01.758260] [DEBUG] [LOCAL ] MVO: Primary data saved (9104 records). [2025-09-17T20:30:01.758432] [INFO ] [MAIN ] MVO: Full history saved. [2025-09-17T20:30:01.758532] [INFO ] [MAIN ] Update Progress: 1437/2371 symbols completed. MVO took 21.9s. Estimated remaining: 2h 16m 29s. Rate: 6.8 symbols/min [2025-09-17T20:30:01.952932] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T20:30:02.015770] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-05. [2025-09-17T20:30:02.815772] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-11. [2025-09-17T20:30:02.920062] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T20:30:03.615807] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-06. [2025-09-17T20:30:04.415824] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-08. [2025-09-17T20:30:04.538476] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T20:30:04.557173] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T20:30:05.166440] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T20:30:05.215829] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-07. [2025-09-17T20:30:06.015847] [INFO ] [REMOTE ] MVT: Fetching primary data for 2025-09. [2025-09-17T20:30:06.159407] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T20:30:06.628285] [INFO ] [REMOTE ] MVT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T20:30:06.630671] [INFO ] [REMOTE ] MVT: Full fetch complete (14559 records). [2025-09-17T20:30:06.630759] [DEBUG] [VALIDATOR ] MVT: Validating primary data. [2025-09-17T20:30:06.819909] [INFO ] [REMOTE ] MWA: Fetching primary data for 2024-12. [2025-09-17T20:30:07.047060] [DEBUG] [VALIDATOR ] MVT: All expected trading days are present. [2025-09-17T20:30:07.047167] [DEBUG] [VALIDATOR ] MVT: Primary data validation passed. [2025-09-17T20:30:07.047767] [INFO ] [MAIN ] MVT: Fetched primary data is valid. [2025-09-17T20:30:07.047823] [DEBUG] [LOCAL ] MVT: Saving primary data. [2025-09-17T20:30:07.048444] [DEBUG] [LOCAL ] MVT: Trimmed 14559 records to 10102 (keeping 200 days of data) [2025-09-17T20:30:07.118175] [DEBUG] [LOCAL ] MVT: Primary data saved (10102 records). [2025-09-17T20:30:07.118384] [INFO ] [MAIN ] MVT: Full history saved. [2025-09-17T20:30:07.118530] [INFO ] [MAIN ] Update Progress: 1438/2371 symbols completed. MVT took 24.3s. Estimated remaining: 2h 16m 18s. Rate: 6.8 symbols/min [2025-09-17T20:30:07.615809] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-08. [2025-09-17T20:30:08.549604] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T20:30:08.553274] [INFO ] [REMOTE ] MVF: Fetching primary data for 2025-09. [2025-09-17T20:30:08.651864] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T20:30:09.215844] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-01. [2025-09-17T20:30:09.379794] [INFO ] [REMOTE ] MVF: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T20:30:09.382444] [INFO ] [REMOTE ] MVF: Full fetch complete (19186 records). [2025-09-17T20:30:09.382572] [DEBUG] [VALIDATOR ] MVF: Validating primary data. [2025-09-17T20:30:09.837006] [DEBUG] [VALIDATOR ] MVF: All expected trading days are present. [2025-09-17T20:30:09.837182] [DEBUG] [VALIDATOR ] MVF: Primary data validation passed. [2025-09-17T20:30:09.838669] [INFO ] [MAIN ] MVF: Fetched primary data is valid. [2025-09-17T20:30:09.838783] [DEBUG] [LOCAL ] MVF: Saving primary data. [2025-09-17T20:30:09.840268] [DEBUG] [LOCAL ] MVF: Trimmed 19186 records to 12892 (keeping 200 days of data) [2025-09-17T20:30:09.958990] [DEBUG] [LOCAL ] MVF: Primary data saved (12892 records). [2025-09-17T20:30:09.959244] [INFO ] [MAIN ] MVF: Full history saved. [2025-09-17T20:30:09.959376] [INFO ] [MAIN ] Update Progress: 1439/2371 symbols completed. MVF took 41.4s. Estimated remaining: 2h 16m 6s. Rate: 6.8 symbols/min [2025-09-17T20:30:11.029163] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T20:30:11.039133] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-02. [2025-09-17T20:30:12.751013] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T20:30:12.760742] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-03. [2025-09-17T20:30:14.805272] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T20:30:14.816998] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-04. [2025-09-17T20:30:16.662207] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T20:30:16.673327] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-05. [2025-09-17T20:30:18.220722] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T20:30:18.231016] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-06. [2025-09-17T20:30:19.875576] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T20:30:19.886021] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-07. [2025-09-17T20:30:21.513309] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T20:30:21.523374] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-08. [2025-09-17T20:30:23.193072] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T20:30:23.203118] [INFO ] [REMOTE ] MWA: Fetching primary data for 2025-09. [2025-09-17T20:30:24.633352] [INFO ] [REMOTE ] MWA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T20:30:24.639472] [INFO ] [REMOTE ] MWA: Full fetch complete (67647 records). [2025-09-17T20:30:24.639613] [DEBUG] [VALIDATOR ] MWA: Validating primary data. [2025-09-17T20:30:25.042537] [DEBUG] [VALIDATOR ] MWA: All expected trading days are present. [2025-09-17T20:30:25.042687] [DEBUG] [VALIDATOR ] MWA: Primary data validation passed. [2025-09-17T20:30:25.043774] [INFO ] [MAIN ] MWA: Fetched primary data is valid. [2025-09-17T20:30:25.043825] [DEBUG] [LOCAL ] MWA: Saving primary data. [2025-09-17T20:30:25.045338] [DEBUG] [LOCAL ] MWA: Trimmed 67647 records to 47233 (keeping 200 days of data) [2025-09-17T20:30:25.353288] [DEBUG] [LOCAL ] MWA: Primary data saved (47233 records). [2025-09-17T20:30:25.353458] [INFO ] [MAIN ] MWA: Full history saved. [2025-09-17T20:30:25.353595] [INFO ] [MAIN ] Update Progress: 1440/2371 symbols completed. MWA took 25.2s. Estimated remaining: 2h 16m 1s. Rate: 6.8 symbols/min [2025-09-17T20:30:25.991179] [INFO ] [MAIN ] MXE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:30:26.048408] [INFO ] [MAIN ] MX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:30:26.051846] [DEBUG] [LOCAL ] MXE: No existing data file found in primary storage. [2025-09-17T20:30:26.087871] [WARN ] [MAIN ] MXE: No existing data found, performing full refresh instead. [2025-09-17T20:30:26.089945] [INFO ] [MAIN ] MXF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:30:26.093798] [INFO ] [MAIN ] MYD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:30:26.094779] [INFO ] [MAIN ] MXE: Wiping existing primary data before full refresh. [2025-09-17T20:30:26.095130] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-17T20:30:26.095196] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-17T20:30:26.095234] [INFO ] [MAIN ] MXE: Starting full primary refresh. [2025-09-17T20:30:26.224458] [DEBUG] [LOCAL ] MYD: Loaded 13768 existing records from primary storage. [2025-09-17T20:30:26.237236] [INFO ] [MAIN ] MYD: Loaded 13768 existing records. [2025-09-17T20:30:26.237168] [DEBUG] [LOCAL ] MXF: Loaded 6138 existing records from primary storage. [2025-09-17T20:30:26.237752] [INFO ] [MAIN ] MXF: Loaded 6138 existing records. [2025-09-17T20:30:26.249434] [DEBUG] [LOCAL ] MX: Loaded 22967 existing records from primary storage. [2025-09-17T20:30:26.283792] [INFO ] [MAIN ] MX: Loaded 22967 existing records. [2025-09-17T20:30:26.903367] [WARN ] [MAIN ] MXF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:30:26.935467] [WARN ] [MAIN ] MYD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:30:26.941373] [INFO ] [MAIN ] MYD: Wiping existing primary data before full refresh. [2025-09-17T20:30:26.952274] [INFO ] [LOCAL ] MYD: Starting deletion of primary data. [2025-09-17T20:30:26.952158] [INFO ] [MAIN ] MXF: Wiping existing primary data before full refresh. [2025-09-17T20:30:27.003157] [DEBUG] [LOCAL ] MYD: Deleted primary data file. [2025-09-17T20:30:27.011126] [INFO ] [MAIN ] MYD: Starting full primary refresh. [2025-09-17T20:30:27.056316] [INFO ] [LOCAL ] MXF: Starting deletion of primary data. [2025-09-17T20:30:27.133243] [WARN ] [MAIN ] MX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:30:27.133145] [INFO ] [REMOTE ] MXE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:30:27.146899] [DEBUG] [LOCAL ] MXF: Deleted primary data file. [2025-09-17T20:30:27.192506] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-11. [2025-09-17T20:30:27.176766] [INFO ] [MAIN ] MX: Wiping existing primary data before full refresh. [2025-09-17T20:30:27.197210] [INFO ] [MAIN ] MXF: Starting full primary refresh. [2025-09-17T20:30:27.197358] [INFO ] [LOCAL ] MX: Starting deletion of primary data. [2025-09-17T20:30:27.254418] [DEBUG] [LOCAL ] MX: Deleted primary data file. [2025-09-17T20:30:27.337363] [INFO ] [MAIN ] MX: Starting full primary refresh. [2025-09-17T20:30:28.000395] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T20:30:28.019544] [INFO ] [REMOTE ] MYD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:30:28.054059] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-11. [2025-09-17T20:30:28.053707] [INFO ] [REMOTE ] MXE: Fetching primary data for 2024-12. [2025-09-17T20:30:28.187556] [INFO ] [REMOTE ] MXF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:30:28.207760] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-11. [2025-09-17T20:30:28.306095] [INFO ] [REMOTE ] MX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:30:28.306491] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-11. [2025-09-17T20:30:28.743794] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T20:30:28.745357] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-01. [2025-09-17T20:30:28.996335] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T20:30:28.999837] [INFO ] [REMOTE ] MYD: Fetching primary data for 2024-12. [2025-09-17T20:30:29.062491] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T20:30:29.065638] [INFO ] [REMOTE ] MXF: Fetching primary data for 2024-12. [2025-09-17T20:30:29.314844] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T20:30:29.316855] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-02. [2025-09-17T20:30:29.566983] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T20:30:29.572531] [INFO ] [REMOTE ] MX: Fetching primary data for 2024-12. [2025-09-17T20:30:29.688685] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T20:30:29.691573] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-01. [2025-09-17T20:30:29.812888] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T20:30:29.814208] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-03. [2025-09-17T20:30:29.914621] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T20:30:29.919417] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-01. [2025-09-17T20:30:30.307304] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-03 (0.49 seconds). [2025-09-17T20:30:30.308386] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-04. [2025-09-17T20:30:30.462773] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T20:30:30.467606] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-02. [2025-09-17T20:30:30.516437] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T20:30:30.522246] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-01. [2025-09-17T20:30:30.766670] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T20:30:30.770150] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-02. [2025-09-17T20:30:30.810516] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T20:30:30.811617] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-05. [2025-09-17T20:30:31.269715] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T20:30:31.270832] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-06. [2025-09-17T20:30:31.362431] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T20:30:31.483481] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T20:30:31.534039] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T20:30:31.615767] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-03. [2025-09-17T20:30:31.709778] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T20:30:32.418364] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-02. [2025-09-17T20:30:32.421320] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T20:30:33.215830] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-03. [2025-09-17T20:30:33.629672] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T20:30:33.902353] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T20:30:34.015836] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-04. [2025-09-17T20:30:34.792396] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T20:30:34.815736] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-05. [2025-09-17T20:30:35.615775] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-07. [2025-09-17T20:30:35.628032] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T20:30:36.176566] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T20:30:36.415807] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-03. [2025-09-17T20:30:37.215812] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-08. [2025-09-17T20:30:37.660657] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T20:30:37.715583] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T20:30:38.015838] [INFO ] [REMOTE ] MXE: Fetching primary data for 2025-09. [2025-09-17T20:30:38.496081] [INFO ] [REMOTE ] MXE: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T20:30:38.497158] [INFO ] [REMOTE ] MXE: Full fetch complete (2699 records). [2025-09-17T20:30:38.497231] [DEBUG] [VALIDATOR ] MXE: Validating primary data. [2025-09-17T20:30:38.694050] [WARN ] [VALIDATOR ] MXE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T20:30:38.694318] [FATAL] [MAIN ] MXE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:30:38.694399] [WARN ] [MAIN ] MXE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:30:38.694472] [INFO ] [LOCAL ] MXE: Starting deletion of primary data. [2025-09-17T20:30:38.694562] [DEBUG] [LOCAL ] MXE: No primary data file found to delete. [2025-09-17T20:30:38.694617] [INFO ] [LOCAL ] MXE: Starting deletion of derivative data. [2025-09-17T20:30:38.694700] [DEBUG] [LOCAL ] MXE: No derivative data file found to delete. [2025-09-17T20:30:38.694813] [INFO ] [MAIN ] Update Progress: 1441/2371 symbols completed. MXE took 13.3s. Estimated remaining: 2h 15m 56s. Rate: 6.8 symbols/min [2025-09-17T20:30:38.820877] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-04. [2025-09-17T20:30:38.872815] [INFO ] [MAIN ] MYE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:30:38.901456] [DEBUG] [LOCAL ] MYE: Loaded 25615 existing records from primary storage. [2025-09-17T20:30:38.901620] [INFO ] [MAIN ] MYE: Loaded 25615 existing records. [2025-09-17T20:30:39.077832] [WARN ] [MAIN ] MYE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:30:39.078105] [INFO ] [MAIN ] MYE: Wiping existing primary data before full refresh. [2025-09-17T20:30:39.078171] [INFO ] [LOCAL ] MYE: Starting deletion of primary data. [2025-09-17T20:30:39.078894] [DEBUG] [LOCAL ] MYE: Deleted primary data file. [2025-09-17T20:30:39.078942] [INFO ] [MAIN ] MYE: Starting full primary refresh. [2025-09-17T20:30:39.439200] [INFO ] [REMOTE ] MYE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:30:39.615812] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-11. [2025-09-17T20:30:40.021295] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-04 (1.20 seconds). [2025-09-17T20:30:40.415824] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-06. [2025-09-17T20:30:41.075097] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T20:30:41.149101] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T20:30:41.215780] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-07. [2025-09-17T20:30:41.978558] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T20:30:42.015766] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-08. [2025-09-17T20:30:42.586052] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T20:30:42.815818] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-04. [2025-09-17T20:30:43.615860] [INFO ] [REMOTE ] MYE: Fetching primary data for 2024-12. [2025-09-17T20:30:43.991997] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T20:30:44.415845] [INFO ] [REMOTE ] MXF: Fetching primary data for 2025-09. [2025-09-17T20:30:45.018847] [INFO ] [REMOTE ] MXF: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T20:30:45.019976] [INFO ] [REMOTE ] MXF: Full fetch complete (10672 records). [2025-09-17T20:30:45.020045] [DEBUG] [VALIDATOR ] MXF: Validating primary data. [2025-09-17T20:30:45.169208] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T20:30:45.215894] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-05. [2025-09-17T20:30:45.434418] [DEBUG] [VALIDATOR ] MXF: All expected trading days are present. [2025-09-17T20:30:45.434509] [DEBUG] [VALIDATOR ] MXF: Primary data validation passed. [2025-09-17T20:30:45.434837] [INFO ] [MAIN ] MXF: Fetched primary data is valid. [2025-09-17T20:30:45.434895] [DEBUG] [LOCAL ] MXF: Saving primary data. [2025-09-17T20:30:45.435357] [DEBUG] [LOCAL ] MXF: Trimmed 10672 records to 6127 (keeping 200 days of data) [2025-09-17T20:30:45.473292] [DEBUG] [LOCAL ] MXF: Primary data saved (6127 records). [2025-09-17T20:30:45.473403] [INFO ] [MAIN ] MXF: Full history saved. [2025-09-17T20:30:45.473504] [INFO ] [MAIN ] Update Progress: 1442/2371 symbols completed. MXF took 20.1s. Estimated remaining: 2h 15m 46s. Rate: 6.8 symbols/min [2025-09-17T20:30:45.645071] [INFO ] [MAIN ] MYI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:30:45.666779] [DEBUG] [LOCAL ] MYI: Loaded 19326 existing records from primary storage. [2025-09-17T20:30:45.666927] [INFO ] [MAIN ] MYI: Loaded 19326 existing records. [2025-09-17T20:30:45.846631] [WARN ] [MAIN ] MYI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:30:45.847068] [INFO ] [MAIN ] MYI: Wiping existing primary data before full refresh. [2025-09-17T20:30:45.847116] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-17T20:30:45.847990] [DEBUG] [LOCAL ] MYI: Deleted primary data file. [2025-09-17T20:30:45.848050] [INFO ] [MAIN ] MYI: Starting full primary refresh. [2025-09-17T20:30:46.024314] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-05. [2025-09-17T20:30:46.210750] [INFO ] [REMOTE ] MYI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:30:46.224938] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T20:30:46.815786] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-06. [2025-09-17T20:30:47.201908] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T20:30:47.615803] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-11. [2025-09-17T20:30:47.764562] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T20:30:48.415847] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-06. [2025-09-17T20:30:48.770897] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T20:30:49.215791] [INFO ] [REMOTE ] MYI: Fetching primary data for 2024-12. [2025-09-17T20:30:49.597710] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T20:30:50.015794] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-01. [2025-09-17T20:30:50.531564] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T20:30:50.815779] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-01. [2025-09-17T20:30:50.921728] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T20:30:50.927131] [DEBUG] [REMOTE ] MYI: Error fetching primary data for 2025-01: 'API call returned an empty response.' [2025-09-17T20:30:50.928014] [WARN ] [REMOTE ] MYI: No data returned for month 2025-01 [2025-09-17T20:30:51.615789] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-02. [2025-09-17T20:30:52.415783] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-07. [2025-09-17T20:30:52.828068] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T20:30:53.216006] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-02. [2025-09-17T20:30:53.390498] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T20:30:54.015821] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-03. [2025-09-17T20:30:54.242178] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T20:30:54.815831] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-03. [2025-09-17T20:30:55.238369] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T20:30:55.615835] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-08. [2025-09-17T20:30:55.815559] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T20:30:56.415839] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-04. [2025-09-17T20:30:57.089476] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T20:30:57.215746] [INFO ] [REMOTE ] MX: Fetching primary data for 2025-09. [2025-09-17T20:30:57.682376] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T20:30:58.022412] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-07. [2025-09-17T20:30:58.023319] [INFO ] [REMOTE ] MX: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T20:30:58.027664] [INFO ] [REMOTE ] MX: Full fetch complete (31748 records). [2025-09-17T20:30:58.027783] [DEBUG] [VALIDATOR ] MX: Validating primary data. [2025-09-17T20:30:58.402965] [DEBUG] [VALIDATOR ] MX: All expected trading days are present. [2025-09-17T20:30:58.403062] [DEBUG] [VALIDATOR ] MX: Primary data validation passed. [2025-09-17T20:30:58.403979] [INFO ] [MAIN ] MX: Fetched primary data is valid. [2025-09-17T20:30:58.404030] [DEBUG] [LOCAL ] MX: Saving primary data. [2025-09-17T20:30:58.405070] [DEBUG] [LOCAL ] MX: Trimmed 31748 records to 22963 (keeping 200 days of data) [2025-09-17T20:30:58.538767] [DEBUG] [LOCAL ] MX: Primary data saved (22963 records). [2025-09-17T20:30:58.538910] [INFO ] [MAIN ] MX: Full history saved. [2025-09-17T20:30:58.539000] [INFO ] [MAIN ] Update Progress: 1443/2371 symbols completed. MX took 33.2s. Estimated remaining: 2h 15m 40s. Rate: 6.8 symbols/min [2025-09-17T20:30:58.708846] [INFO ] [MAIN ] MYN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:30:58.719244] [DEBUG] [LOCAL ] MYN: Loaded 10308 existing records from primary storage. [2025-09-17T20:30:58.719342] [INFO ] [MAIN ] MYN: Loaded 10308 existing records. [2025-09-17T20:30:58.819622] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-05. [2025-09-17T20:30:58.899543] [WARN ] [MAIN ] MYN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:30:58.899793] [INFO ] [MAIN ] MYN: Wiping existing primary data before full refresh. [2025-09-17T20:30:58.899843] [INFO ] [LOCAL ] MYN: Starting deletion of primary data. [2025-09-17T20:30:58.900205] [DEBUG] [LOCAL ] MYN: Deleted primary data file. [2025-09-17T20:30:58.900253] [INFO ] [MAIN ] MYN: Starting full primary refresh. [2025-09-17T20:30:59.202461] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T20:30:59.271261] [INFO ] [REMOTE ] MYN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:30:59.615825] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-04. [2025-09-17T20:31:00.167936] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T20:31:00.415785] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-08. [2025-09-17T20:31:00.853396] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T20:31:01.215800] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-05. [2025-09-17T20:31:01.318494] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T20:31:02.015822] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-06. [2025-09-17T20:31:02.410821] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T20:31:02.815857] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-11. [2025-09-17T20:31:02.953371] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T20:31:03.615801] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-07. [2025-09-17T20:31:03.870836] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T20:31:04.360092] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T20:31:04.415833] [INFO ] [REMOTE ] MYN: Fetching primary data for 2024-12. [2025-09-17T20:31:05.213761] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T20:31:05.216461] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-06. [2025-09-17T20:31:06.015783] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-01. [2025-09-17T20:31:06.510953] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T20:31:06.815707] [INFO ] [REMOTE ] MYD: Fetching primary data for 2025-09. [2025-09-17T20:31:06.825851] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T20:31:07.474943] [INFO ] [REMOTE ] MYD: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T20:31:07.477179] [INFO ] [REMOTE ] MYD: Full fetch complete (21055 records). [2025-09-17T20:31:07.477267] [DEBUG] [VALIDATOR ] MYD: Validating primary data. [2025-09-17T20:31:07.627447] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-08. [2025-09-17T20:31:07.862789] [DEBUG] [VALIDATOR ] MYD: All expected trading days are present. [2025-09-17T20:31:07.862876] [DEBUG] [VALIDATOR ] MYD: Primary data validation passed. [2025-09-17T20:31:07.863341] [INFO ] [MAIN ] MYD: Fetched primary data is valid. [2025-09-17T20:31:07.863422] [DEBUG] [LOCAL ] MYD: Saving primary data. [2025-09-17T20:31:07.864207] [DEBUG] [LOCAL ] MYD: Trimmed 21055 records to 13861 (keeping 200 days of data) [2025-09-17T20:31:07.949363] [DEBUG] [LOCAL ] MYD: Primary data saved (13861 records). [2025-09-17T20:31:07.949523] [INFO ] [MAIN ] MYD: Full history saved. [2025-09-17T20:31:07.949614] [INFO ] [MAIN ] Update Progress: 1444/2371 symbols completed. MYD took 42.6s. Estimated remaining: 2h 15m 31s. Rate: 6.8 symbols/min [2025-09-17T20:31:08.120483] [INFO ] [MAIN ] NABL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:31:08.158828] [DEBUG] [LOCAL ] NABL: Loaded 40431 existing records from primary storage. [2025-09-17T20:31:08.158994] [INFO ] [MAIN ] NABL: Loaded 40431 existing records. [2025-09-17T20:31:08.352605] [WARN ] [MAIN ] NABL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:31:08.352946] [INFO ] [MAIN ] NABL: Wiping existing primary data before full refresh. [2025-09-17T20:31:08.352996] [INFO ] [LOCAL ] NABL: Starting deletion of primary data. [2025-09-17T20:31:08.353815] [DEBUG] [LOCAL ] NABL: Deleted primary data file. [2025-09-17T20:31:08.353871] [INFO ] [MAIN ] NABL: Starting full primary refresh. [2025-09-17T20:31:08.420978] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-07. [2025-09-17T20:31:08.696706] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T20:31:08.738840] [INFO ] [REMOTE ] NABL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:31:09.215788] [INFO ] [REMOTE ] MYI: Fetching primary data for 2025-09. [2025-09-17T20:31:09.338599] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T20:31:09.920942] [INFO ] [REMOTE ] MYI: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T20:31:09.924502] [INFO ] [REMOTE ] MYI: Full fetch complete (26688 records). [2025-09-17T20:31:09.924592] [DEBUG] [VALIDATOR ] MYI: Validating primary data. [2025-09-17T20:31:10.020956] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-11. [2025-09-17T20:31:10.123331] [WARN ] [VALIDATOR ] MYI: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T20:31:10.123803] [FATAL] [MAIN ] MYI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:31:10.123868] [WARN ] [MAIN ] MYI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:31:10.123927] [INFO ] [LOCAL ] MYI: Starting deletion of primary data. [2025-09-17T20:31:10.124008] [DEBUG] [LOCAL ] MYI: No primary data file found to delete. [2025-09-17T20:31:10.124067] [INFO ] [LOCAL ] MYI: Starting deletion of derivative data. [2025-09-17T20:31:10.124443] [DEBUG] [LOCAL ] MYI: Deleted derivative data file. [2025-09-17T20:31:10.124567] [INFO ] [MAIN ] Update Progress: 1445/2371 symbols completed. MYI took 24.7s. Estimated remaining: 2h 15m 18s. Rate: 6.8 symbols/min [2025-09-17T20:31:10.315584] [INFO ] [MAIN ] NAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:31:10.341791] [DEBUG] [LOCAL ] NAC: Loaded 24749 existing records from primary storage. [2025-09-17T20:31:10.341961] [INFO ] [MAIN ] NAC: Loaded 24749 existing records. [2025-09-17T20:31:10.522804] [WARN ] [MAIN ] NAC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:31:10.523051] [INFO ] [MAIN ] NAC: Wiping existing primary data before full refresh. [2025-09-17T20:31:10.523678] [INFO ] [LOCAL ] NAC: Starting deletion of primary data. [2025-09-17T20:31:10.524399] [DEBUG] [LOCAL ] NAC: Deleted primary data file. [2025-09-17T20:31:10.524452] [INFO ] [MAIN ] NAC: Starting full primary refresh. [2025-09-17T20:31:10.821027] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-02. [2025-09-17T20:31:10.895616] [INFO ] [REMOTE ] NAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:31:11.538536] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T20:31:11.612041] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T20:31:11.615811] [INFO ] [REMOTE ] NABL: Fetching primary data for 2024-12. [2025-09-17T20:31:12.415782] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-08. [2025-09-17T20:31:13.170948] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T20:31:13.215730] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-01. [2025-09-17T20:31:13.638330] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T20:31:14.015819] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-11. [2025-09-17T20:31:14.785978] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T20:31:14.815762] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-02. [2025-09-17T20:31:15.284782] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T20:31:15.615780] [INFO ] [REMOTE ] NAC: Fetching primary data for 2024-12. [2025-09-17T20:31:16.079474] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T20:31:16.415788] [INFO ] [REMOTE ] MYE: Fetching primary data for 2025-09. [2025-09-17T20:31:16.680689] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T20:31:17.215795] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-01. [2025-09-17T20:31:17.562252] [INFO ] [REMOTE ] MYE: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T20:31:17.567047] [INFO ] [REMOTE ] MYE: Full fetch complete (37232 records). [2025-09-17T20:31:17.567194] [DEBUG] [VALIDATOR ] MYE: Validating primary data. [2025-09-17T20:31:17.953082] [DEBUG] [VALIDATOR ] MYE: All expected trading days are present. [2025-09-17T20:31:17.953164] [DEBUG] [VALIDATOR ] MYE: Primary data validation passed. [2025-09-17T20:31:17.953909] [INFO ] [MAIN ] MYE: Fetched primary data is valid. [2025-09-17T20:31:17.953972] [DEBUG] [LOCAL ] MYE: Saving primary data. [2025-09-17T20:31:17.955746] [DEBUG] [LOCAL ] MYE: Trimmed 37232 records to 25560 (keeping 200 days of data) [2025-09-17T20:31:18.017465] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-03. [2025-09-17T20:31:18.122407] [DEBUG] [LOCAL ] MYE: Primary data saved (25560 records). [2025-09-17T20:31:18.122559] [INFO ] [MAIN ] MYE: Full history saved. [2025-09-17T20:31:18.122680] [INFO ] [MAIN ] Update Progress: 1446/2371 symbols completed. MYE took 39.4s. Estimated remaining: 2h 15m 9s. Rate: 6.8 symbols/min [2025-09-17T20:31:18.294564] [INFO ] [MAIN ] NAD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:31:18.309286] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T20:31:18.348442] [DEBUG] [LOCAL ] NAD: Loaded 34164 existing records from primary storage. [2025-09-17T20:31:18.348589] [INFO ] [MAIN ] NAD: Loaded 34164 existing records. [2025-09-17T20:31:18.524842] [WARN ] [MAIN ] NAD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:31:18.525104] [INFO ] [MAIN ] NAD: Wiping existing primary data before full refresh. [2025-09-17T20:31:18.525149] [INFO ] [LOCAL ] NAD: Starting deletion of primary data. [2025-09-17T20:31:18.526130] [DEBUG] [LOCAL ] NAD: Deleted primary data file. [2025-09-17T20:31:18.526180] [INFO ] [MAIN ] NAD: Starting full primary refresh. [2025-09-17T20:31:18.847371] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-02. [2025-09-17T20:31:18.923762] [INFO ] [REMOTE ] NAD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:31:19.615791] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-11. [2025-09-17T20:31:19.739164] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T20:31:20.098612] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T20:31:20.415801] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-03. [2025-09-17T20:31:21.037827] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T20:31:21.215787] [INFO ] [REMOTE ] NAD: Fetching primary data for 2024-12. [2025-09-17T20:31:21.275246] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T20:31:22.015773] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-04. [2025-09-17T20:31:22.609207] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T20:31:22.815773] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-03. [2025-09-17T20:31:22.850585] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T20:31:23.615741] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-01. [2025-09-17T20:31:24.078860] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T20:31:24.415772] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-04. [2025-09-17T20:31:25.201089] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T20:31:25.215682] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-02. [2025-09-17T20:31:25.871006] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T20:31:26.015818] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-05. [2025-09-17T20:31:26.650925] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T20:31:26.815786] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-04. [2025-09-17T20:31:26.885121] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T20:31:27.615836] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-03. [2025-09-17T20:31:28.425819] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-06. [2025-09-17T20:31:28.431526] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T20:31:28.793821] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T20:31:29.215845] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-04. [2025-09-17T20:31:29.585358] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T20:31:30.015826] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-05. [2025-09-17T20:31:30.762576] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T20:31:30.800054] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T20:31:30.815685] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-05. [2025-09-17T20:31:31.615826] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-06. [2025-09-17T20:31:32.149490] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T20:31:32.283277] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T20:31:32.415826] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-07. [2025-09-17T20:31:33.215779] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-07. [2025-09-17T20:31:33.368027] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T20:31:34.015807] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-06. [2025-09-17T20:31:34.464167] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T20:31:34.815800] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-08. [2025-09-17T20:31:35.245681] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T20:31:35.615725] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-08. [2025-09-17T20:31:36.021482] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T20:31:36.379946] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T20:31:36.415810] [INFO ] [REMOTE ] NAC: Fetching primary data for 2025-09. [2025-09-17T20:31:37.215871] [INFO ] [REMOTE ] MYN: Fetching primary data for 2025-09. [2025-09-17T20:31:37.565884] [INFO ] [REMOTE ] NAC: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T20:31:37.570533] [INFO ] [REMOTE ] NAC: Full fetch complete (36313 records). [2025-09-17T20:31:37.570627] [DEBUG] [VALIDATOR ] NAC: Validating primary data. [2025-09-17T20:31:37.948898] [DEBUG] [VALIDATOR ] NAC: All expected trading days are present. [2025-09-17T20:31:37.949054] [DEBUG] [VALIDATOR ] NAC: Primary data validation passed. [2025-09-17T20:31:37.949891] [INFO ] [MAIN ] NAC: Fetched primary data is valid. [2025-09-17T20:31:37.949941] [DEBUG] [LOCAL ] NAC: Saving primary data. [2025-09-17T20:31:37.951337] [DEBUG] [LOCAL ] NAC: Trimmed 36313 records to 24830 (keeping 200 days of data) [2025-09-17T20:31:38.023039] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-05. [2025-09-17T20:31:38.056358] [INFO ] [REMOTE ] MYN: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T20:31:38.066190] [INFO ] [REMOTE ] MYN: Full fetch complete (15590 records). [2025-09-17T20:31:38.076959] [DEBUG] [VALIDATOR ] MYN: Validating primary data. [2025-09-17T20:31:38.489796] [DEBUG] [VALIDATOR ] MYN: All expected trading days are present. [2025-09-17T20:31:38.491341] [DEBUG] [VALIDATOR ] MYN: Primary data validation passed. [2025-09-17T20:31:38.492245] [INFO ] [MAIN ] MYN: Fetched primary data is valid. [2025-09-17T20:31:38.492302] [DEBUG] [LOCAL ] MYN: Saving primary data. [2025-09-17T20:31:38.497681] [DEBUG] [LOCAL ] MYN: Trimmed 15590 records to 10421 (keeping 200 days of data) [2025-09-17T20:31:38.583486] [DEBUG] [LOCAL ] NAC: Primary data saved (24830 records). [2025-09-17T20:31:38.598198] [INFO ] [MAIN ] NAC: Full history saved. [2025-09-17T20:31:38.600591] [INFO ] [MAIN ] Update Progress: 1447/2371 symbols completed. NAC took 28.5s. Estimated remaining: 2h 15m 8s. Rate: 6.8 symbols/min [2025-09-17T20:31:38.600712] [DEBUG] [LOCAL ] MYN: Primary data saved (10421 records). [2025-09-17T20:31:38.645868] [INFO ] [MAIN ] MYN: Full history saved. [2025-09-17T20:31:38.683611] [INFO ] [MAIN ] Update Progress: 1448/2371 symbols completed. MYN took 40.1s. Estimated remaining: 2h 14m 53s. Rate: 6.8 symbols/min [2025-09-17T20:31:38.824858] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-07. [2025-09-17T20:31:38.859155] [INFO ] [MAIN ] NAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:31:38.994321] [INFO ] [MAIN ] NAT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:31:38.995210] [DEBUG] [LOCAL ] NAN: Loaded 9137 existing records from primary storage. [2025-09-17T20:31:38.995303] [INFO ] [MAIN ] NAN: Loaded 9137 existing records. [2025-09-17T20:31:39.199829] [WARN ] [MAIN ] NAN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:31:39.200206] [INFO ] [MAIN ] NAN: Wiping existing primary data before full refresh. [2025-09-17T20:31:39.200257] [INFO ] [LOCAL ] NAN: Starting deletion of primary data. [2025-09-17T20:31:39.200565] [DEBUG] [LOCAL ] NAN: Deleted primary data file. [2025-09-17T20:31:39.200619] [INFO ] [MAIN ] NAN: Starting full primary refresh. [2025-09-17T20:31:39.372529] [DEBUG] [LOCAL ] NAT: Loaded 49168 existing records from primary storage. [2025-09-17T20:31:39.378522] [INFO ] [MAIN ] NAT: Loaded 49168 existing records. [2025-09-17T20:31:39.769498] [INFO ] [REMOTE ] NAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:31:39.764278] [WARN ] [MAIN ] NAT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:31:39.769900] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-11. [2025-09-17T20:31:39.771082] [INFO ] [MAIN ] NAT: Wiping existing primary data before full refresh. [2025-09-17T20:31:39.771210] [INFO ] [LOCAL ] NAT: Starting deletion of primary data. [2025-09-17T20:31:39.772328] [DEBUG] [LOCAL ] NAT: Deleted primary data file. [2025-09-17T20:31:39.772385] [INFO ] [MAIN ] NAT: Starting full primary refresh. [2025-09-17T20:31:39.902031] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T20:31:40.168346] [INFO ] [REMOTE ] NAT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:31:40.189899] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T20:31:40.415793] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-11. [2025-09-17T20:31:40.675615] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T20:31:41.215786] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-08. [2025-09-17T20:31:42.015816] [INFO ] [REMOTE ] NAN: Fetching primary data for 2024-12. [2025-09-17T20:31:42.251722] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T20:31:42.627004] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T20:31:42.815788] [INFO ] [REMOTE ] NAT: Fetching primary data for 2024-12. [2025-09-17T20:31:42.914682] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T20:31:43.615820] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-01. [2025-09-17T20:31:44.417180] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T20:31:44.415875] [INFO ] [REMOTE ] NAD: Fetching primary data for 2025-09. [2025-09-17T20:31:44.437053] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T20:31:45.215782] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-01. [2025-09-17T20:31:45.767383] [INFO ] [REMOTE ] NAD: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T20:31:45.774492] [INFO ] [REMOTE ] NAD: Full fetch complete (50350 records). [2025-09-17T20:31:45.774667] [DEBUG] [VALIDATOR ] NAD: Validating primary data. [2025-09-17T20:31:46.021366] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-06. [2025-09-17T20:31:46.182049] [DEBUG] [VALIDATOR ] NAD: All expected trading days are present. [2025-09-17T20:31:46.182131] [DEBUG] [VALIDATOR ] NAD: Primary data validation passed. [2025-09-17T20:31:46.182960] [INFO ] [MAIN ] NAD: Fetched primary data is valid. [2025-09-17T20:31:46.183006] [DEBUG] [LOCAL ] NAD: Saving primary data. [2025-09-17T20:31:46.184150] [DEBUG] [LOCAL ] NAD: Trimmed 50350 records to 34208 (keeping 200 days of data) [2025-09-17T20:31:46.411636] [DEBUG] [LOCAL ] NAD: Primary data saved (34208 records). [2025-09-17T20:31:46.411828] [INFO ] [MAIN ] NAD: Full history saved. [2025-09-17T20:31:46.411919] [INFO ] [MAIN ] Update Progress: 1449/2371 symbols completed. NAD took 28.3s. Estimated remaining: 2h 14m 44s. Rate: 6.8 symbols/min [2025-09-17T20:31:46.582537] [INFO ] [MAIN ] NATL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:31:46.615719] [DEBUG] [LOCAL ] NATL: Loaded 32794 existing records from primary storage. [2025-09-17T20:31:46.615860] [INFO ] [MAIN ] NATL: Loaded 32794 existing records. [2025-09-17T20:31:46.796201] [WARN ] [MAIN ] NATL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:31:46.796527] [INFO ] [MAIN ] NATL: Wiping existing primary data before full refresh. [2025-09-17T20:31:46.796595] [INFO ] [LOCAL ] NATL: Starting deletion of primary data. [2025-09-17T20:31:46.797299] [DEBUG] [LOCAL ] NATL: Deleted primary data file. [2025-09-17T20:31:46.797353] [INFO ] [MAIN ] NATL: Starting full primary refresh. [2025-09-17T20:31:46.829019] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-02. [2025-09-17T20:31:47.169072] [INFO ] [REMOTE ] NATL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:31:47.200756] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T20:31:47.281908] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T20:31:47.486733] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T20:31:47.615804] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-02. [2025-09-17T20:31:48.415832] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-11. [2025-09-17T20:31:49.215790] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-03. [2025-09-17T20:31:49.355357] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T20:31:49.856213] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T20:31:49.917175] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T20:31:50.015809] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-03. [2025-09-17T20:31:50.815816] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-07. [2025-09-17T20:31:51.615799] [INFO ] [REMOTE ] NATL: Fetching primary data for 2024-12. [2025-09-17T20:31:51.919087] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T20:31:51.993227] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-07 (1.18 seconds). [2025-09-17T20:31:52.415785] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-04. [2025-09-17T20:31:52.717955] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T20:31:53.215802] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-04. [2025-09-17T20:31:53.270574] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T20:31:54.015801] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-05. [2025-09-17T20:31:54.763589] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T20:31:54.815803] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-01. [2025-09-17T20:31:55.071970] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T20:31:55.615756] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-06. [2025-09-17T20:31:56.006039] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T20:31:56.415835] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-08. [2025-09-17T20:31:56.428462] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T20:31:57.215801] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-07. [2025-09-17T20:31:57.672302] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T20:31:58.015789] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-05. [2025-09-17T20:31:58.053418] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T20:31:58.815831] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-02. [2025-09-17T20:31:59.384792] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T20:31:59.615788] [INFO ] [REMOTE ] NABL: Fetching primary data for 2025-09. [2025-09-17T20:31:59.851112] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T20:32:00.415795] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-06. [2025-09-17T20:32:00.650091] [INFO ] [REMOTE ] NABL: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T20:32:00.656929] [INFO ] [REMOTE ] NABL: Full fetch complete (56644 records). [2025-09-17T20:32:00.657050] [DEBUG] [VALIDATOR ] NABL: Validating primary data. [2025-09-17T20:32:01.037730] [DEBUG] [VALIDATOR ] NABL: All expected trading days are present. [2025-09-17T20:32:01.037823] [DEBUG] [VALIDATOR ] NABL: Primary data validation passed. [2025-09-17T20:32:01.038690] [INFO ] [MAIN ] NABL: Fetched primary data is valid. [2025-09-17T20:32:01.038736] [DEBUG] [LOCAL ] NABL: Saving primary data. [2025-09-17T20:32:01.040091] [DEBUG] [LOCAL ] NABL: Trimmed 56644 records to 40412 (keeping 200 days of data) [2025-09-17T20:32:01.221637] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-03. [2025-09-17T20:32:01.284356] [DEBUG] [LOCAL ] NABL: Primary data saved (40412 records). [2025-09-17T20:32:01.284501] [INFO ] [MAIN ] NABL: Full history saved. [2025-09-17T20:32:01.284599] [INFO ] [MAIN ] Update Progress: 1450/2371 symbols completed. NABL took 53.3s. Estimated remaining: 2h 14m 39s. Rate: 6.8 symbols/min [2025-09-17T20:32:01.459029] [INFO ] [MAIN ] NAZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:32:01.464181] [DEBUG] [LOCAL ] NAZ: Loaded 2723 existing records from primary storage. [2025-09-17T20:32:01.464274] [INFO ] [MAIN ] NAZ: Loaded 2723 existing records. [2025-09-17T20:32:01.641511] [WARN ] [MAIN ] NAZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:32:01.641786] [INFO ] [MAIN ] NAZ: Wiping existing primary data before full refresh. [2025-09-17T20:32:01.641842] [INFO ] [LOCAL ] NAZ: Starting deletion of primary data. [2025-09-17T20:32:01.642111] [DEBUG] [LOCAL ] NAZ: Deleted primary data file. [2025-09-17T20:32:01.642156] [INFO ] [MAIN ] NAZ: Starting full primary refresh. [2025-09-17T20:32:02.005937] [INFO ] [REMOTE ] NAZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:32:02.015752] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-11. [2025-09-17T20:32:02.268390] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T20:32:02.665285] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T20:32:02.690084] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T20:32:02.815786] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-04. [2025-09-17T20:32:03.615797] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-08. [2025-09-17T20:32:04.024654] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T20:32:04.415872] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2024-12. [2025-09-17T20:32:04.440001] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T20:32:05.126345] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T20:32:05.215828] [INFO ] [REMOTE ] NAN: Fetching primary data for 2025-09. [2025-09-17T20:32:05.905264] [INFO ] [REMOTE ] NAN: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T20:32:05.907207] [INFO ] [REMOTE ] NAN: Full fetch complete (14297 records). [2025-09-17T20:32:05.907277] [DEBUG] [VALIDATOR ] NAN: Validating primary data. [2025-09-17T20:32:06.020863] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-01. [2025-09-17T20:32:06.283513] [DEBUG] [VALIDATOR ] NAN: All expected trading days are present. [2025-09-17T20:32:06.283596] [DEBUG] [VALIDATOR ] NAN: Primary data validation passed. [2025-09-17T20:32:06.283947] [INFO ] [MAIN ] NAN: Fetched primary data is valid. [2025-09-17T20:32:06.283991] [DEBUG] [LOCAL ] NAN: Saving primary data. [2025-09-17T20:32:06.284479] [DEBUG] [LOCAL ] NAN: Trimmed 14297 records to 9127 (keeping 200 days of data) [2025-09-17T20:32:06.342479] [DEBUG] [LOCAL ] NAN: Primary data saved (9127 records). [2025-09-17T20:32:06.342617] [INFO ] [MAIN ] NAN: Full history saved. [2025-09-17T20:32:06.342721] [INFO ] [MAIN ] Update Progress: 1451/2371 symbols completed. NAN took 27.7s. Estimated remaining: 2h 14m 28s. Rate: 6.8 symbols/min [2025-09-17T20:32:06.515725] [INFO ] [MAIN ] NBB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:32:06.526164] [DEBUG] [LOCAL ] NBB: Loaded 8923 existing records from primary storage. [2025-09-17T20:32:06.526286] [INFO ] [MAIN ] NBB: Loaded 8923 existing records. [2025-09-17T20:32:06.691684] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T20:32:06.710785] [WARN ] [MAIN ] NBB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:32:06.712465] [INFO ] [MAIN ] NBB: Wiping existing primary data before full refresh. [2025-09-17T20:32:06.712562] [INFO ] [LOCAL ] NBB: Starting deletion of primary data. [2025-09-17T20:32:06.712890] [DEBUG] [LOCAL ] NBB: Deleted primary data file. [2025-09-17T20:32:06.712941] [INFO ] [MAIN ] NBB: Starting full primary refresh. [2025-09-17T20:32:06.819929] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-07. [2025-09-17T20:32:07.087132] [INFO ] [REMOTE ] NBB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:32:07.615805] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-02. [2025-09-17T20:32:08.264497] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T20:32:08.415790] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-03. [2025-09-17T20:32:08.559862] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T20:32:09.058687] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T20:32:09.215792] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-05. [2025-09-17T20:32:10.015790] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-08. [2025-09-17T20:32:10.477236] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T20:32:10.815782] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-04. [2025-09-17T20:32:11.510871] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T20:32:11.607153] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T20:32:11.615723] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-05. [2025-09-17T20:32:12.152942] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T20:32:12.415786] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-06. [2025-09-17T20:32:13.215779] [INFO ] [REMOTE ] NAT: Fetching primary data for 2025-09. [2025-09-17T20:32:13.781410] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T20:32:14.015831] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-07. [2025-09-17T20:32:14.718403] [INFO ] [REMOTE ] NAT: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T20:32:14.729633] [INFO ] [REMOTE ] NAT: Full fetch complete (72156 records). [2025-09-17T20:32:14.729920] [DEBUG] [VALIDATOR ] NAT: Validating primary data. [2025-09-17T20:32:14.821066] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-11. [2025-09-17T20:32:15.281842] [DEBUG] [VALIDATOR ] NAT: All expected trading days are present. [2025-09-17T20:32:15.281964] [DEBUG] [VALIDATOR ] NAT: Primary data validation passed. [2025-09-17T20:32:15.283225] [INFO ] [MAIN ] NAT: Fetched primary data is valid. [2025-09-17T20:32:15.283316] [DEBUG] [LOCAL ] NAT: Saving primary data. [2025-09-17T20:32:15.285274] [DEBUG] [LOCAL ] NAT: Trimmed 72156 records to 49155 (keeping 200 days of data) [2025-09-17T20:32:15.404594] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T20:32:15.617009] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-08. [2025-09-17T20:32:15.621792] [DEBUG] [LOCAL ] NAT: Primary data saved (49155 records). [2025-09-17T20:32:15.621874] [INFO ] [MAIN ] NAT: Full history saved. [2025-09-17T20:32:15.622678] [INFO ] [MAIN ] Update Progress: 1452/2371 symbols completed. NAT took 36.9s. Estimated remaining: 2h 14m 19s. Rate: 6.8 symbols/min [2025-09-17T20:32:15.795439] [INFO ] [MAIN ] NBHC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:32:15.802735] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T20:32:15.826544] [DEBUG] [LOCAL ] NBHC: Loaded 22776 existing records from primary storage. [2025-09-17T20:32:15.826701] [INFO ] [MAIN ] NBHC: Loaded 22776 existing records. [2025-09-17T20:32:16.004775] [WARN ] [MAIN ] NBHC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:32:16.005052] [INFO ] [MAIN ] NBHC: Wiping existing primary data before full refresh. [2025-09-17T20:32:16.005098] [INFO ] [LOCAL ] NBHC: Starting deletion of primary data. [2025-09-17T20:32:16.005661] [DEBUG] [LOCAL ] NBHC: Deleted primary data file. [2025-09-17T20:32:16.005710] [INFO ] [MAIN ] NBHC: Starting full primary refresh. [2025-09-17T20:32:16.356550] [INFO ] [REMOTE ] NBHC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:32:16.415717] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-11. [2025-09-17T20:32:17.215817] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-06. [2025-09-17T20:32:17.250074] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T20:32:17.579480] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T20:32:17.653681] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T20:32:18.015799] [INFO ] [REMOTE ] NBB: Fetching primary data for 2024-12. [2025-09-17T20:32:18.786725] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T20:32:18.815711] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2024-12. [2025-09-17T20:32:19.615759] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-07. [2025-09-17T20:32:19.935231] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T20:32:20.312784] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T20:32:20.415781] [INFO ] [REMOTE ] NATL: Fetching primary data for 2025-09. [2025-09-17T20:32:21.215772] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-08. [2025-09-17T20:32:21.738286] [INFO ] [REMOTE ] NATL: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T20:32:21.743302] [INFO ] [REMOTE ] NATL: Full fetch complete (45448 records). [2025-09-17T20:32:21.743402] [DEBUG] [VALIDATOR ] NATL: Validating primary data. [2025-09-17T20:32:21.856564] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T20:32:22.020843] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-01. [2025-09-17T20:32:22.149965] [DEBUG] [VALIDATOR ] NATL: All expected trading days are present. [2025-09-17T20:32:22.150049] [DEBUG] [VALIDATOR ] NATL: Primary data validation passed. [2025-09-17T20:32:22.150819] [INFO ] [MAIN ] NATL: Fetched primary data is valid. [2025-09-17T20:32:22.150864] [DEBUG] [LOCAL ] NATL: Saving primary data. [2025-09-17T20:32:22.151921] [DEBUG] [LOCAL ] NATL: Trimmed 45448 records to 32892 (keeping 200 days of data) [2025-09-17T20:32:22.356509] [DEBUG] [LOCAL ] NATL: Primary data saved (32892 records). [2025-09-17T20:32:22.356698] [INFO ] [MAIN ] NATL: Full history saved. [2025-09-17T20:32:22.356812] [INFO ] [MAIN ] Update Progress: 1453/2371 symbols completed. NATL took 35.9s. Estimated remaining: 2h 14m 9s. Rate: 6.8 symbols/min [2025-09-17T20:32:22.542085] [INFO ] [MAIN ] NBR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:32:22.579983] [DEBUG] [LOCAL ] NBR: Loaded 35065 existing records from primary storage. [2025-09-17T20:32:22.580159] [INFO ] [MAIN ] NBR: Loaded 35065 existing records. [2025-09-17T20:32:22.761588] [WARN ] [MAIN ] NBR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:32:22.761869] [INFO ] [MAIN ] NBR: Wiping existing primary data before full refresh. [2025-09-17T20:32:22.761915] [INFO ] [LOCAL ] NBR: Starting deletion of primary data. [2025-09-17T20:32:22.762664] [DEBUG] [LOCAL ] NBR: Deleted primary data file. [2025-09-17T20:32:22.762717] [INFO ] [MAIN ] NBR: Starting full primary refresh. [2025-09-17T20:32:22.822973] [INFO ] [REMOTE ] NAZ: Fetching primary data for 2025-09. [2025-09-17T20:32:23.192783] [INFO ] [REMOTE ] NBR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:32:23.249908] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T20:32:23.308820] [INFO ] [REMOTE ] NAZ: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T20:32:23.310250] [INFO ] [REMOTE ] NAZ: Full fetch complete (4434 records). [2025-09-17T20:32:23.310339] [DEBUG] [VALIDATOR ] NAZ: Validating primary data. [2025-09-17T20:32:23.620899] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-11. [2025-09-17T20:32:23.681316] [DEBUG] [VALIDATOR ] NAZ: All expected trading days are present. [2025-09-17T20:32:23.681435] [DEBUG] [VALIDATOR ] NAZ: Primary data validation passed. [2025-09-17T20:32:23.681638] [INFO ] [MAIN ] NAZ: Fetched primary data is valid. [2025-09-17T20:32:23.681706] [DEBUG] [LOCAL ] NAZ: Saving primary data. [2025-09-17T20:32:23.682123] [DEBUG] [LOCAL ] NAZ: Trimmed 4434 records to 2738 (keeping 200 days of data) [2025-09-17T20:32:23.703140] [DEBUG] [LOCAL ] NAZ: Primary data saved (2738 records). [2025-09-17T20:32:23.703296] [INFO ] [MAIN ] NAZ: Full history saved. [2025-09-17T20:32:23.703393] [INFO ] [MAIN ] Update Progress: 1454/2371 symbols completed. NAZ took 22.4s. Estimated remaining: 2h 13m 56s. Rate: 6.8 symbols/min [2025-09-17T20:32:23.882408] [INFO ] [MAIN ] NBXG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:32:23.906445] [DEBUG] [LOCAL ] NBXG: Loaded 22900 existing records from primary storage. [2025-09-17T20:32:23.906600] [INFO ] [MAIN ] NBXG: Loaded 22900 existing records. [2025-09-17T20:32:24.094232] [WARN ] [MAIN ] NBXG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:32:24.094513] [INFO ] [MAIN ] NBXG: Wiping existing primary data before full refresh. [2025-09-17T20:32:24.094609] [INFO ] [LOCAL ] NBXG: Starting deletion of primary data. [2025-09-17T20:32:24.095466] [DEBUG] [LOCAL ] NBXG: Deleted primary data file. [2025-09-17T20:32:24.095527] [INFO ] [MAIN ] NBXG: Starting full primary refresh. [2025-09-17T20:32:24.420854] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-01. [2025-09-17T20:32:24.496199] [INFO ] [REMOTE ] NBXG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:32:25.160132] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T20:32:25.215763] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-02. [2025-09-17T20:32:25.346815] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T20:32:26.015807] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-11. [2025-09-17T20:32:26.298754] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T20:32:26.815754] [INFO ] [REMOTE ] NBR: Fetching primary data for 2024-12. [2025-09-17T20:32:27.166216] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T20:32:27.615841] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-03. [2025-09-17T20:32:27.876832] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T20:32:28.415773] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-02. [2025-09-17T20:32:28.573527] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T20:32:29.204875] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T20:32:29.215706] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-03. [2025-09-17T20:32:29.916982] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T20:32:30.015797] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-01. [2025-09-17T20:32:30.815784] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2024-12. [2025-09-17T20:32:31.320103] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T20:32:31.615792] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-04. [2025-09-17T20:32:32.060816] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T20:32:32.415822] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-02. [2025-09-17T20:32:32.570945] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T20:32:33.215832] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-05. [2025-09-17T20:32:33.880980] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T20:32:34.015830] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-04. [2025-09-17T20:32:34.316540] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T20:32:34.603497] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T20:32:34.815792] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-06. [2025-09-17T20:32:35.615820] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-05. [2025-09-17T20:32:35.652740] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T20:32:36.121023] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T20:32:36.415807] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-03. [2025-09-17T20:32:37.215791] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-06. [2025-09-17T20:32:38.015898] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-01. [2025-09-17T20:32:38.038251] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T20:32:38.119289] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T20:32:38.815842] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-04. [2025-09-17T20:32:38.931901] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T20:32:39.615838] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-02. [2025-09-17T20:32:40.231852] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T20:32:40.415819] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-07. [2025-09-17T20:32:40.527702] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T20:32:41.215792] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-05. [2025-09-17T20:32:41.346500] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T20:32:42.015814] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-08. [2025-09-17T20:32:42.398221] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T20:32:42.815835] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-03. [2025-09-17T20:32:42.901896] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T20:32:43.615820] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-07. [2025-09-17T20:32:43.740786] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T20:32:44.415831] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-04. [2025-09-17T20:32:44.703760] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T20:32:45.215809] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-08. [2025-09-17T20:32:45.762017] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T20:32:46.015833] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-05. [2025-09-17T20:32:46.280600] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T20:32:46.815802] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-06. [2025-09-17T20:32:47.318100] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T20:32:47.615794] [INFO ] [REMOTE ] NBHC: Fetching primary data for 2025-09. [2025-09-17T20:32:48.355808] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T20:32:48.415786] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-07. [2025-09-17T20:32:48.839064] [INFO ] [REMOTE ] NBHC: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T20:32:48.843256] [INFO ] [REMOTE ] NBHC: Full fetch complete (31372 records). [2025-09-17T20:32:48.843446] [DEBUG] [VALIDATOR ] NBHC: Validating primary data. [2025-09-17T20:32:49.222471] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-06. [2025-09-17T20:32:49.236578] [DEBUG] [VALIDATOR ] NBHC: All expected trading days are present. [2025-09-17T20:32:49.237390] [DEBUG] [VALIDATOR ] NBHC: Primary data validation passed. [2025-09-17T20:32:49.238278] [INFO ] [MAIN ] NBHC: Fetched primary data is valid. [2025-09-17T20:32:49.238419] [DEBUG] [LOCAL ] NBHC: Saving primary data. [2025-09-17T20:32:49.239515] [DEBUG] [LOCAL ] NBHC: Trimmed 31372 records to 22916 (keeping 200 days of data) [2025-09-17T20:32:49.385287] [DEBUG] [LOCAL ] NBHC: Primary data saved (22916 records). [2025-09-17T20:32:49.385436] [INFO ] [MAIN ] NBHC: Full history saved. [2025-09-17T20:32:49.385559] [INFO ] [MAIN ] Update Progress: 1455/2371 symbols completed. NBHC took 33.8s. Estimated remaining: 2h 13m 58s. Rate: 6.8 symbols/min [2025-09-17T20:32:49.557497] [INFO ] [MAIN ] NC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:32:49.561427] [DEBUG] [LOCAL ] NC: Loaded 1919 existing records from primary storage. [2025-09-17T20:32:49.561511] [INFO ] [MAIN ] NC: Loaded 1919 existing records. [2025-09-17T20:32:49.749333] [WARN ] [MAIN ] NC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:32:49.749604] [INFO ] [MAIN ] NC: Wiping existing primary data before full refresh. [2025-09-17T20:32:49.749704] [INFO ] [LOCAL ] NC: Starting deletion of primary data. [2025-09-17T20:32:49.749923] [DEBUG] [LOCAL ] NC: Deleted primary data file. [2025-09-17T20:32:49.749970] [INFO ] [MAIN ] NC: Starting full primary refresh. [2025-09-17T20:32:50.016676] [INFO ] [REMOTE ] NBB: Fetching primary data for 2025-09. [2025-09-17T20:32:50.125442] [INFO ] [REMOTE ] NC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:32:50.157059] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T20:32:50.490417] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T20:32:50.579342] [INFO ] [REMOTE ] NBB: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T20:32:50.581356] [INFO ] [REMOTE ] NBB: Full fetch complete (13999 records). [2025-09-17T20:32:50.581442] [DEBUG] [VALIDATOR ] NBB: Validating primary data. [2025-09-17T20:32:50.824211] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-11. [2025-09-17T20:32:50.993634] [DEBUG] [VALIDATOR ] NBB: All expected trading days are present. [2025-09-17T20:32:50.993780] [DEBUG] [VALIDATOR ] NBB: Primary data validation passed. [2025-09-17T20:32:50.994339] [INFO ] [MAIN ] NBB: Fetched primary data is valid. [2025-09-17T20:32:50.994407] [DEBUG] [LOCAL ] NBB: Saving primary data. [2025-09-17T20:32:50.995000] [DEBUG] [LOCAL ] NBB: Trimmed 13999 records to 8927 (keeping 200 days of data) [2025-09-17T20:32:51.054655] [DEBUG] [LOCAL ] NBB: Primary data saved (8927 records). [2025-09-17T20:32:51.054851] [INFO ] [MAIN ] NBB: Full history saved. [2025-09-17T20:32:51.054961] [INFO ] [MAIN ] Update Progress: 1456/2371 symbols completed. NBB took 44.7s. Estimated remaining: 2h 13m 45s. Rate: 6.8 symbols/min [2025-09-17T20:32:51.238112] [INFO ] [MAIN ] NCA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:32:51.250786] [DEBUG] [LOCAL ] NCA: Loaded 9900 existing records from primary storage. [2025-09-17T20:32:51.251003] [INFO ] [MAIN ] NCA: Loaded 9900 existing records. [2025-09-17T20:32:51.445030] [WARN ] [MAIN ] NCA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:32:51.445549] [INFO ] [MAIN ] NCA: Wiping existing primary data before full refresh. [2025-09-17T20:32:51.445601] [INFO ] [LOCAL ] NCA: Starting deletion of primary data. [2025-09-17T20:32:51.446158] [DEBUG] [LOCAL ] NCA: Deleted primary data file. [2025-09-17T20:32:51.446213] [INFO ] [MAIN ] NCA: Starting full primary refresh. [2025-09-17T20:32:51.559938] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T20:32:51.627344] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-08. [2025-09-17T20:32:51.833716] [INFO ] [REMOTE ] NCA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:32:52.415868] [INFO ] [REMOTE ] NC: Fetching primary data for 2024-12. [2025-09-17T20:32:53.042399] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T20:32:53.218294] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-07. [2025-09-17T20:32:53.221961] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T20:32:54.015816] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-01. [2025-09-17T20:32:54.371853] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T20:32:54.552709] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T20:32:54.815793] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-11. [2025-09-17T20:32:55.474374] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T20:32:55.615807] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-08. [2025-09-17T20:32:56.415837] [INFO ] [REMOTE ] NBR: Fetching primary data for 2025-09. [2025-09-17T20:32:56.847388] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T20:32:57.215836] [INFO ] [REMOTE ] NBXG: Fetching primary data for 2025-09. [2025-09-17T20:32:57.683229] [INFO ] [REMOTE ] NBR: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T20:32:57.688337] [INFO ] [REMOTE ] NBR: Full fetch complete (49143 records). [2025-09-17T20:32:57.688449] [DEBUG] [VALIDATOR ] NBR: Validating primary data. [2025-09-17T20:32:58.017886] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-02. [2025-09-17T20:32:58.113326] [DEBUG] [VALIDATOR ] NBR: All expected trading days are present. [2025-09-17T20:32:58.113160] [INFO ] [REMOTE ] NBXG: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T20:32:58.113576] [DEBUG] [VALIDATOR ] NBR: Primary data validation passed. [2025-09-17T20:32:58.117753] [INFO ] [MAIN ] NBR: Fetched primary data is valid. [2025-09-17T20:32:58.117956] [DEBUG] [LOCAL ] NBR: Saving primary data. [2025-09-17T20:32:58.118884] [INFO ] [REMOTE ] NBXG: Full fetch complete (33238 records). [2025-09-17T20:32:58.119189] [DEBUG] [VALIDATOR ] NBXG: Validating primary data. [2025-09-17T20:32:58.125409] [DEBUG] [LOCAL ] NBR: Trimmed 49143 records to 35033 (keeping 200 days of data) [2025-09-17T20:32:58.487167] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T20:32:58.748196] [DEBUG] [VALIDATOR ] NBXG: All expected trading days are present. [2025-09-17T20:32:58.751890] [DEBUG] [VALIDATOR ] NBXG: Primary data validation passed. [2025-09-17T20:32:58.754237] [INFO ] [MAIN ] NBXG: Fetched primary data is valid. [2025-09-17T20:32:58.754314] [DEBUG] [LOCAL ] NBXG: Saving primary data. [2025-09-17T20:32:58.758927] [DEBUG] [LOCAL ] NBXG: Trimmed 33238 records to 22876 (keeping 200 days of data) [2025-09-17T20:32:58.764054] [DEBUG] [LOCAL ] NBR: Primary data saved (35033 records). [2025-09-17T20:32:58.764433] [INFO ] [MAIN ] NBR: Full history saved. [2025-09-17T20:32:58.764611] [INFO ] [MAIN ] Update Progress: 1457/2371 symbols completed. NBR took 36.4s. Estimated remaining: 2h 13m 35s. Rate: 6.8 symbols/min [2025-09-17T20:32:58.825331] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-03. [2025-09-17T20:32:59.054165] [INFO ] [MAIN ] NCDL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:32:59.083183] [DEBUG] [LOCAL ] NCDL: Loaded 21877 existing records from primary storage. [2025-09-17T20:32:59.083870] [INFO ] [MAIN ] NCDL: Loaded 21877 existing records. [2025-09-17T20:32:59.286368] [WARN ] [MAIN ] NCDL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:32:59.288757] [INFO ] [MAIN ] NCDL: Wiping existing primary data before full refresh. [2025-09-17T20:32:59.289153] [INFO ] [LOCAL ] NCDL: Starting deletion of primary data. [2025-09-17T20:32:59.290247] [DEBUG] [LOCAL ] NCDL: Deleted primary data file. [2025-09-17T20:32:59.290904] [INFO ] [MAIN ] NCDL: Starting full primary refresh. [2025-09-17T20:32:59.538472] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T20:32:59.621988] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-04. [2025-09-17T20:32:59.629031] [DEBUG] [LOCAL ] NBXG: Primary data saved (22876 records). [2025-09-17T20:32:59.630916] [INFO ] [MAIN ] NBXG: Full history saved. [2025-09-17T20:32:59.631087] [INFO ] [MAIN ] Update Progress: 1458/2371 symbols completed. NBXG took 35.9s. Estimated remaining: 2h 13m 21s. Rate: 6.8 symbols/min [2025-09-17T20:32:59.803675] [INFO ] [REMOTE ] NCDL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:32:59.901737] [INFO ] [MAIN ] NCLH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:32:59.956323] [DEBUG] [LOCAL ] NCLH: Loaded 53753 existing records from primary storage. [2025-09-17T20:32:59.956481] [INFO ] [MAIN ] NCLH: Loaded 53753 existing records. [2025-09-17T20:33:00.149102] [WARN ] [MAIN ] NCLH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:33:00.154101] [INFO ] [MAIN ] NCLH: Wiping existing primary data before full refresh. [2025-09-17T20:33:00.154795] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-17T20:33:00.155066] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-17T20:33:00.156638] [DEBUG] [LOCAL ] NCLH: Deleted primary data file. [2025-09-17T20:33:00.157381] [INFO ] [MAIN ] NCLH: Starting full primary refresh. [2025-09-17T20:33:00.421121] [INFO ] [REMOTE ] NCA: Fetching primary data for 2024-12. [2025-09-17T20:33:00.556422] [INFO ] [REMOTE ] NCLH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:33:01.215832] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-11. [2025-09-17T20:33:01.345203] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T20:33:02.015805] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-01. [2025-09-17T20:33:02.488799] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T20:33:02.768042] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T20:33:02.815816] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2024-12. [2025-09-17T20:33:03.615823] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-02. [2025-09-17T20:33:03.765666] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T20:33:04.415830] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-11. [2025-09-17T20:33:04.461503] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T20:33:05.215809] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-05. [2025-09-17T20:33:05.749306] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T20:33:06.015855] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-01. [2025-09-17T20:33:06.562362] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-11 (2.15 seconds). [2025-09-17T20:33:06.815861] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-06. [2025-09-17T20:33:06.922368] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T20:33:07.359531] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T20:33:07.615934] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-07. [2025-09-17T20:33:08.140824] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T20:33:08.415780] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-02. [2025-09-17T20:33:09.163039] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T20:33:09.215832] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2024-12. [2025-09-17T20:33:10.015796] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-03. [2025-09-17T20:33:10.815781] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-08. [2025-09-17T20:33:11.225897] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T20:33:11.358695] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-17T20:33:11.433246] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T20:33:11.615777] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-01. [2025-09-17T20:33:12.415816] [INFO ] [REMOTE ] NC: Fetching primary data for 2025-09. [2025-09-17T20:33:12.868808] [INFO ] [REMOTE ] NC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T20:33:12.869725] [INFO ] [REMOTE ] NC: Full fetch complete (2701 records). [2025-09-17T20:33:12.869798] [DEBUG] [VALIDATOR ] NC: Validating primary data. [2025-09-17T20:33:13.228579] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-04. [2025-09-17T20:33:13.235283] [DEBUG] [VALIDATOR ] NC: All expected trading days are present. [2025-09-17T20:33:13.236170] [DEBUG] [VALIDATOR ] NC: Primary data validation passed. [2025-09-17T20:33:13.236281] [INFO ] [MAIN ] NC: Fetched primary data is valid. [2025-09-17T20:33:13.236333] [DEBUG] [LOCAL ] NC: Saving primary data. [2025-09-17T20:33:13.236720] [DEBUG] [LOCAL ] NC: Trimmed 2701 records to 1920 (keeping 200 days of data) [2025-09-17T20:33:13.250041] [DEBUG] [LOCAL ] NC: Primary data saved (1920 records). [2025-09-17T20:33:13.250105] [INFO ] [MAIN ] NC: Full history saved. [2025-09-17T20:33:13.250191] [INFO ] [MAIN ] Update Progress: 1459/2371 symbols completed. NC took 23.9s. Estimated remaining: 2h 13m 16s. Rate: 6.8 symbols/min [2025-09-17T20:33:13.418315] [INFO ] [MAIN ] NCV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:33:13.435376] [DEBUG] [LOCAL ] NCV: Loaded 13380 existing records from primary storage. [2025-09-17T20:33:13.435548] [INFO ] [MAIN ] NCV: Loaded 13380 existing records. [2025-09-17T20:33:13.614261] [WARN ] [MAIN ] NCV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:33:13.614610] [INFO ] [MAIN ] NCV: Wiping existing primary data before full refresh. [2025-09-17T20:33:13.614697] [INFO ] [LOCAL ] NCV: Starting deletion of primary data. [2025-09-17T20:33:13.615456] [DEBUG] [LOCAL ] NCV: Deleted primary data file. [2025-09-17T20:33:13.615519] [INFO ] [MAIN ] NCV: Starting full primary refresh. [2025-09-17T20:33:13.984098] [INFO ] [REMOTE ] NCV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:33:14.014906] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-17T20:33:14.024919] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-03. [2025-09-17T20:33:14.616518] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T20:33:14.815784] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-02. [2025-09-17T20:33:14.879006] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T20:33:15.615800] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-05. [2025-09-17T20:33:16.415794] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-04. [2025-09-17T20:33:16.649709] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T20:33:16.827537] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T20:33:17.215796] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-03. [2025-09-17T20:33:17.349449] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T20:33:18.015790] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-05. [2025-09-17T20:33:18.815760] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-06. [2025-09-17T20:33:18.966892] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T20:33:19.459246] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-17T20:33:19.615793] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-06. [2025-09-17T20:33:19.886051] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T20:33:20.195174] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T20:33:20.415788] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-07. [2025-09-17T20:33:21.215774] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-07. [2025-09-17T20:33:21.249365] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T20:33:22.015802] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-11. [2025-09-17T20:33:22.364335] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T20:33:22.815802] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-04. [2025-09-17T20:33:22.977446] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T20:33:23.615784] [INFO ] [REMOTE ] NCV: Fetching primary data for 2024-12. [2025-09-17T20:33:24.415763] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-08. [2025-09-17T20:33:24.484140] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T20:33:25.121384] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-17T20:33:25.213440] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T20:33:25.215724] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-05. [2025-09-17T20:33:26.015786] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-01. [2025-09-17T20:33:26.815771] [INFO ] [REMOTE ] NCA: Fetching primary data for 2025-09. [2025-09-17T20:33:27.120624] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T20:33:27.194848] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T20:33:27.546922] [INFO ] [REMOTE ] NCA: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T20:33:27.548705] [INFO ] [REMOTE ] NCA: Full fetch complete (15964 records). [2025-09-17T20:33:27.548789] [DEBUG] [VALIDATOR ] NCA: Validating primary data. [2025-09-17T20:33:27.620991] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-02. [2025-09-17T20:33:27.949020] [DEBUG] [VALIDATOR ] NCA: All expected trading days are present. [2025-09-17T20:33:27.949151] [DEBUG] [VALIDATOR ] NCA: Primary data validation passed. [2025-09-17T20:33:27.949688] [INFO ] [MAIN ] NCA: Fetched primary data is valid. [2025-09-17T20:33:27.949739] [DEBUG] [LOCAL ] NCA: Saving primary data. [2025-09-17T20:33:27.950866] [DEBUG] [LOCAL ] NCA: Trimmed 15964 records to 9980 (keeping 200 days of data) [2025-09-17T20:33:28.016876] [DEBUG] [LOCAL ] NCA: Primary data saved (9980 records). [2025-09-17T20:33:28.017053] [INFO ] [MAIN ] NCA: Full history saved. [2025-09-17T20:33:28.017154] [INFO ] [MAIN ] Update Progress: 1460/2371 symbols completed. NCA took 37.0s. Estimated remaining: 2h 13m 11s. Rate: 6.8 symbols/min [2025-09-17T20:33:28.189819] [INFO ] [MAIN ] NCZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:33:28.203073] [DEBUG] [LOCAL ] NCZ: Loaded 11724 existing records from primary storage. [2025-09-17T20:33:28.203201] [INFO ] [MAIN ] NCZ: Loaded 11724 existing records. [2025-09-17T20:33:28.421011] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-06. [2025-09-17T20:33:28.453872] [WARN ] [MAIN ] NCZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:33:28.454189] [INFO ] [MAIN ] NCZ: Wiping existing primary data before full refresh. [2025-09-17T20:33:28.454238] [INFO ] [LOCAL ] NCZ: Starting deletion of primary data. [2025-09-17T20:33:28.454865] [DEBUG] [LOCAL ] NCZ: Deleted primary data file. [2025-09-17T20:33:28.454927] [INFO ] [MAIN ] NCZ: Starting full primary refresh. [2025-09-17T20:33:28.849904] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T20:33:28.879537] [INFO ] [REMOTE ] NCZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:33:29.215830] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-11. [2025-09-17T20:33:30.015817] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-03. [2025-09-17T20:33:30.370984] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T20:33:30.457806] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T20:33:30.815789] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-07. [2025-09-17T20:33:30.928235] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T20:33:31.615795] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-04. [2025-09-17T20:33:32.415828] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-08. [2025-09-17T20:33:32.608954] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T20:33:33.175904] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-07 (2.36 seconds). [2025-09-17T20:33:33.200114] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T20:33:33.215717] [INFO ] [REMOTE ] NCDL: Fetching primary data for 2025-09. [2025-09-17T20:33:34.003211] [INFO ] [REMOTE ] NCDL: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T20:33:34.006293] [INFO ] [REMOTE ] NCDL: Full fetch complete (33678 records). [2025-09-17T20:33:34.006392] [DEBUG] [VALIDATOR ] NCDL: Validating primary data. [2025-09-17T20:33:34.020922] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-08. [2025-09-17T20:33:34.424013] [DEBUG] [VALIDATOR ] NCDL: All expected trading days are present. [2025-09-17T20:33:34.424108] [DEBUG] [VALIDATOR ] NCDL: Primary data validation passed. [2025-09-17T20:33:34.424924] [INFO ] [MAIN ] NCDL: Fetched primary data is valid. [2025-09-17T20:33:34.424978] [DEBUG] [LOCAL ] NCDL: Saving primary data. [2025-09-17T20:33:34.425927] [DEBUG] [LOCAL ] NCDL: Trimmed 33678 records to 21844 (keeping 200 days of data) [2025-09-17T20:33:34.568223] [DEBUG] [LOCAL ] NCDL: Primary data saved (21844 records). [2025-09-17T20:33:34.568361] [INFO ] [MAIN ] NCDL: Full history saved. [2025-09-17T20:33:34.568448] [INFO ] [MAIN ] Update Progress: 1461/2371 symbols completed. NCDL took 35.8s. Estimated remaining: 2h 13m 1s. Rate: 6.8 symbols/min [2025-09-17T20:33:34.752427] [INFO ] [MAIN ] NDMO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:33:34.769571] [DEBUG] [LOCAL ] NDMO: Loaded 16383 existing records from primary storage. [2025-09-17T20:33:34.769729] [INFO ] [MAIN ] NDMO: Loaded 16383 existing records. [2025-09-17T20:33:34.825511] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2024-12. [2025-09-17T20:33:34.958411] [WARN ] [MAIN ] NDMO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:33:34.958792] [INFO ] [MAIN ] NDMO: Wiping existing primary data before full refresh. [2025-09-17T20:33:34.958858] [INFO ] [LOCAL ] NDMO: Starting deletion of primary data. [2025-09-17T20:33:34.959629] [DEBUG] [LOCAL ] NDMO: Deleted primary data file. [2025-09-17T20:33:34.959731] [INFO ] [MAIN ] NDMO: Starting full primary refresh. [2025-09-17T20:33:35.355965] [INFO ] [REMOTE ] NDMO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:33:35.615798] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-11. [2025-09-17T20:33:36.032164] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T20:33:36.231803] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-17T20:33:36.256279] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T20:33:36.415799] [INFO ] [REMOTE ] NCLH: Fetching primary data for 2025-09. [2025-09-17T20:33:37.215815] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-01. [2025-09-17T20:33:37.242046] [INFO ] [REMOTE ] NCLH: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T20:33:37.249865] [INFO ] [REMOTE ] NCLH: Full fetch complete (77328 records). [2025-09-17T20:33:37.250069] [DEBUG] [VALIDATOR ] NCLH: Validating primary data. [2025-09-17T20:33:37.252390] [FATAL] [VALIDATOR ] NCLH: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:33:37.252517] [FATAL] [MAIN ] NCLH: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:33:37.252564] [WARN ] [MAIN ] NCLH: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:33:37.252620] [INFO ] [LOCAL ] NCLH: Starting deletion of primary data. [2025-09-17T20:33:37.252728] [DEBUG] [LOCAL ] NCLH: No primary data file found to delete. [2025-09-17T20:33:37.252790] [INFO ] [LOCAL ] NCLH: Starting deletion of derivative data. [2025-09-17T20:33:37.253124] [DEBUG] [LOCAL ] NCLH: Deleted derivative data file. [2025-09-17T20:33:37.253223] [INFO ] [MAIN ] Update Progress: 1462/2371 symbols completed. NCLH took 37.6s. Estimated remaining: 2h 12m 48s. Rate: 6.8 symbols/min [2025-09-17T20:33:37.438053] [INFO ] [MAIN ] NE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:33:37.497091] [DEBUG] [LOCAL ] NE: Loaded 52384 existing records from primary storage. [2025-09-17T20:33:37.497280] [INFO ] [MAIN ] NE: Loaded 52384 existing records. [2025-09-17T20:33:37.687403] [WARN ] [MAIN ] NE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:33:37.687753] [INFO ] [MAIN ] NE: Wiping existing primary data before full refresh. [2025-09-17T20:33:37.687805] [INFO ] [LOCAL ] NE: Starting deletion of primary data. [2025-09-17T20:33:37.689422] [DEBUG] [LOCAL ] NE: Deleted primary data file. [2025-09-17T20:33:37.689490] [INFO ] [MAIN ] NE: Starting full primary refresh. [2025-09-17T20:33:38.020946] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-05. [2025-09-17T20:33:38.054274] [INFO ] [REMOTE ] NE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:33:38.529372] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T20:33:38.815804] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-02. [2025-09-17T20:33:39.036089] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T20:33:39.615792] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-06. [2025-09-17T20:33:39.983732] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T20:33:40.319247] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T20:33:40.415770] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2024-12. [2025-09-17T20:33:41.215793] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-11. [2025-09-17T20:33:41.713159] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T20:33:42.015822] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-03. [2025-09-17T20:33:42.815843] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-07. [2025-09-17T20:33:43.000829] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T20:33:43.207610] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T20:33:43.563031] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T20:33:43.615843] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-01. [2025-09-17T20:33:44.415797] [INFO ] [REMOTE ] NE: Fetching primary data for 2024-12. [2025-09-17T20:33:44.665287] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T20:33:45.215812] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-02. [2025-09-17T20:33:46.015771] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-08. [2025-09-17T20:33:46.082816] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T20:33:46.453856] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T20:33:46.815807] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-01. [2025-09-17T20:33:47.287710] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T20:33:47.615816] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-04. [2025-09-17T20:33:48.415766] [INFO ] [REMOTE ] NCV: Fetching primary data for 2025-09. [2025-09-17T20:33:48.527687] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T20:33:48.892430] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T20:33:49.074830] [INFO ] [REMOTE ] NCV: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T20:33:49.077224] [INFO ] [REMOTE ] NCV: Full fetch complete (23278 records). [2025-09-17T20:33:49.077352] [DEBUG] [VALIDATOR ] NCV: Validating primary data. [2025-09-17T20:33:49.220855] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-03. [2025-09-17T20:33:49.447694] [DEBUG] [VALIDATOR ] NCV: All expected trading days are present. [2025-09-17T20:33:49.447778] [DEBUG] [VALIDATOR ] NCV: Primary data validation passed. [2025-09-17T20:33:49.448299] [INFO ] [MAIN ] NCV: Fetched primary data is valid. [2025-09-17T20:33:49.448360] [DEBUG] [LOCAL ] NCV: Saving primary data. [2025-09-17T20:33:49.449271] [DEBUG] [LOCAL ] NCV: Trimmed 23278 records to 13420 (keeping 200 days of data) [2025-09-17T20:33:49.537563] [DEBUG] [LOCAL ] NCV: Primary data saved (13420 records). [2025-09-17T20:33:49.537741] [INFO ] [MAIN ] NCV: Full history saved. [2025-09-17T20:33:49.537906] [INFO ] [MAIN ] Update Progress: 1463/2371 symbols completed. NCV took 36.3s. Estimated remaining: 2h 12m 41s. Rate: 6.8 symbols/min [2025-09-17T20:33:49.705425] [INFO ] [MAIN ] NEA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:33:49.747862] [DEBUG] [LOCAL ] NEA: Loaded 35411 existing records from primary storage. [2025-09-17T20:33:49.748011] [INFO ] [MAIN ] NEA: Loaded 35411 existing records. [2025-09-17T20:33:49.924994] [WARN ] [MAIN ] NEA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:33:49.925261] [INFO ] [MAIN ] NEA: Wiping existing primary data before full refresh. [2025-09-17T20:33:49.925315] [INFO ] [LOCAL ] NEA: Starting deletion of primary data. [2025-09-17T20:33:49.926578] [DEBUG] [LOCAL ] NEA: Deleted primary data file. [2025-09-17T20:33:49.926633] [INFO ] [MAIN ] NEA: Starting full primary refresh. [2025-09-17T20:33:50.022895] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-02. [2025-09-17T20:33:50.300810] [INFO ] [REMOTE ] NEA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:33:50.413682] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T20:33:50.815823] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-04. [2025-09-17T20:33:51.611964] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T20:33:51.621058] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-11. [2025-09-17T20:33:51.691621] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T20:33:52.415774] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-03. [2025-09-17T20:33:53.092228] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T20:33:53.215806] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-05. [2025-09-17T20:33:54.015695] [INFO ] [REMOTE ] NEA: Fetching primary data for 2024-12. [2025-09-17T20:33:54.056227] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T20:33:54.182101] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T20:33:54.815784] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-04. [2025-09-17T20:33:55.461112] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T20:33:55.615799] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-01. [2025-09-17T20:33:56.415836] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-06. [2025-09-17T20:33:56.578113] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T20:33:56.839407] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T20:33:57.066824] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T20:33:57.215740] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-07. [2025-09-17T20:33:58.015759] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-05. [2025-09-17T20:33:58.323974] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T20:33:58.652114] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T20:33:58.815830] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-06. [2025-09-17T20:33:59.615799] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-05. [2025-09-17T20:33:59.709039] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T20:34:00.415836] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-07. [2025-09-17T20:34:01.215799] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-02. [2025-09-17T20:34:01.614399] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T20:34:01.714866] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T20:34:02.015813] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-08. [2025-09-17T20:34:02.631676] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T20:34:02.815756] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-08. [2025-09-17T20:34:02.872416] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T20:34:03.532043] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T20:34:03.615732] [INFO ] [REMOTE ] NCZ: Fetching primary data for 2025-09. [2025-09-17T20:34:04.352849] [INFO ] [REMOTE ] NCZ: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T20:34:04.354861] [INFO ] [REMOTE ] NCZ: Full fetch complete (21568 records). [2025-09-17T20:34:04.354935] [DEBUG] [VALIDATOR ] NCZ: Validating primary data. [2025-09-17T20:34:04.420825] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-06. [2025-09-17T20:34:04.731119] [DEBUG] [VALIDATOR ] NCZ: All expected trading days are present. [2025-09-17T20:34:04.731206] [DEBUG] [VALIDATOR ] NCZ: Primary data validation passed. [2025-09-17T20:34:04.731707] [INFO ] [MAIN ] NCZ: Fetched primary data is valid. [2025-09-17T20:34:04.731750] [DEBUG] [LOCAL ] NCZ: Saving primary data. [2025-09-17T20:34:04.732689] [DEBUG] [LOCAL ] NCZ: Trimmed 21568 records to 11777 (keeping 200 days of data) [2025-09-17T20:34:04.808489] [DEBUG] [LOCAL ] NCZ: Primary data saved (11777 records). [2025-09-17T20:34:04.808654] [INFO ] [MAIN ] NCZ: Full history saved. [2025-09-17T20:34:04.808747] [INFO ] [MAIN ] Update Progress: 1464/2371 symbols completed. NCZ took 36.8s. Estimated remaining: 2h 12m 37s. Rate: 6.8 symbols/min [2025-09-17T20:34:04.982076] [INFO ] [MAIN ] NEE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:34:05.039600] [DEBUG] [LOCAL ] NEE: Loaded 53707 existing records from primary storage. [2025-09-17T20:34:05.039771] [INFO ] [MAIN ] NEE: Loaded 53707 existing records. [2025-09-17T20:34:05.216349] [WARN ] [MAIN ] NEE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:34:05.216159] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-03. [2025-09-17T20:34:05.217591] [INFO ] [MAIN ] NEE: Wiping existing primary data before full refresh. [2025-09-17T20:34:05.217681] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-17T20:34:05.219522] [DEBUG] [LOCAL ] NEE: Deleted primary data file. [2025-09-17T20:34:05.219614] [INFO ] [MAIN ] NEE: Starting full primary refresh. [2025-09-17T20:34:05.574118] [INFO ] [REMOTE ] NEE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:34:06.015742] [INFO ] [REMOTE ] NDMO: Fetching primary data for 2025-09. [2025-09-17T20:34:06.219078] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T20:34:06.445061] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T20:34:06.815812] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-04. [2025-09-17T20:34:07.021543] [INFO ] [REMOTE ] NDMO: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T20:34:07.027614] [INFO ] [REMOTE ] NDMO: Full fetch complete (25100 records). [2025-09-17T20:34:07.027772] [DEBUG] [VALIDATOR ] NDMO: Validating primary data. [2025-09-17T20:34:07.459995] [DEBUG] [VALIDATOR ] NDMO: All expected trading days are present. [2025-09-17T20:34:07.460112] [DEBUG] [VALIDATOR ] NDMO: Primary data validation passed. [2025-09-17T20:34:07.460750] [INFO ] [MAIN ] NDMO: Fetched primary data is valid. [2025-09-17T20:34:07.460798] [DEBUG] [LOCAL ] NDMO: Saving primary data. [2025-09-17T20:34:07.461539] [DEBUG] [LOCAL ] NDMO: Trimmed 25100 records to 16496 (keeping 200 days of data) [2025-09-17T20:34:07.579446] [DEBUG] [LOCAL ] NDMO: Primary data saved (16496 records). [2025-09-17T20:34:07.579610] [INFO ] [MAIN ] NDMO: Full history saved. [2025-09-17T20:34:07.579742] [INFO ] [MAIN ] Update Progress: 1465/2371 symbols completed. NDMO took 33.0s. Estimated remaining: 2h 12m 24s. Rate: 6.8 symbols/min [2025-09-17T20:34:07.620957] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-11. [2025-09-17T20:34:07.761328] [INFO ] [MAIN ] NEM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:34:07.816971] [DEBUG] [LOCAL ] NEM: Loaded 53708 existing records from primary storage. [2025-09-17T20:34:07.817242] [INFO ] [MAIN ] NEM: Loaded 53708 existing records. [2025-09-17T20:34:08.009609] [WARN ] [MAIN ] NEM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:34:08.010127] [INFO ] [MAIN ] NEM: Wiping existing primary data before full refresh. [2025-09-17T20:34:08.010195] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-17T20:34:08.011605] [DEBUG] [LOCAL ] NEM: Deleted primary data file. [2025-09-17T20:34:08.011694] [INFO ] [MAIN ] NEM: Starting full primary refresh. [2025-09-17T20:34:08.386365] [INFO ] [REMOTE ] NEM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:34:08.411747] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T20:34:08.419871] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-11. [2025-09-17T20:34:09.215842] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-07. [2025-09-17T20:34:09.753727] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-11 (2.13 seconds). [2025-09-17T20:34:10.015778] [INFO ] [REMOTE ] NEE: Fetching primary data for 2024-12. [2025-09-17T20:34:10.523565] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-11 (2.10 seconds). [2025-09-17T20:34:10.815785] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-05. [2025-09-17T20:34:11.204809] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T20:34:11.615778] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-08. [2025-09-17T20:34:11.839391] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T20:34:11.889078] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T20:34:12.415783] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-06. [2025-09-17T20:34:13.215706] [INFO ] [REMOTE ] NEM: Fetching primary data for 2024-12. [2025-09-17T20:34:13.306551] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T20:34:13.934972] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T20:34:14.015769] [INFO ] [REMOTE ] NE: Fetching primary data for 2025-09. [2025-09-17T20:34:14.815785] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-01. [2025-09-17T20:34:15.299334] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T20:34:15.463486] [INFO ] [REMOTE ] NE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T20:34:15.470210] [INFO ] [REMOTE ] NE: Full fetch complete (75143 records). [2025-09-17T20:34:15.470331] [DEBUG] [VALIDATOR ] NE: Validating primary data. [2025-09-17T20:34:15.624026] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-01. [2025-09-17T20:34:15.867959] [DEBUG] [VALIDATOR ] NE: All expected trading days are present. [2025-09-17T20:34:15.868042] [DEBUG] [VALIDATOR ] NE: Primary data validation passed. [2025-09-17T20:34:15.869031] [INFO ] [MAIN ] NE: Fetched primary data is valid. [2025-09-17T20:34:15.869079] [DEBUG] [LOCAL ] NE: Saving primary data. [2025-09-17T20:34:15.872666] [DEBUG] [LOCAL ] NE: Trimmed 75143 records to 52394 (keeping 200 days of data) [2025-09-17T20:34:16.209605] [DEBUG] [LOCAL ] NE: Primary data saved (52394 records). [2025-09-17T20:34:16.209936] [INFO ] [MAIN ] NE: Full history saved. [2025-09-17T20:34:16.210054] [INFO ] [MAIN ] Update Progress: 1466/2371 symbols completed. NE took 39.0s. Estimated remaining: 2h 12m 15s. Rate: 6.8 symbols/min [2025-09-17T20:34:16.379526] [INFO ] [MAIN ] NET: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:34:16.415855] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-07. [2025-09-17T20:34:16.432232] [DEBUG] [LOCAL ] NET: Loaded 53095 existing records from primary storage. [2025-09-17T20:34:16.432333] [INFO ] [MAIN ] NET: Loaded 53095 existing records. [2025-09-17T20:34:16.617477] [WARN ] [MAIN ] NET: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:34:16.618125] [INFO ] [MAIN ] NET: Wiping existing primary data before full refresh. [2025-09-17T20:34:16.618210] [INFO ] [LOCAL ] NET: Starting deletion of primary data. [2025-09-17T20:34:16.620262] [DEBUG] [LOCAL ] NET: Deleted primary data file. [2025-09-17T20:34:16.620339] [INFO ] [MAIN ] NET: Starting full primary refresh. [2025-09-17T20:34:17.034618] [INFO ] [REMOTE ] NET: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:34:17.071534] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-17T20:34:17.215784] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-02. [2025-09-17T20:34:17.845713] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-17T20:34:17.986016] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T20:34:18.015768] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-02. [2025-09-17T20:34:18.815757] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-11. [2025-09-17T20:34:19.237103] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T20:34:19.615780] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-03. [2025-09-17T20:34:19.833134] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T20:34:20.415773] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-03. [2025-09-17T20:34:20.828386] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-17T20:34:21.215733] [INFO ] [REMOTE ] NET: Fetching primary data for 2024-12. [2025-09-17T20:34:22.015761] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-08. [2025-09-17T20:34:22.312252] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-03 (2.70 seconds). [2025-09-17T20:34:22.756563] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-17T20:34:22.825615] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-04. [2025-09-17T20:34:22.831168] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T20:34:23.459692] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T20:34:23.615802] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-01. [2025-09-17T20:34:24.415833] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-04. [2025-09-17T20:34:25.059924] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T20:34:25.215807] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-05. [2025-09-17T20:34:25.302850] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T20:34:26.015805] [INFO ] [REMOTE ] NEA: Fetching primary data for 2025-09. [2025-09-17T20:34:26.618005] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T20:34:26.815787] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-05. [2025-09-17T20:34:27.185585] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T20:34:27.211190] [INFO ] [REMOTE ] NEA: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T20:34:27.216578] [INFO ] [REMOTE ] NEA: Full fetch complete (52444 records). [2025-09-17T20:34:27.216745] [DEBUG] [VALIDATOR ] NEA: Validating primary data. [2025-09-17T20:34:27.607969] [DEBUG] [VALIDATOR ] NEA: All expected trading days are present. [2025-09-17T20:34:27.608098] [DEBUG] [VALIDATOR ] NEA: Primary data validation passed. [2025-09-17T20:34:27.609057] [INFO ] [MAIN ] NEA: Fetched primary data is valid. [2025-09-17T20:34:27.609106] [DEBUG] [LOCAL ] NEA: Saving primary data. [2025-09-17T20:34:27.610316] [DEBUG] [LOCAL ] NEA: Trimmed 52444 records to 35408 (keeping 200 days of data) [2025-09-17T20:34:27.615774] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-06. [2025-09-17T20:34:27.853661] [DEBUG] [LOCAL ] NEA: Primary data saved (35408 records). [2025-09-17T20:34:27.853885] [INFO ] [MAIN ] NEA: Full history saved. [2025-09-17T20:34:27.854779] [INFO ] [MAIN ] Update Progress: 1467/2371 symbols completed. NEA took 38.3s. Estimated remaining: 2h 12m 8s. Rate: 6.8 symbols/min [2025-09-17T20:34:28.045222] [INFO ] [MAIN ] NEU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:34:28.058908] [DEBUG] [LOCAL ] NEU: Loaded 8109 existing records from primary storage. [2025-09-17T20:34:28.059107] [INFO ] [MAIN ] NEU: Loaded 8109 existing records. [2025-09-17T20:34:28.250315] [WARN ] [MAIN ] NEU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:34:28.250717] [INFO ] [MAIN ] NEU: Wiping existing primary data before full refresh. [2025-09-17T20:34:28.250772] [INFO ] [LOCAL ] NEU: Starting deletion of primary data. [2025-09-17T20:34:28.251144] [DEBUG] [LOCAL ] NEU: Deleted primary data file. [2025-09-17T20:34:28.251288] [INFO ] [MAIN ] NEU: Starting full primary refresh. [2025-09-17T20:34:28.420976] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-02. [2025-09-17T20:34:28.698312] [INFO ] [REMOTE ] NEU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:34:28.889261] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T20:34:29.215883] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-06. [2025-09-17T20:34:29.786897] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-17T20:34:30.015788] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-07. [2025-09-17T20:34:30.740701] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-02 (2.32 seconds). [2025-09-17T20:34:30.815845] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-03. [2025-09-17T20:34:31.177883] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T20:34:31.615792] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-11. [2025-09-17T20:34:32.064272] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T20:34:32.415796] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-08. [2025-09-17T20:34:32.423562] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T20:34:33.135149] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-17T20:34:33.215741] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-04. [2025-09-17T20:34:34.015790] [INFO ] [REMOTE ] NEU: Fetching primary data for 2024-12. [2025-09-17T20:34:34.751356] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-17T20:34:34.793939] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T20:34:34.815745] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-01. [2025-09-17T20:34:35.189218] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T20:34:35.561454] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T20:34:35.615818] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-05. [2025-09-17T20:34:36.415811] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-02. [2025-09-17T20:34:37.147368] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T20:34:37.215830] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-07. [2025-09-17T20:34:37.983535] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-17T20:34:38.015749] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-06. [2025-09-17T20:34:38.815816] [INFO ] [REMOTE ] NEM: Fetching primary data for 2025-09. [2025-09-17T20:34:39.373173] [INFO ] [REMOTE ] NEM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T20:34:39.380597] [INFO ] [REMOTE ] NEM: Full fetch complete (77262 records). [2025-09-17T20:34:39.380794] [DEBUG] [VALIDATOR ] NEM: Validating primary data. [2025-09-17T20:34:39.381991] [FATAL] [VALIDATOR ] NEM: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:34:39.382086] [FATAL] [MAIN ] NEM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:34:39.382136] [WARN ] [MAIN ] NEM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:34:39.382182] [INFO ] [LOCAL ] NEM: Starting deletion of primary data. [2025-09-17T20:34:39.382245] [DEBUG] [LOCAL ] NEM: No primary data file found to delete. [2025-09-17T20:34:39.382318] [INFO ] [LOCAL ] NEM: Starting deletion of derivative data. [2025-09-17T20:34:39.382692] [DEBUG] [LOCAL ] NEM: Deleted derivative data file. [2025-09-17T20:34:39.382832] [INFO ] [MAIN ] Update Progress: 1468/2371 symbols completed. NEM took 31.8s. Estimated remaining: 2h 12m 1s. Rate: 6.8 symbols/min [2025-09-17T20:34:39.564628] [INFO ] [MAIN ] NEUE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:34:39.569541] [DEBUG] [LOCAL ] NEUE: Loaded 2258 existing records from primary storage. [2025-09-17T20:34:39.569755] [INFO ] [MAIN ] NEUE: Loaded 2258 existing records. [2025-09-17T20:34:39.627783] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-03. [2025-09-17T20:34:39.810524] [WARN ] [MAIN ] NEUE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:34:39.813005] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-07 (2.60 seconds). [2025-09-17T20:34:39.824518] [INFO ] [MAIN ] NEUE: Wiping existing primary data before full refresh. [2025-09-17T20:34:39.824985] [INFO ] [LOCAL ] NEUE: Starting deletion of primary data. [2025-09-17T20:34:39.825542] [DEBUG] [LOCAL ] NEUE: Deleted primary data file. [2025-09-17T20:34:39.825594] [INFO ] [MAIN ] NEUE: Starting full primary refresh. [2025-09-17T20:34:40.192542] [INFO ] [REMOTE ] NEUE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:34:40.230847] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-17T20:34:40.396099] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T20:34:40.415751] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-04. [2025-09-17T20:34:41.215846] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-11. [2025-09-17T20:34:41.241521] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T20:34:41.851257] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T20:34:42.015782] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2024-12. [2025-09-17T20:34:42.729623] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T20:34:42.815807] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-08. [2025-09-17T20:34:43.615775] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-01. [2025-09-17T20:34:44.240072] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T20:34:44.415790] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-07. [2025-09-17T20:34:45.024201] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-08 (2.21 seconds). [2025-09-17T20:34:45.215818] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-02. [2025-09-17T20:34:45.706733] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-02 (0.49 seconds). [2025-09-17T20:34:46.015799] [INFO ] [REMOTE ] NEE: Fetching primary data for 2025-09. [2025-09-17T20:34:46.416801] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T20:34:46.806840] [INFO ] [REMOTE ] NEE: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T20:34:46.813509] [INFO ] [REMOTE ] NEE: Full fetch complete (77243 records). [2025-09-17T20:34:46.813692] [DEBUG] [VALIDATOR ] NEE: Validating primary data. [2025-09-17T20:34:46.814554] [FATAL] [VALIDATOR ] NEE: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:34:46.814672] [FATAL] [MAIN ] NEE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:34:46.814727] [WARN ] [MAIN ] NEE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:34:46.814780] [INFO ] [LOCAL ] NEE: Starting deletion of primary data. [2025-09-17T20:34:46.814841] [DEBUG] [LOCAL ] NEE: No primary data file found to delete. [2025-09-17T20:34:46.814880] [INFO ] [LOCAL ] NEE: Starting deletion of derivative data. [2025-09-17T20:34:46.815128] [DEBUG] [LOCAL ] NEE: Deleted derivative data file. [2025-09-17T20:34:46.815259] [INFO ] [MAIN ] Update Progress: 1469/2371 symbols completed. NEE took 42.0s. Estimated remaining: 2h 11m 52s. Rate: 6.8 symbols/min [2025-09-17T20:34:46.820804] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-08. [2025-09-17T20:34:46.993814] [INFO ] [MAIN ] NEXA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:34:46.999281] [DEBUG] [LOCAL ] NEXA: Loaded 3859 existing records from primary storage. [2025-09-17T20:34:46.999385] [INFO ] [MAIN ] NEXA: Loaded 3859 existing records. [2025-09-17T20:34:47.182342] [WARN ] [MAIN ] NEXA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:34:47.182605] [INFO ] [MAIN ] NEXA: Wiping existing primary data before full refresh. [2025-09-17T20:34:47.182674] [INFO ] [LOCAL ] NEXA: Starting deletion of primary data. [2025-09-17T20:34:47.182892] [DEBUG] [LOCAL ] NEXA: Deleted primary data file. [2025-09-17T20:34:47.182938] [INFO ] [MAIN ] NEXA: Starting full primary refresh. [2025-09-17T20:34:47.544883] [INFO ] [REMOTE ] NEXA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:34:47.615772] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-03. [2025-09-17T20:34:48.307158] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T20:34:48.415770] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-04. [2025-09-17T20:34:48.954012] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-17T20:34:49.134189] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-17T20:34:49.215748] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-05. [2025-09-17T20:34:49.697073] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T20:34:50.015792] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-11. [2025-09-17T20:34:50.815804] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-05. [2025-09-17T20:34:50.859297] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T20:34:51.543821] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T20:34:51.615783] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-06. [2025-09-17T20:34:52.415786] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2024-12. [2025-09-17T20:34:52.714678] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T20:34:53.013166] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T20:34:53.215896] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-07. [2025-09-17T20:34:54.015994] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-06. [2025-09-17T20:34:54.082470] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T20:34:54.433635] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T20:34:54.815775] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-07. [2025-09-17T20:34:55.263227] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T20:34:55.615785] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-08. [2025-09-17T20:34:56.092473] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T20:34:56.415781] [INFO ] [REMOTE ] NEUE: Fetching primary data for 2025-09. [2025-09-17T20:34:56.861069] [INFO ] [REMOTE ] NEUE: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T20:34:56.861908] [INFO ] [REMOTE ] NEUE: Full fetch complete (3994 records). [2025-09-17T20:34:56.861979] [DEBUG] [VALIDATOR ] NEUE: Validating primary data. [2025-09-17T20:34:57.215941] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-01. [2025-09-17T20:34:57.222371] [DEBUG] [VALIDATOR ] NEUE: All expected trading days are present. [2025-09-17T20:34:57.222465] [DEBUG] [VALIDATOR ] NEUE: Primary data validation passed. [2025-09-17T20:34:57.222661] [INFO ] [MAIN ] NEUE: Fetched primary data is valid. [2025-09-17T20:34:57.222795] [DEBUG] [LOCAL ] NEUE: Saving primary data. [2025-09-17T20:34:57.223318] [DEBUG] [LOCAL ] NEUE: Trimmed 3994 records to 2256 (keeping 200 days of data) [2025-09-17T20:34:57.237800] [DEBUG] [LOCAL ] NEUE: Primary data saved (2256 records). [2025-09-17T20:34:57.237884] [INFO ] [MAIN ] NEUE: Full history saved. [2025-09-17T20:34:57.237968] [INFO ] [MAIN ] Update Progress: 1470/2371 symbols completed. NEUE took 17.9s. Estimated remaining: 2h 11m 44s. Rate: 6.8 symbols/min [2025-09-17T20:34:57.418171] [INFO ] [MAIN ] NFG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:34:57.456811] [DEBUG] [LOCAL ] NFG: Loaded 38883 existing records from primary storage. [2025-09-17T20:34:57.456955] [INFO ] [MAIN ] NFG: Loaded 38883 existing records. [2025-09-17T20:34:57.642870] [WARN ] [MAIN ] NFG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:34:57.643168] [INFO ] [MAIN ] NFG: Wiping existing primary data before full refresh. [2025-09-17T20:34:57.643215] [INFO ] [LOCAL ] NFG: Starting deletion of primary data. [2025-09-17T20:34:57.644144] [DEBUG] [LOCAL ] NFG: Deleted primary data file. [2025-09-17T20:34:57.644202] [INFO ] [MAIN ] NFG: Starting full primary refresh. [2025-09-17T20:34:58.016338] [INFO ] [REMOTE ] NFG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:34:58.016637] [INFO ] [REMOTE ] NET: Fetching primary data for 2025-09. [2025-09-17T20:34:58.068520] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T20:34:58.815797] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-02. [2025-09-17T20:34:59.213283] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T20:34:59.615818] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-08. [2025-09-17T20:34:59.991511] [INFO ] [REMOTE ] NET: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-17T20:35:00.000498] [INFO ] [REMOTE ] NET: Full fetch complete (76783 records). [2025-09-17T20:35:00.000897] [DEBUG] [VALIDATOR ] NET: Validating primary data. [2025-09-17T20:35:00.395962] [DEBUG] [VALIDATOR ] NET: All expected trading days are present. [2025-09-17T20:35:00.396051] [DEBUG] [VALIDATOR ] NET: Primary data validation passed. [2025-09-17T20:35:00.397218] [INFO ] [MAIN ] NET: Fetched primary data is valid. [2025-09-17T20:35:00.397299] [DEBUG] [LOCAL ] NET: Saving primary data. [2025-09-17T20:35:00.399320] [DEBUG] [LOCAL ] NET: Trimmed 76783 records to 53095 (keeping 200 days of data) [2025-09-17T20:35:00.453483] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-11. [2025-09-17T20:35:00.506815] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T20:35:00.750332] [DEBUG] [LOCAL ] NET: Primary data saved (53095 records). [2025-09-17T20:35:00.750497] [INFO ] [MAIN ] NET: Full history saved. [2025-09-17T20:35:00.750595] [INFO ] [MAIN ] Update Progress: 1471/2371 symbols completed. NET took 44.5s. Estimated remaining: 2h 11m 32s. Rate: 6.8 symbols/min [2025-09-17T20:35:00.920697] [INFO ] [MAIN ] NFJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:35:00.942145] [DEBUG] [LOCAL ] NFJ: Loaded 20515 existing records from primary storage. [2025-09-17T20:35:00.942322] [INFO ] [MAIN ] NFJ: Loaded 20515 existing records. [2025-09-17T20:35:01.124629] [WARN ] [MAIN ] NFJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:35:01.124938] [INFO ] [MAIN ] NFJ: Wiping existing primary data before full refresh. [2025-09-17T20:35:01.124987] [INFO ] [LOCAL ] NFJ: Starting deletion of primary data. [2025-09-17T20:35:01.125542] [DEBUG] [LOCAL ] NFJ: Deleted primary data file. [2025-09-17T20:35:01.125614] [INFO ] [MAIN ] NFJ: Starting full primary refresh. [2025-09-17T20:35:01.225722] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-03. [2025-09-17T20:35:01.519405] [INFO ] [REMOTE ] NFJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:35:01.908957] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T20:35:02.015824] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-11. [2025-09-17T20:35:02.694707] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-11 (2.24 seconds). [2025-09-17T20:35:02.815845] [INFO ] [REMOTE ] NFG: Fetching primary data for 2024-12. [2025-09-17T20:35:03.408738] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T20:35:03.615849] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2024-12. [2025-09-17T20:35:04.201929] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T20:35:04.415827] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-04. [2025-09-17T20:35:04.595078] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T20:35:05.014049] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T20:35:05.215830] [INFO ] [REMOTE ] NEU: Fetching primary data for 2025-09. [2025-09-17T20:35:05.987529] [INFO ] [REMOTE ] NEU: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T20:35:05.989740] [INFO ] [REMOTE ] NEU: Full fetch complete (10099 records). [2025-09-17T20:35:05.989849] [DEBUG] [VALIDATOR ] NEU: Validating primary data. [2025-09-17T20:35:06.021132] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-05. [2025-09-17T20:35:06.388945] [DEBUG] [VALIDATOR ] NEU: All expected trading days are present. [2025-09-17T20:35:06.389049] [DEBUG] [VALIDATOR ] NEU: Primary data validation passed. [2025-09-17T20:35:06.389392] [INFO ] [MAIN ] NEU: Fetched primary data is valid. [2025-09-17T20:35:06.389444] [DEBUG] [LOCAL ] NEU: Saving primary data. [2025-09-17T20:35:06.390093] [DEBUG] [LOCAL ] NEU: Trimmed 10099 records to 8121 (keeping 200 days of data) [2025-09-17T20:35:06.454286] [DEBUG] [LOCAL ] NEU: Primary data saved (8121 records). [2025-09-17T20:35:06.454508] [INFO ] [MAIN ] NEU: Full history saved. [2025-09-17T20:35:06.454674] [INFO ] [MAIN ] Update Progress: 1472/2371 symbols completed. NEU took 38.6s. Estimated remaining: 2h 11m 21s. Rate: 6.8 symbols/min [2025-09-17T20:35:06.673265] [INFO ] [MAIN ] NGG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:35:06.729825] [DEBUG] [LOCAL ] NGG: Loaded 46207 existing records from primary storage. [2025-09-17T20:35:06.730071] [INFO ] [MAIN ] NGG: Loaded 46207 existing records. [2025-09-17T20:35:06.817889] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-01. [2025-09-17T20:35:06.849597] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T20:35:06.940688] [WARN ] [MAIN ] NGG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:35:06.941095] [INFO ] [MAIN ] NGG: Wiping existing primary data before full refresh. [2025-09-17T20:35:06.941152] [INFO ] [LOCAL ] NGG: Starting deletion of primary data. [2025-09-17T20:35:06.942390] [DEBUG] [LOCAL ] NGG: Deleted primary data file. [2025-09-17T20:35:06.942455] [INFO ] [MAIN ] NGG: Starting full primary refresh. [2025-09-17T20:35:07.332670] [INFO ] [REMOTE ] NGG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:35:07.615858] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-01. [2025-09-17T20:35:08.071596] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T20:35:08.415868] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-11. [2025-09-17T20:35:09.049982] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T20:35:09.215848] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-02. [2025-09-17T20:35:10.015787] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-06. [2025-09-17T20:35:10.493186] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T20:35:10.763297] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T20:35:10.790068] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T20:35:10.815746] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-03. [2025-09-17T20:35:11.615777] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-07. [2025-09-17T20:35:12.274945] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T20:35:12.303815] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T20:35:12.415774] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-08. [2025-09-17T20:35:12.832821] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-08 (0.42 seconds). [2025-09-17T20:35:13.215797] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-04. [2025-09-17T20:35:14.015790] [INFO ] [REMOTE ] NEXA: Fetching primary data for 2025-09. [2025-09-17T20:35:14.632748] [INFO ] [REMOTE ] NEXA: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T20:35:14.634121] [INFO ] [REMOTE ] NEXA: Full fetch complete (7412 records). [2025-09-17T20:35:14.634191] [DEBUG] [VALIDATOR ] NEXA: Validating primary data. [2025-09-17T20:35:14.816378] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-02. [2025-09-17T20:35:15.031317] [DEBUG] [VALIDATOR ] NEXA: All expected trading days are present. [2025-09-17T20:35:15.031484] [DEBUG] [VALIDATOR ] NEXA: Primary data validation passed. [2025-09-17T20:35:15.031997] [INFO ] [MAIN ] NEXA: Fetched primary data is valid. [2025-09-17T20:35:15.032066] [DEBUG] [LOCAL ] NEXA: Saving primary data. [2025-09-17T20:35:15.033053] [DEBUG] [LOCAL ] NEXA: Trimmed 7412 records to 3923 (keeping 200 days of data) [2025-09-17T20:35:15.096695] [DEBUG] [LOCAL ] NEXA: Primary data saved (3923 records). [2025-09-17T20:35:15.096970] [INFO ] [MAIN ] NEXA: Full history saved. [2025-09-17T20:35:15.097117] [INFO ] [MAIN ] Update Progress: 1473/2371 symbols completed. NEXA took 28.3s. Estimated remaining: 2h 11m 12s. Rate: 6.8 symbols/min [2025-09-17T20:35:15.167177] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T20:35:15.293251] [INFO ] [MAIN ] NGL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:35:15.326275] [DEBUG] [LOCAL ] NGL: Loaded 30328 existing records from primary storage. [2025-09-17T20:35:15.326445] [INFO ] [MAIN ] NGL: Loaded 30328 existing records. [2025-09-17T20:35:15.515206] [WARN ] [MAIN ] NGL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:35:15.515536] [INFO ] [MAIN ] NGL: Wiping existing primary data before full refresh. [2025-09-17T20:35:15.515608] [INFO ] [LOCAL ] NGL: Starting deletion of primary data. [2025-09-17T20:35:15.516206] [DEBUG] [LOCAL ] NGL: Deleted primary data file. [2025-09-17T20:35:15.516273] [INFO ] [MAIN ] NGL: Starting full primary refresh. [2025-09-17T20:35:15.617551] [INFO ] [REMOTE ] NGG: Fetching primary data for 2024-12. [2025-09-17T20:35:15.786537] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T20:35:15.902586] [INFO ] [REMOTE ] NGL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:35:16.415809] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-11. [2025-09-17T20:35:17.205856] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T20:35:17.215722] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-01. [2025-09-17T20:35:17.284986] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T20:35:18.015771] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-05. [2025-09-17T20:35:18.530046] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T20:35:18.815777] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-02. [2025-09-17T20:35:19.548009] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T20:35:19.615783] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-06. [2025-09-17T20:35:20.353907] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T20:35:20.415728] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-03. [2025-09-17T20:35:20.588198] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T20:35:21.215869] [INFO ] [REMOTE ] NGL: Fetching primary data for 2024-12. [2025-09-17T20:35:21.843945] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T20:35:22.015778] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-03. [2025-09-17T20:35:22.332288] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T20:35:22.815790] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-04. [2025-09-17T20:35:22.922755] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T20:35:23.615803] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-01. [2025-09-17T20:35:24.415835] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-04. [2025-09-17T20:35:24.678938] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T20:35:24.857457] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T20:35:25.215787] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-02. [2025-09-17T20:35:25.584926] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T20:35:26.015755] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-07. [2025-09-17T20:35:26.421235] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T20:35:26.815799] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-03. [2025-09-17T20:35:27.466108] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T20:35:27.615840] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-05. [2025-09-17T20:35:28.002245] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T20:35:28.415856] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-08. [2025-09-17T20:35:28.721955] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T20:35:29.215786] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-05. [2025-09-17T20:35:29.991401] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T20:35:30.015725] [INFO ] [REMOTE ] NFG: Fetching primary data for 2025-09. [2025-09-17T20:35:30.815738] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-06. [2025-09-17T20:35:30.847710] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T20:35:31.179980] [INFO ] [REMOTE ] NFG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T20:35:31.185094] [INFO ] [REMOTE ] NFG: Full fetch complete (56348 records). [2025-09-17T20:35:31.185235] [DEBUG] [VALIDATOR ] NFG: Validating primary data. [2025-09-17T20:35:31.602586] [DEBUG] [VALIDATOR ] NFG: All expected trading days are present. [2025-09-17T20:35:31.602719] [DEBUG] [VALIDATOR ] NFG: Primary data validation passed. [2025-09-17T20:35:31.603633] [INFO ] [MAIN ] NFG: Fetched primary data is valid. [2025-09-17T20:35:31.603702] [DEBUG] [LOCAL ] NFG: Saving primary data. [2025-09-17T20:35:31.605116] [DEBUG] [LOCAL ] NFG: Trimmed 56348 records to 38837 (keeping 200 days of data) [2025-09-17T20:35:31.665944] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-04. [2025-09-17T20:35:31.754387] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T20:35:31.873180] [DEBUG] [LOCAL ] NFG: Primary data saved (38837 records). [2025-09-17T20:35:31.873365] [INFO ] [MAIN ] NFG: Full history saved. [2025-09-17T20:35:31.873473] [INFO ] [MAIN ] Update Progress: 1474/2371 symbols completed. NFG took 34.6s. Estimated remaining: 2h 11m 9s. Rate: 6.8 symbols/min [2025-09-17T20:35:32.080384] [INFO ] [MAIN ] NGS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:35:32.093129] [DEBUG] [LOCAL ] NGS: Loaded 11791 existing records from primary storage. [2025-09-17T20:35:32.093268] [INFO ] [MAIN ] NGS: Loaded 11791 existing records. [2025-09-17T20:35:32.278116] [WARN ] [MAIN ] NGS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:35:32.278424] [INFO ] [MAIN ] NGS: Wiping existing primary data before full refresh. [2025-09-17T20:35:32.278474] [INFO ] [LOCAL ] NGS: Starting deletion of primary data. [2025-09-17T20:35:32.278829] [DEBUG] [LOCAL ] NGS: Deleted primary data file. [2025-09-17T20:35:32.278877] [INFO ] [MAIN ] NGS: Starting full primary refresh. [2025-09-17T20:35:32.420973] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-07. [2025-09-17T20:35:32.647808] [INFO ] [REMOTE ] NGS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:35:32.836504] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T20:35:33.215780] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-11. [2025-09-17T20:35:33.559298] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T20:35:34.015858] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-05. [2025-09-17T20:35:34.097511] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T20:35:34.815789] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-08. [2025-09-17T20:35:35.149546] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T20:35:35.589086] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T20:35:35.615792] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-06. [2025-09-17T20:35:36.415815] [INFO ] [REMOTE ] NGS: Fetching primary data for 2024-12. [2025-09-17T20:35:37.153123] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T20:35:37.215844] [INFO ] [REMOTE ] NFJ: Fetching primary data for 2025-09. [2025-09-17T20:35:37.453050] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T20:35:38.015783] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-01. [2025-09-17T20:35:38.093735] [INFO ] [REMOTE ] NFJ: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T20:35:38.096697] [INFO ] [REMOTE ] NFJ: Full fetch complete (30495 records). [2025-09-17T20:35:38.096793] [DEBUG] [VALIDATOR ] NFJ: Validating primary data. [2025-09-17T20:35:38.482871] [DEBUG] [VALIDATOR ] NFJ: All expected trading days are present. [2025-09-17T20:35:38.482991] [DEBUG] [VALIDATOR ] NFJ: Primary data validation passed. [2025-09-17T20:35:38.483696] [INFO ] [MAIN ] NFJ: Fetched primary data is valid. [2025-09-17T20:35:38.483764] [DEBUG] [LOCAL ] NFJ: Saving primary data. [2025-09-17T20:35:38.484803] [DEBUG] [LOCAL ] NFJ: Trimmed 30495 records to 20489 (keeping 200 days of data) [2025-09-17T20:35:38.612883] [DEBUG] [LOCAL ] NFJ: Primary data saved (20489 records). [2025-09-17T20:35:38.613036] [INFO ] [MAIN ] NFJ: Full history saved. [2025-09-17T20:35:38.613124] [INFO ] [MAIN ] Update Progress: 1475/2371 symbols completed. NFJ took 37.9s. Estimated remaining: 2h 10m 59s. Rate: 6.8 symbols/min [2025-09-17T20:35:38.786263] [INFO ] [MAIN ] NGVC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:35:38.807146] [DEBUG] [LOCAL ] NGVC: Loaded 22399 existing records from primary storage. [2025-09-17T20:35:38.807307] [INFO ] [MAIN ] NGVC: Loaded 22399 existing records. [2025-09-17T20:35:38.820960] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-07. [2025-09-17T20:35:38.989480] [WARN ] [MAIN ] NGVC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:35:38.989850] [INFO ] [MAIN ] NGVC: Wiping existing primary data before full refresh. [2025-09-17T20:35:38.989981] [INFO ] [LOCAL ] NGVC: Starting deletion of primary data. [2025-09-17T20:35:38.995709] [DEBUG] [LOCAL ] NGVC: Deleted primary data file. [2025-09-17T20:35:39.000612] [INFO ] [MAIN ] NGVC: Starting full primary refresh. [2025-09-17T20:35:39.006629] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T20:35:39.396428] [INFO ] [REMOTE ] NGVC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:35:39.615815] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-11. [2025-09-17T20:35:40.415826] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-02. [2025-09-17T20:35:40.584208] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T20:35:40.796436] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T20:35:41.215819] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-06. [2025-09-17T20:35:41.288246] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T20:35:42.015797] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-03. [2025-09-17T20:35:42.595873] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T20:35:42.815809] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-08. [2025-09-17T20:35:43.112525] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T20:35:43.615806] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-07. [2025-09-17T20:35:44.305769] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T20:35:44.415784] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-04. [2025-09-17T20:35:45.147219] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T20:35:45.215737] [INFO ] [REMOTE ] NGG: Fetching primary data for 2025-09. [2025-09-17T20:35:45.471934] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T20:35:46.015814] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-05. [2025-09-17T20:35:46.555331] [INFO ] [REMOTE ] NGG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T20:35:46.561553] [INFO ] [REMOTE ] NGG: Full fetch complete (66160 records). [2025-09-17T20:35:46.561761] [DEBUG] [VALIDATOR ] NGG: Validating primary data. [2025-09-17T20:35:46.820959] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2024-12. [2025-09-17T20:35:46.975825] [DEBUG] [VALIDATOR ] NGG: All expected trading days are present. [2025-09-17T20:35:46.983283] [DEBUG] [VALIDATOR ] NGG: Primary data validation passed. [2025-09-17T20:35:46.984992] [INFO ] [MAIN ] NGG: Fetched primary data is valid. [2025-09-17T20:35:46.985439] [DEBUG] [LOCAL ] NGG: Saving primary data. [2025-09-17T20:35:46.985356] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T20:35:46.989910] [DEBUG] [LOCAL ] NGG: Trimmed 66160 records to 46212 (keeping 200 days of data) [2025-09-17T20:35:47.276070] [DEBUG] [LOCAL ] NGG: Primary data saved (46212 records). [2025-09-17T20:35:47.276218] [INFO ] [MAIN ] NGG: Full history saved. [2025-09-17T20:35:47.277143] [INFO ] [MAIN ] Update Progress: 1476/2371 symbols completed. NGG took 40.8s. Estimated remaining: 2h 10m 50s. Rate: 6.8 symbols/min [2025-09-17T20:35:47.455983] [INFO ] [MAIN ] NGVT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:35:47.456252] [DEBUG] [LOCAL ] NGVT: No existing data file found in primary storage. [2025-09-17T20:35:47.456304] [WARN ] [MAIN ] NGVT: No existing data found, performing full refresh instead. [2025-09-17T20:35:47.456461] [INFO ] [MAIN ] NGVT: Wiping existing primary data before full refresh. [2025-09-17T20:35:47.456508] [INFO ] [LOCAL ] NGVT: Starting deletion of primary data. [2025-09-17T20:35:47.456557] [DEBUG] [LOCAL ] NGVT: No primary data file found to delete. [2025-09-17T20:35:47.456595] [INFO ] [MAIN ] NGVT: Starting full primary refresh. [2025-09-17T20:35:47.625525] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-06. [2025-09-17T20:35:47.853020] [INFO ] [REMOTE ] NGVT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:35:47.993030] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T20:35:48.415769] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-08. [2025-09-17T20:35:48.468863] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T20:35:49.215772] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-01. [2025-09-17T20:35:49.605120] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T20:35:50.015791] [INFO ] [REMOTE ] NGL: Fetching primary data for 2025-09. [2025-09-17T20:35:50.236787] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T20:35:50.815826] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-07. [2025-09-17T20:35:51.268582] [INFO ] [REMOTE ] NGL: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T20:35:51.273494] [INFO ] [REMOTE ] NGL: Full fetch complete (40275 records). [2025-09-17T20:35:51.273634] [DEBUG] [VALIDATOR ] NGL: Validating primary data. [2025-09-17T20:35:51.607715] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T20:35:51.631414] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-02. [2025-09-17T20:35:51.680076] [DEBUG] [VALIDATOR ] NGL: All expected trading days are present. [2025-09-17T20:35:51.680186] [DEBUG] [VALIDATOR ] NGL: Primary data validation passed. [2025-09-17T20:35:51.680998] [INFO ] [MAIN ] NGL: Fetched primary data is valid. [2025-09-17T20:35:51.681050] [DEBUG] [LOCAL ] NGL: Saving primary data. [2025-09-17T20:35:51.682253] [DEBUG] [LOCAL ] NGL: Trimmed 40275 records to 30422 (keeping 200 days of data) [2025-09-17T20:35:51.864514] [DEBUG] [LOCAL ] NGL: Primary data saved (30422 records). [2025-09-17T20:35:51.864701] [INFO ] [MAIN ] NGL: Full history saved. [2025-09-17T20:35:51.864812] [INFO ] [MAIN ] Update Progress: 1477/2371 symbols completed. NGL took 36.8s. Estimated remaining: 2h 10m 38s. Rate: 6.8 symbols/min [2025-09-17T20:35:52.415794] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-08. [2025-09-17T20:35:52.749930] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T20:35:53.215829] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-03. [2025-09-17T20:35:53.303986] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T20:35:54.015784] [INFO ] [REMOTE ] NGS: Fetching primary data for 2025-09. [2025-09-17T20:35:54.351963] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T20:35:54.815776] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-11. [2025-09-17T20:35:54.865455] [INFO ] [REMOTE ] NGS: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T20:35:54.867974] [INFO ] [REMOTE ] NGS: Full fetch complete (17087 records). [2025-09-17T20:35:54.868215] [DEBUG] [VALIDATOR ] NGS: Validating primary data. [2025-09-17T20:35:55.256483] [DEBUG] [VALIDATOR ] NGS: All expected trading days are present. [2025-09-17T20:35:55.256581] [DEBUG] [VALIDATOR ] NGS: Primary data validation passed. [2025-09-17T20:35:55.257112] [INFO ] [MAIN ] NGS: Fetched primary data is valid. [2025-09-17T20:35:55.257158] [DEBUG] [LOCAL ] NGS: Saving primary data. [2025-09-17T20:35:55.257841] [DEBUG] [LOCAL ] NGS: Trimmed 17087 records to 11774 (keeping 200 days of data) [2025-09-17T20:35:55.331785] [DEBUG] [LOCAL ] NGS: Primary data saved (11774 records). [2025-09-17T20:35:55.331947] [INFO ] [MAIN ] NGS: Full history saved. [2025-09-17T20:35:55.332039] [INFO ] [MAIN ] Update Progress: 1478/2371 symbols completed. NGS took 23.5s. Estimated remaining: 2h 10m 26s. Rate: 6.8 symbols/min [2025-09-17T20:35:55.615756] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-04. [2025-09-17T20:35:55.778740] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T20:35:56.415694] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2024-12. [2025-09-17T20:35:56.456949] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T20:35:57.215742] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-05. [2025-09-17T20:35:57.383328] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T20:35:58.015740] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-01. [2025-09-17T20:35:58.392906] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T20:35:58.815842] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-06. [2025-09-17T20:35:59.201791] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T20:35:59.615799] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-02. [2025-09-17T20:36:00.057287] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T20:36:00.415786] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-07. [2025-09-17T20:36:00.934411] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T20:36:01.215834] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-03. [2025-09-17T20:36:01.638147] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T20:36:02.015789] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-08. [2025-09-17T20:36:02.467087] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T20:36:02.815840] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-04. [2025-09-17T20:36:03.251866] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T20:36:03.615891] [INFO ] [REMOTE ] NGVC: Fetching primary data for 2025-09. [2025-09-17T20:36:04.259501] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T20:36:04.415806] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-05. [2025-09-17T20:36:04.770977] [INFO ] [REMOTE ] NGVC: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T20:36:04.774965] [INFO ] [REMOTE ] NGVC: Full fetch complete (30151 records). [2025-09-17T20:36:04.775105] [DEBUG] [VALIDATOR ] NGVC: Validating primary data. [2025-09-17T20:36:05.375818] [DEBUG] [VALIDATOR ] NGVC: All expected trading days are present. [2025-09-17T20:36:05.376230] [DEBUG] [VALIDATOR ] NGVC: Primary data validation passed. [2025-09-17T20:36:05.378068] [INFO ] [MAIN ] NGVC: Fetched primary data is valid. [2025-09-17T20:36:05.378420] [DEBUG] [LOCAL ] NGVC: Saving primary data. [2025-09-17T20:36:05.380530] [DEBUG] [LOCAL ] NGVC: Trimmed 30151 records to 22449 (keeping 200 days of data) [2025-09-17T20:36:05.569339] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T20:36:05.586590] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-06. [2025-09-17T20:36:05.622423] [DEBUG] [LOCAL ] NGVC: Primary data saved (22449 records). [2025-09-17T20:36:05.622635] [INFO ] [MAIN ] NGVC: Full history saved. [2025-09-17T20:36:05.622855] [INFO ] [MAIN ] Update Progress: 1479/2371 symbols completed. NGVC took 27.0s. Estimated remaining: 2h 10m 19s. Rate: 6.8 symbols/min [2025-09-17T20:36:06.838238] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T20:36:06.843965] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-07. [2025-09-17T20:36:08.057093] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T20:36:08.063120] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-08. [2025-09-17T20:36:09.318339] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T20:36:09.324669] [INFO ] [REMOTE ] NGVT: Fetching primary data for 2025-09. [2025-09-17T20:36:10.069330] [INFO ] [REMOTE ] NGVT: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T20:36:10.072741] [INFO ] [REMOTE ] NGVT: Full fetch complete (34485 records). [2025-09-17T20:36:10.072835] [DEBUG] [VALIDATOR ] NGVT: Validating primary data. [2025-09-17T20:36:10.480820] [DEBUG] [VALIDATOR ] NGVT: All expected trading days are present. [2025-09-17T20:36:10.480930] [DEBUG] [VALIDATOR ] NGVT: Primary data validation passed. [2025-09-17T20:36:10.481791] [INFO ] [MAIN ] NGVT: Fetched primary data is valid. [2025-09-17T20:36:10.481860] [DEBUG] [LOCAL ] NGVT: Saving primary data. [2025-09-17T20:36:10.483057] [DEBUG] [LOCAL ] NGVT: Trimmed 34485 records to 24542 (keeping 200 days of data) [2025-09-17T20:36:10.632045] [DEBUG] [LOCAL ] NGVT: Primary data saved (24542 records). [2025-09-17T20:36:10.632201] [INFO ] [MAIN ] NGVT: Full history saved. [2025-09-17T20:36:10.632363] [INFO ] [MAIN ] Update Progress: 1480/2371 symbols completed. NGVT took 23.4s. Estimated remaining: 2h 10m 8s. Rate: 6.8 symbols/min [2025-09-17T20:36:11.225880] [INFO ] [MAIN ] NHI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:36:11.312087] [INFO ] [MAIN ] NIC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:36:11.311256] [INFO ] [MAIN ] NIE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:36:11.332236] [INFO ] [MAIN ] NI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:36:11.349464] [DEBUG] [LOCAL ] NIC: Loaded 8892 existing records from primary storage. [2025-09-17T20:36:11.358772] [DEBUG] [LOCAL ] NIE: Loaded 11665 existing records from primary storage. [2025-09-17T20:36:11.359008] [INFO ] [MAIN ] NIC: Loaded 8892 existing records. [2025-09-17T20:36:11.359088] [INFO ] [MAIN ] NIE: Loaded 11665 existing records. [2025-09-17T20:36:11.565089] [DEBUG] [LOCAL ] NHI: Loaded 22187 existing records from primary storage. [2025-09-17T20:36:11.597156] [INFO ] [MAIN ] NHI: Loaded 22187 existing records. [2025-09-17T20:36:11.750830] [DEBUG] [LOCAL ] NI: Loaded 53423 existing records from primary storage. [2025-09-17T20:36:11.811916] [INFO ] [MAIN ] NI: Loaded 53423 existing records. [2025-09-17T20:36:11.841977] [WARN ] [MAIN ] NIC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:36:11.907333] [WARN ] [MAIN ] NIE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:36:11.918666] [INFO ] [MAIN ] NIC: Wiping existing primary data before full refresh. [2025-09-17T20:36:11.956382] [INFO ] [MAIN ] NIE: Wiping existing primary data before full refresh. [2025-09-17T20:36:11.981481] [INFO ] [LOCAL ] NIC: Starting deletion of primary data. [2025-09-17T20:36:11.996930] [INFO ] [LOCAL ] NIE: Starting deletion of primary data. [2025-09-17T20:36:12.052193] [DEBUG] [LOCAL ] NIC: Deleted primary data file. [2025-09-17T20:36:12.052119] [DEBUG] [LOCAL ] NIE: Deleted primary data file. [2025-09-17T20:36:12.071820] [INFO ] [MAIN ] NIE: Starting full primary refresh. [2025-09-17T20:36:12.087312] [INFO ] [MAIN ] NIC: Starting full primary refresh. [2025-09-17T20:36:12.121798] [WARN ] [MAIN ] NHI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:36:12.339304] [WARN ] [MAIN ] NI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:36:12.344623] [INFO ] [MAIN ] NHI: Wiping existing primary data before full refresh. [2025-09-17T20:36:12.360441] [INFO ] [LOCAL ] NHI: Starting deletion of primary data. [2025-09-17T20:36:12.381698] [INFO ] [MAIN ] NI: Wiping existing primary data before full refresh. [2025-09-17T20:36:12.408298] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-17T20:36:12.426334] [DEBUG] [LOCAL ] NI: Deleted primary data file. [2025-09-17T20:36:12.421135] [DEBUG] [LOCAL ] NHI: Deleted primary data file. [2025-09-17T20:36:12.495753] [INFO ] [MAIN ] NHI: Starting full primary refresh. [2025-09-17T20:36:12.466968] [INFO ] [MAIN ] NI: Starting full primary refresh. [2025-09-17T20:36:13.170167] [INFO ] [REMOTE ] NIE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:36:13.304900] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-11. [2025-09-17T20:36:13.376533] [INFO ] [REMOTE ] NIC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:36:13.416111] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-11. [2025-09-17T20:36:13.634870] [INFO ] [REMOTE ] NHI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:36:13.655249] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-11. [2025-09-17T20:36:13.654982] [INFO ] [REMOTE ] NI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:36:13.656361] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-11. [2025-09-17T20:36:14.348279] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T20:36:14.350583] [INFO ] [REMOTE ] NIC: Fetching primary data for 2024-12. [2025-09-17T20:36:14.414225] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T20:36:14.417235] [INFO ] [REMOTE ] NIE: Fetching primary data for 2024-12. [2025-09-17T20:36:14.699287] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T20:36:14.704547] [INFO ] [REMOTE ] NHI: Fetching primary data for 2024-12. [2025-09-17T20:36:14.914657] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T20:36:14.916980] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-01. [2025-09-17T20:36:15.100978] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T20:36:15.104797] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-01. [2025-09-17T20:36:15.277275] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T20:36:15.493227] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T20:36:15.615757] [INFO ] [REMOTE ] NI: Fetching primary data for 2024-12. [2025-09-17T20:36:15.733218] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T20:36:16.051475] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T20:36:16.415784] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-01. [2025-09-17T20:36:17.215789] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-02. [2025-09-17T20:36:17.393912] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T20:36:17.534863] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T20:36:18.015772] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-02. [2025-09-17T20:36:18.081252] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T20:36:18.815763] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-03. [2025-09-17T20:36:19.005596] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T20:36:19.415457] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T20:36:19.615769] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-04. [2025-09-17T20:36:20.415774] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-01. [2025-09-17T20:36:20.475081] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T20:36:21.215780] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-03. [2025-09-17T20:36:22.015764] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-02. [2025-09-17T20:36:22.376229] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T20:36:22.554421] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T20:36:22.559043] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-17T20:36:22.815786] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-04. [2025-09-17T20:36:23.615771] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-05. [2025-09-17T20:36:24.007677] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T20:36:24.415685] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-03. [2025-09-17T20:36:24.423705] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T20:36:25.215758] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-06. [2025-09-17T20:36:25.329670] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T20:36:26.015776] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-04. [2025-09-17T20:36:26.091670] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T20:36:26.815782] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-02. [2025-09-17T20:36:26.996312] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T20:36:27.615795] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-05. [2025-09-17T20:36:28.415765] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-05. [2025-09-17T20:36:28.635987] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T20:36:28.654769] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T20:36:29.215777] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-06. [2025-09-17T20:36:29.411406] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T20:36:30.018368] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-06. [2025-09-17T20:36:30.021289] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T20:36:30.815741] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-03. [2025-09-17T20:36:31.212238] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T20:36:31.615833] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-07. [2025-09-17T20:36:32.415762] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-07. [2025-09-17T20:36:32.859697] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T20:36:32.885423] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T20:36:33.215789] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-04. [2025-09-17T20:36:33.453707] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T20:36:34.015819] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-07. [2025-09-17T20:36:34.815859] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-08. [2025-09-17T20:36:34.941059] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T20:36:35.167569] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T20:36:35.615753] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-05. [2025-09-17T20:36:36.029280] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T20:36:36.415801] [INFO ] [REMOTE ] NHI: Fetching primary data for 2025-09. [2025-09-17T20:36:37.215794] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-08. [2025-09-17T20:36:37.576453] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T20:36:37.595527] [INFO ] [REMOTE ] NHI: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T20:36:37.599892] [INFO ] [REMOTE ] NHI: Full fetch complete (31638 records). [2025-09-17T20:36:37.600057] [DEBUG] [VALIDATOR ] NHI: Validating primary data. [2025-09-17T20:36:37.988261] [DEBUG] [VALIDATOR ] NHI: All expected trading days are present. [2025-09-17T20:36:37.988344] [DEBUG] [VALIDATOR ] NHI: Primary data validation passed. [2025-09-17T20:36:37.989020] [INFO ] [MAIN ] NHI: Fetched primary data is valid. [2025-09-17T20:36:37.989064] [DEBUG] [LOCAL ] NHI: Saving primary data. [2025-09-17T20:36:37.989878] [DEBUG] [LOCAL ] NHI: Trimmed 31638 records to 22149 (keeping 200 days of data) [2025-09-17T20:36:38.045434] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-06. [2025-09-17T20:36:38.119271] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T20:36:38.150784] [DEBUG] [LOCAL ] NHI: Primary data saved (22149 records). [2025-09-17T20:36:38.151097] [INFO ] [MAIN ] NHI: Full history saved. [2025-09-17T20:36:38.151241] [INFO ] [MAIN ] Update Progress: 1481/2371 symbols completed. NHI took 27.5s. Estimated remaining: 2h 10m 10s. Rate: 6.8 symbols/min [2025-09-17T20:36:38.321430] [INFO ] [MAIN ] NIM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:36:38.328369] [DEBUG] [LOCAL ] NIM: Loaded 4172 existing records from primary storage. [2025-09-17T20:36:38.328515] [INFO ] [MAIN ] NIM: Loaded 4172 existing records. [2025-09-17T20:36:38.520569] [WARN ] [MAIN ] NIM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:36:38.521189] [INFO ] [MAIN ] NIM: Wiping existing primary data before full refresh. [2025-09-17T20:36:38.521263] [INFO ] [LOCAL ] NIM: Starting deletion of primary data. [2025-09-17T20:36:38.521574] [DEBUG] [LOCAL ] NIM: Deleted primary data file. [2025-09-17T20:36:38.521622] [INFO ] [MAIN ] NIM: Starting full primary refresh. [2025-09-17T20:36:38.820895] [INFO ] [REMOTE ] NIE: Fetching primary data for 2025-09. [2025-09-17T20:36:38.892815] [INFO ] [REMOTE ] NIM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:36:39.604189] [INFO ] [REMOTE ] NIE: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T20:36:39.605946] [INFO ] [REMOTE ] NIE: Full fetch complete (16343 records). [2025-09-17T20:36:39.606019] [DEBUG] [VALIDATOR ] NIE: Validating primary data. [2025-09-17T20:36:39.620852] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-11. [2025-09-17T20:36:39.985017] [DEBUG] [VALIDATOR ] NIE: All expected trading days are present. [2025-09-17T20:36:39.985166] [DEBUG] [VALIDATOR ] NIE: Primary data validation passed. [2025-09-17T20:36:39.985578] [INFO ] [MAIN ] NIE: Fetched primary data is valid. [2025-09-17T20:36:39.985668] [DEBUG] [LOCAL ] NIE: Saving primary data. [2025-09-17T20:36:39.986442] [DEBUG] [LOCAL ] NIE: Trimmed 16343 records to 11673 (keeping 200 days of data) [2025-09-17T20:36:40.060755] [DEBUG] [LOCAL ] NIE: Primary data saved (11673 records). [2025-09-17T20:36:40.060978] [INFO ] [MAIN ] NIE: Full history saved. [2025-09-17T20:36:40.061086] [INFO ] [MAIN ] Update Progress: 1482/2371 symbols completed. NIE took 29.4s. Estimated remaining: 2h 9m 57s. Rate: 6.8 symbols/min [2025-09-17T20:36:40.251932] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-17T20:36:40.275269] [INFO ] [MAIN ] NINE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:36:40.316318] [DEBUG] [LOCAL ] NINE: Loaded 29103 existing records from primary storage. [2025-09-17T20:36:40.316491] [INFO ] [MAIN ] NINE: Loaded 29103 existing records. [2025-09-17T20:36:40.421027] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-08. [2025-09-17T20:36:40.507350] [WARN ] [MAIN ] NINE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:36:40.507701] [INFO ] [MAIN ] NINE: Wiping existing primary data before full refresh. [2025-09-17T20:36:40.507754] [INFO ] [LOCAL ] NINE: Starting deletion of primary data. [2025-09-17T20:36:40.508804] [DEBUG] [LOCAL ] NINE: Deleted primary data file. [2025-09-17T20:36:40.508859] [INFO ] [MAIN ] NINE: Starting full primary refresh. [2025-09-17T20:36:40.735247] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T20:36:40.894571] [INFO ] [REMOTE ] NINE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:36:41.215823] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-11. [2025-09-17T20:36:41.232109] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T20:36:42.015898] [INFO ] [REMOTE ] NIC: Fetching primary data for 2025-09. [2025-09-17T20:36:42.742602] [INFO ] [REMOTE ] NIC: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T20:36:42.744094] [INFO ] [REMOTE ] NIC: Full fetch complete (12031 records). [2025-09-17T20:36:42.744168] [DEBUG] [VALIDATOR ] NIC: Validating primary data. [2025-09-17T20:36:42.820961] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-07. [2025-09-17T20:36:43.173668] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-11 (1.96 seconds). [2025-09-17T20:36:43.190433] [DEBUG] [VALIDATOR ] NIC: All expected trading days are present. [2025-09-17T20:36:43.190552] [DEBUG] [VALIDATOR ] NIC: Primary data validation passed. [2025-09-17T20:36:43.191025] [INFO ] [MAIN ] NIC: Fetched primary data is valid. [2025-09-17T20:36:43.191077] [DEBUG] [LOCAL ] NIC: Saving primary data. [2025-09-17T20:36:43.191776] [DEBUG] [LOCAL ] NIC: Trimmed 12031 records to 8913 (keeping 200 days of data) [2025-09-17T20:36:43.266606] [DEBUG] [LOCAL ] NIC: Primary data saved (8913 records). [2025-09-17T20:36:43.266889] [INFO ] [MAIN ] NIC: Full history saved. [2025-09-17T20:36:43.267029] [INFO ] [MAIN ] Update Progress: 1483/2371 symbols completed. NIC took 32.6s. Estimated remaining: 2h 9m 45s. Rate: 6.8 symbols/min [2025-09-17T20:36:43.451955] [INFO ] [MAIN ] NIO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:36:43.515394] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-09-17T20:36:43.515689] [INFO ] [MAIN ] NIO: Loaded 53802 existing records. [2025-09-17T20:36:43.620976] [INFO ] [REMOTE ] NINE: Fetching primary data for 2024-12. [2025-09-17T20:36:43.722228] [WARN ] [MAIN ] NIO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:36:43.722610] [INFO ] [MAIN ] NIO: Wiping existing primary data before full refresh. [2025-09-17T20:36:43.722688] [INFO ] [LOCAL ] NIO: Starting deletion of primary data. [2025-09-17T20:36:43.724326] [DEBUG] [LOCAL ] NIO: Deleted primary data file. [2025-09-17T20:36:43.724630] [INFO ] [MAIN ] NIO: Starting full primary refresh. [2025-09-17T20:36:44.105793] [INFO ] [REMOTE ] NIO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:36:44.415827] [INFO ] [REMOTE ] NIM: Fetching primary data for 2024-12. [2025-09-17T20:36:44.845234] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T20:36:45.027835] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T20:36:45.183258] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T20:36:45.215773] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-01. [2025-09-17T20:36:46.015850] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-11. [2025-09-17T20:36:46.605992] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T20:36:46.815822] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-08. [2025-09-17T20:36:47.615881] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-02. [2025-09-17T20:36:48.415833] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-01. [2025-09-17T20:36:48.679732] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-11 (2.66 seconds). [2025-09-17T20:36:48.758937] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T20:36:48.843738] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T20:36:48.858366] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T20:36:49.215835] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-03. [2025-09-17T20:36:50.015863] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-02. [2025-09-17T20:36:50.488004] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T20:36:50.688724] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T20:36:50.815820] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-03. [2025-09-17T20:36:51.443041] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T20:36:51.615816] [INFO ] [REMOTE ] NI: Fetching primary data for 2025-09. [2025-09-17T20:36:52.359755] [INFO ] [REMOTE ] NI: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T20:36:52.368603] [INFO ] [REMOTE ] NI: Full fetch complete (76696 records). [2025-09-17T20:36:52.368876] [DEBUG] [VALIDATOR ] NI: Validating primary data. [2025-09-17T20:36:52.370312] [FATAL] [VALIDATOR ] NI: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:36:52.370429] [FATAL] [MAIN ] NI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:36:52.370469] [WARN ] [MAIN ] NI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:36:52.370527] [INFO ] [LOCAL ] NI: Starting deletion of primary data. [2025-09-17T20:36:52.370604] [DEBUG] [LOCAL ] NI: No primary data file found to delete. [2025-09-17T20:36:52.370664] [INFO ] [LOCAL ] NI: Starting deletion of derivative data. [2025-09-17T20:36:52.371097] [DEBUG] [LOCAL ] NI: Deleted derivative data file. [2025-09-17T20:36:52.371209] [INFO ] [MAIN ] Update Progress: 1484/2371 symbols completed. NI took 41.7s. Estimated remaining: 2h 9m 36s. Rate: 6.8 symbols/min [2025-09-17T20:36:52.421043] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-04. [2025-09-17T20:36:52.553250] [INFO ] [MAIN ] NIQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:36:52.553520] [DEBUG] [LOCAL ] NIQ: No existing data file found in primary storage. [2025-09-17T20:36:52.553560] [WARN ] [MAIN ] NIQ: No existing data found, performing full refresh instead. [2025-09-17T20:36:52.553717] [INFO ] [MAIN ] NIQ: Wiping existing primary data before full refresh. [2025-09-17T20:36:52.553779] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-17T20:36:52.553825] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-17T20:36:52.553859] [INFO ] [MAIN ] NIQ: Starting full primary refresh. [2025-09-17T20:36:52.934770] [INFO ] [REMOTE ] NIQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:36:53.215813] [INFO ] [REMOTE ] NIO: Fetching primary data for 2024-12. [2025-09-17T20:36:53.882674] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T20:36:54.015762] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-05. [2025-09-17T20:36:54.815853] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-04. [2025-09-17T20:36:55.294436] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T20:36:55.518171] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T20:36:55.595837] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2024-12 (2.38 seconds). [2025-09-17T20:36:55.615730] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-01. [2025-09-17T20:36:56.415775] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-11. [2025-09-17T20:36:56.753274] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:36:56.753600] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-11 [2025-09-17T20:36:57.215810] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-06. [2025-09-17T20:36:57.900916] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-17T20:36:58.015871] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-05. [2025-09-17T20:36:58.718277] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T20:36:58.775721] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-06 (1.56 seconds). [2025-09-17T20:36:58.815762] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-06. [2025-09-17T20:36:59.348611] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T20:36:59.615776] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-07. [2025-09-17T20:37:00.233163] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T20:37:00.415816] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2024-12. [2025-09-17T20:37:00.749447] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:37:00.749841] [WARN ] [REMOTE ] NIQ: No data returned for month 2024-12 [2025-09-17T20:37:01.215799] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-02. [2025-09-17T20:37:02.015801] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-07. [2025-09-17T20:37:02.815811] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-08. [2025-09-17T20:37:03.306098] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T20:37:03.373250] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T20:37:03.444528] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-02 (2.23 seconds). [2025-09-17T20:37:03.615781] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-03. [2025-09-17T20:37:04.415782] [INFO ] [REMOTE ] NIM: Fetching primary data for 2025-09. [2025-09-17T20:37:04.810530] [INFO ] [REMOTE ] NIM: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T20:37:04.811493] [INFO ] [REMOTE ] NIM: Full fetch complete (6941 records). [2025-09-17T20:37:04.811563] [DEBUG] [VALIDATOR ] NIM: Validating primary data. [2025-09-17T20:37:05.173696] [DEBUG] [VALIDATOR ] NIM: All expected trading days are present. [2025-09-17T20:37:05.173813] [DEBUG] [VALIDATOR ] NIM: Primary data validation passed. [2025-09-17T20:37:05.174072] [INFO ] [MAIN ] NIM: Fetched primary data is valid. [2025-09-17T20:37:05.174113] [DEBUG] [LOCAL ] NIM: Saving primary data. [2025-09-17T20:37:05.174555] [DEBUG] [LOCAL ] NIM: Trimmed 6941 records to 4158 (keeping 200 days of data) [2025-09-17T20:37:05.202041] [DEBUG] [LOCAL ] NIM: Primary data saved (4158 records). [2025-09-17T20:37:05.202183] [INFO ] [MAIN ] NIM: Full history saved. [2025-09-17T20:37:05.202274] [INFO ] [MAIN ] Update Progress: 1485/2371 symbols completed. NIM took 27.1s. Estimated remaining: 2h 9m 30s. Rate: 6.8 symbols/min [2025-09-17T20:37:05.223290] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-08. [2025-09-17T20:37:05.392582] [INFO ] [MAIN ] NJR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:37:05.432198] [DEBUG] [LOCAL ] NJR: Loaded 37915 existing records from primary storage. [2025-09-17T20:37:05.432354] [INFO ] [MAIN ] NJR: Loaded 37915 existing records. [2025-09-17T20:37:05.611593] [WARN ] [MAIN ] NJR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:37:05.611876] [INFO ] [MAIN ] NJR: Wiping existing primary data before full refresh. [2025-09-17T20:37:05.611922] [INFO ] [LOCAL ] NJR: Starting deletion of primary data. [2025-09-17T20:37:05.612867] [DEBUG] [LOCAL ] NJR: Deleted primary data file. [2025-09-17T20:37:05.612939] [INFO ] [MAIN ] NJR: Starting full primary refresh. [2025-09-17T20:37:05.976665] [INFO ] [REMOTE ] NJR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:37:06.015792] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-01. [2025-09-17T20:37:06.284734] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:37:06.285087] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-01 [2025-09-17T20:37:06.333435] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-03 (2.72 seconds). [2025-09-17T20:37:06.663974] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T20:37:06.815818] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-11. [2025-09-17T20:37:07.615790] [INFO ] [REMOTE ] NINE: Fetching primary data for 2025-09. [2025-09-17T20:37:08.050634] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T20:37:08.415797] [INFO ] [REMOTE ] NJR: Fetching primary data for 2024-12. [2025-09-17T20:37:08.685689] [INFO ] [REMOTE ] NINE: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T20:37:08.688800] [INFO ] [REMOTE ] NINE: Full fetch complete (44677 records). [2025-09-17T20:37:08.688897] [DEBUG] [VALIDATOR ] NINE: Validating primary data. [2025-09-17T20:37:09.073294] [DEBUG] [VALIDATOR ] NINE: All expected trading days are present. [2025-09-17T20:37:09.073381] [DEBUG] [VALIDATOR ] NINE: Primary data validation passed. [2025-09-17T20:37:09.074161] [INFO ] [MAIN ] NINE: Fetched primary data is valid. [2025-09-17T20:37:09.074207] [DEBUG] [LOCAL ] NINE: Saving primary data. [2025-09-17T20:37:09.075356] [DEBUG] [LOCAL ] NINE: Trimmed 44677 records to 29062 (keeping 200 days of data) [2025-09-17T20:37:09.220128] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-04. [2025-09-17T20:37:09.255547] [DEBUG] [LOCAL ] NINE: Primary data saved (29062 records). [2025-09-17T20:37:09.255694] [INFO ] [MAIN ] NINE: Full history saved. [2025-09-17T20:37:09.255784] [INFO ] [MAIN ] Update Progress: 1486/2371 symbols completed. NINE took 29.2s. Estimated remaining: 2h 9m 19s. Rate: 6.8 symbols/min [2025-09-17T20:37:09.429075] [INFO ] [MAIN ] NKE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:37:09.429246] [DEBUG] [LOCAL ] NKE: No existing data file found in primary storage. [2025-09-17T20:37:09.429283] [WARN ] [MAIN ] NKE: No existing data found, performing full refresh instead. [2025-09-17T20:37:09.429407] [INFO ] [MAIN ] NKE: Wiping existing primary data before full refresh. [2025-09-17T20:37:09.429446] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-17T20:37:09.429485] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-17T20:37:09.429518] [INFO ] [MAIN ] NKE: Starting full primary refresh. [2025-09-17T20:37:09.790715] [INFO ] [REMOTE ] NKE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:37:09.892079] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T20:37:10.015778] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-01. [2025-09-17T20:37:10.815789] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-02. [2025-09-17T20:37:11.124372] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:37:11.124763] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-02 [2025-09-17T20:37:11.367414] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T20:37:11.490692] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-04 (2.27 seconds). [2025-09-17T20:37:11.615736] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-05. [2025-09-17T20:37:12.415776] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-02. [2025-09-17T20:37:13.215779] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-11. [2025-09-17T20:37:13.879023] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T20:37:13.929345] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-17T20:37:14.015816] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-03. [2025-09-17T20:37:14.815821] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-03. [2025-09-17T20:37:15.065356] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:37:15.065721] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-03 [2025-09-17T20:37:15.550472] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T20:37:15.615731] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-04. [2025-09-17T20:37:15.723440] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-11 (2.51 seconds). [2025-09-17T20:37:16.415787] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-06. [2025-09-17T20:37:17.215801] [INFO ] [REMOTE ] NKE: Fetching primary data for 2024-12. [2025-09-17T20:37:17.293514] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T20:37:18.015813] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-05. [2025-09-17T20:37:18.753803] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-17T20:37:18.815724] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-07. [2025-09-17T20:37:19.589204] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T20:37:19.615715] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-06. [2025-09-17T20:37:19.708321] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-17T20:37:20.415828] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-01. [2025-09-17T20:37:20.755475] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T20:37:21.080740] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-17T20:37:21.215791] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-08. [2025-09-17T20:37:22.015781] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-04. [2025-09-17T20:37:22.311733] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:37:22.312070] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-04 [2025-09-17T20:37:22.675368] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-17T20:37:22.815799] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-05. [2025-09-17T20:37:23.076831] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:37:23.077160] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-05 [2025-09-17T20:37:23.419388] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-17T20:37:23.615807] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-07. [2025-09-17T20:37:24.415794] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-06. [2025-09-17T20:37:24.729843] [DEBUG] [REMOTE ] NIQ: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:37:24.730122] [WARN ] [REMOTE ] NIQ: No data returned for month 2025-06 [2025-09-17T20:37:25.192296] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T20:37:25.215732] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-08. [2025-09-17T20:37:26.015820] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-02. [2025-09-17T20:37:26.815836] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-07. [2025-09-17T20:37:26.869069] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T20:37:27.615764] [INFO ] [REMOTE ] NJR: Fetching primary data for 2025-09. [2025-09-17T20:37:27.785792] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T20:37:28.114703] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T20:37:28.415821] [INFO ] [REMOTE ] NIO: Fetching primary data for 2025-09. [2025-09-17T20:37:28.747354] [INFO ] [REMOTE ] NJR: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T20:37:28.752685] [INFO ] [REMOTE ] NJR: Full fetch complete (54004 records). [2025-09-17T20:37:28.752822] [DEBUG] [VALIDATOR ] NJR: Validating primary data. [2025-09-17T20:37:29.160388] [DEBUG] [VALIDATOR ] NJR: All expected trading days are present. [2025-09-17T20:37:29.160537] [DEBUG] [VALIDATOR ] NJR: Primary data validation passed. [2025-09-17T20:37:29.162319] [INFO ] [MAIN ] NJR: Fetched primary data is valid. [2025-09-17T20:37:29.162387] [DEBUG] [LOCAL ] NJR: Saving primary data. [2025-09-17T20:37:29.164315] [DEBUG] [LOCAL ] NJR: Trimmed 54004 records to 37970 (keeping 200 days of data) [2025-09-17T20:37:29.226223] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-03. [2025-09-17T20:37:29.425872] [DEBUG] [LOCAL ] NJR: Primary data saved (37970 records). [2025-09-17T20:37:29.426098] [INFO ] [MAIN ] NJR: Full history saved. [2025-09-17T20:37:29.426214] [INFO ] [MAIN ] Update Progress: 1487/2371 symbols completed. NJR took 24.2s. Estimated remaining: 2h 9m 17s. Rate: 6.8 symbols/min [2025-09-17T20:37:29.605427] [INFO ] [MAIN ] NKX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:37:29.623140] [DEBUG] [LOCAL ] NKX: Loaded 13626 existing records from primary storage. [2025-09-17T20:37:29.623322] [INFO ] [MAIN ] NKX: Loaded 13626 existing records. [2025-09-17T20:37:29.804248] [WARN ] [MAIN ] NKX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:37:29.804533] [INFO ] [MAIN ] NKX: Wiping existing primary data before full refresh. [2025-09-17T20:37:29.804593] [INFO ] [LOCAL ] NKX: Starting deletion of primary data. [2025-09-17T20:37:29.805032] [DEBUG] [LOCAL ] NKX: Deleted primary data file. [2025-09-17T20:37:29.805078] [INFO ] [MAIN ] NKX: Starting full primary refresh. [2025-09-17T20:37:30.024766] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-08. [2025-09-17T20:37:30.163360] [INFO ] [REMOTE ] NKX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:37:30.815833] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-11. [2025-09-17T20:37:30.918449] [INFO ] [REMOTE ] NIO: Incremental fetch complete for 2025-09 (2.50 seconds). [2025-09-17T20:37:30.926173] [INFO ] [REMOTE ] NIO: Full fetch complete (77970 records). [2025-09-17T20:37:30.926353] [DEBUG] [VALIDATOR ] NIO: Validating primary data. [2025-09-17T20:37:31.354082] [DEBUG] [VALIDATOR ] NIO: All expected trading days are present. [2025-09-17T20:37:31.354215] [DEBUG] [VALIDATOR ] NIO: Primary data validation passed. [2025-09-17T20:37:31.355744] [INFO ] [MAIN ] NIO: Fetched primary data is valid. [2025-09-17T20:37:31.355833] [DEBUG] [LOCAL ] NIO: Saving primary data. [2025-09-17T20:37:31.358225] [DEBUG] [LOCAL ] NIO: Trimmed 77970 records to 53802 (keeping 200 days of data) [2025-09-17T20:37:31.689180] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T20:37:31.702361] [INFO ] [REMOTE ] NIQ: Fetching primary data for 2025-09. [2025-09-17T20:37:31.747752] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-17T20:37:31.764147] [DEBUG] [LOCAL ] NIO: Primary data saved (53802 records). [2025-09-17T20:37:31.764751] [INFO ] [MAIN ] NIO: Full history saved. [2025-09-17T20:37:31.764873] [INFO ] [MAIN ] Update Progress: 1488/2371 symbols completed. NIO took 48.5s. Estimated remaining: 2h 9m 4s. Rate: 6.8 symbols/min [2025-09-17T20:37:31.962409] [INFO ] [MAIN ] NL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:37:31.962691] [DEBUG] [LOCAL ] NL: No existing data file found in primary storage. [2025-09-17T20:37:31.962855] [WARN ] [MAIN ] NL: No existing data found, performing full refresh instead. [2025-09-17T20:37:31.963062] [INFO ] [MAIN ] NL: Wiping existing primary data before full refresh. [2025-09-17T20:37:31.963117] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-17T20:37:31.970075] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-17T20:37:31.970168] [INFO ] [MAIN ] NL: Starting full primary refresh. [2025-09-17T20:37:32.004638] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T20:37:32.332749] [INFO ] [REMOTE ] NL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:37:32.415790] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-04. [2025-09-17T20:37:32.962623] [INFO ] [REMOTE ] NIQ: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T20:37:32.968321] [INFO ] [REMOTE ] NIQ: Full fetch complete (13662 records). [2025-09-17T20:37:32.968422] [DEBUG] [VALIDATOR ] NIQ: Validating primary data. [2025-09-17T20:37:33.154377] [WARN ] [VALIDATOR ] NIQ: Validation failed - insufficient historical data. Have 40 unique days, need 200 days [2025-09-17T20:37:33.154746] [FATAL] [MAIN ] NIQ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:37:33.154802] [WARN ] [MAIN ] NIQ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:37:33.154842] [INFO ] [LOCAL ] NIQ: Starting deletion of primary data. [2025-09-17T20:37:33.154901] [DEBUG] [LOCAL ] NIQ: No primary data file found to delete. [2025-09-17T20:37:33.154936] [INFO ] [LOCAL ] NIQ: Starting deletion of derivative data. [2025-09-17T20:37:33.154986] [DEBUG] [LOCAL ] NIQ: No derivative data file found to delete. [2025-09-17T20:37:33.155071] [INFO ] [MAIN ] Update Progress: 1489/2371 symbols completed. NIQ took 40.8s. Estimated remaining: 2h 8m 51s. Rate: 6.8 symbols/min [2025-09-17T20:37:33.221016] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-11. [2025-09-17T20:37:33.359171] [INFO ] [MAIN ] NLOP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:37:33.371531] [DEBUG] [LOCAL ] NLOP: Loaded 11781 existing records from primary storage. [2025-09-17T20:37:33.371678] [INFO ] [MAIN ] NLOP: Loaded 11781 existing records. [2025-09-17T20:37:33.557881] [WARN ] [MAIN ] NLOP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:37:33.558293] [INFO ] [MAIN ] NLOP: Wiping existing primary data before full refresh. [2025-09-17T20:37:33.558349] [INFO ] [LOCAL ] NLOP: Starting deletion of primary data. [2025-09-17T20:37:33.558845] [DEBUG] [LOCAL ] NLOP: Deleted primary data file. [2025-09-17T20:37:33.558898] [INFO ] [MAIN ] NLOP: Starting full primary refresh. [2025-09-17T20:37:33.919070] [INFO ] [REMOTE ] NLOP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:37:33.919983] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-17T20:37:34.015737] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-11. [2025-09-17T20:37:34.815806] [INFO ] [REMOTE ] NKX: Fetching primary data for 2024-12. [2025-09-17T20:37:34.836602] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T20:37:35.469910] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-04 (3.05 seconds). [2025-09-17T20:37:35.615767] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-05. [2025-09-17T20:37:35.906532] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T20:37:36.415804] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-01. [2025-09-17T20:37:37.149057] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T20:37:37.215731] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-02. [2025-09-17T20:37:38.015862] [INFO ] [REMOTE ] NL: Fetching primary data for 2024-12. [2025-09-17T20:37:38.059448] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-17T20:37:38.083538] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T20:37:38.815819] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-06. [2025-09-17T20:37:38.886158] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T20:37:39.615834] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-01. [2025-09-17T20:37:40.273396] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T20:37:40.415861] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-03. [2025-09-17T20:37:41.110776] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T20:37:41.215818] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-07. [2025-09-17T20:37:41.340253] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T20:37:42.015837] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-04. [2025-09-17T20:37:42.654720] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T20:37:42.815777] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-05. [2025-09-17T20:37:43.615795] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-02. [2025-09-17T20:37:43.863738] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T20:37:43.899088] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-17T20:37:44.252614] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T20:37:44.415779] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-03. [2025-09-17T20:37:45.215825] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-08. [2025-09-17T20:37:45.487785] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T20:37:46.015850] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-04. [2025-09-17T20:37:46.701689] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T20:37:46.815832] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-05. [2025-09-17T20:37:47.449007] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-08 (2.23 seconds). [2025-09-17T20:37:47.485454] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T20:37:47.615797] [INFO ] [REMOTE ] NKE: Fetching primary data for 2025-09. [2025-09-17T20:37:48.415806] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-06. [2025-09-17T20:37:49.060553] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T20:37:49.215960] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2024-12. [2025-09-17T20:37:49.744125] [INFO ] [REMOTE ] NKE: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-17T20:37:49.751530] [INFO ] [REMOTE ] NKE: Full fetch complete (77178 records). [2025-09-17T20:37:49.751685] [DEBUG] [VALIDATOR ] NKE: Validating primary data. [2025-09-17T20:37:49.876110] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T20:37:49.971655] [WARN ] [VALIDATOR ] NKE: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T20:37:49.972451] [FATAL] [MAIN ] NKE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:37:49.972503] [WARN ] [MAIN ] NKE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:37:49.972555] [INFO ] [LOCAL ] NKE: Starting deletion of primary data. [2025-09-17T20:37:49.972630] [DEBUG] [LOCAL ] NKE: No primary data file found to delete. [2025-09-17T20:37:49.972688] [INFO ] [LOCAL ] NKE: Starting deletion of derivative data. [2025-09-17T20:37:49.972730] [DEBUG] [LOCAL ] NKE: No derivative data file found to delete. [2025-09-17T20:37:49.972809] [INFO ] [MAIN ] Update Progress: 1490/2371 symbols completed. NKE took 40.7s. Estimated remaining: 2h 8m 47s. Rate: 6.8 symbols/min [2025-09-17T20:37:50.026265] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-01. [2025-09-17T20:37:50.146876] [INFO ] [MAIN ] NLY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:37:50.204226] [DEBUG] [LOCAL ] NLY: Loaded 53583 existing records from primary storage. [2025-09-17T20:37:50.204393] [INFO ] [MAIN ] NLY: Loaded 53583 existing records. [2025-09-17T20:37:50.384438] [WARN ] [MAIN ] NLY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:37:50.384732] [INFO ] [MAIN ] NLY: Wiping existing primary data before full refresh. [2025-09-17T20:37:50.384782] [INFO ] [LOCAL ] NLY: Starting deletion of primary data. [2025-09-17T20:37:50.385870] [DEBUG] [LOCAL ] NLY: Deleted primary data file. [2025-09-17T20:37:50.385924] [INFO ] [MAIN ] NLY: Starting full primary refresh. [2025-09-17T20:37:50.803688] [INFO ] [REMOTE ] NLY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:37:50.818218] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-07. [2025-09-17T20:37:50.825350] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T20:37:51.581380] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T20:37:51.615788] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-02. [2025-09-17T20:37:52.415818] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-08. [2025-09-17T20:37:52.682923] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T20:37:53.109742] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T20:37:53.215752] [INFO ] [REMOTE ] NL: Fetching primary data for 2025-09. [2025-09-17T20:37:53.774667] [INFO ] [REMOTE ] NL: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T20:37:53.775785] [INFO ] [REMOTE ] NL: Full fetch complete (6967 records). [2025-09-17T20:37:53.775879] [DEBUG] [VALIDATOR ] NL: Validating primary data. [2025-09-17T20:37:53.955785] [WARN ] [VALIDATOR ] NL: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T20:37:53.956155] [FATAL] [MAIN ] NL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:37:53.956230] [WARN ] [MAIN ] NL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:37:53.956286] [INFO ] [LOCAL ] NL: Starting deletion of primary data. [2025-09-17T20:37:53.956371] [DEBUG] [LOCAL ] NL: No primary data file found to delete. [2025-09-17T20:37:53.956421] [INFO ] [LOCAL ] NL: Starting deletion of derivative data. [2025-09-17T20:37:53.956478] [DEBUG] [LOCAL ] NL: No derivative data file found to delete. [2025-09-17T20:37:53.956567] [INFO ] [MAIN ] Update Progress: 1491/2371 symbols completed. NL took 22.2s. Estimated remaining: 2h 8m 35s. Rate: 6.8 symbols/min [2025-09-17T20:37:54.024443] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-06. [2025-09-17T20:37:54.137766] [INFO ] [MAIN ] NMAI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:37:54.151825] [DEBUG] [LOCAL ] NMAI: Loaded 13188 existing records from primary storage. [2025-09-17T20:37:54.151937] [INFO ] [MAIN ] NMAI: Loaded 13188 existing records. [2025-09-17T20:37:54.328824] [WARN ] [MAIN ] NMAI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:37:54.329074] [INFO ] [MAIN ] NMAI: Wiping existing primary data before full refresh. [2025-09-17T20:37:54.329129] [INFO ] [LOCAL ] NMAI: Starting deletion of primary data. [2025-09-17T20:37:54.329615] [DEBUG] [LOCAL ] NMAI: Deleted primary data file. [2025-09-17T20:37:54.329692] [INFO ] [MAIN ] NMAI: Starting full primary refresh. [2025-09-17T20:37:54.689247] [INFO ] [REMOTE ] NMAI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:37:54.815749] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-11. [2025-09-17T20:37:54.955526] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T20:37:55.615755] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-07. [2025-09-17T20:37:55.869923] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T20:37:56.363435] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T20:37:56.415724] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-08. [2025-09-17T20:37:57.215826] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-11. [2025-09-17T20:37:57.341211] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T20:37:58.015831] [INFO ] [REMOTE ] NKX: Fetching primary data for 2025-09. [2025-09-17T20:37:58.815829] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2024-12. [2025-09-17T20:37:59.058730] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T20:37:59.092306] [INFO ] [REMOTE ] NKX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T20:37:59.094701] [INFO ] [REMOTE ] NKX: Full fetch complete (19568 records). [2025-09-17T20:37:59.094772] [DEBUG] [VALIDATOR ] NKX: Validating primary data. [2025-09-17T20:37:59.461324] [DEBUG] [VALIDATOR ] NKX: All expected trading days are present. [2025-09-17T20:37:59.461447] [DEBUG] [VALIDATOR ] NKX: Primary data validation passed. [2025-09-17T20:37:59.462029] [INFO ] [MAIN ] NKX: Fetched primary data is valid. [2025-09-17T20:37:59.462090] [DEBUG] [LOCAL ] NKX: Saving primary data. [2025-09-17T20:37:59.462775] [DEBUG] [LOCAL ] NKX: Trimmed 19568 records to 13635 (keeping 200 days of data) [2025-09-17T20:37:59.553398] [DEBUG] [LOCAL ] NKX: Primary data saved (13635 records). [2025-09-17T20:37:59.553538] [INFO ] [MAIN ] NKX: Full history saved. [2025-09-17T20:37:59.553659] [INFO ] [MAIN ] Update Progress: 1492/2371 symbols completed. NKX took 30.1s. Estimated remaining: 2h 8m 25s. Rate: 6.8 symbols/min [2025-09-17T20:37:59.618146] [INFO ] [REMOTE ] NLY: Fetching primary data for 2024-12. [2025-09-17T20:37:59.727523] [INFO ] [MAIN ] NMAX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:37:59.727809] [DEBUG] [LOCAL ] NMAX: No existing data file found in primary storage. [2025-09-17T20:37:59.727888] [WARN ] [MAIN ] NMAX: No existing data found, performing full refresh instead. [2025-09-17T20:37:59.738239] [INFO ] [MAIN ] NMAX: Wiping existing primary data before full refresh. [2025-09-17T20:37:59.738718] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T20:37:59.738864] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-17T20:37:59.739040] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-17T20:37:59.743404] [INFO ] [MAIN ] NMAX: Starting full primary refresh. [2025-09-17T20:38:00.098451] [INFO ] [REMOTE ] NMAX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:38:00.415838] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-01. [2025-09-17T20:38:01.215861] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-03. [2025-09-17T20:38:01.501352] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T20:38:01.676702] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-17T20:38:02.015812] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-11. [2025-09-17T20:38:02.029084] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T20:38:02.414832] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:38:02.415267] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-11 [2025-09-17T20:38:02.815849] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2024-12. [2025-09-17T20:38:03.059275] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:38:03.059743] [WARN ] [REMOTE ] NMAX: No data returned for month 2024-12 [2025-09-17T20:38:03.615867] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-01. [2025-09-17T20:38:03.928186] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:38:03.928690] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-01 [2025-09-17T20:38:04.415802] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-01. [2025-09-17T20:38:05.215801] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-02. [2025-09-17T20:38:06.015781] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-04. [2025-09-17T20:38:06.095133] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T20:38:06.425036] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T20:38:06.815800] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-03. [2025-09-17T20:38:06.895452] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T20:38:07.607837] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T20:38:07.615719] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-04. [2025-09-17T20:38:08.184249] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T20:38:08.415770] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-05. [2025-09-17T20:38:09.215824] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-02. [2025-09-17T20:38:09.290527] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T20:38:10.015775] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-02. [2025-09-17T20:38:10.285977] [DEBUG] [REMOTE ] NMAX: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:38:10.286320] [WARN ] [REMOTE ] NMAX: No data returned for month 2025-02 [2025-09-17T20:38:10.815854] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-03. [2025-09-17T20:38:11.091783] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T20:38:11.276091] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T20:38:11.615785] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-06. [2025-09-17T20:38:12.415768] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-04. [2025-09-17T20:38:12.625999] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T20:38:13.215777] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-05. [2025-09-17T20:38:14.015777] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-07. [2025-09-17T20:38:14.076772] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T20:38:14.815863] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-06. [2025-09-17T20:38:14.845946] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T20:38:14.963691] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-17T20:38:15.550786] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T20:38:15.615795] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-07. [2025-09-17T20:38:16.178749] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T20:38:16.415837] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-05. [2025-09-17T20:38:17.215791] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-03. [2025-09-17T20:38:18.015790] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-08. [2025-09-17T20:38:18.337793] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T20:38:18.666415] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T20:38:18.815701] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-06. [2025-09-17T20:38:18.956112] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T20:38:19.615794] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-08. [2025-09-17T20:38:20.415811] [INFO ] [REMOTE ] NMAI: Fetching primary data for 2025-09. [2025-09-17T20:38:20.828204] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-06 (2.01 seconds). [2025-09-17T20:38:20.866143] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T20:38:21.215783] [INFO ] [REMOTE ] NLOP: Fetching primary data for 2025-09. [2025-09-17T20:38:21.305725] [INFO ] [REMOTE ] NMAI: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T20:38:21.308385] [INFO ] [REMOTE ] NMAI: Full fetch complete (19907 records). [2025-09-17T20:38:21.308502] [DEBUG] [VALIDATOR ] NMAI: Validating primary data. [2025-09-17T20:38:21.696637] [DEBUG] [VALIDATOR ] NMAI: All expected trading days are present. [2025-09-17T20:38:21.696910] [DEBUG] [VALIDATOR ] NMAI: Primary data validation passed. [2025-09-17T20:38:21.697428] [INFO ] [MAIN ] NMAI: Fetched primary data is valid. [2025-09-17T20:38:21.697487] [DEBUG] [LOCAL ] NMAI: Saving primary data. [2025-09-17T20:38:21.698523] [DEBUG] [LOCAL ] NMAI: Trimmed 19907 records to 13194 (keeping 200 days of data) [2025-09-17T20:38:21.787555] [DEBUG] [LOCAL ] NMAI: Primary data saved (13194 records). [2025-09-17T20:38:21.787736] [INFO ] [MAIN ] NMAI: Full history saved. [2025-09-17T20:38:21.787832] [INFO ] [MAIN ] Update Progress: 1493/2371 symbols completed. NMAI took 27.8s. Estimated remaining: 2h 8m 24s. Rate: 6.8 symbols/min [2025-09-17T20:38:21.955692] [INFO ] [MAIN ] NMCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:38:21.972509] [DEBUG] [LOCAL ] NMCO: Loaded 16350 existing records from primary storage. [2025-09-17T20:38:21.972680] [INFO ] [MAIN ] NMCO: Loaded 16350 existing records. [2025-09-17T20:38:22.027194] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-04. [2025-09-17T20:38:22.158700] [WARN ] [MAIN ] NMCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:38:22.159019] [INFO ] [MAIN ] NMCO: Wiping existing primary data before full refresh. [2025-09-17T20:38:22.159073] [INFO ] [LOCAL ] NMCO: Starting deletion of primary data. [2025-09-17T20:38:22.159705] [DEBUG] [LOCAL ] NMCO: Deleted primary data file. [2025-09-17T20:38:22.159759] [INFO ] [MAIN ] NMCO: Starting full primary refresh. [2025-09-17T20:38:22.280316] [INFO ] [REMOTE ] NLOP: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T20:38:22.317235] [INFO ] [REMOTE ] NLOP: Full fetch complete (17593 records). [2025-09-17T20:38:22.334756] [DEBUG] [VALIDATOR ] NLOP: Validating primary data. [2025-09-17T20:38:22.835658] [INFO ] [REMOTE ] NMCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:38:22.825161] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-07. [2025-09-17T20:38:22.954084] [DEBUG] [VALIDATOR ] NLOP: All expected trading days are present. [2025-09-17T20:38:22.954186] [DEBUG] [VALIDATOR ] NLOP: Primary data validation passed. [2025-09-17T20:38:22.954849] [INFO ] [MAIN ] NLOP: Fetched primary data is valid. [2025-09-17T20:38:22.954918] [DEBUG] [LOCAL ] NLOP: Saving primary data. [2025-09-17T20:38:22.955523] [DEBUG] [LOCAL ] NLOP: Trimmed 17593 records to 11797 (keeping 200 days of data) [2025-09-17T20:38:23.029580] [DEBUG] [LOCAL ] NLOP: Primary data saved (11797 records). [2025-09-17T20:38:23.029758] [INFO ] [MAIN ] NLOP: Full history saved. [2025-09-17T20:38:23.029854] [INFO ] [MAIN ] Update Progress: 1494/2371 symbols completed. NLOP took 49.9s. Estimated remaining: 2h 8m 11s. Rate: 6.8 symbols/min [2025-09-17T20:38:23.200486] [INFO ] [MAIN ] NMG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:38:23.210318] [DEBUG] [LOCAL ] NMG: Loaded 7359 existing records from primary storage. [2025-09-17T20:38:23.210445] [INFO ] [MAIN ] NMG: Loaded 7359 existing records. [2025-09-17T20:38:23.401217] [WARN ] [MAIN ] NMG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:38:23.401543] [INFO ] [MAIN ] NMG: Wiping existing primary data before full refresh. [2025-09-17T20:38:23.401604] [INFO ] [LOCAL ] NMG: Starting deletion of primary data. [2025-09-17T20:38:23.402022] [DEBUG] [LOCAL ] NMG: Deleted primary data file. [2025-09-17T20:38:23.402081] [INFO ] [MAIN ] NMG: Starting full primary refresh. [2025-09-17T20:38:23.625471] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-11. [2025-09-17T20:38:23.764322] [INFO ] [REMOTE ] NMG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:38:23.800033] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T20:38:24.402255] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T20:38:24.415729] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2024-12. [2025-09-17T20:38:24.699659] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T20:38:25.215790] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-05. [2025-09-17T20:38:25.627737] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T20:38:26.015796] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-01. [2025-09-17T20:38:26.815767] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-08. [2025-09-17T20:38:27.028988] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T20:38:27.070792] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T20:38:27.615792] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-06. [2025-09-17T20:38:28.415818] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-11. [2025-09-17T20:38:28.586788] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T20:38:28.860470] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T20:38:29.215754] [INFO ] [REMOTE ] NMAX: Fetching primary data for 2025-09. [2025-09-17T20:38:29.646133] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T20:38:30.015804] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-02. [2025-09-17T20:38:30.664178] [INFO ] [REMOTE ] NMAX: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T20:38:30.669738] [INFO ] [REMOTE ] NMAX: Full fetch complete (38792 records). [2025-09-17T20:38:30.669859] [DEBUG] [VALIDATOR ] NMAX: Validating primary data. [2025-09-17T20:38:30.820858] [INFO ] [REMOTE ] NMG: Fetching primary data for 2024-12. [2025-09-17T20:38:30.863333] [WARN ] [VALIDATOR ] NMAX: Validation failed - insufficient historical data. Have 118 unique days, need 200 days [2025-09-17T20:38:30.864066] [FATAL] [MAIN ] NMAX: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:38:30.864175] [WARN ] [MAIN ] NMAX: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:38:30.864264] [INFO ] [LOCAL ] NMAX: Starting deletion of primary data. [2025-09-17T20:38:30.864359] [DEBUG] [LOCAL ] NMAX: No primary data file found to delete. [2025-09-17T20:38:30.864420] [INFO ] [LOCAL ] NMAX: Starting deletion of derivative data. [2025-09-17T20:38:30.864497] [DEBUG] [LOCAL ] NMAX: No derivative data file found to delete. [2025-09-17T20:38:30.864666] [INFO ] [MAIN ] Update Progress: 1495/2371 symbols completed. NMAX took 31.3s. Estimated remaining: 2h 8m 1s. Rate: 6.8 symbols/min [2025-09-17T20:38:31.053217] [INFO ] [MAIN ] NMI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:38:31.058710] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T20:38:31.067694] [DEBUG] [LOCAL ] NMI: Loaded 4088 existing records from primary storage. [2025-09-17T20:38:31.067863] [INFO ] [MAIN ] NMI: Loaded 4088 existing records. [2025-09-17T20:38:31.245223] [WARN ] [MAIN ] NMI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:38:31.245521] [INFO ] [MAIN ] NMI: Wiping existing primary data before full refresh. [2025-09-17T20:38:31.245584] [INFO ] [LOCAL ] NMI: Starting deletion of primary data. [2025-09-17T20:38:31.245945] [DEBUG] [LOCAL ] NMI: Deleted primary data file. [2025-09-17T20:38:31.246003] [INFO ] [MAIN ] NMI: Starting full primary refresh. [2025-09-17T20:38:31.596568] [INFO ] [REMOTE ] NMI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:38:31.615773] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-07. [2025-09-17T20:38:31.800533] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T20:38:32.415798] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-01. [2025-09-17T20:38:33.228531] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-03. [2025-09-17T20:38:33.235169] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T20:38:33.288854] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T20:38:34.015833] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-08. [2025-09-17T20:38:34.242892] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T20:38:34.815840] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-11. [2025-09-17T20:38:35.615804] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-04. [2025-09-17T20:38:35.730988] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T20:38:36.035923] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T20:38:36.415687] [INFO ] [REMOTE ] NLY: Fetching primary data for 2025-09. [2025-09-17T20:38:36.530705] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T20:38:37.215855] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-02. [2025-09-17T20:38:37.996540] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T20:38:38.015863] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-03. [2025-09-17T20:38:38.299154] [INFO ] [REMOTE ] NLY: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T20:38:38.306985] [INFO ] [REMOTE ] NLY: Full fetch complete (77423 records). [2025-09-17T20:38:38.307120] [DEBUG] [VALIDATOR ] NLY: Validating primary data. [2025-09-17T20:38:38.696058] [DEBUG] [VALIDATOR ] NLY: All expected trading days are present. [2025-09-17T20:38:38.696144] [DEBUG] [VALIDATOR ] NLY: Primary data validation passed. [2025-09-17T20:38:38.697181] [INFO ] [MAIN ] NLY: Fetched primary data is valid. [2025-09-17T20:38:38.697233] [DEBUG] [LOCAL ] NLY: Saving primary data. [2025-09-17T20:38:38.698772] [DEBUG] [LOCAL ] NLY: Trimmed 77423 records to 53581 (keeping 200 days of data) [2025-09-17T20:38:38.817689] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T20:38:38.816008] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-05. [2025-09-17T20:38:39.054465] [DEBUG] [LOCAL ] NLY: Primary data saved (53581 records). [2025-09-17T20:38:39.054624] [INFO ] [MAIN ] NLY: Full history saved. [2025-09-17T20:38:39.055716] [INFO ] [MAIN ] Update Progress: 1496/2371 symbols completed. NLY took 49.1s. Estimated remaining: 2h 7m 52s. Rate: 6.8 symbols/min [2025-09-17T20:38:39.238806] [INFO ] [MAIN ] NMM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:38:39.260975] [DEBUG] [LOCAL ] NMM: Loaded 14418 existing records from primary storage. [2025-09-17T20:38:39.261170] [INFO ] [MAIN ] NMM: Loaded 14418 existing records. [2025-09-17T20:38:39.443352] [WARN ] [MAIN ] NMM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:38:39.443726] [INFO ] [MAIN ] NMM: Wiping existing primary data before full refresh. [2025-09-17T20:38:39.443803] [INFO ] [LOCAL ] NMM: Starting deletion of primary data. [2025-09-17T20:38:39.444424] [DEBUG] [LOCAL ] NMM: Deleted primary data file. [2025-09-17T20:38:39.444476] [INFO ] [MAIN ] NMM: Starting full primary refresh. [2025-09-17T20:38:39.616164] [INFO ] [REMOTE ] NMI: Fetching primary data for 2024-12. [2025-09-17T20:38:39.832127] [INFO ] [REMOTE ] NMM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:38:39.844518] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T20:38:40.351393] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T20:38:40.415828] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-01. [2025-09-17T20:38:41.066191] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T20:38:41.215805] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-04. [2025-09-17T20:38:42.004964] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T20:38:42.015671] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-05. [2025-09-17T20:38:42.633845] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T20:38:42.815845] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-02. [2025-09-17T20:38:43.385242] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T20:38:43.615867] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-06. [2025-09-17T20:38:44.415858] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-03. [2025-09-17T20:38:44.668436] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T20:38:44.814789] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T20:38:45.215811] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-06. [2025-09-17T20:38:45.908102] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T20:38:46.015863] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-11. [2025-09-17T20:38:46.816608] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-07. [2025-09-17T20:38:46.824243] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T20:38:47.615786] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-04. [2025-09-17T20:38:47.762524] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T20:38:48.415813] [INFO ] [REMOTE ] NMM: Fetching primary data for 2024-12. [2025-09-17T20:38:48.427150] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T20:38:49.215841] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-08. [2025-09-17T20:38:49.579826] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T20:38:50.001455] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T20:38:50.015744] [INFO ] [REMOTE ] NMG: Fetching primary data for 2025-09. [2025-09-17T20:38:50.716067] [INFO ] [REMOTE ] NMG: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T20:38:50.717967] [INFO ] [REMOTE ] NMG: Full fetch complete (12811 records). [2025-09-17T20:38:50.718039] [DEBUG] [VALIDATOR ] NMG: Validating primary data. [2025-09-17T20:38:50.817392] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-01. [2025-09-17T20:38:51.081488] [DEBUG] [VALIDATOR ] NMG: All expected trading days are present. [2025-09-17T20:38:51.081579] [DEBUG] [VALIDATOR ] NMG: Primary data validation passed. [2025-09-17T20:38:51.081972] [INFO ] [MAIN ] NMG: Fetched primary data is valid. [2025-09-17T20:38:51.082016] [DEBUG] [LOCAL ] NMG: Saving primary data. [2025-09-17T20:38:51.082482] [DEBUG] [LOCAL ] NMG: Trimmed 12811 records to 7384 (keeping 200 days of data) [2025-09-17T20:38:51.128002] [DEBUG] [LOCAL ] NMG: Primary data saved (7384 records). [2025-09-17T20:38:51.128135] [INFO ] [MAIN ] NMG: Full history saved. [2025-09-17T20:38:51.128244] [INFO ] [MAIN ] Update Progress: 1497/2371 symbols completed. NMG took 28.1s. Estimated remaining: 2h 7m 45s. Rate: 6.8 symbols/min [2025-09-17T20:38:51.296303] [INFO ] [MAIN ] NMR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:38:51.342018] [DEBUG] [LOCAL ] NMR: Loaded 35260 existing records from primary storage. [2025-09-17T20:38:51.342187] [INFO ] [MAIN ] NMR: Loaded 35260 existing records. [2025-09-17T20:38:51.527439] [WARN ] [MAIN ] NMR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:38:51.527964] [INFO ] [MAIN ] NMR: Wiping existing primary data before full refresh. [2025-09-17T20:38:51.528012] [INFO ] [LOCAL ] NMR: Starting deletion of primary data. [2025-09-17T20:38:51.528882] [DEBUG] [LOCAL ] NMR: Deleted primary data file. [2025-09-17T20:38:51.528952] [INFO ] [MAIN ] NMR: Starting full primary refresh. [2025-09-17T20:38:51.620930] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-05. [2025-09-17T20:38:51.934405] [INFO ] [REMOTE ] NMR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:38:51.936159] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T20:38:52.400011] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T20:38:52.415741] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-06. [2025-09-17T20:38:53.058143] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T20:38:53.215775] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-07. [2025-09-17T20:38:54.015763] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-07. [2025-09-17T20:38:54.291061] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T20:38:54.441309] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T20:38:54.815805] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-08. [2025-09-17T20:38:55.547151] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T20:38:55.615815] [INFO ] [REMOTE ] NMI: Fetching primary data for 2025-09. [2025-09-17T20:38:56.335193] [INFO ] [REMOTE ] NMI: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T20:38:56.337020] [INFO ] [REMOTE ] NMI: Full fetch complete (6340 records). [2025-09-17T20:38:56.337107] [DEBUG] [VALIDATOR ] NMI: Validating primary data. [2025-09-17T20:38:56.420919] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-11. [2025-09-17T20:38:56.722580] [DEBUG] [VALIDATOR ] NMI: All expected trading days are present. [2025-09-17T20:38:56.722735] [DEBUG] [VALIDATOR ] NMI: Primary data validation passed. [2025-09-17T20:38:56.722978] [INFO ] [MAIN ] NMI: Fetched primary data is valid. [2025-09-17T20:38:56.723025] [DEBUG] [LOCAL ] NMI: Saving primary data. [2025-09-17T20:38:56.723829] [DEBUG] [LOCAL ] NMI: Trimmed 6340 records to 4116 (keeping 200 days of data) [2025-09-17T20:38:56.750368] [DEBUG] [LOCAL ] NMI: Primary data saved (4116 records). [2025-09-17T20:38:56.750549] [INFO ] [MAIN ] NMI: Full history saved. [2025-09-17T20:38:56.750672] [INFO ] [MAIN ] Update Progress: 1498/2371 symbols completed. NMI took 25.9s. Estimated remaining: 2h 7m 35s. Rate: 6.8 symbols/min [2025-09-17T20:38:56.929146] [INFO ] [MAIN ] NMS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:38:56.935407] [DEBUG] [LOCAL ] NMS: Loaded 2903 existing records from primary storage. [2025-09-17T20:38:56.935510] [INFO ] [MAIN ] NMS: Loaded 2903 existing records. [2025-09-17T20:38:57.115618] [WARN ] [MAIN ] NMS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:38:57.115943] [INFO ] [MAIN ] NMS: Wiping existing primary data before full refresh. [2025-09-17T20:38:57.115990] [INFO ] [LOCAL ] NMS: Starting deletion of primary data. [2025-09-17T20:38:57.116341] [DEBUG] [LOCAL ] NMS: Deleted primary data file. [2025-09-17T20:38:57.116389] [INFO ] [MAIN ] NMS: Starting full primary refresh. [2025-09-17T20:38:57.219063] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-02. [2025-09-17T20:38:57.489114] [INFO ] [REMOTE ] NMS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:38:57.771622] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T20:38:58.015763] [INFO ] [REMOTE ] NMR: Fetching primary data for 2024-12. [2025-09-17T20:38:58.146174] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T20:38:58.815856] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-03. [2025-09-17T20:38:59.484771] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T20:38:59.575068] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T20:38:59.615737] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-04. [2025-09-17T20:39:00.415848] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-08. [2025-09-17T20:39:00.936156] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T20:39:01.215791] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-05. [2025-09-17T20:39:01.558253] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T20:39:01.890611] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T20:39:02.015810] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-06. [2025-09-17T20:39:02.815832] [INFO ] [REMOTE ] NMCO: Fetching primary data for 2025-09. [2025-09-17T20:39:03.036243] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T20:39:03.566309] [INFO ] [REMOTE ] NMCO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T20:39:03.569521] [INFO ] [REMOTE ] NMCO: Full fetch complete (24590 records). [2025-09-17T20:39:03.569722] [DEBUG] [VALIDATOR ] NMCO: Validating primary data. [2025-09-17T20:39:03.625485] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-07. [2025-09-17T20:39:03.967828] [DEBUG] [VALIDATOR ] NMCO: All expected trading days are present. [2025-09-17T20:39:03.967933] [DEBUG] [VALIDATOR ] NMCO: Primary data validation passed. [2025-09-17T20:39:03.968703] [INFO ] [MAIN ] NMCO: Fetched primary data is valid. [2025-09-17T20:39:03.968768] [DEBUG] [LOCAL ] NMCO: Saving primary data. [2025-09-17T20:39:03.970263] [DEBUG] [LOCAL ] NMCO: Trimmed 24590 records to 16453 (keeping 200 days of data) [2025-09-17T20:39:04.083406] [DEBUG] [LOCAL ] NMCO: Primary data saved (16453 records). [2025-09-17T20:39:04.083581] [INFO ] [MAIN ] NMCO: Full history saved. [2025-09-17T20:39:04.083722] [INFO ] [MAIN ] Update Progress: 1499/2371 symbols completed. NMCO took 42.3s. Estimated remaining: 2h 7m 25s. Rate: 6.8 symbols/min [2025-09-17T20:39:04.272963] [INFO ] [MAIN ] NMT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:39:04.278822] [DEBUG] [LOCAL ] NMT: Loaded 2822 existing records from primary storage. [2025-09-17T20:39:04.278939] [INFO ] [MAIN ] NMT: Loaded 2822 existing records. [2025-09-17T20:39:04.424623] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-01. [2025-09-17T20:39:04.465476] [WARN ] [MAIN ] NMT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:39:04.465873] [INFO ] [MAIN ] NMT: Wiping existing primary data before full refresh. [2025-09-17T20:39:04.465922] [INFO ] [LOCAL ] NMT: Starting deletion of primary data. [2025-09-17T20:39:04.466484] [DEBUG] [LOCAL ] NMT: Deleted primary data file. [2025-09-17T20:39:04.466536] [INFO ] [MAIN ] NMT: Starting full primary refresh. [2025-09-17T20:39:04.833020] [INFO ] [REMOTE ] NMT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:39:04.843286] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T20:39:05.215805] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-11. [2025-09-17T20:39:05.997066] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T20:39:06.015734] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-02. [2025-09-17T20:39:06.080410] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T20:39:06.815823] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-11. [2025-09-17T20:39:07.424143] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T20:39:07.482856] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T20:39:07.615812] [INFO ] [REMOTE ] NMS: Fetching primary data for 2024-12. [2025-09-17T20:39:08.038148] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2024-12 (0.42 seconds). [2025-09-17T20:39:08.415813] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-01. [2025-09-17T20:39:08.911921] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-01 (0.50 seconds). [2025-09-17T20:39:09.215838] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-08. [2025-09-17T20:39:09.926491] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T20:39:10.015828] [INFO ] [REMOTE ] NMM: Fetching primary data for 2025-09. [2025-09-17T20:39:10.815715] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-02. [2025-09-17T20:39:10.881304] [INFO ] [REMOTE ] NMM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T20:39:10.883791] [INFO ] [REMOTE ] NMM: Full fetch complete (22518 records). [2025-09-17T20:39:10.883883] [DEBUG] [VALIDATOR ] NMM: Validating primary data. [2025-09-17T20:39:11.267877] [DEBUG] [VALIDATOR ] NMM: All expected trading days are present. [2025-09-17T20:39:11.267978] [DEBUG] [VALIDATOR ] NMM: Primary data validation passed. [2025-09-17T20:39:11.268711] [INFO ] [MAIN ] NMM: Fetched primary data is valid. [2025-09-17T20:39:11.268756] [DEBUG] [LOCAL ] NMM: Saving primary data. [2025-09-17T20:39:11.270088] [DEBUG] [LOCAL ] NMM: Trimmed 22518 records to 14353 (keeping 200 days of data) [2025-09-17T20:39:11.366671] [DEBUG] [LOCAL ] NMM: Primary data saved (14353 records). [2025-09-17T20:39:11.366870] [INFO ] [MAIN ] NMM: Full history saved. [2025-09-17T20:39:11.366974] [INFO ] [MAIN ] Update Progress: 1500/2371 symbols completed. NMM took 32.3s. Estimated remaining: 2h 7m 15s. Rate: 6.8 symbols/min [2025-09-17T20:39:11.480033] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T20:39:11.558740] [INFO ] [MAIN ] NMZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:39:11.589131] [DEBUG] [LOCAL ] NMZ: Loaded 21401 existing records from primary storage. [2025-09-17T20:39:11.589436] [INFO ] [MAIN ] NMZ: Loaded 21401 existing records. [2025-09-17T20:39:11.620984] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-03. [2025-09-17T20:39:11.785348] [WARN ] [MAIN ] NMZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:39:11.785786] [INFO ] [MAIN ] NMZ: Wiping existing primary data before full refresh. [2025-09-17T20:39:11.785864] [INFO ] [LOCAL ] NMZ: Starting deletion of primary data. [2025-09-17T20:39:11.786686] [DEBUG] [LOCAL ] NMZ: Deleted primary data file. [2025-09-17T20:39:11.786741] [INFO ] [MAIN ] NMZ: Starting full primary refresh. [2025-09-17T20:39:12.159743] [INFO ] [REMOTE ] NMZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:39:12.415808] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-03. [2025-09-17T20:39:13.114044] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T20:39:13.139430] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T20:39:13.215801] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-04. [2025-09-17T20:39:14.015816] [INFO ] [REMOTE ] NMT: Fetching primary data for 2024-12. [2025-09-17T20:39:14.692764] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T20:39:14.752396] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T20:39:14.815798] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-01. [2025-09-17T20:39:15.347344] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-01 (0.53 seconds). [2025-09-17T20:39:15.615794] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-05. [2025-09-17T20:39:16.415834] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-02. [2025-09-17T20:39:17.020391] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T20:39:17.209336] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T20:39:17.216583] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-04. [2025-09-17T20:39:17.781118] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T20:39:18.015865] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-03. [2025-09-17T20:39:18.586133] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T20:39:18.815855] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-04. [2025-09-17T20:39:19.438624] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T20:39:19.615846] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-06. [2025-09-17T20:39:20.415856] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-05. [2025-09-17T20:39:20.742175] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T20:39:20.880590] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T20:39:21.215827] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-05. [2025-09-17T20:39:21.962026] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T20:39:22.015827] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-07. [2025-09-17T20:39:22.815818] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-06. [2025-09-17T20:39:23.342204] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T20:39:23.506008] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T20:39:23.615737] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-08. [2025-09-17T20:39:24.415797] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-06. [2025-09-17T20:39:25.122458] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T20:39:25.124396] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T20:39:25.215803] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-11. [2025-09-17T20:39:26.015809] [INFO ] [REMOTE ] NMR: Fetching primary data for 2025-09. [2025-09-17T20:39:26.728269] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T20:39:26.815818] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2024-12. [2025-09-17T20:39:27.302379] [INFO ] [REMOTE ] NMR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T20:39:27.307216] [INFO ] [REMOTE ] NMR: Full fetch complete (50090 records). [2025-09-17T20:39:27.307337] [DEBUG] [VALIDATOR ] NMR: Validating primary data. [2025-09-17T20:39:27.621016] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-07. [2025-09-17T20:39:27.738011] [DEBUG] [VALIDATOR ] NMR: All expected trading days are present. [2025-09-17T20:39:27.738139] [DEBUG] [VALIDATOR ] NMR: Primary data validation passed. [2025-09-17T20:39:27.739296] [INFO ] [MAIN ] NMR: Fetched primary data is valid. [2025-09-17T20:39:27.739351] [DEBUG] [LOCAL ] NMR: Saving primary data. [2025-09-17T20:39:27.741085] [DEBUG] [LOCAL ] NMR: Trimmed 50090 records to 35265 (keeping 200 days of data) [2025-09-17T20:39:27.942035] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T20:39:27.996185] [DEBUG] [LOCAL ] NMR: Primary data saved (35265 records). [2025-09-17T20:39:27.996414] [INFO ] [MAIN ] NMR: Full history saved. [2025-09-17T20:39:27.996549] [INFO ] [MAIN ] Update Progress: 1501/2371 symbols completed. NMR took 36.9s. Estimated remaining: 2h 7m 11s. Rate: 6.8 symbols/min [2025-09-17T20:39:28.169909] [INFO ] [MAIN ] NNI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:39:28.183217] [DEBUG] [LOCAL ] NNI: Loaded 9793 existing records from primary storage. [2025-09-17T20:39:28.183382] [INFO ] [MAIN ] NNI: Loaded 9793 existing records. [2025-09-17T20:39:28.289054] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T20:39:28.377039] [WARN ] [MAIN ] NNI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:39:28.377363] [INFO ] [MAIN ] NNI: Wiping existing primary data before full refresh. [2025-09-17T20:39:28.377416] [INFO ] [LOCAL ] NNI: Starting deletion of primary data. [2025-09-17T20:39:28.377953] [DEBUG] [LOCAL ] NNI: Deleted primary data file. [2025-09-17T20:39:28.378007] [INFO ] [MAIN ] NNI: Starting full primary refresh. [2025-09-17T20:39:28.421039] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-08. [2025-09-17T20:39:28.770684] [INFO ] [REMOTE ] NNI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:39:28.890213] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T20:39:29.215782] [INFO ] [REMOTE ] NMS: Fetching primary data for 2025-09. [2025-09-17T20:39:29.734350] [INFO ] [REMOTE ] NMS: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T20:39:29.735482] [INFO ] [REMOTE ] NMS: Full fetch complete (4025 records). [2025-09-17T20:39:29.735550] [DEBUG] [VALIDATOR ] NMS: Validating primary data. [2025-09-17T20:39:30.020916] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-01. [2025-09-17T20:39:30.094300] [DEBUG] [VALIDATOR ] NMS: All expected trading days are present. [2025-09-17T20:39:30.094391] [DEBUG] [VALIDATOR ] NMS: Primary data validation passed. [2025-09-17T20:39:30.094536] [INFO ] [MAIN ] NMS: Fetched primary data is valid. [2025-09-17T20:39:30.094575] [DEBUG] [LOCAL ] NMS: Saving primary data. [2025-09-17T20:39:30.094955] [DEBUG] [LOCAL ] NMS: Trimmed 4025 records to 2878 (keeping 200 days of data) [2025-09-17T20:39:30.115221] [DEBUG] [LOCAL ] NMS: Primary data saved (2878 records). [2025-09-17T20:39:30.115383] [INFO ] [MAIN ] NMS: Full history saved. [2025-09-17T20:39:30.115497] [INFO ] [MAIN ] Update Progress: 1502/2371 symbols completed. NMS took 33.4s. Estimated remaining: 2h 6m 59s. Rate: 6.8 symbols/min [2025-09-17T20:39:30.289724] [INFO ] [MAIN ] NNN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:39:30.339563] [DEBUG] [LOCAL ] NNN: Loaded 48494 existing records from primary storage. [2025-09-17T20:39:30.339782] [INFO ] [MAIN ] NNN: Loaded 48494 existing records. [2025-09-17T20:39:30.517294] [WARN ] [MAIN ] NNN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:39:30.517573] [INFO ] [MAIN ] NNN: Wiping existing primary data before full refresh. [2025-09-17T20:39:30.517617] [INFO ] [LOCAL ] NNN: Starting deletion of primary data. [2025-09-17T20:39:30.518732] [DEBUG] [LOCAL ] NNN: Deleted primary data file. [2025-09-17T20:39:30.518781] [INFO ] [MAIN ] NNN: Starting full primary refresh. [2025-09-17T20:39:30.821015] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-11. [2025-09-17T20:39:30.880897] [INFO ] [REMOTE ] NNN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:39:31.262821] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T20:39:31.615766] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-02. [2025-09-17T20:39:31.709900] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T20:39:32.415700] [INFO ] [REMOTE ] NNI: Fetching primary data for 2024-12. [2025-09-17T20:39:32.809549] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T20:39:33.126984] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T20:39:33.215781] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-03. [2025-09-17T20:39:33.907165] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T20:39:34.015761] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-04. [2025-09-17T20:39:34.815838] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-11. [2025-09-17T20:39:35.240801] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T20:39:35.615752] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-07. [2025-09-17T20:39:36.204336] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T20:39:36.415762] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-01. [2025-09-17T20:39:36.566126] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T20:39:36.871888] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T20:39:37.216013] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-08. [2025-09-17T20:39:37.795456] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T20:39:38.015854] [INFO ] [REMOTE ] NNN: Fetching primary data for 2024-12. [2025-09-17T20:39:38.815835] [INFO ] [REMOTE ] NMT: Fetching primary data for 2025-09. [2025-09-17T20:39:39.430625] [INFO ] [REMOTE ] NMT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T20:39:39.431863] [INFO ] [REMOTE ] NMT: Full fetch complete (4333 records). [2025-09-17T20:39:39.431943] [DEBUG] [VALIDATOR ] NMT: Validating primary data. [2025-09-17T20:39:39.616027] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-05. [2025-09-17T20:39:39.830496] [DEBUG] [VALIDATOR ] NMT: All expected trading days are present. [2025-09-17T20:39:39.830597] [DEBUG] [VALIDATOR ] NMT: Primary data validation passed. [2025-09-17T20:39:39.830863] [INFO ] [MAIN ] NMT: Fetched primary data is valid. [2025-09-17T20:39:39.830921] [DEBUG] [LOCAL ] NMT: Saving primary data. [2025-09-17T20:39:39.831407] [DEBUG] [LOCAL ] NMT: Trimmed 4333 records to 2826 (keeping 200 days of data) [2025-09-17T20:39:39.850214] [DEBUG] [LOCAL ] NMT: Primary data saved (2826 records). [2025-09-17T20:39:39.850489] [INFO ] [MAIN ] NMT: Full history saved. [2025-09-17T20:39:39.850587] [INFO ] [MAIN ] Update Progress: 1503/2371 symbols completed. NMT took 35.8s. Estimated remaining: 2h 6m 50s. Rate: 6.8 symbols/min [2025-09-17T20:39:40.022387] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T20:39:40.085287] [INFO ] [MAIN ] NNY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:39:40.094243] [DEBUG] [LOCAL ] NNY: Loaded 5701 existing records from primary storage. [2025-09-17T20:39:40.094399] [INFO ] [MAIN ] NNY: Loaded 5701 existing records. [2025-09-17T20:39:40.274350] [WARN ] [MAIN ] NNY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:39:40.274658] [INFO ] [MAIN ] NNY: Wiping existing primary data before full refresh. [2025-09-17T20:39:40.274706] [INFO ] [LOCAL ] NNY: Starting deletion of primary data. [2025-09-17T20:39:40.275032] [DEBUG] [LOCAL ] NNY: Deleted primary data file. [2025-09-17T20:39:40.275102] [INFO ] [MAIN ] NNY: Starting full primary refresh. [2025-09-17T20:39:40.421141] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-01. [2025-09-17T20:39:40.640225] [INFO ] [REMOTE ] NNY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:39:40.767353] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T20:39:41.215814] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-11. [2025-09-17T20:39:41.924920] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T20:39:42.015810] [INFO ] [REMOTE ] NNY: Fetching primary data for 2024-12. [2025-09-17T20:39:42.206849] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T20:39:42.730325] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T20:39:42.815831] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-01. [2025-09-17T20:39:43.227312] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-17T20:39:43.615797] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-02. [2025-09-17T20:39:44.317274] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T20:39:44.415829] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-06. [2025-09-17T20:39:45.215767] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-03. [2025-09-17T20:39:45.362390] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T20:39:45.875705] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T20:39:46.015782] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-04. [2025-09-17T20:39:46.803293] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T20:39:46.815738] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-05. [2025-09-17T20:39:47.539722] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T20:39:47.615776] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-07. [2025-09-17T20:39:48.415894] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-06. [2025-09-17T20:39:48.819223] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T20:39:49.130791] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T20:39:49.215745] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-07. [2025-09-17T20:39:49.725575] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T20:39:50.015789] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-02. [2025-09-17T20:39:50.796770] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T20:39:50.815828] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-08. [2025-09-17T20:39:51.507426] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T20:39:51.615815] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-08. [2025-09-17T20:39:52.415812] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-02. [2025-09-17T20:39:52.733081] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T20:39:53.215781] [INFO ] [REMOTE ] NMZ: Fetching primary data for 2025-09. [2025-09-17T20:39:54.015767] [INFO ] [REMOTE ] NNY: Fetching primary data for 2025-09. [2025-09-17T20:39:54.234554] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T20:39:54.313137] [INFO ] [REMOTE ] NMZ: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T20:39:54.316576] [INFO ] [REMOTE ] NMZ: Full fetch complete (32080 records). [2025-09-17T20:39:54.316674] [DEBUG] [VALIDATOR ] NMZ: Validating primary data. [2025-09-17T20:39:54.629897] [INFO ] [REMOTE ] NNY: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T20:39:54.641514] [INFO ] [REMOTE ] NNY: Full fetch complete (8987 records). [2025-09-17T20:39:54.662583] [DEBUG] [VALIDATOR ] NNY: Validating primary data. [2025-09-17T20:39:54.821009] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-03. [2025-09-17T20:39:54.895043] [DEBUG] [VALIDATOR ] NMZ: All expected trading days are present. [2025-09-17T20:39:54.937104] [DEBUG] [VALIDATOR ] NMZ: Primary data validation passed. [2025-09-17T20:39:54.956458] [INFO ] [MAIN ] NMZ: Fetched primary data is valid. [2025-09-17T20:39:54.994819] [DEBUG] [LOCAL ] NMZ: Saving primary data. [2025-09-17T20:39:55.088180] [DEBUG] [LOCAL ] NMZ: Trimmed 32080 records to 21499 (keeping 200 days of data) [2025-09-17T20:39:55.480136] [DEBUG] [VALIDATOR ] NNY: All expected trading days are present. [2025-09-17T20:39:55.481770] [DEBUG] [VALIDATOR ] NNY: Primary data validation passed. [2025-09-17T20:39:55.482788] [INFO ] [MAIN ] NNY: Fetched primary data is valid. [2025-09-17T20:39:55.483613] [DEBUG] [LOCAL ] NNY: Saving primary data. [2025-09-17T20:39:55.491799] [DEBUG] [LOCAL ] NNY: Trimmed 8987 records to 5683 (keeping 200 days of data) [2025-09-17T20:39:55.570045] [DEBUG] [LOCAL ] NNY: Primary data saved (5683 records). [2025-09-17T20:39:55.573251] [INFO ] [MAIN ] NNY: Full history saved. [2025-09-17T20:39:55.573154] [DEBUG] [LOCAL ] NMZ: Primary data saved (21499 records). [2025-09-17T20:39:55.573457] [INFO ] [MAIN ] Update Progress: 1504/2371 symbols completed. NNY took 15.7s. Estimated remaining: 2h 6m 46s. Rate: 6.8 symbols/min [2025-09-17T20:39:55.573579] [INFO ] [MAIN ] NMZ: Full history saved. [2025-09-17T20:39:55.574027] [INFO ] [MAIN ] Update Progress: 1505/2371 symbols completed. NMZ took 44.2s. Estimated remaining: 2h 6m 32s. Rate: 6.8 symbols/min [2025-09-17T20:39:55.621493] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-03. [2025-09-17T20:39:56.025629] [INFO ] [MAIN ] NOA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:39:56.029287] [INFO ] [MAIN ] NOAH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:39:56.031178] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T20:39:56.054489] [DEBUG] [LOCAL ] NOA: Loaded 16566 existing records from primary storage. [2025-09-17T20:39:56.054675] [INFO ] [MAIN ] NOA: Loaded 16566 existing records. [2025-09-17T20:39:56.162434] [DEBUG] [LOCAL ] NOAH: Loaded 20019 existing records from primary storage. [2025-09-17T20:39:56.168069] [INFO ] [MAIN ] NOAH: Loaded 20019 existing records. [2025-09-17T20:39:56.395463] [WARN ] [MAIN ] NOA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:39:56.416248] [INFO ] [MAIN ] NOA: Wiping existing primary data before full refresh. [2025-09-17T20:39:56.416340] [INFO ] [LOCAL ] NOA: Starting deletion of primary data. [2025-09-17T20:39:56.416139] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-04. [2025-09-17T20:39:56.431586] [DEBUG] [LOCAL ] NOA: Deleted primary data file. [2025-09-17T20:39:56.436740] [INFO ] [MAIN ] NOA: Starting full primary refresh. [2025-09-17T20:39:56.513804] [WARN ] [MAIN ] NOAH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:39:56.572124] [INFO ] [MAIN ] NOAH: Wiping existing primary data before full refresh. [2025-09-17T20:39:56.572256] [INFO ] [LOCAL ] NOAH: Starting deletion of primary data. [2025-09-17T20:39:56.588773] [DEBUG] [LOCAL ] NOAH: Deleted primary data file. [2025-09-17T20:39:56.617944] [INFO ] [MAIN ] NOAH: Starting full primary refresh. [2025-09-17T20:39:57.050613] [INFO ] [REMOTE ] NOA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:39:57.216296] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-11. [2025-09-17T20:39:57.216217] [INFO ] [REMOTE ] NOAH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:39:57.437263] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T20:39:57.636629] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T20:39:57.868221] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T20:39:58.015764] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-04. [2025-09-17T20:39:58.815783] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-05. [2025-09-17T20:39:59.424293] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T20:39:59.615784] [INFO ] [REMOTE ] NOA: Fetching primary data for 2024-12. [2025-09-17T20:39:59.872865] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T20:40:00.415777] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-05. [2025-09-17T20:40:00.468831] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T20:40:01.215786] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-01. [2025-09-17T20:40:02.015817] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-11. [2025-09-17T20:40:02.221526] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T20:40:02.601896] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T20:40:02.815749] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-02. [2025-09-17T20:40:02.928524] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T20:40:03.615834] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-06. [2025-09-17T20:40:03.770873] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T20:40:04.415815] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-03. [2025-09-17T20:40:04.608367] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T20:40:05.215818] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2024-12. [2025-09-17T20:40:05.318832] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T20:40:06.015789] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-07. [2025-09-17T20:40:06.314130] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T20:40:06.815763] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-04. [2025-09-17T20:40:06.860355] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T20:40:07.615816] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-01. [2025-09-17T20:40:07.965836] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T20:40:08.415810] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-08. [2025-09-17T20:40:08.445707] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T20:40:09.215779] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-02. [2025-09-17T20:40:09.321855] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T20:40:10.015787] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-06. [2025-09-17T20:40:10.341835] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T20:40:10.815783] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-03. [2025-09-17T20:40:11.460070] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T20:40:11.615771] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-05. [2025-09-17T20:40:11.672719] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-03 (0.86 seconds). [2025-09-17T20:40:12.415829] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-04. [2025-09-17T20:40:12.693632] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T20:40:13.215809] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-06. [2025-09-17T20:40:13.362594] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T20:40:14.008947] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T20:40:14.015671] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-05. [2025-09-17T20:40:14.815780] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-07. [2025-09-17T20:40:15.026063] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T20:40:15.558834] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T20:40:15.615734] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-08. [2025-09-17T20:40:16.415810] [INFO ] [REMOTE ] NNI: Fetching primary data for 2025-09. [2025-09-17T20:40:16.666778] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T20:40:17.215817] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-07. [2025-09-17T20:40:17.328131] [INFO ] [REMOTE ] NNI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T20:40:17.330228] [INFO ] [REMOTE ] NNI: Full fetch complete (12362 records). [2025-09-17T20:40:17.330307] [DEBUG] [VALIDATOR ] NNI: Validating primary data. [2025-09-17T20:40:17.705432] [DEBUG] [VALIDATOR ] NNI: All expected trading days are present. [2025-09-17T20:40:17.705545] [DEBUG] [VALIDATOR ] NNI: Primary data validation passed. [2025-09-17T20:40:17.705927] [INFO ] [MAIN ] NNI: Fetched primary data is valid. [2025-09-17T20:40:17.705979] [DEBUG] [LOCAL ] NNI: Saving primary data. [2025-09-17T20:40:17.706479] [DEBUG] [LOCAL ] NNI: Trimmed 12362 records to 9783 (keeping 200 days of data) [2025-09-17T20:40:17.768628] [DEBUG] [LOCAL ] NNI: Primary data saved (9783 records). [2025-09-17T20:40:17.768812] [INFO ] [MAIN ] NNI: Full history saved. [2025-09-17T20:40:17.768927] [INFO ] [MAIN ] Update Progress: 1506/2371 symbols completed. NNI took 49.8s. Estimated remaining: 2h 6m 31s. Rate: 6.8 symbols/min [2025-09-17T20:40:17.944389] [INFO ] [MAIN ] NOC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:40:17.987334] [DEBUG] [LOCAL ] NOC: Loaded 42980 existing records from primary storage. [2025-09-17T20:40:17.987491] [INFO ] [MAIN ] NOC: Loaded 42980 existing records. [2025-09-17T20:40:18.020840] [INFO ] [REMOTE ] NOA: Fetching primary data for 2025-09. [2025-09-17T20:40:18.172400] [WARN ] [MAIN ] NOC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:40:18.172874] [INFO ] [MAIN ] NOC: Wiping existing primary data before full refresh. [2025-09-17T20:40:18.172925] [INFO ] [LOCAL ] NOC: Starting deletion of primary data. [2025-09-17T20:40:18.173989] [DEBUG] [LOCAL ] NOC: Deleted primary data file. [2025-09-17T20:40:18.174045] [INFO ] [MAIN ] NOC: Starting full primary refresh. [2025-09-17T20:40:18.529577] [INFO ] [REMOTE ] NOC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:40:18.697072] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T20:40:18.815819] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-11. [2025-09-17T20:40:18.949852] [INFO ] [REMOTE ] NOA: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T20:40:18.954235] [INFO ] [REMOTE ] NOA: Full fetch complete (21666 records). [2025-09-17T20:40:18.954478] [DEBUG] [VALIDATOR ] NOA: Validating primary data. [2025-09-17T20:40:19.336582] [DEBUG] [VALIDATOR ] NOA: All expected trading days are present. [2025-09-17T20:40:19.336693] [DEBUG] [VALIDATOR ] NOA: Primary data validation passed. [2025-09-17T20:40:19.337324] [INFO ] [MAIN ] NOA: Fetched primary data is valid. [2025-09-17T20:40:19.337365] [DEBUG] [LOCAL ] NOA: Saving primary data. [2025-09-17T20:40:19.338446] [DEBUG] [LOCAL ] NOA: Trimmed 21666 records to 16516 (keeping 200 days of data) [2025-09-17T20:40:19.441159] [DEBUG] [LOCAL ] NOA: Primary data saved (16516 records). [2025-09-17T20:40:19.441316] [INFO ] [MAIN ] NOA: Full history saved. [2025-09-17T20:40:19.441417] [INFO ] [MAIN ] Update Progress: 1507/2371 symbols completed. NOA took 23.9s. Estimated remaining: 2h 6m 18s. Rate: 6.8 symbols/min [2025-09-17T20:40:19.611024] [INFO ] [MAIN ] NOG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:40:19.615885] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-06. [2025-09-17T20:40:19.666671] [DEBUG] [LOCAL ] NOG: Loaded 51174 existing records from primary storage. [2025-09-17T20:40:19.666834] [INFO ] [MAIN ] NOG: Loaded 51174 existing records. [2025-09-17T20:40:19.847358] [WARN ] [MAIN ] NOG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:40:19.847605] [INFO ] [MAIN ] NOG: Wiping existing primary data before full refresh. [2025-09-17T20:40:19.847674] [INFO ] [LOCAL ] NOG: Starting deletion of primary data. [2025-09-17T20:40:19.848699] [DEBUG] [LOCAL ] NOG: Deleted primary data file. [2025-09-17T20:40:19.848748] [INFO ] [MAIN ] NOG: Starting full primary refresh. [2025-09-17T20:40:20.211867] [INFO ] [REMOTE ] NOG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:40:20.415781] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-11. [2025-09-17T20:40:20.521179] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T20:40:20.806912] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T20:40:21.215832] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-07. [2025-09-17T20:40:21.870349] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T20:40:22.015393] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-07 (0.80 seconds). [2025-09-17T20:40:22.019243] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-08. [2025-09-17T20:40:22.815795] [INFO ] [REMOTE ] NOG: Fetching primary data for 2024-12. [2025-09-17T20:40:23.615779] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-08. [2025-09-17T20:40:23.674803] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T20:40:24.348519] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T20:40:24.415806] [INFO ] [REMOTE ] NNN: Fetching primary data for 2025-09. [2025-09-17T20:40:24.680472] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T20:40:25.215780] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-01. [2025-09-17T20:40:25.824756] [INFO ] [REMOTE ] NNN: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T20:40:25.832282] [INFO ] [REMOTE ] NNN: Full fetch complete (70019 records). [2025-09-17T20:40:25.832474] [DEBUG] [VALIDATOR ] NNN: Validating primary data. [2025-09-17T20:40:26.027272] [INFO ] [REMOTE ] NOAH: Fetching primary data for 2025-09. [2025-09-17T20:40:26.238003] [DEBUG] [VALIDATOR ] NNN: All expected trading days are present. [2025-09-17T20:40:26.238099] [DEBUG] [VALIDATOR ] NNN: Primary data validation passed. [2025-09-17T20:40:26.239234] [INFO ] [MAIN ] NNN: Fetched primary data is valid. [2025-09-17T20:40:26.239296] [DEBUG] [LOCAL ] NNN: Saving primary data. [2025-09-17T20:40:26.240867] [DEBUG] [LOCAL ] NNN: Trimmed 70019 records to 48485 (keeping 200 days of data) [2025-09-17T20:40:26.541916] [DEBUG] [LOCAL ] NNN: Primary data saved (48485 records). [2025-09-17T20:40:26.542086] [INFO ] [MAIN ] NNN: Full history saved. [2025-09-17T20:40:26.542194] [INFO ] [MAIN ] Update Progress: 1508/2371 symbols completed. NNN took 56.4s. Estimated remaining: 2h 6m 8s. Rate: 6.8 symbols/min [2025-09-17T20:40:26.712755] [INFO ] [MAIN ] NOK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:40:26.761632] [DEBUG] [LOCAL ] NOK: Loaded 53620 existing records from primary storage. [2025-09-17T20:40:26.761809] [INFO ] [MAIN ] NOK: Loaded 53620 existing records. [2025-09-17T20:40:26.824737] [INFO ] [REMOTE ] NOC: Fetching primary data for 2024-12. [2025-09-17T20:40:26.943687] [WARN ] [MAIN ] NOK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:40:26.944094] [INFO ] [MAIN ] NOK: Wiping existing primary data before full refresh. [2025-09-17T20:40:26.944161] [INFO ] [LOCAL ] NOK: Starting deletion of primary data. [2025-09-17T20:40:26.945340] [DEBUG] [LOCAL ] NOK: Deleted primary data file. [2025-09-17T20:40:26.945404] [INFO ] [MAIN ] NOK: Starting full primary refresh. [2025-09-17T20:40:27.301283] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-17T20:40:27.370009] [INFO ] [REMOTE ] NOK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:40:27.380688] [INFO ] [REMOTE ] NOAH: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T20:40:27.384403] [INFO ] [REMOTE ] NOAH: Full fetch complete (28833 records). [2025-09-17T20:40:27.384485] [DEBUG] [VALIDATOR ] NOAH: Validating primary data. [2025-09-17T20:40:27.623692] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-11. [2025-09-17T20:40:27.760305] [DEBUG] [VALIDATOR ] NOAH: All expected trading days are present. [2025-09-17T20:40:27.760391] [DEBUG] [VALIDATOR ] NOAH: Primary data validation passed. [2025-09-17T20:40:27.761075] [INFO ] [MAIN ] NOAH: Fetched primary data is valid. [2025-09-17T20:40:27.761120] [DEBUG] [LOCAL ] NOAH: Saving primary data. [2025-09-17T20:40:27.761866] [DEBUG] [LOCAL ] NOAH: Trimmed 28833 records to 20033 (keeping 200 days of data) [2025-09-17T20:40:27.889219] [DEBUG] [LOCAL ] NOAH: Primary data saved (20033 records). [2025-09-17T20:40:27.889354] [INFO ] [MAIN ] NOAH: Full history saved. [2025-09-17T20:40:27.889436] [INFO ] [MAIN ] Update Progress: 1509/2371 symbols completed. NOAH took 32.3s. Estimated remaining: 2h 5m 55s. Rate: 6.8 symbols/min [2025-09-17T20:40:28.060620] [INFO ] [MAIN ] NOM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:40:28.060833] [DEBUG] [LOCAL ] NOM: No existing data file found in primary storage. [2025-09-17T20:40:28.060879] [WARN ] [MAIN ] NOM: No existing data found, performing full refresh instead. [2025-09-17T20:40:28.061012] [INFO ] [MAIN ] NOM: Wiping existing primary data before full refresh. [2025-09-17T20:40:28.061051] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-17T20:40:28.061140] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-17T20:40:28.061174] [INFO ] [MAIN ] NOM: Starting full primary refresh. [2025-09-17T20:40:28.419629] [INFO ] [REMOTE ] NOM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:40:28.419771] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-02. [2025-09-17T20:40:28.535075] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T20:40:29.215795] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-01. [2025-09-17T20:40:29.834987] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-17T20:40:30.015734] [INFO ] [REMOTE ] NOK: Fetching primary data for 2024-12. [2025-09-17T20:40:30.256026] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T20:40:30.667735] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T20:40:30.815740] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-02. [2025-09-17T20:40:31.615776] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-11. [2025-09-17T20:40:32.001601] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T20:40:32.183749] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-17T20:40:32.415763] [INFO ] [REMOTE ] NOM: Fetching primary data for 2024-12. [2025-09-17T20:40:32.807498] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T20:40:32.981022] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T20:40:33.215777] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-01. [2025-09-17T20:40:33.620989] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-01 (0.41 seconds). [2025-09-17T20:40:34.015788] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-02. [2025-09-17T20:40:34.432368] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T20:40:34.815805] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-03. [2025-09-17T20:40:35.615768] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-03. [2025-09-17T20:40:36.121204] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T20:40:36.415826] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-04. [2025-09-17T20:40:36.707486] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T20:40:36.861688] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T20:40:37.215830] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-04. [2025-09-17T20:40:38.015792] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-03. [2025-09-17T20:40:38.722014] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T20:40:38.815804] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-05. [2025-09-17T20:40:39.325014] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T20:40:39.417529] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T20:40:39.615776] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-04. [2025-09-17T20:40:40.415772] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-05. [2025-09-17T20:40:41.215784] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-06. [2025-09-17T20:40:41.443549] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T20:40:41.651587] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T20:40:41.919399] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T20:40:42.015803] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-05. [2025-09-17T20:40:42.815792] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-06. [2025-09-17T20:40:43.615751] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-01. [2025-09-17T20:40:43.657348] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T20:40:44.415809] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-06. [2025-09-17T20:40:44.724966] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T20:40:45.216243] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-07. [2025-09-17T20:40:45.731728] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T20:40:45.759998] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-17T20:40:45.948701] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T20:40:46.015795] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-02. [2025-09-17T20:40:46.815813] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-07. [2025-09-17T20:40:47.616334] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-07. [2025-09-17T20:40:48.038435] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-02 (2.02 seconds). [2025-09-17T20:40:48.324806] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T20:40:48.415833] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-08. [2025-09-17T20:40:49.022349] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T20:40:49.091424] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T20:40:49.215815] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-08. [2025-09-17T20:40:50.015835] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-08. [2025-09-17T20:40:50.630200] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T20:40:50.815795] [INFO ] [REMOTE ] NOM: Fetching primary data for 2025-09. [2025-09-17T20:40:51.338943] [INFO ] [REMOTE ] NOM: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T20:40:51.340099] [INFO ] [REMOTE ] NOM: Full fetch complete (1727 records). [2025-09-17T20:40:51.340182] [DEBUG] [VALIDATOR ] NOM: Validating primary data. [2025-09-17T20:40:51.533407] [WARN ] [VALIDATOR ] NOM: Validation failed - insufficient historical data. Have 188 unique days, need 200 days [2025-09-17T20:40:51.533582] [FATAL] [MAIN ] NOM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:40:51.533629] [WARN ] [MAIN ] NOM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:40:51.533691] [INFO ] [LOCAL ] NOM: Starting deletion of primary data. [2025-09-17T20:40:51.533747] [DEBUG] [LOCAL ] NOM: No primary data file found to delete. [2025-09-17T20:40:51.533806] [INFO ] [LOCAL ] NOM: Starting deletion of derivative data. [2025-09-17T20:40:51.533858] [DEBUG] [LOCAL ] NOM: No derivative data file found to delete. [2025-09-17T20:40:51.533916] [INFO ] [MAIN ] Update Progress: 1510/2371 symbols completed. NOM took 23.6s. Estimated remaining: 2h 5m 55s. Rate: 6.8 symbols/min [2025-09-17T20:40:51.622827] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-03. [2025-09-17T20:40:51.703879] [INFO ] [MAIN ] NOMD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:40:51.771932] [DEBUG] [LOCAL ] NOMD: Loaded 41377 existing records from primary storage. [2025-09-17T20:40:51.773594] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T20:40:51.784235] [INFO ] [MAIN ] NOMD: Loaded 41377 existing records. [2025-09-17T20:40:51.974918] [WARN ] [MAIN ] NOMD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:40:51.975215] [INFO ] [MAIN ] NOMD: Wiping existing primary data before full refresh. [2025-09-17T20:40:51.975297] [INFO ] [LOCAL ] NOMD: Starting deletion of primary data. [2025-09-17T20:40:51.976223] [DEBUG] [LOCAL ] NOMD: Deleted primary data file. [2025-09-17T20:40:51.976300] [INFO ] [MAIN ] NOMD: Starting full primary refresh. [2025-09-17T20:40:52.352187] [INFO ] [REMOTE ] NOMD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:40:52.415763] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-11. [2025-09-17T20:40:53.215856] [INFO ] [REMOTE ] NOG: Fetching primary data for 2025-09. [2025-09-17T20:40:53.624860] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T20:40:53.955424] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T20:40:54.015720] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2024-12. [2025-09-17T20:40:54.734274] [INFO ] [REMOTE ] NOG: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T20:40:54.740756] [INFO ] [REMOTE ] NOG: Full fetch complete (73341 records). [2025-09-17T20:40:54.740867] [DEBUG] [VALIDATOR ] NOG: Validating primary data. [2025-09-17T20:40:54.820894] [INFO ] [REMOTE ] NOC: Fetching primary data for 2025-09. [2025-09-17T20:40:55.138878] [DEBUG] [VALIDATOR ] NOG: All expected trading days are present. [2025-09-17T20:40:55.138990] [DEBUG] [VALIDATOR ] NOG: Primary data validation passed. [2025-09-17T20:40:55.140208] [INFO ] [MAIN ] NOG: Fetched primary data is valid. [2025-09-17T20:40:55.140265] [DEBUG] [LOCAL ] NOG: Saving primary data. [2025-09-17T20:40:55.141966] [DEBUG] [LOCAL ] NOG: Trimmed 73341 records to 51172 (keeping 200 days of data) [2025-09-17T20:40:55.464787] [DEBUG] [LOCAL ] NOG: Primary data saved (51172 records). [2025-09-17T20:40:55.464964] [INFO ] [MAIN ] NOG: Full history saved. [2025-09-17T20:40:55.465061] [INFO ] [MAIN ] Update Progress: 1511/2371 symbols completed. NOG took 36.0s. Estimated remaining: 2h 5m 43s. Rate: 6.8 symbols/min [2025-09-17T20:40:55.616895] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-04. [2025-09-17T20:40:55.640951] [INFO ] [MAIN ] NOTE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:40:55.667120] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T20:40:55.709483] [DEBUG] [LOCAL ] NOTE: Loaded 43642 existing records from primary storage. [2025-09-17T20:40:55.709683] [INFO ] [MAIN ] NOTE: Loaded 43642 existing records. [2025-09-17T20:40:55.885801] [WARN ] [MAIN ] NOTE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:40:55.886032] [INFO ] [MAIN ] NOTE: Wiping existing primary data before full refresh. [2025-09-17T20:40:55.886076] [INFO ] [LOCAL ] NOTE: Starting deletion of primary data. [2025-09-17T20:40:55.886909] [DEBUG] [LOCAL ] NOTE: Deleted primary data file. [2025-09-17T20:40:55.886960] [INFO ] [MAIN ] NOTE: Starting full primary refresh. [2025-09-17T20:40:56.255462] [INFO ] [REMOTE ] NOC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T20:40:56.258537] [INFO ] [REMOTE ] NOTE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:40:56.264130] [INFO ] [REMOTE ] NOC: Full fetch complete (62090 records). [2025-09-17T20:40:56.264283] [DEBUG] [VALIDATOR ] NOC: Validating primary data. [2025-09-17T20:40:56.431761] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-11. [2025-09-17T20:40:56.674733] [DEBUG] [VALIDATOR ] NOC: All expected trading days are present. [2025-09-17T20:40:56.674848] [DEBUG] [VALIDATOR ] NOC: Primary data validation passed. [2025-09-17T20:40:56.675835] [INFO ] [MAIN ] NOC: Fetched primary data is valid. [2025-09-17T20:40:56.675887] [DEBUG] [LOCAL ] NOC: Saving primary data. [2025-09-17T20:40:56.677392] [DEBUG] [LOCAL ] NOC: Trimmed 62090 records to 42935 (keeping 200 days of data) [2025-09-17T20:40:56.985386] [DEBUG] [LOCAL ] NOC: Primary data saved (42935 records). [2025-09-17T20:40:56.985563] [INFO ] [MAIN ] NOC: Full history saved. [2025-09-17T20:40:56.985706] [INFO ] [MAIN ] Update Progress: 1512/2371 symbols completed. NOC took 39.2s. Estimated remaining: 2h 5m 31s. Rate: 6.8 symbols/min [2025-09-17T20:40:57.172499] [INFO ] [MAIN ] NOV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:40:57.215804] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-01. [2025-09-17T20:40:57.235758] [DEBUG] [LOCAL ] NOV: Loaded 53201 existing records from primary storage. [2025-09-17T20:40:57.235972] [INFO ] [MAIN ] NOV: Loaded 53201 existing records. [2025-09-17T20:40:57.427608] [WARN ] [MAIN ] NOV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:40:57.427901] [INFO ] [MAIN ] NOV: Wiping existing primary data before full refresh. [2025-09-17T20:40:57.427952] [INFO ] [LOCAL ] NOV: Starting deletion of primary data. [2025-09-17T20:40:57.428933] [DEBUG] [LOCAL ] NOV: Deleted primary data file. [2025-09-17T20:40:57.429004] [INFO ] [MAIN ] NOV: Starting full primary refresh. [2025-09-17T20:40:57.796000] [INFO ] [REMOTE ] NOV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:40:57.900555] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-04 (2.28 seconds). [2025-09-17T20:40:58.000362] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T20:40:58.015719] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2024-12. [2025-09-17T20:40:58.588614] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T20:40:58.815797] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-11. [2025-09-17T20:40:59.615774] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-02. [2025-09-17T20:41:00.047807] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T20:41:00.399857] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T20:41:00.415734] [INFO ] [REMOTE ] NOV: Fetching primary data for 2024-12. [2025-09-17T20:41:01.215796] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-01. [2025-09-17T20:41:01.256816] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T20:41:02.015821] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-05. [2025-09-17T20:41:02.387051] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T20:41:02.815811] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-03. [2025-09-17T20:41:03.035158] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T20:41:03.615786] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-02. [2025-09-17T20:41:03.879579] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T20:41:04.113772] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T20:41:04.415795] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-04. [2025-09-17T20:41:05.134635] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T20:41:05.215783] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-06. [2025-09-17T20:41:06.015784] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-01. [2025-09-17T20:41:06.121932] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T20:41:06.815753] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-03. [2025-09-17T20:41:07.038531] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T20:41:07.615785] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-07. [2025-09-17T20:41:07.854390] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T20:41:08.206163] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T20:41:08.415777] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-04. [2025-09-17T20:41:09.215803] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-02. [2025-09-17T20:41:09.744988] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T20:41:10.015776] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-08. [2025-09-17T20:41:10.123703] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T20:41:10.815789] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-05. [2025-09-17T20:41:10.897872] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T20:41:11.615773] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-03. [2025-09-17T20:41:12.137244] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-17T20:41:12.362908] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T20:41:12.415768] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-06. [2025-09-17T20:41:13.215860] [INFO ] [REMOTE ] NOK: Fetching primary data for 2025-09. [2025-09-17T20:41:13.505091] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T20:41:13.836761] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T20:41:14.015826] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-05. [2025-09-17T20:41:14.815823] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-07. [2025-09-17T20:41:14.855041] [INFO ] [REMOTE ] NOK: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T20:41:14.862035] [INFO ] [REMOTE ] NOK: Full fetch complete (77523 records). [2025-09-17T20:41:14.862236] [DEBUG] [VALIDATOR ] NOK: Validating primary data. [2025-09-17T20:41:15.258305] [DEBUG] [VALIDATOR ] NOK: All expected trading days are present. [2025-09-17T20:41:15.258392] [DEBUG] [VALIDATOR ] NOK: Primary data validation passed. [2025-09-17T20:41:15.259441] [INFO ] [MAIN ] NOK: Fetched primary data is valid. [2025-09-17T20:41:15.259518] [DEBUG] [LOCAL ] NOK: Saving primary data. [2025-09-17T20:41:15.261626] [DEBUG] [LOCAL ] NOK: Trimmed 77523 records to 53621 (keeping 200 days of data) [2025-09-17T20:41:15.588955] [DEBUG] [LOCAL ] NOK: Primary data saved (53621 records). [2025-09-17T20:41:15.589129] [INFO ] [MAIN ] NOK: Full history saved. [2025-09-17T20:41:15.589259] [INFO ] [MAIN ] Update Progress: 1513/2371 symbols completed. NOK took 49.0s. Estimated remaining: 2h 5m 27s. Rate: 6.8 symbols/min [2025-09-17T20:41:15.621421] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-04. [2025-09-17T20:41:15.771081] [INFO ] [MAIN ] NOW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:41:15.826286] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T20:41:15.852248] [DEBUG] [LOCAL ] NOW: Loaded 49012 existing records from primary storage. [2025-09-17T20:41:15.852411] [INFO ] [MAIN ] NOW: Loaded 49012 existing records. [2025-09-17T20:41:16.032811] [WARN ] [MAIN ] NOW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:41:16.033066] [INFO ] [MAIN ] NOW: Wiping existing primary data before full refresh. [2025-09-17T20:41:16.033111] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-17T20:41:16.034151] [DEBUG] [LOCAL ] NOW: Deleted primary data file. [2025-09-17T20:41:16.034211] [INFO ] [MAIN ] NOW: Starting full primary refresh. [2025-09-17T20:41:16.403177] [INFO ] [REMOTE ] NOW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:41:16.415730] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-11. [2025-09-17T20:41:16.650682] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T20:41:17.215784] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-08. [2025-09-17T20:41:17.436272] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T20:41:18.015766] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-05. [2025-09-17T20:41:18.408752] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T20:41:18.639861] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T20:41:18.815806] [INFO ] [REMOTE ] NOW: Fetching primary data for 2024-12. [2025-09-17T20:41:19.615800] [INFO ] [REMOTE ] NOTE: Fetching primary data for 2025-09. [2025-09-17T20:41:19.863141] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T20:41:20.415824] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-06. [2025-09-17T20:41:20.781935] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T20:41:21.061380] [INFO ] [REMOTE ] NOTE: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T20:41:21.066498] [INFO ] [REMOTE ] NOTE: Full fetch complete (64871 records). [2025-09-17T20:41:21.066714] [DEBUG] [VALIDATOR ] NOTE: Validating primary data. [2025-09-17T20:41:21.225949] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-06. [2025-09-17T20:41:21.473288] [DEBUG] [VALIDATOR ] NOTE: All expected trading days are present. [2025-09-17T20:41:21.473372] [DEBUG] [VALIDATOR ] NOTE: Primary data validation passed. [2025-09-17T20:41:21.474350] [INFO ] [MAIN ] NOTE: Fetched primary data is valid. [2025-09-17T20:41:21.474397] [DEBUG] [LOCAL ] NOTE: Saving primary data. [2025-09-17T20:41:21.475659] [DEBUG] [LOCAL ] NOTE: Trimmed 64871 records to 43496 (keeping 200 days of data) [2025-09-17T20:41:21.741166] [DEBUG] [LOCAL ] NOTE: Primary data saved (43496 records). [2025-09-17T20:41:21.741309] [INFO ] [MAIN ] NOTE: Full history saved. [2025-09-17T20:41:21.741404] [INFO ] [MAIN ] Update Progress: 1514/2371 symbols completed. NOTE took 26.3s. Estimated remaining: 2h 5m 17s. Rate: 6.8 symbols/min [2025-09-17T20:41:21.918807] [INFO ] [MAIN ] NPB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:41:21.919127] [DEBUG] [LOCAL ] NPB: No existing data file found in primary storage. [2025-09-17T20:41:21.919206] [WARN ] [MAIN ] NPB: No existing data found, performing full refresh instead. [2025-09-17T20:41:21.919593] [INFO ] [MAIN ] NPB: Wiping existing primary data before full refresh. [2025-09-17T20:41:21.919740] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-17T20:41:21.919859] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-17T20:41:21.919914] [INFO ] [MAIN ] NPB: Starting full primary refresh. [2025-09-17T20:41:22.019705] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-01. [2025-09-17T20:41:22.236292] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T20:41:22.327278] [INFO ] [REMOTE ] NPB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:41:22.815788] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-07. [2025-09-17T20:41:22.967535] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T20:41:23.615831] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-11. [2025-09-17T20:41:23.897097] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:41:23.897465] [WARN ] [REMOTE ] NPB: No data returned for month 2024-11 [2025-09-17T20:41:24.209707] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-17T20:41:24.415745] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-07. [2025-09-17T20:41:24.477918] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T20:41:25.215823] [INFO ] [REMOTE ] NPB: Fetching primary data for 2024-12. [2025-09-17T20:41:25.524358] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:41:25.524718] [WARN ] [REMOTE ] NPB: No data returned for month 2024-12 [2025-09-17T20:41:25.770473] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T20:41:26.015822] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-02. [2025-09-17T20:41:26.815801] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-01. [2025-09-17T20:41:27.066428] [DEBUG] [REMOTE ] NPB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:41:27.066790] [WARN ] [REMOTE ] NPB: No data returned for month 2025-01 [2025-09-17T20:41:27.615689] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-08. [2025-09-17T20:41:28.137733] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-02 (2.12 seconds). [2025-09-17T20:41:28.415805] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-03. [2025-09-17T20:41:28.801034] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T20:41:29.215834] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-08. [2025-09-17T20:41:30.015809] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-02. [2025-09-17T20:41:30.350092] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T20:41:30.720753] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T20:41:30.815856] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-03. [2025-09-17T20:41:31.156399] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T20:41:31.615792] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-04. [2025-09-17T20:41:31.989168] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T20:41:32.415787] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-04. [2025-09-17T20:41:33.215833] [INFO ] [REMOTE ] NOMD: Fetching primary data for 2025-09. [2025-09-17T20:41:33.479008] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T20:41:33.993528] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-17T20:41:34.015755] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-05. [2025-09-17T20:41:34.700534] [INFO ] [REMOTE ] NOMD: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T20:41:34.706505] [INFO ] [REMOTE ] NOMD: Full fetch complete (58654 records). [2025-09-17T20:41:34.706612] [DEBUG] [VALIDATOR ] NOMD: Validating primary data. [2025-09-17T20:41:34.815752] [INFO ] [REMOTE ] NOV: Fetching primary data for 2025-09. [2025-09-17T20:41:34.845851] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T20:41:35.144709] [DEBUG] [VALIDATOR ] NOMD: All expected trading days are present. [2025-09-17T20:41:35.144946] [DEBUG] [VALIDATOR ] NOMD: Primary data validation passed. [2025-09-17T20:41:35.145974] [INFO ] [MAIN ] NOMD: Fetched primary data is valid. [2025-09-17T20:41:35.146025] [DEBUG] [LOCAL ] NOMD: Saving primary data. [2025-09-17T20:41:35.147563] [DEBUG] [LOCAL ] NOMD: Trimmed 58654 records to 41492 (keeping 200 days of data) [2025-09-17T20:41:35.421676] [DEBUG] [LOCAL ] NOMD: Primary data saved (41492 records). [2025-09-17T20:41:35.421841] [INFO ] [MAIN ] NOMD: Full history saved. [2025-09-17T20:41:35.423817] [INFO ] [MAIN ] Update Progress: 1515/2371 symbols completed. NOMD took 43.9s. Estimated remaining: 2h 5m 11s. Rate: 6.8 symbols/min [2025-09-17T20:41:35.597430] [INFO ] [MAIN ] NPCT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:41:35.616618] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-06. [2025-09-17T20:41:35.617120] [DEBUG] [LOCAL ] NPCT: Loaded 17213 existing records from primary storage. [2025-09-17T20:41:35.617954] [INFO ] [MAIN ] NPCT: Loaded 17213 existing records. [2025-09-17T20:41:35.803776] [WARN ] [MAIN ] NPCT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:41:35.804067] [INFO ] [MAIN ] NPCT: Wiping existing primary data before full refresh. [2025-09-17T20:41:35.804115] [INFO ] [LOCAL ] NPCT: Starting deletion of primary data. [2025-09-17T20:41:35.804933] [DEBUG] [LOCAL ] NPCT: Deleted primary data file. [2025-09-17T20:41:35.804984] [INFO ] [MAIN ] NPCT: Starting full primary refresh. [2025-09-17T20:41:36.166070] [INFO ] [REMOTE ] NPCT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:41:36.322234] [INFO ] [REMOTE ] NOV: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T20:41:36.330341] [INFO ] [REMOTE ] NOV: Full fetch complete (76799 records). [2025-09-17T20:41:36.330482] [DEBUG] [VALIDATOR ] NOV: Validating primary data. [2025-09-17T20:41:36.424348] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-05. [2025-09-17T20:41:36.721589] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T20:41:36.765691] [DEBUG] [VALIDATOR ] NOV: All expected trading days are present. [2025-09-17T20:41:36.765792] [DEBUG] [VALIDATOR ] NOV: Primary data validation passed. [2025-09-17T20:41:36.766920] [INFO ] [MAIN ] NOV: Fetched primary data is valid. [2025-09-17T20:41:36.766972] [DEBUG] [LOCAL ] NOV: Saving primary data. [2025-09-17T20:41:36.768609] [DEBUG] [LOCAL ] NOV: Trimmed 76799 records to 53200 (keeping 200 days of data) [2025-09-17T20:41:37.132685] [DEBUG] [LOCAL ] NOV: Primary data saved (53200 records). [2025-09-17T20:41:37.132895] [INFO ] [MAIN ] NOV: Full history saved. [2025-09-17T20:41:37.133030] [INFO ] [MAIN ] Update Progress: 1516/2371 symbols completed. NOV took 40.1s. Estimated remaining: 2h 4m 58s. Rate: 6.8 symbols/min [2025-09-17T20:41:37.225316] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-11. [2025-09-17T20:41:37.309908] [INFO ] [MAIN ] NPFD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:41:37.322178] [DEBUG] [LOCAL ] NPFD: Loaded 9755 existing records from primary storage. [2025-09-17T20:41:37.322337] [INFO ] [MAIN ] NPFD: Loaded 9755 existing records. [2025-09-17T20:41:37.507778] [WARN ] [MAIN ] NPFD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:41:37.508071] [INFO ] [MAIN ] NPFD: Wiping existing primary data before full refresh. [2025-09-17T20:41:37.508121] [INFO ] [LOCAL ] NPFD: Starting deletion of primary data. [2025-09-17T20:41:37.508469] [DEBUG] [LOCAL ] NPFD: Deleted primary data file. [2025-09-17T20:41:37.508517] [INFO ] [MAIN ] NPFD: Starting full primary refresh. [2025-09-17T20:41:37.865213] [INFO ] [REMOTE ] NPFD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:41:38.015790] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-11. [2025-09-17T20:41:38.297370] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T20:41:38.647998] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-05 (2.22 seconds). [2025-09-17T20:41:38.815771] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-06. [2025-09-17T20:41:38.835418] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T20:41:39.615799] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-07. [2025-09-17T20:41:40.415855] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2024-12. [2025-09-17T20:41:40.702379] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T20:41:40.747609] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T20:41:41.215877] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2024-12. [2025-09-17T20:41:41.379328] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T20:41:42.015799] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-07. [2025-09-17T20:41:42.181795] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T20:41:42.815807] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-08. [2025-09-17T20:41:43.615779] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-01. [2025-09-17T20:41:43.917203] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T20:41:43.992630] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T20:41:44.415856] [INFO ] [REMOTE ] NPB: Fetching primary data for 2025-09. [2025-09-17T20:41:44.424988] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-01 (0.81 seconds). [2025-09-17T20:41:45.215750] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-02. [2025-09-17T20:41:45.447505] [INFO ] [REMOTE ] NPB: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T20:41:45.450148] [INFO ] [REMOTE ] NPB: Full fetch complete (15544 records). [2025-09-17T20:41:45.450224] [DEBUG] [VALIDATOR ] NPB: Validating primary data. [2025-09-17T20:41:45.631918] [WARN ] [VALIDATOR ] NPB: Validation failed - insufficient historical data. Have 148 unique days, need 200 days [2025-09-17T20:41:45.632263] [FATAL] [MAIN ] NPB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:41:45.632345] [WARN ] [MAIN ] NPB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:41:45.632424] [INFO ] [LOCAL ] NPB: Starting deletion of primary data. [2025-09-17T20:41:45.632493] [DEBUG] [LOCAL ] NPB: No primary data file found to delete. [2025-09-17T20:41:45.632540] [INFO ] [LOCAL ] NPB: Starting deletion of derivative data. [2025-09-17T20:41:45.632585] [DEBUG] [LOCAL ] NPB: No derivative data file found to delete. [2025-09-17T20:41:45.632685] [INFO ] [MAIN ] Update Progress: 1517/2371 symbols completed. NPB took 23.9s. Estimated remaining: 2h 4m 49s. Rate: 6.8 symbols/min [2025-09-17T20:41:46.015810] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-08. [2025-09-17T20:41:46.045091] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T20:41:46.815811] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-03. [2025-09-17T20:41:47.615816] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-01. [2025-09-17T20:41:47.653059] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T20:41:48.016551] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T20:41:48.415753] [INFO ] [REMOTE ] NOW: Fetching primary data for 2025-09. [2025-09-17T20:41:48.609840] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T20:41:48.952623] [INFO ] [REMOTE ] NOW: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T20:41:48.958596] [INFO ] [REMOTE ] NOW: Full fetch complete (70346 records). [2025-09-17T20:41:48.958740] [DEBUG] [VALIDATOR ] NOW: Validating primary data. [2025-09-17T20:41:48.959627] [FATAL] [VALIDATOR ] NOW: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:41:48.959750] [FATAL] [MAIN ] NOW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:41:48.959789] [WARN ] [MAIN ] NOW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:41:48.959831] [INFO ] [LOCAL ] NOW: Starting deletion of primary data. [2025-09-17T20:41:48.959890] [DEBUG] [LOCAL ] NOW: No primary data file found to delete. [2025-09-17T20:41:48.959925] [INFO ] [LOCAL ] NOW: Starting deletion of derivative data. [2025-09-17T20:41:48.960292] [DEBUG] [LOCAL ] NOW: Deleted derivative data file. [2025-09-17T20:41:48.960379] [INFO ] [MAIN ] Update Progress: 1518/2371 symbols completed. NOW took 33.4s. Estimated remaining: 2h 4m 38s. Rate: 6.8 symbols/min [2025-09-17T20:41:49.215798] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-04. [2025-09-17T20:41:50.015837] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-02. [2025-09-17T20:41:50.196890] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T20:41:50.785745] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T20:41:50.815675] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-05. [2025-09-17T20:41:51.386174] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T20:41:51.615791] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-03. [2025-09-17T20:41:52.415821] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-06. [2025-09-17T20:41:52.677806] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T20:41:53.104031] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T20:41:53.215849] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-07. [2025-09-17T20:41:54.015847] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-04. [2025-09-17T20:41:54.152529] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T20:41:54.815837] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-08. [2025-09-17T20:41:55.063747] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T20:41:55.615748] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-05. [2025-09-17T20:41:55.638903] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T20:41:56.415809] [INFO ] [REMOTE ] NPFD: Fetching primary data for 2025-09. [2025-09-17T20:41:56.700905] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T20:41:57.030396] [INFO ] [REMOTE ] NPFD: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T20:41:57.032503] [INFO ] [REMOTE ] NPFD: Full fetch complete (14753 records). [2025-09-17T20:41:57.032579] [DEBUG] [VALIDATOR ] NPFD: Validating primary data. [2025-09-17T20:41:57.220281] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-06. [2025-09-17T20:41:57.422278] [DEBUG] [VALIDATOR ] NPFD: All expected trading days are present. [2025-09-17T20:41:57.422364] [DEBUG] [VALIDATOR ] NPFD: Primary data validation passed. [2025-09-17T20:41:57.422818] [INFO ] [MAIN ] NPFD: Fetched primary data is valid. [2025-09-17T20:41:57.422869] [DEBUG] [LOCAL ] NPFD: Saving primary data. [2025-09-17T20:41:57.423414] [DEBUG] [LOCAL ] NPFD: Trimmed 14753 records to 9711 (keeping 200 days of data) [2025-09-17T20:41:57.488379] [DEBUG] [LOCAL ] NPFD: Primary data saved (9711 records). [2025-09-17T20:41:57.488537] [INFO ] [MAIN ] NPFD: Full history saved. [2025-09-17T20:41:57.488664] [INFO ] [MAIN ] Update Progress: 1519/2371 symbols completed. NPFD took 20.4s. Estimated remaining: 2h 4m 29s. Rate: 6.8 symbols/min [2025-09-17T20:41:58.521724] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T20:41:58.527336] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-07. [2025-09-17T20:41:59.892458] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T20:41:59.897410] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-08. [2025-09-17T20:42:00.985170] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T20:42:00.988974] [INFO ] [REMOTE ] NPCT: Fetching primary data for 2025-09. [2025-09-17T20:42:01.931535] [INFO ] [REMOTE ] NPCT: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T20:42:01.934790] [INFO ] [REMOTE ] NPCT: Full fetch complete (25282 records). [2025-09-17T20:42:01.934955] [DEBUG] [VALIDATOR ] NPCT: Validating primary data. [2025-09-17T20:42:02.342560] [DEBUG] [VALIDATOR ] NPCT: All expected trading days are present. [2025-09-17T20:42:02.342673] [DEBUG] [VALIDATOR ] NPCT: Primary data validation passed. [2025-09-17T20:42:02.343382] [INFO ] [MAIN ] NPCT: Fetched primary data is valid. [2025-09-17T20:42:02.343426] [DEBUG] [LOCAL ] NPCT: Saving primary data. [2025-09-17T20:42:02.345138] [DEBUG] [LOCAL ] NPCT: Trimmed 25282 records to 17050 (keeping 200 days of data) [2025-09-17T20:42:02.453682] [DEBUG] [LOCAL ] NPCT: Primary data saved (17050 records). [2025-09-17T20:42:02.453869] [INFO ] [MAIN ] NPCT: Full history saved. [2025-09-17T20:42:02.453984] [INFO ] [MAIN ] Update Progress: 1520/2371 symbols completed. NPCT took 27.0s. Estimated remaining: 2h 4m 18s. Rate: 6.8 symbols/min [2025-09-17T20:42:03.160192] [INFO ] [MAIN ] NPK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:42:03.232895] [INFO ] [MAIN ] NPKI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:42:03.271319] [DEBUG] [LOCAL ] NPKI: No existing data file found in primary storage. [2025-09-17T20:42:03.270957] [INFO ] [MAIN ] NPV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:42:03.280700] [WARN ] [MAIN ] NPKI: No existing data found, performing full refresh instead. [2025-09-17T20:42:03.301764] [INFO ] [MAIN ] NPO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:42:03.305301] [INFO ] [MAIN ] NPKI: Wiping existing primary data before full refresh. [2025-09-17T20:42:03.305949] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-17T20:42:03.306041] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-17T20:42:03.306185] [INFO ] [MAIN ] NPKI: Starting full primary refresh. [2025-09-17T20:42:03.394409] [DEBUG] [LOCAL ] NPK: Loaded 8172 existing records from primary storage. [2025-09-17T20:42:03.400126] [INFO ] [MAIN ] NPK: Loaded 8172 existing records. [2025-09-17T20:42:03.455167] [DEBUG] [LOCAL ] NPV: Loaded 4978 existing records from primary storage. [2025-09-17T20:42:03.476477] [DEBUG] [LOCAL ] NPO: Loaded 12893 existing records from primary storage. [2025-09-17T20:42:03.477088] [INFO ] [MAIN ] NPV: Loaded 4978 existing records. [2025-09-17T20:42:03.482420] [INFO ] [MAIN ] NPO: Loaded 12893 existing records. [2025-09-17T20:42:04.202861] [WARN ] [MAIN ] NPK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:42:04.280156] [WARN ] [MAIN ] NPO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:42:04.270782] [INFO ] [MAIN ] NPK: Wiping existing primary data before full refresh. [2025-09-17T20:42:04.246574] [WARN ] [MAIN ] NPV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:42:04.338762] [INFO ] [REMOTE ] NPKI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:42:04.336105] [INFO ] [MAIN ] NPO: Wiping existing primary data before full refresh. [2025-09-17T20:42:04.338947] [INFO ] [MAIN ] NPV: Wiping existing primary data before full refresh. [2025-09-17T20:42:04.312763] [INFO ] [LOCAL ] NPK: Starting deletion of primary data. [2025-09-17T20:42:04.339533] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-11. [2025-09-17T20:42:04.339780] [INFO ] [LOCAL ] NPV: Starting deletion of primary data. [2025-09-17T20:42:04.339709] [INFO ] [LOCAL ] NPO: Starting deletion of primary data. [2025-09-17T20:42:04.341079] [DEBUG] [LOCAL ] NPV: Deleted primary data file. [2025-09-17T20:42:04.341158] [INFO ] [MAIN ] NPV: Starting full primary refresh. [2025-09-17T20:42:04.346594] [DEBUG] [LOCAL ] NPK: Deleted primary data file. [2025-09-17T20:42:04.346423] [DEBUG] [LOCAL ] NPO: Deleted primary data file. [2025-09-17T20:42:04.384031] [INFO ] [MAIN ] NPK: Starting full primary refresh. [2025-09-17T20:42:04.420848] [INFO ] [MAIN ] NPO: Starting full primary refresh. [2025-09-17T20:42:04.673465] [DEBUG] [REMOTE ] NPKI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:42:04.763711] [WARN ] [REMOTE ] NPKI: No data returned for month 2024-11 [2025-09-17T20:42:04.880067] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2024-12. [2025-09-17T20:42:05.203690] [INFO ] [REMOTE ] NPV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:42:05.311942] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-11. [2025-09-17T20:42:05.507192] [INFO ] [REMOTE ] NPK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:42:05.513044] [INFO ] [REMOTE ] NPO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:42:05.513600] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-11. [2025-09-17T20:42:05.513850] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-11. [2025-09-17T20:42:05.852940] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T20:42:05.856102] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-01. [2025-09-17T20:42:06.218029] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-17T20:42:06.220732] [INFO ] [REMOTE ] NPK: Fetching primary data for 2024-12. [2025-09-17T20:42:06.299558] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T20:42:06.302948] [INFO ] [REMOTE ] NPO: Fetching primary data for 2024-12. [2025-09-17T20:42:06.350716] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T20:42:06.815778] [INFO ] [REMOTE ] NPV: Fetching primary data for 2024-12. [2025-09-17T20:42:07.040541] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T20:42:07.056033] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T20:42:07.153540] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T20:42:07.254431] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-17T20:42:07.615770] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-01. [2025-09-17T20:42:08.354284] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T20:42:08.415745] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-02. [2025-09-17T20:42:09.159024] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T20:42:09.215723] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-01. [2025-09-17T20:42:09.999895] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T20:42:10.015744] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-02. [2025-09-17T20:42:10.704178] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T20:42:10.815773] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-02. [2025-09-17T20:42:11.615795] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-01. [2025-09-17T20:42:12.266261] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T20:42:12.267801] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T20:42:12.415829] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-02. [2025-09-17T20:42:13.063892] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T20:42:13.215762] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-03. [2025-09-17T20:42:13.957971] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T20:42:14.015798] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-03. [2025-09-17T20:42:14.815851] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-03. [2025-09-17T20:42:15.494788] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T20:42:15.560924] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T20:42:15.615802] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-04. [2025-09-17T20:42:16.415856] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-03. [2025-09-17T20:42:17.063831] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T20:42:17.215993] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-05. [2025-09-17T20:42:17.473062] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T20:42:18.015795] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-04. [2025-09-17T20:42:18.695479] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T20:42:18.815827] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-06. [2025-09-17T20:42:19.156695] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T20:42:19.615810] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-05. [2025-09-17T20:42:20.426243] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-04. [2025-09-17T20:42:20.432469] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T20:42:20.681539] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T20:42:21.025923] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T20:42:21.215837] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-04. [2025-09-17T20:42:22.015762] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-05. [2025-09-17T20:42:22.104890] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T20:42:22.668098] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T20:42:22.815780] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-07. [2025-09-17T20:42:23.615828] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-06. [2025-09-17T20:42:24.415762] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-06. [2025-09-17T20:42:24.497957] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T20:42:24.518431] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T20:42:24.870564] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T20:42:25.215831] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-08. [2025-09-17T20:42:26.015859] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-07. [2025-09-17T20:42:26.815834] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-07. [2025-09-17T20:42:26.969171] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T20:42:27.000384] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T20:42:27.459614] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T20:42:27.615792] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-08. [2025-09-17T20:42:28.415816] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-05. [2025-09-17T20:42:28.597111] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T20:42:29.107507] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T20:42:29.215868] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-06. [2025-09-17T20:42:30.015808] [INFO ] [REMOTE ] NPO: Fetching primary data for 2025-09. [2025-09-17T20:42:30.102923] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T20:42:30.659660] [INFO ] [REMOTE ] NPO: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T20:42:30.661673] [INFO ] [REMOTE ] NPO: Full fetch complete (18169 records). [2025-09-17T20:42:30.661770] [DEBUG] [VALIDATOR ] NPO: Validating primary data. [2025-09-17T20:42:30.821669] [INFO ] [REMOTE ] NPKI: Fetching primary data for 2025-09. [2025-09-17T20:42:31.055578] [DEBUG] [VALIDATOR ] NPO: All expected trading days are present. [2025-09-17T20:42:31.055684] [DEBUG] [VALIDATOR ] NPO: Primary data validation passed. [2025-09-17T20:42:31.056106] [INFO ] [MAIN ] NPO: Fetched primary data is valid. [2025-09-17T20:42:31.056146] [DEBUG] [LOCAL ] NPO: Saving primary data. [2025-09-17T20:42:31.056855] [DEBUG] [LOCAL ] NPO: Trimmed 18169 records to 12875 (keeping 200 days of data) [2025-09-17T20:42:31.140398] [DEBUG] [LOCAL ] NPO: Primary data saved (12875 records). [2025-09-17T20:42:31.140571] [INFO ] [MAIN ] NPO: Full history saved. [2025-09-17T20:42:31.140682] [INFO ] [MAIN ] Update Progress: 1521/2371 symbols completed. NPO took 28.7s. Estimated remaining: 2h 4m 20s. Rate: 6.8 symbols/min [2025-09-17T20:42:31.313165] [INFO ] [MAIN ] NPWR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:42:31.353231] [DEBUG] [LOCAL ] NPWR: Loaded 42970 existing records from primary storage. [2025-09-17T20:42:31.353394] [INFO ] [MAIN ] NPWR: Loaded 42970 existing records. [2025-09-17T20:42:31.539284] [WARN ] [MAIN ] NPWR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:42:31.539543] [INFO ] [MAIN ] NPWR: Wiping existing primary data before full refresh. [2025-09-17T20:42:31.539590] [INFO ] [LOCAL ] NPWR: Starting deletion of primary data. [2025-09-17T20:42:31.540593] [DEBUG] [LOCAL ] NPWR: Deleted primary data file. [2025-09-17T20:42:31.540665] [INFO ] [MAIN ] NPWR: Starting full primary refresh. [2025-09-17T20:42:31.620873] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-08. [2025-09-17T20:42:31.898611] [INFO ] [REMOTE ] NPWR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:42:32.314784] [INFO ] [REMOTE ] NPKI: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T20:42:32.324465] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T20:42:32.326822] [INFO ] [REMOTE ] NPKI: Full fetch complete (51826 records). [2025-09-17T20:42:32.326917] [DEBUG] [VALIDATOR ] NPKI: Validating primary data. [2025-09-17T20:42:32.424325] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-07. [2025-09-17T20:42:32.520098] [WARN ] [VALIDATOR ] NPKI: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-09-17T20:42:32.520803] [FATAL] [MAIN ] NPKI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:42:32.520880] [WARN ] [MAIN ] NPKI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:42:32.520953] [INFO ] [LOCAL ] NPKI: Starting deletion of primary data. [2025-09-17T20:42:32.521059] [DEBUG] [LOCAL ] NPKI: No primary data file found to delete. [2025-09-17T20:42:32.521107] [INFO ] [LOCAL ] NPKI: Starting deletion of derivative data. [2025-09-17T20:42:32.521149] [DEBUG] [LOCAL ] NPKI: No derivative data file found to delete. [2025-09-17T20:42:32.521223] [INFO ] [MAIN ] Update Progress: 1522/2371 symbols completed. NPKI took 30.1s. Estimated remaining: 2h 4m 7s. Rate: 6.8 symbols/min [2025-09-17T20:42:32.688930] [INFO ] [MAIN ] NQP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:42:32.699982] [DEBUG] [LOCAL ] NQP: Loaded 9175 existing records from primary storage. [2025-09-17T20:42:32.700108] [INFO ] [MAIN ] NQP: Loaded 9175 existing records. [2025-09-17T20:42:32.883353] [WARN ] [MAIN ] NQP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:42:32.883614] [INFO ] [MAIN ] NQP: Wiping existing primary data before full refresh. [2025-09-17T20:42:32.883678] [INFO ] [LOCAL ] NQP: Starting deletion of primary data. [2025-09-17T20:42:32.884078] [DEBUG] [LOCAL ] NQP: Deleted primary data file. [2025-09-17T20:42:32.884127] [INFO ] [MAIN ] NQP: Starting full primary refresh. [2025-09-17T20:42:33.230851] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-11. [2025-09-17T20:42:33.279154] [INFO ] [REMOTE ] NQP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:42:33.466486] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T20:42:34.015867] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-08. [2025-09-17T20:42:34.815791] [INFO ] [REMOTE ] NPV: Fetching primary data for 2025-09. [2025-09-17T20:42:34.871364] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T20:42:34.885669] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T20:42:35.578211] [INFO ] [REMOTE ] NPV: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T20:42:35.579801] [INFO ] [REMOTE ] NPV: Full fetch complete (6749 records). [2025-09-17T20:42:35.579880] [DEBUG] [VALIDATOR ] NPV: Validating primary data. [2025-09-17T20:42:35.620943] [INFO ] [REMOTE ] NPK: Fetching primary data for 2025-09. [2025-09-17T20:42:35.964389] [DEBUG] [VALIDATOR ] NPV: All expected trading days are present. [2025-09-17T20:42:35.964533] [DEBUG] [VALIDATOR ] NPV: Primary data validation passed. [2025-09-17T20:42:35.964813] [INFO ] [MAIN ] NPV: Fetched primary data is valid. [2025-09-17T20:42:35.964878] [DEBUG] [LOCAL ] NPV: Saving primary data. [2025-09-17T20:42:35.965333] [DEBUG] [LOCAL ] NPV: Trimmed 6749 records to 4973 (keeping 200 days of data) [2025-09-17T20:42:35.997176] [DEBUG] [LOCAL ] NPV: Primary data saved (4973 records). [2025-09-17T20:42:35.997300] [INFO ] [MAIN ] NPV: Full history saved. [2025-09-17T20:42:35.997399] [INFO ] [MAIN ] Update Progress: 1523/2371 symbols completed. NPV took 33.5s. Estimated remaining: 2h 3m 56s. Rate: 6.8 symbols/min [2025-09-17T20:42:36.172954] [INFO ] [MAIN ] NRDY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:42:36.210882] [DEBUG] [LOCAL ] NRDY: Loaded 33381 existing records from primary storage. [2025-09-17T20:42:36.211046] [INFO ] [MAIN ] NRDY: Loaded 33381 existing records. [2025-09-17T20:42:36.399861] [INFO ] [REMOTE ] NPK: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T20:42:36.405812] [WARN ] [MAIN ] NRDY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:42:36.407398] [INFO ] [REMOTE ] NPK: Full fetch complete (11041 records). [2025-09-17T20:42:36.407609] [INFO ] [MAIN ] NRDY: Wiping existing primary data before full refresh. [2025-09-17T20:42:36.407734] [DEBUG] [VALIDATOR ] NPK: Validating primary data. [2025-09-17T20:42:36.407793] [INFO ] [LOCAL ] NRDY: Starting deletion of primary data. [2025-09-17T20:42:36.420932] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-11. [2025-09-17T20:42:36.439769] [DEBUG] [LOCAL ] NRDY: Deleted primary data file. [2025-09-17T20:42:36.453141] [INFO ] [MAIN ] NRDY: Starting full primary refresh. [2025-09-17T20:42:37.192702] [INFO ] [REMOTE ] NRDY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:42:37.192906] [DEBUG] [VALIDATOR ] NPK: All expected trading days are present. [2025-09-17T20:42:37.193038] [DEBUG] [VALIDATOR ] NPK: Primary data validation passed. [2025-09-17T20:42:37.193771] [INFO ] [MAIN ] NPK: Fetched primary data is valid. [2025-09-17T20:42:37.193831] [DEBUG] [LOCAL ] NPK: Saving primary data. [2025-09-17T20:42:37.194297] [DEBUG] [LOCAL ] NPK: Trimmed 11041 records to 8169 (keeping 200 days of data) [2025-09-17T20:42:37.215855] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2024-12. [2025-09-17T20:42:37.248081] [DEBUG] [LOCAL ] NPK: Primary data saved (8169 records). [2025-09-17T20:42:37.248194] [INFO ] [MAIN ] NPK: Full history saved. [2025-09-17T20:42:37.248296] [INFO ] [MAIN ] Update Progress: 1524/2371 symbols completed. NPK took 34.8s. Estimated remaining: 2h 3m 43s. Rate: 6.8 symbols/min [2025-09-17T20:42:37.421936] [INFO ] [MAIN ] NREF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:42:37.431685] [DEBUG] [LOCAL ] NREF: Loaded 7779 existing records from primary storage. [2025-09-17T20:42:37.431812] [INFO ] [MAIN ] NREF: Loaded 7779 existing records. [2025-09-17T20:42:37.568988] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T20:42:37.625052] [WARN ] [MAIN ] NREF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:42:37.625325] [INFO ] [MAIN ] NREF: Wiping existing primary data before full refresh. [2025-09-17T20:42:37.625373] [INFO ] [LOCAL ] NREF: Starting deletion of primary data. [2025-09-17T20:42:37.625699] [DEBUG] [LOCAL ] NREF: Deleted primary data file. [2025-09-17T20:42:37.625748] [INFO ] [MAIN ] NREF: Starting full primary refresh. [2025-09-17T20:42:37.995754] [INFO ] [REMOTE ] NREF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:42:38.015756] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-11. [2025-09-17T20:42:38.224260] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T20:42:38.771092] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T20:42:38.815789] [INFO ] [REMOTE ] NREF: Fetching primary data for 2024-12. [2025-09-17T20:42:39.615832] [INFO ] [REMOTE ] NQP: Fetching primary data for 2024-12. [2025-09-17T20:42:39.629525] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T20:42:40.377513] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2024-12 (0.76 seconds). [2025-09-17T20:42:40.415773] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-01. [2025-09-17T20:42:41.210310] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T20:42:41.215675] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-02. [2025-09-17T20:42:42.015783] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-11. [2025-09-17T20:42:42.033415] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T20:42:42.815835] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-01. [2025-09-17T20:42:43.460665] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T20:42:43.617401] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-01. [2025-09-17T20:42:43.622621] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T20:42:44.415838] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-02. [2025-09-17T20:42:44.787346] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T20:42:45.151259] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T20:42:45.215738] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-03. [2025-09-17T20:42:45.988566] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T20:42:46.015738] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-04. [2025-09-17T20:42:46.601050] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T20:42:46.815838] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-03. [2025-09-17T20:42:47.462606] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T20:42:47.615845] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2024-12. [2025-09-17T20:42:48.415830] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-04. [2025-09-17T20:42:49.215808] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-02. [2025-09-17T20:42:49.402275] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T20:42:49.599152] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T20:42:50.015788] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-05. [2025-09-17T20:42:50.304981] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T20:42:50.815758] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-01. [2025-09-17T20:42:50.912088] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T20:42:51.615777] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-03. [2025-09-17T20:42:52.388854] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T20:42:52.415728] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-02. [2025-09-17T20:42:53.215754] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-05. [2025-09-17T20:42:53.634413] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T20:42:53.929051] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T20:42:54.015779] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-03. [2025-09-17T20:42:54.035518] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T20:42:54.815841] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-06. [2025-09-17T20:42:55.615309] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T20:42:55.623030] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-04. [2025-09-17T20:42:55.694530] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T20:42:56.415821] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-06. [2025-09-17T20:42:56.878218] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T20:42:57.030755] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T20:42:57.215811] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-05. [2025-09-17T20:42:58.015789] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-04. [2025-09-17T20:42:58.776541] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T20:42:58.815755] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-06. [2025-09-17T20:42:59.435788] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T20:42:59.615842] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-05. [2025-09-17T20:43:00.399273] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T20:43:00.415735] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-07. [2025-09-17T20:43:01.009306] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T20:43:01.215781] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-06. [2025-09-17T20:43:02.015796] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-07. [2025-09-17T20:43:02.186908] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T20:43:02.480919] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T20:43:02.815792] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-07. [2025-09-17T20:43:02.828817] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T20:43:03.615820] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-08. [2025-09-17T20:43:04.266433] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T20:43:04.415826] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-08. [2025-09-17T20:43:05.215774] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-08. [2025-09-17T20:43:05.272299] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T20:43:05.306227] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T20:43:06.015791] [INFO ] [REMOTE ] NQP: Fetching primary data for 2025-09. [2025-09-17T20:43:06.543213] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T20:43:06.813252] [INFO ] [REMOTE ] NQP: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T20:43:06.815023] [INFO ] [REMOTE ] NQP: Full fetch complete (13513 records). [2025-09-17T20:43:06.815094] [DEBUG] [VALIDATOR ] NQP: Validating primary data. [2025-09-17T20:43:06.821007] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-07. [2025-09-17T20:43:07.189393] [DEBUG] [VALIDATOR ] NQP: All expected trading days are present. [2025-09-17T20:43:07.189486] [DEBUG] [VALIDATOR ] NQP: Primary data validation passed. [2025-09-17T20:43:07.189857] [INFO ] [MAIN ] NQP: Fetched primary data is valid. [2025-09-17T20:43:07.189901] [DEBUG] [LOCAL ] NQP: Saving primary data. [2025-09-17T20:43:07.190391] [DEBUG] [LOCAL ] NQP: Trimmed 13513 records to 9172 (keeping 200 days of data) [2025-09-17T20:43:07.248519] [DEBUG] [LOCAL ] NQP: Primary data saved (9172 records). [2025-09-17T20:43:07.248885] [INFO ] [MAIN ] NQP: Full history saved. [2025-09-17T20:43:07.249000] [INFO ] [MAIN ] Update Progress: 1525/2371 symbols completed. NQP took 34.7s. Estimated remaining: 2h 3m 46s. Rate: 6.8 symbols/min [2025-09-17T20:43:07.419699] [INFO ] [MAIN ] NRG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:43:07.478389] [DEBUG] [LOCAL ] NRG: Loaded 52949 existing records from primary storage. [2025-09-17T20:43:07.478564] [INFO ] [MAIN ] NRG: Loaded 52949 existing records. [2025-09-17T20:43:07.632474] [INFO ] [REMOTE ] NPWR: Fetching primary data for 2025-09. [2025-09-17T20:43:07.679627] [WARN ] [MAIN ] NRG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:43:07.680002] [INFO ] [MAIN ] NRG: Wiping existing primary data before full refresh. [2025-09-17T20:43:07.680057] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-17T20:43:07.681573] [DEBUG] [LOCAL ] NRG: Deleted primary data file. [2025-09-17T20:43:07.681636] [INFO ] [MAIN ] NRG: Starting full primary refresh. [2025-09-17T20:43:07.865729] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T20:43:08.069776] [INFO ] [REMOTE ] NRG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:43:08.415773] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-08. [2025-09-17T20:43:08.954384] [INFO ] [REMOTE ] NPWR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T20:43:08.963840] [INFO ] [REMOTE ] NPWR: Full fetch complete (58731 records). [2025-09-17T20:43:08.964540] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-08 (0.55 seconds). [2025-09-17T20:43:08.964612] [DEBUG] [VALIDATOR ] NPWR: Validating primary data. [2025-09-17T20:43:09.222070] [INFO ] [REMOTE ] NREF: Fetching primary data for 2025-09. [2025-09-17T20:43:09.368412] [DEBUG] [VALIDATOR ] NPWR: All expected trading days are present. [2025-09-17T20:43:09.368547] [DEBUG] [VALIDATOR ] NPWR: Primary data validation passed. [2025-09-17T20:43:09.369894] [INFO ] [MAIN ] NPWR: Fetched primary data is valid. [2025-09-17T20:43:09.369973] [DEBUG] [LOCAL ] NPWR: Saving primary data. [2025-09-17T20:43:09.371805] [DEBUG] [LOCAL ] NPWR: Trimmed 58731 records to 42960 (keeping 200 days of data) [2025-09-17T20:43:09.650039] [DEBUG] [LOCAL ] NPWR: Primary data saved (42960 records). [2025-09-17T20:43:09.650321] [INFO ] [MAIN ] NPWR: Full history saved. [2025-09-17T20:43:09.650503] [INFO ] [MAIN ] Update Progress: 1526/2371 symbols completed. NPWR took 38.5s. Estimated remaining: 2h 3m 33s. Rate: 6.8 symbols/min [2025-09-17T20:43:09.839089] [INFO ] [MAIN ] NRGV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:43:09.885090] [DEBUG] [LOCAL ] NRGV: Loaded 42570 existing records from primary storage. [2025-09-17T20:43:09.885344] [INFO ] [MAIN ] NRGV: Loaded 42570 existing records. [2025-09-17T20:43:10.020940] [INFO ] [REMOTE ] NRDY: Fetching primary data for 2025-09. [2025-09-17T20:43:10.084391] [WARN ] [MAIN ] NRGV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:43:10.084717] [INFO ] [MAIN ] NRGV: Wiping existing primary data before full refresh. [2025-09-17T20:43:10.084771] [INFO ] [LOCAL ] NRGV: Starting deletion of primary data. [2025-09-17T20:43:10.086023] [DEBUG] [LOCAL ] NRGV: Deleted primary data file. [2025-09-17T20:43:10.086083] [INFO ] [MAIN ] NRGV: Starting full primary refresh. [2025-09-17T20:43:10.226830] [INFO ] [REMOTE ] NREF: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T20:43:10.245429] [INFO ] [REMOTE ] NREF: Full fetch complete (10806 records). [2025-09-17T20:43:10.250705] [DEBUG] [VALIDATOR ] NREF: Validating primary data. [2025-09-17T20:43:10.825433] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-11. [2025-09-17T20:43:10.831426] [INFO ] [REMOTE ] NRGV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:43:10.900774] [DEBUG] [VALIDATOR ] NREF: All expected trading days are present. [2025-09-17T20:43:10.900861] [DEBUG] [VALIDATOR ] NREF: Primary data validation passed. [2025-09-17T20:43:10.901174] [INFO ] [MAIN ] NREF: Fetched primary data is valid. [2025-09-17T20:43:10.901212] [DEBUG] [LOCAL ] NREF: Saving primary data. [2025-09-17T20:43:10.901675] [DEBUG] [LOCAL ] NREF: Trimmed 10806 records to 7790 (keeping 200 days of data) [2025-09-17T20:43:10.950992] [DEBUG] [LOCAL ] NREF: Primary data saved (7790 records). [2025-09-17T20:43:10.951110] [INFO ] [MAIN ] NREF: Full history saved. [2025-09-17T20:43:10.951207] [INFO ] [MAIN ] Update Progress: 1527/2371 symbols completed. NREF took 33.7s. Estimated remaining: 2h 3m 20s. Rate: 6.8 symbols/min [2025-09-17T20:43:11.124402] [INFO ] [MAIN ] NRK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:43:11.144322] [DEBUG] [LOCAL ] NRK: Loaded 19390 existing records from primary storage. [2025-09-17T20:43:11.144470] [INFO ] [MAIN ] NRK: Loaded 19390 existing records. [2025-09-17T20:43:11.324224] [WARN ] [MAIN ] NRK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:43:11.324543] [INFO ] [MAIN ] NRK: Wiping existing primary data before full refresh. [2025-09-17T20:43:11.324598] [INFO ] [LOCAL ] NRK: Starting deletion of primary data. [2025-09-17T20:43:11.325417] [DEBUG] [LOCAL ] NRK: Deleted primary data file. [2025-09-17T20:43:11.325466] [INFO ] [MAIN ] NRK: Starting full primary refresh. [2025-09-17T20:43:11.527611] [INFO ] [REMOTE ] NRDY: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T20:43:11.619535] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-11. [2025-09-17T20:43:11.636233] [INFO ] [REMOTE ] NRDY: Full fetch complete (52582 records). [2025-09-17T20:43:11.637220] [DEBUG] [VALIDATOR ] NRDY: Validating primary data. [2025-09-17T20:43:11.849238] [INFO ] [REMOTE ] NRK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:43:12.135505] [DEBUG] [VALIDATOR ] NRDY: All expected trading days are present. [2025-09-17T20:43:12.135595] [DEBUG] [VALIDATOR ] NRDY: Primary data validation passed. [2025-09-17T20:43:12.136682] [INFO ] [MAIN ] NRDY: Fetched primary data is valid. [2025-09-17T20:43:12.136729] [DEBUG] [LOCAL ] NRDY: Saving primary data. [2025-09-17T20:43:12.138087] [DEBUG] [LOCAL ] NRDY: Trimmed 52582 records to 33268 (keeping 200 days of data) [2025-09-17T20:43:12.335087] [DEBUG] [LOCAL ] NRDY: Primary data saved (33268 records). [2025-09-17T20:43:12.335238] [INFO ] [MAIN ] NRDY: Full history saved. [2025-09-17T20:43:12.336923] [INFO ] [MAIN ] Update Progress: 1528/2371 symbols completed. NRDY took 36.3s. Estimated remaining: 2h 3m 8s. Rate: 6.8 symbols/min [2025-09-17T20:43:12.420980] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-11. [2025-09-17T20:43:12.514374] [INFO ] [MAIN ] NRP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:43:12.525733] [DEBUG] [LOCAL ] NRP: Loaded 4166 existing records from primary storage. [2025-09-17T20:43:12.526063] [INFO ] [MAIN ] NRP: Loaded 4166 existing records. [2025-09-17T20:43:12.707386] [WARN ] [MAIN ] NRP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:43:12.707969] [INFO ] [MAIN ] NRP: Wiping existing primary data before full refresh. [2025-09-17T20:43:12.708163] [INFO ] [LOCAL ] NRP: Starting deletion of primary data. [2025-09-17T20:43:12.708602] [DEBUG] [LOCAL ] NRP: Deleted primary data file. [2025-09-17T20:43:12.708688] [INFO ] [MAIN ] NRP: Starting full primary refresh. [2025-09-17T20:43:13.036977] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-11 (2.21 seconds). [2025-09-17T20:43:13.115221] [INFO ] [REMOTE ] NRP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:43:13.215787] [INFO ] [REMOTE ] NRG: Fetching primary data for 2024-12. [2025-09-17T20:43:13.328143] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T20:43:13.406941] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T20:43:14.015792] [INFO ] [REMOTE ] NRK: Fetching primary data for 2024-12. [2025-09-17T20:43:14.815786] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-11. [2025-09-17T20:43:14.890545] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T20:43:14.953087] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T20:43:15.615746] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-01. [2025-09-17T20:43:15.833700] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T20:43:16.415805] [INFO ] [REMOTE ] NRP: Fetching primary data for 2024-12. [2025-09-17T20:43:16.689091] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T20:43:17.025363] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T20:43:17.215787] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2024-12. [2025-09-17T20:43:18.015804] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-01. [2025-09-17T20:43:18.506968] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T20:43:18.815783] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-01. [2025-09-17T20:43:18.975136] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T20:43:19.615790] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-02. [2025-09-17T20:43:20.310063] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T20:43:20.415792] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-01. [2025-09-17T20:43:20.843326] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T20:43:21.215795] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-02. [2025-09-17T20:43:21.808885] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T20:43:22.015804] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-02. [2025-09-17T20:43:22.815881] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-03. [2025-09-17T20:43:23.168656] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T20:43:23.222017] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T20:43:23.256116] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T20:43:23.615820] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-03. [2025-09-17T20:43:24.415809] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-02. [2025-09-17T20:43:25.215748] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-03. [2025-09-17T20:43:25.342576] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T20:43:25.485073] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T20:43:26.015790] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-04. [2025-09-17T20:43:26.611977] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T20:43:26.815793] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-05. [2025-09-17T20:43:26.853631] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T20:43:27.371067] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T20:43:27.615769] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-06. [2025-09-17T20:43:28.149200] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T20:43:28.415823] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-04. [2025-09-17T20:43:29.215834] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-04. [2025-09-17T20:43:29.852573] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T20:43:30.015787] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-05. [2025-09-17T20:43:30.815844] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-07. [2025-09-17T20:43:31.081813] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T20:43:31.282535] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T20:43:31.496836] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T20:43:31.615769] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-06. [2025-09-17T20:43:32.415785] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-08. [2025-09-17T20:43:32.919859] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T20:43:33.197594] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T20:43:33.215723] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-07. [2025-09-17T20:43:34.015803] [INFO ] [REMOTE ] NRP: Fetching primary data for 2025-09. [2025-09-17T20:43:34.534721] [INFO ] [REMOTE ] NRP: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T20:43:34.536167] [INFO ] [REMOTE ] NRP: Full fetch complete (6512 records). [2025-09-17T20:43:34.536310] [DEBUG] [VALIDATOR ] NRP: Validating primary data. [2025-09-17T20:43:34.821030] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-03. [2025-09-17T20:43:34.946905] [DEBUG] [VALIDATOR ] NRP: All expected trading days are present. [2025-09-17T20:43:34.947023] [DEBUG] [VALIDATOR ] NRP: Primary data validation passed. [2025-09-17T20:43:34.947301] [INFO ] [MAIN ] NRP: Fetched primary data is valid. [2025-09-17T20:43:34.947355] [DEBUG] [LOCAL ] NRP: Saving primary data. [2025-09-17T20:43:34.947810] [DEBUG] [LOCAL ] NRP: Trimmed 6512 records to 4153 (keeping 200 days of data) [2025-09-17T20:43:34.994277] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T20:43:35.009673] [DEBUG] [LOCAL ] NRP: Primary data saved (4153 records). [2025-09-17T20:43:35.009795] [INFO ] [MAIN ] NRP: Full history saved. [2025-09-17T20:43:35.009875] [INFO ] [MAIN ] Update Progress: 1529/2371 symbols completed. NRP took 22.7s. Estimated remaining: 2h 3m 6s. Rate: 6.8 symbols/min [2025-09-17T20:43:35.183559] [INFO ] [MAIN ] NRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:43:35.191547] [DEBUG] [LOCAL ] NRT: Loaded 4956 existing records from primary storage. [2025-09-17T20:43:35.191745] [INFO ] [MAIN ] NRT: Loaded 4956 existing records. [2025-09-17T20:43:35.379193] [WARN ] [MAIN ] NRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:43:35.379439] [INFO ] [MAIN ] NRT: Wiping existing primary data before full refresh. [2025-09-17T20:43:35.379488] [INFO ] [LOCAL ] NRT: Starting deletion of primary data. [2025-09-17T20:43:35.379843] [DEBUG] [LOCAL ] NRT: Deleted primary data file. [2025-09-17T20:43:35.379894] [INFO ] [MAIN ] NRT: Starting full primary refresh. [2025-09-17T20:43:35.615826] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-08. [2025-09-17T20:43:35.759546] [INFO ] [REMOTE ] NRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:43:35.933934] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T20:43:36.415819] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-11. [2025-09-17T20:43:36.982820] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T20:43:37.215814] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-04. [2025-09-17T20:43:37.403288] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T20:43:38.015800] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-05. [2025-09-17T20:43:38.183189] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T20:43:38.815848] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-05. [2025-09-17T20:43:39.615754] [INFO ] [REMOTE ] NRGV: Fetching primary data for 2025-09. [2025-09-17T20:43:39.889602] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T20:43:40.169179] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T20:43:40.415789] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-06. [2025-09-17T20:43:41.177102] [INFO ] [REMOTE ] NRGV: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T20:43:41.183696] [INFO ] [REMOTE ] NRGV: Full fetch complete (61459 records). [2025-09-17T20:43:41.183855] [DEBUG] [VALIDATOR ] NRGV: Validating primary data. [2025-09-17T20:43:41.220880] [INFO ] [REMOTE ] NRT: Fetching primary data for 2024-12. [2025-09-17T20:43:41.588118] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T20:43:41.607138] [DEBUG] [VALIDATOR ] NRGV: All expected trading days are present. [2025-09-17T20:43:41.607229] [DEBUG] [VALIDATOR ] NRGV: Primary data validation passed. [2025-09-17T20:43:41.608636] [INFO ] [MAIN ] NRGV: Fetched primary data is valid. [2025-09-17T20:43:41.608840] [DEBUG] [LOCAL ] NRGV: Saving primary data. [2025-09-17T20:43:41.610459] [DEBUG] [LOCAL ] NRGV: Trimmed 61459 records to 42685 (keeping 200 days of data) [2025-09-17T20:43:41.873748] [DEBUG] [LOCAL ] NRGV: Primary data saved (42685 records). [2025-09-17T20:43:41.873929] [INFO ] [MAIN ] NRGV: Full history saved. [2025-09-17T20:43:41.874081] [INFO ] [MAIN ] Update Progress: 1530/2371 symbols completed. NRGV took 32.2s. Estimated remaining: 2h 2m 57s. Rate: 6.8 symbols/min [2025-09-17T20:43:42.020859] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-07. [2025-09-17T20:43:42.052117] [INFO ] [MAIN ] NRUC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:43:42.057578] [DEBUG] [LOCAL ] NRUC: Loaded 3116 existing records from primary storage. [2025-09-17T20:43:42.057780] [INFO ] [MAIN ] NRUC: Loaded 3116 existing records. [2025-09-17T20:43:42.222838] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T20:43:42.243747] [WARN ] [MAIN ] NRUC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:43:42.244425] [INFO ] [MAIN ] NRUC: Wiping existing primary data before full refresh. [2025-09-17T20:43:42.244475] [INFO ] [LOCAL ] NRUC: Starting deletion of primary data. [2025-09-17T20:43:42.244707] [DEBUG] [LOCAL ] NRUC: Deleted primary data file. [2025-09-17T20:43:42.244765] [INFO ] [MAIN ] NRUC: Starting full primary refresh. [2025-09-17T20:43:42.620516] [INFO ] [REMOTE ] NRUC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:43:42.815779] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-01. [2025-09-17T20:43:42.886185] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T20:43:43.615890] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-06. [2025-09-17T20:43:43.651533] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T20:43:44.415867] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-11. [2025-09-17T20:43:45.158022] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T20:43:45.215903] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-08. [2025-09-17T20:43:45.641733] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T20:43:46.015860] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-07. [2025-09-17T20:43:46.076218] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T20:43:46.815802] [INFO ] [REMOTE ] NRK: Fetching primary data for 2025-09. [2025-09-17T20:43:47.615830] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-02. [2025-09-17T20:43:47.857542] [INFO ] [REMOTE ] NRK: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T20:43:47.861822] [INFO ] [REMOTE ] NRK: Full fetch complete (27704 records). [2025-09-17T20:43:47.862011] [DEBUG] [VALIDATOR ] NRK: Validating primary data. [2025-09-17T20:43:48.291861] [DEBUG] [VALIDATOR ] NRK: All expected trading days are present. [2025-09-17T20:43:48.292150] [DEBUG] [VALIDATOR ] NRK: Primary data validation passed. [2025-09-17T20:43:48.293180] [INFO ] [MAIN ] NRK: Fetched primary data is valid. [2025-09-17T20:43:48.293241] [DEBUG] [LOCAL ] NRK: Saving primary data. [2025-09-17T20:43:48.295302] [DEBUG] [LOCAL ] NRK: Trimmed 27704 records to 19512 (keeping 200 days of data) [2025-09-17T20:43:48.425371] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-17T20:43:48.423184] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2024-12. [2025-09-17T20:43:48.450280] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T20:43:48.484457] [DEBUG] [LOCAL ] NRK: Primary data saved (19512 records). [2025-09-17T20:43:48.484701] [INFO ] [MAIN ] NRK: Full history saved. [2025-09-17T20:43:48.484841] [INFO ] [MAIN ] Update Progress: 1531/2371 symbols completed. NRK took 37.5s. Estimated remaining: 2h 2m 47s. Rate: 6.8 symbols/min [2025-09-17T20:43:48.658990] [INFO ] [MAIN ] NSA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:43:48.725516] [DEBUG] [LOCAL ] NSA: Loaded 44838 existing records from primary storage. [2025-09-17T20:43:48.725772] [INFO ] [MAIN ] NSA: Loaded 44838 existing records. [2025-09-17T20:43:48.919540] [WARN ] [MAIN ] NSA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:43:48.926137] [INFO ] [MAIN ] NSA: Wiping existing primary data before full refresh. [2025-09-17T20:43:48.926371] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T20:43:48.926511] [INFO ] [LOCAL ] NSA: Starting deletion of primary data. [2025-09-17T20:43:48.930035] [DEBUG] [LOCAL ] NSA: Deleted primary data file. [2025-09-17T20:43:48.930122] [INFO ] [MAIN ] NSA: Starting full primary refresh. [2025-09-17T20:43:49.221085] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-08. [2025-09-17T20:43:49.308237] [INFO ] [REMOTE ] NSA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:43:50.015804] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-01. [2025-09-17T20:43:50.672101] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T20:43:50.815832] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-02. [2025-09-17T20:43:51.177267] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T20:43:51.533544] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T20:43:51.615767] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-03. [2025-09-17T20:43:52.206175] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T20:43:52.415782] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-03. [2025-09-17T20:43:53.074499] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T20:43:53.215822] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-04. [2025-09-17T20:43:53.916433] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T20:43:54.015785] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-04. [2025-09-17T20:43:54.641117] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T20:43:54.815807] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-05. [2025-09-17T20:43:55.498208] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T20:43:55.615780] [INFO ] [REMOTE ] NRG: Fetching primary data for 2025-09. [2025-09-17T20:43:56.168710] [INFO ] [REMOTE ] NRG: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T20:43:56.175210] [INFO ] [REMOTE ] NRG: Full fetch complete (76023 records). [2025-09-17T20:43:56.175353] [DEBUG] [VALIDATOR ] NRG: Validating primary data. [2025-09-17T20:43:56.176222] [FATAL] [VALIDATOR ] NRG: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:43:56.176308] [FATAL] [MAIN ] NRG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:43:56.176355] [WARN ] [MAIN ] NRG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:43:56.176445] [INFO ] [LOCAL ] NRG: Starting deletion of primary data. [2025-09-17T20:43:56.176513] [DEBUG] [LOCAL ] NRG: No primary data file found to delete. [2025-09-17T20:43:56.176556] [INFO ] [LOCAL ] NRG: Starting deletion of derivative data. [2025-09-17T20:43:56.176872] [DEBUG] [LOCAL ] NRG: Deleted derivative data file. [2025-09-17T20:43:56.176957] [INFO ] [MAIN ] Update Progress: 1532/2371 symbols completed. NRG took 48.9s. Estimated remaining: 2h 2m 37s. Rate: 6.8 symbols/min [2025-09-17T20:43:56.352286] [INFO ] [MAIN ] NSC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:43:56.412432] [DEBUG] [LOCAL ] NSC: Loaded 49164 existing records from primary storage. [2025-09-17T20:43:56.412614] [INFO ] [MAIN ] NSC: Loaded 49164 existing records. [2025-09-17T20:43:56.424376] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-05. [2025-09-17T20:43:56.613138] [WARN ] [MAIN ] NSC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:43:56.613577] [INFO ] [MAIN ] NSC: Wiping existing primary data before full refresh. [2025-09-17T20:43:56.613630] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-17T20:43:56.614980] [DEBUG] [LOCAL ] NSC: Deleted primary data file. [2025-09-17T20:43:56.615040] [INFO ] [MAIN ] NSC: Starting full primary refresh. [2025-09-17T20:43:57.006558] [INFO ] [REMOTE ] NSC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:43:57.215787] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-11. [2025-09-17T20:43:57.374284] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T20:43:58.015816] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-06. [2025-09-17T20:43:58.485367] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T20:43:58.661699] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T20:43:58.815816] [INFO ] [REMOTE ] NSC: Fetching primary data for 2024-12. [2025-09-17T20:43:59.615776] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-07. [2025-09-17T20:44:00.147284] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-07 (0.53 seconds). [2025-09-17T20:44:00.415776] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-06. [2025-09-17T20:44:00.515022] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T20:44:01.159906] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T20:44:01.215814] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-07. [2025-09-17T20:44:01.811813] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T20:44:02.015852] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-08. [2025-09-17T20:44:02.815786] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-11. [2025-09-17T20:44:02.834048] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T20:44:03.615767] [INFO ] [REMOTE ] NRT: Fetching primary data for 2025-09. [2025-09-17T20:44:04.230073] [INFO ] [REMOTE ] NRT: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T20:44:04.231697] [INFO ] [REMOTE ] NRT: Full fetch complete (8112 records). [2025-09-17T20:44:04.231787] [DEBUG] [VALIDATOR ] NRT: Validating primary data. [2025-09-17T20:44:04.421056] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-01. [2025-09-17T20:44:04.661694] [DEBUG] [VALIDATOR ] NRT: All expected trading days are present. [2025-09-17T20:44:04.661984] [DEBUG] [VALIDATOR ] NRT: Primary data validation passed. [2025-09-17T20:44:04.662319] [INFO ] [MAIN ] NRT: Fetched primary data is valid. [2025-09-17T20:44:04.670923] [DEBUG] [LOCAL ] NRT: Saving primary data. [2025-09-17T20:44:04.689065] [DEBUG] [LOCAL ] NRT: Trimmed 8112 records to 4936 (keeping 200 days of data) [2025-09-17T20:44:04.691705] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T20:44:04.732521] [DEBUG] [LOCAL ] NRT: Primary data saved (4936 records). [2025-09-17T20:44:04.732681] [INFO ] [MAIN ] NRT: Full history saved. [2025-09-17T20:44:04.732788] [INFO ] [MAIN ] Update Progress: 1533/2371 symbols completed. NRT took 29.7s. Estimated remaining: 2h 2m 28s. Rate: 6.8 symbols/min [2025-09-17T20:44:04.907273] [INFO ] [MAIN ] NSP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:44:04.948226] [DEBUG] [LOCAL ] NSP: Loaded 34941 existing records from primary storage. [2025-09-17T20:44:04.948388] [INFO ] [MAIN ] NSP: Loaded 34941 existing records. [2025-09-17T20:44:05.142768] [WARN ] [MAIN ] NSP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:44:05.143989] [INFO ] [MAIN ] NSP: Wiping existing primary data before full refresh. [2025-09-17T20:44:05.144042] [INFO ] [LOCAL ] NSP: Starting deletion of primary data. [2025-09-17T20:44:05.145476] [DEBUG] [LOCAL ] NSP: Deleted primary data file. [2025-09-17T20:44:05.145538] [INFO ] [MAIN ] NSP: Starting full primary refresh. [2025-09-17T20:44:05.220947] [INFO ] [REMOTE ] NSA: Fetching primary data for 2024-12. [2025-09-17T20:44:05.548291] [INFO ] [REMOTE ] NSP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:44:06.015808] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-11. [2025-09-17T20:44:06.304154] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T20:44:06.399341] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T20:44:06.815866] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-01. [2025-09-17T20:44:07.295543] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T20:44:07.615812] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-08. [2025-09-17T20:44:08.212401] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T20:44:08.262027] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T20:44:08.415884] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-02. [2025-09-17T20:44:09.215886] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-02. [2025-09-17T20:44:10.015856] [INFO ] [REMOTE ] NSP: Fetching primary data for 2024-12. [2025-09-17T20:44:10.176159] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T20:44:10.616157] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T20:44:10.815824] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-03. [2025-09-17T20:44:11.294087] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T20:44:11.615774] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-01. [2025-09-17T20:44:12.416060] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T20:44:12.416251] [INFO ] [REMOTE ] NRUC: Fetching primary data for 2025-09. [2025-09-17T20:44:12.984375] [INFO ] [REMOTE ] NRUC: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T20:44:12.985432] [INFO ] [REMOTE ] NRUC: Full fetch complete (5555 records). [2025-09-17T20:44:12.985503] [DEBUG] [VALIDATOR ] NRUC: Validating primary data. [2025-09-17T20:44:13.166654] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T20:44:13.220843] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-03. [2025-09-17T20:44:13.399772] [DEBUG] [VALIDATOR ] NRUC: All expected trading days are present. [2025-09-17T20:44:13.399906] [DEBUG] [VALIDATOR ] NRUC: Primary data validation passed. [2025-09-17T20:44:13.400098] [INFO ] [MAIN ] NRUC: Fetched primary data is valid. [2025-09-17T20:44:13.400139] [DEBUG] [LOCAL ] NRUC: Saving primary data. [2025-09-17T20:44:13.400563] [DEBUG] [LOCAL ] NRUC: Trimmed 5555 records to 3126 (keeping 200 days of data) [2025-09-17T20:44:13.422625] [DEBUG] [LOCAL ] NRUC: Primary data saved (3126 records). [2025-09-17T20:44:13.422811] [INFO ] [MAIN ] NRUC: Full history saved. [2025-09-17T20:44:13.422923] [INFO ] [MAIN ] Update Progress: 1534/2371 symbols completed. NRUC took 31.5s. Estimated remaining: 2h 2m 20s. Rate: 6.8 symbols/min [2025-09-17T20:44:13.614722] [INFO ] [MAIN ] NTB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:44:13.638068] [DEBUG] [LOCAL ] NTB: Loaded 20891 existing records from primary storage. [2025-09-17T20:44:13.638218] [INFO ] [MAIN ] NTB: Loaded 20891 existing records. [2025-09-17T20:44:13.817536] [WARN ] [MAIN ] NTB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:44:13.817827] [INFO ] [MAIN ] NTB: Wiping existing primary data before full refresh. [2025-09-17T20:44:13.817883] [INFO ] [LOCAL ] NTB: Starting deletion of primary data. [2025-09-17T20:44:13.818548] [DEBUG] [LOCAL ] NTB: Deleted primary data file. [2025-09-17T20:44:13.818596] [INFO ] [MAIN ] NTB: Starting full primary refresh. [2025-09-17T20:44:14.024994] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-02. [2025-09-17T20:44:14.176043] [INFO ] [REMOTE ] NTB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:44:14.815771] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-04. [2025-09-17T20:44:15.025990] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T20:44:15.566767] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T20:44:15.615757] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-04. [2025-09-17T20:44:16.185317] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T20:44:16.415808] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-11. [2025-09-17T20:44:17.215756] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-05. [2025-09-17T20:44:17.336862] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T20:44:17.608563] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T20:44:18.015793] [INFO ] [REMOTE ] NTB: Fetching primary data for 2024-12. [2025-09-17T20:44:18.704628] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T20:44:18.815756] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-03. [2025-09-17T20:44:18.873543] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T20:44:19.615765] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-05. [2025-09-17T20:44:20.331204] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T20:44:20.415820] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-04. [2025-09-17T20:44:21.215836] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-06. [2025-09-17T20:44:21.485614] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T20:44:21.883220] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T20:44:22.015775] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-05. [2025-09-17T20:44:22.815814] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-06. [2025-09-17T20:44:23.042148] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T20:44:23.502274] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T20:44:23.615792] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-07. [2025-09-17T20:44:24.256424] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T20:44:24.415783] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-07. [2025-09-17T20:44:25.215692] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-01. [2025-09-17T20:44:25.324302] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T20:44:26.015860] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-06. [2025-09-17T20:44:26.109375] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T20:44:26.452027] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T20:44:26.815803] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-02. [2025-09-17T20:44:27.520034] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T20:44:27.615737] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-08. [2025-09-17T20:44:28.021506] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T20:44:28.415821] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-08. [2025-09-17T20:44:29.215804] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-03. [2025-09-17T20:44:29.275253] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T20:44:30.015744] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-07. [2025-09-17T20:44:30.052361] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T20:44:30.250373] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T20:44:30.815816] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-04. [2025-09-17T20:44:31.509471] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T20:44:31.615730] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-08. [2025-09-17T20:44:32.038393] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T20:44:32.415778] [INFO ] [REMOTE ] NSC: Fetching primary data for 2025-09. [2025-09-17T20:44:33.184560] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T20:44:33.215746] [INFO ] [REMOTE ] NSP: Fetching primary data for 2025-09. [2025-09-17T20:44:33.246564] [INFO ] [REMOTE ] NSC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T20:44:33.252784] [INFO ] [REMOTE ] NSC: Full fetch complete (70268 records). [2025-09-17T20:44:33.252963] [DEBUG] [VALIDATOR ] NSC: Validating primary data. [2025-09-17T20:44:33.253733] [FATAL] [VALIDATOR ] NSC: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:44:33.253844] [FATAL] [MAIN ] NSC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:44:33.253883] [WARN ] [MAIN ] NSC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:44:33.253923] [INFO ] [LOCAL ] NSC: Starting deletion of primary data. [2025-09-17T20:44:33.253983] [DEBUG] [LOCAL ] NSC: No primary data file found to delete. [2025-09-17T20:44:33.254018] [INFO ] [LOCAL ] NSC: Starting deletion of derivative data. [2025-09-17T20:44:33.254302] [DEBUG] [LOCAL ] NSC: Deleted derivative data file. [2025-09-17T20:44:33.254390] [INFO ] [MAIN ] Update Progress: 1535/2371 symbols completed. NSC took 37.1s. Estimated remaining: 2h 2m 17s. Rate: 6.8 symbols/min [2025-09-17T20:44:33.434988] [INFO ] [MAIN ] NTEST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:44:33.435196] [DEBUG] [LOCAL ] NTEST: No existing data file found in primary storage. [2025-09-17T20:44:33.435237] [WARN ] [MAIN ] NTEST: No existing data found, performing full refresh instead. [2025-09-17T20:44:33.435405] [INFO ] [MAIN ] NTEST: Wiping existing primary data before full refresh. [2025-09-17T20:44:33.435447] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-17T20:44:33.435490] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-17T20:44:33.435523] [INFO ] [MAIN ] NTEST: Starting full primary refresh. [2025-09-17T20:44:33.802800] [INFO ] [REMOTE ] NTEST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:44:34.015854] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-05. [2025-09-17T20:44:34.616397] [INFO ] [REMOTE ] NSP: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T20:44:34.621332] [INFO ] [REMOTE ] NSP: Full fetch complete (49199 records). [2025-09-17T20:44:34.621430] [DEBUG] [VALIDATOR ] NSP: Validating primary data. [2025-09-17T20:44:34.817317] [INFO ] [REMOTE ] NSA: Fetching primary data for 2025-09. [2025-09-17T20:44:35.030876] [DEBUG] [VALIDATOR ] NSP: All expected trading days are present. [2025-09-17T20:44:35.031030] [DEBUG] [VALIDATOR ] NSP: Primary data validation passed. [2025-09-17T20:44:35.032170] [INFO ] [MAIN ] NSP: Fetched primary data is valid. [2025-09-17T20:44:35.032245] [DEBUG] [LOCAL ] NSP: Saving primary data. [2025-09-17T20:44:35.047846] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T20:44:35.052466] [DEBUG] [LOCAL ] NSP: Trimmed 49199 records to 34929 (keeping 200 days of data) [2025-09-17T20:44:35.297058] [DEBUG] [LOCAL ] NSP: Primary data saved (34929 records). [2025-09-17T20:44:35.297228] [INFO ] [MAIN ] NSP: Full history saved. [2025-09-17T20:44:35.297960] [INFO ] [MAIN ] Update Progress: 1536/2371 symbols completed. NSP took 30.6s. Estimated remaining: 2h 2m 4s. Rate: 6.8 symbols/min [2025-09-17T20:44:35.474115] [INFO ] [MAIN ] NTR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:44:35.528348] [DEBUG] [LOCAL ] NTR: Loaded 52624 existing records from primary storage. [2025-09-17T20:44:35.528505] [INFO ] [MAIN ] NTR: Loaded 52624 existing records. [2025-09-17T20:44:35.625001] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-06. [2025-09-17T20:44:35.707366] [WARN ] [MAIN ] NTR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:44:35.707610] [INFO ] [MAIN ] NTR: Wiping existing primary data before full refresh. [2025-09-17T20:44:35.707677] [INFO ] [LOCAL ] NTR: Starting deletion of primary data. [2025-09-17T20:44:35.708875] [DEBUG] [LOCAL ] NTR: Deleted primary data file. [2025-09-17T20:44:35.708927] [INFO ] [MAIN ] NTR: Starting full primary refresh. [2025-09-17T20:44:36.101759] [INFO ] [REMOTE ] NTR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:44:36.297398] [INFO ] [REMOTE ] NSA: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T20:44:36.303843] [INFO ] [REMOTE ] NSA: Full fetch complete (61332 records). [2025-09-17T20:44:36.303967] [DEBUG] [VALIDATOR ] NSA: Validating primary data. [2025-09-17T20:44:36.421001] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-11. [2025-09-17T20:44:36.704695] [DEBUG] [VALIDATOR ] NSA: All expected trading days are present. [2025-09-17T20:44:36.704905] [DEBUG] [VALIDATOR ] NSA: Primary data validation passed. [2025-09-17T20:44:36.705977] [INFO ] [MAIN ] NSA: Fetched primary data is valid. [2025-09-17T20:44:36.706040] [DEBUG] [LOCAL ] NSA: Saving primary data. [2025-09-17T20:44:36.718724] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T20:44:36.723679] [DEBUG] [LOCAL ] NSA: Trimmed 61332 records to 44818 (keeping 200 days of data) [2025-09-17T20:44:37.005983] [DEBUG] [LOCAL ] NSA: Primary data saved (44818 records). [2025-09-17T20:44:37.006178] [INFO ] [MAIN ] NSA: Full history saved. [2025-09-17T20:44:37.006287] [INFO ] [MAIN ] Update Progress: 1537/2371 symbols completed. NSA took 48.5s. Estimated remaining: 2h 1m 52s. Rate: 6.8 symbols/min [2025-09-17T20:44:37.177340] [INFO ] [MAIN ] NTST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:44:37.218207] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-11. [2025-09-17T20:44:37.220168] [DEBUG] [LOCAL ] NTST: Loaded 43393 existing records from primary storage. [2025-09-17T20:44:37.220401] [INFO ] [MAIN ] NTST: Loaded 43393 existing records. [2025-09-17T20:44:37.421754] [WARN ] [MAIN ] NTST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:44:37.422064] [INFO ] [MAIN ] NTST: Wiping existing primary data before full refresh. [2025-09-17T20:44:37.422112] [INFO ] [LOCAL ] NTST: Starting deletion of primary data. [2025-09-17T20:44:37.423015] [DEBUG] [LOCAL ] NTST: Deleted primary data file. [2025-09-17T20:44:37.423067] [INFO ] [MAIN ] NTST: Starting full primary refresh. [2025-09-17T20:44:37.824459] [INFO ] [REMOTE ] NTST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:44:37.946816] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T20:44:38.015839] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2024-12. [2025-09-17T20:44:38.426039] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-11 (2.01 seconds). [2025-09-17T20:44:38.575299] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T20:44:38.815853] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-07. [2025-09-17T20:44:39.615774] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-11. [2025-09-17T20:44:39.767905] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T20:44:40.415810] [INFO ] [REMOTE ] NTR: Fetching primary data for 2024-12. [2025-09-17T20:44:40.851401] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T20:44:41.215814] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-01. [2025-09-17T20:44:41.895997] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T20:44:41.982671] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T20:44:42.015790] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-02. [2025-09-17T20:44:42.634539] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T20:44:42.815789] [INFO ] [REMOTE ] NTST: Fetching primary data for 2024-12. [2025-09-17T20:44:43.615779] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-08. [2025-09-17T20:44:44.380244] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T20:44:44.415743] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-01. [2025-09-17T20:44:44.443482] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T20:44:45.215796] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-03. [2025-09-17T20:44:45.742900] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T20:44:45.969491] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T20:44:46.015760] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-02. [2025-09-17T20:44:46.815860] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-04. [2025-09-17T20:44:47.112738] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T20:44:47.331511] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T20:44:47.615770] [INFO ] [REMOTE ] NTB: Fetching primary data for 2025-09. [2025-09-17T20:44:48.415759] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-01. [2025-09-17T20:44:48.465027] [INFO ] [REMOTE ] NTB: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T20:44:48.467813] [INFO ] [REMOTE ] NTB: Full fetch complete (30830 records). [2025-09-17T20:44:48.467894] [DEBUG] [VALIDATOR ] NTB: Validating primary data. [2025-09-17T20:44:48.864994] [DEBUG] [VALIDATOR ] NTB: All expected trading days are present. [2025-09-17T20:44:48.865104] [DEBUG] [VALIDATOR ] NTB: Primary data validation passed. [2025-09-17T20:44:48.866000] [INFO ] [MAIN ] NTB: Fetched primary data is valid. [2025-09-17T20:44:48.866058] [DEBUG] [LOCAL ] NTB: Saving primary data. [2025-09-17T20:44:48.867025] [DEBUG] [LOCAL ] NTB: Trimmed 30830 records to 20852 (keeping 200 days of data) [2025-09-17T20:44:49.008794] [DEBUG] [LOCAL ] NTB: Primary data saved (20852 records). [2025-09-17T20:44:49.008995] [INFO ] [MAIN ] NTB: Full history saved. [2025-09-17T20:44:49.009103] [INFO ] [MAIN ] Update Progress: 1538/2371 symbols completed. NTB took 35.6s. Estimated remaining: 2h 1m 45s. Rate: 6.8 symbols/min [2025-09-17T20:44:49.193158] [INFO ] [MAIN ] NU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:44:49.230187] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-03. [2025-09-17T20:44:49.257105] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-17T20:44:49.257393] [INFO ] [MAIN ] NU: Loaded 53746 existing records. [2025-09-17T20:44:49.453723] [WARN ] [MAIN ] NU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:44:49.454101] [INFO ] [MAIN ] NU: Wiping existing primary data before full refresh. [2025-09-17T20:44:49.454165] [INFO ] [LOCAL ] NU: Starting deletion of primary data. [2025-09-17T20:44:49.455379] [DEBUG] [LOCAL ] NU: Deleted primary data file. [2025-09-17T20:44:49.455436] [INFO ] [MAIN ] NU: Starting full primary refresh. [2025-09-17T20:44:49.852783] [INFO ] [REMOTE ] NU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:44:50.015845] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-11. [2025-09-17T20:44:50.070880] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T20:44:50.642939] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T20:44:50.815835] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-05. [2025-09-17T20:44:51.533728] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T20:44:51.615823] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-06. [2025-09-17T20:44:52.323059] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T20:44:52.382511] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-11 (2.37 seconds). [2025-09-17T20:44:52.415739] [INFO ] [REMOTE ] NU: Fetching primary data for 2024-12. [2025-09-17T20:44:53.215776] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-02. [2025-09-17T20:44:54.015791] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-04. [2025-09-17T20:44:54.815792] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-07. [2025-09-17T20:44:54.931087] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-17T20:44:54.985772] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T20:44:55.395328] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T20:44:55.615773] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-01. [2025-09-17T20:44:55.657736] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T20:44:56.415788] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-08. [2025-09-17T20:44:57.018332] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T20:44:57.215766] [INFO ] [REMOTE ] NTEST: Fetching primary data for 2025-09. [2025-09-17T20:44:57.707313] [INFO ] [REMOTE ] NTEST: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T20:44:57.708036] [INFO ] [REMOTE ] NTEST: Full fetch complete (2021 records). [2025-09-17T20:44:57.708118] [DEBUG] [VALIDATOR ] NTEST: Validating primary data. [2025-09-17T20:44:57.890745] [WARN ] [VALIDATOR ] NTEST: Validation failed - insufficient historical data. Have 165 unique days, need 200 days [2025-09-17T20:44:57.890997] [FATAL] [MAIN ] NTEST: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:44:57.891063] [WARN ] [MAIN ] NTEST: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:44:57.891118] [INFO ] [LOCAL ] NTEST: Starting deletion of primary data. [2025-09-17T20:44:57.891235] [DEBUG] [LOCAL ] NTEST: No primary data file found to delete. [2025-09-17T20:44:57.891572] [INFO ] [LOCAL ] NTEST: Starting deletion of derivative data. [2025-09-17T20:44:57.891633] [DEBUG] [LOCAL ] NTEST: No derivative data file found to delete. [2025-09-17T20:44:57.891752] [INFO ] [MAIN ] Update Progress: 1539/2371 symbols completed. NTEST took 24.6s. Estimated remaining: 2h 1m 36s. Rate: 6.8 symbols/min [2025-09-17T20:44:58.017723] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-05. [2025-09-17T20:44:58.071953] [INFO ] [MAIN ] NUE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:44:58.073193] [DEBUG] [LOCAL ] NUE: No existing data file found in primary storage. [2025-09-17T20:44:58.073248] [WARN ] [MAIN ] NUE: No existing data found, performing full refresh instead. [2025-09-17T20:44:58.074124] [INFO ] [MAIN ] NUE: Wiping existing primary data before full refresh. [2025-09-17T20:44:58.074215] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-17T20:44:58.074265] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-17T20:44:58.074392] [INFO ] [MAIN ] NUE: Starting full primary refresh. [2025-09-17T20:44:58.252175] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-01 (2.64 seconds). [2025-09-17T20:44:58.519524] [INFO ] [REMOTE ] NUE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:44:58.815816] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-02. [2025-09-17T20:44:59.341187] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T20:44:59.615826] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-03. [2025-09-17T20:45:00.415805] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-06. [2025-09-17T20:45:00.927708] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-02 (2.11 seconds). [2025-09-17T20:45:01.215849] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-11. [2025-09-17T20:45:01.440218] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T20:45:02.015747] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-03. [2025-09-17T20:45:02.068312] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T20:45:02.815852] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-07. [2025-09-17T20:45:02.855671] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T20:45:03.615848] [INFO ] [REMOTE ] NUE: Fetching primary data for 2024-12. [2025-09-17T20:45:04.249289] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T20:45:04.415791] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-08. [2025-09-17T20:45:04.523558] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-17T20:45:05.215809] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-04. [2025-09-17T20:45:05.468085] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T20:45:06.015856] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-04. [2025-09-17T20:45:06.094199] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T20:45:06.815804] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-01. [2025-09-17T20:45:07.615883] [INFO ] [REMOTE ] NTST: Fetching primary data for 2025-09. [2025-09-17T20:45:07.769886] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T20:45:07.828192] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-04 (2.61 seconds). [2025-09-17T20:45:08.415856] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-05. [2025-09-17T20:45:08.833323] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-01 (2.02 seconds). [2025-09-17T20:45:09.118888] [INFO ] [REMOTE ] NTST: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T20:45:09.126576] [INFO ] [REMOTE ] NTST: Full fetch complete (60460 records). [2025-09-17T20:45:09.126916] [DEBUG] [VALIDATOR ] NTST: Validating primary data. [2025-09-17T20:45:09.221127] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-02. [2025-09-17T20:45:09.560940] [DEBUG] [VALIDATOR ] NTST: All expected trading days are present. [2025-09-17T20:45:09.561080] [DEBUG] [VALIDATOR ] NTST: Primary data validation passed. [2025-09-17T20:45:09.562443] [INFO ] [MAIN ] NTST: Fetched primary data is valid. [2025-09-17T20:45:09.562520] [DEBUG] [LOCAL ] NTST: Saving primary data. [2025-09-17T20:45:09.569412] [DEBUG] [LOCAL ] NTST: Trimmed 60460 records to 43391 (keeping 200 days of data) [2025-09-17T20:45:09.868063] [DEBUG] [LOCAL ] NTST: Primary data saved (43391 records). [2025-09-17T20:45:09.868270] [INFO ] [MAIN ] NTST: Full history saved. [2025-09-17T20:45:09.868443] [INFO ] [MAIN ] Update Progress: 1540/2371 symbols completed. NTST took 32.9s. Estimated remaining: 2h 1m 29s. Rate: 6.8 symbols/min [2025-09-17T20:45:10.022846] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-05. [2025-09-17T20:45:10.051355] [INFO ] [MAIN ] NUS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:45:10.090908] [DEBUG] [LOCAL ] NUS: Loaded 36492 existing records from primary storage. [2025-09-17T20:45:10.091134] [INFO ] [MAIN ] NUS: Loaded 36492 existing records. [2025-09-17T20:45:10.281138] [WARN ] [MAIN ] NUS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:45:10.281509] [INFO ] [MAIN ] NUS: Wiping existing primary data before full refresh. [2025-09-17T20:45:10.281562] [INFO ] [LOCAL ] NUS: Starting deletion of primary data. [2025-09-17T20:45:10.282618] [DEBUG] [LOCAL ] NUS: Deleted primary data file. [2025-09-17T20:45:10.282703] [INFO ] [MAIN ] NUS: Starting full primary refresh. [2025-09-17T20:45:10.709833] [INFO ] [REMOTE ] NUS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:45:10.824554] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-11. [2025-09-17T20:45:10.834687] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-17T20:45:11.381883] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-17T20:45:11.615758] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-03. [2025-09-17T20:45:11.725300] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T20:45:12.108594] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T20:45:12.415989] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-06. [2025-09-17T20:45:13.215849] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-06. [2025-09-17T20:45:13.835474] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-17T20:45:14.017856] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-04. [2025-09-17T20:45:14.020787] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T20:45:14.815836] [INFO ] [REMOTE ] NUS: Fetching primary data for 2024-12. [2025-09-17T20:45:15.535981] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-06 (2.32 seconds). [2025-09-17T20:45:15.615724] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-07. [2025-09-17T20:45:16.149178] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-17T20:45:16.205612] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T20:45:16.415780] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-05. [2025-09-17T20:45:17.215828] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-01. [2025-09-17T20:45:18.015800] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-07. [2025-09-17T20:45:18.064151] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-07 (2.45 seconds). [2025-09-17T20:45:18.506673] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T20:45:18.546482] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T20:45:18.815784] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-06. [2025-09-17T20:45:19.615773] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-08. [2025-09-17T20:45:19.797798] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T20:45:20.415768] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-08. [2025-09-17T20:45:20.877096] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-06 (2.06 seconds). [2025-09-17T20:45:21.215771] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-07. [2025-09-17T20:45:21.803193] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T20:45:21.952382] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T20:45:22.015736] [INFO ] [REMOTE ] NTR: Fetching primary data for 2025-09. [2025-09-17T20:45:22.815793] [INFO ] [REMOTE ] NU: Fetching primary data for 2025-09. [2025-09-17T20:45:23.447952] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T20:45:23.615774] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-08. [2025-09-17T20:45:24.005341] [INFO ] [REMOTE ] NTR: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-17T20:45:24.013136] [INFO ] [REMOTE ] NTR: Full fetch complete (76134 records). [2025-09-17T20:45:24.013266] [DEBUG] [VALIDATOR ] NTR: Validating primary data. [2025-09-17T20:45:24.417235] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-02. [2025-09-17T20:45:24.417466] [DEBUG] [VALIDATOR ] NTR: All expected trading days are present. [2025-09-17T20:45:24.418328] [DEBUG] [VALIDATOR ] NTR: Primary data validation passed. [2025-09-17T20:45:24.419465] [INFO ] [MAIN ] NTR: Fetched primary data is valid. [2025-09-17T20:45:24.419609] [DEBUG] [LOCAL ] NTR: Saving primary data. [2025-09-17T20:45:24.421409] [DEBUG] [LOCAL ] NTR: Trimmed 76134 records to 52625 (keeping 200 days of data) [2025-09-17T20:45:24.774219] [DEBUG] [LOCAL ] NTR: Primary data saved (52625 records). [2025-09-17T20:45:24.774379] [INFO ] [MAIN ] NTR: Full history saved. [2025-09-17T20:45:24.775559] [INFO ] [MAIN ] Update Progress: 1541/2371 symbols completed. NTR took 49.5s. Estimated remaining: 2h 1m 24s. Rate: 6.8 symbols/min [2025-09-17T20:45:24.951677] [INFO ] [MAIN ] NUV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:45:24.975840] [DEBUG] [LOCAL ] NUV: Loaded 23052 existing records from primary storage. [2025-09-17T20:45:24.975978] [INFO ] [MAIN ] NUV: Loaded 23052 existing records. [2025-09-17T20:45:25.168487] [WARN ] [MAIN ] NUV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:45:25.169037] [INFO ] [MAIN ] NUV: Wiping existing primary data before full refresh. [2025-09-17T20:45:25.169205] [INFO ] [LOCAL ] NUV: Starting deletion of primary data. [2025-09-17T20:45:25.169820] [DEBUG] [LOCAL ] NUV: Deleted primary data file. [2025-09-17T20:45:25.169876] [INFO ] [MAIN ] NUV: Starting full primary refresh. [2025-09-17T20:45:25.297027] [INFO ] [REMOTE ] NU: Incremental fetch complete for 2025-09 (2.48 seconds). [2025-09-17T20:45:25.354119] [INFO ] [REMOTE ] NU: Full fetch complete (77880 records). [2025-09-17T20:45:25.404013] [DEBUG] [VALIDATOR ] NU: Validating primary data. [2025-09-17T20:45:25.676416] [INFO ] [REMOTE ] NUV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:45:25.677469] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-11. [2025-09-17T20:45:25.922929] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-17T20:45:26.017796] [INFO ] [REMOTE ] NUE: Fetching primary data for 2025-09. [2025-09-17T20:45:26.039311] [DEBUG] [VALIDATOR ] NU: All expected trading days are present. [2025-09-17T20:45:26.039459] [DEBUG] [VALIDATOR ] NU: Primary data validation passed. [2025-09-17T20:45:26.040694] [INFO ] [MAIN ] NU: Fetched primary data is valid. [2025-09-17T20:45:26.041006] [DEBUG] [LOCAL ] NU: Saving primary data. [2025-09-17T20:45:26.054455] [DEBUG] [LOCAL ] NU: Trimmed 77880 records to 53746 (keeping 200 days of data) [2025-09-17T20:45:26.071532] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T20:45:26.410829] [DEBUG] [LOCAL ] NU: Primary data saved (53746 records). [2025-09-17T20:45:26.411014] [INFO ] [MAIN ] NU: Full history saved. [2025-09-17T20:45:26.411112] [INFO ] [MAIN ] Update Progress: 1542/2371 symbols completed. NU took 37.4s. Estimated remaining: 2h 1m 11s. Rate: 6.8 symbols/min [2025-09-17T20:45:26.587428] [INFO ] [MAIN ] NUVB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:45:26.606390] [INFO ] [REMOTE ] NUE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T20:45:26.612598] [INFO ] [REMOTE ] NUE: Full fetch complete (74352 records). [2025-09-17T20:45:26.612841] [DEBUG] [VALIDATOR ] NUE: Validating primary data. [2025-09-17T20:45:26.613734] [FATAL] [VALIDATOR ] NUE: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:45:26.613844] [FATAL] [MAIN ] NUE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:45:26.613882] [WARN ] [MAIN ] NUE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:45:26.613933] [INFO ] [LOCAL ] NUE: Starting deletion of primary data. [2025-09-17T20:45:26.614058] [DEBUG] [LOCAL ] NUE: No primary data file found to delete. [2025-09-17T20:45:26.614119] [INFO ] [LOCAL ] NUE: Starting deletion of derivative data. [2025-09-17T20:45:26.614188] [DEBUG] [LOCAL ] NUE: No derivative data file found to delete. [2025-09-17T20:45:26.614280] [INFO ] [MAIN ] Update Progress: 1543/2371 symbols completed. NUE took 28.7s. Estimated remaining: 2h 0m 58s. Rate: 6.8 symbols/min [2025-09-17T20:45:26.816569] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-03. [2025-09-17T20:45:26.820391] [INFO ] [MAIN ] NUW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:45:26.841830] [DEBUG] [LOCAL ] NUVB: Loaded 51136 existing records from primary storage. [2025-09-17T20:45:26.842069] [INFO ] [MAIN ] NUVB: Loaded 51136 existing records. [2025-09-17T20:45:26.928951] [DEBUG] [LOCAL ] NUW: Loaded 7444 existing records from primary storage. [2025-09-17T20:45:26.947253] [INFO ] [MAIN ] NUW: Loaded 7444 existing records. [2025-09-17T20:45:27.127508] [WARN ] [MAIN ] NUVB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:45:27.165267] [INFO ] [MAIN ] NUVB: Wiping existing primary data before full refresh. [2025-09-17T20:45:27.165605] [INFO ] [LOCAL ] NUVB: Starting deletion of primary data. [2025-09-17T20:45:27.237091] [DEBUG] [LOCAL ] NUVB: Deleted primary data file. [2025-09-17T20:45:27.264329] [INFO ] [MAIN ] NUVB: Starting full primary refresh. [2025-09-17T20:45:27.271780] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T20:45:27.270665] [WARN ] [MAIN ] NUW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:45:27.311445] [INFO ] [MAIN ] NUW: Wiping existing primary data before full refresh. [2025-09-17T20:45:27.325252] [INFO ] [LOCAL ] NUW: Starting deletion of primary data. [2025-09-17T20:45:27.359785] [DEBUG] [LOCAL ] NUW: Deleted primary data file. [2025-09-17T20:45:27.376199] [INFO ] [MAIN ] NUW: Starting full primary refresh. [2025-09-17T20:45:27.628143] [INFO ] [REMOTE ] NUV: Fetching primary data for 2024-12. [2025-09-17T20:45:28.044657] [INFO ] [REMOTE ] NUVB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:45:28.064688] [INFO ] [REMOTE ] NUW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:45:28.319851] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T20:45:28.415745] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-04. [2025-09-17T20:45:29.155932] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T20:45:29.215737] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-01. [2025-09-17T20:45:30.015745] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-11. [2025-09-17T20:45:30.236733] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T20:45:30.823087] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-05. [2025-09-17T20:45:30.827317] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T20:45:30.878704] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T20:45:31.615816] [INFO ] [REMOTE ] NUW: Fetching primary data for 2024-12. [2025-09-17T20:45:32.383347] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2024-12 (0.77 seconds). [2025-09-17T20:45:32.415727] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-02. [2025-09-17T20:45:32.526300] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T20:45:33.185728] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T20:45:33.215751] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-03. [2025-09-17T20:45:34.015804] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-11. [2025-09-17T20:45:34.327569] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T20:45:34.815827] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-06. [2025-09-17T20:45:35.586927] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T20:45:35.615745] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2024-12. [2025-09-17T20:45:36.415853] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-01. [2025-09-17T20:45:36.495204] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T20:45:36.928176] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T20:45:37.215778] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-07. [2025-09-17T20:45:37.541687] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T20:45:38.015790] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-01. [2025-09-17T20:45:38.414932] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T20:45:38.815822] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-04. [2025-09-17T20:45:39.615823] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-02. [2025-09-17T20:45:39.717238] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T20:45:40.150125] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T20:45:40.166575] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T20:45:40.415821] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-05. [2025-09-17T20:45:41.215781] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-02. [2025-09-17T20:45:41.853079] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T20:45:42.015776] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-03. [2025-09-17T20:45:42.756322] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T20:45:42.815783] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-08. [2025-09-17T20:45:42.887631] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T20:45:43.615789] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-04. [2025-09-17T20:45:44.415783] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-06. [2025-09-17T20:45:44.461512] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T20:45:44.504993] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T20:45:45.215903] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-05. [2025-09-17T20:45:45.700797] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T20:45:46.015828] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-07. [2025-09-17T20:45:46.061779] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T20:45:46.815803] [INFO ] [REMOTE ] NUS: Fetching primary data for 2025-09. [2025-09-17T20:45:47.405595] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T20:45:47.615825] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-06. [2025-09-17T20:45:48.161063] [INFO ] [REMOTE ] NUS: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T20:45:48.165582] [INFO ] [REMOTE ] NUS: Full fetch complete (53825 records). [2025-09-17T20:45:48.165707] [DEBUG] [VALIDATOR ] NUS: Validating primary data. [2025-09-17T20:45:48.427463] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-03. [2025-09-17T20:45:48.485599] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T20:45:48.574620] [DEBUG] [VALIDATOR ] NUS: All expected trading days are present. [2025-09-17T20:45:48.574729] [DEBUG] [VALIDATOR ] NUS: Primary data validation passed. [2025-09-17T20:45:48.575703] [INFO ] [MAIN ] NUS: Fetched primary data is valid. [2025-09-17T20:45:48.575759] [DEBUG] [LOCAL ] NUS: Saving primary data. [2025-09-17T20:45:48.577054] [DEBUG] [LOCAL ] NUS: Trimmed 53825 records to 36439 (keeping 200 days of data) [2025-09-17T20:45:48.799995] [DEBUG] [LOCAL ] NUS: Primary data saved (36439 records). [2025-09-17T20:45:48.800134] [INFO ] [MAIN ] NUS: Full history saved. [2025-09-17T20:45:48.800217] [INFO ] [MAIN ] Update Progress: 1544/2371 symbols completed. NUS took 38.9s. Estimated remaining: 2h 0m 56s. Rate: 6.8 symbols/min [2025-09-17T20:45:48.978187] [INFO ] [MAIN ] NVG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:45:49.010463] [DEBUG] [LOCAL ] NVG: Loaded 27231 existing records from primary storage. [2025-09-17T20:45:49.010608] [INFO ] [MAIN ] NVG: Loaded 27231 existing records. [2025-09-17T20:45:49.190719] [WARN ] [MAIN ] NVG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:45:49.191056] [INFO ] [MAIN ] NVG: Wiping existing primary data before full refresh. [2025-09-17T20:45:49.191106] [INFO ] [LOCAL ] NVG: Starting deletion of primary data. [2025-09-17T20:45:49.191954] [DEBUG] [LOCAL ] NVG: Deleted primary data file. [2025-09-17T20:45:49.192014] [INFO ] [MAIN ] NVG: Starting full primary refresh. [2025-09-17T20:45:49.223535] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-08. [2025-09-17T20:45:49.564501] [INFO ] [REMOTE ] NVG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:45:50.015776] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-11. [2025-09-17T20:45:50.412696] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T20:45:50.769876] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T20:45:50.815806] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-07. [2025-09-17T20:45:51.016002] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T20:45:51.519232] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-07 (0.70 seconds). [2025-09-17T20:45:51.615778] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-04. [2025-09-17T20:45:52.415791] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-08. [2025-09-17T20:45:53.215855] [INFO ] [REMOTE ] NUV: Fetching primary data for 2025-09. [2025-09-17T20:45:53.334015] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T20:45:53.706904] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T20:45:54.015788] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-05. [2025-09-17T20:45:54.327989] [INFO ] [REMOTE ] NUV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T20:45:54.331285] [INFO ] [REMOTE ] NUV: Full fetch complete (34361 records). [2025-09-17T20:45:54.331414] [DEBUG] [VALIDATOR ] NUV: Validating primary data. [2025-09-17T20:45:54.718002] [DEBUG] [VALIDATOR ] NUV: All expected trading days are present. [2025-09-17T20:45:54.718169] [DEBUG] [VALIDATOR ] NUV: Primary data validation passed. [2025-09-17T20:45:54.719060] [INFO ] [MAIN ] NUV: Fetched primary data is valid. [2025-09-17T20:45:54.719143] [DEBUG] [LOCAL ] NUV: Saving primary data. [2025-09-17T20:45:54.720179] [DEBUG] [LOCAL ] NUV: Trimmed 34361 records to 23086 (keeping 200 days of data) [2025-09-17T20:45:54.815807] [INFO ] [REMOTE ] NUW: Fetching primary data for 2025-09. [2025-09-17T20:45:54.863357] [DEBUG] [LOCAL ] NUV: Primary data saved (23086 records). [2025-09-17T20:45:54.863510] [INFO ] [MAIN ] NUV: Full history saved. [2025-09-17T20:45:54.863660] [INFO ] [MAIN ] Update Progress: 1545/2371 symbols completed. NUV took 30.1s. Estimated remaining: 2h 0m 46s. Rate: 6.8 symbols/min [2025-09-17T20:45:55.035533] [INFO ] [MAIN ] NVGS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:45:55.070762] [DEBUG] [LOCAL ] NVGS: Loaded 31402 existing records from primary storage. [2025-09-17T20:45:55.070909] [INFO ] [MAIN ] NVGS: Loaded 31402 existing records. [2025-09-17T20:45:55.257877] [WARN ] [MAIN ] NVGS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:45:55.258163] [INFO ] [MAIN ] NVGS: Wiping existing primary data before full refresh. [2025-09-17T20:45:55.258210] [INFO ] [LOCAL ] NVGS: Starting deletion of primary data. [2025-09-17T20:45:55.258914] [DEBUG] [LOCAL ] NVGS: Deleted primary data file. [2025-09-17T20:45:55.258970] [INFO ] [MAIN ] NVGS: Starting full primary refresh. [2025-09-17T20:45:55.620499] [INFO ] [REMOTE ] NVGS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:45:55.617428] [INFO ] [REMOTE ] NVG: Fetching primary data for 2024-12. [2025-09-17T20:45:55.626863] [INFO ] [REMOTE ] NUW: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T20:45:55.628627] [INFO ] [REMOTE ] NUW: Full fetch complete (11836 records). [2025-09-17T20:45:55.628772] [DEBUG] [VALIDATOR ] NUW: Validating primary data. [2025-09-17T20:45:56.029342] [DEBUG] [VALIDATOR ] NUW: All expected trading days are present. [2025-09-17T20:45:56.029454] [DEBUG] [VALIDATOR ] NUW: Primary data validation passed. [2025-09-17T20:45:56.029800] [INFO ] [MAIN ] NUW: Fetched primary data is valid. [2025-09-17T20:45:56.029865] [DEBUG] [LOCAL ] NUW: Saving primary data. [2025-09-17T20:45:56.033394] [DEBUG] [LOCAL ] NUW: Trimmed 11836 records to 7511 (keeping 200 days of data) [2025-09-17T20:45:56.035674] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T20:45:56.094401] [DEBUG] [LOCAL ] NUW: Primary data saved (7511 records). [2025-09-17T20:45:56.094558] [INFO ] [MAIN ] NUW: Full history saved. [2025-09-17T20:45:56.094687] [INFO ] [MAIN ] Update Progress: 1546/2371 symbols completed. NUW took 29.5s. Estimated remaining: 2h 0m 33s. Rate: 6.8 symbols/min [2025-09-17T20:45:56.265251] [INFO ] [MAIN ] NVO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:45:56.322396] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-17T20:45:56.322551] [INFO ] [MAIN ] NVO: Loaded 53784 existing records. [2025-09-17T20:45:56.420873] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-06. [2025-09-17T20:45:56.501998] [WARN ] [MAIN ] NVO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:45:56.502229] [INFO ] [MAIN ] NVO: Wiping existing primary data before full refresh. [2025-09-17T20:45:56.502273] [INFO ] [LOCAL ] NVO: Starting deletion of primary data. [2025-09-17T20:45:56.503325] [DEBUG] [LOCAL ] NVO: Deleted primary data file. [2025-09-17T20:45:56.503384] [INFO ] [MAIN ] NVO: Starting full primary refresh. [2025-09-17T20:45:56.874714] [INFO ] [REMOTE ] NVO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:45:56.895123] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T20:45:57.215791] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-11. [2025-09-17T20:45:58.015785] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-01. [2025-09-17T20:45:58.420929] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-06 (2.00 seconds). [2025-09-17T20:45:58.815764] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-07. [2025-09-17T20:45:59.120889] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T20:45:59.501403] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-11 (2.29 seconds). [2025-09-17T20:45:59.615793] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-02. [2025-09-17T20:46:00.415988] [INFO ] [REMOTE ] NVO: Fetching primary data for 2024-12. [2025-09-17T20:46:00.507177] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T20:46:00.989081] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T20:46:01.215816] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-11. [2025-09-17T20:46:02.015796] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-08. [2025-09-17T20:46:02.323004] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T20:46:02.815786] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-03. [2025-09-17T20:46:03.044794] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2024-12 (2.63 seconds). [2025-09-17T20:46:03.615777] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-01. [2025-09-17T20:46:03.914360] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T20:46:04.018271] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T20:46:04.415834] [INFO ] [REMOTE ] NUVB: Fetching primary data for 2025-09. [2025-09-17T20:46:05.215785] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-04. [2025-09-17T20:46:05.991440] [INFO ] [REMOTE ] NUVB: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T20:46:05.998793] [INFO ] [REMOTE ] NUVB: Full fetch complete (72181 records). [2025-09-17T20:46:05.998966] [DEBUG] [VALIDATOR ] NUVB: Validating primary data. [2025-09-17T20:46:06.021631] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2024-12. [2025-09-17T20:46:06.416412] [DEBUG] [VALIDATOR ] NUVB: All expected trading days are present. [2025-09-17T20:46:06.416511] [DEBUG] [VALIDATOR ] NUVB: Primary data validation passed. [2025-09-17T20:46:06.417593] [INFO ] [MAIN ] NUVB: Fetched primary data is valid. [2025-09-17T20:46:06.417701] [DEBUG] [LOCAL ] NUVB: Saving primary data. [2025-09-17T20:46:06.419368] [DEBUG] [LOCAL ] NUVB: Trimmed 72181 records to 51183 (keeping 200 days of data) [2025-09-17T20:46:06.537052] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-01 (2.92 seconds). [2025-09-17T20:46:06.731293] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T20:46:06.819069] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-05. [2025-09-17T20:46:06.819334] [DEBUG] [LOCAL ] NUVB: Primary data saved (51183 records). [2025-09-17T20:46:06.820591] [INFO ] [MAIN ] NUVB: Full history saved. [2025-09-17T20:46:06.820782] [INFO ] [MAIN ] Update Progress: 1547/2371 symbols completed. NUVB took 40.4s. Estimated remaining: 2h 0m 25s. Rate: 6.8 symbols/min [2025-09-17T20:46:07.003038] [INFO ] [MAIN ] NVR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:46:07.026329] [DEBUG] [LOCAL ] NVR: Loaded 19506 existing records from primary storage. [2025-09-17T20:46:07.026484] [INFO ] [MAIN ] NVR: Loaded 19506 existing records. [2025-09-17T20:46:07.219877] [WARN ] [MAIN ] NVR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:46:07.220274] [INFO ] [MAIN ] NVR: Wiping existing primary data before full refresh. [2025-09-17T20:46:07.220340] [INFO ] [LOCAL ] NVR: Starting deletion of primary data. [2025-09-17T20:46:07.236093] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T20:46:07.236163] [DEBUG] [LOCAL ] NVR: Deleted primary data file. [2025-09-17T20:46:07.236355] [INFO ] [MAIN ] NVR: Starting full primary refresh. [2025-09-17T20:46:07.609353] [INFO ] [REMOTE ] NVR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:46:07.615735] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-11. [2025-09-17T20:46:07.839609] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T20:46:08.415760] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-01. [2025-09-17T20:46:08.769978] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T20:46:09.215818] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-02. [2025-09-17T20:46:09.370151] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T20:46:10.015827] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-06. [2025-09-17T20:46:10.815793] [INFO ] [REMOTE ] NVR: Fetching primary data for 2024-12. [2025-09-17T20:46:11.290799] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T20:46:11.615690] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-02. [2025-09-17T20:46:11.730734] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-02 (2.51 seconds). [2025-09-17T20:46:11.901459] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T20:46:12.415779] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-01. [2025-09-17T20:46:12.851191] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T20:46:13.215820] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-03. [2025-09-17T20:46:13.332249] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T20:46:14.015825] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-03. [2025-09-17T20:46:14.815816] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-02. [2025-09-17T20:46:15.162025] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T20:46:15.615810] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-07. [2025-09-17T20:46:15.617879] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T20:46:15.951559] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-03 (2.74 seconds). [2025-09-17T20:46:16.415839] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-04. [2025-09-17T20:46:16.645491] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T20:46:17.215800] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-03. [2025-09-17T20:46:17.901290] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T20:46:18.015806] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-08. [2025-09-17T20:46:18.439862] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T20:46:18.815773] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-05. [2025-09-17T20:46:19.314898] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-08 (1.30 seconds). [2025-09-17T20:46:19.615779] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-04. [2025-09-17T20:46:19.867006] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T20:46:20.415824] [INFO ] [REMOTE ] NVG: Fetching primary data for 2025-09. [2025-09-17T20:46:20.693949] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T20:46:21.215820] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-06. [2025-09-17T20:46:21.472969] [INFO ] [REMOTE ] NVG: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T20:46:21.479525] [INFO ] [REMOTE ] NVG: Full fetch complete (40682 records). [2025-09-17T20:46:21.479732] [DEBUG] [VALIDATOR ] NVG: Validating primary data. [2025-09-17T20:46:21.909510] [DEBUG] [VALIDATOR ] NVG: All expected trading days are present. [2025-09-17T20:46:21.909747] [DEBUG] [VALIDATOR ] NVG: Primary data validation passed. [2025-09-17T20:46:21.910598] [INFO ] [MAIN ] NVG: Fetched primary data is valid. [2025-09-17T20:46:21.910663] [DEBUG] [LOCAL ] NVG: Saving primary data. [2025-09-17T20:46:21.911888] [DEBUG] [LOCAL ] NVG: Trimmed 40682 records to 27231 (keeping 200 days of data) [2025-09-17T20:46:22.015849] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-04. [2025-09-17T20:46:22.102332] [DEBUG] [LOCAL ] NVG: Primary data saved (27231 records). [2025-09-17T20:46:22.102542] [INFO ] [MAIN ] NVG: Full history saved. [2025-09-17T20:46:22.102696] [INFO ] [MAIN ] Update Progress: 1548/2371 symbols completed. NVG took 33.3s. Estimated remaining: 2h 0m 20s. Rate: 6.8 symbols/min [2025-09-17T20:46:22.292535] [INFO ] [MAIN ] NVRI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:46:22.331717] [DEBUG] [LOCAL ] NVRI: Loaded 38963 existing records from primary storage. [2025-09-17T20:46:22.331872] [INFO ] [MAIN ] NVRI: Loaded 38963 existing records. [2025-09-17T20:46:22.541214] [WARN ] [MAIN ] NVRI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:46:22.541588] [INFO ] [MAIN ] NVRI: Wiping existing primary data before full refresh. [2025-09-17T20:46:22.541658] [INFO ] [LOCAL ] NVRI: Starting deletion of primary data. [2025-09-17T20:46:22.542488] [DEBUG] [LOCAL ] NVRI: Deleted primary data file. [2025-09-17T20:46:22.542538] [INFO ] [MAIN ] NVRI: Starting full primary refresh. [2025-09-17T20:46:22.816212] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-05. [2025-09-17T20:46:22.948250] [INFO ] [REMOTE ] NVRI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:46:22.963444] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T20:46:23.616941] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-07. [2025-09-17T20:46:23.621475] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T20:46:24.415874] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-11. [2025-09-17T20:46:24.827435] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-04 (2.81 seconds). [2025-09-17T20:46:24.955102] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T20:46:25.215804] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-05. [2025-09-17T20:46:25.549042] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T20:46:26.015822] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-08. [2025-09-17T20:46:26.815787] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-06. [2025-09-17T20:46:27.368428] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T20:46:27.616511] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2024-12. [2025-09-17T20:46:27.622758] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-05 (2.41 seconds). [2025-09-17T20:46:27.821355] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T20:46:28.415787] [INFO ] [REMOTE ] NVGS: Fetching primary data for 2025-09. [2025-09-17T20:46:29.157862] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T20:46:29.215762] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-01. [2025-09-17T20:46:29.331351] [INFO ] [REMOTE ] NVGS: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T20:46:29.334935] [INFO ] [REMOTE ] NVGS: Full fetch complete (41512 records). [2025-09-17T20:46:29.335051] [DEBUG] [VALIDATOR ] NVGS: Validating primary data. [2025-09-17T20:46:29.724275] [DEBUG] [VALIDATOR ] NVGS: All expected trading days are present. [2025-09-17T20:46:29.724376] [DEBUG] [VALIDATOR ] NVGS: Primary data validation passed. [2025-09-17T20:46:29.725303] [INFO ] [MAIN ] NVGS: Fetched primary data is valid. [2025-09-17T20:46:29.725354] [DEBUG] [LOCAL ] NVGS: Saving primary data. [2025-09-17T20:46:29.726742] [DEBUG] [LOCAL ] NVGS: Trimmed 41512 records to 31383 (keeping 200 days of data) [2025-09-17T20:46:29.927499] [DEBUG] [LOCAL ] NVGS: Primary data saved (31383 records). [2025-09-17T20:46:29.927655] [INFO ] [MAIN ] NVGS: Full history saved. [2025-09-17T20:46:29.928606] [INFO ] [MAIN ] Update Progress: 1549/2371 symbols completed. NVGS took 35.1s. Estimated remaining: 2h 0m 11s. Rate: 6.8 symbols/min [2025-09-17T20:46:30.022069] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-06. [2025-09-17T20:46:30.106351] [INFO ] [MAIN ] NVS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:46:30.161086] [DEBUG] [LOCAL ] NVS: Loaded 51723 existing records from primary storage. [2025-09-17T20:46:30.161258] [INFO ] [MAIN ] NVS: Loaded 51723 existing records. [2025-09-17T20:46:30.347854] [WARN ] [MAIN ] NVS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:46:30.348235] [INFO ] [MAIN ] NVS: Wiping existing primary data before full refresh. [2025-09-17T20:46:30.348382] [INFO ] [LOCAL ] NVS: Starting deletion of primary data. [2025-09-17T20:46:30.349585] [DEBUG] [LOCAL ] NVS: Deleted primary data file. [2025-09-17T20:46:30.349674] [INFO ] [MAIN ] NVS: Starting full primary refresh. [2025-09-17T20:46:30.631845] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T20:46:30.752714] [INFO ] [REMOTE ] NVS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:46:30.815757] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-02. [2025-09-17T20:46:31.615769] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-07. [2025-09-17T20:46:32.013478] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T20:46:32.415802] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-11. [2025-09-17T20:46:32.709228] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-17T20:46:32.753546] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T20:46:33.215787] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-07. [2025-09-17T20:46:33.994474] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T20:46:34.015721] [INFO ] [REMOTE ] NVS: Fetching primary data for 2024-12. [2025-09-17T20:46:34.815781] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-03. [2025-09-17T20:46:35.615844] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-08. [2025-09-17T20:46:35.825407] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-17T20:46:35.878718] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T20:46:36.415802] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-08. [2025-09-17T20:46:36.504056] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T20:46:36.699453] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T20:46:37.215837] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-01. [2025-09-17T20:46:38.015799] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-04. [2025-09-17T20:46:38.815800] [INFO ] [REMOTE ] NVR: Fetching primary data for 2025-09. [2025-09-17T20:46:39.069839] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T20:46:39.194735] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-17T20:46:39.615831] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-02. [2025-09-17T20:46:39.649575] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T20:46:39.806418] [INFO ] [REMOTE ] NVR: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T20:46:39.809622] [INFO ] [REMOTE ] NVR: Full fetch complete (29756 records). [2025-09-17T20:46:39.809837] [DEBUG] [VALIDATOR ] NVR: Validating primary data. [2025-09-17T20:46:40.211835] [DEBUG] [VALIDATOR ] NVR: All expected trading days are present. [2025-09-17T20:46:40.211935] [DEBUG] [VALIDATOR ] NVR: Primary data validation passed. [2025-09-17T20:46:40.212612] [INFO ] [MAIN ] NVR: Fetched primary data is valid. [2025-09-17T20:46:40.212677] [DEBUG] [LOCAL ] NVR: Saving primary data. [2025-09-17T20:46:40.213675] [DEBUG] [LOCAL ] NVR: Trimmed 29756 records to 19535 (keeping 200 days of data) [2025-09-17T20:46:40.340769] [DEBUG] [LOCAL ] NVR: Primary data saved (19535 records). [2025-09-17T20:46:40.340940] [INFO ] [MAIN ] NVR: Full history saved. [2025-09-17T20:46:40.341036] [INFO ] [MAIN ] Update Progress: 1550/2371 symbols completed. NVR took 33.5s. Estimated remaining: 2h 0m 3s. Rate: 6.8 symbols/min [2025-09-17T20:46:40.426704] [INFO ] [REMOTE ] NVO: Fetching primary data for 2025-09. [2025-09-17T20:46:40.554474] [INFO ] [MAIN ] NVST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:46:40.605757] [DEBUG] [LOCAL ] NVST: Loaded 51696 existing records from primary storage. [2025-09-17T20:46:40.605931] [INFO ] [MAIN ] NVST: Loaded 51696 existing records. [2025-09-17T20:46:40.790664] [WARN ] [MAIN ] NVST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:46:40.790959] [INFO ] [MAIN ] NVST: Wiping existing primary data before full refresh. [2025-09-17T20:46:40.791004] [INFO ] [LOCAL ] NVST: Starting deletion of primary data. [2025-09-17T20:46:40.791991] [DEBUG] [LOCAL ] NVST: Deleted primary data file. [2025-09-17T20:46:40.792042] [INFO ] [MAIN ] NVST: Starting full primary refresh. [2025-09-17T20:46:41.192553] [INFO ] [REMOTE ] NVST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:46:41.215709] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-05. [2025-09-17T20:46:41.264557] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T20:46:42.015837] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-11. [2025-09-17T20:46:42.272235] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T20:46:42.815801] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-06. [2025-09-17T20:46:43.018567] [INFO ] [REMOTE ] NVO: Incremental fetch complete for 2025-09 (2.59 seconds). [2025-09-17T20:46:43.025583] [INFO ] [REMOTE ] NVO: Full fetch complete (77914 records). [2025-09-17T20:46:43.025778] [DEBUG] [VALIDATOR ] NVO: Validating primary data. [2025-09-17T20:46:43.438769] [DEBUG] [VALIDATOR ] NVO: All expected trading days are present. [2025-09-17T20:46:43.438891] [DEBUG] [VALIDATOR ] NVO: Primary data validation passed. [2025-09-17T20:46:43.440359] [INFO ] [MAIN ] NVO: Fetched primary data is valid. [2025-09-17T20:46:43.440436] [DEBUG] [LOCAL ] NVO: Saving primary data. [2025-09-17T20:46:43.442512] [DEBUG] [LOCAL ] NVO: Trimmed 77914 records to 53784 (keeping 200 days of data) [2025-09-17T20:46:43.630898] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-03. [2025-09-17T20:46:43.786934] [DEBUG] [LOCAL ] NVO: Primary data saved (53784 records). [2025-09-17T20:46:43.787125] [INFO ] [MAIN ] NVO: Full history saved. [2025-09-17T20:46:43.787248] [INFO ] [MAIN ] Update Progress: 1551/2371 symbols completed. NVO took 47.7s. Estimated remaining: 1h 59m 51s. Rate: 6.8 symbols/min [2025-09-17T20:46:43.962457] [INFO ] [MAIN ] NVT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:46:43.992397] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-17T20:46:44.046319] [DEBUG] [LOCAL ] NVT: Loaded 51625 existing records from primary storage. [2025-09-17T20:46:44.046472] [INFO ] [MAIN ] NVT: Loaded 51625 existing records. [2025-09-17T20:46:44.230808] [WARN ] [MAIN ] NVT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:46:44.231093] [INFO ] [MAIN ] NVT: Wiping existing primary data before full refresh. [2025-09-17T20:46:44.231140] [INFO ] [LOCAL ] NVT: Starting deletion of primary data. [2025-09-17T20:46:44.232050] [DEBUG] [LOCAL ] NVT: Deleted primary data file. [2025-09-17T20:46:44.232101] [INFO ] [MAIN ] NVT: Starting full primary refresh. [2025-09-17T20:46:44.422503] [INFO ] [REMOTE ] NVST: Fetching primary data for 2024-12. [2025-09-17T20:46:44.602712] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T20:46:44.636060] [INFO ] [REMOTE ] NVT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:46:45.215749] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-07. [2025-09-17T20:46:45.478520] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T20:46:45.968896] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T20:46:46.015749] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-01. [2025-09-17T20:46:46.666986] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T20:46:46.815770] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-08. [2025-09-17T20:46:47.434715] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T20:46:47.615790] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-11. [2025-09-17T20:46:48.426713] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-02. [2025-09-17T20:46:48.429992] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T20:46:49.215761] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-04. [2025-09-17T20:46:49.257390] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T20:46:50.015783] [INFO ] [REMOTE ] NVT: Fetching primary data for 2024-12. [2025-09-17T20:46:50.210892] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T20:46:50.815784] [INFO ] [REMOTE ] NVRI: Fetching primary data for 2025-09. [2025-09-17T20:46:51.258983] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T20:46:51.515419] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T20:46:51.615802] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-03. [2025-09-17T20:46:52.059581] [INFO ] [REMOTE ] NVRI: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T20:46:52.065709] [INFO ] [REMOTE ] NVRI: Full fetch complete (55756 records). [2025-09-17T20:46:52.065849] [DEBUG] [VALIDATOR ] NVRI: Validating primary data. [2025-09-17T20:46:52.420874] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-01. [2025-09-17T20:46:52.485126] [DEBUG] [VALIDATOR ] NVRI: All expected trading days are present. [2025-09-17T20:46:52.485258] [DEBUG] [VALIDATOR ] NVRI: Primary data validation passed. [2025-09-17T20:46:52.486692] [INFO ] [MAIN ] NVRI: Fetched primary data is valid. [2025-09-17T20:46:52.486755] [DEBUG] [LOCAL ] NVRI: Saving primary data. [2025-09-17T20:46:52.488698] [DEBUG] [LOCAL ] NVRI: Trimmed 55756 records to 38957 (keeping 200 days of data) [2025-09-17T20:46:52.723193] [DEBUG] [LOCAL ] NVRI: Primary data saved (38957 records). [2025-09-17T20:46:52.723350] [INFO ] [MAIN ] NVRI: Full history saved. [2025-09-17T20:46:52.723450] [INFO ] [MAIN ] Update Progress: 1552/2371 symbols completed. NVRI took 30.6s. Estimated remaining: 1h 59m 43s. Rate: 6.8 symbols/min [2025-09-17T20:46:52.894193] [INFO ] [MAIN ] NWG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:46:52.945892] [DEBUG] [LOCAL ] NWG: Loaded 51721 existing records from primary storage. [2025-09-17T20:46:52.946072] [INFO ] [MAIN ] NWG: Loaded 51721 existing records. [2025-09-17T20:46:53.124836] [WARN ] [MAIN ] NWG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:46:53.125107] [INFO ] [MAIN ] NWG: Wiping existing primary data before full refresh. [2025-09-17T20:46:53.125156] [INFO ] [LOCAL ] NWG: Starting deletion of primary data. [2025-09-17T20:46:53.126124] [DEBUG] [LOCAL ] NWG: Deleted primary data file. [2025-09-17T20:46:53.126217] [INFO ] [MAIN ] NWG: Starting full primary refresh. [2025-09-17T20:46:53.219454] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-05. [2025-09-17T20:46:53.453965] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T20:46:53.543472] [INFO ] [REMOTE ] NWG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:46:54.000495] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T20:46:54.015715] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-02. [2025-09-17T20:46:54.815759] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-11. [2025-09-17T20:46:54.884750] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T20:46:55.587052] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T20:46:55.615671] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-03. [2025-09-17T20:46:56.415768] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-04. [2025-09-17T20:46:56.508211] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T20:46:57.166330] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T20:46:57.215753] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-04. [2025-09-17T20:46:57.957554] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T20:46:58.015796] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-05. [2025-09-17T20:46:58.658074] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T20:46:58.815810] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-05. [2025-09-17T20:46:59.615815] [INFO ] [REMOTE ] NWG: Fetching primary data for 2024-12. [2025-09-17T20:46:59.907080] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T20:47:00.412951] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T20:47:00.423193] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-06. [2025-09-17T20:47:00.965861] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T20:47:01.215794] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-06. [2025-09-17T20:47:01.728566] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T20:47:02.015794] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-01. [2025-09-17T20:47:02.815792] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-06. [2025-09-17T20:47:03.068350] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T20:47:03.328894] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T20:47:03.615793] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-07. [2025-09-17T20:47:04.415792] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-02. [2025-09-17T20:47:04.734312] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T20:47:05.173070] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T20:47:05.215755] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-08. [2025-09-17T20:47:05.876569] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T20:47:06.015814] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-07. [2025-09-17T20:47:06.798707] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T20:47:06.815737] [INFO ] [REMOTE ] NVST: Fetching primary data for 2025-09. [2025-09-17T20:47:07.615790] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-07. [2025-09-17T20:47:07.877906] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T20:47:08.237717] [INFO ] [REMOTE ] NVST: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T20:47:08.244371] [INFO ] [REMOTE ] NVST: Full fetch complete (73862 records). [2025-09-17T20:47:08.244485] [DEBUG] [VALIDATOR ] NVST: Validating primary data. [2025-09-17T20:47:08.421540] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-08. [2025-09-17T20:47:08.641367] [DEBUG] [VALIDATOR ] NVST: All expected trading days are present. [2025-09-17T20:47:08.641468] [DEBUG] [VALIDATOR ] NVST: Primary data validation passed. [2025-09-17T20:47:08.642478] [INFO ] [MAIN ] NVST: Fetched primary data is valid. [2025-09-17T20:47:08.642524] [DEBUG] [LOCAL ] NVST: Saving primary data. [2025-09-17T20:47:08.643973] [DEBUG] [LOCAL ] NVST: Trimmed 73862 records to 51698 (keeping 200 days of data) [2025-09-17T20:47:08.944791] [DEBUG] [LOCAL ] NVST: Primary data saved (51698 records). [2025-09-17T20:47:08.944933] [INFO ] [MAIN ] NVST: Full history saved. [2025-09-17T20:47:08.945037] [INFO ] [MAIN ] Update Progress: 1553/2371 symbols completed. NVST took 28.6s. Estimated remaining: 1h 59m 38s. Rate: 6.8 symbols/min [2025-09-17T20:47:09.113446] [INFO ] [MAIN ] NWN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:47:09.144185] [DEBUG] [LOCAL ] NWN: Loaded 26946 existing records from primary storage. [2025-09-17T20:47:09.144345] [INFO ] [MAIN ] NWN: Loaded 26946 existing records. [2025-09-17T20:47:09.221014] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-03. [2025-09-17T20:47:09.329798] [WARN ] [MAIN ] NWN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:47:09.330092] [INFO ] [MAIN ] NWN: Wiping existing primary data before full refresh. [2025-09-17T20:47:09.330139] [INFO ] [LOCAL ] NWN: Starting deletion of primary data. [2025-09-17T20:47:09.330752] [DEBUG] [LOCAL ] NWN: Deleted primary data file. [2025-09-17T20:47:09.330800] [INFO ] [MAIN ] NWN: Starting full primary refresh. [2025-09-17T20:47:09.692189] [INFO ] [REMOTE ] NWN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:47:09.823590] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T20:47:10.003735] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T20:47:10.015730] [INFO ] [REMOTE ] NVT: Fetching primary data for 2025-09. [2025-09-17T20:47:10.815747] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-08. [2025-09-17T20:47:10.882094] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T20:47:11.615782] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-04. [2025-09-17T20:47:11.731056] [INFO ] [REMOTE ] NVT: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T20:47:11.737998] [INFO ] [REMOTE ] NVT: Full fetch complete (74266 records). [2025-09-17T20:47:11.738168] [DEBUG] [VALIDATOR ] NVT: Validating primary data. [2025-09-17T20:47:12.159891] [DEBUG] [VALIDATOR ] NVT: All expected trading days are present. [2025-09-17T20:47:12.160216] [DEBUG] [VALIDATOR ] NVT: Primary data validation passed. [2025-09-17T20:47:12.162106] [INFO ] [MAIN ] NVT: Fetched primary data is valid. [2025-09-17T20:47:12.162197] [DEBUG] [LOCAL ] NVT: Saving primary data. [2025-09-17T20:47:12.164338] [DEBUG] [LOCAL ] NVT: Trimmed 74266 records to 51622 (keeping 200 days of data) [2025-09-17T20:47:12.420812] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-11. [2025-09-17T20:47:12.528962] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T20:47:12.560089] [DEBUG] [LOCAL ] NVT: Primary data saved (51622 records). [2025-09-17T20:47:12.560239] [INFO ] [MAIN ] NVT: Full history saved. [2025-09-17T20:47:12.560331] [INFO ] [MAIN ] Update Progress: 1554/2371 symbols completed. NVT took 28.8s. Estimated remaining: 1h 59m 26s. Rate: 6.8 symbols/min [2025-09-17T20:47:12.739403] [INFO ] [MAIN ] NX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:47:12.782400] [DEBUG] [LOCAL ] NX: Loaded 33431 existing records from primary storage. [2025-09-17T20:47:12.782587] [INFO ] [MAIN ] NX: Loaded 33431 existing records. [2025-09-17T20:47:12.963100] [WARN ] [MAIN ] NX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:47:12.963435] [INFO ] [MAIN ] NX: Wiping existing primary data before full refresh. [2025-09-17T20:47:12.963484] [INFO ] [LOCAL ] NX: Starting deletion of primary data. [2025-09-17T20:47:12.964249] [DEBUG] [LOCAL ] NX: Deleted primary data file. [2025-09-17T20:47:12.964301] [INFO ] [MAIN ] NX: Starting full primary refresh. [2025-09-17T20:47:13.220887] [INFO ] [REMOTE ] NVS: Fetching primary data for 2025-09. [2025-09-17T20:47:13.347127] [INFO ] [REMOTE ] NX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:47:13.367159] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T20:47:13.404555] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T20:47:14.015821] [INFO ] [REMOTE ] NWN: Fetching primary data for 2024-12. [2025-09-17T20:47:14.750266] [INFO ] [REMOTE ] NVS: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T20:47:14.759828] [INFO ] [REMOTE ] NVS: Full fetch complete (74633 records). [2025-09-17T20:47:14.759970] [DEBUG] [VALIDATOR ] NVS: Validating primary data. [2025-09-17T20:47:14.828684] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-05. [2025-09-17T20:47:15.052453] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T20:47:15.178625] [DEBUG] [VALIDATOR ] NVS: All expected trading days are present. [2025-09-17T20:47:15.178732] [DEBUG] [VALIDATOR ] NVS: Primary data validation passed. [2025-09-17T20:47:15.180062] [INFO ] [MAIN ] NVS: Fetched primary data is valid. [2025-09-17T20:47:15.180116] [DEBUG] [LOCAL ] NVS: Saving primary data. [2025-09-17T20:47:15.181906] [DEBUG] [LOCAL ] NVS: Trimmed 74633 records to 51713 (keeping 200 days of data) [2025-09-17T20:47:15.507669] [DEBUG] [LOCAL ] NVS: Primary data saved (51713 records). [2025-09-17T20:47:15.507817] [INFO ] [MAIN ] NVS: Full history saved. [2025-09-17T20:47:15.508442] [INFO ] [MAIN ] Update Progress: 1555/2371 symbols completed. NVS took 45.6s. Estimated remaining: 1h 59m 14s. Rate: 6.8 symbols/min [2025-09-17T20:47:15.620893] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-11. [2025-09-17T20:47:15.679907] [INFO ] [MAIN ] NXC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:47:15.689551] [DEBUG] [LOCAL ] NXC: Loaded 4142 existing records from primary storage. [2025-09-17T20:47:15.690047] [INFO ] [MAIN ] NXC: Loaded 4142 existing records. [2025-09-17T20:47:15.869224] [WARN ] [MAIN ] NXC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:47:15.869496] [INFO ] [MAIN ] NXC: Wiping existing primary data before full refresh. [2025-09-17T20:47:15.869546] [INFO ] [LOCAL ] NXC: Starting deletion of primary data. [2025-09-17T20:47:15.869805] [DEBUG] [LOCAL ] NXC: Deleted primary data file. [2025-09-17T20:47:15.869856] [INFO ] [MAIN ] NXC: Starting full primary refresh. [2025-09-17T20:47:16.235795] [INFO ] [REMOTE ] NXC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:47:16.415792] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-01. [2025-09-17T20:47:16.474807] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T20:47:17.157424] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T20:47:17.215763] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-06. [2025-09-17T20:47:17.307452] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T20:47:18.015800] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-11. [2025-09-17T20:47:18.623079] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T20:47:18.727396] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T20:47:18.815773] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-02. [2025-09-17T20:47:19.615866] [INFO ] [REMOTE ] NX: Fetching primary data for 2024-12. [2025-09-17T20:47:19.736717] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T20:47:20.415871] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-03. [2025-09-17T20:47:21.145362] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T20:47:21.215763] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-01. [2025-09-17T20:47:21.528032] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T20:47:22.015855] [INFO ] [REMOTE ] NXC: Fetching primary data for 2024-12. [2025-09-17T20:47:22.538336] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T20:47:22.641188] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T20:47:22.815861] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-02. [2025-09-17T20:47:23.615790] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-01. [2025-09-17T20:47:24.132220] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T20:47:24.162460] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T20:47:24.415788] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-03. [2025-09-17T20:47:25.215829] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-07. [2025-09-17T20:47:25.957892] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T20:47:26.015729] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-04. [2025-09-17T20:47:26.815800] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-04. [2025-09-17T20:47:27.055708] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T20:47:27.534012] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T20:47:27.615822] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-05. [2025-09-17T20:47:28.218731] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T20:47:28.415818] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-05. [2025-09-17T20:47:29.020607] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T20:47:29.215844] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-08. [2025-09-17T20:47:29.351711] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T20:47:30.015785] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-06. [2025-09-17T20:47:30.814360] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T20:47:30.824080] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-02. [2025-09-17T20:47:31.279258] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T20:47:31.572439] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T20:47:31.615726] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-03. [2025-09-17T20:47:32.009937] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-17T20:47:32.415801] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-04. [2025-09-17T20:47:32.978212] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T20:47:33.215788] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-05. [2025-09-17T20:47:33.761987] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T20:47:34.015790] [INFO ] [REMOTE ] NWG: Fetching primary data for 2025-09. [2025-09-17T20:47:34.815809] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-07. [2025-09-17T20:47:35.507252] [INFO ] [REMOTE ] NWG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T20:47:35.515144] [INFO ] [REMOTE ] NWG: Full fetch complete (72763 records). [2025-09-17T20:47:35.515310] [DEBUG] [VALIDATOR ] NWG: Validating primary data. [2025-09-17T20:47:35.620885] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-06. [2025-09-17T20:47:35.921838] [DEBUG] [VALIDATOR ] NWG: All expected trading days are present. [2025-09-17T20:47:35.921975] [DEBUG] [VALIDATOR ] NWG: Primary data validation passed. [2025-09-17T20:47:35.923143] [INFO ] [MAIN ] NWG: Fetched primary data is valid. [2025-09-17T20:47:35.923221] [DEBUG] [LOCAL ] NWG: Saving primary data. [2025-09-17T20:47:35.924950] [DEBUG] [LOCAL ] NWG: Trimmed 72763 records to 51705 (keeping 200 days of data) [2025-09-17T20:47:36.253680] [DEBUG] [LOCAL ] NWG: Primary data saved (51705 records). [2025-09-17T20:47:36.253975] [INFO ] [MAIN ] NWG: Full history saved. [2025-09-17T20:47:36.254094] [INFO ] [MAIN ] Update Progress: 1556/2371 symbols completed. NWG took 43.5s. Estimated remaining: 1h 59m 12s. Rate: 6.8 symbols/min [2025-09-17T20:47:36.420487] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-06. [2025-09-17T20:47:36.423053] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T20:47:36.440141] [INFO ] [MAIN ] NXDR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:47:36.444370] [DEBUG] [LOCAL ] NXDR: No existing data file found in primary storage. [2025-09-17T20:47:36.444520] [WARN ] [MAIN ] NXDR: No existing data found, performing full refresh instead. [2025-09-17T20:47:36.444975] [INFO ] [MAIN ] NXDR: Wiping existing primary data before full refresh. [2025-09-17T20:47:36.445076] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-17T20:47:36.445242] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-17T20:47:36.463565] [INFO ] [MAIN ] NXDR: Starting full primary refresh. [2025-09-17T20:47:36.479748] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T20:47:36.871585] [INFO ] [REMOTE ] NXDR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:47:37.215859] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-11. [2025-09-17T20:47:37.559216] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:47:37.559717] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-11 [2025-09-17T20:47:37.677183] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T20:47:38.015791] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2024-12. [2025-09-17T20:47:38.303891] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:47:38.304263] [WARN ] [REMOTE ] NXDR: No data returned for month 2024-12 [2025-09-17T20:47:38.815786] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-07. [2025-09-17T20:47:39.495819] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T20:47:39.615744] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-08. [2025-09-17T20:47:39.998399] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T20:47:40.415774] [INFO ] [REMOTE ] NXC: Fetching primary data for 2025-09. [2025-09-17T20:47:40.892031] [INFO ] [REMOTE ] NXC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T20:47:40.893201] [INFO ] [REMOTE ] NXC: Full fetch complete (6043 records). [2025-09-17T20:47:40.893271] [DEBUG] [VALIDATOR ] NXC: Validating primary data. [2025-09-17T20:47:41.226468] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-07. [2025-09-17T20:47:41.267133] [DEBUG] [VALIDATOR ] NXC: All expected trading days are present. [2025-09-17T20:47:41.267508] [DEBUG] [VALIDATOR ] NXC: Primary data validation passed. [2025-09-17T20:47:41.267707] [INFO ] [MAIN ] NXC: Fetched primary data is valid. [2025-09-17T20:47:41.267748] [DEBUG] [LOCAL ] NXC: Saving primary data. [2025-09-17T20:47:41.268163] [DEBUG] [LOCAL ] NXC: Trimmed 6043 records to 4157 (keeping 200 days of data) [2025-09-17T20:47:41.294870] [DEBUG] [LOCAL ] NXC: Primary data saved (4157 records). [2025-09-17T20:47:41.294967] [INFO ] [MAIN ] NXC: Full history saved. [2025-09-17T20:47:41.295050] [INFO ] [MAIN ] Update Progress: 1557/2371 symbols completed. NXC took 25.8s. Estimated remaining: 1h 59m 1s. Rate: 6.8 symbols/min [2025-09-17T20:47:42.015775] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-08. [2025-09-17T20:47:42.694758] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T20:47:42.815776] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-01. [2025-09-17T20:47:43.104018] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:47:43.106331] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-01 [2025-09-17T20:47:43.107236] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T20:47:43.615782] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-02. [2025-09-17T20:47:43.876473] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:47:43.876867] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-02 [2025-09-17T20:47:44.415784] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-08. [2025-09-17T20:47:45.215782] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-03. [2025-09-17T20:47:45.496827] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:47:45.497214] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-03 [2025-09-17T20:47:45.868478] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T20:47:46.015788] [INFO ] [REMOTE ] NX: Fetching primary data for 2025-09. [2025-09-17T20:47:46.815770] [INFO ] [REMOTE ] NWN: Fetching primary data for 2025-09. [2025-09-17T20:47:47.431030] [INFO ] [REMOTE ] NX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T20:47:47.436526] [INFO ] [REMOTE ] NX: Full fetch complete (47925 records). [2025-09-17T20:47:47.436635] [DEBUG] [VALIDATOR ] NX: Validating primary data. [2025-09-17T20:47:47.627346] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-04. [2025-09-17T20:47:47.821489] [DEBUG] [VALIDATOR ] NX: All expected trading days are present. [2025-09-17T20:47:47.821570] [DEBUG] [VALIDATOR ] NX: Primary data validation passed. [2025-09-17T20:47:47.822475] [INFO ] [MAIN ] NX: Fetched primary data is valid. [2025-09-17T20:47:47.822540] [DEBUG] [LOCAL ] NX: Saving primary data. [2025-09-17T20:47:47.823587] [DEBUG] [LOCAL ] NX: Trimmed 47925 records to 33389 (keeping 200 days of data) [2025-09-17T20:47:47.936273] [INFO ] [REMOTE ] NWN: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T20:47:47.943139] [INFO ] [REMOTE ] NWN: Full fetch complete (36823 records). [2025-09-17T20:47:47.944203] [DEBUG] [VALIDATOR ] NWN: Validating primary data. [2025-09-17T20:47:48.023469] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:47:48.054392] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-04 [2025-09-17T20:47:48.355890] [DEBUG] [VALIDATOR ] NWN: All expected trading days are present. [2025-09-17T20:47:48.356273] [DEBUG] [VALIDATOR ] NWN: Primary data validation passed. [2025-09-17T20:47:48.358000] [INFO ] [MAIN ] NWN: Fetched primary data is valid. [2025-09-17T20:47:48.358841] [DEBUG] [LOCAL ] NWN: Saving primary data. [2025-09-17T20:47:48.363339] [DEBUG] [LOCAL ] NWN: Trimmed 36823 records to 26970 (keeping 200 days of data) [2025-09-17T20:47:48.422625] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-05. [2025-09-17T20:47:48.567993] [DEBUG] [LOCAL ] NX: Primary data saved (33389 records). [2025-09-17T20:47:48.570203] [INFO ] [MAIN ] NX: Full history saved. [2025-09-17T20:47:48.570573] [INFO ] [MAIN ] Update Progress: 1558/2371 symbols completed. NX took 36.0s. Estimated remaining: 1h 58m 52s. Rate: 6.8 symbols/min [2025-09-17T20:47:48.624271] [DEBUG] [LOCAL ] NWN: Primary data saved (26970 records). [2025-09-17T20:47:48.624416] [INFO ] [MAIN ] NWN: Full history saved. [2025-09-17T20:47:48.624514] [INFO ] [MAIN ] Update Progress: 1559/2371 symbols completed. NWN took 39.7s. Estimated remaining: 1h 58m 38s. Rate: 6.8 symbols/min [2025-09-17T20:47:48.854806] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:47:48.855134] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-05 [2025-09-17T20:47:49.215778] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-06. [2025-09-17T20:47:49.823102] [DEBUG] [REMOTE ] NXDR: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:47:49.823449] [WARN ] [REMOTE ] NXDR: No data returned for month 2025-06 [2025-09-17T20:47:50.015781] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-07. [2025-09-17T20:47:51.347673] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T20:47:51.352588] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-08. [2025-09-17T20:47:53.143743] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T20:47:53.154103] [INFO ] [REMOTE ] NXDR: Fetching primary data for 2025-09. [2025-09-17T20:47:54.831294] [INFO ] [REMOTE ] NXDR: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T20:47:54.840144] [INFO ] [REMOTE ] NXDR: Full fetch complete (15156 records). [2025-09-17T20:47:54.840336] [DEBUG] [VALIDATOR ] NXDR: Validating primary data. [2025-09-17T20:47:55.030550] [WARN ] [VALIDATOR ] NXDR: Validation failed - insufficient historical data. Have 42 unique days, need 200 days [2025-09-17T20:47:55.030900] [FATAL] [MAIN ] NXDR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:47:55.031484] [WARN ] [MAIN ] NXDR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:47:55.031543] [INFO ] [LOCAL ] NXDR: Starting deletion of primary data. [2025-09-17T20:47:55.031614] [DEBUG] [LOCAL ] NXDR: No primary data file found to delete. [2025-09-17T20:47:55.031681] [INFO ] [LOCAL ] NXDR: Starting deletion of derivative data. [2025-09-17T20:47:55.031736] [DEBUG] [LOCAL ] NXDR: No derivative data file found to delete. [2025-09-17T20:47:55.031805] [INFO ] [MAIN ] Update Progress: 1560/2371 symbols completed. NXDR took 18.8s. Estimated remaining: 1h 58m 28s. Rate: 6.8 symbols/min [2025-09-17T20:47:55.602454] [INFO ] [MAIN ] NXG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:47:55.704959] [INFO ] [MAIN ] NXE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:47:55.757409] [INFO ] [MAIN ] NXDT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:47:55.759291] [INFO ] [MAIN ] NXJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:47:55.772149] [DEBUG] [LOCAL ] NXG: Loaded 10581 existing records from primary storage. [2025-09-17T20:47:55.772501] [INFO ] [MAIN ] NXG: Loaded 10581 existing records. [2025-09-17T20:47:55.896677] [DEBUG] [LOCAL ] NXJ: Loaded 14746 existing records from primary storage. [2025-09-17T20:47:55.931357] [INFO ] [MAIN ] NXJ: Loaded 14746 existing records. [2025-09-17T20:47:55.926146] [DEBUG] [LOCAL ] NXDT: Loaded 16606 existing records from primary storage. [2025-09-17T20:47:56.006615] [INFO ] [MAIN ] NXDT: Loaded 16606 existing records. [2025-09-17T20:47:56.064852] [WARN ] [MAIN ] NXG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:47:56.182431] [INFO ] [MAIN ] NXG: Wiping existing primary data before full refresh. [2025-09-17T20:47:56.188890] [DEBUG] [LOCAL ] NXE: Loaded 52978 existing records from primary storage. [2025-09-17T20:47:56.214667] [INFO ] [LOCAL ] NXG: Starting deletion of primary data. [2025-09-17T20:47:56.230209] [INFO ] [MAIN ] NXE: Loaded 52978 existing records. [2025-09-17T20:47:56.290913] [DEBUG] [LOCAL ] NXG: Deleted primary data file. [2025-09-17T20:47:56.306010] [INFO ] [MAIN ] NXG: Starting full primary refresh. [2025-09-17T20:47:56.306243] [WARN ] [MAIN ] NXJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:47:56.471639] [INFO ] [MAIN ] NXJ: Wiping existing primary data before full refresh. [2025-09-17T20:47:56.536529] [INFO ] [LOCAL ] NXJ: Starting deletion of primary data. [2025-09-17T20:47:56.604997] [DEBUG] [LOCAL ] NXJ: Deleted primary data file. [2025-09-17T20:47:56.595179] [WARN ] [MAIN ] NXDT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:47:56.609627] [INFO ] [MAIN ] NXJ: Starting full primary refresh. [2025-09-17T20:47:56.625695] [INFO ] [MAIN ] NXDT: Wiping existing primary data before full refresh. [2025-09-17T20:47:56.662144] [INFO ] [LOCAL ] NXDT: Starting deletion of primary data. [2025-09-17T20:47:56.710097] [DEBUG] [LOCAL ] NXDT: Deleted primary data file. [2025-09-17T20:47:56.765611] [INFO ] [MAIN ] NXDT: Starting full primary refresh. [2025-09-17T20:47:56.825767] [WARN ] [MAIN ] NXE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:47:56.946606] [INFO ] [MAIN ] NXE: Wiping existing primary data before full refresh. [2025-09-17T20:47:56.973096] [INFO ] [LOCAL ] NXE: Starting deletion of primary data. [2025-09-17T20:47:57.090097] [DEBUG] [LOCAL ] NXE: Deleted primary data file. [2025-09-17T20:47:57.226350] [INFO ] [MAIN ] NXE: Starting full primary refresh. [2025-09-17T20:47:57.631132] [INFO ] [REMOTE ] NXG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:47:57.681792] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-11. [2025-09-17T20:47:57.853124] [INFO ] [REMOTE ] NXJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:47:57.887287] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-11. [2025-09-17T20:47:58.008556] [INFO ] [REMOTE ] NXDT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:47:58.032076] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-11. [2025-09-17T20:47:58.122366] [INFO ] [REMOTE ] NXE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:47:58.122700] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-11. [2025-09-17T20:47:58.640390] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T20:47:58.642421] [INFO ] [REMOTE ] NXG: Fetching primary data for 2024-12. [2025-09-17T20:47:58.755612] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T20:47:58.758612] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2024-12. [2025-09-17T20:47:59.089418] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T20:47:59.092882] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2024-12. [2025-09-17T20:47:59.225332] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T20:47:59.228045] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-01. [2025-09-17T20:47:59.654503] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T20:47:59.658708] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-01. [2025-09-17T20:47:59.963356] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T20:47:59.973844] [INFO ] [REMOTE ] NXE: Fetching primary data for 2024-12. [2025-09-17T20:48:00.064577] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T20:48:00.102563] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T20:48:00.407012] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T20:48:00.415672] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-02. [2025-09-17T20:48:01.215781] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-01. [2025-09-17T20:48:01.253575] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T20:48:01.482038] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T20:48:02.015809] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-02. [2025-09-17T20:48:02.073669] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T20:48:02.815785] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-01. [2025-09-17T20:48:02.827771] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T20:48:03.615775] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-03. [2025-09-17T20:48:04.310271] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T20:48:04.415811] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-02. [2025-09-17T20:48:04.598269] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T20:48:05.215834] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-04. [2025-09-17T20:48:06.012374] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T20:48:06.021722] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-03. [2025-09-17T20:48:06.112567] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T20:48:06.815798] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-02. [2025-09-17T20:48:06.972938] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T20:48:07.615813] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-04. [2025-09-17T20:48:07.949258] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T20:48:08.250077] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T20:48:08.415792] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-05. [2025-09-17T20:48:09.215830] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-03. [2025-09-17T20:48:09.484335] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T20:48:09.983214] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T20:48:10.015780] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-06. [2025-09-17T20:48:10.799698] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T20:48:10.815732] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-07. [2025-09-17T20:48:11.445495] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T20:48:11.615778] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-04. [2025-09-17T20:48:12.415772] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-08. [2025-09-17T20:48:12.757527] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T20:48:13.211769] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T20:48:13.215678] [INFO ] [REMOTE ] NXG: Fetching primary data for 2025-09. [2025-09-17T20:48:14.015813] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-05. [2025-09-17T20:48:14.058332] [INFO ] [REMOTE ] NXG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T20:48:14.060319] [INFO ] [REMOTE ] NXG: Full fetch complete (14383 records). [2025-09-17T20:48:14.060402] [DEBUG] [VALIDATOR ] NXG: Validating primary data. [2025-09-17T20:48:14.443355] [DEBUG] [VALIDATOR ] NXG: All expected trading days are present. [2025-09-17T20:48:14.443450] [DEBUG] [VALIDATOR ] NXG: Primary data validation passed. [2025-09-17T20:48:14.443876] [INFO ] [MAIN ] NXG: Fetched primary data is valid. [2025-09-17T20:48:14.443944] [DEBUG] [LOCAL ] NXG: Saving primary data. [2025-09-17T20:48:14.445525] [DEBUG] [LOCAL ] NXG: Trimmed 14383 records to 10557 (keeping 200 days of data) [2025-09-17T20:48:14.520273] [DEBUG] [LOCAL ] NXG: Primary data saved (10557 records). [2025-09-17T20:48:14.520435] [INFO ] [MAIN ] NXG: Full history saved. [2025-09-17T20:48:14.520572] [INFO ] [MAIN ] Update Progress: 1561/2371 symbols completed. NXG took 19.5s. Estimated remaining: 1h 58m 25s. Rate: 6.8 symbols/min [2025-09-17T20:48:14.701202] [INFO ] [MAIN ] NXN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:48:14.708129] [DEBUG] [LOCAL ] NXN: Loaded 2339 existing records from primary storage. [2025-09-17T20:48:14.708280] [INFO ] [MAIN ] NXN: Loaded 2339 existing records. [2025-09-17T20:48:14.820522] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-03. [2025-09-17T20:48:14.902457] [WARN ] [MAIN ] NXN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:48:14.912609] [INFO ] [MAIN ] NXN: Wiping existing primary data before full refresh. [2025-09-17T20:48:14.912898] [INFO ] [LOCAL ] NXN: Starting deletion of primary data. [2025-09-17T20:48:14.914039] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T20:48:14.914103] [DEBUG] [LOCAL ] NXN: Deleted primary data file. [2025-09-17T20:48:14.917412] [INFO ] [MAIN ] NXN: Starting full primary refresh. [2025-09-17T20:48:15.275193] [INFO ] [REMOTE ] NXN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:48:15.615790] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-06. [2025-09-17T20:48:16.302713] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T20:48:16.415750] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-05. [2025-09-17T20:48:16.880392] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T20:48:17.215801] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-04. [2025-09-17T20:48:17.625714] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T20:48:18.015780] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-07. [2025-09-17T20:48:18.815769] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-11. [2025-09-17T20:48:19.112718] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T20:48:19.136324] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T20:48:19.423400] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T20:48:19.615773] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-05. [2025-09-17T20:48:20.415801] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-06. [2025-09-17T20:48:21.215771] [INFO ] [REMOTE ] NXN: Fetching primary data for 2024-12. [2025-09-17T20:48:21.265730] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T20:48:21.306438] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T20:48:21.777504] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2024-12 (0.56 seconds). [2025-09-17T20:48:22.015827] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-01. [2025-09-17T20:48:22.554242] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-01 (0.54 seconds). [2025-09-17T20:48:22.815810] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-07. [2025-09-17T20:48:23.615783] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-02. [2025-09-17T20:48:23.816093] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T20:48:24.046171] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T20:48:24.415815] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-08. [2025-09-17T20:48:25.215788] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-08. [2025-09-17T20:48:25.569973] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T20:48:26.015782] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-06. [2025-09-17T20:48:26.348149] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T20:48:26.815825] [INFO ] [REMOTE ] NXJ: Fetching primary data for 2025-09. [2025-09-17T20:48:27.615748] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-03. [2025-09-17T20:48:27.738375] [INFO ] [REMOTE ] NXJ: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T20:48:27.741852] [INFO ] [REMOTE ] NXJ: Full fetch complete (21304 records). [2025-09-17T20:48:27.741925] [DEBUG] [VALIDATOR ] NXJ: Validating primary data. [2025-09-17T20:48:28.109117] [DEBUG] [VALIDATOR ] NXJ: All expected trading days are present. [2025-09-17T20:48:28.109207] [DEBUG] [VALIDATOR ] NXJ: Primary data validation passed. [2025-09-17T20:48:28.109959] [INFO ] [MAIN ] NXJ: Fetched primary data is valid. [2025-09-17T20:48:28.110060] [DEBUG] [LOCAL ] NXJ: Saving primary data. [2025-09-17T20:48:28.111157] [DEBUG] [LOCAL ] NXJ: Trimmed 21304 records to 14804 (keeping 200 days of data) [2025-09-17T20:48:28.225205] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-17T20:48:28.239951] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T20:48:28.257728] [DEBUG] [LOCAL ] NXJ: Primary data saved (14804 records). [2025-09-17T20:48:28.259754] [INFO ] [MAIN ] NXJ: Full history saved. [2025-09-17T20:48:28.259862] [INFO ] [MAIN ] Update Progress: 1562/2371 symbols completed. NXJ took 33.2s. Estimated remaining: 1h 58m 19s. Rate: 6.8 symbols/min [2025-09-17T20:48:28.425495] [INFO ] [REMOTE ] NXDT: Fetching primary data for 2025-09. [2025-09-17T20:48:28.427833] [INFO ] [MAIN ] NXP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:48:28.443171] [DEBUG] [LOCAL ] NXP: Loaded 12194 existing records from primary storage. [2025-09-17T20:48:28.443362] [INFO ] [MAIN ] NXP: Loaded 12194 existing records. [2025-09-17T20:48:28.623197] [WARN ] [MAIN ] NXP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:48:28.623539] [INFO ] [MAIN ] NXP: Wiping existing primary data before full refresh. [2025-09-17T20:48:28.623628] [INFO ] [LOCAL ] NXP: Starting deletion of primary data. [2025-09-17T20:48:28.624117] [DEBUG] [LOCAL ] NXP: Deleted primary data file. [2025-09-17T20:48:28.624165] [INFO ] [MAIN ] NXP: Starting full primary refresh. [2025-09-17T20:48:28.970450] [INFO ] [REMOTE ] NXP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:48:29.215841] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-11. [2025-09-17T20:48:29.359296] [INFO ] [REMOTE ] NXDT: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T20:48:29.363028] [INFO ] [REMOTE ] NXDT: Full fetch complete (25842 records). [2025-09-17T20:48:29.363192] [DEBUG] [VALIDATOR ] NXDT: Validating primary data. [2025-09-17T20:48:29.956197] [DEBUG] [VALIDATOR ] NXDT: All expected trading days are present. [2025-09-17T20:48:29.956506] [DEBUG] [VALIDATOR ] NXDT: Primary data validation passed. [2025-09-17T20:48:29.958106] [INFO ] [MAIN ] NXDT: Fetched primary data is valid. [2025-09-17T20:48:29.958205] [DEBUG] [LOCAL ] NXDT: Saving primary data. [2025-09-17T20:48:29.959743] [DEBUG] [LOCAL ] NXDT: Trimmed 25842 records to 16604 (keeping 200 days of data) [2025-09-17T20:48:30.019480] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-07. [2025-09-17T20:48:30.103985] [DEBUG] [LOCAL ] NXDT: Primary data saved (16604 records). [2025-09-17T20:48:30.104166] [INFO ] [MAIN ] NXDT: Full history saved. [2025-09-17T20:48:30.104308] [INFO ] [MAIN ] Update Progress: 1563/2371 symbols completed. NXDT took 35.1s. Estimated remaining: 1h 58m 7s. Rate: 6.8 symbols/min [2025-09-17T20:48:30.150990] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T20:48:30.386246] [INFO ] [MAIN ] NXRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:48:30.406835] [DEBUG] [LOCAL ] NXRT: Loaded 18844 existing records from primary storage. [2025-09-17T20:48:30.406987] [INFO ] [MAIN ] NXRT: Loaded 18844 existing records. [2025-09-17T20:48:30.606363] [WARN ] [MAIN ] NXRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:48:30.606721] [INFO ] [MAIN ] NXRT: Wiping existing primary data before full refresh. [2025-09-17T20:48:30.606790] [INFO ] [LOCAL ] NXRT: Starting deletion of primary data. [2025-09-17T20:48:30.607601] [DEBUG] [LOCAL ] NXRT: Deleted primary data file. [2025-09-17T20:48:30.607699] [INFO ] [MAIN ] NXRT: Starting full primary refresh. [2025-09-17T20:48:30.820855] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-04. [2025-09-17T20:48:30.976192] [INFO ] [REMOTE ] NXRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:48:31.420299] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T20:48:31.615777] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-05. [2025-09-17T20:48:32.121461] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T20:48:32.192391] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T20:48:32.415787] [INFO ] [REMOTE ] NXP: Fetching primary data for 2024-12. [2025-09-17T20:48:33.215792] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-11. [2025-09-17T20:48:33.259438] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T20:48:33.999980] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T20:48:34.015735] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2024-12. [2025-09-17T20:48:34.815783] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-06. [2025-09-17T20:48:34.868395] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T20:48:35.432221] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T20:48:35.615792] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-01. [2025-09-17T20:48:36.415789] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-07. [2025-09-17T20:48:36.460059] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T20:48:36.937799] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T20:48:37.215778] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-02. [2025-09-17T20:48:37.931744] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T20:48:38.015782] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-08. [2025-09-17T20:48:38.815820] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-03. [2025-09-17T20:48:39.581262] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T20:48:39.606912] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T20:48:39.615690] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-01. [2025-09-17T20:48:40.415787] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-04. [2025-09-17T20:48:40.648474] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T20:48:41.197026] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T20:48:41.215739] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-05. [2025-09-17T20:48:42.015782] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-08. [2025-09-17T20:48:42.124451] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T20:48:42.669498] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T20:48:42.815782] [INFO ] [REMOTE ] NXN: Fetching primary data for 2025-09. [2025-09-17T20:48:43.251216] [INFO ] [REMOTE ] NXN: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T20:48:43.252246] [INFO ] [REMOTE ] NXN: Full fetch complete (3690 records). [2025-09-17T20:48:43.252320] [DEBUG] [VALIDATOR ] NXN: Validating primary data. [2025-09-17T20:48:43.608318] [DEBUG] [VALIDATOR ] NXN: All expected trading days are present. [2025-09-17T20:48:43.608399] [DEBUG] [VALIDATOR ] NXN: Primary data validation passed. [2025-09-17T20:48:43.608523] [INFO ] [MAIN ] NXN: Fetched primary data is valid. [2025-09-17T20:48:43.608562] [DEBUG] [LOCAL ] NXN: Saving primary data. [2025-09-17T20:48:43.608952] [DEBUG] [LOCAL ] NXN: Trimmed 3690 records to 2339 (keeping 200 days of data) [2025-09-17T20:48:43.625339] [DEBUG] [LOCAL ] NXN: Primary data saved (2339 records). [2025-09-17T20:48:43.618313] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-02. [2025-09-17T20:48:43.625593] [INFO ] [MAIN ] NXN: Full history saved. [2025-09-17T20:48:43.625718] [INFO ] [MAIN ] Update Progress: 1564/2371 symbols completed. NXN took 29.1s. Estimated remaining: 1h 58m 0s. Rate: 6.8 symbols/min [2025-09-17T20:48:43.796104] [INFO ] [MAIN ] NYC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:48:43.796312] [DEBUG] [LOCAL ] NYC: No existing data file found in primary storage. [2025-09-17T20:48:43.796352] [WARN ] [MAIN ] NYC: No existing data found, performing full refresh instead. [2025-09-17T20:48:43.796480] [INFO ] [MAIN ] NYC: Wiping existing primary data before full refresh. [2025-09-17T20:48:43.796526] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-17T20:48:43.796583] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-17T20:48:43.796621] [INFO ] [MAIN ] NYC: Starting full primary refresh. [2025-09-17T20:48:44.157710] [INFO ] [REMOTE ] NYC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:48:44.415782] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-06. [2025-09-17T20:48:44.699058] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T20:48:45.215788] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-11. [2025-09-17T20:48:45.566667] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T20:48:45.651072] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-11 (0.44 seconds). [2025-09-17T20:48:46.015798] [INFO ] [REMOTE ] NYC: Fetching primary data for 2024-12. [2025-09-17T20:48:46.478074] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T20:48:46.815785] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-03. [2025-09-17T20:48:47.615750] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-01. [2025-09-17T20:48:47.929232] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T20:48:48.098627] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T20:48:48.415773] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-02. [2025-09-17T20:48:49.113038] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T20:48:49.215785] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-04. [2025-09-17T20:48:50.015792] [INFO ] [REMOTE ] NXE: Fetching primary data for 2025-09. [2025-09-17T20:48:50.360746] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T20:48:50.815777] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-05. [2025-09-17T20:48:51.615701] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-03. [2025-09-17T20:48:51.686175] [INFO ] [REMOTE ] NXE: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T20:48:51.694635] [INFO ] [REMOTE ] NXE: Full fetch complete (76492 records). [2025-09-17T20:48:51.694837] [DEBUG] [VALIDATOR ] NXE: Validating primary data. [2025-09-17T20:48:52.015360] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T20:48:52.114938] [DEBUG] [VALIDATOR ] NXE: All expected trading days are present. [2025-09-17T20:48:52.115064] [DEBUG] [VALIDATOR ] NXE: Primary data validation passed. [2025-09-17T20:48:52.116408] [INFO ] [MAIN ] NXE: Fetched primary data is valid. [2025-09-17T20:48:52.116500] [DEBUG] [LOCAL ] NXE: Saving primary data. [2025-09-17T20:48:52.129126] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T20:48:52.133481] [DEBUG] [LOCAL ] NXE: Trimmed 76492 records to 52981 (keeping 200 days of data) [2025-09-17T20:48:52.423030] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-07. [2025-09-17T20:48:52.446320] [DEBUG] [LOCAL ] NXE: Primary data saved (52981 records). [2025-09-17T20:48:52.446483] [INFO ] [MAIN ] NXE: Full history saved. [2025-09-17T20:48:52.446573] [INFO ] [MAIN ] Update Progress: 1565/2371 symbols completed. NXE took 57.4s. Estimated remaining: 1h 57m 51s. Rate: 6.8 symbols/min [2025-09-17T20:48:52.618681] [INFO ] [MAIN ] NYT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:48:52.664216] [DEBUG] [LOCAL ] NYT: Loaded 50091 existing records from primary storage. [2025-09-17T20:48:52.664428] [INFO ] [MAIN ] NYT: Loaded 50091 existing records. [2025-09-17T20:48:52.842657] [WARN ] [MAIN ] NYT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:48:52.842924] [INFO ] [MAIN ] NYT: Wiping existing primary data before full refresh. [2025-09-17T20:48:52.843013] [INFO ] [LOCAL ] NYT: Starting deletion of primary data. [2025-09-17T20:48:52.844273] [DEBUG] [LOCAL ] NYT: Deleted primary data file. [2025-09-17T20:48:52.844330] [INFO ] [MAIN ] NYT: Starting full primary refresh. [2025-09-17T20:48:53.202796] [INFO ] [REMOTE ] NYT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:48:53.215721] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-11. [2025-09-17T20:48:53.264044] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T20:48:54.015772] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-06. [2025-09-17T20:48:54.815747] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-04. [2025-09-17T20:48:54.912297] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T20:48:54.970677] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T20:48:55.203107] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-04 (0.39 seconds). [2025-09-17T20:48:55.615834] [INFO ] [REMOTE ] NYT: Fetching primary data for 2024-12. [2025-09-17T20:48:56.415816] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-07. [2025-09-17T20:48:57.149551] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T20:48:57.215848] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-08. [2025-09-17T20:48:57.492483] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T20:48:58.015824] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-08. [2025-09-17T20:48:58.179442] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T20:48:58.815792] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-01. [2025-09-17T20:48:59.291288] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T20:48:59.615789] [INFO ] [REMOTE ] NXRT: Fetching primary data for 2025-09. [2025-09-17T20:49:00.137861] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T20:49:00.415776] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-05. [2025-09-17T20:49:00.697361] [INFO ] [REMOTE ] NXRT: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T20:49:00.700610] [INFO ] [REMOTE ] NXRT: Full fetch complete (24798 records). [2025-09-17T20:49:00.700767] [DEBUG] [VALIDATOR ] NXRT: Validating primary data. [2025-09-17T20:49:00.807011] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-05 (0.39 seconds). [2025-09-17T20:49:01.080453] [DEBUG] [VALIDATOR ] NXRT: All expected trading days are present. [2025-09-17T20:49:01.080543] [DEBUG] [VALIDATOR ] NXRT: Primary data validation passed. [2025-09-17T20:49:01.081221] [INFO ] [MAIN ] NXRT: Fetched primary data is valid. [2025-09-17T20:49:01.081268] [DEBUG] [LOCAL ] NXRT: Saving primary data. [2025-09-17T20:49:01.082157] [DEBUG] [LOCAL ] NXRT: Trimmed 24798 records to 18912 (keeping 200 days of data) [2025-09-17T20:49:01.201939] [DEBUG] [LOCAL ] NXRT: Primary data saved (18912 records). [2025-09-17T20:49:01.202100] [INFO ] [MAIN ] NXRT: Full history saved. [2025-09-17T20:49:01.202238] [INFO ] [MAIN ] Update Progress: 1566/2371 symbols completed. NXRT took 31.1s. Estimated remaining: 1h 57m 43s. Rate: 6.8 symbols/min [2025-09-17T20:49:01.223006] [INFO ] [REMOTE ] NXP: Fetching primary data for 2025-09. [2025-09-17T20:49:01.376089] [INFO ] [MAIN ] NZF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:49:01.409807] [DEBUG] [LOCAL ] NZF: Loaded 29303 existing records from primary storage. [2025-09-17T20:49:01.409955] [INFO ] [MAIN ] NZF: Loaded 29303 existing records. [2025-09-17T20:49:01.596859] [WARN ] [MAIN ] NZF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:49:01.597164] [INFO ] [MAIN ] NZF: Wiping existing primary data before full refresh. [2025-09-17T20:49:01.597226] [INFO ] [LOCAL ] NZF: Starting deletion of primary data. [2025-09-17T20:49:01.598126] [DEBUG] [LOCAL ] NZF: Deleted primary data file. [2025-09-17T20:49:01.598180] [INFO ] [MAIN ] NZF: Starting full primary refresh. [2025-09-17T20:49:01.961689] [INFO ] [REMOTE ] NZF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:49:02.015754] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-11. [2025-09-17T20:49:02.121506] [INFO ] [REMOTE ] NXP: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T20:49:02.124063] [INFO ] [REMOTE ] NXP: Full fetch complete (16822 records). [2025-09-17T20:49:02.124193] [DEBUG] [VALIDATOR ] NXP: Validating primary data. [2025-09-17T20:49:02.489994] [DEBUG] [VALIDATOR ] NXP: All expected trading days are present. [2025-09-17T20:49:02.490085] [DEBUG] [VALIDATOR ] NXP: Primary data validation passed. [2025-09-17T20:49:02.490610] [INFO ] [MAIN ] NXP: Fetched primary data is valid. [2025-09-17T20:49:02.490683] [DEBUG] [LOCAL ] NXP: Saving primary data. [2025-09-17T20:49:02.491345] [DEBUG] [LOCAL ] NXP: Trimmed 16822 records to 12248 (keeping 200 days of data) [2025-09-17T20:49:02.577221] [DEBUG] [LOCAL ] NXP: Primary data saved (12248 records). [2025-09-17T20:49:02.577376] [INFO ] [MAIN ] NXP: Full history saved. [2025-09-17T20:49:02.577483] [INFO ] [MAIN ] Update Progress: 1567/2371 symbols completed. NXP took 34.3s. Estimated remaining: 1h 57m 30s. Rate: 6.8 symbols/min [2025-09-17T20:49:02.744242] [INFO ] [MAIN ] O: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:49:02.744405] [DEBUG] [LOCAL ] O: No existing data file found in primary storage. [2025-09-17T20:49:02.744441] [WARN ] [MAIN ] O: No existing data found, performing full refresh instead. [2025-09-17T20:49:02.744556] [INFO ] [MAIN ] O: Wiping existing primary data before full refresh. [2025-09-17T20:49:02.744595] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-17T20:49:02.744634] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-17T20:49:02.744687] [INFO ] [MAIN ] O: Starting full primary refresh. [2025-09-17T20:49:02.820910] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-06. [2025-09-17T20:49:03.100822] [INFO ] [REMOTE ] O: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:49:03.401526] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T20:49:03.410013] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T20:49:03.615820] [INFO ] [REMOTE ] NZF: Fetching primary data for 2024-12. [2025-09-17T20:49:04.415827] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-07. [2025-09-17T20:49:05.200758] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T20:49:05.215731] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-01. [2025-09-17T20:49:05.300422] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T20:49:06.015841] [INFO ] [REMOTE ] O: Fetching primary data for 2024-11. [2025-09-17T20:49:06.615499] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T20:49:06.815782] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-02. [2025-09-17T20:49:07.615787] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-08. [2025-09-17T20:49:08.008231] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-17T20:49:08.152763] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T20:49:08.415817] [INFO ] [REMOTE ] NYC: Fetching primary data for 2025-09. [2025-09-17T20:49:08.621466] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-11 (2.61 seconds). [2025-09-17T20:49:08.806953] [INFO ] [REMOTE ] NYC: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T20:49:08.808049] [INFO ] [REMOTE ] NYC: Full fetch complete (1881 records). [2025-09-17T20:49:08.808138] [DEBUG] [VALIDATOR ] NYC: Validating primary data. [2025-09-17T20:49:08.993944] [WARN ] [VALIDATOR ] NYC: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-17T20:49:08.994184] [FATAL] [MAIN ] NYC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:49:08.994255] [WARN ] [MAIN ] NYC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:49:08.994323] [INFO ] [LOCAL ] NYC: Starting deletion of primary data. [2025-09-17T20:49:08.994392] [DEBUG] [LOCAL ] NYC: No primary data file found to delete. [2025-09-17T20:49:08.994428] [INFO ] [LOCAL ] NYC: Starting deletion of derivative data. [2025-09-17T20:49:08.994469] [DEBUG] [LOCAL ] NYC: No derivative data file found to delete. [2025-09-17T20:49:08.994529] [INFO ] [MAIN ] Update Progress: 1568/2371 symbols completed. NYC took 25.4s. Estimated remaining: 1h 57m 20s. Rate: 6.8 symbols/min [2025-09-17T20:49:09.170517] [INFO ] [MAIN ] OBDC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:49:09.226570] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-02. [2025-09-17T20:49:09.230047] [DEBUG] [LOCAL ] OBDC: Loaded 51637 existing records from primary storage. [2025-09-17T20:49:09.230218] [INFO ] [MAIN ] OBDC: Loaded 51637 existing records. [2025-09-17T20:49:09.418756] [WARN ] [MAIN ] OBDC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:49:09.418998] [INFO ] [MAIN ] OBDC: Wiping existing primary data before full refresh. [2025-09-17T20:49:09.419044] [INFO ] [LOCAL ] OBDC: Starting deletion of primary data. [2025-09-17T20:49:09.420266] [DEBUG] [LOCAL ] OBDC: Deleted primary data file. [2025-09-17T20:49:09.420328] [INFO ] [MAIN ] OBDC: Starting full primary refresh. [2025-09-17T20:49:09.785483] [INFO ] [REMOTE ] OBDC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:49:10.015827] [INFO ] [REMOTE ] O: Fetching primary data for 2024-12. [2025-09-17T20:49:10.815832] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-11. [2025-09-17T20:49:11.116739] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T20:49:11.615796] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-03. [2025-09-17T20:49:12.371793] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T20:49:12.415749] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-03. [2025-09-17T20:49:12.450159] [INFO ] [REMOTE ] O: Incremental fetch complete for 2024-12 (2.43 seconds). [2025-09-17T20:49:12.983078] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T20:49:13.215783] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2024-12. [2025-09-17T20:49:13.755557] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T20:49:14.015840] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-04. [2025-09-17T20:49:14.815866] [INFO ] [REMOTE ] O: Fetching primary data for 2025-01. [2025-09-17T20:49:14.958803] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T20:49:15.615786] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-01. [2025-09-17T20:49:15.662947] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T20:49:16.415806] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-04. [2025-09-17T20:49:17.215789] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-05. [2025-09-17T20:49:17.446766] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-01 (2.63 seconds). [2025-09-17T20:49:17.532413] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T20:49:17.641762] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T20:49:18.015769] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-05. [2025-09-17T20:49:18.815857] [INFO ] [REMOTE ] O: Fetching primary data for 2025-02. [2025-09-17T20:49:18.984651] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T20:49:19.289067] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T20:49:19.615802] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-02. [2025-09-17T20:49:20.415832] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-06. [2025-09-17T20:49:21.215801] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-06. [2025-09-17T20:49:21.335835] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-02 (2.52 seconds). [2025-09-17T20:49:21.456278] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T20:49:22.015960] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-03. [2025-09-17T20:49:22.119536] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T20:49:22.178445] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T20:49:22.815827] [INFO ] [REMOTE ] O: Fetching primary data for 2025-03. [2025-09-17T20:49:23.615784] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-07. [2025-09-17T20:49:24.058626] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T20:49:24.415831] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-04. [2025-09-17T20:49:24.919581] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T20:49:25.165087] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-17T20:49:25.215729] [INFO ] [REMOTE ] O: Fetching primary data for 2025-04. [2025-09-17T20:49:26.015834] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-08. [2025-09-17T20:49:26.274797] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T20:49:26.815819] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-07. [2025-09-17T20:49:27.028176] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T20:49:27.386888] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-17T20:49:27.615741] [INFO ] [REMOTE ] O: Fetching primary data for 2025-05. [2025-09-17T20:49:28.415747] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-05. [2025-09-17T20:49:28.745110] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T20:49:29.215829] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-08. [2025-09-17T20:49:30.024043] [INFO ] [REMOTE ] NZF: Fetching primary data for 2025-09. [2025-09-17T20:49:30.037177] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-05 (2.42 seconds). [2025-09-17T20:49:30.219786] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T20:49:30.820839] [INFO ] [REMOTE ] O: Fetching primary data for 2025-06. [2025-09-17T20:49:30.837678] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T20:49:30.969115] [INFO ] [REMOTE ] NZF: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T20:49:30.973904] [INFO ] [REMOTE ] NZF: Full fetch complete (43869 records). [2025-09-17T20:49:30.974039] [DEBUG] [VALIDATOR ] NZF: Validating primary data. [2025-09-17T20:49:31.401619] [DEBUG] [VALIDATOR ] NZF: All expected trading days are present. [2025-09-17T20:49:31.401726] [DEBUG] [VALIDATOR ] NZF: Primary data validation passed. [2025-09-17T20:49:31.402463] [INFO ] [MAIN ] NZF: Fetched primary data is valid. [2025-09-17T20:49:31.402512] [DEBUG] [LOCAL ] NZF: Saving primary data. [2025-09-17T20:49:31.403532] [DEBUG] [LOCAL ] NZF: Trimmed 43869 records to 29303 (keeping 200 days of data) [2025-09-17T20:49:31.597939] [DEBUG] [LOCAL ] NZF: Primary data saved (29303 records). [2025-09-17T20:49:31.598189] [INFO ] [MAIN ] NZF: Full history saved. [2025-09-17T20:49:31.598347] [INFO ] [MAIN ] Update Progress: 1569/2371 symbols completed. NZF took 30.4s. Estimated remaining: 1h 57m 18s. Rate: 6.8 symbols/min [2025-09-17T20:49:31.620936] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-06. [2025-09-17T20:49:31.770577] [INFO ] [MAIN ] OBK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:49:31.788531] [DEBUG] [LOCAL ] OBK: Loaded 16147 existing records from primary storage. [2025-09-17T20:49:31.788658] [INFO ] [MAIN ] OBK: Loaded 16147 existing records. [2025-09-17T20:49:31.965403] [WARN ] [MAIN ] OBK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:49:31.965698] [INFO ] [MAIN ] OBK: Wiping existing primary data before full refresh. [2025-09-17T20:49:31.965745] [INFO ] [LOCAL ] OBK: Starting deletion of primary data. [2025-09-17T20:49:31.966210] [DEBUG] [LOCAL ] OBK: Deleted primary data file. [2025-09-17T20:49:31.966256] [INFO ] [MAIN ] OBK: Starting full primary refresh. [2025-09-17T20:49:32.321001] [INFO ] [REMOTE ] OBK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:49:32.415733] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-11. [2025-09-17T20:49:33.215706] [INFO ] [REMOTE ] NYT: Fetching primary data for 2025-09. [2025-09-17T20:49:33.279421] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T20:49:33.298853] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T20:49:33.333872] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-06 (2.51 seconds). [2025-09-17T20:49:34.015842] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-07. [2025-09-17T20:49:34.813833] [INFO ] [REMOTE ] NYT: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T20:49:34.819544] [INFO ] [REMOTE ] O: Fetching primary data for 2025-07. [2025-09-17T20:49:34.821450] [INFO ] [REMOTE ] NYT: Full fetch complete (71943 records). [2025-09-17T20:49:34.821596] [DEBUG] [VALIDATOR ] NYT: Validating primary data. [2025-09-17T20:49:35.210704] [DEBUG] [VALIDATOR ] NYT: All expected trading days are present. [2025-09-17T20:49:35.210785] [DEBUG] [VALIDATOR ] NYT: Primary data validation passed. [2025-09-17T20:49:35.211724] [INFO ] [MAIN ] NYT: Fetched primary data is valid. [2025-09-17T20:49:35.211770] [DEBUG] [LOCAL ] NYT: Saving primary data. [2025-09-17T20:49:35.213200] [DEBUG] [LOCAL ] NYT: Trimmed 71943 records to 50051 (keeping 200 days of data) [2025-09-17T20:49:35.525958] [DEBUG] [LOCAL ] NYT: Primary data saved (50051 records). [2025-09-17T20:49:35.526109] [INFO ] [MAIN ] NYT: Full history saved. [2025-09-17T20:49:35.526209] [INFO ] [MAIN ] Update Progress: 1570/2371 symbols completed. NYT took 43.1s. Estimated remaining: 1h 57m 7s. Rate: 6.8 symbols/min [2025-09-17T20:49:35.624902] [INFO ] [REMOTE ] OBK: Fetching primary data for 2024-12. [2025-09-17T20:49:35.698803] [INFO ] [MAIN ] OC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:49:35.743362] [DEBUG] [LOCAL ] OC: Loaded 44862 existing records from primary storage. [2025-09-17T20:49:35.743515] [INFO ] [MAIN ] OC: Loaded 44862 existing records. [2025-09-17T20:49:35.920879] [WARN ] [MAIN ] OC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:49:35.921276] [INFO ] [MAIN ] OC: Wiping existing primary data before full refresh. [2025-09-17T20:49:35.921327] [INFO ] [LOCAL ] OC: Starting deletion of primary data. [2025-09-17T20:49:35.922325] [DEBUG] [LOCAL ] OC: Deleted primary data file. [2025-09-17T20:49:35.922378] [INFO ] [MAIN ] OC: Starting full primary refresh. [2025-09-17T20:49:36.248356] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T20:49:36.331829] [INFO ] [REMOTE ] OC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:49:36.415755] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-11. [2025-09-17T20:49:36.773555] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T20:49:37.208574] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-17T20:49:37.219625] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-08. [2025-09-17T20:49:37.587449] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T20:49:38.015862] [INFO ] [REMOTE ] OC: Fetching primary data for 2024-12. [2025-09-17T20:49:38.815758] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-01. [2025-09-17T20:49:39.149869] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-08 (1.93 seconds). [2025-09-17T20:49:39.615752] [INFO ] [REMOTE ] OBDC: Fetching primary data for 2025-09. [2025-09-17T20:49:39.927844] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T20:49:40.040768] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T20:49:40.415786] [INFO ] [REMOTE ] O: Fetching primary data for 2025-08. [2025-09-17T20:49:41.215781] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-02. [2025-09-17T20:49:41.366100] [INFO ] [REMOTE ] OBDC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T20:49:41.373635] [INFO ] [REMOTE ] OBDC: Full fetch complete (74648 records). [2025-09-17T20:49:41.373881] [DEBUG] [VALIDATOR ] OBDC: Validating primary data. [2025-09-17T20:49:41.788743] [DEBUG] [VALIDATOR ] OBDC: All expected trading days are present. [2025-09-17T20:49:41.788879] [DEBUG] [VALIDATOR ] OBDC: Primary data validation passed. [2025-09-17T20:49:41.790221] [INFO ] [MAIN ] OBDC: Fetched primary data is valid. [2025-09-17T20:49:41.790311] [DEBUG] [LOCAL ] OBDC: Saving primary data. [2025-09-17T20:49:41.792016] [DEBUG] [LOCAL ] OBDC: Trimmed 74648 records to 51636 (keeping 200 days of data) [2025-09-17T20:49:42.019445] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-01. [2025-09-17T20:49:42.131295] [DEBUG] [LOCAL ] OBDC: Primary data saved (51636 records). [2025-09-17T20:49:42.131452] [INFO ] [MAIN ] OBDC: Full history saved. [2025-09-17T20:49:42.131545] [INFO ] [MAIN ] Update Progress: 1571/2371 symbols completed. OBDC took 33.1s. Estimated remaining: 1h 56m 57s. Rate: 6.8 symbols/min [2025-09-17T20:49:42.304072] [INFO ] [MAIN ] OCFT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:49:42.315604] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T20:49:42.327834] [DEBUG] [LOCAL ] OCFT: Loaded 9725 existing records from primary storage. [2025-09-17T20:49:42.327960] [INFO ] [MAIN ] OCFT: Loaded 9725 existing records. [2025-09-17T20:49:42.509076] [WARN ] [MAIN ] OCFT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:49:42.509442] [INFO ] [MAIN ] OCFT: Wiping existing primary data before full refresh. [2025-09-17T20:49:42.509492] [INFO ] [LOCAL ] OCFT: Starting deletion of primary data. [2025-09-17T20:49:42.509845] [DEBUG] [LOCAL ] OCFT: Deleted primary data file. [2025-09-17T20:49:42.509901] [INFO ] [MAIN ] OCFT: Starting full primary refresh. [2025-09-17T20:49:42.821163] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-03. [2025-09-17T20:49:42.934265] [INFO ] [REMOTE ] OCFT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:49:42.973906] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-17T20:49:43.327304] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T20:49:43.615834] [INFO ] [REMOTE ] O: Fetching primary data for 2025-09. [2025-09-17T20:49:43.809282] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T20:49:44.415798] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-02. [2025-09-17T20:49:45.215785] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-11. [2025-09-17T20:49:45.901941] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-11 (0.69 seconds). [2025-09-17T20:49:45.991819] [INFO ] [REMOTE ] O: Incremental fetch complete for 2025-09 (2.38 seconds). [2025-09-17T20:49:45.999261] [INFO ] [REMOTE ] O: Full fetch complete (77534 records). [2025-09-17T20:49:45.999934] [DEBUG] [VALIDATOR ] O: Validating primary data. [2025-09-17T20:49:46.021598] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2024-12. [2025-09-17T20:49:46.223779] [WARN ] [VALIDATOR ] O: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T20:49:46.233226] [FATAL] [MAIN ] O: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:49:46.233317] [WARN ] [MAIN ] O: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:49:46.233368] [INFO ] [LOCAL ] O: Starting deletion of primary data. [2025-09-17T20:49:46.233442] [DEBUG] [LOCAL ] O: No primary data file found to delete. [2025-09-17T20:49:46.236144] [INFO ] [LOCAL ] O: Starting deletion of derivative data. [2025-09-17T20:49:46.236248] [DEBUG] [LOCAL ] O: No derivative data file found to delete. [2025-09-17T20:49:46.236332] [INFO ] [MAIN ] Update Progress: 1572/2371 symbols completed. O took 43.7s. Estimated remaining: 1h 56m 46s. Rate: 6.8 symbols/min [2025-09-17T20:49:46.307158] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T20:49:46.432516] [INFO ] [MAIN ] ODC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:49:46.442716] [DEBUG] [LOCAL ] ODC: Loaded 8458 existing records from primary storage. [2025-09-17T20:49:46.442836] [INFO ] [MAIN ] ODC: Loaded 8458 existing records. [2025-09-17T20:49:46.651561] [WARN ] [MAIN ] ODC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:49:46.651834] [INFO ] [MAIN ] ODC: Wiping existing primary data before full refresh. [2025-09-17T20:49:46.651883] [INFO ] [LOCAL ] ODC: Starting deletion of primary data. [2025-09-17T20:49:46.652338] [DEBUG] [LOCAL ] ODC: Deleted primary data file. [2025-09-17T20:49:46.652387] [INFO ] [MAIN ] ODC: Starting full primary refresh. [2025-09-17T20:49:46.769817] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T20:49:46.823184] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-01. [2025-09-17T20:49:47.030271] [INFO ] [REMOTE ] ODC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:49:47.562893] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T20:49:47.615741] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-03. [2025-09-17T20:49:48.415841] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-04. [2025-09-17T20:49:49.215749] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-11. [2025-09-17T20:49:49.528271] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T20:49:49.609297] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T20:49:49.821169] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T20:49:50.015773] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-05. [2025-09-17T20:49:50.815784] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-04. [2025-09-17T20:49:51.056673] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T20:49:51.615782] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-06. [2025-09-17T20:49:52.226156] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T20:49:52.415766] [INFO ] [REMOTE ] ODC: Fetching primary data for 2024-12. [2025-09-17T20:49:52.682441] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T20:49:53.215760] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-02. [2025-09-17T20:49:53.235609] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T20:49:54.015803] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-05. [2025-09-17T20:49:54.114021] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T20:49:54.815842] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-07. [2025-09-17T20:49:55.615803] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-01. [2025-09-17T20:49:55.784562] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T20:49:55.859531] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T20:49:56.099723] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T20:49:56.415805] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-08. [2025-09-17T20:49:57.215779] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-03. [2025-09-17T20:49:57.444407] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T20:49:58.015799] [INFO ] [REMOTE ] OBK: Fetching primary data for 2025-09. [2025-09-17T20:49:58.081052] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T20:49:58.778638] [INFO ] [REMOTE ] OBK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T20:49:58.781519] [INFO ] [REMOTE ] OBK: Full fetch complete (23946 records). [2025-09-17T20:49:58.781596] [DEBUG] [VALIDATOR ] OBK: Validating primary data. [2025-09-17T20:49:58.820973] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-04. [2025-09-17T20:49:59.169296] [DEBUG] [VALIDATOR ] OBK: All expected trading days are present. [2025-09-17T20:49:59.169392] [DEBUG] [VALIDATOR ] OBK: Primary data validation passed. [2025-09-17T20:49:59.170105] [INFO ] [MAIN ] OBK: Fetched primary data is valid. [2025-09-17T20:49:59.170150] [DEBUG] [LOCAL ] OBK: Saving primary data. [2025-09-17T20:49:59.171081] [DEBUG] [LOCAL ] OBK: Trimmed 23946 records to 16181 (keeping 200 days of data) [2025-09-17T20:49:59.277144] [DEBUG] [LOCAL ] OBK: Primary data saved (16181 records). [2025-09-17T20:49:59.277294] [INFO ] [MAIN ] OBK: Full history saved. [2025-09-17T20:49:59.277384] [INFO ] [MAIN ] Update Progress: 1573/2371 symbols completed. OBK took 27.7s. Estimated remaining: 1h 56m 40s. Rate: 6.8 symbols/min [2025-09-17T20:49:59.453398] [INFO ] [MAIN ] ODV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:49:59.479135] [DEBUG] [LOCAL ] ODV: Loaded 24721 existing records from primary storage. [2025-09-17T20:49:59.479297] [INFO ] [MAIN ] ODV: Loaded 24721 existing records. [2025-09-17T20:49:59.627879] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-02. [2025-09-17T20:49:59.675835] [WARN ] [MAIN ] ODV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:49:59.676263] [INFO ] [MAIN ] ODV: Wiping existing primary data before full refresh. [2025-09-17T20:49:59.676318] [INFO ] [LOCAL ] ODV: Starting deletion of primary data. [2025-09-17T20:49:59.677387] [DEBUG] [LOCAL ] ODV: Deleted primary data file. [2025-09-17T20:49:59.677491] [INFO ] [MAIN ] ODV: Starting full primary refresh. [2025-09-17T20:49:59.847832] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T20:50:00.082702] [INFO ] [REMOTE ] ODV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:50:00.415761] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-06. [2025-09-17T20:50:00.420255] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T20:50:01.215851] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-03. [2025-09-17T20:50:02.015782] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-05. [2025-09-17T20:50:02.113750] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T20:50:02.182140] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T20:50:02.815787] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-07. [2025-09-17T20:50:02.919939] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T20:50:03.615830] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-06. [2025-09-17T20:50:04.260092] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T20:50:04.287484] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T20:50:04.415803] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-07. [2025-09-17T20:50:05.215817] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-04. [2025-09-17T20:50:05.306231] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T20:50:06.015772] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-08. [2025-09-17T20:50:06.064955] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T20:50:06.783009] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T20:50:06.815788] [INFO ] [REMOTE ] OCFT: Fetching primary data for 2025-09. [2025-09-17T20:50:07.413162] [INFO ] [REMOTE ] OCFT: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T20:50:07.414422] [INFO ] [REMOTE ] OCFT: Full fetch complete (11725 records). [2025-09-17T20:50:07.414495] [DEBUG] [VALIDATOR ] OCFT: Validating primary data. [2025-09-17T20:50:07.620947] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-08. [2025-09-17T20:50:07.781386] [DEBUG] [VALIDATOR ] OCFT: All expected trading days are present. [2025-09-17T20:50:07.781464] [DEBUG] [VALIDATOR ] OCFT: Primary data validation passed. [2025-09-17T20:50:07.781757] [INFO ] [MAIN ] OCFT: Fetched primary data is valid. [2025-09-17T20:50:07.781799] [DEBUG] [LOCAL ] OCFT: Saving primary data. [2025-09-17T20:50:07.782294] [DEBUG] [LOCAL ] OCFT: Trimmed 11725 records to 9480 (keeping 200 days of data) [2025-09-17T20:50:07.837076] [DEBUG] [LOCAL ] OCFT: Primary data saved (9480 records). [2025-09-17T20:50:07.837219] [INFO ] [MAIN ] OCFT: Full history saved. [2025-09-17T20:50:07.837307] [INFO ] [MAIN ] Update Progress: 1574/2371 symbols completed. OCFT took 25.7s. Estimated remaining: 1h 56m 31s. Rate: 6.8 symbols/min [2025-09-17T20:50:08.019947] [INFO ] [MAIN ] OEC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:50:08.061062] [DEBUG] [LOCAL ] OEC: Loaded 37497 existing records from primary storage. [2025-09-17T20:50:08.061240] [INFO ] [MAIN ] OEC: Loaded 37497 existing records. [2025-09-17T20:50:08.240570] [WARN ] [MAIN ] OEC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:50:08.240902] [INFO ] [MAIN ] OEC: Wiping existing primary data before full refresh. [2025-09-17T20:50:08.240950] [INFO ] [LOCAL ] OEC: Starting deletion of primary data. [2025-09-17T20:50:08.241990] [DEBUG] [LOCAL ] OEC: Deleted primary data file. [2025-09-17T20:50:08.242045] [INFO ] [MAIN ] OEC: Starting full primary refresh. [2025-09-17T20:50:08.423539] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-11. [2025-09-17T20:50:08.601603] [INFO ] [REMOTE ] OEC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:50:09.215924] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-05. [2025-09-17T20:50:09.478165] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T20:50:09.619389] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T20:50:09.789426] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T20:50:10.015828] [INFO ] [REMOTE ] ODV: Fetching primary data for 2024-12. [2025-09-17T20:50:10.815873] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-11. [2025-09-17T20:50:11.217744] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T20:50:11.615749] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-01. [2025-09-17T20:50:12.208536] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T20:50:12.415820] [INFO ] [REMOTE ] OEC: Fetching primary data for 2024-12. [2025-09-17T20:50:12.460231] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T20:50:13.215843] [INFO ] [REMOTE ] OC: Fetching primary data for 2025-09. [2025-09-17T20:50:13.378699] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T20:50:14.015837] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-01. [2025-09-17T20:50:14.744129] [INFO ] [REMOTE ] OC: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T20:50:14.755980] [INFO ] [REMOTE ] OC: Full fetch complete (63816 records). [2025-09-17T20:50:14.756258] [DEBUG] [VALIDATOR ] OC: Validating primary data. [2025-09-17T20:50:14.821008] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-06. [2025-09-17T20:50:15.263968] [DEBUG] [VALIDATOR ] OC: All expected trading days are present. [2025-09-17T20:50:15.264172] [DEBUG] [VALIDATOR ] OC: Primary data validation passed. [2025-09-17T20:50:15.265250] [INFO ] [MAIN ] OC: Fetched primary data is valid. [2025-09-17T20:50:15.265335] [DEBUG] [LOCAL ] OC: Saving primary data. [2025-09-17T20:50:15.273361] [DEBUG] [LOCAL ] OC: Trimmed 63816 records to 44873 (keeping 200 days of data) [2025-09-17T20:50:15.290338] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T20:50:15.586924] [DEBUG] [LOCAL ] OC: Primary data saved (44873 records). [2025-09-17T20:50:15.587079] [INFO ] [MAIN ] OC: Full history saved. [2025-09-17T20:50:15.587206] [INFO ] [MAIN ] Update Progress: 1575/2371 symbols completed. OC took 40.1s. Estimated remaining: 1h 56m 21s. Rate: 6.8 symbols/min [2025-09-17T20:50:15.620881] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-02. [2025-09-17T20:50:15.758377] [INFO ] [MAIN ] OFG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:50:15.780519] [DEBUG] [LOCAL ] OFG: Loaded 22442 existing records from primary storage. [2025-09-17T20:50:15.780685] [INFO ] [MAIN ] OFG: Loaded 22442 existing records. [2025-09-17T20:50:15.960423] [WARN ] [MAIN ] OFG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:50:15.968274] [INFO ] [MAIN ] OFG: Wiping existing primary data before full refresh. [2025-09-17T20:50:15.968388] [INFO ] [LOCAL ] OFG: Starting deletion of primary data. [2025-09-17T20:50:15.969549] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T20:50:15.972017] [DEBUG] [LOCAL ] OFG: Deleted primary data file. [2025-09-17T20:50:15.972451] [INFO ] [MAIN ] OFG: Starting full primary refresh. [2025-09-17T20:50:16.347951] [INFO ] [REMOTE ] OFG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:50:16.356734] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T20:50:16.415825] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-07. [2025-09-17T20:50:17.215796] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-03. [2025-09-17T20:50:17.313060] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T20:50:18.015786] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-08. [2025-09-17T20:50:18.268395] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T20:50:18.687941] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T20:50:18.815787] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-02. [2025-09-17T20:50:19.615866] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-11. [2025-09-17T20:50:20.310723] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T20:50:20.415743] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-03. [2025-09-17T20:50:20.902347] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T20:50:21.215816] [INFO ] [REMOTE ] ODC: Fetching primary data for 2025-09. [2025-09-17T20:50:21.974379] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T20:50:22.015783] [INFO ] [REMOTE ] OFG: Fetching primary data for 2024-12. [2025-09-17T20:50:22.050251] [INFO ] [REMOTE ] ODC: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T20:50:22.052088] [INFO ] [REMOTE ] ODC: Full fetch complete (10790 records). [2025-09-17T20:50:22.052174] [DEBUG] [VALIDATOR ] ODC: Validating primary data. [2025-09-17T20:50:22.425124] [DEBUG] [VALIDATOR ] ODC: All expected trading days are present. [2025-09-17T20:50:22.425211] [DEBUG] [VALIDATOR ] ODC: Primary data validation passed. [2025-09-17T20:50:22.425593] [INFO ] [MAIN ] ODC: Fetched primary data is valid. [2025-09-17T20:50:22.425662] [DEBUG] [LOCAL ] ODC: Saving primary data. [2025-09-17T20:50:22.426372] [DEBUG] [LOCAL ] ODC: Trimmed 10790 records to 8503 (keeping 200 days of data) [2025-09-17T20:50:22.481365] [DEBUG] [LOCAL ] ODC: Primary data saved (8503 records). [2025-09-17T20:50:22.481509] [INFO ] [MAIN ] ODC: Full history saved. [2025-09-17T20:50:22.481626] [INFO ] [MAIN ] Update Progress: 1576/2371 symbols completed. ODC took 36.2s. Estimated remaining: 1h 56m 12s. Rate: 6.8 symbols/min [2025-09-17T20:50:22.649831] [INFO ] [MAIN ] OGE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:50:22.702104] [DEBUG] [LOCAL ] OGE: Loaded 46674 existing records from primary storage. [2025-09-17T20:50:22.702277] [INFO ] [MAIN ] OGE: Loaded 46674 existing records. [2025-09-17T20:50:22.820855] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-04. [2025-09-17T20:50:22.893427] [WARN ] [MAIN ] OGE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:50:22.893717] [INFO ] [MAIN ] OGE: Wiping existing primary data before full refresh. [2025-09-17T20:50:22.893766] [INFO ] [LOCAL ] OGE: Starting deletion of primary data. [2025-09-17T20:50:22.894920] [DEBUG] [LOCAL ] OGE: Deleted primary data file. [2025-09-17T20:50:22.895013] [INFO ] [MAIN ] OGE: Starting full primary refresh. [2025-09-17T20:50:23.273877] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T20:50:23.321321] [INFO ] [REMOTE ] OGE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:50:23.615826] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-04. [2025-09-17T20:50:24.185877] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T20:50:24.415758] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-05. [2025-09-17T20:50:24.805687] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T20:50:25.215824] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-05. [2025-09-17T20:50:26.020797] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-11. [2025-09-17T20:50:26.034029] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T20:50:26.274805] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T20:50:26.815808] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-06. [2025-09-17T20:50:27.615818] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-06. [2025-09-17T20:50:27.732353] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T20:50:27.804961] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T20:50:28.415798] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-07. [2025-09-17T20:50:28.879239] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T20:50:29.215838] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-01. [2025-09-17T20:50:29.932996] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T20:50:30.015796] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-08. [2025-09-17T20:50:30.671950] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T20:50:30.815788] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-02. [2025-09-17T20:50:31.510128] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T20:50:31.615787] [INFO ] [REMOTE ] OEC: Fetching primary data for 2025-09. [2025-09-17T20:50:32.094157] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T20:50:32.415783] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-07. [2025-09-17T20:50:32.578323] [INFO ] [REMOTE ] OEC: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T20:50:32.584013] [INFO ] [REMOTE ] OEC: Full fetch complete (52516 records). [2025-09-17T20:50:32.584150] [DEBUG] [VALIDATOR ] OEC: Validating primary data. [2025-09-17T20:50:32.972108] [DEBUG] [VALIDATOR ] OEC: All expected trading days are present. [2025-09-17T20:50:32.972193] [DEBUG] [VALIDATOR ] OEC: Primary data validation passed. [2025-09-17T20:50:32.973023] [INFO ] [MAIN ] OEC: Fetched primary data is valid. [2025-09-17T20:50:32.973067] [DEBUG] [LOCAL ] OEC: Saving primary data. [2025-09-17T20:50:32.974304] [DEBUG] [LOCAL ] OEC: Trimmed 52516 records to 37489 (keeping 200 days of data) [2025-09-17T20:50:33.210907] [DEBUG] [LOCAL ] OEC: Primary data saved (37489 records). [2025-09-17T20:50:33.211320] [INFO ] [MAIN ] OEC: Full history saved. [2025-09-17T20:50:33.211508] [INFO ] [MAIN ] Update Progress: 1577/2371 symbols completed. OEC took 25.4s. Estimated remaining: 1h 56m 4s. Rate: 6.8 symbols/min [2025-09-17T20:50:33.216982] [INFO ] [REMOTE ] OGE: Fetching primary data for 2024-12. [2025-09-17T20:50:33.388045] [INFO ] [MAIN ] OGN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:50:33.441131] [DEBUG] [LOCAL ] OGN: Loaded 53131 existing records from primary storage. [2025-09-17T20:50:33.441335] [INFO ] [MAIN ] OGN: Loaded 53131 existing records. [2025-09-17T20:50:33.624278] [WARN ] [MAIN ] OGN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:50:33.624565] [INFO ] [MAIN ] OGN: Wiping existing primary data before full refresh. [2025-09-17T20:50:33.624613] [INFO ] [LOCAL ] OGN: Starting deletion of primary data. [2025-09-17T20:50:33.630836] [DEBUG] [LOCAL ] OGN: Deleted primary data file. [2025-09-17T20:50:33.640295] [INFO ] [MAIN ] OGN: Starting full primary refresh. [2025-09-17T20:50:33.673352] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T20:50:34.008852] [INFO ] [REMOTE ] OGN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:50:34.015725] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-11. [2025-09-17T20:50:34.728759] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T20:50:34.815792] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-03. [2025-09-17T20:50:35.602409] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-11 (1.59 seconds). [2025-09-17T20:50:35.615723] [INFO ] [REMOTE ] OGN: Fetching primary data for 2024-12. [2025-09-17T20:50:36.232039] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T20:50:36.415774] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-04. [2025-09-17T20:50:37.215776] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-01. [2025-09-17T20:50:37.611185] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T20:50:37.727281] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T20:50:38.015796] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-01. [2025-09-17T20:50:38.582497] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T20:50:38.815782] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-05. [2025-09-17T20:50:39.615778] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-08. [2025-09-17T20:50:39.700802] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T20:50:39.831360] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T20:50:40.415777] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-02. [2025-09-17T20:50:41.104856] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T20:50:41.215785] [INFO ] [REMOTE ] ODV: Fetching primary data for 2025-09. [2025-09-17T20:50:41.999338] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T20:50:42.015726] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-03. [2025-09-17T20:50:42.322218] [INFO ] [REMOTE ] ODV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T20:50:42.328138] [INFO ] [REMOTE ] ODV: Full fetch complete (31030 records). [2025-09-17T20:50:42.328263] [DEBUG] [VALIDATOR ] ODV: Validating primary data. [2025-09-17T20:50:42.713156] [DEBUG] [VALIDATOR ] ODV: All expected trading days are present. [2025-09-17T20:50:42.713383] [DEBUG] [VALIDATOR ] ODV: Primary data validation passed. [2025-09-17T20:50:42.714086] [INFO ] [MAIN ] ODV: Fetched primary data is valid. [2025-09-17T20:50:42.714134] [DEBUG] [LOCAL ] ODV: Saving primary data. [2025-09-17T20:50:42.715180] [DEBUG] [LOCAL ] ODV: Trimmed 31030 records to 24855 (keeping 200 days of data) [2025-09-17T20:50:42.815854] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-06. [2025-09-17T20:50:42.863828] [DEBUG] [LOCAL ] ODV: Primary data saved (24855 records). [2025-09-17T20:50:42.863969] [INFO ] [MAIN ] ODV: Full history saved. [2025-09-17T20:50:42.864073] [INFO ] [MAIN ] Update Progress: 1578/2371 symbols completed. ODV took 43.6s. Estimated remaining: 1h 55m 56s. Rate: 6.8 symbols/min [2025-09-17T20:50:43.051819] [INFO ] [MAIN ] OGS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:50:43.087710] [DEBUG] [LOCAL ] OGS: Loaded 33927 existing records from primary storage. [2025-09-17T20:50:43.087877] [INFO ] [MAIN ] OGS: Loaded 33927 existing records. [2025-09-17T20:50:43.282229] [WARN ] [MAIN ] OGS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:50:43.282744] [INFO ] [MAIN ] OGS: Wiping existing primary data before full refresh. [2025-09-17T20:50:43.282799] [INFO ] [LOCAL ] OGS: Starting deletion of primary data. [2025-09-17T20:50:43.283595] [DEBUG] [LOCAL ] OGS: Deleted primary data file. [2025-09-17T20:50:43.283679] [INFO ] [MAIN ] OGS: Starting full primary refresh. [2025-09-17T20:50:43.620878] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-02. [2025-09-17T20:50:43.684901] [INFO ] [REMOTE ] OGS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:50:43.746256] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T20:50:43.926047] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T20:50:44.415784] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-11. [2025-09-17T20:50:45.175996] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T20:50:45.215714] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-03. [2025-09-17T20:50:45.560443] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T20:50:46.015827] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-04. [2025-09-17T20:50:46.815794] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-07. [2025-09-17T20:50:47.078553] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T20:50:47.615762] [INFO ] [REMOTE ] OGS: Fetching primary data for 2024-12. [2025-09-17T20:50:48.074744] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T20:50:48.182380] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T20:50:48.415772] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-08. [2025-09-17T20:50:48.774259] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T20:50:49.215757] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-05. [2025-09-17T20:50:49.518022] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T20:50:50.015779] [INFO ] [REMOTE ] OFG: Fetching primary data for 2025-09. [2025-09-17T20:50:50.815828] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-01. [2025-09-17T20:50:51.025188] [INFO ] [REMOTE ] OFG: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T20:50:51.028057] [INFO ] [REMOTE ] OFG: Full fetch complete (34487 records). [2025-09-17T20:50:51.028168] [DEBUG] [VALIDATOR ] OFG: Validating primary data. [2025-09-17T20:50:51.432672] [DEBUG] [VALIDATOR ] OFG: All expected trading days are present. [2025-09-17T20:50:51.432876] [DEBUG] [VALIDATOR ] OFG: Primary data validation passed. [2025-09-17T20:50:51.433560] [INFO ] [MAIN ] OFG: Fetched primary data is valid. [2025-09-17T20:50:51.433612] [DEBUG] [LOCAL ] OFG: Saving primary data. [2025-09-17T20:50:51.438277] [DEBUG] [LOCAL ] OFG: Trimmed 34487 records to 22371 (keeping 200 days of data) [2025-09-17T20:50:51.572471] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-17T20:50:51.618839] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-06. [2025-09-17T20:50:51.623690] [DEBUG] [LOCAL ] OFG: Primary data saved (22371 records). [2025-09-17T20:50:51.623878] [INFO ] [MAIN ] OFG: Full history saved. [2025-09-17T20:50:51.623993] [INFO ] [MAIN ] Update Progress: 1579/2371 symbols completed. OFG took 36.0s. Estimated remaining: 1h 55m 47s. Rate: 6.8 symbols/min [2025-09-17T20:50:51.797463] [INFO ] [MAIN ] OHI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:50:51.845058] [DEBUG] [LOCAL ] OHI: Loaded 52178 existing records from primary storage. [2025-09-17T20:50:51.845231] [INFO ] [MAIN ] OHI: Loaded 52178 existing records. [2025-09-17T20:50:52.021535] [WARN ] [MAIN ] OHI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:50:52.021819] [INFO ] [MAIN ] OHI: Wiping existing primary data before full refresh. [2025-09-17T20:50:52.021874] [INFO ] [LOCAL ] OHI: Starting deletion of primary data. [2025-09-17T20:50:52.023142] [DEBUG] [LOCAL ] OHI: Deleted primary data file. [2025-09-17T20:50:52.023194] [INFO ] [MAIN ] OHI: Starting full primary refresh. [2025-09-17T20:50:52.386576] [INFO ] [REMOTE ] OHI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:50:52.404716] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T20:50:52.415679] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-11. [2025-09-17T20:50:53.215802] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-04. [2025-09-17T20:50:53.264999] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T20:50:54.015791] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-07. [2025-09-17T20:50:54.388020] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T20:50:54.726949] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T20:50:54.815818] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-05. [2025-09-17T20:50:55.615806] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-02. [2025-09-17T20:50:55.861925] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T20:50:56.079629] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T20:50:56.415840] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-06. [2025-09-17T20:50:56.603109] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T20:50:57.215854] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-08. [2025-09-17T20:50:57.954970] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T20:50:58.015740] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-07. [2025-09-17T20:50:58.815748] [INFO ] [REMOTE ] OHI: Fetching primary data for 2024-12. [2025-09-17T20:50:58.926213] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T20:50:59.456803] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T20:50:59.615769] [INFO ] [REMOTE ] OGN: Fetching primary data for 2025-09. [2025-09-17T20:51:00.415745] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-03. [2025-09-17T20:51:00.473698] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T20:51:01.060814] [INFO ] [REMOTE ] OGN: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T20:51:01.067773] [INFO ] [REMOTE ] OGN: Full fetch complete (76629 records). [2025-09-17T20:51:01.067930] [DEBUG] [VALIDATOR ] OGN: Validating primary data. [2025-09-17T20:51:01.223872] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-01. [2025-09-17T20:51:01.484677] [DEBUG] [VALIDATOR ] OGN: All expected trading days are present. [2025-09-17T20:51:01.484784] [DEBUG] [VALIDATOR ] OGN: Primary data validation passed. [2025-09-17T20:51:01.485970] [INFO ] [MAIN ] OGN: Fetched primary data is valid. [2025-09-17T20:51:01.486026] [DEBUG] [LOCAL ] OGN: Saving primary data. [2025-09-17T20:51:01.487746] [DEBUG] [LOCAL ] OGN: Trimmed 76629 records to 53130 (keeping 200 days of data) [2025-09-17T20:51:01.843370] [DEBUG] [LOCAL ] OGN: Primary data saved (53130 records). [2025-09-17T20:51:01.843608] [INFO ] [MAIN ] OGN: Full history saved. [2025-09-17T20:51:01.855663] [INFO ] [MAIN ] Update Progress: 1580/2371 symbols completed. OGN took 28.6s. Estimated remaining: 1h 55m 39s. Rate: 6.8 symbols/min [2025-09-17T20:51:01.929660] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T20:51:02.031502] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-08. [2025-09-17T20:51:02.065571] [INFO ] [MAIN ] OI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:51:02.112804] [DEBUG] [LOCAL ] OI: Loaded 47479 existing records from primary storage. [2025-09-17T20:51:02.113018] [INFO ] [MAIN ] OI: Loaded 47479 existing records. [2025-09-17T20:51:02.310154] [WARN ] [MAIN ] OI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:51:02.310451] [INFO ] [MAIN ] OI: Wiping existing primary data before full refresh. [2025-09-17T20:51:02.310503] [INFO ] [LOCAL ] OI: Starting deletion of primary data. [2025-09-17T20:51:02.311414] [DEBUG] [LOCAL ] OI: Deleted primary data file. [2025-09-17T20:51:02.311468] [INFO ] [MAIN ] OI: Starting full primary refresh. [2025-09-17T20:51:02.686624] [INFO ] [REMOTE ] OI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:51:02.815791] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-11. [2025-09-17T20:51:03.218020] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T20:51:03.428782] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T20:51:03.615802] [INFO ] [REMOTE ] OGE: Fetching primary data for 2025-09. [2025-09-17T20:51:04.415883] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-04. [2025-09-17T20:51:04.526683] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T20:51:04.907982] [INFO ] [REMOTE ] OGE: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T20:51:04.914827] [INFO ] [REMOTE ] OGE: Full fetch complete (66583 records). [2025-09-17T20:51:04.915047] [DEBUG] [VALIDATOR ] OGE: Validating primary data. [2025-09-17T20:51:05.220987] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-02. [2025-09-17T20:51:05.329160] [DEBUG] [VALIDATOR ] OGE: All expected trading days are present. [2025-09-17T20:51:05.329344] [DEBUG] [VALIDATOR ] OGE: Primary data validation passed. [2025-09-17T20:51:05.330361] [INFO ] [MAIN ] OGE: Fetched primary data is valid. [2025-09-17T20:51:05.330411] [DEBUG] [LOCAL ] OGE: Saving primary data. [2025-09-17T20:51:05.332932] [DEBUG] [LOCAL ] OGE: Trimmed 66583 records to 46665 (keeping 200 days of data) [2025-09-17T20:51:05.637698] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T20:51:05.652651] [DEBUG] [LOCAL ] OGE: Primary data saved (46665 records). [2025-09-17T20:51:05.652813] [INFO ] [MAIN ] OGE: Full history saved. [2025-09-17T20:51:05.652917] [INFO ] [MAIN ] Update Progress: 1581/2371 symbols completed. OGE took 43.2s. Estimated remaining: 1h 55m 27s. Rate: 6.8 symbols/min [2025-09-17T20:51:05.822201] [INFO ] [MAIN ] OIA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:51:05.835522] [DEBUG] [LOCAL ] OIA: Loaded 13630 existing records from primary storage. [2025-09-17T20:51:05.835626] [INFO ] [MAIN ] OIA: Loaded 13630 existing records. [2025-09-17T20:51:06.015342] [WARN ] [MAIN ] OIA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:51:06.015671] [INFO ] [MAIN ] OIA: Wiping existing primary data before full refresh. [2025-09-17T20:51:06.015720] [INFO ] [LOCAL ] OIA: Starting deletion of primary data. [2025-09-17T20:51:06.015809] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-05. [2025-09-17T20:51:06.016988] [DEBUG] [LOCAL ] OIA: Deleted primary data file. [2025-09-17T20:51:06.017060] [INFO ] [MAIN ] OIA: Starting full primary refresh. [2025-09-17T20:51:06.369205] [INFO ] [REMOTE ] OIA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:51:06.815719] [INFO ] [REMOTE ] OI: Fetching primary data for 2024-12. [2025-09-17T20:51:06.848020] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T20:51:07.620904] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-03. [2025-09-17T20:51:07.638674] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T20:51:08.415823] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-06. [2025-09-17T20:51:08.584833] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T20:51:09.215801] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-01. [2025-09-17T20:51:09.333590] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T20:51:09.457906] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T20:51:10.015811] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-07. [2025-09-17T20:51:10.577915] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T20:51:10.815796] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-02. [2025-09-17T20:51:11.233438] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T20:51:11.615775] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-11. [2025-09-17T20:51:12.057774] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T20:51:12.311191] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-17T20:51:12.415782] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-08. [2025-09-17T20:51:13.215782] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-04. [2025-09-17T20:51:13.882518] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T20:51:14.015787] [INFO ] [REMOTE ] OGS: Fetching primary data for 2025-09. [2025-09-17T20:51:14.815786] [INFO ] [REMOTE ] OIA: Fetching primary data for 2024-12. [2025-09-17T20:51:14.999818] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T20:51:15.265009] [INFO ] [REMOTE ] OGS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T20:51:15.269262] [INFO ] [REMOTE ] OGS: Full fetch complete (47671 records). [2025-09-17T20:51:15.269380] [DEBUG] [VALIDATOR ] OGS: Validating primary data. [2025-09-17T20:51:15.620934] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-03. [2025-09-17T20:51:15.660254] [DEBUG] [VALIDATOR ] OGS: All expected trading days are present. [2025-09-17T20:51:15.660338] [DEBUG] [VALIDATOR ] OGS: Primary data validation passed. [2025-09-17T20:51:15.661125] [INFO ] [MAIN ] OGS: Fetched primary data is valid. [2025-09-17T20:51:15.661172] [DEBUG] [LOCAL ] OGS: Saving primary data. [2025-09-17T20:51:15.662235] [DEBUG] [LOCAL ] OGS: Trimmed 47671 records to 33913 (keeping 200 days of data) [2025-09-17T20:51:15.872707] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T20:51:15.904286] [DEBUG] [LOCAL ] OGS: Primary data saved (33913 records). [2025-09-17T20:51:15.904455] [INFO ] [MAIN ] OGS: Full history saved. [2025-09-17T20:51:15.905676] [INFO ] [MAIN ] Update Progress: 1582/2371 symbols completed. OGS took 33.0s. Estimated remaining: 1h 55m 19s. Rate: 6.8 symbols/min [2025-09-17T20:51:16.085190] [INFO ] [MAIN ] OII: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:51:16.126962] [DEBUG] [LOCAL ] OII: Loaded 43228 existing records from primary storage. [2025-09-17T20:51:16.127117] [INFO ] [MAIN ] OII: Loaded 43228 existing records. [2025-09-17T20:51:16.317144] [WARN ] [MAIN ] OII: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:51:16.317400] [INFO ] [MAIN ] OII: Wiping existing primary data before full refresh. [2025-09-17T20:51:16.317449] [INFO ] [LOCAL ] OII: Starting deletion of primary data. [2025-09-17T20:51:16.318310] [DEBUG] [LOCAL ] OII: Deleted primary data file. [2025-09-17T20:51:16.318363] [INFO ] [MAIN ] OII: Starting full primary refresh. [2025-09-17T20:51:16.419135] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-01. [2025-09-17T20:51:16.684403] [INFO ] [REMOTE ] OII: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:51:17.216124] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T20:51:17.216215] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-05. [2025-09-17T20:51:17.468429] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T20:51:18.015794] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-11. [2025-09-17T20:51:18.815758] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-02. [2025-09-17T20:51:18.971435] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T20:51:19.248959] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T20:51:19.615791] [INFO ] [REMOTE ] OII: Fetching primary data for 2024-12. [2025-09-17T20:51:19.879591] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T20:51:20.415790] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-04. [2025-09-17T20:51:21.109925] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T20:51:21.215777] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-01. [2025-09-17T20:51:22.015708] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-06. [2025-09-17T20:51:22.089745] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T20:51:22.800064] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T20:51:22.815699] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-03. [2025-09-17T20:51:23.615792] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-05. [2025-09-17T20:51:23.856795] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T20:51:23.898617] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T20:51:24.415802] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-04. [2025-09-17T20:51:25.220787] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-07. [2025-09-17T20:51:25.241806] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T20:51:25.470540] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T20:51:26.015840] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-06. [2025-09-17T20:51:26.815853] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-05. [2025-09-17T20:51:27.059344] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T20:51:27.615910] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-08. [2025-09-17T20:51:27.679429] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T20:51:27.679513] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T20:51:28.415789] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-07. [2025-09-17T20:51:29.131365] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T20:51:29.215795] [INFO ] [REMOTE ] OHI: Fetching primary data for 2025-09. [2025-09-17T20:51:29.743086] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T20:51:30.015854] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-06. [2025-09-17T20:51:30.573052] [INFO ] [REMOTE ] OHI: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T20:51:30.579928] [INFO ] [REMOTE ] OHI: Full fetch complete (74929 records). [2025-09-17T20:51:30.580065] [DEBUG] [VALIDATOR ] OHI: Validating primary data. [2025-09-17T20:51:30.820927] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-08. [2025-09-17T20:51:31.000501] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T20:51:31.000796] [DEBUG] [VALIDATOR ] OHI: All expected trading days are present. [2025-09-17T20:51:31.004182] [DEBUG] [VALIDATOR ] OHI: Primary data validation passed. [2025-09-17T20:51:31.005712] [INFO ] [MAIN ] OHI: Fetched primary data is valid. [2025-09-17T20:51:31.006124] [DEBUG] [LOCAL ] OHI: Saving primary data. [2025-09-17T20:51:31.007585] [DEBUG] [LOCAL ] OHI: Trimmed 74929 records to 52161 (keeping 200 days of data) [2025-09-17T20:51:31.349909] [DEBUG] [LOCAL ] OHI: Primary data saved (52161 records). [2025-09-17T20:51:31.350067] [INFO ] [MAIN ] OHI: Full history saved. [2025-09-17T20:51:31.350159] [INFO ] [MAIN ] Update Progress: 1583/2371 symbols completed. OHI took 39.7s. Estimated remaining: 1h 55m 14s. Rate: 6.8 symbols/min [2025-09-17T20:51:31.539860] [INFO ] [MAIN ] OIS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:51:31.578960] [DEBUG] [LOCAL ] OIS: Loaded 41051 existing records from primary storage. [2025-09-17T20:51:31.579112] [INFO ] [MAIN ] OIS: Loaded 41051 existing records. [2025-09-17T20:51:31.622681] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-02. [2025-09-17T20:51:31.765139] [WARN ] [MAIN ] OIS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:51:31.765380] [INFO ] [MAIN ] OIS: Wiping existing primary data before full refresh. [2025-09-17T20:51:31.765428] [INFO ] [LOCAL ] OIS: Starting deletion of primary data. [2025-09-17T20:51:31.766207] [DEBUG] [LOCAL ] OIS: Deleted primary data file. [2025-09-17T20:51:31.766267] [INFO ] [MAIN ] OIS: Starting full primary refresh. [2025-09-17T20:51:32.127684] [INFO ] [REMOTE ] OIS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:51:32.415786] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-11. [2025-09-17T20:51:32.457296] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T20:51:32.997514] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T20:51:33.215787] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-03. [2025-09-17T20:51:33.479407] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T20:51:34.015779] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-07. [2025-09-17T20:51:34.825782] [INFO ] [REMOTE ] OI: Fetching primary data for 2025-09. [2025-09-17T20:51:34.829328] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T20:51:34.978088] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T20:51:35.615833] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-08. [2025-09-17T20:51:36.322351] [INFO ] [REMOTE ] OI: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T20:51:36.328980] [INFO ] [REMOTE ] OI: Full fetch complete (68098 records). [2025-09-17T20:51:36.329094] [DEBUG] [VALIDATOR ] OI: Validating primary data. [2025-09-17T20:51:36.421323] [INFO ] [REMOTE ] OIS: Fetching primary data for 2024-12. [2025-09-17T20:51:36.739484] [DEBUG] [VALIDATOR ] OI: All expected trading days are present. [2025-09-17T20:51:36.740076] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T20:51:36.744403] [DEBUG] [VALIDATOR ] OI: Primary data validation passed. [2025-09-17T20:51:36.745807] [INFO ] [MAIN ] OI: Fetched primary data is valid. [2025-09-17T20:51:36.745882] [DEBUG] [LOCAL ] OI: Saving primary data. [2025-09-17T20:51:36.747536] [DEBUG] [LOCAL ] OI: Trimmed 68098 records to 47447 (keeping 200 days of data) [2025-09-17T20:51:37.021921] [DEBUG] [LOCAL ] OI: Primary data saved (47447 records). [2025-09-17T20:51:37.022058] [INFO ] [MAIN ] OI: Full history saved. [2025-09-17T20:51:37.022141] [INFO ] [MAIN ] Update Progress: 1584/2371 symbols completed. OI took 35.2s. Estimated remaining: 1h 55m 4s. Rate: 6.8 symbols/min [2025-09-17T20:51:37.190746] [INFO ] [MAIN ] OKE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:51:37.218387] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-04. [2025-09-17T20:51:37.241941] [DEBUG] [LOCAL ] OKE: Loaded 53535 existing records from primary storage. [2025-09-17T20:51:37.242079] [INFO ] [MAIN ] OKE: Loaded 53535 existing records. [2025-09-17T20:51:37.419412] [WARN ] [MAIN ] OKE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:51:37.419678] [INFO ] [MAIN ] OKE: Wiping existing primary data before full refresh. [2025-09-17T20:51:37.419731] [INFO ] [LOCAL ] OKE: Starting deletion of primary data. [2025-09-17T20:51:37.421034] [DEBUG] [LOCAL ] OKE: Deleted primary data file. [2025-09-17T20:51:37.421087] [INFO ] [MAIN ] OKE: Starting full primary refresh. [2025-09-17T20:51:37.782608] [INFO ] [REMOTE ] OKE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:51:37.995972] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T20:51:38.015719] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-01. [2025-09-17T20:51:38.545321] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T20:51:38.815846] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-11. [2025-09-17T20:51:39.463925] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T20:51:39.615743] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-02. [2025-09-17T20:51:40.415806] [INFO ] [REMOTE ] OIA: Fetching primary data for 2025-09. [2025-09-17T20:51:40.739513] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-11 (1.92 seconds). [2025-09-17T20:51:40.858520] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T20:51:41.095825] [INFO ] [REMOTE ] OIA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T20:51:41.098614] [INFO ] [REMOTE ] OIA: Full fetch complete (20839 records). [2025-09-17T20:51:41.098720] [DEBUG] [VALIDATOR ] OIA: Validating primary data. [2025-09-17T20:51:41.220885] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-03. [2025-09-17T20:51:41.495056] [DEBUG] [VALIDATOR ] OIA: All expected trading days are present. [2025-09-17T20:51:41.495141] [DEBUG] [VALIDATOR ] OIA: Primary data validation passed. [2025-09-17T20:51:41.495595] [INFO ] [MAIN ] OIA: Fetched primary data is valid. [2025-09-17T20:51:41.495633] [DEBUG] [LOCAL ] OIA: Saving primary data. [2025-09-17T20:51:41.496232] [DEBUG] [LOCAL ] OIA: Trimmed 20839 records to 13771 (keeping 200 days of data) [2025-09-17T20:51:41.576703] [DEBUG] [LOCAL ] OIA: Primary data saved (13771 records). [2025-09-17T20:51:41.576853] [INFO ] [MAIN ] OIA: Full history saved. [2025-09-17T20:51:41.576938] [INFO ] [MAIN ] Update Progress: 1585/2371 symbols completed. OIA took 35.9s. Estimated remaining: 1h 54m 53s. Rate: 6.8 symbols/min [2025-09-17T20:51:41.751918] [INFO ] [MAIN ] OKLO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:51:41.804512] [DEBUG] [LOCAL ] OKLO: Loaded 53819 existing records from primary storage. [2025-09-17T20:51:41.804689] [INFO ] [MAIN ] OKLO: Loaded 53819 existing records. [2025-09-17T20:51:41.984194] [WARN ] [MAIN ] OKLO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:51:41.984500] [INFO ] [MAIN ] OKLO: Wiping existing primary data before full refresh. [2025-09-17T20:51:41.984551] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-17T20:51:41.985524] [DEBUG] [LOCAL ] OKLO: Deleted primary data file. [2025-09-17T20:51:41.985577] [INFO ] [MAIN ] OKLO: Starting full primary refresh. [2025-09-17T20:51:42.021014] [INFO ] [REMOTE ] OKE: Fetching primary data for 2024-12. [2025-09-17T20:51:42.347032] [INFO ] [REMOTE ] OKLO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:51:42.820889] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-05. [2025-09-17T20:51:42.836548] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T20:51:43.615834] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-11. [2025-09-17T20:51:43.900897] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T20:51:44.363842] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T20:51:44.415719] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-06. [2025-09-17T20:51:45.215789] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-01. [2025-09-17T20:51:45.723560] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T20:51:46.015796] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-07. [2025-09-17T20:51:46.304558] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-11 (2.69 seconds). [2025-09-17T20:51:46.815754] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2024-12. [2025-09-17T20:51:46.888663] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T20:51:47.429887] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T20:51:47.615768] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-02. [2025-09-17T20:51:48.415808] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-04. [2025-09-17T20:51:49.227807] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-08. [2025-09-17T20:51:49.238035] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-17T20:51:49.482316] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T20:51:50.015782] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-03. [2025-09-17T20:51:50.049355] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T20:51:50.457182] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T20:51:50.815792] [INFO ] [REMOTE ] OII: Fetching primary data for 2025-09. [2025-09-17T20:51:51.615746] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-05. [2025-09-17T20:51:51.803336] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T20:51:52.242367] [INFO ] [REMOTE ] OII: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T20:51:52.247587] [INFO ] [REMOTE ] OII: Full fetch complete (62146 records). [2025-09-17T20:51:52.247715] [DEBUG] [VALIDATOR ] OII: Validating primary data. [2025-09-17T20:51:52.426584] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-04. [2025-09-17T20:51:52.650342] [DEBUG] [VALIDATOR ] OII: All expected trading days are present. [2025-09-17T20:51:52.650433] [DEBUG] [VALIDATOR ] OII: Primary data validation passed. [2025-09-17T20:51:52.651375] [INFO ] [MAIN ] OII: Fetched primary data is valid. [2025-09-17T20:51:52.651422] [DEBUG] [LOCAL ] OII: Saving primary data. [2025-09-17T20:51:52.652753] [DEBUG] [LOCAL ] OII: Trimmed 62146 records to 43182 (keeping 200 days of data) [2025-09-17T20:51:52.927241] [DEBUG] [LOCAL ] OII: Primary data saved (43182 records). [2025-09-17T20:51:52.927438] [INFO ] [MAIN ] OII: Full history saved. [2025-09-17T20:51:52.928452] [INFO ] [MAIN ] Update Progress: 1586/2371 symbols completed. OII took 37.0s. Estimated remaining: 1h 54m 45s. Rate: 6.8 symbols/min [2025-09-17T20:51:53.110768] [INFO ] [MAIN ] OLN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:51:53.135606] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T20:51:53.200806] [DEBUG] [LOCAL ] OLN: Loaded 51697 existing records from primary storage. [2025-09-17T20:51:53.201048] [INFO ] [MAIN ] OLN: Loaded 51697 existing records. [2025-09-17T20:51:53.223065] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-01. [2025-09-17T20:51:53.398350] [WARN ] [MAIN ] OLN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:51:53.398728] [INFO ] [MAIN ] OLN: Wiping existing primary data before full refresh. [2025-09-17T20:51:53.398779] [INFO ] [LOCAL ] OLN: Starting deletion of primary data. [2025-09-17T20:51:53.400001] [DEBUG] [LOCAL ] OLN: Deleted primary data file. [2025-09-17T20:51:53.400067] [INFO ] [MAIN ] OLN: Starting full primary refresh. [2025-09-17T20:51:53.781515] [INFO ] [REMOTE ] OLN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:51:54.015762] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-11. [2025-09-17T20:51:54.546807] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T20:51:54.815820] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-06. [2025-09-17T20:51:55.571109] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T20:51:55.615728] [INFO ] [REMOTE ] OLN: Fetching primary data for 2024-12. [2025-09-17T20:51:56.061900] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-01 (2.84 seconds). [2025-09-17T20:51:56.138199] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T20:51:56.415804] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-02. [2025-09-17T20:51:57.215866] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-05. [2025-09-17T20:51:57.737590] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-17T20:51:58.015837] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-01. [2025-09-17T20:51:58.815755] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-07. [2025-09-17T20:51:58.899994] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T20:51:59.103005] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-09-17T20:51:59.601618] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T20:51:59.615683] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-02. [2025-09-17T20:52:00.103442] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T20:52:00.415779] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-08. [2025-09-17T20:52:01.215858] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-06. [2025-09-17T20:52:01.394278] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T20:52:01.731349] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T20:52:02.015813] [INFO ] [REMOTE ] OIS: Fetching primary data for 2025-09. [2025-09-17T20:52:02.815799] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-03. [2025-09-17T20:52:03.152447] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T20:52:03.226045] [INFO ] [REMOTE ] OIS: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T20:52:03.230666] [INFO ] [REMOTE ] OIS: Full fetch complete (56737 records). [2025-09-17T20:52:03.230784] [DEBUG] [VALIDATOR ] OIS: Validating primary data. [2025-09-17T20:52:03.623019] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-03. [2025-09-17T20:52:03.625007] [DEBUG] [VALIDATOR ] OIS: All expected trading days are present. [2025-09-17T20:52:03.625108] [DEBUG] [VALIDATOR ] OIS: Primary data validation passed. [2025-09-17T20:52:03.626068] [INFO ] [MAIN ] OIS: Fetched primary data is valid. [2025-09-17T20:52:03.626139] [DEBUG] [LOCAL ] OIS: Saving primary data. [2025-09-17T20:52:03.627635] [DEBUG] [LOCAL ] OIS: Trimmed 56737 records to 41002 (keeping 200 days of data) [2025-09-17T20:52:03.876046] [DEBUG] [LOCAL ] OIS: Primary data saved (41002 records). [2025-09-17T20:52:03.876182] [INFO ] [MAIN ] OIS: Full history saved. [2025-09-17T20:52:03.876265] [INFO ] [MAIN ] Update Progress: 1587/2371 symbols completed. OIS took 32.5s. Estimated remaining: 1h 54m 38s. Rate: 6.8 symbols/min [2025-09-17T20:52:04.044060] [INFO ] [MAIN ] OLP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:52:04.054798] [DEBUG] [LOCAL ] OLP: Loaded 9608 existing records from primary storage. [2025-09-17T20:52:04.054915] [INFO ] [MAIN ] OLP: Loaded 9608 existing records. [2025-09-17T20:52:04.244403] [WARN ] [MAIN ] OLP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:52:04.244785] [INFO ] [MAIN ] OLP: Wiping existing primary data before full refresh. [2025-09-17T20:52:04.244835] [INFO ] [LOCAL ] OLP: Starting deletion of primary data. [2025-09-17T20:52:04.245321] [DEBUG] [LOCAL ] OLP: Deleted primary data file. [2025-09-17T20:52:04.245373] [INFO ] [MAIN ] OLP: Starting full primary refresh. [2025-09-17T20:52:04.429134] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-07. [2025-09-17T20:52:04.616151] [INFO ] [REMOTE ] OLP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:52:05.215864] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-11. [2025-09-17T20:52:05.338497] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-03 (2.52 seconds). [2025-09-17T20:52:05.550766] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T20:52:06.015734] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-04. [2025-09-17T20:52:06.070498] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T20:52:06.238320] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T20:52:06.815787] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-08. [2025-09-17T20:52:07.615826] [INFO ] [REMOTE ] OLP: Fetching primary data for 2024-12. [2025-09-17T20:52:08.415747] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-04. [2025-09-17T20:52:08.719264] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-04 (2.70 seconds). [2025-09-17T20:52:08.741601] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T20:52:08.795764] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T20:52:09.215823] [INFO ] [REMOTE ] OKE: Fetching primary data for 2025-09. [2025-09-17T20:52:10.015750] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-01. [2025-09-17T20:52:10.079527] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T20:52:10.815796] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-05. [2025-09-17T20:52:10.891890] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T20:52:11.068259] [INFO ] [REMOTE ] OKE: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T20:52:11.075435] [INFO ] [REMOTE ] OKE: Full fetch complete (77324 records). [2025-09-17T20:52:11.075591] [DEBUG] [VALIDATOR ] OKE: Validating primary data. [2025-09-17T20:52:11.475225] [DEBUG] [VALIDATOR ] OKE: All expected trading days are present. [2025-09-17T20:52:11.475319] [DEBUG] [VALIDATOR ] OKE: Primary data validation passed. [2025-09-17T20:52:11.476344] [INFO ] [MAIN ] OKE: Fetched primary data is valid. [2025-09-17T20:52:11.476393] [DEBUG] [LOCAL ] OKE: Saving primary data. [2025-09-17T20:52:11.478069] [DEBUG] [LOCAL ] OKE: Trimmed 77324 records to 53536 (keeping 200 days of data) [2025-09-17T20:52:11.662845] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-05. [2025-09-17T20:52:11.822080] [DEBUG] [LOCAL ] OKE: Primary data saved (53536 records). [2025-09-17T20:52:11.822244] [INFO ] [MAIN ] OKE: Full history saved. [2025-09-17T20:52:11.822337] [INFO ] [MAIN ] Update Progress: 1588/2371 symbols completed. OKE took 34.8s. Estimated remaining: 1h 54m 28s. Rate: 6.8 symbols/min [2025-09-17T20:52:11.998417] [INFO ] [MAIN ] OMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:52:12.048150] [DEBUG] [LOCAL ] OMC: Loaded 53295 existing records from primary storage. [2025-09-17T20:52:12.048302] [INFO ] [MAIN ] OMC: Loaded 53295 existing records. [2025-09-17T20:52:12.225584] [WARN ] [MAIN ] OMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:52:12.225891] [INFO ] [MAIN ] OMC: Wiping existing primary data before full refresh. [2025-09-17T20:52:12.225938] [INFO ] [LOCAL ] OMC: Starting deletion of primary data. [2025-09-17T20:52:12.227185] [DEBUG] [LOCAL ] OMC: Deleted primary data file. [2025-09-17T20:52:12.227238] [INFO ] [MAIN ] OMC: Starting full primary refresh. [2025-09-17T20:52:12.434429] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-02. [2025-09-17T20:52:12.583767] [INFO ] [REMOTE ] OMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:52:12.875046] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T20:52:13.215784] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-11. [2025-09-17T20:52:13.299525] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-02 (0.87 seconds). [2025-09-17T20:52:14.015820] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-06. [2025-09-17T20:52:14.562113] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-05 (2.90 seconds). [2025-09-17T20:52:14.605586] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T20:52:14.815782] [INFO ] [REMOTE ] OMC: Fetching primary data for 2024-12. [2025-09-17T20:52:15.615749] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-03. [2025-09-17T20:52:15.724765] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T20:52:16.415846] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-07. [2025-09-17T20:52:16.507933] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T20:52:16.601461] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T20:52:17.215777] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-04. [2025-09-17T20:52:18.003896] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T20:52:18.015695] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-08. [2025-09-17T20:52:18.094003] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T20:52:18.815814] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-06. [2025-09-17T20:52:19.615909] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-01. [2025-09-17T20:52:19.676694] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T20:52:20.415829] [INFO ] [REMOTE ] OLN: Fetching primary data for 2025-09. [2025-09-17T20:52:21.102528] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-06 (2.29 seconds). [2025-09-17T20:52:21.215808] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-07. [2025-09-17T20:52:21.564472] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T20:52:21.690948] [INFO ] [REMOTE ] OLN: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T20:52:21.697924] [INFO ] [REMOTE ] OLN: Full fetch complete (74184 records). [2025-09-17T20:52:21.698073] [DEBUG] [VALIDATOR ] OLN: Validating primary data. [2025-09-17T20:52:22.020872] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-05. [2025-09-17T20:52:22.095525] [DEBUG] [VALIDATOR ] OLN: All expected trading days are present. [2025-09-17T20:52:22.095606] [DEBUG] [VALIDATOR ] OLN: Primary data validation passed. [2025-09-17T20:52:22.096590] [INFO ] [MAIN ] OLN: Fetched primary data is valid. [2025-09-17T20:52:22.096651] [DEBUG] [LOCAL ] OLN: Saving primary data. [2025-09-17T20:52:22.098155] [DEBUG] [LOCAL ] OLN: Trimmed 74184 records to 51713 (keeping 200 days of data) [2025-09-17T20:52:22.420241] [DEBUG] [LOCAL ] OLN: Primary data saved (51713 records). [2025-09-17T20:52:22.420397] [INFO ] [MAIN ] OLN: Full history saved. [2025-09-17T20:52:22.421417] [INFO ] [MAIN ] Update Progress: 1589/2371 symbols completed. OLN took 29.5s. Estimated remaining: 1h 54m 21s. Rate: 6.8 symbols/min [2025-09-17T20:52:22.595162] [INFO ] [MAIN ] OMF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:52:22.639285] [DEBUG] [LOCAL ] OMF: Loaded 46316 existing records from primary storage. [2025-09-17T20:52:22.639436] [INFO ] [MAIN ] OMF: Loaded 46316 existing records. [2025-09-17T20:52:22.822977] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-02. [2025-09-17T20:52:22.823159] [WARN ] [MAIN ] OMF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:52:22.824436] [INFO ] [MAIN ] OMF: Wiping existing primary data before full refresh. [2025-09-17T20:52:22.824485] [INFO ] [LOCAL ] OMF: Starting deletion of primary data. [2025-09-17T20:52:22.825485] [DEBUG] [LOCAL ] OMF: Deleted primary data file. [2025-09-17T20:52:22.825539] [INFO ] [MAIN ] OMF: Starting full primary refresh. [2025-09-17T20:52:23.011808] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T20:52:23.196283] [INFO ] [REMOTE ] OMF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:52:23.615774] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-11. [2025-09-17T20:52:23.931007] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-07 (2.72 seconds). [2025-09-17T20:52:24.415773] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-06. [2025-09-17T20:52:24.467250] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T20:52:25.014175] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T20:52:25.215824] [INFO ] [REMOTE ] OMF: Fetching primary data for 2024-12. [2025-09-17T20:52:25.235887] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T20:52:26.015795] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-07. [2025-09-17T20:52:26.671926] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T20:52:26.815756] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-01. [2025-09-17T20:52:26.936954] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T20:52:27.615780] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-03. [2025-09-17T20:52:28.335904] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T20:52:28.415742] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-02. [2025-09-17T20:52:29.217799] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-08. [2025-09-17T20:52:29.220809] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T20:52:30.006162] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T20:52:30.015728] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-03. [2025-09-17T20:52:30.815780] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-08. [2025-09-17T20:52:31.615770] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-04. [2025-09-17T20:52:31.725273] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T20:52:31.965051] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T20:52:32.397957] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-08 (3.18 seconds). [2025-09-17T20:52:32.415729] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-04. [2025-09-17T20:52:33.215767] [INFO ] [REMOTE ] OLP: Fetching primary data for 2025-09. [2025-09-17T20:52:33.364213] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T20:52:33.960275] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T20:52:34.015744] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-05. [2025-09-17T20:52:34.022242] [INFO ] [REMOTE ] OLP: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T20:52:34.024388] [INFO ] [REMOTE ] OLP: Full fetch complete (13845 records). [2025-09-17T20:52:34.024491] [DEBUG] [VALIDATOR ] OLP: Validating primary data. [2025-09-17T20:52:34.389550] [DEBUG] [VALIDATOR ] OLP: All expected trading days are present. [2025-09-17T20:52:34.389628] [DEBUG] [VALIDATOR ] OLP: Primary data validation passed. [2025-09-17T20:52:34.389968] [INFO ] [MAIN ] OLP: Fetched primary data is valid. [2025-09-17T20:52:34.390055] [DEBUG] [LOCAL ] OLP: Saving primary data. [2025-09-17T20:52:34.390626] [DEBUG] [LOCAL ] OLP: Trimmed 13845 records to 9634 (keeping 200 days of data) [2025-09-17T20:52:34.450005] [DEBUG] [LOCAL ] OLP: Primary data saved (9634 records). [2025-09-17T20:52:34.450155] [INFO ] [MAIN ] OLP: Full history saved. [2025-09-17T20:52:34.450265] [INFO ] [MAIN ] Update Progress: 1590/2371 symbols completed. OLP took 30.6s. Estimated remaining: 1h 54m 13s. Rate: 6.8 symbols/min [2025-09-17T20:52:34.619846] [INFO ] [MAIN ] OMI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:52:34.661431] [DEBUG] [LOCAL ] OMI: Loaded 45878 existing records from primary storage. [2025-09-17T20:52:34.661573] [INFO ] [MAIN ] OMI: Loaded 45878 existing records. [2025-09-17T20:52:34.817445] [INFO ] [REMOTE ] OKLO: Fetching primary data for 2025-09. [2025-09-17T20:52:34.841780] [WARN ] [MAIN ] OMI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:52:34.842025] [INFO ] [MAIN ] OMI: Wiping existing primary data before full refresh. [2025-09-17T20:52:34.842088] [INFO ] [LOCAL ] OMI: Starting deletion of primary data. [2025-09-17T20:52:34.842838] [DEBUG] [LOCAL ] OMI: Deleted primary data file. [2025-09-17T20:52:34.842900] [INFO ] [MAIN ] OMI: Starting full primary refresh. [2025-09-17T20:52:35.201963] [INFO ] [REMOTE ] OMI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:52:35.594492] [INFO ] [REMOTE ] OKLO: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T20:52:35.603281] [INFO ] [REMOTE ] OKLO: Full fetch complete (77587 records). [2025-09-17T20:52:35.603430] [DEBUG] [VALIDATOR ] OKLO: Validating primary data. [2025-09-17T20:52:35.604183] [FATAL] [VALIDATOR ] OKLO: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:52:35.604263] [FATAL] [MAIN ] OKLO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:52:35.604311] [WARN ] [MAIN ] OKLO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:52:35.604356] [INFO ] [LOCAL ] OKLO: Starting deletion of primary data. [2025-09-17T20:52:35.604421] [DEBUG] [LOCAL ] OKLO: No primary data file found to delete. [2025-09-17T20:52:35.604462] [INFO ] [LOCAL ] OKLO: Starting deletion of derivative data. [2025-09-17T20:52:35.604795] [DEBUG] [LOCAL ] OKLO: Deleted derivative data file. [2025-09-17T20:52:35.604896] [INFO ] [MAIN ] Update Progress: 1591/2371 symbols completed. OKLO took 54.0s. Estimated remaining: 1h 54m 1s. Rate: 6.8 symbols/min [2025-09-17T20:52:35.620983] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-11. [2025-09-17T20:52:35.790732] [INFO ] [MAIN ] ONIT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:52:35.820578] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T20:52:35.834461] [DEBUG] [LOCAL ] ONIT: Loaded 7766 existing records from primary storage. [2025-09-17T20:52:35.834813] [INFO ] [MAIN ] ONIT: Loaded 7766 existing records. [2025-09-17T20:52:36.018129] [WARN ] [MAIN ] ONIT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:52:36.018407] [INFO ] [MAIN ] ONIT: Wiping existing primary data before full refresh. [2025-09-17T20:52:36.018452] [INFO ] [LOCAL ] ONIT: Starting deletion of primary data. [2025-09-17T20:52:36.018819] [DEBUG] [LOCAL ] ONIT: Deleted primary data file. [2025-09-17T20:52:36.018877] [INFO ] [MAIN ] ONIT: Starting full primary refresh. [2025-09-17T20:52:36.408133] [INFO ] [REMOTE ] ONIT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:52:36.415726] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-11. [2025-09-17T20:52:37.092180] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T20:52:37.121964] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T20:52:37.215768] [INFO ] [REMOTE ] OMI: Fetching primary data for 2024-12. [2025-09-17T20:52:38.015764] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2024-12. [2025-09-17T20:52:38.390968] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T20:52:38.803687] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T20:52:38.815728] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-01. [2025-09-17T20:52:39.536587] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T20:52:39.615773] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-01. [2025-09-17T20:52:40.415774] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-02. [2025-09-17T20:52:41.132150] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T20:52:41.215790] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-05. [2025-09-17T20:52:41.261613] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T20:52:42.015786] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-02. [2025-09-17T20:52:42.815803] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-06. [2025-09-17T20:52:43.148600] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T20:52:43.615803] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-03. [2025-09-17T20:52:43.702111] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T20:52:43.928596] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T20:52:44.416074] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-03. [2025-09-17T20:52:44.418113] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-03 (0.80 seconds). [2025-09-17T20:52:45.215774] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-04. [2025-09-17T20:52:45.744505] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T20:52:46.015811] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-07. [2025-09-17T20:52:46.174697] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T20:52:46.815790] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-05. [2025-09-17T20:52:47.615794] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-06. [2025-09-17T20:52:47.636517] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T20:52:47.819334] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T20:52:48.415771] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-08. [2025-09-17T20:52:49.215793] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-06. [2025-09-17T20:52:49.489972] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T20:52:49.810755] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T20:52:49.881236] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T20:52:50.015752] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-07. [2025-09-17T20:52:50.815784] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-07. [2025-09-17T20:52:51.615805] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-04. [2025-09-17T20:52:51.715050] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T20:52:51.983025] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T20:52:52.415817] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-08. [2025-09-17T20:52:53.105039] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T20:52:53.215802] [INFO ] [REMOTE ] ONIT: Fetching primary data for 2025-09. [2025-09-17T20:52:53.334209] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T20:52:53.712960] [INFO ] [REMOTE ] ONIT: Incremental fetch complete for 2025-09 (0.50 seconds). [2025-09-17T20:52:53.714620] [INFO ] [REMOTE ] ONIT: Full fetch complete (11195 records). [2025-09-17T20:52:53.714710] [DEBUG] [VALIDATOR ] ONIT: Validating primary data. [2025-09-17T20:52:54.020836] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-08. [2025-09-17T20:52:54.090054] [DEBUG] [VALIDATOR ] ONIT: All expected trading days are present. [2025-09-17T20:52:54.090135] [DEBUG] [VALIDATOR ] ONIT: Primary data validation passed. [2025-09-17T20:52:54.090448] [INFO ] [MAIN ] ONIT: Fetched primary data is valid. [2025-09-17T20:52:54.090489] [DEBUG] [LOCAL ] ONIT: Saving primary data. [2025-09-17T20:52:54.091235] [DEBUG] [LOCAL ] ONIT: Trimmed 11195 records to 7821 (keeping 200 days of data) [2025-09-17T20:52:54.137476] [DEBUG] [LOCAL ] ONIT: Primary data saved (7821 records). [2025-09-17T20:52:54.137581] [INFO ] [MAIN ] ONIT: Full history saved. [2025-09-17T20:52:54.137702] [INFO ] [MAIN ] Update Progress: 1592/2371 symbols completed. ONIT took 18.5s. Estimated remaining: 1h 53m 57s. Rate: 6.8 symbols/min [2025-09-17T20:52:54.312723] [INFO ] [MAIN ] ONL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:52:54.349785] [DEBUG] [LOCAL ] ONL: Loaded 32227 existing records from primary storage. [2025-09-17T20:52:54.349963] [INFO ] [MAIN ] ONL: Loaded 32227 existing records. [2025-09-17T20:52:54.535931] [WARN ] [MAIN ] ONL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:52:54.536196] [INFO ] [MAIN ] ONL: Wiping existing primary data before full refresh. [2025-09-17T20:52:54.536242] [INFO ] [LOCAL ] ONL: Starting deletion of primary data. [2025-09-17T20:52:54.536926] [DEBUG] [LOCAL ] ONL: Deleted primary data file. [2025-09-17T20:52:54.536986] [INFO ] [MAIN ] ONL: Starting full primary refresh. [2025-09-17T20:52:54.820895] [INFO ] [REMOTE ] OMF: Fetching primary data for 2025-09. [2025-09-17T20:52:54.920041] [INFO ] [REMOTE ] ONL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:52:55.615832] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-11. [2025-09-17T20:52:55.987197] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T20:52:56.031456] [INFO ] [REMOTE ] OMF: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T20:52:56.037210] [INFO ] [REMOTE ] OMF: Full fetch complete (66369 records). [2025-09-17T20:52:56.037341] [DEBUG] [VALIDATOR ] OMF: Validating primary data. [2025-09-17T20:52:56.425420] [INFO ] [REMOTE ] OMC: Fetching primary data for 2025-09. [2025-09-17T20:52:56.429002] [DEBUG] [VALIDATOR ] OMF: All expected trading days are present. [2025-09-17T20:52:56.429316] [DEBUG] [VALIDATOR ] OMF: Primary data validation passed. [2025-09-17T20:52:56.431134] [INFO ] [MAIN ] OMF: Fetched primary data is valid. [2025-09-17T20:52:56.431294] [DEBUG] [LOCAL ] OMF: Saving primary data. [2025-09-17T20:52:56.432784] [DEBUG] [LOCAL ] OMF: Trimmed 66369 records to 46331 (keeping 200 days of data) [2025-09-17T20:52:56.719965] [DEBUG] [LOCAL ] OMF: Primary data saved (46331 records). [2025-09-17T20:52:56.720109] [INFO ] [MAIN ] OMF: Full history saved. [2025-09-17T20:52:56.720824] [INFO ] [MAIN ] Update Progress: 1593/2371 symbols completed. OMF took 34.3s. Estimated remaining: 1h 53m 45s. Rate: 6.8 symbols/min [2025-09-17T20:52:56.893015] [INFO ] [MAIN ] ONON: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:52:56.946166] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-09-17T20:52:56.946345] [INFO ] [MAIN ] ONON: Loaded 53613 existing records. [2025-09-17T20:52:57.127132] [WARN ] [MAIN ] ONON: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:52:57.127474] [INFO ] [MAIN ] ONON: Wiping existing primary data before full refresh. [2025-09-17T20:52:57.127533] [INFO ] [LOCAL ] ONON: Starting deletion of primary data. [2025-09-17T20:52:57.143911] [DEBUG] [LOCAL ] ONON: Deleted primary data file. [2025-09-17T20:52:57.143842] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T20:52:57.144074] [INFO ] [MAIN ] ONON: Starting full primary refresh. [2025-09-17T20:52:57.220930] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-05. [2025-09-17T20:52:57.521500] [INFO ] [REMOTE ] ONON: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:52:58.015796] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-11. [2025-09-17T20:52:58.367306] [INFO ] [REMOTE ] OMC: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T20:52:58.375134] [INFO ] [REMOTE ] OMC: Full fetch complete (76541 records). [2025-09-17T20:52:58.375265] [DEBUG] [VALIDATOR ] OMC: Validating primary data. [2025-09-17T20:52:58.766950] [DEBUG] [VALIDATOR ] OMC: All expected trading days are present. [2025-09-17T20:52:58.767038] [DEBUG] [VALIDATOR ] OMC: Primary data validation passed. [2025-09-17T20:52:58.768056] [INFO ] [MAIN ] OMC: Fetched primary data is valid. [2025-09-17T20:52:58.768108] [DEBUG] [LOCAL ] OMC: Saving primary data. [2025-09-17T20:52:58.769611] [DEBUG] [LOCAL ] OMC: Trimmed 76541 records to 53293 (keeping 200 days of data) [2025-09-17T20:52:58.833473] [INFO ] [REMOTE ] ONL: Fetching primary data for 2024-12. [2025-09-17T20:52:59.130520] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T20:52:59.162756] [DEBUG] [LOCAL ] OMC: Primary data saved (53293 records). [2025-09-17T20:52:59.162917] [INFO ] [MAIN ] OMC: Full history saved. [2025-09-17T20:52:59.163050] [INFO ] [MAIN ] Update Progress: 1594/2371 symbols completed. OMC took 47.3s. Estimated remaining: 1h 53m 33s. Rate: 6.8 symbols/min [2025-09-17T20:52:59.333106] [INFO ] [MAIN ] ONTF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:52:59.355794] [DEBUG] [LOCAL ] ONTF: Loaded 23024 existing records from primary storage. [2025-09-17T20:52:59.355955] [INFO ] [MAIN ] ONTF: Loaded 23024 existing records. [2025-09-17T20:52:59.533777] [WARN ] [MAIN ] ONTF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:52:59.534060] [INFO ] [MAIN ] ONTF: Wiping existing primary data before full refresh. [2025-09-17T20:52:59.534104] [INFO ] [LOCAL ] ONTF: Starting deletion of primary data. [2025-09-17T20:52:59.534572] [DEBUG] [LOCAL ] ONTF: Deleted primary data file. [2025-09-17T20:52:59.534617] [INFO ] [MAIN ] ONTF: Starting full primary refresh. [2025-09-17T20:52:59.633101] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-06. [2025-09-17T20:52:59.903098] [INFO ] [REMOTE ] ONTF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:52:59.922066] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T20:52:59.957545] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T20:53:00.415838] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-11. [2025-09-17T20:53:00.949930] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T20:53:01.215801] [INFO ] [REMOTE ] ONON: Fetching primary data for 2024-12. [2025-09-17T20:53:01.607208] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T20:53:02.015797] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2024-12. [2025-09-17T20:53:02.815793] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-07. [2025-09-17T20:53:02.884958] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T20:53:03.357778] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-17T20:53:03.615834] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-01. [2025-09-17T20:53:04.158382] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T20:53:04.415796] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-08. [2025-09-17T20:53:04.673346] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T20:53:05.215842] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-01. [2025-09-17T20:53:06.015764] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-01. [2025-09-17T20:53:06.193167] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T20:53:06.275993] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T20:53:06.815817] [INFO ] [REMOTE ] OMI: Fetching primary data for 2025-09. [2025-09-17T20:53:07.615799] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-02. [2025-09-17T20:53:08.056338] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T20:53:08.113394] [INFO ] [REMOTE ] OMI: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T20:53:08.120158] [INFO ] [REMOTE ] OMI: Full fetch complete (63125 records). [2025-09-17T20:53:08.120278] [DEBUG] [VALIDATOR ] OMI: Validating primary data. [2025-09-17T20:53:08.419578] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-02. [2025-09-17T20:53:08.512662] [DEBUG] [VALIDATOR ] OMI: All expected trading days are present. [2025-09-17T20:53:08.512751] [DEBUG] [VALIDATOR ] OMI: Primary data validation passed. [2025-09-17T20:53:08.513743] [INFO ] [MAIN ] OMI: Fetched primary data is valid. [2025-09-17T20:53:08.513814] [DEBUG] [LOCAL ] OMI: Saving primary data. [2025-09-17T20:53:08.515112] [DEBUG] [LOCAL ] OMI: Trimmed 63125 records to 45865 (keeping 200 days of data) [2025-09-17T20:53:08.752189] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T20:53:08.795158] [DEBUG] [LOCAL ] OMI: Primary data saved (45865 records). [2025-09-17T20:53:08.795302] [INFO ] [MAIN ] OMI: Full history saved. [2025-09-17T20:53:08.795408] [INFO ] [MAIN ] Update Progress: 1595/2371 symbols completed. OMI took 34.3s. Estimated remaining: 1h 53m 25s. Rate: 6.8 symbols/min [2025-09-17T20:53:08.963455] [INFO ] [MAIN ] ONTO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:53:09.005459] [DEBUG] [LOCAL ] ONTO: Loaded 46467 existing records from primary storage. [2025-09-17T20:53:09.005634] [INFO ] [MAIN ] ONTO: Loaded 46467 existing records. [2025-09-17T20:53:09.188073] [WARN ] [MAIN ] ONTO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:53:09.188510] [INFO ] [MAIN ] ONTO: Wiping existing primary data before full refresh. [2025-09-17T20:53:09.188638] [INFO ] [LOCAL ] ONTO: Starting deletion of primary data. [2025-09-17T20:53:09.189553] [DEBUG] [LOCAL ] ONTO: Deleted primary data file. [2025-09-17T20:53:09.189599] [INFO ] [MAIN ] ONTO: Starting full primary refresh. [2025-09-17T20:53:09.220864] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-02. [2025-09-17T20:53:09.348459] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T20:53:09.574350] [INFO ] [REMOTE ] ONTO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:53:10.015792] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-03. [2025-09-17T20:53:10.815813] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-11. [2025-09-17T20:53:10.985912] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T20:53:11.035701] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T20:53:11.615831] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-03. [2025-09-17T20:53:12.416034] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-04. [2025-09-17T20:53:12.563936] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T20:53:13.215819] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2024-12. [2025-09-17T20:53:13.446623] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T20:53:13.632867] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-03 (2.02 seconds). [2025-09-17T20:53:14.015823] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-03. [2025-09-17T20:53:14.457924] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T20:53:14.815830] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-04. [2025-09-17T20:53:15.576095] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T20:53:15.615741] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-04. [2025-09-17T20:53:16.415736] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-05. [2025-09-17T20:53:16.944840] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-17T20:53:17.000720] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T20:53:17.215780] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-05. [2025-09-17T20:53:17.570257] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T20:53:18.015823] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-01. [2025-09-17T20:53:18.815799] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-06. [2025-09-17T20:53:19.258688] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-17T20:53:19.430630] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T20:53:19.615786] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-02. [2025-09-17T20:53:19.712256] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T20:53:20.415823] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-05. [2025-09-17T20:53:21.215851] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-07. [2025-09-17T20:53:21.436002] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T20:53:21.568461] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T20:53:22.015784] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-06. [2025-09-17T20:53:22.079014] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T20:53:22.815790] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-03. [2025-09-17T20:53:23.547965] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T20:53:23.615805] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-06. [2025-09-17T20:53:24.320058] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T20:53:24.415790] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-04. [2025-09-17T20:53:25.215789] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-08. [2025-09-17T20:53:25.729924] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T20:53:26.015782] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-07. [2025-09-17T20:53:26.127487] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T20:53:26.178167] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T20:53:26.815790] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-05. [2025-09-17T20:53:27.306687] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T20:53:27.615787] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-07. [2025-09-17T20:53:28.415818] [INFO ] [REMOTE ] ONTF: Fetching primary data for 2025-09. [2025-09-17T20:53:28.476140] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T20:53:29.215763] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-06. [2025-09-17T20:53:29.533908] [INFO ] [REMOTE ] ONTF: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T20:53:29.543562] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T20:53:29.541671] [INFO ] [REMOTE ] ONTF: Full fetch complete (31759 records). [2025-09-17T20:53:29.554709] [DEBUG] [VALIDATOR ] ONTF: Validating primary data. [2025-09-17T20:53:29.936604] [DEBUG] [VALIDATOR ] ONTF: All expected trading days are present. [2025-09-17T20:53:29.936697] [DEBUG] [VALIDATOR ] ONTF: Primary data validation passed. [2025-09-17T20:53:29.937331] [INFO ] [MAIN ] ONTF: Fetched primary data is valid. [2025-09-17T20:53:29.937371] [DEBUG] [LOCAL ] ONTF: Saving primary data. [2025-09-17T20:53:29.938098] [DEBUG] [LOCAL ] ONTF: Trimmed 31759 records to 23049 (keeping 200 days of data) [2025-09-17T20:53:30.019875] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-08. [2025-09-17T20:53:30.067678] [DEBUG] [LOCAL ] ONTF: Primary data saved (23049 records). [2025-09-17T20:53:30.067818] [INFO ] [MAIN ] ONTF: Full history saved. [2025-09-17T20:53:30.067901] [INFO ] [MAIN ] Update Progress: 1596/2371 symbols completed. ONTF took 30.9s. Estimated remaining: 1h 53m 22s. Rate: 6.8 symbols/min [2025-09-17T20:53:30.240507] [INFO ] [MAIN ] OOMA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:53:30.260189] [DEBUG] [LOCAL ] OOMA: Loaded 19116 existing records from primary storage. [2025-09-17T20:53:30.260324] [INFO ] [MAIN ] OOMA: Loaded 19116 existing records. [2025-09-17T20:53:30.435954] [WARN ] [MAIN ] OOMA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:53:30.436228] [INFO ] [MAIN ] OOMA: Wiping existing primary data before full refresh. [2025-09-17T20:53:30.436288] [INFO ] [LOCAL ] OOMA: Starting deletion of primary data. [2025-09-17T20:53:30.436719] [DEBUG] [LOCAL ] OOMA: Deleted primary data file. [2025-09-17T20:53:30.436765] [INFO ] [MAIN ] OOMA: Starting full primary refresh. [2025-09-17T20:53:30.789961] [INFO ] [REMOTE ] OOMA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:53:30.815718] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-11. [2025-09-17T20:53:31.003570] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T20:53:31.061713] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T20:53:31.615780] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-07. [2025-09-17T20:53:31.801050] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T20:53:32.415796] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2024-12. [2025-09-17T20:53:32.971954] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T20:53:33.215798] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-08. [2025-09-17T20:53:33.482007] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T20:53:34.015791] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-01. [2025-09-17T20:53:34.723076] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T20:53:34.815760] [INFO ] [REMOTE ] ONL: Fetching primary data for 2025-09. [2025-09-17T20:53:35.132400] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T20:53:35.615754] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-02. [2025-09-17T20:53:35.911285] [INFO ] [REMOTE ] ONL: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T20:53:35.914956] [INFO ] [REMOTE ] ONL: Full fetch complete (43888 records). [2025-09-17T20:53:35.915052] [DEBUG] [VALIDATOR ] ONL: Validating primary data. [2025-09-17T20:53:36.302677] [DEBUG] [VALIDATOR ] ONL: All expected trading days are present. [2025-09-17T20:53:36.302813] [DEBUG] [VALIDATOR ] ONL: Primary data validation passed. [2025-09-17T20:53:36.304008] [INFO ] [MAIN ] ONL: Fetched primary data is valid. [2025-09-17T20:53:36.304060] [DEBUG] [LOCAL ] ONL: Saving primary data. [2025-09-17T20:53:36.305520] [DEBUG] [LOCAL ] ONL: Trimmed 43888 records to 32236 (keeping 200 days of data) [2025-09-17T20:53:36.415810] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-08. [2025-09-17T20:53:36.497223] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T20:53:36.523389] [DEBUG] [LOCAL ] ONL: Primary data saved (32236 records). [2025-09-17T20:53:36.523560] [INFO ] [MAIN ] ONL: Full history saved. [2025-09-17T20:53:36.523696] [INFO ] [MAIN ] Update Progress: 1597/2371 symbols completed. ONL took 42.4s. Estimated remaining: 1h 53m 12s. Rate: 6.8 symbols/min [2025-09-17T20:53:37.215784] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-03. [2025-09-17T20:53:38.015823] [INFO ] [REMOTE ] ONTO: Fetching primary data for 2025-09. [2025-09-17T20:53:38.158693] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T20:53:38.595150] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T20:53:38.815861] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-04. [2025-09-17T20:53:39.605700] [INFO ] [REMOTE ] ONTO: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T20:53:39.612111] [INFO ] [REMOTE ] ONTO: Full fetch complete (65164 records). [2025-09-17T20:53:39.612235] [DEBUG] [VALIDATOR ] ONTO: Validating primary data. [2025-09-17T20:53:39.645064] [INFO ] [REMOTE ] ONON: Fetching primary data for 2025-09. [2025-09-17T20:53:40.041985] [DEBUG] [VALIDATOR ] ONTO: All expected trading days are present. [2025-09-17T20:53:40.050245] [DEBUG] [VALIDATOR ] ONTO: Primary data validation passed. [2025-09-17T20:53:40.052968] [INFO ] [MAIN ] ONTO: Fetched primary data is valid. [2025-09-17T20:53:40.051751] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T20:53:40.053196] [DEBUG] [LOCAL ] ONTO: Saving primary data. [2025-09-17T20:53:40.059495] [DEBUG] [LOCAL ] ONTO: Trimmed 65164 records to 46488 (keeping 200 days of data) [2025-09-17T20:53:40.343193] [DEBUG] [LOCAL ] ONTO: Primary data saved (46488 records). [2025-09-17T20:53:40.343399] [INFO ] [MAIN ] ONTO: Full history saved. [2025-09-17T20:53:40.343492] [INFO ] [MAIN ] Update Progress: 1598/2371 symbols completed. ONTO took 31.5s. Estimated remaining: 1h 53m 1s. Rate: 6.8 symbols/min [2025-09-17T20:53:40.415861] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-05. [2025-09-17T20:53:41.451489] [INFO ] [REMOTE ] ONON: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T20:53:41.458483] [INFO ] [REMOTE ] ONON: Full fetch complete (77409 records). [2025-09-17T20:53:41.458626] [DEBUG] [VALIDATOR ] ONON: Validating primary data. [2025-09-17T20:53:41.757043] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T20:53:41.790106] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-06. [2025-09-17T20:53:41.888124] [DEBUG] [VALIDATOR ] ONON: All expected trading days are present. [2025-09-17T20:53:41.888209] [DEBUG] [VALIDATOR ] ONON: Primary data validation passed. [2025-09-17T20:53:41.889381] [INFO ] [MAIN ] ONON: Fetched primary data is valid. [2025-09-17T20:53:41.889435] [DEBUG] [LOCAL ] ONON: Saving primary data. [2025-09-17T20:53:41.890970] [DEBUG] [LOCAL ] ONON: Trimmed 77409 records to 53613 (keeping 200 days of data) [2025-09-17T20:53:42.218198] [DEBUG] [LOCAL ] ONON: Primary data saved (53613 records). [2025-09-17T20:53:42.218377] [INFO ] [MAIN ] ONON: Full history saved. [2025-09-17T20:53:42.219594] [INFO ] [MAIN ] Update Progress: 1599/2371 symbols completed. ONON took 45.5s. Estimated remaining: 1h 52m 49s. Rate: 6.8 symbols/min [2025-09-17T20:53:42.935747] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T20:53:42.940610] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-07. [2025-09-17T20:53:44.142676] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T20:53:44.148934] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-08. [2025-09-17T20:53:45.068006] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T20:53:45.072438] [INFO ] [REMOTE ] OOMA: Fetching primary data for 2025-09. [2025-09-17T20:53:46.009738] [INFO ] [REMOTE ] OOMA: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T20:53:46.012674] [INFO ] [REMOTE ] OOMA: Full fetch complete (26308 records). [2025-09-17T20:53:46.012766] [DEBUG] [VALIDATOR ] OOMA: Validating primary data. [2025-09-17T20:53:46.386238] [DEBUG] [VALIDATOR ] OOMA: All expected trading days are present. [2025-09-17T20:53:46.386339] [DEBUG] [VALIDATOR ] OOMA: Primary data validation passed. [2025-09-17T20:53:46.386919] [INFO ] [MAIN ] OOMA: Fetched primary data is valid. [2025-09-17T20:53:46.386962] [DEBUG] [LOCAL ] OOMA: Saving primary data. [2025-09-17T20:53:46.387621] [DEBUG] [LOCAL ] OOMA: Trimmed 26308 records to 19176 (keeping 200 days of data) [2025-09-17T20:53:46.499386] [DEBUG] [LOCAL ] OOMA: Primary data saved (19176 records). [2025-09-17T20:53:46.499532] [INFO ] [MAIN ] OOMA: Full history saved. [2025-09-17T20:53:46.499619] [INFO ] [MAIN ] Update Progress: 1600/2371 symbols completed. OOMA took 16.4s. Estimated remaining: 1h 52m 38s. Rate: 6.8 symbols/min [2025-09-17T20:53:47.083836] [INFO ] [MAIN ] OPFI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:53:47.162276] [INFO ] [MAIN ] OPY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:53:47.210075] [INFO ] [MAIN ] OPAD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:53:47.217365] [DEBUG] [LOCAL ] OPY: No existing data file found in primary storage. [2025-09-17T20:53:47.245033] [INFO ] [MAIN ] OPP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:53:47.245389] [WARN ] [MAIN ] OPY: No existing data found, performing full refresh instead. [2025-09-17T20:53:47.246401] [INFO ] [MAIN ] OPY: Wiping existing primary data before full refresh. [2025-09-17T20:53:47.246562] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-17T20:53:47.246631] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-17T20:53:47.246687] [INFO ] [MAIN ] OPY: Starting full primary refresh. [2025-09-17T20:53:47.403293] [DEBUG] [LOCAL ] OPAD: Loaded 18309 existing records from primary storage. [2025-09-17T20:53:47.414929] [INFO ] [MAIN ] OPAD: Loaded 18309 existing records. [2025-09-17T20:53:47.409547] [DEBUG] [LOCAL ] OPP: Loaded 11811 existing records from primary storage. [2025-09-17T20:53:47.468460] [INFO ] [MAIN ] OPP: Loaded 11811 existing records. [2025-09-17T20:53:47.608117] [DEBUG] [LOCAL ] OPFI: Loaded 46843 existing records from primary storage. [2025-09-17T20:53:47.672975] [INFO ] [MAIN ] OPFI: Loaded 46843 existing records. [2025-09-17T20:53:48.121407] [WARN ] [MAIN ] OPAD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:53:48.232225] [WARN ] [MAIN ] OPP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:53:48.227550] [INFO ] [REMOTE ] OPY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:53:48.232349] [INFO ] [MAIN ] OPAD: Wiping existing primary data before full refresh. [2025-09-17T20:53:48.241980] [INFO ] [LOCAL ] OPAD: Starting deletion of primary data. [2025-09-17T20:53:48.241820] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-11. [2025-09-17T20:53:48.259410] [INFO ] [MAIN ] OPP: Wiping existing primary data before full refresh. [2025-09-17T20:53:48.263987] [DEBUG] [LOCAL ] OPAD: Deleted primary data file. [2025-09-17T20:53:48.264051] [INFO ] [LOCAL ] OPP: Starting deletion of primary data. [2025-09-17T20:53:48.264194] [WARN ] [MAIN ] OPFI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:53:48.264424] [INFO ] [MAIN ] OPAD: Starting full primary refresh. [2025-09-17T20:53:48.269694] [DEBUG] [LOCAL ] OPP: Deleted primary data file. [2025-09-17T20:53:48.286816] [INFO ] [MAIN ] OPFI: Wiping existing primary data before full refresh. [2025-09-17T20:53:48.295597] [INFO ] [LOCAL ] OPFI: Starting deletion of primary data. [2025-09-17T20:53:48.281270] [INFO ] [MAIN ] OPP: Starting full primary refresh. [2025-09-17T20:53:48.340715] [DEBUG] [LOCAL ] OPFI: Deleted primary data file. [2025-09-17T20:53:48.340826] [INFO ] [MAIN ] OPFI: Starting full primary refresh. [2025-09-17T20:53:49.271233] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T20:53:49.306814] [INFO ] [REMOTE ] OPY: Fetching primary data for 2024-12. [2025-09-17T20:53:49.274513] [INFO ] [REMOTE ] OPAD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:53:49.341787] [INFO ] [REMOTE ] OPP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:53:49.342409] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-11. [2025-09-17T20:53:49.358229] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-11. [2025-09-17T20:53:49.409705] [INFO ] [REMOTE ] OPFI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:53:49.410283] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-11. [2025-09-17T20:53:49.947151] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T20:53:49.948969] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2024-12. [2025-09-17T20:53:50.192453] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T20:53:50.194507] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-01. [2025-09-17T20:53:50.406528] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T20:53:50.410194] [INFO ] [REMOTE ] OPP: Fetching primary data for 2024-12. [2025-09-17T20:53:50.447952] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T20:53:50.525238] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T20:53:50.711484] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T20:53:50.815813] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2024-12. [2025-09-17T20:53:51.519621] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T20:53:51.615738] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-01. [2025-09-17T20:53:52.121254] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T20:53:52.415835] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-02. [2025-09-17T20:53:52.550436] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T20:53:53.013126] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T20:53:53.215857] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-03. [2025-09-17T20:53:53.882264] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T20:53:54.015794] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-02. [2025-09-17T20:53:54.674333] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T20:53:54.815798] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-01. [2025-09-17T20:53:55.408434] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T20:53:55.615819] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-01. [2025-09-17T20:53:56.415834] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-02. [2025-09-17T20:53:57.078973] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-02 (0.66 seconds). [2025-09-17T20:53:57.215772] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-03. [2025-09-17T20:53:57.402274] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T20:53:58.015834] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-02. [2025-09-17T20:53:58.361152] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T20:53:58.815787] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-04. [2025-09-17T20:53:59.573027] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T20:53:59.615792] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-04. [2025-09-17T20:54:00.028901] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T20:54:00.216315] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T20:54:00.415811] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-03. [2025-09-17T20:54:01.215801] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-05. [2025-09-17T20:54:01.922911] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T20:54:02.015806] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-05. [2025-09-17T20:54:02.194982] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T20:54:02.815862] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-03. [2025-09-17T20:54:03.012679] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T20:54:03.489301] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T20:54:03.615783] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-04. [2025-09-17T20:54:04.394839] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T20:54:04.415865] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-05. [2025-09-17T20:54:05.101584] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T20:54:05.215846] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-06. [2025-09-17T20:54:05.936896] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T20:54:06.015804] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-06. [2025-09-17T20:54:06.751463] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T20:54:06.815836] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-07. [2025-09-17T20:54:07.615779] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-07. [2025-09-17T20:54:07.709872] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T20:54:08.415789] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-04. [2025-09-17T20:54:09.129413] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T20:54:09.215740] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-08. [2025-09-17T20:54:09.963428] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T20:54:10.015804] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-05. [2025-09-17T20:54:10.815797] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-08. [2025-09-17T20:54:11.052819] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T20:54:11.511141] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T20:54:11.615783] [INFO ] [REMOTE ] OPP: Fetching primary data for 2025-09. [2025-09-17T20:54:11.811093] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T20:54:12.415807] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-06. [2025-09-17T20:54:12.471231] [INFO ] [REMOTE ] OPP: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T20:54:12.473502] [INFO ] [REMOTE ] OPP: Full fetch complete (17974 records). [2025-09-17T20:54:12.473621] [DEBUG] [VALIDATOR ] OPP: Validating primary data. [2025-09-17T20:54:12.863897] [DEBUG] [VALIDATOR ] OPP: All expected trading days are present. [2025-09-17T20:54:12.863990] [DEBUG] [VALIDATOR ] OPP: Primary data validation passed. [2025-09-17T20:54:12.864446] [INFO ] [MAIN ] OPP: Fetched primary data is valid. [2025-09-17T20:54:12.864488] [DEBUG] [LOCAL ] OPP: Saving primary data. [2025-09-17T20:54:12.865108] [DEBUG] [LOCAL ] OPP: Trimmed 17974 records to 11786 (keeping 200 days of data) [2025-09-17T20:54:12.941412] [DEBUG] [LOCAL ] OPP: Primary data saved (11786 records). [2025-09-17T20:54:12.941573] [INFO ] [MAIN ] OPP: Full history saved. [2025-09-17T20:54:12.941733] [INFO ] [MAIN ] Update Progress: 1601/2371 symbols completed. OPP took 26.4s. Estimated remaining: 1h 52m 38s. Rate: 6.8 symbols/min [2025-09-17T20:54:13.112458] [INFO ] [MAIN ] OR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:54:13.155465] [DEBUG] [LOCAL ] OR: Loaded 45886 existing records from primary storage. [2025-09-17T20:54:13.155609] [INFO ] [MAIN ] OR: Loaded 45886 existing records. [2025-09-17T20:54:13.220979] [INFO ] [REMOTE ] OPAD: Fetching primary data for 2025-09. [2025-09-17T20:54:13.336372] [WARN ] [MAIN ] OR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:54:13.336694] [INFO ] [MAIN ] OR: Wiping existing primary data before full refresh. [2025-09-17T20:54:13.342552] [INFO ] [LOCAL ] OR: Starting deletion of primary data. [2025-09-17T20:54:13.343257] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T20:54:13.345816] [DEBUG] [LOCAL ] OR: Deleted primary data file. [2025-09-17T20:54:13.346095] [INFO ] [MAIN ] OR: Starting full primary refresh. [2025-09-17T20:54:13.704419] [INFO ] [REMOTE ] OR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:54:14.015790] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-07. [2025-09-17T20:54:14.815870] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-11. [2025-09-17T20:54:14.909624] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T20:54:15.412822] [INFO ] [REMOTE ] OPAD: Incremental fetch complete for 2025-09 (2.19 seconds). [2025-09-17T20:54:15.419389] [INFO ] [REMOTE ] OPAD: Full fetch complete (21547 records). [2025-09-17T20:54:15.419477] [DEBUG] [VALIDATOR ] OPAD: Validating primary data. [2025-09-17T20:54:15.621443] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-08. [2025-09-17T20:54:15.786355] [DEBUG] [VALIDATOR ] OPAD: All expected trading days are present. [2025-09-17T20:54:15.786438] [DEBUG] [VALIDATOR ] OPAD: Primary data validation passed. [2025-09-17T20:54:15.786917] [INFO ] [MAIN ] OPAD: Fetched primary data is valid. [2025-09-17T20:54:15.786960] [DEBUG] [LOCAL ] OPAD: Saving primary data. [2025-09-17T20:54:15.787614] [DEBUG] [LOCAL ] OPAD: Trimmed 21547 records to 18628 (keeping 200 days of data) [2025-09-17T20:54:15.899135] [DEBUG] [LOCAL ] OPAD: Primary data saved (18628 records). [2025-09-17T20:54:15.899371] [INFO ] [MAIN ] OPAD: Full history saved. [2025-09-17T20:54:15.899507] [INFO ] [MAIN ] Update Progress: 1602/2371 symbols completed. OPAD took 29.4s. Estimated remaining: 1h 52m 26s. Rate: 6.8 symbols/min [2025-09-17T20:54:16.070749] [INFO ] [MAIN ] ORA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:54:16.098720] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T20:54:16.134667] [DEBUG] [LOCAL ] ORA: Loaded 32627 existing records from primary storage. [2025-09-17T20:54:16.134810] [INFO ] [MAIN ] ORA: Loaded 32627 existing records. [2025-09-17T20:54:16.315445] [WARN ] [MAIN ] ORA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:54:16.315744] [INFO ] [MAIN ] ORA: Wiping existing primary data before full refresh. [2025-09-17T20:54:16.315793] [INFO ] [LOCAL ] ORA: Starting deletion of primary data. [2025-09-17T20:54:16.316529] [DEBUG] [LOCAL ] ORA: Deleted primary data file. [2025-09-17T20:54:16.316576] [INFO ] [MAIN ] ORA: Starting full primary refresh. [2025-09-17T20:54:16.416858] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-06. [2025-09-17T20:54:16.621974] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T20:54:16.696247] [INFO ] [REMOTE ] ORA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:54:17.215834] [INFO ] [REMOTE ] OPY: Fetching primary data for 2025-09. [2025-09-17T20:54:17.997020] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T20:54:18.015746] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-07. [2025-09-17T20:54:18.051133] [INFO ] [REMOTE ] OPY: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T20:54:18.053625] [INFO ] [REMOTE ] OPY: Full fetch complete (10157 records). [2025-09-17T20:54:18.053721] [DEBUG] [VALIDATOR ] OPY: Validating primary data. [2025-09-17T20:54:18.241267] [WARN ] [VALIDATOR ] OPY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T20:54:18.241579] [FATAL] [MAIN ] OPY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:54:18.241632] [WARN ] [MAIN ] OPY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:54:18.241691] [INFO ] [LOCAL ] OPY: Starting deletion of primary data. [2025-09-17T20:54:18.241748] [DEBUG] [LOCAL ] OPY: No primary data file found to delete. [2025-09-17T20:54:18.241783] [INFO ] [LOCAL ] OPY: Starting deletion of derivative data. [2025-09-17T20:54:18.241821] [DEBUG] [LOCAL ] OPY: No derivative data file found to delete. [2025-09-17T20:54:18.241907] [INFO ] [MAIN ] Update Progress: 1603/2371 symbols completed. OPY took 31.7s. Estimated remaining: 1h 52m 14s. Rate: 6.8 symbols/min [2025-09-17T20:54:18.412545] [INFO ] [MAIN ] ORC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:54:18.462407] [DEBUG] [LOCAL ] ORC: Loaded 52270 existing records from primary storage. [2025-09-17T20:54:18.462572] [INFO ] [MAIN ] ORC: Loaded 52270 existing records. [2025-09-17T20:54:18.650256] [WARN ] [MAIN ] ORC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:54:18.650507] [INFO ] [MAIN ] ORC: Wiping existing primary data before full refresh. [2025-09-17T20:54:18.650555] [INFO ] [LOCAL ] ORC: Starting deletion of primary data. [2025-09-17T20:54:18.651617] [DEBUG] [LOCAL ] ORC: Deleted primary data file. [2025-09-17T20:54:18.651709] [INFO ] [MAIN ] ORC: Starting full primary refresh. [2025-09-17T20:54:18.816141] [INFO ] [REMOTE ] OR: Fetching primary data for 2024-12. [2025-09-17T20:54:19.026200] [INFO ] [REMOTE ] ORC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:54:19.615797] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-11. [2025-09-17T20:54:19.810419] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T20:54:20.415808] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-08. [2025-09-17T20:54:20.522362] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T20:54:20.885113] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T20:54:21.215776] [INFO ] [REMOTE ] ORA: Fetching primary data for 2024-12. [2025-09-17T20:54:21.898759] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T20:54:22.015813] [INFO ] [REMOTE ] OPFI: Fetching primary data for 2025-09. [2025-09-17T20:54:22.462525] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T20:54:22.815794] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-01. [2025-09-17T20:54:23.300236] [INFO ] [REMOTE ] OPFI: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T20:54:23.307107] [INFO ] [REMOTE ] OPFI: Full fetch complete (67119 records). [2025-09-17T20:54:23.307260] [DEBUG] [VALIDATOR ] OPFI: Validating primary data. [2025-09-17T20:54:23.620952] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-11. [2025-09-17T20:54:23.708047] [DEBUG] [VALIDATOR ] OPFI: All expected trading days are present. [2025-09-17T20:54:23.708177] [DEBUG] [VALIDATOR ] OPFI: Primary data validation passed. [2025-09-17T20:54:23.709393] [INFO ] [MAIN ] OPFI: Fetched primary data is valid. [2025-09-17T20:54:23.709475] [DEBUG] [LOCAL ] OPFI: Saving primary data. [2025-09-17T20:54:23.713367] [DEBUG] [LOCAL ] OPFI: Trimmed 67119 records to 46831 (keeping 200 days of data) [2025-09-17T20:54:24.001228] [DEBUG] [LOCAL ] OPFI: Primary data saved (46831 records). [2025-09-17T20:54:24.001381] [INFO ] [MAIN ] OPFI: Full history saved. [2025-09-17T20:54:24.001492] [INFO ] [MAIN ] Update Progress: 1604/2371 symbols completed. OPFI took 37.5s. Estimated remaining: 1h 52m 4s. Rate: 6.8 symbols/min [2025-09-17T20:54:24.175331] [INFO ] [MAIN ] ORCL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:54:24.175562] [DEBUG] [LOCAL ] ORCL: No existing data file found in primary storage. [2025-09-17T20:54:24.175602] [WARN ] [MAIN ] ORCL: No existing data found, performing full refresh instead. [2025-09-17T20:54:24.175734] [INFO ] [MAIN ] ORCL: Wiping existing primary data before full refresh. [2025-09-17T20:54:24.175781] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-17T20:54:24.175823] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-17T20:54:24.175856] [INFO ] [MAIN ] ORCL: Starting full primary refresh. [2025-09-17T20:54:24.429015] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-01. [2025-09-17T20:54:24.548374] [INFO ] [REMOTE ] ORCL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:54:24.569346] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T20:54:25.215821] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-02. [2025-09-17T20:54:25.329147] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T20:54:25.783429] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T20:54:26.015859] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-11. [2025-09-17T20:54:26.652976] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T20:54:26.815784] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-03. [2025-09-17T20:54:27.615815] [INFO ] [REMOTE ] ORC: Fetching primary data for 2024-12. [2025-09-17T20:54:28.216192] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-17T20:54:28.415808] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-02. [2025-09-17T20:54:28.518224] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T20:54:29.215798] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-04. [2025-09-17T20:54:29.389862] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T20:54:29.764551] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T20:54:30.015819] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2024-12. [2025-09-17T20:54:30.278230] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T20:54:30.815857] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-01. [2025-09-17T20:54:31.615852] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-03. [2025-09-17T20:54:32.415878] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-05. [2025-09-17T20:54:32.734300] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2024-12 (2.72 seconds). [2025-09-17T20:54:32.777037] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T20:54:32.876868] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T20:54:33.215791] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-02. [2025-09-17T20:54:33.655213] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T20:54:34.015797] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-04. [2025-09-17T20:54:34.815803] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-01. [2025-09-17T20:54:35.200702] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T20:54:35.440307] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T20:54:35.615778] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-05. [2025-09-17T20:54:36.415784] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-03. [2025-09-17T20:54:37.215821] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-06. [2025-09-17T20:54:37.385712] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T20:54:37.431350] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-01 (2.62 seconds). [2025-09-17T20:54:38.015764] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-02. [2025-09-17T20:54:38.376610] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T20:54:38.515662] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T20:54:38.815796] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-07. [2025-09-17T20:54:39.615807] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-06. [2025-09-17T20:54:40.309847] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-02 (2.29 seconds). [2025-09-17T20:54:40.344935] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T20:54:40.415787] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-08. [2025-09-17T20:54:41.215833] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-04. [2025-09-17T20:54:41.364831] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T20:54:41.908524] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T20:54:42.015772] [INFO ] [REMOTE ] ORA: Fetching primary data for 2025-09. [2025-09-17T20:54:42.815777] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-03. [2025-09-17T20:54:43.464140] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-04 (2.25 seconds). [2025-09-17T20:54:43.508725] [INFO ] [REMOTE ] ORA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T20:54:43.513107] [INFO ] [REMOTE ] ORA: Full fetch complete (49146 records). [2025-09-17T20:54:43.513214] [DEBUG] [VALIDATOR ] ORA: Validating primary data. [2025-09-17T20:54:43.620940] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-07. [2025-09-17T20:54:43.901202] [DEBUG] [VALIDATOR ] ORA: All expected trading days are present. [2025-09-17T20:54:43.901335] [DEBUG] [VALIDATOR ] ORA: Primary data validation passed. [2025-09-17T20:54:43.902346] [INFO ] [MAIN ] ORA: Fetched primary data is valid. [2025-09-17T20:54:43.902397] [DEBUG] [LOCAL ] ORA: Saving primary data. [2025-09-17T20:54:43.903862] [DEBUG] [LOCAL ] ORA: Trimmed 49146 records to 32661 (keeping 200 days of data) [2025-09-17T20:54:44.111371] [DEBUG] [LOCAL ] ORA: Primary data saved (32661 records). [2025-09-17T20:54:44.111534] [INFO ] [MAIN ] ORA: Full history saved. [2025-09-17T20:54:44.111626] [INFO ] [MAIN ] Update Progress: 1605/2371 symbols completed. ORA took 28.2s. Estimated remaining: 1h 52m 1s. Rate: 6.8 symbols/min [2025-09-17T20:54:44.288965] [INFO ] [MAIN ] ORI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:54:44.289217] [DEBUG] [LOCAL ] ORI: No existing data file found in primary storage. [2025-09-17T20:54:44.289275] [WARN ] [MAIN ] ORI: No existing data found, performing full refresh instead. [2025-09-17T20:54:44.289471] [INFO ] [MAIN ] ORI: Wiping existing primary data before full refresh. [2025-09-17T20:54:44.289535] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-17T20:54:44.289613] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-17T20:54:44.289684] [INFO ] [MAIN ] ORI: Starting full primary refresh. [2025-09-17T20:54:44.420924] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-05. [2025-09-17T20:54:44.680958] [INFO ] [REMOTE ] ORI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:54:44.938772] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T20:54:44.983521] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T20:54:45.215777] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-04. [2025-09-17T20:54:46.015811] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-08. [2025-09-17T20:54:46.626449] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-17T20:54:46.815862] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-11. [2025-09-17T20:54:47.455092] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T20:54:47.615754] [INFO ] [REMOTE ] OR: Fetching primary data for 2025-09. [2025-09-17T20:54:47.764503] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-17T20:54:48.415839] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-05. [2025-09-17T20:54:48.538947] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T20:54:49.079050] [INFO ] [REMOTE ] OR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T20:54:49.085762] [INFO ] [REMOTE ] OR: Full fetch complete (64489 records). [2025-09-17T20:54:49.085943] [DEBUG] [VALIDATOR ] OR: Validating primary data. [2025-09-17T20:54:49.221061] [INFO ] [REMOTE ] ORI: Fetching primary data for 2024-12. [2025-09-17T20:54:49.499537] [DEBUG] [VALIDATOR ] OR: All expected trading days are present. [2025-09-17T20:54:49.499678] [DEBUG] [VALIDATOR ] OR: Primary data validation passed. [2025-09-17T20:54:49.501316] [INFO ] [MAIN ] OR: Fetched primary data is valid. [2025-09-17T20:54:49.501386] [DEBUG] [LOCAL ] OR: Saving primary data. [2025-09-17T20:54:49.503392] [DEBUG] [LOCAL ] OR: Trimmed 64489 records to 45904 (keeping 200 days of data) [2025-09-17T20:54:49.818717] [DEBUG] [LOCAL ] OR: Primary data saved (45904 records). [2025-09-17T20:54:49.818927] [INFO ] [MAIN ] OR: Full history saved. [2025-09-17T20:54:49.820421] [INFO ] [MAIN ] Update Progress: 1606/2371 symbols completed. OR took 36.9s. Estimated remaining: 1h 51m 51s. Rate: 6.8 symbols/min [2025-09-17T20:54:50.015890] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-06. [2025-09-17T20:54:50.017542] [INFO ] [MAIN ] ORN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:54:50.058853] [DEBUG] [LOCAL ] ORN: Loaded 31790 existing records from primary storage. [2025-09-17T20:54:50.059064] [INFO ] [MAIN ] ORN: Loaded 31790 existing records. [2025-09-17T20:54:50.253468] [WARN ] [MAIN ] ORN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:54:50.254175] [INFO ] [MAIN ] ORN: Wiping existing primary data before full refresh. [2025-09-17T20:54:50.254411] [INFO ] [LOCAL ] ORN: Starting deletion of primary data. [2025-09-17T20:54:50.255393] [DEBUG] [LOCAL ] ORN: Deleted primary data file. [2025-09-17T20:54:50.255451] [INFO ] [MAIN ] ORN: Starting full primary refresh. [2025-09-17T20:54:50.624974] [INFO ] [REMOTE ] ORN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:54:50.815835] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-11. [2025-09-17T20:54:51.022279] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T20:54:51.050758] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-05 (2.63 seconds). [2025-09-17T20:54:51.609073] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T20:54:51.619140] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-01. [2025-09-17T20:54:52.059276] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T20:54:52.415794] [INFO ] [REMOTE ] ORN: Fetching primary data for 2024-12. [2025-09-17T20:54:53.076958] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T20:54:53.215783] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-06. [2025-09-17T20:54:53.350133] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T20:54:54.015819] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-01. [2025-09-17T20:54:54.815785] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-07. [2025-09-17T20:54:55.498007] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T20:54:55.615766] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-02. [2025-09-17T20:54:55.754468] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-06 (2.54 seconds). [2025-09-17T20:54:56.415839] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-02. [2025-09-17T20:54:56.679523] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T20:54:56.886157] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T20:54:57.215792] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-08. [2025-09-17T20:54:57.747409] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T20:54:58.015791] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-07. [2025-09-17T20:54:58.815816] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-03. [2025-09-17T20:54:59.131150] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T20:54:59.615825] [INFO ] [REMOTE ] ORC: Fetching primary data for 2025-09. [2025-09-17T20:55:00.320313] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T20:55:00.415841] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-03. [2025-09-17T20:55:00.763375] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-07 (2.75 seconds). [2025-09-17T20:55:01.215783] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-04. [2025-09-17T20:55:01.377590] [INFO ] [REMOTE ] ORC: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T20:55:01.385584] [INFO ] [REMOTE ] ORC: Full fetch complete (74995 records). [2025-09-17T20:55:01.385923] [DEBUG] [VALIDATOR ] ORC: Validating primary data. [2025-09-17T20:55:01.818317] [DEBUG] [VALIDATOR ] ORC: All expected trading days are present. [2025-09-17T20:55:01.818410] [DEBUG] [VALIDATOR ] ORC: Primary data validation passed. [2025-09-17T20:55:01.819430] [INFO ] [MAIN ] ORC: Fetched primary data is valid. [2025-09-17T20:55:01.819505] [DEBUG] [LOCAL ] ORC: Saving primary data. [2025-09-17T20:55:01.822348] [DEBUG] [LOCAL ] ORC: Trimmed 74995 records to 52262 (keeping 200 days of data) [2025-09-17T20:55:02.040046] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-08. [2025-09-17T20:55:02.216881] [DEBUG] [LOCAL ] ORC: Primary data saved (52262 records). [2025-09-17T20:55:02.217129] [INFO ] [MAIN ] ORC: Full history saved. [2025-09-17T20:55:02.217309] [INFO ] [MAIN ] Update Progress: 1607/2371 symbols completed. ORC took 44.0s. Estimated remaining: 1h 51m 44s. Rate: 6.8 symbols/min [2025-09-17T20:55:02.421357] [INFO ] [MAIN ] OSCR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:55:02.421896] [DEBUG] [LOCAL ] OSCR: No existing data file found in primary storage. [2025-09-17T20:55:02.422009] [WARN ] [MAIN ] OSCR: No existing data found, performing full refresh instead. [2025-09-17T20:55:02.422319] [INFO ] [MAIN ] OSCR: Wiping existing primary data before full refresh. [2025-09-17T20:55:02.422406] [INFO ] [LOCAL ] OSCR: Starting deletion of primary data. [2025-09-17T20:55:02.422499] [DEBUG] [LOCAL ] OSCR: No primary data file found to delete. [2025-09-17T20:55:02.422626] [INFO ] [MAIN ] OSCR: Starting full primary refresh. [2025-09-17T20:55:02.798200] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-03 (2.38 seconds). [2025-09-17T20:55:02.868928] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-04. [2025-09-17T20:55:02.927436] [INFO ] [REMOTE ] OSCR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:55:02.964534] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T20:55:03.615776] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-05. [2025-09-17T20:55:04.415899] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-11. [2025-09-17T20:55:04.713332] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T20:55:04.763032] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-08 (2.72 seconds). [2025-09-17T20:55:04.802564] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T20:55:05.215792] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-05. [2025-09-17T20:55:05.841526] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T20:55:06.015813] [INFO ] [REMOTE ] ORCL: Fetching primary data for 2025-09. [2025-09-17T20:55:06.681312] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T20:55:06.727342] [INFO ] [REMOTE ] ORCL: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T20:55:06.733540] [INFO ] [REMOTE ] ORCL: Full fetch complete (77060 records). [2025-09-17T20:55:06.733736] [DEBUG] [VALIDATOR ] ORCL: Validating primary data. [2025-09-17T20:55:06.734592] [FATAL] [VALIDATOR ] ORCL: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T20:55:06.734712] [FATAL] [MAIN ] ORCL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:55:06.734773] [WARN ] [MAIN ] ORCL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:55:06.734823] [INFO ] [LOCAL ] ORCL: Starting deletion of primary data. [2025-09-17T20:55:06.734884] [DEBUG] [LOCAL ] ORCL: No primary data file found to delete. [2025-09-17T20:55:06.734928] [INFO ] [LOCAL ] ORCL: Starting deletion of derivative data. [2025-09-17T20:55:06.734970] [DEBUG] [LOCAL ] ORCL: No derivative data file found to delete. [2025-09-17T20:55:06.735032] [INFO ] [MAIN ] Update Progress: 1608/2371 symbols completed. ORCL took 42.7s. Estimated remaining: 1h 51m 33s. Rate: 6.8 symbols/min [2025-09-17T20:55:06.820983] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-06. [2025-09-17T20:55:06.914480] [INFO ] [MAIN ] OSK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:55:06.914702] [DEBUG] [LOCAL ] OSK: No existing data file found in primary storage. [2025-09-17T20:55:06.914742] [WARN ] [MAIN ] OSK: No existing data found, performing full refresh instead. [2025-09-17T20:55:06.914873] [INFO ] [MAIN ] OSK: Wiping existing primary data before full refresh. [2025-09-17T20:55:06.914914] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-17T20:55:06.914956] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-17T20:55:06.914989] [INFO ] [MAIN ] OSK: Starting full primary refresh. [2025-09-17T20:55:07.368212] [INFO ] [REMOTE ] OSK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:55:07.615828] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-06. [2025-09-17T20:55:08.415770] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2024-12. [2025-09-17T20:55:08.633444] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T20:55:08.879607] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T20:55:09.215846] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-07. [2025-09-17T20:55:10.015841] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-07. [2025-09-17T20:55:10.219404] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T20:55:10.815783] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-01. [2025-09-17T20:55:11.127586] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T20:55:11.182039] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T20:55:11.615769] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-11. [2025-09-17T20:55:12.380075] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T20:55:12.415790] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-08. [2025-09-17T20:55:13.009362] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T20:55:13.215783] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-02. [2025-09-17T20:55:13.645947] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T20:55:14.015776] [INFO ] [REMOTE ] ORN: Fetching primary data for 2025-09. [2025-09-17T20:55:14.815767] [INFO ] [REMOTE ] OSK: Fetching primary data for 2024-12. [2025-09-17T20:55:15.294486] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T20:55:15.319424] [INFO ] [REMOTE ] ORN: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T20:55:15.323997] [INFO ] [REMOTE ] ORN: Full fetch complete (45510 records). [2025-09-17T20:55:15.324170] [DEBUG] [VALIDATOR ] ORN: Validating primary data. [2025-09-17T20:55:15.620948] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-03. [2025-09-17T20:55:15.845766] [DEBUG] [VALIDATOR ] ORN: All expected trading days are present. [2025-09-17T20:55:15.845940] [DEBUG] [VALIDATOR ] ORN: Primary data validation passed. [2025-09-17T20:55:15.847636] [INFO ] [MAIN ] ORN: Fetched primary data is valid. [2025-09-17T20:55:15.847771] [DEBUG] [LOCAL ] ORN: Saving primary data. [2025-09-17T20:55:15.849504] [DEBUG] [LOCAL ] ORN: Trimmed 45510 records to 31858 (keeping 200 days of data) [2025-09-17T20:55:16.132561] [DEBUG] [LOCAL ] ORN: Primary data saved (31858 records). [2025-09-17T20:55:16.132796] [INFO ] [MAIN ] ORN: Full history saved. [2025-09-17T20:55:16.133727] [INFO ] [MAIN ] Update Progress: 1609/2371 symbols completed. ORN took 26.3s. Estimated remaining: 1h 51m 24s. Rate: 6.8 symbols/min [2025-09-17T20:55:16.395610] [INFO ] [MAIN ] OTF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:55:16.395862] [DEBUG] [LOCAL ] OTF: No existing data file found in primary storage. [2025-09-17T20:55:16.395903] [WARN ] [MAIN ] OTF: No existing data found, performing full refresh instead. [2025-09-17T20:55:16.396051] [INFO ] [MAIN ] OTF: Wiping existing primary data before full refresh. [2025-09-17T20:55:16.396094] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-17T20:55:16.396137] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-17T20:55:16.396205] [INFO ] [MAIN ] OTF: Starting full primary refresh. [2025-09-17T20:55:16.428884] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-08. [2025-09-17T20:55:16.807710] [INFO ] [REMOTE ] OTF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:55:16.835234] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T20:55:17.215810] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-11. [2025-09-17T20:55:17.790410] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T20:55:17.935343] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:55:17.946449] [WARN ] [REMOTE ] OTF: No data returned for month 2024-11 [2025-09-17T20:55:17.970142] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-17T20:55:18.015777] [INFO ] [REMOTE ] ORI: Fetching primary data for 2025-09. [2025-09-17T20:55:18.815827] [INFO ] [REMOTE ] OTF: Fetching primary data for 2024-12. [2025-09-17T20:55:19.067431] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:55:19.067801] [WARN ] [REMOTE ] OTF: No data returned for month 2024-12 [2025-09-17T20:55:19.628622] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-01. [2025-09-17T20:55:19.631406] [INFO ] [REMOTE ] ORI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T20:55:19.640884] [INFO ] [REMOTE ] ORI: Full fetch complete (69915 records). [2025-09-17T20:55:19.641064] [DEBUG] [VALIDATOR ] ORI: Validating primary data. [2025-09-17T20:55:19.886606] [WARN ] [VALIDATOR ] ORI: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T20:55:19.887442] [FATAL] [MAIN ] ORI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:55:19.887496] [WARN ] [MAIN ] ORI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:55:19.887542] [INFO ] [LOCAL ] ORI: Starting deletion of primary data. [2025-09-17T20:55:19.887611] [DEBUG] [LOCAL ] ORI: No primary data file found to delete. [2025-09-17T20:55:19.887667] [INFO ] [LOCAL ] ORI: Starting deletion of derivative data. [2025-09-17T20:55:19.887711] [DEBUG] [LOCAL ] ORI: No derivative data file found to delete. [2025-09-17T20:55:19.887804] [INFO ] [MAIN ] Update Progress: 1610/2371 symbols completed. ORI took 35.8s. Estimated remaining: 1h 51m 13s. Rate: 6.8 symbols/min [2025-09-17T20:55:20.055801] [INFO ] [MAIN ] OTIS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:55:20.071196] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:55:20.071540] [WARN ] [REMOTE ] OTF: No data returned for month 2025-01 [2025-09-17T20:55:20.114064] [DEBUG] [LOCAL ] OTIS: Loaded 52711 existing records from primary storage. [2025-09-17T20:55:20.114211] [INFO ] [MAIN ] OTIS: Loaded 52711 existing records. [2025-09-17T20:55:20.295126] [WARN ] [MAIN ] OTIS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:55:20.295378] [INFO ] [MAIN ] OTIS: Wiping existing primary data before full refresh. [2025-09-17T20:55:20.295425] [INFO ] [LOCAL ] OTIS: Starting deletion of primary data. [2025-09-17T20:55:20.296896] [DEBUG] [LOCAL ] OTIS: Deleted primary data file. [2025-09-17T20:55:20.296959] [INFO ] [MAIN ] OTIS: Starting full primary refresh. [2025-09-17T20:55:20.420914] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-02. [2025-09-17T20:55:20.666444] [INFO ] [REMOTE ] OTIS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:55:20.822167] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:55:20.822500] [WARN ] [REMOTE ] OTF: No data returned for month 2025-02 [2025-09-17T20:55:21.215776] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-11. [2025-09-17T20:55:22.015788] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-04. [2025-09-17T20:55:22.815820] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-01. [2025-09-17T20:55:22.990992] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T20:55:23.615788] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2024-12. [2025-09-17T20:55:24.082512] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-04 (2.07 seconds). [2025-09-17T20:55:24.202201] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T20:55:24.415778] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-03. [2025-09-17T20:55:24.665347] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:55:24.665702] [WARN ] [REMOTE ] OTF: No data returned for month 2025-03 [2025-09-17T20:55:25.084487] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T20:55:25.215767] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-01. [2025-09-17T20:55:26.015775] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-05. [2025-09-17T20:55:26.815783] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-04. [2025-09-17T20:55:27.078366] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T20:55:27.104894] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:55:27.105164] [WARN ] [REMOTE ] OTF: No data returned for month 2025-04 [2025-09-17T20:55:27.615782] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-05. [2025-09-17T20:55:27.891146] [DEBUG] [REMOTE ] OTF: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:55:27.891508] [WARN ] [REMOTE ] OTF: No data returned for month 2025-05 [2025-09-17T20:55:28.415763] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-06. [2025-09-17T20:55:28.464418] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-05 (2.45 seconds). [2025-09-17T20:55:29.215789] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-06. [2025-09-17T20:55:29.247774] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T20:55:30.015784] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-02. [2025-09-17T20:55:30.815792] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-02. [2025-09-17T20:55:31.613909] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T20:55:31.621787] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-07. [2025-09-17T20:55:31.814397] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-17T20:55:32.380901] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T20:55:32.415756] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-03. [2025-09-17T20:55:32.505169] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T20:55:33.215785] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-03. [2025-09-17T20:55:33.808313] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T20:55:34.015814] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-08. [2025-09-17T20:55:34.809740] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T20:55:34.815665] [INFO ] [REMOTE ] OTF: Fetching primary data for 2025-09. [2025-09-17T20:55:34.892260] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T20:55:35.615824] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-04. [2025-09-17T20:55:35.879945] [INFO ] [REMOTE ] OTF: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T20:55:35.883872] [INFO ] [REMOTE ] OTF: Full fetch complete (6963 records). [2025-09-17T20:55:35.883983] [DEBUG] [VALIDATOR ] OTF: Validating primary data. [2025-09-17T20:55:36.065306] [WARN ] [VALIDATOR ] OTF: Validation failed - insufficient historical data. Have 67 unique days, need 200 days [2025-09-17T20:55:36.065581] [FATAL] [MAIN ] OTF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:55:36.065668] [WARN ] [MAIN ] OTF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:55:36.065774] [INFO ] [LOCAL ] OTF: Starting deletion of primary data. [2025-09-17T20:55:36.065845] [DEBUG] [LOCAL ] OTF: No primary data file found to delete. [2025-09-17T20:55:36.065882] [INFO ] [LOCAL ] OTF: Starting deletion of derivative data. [2025-09-17T20:55:36.065921] [DEBUG] [LOCAL ] OTF: No derivative data file found to delete. [2025-09-17T20:55:36.065991] [INFO ] [MAIN ] Update Progress: 1611/2371 symbols completed. OTF took 19.9s. Estimated remaining: 1h 51m 8s. Rate: 6.8 symbols/min [2025-09-17T20:55:36.241563] [INFO ] [MAIN ] OUT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:55:36.298451] [DEBUG] [LOCAL ] OUT: Loaded 48284 existing records from primary storage. [2025-09-17T20:55:36.298606] [INFO ] [MAIN ] OUT: Loaded 48284 existing records. [2025-09-17T20:55:36.420896] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-07. [2025-09-17T20:55:36.477741] [WARN ] [MAIN ] OUT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:55:36.478086] [INFO ] [MAIN ] OUT: Wiping existing primary data before full refresh. [2025-09-17T20:55:36.478141] [INFO ] [LOCAL ] OUT: Starting deletion of primary data. [2025-09-17T20:55:36.479491] [DEBUG] [LOCAL ] OUT: Deleted primary data file. [2025-09-17T20:55:36.479546] [INFO ] [MAIN ] OUT: Starting full primary refresh. [2025-09-17T20:55:36.872394] [INFO ] [REMOTE ] OUT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:55:37.215796] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-04. [2025-09-17T20:55:37.554690] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T20:55:38.015783] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-05. [2025-09-17T20:55:38.710739] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T20:55:38.815729] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-05. [2025-09-17T20:55:39.201076] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-07 (2.78 seconds). [2025-09-17T20:55:39.615793] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-11. [2025-09-17T20:55:40.005938] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-05 (1.99 seconds). [2025-09-17T20:55:40.227248] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T20:55:40.415795] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-06. [2025-09-17T20:55:41.002346] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T20:55:41.215770] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-08. [2025-09-17T20:55:42.015751] [INFO ] [REMOTE ] OUT: Fetching primary data for 2024-12. [2025-09-17T20:55:42.018512] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T20:55:42.815728] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-07. [2025-09-17T20:55:43.615776] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-06. [2025-09-17T20:55:43.679794] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-17T20:55:43.718178] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T20:55:44.413488] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T20:55:44.422413] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-01. [2025-09-17T20:55:45.223023] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-08. [2025-09-17T20:55:45.228458] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T20:55:45.717191] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T20:55:46.015840] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-02. [2025-09-17T20:55:46.815806] [INFO ] [REMOTE ] OSCR: Fetching primary data for 2025-09. [2025-09-17T20:55:46.974717] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T20:55:47.272330] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T20:55:47.615817] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-03. [2025-09-17T20:55:48.415813] [INFO ] [REMOTE ] OSK: Fetching primary data for 2025-09. [2025-09-17T20:55:49.000714] [INFO ] [REMOTE ] OSCR: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-17T20:55:49.008979] [INFO ] [REMOTE ] OSCR: Full fetch complete (77301 records). [2025-09-17T20:55:49.009126] [DEBUG] [VALIDATOR ] OSCR: Validating primary data. [2025-09-17T20:55:49.241023] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-07. [2025-09-17T20:55:49.413932] [DEBUG] [VALIDATOR ] OSCR: All expected trading days are present. [2025-09-17T20:55:49.414062] [DEBUG] [VALIDATOR ] OSCR: Primary data validation passed. [2025-09-17T20:55:49.415192] [INFO ] [MAIN ] OSCR: Fetched primary data is valid. [2025-09-17T20:55:49.415313] [DEBUG] [LOCAL ] OSCR: Saving primary data. [2025-09-17T20:55:49.417201] [DEBUG] [LOCAL ] OSCR: Trimmed 77301 records to 53695 (keeping 200 days of data) [2025-09-17T20:55:49.541372] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T20:55:49.794045] [DEBUG] [LOCAL ] OSCR: Primary data saved (53695 records). [2025-09-17T20:55:49.794198] [INFO ] [MAIN ] OSCR: Full history saved. [2025-09-17T20:55:49.794284] [INFO ] [MAIN ] Update Progress: 1612/2371 symbols completed. OSCR took 47.6s. Estimated remaining: 1h 51m 1s. Rate: 6.8 symbols/min [2025-09-17T20:55:49.975501] [INFO ] [MAIN ] OVV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:55:49.991880] [INFO ] [REMOTE ] OSK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T20:55:49.997948] [INFO ] [REMOTE ] OSK: Full fetch complete (61303 records). [2025-09-17T20:55:49.998100] [DEBUG] [VALIDATOR ] OSK: Validating primary data. [2025-09-17T20:55:50.020891] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-04. [2025-09-17T20:55:50.210597] [WARN ] [VALIDATOR ] OSK: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T20:55:50.211317] [FATAL] [MAIN ] OSK: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:55:50.211390] [WARN ] [MAIN ] OSK: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:55:50.211477] [INFO ] [LOCAL ] OSK: Starting deletion of primary data. [2025-09-17T20:55:50.211550] [DEBUG] [LOCAL ] OSK: No primary data file found to delete. [2025-09-17T20:55:50.211588] [INFO ] [LOCAL ] OSK: Starting deletion of derivative data. [2025-09-17T20:55:50.211628] [DEBUG] [LOCAL ] OSK: No derivative data file found to delete. [2025-09-17T20:55:50.211736] [INFO ] [MAIN ] Update Progress: 1613/2371 symbols completed. OSK took 43.5s. Estimated remaining: 1h 50m 49s. Rate: 6.8 symbols/min [2025-09-17T20:55:50.331056] [DEBUG] [LOCAL ] OVV: Loaded 53517 existing records from primary storage. [2025-09-17T20:55:50.346806] [INFO ] [MAIN ] OVV: Loaded 53517 existing records. [2025-09-17T20:55:50.513282] [INFO ] [MAIN ] OWL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:55:50.598238] [WARN ] [MAIN ] OVV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:55:50.598487] [INFO ] [MAIN ] OVV: Wiping existing primary data before full refresh. [2025-09-17T20:55:50.598544] [INFO ] [LOCAL ] OVV: Starting deletion of primary data. [2025-09-17T20:55:50.600088] [DEBUG] [LOCAL ] OVV: Deleted primary data file. [2025-09-17T20:55:50.600165] [INFO ] [MAIN ] OVV: Starting full primary refresh. [2025-09-17T20:55:50.922924] [DEBUG] [LOCAL ] OWL: Loaded 53557 existing records from primary storage. [2025-09-17T20:55:50.928702] [INFO ] [MAIN ] OWL: Loaded 53557 existing records. [2025-09-17T20:55:51.122870] [INFO ] [REMOTE ] OVV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:55:51.133484] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-11. [2025-09-17T20:55:51.189992] [WARN ] [MAIN ] OWL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:55:51.190325] [INFO ] [MAIN ] OWL: Wiping existing primary data before full refresh. [2025-09-17T20:55:51.190428] [INFO ] [LOCAL ] OWL: Starting deletion of primary data. [2025-09-17T20:55:51.191511] [DEBUG] [LOCAL ] OWL: Deleted primary data file. [2025-09-17T20:55:51.191588] [INFO ] [MAIN ] OWL: Starting full primary refresh. [2025-09-17T20:55:51.571560] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-17T20:55:51.601776] [INFO ] [REMOTE ] OWL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:55:51.615726] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-11. [2025-09-17T20:55:51.874708] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T20:55:52.415798] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-08. [2025-09-17T20:55:52.629287] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T20:55:52.929666] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T20:55:53.215795] [INFO ] [REMOTE ] OWL: Fetching primary data for 2024-12. [2025-09-17T20:55:54.015811] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-05. [2025-09-17T20:55:54.377674] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T20:55:54.815799] [INFO ] [REMOTE ] OTIS: Fetching primary data for 2025-09. [2025-09-17T20:55:54.916296] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T20:55:55.614928] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T20:55:55.624718] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-01. [2025-09-17T20:55:56.134863] [INFO ] [REMOTE ] OTIS: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T20:55:56.143296] [INFO ] [REMOTE ] OTIS: Full fetch complete (75531 records). [2025-09-17T20:55:56.143432] [DEBUG] [VALIDATOR ] OTIS: Validating primary data. [2025-09-17T20:55:56.421052] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-06. [2025-09-17T20:55:56.536894] [DEBUG] [VALIDATOR ] OTIS: All expected trading days are present. [2025-09-17T20:55:56.536977] [DEBUG] [VALIDATOR ] OTIS: Primary data validation passed. [2025-09-17T20:55:56.537997] [INFO ] [MAIN ] OTIS: Fetched primary data is valid. [2025-09-17T20:55:56.538044] [DEBUG] [LOCAL ] OTIS: Saving primary data. [2025-09-17T20:55:56.539535] [DEBUG] [LOCAL ] OTIS: Trimmed 75531 records to 52715 (keeping 200 days of data) [2025-09-17T20:55:56.886907] [DEBUG] [LOCAL ] OTIS: Primary data saved (52715 records). [2025-09-17T20:55:56.887088] [INFO ] [MAIN ] OTIS: Full history saved. [2025-09-17T20:55:56.887210] [INFO ] [MAIN ] Update Progress: 1614/2371 symbols completed. OTIS took 37.0s. Estimated remaining: 1h 50m 39s. Rate: 6.8 symbols/min [2025-09-17T20:55:57.073137] [INFO ] [MAIN ] OWLT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:55:57.084020] [DEBUG] [LOCAL ] OWLT: Loaded 8697 existing records from primary storage. [2025-09-17T20:55:57.084140] [INFO ] [MAIN ] OWLT: Loaded 8697 existing records. [2025-09-17T20:55:57.227330] [INFO ] [REMOTE ] OVV: Fetching primary data for 2024-12. [2025-09-17T20:55:57.267284] [WARN ] [MAIN ] OWLT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:55:57.267534] [INFO ] [MAIN ] OWLT: Wiping existing primary data before full refresh. [2025-09-17T20:55:57.267582] [INFO ] [LOCAL ] OWLT: Starting deletion of primary data. [2025-09-17T20:55:57.267907] [DEBUG] [LOCAL ] OWLT: Deleted primary data file. [2025-09-17T20:55:57.267956] [INFO ] [MAIN ] OWLT: Starting full primary refresh. [2025-09-17T20:55:57.631633] [INFO ] [REMOTE ] OWLT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:55:57.663106] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T20:55:57.740490] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T20:55:58.015789] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-02. [2025-09-17T20:55:58.815818] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-07. [2025-09-17T20:55:59.232764] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T20:55:59.363091] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T20:55:59.615846] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-11. [2025-09-17T20:56:00.325377] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T20:56:00.415775] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-08. [2025-09-17T20:56:00.495411] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T20:56:01.215897] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2024-12. [2025-09-17T20:56:02.015833] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-03. [2025-09-17T20:56:02.048429] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T20:56:02.167677] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T20:56:02.815820] [INFO ] [REMOTE ] OUT: Fetching primary data for 2025-09. [2025-09-17T20:56:03.615766] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-01. [2025-09-17T20:56:04.005358] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T20:56:04.046725] [INFO ] [REMOTE ] OUT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T20:56:04.052989] [INFO ] [REMOTE ] OUT: Full fetch complete (69005 records). [2025-09-17T20:56:04.053106] [DEBUG] [VALIDATOR ] OUT: Validating primary data. [2025-09-17T20:56:04.421474] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-04. [2025-09-17T20:56:04.459716] [DEBUG] [VALIDATOR ] OUT: All expected trading days are present. [2025-09-17T20:56:04.459808] [DEBUG] [VALIDATOR ] OUT: Primary data validation passed. [2025-09-17T20:56:04.460772] [INFO ] [MAIN ] OUT: Fetched primary data is valid. [2025-09-17T20:56:04.460818] [DEBUG] [LOCAL ] OUT: Saving primary data. [2025-09-17T20:56:04.462373] [DEBUG] [LOCAL ] OUT: Trimmed 69005 records to 48280 (keeping 200 days of data) [2025-09-17T20:56:04.765682] [DEBUG] [LOCAL ] OUT: Primary data saved (48280 records). [2025-09-17T20:56:04.765832] [INFO ] [MAIN ] OUT: Full history saved. [2025-09-17T20:56:04.766556] [INFO ] [MAIN ] Update Progress: 1615/2371 symbols completed. OUT took 28.7s. Estimated remaining: 1h 50m 30s. Rate: 6.8 symbols/min [2025-09-17T20:56:04.940633] [INFO ] [MAIN ] OXM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:56:04.985415] [DEBUG] [LOCAL ] OXM: Loaded 33661 existing records from primary storage. [2025-09-17T20:56:04.985702] [INFO ] [MAIN ] OXM: Loaded 33661 existing records. [2025-09-17T20:56:05.182193] [WARN ] [MAIN ] OXM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:56:05.182570] [INFO ] [MAIN ] OXM: Wiping existing primary data before full refresh. [2025-09-17T20:56:05.182780] [INFO ] [LOCAL ] OXM: Starting deletion of primary data. [2025-09-17T20:56:05.183704] [DEBUG] [LOCAL ] OXM: Deleted primary data file. [2025-09-17T20:56:05.183771] [INFO ] [MAIN ] OXM: Starting full primary refresh. [2025-09-17T20:56:05.223943] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-01. [2025-09-17T20:56:05.263261] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T20:56:05.623989] [INFO ] [REMOTE ] OXM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:56:06.016398] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-02. [2025-09-17T20:56:06.022868] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T20:56:06.045324] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T20:56:06.815811] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-05. [2025-09-17T20:56:07.615806] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-02. [2025-09-17T20:56:07.712892] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T20:56:08.042932] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T20:56:08.232161] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T20:56:08.415849] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-06. [2025-09-17T20:56:09.215841] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-03. [2025-09-17T20:56:10.015797] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-03. [2025-09-17T20:56:10.041524] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T20:56:10.084524] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T20:56:10.815800] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-07. [2025-09-17T20:56:11.615787] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-11. [2025-09-17T20:56:11.976173] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T20:56:12.415741] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-04. [2025-09-17T20:56:12.581157] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T20:56:12.869469] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T20:56:13.100353] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T20:56:13.215773] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-08. [2025-09-17T20:56:14.015778] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-04. [2025-09-17T20:56:14.815756] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-05. [2025-09-17T20:56:14.893529] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T20:56:15.568219] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T20:56:15.568394] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T20:56:15.615731] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-05. [2025-09-17T20:56:16.415787] [INFO ] [REMOTE ] OWL: Fetching primary data for 2025-09. [2025-09-17T20:56:17.215781] [INFO ] [REMOTE ] OXM: Fetching primary data for 2024-12. [2025-09-17T20:56:17.458781] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T20:56:17.881290] [INFO ] [REMOTE ] OWL: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T20:56:17.888209] [INFO ] [REMOTE ] OWL: Full fetch complete (77347 records). [2025-09-17T20:56:17.888339] [DEBUG] [VALIDATOR ] OWL: Validating primary data. [2025-09-17T20:56:18.020865] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-06. [2025-09-17T20:56:18.309224] [DEBUG] [VALIDATOR ] OWL: All expected trading days are present. [2025-09-17T20:56:18.309380] [DEBUG] [VALIDATOR ] OWL: Primary data validation passed. [2025-09-17T20:56:18.310536] [INFO ] [MAIN ] OWL: Fetched primary data is valid. [2025-09-17T20:56:18.310587] [DEBUG] [LOCAL ] OWL: Saving primary data. [2025-09-17T20:56:18.312216] [DEBUG] [LOCAL ] OWL: Trimmed 77347 records to 53556 (keeping 200 days of data) [2025-09-17T20:56:18.653356] [DEBUG] [LOCAL ] OWL: Primary data saved (53556 records). [2025-09-17T20:56:18.653516] [INFO ] [MAIN ] OWL: Full history saved. [2025-09-17T20:56:18.653630] [INFO ] [MAIN ] Update Progress: 1616/2371 symbols completed. OWL took 28.4s. Estimated remaining: 1h 50m 23s. Rate: 6.8 symbols/min [2025-09-17T20:56:18.819820] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-06. [2025-09-17T20:56:18.844347] [INFO ] [MAIN ] OXY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:56:18.845999] [DEBUG] [LOCAL ] OXY: No existing data file found in primary storage. [2025-09-17T20:56:18.846153] [WARN ] [MAIN ] OXY: No existing data found, performing full refresh instead. [2025-09-17T20:56:18.846495] [INFO ] [MAIN ] OXY: Wiping existing primary data before full refresh. [2025-09-17T20:56:18.855191] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-17T20:56:18.856248] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T20:56:18.856564] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-17T20:56:18.860286] [INFO ] [MAIN ] OXY: Starting full primary refresh. [2025-09-17T20:56:19.265109] [INFO ] [REMOTE ] OXY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:56:19.268119] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-17T20:56:19.615822] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-11. [2025-09-17T20:56:20.421114] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-07. [2025-09-17T20:56:20.435246] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T20:56:21.215795] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-01. [2025-09-17T20:56:21.293069] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T20:56:22.015810] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-08. [2025-09-17T20:56:22.087303] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-11 (2.47 seconds). [2025-09-17T20:56:22.162093] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T20:56:22.815798] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-07. [2025-09-17T20:56:22.893534] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T20:56:23.615789] [INFO ] [REMOTE ] OXY: Fetching primary data for 2024-12. [2025-09-17T20:56:24.415776] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-02. [2025-09-17T20:56:24.818138] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T20:56:25.215776] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-08. [2025-09-17T20:56:25.724774] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T20:56:25.913660] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-17T20:56:26.015796] [INFO ] [REMOTE ] OWLT: Fetching primary data for 2025-09. [2025-09-17T20:56:26.704584] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T20:56:26.791530] [INFO ] [REMOTE ] OWLT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T20:56:26.793417] [INFO ] [REMOTE ] OWLT: Full fetch complete (11484 records). [2025-09-17T20:56:26.793502] [DEBUG] [VALIDATOR ] OWLT: Validating primary data. [2025-09-17T20:56:26.823765] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-03. [2025-09-17T20:56:27.176069] [DEBUG] [VALIDATOR ] OWLT: All expected trading days are present. [2025-09-17T20:56:27.176230] [DEBUG] [VALIDATOR ] OWLT: Primary data validation passed. [2025-09-17T20:56:27.176545] [INFO ] [MAIN ] OWLT: Fetched primary data is valid. [2025-09-17T20:56:27.176597] [DEBUG] [LOCAL ] OWLT: Saving primary data. [2025-09-17T20:56:27.177356] [DEBUG] [LOCAL ] OWLT: Trimmed 11484 records to 8756 (keeping 200 days of data) [2025-09-17T20:56:27.232058] [DEBUG] [LOCAL ] OWLT: Primary data saved (8756 records). [2025-09-17T20:56:27.232219] [INFO ] [MAIN ] OWLT: Full history saved. [2025-09-17T20:56:27.232319] [INFO ] [MAIN ] Update Progress: 1617/2371 symbols completed. OWLT took 30.3s. Estimated remaining: 1h 50m 15s. Rate: 6.8 symbols/min [2025-09-17T20:56:27.426261] [INFO ] [MAIN ] PAAS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:56:27.480426] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-17T20:56:27.480579] [INFO ] [MAIN ] PAAS: Loaded 53603 existing records. [2025-09-17T20:56:27.620976] [INFO ] [REMOTE ] OVV: Fetching primary data for 2025-09. [2025-09-17T20:56:27.665146] [WARN ] [MAIN ] PAAS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:56:27.665477] [INFO ] [MAIN ] PAAS: Wiping existing primary data before full refresh. [2025-09-17T20:56:27.665541] [INFO ] [LOCAL ] PAAS: Starting deletion of primary data. [2025-09-17T20:56:27.666724] [DEBUG] [LOCAL ] PAAS: Deleted primary data file. [2025-09-17T20:56:27.666775] [INFO ] [MAIN ] PAAS: Starting full primary refresh. [2025-09-17T20:56:28.017370] [INFO ] [REMOTE ] PAAS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:56:28.415856] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-01. [2025-09-17T20:56:28.643226] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T20:56:29.215798] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-04. [2025-09-17T20:56:29.501846] [INFO ] [REMOTE ] OVV: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T20:56:29.508975] [INFO ] [REMOTE ] OVV: Full fetch complete (77120 records). [2025-09-17T20:56:29.509168] [DEBUG] [VALIDATOR ] OVV: Validating primary data. [2025-09-17T20:56:29.937959] [DEBUG] [VALIDATOR ] OVV: All expected trading days are present. [2025-09-17T20:56:29.938051] [DEBUG] [VALIDATOR ] OVV: Primary data validation passed. [2025-09-17T20:56:29.939245] [INFO ] [MAIN ] OVV: Fetched primary data is valid. [2025-09-17T20:56:29.939293] [DEBUG] [LOCAL ] OVV: Saving primary data. [2025-09-17T20:56:29.940742] [DEBUG] [LOCAL ] OVV: Trimmed 77120 records to 53517 (keeping 200 days of data) [2025-09-17T20:56:30.033532] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-11. [2025-09-17T20:56:30.275449] [DEBUG] [LOCAL ] OVV: Primary data saved (53517 records). [2025-09-17T20:56:30.275608] [INFO ] [MAIN ] OVV: Full history saved. [2025-09-17T20:56:30.275714] [INFO ] [MAIN ] Update Progress: 1618/2371 symbols completed. OVV took 40.5s. Estimated remaining: 1h 50m 3s. Rate: 6.8 symbols/min [2025-09-17T20:56:30.444916] [INFO ] [MAIN ] PAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:56:30.457888] [DEBUG] [LOCAL ] PAC: Loaded 11690 existing records from primary storage. [2025-09-17T20:56:30.458016] [INFO ] [MAIN ] PAC: Loaded 11690 existing records. [2025-09-17T20:56:30.641267] [WARN ] [MAIN ] PAC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:56:30.641612] [INFO ] [MAIN ] PAC: Wiping existing primary data before full refresh. [2025-09-17T20:56:30.641745] [INFO ] [LOCAL ] PAC: Starting deletion of primary data. [2025-09-17T20:56:30.642180] [DEBUG] [LOCAL ] PAC: Deleted primary data file. [2025-09-17T20:56:30.642241] [INFO ] [MAIN ] PAC: Starting full primary refresh. [2025-09-17T20:56:30.847187] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T20:56:30.914317] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-05. [2025-09-17T20:56:31.032749] [INFO ] [REMOTE ] PAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:56:31.064743] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-17T20:56:31.615824] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-11. [2025-09-17T20:56:32.063773] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-17T20:56:32.118545] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T20:56:32.346397] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T20:56:32.415762] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-06. [2025-09-17T20:56:33.215781] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-02. [2025-09-17T20:56:34.009629] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T20:56:34.019441] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2024-12. [2025-09-17T20:56:34.815777] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-07. [2025-09-17T20:56:35.587214] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-02 (2.37 seconds). [2025-09-17T20:56:35.615778] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-03. [2025-09-17T20:56:35.930819] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T20:56:36.117974] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T20:56:36.415778] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-01. [2025-09-17T20:56:37.215793] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-08. [2025-09-17T20:56:37.775287] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-17T20:56:38.015761] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-04. [2025-09-17T20:56:38.159555] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T20:56:38.200154] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T20:56:38.815800] [INFO ] [REMOTE ] OXM: Fetching primary data for 2025-09. [2025-09-17T20:56:39.615792] [INFO ] [REMOTE ] PAC: Fetching primary data for 2024-12. [2025-09-17T20:56:40.151106] [INFO ] [REMOTE ] OXM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T20:56:40.158346] [INFO ] [REMOTE ] OXM: Full fetch complete (46116 records). [2025-09-17T20:56:40.158542] [DEBUG] [VALIDATOR ] OXM: Validating primary data. [2025-09-17T20:56:40.420945] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-02. [2025-09-17T20:56:40.565170] [DEBUG] [VALIDATOR ] OXM: All expected trading days are present. [2025-09-17T20:56:40.565450] [DEBUG] [VALIDATOR ] OXM: Primary data validation passed. [2025-09-17T20:56:40.566320] [INFO ] [MAIN ] OXM: Fetched primary data is valid. [2025-09-17T20:56:40.566530] [DEBUG] [LOCAL ] OXM: Saving primary data. [2025-09-17T20:56:40.575906] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T20:56:40.579912] [DEBUG] [LOCAL ] OXM: Trimmed 46116 records to 33657 (keeping 200 days of data) [2025-09-17T20:56:40.726877] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-17T20:56:40.838412] [DEBUG] [LOCAL ] OXM: Primary data saved (33657 records). [2025-09-17T20:56:40.838586] [INFO ] [MAIN ] OXM: Full history saved. [2025-09-17T20:56:40.839484] [INFO ] [MAIN ] Update Progress: 1619/2371 symbols completed. OXM took 36.1s. Estimated remaining: 1h 49m 55s. Rate: 6.8 symbols/min [2025-09-17T20:56:41.010808] [INFO ] [MAIN ] PACK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:56:41.048605] [DEBUG] [LOCAL ] PACK: Loaded 32001 existing records from primary storage. [2025-09-17T20:56:41.048819] [INFO ] [MAIN ] PACK: Loaded 32001 existing records. [2025-09-17T20:56:41.221167] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-01. [2025-09-17T20:56:41.226728] [WARN ] [MAIN ] PACK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:56:41.226983] [INFO ] [MAIN ] PACK: Wiping existing primary data before full refresh. [2025-09-17T20:56:41.227029] [INFO ] [LOCAL ] PACK: Starting deletion of primary data. [2025-09-17T20:56:41.227724] [DEBUG] [LOCAL ] PACK: Deleted primary data file. [2025-09-17T20:56:41.227774] [INFO ] [MAIN ] PACK: Starting full primary refresh. [2025-09-17T20:56:41.587993] [INFO ] [REMOTE ] PACK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:56:42.015819] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-11. [2025-09-17T20:56:42.416788] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T20:56:42.460054] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T20:56:42.815846] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-05. [2025-09-17T20:56:42.905103] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T20:56:43.615856] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-02. [2025-09-17T20:56:44.235387] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T20:56:44.415885] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-03. [2025-09-17T20:56:45.064580] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-17T20:56:45.215777] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-06. [2025-09-17T20:56:46.015806] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-03. [2025-09-17T20:56:46.446982] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T20:56:46.815802] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-04. [2025-09-17T20:56:46.936875] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T20:56:47.615769] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-04. [2025-09-17T20:56:47.713291] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-06 (2.50 seconds). [2025-09-17T20:56:48.415807] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-07. [2025-09-17T20:56:48.431980] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T20:56:48.618902] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T20:56:49.215893] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-05. [2025-09-17T20:56:50.015802] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-05. [2025-09-17T20:56:50.234357] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T20:56:50.815895] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-06. [2025-09-17T20:56:51.124383] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-07 (2.71 seconds). [2025-09-17T20:56:51.512345] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T20:56:51.620963] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-07. [2025-09-17T20:56:51.636804] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T20:56:52.415775] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-08. [2025-09-17T20:56:52.550488] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T20:56:53.215786] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-06. [2025-09-17T20:56:54.015803] [INFO ] [REMOTE ] PACK: Fetching primary data for 2024-12. [2025-09-17T20:56:54.809592] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-17T20:56:54.820240] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-08. [2025-09-17T20:56:54.975101] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T20:56:55.148358] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T20:56:55.615799] [INFO ] [REMOTE ] OXY: Fetching primary data for 2025-09. [2025-09-17T20:56:55.700993] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-08 (0.88 seconds). [2025-09-17T20:56:56.415817] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-07. [2025-09-17T20:56:57.215798] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-01. [2025-09-17T20:56:57.795247] [INFO ] [REMOTE ] OXY: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-17T20:56:57.801775] [INFO ] [REMOTE ] OXY: Full fetch complete (77518 records). [2025-09-17T20:56:57.801923] [DEBUG] [VALIDATOR ] OXY: Validating primary data. [2025-09-17T20:56:58.009826] [WARN ] [VALIDATOR ] OXY: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T20:56:58.010801] [FATAL] [MAIN ] OXY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:56:58.010860] [WARN ] [MAIN ] OXY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:56:58.010913] [INFO ] [LOCAL ] OXY: Starting deletion of primary data. [2025-09-17T20:56:58.011008] [DEBUG] [LOCAL ] OXY: No primary data file found to delete. [2025-09-17T20:56:58.011052] [INFO ] [LOCAL ] OXY: Starting deletion of derivative data. [2025-09-17T20:56:58.011093] [DEBUG] [LOCAL ] OXY: No derivative data file found to delete. [2025-09-17T20:56:58.011183] [INFO ] [MAIN ] Update Progress: 1620/2371 symbols completed. OXY took 39.4s. Estimated remaining: 1h 49m 50s. Rate: 6.8 symbols/min [2025-09-17T20:56:58.025190] [INFO ] [REMOTE ] PAC: Fetching primary data for 2025-09. [2025-09-17T20:56:58.194965] [INFO ] [MAIN ] PACS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:56:58.211252] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T20:56:58.255095] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T20:56:58.293839] [DEBUG] [LOCAL ] PACS: Loaded 33702 existing records from primary storage. [2025-09-17T20:56:58.294054] [INFO ] [MAIN ] PACS: Loaded 33702 existing records. [2025-09-17T20:56:58.485509] [WARN ] [MAIN ] PACS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:56:58.485868] [INFO ] [MAIN ] PACS: Wiping existing primary data before full refresh. [2025-09-17T20:56:58.485922] [INFO ] [LOCAL ] PACS: Starting deletion of primary data. [2025-09-17T20:56:58.487028] [DEBUG] [LOCAL ] PACS: Deleted primary data file. [2025-09-17T20:56:58.487092] [INFO ] [MAIN ] PACS: Starting full primary refresh. [2025-09-17T20:56:58.827694] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-02. [2025-09-17T20:56:58.874935] [INFO ] [REMOTE ] PACS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:56:58.880602] [INFO ] [REMOTE ] PAC: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T20:56:58.882457] [INFO ] [REMOTE ] PAC: Full fetch complete (16565 records). [2025-09-17T20:56:58.882542] [DEBUG] [VALIDATOR ] PAC: Validating primary data. [2025-09-17T20:56:59.287581] [DEBUG] [VALIDATOR ] PAC: All expected trading days are present. [2025-09-17T20:56:59.287723] [DEBUG] [VALIDATOR ] PAC: Primary data validation passed. [2025-09-17T20:56:59.288498] [INFO ] [MAIN ] PAC: Fetched primary data is valid. [2025-09-17T20:56:59.288586] [DEBUG] [LOCAL ] PAC: Saving primary data. [2025-09-17T20:56:59.289511] [DEBUG] [LOCAL ] PAC: Trimmed 16565 records to 11719 (keeping 200 days of data) [2025-09-17T20:56:59.368774] [DEBUG] [LOCAL ] PAC: Primary data saved (11719 records). [2025-09-17T20:56:59.368935] [INFO ] [MAIN ] PAC: Full history saved. [2025-09-17T20:56:59.369025] [INFO ] [MAIN ] Update Progress: 1621/2371 symbols completed. PAC took 29.1s. Estimated remaining: 1h 49m 38s. Rate: 6.8 symbols/min [2025-09-17T20:56:59.560800] [INFO ] [MAIN ] PAG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:56:59.584542] [DEBUG] [LOCAL ] PAG: Loaded 22217 existing records from primary storage. [2025-09-17T20:56:59.584758] [INFO ] [MAIN ] PAG: Loaded 22217 existing records. [2025-09-17T20:56:59.621048] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-11. [2025-09-17T20:56:59.772385] [WARN ] [MAIN ] PAG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:56:59.772708] [INFO ] [MAIN ] PAG: Wiping existing primary data before full refresh. [2025-09-17T20:56:59.772758] [INFO ] [LOCAL ] PAG: Starting deletion of primary data. [2025-09-17T20:56:59.773375] [DEBUG] [LOCAL ] PAG: Deleted primary data file. [2025-09-17T20:56:59.773424] [INFO ] [MAIN ] PAG: Starting full primary refresh. [2025-09-17T20:57:00.126957] [INFO ] [REMOTE ] PAG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:57:00.172749] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T20:57:00.415803] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-08. [2025-09-17T20:57:01.215837] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-03. [2025-09-17T20:57:01.562356] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T20:57:02.018409] [INFO ] [REMOTE ] PACS: Fetching primary data for 2024-12. [2025-09-17T20:57:02.277348] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T20:57:02.727111] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T20:57:02.815847] [INFO ] [REMOTE ] PAAS: Fetching primary data for 2025-09. [2025-09-17T20:57:03.591965] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T20:57:03.615730] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-01. [2025-09-17T20:57:04.415763] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-11. [2025-09-17T20:57:04.681333] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T20:57:04.801141] [INFO ] [REMOTE ] PAAS: Incremental fetch complete for 2025-09 (1.99 seconds). [2025-09-17T20:57:04.808320] [INFO ] [REMOTE ] PAAS: Full fetch complete (77242 records). [2025-09-17T20:57:04.808482] [DEBUG] [VALIDATOR ] PAAS: Validating primary data. [2025-09-17T20:57:05.210478] [DEBUG] [VALIDATOR ] PAAS: All expected trading days are present. [2025-09-17T20:57:05.210563] [DEBUG] [VALIDATOR ] PAAS: Primary data validation passed. [2025-09-17T20:57:05.211625] [INFO ] [MAIN ] PAAS: Fetched primary data is valid. [2025-09-17T20:57:05.211689] [DEBUG] [LOCAL ] PAAS: Saving primary data. [2025-09-17T20:57:05.213261] [DEBUG] [LOCAL ] PAAS: Trimmed 77242 records to 53603 (keeping 200 days of data) [2025-09-17T20:57:05.268557] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-02. [2025-09-17T20:57:05.518223] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T20:57:05.564268] [DEBUG] [LOCAL ] PAAS: Primary data saved (53603 records). [2025-09-17T20:57:05.564677] [INFO ] [MAIN ] PAAS: Full history saved. [2025-09-17T20:57:05.564789] [INFO ] [MAIN ] Update Progress: 1622/2371 symbols completed. PAAS took 38.3s. Estimated remaining: 1h 49m 28s. Rate: 6.8 symbols/min [2025-09-17T20:57:05.732976] [INFO ] [MAIN ] PAGS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:57:05.785775] [DEBUG] [LOCAL ] PAGS: Loaded 52680 existing records from primary storage. [2025-09-17T20:57:05.785948] [INFO ] [MAIN ] PAGS: Loaded 52680 existing records. [2025-09-17T20:57:05.961507] [WARN ] [MAIN ] PAGS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:57:05.961774] [INFO ] [MAIN ] PAGS: Wiping existing primary data before full refresh. [2025-09-17T20:57:05.961821] [INFO ] [LOCAL ] PAGS: Starting deletion of primary data. [2025-09-17T20:57:05.962992] [DEBUG] [LOCAL ] PAGS: Deleted primary data file. [2025-09-17T20:57:05.963045] [INFO ] [MAIN ] PAGS: Starting full primary refresh. [2025-09-17T20:57:06.026344] [INFO ] [REMOTE ] PAG: Fetching primary data for 2024-12. [2025-09-17T20:57:06.318443] [INFO ] [REMOTE ] PAGS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:57:06.599309] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T20:57:06.815846] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-03. [2025-09-17T20:57:06.846238] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T20:57:07.615786] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-01. [2025-09-17T20:57:08.315792] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T20:57:08.341690] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T20:57:08.415806] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-04. [2025-09-17T20:57:09.215842] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-02. [2025-09-17T20:57:09.809550] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T20:57:10.015782] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-04. [2025-09-17T20:57:10.498370] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T20:57:10.815785] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-03. [2025-09-17T20:57:11.189455] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T20:57:11.615841] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-05. [2025-09-17T20:57:12.118678] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T20:57:12.415780] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-11. [2025-09-17T20:57:12.797914] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T20:57:13.215788] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-06. [2025-09-17T20:57:14.015793] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-05. [2025-09-17T20:57:14.136534] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T20:57:14.685448] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T20:57:14.815785] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2024-12. [2025-09-17T20:57:15.453180] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T20:57:15.615771] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-06. [2025-09-17T20:57:16.426714] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-04. [2025-09-17T20:57:16.452537] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T20:57:16.499515] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T20:57:17.215792] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-07. [2025-09-17T20:57:17.727797] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T20:57:18.015785] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-05. [2025-09-17T20:57:18.119628] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T20:57:18.815743] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-01. [2025-09-17T20:57:19.169888] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T20:57:19.615831] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-06. [2025-09-17T20:57:20.415801] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-07. [2025-09-17T20:57:20.544410] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T20:57:20.855277] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T20:57:21.215783] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-07. [2025-09-17T20:57:21.573935] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T20:57:22.015789] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-08. [2025-09-17T20:57:22.203558] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T20:57:22.815769] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-08. [2025-09-17T20:57:23.530850] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T20:57:23.615749] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-08. [2025-09-17T20:57:23.973847] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T20:57:24.415780] [INFO ] [REMOTE ] PAG: Fetching primary data for 2025-09. [2025-09-17T20:57:24.805063] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T20:57:25.168080] [INFO ] [REMOTE ] PAG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T20:57:25.171655] [INFO ] [REMOTE ] PAG: Full fetch complete (29752 records). [2025-09-17T20:57:25.171755] [DEBUG] [VALIDATOR ] PAG: Validating primary data. [2025-09-17T20:57:25.227781] [INFO ] [REMOTE ] PACS: Fetching primary data for 2025-09. [2025-09-17T20:57:25.562583] [DEBUG] [VALIDATOR ] PAG: All expected trading days are present. [2025-09-17T20:57:25.562683] [DEBUG] [VALIDATOR ] PAG: Primary data validation passed. [2025-09-17T20:57:25.563304] [INFO ] [MAIN ] PAG: Fetched primary data is valid. [2025-09-17T20:57:25.563371] [DEBUG] [LOCAL ] PAG: Saving primary data. [2025-09-17T20:57:25.564727] [DEBUG] [LOCAL ] PAG: Trimmed 29752 records to 22112 (keeping 200 days of data) [2025-09-17T20:57:25.707849] [DEBUG] [LOCAL ] PAG: Primary data saved (22112 records). [2025-09-17T20:57:25.707990] [INFO ] [MAIN ] PAG: Full history saved. [2025-09-17T20:57:25.708114] [INFO ] [MAIN ] Update Progress: 1623/2371 symbols completed. PAG took 26.3s. Estimated remaining: 1h 49m 25s. Rate: 6.8 symbols/min [2025-09-17T20:57:25.878731] [INFO ] [MAIN ] PAI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:57:25.883686] [DEBUG] [LOCAL ] PAI: Loaded 2716 existing records from primary storage. [2025-09-17T20:57:25.883784] [INFO ] [MAIN ] PAI: Loaded 2716 existing records. [2025-09-17T20:57:26.029602] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-02. [2025-09-17T20:57:26.070478] [WARN ] [MAIN ] PAI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:57:26.070765] [INFO ] [MAIN ] PAI: Wiping existing primary data before full refresh. [2025-09-17T20:57:26.070815] [INFO ] [LOCAL ] PAI: Starting deletion of primary data. [2025-09-17T20:57:26.071078] [DEBUG] [LOCAL ] PAI: Deleted primary data file. [2025-09-17T20:57:26.071137] [INFO ] [MAIN ] PAI: Starting full primary refresh. [2025-09-17T20:57:26.425842] [INFO ] [REMOTE ] PAI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:57:26.444065] [INFO ] [REMOTE ] PACS: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T20:57:26.450270] [INFO ] [REMOTE ] PACS: Full fetch complete (50776 records). [2025-09-17T20:57:26.450482] [DEBUG] [VALIDATOR ] PACS: Validating primary data. [2025-09-17T20:57:26.816214] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-11. [2025-09-17T20:57:26.851738] [DEBUG] [VALIDATOR ] PACS: All expected trading days are present. [2025-09-17T20:57:26.851826] [DEBUG] [VALIDATOR ] PACS: Primary data validation passed. [2025-09-17T20:57:26.852719] [INFO ] [MAIN ] PACS: Fetched primary data is valid. [2025-09-17T20:57:26.852768] [DEBUG] [LOCAL ] PACS: Saving primary data. [2025-09-17T20:57:26.853956] [DEBUG] [LOCAL ] PACS: Trimmed 50776 records to 33788 (keeping 200 days of data) [2025-09-17T20:57:27.088664] [DEBUG] [LOCAL ] PACS: Primary data saved (33788 records). [2025-09-17T20:57:27.088903] [INFO ] [MAIN ] PACS: Full history saved. [2025-09-17T20:57:27.089111] [INFO ] [MAIN ] Update Progress: 1624/2371 symbols completed. PACS took 29.1s. Estimated remaining: 1h 49m 12s. Rate: 6.8 symbols/min [2025-09-17T20:57:27.276975] [INFO ] [MAIN ] PAII: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:57:27.277270] [DEBUG] [LOCAL ] PAII: No existing data file found in primary storage. [2025-09-17T20:57:27.277309] [WARN ] [MAIN ] PAII: No existing data found, performing full refresh instead. [2025-09-17T20:57:27.277453] [INFO ] [MAIN ] PAII: Wiping existing primary data before full refresh. [2025-09-17T20:57:27.277493] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-17T20:57:27.277533] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-17T20:57:27.277566] [INFO ] [MAIN ] PAII: Starting full primary refresh. [2025-09-17T20:57:27.624036] [INFO ] [REMOTE ] PACK: Fetching primary data for 2025-09. [2025-09-17T20:57:27.608182] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T20:57:27.666199] [INFO ] [REMOTE ] PAII: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:57:27.927449] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T20:57:28.415772] [INFO ] [REMOTE ] PAI: Fetching primary data for 2024-12. [2025-09-17T20:57:28.927218] [INFO ] [REMOTE ] PACK: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T20:57:28.932866] [INFO ] [REMOTE ] PACK: Full fetch complete (42787 records). [2025-09-17T20:57:28.932997] [DEBUG] [VALIDATOR ] PACK: Validating primary data. [2025-09-17T20:57:29.120319] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T20:57:29.220929] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-11. [2025-09-17T20:57:29.327087] [DEBUG] [VALIDATOR ] PACK: All expected trading days are present. [2025-09-17T20:57:29.327168] [DEBUG] [VALIDATOR ] PACK: Primary data validation passed. [2025-09-17T20:57:29.327981] [INFO ] [MAIN ] PACK: Fetched primary data is valid. [2025-09-17T20:57:29.328027] [DEBUG] [LOCAL ] PACK: Saving primary data. [2025-09-17T20:57:29.329053] [DEBUG] [LOCAL ] PACK: Trimmed 42787 records to 31966 (keeping 200 days of data) [2025-09-17T20:57:29.525448] [DEBUG] [LOCAL ] PACK: Primary data saved (31966 records). [2025-09-17T20:57:29.525653] [INFO ] [MAIN ] PACK: Full history saved. [2025-09-17T20:57:29.526726] [INFO ] [MAIN ] Update Progress: 1625/2371 symbols completed. PACK took 48.7s. Estimated remaining: 1h 49m 1s. Rate: 6.8 symbols/min [2025-09-17T20:57:29.702789] [INFO ] [MAIN ] PAM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:57:29.736821] [DEBUG] [LOCAL ] PAM: Loaded 27442 existing records from primary storage. [2025-09-17T20:57:29.736984] [INFO ] [MAIN ] PAM: Loaded 27442 existing records. [2025-09-17T20:57:29.843546] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:57:29.844461] [WARN ] [REMOTE ] PAII: No data returned for month 2024-11 [2025-09-17T20:57:29.921952] [WARN ] [MAIN ] PAM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:57:29.922165] [INFO ] [MAIN ] PAM: Wiping existing primary data before full refresh. [2025-09-17T20:57:29.922213] [INFO ] [LOCAL ] PAM: Starting deletion of primary data. [2025-09-17T20:57:29.922902] [DEBUG] [LOCAL ] PAM: Deleted primary data file. [2025-09-17T20:57:29.922960] [INFO ] [MAIN ] PAM: Starting full primary refresh. [2025-09-17T20:57:30.023703] [INFO ] [REMOTE ] PAII: Fetching primary data for 2024-12. [2025-09-17T20:57:30.288459] [INFO ] [REMOTE ] PAM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:57:30.343163] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:57:30.343569] [WARN ] [REMOTE ] PAII: No data returned for month 2024-12 [2025-09-17T20:57:30.815786] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-01. [2025-09-17T20:57:31.498136] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T20:57:31.615781] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-01. [2025-09-17T20:57:31.922413] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:57:31.922759] [WARN ] [REMOTE ] PAII: No data returned for month 2025-01 [2025-09-17T20:57:32.415793] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-02. [2025-09-17T20:57:32.689845] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:57:32.690172] [WARN ] [REMOTE ] PAII: No data returned for month 2025-02 [2025-09-17T20:57:33.215801] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-02. [2025-09-17T20:57:33.758487] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T20:57:34.015777] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-03. [2025-09-17T20:57:34.550585] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T20:57:34.815764] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-04. [2025-09-17T20:57:35.335517] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T20:57:35.615784] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-05. [2025-09-17T20:57:36.185690] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T20:57:36.415776] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-03. [2025-09-17T20:57:37.215781] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-03. [2025-09-17T20:57:37.470201] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:57:37.470590] [WARN ] [REMOTE ] PAII: No data returned for month 2025-03 [2025-09-17T20:57:38.015776] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-11. [2025-09-17T20:57:38.143056] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T20:57:38.815786] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-04. [2025-09-17T20:57:39.217260] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T20:57:39.615793] [INFO ] [REMOTE ] PAM: Fetching primary data for 2024-12. [2025-09-17T20:57:40.415778] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-06. [2025-09-17T20:57:40.789975] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T20:57:40.808753] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T20:57:40.863148] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T20:57:41.215802] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-01. [2025-09-17T20:57:42.015835] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-04. [2025-09-17T20:57:42.305306] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:57:42.306065] [WARN ] [REMOTE ] PAII: No data returned for month 2025-04 [2025-09-17T20:57:42.741002] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T20:57:42.815768] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-05. [2025-09-17T20:57:43.615818] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-02. [2025-09-17T20:57:44.415793] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-05. [2025-09-17T20:57:44.620501] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T20:57:44.712720] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:57:44.713100] [WARN ] [REMOTE ] PAII: No data returned for month 2025-05 [2025-09-17T20:57:45.056884] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T20:57:45.215791] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-06. [2025-09-17T20:57:45.490402] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:57:45.490759] [WARN ] [REMOTE ] PAII: No data returned for month 2025-06 [2025-09-17T20:57:46.015792] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-07. [2025-09-17T20:57:46.309533] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:57:46.309910] [WARN ] [REMOTE ] PAII: No data returned for month 2025-07 [2025-09-17T20:57:46.815783] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-06. [2025-09-17T20:57:47.615791] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-07. [2025-09-17T20:57:48.209428] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T20:57:48.415787] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-08. [2025-09-17T20:57:48.654300] [DEBUG] [REMOTE ] PAII: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T20:57:48.654621] [WARN ] [REMOTE ] PAII: No data returned for month 2025-08 [2025-09-17T20:57:48.686243] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T20:57:49.215775] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-03. [2025-09-17T20:57:50.015778] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-07. [2025-09-17T20:57:50.514720] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T20:57:50.815778] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-04. [2025-09-17T20:57:51.616263] [INFO ] [REMOTE ] PAII: Fetching primary data for 2025-09. [2025-09-17T20:57:51.944088] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T20:57:52.018508] [INFO ] [REMOTE ] PAII: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T20:57:52.019169] [INFO ] [REMOTE ] PAII: Full fetch complete (48 records). [2025-09-17T20:57:52.019234] [DEBUG] [VALIDATOR ] PAII: Validating primary data. [2025-09-17T20:57:52.198736] [WARN ] [VALIDATOR ] PAII: Validation failed - insufficient historical data. Have 6 unique days, need 200 days [2025-09-17T20:57:52.198944] [FATAL] [MAIN ] PAII: Fetched primary data is invalid. Refusing to save it. [2025-09-17T20:57:52.199082] [WARN ] [MAIN ] PAII: Deleting existing primary and derivative data due to validation failure. [2025-09-17T20:57:52.199196] [INFO ] [LOCAL ] PAII: Starting deletion of primary data. [2025-09-17T20:57:52.199261] [DEBUG] [LOCAL ] PAII: No primary data file found to delete. [2025-09-17T20:57:52.199364] [INFO ] [LOCAL ] PAII: Starting deletion of derivative data. [2025-09-17T20:57:52.199479] [DEBUG] [LOCAL ] PAII: No derivative data file found to delete. [2025-09-17T20:57:52.199546] [INFO ] [MAIN ] Update Progress: 1626/2371 symbols completed. PAII took 25.1s. Estimated remaining: 1h 48m 58s. Rate: 6.8 symbols/min [2025-09-17T20:57:52.374300] [INFO ] [MAIN ] PAR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:57:52.398191] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T20:57:52.421757] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-05. [2025-09-17T20:57:52.437263] [DEBUG] [LOCAL ] PAR: Loaded 32494 existing records from primary storage. [2025-09-17T20:57:52.437415] [INFO ] [MAIN ] PAR: Loaded 32494 existing records. [2025-09-17T20:57:52.614254] [WARN ] [MAIN ] PAR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:57:52.614526] [INFO ] [MAIN ] PAR: Wiping existing primary data before full refresh. [2025-09-17T20:57:52.614583] [INFO ] [LOCAL ] PAR: Starting deletion of primary data. [2025-09-17T20:57:52.615717] [DEBUG] [LOCAL ] PAR: Deleted primary data file. [2025-09-17T20:57:52.615771] [INFO ] [MAIN ] PAR: Starting full primary refresh. [2025-09-17T20:57:52.965711] [INFO ] [REMOTE ] PAR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:57:53.215794] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-11. [2025-09-17T20:57:53.767488] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T20:57:54.015838] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-08. [2025-09-17T20:57:54.494353] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T20:57:54.706511] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T20:57:54.815853] [INFO ] [REMOTE ] PAI: Fetching primary data for 2025-09. [2025-09-17T20:57:55.425798] [INFO ] [REMOTE ] PAI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T20:57:55.427217] [INFO ] [REMOTE ] PAI: Full fetch complete (4131 records). [2025-09-17T20:57:55.427284] [DEBUG] [VALIDATOR ] PAI: Validating primary data. [2025-09-17T20:57:55.623451] [INFO ] [REMOTE ] PAR: Fetching primary data for 2024-12. [2025-09-17T20:57:55.816781] [DEBUG] [VALIDATOR ] PAI: All expected trading days are present. [2025-09-17T20:57:55.816860] [DEBUG] [VALIDATOR ] PAI: Primary data validation passed. [2025-09-17T20:57:55.816988] [INFO ] [MAIN ] PAI: Fetched primary data is valid. [2025-09-17T20:57:55.817027] [DEBUG] [LOCAL ] PAI: Saving primary data. [2025-09-17T20:57:55.817388] [DEBUG] [LOCAL ] PAI: Trimmed 4131 records to 2731 (keeping 200 days of data) [2025-09-17T20:57:55.835120] [DEBUG] [LOCAL ] PAI: Primary data saved (2731 records). [2025-09-17T20:57:55.835187] [INFO ] [MAIN ] PAI: Full history saved. [2025-09-17T20:57:55.835274] [INFO ] [MAIN ] Update Progress: 1627/2371 symbols completed. PAI took 30.1s. Estimated remaining: 1h 48m 47s. Rate: 6.8 symbols/min [2025-09-17T20:57:56.008224] [INFO ] [MAIN ] PARR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:57:56.058757] [DEBUG] [LOCAL ] PARR: Loaded 48464 existing records from primary storage. [2025-09-17T20:57:56.058905] [INFO ] [MAIN ] PARR: Loaded 48464 existing records. [2025-09-17T20:57:56.238080] [WARN ] [MAIN ] PARR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:57:56.238335] [INFO ] [MAIN ] PARR: Wiping existing primary data before full refresh. [2025-09-17T20:57:56.238379] [INFO ] [LOCAL ] PARR: Starting deletion of primary data. [2025-09-17T20:57:56.239348] [DEBUG] [LOCAL ] PARR: Deleted primary data file. [2025-09-17T20:57:56.239398] [INFO ] [MAIN ] PARR: Starting full primary refresh. [2025-09-17T20:57:56.423027] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-06. [2025-09-17T20:57:56.599568] [INFO ] [REMOTE ] PARR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:57:57.084453] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T20:57:57.215751] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-01. [2025-09-17T20:57:57.604327] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T20:57:58.015782] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-11. [2025-09-17T20:57:58.815818] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-08. [2025-09-17T20:57:58.842039] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T20:57:59.615813] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-07. [2025-09-17T20:57:59.684103] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T20:58:00.415745] [INFO ] [REMOTE ] PARR: Fetching primary data for 2024-12. [2025-09-17T20:58:00.451849] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T20:58:00.998044] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T20:58:01.215753] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-08. [2025-09-17T20:58:02.015837] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-02. [2025-09-17T20:58:02.046442] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T20:58:02.327850] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T20:58:02.815795] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-01. [2025-09-17T20:58:03.234500] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T20:58:03.615789] [INFO ] [REMOTE ] PAM: Fetching primary data for 2025-09. [2025-09-17T20:58:04.389193] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T20:58:04.415724] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-02. [2025-09-17T20:58:04.649289] [INFO ] [REMOTE ] PAM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T20:58:04.654851] [INFO ] [REMOTE ] PAM: Full fetch complete (41577 records). [2025-09-17T20:58:04.655016] [DEBUG] [VALIDATOR ] PAM: Validating primary data. [2025-09-17T20:58:05.042990] [DEBUG] [VALIDATOR ] PAM: All expected trading days are present. [2025-09-17T20:58:05.043083] [DEBUG] [VALIDATOR ] PAM: Primary data validation passed. [2025-09-17T20:58:05.043939] [INFO ] [MAIN ] PAM: Fetched primary data is valid. [2025-09-17T20:58:05.043986] [DEBUG] [LOCAL ] PAM: Saving primary data. [2025-09-17T20:58:05.045041] [DEBUG] [LOCAL ] PAM: Trimmed 41577 records to 27386 (keeping 200 days of data) [2025-09-17T20:58:05.211619] [DEBUG] [LOCAL ] PAM: Primary data saved (27386 records). [2025-09-17T20:58:05.211817] [INFO ] [MAIN ] PAM: Full history saved. [2025-09-17T20:58:05.211904] [INFO ] [MAIN ] Update Progress: 1628/2371 symbols completed. PAM took 35.7s. Estimated remaining: 1h 48m 39s. Rate: 6.8 symbols/min [2025-09-17T20:58:05.224134] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-03. [2025-09-17T20:58:05.382018] [INFO ] [MAIN ] PATH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:58:05.436419] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-09-17T20:58:05.436566] [INFO ] [MAIN ] PATH: Loaded 53678 existing records. [2025-09-17T20:58:05.619293] [WARN ] [MAIN ] PATH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:58:05.619538] [INFO ] [MAIN ] PATH: Wiping existing primary data before full refresh. [2025-09-17T20:58:05.619591] [INFO ] [LOCAL ] PATH: Starting deletion of primary data. [2025-09-17T20:58:05.620847] [DEBUG] [LOCAL ] PATH: Deleted primary data file. [2025-09-17T20:58:05.620899] [INFO ] [MAIN ] PATH: Starting full primary refresh. [2025-09-17T20:58:05.982387] [INFO ] [REMOTE ] PATH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:58:06.008222] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T20:58:06.016857] [INFO ] [REMOTE ] PAGS: Fetching primary data for 2025-09. [2025-09-17T20:58:06.715540] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T20:58:06.815782] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-11. [2025-09-17T20:58:07.415324] [INFO ] [REMOTE ] PAGS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T20:58:07.422564] [INFO ] [REMOTE ] PAGS: Full fetch complete (76182 records). [2025-09-17T20:58:07.422712] [DEBUG] [VALIDATOR ] PAGS: Validating primary data. [2025-09-17T20:58:07.626307] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-04. [2025-09-17T20:58:07.843102] [DEBUG] [VALIDATOR ] PAGS: All expected trading days are present. [2025-09-17T20:58:07.843193] [DEBUG] [VALIDATOR ] PAGS: Primary data validation passed. [2025-09-17T20:58:07.844274] [INFO ] [MAIN ] PAGS: Fetched primary data is valid. [2025-09-17T20:58:07.844327] [DEBUG] [LOCAL ] PAGS: Saving primary data. [2025-09-17T20:58:07.847444] [DEBUG] [LOCAL ] PAGS: Trimmed 76182 records to 52677 (keeping 200 days of data) [2025-09-17T20:58:08.178527] [DEBUG] [LOCAL ] PAGS: Primary data saved (52677 records). [2025-09-17T20:58:08.178708] [INFO ] [MAIN ] PAGS: Full history saved. [2025-09-17T20:58:08.178829] [INFO ] [MAIN ] Update Progress: 1629/2371 symbols completed. PAGS took 1m 3s. Estimated remaining: 1h 48m 27s. Rate: 6.8 symbols/min [2025-09-17T20:58:08.350266] [INFO ] [MAIN ] PAXS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:58:08.372598] [DEBUG] [LOCAL ] PAXS: Loaded 21177 existing records from primary storage. [2025-09-17T20:58:08.372753] [INFO ] [MAIN ] PAXS: Loaded 21177 existing records. [2025-09-17T20:58:08.438212] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-03. [2025-09-17T20:58:08.561103] [WARN ] [MAIN ] PAXS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:58:08.561343] [INFO ] [MAIN ] PAXS: Wiping existing primary data before full refresh. [2025-09-17T20:58:08.561388] [INFO ] [LOCAL ] PAXS: Starting deletion of primary data. [2025-09-17T20:58:08.561917] [DEBUG] [LOCAL ] PAXS: Deleted primary data file. [2025-09-17T20:58:08.561964] [INFO ] [MAIN ] PAXS: Starting full primary refresh. [2025-09-17T20:58:08.946168] [INFO ] [REMOTE ] PAXS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:58:09.208917] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-11 (2.39 seconds). [2025-09-17T20:58:09.219089] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-11. [2025-09-17T20:58:09.241713] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T20:58:10.029192] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-05. [2025-09-17T20:58:10.051412] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T20:58:10.076663] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T20:58:10.815819] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2024-12. [2025-09-17T20:58:11.403356] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T20:58:11.615798] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-04. [2025-09-17T20:58:11.965540] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T20:58:12.415795] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-06. [2025-09-17T20:58:13.140429] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T20:58:13.215736] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-05. [2025-09-17T20:58:13.242308] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T20:58:14.015789] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-01. [2025-09-17T20:58:14.815741] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-07. [2025-09-17T20:58:14.922314] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T20:58:15.192359] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T20:58:15.615774] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-02. [2025-09-17T20:58:16.305023] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T20:58:16.415816] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-08. [2025-09-17T20:58:16.662253] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T20:58:17.215790] [INFO ] [REMOTE ] PATH: Fetching primary data for 2024-12. [2025-09-17T20:58:18.015752] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-06. [2025-09-17T20:58:18.064299] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T20:58:18.815788] [INFO ] [REMOTE ] PAR: Fetching primary data for 2025-09. [2025-09-17T20:58:19.633879] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-03. [2025-09-17T20:58:19.637968] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2024-12 (2.42 seconds). [2025-09-17T20:58:19.708555] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T20:58:19.890886] [INFO ] [REMOTE ] PAR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T20:58:19.896399] [INFO ] [REMOTE ] PAR: Full fetch complete (46815 records). [2025-09-17T20:58:19.896501] [DEBUG] [VALIDATOR ] PAR: Validating primary data. [2025-09-17T20:58:20.293220] [DEBUG] [VALIDATOR ] PAR: All expected trading days are present. [2025-09-17T20:58:20.293328] [DEBUG] [VALIDATOR ] PAR: Primary data validation passed. [2025-09-17T20:58:20.294505] [INFO ] [MAIN ] PAR: Fetched primary data is valid. [2025-09-17T20:58:20.294558] [DEBUG] [LOCAL ] PAR: Saving primary data. [2025-09-17T20:58:20.295931] [DEBUG] [LOCAL ] PAR: Trimmed 46815 records to 32503 (keeping 200 days of data) [2025-09-17T20:58:20.444497] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-01. [2025-09-17T20:58:20.490782] [DEBUG] [LOCAL ] PAR: Primary data saved (32503 records). [2025-09-17T20:58:20.491082] [INFO ] [MAIN ] PAR: Full history saved. [2025-09-17T20:58:20.491252] [INFO ] [MAIN ] Update Progress: 1630/2371 symbols completed. PAR took 28.3s. Estimated remaining: 1h 48m 20s. Rate: 6.8 symbols/min [2025-09-17T20:58:20.640801] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T20:58:20.691967] [INFO ] [MAIN ] PAY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:58:20.727205] [DEBUG] [LOCAL ] PAY: Loaded 38059 existing records from primary storage. [2025-09-17T20:58:20.727354] [INFO ] [MAIN ] PAY: Loaded 38059 existing records. [2025-09-17T20:58:20.924368] [WARN ] [MAIN ] PAY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:58:20.924855] [INFO ] [MAIN ] PAY: Wiping existing primary data before full refresh. [2025-09-17T20:58:20.924930] [INFO ] [LOCAL ] PAY: Starting deletion of primary data. [2025-09-17T20:58:20.925994] [DEBUG] [LOCAL ] PAY: Deleted primary data file. [2025-09-17T20:58:20.926071] [INFO ] [MAIN ] PAY: Starting full primary refresh. [2025-09-17T20:58:21.222362] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-04. [2025-09-17T20:58:21.313505] [INFO ] [REMOTE ] PAY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:58:22.015836] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-07. [2025-09-17T20:58:22.394829] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T20:58:22.815773] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-05. [2025-09-17T20:58:22.928738] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-17T20:58:23.469077] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T20:58:23.615744] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-08. [2025-09-17T20:58:24.018473] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T20:58:24.415783] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-06. [2025-09-17T20:58:25.215798] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-02. [2025-09-17T20:58:25.372538] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T20:58:25.412060] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T20:58:26.015833] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-11. [2025-09-17T20:58:26.815795] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-07. [2025-09-17T20:58:27.371683] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-17T20:58:27.403335] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T20:58:27.615786] [INFO ] [REMOTE ] PARR: Fetching primary data for 2025-09. [2025-09-17T20:58:27.660228] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T20:58:28.415808] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-08. [2025-09-17T20:58:29.121597] [INFO ] [REMOTE ] PARR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T20:58:29.128048] [INFO ] [REMOTE ] PARR: Full fetch complete (68221 records). [2025-09-17T20:58:29.128162] [DEBUG] [VALIDATOR ] PARR: Validating primary data. [2025-09-17T20:58:29.220857] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-03. [2025-09-17T20:58:29.530834] [DEBUG] [VALIDATOR ] PARR: All expected trading days are present. [2025-09-17T20:58:29.530932] [DEBUG] [VALIDATOR ] PARR: Primary data validation passed. [2025-09-17T20:58:29.531919] [INFO ] [MAIN ] PARR: Fetched primary data is valid. [2025-09-17T20:58:29.531968] [DEBUG] [LOCAL ] PARR: Saving primary data. [2025-09-17T20:58:29.533480] [DEBUG] [LOCAL ] PARR: Trimmed 68221 records to 48445 (keeping 200 days of data) [2025-09-17T20:58:29.757815] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T20:58:29.849538] [DEBUG] [LOCAL ] PARR: Primary data saved (48445 records). [2025-09-17T20:58:29.849751] [INFO ] [MAIN ] PARR: Full history saved. [2025-09-17T20:58:29.849852] [INFO ] [MAIN ] Update Progress: 1631/2371 symbols completed. PARR took 34.0s. Estimated remaining: 1h 48m 12s. Rate: 6.8 symbols/min [2025-09-17T20:58:30.021624] [INFO ] [REMOTE ] PAY: Fetching primary data for 2024-12. [2025-09-17T20:58:30.024886] [INFO ] [MAIN ] PAYC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:58:30.072877] [DEBUG] [LOCAL ] PAYC: Loaded 36455 existing records from primary storage. [2025-09-17T20:58:30.073093] [INFO ] [MAIN ] PAYC: Loaded 36455 existing records. [2025-09-17T20:58:30.259890] [WARN ] [MAIN ] PAYC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:58:30.260239] [INFO ] [MAIN ] PAYC: Wiping existing primary data before full refresh. [2025-09-17T20:58:30.260289] [INFO ] [LOCAL ] PAYC: Starting deletion of primary data. [2025-09-17T20:58:30.261401] [DEBUG] [LOCAL ] PAYC: Deleted primary data file. [2025-09-17T20:58:30.261453] [INFO ] [MAIN ] PAYC: Starting full primary refresh. [2025-09-17T20:58:30.634536] [INFO ] [REMOTE ] PAYC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:58:30.815770] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-11. [2025-09-17T20:58:31.438663] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-17T20:58:31.521424] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T20:58:31.615775] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-04. [2025-09-17T20:58:32.184262] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T20:58:32.415817] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2024-12. [2025-09-17T20:58:33.215868] [INFO ] [REMOTE ] PAXS: Fetching primary data for 2025-09. [2025-09-17T20:58:33.711123] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T20:58:34.015939] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-05. [2025-09-17T20:58:34.040461] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T20:58:34.169862] [INFO ] [REMOTE ] PAXS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T20:58:34.172949] [INFO ] [REMOTE ] PAXS: Full fetch complete (31530 records). [2025-09-17T20:58:34.173060] [DEBUG] [VALIDATOR ] PAXS: Validating primary data. [2025-09-17T20:58:34.549204] [DEBUG] [VALIDATOR ] PAXS: All expected trading days are present. [2025-09-17T20:58:34.549283] [DEBUG] [VALIDATOR ] PAXS: Primary data validation passed. [2025-09-17T20:58:34.549954] [INFO ] [MAIN ] PAXS: Fetched primary data is valid. [2025-09-17T20:58:34.549997] [DEBUG] [LOCAL ] PAXS: Saving primary data. [2025-09-17T20:58:34.550848] [DEBUG] [LOCAL ] PAXS: Trimmed 31530 records to 21137 (keeping 200 days of data) [2025-09-17T20:58:34.679093] [DEBUG] [LOCAL ] PAXS: Primary data saved (21137 records). [2025-09-17T20:58:34.679231] [INFO ] [MAIN ] PAXS: Full history saved. [2025-09-17T20:58:34.679313] [INFO ] [MAIN ] Update Progress: 1632/2371 symbols completed. PAXS took 26.5s. Estimated remaining: 1h 48m 1s. Rate: 6.8 symbols/min [2025-09-17T20:58:34.823092] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-01. [2025-09-17T20:58:34.854341] [INFO ] [MAIN ] PB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:58:34.895289] [DEBUG] [LOCAL ] PB: Loaded 41317 existing records from primary storage. [2025-09-17T20:58:34.895460] [INFO ] [MAIN ] PB: Loaded 41317 existing records. [2025-09-17T20:58:35.072968] [WARN ] [MAIN ] PB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:58:35.073257] [INFO ] [MAIN ] PB: Wiping existing primary data before full refresh. [2025-09-17T20:58:35.073305] [INFO ] [LOCAL ] PB: Starting deletion of primary data. [2025-09-17T20:58:35.074222] [DEBUG] [LOCAL ] PB: Deleted primary data file. [2025-09-17T20:58:35.074273] [INFO ] [MAIN ] PB: Starting full primary refresh. [2025-09-17T20:58:35.425799] [INFO ] [REMOTE ] PB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:58:35.615769] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-11. [2025-09-17T20:58:36.155823] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T20:58:36.329581] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T20:58:36.415802] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-02. [2025-09-17T20:58:37.215792] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-01. [2025-09-17T20:58:37.264948] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T20:58:37.807244] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T20:58:38.015769] [INFO ] [REMOTE ] PB: Fetching primary data for 2024-12. [2025-09-17T20:58:38.584536] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T20:58:38.815778] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-02. [2025-09-17T20:58:39.512832] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T20:58:39.615775] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-01. [2025-09-17T20:58:39.749689] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T20:58:40.415806] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-03. [2025-09-17T20:58:41.134212] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T20:58:41.215795] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-02. [2025-09-17T20:58:42.015815] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-06. [2025-09-17T20:58:42.080177] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T20:58:42.490865] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T20:58:42.815768] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-03. [2025-09-17T20:58:43.615779] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-04. [2025-09-17T20:58:44.298583] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-06 (2.28 seconds). [2025-09-17T20:58:44.415780] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-07. [2025-09-17T20:58:44.505014] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T20:58:45.084063] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T20:58:45.215798] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-03. [2025-09-17T20:58:46.015795] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-04. [2025-09-17T20:58:46.523881] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T20:58:46.771585] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T20:58:46.815739] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-04. [2025-09-17T20:58:47.615754] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-05. [2025-09-17T20:58:47.660899] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T20:58:48.338189] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T20:58:48.415730] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-05. [2025-09-17T20:58:49.026859] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T20:58:49.215788] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-08. [2025-09-17T20:58:49.578272] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T20:58:50.015785] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-06. [2025-09-17T20:58:50.815822] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-06. [2025-09-17T20:58:51.610740] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-08 (2.39 seconds). [2025-09-17T20:58:51.621280] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-05. [2025-09-17T20:58:51.656695] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T20:58:51.978424] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T20:58:52.415790] [INFO ] [REMOTE ] PATH: Fetching primary data for 2025-09. [2025-09-17T20:58:52.782305] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T20:58:53.215837] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-07. [2025-09-17T20:58:54.015787] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-06. [2025-09-17T20:58:54.479899] [INFO ] [REMOTE ] PATH: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-17T20:58:54.488868] [INFO ] [REMOTE ] PATH: Full fetch complete (77703 records). [2025-09-17T20:58:54.489088] [DEBUG] [VALIDATOR ] PATH: Validating primary data. [2025-09-17T20:58:54.816457] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-07. [2025-09-17T20:58:54.900800] [DEBUG] [VALIDATOR ] PATH: All expected trading days are present. [2025-09-17T20:58:54.908033] [DEBUG] [VALIDATOR ] PATH: Primary data validation passed. [2025-09-17T20:58:54.921524] [INFO ] [MAIN ] PATH: Fetched primary data is valid. [2025-09-17T20:58:54.921659] [DEBUG] [LOCAL ] PATH: Saving primary data. [2025-09-17T20:58:54.923602] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T20:58:54.931960] [DEBUG] [LOCAL ] PATH: Trimmed 77703 records to 53678 (keeping 200 days of data) [2025-09-17T20:58:55.261435] [DEBUG] [LOCAL ] PATH: Primary data saved (53678 records). [2025-09-17T20:58:55.261596] [INFO ] [MAIN ] PATH: Full history saved. [2025-09-17T20:58:55.262353] [INFO ] [MAIN ] Update Progress: 1633/2371 symbols completed. PATH took 50.1s. Estimated remaining: 1h 47m 58s. Rate: 6.8 symbols/min [2025-09-17T20:58:55.441742] [INFO ] [MAIN ] PBA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:58:55.498705] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T20:58:55.526603] [DEBUG] [LOCAL ] PBA: Loaded 49111 existing records from primary storage. [2025-09-17T20:58:55.526851] [INFO ] [MAIN ] PBA: Loaded 49111 existing records. [2025-09-17T20:58:55.620929] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-07. [2025-09-17T20:58:55.727895] [WARN ] [MAIN ] PBA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:58:55.728239] [INFO ] [MAIN ] PBA: Wiping existing primary data before full refresh. [2025-09-17T20:58:55.728299] [INFO ] [LOCAL ] PBA: Starting deletion of primary data. [2025-09-17T20:58:55.729739] [DEBUG] [LOCAL ] PBA: Deleted primary data file. [2025-09-17T20:58:55.729808] [INFO ] [MAIN ] PBA: Starting full primary refresh. [2025-09-17T20:58:56.108748] [INFO ] [REMOTE ] PBA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:58:56.415770] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-08. [2025-09-17T20:58:56.466937] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T20:58:57.215794] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-08. [2025-09-17T20:58:57.334947] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T20:58:57.555546] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T20:58:58.015816] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-08. [2025-09-17T20:58:58.418337] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T20:58:58.815774] [INFO ] [REMOTE ] PAYC: Fetching primary data for 2025-09. [2025-09-17T20:58:59.263558] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T20:58:59.615793] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-11. [2025-09-17T20:58:59.819801] [INFO ] [REMOTE ] PAYC: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T20:58:59.826332] [INFO ] [REMOTE ] PAYC: Full fetch complete (52573 records). [2025-09-17T20:58:59.826444] [DEBUG] [VALIDATOR ] PAYC: Validating primary data. [2025-09-17T20:59:00.203859] [DEBUG] [VALIDATOR ] PAYC: All expected trading days are present. [2025-09-17T20:59:00.203939] [DEBUG] [VALIDATOR ] PAYC: Primary data validation passed. [2025-09-17T20:59:00.204723] [INFO ] [MAIN ] PAYC: Fetched primary data is valid. [2025-09-17T20:59:00.204766] [DEBUG] [LOCAL ] PAYC: Saving primary data. [2025-09-17T20:59:00.205799] [DEBUG] [LOCAL ] PAYC: Trimmed 52573 records to 36393 (keeping 200 days of data) [2025-09-17T20:59:00.423440] [INFO ] [REMOTE ] PAY: Fetching primary data for 2025-09. [2025-09-17T20:59:00.454436] [DEBUG] [LOCAL ] PAYC: Primary data saved (36393 records). [2025-09-17T20:59:00.454609] [INFO ] [MAIN ] PAYC: Full history saved. [2025-09-17T20:59:00.454753] [INFO ] [MAIN ] Update Progress: 1634/2371 symbols completed. PAYC took 30.6s. Estimated remaining: 1h 47m 47s. Rate: 6.8 symbols/min [2025-09-17T20:59:00.624406] [INFO ] [MAIN ] PBF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:59:00.679789] [DEBUG] [LOCAL ] PBF: Loaded 53093 existing records from primary storage. [2025-09-17T20:59:00.679932] [INFO ] [MAIN ] PBF: Loaded 53093 existing records. [2025-09-17T20:59:00.857288] [WARN ] [MAIN ] PBF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:59:00.857515] [INFO ] [MAIN ] PBF: Wiping existing primary data before full refresh. [2025-09-17T20:59:00.857559] [INFO ] [LOCAL ] PBF: Starting deletion of primary data. [2025-09-17T20:59:00.858485] [DEBUG] [LOCAL ] PBF: Deleted primary data file. [2025-09-17T20:59:00.858532] [INFO ] [MAIN ] PBF: Starting full primary refresh. [2025-09-17T20:59:01.221543] [INFO ] [REMOTE ] PB: Fetching primary data for 2025-09. [2025-09-17T20:59:01.282933] [INFO ] [REMOTE ] PBF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:59:01.311159] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T20:59:01.862084] [INFO ] [REMOTE ] PAY: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T20:59:01.867949] [INFO ] [REMOTE ] PAY: Full fetch complete (52899 records). [2025-09-17T20:59:01.868087] [DEBUG] [VALIDATOR ] PAY: Validating primary data. [2025-09-17T20:59:02.027668] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-11. [2025-09-17T20:59:02.252925] [DEBUG] [VALIDATOR ] PAY: All expected trading days are present. [2025-09-17T20:59:02.253051] [DEBUG] [VALIDATOR ] PAY: Primary data validation passed. [2025-09-17T20:59:02.254633] [INFO ] [MAIN ] PAY: Fetched primary data is valid. [2025-09-17T20:59:02.254730] [DEBUG] [LOCAL ] PAY: Saving primary data. [2025-09-17T20:59:02.256710] [DEBUG] [LOCAL ] PAY: Trimmed 52899 records to 38157 (keeping 200 days of data) [2025-09-17T20:59:02.515230] [DEBUG] [LOCAL ] PAY: Primary data saved (38157 records). [2025-09-17T20:59:02.515446] [INFO ] [MAIN ] PAY: Full history saved. [2025-09-17T20:59:02.515568] [INFO ] [MAIN ] Update Progress: 1635/2371 symbols completed. PAY took 42.0s. Estimated remaining: 1h 47m 35s. Rate: 6.8 symbols/min [2025-09-17T20:59:02.721496] [INFO ] [MAIN ] PBH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:59:02.756397] [DEBUG] [LOCAL ] PBH: Loaded 31362 existing records from primary storage. [2025-09-17T20:59:02.756551] [INFO ] [MAIN ] PBH: Loaded 31362 existing records. [2025-09-17T20:59:02.821006] [INFO ] [REMOTE ] PBA: Fetching primary data for 2024-12. [2025-09-17T20:59:02.940183] [WARN ] [MAIN ] PBH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:59:02.940578] [INFO ] [MAIN ] PBH: Wiping existing primary data before full refresh. [2025-09-17T20:59:02.940708] [INFO ] [LOCAL ] PBH: Starting deletion of primary data. [2025-09-17T20:59:02.946983] [DEBUG] [LOCAL ] PBH: Deleted primary data file. [2025-09-17T20:59:02.956595] [INFO ] [MAIN ] PBH: Starting full primary refresh. [2025-09-17T20:59:02.964137] [INFO ] [REMOTE ] PB: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T20:59:03.061163] [INFO ] [REMOTE ] PB: Full fetch complete (57280 records). [2025-09-17T20:59:03.072196] [DEBUG] [VALIDATOR ] PB: Validating primary data. [2025-09-17T20:59:03.569470] [INFO ] [REMOTE ] PBH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:59:03.625607] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-11. [2025-09-17T20:59:03.729892] [DEBUG] [VALIDATOR ] PB: All expected trading days are present. [2025-09-17T20:59:03.730047] [DEBUG] [VALIDATOR ] PB: Primary data validation passed. [2025-09-17T20:59:03.731019] [INFO ] [MAIN ] PB: Fetched primary data is valid. [2025-09-17T20:59:03.731116] [DEBUG] [LOCAL ] PB: Saving primary data. [2025-09-17T20:59:03.732559] [DEBUG] [LOCAL ] PB: Trimmed 57280 records to 41348 (keeping 200 days of data) [2025-09-17T20:59:03.860154] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T20:59:04.030234] [DEBUG] [LOCAL ] PB: Primary data saved (41348 records). [2025-09-17T20:59:04.030375] [INFO ] [MAIN ] PB: Full history saved. [2025-09-17T20:59:04.030471] [INFO ] [MAIN ] Update Progress: 1636/2371 symbols completed. PB took 29.4s. Estimated remaining: 1h 47m 23s. Rate: 6.8 symbols/min [2025-09-17T20:59:04.205916] [INFO ] [MAIN ] PBI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:59:04.253108] [DEBUG] [LOCAL ] PBI: Loaded 50164 existing records from primary storage. [2025-09-17T20:59:04.253260] [INFO ] [MAIN ] PBI: Loaded 50164 existing records. [2025-09-17T20:59:04.428453] [INFO ] [REMOTE ] PBF: Fetching primary data for 2024-12. [2025-09-17T20:59:04.432998] [WARN ] [MAIN ] PBI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:59:04.434241] [INFO ] [MAIN ] PBI: Wiping existing primary data before full refresh. [2025-09-17T20:59:04.434299] [INFO ] [LOCAL ] PBI: Starting deletion of primary data. [2025-09-17T20:59:04.435362] [DEBUG] [LOCAL ] PBI: Deleted primary data file. [2025-09-17T20:59:04.435422] [INFO ] [MAIN ] PBI: Starting full primary refresh. [2025-09-17T20:59:04.646738] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T20:59:04.858188] [INFO ] [REMOTE ] PBI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:59:04.859531] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T20:59:05.215827] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-01. [2025-09-17T20:59:06.015841] [INFO ] [REMOTE ] PBH: Fetching primary data for 2024-12. [2025-09-17T20:59:06.295205] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T20:59:06.682951] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T20:59:06.815732] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-02. [2025-09-17T20:59:07.138003] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T20:59:07.615786] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-11. [2025-09-17T20:59:08.282388] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T20:59:08.415827] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-01. [2025-09-17T20:59:09.215816] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-03. [2025-09-17T20:59:09.382183] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T20:59:10.015792] [INFO ] [REMOTE ] PBI: Fetching primary data for 2024-12. [2025-09-17T20:59:10.317084] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T20:59:10.659435] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T20:59:10.815768] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-02. [2025-09-17T20:59:11.615774] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-04. [2025-09-17T20:59:11.795696] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T20:59:12.415804] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-01. [2025-09-17T20:59:12.911782] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-02 (2.10 seconds). [2025-09-17T20:59:13.006996] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T20:59:13.215784] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-05. [2025-09-17T20:59:13.698050] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T20:59:14.015781] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-02. [2025-09-17T20:59:14.568087] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T20:59:14.815770] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-06. [2025-09-17T20:59:15.449970] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T20:59:15.615759] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-03. [2025-09-17T20:59:16.320783] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T20:59:16.415815] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-07. [2025-09-17T20:59:16.816631] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T20:59:17.215798] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-01. [2025-09-17T20:59:18.015812] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-03. [2025-09-17T20:59:18.261711] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T20:59:18.641492] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T20:59:18.815803] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-02. [2025-09-17T20:59:19.615806] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-04. [2025-09-17T20:59:19.873004] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T20:59:20.392483] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T20:59:20.415754] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-03. [2025-09-17T20:59:20.902485] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T20:59:21.215799] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-08. [2025-09-17T20:59:22.015800] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-04. [2025-09-17T20:59:22.210567] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T20:59:22.815840] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-05. [2025-09-17T20:59:23.157602] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T20:59:23.615790] [INFO ] [REMOTE ] PBA: Fetching primary data for 2025-09. [2025-09-17T20:59:23.706284] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T20:59:24.269799] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T20:59:24.415771] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-06. [2025-09-17T20:59:25.007172] [INFO ] [REMOTE ] PBA: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T20:59:25.013955] [INFO ] [REMOTE ] PBA: Full fetch complete (71420 records). [2025-09-17T20:59:25.014132] [DEBUG] [VALIDATOR ] PBA: Validating primary data. [2025-09-17T20:59:25.225787] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-04. [2025-09-17T20:59:25.446519] [DEBUG] [VALIDATOR ] PBA: All expected trading days are present. [2025-09-17T20:59:25.446635] [DEBUG] [VALIDATOR ] PBA: Primary data validation passed. [2025-09-17T20:59:25.448082] [INFO ] [MAIN ] PBA: Fetched primary data is valid. [2025-09-17T20:59:25.448136] [DEBUG] [LOCAL ] PBA: Saving primary data. [2025-09-17T20:59:25.450490] [DEBUG] [LOCAL ] PBA: Trimmed 71420 records to 49065 (keeping 200 days of data) [2025-09-17T20:59:25.714276] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T20:59:25.813275] [DEBUG] [LOCAL ] PBA: Primary data saved (49065 records). [2025-09-17T20:59:25.813475] [INFO ] [MAIN ] PBA: Full history saved. [2025-09-17T20:59:25.814690] [INFO ] [MAIN ] Update Progress: 1637/2371 symbols completed. PBA took 30.6s. Estimated remaining: 1h 47m 21s. Rate: 6.8 symbols/min [2025-09-17T20:59:26.015847] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-07. [2025-09-17T20:59:26.815812] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-05. [2025-09-17T20:59:26.946765] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T20:59:26.985356] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T20:59:27.615791] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-08. [2025-09-17T20:59:28.415800] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-05. [2025-09-17T20:59:28.818350] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-05 (2.00 seconds). [2025-09-17T20:59:29.199815] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T20:59:29.215669] [INFO ] [REMOTE ] PBH: Fetching primary data for 2025-09. [2025-09-17T20:59:30.016427] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-06. [2025-09-17T20:59:30.024219] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T20:59:30.601226] [INFO ] [REMOTE ] PBH: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T20:59:30.606516] [INFO ] [REMOTE ] PBH: Full fetch complete (42322 records). [2025-09-17T20:59:30.606702] [DEBUG] [VALIDATOR ] PBH: Validating primary data. [2025-09-17T20:59:30.831690] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-06. [2025-09-17T20:59:30.996699] [DEBUG] [VALIDATOR ] PBH: All expected trading days are present. [2025-09-17T20:59:30.996819] [DEBUG] [VALIDATOR ] PBH: Primary data validation passed. [2025-09-17T20:59:30.998043] [INFO ] [MAIN ] PBH: Fetched primary data is valid. [2025-09-17T20:59:30.998137] [DEBUG] [LOCAL ] PBH: Saving primary data. [2025-09-17T20:59:31.000961] [DEBUG] [LOCAL ] PBH: Trimmed 42322 records to 31378 (keeping 200 days of data) [2025-09-17T20:59:31.194608] [DEBUG] [LOCAL ] PBH: Primary data saved (31378 records). [2025-09-17T20:59:31.194826] [INFO ] [MAIN ] PBH: Full history saved. [2025-09-17T20:59:31.195041] [INFO ] [MAIN ] Update Progress: 1638/2371 symbols completed. PBH took 28.7s. Estimated remaining: 1h 47m 10s. Rate: 6.8 symbols/min [2025-09-17T20:59:31.846042] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T20:59:31.857008] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-07. [2025-09-17T20:59:32.547058] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T20:59:32.557999] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-07. [2025-09-17T20:59:33.831259] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T20:59:33.842990] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-08. [2025-09-17T20:59:34.524812] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-07 (1.97 seconds). [2025-09-17T20:59:34.539732] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-08. [2025-09-17T20:59:35.648844] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T20:59:35.661343] [INFO ] [REMOTE ] PBF: Fetching primary data for 2025-09. [2025-09-17T20:59:36.279769] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T20:59:36.292350] [INFO ] [REMOTE ] PBI: Fetching primary data for 2025-09. [2025-09-17T20:59:37.378968] [INFO ] [REMOTE ] PBF: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T20:59:37.390750] [INFO ] [REMOTE ] PBF: Full fetch complete (76353 records). [2025-09-17T20:59:37.390993] [DEBUG] [VALIDATOR ] PBF: Validating primary data. [2025-09-17T20:59:37.793462] [DEBUG] [VALIDATOR ] PBF: All expected trading days are present. [2025-09-17T20:59:37.793590] [DEBUG] [VALIDATOR ] PBF: Primary data validation passed. [2025-09-17T20:59:37.794705] [INFO ] [MAIN ] PBF: Fetched primary data is valid. [2025-09-17T20:59:37.794801] [DEBUG] [LOCAL ] PBF: Saving primary data. [2025-09-17T20:59:37.813266] [INFO ] [REMOTE ] PBI: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T20:59:37.820100] [DEBUG] [LOCAL ] PBF: Trimmed 76353 records to 53095 (keeping 200 days of data) [2025-09-17T20:59:37.821183] [INFO ] [REMOTE ] PBI: Full fetch complete (71712 records). [2025-09-17T20:59:37.821314] [DEBUG] [VALIDATOR ] PBI: Validating primary data. [2025-09-17T20:59:38.333257] [DEBUG] [VALIDATOR ] PBI: All expected trading days are present. [2025-09-17T20:59:38.333852] [DEBUG] [VALIDATOR ] PBI: Primary data validation passed. [2025-09-17T20:59:38.335134] [INFO ] [MAIN ] PBI: Fetched primary data is valid. [2025-09-17T20:59:38.335882] [DEBUG] [LOCAL ] PBI: Saving primary data. [2025-09-17T20:59:38.341093] [DEBUG] [LOCAL ] PBI: Trimmed 71712 records to 50118 (keeping 200 days of data) [2025-09-17T20:59:38.862625] [DEBUG] [LOCAL ] PBF: Primary data saved (53095 records). [2025-09-17T20:59:38.863745] [INFO ] [MAIN ] PBF: Full history saved. [2025-09-17T20:59:38.864158] [INFO ] [MAIN ] Update Progress: 1639/2371 symbols completed. PBF took 38.4s. Estimated remaining: 1h 47m 1s. Rate: 6.8 symbols/min [2025-09-17T20:59:38.876025] [DEBUG] [LOCAL ] PBI: Primary data saved (50118 records). [2025-09-17T20:59:38.876099] [INFO ] [MAIN ] PBI: Full history saved. [2025-09-17T20:59:38.876201] [INFO ] [MAIN ] Update Progress: 1640/2371 symbols completed. PBI took 34.8s. Estimated remaining: 1h 46m 48s. Rate: 6.8 symbols/min [2025-09-17T20:59:39.526881] [INFO ] [MAIN ] PBR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:59:39.520931] [INFO ] [MAIN ] PCF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:59:39.568469] [INFO ] [MAIN ] PCG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:59:39.570523] [INFO ] [MAIN ] PBT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:59:39.586125] [DEBUG] [LOCAL ] PCF: Loaded 8753 existing records from primary storage. [2025-09-17T20:59:39.586264] [INFO ] [MAIN ] PCF: Loaded 8753 existing records. [2025-09-17T20:59:39.703314] [DEBUG] [LOCAL ] PBT: Loaded 17639 existing records from primary storage. [2025-09-17T20:59:39.709227] [INFO ] [MAIN ] PBT: Loaded 17639 existing records. [2025-09-17T20:59:39.843921] [WARN ] [MAIN ] PCF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:59:39.903974] [INFO ] [MAIN ] PCF: Wiping existing primary data before full refresh. [2025-09-17T20:59:39.957175] [DEBUG] [LOCAL ] PCG: Loaded 53718 existing records from primary storage. [2025-09-17T20:59:39.950825] [INFO ] [LOCAL ] PCF: Starting deletion of primary data. [2025-09-17T20:59:39.972266] [INFO ] [MAIN ] PCG: Loaded 53718 existing records. [2025-09-17T20:59:39.982782] [DEBUG] [LOCAL ] PCF: Deleted primary data file. [2025-09-17T20:59:40.060407] [WARN ] [MAIN ] PBT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:59:40.041302] [INFO ] [MAIN ] PCF: Starting full primary refresh. [2025-09-17T20:59:40.124524] [DEBUG] [LOCAL ] PBR: Loaded 53715 existing records from primary storage. [2025-09-17T20:59:40.109360] [INFO ] [MAIN ] PBT: Wiping existing primary data before full refresh. [2025-09-17T20:59:40.138575] [INFO ] [MAIN ] PBR: Loaded 53715 existing records. [2025-09-17T20:59:40.153991] [INFO ] [LOCAL ] PBT: Starting deletion of primary data. [2025-09-17T20:59:40.206569] [DEBUG] [LOCAL ] PBT: Deleted primary data file. [2025-09-17T20:59:40.234326] [INFO ] [MAIN ] PBT: Starting full primary refresh. [2025-09-17T20:59:40.588073] [WARN ] [MAIN ] PCG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:59:40.697156] [WARN ] [MAIN ] PBR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:59:40.702548] [INFO ] [MAIN ] PCG: Wiping existing primary data before full refresh. [2025-09-17T20:59:40.708017] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-17T20:59:40.757814] [DEBUG] [LOCAL ] PCG: Deleted primary data file. [2025-09-17T20:59:40.773281] [INFO ] [MAIN ] PBR: Wiping existing primary data before full refresh. [2025-09-17T20:59:40.773372] [INFO ] [LOCAL ] PBR: Starting deletion of primary data. [2025-09-17T20:59:40.773226] [INFO ] [MAIN ] PCG: Starting full primary refresh. [2025-09-17T20:59:40.815336] [DEBUG] [LOCAL ] PBR: Deleted primary data file. [2025-09-17T20:59:40.834788] [INFO ] [MAIN ] PBR: Starting full primary refresh. [2025-09-17T20:59:41.121973] [INFO ] [REMOTE ] PCF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:59:41.191949] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-11. [2025-09-17T20:59:41.513889] [INFO ] [REMOTE ] PBT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:59:41.566913] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-11. [2025-09-17T20:59:41.744689] [INFO ] [REMOTE ] PCG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:59:41.760425] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-11. [2025-09-17T20:59:41.820891] [INFO ] [REMOTE ] PBR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T20:59:41.821300] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-11. [2025-09-17T20:59:42.207330] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T20:59:42.210408] [INFO ] [REMOTE ] PCF: Fetching primary data for 2024-12. [2025-09-17T20:59:42.632452] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T20:59:42.637177] [INFO ] [REMOTE ] PBT: Fetching primary data for 2024-12. [2025-09-17T20:59:43.319819] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T20:59:43.330124] [INFO ] [REMOTE ] PCG: Fetching primary data for 2024-12. [2025-09-17T20:59:43.403221] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T20:59:43.407414] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-01. [2025-09-17T20:59:43.833612] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2024-12 (1.20 seconds). [2025-09-17T20:59:43.838396] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-01. [2025-09-17T20:59:44.021626] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-11 (2.20 seconds). [2025-09-17T20:59:44.032109] [INFO ] [REMOTE ] PBR: Fetching primary data for 2024-12. [2025-09-17T20:59:44.244275] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T20:59:44.415834] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-02. [2025-09-17T20:59:44.738475] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T20:59:45.144752] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T20:59:45.199200] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T20:59:45.215674] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-01. [2025-09-17T20:59:46.019984] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-03. [2025-09-17T20:59:46.026031] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T20:59:46.810180] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T20:59:46.815674] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-04. [2025-09-17T20:59:47.170934] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T20:59:47.615840] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-02. [2025-09-17T20:59:47.729754] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T20:59:48.415805] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-02. [2025-09-17T20:59:49.215794] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-01. [2025-09-17T20:59:49.606154] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T20:59:49.611117] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T20:59:50.015819] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-03. [2025-09-17T20:59:50.815747] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-05. [2025-09-17T20:59:51.345215] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T20:59:51.361592] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T20:59:51.615753] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-03. [2025-09-17T20:59:51.656002] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T20:59:52.415753] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-06. [2025-09-17T20:59:52.734261] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T20:59:52.934762] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-17T20:59:53.215780] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-07. [2025-09-17T20:59:54.015782] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-02. [2025-09-17T20:59:54.058349] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T20:59:54.815801] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-08. [2025-09-17T20:59:55.615839] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-04. [2025-09-17T20:59:55.635010] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T20:59:55.973417] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-02 (1.96 seconds). [2025-09-17T20:59:56.415845] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-03. [2025-09-17T20:59:57.165025] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T20:59:57.215753] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-05. [2025-09-17T20:59:58.015820] [INFO ] [REMOTE ] PCF: Fetching primary data for 2025-09. [2025-09-17T20:59:58.632967] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-03 (2.22 seconds). [2025-09-17T20:59:58.750406] [INFO ] [REMOTE ] PCF: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T20:59:58.766053] [INFO ] [REMOTE ] PCF: Full fetch complete (14598 records). [2025-09-17T20:59:58.766449] [DEBUG] [VALIDATOR ] PCF: Validating primary data. [2025-09-17T20:59:58.821056] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-04. [2025-09-17T20:59:59.335274] [DEBUG] [VALIDATOR ] PCF: All expected trading days are present. [2025-09-17T20:59:59.335407] [DEBUG] [VALIDATOR ] PCF: Primary data validation passed. [2025-09-17T20:59:59.336273] [INFO ] [MAIN ] PCF: Fetched primary data is valid. [2025-09-17T20:59:59.336426] [DEBUG] [LOCAL ] PCF: Saving primary data. [2025-09-17T20:59:59.337518] [DEBUG] [LOCAL ] PCF: Trimmed 14598 records to 8754 (keeping 200 days of data) [2025-09-17T20:59:59.426087] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-05 (2.21 seconds). [2025-09-17T20:59:59.456947] [DEBUG] [LOCAL ] PCF: Primary data saved (8754 records). [2025-09-17T20:59:59.457119] [INFO ] [MAIN ] PCF: Full history saved. [2025-09-17T20:59:59.457245] [INFO ] [MAIN ] Update Progress: 1641/2371 symbols completed. PCF took 20.6s. Estimated remaining: 1h 46m 45s. Rate: 6.8 symbols/min [2025-09-17T20:59:59.620933] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-06. [2025-09-17T20:59:59.647933] [INFO ] [MAIN ] PCM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T20:59:59.658895] [DEBUG] [LOCAL ] PCM: Loaded 6779 existing records from primary storage. [2025-09-17T20:59:59.659030] [INFO ] [MAIN ] PCM: Loaded 6779 existing records. [2025-09-17T20:59:59.883623] [WARN ] [MAIN ] PCM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T20:59:59.883974] [INFO ] [MAIN ] PCM: Wiping existing primary data before full refresh. [2025-09-17T20:59:59.884026] [INFO ] [LOCAL ] PCM: Starting deletion of primary data. [2025-09-17T20:59:59.884437] [DEBUG] [LOCAL ] PCM: Deleted primary data file. [2025-09-17T20:59:59.884542] [INFO ] [MAIN ] PCM: Starting full primary refresh. [2025-09-17T21:00:00.244525] [INFO ] [REMOTE ] PCM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:00:00.415720] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-11. [2025-09-17T21:00:01.215755] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-04. [2025-09-17T21:00:01.255529] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T21:00:01.389300] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-17T21:00:01.861474] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-06 (2.24 seconds). [2025-09-17T21:00:02.015784] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-07. [2025-09-17T21:00:02.466675] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T21:00:02.815789] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-05. [2025-09-17T21:00:03.615794] [INFO ] [REMOTE ] PCM: Fetching primary data for 2024-12. [2025-09-17T21:00:03.860512] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T21:00:03.922748] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T21:00:04.185223] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T21:00:04.415793] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-06. [2025-09-17T21:00:05.215838] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-05. [2025-09-17T21:00:05.409009] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T21:00:06.015842] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-07. [2025-09-17T21:00:06.815836] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-01. [2025-09-17T21:00:07.249376] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T21:00:07.278023] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T21:00:07.615791] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-06. [2025-09-17T21:00:07.651064] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T21:00:08.415820] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-08. [2025-09-17T21:00:09.215814] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-08. [2025-09-17T21:00:09.545147] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T21:00:10.015821] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-07. [2025-09-17T21:00:10.139681] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T21:00:10.457753] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T21:00:10.815825] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-02. [2025-09-17T21:00:11.330854] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T21:00:11.615781] [INFO ] [REMOTE ] PCG: Fetching primary data for 2025-09. [2025-09-17T21:00:11.856527] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T21:00:12.362193] [INFO ] [REMOTE ] PCG: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T21:00:12.368819] [INFO ] [REMOTE ] PCG: Full fetch complete (77191 records). [2025-09-17T21:00:12.368954] [DEBUG] [VALIDATOR ] PCG: Validating primary data. [2025-09-17T21:00:12.371601] [FATAL] [VALIDATOR ] PCG: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:00:12.371730] [FATAL] [MAIN ] PCG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:00:12.371768] [WARN ] [MAIN ] PCG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:00:12.371813] [INFO ] [LOCAL ] PCG: Starting deletion of primary data. [2025-09-17T21:00:12.371877] [DEBUG] [LOCAL ] PCG: No primary data file found to delete. [2025-09-17T21:00:12.371914] [INFO ] [LOCAL ] PCG: Starting deletion of derivative data. [2025-09-17T21:00:12.372323] [DEBUG] [LOCAL ] PCG: Deleted derivative data file. [2025-09-17T21:00:12.372427] [INFO ] [MAIN ] Update Progress: 1642/2371 symbols completed. PCG took 33.5s. Estimated remaining: 1h 46m 38s. Rate: 6.8 symbols/min [2025-09-17T21:00:12.420933] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-03. [2025-09-17T21:00:12.568522] [INFO ] [MAIN ] PCN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:00:12.593351] [DEBUG] [LOCAL ] PCN: Loaded 24169 existing records from primary storage. [2025-09-17T21:00:12.593529] [INFO ] [MAIN ] PCN: Loaded 24169 existing records. [2025-09-17T21:00:12.773784] [WARN ] [MAIN ] PCN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:00:12.774043] [INFO ] [MAIN ] PCN: Wiping existing primary data before full refresh. [2025-09-17T21:00:12.774088] [INFO ] [LOCAL ] PCN: Starting deletion of primary data. [2025-09-17T21:00:12.774735] [DEBUG] [LOCAL ] PCN: Deleted primary data file. [2025-09-17T21:00:12.774784] [INFO ] [MAIN ] PCN: Starting full primary refresh. [2025-09-17T21:00:13.131781] [INFO ] [REMOTE ] PCN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:00:13.208624] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T21:00:13.215675] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-04. [2025-09-17T21:00:13.880887] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T21:00:14.015770] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-05. [2025-09-17T21:00:14.740594] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T21:00:14.815762] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-08. [2025-09-17T21:00:15.615846] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-06. [2025-09-17T21:00:16.276194] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T21:00:16.415783] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-07. [2025-09-17T21:00:16.933019] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-17T21:00:17.125427] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-07 (0.71 seconds). [2025-09-17T21:00:17.215786] [INFO ] [REMOTE ] PBR: Fetching primary data for 2025-09. [2025-09-17T21:00:18.015790] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-11. [2025-09-17T21:00:18.815783] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-08. [2025-09-17T21:00:18.950118] [INFO ] [REMOTE ] PBR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T21:00:18.957394] [INFO ] [REMOTE ] PBR: Full fetch complete (77703 records). [2025-09-17T21:00:18.957567] [DEBUG] [VALIDATOR ] PBR: Validating primary data. [2025-09-17T21:00:19.396008] [DEBUG] [VALIDATOR ] PBR: All expected trading days are present. [2025-09-17T21:00:19.394585] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T21:00:19.396254] [DEBUG] [VALIDATOR ] PBR: Primary data validation passed. [2025-09-17T21:00:19.396989] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T21:00:19.398303] [INFO ] [MAIN ] PBR: Fetched primary data is valid. [2025-09-17T21:00:19.404913] [DEBUG] [LOCAL ] PBR: Saving primary data. [2025-09-17T21:00:19.408711] [DEBUG] [LOCAL ] PBR: Trimmed 77703 records to 53715 (keeping 200 days of data) [2025-09-17T21:00:19.635956] [INFO ] [REMOTE ] PCM: Fetching primary data for 2025-09. [2025-09-17T21:00:19.766363] [DEBUG] [LOCAL ] PBR: Primary data saved (53715 records). [2025-09-17T21:00:19.766533] [INFO ] [MAIN ] PBR: Full history saved. [2025-09-17T21:00:19.766622] [INFO ] [MAIN ] Update Progress: 1643/2371 symbols completed. PBR took 40.9s. Estimated remaining: 1h 46m 28s. Rate: 6.8 symbols/min [2025-09-17T21:00:19.957311] [INFO ] [MAIN ] PCOR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:00:20.007178] [DEBUG] [LOCAL ] PCOR: Loaded 48151 existing records from primary storage. [2025-09-17T21:00:20.007355] [INFO ] [MAIN ] PCOR: Loaded 48151 existing records. [2025-09-17T21:00:20.186955] [WARN ] [MAIN ] PCOR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:00:20.187242] [INFO ] [MAIN ] PCOR: Wiping existing primary data before full refresh. [2025-09-17T21:00:20.187304] [INFO ] [LOCAL ] PCOR: Starting deletion of primary data. [2025-09-17T21:00:20.188274] [DEBUG] [LOCAL ] PCOR: Deleted primary data file. [2025-09-17T21:00:20.188326] [INFO ] [MAIN ] PCOR: Starting full primary refresh. [2025-09-17T21:00:20.425938] [INFO ] [REMOTE ] PBT: Fetching primary data for 2025-09. [2025-09-17T21:00:20.539340] [INFO ] [REMOTE ] PCM: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T21:00:20.561536] [INFO ] [REMOTE ] PCOR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:00:20.561897] [INFO ] [REMOTE ] PCM: Full fetch complete (10398 records). [2025-09-17T21:00:20.562334] [DEBUG] [VALIDATOR ] PCM: Validating primary data. [2025-09-17T21:00:20.934316] [DEBUG] [VALIDATOR ] PCM: All expected trading days are present. [2025-09-17T21:00:20.934433] [DEBUG] [VALIDATOR ] PCM: Primary data validation passed. [2025-09-17T21:00:20.934828] [INFO ] [MAIN ] PCM: Fetched primary data is valid. [2025-09-17T21:00:20.934878] [DEBUG] [LOCAL ] PCM: Saving primary data. [2025-09-17T21:00:20.935711] [DEBUG] [LOCAL ] PCM: Trimmed 10398 records to 6807 (keeping 200 days of data) [2025-09-17T21:00:20.982108] [DEBUG] [LOCAL ] PCM: Primary data saved (6807 records). [2025-09-17T21:00:20.982327] [INFO ] [MAIN ] PCM: Full history saved. [2025-09-17T21:00:20.982445] [INFO ] [MAIN ] Update Progress: 1644/2371 symbols completed. PCM took 21.5s. Estimated remaining: 1h 46m 16s. Rate: 6.8 symbols/min [2025-09-17T21:00:21.156693] [INFO ] [MAIN ] PCQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:00:21.170973] [DEBUG] [LOCAL ] PCQ: Loaded 11994 existing records from primary storage. [2025-09-17T21:00:21.171148] [INFO ] [MAIN ] PCQ: Loaded 11994 existing records. [2025-09-17T21:00:21.227263] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-11. [2025-09-17T21:00:21.359499] [WARN ] [MAIN ] PCQ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:00:21.359817] [INFO ] [MAIN ] PCQ: Wiping existing primary data before full refresh. [2025-09-17T21:00:21.359865] [INFO ] [LOCAL ] PCQ: Starting deletion of primary data. [2025-09-17T21:00:21.360271] [DEBUG] [LOCAL ] PCQ: Deleted primary data file. [2025-09-17T21:00:21.360316] [INFO ] [MAIN ] PCQ: Starting full primary refresh. [2025-09-17T21:00:21.736026] [INFO ] [REMOTE ] PCQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:00:21.736930] [INFO ] [REMOTE ] PBT: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T21:00:21.740130] [INFO ] [REMOTE ] PBT: Full fetch complete (25390 records). [2025-09-17T21:00:21.740215] [DEBUG] [VALIDATOR ] PBT: Validating primary data. [2025-09-17T21:00:22.020878] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-11. [2025-09-17T21:00:22.131699] [DEBUG] [VALIDATOR ] PBT: All expected trading days are present. [2025-09-17T21:00:22.131783] [DEBUG] [VALIDATOR ] PBT: Primary data validation passed. [2025-09-17T21:00:22.132379] [INFO ] [MAIN ] PBT: Fetched primary data is valid. [2025-09-17T21:00:22.132419] [DEBUG] [LOCAL ] PBT: Saving primary data. [2025-09-17T21:00:22.133174] [DEBUG] [LOCAL ] PBT: Trimmed 25390 records to 17633 (keeping 200 days of data) [2025-09-17T21:00:22.243725] [DEBUG] [LOCAL ] PBT: Primary data saved (17633 records). [2025-09-17T21:00:22.243929] [INFO ] [MAIN ] PBT: Full history saved. [2025-09-17T21:00:22.244051] [INFO ] [MAIN ] Update Progress: 1645/2371 symbols completed. PBT took 43.4s. Estimated remaining: 1h 46m 4s. Rate: 6.8 symbols/min [2025-09-17T21:00:22.414754] [INFO ] [MAIN ] PD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:00:22.460216] [DEBUG] [LOCAL ] PD: Loaded 47686 existing records from primary storage. [2025-09-17T21:00:22.460368] [INFO ] [MAIN ] PD: Loaded 47686 existing records. [2025-09-17T21:00:22.641327] [WARN ] [MAIN ] PD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:00:22.641587] [INFO ] [MAIN ] PD: Wiping existing primary data before full refresh. [2025-09-17T21:00:22.641632] [INFO ] [LOCAL ] PD: Starting deletion of primary data. [2025-09-17T21:00:22.642517] [DEBUG] [LOCAL ] PD: Deleted primary data file. [2025-09-17T21:00:22.642566] [INFO ] [MAIN ] PD: Starting full primary refresh. [2025-09-17T21:00:22.823075] [INFO ] [REMOTE ] PCN: Fetching primary data for 2024-12. [2025-09-17T21:00:23.017446] [INFO ] [REMOTE ] PD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:00:23.024844] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T21:00:23.058548] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T21:00:23.615782] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2024-12. [2025-09-17T21:00:23.841388] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T21:00:24.415806] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2024-12. [2025-09-17T21:00:25.053946] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T21:00:25.215800] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-01. [2025-09-17T21:00:25.373745] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T21:00:25.997118] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T21:00:26.015670] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-02. [2025-09-17T21:00:26.791100] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T21:00:26.815726] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-03. [2025-09-17T21:00:27.615737] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-01. [2025-09-17T21:00:27.653997] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T21:00:28.415795] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-01. [2025-09-17T21:00:29.215774] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-11. [2025-09-17T21:00:29.403884] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T21:00:29.454536] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T21:00:30.015779] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-02. [2025-09-17T21:00:30.815739] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-02. [2025-09-17T21:00:30.997496] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T21:00:31.129276] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T21:00:31.615790] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-03. [2025-09-17T21:00:32.415817] [INFO ] [REMOTE ] PD: Fetching primary data for 2024-12. [2025-09-17T21:00:32.507705] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T21:00:32.755936] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T21:00:33.215770] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-04. [2025-09-17T21:00:34.015785] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-03. [2025-09-17T21:00:34.663404] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2024-12 (2.25 seconds). [2025-09-17T21:00:34.725308] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T21:00:34.815723] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-01. [2025-09-17T21:00:35.615769] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-05. [2025-09-17T21:00:35.847698] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T21:00:36.220295] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T21:00:36.415778] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-06. [2025-09-17T21:00:36.468019] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T21:00:37.215780] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-04. [2025-09-17T21:00:37.234563] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T21:00:38.015776] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-07. [2025-09-17T21:00:38.368898] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T21:00:38.815766] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-05. [2025-09-17T21:00:38.845254] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T21:00:39.615798] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-08. [2025-09-17T21:00:39.826900] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T21:00:40.415803] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-06. [2025-09-17T21:00:40.692374] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T21:00:41.215816] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-02. [2025-09-17T21:00:41.317677] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T21:00:42.015785] [INFO ] [REMOTE ] PCQ: Fetching primary data for 2025-09. [2025-09-17T21:00:42.705020] [INFO ] [REMOTE ] PCQ: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T21:00:42.707794] [INFO ] [REMOTE ] PCQ: Full fetch complete (17508 records). [2025-09-17T21:00:42.707897] [DEBUG] [VALIDATOR ] PCQ: Validating primary data. [2025-09-17T21:00:42.816817] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-07. [2025-09-17T21:00:43.108007] [DEBUG] [VALIDATOR ] PCQ: All expected trading days are present. [2025-09-17T21:00:43.126391] [DEBUG] [VALIDATOR ] PCQ: Primary data validation passed. [2025-09-17T21:00:43.129334] [INFO ] [MAIN ] PCQ: Fetched primary data is valid. [2025-09-17T21:00:43.129410] [DEBUG] [LOCAL ] PCQ: Saving primary data. [2025-09-17T21:00:43.131145] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-02 (1.92 seconds). [2025-09-17T21:00:43.139346] [DEBUG] [LOCAL ] PCQ: Trimmed 17508 records to 12132 (keeping 200 days of data) [2025-09-17T21:00:43.213598] [DEBUG] [LOCAL ] PCQ: Primary data saved (12132 records). [2025-09-17T21:00:43.213756] [INFO ] [MAIN ] PCQ: Full history saved. [2025-09-17T21:00:43.213857] [INFO ] [MAIN ] Update Progress: 1646/2371 symbols completed. PCQ took 22.2s. Estimated remaining: 1h 46m 1s. Rate: 6.8 symbols/min [2025-09-17T21:00:43.382441] [INFO ] [MAIN ] PDCC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:00:43.382624] [DEBUG] [LOCAL ] PDCC: No existing data file found in primary storage. [2025-09-17T21:00:43.382683] [WARN ] [MAIN ] PDCC: No existing data found, performing full refresh instead. [2025-09-17T21:00:43.382804] [INFO ] [MAIN ] PDCC: Wiping existing primary data before full refresh. [2025-09-17T21:00:43.382845] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-17T21:00:43.382886] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-17T21:00:43.382929] [INFO ] [MAIN ] PDCC: Starting full primary refresh. [2025-09-17T21:00:43.621799] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-03. [2025-09-17T21:00:43.740539] [INFO ] [REMOTE ] PDCC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:00:44.275456] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T21:00:44.415785] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-11. [2025-09-17T21:00:44.832839] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T21:00:45.215814] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-08. [2025-09-17T21:00:45.427769] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T21:00:46.015791] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2024-12. [2025-09-17T21:00:46.318826] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2024-12 (0.30 seconds). [2025-09-17T21:00:46.499201] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T21:00:46.815794] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-04. [2025-09-17T21:00:47.615993] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-01. [2025-09-17T21:00:47.971500] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T21:00:48.182452] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T21:00:48.415752] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-04. [2025-09-17T21:00:49.215780] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-02. [2025-09-17T21:00:49.697948] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T21:00:50.015821] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-05. [2025-09-17T21:00:50.159817] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T21:00:50.815798] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-05. [2025-09-17T21:00:51.457227] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T21:00:51.615797] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-03. [2025-09-17T21:00:52.308536] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T21:00:52.415836] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-04. [2025-09-17T21:00:52.544703] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T21:00:52.984568] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T21:00:53.215844] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-06. [2025-09-17T21:00:54.015845] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-06. [2025-09-17T21:00:54.815794] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-05. [2025-09-17T21:00:54.869453] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T21:00:55.199444] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T21:00:55.615802] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-06. [2025-09-17T21:00:55.626421] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T21:00:56.020423] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-06 (0.40 seconds). [2025-09-17T21:00:56.415776] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-07. [2025-09-17T21:00:56.893571] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T21:00:57.215790] [INFO ] [REMOTE ] PCN: Fetching primary data for 2025-09. [2025-09-17T21:00:58.015825] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-07. [2025-09-17T21:00:58.269329] [INFO ] [REMOTE ] PCN: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T21:00:58.273885] [INFO ] [REMOTE ] PCN: Full fetch complete (33639 records). [2025-09-17T21:00:58.273996] [DEBUG] [VALIDATOR ] PCN: Validating primary data. [2025-09-17T21:00:58.655255] [DEBUG] [VALIDATOR ] PCN: All expected trading days are present. [2025-09-17T21:00:58.655358] [DEBUG] [VALIDATOR ] PCN: Primary data validation passed. [2025-09-17T21:00:58.656057] [INFO ] [MAIN ] PCN: Fetched primary data is valid. [2025-09-17T21:00:58.656101] [DEBUG] [LOCAL ] PCN: Saving primary data. [2025-09-17T21:00:58.656954] [DEBUG] [LOCAL ] PCN: Trimmed 33639 records to 24190 (keeping 200 days of data) [2025-09-17T21:00:58.803720] [DEBUG] [LOCAL ] PCN: Primary data saved (24190 records). [2025-09-17T21:00:58.803881] [INFO ] [MAIN ] PCN: Full history saved. [2025-09-17T21:00:58.803967] [INFO ] [MAIN ] Update Progress: 1647/2371 symbols completed. PCN took 46.4s. Estimated remaining: 1h 45m 55s. Rate: 6.8 symbols/min [2025-09-17T21:00:58.824630] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-07. [2025-09-17T21:00:58.974683] [INFO ] [MAIN ] PDI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:00:59.021764] [DEBUG] [LOCAL ] PDI: Loaded 50271 existing records from primary storage. [2025-09-17T21:00:59.021911] [INFO ] [MAIN ] PDI: Loaded 50271 existing records. [2025-09-17T21:00:59.205597] [WARN ] [MAIN ] PDI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:00:59.205906] [INFO ] [MAIN ] PDI: Wiping existing primary data before full refresh. [2025-09-17T21:00:59.205953] [INFO ] [LOCAL ] PDI: Starting deletion of primary data. [2025-09-17T21:00:59.206975] [DEBUG] [LOCAL ] PDI: Deleted primary data file. [2025-09-17T21:00:59.207026] [INFO ] [MAIN ] PDI: Starting full primary refresh. [2025-09-17T21:00:59.578195] [INFO ] [REMOTE ] PDI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:00:59.613161] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T21:00:59.624213] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-11. [2025-09-17T21:01:00.415815] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-08. [2025-09-17T21:01:00.694097] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T21:01:01.215781] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-08. [2025-09-17T21:01:01.690889] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T21:01:01.968557] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T21:01:02.015865] [INFO ] [REMOTE ] PD: Fetching primary data for 2025-09. [2025-09-17T21:01:02.761402] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T21:01:02.815752] [INFO ] [REMOTE ] PCOR: Fetching primary data for 2025-09. [2025-09-17T21:01:03.490387] [INFO ] [REMOTE ] PD: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T21:01:03.497745] [INFO ] [REMOTE ] PD: Full fetch complete (67289 records). [2025-09-17T21:01:03.497878] [DEBUG] [VALIDATOR ] PD: Validating primary data. [2025-09-17T21:01:03.620978] [INFO ] [REMOTE ] PDI: Fetching primary data for 2024-12. [2025-09-17T21:01:03.906034] [DEBUG] [VALIDATOR ] PD: All expected trading days are present. [2025-09-17T21:01:03.906129] [DEBUG] [VALIDATOR ] PD: Primary data validation passed. [2025-09-17T21:01:03.907097] [INFO ] [MAIN ] PD: Fetched primary data is valid. [2025-09-17T21:01:03.907148] [DEBUG] [LOCAL ] PD: Saving primary data. [2025-09-17T21:01:03.908557] [DEBUG] [LOCAL ] PD: Trimmed 67289 records to 47739 (keeping 200 days of data) [2025-09-17T21:01:04.194043] [DEBUG] [LOCAL ] PD: Primary data saved (47739 records). [2025-09-17T21:01:04.194187] [INFO ] [MAIN ] PD: Full history saved. [2025-09-17T21:01:04.194274] [INFO ] [MAIN ] Update Progress: 1648/2371 symbols completed. PD took 42.0s. Estimated remaining: 1h 45m 45s. Rate: 6.8 symbols/min [2025-09-17T21:01:04.379992] [INFO ] [MAIN ] PDM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:01:04.411157] [INFO ] [REMOTE ] PCOR: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T21:01:04.420231] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-08. [2025-09-17T21:01:04.422522] [INFO ] [REMOTE ] PCOR: Full fetch complete (69594 records). [2025-09-17T21:01:04.422725] [DEBUG] [VALIDATOR ] PCOR: Validating primary data. [2025-09-17T21:01:04.601354] [DEBUG] [LOCAL ] PDM: Loaded 39865 existing records from primary storage. [2025-09-17T21:01:04.632131] [INFO ] [MAIN ] PDM: Loaded 39865 existing records. [2025-09-17T21:01:04.998917] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T21:01:05.060290] [WARN ] [MAIN ] PDM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:01:05.109239] [INFO ] [MAIN ] PDM: Wiping existing primary data before full refresh. [2025-09-17T21:01:05.109452] [DEBUG] [VALIDATOR ] PCOR: All expected trading days are present. [2025-09-17T21:01:05.109504] [INFO ] [LOCAL ] PDM: Starting deletion of primary data. [2025-09-17T21:01:05.109583] [DEBUG] [VALIDATOR ] PCOR: Primary data validation passed. [2025-09-17T21:01:05.110708] [INFO ] [MAIN ] PCOR: Fetched primary data is valid. [2025-09-17T21:01:05.110763] [DEBUG] [LOCAL ] PDM: Deleted primary data file. [2025-09-17T21:01:05.110877] [INFO ] [MAIN ] PDM: Starting full primary refresh. [2025-09-17T21:01:05.110837] [DEBUG] [LOCAL ] PCOR: Saving primary data. [2025-09-17T21:01:05.218089] [INFO ] [REMOTE ] PDCC: Fetching primary data for 2025-09. [2025-09-17T21:01:05.224043] [DEBUG] [LOCAL ] PCOR: Trimmed 69594 records to 48134 (keeping 200 days of data) [2025-09-17T21:01:05.611235] [INFO ] [REMOTE ] PDM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:01:05.661287] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2024-12 (2.04 seconds). [2025-09-17T21:01:05.752356] [INFO ] [REMOTE ] PDCC: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T21:01:05.783972] [INFO ] [REMOTE ] PDCC: Full fetch complete (1319 records). [2025-09-17T21:01:05.788377] [DEBUG] [VALIDATOR ] PDCC: Validating primary data. [2025-09-17T21:01:05.985376] [WARN ] [VALIDATOR ] PDCC: Validation failed - insufficient historical data. Have 186 unique days, need 200 days [2025-09-17T21:01:05.987481] [FATAL] [MAIN ] PDCC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:01:05.988475] [WARN ] [MAIN ] PDCC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:01:05.989424] [INFO ] [LOCAL ] PDCC: Starting deletion of primary data. [2025-09-17T21:01:05.989819] [DEBUG] [LOCAL ] PDCC: No primary data file found to delete. [2025-09-17T21:01:05.990945] [INFO ] [LOCAL ] PDCC: Starting deletion of derivative data. [2025-09-17T21:01:05.991836] [DEBUG] [LOCAL ] PDCC: No derivative data file found to delete. [2025-09-17T21:01:05.992464] [INFO ] [MAIN ] Update Progress: 1649/2371 symbols completed. PDCC took 22.8s. Estimated remaining: 1h 45m 33s. Rate: 6.8 symbols/min [2025-09-17T21:01:06.018695] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-01. [2025-09-17T21:01:06.241750] [INFO ] [MAIN ] PDO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:01:06.257358] [DEBUG] [LOCAL ] PCOR: Primary data saved (48134 records). [2025-09-17T21:01:06.257538] [INFO ] [MAIN ] PCOR: Full history saved. [2025-09-17T21:01:06.259468] [INFO ] [MAIN ] Update Progress: 1650/2371 symbols completed. PCOR took 46.5s. Estimated remaining: 1h 45m 20s. Rate: 6.8 symbols/min [2025-09-17T21:01:06.414165] [DEBUG] [LOCAL ] PDO: Loaded 32021 existing records from primary storage. [2025-09-17T21:01:06.424586] [INFO ] [MAIN ] PDO: Loaded 32021 existing records. [2025-09-17T21:01:06.545289] [INFO ] [MAIN ] PDS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:01:06.662586] [WARN ] [MAIN ] PDO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:01:06.662856] [INFO ] [MAIN ] PDO: Wiping existing primary data before full refresh. [2025-09-17T21:01:06.662932] [INFO ] [LOCAL ] PDO: Starting deletion of primary data. [2025-09-17T21:01:06.663635] [DEBUG] [LOCAL ] PDO: Deleted primary data file. [2025-09-17T21:01:06.663714] [INFO ] [MAIN ] PDO: Starting full primary refresh. [2025-09-17T21:01:06.773487] [DEBUG] [LOCAL ] PDS: Loaded 18821 existing records from primary storage. [2025-09-17T21:01:06.789131] [INFO ] [MAIN ] PDS: Loaded 18821 existing records. [2025-09-17T21:01:06.834444] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-11. [2025-09-17T21:01:07.161361] [WARN ] [MAIN ] PDS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:01:07.198539] [INFO ] [MAIN ] PDS: Wiping existing primary data before full refresh. [2025-09-17T21:01:07.219477] [INFO ] [LOCAL ] PDS: Starting deletion of primary data. [2025-09-17T21:01:07.219414] [INFO ] [REMOTE ] PDO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:01:07.220010] [DEBUG] [LOCAL ] PDS: Deleted primary data file. [2025-09-17T21:01:07.220070] [INFO ] [MAIN ] PDS: Starting full primary refresh. [2025-09-17T21:01:07.601768] [INFO ] [REMOTE ] PDS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:01:07.615741] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-11. [2025-09-17T21:01:08.058342] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T21:01:08.380132] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T21:01:08.415811] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-11. [2025-09-17T21:01:08.923231] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T21:01:09.215805] [INFO ] [REMOTE ] PDM: Fetching primary data for 2024-12. [2025-09-17T21:01:09.841061] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T21:01:10.015787] [INFO ] [REMOTE ] PDO: Fetching primary data for 2024-12. [2025-09-17T21:01:10.545415] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T21:01:10.815772] [INFO ] [REMOTE ] PDS: Fetching primary data for 2024-12. [2025-09-17T21:01:11.342840] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T21:01:11.615772] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-01. [2025-09-17T21:01:11.645469] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T21:01:12.415786] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-01. [2025-09-17T21:01:13.201956] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T21:01:13.215747] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-02. [2025-09-17T21:01:13.469309] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T21:01:14.015780] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-02. [2025-09-17T21:01:14.815783] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-02. [2025-09-17T21:01:14.965602] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T21:01:15.527375] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T21:01:15.615758] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-03. [2025-09-17T21:01:15.902334] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T21:01:16.415803] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-01. [2025-09-17T21:01:17.215760] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-03. [2025-09-17T21:01:17.688774] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-17T21:01:17.722377] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-01 (1.31 seconds). [2025-09-17T21:01:18.015775] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-04. [2025-09-17T21:01:18.408072] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T21:01:18.815781] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-04. [2025-09-17T21:01:19.615747] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-03. [2025-09-17T21:01:19.853017] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T21:01:20.415796] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-05. [2025-09-17T21:01:20.481366] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T21:01:20.852951] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T21:01:21.215811] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-04. [2025-09-17T21:01:22.015742] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-05. [2025-09-17T21:01:22.090962] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T21:01:22.596462] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T21:01:22.815770] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-05. [2025-09-17T21:01:23.384863] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T21:01:23.496930] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T21:01:23.615746] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-06. [2025-09-17T21:01:24.415784] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-06. [2025-09-17T21:01:24.749167] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T21:01:25.215788] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-02. [2025-09-17T21:01:25.611495] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T21:01:26.015767] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-07. [2025-09-17T21:01:26.546984] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T21:01:26.815764] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-03. [2025-09-17T21:01:27.266112] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T21:01:27.615787] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-08. [2025-09-17T21:01:27.906396] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T21:01:28.415773] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-04. [2025-09-17T21:01:28.639501] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T21:01:29.215784] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-07. [2025-09-17T21:01:29.906570] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T21:01:30.015791] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-06. [2025-09-17T21:01:30.219469] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T21:01:30.815758] [INFO ] [REMOTE ] PDM: Fetching primary data for 2025-09. [2025-09-17T21:01:31.409591] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T21:01:31.615790] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-08. [2025-09-17T21:01:32.050963] [INFO ] [REMOTE ] PDM: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T21:01:32.056086] [INFO ] [REMOTE ] PDM: Full fetch complete (57188 records). [2025-09-17T21:01:32.056243] [DEBUG] [VALIDATOR ] PDM: Validating primary data. [2025-09-17T21:01:32.426554] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-07. [2025-09-17T21:01:32.446787] [DEBUG] [VALIDATOR ] PDM: All expected trading days are present. [2025-09-17T21:01:32.446860] [DEBUG] [VALIDATOR ] PDM: Primary data validation passed. [2025-09-17T21:01:32.447758] [INFO ] [MAIN ] PDM: Fetched primary data is valid. [2025-09-17T21:01:32.447893] [DEBUG] [LOCAL ] PDM: Saving primary data. [2025-09-17T21:01:32.449201] [DEBUG] [LOCAL ] PDM: Trimmed 57188 records to 39895 (keeping 200 days of data) [2025-09-17T21:01:32.560135] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T21:01:32.704110] [DEBUG] [LOCAL ] PDM: Primary data saved (39895 records). [2025-09-17T21:01:32.704280] [INFO ] [MAIN ] PDM: Full history saved. [2025-09-17T21:01:32.704426] [INFO ] [MAIN ] Update Progress: 1651/2371 symbols completed. PDM took 28.5s. Estimated remaining: 1h 45m 19s. Rate: 6.8 symbols/min [2025-09-17T21:01:32.908242] [INFO ] [MAIN ] PDT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:01:32.926771] [DEBUG] [LOCAL ] PDT: Loaded 17578 existing records from primary storage. [2025-09-17T21:01:32.926910] [INFO ] [MAIN ] PDT: Loaded 17578 existing records. [2025-09-17T21:01:33.105543] [WARN ] [MAIN ] PDT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:01:33.105836] [INFO ] [MAIN ] PDT: Wiping existing primary data before full refresh. [2025-09-17T21:01:33.105883] [INFO ] [LOCAL ] PDT: Starting deletion of primary data. [2025-09-17T21:01:33.106346] [DEBUG] [LOCAL ] PDT: Deleted primary data file. [2025-09-17T21:01:33.106392] [INFO ] [MAIN ] PDT: Starting full primary refresh. [2025-09-17T21:01:33.221000] [INFO ] [REMOTE ] PDS: Fetching primary data for 2025-09. [2025-09-17T21:01:33.464872] [INFO ] [REMOTE ] PDT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:01:34.015757] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-11. [2025-09-17T21:01:34.169737] [INFO ] [REMOTE ] PDS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T21:01:34.171994] [INFO ] [REMOTE ] PDS: Full fetch complete (25689 records). [2025-09-17T21:01:34.172068] [DEBUG] [VALIDATOR ] PDS: Validating primary data. [2025-09-17T21:01:34.552763] [DEBUG] [VALIDATOR ] PDS: All expected trading days are present. [2025-09-17T21:01:34.552946] [DEBUG] [VALIDATOR ] PDS: Primary data validation passed. [2025-09-17T21:01:34.553498] [INFO ] [MAIN ] PDS: Fetched primary data is valid. [2025-09-17T21:01:34.553568] [DEBUG] [LOCAL ] PDS: Saving primary data. [2025-09-17T21:01:34.554437] [DEBUG] [LOCAL ] PDS: Trimmed 25689 records to 18741 (keeping 200 days of data) [2025-09-17T21:01:34.671513] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-17T21:01:34.698720] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T21:01:34.720533] [DEBUG] [LOCAL ] PDS: Primary data saved (18741 records). [2025-09-17T21:01:34.720673] [INFO ] [MAIN ] PDS: Full history saved. [2025-09-17T21:01:34.720757] [INFO ] [MAIN ] Update Progress: 1652/2371 symbols completed. PDS took 28.5s. Estimated remaining: 1h 45m 8s. Rate: 6.8 symbols/min [2025-09-17T21:01:34.820862] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-05. [2025-09-17T21:01:34.892186] [INFO ] [MAIN ] PDX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:01:34.907138] [DEBUG] [LOCAL ] PDX: Loaded 14635 existing records from primary storage. [2025-09-17T21:01:34.907242] [INFO ] [MAIN ] PDX: Loaded 14635 existing records. [2025-09-17T21:01:35.086607] [WARN ] [MAIN ] PDX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:01:35.086980] [INFO ] [MAIN ] PDX: Wiping existing primary data before full refresh. [2025-09-17T21:01:35.087031] [INFO ] [LOCAL ] PDX: Starting deletion of primary data. [2025-09-17T21:01:35.087533] [DEBUG] [LOCAL ] PDX: Deleted primary data file. [2025-09-17T21:01:35.087580] [INFO ] [MAIN ] PDX: Starting full primary refresh. [2025-09-17T21:01:35.441763] [INFO ] [REMOTE ] PDX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:01:35.615775] [INFO ] [REMOTE ] PDT: Fetching primary data for 2024-12. [2025-09-17T21:01:35.828524] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T21:01:36.415687] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-08. [2025-09-17T21:01:36.737533] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T21:01:37.215771] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-01. [2025-09-17T21:01:38.015752] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-06. [2025-09-17T21:01:38.075000] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T21:01:38.252875] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T21:01:38.815767] [INFO ] [REMOTE ] PDI: Fetching primary data for 2025-09. [2025-09-17T21:01:39.105863] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T21:01:39.615830] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-11. [2025-09-17T21:01:40.415771] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-02. [2025-09-17T21:01:40.609542] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T21:01:40.630943] [INFO ] [REMOTE ] PDI: Incremental fetch complete for 2025-09 (1.82 seconds). [2025-09-17T21:01:40.638498] [INFO ] [REMOTE ] PDI: Full fetch complete (72971 records). [2025-09-17T21:01:40.638629] [DEBUG] [VALIDATOR ] PDI: Validating primary data. [2025-09-17T21:01:41.042943] [DEBUG] [VALIDATOR ] PDI: All expected trading days are present. [2025-09-17T21:01:41.043063] [DEBUG] [VALIDATOR ] PDI: Primary data validation passed. [2025-09-17T21:01:41.044305] [INFO ] [MAIN ] PDI: Fetched primary data is valid. [2025-09-17T21:01:41.044422] [DEBUG] [LOCAL ] PDI: Saving primary data. [2025-09-17T21:01:41.046154] [DEBUG] [LOCAL ] PDI: Trimmed 72971 records to 50272 (keeping 200 days of data) [2025-09-17T21:01:41.230569] [INFO ] [REMOTE ] PDX: Fetching primary data for 2024-12. [2025-09-17T21:01:41.369902] [DEBUG] [LOCAL ] PDI: Primary data saved (50272 records). [2025-09-17T21:01:41.370074] [INFO ] [MAIN ] PDI: Full history saved. [2025-09-17T21:01:41.370168] [INFO ] [MAIN ] Update Progress: 1653/2371 symbols completed. PDI took 42.6s. Estimated remaining: 1h 44m 58s. Rate: 6.8 symbols/min [2025-09-17T21:01:41.555207] [INFO ] [MAIN ] PEB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:01:41.556696] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T21:01:41.609109] [DEBUG] [LOCAL ] PEB: Loaded 50711 existing records from primary storage. [2025-09-17T21:01:41.609320] [INFO ] [MAIN ] PEB: Loaded 50711 existing records. [2025-09-17T21:01:41.789365] [WARN ] [MAIN ] PEB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:01:41.789613] [INFO ] [MAIN ] PEB: Wiping existing primary data before full refresh. [2025-09-17T21:01:41.789678] [INFO ] [LOCAL ] PEB: Starting deletion of primary data. [2025-09-17T21:01:41.791016] [DEBUG] [LOCAL ] PEB: Deleted primary data file. [2025-09-17T21:01:41.791068] [INFO ] [MAIN ] PEB: Starting full primary refresh. [2025-09-17T21:01:42.024151] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-03. [2025-09-17T21:01:42.157281] [INFO ] [REMOTE ] PEB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:01:42.233693] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T21:01:42.815783] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-07. [2025-09-17T21:01:43.322743] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T21:01:43.615816] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-11. [2025-09-17T21:01:43.868084] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T21:01:44.415787] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-01. [2025-09-17T21:01:45.200315] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T21:01:45.215719] [INFO ] [REMOTE ] PEB: Fetching primary data for 2024-12. [2025-09-17T21:01:45.769506] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T21:01:46.015848] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-04. [2025-09-17T21:01:46.582791] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T21:01:46.815770] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-02. [2025-09-17T21:01:46.832488] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T21:01:47.615796] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-05. [2025-09-17T21:01:47.888359] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T21:01:48.415767] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-03. [2025-09-17T21:01:48.684238] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T21:01:49.215766] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-06. [2025-09-17T21:01:49.303261] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T21:01:49.947681] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T21:01:50.015805] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-08. [2025-09-17T21:01:50.815775] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-07. [2025-09-17T21:01:51.146996] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T21:01:51.615838] [INFO ] [REMOTE ] PDO: Fetching primary data for 2025-09. [2025-09-17T21:01:51.854089] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T21:01:52.415783] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-08. [2025-09-17T21:01:52.905460] [INFO ] [REMOTE ] PDO: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T21:01:52.910091] [INFO ] [REMOTE ] PDO: Full fetch complete (48252 records). [2025-09-17T21:01:52.910224] [DEBUG] [VALIDATOR ] PDO: Validating primary data. [2025-09-17T21:01:53.218973] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-04. [2025-09-17T21:01:53.337138] [DEBUG] [VALIDATOR ] PDO: All expected trading days are present. [2025-09-17T21:01:53.337759] [DEBUG] [VALIDATOR ] PDO: Primary data validation passed. [2025-09-17T21:01:53.338608] [INFO ] [MAIN ] PDO: Fetched primary data is valid. [2025-09-17T21:01:53.338683] [DEBUG] [LOCAL ] PDO: Saving primary data. [2025-09-17T21:01:53.341255] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T21:01:53.348615] [DEBUG] [LOCAL ] PDO: Trimmed 48252 records to 31940 (keeping 200 days of data) [2025-09-17T21:01:53.556310] [DEBUG] [LOCAL ] PDO: Primary data saved (31940 records). [2025-09-17T21:01:53.556469] [INFO ] [MAIN ] PDO: Full history saved. [2025-09-17T21:01:53.556564] [INFO ] [MAIN ] Update Progress: 1654/2371 symbols completed. PDO took 47.6s. Estimated remaining: 1h 44m 51s. Rate: 6.8 symbols/min [2025-09-17T21:01:53.751014] [INFO ] [MAIN ] PEG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:01:53.810308] [DEBUG] [LOCAL ] PEG: Loaded 53144 existing records from primary storage. [2025-09-17T21:01:53.810465] [INFO ] [MAIN ] PEG: Loaded 53144 existing records. [2025-09-17T21:01:53.999969] [WARN ] [MAIN ] PEG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:01:54.000240] [INFO ] [MAIN ] PEG: Wiping existing primary data before full refresh. [2025-09-17T21:01:54.000285] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-17T21:01:54.001407] [DEBUG] [LOCAL ] PEG: Deleted primary data file. [2025-09-17T21:01:54.001457] [INFO ] [MAIN ] PEG: Starting full primary refresh. [2025-09-17T21:01:54.021711] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-01. [2025-09-17T21:01:54.391985] [INFO ] [REMOTE ] PEG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:01:54.404611] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T21:01:54.815764] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-05. [2025-09-17T21:01:55.571304] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T21:01:55.615727] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-02. [2025-09-17T21:01:55.867445] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T21:01:56.415785] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-06. [2025-09-17T21:01:57.141699] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T21:01:57.215752] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-11. [2025-09-17T21:01:57.418750] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T21:01:58.015796] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-07. [2025-09-17T21:01:58.815745] [INFO ] [REMOTE ] PDT: Fetching primary data for 2025-09. [2025-09-17T21:01:58.884415] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T21:01:59.142999] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T21:01:59.615746] [INFO ] [REMOTE ] PEG: Fetching primary data for 2024-12. [2025-09-17T21:01:59.719670] [INFO ] [REMOTE ] PDT: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T21:01:59.722691] [INFO ] [REMOTE ] PDT: Full fetch complete (25265 records). [2025-09-17T21:01:59.722845] [DEBUG] [VALIDATOR ] PDT: Validating primary data. [2025-09-17T21:02:00.152225] [DEBUG] [VALIDATOR ] PDT: All expected trading days are present. [2025-09-17T21:02:00.152323] [DEBUG] [VALIDATOR ] PDT: Primary data validation passed. [2025-09-17T21:02:00.152968] [INFO ] [MAIN ] PDT: Fetched primary data is valid. [2025-09-17T21:02:00.153020] [DEBUG] [LOCAL ] PDT: Saving primary data. [2025-09-17T21:02:00.154007] [DEBUG] [LOCAL ] PDT: Trimmed 25265 records to 17595 (keeping 200 days of data) [2025-09-17T21:02:00.267434] [DEBUG] [LOCAL ] PDT: Primary data saved (17595 records). [2025-09-17T21:02:00.267597] [INFO ] [MAIN ] PDT: Full history saved. [2025-09-17T21:02:00.267705] [INFO ] [MAIN ] Update Progress: 1655/2371 symbols completed. PDT took 27.6s. Estimated remaining: 1h 44m 41s. Rate: 6.8 symbols/min [2025-09-17T21:02:00.420535] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-03. [2025-09-17T21:02:00.439109] [INFO ] [MAIN ] PEN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:02:00.471750] [DEBUG] [LOCAL ] PEN: Loaded 30797 existing records from primary storage. [2025-09-17T21:02:00.471899] [INFO ] [MAIN ] PEN: Loaded 30797 existing records. [2025-09-17T21:02:00.657968] [WARN ] [MAIN ] PEN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:02:00.658285] [INFO ] [MAIN ] PEN: Wiping existing primary data before full refresh. [2025-09-17T21:02:00.658341] [INFO ] [LOCAL ] PEN: Starting deletion of primary data. [2025-09-17T21:02:00.659005] [DEBUG] [LOCAL ] PEN: Deleted primary data file. [2025-09-17T21:02:00.659064] [INFO ] [MAIN ] PEN: Starting full primary refresh. [2025-09-17T21:02:01.037606] [INFO ] [REMOTE ] PEN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:02:01.215810] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-11. [2025-09-17T21:02:01.511591] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T21:02:01.938925] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T21:02:02.015815] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-04. [2025-09-17T21:02:02.445950] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T21:02:02.815823] [INFO ] [REMOTE ] PEN: Fetching primary data for 2024-12. [2025-09-17T21:02:03.615777] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-08. [2025-09-17T21:02:03.804542] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T21:02:03.831251] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T21:02:04.380309] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T21:02:04.415783] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-01. [2025-09-17T21:02:05.215809] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-05. [2025-09-17T21:02:05.426324] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T21:02:06.015814] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-02. [2025-09-17T21:02:06.815773] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-01. [2025-09-17T21:02:06.984517] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T21:02:07.075897] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T21:02:07.615788] [INFO ] [REMOTE ] PDX: Fetching primary data for 2025-09. [2025-09-17T21:02:08.415496] [INFO ] [REMOTE ] PDX: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T21:02:08.416580] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-06. [2025-09-17T21:02:08.420152] [INFO ] [REMOTE ] PDX: Full fetch complete (24959 records). [2025-09-17T21:02:08.420274] [DEBUG] [VALIDATOR ] PDX: Validating primary data. [2025-09-17T21:02:08.823711] [DEBUG] [VALIDATOR ] PDX: All expected trading days are present. [2025-09-17T21:02:08.823853] [DEBUG] [VALIDATOR ] PDX: Primary data validation passed. [2025-09-17T21:02:08.824494] [INFO ] [MAIN ] PDX: Fetched primary data is valid. [2025-09-17T21:02:08.824630] [DEBUG] [LOCAL ] PDX: Saving primary data. [2025-09-17T21:02:08.825971] [DEBUG] [LOCAL ] PDX: Trimmed 24959 records to 14557 (keeping 200 days of data) [2025-09-17T21:02:08.929032] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-01 (2.11 seconds). [2025-09-17T21:02:08.965624] [DEBUG] [LOCAL ] PDX: Primary data saved (14557 records). [2025-09-17T21:02:08.965817] [INFO ] [MAIN ] PDX: Full history saved. [2025-09-17T21:02:08.966003] [INFO ] [MAIN ] Update Progress: 1656/2371 symbols completed. PDX took 34.2s. Estimated remaining: 1h 44m 32s. Rate: 6.8 symbols/min [2025-09-17T21:02:09.144865] [INFO ] [MAIN ] PEO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:02:09.158913] [DEBUG] [LOCAL ] PEO: Loaded 10880 existing records from primary storage. [2025-09-17T21:02:09.159061] [INFO ] [MAIN ] PEO: Loaded 10880 existing records. [2025-09-17T21:02:09.226552] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-02. [2025-09-17T21:02:09.349045] [WARN ] [MAIN ] PEO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:02:09.349316] [INFO ] [MAIN ] PEO: Wiping existing primary data before full refresh. [2025-09-17T21:02:09.349381] [INFO ] [LOCAL ] PEO: Starting deletion of primary data. [2025-09-17T21:02:09.349776] [DEBUG] [LOCAL ] PEO: Deleted primary data file. [2025-09-17T21:02:09.349837] [INFO ] [MAIN ] PEO: Starting full primary refresh. [2025-09-17T21:02:09.737959] [INFO ] [REMOTE ] PEO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:02:09.885567] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T21:02:10.015750] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-07. [2025-09-17T21:02:10.815742] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-03. [2025-09-17T21:02:10.869354] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T21:02:11.615789] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-03. [2025-09-17T21:02:11.914329] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T21:02:12.420406] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-08. [2025-09-17T21:02:12.425269] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T21:02:13.215769] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-04. [2025-09-17T21:02:13.280418] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T21:02:14.015765] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-11. [2025-09-17T21:02:14.265244] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T21:02:14.738490] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T21:02:14.778921] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T21:02:14.815721] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-05. [2025-09-17T21:02:15.615779] [INFO ] [REMOTE ] PEO: Fetching primary data for 2024-12. [2025-09-17T21:02:16.188254] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T21:02:16.415789] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-04. [2025-09-17T21:02:16.594787] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T21:02:17.215803] [INFO ] [REMOTE ] PEB: Fetching primary data for 2025-09. [2025-09-17T21:02:18.015795] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-06. [2025-09-17T21:02:18.286674] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T21:02:18.400517] [INFO ] [REMOTE ] PEB: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T21:02:18.410425] [INFO ] [REMOTE ] PEB: Full fetch complete (72597 records). [2025-09-17T21:02:18.410689] [DEBUG] [VALIDATOR ] PEB: Validating primary data. [2025-09-17T21:02:18.820168] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-05. [2025-09-17T21:02:18.842040] [DEBUG] [VALIDATOR ] PEB: All expected trading days are present. [2025-09-17T21:02:18.842101] [DEBUG] [VALIDATOR ] PEB: Primary data validation passed. [2025-09-17T21:02:18.843119] [INFO ] [MAIN ] PEB: Fetched primary data is valid. [2025-09-17T21:02:18.843260] [DEBUG] [LOCAL ] PEB: Saving primary data. [2025-09-17T21:02:18.846815] [DEBUG] [LOCAL ] PEB: Trimmed 72597 records to 50720 (keeping 200 days of data) [2025-09-17T21:02:19.160877] [DEBUG] [LOCAL ] PEB: Primary data saved (50720 records). [2025-09-17T21:02:19.161019] [INFO ] [MAIN ] PEB: Full history saved. [2025-09-17T21:02:19.161123] [INFO ] [MAIN ] Update Progress: 1657/2371 symbols completed. PEB took 37.8s. Estimated remaining: 1h 44m 24s. Rate: 6.8 symbols/min [2025-09-17T21:02:19.338306] [INFO ] [MAIN ] PERF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:02:19.355487] [DEBUG] [LOCAL ] PERF: Loaded 14131 existing records from primary storage. [2025-09-17T21:02:19.355621] [INFO ] [MAIN ] PERF: Loaded 14131 existing records. [2025-09-17T21:02:19.545754] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T21:02:19.580421] [WARN ] [MAIN ] PERF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:02:19.581103] [INFO ] [MAIN ] PERF: Wiping existing primary data before full refresh. [2025-09-17T21:02:19.581194] [INFO ] [LOCAL ] PERF: Starting deletion of primary data. [2025-09-17T21:02:19.582100] [DEBUG] [LOCAL ] PERF: Deleted primary data file. [2025-09-17T21:02:19.582211] [INFO ] [MAIN ] PERF: Starting full primary refresh. [2025-09-17T21:02:19.620838] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-01. [2025-09-17T21:02:19.993119] [INFO ] [REMOTE ] PERF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:02:20.345618] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T21:02:20.415793] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-02. [2025-09-17T21:02:20.511073] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T21:02:21.158958] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T21:02:21.215801] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-03. [2025-09-17T21:02:22.015778] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-11. [2025-09-17T21:02:22.090720] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T21:02:22.564535] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T21:02:22.815777] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-04. [2025-09-17T21:02:23.528488] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T21:02:23.615781] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-05. [2025-09-17T21:02:24.415818] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-07. [2025-09-17T21:02:24.484567] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T21:02:25.215784] [INFO ] [REMOTE ] PERF: Fetching primary data for 2024-12. [2025-09-17T21:02:25.512691] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T21:02:26.015754] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-06. [2025-09-17T21:02:26.318155] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T21:02:26.815778] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-01. [2025-09-17T21:02:27.620839] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-06. [2025-09-17T21:02:27.644872] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T21:02:27.944234] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T21:02:28.415770] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-07. [2025-09-17T21:02:28.512050] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T21:02:29.215782] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-02. [2025-09-17T21:02:30.015792] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-07. [2025-09-17T21:02:30.121304] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T21:02:30.375825] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T21:02:30.815760] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-08. [2025-09-17T21:02:31.027187] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T21:02:31.615768] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-08. [2025-09-17T21:02:32.418197] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-08. [2025-09-17T21:02:32.424674] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T21:02:32.728112] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T21:02:33.215779] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-03. [2025-09-17T21:02:33.282431] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T21:02:34.015772] [INFO ] [REMOTE ] PEG: Fetching primary data for 2025-09. [2025-09-17T21:02:34.168887] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-03 (0.95 seconds). [2025-09-17T21:02:34.815746] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-04. [2025-09-17T21:02:34.850818] [INFO ] [REMOTE ] PEG: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T21:02:34.857354] [INFO ] [REMOTE ] PEG: Full fetch complete (76100 records). [2025-09-17T21:02:34.857516] [DEBUG] [VALIDATOR ] PEG: Validating primary data. [2025-09-17T21:02:34.858415] [FATAL] [VALIDATOR ] PEG: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:02:34.858513] [FATAL] [MAIN ] PEG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:02:34.858560] [WARN ] [MAIN ] PEG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:02:34.858603] [INFO ] [LOCAL ] PEG: Starting deletion of primary data. [2025-09-17T21:02:34.858689] [DEBUG] [LOCAL ] PEG: No primary data file found to delete. [2025-09-17T21:02:34.858734] [INFO ] [LOCAL ] PEG: Starting deletion of derivative data. [2025-09-17T21:02:34.859104] [DEBUG] [LOCAL ] PEG: Deleted derivative data file. [2025-09-17T21:02:34.859188] [INFO ] [MAIN ] Update Progress: 1658/2371 symbols completed. PEG took 41.3s. Estimated remaining: 1h 44m 18s. Rate: 6.8 symbols/min [2025-09-17T21:02:35.035310] [INFO ] [MAIN ] PEW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:02:35.035482] [DEBUG] [LOCAL ] PEW: No existing data file found in primary storage. [2025-09-17T21:02:35.035521] [WARN ] [MAIN ] PEW: No existing data found, performing full refresh instead. [2025-09-17T21:02:35.035669] [INFO ] [MAIN ] PEW: Wiping existing primary data before full refresh. [2025-09-17T21:02:35.035712] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-17T21:02:35.035754] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-17T21:02:35.035800] [INFO ] [MAIN ] PEW: Starting full primary refresh. [2025-09-17T21:02:35.410372] [INFO ] [REMOTE ] PEW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:02:35.602553] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T21:02:35.615678] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-05. [2025-09-17T21:02:36.415788] [INFO ] [REMOTE ] PEO: Fetching primary data for 2025-09. [2025-09-17T21:02:36.499232] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T21:02:37.127826] [INFO ] [REMOTE ] PEO: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T21:02:37.129849] [INFO ] [REMOTE ] PEO: Full fetch complete (16345 records). [2025-09-17T21:02:37.129926] [DEBUG] [VALIDATOR ] PEO: Validating primary data. [2025-09-17T21:02:37.220990] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-06. [2025-09-17T21:02:37.507533] [DEBUG] [VALIDATOR ] PEO: All expected trading days are present. [2025-09-17T21:02:37.507620] [DEBUG] [VALIDATOR ] PEO: Primary data validation passed. [2025-09-17T21:02:37.508130] [INFO ] [MAIN ] PEO: Fetched primary data is valid. [2025-09-17T21:02:37.508175] [DEBUG] [LOCAL ] PEO: Saving primary data. [2025-09-17T21:02:37.508733] [DEBUG] [LOCAL ] PEO: Trimmed 16345 records to 10901 (keeping 200 days of data) [2025-09-17T21:02:37.581044] [DEBUG] [LOCAL ] PEO: Primary data saved (10901 records). [2025-09-17T21:02:37.581196] [INFO ] [MAIN ] PEO: Full history saved. [2025-09-17T21:02:37.581302] [INFO ] [MAIN ] Update Progress: 1659/2371 symbols completed. PEO took 28.6s. Estimated remaining: 1h 44m 7s. Rate: 6.8 symbols/min [2025-09-17T21:02:37.763931] [INFO ] [MAIN ] PFD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:02:37.771434] [DEBUG] [LOCAL ] PFD: Loaded 5090 existing records from primary storage. [2025-09-17T21:02:37.771637] [INFO ] [MAIN ] PFD: Loaded 5090 existing records. [2025-09-17T21:02:38.003255] [WARN ] [MAIN ] PFD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:02:38.003726] [INFO ] [MAIN ] PFD: Wiping existing primary data before full refresh. [2025-09-17T21:02:38.003777] [INFO ] [LOCAL ] PFD: Starting deletion of primary data. [2025-09-17T21:02:38.004311] [DEBUG] [LOCAL ] PFD: Deleted primary data file. [2025-09-17T21:02:38.004360] [INFO ] [MAIN ] PFD: Starting full primary refresh. [2025-09-17T21:02:38.025470] [INFO ] [REMOTE ] PEN: Fetching primary data for 2025-09. [2025-09-17T21:02:38.381217] [INFO ] [REMOTE ] PFD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:02:38.441861] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T21:02:38.815786] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-11. [2025-09-17T21:02:39.086058] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:02:39.086404] [WARN ] [REMOTE ] PEW: No data returned for month 2024-11 [2025-09-17T21:02:39.223911] [INFO ] [REMOTE ] PEN: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T21:02:39.227872] [INFO ] [REMOTE ] PEN: Full fetch complete (43976 records). [2025-09-17T21:02:39.227966] [DEBUG] [VALIDATOR ] PEN: Validating primary data. [2025-09-17T21:02:39.607889] [DEBUG] [VALIDATOR ] PEN: All expected trading days are present. [2025-09-17T21:02:39.607972] [DEBUG] [VALIDATOR ] PEN: Primary data validation passed. [2025-09-17T21:02:39.608728] [INFO ] [MAIN ] PEN: Fetched primary data is valid. [2025-09-17T21:02:39.608772] [DEBUG] [LOCAL ] PEN: Saving primary data. [2025-09-17T21:02:39.609744] [DEBUG] [LOCAL ] PEN: Trimmed 43976 records to 30778 (keeping 200 days of data) [2025-09-17T21:02:39.665557] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-07. [2025-09-17T21:02:39.808436] [DEBUG] [LOCAL ] PEN: Primary data saved (30778 records). [2025-09-17T21:02:39.808592] [INFO ] [MAIN ] PEN: Full history saved. [2025-09-17T21:02:39.808723] [INFO ] [MAIN ] Update Progress: 1660/2371 symbols completed. PEN took 39.5s. Estimated remaining: 1h 43m 55s. Rate: 6.8 symbols/min [2025-09-17T21:02:39.977011] [INFO ] [MAIN ] PFE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:02:40.028587] [DEBUG] [LOCAL ] PFE: Loaded 53813 existing records from primary storage. [2025-09-17T21:02:40.028747] [INFO ] [MAIN ] PFE: Loaded 53813 existing records. [2025-09-17T21:02:40.210075] [WARN ] [MAIN ] PFE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:02:40.210320] [INFO ] [MAIN ] PFE: Wiping existing primary data before full refresh. [2025-09-17T21:02:40.210372] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-17T21:02:40.211614] [DEBUG] [LOCAL ] PFE: Deleted primary data file. [2025-09-17T21:02:40.211690] [INFO ] [MAIN ] PFE: Starting full primary refresh. [2025-09-17T21:02:40.420841] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-11. [2025-09-17T21:02:40.569900] [INFO ] [REMOTE ] PFE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:02:40.930075] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T21:02:41.215087] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T21:02:41.216995] [INFO ] [REMOTE ] PFD: Fetching primary data for 2024-12. [2025-09-17T21:02:41.884849] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T21:02:42.015798] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-11. [2025-09-17T21:02:42.815887] [INFO ] [REMOTE ] PEW: Fetching primary data for 2024-12. [2025-09-17T21:02:43.097995] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:02:43.098544] [WARN ] [REMOTE ] PEW: No data returned for month 2024-12 [2025-09-17T21:02:43.615829] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-01. [2025-09-17T21:02:43.898567] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:02:43.899069] [WARN ] [REMOTE ] PEW: No data returned for month 2025-01 [2025-09-17T21:02:44.302651] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-11 (2.29 seconds). [2025-09-17T21:02:44.415851] [INFO ] [REMOTE ] PFE: Fetching primary data for 2024-12. [2025-09-17T21:02:45.215791] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-01. [2025-09-17T21:02:45.935688] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T21:02:46.015789] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-08. [2025-09-17T21:02:46.815775] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-02. [2025-09-17T21:02:46.916262] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2024-12 (2.50 seconds). [2025-09-17T21:02:46.942304] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T21:02:47.100045] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:02:47.100500] [WARN ] [REMOTE ] PEW: No data returned for month 2025-02 [2025-09-17T21:02:47.615792] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-03. [2025-09-17T21:02:47.911764] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:02:47.912101] [WARN ] [REMOTE ] PEW: No data returned for month 2025-03 [2025-09-17T21:02:48.415796] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-02. [2025-09-17T21:02:49.153244] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T21:02:49.215794] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-03. [2025-09-17T21:02:49.720347] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T21:02:50.015831] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-04. [2025-09-17T21:02:50.330700] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:02:50.331033] [WARN ] [REMOTE ] PEW: No data returned for month 2025-04 [2025-09-17T21:02:50.815816] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-04. [2025-09-17T21:02:51.410263] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T21:02:51.615799] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-05. [2025-09-17T21:02:52.317801] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T21:02:52.415869] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-01. [2025-09-17T21:02:53.215822] [INFO ] [REMOTE ] PERF: Fetching primary data for 2025-09. [2025-09-17T21:02:53.908426] [INFO ] [REMOTE ] PERF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T21:02:53.910717] [INFO ] [REMOTE ] PERF: Full fetch complete (22023 records). [2025-09-17T21:02:53.910816] [DEBUG] [VALIDATOR ] PERF: Validating primary data. [2025-09-17T21:02:54.020143] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-05. [2025-09-17T21:02:54.308858] [DEBUG] [VALIDATOR ] PERF: All expected trading days are present. [2025-09-17T21:02:54.309022] [DEBUG] [VALIDATOR ] PERF: Primary data validation passed. [2025-09-17T21:02:54.310287] [INFO ] [MAIN ] PERF: Fetched primary data is valid. [2025-09-17T21:02:54.310374] [DEBUG] [LOCAL ] PERF: Saving primary data. [2025-09-17T21:02:54.311718] [DEBUG] [LOCAL ] PERF: Trimmed 22023 records to 14091 (keeping 200 days of data) [2025-09-17T21:02:54.349863] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:02:54.378731] [WARN ] [REMOTE ] PEW: No data returned for month 2025-05 [2025-09-17T21:02:54.405732] [DEBUG] [LOCAL ] PERF: Primary data saved (14091 records). [2025-09-17T21:02:54.405951] [INFO ] [MAIN ] PERF: Full history saved. [2025-09-17T21:02:54.406080] [INFO ] [MAIN ] Update Progress: 1661/2371 symbols completed. PERF took 35.2s. Estimated remaining: 1h 43m 49s. Rate: 6.8 symbols/min [2025-09-17T21:02:54.579906] [INFO ] [MAIN ] PFGC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:02:54.630512] [DEBUG] [LOCAL ] PFGC: Loaded 47003 existing records from primary storage. [2025-09-17T21:02:54.630761] [INFO ] [MAIN ] PFGC: Loaded 47003 existing records. [2025-09-17T21:02:54.820482] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-06. [2025-09-17T21:02:54.856232] [WARN ] [MAIN ] PFGC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:02:54.856838] [INFO ] [MAIN ] PFGC: Wiping existing primary data before full refresh. [2025-09-17T21:02:54.856992] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-17T21:02:54.858361] [DEBUG] [LOCAL ] PFGC: Deleted primary data file. [2025-09-17T21:02:54.858425] [INFO ] [MAIN ] PFGC: Starting full primary refresh. [2025-09-17T21:02:55.284242] [INFO ] [REMOTE ] PFGC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:02:55.304026] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-01 (2.89 seconds). [2025-09-17T21:02:55.471202] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T21:02:55.615815] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-07. [2025-09-17T21:02:56.415869] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-02. [2025-09-17T21:02:56.486958] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T21:02:57.215865] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-08. [2025-09-17T21:02:57.923549] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T21:02:58.015864] [INFO ] [REMOTE ] PFD: Fetching primary data for 2025-09. [2025-09-17T21:02:58.815874] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-06. [2025-09-17T21:02:59.018327] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-17T21:02:59.036683] [INFO ] [REMOTE ] PFD: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T21:02:59.038718] [INFO ] [REMOTE ] PFD: Full fetch complete (7318 records). [2025-09-17T21:02:59.038814] [DEBUG] [VALIDATOR ] PFD: Validating primary data. [2025-09-17T21:02:59.136510] [DEBUG] [REMOTE ] PEW: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:02:59.149191] [WARN ] [REMOTE ] PEW: No data returned for month 2025-06 [2025-09-17T21:02:59.447511] [DEBUG] [VALIDATOR ] PFD: All expected trading days are present. [2025-09-17T21:02:59.447598] [DEBUG] [VALIDATOR ] PFD: Primary data validation passed. [2025-09-17T21:02:59.447825] [INFO ] [MAIN ] PFD: Fetched primary data is valid. [2025-09-17T21:02:59.447867] [DEBUG] [LOCAL ] PFD: Saving primary data. [2025-09-17T21:02:59.448296] [DEBUG] [LOCAL ] PFD: Trimmed 7318 records to 5137 (keeping 200 days of data) [2025-09-17T21:02:59.482655] [DEBUG] [LOCAL ] PFD: Primary data saved (5137 records). [2025-09-17T21:02:59.482791] [INFO ] [MAIN ] PFD: Full history saved. [2025-09-17T21:02:59.482904] [INFO ] [MAIN ] Update Progress: 1662/2371 symbols completed. PFD took 21.9s. Estimated remaining: 1h 43m 39s. Rate: 6.8 symbols/min [2025-09-17T21:02:59.621159] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-03. [2025-09-17T21:02:59.676263] [INFO ] [MAIN ] PFH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:02:59.685670] [DEBUG] [LOCAL ] PFH: Loaded 6959 existing records from primary storage. [2025-09-17T21:02:59.685879] [INFO ] [MAIN ] PFH: Loaded 6959 existing records. [2025-09-17T21:02:59.872657] [WARN ] [MAIN ] PFH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:02:59.872926] [INFO ] [MAIN ] PFH: Wiping existing primary data before full refresh. [2025-09-17T21:02:59.872971] [INFO ] [LOCAL ] PFH: Starting deletion of primary data. [2025-09-17T21:02:59.873267] [DEBUG] [LOCAL ] PFH: Deleted primary data file. [2025-09-17T21:02:59.873310] [INFO ] [MAIN ] PFH: Starting full primary refresh. [2025-09-17T21:03:00.246798] [INFO ] [REMOTE ] PFH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:03:00.415811] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-11. [2025-09-17T21:03:01.215815] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-07. [2025-09-17T21:03:01.265623] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T21:03:02.015835] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-11. [2025-09-17T21:03:02.726513] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-03 (3.11 seconds). [2025-09-17T21:03:02.815800] [INFO ] [REMOTE ] PFH: Fetching primary data for 2024-12. [2025-09-17T21:03:03.330481] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T21:03:03.615802] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-08. [2025-09-17T21:03:04.415931] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-04. [2025-09-17T21:03:04.703080] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2024-11 (2.69 seconds). [2025-09-17T21:03:04.745401] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T21:03:05.215786] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-01. [2025-09-17T21:03:05.682282] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T21:03:06.015783] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2024-12. [2025-09-17T21:03:06.061771] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-01 (0.85 seconds). [2025-09-17T21:03:06.118730] [DEBUG] [REMOTE ] PFGC: Error fetching primary data for 2024-12: 'API call returned an empty response.' [2025-09-17T21:03:06.119038] [WARN ] [REMOTE ] PFGC: No data returned for month 2024-12 [2025-09-17T21:03:06.735337] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-17T21:03:06.815764] [INFO ] [REMOTE ] PEW: Fetching primary data for 2025-09. [2025-09-17T21:03:07.615796] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-05. [2025-09-17T21:03:08.082017] [INFO ] [REMOTE ] PEW: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T21:03:08.086991] [INFO ] [REMOTE ] PEW: Full fetch complete (14394 records). [2025-09-17T21:03:08.087076] [DEBUG] [VALIDATOR ] PEW: Validating primary data. [2025-09-17T21:03:08.267529] [WARN ] [VALIDATOR ] PEW: Validation failed - insufficient historical data. Have 45 unique days, need 200 days [2025-09-17T21:03:08.267819] [FATAL] [MAIN ] PEW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:03:08.267870] [WARN ] [MAIN ] PEW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:03:08.267949] [INFO ] [LOCAL ] PEW: Starting deletion of primary data. [2025-09-17T21:03:08.268008] [DEBUG] [LOCAL ] PEW: No primary data file found to delete. [2025-09-17T21:03:08.268044] [INFO ] [LOCAL ] PEW: Starting deletion of derivative data. [2025-09-17T21:03:08.268083] [DEBUG] [LOCAL ] PEW: No derivative data file found to delete. [2025-09-17T21:03:08.268141] [INFO ] [MAIN ] Update Progress: 1663/2371 symbols completed. PEW took 33.4s. Estimated remaining: 1h 43m 30s. Rate: 6.8 symbols/min [2025-09-17T21:03:08.415832] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-02. [2025-09-17T21:03:08.437943] [INFO ] [MAIN ] PFL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:03:08.453746] [DEBUG] [LOCAL ] PFL: Loaded 13859 existing records from primary storage. [2025-09-17T21:03:08.453952] [INFO ] [MAIN ] PFL: Loaded 13859 existing records. [2025-09-17T21:03:08.634499] [WARN ] [MAIN ] PFL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:03:08.634776] [INFO ] [MAIN ] PFL: Wiping existing primary data before full refresh. [2025-09-17T21:03:08.634823] [INFO ] [LOCAL ] PFL: Starting deletion of primary data. [2025-09-17T21:03:08.635230] [DEBUG] [LOCAL ] PFL: Deleted primary data file. [2025-09-17T21:03:08.635274] [INFO ] [MAIN ] PFL: Starting full primary refresh. [2025-09-17T21:03:08.991745] [INFO ] [REMOTE ] PFL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:03:09.114564] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T21:03:09.215876] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-03. [2025-09-17T21:03:09.742734] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-03 (0.53 seconds). [2025-09-17T21:03:10.015775] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-01. [2025-09-17T21:03:10.056084] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-05 (2.44 seconds). [2025-09-17T21:03:10.815786] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-06. [2025-09-17T21:03:11.615803] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-11. [2025-09-17T21:03:12.244329] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-01 (2.23 seconds). [2025-09-17T21:03:12.415774] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-02. [2025-09-17T21:03:12.882491] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T21:03:13.215745] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-04. [2025-09-17T21:03:13.365945] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-06 (2.55 seconds). [2025-09-17T21:03:13.863470] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T21:03:14.015822] [INFO ] [REMOTE ] PFL: Fetching primary data for 2024-12. [2025-09-17T21:03:14.057316] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T21:03:14.815800] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-05. [2025-09-17T21:03:15.032731] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T21:03:15.615816] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-01. [2025-09-17T21:03:15.624917] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T21:03:16.415805] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-06. [2025-09-17T21:03:16.728999] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T21:03:17.216163] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-03. [2025-09-17T21:03:17.217810] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T21:03:18.015789] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-07. [2025-09-17T21:03:18.703858] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-07 (0.69 seconds). [2025-09-17T21:03:18.815743] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-02. [2025-09-17T21:03:18.910396] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T21:03:19.615775] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-04. [2025-09-17T21:03:19.844979] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T21:03:20.415772] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-03. [2025-09-17T21:03:21.215789] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-07. [2025-09-17T21:03:21.276926] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T21:03:21.399351] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T21:03:22.015811] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-08. [2025-09-17T21:03:22.710862] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T21:03:22.815774] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-04. [2025-09-17T21:03:23.459591] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-17T21:03:23.615803] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-08. [2025-09-17T21:03:23.903395] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T21:03:24.415796] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-05. [2025-09-17T21:03:25.132626] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T21:03:25.215735] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-06. [2025-09-17T21:03:26.015790] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-05. [2025-09-17T21:03:26.090310] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T21:03:26.374984] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-08 (2.76 seconds). [2025-09-17T21:03:26.815770] [INFO ] [REMOTE ] PFE: Fetching primary data for 2025-09. [2025-09-17T21:03:27.402208] [INFO ] [REMOTE ] PFE: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T21:03:27.408662] [INFO ] [REMOTE ] PFE: Full fetch complete (77584 records). [2025-09-17T21:03:27.408806] [DEBUG] [VALIDATOR ] PFE: Validating primary data. [2025-09-17T21:03:27.409738] [FATAL] [VALIDATOR ] PFE: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:03:27.409825] [FATAL] [MAIN ] PFE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:03:27.409863] [WARN ] [MAIN ] PFE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:03:27.409902] [INFO ] [LOCAL ] PFE: Starting deletion of primary data. [2025-09-17T21:03:27.409961] [DEBUG] [LOCAL ] PFE: No primary data file found to delete. [2025-09-17T21:03:27.409997] [INFO ] [LOCAL ] PFE: Starting deletion of derivative data. [2025-09-17T21:03:27.410298] [DEBUG] [LOCAL ] PFE: Deleted derivative data file. [2025-09-17T21:03:27.410384] [INFO ] [MAIN ] Update Progress: 1664/2371 symbols completed. PFE took 47.6s. Estimated remaining: 1h 43m 26s. Rate: 6.8 symbols/min [2025-09-17T21:03:27.579874] [INFO ] [MAIN ] PFLT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:03:27.620160] [INFO ] [REMOTE ] PFH: Fetching primary data for 2025-09. [2025-09-17T21:03:27.622079] [DEBUG] [LOCAL ] PFLT: Loaded 43664 existing records from primary storage. [2025-09-17T21:03:27.622239] [INFO ] [MAIN ] PFLT: Loaded 43664 existing records. [2025-09-17T21:03:27.810399] [WARN ] [MAIN ] PFLT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:03:27.810843] [INFO ] [MAIN ] PFLT: Wiping existing primary data before full refresh. [2025-09-17T21:03:27.810941] [INFO ] [LOCAL ] PFLT: Starting deletion of primary data. [2025-09-17T21:03:27.811915] [DEBUG] [LOCAL ] PFLT: Deleted primary data file. [2025-09-17T21:03:27.811966] [INFO ] [MAIN ] PFLT: Starting full primary refresh. [2025-09-17T21:03:28.169015] [INFO ] [REMOTE ] PFH: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T21:03:28.205444] [INFO ] [REMOTE ] PFLT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:03:28.205522] [INFO ] [REMOTE ] PFH: Full fetch complete (10776 records). [2025-09-17T21:03:28.207671] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-05 (2.19 seconds). [2025-09-17T21:03:28.208057] [DEBUG] [VALIDATOR ] PFH: Validating primary data. [2025-09-17T21:03:28.420824] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-11. [2025-09-17T21:03:28.582700] [DEBUG] [VALIDATOR ] PFH: All expected trading days are present. [2025-09-17T21:03:28.582777] [DEBUG] [VALIDATOR ] PFH: Primary data validation passed. [2025-09-17T21:03:28.583034] [INFO ] [MAIN ] PFH: Fetched primary data is valid. [2025-09-17T21:03:28.583071] [DEBUG] [LOCAL ] PFH: Saving primary data. [2025-09-17T21:03:28.583513] [DEBUG] [LOCAL ] PFH: Trimmed 10776 records to 6956 (keeping 200 days of data) [2025-09-17T21:03:28.626990] [DEBUG] [LOCAL ] PFH: Primary data saved (6956 records). [2025-09-17T21:03:28.627109] [INFO ] [MAIN ] PFH: Full history saved. [2025-09-17T21:03:28.627194] [INFO ] [MAIN ] Update Progress: 1665/2371 symbols completed. PFH took 29.1s. Estimated remaining: 1h 43m 14s. Rate: 6.8 symbols/min [2025-09-17T21:03:28.797826] [INFO ] [MAIN ] PFN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:03:28.819029] [DEBUG] [LOCAL ] PFN: Loaded 21775 existing records from primary storage. [2025-09-17T21:03:28.819166] [INFO ] [MAIN ] PFN: Loaded 21775 existing records. [2025-09-17T21:03:29.006486] [WARN ] [MAIN ] PFN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:03:29.006755] [INFO ] [MAIN ] PFN: Wiping existing primary data before full refresh. [2025-09-17T21:03:29.006805] [INFO ] [LOCAL ] PFN: Starting deletion of primary data. [2025-09-17T21:03:29.007384] [DEBUG] [LOCAL ] PFN: Deleted primary data file. [2025-09-17T21:03:29.007432] [INFO ] [MAIN ] PFN: Starting full primary refresh. [2025-09-17T21:03:29.220961] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-07. [2025-09-17T21:03:29.371213] [INFO ] [REMOTE ] PFN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:03:29.811134] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T21:03:30.015821] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-11. [2025-09-17T21:03:30.084847] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T21:03:30.815790] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-08. [2025-09-17T21:03:31.294310] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T21:03:31.615756] [INFO ] [REMOTE ] PFN: Fetching primary data for 2024-12. [2025-09-17T21:03:31.703119] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T21:03:32.415763] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2024-12. [2025-09-17T21:03:32.820904] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T21:03:33.215793] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-06. [2025-09-17T21:03:34.015781] [INFO ] [REMOTE ] PFL: Fetching primary data for 2025-09. [2025-09-17T21:03:34.137193] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T21:03:34.628003] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T21:03:34.708097] [INFO ] [REMOTE ] PFL: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T21:03:34.710852] [INFO ] [REMOTE ] PFL: Full fetch complete (20231 records). [2025-09-17T21:03:34.710961] [DEBUG] [VALIDATOR ] PFL: Validating primary data. [2025-09-17T21:03:34.818962] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-01. [2025-09-17T21:03:35.089044] [DEBUG] [VALIDATOR ] PFL: All expected trading days are present. [2025-09-17T21:03:35.089129] [DEBUG] [VALIDATOR ] PFL: Primary data validation passed. [2025-09-17T21:03:35.089589] [INFO ] [MAIN ] PFL: Fetched primary data is valid. [2025-09-17T21:03:35.089638] [DEBUG] [LOCAL ] PFL: Saving primary data. [2025-09-17T21:03:35.090260] [DEBUG] [LOCAL ] PFL: Trimmed 20231 records to 13840 (keeping 200 days of data) [2025-09-17T21:03:35.173927] [DEBUG] [LOCAL ] PFL: Primary data saved (13840 records). [2025-09-17T21:03:35.174086] [INFO ] [MAIN ] PFL: Full history saved. [2025-09-17T21:03:35.174181] [INFO ] [MAIN ] Update Progress: 1666/2371 symbols completed. PFL took 26.9s. Estimated remaining: 1h 43m 4s. Rate: 6.8 symbols/min [2025-09-17T21:03:35.343754] [INFO ] [MAIN ] PFO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:03:35.351081] [DEBUG] [LOCAL ] PFO: Loaded 5667 existing records from primary storage. [2025-09-17T21:03:35.351252] [INFO ] [MAIN ] PFO: Loaded 5667 existing records. [2025-09-17T21:03:35.530571] [WARN ] [MAIN ] PFO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:03:35.530840] [INFO ] [MAIN ] PFO: Wiping existing primary data before full refresh. [2025-09-17T21:03:35.530888] [INFO ] [LOCAL ] PFO: Starting deletion of primary data. [2025-09-17T21:03:35.531215] [DEBUG] [LOCAL ] PFO: Deleted primary data file. [2025-09-17T21:03:35.531264] [INFO ] [MAIN ] PFO: Starting full primary refresh. [2025-09-17T21:03:35.620925] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-01. [2025-09-17T21:03:35.896684] [INFO ] [REMOTE ] PFO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:03:36.151742] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T21:03:36.415780] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-02. [2025-09-17T21:03:36.722759] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T21:03:37.215799] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-02. [2025-09-17T21:03:38.020922] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-07. [2025-09-17T21:03:38.039118] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T21:03:38.163886] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T21:03:38.815864] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-03. [2025-09-17T21:03:39.411587] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T21:03:39.615794] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-08. [2025-09-17T21:03:40.419755] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-11. [2025-09-17T21:03:40.432867] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T21:03:40.904619] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T21:03:41.215797] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-03. [2025-09-17T21:03:41.260379] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T21:03:42.015825] [INFO ] [REMOTE ] PFGC: Fetching primary data for 2025-09. [2025-09-17T21:03:42.349586] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T21:03:42.815863] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-04. [2025-09-17T21:03:43.623287] [INFO ] [REMOTE ] PFO: Fetching primary data for 2024-12. [2025-09-17T21:03:43.625872] [INFO ] [REMOTE ] PFGC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T21:03:43.632902] [INFO ] [REMOTE ] PFGC: Full fetch complete (60712 records). [2025-09-17T21:03:43.633072] [DEBUG] [VALIDATOR ] PFGC: Validating primary data. [2025-09-17T21:03:43.834266] [WARN ] [VALIDATOR ] PFGC: Validation failed - insufficient historical data. Have 179 unique days, need 200 days [2025-09-17T21:03:43.835099] [FATAL] [MAIN ] PFGC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:03:43.835173] [WARN ] [MAIN ] PFGC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:03:43.835226] [INFO ] [LOCAL ] PFGC: Starting deletion of primary data. [2025-09-17T21:03:43.835310] [DEBUG] [LOCAL ] PFGC: No primary data file found to delete. [2025-09-17T21:03:43.835350] [INFO ] [LOCAL ] PFGC: Starting deletion of derivative data. [2025-09-17T21:03:43.835697] [DEBUG] [LOCAL ] PFGC: Deleted derivative data file. [2025-09-17T21:03:43.835825] [INFO ] [MAIN ] Update Progress: 1667/2371 symbols completed. PFGC took 49.4s. Estimated remaining: 1h 42m 55s. Rate: 6.8 symbols/min [2025-09-17T21:03:44.018546] [INFO ] [MAIN ] PFS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:03:44.057976] [DEBUG] [LOCAL ] PFS: Loaded 35764 existing records from primary storage. [2025-09-17T21:03:44.058144] [INFO ] [MAIN ] PFS: Loaded 35764 existing records. [2025-09-17T21:03:44.242868] [WARN ] [MAIN ] PFS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:03:44.243151] [INFO ] [MAIN ] PFS: Wiping existing primary data before full refresh. [2025-09-17T21:03:44.243200] [INFO ] [LOCAL ] PFS: Starting deletion of primary data. [2025-09-17T21:03:44.244065] [DEBUG] [LOCAL ] PFS: Deleted primary data file. [2025-09-17T21:03:44.244127] [INFO ] [MAIN ] PFS: Starting full primary refresh. [2025-09-17T21:03:44.428175] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-04. [2025-09-17T21:03:44.523604] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T21:03:44.668216] [INFO ] [REMOTE ] PFS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:03:44.698499] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T21:03:45.215786] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-11. [2025-09-17T21:03:45.689143] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T21:03:46.015784] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-01. [2025-09-17T21:03:46.644500] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T21:03:46.679551] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T21:03:46.815780] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-05. [2025-09-17T21:03:47.615803] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-02. [2025-09-17T21:03:48.119843] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T21:03:48.254116] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T21:03:48.415791] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-03. [2025-09-17T21:03:49.068706] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T21:03:49.215834] [INFO ] [REMOTE ] PFS: Fetching primary data for 2024-12. [2025-09-17T21:03:50.015878] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-04. [2025-09-17T21:03:50.426024] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T21:03:50.625604] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T21:03:50.815789] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-01. [2025-09-17T21:03:51.615787] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-06. [2025-09-17T21:03:52.317767] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T21:03:52.415807] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-05. [2025-09-17T21:03:52.912736] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T21:03:53.215814] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-06. [2025-09-17T21:03:53.252542] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T21:03:53.838871] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T21:03:54.015801] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-07. [2025-09-17T21:03:54.815791] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-05. [2025-09-17T21:03:55.460670] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T21:03:55.615757] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-02. [2025-09-17T21:03:56.008892] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T21:03:56.415791] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-06. [2025-09-17T21:03:56.746333] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T21:03:57.215824] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-07. [2025-09-17T21:03:57.561829] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T21:03:57.683281] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T21:03:58.015836] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-08. [2025-09-17T21:03:58.815793] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-03. [2025-09-17T21:03:59.392760] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T21:03:59.615790] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-07. [2025-09-17T21:04:00.368016] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T21:04:00.415726] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-04. [2025-09-17T21:04:00.673260] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T21:04:01.215799] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-08. [2025-09-17T21:04:01.832216] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T21:04:02.015947] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-08. [2025-09-17T21:04:02.115705] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T21:04:02.503351] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T21:04:02.815839] [INFO ] [REMOTE ] PFLT: Fetching primary data for 2025-09. [2025-09-17T21:04:03.615797] [INFO ] [REMOTE ] PFN: Fetching primary data for 2025-09. [2025-09-17T21:04:04.415798] [INFO ] [REMOTE ] PFO: Fetching primary data for 2025-09. [2025-09-17T21:04:04.483186] [INFO ] [REMOTE ] PFLT: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T21:04:04.499072] [INFO ] [REMOTE ] PFN: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T21:04:04.499282] [INFO ] [REMOTE ] PFLT: Full fetch complete (63076 records). [2025-09-17T21:04:04.502574] [DEBUG] [VALIDATOR ] PFLT: Validating primary data. [2025-09-17T21:04:04.502848] [INFO ] [REMOTE ] PFN: Full fetch complete (30616 records). [2025-09-17T21:04:04.502953] [DEBUG] [VALIDATOR ] PFN: Validating primary data. [2025-09-17T21:04:05.174049] [INFO ] [REMOTE ] PFO: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T21:04:05.184022] [INFO ] [REMOTE ] PFO: Full fetch complete (7696 records). [2025-09-17T21:04:05.219587] [DEBUG] [VALIDATOR ] PFO: Validating primary data. [2025-09-17T21:04:05.219432] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-05. [2025-09-17T21:04:05.307506] [DEBUG] [VALIDATOR ] PFLT: All expected trading days are present. [2025-09-17T21:04:05.351001] [DEBUG] [VALIDATOR ] PFLT: Primary data validation passed. [2025-09-17T21:04:05.391884] [INFO ] [MAIN ] PFLT: Fetched primary data is valid. [2025-09-17T21:04:05.436026] [DEBUG] [LOCAL ] PFLT: Saving primary data. [2025-09-17T21:04:05.440246] [DEBUG] [VALIDATOR ] PFN: All expected trading days are present. [2025-09-17T21:04:05.440752] [DEBUG] [VALIDATOR ] PFN: Primary data validation passed. [2025-09-17T21:04:05.441171] [INFO ] [MAIN ] PFN: Fetched primary data is valid. [2025-09-17T21:04:05.441558] [DEBUG] [LOCAL ] PFN: Saving primary data. [2025-09-17T21:04:05.504252] [DEBUG] [LOCAL ] PFN: Trimmed 30616 records to 21736 (keeping 200 days of data) [2025-09-17T21:04:05.520501] [DEBUG] [LOCAL ] PFLT: Trimmed 63076 records to 43677 (keeping 200 days of data) [2025-09-17T21:04:05.923278] [DEBUG] [VALIDATOR ] PFO: All expected trading days are present. [2025-09-17T21:04:05.924865] [DEBUG] [VALIDATOR ] PFO: Primary data validation passed. [2025-09-17T21:04:05.927915] [INFO ] [MAIN ] PFO: Fetched primary data is valid. [2025-09-17T21:04:05.928660] [DEBUG] [LOCAL ] PFO: Saving primary data. [2025-09-17T21:04:05.933322] [DEBUG] [LOCAL ] PFO: Trimmed 7696 records to 5773 (keeping 200 days of data) [2025-09-17T21:04:06.010839] [DEBUG] [LOCAL ] PFO: Primary data saved (5773 records). [2025-09-17T21:04:06.012190] [INFO ] [MAIN ] PFO: Full history saved. [2025-09-17T21:04:06.014596] [INFO ] [MAIN ] Update Progress: 1668/2371 symbols completed. PFO took 30.8s. Estimated remaining: 1h 42m 52s. Rate: 6.8 symbols/min [2025-09-17T21:04:06.155746] [DEBUG] [LOCAL ] PFN: Primary data saved (21736 records). [2025-09-17T21:04:06.159159] [INFO ] [MAIN ] PFN: Full history saved. [2025-09-17T21:04:06.159308] [INFO ] [MAIN ] Update Progress: 1669/2371 symbols completed. PFN took 37.5s. Estimated remaining: 1h 42m 40s. Rate: 6.8 symbols/min [2025-09-17T21:04:06.449009] [INFO ] [MAIN ] PFSI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:04:06.535549] [INFO ] [MAIN ] PG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:04:06.605812] [DEBUG] [LOCAL ] PFLT: Primary data saved (43677 records). [2025-09-17T21:04:06.615677] [INFO ] [MAIN ] PFLT: Full history saved. [2025-09-17T21:04:06.615874] [INFO ] [MAIN ] Update Progress: 1670/2371 symbols completed. PFLT took 39.2s. Estimated remaining: 1h 42m 27s. Rate: 6.8 symbols/min [2025-09-17T21:04:06.628498] [DEBUG] [LOCAL ] PFSI: Loaded 28599 existing records from primary storage. [2025-09-17T21:04:06.654294] [INFO ] [MAIN ] PFSI: Loaded 28599 existing records. [2025-09-17T21:04:06.934341] [INFO ] [MAIN ] PGP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:04:06.941083] [DEBUG] [LOCAL ] PG: Loaded 53752 existing records from primary storage. [2025-09-17T21:04:06.958393] [INFO ] [MAIN ] PG: Loaded 53752 existing records. [2025-09-17T21:04:07.042002] [WARN ] [MAIN ] PFSI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:04:07.099440] [INFO ] [MAIN ] PFSI: Wiping existing primary data before full refresh. [2025-09-17T21:04:07.110179] [INFO ] [LOCAL ] PFSI: Starting deletion of primary data. [2025-09-17T21:04:07.123875] [DEBUG] [LOCAL ] PGP: Loaded 5459 existing records from primary storage. [2025-09-17T21:04:07.130696] [INFO ] [MAIN ] PGP: Loaded 5459 existing records. [2025-09-17T21:04:07.163422] [DEBUG] [LOCAL ] PFSI: Deleted primary data file. [2025-09-17T21:04:07.194664] [INFO ] [MAIN ] PFSI: Starting full primary refresh. [2025-09-17T21:04:07.329334] [WARN ] [MAIN ] PG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:04:07.440562] [INFO ] [MAIN ] PG: Wiping existing primary data before full refresh. [2025-09-17T21:04:07.507764] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-17T21:04:07.579580] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-17T21:04:07.550460] [WARN ] [MAIN ] PGP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:04:07.627226] [DEBUG] [LOCAL ] PG: Deleted primary data file. [2025-09-17T21:04:07.656413] [INFO ] [MAIN ] PGP: Wiping existing primary data before full refresh. [2025-09-17T21:04:07.637577] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-06. [2025-09-17T21:04:07.661691] [INFO ] [LOCAL ] PGP: Starting deletion of primary data. [2025-09-17T21:04:07.656359] [INFO ] [MAIN ] PG: Starting full primary refresh. [2025-09-17T21:04:07.693498] [DEBUG] [LOCAL ] PGP: Deleted primary data file. [2025-09-17T21:04:07.713451] [INFO ] [MAIN ] PGP: Starting full primary refresh. [2025-09-17T21:04:08.041983] [INFO ] [REMOTE ] PFSI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:04:08.171906] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-11. [2025-09-17T21:04:08.555426] [INFO ] [REMOTE ] PG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:04:08.559164] [INFO ] [REMOTE ] PGP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:04:08.559500] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-11. [2025-09-17T21:04:08.559782] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-11. [2025-09-17T21:04:09.281703] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T21:04:09.289684] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-07. [2025-09-17T21:04:09.305620] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T21:04:09.337059] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-11 (0.78 seconds). [2025-09-17T21:04:10.015796] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2024-12. [2025-09-17T21:04:10.779002] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T21:04:10.816443] [INFO ] [REMOTE ] PG: Fetching primary data for 2024-12. [2025-09-17T21:04:10.830793] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T21:04:11.206987] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T21:04:11.615777] [INFO ] [REMOTE ] PGP: Fetching primary data for 2024-12. [2025-09-17T21:04:12.111444] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T21:04:12.415774] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-08. [2025-09-17T21:04:12.586248] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T21:04:13.215766] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-01. [2025-09-17T21:04:13.559574] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T21:04:14.015788] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-01. [2025-09-17T21:04:14.815786] [INFO ] [REMOTE ] PFS: Fetching primary data for 2025-09. [2025-09-17T21:04:15.346414] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-01 (2.13 seconds). [2025-09-17T21:04:15.383070] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T21:04:15.615773] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-02. [2025-09-17T21:04:15.803742] [INFO ] [REMOTE ] PFS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T21:04:15.808464] [INFO ] [REMOTE ] PFS: Full fetch complete (51401 records). [2025-09-17T21:04:15.808589] [DEBUG] [VALIDATOR ] PFS: Validating primary data. [2025-09-17T21:04:16.195628] [DEBUG] [VALIDATOR ] PFS: All expected trading days are present. [2025-09-17T21:04:16.195766] [DEBUG] [VALIDATOR ] PFS: Primary data validation passed. [2025-09-17T21:04:16.196691] [INFO ] [MAIN ] PFS: Fetched primary data is valid. [2025-09-17T21:04:16.196745] [DEBUG] [LOCAL ] PFS: Saving primary data. [2025-09-17T21:04:16.198088] [DEBUG] [LOCAL ] PFS: Trimmed 51401 records to 35805 (keeping 200 days of data) [2025-09-17T21:04:16.415820] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-01. [2025-09-17T21:04:16.421421] [DEBUG] [LOCAL ] PFS: Primary data saved (35805 records). [2025-09-17T21:04:16.421546] [INFO ] [MAIN ] PFS: Full history saved. [2025-09-17T21:04:16.421627] [INFO ] [MAIN ] Update Progress: 1671/2371 symbols completed. PFS took 32.6s. Estimated remaining: 1h 42m 19s. Rate: 6.8 symbols/min [2025-09-17T21:04:16.593344] [INFO ] [MAIN ] PGR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:04:16.648583] [DEBUG] [LOCAL ] PGR: Loaded 52999 existing records from primary storage. [2025-09-17T21:04:16.656830] [INFO ] [MAIN ] PGR: Loaded 52999 existing records. [2025-09-17T21:04:16.722759] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T21:04:16.844369] [WARN ] [MAIN ] PGR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:04:16.844637] [INFO ] [MAIN ] PGR: Wiping existing primary data before full refresh. [2025-09-17T21:04:16.844705] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-17T21:04:16.845787] [DEBUG] [LOCAL ] PGR: Deleted primary data file. [2025-09-17T21:04:16.845847] [INFO ] [MAIN ] PGR: Starting full primary refresh. [2025-09-17T21:04:17.204758] [INFO ] [REMOTE ] PGR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:04:17.209230] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T21:04:17.215668] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-02. [2025-09-17T21:04:17.934428] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T21:04:18.015778] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-03. [2025-09-17T21:04:18.715834] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-03 (0.70 seconds). [2025-09-17T21:04:18.815743] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-04. [2025-09-17T21:04:19.615802] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-11. [2025-09-17T21:04:19.644613] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T21:04:20.415799] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-03. [2025-09-17T21:04:21.215849] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-05. [2025-09-17T21:04:21.590450] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-11 (1.97 seconds). [2025-09-17T21:04:21.629481] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-17T21:04:21.759130] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T21:04:22.015798] [INFO ] [REMOTE ] PGR: Fetching primary data for 2024-12. [2025-09-17T21:04:22.815804] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-02. [2025-09-17T21:04:23.615759] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-04. [2025-09-17T21:04:24.089971] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-17T21:04:24.415773] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-01. [2025-09-17T21:04:24.502275] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T21:04:24.833400] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T21:04:25.215765] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-03. [2025-09-17T21:04:26.015816] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-05. [2025-09-17T21:04:26.074154] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T21:04:26.815786] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-06. [2025-09-17T21:04:27.277612] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-05 (1.26 seconds). [2025-09-17T21:04:27.530175] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-17T21:04:27.548037] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T21:04:27.615718] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-04. [2025-09-17T21:04:28.415785] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-07. [2025-09-17T21:04:29.134149] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T21:04:29.215784] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-06. [2025-09-17T21:04:29.646959] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T21:04:30.015826] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-08. [2025-09-17T21:04:30.465046] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T21:04:30.757957] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T21:04:30.815735] [INFO ] [REMOTE ] PGP: Fetching primary data for 2025-09. [2025-09-17T21:04:31.412947] [INFO ] [REMOTE ] PGP: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T21:04:31.414368] [INFO ] [REMOTE ] PGP: Full fetch complete (7926 records). [2025-09-17T21:04:31.414437] [DEBUG] [VALIDATOR ] PGP: Validating primary data. [2025-09-17T21:04:31.620845] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-07. [2025-09-17T21:04:31.812604] [DEBUG] [VALIDATOR ] PGP: All expected trading days are present. [2025-09-17T21:04:31.812705] [DEBUG] [VALIDATOR ] PGP: Primary data validation passed. [2025-09-17T21:04:31.812924] [INFO ] [MAIN ] PGP: Fetched primary data is valid. [2025-09-17T21:04:31.812964] [DEBUG] [LOCAL ] PGP: Saving primary data. [2025-09-17T21:04:31.813489] [DEBUG] [LOCAL ] PGP: Trimmed 7926 records to 5420 (keeping 200 days of data) [2025-09-17T21:04:31.846740] [DEBUG] [LOCAL ] PGP: Primary data saved (5420 records). [2025-09-17T21:04:31.846876] [INFO ] [MAIN ] PGP: Full history saved. [2025-09-17T21:04:31.846962] [INFO ] [MAIN ] Update Progress: 1672/2371 symbols completed. PGP took 25.2s. Estimated remaining: 1h 42m 13s. Rate: 6.8 symbols/min [2025-09-17T21:04:32.024800] [INFO ] [MAIN ] PGRE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:04:32.071752] [DEBUG] [LOCAL ] PGRE: Loaded 46058 existing records from primary storage. [2025-09-17T21:04:32.071919] [INFO ] [MAIN ] PGRE: Loaded 46058 existing records. [2025-09-17T21:04:32.249103] [WARN ] [MAIN ] PGRE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:04:32.249351] [INFO ] [MAIN ] PGRE: Wiping existing primary data before full refresh. [2025-09-17T21:04:32.249398] [INFO ] [LOCAL ] PGRE: Starting deletion of primary data. [2025-09-17T21:04:32.250621] [DEBUG] [LOCAL ] PGRE: Deleted primary data file. [2025-09-17T21:04:32.250697] [INFO ] [MAIN ] PGRE: Starting full primary refresh. [2025-09-17T21:04:32.424046] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-02. [2025-09-17T21:04:32.610321] [INFO ] [REMOTE ] PGRE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:04:33.215780] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-05. [2025-09-17T21:04:33.254659] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T21:04:34.015745] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-08. [2025-09-17T21:04:34.188453] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T21:04:34.815804] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-03. [2025-09-17T21:04:35.387911] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T21:04:35.506135] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-05 (2.29 seconds). [2025-09-17T21:04:35.615720] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-06. [2025-09-17T21:04:36.415787] [INFO ] [REMOTE ] PFSI: Fetching primary data for 2025-09. [2025-09-17T21:04:36.621708] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T21:04:37.215763] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-04. [2025-09-17T21:04:37.479955] [INFO ] [REMOTE ] PFSI: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T21:04:37.484472] [INFO ] [REMOTE ] PFSI: Full fetch complete (40181 records). [2025-09-17T21:04:37.484578] [DEBUG] [VALIDATOR ] PFSI: Validating primary data. [2025-09-17T21:04:37.876006] [DEBUG] [VALIDATOR ] PFSI: All expected trading days are present. [2025-09-17T21:04:37.876183] [DEBUG] [VALIDATOR ] PFSI: Primary data validation passed. [2025-09-17T21:04:37.877081] [INFO ] [MAIN ] PFSI: Fetched primary data is valid. [2025-09-17T21:04:37.877176] [DEBUG] [LOCAL ] PFSI: Saving primary data. [2025-09-17T21:04:37.880025] [DEBUG] [LOCAL ] PFSI: Trimmed 40181 records to 28720 (keeping 200 days of data) [2025-09-17T21:04:38.023000] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-11. [2025-09-17T21:04:38.039412] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-17T21:04:38.121524] [DEBUG] [LOCAL ] PFSI: Primary data saved (28720 records). [2025-09-17T21:04:38.121714] [INFO ] [MAIN ] PFSI: Full history saved. [2025-09-17T21:04:38.121874] [INFO ] [MAIN ] Update Progress: 1673/2371 symbols completed. PFSI took 32.1s. Estimated remaining: 1h 42m 3s. Rate: 6.8 symbols/min [2025-09-17T21:04:38.294949] [INFO ] [MAIN ] PGZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:04:38.302591] [DEBUG] [LOCAL ] PGZ: Loaded 5424 existing records from primary storage. [2025-09-17T21:04:38.302761] [INFO ] [MAIN ] PGZ: Loaded 5424 existing records. [2025-09-17T21:04:38.485424] [WARN ] [MAIN ] PGZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:04:38.485726] [INFO ] [MAIN ] PGZ: Wiping existing primary data before full refresh. [2025-09-17T21:04:38.485774] [INFO ] [LOCAL ] PGZ: Starting deletion of primary data. [2025-09-17T21:04:38.486022] [DEBUG] [LOCAL ] PGZ: Deleted primary data file. [2025-09-17T21:04:38.486076] [INFO ] [MAIN ] PGZ: Starting full primary refresh. [2025-09-17T21:04:38.822888] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-07. [2025-09-17T21:04:38.851789] [INFO ] [REMOTE ] PGZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:04:39.314332] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T21:04:39.542724] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T21:04:39.615729] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2024-12. [2025-09-17T21:04:40.415801] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-05. [2025-09-17T21:04:41.114428] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T21:04:41.215783] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-01. [2025-09-17T21:04:41.521956] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-07 (2.70 seconds). [2025-09-17T21:04:42.015815] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-11. [2025-09-17T21:04:42.417604] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T21:04:42.552825] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T21:04:42.655889] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T21:04:42.815844] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2024-12. [2025-09-17T21:04:43.615809] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-08. [2025-09-17T21:04:43.700268] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T21:04:44.318882] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T21:04:44.415751] [INFO ] [REMOTE ] PG: Fetching primary data for 2025-09. [2025-09-17T21:04:45.215825] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-02. [2025-09-17T21:04:45.285028] [INFO ] [REMOTE ] PG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T21:04:45.293329] [INFO ] [REMOTE ] PG: Full fetch complete (77283 records). [2025-09-17T21:04:45.293567] [DEBUG] [VALIDATOR ] PG: Validating primary data. [2025-09-17T21:04:45.297155] [FATAL] [VALIDATOR ] PG: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:04:45.297287] [FATAL] [MAIN ] PG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:04:45.297340] [WARN ] [MAIN ] PG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:04:45.297392] [INFO ] [LOCAL ] PG: Starting deletion of primary data. [2025-09-17T21:04:45.297474] [DEBUG] [LOCAL ] PG: No primary data file found to delete. [2025-09-17T21:04:45.297520] [INFO ] [LOCAL ] PG: Starting deletion of derivative data. [2025-09-17T21:04:45.297884] [DEBUG] [LOCAL ] PG: Deleted derivative data file. [2025-09-17T21:04:45.298004] [INFO ] [MAIN ] Update Progress: 1674/2371 symbols completed. PG took 39.1s. Estimated remaining: 1h 41m 54s. Rate: 6.8 symbols/min [2025-09-17T21:04:45.470994] [INFO ] [MAIN ] PH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:04:45.522668] [DEBUG] [LOCAL ] PH: Loaded 39450 existing records from primary storage. [2025-09-17T21:04:45.522913] [INFO ] [MAIN ] PH: Loaded 39450 existing records. [2025-09-17T21:04:45.783947] [WARN ] [MAIN ] PH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:04:45.784264] [INFO ] [MAIN ] PH: Wiping existing primary data before full refresh. [2025-09-17T21:04:45.784314] [INFO ] [LOCAL ] PH: Starting deletion of primary data. [2025-09-17T21:04:45.785416] [DEBUG] [LOCAL ] PH: Deleted primary data file. [2025-09-17T21:04:45.785469] [INFO ] [MAIN ] PH: Starting full primary refresh. [2025-09-17T21:04:46.022930] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-01. [2025-09-17T21:04:46.150746] [INFO ] [REMOTE ] PH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:04:46.685704] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T21:04:46.815797] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-03. [2025-09-17T21:04:46.930995] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T21:04:47.615840] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-06. [2025-09-17T21:04:48.180201] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T21:04:48.415770] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-04. [2025-09-17T21:04:49.215769] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-02. [2025-09-17T21:04:49.283953] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T21:04:49.923365] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T21:04:50.016296] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-03. [2025-09-17T21:04:50.028820] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T21:04:50.767836] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T21:04:50.815820] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-05. [2025-09-17T21:04:51.615789] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-07. [2025-09-17T21:04:52.400322] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T21:04:52.415723] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-06. [2025-09-17T21:04:53.215828] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-04. [2025-09-17T21:04:53.886895] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-07 (2.27 seconds). [2025-09-17T21:04:53.887516] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T21:04:54.018242] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-08. [2025-09-17T21:04:54.025177] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T21:04:54.815847] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-05. [2025-09-17T21:04:54.871280] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T21:04:55.615811] [INFO ] [REMOTE ] PGR: Fetching primary data for 2025-09. [2025-09-17T21:04:55.676951] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T21:04:56.415918] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-06. [2025-09-17T21:04:56.440133] [INFO ] [REMOTE ] PGR: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T21:04:56.449719] [INFO ] [REMOTE ] PGR: Full fetch complete (76060 records). [2025-09-17T21:04:56.449916] [DEBUG] [VALIDATOR ] PGR: Validating primary data. [2025-09-17T21:04:56.451234] [FATAL] [VALIDATOR ] PGR: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:04:56.451386] [FATAL] [MAIN ] PGR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:04:56.451438] [WARN ] [MAIN ] PGR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:04:56.451488] [INFO ] [LOCAL ] PGR: Starting deletion of primary data. [2025-09-17T21:04:56.451559] [DEBUG] [LOCAL ] PGR: No primary data file found to delete. [2025-09-17T21:04:56.451598] [INFO ] [LOCAL ] PGR: Starting deletion of derivative data. [2025-09-17T21:04:56.452008] [DEBUG] [LOCAL ] PGR: Deleted derivative data file. [2025-09-17T21:04:56.452122] [INFO ] [MAIN ] Update Progress: 1675/2371 symbols completed. PGR took 40.0s. Estimated remaining: 1h 41m 46s. Rate: 6.8 symbols/min [2025-09-17T21:04:56.635141] [INFO ] [MAIN ] PHD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:04:56.651575] [DEBUG] [LOCAL ] PHD: Loaded 9559 existing records from primary storage. [2025-09-17T21:04:56.651782] [INFO ] [MAIN ] PHD: Loaded 9559 existing records. [2025-09-17T21:04:56.832586] [WARN ] [MAIN ] PHD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:04:56.833022] [INFO ] [MAIN ] PHD: Wiping existing primary data before full refresh. [2025-09-17T21:04:56.833071] [INFO ] [LOCAL ] PHD: Starting deletion of primary data. [2025-09-17T21:04:56.833604] [DEBUG] [LOCAL ] PHD: Deleted primary data file. [2025-09-17T21:04:56.833706] [INFO ] [MAIN ] PHD: Starting full primary refresh. [2025-09-17T21:04:57.200195] [INFO ] [REMOTE ] PHD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:04:57.215757] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-11. [2025-09-17T21:04:57.226149] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T21:04:58.015849] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-07. [2025-09-17T21:04:58.286590] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T21:04:58.477284] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T21:04:58.815835] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-08. [2025-09-17T21:04:59.615827] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-07. [2025-09-17T21:04:59.690140] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T21:05:00.415866] [INFO ] [REMOTE ] PGZ: Fetching primary data for 2025-09. [2025-09-17T21:05:01.130250] [INFO ] [REMOTE ] PGZ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T21:05:01.132047] [INFO ] [REMOTE ] PGZ: Full fetch complete (8991 records). [2025-09-17T21:05:01.132124] [DEBUG] [VALIDATOR ] PGZ: Validating primary data. [2025-09-17T21:05:01.217448] [INFO ] [REMOTE ] PHD: Fetching primary data for 2024-12. [2025-09-17T21:05:01.576135] [DEBUG] [VALIDATOR ] PGZ: All expected trading days are present. [2025-09-17T21:05:01.576334] [DEBUG] [VALIDATOR ] PGZ: Primary data validation passed. [2025-09-17T21:05:01.577140] [INFO ] [MAIN ] PGZ: Fetched primary data is valid. [2025-09-17T21:05:01.577275] [DEBUG] [LOCAL ] PGZ: Saving primary data. [2025-09-17T21:05:01.578247] [DEBUG] [LOCAL ] PGZ: Trimmed 8991 records to 5430 (keeping 200 days of data) [2025-09-17T21:05:01.651678] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T21:05:01.669323] [DEBUG] [LOCAL ] PGZ: Primary data saved (5430 records). [2025-09-17T21:05:01.669514] [INFO ] [MAIN ] PGZ: Full history saved. [2025-09-17T21:05:01.669704] [INFO ] [MAIN ] Update Progress: 1676/2371 symbols completed. PGZ took 23.5s. Estimated remaining: 1h 41m 36s. Rate: 6.8 symbols/min [2025-09-17T21:05:01.863853] [INFO ] [MAIN ] PHG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:05:01.936289] [DEBUG] [LOCAL ] PHG: Loaded 46302 existing records from primary storage. [2025-09-17T21:05:01.936567] [INFO ] [MAIN ] PHG: Loaded 46302 existing records. [2025-09-17T21:05:02.021099] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-08. [2025-09-17T21:05:02.149662] [WARN ] [MAIN ] PHG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:05:02.150767] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T21:05:02.153220] [INFO ] [MAIN ] PHG: Wiping existing primary data before full refresh. [2025-09-17T21:05:02.153287] [INFO ] [LOCAL ] PHG: Starting deletion of primary data. [2025-09-17T21:05:02.154598] [DEBUG] [LOCAL ] PHG: Deleted primary data file. [2025-09-17T21:05:02.154687] [INFO ] [MAIN ] PHG: Starting full primary refresh. [2025-09-17T21:05:02.549081] [INFO ] [REMOTE ] PHG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:05:02.815879] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-01. [2025-09-17T21:05:03.523006] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T21:05:03.615878] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-02. [2025-09-17T21:05:03.900304] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T21:05:04.348446] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T21:05:04.415863] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-03. [2025-09-17T21:05:05.160679] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T21:05:05.215817] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-04. [2025-09-17T21:05:06.015867] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-11. [2025-09-17T21:05:06.090256] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T21:05:06.815840] [INFO ] [REMOTE ] PGRE: Fetching primary data for 2025-09. [2025-09-17T21:05:07.615858] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-11. [2025-09-17T21:05:07.698912] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T21:05:08.118733] [INFO ] [REMOTE ] PGRE: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T21:05:08.125406] [INFO ] [REMOTE ] PGRE: Full fetch complete (62827 records). [2025-09-17T21:05:08.125612] [DEBUG] [VALIDATOR ] PGRE: Validating primary data. [2025-09-17T21:05:08.423455] [INFO ] [REMOTE ] PH: Fetching primary data for 2024-12. [2025-09-17T21:05:08.563401] [DEBUG] [VALIDATOR ] PGRE: All expected trading days are present. [2025-09-17T21:05:08.563544] [DEBUG] [VALIDATOR ] PGRE: Primary data validation passed. [2025-09-17T21:05:08.565209] [INFO ] [MAIN ] PGRE: Fetched primary data is valid. [2025-09-17T21:05:08.565296] [DEBUG] [LOCAL ] PGRE: Saving primary data. [2025-09-17T21:05:08.567426] [DEBUG] [LOCAL ] PGRE: Trimmed 62827 records to 46142 (keeping 200 days of data) [2025-09-17T21:05:08.879049] [DEBUG] [LOCAL ] PGRE: Primary data saved (46142 records). [2025-09-17T21:05:08.879355] [INFO ] [MAIN ] PGRE: Full history saved. [2025-09-17T21:05:08.879463] [INFO ] [MAIN ] Update Progress: 1677/2371 symbols completed. PGRE took 37.0s. Estimated remaining: 1h 41m 26s. Rate: 6.8 symbols/min [2025-09-17T21:05:09.215920] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-05. [2025-09-17T21:05:09.448750] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T21:05:09.983960] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T21:05:10.015711] [INFO ] [REMOTE ] PHG: Fetching primary data for 2024-12. [2025-09-17T21:05:10.067090] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T21:05:10.815893] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-01. [2025-09-17T21:05:11.615850] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-06. [2025-09-17T21:05:11.757154] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T21:05:12.418463] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-01. [2025-09-17T21:05:12.422450] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T21:05:12.466119] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T21:05:13.215775] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-07. [2025-09-17T21:05:13.839130] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T21:05:14.015806] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-02. [2025-09-17T21:05:14.119721] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T21:05:14.815780] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-08. [2025-09-17T21:05:15.615792] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-02. [2025-09-17T21:05:15.656788] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T21:05:15.750298] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T21:05:16.415780] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-03. [2025-09-17T21:05:17.072562] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T21:05:17.215792] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-03. [2025-09-17T21:05:18.015903] [INFO ] [REMOTE ] PHD: Fetching primary data for 2025-09. [2025-09-17T21:05:18.189864] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T21:05:18.730832] [INFO ] [REMOTE ] PHD: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T21:05:18.732783] [INFO ] [REMOTE ] PHD: Full fetch complete (13692 records). [2025-09-17T21:05:18.732853] [DEBUG] [VALIDATOR ] PHD: Validating primary data. [2025-09-17T21:05:18.825754] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-04. [2025-09-17T21:05:19.112322] [DEBUG] [VALIDATOR ] PHD: All expected trading days are present. [2025-09-17T21:05:19.112423] [DEBUG] [VALIDATOR ] PHD: Primary data validation passed. [2025-09-17T21:05:19.112927] [INFO ] [MAIN ] PHD: Fetched primary data is valid. [2025-09-17T21:05:19.112987] [DEBUG] [LOCAL ] PHD: Saving primary data. [2025-09-17T21:05:19.139790] [DEBUG] [LOCAL ] PHD: Trimmed 13692 records to 9577 (keeping 200 days of data) [2025-09-17T21:05:19.141139] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T21:05:19.206892] [DEBUG] [LOCAL ] PHD: Primary data saved (9577 records). [2025-09-17T21:05:19.207018] [INFO ] [MAIN ] PHD: Full history saved. [2025-09-17T21:05:19.207104] [INFO ] [MAIN ] Update Progress: 1678/2371 symbols completed. PHD took 22.8s. Estimated remaining: 1h 41m 18s. Rate: 6.8 symbols/min [2025-09-17T21:05:19.615778] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-04. [2025-09-17T21:05:20.449851] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T21:05:20.459459] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-05. [2025-09-17T21:05:21.056847] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T21:05:21.215779] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-05. [2025-09-17T21:05:21.953359] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T21:05:22.015785] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-06. [2025-09-17T21:05:22.872460] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T21:05:22.883573] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-06. [2025-09-17T21:05:23.708037] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T21:05:23.717463] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-07. [2025-09-17T21:05:24.179238] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T21:05:24.416141] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-07. [2025-09-17T21:05:25.316454] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T21:05:25.324378] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-08. [2025-09-17T21:05:26.226870] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T21:05:26.237423] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-08. [2025-09-17T21:05:26.770749] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-08 (1.45 seconds). [2025-09-17T21:05:26.815827] [INFO ] [REMOTE ] PH: Fetching primary data for 2025-09. [2025-09-17T21:05:28.144696] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T21:05:28.155386] [INFO ] [REMOTE ] PHG: Fetching primary data for 2025-09. [2025-09-17T21:05:28.296619] [INFO ] [REMOTE ] PH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T21:05:28.303795] [INFO ] [REMOTE ] PH: Full fetch complete (56651 records). [2025-09-17T21:05:28.304034] [DEBUG] [VALIDATOR ] PH: Validating primary data. [2025-09-17T21:05:28.707772] [DEBUG] [VALIDATOR ] PH: All expected trading days are present. [2025-09-17T21:05:28.707872] [DEBUG] [VALIDATOR ] PH: Primary data validation passed. [2025-09-17T21:05:28.708846] [INFO ] [MAIN ] PH: Fetched primary data is valid. [2025-09-17T21:05:28.708937] [DEBUG] [LOCAL ] PH: Saving primary data. [2025-09-17T21:05:28.710244] [DEBUG] [LOCAL ] PH: Trimmed 56651 records to 39455 (keeping 200 days of data) [2025-09-17T21:05:28.970667] [DEBUG] [LOCAL ] PH: Primary data saved (39455 records). [2025-09-17T21:05:28.970818] [INFO ] [MAIN ] PH: Full history saved. [2025-09-17T21:05:28.972166] [INFO ] [MAIN ] Update Progress: 1679/2371 symbols completed. PH took 43.7s. Estimated remaining: 1h 41m 10s. Rate: 6.8 symbols/min [2025-09-17T21:05:29.561490] [INFO ] [REMOTE ] PHG: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T21:05:29.567348] [INFO ] [REMOTE ] PHG: Full fetch complete (65497 records). [2025-09-17T21:05:29.567475] [DEBUG] [VALIDATOR ] PHG: Validating primary data. [2025-09-17T21:05:29.975922] [DEBUG] [VALIDATOR ] PHG: All expected trading days are present. [2025-09-17T21:05:29.976021] [DEBUG] [VALIDATOR ] PHG: Primary data validation passed. [2025-09-17T21:05:29.977753] [INFO ] [MAIN ] PHG: Fetched primary data is valid. [2025-09-17T21:05:29.977804] [DEBUG] [LOCAL ] PHG: Saving primary data. [2025-09-17T21:05:29.979304] [DEBUG] [LOCAL ] PHG: Trimmed 65497 records to 46280 (keeping 200 days of data) [2025-09-17T21:05:30.270112] [DEBUG] [LOCAL ] PHG: Primary data saved (46280 records). [2025-09-17T21:05:30.270259] [INFO ] [MAIN ] PHG: Full history saved. [2025-09-17T21:05:30.270370] [INFO ] [MAIN ] Update Progress: 1680/2371 symbols completed. PHG took 28.6s. Estimated remaining: 1h 40m 58s. Rate: 6.8 symbols/min [2025-09-17T21:05:30.851466] [INFO ] [MAIN ] PHIN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:05:30.954984] [INFO ] [MAIN ] PHI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:05:30.986588] [INFO ] [MAIN ] PHM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:05:31.035902] [INFO ] [MAIN ] PHK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:05:31.050080] [DEBUG] [LOCAL ] PHI: Loaded 14815 existing records from primary storage. [2025-09-17T21:05:31.050399] [INFO ] [MAIN ] PHI: Loaded 14815 existing records. [2025-09-17T21:05:31.292533] [DEBUG] [LOCAL ] PHIN: Loaded 33538 existing records from primary storage. [2025-09-17T21:05:31.293063] [DEBUG] [LOCAL ] PHK: Loaded 26713 existing records from primary storage. [2025-09-17T21:05:31.291194] [WARN ] [MAIN ] PHI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:05:31.293342] [INFO ] [MAIN ] PHK: Loaded 26713 existing records. [2025-09-17T21:05:31.293253] [INFO ] [MAIN ] PHIN: Loaded 33538 existing records. [2025-09-17T21:05:31.376822] [INFO ] [MAIN ] PHI: Wiping existing primary data before full refresh. [2025-09-17T21:05:31.426299] [DEBUG] [LOCAL ] PHM: Loaded 51713 existing records from primary storage. [2025-09-17T21:05:31.436739] [INFO ] [LOCAL ] PHI: Starting deletion of primary data. [2025-09-17T21:05:31.436664] [INFO ] [MAIN ] PHM: Loaded 51713 existing records. [2025-09-17T21:05:31.557099] [DEBUG] [LOCAL ] PHI: Deleted primary data file. [2025-09-17T21:05:31.632746] [INFO ] [MAIN ] PHI: Starting full primary refresh. [2025-09-17T21:05:31.817905] [WARN ] [MAIN ] PHIN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:05:31.807721] [WARN ] [MAIN ] PHK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:05:31.887833] [INFO ] [MAIN ] PHK: Wiping existing primary data before full refresh. [2025-09-17T21:05:31.927556] [INFO ] [MAIN ] PHIN: Wiping existing primary data before full refresh. [2025-09-17T21:05:31.947383] [INFO ] [LOCAL ] PHIN: Starting deletion of primary data. [2025-09-17T21:05:31.974250] [WARN ] [MAIN ] PHM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:05:31.974339] [INFO ] [LOCAL ] PHK: Starting deletion of primary data. [2025-09-17T21:05:31.975086] [INFO ] [MAIN ] PHM: Wiping existing primary data before full refresh. [2025-09-17T21:05:31.980341] [DEBUG] [LOCAL ] PHIN: Deleted primary data file. [2025-09-17T21:05:31.980410] [DEBUG] [LOCAL ] PHK: Deleted primary data file. [2025-09-17T21:05:32.001176] [INFO ] [MAIN ] PHIN: Starting full primary refresh. [2025-09-17T21:05:32.001107] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-17T21:05:32.001229] [INFO ] [MAIN ] PHK: Starting full primary refresh. [2025-09-17T21:05:32.206450] [DEBUG] [LOCAL ] PHM: Deleted primary data file. [2025-09-17T21:05:32.359021] [INFO ] [MAIN ] PHM: Starting full primary refresh. [2025-09-17T21:05:32.662204] [INFO ] [REMOTE ] PHI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:05:32.744978] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-11. [2025-09-17T21:05:33.142377] [INFO ] [REMOTE ] PHIN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:05:33.197047] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-11. [2025-09-17T21:05:33.390241] [INFO ] [REMOTE ] PHK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:05:33.420743] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-11. [2025-09-17T21:05:33.455780] [INFO ] [REMOTE ] PHM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:05:33.456277] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-11. [2025-09-17T21:05:33.788910] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T21:05:33.791883] [INFO ] [REMOTE ] PHI: Fetching primary data for 2024-12. [2025-09-17T21:05:34.401486] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T21:05:34.409450] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2024-12. [2025-09-17T21:05:34.449671] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T21:05:34.456995] [INFO ] [REMOTE ] PHK: Fetching primary data for 2024-12. [2025-09-17T21:05:34.808671] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T21:05:34.832951] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-01. [2025-09-17T21:05:35.325742] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T21:05:35.336348] [INFO ] [REMOTE ] PHM: Fetching primary data for 2024-12. [2025-09-17T21:05:35.357104] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T21:05:35.615794] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-01. [2025-09-17T21:05:35.818235] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T21:05:35.903590] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T21:05:36.415813] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-01. [2025-09-17T21:05:37.066808] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T21:05:37.215815] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-02. [2025-09-17T21:05:37.316862] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T21:05:37.454382] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T21:05:38.015800] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-02. [2025-09-17T21:05:38.101148] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T21:05:38.815883] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-02. [2025-09-17T21:05:39.552753] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T21:05:39.615817] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-03. [2025-09-17T21:05:39.806000] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T21:05:40.415777] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-01. [2025-09-17T21:05:41.215696] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-03. [2025-09-17T21:05:41.320434] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T21:05:42.015769] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-04. [2025-09-17T21:05:42.287119] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T21:05:42.474561] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T21:05:42.815826] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-02. [2025-09-17T21:05:43.502072] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T21:05:43.615776] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-05. [2025-09-17T21:05:44.415846] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-03. [2025-09-17T21:05:44.681079] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T21:05:44.714835] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T21:05:45.215886] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-06. [2025-09-17T21:05:45.562583] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T21:05:46.015964] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-03. [2025-09-17T21:05:46.141142] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T21:05:46.815836] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-04. [2025-09-17T21:05:47.517550] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T21:05:47.615820] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-04. [2025-09-17T21:05:48.295596] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T21:05:48.415815] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-04. [2025-09-17T21:05:49.215778] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-07. [2025-09-17T21:05:49.342988] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T21:05:49.496185] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T21:05:50.015795] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-05. [2025-09-17T21:05:50.453498] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T21:05:50.765805] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T21:05:50.815816] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-06. [2025-09-17T21:05:51.615778] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-05. [2025-09-17T21:05:51.850153] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T21:05:52.415787] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-07. [2025-09-17T21:05:52.663033] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T21:05:53.215781] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-05. [2025-09-17T21:05:53.413491] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T21:05:54.015791] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-08. [2025-09-17T21:05:54.815841] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-08. [2025-09-17T21:05:55.112687] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T21:05:55.170228] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T21:05:55.484909] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T21:05:55.615843] [INFO ] [REMOTE ] PHIN: Fetching primary data for 2025-09. [2025-09-17T21:05:56.415850] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-06. [2025-09-17T21:05:56.940352] [INFO ] [REMOTE ] PHIN: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T21:05:56.945939] [INFO ] [REMOTE ] PHIN: Full fetch complete (48165 records). [2025-09-17T21:05:56.946184] [DEBUG] [VALIDATOR ] PHIN: Validating primary data. [2025-09-17T21:05:57.222034] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-06. [2025-09-17T21:05:57.345448] [DEBUG] [VALIDATOR ] PHIN: All expected trading days are present. [2025-09-17T21:05:57.345583] [DEBUG] [VALIDATOR ] PHIN: Primary data validation passed. [2025-09-17T21:05:57.346889] [INFO ] [MAIN ] PHIN: Fetched primary data is valid. [2025-09-17T21:05:57.346942] [DEBUG] [LOCAL ] PHIN: Saving primary data. [2025-09-17T21:05:57.348244] [DEBUG] [LOCAL ] PHIN: Trimmed 48165 records to 33544 (keeping 200 days of data) [2025-09-17T21:05:57.509106] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T21:05:57.605527] [DEBUG] [LOCAL ] PHIN: Primary data saved (33544 records). [2025-09-17T21:05:57.605717] [INFO ] [MAIN ] PHIN: Full history saved. [2025-09-17T21:05:57.605832] [INFO ] [MAIN ] Update Progress: 1681/2371 symbols completed. PHIN took 27.3s. Estimated remaining: 1h 40m 57s. Rate: 6.8 symbols/min [2025-09-17T21:05:57.792311] [INFO ] [MAIN ] PHR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:05:57.832151] [DEBUG] [LOCAL ] PHR: Loaded 36960 existing records from primary storage. [2025-09-17T21:05:57.832309] [INFO ] [MAIN ] PHR: Loaded 36960 existing records. [2025-09-17T21:05:58.014193] [WARN ] [MAIN ] PHR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:05:58.014475] [INFO ] [MAIN ] PHR: Wiping existing primary data before full refresh. [2025-09-17T21:05:58.014522] [INFO ] [LOCAL ] PHR: Starting deletion of primary data. [2025-09-17T21:05:58.015483] [DEBUG] [LOCAL ] PHR: Deleted primary data file. [2025-09-17T21:05:58.015540] [INFO ] [MAIN ] PHR: Starting full primary refresh. [2025-09-17T21:05:58.026823] [INFO ] [REMOTE ] PHI: Fetching primary data for 2025-09. [2025-09-17T21:05:58.389408] [INFO ] [REMOTE ] PHR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:05:58.815817] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-11. [2025-09-17T21:05:58.885163] [INFO ] [REMOTE ] PHI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T21:05:58.888837] [INFO ] [REMOTE ] PHI: Full fetch complete (20549 records). [2025-09-17T21:05:58.888950] [DEBUG] [VALIDATOR ] PHI: Validating primary data. [2025-09-17T21:05:59.362760] [DEBUG] [VALIDATOR ] PHI: All expected trading days are present. [2025-09-17T21:05:59.362930] [DEBUG] [VALIDATOR ] PHI: Primary data validation passed. [2025-09-17T21:05:59.363530] [INFO ] [MAIN ] PHI: Fetched primary data is valid. [2025-09-17T21:05:59.363669] [DEBUG] [LOCAL ] PHI: Saving primary data. [2025-09-17T21:05:59.364676] [DEBUG] [LOCAL ] PHI: Trimmed 20549 records to 14878 (keeping 200 days of data) [2025-09-17T21:05:59.473760] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-06 (2.25 seconds). [2025-09-17T21:05:59.512411] [DEBUG] [LOCAL ] PHI: Primary data saved (14878 records). [2025-09-17T21:05:59.512579] [INFO ] [MAIN ] PHI: Full history saved. [2025-09-17T21:05:59.512700] [INFO ] [MAIN ] Update Progress: 1682/2371 symbols completed. PHI took 29.2s. Estimated remaining: 1h 40m 45s. Rate: 6.8 symbols/min [2025-09-17T21:05:59.619851] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-07. [2025-09-17T21:05:59.693232] [INFO ] [MAIN ] PHT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:05:59.710073] [DEBUG] [LOCAL ] PHT: Loaded 15346 existing records from primary storage. [2025-09-17T21:05:59.710359] [INFO ] [MAIN ] PHT: Loaded 15346 existing records. [2025-09-17T21:05:59.896368] [WARN ] [MAIN ] PHT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:05:59.896622] [INFO ] [MAIN ] PHT: Wiping existing primary data before full refresh. [2025-09-17T21:05:59.896689] [INFO ] [LOCAL ] PHT: Starting deletion of primary data. [2025-09-17T21:05:59.897230] [DEBUG] [LOCAL ] PHT: Deleted primary data file. [2025-09-17T21:05:59.897279] [INFO ] [MAIN ] PHT: Starting full primary refresh. [2025-09-17T21:06:00.283339] [INFO ] [REMOTE ] PHT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:06:00.312532] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T21:06:00.415875] [INFO ] [REMOTE ] PHR: Fetching primary data for 2024-12. [2025-09-17T21:06:00.905732] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T21:06:01.215888] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-08. [2025-09-17T21:06:01.691685] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T21:06:02.015810] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-07. [2025-09-17T21:06:02.815863] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-01. [2025-09-17T21:06:02.878588] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T21:06:03.615876] [INFO ] [REMOTE ] PHK: Fetching primary data for 2025-09. [2025-09-17T21:06:04.415886] [INFO ] [REMOTE ] PHT: Fetching primary data for 2024-11. [2025-09-17T21:06:05.227721] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T21:06:05.230427] [INFO ] [REMOTE ] PHT: Fetching primary data for 2024-12. [2025-09-17T21:06:05.668486] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-01 (2.85 seconds). [2025-09-17T21:06:05.733854] [INFO ] [REMOTE ] PHK: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-17T21:06:05.738995] [INFO ] [REMOTE ] PHK: Full fetch complete (39445 records). [2025-09-17T21:06:05.739314] [DEBUG] [VALIDATOR ] PHK: Validating primary data. [2025-09-17T21:06:06.022142] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-02. [2025-09-17T21:06:06.141787] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T21:06:06.159435] [DEBUG] [VALIDATOR ] PHK: All expected trading days are present. [2025-09-17T21:06:06.159605] [DEBUG] [VALIDATOR ] PHK: Primary data validation passed. [2025-09-17T21:06:06.160533] [INFO ] [MAIN ] PHK: Fetched primary data is valid. [2025-09-17T21:06:06.160595] [DEBUG] [LOCAL ] PHK: Saving primary data. [2025-09-17T21:06:06.161990] [DEBUG] [LOCAL ] PHK: Trimmed 39445 records to 26732 (keeping 200 days of data) [2025-09-17T21:06:06.287007] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-07 (4.27 seconds). [2025-09-17T21:06:06.376374] [DEBUG] [LOCAL ] PHK: Primary data saved (26732 records). [2025-09-17T21:06:06.376549] [INFO ] [MAIN ] PHK: Full history saved. [2025-09-17T21:06:06.376669] [INFO ] [MAIN ] Update Progress: 1683/2371 symbols completed. PHK took 36.1s. Estimated remaining: 1h 40m 36s. Rate: 6.8 symbols/min [2025-09-17T21:06:06.563014] [INFO ] [MAIN ] PII: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:06:06.610918] [DEBUG] [LOCAL ] PII: Loaded 49453 existing records from primary storage. [2025-09-17T21:06:06.611095] [INFO ] [MAIN ] PII: Loaded 49453 existing records. [2025-09-17T21:06:06.798260] [WARN ] [MAIN ] PII: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:06:06.798548] [INFO ] [MAIN ] PII: Wiping existing primary data before full refresh. [2025-09-17T21:06:06.798601] [INFO ] [LOCAL ] PII: Starting deletion of primary data. [2025-09-17T21:06:06.799803] [DEBUG] [LOCAL ] PII: Deleted primary data file. [2025-09-17T21:06:06.799876] [INFO ] [MAIN ] PII: Starting full primary refresh. [2025-09-17T21:06:06.820876] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-01. [2025-09-17T21:06:07.170791] [INFO ] [REMOTE ] PII: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:06:07.188392] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T21:06:07.416057] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T21:06:07.615781] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-02. [2025-09-17T21:06:08.415684] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-08. [2025-09-17T21:06:08.415926] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T21:06:09.215775] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-03. [2025-09-17T21:06:10.015788] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-11. [2025-09-17T21:06:10.205872] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T21:06:10.496103] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T21:06:10.815794] [INFO ] [REMOTE ] PHM: Fetching primary data for 2025-09. [2025-09-17T21:06:11.433436] [INFO ] [REMOTE ] PHM: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T21:06:11.440923] [INFO ] [REMOTE ] PHM: Full fetch complete (74426 records). [2025-09-17T21:06:11.441082] [DEBUG] [VALIDATOR ] PHM: Validating primary data. [2025-09-17T21:06:11.441977] [FATAL] [VALIDATOR ] PHM: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:06:11.442071] [FATAL] [MAIN ] PHM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:06:11.442109] [WARN ] [MAIN ] PHM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:06:11.442148] [INFO ] [LOCAL ] PHM: Starting deletion of primary data. [2025-09-17T21:06:11.442212] [DEBUG] [LOCAL ] PHM: No primary data file found to delete. [2025-09-17T21:06:11.442250] [INFO ] [LOCAL ] PHM: Starting deletion of derivative data. [2025-09-17T21:06:11.442579] [DEBUG] [LOCAL ] PHM: Deleted derivative data file. [2025-09-17T21:06:11.444113] [INFO ] [MAIN ] Update Progress: 1684/2371 symbols completed. PHM took 41.2s. Estimated remaining: 1h 40m 25s. Rate: 6.8 symbols/min [2025-09-17T21:06:11.620487] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-04. [2025-09-17T21:06:11.624757] [INFO ] [MAIN ] PIM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:06:11.659129] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T21:06:11.658015] [DEBUG] [LOCAL ] PIM: Loaded 4766 existing records from primary storage. [2025-09-17T21:06:11.668348] [INFO ] [MAIN ] PIM: Loaded 4766 existing records. [2025-09-17T21:06:11.849466] [WARN ] [MAIN ] PIM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:06:11.849747] [INFO ] [MAIN ] PIM: Wiping existing primary data before full refresh. [2025-09-17T21:06:11.849794] [INFO ] [LOCAL ] PIM: Starting deletion of primary data. [2025-09-17T21:06:11.850004] [DEBUG] [LOCAL ] PIM: Deleted primary data file. [2025-09-17T21:06:11.850047] [INFO ] [MAIN ] PIM: Starting full primary refresh. [2025-09-17T21:06:12.224722] [INFO ] [REMOTE ] PIM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:06:12.296448] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T21:06:12.415784] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-05. [2025-09-17T21:06:13.215799] [INFO ] [REMOTE ] PII: Fetching primary data for 2024-12. [2025-09-17T21:06:13.577933] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T21:06:14.015778] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-06. [2025-09-17T21:06:14.815798] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-11. [2025-09-17T21:06:15.615699] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-03. [2025-09-17T21:06:15.652121] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2024-12 (2.44 seconds). [2025-09-17T21:06:15.672948] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T21:06:15.884812] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T21:06:16.415776] [INFO ] [REMOTE ] PIM: Fetching primary data for 2024-12. [2025-09-17T21:06:17.114097] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T21:06:17.129693] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T21:06:17.215814] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-01. [2025-09-17T21:06:17.846243] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T21:06:18.015775] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-02. [2025-09-17T21:06:18.702107] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T21:06:18.815792] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-01. [2025-09-17T21:06:19.615778] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-03. [2025-09-17T21:06:20.169017] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T21:06:20.373487] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T21:06:20.415777] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-02. [2025-09-17T21:06:21.215785] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-07. [2025-09-17T21:06:22.015793] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-04. [2025-09-17T21:06:22.182375] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T21:06:22.488273] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T21:06:22.815774] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-08. [2025-09-17T21:06:23.450702] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T21:06:23.477124] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T21:06:23.615775] [INFO ] [REMOTE ] PHT: Fetching primary data for 2025-09. [2025-09-17T21:06:24.415762] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-04. [2025-09-17T21:06:24.634446] [INFO ] [REMOTE ] PHT: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T21:06:24.637059] [INFO ] [REMOTE ] PHT: Full fetch complete (19175 records). [2025-09-17T21:06:24.637164] [DEBUG] [VALIDATOR ] PHT: Validating primary data. [2025-09-17T21:06:25.026881] [DEBUG] [VALIDATOR ] PHT: All expected trading days are present. [2025-09-17T21:06:25.026970] [DEBUG] [VALIDATOR ] PHT: Primary data validation passed. [2025-09-17T21:06:25.027454] [INFO ] [MAIN ] PHT: Fetched primary data is valid. [2025-09-17T21:06:25.027514] [DEBUG] [LOCAL ] PHT: Saving primary data. [2025-09-17T21:06:25.028328] [DEBUG] [LOCAL ] PHT: Trimmed 19175 records to 15323 (keeping 200 days of data) [2025-09-17T21:06:25.140301] [DEBUG] [LOCAL ] PHT: Primary data saved (15323 records). [2025-09-17T21:06:25.140446] [INFO ] [MAIN ] PHT: Full history saved. [2025-09-17T21:06:25.140550] [INFO ] [MAIN ] Update Progress: 1685/2371 symbols completed. PHT took 25.6s. Estimated remaining: 1h 40m 19s. Rate: 6.8 symbols/min [2025-09-17T21:06:25.219188] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-03. [2025-09-17T21:06:25.328349] [INFO ] [MAIN ] PINE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:06:25.345554] [DEBUG] [LOCAL ] PINE: Loaded 14240 existing records from primary storage. [2025-09-17T21:06:25.345703] [INFO ] [MAIN ] PINE: Loaded 14240 existing records. [2025-09-17T21:06:25.455249] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T21:06:25.539771] [WARN ] [MAIN ] PINE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:06:25.540044] [INFO ] [MAIN ] PINE: Wiping existing primary data before full refresh. [2025-09-17T21:06:25.540101] [INFO ] [LOCAL ] PINE: Starting deletion of primary data. [2025-09-17T21:06:25.540471] [DEBUG] [LOCAL ] PINE: Deleted primary data file. [2025-09-17T21:06:25.540516] [INFO ] [MAIN ] PINE: Starting full primary refresh. [2025-09-17T21:06:25.918480] [INFO ] [REMOTE ] PINE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:06:26.015755] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-11. [2025-09-17T21:06:26.815792] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-05. [2025-09-17T21:06:27.069141] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T21:06:27.562334] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-17T21:06:27.615746] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-04. [2025-09-17T21:06:28.228459] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T21:06:28.415775] [INFO ] [REMOTE ] PINE: Fetching primary data for 2024-12. [2025-09-17T21:06:29.146588] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T21:06:29.215739] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-01. [2025-09-17T21:06:29.549911] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T21:06:30.015770] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-05. [2025-09-17T21:06:30.174065] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-01 (0.96 seconds). [2025-09-17T21:06:30.815832] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-05. [2025-09-17T21:06:31.377032] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T21:06:31.615834] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-06. [2025-09-17T21:06:31.932619] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T21:06:32.297577] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T21:06:32.415821] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-07. [2025-09-17T21:06:32.977528] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T21:06:33.215803] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-02. [2025-09-17T21:06:34.015837] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-06. [2025-09-17T21:06:34.162447] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T21:06:34.815831] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-03. [2025-09-17T21:06:35.216541] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T21:06:35.615804] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-07. [2025-09-17T21:06:35.790201] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T21:06:36.415827] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-08. [2025-09-17T21:06:36.987827] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T21:06:37.031555] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T21:06:37.215832] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-08. [2025-09-17T21:06:38.015793] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-06. [2025-09-17T21:06:38.815799] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-04. [2025-09-17T21:06:38.881663] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T21:06:39.615837] [INFO ] [REMOTE ] PHR: Fetching primary data for 2025-09. [2025-09-17T21:06:39.873220] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T21:06:39.896599] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T21:06:40.415785] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-05. [2025-09-17T21:06:41.197351] [INFO ] [REMOTE ] PHR: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T21:06:41.203714] [INFO ] [REMOTE ] PHR: Full fetch complete (51750 records). [2025-09-17T21:06:41.203835] [DEBUG] [VALIDATOR ] PHR: Validating primary data. [2025-09-17T21:06:41.225295] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-07. [2025-09-17T21:06:41.404889] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T21:06:41.623040] [DEBUG] [VALIDATOR ] PHR: All expected trading days are present. [2025-09-17T21:06:41.623122] [DEBUG] [VALIDATOR ] PHR: Primary data validation passed. [2025-09-17T21:06:41.623971] [INFO ] [MAIN ] PHR: Fetched primary data is valid. [2025-09-17T21:06:41.624035] [DEBUG] [LOCAL ] PHR: Saving primary data. [2025-09-17T21:06:41.625337] [DEBUG] [LOCAL ] PHR: Trimmed 51750 records to 37087 (keeping 200 days of data) [2025-09-17T21:06:41.859227] [DEBUG] [LOCAL ] PHR: Primary data saved (37087 records). [2025-09-17T21:06:41.859440] [INFO ] [MAIN ] PHR: Full history saved. [2025-09-17T21:06:41.859535] [INFO ] [MAIN ] Update Progress: 1686/2371 symbols completed. PHR took 44.3s. Estimated remaining: 1h 40m 13s. Rate: 6.8 symbols/min [2025-09-17T21:06:42.020074] [INFO ] [REMOTE ] PIM: Fetching primary data for 2025-09. [2025-09-17T21:06:42.042333] [INFO ] [MAIN ] PINS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:06:42.095428] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-17T21:06:42.095578] [INFO ] [MAIN ] PINS: Loaded 53693 existing records. [2025-09-17T21:06:42.280953] [WARN ] [MAIN ] PINS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:06:42.281247] [INFO ] [MAIN ] PINS: Wiping existing primary data before full refresh. [2025-09-17T21:06:42.281295] [INFO ] [LOCAL ] PINS: Starting deletion of primary data. [2025-09-17T21:06:42.282589] [DEBUG] [LOCAL ] PINS: Deleted primary data file. [2025-09-17T21:06:42.282680] [INFO ] [MAIN ] PINS: Starting full primary refresh. [2025-09-17T21:06:42.645814] [INFO ] [REMOTE ] PINS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:06:42.678423] [INFO ] [REMOTE ] PIM: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T21:06:42.680464] [INFO ] [REMOTE ] PIM: Full fetch complete (6622 records). [2025-09-17T21:06:42.680532] [DEBUG] [VALIDATOR ] PIM: Validating primary data. [2025-09-17T21:06:42.821414] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-11. [2025-09-17T21:06:43.053584] [DEBUG] [VALIDATOR ] PIM: All expected trading days are present. [2025-09-17T21:06:43.053706] [DEBUG] [VALIDATOR ] PIM: Primary data validation passed. [2025-09-17T21:06:43.053952] [INFO ] [MAIN ] PIM: Fetched primary data is valid. [2025-09-17T21:06:43.054062] [DEBUG] [LOCAL ] PIM: Saving primary data. [2025-09-17T21:06:43.054660] [DEBUG] [LOCAL ] PIM: Trimmed 6622 records to 4781 (keeping 200 days of data) [2025-09-17T21:06:43.109805] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T21:06:43.130333] [DEBUG] [LOCAL ] PIM: Primary data saved (4781 records). [2025-09-17T21:06:43.130507] [INFO ] [MAIN ] PIM: Full history saved. [2025-09-17T21:06:43.130621] [INFO ] [MAIN ] Update Progress: 1687/2371 symbols completed. PIM took 31.7s. Estimated remaining: 1h 40m 1s. Rate: 6.8 symbols/min [2025-09-17T21:06:43.303280] [INFO ] [MAIN ] PIPR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:06:43.320393] [DEBUG] [LOCAL ] PIPR: Loaded 15340 existing records from primary storage. [2025-09-17T21:06:43.320559] [INFO ] [MAIN ] PIPR: Loaded 15340 existing records. [2025-09-17T21:06:43.516116] [WARN ] [MAIN ] PIPR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:06:43.516418] [INFO ] [MAIN ] PIPR: Wiping existing primary data before full refresh. [2025-09-17T21:06:43.516467] [INFO ] [LOCAL ] PIPR: Starting deletion of primary data. [2025-09-17T21:06:43.517022] [DEBUG] [LOCAL ] PIPR: Deleted primary data file. [2025-09-17T21:06:43.517073] [INFO ] [MAIN ] PIPR: Starting full primary refresh. [2025-09-17T21:06:43.620892] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-08. [2025-09-17T21:06:43.891449] [INFO ] [REMOTE ] PIPR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:06:44.415776] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-06. [2025-09-17T21:06:45.040472] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T21:06:45.215741] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-07. [2025-09-17T21:06:45.246486] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-11 (2.43 seconds). [2025-09-17T21:06:45.686345] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T21:06:46.015789] [INFO ] [REMOTE ] PINS: Fetching primary data for 2024-12. [2025-09-17T21:06:46.360015] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T21:06:46.815795] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-11. [2025-09-17T21:06:47.615864] [INFO ] [REMOTE ] PII: Fetching primary data for 2025-09. [2025-09-17T21:06:47.875254] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T21:06:47.909055] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T21:06:48.415785] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-01. [2025-09-17T21:06:48.977118] [INFO ] [REMOTE ] PII: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T21:06:48.983774] [INFO ] [REMOTE ] PII: Full fetch complete (70950 records). [2025-09-17T21:06:48.983961] [DEBUG] [VALIDATOR ] PII: Validating primary data. [2025-09-17T21:06:49.226774] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-08. [2025-09-17T21:06:49.405147] [DEBUG] [VALIDATOR ] PII: All expected trading days are present. [2025-09-17T21:06:49.405253] [DEBUG] [VALIDATOR ] PII: Primary data validation passed. [2025-09-17T21:06:49.406425] [INFO ] [MAIN ] PII: Fetched primary data is valid. [2025-09-17T21:06:49.406478] [DEBUG] [LOCAL ] PII: Saving primary data. [2025-09-17T21:06:49.408067] [DEBUG] [LOCAL ] PII: Trimmed 70950 records to 49436 (keeping 200 days of data) [2025-09-17T21:06:49.724994] [DEBUG] [LOCAL ] PII: Primary data saved (49436 records). [2025-09-17T21:06:49.725155] [INFO ] [MAIN ] PII: Full history saved. [2025-09-17T21:06:49.726507] [INFO ] [MAIN ] Update Progress: 1688/2371 symbols completed. PII took 43.3s. Estimated remaining: 1h 39m 52s. Rate: 6.8 symbols/min [2025-09-17T21:06:49.895986] [INFO ] [MAIN ] PJT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:06:49.919968] [DEBUG] [LOCAL ] PJT: Loaded 23021 existing records from primary storage. [2025-09-17T21:06:49.920102] [INFO ] [MAIN ] PJT: Loaded 23021 existing records. [2025-09-17T21:06:50.020879] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2024-12. [2025-09-17T21:06:50.104817] [WARN ] [MAIN ] PJT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:06:50.105218] [INFO ] [MAIN ] PJT: Wiping existing primary data before full refresh. [2025-09-17T21:06:50.105325] [INFO ] [LOCAL ] PJT: Starting deletion of primary data. [2025-09-17T21:06:50.105940] [DEBUG] [LOCAL ] PJT: Deleted primary data file. [2025-09-17T21:06:50.105988] [INFO ] [MAIN ] PJT: Starting full primary refresh. [2025-09-17T21:06:50.429328] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T21:06:50.499830] [INFO ] [REMOTE ] PJT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:06:50.535321] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T21:06:50.736621] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T21:06:50.815727] [INFO ] [REMOTE ] PINE: Fetching primary data for 2025-09. [2025-09-17T21:06:51.615795] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-01. [2025-09-17T21:06:51.705430] [INFO ] [REMOTE ] PINE: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T21:06:51.707546] [INFO ] [REMOTE ] PINE: Full fetch complete (21241 records). [2025-09-17T21:06:51.707617] [DEBUG] [VALIDATOR ] PINE: Validating primary data. [2025-09-17T21:06:52.089799] [DEBUG] [VALIDATOR ] PINE: All expected trading days are present. [2025-09-17T21:06:52.089879] [DEBUG] [VALIDATOR ] PINE: Primary data validation passed. [2025-09-17T21:06:52.090421] [INFO ] [MAIN ] PINE: Fetched primary data is valid. [2025-09-17T21:06:52.090462] [DEBUG] [LOCAL ] PINE: Saving primary data. [2025-09-17T21:06:52.091094] [DEBUG] [LOCAL ] PINE: Trimmed 21241 records to 14236 (keeping 200 days of data) [2025-09-17T21:06:52.180219] [DEBUG] [LOCAL ] PINE: Primary data saved (14236 records). [2025-09-17T21:06:52.180360] [INFO ] [MAIN ] PINE: Full history saved. [2025-09-17T21:06:52.180443] [INFO ] [MAIN ] Update Progress: 1689/2371 symbols completed. PINE took 27.0s. Estimated remaining: 1h 39m 40s. Rate: 6.8 symbols/min [2025-09-17T21:06:52.363052] [INFO ] [MAIN ] PK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:06:52.415203] [DEBUG] [LOCAL ] PK: Loaded 52885 existing records from primary storage. [2025-09-17T21:06:52.415346] [INFO ] [MAIN ] PK: Loaded 52885 existing records. [2025-09-17T21:06:52.426628] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-02. [2025-09-17T21:06:52.601758] [WARN ] [MAIN ] PK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:06:52.601984] [INFO ] [MAIN ] PK: Wiping existing primary data before full refresh. [2025-09-17T21:06:52.602031] [INFO ] [LOCAL ] PK: Starting deletion of primary data. [2025-09-17T21:06:52.603504] [DEBUG] [LOCAL ] PK: Deleted primary data file. [2025-09-17T21:06:52.603558] [INFO ] [MAIN ] PK: Starting full primary refresh. [2025-09-17T21:06:53.016869] [INFO ] [REMOTE ] PK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:06:53.025751] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T21:06:53.215738] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-11. [2025-09-17T21:06:54.015805] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-11. [2025-09-17T21:06:54.643039] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-02 (2.22 seconds). [2025-09-17T21:06:54.815820] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-03. [2025-09-17T21:06:54.940815] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T21:06:55.065708] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T21:06:55.615799] [INFO ] [REMOTE ] PK: Fetching primary data for 2024-12. [2025-09-17T21:06:56.415836] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-02. [2025-09-17T21:06:56.731194] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T21:06:57.215761] [INFO ] [REMOTE ] PJT: Fetching primary data for 2024-12. [2025-09-17T21:06:57.295956] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T21:06:57.416390] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T21:06:58.015816] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-01. [2025-09-17T21:06:58.436446] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T21:06:58.815782] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-03. [2025-09-17T21:06:59.615880] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-04. [2025-09-17T21:06:59.842246] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T21:07:00.056124] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T21:07:00.415784] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-02. [2025-09-17T21:07:01.215807] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-04. [2025-09-17T21:07:02.015780] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-01. [2025-09-17T21:07:02.094429] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-04 (2.48 seconds). [2025-09-17T21:07:02.145727] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T21:07:02.166966] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T21:07:02.815831] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-03. [2025-09-17T21:07:03.337334] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T21:07:03.615816] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-05. [2025-09-17T21:07:04.415813] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-02. [2025-09-17T21:07:04.769553] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T21:07:04.793141] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T21:07:05.215853] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-06. [2025-09-17T21:07:05.346498] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T21:07:06.015802] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-05. [2025-09-17T21:07:06.286785] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T21:07:06.815797] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-03. [2025-09-17T21:07:07.615827] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-07. [2025-09-17T21:07:08.230709] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T21:07:08.352914] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-05 (2.34 seconds). [2025-09-17T21:07:08.415728] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-04. [2025-09-17T21:07:08.561268] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T21:07:09.215782] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-04. [2025-09-17T21:07:09.950720] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T21:07:10.015733] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-05. [2025-09-17T21:07:10.815784] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-06. [2025-09-17T21:07:11.154535] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T21:07:11.395260] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T21:07:11.615803] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-05. [2025-09-17T21:07:12.415882] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-06. [2025-09-17T21:07:12.557774] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T21:07:13.215795] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-07. [2025-09-17T21:07:13.339783] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-06 (0.92 seconds). [2025-09-17T21:07:13.582116] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T21:07:14.015792] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-08. [2025-09-17T21:07:14.707948] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T21:07:14.815769] [INFO ] [REMOTE ] PIPR: Fetching primary data for 2025-09. [2025-09-17T21:07:15.430691] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-07 (2.21 seconds). [2025-09-17T21:07:15.615757] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-06. [2025-09-17T21:07:15.786115] [INFO ] [REMOTE ] PIPR: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T21:07:15.788583] [INFO ] [REMOTE ] PIPR: Full fetch complete (20221 records). [2025-09-17T21:07:15.788708] [DEBUG] [VALIDATOR ] PIPR: Validating primary data. [2025-09-17T21:07:16.172535] [DEBUG] [VALIDATOR ] PIPR: All expected trading days are present. [2025-09-17T21:07:16.172623] [DEBUG] [VALIDATOR ] PIPR: Primary data validation passed. [2025-09-17T21:07:16.173062] [INFO ] [MAIN ] PIPR: Fetched primary data is valid. [2025-09-17T21:07:16.173119] [DEBUG] [LOCAL ] PIPR: Saving primary data. [2025-09-17T21:07:16.173742] [DEBUG] [LOCAL ] PIPR: Trimmed 20221 records to 15397 (keeping 200 days of data) [2025-09-17T21:07:16.279730] [DEBUG] [LOCAL ] PIPR: Primary data saved (15397 records). [2025-09-17T21:07:16.279914] [INFO ] [MAIN ] PIPR: Full history saved. [2025-09-17T21:07:16.280068] [INFO ] [MAIN ] Update Progress: 1690/2371 symbols completed. PIPR took 33.1s. Estimated remaining: 1h 39m 38s. Rate: 6.8 symbols/min [2025-09-17T21:07:16.423929] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-07. [2025-09-17T21:07:16.454941] [INFO ] [MAIN ] PKE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:07:16.469634] [DEBUG] [LOCAL ] PKE: Loaded 12253 existing records from primary storage. [2025-09-17T21:07:16.469777] [INFO ] [MAIN ] PKE: Loaded 12253 existing records. [2025-09-17T21:07:16.659084] [WARN ] [MAIN ] PKE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:07:16.659327] [INFO ] [MAIN ] PKE: Wiping existing primary data before full refresh. [2025-09-17T21:07:16.659374] [INFO ] [LOCAL ] PKE: Starting deletion of primary data. [2025-09-17T21:07:16.659838] [DEBUG] [LOCAL ] PKE: Deleted primary data file. [2025-09-17T21:07:16.659891] [INFO ] [MAIN ] PKE: Starting full primary refresh. [2025-09-17T21:07:17.012206] [INFO ] [REMOTE ] PKE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:07:17.215747] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-11. [2025-09-17T21:07:17.302106] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T21:07:17.525406] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T21:07:18.015893] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-08. [2025-09-17T21:07:18.241013] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T21:07:18.815789] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-07. [2025-09-17T21:07:18.869607] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T21:07:19.615858] [INFO ] [REMOTE ] PKE: Fetching primary data for 2024-12. [2025-09-17T21:07:20.415901] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-08. [2025-09-17T21:07:20.549370] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T21:07:20.712695] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T21:07:21.215802] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-08. [2025-09-17T21:07:22.015868] [INFO ] [REMOTE ] PJT: Fetching primary data for 2025-09. [2025-09-17T21:07:22.748156] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-08 (2.33 seconds). [2025-09-17T21:07:22.816342] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-01. [2025-09-17T21:07:22.819816] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T21:07:22.856865] [INFO ] [REMOTE ] PJT: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T21:07:22.860178] [INFO ] [REMOTE ] PJT: Full fetch complete (32145 records). [2025-09-17T21:07:22.860258] [DEBUG] [VALIDATOR ] PJT: Validating primary data. [2025-09-17T21:07:23.241798] [DEBUG] [VALIDATOR ] PJT: All expected trading days are present. [2025-09-17T21:07:23.241882] [DEBUG] [VALIDATOR ] PJT: Primary data validation passed. [2025-09-17T21:07:23.242568] [INFO ] [MAIN ] PJT: Fetched primary data is valid. [2025-09-17T21:07:23.242608] [DEBUG] [LOCAL ] PJT: Saving primary data. [2025-09-17T21:07:23.243402] [DEBUG] [LOCAL ] PJT: Trimmed 32145 records to 22933 (keeping 200 days of data) [2025-09-17T21:07:23.394405] [DEBUG] [LOCAL ] PJT: Primary data saved (22933 records). [2025-09-17T21:07:23.394549] [INFO ] [MAIN ] PJT: Full history saved. [2025-09-17T21:07:23.394673] [INFO ] [MAIN ] Update Progress: 1691/2371 symbols completed. PJT took 33.7s. Estimated remaining: 1h 39m 28s. Rate: 6.8 symbols/min [2025-09-17T21:07:23.565691] [INFO ] [MAIN ] PKG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:07:23.612385] [DEBUG] [LOCAL ] PKG: Loaded 39476 existing records from primary storage. [2025-09-17T21:07:23.612534] [INFO ] [MAIN ] PKG: Loaded 39476 existing records. [2025-09-17T21:07:23.623412] [INFO ] [REMOTE ] PINS: Fetching primary data for 2025-09. [2025-09-17T21:07:23.715816] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-01 (0.90 seconds). [2025-09-17T21:07:23.818189] [WARN ] [MAIN ] PKG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:07:23.818573] [INFO ] [MAIN ] PKG: Wiping existing primary data before full refresh. [2025-09-17T21:07:23.818631] [INFO ] [LOCAL ] PKG: Starting deletion of primary data. [2025-09-17T21:07:23.819753] [DEBUG] [LOCAL ] PKG: Deleted primary data file. [2025-09-17T21:07:23.819814] [INFO ] [MAIN ] PKG: Starting full primary refresh. [2025-09-17T21:07:24.209103] [INFO ] [REMOTE ] PKG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:07:24.415774] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-02. [2025-09-17T21:07:25.189424] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T21:07:25.215735] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-03. [2025-09-17T21:07:25.626388] [INFO ] [REMOTE ] PINS: Incremental fetch complete for 2025-09 (2.00 seconds). [2025-09-17T21:07:25.633853] [INFO ] [REMOTE ] PINS: Full fetch complete (77649 records). [2025-09-17T21:07:25.633997] [DEBUG] [VALIDATOR ] PINS: Validating primary data. [2025-09-17T21:07:25.935466] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T21:07:26.022783] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-04. [2025-09-17T21:07:26.067382] [DEBUG] [VALIDATOR ] PINS: All expected trading days are present. [2025-09-17T21:07:26.067502] [DEBUG] [VALIDATOR ] PINS: Primary data validation passed. [2025-09-17T21:07:26.068668] [INFO ] [MAIN ] PINS: Fetched primary data is valid. [2025-09-17T21:07:26.068718] [DEBUG] [LOCAL ] PINS: Saving primary data. [2025-09-17T21:07:26.070890] [DEBUG] [LOCAL ] PINS: Trimmed 77649 records to 53693 (keeping 200 days of data) [2025-09-17T21:07:26.434596] [DEBUG] [LOCAL ] PINS: Primary data saved (53693 records). [2025-09-17T21:07:26.434879] [INFO ] [MAIN ] PINS: Full history saved. [2025-09-17T21:07:26.435058] [INFO ] [MAIN ] Update Progress: 1692/2371 symbols completed. PINS took 44.6s. Estimated remaining: 1h 39m 17s. Rate: 6.8 symbols/min [2025-09-17T21:07:26.628803] [INFO ] [MAIN ] PKST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:07:26.661246] [DEBUG] [LOCAL ] PKST: Loaded 19656 existing records from primary storage. [2025-09-17T21:07:26.661473] [INFO ] [MAIN ] PKST: Loaded 19656 existing records. [2025-09-17T21:07:26.820903] [INFO ] [REMOTE ] PK: Fetching primary data for 2025-09. [2025-09-17T21:07:26.862133] [WARN ] [MAIN ] PKST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:07:26.862525] [INFO ] [MAIN ] PKST: Wiping existing primary data before full refresh. [2025-09-17T21:07:26.862576] [INFO ] [LOCAL ] PKST: Starting deletion of primary data. [2025-09-17T21:07:26.863626] [DEBUG] [LOCAL ] PKST: Deleted primary data file. [2025-09-17T21:07:26.863715] [INFO ] [MAIN ] PKST: Starting full primary refresh. [2025-09-17T21:07:27.056826] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T21:07:27.250071] [INFO ] [REMOTE ] PKST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:07:27.615789] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-05. [2025-09-17T21:07:28.415823] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-11. [2025-09-17T21:07:28.492100] [INFO ] [REMOTE ] PK: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T21:07:28.499407] [INFO ] [REMOTE ] PK: Full fetch complete (76192 records). [2025-09-17T21:07:28.499560] [DEBUG] [VALIDATOR ] PK: Validating primary data. [2025-09-17T21:07:28.666977] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T21:07:28.949203] [DEBUG] [VALIDATOR ] PK: All expected trading days are present. [2025-09-17T21:07:28.949297] [DEBUG] [VALIDATOR ] PK: Primary data validation passed. [2025-09-17T21:07:28.950387] [INFO ] [MAIN ] PK: Fetched primary data is valid. [2025-09-17T21:07:28.950439] [DEBUG] [LOCAL ] PK: Saving primary data. [2025-09-17T21:07:28.952973] [DEBUG] [LOCAL ] PK: Trimmed 76192 records to 52900 (keeping 200 days of data) [2025-09-17T21:07:29.244176] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-11. [2025-09-17T21:07:29.295498] [DEBUG] [LOCAL ] PK: Primary data saved (52900 records). [2025-09-17T21:07:29.295674] [INFO ] [MAIN ] PK: Full history saved. [2025-09-17T21:07:29.295859] [INFO ] [MAIN ] Update Progress: 1693/2371 symbols completed. PK took 37.1s. Estimated remaining: 1h 39m 6s. Rate: 6.8 symbols/min [2025-09-17T21:07:29.474154] [INFO ] [MAIN ] PKX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:07:29.501108] [DEBUG] [LOCAL ] PKX: Loaded 25476 existing records from primary storage. [2025-09-17T21:07:29.501289] [INFO ] [MAIN ] PKX: Loaded 25476 existing records. [2025-09-17T21:07:29.684959] [WARN ] [MAIN ] PKX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:07:29.685247] [INFO ] [MAIN ] PKX: Wiping existing primary data before full refresh. [2025-09-17T21:07:29.685294] [INFO ] [LOCAL ] PKX: Starting deletion of primary data. [2025-09-17T21:07:29.686021] [DEBUG] [LOCAL ] PKX: Deleted primary data file. [2025-09-17T21:07:29.686068] [INFO ] [MAIN ] PKX: Starting full primary refresh. [2025-09-17T21:07:30.032758] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-06. [2025-09-17T21:07:30.071186] [INFO ] [REMOTE ] PKX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:07:30.094293] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T21:07:30.135497] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T21:07:30.815827] [INFO ] [REMOTE ] PKST: Fetching primary data for 2024-12. [2025-09-17T21:07:30.848340] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T21:07:31.615801] [INFO ] [REMOTE ] PKG: Fetching primary data for 2024-12. [2025-09-17T21:07:32.053503] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T21:07:32.415782] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-01. [2025-09-17T21:07:33.216365] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T21:07:33.216550] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-07. [2025-09-17T21:07:33.653870] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T21:07:34.015737] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-01. [2025-09-17T21:07:34.176877] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T21:07:34.815817] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-08. [2025-09-17T21:07:35.502328] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T21:07:35.615817] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-11. [2025-09-17T21:07:35.851206] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-08 (1.04 seconds). [2025-09-17T21:07:36.415814] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-02. [2025-09-17T21:07:37.162493] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T21:07:37.215815] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-02. [2025-09-17T21:07:37.771779] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T21:07:38.015846] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-03. [2025-09-17T21:07:38.442061] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T21:07:38.815822] [INFO ] [REMOTE ] PKE: Fetching primary data for 2025-09. [2025-09-17T21:07:39.508491] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T21:07:39.615793] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-04. [2025-09-17T21:07:39.804089] [INFO ] [REMOTE ] PKE: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T21:07:39.808556] [INFO ] [REMOTE ] PKE: Full fetch complete (16696 records). [2025-09-17T21:07:39.808779] [DEBUG] [VALIDATOR ] PKE: Validating primary data. [2025-09-17T21:07:40.322958] [DEBUG] [VALIDATOR ] PKE: All expected trading days are present. [2025-09-17T21:07:40.323089] [DEBUG] [VALIDATOR ] PKE: Primary data validation passed. [2025-09-17T21:07:40.324018] [INFO ] [MAIN ] PKE: Fetched primary data is valid. [2025-09-17T21:07:40.324106] [DEBUG] [LOCAL ] PKE: Saving primary data. [2025-09-17T21:07:40.325759] [DEBUG] [LOCAL ] PKE: Trimmed 16696 records to 12305 (keeping 200 days of data) [2025-09-17T21:07:40.416424] [INFO ] [REMOTE ] PKX: Fetching primary data for 2024-12. [2025-09-17T21:07:40.456131] [DEBUG] [LOCAL ] PKE: Primary data saved (12305 records). [2025-09-17T21:07:40.456319] [INFO ] [MAIN ] PKE: Full history saved. [2025-09-17T21:07:40.456511] [INFO ] [MAIN ] Update Progress: 1694/2371 symbols completed. PKE took 24.2s. Estimated remaining: 1h 38m 58s. Rate: 6.8 symbols/min [2025-09-17T21:07:40.692947] [INFO ] [MAIN ] PL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:07:40.777494] [DEBUG] [LOCAL ] PL: Loaded 53099 existing records from primary storage. [2025-09-17T21:07:40.777737] [INFO ] [MAIN ] PL: Loaded 53099 existing records. [2025-09-17T21:07:40.985084] [WARN ] [MAIN ] PL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:07:40.985387] [INFO ] [MAIN ] PL: Wiping existing primary data before full refresh. [2025-09-17T21:07:40.985637] [INFO ] [LOCAL ] PL: Starting deletion of primary data. [2025-09-17T21:07:40.986536] [DEBUG] [LOCAL ] PL: Deleted primary data file. [2025-09-17T21:07:40.986594] [INFO ] [MAIN ] PL: Starting full primary refresh. [2025-09-17T21:07:41.238109] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-03. [2025-09-17T21:07:41.400007] [INFO ] [REMOTE ] PL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:07:41.428856] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T21:07:41.785114] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T21:07:42.015781] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-11. [2025-09-17T21:07:42.392604] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T21:07:42.815785] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-05. [2025-09-17T21:07:43.615763] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-01. [2025-09-17T21:07:43.721272] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T21:07:44.415744] [INFO ] [REMOTE ] PL: Fetching primary data for 2024-12. [2025-09-17T21:07:44.512471] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T21:07:44.771625] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T21:07:45.215823] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-06. [2025-09-17T21:07:46.015837] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-04. [2025-09-17T21:07:46.322960] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T21:07:46.815857] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-02. [2025-09-17T21:07:46.952813] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T21:07:47.283146] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T21:07:47.615781] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-05. [2025-09-17T21:07:48.027932] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T21:07:48.415827] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-01. [2025-09-17T21:07:48.660840] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T21:07:49.215797] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-07. [2025-09-17T21:07:50.015885] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-06. [2025-09-17T21:07:50.556743] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-17T21:07:50.748607] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T21:07:50.815762] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-03. [2025-09-17T21:07:50.879274] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T21:07:51.615799] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-02. [2025-09-17T21:07:52.415789] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-07. [2025-09-17T21:07:52.441821] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T21:07:53.144991] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T21:07:53.215770] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-08. [2025-09-17T21:07:53.614202] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T21:07:54.015847] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-08. [2025-09-17T21:07:54.325355] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T21:07:54.815800] [INFO ] [REMOTE ] PKST: Fetching primary data for 2025-09. [2025-09-17T21:07:55.125901] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T21:07:55.480425] [INFO ] [REMOTE ] PKST: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T21:07:55.483725] [INFO ] [REMOTE ] PKST: Full fetch complete (29684 records). [2025-09-17T21:07:55.483848] [DEBUG] [VALIDATOR ] PKST: Validating primary data. [2025-09-17T21:07:55.620918] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-03. [2025-09-17T21:07:55.876097] [DEBUG] [VALIDATOR ] PKST: All expected trading days are present. [2025-09-17T21:07:55.876183] [DEBUG] [VALIDATOR ] PKST: Primary data validation passed. [2025-09-17T21:07:55.876908] [INFO ] [MAIN ] PKST: Fetched primary data is valid. [2025-09-17T21:07:55.876959] [DEBUG] [LOCAL ] PKST: Saving primary data. [2025-09-17T21:07:55.877780] [DEBUG] [LOCAL ] PKST: Trimmed 29684 records to 19563 (keeping 200 days of data) [2025-09-17T21:07:55.999175] [DEBUG] [LOCAL ] PKST: Primary data saved (19563 records). [2025-09-17T21:07:55.999337] [INFO ] [MAIN ] PKST: Full history saved. [2025-09-17T21:07:55.999441] [INFO ] [MAIN ] Update Progress: 1695/2371 symbols completed. PKST took 29.6s. Estimated remaining: 1h 38m 52s. Rate: 6.8 symbols/min [2025-09-17T21:07:56.174890] [INFO ] [MAIN ] PLD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:07:56.230887] [DEBUG] [LOCAL ] PLD: Loaded 53485 existing records from primary storage. [2025-09-17T21:07:56.231068] [INFO ] [MAIN ] PLD: Loaded 53485 existing records. [2025-09-17T21:07:56.418719] [INFO ] [REMOTE ] PKG: Fetching primary data for 2025-09. [2025-09-17T21:07:56.423332] [WARN ] [MAIN ] PLD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:07:56.424337] [INFO ] [MAIN ] PLD: Wiping existing primary data before full refresh. [2025-09-17T21:07:56.424389] [INFO ] [LOCAL ] PLD: Starting deletion of primary data. [2025-09-17T21:07:56.425684] [DEBUG] [LOCAL ] PLD: Deleted primary data file. [2025-09-17T21:07:56.425755] [INFO ] [MAIN ] PLD: Starting full primary refresh. [2025-09-17T21:07:56.796702] [INFO ] [REMOTE ] PLD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:07:57.215798] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-11. [2025-09-17T21:07:57.715191] [INFO ] [REMOTE ] PKG: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T21:07:57.720811] [INFO ] [REMOTE ] PKG: Full fetch complete (57338 records). [2025-09-17T21:07:57.720987] [DEBUG] [VALIDATOR ] PKG: Validating primary data. [2025-09-17T21:07:58.023263] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-04. [2025-09-17T21:07:58.114576] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-03 (2.49 seconds). [2025-09-17T21:07:58.203178] [DEBUG] [VALIDATOR ] PKG: All expected trading days are present. [2025-09-17T21:07:58.203516] [DEBUG] [VALIDATOR ] PKG: Primary data validation passed. [2025-09-17T21:07:58.204891] [INFO ] [MAIN ] PKG: Fetched primary data is valid. [2025-09-17T21:07:58.205371] [DEBUG] [LOCAL ] PKG: Saving primary data. [2025-09-17T21:07:58.206769] [DEBUG] [LOCAL ] PKG: Trimmed 57338 records to 39509 (keeping 200 days of data) [2025-09-17T21:07:58.458198] [DEBUG] [LOCAL ] PKG: Primary data saved (39509 records). [2025-09-17T21:07:58.458355] [INFO ] [MAIN ] PKG: Full history saved. [2025-09-17T21:07:58.459298] [INFO ] [MAIN ] Update Progress: 1696/2371 symbols completed. PKG took 35.1s. Estimated remaining: 1h 38m 41s. Rate: 6.8 symbols/min [2025-09-17T21:07:58.631702] [INFO ] [MAIN ] PLNT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:07:58.681474] [DEBUG] [LOCAL ] PLNT: Loaded 48629 existing records from primary storage. [2025-09-17T21:07:58.681625] [INFO ] [MAIN ] PLNT: Loaded 48629 existing records. [2025-09-17T21:07:58.820860] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-04. [2025-09-17T21:07:58.861959] [WARN ] [MAIN ] PLNT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:07:58.862201] [INFO ] [MAIN ] PLNT: Wiping existing primary data before full refresh. [2025-09-17T21:07:58.862247] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-17T21:07:58.863182] [DEBUG] [LOCAL ] PLNT: Deleted primary data file. [2025-09-17T21:07:58.863232] [INFO ] [MAIN ] PLNT: Starting full primary refresh. [2025-09-17T21:07:59.231494] [INFO ] [REMOTE ] PLNT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:07:59.263581] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T21:07:59.551039] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T21:07:59.615746] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-05. [2025-09-17T21:08:00.415792] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-11. [2025-09-17T21:08:00.613176] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T21:08:00.991018] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-04 (2.17 seconds). [2025-09-17T21:08:01.215840] [INFO ] [REMOTE ] PLD: Fetching primary data for 2024-12. [2025-09-17T21:08:01.991589] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T21:08:02.015863] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-06. [2025-09-17T21:08:02.815754] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-05. [2025-09-17T21:08:02.960367] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T21:08:02.991981] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T21:08:03.615788] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-07. [2025-09-17T21:08:04.415911] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-01. [2025-09-17T21:08:04.871067] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T21:08:05.053949] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T21:08:05.215862] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2024-12. [2025-09-17T21:08:06.015936] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-08. [2025-09-17T21:08:06.195386] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T21:08:06.445979] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T21:08:06.815787] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-01. [2025-09-17T21:08:07.271706] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T21:08:07.615810] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-06. [2025-09-17T21:08:08.415802] [INFO ] [REMOTE ] PKX: Fetching primary data for 2025-09. [2025-09-17T21:08:08.619120] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T21:08:09.215790] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-02. [2025-09-17T21:08:09.693486] [DEBUG] [REMOTE ] PLNT: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T21:08:09.693969] [WARN ] [REMOTE ] PLNT: No data returned for month 2025-02 [2025-09-17T21:08:09.704315] [INFO ] [REMOTE ] PKX: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T21:08:09.708169] [INFO ] [REMOTE ] PKX: Full fetch complete (38311 records). [2025-09-17T21:08:09.708338] [DEBUG] [VALIDATOR ] PKX: Validating primary data. [2025-09-17T21:08:10.018041] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-03. [2025-09-17T21:08:10.103414] [DEBUG] [VALIDATOR ] PKX: All expected trading days are present. [2025-09-17T21:08:10.103542] [DEBUG] [VALIDATOR ] PKX: Primary data validation passed. [2025-09-17T21:08:10.104701] [INFO ] [MAIN ] PKX: Fetched primary data is valid. [2025-09-17T21:08:10.104764] [DEBUG] [LOCAL ] PKX: Saving primary data. [2025-09-17T21:08:10.136409] [DEBUG] [LOCAL ] PKX: Trimmed 38311 records to 25446 (keeping 200 days of data) [2025-09-17T21:08:10.138008] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-06 (2.52 seconds). [2025-09-17T21:08:10.305407] [DEBUG] [LOCAL ] PKX: Primary data saved (25446 records). [2025-09-17T21:08:10.305559] [INFO ] [MAIN ] PKX: Full history saved. [2025-09-17T21:08:10.305675] [INFO ] [MAIN ] Update Progress: 1697/2371 symbols completed. PKX took 41.0s. Estimated remaining: 1h 38m 33s. Rate: 6.8 symbols/min [2025-09-17T21:08:10.479276] [INFO ] [MAIN ] PLOW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:08:10.499747] [DEBUG] [LOCAL ] PLOW: Loaded 20830 existing records from primary storage. [2025-09-17T21:08:10.499889] [INFO ] [MAIN ] PLOW: Loaded 20830 existing records. [2025-09-17T21:08:10.679775] [WARN ] [MAIN ] PLOW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:08:10.680036] [INFO ] [MAIN ] PLOW: Wiping existing primary data before full refresh. [2025-09-17T21:08:10.680082] [INFO ] [LOCAL ] PLOW: Starting deletion of primary data. [2025-09-17T21:08:10.680627] [DEBUG] [LOCAL ] PLOW: Deleted primary data file. [2025-09-17T21:08:10.680703] [INFO ] [MAIN ] PLOW: Starting full primary refresh. [2025-09-17T21:08:10.824220] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-07. [2025-09-17T21:08:11.038794] [INFO ] [REMOTE ] PLOW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:08:11.479086] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T21:08:11.615777] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-04. [2025-09-17T21:08:12.415811] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-02. [2025-09-17T21:08:13.215853] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-11. [2025-09-17T21:08:13.481342] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-07 (2.66 seconds). [2025-09-17T21:08:13.545512] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T21:08:13.873867] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T21:08:14.015769] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-05. [2025-09-17T21:08:14.285732] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T21:08:14.815788] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-08. [2025-09-17T21:08:15.615784] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-03. [2025-09-17T21:08:15.842258] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T21:08:16.415821] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2024-12. [2025-09-17T21:08:16.808563] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T21:08:17.215788] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-06. [2025-09-17T21:08:17.514177] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T21:08:17.669160] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T21:08:18.015784] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-04. [2025-09-17T21:08:18.815801] [INFO ] [REMOTE ] PL: Fetching primary data for 2025-09. [2025-09-17T21:08:19.069011] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T21:08:19.598598] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T21:08:19.615679] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-05. [2025-09-17T21:08:20.415810] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-07. [2025-09-17T21:08:20.992833] [INFO ] [REMOTE ] PL: Incremental fetch complete for 2025-09 (2.18 seconds). [2025-09-17T21:08:21.002087] [INFO ] [REMOTE ] PL: Full fetch complete (76838 records). [2025-09-17T21:08:21.002441] [DEBUG] [VALIDATOR ] PL: Validating primary data. [2025-09-17T21:08:21.220992] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-01. [2025-09-17T21:08:21.433230] [DEBUG] [VALIDATOR ] PL: All expected trading days are present. [2025-09-17T21:08:21.433360] [DEBUG] [VALIDATOR ] PL: Primary data validation passed. [2025-09-17T21:08:21.434778] [INFO ] [MAIN ] PL: Fetched primary data is valid. [2025-09-17T21:08:21.434862] [DEBUG] [LOCAL ] PL: Saving primary data. [2025-09-17T21:08:21.436996] [DEBUG] [LOCAL ] PL: Trimmed 76838 records to 53104 (keeping 200 days of data) [2025-09-17T21:08:21.719928] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T21:08:21.853883] [DEBUG] [LOCAL ] PL: Primary data saved (53104 records). [2025-09-17T21:08:21.854204] [INFO ] [MAIN ] PL: Full history saved. [2025-09-17T21:08:21.854430] [INFO ] [MAIN ] Update Progress: 1698/2371 symbols completed. PL took 41.4s. Estimated remaining: 1h 38m 26s. Rate: 6.8 symbols/min [2025-09-17T21:08:22.017936] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-06. [2025-09-17T21:08:22.039790] [INFO ] [MAIN ] PLYM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:08:22.093688] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T21:08:22.122167] [DEBUG] [LOCAL ] PLYM: Loaded 32964 existing records from primary storage. [2025-09-17T21:08:22.122420] [INFO ] [MAIN ] PLYM: Loaded 32964 existing records. [2025-09-17T21:08:22.324051] [WARN ] [MAIN ] PLYM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:08:22.324589] [INFO ] [MAIN ] PLYM: Wiping existing primary data before full refresh. [2025-09-17T21:08:22.324688] [INFO ] [LOCAL ] PLYM: Starting deletion of primary data. [2025-09-17T21:08:22.330711] [DEBUG] [LOCAL ] PLYM: Deleted primary data file. [2025-09-17T21:08:22.339713] [INFO ] [MAIN ] PLYM: Starting full primary refresh. [2025-09-17T21:08:22.377434] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T21:08:22.749098] [INFO ] [REMOTE ] PLYM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:08:22.815785] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-08. [2025-09-17T21:08:23.615786] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-02. [2025-09-17T21:08:23.913789] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-06 (1.90 seconds). [2025-09-17T21:08:24.415763] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-07. [2025-09-17T21:08:24.531623] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T21:08:24.628799] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T21:08:25.215774] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-11. [2025-09-17T21:08:26.015851] [INFO ] [REMOTE ] PLNT: Fetching primary data for 2025-09. [2025-09-17T21:08:26.396298] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T21:08:26.531617] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-17T21:08:26.815791] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2024-12. [2025-09-17T21:08:27.253813] [INFO ] [REMOTE ] PLNT: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T21:08:27.259873] [INFO ] [REMOTE ] PLNT: Full fetch complete (63039 records). [2025-09-17T21:08:27.260048] [DEBUG] [VALIDATOR ] PLNT: Validating primary data. [2025-09-17T21:08:27.461715] [WARN ] [VALIDATOR ] PLNT: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T21:08:27.462368] [FATAL] [MAIN ] PLNT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:08:27.462421] [WARN ] [MAIN ] PLNT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:08:27.462460] [INFO ] [LOCAL ] PLNT: Starting deletion of primary data. [2025-09-17T21:08:27.462528] [DEBUG] [LOCAL ] PLNT: No primary data file found to delete. [2025-09-17T21:08:27.462566] [INFO ] [LOCAL ] PLNT: Starting deletion of derivative data. [2025-09-17T21:08:27.462941] [DEBUG] [LOCAL ] PLNT: Deleted derivative data file. [2025-09-17T21:08:27.463423] [INFO ] [MAIN ] Update Progress: 1699/2371 symbols completed. PLNT took 29.0s. Estimated remaining: 1h 38m 16s. Rate: 6.8 symbols/min [2025-09-17T21:08:27.621087] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-08. [2025-09-17T21:08:27.649619] [INFO ] [MAIN ] PM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:08:27.708234] [DEBUG] [LOCAL ] PM: Loaded 53666 existing records from primary storage. [2025-09-17T21:08:27.708395] [INFO ] [MAIN ] PM: Loaded 53666 existing records. [2025-09-17T21:08:27.888628] [WARN ] [MAIN ] PM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:08:27.888898] [INFO ] [MAIN ] PM: Wiping existing primary data before full refresh. [2025-09-17T21:08:27.888955] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-17T21:08:27.890086] [DEBUG] [LOCAL ] PM: Deleted primary data file. [2025-09-17T21:08:27.890148] [INFO ] [MAIN ] PM: Starting full primary refresh. [2025-09-17T21:08:28.257616] [INFO ] [REMOTE ] PM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:08:28.274042] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T21:08:28.415763] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-03. [2025-09-17T21:08:28.602042] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T21:08:29.215762] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-01. [2025-09-17T21:08:29.562556] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T21:08:30.015768] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-11. [2025-09-17T21:08:30.206664] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T21:08:30.815793] [INFO ] [REMOTE ] PLD: Fetching primary data for 2025-09. [2025-09-17T21:08:31.615749] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-04. [2025-09-17T21:08:31.844527] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T21:08:32.415842] [INFO ] [REMOTE ] PM: Fetching primary data for 2024-12. [2025-09-17T21:08:32.536547] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T21:08:32.715471] [INFO ] [REMOTE ] PLD: Incremental fetch complete for 2025-09 (1.90 seconds). [2025-09-17T21:08:32.726081] [INFO ] [REMOTE ] PLD: Full fetch complete (77282 records). [2025-09-17T21:08:32.726344] [DEBUG] [VALIDATOR ] PLD: Validating primary data. [2025-09-17T21:08:33.222602] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-05. [2025-09-17T21:08:33.292386] [DEBUG] [VALIDATOR ] PLD: All expected trading days are present. [2025-09-17T21:08:33.292516] [DEBUG] [VALIDATOR ] PLD: Primary data validation passed. [2025-09-17T21:08:33.293801] [INFO ] [MAIN ] PLD: Fetched primary data is valid. [2025-09-17T21:08:33.293910] [DEBUG] [LOCAL ] PLD: Saving primary data. [2025-09-17T21:08:33.295628] [DEBUG] [LOCAL ] PLD: Trimmed 77282 records to 53486 (keeping 200 days of data) [2025-09-17T21:08:33.682846] [DEBUG] [LOCAL ] PLD: Primary data saved (53486 records). [2025-09-17T21:08:33.683022] [INFO ] [MAIN ] PLD: Full history saved. [2025-09-17T21:08:33.683125] [INFO ] [MAIN ] Update Progress: 1700/2371 symbols completed. PLD took 37.7s. Estimated remaining: 1h 38m 6s. Rate: 6.8 symbols/min [2025-09-17T21:08:33.863394] [INFO ] [MAIN ] PML: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:08:33.883781] [DEBUG] [LOCAL ] PML: Loaded 20193 existing records from primary storage. [2025-09-17T21:08:33.883971] [INFO ] [MAIN ] PML: Loaded 20193 existing records. [2025-09-17T21:08:34.030849] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-02. [2025-09-17T21:08:34.073013] [WARN ] [MAIN ] PML: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:08:34.073295] [INFO ] [MAIN ] PML: Wiping existing primary data before full refresh. [2025-09-17T21:08:34.073342] [INFO ] [LOCAL ] PML: Starting deletion of primary data. [2025-09-17T21:08:34.073860] [DEBUG] [LOCAL ] PML: Deleted primary data file. [2025-09-17T21:08:34.073910] [INFO ] [MAIN ] PML: Starting full primary refresh. [2025-09-17T21:08:34.471152] [INFO ] [REMOTE ] PML: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:08:34.473110] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T21:08:34.555708] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2024-12 (2.14 seconds). [2025-09-17T21:08:34.815735] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-01. [2025-09-17T21:08:35.063588] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T21:08:35.615825] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-03. [2025-09-17T21:08:36.415759] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-06. [2025-09-17T21:08:36.802347] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T21:08:36.863749] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T21:08:37.215750] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-04. [2025-09-17T21:08:37.230863] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T21:08:38.015777] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-02. [2025-09-17T21:08:38.621416] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T21:08:38.815813] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-05. [2025-09-17T21:08:39.615845] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-11. [2025-09-17T21:08:40.216504] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-02 (2.20 seconds). [2025-09-17T21:08:40.268555] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T21:08:40.415802] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-07. [2025-09-17T21:08:40.551702] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T21:08:41.215801] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-03. [2025-09-17T21:08:41.320943] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T21:08:42.015794] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-06. [2025-09-17T21:08:42.815844] [INFO ] [REMOTE ] PML: Fetching primary data for 2024-12. [2025-09-17T21:08:43.299303] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T21:08:43.584214] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-03 (2.37 seconds). [2025-09-17T21:08:43.615726] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-04. [2025-09-17T21:08:44.050069] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T21:08:44.415833] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-01. [2025-09-17T21:08:45.215811] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-08. [2025-09-17T21:08:45.503954] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T21:08:45.716756] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T21:08:45.989078] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T21:08:46.015775] [INFO ] [REMOTE ] PLOW: Fetching primary data for 2025-09. [2025-09-17T21:08:46.815751] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-05. [2025-09-17T21:08:47.027331] [INFO ] [REMOTE ] PLOW: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T21:08:47.029871] [INFO ] [REMOTE ] PLOW: Full fetch complete (28846 records). [2025-09-17T21:08:47.029961] [DEBUG] [VALIDATOR ] PLOW: Validating primary data. [2025-09-17T21:08:47.396072] [DEBUG] [VALIDATOR ] PLOW: All expected trading days are present. [2025-09-17T21:08:47.396150] [DEBUG] [VALIDATOR ] PLOW: Primary data validation passed. [2025-09-17T21:08:47.396755] [INFO ] [MAIN ] PLOW: Fetched primary data is valid. [2025-09-17T21:08:47.396814] [DEBUG] [LOCAL ] PLOW: Saving primary data. [2025-09-17T21:08:47.397518] [DEBUG] [LOCAL ] PLOW: Trimmed 28846 records to 20777 (keeping 200 days of data) [2025-09-17T21:08:47.531740] [DEBUG] [LOCAL ] PLOW: Primary data saved (20777 records). [2025-09-17T21:08:47.531868] [INFO ] [MAIN ] PLOW: Full history saved. [2025-09-17T21:08:47.531954] [INFO ] [MAIN ] Update Progress: 1701/2371 symbols completed. PLOW took 37.2s. Estimated remaining: 1h 37m 59s. Rate: 6.8 symbols/min [2025-09-17T21:08:47.621377] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-07. [2025-09-17T21:08:47.702437] [INFO ] [MAIN ] PMM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:08:47.714916] [DEBUG] [LOCAL ] PMM: Loaded 10757 existing records from primary storage. [2025-09-17T21:08:47.715036] [INFO ] [MAIN ] PMM: Loaded 10757 existing records. [2025-09-17T21:08:47.897983] [WARN ] [MAIN ] PMM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:08:47.898256] [INFO ] [MAIN ] PMM: Wiping existing primary data before full refresh. [2025-09-17T21:08:47.898311] [INFO ] [LOCAL ] PMM: Starting deletion of primary data. [2025-09-17T21:08:47.898807] [DEBUG] [LOCAL ] PMM: Deleted primary data file. [2025-09-17T21:08:47.898863] [INFO ] [MAIN ] PMM: Starting full primary refresh. [2025-09-17T21:08:48.262545] [INFO ] [REMOTE ] PMM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:08:48.415733] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-11. [2025-09-17T21:08:48.647833] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T21:08:48.990057] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T21:08:49.215792] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-02. [2025-09-17T21:08:49.274273] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T21:08:50.015828] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-06. [2025-09-17T21:08:50.170717] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T21:08:50.815817] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-08. [2025-09-17T21:08:51.615762] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-03. [2025-09-17T21:08:51.836972] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T21:08:52.348827] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T21:08:52.415812] [INFO ] [REMOTE ] PMM: Fetching primary data for 2024-12. [2025-09-17T21:08:52.472855] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T21:08:53.215794] [INFO ] [REMOTE ] PLYM: Fetching primary data for 2025-09. [2025-09-17T21:08:53.700531] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T21:08:54.015792] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-04. [2025-09-17T21:08:54.725983] [INFO ] [REMOTE ] PLYM: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T21:08:54.731523] [INFO ] [REMOTE ] PLYM: Full fetch complete (45938 records). [2025-09-17T21:08:54.731621] [DEBUG] [VALIDATOR ] PLYM: Validating primary data. [2025-09-17T21:08:54.823285] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-07. [2025-09-17T21:08:55.129426] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T21:08:55.136443] [DEBUG] [VALIDATOR ] PLYM: All expected trading days are present. [2025-09-17T21:08:55.136866] [DEBUG] [VALIDATOR ] PLYM: Primary data validation passed. [2025-09-17T21:08:55.137784] [INFO ] [MAIN ] PLYM: Fetched primary data is valid. [2025-09-17T21:08:55.138115] [DEBUG] [LOCAL ] PLYM: Saving primary data. [2025-09-17T21:08:55.139494] [DEBUG] [LOCAL ] PLYM: Trimmed 45938 records to 33009 (keeping 200 days of data) [2025-09-17T21:08:55.343665] [DEBUG] [LOCAL ] PLYM: Primary data saved (33009 records). [2025-09-17T21:08:55.343808] [INFO ] [MAIN ] PLYM: Full history saved. [2025-09-17T21:08:55.343919] [INFO ] [MAIN ] Update Progress: 1702/2371 symbols completed. PLYM took 33.5s. Estimated remaining: 1h 37m 50s. Rate: 6.8 symbols/min [2025-09-17T21:08:55.529924] [INFO ] [MAIN ] PMO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:08:55.541343] [DEBUG] [LOCAL ] PMO: Loaded 10707 existing records from primary storage. [2025-09-17T21:08:55.541462] [INFO ] [MAIN ] PMO: Loaded 10707 existing records. [2025-09-17T21:08:55.620792] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-01. [2025-09-17T21:08:55.724933] [WARN ] [MAIN ] PMO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:08:55.725201] [INFO ] [MAIN ] PMO: Wiping existing primary data before full refresh. [2025-09-17T21:08:55.725247] [INFO ] [LOCAL ] PMO: Starting deletion of primary data. [2025-09-17T21:08:55.725572] [DEBUG] [LOCAL ] PMO: Deleted primary data file. [2025-09-17T21:08:55.725614] [INFO ] [MAIN ] PMO: Starting full primary refresh. [2025-09-17T21:08:56.085377] [INFO ] [REMOTE ] PMO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:08:56.415781] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-11. [2025-09-17T21:08:56.638547] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T21:08:57.000771] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T21:08:57.215806] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-08. [2025-09-17T21:08:57.448032] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T21:08:58.015810] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-02. [2025-09-17T21:08:58.209606] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T21:08:58.815792] [INFO ] [REMOTE ] PMO: Fetching primary data for 2024-12. [2025-09-17T21:08:59.142421] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T21:08:59.615841] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-05. [2025-09-17T21:08:59.630873] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T21:09:00.415762] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-03. [2025-09-17T21:09:00.683621] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T21:09:01.082495] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T21:09:01.215747] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-06. [2025-09-17T21:09:02.015829] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-01. [2025-09-17T21:09:02.359207] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T21:09:02.815835] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-07. [2025-09-17T21:09:03.615777] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-04. [2025-09-17T21:09:04.085999] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-17T21:09:04.254095] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T21:09:04.415770] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-08. [2025-09-17T21:09:05.215790] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-02. [2025-09-17T21:09:05.323615] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T21:09:05.834365] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T21:09:05.905817] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-02 (0.69 seconds). [2025-09-17T21:09:06.015799] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-05. [2025-09-17T21:09:06.787803] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T21:09:06.815681] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-06. [2025-09-17T21:09:07.597349] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T21:09:07.615678] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-07. [2025-09-17T21:09:08.415839] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-03. [2025-09-17T21:09:08.502204] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T21:09:09.215802] [INFO ] [REMOTE ] PML: Fetching primary data for 2025-09. [2025-09-17T21:09:09.344676] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T21:09:10.015786] [INFO ] [REMOTE ] PM: Fetching primary data for 2025-09. [2025-09-17T21:09:10.077070] [INFO ] [REMOTE ] PML: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T21:09:10.081210] [INFO ] [REMOTE ] PML: Full fetch complete (29579 records). [2025-09-17T21:09:10.081284] [DEBUG] [VALIDATOR ] PML: Validating primary data. [2025-09-17T21:09:10.469931] [DEBUG] [VALIDATOR ] PML: All expected trading days are present. [2025-09-17T21:09:10.470066] [DEBUG] [VALIDATOR ] PML: Primary data validation passed. [2025-09-17T21:09:10.471016] [INFO ] [MAIN ] PML: Fetched primary data is valid. [2025-09-17T21:09:10.471191] [DEBUG] [LOCAL ] PML: Saving primary data. [2025-09-17T21:09:10.472223] [DEBUG] [LOCAL ] PML: Trimmed 29579 records to 20318 (keeping 200 days of data) [2025-09-17T21:09:10.583862] [INFO ] [REMOTE ] PM: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T21:09:10.596878] [INFO ] [REMOTE ] PM: Full fetch complete (77199 records). [2025-09-17T21:09:10.598707] [DEBUG] [VALIDATOR ] PM: Validating primary data. [2025-09-17T21:09:10.603066] [FATAL] [VALIDATOR ] PM: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:09:10.605625] [FATAL] [MAIN ] PM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:09:10.606255] [WARN ] [MAIN ] PM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:09:10.606330] [INFO ] [LOCAL ] PM: Starting deletion of primary data. [2025-09-17T21:09:10.606928] [DEBUG] [LOCAL ] PM: No primary data file found to delete. [2025-09-17T21:09:10.607489] [INFO ] [LOCAL ] PM: Starting deletion of derivative data. [2025-09-17T21:09:10.609015] [DEBUG] [LOCAL ] PM: Deleted derivative data file. [2025-09-17T21:09:10.611507] [INFO ] [MAIN ] Update Progress: 1703/2371 symbols completed. PM took 43.1s. Estimated remaining: 1h 37m 44s. Rate: 6.8 symbols/min [2025-09-17T21:09:10.798733] [INFO ] [MAIN ] PMT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:09:10.813046] [DEBUG] [LOCAL ] PML: Primary data saved (20318 records). [2025-09-17T21:09:10.813210] [INFO ] [MAIN ] PML: Full history saved. [2025-09-17T21:09:10.813346] [INFO ] [MAIN ] Update Progress: 1704/2371 symbols completed. PML took 37.1s. Estimated remaining: 1h 37m 31s. Rate: 6.8 symbols/min [2025-09-17T21:09:10.818787] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-08. [2025-09-17T21:09:11.002066] [INFO ] [MAIN ] PMTU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:09:11.003185] [DEBUG] [LOCAL ] PMTU: No existing data file found in primary storage. [2025-09-17T21:09:11.003299] [WARN ] [MAIN ] PMTU: No existing data found, performing full refresh instead. [2025-09-17T21:09:11.018391] [INFO ] [MAIN ] PMTU: Wiping existing primary data before full refresh. [2025-09-17T21:09:11.018468] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-17T21:09:11.019256] [DEBUG] [LOCAL ] PMT: Loaded 40314 existing records from primary storage. [2025-09-17T21:09:11.019368] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-17T21:09:11.019436] [INFO ] [MAIN ] PMT: Loaded 40314 existing records. [2025-09-17T21:09:11.019509] [INFO ] [MAIN ] PMTU: Starting full primary refresh. [2025-09-17T21:09:11.381460] [WARN ] [MAIN ] PMT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:09:11.397496] [INFO ] [MAIN ] PMT: Wiping existing primary data before full refresh. [2025-09-17T21:09:11.405488] [INFO ] [LOCAL ] PMT: Starting deletion of primary data. [2025-09-17T21:09:11.491696] [DEBUG] [LOCAL ] PMT: Deleted primary data file. [2025-09-17T21:09:11.502102] [INFO ] [MAIN ] PMT: Starting full primary refresh. [2025-09-17T21:09:11.623395] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-04. [2025-09-17T21:09:11.692896] [INFO ] [REMOTE ] PMTU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:09:11.899377] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T21:09:12.009754] [INFO ] [REMOTE ] PMT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:09:12.415778] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-11. [2025-09-17T21:09:12.615436] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T21:09:13.215779] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-05. [2025-09-17T21:09:13.652010] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T21:09:14.015782] [INFO ] [REMOTE ] PMT: Fetching primary data for 2024-12. [2025-09-17T21:09:14.089077] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T21:09:14.815816] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-06. [2025-09-17T21:09:15.395704] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T21:09:15.615790] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-01. [2025-09-17T21:09:15.690952] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T21:09:16.415801] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-11. [2025-09-17T21:09:16.840077] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T21:09:16.866080] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T21:09:17.215780] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-02. [2025-09-17T21:09:18.015788] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2024-12. [2025-09-17T21:09:18.810324] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T21:09:18.822012] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-01. [2025-09-17T21:09:18.842138] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T21:09:19.412257] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T21:09:19.615936] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-02. [2025-09-17T21:09:20.415776] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-03. [2025-09-17T21:09:20.939250] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T21:09:21.215786] [INFO ] [REMOTE ] PMM: Fetching primary data for 2025-09. [2025-09-17T21:09:21.911029] [INFO ] [REMOTE ] PMM: Incremental fetch complete for 2025-09 (0.70 seconds). [2025-09-17T21:09:21.912985] [INFO ] [REMOTE ] PMM: Full fetch complete (18437 records). [2025-09-17T21:09:21.913086] [DEBUG] [VALIDATOR ] PMM: Validating primary data. [2025-09-17T21:09:22.020882] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-03. [2025-09-17T21:09:22.285967] [DEBUG] [VALIDATOR ] PMM: All expected trading days are present. [2025-09-17T21:09:22.286045] [DEBUG] [VALIDATOR ] PMM: Primary data validation passed. [2025-09-17T21:09:22.286501] [INFO ] [MAIN ] PMM: Fetched primary data is valid. [2025-09-17T21:09:22.286576] [DEBUG] [LOCAL ] PMM: Saving primary data. [2025-09-17T21:09:22.287136] [DEBUG] [LOCAL ] PMM: Trimmed 18437 records to 10771 (keeping 200 days of data) [2025-09-17T21:09:22.353538] [DEBUG] [LOCAL ] PMM: Primary data saved (10771 records). [2025-09-17T21:09:22.353847] [INFO ] [MAIN ] PMM: Full history saved. [2025-09-17T21:09:22.354082] [INFO ] [MAIN ] Update Progress: 1705/2371 symbols completed. PMM took 34.8s. Estimated remaining: 1h 37m 24s. Rate: 6.8 symbols/min [2025-09-17T21:09:22.533160] [INFO ] [MAIN ] PMTV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:09:22.555826] [DEBUG] [LOCAL ] PMTV: No existing data file found in primary storage. [2025-09-17T21:09:22.558538] [WARN ] [MAIN ] PMTV: No existing data found, performing full refresh instead. [2025-09-17T21:09:22.560954] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T21:09:22.561105] [INFO ] [MAIN ] PMTV: Wiping existing primary data before full refresh. [2025-09-17T21:09:22.562548] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-17T21:09:22.563013] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-17T21:09:22.564376] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-03 (2.15 seconds). [2025-09-17T21:09:22.572544] [INFO ] [MAIN ] PMTV: Starting full primary refresh. [2025-09-17T21:09:22.821032] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-07. [2025-09-17T21:09:22.926457] [INFO ] [REMOTE ] PMTV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:09:23.615827] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-04. [2025-09-17T21:09:23.669817] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T21:09:24.415776] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-04. [2025-09-17T21:09:25.007335] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T21:09:25.215800] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-08. [2025-09-17T21:09:25.467588] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T21:09:26.015810] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-05. [2025-09-17T21:09:26.028736] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T21:09:26.815775] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-11. [2025-09-17T21:09:27.122289] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:09:27.122870] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-11 [2025-09-17T21:09:27.382322] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T21:09:27.615790] [INFO ] [REMOTE ] PMO: Fetching primary data for 2025-09. [2025-09-17T21:09:28.365580] [INFO ] [REMOTE ] PMO: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T21:09:28.367866] [INFO ] [REMOTE ] PMO: Full fetch complete (17685 records). [2025-09-17T21:09:28.367994] [DEBUG] [VALIDATOR ] PMO: Validating primary data. [2025-09-17T21:09:28.425208] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2024-12. [2025-09-17T21:09:28.759915] [DEBUG] [VALIDATOR ] PMO: All expected trading days are present. [2025-09-17T21:09:28.759995] [DEBUG] [VALIDATOR ] PMO: Primary data validation passed. [2025-09-17T21:09:28.760384] [INFO ] [MAIN ] PMO: Fetched primary data is valid. [2025-09-17T21:09:28.760421] [DEBUG] [LOCAL ] PMO: Saving primary data. [2025-09-17T21:09:28.760971] [DEBUG] [LOCAL ] PMO: Trimmed 17685 records to 10752 (keeping 200 days of data) [2025-09-17T21:09:28.789962] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:09:28.809970] [WARN ] [REMOTE ] PMTV: No data returned for month 2024-12 [2025-09-17T21:09:28.827566] [DEBUG] [LOCAL ] PMO: Primary data saved (10752 records). [2025-09-17T21:09:28.827674] [INFO ] [MAIN ] PMO: Full history saved. [2025-09-17T21:09:28.827769] [INFO ] [MAIN ] Update Progress: 1706/2371 symbols completed. PMO took 33.5s. Estimated remaining: 1h 37m 14s. Rate: 6.8 symbols/min [2025-09-17T21:09:28.996263] [INFO ] [MAIN ] PMTW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:09:28.996457] [DEBUG] [LOCAL ] PMTW: No existing data file found in primary storage. [2025-09-17T21:09:28.996494] [WARN ] [MAIN ] PMTW: No existing data found, performing full refresh instead. [2025-09-17T21:09:28.996611] [INFO ] [MAIN ] PMTW: Wiping existing primary data before full refresh. [2025-09-17T21:09:28.996670] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-17T21:09:28.996714] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-17T21:09:28.996747] [INFO ] [MAIN ] PMTW: Starting full primary refresh. [2025-09-17T21:09:29.220923] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-06. [2025-09-17T21:09:29.355112] [INFO ] [REMOTE ] PMTW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:09:30.015790] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-11. [2025-09-17T21:09:30.406081] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:09:30.406457] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-11 [2025-09-17T21:09:30.624141] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T21:09:30.815754] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2024-12. [2025-09-17T21:09:31.065237] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:09:31.065597] [WARN ] [REMOTE ] PMTW: No data returned for month 2024-12 [2025-09-17T21:09:31.615791] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-01. [2025-09-17T21:09:32.130216] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:09:32.130551] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-01 [2025-09-17T21:09:32.415792] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-01. [2025-09-17T21:09:32.866897] [DEBUG] [REMOTE ] PMTV: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:09:32.867231] [WARN ] [REMOTE ] PMTV: No data returned for month 2025-01 [2025-09-17T21:09:33.215828] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-05. [2025-09-17T21:09:33.694946] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T21:09:34.015783] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-02. [2025-09-17T21:09:34.627575] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T21:09:34.815787] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-06. [2025-09-17T21:09:35.461679] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T21:09:35.615798] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-07. [2025-09-17T21:09:36.415804] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-07. [2025-09-17T21:09:36.889029] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T21:09:37.215777] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-08. [2025-09-17T21:09:37.322837] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T21:09:37.567003] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-08 (0.35 seconds). [2025-09-17T21:09:38.015780] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-08. [2025-09-17T21:09:38.815812] [INFO ] [REMOTE ] PMTU: Fetching primary data for 2025-09. [2025-09-17T21:09:39.187806] [INFO ] [REMOTE ] PMTU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T21:09:39.188732] [INFO ] [REMOTE ] PMTU: Full fetch complete (1192 records). [2025-09-17T21:09:39.188798] [DEBUG] [VALIDATOR ] PMTU: Validating primary data. [2025-09-17T21:09:39.387135] [WARN ] [VALIDATOR ] PMTU: Validation failed - insufficient historical data. Have 191 unique days, need 200 days [2025-09-17T21:09:39.387374] [FATAL] [MAIN ] PMTU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:09:39.387514] [WARN ] [MAIN ] PMTU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:09:39.387632] [INFO ] [LOCAL ] PMTU: Starting deletion of primary data. [2025-09-17T21:09:39.387871] [DEBUG] [LOCAL ] PMTU: No primary data file found to delete. [2025-09-17T21:09:39.387925] [INFO ] [LOCAL ] PMTU: Starting deletion of derivative data. [2025-09-17T21:09:39.388043] [DEBUG] [LOCAL ] PMTU: No derivative data file found to delete. [2025-09-17T21:09:39.388145] [INFO ] [MAIN ] Update Progress: 1707/2371 symbols completed. PMTU took 28.6s. Estimated remaining: 1h 37m 6s. Rate: 6.8 symbols/min [2025-09-17T21:09:39.571828] [INFO ] [MAIN ] PNC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:09:39.588684] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T21:09:39.615790] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-03. [2025-09-17T21:09:39.658411] [DEBUG] [LOCAL ] PNC: Loaded 52383 existing records from primary storage. [2025-09-17T21:09:39.658564] [INFO ] [MAIN ] PNC: Loaded 52383 existing records. [2025-09-17T21:09:39.837831] [WARN ] [MAIN ] PNC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:09:39.838088] [INFO ] [MAIN ] PNC: Wiping existing primary data before full refresh. [2025-09-17T21:09:39.838133] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-17T21:09:39.839521] [DEBUG] [LOCAL ] PNC: Deleted primary data file. [2025-09-17T21:09:39.839579] [INFO ] [MAIN ] PNC: Starting full primary refresh. [2025-09-17T21:09:40.211490] [INFO ] [REMOTE ] PNC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:09:40.269207] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T21:09:40.415777] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-02. [2025-09-17T21:09:40.715072] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:09:40.715435] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-02 [2025-09-17T21:09:41.215839] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-04. [2025-09-17T21:09:41.893907] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T21:09:42.015792] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-11. [2025-09-17T21:09:42.815802] [INFO ] [REMOTE ] PMT: Fetching primary data for 2025-09. [2025-09-17T21:09:43.582211] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T21:09:43.615735] [INFO ] [REMOTE ] PNC: Fetching primary data for 2024-12. [2025-09-17T21:09:44.216067] [INFO ] [REMOTE ] PMT: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T21:09:44.220993] [INFO ] [REMOTE ] PMT: Full fetch complete (57810 records). [2025-09-17T21:09:44.221104] [DEBUG] [VALIDATOR ] PMT: Validating primary data. [2025-09-17T21:09:44.419351] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-05. [2025-09-17T21:09:44.644859] [DEBUG] [VALIDATOR ] PMT: All expected trading days are present. [2025-09-17T21:09:44.644962] [DEBUG] [VALIDATOR ] PMT: Primary data validation passed. [2025-09-17T21:09:44.646027] [INFO ] [MAIN ] PMT: Fetched primary data is valid. [2025-09-17T21:09:44.646091] [DEBUG] [LOCAL ] PMT: Saving primary data. [2025-09-17T21:09:44.647660] [DEBUG] [LOCAL ] PMT: Trimmed 57810 records to 40272 (keeping 200 days of data) [2025-09-17T21:09:44.902866] [DEBUG] [LOCAL ] PMT: Primary data saved (40272 records). [2025-09-17T21:09:44.903006] [INFO ] [MAIN ] PMT: Full history saved. [2025-09-17T21:09:44.903884] [INFO ] [MAIN ] Update Progress: 1708/2371 symbols completed. PMT took 34.3s. Estimated remaining: 1h 36m 56s. Rate: 6.8 symbols/min [2025-09-17T21:09:45.075208] [INFO ] [MAIN ] PNI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:09:45.089909] [DEBUG] [LOCAL ] PNI: Loaded 6704 existing records from primary storage. [2025-09-17T21:09:45.090048] [INFO ] [MAIN ] PNI: Loaded 6704 existing records. [2025-09-17T21:09:45.217521] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-03. [2025-09-17T21:09:45.228549] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T21:09:45.288110] [WARN ] [MAIN ] PNI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:09:45.288378] [INFO ] [MAIN ] PNI: Wiping existing primary data before full refresh. [2025-09-17T21:09:45.288429] [INFO ] [LOCAL ] PNI: Starting deletion of primary data. [2025-09-17T21:09:45.288762] [DEBUG] [LOCAL ] PNI: Deleted primary data file. [2025-09-17T21:09:45.288818] [INFO ] [MAIN ] PNI: Starting full primary refresh. [2025-09-17T21:09:45.529127] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:09:45.551805] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-03 [2025-09-17T21:09:45.648372] [INFO ] [REMOTE ] PNI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:09:45.678529] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-17T21:09:46.015790] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-06. [2025-09-17T21:09:46.716004] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T21:09:46.815757] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-01. [2025-09-17T21:09:47.615824] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-11. [2025-09-17T21:09:48.183708] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T21:09:48.416344] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-07. [2025-09-17T21:09:48.421755] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T21:09:48.884738] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T21:09:49.215791] [INFO ] [REMOTE ] PNI: Fetching primary data for 2024-12. [2025-09-17T21:09:50.004264] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T21:09:50.015673] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-01. [2025-09-17T21:09:50.785118] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T21:09:50.815730] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-02. [2025-09-17T21:09:51.323535] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T21:09:51.615791] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-04. [2025-09-17T21:09:52.198845] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:09:52.199413] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-04 [2025-09-17T21:09:52.415827] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-03. [2025-09-17T21:09:53.079934] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-03 (0.66 seconds). [2025-09-17T21:09:53.215805] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-04. [2025-09-17T21:09:53.955528] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T21:09:54.015824] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-05. [2025-09-17T21:09:54.719541] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T21:09:54.815767] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-08. [2025-09-17T21:09:55.440785] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T21:09:55.615787] [INFO ] [REMOTE ] PMTV: Fetching primary data for 2025-09. [2025-09-17T21:09:56.138918] [INFO ] [REMOTE ] PMTV: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T21:09:56.140103] [INFO ] [REMOTE ] PMTV: Full fetch complete (6040 records). [2025-09-17T21:09:56.140172] [DEBUG] [VALIDATOR ] PMTV: Validating primary data. [2025-09-17T21:09:56.323276] [WARN ] [VALIDATOR ] PMTV: Validation failed - insufficient historical data. Have 148 unique days, need 200 days [2025-09-17T21:09:56.324087] [FATAL] [MAIN ] PMTV: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:09:56.324140] [WARN ] [MAIN ] PMTV: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:09:56.324179] [INFO ] [LOCAL ] PMTV: Starting deletion of primary data. [2025-09-17T21:09:56.324244] [DEBUG] [LOCAL ] PMTV: No primary data file found to delete. [2025-09-17T21:09:56.324296] [INFO ] [LOCAL ] PMTV: Starting deletion of derivative data. [2025-09-17T21:09:56.324345] [DEBUG] [LOCAL ] PMTV: No derivative data file found to delete. [2025-09-17T21:09:56.324427] [INFO ] [MAIN ] Update Progress: 1709/2371 symbols completed. PMTV took 34.0s. Estimated remaining: 1h 36m 48s. Rate: 6.8 symbols/min [2025-09-17T21:09:56.423336] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-02. [2025-09-17T21:09:56.496844] [INFO ] [MAIN ] PNNT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:09:56.530708] [DEBUG] [LOCAL ] PNNT: Loaded 32998 existing records from primary storage. [2025-09-17T21:09:56.530847] [INFO ] [MAIN ] PNNT: Loaded 32998 existing records. [2025-09-17T21:09:56.709820] [WARN ] [MAIN ] PNNT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:09:56.710127] [INFO ] [MAIN ] PNNT: Wiping existing primary data before full refresh. [2025-09-17T21:09:56.710172] [INFO ] [LOCAL ] PNNT: Starting deletion of primary data. [2025-09-17T21:09:56.711051] [DEBUG] [LOCAL ] PNNT: Deleted primary data file. [2025-09-17T21:09:56.711100] [INFO ] [MAIN ] PNNT: Starting full primary refresh. [2025-09-17T21:09:57.068026] [INFO ] [REMOTE ] PNNT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:09:57.215765] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-11. [2025-09-17T21:09:58.000835] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T21:09:58.015669] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-03. [2025-09-17T21:09:58.587185] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T21:09:58.815811] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2024-12. [2025-09-17T21:09:59.615756] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-06. [2025-09-17T21:09:59.769528] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T21:10:00.147871] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T21:10:00.359666] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T21:10:00.415796] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-05. [2025-09-17T21:10:00.722326] [DEBUG] [REMOTE ] PMTW: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:10:00.722674] [WARN ] [REMOTE ] PMTW: No data returned for month 2025-05 [2025-09-17T21:10:01.215825] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-06. [2025-09-17T21:10:02.015835] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-07. [2025-09-17T21:10:02.032839] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T21:10:02.732958] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T21:10:02.815832] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-07. [2025-09-17T21:10:03.591125] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T21:10:03.615755] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-08. [2025-09-17T21:10:04.415707] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-01. [2025-09-17T21:10:04.464767] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T21:10:05.215781] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-04. [2025-09-17T21:10:06.015814] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-08. [2025-09-17T21:10:06.050789] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T21:10:06.815802] [INFO ] [REMOTE ] PMTW: Fetching primary data for 2025-09. [2025-09-17T21:10:06.844002] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T21:10:07.107600] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T21:10:07.197410] [INFO ] [REMOTE ] PMTW: Incremental fetch complete for 2025-09 (0.38 seconds). [2025-09-17T21:10:07.198485] [INFO ] [REMOTE ] PMTW: Full fetch complete (3601 records). [2025-09-17T21:10:07.198553] [DEBUG] [VALIDATOR ] PMTW: Validating primary data. [2025-09-17T21:10:07.382728] [WARN ] [VALIDATOR ] PMTW: Validation failed - insufficient historical data. Have 67 unique days, need 200 days [2025-09-17T21:10:07.382943] [FATAL] [MAIN ] PMTW: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:10:07.382997] [WARN ] [MAIN ] PMTW: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:10:07.383047] [INFO ] [LOCAL ] PMTW: Starting deletion of primary data. [2025-09-17T21:10:07.383120] [DEBUG] [LOCAL ] PMTW: No primary data file found to delete. [2025-09-17T21:10:07.383158] [INFO ] [LOCAL ] PMTW: Starting deletion of derivative data. [2025-09-17T21:10:07.383199] [DEBUG] [LOCAL ] PMTW: No derivative data file found to delete. [2025-09-17T21:10:07.383264] [INFO ] [MAIN ] Update Progress: 1710/2371 symbols completed. PMTW took 38.6s. Estimated remaining: 1h 36m 40s. Rate: 6.8 symbols/min [2025-09-17T21:10:07.552019] [INFO ] [MAIN ] PNR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:10:07.605018] [DEBUG] [LOCAL ] PNR: Loaded 48283 existing records from primary storage. [2025-09-17T21:10:07.605172] [INFO ] [MAIN ] PNR: Loaded 48283 existing records. [2025-09-17T21:10:07.625628] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-02. [2025-09-17T21:10:07.790397] [WARN ] [MAIN ] PNR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:10:07.790722] [INFO ] [MAIN ] PNR: Wiping existing primary data before full refresh. [2025-09-17T21:10:07.790785] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-17T21:10:07.791961] [DEBUG] [LOCAL ] PNR: Deleted primary data file. [2025-09-17T21:10:07.792024] [INFO ] [MAIN ] PNR: Starting full primary refresh. [2025-09-17T21:10:08.170082] [INFO ] [REMOTE ] PNR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:10:08.415777] [INFO ] [REMOTE ] PNI: Fetching primary data for 2025-09. [2025-09-17T21:10:08.725792] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T21:10:09.216154] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-11. [2025-09-17T21:10:09.217564] [INFO ] [REMOTE ] PNI: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T21:10:09.221703] [INFO ] [REMOTE ] PNI: Full fetch complete (10114 records). [2025-09-17T21:10:09.221800] [DEBUG] [VALIDATOR ] PNI: Validating primary data. [2025-09-17T21:10:09.597398] [DEBUG] [VALIDATOR ] PNI: All expected trading days are present. [2025-09-17T21:10:09.597485] [DEBUG] [VALIDATOR ] PNI: Primary data validation passed. [2025-09-17T21:10:09.597857] [INFO ] [MAIN ] PNI: Fetched primary data is valid. [2025-09-17T21:10:09.597925] [DEBUG] [LOCAL ] PNI: Saving primary data. [2025-09-17T21:10:09.598458] [DEBUG] [LOCAL ] PNI: Trimmed 10114 records to 6795 (keeping 200 days of data) [2025-09-17T21:10:09.642103] [DEBUG] [LOCAL ] PNI: Primary data saved (6795 records). [2025-09-17T21:10:09.642231] [INFO ] [MAIN ] PNI: Full history saved. [2025-09-17T21:10:09.642336] [INFO ] [MAIN ] Update Progress: 1711/2371 symbols completed. PNI took 24.7s. Estimated remaining: 1h 36m 29s. Rate: 6.8 symbols/min [2025-09-17T21:10:09.820126] [INFO ] [MAIN ] PNW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:10:09.865424] [DEBUG] [LOCAL ] PNW: Loaded 46144 existing records from primary storage. [2025-09-17T21:10:09.865578] [INFO ] [MAIN ] PNW: Loaded 46144 existing records. [2025-09-17T21:10:10.022521] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-03. [2025-09-17T21:10:10.054613] [WARN ] [MAIN ] PNW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:10:10.054925] [INFO ] [MAIN ] PNW: Wiping existing primary data before full refresh. [2025-09-17T21:10:10.054982] [INFO ] [LOCAL ] PNW: Starting deletion of primary data. [2025-09-17T21:10:10.056118] [DEBUG] [LOCAL ] PNW: Deleted primary data file. [2025-09-17T21:10:10.056180] [INFO ] [MAIN ] PNW: Starting full primary refresh. [2025-09-17T21:10:10.426913] [INFO ] [REMOTE ] PNW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:10:10.815783] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-05. [2025-09-17T21:10:11.000320] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T21:10:11.412198] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T21:10:11.615778] [INFO ] [REMOTE ] PNR: Fetching primary data for 2024-12. [2025-09-17T21:10:12.415754] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-04. [2025-09-17T21:10:12.760178] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T21:10:13.215795] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-11. [2025-09-17T21:10:13.267228] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T21:10:13.801192] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T21:10:14.015786] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-01. [2025-09-17T21:10:14.815822] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-05. [2025-09-17T21:10:14.988511] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T21:10:15.615795] [INFO ] [REMOTE ] PNW: Fetching primary data for 2024-12. [2025-09-17T21:10:15.845711] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T21:10:16.415761] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-02. [2025-09-17T21:10:16.634540] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T21:10:17.140224] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T21:10:17.215765] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-01. [2025-09-17T21:10:17.885608] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T21:10:18.015765] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-03. [2025-09-17T21:10:18.705663] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T21:10:18.815786] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-02. [2025-09-17T21:10:19.615797] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-06. [2025-09-17T21:10:19.890571] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T21:10:20.216442] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T21:10:20.415772] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-04. [2025-09-17T21:10:21.163367] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T21:10:21.215786] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-07. [2025-09-17T21:10:22.015766] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-06. [2025-09-17T21:10:22.297020] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T21:10:22.815746] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-05. [2025-09-17T21:10:22.858084] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T21:10:23.196150] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T21:10:23.615773] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-07. [2025-09-17T21:10:24.333997] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T21:10:24.415726] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-06. [2025-09-17T21:10:25.216203] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-08. [2025-09-17T21:10:25.222238] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T21:10:26.020979] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-03. [2025-09-17T21:10:26.038418] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-06 (1.62 seconds). [2025-09-17T21:10:26.087342] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T21:10:26.815781] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-08. [2025-09-17T21:10:27.615766] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-07. [2025-09-17T21:10:27.845684] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T21:10:28.350258] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T21:10:28.415756] [INFO ] [REMOTE ] PNC: Fetching primary data for 2025-09. [2025-09-17T21:10:29.010088] [INFO ] [REMOTE ] PNC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T21:10:29.017422] [INFO ] [REMOTE ] PNC: Full fetch complete (75013 records). [2025-09-17T21:10:29.017558] [DEBUG] [VALIDATOR ] PNC: Validating primary data. [2025-09-17T21:10:29.018569] [FATAL] [VALIDATOR ] PNC: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:10:29.018670] [FATAL] [MAIN ] PNC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:10:29.018711] [WARN ] [MAIN ] PNC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:10:29.018752] [INFO ] [LOCAL ] PNC: Starting deletion of primary data. [2025-09-17T21:10:29.018815] [DEBUG] [LOCAL ] PNC: No primary data file found to delete. [2025-09-17T21:10:29.018852] [INFO ] [LOCAL ] PNC: Starting deletion of derivative data. [2025-09-17T21:10:29.019139] [DEBUG] [LOCAL ] PNC: Deleted derivative data file. [2025-09-17T21:10:29.019259] [INFO ] [MAIN ] Update Progress: 1712/2371 symbols completed. PNC took 49.6s. Estimated remaining: 1h 36m 24s. Rate: 6.8 symbols/min [2025-09-17T21:10:29.199772] [INFO ] [MAIN ] POR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:10:29.215758] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-04. [2025-09-17T21:10:29.249369] [DEBUG] [LOCAL ] POR: Loaded 46953 existing records from primary storage. [2025-09-17T21:10:29.249528] [INFO ] [MAIN ] POR: Loaded 46953 existing records. [2025-09-17T21:10:29.428402] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T21:10:29.502749] [WARN ] [MAIN ] POR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:10:29.503059] [INFO ] [MAIN ] POR: Wiping existing primary data before full refresh. [2025-09-17T21:10:29.504026] [INFO ] [LOCAL ] POR: Starting deletion of primary data. [2025-09-17T21:10:29.505252] [DEBUG] [LOCAL ] POR: Deleted primary data file. [2025-09-17T21:10:29.505322] [INFO ] [MAIN ] POR: Starting full primary refresh. [2025-09-17T21:10:29.867013] [INFO ] [REMOTE ] POR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:10:30.015844] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-11. [2025-09-17T21:10:30.815830] [INFO ] [REMOTE ] PNNT: Fetching primary data for 2025-09. [2025-09-17T21:10:31.014595] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T21:10:31.615709] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-05. [2025-09-17T21:10:31.710634] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T21:10:31.960022] [INFO ] [REMOTE ] PNNT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T21:10:31.964603] [INFO ] [REMOTE ] PNNT: Full fetch complete (47496 records). [2025-09-17T21:10:31.964708] [DEBUG] [VALIDATOR ] PNNT: Validating primary data. [2025-09-17T21:10:32.349520] [DEBUG] [VALIDATOR ] PNNT: All expected trading days are present. [2025-09-17T21:10:32.349624] [DEBUG] [VALIDATOR ] PNNT: Primary data validation passed. [2025-09-17T21:10:32.350606] [INFO ] [MAIN ] PNNT: Fetched primary data is valid. [2025-09-17T21:10:32.350689] [DEBUG] [LOCAL ] PNNT: Saving primary data. [2025-09-17T21:10:32.351905] [DEBUG] [LOCAL ] PNNT: Trimmed 47496 records to 33012 (keeping 200 days of data) [2025-09-17T21:10:32.437228] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-08. [2025-09-17T21:10:32.554378] [DEBUG] [LOCAL ] PNNT: Primary data saved (33012 records). [2025-09-17T21:10:32.554562] [INFO ] [MAIN ] PNNT: Full history saved. [2025-09-17T21:10:32.554702] [INFO ] [MAIN ] Update Progress: 1713/2371 symbols completed. PNNT took 36.2s. Estimated remaining: 1h 36m 14s. Rate: 6.8 symbols/min [2025-09-17T21:10:32.729575] [INFO ] [MAIN ] POST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:10:32.768141] [DEBUG] [LOCAL ] POST: Loaded 38940 existing records from primary storage. [2025-09-17T21:10:32.768321] [INFO ] [MAIN ] POST: Loaded 38940 existing records. [2025-09-17T21:10:32.948370] [WARN ] [MAIN ] POST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:10:32.948706] [INFO ] [MAIN ] POST: Wiping existing primary data before full refresh. [2025-09-17T21:10:32.948755] [INFO ] [LOCAL ] POST: Starting deletion of primary data. [2025-09-17T21:10:32.950428] [DEBUG] [LOCAL ] POST: Deleted primary data file. [2025-09-17T21:10:32.950486] [INFO ] [MAIN ] POST: Starting full primary refresh. [2025-09-17T21:10:33.224123] [INFO ] [REMOTE ] POR: Fetching primary data for 2024-12. [2025-09-17T21:10:33.316788] [INFO ] [REMOTE ] POST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:10:33.351116] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T21:10:33.940728] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T21:10:34.015769] [INFO ] [REMOTE ] PNR: Fetching primary data for 2025-09. [2025-09-17T21:10:34.767868] [INFO ] [REMOTE ] PNR: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T21:10:34.773878] [INFO ] [REMOTE ] PNR: Full fetch complete (68833 records). [2025-09-17T21:10:34.774003] [DEBUG] [VALIDATOR ] PNR: Validating primary data. [2025-09-17T21:10:34.774857] [FATAL] [VALIDATOR ] PNR: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:10:34.774943] [FATAL] [MAIN ] PNR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:10:34.774982] [WARN ] [MAIN ] PNR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:10:34.775069] [INFO ] [LOCAL ] PNR: Starting deletion of primary data. [2025-09-17T21:10:34.775135] [DEBUG] [LOCAL ] PNR: No primary data file found to delete. [2025-09-17T21:10:34.775197] [INFO ] [LOCAL ] PNR: Starting deletion of derivative data. [2025-09-17T21:10:34.775478] [DEBUG] [LOCAL ] PNR: Deleted derivative data file. [2025-09-17T21:10:34.775562] [INFO ] [MAIN ] Update Progress: 1714/2371 symbols completed. PNR took 27.4s. Estimated remaining: 1h 36m 2s. Rate: 6.8 symbols/min [2025-09-17T21:10:34.820688] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-06. [2025-09-17T21:10:34.962329] [INFO ] [MAIN ] PPG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:10:34.997479] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T21:10:35.061976] [DEBUG] [LOCAL ] PPG: Loaded 50772 existing records from primary storage. [2025-09-17T21:10:35.062130] [INFO ] [MAIN ] PPG: Loaded 50772 existing records. [2025-09-17T21:10:35.251107] [WARN ] [MAIN ] PPG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:10:35.251416] [INFO ] [MAIN ] PPG: Wiping existing primary data before full refresh. [2025-09-17T21:10:35.251466] [INFO ] [LOCAL ] PPG: Starting deletion of primary data. [2025-09-17T21:10:35.252678] [DEBUG] [LOCAL ] PPG: Deleted primary data file. [2025-09-17T21:10:35.252740] [INFO ] [MAIN ] PPG: Starting full primary refresh. [2025-09-17T21:10:35.620976] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-01. [2025-09-17T21:10:35.620833] [INFO ] [REMOTE ] PPG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:10:36.415771] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-11. [2025-09-17T21:10:36.543126] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T21:10:37.205118] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T21:10:37.217729] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-07. [2025-09-17T21:10:37.900163] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T21:10:38.015905] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-11. [2025-09-17T21:10:38.815890] [INFO ] [REMOTE ] POST: Fetching primary data for 2024-12. [2025-09-17T21:10:39.097291] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T21:10:39.507905] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T21:10:39.615818] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-08. [2025-09-17T21:10:40.378892] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T21:10:40.415784] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-01. [2025-09-17T21:10:40.996515] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T21:10:41.215898] [INFO ] [REMOTE ] PNW: Fetching primary data for 2025-09. [2025-09-17T21:10:42.015795] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-02. [2025-09-17T21:10:42.040401] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T21:10:42.772187] [INFO ] [REMOTE ] PNW: Incremental fetch complete for 2025-09 (1.56 seconds). [2025-09-17T21:10:42.778499] [INFO ] [REMOTE ] PNW: Full fetch complete (66141 records). [2025-09-17T21:10:42.778683] [DEBUG] [VALIDATOR ] PNW: Validating primary data. [2025-09-17T21:10:42.823875] [INFO ] [REMOTE ] PPG: Fetching primary data for 2024-12. [2025-09-17T21:10:43.185727] [DEBUG] [VALIDATOR ] PNW: All expected trading days are present. [2025-09-17T21:10:43.185820] [DEBUG] [VALIDATOR ] PNW: Primary data validation passed. [2025-09-17T21:10:43.186895] [INFO ] [MAIN ] PNW: Fetched primary data is valid. [2025-09-17T21:10:43.186982] [DEBUG] [LOCAL ] PNW: Saving primary data. [2025-09-17T21:10:43.188524] [DEBUG] [LOCAL ] PNW: Trimmed 66141 records to 46133 (keeping 200 days of data) [2025-09-17T21:10:43.491462] [DEBUG] [LOCAL ] PNW: Primary data saved (46133 records). [2025-09-17T21:10:43.491617] [INFO ] [MAIN ] PNW: Full history saved. [2025-09-17T21:10:43.492573] [INFO ] [MAIN ] Update Progress: 1715/2371 symbols completed. PNW took 33.9s. Estimated remaining: 1h 35m 54s. Rate: 6.8 symbols/min [2025-09-17T21:10:43.616561] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-02. [2025-09-17T21:10:43.675756] [INFO ] [MAIN ] PPL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:10:43.715749] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T21:10:43.771584] [DEBUG] [LOCAL ] PPL: Loaded 53516 existing records from primary storage. [2025-09-17T21:10:43.771804] [INFO ] [MAIN ] PPL: Loaded 53516 existing records. [2025-09-17T21:10:43.958719] [WARN ] [MAIN ] PPL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:10:43.959027] [INFO ] [MAIN ] PPL: Wiping existing primary data before full refresh. [2025-09-17T21:10:43.959097] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-17T21:10:43.960097] [DEBUG] [LOCAL ] PPL: Deleted primary data file. [2025-09-17T21:10:43.960150] [INFO ] [MAIN ] PPL: Starting full primary refresh. [2025-09-17T21:10:44.348508] [INFO ] [REMOTE ] PPL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:10:44.415851] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-11. [2025-09-17T21:10:44.782746] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T21:10:45.027617] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T21:10:45.215846] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-03. [2025-09-17T21:10:46.015885] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-03. [2025-09-17T21:10:46.189503] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T21:10:46.623631] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T21:10:46.815846] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-01. [2025-09-17T21:10:47.615801] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-04. [2025-09-17T21:10:47.705871] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T21:10:48.415848] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-04. [2025-09-17T21:10:48.570358] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T21:10:49.215707] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-02. [2025-09-17T21:10:49.272239] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T21:10:50.021030] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-05. [2025-09-17T21:10:50.033911] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T21:10:50.815860] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-05. [2025-09-17T21:10:51.004502] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T21:10:51.582205] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T21:10:51.615754] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-06. [2025-09-17T21:10:52.295266] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T21:10:52.415775] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-06. [2025-09-17T21:10:52.640895] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T21:10:53.215834] [INFO ] [REMOTE ] PPL: Fetching primary data for 2024-12. [2025-09-17T21:10:54.015776] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-03. [2025-09-17T21:10:54.190044] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T21:10:54.815832] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-07. [2025-09-17T21:10:55.121061] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T21:10:55.615837] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-01. [2025-09-17T21:10:55.950469] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T21:10:56.415838] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-07. [2025-09-17T21:10:56.532386] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T21:10:57.215765] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-08. [2025-09-17T21:10:57.262495] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T21:10:57.994664] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T21:10:58.015731] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-08. [2025-09-17T21:10:58.815848] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-04. [2025-09-17T21:10:58.988323] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T21:10:59.423494] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T21:10:59.615801] [INFO ] [REMOTE ] POST: Fetching primary data for 2025-09. [2025-09-17T21:11:00.415841] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-02. [2025-09-17T21:11:01.051179] [INFO ] [REMOTE ] POST: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T21:11:01.057508] [INFO ] [REMOTE ] POST: Full fetch complete (55676 records). [2025-09-17T21:11:01.057674] [DEBUG] [VALIDATOR ] POST: Validating primary data. [2025-09-17T21:11:01.229611] [INFO ] [REMOTE ] POR: Fetching primary data for 2025-09. [2025-09-17T21:11:01.453827] [DEBUG] [VALIDATOR ] POST: All expected trading days are present. [2025-09-17T21:11:01.453905] [DEBUG] [VALIDATOR ] POST: Primary data validation passed. [2025-09-17T21:11:01.454729] [INFO ] [MAIN ] POST: Fetched primary data is valid. [2025-09-17T21:11:01.454774] [DEBUG] [LOCAL ] POST: Saving primary data. [2025-09-17T21:11:01.455850] [DEBUG] [LOCAL ] POST: Trimmed 55676 records to 38969 (keeping 200 days of data) [2025-09-17T21:11:01.583661] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-04 (2.77 seconds). [2025-09-17T21:11:01.739355] [DEBUG] [LOCAL ] POST: Primary data saved (38969 records). [2025-09-17T21:11:01.739520] [INFO ] [MAIN ] POST: Full history saved. [2025-09-17T21:11:01.739633] [INFO ] [MAIN ] Update Progress: 1716/2371 symbols completed. POST took 29.2s. Estimated remaining: 1h 35m 48s. Rate: 6.8 symbols/min [2025-09-17T21:11:01.909634] [INFO ] [MAIN ] PPT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:11:01.929843] [DEBUG] [LOCAL ] PPT: Loaded 20338 existing records from primary storage. [2025-09-17T21:11:01.929968] [INFO ] [MAIN ] PPT: Loaded 20338 existing records. [2025-09-17T21:11:02.021246] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-05. [2025-09-17T21:11:02.111353] [WARN ] [MAIN ] PPT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:11:02.111685] [INFO ] [MAIN ] PPT: Wiping existing primary data before full refresh. [2025-09-17T21:11:02.111739] [INFO ] [LOCAL ] PPT: Starting deletion of primary data. [2025-09-17T21:11:02.121201] [DEBUG] [LOCAL ] PPT: Deleted primary data file. [2025-09-17T21:11:02.136401] [INFO ] [MAIN ] PPT: Starting full primary refresh. [2025-09-17T21:11:02.212420] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T21:11:02.506077] [INFO ] [REMOTE ] PPT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:11:02.546462] [INFO ] [REMOTE ] POR: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T21:11:02.552718] [INFO ] [REMOTE ] POR: Full fetch complete (67541 records). [2025-09-17T21:11:02.552822] [DEBUG] [VALIDATOR ] POR: Validating primary data. [2025-09-17T21:11:02.820981] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-03. [2025-09-17T21:11:02.940043] [DEBUG] [VALIDATOR ] POR: All expected trading days are present. [2025-09-17T21:11:02.940123] [DEBUG] [VALIDATOR ] POR: Primary data validation passed. [2025-09-17T21:11:02.941064] [INFO ] [MAIN ] POR: Fetched primary data is valid. [2025-09-17T21:11:02.941110] [DEBUG] [LOCAL ] POR: Saving primary data. [2025-09-17T21:11:02.942594] [DEBUG] [LOCAL ] POR: Trimmed 67541 records to 46973 (keeping 200 days of data) [2025-09-17T21:11:03.230295] [DEBUG] [LOCAL ] POR: Primary data saved (46973 records). [2025-09-17T21:11:03.230441] [INFO ] [MAIN ] POR: Full history saved. [2025-09-17T21:11:03.230527] [INFO ] [MAIN ] Update Progress: 1717/2371 symbols completed. POR took 34.2s. Estimated remaining: 1h 35m 37s. Rate: 6.8 symbols/min [2025-09-17T21:11:03.615789] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-11. [2025-09-17T21:11:04.044884] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T21:11:04.395394] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T21:11:04.415731] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-04. [2025-09-17T21:11:04.629123] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T21:11:05.215779] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-06. [2025-09-17T21:11:06.017299] [INFO ] [REMOTE ] PPT: Fetching primary data for 2024-12. [2025-09-17T21:11:06.020967] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T21:11:06.815764] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-05. [2025-09-17T21:11:06.845630] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T21:11:06.880774] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T21:11:07.615812] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-01. [2025-09-17T21:11:08.415760] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-07. [2025-09-17T21:11:08.703965] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T21:11:08.726241] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T21:11:09.215771] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-02. [2025-09-17T21:11:10.015843] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-06. [2025-09-17T21:11:10.316247] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T21:11:10.577588] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-17T21:11:10.815848] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-03. [2025-09-17T21:11:11.615807] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-08. [2025-09-17T21:11:11.931295] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T21:11:12.046766] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T21:11:12.415785] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-07. [2025-09-17T21:11:13.215741] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-04. [2025-09-17T21:11:13.268867] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T21:11:14.024868] [INFO ] [REMOTE ] PPG: Fetching primary data for 2025-09. [2025-09-17T21:11:14.027693] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T21:11:14.063510] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T21:11:14.815779] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-08. [2025-09-17T21:11:15.466232] [INFO ] [REMOTE ] PPG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T21:11:15.473968] [INFO ] [REMOTE ] PPG: Full fetch complete (73528 records). [2025-09-17T21:11:15.474099] [DEBUG] [VALIDATOR ] PPG: Validating primary data. [2025-09-17T21:11:15.620983] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-05. [2025-09-17T21:11:15.868813] [DEBUG] [VALIDATOR ] PPG: All expected trading days are present. [2025-09-17T21:11:15.868893] [DEBUG] [VALIDATOR ] PPG: Primary data validation passed. [2025-09-17T21:11:15.869859] [INFO ] [MAIN ] PPG: Fetched primary data is valid. [2025-09-17T21:11:15.869909] [DEBUG] [LOCAL ] PPG: Saving primary data. [2025-09-17T21:11:15.871424] [DEBUG] [LOCAL ] PPG: Trimmed 73528 records to 50749 (keeping 200 days of data) [2025-09-17T21:11:16.199938] [DEBUG] [LOCAL ] PPG: Primary data saved (50749 records). [2025-09-17T21:11:16.200081] [INFO ] [MAIN ] PPG: Full history saved. [2025-09-17T21:11:16.201147] [INFO ] [MAIN ] Update Progress: 1718/2371 symbols completed. PPG took 41.4s. Estimated remaining: 1h 35m 30s. Rate: 6.8 symbols/min [2025-09-17T21:11:16.757012] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T21:11:16.762926] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-06. [2025-09-17T21:11:16.877284] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-08 (2.06 seconds). [2025-09-17T21:11:17.215796] [INFO ] [REMOTE ] PPL: Fetching primary data for 2025-09. [2025-09-17T21:11:17.917212] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T21:11:18.020796] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-07. [2025-09-17T21:11:18.029312] [INFO ] [REMOTE ] PPL: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T21:11:18.035695] [INFO ] [REMOTE ] PPL: Full fetch complete (76866 records). [2025-09-17T21:11:18.035795] [DEBUG] [VALIDATOR ] PPL: Validating primary data. [2025-09-17T21:11:18.036660] [FATAL] [VALIDATOR ] PPL: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:11:18.036759] [FATAL] [MAIN ] PPL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:11:18.036796] [WARN ] [MAIN ] PPL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:11:18.036833] [INFO ] [LOCAL ] PPL: Starting deletion of primary data. [2025-09-17T21:11:18.036906] [DEBUG] [LOCAL ] PPL: No primary data file found to delete. [2025-09-17T21:11:18.036945] [INFO ] [LOCAL ] PPL: Starting deletion of derivative data. [2025-09-17T21:11:18.037310] [DEBUG] [LOCAL ] PPL: Deleted derivative data file. [2025-09-17T21:11:18.038306] [INFO ] [MAIN ] Update Progress: 1719/2371 symbols completed. PPL took 34.5s. Estimated remaining: 1h 35m 18s. Rate: 6.8 symbols/min [2025-09-17T21:11:19.322410] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T21:11:19.327791] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-08. [2025-09-17T21:11:20.386051] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T21:11:20.390336] [INFO ] [REMOTE ] PPT: Fetching primary data for 2025-09. [2025-09-17T21:11:21.443021] [INFO ] [REMOTE ] PPT: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T21:11:21.446069] [INFO ] [REMOTE ] PPT: Full fetch complete (29319 records). [2025-09-17T21:11:21.446155] [DEBUG] [VALIDATOR ] PPT: Validating primary data. [2025-09-17T21:11:21.828214] [DEBUG] [VALIDATOR ] PPT: All expected trading days are present. [2025-09-17T21:11:21.828388] [DEBUG] [VALIDATOR ] PPT: Primary data validation passed. [2025-09-17T21:11:21.829010] [INFO ] [MAIN ] PPT: Fetched primary data is valid. [2025-09-17T21:11:21.829056] [DEBUG] [LOCAL ] PPT: Saving primary data. [2025-09-17T21:11:21.829868] [DEBUG] [LOCAL ] PPT: Trimmed 29319 records to 20368 (keeping 200 days of data) [2025-09-17T21:11:21.955461] [DEBUG] [LOCAL ] PPT: Primary data saved (20368 records). [2025-09-17T21:11:21.955606] [INFO ] [MAIN ] PPT: Full history saved. [2025-09-17T21:11:21.955727] [INFO ] [MAIN ] Update Progress: 1720/2371 symbols completed. PPT took 20.2s. Estimated remaining: 1h 35m 8s. Rate: 6.8 symbols/min [2025-09-17T21:11:22.520999] [INFO ] [MAIN ] PR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:11:22.641129] [INFO ] [MAIN ] PRCS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:11:22.641865] [INFO ] [MAIN ] PRG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:11:22.661065] [DEBUG] [LOCAL ] PRCS: No existing data file found in primary storage. [2025-09-17T21:11:22.660888] [INFO ] [MAIN ] PRA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:11:22.661696] [WARN ] [MAIN ] PRCS: No existing data found, performing full refresh instead. [2025-09-17T21:11:22.664497] [INFO ] [MAIN ] PRCS: Wiping existing primary data before full refresh. [2025-09-17T21:11:22.664591] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-17T21:11:22.664669] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-17T21:11:22.664716] [INFO ] [MAIN ] PRCS: Starting full primary refresh. [2025-09-17T21:11:22.933199] [DEBUG] [LOCAL ] PRG: Loaded 30591 existing records from primary storage. [2025-09-17T21:11:22.933720] [DEBUG] [LOCAL ] PRA: Loaded 34724 existing records from primary storage. [2025-09-17T21:11:22.948846] [INFO ] [MAIN ] PRA: Loaded 34724 existing records. [2025-09-17T21:11:22.943696] [INFO ] [MAIN ] PRG: Loaded 30591 existing records. [2025-09-17T21:11:23.226763] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-17T21:11:23.277608] [INFO ] [MAIN ] PR: Loaded 53609 existing records. [2025-09-17T21:11:23.462804] [INFO ] [REMOTE ] PRCS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:11:23.517970] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-11. [2025-09-17T21:11:23.518096] [WARN ] [MAIN ] PRG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:11:23.581117] [INFO ] [MAIN ] PRG: Wiping existing primary data before full refresh. [2025-09-17T21:11:23.616420] [INFO ] [LOCAL ] PRG: Starting deletion of primary data. [2025-09-17T21:11:23.622079] [WARN ] [MAIN ] PRA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:11:23.648513] [INFO ] [MAIN ] PRA: Wiping existing primary data before full refresh. [2025-09-17T21:11:23.648943] [INFO ] [LOCAL ] PRA: Starting deletion of primary data. [2025-09-17T21:11:23.668222] [DEBUG] [LOCAL ] PRG: Deleted primary data file. [2025-09-17T21:11:23.674142] [DEBUG] [LOCAL ] PRA: Deleted primary data file. [2025-09-17T21:11:23.703355] [INFO ] [MAIN ] PRA: Starting full primary refresh. [2025-09-17T21:11:23.703210] [WARN ] [MAIN ] PR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:11:23.703309] [INFO ] [MAIN ] PRG: Starting full primary refresh. [2025-09-17T21:11:23.821027] [INFO ] [MAIN ] PR: Wiping existing primary data before full refresh. [2025-09-17T21:11:23.852862] [INFO ] [LOCAL ] PR: Starting deletion of primary data. [2025-09-17T21:11:23.873686] [DEBUG] [LOCAL ] PR: Deleted primary data file. [2025-09-17T21:11:23.905165] [INFO ] [MAIN ] PR: Starting full primary refresh. [2025-09-17T21:11:23.971438] [DEBUG] [REMOTE ] PRCS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:11:24.002780] [WARN ] [REMOTE ] PRCS: No data returned for month 2024-11 [2025-09-17T21:11:24.094275] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2024-12. [2025-09-17T21:11:24.702721] [INFO ] [REMOTE ] PRA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:11:24.699550] [INFO ] [REMOTE ] PRG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:11:24.703064] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-11. [2025-09-17T21:11:24.703282] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-11. [2025-09-17T21:11:24.783376] [INFO ] [REMOTE ] PR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:11:24.784122] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-11. [2025-09-17T21:11:24.825081] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T21:11:24.825949] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-01. [2025-09-17T21:11:25.337073] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-01 (0.51 seconds). [2025-09-17T21:11:25.338289] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-02. [2025-09-17T21:11:25.860495] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T21:11:25.880188] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T21:11:25.890632] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T21:11:26.015731] [INFO ] [REMOTE ] PRG: Fetching primary data for 2024-12. [2025-09-17T21:11:26.817490] [INFO ] [REMOTE ] PRA: Fetching primary data for 2024-12. [2025-09-17T21:11:26.820249] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-17T21:11:27.469038] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T21:11:27.615759] [INFO ] [REMOTE ] PR: Fetching primary data for 2024-12. [2025-09-17T21:11:27.741047] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T21:11:28.415807] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-01. [2025-09-17T21:11:29.215818] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-03. [2025-09-17T21:11:29.462679] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T21:11:29.759723] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T21:11:29.788339] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T21:11:30.015833] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-04. [2025-09-17T21:11:30.551021] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-04 (0.54 seconds). [2025-09-17T21:11:30.815833] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-01. [2025-09-17T21:11:31.615792] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-02. [2025-09-17T21:11:32.415768] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-01. [2025-09-17T21:11:32.676757] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T21:11:32.717318] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-01 (1.90 seconds). [2025-09-17T21:11:33.215785] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-02. [2025-09-17T21:11:33.407576] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T21:11:34.015816] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-03. [2025-09-17T21:11:34.815839] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-05. [2025-09-17T21:11:34.967860] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T21:11:35.187310] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-17T21:11:35.253091] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T21:11:35.615785] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-04. [2025-09-17T21:11:36.415832] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-03. [2025-09-17T21:11:37.158779] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T21:11:37.215762] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-05. [2025-09-17T21:11:38.015798] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-06. [2025-09-17T21:11:38.151561] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T21:11:38.344084] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T21:11:38.627545] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T21:11:38.815782] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-06. [2025-09-17T21:11:39.615811] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-07. [2025-09-17T21:11:39.989729] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-07 (0.37 seconds). [2025-09-17T21:11:40.190174] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T21:11:40.415743] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-07. [2025-09-17T21:11:41.215783] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-08. [2025-09-17T21:11:41.846250] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T21:11:41.864969] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T21:11:42.015753] [INFO ] [REMOTE ] PRCS: Fetching primary data for 2025-09. [2025-09-17T21:11:42.466215] [INFO ] [REMOTE ] PRCS: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T21:11:42.467291] [INFO ] [REMOTE ] PRCS: Full fetch complete (3705 records). [2025-09-17T21:11:42.467380] [DEBUG] [VALIDATOR ] PRCS: Validating primary data. [2025-09-17T21:11:42.657679] [WARN ] [VALIDATOR ] PRCS: Validation failed - insufficient historical data. Have 190 unique days, need 200 days [2025-09-17T21:11:42.657879] [FATAL] [MAIN ] PRCS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:11:42.657929] [WARN ] [MAIN ] PRCS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:11:42.657978] [INFO ] [LOCAL ] PRCS: Starting deletion of primary data. [2025-09-17T21:11:42.658051] [DEBUG] [LOCAL ] PRCS: No primary data file found to delete. [2025-09-17T21:11:42.658091] [INFO ] [LOCAL ] PRCS: Starting deletion of derivative data. [2025-09-17T21:11:42.658134] [DEBUG] [LOCAL ] PRCS: No derivative data file found to delete. [2025-09-17T21:11:42.658195] [INFO ] [MAIN ] Update Progress: 1721/2371 symbols completed. PRCS took 20.7s. Estimated remaining: 1h 35m 3s. Rate: 6.8 symbols/min [2025-09-17T21:11:42.824687] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-02. [2025-09-17T21:11:42.844453] [INFO ] [MAIN ] PRGO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:11:42.893109] [DEBUG] [LOCAL ] PRGO: Loaded 46972 existing records from primary storage. [2025-09-17T21:11:42.893260] [INFO ] [MAIN ] PRGO: Loaded 46972 existing records. [2025-09-17T21:11:43.069532] [WARN ] [MAIN ] PRGO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:11:43.069837] [INFO ] [MAIN ] PRGO: Wiping existing primary data before full refresh. [2025-09-17T21:11:43.069884] [INFO ] [LOCAL ] PRGO: Starting deletion of primary data. [2025-09-17T21:11:43.071059] [DEBUG] [LOCAL ] PRGO: Deleted primary data file. [2025-09-17T21:11:43.071115] [INFO ] [MAIN ] PRGO: Starting full primary refresh. [2025-09-17T21:11:43.442702] [INFO ] [REMOTE ] PRGO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:11:43.615745] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-08. [2025-09-17T21:11:44.010104] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T21:11:44.415780] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-04. [2025-09-17T21:11:45.028805] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T21:11:45.215824] [INFO ] [REMOTE ] PRG: Fetching primary data for 2025-09. [2025-09-17T21:11:46.015837] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-11. [2025-09-17T21:11:46.282577] [INFO ] [REMOTE ] PRG: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T21:11:46.286144] [INFO ] [REMOTE ] PRG: Full fetch complete (44039 records). [2025-09-17T21:11:46.286255] [DEBUG] [VALIDATOR ] PRG: Validating primary data. [2025-09-17T21:11:46.697915] [DEBUG] [VALIDATOR ] PRG: All expected trading days are present. [2025-09-17T21:11:46.698051] [DEBUG] [VALIDATOR ] PRG: Primary data validation passed. [2025-09-17T21:11:46.699163] [INFO ] [MAIN ] PRG: Fetched primary data is valid. [2025-09-17T21:11:46.699392] [DEBUG] [LOCAL ] PRG: Saving primary data. [2025-09-17T21:11:46.701284] [DEBUG] [LOCAL ] PRG: Trimmed 44039 records to 30526 (keeping 200 days of data) [2025-09-17T21:11:46.842113] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-03. [2025-09-17T21:11:46.854091] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-17T21:11:46.971459] [DEBUG] [LOCAL ] PRG: Primary data saved (30526 records). [2025-09-17T21:11:46.971723] [INFO ] [MAIN ] PRG: Full history saved. [2025-09-17T21:11:46.971898] [INFO ] [MAIN ] Update Progress: 1722/2371 symbols completed. PRG took 25.0s. Estimated remaining: 1h 34m 53s. Rate: 6.8 symbols/min [2025-09-17T21:11:47.156881] [INFO ] [MAIN ] PRH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:11:47.170634] [DEBUG] [LOCAL ] PRH: Loaded 4987 existing records from primary storage. [2025-09-17T21:11:47.170842] [INFO ] [MAIN ] PRH: Loaded 4987 existing records. [2025-09-17T21:11:47.357632] [WARN ] [MAIN ] PRH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:11:47.357993] [INFO ] [MAIN ] PRH: Wiping existing primary data before full refresh. [2025-09-17T21:11:47.358046] [INFO ] [LOCAL ] PRH: Starting deletion of primary data. [2025-09-17T21:11:47.358451] [DEBUG] [LOCAL ] PRH: Deleted primary data file. [2025-09-17T21:11:47.358504] [INFO ] [MAIN ] PRH: Starting full primary refresh. [2025-09-17T21:11:47.625299] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-05. [2025-09-17T21:11:47.738861] [INFO ] [REMOTE ] PRH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:11:47.816114] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T21:11:48.152425] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T21:11:48.415822] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2024-12. [2025-09-17T21:11:49.215858] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-11. [2025-09-17T21:11:49.597156] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T21:11:49.689503] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T21:11:49.933175] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T21:11:50.015790] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-01. [2025-09-17T21:11:50.815877] [INFO ] [REMOTE ] PRH: Fetching primary data for 2024-12. [2025-09-17T21:11:51.497131] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T21:11:51.621929] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-06. [2025-09-17T21:11:51.627437] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T21:11:52.415788] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-01. [2025-09-17T21:11:53.125072] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T21:11:53.215745] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-04. [2025-09-17T21:11:53.253858] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T21:11:54.015820] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-07. [2025-09-17T21:11:54.815753] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-02. [2025-09-17T21:11:55.006537] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T21:11:55.615763] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-05. [2025-09-17T21:11:55.658280] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T21:11:56.415781] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-03. [2025-09-17T21:11:56.962862] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-07 (2.95 seconds). [2025-09-17T21:11:57.047304] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T21:11:57.215817] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-04. [2025-09-17T21:11:57.989949] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T21:11:58.015738] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-05. [2025-09-17T21:11:58.193031] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-05 (2.58 seconds). [2025-09-17T21:11:58.788328] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T21:11:58.815720] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-06. [2025-09-17T21:11:59.555156] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T21:11:59.615785] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-02. [2025-09-17T21:12:00.415786] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-08. [2025-09-17T21:12:01.215795] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-07. [2025-09-17T21:12:01.365459] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T21:12:02.015833] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-06. [2025-09-17T21:12:02.620116] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T21:12:02.815821] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-08. [2025-09-17T21:12:03.390795] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-08 (2.98 seconds). [2025-09-17T21:12:03.615780] [INFO ] [REMOTE ] PR: Fetching primary data for 2025-09. [2025-09-17T21:12:03.953719] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T21:12:04.415791] [INFO ] [REMOTE ] PRH: Fetching primary data for 2025-09. [2025-09-17T21:12:05.093235] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-06 (3.08 seconds). [2025-09-17T21:12:05.139138] [INFO ] [REMOTE ] PRH: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T21:12:05.140437] [INFO ] [REMOTE ] PRH: Full fetch complete (7720 records). [2025-09-17T21:12:05.140510] [DEBUG] [VALIDATOR ] PRH: Validating primary data. [2025-09-17T21:12:05.220862] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-07. [2025-09-17T21:12:05.526254] [DEBUG] [VALIDATOR ] PRH: All expected trading days are present. [2025-09-17T21:12:05.526431] [DEBUG] [VALIDATOR ] PRH: Primary data validation passed. [2025-09-17T21:12:05.526796] [INFO ] [MAIN ] PRH: Fetched primary data is valid. [2025-09-17T21:12:05.526924] [DEBUG] [LOCAL ] PRH: Saving primary data. [2025-09-17T21:12:05.527630] [DEBUG] [LOCAL ] PRH: Trimmed 7720 records to 4965 (keeping 200 days of data) [2025-09-17T21:12:05.572856] [INFO ] [REMOTE ] PR: Incremental fetch complete for 2025-09 (1.96 seconds). [2025-09-17T21:12:05.583753] [INFO ] [REMOTE ] PR: Full fetch complete (77413 records). [2025-09-17T21:12:05.584909] [DEBUG] [VALIDATOR ] PR: Validating primary data. [2025-09-17T21:12:05.668842] [DEBUG] [LOCAL ] PRH: Primary data saved (4965 records). [2025-09-17T21:12:05.687728] [INFO ] [MAIN ] PRH: Full history saved. [2025-09-17T21:12:05.690018] [INFO ] [MAIN ] Update Progress: 1723/2371 symbols completed. PRH took 18.7s. Estimated remaining: 1h 34m 48s. Rate: 6.8 symbols/min [2025-09-17T21:12:06.020578] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-03. [2025-09-17T21:12:06.062611] [INFO ] [MAIN ] PRI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:12:06.168556] [DEBUG] [VALIDATOR ] PR: All expected trading days are present. [2025-09-17T21:12:06.173204] [DEBUG] [VALIDATOR ] PR: Primary data validation passed. [2025-09-17T21:12:06.174398] [INFO ] [MAIN ] PR: Fetched primary data is valid. [2025-09-17T21:12:06.174526] [DEBUG] [LOCAL ] PR: Saving primary data. [2025-09-17T21:12:06.176410] [DEBUG] [LOCAL ] PR: Trimmed 77413 records to 53609 (keeping 200 days of data) [2025-09-17T21:12:06.183507] [DEBUG] [LOCAL ] PRI: Loaded 18506 existing records from primary storage. [2025-09-17T21:12:06.183807] [INFO ] [MAIN ] PRI: Loaded 18506 existing records. [2025-09-17T21:12:06.463220] [WARN ] [MAIN ] PRI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:12:06.468769] [INFO ] [MAIN ] PRI: Wiping existing primary data before full refresh. [2025-09-17T21:12:06.469760] [INFO ] [LOCAL ] PRI: Starting deletion of primary data. [2025-09-17T21:12:06.472709] [DEBUG] [LOCAL ] PRI: Deleted primary data file. [2025-09-17T21:12:06.473593] [INFO ] [MAIN ] PRI: Starting full primary refresh. [2025-09-17T21:12:06.944884] [INFO ] [REMOTE ] PRI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:12:06.946015] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-11. [2025-09-17T21:12:06.979240] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T21:12:07.102179] [DEBUG] [LOCAL ] PR: Primary data saved (53609 records). [2025-09-17T21:12:07.102336] [INFO ] [MAIN ] PR: Full history saved. [2025-09-17T21:12:07.102478] [INFO ] [MAIN ] Update Progress: 1724/2371 symbols completed. PR took 45.1s. Estimated remaining: 1h 34m 36s. Rate: 6.8 symbols/min [2025-09-17T21:12:07.269622] [INFO ] [MAIN ] PRIM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:12:07.312381] [DEBUG] [LOCAL ] PRIM: Loaded 44570 existing records from primary storage. [2025-09-17T21:12:07.312543] [INFO ] [MAIN ] PRIM: Loaded 44570 existing records. [2025-09-17T21:12:07.489446] [WARN ] [MAIN ] PRIM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:12:07.489763] [INFO ] [MAIN ] PRIM: Wiping existing primary data before full refresh. [2025-09-17T21:12:07.489829] [INFO ] [LOCAL ] PRIM: Starting deletion of primary data. [2025-09-17T21:12:07.491022] [DEBUG] [LOCAL ] PRIM: Deleted primary data file. [2025-09-17T21:12:07.491085] [INFO ] [MAIN ] PRIM: Starting full primary refresh. [2025-09-17T21:12:07.620917] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-08. [2025-09-17T21:12:07.882995] [INFO ] [REMOTE ] PRIM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:12:08.004235] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T21:12:08.027056] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T21:12:08.415813] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-04. [2025-09-17T21:12:08.904826] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T21:12:09.215846] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-11. [2025-09-17T21:12:10.015798] [INFO ] [REMOTE ] PRI: Fetching primary data for 2024-12. [2025-09-17T21:12:10.135532] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T21:12:10.580693] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T21:12:10.815754] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-05. [2025-09-17T21:12:11.196153] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T21:12:11.615823] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2024-12. [2025-09-17T21:12:12.415765] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-01. [2025-09-17T21:12:12.471624] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T21:12:13.216805] [INFO ] [REMOTE ] PRA: Fetching primary data for 2025-09. [2025-09-17T21:12:13.219681] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T21:12:13.619972] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T21:12:14.015779] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-06. [2025-09-17T21:12:14.708519] [INFO ] [REMOTE ] PRA: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T21:12:14.714749] [INFO ] [REMOTE ] PRA: Full fetch complete (43208 records). [2025-09-17T21:12:14.714873] [DEBUG] [VALIDATOR ] PRA: Validating primary data. [2025-09-17T21:12:14.818742] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-01. [2025-09-17T21:12:15.096945] [DEBUG] [VALIDATOR ] PRA: All expected trading days are present. [2025-09-17T21:12:15.097025] [DEBUG] [VALIDATOR ] PRA: Primary data validation passed. [2025-09-17T21:12:15.097733] [INFO ] [MAIN ] PRA: Fetched primary data is valid. [2025-09-17T21:12:15.097778] [DEBUG] [LOCAL ] PRA: Saving primary data. [2025-09-17T21:12:15.098751] [DEBUG] [LOCAL ] PRA: Trimmed 43208 records to 34737 (keeping 200 days of data) [2025-09-17T21:12:15.315126] [DEBUG] [LOCAL ] PRA: Primary data saved (34737 records). [2025-09-17T21:12:15.315472] [INFO ] [MAIN ] PRA: Full history saved. [2025-09-17T21:12:15.315671] [INFO ] [MAIN ] Update Progress: 1725/2371 symbols completed. PRA took 53.4s. Estimated remaining: 1h 34m 27s. Rate: 6.8 symbols/min [2025-09-17T21:12:15.485792] [INFO ] [MAIN ] PRKS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:12:15.530251] [DEBUG] [LOCAL ] PRKS: Loaded 42756 existing records from primary storage. [2025-09-17T21:12:15.530387] [INFO ] [MAIN ] PRKS: Loaded 42756 existing records. [2025-09-17T21:12:15.620943] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-02. [2025-09-17T21:12:15.710660] [WARN ] [MAIN ] PRKS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:12:15.710939] [INFO ] [MAIN ] PRKS: Wiping existing primary data before full refresh. [2025-09-17T21:12:15.711019] [INFO ] [LOCAL ] PRKS: Starting deletion of primary data. [2025-09-17T21:12:15.711942] [DEBUG] [LOCAL ] PRKS: Deleted primary data file. [2025-09-17T21:12:15.711990] [INFO ] [MAIN ] PRKS: Starting full primary refresh. [2025-09-17T21:12:16.073710] [INFO ] [REMOTE ] PRKS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:12:16.275584] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T21:12:16.365369] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-17T21:12:16.415743] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-02. [2025-09-17T21:12:16.551370] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T21:12:17.215806] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-03. [2025-09-17T21:12:17.698243] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T21:12:18.015765] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-07. [2025-09-17T21:12:18.444837] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T21:12:18.815778] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-04. [2025-09-17T21:12:19.454051] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T21:12:19.615788] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-03. [2025-09-17T21:12:19.706156] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T21:12:20.415785] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-11. [2025-09-17T21:12:21.215752] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-08. [2025-09-17T21:12:21.591926] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T21:12:21.628494] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T21:12:22.015775] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-05. [2025-09-17T21:12:22.815803] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2024-12. [2025-09-17T21:12:23.022016] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T21:12:23.067887] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T21:12:23.615807] [INFO ] [REMOTE ] PRGO: Fetching primary data for 2025-09. [2025-09-17T21:12:24.404720] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T21:12:24.415728] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-04. [2025-09-17T21:12:24.946517] [INFO ] [REMOTE ] PRGO: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T21:12:24.953143] [INFO ] [REMOTE ] PRGO: Full fetch complete (68071 records). [2025-09-17T21:12:24.953328] [DEBUG] [VALIDATOR ] PRGO: Validating primary data. [2025-09-17T21:12:25.220932] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-06. [2025-09-17T21:12:25.452497] [DEBUG] [VALIDATOR ] PRGO: All expected trading days are present. [2025-09-17T21:12:25.452598] [DEBUG] [VALIDATOR ] PRGO: Primary data validation passed. [2025-09-17T21:12:25.453589] [INFO ] [MAIN ] PRGO: Fetched primary data is valid. [2025-09-17T21:12:25.453662] [DEBUG] [LOCAL ] PRGO: Saving primary data. [2025-09-17T21:12:25.455241] [DEBUG] [LOCAL ] PRGO: Trimmed 68071 records to 46960 (keeping 200 days of data) [2025-09-17T21:12:25.768975] [DEBUG] [LOCAL ] PRGO: Primary data saved (46960 records). [2025-09-17T21:12:25.769229] [INFO ] [MAIN ] PRGO: Full history saved. [2025-09-17T21:12:25.770824] [INFO ] [MAIN ] Update Progress: 1726/2371 symbols completed. PRGO took 43.1s. Estimated remaining: 1h 34m 19s. Rate: 6.8 symbols/min [2025-09-17T21:12:25.958519] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T21:12:25.984094] [INFO ] [MAIN ] PRLB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:12:26.007142] [DEBUG] [LOCAL ] PRLB: Loaded 20950 existing records from primary storage. [2025-09-17T21:12:26.007307] [INFO ] [MAIN ] PRLB: Loaded 20950 existing records. [2025-09-17T21:12:26.020824] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-05. [2025-09-17T21:12:26.195815] [WARN ] [MAIN ] PRLB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:12:26.207149] [INFO ] [MAIN ] PRLB: Wiping existing primary data before full refresh. [2025-09-17T21:12:26.207764] [INFO ] [LOCAL ] PRLB: Starting deletion of primary data. [2025-09-17T21:12:26.208157] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T21:12:26.212378] [DEBUG] [LOCAL ] PRLB: Deleted primary data file. [2025-09-17T21:12:26.212492] [INFO ] [MAIN ] PRLB: Starting full primary refresh. [2025-09-17T21:12:26.574119] [INFO ] [REMOTE ] PRLB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:12:26.815769] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-01. [2025-09-17T21:12:27.615768] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-07. [2025-09-17T21:12:27.979321] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T21:12:28.415755] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-06. [2025-09-17T21:12:28.494674] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T21:12:28.880477] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T21:12:29.215800] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-11. [2025-09-17T21:12:30.001065] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T21:12:30.015680] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-07. [2025-09-17T21:12:30.152237] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T21:12:30.815795] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2024-12. [2025-09-17T21:12:31.615752] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-02. [2025-09-17T21:12:31.718399] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T21:12:31.942343] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T21:12:32.415793] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-08. [2025-09-17T21:12:33.167609] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T21:12:33.215761] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-08. [2025-09-17T21:12:34.015742] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-01. [2025-09-17T21:12:34.173905] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T21:12:34.256358] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T21:12:34.815746] [INFO ] [REMOTE ] PRI: Fetching primary data for 2025-09. [2025-09-17T21:12:35.130852] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T21:12:35.615741] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-03. [2025-09-17T21:12:35.631060] [INFO ] [REMOTE ] PRI: Incremental fetch complete for 2025-09 (0.82 seconds). [2025-09-17T21:12:35.633700] [INFO ] [REMOTE ] PRI: Full fetch complete (25586 records). [2025-09-17T21:12:35.633843] [DEBUG] [VALIDATOR ] PRI: Validating primary data. [2025-09-17T21:12:35.999105] [DEBUG] [VALIDATOR ] PRI: All expected trading days are present. [2025-09-17T21:12:35.999185] [DEBUG] [VALIDATOR ] PRI: Primary data validation passed. [2025-09-17T21:12:35.999736] [INFO ] [MAIN ] PRI: Fetched primary data is valid. [2025-09-17T21:12:35.999779] [DEBUG] [LOCAL ] PRI: Saving primary data. [2025-09-17T21:12:36.000406] [DEBUG] [LOCAL ] PRI: Trimmed 25586 records to 18455 (keeping 200 days of data) [2025-09-17T21:12:36.116335] [DEBUG] [LOCAL ] PRI: Primary data saved (18455 records). [2025-09-17T21:12:36.116479] [INFO ] [MAIN ] PRI: Full history saved. [2025-09-17T21:12:36.116564] [INFO ] [MAIN ] Update Progress: 1727/2371 symbols completed. PRI took 30.4s. Estimated remaining: 1h 34m 11s. Rate: 6.8 symbols/min [2025-09-17T21:12:36.302899] [INFO ] [MAIN ] PRM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:12:36.345630] [DEBUG] [LOCAL ] PRM: Loaded 44761 existing records from primary storage. [2025-09-17T21:12:36.345806] [INFO ] [MAIN ] PRM: Loaded 44761 existing records. [2025-09-17T21:12:36.425114] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-02. [2025-09-17T21:12:36.540487] [WARN ] [MAIN ] PRM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:12:36.540738] [INFO ] [MAIN ] PRM: Wiping existing primary data before full refresh. [2025-09-17T21:12:36.540796] [INFO ] [LOCAL ] PRM: Starting deletion of primary data. [2025-09-17T21:12:36.541828] [DEBUG] [LOCAL ] PRM: Deleted primary data file. [2025-09-17T21:12:36.541888] [INFO ] [MAIN ] PRM: Starting full primary refresh. [2025-09-17T21:12:36.895580] [INFO ] [REMOTE ] PRM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:12:37.011615] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T21:12:37.215845] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-11. [2025-09-17T21:12:37.787156] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T21:12:38.015799] [INFO ] [REMOTE ] PRIM: Fetching primary data for 2025-09. [2025-09-17T21:12:38.563868] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T21:12:38.815794] [INFO ] [REMOTE ] PRM: Fetching primary data for 2024-12. [2025-09-17T21:12:39.306352] [INFO ] [REMOTE ] PRIM: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T21:12:39.312798] [INFO ] [REMOTE ] PRIM: Full fetch complete (62916 records). [2025-09-17T21:12:39.312971] [DEBUG] [VALIDATOR ] PRIM: Validating primary data. [2025-09-17T21:12:39.620939] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-04. [2025-09-17T21:12:39.724248] [DEBUG] [VALIDATOR ] PRIM: All expected trading days are present. [2025-09-17T21:12:39.724332] [DEBUG] [VALIDATOR ] PRIM: Primary data validation passed. [2025-09-17T21:12:39.725418] [INFO ] [MAIN ] PRIM: Fetched primary data is valid. [2025-09-17T21:12:39.725469] [DEBUG] [LOCAL ] PRIM: Saving primary data. [2025-09-17T21:12:39.726952] [DEBUG] [LOCAL ] PRIM: Trimmed 62916 records to 44530 (keeping 200 days of data) [2025-09-17T21:12:40.000707] [DEBUG] [LOCAL ] PRIM: Primary data saved (44530 records). [2025-09-17T21:12:40.000852] [INFO ] [MAIN ] PRIM: Full history saved. [2025-09-17T21:12:40.000961] [INFO ] [MAIN ] Update Progress: 1728/2371 symbols completed. PRIM took 32.9s. Estimated remaining: 1h 34m 0s. Rate: 6.8 symbols/min [2025-09-17T21:12:40.178404] [INFO ] [MAIN ] PRMB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:12:40.203710] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T21:12:40.257682] [DEBUG] [LOCAL ] PRMB: Loaded 53131 existing records from primary storage. [2025-09-17T21:12:40.257850] [INFO ] [MAIN ] PRMB: Loaded 53131 existing records. [2025-09-17T21:12:40.425688] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-03. [2025-09-17T21:12:40.447580] [WARN ] [MAIN ] PRMB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:12:40.447766] [INFO ] [MAIN ] PRMB: Wiping existing primary data before full refresh. [2025-09-17T21:12:40.447813] [INFO ] [LOCAL ] PRMB: Starting deletion of primary data. [2025-09-17T21:12:40.449253] [DEBUG] [LOCAL ] PRMB: Deleted primary data file. [2025-09-17T21:12:40.449308] [INFO ] [MAIN ] PRMB: Starting full primary refresh. [2025-09-17T21:12:40.811589] [INFO ] [REMOTE ] PRMB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:12:41.143285] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T21:12:41.218020] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-11. [2025-09-17T21:12:41.234059] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T21:12:42.015791] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-04. [2025-09-17T21:12:42.687856] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T21:12:42.815753] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2024-12. [2025-09-17T21:12:43.307832] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T21:12:43.615776] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-01. [2025-09-17T21:12:44.415762] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-05. [2025-09-17T21:12:44.555147] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T21:12:45.221122] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-05. [2025-09-17T21:12:45.239102] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T21:12:45.910735] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T21:12:46.015755] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-06. [2025-09-17T21:12:46.452454] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T21:12:46.815779] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-02. [2025-09-17T21:12:47.615753] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-06. [2025-09-17T21:12:47.865284] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T21:12:48.132778] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T21:12:48.315970] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T21:12:48.415839] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-01. [2025-09-17T21:12:49.215793] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-07. [2025-09-17T21:12:49.909981] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T21:12:50.015828] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-07. [2025-09-17T21:12:50.227325] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T21:12:50.815819] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-02. [2025-09-17T21:12:51.615813] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-08. [2025-09-17T21:12:51.666389] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T21:12:52.415803] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-03. [2025-09-17T21:12:52.538054] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T21:12:52.707039] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T21:12:53.215828] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-03. [2025-09-17T21:12:54.015824] [INFO ] [REMOTE ] PRLB: Fetching primary data for 2025-09. [2025-09-17T21:12:54.280071] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T21:12:54.730071] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T21:12:54.815808] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-04. [2025-09-17T21:12:54.966944] [INFO ] [REMOTE ] PRLB: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T21:12:54.969544] [INFO ] [REMOTE ] PRLB: Full fetch complete (31003 records). [2025-09-17T21:12:54.969662] [DEBUG] [VALIDATOR ] PRLB: Validating primary data. [2025-09-17T21:12:55.338696] [DEBUG] [VALIDATOR ] PRLB: All expected trading days are present. [2025-09-17T21:12:55.338774] [DEBUG] [VALIDATOR ] PRLB: Primary data validation passed. [2025-09-17T21:12:55.339421] [INFO ] [MAIN ] PRLB: Fetched primary data is valid. [2025-09-17T21:12:55.339462] [DEBUG] [LOCAL ] PRLB: Saving primary data. [2025-09-17T21:12:55.340197] [DEBUG] [LOCAL ] PRLB: Trimmed 31003 records to 20907 (keeping 200 days of data) [2025-09-17T21:12:55.463856] [DEBUG] [LOCAL ] PRLB: Primary data saved (20907 records). [2025-09-17T21:12:55.464005] [INFO ] [MAIN ] PRLB: Full history saved. [2025-09-17T21:12:55.464127] [INFO ] [MAIN ] Update Progress: 1729/2371 symbols completed. PRLB took 29.7s. Estimated remaining: 1h 33m 54s. Rate: 6.8 symbols/min [2025-09-17T21:12:55.630928] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-08. [2025-09-17T21:12:55.633458] [INFO ] [MAIN ] PRO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:12:55.674799] [DEBUG] [LOCAL ] PRO: Loaded 37111 existing records from primary storage. [2025-09-17T21:12:55.674955] [INFO ] [MAIN ] PRO: Loaded 37111 existing records. [2025-09-17T21:12:55.850547] [WARN ] [MAIN ] PRO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:12:55.850824] [INFO ] [MAIN ] PRO: Wiping existing primary data before full refresh. [2025-09-17T21:12:55.850869] [INFO ] [LOCAL ] PRO: Starting deletion of primary data. [2025-09-17T21:12:55.851709] [DEBUG] [LOCAL ] PRO: Deleted primary data file. [2025-09-17T21:12:55.851760] [INFO ] [MAIN ] PRO: Starting full primary refresh. [2025-09-17T21:12:56.206034] [INFO ] [REMOTE ] PRO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:12:56.415787] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-11. [2025-09-17T21:12:56.482071] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T21:12:57.215839] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-05. [2025-09-17T21:12:57.263431] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T21:12:57.454399] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T21:12:58.015832] [INFO ] [REMOTE ] PRO: Fetching primary data for 2024-12. [2025-09-17T21:12:58.815812] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-04. [2025-09-17T21:12:59.468961] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-17T21:12:59.482991] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T21:12:59.615752] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-06. [2025-09-17T21:13:00.099445] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T21:13:00.415872] [INFO ] [REMOTE ] PRKS: Fetching primary data for 2025-09. [2025-09-17T21:13:01.215832] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-05. [2025-09-17T21:13:01.467594] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T21:13:02.015822] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-01. [2025-09-17T21:13:02.083976] [INFO ] [REMOTE ] PRKS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T21:13:02.090924] [INFO ] [REMOTE ] PRKS: Full fetch complete (60703 records). [2025-09-17T21:13:02.091080] [DEBUG] [VALIDATOR ] PRKS: Validating primary data. [2025-09-17T21:13:02.501278] [DEBUG] [VALIDATOR ] PRKS: All expected trading days are present. [2025-09-17T21:13:02.501612] [DEBUG] [VALIDATOR ] PRKS: Primary data validation passed. [2025-09-17T21:13:02.504034] [INFO ] [MAIN ] PRKS: Fetched primary data is valid. [2025-09-17T21:13:02.504123] [DEBUG] [LOCAL ] PRKS: Saving primary data. [2025-09-17T21:13:02.506826] [DEBUG] [LOCAL ] PRKS: Trimmed 60703 records to 42722 (keeping 200 days of data) [2025-09-17T21:13:02.649081] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T21:13:02.816030] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-06. [2025-09-17T21:13:02.852212] [DEBUG] [LOCAL ] PRKS: Primary data saved (42722 records). [2025-09-17T21:13:02.852382] [INFO ] [MAIN ] PRKS: Full history saved. [2025-09-17T21:13:02.852510] [INFO ] [MAIN ] Update Progress: 1730/2371 symbols completed. PRKS took 47.5s. Estimated remaining: 1h 33m 45s. Rate: 6.8 symbols/min [2025-09-17T21:13:03.039741] [INFO ] [MAIN ] PRSU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:13:03.040076] [DEBUG] [LOCAL ] PRSU: No existing data file found in primary storage. [2025-09-17T21:13:03.040147] [WARN ] [MAIN ] PRSU: No existing data found, performing full refresh instead. [2025-09-17T21:13:03.040437] [INFO ] [MAIN ] PRSU: Wiping existing primary data before full refresh. [2025-09-17T21:13:03.040620] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-17T21:13:03.040852] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-17T21:13:03.040945] [INFO ] [MAIN ] PRSU: Starting full primary refresh. [2025-09-17T21:13:03.418883] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T21:13:03.457901] [INFO ] [REMOTE ] PRSU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:13:03.615768] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-11. [2025-09-17T21:13:04.015266] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:13:04.015751] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-11 [2025-09-17T21:13:04.351950] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T21:13:04.415806] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-07. [2025-09-17T21:13:05.215804] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-02. [2025-09-17T21:13:06.015822] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2024-12. [2025-09-17T21:13:06.408981] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T21:13:06.607700] [DEBUG] [REMOTE ] PRSU: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:13:06.613404] [WARN ] [REMOTE ] PRSU: No data returned for month 2024-12 [2025-09-17T21:13:06.624720] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T21:13:06.815823] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-08. [2025-09-17T21:13:07.615790] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-01. [2025-09-17T21:13:08.415801] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-03. [2025-09-17T21:13:08.907864] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T21:13:09.016906] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-08 (2.20 seconds). [2025-09-17T21:13:09.215794] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-07. [2025-09-17T21:13:09.754819] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T21:13:10.015789] [INFO ] [REMOTE ] PRMB: Fetching primary data for 2025-09. [2025-09-17T21:13:10.815813] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-04. [2025-09-17T21:13:10.948154] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T21:13:11.615801] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-08. [2025-09-17T21:13:11.990152] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T21:13:12.415788] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-05. [2025-09-17T21:13:12.871746] [INFO ] [REMOTE ] PRMB: Incremental fetch complete for 2025-09 (2.86 seconds). [2025-09-17T21:13:12.879855] [INFO ] [REMOTE ] PRMB: Full fetch complete (75814 records). [2025-09-17T21:13:12.880052] [DEBUG] [VALIDATOR ] PRMB: Validating primary data. [2025-09-17T21:13:13.222961] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-02. [2025-09-17T21:13:13.282719] [DEBUG] [VALIDATOR ] PRMB: All expected trading days are present. [2025-09-17T21:13:13.282800] [DEBUG] [VALIDATOR ] PRMB: Primary data validation passed. [2025-09-17T21:13:13.283940] [INFO ] [MAIN ] PRMB: Fetched primary data is valid. [2025-09-17T21:13:13.284006] [DEBUG] [LOCAL ] PRMB: Saving primary data. [2025-09-17T21:13:13.285632] [DEBUG] [LOCAL ] PRMB: Trimmed 75814 records to 53131 (keeping 200 days of data) [2025-09-17T21:13:13.436911] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T21:13:13.659824] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T21:13:13.686004] [DEBUG] [LOCAL ] PRMB: Primary data saved (53131 records). [2025-09-17T21:13:13.686152] [INFO ] [MAIN ] PRMB: Full history saved. [2025-09-17T21:13:13.686241] [INFO ] [MAIN ] Update Progress: 1731/2371 symbols completed. PRMB took 33.7s. Estimated remaining: 1h 33m 37s. Rate: 6.8 symbols/min [2025-09-17T21:13:13.856044] [INFO ] [MAIN ] PRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:13:13.863218] [DEBUG] [LOCAL ] PRT: Loaded 5446 existing records from primary storage. [2025-09-17T21:13:13.863326] [INFO ] [MAIN ] PRT: Loaded 5446 existing records. [2025-09-17T21:13:14.022505] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-06. [2025-09-17T21:13:14.046142] [WARN ] [MAIN ] PRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:13:14.046383] [INFO ] [MAIN ] PRT: Wiping existing primary data before full refresh. [2025-09-17T21:13:14.046500] [INFO ] [LOCAL ] PRT: Starting deletion of primary data. [2025-09-17T21:13:14.046855] [DEBUG] [LOCAL ] PRT: Deleted primary data file. [2025-09-17T21:13:14.047370] [INFO ] [MAIN ] PRT: Starting full primary refresh. [2025-09-17T21:13:14.425528] [INFO ] [REMOTE ] PRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:13:14.440567] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T21:13:14.815797] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-11. [2025-09-17T21:13:15.365808] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T21:13:15.406639] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T21:13:15.615850] [INFO ] [REMOTE ] PRM: Fetching primary data for 2025-09. [2025-09-17T21:13:16.415779] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-07. [2025-09-17T21:13:17.216130] [INFO ] [REMOTE ] PRM: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T21:13:17.216265] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-03. [2025-09-17T21:13:17.224022] [INFO ] [REMOTE ] PRM: Full fetch complete (64085 records). [2025-09-17T21:13:17.224152] [DEBUG] [VALIDATOR ] PRM: Validating primary data. [2025-09-17T21:13:17.616216] [DEBUG] [VALIDATOR ] PRM: All expected trading days are present. [2025-09-17T21:13:17.616298] [DEBUG] [VALIDATOR ] PRM: Primary data validation passed. [2025-09-17T21:13:17.617287] [INFO ] [MAIN ] PRM: Fetched primary data is valid. [2025-09-17T21:13:17.617333] [DEBUG] [LOCAL ] PRM: Saving primary data. [2025-09-17T21:13:17.618574] [DEBUG] [LOCAL ] PRM: Trimmed 64085 records to 44724 (keeping 200 days of data) [2025-09-17T21:13:17.882950] [DEBUG] [LOCAL ] PRM: Primary data saved (44724 records). [2025-09-17T21:13:17.883084] [INFO ] [MAIN ] PRM: Full history saved. [2025-09-17T21:13:17.883202] [INFO ] [MAIN ] Update Progress: 1732/2371 symbols completed. PRM took 41.8s. Estimated remaining: 1h 33m 26s. Rate: 6.8 symbols/min [2025-09-17T21:13:18.024907] [INFO ] [REMOTE ] PRT: Fetching primary data for 2024-12. [2025-09-17T21:13:18.056113] [INFO ] [MAIN ] PRU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:13:18.083897] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T21:13:18.138398] [DEBUG] [LOCAL ] PRU: Loaded 51578 existing records from primary storage. [2025-09-17T21:13:18.138541] [INFO ] [MAIN ] PRU: Loaded 51578 existing records. [2025-09-17T21:13:18.326970] [WARN ] [MAIN ] PRU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:13:18.339973] [INFO ] [MAIN ] PRU: Wiping existing primary data before full refresh. [2025-09-17T21:13:18.342034] [INFO ] [LOCAL ] PRU: Starting deletion of primary data. [2025-09-17T21:13:18.343073] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T21:13:18.348582] [DEBUG] [LOCAL ] PRU: Deleted primary data file. [2025-09-17T21:13:18.349052] [INFO ] [MAIN ] PRU: Starting full primary refresh. [2025-09-17T21:13:18.720268] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T21:13:18.725726] [INFO ] [REMOTE ] PRU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:13:18.815768] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-11. [2025-09-17T21:13:19.615787] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-04. [2025-09-17T21:13:20.355427] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T21:13:20.415774] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-01. [2025-09-17T21:13:20.520337] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T21:13:21.030896] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T21:13:21.215780] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-02. [2025-09-17T21:13:22.015769] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-05. [2025-09-17T21:13:22.062431] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T21:13:22.815775] [INFO ] [REMOTE ] PRU: Fetching primary data for 2024-12. [2025-09-17T21:13:22.927501] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T21:13:23.615766] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-08. [2025-09-17T21:13:24.415693] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-06. [2025-09-17T21:13:24.766564] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T21:13:24.830533] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T21:13:25.215768] [INFO ] [REMOTE ] PRO: Fetching primary data for 2025-09. [2025-09-17T21:13:25.697566] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T21:13:26.015816] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-03. [2025-09-17T21:13:26.521722] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T21:13:26.587816] [INFO ] [REMOTE ] PRO: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T21:13:26.593067] [INFO ] [REMOTE ] PRO: Full fetch complete (50656 records). [2025-09-17T21:13:26.593258] [DEBUG] [VALIDATOR ] PRO: Validating primary data. [2025-09-17T21:13:26.826235] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-04. [2025-09-17T21:13:26.992072] [DEBUG] [VALIDATOR ] PRO: All expected trading days are present. [2025-09-17T21:13:26.992154] [DEBUG] [VALIDATOR ] PRO: Primary data validation passed. [2025-09-17T21:13:26.992985] [INFO ] [MAIN ] PRO: Fetched primary data is valid. [2025-09-17T21:13:26.993072] [DEBUG] [LOCAL ] PRO: Saving primary data. [2025-09-17T21:13:26.995859] [DEBUG] [LOCAL ] PRO: Trimmed 50656 records to 37205 (keeping 200 days of data) [2025-09-17T21:13:27.219419] [DEBUG] [LOCAL ] PRO: Primary data saved (37205 records). [2025-09-17T21:13:27.219574] [INFO ] [MAIN ] PRO: Full history saved. [2025-09-17T21:13:27.220329] [INFO ] [MAIN ] Update Progress: 1733/2371 symbols completed. PRO took 31.8s. Estimated remaining: 1h 33m 18s. Rate: 6.8 symbols/min [2025-09-17T21:13:27.395985] [INFO ] [MAIN ] PRVS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:13:27.396185] [DEBUG] [LOCAL ] PRVS: No existing data file found in primary storage. [2025-09-17T21:13:27.396226] [WARN ] [MAIN ] PRVS: No existing data found, performing full refresh instead. [2025-09-17T21:13:27.396359] [INFO ] [MAIN ] PRVS: Wiping existing primary data before full refresh. [2025-09-17T21:13:27.396400] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-17T21:13:27.396443] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-17T21:13:27.396477] [INFO ] [MAIN ] PRVS: Starting full primary refresh. [2025-09-17T21:13:27.620978] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-01. [2025-09-17T21:13:27.702870] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T21:13:27.779547] [INFO ] [REMOTE ] PRVS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:13:28.415789] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-05. [2025-09-17T21:13:28.920326] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T21:13:29.185905] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T21:13:29.215740] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-02. [2025-09-17T21:13:30.015773] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-06. [2025-09-17T21:13:30.676028] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T21:13:30.815744] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-11. [2025-09-17T21:13:31.058510] [DEBUG] [REMOTE ] PRVS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:13:31.058840] [WARN ] [REMOTE ] PRVS: No data returned for month 2024-11 [2025-09-17T21:13:31.127363] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-17T21:13:31.615777] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2024-12. [2025-09-17T21:13:32.113341] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T21:13:32.415813] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-01. [2025-09-17T21:13:32.893810] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-01 (0.48 seconds). [2025-09-17T21:13:33.215785] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-07. [2025-09-17T21:13:33.991410] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T21:13:34.015734] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-07. [2025-09-17T21:13:34.815776] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-08. [2025-09-17T21:13:35.315017] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T21:13:35.501527] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T21:13:35.615758] [INFO ] [REMOTE ] PRT: Fetching primary data for 2025-09. [2025-09-17T21:13:36.371985] [INFO ] [REMOTE ] PRT: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T21:13:36.374454] [INFO ] [REMOTE ] PRT: Full fetch complete (9173 records). [2025-09-17T21:13:36.374779] [DEBUG] [VALIDATOR ] PRT: Validating primary data. [2025-09-17T21:13:36.421356] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-08. [2025-09-17T21:13:36.756739] [DEBUG] [VALIDATOR ] PRT: All expected trading days are present. [2025-09-17T21:13:36.756828] [DEBUG] [VALIDATOR ] PRT: Primary data validation passed. [2025-09-17T21:13:36.757067] [INFO ] [MAIN ] PRT: Fetched primary data is valid. [2025-09-17T21:13:36.757107] [DEBUG] [LOCAL ] PRT: Saving primary data. [2025-09-17T21:13:36.757522] [DEBUG] [LOCAL ] PRT: Trimmed 9173 records to 5402 (keeping 200 days of data) [2025-09-17T21:13:36.790346] [DEBUG] [LOCAL ] PRT: Primary data saved (5402 records). [2025-09-17T21:13:36.790479] [INFO ] [MAIN ] PRT: Full history saved. [2025-09-17T21:13:36.790575] [INFO ] [MAIN ] Update Progress: 1734/2371 symbols completed. PRT took 23.1s. Estimated remaining: 1h 33m 9s. Rate: 6.8 symbols/min [2025-09-17T21:13:36.961248] [INFO ] [MAIN ] PSA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:13:37.002241] [DEBUG] [LOCAL ] PSA: Loaded 41934 existing records from primary storage. [2025-09-17T21:13:37.002387] [INFO ] [MAIN ] PSA: Loaded 41934 existing records. [2025-09-17T21:13:37.213665] [WARN ] [MAIN ] PSA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:13:37.213948] [INFO ] [MAIN ] PSA: Wiping existing primary data before full refresh. [2025-09-17T21:13:37.213993] [INFO ] [LOCAL ] PSA: Starting deletion of primary data. [2025-09-17T21:13:37.215106] [DEBUG] [LOCAL ] PSA: Deleted primary data file. [2025-09-17T21:13:37.215157] [INFO ] [MAIN ] PSA: Starting full primary refresh. [2025-09-17T21:13:37.226362] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-03. [2025-09-17T21:13:37.571904] [INFO ] [REMOTE ] PSA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:13:37.757223] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T21:13:38.015812] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-02. [2025-09-17T21:13:38.338759] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-17T21:13:38.815806] [INFO ] [REMOTE ] PRSU: Fetching primary data for 2025-09. [2025-09-17T21:13:38.939605] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T21:13:39.507432] [INFO ] [REMOTE ] PRSU: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T21:13:39.510437] [INFO ] [REMOTE ] PRSU: Full fetch complete (31310 records). [2025-09-17T21:13:39.510509] [DEBUG] [VALIDATOR ] PRSU: Validating primary data. [2025-09-17T21:13:39.618001] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-04. [2025-09-17T21:13:39.712283] [WARN ] [VALIDATOR ] PRSU: Validation failed - insufficient historical data. Have 177 unique days, need 200 days [2025-09-17T21:13:39.713112] [FATAL] [MAIN ] PRSU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:13:39.713188] [WARN ] [MAIN ] PRSU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:13:39.713256] [INFO ] [LOCAL ] PRSU: Starting deletion of primary data. [2025-09-17T21:13:39.713338] [DEBUG] [LOCAL ] PRSU: No primary data file found to delete. [2025-09-17T21:13:39.713388] [INFO ] [LOCAL ] PRSU: Starting deletion of derivative data. [2025-09-17T21:13:39.713440] [DEBUG] [LOCAL ] PRSU: No derivative data file found to delete. [2025-09-17T21:13:39.713506] [INFO ] [MAIN ] Update Progress: 1735/2371 symbols completed. PRSU took 36.9s. Estimated remaining: 1h 32m 58s. Rate: 6.8 symbols/min [2025-09-17T21:13:39.882241] [INFO ] [MAIN ] PSBD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:13:39.891447] [DEBUG] [LOCAL ] PSBD: Loaded 6796 existing records from primary storage. [2025-09-17T21:13:39.891595] [INFO ] [MAIN ] PSBD: Loaded 6796 existing records. [2025-09-17T21:13:40.069343] [WARN ] [MAIN ] PSBD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:13:40.069616] [INFO ] [MAIN ] PSBD: Wiping existing primary data before full refresh. [2025-09-17T21:13:40.069695] [INFO ] [LOCAL ] PSBD: Starting deletion of primary data. [2025-09-17T21:13:40.069991] [DEBUG] [LOCAL ] PSBD: Deleted primary data file. [2025-09-17T21:13:40.070044] [INFO ] [MAIN ] PSBD: Starting full primary refresh. [2025-09-17T21:13:40.424913] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-11. [2025-09-17T21:13:40.430313] [INFO ] [REMOTE ] PSBD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:13:41.183014] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T21:13:41.215680] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-03. [2025-09-17T21:13:41.619087] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T21:13:42.015786] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-04. [2025-09-17T21:13:42.147606] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T21:13:42.380009] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-04 (0.36 seconds). [2025-09-17T21:13:42.815765] [INFO ] [REMOTE ] PSA: Fetching primary data for 2024-12. [2025-09-17T21:13:43.615821] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-05. [2025-09-17T21:13:43.956374] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T21:13:44.407740] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T21:13:44.415684] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-01. [2025-09-17T21:13:45.215812] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-06. [2025-09-17T21:13:45.519561] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T21:13:45.664079] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T21:13:46.015827] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-05. [2025-09-17T21:13:46.815788] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-02. [2025-09-17T21:13:47.615811] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-07. [2025-09-17T21:13:48.273387] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-05 (2.26 seconds). [2025-09-17T21:13:48.335868] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T21:13:48.366944] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T21:13:48.415749] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-03. [2025-09-17T21:13:49.215831] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-08. [2025-09-17T21:13:49.693155] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-08 (0.48 seconds). [2025-09-17T21:13:50.015809] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-06. [2025-09-17T21:13:50.114521] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T21:13:50.815811] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-11. [2025-09-17T21:13:51.231709] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T21:13:51.513567] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T21:13:51.615757] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-07. [2025-09-17T21:13:52.415812] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2024-12. [2025-09-17T21:13:53.170215] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T21:13:53.215744] [INFO ] [REMOTE ] PRVS: Fetching primary data for 2025-09. [2025-09-17T21:13:53.298785] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T21:13:53.619260] [INFO ] [REMOTE ] PRVS: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T21:13:53.619981] [INFO ] [REMOTE ] PRVS: Full fetch complete (1229 records). [2025-09-17T21:13:53.620048] [DEBUG] [VALIDATOR ] PRVS: Validating primary data. [2025-09-17T21:13:53.806405] [WARN ] [VALIDATOR ] PRVS: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-17T21:13:53.806604] [FATAL] [MAIN ] PRVS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:13:53.806675] [WARN ] [MAIN ] PRVS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:13:53.806723] [INFO ] [LOCAL ] PRVS: Starting deletion of primary data. [2025-09-17T21:13:53.806792] [DEBUG] [LOCAL ] PRVS: No primary data file found to delete. [2025-09-17T21:13:53.806829] [INFO ] [LOCAL ] PRVS: Starting deletion of derivative data. [2025-09-17T21:13:53.806872] [DEBUG] [LOCAL ] PRVS: No derivative data file found to delete. [2025-09-17T21:13:53.806944] [INFO ] [MAIN ] Update Progress: 1736/2371 symbols completed. PRVS took 26.6s. Estimated remaining: 1h 32m 52s. Rate: 6.8 symbols/min [2025-09-17T21:13:53.988110] [INFO ] [MAIN ] PSF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:13:54.004811] [DEBUG] [LOCAL ] PSF: Loaded 6679 existing records from primary storage. [2025-09-17T21:13:54.004945] [INFO ] [MAIN ] PSF: Loaded 6679 existing records. [2025-09-17T21:13:54.025546] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-01. [2025-09-17T21:13:54.193611] [WARN ] [MAIN ] PSF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:13:54.193959] [INFO ] [MAIN ] PSF: Wiping existing primary data before full refresh. [2025-09-17T21:13:54.194013] [INFO ] [LOCAL ] PSF: Starting deletion of primary data. [2025-09-17T21:13:54.194310] [DEBUG] [LOCAL ] PSF: Deleted primary data file. [2025-09-17T21:13:54.194355] [INFO ] [MAIN ] PSF: Starting full primary refresh. [2025-09-17T21:13:54.553330] [INFO ] [REMOTE ] PSF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:13:54.815787] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-04. [2025-09-17T21:13:54.970363] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T21:13:55.615795] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-08. [2025-09-17T21:13:56.420781] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-02. [2025-09-17T21:13:56.426008] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T21:13:56.477483] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T21:13:57.119695] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T21:13:57.215774] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-03. [2025-09-17T21:13:58.015767] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-05. [2025-09-17T21:13:58.047898] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T21:13:58.815773] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-04. [2025-09-17T21:13:59.540332] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-04 (0.72 seconds). [2025-09-17T21:13:59.615746] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-05. [2025-09-17T21:13:59.714337] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T21:14:00.341537] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T21:14:00.415747] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-06. [2025-09-17T21:14:01.215792] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-06. [2025-09-17T21:14:01.511897] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T21:14:02.015823] [INFO ] [REMOTE ] PRU: Fetching primary data for 2025-09. [2025-09-17T21:14:02.815762] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-07. [2025-09-17T21:14:02.920159] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T21:14:03.326838] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T21:14:03.615799] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-08. [2025-09-17T21:14:03.877516] [INFO ] [REMOTE ] PRU: Incremental fetch complete for 2025-09 (1.86 seconds). [2025-09-17T21:14:03.884181] [INFO ] [REMOTE ] PRU: Full fetch complete (74088 records). [2025-09-17T21:14:03.884298] [DEBUG] [VALIDATOR ] PRU: Validating primary data. [2025-09-17T21:14:04.279291] [DEBUG] [VALIDATOR ] PRU: All expected trading days are present. [2025-09-17T21:14:04.279401] [DEBUG] [VALIDATOR ] PRU: Primary data validation passed. [2025-09-17T21:14:04.280438] [INFO ] [MAIN ] PRU: Fetched primary data is valid. [2025-09-17T21:14:04.280507] [DEBUG] [LOCAL ] PRU: Saving primary data. [2025-09-17T21:14:04.288077] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T21:14:04.289202] [DEBUG] [LOCAL ] PRU: Trimmed 74088 records to 51572 (keeping 200 days of data) [2025-09-17T21:14:04.415777] [INFO ] [REMOTE ] PSBD: Fetching primary data for 2025-09. [2025-09-17T21:14:04.629919] [DEBUG] [LOCAL ] PRU: Primary data saved (51572 records). [2025-09-17T21:14:04.630111] [INFO ] [MAIN ] PRU: Full history saved. [2025-09-17T21:14:04.630237] [INFO ] [MAIN ] Update Progress: 1737/2371 symbols completed. PRU took 46.7s. Estimated remaining: 1h 32m 44s. Rate: 6.8 symbols/min [2025-09-17T21:14:04.799820] [INFO ] [MAIN ] PSFE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:14:04.830020] [DEBUG] [LOCAL ] PSFE: Loaded 30931 existing records from primary storage. [2025-09-17T21:14:04.830154] [INFO ] [MAIN ] PSFE: Loaded 30931 existing records. [2025-09-17T21:14:05.007758] [WARN ] [MAIN ] PSFE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:14:05.008046] [INFO ] [MAIN ] PSFE: Wiping existing primary data before full refresh. [2025-09-17T21:14:05.008094] [INFO ] [LOCAL ] PSFE: Starting deletion of primary data. [2025-09-17T21:14:05.008861] [DEBUG] [LOCAL ] PSFE: Deleted primary data file. [2025-09-17T21:14:05.008913] [INFO ] [MAIN ] PSFE: Starting full primary refresh. [2025-09-17T21:14:05.220950] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-07. [2025-09-17T21:14:05.269198] [INFO ] [REMOTE ] PSBD: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T21:14:05.310755] [INFO ] [REMOTE ] PSBD: Full fetch complete (9093 records). [2025-09-17T21:14:05.316739] [DEBUG] [VALIDATOR ] PSBD: Validating primary data. [2025-09-17T21:14:05.489108] [INFO ] [REMOTE ] PSFE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:14:05.764858] [DEBUG] [VALIDATOR ] PSBD: All expected trading days are present. [2025-09-17T21:14:05.764941] [DEBUG] [VALIDATOR ] PSBD: Primary data validation passed. [2025-09-17T21:14:05.765190] [INFO ] [MAIN ] PSBD: Fetched primary data is valid. [2025-09-17T21:14:05.765229] [DEBUG] [LOCAL ] PSBD: Saving primary data. [2025-09-17T21:14:05.765677] [DEBUG] [LOCAL ] PSBD: Trimmed 9093 records to 6826 (keeping 200 days of data) [2025-09-17T21:14:05.808719] [DEBUG] [LOCAL ] PSBD: Primary data saved (6826 records). [2025-09-17T21:14:05.808856] [INFO ] [MAIN ] PSBD: Full history saved. [2025-09-17T21:14:05.808951] [INFO ] [MAIN ] Update Progress: 1738/2371 symbols completed. PSBD took 26.1s. Estimated remaining: 1h 32m 32s. Rate: 6.8 symbols/min [2025-09-17T21:14:05.981837] [INFO ] [MAIN ] PSN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:14:06.026263] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-11. [2025-09-17T21:14:06.029332] [DEBUG] [LOCAL ] PSN: Loaded 46387 existing records from primary storage. [2025-09-17T21:14:06.029493] [INFO ] [MAIN ] PSN: Loaded 46387 existing records. [2025-09-17T21:14:06.205972] [WARN ] [MAIN ] PSN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:14:06.206212] [INFO ] [MAIN ] PSN: Wiping existing primary data before full refresh. [2025-09-17T21:14:06.206257] [INFO ] [LOCAL ] PSN: Starting deletion of primary data. [2025-09-17T21:14:06.207261] [DEBUG] [LOCAL ] PSN: Deleted primary data file. [2025-09-17T21:14:06.207310] [INFO ] [MAIN ] PSN: Starting full primary refresh. [2025-09-17T21:14:06.558761] [INFO ] [REMOTE ] PSN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:14:06.818437] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-11. [2025-09-17T21:14:06.824564] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T21:14:07.122435] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T21:14:07.538992] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T21:14:07.615753] [INFO ] [REMOTE ] PSF: Fetching primary data for 2024-12. [2025-09-17T21:14:08.129448] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T21:14:08.415785] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2024-12. [2025-09-17T21:14:09.215803] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-11. [2025-09-17T21:14:10.015784] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-08. [2025-09-17T21:14:10.047866] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T21:14:10.815752] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-01. [2025-09-17T21:14:10.817003] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T21:14:10.851151] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T21:14:11.615782] [INFO ] [REMOTE ] PSN: Fetching primary data for 2024-12. [2025-09-17T21:14:11.888280] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T21:14:12.415786] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-02. [2025-09-17T21:14:12.855219] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T21:14:13.215789] [INFO ] [REMOTE ] PSA: Fetching primary data for 2025-09. [2025-09-17T21:14:13.761935] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T21:14:14.015773] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-03. [2025-09-17T21:14:14.758729] [INFO ] [REMOTE ] PSA: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T21:14:14.764415] [INFO ] [REMOTE ] PSA: Full fetch complete (58872 records). [2025-09-17T21:14:14.764546] [DEBUG] [VALIDATOR ] PSA: Validating primary data. [2025-09-17T21:14:14.823179] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-01. [2025-09-17T21:14:15.154789] [DEBUG] [VALIDATOR ] PSA: All expected trading days are present. [2025-09-17T21:14:15.154884] [DEBUG] [VALIDATOR ] PSA: Primary data validation passed. [2025-09-17T21:14:15.155836] [INFO ] [MAIN ] PSA: Fetched primary data is valid. [2025-09-17T21:14:15.155885] [DEBUG] [LOCAL ] PSA: Saving primary data. [2025-09-17T21:14:15.157261] [DEBUG] [LOCAL ] PSA: Trimmed 58872 records to 41914 (keeping 200 days of data) [2025-09-17T21:14:15.410501] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T21:14:15.457786] [DEBUG] [LOCAL ] PSA: Primary data saved (41914 records). [2025-09-17T21:14:15.457930] [INFO ] [MAIN ] PSA: Full history saved. [2025-09-17T21:14:15.458020] [INFO ] [MAIN ] Update Progress: 1739/2371 symbols completed. PSA took 38.7s. Estimated remaining: 1h 32m 24s. Rate: 6.8 symbols/min [2025-09-17T21:14:15.617744] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-04. [2025-09-17T21:14:15.626733] [INFO ] [MAIN ] PSO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:14:15.664400] [DEBUG] [LOCAL ] PSO: Loaded 37841 existing records from primary storage. [2025-09-17T21:14:15.664547] [INFO ] [MAIN ] PSO: Loaded 37841 existing records. [2025-09-17T21:14:15.840322] [WARN ] [MAIN ] PSO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:14:15.840575] [INFO ] [MAIN ] PSO: Wiping existing primary data before full refresh. [2025-09-17T21:14:15.840621] [INFO ] [LOCAL ] PSO: Starting deletion of primary data. [2025-09-17T21:14:15.841490] [DEBUG] [LOCAL ] PSO: Deleted primary data file. [2025-09-17T21:14:15.841537] [INFO ] [MAIN ] PSO: Starting full primary refresh. [2025-09-17T21:14:16.197192] [INFO ] [REMOTE ] PSO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:14:16.287046] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T21:14:16.415734] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-11. [2025-09-17T21:14:16.735455] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T21:14:17.215796] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-01. [2025-09-17T21:14:17.783203] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T21:14:17.934291] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T21:14:18.015781] [INFO ] [REMOTE ] PSO: Fetching primary data for 2024-12. [2025-09-17T21:14:18.815774] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-02. [2025-09-17T21:14:19.299741] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T21:14:19.615791] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-01. [2025-09-17T21:14:20.356412] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T21:14:20.415794] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-05. [2025-09-17T21:14:20.741554] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T21:14:21.215759] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-02. [2025-09-17T21:14:21.526434] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T21:14:21.899504] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T21:14:22.015740] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-06. [2025-09-17T21:14:22.815781] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-03. [2025-09-17T21:14:23.361005] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T21:14:23.615838] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-07. [2025-09-17T21:14:24.318128] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T21:14:24.415822] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-04. [2025-09-17T21:14:24.882078] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T21:14:25.215813] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-03. [2025-09-17T21:14:25.774708] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T21:14:25.896200] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-03 (0.68 seconds). [2025-09-17T21:14:26.015848] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-04. [2025-09-17T21:14:26.632459] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T21:14:26.815846] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-08. [2025-09-17T21:14:27.615837] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-05. [2025-09-17T21:14:28.292681] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T21:14:28.415795] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-05. [2025-09-17T21:14:28.453621] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T21:14:29.215829] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-06. [2025-09-17T21:14:29.776817] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T21:14:30.015825] [INFO ] [REMOTE ] PSFE: Fetching primary data for 2025-09. [2025-09-17T21:14:30.562139] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T21:14:30.815777] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-06. [2025-09-17T21:14:31.119047] [INFO ] [REMOTE ] PSFE: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T21:14:31.122440] [INFO ] [REMOTE ] PSFE: Full fetch complete (43478 records). [2025-09-17T21:14:31.122570] [DEBUG] [VALIDATOR ] PSFE: Validating primary data. [2025-09-17T21:14:31.526844] [DEBUG] [VALIDATOR ] PSFE: All expected trading days are present. [2025-09-17T21:14:31.526934] [DEBUG] [VALIDATOR ] PSFE: Primary data validation passed. [2025-09-17T21:14:31.527840] [INFO ] [MAIN ] PSFE: Fetched primary data is valid. [2025-09-17T21:14:31.527915] [DEBUG] [LOCAL ] PSFE: Saving primary data. [2025-09-17T21:14:31.528934] [DEBUG] [LOCAL ] PSFE: Trimmed 43478 records to 30902 (keeping 200 days of data) [2025-09-17T21:14:31.623686] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-02. [2025-09-17T21:14:31.716177] [DEBUG] [LOCAL ] PSFE: Primary data saved (30902 records). [2025-09-17T21:14:31.716348] [INFO ] [MAIN ] PSFE: Full history saved. [2025-09-17T21:14:31.716491] [INFO ] [MAIN ] Update Progress: 1740/2371 symbols completed. PSFE took 27.1s. Estimated remaining: 1h 32m 18s. Rate: 6.8 symbols/min [2025-09-17T21:14:31.905984] [INFO ] [MAIN ] PSQH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:14:31.946915] [DEBUG] [LOCAL ] PSQH: Loaded 34432 existing records from primary storage. [2025-09-17T21:14:31.947088] [INFO ] [MAIN ] PSQH: Loaded 34432 existing records. [2025-09-17T21:14:32.132370] [WARN ] [MAIN ] PSQH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:14:32.132596] [INFO ] [MAIN ] PSQH: Wiping existing primary data before full refresh. [2025-09-17T21:14:32.132658] [INFO ] [LOCAL ] PSQH: Starting deletion of primary data. [2025-09-17T21:14:32.133518] [DEBUG] [LOCAL ] PSQH: Deleted primary data file. [2025-09-17T21:14:32.133577] [INFO ] [MAIN ] PSQH: Starting full primary refresh. [2025-09-17T21:14:32.427439] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-07. [2025-09-17T21:14:32.511688] [INFO ] [REMOTE ] PSQH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:14:32.539841] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T21:14:32.607702] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-02 (0.98 seconds). [2025-09-17T21:14:33.163339] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T21:14:33.215750] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-08. [2025-09-17T21:14:33.854873] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T21:14:34.015824] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-11. [2025-09-17T21:14:34.815812] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-03. [2025-09-17T21:14:34.830393] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T21:14:35.615790] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-07. [2025-09-17T21:14:36.208613] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T21:14:36.415777] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-04. [2025-09-17T21:14:36.931259] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T21:14:37.215794] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-08. [2025-09-17T21:14:37.674998] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T21:14:38.015762] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-05. [2025-09-17T21:14:38.815806] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2024-12. [2025-09-17T21:14:38.931092] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T21:14:39.096711] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T21:14:39.615833] [INFO ] [REMOTE ] PSN: Fetching primary data for 2025-09. [2025-09-17T21:14:40.415793] [INFO ] [REMOTE ] PSF: Fetching primary data for 2025-09. [2025-09-17T21:14:41.118922] [INFO ] [REMOTE ] PSN: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T21:14:41.155329] [INFO ] [REMOTE ] PSN: Full fetch complete (66547 records). [2025-09-17T21:14:41.158233] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-17T21:14:41.158380] [DEBUG] [VALIDATOR ] PSN: Validating primary data. [2025-09-17T21:14:41.174119] [INFO ] [REMOTE ] PSF: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T21:14:41.217982] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-01. [2025-09-17T21:14:41.271106] [INFO ] [REMOTE ] PSF: Full fetch complete (9656 records). [2025-09-17T21:14:41.282269] [DEBUG] [VALIDATOR ] PSF: Validating primary data. [2025-09-17T21:14:41.881743] [DEBUG] [VALIDATOR ] PSN: All expected trading days are present. [2025-09-17T21:14:41.900416] [DEBUG] [VALIDATOR ] PSN: Primary data validation passed. [2025-09-17T21:14:41.918233] [INFO ] [MAIN ] PSN: Fetched primary data is valid. [2025-09-17T21:14:41.941726] [DEBUG] [LOCAL ] PSN: Saving primary data. [2025-09-17T21:14:41.941932] [DEBUG] [VALIDATOR ] PSF: All expected trading days are present. [2025-09-17T21:14:41.941982] [DEBUG] [VALIDATOR ] PSF: Primary data validation passed. [2025-09-17T21:14:41.942126] [INFO ] [MAIN ] PSF: Fetched primary data is valid. [2025-09-17T21:14:41.942309] [DEBUG] [LOCAL ] PSF: Saving primary data. [2025-09-17T21:14:41.942972] [DEBUG] [LOCAL ] PSF: Trimmed 9656 records to 6743 (keeping 200 days of data) [2025-09-17T21:14:41.943577] [DEBUG] [LOCAL ] PSN: Trimmed 66547 records to 46416 (keeping 200 days of data) [2025-09-17T21:14:42.022814] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-06. [2025-09-17T21:14:42.156730] [DEBUG] [LOCAL ] PSF: Primary data saved (6743 records). [2025-09-17T21:14:42.166580] [INFO ] [MAIN ] PSF: Full history saved. [2025-09-17T21:14:42.167407] [INFO ] [MAIN ] Update Progress: 1741/2371 symbols completed. PSF took 48.4s. Estimated remaining: 1h 32m 9s. Rate: 6.8 symbols/min [2025-09-17T21:14:42.396413] [INFO ] [MAIN ] PSTG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:14:42.445105] [DEBUG] [LOCAL ] PSN: Primary data saved (46416 records). [2025-09-17T21:14:42.445288] [INFO ] [MAIN ] PSN: Full history saved. [2025-09-17T21:14:42.445431] [INFO ] [MAIN ] Update Progress: 1742/2371 symbols completed. PSN took 36.6s. Estimated remaining: 1h 31m 57s. Rate: 6.8 symbols/min [2025-09-17T21:14:42.635120] [INFO ] [MAIN ] PSTL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:14:42.651407] [DEBUG] [LOCAL ] PSTG: Loaded 52858 existing records from primary storage. [2025-09-17T21:14:42.651701] [INFO ] [MAIN ] PSTG: Loaded 52858 existing records. [2025-09-17T21:14:42.852407] [WARN ] [MAIN ] PSTG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:14:42.852518] [DEBUG] [LOCAL ] PSTL: Loaded 20679 existing records from primary storage. [2025-09-17T21:14:42.852871] [INFO ] [MAIN ] PSTL: Loaded 20679 existing records. [2025-09-17T21:14:42.922318] [INFO ] [MAIN ] PSTG: Wiping existing primary data before full refresh. [2025-09-17T21:14:42.944054] [INFO ] [LOCAL ] PSTG: Starting deletion of primary data. [2025-09-17T21:14:42.960780] [DEBUG] [LOCAL ] PSTG: Deleted primary data file. [2025-09-17T21:14:42.971120] [INFO ] [MAIN ] PSTG: Starting full primary refresh. [2025-09-17T21:14:43.104586] [WARN ] [MAIN ] PSTL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:14:43.111950] [INFO ] [MAIN ] PSTL: Wiping existing primary data before full refresh. [2025-09-17T21:14:43.130567] [INFO ] [LOCAL ] PSTL: Starting deletion of primary data. [2025-09-17T21:14:43.149300] [DEBUG] [LOCAL ] PSTL: Deleted primary data file. [2025-09-17T21:14:43.190608] [INFO ] [MAIN ] PSTL: Starting full primary refresh. [2025-09-17T21:14:43.622290] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-01 (2.40 seconds). [2025-09-17T21:14:43.678763] [INFO ] [REMOTE ] PSTG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:14:43.714102] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-11. [2025-09-17T21:14:43.747035] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-02. [2025-09-17T21:14:43.849382] [INFO ] [REMOTE ] PSTL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:14:43.872658] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T21:14:44.415834] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-07. [2025-09-17T21:14:45.215801] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-11. [2025-09-17T21:14:45.246446] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T21:14:45.690415] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-11 (1.98 seconds). [2025-09-17T21:14:45.764712] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T21:14:45.932159] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T21:14:46.015794] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2024-12. [2025-09-17T21:14:46.815798] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-08. [2025-09-17T21:14:47.615798] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-03. [2025-09-17T21:14:47.983689] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T21:14:48.016391] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T21:14:48.415787] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-01. [2025-09-17T21:14:49.176552] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T21:14:49.215757] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-04. [2025-09-17T21:14:50.015795] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2024-12. [2025-09-17T21:14:50.137474] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T21:14:50.370322] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T21:14:50.815797] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-02. [2025-09-17T21:14:51.134984] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T21:14:51.615841] [INFO ] [REMOTE ] PSO: Fetching primary data for 2025-09. [2025-09-17T21:14:52.415806] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-05. [2025-09-17T21:14:52.601856] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T21:14:52.671051] [INFO ] [REMOTE ] PSO: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T21:14:52.675799] [INFO ] [REMOTE ] PSO: Full fetch complete (51553 records). [2025-09-17T21:14:52.675916] [DEBUG] [VALIDATOR ] PSO: Validating primary data. [2025-09-17T21:14:53.078439] [DEBUG] [VALIDATOR ] PSO: All expected trading days are present. [2025-09-17T21:14:53.078563] [DEBUG] [VALIDATOR ] PSO: Primary data validation passed. [2025-09-17T21:14:53.079549] [INFO ] [MAIN ] PSO: Fetched primary data is valid. [2025-09-17T21:14:53.079597] [DEBUG] [LOCAL ] PSO: Saving primary data. [2025-09-17T21:14:53.080830] [DEBUG] [LOCAL ] PSO: Trimmed 51553 records to 37818 (keeping 200 days of data) [2025-09-17T21:14:53.258715] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-03. [2025-09-17T21:14:53.320381] [DEBUG] [LOCAL ] PSO: Primary data saved (37818 records). [2025-09-17T21:14:53.320524] [INFO ] [MAIN ] PSO: Full history saved. [2025-09-17T21:14:53.320670] [INFO ] [MAIN ] Update Progress: 1743/2371 symbols completed. PSO took 37.9s. Estimated remaining: 1h 31m 49s. Rate: 6.8 symbols/min [2025-09-17T21:14:53.504404] [INFO ] [MAIN ] PSX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:14:53.562253] [DEBUG] [LOCAL ] PSX: Loaded 53144 existing records from primary storage. [2025-09-17T21:14:53.562409] [INFO ] [MAIN ] PSX: Loaded 53144 existing records. [2025-09-17T21:14:53.761478] [WARN ] [MAIN ] PSX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:14:53.761894] [INFO ] [MAIN ] PSX: Wiping existing primary data before full refresh. [2025-09-17T21:14:53.762007] [INFO ] [LOCAL ] PSX: Starting deletion of primary data. [2025-09-17T21:14:53.771455] [DEBUG] [LOCAL ] PSX: Deleted primary data file. [2025-09-17T21:14:53.785090] [INFO ] [MAIN ] PSX: Starting full primary refresh. [2025-09-17T21:14:53.809035] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T21:14:54.021991] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-06. [2025-09-17T21:14:54.164130] [INFO ] [REMOTE ] PSX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:14:54.815835] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-01. [2025-09-17T21:14:55.269470] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T21:14:55.548107] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T21:14:55.615742] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-04. [2025-09-17T21:14:55.767791] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T21:14:56.415807] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-11. [2025-09-17T21:14:57.215805] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-07. [2025-09-17T21:14:57.678926] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T21:14:57.868274] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T21:14:58.015779] [INFO ] [REMOTE ] PSX: Fetching primary data for 2024-12. [2025-09-17T21:14:58.288949] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T21:14:58.815785] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-02. [2025-09-17T21:14:59.450081] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T21:14:59.615804] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-08. [2025-09-17T21:14:59.944708] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T21:15:00.415795] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-05. [2025-09-17T21:15:01.156665] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T21:15:01.215771] [INFO ] [REMOTE ] PSQH: Fetching primary data for 2025-09. [2025-09-17T21:15:02.015831] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-01. [2025-09-17T21:15:02.815793] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-03. [2025-09-17T21:15:03.197206] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-05 (2.78 seconds). [2025-09-17T21:15:03.192259] [INFO ] [REMOTE ] PSQH: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-17T21:15:03.215196] [INFO ] [REMOTE ] PSQH: Full fetch complete (53309 records). [2025-09-17T21:15:03.215438] [DEBUG] [VALIDATOR ] PSQH: Validating primary data. [2025-09-17T21:15:03.611592] [DEBUG] [VALIDATOR ] PSQH: All expected trading days are present. [2025-09-17T21:15:03.611716] [DEBUG] [VALIDATOR ] PSQH: Primary data validation passed. [2025-09-17T21:15:03.612578] [INFO ] [MAIN ] PSQH: Fetched primary data is valid. [2025-09-17T21:15:03.612622] [DEBUG] [LOCAL ] PSQH: Saving primary data. [2025-09-17T21:15:03.615059] [DEBUG] [LOCAL ] PSQH: Trimmed 53309 records to 34479 (keeping 200 days of data) [2025-09-17T21:15:03.615824] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-06. [2025-09-17T21:15:03.825597] [DEBUG] [LOCAL ] PSQH: Primary data saved (34479 records). [2025-09-17T21:15:03.825797] [INFO ] [MAIN ] PSQH: Full history saved. [2025-09-17T21:15:03.825896] [INFO ] [MAIN ] Update Progress: 1744/2371 symbols completed. PSQH took 32.1s. Estimated remaining: 1h 31m 41s. Rate: 6.8 symbols/min [2025-09-17T21:15:03.999196] [INFO ] [MAIN ] PTA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:15:04.016373] [DEBUG] [LOCAL ] PTA: Loaded 15067 existing records from primary storage. [2025-09-17T21:15:04.016522] [INFO ] [MAIN ] PTA: Loaded 15067 existing records. [2025-09-17T21:15:04.202193] [WARN ] [MAIN ] PTA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:15:04.202479] [INFO ] [MAIN ] PTA: Wiping existing primary data before full refresh. [2025-09-17T21:15:04.202525] [INFO ] [LOCAL ] PTA: Starting deletion of primary data. [2025-09-17T21:15:04.203303] [DEBUG] [LOCAL ] PTA: Deleted primary data file. [2025-09-17T21:15:04.203351] [INFO ] [MAIN ] PTA: Starting full primary refresh. [2025-09-17T21:15:04.600874] [INFO ] [REMOTE ] PTA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:15:04.601353] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-11. [2025-09-17T21:15:04.618601] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T21:15:05.215890] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-04. [2025-09-17T21:15:05.726938] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T21:15:06.015805] [INFO ] [REMOTE ] PTA: Fetching primary data for 2024-12. [2025-09-17T21:15:06.309177] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-06 (2.69 seconds). [2025-09-17T21:15:06.436499] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-01 (4.42 seconds). [2025-09-17T21:15:06.461106] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T21:15:06.815783] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-05. [2025-09-17T21:15:07.325318] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T21:15:07.615792] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-02. [2025-09-17T21:15:08.159494] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T21:15:08.415814] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-06. [2025-09-17T21:15:09.128859] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T21:15:09.215770] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-07. [2025-09-17T21:15:09.408310] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T21:15:10.015781] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-07. [2025-09-17T21:15:10.264991] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T21:15:10.815786] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-08. [2025-09-17T21:15:11.615750] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-03. [2025-09-17T21:15:11.788429] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T21:15:12.069669] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T21:15:12.415775] [INFO ] [REMOTE ] PSTL: Fetching primary data for 2025-09. [2025-09-17T21:15:13.215781] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-08. [2025-09-17T21:15:13.411720] [INFO ] [REMOTE ] PSTL: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T21:15:13.414976] [INFO ] [REMOTE ] PSTL: Full fetch complete (29425 records). [2025-09-17T21:15:13.415098] [DEBUG] [VALIDATOR ] PSTL: Validating primary data. [2025-09-17T21:15:13.807252] [DEBUG] [VALIDATOR ] PSTL: All expected trading days are present. [2025-09-17T21:15:13.807343] [DEBUG] [VALIDATOR ] PSTL: Primary data validation passed. [2025-09-17T21:15:13.807951] [INFO ] [MAIN ] PSTL: Fetched primary data is valid. [2025-09-17T21:15:13.808003] [DEBUG] [LOCAL ] PSTL: Saving primary data. [2025-09-17T21:15:13.809029] [DEBUG] [LOCAL ] PSTL: Trimmed 29425 records to 20594 (keeping 200 days of data) [2025-09-17T21:15:13.955669] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-17T21:15:13.989023] [DEBUG] [LOCAL ] PSTL: Primary data saved (20594 records). [2025-09-17T21:15:13.989167] [INFO ] [MAIN ] PSTL: Full history saved. [2025-09-17T21:15:13.989256] [INFO ] [MAIN ] Update Progress: 1745/2371 symbols completed. PSTL took 31.5s. Estimated remaining: 1h 31m 33s. Rate: 6.8 symbols/min [2025-09-17T21:15:14.020978] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-01. [2025-09-17T21:15:14.164821] [INFO ] [MAIN ] PTY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:15:14.203795] [DEBUG] [LOCAL ] PTY: Loaded 37375 existing records from primary storage. [2025-09-17T21:15:14.203965] [INFO ] [MAIN ] PTY: Loaded 37375 existing records. [2025-09-17T21:15:14.385364] [WARN ] [MAIN ] PTY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:15:14.385671] [INFO ] [MAIN ] PTY: Wiping existing primary data before full refresh. [2025-09-17T21:15:14.385736] [INFO ] [LOCAL ] PTY: Starting deletion of primary data. [2025-09-17T21:15:14.386697] [DEBUG] [LOCAL ] PTY: Deleted primary data file. [2025-09-17T21:15:14.386751] [INFO ] [MAIN ] PTY: Starting full primary refresh. [2025-09-17T21:15:14.752061] [INFO ] [REMOTE ] PTY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:15:14.815743] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-11. [2025-09-17T21:15:15.433612] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-08 (2.22 seconds). [2025-09-17T21:15:15.615796] [INFO ] [REMOTE ] PSTG: Fetching primary data for 2025-09. [2025-09-17T21:15:16.209178] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-17T21:15:16.237131] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T21:15:16.415797] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-04. [2025-09-17T21:15:17.215763] [INFO ] [REMOTE ] PTY: Fetching primary data for 2024-12. [2025-09-17T21:15:17.465805] [INFO ] [REMOTE ] PSTG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T21:15:17.472948] [INFO ] [REMOTE ] PSTG: Full fetch complete (76395 records). [2025-09-17T21:15:17.473132] [DEBUG] [VALIDATOR ] PSTG: Validating primary data. [2025-09-17T21:15:17.870114] [DEBUG] [VALIDATOR ] PSTG: All expected trading days are present. [2025-09-17T21:15:17.870218] [DEBUG] [VALIDATOR ] PSTG: Primary data validation passed. [2025-09-17T21:15:17.871449] [INFO ] [MAIN ] PSTG: Fetched primary data is valid. [2025-09-17T21:15:17.871497] [DEBUG] [LOCAL ] PSTG: Saving primary data. [2025-09-17T21:15:17.873361] [DEBUG] [LOCAL ] PSTG: Trimmed 76395 records to 52855 (keeping 200 days of data) [2025-09-17T21:15:18.043327] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-02. [2025-09-17T21:15:18.202957] [DEBUG] [LOCAL ] PSTG: Primary data saved (52855 records). [2025-09-17T21:15:18.203229] [INFO ] [MAIN ] PSTG: Full history saved. [2025-09-17T21:15:18.204477] [INFO ] [MAIN ] Update Progress: 1746/2371 symbols completed. PSTG took 36.0s. Estimated remaining: 1h 31m 23s. Rate: 6.8 symbols/min [2025-09-17T21:15:18.486253] [INFO ] [MAIN ] PUK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:15:18.496635] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T21:15:18.556051] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T21:15:18.615703] [DEBUG] [LOCAL ] PUK: Loaded 45047 existing records from primary storage. [2025-09-17T21:15:18.615901] [INFO ] [MAIN ] PUK: Loaded 45047 existing records. [2025-09-17T21:15:18.797289] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T21:15:18.821223] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-01. [2025-09-17T21:15:18.938259] [WARN ] [MAIN ] PUK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:15:18.938592] [INFO ] [MAIN ] PUK: Wiping existing primary data before full refresh. [2025-09-17T21:15:18.938742] [INFO ] [LOCAL ] PUK: Starting deletion of primary data. [2025-09-17T21:15:18.939869] [DEBUG] [LOCAL ] PUK: Deleted primary data file. [2025-09-17T21:15:18.939957] [INFO ] [MAIN ] PUK: Starting full primary refresh. [2025-09-17T21:15:19.405762] [INFO ] [REMOTE ] PUK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:15:19.615776] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-03. [2025-09-17T21:15:19.979586] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-01 (1.16 seconds). [2025-09-17T21:15:20.415779] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-02. [2025-09-17T21:15:20.492582] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T21:15:21.215766] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-04. [2025-09-17T21:15:21.566668] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T21:15:22.015767] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-05. [2025-09-17T21:15:22.245959] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T21:15:22.815801] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-03. [2025-09-17T21:15:23.615692] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-11. [2025-09-17T21:15:23.720373] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T21:15:23.848713] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T21:15:24.415799] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-04. [2025-09-17T21:15:25.215801] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-06. [2025-09-17T21:15:26.015753] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-05. [2025-09-17T21:15:26.424473] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-11 (2.81 seconds). [2025-09-17T21:15:26.815781] [INFO ] [REMOTE ] PUK: Fetching primary data for 2024-12. [2025-09-17T21:15:26.988146] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-04 (2.57 seconds). [2025-09-17T21:15:27.103393] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T21:15:27.316588] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-17T21:15:27.615773] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-07. [2025-09-17T21:15:28.024802] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T21:15:28.415828] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-05. [2025-09-17T21:15:29.224104] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-01. [2025-09-17T21:15:29.246316] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T21:15:30.021534] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-06. [2025-09-17T21:15:30.032881] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T21:15:30.657601] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T21:15:30.815745] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-02. [2025-09-17T21:15:30.992575] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T21:15:31.615789] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-06. [2025-09-17T21:15:32.182143] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T21:15:32.415804] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-08. [2025-09-17T21:15:33.152422] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T21:15:33.215786] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-07. [2025-09-17T21:15:33.671959] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T21:15:34.015808] [INFO ] [REMOTE ] PSX: Fetching primary data for 2025-09. [2025-09-17T21:15:34.807578] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T21:15:34.817102] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-07. [2025-09-17T21:15:35.371068] [INFO ] [REMOTE ] PSX: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T21:15:35.378067] [INFO ] [REMOTE ] PSX: Full fetch complete (76886 records). [2025-09-17T21:15:35.378197] [DEBUG] [VALIDATOR ] PSX: Validating primary data. [2025-09-17T21:15:35.620841] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-03. [2025-09-17T21:15:35.787267] [DEBUG] [VALIDATOR ] PSX: All expected trading days are present. [2025-09-17T21:15:35.787359] [DEBUG] [VALIDATOR ] PSX: Primary data validation passed. [2025-09-17T21:15:35.788410] [INFO ] [MAIN ] PSX: Fetched primary data is valid. [2025-09-17T21:15:35.788460] [DEBUG] [LOCAL ] PSX: Saving primary data. [2025-09-17T21:15:35.791317] [DEBUG] [LOCAL ] PSX: Trimmed 76886 records to 53135 (keeping 200 days of data) [2025-09-17T21:15:35.901873] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T21:15:36.148429] [DEBUG] [LOCAL ] PSX: Primary data saved (53135 records). [2025-09-17T21:15:36.148578] [INFO ] [MAIN ] PSX: Full history saved. [2025-09-17T21:15:36.148686] [INFO ] [MAIN ] Update Progress: 1747/2371 symbols completed. PSX took 42.8s. Estimated remaining: 1h 31m 17s. Rate: 6.8 symbols/min [2025-09-17T21:15:36.318342] [INFO ] [MAIN ] PUMP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:15:36.364209] [DEBUG] [LOCAL ] PUMP: Loaded 49500 existing records from primary storage. [2025-09-17T21:15:36.364422] [INFO ] [MAIN ] PUMP: Loaded 49500 existing records. [2025-09-17T21:15:36.422135] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-08. [2025-09-17T21:15:36.557125] [WARN ] [MAIN ] PUMP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:15:36.557385] [INFO ] [MAIN ] PUMP: Wiping existing primary data before full refresh. [2025-09-17T21:15:36.557434] [INFO ] [LOCAL ] PUMP: Starting deletion of primary data. [2025-09-17T21:15:36.558415] [DEBUG] [LOCAL ] PUMP: Deleted primary data file. [2025-09-17T21:15:36.558473] [INFO ] [MAIN ] PUMP: Starting full primary refresh. [2025-09-17T21:15:36.947256] [INFO ] [REMOTE ] PUMP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:15:37.151722] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T21:15:37.215760] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-04. [2025-09-17T21:15:37.490690] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T21:15:38.015794] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-08. [2025-09-17T21:15:38.685215] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T21:15:38.815792] [INFO ] [REMOTE ] PTA: Fetching primary data for 2025-09. [2025-09-17T21:15:39.132368] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T21:15:39.491891] [INFO ] [REMOTE ] PTA: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T21:15:39.494478] [INFO ] [REMOTE ] PTA: Full fetch complete (23727 records). [2025-09-17T21:15:39.494577] [DEBUG] [VALIDATOR ] PTA: Validating primary data. [2025-09-17T21:15:39.620855] [INFO ] [REMOTE ] PTY: Fetching primary data for 2025-09. [2025-09-17T21:15:39.923375] [DEBUG] [VALIDATOR ] PTA: All expected trading days are present. [2025-09-17T21:15:39.923460] [DEBUG] [VALIDATOR ] PTA: Primary data validation passed. [2025-09-17T21:15:39.924138] [INFO ] [MAIN ] PTA: Fetched primary data is valid. [2025-09-17T21:15:39.924186] [DEBUG] [LOCAL ] PTA: Saving primary data. [2025-09-17T21:15:39.924861] [DEBUG] [LOCAL ] PTA: Trimmed 23727 records to 15083 (keeping 200 days of data) [2025-09-17T21:15:40.024154] [DEBUG] [LOCAL ] PTA: Primary data saved (15083 records). [2025-09-17T21:15:40.024307] [INFO ] [MAIN ] PTA: Full history saved. [2025-09-17T21:15:40.024452] [INFO ] [MAIN ] Update Progress: 1748/2371 symbols completed. PTA took 36.2s. Estimated remaining: 1h 31m 7s. Rate: 6.8 symbols/min [2025-09-17T21:15:40.202366] [INFO ] [MAIN ] PVH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:15:40.249102] [DEBUG] [LOCAL ] PVH: Loaded 50376 existing records from primary storage. [2025-09-17T21:15:40.249252] [INFO ] [MAIN ] PVH: Loaded 50376 existing records. [2025-09-17T21:15:40.417971] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-11. [2025-09-17T21:15:40.443288] [WARN ] [MAIN ] PVH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:15:40.443520] [INFO ] [MAIN ] PVH: Wiping existing primary data before full refresh. [2025-09-17T21:15:40.443567] [INFO ] [LOCAL ] PVH: Starting deletion of primary data. [2025-09-17T21:15:40.444600] [DEBUG] [LOCAL ] PVH: Deleted primary data file. [2025-09-17T21:15:40.444678] [INFO ] [MAIN ] PVH: Starting full primary refresh. [2025-09-17T21:15:40.814480] [INFO ] [REMOTE ] PVH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:15:40.978471] [INFO ] [REMOTE ] PTY: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T21:15:40.983968] [INFO ] [REMOTE ] PTY: Full fetch complete (53697 records). [2025-09-17T21:15:40.984113] [DEBUG] [VALIDATOR ] PTY: Validating primary data. [2025-09-17T21:15:41.225128] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-05. [2025-09-17T21:15:41.375952] [DEBUG] [VALIDATOR ] PTY: All expected trading days are present. [2025-09-17T21:15:41.376030] [DEBUG] [VALIDATOR ] PTY: Primary data validation passed. [2025-09-17T21:15:41.376887] [INFO ] [MAIN ] PTY: Fetched primary data is valid. [2025-09-17T21:15:41.376940] [DEBUG] [LOCAL ] PTY: Saving primary data. [2025-09-17T21:15:41.378908] [DEBUG] [LOCAL ] PTY: Trimmed 53697 records to 37374 (keeping 200 days of data) [2025-09-17T21:15:41.608998] [DEBUG] [LOCAL ] PTY: Primary data saved (37374 records). [2025-09-17T21:15:41.609130] [INFO ] [MAIN ] PTY: Full history saved. [2025-09-17T21:15:41.609223] [INFO ] [MAIN ] Update Progress: 1749/2371 symbols completed. PTY took 27.6s. Estimated remaining: 1h 30m 55s. Rate: 6.8 symbols/min [2025-09-17T21:15:41.777919] [INFO ] [MAIN ] PVL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:15:41.784369] [DEBUG] [LOCAL ] PVL: Loaded 4696 existing records from primary storage. [2025-09-17T21:15:41.784474] [INFO ] [MAIN ] PVL: Loaded 4696 existing records. [2025-09-17T21:15:41.969351] [WARN ] [MAIN ] PVL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:15:41.969745] [INFO ] [MAIN ] PVL: Wiping existing primary data before full refresh. [2025-09-17T21:15:41.969794] [INFO ] [LOCAL ] PVL: Starting deletion of primary data. [2025-09-17T21:15:41.970051] [DEBUG] [LOCAL ] PVL: Deleted primary data file. [2025-09-17T21:15:41.970102] [INFO ] [MAIN ] PVL: Starting full primary refresh. [2025-09-17T21:15:42.025660] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-11. [2025-09-17T21:15:42.336344] [INFO ] [REMOTE ] PVL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:15:42.362979] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-17T21:15:42.677304] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T21:15:42.815788] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2024-12. [2025-09-17T21:15:43.376227] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T21:15:43.615781] [INFO ] [REMOTE ] PVH: Fetching primary data for 2024-12. [2025-09-17T21:15:44.257957] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T21:15:44.415773] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-11. [2025-09-17T21:15:45.141579] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T21:15:45.215804] [INFO ] [REMOTE ] PVL: Fetching primary data for 2024-12. [2025-09-17T21:15:45.662055] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2024-12 (2.05 seconds). [2025-09-17T21:15:45.753243] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T21:15:46.015764] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-01. [2025-09-17T21:15:46.815835] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-06. [2025-09-17T21:15:47.615795] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-01. [2025-09-17T21:15:47.675547] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T21:15:48.138462] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T21:15:48.322441] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T21:15:48.415761] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-07. [2025-09-17T21:15:49.215812] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-02. [2025-09-17T21:15:50.015824] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-02. [2025-09-17T21:15:50.238665] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T21:15:50.426413] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T21:15:50.473091] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T21:15:50.815777] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-03. [2025-09-17T21:15:51.461783] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T21:15:51.615790] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-04. [2025-09-17T21:15:52.293111] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T21:15:52.415808] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-01. [2025-09-17T21:15:53.215821] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-08. [2025-09-17T21:15:53.972705] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T21:15:54.015755] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-02. [2025-09-17T21:15:54.815782] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-05. [2025-09-17T21:15:54.877667] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T21:15:55.263742] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T21:15:55.431377] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T21:15:55.615814] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-06. [2025-09-17T21:15:56.251210] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T21:15:56.415833] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-03. [2025-09-17T21:15:57.215829] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-07. [2025-09-17T21:15:57.850930] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T21:15:58.015769] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-03. [2025-09-17T21:15:58.140416] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T21:15:58.815792] [INFO ] [REMOTE ] PUK: Fetching primary data for 2025-09. [2025-09-17T21:15:59.615695] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-08. [2025-09-17T21:15:59.666376] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T21:16:00.227820] [INFO ] [REMOTE ] PUK: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T21:16:00.234087] [INFO ] [REMOTE ] PUK: Full fetch complete (64886 records). [2025-09-17T21:16:00.234225] [DEBUG] [VALIDATOR ] PUK: Validating primary data. [2025-09-17T21:16:00.358528] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T21:16:00.422842] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-04. [2025-09-17T21:16:00.660367] [DEBUG] [VALIDATOR ] PUK: All expected trading days are present. [2025-09-17T21:16:00.660459] [DEBUG] [VALIDATOR ] PUK: Primary data validation passed. [2025-09-17T21:16:00.661525] [INFO ] [MAIN ] PUK: Fetched primary data is valid. [2025-09-17T21:16:00.661575] [DEBUG] [LOCAL ] PUK: Saving primary data. [2025-09-17T21:16:00.663439] [DEBUG] [LOCAL ] PUK: Trimmed 64886 records to 45055 (keeping 200 days of data) [2025-09-17T21:16:00.952186] [DEBUG] [LOCAL ] PUK: Primary data saved (45055 records). [2025-09-17T21:16:00.952326] [INFO ] [MAIN ] PUK: Full history saved. [2025-09-17T21:16:00.953123] [INFO ] [MAIN ] Update Progress: 1750/2371 symbols completed. PUK took 42.7s. Estimated remaining: 1h 30m 50s. Rate: 6.8 symbols/min [2025-09-17T21:16:01.124951] [INFO ] [MAIN ] PWR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:16:01.173412] [DEBUG] [LOCAL ] PWR: Loaded 47691 existing records from primary storage. [2025-09-17T21:16:01.173558] [INFO ] [MAIN ] PWR: Loaded 47691 existing records. [2025-09-17T21:16:01.227534] [INFO ] [REMOTE ] PVL: Fetching primary data for 2025-09. [2025-09-17T21:16:01.356899] [WARN ] [MAIN ] PWR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:16:01.357157] [INFO ] [MAIN ] PWR: Wiping existing primary data before full refresh. [2025-09-17T21:16:01.357207] [INFO ] [LOCAL ] PWR: Starting deletion of primary data. [2025-09-17T21:16:01.358218] [DEBUG] [LOCAL ] PWR: Deleted primary data file. [2025-09-17T21:16:01.358273] [INFO ] [MAIN ] PWR: Starting full primary refresh. [2025-09-17T21:16:01.722338] [INFO ] [REMOTE ] PWR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:16:01.893875] [INFO ] [REMOTE ] PVL: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T21:16:01.895103] [INFO ] [REMOTE ] PVL: Full fetch complete (7520 records). [2025-09-17T21:16:01.895179] [DEBUG] [VALIDATOR ] PVL: Validating primary data. [2025-09-17T21:16:02.020904] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-04. [2025-09-17T21:16:02.273550] [DEBUG] [VALIDATOR ] PVL: All expected trading days are present. [2025-09-17T21:16:02.273708] [DEBUG] [VALIDATOR ] PVL: Primary data validation passed. [2025-09-17T21:16:02.273993] [INFO ] [MAIN ] PVL: Fetched primary data is valid. [2025-09-17T21:16:02.274064] [DEBUG] [LOCAL ] PVL: Saving primary data. [2025-09-17T21:16:02.274661] [DEBUG] [LOCAL ] PVL: Trimmed 7520 records to 4690 (keeping 200 days of data) [2025-09-17T21:16:02.303449] [DEBUG] [LOCAL ] PVL: Primary data saved (4690 records). [2025-09-17T21:16:02.303597] [INFO ] [MAIN ] PVL: Full history saved. [2025-09-17T21:16:02.303785] [INFO ] [MAIN ] Update Progress: 1751/2371 symbols completed. PVL took 20.7s. Estimated remaining: 1h 30m 39s. Rate: 6.8 symbols/min [2025-09-17T21:16:02.466547] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T21:16:02.528211] [INFO ] [MAIN ] PX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:16:02.564994] [DEBUG] [LOCAL ] PX: Loaded 34755 existing records from primary storage. [2025-09-17T21:16:02.565200] [INFO ] [MAIN ] PX: Loaded 34755 existing records. [2025-09-17T21:16:02.749832] [WARN ] [MAIN ] PX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:16:02.750098] [INFO ] [MAIN ] PX: Wiping existing primary data before full refresh. [2025-09-17T21:16:02.750152] [INFO ] [LOCAL ] PX: Starting deletion of primary data. [2025-09-17T21:16:02.750932] [DEBUG] [LOCAL ] PX: Deleted primary data file. [2025-09-17T21:16:02.750983] [INFO ] [MAIN ] PX: Starting full primary refresh. [2025-09-17T21:16:02.825087] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-05. [2025-09-17T21:16:03.107981] [INFO ] [REMOTE ] PX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:16:03.615819] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-11. [2025-09-17T21:16:03.899270] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T21:16:04.415757] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-11. [2025-09-17T21:16:04.695956] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T21:16:05.114468] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T21:16:05.215731] [INFO ] [REMOTE ] PX: Fetching primary data for 2024-12. [2025-09-17T21:16:05.747315] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T21:16:06.015781] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-06. [2025-09-17T21:16:06.664301] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T21:16:06.815773] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-01. [2025-09-17T21:16:07.552762] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T21:16:07.615747] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-07. [2025-09-17T21:16:07.901906] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T21:16:08.415784] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-05. [2025-09-17T21:16:09.215791] [INFO ] [REMOTE ] PWR: Fetching primary data for 2024-12. [2025-09-17T21:16:09.463684] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T21:16:09.992398] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T21:16:10.015734] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-06. [2025-09-17T21:16:10.652353] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T21:16:10.815777] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-01. [2025-09-17T21:16:11.615850] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-02. [2025-09-17T21:16:11.838613] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T21:16:12.327449] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T21:16:12.415815] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-07. [2025-09-17T21:16:12.823433] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T21:16:13.215786] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-02. [2025-09-17T21:16:14.015754] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-08. [2025-09-17T21:16:14.281833] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T21:16:14.635953] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T21:16:14.815795] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-03. [2025-09-17T21:16:15.582063] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T21:16:15.615782] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-08. [2025-09-17T21:16:16.415786] [INFO ] [REMOTE ] PVH: Fetching primary data for 2025-09. [2025-09-17T21:16:16.767113] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T21:16:17.215767] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-03. [2025-09-17T21:16:17.518892] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T21:16:17.736711] [INFO ] [REMOTE ] PVH: Incremental fetch complete for 2025-09 (1.32 seconds). [2025-09-17T21:16:17.743359] [INFO ] [REMOTE ] PVH: Full fetch complete (70580 records). [2025-09-17T21:16:17.743508] [DEBUG] [VALIDATOR ] PVH: Validating primary data. [2025-09-17T21:16:18.022815] [INFO ] [REMOTE ] PUMP: Fetching primary data for 2025-09. [2025-09-17T21:16:18.155221] [DEBUG] [VALIDATOR ] PVH: All expected trading days are present. [2025-09-17T21:16:18.155322] [DEBUG] [VALIDATOR ] PVH: Primary data validation passed. [2025-09-17T21:16:18.156411] [INFO ] [MAIN ] PVH: Fetched primary data is valid. [2025-09-17T21:16:18.156470] [DEBUG] [LOCAL ] PVH: Saving primary data. [2025-09-17T21:16:18.158005] [DEBUG] [LOCAL ] PVH: Trimmed 70580 records to 50403 (keeping 200 days of data) [2025-09-17T21:16:18.487185] [DEBUG] [LOCAL ] PVH: Primary data saved (50403 records). [2025-09-17T21:16:18.487361] [INFO ] [MAIN ] PVH: Full history saved. [2025-09-17T21:16:18.487490] [INFO ] [MAIN ] Update Progress: 1752/2371 symbols completed. PVH took 38.5s. Estimated remaining: 1h 30m 33s. Rate: 6.8 symbols/min [2025-09-17T21:16:18.662704] [INFO ] [MAIN ] QBTS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:16:18.687099] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T21:16:18.744883] [DEBUG] [LOCAL ] QBTS: Loaded 53743 existing records from primary storage. [2025-09-17T21:16:18.745036] [INFO ] [MAIN ] QBTS: Loaded 53743 existing records. [2025-09-17T21:16:18.820936] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-04. [2025-09-17T21:16:18.939424] [WARN ] [MAIN ] QBTS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:16:18.939841] [INFO ] [MAIN ] QBTS: Wiping existing primary data before full refresh. [2025-09-17T21:16:18.939892] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-17T21:16:18.941212] [DEBUG] [LOCAL ] QBTS: Deleted primary data file. [2025-09-17T21:16:18.941275] [INFO ] [MAIN ] QBTS: Starting full primary refresh. [2025-09-17T21:16:19.315160] [INFO ] [REMOTE ] QBTS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:16:19.362711] [INFO ] [REMOTE ] PUMP: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T21:16:19.369261] [INFO ] [REMOTE ] PUMP: Full fetch complete (71373 records). [2025-09-17T21:16:19.369370] [DEBUG] [VALIDATOR ] PUMP: Validating primary data. [2025-09-17T21:16:19.615742] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-04. [2025-09-17T21:16:19.755502] [DEBUG] [VALIDATOR ] PUMP: All expected trading days are present. [2025-09-17T21:16:19.755580] [DEBUG] [VALIDATOR ] PUMP: Primary data validation passed. [2025-09-17T21:16:19.756557] [INFO ] [MAIN ] PUMP: Fetched primary data is valid. [2025-09-17T21:16:19.756605] [DEBUG] [LOCAL ] PUMP: Saving primary data. [2025-09-17T21:16:19.758120] [DEBUG] [LOCAL ] PUMP: Trimmed 71373 records to 49492 (keeping 200 days of data) [2025-09-17T21:16:20.035699] [DEBUG] [LOCAL ] PUMP: Primary data saved (49492 records). [2025-09-17T21:16:20.035841] [INFO ] [MAIN ] PUMP: Full history saved. [2025-09-17T21:16:20.035951] [INFO ] [MAIN ] Update Progress: 1753/2371 symbols completed. PUMP took 43.9s. Estimated remaining: 1h 30m 21s. Rate: 6.8 symbols/min [2025-09-17T21:16:20.205711] [INFO ] [MAIN ] QD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:16:20.232273] [DEBUG] [LOCAL ] QD: Loaded 27951 existing records from primary storage. [2025-09-17T21:16:20.232454] [INFO ] [MAIN ] QD: Loaded 27951 existing records. [2025-09-17T21:16:20.421331] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-11. [2025-09-17T21:16:20.426032] [WARN ] [MAIN ] QD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:16:20.427348] [INFO ] [MAIN ] QD: Wiping existing primary data before full refresh. [2025-09-17T21:16:20.427398] [INFO ] [LOCAL ] QD: Starting deletion of primary data. [2025-09-17T21:16:20.427978] [DEBUG] [LOCAL ] QD: Deleted primary data file. [2025-09-17T21:16:20.428032] [INFO ] [MAIN ] QD: Starting full primary refresh. [2025-09-17T21:16:20.802572] [INFO ] [REMOTE ] QD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:16:20.884521] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T21:16:20.932187] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T21:16:21.215801] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-05. [2025-09-17T21:16:22.015771] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-05. [2025-09-17T21:16:22.815757] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-11. [2025-09-17T21:16:22.949341] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-11 (2.53 seconds). [2025-09-17T21:16:23.615761] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2024-12. [2025-09-17T21:16:23.648032] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T21:16:23.851072] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-17T21:16:24.056598] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T21:16:24.415812] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-06. [2025-09-17T21:16:25.215784] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-06. [2025-09-17T21:16:25.612236] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T21:16:26.015737] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-07. [2025-09-17T21:16:26.394576] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2024-12 (2.78 seconds). [2025-09-17T21:16:26.689943] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T21:16:26.815801] [INFO ] [REMOTE ] QD: Fetching primary data for 2024-12. [2025-09-17T21:16:27.165368] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T21:16:27.615825] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-08. [2025-09-17T21:16:28.209717] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T21:16:28.415743] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-01. [2025-09-17T21:16:28.886732] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T21:16:29.215798] [INFO ] [REMOTE ] PX: Fetching primary data for 2025-09. [2025-09-17T21:16:29.533097] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T21:16:30.015768] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-02. [2025-09-17T21:16:30.421631] [INFO ] [REMOTE ] PX: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T21:16:30.425877] [INFO ] [REMOTE ] PX: Full fetch complete (51142 records). [2025-09-17T21:16:30.425984] [DEBUG] [VALIDATOR ] PX: Validating primary data. [2025-09-17T21:16:30.822389] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-01. [2025-09-17T21:16:30.823182] [DEBUG] [VALIDATOR ] PX: All expected trading days are present. [2025-09-17T21:16:30.823424] [DEBUG] [VALIDATOR ] PX: Primary data validation passed. [2025-09-17T21:16:30.825016] [INFO ] [MAIN ] PX: Fetched primary data is valid. [2025-09-17T21:16:30.825166] [DEBUG] [LOCAL ] PX: Saving primary data. [2025-09-17T21:16:30.826308] [DEBUG] [LOCAL ] PX: Trimmed 51142 records to 34737 (keeping 200 days of data) [2025-09-17T21:16:30.948355] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T21:16:31.073142] [DEBUG] [LOCAL ] PX: Primary data saved (34737 records). [2025-09-17T21:16:31.073320] [INFO ] [MAIN ] PX: Full history saved. [2025-09-17T21:16:31.073418] [INFO ] [MAIN ] Update Progress: 1754/2371 symbols completed. PX took 28.8s. Estimated remaining: 1h 30m 13s. Rate: 6.8 symbols/min [2025-09-17T21:16:31.244386] [INFO ] [MAIN ] QGEN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:16:31.288118] [DEBUG] [LOCAL ] QGEN: Loaded 49187 existing records from primary storage. [2025-09-17T21:16:31.288263] [INFO ] [MAIN ] QGEN: Loaded 49187 existing records. [2025-09-17T21:16:31.473343] [WARN ] [MAIN ] QGEN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:16:31.473608] [INFO ] [MAIN ] QGEN: Wiping existing primary data before full refresh. [2025-09-17T21:16:31.473671] [INFO ] [LOCAL ] QGEN: Starting deletion of primary data. [2025-09-17T21:16:31.474531] [DEBUG] [LOCAL ] QGEN: Deleted primary data file. [2025-09-17T21:16:31.474579] [INFO ] [MAIN ] QGEN: Starting full primary refresh. [2025-09-17T21:16:31.620959] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-03. [2025-09-17T21:16:31.835892] [INFO ] [REMOTE ] QGEN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:16:32.415784] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-11. [2025-09-17T21:16:32.697862] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T21:16:33.215702] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-04. [2025-09-17T21:16:33.333872] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-01 (2.51 seconds). [2025-09-17T21:16:33.697956] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T21:16:34.015772] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-02. [2025-09-17T21:16:34.153000] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T21:16:34.815828] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-05. [2025-09-17T21:16:35.615754] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-07. [2025-09-17T21:16:36.031331] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T21:16:36.415765] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-06. [2025-09-17T21:16:36.710717] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-02 (2.69 seconds). [2025-09-17T21:16:37.093584] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T21:16:37.118116] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T21:16:37.215763] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-08. [2025-09-17T21:16:37.780929] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T21:16:38.015740] [INFO ] [REMOTE ] PWR: Fetching primary data for 2025-09. [2025-09-17T21:16:38.815822] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-07. [2025-09-17T21:16:39.296914] [INFO ] [REMOTE ] PWR: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T21:16:39.302602] [INFO ] [REMOTE ] PWR: Full fetch complete (68800 records). [2025-09-17T21:16:39.302731] [DEBUG] [VALIDATOR ] PWR: Validating primary data. [2025-09-17T21:16:39.620867] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-03. [2025-09-17T21:16:39.701262] [DEBUG] [VALIDATOR ] PWR: All expected trading days are present. [2025-09-17T21:16:39.701420] [DEBUG] [VALIDATOR ] PWR: Primary data validation passed. [2025-09-17T21:16:39.702404] [INFO ] [MAIN ] PWR: Fetched primary data is valid. [2025-09-17T21:16:39.702452] [DEBUG] [LOCAL ] PWR: Saving primary data. [2025-09-17T21:16:39.703926] [DEBUG] [LOCAL ] PWR: Trimmed 68800 records to 47616 (keeping 200 days of data) [2025-09-17T21:16:39.980503] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T21:16:40.041296] [DEBUG] [LOCAL ] PWR: Primary data saved (47616 records). [2025-09-17T21:16:40.041468] [INFO ] [MAIN ] PWR: Full history saved. [2025-09-17T21:16:40.043299] [INFO ] [MAIN ] Update Progress: 1755/2371 symbols completed. PWR took 39.1s. Estimated remaining: 1h 30m 5s. Rate: 6.8 symbols/min [2025-09-17T21:16:40.226756] [INFO ] [MAIN ] QS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:16:40.283580] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-17T21:16:40.283777] [INFO ] [MAIN ] QS: Loaded 53742 existing records. [2025-09-17T21:16:40.426919] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-08. [2025-09-17T21:16:40.468278] [WARN ] [MAIN ] QS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:16:40.468546] [INFO ] [MAIN ] QS: Wiping existing primary data before full refresh. [2025-09-17T21:16:40.468599] [INFO ] [LOCAL ] QS: Starting deletion of primary data. [2025-09-17T21:16:40.469467] [DEBUG] [LOCAL ] QS: Deleted primary data file. [2025-09-17T21:16:40.469545] [INFO ] [MAIN ] QS: Starting full primary refresh. [2025-09-17T21:16:40.847939] [INFO ] [REMOTE ] QS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:16:41.215814] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-11. [2025-09-17T21:16:41.602508] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-08 (1.18 seconds). [2025-09-17T21:16:42.015813] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2024-12. [2025-09-17T21:16:42.462448] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-03 (2.84 seconds). [2025-09-17T21:16:42.815795] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-04. [2025-09-17T21:16:43.245001] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-17T21:16:43.322004] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T21:16:43.615807] [INFO ] [REMOTE ] QD: Fetching primary data for 2025-09. [2025-09-17T21:16:44.415807] [INFO ] [REMOTE ] QS: Fetching primary data for 2024-12. [2025-09-17T21:16:44.918284] [INFO ] [REMOTE ] QD: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T21:16:44.922266] [INFO ] [REMOTE ] QD: Full fetch complete (40700 records). [2025-09-17T21:16:44.922403] [DEBUG] [VALIDATOR ] QD: Validating primary data. [2025-09-17T21:16:45.218558] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-01. [2025-09-17T21:16:45.307699] [DEBUG] [VALIDATOR ] QD: All expected trading days are present. [2025-09-17T21:16:45.307796] [DEBUG] [VALIDATOR ] QD: Primary data validation passed. [2025-09-17T21:16:45.308549] [INFO ] [MAIN ] QD: Fetched primary data is valid. [2025-09-17T21:16:45.308592] [DEBUG] [LOCAL ] QD: Saving primary data. [2025-09-17T21:16:45.309703] [DEBUG] [LOCAL ] QD: Trimmed 40700 records to 27932 (keeping 200 days of data) [2025-09-17T21:16:45.489460] [DEBUG] [LOCAL ] QD: Primary data saved (27932 records). [2025-09-17T21:16:45.489728] [INFO ] [MAIN ] QD: Full history saved. [2025-09-17T21:16:45.489912] [INFO ] [MAIN ] Update Progress: 1756/2371 symbols completed. QD took 25.5s. Estimated remaining: 1h 29m 55s. Rate: 6.8 symbols/min [2025-09-17T21:16:45.661704] [INFO ] [MAIN ] QSR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:16:45.695989] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-04 (2.88 seconds). [2025-09-17T21:16:45.752011] [DEBUG] [LOCAL ] QSR: Loaded 52412 existing records from primary storage. [2025-09-17T21:16:45.752156] [INFO ] [MAIN ] QSR: Loaded 52412 existing records. [2025-09-17T21:16:45.957239] [WARN ] [MAIN ] QSR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:16:45.957479] [INFO ] [MAIN ] QSR: Wiping existing primary data before full refresh. [2025-09-17T21:16:45.957524] [INFO ] [LOCAL ] QSR: Starting deletion of primary data. [2025-09-17T21:16:45.958521] [DEBUG] [LOCAL ] QSR: Deleted primary data file. [2025-09-17T21:16:45.958574] [INFO ] [MAIN ] QSR: Starting full primary refresh. [2025-09-17T21:16:46.023507] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-05. [2025-09-17T21:16:46.313610] [INFO ] [REMOTE ] QSR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:16:46.679633] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-17T21:16:46.815736] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-01. [2025-09-17T21:16:46.945225] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T21:16:47.615776] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-11. [2025-09-17T21:16:48.415747] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-02. [2025-09-17T21:16:48.663228] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-05 (2.64 seconds). [2025-09-17T21:16:48.877987] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T21:16:48.925951] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T21:16:49.215805] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-06. [2025-09-17T21:16:49.829776] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T21:16:50.015812] [INFO ] [REMOTE ] QSR: Fetching primary data for 2024-12. [2025-09-17T21:16:50.815828] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-02. [2025-09-17T21:16:51.615830] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-03. [2025-09-17T21:16:51.879957] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-17T21:16:51.988548] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T21:16:52.415809] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-01. [2025-09-17T21:16:52.697838] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T21:16:53.042382] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T21:16:53.215783] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-04. [2025-09-17T21:16:53.793327] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T21:16:54.015789] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-02. [2025-09-17T21:16:54.815827] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-07. [2025-09-17T21:16:55.166852] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T21:16:55.420828] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T21:16:55.615794] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-03. [2025-09-17T21:16:56.415808] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-05. [2025-09-17T21:16:57.215776] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-03. [2025-09-17T21:16:57.374835] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-17T21:16:57.422570] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T21:16:57.886444] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T21:16:58.015750] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-06. [2025-09-17T21:16:58.815829] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-08. [2025-09-17T21:16:59.309091] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T21:16:59.516631] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T21:16:59.615747] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-07. [2025-09-17T21:17:00.415794] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-04. [2025-09-17T21:17:01.215842] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-04. [2025-09-17T21:17:01.598326] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-08 (2.78 seconds). [2025-09-17T21:17:01.741294] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T21:17:02.015779] [INFO ] [REMOTE ] QBTS: Fetching primary data for 2025-09. [2025-09-17T21:17:02.595203] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-17T21:17:02.728674] [INFO ] [REMOTE ] QBTS: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T21:17:02.735017] [INFO ] [REMOTE ] QBTS: Full fetch complete (77532 records). [2025-09-17T21:17:02.735131] [DEBUG] [VALIDATOR ] QBTS: Validating primary data. [2025-09-17T21:17:02.735883] [FATAL] [VALIDATOR ] QBTS: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:17:02.735978] [FATAL] [MAIN ] QBTS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:17:02.736014] [WARN ] [MAIN ] QBTS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:17:02.736052] [INFO ] [LOCAL ] QBTS: Starting deletion of primary data. [2025-09-17T21:17:02.736172] [DEBUG] [LOCAL ] QBTS: No primary data file found to delete. [2025-09-17T21:17:02.736220] [INFO ] [LOCAL ] QBTS: Starting deletion of derivative data. [2025-09-17T21:17:02.736547] [DEBUG] [LOCAL ] QBTS: Deleted derivative data file. [2025-09-17T21:17:02.736635] [INFO ] [MAIN ] Update Progress: 1757/2371 symbols completed. QBTS took 44.2s. Estimated remaining: 1h 29m 49s. Rate: 6.8 symbols/min [2025-09-17T21:17:02.815830] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-05. [2025-09-17T21:17:02.864881] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T21:17:03.615834] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-05. [2025-09-17T21:17:04.415854] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-08. [2025-09-17T21:17:04.768870] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T21:17:05.130007] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T21:17:05.215894] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-06. [2025-09-17T21:17:06.015851] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-06. [2025-09-17T21:17:06.291285] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T21:17:06.815844] [INFO ] [REMOTE ] QGEN: Fetching primary data for 2025-09. [2025-09-17T21:17:06.969194] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T21:17:07.615896] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-07. [2025-09-17T21:17:08.042528] [INFO ] [REMOTE ] QGEN: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T21:17:08.050391] [INFO ] [REMOTE ] QGEN: Full fetch complete (69811 records). [2025-09-17T21:17:08.050657] [DEBUG] [VALIDATOR ] QGEN: Validating primary data. [2025-09-17T21:17:08.471705] [DEBUG] [VALIDATOR ] QGEN: All expected trading days are present. [2025-09-17T21:17:08.471867] [DEBUG] [VALIDATOR ] QGEN: Primary data validation passed. [2025-09-17T21:17:08.473033] [INFO ] [MAIN ] QGEN: Fetched primary data is valid. [2025-09-17T21:17:08.473146] [DEBUG] [LOCAL ] QGEN: Saving primary data. [2025-09-17T21:17:08.474929] [DEBUG] [LOCAL ] QGEN: Trimmed 69811 records to 49212 (keeping 200 days of data) [2025-09-17T21:17:08.633203] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-06 (2.62 seconds). [2025-09-17T21:17:08.646131] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-07. [2025-09-17T21:17:08.828197] [DEBUG] [LOCAL ] QGEN: Primary data saved (49212 records). [2025-09-17T21:17:08.828366] [INFO ] [MAIN ] QGEN: Full history saved. [2025-09-17T21:17:08.828475] [INFO ] [MAIN ] Update Progress: 1758/2371 symbols completed. QGEN took 37.8s. Estimated remaining: 1h 29m 39s. Rate: 6.8 symbols/min [2025-09-17T21:17:09.568743] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T21:17:09.580347] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-08. [2025-09-17T21:17:11.458951] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-08 (1.88 seconds). [2025-09-17T21:17:11.475069] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-07 (2.83 seconds). [2025-09-17T21:17:11.486875] [INFO ] [REMOTE ] QSR: Fetching primary data for 2025-09. [2025-09-17T21:17:11.488837] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-08. [2025-09-17T21:17:13.139975] [INFO ] [REMOTE ] QSR: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T21:17:13.146937] [INFO ] [REMOTE ] QSR: Full fetch complete (75656 records). [2025-09-17T21:17:13.147113] [DEBUG] [VALIDATOR ] QSR: Validating primary data. [2025-09-17T21:17:13.555132] [DEBUG] [VALIDATOR ] QSR: All expected trading days are present. [2025-09-17T21:17:13.555346] [DEBUG] [VALIDATOR ] QSR: Primary data validation passed. [2025-09-17T21:17:13.556462] [INFO ] [MAIN ] QSR: Fetched primary data is valid. [2025-09-17T21:17:13.556597] [DEBUG] [LOCAL ] QSR: Saving primary data. [2025-09-17T21:17:13.559098] [DEBUG] [LOCAL ] QSR: Trimmed 75656 records to 52402 (keeping 200 days of data) [2025-09-17T21:17:13.901103] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-08 (2.41 seconds). [2025-09-17T21:17:13.929668] [DEBUG] [LOCAL ] QSR: Primary data saved (52402 records). [2025-09-17T21:17:13.930306] [INFO ] [MAIN ] QSR: Full history saved. [2025-09-17T21:17:13.930406] [INFO ] [MAIN ] Update Progress: 1759/2371 symbols completed. QSR took 28.4s. Estimated remaining: 1h 29m 29s. Rate: 6.8 symbols/min [2025-09-17T21:17:13.930931] [INFO ] [REMOTE ] QS: Fetching primary data for 2025-09. [2025-09-17T21:17:16.049336] [INFO ] [REMOTE ] QS: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-17T21:17:16.058041] [INFO ] [REMOTE ] QS: Full fetch complete (77810 records). [2025-09-17T21:17:16.058206] [DEBUG] [VALIDATOR ] QS: Validating primary data. [2025-09-17T21:17:16.450910] [DEBUG] [VALIDATOR ] QS: All expected trading days are present. [2025-09-17T21:17:16.450992] [DEBUG] [VALIDATOR ] QS: Primary data validation passed. [2025-09-17T21:17:16.452004] [INFO ] [MAIN ] QS: Fetched primary data is valid. [2025-09-17T21:17:16.452055] [DEBUG] [LOCAL ] QS: Saving primary data. [2025-09-17T21:17:16.453498] [DEBUG] [LOCAL ] QS: Trimmed 77810 records to 53742 (keeping 200 days of data) [2025-09-17T21:17:16.774657] [DEBUG] [LOCAL ] QS: Primary data saved (53742 records). [2025-09-17T21:17:16.774802] [INFO ] [MAIN ] QS: Full history saved. [2025-09-17T21:17:16.775631] [INFO ] [MAIN ] Update Progress: 1760/2371 symbols completed. QS took 36.7s. Estimated remaining: 1h 29m 18s. Rate: 6.8 symbols/min [2025-09-17T21:17:17.392861] [INFO ] [MAIN ] QVCC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:17:17.472945] [INFO ] [MAIN ] QVCD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:17:17.490716] [INFO ] [MAIN ] QTWO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:17:17.494767] [INFO ] [MAIN ] QUAD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:17:17.508206] [DEBUG] [LOCAL ] QVCC: Loaded 9092 existing records from primary storage. [2025-09-17T21:17:17.508495] [INFO ] [MAIN ] QVCC: Loaded 9092 existing records. [2025-09-17T21:17:17.532006] [DEBUG] [LOCAL ] QVCD: Loaded 4664 existing records from primary storage. [2025-09-17T21:17:17.546359] [INFO ] [MAIN ] QVCD: Loaded 4664 existing records. [2025-09-17T21:17:17.795149] [DEBUG] [LOCAL ] QUAD: Loaded 24268 existing records from primary storage. [2025-09-17T21:17:17.843859] [INFO ] [MAIN ] QUAD: Loaded 24268 existing records. [2025-09-17T21:17:17.882284] [WARN ] [MAIN ] QVCC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:17:17.894789] [DEBUG] [LOCAL ] QTWO: Loaded 38982 existing records from primary storage. [2025-09-17T21:17:17.917266] [WARN ] [MAIN ] QVCD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:17:17.938443] [INFO ] [MAIN ] QTWO: Loaded 38982 existing records. [2025-09-17T21:17:17.958140] [INFO ] [MAIN ] QVCD: Wiping existing primary data before full refresh. [2025-09-17T21:17:17.975086] [INFO ] [MAIN ] QVCC: Wiping existing primary data before full refresh. [2025-09-17T21:17:17.980360] [INFO ] [LOCAL ] QVCD: Starting deletion of primary data. [2025-09-17T21:17:18.007556] [DEBUG] [LOCAL ] QVCD: Deleted primary data file. [2025-09-17T21:17:18.012766] [INFO ] [LOCAL ] QVCC: Starting deletion of primary data. [2025-09-17T21:17:18.088966] [DEBUG] [LOCAL ] QVCC: Deleted primary data file. [2025-09-17T21:17:18.073329] [INFO ] [MAIN ] QVCD: Starting full primary refresh. [2025-09-17T21:17:18.145023] [INFO ] [MAIN ] QVCC: Starting full primary refresh. [2025-09-17T21:17:18.560511] [WARN ] [MAIN ] QUAD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:17:18.551827] [WARN ] [MAIN ] QTWO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:17:18.646099] [INFO ] [MAIN ] QUAD: Wiping existing primary data before full refresh. [2025-09-17T21:17:18.646246] [INFO ] [LOCAL ] QUAD: Starting deletion of primary data. [2025-09-17T21:17:18.601806] [INFO ] [MAIN ] QTWO: Wiping existing primary data before full refresh. [2025-09-17T21:17:18.703258] [INFO ] [LOCAL ] QTWO: Starting deletion of primary data. [2025-09-17T21:17:18.703141] [DEBUG] [LOCAL ] QUAD: Deleted primary data file. [2025-09-17T21:17:18.718941] [INFO ] [MAIN ] QUAD: Starting full primary refresh. [2025-09-17T21:17:18.718879] [DEBUG] [LOCAL ] QTWO: Deleted primary data file. [2025-09-17T21:17:18.784191] [INFO ] [MAIN ] QTWO: Starting full primary refresh. [2025-09-17T21:17:19.200593] [INFO ] [REMOTE ] QVCD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:17:19.258526] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-11. [2025-09-17T21:17:19.483754] [INFO ] [REMOTE ] QVCC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:17:19.518781] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-11. [2025-09-17T21:17:19.816990] [INFO ] [REMOTE ] QTWO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:17:19.821024] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-11. [2025-09-17T21:17:19.820806] [INFO ] [REMOTE ] QUAD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:17:19.821268] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-11. [2025-09-17T21:17:20.118362] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T21:17:20.120097] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2024-12. [2025-09-17T21:17:20.332775] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T21:17:20.334533] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2024-12. [2025-09-17T21:17:20.725875] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T21:17:20.731404] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2024-12. [2025-09-17T21:17:20.845829] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T21:17:20.847708] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-01. [2025-09-17T21:17:21.182598] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T21:17:21.190473] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2024-12. [2025-09-17T21:17:21.227860] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T21:17:21.230811] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-01. [2025-09-17T21:17:21.582797] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T21:17:21.584696] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-02. [2025-09-17T21:17:21.852895] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T21:17:21.858743] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-01. [2025-09-17T21:17:21.914050] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T21:17:21.932154] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T21:17:22.015731] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-03. [2025-09-17T21:17:22.550490] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T21:17:22.748138] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T21:17:22.760145] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T21:17:22.815801] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-01. [2025-09-17T21:17:23.615805] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-02. [2025-09-17T21:17:24.344367] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T21:17:24.415813] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-02. [2025-09-17T21:17:24.524899] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T21:17:25.215816] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-04. [2025-09-17T21:17:25.256064] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T21:17:25.653269] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T21:17:26.015812] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-05. [2025-09-17T21:17:26.654935] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T21:17:26.815785] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-03. [2025-09-17T21:17:27.615824] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-02. [2025-09-17T21:17:27.937762] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T21:17:28.415832] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-03. [2025-09-17T21:17:29.111883] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T21:17:29.169513] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T21:17:29.215798] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-03. [2025-09-17T21:17:30.015777] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-04. [2025-09-17T21:17:30.534021] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T21:17:30.815810] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-04. [2025-09-17T21:17:30.905491] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T21:17:31.387701] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T21:17:31.615797] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-06. [2025-09-17T21:17:32.070113] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T21:17:32.415823] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-05. [2025-09-17T21:17:33.215787] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-05. [2025-09-17T21:17:33.251510] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T21:17:34.015733] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-06. [2025-09-17T21:17:34.050529] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T21:17:34.815780] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-04. [2025-09-17T21:17:34.951019] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T21:17:35.615796] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-06. [2025-09-17T21:17:36.323423] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T21:17:36.415740] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-05. [2025-09-17T21:17:36.487082] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T21:17:37.215785] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-07. [2025-09-17T21:17:37.514328] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T21:17:38.015755] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-06. [2025-09-17T21:17:38.040142] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T21:17:38.815784] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-08. [2025-09-17T21:17:39.568993] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T21:17:39.615723] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-07. [2025-09-17T21:17:39.702333] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T21:17:40.415778] [INFO ] [REMOTE ] QUAD: Fetching primary data for 2025-09. [2025-09-17T21:17:41.055137] [INFO ] [REMOTE ] QUAD: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T21:17:41.058100] [INFO ] [REMOTE ] QUAD: Full fetch complete (35147 records). [2025-09-17T21:17:41.058178] [DEBUG] [VALIDATOR ] QUAD: Validating primary data. [2025-09-17T21:17:41.218582] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-07. [2025-09-17T21:17:41.453292] [DEBUG] [VALIDATOR ] QUAD: All expected trading days are present. [2025-09-17T21:17:41.453447] [DEBUG] [VALIDATOR ] QUAD: Primary data validation passed. [2025-09-17T21:17:41.454185] [INFO ] [MAIN ] QUAD: Fetched primary data is valid. [2025-09-17T21:17:41.454241] [DEBUG] [LOCAL ] QUAD: Saving primary data. [2025-09-17T21:17:41.473261] [DEBUG] [LOCAL ] QUAD: Trimmed 35147 records to 24247 (keeping 200 days of data) [2025-09-17T21:17:41.474411] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T21:17:41.628512] [DEBUG] [LOCAL ] QUAD: Primary data saved (24247 records). [2025-09-17T21:17:41.628675] [INFO ] [MAIN ] QUAD: Full history saved. [2025-09-17T21:17:41.628760] [INFO ] [MAIN ] Update Progress: 1761/2371 symbols completed. QUAD took 24.8s. Estimated remaining: 1h 29m 15s. Rate: 6.8 symbols/min [2025-09-17T21:17:41.804872] [INFO ] [MAIN ] QXO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:17:41.808258] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T21:17:41.860238] [DEBUG] [LOCAL ] QXO: Loaded 53128 existing records from primary storage. [2025-09-17T21:17:41.860410] [INFO ] [MAIN ] QXO: Loaded 53128 existing records. [2025-09-17T21:17:42.020864] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-08. [2025-09-17T21:17:42.049303] [WARN ] [MAIN ] QXO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:17:42.049511] [INFO ] [MAIN ] QXO: Wiping existing primary data before full refresh. [2025-09-17T21:17:42.049557] [INFO ] [LOCAL ] QXO: Starting deletion of primary data. [2025-09-17T21:17:42.050760] [DEBUG] [LOCAL ] QXO: Deleted primary data file. [2025-09-17T21:17:42.050811] [INFO ] [MAIN ] QXO: Starting full primary refresh. [2025-09-17T21:17:42.427471] [INFO ] [REMOTE ] QXO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:17:42.815780] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-07. [2025-09-17T21:17:43.140297] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T21:17:43.575698] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T21:17:43.615788] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-08. [2025-09-17T21:17:44.159696] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T21:17:44.415870] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-08. [2025-09-17T21:17:45.215801] [INFO ] [REMOTE ] QTWO: Fetching primary data for 2025-09. [2025-09-17T21:17:45.512382] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T21:17:46.015769] [INFO ] [REMOTE ] QVCC: Fetching primary data for 2025-09. [2025-09-17T21:17:46.376431] [INFO ] [REMOTE ] QTWO: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T21:17:46.382428] [INFO ] [REMOTE ] QTWO: Full fetch complete (56814 records). [2025-09-17T21:17:46.382534] [DEBUG] [VALIDATOR ] QTWO: Validating primary data. [2025-09-17T21:17:46.656137] [INFO ] [REMOTE ] QVCC: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T21:17:46.716332] [INFO ] [REMOTE ] QVCC: Full fetch complete (11975 records). [2025-09-17T21:17:46.721905] [DEBUG] [VALIDATOR ] QVCC: Validating primary data. [2025-09-17T21:17:46.833598] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-11. [2025-09-17T21:17:46.895416] [DEBUG] [VALIDATOR ] QTWO: All expected trading days are present. [2025-09-17T21:17:46.906666] [DEBUG] [VALIDATOR ] QTWO: Primary data validation passed. [2025-09-17T21:17:46.915682] [INFO ] [MAIN ] QTWO: Fetched primary data is valid. [2025-09-17T21:17:46.915756] [DEBUG] [LOCAL ] QTWO: Saving primary data. [2025-09-17T21:17:46.991183] [DEBUG] [LOCAL ] QTWO: Trimmed 56814 records to 39001 (keeping 200 days of data) [2025-09-17T21:17:47.415693] [DEBUG] [VALIDATOR ] QVCC: All expected trading days are present. [2025-09-17T21:17:47.416595] [DEBUG] [VALIDATOR ] QVCC: Primary data validation passed. [2025-09-17T21:17:47.417567] [INFO ] [MAIN ] QVCC: Fetched primary data is valid. [2025-09-17T21:17:47.418150] [DEBUG] [LOCAL ] QVCC: Saving primary data. [2025-09-17T21:17:47.422553] [DEBUG] [LOCAL ] QVCC: Trimmed 11975 records to 9120 (keeping 200 days of data) [2025-09-17T21:17:47.483154] [DEBUG] [LOCAL ] QTWO: Primary data saved (39001 records). [2025-09-17T21:17:47.483907] [INFO ] [MAIN ] QTWO: Full history saved. [2025-09-17T21:17:47.484333] [INFO ] [MAIN ] Update Progress: 1762/2371 symbols completed. QTWO took 30.7s. Estimated remaining: 1h 29m 5s. Rate: 6.8 symbols/min [2025-09-17T21:17:47.615816] [INFO ] [REMOTE ] QVCD: Fetching primary data for 2025-09. [2025-09-17T21:17:47.662041] [INFO ] [MAIN ] R: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:17:47.665396] [DEBUG] [LOCAL ] QVCC: Primary data saved (9120 records). [2025-09-17T21:17:47.665473] [INFO ] [MAIN ] QVCC: Full history saved. [2025-09-17T21:17:47.665552] [INFO ] [MAIN ] Update Progress: 1763/2371 symbols completed. QVCC took 30.9s. Estimated remaining: 1h 28m 54s. Rate: 6.8 symbols/min [2025-09-17T21:17:47.845198] [INFO ] [MAIN ] RA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:17:47.854851] [DEBUG] [LOCAL ] R: Loaded 29854 existing records from primary storage. [2025-09-17T21:17:47.855010] [INFO ] [MAIN ] R: Loaded 29854 existing records. [2025-09-17T21:17:48.051114] [WARN ] [MAIN ] R: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:17:48.051555] [DEBUG] [LOCAL ] RA: Loaded 21816 existing records from primary storage. [2025-09-17T21:17:48.051757] [INFO ] [MAIN ] R: Wiping existing primary data before full refresh. [2025-09-17T21:17:48.051805] [INFO ] [MAIN ] RA: Loaded 21816 existing records. [2025-09-17T21:17:48.051896] [INFO ] [LOCAL ] R: Starting deletion of primary data. [2025-09-17T21:17:48.126946] [DEBUG] [LOCAL ] R: Deleted primary data file. [2025-09-17T21:17:48.142870] [INFO ] [MAIN ] R: Starting full primary refresh. [2025-09-17T21:17:48.263167] [INFO ] [REMOTE ] QVCD: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T21:17:48.303253] [INFO ] [REMOTE ] QVCD: Full fetch complete (6212 records). [2025-09-17T21:17:48.291708] [WARN ] [MAIN ] RA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:17:48.313678] [DEBUG] [VALIDATOR ] QVCD: Validating primary data. [2025-09-17T21:17:48.338078] [INFO ] [MAIN ] RA: Wiping existing primary data before full refresh. [2025-09-17T21:17:48.343928] [INFO ] [LOCAL ] RA: Starting deletion of primary data. [2025-09-17T21:17:48.387818] [DEBUG] [LOCAL ] RA: Deleted primary data file. [2025-09-17T21:17:48.418473] [INFO ] [MAIN ] RA: Starting full primary refresh. [2025-09-17T21:17:48.978166] [INFO ] [REMOTE ] R: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:17:49.018534] [INFO ] [REMOTE ] R: Fetching primary data for 2024-11. [2025-09-17T21:17:49.256010] [DEBUG] [VALIDATOR ] QVCD: All expected trading days are present. [2025-09-17T21:17:49.256348] [DEBUG] [VALIDATOR ] QVCD: Primary data validation passed. [2025-09-17T21:17:49.271991] [INFO ] [MAIN ] QVCD: Fetched primary data is valid. [2025-09-17T21:17:49.298004] [DEBUG] [LOCAL ] QVCD: Saving primary data. [2025-09-17T21:17:49.313887] [DEBUG] [LOCAL ] QVCD: Trimmed 6212 records to 4668 (keeping 200 days of data) [2025-09-17T21:17:49.336365] [INFO ] [REMOTE ] RA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:17:49.348622] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-11. [2025-09-17T21:17:49.390659] [DEBUG] [LOCAL ] QVCD: Primary data saved (4668 records). [2025-09-17T21:17:49.391025] [INFO ] [MAIN ] QVCD: Full history saved. [2025-09-17T21:17:49.391369] [INFO ] [MAIN ] Update Progress: 1764/2371 symbols completed. QVCD took 32.6s. Estimated remaining: 1h 28m 42s. Rate: 6.8 symbols/min [2025-09-17T21:17:49.392322] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-11 (2.56 seconds). [2025-09-17T21:17:49.569080] [INFO ] [MAIN ] RACE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:17:49.602445] [DEBUG] [LOCAL ] RACE: Loaded 33210 existing records from primary storage. [2025-09-17T21:17:49.602593] [INFO ] [MAIN ] RACE: Loaded 33210 existing records. [2025-09-17T21:17:49.778265] [WARN ] [MAIN ] RACE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:17:49.778475] [INFO ] [MAIN ] RACE: Wiping existing primary data before full refresh. [2025-09-17T21:17:49.778528] [INFO ] [LOCAL ] RACE: Starting deletion of primary data. [2025-09-17T21:17:49.779360] [DEBUG] [LOCAL ] RACE: Deleted primary data file. [2025-09-17T21:17:49.779411] [INFO ] [MAIN ] RACE: Starting full primary refresh. [2025-09-17T21:17:50.022623] [INFO ] [REMOTE ] QXO: Fetching primary data for 2024-12. [2025-09-17T21:17:50.142987] [INFO ] [REMOTE ] RACE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:17:50.378357] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T21:17:50.590321] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T21:17:50.815784] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-11. [2025-09-17T21:17:51.615751] [INFO ] [REMOTE ] RA: Fetching primary data for 2024-12. [2025-09-17T21:17:51.709388] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T21:17:52.074300] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T21:17:52.415786] [INFO ] [REMOTE ] RACE: Fetching primary data for 2024-12. [2025-09-17T21:17:52.592603] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T21:17:53.215814] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-01. [2025-09-17T21:17:53.839007] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T21:17:54.015791] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-01. [2025-09-17T21:17:54.785937] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T21:17:54.815740] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-02. [2025-09-17T21:17:55.581207] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T21:17:55.615735] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-01. [2025-09-17T21:17:56.418210] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-02. [2025-09-17T21:17:56.420636] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T21:17:56.793301] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T21:17:57.215815] [INFO ] [REMOTE ] R: Fetching primary data for 2024-12. [2025-09-17T21:17:57.788544] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T21:17:58.015837] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-03. [2025-09-17T21:17:58.232530] [INFO ] [REMOTE ] R: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T21:17:58.815790] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-02. [2025-09-17T21:17:59.615823] [INFO ] [REMOTE ] R: Fetching primary data for 2025-01. [2025-09-17T21:17:59.644250] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T21:17:59.995194] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T21:18:00.415788] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-04. [2025-09-17T21:18:00.935956] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T21:18:01.215829] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-03. [2025-09-17T21:18:02.015772] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-03. [2025-09-17T21:18:02.558603] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-04 (2.14 seconds). [2025-09-17T21:18:02.815779] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-05. [2025-09-17T21:18:03.615750] [INFO ] [REMOTE ] R: Fetching primary data for 2025-02. [2025-09-17T21:18:03.711615] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-03 (2.50 seconds). [2025-09-17T21:18:04.415812] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-04. [2025-09-17T21:18:04.981833] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-03 (2.97 seconds). [2025-09-17T21:18:05.173115] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-05 (2.36 seconds). [2025-09-17T21:18:05.180238] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T21:18:05.215731] [INFO ] [REMOTE ] R: Fetching primary data for 2025-03. [2025-09-17T21:18:06.015769] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-04. [2025-09-17T21:18:06.295467] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T21:18:06.674564] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T21:18:06.786009] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T21:18:06.815732] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-05. [2025-09-17T21:18:07.615804] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-05. [2025-09-17T21:18:07.835013] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T21:18:08.415779] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-06. [2025-09-17T21:18:09.215788] [INFO ] [REMOTE ] R: Fetching primary data for 2025-04. [2025-09-17T21:18:09.410732] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T21:18:09.485277] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T21:18:10.015814] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-06. [2025-09-17T21:18:10.525516] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T21:18:10.815772] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-07. [2025-09-17T21:18:11.615794] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-06. [2025-09-17T21:18:11.907829] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T21:18:12.226288] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T21:18:12.415751] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-08. [2025-09-17T21:18:12.465360] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T21:18:13.215774] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-07. [2025-09-17T21:18:14.012937] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T21:18:14.019779] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-07. [2025-09-17T21:18:14.222000] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T21:18:14.815790] [INFO ] [REMOTE ] RACE: Fetching primary data for 2025-09. [2025-09-17T21:18:15.615838] [INFO ] [REMOTE ] R: Fetching primary data for 2025-05. [2025-09-17T21:18:16.415776] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-08. [2025-09-17T21:18:16.932416] [INFO ] [REMOTE ] RACE: Incremental fetch complete for 2025-09 (2.12 seconds). [2025-09-17T21:18:16.936738] [INFO ] [REMOTE ] RACE: Full fetch complete (47450 records). [2025-09-17T21:18:16.936851] [DEBUG] [VALIDATOR ] RACE: Validating primary data. [2025-09-17T21:18:17.150676] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-09-17T21:18:17.250162] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-08. [2025-09-17T21:18:17.367886] [DEBUG] [VALIDATOR ] RACE: All expected trading days are present. [2025-09-17T21:18:17.367968] [DEBUG] [VALIDATOR ] RACE: Primary data validation passed. [2025-09-17T21:18:17.368776] [INFO ] [MAIN ] RACE: Fetched primary data is valid. [2025-09-17T21:18:17.368820] [DEBUG] [LOCAL ] RACE: Saving primary data. [2025-09-17T21:18:17.369844] [DEBUG] [LOCAL ] RACE: Trimmed 47450 records to 33145 (keeping 200 days of data) [2025-09-17T21:18:17.580947] [DEBUG] [LOCAL ] RACE: Primary data saved (33145 records). [2025-09-17T21:18:17.581095] [INFO ] [MAIN ] RACE: Full history saved. [2025-09-17T21:18:17.581793] [INFO ] [MAIN ] Update Progress: 1765/2371 symbols completed. RACE took 28.2s. Estimated remaining: 1h 28m 40s. Rate: 6.8 symbols/min [2025-09-17T21:18:17.756657] [INFO ] [MAIN ] RAMP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:18:17.794575] [DEBUG] [LOCAL ] RAMP: Loaded 37720 existing records from primary storage. [2025-09-17T21:18:17.794744] [INFO ] [MAIN ] RAMP: Loaded 37720 existing records. [2025-09-17T21:18:17.969078] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-05 (2.35 seconds). [2025-09-17T21:18:18.003871] [WARN ] [MAIN ] RAMP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:18:18.004675] [INFO ] [MAIN ] RAMP: Wiping existing primary data before full refresh. [2025-09-17T21:18:18.005273] [INFO ] [LOCAL ] RAMP: Starting deletion of primary data. [2025-09-17T21:18:18.019551] [INFO ] [REMOTE ] R: Fetching primary data for 2025-06. [2025-09-17T21:18:18.022311] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T21:18:18.022485] [DEBUG] [LOCAL ] RAMP: Deleted primary data file. [2025-09-17T21:18:18.027402] [INFO ] [MAIN ] RAMP: Starting full primary refresh. [2025-09-17T21:18:18.399125] [INFO ] [REMOTE ] RAMP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:18:18.815771] [INFO ] [REMOTE ] RA: Fetching primary data for 2025-09. [2025-09-17T21:18:19.047898] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T21:18:19.365961] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-17T21:18:19.615860] [INFO ] [REMOTE ] R: Fetching primary data for 2025-07. [2025-09-17T21:18:19.931766] [INFO ] [REMOTE ] RA: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T21:18:19.934907] [INFO ] [REMOTE ] RA: Full fetch complete (31914 records). [2025-09-17T21:18:19.935004] [DEBUG] [VALIDATOR ] RA: Validating primary data. [2025-09-17T21:18:20.305857] [DEBUG] [VALIDATOR ] RA: All expected trading days are present. [2025-09-17T21:18:20.305973] [DEBUG] [VALIDATOR ] RA: Primary data validation passed. [2025-09-17T21:18:20.306728] [INFO ] [MAIN ] RA: Fetched primary data is valid. [2025-09-17T21:18:20.306785] [DEBUG] [LOCAL ] RA: Saving primary data. [2025-09-17T21:18:20.307704] [DEBUG] [LOCAL ] RA: Trimmed 31914 records to 21808 (keeping 200 days of data) [2025-09-17T21:18:20.416136] [INFO ] [REMOTE ] QXO: Fetching primary data for 2025-09. [2025-09-17T21:18:20.451327] [DEBUG] [LOCAL ] RA: Primary data saved (21808 records). [2025-09-17T21:18:20.451477] [INFO ] [MAIN ] RA: Full history saved. [2025-09-17T21:18:20.451576] [INFO ] [MAIN ] Update Progress: 1766/2371 symbols completed. RA took 32.8s. Estimated remaining: 1h 28m 30s. Rate: 6.8 symbols/min [2025-09-17T21:18:20.634946] [INFO ] [MAIN ] RBA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:18:20.679557] [DEBUG] [LOCAL ] RBA: Loaded 46158 existing records from primary storage. [2025-09-17T21:18:20.679769] [INFO ] [MAIN ] RBA: Loaded 46158 existing records. [2025-09-17T21:18:20.865345] [WARN ] [MAIN ] RBA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:18:20.865807] [INFO ] [MAIN ] RBA: Wiping existing primary data before full refresh. [2025-09-17T21:18:20.865903] [INFO ] [LOCAL ] RBA: Starting deletion of primary data. [2025-09-17T21:18:20.867313] [DEBUG] [LOCAL ] RBA: Deleted primary data file. [2025-09-17T21:18:20.867381] [INFO ] [MAIN ] RBA: Starting full primary refresh. [2025-09-17T21:18:21.074386] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T21:18:21.220990] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-11. [2025-09-17T21:18:21.276453] [INFO ] [REMOTE ] RBA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:18:22.015780] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-11. [2025-09-17T21:18:22.282789] [INFO ] [REMOTE ] QXO: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T21:18:22.292338] [INFO ] [REMOTE ] QXO: Full fetch complete (75249 records). [2025-09-17T21:18:22.292574] [DEBUG] [VALIDATOR ] QXO: Validating primary data. [2025-09-17T21:18:22.730772] [DEBUG] [VALIDATOR ] QXO: All expected trading days are present. [2025-09-17T21:18:22.730960] [DEBUG] [VALIDATOR ] QXO: Primary data validation passed. [2025-09-17T21:18:22.733036] [INFO ] [MAIN ] QXO: Fetched primary data is valid. [2025-09-17T21:18:22.733186] [DEBUG] [LOCAL ] QXO: Saving primary data. [2025-09-17T21:18:22.759125] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T21:18:22.767342] [DEBUG] [LOCAL ] QXO: Trimmed 75249 records to 53142 (keeping 200 days of data) [2025-09-17T21:18:22.819137] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2024-12. [2025-09-17T21:18:23.091015] [DEBUG] [LOCAL ] QXO: Primary data saved (53142 records). [2025-09-17T21:18:23.091169] [INFO ] [MAIN ] QXO: Full history saved. [2025-09-17T21:18:23.091263] [INFO ] [MAIN ] Update Progress: 1767/2371 symbols completed. QXO took 41.5s. Estimated remaining: 1h 28m 19s. Rate: 6.8 symbols/min [2025-09-17T21:18:23.274903] [INFO ] [MAIN ] RBC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:18:23.291090] [DEBUG] [LOCAL ] RBC: Loaded 14994 existing records from primary storage. [2025-09-17T21:18:23.291232] [INFO ] [MAIN ] RBC: Loaded 14994 existing records. [2025-09-17T21:18:23.502439] [WARN ] [MAIN ] RBC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:18:23.502847] [INFO ] [MAIN ] RBC: Wiping existing primary data before full refresh. [2025-09-17T21:18:23.503491] [INFO ] [LOCAL ] RBC: Starting deletion of primary data. [2025-09-17T21:18:23.504464] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T21:18:23.513600] [DEBUG] [LOCAL ] RBC: Deleted primary data file. [2025-09-17T21:18:23.513755] [INFO ] [MAIN ] RBC: Starting full primary refresh. [2025-09-17T21:18:23.620953] [INFO ] [REMOTE ] RBA: Fetching primary data for 2024-12. [2025-09-17T21:18:23.896867] [INFO ] [REMOTE ] RBC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:18:24.319120] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T21:18:24.415823] [INFO ] [REMOTE ] R: Fetching primary data for 2025-08. [2025-09-17T21:18:25.117103] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T21:18:25.215785] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-11. [2025-09-17T21:18:25.644234] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T21:18:26.015761] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-01. [2025-09-17T21:18:26.089225] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T21:18:26.815819] [INFO ] [REMOTE ] R: Fetching primary data for 2025-09. [2025-09-17T21:18:27.566311] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T21:18:27.615762] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-02. [2025-09-17T21:18:27.761501] [INFO ] [REMOTE ] R: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T21:18:27.765008] [INFO ] [REMOTE ] R: Full fetch complete (41833 records). [2025-09-17T21:18:27.765136] [DEBUG] [VALIDATOR ] R: Validating primary data. [2025-09-17T21:18:28.162600] [DEBUG] [VALIDATOR ] R: All expected trading days are present. [2025-09-17T21:18:28.162732] [DEBUG] [VALIDATOR ] R: Primary data validation passed. [2025-09-17T21:18:28.163668] [INFO ] [MAIN ] R: Fetched primary data is valid. [2025-09-17T21:18:28.163728] [DEBUG] [LOCAL ] R: Saving primary data. [2025-09-17T21:18:28.164995] [DEBUG] [LOCAL ] R: Trimmed 41833 records to 29855 (keeping 200 days of data) [2025-09-17T21:18:28.363050] [DEBUG] [LOCAL ] R: Primary data saved (29855 records). [2025-09-17T21:18:28.363199] [INFO ] [MAIN ] R: Full history saved. [2025-09-17T21:18:28.363303] [INFO ] [MAIN ] Update Progress: 1768/2371 symbols completed. R took 40.9s. Estimated remaining: 1h 28m 9s. Rate: 6.8 symbols/min [2025-09-17T21:18:28.422760] [INFO ] [REMOTE ] RBC: Fetching primary data for 2024-12. [2025-09-17T21:18:28.549368] [INFO ] [MAIN ] RBLX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:18:28.608717] [DEBUG] [LOCAL ] RBLX: Loaded 53722 existing records from primary storage. [2025-09-17T21:18:28.608855] [INFO ] [MAIN ] RBLX: Loaded 53722 existing records. [2025-09-17T21:18:28.807678] [WARN ] [MAIN ] RBLX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:18:28.807974] [INFO ] [MAIN ] RBLX: Wiping existing primary data before full refresh. [2025-09-17T21:18:28.808023] [INFO ] [LOCAL ] RBLX: Starting deletion of primary data. [2025-09-17T21:18:28.809055] [DEBUG] [LOCAL ] RBLX: Deleted primary data file. [2025-09-17T21:18:28.809110] [INFO ] [MAIN ] RBLX: Starting full primary refresh. [2025-09-17T21:18:29.186851] [INFO ] [REMOTE ] RBLX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:18:29.215734] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-11. [2025-09-17T21:18:29.241836] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T21:18:29.392407] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T21:18:30.015788] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-01. [2025-09-17T21:18:30.753919] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T21:18:30.815803] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-03. [2025-09-17T21:18:31.220252] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T21:18:31.615786] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-02. [2025-09-17T21:18:32.393442] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T21:18:32.415733] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-01. [2025-09-17T21:18:32.458280] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T21:18:33.215801] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-04. [2025-09-17T21:18:33.790306] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T21:18:34.015782] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-02. [2025-09-17T21:18:34.672823] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T21:18:34.815790] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-05. [2025-09-17T21:18:35.607186] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T21:18:35.615688] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-03. [2025-09-17T21:18:36.371183] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T21:18:36.415748] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-06. [2025-09-17T21:18:37.104848] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T21:18:37.215725] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-04. [2025-09-17T21:18:38.015748] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-03. [2025-09-17T21:18:38.106508] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T21:18:38.744176] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T21:18:38.756124] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T21:18:38.815765] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-05. [2025-09-17T21:18:39.615835] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-07. [2025-09-17T21:18:39.958927] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T21:18:40.415810] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-04. [2025-09-17T21:18:41.131575] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T21:18:41.217056] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-06. [2025-09-17T21:18:41.236566] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T21:18:42.015807] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2024-12. [2025-09-17T21:18:42.588233] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T21:18:42.815853] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-05. [2025-09-17T21:18:43.615792] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-07. [2025-09-17T21:18:43.802722] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-05 (0.99 seconds). [2025-09-17T21:18:44.321933] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-17T21:18:44.415801] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-01. [2025-09-17T21:18:45.021064] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T21:18:45.215851] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-08. [2025-09-17T21:18:46.015837] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-08. [2025-09-17T21:18:46.450306] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T21:18:46.636260] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-17T21:18:46.815780] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-02. [2025-09-17T21:18:47.493775] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T21:18:47.615776] [INFO ] [REMOTE ] RAMP: Fetching primary data for 2025-09. [2025-09-17T21:18:48.415811] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-06. [2025-09-17T21:18:49.007424] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-02 (2.19 seconds). [2025-09-17T21:18:49.118785] [INFO ] [REMOTE ] RAMP: Incremental fetch complete for 2025-09 (1.50 seconds). [2025-09-17T21:18:49.126081] [INFO ] [REMOTE ] RAMP: Full fetch complete (52851 records). [2025-09-17T21:18:49.126237] [DEBUG] [VALIDATOR ] RAMP: Validating primary data. [2025-09-17T21:18:49.221816] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-03. [2025-09-17T21:18:49.530766] [DEBUG] [VALIDATOR ] RAMP: All expected trading days are present. [2025-09-17T21:18:49.531034] [DEBUG] [VALIDATOR ] RAMP: Primary data validation passed. [2025-09-17T21:18:49.532138] [INFO ] [MAIN ] RAMP: Fetched primary data is valid. [2025-09-17T21:18:49.532198] [DEBUG] [LOCAL ] RAMP: Saving primary data. [2025-09-17T21:18:49.545418] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T21:18:49.549392] [DEBUG] [LOCAL ] RAMP: Trimmed 52851 records to 37699 (keeping 200 days of data) [2025-09-17T21:18:49.782022] [DEBUG] [LOCAL ] RAMP: Primary data saved (37699 records). [2025-09-17T21:18:49.782187] [INFO ] [MAIN ] RAMP: Full history saved. [2025-09-17T21:18:49.783049] [INFO ] [MAIN ] Update Progress: 1769/2371 symbols completed. RAMP took 32.2s. Estimated remaining: 1h 28m 4s. Rate: 6.8 symbols/min [2025-09-17T21:18:49.955204] [INFO ] [MAIN ] RBOT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:18:49.965981] [DEBUG] [LOCAL ] RBOT: Loaded 5058 existing records from primary storage. [2025-09-17T21:18:49.966111] [INFO ] [MAIN ] RBOT: Loaded 5058 existing records. [2025-09-17T21:18:50.028824] [INFO ] [REMOTE ] RBA: Fetching primary data for 2025-09. [2025-09-17T21:18:50.145496] [WARN ] [MAIN ] RBOT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:18:50.145753] [INFO ] [MAIN ] RBOT: Wiping existing primary data before full refresh. [2025-09-17T21:18:50.145799] [INFO ] [LOCAL ] RBOT: Starting deletion of primary data. [2025-09-17T21:18:50.146080] [DEBUG] [LOCAL ] RBOT: Deleted primary data file. [2025-09-17T21:18:50.146124] [INFO ] [MAIN ] RBOT: Starting full primary refresh. [2025-09-17T21:18:50.521748] [INFO ] [REMOTE ] RBOT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:18:50.815862] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-11. [2025-09-17T21:18:51.304399] [INFO ] [REMOTE ] RBA: Incremental fetch complete for 2025-09 (1.28 seconds). [2025-09-17T21:18:51.311328] [INFO ] [REMOTE ] RBA: Full fetch complete (65156 records). [2025-09-17T21:18:51.311473] [DEBUG] [VALIDATOR ] RBA: Validating primary data. [2025-09-17T21:18:51.438515] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T21:18:51.620625] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-07. [2025-09-17T21:18:51.717361] [DEBUG] [VALIDATOR ] RBA: All expected trading days are present. [2025-09-17T21:18:51.717473] [DEBUG] [VALIDATOR ] RBA: Primary data validation passed. [2025-09-17T21:18:51.718553] [INFO ] [MAIN ] RBA: Fetched primary data is valid. [2025-09-17T21:18:51.718711] [DEBUG] [LOCAL ] RBA: Saving primary data. [2025-09-17T21:18:51.720743] [DEBUG] [LOCAL ] RBA: Trimmed 65156 records to 46138 (keeping 200 days of data) [2025-09-17T21:18:51.852317] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-03 (2.63 seconds). [2025-09-17T21:18:52.071603] [DEBUG] [LOCAL ] RBA: Primary data saved (46138 records). [2025-09-17T21:18:52.071808] [INFO ] [MAIN ] RBA: Full history saved. [2025-09-17T21:18:52.072041] [INFO ] [MAIN ] Update Progress: 1770/2371 symbols completed. RBA took 31.6s. Estimated remaining: 1h 27m 53s. Rate: 6.8 symbols/min [2025-09-17T21:18:52.242534] [INFO ] [MAIN ] RBRK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:18:52.296799] [DEBUG] [LOCAL ] RBRK: Loaded 53056 existing records from primary storage. [2025-09-17T21:18:52.296973] [INFO ] [MAIN ] RBRK: Loaded 53056 existing records. [2025-09-17T21:18:52.420863] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-04. [2025-09-17T21:18:52.478639] [WARN ] [MAIN ] RBRK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:18:52.478878] [INFO ] [MAIN ] RBRK: Wiping existing primary data before full refresh. [2025-09-17T21:18:52.478925] [INFO ] [LOCAL ] RBRK: Starting deletion of primary data. [2025-09-17T21:18:52.479977] [DEBUG] [LOCAL ] RBRK: Deleted primary data file. [2025-09-17T21:18:52.480044] [INFO ] [MAIN ] RBRK: Starting full primary refresh. [2025-09-17T21:18:52.840087] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T21:18:52.863008] [INFO ] [REMOTE ] RBRK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:18:53.215786] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2024-12. [2025-09-17T21:18:53.788885] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T21:18:54.015780] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-01. [2025-09-17T21:18:54.518228] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T21:18:54.612692] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T21:18:54.815788] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-02. [2025-09-17T21:18:55.599595] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T21:18:55.615764] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-03. [2025-09-17T21:18:56.118673] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T21:18:56.415800] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-08. [2025-09-17T21:18:57.215812] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-05. [2025-09-17T21:18:57.252580] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T21:18:58.015764] [INFO ] [REMOTE ] RBC: Fetching primary data for 2025-09. [2025-09-17T21:18:58.815771] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-04. [2025-09-17T21:18:58.965406] [INFO ] [REMOTE ] RBC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T21:18:58.967785] [INFO ] [REMOTE ] RBC: Full fetch complete (21980 records). [2025-09-17T21:18:58.967863] [DEBUG] [VALIDATOR ] RBC: Validating primary data. [2025-09-17T21:18:59.342866] [DEBUG] [VALIDATOR ] RBC: All expected trading days are present. [2025-09-17T21:18:59.343024] [DEBUG] [VALIDATOR ] RBC: Primary data validation passed. [2025-09-17T21:18:59.343487] [INFO ] [MAIN ] RBC: Fetched primary data is valid. [2025-09-17T21:18:59.343575] [DEBUG] [LOCAL ] RBC: Saving primary data. [2025-09-17T21:18:59.344422] [DEBUG] [LOCAL ] RBC: Trimmed 21980 records to 15055 (keeping 200 days of data) [2025-09-17T21:18:59.442504] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-17T21:18:59.482576] [DEBUG] [LOCAL ] RBC: Primary data saved (15055 records). [2025-09-17T21:18:59.482757] [INFO ] [MAIN ] RBC: Full history saved. [2025-09-17T21:18:59.482874] [INFO ] [MAIN ] Update Progress: 1771/2371 symbols completed. RBC took 36.4s. Estimated remaining: 1h 27m 44s. Rate: 6.8 symbols/min [2025-09-17T21:18:59.622973] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-06. [2025-09-17T21:18:59.654205] [INFO ] [MAIN ] RC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:18:59.705144] [DEBUG] [LOCAL ] RC: Loaded 49154 existing records from primary storage. [2025-09-17T21:18:59.705287] [INFO ] [MAIN ] RC: Loaded 49154 existing records. [2025-09-17T21:18:59.809937] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T21:18:59.888088] [WARN ] [MAIN ] RC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:18:59.888310] [INFO ] [MAIN ] RC: Wiping existing primary data before full refresh. [2025-09-17T21:18:59.888365] [INFO ] [LOCAL ] RC: Starting deletion of primary data. [2025-09-17T21:18:59.889583] [DEBUG] [LOCAL ] RC: Deleted primary data file. [2025-09-17T21:18:59.889632] [INFO ] [MAIN ] RC: Starting full primary refresh. [2025-09-17T21:19:00.260873] [INFO ] [REMOTE ] RC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:19:00.415761] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-11. [2025-09-17T21:19:01.215847] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-05. [2025-09-17T21:19:01.697040] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T21:19:01.854662] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T21:19:01.934556] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-17T21:19:02.015817] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2024-12. [2025-09-17T21:19:02.815801] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-11. [2025-09-17T21:19:03.615763] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-07. [2025-09-17T21:19:04.021931] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T21:19:04.090126] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T21:19:04.415783] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-06. [2025-09-17T21:19:04.901557] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-06 (0.49 seconds). [2025-09-17T21:19:05.215822] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-07. [2025-09-17T21:19:05.763132] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T21:19:05.902802] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-07 (2.29 seconds). [2025-09-17T21:19:06.015779] [INFO ] [REMOTE ] RC: Fetching primary data for 2024-12. [2025-09-17T21:19:06.815796] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-01. [2025-09-17T21:19:07.621069] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-08. [2025-09-17T21:19:07.651697] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T21:19:08.415831] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-08. [2025-09-17T21:19:08.673264] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T21:19:09.215780] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-01. [2025-09-17T21:19:09.282128] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T21:19:10.015775] [INFO ] [REMOTE ] RBOT: Fetching primary data for 2025-09. [2025-09-17T21:19:10.195221] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-08 (2.57 seconds). [2025-09-17T21:19:10.666391] [INFO ] [REMOTE ] RBOT: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T21:19:10.668104] [INFO ] [REMOTE ] RBOT: Full fetch complete (8716 records). [2025-09-17T21:19:10.668178] [DEBUG] [VALIDATOR ] RBOT: Validating primary data. [2025-09-17T21:19:10.820974] [INFO ] [REMOTE ] RBLX: Fetching primary data for 2025-09. [2025-09-17T21:19:11.044712] [DEBUG] [VALIDATOR ] RBOT: All expected trading days are present. [2025-09-17T21:19:11.044822] [DEBUG] [VALIDATOR ] RBOT: Primary data validation passed. [2025-09-17T21:19:11.045134] [INFO ] [MAIN ] RBOT: Fetched primary data is valid. [2025-09-17T21:19:11.045206] [DEBUG] [LOCAL ] RBOT: Saving primary data. [2025-09-17T21:19:11.045995] [DEBUG] [LOCAL ] RBOT: Trimmed 8716 records to 5066 (keeping 200 days of data) [2025-09-17T21:19:11.097665] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T21:19:11.115669] [DEBUG] [LOCAL ] RBOT: Primary data saved (5066 records). [2025-09-17T21:19:11.115776] [INFO ] [MAIN ] RBOT: Full history saved. [2025-09-17T21:19:11.115865] [INFO ] [MAIN ] Update Progress: 1772/2371 symbols completed. RBOT took 21.3s. Estimated remaining: 1h 27m 36s. Rate: 6.8 symbols/min [2025-09-17T21:19:11.296597] [INFO ] [MAIN ] RCB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:19:11.296966] [DEBUG] [LOCAL ] RCB: No existing data file found in primary storage. [2025-09-17T21:19:11.297008] [WARN ] [MAIN ] RCB: No existing data found, performing full refresh instead. [2025-09-17T21:19:11.297175] [INFO ] [MAIN ] RCB: Wiping existing primary data before full refresh. [2025-09-17T21:19:11.297215] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-17T21:19:11.297256] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-17T21:19:11.297300] [INFO ] [MAIN ] RCB: Starting full primary refresh. [2025-09-17T21:19:11.620832] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-02. [2025-09-17T21:19:11.660515] [INFO ] [REMOTE ] RCB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:19:12.415781] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-11. [2025-09-17T21:19:12.844222] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T21:19:13.010739] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T21:19:13.215780] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-02. [2025-09-17T21:19:13.454030] [INFO ] [REMOTE ] RBLX: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-17T21:19:13.461117] [INFO ] [REMOTE ] RBLX: Full fetch complete (77702 records). [2025-09-17T21:19:13.461254] [DEBUG] [VALIDATOR ] RBLX: Validating primary data. [2025-09-17T21:19:13.860406] [DEBUG] [VALIDATOR ] RBLX: All expected trading days are present. [2025-09-17T21:19:13.860501] [DEBUG] [VALIDATOR ] RBLX: Primary data validation passed. [2025-09-17T21:19:13.861553] [INFO ] [MAIN ] RBLX: Fetched primary data is valid. [2025-09-17T21:19:13.861602] [DEBUG] [LOCAL ] RBLX: Saving primary data. [2025-09-17T21:19:13.863972] [DEBUG] [LOCAL ] RBLX: Trimmed 77702 records to 53722 (keeping 200 days of data) [2025-09-17T21:19:14.041941] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-03. [2025-09-17T21:19:14.202154] [DEBUG] [LOCAL ] RBLX: Primary data saved (53722 records). [2025-09-17T21:19:14.202309] [INFO ] [MAIN ] RBLX: Full history saved. [2025-09-17T21:19:14.202437] [INFO ] [MAIN ] Update Progress: 1773/2371 symbols completed. RBLX took 45.8s. Estimated remaining: 1h 27m 26s. Rate: 6.8 symbols/min [2025-09-17T21:19:14.382029] [INFO ] [MAIN ] RCD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:19:14.382829] [DEBUG] [LOCAL ] RCD: No existing data file found in primary storage. [2025-09-17T21:19:14.382871] [WARN ] [MAIN ] RCD: No existing data found, performing full refresh instead. [2025-09-17T21:19:14.383143] [INFO ] [MAIN ] RCD: Wiping existing primary data before full refresh. [2025-09-17T21:19:14.383194] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-17T21:19:14.383236] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-17T21:19:14.383268] [INFO ] [MAIN ] RCD: Starting full primary refresh. [2025-09-17T21:19:14.746778] [INFO ] [REMOTE ] RCD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:19:14.807265] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T21:19:14.816351] [INFO ] [REMOTE ] RCB: Fetching primary data for 2024-12. [2025-09-17T21:19:15.272784] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T21:19:15.615775] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-01. [2025-09-17T21:19:16.085017] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T21:19:16.103066] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T21:19:16.415774] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-02. [2025-09-17T21:19:17.097385] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T21:19:17.215800] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-11. [2025-09-17T21:19:17.478102] [DEBUG] [REMOTE ] RCD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:19:17.478417] [WARN ] [REMOTE ] RCD: No data returned for month 2024-11 [2025-09-17T21:19:18.015771] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-03. [2025-09-17T21:19:18.815844] [INFO ] [REMOTE ] RCD: Fetching primary data for 2024-12. [2025-09-17T21:19:19.604161] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T21:19:19.615684] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-01. [2025-09-17T21:19:20.042496] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-01 (0.43 seconds). [2025-09-17T21:19:20.267002] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-03 (2.25 seconds). [2025-09-17T21:19:20.415802] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-02. [2025-09-17T21:19:20.935599] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T21:19:21.215829] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-03. [2025-09-17T21:19:21.811282] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T21:19:22.015765] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-04. [2025-09-17T21:19:22.815794] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-03. [2025-09-17T21:19:23.463077] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T21:19:23.615829] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-04. [2025-09-17T21:19:23.959041] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T21:19:24.203189] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T21:19:24.415793] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-04. [2025-09-17T21:19:25.215791] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-05. [2025-09-17T21:19:25.868199] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T21:19:26.015770] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-05. [2025-09-17T21:19:26.815807] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-05. [2025-09-17T21:19:27.270181] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T21:19:27.343186] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T21:19:27.615760] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-04. [2025-09-17T21:19:27.978894] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T21:19:28.397839] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T21:19:28.415723] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-05. [2025-09-17T21:19:28.910328] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T21:19:29.215802] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-06. [2025-09-17T21:19:30.015891] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-06. [2025-09-17T21:19:30.815759] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-06. [2025-09-17T21:19:31.058989] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T21:19:31.497116] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T21:19:31.615723] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-07. [2025-09-17T21:19:31.627602] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T21:19:32.415768] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-06. [2025-09-17T21:19:32.783368] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T21:19:33.215786] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-07. [2025-09-17T21:19:33.495439] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T21:19:34.015765] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-08. [2025-09-17T21:19:34.815779] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-07. [2025-09-17T21:19:35.002376] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T21:19:35.364321] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T21:19:35.432567] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T21:19:35.615799] [INFO ] [REMOTE ] RC: Fetching primary data for 2025-09. [2025-09-17T21:19:36.415836] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-08. [2025-09-17T21:19:37.221734] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-07. [2025-09-17T21:19:37.229165] [INFO ] [REMOTE ] RC: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T21:19:37.239489] [INFO ] [REMOTE ] RC: Full fetch complete (70618 records). [2025-09-17T21:19:37.239766] [DEBUG] [VALIDATOR ] RC: Validating primary data. [2025-09-17T21:19:37.647459] [DEBUG] [VALIDATOR ] RC: All expected trading days are present. [2025-09-17T21:19:37.647319] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-07 (0.43 seconds). [2025-09-17T21:19:37.647665] [DEBUG] [VALIDATOR ] RC: Primary data validation passed. [2025-09-17T21:19:37.650015] [INFO ] [MAIN ] RC: Fetched primary data is valid. [2025-09-17T21:19:37.650103] [DEBUG] [LOCAL ] RC: Saving primary data. [2025-09-17T21:19:37.651631] [DEBUG] [LOCAL ] RC: Trimmed 70618 records to 49129 (keeping 200 days of data) [2025-09-17T21:19:37.949957] [DEBUG] [LOCAL ] RC: Primary data saved (49129 records). [2025-09-17T21:19:37.950113] [INFO ] [MAIN ] RC: Full history saved. [2025-09-17T21:19:37.950226] [INFO ] [MAIN ] Update Progress: 1774/2371 symbols completed. RC took 38.5s. Estimated remaining: 1h 27m 22s. Rate: 6.8 symbols/min [2025-09-17T21:19:38.020964] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-08. [2025-09-17T21:19:38.128783] [INFO ] [MAIN ] RCI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:19:38.178876] [DEBUG] [LOCAL ] RCI: Loaded 48841 existing records from primary storage. [2025-09-17T21:19:38.179042] [INFO ] [MAIN ] RCI: Loaded 48841 existing records. [2025-09-17T21:19:38.357443] [WARN ] [MAIN ] RCI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:19:38.357737] [INFO ] [MAIN ] RCI: Wiping existing primary data before full refresh. [2025-09-17T21:19:38.357796] [INFO ] [LOCAL ] RCI: Starting deletion of primary data. [2025-09-17T21:19:38.359728] [DEBUG] [LOCAL ] RCI: Deleted primary data file. [2025-09-17T21:19:38.359786] [INFO ] [MAIN ] RCI: Starting full primary refresh. [2025-09-17T21:19:38.727190] [INFO ] [REMOTE ] RCI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:19:38.763158] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T21:19:38.765174] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-08 (2.35 seconds). [2025-09-17T21:19:38.815773] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-11. [2025-09-17T21:19:39.615848] [INFO ] [REMOTE ] RBRK: Fetching primary data for 2025-09. [2025-09-17T21:19:40.140189] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T21:19:40.415807] [INFO ] [REMOTE ] RCB: Fetching primary data for 2025-09. [2025-09-17T21:19:40.847283] [INFO ] [REMOTE ] RCB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T21:19:40.848053] [INFO ] [REMOTE ] RCB: Full fetch complete (3770 records). [2025-09-17T21:19:40.848120] [DEBUG] [VALIDATOR ] RCB: Validating primary data. [2025-09-17T21:19:41.028265] [WARN ] [VALIDATOR ] RCB: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T21:19:41.028482] [FATAL] [MAIN ] RCB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:19:41.028538] [WARN ] [MAIN ] RCB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:19:41.028585] [INFO ] [LOCAL ] RCB: Starting deletion of primary data. [2025-09-17T21:19:41.028658] [DEBUG] [LOCAL ] RCB: No primary data file found to delete. [2025-09-17T21:19:41.028704] [INFO ] [LOCAL ] RCB: Starting deletion of derivative data. [2025-09-17T21:19:41.028756] [DEBUG] [LOCAL ] RCB: No derivative data file found to delete. [2025-09-17T21:19:41.028823] [INFO ] [MAIN ] Update Progress: 1775/2371 symbols completed. RCB took 29.9s. Estimated remaining: 1h 27m 11s. Rate: 6.8 symbols/min [2025-09-17T21:19:41.203496] [INFO ] [MAIN ] RCL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:19:41.215796] [INFO ] [REMOTE ] RCI: Fetching primary data for 2024-12. [2025-09-17T21:19:41.266980] [DEBUG] [LOCAL ] RCL: Loaded 52254 existing records from primary storage. [2025-09-17T21:19:41.267126] [INFO ] [MAIN ] RCL: Loaded 52254 existing records. [2025-09-17T21:19:41.450868] [WARN ] [MAIN ] RCL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:19:41.451204] [INFO ] [MAIN ] RCL: Wiping existing primary data before full refresh. [2025-09-17T21:19:41.451303] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-17T21:19:41.458284] [DEBUG] [LOCAL ] RCL: Deleted primary data file. [2025-09-17T21:19:41.468970] [INFO ] [MAIN ] RCL: Starting full primary refresh. [2025-09-17T21:19:41.502829] [INFO ] [REMOTE ] RBRK: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-17T21:19:41.580542] [INFO ] [REMOTE ] RBRK: Full fetch complete (76212 records). [2025-09-17T21:19:41.580755] [DEBUG] [VALIDATOR ] RBRK: Validating primary data. [2025-09-17T21:19:42.019547] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-08. [2025-09-17T21:19:42.111212] [INFO ] [REMOTE ] RCL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:19:42.278982] [DEBUG] [VALIDATOR ] RBRK: All expected trading days are present. [2025-09-17T21:19:42.279079] [DEBUG] [VALIDATOR ] RBRK: Primary data validation passed. [2025-09-17T21:19:42.280114] [INFO ] [MAIN ] RBRK: Fetched primary data is valid. [2025-09-17T21:19:42.280165] [DEBUG] [LOCAL ] RBRK: Saving primary data. [2025-09-17T21:19:42.281773] [DEBUG] [LOCAL ] RBRK: Trimmed 76212 records to 53071 (keeping 200 days of data) [2025-09-17T21:19:42.641566] [DEBUG] [LOCAL ] RBRK: Primary data saved (53071 records). [2025-09-17T21:19:42.641814] [INFO ] [MAIN ] RBRK: Full history saved. [2025-09-17T21:19:42.642177] [INFO ] [MAIN ] Update Progress: 1776/2371 symbols completed. RBRK took 50.6s. Estimated remaining: 1h 26m 60s. Rate: 6.8 symbols/min [2025-09-17T21:19:42.656076] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T21:19:42.778223] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-08 (0.76 seconds). [2025-09-17T21:19:42.832229] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-11. [2025-09-17T21:19:42.835413] [INFO ] [MAIN ] RCS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:19:42.848771] [DEBUG] [LOCAL ] RCS: Loaded 11533 existing records from primary storage. [2025-09-17T21:19:42.848908] [INFO ] [MAIN ] RCS: Loaded 11533 existing records. [2025-09-17T21:19:43.030762] [WARN ] [MAIN ] RCS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:19:43.031030] [INFO ] [MAIN ] RCS: Wiping existing primary data before full refresh. [2025-09-17T21:19:43.031082] [INFO ] [LOCAL ] RCS: Starting deletion of primary data. [2025-09-17T21:19:43.031492] [DEBUG] [LOCAL ] RCS: Deleted primary data file. [2025-09-17T21:19:43.031538] [INFO ] [MAIN ] RCS: Starting full primary refresh. [2025-09-17T21:19:43.392439] [INFO ] [REMOTE ] RCS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:19:43.615734] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-11. [2025-09-17T21:19:43.981485] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T21:19:44.242476] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-11 (0.63 seconds). [2025-09-17T21:19:44.415779] [INFO ] [REMOTE ] RCL: Fetching primary data for 2024-12. [2025-09-17T21:19:45.215760] [INFO ] [REMOTE ] RCD: Fetching primary data for 2025-09. [2025-09-17T21:19:45.266389] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2024-12 (0.85 seconds). [2025-09-17T21:19:45.608042] [INFO ] [REMOTE ] RCD: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T21:19:45.609258] [INFO ] [REMOTE ] RCD: Full fetch complete (6710 records). [2025-09-17T21:19:45.609340] [DEBUG] [VALIDATOR ] RCD: Validating primary data. [2025-09-17T21:19:45.791745] [WARN ] [VALIDATOR ] RCD: Validation failed - insufficient historical data. Have 185 unique days, need 200 days [2025-09-17T21:19:45.792066] [FATAL] [MAIN ] RCD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:19:45.792131] [WARN ] [MAIN ] RCD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:19:45.792185] [INFO ] [LOCAL ] RCD: Starting deletion of primary data. [2025-09-17T21:19:45.792253] [DEBUG] [LOCAL ] RCD: No primary data file found to delete. [2025-09-17T21:19:45.792297] [INFO ] [LOCAL ] RCD: Starting deletion of derivative data. [2025-09-17T21:19:45.792346] [DEBUG] [LOCAL ] RCD: No derivative data file found to delete. [2025-09-17T21:19:45.792421] [INFO ] [MAIN ] Update Progress: 1777/2371 symbols completed. RCD took 31.6s. Estimated remaining: 1h 26m 49s. Rate: 6.8 symbols/min [2025-09-17T21:19:45.977331] [INFO ] [MAIN ] RCUS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:19:46.017132] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-01. [2025-09-17T21:19:46.019249] [DEBUG] [LOCAL ] RCUS: Loaded 42981 existing records from primary storage. [2025-09-17T21:19:46.019476] [INFO ] [MAIN ] RCUS: Loaded 42981 existing records. [2025-09-17T21:19:46.200266] [WARN ] [MAIN ] RCUS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:19:46.200513] [INFO ] [MAIN ] RCUS: Wiping existing primary data before full refresh. [2025-09-17T21:19:46.200560] [INFO ] [LOCAL ] RCUS: Starting deletion of primary data. [2025-09-17T21:19:46.201551] [DEBUG] [LOCAL ] RCUS: Deleted primary data file. [2025-09-17T21:19:46.201601] [INFO ] [MAIN ] RCUS: Starting full primary refresh. [2025-09-17T21:19:46.578849] [INFO ] [REMOTE ] RCUS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:19:46.678944] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T21:19:46.815737] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-02. [2025-09-17T21:19:47.340434] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T21:19:47.615762] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-03. [2025-09-17T21:19:48.415776] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-11. [2025-09-17T21:19:48.546123] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T21:19:49.215770] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-04. [2025-09-17T21:19:49.492367] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T21:19:50.015768] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2024-12. [2025-09-17T21:19:50.103614] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T21:19:50.815790] [INFO ] [REMOTE ] RCS: Fetching primary data for 2024-12. [2025-09-17T21:19:51.232667] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T21:19:51.615817] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-05. [2025-09-17T21:19:51.833773] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T21:19:52.407449] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T21:19:52.418218] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-01. [2025-09-17T21:19:53.215784] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-01. [2025-09-17T21:19:53.238659] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T21:19:54.015762] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-06. [2025-09-17T21:19:54.730957] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T21:19:54.815850] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-02. [2025-09-17T21:19:55.027214] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T21:19:55.484313] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T21:19:55.615804] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-01. [2025-09-17T21:19:56.415822] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-03. [2025-09-17T21:19:57.090075] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T21:19:57.215815] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-07. [2025-09-17T21:19:57.265333] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T21:19:58.015806] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-02. [2025-09-17T21:19:58.206402] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T21:19:58.815788] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-04. [2025-09-17T21:19:59.615869] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-02. [2025-09-17T21:19:59.644664] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T21:19:59.703930] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T21:20:00.415918] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-03. [2025-09-17T21:20:01.215801] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-05. [2025-09-17T21:20:01.355066] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T21:20:01.942257] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T21:20:02.015816] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-08. [2025-09-17T21:20:02.322495] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T21:20:02.815879] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-06. [2025-09-17T21:20:03.258688] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T21:20:03.547999] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T21:20:03.615856] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-07. [2025-09-17T21:20:04.366810] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T21:20:04.415874] [INFO ] [REMOTE ] RCL: Fetching primary data for 2025-09. [2025-09-17T21:20:04.927036] [INFO ] [REMOTE ] RCL: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T21:20:04.934312] [INFO ] [REMOTE ] RCL: Full fetch complete (74967 records). [2025-09-17T21:20:04.934538] [DEBUG] [VALIDATOR ] RCL: Validating primary data. [2025-09-17T21:20:04.937177] [FATAL] [VALIDATOR ] RCL: Data is stale - most recent date (2025-09-16) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:20:04.937293] [FATAL] [MAIN ] RCL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:20:04.937349] [WARN ] [MAIN ] RCL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:20:04.937415] [INFO ] [LOCAL ] RCL: Starting deletion of primary data. [2025-09-17T21:20:04.937492] [DEBUG] [LOCAL ] RCL: No primary data file found to delete. [2025-09-17T21:20:04.937530] [INFO ] [LOCAL ] RCL: Starting deletion of derivative data. [2025-09-17T21:20:04.937960] [DEBUG] [LOCAL ] RCL: Deleted derivative data file. [2025-09-17T21:20:04.939021] [INFO ] [MAIN ] Update Progress: 1778/2371 symbols completed. RCL took 23.9s. Estimated remaining: 1h 26m 44s. Rate: 6.8 symbols/min [2025-09-17T21:20:05.131255] [INFO ] [MAIN ] RDDT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:20:05.206991] [DEBUG] [LOCAL ] RDDT: Loaded 53784 existing records from primary storage. [2025-09-17T21:20:05.207227] [INFO ] [MAIN ] RDDT: Loaded 53784 existing records. [2025-09-17T21:20:05.221282] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-08. [2025-09-17T21:20:05.418468] [WARN ] [MAIN ] RDDT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:20:05.418813] [INFO ] [MAIN ] RDDT: Wiping existing primary data before full refresh. [2025-09-17T21:20:05.418865] [INFO ] [LOCAL ] RDDT: Starting deletion of primary data. [2025-09-17T21:20:05.420259] [DEBUG] [LOCAL ] RDDT: Deleted primary data file. [2025-09-17T21:20:05.420314] [INFO ] [MAIN ] RDDT: Starting full primary refresh. [2025-09-17T21:20:05.816183] [INFO ] [REMOTE ] RDDT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:20:06.015827] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-11. [2025-09-17T21:20:06.377130] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T21:20:06.815819] [INFO ] [REMOTE ] RCS: Fetching primary data for 2025-09. [2025-09-17T21:20:06.889311] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T21:20:07.615785] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2024-12. [2025-09-17T21:20:07.791051] [INFO ] [REMOTE ] RCS: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T21:20:07.793384] [INFO ] [REMOTE ] RCS: Full fetch complete (19179 records). [2025-09-17T21:20:07.793457] [DEBUG] [VALIDATOR ] RCS: Validating primary data. [2025-09-17T21:20:08.185916] [DEBUG] [VALIDATOR ] RCS: All expected trading days are present. [2025-09-17T21:20:08.185999] [DEBUG] [VALIDATOR ] RCS: Primary data validation passed. [2025-09-17T21:20:08.186448] [INFO ] [MAIN ] RCS: Fetched primary data is valid. [2025-09-17T21:20:08.186500] [DEBUG] [LOCAL ] RCS: Saving primary data. [2025-09-17T21:20:08.187117] [DEBUG] [LOCAL ] RCS: Trimmed 19179 records to 11571 (keeping 200 days of data) [2025-09-17T21:20:08.261507] [DEBUG] [LOCAL ] RCS: Primary data saved (11571 records). [2025-09-17T21:20:08.261669] [INFO ] [MAIN ] RCS: Full history saved. [2025-09-17T21:20:08.261763] [INFO ] [MAIN ] Update Progress: 1779/2371 symbols completed. RCS took 25.6s. Estimated remaining: 1h 26m 33s. Rate: 6.8 symbols/min [2025-09-17T21:20:08.434861] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-03. [2025-09-17T21:20:08.439215] [INFO ] [MAIN ] RDN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:20:08.490750] [DEBUG] [LOCAL ] RDN: Loaded 45192 existing records from primary storage. [2025-09-17T21:20:08.491075] [INFO ] [MAIN ] RDN: Loaded 45192 existing records. [2025-09-17T21:20:08.686809] [WARN ] [MAIN ] RDN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:20:08.687263] [INFO ] [MAIN ] RDN: Wiping existing primary data before full refresh. [2025-09-17T21:20:08.687393] [INFO ] [LOCAL ] RDN: Starting deletion of primary data. [2025-09-17T21:20:08.688737] [DEBUG] [LOCAL ] RDN: Deleted primary data file. [2025-09-17T21:20:08.688821] [INFO ] [MAIN ] RDN: Starting full primary refresh. [2025-09-17T21:20:08.843490] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T21:20:09.127109] [INFO ] [REMOTE ] RDN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:20:09.215788] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-11. [2025-09-17T21:20:09.667929] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T21:20:10.015810] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-04. [2025-09-17T21:20:10.710003] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T21:20:10.815815] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-01. [2025-09-17T21:20:11.426546] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T21:20:11.615783] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-02. [2025-09-17T21:20:11.718491] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T21:20:12.120775] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T21:20:12.415813] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-03. [2025-09-17T21:20:13.215749] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-05. [2025-09-17T21:20:13.378798] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T21:20:14.015778] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-04. [2025-09-17T21:20:14.815760] [INFO ] [REMOTE ] RDN: Fetching primary data for 2024-12. [2025-09-17T21:20:14.890573] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T21:20:15.615788] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-04. [2025-09-17T21:20:15.719122] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T21:20:15.926237] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T21:20:16.415808] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-01. [2025-09-17T21:20:16.573967] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T21:20:17.215815] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-06. [2025-09-17T21:20:17.751534] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T21:20:18.015823] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-05. [2025-09-17T21:20:18.417576] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T21:20:18.815947] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-02. [2025-09-17T21:20:19.615853] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-07. [2025-09-17T21:20:19.817257] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T21:20:20.119966] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T21:20:20.415800] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-06. [2025-09-17T21:20:21.215786] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-05. [2025-09-17T21:20:21.246250] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T21:20:21.841462] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T21:20:21.895949] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T21:20:22.015837] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-06. [2025-09-17T21:20:22.815799] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-07. [2025-09-17T21:20:22.974318] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T21:20:23.615830] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-07. [2025-09-17T21:20:24.101869] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T21:20:24.321443] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T21:20:24.415815] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-08. [2025-09-17T21:20:25.215785] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-03. [2025-09-17T21:20:25.543300] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T21:20:26.015797] [INFO ] [REMOTE ] RCUS: Fetching primary data for 2025-09. [2025-09-17T21:20:26.749788] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T21:20:26.815847] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-08. [2025-09-17T21:20:27.413854] [INFO ] [REMOTE ] RCUS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T21:20:27.419704] [INFO ] [REMOTE ] RCUS: Full fetch complete (60146 records). [2025-09-17T21:20:27.419874] [DEBUG] [VALIDATOR ] RCUS: Validating primary data. [2025-09-17T21:20:27.621059] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-08. [2025-09-17T21:20:27.822724] [DEBUG] [VALIDATOR ] RCUS: All expected trading days are present. [2025-09-17T21:20:27.822803] [DEBUG] [VALIDATOR ] RCUS: Primary data validation passed. [2025-09-17T21:20:27.823692] [INFO ] [MAIN ] RCUS: Fetched primary data is valid. [2025-09-17T21:20:27.823739] [DEBUG] [LOCAL ] RCUS: Saving primary data. [2025-09-17T21:20:27.825296] [DEBUG] [LOCAL ] RCUS: Trimmed 60146 records to 42918 (keeping 200 days of data) [2025-09-17T21:20:28.081551] [DEBUG] [LOCAL ] RCUS: Primary data saved (42918 records). [2025-09-17T21:20:28.081702] [INFO ] [MAIN ] RCUS: Full history saved. [2025-09-17T21:20:28.081827] [INFO ] [MAIN ] Update Progress: 1780/2371 symbols completed. RCUS took 42.3s. Estimated remaining: 1h 26m 28s. Rate: 6.8 symbols/min [2025-09-17T21:20:28.253265] [INFO ] [MAIN ] RDW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:20:28.302985] [DEBUG] [LOCAL ] RDW: Loaded 51968 existing records from primary storage. [2025-09-17T21:20:28.303130] [INFO ] [MAIN ] RDW: Loaded 51968 existing records. [2025-09-17T21:20:28.421052] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-04. [2025-09-17T21:20:28.487239] [WARN ] [MAIN ] RDW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:20:28.487464] [INFO ] [MAIN ] RDW: Wiping existing primary data before full refresh. [2025-09-17T21:20:28.487520] [INFO ] [LOCAL ] RDW: Starting deletion of primary data. [2025-09-17T21:20:28.488628] [DEBUG] [LOCAL ] RDW: Deleted primary data file. [2025-09-17T21:20:28.488700] [INFO ] [MAIN ] RDW: Starting full primary refresh. [2025-09-17T21:20:28.847027] [INFO ] [REMOTE ] RDW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:20:29.003365] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T21:20:29.145009] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T21:20:29.215759] [INFO ] [REMOTE ] RCI: Fetching primary data for 2025-09. [2025-09-17T21:20:29.992923] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T21:20:30.015723] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-05. [2025-09-17T21:20:30.815826] [INFO ] [REMOTE ] RDDT: Fetching primary data for 2025-09. [2025-09-17T21:20:30.952529] [INFO ] [REMOTE ] RCI: Incremental fetch complete for 2025-09 (1.74 seconds). [2025-09-17T21:20:30.963173] [INFO ] [REMOTE ] RCI: Full fetch complete (70405 records). [2025-09-17T21:20:30.963372] [DEBUG] [VALIDATOR ] RCI: Validating primary data. [2025-09-17T21:20:31.361523] [DEBUG] [VALIDATOR ] RCI: All expected trading days are present. [2025-09-17T21:20:31.361621] [DEBUG] [VALIDATOR ] RCI: Primary data validation passed. [2025-09-17T21:20:31.362605] [INFO ] [MAIN ] RCI: Fetched primary data is valid. [2025-09-17T21:20:31.362677] [DEBUG] [LOCAL ] RCI: Saving primary data. [2025-09-17T21:20:31.364096] [DEBUG] [LOCAL ] RCI: Trimmed 70405 records to 48852 (keeping 200 days of data) [2025-09-17T21:20:31.637396] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-11. [2025-09-17T21:20:31.694352] [DEBUG] [LOCAL ] RCI: Primary data saved (48852 records). [2025-09-17T21:20:31.694823] [INFO ] [MAIN ] RCI: Full history saved. [2025-09-17T21:20:31.695681] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T21:20:31.697230] [INFO ] [MAIN ] Update Progress: 1781/2371 symbols completed. RCI took 53.7s. Estimated remaining: 1h 26m 18s. Rate: 6.8 symbols/min [2025-09-17T21:20:31.875400] [INFO ] [MAIN ] RDY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:20:31.926382] [DEBUG] [LOCAL ] RDY: Loaded 47089 existing records from primary storage. [2025-09-17T21:20:31.926541] [INFO ] [MAIN ] RDY: Loaded 47089 existing records. [2025-09-17T21:20:32.108422] [WARN ] [MAIN ] RDY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:20:32.108761] [INFO ] [MAIN ] RDY: Wiping existing primary data before full refresh. [2025-09-17T21:20:32.108812] [INFO ] [LOCAL ] RDY: Starting deletion of primary data. [2025-09-17T21:20:32.109851] [DEBUG] [LOCAL ] RDY: Deleted primary data file. [2025-09-17T21:20:32.109900] [INFO ] [MAIN ] RDY: Starting full primary refresh. [2025-09-17T21:20:32.426802] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-06. [2025-09-17T21:20:32.467891] [INFO ] [REMOTE ] RDY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:20:32.879341] [INFO ] [REMOTE ] RDDT: Incremental fetch complete for 2025-09 (2.06 seconds). [2025-09-17T21:20:32.886338] [INFO ] [REMOTE ] RDDT: Full fetch complete (77835 records). [2025-09-17T21:20:32.886472] [DEBUG] [VALIDATOR ] RDDT: Validating primary data. [2025-09-17T21:20:33.218706] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-11. [2025-09-17T21:20:33.290953] [DEBUG] [VALIDATOR ] RDDT: All expected trading days are present. [2025-09-17T21:20:33.291243] [DEBUG] [VALIDATOR ] RDDT: Primary data validation passed. [2025-09-17T21:20:33.292365] [INFO ] [MAIN ] RDDT: Fetched primary data is valid. [2025-09-17T21:20:33.292427] [DEBUG] [LOCAL ] RDDT: Saving primary data. [2025-09-17T21:20:33.294771] [DEBUG] [LOCAL ] RDDT: Trimmed 77835 records to 53784 (keeping 200 days of data) [2025-09-17T21:20:33.411126] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T21:20:33.659333] [DEBUG] [LOCAL ] RDDT: Primary data saved (53784 records). [2025-09-17T21:20:33.659488] [INFO ] [MAIN ] RDDT: Full history saved. [2025-09-17T21:20:33.660594] [INFO ] [MAIN ] Update Progress: 1782/2371 symbols completed. RDDT took 28.7s. Estimated remaining: 1h 26m 7s. Rate: 6.8 symbols/min [2025-09-17T21:20:33.830472] [INFO ] [MAIN ] RELX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:20:33.878528] [DEBUG] [LOCAL ] RELX: Loaded 47809 existing records from primary storage. [2025-09-17T21:20:33.878721] [INFO ] [MAIN ] RELX: Loaded 47809 existing records. [2025-09-17T21:20:34.020923] [INFO ] [REMOTE ] RDW: Fetching primary data for 2024-12. [2025-09-17T21:20:34.060761] [WARN ] [MAIN ] RELX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:20:34.060923] [INFO ] [MAIN ] RELX: Wiping existing primary data before full refresh. [2025-09-17T21:20:34.060970] [INFO ] [LOCAL ] RELX: Starting deletion of primary data. [2025-09-17T21:20:34.061913] [DEBUG] [LOCAL ] RELX: Deleted primary data file. [2025-09-17T21:20:34.061999] [INFO ] [MAIN ] RELX: Starting full primary refresh. [2025-09-17T21:20:34.428332] [INFO ] [REMOTE ] RELX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:20:34.455088] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-06 (2.03 seconds). [2025-09-17T21:20:34.488937] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T21:20:34.815815] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-11. [2025-09-17T21:20:35.615687] [INFO ] [REMOTE ] RDY: Fetching primary data for 2024-12. [2025-09-17T21:20:35.711049] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T21:20:36.415779] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-01. [2025-09-17T21:20:36.490951] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T21:20:37.215832] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-07. [2025-09-17T21:20:37.379806] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T21:20:38.015808] [INFO ] [REMOTE ] RELX: Fetching primary data for 2024-12. [2025-09-17T21:20:38.560574] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-17T21:20:38.705028] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T21:20:38.815799] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-01. [2025-09-17T21:20:39.615810] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-02. [2025-09-17T21:20:39.699801] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T21:20:40.415801] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-01. [2025-09-17T21:20:40.759416] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T21:20:41.215820] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-02. [2025-09-17T21:20:41.473279] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-02 (1.86 seconds). [2025-09-17T21:20:41.635957] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T21:20:42.015792] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-02. [2025-09-17T21:20:42.550187] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T21:20:42.815825] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-03. [2025-09-17T21:20:43.618052] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-03. [2025-09-17T21:20:43.621048] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T21:20:44.199689] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T21:20:44.415783] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-04. [2025-09-17T21:20:45.215777] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-03. [2025-09-17T21:20:45.507054] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T21:20:45.848627] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T21:20:46.015773] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-05. [2025-09-17T21:20:46.815812] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-04. [2025-09-17T21:20:46.858332] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T21:20:47.478070] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T21:20:47.615795] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-06. [2025-09-17T21:20:48.415815] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-04. [2025-09-17T21:20:48.731022] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T21:20:48.812827] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T21:20:49.215847] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-07. [2025-09-17T21:20:49.750018] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T21:20:50.015811] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-05. [2025-09-17T21:20:50.660047] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T21:20:50.815836] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-05. [2025-09-17T21:20:51.309080] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T21:20:51.615798] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-08. [2025-09-17T21:20:52.415819] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-08. [2025-09-17T21:20:52.787121] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T21:20:52.977977] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T21:20:53.215840] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-06. [2025-09-17T21:20:53.659489] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T21:20:54.015936] [INFO ] [REMOTE ] RDN: Fetching primary data for 2025-09. [2025-09-17T21:20:54.791714] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T21:20:54.815791] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-07. [2025-09-17T21:20:54.979277] [INFO ] [REMOTE ] RDN: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T21:20:54.985013] [INFO ] [REMOTE ] RDN: Full fetch complete (65285 records). [2025-09-17T21:20:54.985191] [DEBUG] [VALIDATOR ] RDN: Validating primary data. [2025-09-17T21:20:55.429347] [DEBUG] [VALIDATOR ] RDN: All expected trading days are present. [2025-09-17T21:20:55.429453] [DEBUG] [VALIDATOR ] RDN: Primary data validation passed. [2025-09-17T21:20:55.430515] [INFO ] [MAIN ] RDN: Fetched primary data is valid. [2025-09-17T21:20:55.430614] [DEBUG] [LOCAL ] RDN: Saving primary data. [2025-09-17T21:20:55.432287] [DEBUG] [LOCAL ] RDN: Trimmed 65285 records to 45139 (keeping 200 days of data) [2025-09-17T21:20:55.627248] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-06. [2025-09-17T21:20:55.723800] [DEBUG] [LOCAL ] RDN: Primary data saved (45139 records). [2025-09-17T21:20:55.723948] [INFO ] [MAIN ] RDN: Full history saved. [2025-09-17T21:20:55.724045] [INFO ] [MAIN ] Update Progress: 1783/2371 symbols completed. RDN took 47.5s. Estimated remaining: 1h 26m 2s. Rate: 6.8 symbols/min [2025-09-17T21:20:55.896690] [INFO ] [MAIN ] RERE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:20:55.936473] [DEBUG] [LOCAL ] RERE: Loaded 40806 existing records from primary storage. [2025-09-17T21:20:55.936801] [INFO ] [MAIN ] RERE: Loaded 40806 existing records. [2025-09-17T21:20:56.124047] [WARN ] [MAIN ] RERE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:20:56.124304] [INFO ] [MAIN ] RERE: Wiping existing primary data before full refresh. [2025-09-17T21:20:56.124351] [INFO ] [LOCAL ] RERE: Starting deletion of primary data. [2025-09-17T21:20:56.125087] [DEBUG] [LOCAL ] RERE: Deleted primary data file. [2025-09-17T21:20:56.125138] [INFO ] [MAIN ] RERE: Starting full primary refresh. [2025-09-17T21:20:56.416944] [INFO ] [REMOTE ] RDY: Fetching primary data for 2025-09. [2025-09-17T21:20:56.532659] [INFO ] [REMOTE ] RERE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:20:56.597444] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T21:20:57.215780] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-08. [2025-09-17T21:20:57.473128] [INFO ] [REMOTE ] RDY: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T21:20:57.481436] [INFO ] [REMOTE ] RDY: Full fetch complete (69106 records). [2025-09-17T21:20:57.481624] [DEBUG] [VALIDATOR ] RDY: Validating primary data. [2025-09-17T21:20:57.909546] [DEBUG] [VALIDATOR ] RDY: All expected trading days are present. [2025-09-17T21:20:57.909730] [DEBUG] [VALIDATOR ] RDY: Primary data validation passed. [2025-09-17T21:20:57.910888] [INFO ] [MAIN ] RDY: Fetched primary data is valid. [2025-09-17T21:20:57.910964] [DEBUG] [LOCAL ] RDY: Saving primary data. [2025-09-17T21:20:57.912937] [DEBUG] [LOCAL ] RDY: Trimmed 69106 records to 47024 (keeping 200 days of data) [2025-09-17T21:20:58.018348] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-11. [2025-09-17T21:20:58.046611] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-17T21:20:58.259617] [DEBUG] [LOCAL ] RDY: Primary data saved (47024 records). [2025-09-17T21:20:58.259786] [INFO ] [MAIN ] RDY: Full history saved. [2025-09-17T21:20:58.261219] [INFO ] [MAIN ] Update Progress: 1784/2371 symbols completed. RDY took 26.6s. Estimated remaining: 1h 25m 52s. Rate: 6.8 symbols/min [2025-09-17T21:20:58.442111] [INFO ] [MAIN ] RES: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:20:58.492266] [DEBUG] [LOCAL ] RES: Loaded 47631 existing records from primary storage. [2025-09-17T21:20:58.492424] [INFO ] [MAIN ] RES: Loaded 47631 existing records. [2025-09-17T21:20:58.698198] [WARN ] [MAIN ] RES: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:20:58.698517] [INFO ] [MAIN ] RES: Wiping existing primary data before full refresh. [2025-09-17T21:20:58.698597] [INFO ] [LOCAL ] RES: Starting deletion of primary data. [2025-09-17T21:20:58.699465] [DEBUG] [LOCAL ] RES: Deleted primary data file. [2025-09-17T21:20:58.699528] [INFO ] [MAIN ] RES: Starting full primary refresh. [2025-09-17T21:20:58.820908] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-07. [2025-09-17T21:20:59.088140] [INFO ] [REMOTE ] RES: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:20:59.122801] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T21:20:59.254942] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T21:20:59.615801] [INFO ] [REMOTE ] RERE: Fetching primary data for 2024-12. [2025-09-17T21:21:00.415789] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-11. [2025-09-17T21:21:00.902721] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T21:21:01.144242] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T21:21:01.215785] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-01. [2025-09-17T21:21:02.015776] [INFO ] [REMOTE ] RELX: Fetching primary data for 2025-09. [2025-09-17T21:21:02.811506] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-11 (2.40 seconds). [2025-09-17T21:21:02.821376] [INFO ] [REMOTE ] RES: Fetching primary data for 2024-12. [2025-09-17T21:21:02.933587] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T21:21:03.615784] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-02. [2025-09-17T21:21:04.415779] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-08. [2025-09-17T21:21:05.470334] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2024-12 (2.65 seconds). [2025-09-17T21:21:05.480841] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-01. [2025-09-17T21:21:05.548128] [INFO ] [REMOTE ] RELX: Incremental fetch complete for 2025-09 (3.53 seconds). [2025-09-17T21:21:05.559524] [INFO ] [REMOTE ] RELX: Full fetch complete (66680 records). [2025-09-17T21:21:05.559756] [DEBUG] [VALIDATOR ] RELX: Validating primary data. [2025-09-17T21:21:06.001910] [DEBUG] [VALIDATOR ] RELX: All expected trading days are present. [2025-09-17T21:21:06.002069] [DEBUG] [VALIDATOR ] RELX: Primary data validation passed. [2025-09-17T21:21:06.003123] [INFO ] [MAIN ] RELX: Fetched primary data is valid. [2025-09-17T21:21:06.003243] [DEBUG] [LOCAL ] RELX: Saving primary data. [2025-09-17T21:21:06.038510] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-02 (2.42 seconds). [2025-09-17T21:21:06.047050] [DEBUG] [LOCAL ] RELX: Trimmed 66680 records to 47843 (keeping 200 days of data) [2025-09-17T21:21:06.048919] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-03. [2025-09-17T21:21:06.368829] [DEBUG] [LOCAL ] RELX: Primary data saved (47843 records). [2025-09-17T21:21:06.369006] [INFO ] [MAIN ] RELX: Full history saved. [2025-09-17T21:21:06.370262] [INFO ] [MAIN ] Update Progress: 1785/2371 symbols completed. RELX took 32.7s. Estimated remaining: 1h 25m 43s. Rate: 6.8 symbols/min [2025-09-17T21:21:06.555825] [INFO ] [MAIN ] REVG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:21:06.602453] [DEBUG] [LOCAL ] REVG: Loaded 41330 existing records from primary storage. [2025-09-17T21:21:06.602613] [INFO ] [MAIN ] REVG: Loaded 41330 existing records. [2025-09-17T21:21:06.794474] [WARN ] [MAIN ] REVG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:21:06.794829] [INFO ] [MAIN ] REVG: Wiping existing primary data before full refresh. [2025-09-17T21:21:06.795213] [INFO ] [LOCAL ] REVG: Starting deletion of primary data. [2025-09-17T21:21:06.796212] [DEBUG] [LOCAL ] REVG: Deleted primary data file. [2025-09-17T21:21:06.796324] [INFO ] [MAIN ] REVG: Starting full primary refresh. [2025-09-17T21:21:07.055145] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T21:21:07.139112] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-02. [2025-09-17T21:21:07.230841] [INFO ] [REMOTE ] REVG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:21:07.259544] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T21:21:07.301733] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-08 (2.89 seconds). [2025-09-17T21:21:07.615772] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-04. [2025-09-17T21:21:08.380809] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T21:21:08.415738] [INFO ] [REMOTE ] RDW: Fetching primary data for 2025-09. [2025-09-17T21:21:08.621366] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T21:21:09.215805] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-05. [2025-09-17T21:21:10.015826] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-11. [2025-09-17T21:21:10.579523] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T21:21:10.621589] [INFO ] [REMOTE ] RDW: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-17T21:21:10.630326] [INFO ] [REMOTE ] RDW: Full fetch complete (74068 records). [2025-09-17T21:21:10.630547] [DEBUG] [VALIDATOR ] RDW: Validating primary data. [2025-09-17T21:21:10.818090] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-06. [2025-09-17T21:21:11.058625] [DEBUG] [VALIDATOR ] RDW: All expected trading days are present. [2025-09-17T21:21:11.058850] [DEBUG] [VALIDATOR ] RDW: Primary data validation passed. [2025-09-17T21:21:11.059974] [INFO ] [MAIN ] RDW: Fetched primary data is valid. [2025-09-17T21:21:11.060037] [DEBUG] [LOCAL ] RDW: Saving primary data. [2025-09-17T21:21:11.076620] [DEBUG] [LOCAL ] RDW: Trimmed 74068 records to 51988 (keeping 200 days of data) [2025-09-17T21:21:11.081148] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T21:21:11.407551] [DEBUG] [LOCAL ] RDW: Primary data saved (51988 records). [2025-09-17T21:21:11.407724] [INFO ] [MAIN ] RDW: Full history saved. [2025-09-17T21:21:11.407825] [INFO ] [MAIN ] Update Progress: 1786/2371 symbols completed. RDW took 43.3s. Estimated remaining: 1h 25m 33s. Rate: 6.8 symbols/min [2025-09-17T21:21:11.579075] [INFO ] [MAIN ] REX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:21:11.595932] [DEBUG] [LOCAL ] REX: Loaded 13623 existing records from primary storage. [2025-09-17T21:21:11.596067] [INFO ] [MAIN ] REX: Loaded 13623 existing records. [2025-09-17T21:21:11.627190] [INFO ] [REMOTE ] REVG: Fetching primary data for 2024-12. [2025-09-17T21:21:11.782208] [WARN ] [MAIN ] REX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:21:11.782474] [INFO ] [MAIN ] REX: Wiping existing primary data before full refresh. [2025-09-17T21:21:11.782519] [INFO ] [LOCAL ] REX: Starting deletion of primary data. [2025-09-17T21:21:11.782926] [DEBUG] [LOCAL ] REX: Deleted primary data file. [2025-09-17T21:21:11.782982] [INFO ] [MAIN ] REX: Starting full primary refresh. [2025-09-17T21:21:12.155971] [INFO ] [REMOTE ] REX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:21:12.181171] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-06 (1.36 seconds). [2025-09-17T21:21:12.415785] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-07. [2025-09-17T21:21:13.215829] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-11. [2025-09-17T21:21:13.285339] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T21:21:14.015825] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-01. [2025-09-17T21:21:14.186905] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T21:21:14.543427] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T21:21:14.815801] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-08. [2025-09-17T21:21:15.615834] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-03. [2025-09-17T21:21:15.888932] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T21:21:16.415759] [INFO ] [REMOTE ] REX: Fetching primary data for 2024-12. [2025-09-17T21:21:16.512590] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T21:21:16.918313] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T21:21:17.215872] [INFO ] [REMOTE ] RERE: Fetching primary data for 2025-09. [2025-09-17T21:21:17.235874] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T21:21:18.015822] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-04. [2025-09-17T21:21:18.790262] [INFO ] [REMOTE ] RERE: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T21:21:18.796622] [INFO ] [REMOTE ] RERE: Full fetch complete (57367 records). [2025-09-17T21:21:18.796818] [DEBUG] [VALIDATOR ] RERE: Validating primary data. [2025-09-17T21:21:18.820956] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-01. [2025-09-17T21:21:19.214134] [DEBUG] [VALIDATOR ] RERE: All expected trading days are present. [2025-09-17T21:21:19.214269] [DEBUG] [VALIDATOR ] RERE: Primary data validation passed. [2025-09-17T21:21:19.215163] [INFO ] [MAIN ] RERE: Fetched primary data is valid. [2025-09-17T21:21:19.215209] [DEBUG] [LOCAL ] RERE: Saving primary data. [2025-09-17T21:21:19.217546] [DEBUG] [LOCAL ] RERE: Trimmed 57367 records to 40834 (keeping 200 days of data) [2025-09-17T21:21:19.456883] [DEBUG] [LOCAL ] RERE: Primary data saved (40834 records). [2025-09-17T21:21:19.457014] [INFO ] [MAIN ] RERE: Full history saved. [2025-09-17T21:21:19.457155] [INFO ] [MAIN ] Update Progress: 1787/2371 symbols completed. RERE took 23.7s. Estimated remaining: 1h 25m 24s. Rate: 6.8 symbols/min [2025-09-17T21:21:19.627795] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-02. [2025-09-17T21:21:19.630248] [INFO ] [MAIN ] REXR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:21:19.688461] [DEBUG] [LOCAL ] REXR: Loaded 52016 existing records from primary storage. [2025-09-17T21:21:19.688662] [INFO ] [MAIN ] REXR: Loaded 52016 existing records. [2025-09-17T21:21:19.910565] [WARN ] [MAIN ] REXR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:21:19.916506] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T21:21:19.914944] [INFO ] [MAIN ] REXR: Wiping existing primary data before full refresh. [2025-09-17T21:21:19.916768] [INFO ] [LOCAL ] REXR: Starting deletion of primary data. [2025-09-17T21:21:19.936839] [DEBUG] [LOCAL ] REXR: Deleted primary data file. [2025-09-17T21:21:19.937531] [INFO ] [MAIN ] REXR: Starting full primary refresh. [2025-09-17T21:21:19.955142] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T21:21:20.315295] [INFO ] [REMOTE ] REXR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:21:20.415822] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-05. [2025-09-17T21:21:20.810236] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T21:21:21.215798] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-03. [2025-09-17T21:21:21.699177] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T21:21:22.015789] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-11. [2025-09-17T21:21:22.368802] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T21:21:22.815819] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-06. [2025-09-17T21:21:23.615791] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-02. [2025-09-17T21:21:23.682127] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T21:21:24.372309] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T21:21:24.415779] [INFO ] [REMOTE ] REXR: Fetching primary data for 2024-12. [2025-09-17T21:21:24.496615] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T21:21:25.215971] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-07. [2025-09-17T21:21:26.015842] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-04. [2025-09-17T21:21:26.126525] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T21:21:26.815832] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-03. [2025-09-17T21:21:26.969803] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T21:21:27.449189] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T21:21:27.531902] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T21:21:27.615738] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-05. [2025-09-17T21:21:28.415806] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-01. [2025-09-17T21:21:28.781147] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T21:21:29.215796] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-06. [2025-09-17T21:21:29.799732] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T21:21:30.015774] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-08. [2025-09-17T21:21:30.466050] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T21:21:30.815824] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-07. [2025-09-17T21:21:31.615800] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-02. [2025-09-17T21:21:31.663151] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T21:21:31.959019] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T21:21:32.415785] [INFO ] [REMOTE ] RES: Fetching primary data for 2025-09. [2025-09-17T21:21:33.150125] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T21:21:33.215750] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-03. [2025-09-17T21:21:33.678214] [INFO ] [REMOTE ] RES: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T21:21:33.684465] [INFO ] [REMOTE ] RES: Full fetch complete (68615 records). [2025-09-17T21:21:33.684613] [DEBUG] [VALIDATOR ] RES: Validating primary data. [2025-09-17T21:21:34.025278] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-04. [2025-09-17T21:21:34.084069] [DEBUG] [VALIDATOR ] RES: All expected trading days are present. [2025-09-17T21:21:34.084152] [DEBUG] [VALIDATOR ] RES: Primary data validation passed. [2025-09-17T21:21:34.085108] [INFO ] [MAIN ] RES: Fetched primary data is valid. [2025-09-17T21:21:34.085158] [DEBUG] [LOCAL ] RES: Saving primary data. [2025-09-17T21:21:34.086508] [DEBUG] [LOCAL ] RES: Trimmed 68615 records to 47570 (keeping 200 days of data) [2025-09-17T21:21:34.381679] [DEBUG] [LOCAL ] RES: Primary data saved (47570 records). [2025-09-17T21:21:34.381839] [INFO ] [MAIN ] RES: Full history saved. [2025-09-17T21:21:34.382778] [INFO ] [MAIN ] Update Progress: 1788/2371 symbols completed. RES took 36.1s. Estimated remaining: 1h 25m 17s. Rate: 6.8 symbols/min [2025-09-17T21:21:34.560522] [INFO ] [MAIN ] REZI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:21:34.637498] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T21:21:34.638451] [DEBUG] [LOCAL ] REZI: Loaded 46738 existing records from primary storage. [2025-09-17T21:21:34.649231] [INFO ] [MAIN ] REZI: Loaded 46738 existing records. [2025-09-17T21:21:34.823437] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-08. [2025-09-17T21:21:34.828111] [WARN ] [MAIN ] REZI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:21:34.829183] [INFO ] [MAIN ] REZI: Wiping existing primary data before full refresh. [2025-09-17T21:21:34.829237] [INFO ] [LOCAL ] REZI: Starting deletion of primary data. [2025-09-17T21:21:34.830150] [DEBUG] [LOCAL ] REZI: Deleted primary data file. [2025-09-17T21:21:34.830205] [INFO ] [MAIN ] REZI: Starting full primary refresh. [2025-09-17T21:21:35.189841] [INFO ] [REMOTE ] REZI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:21:35.201215] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T21:21:35.615794] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-04. [2025-09-17T21:21:35.916533] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T21:21:36.415782] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-05. [2025-09-17T21:21:37.036867] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-05 (0.62 seconds). [2025-09-17T21:21:37.215788] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-11. [2025-09-17T21:21:37.406948] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T21:21:38.015819] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-05. [2025-09-17T21:21:38.536855] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T21:21:38.815815] [INFO ] [REMOTE ] REZI: Fetching primary data for 2024-12. [2025-09-17T21:21:39.349103] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T21:21:39.615769] [INFO ] [REMOTE ] REVG: Fetching primary data for 2025-09. [2025-09-17T21:21:40.264152] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T21:21:40.415814] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-01. [2025-09-17T21:21:41.064185] [INFO ] [REMOTE ] REVG: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T21:21:41.071274] [INFO ] [REMOTE ] REVG: Full fetch complete (58045 records). [2025-09-17T21:21:41.071410] [DEBUG] [VALIDATOR ] REVG: Validating primary data. [2025-09-17T21:21:41.220875] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-06. [2025-09-17T21:21:41.483125] [DEBUG] [VALIDATOR ] REVG: All expected trading days are present. [2025-09-17T21:21:41.483239] [DEBUG] [VALIDATOR ] REVG: Primary data validation passed. [2025-09-17T21:21:41.484581] [INFO ] [MAIN ] REVG: Fetched primary data is valid. [2025-09-17T21:21:41.484730] [DEBUG] [LOCAL ] REVG: Saving primary data. [2025-09-17T21:21:41.486671] [DEBUG] [LOCAL ] REVG: Trimmed 58045 records to 41303 (keeping 200 days of data) [2025-09-17T21:21:41.510872] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T21:21:41.772270] [DEBUG] [LOCAL ] REVG: Primary data saved (41303 records). [2025-09-17T21:21:41.772405] [INFO ] [MAIN ] REVG: Full history saved. [2025-09-17T21:21:41.773093] [INFO ] [MAIN ] Update Progress: 1789/2371 symbols completed. REVG took 35.4s. Estimated remaining: 1h 25m 8s. Rate: 6.8 symbols/min [2025-09-17T21:21:41.943409] [INFO ] [MAIN ] RF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:21:41.996184] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-17T21:21:41.996351] [INFO ] [MAIN ] RF: Loaded 53630 existing records. [2025-09-17T21:21:42.026687] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-02. [2025-09-17T21:21:42.189325] [WARN ] [MAIN ] RF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:21:42.189560] [INFO ] [MAIN ] RF: Wiping existing primary data before full refresh. [2025-09-17T21:21:42.189618] [INFO ] [LOCAL ] RF: Starting deletion of primary data. [2025-09-17T21:21:42.190660] [DEBUG] [LOCAL ] RF: Deleted primary data file. [2025-09-17T21:21:42.190712] [INFO ] [MAIN ] RF: Starting full primary refresh. [2025-09-17T21:21:42.596799] [INFO ] [REMOTE ] RF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:21:42.654878] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T21:21:42.815771] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-11. [2025-09-17T21:21:43.197236] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-02 (1.17 seconds). [2025-09-17T21:21:43.615796] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-03. [2025-09-17T21:21:44.415763] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-07. [2025-09-17T21:21:44.608358] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T21:21:44.810121] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T21:21:45.215745] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-04. [2025-09-17T21:21:45.804934] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T21:21:46.015739] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-06. [2025-09-17T21:21:46.519565] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T21:21:46.646451] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T21:21:46.815780] [INFO ] [REMOTE ] RF: Fetching primary data for 2024-12. [2025-09-17T21:21:47.615824] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-08. [2025-09-17T21:21:48.415820] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-05. [2025-09-17T21:21:48.615562] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T21:21:48.735014] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T21:21:49.215868] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-07. [2025-09-17T21:21:49.702618] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T21:21:50.015794] [INFO ] [REMOTE ] REXR: Fetching primary data for 2025-09. [2025-09-17T21:21:50.168905] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T21:21:50.815795] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-01. [2025-09-17T21:21:51.543362] [INFO ] [REMOTE ] REXR: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T21:21:51.551509] [INFO ] [REMOTE ] REXR: Full fetch complete (74887 records). [2025-09-17T21:21:51.551845] [DEBUG] [VALIDATOR ] REXR: Validating primary data. [2025-09-17T21:21:51.620923] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-06. [2025-09-17T21:21:51.951667] [DEBUG] [VALIDATOR ] REXR: All expected trading days are present. [2025-09-17T21:21:51.951758] [DEBUG] [VALIDATOR ] REXR: Primary data validation passed. [2025-09-17T21:21:51.952804] [INFO ] [MAIN ] REXR: Fetched primary data is valid. [2025-09-17T21:21:51.952852] [DEBUG] [LOCAL ] REXR: Saving primary data. [2025-09-17T21:21:51.954575] [DEBUG] [LOCAL ] REXR: Trimmed 74887 records to 52021 (keeping 200 days of data) [2025-09-17T21:21:52.214531] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T21:21:52.321846] [DEBUG] [LOCAL ] REXR: Primary data saved (52021 records). [2025-09-17T21:21:52.322020] [INFO ] [MAIN ] REXR: Full history saved. [2025-09-17T21:21:52.322128] [INFO ] [MAIN ] Update Progress: 1790/2371 symbols completed. REXR took 32.9s. Estimated remaining: 1h 24m 59s. Rate: 6.8 symbols/min [2025-09-17T21:21:52.424484] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-02. [2025-09-17T21:21:52.501185] [INFO ] [MAIN ] RFI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:21:52.514655] [DEBUG] [LOCAL ] RFI: Loaded 10593 existing records from primary storage. [2025-09-17T21:21:52.514787] [INFO ] [MAIN ] RFI: Loaded 10593 existing records. [2025-09-17T21:21:52.696454] [WARN ] [MAIN ] RFI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:21:52.696745] [INFO ] [MAIN ] RFI: Wiping existing primary data before full refresh. [2025-09-17T21:21:52.696812] [INFO ] [LOCAL ] RFI: Starting deletion of primary data. [2025-09-17T21:21:52.697304] [DEBUG] [LOCAL ] RFI: Deleted primary data file. [2025-09-17T21:21:52.697366] [INFO ] [MAIN ] RFI: Starting full primary refresh. [2025-09-17T21:21:53.065586] [INFO ] [REMOTE ] RFI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:21:53.100312] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T21:21:53.215780] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-11. [2025-09-17T21:21:53.720838] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T21:21:53.895436] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T21:21:54.015808] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-08. [2025-09-17T21:21:54.705480] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T21:21:54.815783] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-03. [2025-09-17T21:21:55.615741] [INFO ] [REMOTE ] REX: Fetching primary data for 2025-09. [2025-09-17T21:21:56.298755] [INFO ] [REMOTE ] REX: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T21:21:56.301832] [INFO ] [REMOTE ] REX: Full fetch complete (21072 records). [2025-09-17T21:21:56.301981] [DEBUG] [VALIDATOR ] REX: Validating primary data. [2025-09-17T21:21:56.419986] [INFO ] [REMOTE ] RFI: Fetching primary data for 2024-12. [2025-09-17T21:21:56.727725] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T21:21:56.744685] [DEBUG] [VALIDATOR ] REX: All expected trading days are present. [2025-09-17T21:21:56.744848] [DEBUG] [VALIDATOR ] REX: Primary data validation passed. [2025-09-17T21:21:56.745596] [INFO ] [MAIN ] REX: Fetched primary data is valid. [2025-09-17T21:21:56.745987] [DEBUG] [LOCAL ] REX: Saving primary data. [2025-09-17T21:21:56.747307] [DEBUG] [LOCAL ] REX: Trimmed 21072 records to 13762 (keeping 200 days of data) [2025-09-17T21:21:56.838888] [DEBUG] [LOCAL ] REX: Primary data saved (13762 records). [2025-09-17T21:21:56.839070] [INFO ] [MAIN ] REX: Full history saved. [2025-09-17T21:21:56.839188] [INFO ] [MAIN ] Update Progress: 1791/2371 symbols completed. REX took 45.4s. Estimated remaining: 1h 24m 49s. Rate: 6.8 symbols/min [2025-09-17T21:21:57.028010] [INFO ] [MAIN ] RFL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:21:57.040008] [DEBUG] [LOCAL ] RFL: Loaded 10286 existing records from primary storage. [2025-09-17T21:21:57.040131] [INFO ] [MAIN ] RFL: Loaded 10286 existing records. [2025-09-17T21:21:57.218934] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-04. [2025-09-17T21:21:57.224435] [WARN ] [MAIN ] RFL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:21:57.234154] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T21:21:57.237135] [INFO ] [MAIN ] RFL: Wiping existing primary data before full refresh. [2025-09-17T21:21:57.237855] [INFO ] [LOCAL ] RFL: Starting deletion of primary data. [2025-09-17T21:21:57.238191] [DEBUG] [LOCAL ] RFL: Deleted primary data file. [2025-09-17T21:21:57.238238] [INFO ] [MAIN ] RFL: Starting full primary refresh. [2025-09-17T21:21:57.605769] [INFO ] [REMOTE ] RFL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:21:58.015771] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-01. [2025-09-17T21:21:58.815786] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-11. [2025-09-17T21:21:58.896947] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T21:21:59.413230] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-04 (2.19 seconds). [2025-09-17T21:21:59.551829] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T21:21:59.615793] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-02. [2025-09-17T21:22:00.084998] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T21:22:00.415780] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-03. [2025-09-17T21:22:01.136197] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T21:22:01.215781] [INFO ] [REMOTE ] RFL: Fetching primary data for 2024-12. [2025-09-17T21:22:01.698464] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T21:22:02.015775] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-01. [2025-09-17T21:22:02.659005] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-01 (0.64 seconds). [2025-09-17T21:22:02.815785] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-05. [2025-09-17T21:22:03.615783] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-04. [2025-09-17T21:22:04.334834] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T21:22:04.415772] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-06. [2025-09-17T21:22:04.452105] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T21:22:05.215800] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-07. [2025-09-17T21:22:06.015792] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-02. [2025-09-17T21:22:06.104554] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T21:22:06.429822] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T21:22:06.527106] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T21:22:06.815780] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-05. [2025-09-17T21:22:07.344230] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T21:22:07.615768] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-03. [2025-09-17T21:22:08.263977] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T21:22:08.415837] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-07. [2025-09-17T21:22:09.215831] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-06. [2025-09-17T21:22:09.980608] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T21:22:10.013091] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T21:22:10.023705] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-08. [2025-09-17T21:22:10.815786] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-04. [2025-09-17T21:22:11.280233] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T21:22:11.423740] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T21:22:11.615844] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-07. [2025-09-17T21:22:12.415751] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-08. [2025-09-17T21:22:12.665874] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T21:22:13.215795] [INFO ] [REMOTE ] REZI: Fetching primary data for 2025-09. [2025-09-17T21:22:14.015764] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-08. [2025-09-17T21:22:14.277377] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T21:22:14.559597] [INFO ] [REMOTE ] REZI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T21:22:14.566397] [INFO ] [REMOTE ] REZI: Full fetch complete (65276 records). [2025-09-17T21:22:14.566546] [DEBUG] [VALIDATOR ] REZI: Validating primary data. [2025-09-17T21:22:14.821000] [INFO ] [REMOTE ] RF: Fetching primary data for 2025-09. [2025-09-17T21:22:14.963376] [DEBUG] [VALIDATOR ] REZI: All expected trading days are present. [2025-09-17T21:22:14.963553] [DEBUG] [VALIDATOR ] REZI: Primary data validation passed. [2025-09-17T21:22:14.964711] [INFO ] [MAIN ] REZI: Fetched primary data is valid. [2025-09-17T21:22:14.964784] [DEBUG] [LOCAL ] REZI: Saving primary data. [2025-09-17T21:22:14.976755] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T21:22:14.980939] [DEBUG] [LOCAL ] REZI: Trimmed 65276 records to 46796 (keeping 200 days of data) [2025-09-17T21:22:15.258294] [DEBUG] [LOCAL ] REZI: Primary data saved (46796 records). [2025-09-17T21:22:15.258445] [INFO ] [MAIN ] REZI: Full history saved. [2025-09-17T21:22:15.258541] [INFO ] [MAIN ] Update Progress: 1792/2371 symbols completed. REZI took 40.9s. Estimated remaining: 1h 24m 43s. Rate: 6.8 symbols/min [2025-09-17T21:22:15.434423] [INFO ] [MAIN ] RFM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:22:15.440331] [DEBUG] [LOCAL ] RFM: Loaded 3963 existing records from primary storage. [2025-09-17T21:22:15.440452] [INFO ] [MAIN ] RFM: Loaded 3963 existing records. [2025-09-17T21:22:15.616212] [WARN ] [MAIN ] RFM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:22:15.616375] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-05. [2025-09-17T21:22:15.616989] [INFO ] [MAIN ] RFM: Wiping existing primary data before full refresh. [2025-09-17T21:22:15.617088] [INFO ] [LOCAL ] RFM: Starting deletion of primary data. [2025-09-17T21:22:15.618303] [DEBUG] [LOCAL ] RFM: Deleted primary data file. [2025-09-17T21:22:15.618377] [INFO ] [MAIN ] RFM: Starting full primary refresh. [2025-09-17T21:22:15.972203] [INFO ] [REMOTE ] RFM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:22:16.195305] [INFO ] [REMOTE ] RF: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T21:22:16.202805] [INFO ] [REMOTE ] RF: Full fetch complete (77459 records). [2025-09-17T21:22:16.202933] [DEBUG] [VALIDATOR ] RF: Validating primary data. [2025-09-17T21:22:16.420885] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-11. [2025-09-17T21:22:16.601219] [DEBUG] [VALIDATOR ] RF: All expected trading days are present. [2025-09-17T21:22:16.601351] [DEBUG] [VALIDATOR ] RF: Primary data validation passed. [2025-09-17T21:22:16.602653] [INFO ] [MAIN ] RF: Fetched primary data is valid. [2025-09-17T21:22:16.602779] [DEBUG] [LOCAL ] RF: Saving primary data. [2025-09-17T21:22:16.613050] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T21:22:16.617799] [DEBUG] [LOCAL ] RF: Trimmed 77459 records to 53630 (keeping 200 days of data) [2025-09-17T21:22:16.846536] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T21:22:16.971100] [DEBUG] [LOCAL ] RF: Primary data saved (53630 records). [2025-09-17T21:22:16.971276] [INFO ] [MAIN ] RF: Full history saved. [2025-09-17T21:22:16.972004] [INFO ] [MAIN ] Update Progress: 1793/2371 symbols completed. RF took 35.2s. Estimated remaining: 1h 24m 32s. Rate: 6.8 symbols/min [2025-09-17T21:22:17.146120] [INFO ] [MAIN ] RFMZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:22:17.158565] [DEBUG] [LOCAL ] RFMZ: Loaded 8442 existing records from primary storage. [2025-09-17T21:22:17.158720] [INFO ] [MAIN ] RFMZ: Loaded 8442 existing records. [2025-09-17T21:22:17.221033] [INFO ] [REMOTE ] RFI: Fetching primary data for 2025-09. [2025-09-17T21:22:17.342090] [WARN ] [MAIN ] RFMZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:22:17.342331] [INFO ] [MAIN ] RFMZ: Wiping existing primary data before full refresh. [2025-09-17T21:22:17.342376] [INFO ] [LOCAL ] RFMZ: Starting deletion of primary data. [2025-09-17T21:22:17.342722] [DEBUG] [LOCAL ] RFMZ: Deleted primary data file. [2025-09-17T21:22:17.342771] [INFO ] [MAIN ] RFMZ: Starting full primary refresh. [2025-09-17T21:22:17.700429] [INFO ] [REMOTE ] RFMZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:22:17.738758] [INFO ] [REMOTE ] RFI: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T21:22:17.740829] [INFO ] [REMOTE ] RFI: Full fetch complete (15853 records). [2025-09-17T21:22:17.740905] [DEBUG] [VALIDATOR ] RFI: Validating primary data. [2025-09-17T21:22:18.019778] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-06. [2025-09-17T21:22:18.101576] [DEBUG] [VALIDATOR ] RFI: All expected trading days are present. [2025-09-17T21:22:18.101668] [DEBUG] [VALIDATOR ] RFI: Primary data validation passed. [2025-09-17T21:22:18.102015] [INFO ] [MAIN ] RFI: Fetched primary data is valid. [2025-09-17T21:22:18.102060] [DEBUG] [LOCAL ] RFI: Saving primary data. [2025-09-17T21:22:18.102581] [DEBUG] [LOCAL ] RFI: Trimmed 15853 records to 10573 (keeping 200 days of data) [2025-09-17T21:22:18.169962] [DEBUG] [LOCAL ] RFI: Primary data saved (10573 records). [2025-09-17T21:22:18.170098] [INFO ] [MAIN ] RFI: Full history saved. [2025-09-17T21:22:18.170193] [INFO ] [MAIN ] Update Progress: 1794/2371 symbols completed. RFI took 25.8s. Estimated remaining: 1h 24m 21s. Rate: 6.8 symbols/min [2025-09-17T21:22:18.339195] [INFO ] [MAIN ] RGA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:22:18.370091] [DEBUG] [LOCAL ] RGA: Loaded 30127 existing records from primary storage. [2025-09-17T21:22:18.370225] [INFO ] [MAIN ] RGA: Loaded 30127 existing records. [2025-09-17T21:22:18.551140] [WARN ] [MAIN ] RGA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:22:18.551381] [INFO ] [MAIN ] RGA: Wiping existing primary data before full refresh. [2025-09-17T21:22:18.551425] [INFO ] [LOCAL ] RGA: Starting deletion of primary data. [2025-09-17T21:22:18.552178] [DEBUG] [LOCAL ] RGA: Deleted primary data file. [2025-09-17T21:22:18.552228] [INFO ] [MAIN ] RGA: Starting full primary refresh. [2025-09-17T21:22:18.819497] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-11. [2025-09-17T21:22:18.909304] [INFO ] [REMOTE ] RGA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:22:18.922033] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T21:22:19.606797] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T21:22:19.615669] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2024-12. [2025-09-17T21:22:20.232612] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T21:22:20.415779] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-01. [2025-09-17T21:22:20.963570] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T21:22:21.215784] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-11. [2025-09-17T21:22:22.015824] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-02. [2025-09-17T21:22:22.401247] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T21:22:22.629435] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T21:22:22.815803] [INFO ] [REMOTE ] RGA: Fetching primary data for 2024-12. [2025-09-17T21:22:23.615809] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-03. [2025-09-17T21:22:24.090141] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T21:22:24.408794] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T21:22:24.417780] [INFO ] [REMOTE ] RFM: Fetching primary data for 2024-12. [2025-09-17T21:22:24.923861] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T21:22:25.215795] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-07. [2025-09-17T21:22:25.982543] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T21:22:26.015928] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-01. [2025-09-17T21:22:26.815800] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-08. [2025-09-17T21:22:27.309363] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T21:22:27.600206] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T21:22:27.615678] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-02. [2025-09-17T21:22:28.415789] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-04. [2025-09-17T21:22:28.984090] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T21:22:29.215794] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-03. [2025-09-17T21:22:29.237802] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T21:22:30.015803] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-05. [2025-09-17T21:22:30.764315] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T21:22:30.790775] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T21:22:30.815751] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-04. [2025-09-17T21:22:31.615790] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-06. [2025-09-17T21:22:31.958678] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T21:22:32.303658] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T21:22:32.415783] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-05. [2025-09-17T21:22:33.215806] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-01. [2025-09-17T21:22:33.328833] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T21:22:33.684253] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T21:22:34.015803] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-06. [2025-09-17T21:22:34.815780] [INFO ] [REMOTE ] RFL: Fetching primary data for 2025-09. [2025-09-17T21:22:35.223811] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T21:22:35.615803] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-07. [2025-09-17T21:22:35.870733] [INFO ] [REMOTE ] RFL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T21:22:35.874306] [INFO ] [REMOTE ] RFL: Full fetch complete (12296 records). [2025-09-17T21:22:35.874443] [DEBUG] [VALIDATOR ] RFL: Validating primary data. [2025-09-17T21:22:36.183214] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T21:22:36.246346] [DEBUG] [VALIDATOR ] RFL: All expected trading days are present. [2025-09-17T21:22:36.246458] [DEBUG] [VALIDATOR ] RFL: Primary data validation passed. [2025-09-17T21:22:36.246784] [INFO ] [MAIN ] RFL: Fetched primary data is valid. [2025-09-17T21:22:36.246827] [DEBUG] [LOCAL ] RFL: Saving primary data. [2025-09-17T21:22:36.247363] [DEBUG] [LOCAL ] RFL: Trimmed 12296 records to 10456 (keeping 200 days of data) [2025-09-17T21:22:36.307820] [DEBUG] [LOCAL ] RFL: Primary data saved (10456 records). [2025-09-17T21:22:36.307969] [INFO ] [MAIN ] RFL: Full history saved. [2025-09-17T21:22:36.308061] [INFO ] [MAIN ] Update Progress: 1795/2371 symbols completed. RFL took 39.5s. Estimated remaining: 1h 24m 15s. Rate: 6.8 symbols/min [2025-09-17T21:22:36.420944] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-07. [2025-09-17T21:22:36.483170] [INFO ] [MAIN ] RGR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:22:36.504359] [DEBUG] [LOCAL ] RGR: Loaded 19999 existing records from primary storage. [2025-09-17T21:22:36.504535] [INFO ] [MAIN ] RGR: Loaded 19999 existing records. [2025-09-17T21:22:36.681505] [WARN ] [MAIN ] RGR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:22:36.681817] [INFO ] [MAIN ] RGR: Wiping existing primary data before full refresh. [2025-09-17T21:22:36.681865] [INFO ] [LOCAL ] RGR: Starting deletion of primary data. [2025-09-17T21:22:36.682447] [DEBUG] [LOCAL ] RGR: Deleted primary data file. [2025-09-17T21:22:36.682495] [INFO ] [MAIN ] RGR: Starting full primary refresh. [2025-09-17T21:22:37.033781] [INFO ] [REMOTE ] RGR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:22:37.215792] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-02. [2025-09-17T21:22:37.669288] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-02 (0.45 seconds). [2025-09-17T21:22:37.696878] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T21:22:38.015809] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-11. [2025-09-17T21:22:38.752804] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T21:22:38.815813] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-03. [2025-09-17T21:22:39.415622] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T21:22:39.615757] [INFO ] [REMOTE ] RGR: Fetching primary data for 2024-12. [2025-09-17T21:22:40.415748] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-08. [2025-09-17T21:22:40.688675] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T21:22:41.067136] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-08 (0.65 seconds). [2025-09-17T21:22:41.215760] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-01. [2025-09-17T21:22:41.882213] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T21:22:42.015816] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-02. [2025-09-17T21:22:42.768031] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T21:22:42.815762] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-03. [2025-09-17T21:22:43.615798] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-04. [2025-09-17T21:22:43.926826] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T21:22:44.035793] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-04 (0.42 seconds). [2025-09-17T21:22:44.415863] [INFO ] [REMOTE ] RFMZ: Fetching primary data for 2025-09. [2025-09-17T21:22:45.088196] [INFO ] [REMOTE ] RFMZ: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T21:22:45.090816] [INFO ] [REMOTE ] RFMZ: Full fetch complete (12867 records). [2025-09-17T21:22:45.090899] [DEBUG] [VALIDATOR ] RFMZ: Validating primary data. [2025-09-17T21:22:45.220984] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-05. [2025-09-17T21:22:45.482061] [DEBUG] [VALIDATOR ] RFMZ: All expected trading days are present. [2025-09-17T21:22:45.482153] [DEBUG] [VALIDATOR ] RFMZ: Primary data validation passed. [2025-09-17T21:22:45.482607] [INFO ] [MAIN ] RFMZ: Fetched primary data is valid. [2025-09-17T21:22:45.482686] [DEBUG] [LOCAL ] RFMZ: Saving primary data. [2025-09-17T21:22:45.483208] [DEBUG] [LOCAL ] RFMZ: Trimmed 12867 records to 8509 (keeping 200 days of data) [2025-09-17T21:22:45.538033] [DEBUG] [LOCAL ] RFMZ: Primary data saved (8509 records). [2025-09-17T21:22:45.538176] [INFO ] [MAIN ] RFMZ: Full history saved. [2025-09-17T21:22:45.538282] [INFO ] [MAIN ] Update Progress: 1796/2371 symbols completed. RFMZ took 28.6s. Estimated remaining: 1h 24m 7s. Rate: 6.8 symbols/min [2025-09-17T21:22:45.664828] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T21:22:45.715881] [INFO ] [MAIN ] RGT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:22:45.720624] [DEBUG] [LOCAL ] RGT: Loaded 2886 existing records from primary storage. [2025-09-17T21:22:45.720734] [INFO ] [MAIN ] RGT: Loaded 2886 existing records. [2025-09-17T21:22:45.896352] [WARN ] [MAIN ] RGT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:22:45.896626] [INFO ] [MAIN ] RGT: Wiping existing primary data before full refresh. [2025-09-17T21:22:45.896697] [INFO ] [LOCAL ] RGT: Starting deletion of primary data. [2025-09-17T21:22:45.896911] [DEBUG] [LOCAL ] RGT: Deleted primary data file. [2025-09-17T21:22:45.896967] [INFO ] [MAIN ] RGT: Starting full primary refresh. [2025-09-17T21:22:46.020985] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-04. [2025-09-17T21:22:46.257772] [INFO ] [REMOTE ] RGT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:22:46.824133] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-06. [2025-09-17T21:22:46.826186] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-04 (0.81 seconds). [2025-09-17T21:22:47.512898] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T21:22:47.615762] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-08. [2025-09-17T21:22:48.415773] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-11. [2025-09-17T21:22:48.925392] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T21:22:48.945273] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T21:22:49.215768] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-05. [2025-09-17T21:22:50.015842] [INFO ] [REMOTE ] RGA: Fetching primary data for 2025-09. [2025-09-17T21:22:50.194541] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T21:22:50.815830] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-06. [2025-09-17T21:22:51.114480] [INFO ] [REMOTE ] RGA: Incremental fetch complete for 2025-09 (1.10 seconds). [2025-09-17T21:22:51.118656] [INFO ] [REMOTE ] RGA: Full fetch complete (45535 records). [2025-09-17T21:22:51.118742] [DEBUG] [VALIDATOR ] RGA: Validating primary data. [2025-09-17T21:22:51.496267] [DEBUG] [VALIDATOR ] RGA: All expected trading days are present. [2025-09-17T21:22:51.496391] [DEBUG] [VALIDATOR ] RGA: Primary data validation passed. [2025-09-17T21:22:51.497178] [INFO ] [MAIN ] RGA: Fetched primary data is valid. [2025-09-17T21:22:51.497225] [DEBUG] [LOCAL ] RGA: Saving primary data. [2025-09-17T21:22:51.498284] [DEBUG] [LOCAL ] RGA: Trimmed 45535 records to 30186 (keeping 200 days of data) [2025-09-17T21:22:51.617226] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-07. [2025-09-17T21:22:51.714136] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T21:22:51.714261] [DEBUG] [LOCAL ] RGA: Primary data saved (30186 records). [2025-09-17T21:22:51.714513] [INFO ] [MAIN ] RGA: Full history saved. [2025-09-17T21:22:51.719024] [INFO ] [MAIN ] Update Progress: 1797/2371 symbols completed. RGA took 33.5s. Estimated remaining: 1h 23m 57s. Rate: 6.8 symbols/min [2025-09-17T21:22:52.079224] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T21:22:52.415787] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-08. [2025-09-17T21:22:53.163084] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T21:22:53.215730] [INFO ] [REMOTE ] RFM: Fetching primary data for 2025-09. [2025-09-17T21:22:53.625920] [INFO ] [REMOTE ] RFM: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T21:22:53.627211] [INFO ] [REMOTE ] RFM: Full fetch complete (5970 records). [2025-09-17T21:22:53.627279] [DEBUG] [VALIDATOR ] RFM: Validating primary data. [2025-09-17T21:22:54.022775] [DEBUG] [VALIDATOR ] RFM: All expected trading days are present. [2025-09-17T21:22:54.022499] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-07. [2025-09-17T21:22:54.022963] [DEBUG] [VALIDATOR ] RFM: Primary data validation passed. [2025-09-17T21:22:54.024182] [INFO ] [MAIN ] RFM: Fetched primary data is valid. [2025-09-17T21:22:54.024247] [DEBUG] [LOCAL ] RFM: Saving primary data. [2025-09-17T21:22:54.024681] [DEBUG] [LOCAL ] RFM: Trimmed 5970 records to 4008 (keeping 200 days of data) [2025-09-17T21:22:54.051073] [DEBUG] [LOCAL ] RFM: Primary data saved (4008 records). [2025-09-17T21:22:54.051158] [INFO ] [MAIN ] RFM: Full history saved. [2025-09-17T21:22:54.051251] [INFO ] [MAIN ] Update Progress: 1798/2371 symbols completed. RFM took 38.8s. Estimated remaining: 1h 23m 46s. Rate: 6.8 symbols/min [2025-09-17T21:22:54.815745] [INFO ] [REMOTE ] RGT: Fetching primary data for 2024-12. [2025-09-17T21:22:54.953840] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T21:22:55.368966] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T21:22:55.615772] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-08. [2025-09-17T21:22:56.415746] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-01. [2025-09-17T21:22:56.445124] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T21:22:56.779161] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T21:22:57.215822] [INFO ] [REMOTE ] RGR: Fetching primary data for 2025-09. [2025-09-17T21:22:57.982748] [INFO ] [REMOTE ] RGR: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T21:22:57.988227] [INFO ] [REMOTE ] RGR: Full fetch complete (28173 records). [2025-09-17T21:22:57.988412] [DEBUG] [VALIDATOR ] RGR: Validating primary data. [2025-09-17T21:22:58.024609] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-02. [2025-09-17T21:22:58.451692] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T21:22:58.518682] [DEBUG] [VALIDATOR ] RGR: All expected trading days are present. [2025-09-17T21:22:58.518769] [DEBUG] [VALIDATOR ] RGR: Primary data validation passed. [2025-09-17T21:22:58.519489] [INFO ] [MAIN ] RGR: Fetched primary data is valid. [2025-09-17T21:22:58.519530] [DEBUG] [LOCAL ] RGR: Saving primary data. [2025-09-17T21:22:58.520433] [DEBUG] [LOCAL ] RGR: Trimmed 28173 records to 20073 (keeping 200 days of data) [2025-09-17T21:22:58.697788] [DEBUG] [LOCAL ] RGR: Primary data saved (20073 records). [2025-09-17T21:22:58.698024] [INFO ] [MAIN ] RGR: Full history saved. [2025-09-17T21:22:58.698119] [INFO ] [MAIN ] Update Progress: 1799/2371 symbols completed. RGR took 22.4s. Estimated remaining: 1h 23m 36s. Rate: 6.8 symbols/min [2025-09-17T21:22:58.815800] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-03. [2025-09-17T21:23:04.573190] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-03 (5.76 seconds). [2025-09-17T21:23:04.574723] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-04. [2025-09-17T21:23:05.135134] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T21:23:05.136600] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-05. [2025-09-17T21:23:05.804574] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T21:23:05.805973] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-06. [2025-09-17T21:23:06.341436] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T21:23:06.342972] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-07. [2025-09-17T21:23:06.905511] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T21:23:06.907000] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-08. [2025-09-17T21:23:07.237313] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-17T21:23:07.238472] [INFO ] [REMOTE ] RGT: Fetching primary data for 2025-09. [2025-09-17T21:23:07.590837] [INFO ] [REMOTE ] RGT: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T21:23:07.591770] [INFO ] [REMOTE ] RGT: Full fetch complete (4106 records). [2025-09-17T21:23:07.591838] [DEBUG] [VALIDATOR ] RGT: Validating primary data. [2025-09-17T21:23:07.973173] [DEBUG] [VALIDATOR ] RGT: All expected trading days are present. [2025-09-17T21:23:07.973269] [DEBUG] [VALIDATOR ] RGT: Primary data validation passed. [2025-09-17T21:23:07.973409] [INFO ] [MAIN ] RGT: Fetched primary data is valid. [2025-09-17T21:23:07.973447] [DEBUG] [LOCAL ] RGT: Saving primary data. [2025-09-17T21:23:07.973872] [DEBUG] [LOCAL ] RGT: Trimmed 4106 records to 2902 (keeping 200 days of data) [2025-09-17T21:23:07.991538] [DEBUG] [LOCAL ] RGT: Primary data saved (2902 records). [2025-09-17T21:23:07.991631] [INFO ] [MAIN ] RGT: Full history saved. [2025-09-17T21:23:07.991729] [INFO ] [MAIN ] Update Progress: 1800/2371 symbols completed. RGT took 22.5s. Estimated remaining: 1h 23m 28s. Rate: 6.8 symbols/min [2025-09-17T21:23:08.622544] [INFO ] [MAIN ] RHP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:23:08.691598] [INFO ] [MAIN ] RIG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:23:08.646884] [INFO ] [MAIN ] RH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:23:08.726372] [INFO ] [MAIN ] RHI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:23:08.808957] [DEBUG] [LOCAL ] RHP: Loaded 41774 existing records from primary storage. [2025-09-17T21:23:08.809364] [INFO ] [MAIN ] RHP: Loaded 41774 existing records. [2025-09-17T21:23:08.965393] [DEBUG] [LOCAL ] RIG: Loaded 53673 existing records from primary storage. [2025-09-17T21:23:08.966472] [DEBUG] [LOCAL ] RHI: Loaded 49251 existing records from primary storage. [2025-09-17T21:23:08.972158] [INFO ] [MAIN ] RIG: Loaded 53673 existing records. [2025-09-17T21:23:08.983388] [DEBUG] [LOCAL ] RH: Loaded 47702 existing records from primary storage. [2025-09-17T21:23:09.010331] [INFO ] [MAIN ] RHI: Loaded 49251 existing records. [2025-09-17T21:23:09.137023] [INFO ] [MAIN ] RH: Loaded 47702 existing records. [2025-09-17T21:23:09.188632] [WARN ] [MAIN ] RHP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:23:09.235136] [INFO ] [MAIN ] RHP: Wiping existing primary data before full refresh. [2025-09-17T21:23:09.284308] [INFO ] [LOCAL ] RHP: Starting deletion of primary data. [2025-09-17T21:23:09.318069] [DEBUG] [LOCAL ] RHP: Deleted primary data file. [2025-09-17T21:23:09.333567] [INFO ] [MAIN ] RHP: Starting full primary refresh. [2025-09-17T21:23:09.559361] [WARN ] [MAIN ] RIG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:23:09.695462] [WARN ] [MAIN ] RH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:23:09.727242] [WARN ] [MAIN ] RHI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:23:09.737847] [INFO ] [MAIN ] RIG: Wiping existing primary data before full refresh. [2025-09-17T21:23:09.757147] [INFO ] [MAIN ] RH: Wiping existing primary data before full refresh. [2025-09-17T21:23:09.762229] [INFO ] [LOCAL ] RH: Starting deletion of primary data. [2025-09-17T21:23:09.762480] [INFO ] [LOCAL ] RIG: Starting deletion of primary data. [2025-09-17T21:23:09.767776] [INFO ] [MAIN ] RHI: Wiping existing primary data before full refresh. [2025-09-17T21:23:09.792145] [DEBUG] [LOCAL ] RH: Deleted primary data file. [2025-09-17T21:23:09.777016] [INFO ] [LOCAL ] RHI: Starting deletion of primary data. [2025-09-17T21:23:09.792272] [DEBUG] [LOCAL ] RIG: Deleted primary data file. [2025-09-17T21:23:09.794164] [INFO ] [MAIN ] RIG: Starting full primary refresh. [2025-09-17T21:23:09.800859] [DEBUG] [LOCAL ] RHI: Deleted primary data file. [2025-09-17T21:23:09.794107] [INFO ] [MAIN ] RH: Starting full primary refresh. [2025-09-17T21:23:09.812461] [INFO ] [MAIN ] RHI: Starting full primary refresh. [2025-09-17T21:23:10.544032] [INFO ] [REMOTE ] RHP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:23:10.603519] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-11. [2025-09-17T21:23:10.951759] [INFO ] [REMOTE ] RH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:23:10.992020] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-11. [2025-09-17T21:23:11.045557] [INFO ] [REMOTE ] RIG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:23:11.051117] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-11. [2025-09-17T21:23:11.079485] [INFO ] [REMOTE ] RHI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:23:11.079757] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-11. [2025-09-17T21:23:12.175598] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T21:23:12.182660] [INFO ] [REMOTE ] RHP: Fetching primary data for 2024-12. [2025-09-17T21:23:12.484624] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T21:23:12.493125] [INFO ] [REMOTE ] RH: Fetching primary data for 2024-12. [2025-09-17T21:23:12.547246] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T21:23:12.556086] [INFO ] [REMOTE ] RHI: Fetching primary data for 2024-12. [2025-09-17T21:23:12.587713] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T21:23:12.598320] [INFO ] [REMOTE ] RIG: Fetching primary data for 2024-12. [2025-09-17T21:23:13.701661] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T21:23:13.711313] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-01. [2025-09-17T21:23:13.734496] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T21:23:13.742776] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-01. [2025-09-17T21:23:14.047203] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T21:23:14.055980] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-01. [2025-09-17T21:23:14.356887] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T21:23:14.368299] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-01. [2025-09-17T21:23:15.064253] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T21:23:15.075011] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-02. [2025-09-17T21:23:15.281893] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T21:23:15.289218] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-02. [2025-09-17T21:23:15.708013] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T21:23:15.716311] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-02. [2025-09-17T21:23:15.947716] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T21:23:16.415838] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-02. [2025-09-17T21:23:16.632927] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T21:23:16.714447] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T21:23:16.776729] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T21:23:17.215769] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-03. [2025-09-17T21:23:17.846529] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T21:23:18.015782] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-03. [2025-09-17T21:23:18.819314] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-03. [2025-09-17T21:23:18.824977] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T21:23:19.356606] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T21:23:19.615793] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-03. [2025-09-17T21:23:20.415767] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-04. [2025-09-17T21:23:20.705107] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T21:23:21.215766] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-04. [2025-09-17T21:23:21.262122] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T21:23:21.921934] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T21:23:22.015820] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-04. [2025-09-17T21:23:22.815755] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-04. [2025-09-17T21:23:23.380595] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-04 (2.16 seconds). [2025-09-17T21:23:23.479315] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T21:23:23.615796] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-05. [2025-09-17T21:23:24.354335] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T21:23:24.415746] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-05. [2025-09-17T21:23:25.215860] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-05. [2025-09-17T21:23:25.248743] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T21:23:26.015754] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-06. [2025-09-17T21:23:26.084876] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T21:23:26.815820] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-06. [2025-09-17T21:23:26.980808] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T21:23:27.193749] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T21:23:27.615804] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-06. [2025-09-17T21:23:28.370454] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T21:23:28.415731] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-07. [2025-09-17T21:23:29.153272] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T21:23:29.215776] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-07. [2025-09-17T21:23:30.024406] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-07. [2025-09-17T21:23:30.031349] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T21:23:30.815867] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-08. [2025-09-17T21:23:30.873933] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T21:23:31.429814] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T21:23:31.615786] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-08. [2025-09-17T21:23:32.273176] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T21:23:32.415836] [INFO ] [REMOTE ] RIG: Fetching primary data for 2025-09. [2025-09-17T21:23:33.215845] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-05. [2025-09-17T21:23:33.389120] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T21:23:33.905562] [INFO ] [REMOTE ] RIG: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T21:23:33.912928] [INFO ] [REMOTE ] RIG: Full fetch complete (77564 records). [2025-09-17T21:23:33.913118] [DEBUG] [VALIDATOR ] RIG: Validating primary data. [2025-09-17T21:23:34.020862] [INFO ] [REMOTE ] RH: Fetching primary data for 2025-09. [2025-09-17T21:23:34.311044] [DEBUG] [VALIDATOR ] RIG: All expected trading days are present. [2025-09-17T21:23:34.311144] [DEBUG] [VALIDATOR ] RIG: Primary data validation passed. [2025-09-17T21:23:34.312396] [INFO ] [MAIN ] RIG: Fetched primary data is valid. [2025-09-17T21:23:34.312478] [DEBUG] [LOCAL ] RIG: Saving primary data. [2025-09-17T21:23:34.314356] [DEBUG] [LOCAL ] RIG: Trimmed 77564 records to 53673 (keeping 200 days of data) [2025-09-17T21:23:34.640687] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T21:23:34.668858] [DEBUG] [LOCAL ] RIG: Primary data saved (53673 records). [2025-09-17T21:23:34.669000] [INFO ] [MAIN ] RIG: Full history saved. [2025-09-17T21:23:34.669136] [INFO ] [MAIN ] Update Progress: 1801/2371 symbols completed. RIG took 26.7s. Estimated remaining: 1h 23m 25s. Rate: 6.8 symbols/min [2025-09-17T21:23:34.820913] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-06. [2025-09-17T21:23:34.845409] [INFO ] [MAIN ] RIO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:23:34.900161] [DEBUG] [LOCAL ] RIO: Loaded 53404 existing records from primary storage. [2025-09-17T21:23:34.900320] [INFO ] [MAIN ] RIO: Loaded 53404 existing records. [2025-09-17T21:23:35.078851] [WARN ] [MAIN ] RIO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:23:35.079078] [INFO ] [MAIN ] RIO: Wiping existing primary data before full refresh. [2025-09-17T21:23:35.079122] [INFO ] [LOCAL ] RIO: Starting deletion of primary data. [2025-09-17T21:23:35.080369] [DEBUG] [LOCAL ] RIO: Deleted primary data file. [2025-09-17T21:23:35.080433] [INFO ] [MAIN ] RIO: Starting full primary refresh. [2025-09-17T21:23:35.439525] [INFO ] [REMOTE ] RIO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:23:35.465935] [INFO ] [REMOTE ] RH: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T21:23:35.473450] [INFO ] [REMOTE ] RH: Full fetch complete (65250 records). [2025-09-17T21:23:35.473571] [DEBUG] [VALIDATOR ] RH: Validating primary data. [2025-09-17T21:23:35.624512] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-08. [2025-09-17T21:23:35.870134] [DEBUG] [VALIDATOR ] RH: All expected trading days are present. [2025-09-17T21:23:35.870246] [DEBUG] [VALIDATOR ] RH: Primary data validation passed. [2025-09-17T21:23:35.871587] [INFO ] [MAIN ] RH: Fetched primary data is valid. [2025-09-17T21:23:35.871635] [DEBUG] [LOCAL ] RH: Saving primary data. [2025-09-17T21:23:35.874847] [DEBUG] [LOCAL ] RH: Trimmed 65250 records to 47769 (keeping 200 days of data) [2025-09-17T21:23:36.189856] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T21:23:36.211403] [DEBUG] [LOCAL ] RH: Primary data saved (47769 records). [2025-09-17T21:23:36.211531] [INFO ] [MAIN ] RH: Full history saved. [2025-09-17T21:23:36.211688] [INFO ] [MAIN ] Update Progress: 1802/2371 symbols completed. RH took 28.2s. Estimated remaining: 1h 23m 14s. Rate: 6.8 symbols/min [2025-09-17T21:23:36.381045] [INFO ] [MAIN ] RITM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:23:36.415783] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-11. [2025-09-17T21:23:36.437159] [DEBUG] [LOCAL ] RITM: Loaded 52792 existing records from primary storage. [2025-09-17T21:23:36.437302] [INFO ] [MAIN ] RITM: Loaded 52792 existing records. [2025-09-17T21:23:36.619072] [WARN ] [MAIN ] RITM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:23:36.619342] [INFO ] [MAIN ] RITM: Wiping existing primary data before full refresh. [2025-09-17T21:23:36.619390] [INFO ] [LOCAL ] RITM: Starting deletion of primary data. [2025-09-17T21:23:36.620614] [DEBUG] [LOCAL ] RITM: Deleted primary data file. [2025-09-17T21:23:36.620683] [INFO ] [MAIN ] RITM: Starting full primary refresh. [2025-09-17T21:23:36.992689] [INFO ] [REMOTE ] RITM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:23:37.215797] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-11. [2025-09-17T21:23:37.324097] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T21:23:38.015878] [INFO ] [REMOTE ] RHI: Fetching primary data for 2025-09. [2025-09-17T21:23:38.157540] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T21:23:38.597778] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T21:23:38.815786] [INFO ] [REMOTE ] RITM: Fetching primary data for 2024-12. [2025-09-17T21:23:39.403098] [INFO ] [REMOTE ] RHI: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T21:23:39.409599] [INFO ] [REMOTE ] RHI: Full fetch complete (69240 records). [2025-09-17T21:23:39.409799] [DEBUG] [VALIDATOR ] RHI: Validating primary data. [2025-09-17T21:23:39.622988] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-07. [2025-09-17T21:23:39.809636] [DEBUG] [VALIDATOR ] RHI: All expected trading days are present. [2025-09-17T21:23:39.809737] [DEBUG] [VALIDATOR ] RHI: Primary data validation passed. [2025-09-17T21:23:39.810842] [INFO ] [MAIN ] RHI: Fetched primary data is valid. [2025-09-17T21:23:39.810898] [DEBUG] [LOCAL ] RHI: Saving primary data. [2025-09-17T21:23:39.812291] [DEBUG] [LOCAL ] RHI: Trimmed 69240 records to 49264 (keeping 200 days of data) [2025-09-17T21:23:40.167250] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T21:23:40.186515] [DEBUG] [LOCAL ] RHI: Primary data saved (49264 records). [2025-09-17T21:23:40.186663] [INFO ] [MAIN ] RHI: Full history saved. [2025-09-17T21:23:40.186759] [INFO ] [MAIN ] Update Progress: 1803/2371 symbols completed. RHI took 32.2s. Estimated remaining: 1h 23m 3s. Rate: 6.8 symbols/min [2025-09-17T21:23:40.358053] [INFO ] [MAIN ] RIV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:23:40.372354] [DEBUG] [LOCAL ] RIV: Loaded 11587 existing records from primary storage. [2025-09-17T21:23:40.372521] [INFO ] [MAIN ] RIV: Loaded 11587 existing records. [2025-09-17T21:23:40.427985] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-01. [2025-09-17T21:23:40.557542] [WARN ] [MAIN ] RIV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:23:40.557895] [INFO ] [MAIN ] RIV: Wiping existing primary data before full refresh. [2025-09-17T21:23:40.557951] [INFO ] [LOCAL ] RIV: Starting deletion of primary data. [2025-09-17T21:23:40.558429] [DEBUG] [LOCAL ] RIV: Deleted primary data file. [2025-09-17T21:23:40.558483] [INFO ] [MAIN ] RIV: Starting full primary refresh. [2025-09-17T21:23:40.927671] [INFO ] [REMOTE ] RIV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:23:41.208756] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T21:23:41.216637] [INFO ] [REMOTE ] RIO: Fetching primary data for 2024-12. [2025-09-17T21:23:42.015861] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-11. [2025-09-17T21:23:42.441249] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T21:23:42.490704] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T21:23:42.815809] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-08. [2025-09-17T21:23:43.299147] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T21:23:43.615781] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-02. [2025-09-17T21:23:44.075618] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T21:23:44.415783] [INFO ] [REMOTE ] RIV: Fetching primary data for 2024-12. [2025-09-17T21:23:44.993243] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2024-12 (0.58 seconds). [2025-09-17T21:23:45.215781] [INFO ] [REMOTE ] RHP: Fetching primary data for 2025-09. [2025-09-17T21:23:45.412940] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T21:23:46.015791] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-03. [2025-09-17T21:23:46.448990] [INFO ] [REMOTE ] RHP: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T21:23:46.455360] [INFO ] [REMOTE ] RHP: Full fetch complete (57710 records). [2025-09-17T21:23:46.455488] [DEBUG] [VALIDATOR ] RHP: Validating primary data. [2025-09-17T21:23:46.821174] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-01. [2025-09-17T21:23:46.875052] [DEBUG] [VALIDATOR ] RHP: All expected trading days are present. [2025-09-17T21:23:46.875133] [DEBUG] [VALIDATOR ] RHP: Primary data validation passed. [2025-09-17T21:23:46.876046] [INFO ] [MAIN ] RHP: Fetched primary data is valid. [2025-09-17T21:23:46.876091] [DEBUG] [LOCAL ] RHP: Saving primary data. [2025-09-17T21:23:46.877312] [DEBUG] [LOCAL ] RHP: Trimmed 57710 records to 41777 (keeping 200 days of data) [2025-09-17T21:23:47.144139] [DEBUG] [LOCAL ] RHP: Primary data saved (41777 records). [2025-09-17T21:23:47.144278] [INFO ] [MAIN ] RHP: Full history saved. [2025-09-17T21:23:47.144388] [INFO ] [MAIN ] Update Progress: 1804/2371 symbols completed. RHP took 39.1s. Estimated remaining: 1h 22m 54s. Rate: 6.8 symbols/min [2025-09-17T21:23:47.312815] [INFO ] [MAIN ] RJF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:23:47.359633] [DEBUG] [LOCAL ] RJF: Loaded 47105 existing records from primary storage. [2025-09-17T21:23:47.359801] [INFO ] [MAIN ] RJF: Loaded 47105 existing records. [2025-09-17T21:23:47.537911] [WARN ] [MAIN ] RJF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:23:47.538164] [INFO ] [MAIN ] RJF: Wiping existing primary data before full refresh. [2025-09-17T21:23:47.538209] [INFO ] [LOCAL ] RJF: Starting deletion of primary data. [2025-09-17T21:23:47.539278] [DEBUG] [LOCAL ] RJF: Deleted primary data file. [2025-09-17T21:23:47.539330] [INFO ] [MAIN ] RJF: Starting full primary refresh. [2025-09-17T21:23:47.616402] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-01. [2025-09-17T21:23:47.846998] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T21:23:47.937762] [INFO ] [REMOTE ] RJF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:23:47.969538] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T21:23:48.415806] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-11. [2025-09-17T21:23:49.215777] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-02. [2025-09-17T21:23:49.386955] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T21:23:50.015705] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-02. [2025-09-17T21:23:50.065632] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T21:23:50.104211] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-02 (0.89 seconds). [2025-09-17T21:23:50.815829] [INFO ] [REMOTE ] RJF: Fetching primary data for 2024-12. [2025-09-17T21:23:51.615692] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-03. [2025-09-17T21:23:51.659625] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T21:23:52.386223] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T21:23:52.415723] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-01. [2025-09-17T21:23:52.576619] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T21:23:53.215796] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-04. [2025-09-17T21:23:54.020849] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-03. [2025-09-17T21:23:54.035665] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T21:23:54.070292] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T21:23:54.815790] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-04. [2025-09-17T21:23:55.545179] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T21:23:55.615754] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-04. [2025-09-17T21:23:56.349555] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T21:23:56.415733] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-05. [2025-09-17T21:23:57.215722] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-05. [2025-09-17T21:23:57.257527] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T21:23:57.966238] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T21:23:58.015775] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-05. [2025-09-17T21:23:58.331873] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T21:23:58.815811] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-06. [2025-09-17T21:23:59.615714] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-06. [2025-09-17T21:23:59.691003] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T21:24:00.100709] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T21:24:00.415805] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-07. [2025-09-17T21:24:00.563051] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T21:24:01.069574] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T21:24:01.215782] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-08. [2025-09-17T21:24:02.015782] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-06. [2025-09-17T21:24:02.236759] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T21:24:02.815770] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-07. [2025-09-17T21:24:03.615781] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-02. [2025-09-17T21:24:04.415791] [INFO ] [REMOTE ] RIV: Fetching primary data for 2025-09. [2025-09-17T21:24:05.225591] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-06 (3.21 seconds). [2025-09-17T21:24:05.236621] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-07. [2025-09-17T21:24:05.275727] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-17T21:24:05.505406] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-02 (1.89 seconds). [2025-09-17T21:24:05.525123] [INFO ] [REMOTE ] RIV: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T21:24:05.529020] [INFO ] [REMOTE ] RIV: Full fetch complete (17065 records). [2025-09-17T21:24:05.529106] [DEBUG] [VALIDATOR ] RIV: Validating primary data. [2025-09-17T21:24:05.894940] [DEBUG] [VALIDATOR ] RIV: All expected trading days are present. [2025-09-17T21:24:05.895037] [DEBUG] [VALIDATOR ] RIV: Primary data validation passed. [2025-09-17T21:24:05.895459] [INFO ] [MAIN ] RIV: Fetched primary data is valid. [2025-09-17T21:24:05.895499] [DEBUG] [LOCAL ] RIV: Saving primary data. [2025-09-17T21:24:05.896087] [DEBUG] [LOCAL ] RIV: Trimmed 17065 records to 11640 (keeping 200 days of data) [2025-09-17T21:24:05.970743] [DEBUG] [LOCAL ] RIV: Primary data saved (11640 records). [2025-09-17T21:24:05.970913] [INFO ] [MAIN ] RIV: Full history saved. [2025-09-17T21:24:05.971006] [INFO ] [MAIN ] Update Progress: 1805/2371 symbols completed. RIV took 25.8s. Estimated remaining: 1h 22m 48s. Rate: 6.8 symbols/min [2025-09-17T21:24:06.025374] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-08. [2025-09-17T21:24:06.141305] [INFO ] [MAIN ] RKT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:24:06.198041] [DEBUG] [LOCAL ] RKT: Loaded 53720 existing records from primary storage. [2025-09-17T21:24:06.198197] [INFO ] [MAIN ] RKT: Loaded 53720 existing records. [2025-09-17T21:24:06.375619] [WARN ] [MAIN ] RKT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:24:06.375884] [INFO ] [MAIN ] RKT: Wiping existing primary data before full refresh. [2025-09-17T21:24:06.375950] [INFO ] [LOCAL ] RKT: Starting deletion of primary data. [2025-09-17T21:24:06.377115] [DEBUG] [LOCAL ] RKT: Deleted primary data file. [2025-09-17T21:24:06.377178] [INFO ] [MAIN ] RKT: Starting full primary refresh. [2025-09-17T21:24:06.744327] [INFO ] [REMOTE ] RKT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:24:06.815761] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-11. [2025-09-17T21:24:07.589179] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-07 (2.35 seconds). [2025-09-17T21:24:07.615727] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-08. [2025-09-17T21:24:07.723229] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T21:24:08.092834] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T21:24:08.415790] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-03. [2025-09-17T21:24:09.092402] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T21:24:09.215789] [INFO ] [REMOTE ] RIO: Fetching primary data for 2025-09. [2025-09-17T21:24:09.764766] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T21:24:10.015791] [INFO ] [REMOTE ] RKT: Fetching primary data for 2024-12. [2025-09-17T21:24:10.576107] [INFO ] [REMOTE ] RIO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T21:24:10.583610] [INFO ] [REMOTE ] RIO: Full fetch complete (77200 records). [2025-09-17T21:24:10.583784] [DEBUG] [VALIDATOR ] RIO: Validating primary data. [2025-09-17T21:24:10.820992] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-04. [2025-09-17T21:24:10.986934] [DEBUG] [VALIDATOR ] RIO: All expected trading days are present. [2025-09-17T21:24:10.987024] [DEBUG] [VALIDATOR ] RIO: Primary data validation passed. [2025-09-17T21:24:10.988103] [INFO ] [MAIN ] RIO: Fetched primary data is valid. [2025-09-17T21:24:10.988150] [DEBUG] [LOCAL ] RIO: Saving primary data. [2025-09-17T21:24:10.989813] [DEBUG] [LOCAL ] RIO: Trimmed 77200 records to 53402 (keeping 200 days of data) [2025-09-17T21:24:11.321279] [DEBUG] [LOCAL ] RIO: Primary data saved (53402 records). [2025-09-17T21:24:11.321425] [INFO ] [MAIN ] RIO: Full history saved. [2025-09-17T21:24:11.322623] [INFO ] [MAIN ] Update Progress: 1806/2371 symbols completed. RIO took 36.7s. Estimated remaining: 1h 22m 38s. Rate: 6.8 symbols/min [2025-09-17T21:24:11.494924] [INFO ] [MAIN ] RL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:24:11.537613] [DEBUG] [LOCAL ] RL: Loaded 42063 existing records from primary storage. [2025-09-17T21:24:11.537772] [INFO ] [MAIN ] RL: Loaded 42063 existing records. [2025-09-17T21:24:11.627824] [INFO ] [REMOTE ] RITM: Fetching primary data for 2025-09. [2025-09-17T21:24:11.720813] [WARN ] [MAIN ] RL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:24:11.721040] [INFO ] [MAIN ] RL: Wiping existing primary data before full refresh. [2025-09-17T21:24:11.721084] [INFO ] [LOCAL ] RL: Starting deletion of primary data. [2025-09-17T21:24:11.721851] [DEBUG] [LOCAL ] RL: Deleted primary data file. [2025-09-17T21:24:11.721900] [INFO ] [MAIN ] RL: Starting full primary refresh. [2025-09-17T21:24:12.108936] [INFO ] [REMOTE ] RL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:24:12.140145] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2024-12 (2.12 seconds). [2025-09-17T21:24:12.415832] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-01. [2025-09-17T21:24:12.536757] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T21:24:13.145914] [INFO ] [REMOTE ] RITM: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T21:24:13.154815] [INFO ] [REMOTE ] RITM: Full fetch complete (76435 records). [2025-09-17T21:24:13.155002] [DEBUG] [VALIDATOR ] RITM: Validating primary data. [2025-09-17T21:24:13.222079] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-11. [2025-09-17T21:24:13.575427] [DEBUG] [VALIDATOR ] RITM: All expected trading days are present. [2025-09-17T21:24:13.575536] [DEBUG] [VALIDATOR ] RITM: Primary data validation passed. [2025-09-17T21:24:13.576998] [INFO ] [MAIN ] RITM: Fetched primary data is valid. [2025-09-17T21:24:13.577063] [DEBUG] [LOCAL ] RITM: Saving primary data. [2025-09-17T21:24:13.579188] [DEBUG] [LOCAL ] RITM: Trimmed 76435 records to 52801 (keeping 200 days of data) [2025-09-17T21:24:13.933535] [DEBUG] [LOCAL ] RITM: Primary data saved (52801 records). [2025-09-17T21:24:13.933766] [INFO ] [MAIN ] RITM: Full history saved. [2025-09-17T21:24:13.933940] [INFO ] [MAIN ] Update Progress: 1807/2371 symbols completed. RITM took 37.7s. Estimated remaining: 1h 22m 28s. Rate: 6.8 symbols/min [2025-09-17T21:24:14.028513] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-05. [2025-09-17T21:24:14.115312] [INFO ] [MAIN ] RLI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:24:14.152855] [DEBUG] [LOCAL ] RLI: Loaded 33303 existing records from primary storage. [2025-09-17T21:24:14.153103] [INFO ] [MAIN ] RLI: Loaded 33303 existing records. [2025-09-17T21:24:14.338368] [WARN ] [MAIN ] RLI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:24:14.338753] [INFO ] [MAIN ] RLI: Wiping existing primary data before full refresh. [2025-09-17T21:24:14.338805] [INFO ] [LOCAL ] RLI: Starting deletion of primary data. [2025-09-17T21:24:14.339598] [DEBUG] [LOCAL ] RLI: Deleted primary data file. [2025-09-17T21:24:14.339681] [INFO ] [MAIN ] RLI: Starting full primary refresh. [2025-09-17T21:24:14.725060] [INFO ] [REMOTE ] RLI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:24:14.815884] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-11. [2025-09-17T21:24:15.687902] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-11 (2.47 seconds). [2025-09-17T21:24:15.696478] [INFO ] [REMOTE ] RL: Fetching primary data for 2024-12. [2025-09-17T21:24:15.933231] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-01 (3.52 seconds). [2025-09-17T21:24:16.140204] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T21:24:16.415778] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-02. [2025-09-17T21:24:16.526983] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-05 (2.50 seconds). [2025-09-17T21:24:17.146925] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T21:24:17.215728] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-01. [2025-09-17T21:24:17.803476] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T21:24:18.015808] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-06. [2025-09-17T21:24:18.785373] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T21:24:18.815747] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-02. [2025-09-17T21:24:19.352268] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T21:24:19.615829] [INFO ] [REMOTE ] RLI: Fetching primary data for 2024-12. [2025-09-17T21:24:20.021354] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T21:24:20.415793] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-03. [2025-09-17T21:24:20.592931] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T21:24:21.215778] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-01. [2025-09-17T21:24:22.015807] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-03. [2025-09-17T21:24:22.309166] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T21:24:22.429185] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T21:24:22.815789] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-02. [2025-09-17T21:24:23.615809] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-04. [2025-09-17T21:24:23.822745] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T21:24:24.172327] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T21:24:24.415794] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-03. [2025-09-17T21:24:25.215771] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-07. [2025-09-17T21:24:25.382318] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T21:24:25.732565] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T21:24:26.015780] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-04. [2025-09-17T21:24:26.506078] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T21:24:26.815797] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-05. [2025-09-17T21:24:27.615764] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-04. [2025-09-17T21:24:27.685053] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T21:24:28.415729] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-05. [2025-09-17T21:24:28.579567] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T21:24:28.877895] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T21:24:29.215797] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-06. [2025-09-17T21:24:29.695950] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T21:24:30.015798] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-05. [2025-09-17T21:24:30.815798] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-08. [2025-09-17T21:24:31.104198] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T21:24:31.615766] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-06. [2025-09-17T21:24:31.739043] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T21:24:32.068610] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T21:24:32.415783] [INFO ] [REMOTE ] RJF: Fetching primary data for 2025-09. [2025-09-17T21:24:32.474854] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T21:24:33.215773] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-07. [2025-09-17T21:24:34.000364] [INFO ] [REMOTE ] RJF: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T21:24:34.006328] [INFO ] [REMOTE ] RJF: Full fetch complete (68199 records). [2025-09-17T21:24:34.006436] [DEBUG] [VALIDATOR ] RJF: Validating primary data. [2025-09-17T21:24:34.020885] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-06. [2025-09-17T21:24:34.402057] [DEBUG] [VALIDATOR ] RJF: All expected trading days are present. [2025-09-17T21:24:34.402144] [DEBUG] [VALIDATOR ] RJF: Primary data validation passed. [2025-09-17T21:24:34.403118] [INFO ] [MAIN ] RJF: Fetched primary data is valid. [2025-09-17T21:24:34.403164] [DEBUG] [LOCAL ] RJF: Saving primary data. [2025-09-17T21:24:34.404540] [DEBUG] [LOCAL ] RJF: Trimmed 68199 records to 47176 (keeping 200 days of data) [2025-09-17T21:24:34.667631] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T21:24:34.732552] [DEBUG] [LOCAL ] RJF: Primary data saved (47176 records). [2025-09-17T21:24:34.732702] [INFO ] [MAIN ] RJF: Full history saved. [2025-09-17T21:24:34.732790] [INFO ] [MAIN ] Update Progress: 1808/2371 symbols completed. RJF took 47.6s. Estimated remaining: 1h 22m 23s. Rate: 6.8 symbols/min [2025-09-17T21:24:34.821708] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-07. [2025-09-17T21:24:34.900375] [INFO ] [MAIN ] RLJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:24:34.942580] [DEBUG] [LOCAL ] RLJ: Loaded 48337 existing records from primary storage. [2025-09-17T21:24:34.942734] [INFO ] [MAIN ] RLJ: Loaded 48337 existing records. [2025-09-17T21:24:35.129389] [WARN ] [MAIN ] RLJ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:24:35.129629] [INFO ] [MAIN ] RLJ: Wiping existing primary data before full refresh. [2025-09-17T21:24:35.129692] [INFO ] [LOCAL ] RLJ: Starting deletion of primary data. [2025-09-17T21:24:35.130561] [DEBUG] [LOCAL ] RLJ: Deleted primary data file. [2025-09-17T21:24:35.130610] [INFO ] [MAIN ] RLJ: Starting full primary refresh. [2025-09-17T21:24:35.495416] [INFO ] [REMOTE ] RLJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:24:35.518176] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T21:24:35.615760] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-11. [2025-09-17T21:24:36.415772] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-08. [2025-09-17T21:24:37.215752] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-07. [2025-09-17T21:24:37.323087] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-17T21:24:37.353983] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T21:24:37.388716] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T21:24:38.015788] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2024-12. [2025-09-17T21:24:38.416962] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T21:24:38.815783] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-08. [2025-09-17T21:24:39.442040] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T21:24:39.615783] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-08. [2025-09-17T21:24:40.234753] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T21:24:40.415844] [INFO ] [REMOTE ] RL: Fetching primary data for 2025-09. [2025-09-17T21:24:40.720717] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T21:24:41.215786] [INFO ] [REMOTE ] RKT: Fetching primary data for 2025-09. [2025-09-17T21:24:41.468986] [INFO ] [REMOTE ] RL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T21:24:41.474085] [INFO ] [REMOTE ] RL: Full fetch complete (60249 records). [2025-09-17T21:24:41.474189] [DEBUG] [VALIDATOR ] RL: Validating primary data. [2025-09-17T21:24:41.860936] [DEBUG] [VALIDATOR ] RL: All expected trading days are present. [2025-09-17T21:24:41.861020] [DEBUG] [VALIDATOR ] RL: Primary data validation passed. [2025-09-17T21:24:41.862018] [INFO ] [MAIN ] RL: Fetched primary data is valid. [2025-09-17T21:24:41.862065] [DEBUG] [LOCAL ] RL: Saving primary data. [2025-09-17T21:24:41.863324] [DEBUG] [LOCAL ] RL: Trimmed 60249 records to 42059 (keeping 200 days of data) [2025-09-17T21:24:42.050922] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-01. [2025-09-17T21:24:42.136770] [DEBUG] [LOCAL ] RL: Primary data saved (42059 records). [2025-09-17T21:24:42.136900] [INFO ] [MAIN ] RL: Full history saved. [2025-09-17T21:24:42.137833] [INFO ] [MAIN ] Update Progress: 1809/2371 symbols completed. RL took 30.8s. Estimated remaining: 1h 22m 13s. Rate: 6.8 symbols/min [2025-09-17T21:24:42.313564] [INFO ] [MAIN ] RLTY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:24:42.327174] [DEBUG] [LOCAL ] RLTY: Loaded 11238 existing records from primary storage. [2025-09-17T21:24:42.327305] [INFO ] [MAIN ] RLTY: Loaded 11238 existing records. [2025-09-17T21:24:42.518247] [WARN ] [MAIN ] RLTY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:24:42.518505] [INFO ] [MAIN ] RLTY: Wiping existing primary data before full refresh. [2025-09-17T21:24:42.518552] [INFO ] [LOCAL ] RLTY: Starting deletion of primary data. [2025-09-17T21:24:42.518898] [DEBUG] [LOCAL ] RLTY: Deleted primary data file. [2025-09-17T21:24:42.518947] [INFO ] [MAIN ] RLTY: Starting full primary refresh. [2025-09-17T21:24:42.835406] [INFO ] [REMOTE ] RLI: Fetching primary data for 2025-09. [2025-09-17T21:24:43.055785] [INFO ] [REMOTE ] RLTY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:24:43.063212] [INFO ] [REMOTE ] RKT: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T21:24:43.075425] [INFO ] [REMOTE ] RKT: Full fetch complete (77160 records). [2025-09-17T21:24:43.075686] [DEBUG] [VALIDATOR ] RKT: Validating primary data. [2025-09-17T21:24:43.591322] [DEBUG] [VALIDATOR ] RKT: All expected trading days are present. [2025-09-17T21:24:43.591535] [DEBUG] [VALIDATOR ] RKT: Primary data validation passed. [2025-09-17T21:24:43.593007] [INFO ] [MAIN ] RKT: Fetched primary data is valid. [2025-09-17T21:24:43.593188] [DEBUG] [LOCAL ] RKT: Saving primary data. [2025-09-17T21:24:43.627544] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-11. [2025-09-17T21:24:43.614477] [DEBUG] [LOCAL ] RKT: Trimmed 77160 records to 53720 (keeping 200 days of data) [2025-09-17T21:24:43.636480] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T21:24:43.765381] [INFO ] [REMOTE ] RLI: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T21:24:43.772721] [INFO ] [REMOTE ] RLI: Full fetch complete (45548 records). [2025-09-17T21:24:43.773336] [DEBUG] [VALIDATOR ] RLI: Validating primary data. [2025-09-17T21:24:44.233468] [DEBUG] [VALIDATOR ] RLI: All expected trading days are present. [2025-09-17T21:24:44.242540] [DEBUG] [VALIDATOR ] RLI: Primary data validation passed. [2025-09-17T21:24:44.243456] [INFO ] [MAIN ] RLI: Fetched primary data is valid. [2025-09-17T21:24:44.268913] [DEBUG] [LOCAL ] RLI: Saving primary data. [2025-09-17T21:24:44.272625] [DEBUG] [LOCAL ] RLI: Trimmed 45548 records to 33294 (keeping 200 days of data) [2025-09-17T21:24:44.450245] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-02. [2025-09-17T21:24:44.515741] [DEBUG] [LOCAL ] RKT: Primary data saved (53720 records). [2025-09-17T21:24:44.516573] [INFO ] [MAIN ] RKT: Full history saved. [2025-09-17T21:24:44.517154] [INFO ] [MAIN ] Update Progress: 1810/2371 symbols completed. RKT took 38.5s. Estimated remaining: 1h 22m 3s. Rate: 6.8 symbols/min [2025-09-17T21:24:44.776793] [INFO ] [MAIN ] RLX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:24:44.792351] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T21:24:44.811439] [DEBUG] [LOCAL ] RLI: Primary data saved (33294 records). [2025-09-17T21:24:44.811636] [INFO ] [MAIN ] RLI: Full history saved. [2025-09-17T21:24:44.811768] [INFO ] [MAIN ] Update Progress: 1811/2371 symbols completed. RLI took 30.9s. Estimated remaining: 1h 21m 51s. Rate: 6.8 symbols/min [2025-09-17T21:24:45.022402] [INFO ] [MAIN ] RM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:24:45.024752] [DEBUG] [LOCAL ] RLX: Loaded 48166 existing records from primary storage. [2025-09-17T21:24:45.024977] [INFO ] [MAIN ] RLX: Loaded 48166 existing records. [2025-09-17T21:24:45.136140] [DEBUG] [LOCAL ] RM: Loaded 7725 existing records from primary storage. [2025-09-17T21:24:45.151585] [INFO ] [MAIN ] RM: Loaded 7725 existing records. [2025-09-17T21:24:45.222505] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2024-12. [2025-09-17T21:24:45.303603] [WARN ] [MAIN ] RLX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:24:45.316346] [INFO ] [MAIN ] RLX: Wiping existing primary data before full refresh. [2025-09-17T21:24:45.316448] [INFO ] [LOCAL ] RLX: Starting deletion of primary data. [2025-09-17T21:24:45.322506] [DEBUG] [LOCAL ] RLX: Deleted primary data file. [2025-09-17T21:24:45.327753] [INFO ] [MAIN ] RLX: Starting full primary refresh. [2025-09-17T21:24:45.519094] [WARN ] [MAIN ] RM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:24:45.534720] [INFO ] [MAIN ] RM: Wiping existing primary data before full refresh. [2025-09-17T21:24:45.562970] [INFO ] [LOCAL ] RM: Starting deletion of primary data. [2025-09-17T21:24:45.601412] [DEBUG] [LOCAL ] RM: Deleted primary data file. [2025-09-17T21:24:45.626311] [INFO ] [MAIN ] RM: Starting full primary refresh. [2025-09-17T21:24:45.928689] [INFO ] [REMOTE ] RLX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:24:46.028348] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-11. [2025-09-17T21:24:46.187711] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T21:24:46.187084] [INFO ] [REMOTE ] RM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:24:46.220220] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T21:24:46.815779] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-11. [2025-09-17T21:24:47.343493] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T21:24:47.413135] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T21:24:47.615782] [INFO ] [REMOTE ] RLX: Fetching primary data for 2024-12. [2025-09-17T21:24:48.415806] [INFO ] [REMOTE ] RM: Fetching primary data for 2024-12. [2025-09-17T21:24:48.895502] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T21:24:49.165368] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T21:24:49.215768] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-01. [2025-09-17T21:24:49.995584] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T21:24:50.015737] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-02. [2025-09-17T21:24:50.763085] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T21:24:50.815754] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-03. [2025-09-17T21:24:51.615802] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-01. [2025-09-17T21:24:52.415759] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-01. [2025-09-17T21:24:52.510238] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T21:24:52.627828] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T21:24:53.215793] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-03. [2025-09-17T21:24:53.860182] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T21:24:53.861141] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T21:24:54.015753] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-04. [2025-09-17T21:24:54.815797] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-04. [2025-09-17T21:24:54.985450] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T21:24:55.615783] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-02. [2025-09-17T21:24:55.986855] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T21:24:56.415814] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-05. [2025-09-17T21:24:57.215696] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-05. [2025-09-17T21:24:57.297422] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T21:24:58.015792] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-02. [2025-09-17T21:24:58.098797] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-05 (0.88 seconds). [2025-09-17T21:24:58.207544] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T21:24:58.752100] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T21:24:58.815775] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-03. [2025-09-17T21:24:59.615778] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-03. [2025-09-17T21:24:59.663873] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T21:25:00.415774] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-04. [2025-09-17T21:25:01.185196] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T21:25:01.215726] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-04. [2025-09-17T21:25:01.381697] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T21:25:02.015793] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-05. [2025-09-17T21:25:02.584056] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T21:25:02.815804] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-06. [2025-09-17T21:25:02.895959] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T21:25:03.615774] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-05. [2025-09-17T21:25:04.041590] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T21:25:04.415973] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-06. [2025-09-17T21:25:04.953673] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T21:25:05.144375] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T21:25:05.215765] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-06. [2025-09-17T21:25:06.015788] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-07. [2025-09-17T21:25:06.373316] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T21:25:06.506728] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T21:25:06.815778] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-07. [2025-09-17T21:25:07.615776] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-08. [2025-09-17T21:25:08.173317] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-08 (0.56 seconds). [2025-09-17T21:25:08.399607] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T21:25:08.415673] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-08. [2025-09-17T21:25:09.215803] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-07. [2025-09-17T21:25:10.015776] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-06. [2025-09-17T21:25:10.074752] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T21:25:10.542578] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T21:25:10.815784] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-07. [2025-09-17T21:25:10.905074] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T21:25:11.306929] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-07 (0.49 seconds). [2025-09-17T21:25:11.615789] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-08. [2025-09-17T21:25:12.215795] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-08 (0.60 seconds). [2025-09-17T21:25:12.415773] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-08. [2025-09-17T21:25:13.215781] [INFO ] [REMOTE ] RLJ: Fetching primary data for 2025-09. [2025-09-17T21:25:14.015817] [INFO ] [REMOTE ] RM: Fetching primary data for 2025-09. [2025-09-17T21:25:14.051819] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T21:25:14.285905] [INFO ] [REMOTE ] RLJ: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T21:25:14.292947] [INFO ] [REMOTE ] RLJ: Full fetch complete (69112 records). [2025-09-17T21:25:14.293086] [DEBUG] [VALIDATOR ] RLJ: Validating primary data. [2025-09-17T21:25:14.622726] [INFO ] [REMOTE ] RM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T21:25:14.664916] [INFO ] [REMOTE ] RM: Full fetch complete (11409 records). [2025-09-17T21:25:14.676332] [DEBUG] [VALIDATOR ] RM: Validating primary data. [2025-09-17T21:25:14.763741] [DEBUG] [VALIDATOR ] RLJ: All expected trading days are present. [2025-09-17T21:25:14.792363] [DEBUG] [VALIDATOR ] RLJ: Primary data validation passed. [2025-09-17T21:25:14.805014] [INFO ] [MAIN ] RLJ: Fetched primary data is valid. [2025-09-17T21:25:14.816930] [INFO ] [REMOTE ] RLX: Fetching primary data for 2025-09. [2025-09-17T21:25:14.817220] [DEBUG] [LOCAL ] RLJ: Saving primary data. [2025-09-17T21:25:14.891709] [DEBUG] [LOCAL ] RLJ: Trimmed 69112 records to 48328 (keeping 200 days of data) [2025-09-17T21:25:15.208372] [DEBUG] [VALIDATOR ] RM: All expected trading days are present. [2025-09-17T21:25:15.209026] [DEBUG] [VALIDATOR ] RM: Primary data validation passed. [2025-09-17T21:25:15.209693] [INFO ] [MAIN ] RM: Fetched primary data is valid. [2025-09-17T21:25:15.210020] [DEBUG] [LOCAL ] RM: Saving primary data. [2025-09-17T21:25:15.212996] [DEBUG] [LOCAL ] RM: Trimmed 11409 records to 7740 (keeping 200 days of data) [2025-09-17T21:25:15.269028] [DEBUG] [LOCAL ] RM: Primary data saved (7740 records). [2025-09-17T21:25:15.270585] [INFO ] [MAIN ] RM: Full history saved. [2025-09-17T21:25:15.271287] [INFO ] [MAIN ] Update Progress: 1812/2371 symbols completed. RM took 30.5s. Estimated remaining: 1h 21m 49s. Rate: 6.8 symbols/min [2025-09-17T21:25:15.509740] [INFO ] [MAIN ] RMAX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:25:15.576001] [DEBUG] [LOCAL ] RMAX: Loaded 21710 existing records from primary storage. [2025-09-17T21:25:15.577001] [INFO ] [MAIN ] RMAX: Loaded 21710 existing records. [2025-09-17T21:25:15.622528] [INFO ] [REMOTE ] RLTY: Fetching primary data for 2025-09. [2025-09-17T21:25:15.780941] [WARN ] [MAIN ] RMAX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:25:15.783623] [INFO ] [MAIN ] RMAX: Wiping existing primary data before full refresh. [2025-09-17T21:25:15.784108] [INFO ] [LOCAL ] RMAX: Starting deletion of primary data. [2025-09-17T21:25:15.785497] [DEBUG] [LOCAL ] RMAX: Deleted primary data file. [2025-09-17T21:25:15.786219] [INFO ] [MAIN ] RMAX: Starting full primary refresh. [2025-09-17T21:25:16.194236] [DEBUG] [LOCAL ] RLJ: Primary data saved (48328 records). [2025-09-17T21:25:16.222572] [INFO ] [MAIN ] RLJ: Full history saved. [2025-09-17T21:25:16.222836] [INFO ] [MAIN ] Update Progress: 1813/2371 symbols completed. RLJ took 41.5s. Estimated remaining: 1h 21m 38s. Rate: 6.8 symbols/min [2025-09-17T21:25:16.222197] [INFO ] [REMOTE ] RMAX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:25:16.396937] [INFO ] [MAIN ] RMD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:25:16.397245] [DEBUG] [LOCAL ] RMD: No existing data file found in primary storage. [2025-09-17T21:25:16.397388] [WARN ] [MAIN ] RMD: No existing data found, performing full refresh instead. [2025-09-17T21:25:16.402390] [INFO ] [REMOTE ] RLTY: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T21:25:16.402637] [INFO ] [MAIN ] RMD: Wiping existing primary data before full refresh. [2025-09-17T21:25:16.404842] [INFO ] [LOCAL ] RMD: Starting deletion of primary data. [2025-09-17T21:25:16.419550] [DEBUG] [LOCAL ] RMD: No primary data file found to delete. [2025-09-17T21:25:16.419700] [INFO ] [MAIN ] RMD: Starting full primary refresh. [2025-09-17T21:25:16.410719] [INFO ] [REMOTE ] RLTY: Full fetch complete (18154 records). [2025-09-17T21:25:16.419457] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-11. [2025-09-17T21:25:16.419898] [DEBUG] [VALIDATOR ] RLTY: Validating primary data. [2025-09-17T21:25:16.566719] [INFO ] [REMOTE ] RLX: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T21:25:16.643545] [INFO ] [REMOTE ] RLX: Full fetch complete (70207 records). [2025-09-17T21:25:16.674616] [DEBUG] [VALIDATOR ] RLX: Validating primary data. [2025-09-17T21:25:17.454814] [INFO ] [REMOTE ] RMD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:25:17.460389] [DEBUG] [VALIDATOR ] RLTY: All expected trading days are present. [2025-09-17T21:25:17.471054] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-11. [2025-09-17T21:25:17.487684] [DEBUG] [VALIDATOR ] RLTY: Primary data validation passed. [2025-09-17T21:25:17.493022] [INFO ] [MAIN ] RLTY: Fetched primary data is valid. [2025-09-17T21:25:17.493121] [DEBUG] [LOCAL ] RLTY: Saving primary data. [2025-09-17T21:25:17.520025] [DEBUG] [LOCAL ] RLTY: Trimmed 18154 records to 11236 (keeping 200 days of data) [2025-09-17T21:25:17.621528] [DEBUG] [VALIDATOR ] RLX: All expected trading days are present. [2025-09-17T21:25:17.621635] [DEBUG] [VALIDATOR ] RLX: Primary data validation passed. [2025-09-17T21:25:17.622375] [INFO ] [MAIN ] RLX: Fetched primary data is valid. [2025-09-17T21:25:17.628204] [DEBUG] [LOCAL ] RLX: Saving primary data. [2025-09-17T21:25:17.660574] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T21:25:17.660738] [DEBUG] [LOCAL ] RLX: Trimmed 70207 records to 48154 (keeping 200 days of data) [2025-09-17T21:25:17.918577] [DEBUG] [LOCAL ] RLTY: Primary data saved (11236 records). [2025-09-17T21:25:17.918763] [INFO ] [MAIN ] RLTY: Full history saved. [2025-09-17T21:25:17.918874] [INFO ] [MAIN ] Update Progress: 1814/2371 symbols completed. RLTY took 35.8s. Estimated remaining: 1h 21m 27s. Rate: 6.8 symbols/min [2025-09-17T21:25:18.020912] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2024-12. [2025-09-17T21:25:18.150538] [INFO ] [MAIN ] RMI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:25:18.155450] [DEBUG] [LOCAL ] RLX: Primary data saved (48154 records). [2025-09-17T21:25:18.155691] [INFO ] [MAIN ] RLX: Full history saved. [2025-09-17T21:25:18.155790] [INFO ] [MAIN ] Update Progress: 1815/2371 symbols completed. RLX took 33.6s. Estimated remaining: 1h 21m 16s. Rate: 6.8 symbols/min [2025-09-17T21:25:18.264973] [DEBUG] [LOCAL ] RMI: Loaded 4502 existing records from primary storage. [2025-09-17T21:25:18.270621] [INFO ] [MAIN ] RMI: Loaded 4502 existing records. [2025-09-17T21:25:18.436270] [INFO ] [MAIN ] RMM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:25:18.522930] [DEBUG] [LOCAL ] RMM: Loaded 10113 existing records from primary storage. [2025-09-17T21:25:18.523155] [INFO ] [MAIN ] RMM: Loaded 10113 existing records. [2025-09-17T21:25:18.518338] [WARN ] [MAIN ] RMI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:25:18.603617] [INFO ] [MAIN ] RMI: Wiping existing primary data before full refresh. [2025-09-17T21:25:18.622492] [INFO ] [LOCAL ] RMI: Starting deletion of primary data. [2025-09-17T21:25:18.625270] [DEBUG] [LOCAL ] RMI: Deleted primary data file. [2025-09-17T21:25:18.630709] [INFO ] [MAIN ] RMI: Starting full primary refresh. [2025-09-17T21:25:18.805304] [WARN ] [MAIN ] RMM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:25:18.814625] [INFO ] [MAIN ] RMM: Wiping existing primary data before full refresh. [2025-09-17T21:25:18.835281] [INFO ] [LOCAL ] RMM: Starting deletion of primary data. [2025-09-17T21:25:18.885310] [DEBUG] [LOCAL ] RMM: Deleted primary data file. [2025-09-17T21:25:18.924473] [INFO ] [MAIN ] RMM: Starting full primary refresh. [2025-09-17T21:25:18.989057] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T21:25:19.051285] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-01. [2025-09-17T21:25:19.204475] [INFO ] [REMOTE ] RMI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:25:19.448637] [INFO ] [REMOTE ] RMM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:25:19.475497] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T21:25:19.615824] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-11. [2025-09-17T21:25:20.217998] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T21:25:20.415771] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-02. [2025-09-17T21:25:20.626089] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T21:25:21.114936] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T21:25:21.215770] [INFO ] [REMOTE ] RMD: Fetching primary data for 2024-12. [2025-09-17T21:25:22.015802] [INFO ] [REMOTE ] RMM: Fetching primary data for 2024-12. [2025-09-17T21:25:22.658892] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T21:25:22.674343] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T21:25:22.815781] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-01. [2025-09-17T21:25:23.558201] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T21:25:23.615752] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-02. [2025-09-17T21:25:24.378458] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T21:25:24.415783] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-11. [2025-09-17T21:25:25.053511] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T21:25:25.215805] [INFO ] [REMOTE ] RMI: Fetching primary data for 2024-12. [2025-09-17T21:25:25.753728] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2024-12 (0.54 seconds). [2025-09-17T21:25:26.015784] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-01. [2025-09-17T21:25:26.357236] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-01 (0.34 seconds). [2025-09-17T21:25:26.815814] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-01. [2025-09-17T21:25:27.615784] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-03. [2025-09-17T21:25:28.415751] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-03. [2025-09-17T21:25:28.455240] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T21:25:28.486785] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T21:25:29.164061] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T21:25:29.215823] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-04. [2025-09-17T21:25:30.015804] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-02. [2025-09-17T21:25:30.314140] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T21:25:30.478526] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T21:25:30.815776] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-02. [2025-09-17T21:25:31.615814] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-04. [2025-09-17T21:25:32.288233] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-04 (0.67 seconds). [2025-09-17T21:25:32.415742] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-05. [2025-09-17T21:25:32.660267] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T21:25:33.175457] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T21:25:33.215795] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-03. [2025-09-17T21:25:33.587003] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T21:25:34.015814] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-03. [2025-09-17T21:25:34.815812] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-06. [2025-09-17T21:25:35.298068] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T21:25:35.575895] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T21:25:35.615747] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-07. [2025-09-17T21:25:36.236672] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T21:25:36.415788] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-08. [2025-09-17T21:25:37.082484] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T21:25:37.215797] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-05. [2025-09-17T21:25:38.015801] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-04. [2025-09-17T21:25:38.239726] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T21:25:38.359362] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T21:25:38.815793] [INFO ] [REMOTE ] RMM: Fetching primary data for 2025-09. [2025-09-17T21:25:39.376806] [INFO ] [REMOTE ] RMM: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T21:25:39.379174] [INFO ] [REMOTE ] RMM: Full fetch complete (14740 records). [2025-09-17T21:25:39.379243] [DEBUG] [VALIDATOR ] RMM: Validating primary data. [2025-09-17T21:25:39.619669] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-04. [2025-09-17T21:25:39.757239] [DEBUG] [VALIDATOR ] RMM: All expected trading days are present. [2025-09-17T21:25:39.757316] [DEBUG] [VALIDATOR ] RMM: Primary data validation passed. [2025-09-17T21:25:39.757637] [INFO ] [MAIN ] RMM: Fetched primary data is valid. [2025-09-17T21:25:39.757694] [DEBUG] [LOCAL ] RMM: Saving primary data. [2025-09-17T21:25:39.758199] [DEBUG] [LOCAL ] RMM: Trimmed 14740 records to 10213 (keeping 200 days of data) [2025-09-17T21:25:39.821586] [DEBUG] [LOCAL ] RMM: Primary data saved (10213 records). [2025-09-17T21:25:39.821745] [INFO ] [MAIN ] RMM: Full history saved. [2025-09-17T21:25:39.821848] [INFO ] [MAIN ] Update Progress: 1816/2371 symbols completed. RMM took 21.7s. Estimated remaining: 1h 21m 11s. Rate: 6.8 symbols/min [2025-09-17T21:25:40.015164] [INFO ] [MAIN ] RMMZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:25:40.022413] [DEBUG] [LOCAL ] RMMZ: Loaded 4796 existing records from primary storage. [2025-09-17T21:25:40.022537] [INFO ] [MAIN ] RMMZ: Loaded 4796 existing records. [2025-09-17T21:25:40.207350] [WARN ] [MAIN ] RMMZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:25:40.207699] [INFO ] [MAIN ] RMMZ: Wiping existing primary data before full refresh. [2025-09-17T21:25:40.207764] [INFO ] [LOCAL ] RMMZ: Starting deletion of primary data. [2025-09-17T21:25:40.208184] [DEBUG] [LOCAL ] RMMZ: Deleted primary data file. [2025-09-17T21:25:40.208244] [INFO ] [MAIN ] RMMZ: Starting full primary refresh. [2025-09-17T21:25:40.425174] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-05. [2025-09-17T21:25:40.565513] [INFO ] [REMOTE ] RMMZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:25:41.040855] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T21:25:41.061119] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T21:25:41.215792] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-05. [2025-09-17T21:25:42.015777] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-06. [2025-09-17T21:25:42.797445] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T21:25:42.815779] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-06. [2025-09-17T21:25:43.030995] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T21:25:43.188736] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T21:25:43.615806] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-07. [2025-09-17T21:25:44.196755] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T21:25:44.415781] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-08. [2025-09-17T21:25:44.863808] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T21:25:45.215771] [INFO ] [REMOTE ] RMI: Fetching primary data for 2025-09. [2025-09-17T21:25:45.846823] [INFO ] [REMOTE ] RMI: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T21:25:45.848292] [INFO ] [REMOTE ] RMI: Full fetch complete (6293 records). [2025-09-17T21:25:45.848364] [DEBUG] [VALIDATOR ] RMI: Validating primary data. [2025-09-17T21:25:46.016199] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-11. [2025-09-17T21:25:46.237548] [DEBUG] [VALIDATOR ] RMI: All expected trading days are present. [2025-09-17T21:25:46.237628] [DEBUG] [VALIDATOR ] RMI: Primary data validation passed. [2025-09-17T21:25:46.237839] [INFO ] [MAIN ] RMI: Fetched primary data is valid. [2025-09-17T21:25:46.237881] [DEBUG] [LOCAL ] RMI: Saving primary data. [2025-09-17T21:25:46.238291] [DEBUG] [LOCAL ] RMI: Trimmed 6293 records to 4573 (keeping 200 days of data) [2025-09-17T21:25:46.267719] [DEBUG] [LOCAL ] RMI: Primary data saved (4573 records). [2025-09-17T21:25:46.267836] [INFO ] [MAIN ] RMI: Full history saved. [2025-09-17T21:25:46.267920] [INFO ] [MAIN ] Update Progress: 1817/2371 symbols completed. RMI took 28.3s. Estimated remaining: 1h 21m 1s. Rate: 6.8 symbols/min [2025-09-17T21:25:46.455028] [INFO ] [MAIN ] RMT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:25:46.472983] [DEBUG] [LOCAL ] RMT: Loaded 17795 existing records from primary storage. [2025-09-17T21:25:46.473133] [INFO ] [MAIN ] RMT: Loaded 17795 existing records. [2025-09-17T21:25:46.590226] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-11 (0.57 seconds). [2025-09-17T21:25:46.666946] [WARN ] [MAIN ] RMT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:25:46.667199] [INFO ] [MAIN ] RMT: Wiping existing primary data before full refresh. [2025-09-17T21:25:46.667251] [INFO ] [LOCAL ] RMT: Starting deletion of primary data. [2025-09-17T21:25:46.667798] [DEBUG] [LOCAL ] RMT: Deleted primary data file. [2025-09-17T21:25:46.667855] [INFO ] [MAIN ] RMT: Starting full primary refresh. [2025-09-17T21:25:46.825443] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-07. [2025-09-17T21:25:47.025482] [INFO ] [REMOTE ] RMT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:25:47.615988] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-06. [2025-09-17T21:25:47.704082] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T21:25:48.415838] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-08. [2025-09-17T21:25:49.071856] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-06 (1.46 seconds). [2025-09-17T21:25:49.215815] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-11. [2025-09-17T21:25:49.359598] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-08 (0.94 seconds). [2025-09-17T21:25:49.894914] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T21:25:50.015824] [INFO ] [REMOTE ] RMT: Fetching primary data for 2024-12. [2025-09-17T21:25:50.815806] [INFO ] [REMOTE ] RMAX: Fetching primary data for 2025-09. [2025-09-17T21:25:51.085383] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T21:25:51.615851] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-07. [2025-09-17T21:25:51.808752] [INFO ] [REMOTE ] RMAX: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T21:25:51.811871] [INFO ] [REMOTE ] RMAX: Full fetch complete (29524 records). [2025-09-17T21:25:51.812010] [DEBUG] [VALIDATOR ] RMAX: Validating primary data. [2025-09-17T21:25:52.213940] [DEBUG] [VALIDATOR ] RMAX: All expected trading days are present. [2025-09-17T21:25:52.214023] [DEBUG] [VALIDATOR ] RMAX: Primary data validation passed. [2025-09-17T21:25:52.214711] [INFO ] [MAIN ] RMAX: Fetched primary data is valid. [2025-09-17T21:25:52.214782] [DEBUG] [LOCAL ] RMAX: Saving primary data. [2025-09-17T21:25:52.216404] [DEBUG] [LOCAL ] RMAX: Trimmed 29524 records to 21780 (keeping 200 days of data) [2025-09-17T21:25:52.343032] [DEBUG] [LOCAL ] RMAX: Primary data saved (21780 records). [2025-09-17T21:25:52.343170] [INFO ] [MAIN ] RMAX: Full history saved. [2025-09-17T21:25:52.343301] [INFO ] [MAIN ] Update Progress: 1818/2371 symbols completed. RMAX took 37.1s. Estimated remaining: 1h 20m 52s. Rate: 6.8 symbols/min [2025-09-17T21:25:52.420984] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-01. [2025-09-17T21:25:52.531209] [INFO ] [MAIN ] RNG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:25:52.576284] [DEBUG] [LOCAL ] RNG: Loaded 48288 existing records from primary storage. [2025-09-17T21:25:52.576435] [INFO ] [MAIN ] RNG: Loaded 48288 existing records. [2025-09-17T21:25:52.761747] [WARN ] [MAIN ] RNG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:25:52.762009] [INFO ] [MAIN ] RNG: Wiping existing primary data before full refresh. [2025-09-17T21:25:52.762064] [INFO ] [LOCAL ] RNG: Starting deletion of primary data. [2025-09-17T21:25:52.763168] [DEBUG] [LOCAL ] RNG: Deleted primary data file. [2025-09-17T21:25:52.763239] [INFO ] [MAIN ] RNG: Starting full primary refresh. [2025-09-17T21:25:53.148239] [INFO ] [REMOTE ] RNG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:25:53.186167] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T21:25:53.220895] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2024-12. [2025-09-17T21:25:53.233146] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T21:25:53.951969] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T21:25:54.015748] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-01. [2025-09-17T21:25:54.471594] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-01 (0.46 seconds). [2025-09-17T21:25:54.815786] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-02. [2025-09-17T21:25:55.463765] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T21:25:55.615852] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-03. [2025-09-17T21:25:56.343090] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T21:25:56.415854] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-08. [2025-09-17T21:25:57.215796] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-04. [2025-09-17T21:25:58.015802] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-11. [2025-09-17T21:25:58.165159] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T21:25:58.204490] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T21:25:58.815788] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-05. [2025-09-17T21:25:59.412202] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T21:25:59.511801] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-05 (0.70 seconds). [2025-09-17T21:25:59.615774] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-06. [2025-09-17T21:26:00.415811] [INFO ] [REMOTE ] RNG: Fetching primary data for 2024-12. [2025-09-17T21:26:00.558630] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-06 (0.94 seconds). [2025-09-17T21:26:01.215790] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-02. [2025-09-17T21:26:01.678915] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T21:26:01.682119] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T21:26:02.015783] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-03. [2025-09-17T21:26:02.406992] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-03 (0.39 seconds). [2025-09-17T21:26:02.815786] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-07. [2025-09-17T21:26:03.615787] [INFO ] [REMOTE ] RMD: Fetching primary data for 2025-09. [2025-09-17T21:26:03.899675] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T21:26:04.415778] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-08. [2025-09-17T21:26:05.129977] [INFO ] [REMOTE ] RMD: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T21:26:05.136123] [INFO ] [REMOTE ] RMD: Full fetch complete (60770 records). [2025-09-17T21:26:05.136259] [DEBUG] [VALIDATOR ] RMD: Validating primary data. [2025-09-17T21:26:05.220840] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-04. [2025-09-17T21:26:05.484266] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T21:26:05.559509] [DEBUG] [VALIDATOR ] RMD: All expected trading days are present. [2025-09-17T21:26:05.559599] [DEBUG] [VALIDATOR ] RMD: Primary data validation passed. [2025-09-17T21:26:05.560684] [INFO ] [MAIN ] RMD: Fetched primary data is valid. [2025-09-17T21:26:05.560735] [DEBUG] [LOCAL ] RMD: Saving primary data. [2025-09-17T21:26:05.562144] [DEBUG] [LOCAL ] RMD: Trimmed 60770 records to 42597 (keeping 200 days of data) [2025-09-17T21:26:05.794521] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T21:26:05.849255] [DEBUG] [LOCAL ] RMD: Primary data saved (42597 records). [2025-09-17T21:26:05.849390] [INFO ] [MAIN ] RMD: Full history saved. [2025-09-17T21:26:05.849475] [INFO ] [MAIN ] Update Progress: 1819/2371 symbols completed. RMD took 49.6s. Estimated remaining: 1h 20m 44s. Rate: 6.8 symbols/min [2025-09-17T21:26:06.022808] [INFO ] [REMOTE ] RMT: Fetching primary data for 2025-09. [2025-09-17T21:26:06.026385] [INFO ] [MAIN ] RNGR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:26:06.050978] [DEBUG] [LOCAL ] RNGR: Loaded 20302 existing records from primary storage. [2025-09-17T21:26:06.051144] [INFO ] [MAIN ] RNGR: Loaded 20302 existing records. [2025-09-17T21:26:06.228595] [WARN ] [MAIN ] RNGR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:26:06.228869] [INFO ] [MAIN ] RNGR: Wiping existing primary data before full refresh. [2025-09-17T21:26:06.228913] [INFO ] [LOCAL ] RNGR: Starting deletion of primary data. [2025-09-17T21:26:06.229513] [DEBUG] [LOCAL ] RNGR: Deleted primary data file. [2025-09-17T21:26:06.229569] [INFO ] [MAIN ] RNGR: Starting full primary refresh. [2025-09-17T21:26:06.588600] [INFO ] [REMOTE ] RNGR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:26:06.815772] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-05. [2025-09-17T21:26:07.050679] [INFO ] [REMOTE ] RMT: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T21:26:07.053044] [INFO ] [REMOTE ] RMT: Full fetch complete (25541 records). [2025-09-17T21:26:07.053128] [DEBUG] [VALIDATOR ] RMT: Validating primary data. [2025-09-17T21:26:07.427146] [DEBUG] [VALIDATOR ] RMT: All expected trading days are present. [2025-09-17T21:26:07.427022] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T21:26:07.427339] [DEBUG] [VALIDATOR ] RMT: Primary data validation passed. [2025-09-17T21:26:07.429594] [INFO ] [MAIN ] RMT: Fetched primary data is valid. [2025-09-17T21:26:07.429993] [DEBUG] [LOCAL ] RMT: Saving primary data. [2025-09-17T21:26:07.430802] [DEBUG] [LOCAL ] RMT: Trimmed 25541 records to 17815 (keeping 200 days of data) [2025-09-17T21:26:07.540653] [DEBUG] [LOCAL ] RMT: Primary data saved (17815 records). [2025-09-17T21:26:07.540799] [INFO ] [MAIN ] RMT: Full history saved. [2025-09-17T21:26:07.540904] [INFO ] [MAIN ] Update Progress: 1820/2371 symbols completed. RMT took 21.3s. Estimated remaining: 1h 20m 34s. Rate: 6.8 symbols/min [2025-09-17T21:26:07.620865] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-11. [2025-09-17T21:26:07.711621] [INFO ] [MAIN ] RNP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:26:07.728150] [DEBUG] [LOCAL ] RNP: Loaded 15896 existing records from primary storage. [2025-09-17T21:26:07.728298] [INFO ] [MAIN ] RNP: Loaded 15896 existing records. [2025-09-17T21:26:07.908236] [WARN ] [MAIN ] RNP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:26:07.908616] [INFO ] [MAIN ] RNP: Wiping existing primary data before full refresh. [2025-09-17T21:26:07.908680] [INFO ] [LOCAL ] RNP: Starting deletion of primary data. [2025-09-17T21:26:07.909212] [DEBUG] [LOCAL ] RNP: Deleted primary data file. [2025-09-17T21:26:07.909255] [INFO ] [MAIN ] RNP: Starting full primary refresh. [2025-09-17T21:26:08.263582] [INFO ] [REMOTE ] RNP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:26:08.415771] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-01. [2025-09-17T21:26:08.714734] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T21:26:09.215763] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-06. [2025-09-17T21:26:09.623338] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T21:26:09.679208] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T21:26:10.015768] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-11. [2025-09-17T21:26:10.815799] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-02. [2025-09-17T21:26:10.840904] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T21:26:11.615794] [INFO ] [REMOTE ] RNP: Fetching primary data for 2024-12. [2025-09-17T21:26:12.065185] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T21:26:12.415759] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-03. [2025-09-17T21:26:12.643029] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T21:26:13.215989] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2024-12. [2025-09-17T21:26:13.867445] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2024-12 (0.65 seconds). [2025-09-17T21:26:14.015768] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-01. [2025-09-17T21:26:14.208393] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T21:26:14.815764] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-01. [2025-09-17T21:26:15.078094] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T21:26:15.615761] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-02. [2025-09-17T21:26:15.850359] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T21:26:16.266223] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T21:26:16.415779] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-04. [2025-09-17T21:26:17.215803] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-03. [2025-09-17T21:26:18.015781] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-07. [2025-09-17T21:26:18.154710] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T21:26:18.403330] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T21:26:18.523376] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T21:26:18.815834] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-04. [2025-09-17T21:26:19.615767] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-02. [2025-09-17T21:26:19.839290] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T21:26:20.260853] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T21:26:20.415779] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-05. [2025-09-17T21:26:21.215830] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-03. [2025-09-17T21:26:21.831803] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T21:26:21.870321] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T21:26:22.015793] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-04. [2025-09-17T21:26:22.815805] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-05. [2025-09-17T21:26:23.297272] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T21:26:23.615839] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-06. [2025-09-17T21:26:23.911053] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T21:26:24.415816] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-08. [2025-09-17T21:26:24.736190] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T21:26:25.159608] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T21:26:25.215802] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-07. [2025-09-17T21:26:26.015796] [INFO ] [REMOTE ] RMMZ: Fetching primary data for 2025-09. [2025-09-17T21:26:26.380521] [INFO ] [REMOTE ] RMMZ: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T21:26:26.381927] [INFO ] [REMOTE ] RMMZ: Full fetch complete (7285 records). [2025-09-17T21:26:26.382000] [DEBUG] [VALIDATOR ] RMMZ: Validating primary data. [2025-09-17T21:26:26.776769] [DEBUG] [VALIDATOR ] RMMZ: All expected trading days are present. [2025-09-17T21:26:26.776933] [DEBUG] [VALIDATOR ] RMMZ: Primary data validation passed. [2025-09-17T21:26:26.777188] [INFO ] [MAIN ] RMMZ: Fetched primary data is valid. [2025-09-17T21:26:26.777274] [DEBUG] [LOCAL ] RMMZ: Saving primary data. [2025-09-17T21:26:26.777879] [DEBUG] [LOCAL ] RMMZ: Trimmed 7285 records to 4805 (keeping 200 days of data) [2025-09-17T21:26:26.821344] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-05. [2025-09-17T21:26:26.841057] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T21:26:26.858885] [DEBUG] [LOCAL ] RMMZ: Primary data saved (4805 records). [2025-09-17T21:26:26.859023] [INFO ] [MAIN ] RMMZ: Full history saved. [2025-09-17T21:26:26.859120] [INFO ] [MAIN ] Update Progress: 1821/2371 symbols completed. RMMZ took 47.0s. Estimated remaining: 1h 20m 28s. Rate: 6.8 symbols/min [2025-09-17T21:26:27.030351] [INFO ] [MAIN ] RNR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:26:27.076173] [DEBUG] [LOCAL ] RNR: Loaded 34912 existing records from primary storage. [2025-09-17T21:26:27.076312] [INFO ] [MAIN ] RNR: Loaded 34912 existing records. [2025-09-17T21:26:27.261234] [WARN ] [MAIN ] RNR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:26:27.262307] [INFO ] [MAIN ] RNR: Wiping existing primary data before full refresh. [2025-09-17T21:26:27.262408] [INFO ] [LOCAL ] RNR: Starting deletion of primary data. [2025-09-17T21:26:27.263553] [DEBUG] [LOCAL ] RNR: Deleted primary data file. [2025-09-17T21:26:27.263625] [INFO ] [MAIN ] RNR: Starting full primary refresh. [2025-09-17T21:26:27.615921] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-06. [2025-09-17T21:26:27.648407] [INFO ] [REMOTE ] RNR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:26:27.680494] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T21:26:28.415783] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-06. [2025-09-17T21:26:28.737600] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T21:26:29.038520] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T21:26:29.215772] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-07. [2025-09-17T21:26:30.015781] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-08. [2025-09-17T21:26:30.088635] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T21:26:30.815783] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-11. [2025-09-17T21:26:31.615779] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-08. [2025-09-17T21:26:31.878153] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T21:26:31.954512] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T21:26:32.311050] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T21:26:32.415778] [INFO ] [REMOTE ] RNR: Fetching primary data for 2024-12. [2025-09-17T21:26:33.215788] [INFO ] [REMOTE ] RNG: Fetching primary data for 2025-09. [2025-09-17T21:26:33.748555] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T21:26:34.015785] [INFO ] [REMOTE ] RNP: Fetching primary data for 2025-09. [2025-09-17T21:26:34.649055] [INFO ] [REMOTE ] RNP: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T21:26:34.651512] [INFO ] [REMOTE ] RNP: Full fetch complete (23538 records). [2025-09-17T21:26:34.651607] [DEBUG] [VALIDATOR ] RNP: Validating primary data. [2025-09-17T21:26:34.819492] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-01. [2025-09-17T21:26:35.047858] [DEBUG] [VALIDATOR ] RNP: All expected trading days are present. [2025-09-17T21:26:35.063407] [DEBUG] [VALIDATOR ] RNP: Primary data validation passed. [2025-09-17T21:26:35.064558] [INFO ] [MAIN ] RNP: Fetched primary data is valid. [2025-09-17T21:26:35.065147] [DEBUG] [LOCAL ] RNP: Saving primary data. [2025-09-17T21:26:35.065953] [INFO ] [REMOTE ] RNG: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T21:26:35.073102] [DEBUG] [LOCAL ] RNP: Trimmed 23538 records to 15886 (keeping 200 days of data) [2025-09-17T21:26:35.073692] [INFO ] [REMOTE ] RNG: Full fetch complete (69287 records). [2025-09-17T21:26:35.073881] [DEBUG] [VALIDATOR ] RNG: Validating primary data. [2025-09-17T21:26:35.581302] [DEBUG] [VALIDATOR ] RNG: All expected trading days are present. [2025-09-17T21:26:35.584863] [DEBUG] [LOCAL ] RNP: Primary data saved (15886 records). [2025-09-17T21:26:35.584789] [DEBUG] [VALIDATOR ] RNG: Primary data validation passed. [2025-09-17T21:26:35.585931] [INFO ] [MAIN ] RNG: Fetched primary data is valid. [2025-09-17T21:26:35.585997] [INFO ] [MAIN ] RNP: Full history saved. [2025-09-17T21:26:35.586115] [INFO ] [MAIN ] Update Progress: 1822/2371 symbols completed. RNP took 28.0s. Estimated remaining: 1h 20m 19s. Rate: 6.8 symbols/min [2025-09-17T21:26:35.586164] [DEBUG] [LOCAL ] RNG: Saving primary data. [2025-09-17T21:26:35.618416] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-07. [2025-09-17T21:26:35.696330] [DEBUG] [LOCAL ] RNG: Trimmed 69287 records to 48251 (keeping 200 days of data) [2025-09-17T21:26:35.810727] [INFO ] [MAIN ] RNST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:26:35.901758] [DEBUG] [LOCAL ] RNST: Loaded 37415 existing records from primary storage. [2025-09-17T21:26:35.901946] [INFO ] [MAIN ] RNST: Loaded 37415 existing records. [2025-09-17T21:26:36.195967] [WARN ] [MAIN ] RNST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:26:36.202927] [INFO ] [MAIN ] RNST: Wiping existing primary data before full refresh. [2025-09-17T21:26:36.204853] [INFO ] [LOCAL ] RNST: Starting deletion of primary data. [2025-09-17T21:26:36.212409] [DEBUG] [LOCAL ] RNST: Deleted primary data file. [2025-09-17T21:26:36.213260] [INFO ] [MAIN ] RNST: Starting full primary refresh. [2025-09-17T21:26:36.581703] [DEBUG] [LOCAL ] RNG: Primary data saved (48251 records). [2025-09-17T21:26:36.592880] [INFO ] [MAIN ] RNG: Full history saved. [2025-09-17T21:26:36.656186] [INFO ] [MAIN ] Update Progress: 1823/2371 symbols completed. RNG took 44.3s. Estimated remaining: 1h 20m 8s. Rate: 6.8 symbols/min [2025-09-17T21:26:36.675624] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T21:26:36.743494] [INFO ] [REMOTE ] RNST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:26:36.765199] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-02. [2025-09-17T21:26:36.878285] [INFO ] [MAIN ] ROG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:26:36.901953] [DEBUG] [LOCAL ] ROG: Loaded 23511 existing records from primary storage. [2025-09-17T21:26:36.902110] [INFO ] [MAIN ] ROG: Loaded 23511 existing records. [2025-09-17T21:26:37.097431] [WARN ] [MAIN ] ROG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:26:37.111369] [INFO ] [MAIN ] ROG: Wiping existing primary data before full refresh. [2025-09-17T21:26:37.111819] [INFO ] [LOCAL ] ROG: Starting deletion of primary data. [2025-09-17T21:26:37.112358] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-07 (1.49 seconds). [2025-09-17T21:26:37.112430] [DEBUG] [LOCAL ] ROG: Deleted primary data file. [2025-09-17T21:26:37.117668] [INFO ] [MAIN ] ROG: Starting full primary refresh. [2025-09-17T21:26:37.218141] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-11. [2025-09-17T21:26:37.483428] [INFO ] [REMOTE ] ROG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:26:38.015775] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-08. [2025-09-17T21:26:38.075770] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T21:26:38.368861] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T21:26:38.657683] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T21:26:38.815815] [INFO ] [REMOTE ] RNGR: Fetching primary data for 2025-09. [2025-09-17T21:26:39.615794] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-03. [2025-09-17T21:26:39.669189] [INFO ] [REMOTE ] RNGR: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T21:26:39.671929] [INFO ] [REMOTE ] RNGR: Full fetch complete (28333 records). [2025-09-17T21:26:39.672006] [DEBUG] [VALIDATOR ] RNGR: Validating primary data. [2025-09-17T21:26:40.046860] [DEBUG] [VALIDATOR ] RNGR: All expected trading days are present. [2025-09-17T21:26:40.047004] [DEBUG] [VALIDATOR ] RNGR: Primary data validation passed. [2025-09-17T21:26:40.047662] [INFO ] [MAIN ] RNGR: Fetched primary data is valid. [2025-09-17T21:26:40.047733] [DEBUG] [LOCAL ] RNGR: Saving primary data. [2025-09-17T21:26:40.048766] [DEBUG] [LOCAL ] RNGR: Trimmed 28333 records to 20417 (keeping 200 days of data) [2025-09-17T21:26:40.172196] [DEBUG] [LOCAL ] RNGR: Primary data saved (20417 records). [2025-09-17T21:26:40.172327] [INFO ] [MAIN ] RNGR: Full history saved. [2025-09-17T21:26:40.172409] [INFO ] [MAIN ] Update Progress: 1824/2371 symbols completed. RNGR took 34.3s. Estimated remaining: 1h 19m 58s. Rate: 6.8 symbols/min [2025-09-17T21:26:40.351744] [INFO ] [MAIN ] ROK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:26:40.395199] [DEBUG] [LOCAL ] ROK: Loaded 44181 existing records from primary storage. [2025-09-17T21:26:40.395350] [INFO ] [MAIN ] ROK: Loaded 44181 existing records. [2025-09-17T21:26:40.426854] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-11. [2025-09-17T21:26:40.586475] [WARN ] [MAIN ] ROK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:26:40.586766] [INFO ] [MAIN ] ROK: Wiping existing primary data before full refresh. [2025-09-17T21:26:40.586815] [INFO ] [LOCAL ] ROK: Starting deletion of primary data. [2025-09-17T21:26:40.587714] [DEBUG] [LOCAL ] ROK: Deleted primary data file. [2025-09-17T21:26:40.587765] [INFO ] [MAIN ] ROK: Starting full primary refresh. [2025-09-17T21:26:40.963527] [INFO ] [REMOTE ] ROK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:26:40.999297] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T21:26:41.078354] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T21:26:41.215800] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-11. [2025-09-17T21:26:42.015803] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-04. [2025-09-17T21:26:42.815799] [INFO ] [REMOTE ] ROG: Fetching primary data for 2024-12. [2025-09-17T21:26:43.039917] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T21:26:43.547399] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T21:26:43.615772] [INFO ] [REMOTE ] RNST: Fetching primary data for 2024-12. [2025-09-17T21:26:43.820674] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T21:26:44.415781] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-05. [2025-09-17T21:26:44.833151] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T21:26:45.215774] [INFO ] [REMOTE ] ROK: Fetching primary data for 2024-12. [2025-09-17T21:26:45.871113] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T21:26:46.015750] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-06. [2025-09-17T21:26:46.591178] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T21:26:46.815792] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-01. [2025-09-17T21:26:47.426321] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-06 (1.41 seconds). [2025-09-17T21:26:47.615813] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-07. [2025-09-17T21:26:48.291220] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T21:26:48.415854] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-02. [2025-09-17T21:26:49.076431] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T21:26:49.215812] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-01. [2025-09-17T21:26:49.538299] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T21:26:50.015789] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-08. [2025-09-17T21:26:50.441408] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T21:26:50.815780] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-01. [2025-09-17T21:26:51.247439] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T21:26:51.615747] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-03. [2025-09-17T21:26:51.848806] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T21:26:52.415773] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-02. [2025-09-17T21:26:52.859691] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T21:26:53.215799] [INFO ] [REMOTE ] RNR: Fetching primary data for 2025-09. [2025-09-17T21:26:53.476222] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T21:26:54.015797] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-02. [2025-09-17T21:26:54.101856] [INFO ] [REMOTE ] RNR: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T21:26:54.106127] [INFO ] [REMOTE ] RNR: Full fetch complete (51460 records). [2025-09-17T21:26:54.106226] [DEBUG] [VALIDATOR ] RNR: Validating primary data. [2025-09-17T21:26:54.491514] [DEBUG] [VALIDATOR ] RNR: All expected trading days are present. [2025-09-17T21:26:54.491602] [DEBUG] [VALIDATOR ] RNR: Primary data validation passed. [2025-09-17T21:26:54.492436] [INFO ] [MAIN ] RNR: Fetched primary data is valid. [2025-09-17T21:26:54.492481] [DEBUG] [LOCAL ] RNR: Saving primary data. [2025-09-17T21:26:54.493675] [DEBUG] [LOCAL ] RNR: Trimmed 51460 records to 34785 (keeping 200 days of data) [2025-09-17T21:26:54.726704] [DEBUG] [LOCAL ] RNR: Primary data saved (34785 records). [2025-09-17T21:26:54.726875] [INFO ] [MAIN ] RNR: Full history saved. [2025-09-17T21:26:54.726962] [INFO ] [MAIN ] Update Progress: 1825/2371 symbols completed. RNR took 27.9s. Estimated remaining: 1h 19m 51s. Rate: 6.8 symbols/min [2025-09-17T21:26:54.820917] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-03. [2025-09-17T21:26:54.932799] [INFO ] [MAIN ] ROL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:26:54.982378] [DEBUG] [LOCAL ] ROL: Loaded 50280 existing records from primary storage. [2025-09-17T21:26:54.982534] [INFO ] [MAIN ] ROL: Loaded 50280 existing records. [2025-09-17T21:26:55.160398] [WARN ] [MAIN ] ROL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:26:55.160626] [INFO ] [MAIN ] ROL: Wiping existing primary data before full refresh. [2025-09-17T21:26:55.160689] [INFO ] [LOCAL ] ROL: Starting deletion of primary data. [2025-09-17T21:26:55.161911] [DEBUG] [LOCAL ] ROL: Deleted primary data file. [2025-09-17T21:26:55.161968] [INFO ] [MAIN ] ROL: Starting full primary refresh. [2025-09-17T21:26:55.527008] [INFO ] [REMOTE ] ROL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:26:55.602530] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T21:26:55.615717] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-03. [2025-09-17T21:26:55.942481] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T21:26:56.415787] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-11. [2025-09-17T21:26:56.964747] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T21:26:57.215785] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-04. [2025-09-17T21:26:57.671426] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T21:26:58.015801] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-04. [2025-09-17T21:26:58.485468] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T21:26:58.815799] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-05. [2025-09-17T21:26:58.989466] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-04 (0.97 seconds). [2025-09-17T21:26:59.615814] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-05. [2025-09-17T21:27:00.293594] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T21:27:00.415799] [INFO ] [REMOTE ] ROL: Fetching primary data for 2024-12. [2025-09-17T21:27:00.505363] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T21:27:01.215850] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-06. [2025-09-17T21:27:02.015800] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-04. [2025-09-17T21:27:02.815859] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-06. [2025-09-17T21:27:02.924965] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2024-12 (2.51 seconds). [2025-09-17T21:27:03.349855] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-06 (2.13 seconds). [2025-09-17T21:27:03.615780] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-07. [2025-09-17T21:27:04.415788] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-01. [2025-09-17T21:27:04.975700] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-06 (2.16 seconds). [2025-09-17T21:27:05.007762] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T21:27:05.055272] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-04 (3.04 seconds). [2025-09-17T21:27:05.215775] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-08. [2025-09-17T21:27:06.015780] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-07. [2025-09-17T21:27:06.185198] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T21:27:06.582514] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T21:27:06.815789] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-05. [2025-09-17T21:27:07.207275] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T21:27:07.615785] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-02. [2025-09-17T21:27:08.295630] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T21:27:08.415785] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-08. [2025-09-17T21:27:08.897911] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T21:27:09.215812] [INFO ] [REMOTE ] RNST: Fetching primary data for 2025-09. [2025-09-17T21:27:09.550710] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T21:27:10.015779] [INFO ] [REMOTE ] ROG: Fetching primary data for 2025-09. [2025-09-17T21:27:10.509086] [INFO ] [REMOTE ] RNST: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T21:27:10.513726] [INFO ] [REMOTE ] RNST: Full fetch complete (52706 records). [2025-09-17T21:27:10.513825] [DEBUG] [VALIDATOR ] RNST: Validating primary data. [2025-09-17T21:27:10.820906] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-06. [2025-09-17T21:27:10.898820] [DEBUG] [VALIDATOR ] RNST: All expected trading days are present. [2025-09-17T21:27:10.898898] [DEBUG] [VALIDATOR ] RNST: Primary data validation passed. [2025-09-17T21:27:10.899754] [INFO ] [MAIN ] RNST: Fetched primary data is valid. [2025-09-17T21:27:10.899798] [DEBUG] [LOCAL ] RNST: Saving primary data. [2025-09-17T21:27:10.902295] [DEBUG] [LOCAL ] RNST: Trimmed 52706 records to 37354 (keeping 200 days of data) [2025-09-17T21:27:11.009822] [INFO ] [REMOTE ] ROG: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T21:27:11.014374] [INFO ] [REMOTE ] ROG: Full fetch complete (30677 records). [2025-09-17T21:27:11.015029] [DEBUG] [VALIDATOR ] ROG: Validating primary data. [2025-09-17T21:27:11.539736] [DEBUG] [VALIDATOR ] ROG: All expected trading days are present. [2025-09-17T21:27:11.545553] [DEBUG] [VALIDATOR ] ROG: Primary data validation passed. [2025-09-17T21:27:11.545473] [DEBUG] [LOCAL ] RNST: Primary data saved (37354 records). [2025-09-17T21:27:11.546366] [INFO ] [MAIN ] ROG: Fetched primary data is valid. [2025-09-17T21:27:11.546464] [INFO ] [MAIN ] RNST: Full history saved. [2025-09-17T21:27:11.546556] [DEBUG] [LOCAL ] ROG: Saving primary data. [2025-09-17T21:27:11.547500] [INFO ] [MAIN ] Update Progress: 1826/2371 symbols completed. RNST took 36.0s. Estimated remaining: 1h 19m 44s. Rate: 6.8 symbols/min [2025-09-17T21:27:11.617093] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-03. [2025-09-17T21:27:11.648079] [DEBUG] [LOCAL ] ROG: Trimmed 30677 records to 23482 (keeping 200 days of data) [2025-09-17T21:27:11.840178] [INFO ] [MAIN ] RPM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:27:11.903497] [DEBUG] [LOCAL ] ROG: Primary data saved (23482 records). [2025-09-17T21:27:11.919545] [INFO ] [MAIN ] ROG: Full history saved. [2025-09-17T21:27:11.921212] [INFO ] [MAIN ] Update Progress: 1827/2371 symbols completed. ROG took 35.3s. Estimated remaining: 1h 19m 33s. Rate: 6.8 symbols/min [2025-09-17T21:27:11.986397] [DEBUG] [LOCAL ] RPM: Loaded 41100 existing records from primary storage. [2025-09-17T21:27:11.997869] [INFO ] [MAIN ] RPM: Loaded 41100 existing records. [2025-09-17T21:27:12.231465] [INFO ] [MAIN ] RPT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:27:12.231708] [DEBUG] [LOCAL ] RPT: No existing data file found in primary storage. [2025-09-17T21:27:12.231966] [WARN ] [MAIN ] RPT: No existing data found, performing full refresh instead. [2025-09-17T21:27:12.283684] [INFO ] [MAIN ] RPT: Wiping existing primary data before full refresh. [2025-09-17T21:27:12.293461] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-17T21:27:12.309593] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-09-17T21:27:12.313079] [INFO ] [MAIN ] RPT: Starting full primary refresh. [2025-09-17T21:27:12.313005] [WARN ] [MAIN ] RPM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:27:12.389942] [INFO ] [MAIN ] RPM: Wiping existing primary data before full refresh. [2025-09-17T21:27:12.406336] [INFO ] [LOCAL ] RPM: Starting deletion of primary data. [2025-09-17T21:27:12.423123] [DEBUG] [LOCAL ] RPM: Deleted primary data file. [2025-09-17T21:27:12.433501] [INFO ] [MAIN ] RPM: Starting full primary refresh. [2025-09-17T21:27:12.904035] [INFO ] [REMOTE ] RPT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:27:12.927221] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-11. [2025-09-17T21:27:13.069840] [INFO ] [REMOTE ] RPM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:27:13.094136] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-06 (2.27 seconds). [2025-09-17T21:27:13.202767] [DEBUG] [REMOTE ] RPT: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:27:13.203159] [WARN ] [REMOTE ] RPT: No data returned for month 2024-11 [2025-09-17T21:27:13.215669] [INFO ] [REMOTE ] RPT: Fetching primary data for 2024-12. [2025-09-17T21:27:13.491931] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T21:27:14.015777] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-04. [2025-09-17T21:27:14.225790] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T21:27:14.815781] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-11. [2025-09-17T21:27:15.615789] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-01. [2025-09-17T21:27:16.415713] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-07. [2025-09-17T21:27:16.458448] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-17T21:27:16.617548] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T21:27:16.974079] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T21:27:17.215800] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-02. [2025-09-17T21:27:17.896692] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T21:27:18.015786] [INFO ] [REMOTE ] RPM: Fetching primary data for 2024-12. [2025-09-17T21:27:18.158616] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T21:27:18.815810] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-05. [2025-09-17T21:27:19.520310] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T21:27:19.615793] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-01. [2025-09-17T21:27:20.415772] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-08. [2025-09-17T21:27:20.490757] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T21:27:21.140510] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T21:27:21.215762] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-02. [2025-09-17T21:27:21.668398] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T21:27:22.015815] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-03. [2025-09-17T21:27:22.375925] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T21:27:22.815770] [INFO ] [REMOTE ] ROK: Fetching primary data for 2025-09. [2025-09-17T21:27:22.998249] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T21:27:23.615831] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-03. [2025-09-17T21:27:23.921047] [INFO ] [REMOTE ] ROK: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T21:27:23.926498] [INFO ] [REMOTE ] ROK: Full fetch complete (63426 records). [2025-09-17T21:27:23.926659] [DEBUG] [VALIDATOR ] ROK: Validating primary data. [2025-09-17T21:27:24.317123] [DEBUG] [VALIDATOR ] ROK: All expected trading days are present. [2025-09-17T21:27:24.317219] [DEBUG] [VALIDATOR ] ROK: Primary data validation passed. [2025-09-17T21:27:24.318232] [INFO ] [MAIN ] ROK: Fetched primary data is valid. [2025-09-17T21:27:24.318294] [DEBUG] [LOCAL ] ROK: Saving primary data. [2025-09-17T21:27:24.319680] [DEBUG] [LOCAL ] ROK: Trimmed 63426 records to 44212 (keeping 200 days of data) [2025-09-17T21:27:24.415903] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-04. [2025-09-17T21:27:24.614572] [DEBUG] [LOCAL ] ROK: Primary data saved (44212 records). [2025-09-17T21:27:24.614901] [INFO ] [MAIN ] ROK: Full history saved. [2025-09-17T21:27:24.615078] [INFO ] [MAIN ] Update Progress: 1828/2371 symbols completed. ROK took 44.4s. Estimated remaining: 1h 19m 25s. Rate: 6.8 symbols/min [2025-09-17T21:27:24.788055] [INFO ] [MAIN ] RQI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:27:24.817041] [DEBUG] [LOCAL ] RQI: Loaded 29102 existing records from primary storage. [2025-09-17T21:27:24.817184] [INFO ] [MAIN ] RQI: Loaded 29102 existing records. [2025-09-17T21:27:24.994522] [WARN ] [MAIN ] RQI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:27:24.994886] [INFO ] [MAIN ] RQI: Wiping existing primary data before full refresh. [2025-09-17T21:27:24.994951] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-17T21:27:24.995690] [DEBUG] [LOCAL ] RQI: Deleted primary data file. [2025-09-17T21:27:24.995741] [INFO ] [MAIN ] RQI: Starting full primary refresh. [2025-09-17T21:27:25.225765] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T21:27:25.225840] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-06. [2025-09-17T21:27:25.410370] [INFO ] [REMOTE ] RQI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:27:25.415318] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T21:27:26.015836] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-11. [2025-09-17T21:27:26.815793] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-04. [2025-09-17T21:27:27.152021] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T21:27:27.290823] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T21:27:27.615788] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-07. [2025-09-17T21:27:28.415833] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-05. [2025-09-17T21:27:28.667815] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T21:27:29.163238] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T21:27:29.202461] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T21:27:29.215761] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-06. [2025-09-17T21:27:30.015769] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-08. [2025-09-17T21:27:30.385693] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T21:27:30.815795] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-07. [2025-09-17T21:27:31.239347] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T21:27:31.615813] [INFO ] [REMOTE ] RQI: Fetching primary data for 2024-12. [2025-09-17T21:27:31.804626] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T21:27:32.415802] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-08. [2025-09-17T21:27:32.553401] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T21:27:33.215783] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-05. [2025-09-17T21:27:33.680368] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T21:27:34.015812] [INFO ] [REMOTE ] RPT: Fetching primary data for 2025-09. [2025-09-17T21:27:34.385504] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T21:27:34.815839] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-06. [2025-09-17T21:27:34.972395] [INFO ] [REMOTE ] RPT: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T21:27:34.975130] [INFO ] [REMOTE ] RPT: Full fetch complete (28262 records). [2025-09-17T21:27:34.975351] [DEBUG] [VALIDATOR ] RPT: Validating primary data. [2025-09-17T21:27:35.165500] [WARN ] [VALIDATOR ] RPT: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T21:27:35.165962] [FATAL] [MAIN ] RPT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:27:35.166014] [WARN ] [MAIN ] RPT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:27:35.166054] [INFO ] [LOCAL ] RPT: Starting deletion of primary data. [2025-09-17T21:27:35.166123] [DEBUG] [LOCAL ] RPT: No primary data file found to delete. [2025-09-17T21:27:35.166163] [INFO ] [LOCAL ] RPT: Starting deletion of derivative data. [2025-09-17T21:27:35.166216] [DEBUG] [LOCAL ] RPT: No derivative data file found to delete. [2025-09-17T21:27:35.166294] [INFO ] [MAIN ] Update Progress: 1829/2371 symbols completed. RPT took 23.2s. Estimated remaining: 1h 19m 17s. Rate: 6.8 symbols/min [2025-09-17T21:27:35.337706] [INFO ] [MAIN ] RRC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:27:35.388017] [DEBUG] [LOCAL ] RRC: Loaded 52781 existing records from primary storage. [2025-09-17T21:27:35.388201] [INFO ] [MAIN ] RRC: Loaded 52781 existing records. [2025-09-17T21:27:35.569579] [WARN ] [MAIN ] RRC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:27:35.569823] [INFO ] [MAIN ] RRC: Wiping existing primary data before full refresh. [2025-09-17T21:27:35.569869] [INFO ] [LOCAL ] RRC: Starting deletion of primary data. [2025-09-17T21:27:35.571121] [DEBUG] [LOCAL ] RRC: Deleted primary data file. [2025-09-17T21:27:35.571191] [INFO ] [MAIN ] RRC: Starting full primary refresh. [2025-09-17T21:27:35.620906] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-01. [2025-09-17T21:27:35.952449] [INFO ] [REMOTE ] RRC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:27:36.010358] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T21:27:36.415836] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-11. [2025-09-17T21:27:37.120698] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T21:27:37.215776] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-07. [2025-09-17T21:27:37.819198] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T21:27:38.015790] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-02. [2025-09-17T21:27:38.526196] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T21:27:38.815802] [INFO ] [REMOTE ] ROL: Fetching primary data for 2025-09. [2025-09-17T21:27:39.272359] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T21:27:39.615837] [INFO ] [REMOTE ] RRC: Fetching primary data for 2024-12. [2025-09-17T21:27:40.116114] [INFO ] [REMOTE ] ROL: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T21:27:40.123099] [INFO ] [REMOTE ] ROL: Full fetch complete (72386 records). [2025-09-17T21:27:40.123285] [DEBUG] [VALIDATOR ] ROL: Validating primary data. [2025-09-17T21:27:40.428790] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-03. [2025-09-17T21:27:40.735953] [DEBUG] [VALIDATOR ] ROL: All expected trading days are present. [2025-09-17T21:27:40.736103] [DEBUG] [VALIDATOR ] ROL: Primary data validation passed. [2025-09-17T21:27:40.738175] [INFO ] [MAIN ] ROL: Fetched primary data is valid. [2025-09-17T21:27:40.738288] [DEBUG] [LOCAL ] ROL: Saving primary data. [2025-09-17T21:27:40.740305] [DEBUG] [LOCAL ] ROL: Trimmed 72386 records to 50296 (keeping 200 days of data) [2025-09-17T21:27:41.086266] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T21:27:41.189616] [DEBUG] [LOCAL ] ROL: Primary data saved (50296 records). [2025-09-17T21:27:41.189783] [INFO ] [MAIN ] ROL: Full history saved. [2025-09-17T21:27:41.189881] [INFO ] [MAIN ] Update Progress: 1830/2371 symbols completed. ROL took 46.5s. Estimated remaining: 1h 19m 8s. Rate: 6.8 symbols/min [2025-09-17T21:27:41.221284] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-01. [2025-09-17T21:27:41.364864] [INFO ] [MAIN ] RRX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:27:41.383862] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T21:27:41.426334] [DEBUG] [LOCAL ] RRX: Loaded 41134 existing records from primary storage. [2025-09-17T21:27:41.426508] [INFO ] [MAIN ] RRX: Loaded 41134 existing records. [2025-09-17T21:27:41.609637] [WARN ] [MAIN ] RRX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:27:41.609943] [INFO ] [MAIN ] RRX: Wiping existing primary data before full refresh. [2025-09-17T21:27:41.610025] [INFO ] [LOCAL ] RRX: Starting deletion of primary data. [2025-09-17T21:27:41.610894] [DEBUG] [LOCAL ] RRX: Deleted primary data file. [2025-09-17T21:27:41.610945] [INFO ] [MAIN ] RRX: Starting full primary refresh. [2025-09-17T21:27:41.976458] [INFO ] [REMOTE ] RRX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:27:42.015797] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-11. [2025-09-17T21:27:42.815856] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-04. [2025-09-17T21:27:42.973444] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-01 (1.75 seconds). [2025-09-17T21:27:43.199601] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T21:27:43.615792] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-08. [2025-09-17T21:27:43.856602] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T21:27:44.415824] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-02. [2025-09-17T21:27:44.893003] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T21:27:45.215854] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-05. [2025-09-17T21:27:45.734838] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T21:27:46.015818] [INFO ] [REMOTE ] RPM: Fetching primary data for 2025-09. [2025-09-17T21:27:46.319355] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T21:27:46.815840] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-06. [2025-09-17T21:27:46.970286] [INFO ] [REMOTE ] RPM: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T21:27:46.975241] [INFO ] [REMOTE ] RPM: Full fetch complete (58339 records). [2025-09-17T21:27:46.975360] [DEBUG] [VALIDATOR ] RPM: Validating primary data. [2025-09-17T21:27:47.358872] [DEBUG] [VALIDATOR ] RPM: All expected trading days are present. [2025-09-17T21:27:47.358968] [DEBUG] [VALIDATOR ] RPM: Primary data validation passed. [2025-09-17T21:27:47.359840] [INFO ] [MAIN ] RPM: Fetched primary data is valid. [2025-09-17T21:27:47.359897] [DEBUG] [LOCAL ] RPM: Saving primary data. [2025-09-17T21:27:47.361185] [DEBUG] [LOCAL ] RPM: Trimmed 58339 records to 41074 (keeping 200 days of data) [2025-09-17T21:27:47.627328] [DEBUG] [LOCAL ] RPM: Primary data saved (41074 records). [2025-09-17T21:27:47.620722] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-03. [2025-09-17T21:27:47.627520] [INFO ] [MAIN ] RPM: Full history saved. [2025-09-17T21:27:47.627622] [INFO ] [MAIN ] Update Progress: 1831/2371 symbols completed. RPM took 36.1s. Estimated remaining: 1h 18m 58s. Rate: 6.8 symbols/min [2025-09-17T21:27:47.805993] [INFO ] [MAIN ] RS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:27:47.831184] [DEBUG] [LOCAL ] RS: Loaded 25931 existing records from primary storage. [2025-09-17T21:27:47.831397] [INFO ] [MAIN ] RS: Loaded 25931 existing records. [2025-09-17T21:27:48.020267] [WARN ] [MAIN ] RS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:27:48.034961] [INFO ] [MAIN ] RS: Wiping existing primary data before full refresh. [2025-09-17T21:27:48.036119] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T21:27:48.035590] [INFO ] [LOCAL ] RS: Starting deletion of primary data. [2025-09-17T21:27:48.042505] [DEBUG] [LOCAL ] RS: Deleted primary data file. [2025-09-17T21:27:48.042572] [INFO ] [MAIN ] RS: Starting full primary refresh. [2025-09-17T21:27:48.404409] [INFO ] [REMOTE ] RS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:27:48.415725] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-11. [2025-09-17T21:27:49.215798] [INFO ] [REMOTE ] RRX: Fetching primary data for 2024-12. [2025-09-17T21:27:49.556943] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T21:27:49.704927] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T21:27:50.015811] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-07. [2025-09-17T21:27:50.703817] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T21:27:50.815730] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-01. [2025-09-17T21:27:51.258446] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T21:27:51.615787] [INFO ] [REMOTE ] RS: Fetching primary data for 2024-12. [2025-09-17T21:27:51.932029] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T21:27:52.415779] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-08. [2025-09-17T21:27:53.128909] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T21:27:53.215749] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-01. [2025-09-17T21:27:53.652761] [INFO ] [REMOTE ] RQI: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T21:27:54.015782] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-02. [2025-09-17T21:27:54.311140] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T21:27:54.815993] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-04. [2025-09-17T21:27:55.487070] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T21:27:55.615758] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-03. [2025-09-17T21:27:56.415761] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-02. [2025-09-17T21:27:56.688263] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T21:27:56.846437] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T21:27:57.215768] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-05. [2025-09-17T21:27:57.408412] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T21:27:58.015787] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-04. [2025-09-17T21:27:58.702626] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T21:27:58.815754] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-06. [2025-09-17T21:27:59.481619] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T21:27:59.615771] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-05. [2025-09-17T21:28:00.415730] [INFO ] [REMOTE ] RQI: Fetching primary data for 2025-09. [2025-09-17T21:28:00.593952] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T21:28:00.860739] [DEBUG] [REMOTE ] RQI: Error fetching primary data for 2025-09: Server request status code is 503. [2025-09-17T21:28:00.861108] [WARN ] [REMOTE ] RQI: No data returned for month 2025-09 [2025-09-17T21:28:00.861203] [INFO ] [REMOTE ] RQI: Full fetch complete (40191 records). [2025-09-17T21:28:00.861283] [DEBUG] [VALIDATOR ] RQI: Validating primary data. [2025-09-17T21:28:00.862173] [FATAL] [VALIDATOR ] RQI: Data is stale - most recent date (2025-08-29) is before last completed trading day (2025-09-17). Symbol may be delisted or halted. [2025-09-17T21:28:00.862246] [FATAL] [MAIN ] RQI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:28:00.862290] [WARN ] [MAIN ] RQI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:28:00.862336] [INFO ] [LOCAL ] RQI: Starting deletion of primary data. [2025-09-17T21:28:00.862402] [DEBUG] [LOCAL ] RQI: No primary data file found to delete. [2025-09-17T21:28:00.862440] [INFO ] [LOCAL ] RQI: Starting deletion of derivative data. [2025-09-17T21:28:00.862813] [DEBUG] [LOCAL ] RQI: Deleted derivative data file. [2025-09-17T21:28:00.862899] [INFO ] [MAIN ] Update Progress: 1832/2371 symbols completed. RQI took 36.2s. Estimated remaining: 1h 18m 51s. Rate: 6.8 symbols/min [2025-09-17T21:28:01.033857] [INFO ] [MAIN ] RSF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:28:01.034085] [DEBUG] [LOCAL ] RSF: No existing data file found in primary storage. [2025-09-17T21:28:01.034203] [WARN ] [MAIN ] RSF: No existing data found, performing full refresh instead. [2025-09-17T21:28:01.034331] [INFO ] [MAIN ] RSF: Wiping existing primary data before full refresh. [2025-09-17T21:28:01.034369] [INFO ] [LOCAL ] RSF: Starting deletion of primary data. [2025-09-17T21:28:01.034408] [DEBUG] [LOCAL ] RSF: No primary data file found to delete. [2025-09-17T21:28:01.034440] [INFO ] [MAIN ] RSF: Starting full primary refresh. [2025-09-17T21:28:01.184548] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T21:28:01.221940] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-07. [2025-09-17T21:28:01.444822] [INFO ] [REMOTE ] RSF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:28:02.015785] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-11. [2025-09-17T21:28:02.360214] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-17T21:28:02.815774] [INFO ] [REMOTE ] RSF: Fetching primary data for 2024-12. [2025-09-17T21:28:03.316749] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2024-12 (0.50 seconds). [2025-09-17T21:28:03.320830] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T21:28:03.615767] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-06. [2025-09-17T21:28:04.415774] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-01. [2025-09-17T21:28:04.743277] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T21:28:05.037725] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T21:28:05.215770] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-07. [2025-09-17T21:28:06.015779] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-02. [2025-09-17T21:28:06.432912] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T21:28:06.760720] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T21:28:06.815740] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-08. [2025-09-17T21:28:07.615779] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-03. [2025-09-17T21:28:08.239041] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T21:28:08.415767] [INFO ] [REMOTE ] RRX: Fetching primary data for 2025-09. [2025-09-17T21:28:08.691137] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T21:28:09.215777] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-08. [2025-09-17T21:28:09.485042] [INFO ] [REMOTE ] RRX: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T21:28:09.490902] [INFO ] [REMOTE ] RRX: Full fetch complete (57767 records). [2025-09-17T21:28:09.491112] [DEBUG] [VALIDATOR ] RRX: Validating primary data. [2025-09-17T21:28:09.910084] [DEBUG] [VALIDATOR ] RRX: All expected trading days are present. [2025-09-17T21:28:09.910195] [DEBUG] [VALIDATOR ] RRX: Primary data validation passed. [2025-09-17T21:28:09.911523] [INFO ] [MAIN ] RRX: Fetched primary data is valid. [2025-09-17T21:28:09.911613] [DEBUG] [LOCAL ] RRX: Saving primary data. [2025-09-17T21:28:09.913431] [DEBUG] [LOCAL ] RRX: Trimmed 57767 records to 41158 (keeping 200 days of data) [2025-09-17T21:28:10.019550] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-03. [2025-09-17T21:28:10.191845] [DEBUG] [LOCAL ] RRX: Primary data saved (41158 records). [2025-09-17T21:28:10.192024] [INFO ] [MAIN ] RRX: Full history saved. [2025-09-17T21:28:10.192156] [INFO ] [MAIN ] Update Progress: 1833/2371 symbols completed. RRX took 29.0s. Estimated remaining: 1h 18m 42s. Rate: 6.8 symbols/min [2025-09-17T21:28:10.367319] [INFO ] [MAIN ] RSG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:28:10.415507] [DEBUG] [LOCAL ] RSG: Loaded 47449 existing records from primary storage. [2025-09-17T21:28:10.415670] [INFO ] [MAIN ] RSG: Loaded 47449 existing records. [2025-09-17T21:28:10.521277] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-03 (0.50 seconds). [2025-09-17T21:28:10.602513] [WARN ] [MAIN ] RSG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:28:10.602875] [INFO ] [MAIN ] RSG: Wiping existing primary data before full refresh. [2025-09-17T21:28:10.602970] [INFO ] [LOCAL ] RSG: Starting deletion of primary data. [2025-09-17T21:28:10.604056] [DEBUG] [LOCAL ] RSG: Deleted primary data file. [2025-09-17T21:28:10.604209] [INFO ] [MAIN ] RSG: Starting full primary refresh. [2025-09-17T21:28:10.820416] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-04. [2025-09-17T21:28:11.004589] [INFO ] [REMOTE ] RSG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:28:11.007084] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T21:28:11.406338] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T21:28:11.615784] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-11. [2025-09-17T21:28:12.415783] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-04. [2025-09-17T21:28:12.821094] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T21:28:13.215808] [INFO ] [REMOTE ] RSG: Fetching primary data for 2024-12. [2025-09-17T21:28:13.339358] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T21:28:14.015801] [INFO ] [REMOTE ] RRC: Fetching primary data for 2025-09. [2025-09-17T21:28:14.461469] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T21:28:14.815786] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-01. [2025-09-17T21:28:15.389352] [INFO ] [REMOTE ] RRC: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T21:28:15.397566] [INFO ] [REMOTE ] RRC: Full fetch complete (76019 records). [2025-09-17T21:28:15.397727] [DEBUG] [VALIDATOR ] RRC: Validating primary data. [2025-09-17T21:28:15.623700] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-05. [2025-09-17T21:28:15.792493] [DEBUG] [VALIDATOR ] RRC: All expected trading days are present. [2025-09-17T21:28:15.792575] [DEBUG] [VALIDATOR ] RRC: Primary data validation passed. [2025-09-17T21:28:15.793611] [INFO ] [MAIN ] RRC: Fetched primary data is valid. [2025-09-17T21:28:15.793689] [DEBUG] [LOCAL ] RRC: Saving primary data. [2025-09-17T21:28:15.795290] [DEBUG] [LOCAL ] RRC: Trimmed 76019 records to 52777 (keeping 200 days of data) [2025-09-17T21:28:16.138858] [DEBUG] [LOCAL ] RRC: Primary data saved (52777 records). [2025-09-17T21:28:16.139035] [INFO ] [MAIN ] RRC: Full history saved. [2025-09-17T21:28:16.139148] [INFO ] [MAIN ] Update Progress: 1834/2371 symbols completed. RRC took 41.0s. Estimated remaining: 1h 18m 32s. Rate: 6.8 symbols/min [2025-09-17T21:28:16.273336] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T21:28:16.324331] [INFO ] [MAIN ] RSI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:28:16.372690] [DEBUG] [LOCAL ] RSI: Loaded 47306 existing records from primary storage. [2025-09-17T21:28:16.372862] [INFO ] [MAIN ] RSI: Loaded 47306 existing records. [2025-09-17T21:28:16.425776] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-06. [2025-09-17T21:28:16.559124] [WARN ] [MAIN ] RSI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:28:16.559508] [INFO ] [MAIN ] RSI: Wiping existing primary data before full refresh. [2025-09-17T21:28:16.560006] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-17T21:28:16.561086] [DEBUG] [LOCAL ] RSI: Deleted primary data file. [2025-09-17T21:28:16.561238] [INFO ] [MAIN ] RSI: Starting full primary refresh. [2025-09-17T21:28:16.751381] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-01 (1.94 seconds). [2025-09-17T21:28:16.971180] [INFO ] [REMOTE ] RSI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:28:17.160406] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T21:28:17.215759] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-07. [2025-09-17T21:28:17.663471] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T21:28:18.015838] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-11. [2025-09-17T21:28:18.815869] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-08. [2025-09-17T21:28:19.265083] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T21:28:19.380561] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T21:28:19.615782] [INFO ] [REMOTE ] RSI: Fetching primary data for 2024-12. [2025-09-17T21:28:20.415793] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-02. [2025-09-17T21:28:21.173482] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T21:28:21.215812] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-01. [2025-09-17T21:28:21.785095] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T21:28:22.015853] [INFO ] [REMOTE ] RSF: Fetching primary data for 2025-09. [2025-09-17T21:28:22.336402] [INFO ] [REMOTE ] RSF: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T21:28:22.337703] [INFO ] [REMOTE ] RSF: Full fetch complete (5598 records). [2025-09-17T21:28:22.337784] [DEBUG] [VALIDATOR ] RSF: Validating primary data. [2025-09-17T21:28:22.699276] [DEBUG] [VALIDATOR ] RSF: All expected trading days are present. [2025-09-17T21:28:22.699362] [DEBUG] [VALIDATOR ] RSF: Primary data validation passed. [2025-09-17T21:28:22.699541] [INFO ] [MAIN ] RSF: Fetched primary data is valid. [2025-09-17T21:28:22.699579] [DEBUG] [LOCAL ] RSF: Saving primary data. [2025-09-17T21:28:22.699986] [DEBUG] [LOCAL ] RSF: Trimmed 5598 records to 4162 (keeping 200 days of data) [2025-09-17T21:28:22.726383] [DEBUG] [LOCAL ] RSF: Primary data saved (4162 records). [2025-09-17T21:28:22.726523] [INFO ] [MAIN ] RSF: Full history saved. [2025-09-17T21:28:22.726673] [INFO ] [MAIN ] Update Progress: 1835/2371 symbols completed. RSF took 21.9s. Estimated remaining: 1h 18m 23s. Rate: 6.8 symbols/min [2025-09-17T21:28:22.823421] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-05. [2025-09-17T21:28:22.898062] [INFO ] [MAIN ] RSKD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:28:22.942697] [DEBUG] [LOCAL ] RSKD: Loaded 34258 existing records from primary storage. [2025-09-17T21:28:22.942853] [INFO ] [MAIN ] RSKD: Loaded 34258 existing records. [2025-09-17T21:28:23.122463] [WARN ] [MAIN ] RSKD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:28:23.123296] [INFO ] [MAIN ] RSKD: Wiping existing primary data before full refresh. [2025-09-17T21:28:23.123501] [INFO ] [LOCAL ] RSKD: Starting deletion of primary data. [2025-09-17T21:28:23.124410] [DEBUG] [LOCAL ] RSKD: Deleted primary data file. [2025-09-17T21:28:23.124576] [INFO ] [MAIN ] RSKD: Starting full primary refresh. [2025-09-17T21:28:23.488278] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-01 (2.27 seconds). [2025-09-17T21:28:23.577980] [INFO ] [REMOTE ] RSKD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:28:23.615760] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-11. [2025-09-17T21:28:23.978603] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T21:28:24.415784] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-02. [2025-09-17T21:28:24.519427] [DEBUG] [REMOTE ] RSI: Error fetching primary data for 2025-02: 'API call returned an empty response.' [2025-09-17T21:28:24.519790] [WARN ] [REMOTE ] RSI: No data returned for month 2025-02 [2025-09-17T21:28:24.583399] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T21:28:25.215791] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-03. [2025-09-17T21:28:26.015852] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-06. [2025-09-17T21:28:26.815750] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-03. [2025-09-17T21:28:27.140000] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T21:28:27.177935] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T21:28:27.615792] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-04. [2025-09-17T21:28:28.415768] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-07. [2025-09-17T21:28:28.754714] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T21:28:29.134535] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T21:28:29.215742] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-05. [2025-09-17T21:28:29.322149] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T21:28:30.015787] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2024-12. [2025-09-17T21:28:30.500883] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T21:28:30.815789] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-06. [2025-09-17T21:28:30.911110] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T21:28:31.615817] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-04. [2025-09-17T21:28:32.092886] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T21:28:32.415806] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-08. [2025-09-17T21:28:33.215846] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-07. [2025-09-17T21:28:33.590115] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T21:28:33.630309] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T21:28:34.015960] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-01. [2025-09-17T21:28:34.815795] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-05. [2025-09-17T21:28:34.879395] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-07 (1.66 seconds). [2025-09-17T21:28:35.307260] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T21:28:35.615780] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-02. [2025-09-17T21:28:36.415795] [INFO ] [REMOTE ] RS: Fetching primary data for 2025-09. [2025-09-17T21:28:36.536464] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T21:28:36.831490] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T21:28:37.215820] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-06. [2025-09-17T21:28:37.485113] [INFO ] [REMOTE ] RS: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T21:28:37.488614] [INFO ] [REMOTE ] RS: Full fetch complete (39350 records). [2025-09-17T21:28:37.489106] [DEBUG] [VALIDATOR ] RS: Validating primary data. [2025-09-17T21:28:37.880342] [DEBUG] [VALIDATOR ] RS: All expected trading days are present. [2025-09-17T21:28:37.880420] [DEBUG] [VALIDATOR ] RS: Primary data validation passed. [2025-09-17T21:28:37.881158] [INFO ] [MAIN ] RS: Fetched primary data is valid. [2025-09-17T21:28:37.881199] [DEBUG] [LOCAL ] RS: Saving primary data. [2025-09-17T21:28:37.882077] [DEBUG] [LOCAL ] RS: Trimmed 39350 records to 25896 (keeping 200 days of data) [2025-09-17T21:28:38.016353] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-08. [2025-09-17T21:28:38.053404] [DEBUG] [LOCAL ] RS: Primary data saved (25896 records). [2025-09-17T21:28:38.053544] [INFO ] [MAIN ] RS: Full history saved. [2025-09-17T21:28:38.053699] [INFO ] [MAIN ] Update Progress: 1836/2371 symbols completed. RS took 50.4s. Estimated remaining: 1h 18m 16s. Rate: 6.8 symbols/min [2025-09-17T21:28:38.224737] [INFO ] [MAIN ] RTO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:28:38.263044] [DEBUG] [LOCAL ] RTO: Loaded 40747 existing records from primary storage. [2025-09-17T21:28:38.263182] [INFO ] [MAIN ] RTO: Loaded 40747 existing records. [2025-09-17T21:28:38.447940] [WARN ] [MAIN ] RTO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:28:38.448252] [INFO ] [MAIN ] RTO: Wiping existing primary data before full refresh. [2025-09-17T21:28:38.448301] [INFO ] [LOCAL ] RTO: Starting deletion of primary data. [2025-09-17T21:28:38.449147] [DEBUG] [LOCAL ] RTO: Deleted primary data file. [2025-09-17T21:28:38.449200] [INFO ] [MAIN ] RTO: Starting full primary refresh. [2025-09-17T21:28:38.839311] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-03. [2025-09-17T21:28:38.843961] [INFO ] [REMOTE ] RTO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:28:38.921075] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T21:28:39.547549] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-08 (1.53 seconds). [2025-09-17T21:28:39.615824] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-07. [2025-09-17T21:28:40.293711] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T21:28:40.415850] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-04. [2025-09-17T21:28:41.025136] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T21:28:41.215795] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-08. [2025-09-17T21:28:41.426480] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-04 (1.01 seconds). [2025-09-17T21:28:42.015863] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-11. [2025-09-17T21:28:42.483925] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T21:28:42.815790] [INFO ] [REMOTE ] RSG: Fetching primary data for 2025-09. [2025-09-17T21:28:43.507873] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T21:28:43.615786] [INFO ] [REMOTE ] RSI: Fetching primary data for 2025-09. [2025-09-17T21:28:44.412381] [INFO ] [REMOTE ] RSG: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T21:28:44.418054] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-05. [2025-09-17T21:28:44.419231] [INFO ] [REMOTE ] RSG: Full fetch complete (67573 records). [2025-09-17T21:28:44.419315] [DEBUG] [VALIDATOR ] RSG: Validating primary data. [2025-09-17T21:28:44.810637] [DEBUG] [VALIDATOR ] RSG: All expected trading days are present. [2025-09-17T21:28:44.810739] [DEBUG] [VALIDATOR ] RSG: Primary data validation passed. [2025-09-17T21:28:44.811693] [INFO ] [MAIN ] RSG: Fetched primary data is valid. [2025-09-17T21:28:44.811780] [DEBUG] [LOCAL ] RSG: Saving primary data. [2025-09-17T21:28:44.813633] [DEBUG] [LOCAL ] RSG: Trimmed 67573 records to 47462 (keeping 200 days of data) [2025-09-17T21:28:44.956113] [INFO ] [REMOTE ] RSI: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T21:28:44.963777] [INFO ] [REMOTE ] RSI: Full fetch complete (62374 records). [2025-09-17T21:28:44.964815] [DEBUG] [VALIDATOR ] RSI: Validating primary data. [2025-09-17T21:28:45.221257] [INFO ] [REMOTE ] RTO: Fetching primary data for 2024-12. [2025-09-17T21:28:45.262204] [WARN ] [VALIDATOR ] RSI: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T21:28:45.263206] [FATAL] [MAIN ] RSI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:28:45.264052] [WARN ] [MAIN ] RSI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:28:45.265266] [INFO ] [LOCAL ] RSI: Starting deletion of primary data. [2025-09-17T21:28:45.265416] [DEBUG] [LOCAL ] RSI: No primary data file found to delete. [2025-09-17T21:28:45.265911] [INFO ] [LOCAL ] RSI: Starting deletion of derivative data. [2025-09-17T21:28:45.267881] [DEBUG] [LOCAL ] RSI: Deleted derivative data file. [2025-09-17T21:28:45.268921] [INFO ] [MAIN ] Update Progress: 1837/2371 symbols completed. RSI took 29.1s. Estimated remaining: 1h 18m 7s. Rate: 6.8 symbols/min [2025-09-17T21:28:45.339166] [DEBUG] [LOCAL ] RSG: Primary data saved (47462 records). [2025-09-17T21:28:45.339303] [INFO ] [MAIN ] RSG: Full history saved. [2025-09-17T21:28:45.340298] [INFO ] [MAIN ] Update Progress: 1838/2371 symbols completed. RSG took 35.1s. Estimated remaining: 1h 17m 56s. Rate: 6.8 symbols/min [2025-09-17T21:28:45.772338] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T21:28:46.015788] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-06. [2025-09-17T21:28:46.798334] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T21:28:46.815671] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-01. [2025-09-17T21:28:47.013912] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T21:28:47.615799] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-07. [2025-09-17T21:28:48.188345] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T21:28:48.415792] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-02. [2025-09-17T21:28:49.006633] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T21:28:49.215778] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-08. [2025-09-17T21:28:49.982625] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T21:28:50.015747] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-03. [2025-09-17T21:28:50.817079] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T21:28:50.824923] [INFO ] [REMOTE ] RSKD: Fetching primary data for 2025-09. [2025-09-17T21:28:51.681719] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T21:28:51.691854] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-04. [2025-09-17T21:28:51.729567] [INFO ] [REMOTE ] RSKD: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T21:28:51.734028] [INFO ] [REMOTE ] RSKD: Full fetch complete (48331 records). [2025-09-17T21:28:51.734133] [DEBUG] [VALIDATOR ] RSKD: Validating primary data. [2025-09-17T21:28:52.110459] [DEBUG] [VALIDATOR ] RSKD: All expected trading days are present. [2025-09-17T21:28:52.110536] [DEBUG] [VALIDATOR ] RSKD: Primary data validation passed. [2025-09-17T21:28:52.111337] [INFO ] [MAIN ] RSKD: Fetched primary data is valid. [2025-09-17T21:28:52.111380] [DEBUG] [LOCAL ] RSKD: Saving primary data. [2025-09-17T21:28:52.112424] [DEBUG] [LOCAL ] RSKD: Trimmed 48331 records to 34243 (keeping 200 days of data) [2025-09-17T21:28:52.307739] [DEBUG] [LOCAL ] RSKD: Primary data saved (34243 records). [2025-09-17T21:28:52.307905] [INFO ] [MAIN ] RSKD: Full history saved. [2025-09-17T21:28:52.308003] [INFO ] [MAIN ] Update Progress: 1839/2371 symbols completed. RSKD took 29.6s. Estimated remaining: 1h 17m 46s. Rate: 6.8 symbols/min [2025-09-17T21:28:53.315892] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T21:28:53.325437] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-05. [2025-09-17T21:28:54.691911] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T21:28:54.700081] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-06. [2025-09-17T21:28:55.805221] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T21:28:55.813107] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-07. [2025-09-17T21:28:57.091753] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T21:28:57.101134] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-08. [2025-09-17T21:28:58.236266] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T21:28:58.245428] [INFO ] [REMOTE ] RTO: Fetching primary data for 2025-09. [2025-09-17T21:28:59.668339] [INFO ] [REMOTE ] RTO: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T21:28:59.673600] [INFO ] [REMOTE ] RTO: Full fetch complete (58453 records). [2025-09-17T21:28:59.673796] [DEBUG] [VALIDATOR ] RTO: Validating primary data. [2025-09-17T21:29:00.061057] [DEBUG] [VALIDATOR ] RTO: All expected trading days are present. [2025-09-17T21:29:00.061153] [DEBUG] [VALIDATOR ] RTO: Primary data validation passed. [2025-09-17T21:29:00.062052] [INFO ] [MAIN ] RTO: Fetched primary data is valid. [2025-09-17T21:29:00.062101] [DEBUG] [LOCAL ] RTO: Saving primary data. [2025-09-17T21:29:00.063401] [DEBUG] [LOCAL ] RTO: Trimmed 58453 records to 40670 (keeping 200 days of data) [2025-09-17T21:29:00.317788] [DEBUG] [LOCAL ] RTO: Primary data saved (40670 records). [2025-09-17T21:29:00.317924] [INFO ] [MAIN ] RTO: Full history saved. [2025-09-17T21:29:00.318688] [INFO ] [MAIN ] Update Progress: 1840/2371 symbols completed. RTO took 22.3s. Estimated remaining: 1h 17m 37s. Rate: 6.8 symbols/min [2025-09-17T21:29:00.923100] [INFO ] [MAIN ] RVLV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:29:00.997332] [INFO ] [MAIN ] RVTY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:29:01.028794] [INFO ] [MAIN ] RVT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:29:01.048228] [INFO ] [MAIN ] RTX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:29:01.081979] [DEBUG] [LOCAL ] RVT: Loaded 27371 existing records from primary storage. [2025-09-17T21:29:01.082291] [INFO ] [MAIN ] RVT: Loaded 27371 existing records. [2025-09-17T21:29:01.268612] [DEBUG] [LOCAL ] RTX: Loaded 53712 existing records from primary storage. [2025-09-17T21:29:01.314637] [DEBUG] [LOCAL ] RVLV: Loaded 48038 existing records from primary storage. [2025-09-17T21:29:01.314757] [INFO ] [MAIN ] RTX: Loaded 53712 existing records. [2025-09-17T21:29:01.323458] [INFO ] [MAIN ] RVLV: Loaded 48038 existing records. [2025-09-17T21:29:01.422985] [WARN ] [MAIN ] RVT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:29:01.464821] [INFO ] [MAIN ] RVT: Wiping existing primary data before full refresh. [2025-09-17T21:29:01.506198] [INFO ] [LOCAL ] RVT: Starting deletion of primary data. [2025-09-17T21:29:01.506025] [DEBUG] [LOCAL ] RVTY: Loaded 47546 existing records from primary storage. [2025-09-17T21:29:01.563324] [INFO ] [MAIN ] RVTY: Loaded 47546 existing records. [2025-09-17T21:29:01.585026] [DEBUG] [LOCAL ] RVT: Deleted primary data file. [2025-09-17T21:29:01.626692] [INFO ] [MAIN ] RVT: Starting full primary refresh. [2025-09-17T21:29:01.957928] [WARN ] [MAIN ] RTX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:29:01.949403] [WARN ] [MAIN ] RVLV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:29:01.979917] [INFO ] [MAIN ] RTX: Wiping existing primary data before full refresh. [2025-09-17T21:29:01.983191] [INFO ] [LOCAL ] RTX: Starting deletion of primary data. [2025-09-17T21:29:01.983446] [INFO ] [MAIN ] RVLV: Wiping existing primary data before full refresh. [2025-09-17T21:29:01.994483] [INFO ] [LOCAL ] RVLV: Starting deletion of primary data. [2025-09-17T21:29:02.004783] [DEBUG] [LOCAL ] RTX: Deleted primary data file. [2025-09-17T21:29:02.015356] [DEBUG] [LOCAL ] RVLV: Deleted primary data file. [2025-09-17T21:29:02.010203] [INFO ] [MAIN ] RTX: Starting full primary refresh. [2025-09-17T21:29:02.034921] [INFO ] [MAIN ] RVLV: Starting full primary refresh. [2025-09-17T21:29:02.445102] [WARN ] [MAIN ] RVTY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:29:02.488499] [INFO ] [MAIN ] RVTY: Wiping existing primary data before full refresh. [2025-09-17T21:29:02.561362] [INFO ] [LOCAL ] RVTY: Starting deletion of primary data. [2025-09-17T21:29:02.711047] [DEBUG] [LOCAL ] RVTY: Deleted primary data file. [2025-09-17T21:29:02.784729] [INFO ] [MAIN ] RVTY: Starting full primary refresh. [2025-09-17T21:29:02.787625] [INFO ] [REMOTE ] RVT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:29:02.857212] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-11. [2025-09-17T21:29:03.093323] [INFO ] [REMOTE ] RTX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:29:03.102287] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-11. [2025-09-17T21:29:03.233279] [INFO ] [REMOTE ] RVLV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:29:03.235041] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-11. [2025-09-17T21:29:03.434984] [INFO ] [REMOTE ] RVTY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:29:03.435308] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-11. [2025-09-17T21:29:04.274419] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T21:29:04.280546] [INFO ] [REMOTE ] RVT: Fetching primary data for 2024-12. [2025-09-17T21:29:04.605024] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T21:29:04.614607] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2024-12. [2025-09-17T21:29:04.647428] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T21:29:04.656945] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2024-12. [2025-09-17T21:29:04.716356] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T21:29:04.726900] [INFO ] [REMOTE ] RTX: Fetching primary data for 2024-12. [2025-09-17T21:29:05.517404] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T21:29:05.524212] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-01. [2025-09-17T21:29:05.972091] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T21:29:05.982553] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-01. [2025-09-17T21:29:06.209023] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T21:29:06.217249] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-01. [2025-09-17T21:29:06.593910] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T21:29:06.600817] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-02. [2025-09-17T21:29:06.886193] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2024-12 (2.16 seconds). [2025-09-17T21:29:06.897457] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-01. [2025-09-17T21:29:07.228818] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T21:29:07.238707] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-02. [2025-09-17T21:29:07.581279] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T21:29:07.615799] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-02. [2025-09-17T21:29:07.808869] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T21:29:08.415817] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-03. [2025-09-17T21:29:08.704415] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T21:29:08.754191] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T21:29:09.209867] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T21:29:09.218199] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-03. [2025-09-17T21:29:09.320138] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T21:29:10.015826] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-04. [2025-09-17T21:29:10.700491] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T21:29:10.815779] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-03. [2025-09-17T21:29:11.309232] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T21:29:11.615791] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-02. [2025-09-17T21:29:12.415804] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-04. [2025-09-17T21:29:12.580283] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T21:29:13.215825] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-05. [2025-09-17T21:29:13.625468] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T21:29:13.917318] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T21:29:14.015733] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-05. [2025-09-17T21:29:14.184583] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T21:29:14.815782] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-03. [2025-09-17T21:29:15.365694] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T21:29:15.615804] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-06. [2025-09-17T21:29:16.415838] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-04. [2025-09-17T21:29:16.941732] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T21:29:17.128372] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-17T21:29:17.215746] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-04. [2025-09-17T21:29:18.015814] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-07. [2025-09-17T21:29:18.252236] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T21:29:18.815789] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-05. [2025-09-17T21:29:18.956633] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T21:29:19.136569] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T21:29:19.615811] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-06. [2025-09-17T21:29:20.201994] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T21:29:20.415827] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-06. [2025-09-17T21:29:21.187607] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T21:29:21.215743] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-07. [2025-09-17T21:29:21.790628] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T21:29:22.015778] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-07. [2025-09-17T21:29:22.722737] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T21:29:22.815800] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-08. [2025-09-17T21:29:23.423416] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T21:29:23.615789] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-08. [2025-09-17T21:29:24.125114] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T21:29:24.415778] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-05. [2025-09-17T21:29:24.489430] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T21:29:25.215794] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-08. [2025-09-17T21:29:25.952743] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T21:29:26.015782] [INFO ] [REMOTE ] RVTY: Fetching primary data for 2025-09. [2025-09-17T21:29:26.133523] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T21:29:26.815784] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-06. [2025-09-17T21:29:27.099243] [INFO ] [REMOTE ] RVTY: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T21:29:27.105392] [INFO ] [REMOTE ] RVTY: Full fetch complete (66113 records). [2025-09-17T21:29:27.105527] [DEBUG] [VALIDATOR ] RVTY: Validating primary data. [2025-09-17T21:29:27.501398] [DEBUG] [VALIDATOR ] RVTY: All expected trading days are present. [2025-09-17T21:29:27.501492] [DEBUG] [VALIDATOR ] RVTY: Primary data validation passed. [2025-09-17T21:29:27.502479] [INFO ] [MAIN ] RVTY: Fetched primary data is valid. [2025-09-17T21:29:27.502524] [DEBUG] [LOCAL ] RVTY: Saving primary data. [2025-09-17T21:29:27.504131] [DEBUG] [LOCAL ] RVTY: Trimmed 66113 records to 47610 (keeping 200 days of data) [2025-09-17T21:29:27.617492] [INFO ] [REMOTE ] RVLV: Fetching primary data for 2025-09. [2025-09-17T21:29:27.814012] [DEBUG] [LOCAL ] RVTY: Primary data saved (47610 records). [2025-09-17T21:29:27.814163] [INFO ] [MAIN ] RVTY: Full history saved. [2025-09-17T21:29:27.815874] [INFO ] [MAIN ] Update Progress: 1841/2371 symbols completed. RVTY took 27.5s. Estimated remaining: 1h 17m 34s. Rate: 6.8 symbols/min [2025-09-17T21:29:27.985240] [INFO ] [MAIN ] RWT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:29:28.026749] [DEBUG] [LOCAL ] RWT: Loaded 40497 existing records from primary storage. [2025-09-17T21:29:28.026934] [INFO ] [MAIN ] RWT: Loaded 40497 existing records. [2025-09-17T21:29:28.207688] [WARN ] [MAIN ] RWT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:29:28.207952] [INFO ] [MAIN ] RWT: Wiping existing primary data before full refresh. [2025-09-17T21:29:28.208000] [INFO ] [LOCAL ] RWT: Starting deletion of primary data. [2025-09-17T21:29:28.209027] [DEBUG] [LOCAL ] RWT: Deleted primary data file. [2025-09-17T21:29:28.209088] [INFO ] [MAIN ] RWT: Starting full primary refresh. [2025-09-17T21:29:28.424390] [INFO ] [REMOTE ] RVT: Fetching primary data for 2025-09. [2025-09-17T21:29:28.577035] [INFO ] [REMOTE ] RWT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:29:28.669100] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T21:29:29.004978] [INFO ] [REMOTE ] RVLV: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T21:29:29.011074] [INFO ] [REMOTE ] RVLV: Full fetch complete (68809 records). [2025-09-17T21:29:29.011193] [DEBUG] [VALIDATOR ] RVLV: Validating primary data. [2025-09-17T21:29:29.220951] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-07. [2025-09-17T21:29:29.429448] [DEBUG] [VALIDATOR ] RVLV: All expected trading days are present. [2025-09-17T21:29:29.429819] [DEBUG] [VALIDATOR ] RVLV: Primary data validation passed. [2025-09-17T21:29:29.431633] [INFO ] [MAIN ] RVLV: Fetched primary data is valid. [2025-09-17T21:29:29.432684] [INFO ] [REMOTE ] RVT: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T21:29:29.432812] [DEBUG] [LOCAL ] RVLV: Saving primary data. [2025-09-17T21:29:29.443072] [INFO ] [REMOTE ] RVT: Full fetch complete (40149 records). [2025-09-17T21:29:29.443271] [DEBUG] [VALIDATOR ] RVT: Validating primary data. [2025-09-17T21:29:29.481022] [DEBUG] [LOCAL ] RVLV: Trimmed 68809 records to 48014 (keeping 200 days of data) [2025-09-17T21:29:29.931572] [DEBUG] [VALIDATOR ] RVT: All expected trading days are present. [2025-09-17T21:29:29.932026] [DEBUG] [VALIDATOR ] RVT: Primary data validation passed. [2025-09-17T21:29:29.933309] [INFO ] [MAIN ] RVT: Fetched primary data is valid. [2025-09-17T21:29:29.933685] [DEBUG] [LOCAL ] RVT: Saving primary data. [2025-09-17T21:29:29.938743] [DEBUG] [LOCAL ] RVT: Trimmed 40149 records to 27420 (keeping 200 days of data) [2025-09-17T21:29:30.030779] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-11. [2025-09-17T21:29:30.222255] [DEBUG] [LOCAL ] RVT: Primary data saved (27420 records). [2025-09-17T21:29:30.222947] [INFO ] [MAIN ] RVT: Full history saved. [2025-09-17T21:29:30.223071] [INFO ] [MAIN ] Update Progress: 1842/2371 symbols completed. RVT took 29.9s. Estimated remaining: 1h 17m 23s. Rate: 6.8 symbols/min [2025-09-17T21:29:30.402027] [INFO ] [MAIN ] RWTN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:29:30.403203] [DEBUG] [LOCAL ] RWTN: No existing data file found in primary storage. [2025-09-17T21:29:30.403788] [WARN ] [MAIN ] RWTN: No existing data found, performing full refresh instead. [2025-09-17T21:29:30.408841] [INFO ] [MAIN ] RWTN: Wiping existing primary data before full refresh. [2025-09-17T21:29:30.409682] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-17T21:29:30.413791] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-17T21:29:30.420225] [INFO ] [MAIN ] RWTN: Starting full primary refresh. [2025-09-17T21:29:30.741281] [DEBUG] [LOCAL ] RVLV: Primary data saved (48014 records). [2025-09-17T21:29:30.751814] [INFO ] [MAIN ] RVLV: Full history saved. [2025-09-17T21:29:30.752894] [INFO ] [MAIN ] Update Progress: 1843/2371 symbols completed. RVLV took 30.4s. Estimated remaining: 1h 17m 12s. Rate: 6.8 symbols/min [2025-09-17T21:29:30.932124] [INFO ] [REMOTE ] RWTN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:29:30.942821] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-11. [2025-09-17T21:29:31.001287] [INFO ] [MAIN ] RWTO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:29:31.001411] [DEBUG] [LOCAL ] RWTO: No existing data file found in primary storage. [2025-09-17T21:29:31.001448] [WARN ] [MAIN ] RWTO: No existing data found, performing full refresh instead. [2025-09-17T21:29:31.001562] [INFO ] [MAIN ] RWTO: Wiping existing primary data before full refresh. [2025-09-17T21:29:31.001600] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-17T21:29:31.001694] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-17T21:29:31.001730] [INFO ] [MAIN ] RWTO: Starting full primary refresh. [2025-09-17T21:29:31.352729] [INFO ] [REMOTE ] RWTO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:29:31.468050] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T21:29:31.500137] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T21:29:31.620848] [INFO ] [REMOTE ] RWT: Fetching primary data for 2024-12. [2025-09-17T21:29:31.638577] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-07 (2.42 seconds). [2025-09-17T21:29:32.415796] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-08. [2025-09-17T21:29:32.841443] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T21:29:33.215784] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-11. [2025-09-17T21:29:33.606525] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-11 (0.39 seconds). [2025-09-17T21:29:34.015786] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2024-12. [2025-09-17T21:29:34.453315] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T21:29:34.469088] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T21:29:34.815805] [INFO ] [REMOTE ] RTX: Fetching primary data for 2025-09. [2025-09-17T21:29:35.480058] [INFO ] [REMOTE ] RTX: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T21:29:35.487217] [INFO ] [REMOTE ] RTX: Full fetch complete (77617 records). [2025-09-17T21:29:35.487374] [DEBUG] [VALIDATOR ] RTX: Validating primary data. [2025-09-17T21:29:35.627486] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-01. [2025-09-17T21:29:35.889251] [DEBUG] [VALIDATOR ] RTX: All expected trading days are present. [2025-09-17T21:29:35.889343] [DEBUG] [VALIDATOR ] RTX: Primary data validation passed. [2025-09-17T21:29:35.890786] [INFO ] [MAIN ] RTX: Fetched primary data is valid. [2025-09-17T21:29:35.890859] [DEBUG] [LOCAL ] RTX: Saving primary data. [2025-09-17T21:29:35.893320] [DEBUG] [LOCAL ] RTX: Trimmed 77617 records to 53712 (keeping 200 days of data) [2025-09-17T21:29:36.235052] [DEBUG] [LOCAL ] RTX: Primary data saved (53712 records). [2025-09-17T21:29:36.235205] [INFO ] [MAIN ] RTX: Full history saved. [2025-09-17T21:29:36.235293] [INFO ] [MAIN ] Update Progress: 1844/2371 symbols completed. RTX took 35.9s. Estimated remaining: 1h 17m 2s. Rate: 6.8 symbols/min [2025-09-17T21:29:36.415382] [INFO ] [MAIN ] RWTP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:29:36.415550] [DEBUG] [LOCAL ] RWTP: No existing data file found in primary storage. [2025-09-17T21:29:36.415586] [WARN ] [MAIN ] RWTP: No existing data found, performing full refresh instead. [2025-09-17T21:29:36.415729] [INFO ] [MAIN ] RWTP: Wiping existing primary data before full refresh. [2025-09-17T21:29:36.415770] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-17T21:29:36.415834] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-01. [2025-09-17T21:29:36.417121] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-17T21:29:36.417185] [INFO ] [MAIN ] RWTP: Starting full primary refresh. [2025-09-17T21:29:36.782772] [INFO ] [REMOTE ] RWTP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:29:36.847329] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T21:29:37.094846] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T21:29:37.215754] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-02. [2025-09-17T21:29:37.900682] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-02 (0.68 seconds). [2025-09-17T21:29:38.015770] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-03. [2025-09-17T21:29:38.323412] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-03 (0.31 seconds). [2025-09-17T21:29:38.815784] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-02. [2025-09-17T21:29:39.615791] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2024-12. [2025-09-17T21:29:39.806680] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T21:29:40.048223] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T21:29:40.415795] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-11. [2025-09-17T21:29:40.653279] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:29:40.653598] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-11 [2025-09-17T21:29:41.215794] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-03. [2025-09-17T21:29:42.015798] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-01. [2025-09-17T21:29:42.437317] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T21:29:42.582728] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T21:29:42.815781] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-02. [2025-09-17T21:29:43.243023] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T21:29:43.615827] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-04. [2025-09-17T21:29:44.415859] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2024-12. [2025-09-17T21:29:44.624719] [DEBUG] [REMOTE ] RWTP: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:29:44.625205] [WARN ] [REMOTE ] RWTP: No data returned for month 2024-12 [2025-09-17T21:29:44.981844] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T21:29:45.215774] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-01. [2025-09-17T21:29:45.599972] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-01 (0.38 seconds). [2025-09-17T21:29:46.015793] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-02. [2025-09-17T21:29:46.713175] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T21:29:46.815796] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-04. [2025-09-17T21:29:47.303504] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-04 (0.49 seconds). [2025-09-17T21:29:47.615780] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-05. [2025-09-17T21:29:47.980688] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-17T21:29:48.415794] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-03. [2025-09-17T21:29:48.879419] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T21:29:49.215839] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-05. [2025-09-17T21:29:50.015834] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-03. [2025-09-17T21:29:50.347088] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-03 (0.33 seconds). [2025-09-17T21:29:50.730728] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T21:29:50.815726] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-06. [2025-09-17T21:29:51.615797] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-04. [2025-09-17T21:29:52.189883] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T21:29:52.219079] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T21:29:52.415787] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-06. [2025-09-17T21:29:52.834326] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T21:29:53.215773] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-07. [2025-09-17T21:29:53.937595] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T21:29:54.015785] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-05. [2025-09-17T21:29:54.478439] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T21:29:54.815778] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-07. [2025-09-17T21:29:55.615790] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-06. [2025-09-17T21:29:56.045343] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-06 (0.43 seconds). [2025-09-17T21:29:56.236777] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T21:29:56.415775] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-07. [2025-09-17T21:29:56.759076] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-17T21:29:57.215782] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-04. [2025-09-17T21:29:57.677356] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-04 (0.46 seconds). [2025-09-17T21:29:58.015777] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-08. [2025-09-17T21:29:58.815795] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-08. [2025-09-17T21:29:59.097963] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T21:29:59.288015] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T21:29:59.615785] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-08. [2025-09-17T21:30:00.224617] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T21:30:00.415789] [INFO ] [REMOTE ] RWT: Fetching primary data for 2025-09. [2025-09-17T21:30:01.215845] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-05. [2025-09-17T21:30:02.015738] [INFO ] [REMOTE ] RWTP: Fetching primary data for 2025-09. [2025-09-17T21:30:02.145711] [INFO ] [REMOTE ] RWT: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T21:30:02.154790] [INFO ] [REMOTE ] RWT: Full fetch complete (58196 records). [2025-09-17T21:30:02.155033] [DEBUG] [VALIDATOR ] RWT: Validating primary data. [2025-09-17T21:30:02.535400] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T21:30:02.616238] [DEBUG] [VALIDATOR ] RWT: All expected trading days are present. [2025-09-17T21:30:02.616340] [DEBUG] [VALIDATOR ] RWT: Primary data validation passed. [2025-09-17T21:30:02.617263] [INFO ] [MAIN ] RWT: Fetched primary data is valid. [2025-09-17T21:30:02.617313] [DEBUG] [LOCAL ] RWT: Saving primary data. [2025-09-17T21:30:02.619935] [DEBUG] [LOCAL ] RWT: Trimmed 58196 records to 40527 (keeping 200 days of data) [2025-09-17T21:30:02.838598] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-06. [2025-09-17T21:30:02.878603] [DEBUG] [LOCAL ] RWT: Primary data saved (40527 records). [2025-09-17T21:30:02.878751] [INFO ] [MAIN ] RWT: Full history saved. [2025-09-17T21:30:02.879425] [INFO ] [MAIN ] Update Progress: 1845/2371 symbols completed. RWT took 35.1s. Estimated remaining: 1h 16m 59s. Rate: 6.8 symbols/min [2025-09-17T21:30:03.061275] [INFO ] [MAIN ] RXO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:30:03.115598] [DEBUG] [LOCAL ] RXO: Loaded 47716 existing records from primary storage. [2025-09-17T21:30:03.115785] [INFO ] [MAIN ] RXO: Loaded 47716 existing records. [2025-09-17T21:30:03.292775] [WARN ] [MAIN ] RXO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:30:03.293054] [INFO ] [MAIN ] RXO: Wiping existing primary data before full refresh. [2025-09-17T21:30:03.293113] [INFO ] [LOCAL ] RXO: Starting deletion of primary data. [2025-09-17T21:30:03.294267] [DEBUG] [LOCAL ] RXO: Deleted primary data file. [2025-09-17T21:30:03.294325] [INFO ] [MAIN ] RXO: Starting full primary refresh. [2025-09-17T21:30:03.628555] [INFO ] [REMOTE ] RWTO: Fetching primary data for 2025-09. [2025-09-17T21:30:03.668608] [INFO ] [REMOTE ] RXO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:30:04.309895] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T21:30:04.415776] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-07. [2025-09-17T21:30:04.593619] [INFO ] [REMOTE ] RWTP: Incremental fetch complete for 2025-09 (2.58 seconds). [2025-09-17T21:30:04.594850] [INFO ] [REMOTE ] RWTP: Full fetch complete (4253 records). [2025-09-17T21:30:04.594920] [DEBUG] [VALIDATOR ] RWTP: Validating primary data. [2025-09-17T21:30:04.813312] [WARN ] [VALIDATOR ] RWTP: Validation failed - insufficient historical data. Have 159 unique days, need 200 days [2025-09-17T21:30:04.813550] [FATAL] [MAIN ] RWTP: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:30:04.813608] [WARN ] [MAIN ] RWTP: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:30:04.813699] [INFO ] [LOCAL ] RWTP: Starting deletion of primary data. [2025-09-17T21:30:04.813768] [DEBUG] [LOCAL ] RWTP: No primary data file found to delete. [2025-09-17T21:30:04.813819] [INFO ] [LOCAL ] RWTP: Starting deletion of derivative data. [2025-09-17T21:30:04.813921] [DEBUG] [LOCAL ] RWTP: No derivative data file found to delete. [2025-09-17T21:30:04.814006] [INFO ] [MAIN ] Update Progress: 1846/2371 symbols completed. RWTP took 28.6s. Estimated remaining: 1h 16m 48s. Rate: 6.8 symbols/min [2025-09-17T21:30:05.007831] [INFO ] [MAIN ] RY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:30:05.057453] [DEBUG] [LOCAL ] RY: Loaded 48093 existing records from primary storage. [2025-09-17T21:30:05.057599] [INFO ] [MAIN ] RY: Loaded 48093 existing records. [2025-09-17T21:30:05.164386] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T21:30:05.218448] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-08. [2025-09-17T21:30:05.247421] [WARN ] [MAIN ] RY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:30:05.252163] [INFO ] [MAIN ] RY: Wiping existing primary data before full refresh. [2025-09-17T21:30:05.252054] [INFO ] [REMOTE ] RWTO: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T21:30:05.252338] [INFO ] [LOCAL ] RY: Starting deletion of primary data. [2025-09-17T21:30:05.253718] [DEBUG] [LOCAL ] RY: Deleted primary data file. [2025-09-17T21:30:05.253802] [INFO ] [REMOTE ] RWTO: Full fetch complete (4691 records). [2025-09-17T21:30:05.253959] [INFO ] [MAIN ] RY: Starting full primary refresh. [2025-09-17T21:30:05.254060] [DEBUG] [VALIDATOR ] RWTO: Validating primary data. [2025-09-17T21:30:05.722586] [WARN ] [VALIDATOR ] RWTO: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T21:30:05.749371] [FATAL] [MAIN ] RWTO: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:30:05.749742] [WARN ] [MAIN ] RWTO: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:30:05.756145] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-08 (0.54 seconds). [2025-09-17T21:30:05.756319] [INFO ] [LOCAL ] RWTO: Starting deletion of primary data. [2025-09-17T21:30:05.761861] [DEBUG] [LOCAL ] RWTO: No primary data file found to delete. [2025-09-17T21:30:05.767121] [INFO ] [LOCAL ] RWTO: Starting deletion of derivative data. [2025-09-17T21:30:05.809494] [DEBUG] [LOCAL ] RWTO: No derivative data file found to delete. [2025-09-17T21:30:05.809682] [INFO ] [MAIN ] Update Progress: 1847/2371 symbols completed. RWTO took 35.1s. Estimated remaining: 1h 16m 37s. Rate: 6.8 symbols/min [2025-09-17T21:30:05.844777] [INFO ] [REMOTE ] RY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:30:06.023745] [INFO ] [REMOTE ] RWTN: Fetching primary data for 2025-09. [2025-09-17T21:30:06.027348] [INFO ] [MAIN ] RYAM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:30:06.064526] [DEBUG] [LOCAL ] RYAM: Loaded 35181 existing records from primary storage. [2025-09-17T21:30:06.064689] [INFO ] [MAIN ] RYAM: Loaded 35181 existing records. [2025-09-17T21:30:06.241218] [WARN ] [MAIN ] RYAM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:30:06.241478] [INFO ] [MAIN ] RYAM: Wiping existing primary data before full refresh. [2025-09-17T21:30:06.241525] [INFO ] [LOCAL ] RYAM: Starting deletion of primary data. [2025-09-17T21:30:06.242241] [DEBUG] [LOCAL ] RYAM: Deleted primary data file. [2025-09-17T21:30:06.242288] [INFO ] [MAIN ] RYAM: Starting full primary refresh. [2025-09-17T21:30:06.542008] [INFO ] [REMOTE ] RWTN: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T21:30:06.569743] [INFO ] [REMOTE ] RWTN: Full fetch complete (3129 records). [2025-09-17T21:30:06.599148] [DEBUG] [VALIDATOR ] RWTN: Validating primary data. [2025-09-17T21:30:06.700519] [INFO ] [REMOTE ] RYAM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:30:06.815710] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-11. [2025-09-17T21:30:06.820038] [WARN ] [VALIDATOR ] RWTN: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T21:30:06.821100] [FATAL] [MAIN ] RWTN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:30:06.821164] [WARN ] [MAIN ] RWTN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:30:06.821213] [INFO ] [LOCAL ] RWTN: Starting deletion of primary data. [2025-09-17T21:30:06.821277] [DEBUG] [LOCAL ] RWTN: No primary data file found to delete. [2025-09-17T21:30:06.821314] [INFO ] [LOCAL ] RWTN: Starting deletion of derivative data. [2025-09-17T21:30:06.821362] [DEBUG] [LOCAL ] RWTN: No derivative data file found to delete. [2025-09-17T21:30:06.821427] [INFO ] [MAIN ] Update Progress: 1848/2371 symbols completed. RWTN took 36.6s. Estimated remaining: 1h 16m 26s. Rate: 6.8 symbols/min [2025-09-17T21:30:07.003497] [INFO ] [MAIN ] RYAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:30:07.047678] [DEBUG] [LOCAL ] RYAN: Loaded 43877 existing records from primary storage. [2025-09-17T21:30:07.048038] [INFO ] [MAIN ] RYAN: Loaded 43877 existing records. [2025-09-17T21:30:07.233034] [WARN ] [MAIN ] RYAN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:30:07.233288] [INFO ] [MAIN ] RYAN: Wiping existing primary data before full refresh. [2025-09-17T21:30:07.233332] [INFO ] [LOCAL ] RYAN: Starting deletion of primary data. [2025-09-17T21:30:07.234205] [DEBUG] [LOCAL ] RYAN: Deleted primary data file. [2025-09-17T21:30:07.234255] [INFO ] [MAIN ] RYAN: Starting full primary refresh. [2025-09-17T21:30:07.595102] [INFO ] [REMOTE ] RYAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:30:07.615748] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-11. [2025-09-17T21:30:08.415759] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-11. [2025-09-17T21:30:08.474503] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T21:30:09.134219] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T21:30:09.215730] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2024-12. [2025-09-17T21:30:09.885407] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T21:30:10.015808] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-11. [2025-09-17T21:30:10.119739] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T21:30:10.815809] [INFO ] [REMOTE ] RY: Fetching primary data for 2024-12. [2025-09-17T21:30:11.242681] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T21:30:11.615789] [INFO ] [REMOTE ] RXO: Fetching primary data for 2024-12. [2025-09-17T21:30:11.977781] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T21:30:12.415816] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-01. [2025-09-17T21:30:12.825903] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T21:30:13.215782] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-01. [2025-09-17T21:30:14.015831] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-01. [2025-09-17T21:30:14.277145] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T21:30:14.789986] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T21:30:14.815754] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-02. [2025-09-17T21:30:14.937634] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T21:30:15.615803] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-02. [2025-09-17T21:30:16.415788] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2024-12. [2025-09-17T21:30:16.593732] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T21:30:17.201868] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T21:30:17.215682] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-03. [2025-09-17T21:30:18.015895] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-03. [2025-09-17T21:30:18.815799] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-02. [2025-09-17T21:30:18.950456] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-17T21:30:19.082505] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T21:30:19.622080] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-01. [2025-09-17T21:30:19.627779] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T21:30:20.138474] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T21:30:20.415777] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-04. [2025-09-17T21:30:20.873872] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T21:30:21.215770] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-04. [2025-09-17T21:30:21.717747] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T21:30:22.015772] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-03. [2025-09-17T21:30:22.617433] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T21:30:22.815821] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-05. [2025-09-17T21:30:23.390438] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T21:30:23.615804] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-05. [2025-09-17T21:30:24.367420] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T21:30:24.415759] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-06. [2025-09-17T21:30:24.660617] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T21:30:25.215766] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-02. [2025-09-17T21:30:25.764764] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T21:30:26.015806] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-04. [2025-09-17T21:30:26.654354] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T21:30:26.815805] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-06. [2025-09-17T21:30:27.491984] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T21:30:27.615744] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-07. [2025-09-17T21:30:28.016477] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T21:30:28.415794] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-07. [2025-09-17T21:30:29.215774] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-05. [2025-09-17T21:30:29.393335] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T21:30:29.618145] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T21:30:30.015825] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-08. [2025-09-17T21:30:30.612636] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T21:30:30.815797] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-06. [2025-09-17T21:30:31.615726] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-03. [2025-09-17T21:30:31.710286] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T21:30:32.391398] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T21:30:32.415746] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-07. [2025-09-17T21:30:33.215806] [INFO ] [REMOTE ] RXO: Fetching primary data for 2025-09. [2025-09-17T21:30:33.245989] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T21:30:33.752732] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T21:30:34.015818] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-08. [2025-09-17T21:30:34.457544] [INFO ] [REMOTE ] RXO: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T21:30:34.463882] [INFO ] [REMOTE ] RXO: Full fetch complete (67515 records). [2025-09-17T21:30:34.464006] [DEBUG] [VALIDATOR ] RXO: Validating primary data. [2025-09-17T21:30:34.821707] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-08. [2025-09-17T21:30:34.868945] [DEBUG] [VALIDATOR ] RXO: All expected trading days are present. [2025-09-17T21:30:34.869048] [DEBUG] [VALIDATOR ] RXO: Primary data validation passed. [2025-09-17T21:30:34.870073] [INFO ] [MAIN ] RXO: Fetched primary data is valid. [2025-09-17T21:30:34.870145] [DEBUG] [LOCAL ] RXO: Saving primary data. [2025-09-17T21:30:34.871704] [DEBUG] [LOCAL ] RXO: Trimmed 67515 records to 47726 (keeping 200 days of data) [2025-09-17T21:30:35.160099] [DEBUG] [LOCAL ] RXO: Primary data saved (47726 records). [2025-09-17T21:30:35.160240] [INFO ] [MAIN ] RXO: Full history saved. [2025-09-17T21:30:35.161773] [INFO ] [MAIN ] Update Progress: 1849/2371 symbols completed. RXO took 32.3s. Estimated remaining: 1h 16m 23s. Rate: 6.8 symbols/min [2025-09-17T21:30:35.369166] [INFO ] [MAIN ] RYI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:30:35.392081] [DEBUG] [LOCAL ] RYI: Loaded 21534 existing records from primary storage. [2025-09-17T21:30:35.392228] [INFO ] [MAIN ] RYI: Loaded 21534 existing records. [2025-09-17T21:30:35.585571] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T21:30:35.615359] [WARN ] [MAIN ] RYI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:30:35.615940] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-04. [2025-09-17T21:30:35.617549] [INFO ] [MAIN ] RYI: Wiping existing primary data before full refresh. [2025-09-17T21:30:35.617637] [INFO ] [LOCAL ] RYI: Starting deletion of primary data. [2025-09-17T21:30:35.618173] [DEBUG] [LOCAL ] RYI: Deleted primary data file. [2025-09-17T21:30:35.618223] [INFO ] [MAIN ] RYI: Starting full primary refresh. [2025-09-17T21:30:35.972924] [INFO ] [REMOTE ] RYI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:30:36.169852] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T21:30:36.415854] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-11. [2025-09-17T21:30:37.076065] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T21:30:37.215864] [INFO ] [REMOTE ] RY: Fetching primary data for 2025-09. [2025-09-17T21:30:37.316747] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T21:30:38.015791] [INFO ] [REMOTE ] RYAM: Fetching primary data for 2025-09. [2025-09-17T21:30:38.757875] [INFO ] [REMOTE ] RY: Incremental fetch complete for 2025-09 (1.54 seconds). [2025-09-17T21:30:38.764784] [INFO ] [REMOTE ] RY: Full fetch complete (68391 records). [2025-09-17T21:30:38.764974] [DEBUG] [VALIDATOR ] RY: Validating primary data. [2025-09-17T21:30:38.820871] [INFO ] [REMOTE ] RYI: Fetching primary data for 2024-12. [2025-09-17T21:30:39.183747] [DEBUG] [VALIDATOR ] RY: All expected trading days are present. [2025-09-17T21:30:39.201149] [DEBUG] [VALIDATOR ] RY: Primary data validation passed. [2025-09-17T21:30:39.202984] [INFO ] [MAIN ] RY: Fetched primary data is valid. [2025-09-17T21:30:39.204813] [INFO ] [REMOTE ] RYAM: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T21:30:39.203794] [DEBUG] [LOCAL ] RY: Saving primary data. [2025-09-17T21:30:39.213260] [INFO ] [REMOTE ] RYAM: Full fetch complete (48428 records). [2025-09-17T21:30:39.213514] [DEBUG] [VALIDATOR ] RYAM: Validating primary data. [2025-09-17T21:30:39.245259] [DEBUG] [LOCAL ] RY: Trimmed 68391 records to 48054 (keeping 200 days of data) [2025-09-17T21:30:39.623215] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-05. [2025-09-17T21:30:39.748539] [DEBUG] [VALIDATOR ] RYAM: All expected trading days are present. [2025-09-17T21:30:39.751856] [DEBUG] [VALIDATOR ] RYAM: Primary data validation passed. [2025-09-17T21:30:39.754584] [INFO ] [MAIN ] RYAM: Fetched primary data is valid. [2025-09-17T21:30:39.754755] [DEBUG] [LOCAL ] RYAM: Saving primary data. [2025-09-17T21:30:39.761773] [DEBUG] [LOCAL ] RYAM: Trimmed 48428 records to 35209 (keeping 200 days of data) [2025-09-17T21:30:40.063472] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T21:30:40.070566] [DEBUG] [LOCAL ] RY: Primary data saved (48054 records). [2025-09-17T21:30:40.072221] [INFO ] [MAIN ] RY: Full history saved. [2025-09-17T21:30:40.074403] [INFO ] [MAIN ] Update Progress: 1850/2371 symbols completed. RY took 35.3s. Estimated remaining: 1h 16m 13s. Rate: 6.8 symbols/min [2025-09-17T21:30:40.297763] [INFO ] [MAIN ] RYN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:30:40.366884] [DEBUG] [LOCAL ] RYAM: Primary data saved (35209 records). [2025-09-17T21:30:40.367139] [INFO ] [MAIN ] RYAM: Full history saved. [2025-09-17T21:30:40.367315] [INFO ] [MAIN ] Update Progress: 1851/2371 symbols completed. RYAM took 34.6s. Estimated remaining: 1h 16m 2s. Rate: 6.8 symbols/min [2025-09-17T21:30:40.425186] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-01. [2025-09-17T21:30:40.526884] [DEBUG] [LOCAL ] RYN: Loaded 45815 existing records from primary storage. [2025-09-17T21:30:40.547969] [INFO ] [MAIN ] RYN: Loaded 45815 existing records. [2025-09-17T21:30:40.646149] [INFO ] [MAIN ] RZB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:30:40.764283] [DEBUG] [LOCAL ] RZB: Loaded 6241 existing records from primary storage. [2025-09-17T21:30:40.768913] [INFO ] [MAIN ] RZB: Loaded 6241 existing records. [2025-09-17T21:30:40.800892] [WARN ] [MAIN ] RYN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:30:40.847283] [INFO ] [MAIN ] RYN: Wiping existing primary data before full refresh. [2025-09-17T21:30:40.847359] [INFO ] [LOCAL ] RYN: Starting deletion of primary data. [2025-09-17T21:30:40.872966] [DEBUG] [LOCAL ] RYN: Deleted primary data file. [2025-09-17T21:30:40.873055] [INFO ] [MAIN ] RYN: Starting full primary refresh. [2025-09-17T21:30:41.076951] [WARN ] [MAIN ] RZB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:30:41.098042] [INFO ] [MAIN ] RZB: Wiping existing primary data before full refresh. [2025-09-17T21:30:41.118347] [INFO ] [LOCAL ] RZB: Starting deletion of primary data. [2025-09-17T21:30:41.149361] [DEBUG] [LOCAL ] RZB: Deleted primary data file. [2025-09-17T21:30:41.154744] [INFO ] [MAIN ] RZB: Starting full primary refresh. [2025-09-17T21:30:41.661826] [INFO ] [REMOTE ] RYN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:30:41.678096] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-11. [2025-09-17T21:30:41.796909] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T21:30:41.841201] [INFO ] [REMOTE ] RZB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:30:41.859500] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T21:30:42.015778] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-11. [2025-09-17T21:30:42.606117] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T21:30:42.758577] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T21:30:42.815771] [INFO ] [REMOTE ] RYN: Fetching primary data for 2024-12. [2025-09-17T21:30:43.615840] [INFO ] [REMOTE ] RZB: Fetching primary data for 2024-12. [2025-09-17T21:30:44.075352] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T21:30:44.267029] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T21:30:44.415798] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-01. [2025-09-17T21:30:45.028142] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T21:30:45.215780] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-02. [2025-09-17T21:30:45.816977] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-02 (0.60 seconds). [2025-09-17T21:30:46.015839] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-03. [2025-09-17T21:30:46.470111] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-03 (0.45 seconds). [2025-09-17T21:30:46.815815] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-02. [2025-09-17T21:30:47.615833] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-06. [2025-09-17T21:30:47.878270] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T21:30:48.415778] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-03. [2025-09-17T21:30:48.750589] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T21:30:49.215793] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-04. [2025-09-17T21:30:49.317151] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-03 (0.90 seconds). [2025-09-17T21:30:49.832868] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T21:30:50.015818] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-01. [2025-09-17T21:30:50.815784] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-04. [2025-09-17T21:30:51.134887] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T21:30:51.615793] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-07. [2025-09-17T21:30:51.951998] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T21:30:52.415789] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-02. [2025-09-17T21:30:53.020466] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T21:30:53.215788] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-08. [2025-09-17T21:30:53.914230] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T21:30:54.015759] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-03. [2025-09-17T21:30:54.553584] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T21:30:54.815772] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-05. [2025-09-17T21:30:55.197068] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T21:30:55.559762] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T21:30:55.615762] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-06. [2025-09-17T21:30:56.356131] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T21:30:56.415802] [INFO ] [REMOTE ] RYAN: Fetching primary data for 2025-09. [2025-09-17T21:30:57.215790] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-07. [2025-09-17T21:30:57.604109] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-17T21:30:58.015742] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-05. [2025-09-17T21:30:58.113417] [INFO ] [REMOTE ] RYAN: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T21:30:58.120869] [INFO ] [REMOTE ] RYAN: Full fetch complete (62996 records). [2025-09-17T21:30:58.121020] [DEBUG] [VALIDATOR ] RYAN: Validating primary data. [2025-09-17T21:30:58.538518] [DEBUG] [VALIDATOR ] RYAN: All expected trading days are present. [2025-09-17T21:30:58.538669] [DEBUG] [VALIDATOR ] RYAN: Primary data validation passed. [2025-09-17T21:30:58.539619] [INFO ] [MAIN ] RYAN: Fetched primary data is valid. [2025-09-17T21:30:58.539691] [DEBUG] [LOCAL ] RYAN: Saving primary data. [2025-09-17T21:30:58.541580] [DEBUG] [LOCAL ] RYAN: Trimmed 62996 records to 43954 (keeping 200 days of data) [2025-09-17T21:30:58.816087] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-04. [2025-09-17T21:30:58.832269] [DEBUG] [LOCAL ] RYAN: Primary data saved (43954 records). [2025-09-17T21:30:58.832406] [INFO ] [MAIN ] RYAN: Full history saved. [2025-09-17T21:30:58.832515] [INFO ] [MAIN ] Update Progress: 1852/2371 symbols completed. RYAN took 52.0s. Estimated remaining: 1h 15m 56s. Rate: 6.8 symbols/min [2025-09-17T21:30:59.010237] [INFO ] [MAIN ] RZC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:30:59.025044] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-05 (1.01 seconds). [2025-09-17T21:30:59.033130] [DEBUG] [LOCAL ] RZC: Loaded 6928 existing records from primary storage. [2025-09-17T21:30:59.033236] [INFO ] [MAIN ] RZC: Loaded 6928 existing records. [2025-09-17T21:30:59.212918] [WARN ] [MAIN ] RZC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:30:59.213177] [INFO ] [MAIN ] RZC: Wiping existing primary data before full refresh. [2025-09-17T21:30:59.213224] [INFO ] [LOCAL ] RZC: Starting deletion of primary data. [2025-09-17T21:30:59.213597] [DEBUG] [LOCAL ] RZC: Deleted primary data file. [2025-09-17T21:30:59.213677] [INFO ] [MAIN ] RZC: Starting full primary refresh. [2025-09-17T21:30:59.581390] [INFO ] [REMOTE ] RZC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:30:59.615728] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-11. [2025-09-17T21:31:00.311147] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-17T21:31:00.415775] [INFO ] [REMOTE ] RZC: Fetching primary data for 2024-12. [2025-09-17T21:31:00.510658] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T21:31:01.165407] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T21:31:01.215794] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-08. [2025-09-17T21:31:01.626127] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T21:31:02.015781] [INFO ] [REMOTE ] RZB: Fetching primary data for 2025-09. [2025-09-17T21:31:02.440806] [INFO ] [REMOTE ] RZB: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T21:31:02.442014] [INFO ] [REMOTE ] RZB: Full fetch complete (8815 records). [2025-09-17T21:31:02.442091] [DEBUG] [VALIDATOR ] RZB: Validating primary data. [2025-09-17T21:31:02.821214] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-05. [2025-09-17T21:31:02.830617] [DEBUG] [VALIDATOR ] RZB: All expected trading days are present. [2025-09-17T21:31:02.830727] [DEBUG] [VALIDATOR ] RZB: Primary data validation passed. [2025-09-17T21:31:02.831066] [INFO ] [MAIN ] RZB: Fetched primary data is valid. [2025-09-17T21:31:02.831132] [DEBUG] [LOCAL ] RZB: Saving primary data. [2025-09-17T21:31:02.831972] [DEBUG] [LOCAL ] RZB: Trimmed 8815 records to 6326 (keeping 200 days of data) [2025-09-17T21:31:02.873565] [DEBUG] [LOCAL ] RZB: Primary data saved (6326 records). [2025-09-17T21:31:02.873709] [INFO ] [MAIN ] RZB: Full history saved. [2025-09-17T21:31:02.873866] [INFO ] [MAIN ] Update Progress: 1853/2371 symbols completed. RZB took 22.5s. Estimated remaining: 1h 15m 46s. Rate: 6.8 symbols/min [2025-09-17T21:31:03.049040] [INFO ] [MAIN ] S: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:31:03.112806] [DEBUG] [LOCAL ] S: Loaded 53543 existing records from primary storage. [2025-09-17T21:31:03.112959] [INFO ] [MAIN ] S: Loaded 53543 existing records. [2025-09-17T21:31:03.295412] [WARN ] [MAIN ] S: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:31:03.295742] [INFO ] [MAIN ] S: Wiping existing primary data before full refresh. [2025-09-17T21:31:03.295808] [INFO ] [LOCAL ] S: Starting deletion of primary data. [2025-09-17T21:31:03.297045] [DEBUG] [LOCAL ] S: Deleted primary data file. [2025-09-17T21:31:03.297112] [INFO ] [MAIN ] S: Starting full primary refresh. [2025-09-17T21:31:03.623477] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-01. [2025-09-17T21:31:03.663453] [INFO ] [REMOTE ] S: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:31:04.158094] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T21:31:04.406014] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T21:31:04.415718] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-02. [2025-09-17T21:31:05.215771] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-06. [2025-09-17T21:31:05.349195] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T21:31:06.015760] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-03. [2025-09-17T21:31:06.260044] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T21:31:06.815826] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-06. [2025-09-17T21:31:06.834425] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T21:31:07.615794] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-07. [2025-09-17T21:31:08.028595] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T21:31:08.415822] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-07. [2025-09-17T21:31:08.826688] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T21:31:09.215777] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-08. [2025-09-17T21:31:10.015813] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-04. [2025-09-17T21:31:10.084846] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T21:31:10.414569] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T21:31:10.798628] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T21:31:10.815673] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-05. [2025-09-17T21:31:11.399885] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-05 (0.58 seconds). [2025-09-17T21:31:11.615805] [INFO ] [REMOTE ] RYI: Fetching primary data for 2025-09. [2025-09-17T21:31:12.415689] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-06. [2025-09-17T21:31:12.532936] [INFO ] [REMOTE ] RYI: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T21:31:12.536290] [INFO ] [REMOTE ] RYI: Full fetch complete (32137 records). [2025-09-17T21:31:12.536363] [DEBUG] [VALIDATOR ] RYI: Validating primary data. [2025-09-17T21:31:12.838154] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T21:31:12.927602] [DEBUG] [VALIDATOR ] RYI: All expected trading days are present. [2025-09-17T21:31:12.927824] [DEBUG] [VALIDATOR ] RYI: Primary data validation passed. [2025-09-17T21:31:12.928585] [INFO ] [MAIN ] RYI: Fetched primary data is valid. [2025-09-17T21:31:12.928628] [DEBUG] [LOCAL ] RYI: Saving primary data. [2025-09-17T21:31:12.929537] [DEBUG] [LOCAL ] RYI: Trimmed 32137 records to 21523 (keeping 200 days of data) [2025-09-17T21:31:13.059851] [DEBUG] [LOCAL ] RYI: Primary data saved (21523 records). [2025-09-17T21:31:13.059980] [INFO ] [MAIN ] RYI: Full history saved. [2025-09-17T21:31:13.060088] [INFO ] [MAIN ] Update Progress: 1854/2371 symbols completed. RYI took 37.9s. Estimated remaining: 1h 15m 37s. Rate: 6.8 symbols/min [2025-09-17T21:31:13.231192] [INFO ] [MAIN ] SA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:31:13.228025] [INFO ] [REMOTE ] S: Fetching primary data for 2024-11. [2025-09-17T21:31:13.274369] [DEBUG] [LOCAL ] SA: Loaded 42890 existing records from primary storage. [2025-09-17T21:31:13.274560] [INFO ] [MAIN ] SA: Loaded 42890 existing records. [2025-09-17T21:31:13.454267] [WARN ] [MAIN ] SA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:31:13.454551] [INFO ] [MAIN ] SA: Wiping existing primary data before full refresh. [2025-09-17T21:31:13.454597] [INFO ] [LOCAL ] SA: Starting deletion of primary data. [2025-09-17T21:31:13.455776] [DEBUG] [LOCAL ] SA: Deleted primary data file. [2025-09-17T21:31:13.455836] [INFO ] [MAIN ] SA: Starting full primary refresh. [2025-09-17T21:31:13.826853] [INFO ] [REMOTE ] SA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:31:14.015861] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-11. [2025-09-17T21:31:14.815850] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-08. [2025-09-17T21:31:15.167112] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T21:31:15.239290] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T21:31:15.615812] [INFO ] [REMOTE ] SA: Fetching primary data for 2024-12. [2025-09-17T21:31:16.295718] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T21:31:16.415773] [INFO ] [REMOTE ] RYN: Fetching primary data for 2025-09. [2025-09-17T21:31:17.125311] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T21:31:17.215815] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-01. [2025-09-17T21:31:17.559456] [INFO ] [REMOTE ] RYN: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T21:31:17.566538] [INFO ] [REMOTE ] RYN: Full fetch complete (64309 records). [2025-09-17T21:31:17.566731] [DEBUG] [VALIDATOR ] RYN: Validating primary data. [2025-09-17T21:31:17.974749] [DEBUG] [VALIDATOR ] RYN: All expected trading days are present. [2025-09-17T21:31:17.974844] [DEBUG] [VALIDATOR ] RYN: Primary data validation passed. [2025-09-17T21:31:17.975879] [INFO ] [MAIN ] RYN: Fetched primary data is valid. [2025-09-17T21:31:17.975934] [DEBUG] [LOCAL ] RYN: Saving primary data. [2025-09-17T21:31:17.977847] [DEBUG] [LOCAL ] RYN: Trimmed 64309 records to 45855 (keeping 200 days of data) [2025-09-17T21:31:18.036473] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-07. [2025-09-17T21:31:18.270621] [DEBUG] [LOCAL ] RYN: Primary data saved (45855 records). [2025-09-17T21:31:18.270770] [INFO ] [MAIN ] RYN: Full history saved. [2025-09-17T21:31:18.270874] [INFO ] [MAIN ] Update Progress: 1855/2371 symbols completed. RYN took 38.2s. Estimated remaining: 1h 15m 28s. Rate: 6.8 symbols/min [2025-09-17T21:31:18.446905] [INFO ] [MAIN ] SABA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:31:18.457487] [DEBUG] [LOCAL ] SABA: Loaded 9425 existing records from primary storage. [2025-09-17T21:31:18.457611] [INFO ] [MAIN ] SABA: Loaded 9425 existing records. [2025-09-17T21:31:18.648136] [WARN ] [MAIN ] SABA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:31:18.648515] [INFO ] [MAIN ] SABA: Wiping existing primary data before full refresh. [2025-09-17T21:31:18.648638] [INFO ] [LOCAL ] SABA: Starting deletion of primary data. [2025-09-17T21:31:18.649006] [DEBUG] [LOCAL ] SABA: Deleted primary data file. [2025-09-17T21:31:18.649055] [INFO ] [MAIN ] SABA: Starting full primary refresh. [2025-09-17T21:31:18.816035] [INFO ] [REMOTE ] S: Fetching primary data for 2024-12. [2025-09-17T21:31:18.975174] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T21:31:19.032166] [INFO ] [REMOTE ] SABA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:31:19.053971] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T21:31:19.615856] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-08. [2025-09-17T21:31:20.343709] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-08 (0.73 seconds). [2025-09-17T21:31:20.415803] [INFO ] [REMOTE ] RZC: Fetching primary data for 2025-09. [2025-09-17T21:31:21.019201] [INFO ] [REMOTE ] RZC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T21:31:21.020582] [INFO ] [REMOTE ] RZC: Full fetch complete (9945 records). [2025-09-17T21:31:21.020681] [DEBUG] [VALIDATOR ] RZC: Validating primary data. [2025-09-17T21:31:21.219403] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-11. [2025-09-17T21:31:21.404620] [DEBUG] [VALIDATOR ] RZC: All expected trading days are present. [2025-09-17T21:31:21.404760] [DEBUG] [VALIDATOR ] RZC: Primary data validation passed. [2025-09-17T21:31:21.405055] [INFO ] [MAIN ] RZC: Fetched primary data is valid. [2025-09-17T21:31:21.405107] [DEBUG] [LOCAL ] RZC: Saving primary data. [2025-09-17T21:31:21.405696] [DEBUG] [LOCAL ] RZC: Trimmed 9945 records to 6887 (keeping 200 days of data) [2025-09-17T21:31:21.481711] [INFO ] [REMOTE ] S: Incremental fetch complete for 2024-12 (2.67 seconds). [2025-09-17T21:31:21.503502] [DEBUG] [LOCAL ] RZC: Primary data saved (6887 records). [2025-09-17T21:31:21.503686] [INFO ] [MAIN ] RZC: Full history saved. [2025-09-17T21:31:21.503793] [INFO ] [MAIN ] Update Progress: 1856/2371 symbols completed. RZC took 22.7s. Estimated remaining: 1h 15m 17s. Rate: 6.8 symbols/min [2025-09-17T21:31:21.678621] [INFO ] [MAIN ] SAFE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:31:21.709409] [DEBUG] [LOCAL ] SAFE: Loaded 30542 existing records from primary storage. [2025-09-17T21:31:21.709579] [INFO ] [MAIN ] SAFE: Loaded 30542 existing records. [2025-09-17T21:31:21.886020] [WARN ] [MAIN ] SAFE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:31:21.886254] [INFO ] [MAIN ] SAFE: Wiping existing primary data before full refresh. [2025-09-17T21:31:21.886300] [INFO ] [LOCAL ] SAFE: Starting deletion of primary data. [2025-09-17T21:31:21.887444] [DEBUG] [LOCAL ] SAFE: Deleted primary data file. [2025-09-17T21:31:21.887498] [INFO ] [MAIN ] SAFE: Starting full primary refresh. [2025-09-17T21:31:22.020888] [INFO ] [REMOTE ] S: Fetching primary data for 2025-01. [2025-09-17T21:31:22.055408] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T21:31:22.266394] [INFO ] [REMOTE ] SAFE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:31:22.815822] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-11. [2025-09-17T21:31:23.615814] [INFO ] [REMOTE ] SABA: Fetching primary data for 2024-12. [2025-09-17T21:31:23.667064] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T21:31:24.059669] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T21:31:24.415822] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-02. [2025-09-17T21:31:24.457684] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T21:31:25.215794] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2024-12. [2025-09-17T21:31:25.607868] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T21:31:26.015849] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-03. [2025-09-17T21:31:26.529369] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T21:31:26.815782] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-01. [2025-09-17T21:31:27.238778] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T21:31:27.615773] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-04. [2025-09-17T21:31:27.818335] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T21:31:28.415785] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-01. [2025-09-17T21:31:29.220854] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-02. [2025-09-17T21:31:29.236854] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T21:31:29.755471] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T21:31:30.015835] [INFO ] [REMOTE ] S: Fetching primary data for 2025-02. [2025-09-17T21:31:30.056539] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T21:31:30.815805] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-02. [2025-09-17T21:31:31.620961] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-03. [2025-09-17T21:31:31.642726] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T21:31:32.177281] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T21:31:32.191689] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T21:31:32.415785] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-04. [2025-09-17T21:31:33.179292] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T21:31:33.215736] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-05. [2025-09-17T21:31:33.932347] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T21:31:34.015817] [INFO ] [REMOTE ] S: Fetching primary data for 2025-03. [2025-09-17T21:31:34.815801] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-06. [2025-09-17T21:31:35.593971] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T21:31:35.615725] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-07. [2025-09-17T21:31:35.979528] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T21:31:36.415767] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-05. [2025-09-17T21:31:36.525029] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-07 (0.91 seconds). [2025-09-17T21:31:37.215774] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-08. [2025-09-17T21:31:37.982767] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T21:31:38.015425] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T21:31:38.027298] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-03. [2025-09-17T21:31:38.815802] [INFO ] [REMOTE ] SABA: Fetching primary data for 2025-09. [2025-09-17T21:31:39.389438] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T21:31:39.424504] [INFO ] [REMOTE ] SABA: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T21:31:39.427780] [INFO ] [REMOTE ] SABA: Full fetch complete (15559 records). [2025-09-17T21:31:39.427881] [DEBUG] [VALIDATOR ] SABA: Validating primary data. [2025-09-17T21:31:39.625689] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-04. [2025-09-17T21:31:39.796858] [DEBUG] [VALIDATOR ] SABA: All expected trading days are present. [2025-09-17T21:31:39.796942] [DEBUG] [VALIDATOR ] SABA: Primary data validation passed. [2025-09-17T21:31:39.797300] [INFO ] [MAIN ] SABA: Fetched primary data is valid. [2025-09-17T21:31:39.797340] [DEBUG] [LOCAL ] SABA: Saving primary data. [2025-09-17T21:31:39.797874] [DEBUG] [LOCAL ] SABA: Trimmed 15559 records to 9443 (keeping 200 days of data) [2025-09-17T21:31:39.855520] [DEBUG] [LOCAL ] SABA: Primary data saved (9443 records). [2025-09-17T21:31:39.855673] [INFO ] [MAIN ] SABA: Full history saved. [2025-09-17T21:31:39.855761] [INFO ] [MAIN ] Update Progress: 1857/2371 symbols completed. SABA took 21.6s. Estimated remaining: 1h 15m 11s. Rate: 6.8 symbols/min [2025-09-17T21:31:40.024295] [INFO ] [MAIN ] SAH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:31:40.045384] [DEBUG] [LOCAL ] SAH: Loaded 22358 existing records from primary storage. [2025-09-17T21:31:40.045510] [INFO ] [MAIN ] SAH: Loaded 22358 existing records. [2025-09-17T21:31:40.226202] [WARN ] [MAIN ] SAH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:31:40.226473] [INFO ] [MAIN ] SAH: Wiping existing primary data before full refresh. [2025-09-17T21:31:40.226529] [INFO ] [LOCAL ] SAH: Starting deletion of primary data. [2025-09-17T21:31:40.227230] [DEBUG] [LOCAL ] SAH: Deleted primary data file. [2025-09-17T21:31:40.227282] [INFO ] [MAIN ] SAH: Starting full primary refresh. [2025-09-17T21:31:40.420893] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-06. [2025-09-17T21:31:40.584802] [INFO ] [REMOTE ] SAH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:31:41.140845] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T21:31:41.215746] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-05. [2025-09-17T21:31:41.750950] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T21:31:42.015787] [INFO ] [REMOTE ] S: Fetching primary data for 2025-04. [2025-09-17T21:31:42.601153] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T21:31:42.815814] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-11. [2025-09-17T21:31:43.615779] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-06. [2025-09-17T21:31:43.865046] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T21:31:43.999706] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T21:31:44.415819] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-07. [2025-09-17T21:31:44.763562] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T21:31:45.215807] [INFO ] [REMOTE ] SAH: Fetching primary data for 2024-12. [2025-09-17T21:31:45.839962] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T21:31:46.015741] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-07. [2025-09-17T21:31:46.042597] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T21:31:46.815791] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-08. [2025-09-17T21:31:47.482845] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T21:31:47.615749] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-08. [2025-09-17T21:31:48.125068] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T21:31:48.415781] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-01. [2025-09-17T21:31:48.469805] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T21:31:49.215779] [INFO ] [REMOTE ] S: Fetching primary data for 2025-05. [2025-09-17T21:31:49.470921] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T21:31:50.015813] [INFO ] [REMOTE ] SAFE: Fetching primary data for 2025-09. [2025-09-17T21:31:50.822618] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-02. [2025-09-17T21:31:50.855715] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T21:31:50.880532] [INFO ] [REMOTE ] SAFE: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T21:31:50.885772] [INFO ] [REMOTE ] SAFE: Full fetch complete (44887 records). [2025-09-17T21:31:50.885920] [DEBUG] [VALIDATOR ] SAFE: Validating primary data. [2025-09-17T21:31:51.273986] [DEBUG] [VALIDATOR ] SAFE: All expected trading days are present. [2025-09-17T21:31:51.274078] [DEBUG] [VALIDATOR ] SAFE: Primary data validation passed. [2025-09-17T21:31:51.274902] [INFO ] [MAIN ] SAFE: Fetched primary data is valid. [2025-09-17T21:31:51.274949] [DEBUG] [LOCAL ] SAFE: Saving primary data. [2025-09-17T21:31:51.276020] [DEBUG] [LOCAL ] SAFE: Trimmed 44887 records to 30477 (keeping 200 days of data) [2025-09-17T21:31:51.467737] [DEBUG] [LOCAL ] SAFE: Primary data saved (30477 records). [2025-09-17T21:31:51.467887] [INFO ] [MAIN ] SAFE: Full history saved. [2025-09-17T21:31:51.468001] [INFO ] [MAIN ] Update Progress: 1858/2371 symbols completed. SAFE took 30.0s. Estimated remaining: 1h 15m 3s. Rate: 6.8 symbols/min [2025-09-17T21:31:51.616116] [INFO ] [REMOTE ] SA: Fetching primary data for 2025-09. [2025-09-17T21:31:51.641270] [INFO ] [MAIN ] SAJ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:31:51.641766] [DEBUG] [LOCAL ] SAJ: No existing data file found in primary storage. [2025-09-17T21:31:51.641911] [WARN ] [MAIN ] SAJ: No existing data found, performing full refresh instead. [2025-09-17T21:31:51.642248] [INFO ] [MAIN ] SAJ: Wiping existing primary data before full refresh. [2025-09-17T21:31:51.642400] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-17T21:31:51.642502] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-17T21:31:51.642588] [INFO ] [MAIN ] SAJ: Starting full primary refresh. [2025-09-17T21:31:51.763401] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T21:31:52.020502] [INFO ] [REMOTE ] SAJ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:31:52.415795] [INFO ] [REMOTE ] S: Fetching primary data for 2025-06. [2025-09-17T21:31:52.858119] [INFO ] [REMOTE ] SA: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T21:31:52.864449] [INFO ] [REMOTE ] SA: Full fetch complete (61238 records). [2025-09-17T21:31:52.864578] [DEBUG] [VALIDATOR ] SA: Validating primary data. [2025-09-17T21:31:53.220851] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-11. [2025-09-17T21:31:53.265363] [DEBUG] [VALIDATOR ] SA: All expected trading days are present. [2025-09-17T21:31:53.265446] [DEBUG] [VALIDATOR ] SA: Primary data validation passed. [2025-09-17T21:31:53.266669] [INFO ] [MAIN ] SA: Fetched primary data is valid. [2025-09-17T21:31:53.266739] [DEBUG] [LOCAL ] SA: Saving primary data. [2025-09-17T21:31:53.268152] [DEBUG] [LOCAL ] SA: Trimmed 61238 records to 42927 (keeping 200 days of data) [2025-09-17T21:31:53.534407] [DEBUG] [LOCAL ] SA: Primary data saved (42927 records). [2025-09-17T21:31:53.534554] [INFO ] [MAIN ] SA: Full history saved. [2025-09-17T21:31:53.536021] [INFO ] [MAIN ] Update Progress: 1859/2371 symbols completed. SA took 40.5s. Estimated remaining: 1h 14m 53s. Rate: 6.8 symbols/min [2025-09-17T21:31:53.645898] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T21:31:53.721147] [INFO ] [MAIN ] SAM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:31:53.744468] [DEBUG] [LOCAL ] SAM: Loaded 21690 existing records from primary storage. [2025-09-17T21:31:53.744617] [INFO ] [MAIN ] SAM: Loaded 21690 existing records. [2025-09-17T21:31:53.929695] [WARN ] [MAIN ] SAM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:31:53.930129] [INFO ] [MAIN ] SAM: Wiping existing primary data before full refresh. [2025-09-17T21:31:53.930197] [INFO ] [LOCAL ] SAM: Starting deletion of primary data. [2025-09-17T21:31:53.930805] [DEBUG] [LOCAL ] SAM: Deleted primary data file. [2025-09-17T21:31:53.930911] [INFO ] [MAIN ] SAM: Starting full primary refresh. [2025-09-17T21:31:54.020890] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2024-12. [2025-09-17T21:31:54.312637] [INFO ] [REMOTE ] SAM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:31:54.342602] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T21:31:54.377733] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T21:31:54.815793] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-01. [2025-09-17T21:31:55.097378] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-17T21:31:55.615778] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-02. [2025-09-17T21:31:56.195961] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T21:31:56.415802] [INFO ] [REMOTE ] S: Fetching primary data for 2025-07. [2025-09-17T21:31:57.215790] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-11. [2025-09-17T21:31:57.830919] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T21:31:58.015778] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-03. [2025-09-17T21:31:58.309461] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T21:31:58.340210] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-03 (0.32 seconds). [2025-09-17T21:31:58.815794] [INFO ] [REMOTE ] S: Fetching primary data for 2025-08. [2025-09-17T21:31:59.615781] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-03. [2025-09-17T21:32:00.415787] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-04. [2025-09-17T21:32:00.753601] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T21:32:00.846151] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T21:32:01.125329] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-08 (2.31 seconds). [2025-09-17T21:32:01.215773] [INFO ] [REMOTE ] S: Fetching primary data for 2025-09. [2025-09-17T21:32:02.015789] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-05. [2025-09-17T21:32:02.348798] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T21:32:02.815766] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-06. [2025-09-17T21:32:03.137486] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T21:32:03.227501] [INFO ] [REMOTE ] S: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-17T21:32:03.235002] [INFO ] [REMOTE ] S: Full fetch complete (77494 records). [2025-09-17T21:32:03.235177] [DEBUG] [VALIDATOR ] S: Validating primary data. [2025-09-17T21:32:03.628688] [INFO ] [REMOTE ] SAM: Fetching primary data for 2024-12. [2025-09-17T21:32:03.655962] [DEBUG] [VALIDATOR ] S: All expected trading days are present. [2025-09-17T21:32:03.656056] [DEBUG] [VALIDATOR ] S: Primary data validation passed. [2025-09-17T21:32:03.657275] [INFO ] [MAIN ] S: Fetched primary data is valid. [2025-09-17T21:32:03.657330] [DEBUG] [LOCAL ] S: Saving primary data. [2025-09-17T21:32:03.658974] [DEBUG] [LOCAL ] S: Trimmed 77494 records to 53544 (keeping 200 days of data) [2025-09-17T21:32:03.998731] [DEBUG] [LOCAL ] S: Primary data saved (53544 records). [2025-09-17T21:32:03.998871] [INFO ] [MAIN ] S: Full history saved. [2025-09-17T21:32:03.998982] [INFO ] [MAIN ] Update Progress: 1860/2371 symbols completed. S took 1m 1s. Estimated remaining: 1h 14m 44s. Rate: 6.8 symbols/min [2025-09-17T21:32:04.178736] [INFO ] [MAIN ] SAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:32:04.178926] [DEBUG] [LOCAL ] SAN: No existing data file found in primary storage. [2025-09-17T21:32:04.178966] [WARN ] [MAIN ] SAN: No existing data found, performing full refresh instead. [2025-09-17T21:32:04.179089] [INFO ] [MAIN ] SAN: Wiping existing primary data before full refresh. [2025-09-17T21:32:04.179129] [INFO ] [LOCAL ] SAN: Starting deletion of primary data. [2025-09-17T21:32:04.179173] [DEBUG] [LOCAL ] SAN: No primary data file found to delete. [2025-09-17T21:32:04.179208] [INFO ] [MAIN ] SAN: Starting full primary refresh. [2025-09-17T21:32:04.424098] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-07. [2025-09-17T21:32:04.498557] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T21:32:04.591300] [INFO ] [REMOTE ] SAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:32:04.866559] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T21:32:05.215757] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-11. [2025-09-17T21:32:06.015765] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-08. [2025-09-17T21:32:06.602392] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T21:32:06.815780] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-04. [2025-09-17T21:32:07.059281] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T21:32:07.615790] [INFO ] [REMOTE ] SAJ: Fetching primary data for 2025-09. [2025-09-17T21:32:07.858749] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T21:32:07.948408] [INFO ] [REMOTE ] SAJ: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-17T21:32:07.949163] [INFO ] [REMOTE ] SAJ: Full fetch complete (977 records). [2025-09-17T21:32:07.949230] [DEBUG] [VALIDATOR ] SAJ: Validating primary data. [2025-09-17T21:32:08.132389] [WARN ] [VALIDATOR ] SAJ: Validation failed - insufficient historical data. Have 183 unique days, need 200 days [2025-09-17T21:32:08.132749] [FATAL] [MAIN ] SAJ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:32:08.132805] [WARN ] [MAIN ] SAJ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:32:08.132851] [INFO ] [LOCAL ] SAJ: Starting deletion of primary data. [2025-09-17T21:32:08.132943] [DEBUG] [LOCAL ] SAJ: No primary data file found to delete. [2025-09-17T21:32:08.132982] [INFO ] [LOCAL ] SAJ: Starting deletion of derivative data. [2025-09-17T21:32:08.133022] [DEBUG] [LOCAL ] SAJ: No derivative data file found to delete. [2025-09-17T21:32:08.133081] [INFO ] [MAIN ] Update Progress: 1861/2371 symbols completed. SAJ took 16.7s. Estimated remaining: 1h 14m 34s. Rate: 6.8 symbols/min [2025-09-17T21:32:08.305888] [INFO ] [MAIN ] SAND: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:32:08.358167] [DEBUG] [LOCAL ] SAND: Loaded 51777 existing records from primary storage. [2025-09-17T21:32:08.358317] [INFO ] [MAIN ] SAND: Loaded 51777 existing records. [2025-09-17T21:32:08.421842] [INFO ] [REMOTE ] SAN: Fetching primary data for 2024-12. [2025-09-17T21:32:08.550347] [WARN ] [MAIN ] SAND: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:32:08.550609] [INFO ] [MAIN ] SAND: Wiping existing primary data before full refresh. [2025-09-17T21:32:08.550678] [INFO ] [LOCAL ] SAND: Starting deletion of primary data. [2025-09-17T21:32:08.551826] [DEBUG] [LOCAL ] SAND: Deleted primary data file. [2025-09-17T21:32:08.551881] [INFO ] [MAIN ] SAND: Starting full primary refresh. [2025-09-17T21:32:08.944786] [INFO ] [REMOTE ] SAND: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:32:09.215805] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-01. [2025-09-17T21:32:10.015779] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-11. [2025-09-17T21:32:10.032492] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T21:32:10.284135] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T21:32:10.815789] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-02. [2025-09-17T21:32:11.421004] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T21:32:11.615781] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-05. [2025-09-17T21:32:11.700215] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T21:32:12.415825] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-03. [2025-09-17T21:32:12.677503] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T21:32:13.215799] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-06. [2025-09-17T21:32:13.265185] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T21:32:13.961473] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T21:32:14.015732] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-07. [2025-09-17T21:32:14.815826] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-04. [2025-09-17T21:32:15.298531] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T21:32:15.615802] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-08. [2025-09-17T21:32:15.865829] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T21:32:16.415751] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-01. [2025-09-17T21:32:16.765667] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T21:32:17.215811] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-05. [2025-09-17T21:32:17.972881] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T21:32:18.015748] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-06. [2025-09-17T21:32:18.418319] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T21:32:18.815760] [INFO ] [REMOTE ] SAND: Fetching primary data for 2024-12. [2025-09-17T21:32:18.831855] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-06 (0.82 seconds). [2025-09-17T21:32:19.615796] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-02. [2025-09-17T21:32:20.183042] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2024-12 (1.37 seconds). [2025-09-17T21:32:20.415791] [INFO ] [REMOTE ] SAH: Fetching primary data for 2025-09. [2025-09-17T21:32:21.031910] [INFO ] [REMOTE ] SAH: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T21:32:21.034565] [INFO ] [REMOTE ] SAH: Full fetch complete (30293 records). [2025-09-17T21:32:21.034695] [DEBUG] [VALIDATOR ] SAH: Validating primary data. [2025-09-17T21:32:21.221484] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-07. [2025-09-17T21:32:21.416820] [DEBUG] [VALIDATOR ] SAH: All expected trading days are present. [2025-09-17T21:32:21.416925] [DEBUG] [VALIDATOR ] SAH: Primary data validation passed. [2025-09-17T21:32:21.417744] [INFO ] [MAIN ] SAH: Fetched primary data is valid. [2025-09-17T21:32:21.417859] [DEBUG] [LOCAL ] SAH: Saving primary data. [2025-09-17T21:32:21.419342] [DEBUG] [LOCAL ] SAH: Trimmed 30293 records to 22302 (keeping 200 days of data) [2025-09-17T21:32:21.551181] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T21:32:21.609991] [DEBUG] [LOCAL ] SAH: Primary data saved (22302 records). [2025-09-17T21:32:21.610131] [INFO ] [MAIN ] SAH: Full history saved. [2025-09-17T21:32:21.610220] [INFO ] [MAIN ] Update Progress: 1862/2371 symbols completed. SAH took 41.8s. Estimated remaining: 1h 14m 27s. Rate: 6.8 symbols/min [2025-09-17T21:32:21.782543] [INFO ] [MAIN ] SAP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:32:21.832254] [DEBUG] [LOCAL ] SAP: Loaded 50090 existing records from primary storage. [2025-09-17T21:32:21.832433] [INFO ] [MAIN ] SAP: Loaded 50090 existing records. [2025-09-17T21:32:22.026288] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-01. [2025-09-17T21:32:22.032397] [WARN ] [MAIN ] SAP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:32:22.033765] [INFO ] [MAIN ] SAP: Wiping existing primary data before full refresh. [2025-09-17T21:32:22.033816] [INFO ] [LOCAL ] SAP: Starting deletion of primary data. [2025-09-17T21:32:22.035004] [DEBUG] [LOCAL ] SAP: Deleted primary data file. [2025-09-17T21:32:22.035060] [INFO ] [MAIN ] SAP: Starting full primary refresh. [2025-09-17T21:32:22.538128] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T21:32:22.581014] [INFO ] [REMOTE ] SAP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:32:22.815851] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-11. [2025-09-17T21:32:23.503794] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T21:32:23.615745] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-03. [2025-09-17T21:32:24.415821] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-08. [2025-09-17T21:32:24.583947] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T21:32:25.215691] [INFO ] [REMOTE ] SAP: Fetching primary data for 2024-12. [2025-09-17T21:32:25.256174] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T21:32:25.674114] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T21:32:26.015786] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-04. [2025-09-17T21:32:26.815767] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-02. [2025-09-17T21:32:26.917155] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T21:32:27.615767] [INFO ] [REMOTE ] SAM: Fetching primary data for 2025-09. [2025-09-17T21:32:27.738101] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T21:32:28.025260] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T21:32:28.415804] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-01. [2025-09-17T21:32:28.643066] [INFO ] [REMOTE ] SAM: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T21:32:28.646541] [INFO ] [REMOTE ] SAM: Full fetch complete (30008 records). [2025-09-17T21:32:28.646624] [DEBUG] [VALIDATOR ] SAM: Validating primary data. [2025-09-17T21:32:29.026417] [DEBUG] [VALIDATOR ] SAM: All expected trading days are present. [2025-09-17T21:32:29.026508] [DEBUG] [VALIDATOR ] SAM: Primary data validation passed. [2025-09-17T21:32:29.027139] [INFO ] [MAIN ] SAM: Fetched primary data is valid. [2025-09-17T21:32:29.027196] [DEBUG] [LOCAL ] SAM: Saving primary data. [2025-09-17T21:32:29.028202] [DEBUG] [LOCAL ] SAM: Trimmed 30008 records to 21704 (keeping 200 days of data) [2025-09-17T21:32:29.171829] [DEBUG] [LOCAL ] SAM: Primary data saved (21704 records). [2025-09-17T21:32:29.171962] [INFO ] [MAIN ] SAM: Full history saved. [2025-09-17T21:32:29.172063] [INFO ] [MAIN ] Update Progress: 1863/2371 symbols completed. SAM took 35.6s. Estimated remaining: 1h 14m 18s. Rate: 6.8 symbols/min [2025-09-17T21:32:29.220944] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-05. [2025-09-17T21:32:29.346802] [INFO ] [MAIN ] SAR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:32:29.363673] [DEBUG] [LOCAL ] SAR: Loaded 16529 existing records from primary storage. [2025-09-17T21:32:29.363807] [INFO ] [MAIN ] SAR: Loaded 16529 existing records. [2025-09-17T21:32:29.546174] [WARN ] [MAIN ] SAR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:32:29.546503] [INFO ] [MAIN ] SAR: Wiping existing primary data before full refresh. [2025-09-17T21:32:29.546568] [INFO ] [LOCAL ] SAR: Starting deletion of primary data. [2025-09-17T21:32:29.547165] [DEBUG] [LOCAL ] SAR: Deleted primary data file. [2025-09-17T21:32:29.547225] [INFO ] [MAIN ] SAR: Starting full primary refresh. [2025-09-17T21:32:29.945705] [INFO ] [REMOTE ] SAR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:32:30.015796] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-03. [2025-09-17T21:32:30.336929] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-01 (1.92 seconds). [2025-09-17T21:32:30.815819] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-02. [2025-09-17T21:32:31.119871] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T21:32:31.525699] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T21:32:31.615829] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-04. [2025-09-17T21:32:32.415825] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-06. [2025-09-17T21:32:32.714052] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T21:32:33.215821] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-11. [2025-09-17T21:32:33.461009] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T21:32:34.015774] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-05. [2025-09-17T21:32:34.196340] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T21:32:34.288808] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T21:32:34.815793] [INFO ] [REMOTE ] SAR: Fetching primary data for 2024-12. [2025-09-17T21:32:35.392203] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T21:32:35.615781] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-06. [2025-09-17T21:32:35.683897] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T21:32:36.415811] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-01. [2025-09-17T21:32:37.215750] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-03. [2025-09-17T21:32:37.236950] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-01 (0.82 seconds). [2025-09-17T21:32:37.328624] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T21:32:38.015801] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-02. [2025-09-17T21:32:38.733689] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T21:32:38.815776] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-03. [2025-09-17T21:32:39.108281] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T21:32:39.615808] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-07. [2025-09-17T21:32:39.654596] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T21:32:40.415810] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-04. [2025-09-17T21:32:41.091746] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T21:32:41.215814] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-04. [2025-09-17T21:32:41.605709] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T21:32:42.015812] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-08. [2025-09-17T21:32:42.815823] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-05. [2025-09-17T21:32:42.910950] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T21:32:43.553173] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T21:32:43.599589] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T21:32:43.615816] [INFO ] [REMOTE ] SAND: Fetching primary data for 2025-09. [2025-09-17T21:32:44.415850] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-07. [2025-09-17T21:32:44.867934] [INFO ] [REMOTE ] SAND: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T21:32:44.875321] [INFO ] [REMOTE ] SAND: Full fetch complete (74054 records). [2025-09-17T21:32:44.875536] [DEBUG] [VALIDATOR ] SAND: Validating primary data. [2025-09-17T21:32:45.221132] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-06. [2025-09-17T21:32:45.315067] [DEBUG] [VALIDATOR ] SAND: All expected trading days are present. [2025-09-17T21:32:45.315190] [DEBUG] [VALIDATOR ] SAND: Primary data validation passed. [2025-09-17T21:32:45.316398] [INFO ] [MAIN ] SAND: Fetched primary data is valid. [2025-09-17T21:32:45.316453] [DEBUG] [LOCAL ] SAND: Saving primary data. [2025-09-17T21:32:45.318278] [DEBUG] [LOCAL ] SAND: Trimmed 74054 records to 51758 (keeping 200 days of data) [2025-09-17T21:32:45.655524] [DEBUG] [LOCAL ] SAND: Primary data saved (51758 records). [2025-09-17T21:32:45.655710] [INFO ] [MAIN ] SAND: Full history saved. [2025-09-17T21:32:45.655805] [INFO ] [MAIN ] Update Progress: 1864/2371 symbols completed. SAND took 37.5s. Estimated remaining: 1h 14m 11s. Rate: 6.8 symbols/min [2025-09-17T21:32:45.838678] [INFO ] [MAIN ] SARO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:32:45.884110] [DEBUG] [LOCAL ] SARO: Loaded 48767 existing records from primary storage. [2025-09-17T21:32:45.884265] [INFO ] [MAIN ] SARO: Loaded 48767 existing records. [2025-09-17T21:32:46.020935] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-05. [2025-09-17T21:32:46.072763] [WARN ] [MAIN ] SARO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:32:46.072999] [INFO ] [MAIN ] SARO: Wiping existing primary data before full refresh. [2025-09-17T21:32:46.073044] [INFO ] [LOCAL ] SARO: Starting deletion of primary data. [2025-09-17T21:32:46.074368] [DEBUG] [LOCAL ] SARO: Deleted primary data file. [2025-09-17T21:32:46.074426] [INFO ] [MAIN ] SARO: Starting full primary refresh. [2025-09-17T21:32:46.422169] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T21:32:46.466464] [INFO ] [REMOTE ] SARO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:32:46.586340] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-07 (2.17 seconds). [2025-09-17T21:32:46.815812] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-07. [2025-09-17T21:32:47.615769] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-11. [2025-09-17T21:32:48.035939] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T21:32:48.070506] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T21:32:48.415838] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-08. [2025-09-17T21:32:48.775426] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T21:32:49.215773] [INFO ] [REMOTE ] SARO: Fetching primary data for 2024-12. [2025-09-17T21:32:49.971341] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T21:32:50.015730] [INFO ] [REMOTE ] SAN: Fetching primary data for 2025-09. [2025-09-17T21:32:50.608837] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T21:32:50.815782] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-01. [2025-09-17T21:32:51.446218] [INFO ] [REMOTE ] SAN: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T21:32:51.453955] [INFO ] [REMOTE ] SAN: Full fetch complete (76098 records). [2025-09-17T21:32:51.454199] [DEBUG] [VALIDATOR ] SAN: Validating primary data. [2025-09-17T21:32:51.621013] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-08. [2025-09-17T21:32:51.884637] [DEBUG] [VALIDATOR ] SAN: All expected trading days are present. [2025-09-17T21:32:51.884779] [DEBUG] [VALIDATOR ] SAN: Primary data validation passed. [2025-09-17T21:32:51.886231] [INFO ] [MAIN ] SAN: Fetched primary data is valid. [2025-09-17T21:32:51.886283] [DEBUG] [LOCAL ] SAN: Saving primary data. [2025-09-17T21:32:51.888473] [DEBUG] [LOCAL ] SAN: Trimmed 76098 records to 53041 (keeping 200 days of data) [2025-09-17T21:32:52.246749] [DEBUG] [LOCAL ] SAN: Primary data saved (53041 records). [2025-09-17T21:32:52.247217] [INFO ] [MAIN ] SAN: Full history saved. [2025-09-17T21:32:52.247378] [INFO ] [MAIN ] Update Progress: 1865/2371 symbols completed. SAN took 48.2s. Estimated remaining: 1h 14m 2s. Rate: 6.8 symbols/min [2025-09-17T21:32:52.415835] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-06. [2025-09-17T21:32:52.446903] [INFO ] [MAIN ] SAT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:32:52.447570] [DEBUG] [LOCAL ] SAT: No existing data file found in primary storage. [2025-09-17T21:32:52.447677] [WARN ] [MAIN ] SAT: No existing data found, performing full refresh instead. [2025-09-17T21:32:52.461686] [INFO ] [MAIN ] SAT: Wiping existing primary data before full refresh. [2025-09-17T21:32:52.463102] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-17T21:32:52.464468] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-17T21:32:52.464339] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T21:32:52.464746] [INFO ] [MAIN ] SAT: Starting full primary refresh. [2025-09-17T21:32:52.639073] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T21:32:52.905141] [INFO ] [REMOTE ] SAT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:32:53.215774] [INFO ] [REMOTE ] SAR: Fetching primary data for 2025-09. [2025-09-17T21:32:54.015792] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-02. [2025-09-17T21:32:54.151337] [INFO ] [REMOTE ] SAR: Incremental fetch complete for 2025-09 (0.94 seconds). [2025-09-17T21:32:54.154563] [INFO ] [REMOTE ] SAR: Full fetch complete (22705 records). [2025-09-17T21:32:54.154790] [DEBUG] [VALIDATOR ] SAR: Validating primary data. [2025-09-17T21:32:54.558299] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-06 (2.14 seconds). [2025-09-17T21:32:54.576379] [DEBUG] [VALIDATOR ] SAR: All expected trading days are present. [2025-09-17T21:32:54.576606] [DEBUG] [VALIDATOR ] SAR: Primary data validation passed. [2025-09-17T21:32:54.578330] [INFO ] [MAIN ] SAR: Fetched primary data is valid. [2025-09-17T21:32:54.578709] [DEBUG] [LOCAL ] SAR: Saving primary data. [2025-09-17T21:32:54.580528] [DEBUG] [LOCAL ] SAR: Trimmed 22705 records to 16499 (keeping 200 days of data) [2025-09-17T21:32:54.687518] [DEBUG] [LOCAL ] SAR: Primary data saved (16499 records). [2025-09-17T21:32:54.687693] [INFO ] [MAIN ] SAR: Full history saved. [2025-09-17T21:32:54.687833] [INFO ] [MAIN ] Update Progress: 1866/2371 symbols completed. SAR took 25.5s. Estimated remaining: 1h 13m 51s. Rate: 6.8 symbols/min [2025-09-17T21:32:54.827607] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-07. [2025-09-17T21:32:54.871393] [INFO ] [MAIN ] SAY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:32:54.871556] [DEBUG] [LOCAL ] SAY: No existing data file found in primary storage. [2025-09-17T21:32:54.871593] [WARN ] [MAIN ] SAY: No existing data found, performing full refresh instead. [2025-09-17T21:32:54.871729] [INFO ] [MAIN ] SAY: Wiping existing primary data before full refresh. [2025-09-17T21:32:54.871793] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-17T21:32:54.871871] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-17T21:32:54.871928] [INFO ] [MAIN ] SAY: Starting full primary refresh. [2025-09-17T21:32:55.232124] [INFO ] [REMOTE ] SAY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:32:55.252848] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T21:32:55.615774] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-03. [2025-09-17T21:32:56.415794] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-11. [2025-09-17T21:32:56.894624] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T21:32:56.933767] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T21:32:57.215760] [INFO ] [REMOTE ] SAT: Fetching primary data for 2024-12. [2025-09-17T21:32:57.351989] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T21:32:57.618953] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-17T21:32:58.015791] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-01. [2025-09-17T21:32:58.676671] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-01 (0.66 seconds). [2025-09-17T21:32:58.815741] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-02. [2025-09-17T21:32:59.154921] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-02 (0.34 seconds). [2025-09-17T21:32:59.615773] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-03. [2025-09-17T21:33:00.415793] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-08. [2025-09-17T21:33:00.447374] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T21:33:01.215804] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-04. [2025-09-17T21:33:01.630545] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-17T21:33:02.015773] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-11. [2025-09-17T21:33:02.447157] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T21:33:02.815766] [INFO ] [REMOTE ] SAP: Fetching primary data for 2025-09. [2025-09-17T21:33:03.502014] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T21:33:03.615782] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-05. [2025-09-17T21:33:04.308856] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T21:33:04.415775] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-06. [2025-09-17T21:33:04.990011] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-06 (0.57 seconds). [2025-09-17T21:33:05.215755] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-04. [2025-09-17T21:33:05.309935] [INFO ] [REMOTE ] SAP: Incremental fetch complete for 2025-09 (2.49 seconds). [2025-09-17T21:33:05.316675] [INFO ] [REMOTE ] SAP: Full fetch complete (71368 records). [2025-09-17T21:33:05.316796] [DEBUG] [VALIDATOR ] SAP: Validating primary data. [2025-09-17T21:33:05.725230] [DEBUG] [VALIDATOR ] SAP: All expected trading days are present. [2025-09-17T21:33:05.725335] [DEBUG] [VALIDATOR ] SAP: Primary data validation passed. [2025-09-17T21:33:05.726382] [INFO ] [MAIN ] SAP: Fetched primary data is valid. [2025-09-17T21:33:05.726431] [DEBUG] [LOCAL ] SAP: Saving primary data. [2025-09-17T21:33:05.728892] [DEBUG] [LOCAL ] SAP: Trimmed 71368 records to 50093 (keeping 200 days of data) [2025-09-17T21:33:06.020473] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-07. [2025-09-17T21:33:06.053498] [DEBUG] [LOCAL ] SAP: Primary data saved (50093 records). [2025-09-17T21:33:06.053665] [INFO ] [MAIN ] SAP: Full history saved. [2025-09-17T21:33:06.053772] [INFO ] [MAIN ] Update Progress: 1867/2371 symbols completed. SAP took 44.4s. Estimated remaining: 1h 13m 43s. Rate: 6.8 symbols/min [2025-09-17T21:33:06.230662] [INFO ] [MAIN ] SAZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:33:06.230834] [DEBUG] [LOCAL ] SAZ: No existing data file found in primary storage. [2025-09-17T21:33:06.230875] [WARN ] [MAIN ] SAZ: No existing data found, performing full refresh instead. [2025-09-17T21:33:06.231023] [INFO ] [MAIN ] SAZ: Wiping existing primary data before full refresh. [2025-09-17T21:33:06.231073] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-17T21:33:06.231116] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-17T21:33:06.231155] [INFO ] [MAIN ] SAZ: Starting full primary refresh. [2025-09-17T21:33:06.476944] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T21:33:06.625798] [INFO ] [REMOTE ] SAZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:33:06.815737] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-11. [2025-09-17T21:33:07.087113] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T21:33:07.084675] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-11 (0.27 seconds). [2025-09-17T21:33:07.615797] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-05. [2025-09-17T21:33:08.415787] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2024-12. [2025-09-17T21:33:08.708475] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2024-12 (0.29 seconds). [2025-09-17T21:33:09.088583] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T21:33:09.215764] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-06. [2025-09-17T21:33:10.015840] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-08. [2025-09-17T21:33:10.311107] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-17T21:33:10.815757] [INFO ] [REMOTE ] SAY: Fetching primary data for 2024-12. [2025-09-17T21:33:10.877559] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T21:33:11.294793] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2024-12 (0.48 seconds). [2025-09-17T21:33:11.615836] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-01. [2025-09-17T21:33:11.905537] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-17T21:33:12.415795] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-01. [2025-09-17T21:33:12.709590] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-01 (0.29 seconds). [2025-09-17T21:33:13.215808] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-02. [2025-09-17T21:33:13.504853] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-02 (0.29 seconds). [2025-09-17T21:33:14.015779] [INFO ] [REMOTE ] SAT: Fetching primary data for 2025-09. [2025-09-17T21:33:14.277518] [INFO ] [REMOTE ] SAT: Incremental fetch complete for 2025-09 (0.26 seconds). [2025-09-17T21:33:14.278268] [INFO ] [REMOTE ] SAT: Full fetch complete (1621 records). [2025-09-17T21:33:14.278339] [DEBUG] [VALIDATOR ] SAT: Validating primary data. [2025-09-17T21:33:14.461564] [WARN ] [VALIDATOR ] SAT: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-17T21:33:14.461819] [FATAL] [MAIN ] SAT: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:33:14.461879] [WARN ] [MAIN ] SAT: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:33:14.461924] [INFO ] [LOCAL ] SAT: Starting deletion of primary data. [2025-09-17T21:33:14.461982] [DEBUG] [LOCAL ] SAT: No primary data file found to delete. [2025-09-17T21:33:14.462030] [INFO ] [LOCAL ] SAT: Starting deletion of derivative data. [2025-09-17T21:33:14.462080] [DEBUG] [LOCAL ] SAT: No derivative data file found to delete. [2025-09-17T21:33:14.462143] [INFO ] [MAIN ] Update Progress: 1868/2371 symbols completed. SAT took 22.2s. Estimated remaining: 1h 13m 34s. Rate: 6.8 symbols/min [2025-09-17T21:33:14.633414] [INFO ] [MAIN ] SB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:33:14.679407] [DEBUG] [LOCAL ] SB: Loaded 33778 existing records from primary storage. [2025-09-17T21:33:14.679552] [INFO ] [MAIN ] SB: Loaded 33778 existing records. [2025-09-17T21:33:14.822350] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-02. [2025-09-17T21:33:14.862927] [WARN ] [MAIN ] SB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:33:14.863158] [INFO ] [MAIN ] SB: Wiping existing primary data before full refresh. [2025-09-17T21:33:14.863205] [INFO ] [LOCAL ] SB: Starting deletion of primary data. [2025-09-17T21:33:14.864271] [DEBUG] [LOCAL ] SB: Deleted primary data file. [2025-09-17T21:33:14.864335] [INFO ] [MAIN ] SB: Starting full primary refresh. [2025-09-17T21:33:15.225296] [INFO ] [REMOTE ] SB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:33:15.523242] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-02 (0.70 seconds). [2025-09-17T21:33:15.615812] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-03. [2025-09-17T21:33:15.955893] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-17T21:33:16.415785] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-03. [2025-09-17T21:33:16.854310] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-03 (0.44 seconds). [2025-09-17T21:33:17.215819] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-07. [2025-09-17T21:33:18.015796] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-11. [2025-09-17T21:33:18.815763] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-04. [2025-09-17T21:33:18.925226] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T21:33:19.270096] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-04 (0.45 seconds). [2025-09-17T21:33:19.451099] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T21:33:19.615788] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-08. [2025-09-17T21:33:20.415823] [INFO ] [REMOTE ] SB: Fetching primary data for 2024-12. [2025-09-17T21:33:21.215778] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-04. [2025-09-17T21:33:21.301011] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T21:33:22.015804] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-05. [2025-09-17T21:33:22.522509] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2024-12 (2.11 seconds). [2025-09-17T21:33:22.533982] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-04 (1.32 seconds). [2025-09-17T21:33:22.815772] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-01. [2025-09-17T21:33:23.255721] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T21:33:23.615816] [INFO ] [REMOTE ] SARO: Fetching primary data for 2025-09. [2025-09-17T21:33:24.099112] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T21:33:24.415800] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-06. [2025-09-17T21:33:24.803400] [INFO ] [REMOTE ] SARO: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T21:33:24.810177] [INFO ] [REMOTE ] SARO: Full fetch complete (68709 records). [2025-09-17T21:33:24.810293] [DEBUG] [VALIDATOR ] SARO: Validating primary data. [2025-09-17T21:33:24.974047] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-06 (0.56 seconds). [2025-09-17T21:33:25.212291] [DEBUG] [VALIDATOR ] SARO: All expected trading days are present. [2025-09-17T21:33:25.212396] [DEBUG] [VALIDATOR ] SARO: Primary data validation passed. [2025-09-17T21:33:25.213494] [INFO ] [MAIN ] SARO: Fetched primary data is valid. [2025-09-17T21:33:25.213543] [DEBUG] [LOCAL ] SARO: Saving primary data. [2025-09-17T21:33:25.214961] [DEBUG] [LOCAL ] SARO: Trimmed 68709 records to 48817 (keeping 200 days of data) [2025-09-17T21:33:25.215762] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-05. [2025-09-17T21:33:25.513356] [DEBUG] [LOCAL ] SARO: Primary data saved (48817 records). [2025-09-17T21:33:25.513508] [INFO ] [MAIN ] SARO: Full history saved. [2025-09-17T21:33:25.513618] [INFO ] [MAIN ] Update Progress: 1869/2371 symbols completed. SARO took 39.9s. Estimated remaining: 1h 13m 26s. Rate: 6.8 symbols/min [2025-09-17T21:33:25.684830] [INFO ] [MAIN ] SBDS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:33:25.685007] [DEBUG] [LOCAL ] SBDS: No existing data file found in primary storage. [2025-09-17T21:33:25.685044] [WARN ] [MAIN ] SBDS: No existing data found, performing full refresh instead. [2025-09-17T21:33:25.685218] [INFO ] [MAIN ] SBDS: Wiping existing primary data before full refresh. [2025-09-17T21:33:25.685269] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-17T21:33:25.685365] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-17T21:33:25.685413] [INFO ] [MAIN ] SBDS: Starting full primary refresh. [2025-09-17T21:33:25.753761] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T21:33:26.023942] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-02. [2025-09-17T21:33:26.053257] [INFO ] [REMOTE ] SBDS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:33:26.815797] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-06. [2025-09-17T21:33:27.135785] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-06 (0.32 seconds). [2025-09-17T21:33:27.479946] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T21:33:27.615770] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-11. [2025-09-17T21:33:27.835701] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:33:27.836027] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-11 [2025-09-17T21:33:28.415785] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-07. [2025-09-17T21:33:28.730834] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-07 (0.32 seconds). [2025-09-17T21:33:29.215768] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-08. [2025-09-17T21:33:29.517728] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-17T21:33:30.015831] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-03. [2025-09-17T21:33:30.815835] [INFO ] [REMOTE ] SAY: Fetching primary data for 2025-09. [2025-09-17T21:33:31.100011] [INFO ] [REMOTE ] SAY: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-17T21:33:31.100766] [INFO ] [REMOTE ] SAY: Full fetch complete (1466 records). [2025-09-17T21:33:31.100834] [DEBUG] [VALIDATOR ] SAY: Validating primary data. [2025-09-17T21:33:31.278448] [WARN ] [VALIDATOR ] SAY: Validation failed - insufficient historical data. Have 195 unique days, need 200 days [2025-09-17T21:33:31.278683] [FATAL] [MAIN ] SAY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:33:31.278729] [WARN ] [MAIN ] SAY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:33:31.278769] [INFO ] [LOCAL ] SAY: Starting deletion of primary data. [2025-09-17T21:33:31.278844] [DEBUG] [LOCAL ] SAY: No primary data file found to delete. [2025-09-17T21:33:31.278881] [INFO ] [LOCAL ] SAY: Starting deletion of derivative data. [2025-09-17T21:33:31.278920] [DEBUG] [LOCAL ] SAY: No derivative data file found to delete. [2025-09-17T21:33:31.278994] [INFO ] [MAIN ] Update Progress: 1870/2371 symbols completed. SAY took 36.6s. Estimated remaining: 1h 13m 16s. Rate: 6.8 symbols/min [2025-09-17T21:33:31.447435] [INFO ] [MAIN ] SBH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:33:31.501240] [DEBUG] [LOCAL ] SBH: Loaded 49788 existing records from primary storage. [2025-09-17T21:33:31.501399] [INFO ] [MAIN ] SBH: Loaded 49788 existing records. [2025-09-17T21:33:31.618110] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-07. [2025-09-17T21:33:31.690096] [WARN ] [MAIN ] SBH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:33:31.690578] [INFO ] [MAIN ] SBH: Wiping existing primary data before full refresh. [2025-09-17T21:33:31.690629] [INFO ] [LOCAL ] SBH: Starting deletion of primary data. [2025-09-17T21:33:31.714781] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T21:33:31.714839] [DEBUG] [LOCAL ] SBH: Deleted primary data file. [2025-09-17T21:33:31.722560] [INFO ] [MAIN ] SBH: Starting full primary refresh. [2025-09-17T21:33:32.057298] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T21:33:32.086032] [INFO ] [REMOTE ] SBH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:33:32.415775] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-11. [2025-09-17T21:33:33.215849] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2024-12. [2025-09-17T21:33:33.407563] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:33:33.408026] [WARN ] [REMOTE ] SBDS: No data returned for month 2024-12 [2025-09-17T21:33:33.705516] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T21:33:34.015832] [INFO ] [REMOTE ] SBH: Fetching primary data for 2024-12. [2025-09-17T21:33:34.815794] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-04. [2025-09-17T21:33:35.615847] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-01. [2025-09-17T21:33:35.686188] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T21:33:35.848097] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:33:35.848465] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-01 [2025-09-17T21:33:36.272749] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T21:33:36.415786] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-08. [2025-09-17T21:33:36.787520] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-17T21:33:37.215772] [INFO ] [REMOTE ] SAZ: Fetching primary data for 2025-09. [2025-09-17T21:33:37.469626] [INFO ] [REMOTE ] SAZ: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-17T21:33:37.470393] [INFO ] [REMOTE ] SAZ: Full fetch complete (1817 records). [2025-09-17T21:33:37.470463] [DEBUG] [VALIDATOR ] SAZ: Validating primary data. [2025-09-17T21:33:37.652431] [WARN ] [VALIDATOR ] SAZ: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T21:33:37.652622] [FATAL] [MAIN ] SAZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:33:37.652689] [WARN ] [MAIN ] SAZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:33:37.652747] [INFO ] [LOCAL ] SAZ: Starting deletion of primary data. [2025-09-17T21:33:37.652808] [DEBUG] [LOCAL ] SAZ: No primary data file found to delete. [2025-09-17T21:33:37.652846] [INFO ] [LOCAL ] SAZ: Starting deletion of derivative data. [2025-09-17T21:33:37.652900] [DEBUG] [LOCAL ] SAZ: No derivative data file found to delete. [2025-09-17T21:33:37.652962] [INFO ] [MAIN ] Update Progress: 1871/2371 symbols completed. SAZ took 31.6s. Estimated remaining: 1h 13m 7s. Rate: 6.8 symbols/min [2025-09-17T21:33:37.823124] [INFO ] [MAIN ] SBI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:33:37.834225] [DEBUG] [LOCAL ] SBI: Loaded 7698 existing records from primary storage. [2025-09-17T21:33:37.834375] [INFO ] [MAIN ] SBI: Loaded 7698 existing records. [2025-09-17T21:33:38.017826] [WARN ] [MAIN ] SBI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:33:38.017912] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-05. [2025-09-17T21:33:38.018380] [INFO ] [MAIN ] SBI: Wiping existing primary data before full refresh. [2025-09-17T21:33:38.019452] [INFO ] [LOCAL ] SBI: Starting deletion of primary data. [2025-09-17T21:33:38.019773] [DEBUG] [LOCAL ] SBI: Deleted primary data file. [2025-09-17T21:33:38.019819] [INFO ] [MAIN ] SBI: Starting full primary refresh. [2025-09-17T21:33:38.403009] [INFO ] [REMOTE ] SBI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:33:38.815792] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-02. [2025-09-17T21:33:39.348304] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:33:39.348660] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-02 [2025-09-17T21:33:39.536628] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T21:33:39.615801] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-11. [2025-09-17T21:33:40.275711] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T21:33:40.415806] [INFO ] [REMOTE ] SBI: Fetching primary data for 2024-12. [2025-09-17T21:33:40.869239] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T21:33:41.215799] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-01. [2025-09-17T21:33:41.901543] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T21:33:42.015788] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-02. [2025-09-17T21:33:42.593268] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T21:33:42.815779] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-06. [2025-09-17T21:33:43.615795] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-01. [2025-09-17T21:33:43.748741] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-06 (0.93 seconds). [2025-09-17T21:33:44.415800] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-03. [2025-09-17T21:33:44.658200] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:33:44.658521] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-03 [2025-09-17T21:33:44.879633] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T21:33:45.215785] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-07. [2025-09-17T21:33:46.015789] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-03. [2025-09-17T21:33:46.327697] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T21:33:46.710349] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-03 (0.69 seconds). [2025-09-17T21:33:46.815753] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-04. [2025-09-17T21:33:47.333606] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-04 (0.52 seconds). [2025-09-17T21:33:47.615794] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-02. [2025-09-17T21:33:48.415781] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-05. [2025-09-17T21:33:48.818852] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T21:33:48.921197] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T21:33:49.215790] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-03. [2025-09-17T21:33:50.015784] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-06. [2025-09-17T21:33:50.624584] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T21:33:50.815788] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-08. [2025-09-17T21:33:50.911016] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T21:33:51.615772] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-04. [2025-09-17T21:33:51.817209] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:33:51.817737] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-04 [2025-09-17T21:33:52.069885] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T21:33:52.415789] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-05. [2025-09-17T21:33:52.616749] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:33:52.617108] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-05 [2025-09-17T21:33:53.215772] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-06. [2025-09-17T21:33:53.456913] [DEBUG] [REMOTE ] SBDS: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:33:53.457247] [WARN ] [REMOTE ] SBDS: No data returned for month 2025-06 [2025-09-17T21:33:54.015793] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-04. [2025-09-17T21:33:54.815775] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-07. [2025-09-17T21:33:55.079799] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-07 (0.26 seconds). [2025-09-17T21:33:55.615803] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-08. [2025-09-17T21:33:55.719866] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T21:33:56.104931] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T21:33:56.415789] [INFO ] [REMOTE ] SB: Fetching primary data for 2025-09. [2025-09-17T21:33:57.215783] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-05. [2025-09-17T21:33:57.576096] [INFO ] [REMOTE ] SB: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T21:33:57.580170] [INFO ] [REMOTE ] SB: Full fetch complete (50949 records). [2025-09-17T21:33:57.580275] [DEBUG] [VALIDATOR ] SB: Validating primary data. [2025-09-17T21:33:57.959834] [DEBUG] [VALIDATOR ] SB: All expected trading days are present. [2025-09-17T21:33:57.959918] [DEBUG] [VALIDATOR ] SB: Primary data validation passed. [2025-09-17T21:33:57.960761] [INFO ] [MAIN ] SB: Fetched primary data is valid. [2025-09-17T21:33:57.960805] [DEBUG] [LOCAL ] SB: Saving primary data. [2025-09-17T21:33:57.961870] [DEBUG] [LOCAL ] SB: Trimmed 50949 records to 33697 (keeping 200 days of data) [2025-09-17T21:33:58.017538] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-07. [2025-09-17T21:33:58.166997] [DEBUG] [LOCAL ] SB: Primary data saved (33697 records). [2025-09-17T21:33:58.167148] [INFO ] [MAIN ] SB: Full history saved. [2025-09-17T21:33:58.167236] [INFO ] [MAIN ] Update Progress: 1872/2371 symbols completed. SB took 43.7s. Estimated remaining: 1h 13m 1s. Rate: 6.8 symbols/min [2025-09-17T21:33:58.335954] [INFO ] [MAIN ] SBR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:33:58.344681] [DEBUG] [LOCAL ] SBR: Loaded 7276 existing records from primary storage. [2025-09-17T21:33:58.344795] [INFO ] [MAIN ] SBR: Loaded 7276 existing records. [2025-09-17T21:33:58.523861] [WARN ] [MAIN ] SBR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:33:58.524125] [INFO ] [MAIN ] SBR: Wiping existing primary data before full refresh. [2025-09-17T21:33:58.524169] [INFO ] [LOCAL ] SBR: Starting deletion of primary data. [2025-09-17T21:33:58.524439] [DEBUG] [LOCAL ] SBR: Deleted primary data file. [2025-09-17T21:33:58.524483] [INFO ] [MAIN ] SBR: Starting full primary refresh. [2025-09-17T21:33:58.821944] [INFO ] [REMOTE ] SBDS: Fetching primary data for 2025-09. [2025-09-17T21:33:58.895819] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-07 (0.88 seconds). [2025-09-17T21:33:58.895416] [INFO ] [REMOTE ] SBR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:33:59.014459] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T21:33:59.356213] [INFO ] [REMOTE ] SBDS: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T21:33:59.357337] [INFO ] [REMOTE ] SBDS: Full fetch complete (934 records). [2025-09-17T21:33:59.357418] [DEBUG] [VALIDATOR ] SBDS: Validating primary data. [2025-09-17T21:33:59.533696] [WARN ] [VALIDATOR ] SBDS: Validation failed - insufficient historical data. Have 39 unique days, need 200 days [2025-09-17T21:33:59.533887] [FATAL] [MAIN ] SBDS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:33:59.533935] [WARN ] [MAIN ] SBDS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:33:59.533979] [INFO ] [LOCAL ] SBDS: Starting deletion of primary data. [2025-09-17T21:33:59.534034] [DEBUG] [LOCAL ] SBDS: No primary data file found to delete. [2025-09-17T21:33:59.534068] [INFO ] [LOCAL ] SBDS: Starting deletion of derivative data. [2025-09-17T21:33:59.534108] [DEBUG] [LOCAL ] SBDS: No derivative data file found to delete. [2025-09-17T21:33:59.534217] [INFO ] [MAIN ] Update Progress: 1873/2371 symbols completed. SBDS took 34.0s. Estimated remaining: 1h 12m 50s. Rate: 6.8 symbols/min [2025-09-17T21:33:59.620864] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-08. [2025-09-17T21:33:59.708436] [INFO ] [MAIN ] SBS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:33:59.754730] [DEBUG] [LOCAL ] SBS: Loaded 49352 existing records from primary storage. [2025-09-17T21:33:59.754872] [INFO ] [MAIN ] SBS: Loaded 49352 existing records. [2025-09-17T21:33:59.932619] [WARN ] [MAIN ] SBS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:33:59.932860] [INFO ] [MAIN ] SBS: Wiping existing primary data before full refresh. [2025-09-17T21:33:59.932903] [INFO ] [LOCAL ] SBS: Starting deletion of primary data. [2025-09-17T21:33:59.933808] [DEBUG] [LOCAL ] SBS: Deleted primary data file. [2025-09-17T21:33:59.933874] [INFO ] [MAIN ] SBS: Starting full primary refresh. [2025-09-17T21:34:00.286117] [INFO ] [REMOTE ] SBS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:34:00.415758] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-06. [2025-09-17T21:34:00.554587] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T21:34:01.215790] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-11. [2025-09-17T21:34:01.748638] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T21:34:02.015783] [INFO ] [REMOTE ] SBI: Fetching primary data for 2025-09. [2025-09-17T21:34:02.177390] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T21:34:02.384027] [INFO ] [REMOTE ] SBI: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T21:34:02.385243] [INFO ] [REMOTE ] SBI: Full fetch complete (10624 records). [2025-09-17T21:34:02.385326] [DEBUG] [VALIDATOR ] SBI: Validating primary data. [2025-09-17T21:34:02.757007] [DEBUG] [VALIDATOR ] SBI: All expected trading days are present. [2025-09-17T21:34:02.757089] [DEBUG] [VALIDATOR ] SBI: Primary data validation passed. [2025-09-17T21:34:02.757399] [INFO ] [MAIN ] SBI: Fetched primary data is valid. [2025-09-17T21:34:02.757467] [DEBUG] [LOCAL ] SBI: Saving primary data. [2025-09-17T21:34:02.758025] [DEBUG] [LOCAL ] SBI: Trimmed 10624 records to 7713 (keeping 200 days of data) [2025-09-17T21:34:02.804043] [DEBUG] [LOCAL ] SBI: Primary data saved (7713 records). [2025-09-17T21:34:02.804155] [INFO ] [MAIN ] SBI: Full history saved. [2025-09-17T21:34:02.804264] [INFO ] [MAIN ] Update Progress: 1874/2371 symbols completed. SBI took 25.2s. Estimated remaining: 1h 12m 40s. Rate: 6.8 symbols/min [2025-09-17T21:34:02.821489] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-11. [2025-09-17T21:34:02.985606] [INFO ] [MAIN ] SBSI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:34:03.001687] [DEBUG] [LOCAL ] SBSI: Loaded 14601 existing records from primary storage. [2025-09-17T21:34:03.001838] [INFO ] [MAIN ] SBSI: Loaded 14601 existing records. [2025-09-17T21:34:03.184531] [WARN ] [MAIN ] SBSI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:34:03.184813] [INFO ] [MAIN ] SBSI: Wiping existing primary data before full refresh. [2025-09-17T21:34:03.184861] [INFO ] [LOCAL ] SBSI: Starting deletion of primary data. [2025-09-17T21:34:03.185235] [DEBUG] [LOCAL ] SBSI: Deleted primary data file. [2025-09-17T21:34:03.185283] [INFO ] [MAIN ] SBSI: Starting full primary refresh. [2025-09-17T21:34:03.556617] [INFO ] [REMOTE ] SBSI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:34:03.615751] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-11. [2025-09-17T21:34:04.144239] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T21:34:04.415803] [INFO ] [REMOTE ] SBS: Fetching primary data for 2024-12. [2025-09-17T21:34:04.513425] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T21:34:05.215811] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-07. [2025-09-17T21:34:06.004091] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T21:34:06.015675] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-01. [2025-09-17T21:34:06.577099] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T21:34:06.815801] [INFO ] [REMOTE ] SBR: Fetching primary data for 2024-12. [2025-09-17T21:34:07.486995] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T21:34:07.593805] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T21:34:07.615716] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-01. [2025-09-17T21:34:08.372284] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T21:34:08.415795] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-08. [2025-09-17T21:34:09.215818] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-02. [2025-09-17T21:34:10.015753] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-02. [2025-09-17T21:34:10.057298] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T21:34:10.285448] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T21:34:10.820795] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2024-12. [2025-09-17T21:34:10.821684] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T21:34:11.497528] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T21:34:11.615804] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-03. [2025-09-17T21:34:12.415779] [INFO ] [REMOTE ] SBH: Fetching primary data for 2025-09. [2025-09-17T21:34:13.215752] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-03. [2025-09-17T21:34:13.316738] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T21:34:13.856077] [INFO ] [REMOTE ] SBH: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T21:34:13.862851] [INFO ] [REMOTE ] SBH: Full fetch complete (72626 records). [2025-09-17T21:34:13.862972] [DEBUG] [VALIDATOR ] SBH: Validating primary data. [2025-09-17T21:34:14.022073] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-01. [2025-09-17T21:34:14.102720] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T21:34:14.273119] [DEBUG] [VALIDATOR ] SBH: All expected trading days are present. [2025-09-17T21:34:14.273216] [DEBUG] [VALIDATOR ] SBH: Primary data validation passed. [2025-09-17T21:34:14.274565] [INFO ] [MAIN ] SBH: Fetched primary data is valid. [2025-09-17T21:34:14.274620] [DEBUG] [LOCAL ] SBH: Saving primary data. [2025-09-17T21:34:14.276270] [DEBUG] [LOCAL ] SBH: Trimmed 72626 records to 49807 (keeping 200 days of data) [2025-09-17T21:34:14.579914] [DEBUG] [LOCAL ] SBH: Primary data saved (49807 records). [2025-09-17T21:34:14.580076] [INFO ] [MAIN ] SBH: Full history saved. [2025-09-17T21:34:14.580985] [INFO ] [MAIN ] Update Progress: 1875/2371 symbols completed. SBH took 43.3s. Estimated remaining: 1h 12m 32s. Rate: 6.8 symbols/min [2025-09-17T21:34:14.756888] [INFO ] [MAIN ] SBSW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:34:14.812200] [DEBUG] [LOCAL ] SBSW: Loaded 52930 existing records from primary storage. [2025-09-17T21:34:14.812347] [INFO ] [MAIN ] SBSW: Loaded 52930 existing records. [2025-09-17T21:34:14.823524] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-04. [2025-09-17T21:34:15.000096] [WARN ] [MAIN ] SBSW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:34:15.000378] [INFO ] [MAIN ] SBSW: Wiping existing primary data before full refresh. [2025-09-17T21:34:15.000427] [INFO ] [LOCAL ] SBSW: Starting deletion of primary data. [2025-09-17T21:34:15.001431] [DEBUG] [LOCAL ] SBSW: Deleted primary data file. [2025-09-17T21:34:15.001499] [INFO ] [MAIN ] SBSW: Starting full primary refresh. [2025-09-17T21:34:15.241732] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T21:34:15.383749] [INFO ] [REMOTE ] SBSW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:34:15.615805] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-11. [2025-09-17T21:34:16.415787] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-02. [2025-09-17T21:34:16.513482] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T21:34:17.063305] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T21:34:17.110444] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T21:34:17.215757] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2024-12. [2025-09-17T21:34:18.015830] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-04. [2025-09-17T21:34:18.815682] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-05. [2025-09-17T21:34:18.957472] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T21:34:18.979172] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-04 (0.96 seconds). [2025-09-17T21:34:19.615809] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-01. [2025-09-17T21:34:20.107828] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T21:34:20.415822] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-06. [2025-09-17T21:34:21.215777] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-05. [2025-09-17T21:34:21.422374] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T21:34:21.715136] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T21:34:21.761070] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-06 (1.35 seconds). [2025-09-17T21:34:22.015827] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-07. [2025-09-17T21:34:22.815826] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-02. [2025-09-17T21:34:23.615784] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-06. [2025-09-17T21:34:23.721292] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T21:34:24.356261] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-06 (0.74 seconds). [2025-09-17T21:34:24.401983] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T21:34:24.415739] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-03. [2025-09-17T21:34:25.215812] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-07. [2025-09-17T21:34:25.986427] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T21:34:25.981531] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-07 (0.77 seconds). [2025-09-17T21:34:26.015773] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-03. [2025-09-17T21:34:26.815841] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-08. [2025-09-17T21:34:27.045943] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T21:34:27.615878] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-04. [2025-09-17T21:34:28.214887] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T21:34:28.415825] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-08. [2025-09-17T21:34:29.215785] [INFO ] [REMOTE ] SBS: Fetching primary data for 2025-09. [2025-09-17T21:34:29.238600] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T21:34:29.536041] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T21:34:30.015836] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-05. [2025-09-17T21:34:30.733012] [INFO ] [REMOTE ] SBS: Incremental fetch complete for 2025-09 (1.52 seconds). [2025-09-17T21:34:30.739875] [INFO ] [REMOTE ] SBS: Full fetch complete (70000 records). [2025-09-17T21:34:30.740034] [DEBUG] [VALIDATOR ] SBS: Validating primary data. [2025-09-17T21:34:30.821089] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-04. [2025-09-17T21:34:31.139525] [DEBUG] [VALIDATOR ] SBS: All expected trading days are present. [2025-09-17T21:34:31.139685] [DEBUG] [VALIDATOR ] SBS: Primary data validation passed. [2025-09-17T21:34:31.140743] [INFO ] [MAIN ] SBS: Fetched primary data is valid. [2025-09-17T21:34:31.140803] [DEBUG] [LOCAL ] SBS: Saving primary data. [2025-09-17T21:34:31.143149] [DEBUG] [LOCAL ] SBS: Trimmed 70000 records to 49382 (keeping 200 days of data) [2025-09-17T21:34:31.441044] [DEBUG] [LOCAL ] SBS: Primary data saved (49382 records). [2025-09-17T21:34:31.441193] [INFO ] [MAIN ] SBS: Full history saved. [2025-09-17T21:34:31.441280] [INFO ] [MAIN ] Update Progress: 1876/2371 symbols completed. SBS took 31.9s. Estimated remaining: 1h 12m 26s. Rate: 6.8 symbols/min [2025-09-17T21:34:31.628299] [INFO ] [REMOTE ] SBR: Fetching primary data for 2025-09. [2025-09-17T21:34:31.645259] [INFO ] [MAIN ] SBXD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:34:31.645769] [DEBUG] [LOCAL ] SBXD: No existing data file found in primary storage. [2025-09-17T21:34:31.645827] [WARN ] [MAIN ] SBXD: No existing data found, performing full refresh instead. [2025-09-17T21:34:31.646143] [INFO ] [MAIN ] SBXD: Wiping existing primary data before full refresh. [2025-09-17T21:34:31.646451] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-17T21:34:31.646613] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-17T21:34:31.646811] [INFO ] [MAIN ] SBXD: Starting full primary refresh. [2025-09-17T21:34:31.765418] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T21:34:32.077787] [INFO ] [REMOTE ] SBXD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:34:32.082548] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T21:34:32.228528] [INFO ] [REMOTE ] SBR: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T21:34:32.230749] [INFO ] [REMOTE ] SBR: Full fetch complete (10980 records). [2025-09-17T21:34:32.230887] [DEBUG] [VALIDATOR ] SBR: Validating primary data. [2025-09-17T21:34:32.430347] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-11. [2025-09-17T21:34:32.629291] [DEBUG] [VALIDATOR ] SBR: All expected trading days are present. [2025-09-17T21:34:32.629384] [DEBUG] [VALIDATOR ] SBR: Primary data validation passed. [2025-09-17T21:34:32.629706] [INFO ] [MAIN ] SBR: Fetched primary data is valid. [2025-09-17T21:34:32.629792] [DEBUG] [LOCAL ] SBR: Saving primary data. [2025-09-17T21:34:32.630406] [DEBUG] [LOCAL ] SBR: Trimmed 10980 records to 7257 (keeping 200 days of data) [2025-09-17T21:34:32.680952] [DEBUG] [LOCAL ] SBR: Primary data saved (7257 records). [2025-09-17T21:34:32.681158] [INFO ] [MAIN ] SBR: Full history saved. [2025-09-17T21:34:32.681297] [INFO ] [MAIN ] Update Progress: 1877/2371 symbols completed. SBR took 34.5s. Estimated remaining: 1h 12m 15s. Rate: 6.8 symbols/min [2025-09-17T21:34:32.858272] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T21:34:33.215844] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-06. [2025-09-17T21:34:34.015802] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2024-12. [2025-09-17T21:34:34.243164] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2024-12 (0.23 seconds). [2025-09-17T21:34:34.817156] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-01. [2025-09-17T21:34:34.823030] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T21:34:35.074153] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-01 (0.26 seconds). [2025-09-17T21:34:35.615785] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-02. [2025-09-17T21:34:36.240363] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T21:34:36.415785] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-03. [2025-09-17T21:34:36.652272] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-03 (0.24 seconds). [2025-09-17T21:34:37.215798] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-04. [2025-09-17T21:34:37.484338] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-17T21:34:38.015786] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-05. [2025-09-17T21:34:38.345965] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T21:34:38.815800] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-05. [2025-09-17T21:34:39.420869] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T21:34:39.615759] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-07. [2025-09-17T21:34:40.415775] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-06. [2025-09-17T21:34:41.215888] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-06. [2025-09-17T21:34:41.419011] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T21:34:41.515429] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T21:34:41.815796] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T21:34:42.015778] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-08. [2025-09-17T21:34:42.815775] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-07. [2025-09-17T21:34:43.615777] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-07. [2025-09-17T21:34:43.651439] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T21:34:43.852145] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T21:34:44.415781] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-08. [2025-09-17T21:34:44.631606] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T21:34:45.215827] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-08. [2025-09-17T21:34:45.371599] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T21:34:45.659987] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T21:34:46.015773] [INFO ] [REMOTE ] SBSW: Fetching primary data for 2025-09. [2025-09-17T21:34:46.815821] [INFO ] [REMOTE ] SBSI: Fetching primary data for 2025-09. [2025-09-17T21:34:47.585491] [INFO ] [REMOTE ] SBSI: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T21:34:47.607002] [INFO ] [REMOTE ] SBSI: Full fetch complete (20844 records). [2025-09-17T21:34:47.607821] [INFO ] [REMOTE ] SBSW: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T21:34:47.614464] [DEBUG] [VALIDATOR ] SBSI: Validating primary data. [2025-09-17T21:34:47.615754] [INFO ] [REMOTE ] SBXD: Fetching primary data for 2025-09. [2025-09-17T21:34:47.630349] [INFO ] [REMOTE ] SBSW: Full fetch complete (76335 records). [2025-09-17T21:34:47.656460] [DEBUG] [VALIDATOR ] SBSW: Validating primary data. [2025-09-17T21:34:48.180841] [INFO ] [REMOTE ] SBXD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T21:34:48.246074] [INFO ] [REMOTE ] SBXD: Full fetch complete (3069 records). [2025-09-17T21:34:48.272623] [DEBUG] [VALIDATOR ] SBXD: Validating primary data. [2025-09-17T21:34:48.441634] [DEBUG] [VALIDATOR ] SBSI: All expected trading days are present. [2025-09-17T21:34:48.471766] [DEBUG] [VALIDATOR ] SBSI: Primary data validation passed. [2025-09-17T21:34:48.521041] [INFO ] [MAIN ] SBSI: Fetched primary data is valid. [2025-09-17T21:34:48.542320] [DEBUG] [LOCAL ] SBSI: Saving primary data. [2025-09-17T21:34:48.542490] [DEBUG] [VALIDATOR ] SBSW: All expected trading days are present. [2025-09-17T21:34:48.543627] [DEBUG] [VALIDATOR ] SBSW: Primary data validation passed. [2025-09-17T21:34:48.550431] [INFO ] [MAIN ] SBSW: Fetched primary data is valid. [2025-09-17T21:34:48.604521] [DEBUG] [LOCAL ] SBSI: Trimmed 20844 records to 14636 (keeping 200 days of data) [2025-09-17T21:34:48.595964] [DEBUG] [LOCAL ] SBSW: Saving primary data. [2025-09-17T21:34:48.626998] [WARN ] [VALIDATOR ] SBXD: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-17T21:34:48.628829] [FATAL] [MAIN ] SBXD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:34:48.629181] [WARN ] [MAIN ] SBXD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:34:48.629259] [INFO ] [LOCAL ] SBXD: Starting deletion of primary data. [2025-09-17T21:34:48.629333] [DEBUG] [LOCAL ] SBXD: No primary data file found to delete. [2025-09-17T21:34:48.629376] [INFO ] [LOCAL ] SBXD: Starting deletion of derivative data. [2025-09-17T21:34:48.629425] [DEBUG] [LOCAL ] SBXD: No derivative data file found to delete. [2025-09-17T21:34:48.629511] [INFO ] [MAIN ] Update Progress: 1878/2371 symbols completed. SBXD took 17.2s. Estimated remaining: 1h 12m 8s. Rate: 6.8 symbols/min [2025-09-17T21:34:48.632773] [DEBUG] [LOCAL ] SBSW: Trimmed 76335 records to 52923 (keeping 200 days of data) [2025-09-17T21:34:48.831271] [DEBUG] [LOCAL ] SBSI: Primary data saved (14636 records). [2025-09-17T21:34:48.832040] [INFO ] [MAIN ] SBSI: Full history saved. [2025-09-17T21:34:48.833007] [INFO ] [MAIN ] Update Progress: 1879/2371 symbols completed. SBSI took 46.0s. Estimated remaining: 1h 11m 57s. Rate: 6.8 symbols/min [2025-09-17T21:34:49.039993] [DEBUG] [LOCAL ] SBSW: Primary data saved (52923 records). [2025-09-17T21:34:49.040167] [INFO ] [MAIN ] SBSW: Full history saved. [2025-09-17T21:34:49.040902] [INFO ] [MAIN ] Update Progress: 1880/2371 symbols completed. SBSW took 34.5s. Estimated remaining: 1h 11m 46s. Rate: 6.8 symbols/min [2025-09-17T21:34:49.649462] [INFO ] [MAIN ] SCI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:34:49.665634] [INFO ] [MAIN ] SCCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:34:49.702054] [INFO ] [MAIN ] SCD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:34:49.780489] [INFO ] [MAIN ] SCHW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:34:49.802191] [DEBUG] [LOCAL ] SCD: Loaded 12537 existing records from primary storage. [2025-09-17T21:34:49.802512] [INFO ] [MAIN ] SCD: Loaded 12537 existing records. [2025-09-17T21:34:50.025546] [WARN ] [MAIN ] SCD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:34:50.053342] [INFO ] [MAIN ] SCD: Wiping existing primary data before full refresh. [2025-09-17T21:34:50.053460] [INFO ] [LOCAL ] SCD: Starting deletion of primary data. [2025-09-17T21:34:50.055560] [DEBUG] [LOCAL ] SCCO: Loaded 49398 existing records from primary storage. [2025-09-17T21:34:50.054611] [DEBUG] [LOCAL ] SCI: Loaded 46821 existing records from primary storage. [2025-09-17T21:34:50.054697] [DEBUG] [LOCAL ] SCD: Deleted primary data file. [2025-09-17T21:34:50.055958] [INFO ] [MAIN ] SCCO: Loaded 49398 existing records. [2025-09-17T21:34:50.055844] [INFO ] [MAIN ] SCI: Loaded 46821 existing records. [2025-09-17T21:34:50.056039] [INFO ] [MAIN ] SCD: Starting full primary refresh. [2025-09-17T21:34:50.432038] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-09-17T21:34:50.513878] [INFO ] [MAIN ] SCHW: Loaded 53685 existing records. [2025-09-17T21:34:50.642633] [WARN ] [MAIN ] SCI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:34:50.723257] [WARN ] [MAIN ] SCCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:34:50.771920] [INFO ] [MAIN ] SCI: Wiping existing primary data before full refresh. [2025-09-17T21:34:50.840778] [INFO ] [LOCAL ] SCI: Starting deletion of primary data. [2025-09-17T21:34:50.860023] [INFO ] [MAIN ] SCCO: Wiping existing primary data before full refresh. [2025-09-17T21:34:50.875791] [INFO ] [LOCAL ] SCCO: Starting deletion of primary data. [2025-09-17T21:34:50.891852] [DEBUG] [LOCAL ] SCI: Deleted primary data file. [2025-09-17T21:34:50.891951] [DEBUG] [LOCAL ] SCCO: Deleted primary data file. [2025-09-17T21:34:50.916701] [INFO ] [MAIN ] SCI: Starting full primary refresh. [2025-09-17T21:34:50.927444] [INFO ] [MAIN ] SCCO: Starting full primary refresh. [2025-09-17T21:34:51.225624] [INFO ] [REMOTE ] SCD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:34:51.257731] [WARN ] [MAIN ] SCHW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:34:51.263197] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-11. [2025-09-17T21:34:51.274535] [INFO ] [MAIN ] SCHW: Wiping existing primary data before full refresh. [2025-09-17T21:34:51.280135] [INFO ] [LOCAL ] SCHW: Starting deletion of primary data. [2025-09-17T21:34:51.312672] [DEBUG] [LOCAL ] SCHW: Deleted primary data file. [2025-09-17T21:34:51.475356] [INFO ] [MAIN ] SCHW: Starting full primary refresh. [2025-09-17T21:34:52.003047] [INFO ] [REMOTE ] SCI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:34:52.088604] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T21:34:52.088840] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-11. [2025-09-17T21:34:52.107916] [INFO ] [REMOTE ] SCCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:34:52.136390] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-11. [2025-09-17T21:34:52.139137] [INFO ] [REMOTE ] SCD: Fetching primary data for 2024-12. [2025-09-17T21:34:52.252480] [INFO ] [REMOTE ] SCHW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:34:52.252791] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-11. [2025-09-17T21:34:52.954054] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T21:34:52.956160] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-01. [2025-09-17T21:34:53.307676] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-11 (1.22 seconds). [2025-09-17T21:34:53.316402] [INFO ] [REMOTE ] SCI: Fetching primary data for 2024-12. [2025-09-17T21:34:53.716106] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T21:34:53.735510] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T21:34:53.801600] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T21:34:54.015782] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2024-12. [2025-09-17T21:34:54.487539] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T21:34:54.815788] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2024-12. [2025-09-17T21:34:55.615784] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-01. [2025-09-17T21:34:55.710333] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T21:34:56.089474] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T21:34:56.415774] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-01. [2025-09-17T21:34:56.741525] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T21:34:57.215776] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-02. [2025-09-17T21:34:57.860744] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T21:34:58.015764] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-02. [2025-09-17T21:34:58.075076] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T21:34:58.815836] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-01. [2025-09-17T21:34:59.615793] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-02. [2025-09-17T21:34:59.727028] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T21:35:00.415825] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-03. [2025-09-17T21:35:00.726179] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T21:35:00.974870] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-01 (2.16 seconds). [2025-09-17T21:35:01.215770] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-02. [2025-09-17T21:35:01.964580] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T21:35:02.015772] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-04. [2025-09-17T21:35:02.815823] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-03. [2025-09-17T21:35:03.032333] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T21:35:03.549393] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T21:35:03.615846] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-03. [2025-09-17T21:35:03.971249] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T21:35:04.415835] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-03. [2025-09-17T21:35:05.139593] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T21:35:05.215785] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-04. [2025-09-17T21:35:06.015711] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-04. [2025-09-17T21:35:06.122489] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T21:35:06.548538] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-04 (0.53 seconds). [2025-09-17T21:35:06.815800] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-05. [2025-09-17T21:35:07.238267] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T21:35:07.540408] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T21:35:07.615766] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-06. [2025-09-17T21:35:08.208699] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T21:35:08.415809] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-07. [2025-09-17T21:35:09.215768] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-04. [2025-09-17T21:35:09.520232] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T21:35:10.015795] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-08. [2025-09-17T21:35:10.592407] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T21:35:10.815842] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-05. [2025-09-17T21:35:10.978860] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T21:35:11.615784] [INFO ] [REMOTE ] SCD: Fetching primary data for 2025-09. [2025-09-17T21:35:12.186731] [INFO ] [REMOTE ] SCD: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T21:35:12.188923] [INFO ] [REMOTE ] SCD: Full fetch complete (15989 records). [2025-09-17T21:35:12.188998] [DEBUG] [VALIDATOR ] SCD: Validating primary data. [2025-09-17T21:35:12.419426] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-05. [2025-09-17T21:35:12.563290] [DEBUG] [VALIDATOR ] SCD: All expected trading days are present. [2025-09-17T21:35:12.563396] [DEBUG] [VALIDATOR ] SCD: Primary data validation passed. [2025-09-17T21:35:12.563817] [INFO ] [MAIN ] SCD: Fetched primary data is valid. [2025-09-17T21:35:12.563952] [DEBUG] [LOCAL ] SCD: Saving primary data. [2025-09-17T21:35:12.564657] [DEBUG] [LOCAL ] SCD: Trimmed 15989 records to 12610 (keeping 200 days of data) [2025-09-17T21:35:12.644103] [DEBUG] [LOCAL ] SCD: Primary data saved (12610 records). [2025-09-17T21:35:12.644251] [INFO ] [MAIN ] SCD: Full history saved. [2025-09-17T21:35:12.644340] [INFO ] [MAIN ] Update Progress: 1881/2371 symbols completed. SCD took 23.6s. Estimated remaining: 1h 11m 41s. Rate: 6.8 symbols/min [2025-09-17T21:35:12.817612] [INFO ] [MAIN ] SCL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:35:12.845985] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-05 (2.03 seconds). [2025-09-17T21:35:12.867494] [DEBUG] [LOCAL ] SCL: Loaded 14755 existing records from primary storage. [2025-09-17T21:35:12.867620] [INFO ] [MAIN ] SCL: Loaded 14755 existing records. [2025-09-17T21:35:13.043040] [WARN ] [MAIN ] SCL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:35:13.043293] [INFO ] [MAIN ] SCL: Wiping existing primary data before full refresh. [2025-09-17T21:35:13.043338] [INFO ] [LOCAL ] SCL: Starting deletion of primary data. [2025-09-17T21:35:13.043911] [DEBUG] [LOCAL ] SCL: Deleted primary data file. [2025-09-17T21:35:13.043967] [INFO ] [MAIN ] SCL: Starting full primary refresh. [2025-09-17T21:35:13.220927] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-05. [2025-09-17T21:35:13.405674] [INFO ] [REMOTE ] SCL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:35:14.015789] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-06. [2025-09-17T21:35:14.283366] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T21:35:14.815757] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-06. [2025-09-17T21:35:14.846209] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T21:35:15.509925] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T21:35:15.615853] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-06. [2025-09-17T21:35:16.045669] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T21:35:16.415805] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-07. [2025-09-17T21:35:17.215768] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-07. [2025-09-17T21:35:17.437795] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-06 (1.82 seconds). [2025-09-17T21:35:18.020845] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-07. [2025-09-17T21:35:18.033214] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T21:35:18.815730] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-11. [2025-09-17T21:35:19.235037] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T21:35:19.615865] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-08. [2025-09-17T21:35:19.663577] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T21:35:20.119218] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T21:35:20.415848] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-08. [2025-09-17T21:35:21.215815] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-08. [2025-09-17T21:35:21.419758] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T21:35:22.015811] [INFO ] [REMOTE ] SCI: Fetching primary data for 2025-09. [2025-09-17T21:35:22.310651] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T21:35:22.614000] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T21:35:22.815825] [INFO ] [REMOTE ] SCHW: Fetching primary data for 2025-09. [2025-09-17T21:35:23.094041] [INFO ] [REMOTE ] SCI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T21:35:23.111170] [INFO ] [REMOTE ] SCHW: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-17T21:35:23.117673] [INFO ] [REMOTE ] SCI: Full fetch complete (66933 records). [2025-09-17T21:35:23.117977] [DEBUG] [VALIDATOR ] SCI: Validating primary data. [2025-09-17T21:35:23.118493] [INFO ] [REMOTE ] SCHW: Full fetch complete (77560 records). [2025-09-17T21:35:23.118587] [DEBUG] [VALIDATOR ] SCHW: Validating primary data. [2025-09-17T21:35:23.619795] [INFO ] [REMOTE ] SCL: Fetching primary data for 2024-12. [2025-09-17T21:35:23.962470] [DEBUG] [VALIDATOR ] SCHW: All expected trading days are present. [2025-09-17T21:35:23.962738] [DEBUG] [VALIDATOR ] SCI: All expected trading days are present. [2025-09-17T21:35:23.962859] [DEBUG] [VALIDATOR ] SCHW: Primary data validation passed. [2025-09-17T21:35:23.963996] [INFO ] [MAIN ] SCHW: Fetched primary data is valid. [2025-09-17T21:35:23.962939] [DEBUG] [VALIDATOR ] SCI: Primary data validation passed. [2025-09-17T21:35:23.964161] [DEBUG] [LOCAL ] SCHW: Saving primary data. [2025-09-17T21:35:23.965595] [INFO ] [MAIN ] SCI: Fetched primary data is valid. [2025-09-17T21:35:23.965857] [DEBUG] [LOCAL ] SCI: Saving primary data. [2025-09-17T21:35:23.967488] [DEBUG] [LOCAL ] SCI: Trimmed 66933 records to 46762 (keeping 200 days of data) [2025-09-17T21:35:23.969578] [DEBUG] [LOCAL ] SCHW: Trimmed 77560 records to 53685 (keeping 200 days of data) [2025-09-17T21:35:24.419442] [INFO ] [REMOTE ] SCCO: Fetching primary data for 2025-09. [2025-09-17T21:35:24.563346] [DEBUG] [LOCAL ] SCHW: Primary data saved (53685 records). [2025-09-17T21:35:24.564499] [INFO ] [MAIN ] SCHW: Full history saved. [2025-09-17T21:35:24.565135] [INFO ] [MAIN ] Update Progress: 1882/2371 symbols completed. SCHW took 35.5s. Estimated remaining: 1h 11m 33s. Rate: 6.8 symbols/min [2025-09-17T21:35:24.746963] [INFO ] [MAIN ] SCM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:35:24.763140] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T21:35:24.828980] [DEBUG] [LOCAL ] SCM: Loaded 20156 existing records from primary storage. [2025-09-17T21:35:24.829984] [INFO ] [MAIN ] SCM: Loaded 20156 existing records. [2025-09-17T21:35:24.904328] [DEBUG] [LOCAL ] SCI: Primary data saved (46762 records). [2025-09-17T21:35:24.915634] [INFO ] [MAIN ] SCI: Full history saved. [2025-09-17T21:35:24.937361] [INFO ] [MAIN ] Update Progress: 1883/2371 symbols completed. SCI took 35.9s. Estimated remaining: 1h 11m 22s. Rate: 6.8 symbols/min [2025-09-17T21:35:25.146910] [WARN ] [MAIN ] SCM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:35:25.172486] [INFO ] [MAIN ] SCM: Wiping existing primary data before full refresh. [2025-09-17T21:35:25.183416] [INFO ] [LOCAL ] SCM: Starting deletion of primary data. [2025-09-17T21:35:25.198868] [DEBUG] [LOCAL ] SCM: Deleted primary data file. [2025-09-17T21:35:25.201486] [INFO ] [MAIN ] SCM: Starting full primary refresh. [2025-09-17T21:35:25.201304] [INFO ] [MAIN ] SCS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:35:25.223539] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-01. [2025-09-17T21:35:25.564991] [DEBUG] [LOCAL ] SCS: Loaded 42722 existing records from primary storage. [2025-09-17T21:35:25.584125] [INFO ] [MAIN ] SCS: Loaded 42722 existing records. [2025-09-17T21:35:25.706626] [INFO ] [REMOTE ] SCM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:35:25.809635] [WARN ] [MAIN ] SCS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:35:25.810010] [INFO ] [MAIN ] SCS: Wiping existing primary data before full refresh. [2025-09-17T21:35:25.810137] [INFO ] [LOCAL ] SCS: Starting deletion of primary data. [2025-09-17T21:35:25.817335] [DEBUG] [LOCAL ] SCS: Deleted primary data file. [2025-09-17T21:35:25.826963] [INFO ] [MAIN ] SCS: Starting full primary refresh. [2025-09-17T21:35:25.871986] [INFO ] [REMOTE ] SCCO: Incremental fetch complete for 2025-09 (1.45 seconds). [2025-09-17T21:35:25.956258] [INFO ] [REMOTE ] SCCO: Full fetch complete (70506 records). [2025-09-17T21:35:25.990020] [DEBUG] [VALIDATOR ] SCCO: Validating primary data. [2025-09-17T21:35:26.033094] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-11. [2025-09-17T21:35:26.404258] [INFO ] [REMOTE ] SCS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:35:26.560758] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T21:35:26.653108] [DEBUG] [VALIDATOR ] SCCO: All expected trading days are present. [2025-09-17T21:35:26.653220] [DEBUG] [VALIDATOR ] SCCO: Primary data validation passed. [2025-09-17T21:35:26.655432] [INFO ] [MAIN ] SCCO: Fetched primary data is valid. [2025-09-17T21:35:26.655680] [DEBUG] [LOCAL ] SCCO: Saving primary data. [2025-09-17T21:35:26.659579] [DEBUG] [LOCAL ] SCCO: Trimmed 70506 records to 49388 (keeping 200 days of data) [2025-09-17T21:35:26.851792] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-11. [2025-09-17T21:35:26.916213] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T21:35:27.021951] [DEBUG] [LOCAL ] SCCO: Primary data saved (49388 records). [2025-09-17T21:35:27.022109] [INFO ] [MAIN ] SCCO: Full history saved. [2025-09-17T21:35:27.022241] [INFO ] [MAIN ] Update Progress: 1884/2371 symbols completed. SCCO took 38.0s. Estimated remaining: 1h 11m 12s. Rate: 6.8 symbols/min [2025-09-17T21:35:27.207604] [INFO ] [MAIN ] SD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:35:27.236126] [DEBUG] [LOCAL ] SD: Loaded 29171 existing records from primary storage. [2025-09-17T21:35:27.236280] [INFO ] [MAIN ] SD: Loaded 29171 existing records. [2025-09-17T21:35:27.416943] [WARN ] [MAIN ] SD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:35:27.417198] [INFO ] [MAIN ] SD: Wiping existing primary data before full refresh. [2025-09-17T21:35:27.417244] [INFO ] [LOCAL ] SD: Starting deletion of primary data. [2025-09-17T21:35:27.417954] [DEBUG] [LOCAL ] SD: Deleted primary data file. [2025-09-17T21:35:27.418012] [INFO ] [MAIN ] SD: Starting full primary refresh. [2025-09-17T21:35:27.620950] [INFO ] [REMOTE ] SCM: Fetching primary data for 2024-12. [2025-09-17T21:35:27.777056] [INFO ] [REMOTE ] SD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:35:28.064495] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T21:35:28.312149] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T21:35:28.415723] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-01. [2025-09-17T21:35:29.215764] [INFO ] [REMOTE ] SCS: Fetching primary data for 2024-12. [2025-09-17T21:35:29.518323] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T21:35:30.015786] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-02. [2025-09-17T21:35:30.640585] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T21:35:30.731778] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T21:35:30.815765] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-01. [2025-09-17T21:35:31.615743] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-03. [2025-09-17T21:35:32.093693] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T21:35:32.415803] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-02. [2025-09-17T21:35:32.734143] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T21:35:32.943753] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T21:35:33.215783] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-02. [2025-09-17T21:35:34.015795] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-04. [2025-09-17T21:35:34.534358] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T21:35:34.815755] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-03. [2025-09-17T21:35:34.848414] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T21:35:35.615801] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-03. [2025-09-17T21:35:35.876257] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T21:35:36.415800] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-05. [2025-09-17T21:35:37.014443] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T21:35:37.162112] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T21:35:37.215736] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-06. [2025-09-17T21:35:37.890467] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T21:35:38.015755] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-04. [2025-09-17T21:35:38.815820] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-04. [2025-09-17T21:35:39.604233] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T21:35:39.615725] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-05. [2025-09-17T21:35:39.954781] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T21:35:40.415774] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-11. [2025-09-17T21:35:40.931179] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T21:35:41.215775] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-05. [2025-09-17T21:35:41.320188] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T21:35:41.872340] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-05 (0.66 seconds). [2025-09-17T21:35:42.015858] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-06. [2025-09-17T21:35:42.803656] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T21:35:42.815718] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-07. [2025-09-17T21:35:43.615827] [INFO ] [REMOTE ] SD: Fetching primary data for 2024-12. [2025-09-17T21:35:43.661587] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T21:35:44.415783] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-06. [2025-09-17T21:35:44.608199] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T21:35:45.215780] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-07. [2025-09-17T21:35:46.015793] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-01. [2025-09-17T21:35:46.271082] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T21:35:46.361438] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T21:35:46.815744] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-07. [2025-09-17T21:35:46.847722] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T21:35:47.615784] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-08. [2025-09-17T21:35:47.949357] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T21:35:48.294398] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T21:35:48.415804] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-08. [2025-09-17T21:35:49.215798] [INFO ] [REMOTE ] SCL: Fetching primary data for 2025-09. [2025-09-17T21:35:49.873070] [INFO ] [REMOTE ] SCL: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T21:35:49.876071] [INFO ] [REMOTE ] SCL: Full fetch complete (20719 records). [2025-09-17T21:35:49.876172] [DEBUG] [VALIDATOR ] SCL: Validating primary data. [2025-09-17T21:35:50.016636] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-08. [2025-09-17T21:35:50.317386] [DEBUG] [VALIDATOR ] SCL: All expected trading days are present. [2025-09-17T21:35:50.317697] [DEBUG] [VALIDATOR ] SCL: Primary data validation passed. [2025-09-17T21:35:50.318901] [INFO ] [MAIN ] SCL: Fetched primary data is valid. [2025-09-17T21:35:50.318974] [DEBUG] [LOCAL ] SCL: Saving primary data. [2025-09-17T21:35:50.321101] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T21:35:50.332937] [DEBUG] [LOCAL ] SCL: Trimmed 20719 records to 14788 (keeping 200 days of data) [2025-09-17T21:35:50.431984] [DEBUG] [LOCAL ] SCL: Primary data saved (14788 records). [2025-09-17T21:35:50.432123] [INFO ] [MAIN ] SCL: Full history saved. [2025-09-17T21:35:50.432268] [INFO ] [MAIN ] Update Progress: 1885/2371 symbols completed. SCL took 37.8s. Estimated remaining: 1h 11m 7s. Rate: 6.8 symbols/min [2025-09-17T21:35:50.605453] [INFO ] [MAIN ] SDHC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:35:50.617715] [DEBUG] [LOCAL ] SDHC: Loaded 10516 existing records from primary storage. [2025-09-17T21:35:50.617827] [INFO ] [MAIN ] SDHC: Loaded 10516 existing records. [2025-09-17T21:35:50.801544] [WARN ] [MAIN ] SDHC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:35:50.801868] [INFO ] [MAIN ] SDHC: Wiping existing primary data before full refresh. [2025-09-17T21:35:50.801919] [INFO ] [LOCAL ] SDHC: Starting deletion of primary data. [2025-09-17T21:35:50.802386] [DEBUG] [LOCAL ] SDHC: Deleted primary data file. [2025-09-17T21:35:50.802460] [INFO ] [MAIN ] SDHC: Starting full primary refresh. [2025-09-17T21:35:50.825242] [INFO ] [REMOTE ] SCS: Fetching primary data for 2025-09. [2025-09-17T21:35:51.171339] [INFO ] [REMOTE ] SDHC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:35:51.184238] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T21:35:51.615783] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-11. [2025-09-17T21:35:51.918905] [INFO ] [REMOTE ] SCS: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T21:35:51.930096] [INFO ] [REMOTE ] SCS: Full fetch complete (59536 records). [2025-09-17T21:35:51.930769] [DEBUG] [VALIDATOR ] SCS: Validating primary data. [2025-09-17T21:35:52.253240] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T21:35:52.350053] [DEBUG] [VALIDATOR ] SCS: All expected trading days are present. [2025-09-17T21:35:52.350172] [DEBUG] [VALIDATOR ] SCS: Primary data validation passed. [2025-09-17T21:35:52.351430] [INFO ] [MAIN ] SCS: Fetched primary data is valid. [2025-09-17T21:35:52.351488] [DEBUG] [LOCAL ] SCS: Saving primary data. [2025-09-17T21:35:52.353066] [DEBUG] [LOCAL ] SCS: Trimmed 59536 records to 42799 (keeping 200 days of data) [2025-09-17T21:35:52.416945] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-02. [2025-09-17T21:35:52.630092] [DEBUG] [LOCAL ] SCS: Primary data saved (42799 records). [2025-09-17T21:35:52.630235] [INFO ] [MAIN ] SCS: Full history saved. [2025-09-17T21:35:52.630325] [INFO ] [MAIN ] Update Progress: 1886/2371 symbols completed. SCS took 27.7s. Estimated remaining: 1h 10m 56s. Rate: 6.8 symbols/min [2025-09-17T21:35:52.804408] [INFO ] [MAIN ] SDHY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:35:52.816093] [DEBUG] [LOCAL ] SDHY: Loaded 10765 existing records from primary storage. [2025-09-17T21:35:52.816199] [INFO ] [MAIN ] SDHY: Loaded 10765 existing records. [2025-09-17T21:35:52.991560] [WARN ] [MAIN ] SDHY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:35:52.991861] [INFO ] [MAIN ] SDHY: Wiping existing primary data before full refresh. [2025-09-17T21:35:52.991910] [INFO ] [LOCAL ] SDHY: Starting deletion of primary data. [2025-09-17T21:35:52.992393] [DEBUG] [LOCAL ] SDHY: Deleted primary data file. [2025-09-17T21:35:52.992438] [INFO ] [MAIN ] SDHY: Starting full primary refresh. [2025-09-17T21:35:53.222822] [INFO ] [REMOTE ] SCM: Fetching primary data for 2025-09. [2025-09-17T21:35:53.347800] [INFO ] [REMOTE ] SDHY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:35:53.667895] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T21:35:54.015800] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2024-12. [2025-09-17T21:35:54.112138] [INFO ] [REMOTE ] SCM: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T21:35:54.115488] [INFO ] [REMOTE ] SCM: Full fetch complete (28289 records). [2025-09-17T21:35:54.115565] [DEBUG] [VALIDATOR ] SCM: Validating primary data. [2025-09-17T21:35:54.503539] [DEBUG] [VALIDATOR ] SCM: All expected trading days are present. [2025-09-17T21:35:54.503656] [DEBUG] [VALIDATOR ] SCM: Primary data validation passed. [2025-09-17T21:35:54.504339] [INFO ] [MAIN ] SCM: Fetched primary data is valid. [2025-09-17T21:35:54.504383] [DEBUG] [LOCAL ] SCM: Saving primary data. [2025-09-17T21:35:54.505323] [DEBUG] [LOCAL ] SCM: Trimmed 28289 records to 20182 (keeping 200 days of data) [2025-09-17T21:35:54.619159] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T21:35:54.648172] [DEBUG] [LOCAL ] SCM: Primary data saved (20182 records). [2025-09-17T21:35:54.648316] [INFO ] [MAIN ] SCM: Full history saved. [2025-09-17T21:35:54.648422] [INFO ] [MAIN ] Update Progress: 1887/2371 symbols completed. SCM took 30.1s. Estimated remaining: 1h 10m 46s. Rate: 6.8 symbols/min [2025-09-17T21:35:54.820914] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-01. [2025-09-17T21:35:54.823367] [INFO ] [MAIN ] SDRL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:35:54.865695] [DEBUG] [LOCAL ] SDRL: Loaded 42247 existing records from primary storage. [2025-09-17T21:35:54.865851] [INFO ] [MAIN ] SDRL: Loaded 42247 existing records. [2025-09-17T21:35:55.091996] [WARN ] [MAIN ] SDRL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:35:55.092272] [INFO ] [MAIN ] SDRL: Wiping existing primary data before full refresh. [2025-09-17T21:35:55.092320] [INFO ] [LOCAL ] SDRL: Starting deletion of primary data. [2025-09-17T21:35:55.093310] [DEBUG] [LOCAL ] SDRL: Deleted primary data file. [2025-09-17T21:35:55.093365] [INFO ] [MAIN ] SDRL: Starting full primary refresh. [2025-09-17T21:35:55.482360] [INFO ] [REMOTE ] SDRL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:35:55.615774] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-11. [2025-09-17T21:35:55.733880] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T21:35:56.415785] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-11. [2025-09-17T21:35:56.807918] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T21:35:57.061686] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T21:35:57.215765] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2024-12. [2025-09-17T21:35:58.015696] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-02. [2025-09-17T21:35:58.291545] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T21:35:58.815780] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2024-12. [2025-09-17T21:35:58.971343] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T21:35:59.615783] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-01. [2025-09-17T21:36:00.124993] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T21:36:00.387038] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T21:36:00.415753] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-02. [2025-09-17T21:36:01.215784] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-01. [2025-09-17T21:36:01.762551] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T21:36:02.015766] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-03. [2025-09-17T21:36:02.815807] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-03. [2025-09-17T21:36:03.592928] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-01 (2.38 seconds). [2025-09-17T21:36:03.615731] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-02. [2025-09-17T21:36:04.174462] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-17T21:36:04.415801] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-03. [2025-09-17T21:36:04.824918] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-03 (2.01 seconds). [2025-09-17T21:36:04.901675] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T21:36:05.156399] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T21:36:05.215770] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-04. [2025-09-17T21:36:05.917029] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T21:36:06.015792] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-04. [2025-09-17T21:36:06.594594] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-04 (0.58 seconds). [2025-09-17T21:36:06.815770] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-05. [2025-09-17T21:36:07.561446] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T21:36:07.615766] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-04. [2025-09-17T21:36:08.415829] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-06. [2025-09-17T21:36:08.899867] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T21:36:09.003345] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T21:36:09.215769] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-05. [2025-09-17T21:36:09.707972] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T21:36:10.015759] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-03. [2025-09-17T21:36:10.815789] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-07. [2025-09-17T21:36:11.615898] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-05. [2025-09-17T21:36:11.622167] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T21:36:11.650275] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T21:36:12.415820] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-08. [2025-09-17T21:36:12.581916] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T21:36:13.215400] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T21:36:13.218005] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-06. [2025-09-17T21:36:14.001877] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T21:36:14.015674] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-07. [2025-09-17T21:36:14.815790] [INFO ] [REMOTE ] SDHC: Fetching primary data for 2025-09. [2025-09-17T21:36:15.265865] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T21:36:15.615825] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-08. [2025-09-17T21:36:16.248443] [INFO ] [REMOTE ] SDHC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T21:36:16.250366] [INFO ] [REMOTE ] SDHC: Full fetch complete (16873 records). [2025-09-17T21:36:16.250439] [DEBUG] [VALIDATOR ] SDHC: Validating primary data. [2025-09-17T21:36:16.418053] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-06. [2025-09-17T21:36:16.561840] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T21:36:16.631065] [DEBUG] [VALIDATOR ] SDHC: All expected trading days are present. [2025-09-17T21:36:16.631142] [DEBUG] [VALIDATOR ] SDHC: Primary data validation passed. [2025-09-17T21:36:16.631552] [INFO ] [MAIN ] SDHC: Fetched primary data is valid. [2025-09-17T21:36:16.631628] [DEBUG] [LOCAL ] SDHC: Saving primary data. [2025-09-17T21:36:16.632168] [DEBUG] [LOCAL ] SDHC: Trimmed 16873 records to 10603 (keeping 200 days of data) [2025-09-17T21:36:16.695190] [DEBUG] [LOCAL ] SDHC: Primary data saved (10603 records). [2025-09-17T21:36:16.695318] [INFO ] [MAIN ] SDHC: Full history saved. [2025-09-17T21:36:16.695413] [INFO ] [MAIN ] Update Progress: 1888/2371 symbols completed. SDHC took 26.3s. Estimated remaining: 1h 10m 40s. Rate: 6.8 symbols/min [2025-09-17T21:36:16.867057] [INFO ] [MAIN ] SE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:36:16.920189] [DEBUG] [LOCAL ] SE: Loaded 53405 existing records from primary storage. [2025-09-17T21:36:16.920329] [INFO ] [MAIN ] SE: Loaded 53405 existing records. [2025-09-17T21:36:17.105017] [WARN ] [MAIN ] SE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:36:17.105305] [INFO ] [MAIN ] SE: Wiping existing primary data before full refresh. [2025-09-17T21:36:17.105369] [INFO ] [LOCAL ] SE: Starting deletion of primary data. [2025-09-17T21:36:17.106439] [DEBUG] [LOCAL ] SE: Deleted primary data file. [2025-09-17T21:36:17.106496] [INFO ] [MAIN ] SE: Starting full primary refresh. [2025-09-17T21:36:17.220872] [INFO ] [REMOTE ] SDHY: Fetching primary data for 2025-09. [2025-09-17T21:36:17.474627] [INFO ] [REMOTE ] SE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:36:17.898919] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T21:36:18.019060] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-07. [2025-09-17T21:36:18.019919] [INFO ] [REMOTE ] SDHY: Incremental fetch complete for 2025-09 (0.80 seconds). [2025-09-17T21:36:18.023234] [INFO ] [REMOTE ] SDHY: Full fetch complete (16451 records). [2025-09-17T21:36:18.023314] [DEBUG] [VALIDATOR ] SDHY: Validating primary data. [2025-09-17T21:36:18.388588] [DEBUG] [VALIDATOR ] SDHY: All expected trading days are present. [2025-09-17T21:36:18.388693] [DEBUG] [VALIDATOR ] SDHY: Primary data validation passed. [2025-09-17T21:36:18.389165] [INFO ] [MAIN ] SDHY: Fetched primary data is valid. [2025-09-17T21:36:18.389207] [DEBUG] [LOCAL ] SDHY: Saving primary data. [2025-09-17T21:36:18.389778] [DEBUG] [LOCAL ] SDHY: Trimmed 16451 records to 10736 (keeping 200 days of data) [2025-09-17T21:36:18.456277] [DEBUG] [LOCAL ] SDHY: Primary data saved (10736 records). [2025-09-17T21:36:18.456426] [INFO ] [MAIN ] SDHY: Full history saved. [2025-09-17T21:36:18.456550] [INFO ] [MAIN ] Update Progress: 1889/2371 symbols completed. SDHY took 25.8s. Estimated remaining: 1h 10m 30s. Rate: 6.8 symbols/min [2025-09-17T21:36:18.636345] [INFO ] [MAIN ] SEE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:36:18.685099] [DEBUG] [LOCAL ] SEE: Loaded 48491 existing records from primary storage. [2025-09-17T21:36:18.685241] [INFO ] [MAIN ] SEE: Loaded 48491 existing records. [2025-09-17T21:36:18.821049] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-11. [2025-09-17T21:36:18.889382] [WARN ] [MAIN ] SEE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:36:18.889667] [INFO ] [MAIN ] SEE: Wiping existing primary data before full refresh. [2025-09-17T21:36:18.889719] [INFO ] [LOCAL ] SEE: Starting deletion of primary data. [2025-09-17T21:36:18.890992] [DEBUG] [LOCAL ] SEE: Deleted primary data file. [2025-09-17T21:36:18.891046] [INFO ] [MAIN ] SEE: Starting full primary refresh. [2025-09-17T21:36:19.271593] [INFO ] [REMOTE ] SEE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:36:19.318953] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T21:36:19.615792] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-11. [2025-09-17T21:36:20.415797] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-04. [2025-09-17T21:36:20.611415] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T21:36:20.689504] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T21:36:21.215805] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-08. [2025-09-17T21:36:21.485227] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T21:36:22.015759] [INFO ] [REMOTE ] SEE: Fetching primary data for 2024-12. [2025-09-17T21:36:22.502311] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T21:36:22.815802] [INFO ] [REMOTE ] SD: Fetching primary data for 2025-09. [2025-09-17T21:36:23.615781] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-05. [2025-09-17T21:36:23.679422] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T21:36:23.813922] [INFO ] [REMOTE ] SD: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T21:36:23.817414] [INFO ] [REMOTE ] SD: Full fetch complete (40966 records). [2025-09-17T21:36:23.817508] [DEBUG] [VALIDATOR ] SD: Validating primary data. [2025-09-17T21:36:24.197719] [DEBUG] [VALIDATOR ] SD: All expected trading days are present. [2025-09-17T21:36:24.197797] [DEBUG] [VALIDATOR ] SD: Primary data validation passed. [2025-09-17T21:36:24.198511] [INFO ] [MAIN ] SD: Fetched primary data is valid. [2025-09-17T21:36:24.198551] [DEBUG] [LOCAL ] SD: Saving primary data. [2025-09-17T21:36:24.199413] [DEBUG] [LOCAL ] SD: Trimmed 40966 records to 29207 (keeping 200 days of data) [2025-09-17T21:36:24.378074] [DEBUG] [LOCAL ] SD: Primary data saved (29207 records). [2025-09-17T21:36:24.378211] [INFO ] [MAIN ] SD: Full history saved. [2025-09-17T21:36:24.378303] [INFO ] [MAIN ] Update Progress: 1890/2371 symbols completed. SD took 57.4s. Estimated remaining: 1h 10m 20s. Rate: 6.8 symbols/min [2025-09-17T21:36:24.422950] [INFO ] [REMOTE ] SE: Fetching primary data for 2024-12. [2025-09-17T21:36:24.552636] [INFO ] [MAIN ] SEG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:36:24.567878] [DEBUG] [LOCAL ] SEG: Loaded 14006 existing records from primary storage. [2025-09-17T21:36:24.568005] [INFO ] [MAIN ] SEG: Loaded 14006 existing records. [2025-09-17T21:36:24.755223] [WARN ] [MAIN ] SEG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:36:24.755562] [INFO ] [MAIN ] SEG: Wiping existing primary data before full refresh. [2025-09-17T21:36:24.755622] [INFO ] [LOCAL ] SEG: Starting deletion of primary data. [2025-09-17T21:36:24.756177] [DEBUG] [LOCAL ] SEG: Deleted primary data file. [2025-09-17T21:36:24.756270] [INFO ] [MAIN ] SEG: Starting full primary refresh. [2025-09-17T21:36:25.074851] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T21:36:25.150835] [INFO ] [REMOTE ] SEG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:36:25.215722] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-11. [2025-09-17T21:36:26.015741] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-06. [2025-09-17T21:36:26.035666] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T21:36:26.081268] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T21:36:26.815808] [INFO ] [REMOTE ] SEG: Fetching primary data for 2024-12. [2025-09-17T21:36:27.615797] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-01. [2025-09-17T21:36:27.767067] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T21:36:28.038145] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T21:36:28.415813] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-07. [2025-09-17T21:36:28.837729] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T21:36:29.215833] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-02. [2025-09-17T21:36:29.539883] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T21:36:30.015812] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-08. [2025-09-17T21:36:30.419965] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T21:36:30.815775] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-01. [2025-09-17T21:36:31.592719] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T21:36:31.615730] [INFO ] [REMOTE ] SDRL: Fetching primary data for 2025-09. [2025-09-17T21:36:32.415836] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-03. [2025-09-17T21:36:32.514874] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T21:36:32.753471] [INFO ] [REMOTE ] SDRL: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T21:36:32.758784] [INFO ] [REMOTE ] SDRL: Full fetch complete (61738 records). [2025-09-17T21:36:32.758905] [DEBUG] [VALIDATOR ] SDRL: Validating primary data. [2025-09-17T21:36:33.144484] [DEBUG] [VALIDATOR ] SDRL: All expected trading days are present. [2025-09-17T21:36:33.144563] [DEBUG] [VALIDATOR ] SDRL: Primary data validation passed. [2025-09-17T21:36:33.145471] [INFO ] [MAIN ] SDRL: Fetched primary data is valid. [2025-09-17T21:36:33.145516] [DEBUG] [LOCAL ] SDRL: Saving primary data. [2025-09-17T21:36:33.146751] [DEBUG] [LOCAL ] SDRL: Trimmed 61738 records to 42153 (keeping 200 days of data) [2025-09-17T21:36:33.233590] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-01. [2025-09-17T21:36:33.399265] [DEBUG] [LOCAL ] SDRL: Primary data saved (42153 records). [2025-09-17T21:36:33.399406] [INFO ] [MAIN ] SDRL: Full history saved. [2025-09-17T21:36:33.399502] [INFO ] [MAIN ] Update Progress: 1891/2371 symbols completed. SDRL took 38.8s. Estimated remaining: 1h 10m 11s. Rate: 6.8 symbols/min [2025-09-17T21:36:33.566119] [INFO ] [MAIN ] SEI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:36:33.609561] [DEBUG] [LOCAL ] SEI: Loaded 49547 existing records from primary storage. [2025-09-17T21:36:33.609721] [INFO ] [MAIN ] SEI: Loaded 49547 existing records. [2025-09-17T21:36:33.788968] [WARN ] [MAIN ] SEI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:36:33.789250] [INFO ] [MAIN ] SEI: Wiping existing primary data before full refresh. [2025-09-17T21:36:33.789338] [INFO ] [LOCAL ] SEI: Starting deletion of primary data. [2025-09-17T21:36:33.790374] [DEBUG] [LOCAL ] SEI: Deleted primary data file. [2025-09-17T21:36:33.790481] [INFO ] [MAIN ] SEI: Starting full primary refresh. [2025-09-17T21:36:34.025709] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-02. [2025-09-17T21:36:34.073248] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T21:36:34.203101] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T21:36:34.225615] [INFO ] [REMOTE ] SEI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:36:34.815796] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-11. [2025-09-17T21:36:35.615747] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-02. [2025-09-17T21:36:35.736472] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T21:36:35.851317] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T21:36:36.270171] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T21:36:36.415754] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-04. [2025-09-17T21:36:37.215765] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-03. [2025-09-17T21:36:38.015800] [INFO ] [REMOTE ] SEI: Fetching primary data for 2024-12. [2025-09-17T21:36:38.144687] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T21:36:38.815802] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-05. [2025-09-17T21:36:39.158386] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T21:36:39.335983] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T21:36:39.615802] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-01. [2025-09-17T21:36:40.203065] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T21:36:40.415795] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-06. [2025-09-17T21:36:41.158221] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T21:36:41.215745] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-02. [2025-09-17T21:36:41.527085] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T21:36:42.015783] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-04. [2025-09-17T21:36:42.815801] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-07. [2025-09-17T21:36:42.880808] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T21:36:43.615779] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-03. [2025-09-17T21:36:44.247763] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-04 (2.23 seconds). [2025-09-17T21:36:44.365717] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T21:36:44.415734] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-08. [2025-09-17T21:36:45.215746] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-05. [2025-09-17T21:36:45.314112] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T21:36:45.738223] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T21:36:46.015792] [INFO ] [REMOTE ] SEE: Fetching primary data for 2025-09. [2025-09-17T21:36:46.815810] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-04. [2025-09-17T21:36:47.362947] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T21:36:47.546104] [INFO ] [REMOTE ] SEE: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T21:36:47.553271] [INFO ] [REMOTE ] SEE: Full fetch complete (69374 records). [2025-09-17T21:36:47.553395] [DEBUG] [VALIDATOR ] SEE: Validating primary data. [2025-09-17T21:36:47.620864] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-03. [2025-09-17T21:36:47.951187] [DEBUG] [VALIDATOR ] SEE: All expected trading days are present. [2025-09-17T21:36:47.951330] [DEBUG] [VALIDATOR ] SEE: Primary data validation passed. [2025-09-17T21:36:47.952444] [INFO ] [MAIN ] SEE: Fetched primary data is valid. [2025-09-17T21:36:47.952502] [DEBUG] [LOCAL ] SEE: Saving primary data. [2025-09-17T21:36:47.955715] [DEBUG] [LOCAL ] SEE: Trimmed 69374 records to 48471 (keeping 200 days of data) [2025-09-17T21:36:48.229541] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T21:36:48.299065] [DEBUG] [LOCAL ] SEE: Primary data saved (48471 records). [2025-09-17T21:36:48.299208] [INFO ] [MAIN ] SEE: Full history saved. [2025-09-17T21:36:48.299957] [INFO ] [MAIN ] Update Progress: 1892/2371 symbols completed. SEE took 29.8s. Estimated remaining: 1h 10m 4s. Rate: 6.8 symbols/min [2025-09-17T21:36:48.420830] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-05. [2025-09-17T21:36:48.470475] [INFO ] [MAIN ] SEM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:36:48.516553] [DEBUG] [LOCAL ] SEM: Loaded 43155 existing records from primary storage. [2025-09-17T21:36:48.516717] [INFO ] [MAIN ] SEM: Loaded 43155 existing records. [2025-09-17T21:36:48.731513] [WARN ] [MAIN ] SEM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:36:48.731904] [INFO ] [MAIN ] SEM: Wiping existing primary data before full refresh. [2025-09-17T21:36:48.731980] [INFO ] [LOCAL ] SEM: Starting deletion of primary data. [2025-09-17T21:36:48.732795] [DEBUG] [LOCAL ] SEM: Deleted primary data file. [2025-09-17T21:36:48.732850] [INFO ] [MAIN ] SEM: Starting full primary refresh. [2025-09-17T21:36:49.004192] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T21:36:49.128852] [INFO ] [REMOTE ] SEM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:36:49.215759] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-06. [2025-09-17T21:36:50.020362] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-11. [2025-09-17T21:36:50.026703] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T21:36:50.815753] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-04. [2025-09-17T21:36:51.147226] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T21:36:51.333446] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T21:36:51.615814] [INFO ] [REMOTE ] SEM: Fetching primary data for 2024-12. [2025-09-17T21:36:51.743229] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T21:36:52.415784] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-05. [2025-09-17T21:36:52.749940] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T21:36:53.215768] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-01. [2025-09-17T21:36:53.256011] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T21:36:54.015782] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-06. [2025-09-17T21:36:54.532743] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-17T21:36:54.690615] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T21:36:54.815819] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-02. [2025-09-17T21:36:55.615778] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-07. [2025-09-17T21:36:55.894913] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T21:36:56.415688] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-07. [2025-09-17T21:36:56.694609] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T21:36:57.215777] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-06. [2025-09-17T21:36:58.015792] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-03. [2025-09-17T21:36:58.598590] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T21:36:58.642467] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T21:36:58.815790] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-07. [2025-09-17T21:36:59.260862] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T21:36:59.615786] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-08. [2025-09-17T21:37:00.415695] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-08. [2025-09-17T21:37:00.468013] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T21:37:00.660882] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T21:37:01.215775] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-04. [2025-09-17T21:37:02.015768] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-08. [2025-09-17T21:37:02.065275] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T21:37:02.381749] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T21:37:02.815727] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-05. [2025-09-17T21:37:03.615840] [INFO ] [REMOTE ] SEG: Fetching primary data for 2025-09. [2025-09-17T21:37:03.830307] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T21:37:04.310562] [INFO ] [REMOTE ] SEG: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T21:37:04.312508] [INFO ] [REMOTE ] SEG: Full fetch complete (19760 records). [2025-09-17T21:37:04.312583] [DEBUG] [VALIDATOR ] SEG: Validating primary data. [2025-09-17T21:37:04.426144] [INFO ] [REMOTE ] SE: Fetching primary data for 2025-09. [2025-09-17T21:37:04.701318] [DEBUG] [VALIDATOR ] SEG: All expected trading days are present. [2025-09-17T21:37:04.701509] [DEBUG] [VALIDATOR ] SEG: Primary data validation passed. [2025-09-17T21:37:04.702034] [INFO ] [MAIN ] SEG: Fetched primary data is valid. [2025-09-17T21:37:04.702157] [DEBUG] [LOCAL ] SEG: Saving primary data. [2025-09-17T21:37:04.725610] [DEBUG] [LOCAL ] SEG: Trimmed 19760 records to 13948 (keeping 200 days of data) [2025-09-17T21:37:04.731154] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-05 (1.92 seconds). [2025-09-17T21:37:04.830770] [DEBUG] [LOCAL ] SEG: Primary data saved (13948 records). [2025-09-17T21:37:04.830938] [INFO ] [MAIN ] SEG: Full history saved. [2025-09-17T21:37:04.831032] [INFO ] [MAIN ] Update Progress: 1893/2371 symbols completed. SEG took 40.5s. Estimated remaining: 1h 9m 57s. Rate: 6.8 symbols/min [2025-09-17T21:37:05.004002] [INFO ] [MAIN ] SEMR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:37:05.042756] [DEBUG] [LOCAL ] SEMR: Loaded 41787 existing records from primary storage. [2025-09-17T21:37:05.042901] [INFO ] [MAIN ] SEMR: Loaded 41787 existing records. [2025-09-17T21:37:05.222951] [INFO ] [REMOTE ] SEI: Fetching primary data for 2025-09. [2025-09-17T21:37:05.223177] [WARN ] [MAIN ] SEMR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:37:05.224674] [INFO ] [MAIN ] SEMR: Wiping existing primary data before full refresh. [2025-09-17T21:37:05.224728] [INFO ] [LOCAL ] SEMR: Starting deletion of primary data. [2025-09-17T21:37:05.225472] [DEBUG] [LOCAL ] SEMR: Deleted primary data file. [2025-09-17T21:37:05.225521] [INFO ] [MAIN ] SEMR: Starting full primary refresh. [2025-09-17T21:37:05.590967] [INFO ] [REMOTE ] SEMR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:37:06.015765] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-11. [2025-09-17T21:37:06.336372] [INFO ] [REMOTE ] SE: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T21:37:06.344841] [INFO ] [REMOTE ] SE: Full fetch complete (76953 records). [2025-09-17T21:37:06.345005] [DEBUG] [VALIDATOR ] SE: Validating primary data. [2025-09-17T21:37:06.746456] [DEBUG] [VALIDATOR ] SE: All expected trading days are present. [2025-09-17T21:37:06.746553] [DEBUG] [VALIDATOR ] SE: Primary data validation passed. [2025-09-17T21:37:06.747583] [INFO ] [MAIN ] SE: Fetched primary data is valid. [2025-09-17T21:37:06.747630] [DEBUG] [LOCAL ] SE: Saving primary data. [2025-09-17T21:37:06.749100] [DEBUG] [LOCAL ] SE: Trimmed 76953 records to 53400 (keeping 200 days of data) [2025-09-17T21:37:06.816437] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-06. [2025-09-17T21:37:07.004026] [INFO ] [REMOTE ] SEI: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T21:37:07.013514] [INFO ] [REMOTE ] SEI: Full fetch complete (69207 records). [2025-09-17T21:37:07.014616] [DEBUG] [VALIDATOR ] SEI: Validating primary data. [2025-09-17T21:37:07.434683] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T21:37:07.484439] [DEBUG] [LOCAL ] SE: Primary data saved (53400 records). [2025-09-17T21:37:07.518875] [INFO ] [MAIN ] SE: Full history saved. [2025-09-17T21:37:07.538685] [INFO ] [MAIN ] Update Progress: 1894/2371 symbols completed. SE took 50.8s. Estimated remaining: 1h 9m 47s. Rate: 6.8 symbols/min [2025-09-17T21:37:07.538846] [DEBUG] [VALIDATOR ] SEI: All expected trading days are present. [2025-09-17T21:37:07.538909] [DEBUG] [VALIDATOR ] SEI: Primary data validation passed. [2025-09-17T21:37:07.540138] [INFO ] [MAIN ] SEI: Fetched primary data is valid. [2025-09-17T21:37:07.540237] [DEBUG] [LOCAL ] SEI: Saving primary data. [2025-09-17T21:37:07.615869] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2024-12. [2025-09-17T21:37:07.644699] [DEBUG] [LOCAL ] SEI: Trimmed 69207 records to 49604 (keeping 200 days of data) [2025-09-17T21:37:07.821891] [INFO ] [MAIN ] SES: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:37:08.048035] [DEBUG] [LOCAL ] SEI: Primary data saved (49604 records). [2025-09-17T21:37:08.048337] [INFO ] [MAIN ] SEI: Full history saved. [2025-09-17T21:37:08.048546] [INFO ] [MAIN ] Update Progress: 1895/2371 symbols completed. SEI took 34.6s. Estimated remaining: 1h 9m 36s. Rate: 6.8 symbols/min [2025-09-17T21:37:08.166654] [DEBUG] [LOCAL ] SES: Loaded 51522 existing records from primary storage. [2025-09-17T21:37:08.182375] [INFO ] [MAIN ] SES: Loaded 51522 existing records. [2025-09-17T21:37:08.271067] [INFO ] [MAIN ] SF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:37:08.445036] [WARN ] [MAIN ] SES: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:37:08.445457] [INFO ] [MAIN ] SES: Wiping existing primary data before full refresh. [2025-09-17T21:37:08.445811] [INFO ] [LOCAL ] SES: Starting deletion of primary data. [2025-09-17T21:37:08.447529] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T21:37:08.447716] [DEBUG] [LOCAL ] SES: Deleted primary data file. [2025-09-17T21:37:08.456625] [INFO ] [MAIN ] SES: Starting full primary refresh. [2025-09-17T21:37:08.495383] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-07. [2025-09-17T21:37:08.644320] [DEBUG] [LOCAL ] SF: Loaded 41950 existing records from primary storage. [2025-09-17T21:37:08.659232] [INFO ] [MAIN ] SF: Loaded 41950 existing records. [2025-09-17T21:37:09.027492] [WARN ] [MAIN ] SF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:37:09.031271] [INFO ] [REMOTE ] SES: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:37:09.032003] [INFO ] [MAIN ] SF: Wiping existing primary data before full refresh. [2025-09-17T21:37:09.032072] [INFO ] [LOCAL ] SF: Starting deletion of primary data. [2025-09-17T21:37:09.039536] [DEBUG] [LOCAL ] SF: Deleted primary data file. [2025-09-17T21:37:09.050289] [INFO ] [MAIN ] SF: Starting full primary refresh. [2025-09-17T21:37:09.119379] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T21:37:09.222869] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-01. [2025-09-17T21:37:09.429740] [INFO ] [REMOTE ] SF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:37:09.755369] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T21:37:10.015786] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-08. [2025-09-17T21:37:10.361370] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T21:37:10.815817] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-11. [2025-09-17T21:37:11.615843] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-02. [2025-09-17T21:37:11.742474] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T21:37:11.932378] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-11 (1.12 seconds). [2025-09-17T21:37:12.415784] [INFO ] [REMOTE ] SEM: Fetching primary data for 2025-09. [2025-09-17T21:37:13.082222] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T21:37:13.215760] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-03. [2025-09-17T21:37:13.289078] [INFO ] [REMOTE ] SEM: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T21:37:13.294300] [INFO ] [REMOTE ] SEM: Full fetch complete (61904 records). [2025-09-17T21:37:13.294400] [DEBUG] [VALIDATOR ] SEM: Validating primary data. [2025-09-17T21:37:13.703622] [DEBUG] [VALIDATOR ] SEM: All expected trading days are present. [2025-09-17T21:37:13.703719] [DEBUG] [VALIDATOR ] SEM: Primary data validation passed. [2025-09-17T21:37:13.704620] [INFO ] [MAIN ] SEM: Fetched primary data is valid. [2025-09-17T21:37:13.704677] [DEBUG] [LOCAL ] SEM: Saving primary data. [2025-09-17T21:37:13.705975] [DEBUG] [LOCAL ] SEM: Trimmed 61904 records to 43135 (keeping 200 days of data) [2025-09-17T21:37:13.978691] [DEBUG] [LOCAL ] SEM: Primary data saved (43135 records). [2025-09-17T21:37:13.978833] [INFO ] [MAIN ] SEM: Full history saved. [2025-09-17T21:37:13.980139] [INFO ] [MAIN ] Update Progress: 1896/2371 symbols completed. SEM took 25.7s. Estimated remaining: 1h 9m 27s. Rate: 6.8 symbols/min [2025-09-17T21:37:14.023439] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-11. [2025-09-17T21:37:14.160377] [INFO ] [MAIN ] SFB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:37:14.169625] [DEBUG] [LOCAL ] SFB: Loaded 4095 existing records from primary storage. [2025-09-17T21:37:14.169779] [INFO ] [MAIN ] SFB: Loaded 4095 existing records. [2025-09-17T21:37:14.350689] [WARN ] [MAIN ] SFB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:37:14.351735] [INFO ] [MAIN ] SFB: Wiping existing primary data before full refresh. [2025-09-17T21:37:14.351803] [INFO ] [LOCAL ] SFB: Starting deletion of primary data. [2025-09-17T21:37:14.352037] [DEBUG] [LOCAL ] SFB: Deleted primary data file. [2025-09-17T21:37:14.352129] [INFO ] [MAIN ] SFB: Starting full primary refresh. [2025-09-17T21:37:14.713597] [INFO ] [REMOTE ] SFB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:37:14.738483] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T21:37:14.815751] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-11. [2025-09-17T21:37:15.236355] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-11 (0.42 seconds). [2025-09-17T21:37:15.615783] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-04. [2025-09-17T21:37:15.839584] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T21:37:16.415796] [INFO ] [REMOTE ] SF: Fetching primary data for 2024-12. [2025-09-17T21:37:16.865904] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T21:37:17.215780] [INFO ] [REMOTE ] SES: Fetching primary data for 2024-12. [2025-09-17T21:37:17.521920] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T21:37:18.015783] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-01. [2025-09-17T21:37:18.815762] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-05. [2025-09-17T21:37:18.891691] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T21:37:19.536847] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T21:37:19.615788] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-01. [2025-09-17T21:37:20.321672] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T21:37:20.415782] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-02. [2025-09-17T21:37:21.215787] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-06. [2025-09-17T21:37:21.904857] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-17T21:37:21.935444] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T21:37:22.015820] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-02. [2025-09-17T21:37:22.770407] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T21:37:22.815866] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-03. [2025-09-17T21:37:23.615773] [INFO ] [REMOTE ] SFB: Fetching primary data for 2024-12. [2025-09-17T21:37:24.136962] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T21:37:24.213338] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T21:37:24.415761] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-01. [2025-09-17T21:37:24.561155] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-02 (2.55 seconds). [2025-09-17T21:37:24.745479] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-01 (0.33 seconds). [2025-09-17T21:37:25.215790] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-03. [2025-09-17T21:37:26.015796] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-04. [2025-09-17T21:37:26.815814] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-07. [2025-09-17T21:37:27.321345] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-03 (2.11 seconds). [2025-09-17T21:37:27.615694] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-04. [2025-09-17T21:37:27.728895] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T21:37:28.415895] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-05. [2025-09-17T21:37:28.420729] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T21:37:29.215804] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-08. [2025-09-17T21:37:29.614475] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T21:37:29.918929] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-17T21:37:30.015803] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-05. [2025-09-17T21:37:30.500399] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T21:37:30.815771] [INFO ] [REMOTE ] SEMR: Fetching primary data for 2025-09. [2025-09-17T21:37:31.615809] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-06. [2025-09-17T21:37:32.182072] [INFO ] [REMOTE ] SEMR: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T21:37:32.188112] [INFO ] [REMOTE ] SEMR: Full fetch complete (58363 records). [2025-09-17T21:37:32.188259] [DEBUG] [VALIDATOR ] SEMR: Validating primary data. [2025-09-17T21:37:32.424002] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-02. [2025-09-17T21:37:32.592155] [DEBUG] [VALIDATOR ] SEMR: All expected trading days are present. [2025-09-17T21:37:32.592426] [DEBUG] [VALIDATOR ] SEMR: Primary data validation passed. [2025-09-17T21:37:32.593831] [INFO ] [MAIN ] SEMR: Fetched primary data is valid. [2025-09-17T21:37:32.593997] [DEBUG] [LOCAL ] SEMR: Saving primary data. [2025-09-17T21:37:32.596434] [DEBUG] [LOCAL ] SEMR: Trimmed 58363 records to 41753 (keeping 200 days of data) [2025-09-17T21:37:32.628916] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-17T21:37:32.752688] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T21:37:32.913715] [DEBUG] [LOCAL ] SEMR: Primary data saved (41753 records). [2025-09-17T21:37:32.913886] [INFO ] [MAIN ] SEMR: Full history saved. [2025-09-17T21:37:32.913979] [INFO ] [MAIN ] Update Progress: 1897/2371 symbols completed. SEMR took 28.1s. Estimated remaining: 1h 9m 21s. Rate: 6.8 symbols/min [2025-09-17T21:37:33.092511] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-02 (0.67 seconds). [2025-09-17T21:37:33.092341] [INFO ] [MAIN ] SFBS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:37:33.114983] [DEBUG] [LOCAL ] SFBS: Loaded 21394 existing records from primary storage. [2025-09-17T21:37:33.115120] [INFO ] [MAIN ] SFBS: Loaded 21394 existing records. [2025-09-17T21:37:33.220851] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-06. [2025-09-17T21:37:33.330930] [WARN ] [MAIN ] SFBS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:37:33.331190] [INFO ] [MAIN ] SFBS: Wiping existing primary data before full refresh. [2025-09-17T21:37:33.331237] [INFO ] [LOCAL ] SFBS: Starting deletion of primary data. [2025-09-17T21:37:33.331748] [DEBUG] [LOCAL ] SFBS: Deleted primary data file. [2025-09-17T21:37:33.331795] [INFO ] [MAIN ] SFBS: Starting full primary refresh. [2025-09-17T21:37:33.691815] [INFO ] [REMOTE ] SFBS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:37:34.015802] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-11. [2025-09-17T21:37:34.765143] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T21:37:34.815735] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2024-12. [2025-09-17T21:37:35.541754] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T21:37:35.615803] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-03. [2025-09-17T21:37:35.677788] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-17T21:37:35.981401] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T21:37:36.415805] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-04. [2025-09-17T21:37:36.822802] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-17T21:37:37.215763] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-05. [2025-09-17T21:37:37.576994] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-05 (0.36 seconds). [2025-09-17T21:37:38.015836] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-07. [2025-09-17T21:37:38.815790] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-07. [2025-09-17T21:37:39.615871] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-06. [2025-09-17T21:37:40.006923] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T21:37:40.054121] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T21:37:40.056229] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T21:37:40.415818] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-08. [2025-09-17T21:37:41.215768] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-08. [2025-09-17T21:37:41.497923] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T21:37:42.015792] [INFO ] [REMOTE ] SF: Fetching primary data for 2025-09. [2025-09-17T21:37:42.815773] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-01. [2025-09-17T21:37:43.204869] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T21:37:43.301793] [INFO ] [REMOTE ] SF: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T21:37:43.307277] [INFO ] [REMOTE ] SF: Full fetch complete (59176 records). [2025-09-17T21:37:43.307471] [DEBUG] [VALIDATOR ] SF: Validating primary data. [2025-09-17T21:37:43.620911] [INFO ] [REMOTE ] SES: Fetching primary data for 2025-09. [2025-09-17T21:37:43.710232] [DEBUG] [VALIDATOR ] SF: All expected trading days are present. [2025-09-17T21:37:43.710320] [DEBUG] [VALIDATOR ] SF: Primary data validation passed. [2025-09-17T21:37:43.711285] [INFO ] [MAIN ] SF: Fetched primary data is valid. [2025-09-17T21:37:43.711358] [DEBUG] [LOCAL ] SF: Saving primary data. [2025-09-17T21:37:43.712706] [DEBUG] [LOCAL ] SF: Trimmed 59176 records to 41953 (keeping 200 days of data) [2025-09-17T21:37:43.994140] [DEBUG] [LOCAL ] SF: Primary data saved (41953 records). [2025-09-17T21:37:43.994295] [INFO ] [MAIN ] SF: Full history saved. [2025-09-17T21:37:43.994426] [INFO ] [MAIN ] Update Progress: 1898/2371 symbols completed. SF took 35.9s. Estimated remaining: 1h 9m 12s. Rate: 6.8 symbols/min [2025-09-17T21:37:44.170514] [INFO ] [MAIN ] SFL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:37:44.186905] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T21:37:44.233877] [DEBUG] [LOCAL ] SFL: Loaded 45538 existing records from primary storage. [2025-09-17T21:37:44.234090] [INFO ] [MAIN ] SFL: Loaded 45538 existing records. [2025-09-17T21:37:44.419053] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-02. [2025-09-17T21:37:44.419298] [WARN ] [MAIN ] SFL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:37:44.420579] [INFO ] [MAIN ] SFL: Wiping existing primary data before full refresh. [2025-09-17T21:37:44.420632] [INFO ] [LOCAL ] SFL: Starting deletion of primary data. [2025-09-17T21:37:44.421691] [DEBUG] [LOCAL ] SFL: Deleted primary data file. [2025-09-17T21:37:44.421762] [INFO ] [MAIN ] SFL: Starting full primary refresh. [2025-09-17T21:37:44.785067] [INFO ] [REMOTE ] SFL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:37:45.141263] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T21:37:45.215782] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-03. [2025-09-17T21:37:45.627335] [INFO ] [REMOTE ] SES: Incremental fetch complete for 2025-09 (2.01 seconds). [2025-09-17T21:37:45.634175] [INFO ] [REMOTE ] SES: Full fetch complete (74076 records). [2025-09-17T21:37:45.634378] [DEBUG] [VALIDATOR ] SES: Validating primary data. [2025-09-17T21:37:46.030230] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-11. [2025-09-17T21:37:46.034338] [DEBUG] [VALIDATOR ] SES: All expected trading days are present. [2025-09-17T21:37:46.035600] [DEBUG] [VALIDATOR ] SES: Primary data validation passed. [2025-09-17T21:37:46.036717] [INFO ] [MAIN ] SES: Fetched primary data is valid. [2025-09-17T21:37:46.037087] [DEBUG] [LOCAL ] SES: Saving primary data. [2025-09-17T21:37:46.039123] [DEBUG] [LOCAL ] SES: Trimmed 74076 records to 51517 (keeping 200 days of data) [2025-09-17T21:37:46.352065] [DEBUG] [LOCAL ] SES: Primary data saved (51517 records). [2025-09-17T21:37:46.352234] [INFO ] [MAIN ] SES: Full history saved. [2025-09-17T21:37:46.352379] [INFO ] [MAIN ] Update Progress: 1899/2371 symbols completed. SES took 38.8s. Estimated remaining: 1h 9m 2s. Rate: 6.8 symbols/min [2025-09-17T21:37:46.534155] [INFO ] [MAIN ] SG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:37:46.549349] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T21:37:46.603456] [DEBUG] [LOCAL ] SG: Loaded 53464 existing records from primary storage. [2025-09-17T21:37:46.603700] [INFO ] [MAIN ] SG: Loaded 53464 existing records. [2025-09-17T21:37:46.784417] [WARN ] [MAIN ] SG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:37:46.784691] [INFO ] [MAIN ] SG: Wiping existing primary data before full refresh. [2025-09-17T21:37:46.784737] [INFO ] [LOCAL ] SG: Starting deletion of primary data. [2025-09-17T21:37:46.785829] [DEBUG] [LOCAL ] SG: Deleted primary data file. [2025-09-17T21:37:46.785880] [INFO ] [MAIN ] SG: Starting full primary refresh. [2025-09-17T21:37:46.820980] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-04. [2025-09-17T21:37:47.144682] [INFO ] [REMOTE ] SG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:37:47.615015] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T21:37:47.623451] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-11. [2025-09-17T21:37:48.081895] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T21:37:48.415793] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-07. [2025-09-17T21:37:49.070867] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T21:37:49.082870] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T21:37:49.215738] [INFO ] [REMOTE ] SG: Fetching primary data for 2024-12. [2025-09-17T21:37:50.015811] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-05. [2025-09-17T21:37:50.815792] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-08. [2025-09-17T21:37:51.087119] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T21:37:51.123002] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-08 (0.31 seconds). [2025-09-17T21:37:51.138888] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T21:37:51.615815] [INFO ] [REMOTE ] SFB: Fetching primary data for 2025-09. [2025-09-17T21:37:51.935851] [INFO ] [REMOTE ] SFB: Incremental fetch complete for 2025-09 (0.32 seconds). [2025-09-17T21:37:51.936944] [INFO ] [REMOTE ] SFB: Full fetch complete (5731 records). [2025-09-17T21:37:51.937051] [DEBUG] [VALIDATOR ] SFB: Validating primary data. [2025-09-17T21:37:52.335483] [DEBUG] [VALIDATOR ] SFB: All expected trading days are present. [2025-09-17T21:37:52.335628] [DEBUG] [VALIDATOR ] SFB: Primary data validation passed. [2025-09-17T21:37:52.335902] [INFO ] [MAIN ] SFB: Fetched primary data is valid. [2025-09-17T21:37:52.335945] [DEBUG] [LOCAL ] SFB: Saving primary data. [2025-09-17T21:37:52.336492] [DEBUG] [LOCAL ] SFB: Trimmed 5731 records to 4084 (keeping 200 days of data) [2025-09-17T21:37:52.365276] [DEBUG] [LOCAL ] SFB: Primary data saved (4084 records). [2025-09-17T21:37:52.365495] [INFO ] [MAIN ] SFB: Full history saved. [2025-09-17T21:37:52.365607] [INFO ] [MAIN ] Update Progress: 1900/2371 symbols completed. SFB took 38.4s. Estimated remaining: 1h 8m 53s. Rate: 6.8 symbols/min [2025-09-17T21:37:52.421088] [INFO ] [REMOTE ] SFL: Fetching primary data for 2024-12. [2025-09-17T21:37:52.543856] [INFO ] [MAIN ] SGHC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:37:52.594898] [DEBUG] [LOCAL ] SGHC: Loaded 45273 existing records from primary storage. [2025-09-17T21:37:52.595058] [INFO ] [MAIN ] SGHC: Loaded 45273 existing records. [2025-09-17T21:37:52.772188] [WARN ] [MAIN ] SGHC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:37:52.772476] [INFO ] [MAIN ] SGHC: Wiping existing primary data before full refresh. [2025-09-17T21:37:52.772521] [INFO ] [LOCAL ] SGHC: Starting deletion of primary data. [2025-09-17T21:37:52.773392] [DEBUG] [LOCAL ] SGHC: Deleted primary data file. [2025-09-17T21:37:52.773470] [INFO ] [MAIN ] SGHC: Starting full primary refresh. [2025-09-17T21:37:53.123775] [INFO ] [REMOTE ] SGHC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:37:53.215795] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-06. [2025-09-17T21:37:53.681407] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T21:37:53.933693] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T21:37:54.015745] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-01. [2025-09-17T21:37:54.815774] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-07. [2025-09-17T21:37:55.222682] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T21:37:55.532197] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T21:37:55.615735] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-08. [2025-09-17T21:37:56.415805] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-01. [2025-09-17T21:37:56.649088] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T21:37:57.215791] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-02. [2025-09-17T21:37:58.015754] [INFO ] [REMOTE ] SFBS: Fetching primary data for 2025-09. [2025-09-17T21:37:58.095955] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T21:37:58.390927] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T21:37:58.648108] [INFO ] [REMOTE ] SFBS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T21:37:58.652214] [INFO ] [REMOTE ] SFBS: Full fetch complete (30032 records). [2025-09-17T21:37:58.652335] [DEBUG] [VALIDATOR ] SFBS: Validating primary data. [2025-09-17T21:37:58.823415] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-11. [2025-09-17T21:37:59.032070] [DEBUG] [VALIDATOR ] SFBS: All expected trading days are present. [2025-09-17T21:37:59.032186] [DEBUG] [VALIDATOR ] SFBS: Primary data validation passed. [2025-09-17T21:37:59.032774] [INFO ] [MAIN ] SFBS: Fetched primary data is valid. [2025-09-17T21:37:59.032819] [DEBUG] [LOCAL ] SFBS: Saving primary data. [2025-09-17T21:37:59.033955] [DEBUG] [LOCAL ] SFBS: Trimmed 30032 records to 21357 (keeping 200 days of data) [2025-09-17T21:37:59.173598] [DEBUG] [LOCAL ] SFBS: Primary data saved (21357 records). [2025-09-17T21:37:59.173748] [INFO ] [MAIN ] SFBS: Full history saved. [2025-09-17T21:37:59.173921] [INFO ] [MAIN ] Update Progress: 1901/2371 symbols completed. SFBS took 26.3s. Estimated remaining: 1h 8m 43s. Rate: 6.8 symbols/min [2025-09-17T21:37:59.347555] [INFO ] [MAIN ] SGI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:37:59.347756] [DEBUG] [LOCAL ] SGI: No existing data file found in primary storage. [2025-09-17T21:37:59.347795] [WARN ] [MAIN ] SGI: No existing data found, performing full refresh instead. [2025-09-17T21:37:59.347945] [INFO ] [MAIN ] SGI: Wiping existing primary data before full refresh. [2025-09-17T21:37:59.347985] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-17T21:37:59.348027] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-17T21:37:59.348060] [INFO ] [MAIN ] SGI: Starting full primary refresh. [2025-09-17T21:37:59.620911] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-02. [2025-09-17T21:37:59.732091] [INFO ] [REMOTE ] SGI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:37:59.904286] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T21:38:00.415803] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-03. [2025-09-17T21:38:01.215843] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2024-12. [2025-09-17T21:38:01.589856] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T21:38:01.720660] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T21:38:02.015795] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-03. [2025-09-17T21:38:02.255868] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T21:38:02.815791] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-04. [2025-09-17T21:38:03.615766] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-11. [2025-09-17T21:38:03.816549] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:38:03.816930] [WARN ] [REMOTE ] SGI: No data returned for month 2024-11 [2025-09-17T21:38:03.906715] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T21:38:04.415783] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-04. [2025-09-17T21:38:04.492325] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T21:38:05.215792] [INFO ] [REMOTE ] SGI: Fetching primary data for 2024-12. [2025-09-17T21:38:05.412785] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:38:05.413176] [WARN ] [REMOTE ] SGI: No data returned for month 2024-12 [2025-09-17T21:38:06.015744] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-01. [2025-09-17T21:38:06.108979] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T21:38:06.815799] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-05. [2025-09-17T21:38:07.070139] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T21:38:07.615840] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-01. [2025-09-17T21:38:07.843788] [DEBUG] [REMOTE ] SGI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:38:07.844154] [WARN ] [REMOTE ] SGI: No data returned for month 2025-01 [2025-09-17T21:38:08.386695] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T21:38:08.415676] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-06. [2025-09-17T21:38:09.215837] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-02. [2025-09-17T21:38:10.015801] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-02. [2025-09-17T21:38:10.057189] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T21:38:10.444879] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T21:38:10.816079] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-03. [2025-09-17T21:38:10.816010] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T21:38:11.615793] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-03. [2025-09-17T21:38:12.073541] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T21:38:12.415781] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-04. [2025-09-17T21:38:13.215819] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-05. [2025-09-17T21:38:13.482240] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T21:38:13.557893] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T21:38:14.015823] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-05. [2025-09-17T21:38:14.821777] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-07. [2025-09-17T21:38:14.848839] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T21:38:15.195073] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T21:38:15.615883] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-06. [2025-09-17T21:38:16.415857] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-06. [2025-09-17T21:38:16.460380] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T21:38:17.215810] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-04. [2025-09-17T21:38:17.458431] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T21:38:18.004534] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T21:38:18.015720] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-07. [2025-09-17T21:38:18.815783] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-08. [2025-09-17T21:38:19.003302] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T21:38:19.615871] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-07. [2025-09-17T21:38:19.755338] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T21:38:20.032822] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T21:38:20.415813] [INFO ] [REMOTE ] SFL: Fetching primary data for 2025-09. [2025-09-17T21:38:21.215816] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-08. [2025-09-17T21:38:21.616386] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T21:38:21.877072] [INFO ] [REMOTE ] SFL: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T21:38:21.883193] [INFO ] [REMOTE ] SFL: Full fetch complete (65150 records). [2025-09-17T21:38:21.883316] [DEBUG] [VALIDATOR ] SFL: Validating primary data. [2025-09-17T21:38:22.024663] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-08. [2025-09-17T21:38:22.288278] [DEBUG] [VALIDATOR ] SFL: All expected trading days are present. [2025-09-17T21:38:22.288400] [DEBUG] [VALIDATOR ] SFL: Primary data validation passed. [2025-09-17T21:38:22.289915] [INFO ] [MAIN ] SFL: Fetched primary data is valid. [2025-09-17T21:38:22.289995] [DEBUG] [LOCAL ] SFL: Saving primary data. [2025-09-17T21:38:22.292483] [DEBUG] [LOCAL ] SFL: Trimmed 65150 records to 45499 (keeping 200 days of data) [2025-09-17T21:38:22.589236] [DEBUG] [LOCAL ] SFL: Primary data saved (45499 records). [2025-09-17T21:38:22.589397] [INFO ] [MAIN ] SFL: Full history saved. [2025-09-17T21:38:22.589487] [INFO ] [MAIN ] Update Progress: 1902/2371 symbols completed. SFL took 38.6s. Estimated remaining: 1h 8m 38s. Rate: 6.8 symbols/min [2025-09-17T21:38:22.760870] [INFO ] [MAIN ] SGU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:38:22.769664] [DEBUG] [LOCAL ] SGU: Loaded 6617 existing records from primary storage. [2025-09-17T21:38:22.769776] [INFO ] [MAIN ] SGU: Loaded 6617 existing records. [2025-09-17T21:38:22.834881] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-05. [2025-09-17T21:38:22.954925] [WARN ] [MAIN ] SGU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:38:22.955248] [INFO ] [MAIN ] SGU: Wiping existing primary data before full refresh. [2025-09-17T21:38:22.955414] [INFO ] [LOCAL ] SGU: Starting deletion of primary data. [2025-09-17T21:38:22.955755] [DEBUG] [LOCAL ] SGU: Deleted primary data file. [2025-09-17T21:38:22.955838] [INFO ] [MAIN ] SGU: Starting full primary refresh. [2025-09-17T21:38:23.208333] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T21:38:23.359563] [INFO ] [REMOTE ] SGU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:38:23.615806] [INFO ] [REMOTE ] SGHC: Fetching primary data for 2025-09. [2025-09-17T21:38:23.855543] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T21:38:24.305256] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T21:38:24.415785] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-11. [2025-09-17T21:38:24.796302] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-11 (0.38 seconds). [2025-09-17T21:38:25.215824] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-06. [2025-09-17T21:38:25.362970] [INFO ] [REMOTE ] SGHC: Incremental fetch complete for 2025-09 (1.75 seconds). [2025-09-17T21:38:25.369746] [INFO ] [REMOTE ] SGHC: Full fetch complete (62841 records). [2025-09-17T21:38:25.369866] [DEBUG] [VALIDATOR ] SGHC: Validating primary data. [2025-09-17T21:38:25.752016] [DEBUG] [VALIDATOR ] SGHC: All expected trading days are present. [2025-09-17T21:38:25.752097] [DEBUG] [VALIDATOR ] SGHC: Primary data validation passed. [2025-09-17T21:38:25.753007] [INFO ] [MAIN ] SGHC: Fetched primary data is valid. [2025-09-17T21:38:25.753053] [DEBUG] [LOCAL ] SGHC: Saving primary data. [2025-09-17T21:38:25.754332] [DEBUG] [LOCAL ] SGHC: Trimmed 62841 records to 45384 (keeping 200 days of data) [2025-09-17T21:38:26.021817] [INFO ] [REMOTE ] SGU: Fetching primary data for 2024-12. [2025-09-17T21:38:26.032548] [DEBUG] [LOCAL ] SGHC: Primary data saved (45384 records). [2025-09-17T21:38:26.032671] [INFO ] [MAIN ] SGHC: Full history saved. [2025-09-17T21:38:26.033582] [INFO ] [MAIN ] Update Progress: 1903/2371 symbols completed. SGHC took 33.7s. Estimated remaining: 1h 8m 28s. Rate: 6.8 symbols/min [2025-09-17T21:38:26.205747] [INFO ] [MAIN ] SHAK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:38:26.254464] [DEBUG] [LOCAL ] SHAK: Loaded 49228 existing records from primary storage. [2025-09-17T21:38:26.254663] [INFO ] [MAIN ] SHAK: Loaded 49228 existing records. [2025-09-17T21:38:26.435284] [WARN ] [MAIN ] SHAK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:38:26.435787] [INFO ] [MAIN ] SHAK: Wiping existing primary data before full refresh. [2025-09-17T21:38:26.435847] [INFO ] [LOCAL ] SHAK: Starting deletion of primary data. [2025-09-17T21:38:26.437567] [DEBUG] [LOCAL ] SHAK: Deleted primary data file. [2025-09-17T21:38:26.437688] [INFO ] [MAIN ] SHAK: Starting full primary refresh. [2025-09-17T21:38:26.739588] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T21:38:26.819461] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-01. [2025-09-17T21:38:26.853494] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T21:38:26.850786] [INFO ] [REMOTE ] SHAK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:38:27.336350] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-01 (0.52 seconds). [2025-09-17T21:38:27.615773] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-07. [2025-09-17T21:38:28.415860] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-02. [2025-09-17T21:38:29.215854] [INFO ] [REMOTE ] SG: Fetching primary data for 2025-09. [2025-09-17T21:38:29.223526] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T21:38:29.573247] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T21:38:30.015798] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-11. [2025-09-17T21:38:30.638229] [INFO ] [REMOTE ] SG: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T21:38:30.644996] [INFO ] [REMOTE ] SG: Full fetch complete (77095 records). [2025-09-17T21:38:30.645109] [DEBUG] [VALIDATOR ] SG: Validating primary data. [2025-09-17T21:38:30.822147] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-08. [2025-09-17T21:38:31.079776] [DEBUG] [VALIDATOR ] SG: All expected trading days are present. [2025-09-17T21:38:31.079862] [DEBUG] [VALIDATOR ] SG: Primary data validation passed. [2025-09-17T21:38:31.080955] [INFO ] [MAIN ] SG: Fetched primary data is valid. [2025-09-17T21:38:31.081001] [DEBUG] [LOCAL ] SG: Saving primary data. [2025-09-17T21:38:31.082441] [DEBUG] [LOCAL ] SG: Trimmed 77095 records to 53460 (keeping 200 days of data) [2025-09-17T21:38:31.397509] [DEBUG] [LOCAL ] SG: Primary data saved (53460 records). [2025-09-17T21:38:31.397678] [INFO ] [MAIN ] SG: Full history saved. [2025-09-17T21:38:31.397768] [INFO ] [MAIN ] Update Progress: 1904/2371 symbols completed. SG took 45.0s. Estimated remaining: 1h 8m 18s. Rate: 6.8 symbols/min [2025-09-17T21:38:31.574977] [INFO ] [MAIN ] SHCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:38:31.599957] [DEBUG] [LOCAL ] SHCO: Loaded 26419 existing records from primary storage. [2025-09-17T21:38:31.600086] [INFO ] [MAIN ] SHCO: Loaded 26419 existing records. [2025-09-17T21:38:31.621047] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-03. [2025-09-17T21:38:31.785106] [WARN ] [MAIN ] SHCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:38:31.785734] [INFO ] [MAIN ] SHCO: Wiping existing primary data before full refresh. [2025-09-17T21:38:31.785786] [INFO ] [LOCAL ] SHCO: Starting deletion of primary data. [2025-09-17T21:38:31.800596] [DEBUG] [LOCAL ] SHCO: Deleted primary data file. [2025-09-17T21:38:31.800719] [INFO ] [MAIN ] SHCO: Starting full primary refresh. [2025-09-17T21:38:31.926207] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T21:38:32.194035] [INFO ] [REMOTE ] SHCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:38:32.195206] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T21:38:32.415684] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-11. [2025-09-17T21:38:32.494255] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T21:38:33.095913] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-11 (0.68 seconds). [2025-09-17T21:38:33.215812] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2024-12. [2025-09-17T21:38:34.015786] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-04. [2025-09-17T21:38:34.513978] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T21:38:34.714930] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T21:38:34.815853] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2024-12. [2025-09-17T21:38:35.620936] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-01. [2025-09-17T21:38:35.628881] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T21:38:36.415785] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-05. [2025-09-17T21:38:37.123021] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T21:38:37.215797] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-06. [2025-09-17T21:38:37.397619] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T21:38:37.681448] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T21:38:38.015808] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-02. [2025-09-17T21:38:38.815802] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-07. [2025-09-17T21:38:39.615837] [INFO ] [REMOTE ] SGI: Fetching primary data for 2025-09. [2025-09-17T21:38:39.757395] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T21:38:39.793443] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T21:38:40.415787] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-03. [2025-09-17T21:38:40.902499] [INFO ] [REMOTE ] SGI: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T21:38:40.909263] [INFO ] [REMOTE ] SGI: Full fetch complete (55668 records). [2025-09-17T21:38:40.909384] [DEBUG] [VALIDATOR ] SGI: Validating primary data. [2025-09-17T21:38:41.105043] [WARN ] [VALIDATOR ] SGI: Validation failed - insufficient historical data. Have 147 unique days, need 200 days [2025-09-17T21:38:41.105677] [FATAL] [MAIN ] SGI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:38:41.105730] [WARN ] [MAIN ] SGI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:38:41.105781] [INFO ] [LOCAL ] SGI: Starting deletion of primary data. [2025-09-17T21:38:41.105852] [DEBUG] [LOCAL ] SGI: No primary data file found to delete. [2025-09-17T21:38:41.105895] [INFO ] [LOCAL ] SGI: Starting deletion of derivative data. [2025-09-17T21:38:41.105955] [DEBUG] [LOCAL ] SGI: No derivative data file found to delete. [2025-09-17T21:38:41.106031] [INFO ] [MAIN ] Update Progress: 1905/2371 symbols completed. SGI took 41.9s. Estimated remaining: 1h 8m 10s. Rate: 6.8 symbols/min [2025-09-17T21:38:41.220843] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-01. [2025-09-17T21:38:41.277112] [INFO ] [MAIN ] SHEL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:38:41.332920] [DEBUG] [LOCAL ] SHEL: Loaded 53673 existing records from primary storage. [2025-09-17T21:38:41.333414] [INFO ] [MAIN ] SHEL: Loaded 53673 existing records. [2025-09-17T21:38:41.508627] [WARN ] [MAIN ] SHEL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:38:41.508902] [INFO ] [MAIN ] SHEL: Wiping existing primary data before full refresh. [2025-09-17T21:38:41.508970] [INFO ] [LOCAL ] SHEL: Starting deletion of primary data. [2025-09-17T21:38:41.510184] [DEBUG] [LOCAL ] SHEL: Deleted primary data file. [2025-09-17T21:38:41.510241] [INFO ] [MAIN ] SHEL: Starting full primary refresh. [2025-09-17T21:38:41.867478] [INFO ] [REMOTE ] SHEL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:38:42.015790] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-08. [2025-09-17T21:38:42.112384] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T21:38:42.456952] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-08 (0.44 seconds). [2025-09-17T21:38:42.729976] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-03 (2.31 seconds). [2025-09-17T21:38:42.815686] [INFO ] [REMOTE ] SGU: Fetching primary data for 2025-09. [2025-09-17T21:38:43.487746] [INFO ] [REMOTE ] SGU: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T21:38:43.489243] [INFO ] [REMOTE ] SGU: Full fetch complete (8856 records). [2025-09-17T21:38:43.489314] [DEBUG] [VALIDATOR ] SGU: Validating primary data. [2025-09-17T21:38:43.620857] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-02. [2025-09-17T21:38:43.877698] [DEBUG] [VALIDATOR ] SGU: All expected trading days are present. [2025-09-17T21:38:43.877782] [DEBUG] [VALIDATOR ] SGU: Primary data validation passed. [2025-09-17T21:38:43.878016] [INFO ] [MAIN ] SGU: Fetched primary data is valid. [2025-09-17T21:38:43.878058] [DEBUG] [LOCAL ] SGU: Saving primary data. [2025-09-17T21:38:43.878504] [DEBUG] [LOCAL ] SGU: Trimmed 8856 records to 6642 (keeping 200 days of data) [2025-09-17T21:38:43.920036] [DEBUG] [LOCAL ] SGU: Primary data saved (6642 records). [2025-09-17T21:38:43.920160] [INFO ] [MAIN ] SGU: Full history saved. [2025-09-17T21:38:43.920244] [INFO ] [MAIN ] Update Progress: 1906/2371 symbols completed. SGU took 21.3s. Estimated remaining: 1h 7m 60s. Rate: 6.8 symbols/min [2025-09-17T21:38:44.101568] [INFO ] [MAIN ] SHG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:38:44.128637] [DEBUG] [LOCAL ] SHG: Loaded 27707 existing records from primary storage. [2025-09-17T21:38:44.128819] [INFO ] [MAIN ] SHG: Loaded 27707 existing records. [2025-09-17T21:38:44.318442] [WARN ] [MAIN ] SHG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:38:44.318750] [INFO ] [MAIN ] SHG: Wiping existing primary data before full refresh. [2025-09-17T21:38:44.318805] [INFO ] [LOCAL ] SHG: Starting deletion of primary data. [2025-09-17T21:38:44.319401] [DEBUG] [LOCAL ] SHG: Deleted primary data file. [2025-09-17T21:38:44.319448] [INFO ] [MAIN ] SHG: Starting full primary refresh. [2025-09-17T21:38:44.423076] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-04. [2025-09-17T21:38:44.704275] [INFO ] [REMOTE ] SHG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:38:44.717347] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T21:38:45.215794] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-11. [2025-09-17T21:38:46.015767] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-03. [2025-09-17T21:38:46.093443] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T21:38:46.354567] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T21:38:46.815790] [INFO ] [REMOTE ] SHG: Fetching primary data for 2024-12. [2025-09-17T21:38:47.103564] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T21:38:47.615781] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-05. [2025-09-17T21:38:48.117346] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T21:38:48.415785] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-11. [2025-09-17T21:38:49.215797] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-04. [2025-09-17T21:38:49.433312] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T21:38:50.027303] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-01. [2025-09-17T21:38:50.032923] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T21:38:50.468706] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T21:38:50.815815] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-06. [2025-09-17T21:38:50.950904] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T21:38:51.615821] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-02. [2025-09-17T21:38:52.181198] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T21:38:52.415759] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-07. [2025-09-17T21:38:52.828023] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T21:38:53.215793] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-03. [2025-09-17T21:38:53.813264] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T21:38:54.015773] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-08. [2025-09-17T21:38:54.277705] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T21:38:54.815793] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-05. [2025-09-17T21:38:55.439007] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T21:38:55.464292] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T21:38:55.615765] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2024-12. [2025-09-17T21:38:56.415763] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-04. [2025-09-17T21:38:57.215761] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-06. [2025-09-17T21:38:57.363993] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T21:38:57.600922] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T21:38:58.015717] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-01. [2025-09-17T21:38:58.257738] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T21:38:58.815801] [INFO ] [REMOTE ] SHAK: Fetching primary data for 2025-09. [2025-09-17T21:38:59.615785] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-07. [2025-09-17T21:39:00.027309] [INFO ] [REMOTE ] SHAK: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T21:39:00.034150] [INFO ] [REMOTE ] SHAK: Full fetch complete (69743 records). [2025-09-17T21:39:00.034312] [DEBUG] [VALIDATOR ] SHAK: Validating primary data. [2025-09-17T21:39:00.417136] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-05. [2025-09-17T21:39:00.441274] [DEBUG] [VALIDATOR ] SHAK: All expected trading days are present. [2025-09-17T21:39:00.441466] [DEBUG] [VALIDATOR ] SHAK: Primary data validation passed. [2025-09-17T21:39:00.442715] [INFO ] [MAIN ] SHAK: Fetched primary data is valid. [2025-09-17T21:39:00.443023] [DEBUG] [LOCAL ] SHAK: Saving primary data. [2025-09-17T21:39:00.472527] [DEBUG] [LOCAL ] SHAK: Trimmed 69743 records to 49214 (keeping 200 days of data) [2025-09-17T21:39:00.479440] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-17T21:39:00.597450] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T21:39:00.814424] [DEBUG] [LOCAL ] SHAK: Primary data saved (49214 records). [2025-09-17T21:39:00.814578] [INFO ] [MAIN ] SHAK: Full history saved. [2025-09-17T21:39:00.815775] [INFO ] [MAIN ] Update Progress: 1907/2371 symbols completed. SHAK took 34.8s. Estimated remaining: 1h 7m 53s. Rate: 6.8 symbols/min [2025-09-17T21:39:00.998461] [INFO ] [MAIN ] SHO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:39:01.045480] [DEBUG] [LOCAL ] SHO: Loaded 49830 existing records from primary storage. [2025-09-17T21:39:01.045631] [INFO ] [MAIN ] SHO: Loaded 49830 existing records. [2025-09-17T21:39:01.228090] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-02. [2025-09-17T21:39:01.232717] [WARN ] [MAIN ] SHO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:39:01.233928] [INFO ] [MAIN ] SHO: Wiping existing primary data before full refresh. [2025-09-17T21:39:01.234010] [INFO ] [LOCAL ] SHO: Starting deletion of primary data. [2025-09-17T21:39:01.235111] [DEBUG] [LOCAL ] SHO: Deleted primary data file. [2025-09-17T21:39:01.235166] [INFO ] [MAIN ] SHO: Starting full primary refresh. [2025-09-17T21:39:01.598594] [INFO ] [REMOTE ] SHO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:39:01.692407] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T21:39:02.015833] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-06. [2025-09-17T21:39:02.815832] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-08. [2025-09-17T21:39:03.615850] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-11. [2025-09-17T21:39:04.760581] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-02 (3.53 seconds). [2025-09-17T21:39:04.771499] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-03. [2025-09-17T21:39:04.943350] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-06 (2.93 seconds). [2025-09-17T21:39:05.155785] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T21:39:05.215727] [INFO ] [REMOTE ] SHO: Fetching primary data for 2024-12. [2025-09-17T21:39:05.379548] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-17T21:39:06.015818] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-07. [2025-09-17T21:39:06.614009] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T21:39:06.815805] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-01. [2025-09-17T21:39:07.054482] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-03 (2.28 seconds). [2025-09-17T21:39:07.085310] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-07 (1.07 seconds). [2025-09-17T21:39:07.615838] [INFO ] [REMOTE ] SHCO: Fetching primary data for 2025-09. [2025-09-17T21:39:08.198464] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T21:39:08.415828] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-04. [2025-09-17T21:39:08.610331] [INFO ] [REMOTE ] SHCO: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T21:39:08.614990] [INFO ] [REMOTE ] SHCO: Full fetch complete (37067 records). [2025-09-17T21:39:08.615075] [DEBUG] [VALIDATOR ] SHCO: Validating primary data. [2025-09-17T21:39:09.000001] [DEBUG] [VALIDATOR ] SHCO: All expected trading days are present. [2025-09-17T21:39:09.000117] [DEBUG] [VALIDATOR ] SHCO: Primary data validation passed. [2025-09-17T21:39:09.000951] [INFO ] [MAIN ] SHCO: Fetched primary data is valid. [2025-09-17T21:39:09.001005] [DEBUG] [LOCAL ] SHCO: Saving primary data. [2025-09-17T21:39:09.001993] [DEBUG] [LOCAL ] SHCO: Trimmed 37067 records to 26315 (keeping 200 days of data) [2025-09-17T21:39:09.151563] [DEBUG] [LOCAL ] SHCO: Primary data saved (26315 records). [2025-09-17T21:39:09.151718] [INFO ] [MAIN ] SHCO: Full history saved. [2025-09-17T21:39:09.151814] [INFO ] [MAIN ] Update Progress: 1908/2371 symbols completed. SHCO took 37.8s. Estimated remaining: 1h 7m 44s. Rate: 6.8 symbols/min [2025-09-17T21:39:09.221099] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-02. [2025-09-17T21:39:09.324120] [INFO ] [MAIN ] SHOC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:39:09.331013] [DEBUG] [LOCAL ] SHOC: Loaded 4280 existing records from primary storage. [2025-09-17T21:39:09.331133] [INFO ] [MAIN ] SHOC: Loaded 4280 existing records. [2025-09-17T21:39:09.508186] [WARN ] [MAIN ] SHOC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:39:09.508479] [INFO ] [MAIN ] SHOC: Wiping existing primary data before full refresh. [2025-09-17T21:39:09.508527] [INFO ] [LOCAL ] SHOC: Starting deletion of primary data. [2025-09-17T21:39:09.508789] [DEBUG] [LOCAL ] SHOC: Deleted primary data file. [2025-09-17T21:39:09.508838] [INFO ] [MAIN ] SHOC: Starting full primary refresh. [2025-09-17T21:39:09.864042] [INFO ] [REMOTE ] SHOC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:39:10.015800] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-11. [2025-09-17T21:39:10.490725] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T21:39:10.639764] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T21:39:10.671757] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-04 (2.26 seconds). [2025-09-17T21:39:10.815851] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-05. [2025-09-17T21:39:11.615832] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2024-12. [2025-09-17T21:39:12.325569] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T21:39:12.415783] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-01. [2025-09-17T21:39:13.042894] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-17T21:39:13.174939] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T21:39:13.215761] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-06. [2025-09-17T21:39:14.015835] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-08. [2025-09-17T21:39:14.815791] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-02. [2025-09-17T21:39:15.615809] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-03. [2025-09-17T21:39:15.849201] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-06 (2.63 seconds). [2025-09-17T21:39:16.002099] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T21:39:16.415847] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-07. [2025-09-17T21:39:16.519752] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-08 (2.50 seconds). [2025-09-17T21:39:17.007882] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T21:39:17.215813] [INFO ] [REMOTE ] SHG: Fetching primary data for 2025-09. [2025-09-17T21:39:18.015834] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-03. [2025-09-17T21:39:18.084206] [INFO ] [REMOTE ] SHG: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T21:39:18.088342] [INFO ] [REMOTE ] SHG: Full fetch complete (41711 records). [2025-09-17T21:39:18.088426] [DEBUG] [VALIDATOR ] SHG: Validating primary data. [2025-09-17T21:39:18.469955] [DEBUG] [VALIDATOR ] SHG: All expected trading days are present. [2025-09-17T21:39:18.470065] [DEBUG] [VALIDATOR ] SHG: Primary data validation passed. [2025-09-17T21:39:18.471243] [INFO ] [MAIN ] SHG: Fetched primary data is valid. [2025-09-17T21:39:18.471296] [DEBUG] [LOCAL ] SHG: Saving primary data. [2025-09-17T21:39:18.472510] [DEBUG] [LOCAL ] SHG: Trimmed 41711 records to 27665 (keeping 200 days of data) [2025-09-17T21:39:18.578838] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T21:39:18.656534] [DEBUG] [LOCAL ] SHG: Primary data saved (27665 records). [2025-09-17T21:39:18.656694] [INFO ] [MAIN ] SHG: Full history saved. [2025-09-17T21:39:18.656806] [INFO ] [MAIN ] Update Progress: 1909/2371 symbols completed. SHG took 34.7s. Estimated remaining: 1h 7m 35s. Rate: 6.8 symbols/min [2025-09-17T21:39:18.827944] [INFO ] [MAIN ] SHW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:39:18.825221] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-04. [2025-09-17T21:39:18.873018] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-17T21:39:18.941279] [DEBUG] [LOCAL ] SHW: Loaded 50554 existing records from primary storage. [2025-09-17T21:39:18.941431] [INFO ] [MAIN ] SHW: Loaded 50554 existing records. [2025-09-17T21:39:19.123999] [WARN ] [MAIN ] SHW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:39:19.124244] [INFO ] [MAIN ] SHW: Wiping existing primary data before full refresh. [2025-09-17T21:39:19.124293] [INFO ] [LOCAL ] SHW: Starting deletion of primary data. [2025-09-17T21:39:19.125351] [DEBUG] [LOCAL ] SHW: Deleted primary data file. [2025-09-17T21:39:19.125402] [INFO ] [MAIN ] SHW: Starting full primary refresh. [2025-09-17T21:39:19.417680] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T21:39:19.491046] [INFO ] [REMOTE ] SHW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:39:19.615806] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-11. [2025-09-17T21:39:20.415840] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-05. [2025-09-17T21:39:20.886690] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T21:39:21.215837] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-08. [2025-09-17T21:39:21.442773] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T21:39:22.015848] [INFO ] [REMOTE ] SHW: Fetching primary data for 2024-12. [2025-09-17T21:39:22.815827] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-06. [2025-09-17T21:39:23.334051] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-06 (0.52 seconds). [2025-09-17T21:39:23.338287] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-08 (2.12 seconds). [2025-09-17T21:39:23.519227] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T21:39:23.615786] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-07. [2025-09-17T21:39:24.190187] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T21:39:24.415794] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-04. [2025-09-17T21:39:25.215786] [INFO ] [REMOTE ] SHEL: Fetching primary data for 2025-09. [2025-09-17T21:39:26.015798] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-08. [2025-09-17T21:39:26.716499] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-08 (0.70 seconds). [2025-09-17T21:39:26.721624] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-04 (2.31 seconds). [2025-09-17T21:39:26.769744] [INFO ] [REMOTE ] SHEL: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T21:39:26.778340] [INFO ] [REMOTE ] SHEL: Full fetch complete (77599 records). [2025-09-17T21:39:26.778538] [DEBUG] [VALIDATOR ] SHEL: Validating primary data. [2025-09-17T21:39:26.820889] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-05. [2025-09-17T21:39:27.179004] [DEBUG] [VALIDATOR ] SHEL: All expected trading days are present. [2025-09-17T21:39:27.179109] [DEBUG] [VALIDATOR ] SHEL: Primary data validation passed. [2025-09-17T21:39:27.180246] [INFO ] [MAIN ] SHEL: Fetched primary data is valid. [2025-09-17T21:39:27.180307] [DEBUG] [LOCAL ] SHEL: Saving primary data. [2025-09-17T21:39:27.181919] [DEBUG] [LOCAL ] SHEL: Trimmed 77599 records to 53672 (keeping 200 days of data) [2025-09-17T21:39:27.523180] [DEBUG] [LOCAL ] SHEL: Primary data saved (53672 records). [2025-09-17T21:39:27.523342] [INFO ] [MAIN ] SHEL: Full history saved. [2025-09-17T21:39:27.523433] [INFO ] [MAIN ] Update Progress: 1910/2371 symbols completed. SHEL took 46.4s. Estimated remaining: 1h 7m 27s. Rate: 6.8 symbols/min [2025-09-17T21:39:27.622821] [INFO ] [REMOTE ] SHOC: Fetching primary data for 2025-09. [2025-09-17T21:39:27.697481] [INFO ] [MAIN ] SI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:39:27.697706] [DEBUG] [LOCAL ] SI: No existing data file found in primary storage. [2025-09-17T21:39:27.697748] [WARN ] [MAIN ] SI: No existing data found, performing full refresh instead. [2025-09-17T21:39:27.697878] [INFO ] [MAIN ] SI: Wiping existing primary data before full refresh. [2025-09-17T21:39:27.697916] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-17T21:39:27.697956] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-17T21:39:27.697988] [INFO ] [MAIN ] SI: Starting full primary refresh. [2025-09-17T21:39:28.052290] [INFO ] [REMOTE ] SI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:39:28.224414] [INFO ] [REMOTE ] SHOC: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T21:39:28.225500] [INFO ] [REMOTE ] SHOC: Full fetch complete (7575 records). [2025-09-17T21:39:28.225569] [DEBUG] [VALIDATOR ] SHOC: Validating primary data. [2025-09-17T21:39:28.421041] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-01. [2025-09-17T21:39:28.592037] [DEBUG] [VALIDATOR ] SHOC: All expected trading days are present. [2025-09-17T21:39:28.592180] [DEBUG] [VALIDATOR ] SHOC: Primary data validation passed. [2025-09-17T21:39:28.592505] [INFO ] [MAIN ] SHOC: Fetched primary data is valid. [2025-09-17T21:39:28.592562] [DEBUG] [LOCAL ] SHOC: Saving primary data. [2025-09-17T21:39:28.593136] [DEBUG] [LOCAL ] SHOC: Trimmed 7575 records to 4202 (keeping 200 days of data) [2025-09-17T21:39:28.647773] [DEBUG] [LOCAL ] SHOC: Primary data saved (4202 records). [2025-09-17T21:39:28.648514] [INFO ] [MAIN ] SHOC: Full history saved. [2025-09-17T21:39:28.649485] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T21:39:28.649753] [INFO ] [MAIN ] Update Progress: 1911/2371 symbols completed. SHOC took 19.5s. Estimated remaining: 1h 7m 16s. Rate: 6.8 symbols/min [2025-09-17T21:39:28.831104] [INFO ] [MAIN ] SID: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:39:28.875306] [DEBUG] [LOCAL ] SID: Loaded 42068 existing records from primary storage. [2025-09-17T21:39:28.875478] [INFO ] [MAIN ] SID: Loaded 42068 existing records. [2025-09-17T21:39:29.057157] [WARN ] [MAIN ] SID: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:39:29.057466] [INFO ] [MAIN ] SID: Wiping existing primary data before full refresh. [2025-09-17T21:39:29.057514] [INFO ] [LOCAL ] SID: Starting deletion of primary data. [2025-09-17T21:39:29.058407] [DEBUG] [LOCAL ] SID: Deleted primary data file. [2025-09-17T21:39:29.058458] [INFO ] [MAIN ] SID: Starting full primary refresh. [2025-09-17T21:39:29.221607] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-06. [2025-09-17T21:39:29.426302] [INFO ] [REMOTE ] SID: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:39:29.915876] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T21:39:30.015750] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-02. [2025-09-17T21:39:30.600718] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T21:39:30.815793] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-11. [2025-09-17T21:39:31.041029] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:39:31.041357] [WARN ] [REMOTE ] SI: No data returned for month 2024-11 [2025-09-17T21:39:31.615807] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-11. [2025-09-17T21:39:31.767198] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T21:39:32.415781] [INFO ] [REMOTE ] SI: Fetching primary data for 2024-12. [2025-09-17T21:39:32.646857] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:39:32.647206] [WARN ] [REMOTE ] SI: No data returned for month 2024-12 [2025-09-17T21:39:33.093118] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T21:39:33.215781] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-03. [2025-09-17T21:39:34.015805] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-01. [2025-09-17T21:39:34.238553] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:39:34.238940] [WARN ] [REMOTE ] SI: No data returned for month 2025-01 [2025-09-17T21:39:34.746930] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T21:39:34.815750] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-04. [2025-09-17T21:39:35.615792] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-07. [2025-09-17T21:39:36.415789] [INFO ] [REMOTE ] SID: Fetching primary data for 2024-12. [2025-09-17T21:39:36.737983] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T21:39:37.118362] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T21:39:37.215808] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-05. [2025-09-17T21:39:37.641681] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T21:39:38.015780] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-01. [2025-09-17T21:39:38.636872] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T21:39:38.815774] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-08. [2025-09-17T21:39:39.578302] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T21:39:39.615736] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-02. [2025-09-17T21:39:40.106929] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T21:39:40.415782] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-02. [2025-09-17T21:39:40.647373] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:39:40.647706] [WARN ] [REMOTE ] SI: No data returned for month 2025-02 [2025-09-17T21:39:40.749334] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T21:39:41.215791] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-03. [2025-09-17T21:39:41.438392] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:39:41.438732] [WARN ] [REMOTE ] SI: No data returned for month 2025-03 [2025-09-17T21:39:42.015791] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-04. [2025-09-17T21:39:42.228870] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:39:42.229207] [WARN ] [REMOTE ] SI: No data returned for month 2025-04 [2025-09-17T21:39:42.815795] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-03. [2025-09-17T21:39:43.615810] [INFO ] [REMOTE ] SHO: Fetching primary data for 2025-09. [2025-09-17T21:39:44.236840] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T21:39:44.415784] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-06. [2025-09-17T21:39:44.703787] [INFO ] [REMOTE ] SHO: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T21:39:44.712308] [INFO ] [REMOTE ] SHO: Full fetch complete (71051 records). [2025-09-17T21:39:44.712442] [DEBUG] [VALIDATOR ] SHO: Validating primary data. [2025-09-17T21:39:45.116082] [DEBUG] [VALIDATOR ] SHO: All expected trading days are present. [2025-09-17T21:39:45.116162] [DEBUG] [VALIDATOR ] SHO: Primary data validation passed. [2025-09-17T21:39:45.117158] [INFO ] [MAIN ] SHO: Fetched primary data is valid. [2025-09-17T21:39:45.117204] [DEBUG] [LOCAL ] SHO: Saving primary data. [2025-09-17T21:39:45.118518] [DEBUG] [LOCAL ] SHO: Trimmed 71051 records to 49859 (keeping 200 days of data) [2025-09-17T21:39:45.217181] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-05. [2025-09-17T21:39:45.435219] [DEBUG] [LOCAL ] SHO: Primary data saved (49859 records). [2025-09-17T21:39:45.435403] [INFO ] [MAIN ] SHO: Full history saved. [2025-09-17T21:39:45.437187] [INFO ] [MAIN ] Update Progress: 1912/2371 symbols completed. SHO took 44.6s. Estimated remaining: 1h 7m 9s. Rate: 6.8 symbols/min [2025-09-17T21:39:45.507222] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:39:45.536753] [WARN ] [REMOTE ] SI: No data returned for month 2025-05 [2025-09-17T21:39:45.610535] [INFO ] [MAIN ] SIG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:39:45.659202] [DEBUG] [LOCAL ] SIG: Loaded 46812 existing records from primary storage. [2025-09-17T21:39:45.659416] [INFO ] [MAIN ] SIG: Loaded 46812 existing records. [2025-09-17T21:39:45.804734] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T21:39:45.881013] [WARN ] [MAIN ] SIG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:39:45.881277] [INFO ] [MAIN ] SIG: Wiping existing primary data before full refresh. [2025-09-17T21:39:45.881326] [INFO ] [LOCAL ] SIG: Starting deletion of primary data. [2025-09-17T21:39:45.882263] [DEBUG] [LOCAL ] SIG: Deleted primary data file. [2025-09-17T21:39:45.882316] [INFO ] [MAIN ] SIG: Starting full primary refresh. [2025-09-17T21:39:46.021441] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-04. [2025-09-17T21:39:46.246229] [INFO ] [REMOTE ] SIG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:39:46.815832] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-06. [2025-09-17T21:39:47.030766] [DEBUG] [REMOTE ] SI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:39:47.031021] [WARN ] [REMOTE ] SI: No data returned for month 2025-06 [2025-09-17T21:39:47.282384] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T21:39:47.615828] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-07. [2025-09-17T21:39:48.022314] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-17T21:39:48.415780] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-11. [2025-09-17T21:39:49.215772] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-05. [2025-09-17T21:39:49.939800] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T21:39:50.015758] [INFO ] [REMOTE ] SIG: Fetching primary data for 2024-12. [2025-09-17T21:39:50.537791] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T21:39:50.815812] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-08. [2025-09-17T21:39:51.615751] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-06. [2025-09-17T21:39:51.701469] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T21:39:51.917400] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T21:39:52.415794] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-07. [2025-09-17T21:39:53.069105] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T21:39:53.215753] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-07. [2025-09-17T21:39:53.915535] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T21:39:54.015770] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-08. [2025-09-17T21:39:54.476762] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-07 (1.26 seconds). [2025-09-17T21:39:54.815776] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-01. [2025-09-17T21:39:55.473117] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T21:39:55.615785] [INFO ] [REMOTE ] SHW: Fetching primary data for 2025-09. [2025-09-17T21:39:56.025316] [INFO ] [REMOTE ] SHW: Incremental fetch complete for 2025-09 (0.41 seconds). [2025-09-17T21:39:56.032422] [INFO ] [REMOTE ] SHW: Full fetch complete (72874 records). [2025-09-17T21:39:56.032618] [DEBUG] [VALIDATOR ] SHW: Validating primary data. [2025-09-17T21:39:56.427365] [DEBUG] [VALIDATOR ] SHW: All expected trading days are present. [2025-09-17T21:39:56.423545] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-08. [2025-09-17T21:39:56.427545] [DEBUG] [VALIDATOR ] SHW: Primary data validation passed. [2025-09-17T21:39:56.428710] [INFO ] [MAIN ] SHW: Fetched primary data is valid. [2025-09-17T21:39:56.429608] [DEBUG] [LOCAL ] SHW: Saving primary data. [2025-09-17T21:39:56.431587] [DEBUG] [LOCAL ] SHW: Trimmed 72874 records to 50526 (keeping 200 days of data) [2025-09-17T21:39:56.571761] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T21:39:56.807861] [DEBUG] [LOCAL ] SHW: Primary data saved (50526 records). [2025-09-17T21:39:56.808064] [INFO ] [MAIN ] SHW: Full history saved. [2025-09-17T21:39:56.808285] [INFO ] [MAIN ] Update Progress: 1913/2371 symbols completed. SHW took 38.2s. Estimated remaining: 1h 7m 1s. Rate: 6.8 symbols/min [2025-09-17T21:39:56.980231] [INFO ] [MAIN ] SII: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:39:57.002607] [DEBUG] [LOCAL ] SII: Loaded 22885 existing records from primary storage. [2025-09-17T21:39:57.002786] [INFO ] [MAIN ] SII: Loaded 22885 existing records. [2025-09-17T21:39:57.181055] [WARN ] [MAIN ] SII: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:39:57.181352] [INFO ] [MAIN ] SII: Wiping existing primary data before full refresh. [2025-09-17T21:39:57.181423] [INFO ] [LOCAL ] SII: Starting deletion of primary data. [2025-09-17T21:39:57.182029] [DEBUG] [LOCAL ] SII: Deleted primary data file. [2025-09-17T21:39:57.182101] [INFO ] [MAIN ] SII: Starting full primary refresh. [2025-09-17T21:39:57.224598] [INFO ] [REMOTE ] SI: Fetching primary data for 2025-09. [2025-09-17T21:39:57.586451] [INFO ] [REMOTE ] SII: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:39:57.668100] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T21:39:58.016586] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-02. [2025-09-17T21:39:58.018269] [INFO ] [REMOTE ] SI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T21:39:58.021155] [INFO ] [REMOTE ] SI: Full fetch complete (5186 records). [2025-09-17T21:39:58.021243] [DEBUG] [VALIDATOR ] SI: Validating primary data. [2025-09-17T21:39:58.216274] [WARN ] [VALIDATOR ] SI: Validation failed - insufficient historical data. Have 34 unique days, need 200 days [2025-09-17T21:39:58.216510] [FATAL] [MAIN ] SI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:39:58.216560] [WARN ] [MAIN ] SI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:39:58.216604] [INFO ] [LOCAL ] SI: Starting deletion of primary data. [2025-09-17T21:39:58.216687] [DEBUG] [LOCAL ] SI: No primary data file found to delete. [2025-09-17T21:39:58.216728] [INFO ] [LOCAL ] SI: Starting deletion of derivative data. [2025-09-17T21:39:58.216779] [DEBUG] [LOCAL ] SI: No derivative data file found to delete. [2025-09-17T21:39:58.216853] [INFO ] [MAIN ] Update Progress: 1914/2371 symbols completed. SI took 30.7s. Estimated remaining: 1h 6m 50s. Rate: 6.8 symbols/min [2025-09-17T21:39:58.398747] [INFO ] [MAIN ] SILA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:39:58.442132] [DEBUG] [LOCAL ] SILA: Loaded 31315 existing records from primary storage. [2025-09-17T21:39:58.442280] [INFO ] [MAIN ] SILA: Loaded 31315 existing records. [2025-09-17T21:39:58.630604] [WARN ] [MAIN ] SILA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:39:58.630890] [INFO ] [MAIN ] SILA: Wiping existing primary data before full refresh. [2025-09-17T21:39:58.631003] [INFO ] [LOCAL ] SILA: Starting deletion of primary data. [2025-09-17T21:39:58.632050] [DEBUG] [LOCAL ] SILA: Deleted primary data file. [2025-09-17T21:39:58.632101] [INFO ] [MAIN ] SILA: Starting full primary refresh. [2025-09-17T21:39:58.817755] [INFO ] [REMOTE ] SID: Fetching primary data for 2025-09. [2025-09-17T21:39:59.016409] [INFO ] [REMOTE ] SILA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:39:59.615828] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-11. [2025-09-17T21:39:59.947114] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-02 (1.93 seconds). [2025-09-17T21:39:59.978074] [INFO ] [REMOTE ] SID: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T21:39:59.984493] [INFO ] [REMOTE ] SID: Full fetch complete (60809 records). [2025-09-17T21:39:59.984662] [DEBUG] [VALIDATOR ] SID: Validating primary data. [2025-09-17T21:40:00.418778] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-11. [2025-09-17T21:40:00.467742] [DEBUG] [VALIDATOR ] SID: All expected trading days are present. [2025-09-17T21:40:00.467860] [DEBUG] [VALIDATOR ] SID: Primary data validation passed. [2025-09-17T21:40:00.469400] [INFO ] [MAIN ] SID: Fetched primary data is valid. [2025-09-17T21:40:00.469525] [DEBUG] [LOCAL ] SID: Saving primary data. [2025-09-17T21:40:00.472061] [DEBUG] [LOCAL ] SID: Trimmed 60809 records to 42163 (keeping 200 days of data) [2025-09-17T21:40:00.810527] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T21:40:00.862207] [DEBUG] [LOCAL ] SID: Primary data saved (42163 records). [2025-09-17T21:40:00.862413] [INFO ] [MAIN ] SID: Full history saved. [2025-09-17T21:40:00.862540] [INFO ] [MAIN ] Update Progress: 1915/2371 symbols completed. SID took 32.2s. Estimated remaining: 1h 6m 40s. Rate: 6.8 symbols/min [2025-09-17T21:40:01.113621] [INFO ] [MAIN ] SITC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:40:01.163314] [DEBUG] [LOCAL ] SITC: Loaded 41687 existing records from primary storage. [2025-09-17T21:40:01.163493] [INFO ] [MAIN ] SITC: Loaded 41687 existing records. [2025-09-17T21:40:01.221247] [INFO ] [REMOTE ] SILA: Fetching primary data for 2024-12. [2025-09-17T21:40:01.393198] [WARN ] [MAIN ] SITC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:40:01.393509] [INFO ] [MAIN ] SITC: Wiping existing primary data before full refresh. [2025-09-17T21:40:01.393579] [INFO ] [LOCAL ] SITC: Starting deletion of primary data. [2025-09-17T21:40:01.394703] [DEBUG] [LOCAL ] SITC: Deleted primary data file. [2025-09-17T21:40:01.394777] [INFO ] [MAIN ] SITC: Starting full primary refresh. [2025-09-17T21:40:01.785965] [INFO ] [REMOTE ] SITC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:40:01.798283] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T21:40:02.015815] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-11. [2025-09-17T21:40:02.672071] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T21:40:02.815819] [INFO ] [REMOTE ] SII: Fetching primary data for 2024-12. [2025-09-17T21:40:03.480983] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T21:40:03.615781] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-03. [2025-09-17T21:40:03.828517] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T21:40:04.415831] [INFO ] [REMOTE ] SITC: Fetching primary data for 2024-12. [2025-09-17T21:40:05.215828] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-01. [2025-09-17T21:40:05.489550] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T21:40:05.562153] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T21:40:06.015793] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-04. [2025-09-17T21:40:06.450898] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T21:40:06.815798] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-02. [2025-09-17T21:40:07.623754] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-01. [2025-09-17T21:40:07.653739] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T21:40:07.992182] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T21:40:08.415815] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-03. [2025-09-17T21:40:08.499521] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T21:40:09.215838] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-05. [2025-09-17T21:40:09.535046] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T21:40:10.015781] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-01. [2025-09-17T21:40:10.821719] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-02. [2025-09-17T21:40:10.834109] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T21:40:11.267622] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T21:40:11.615816] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-02. [2025-09-17T21:40:11.934110] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T21:40:12.415813] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-03. [2025-09-17T21:40:12.826075] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T21:40:13.181006] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T21:40:13.215730] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-04. [2025-09-17T21:40:14.015785] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-06. [2025-09-17T21:40:14.235774] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T21:40:14.815831] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-04. [2025-09-17T21:40:15.615811] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-03. [2025-09-17T21:40:15.650165] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T21:40:15.848738] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T21:40:16.415822] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-05. [2025-09-17T21:40:17.220830] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-05. [2025-09-17T21:40:17.229546] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T21:40:17.316437] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T21:40:18.015796] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-06. [2025-09-17T21:40:18.544418] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T21:40:18.815834] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-06. [2025-09-17T21:40:19.041687] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T21:40:19.615830] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-07. [2025-09-17T21:40:20.196837] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T21:40:20.415787] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-04. [2025-09-17T21:40:20.702799] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T21:40:21.215784] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-07. [2025-09-17T21:40:22.015786] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-07. [2025-09-17T21:40:22.083240] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T21:40:22.815782] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-05. [2025-09-17T21:40:23.014330] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T21:40:23.055776] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T21:40:23.615836] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-08. [2025-09-17T21:40:24.181412] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T21:40:24.415868] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-08. [2025-09-17T21:40:25.215747] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-06. [2025-09-17T21:40:25.311780] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T21:40:25.543684] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T21:40:26.015793] [INFO ] [REMOTE ] SII: Fetching primary data for 2025-09. [2025-09-17T21:40:26.382236] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T21:40:26.815834] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-08. [2025-09-17T21:40:27.005346] [INFO ] [REMOTE ] SII: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T21:40:27.010019] [INFO ] [REMOTE ] SII: Full fetch complete (29324 records). [2025-09-17T21:40:27.010129] [DEBUG] [VALIDATOR ] SII: Validating primary data. [2025-09-17T21:40:27.420543] [DEBUG] [VALIDATOR ] SII: All expected trading days are present. [2025-09-17T21:40:27.420768] [DEBUG] [VALIDATOR ] SII: Primary data validation passed. [2025-09-17T21:40:27.421448] [INFO ] [MAIN ] SII: Fetched primary data is valid. [2025-09-17T21:40:27.421492] [DEBUG] [LOCAL ] SII: Saving primary data. [2025-09-17T21:40:27.422385] [DEBUG] [LOCAL ] SII: Trimmed 29324 records to 22961 (keeping 200 days of data) [2025-09-17T21:40:27.573820] [DEBUG] [LOCAL ] SII: Primary data saved (22961 records). [2025-09-17T21:40:27.574115] [INFO ] [MAIN ] SII: Full history saved. [2025-09-17T21:40:27.574225] [INFO ] [MAIN ] Update Progress: 1916/2371 symbols completed. SII took 30.8s. Estimated remaining: 1h 6m 36s. Rate: 6.8 symbols/min [2025-09-17T21:40:27.621762] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-07. [2025-09-17T21:40:27.760479] [INFO ] [MAIN ] SITE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:40:27.799465] [DEBUG] [LOCAL ] SITE: Loaded 35336 existing records from primary storage. [2025-09-17T21:40:27.799675] [INFO ] [MAIN ] SITE: Loaded 35336 existing records. [2025-09-17T21:40:27.996051] [WARN ] [MAIN ] SITE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:40:27.996437] [INFO ] [MAIN ] SITE: Wiping existing primary data before full refresh. [2025-09-17T21:40:27.996606] [INFO ] [LOCAL ] SITE: Starting deletion of primary data. [2025-09-17T21:40:28.002555] [DEBUG] [LOCAL ] SITE: Deleted primary data file. [2025-09-17T21:40:28.012193] [INFO ] [MAIN ] SITE: Starting full primary refresh. [2025-09-17T21:40:28.018553] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T21:40:28.389703] [INFO ] [REMOTE ] SITE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:40:28.415747] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-11. [2025-09-17T21:40:28.833563] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T21:40:29.215803] [INFO ] [REMOTE ] SIG: Fetching primary data for 2025-09. [2025-09-17T21:40:29.439846] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T21:40:30.015796] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-08. [2025-09-17T21:40:30.796197] [INFO ] [REMOTE ] SIG: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T21:40:30.802391] [INFO ] [REMOTE ] SIG: Full fetch complete (68270 records). [2025-09-17T21:40:30.802522] [DEBUG] [VALIDATOR ] SIG: Validating primary data. [2025-09-17T21:40:30.823873] [INFO ] [REMOTE ] SILA: Fetching primary data for 2025-09. [2025-09-17T21:40:31.211889] [DEBUG] [VALIDATOR ] SIG: All expected trading days are present. [2025-09-17T21:40:31.212062] [DEBUG] [VALIDATOR ] SIG: Primary data validation passed. [2025-09-17T21:40:31.213263] [INFO ] [MAIN ] SIG: Fetched primary data is valid. [2025-09-17T21:40:31.213354] [DEBUG] [LOCAL ] SIG: Saving primary data. [2025-09-17T21:40:31.215169] [DEBUG] [LOCAL ] SIG: Trimmed 68270 records to 46750 (keeping 200 days of data) [2025-09-17T21:40:31.335021] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T21:40:31.550753] [DEBUG] [LOCAL ] SIG: Primary data saved (46750 records). [2025-09-17T21:40:31.550896] [INFO ] [MAIN ] SIG: Full history saved. [2025-09-17T21:40:31.551720] [INFO ] [MAIN ] Update Progress: 1917/2371 symbols completed. SIG took 46.1s. Estimated remaining: 1h 6m 26s. Rate: 6.8 symbols/min [2025-09-17T21:40:31.615780] [INFO ] [REMOTE ] SITC: Fetching primary data for 2025-09. [2025-09-17T21:40:32.030295] [INFO ] [REMOTE ] SILA: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T21:40:32.034037] [INFO ] [REMOTE ] SILA: Full fetch complete (45318 records). [2025-09-17T21:40:32.034182] [DEBUG] [VALIDATOR ] SILA: Validating primary data. [2025-09-17T21:40:32.415204] [DEBUG] [VALIDATOR ] SILA: All expected trading days are present. [2025-09-17T21:40:32.415289] [DEBUG] [VALIDATOR ] SILA: Primary data validation passed. [2025-09-17T21:40:32.416033] [INFO ] [MAIN ] SILA: Fetched primary data is valid. [2025-09-17T21:40:32.416142] [DEBUG] [LOCAL ] SILA: Saving primary data. [2025-09-17T21:40:32.416092] [INFO ] [REMOTE ] SITE: Fetching primary data for 2024-12. [2025-09-17T21:40:32.417988] [DEBUG] [LOCAL ] SILA: Trimmed 45318 records to 31283 (keeping 200 days of data) [2025-09-17T21:40:32.621448] [DEBUG] [LOCAL ] SILA: Primary data saved (31283 records). [2025-09-17T21:40:32.621605] [INFO ] [MAIN ] SILA: Full history saved. [2025-09-17T21:40:32.621719] [INFO ] [MAIN ] Update Progress: 1918/2371 symbols completed. SILA took 34.4s. Estimated remaining: 1h 6m 15s. Rate: 6.8 symbols/min [2025-09-17T21:40:33.105808] [INFO ] [REMOTE ] SITC: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T21:40:33.112102] [INFO ] [REMOTE ] SITC: Full fetch complete (60672 records). [2025-09-17T21:40:33.112278] [DEBUG] [VALIDATOR ] SITC: Validating primary data. [2025-09-17T21:40:33.499596] [DEBUG] [VALIDATOR ] SITC: All expected trading days are present. [2025-09-17T21:40:33.499701] [DEBUG] [VALIDATOR ] SITC: Primary data validation passed. [2025-09-17T21:40:33.500834] [INFO ] [MAIN ] SITC: Fetched primary data is valid. [2025-09-17T21:40:33.500880] [DEBUG] [LOCAL ] SITC: Saving primary data. [2025-09-17T21:40:33.502175] [DEBUG] [LOCAL ] SITC: Trimmed 60672 records to 41624 (keeping 200 days of data) [2025-09-17T21:40:33.737516] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T21:40:33.745092] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-01. [2025-09-17T21:40:33.777724] [DEBUG] [LOCAL ] SITC: Primary data saved (41624 records). [2025-09-17T21:40:33.777861] [INFO ] [MAIN ] SITC: Full history saved. [2025-09-17T21:40:33.777948] [INFO ] [MAIN ] Update Progress: 1919/2371 symbols completed. SITC took 32.9s. Estimated remaining: 1h 6m 5s. Rate: 6.8 symbols/min [2025-09-17T21:40:35.148266] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-01 (1.40 seconds). [2025-09-17T21:40:35.154600] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-02. [2025-09-17T21:40:36.601324] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T21:40:36.608726] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-03. [2025-09-17T21:40:38.135423] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T21:40:38.143471] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-04. [2025-09-17T21:40:39.510594] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T21:40:39.521290] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-05. [2025-09-17T21:40:40.524029] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T21:40:40.531903] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-06. [2025-09-17T21:40:41.850803] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T21:40:41.858007] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-07. [2025-09-17T21:40:43.466620] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T21:40:43.476552] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-08. [2025-09-17T21:40:44.916787] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T21:40:44.924964] [INFO ] [REMOTE ] SITE: Fetching primary data for 2025-09. [2025-09-17T21:40:46.306662] [INFO ] [REMOTE ] SITE: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T21:40:46.311832] [INFO ] [REMOTE ] SITE: Full fetch complete (49024 records). [2025-09-17T21:40:46.311940] [DEBUG] [VALIDATOR ] SITE: Validating primary data. [2025-09-17T21:40:46.694564] [DEBUG] [VALIDATOR ] SITE: All expected trading days are present. [2025-09-17T21:40:46.694664] [DEBUG] [VALIDATOR ] SITE: Primary data validation passed. [2025-09-17T21:40:46.695467] [INFO ] [MAIN ] SITE: Fetched primary data is valid. [2025-09-17T21:40:46.695509] [DEBUG] [LOCAL ] SITE: Saving primary data. [2025-09-17T21:40:46.696669] [DEBUG] [LOCAL ] SITE: Trimmed 49024 records to 35327 (keeping 200 days of data) [2025-09-17T21:40:46.917286] [DEBUG] [LOCAL ] SITE: Primary data saved (35327 records). [2025-09-17T21:40:46.917448] [INFO ] [MAIN ] SITE: Full history saved. [2025-09-17T21:40:46.917564] [INFO ] [MAIN ] Update Progress: 1920/2371 symbols completed. SITE took 19.3s. Estimated remaining: 1h 5m 57s. Rate: 6.8 symbols/min [2025-09-17T21:40:47.469410] [INFO ] [MAIN ] SKIL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:40:47.573716] [INFO ] [MAIN ] SJM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:40:47.580532] [INFO ] [MAIN ] SKE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:40:47.658188] [INFO ] [MAIN ] SJT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:40:47.662971] [DEBUG] [LOCAL ] SKIL: Loaded 6295 existing records from primary storage. [2025-09-17T21:40:47.663659] [INFO ] [MAIN ] SKIL: Loaded 6295 existing records. [2025-09-17T21:40:47.843291] [DEBUG] [LOCAL ] SJT: Loaded 22075 existing records from primary storage. [2025-09-17T21:40:47.899881] [INFO ] [MAIN ] SJT: Loaded 22075 existing records. [2025-09-17T21:40:47.899762] [WARN ] [MAIN ] SKIL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:40:47.893232] [DEBUG] [LOCAL ] SKE: Loaded 35179 existing records from primary storage. [2025-09-17T21:40:47.946815] [INFO ] [MAIN ] SKE: Loaded 35179 existing records. [2025-09-17T21:40:47.935043] [INFO ] [MAIN ] SKIL: Wiping existing primary data before full refresh. [2025-09-17T21:40:47.962998] [INFO ] [LOCAL ] SKIL: Starting deletion of primary data. [2025-09-17T21:40:48.042700] [DEBUG] [LOCAL ] SKIL: Deleted primary data file. [2025-09-17T21:40:48.098796] [INFO ] [MAIN ] SKIL: Starting full primary refresh. [2025-09-17T21:40:48.073940] [DEBUG] [LOCAL ] SJM: Loaded 50109 existing records from primary storage. [2025-09-17T21:40:48.164204] [INFO ] [MAIN ] SJM: Loaded 50109 existing records. [2025-09-17T21:40:48.322323] [WARN ] [MAIN ] SJT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:40:48.424450] [INFO ] [MAIN ] SJT: Wiping existing primary data before full refresh. [2025-09-17T21:40:48.432719] [INFO ] [LOCAL ] SJT: Starting deletion of primary data. [2025-09-17T21:40:48.455836] [DEBUG] [LOCAL ] SJT: Deleted primary data file. [2025-09-17T21:40:48.477235] [INFO ] [MAIN ] SJT: Starting full primary refresh. [2025-09-17T21:40:48.490555] [WARN ] [MAIN ] SKE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:40:48.687948] [INFO ] [MAIN ] SKE: Wiping existing primary data before full refresh. [2025-09-17T21:40:48.768718] [WARN ] [MAIN ] SJM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:40:48.768587] [INFO ] [LOCAL ] SKE: Starting deletion of primary data. [2025-09-17T21:40:48.816364] [INFO ] [MAIN ] SJM: Wiping existing primary data before full refresh. [2025-09-17T21:40:48.821832] [INFO ] [LOCAL ] SJM: Starting deletion of primary data. [2025-09-17T21:40:48.816267] [DEBUG] [LOCAL ] SKE: Deleted primary data file. [2025-09-17T21:40:48.862902] [INFO ] [MAIN ] SKE: Starting full primary refresh. [2025-09-17T21:40:48.857735] [DEBUG] [LOCAL ] SJM: Deleted primary data file. [2025-09-17T21:40:48.956917] [INFO ] [MAIN ] SJM: Starting full primary refresh. [2025-09-17T21:40:49.216987] [INFO ] [REMOTE ] SKIL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:40:49.300307] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-11. [2025-09-17T21:40:49.528579] [INFO ] [REMOTE ] SJT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:40:49.589790] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-11. [2025-09-17T21:40:49.932305] [INFO ] [REMOTE ] SKE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:40:49.950402] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-11. [2025-09-17T21:40:49.953995] [INFO ] [REMOTE ] SJM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:40:49.955038] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-11. [2025-09-17T21:40:50.164043] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T21:40:50.165438] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2024-12. [2025-09-17T21:40:50.680594] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2024-12 (0.52 seconds). [2025-09-17T21:40:50.683191] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-01. [2025-09-17T21:40:50.844906] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T21:40:50.849379] [INFO ] [REMOTE ] SJT: Fetching primary data for 2024-12. [2025-09-17T21:40:50.887863] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T21:40:50.895456] [INFO ] [REMOTE ] SKE: Fetching primary data for 2024-12. [2025-09-17T21:40:51.424140] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T21:40:51.427709] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-02. [2025-09-17T21:40:51.626025] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T21:40:51.632377] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-01. [2025-09-17T21:40:51.667747] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T21:40:51.677309] [INFO ] [REMOTE ] SJM: Fetching primary data for 2024-12. [2025-09-17T21:40:51.920393] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T21:40:51.927245] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-01. [2025-09-17T21:40:52.160659] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T21:40:52.162746] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-03. [2025-09-17T21:40:52.736473] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T21:40:52.743139] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-02. [2025-09-17T21:40:52.796381] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T21:40:52.799464] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-04. [2025-09-17T21:40:53.352620] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T21:40:53.354546] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-05. [2025-09-17T21:40:53.464962] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T21:40:53.470079] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-03. [2025-09-17T21:40:53.545170] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T21:40:53.723998] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T21:40:53.775588] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T21:40:54.015776] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-01. [2025-09-17T21:40:54.627594] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T21:40:54.815786] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-04. [2025-09-17T21:40:55.271877] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T21:40:55.601179] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T21:40:55.615672] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-05. [2025-09-17T21:40:56.415794] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-06. [2025-09-17T21:40:56.958367] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T21:40:57.215788] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-02. [2025-09-17T21:40:57.313625] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T21:40:58.015782] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-06. [2025-09-17T21:40:58.742436] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T21:40:58.815775] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-07. [2025-09-17T21:40:59.259884] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-17T21:40:59.548253] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T21:40:59.615817] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-03. [2025-09-17T21:41:00.415818] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-07. [2025-09-17T21:41:01.030321] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T21:41:01.215816] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-02. [2025-09-17T21:41:01.226827] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T21:41:02.015781] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-08. [2025-09-17T21:41:02.488255] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T21:41:02.815795] [INFO ] [REMOTE ] SKIL: Fetching primary data for 2025-09. [2025-09-17T21:41:02.910213] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T21:41:03.292337] [INFO ] [REMOTE ] SKIL: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T21:41:03.294738] [INFO ] [REMOTE ] SKIL: Full fetch complete (9936 records). [2025-09-17T21:41:03.294822] [DEBUG] [VALIDATOR ] SKIL: Validating primary data. [2025-09-17T21:41:03.621844] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-03. [2025-09-17T21:41:03.663176] [DEBUG] [VALIDATOR ] SKIL: All expected trading days are present. [2025-09-17T21:41:03.663257] [DEBUG] [VALIDATOR ] SKIL: Primary data validation passed. [2025-09-17T21:41:03.663528] [INFO ] [MAIN ] SKIL: Fetched primary data is valid. [2025-09-17T21:41:03.663567] [DEBUG] [LOCAL ] SKIL: Saving primary data. [2025-09-17T21:41:03.664500] [DEBUG] [LOCAL ] SKIL: Trimmed 9936 records to 6376 (keeping 200 days of data) [2025-09-17T21:41:03.702747] [DEBUG] [LOCAL ] SKIL: Primary data saved (6376 records). [2025-09-17T21:41:03.702892] [INFO ] [MAIN ] SKIL: Full history saved. [2025-09-17T21:41:03.702990] [INFO ] [MAIN ] Update Progress: 1921/2371 symbols completed. SKIL took 16.8s. Estimated remaining: 1h 5m 50s. Rate: 6.8 symbols/min [2025-09-17T21:41:03.875336] [INFO ] [MAIN ] SKLZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:41:03.887748] [DEBUG] [LOCAL ] SKLZ: Loaded 12028 existing records from primary storage. [2025-09-17T21:41:03.887883] [INFO ] [MAIN ] SKLZ: Loaded 12028 existing records. [2025-09-17T21:41:04.064324] [WARN ] [MAIN ] SKLZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:41:04.064563] [INFO ] [MAIN ] SKLZ: Wiping existing primary data before full refresh. [2025-09-17T21:41:04.064611] [INFO ] [LOCAL ] SKLZ: Starting deletion of primary data. [2025-09-17T21:41:04.065001] [DEBUG] [LOCAL ] SKLZ: Deleted primary data file. [2025-09-17T21:41:04.065053] [INFO ] [MAIN ] SKLZ: Starting full primary refresh. [2025-09-17T21:41:04.417818] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-08. [2025-09-17T21:41:04.421314] [INFO ] [REMOTE ] SKLZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:41:05.215826] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-04. [2025-09-17T21:41:05.431768] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T21:41:06.015801] [INFO ] [REMOTE ] SJT: Fetching primary data for 2025-09. [2025-09-17T21:41:06.310337] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-03 (2.69 seconds). [2025-09-17T21:41:06.791752] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T21:41:06.808506] [INFO ] [REMOTE ] SJT: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T21:41:06.811607] [INFO ] [REMOTE ] SJT: Full fetch complete (32331 records). [2025-09-17T21:41:06.811709] [DEBUG] [VALIDATOR ] SJT: Validating primary data. [2025-09-17T21:41:06.823212] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-11. [2025-09-17T21:41:07.198196] [DEBUG] [VALIDATOR ] SJT: All expected trading days are present. [2025-09-17T21:41:07.198287] [DEBUG] [VALIDATOR ] SJT: Primary data validation passed. [2025-09-17T21:41:07.198972] [INFO ] [MAIN ] SJT: Fetched primary data is valid. [2025-09-17T21:41:07.199015] [DEBUG] [LOCAL ] SJT: Saving primary data. [2025-09-17T21:41:07.199826] [DEBUG] [LOCAL ] SJT: Trimmed 32331 records to 22207 (keeping 200 days of data) [2025-09-17T21:41:07.325351] [DEBUG] [LOCAL ] SJT: Primary data saved (22207 records). [2025-09-17T21:41:07.325488] [INFO ] [MAIN ] SJT: Full history saved. [2025-09-17T21:41:07.325583] [INFO ] [MAIN ] Update Progress: 1922/2371 symbols completed. SJT took 20.4s. Estimated remaining: 1h 5m 40s. Rate: 6.8 symbols/min [2025-09-17T21:41:07.494447] [INFO ] [MAIN ] SKM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:41:07.532685] [DEBUG] [LOCAL ] SKM: Loaded 35464 existing records from primary storage. [2025-09-17T21:41:07.532836] [INFO ] [MAIN ] SKM: Loaded 35464 existing records. [2025-09-17T21:41:07.621032] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-04. [2025-09-17T21:41:07.711909] [WARN ] [MAIN ] SKM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:41:07.712144] [INFO ] [MAIN ] SKM: Wiping existing primary data before full refresh. [2025-09-17T21:41:07.712224] [INFO ] [LOCAL ] SKM: Starting deletion of primary data. [2025-09-17T21:41:07.712982] [DEBUG] [LOCAL ] SKM: Deleted primary data file. [2025-09-17T21:41:07.713039] [INFO ] [MAIN ] SKM: Starting full primary refresh. [2025-09-17T21:41:08.075545] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T21:41:08.088908] [INFO ] [REMOTE ] SKM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:41:08.415823] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-05. [2025-09-17T21:41:09.085829] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T21:41:09.215781] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-05. [2025-09-17T21:41:09.614230] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T21:41:10.015772] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-06. [2025-09-17T21:41:10.553967] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T21:41:10.815773] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-06. [2025-09-17T21:41:11.007406] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T21:41:11.615811] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2024-12. [2025-09-17T21:41:12.415854] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-11. [2025-09-17T21:41:12.829072] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T21:41:13.215781] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-01. [2025-09-17T21:41:13.267043] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T21:41:13.412361] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-06 (2.60 seconds). [2025-09-17T21:41:13.983147] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T21:41:14.015760] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-07. [2025-09-17T21:41:14.815789] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-07. [2025-09-17T21:41:15.618413] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-02. [2025-09-17T21:41:15.623954] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T21:41:16.210620] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T21:41:16.415819] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-08. [2025-09-17T21:41:16.497806] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T21:41:17.220893] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-03. [2025-09-17T21:41:17.244007] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T21:41:18.015811] [INFO ] [REMOTE ] SKM: Fetching primary data for 2024-12. [2025-09-17T21:41:18.136484] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-03 (0.92 seconds). [2025-09-17T21:41:18.815764] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-04. [2025-09-17T21:41:19.374761] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T21:41:19.578799] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T21:41:19.615786] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-01. [2025-09-17T21:41:20.415900] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-05. [2025-09-17T21:41:20.917224] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T21:41:20.962127] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T21:41:21.215812] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-08. [2025-09-17T21:41:22.015802] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-06. [2025-09-17T21:41:22.268875] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T21:41:22.488456] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T21:41:22.815799] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-07. [2025-09-17T21:41:23.615790] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-02. [2025-09-17T21:41:23.869485] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T21:41:24.415801] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-08. [2025-09-17T21:41:24.473179] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T21:41:25.215803] [INFO ] [REMOTE ] SJM: Fetching primary data for 2025-09. [2025-09-17T21:41:25.494150] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T21:41:26.015827] [INFO ] [REMOTE ] SKE: Fetching primary data for 2025-09. [2025-09-17T21:41:26.552023] [INFO ] [REMOTE ] SJM: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T21:41:26.560947] [INFO ] [REMOTE ] SJM: Full fetch complete (71825 records). [2025-09-17T21:41:26.561103] [DEBUG] [VALIDATOR ] SJM: Validating primary data. [2025-09-17T21:41:26.821611] [INFO ] [REMOTE ] SKLZ: Fetching primary data for 2025-09. [2025-09-17T21:41:26.953783] [DEBUG] [VALIDATOR ] SJM: All expected trading days are present. [2025-09-17T21:41:26.953894] [DEBUG] [VALIDATOR ] SJM: Primary data validation passed. [2025-09-17T21:41:26.954978] [INFO ] [MAIN ] SJM: Fetched primary data is valid. [2025-09-17T21:41:26.955034] [DEBUG] [LOCAL ] SJM: Saving primary data. [2025-09-17T21:41:26.957892] [DEBUG] [LOCAL ] SJM: Trimmed 71825 records to 50122 (keeping 200 days of data) [2025-09-17T21:41:27.284099] [DEBUG] [LOCAL ] SJM: Primary data saved (50122 records). [2025-09-17T21:41:27.284236] [INFO ] [MAIN ] SJM: Full history saved. [2025-09-17T21:41:27.284336] [INFO ] [MAIN ] Update Progress: 1923/2371 symbols completed. SJM took 40.4s. Estimated remaining: 1h 5m 34s. Rate: 6.8 symbols/min [2025-09-17T21:41:27.459217] [INFO ] [MAIN ] SKT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:41:27.465054] [INFO ] [REMOTE ] SKLZ: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T21:41:27.473366] [INFO ] [REMOTE ] SKLZ: Full fetch complete (19163 records). [2025-09-17T21:41:27.481704] [DEBUG] [VALIDATOR ] SKLZ: Validating primary data. [2025-09-17T21:41:27.504289] [INFO ] [REMOTE ] SKE: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T21:41:27.558137] [INFO ] [REMOTE ] SKE: Full fetch complete (49699 records). [2025-09-17T21:41:27.575428] [DEBUG] [VALIDATOR ] SKE: Validating primary data. [2025-09-17T21:41:27.623458] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-03. [2025-09-17T21:41:27.857700] [DEBUG] [LOCAL ] SKT: Loaded 42515 existing records from primary storage. [2025-09-17T21:41:27.960035] [INFO ] [MAIN ] SKT: Loaded 42515 existing records. [2025-09-17T21:41:28.279383] [DEBUG] [VALIDATOR ] SKLZ: All expected trading days are present. [2025-09-17T21:41:28.304296] [DEBUG] [VALIDATOR ] SKLZ: Primary data validation passed. [2025-09-17T21:41:28.308103] [INFO ] [MAIN ] SKLZ: Fetched primary data is valid. [2025-09-17T21:41:28.308199] [DEBUG] [LOCAL ] SKLZ: Saving primary data. [2025-09-17T21:41:28.392885] [DEBUG] [LOCAL ] SKLZ: Trimmed 19163 records to 12034 (keeping 200 days of data) [2025-09-17T21:41:28.511316] [WARN ] [MAIN ] SKT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:41:28.511771] [DEBUG] [VALIDATOR ] SKE: All expected trading days are present. [2025-09-17T21:41:28.534402] [INFO ] [MAIN ] SKT: Wiping existing primary data before full refresh. [2025-09-17T21:41:28.534515] [DEBUG] [VALIDATOR ] SKE: Primary data validation passed. [2025-09-17T21:41:28.535341] [INFO ] [MAIN ] SKE: Fetched primary data is valid. [2025-09-17T21:41:28.536737] [INFO ] [LOCAL ] SKT: Starting deletion of primary data. [2025-09-17T21:41:28.537052] [DEBUG] [LOCAL ] SKE: Saving primary data. [2025-09-17T21:41:28.539418] [DEBUG] [LOCAL ] SKT: Deleted primary data file. [2025-09-17T21:41:28.539605] [INFO ] [MAIN ] SKT: Starting full primary refresh. [2025-09-17T21:41:28.552410] [DEBUG] [LOCAL ] SKE: Trimmed 49699 records to 35274 (keeping 200 days of data) [2025-09-17T21:41:28.957045] [DEBUG] [LOCAL ] SKLZ: Primary data saved (12034 records). [2025-09-17T21:41:28.969039] [INFO ] [MAIN ] SKLZ: Full history saved. [2025-09-17T21:41:28.975137] [INFO ] [MAIN ] Update Progress: 1924/2371 symbols completed. SKLZ took 25.3s. Estimated remaining: 1h 5m 23s. Rate: 6.8 symbols/min [2025-09-17T21:41:29.066002] [INFO ] [REMOTE ] SKT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:41:29.083162] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-11. [2025-09-17T21:41:29.291878] [INFO ] [MAIN ] SKY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:41:29.341067] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T21:41:29.351854] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-04. [2025-09-17T21:41:29.387070] [DEBUG] [LOCAL ] SKY: Loaded 37601 existing records from primary storage. [2025-09-17T21:41:29.388130] [INFO ] [MAIN ] SKY: Loaded 37601 existing records. [2025-09-17T21:41:29.511700] [DEBUG] [LOCAL ] SKE: Primary data saved (35274 records). [2025-09-17T21:41:29.522131] [INFO ] [MAIN ] SKE: Full history saved. [2025-09-17T21:41:29.536308] [INFO ] [MAIN ] Update Progress: 1925/2371 symbols completed. SKE took 42.6s. Estimated remaining: 1h 5m 13s. Rate: 6.8 symbols/min [2025-09-17T21:41:29.648631] [WARN ] [MAIN ] SKY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:41:29.680711] [INFO ] [MAIN ] SKY: Wiping existing primary data before full refresh. [2025-09-17T21:41:29.680809] [INFO ] [LOCAL ] SKY: Starting deletion of primary data. [2025-09-17T21:41:29.686912] [DEBUG] [LOCAL ] SKY: Deleted primary data file. [2025-09-17T21:41:29.697181] [INFO ] [MAIN ] SKY: Starting full primary refresh. [2025-09-17T21:41:29.854627] [INFO ] [MAIN ] SKYH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:41:30.043319] [DEBUG] [LOCAL ] SKYH: Loaded 16523 existing records from primary storage. [2025-09-17T21:41:30.059019] [INFO ] [MAIN ] SKYH: Loaded 16523 existing records. [2025-09-17T21:41:30.229281] [INFO ] [REMOTE ] SKY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:41:30.240438] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-11. [2025-09-17T21:41:30.309953] [WARN ] [MAIN ] SKYH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:41:30.310286] [INFO ] [MAIN ] SKYH: Wiping existing primary data before full refresh. [2025-09-17T21:41:30.310403] [INFO ] [LOCAL ] SKYH: Starting deletion of primary data. [2025-09-17T21:41:30.310858] [DEBUG] [LOCAL ] SKYH: Deleted primary data file. [2025-09-17T21:41:30.310925] [INFO ] [MAIN ] SKYH: Starting full primary refresh. [2025-09-17T21:41:30.677214] [INFO ] [REMOTE ] SKYH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:41:30.701294] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T21:41:30.815804] [INFO ] [REMOTE ] SKT: Fetching primary data for 2024-12. [2025-09-17T21:41:30.945420] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-04 (1.59 seconds). [2025-09-17T21:41:31.412754] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T21:41:31.615792] [INFO ] [REMOTE ] SKY: Fetching primary data for 2024-12. [2025-09-17T21:41:31.822201] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T21:41:32.415800] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-05. [2025-09-17T21:41:32.760508] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2024-12 (1.14 seconds). [2025-09-17T21:41:33.215778] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-01. [2025-09-17T21:41:33.482510] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T21:41:34.015790] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-01. [2025-09-17T21:41:34.589981] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T21:41:34.815809] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-02. [2025-09-17T21:41:35.027412] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T21:41:35.615776] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-02. [2025-09-17T21:41:35.818465] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T21:41:36.415782] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-03. [2025-09-17T21:41:37.096623] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T21:41:37.215734] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-03. [2025-09-17T21:41:37.433279] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T21:41:38.015795] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-06. [2025-09-17T21:41:38.815801] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-04. [2025-09-17T21:41:39.222709] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T21:41:39.254187] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-03 (2.04 seconds). [2025-09-17T21:41:39.615789] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-07. [2025-09-17T21:41:39.856778] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-04 (1.04 seconds). [2025-09-17T21:41:40.415767] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-05. [2025-09-17T21:41:40.753056] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T21:41:41.215775] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-11. [2025-09-17T21:41:41.821985] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T21:41:41.840366] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-11 (0.62 seconds). [2025-09-17T21:41:42.015750] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-06. [2025-09-17T21:41:42.815779] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-04. [2025-09-17T21:41:43.287143] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T21:41:43.615765] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-07. [2025-09-17T21:41:44.415796] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-08. [2025-09-17T21:41:44.482341] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T21:41:44.576335] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T21:41:45.215779] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-05. [2025-09-17T21:41:45.310738] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T21:41:46.015801] [INFO ] [REMOTE ] SKM: Fetching primary data for 2025-09. [2025-09-17T21:41:46.371866] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T21:41:46.815832] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2024-12. [2025-09-17T21:41:47.239993] [INFO ] [REMOTE ] SKM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T21:41:47.244816] [INFO ] [REMOTE ] SKM: Full fetch complete (47957 records). [2025-09-17T21:41:47.244910] [DEBUG] [VALIDATOR ] SKM: Validating primary data. [2025-09-17T21:41:47.620746] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-06. [2025-09-17T21:41:47.637098] [DEBUG] [VALIDATOR ] SKM: All expected trading days are present. [2025-09-17T21:41:47.637167] [DEBUG] [VALIDATOR ] SKM: Primary data validation passed. [2025-09-17T21:41:47.638120] [INFO ] [MAIN ] SKM: Fetched primary data is valid. [2025-09-17T21:41:47.638318] [DEBUG] [LOCAL ] SKM: Saving primary data. [2025-09-17T21:41:47.639440] [DEBUG] [LOCAL ] SKM: Trimmed 47957 records to 35400 (keeping 200 days of data) [2025-09-17T21:41:47.823869] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T21:41:47.872779] [DEBUG] [LOCAL ] SKM: Primary data saved (35400 records). [2025-09-17T21:41:47.872932] [INFO ] [MAIN ] SKM: Full history saved. [2025-09-17T21:41:47.873040] [INFO ] [MAIN ] Update Progress: 1926/2371 symbols completed. SKM took 40.5s. Estimated remaining: 1h 5m 6s. Rate: 6.8 symbols/min [2025-09-17T21:41:48.041540] [INFO ] [MAIN ] SLB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:41:48.091156] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-17T21:41:48.091329] [INFO ] [MAIN ] SLB: Loaded 53697 existing records. [2025-09-17T21:41:48.268718] [WARN ] [MAIN ] SLB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:41:48.268978] [INFO ] [MAIN ] SLB: Wiping existing primary data before full refresh. [2025-09-17T21:41:48.269024] [INFO ] [LOCAL ] SLB: Starting deletion of primary data. [2025-09-17T21:41:48.270717] [DEBUG] [LOCAL ] SLB: Deleted primary data file. [2025-09-17T21:41:48.270769] [INFO ] [MAIN ] SLB: Starting full primary refresh. [2025-09-17T21:41:48.424743] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-01. [2025-09-17T21:41:48.656046] [INFO ] [REMOTE ] SLB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:41:49.074410] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T21:41:49.215748] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-02. [2025-09-17T21:41:49.469494] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-06 (1.85 seconds). [2025-09-17T21:41:49.973573] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T21:41:50.015738] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-03. [2025-09-17T21:41:50.741106] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T21:41:50.815741] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-04. [2025-09-17T21:41:51.615747] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-11. [2025-09-17T21:41:51.905250] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T21:41:52.415784] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-07. [2025-09-17T21:41:53.214846] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T21:41:53.224918] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-05. [2025-09-17T21:41:53.994841] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T21:41:54.015750] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-08. [2025-09-17T21:41:54.403634] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T21:41:54.815766] [INFO ] [REMOTE ] SLB: Fetching primary data for 2024-12. [2025-09-17T21:41:55.131034] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T21:41:55.615771] [INFO ] [REMOTE ] SKT: Fetching primary data for 2025-09. [2025-09-17T21:41:56.415769] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-06. [2025-09-17T21:41:56.752823] [INFO ] [REMOTE ] SKT: Incremental fetch complete for 2025-09 (1.14 seconds). [2025-09-17T21:41:56.758350] [INFO ] [REMOTE ] SKT: Full fetch complete (59591 records). [2025-09-17T21:41:56.758461] [DEBUG] [VALIDATOR ] SKT: Validating primary data. [2025-09-17T21:41:57.149079] [DEBUG] [VALIDATOR ] SKT: All expected trading days are present. [2025-09-17T21:41:57.149213] [DEBUG] [VALIDATOR ] SKT: Primary data validation passed. [2025-09-17T21:41:57.150170] [INFO ] [MAIN ] SKT: Fetched primary data is valid. [2025-09-17T21:41:57.150317] [DEBUG] [LOCAL ] SKT: Saving primary data. [2025-09-17T21:41:57.152616] [DEBUG] [LOCAL ] SKT: Trimmed 59591 records to 42554 (keeping 200 days of data) [2025-09-17T21:41:57.218843] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-08. [2025-09-17T21:41:57.412673] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2024-12 (2.60 seconds). [2025-09-17T21:41:57.483715] [DEBUG] [LOCAL ] SKT: Primary data saved (42554 records). [2025-09-17T21:41:57.483911] [INFO ] [MAIN ] SKT: Full history saved. [2025-09-17T21:41:57.485175] [INFO ] [MAIN ] Update Progress: 1927/2371 symbols completed. SKT took 30.2s. Estimated remaining: 1h 4m 58s. Rate: 6.8 symbols/min [2025-09-17T21:41:57.662409] [INFO ] [MAIN ] SLF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:41:57.675090] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T21:41:57.719705] [DEBUG] [LOCAL ] SLF: Loaded 39373 existing records from primary storage. [2025-09-17T21:41:57.719862] [INFO ] [MAIN ] SLF: Loaded 39373 existing records. [2025-09-17T21:41:57.908935] [WARN ] [MAIN ] SLF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:41:57.909270] [INFO ] [MAIN ] SLF: Wiping existing primary data before full refresh. [2025-09-17T21:41:57.909344] [INFO ] [LOCAL ] SLF: Starting deletion of primary data. [2025-09-17T21:41:57.910492] [DEBUG] [LOCAL ] SLF: Deleted primary data file. [2025-09-17T21:41:57.910576] [INFO ] [MAIN ] SLF: Starting full primary refresh. [2025-09-17T21:41:58.017460] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-01. [2025-09-17T21:41:58.283282] [INFO ] [REMOTE ] SLF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:41:58.658210] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T21:41:58.815779] [INFO ] [REMOTE ] SKY: Fetching primary data for 2025-09. [2025-09-17T21:41:59.615803] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-11. [2025-09-17T21:41:59.884817] [INFO ] [REMOTE ] SKY: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T21:41:59.890454] [INFO ] [REMOTE ] SKY: Full fetch complete (54599 records). [2025-09-17T21:41:59.890630] [DEBUG] [VALIDATOR ] SKY: Validating primary data. [2025-09-17T21:42:00.298121] [DEBUG] [VALIDATOR ] SKY: All expected trading days are present. [2025-09-17T21:42:00.298225] [DEBUG] [VALIDATOR ] SKY: Primary data validation passed. [2025-09-17T21:42:00.299263] [INFO ] [MAIN ] SKY: Fetched primary data is valid. [2025-09-17T21:42:00.299347] [DEBUG] [LOCAL ] SKY: Saving primary data. [2025-09-17T21:42:00.300738] [DEBUG] [LOCAL ] SKY: Trimmed 54599 records to 37604 (keeping 200 days of data) [2025-09-17T21:42:00.418779] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-07. [2025-09-17T21:42:00.455282] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-17T21:42:00.575288] [DEBUG] [LOCAL ] SKY: Primary data saved (37604 records). [2025-09-17T21:42:00.575447] [INFO ] [MAIN ] SKY: Full history saved. [2025-09-17T21:42:00.575664] [INFO ] [MAIN ] Update Progress: 1928/2371 symbols completed. SKY took 31.6s. Estimated remaining: 1h 4m 47s. Rate: 6.8 symbols/min [2025-09-17T21:42:00.747290] [INFO ] [MAIN ] SLG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:42:00.788673] [DEBUG] [LOCAL ] SLG: Loaded 45558 existing records from primary storage. [2025-09-17T21:42:00.788816] [INFO ] [MAIN ] SLG: Loaded 45558 existing records. [2025-09-17T21:42:00.975976] [WARN ] [MAIN ] SLG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:42:00.976533] [INFO ] [MAIN ] SLG: Wiping existing primary data before full refresh. [2025-09-17T21:42:00.976614] [INFO ] [LOCAL ] SLG: Starting deletion of primary data. [2025-09-17T21:42:00.977751] [DEBUG] [LOCAL ] SLG: Deleted primary data file. [2025-09-17T21:42:00.977809] [INFO ] [MAIN ] SLG: Starting full primary refresh. [2025-09-17T21:42:01.222630] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-02. [2025-09-17T21:42:01.253473] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T21:42:01.347177] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-07 (0.93 seconds). [2025-09-17T21:42:01.431009] [INFO ] [REMOTE ] SLG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:42:02.015795] [INFO ] [REMOTE ] SLF: Fetching primary data for 2024-12. [2025-09-17T21:42:02.815798] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-11. [2025-09-17T21:42:03.615854] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-08. [2025-09-17T21:42:03.667481] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-02 (2.44 seconds). [2025-09-17T21:42:04.415822] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-03. [2025-09-17T21:42:04.503069] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2024-12 (2.49 seconds). [2025-09-17T21:42:04.525900] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T21:42:04.749531] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T21:42:05.215835] [INFO ] [REMOTE ] SKYH: Fetching primary data for 2025-09. [2025-09-17T21:42:05.884548] [INFO ] [REMOTE ] SKYH: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T21:42:05.886760] [INFO ] [REMOTE ] SKYH: Full fetch complete (22420 records). [2025-09-17T21:42:05.886838] [DEBUG] [VALIDATOR ] SKYH: Validating primary data. [2025-09-17T21:42:06.020963] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-01. [2025-09-17T21:42:06.279155] [DEBUG] [VALIDATOR ] SKYH: All expected trading days are present. [2025-09-17T21:42:06.279239] [DEBUG] [VALIDATOR ] SKYH: Primary data validation passed. [2025-09-17T21:42:06.279781] [INFO ] [MAIN ] SKYH: Fetched primary data is valid. [2025-09-17T21:42:06.279828] [DEBUG] [LOCAL ] SKYH: Saving primary data. [2025-09-17T21:42:06.281105] [DEBUG] [LOCAL ] SKYH: Trimmed 22420 records to 16561 (keeping 200 days of data) [2025-09-17T21:42:06.383689] [DEBUG] [LOCAL ] SKYH: Primary data saved (16561 records). [2025-09-17T21:42:06.383860] [INFO ] [MAIN ] SKYH: Full history saved. [2025-09-17T21:42:06.383953] [INFO ] [MAIN ] Update Progress: 1929/2371 symbols completed. SKYH took 36.8s. Estimated remaining: 1h 4m 38s. Rate: 6.8 symbols/min [2025-09-17T21:42:06.567374] [INFO ] [MAIN ] SLGN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:42:06.605584] [DEBUG] [LOCAL ] SLGN: Loaded 40234 existing records from primary storage. [2025-09-17T21:42:06.605788] [INFO ] [MAIN ] SLGN: Loaded 40234 existing records. [2025-09-17T21:42:06.784754] [WARN ] [MAIN ] SLGN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:42:06.785001] [INFO ] [MAIN ] SLGN: Wiping existing primary data before full refresh. [2025-09-17T21:42:06.785058] [INFO ] [LOCAL ] SLGN: Starting deletion of primary data. [2025-09-17T21:42:06.803155] [DEBUG] [LOCAL ] SLGN: Deleted primary data file. [2025-09-17T21:42:06.820421] [INFO ] [MAIN ] SLGN: Starting full primary refresh. [2025-09-17T21:42:06.823600] [INFO ] [REMOTE ] SLG: Fetching primary data for 2024-12. [2025-09-17T21:42:06.871184] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-03 (2.46 seconds). [2025-09-17T21:42:07.201733] [INFO ] [REMOTE ] SLGN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:42:07.224459] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T21:42:07.615792] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-02. [2025-09-17T21:42:08.310210] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T21:42:08.415793] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-01. [2025-09-17T21:42:08.832688] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T21:42:09.215834] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-04. [2025-09-17T21:42:10.015829] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-11. [2025-09-17T21:42:10.192238] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T21:42:10.815742] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-03. [2025-09-17T21:42:11.211739] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T21:42:11.392417] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-17T21:42:11.615787] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-05. [2025-09-17T21:42:11.924179] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T21:42:12.415809] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-04. [2025-09-17T21:42:13.004655] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T21:42:13.215806] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2024-12. [2025-09-17T21:42:13.895562] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T21:42:14.015801] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-05. [2025-09-17T21:42:14.634516] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T21:42:14.815829] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-06. [2025-09-17T21:42:15.118508] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T21:42:15.615793] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-06. [2025-09-17T21:42:16.415791] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-01. [2025-09-17T21:42:17.215779] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-02. [2025-09-17T21:42:17.924431] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-06 (3.11 seconds). [2025-09-17T21:42:18.015770] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-07. [2025-09-17T21:42:18.219158] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T21:42:18.444072] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-06 (2.83 seconds). [2025-09-17T21:42:18.666694] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T21:42:18.815779] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-03. [2025-09-17T21:42:19.615809] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-02. [2025-09-17T21:42:19.972738] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T21:42:20.113781] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T21:42:20.415799] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-04. [2025-09-17T21:42:20.976702] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T21:42:21.215795] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-07. [2025-09-17T21:42:21.839294] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T21:42:22.015786] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-05. [2025-09-17T21:42:22.693600] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T21:42:22.815768] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-03. [2025-09-17T21:42:23.615769] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-08. [2025-09-17T21:42:23.895818] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T21:42:24.366756] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T21:42:24.415737] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-04. [2025-09-17T21:42:24.601669] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-08 (0.99 seconds). [2025-09-17T21:42:25.215797] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-08. [2025-09-17T21:42:26.015683] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-06. [2025-09-17T21:42:26.196832] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T21:42:26.815795] [INFO ] [REMOTE ] SLF: Fetching primary data for 2025-09. [2025-09-17T21:42:27.265618] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T21:42:27.615763] [INFO ] [REMOTE ] SLB: Fetching primary data for 2025-09. [2025-09-17T21:42:27.783070] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T21:42:27.928360] [INFO ] [REMOTE ] SLB: Incremental fetch complete for 2025-09 (0.31 seconds). [2025-09-17T21:42:27.935947] [INFO ] [REMOTE ] SLB: Full fetch complete (77603 records). [2025-09-17T21:42:27.936072] [DEBUG] [VALIDATOR ] SLB: Validating primary data. [2025-09-17T21:42:28.332269] [DEBUG] [VALIDATOR ] SLB: All expected trading days are present. [2025-09-17T21:42:28.332460] [DEBUG] [VALIDATOR ] SLB: Primary data validation passed. [2025-09-17T21:42:28.333719] [INFO ] [MAIN ] SLB: Fetched primary data is valid. [2025-09-17T21:42:28.333828] [DEBUG] [LOCAL ] SLB: Saving primary data. [2025-09-17T21:42:28.347601] [INFO ] [REMOTE ] SLF: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T21:42:28.352426] [DEBUG] [LOCAL ] SLB: Trimmed 77603 records to 53697 (keeping 200 days of data) [2025-09-17T21:42:28.353311] [INFO ] [REMOTE ] SLF: Full fetch complete (56561 records). [2025-09-17T21:42:28.353568] [DEBUG] [VALIDATOR ] SLF: Validating primary data. [2025-09-17T21:42:28.445464] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-05. [2025-09-17T21:42:28.860783] [DEBUG] [VALIDATOR ] SLF: All expected trading days are present. [2025-09-17T21:42:28.862852] [DEBUG] [VALIDATOR ] SLF: Primary data validation passed. [2025-09-17T21:42:28.866467] [INFO ] [MAIN ] SLF: Fetched primary data is valid. [2025-09-17T21:42:28.866898] [DEBUG] [LOCAL ] SLF: Saving primary data. [2025-09-17T21:42:28.883459] [DEBUG] [LOCAL ] SLF: Trimmed 56561 records to 39345 (keeping 200 days of data) [2025-09-17T21:42:29.215985] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-07. [2025-09-17T21:42:29.223409] [DEBUG] [LOCAL ] SLB: Primary data saved (53697 records). [2025-09-17T21:42:29.224073] [INFO ] [MAIN ] SLB: Full history saved. [2025-09-17T21:42:29.224438] [INFO ] [MAIN ] Update Progress: 1930/2371 symbols completed. SLB took 41.4s. Estimated remaining: 1h 4m 32s. Rate: 6.8 symbols/min [2025-09-17T21:42:29.517778] [INFO ] [MAIN ] SLNZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:42:29.519088] [DEBUG] [LOCAL ] SLNZ: No existing data file found in primary storage. [2025-09-17T21:42:29.519694] [WARN ] [MAIN ] SLNZ: No existing data found, performing full refresh instead. [2025-09-17T21:42:29.522123] [INFO ] [MAIN ] SLNZ: Wiping existing primary data before full refresh. [2025-09-17T21:42:29.522498] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-17T21:42:29.523587] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-17T21:42:29.524226] [INFO ] [MAIN ] SLNZ: Starting full primary refresh. [2025-09-17T21:42:29.608535] [DEBUG] [LOCAL ] SLF: Primary data saved (39345 records). [2025-09-17T21:42:29.629596] [INFO ] [MAIN ] SLF: Full history saved. [2025-09-17T21:42:29.630779] [INFO ] [MAIN ] Update Progress: 1931/2371 symbols completed. SLF took 32.1s. Estimated remaining: 1h 4m 22s. Rate: 6.8 symbols/min [2025-09-17T21:42:29.959751] [INFO ] [MAIN ] SLQT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:42:30.073784] [INFO ] [REMOTE ] SLNZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:42:30.074205] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-11. [2025-09-17T21:42:30.099850] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T21:42:30.135472] [DEBUG] [LOCAL ] SLQT: Loaded 44443 existing records from primary storage. [2025-09-17T21:42:30.135613] [INFO ] [MAIN ] SLQT: Loaded 44443 existing records. [2025-09-17T21:42:30.312110] [WARN ] [MAIN ] SLQT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:42:30.312358] [INFO ] [MAIN ] SLQT: Wiping existing primary data before full refresh. [2025-09-17T21:42:30.312404] [INFO ] [LOCAL ] SLQT: Starting deletion of primary data. [2025-09-17T21:42:30.313262] [DEBUG] [LOCAL ] SLQT: Deleted primary data file. [2025-09-17T21:42:30.313310] [INFO ] [MAIN ] SLQT: Starting full primary refresh. [2025-09-17T21:42:30.438908] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T21:42:30.681963] [INFO ] [REMOTE ] SLQT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:42:30.771751] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-07 (1.56 seconds). [2025-09-17T21:42:30.815733] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-11. [2025-09-17T21:42:31.615784] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2024-12. [2025-09-17T21:42:32.144449] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2024-12 (0.53 seconds). [2025-09-17T21:42:32.166221] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T21:42:32.415771] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2024-12. [2025-09-17T21:42:33.215787] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-06. [2025-09-17T21:42:33.888352] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2024-12 (1.47 seconds). [2025-09-17T21:42:34.015775] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-08. [2025-09-17T21:42:34.209235] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T21:42:34.815774] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-01. [2025-09-17T21:42:35.573983] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T21:42:35.615742] [INFO ] [REMOTE ] SLG: Fetching primary data for 2025-09. [2025-09-17T21:42:36.317220] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T21:42:36.415739] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-02. [2025-09-17T21:42:36.781841] [INFO ] [REMOTE ] SLG: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T21:42:36.788336] [INFO ] [REMOTE ] SLG: Full fetch complete (65272 records). [2025-09-17T21:42:36.788484] [DEBUG] [VALIDATOR ] SLG: Validating primary data. [2025-09-17T21:42:37.183899] [DEBUG] [VALIDATOR ] SLG: All expected trading days are present. [2025-09-17T21:42:37.183978] [DEBUG] [VALIDATOR ] SLG: Primary data validation passed. [2025-09-17T21:42:37.185046] [INFO ] [MAIN ] SLG: Fetched primary data is valid. [2025-09-17T21:42:37.185098] [DEBUG] [LOCAL ] SLG: Saving primary data. [2025-09-17T21:42:37.186938] [DEBUG] [LOCAL ] SLG: Trimmed 65272 records to 45646 (keeping 200 days of data) [2025-09-17T21:42:37.243596] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-01. [2025-09-17T21:42:37.484348] [DEBUG] [LOCAL ] SLG: Primary data saved (45646 records). [2025-09-17T21:42:37.484499] [INFO ] [MAIN ] SLG: Full history saved. [2025-09-17T21:42:37.484614] [INFO ] [MAIN ] Update Progress: 1932/2371 symbols completed. SLG took 36.9s. Estimated remaining: 1h 4m 13s. Rate: 6.8 symbols/min [2025-09-17T21:42:37.645292] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-17T21:42:37.665252] [INFO ] [MAIN ] SLVM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:42:37.694379] [DEBUG] [LOCAL ] SLVM: Loaded 28030 existing records from primary storage. [2025-09-17T21:42:37.694624] [INFO ] [MAIN ] SLVM: Loaded 28030 existing records. [2025-09-17T21:42:37.901113] [WARN ] [MAIN ] SLVM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:42:37.905813] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T21:42:37.904795] [INFO ] [MAIN ] SLVM: Wiping existing primary data before full refresh. [2025-09-17T21:42:37.914955] [INFO ] [LOCAL ] SLVM: Starting deletion of primary data. [2025-09-17T21:42:37.915977] [DEBUG] [LOCAL ] SLVM: Deleted primary data file. [2025-09-17T21:42:37.916040] [INFO ] [MAIN ] SLVM: Starting full primary refresh. [2025-09-17T21:42:38.020815] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-07. [2025-09-17T21:42:38.275737] [INFO ] [REMOTE ] SLVM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:42:38.815869] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-03. [2025-09-17T21:42:39.457257] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T21:42:39.615883] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-08. [2025-09-17T21:42:40.348687] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-03 (1.53 seconds). [2025-09-17T21:42:40.415760] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-11. [2025-09-17T21:42:40.843009] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-08 (1.23 seconds). [2025-09-17T21:42:41.215875] [INFO ] [REMOTE ] SLGN: Fetching primary data for 2025-09. [2025-09-17T21:42:41.374786] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T21:42:42.015779] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2024-12. [2025-09-17T21:42:42.815739] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-02. [2025-09-17T21:42:42.853045] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2024-12 (0.84 seconds). [2025-09-17T21:42:43.143298] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-02 (0.33 seconds). [2025-09-17T21:42:43.188339] [INFO ] [REMOTE ] SLGN: Incremental fetch complete for 2025-09 (1.97 seconds). [2025-09-17T21:42:43.194255] [INFO ] [REMOTE ] SLGN: Full fetch complete (57522 records). [2025-09-17T21:42:43.194428] [DEBUG] [VALIDATOR ] SLGN: Validating primary data. [2025-09-17T21:42:43.589591] [DEBUG] [VALIDATOR ] SLGN: All expected trading days are present. [2025-09-17T21:42:43.589693] [DEBUG] [VALIDATOR ] SLGN: Primary data validation passed. [2025-09-17T21:42:43.590573] [INFO ] [MAIN ] SLGN: Fetched primary data is valid. [2025-09-17T21:42:43.590616] [DEBUG] [LOCAL ] SLGN: Saving primary data. [2025-09-17T21:42:43.591804] [DEBUG] [LOCAL ] SLGN: Trimmed 57522 records to 40273 (keeping 200 days of data) [2025-09-17T21:42:43.648796] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-01. [2025-09-17T21:42:43.844241] [DEBUG] [LOCAL ] SLGN: Primary data saved (40273 records). [2025-09-17T21:42:43.844378] [INFO ] [MAIN ] SLGN: Full history saved. [2025-09-17T21:42:43.844462] [INFO ] [MAIN ] Update Progress: 1933/2371 symbols completed. SLGN took 37.5s. Estimated remaining: 1h 4m 3s. Rate: 6.8 symbols/min [2025-09-17T21:42:44.017156] [INFO ] [MAIN ] SM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:42:44.065604] [DEBUG] [LOCAL ] SM: Loaded 52323 existing records from primary storage. [2025-09-17T21:42:44.065770] [INFO ] [MAIN ] SM: Loaded 52323 existing records. [2025-09-17T21:42:44.250748] [WARN ] [MAIN ] SM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:42:44.251038] [INFO ] [MAIN ] SM: Wiping existing primary data before full refresh. [2025-09-17T21:42:44.251091] [INFO ] [LOCAL ] SM: Starting deletion of primary data. [2025-09-17T21:42:44.252394] [DEBUG] [LOCAL ] SM: Deleted primary data file. [2025-09-17T21:42:44.252446] [INFO ] [MAIN ] SM: Starting full primary refresh. [2025-09-17T21:42:44.432257] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-04. [2025-09-17T21:42:44.625315] [INFO ] [REMOTE ] SM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:42:44.785829] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T21:42:45.215781] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-11. [2025-09-17T21:42:45.893322] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-04 (1.46 seconds). [2025-09-17T21:42:46.015768] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-05. [2025-09-17T21:42:46.567235] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T21:42:46.815776] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-02. [2025-09-17T21:42:47.334091] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-05 (1.32 seconds). [2025-09-17T21:42:47.590795] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T21:42:47.615719] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-03. [2025-09-17T21:42:48.415793] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-06. [2025-09-17T21:42:48.967685] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T21:42:49.215823] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-04. [2025-09-17T21:42:49.792952] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T21:42:50.015788] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-07. [2025-09-17T21:42:50.288092] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T21:42:50.815792] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-05. [2025-09-17T21:42:51.615707] [INFO ] [REMOTE ] SM: Fetching primary data for 2024-12. [2025-09-17T21:42:51.721460] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T21:42:51.847995] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T21:42:52.415777] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-08. [2025-09-17T21:42:53.196037] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T21:42:53.215719] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-01. [2025-09-17T21:42:53.829362] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T21:42:54.015772] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-06. [2025-09-17T21:42:54.544764] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T21:42:54.815730] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-03. [2025-09-17T21:42:55.102309] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T21:42:55.330301] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-03 (0.51 seconds). [2025-09-17T21:42:55.615767] [INFO ] [REMOTE ] SLQT: Fetching primary data for 2025-09. [2025-09-17T21:42:56.415918] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-04. [2025-09-17T21:42:56.754250] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T21:42:56.881422] [INFO ] [REMOTE ] SLQT: Incremental fetch complete for 2025-09 (1.27 seconds). [2025-09-17T21:42:56.889529] [INFO ] [REMOTE ] SLQT: Full fetch complete (63487 records). [2025-09-17T21:42:56.889759] [DEBUG] [VALIDATOR ] SLQT: Validating primary data. [2025-09-17T21:42:57.220859] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-05. [2025-09-17T21:42:57.344495] [DEBUG] [VALIDATOR ] SLQT: All expected trading days are present. [2025-09-17T21:42:57.344598] [DEBUG] [VALIDATOR ] SLQT: Primary data validation passed. [2025-09-17T21:42:57.345976] [INFO ] [MAIN ] SLQT: Fetched primary data is valid. [2025-09-17T21:42:57.346090] [DEBUG] [LOCAL ] SLQT: Saving primary data. [2025-09-17T21:42:57.348046] [DEBUG] [LOCAL ] SLQT: Trimmed 63487 records to 44321 (keeping 200 days of data) [2025-09-17T21:42:57.631206] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-05 (0.41 seconds). [2025-09-17T21:42:57.737201] [DEBUG] [LOCAL ] SLQT: Primary data saved (44321 records). [2025-09-17T21:42:57.737406] [INFO ] [MAIN ] SLQT: Full history saved. [2025-09-17T21:42:57.737549] [INFO ] [MAIN ] Update Progress: 1934/2371 symbols completed. SLQT took 28.1s. Estimated remaining: 1h 3m 56s. Rate: 6.8 symbols/min [2025-09-17T21:42:57.942408] [INFO ] [MAIN ] SMA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:42:57.942620] [DEBUG] [LOCAL ] SMA: No existing data file found in primary storage. [2025-09-17T21:42:57.942679] [WARN ] [MAIN ] SMA: No existing data found, performing full refresh instead. [2025-09-17T21:42:57.942816] [INFO ] [MAIN ] SMA: Wiping existing primary data before full refresh. [2025-09-17T21:42:57.942857] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-17T21:42:57.942899] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-17T21:42:57.942932] [INFO ] [MAIN ] SMA: Starting full primary refresh. [2025-09-17T21:42:58.020951] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-02. [2025-09-17T21:42:58.324082] [INFO ] [REMOTE ] SMA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:42:58.815804] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-06. [2025-09-17T21:42:59.159523] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T21:42:59.615791] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-07. [2025-09-17T21:42:59.734682] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T21:43:00.415832] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-03. [2025-09-17T21:43:00.946128] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-07 (1.33 seconds). [2025-09-17T21:43:01.215792] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-08. [2025-09-17T21:43:02.015848] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-07. [2025-09-17T21:43:02.197475] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T21:43:02.228544] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T21:43:02.356854] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-17T21:43:02.815827] [INFO ] [REMOTE ] SLVM: Fetching primary data for 2025-09. [2025-09-17T21:43:03.615781] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-04. [2025-09-17T21:43:04.079100] [INFO ] [REMOTE ] SLVM: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T21:43:04.083130] [INFO ] [REMOTE ] SLVM: Full fetch complete (39260 records). [2025-09-17T21:43:04.083211] [DEBUG] [VALIDATOR ] SLVM: Validating primary data. [2025-09-17T21:43:04.421040] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-08. [2025-09-17T21:43:04.457255] [DEBUG] [VALIDATOR ] SLVM: All expected trading days are present. [2025-09-17T21:43:04.457317] [DEBUG] [VALIDATOR ] SLVM: Primary data validation passed. [2025-09-17T21:43:04.458072] [INFO ] [MAIN ] SLVM: Fetched primary data is valid. [2025-09-17T21:43:04.458121] [DEBUG] [LOCAL ] SLVM: Saving primary data. [2025-09-17T21:43:04.459119] [DEBUG] [LOCAL ] SLVM: Trimmed 39260 records to 28006 (keeping 200 days of data) [2025-09-17T21:43:04.634225] [DEBUG] [LOCAL ] SLVM: Primary data saved (28006 records). [2025-09-17T21:43:04.634359] [INFO ] [MAIN ] SLVM: Full history saved. [2025-09-17T21:43:04.634450] [INFO ] [MAIN ] Update Progress: 1935/2371 symbols completed. SLVM took 27.1s. Estimated remaining: 1h 3m 47s. Rate: 6.8 symbols/min [2025-09-17T21:43:04.835558] [INFO ] [MAIN ] SMBK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:43:04.844863] [DEBUG] [LOCAL ] SMBK: Loaded 8272 existing records from primary storage. [2025-09-17T21:43:04.844991] [INFO ] [MAIN ] SMBK: Loaded 8272 existing records. [2025-09-17T21:43:05.026087] [WARN ] [MAIN ] SMBK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:43:05.026441] [INFO ] [MAIN ] SMBK: Wiping existing primary data before full refresh. [2025-09-17T21:43:05.026541] [INFO ] [LOCAL ] SMBK: Starting deletion of primary data. [2025-09-17T21:43:05.027063] [DEBUG] [LOCAL ] SMBK: Deleted primary data file. [2025-09-17T21:43:05.027129] [INFO ] [MAIN ] SMBK: Starting full primary refresh. [2025-09-17T21:43:05.137043] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-08 (0.72 seconds). [2025-09-17T21:43:05.220186] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-11. [2025-09-17T21:43:05.397836] [INFO ] [REMOTE ] SMBK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:43:05.430529] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T21:43:05.511014] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:43:05.511335] [WARN ] [REMOTE ] SMA: No data returned for month 2024-11 [2025-09-17T21:43:06.015776] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-11. [2025-09-17T21:43:06.817223] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-05. [2025-09-17T21:43:06.824763] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T21:43:07.615789] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2024-12. [2025-09-17T21:43:08.255011] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T21:43:08.415815] [INFO ] [REMOTE ] SMA: Fetching primary data for 2024-12. [2025-09-17T21:43:08.590632] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T21:43:08.663427] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:43:08.663742] [WARN ] [REMOTE ] SMA: No data returned for month 2024-12 [2025-09-17T21:43:09.215795] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-01. [2025-09-17T21:43:10.005834] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T21:43:10.015669] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-02. [2025-09-17T21:43:10.483619] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-02 (0.47 seconds). [2025-09-17T21:43:10.815803] [INFO ] [REMOTE ] SLNZ: Fetching primary data for 2025-09. [2025-09-17T21:43:11.061282] [INFO ] [REMOTE ] SLNZ: Incremental fetch complete for 2025-09 (0.25 seconds). [2025-09-17T21:43:11.061988] [INFO ] [REMOTE ] SLNZ: Full fetch complete (1066 records). [2025-09-17T21:43:11.062055] [DEBUG] [VALIDATOR ] SLNZ: Validating primary data. [2025-09-17T21:43:11.244462] [WARN ] [VALIDATOR ] SLNZ: Validation failed - insufficient historical data. Have 196 unique days, need 200 days [2025-09-17T21:43:11.244663] [FATAL] [MAIN ] SLNZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:43:11.244713] [WARN ] [MAIN ] SLNZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:43:11.244758] [INFO ] [LOCAL ] SLNZ: Starting deletion of primary data. [2025-09-17T21:43:11.244814] [DEBUG] [LOCAL ] SLNZ: No primary data file found to delete. [2025-09-17T21:43:11.244847] [INFO ] [LOCAL ] SLNZ: Starting deletion of derivative data. [2025-09-17T21:43:11.244899] [DEBUG] [LOCAL ] SLNZ: No derivative data file found to delete. [2025-09-17T21:43:11.244967] [INFO ] [MAIN ] Update Progress: 1936/2371 symbols completed. SLNZ took 42.0s. Estimated remaining: 1h 3m 37s. Rate: 6.8 symbols/min [2025-09-17T21:43:11.415417] [INFO ] [MAIN ] SMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:43:11.427754] [DEBUG] [LOCAL ] SMC: Loaded 11502 existing records from primary storage. [2025-09-17T21:43:11.427876] [INFO ] [MAIN ] SMC: Loaded 11502 existing records. [2025-09-17T21:43:11.607105] [WARN ] [MAIN ] SMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:43:11.607372] [INFO ] [MAIN ] SMC: Wiping existing primary data before full refresh. [2025-09-17T21:43:11.607418] [INFO ] [LOCAL ] SMC: Starting deletion of primary data. [2025-09-17T21:43:11.607783] [DEBUG] [LOCAL ] SMC: Deleted primary data file. [2025-09-17T21:43:11.607831] [INFO ] [MAIN ] SMC: Starting full primary refresh. [2025-09-17T21:43:11.620876] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-03. [2025-09-17T21:43:11.975824] [INFO ] [REMOTE ] SMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:43:12.415791] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-06. [2025-09-17T21:43:12.486655] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T21:43:13.215781] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-04. [2025-09-17T21:43:13.857089] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T21:43:14.015794] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-05. [2025-09-17T21:43:14.324059] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T21:43:14.798789] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T21:43:14.815715] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-06. [2025-09-17T21:43:15.621343] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-01. [2025-09-17T21:43:15.624026] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T21:43:15.830890] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:43:15.831243] [WARN ] [REMOTE ] SMA: No data returned for month 2025-01 [2025-09-17T21:43:16.415795] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-07. [2025-09-17T21:43:16.929825] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-07 (0.51 seconds). [2025-09-17T21:43:17.215851] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-02. [2025-09-17T21:43:17.610173] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:43:17.610508] [WARN ] [REMOTE ] SMA: No data returned for month 2025-02 [2025-09-17T21:43:18.015782] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-08. [2025-09-17T21:43:18.784091] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T21:43:18.815729] [INFO ] [REMOTE ] SMBK: Fetching primary data for 2025-09. [2025-09-17T21:43:19.464950] [INFO ] [REMOTE ] SMBK: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T21:43:19.467408] [INFO ] [REMOTE ] SMBK: Full fetch complete (11719 records). [2025-09-17T21:43:19.467668] [DEBUG] [VALIDATOR ] SMBK: Validating primary data. [2025-09-17T21:43:19.622260] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-03. [2025-09-17T21:43:19.848101] [DEBUG] [VALIDATOR ] SMBK: All expected trading days are present. [2025-09-17T21:43:19.848186] [DEBUG] [VALIDATOR ] SMBK: Primary data validation passed. [2025-09-17T21:43:19.848544] [INFO ] [MAIN ] SMBK: Fetched primary data is valid. [2025-09-17T21:43:19.848596] [DEBUG] [LOCAL ] SMBK: Saving primary data. [2025-09-17T21:43:19.849141] [DEBUG] [LOCAL ] SMBK: Trimmed 11719 records to 8268 (keeping 200 days of data) [2025-09-17T21:43:19.906197] [DEBUG] [LOCAL ] SMBK: Primary data saved (8268 records). [2025-09-17T21:43:19.906368] [INFO ] [MAIN ] SMBK: Full history saved. [2025-09-17T21:43:19.906474] [INFO ] [MAIN ] Update Progress: 1937/2371 symbols completed. SMBK took 15.3s. Estimated remaining: 1h 3m 29s. Rate: 6.8 symbols/min [2025-09-17T21:43:19.983301] [DEBUG] [REMOTE ] SMA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:43:20.017485] [WARN ] [REMOTE ] SMA: No data returned for month 2025-03 [2025-09-17T21:43:20.092076] [INFO ] [MAIN ] SMFG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:43:20.140308] [DEBUG] [LOCAL ] SMFG: Loaded 48184 existing records from primary storage. [2025-09-17T21:43:20.140499] [INFO ] [MAIN ] SMFG: Loaded 48184 existing records. [2025-09-17T21:43:20.334158] [WARN ] [MAIN ] SMFG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:43:20.334465] [INFO ] [MAIN ] SMFG: Wiping existing primary data before full refresh. [2025-09-17T21:43:20.334524] [INFO ] [LOCAL ] SMFG: Starting deletion of primary data. [2025-09-17T21:43:20.335678] [DEBUG] [LOCAL ] SMFG: Deleted primary data file. [2025-09-17T21:43:20.335743] [INFO ] [MAIN ] SMFG: Starting full primary refresh. [2025-09-17T21:43:20.421069] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-04. [2025-09-17T21:43:20.709397] [INFO ] [REMOTE ] SMFG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:43:21.215805] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-11. [2025-09-17T21:43:21.517083] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T21:43:21.952146] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T21:43:22.015798] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-05. [2025-09-17T21:43:22.815782] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-11. [2025-09-17T21:43:23.396966] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T21:43:23.615769] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-06. [2025-09-17T21:43:24.415830] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-07. [2025-09-17T21:43:24.450615] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T21:43:24.981428] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T21:43:25.215780] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-07. [2025-09-17T21:43:26.015807] [INFO ] [REMOTE ] SMC: Fetching primary data for 2024-12. [2025-09-17T21:43:26.161661] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T21:43:26.388235] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T21:43:26.815788] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-08. [2025-09-17T21:43:26.940317] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T21:43:27.615777] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-08. [2025-09-17T21:43:28.283396] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T21:43:28.415806] [INFO ] [REMOTE ] SMA: Fetching primary data for 2025-09. [2025-09-17T21:43:29.018005] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T21:43:29.215847] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2024-12. [2025-09-17T21:43:29.332389] [INFO ] [REMOTE ] SMA: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T21:43:29.338421] [INFO ] [REMOTE ] SMA: Full fetch complete (28427 records). [2025-09-17T21:43:29.338633] [DEBUG] [VALIDATOR ] SMA: Validating primary data. [2025-09-17T21:43:29.563785] [WARN ] [VALIDATOR ] SMA: Validation failed - insufficient historical data. Have 116 unique days, need 200 days [2025-09-17T21:43:29.564185] [FATAL] [MAIN ] SMA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:43:29.564234] [WARN ] [MAIN ] SMA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:43:29.564274] [INFO ] [LOCAL ] SMA: Starting deletion of primary data. [2025-09-17T21:43:29.564331] [DEBUG] [LOCAL ] SMA: No primary data file found to delete. [2025-09-17T21:43:29.564366] [INFO ] [LOCAL ] SMA: Starting deletion of derivative data. [2025-09-17T21:43:29.564404] [DEBUG] [LOCAL ] SMA: No derivative data file found to delete. [2025-09-17T21:43:29.564470] [INFO ] [MAIN ] Update Progress: 1938/2371 symbols completed. SMA took 31.8s. Estimated remaining: 1h 3m 20s. Rate: 6.8 symbols/min [2025-09-17T21:43:29.736078] [INFO ] [MAIN ] SMG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:43:29.777510] [DEBUG] [LOCAL ] SMG: Loaded 44376 existing records from primary storage. [2025-09-17T21:43:29.777674] [INFO ] [MAIN ] SMG: Loaded 44376 existing records. [2025-09-17T21:43:29.953687] [WARN ] [MAIN ] SMG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:43:29.953969] [INFO ] [MAIN ] SMG: Wiping existing primary data before full refresh. [2025-09-17T21:43:29.954014] [INFO ] [LOCAL ] SMG: Starting deletion of primary data. [2025-09-17T21:43:29.954879] [DEBUG] [LOCAL ] SMG: Deleted primary data file. [2025-09-17T21:43:29.954927] [INFO ] [MAIN ] SMG: Starting full primary refresh. [2025-09-17T21:43:30.021066] [INFO ] [REMOTE ] SM: Fetching primary data for 2025-09. [2025-09-17T21:43:30.311620] [INFO ] [REMOTE ] SMG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:43:30.815783] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-11. [2025-09-17T21:43:30.907124] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T21:43:31.389487] [INFO ] [REMOTE ] SM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T21:43:31.396329] [INFO ] [REMOTE ] SM: Full fetch complete (74897 records). [2025-09-17T21:43:31.396478] [DEBUG] [VALIDATOR ] SM: Validating primary data. [2025-09-17T21:43:31.627538] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-01. [2025-09-17T21:43:31.796223] [DEBUG] [VALIDATOR ] SM: All expected trading days are present. [2025-09-17T21:43:31.796309] [DEBUG] [VALIDATOR ] SM: Primary data validation passed. [2025-09-17T21:43:31.797335] [INFO ] [MAIN ] SM: Fetched primary data is valid. [2025-09-17T21:43:31.797391] [DEBUG] [LOCAL ] SM: Saving primary data. [2025-09-17T21:43:31.798882] [DEBUG] [LOCAL ] SM: Trimmed 74897 records to 52333 (keeping 200 days of data) [2025-09-17T21:43:32.120510] [DEBUG] [LOCAL ] SM: Primary data saved (52333 records). [2025-09-17T21:43:32.120686] [INFO ] [MAIN ] SM: Full history saved. [2025-09-17T21:43:32.120779] [INFO ] [MAIN ] Update Progress: 1939/2371 symbols completed. SM took 48.3s. Estimated remaining: 1h 3m 10s. Rate: 6.8 symbols/min [2025-09-17T21:43:32.309221] [INFO ] [MAIN ] SMHI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:43:32.318288] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T21:43:32.335354] [DEBUG] [LOCAL ] SMHI: Loaded 14649 existing records from primary storage. [2025-09-17T21:43:32.335489] [INFO ] [MAIN ] SMHI: Loaded 14649 existing records. [2025-09-17T21:43:32.421000] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-02. [2025-09-17T21:43:32.525472] [WARN ] [MAIN ] SMHI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:43:32.525766] [INFO ] [MAIN ] SMHI: Wiping existing primary data before full refresh. [2025-09-17T21:43:32.525814] [INFO ] [LOCAL ] SMHI: Starting deletion of primary data. [2025-09-17T21:43:32.526178] [DEBUG] [LOCAL ] SMHI: Deleted primary data file. [2025-09-17T21:43:32.526223] [INFO ] [MAIN ] SMHI: Starting full primary refresh. [2025-09-17T21:43:32.894191] [INFO ] [REMOTE ] SMHI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:43:32.963435] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T21:43:33.215811] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-11. [2025-09-17T21:43:33.954263] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T21:43:34.015743] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2024-12. [2025-09-17T21:43:34.815850] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-01. [2025-09-17T21:43:35.028190] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T21:43:35.313381] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-11 (4.50 seconds). [2025-09-17T21:43:35.615838] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-01. [2025-09-17T21:43:36.002077] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T21:43:36.415776] [INFO ] [REMOTE ] SMG: Fetching primary data for 2024-12. [2025-09-17T21:43:36.723500] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T21:43:37.215811] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-02. [2025-09-17T21:43:37.533566] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T21:43:38.015800] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-01. [2025-09-17T21:43:38.815798] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-03. [2025-09-17T21:43:39.154181] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T21:43:39.237441] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T21:43:39.615817] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-02. [2025-09-17T21:43:39.760073] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T21:43:40.390608] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T21:43:40.415733] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-03. [2025-09-17T21:43:41.215789] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-04. [2025-09-17T21:43:41.413361] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-03 (1.00 seconds). [2025-09-17T21:43:42.015781] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-04. [2025-09-17T21:43:42.162795] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T21:43:42.815778] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-05. [2025-09-17T21:43:43.074378] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T21:43:43.611943] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-05 (0.80 seconds). [2025-09-17T21:43:43.615663] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-06. [2025-09-17T21:43:44.415798] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-03. [2025-09-17T21:43:44.515415] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T21:43:45.215783] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-07. [2025-09-17T21:43:45.760518] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T21:43:45.979196] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T21:43:46.015727] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-04. [2025-09-17T21:43:46.815788] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-05. [2025-09-17T21:43:47.497260] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-05 (0.68 seconds). [2025-09-17T21:43:47.615710] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-06. [2025-09-17T21:43:47.772206] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T21:43:48.423379] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-08. [2025-09-17T21:43:48.425067] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T21:43:49.039028] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T21:43:49.215795] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-07. [2025-09-17T21:43:49.821051] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T21:43:50.015855] [INFO ] [REMOTE ] SMC: Fetching primary data for 2025-09. [2025-09-17T21:43:50.726551] [INFO ] [REMOTE ] SMC: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T21:43:50.728467] [INFO ] [REMOTE ] SMC: Full fetch complete (16807 records). [2025-09-17T21:43:50.728543] [DEBUG] [VALIDATOR ] SMC: Validating primary data. [2025-09-17T21:43:50.820932] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-08. [2025-09-17T21:43:51.103256] [DEBUG] [VALIDATOR ] SMC: All expected trading days are present. [2025-09-17T21:43:51.103352] [DEBUG] [VALIDATOR ] SMC: Primary data validation passed. [2025-09-17T21:43:51.103924] [INFO ] [MAIN ] SMC: Fetched primary data is valid. [2025-09-17T21:43:51.103986] [DEBUG] [LOCAL ] SMC: Saving primary data. [2025-09-17T21:43:51.105155] [DEBUG] [LOCAL ] SMC: Trimmed 16807 records to 11482 (keeping 200 days of data) [2025-09-17T21:43:51.175059] [DEBUG] [LOCAL ] SMC: Primary data saved (11482 records). [2025-09-17T21:43:51.175215] [INFO ] [MAIN ] SMC: Full history saved. [2025-09-17T21:43:51.175309] [INFO ] [MAIN ] Update Progress: 1940/2371 symbols completed. SMC took 39.9s. Estimated remaining: 1h 3m 3s. Rate: 6.8 symbols/min [2025-09-17T21:43:51.345910] [INFO ] [MAIN ] SMP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:43:51.365388] [DEBUG] [LOCAL ] SMP: Loaded 20039 existing records from primary storage. [2025-09-17T21:43:51.365522] [INFO ] [MAIN ] SMP: Loaded 20039 existing records. [2025-09-17T21:43:51.549323] [WARN ] [MAIN ] SMP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:43:51.549675] [INFO ] [MAIN ] SMP: Wiping existing primary data before full refresh. [2025-09-17T21:43:51.549735] [INFO ] [LOCAL ] SMP: Starting deletion of primary data. [2025-09-17T21:43:51.550254] [DEBUG] [LOCAL ] SMP: Deleted primary data file. [2025-09-17T21:43:51.550306] [INFO ] [MAIN ] SMP: Starting full primary refresh. [2025-09-17T21:43:51.624583] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-05. [2025-09-17T21:43:51.905862] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T21:43:51.925299] [INFO ] [REMOTE ] SMP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:43:52.415766] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-11. [2025-09-17T21:43:53.017992] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T21:43:53.127744] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T21:43:53.215761] [INFO ] [REMOTE ] SMP: Fetching primary data for 2024-12. [2025-09-17T21:43:54.015781] [INFO ] [REMOTE ] SMHI: Fetching primary data for 2025-09. [2025-09-17T21:43:54.147257] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T21:43:54.688526] [INFO ] [REMOTE ] SMHI: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T21:43:54.690389] [INFO ] [REMOTE ] SMHI: Full fetch complete (24968 records). [2025-09-17T21:43:54.690465] [DEBUG] [VALIDATOR ] SMHI: Validating primary data. [2025-09-17T21:43:54.820838] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-06. [2025-09-17T21:43:55.073749] [DEBUG] [VALIDATOR ] SMHI: All expected trading days are present. [2025-09-17T21:43:55.073855] [DEBUG] [VALIDATOR ] SMHI: Primary data validation passed. [2025-09-17T21:43:55.074382] [INFO ] [MAIN ] SMHI: Fetched primary data is valid. [2025-09-17T21:43:55.074438] [DEBUG] [LOCAL ] SMHI: Saving primary data. [2025-09-17T21:43:55.075173] [DEBUG] [LOCAL ] SMHI: Trimmed 24968 records to 14627 (keeping 200 days of data) [2025-09-17T21:43:55.161920] [DEBUG] [LOCAL ] SMHI: Primary data saved (14627 records). [2025-09-17T21:43:55.162146] [INFO ] [MAIN ] SMHI: Full history saved. [2025-09-17T21:43:55.162252] [INFO ] [MAIN ] Update Progress: 1941/2371 symbols completed. SMHI took 23.0s. Estimated remaining: 1h 2m 53s. Rate: 6.8 symbols/min [2025-09-17T21:43:55.331749] [INFO ] [MAIN ] SMR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:43:55.389789] [DEBUG] [LOCAL ] SMR: Loaded 53797 existing records from primary storage. [2025-09-17T21:43:55.389984] [INFO ] [MAIN ] SMR: Loaded 53797 existing records. [2025-09-17T21:43:55.577369] [WARN ] [MAIN ] SMR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:43:55.577619] [INFO ] [MAIN ] SMR: Wiping existing primary data before full refresh. [2025-09-17T21:43:55.577687] [INFO ] [LOCAL ] SMR: Starting deletion of primary data. [2025-09-17T21:43:55.578849] [DEBUG] [LOCAL ] SMR: Deleted primary data file. [2025-09-17T21:43:55.578901] [INFO ] [MAIN ] SMR: Starting full primary refresh. [2025-09-17T21:43:55.623765] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-01. [2025-09-17T21:43:55.957223] [INFO ] [REMOTE ] SMR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:43:56.104385] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T21:43:56.415782] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-02. [2025-09-17T21:43:56.625301] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T21:43:57.215771] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-02. [2025-09-17T21:43:57.981783] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T21:43:58.015675] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-03. [2025-09-17T21:43:58.077898] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T21:43:58.815802] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-07. [2025-09-17T21:43:59.395781] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-03 (1.38 seconds). [2025-09-17T21:43:59.615855] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-04. [2025-09-17T21:44:00.415783] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-03. [2025-09-17T21:44:00.577065] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T21:44:00.837769] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T21:44:01.215788] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-11. [2025-09-17T21:44:02.015828] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-05. [2025-09-17T21:44:02.163585] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T21:44:02.815785] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-04. [2025-09-17T21:44:02.842284] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T21:44:03.615746] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-06. [2025-09-17T21:44:03.787922] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-11 (2.57 seconds). [2025-09-17T21:44:04.260696] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T21:44:04.307614] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-06 (0.69 seconds). [2025-09-17T21:44:04.415815] [INFO ] [REMOTE ] SMR: Fetching primary data for 2024-12. [2025-09-17T21:44:05.215839] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-08. [2025-09-17T21:44:06.015841] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-05. [2025-09-17T21:44:06.815813] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-07. [2025-09-17T21:44:06.997458] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T21:44:07.077781] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2024-12 (2.66 seconds). [2025-09-17T21:44:07.615745] [INFO ] [REMOTE ] SMFG: Fetching primary data for 2025-09. [2025-09-17T21:44:07.702414] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T21:44:07.906182] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T21:44:08.415797] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-08. [2025-09-17T21:44:08.957541] [INFO ] [REMOTE ] SMFG: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T21:44:08.964160] [INFO ] [REMOTE ] SMFG: Full fetch complete (68636 records). [2025-09-17T21:44:08.964366] [DEBUG] [VALIDATOR ] SMFG: Validating primary data. [2025-09-17T21:44:09.228295] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-01. [2025-09-17T21:44:09.365666] [DEBUG] [VALIDATOR ] SMFG: All expected trading days are present. [2025-09-17T21:44:09.365750] [DEBUG] [VALIDATOR ] SMFG: Primary data validation passed. [2025-09-17T21:44:09.366813] [INFO ] [MAIN ] SMFG: Fetched primary data is valid. [2025-09-17T21:44:09.366904] [DEBUG] [LOCAL ] SMFG: Saving primary data. [2025-09-17T21:44:09.368281] [DEBUG] [LOCAL ] SMFG: Trimmed 68636 records to 48191 (keeping 200 days of data) [2025-09-17T21:44:09.604455] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T21:44:09.713858] [DEBUG] [LOCAL ] SMFG: Primary data saved (48191 records). [2025-09-17T21:44:09.714028] [INFO ] [MAIN ] SMFG: Full history saved. [2025-09-17T21:44:09.714119] [INFO ] [MAIN ] Update Progress: 1942/2371 symbols completed. SMFG took 49.8s. Estimated remaining: 1h 2m 46s. Rate: 6.8 symbols/min [2025-09-17T21:44:09.883421] [INFO ] [MAIN ] SMRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:44:09.924036] [DEBUG] [LOCAL ] SMRT: Loaded 44448 existing records from primary storage. [2025-09-17T21:44:09.924193] [INFO ] [MAIN ] SMRT: Loaded 44448 existing records. [2025-09-17T21:44:10.020963] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-06. [2025-09-17T21:44:10.116452] [WARN ] [MAIN ] SMRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:44:10.116709] [INFO ] [MAIN ] SMRT: Wiping existing primary data before full refresh. [2025-09-17T21:44:10.116756] [INFO ] [LOCAL ] SMRT: Starting deletion of primary data. [2025-09-17T21:44:10.117589] [DEBUG] [LOCAL ] SMRT: Deleted primary data file. [2025-09-17T21:44:10.117637] [INFO ] [MAIN ] SMRT: Starting full primary refresh. [2025-09-17T21:44:10.471507] [INFO ] [REMOTE ] SMRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:44:10.815786] [INFO ] [REMOTE ] SMP: Fetching primary data for 2025-09. [2025-09-17T21:44:11.615825] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-11. [2025-09-17T21:44:11.770158] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T21:44:11.938868] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-01 (2.71 seconds). [2025-09-17T21:44:11.939544] [INFO ] [REMOTE ] SMP: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T21:44:11.954044] [INFO ] [REMOTE ] SMP: Full fetch complete (25890 records). [2025-09-17T21:44:11.954210] [DEBUG] [VALIDATOR ] SMP: Validating primary data. [2025-09-17T21:44:12.333683] [DEBUG] [VALIDATOR ] SMP: All expected trading days are present. [2025-09-17T21:44:12.333797] [DEBUG] [VALIDATOR ] SMP: Primary data validation passed. [2025-09-17T21:44:12.334380] [INFO ] [MAIN ] SMP: Fetched primary data is valid. [2025-09-17T21:44:12.334421] [DEBUG] [LOCAL ] SMP: Saving primary data. [2025-09-17T21:44:12.335188] [DEBUG] [LOCAL ] SMP: Trimmed 25890 records to 19979 (keeping 200 days of data) [2025-09-17T21:44:12.425577] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-02. [2025-09-17T21:44:12.462068] [DEBUG] [LOCAL ] SMP: Primary data saved (19979 records). [2025-09-17T21:44:12.462230] [INFO ] [MAIN ] SMP: Full history saved. [2025-09-17T21:44:12.462320] [INFO ] [MAIN ] Update Progress: 1943/2371 symbols completed. SMP took 21.3s. Estimated remaining: 1h 2m 36s. Rate: 6.8 symbols/min [2025-09-17T21:44:12.635468] [INFO ] [MAIN ] SMWB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:44:12.667375] [DEBUG] [LOCAL ] SMWB: Loaded 33445 existing records from primary storage. [2025-09-17T21:44:12.667513] [INFO ] [MAIN ] SMWB: Loaded 33445 existing records. [2025-09-17T21:44:12.848463] [WARN ] [MAIN ] SMWB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:44:12.848814] [INFO ] [MAIN ] SMWB: Wiping existing primary data before full refresh. [2025-09-17T21:44:12.848879] [INFO ] [LOCAL ] SMWB: Starting deletion of primary data. [2025-09-17T21:44:12.858561] [DEBUG] [LOCAL ] SMWB: Deleted primary data file. [2025-09-17T21:44:12.871265] [INFO ] [MAIN ] SMWB: Starting full primary refresh. [2025-09-17T21:44:12.951442] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T21:44:13.223355] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-07. [2025-09-17T21:44:13.244759] [INFO ] [REMOTE ] SMWB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:44:14.015772] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-11. [2025-09-17T21:44:14.580803] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-17T21:44:14.795965] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T21:44:14.815724] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-08. [2025-09-17T21:44:15.363953] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T21:44:15.615812] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-03. [2025-09-17T21:44:15.983852] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T21:44:16.415800] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2024-12. [2025-09-17T21:44:17.215833] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2024-12. [2025-09-17T21:44:17.607830] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T21:44:18.015791] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-01. [2025-09-17T21:44:18.327315] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-17T21:44:18.406334] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T21:44:18.815829] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-01. [2025-09-17T21:44:18.930397] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T21:44:19.615842] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-02. [2025-09-17T21:44:20.022151] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T21:44:20.415891] [INFO ] [REMOTE ] SMG: Fetching primary data for 2025-09. [2025-09-17T21:44:21.079348] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T21:44:21.215817] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-02. [2025-09-17T21:44:21.802340] [INFO ] [REMOTE ] SMG: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T21:44:21.812588] [INFO ] [REMOTE ] SMG: Full fetch complete (62672 records). [2025-09-17T21:44:21.812775] [DEBUG] [VALIDATOR ] SMG: Validating primary data. [2025-09-17T21:44:22.024265] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-04. [2025-09-17T21:44:22.217405] [DEBUG] [VALIDATOR ] SMG: All expected trading days are present. [2025-09-17T21:44:22.217501] [DEBUG] [VALIDATOR ] SMG: Primary data validation passed. [2025-09-17T21:44:22.218509] [INFO ] [MAIN ] SMG: Fetched primary data is valid. [2025-09-17T21:44:22.218562] [DEBUG] [LOCAL ] SMG: Saving primary data. [2025-09-17T21:44:22.220044] [DEBUG] [LOCAL ] SMG: Trimmed 62672 records to 44277 (keeping 200 days of data) [2025-09-17T21:44:22.480051] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-02 (1.26 seconds). [2025-09-17T21:44:22.552269] [DEBUG] [LOCAL ] SMG: Primary data saved (44277 records). [2025-09-17T21:44:22.552431] [INFO ] [MAIN ] SMG: Full history saved. [2025-09-17T21:44:22.554124] [INFO ] [MAIN ] Update Progress: 1944/2371 symbols completed. SMG took 53.0s. Estimated remaining: 1h 2m 27s. Rate: 6.8 symbols/min [2025-09-17T21:44:22.792738] [INFO ] [MAIN ] SN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:44:22.822982] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-03. [2025-09-17T21:44:22.845017] [DEBUG] [LOCAL ] SN: Loaded 49829 existing records from primary storage. [2025-09-17T21:44:22.845266] [INFO ] [MAIN ] SN: Loaded 49829 existing records. [2025-09-17T21:44:23.022347] [WARN ] [MAIN ] SN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:44:23.022567] [INFO ] [MAIN ] SN: Wiping existing primary data before full refresh. [2025-09-17T21:44:23.022611] [INFO ] [LOCAL ] SN: Starting deletion of primary data. [2025-09-17T21:44:23.023573] [DEBUG] [LOCAL ] SN: Deleted primary data file. [2025-09-17T21:44:23.023623] [INFO ] [MAIN ] SN: Starting full primary refresh. [2025-09-17T21:44:23.389373] [INFO ] [REMOTE ] SN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:44:23.615798] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-03. [2025-09-17T21:44:23.806777] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T21:44:24.415782] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-04. [2025-09-17T21:44:24.693203] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-04 (2.67 seconds). [2025-09-17T21:44:24.864923] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T21:44:25.215817] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-05. [2025-09-17T21:44:25.464388] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T21:44:26.015804] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-04. [2025-09-17T21:44:26.815777] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-05. [2025-09-17T21:44:27.246825] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T21:44:27.615808] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-05. [2025-09-17T21:44:27.942518] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-05 (2.73 seconds). [2025-09-17T21:44:28.415835] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-06. [2025-09-17T21:44:28.450984] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-05 (1.64 seconds). [2025-09-17T21:44:28.884768] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T21:44:29.215815] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-06. [2025-09-17T21:44:30.015863] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-06. [2025-09-17T21:44:30.486937] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T21:44:30.815801] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-07. [2025-09-17T21:44:30.890843] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-17T21:44:30.989723] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T21:44:31.615797] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-07. [2025-09-17T21:44:32.415791] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-07. [2025-09-17T21:44:32.583898] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T21:44:32.849782] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T21:44:33.215794] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-08. [2025-09-17T21:44:34.015765] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-08. [2025-09-17T21:44:34.815759] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-11. [2025-09-17T21:44:34.933719] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T21:44:35.205231] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-07 (2.79 seconds). [2025-09-17T21:44:35.441485] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T21:44:35.615770] [INFO ] [REMOTE ] SMWB: Fetching primary data for 2025-09. [2025-09-17T21:44:36.345796] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T21:44:36.415808] [INFO ] [REMOTE ] SN: Fetching primary data for 2024-12. [2025-09-17T21:44:36.481722] [INFO ] [REMOTE ] SMWB: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T21:44:36.486159] [INFO ] [REMOTE ] SMWB: Full fetch complete (50595 records). [2025-09-17T21:44:36.486314] [DEBUG] [VALIDATOR ] SMWB: Validating primary data. [2025-09-17T21:44:36.874067] [DEBUG] [VALIDATOR ] SMWB: All expected trading days are present. [2025-09-17T21:44:36.874155] [DEBUG] [VALIDATOR ] SMWB: Primary data validation passed. [2025-09-17T21:44:36.874969] [INFO ] [MAIN ] SMWB: Fetched primary data is valid. [2025-09-17T21:44:36.875029] [DEBUG] [LOCAL ] SMWB: Saving primary data. [2025-09-17T21:44:36.876926] [DEBUG] [LOCAL ] SMWB: Trimmed 50595 records to 33407 (keeping 200 days of data) [2025-09-17T21:44:37.071800] [DEBUG] [LOCAL ] SMWB: Primary data saved (33407 records). [2025-09-17T21:44:37.071945] [INFO ] [MAIN ] SMWB: Full history saved. [2025-09-17T21:44:37.072052] [INFO ] [MAIN ] Update Progress: 1945/2371 symbols completed. SMWB took 24.6s. Estimated remaining: 1h 2m 20s. Rate: 6.8 symbols/min [2025-09-17T21:44:37.223436] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-08. [2025-09-17T21:44:37.243896] [INFO ] [MAIN ] SNA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:44:37.274335] [DEBUG] [LOCAL ] SNA: Loaded 26389 existing records from primary storage. [2025-09-17T21:44:37.274471] [INFO ] [MAIN ] SNA: Loaded 26389 existing records. [2025-09-17T21:44:37.454155] [WARN ] [MAIN ] SNA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:44:37.454394] [INFO ] [MAIN ] SNA: Wiping existing primary data before full refresh. [2025-09-17T21:44:37.454438] [INFO ] [LOCAL ] SNA: Starting deletion of primary data. [2025-09-17T21:44:37.455033] [DEBUG] [LOCAL ] SNA: Deleted primary data file. [2025-09-17T21:44:37.455080] [INFO ] [MAIN ] SNA: Starting full primary refresh. [2025-09-17T21:44:37.809923] [INFO ] [REMOTE ] SNA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:44:38.015776] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-11. [2025-09-17T21:44:38.115219] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T21:44:38.815785] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-01. [2025-09-17T21:44:39.042728] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T21:44:39.615699] [INFO ] [REMOTE ] SNA: Fetching primary data for 2024-12. [2025-09-17T21:44:39.678269] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-08 (2.45 seconds). [2025-09-17T21:44:40.398028] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T21:44:40.415680] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-02. [2025-09-17T21:44:40.902436] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T21:44:41.215790] [INFO ] [REMOTE ] SMR: Fetching primary data for 2025-09. [2025-09-17T21:44:41.785170] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T21:44:42.015791] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-01. [2025-09-17T21:44:42.815819] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-03. [2025-09-17T21:44:43.396005] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T21:44:43.421791] [INFO ] [REMOTE ] SMR: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-17T21:44:43.428918] [INFO ] [REMOTE ] SMR: Full fetch complete (77974 records). [2025-09-17T21:44:43.429101] [DEBUG] [VALIDATOR ] SMR: Validating primary data. [2025-09-17T21:44:43.624082] [INFO ] [REMOTE ] SMRT: Fetching primary data for 2025-09. [2025-09-17T21:44:43.831504] [DEBUG] [VALIDATOR ] SMR: All expected trading days are present. [2025-09-17T21:44:43.831600] [DEBUG] [VALIDATOR ] SMR: Primary data validation passed. [2025-09-17T21:44:43.832710] [INFO ] [MAIN ] SMR: Fetched primary data is valid. [2025-09-17T21:44:43.832758] [DEBUG] [LOCAL ] SMR: Saving primary data. [2025-09-17T21:44:43.835790] [DEBUG] [LOCAL ] SMR: Trimmed 77974 records to 53797 (keeping 200 days of data) [2025-09-17T21:44:44.159382] [DEBUG] [LOCAL ] SMR: Primary data saved (53797 records). [2025-09-17T21:44:44.159537] [INFO ] [MAIN ] SMR: Full history saved. [2025-09-17T21:44:44.159690] [INFO ] [MAIN ] Update Progress: 1946/2371 symbols completed. SMR took 49.0s. Estimated remaining: 1h 2m 11s. Rate: 6.8 symbols/min [2025-09-17T21:44:44.336922] [INFO ] [MAIN ] SNAP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:44:44.388389] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-17T21:44:44.388564] [INFO ] [MAIN ] SNAP: Loaded 53796 existing records. [2025-09-17T21:44:44.420950] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-02. [2025-09-17T21:44:44.576251] [WARN ] [MAIN ] SNAP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:44:44.576671] [INFO ] [MAIN ] SNAP: Wiping existing primary data before full refresh. [2025-09-17T21:44:44.576835] [INFO ] [LOCAL ] SNAP: Starting deletion of primary data. [2025-09-17T21:44:44.577904] [DEBUG] [LOCAL ] SNAP: Deleted primary data file. [2025-09-17T21:44:44.577963] [INFO ] [MAIN ] SNAP: Starting full primary refresh. [2025-09-17T21:44:44.874489] [INFO ] [REMOTE ] SMRT: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T21:44:44.885424] [INFO ] [REMOTE ] SMRT: Full fetch complete (62256 records). [2025-09-17T21:44:44.945720] [DEBUG] [VALIDATOR ] SMRT: Validating primary data. [2025-09-17T21:44:44.987385] [INFO ] [REMOTE ] SNAP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:44:44.998043] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-03 (2.18 seconds). [2025-09-17T21:44:45.223747] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-04. [2025-09-17T21:44:45.385111] [DEBUG] [VALIDATOR ] SMRT: All expected trading days are present. [2025-09-17T21:44:45.385187] [DEBUG] [VALIDATOR ] SMRT: Primary data validation passed. [2025-09-17T21:44:45.386125] [INFO ] [MAIN ] SMRT: Fetched primary data is valid. [2025-09-17T21:44:45.386170] [DEBUG] [LOCAL ] SMRT: Saving primary data. [2025-09-17T21:44:45.387892] [DEBUG] [LOCAL ] SMRT: Trimmed 62256 records to 44441 (keeping 200 days of data) [2025-09-17T21:44:45.646397] [DEBUG] [LOCAL ] SMRT: Primary data saved (44441 records). [2025-09-17T21:44:45.646538] [INFO ] [MAIN ] SMRT: Full history saved. [2025-09-17T21:44:45.646673] [INFO ] [MAIN ] Update Progress: 1947/2371 symbols completed. SMRT took 35.9s. Estimated remaining: 1h 2m 0s. Rate: 6.8 symbols/min [2025-09-17T21:44:45.823485] [INFO ] [MAIN ] SNDA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:44:45.830001] [DEBUG] [LOCAL ] SNDA: Loaded 4759 existing records from primary storage. [2025-09-17T21:44:45.830122] [INFO ] [MAIN ] SNDA: Loaded 4759 existing records. [2025-09-17T21:44:46.007830] [WARN ] [MAIN ] SNDA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:44:46.008148] [INFO ] [MAIN ] SNDA: Wiping existing primary data before full refresh. [2025-09-17T21:44:46.008233] [INFO ] [LOCAL ] SNDA: Starting deletion of primary data. [2025-09-17T21:44:46.008608] [DEBUG] [LOCAL ] SNDA: Deleted primary data file. [2025-09-17T21:44:46.008722] [INFO ] [MAIN ] SNDA: Starting full primary refresh. [2025-09-17T21:44:46.021460] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-11. [2025-09-17T21:44:46.133993] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-02 (1.71 seconds). [2025-09-17T21:44:46.393434] [INFO ] [REMOTE ] SNDA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:44:46.815822] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-11. [2025-09-17T21:44:47.127680] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T21:44:47.457447] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-11 (0.64 seconds). [2025-09-17T21:44:47.615774] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-03. [2025-09-17T21:44:48.378900] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-11 (2.36 seconds). [2025-09-17T21:44:48.415737] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-05. [2025-09-17T21:44:49.054133] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T21:44:49.215817] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-04. [2025-09-17T21:44:50.015789] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2024-12. [2025-09-17T21:44:50.191231] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T21:44:50.781794] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T21:44:50.815735] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-05. [2025-09-17T21:44:51.615776] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-06. [2025-09-17T21:44:52.082389] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T21:44:52.292545] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-17T21:44:52.415751] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-01. [2025-09-17T21:44:53.215769] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2024-12. [2025-09-17T21:44:53.286744] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T21:44:53.767880] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T21:44:54.015771] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-01. [2025-09-17T21:44:54.429775] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T21:44:54.782429] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T21:44:54.815727] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-02. [2025-09-17T21:44:55.378633] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T21:44:55.615771] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-03. [2025-09-17T21:44:56.048858] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-17T21:44:56.415768] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-02. [2025-09-17T21:44:57.215803] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-06. [2025-09-17T21:44:58.015795] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-07. [2025-09-17T21:44:58.104976] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T21:44:58.671681] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-02 (2.26 seconds). [2025-09-17T21:44:58.815799] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-03. [2025-09-17T21:44:59.615777] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-04. [2025-09-17T21:44:59.728300] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T21:45:00.252038] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-04 (0.64 seconds). [2025-09-17T21:45:00.415803] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-07. [2025-09-17T21:45:00.803286] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T21:45:01.215854] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-05. [2025-09-17T21:45:02.015753] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-04. [2025-09-17T21:45:02.114756] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T21:45:02.172481] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T21:45:02.815832] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-08. [2025-09-17T21:45:03.615823] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-06. [2025-09-17T21:45:04.415828] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-08. [2025-09-17T21:45:04.720450] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T21:45:05.215896] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-07. [2025-09-17T21:45:05.384328] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T21:45:05.637296] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-07 (0.42 seconds). [2025-09-17T21:45:06.015838] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-08. [2025-09-17T21:45:06.054560] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-08 (3.24 seconds). [2025-09-17T21:45:06.231886] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-04 (4.22 seconds). [2025-09-17T21:45:06.423783] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-08 (0.41 seconds). [2025-09-17T21:45:06.815820] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-05. [2025-09-17T21:45:07.615796] [INFO ] [REMOTE ] SN: Fetching primary data for 2025-09. [2025-09-17T21:45:08.415819] [INFO ] [REMOTE ] SNA: Fetching primary data for 2025-09. [2025-09-17T21:45:09.096870] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-05 (2.28 seconds). [2025-09-17T21:45:09.148550] [INFO ] [REMOTE ] SN: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T21:45:09.163413] [INFO ] [REMOTE ] SN: Full fetch complete (70682 records). [2025-09-17T21:45:09.164394] [INFO ] [REMOTE ] SNA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T21:45:09.164486] [DEBUG] [VALIDATOR ] SN: Validating primary data. [2025-09-17T21:45:09.168044] [INFO ] [REMOTE ] SNA: Full fetch complete (39117 records). [2025-09-17T21:45:09.168175] [DEBUG] [VALIDATOR ] SNA: Validating primary data. [2025-09-17T21:45:09.227694] [INFO ] [REMOTE ] SNDA: Fetching primary data for 2025-09. [2025-09-17T21:45:09.940626] [INFO ] [REMOTE ] SNDA: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T21:45:10.014171] [INFO ] [REMOTE ] SNDA: Full fetch complete (8619 records). [2025-09-17T21:45:10.014038] [DEBUG] [VALIDATOR ] SNA: All expected trading days are present. [2025-09-17T21:45:10.030059] [DEBUG] [VALIDATOR ] SNDA: Validating primary data. [2025-09-17T21:45:10.030133] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-06. [2025-09-17T21:45:10.053766] [DEBUG] [VALIDATOR ] SNA: Primary data validation passed. [2025-09-17T21:45:10.070852] [DEBUG] [VALIDATOR ] SN: All expected trading days are present. [2025-09-17T21:45:10.096369] [DEBUG] [VALIDATOR ] SN: Primary data validation passed. [2025-09-17T21:45:10.110440] [INFO ] [MAIN ] SN: Fetched primary data is valid. [2025-09-17T21:45:10.110551] [DEBUG] [LOCAL ] SN: Saving primary data. [2025-09-17T21:45:10.104020] [INFO ] [MAIN ] SNA: Fetched primary data is valid. [2025-09-17T21:45:10.152790] [DEBUG] [LOCAL ] SNA: Saving primary data. [2025-09-17T21:45:10.181149] [DEBUG] [LOCAL ] SN: Trimmed 70682 records to 49857 (keeping 200 days of data) [2025-09-17T21:45:10.283142] [DEBUG] [LOCAL ] SNA: Trimmed 39117 records to 26421 (keeping 200 days of data) [2025-09-17T21:45:10.627362] [DEBUG] [VALIDATOR ] SNDA: All expected trading days are present. [2025-09-17T21:45:10.628004] [DEBUG] [VALIDATOR ] SNDA: Primary data validation passed. [2025-09-17T21:45:10.628509] [INFO ] [MAIN ] SNDA: Fetched primary data is valid. [2025-09-17T21:45:10.629159] [DEBUG] [LOCAL ] SNDA: Saving primary data. [2025-09-17T21:45:10.631996] [DEBUG] [LOCAL ] SNDA: Trimmed 8619 records to 4753 (keeping 200 days of data) [2025-09-17T21:45:10.683003] [DEBUG] [LOCAL ] SNDA: Primary data saved (4753 records). [2025-09-17T21:45:10.687369] [INFO ] [MAIN ] SNDA: Full history saved. [2025-09-17T21:45:10.688448] [INFO ] [MAIN ] Update Progress: 1948/2371 symbols completed. SNDA took 25.0s. Estimated remaining: 1h 1m 55s. Rate: 6.8 symbols/min [2025-09-17T21:45:10.965627] [INFO ] [MAIN ] SNDR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:45:11.044577] [DEBUG] [LOCAL ] SNDR: Loaded 40411 existing records from primary storage. [2025-09-17T21:45:11.048872] [INFO ] [MAIN ] SNDR: Loaded 40411 existing records. [2025-09-17T21:45:11.303634] [WARN ] [MAIN ] SNDR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:45:11.306146] [INFO ] [MAIN ] SNDR: Wiping existing primary data before full refresh. [2025-09-17T21:45:11.306487] [INFO ] [LOCAL ] SNDR: Starting deletion of primary data. [2025-09-17T21:45:11.308213] [DEBUG] [LOCAL ] SNDR: Deleted primary data file. [2025-09-17T21:45:11.309320] [INFO ] [MAIN ] SNDR: Starting full primary refresh. [2025-09-17T21:45:11.349224] [DEBUG] [LOCAL ] SNA: Primary data saved (26421 records). [2025-09-17T21:45:11.357188] [INFO ] [MAIN ] SNA: Full history saved. [2025-09-17T21:45:11.357684] [INFO ] [MAIN ] Update Progress: 1949/2371 symbols completed. SNA took 34.3s. Estimated remaining: 1h 1m 45s. Rate: 6.8 symbols/min [2025-09-17T21:45:11.714129] [INFO ] [MAIN ] SNN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:45:11.806659] [DEBUG] [LOCAL ] SN: Primary data saved (49857 records). [2025-09-17T21:45:11.817057] [INFO ] [MAIN ] SN: Full history saved. [2025-09-17T21:45:11.835949] [INFO ] [MAIN ] Update Progress: 1950/2371 symbols completed. SN took 49.3s. Estimated remaining: 1h 1m 34s. Rate: 6.8 symbols/min [2025-09-17T21:45:11.886048] [INFO ] [REMOTE ] SNDR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:45:11.912278] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-11. [2025-09-17T21:45:12.054476] [DEBUG] [LOCAL ] SNN: Loaded 44398 existing records from primary storage. [2025-09-17T21:45:12.078298] [INFO ] [MAIN ] SNOW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:45:12.078359] [INFO ] [MAIN ] SNN: Loaded 44398 existing records. [2025-09-17T21:45:12.261446] [WARN ] [MAIN ] SNN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:45:12.262371] [INFO ] [MAIN ] SNN: Wiping existing primary data before full refresh. [2025-09-17T21:45:12.262575] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-17T21:45:12.277318] [DEBUG] [LOCAL ] SNN: Deleted primary data file. [2025-09-17T21:45:12.297009] [INFO ] [MAIN ] SNN: Starting full primary refresh. [2025-09-17T21:45:12.332231] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-06 (2.30 seconds). [2025-09-17T21:45:12.427276] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-07. [2025-09-17T21:45:12.500058] [DEBUG] [LOCAL ] SNOW: Loaded 53570 existing records from primary storage. [2025-09-17T21:45:12.508585] [INFO ] [MAIN ] SNOW: Loaded 53570 existing records. [2025-09-17T21:45:12.904312] [INFO ] [REMOTE ] SNN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:45:12.904472] [WARN ] [MAIN ] SNOW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:45:12.904903] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-11. [2025-09-17T21:45:12.905093] [INFO ] [MAIN ] SNOW: Wiping existing primary data before full refresh. [2025-09-17T21:45:12.905984] [INFO ] [LOCAL ] SNOW: Starting deletion of primary data. [2025-09-17T21:45:12.906883] [DEBUG] [LOCAL ] SNOW: Deleted primary data file. [2025-09-17T21:45:12.906937] [INFO ] [MAIN ] SNOW: Starting full primary refresh. [2025-09-17T21:45:13.272046] [INFO ] [REMOTE ] SNOW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:45:13.272442] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-11. [2025-09-17T21:45:13.302851] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T21:45:14.015807] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2024-12. [2025-09-17T21:45:14.258602] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T21:45:14.815748] [INFO ] [REMOTE ] SNN: Fetching primary data for 2024-12. [2025-09-17T21:45:15.251771] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-07 (2.82 seconds). [2025-09-17T21:45:15.615840] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-08. [2025-09-17T21:45:16.446357] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-11 (3.17 seconds). [2025-09-17T21:45:16.457538] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2024-12. [2025-09-17T21:45:16.482543] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2024-12 (2.47 seconds). [2025-09-17T21:45:17.109773] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-17T21:45:17.215820] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-01. [2025-09-17T21:45:18.015796] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-01. [2025-09-17T21:45:18.763695] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-17T21:45:18.797679] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T21:45:18.815720] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-02. [2025-09-17T21:45:19.059412] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-08 (3.44 seconds). [2025-09-17T21:45:19.185376] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T21:45:19.615817] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-01. [2025-09-17T21:45:19.891381] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T21:45:20.415783] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-02. [2025-09-17T21:45:21.215797] [INFO ] [REMOTE ] SNAP: Fetching primary data for 2025-09. [2025-09-17T21:45:21.576967] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T21:45:21.921328] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T21:45:22.015754] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-03. [2025-09-17T21:45:22.815840] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-02. [2025-09-17T21:45:23.260587] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T21:45:23.553517] [INFO ] [REMOTE ] SNAP: Incremental fetch complete for 2025-09 (2.34 seconds). [2025-09-17T21:45:23.560568] [INFO ] [REMOTE ] SNAP: Full fetch complete (77895 records). [2025-09-17T21:45:23.560725] [DEBUG] [VALIDATOR ] SNAP: Validating primary data. [2025-09-17T21:45:23.624268] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-04. [2025-09-17T21:45:23.959808] [DEBUG] [VALIDATOR ] SNAP: All expected trading days are present. [2025-09-17T21:45:23.959905] [DEBUG] [VALIDATOR ] SNAP: Primary data validation passed. [2025-09-17T21:45:23.960981] [INFO ] [MAIN ] SNAP: Fetched primary data is valid. [2025-09-17T21:45:23.961034] [DEBUG] [LOCAL ] SNAP: Saving primary data. [2025-09-17T21:45:23.962628] [DEBUG] [LOCAL ] SNAP: Trimmed 77895 records to 53796 (keeping 200 days of data) [2025-09-17T21:45:24.278435] [DEBUG] [LOCAL ] SNAP: Primary data saved (53796 records). [2025-09-17T21:45:24.278582] [INFO ] [MAIN ] SNAP: Full history saved. [2025-09-17T21:45:24.278686] [INFO ] [MAIN ] Update Progress: 1951/2371 symbols completed. SNAP took 40.1s. Estimated remaining: 1h 1m 26s. Rate: 6.8 symbols/min [2025-09-17T21:45:24.423330] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-03. [2025-09-17T21:45:24.458042] [INFO ] [MAIN ] SNV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:45:24.503446] [DEBUG] [LOCAL ] SNV: Loaded 48938 existing records from primary storage. [2025-09-17T21:45:24.503598] [INFO ] [MAIN ] SNV: Loaded 48938 existing records. [2025-09-17T21:45:24.695630] [WARN ] [MAIN ] SNV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:45:24.695904] [INFO ] [MAIN ] SNV: Wiping existing primary data before full refresh. [2025-09-17T21:45:24.695952] [INFO ] [LOCAL ] SNV: Starting deletion of primary data. [2025-09-17T21:45:24.696856] [DEBUG] [LOCAL ] SNV: Deleted primary data file. [2025-09-17T21:45:24.696907] [INFO ] [MAIN ] SNV: Starting full primary refresh. [2025-09-17T21:45:25.068429] [INFO ] [REMOTE ] SNV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:45:25.124838] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-17T21:45:25.215733] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-03. [2025-09-17T21:45:25.290195] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T21:45:25.927624] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T21:45:26.015734] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-04. [2025-09-17T21:45:26.815773] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-11. [2025-09-17T21:45:27.418929] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-03 (2.20 seconds). [2025-09-17T21:45:27.615783] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-05. [2025-09-17T21:45:28.415784] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-04. [2025-09-17T21:45:28.721879] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-04 (2.71 seconds). [2025-09-17T21:45:29.215824] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-05. [2025-09-17T21:45:29.577579] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-11 (2.76 seconds). [2025-09-17T21:45:29.662078] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T21:45:30.015787] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-06. [2025-09-17T21:45:30.625843] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T21:45:30.779170] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-17T21:45:30.815767] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-05. [2025-09-17T21:45:31.553812] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T21:45:31.615804] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-06. [2025-09-17T21:45:32.415819] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-07. [2025-09-17T21:45:32.520863] [DEBUG] [REMOTE ] SNN: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-17T21:45:32.521210] [WARN ] [REMOTE ] SNN: No data returned for month 2025-07 [2025-09-17T21:45:32.748454] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T21:45:32.943689] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-05 (2.13 seconds). [2025-09-17T21:45:33.215799] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-07. [2025-09-17T21:45:34.015790] [INFO ] [REMOTE ] SNV: Fetching primary data for 2024-12. [2025-09-17T21:45:34.404907] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-07 (1.19 seconds). [2025-09-17T21:45:34.815783] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-08. [2025-09-17T21:45:35.377931] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T21:45:35.615754] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-06. [2025-09-17T21:45:36.415743] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-01. [2025-09-17T21:45:36.447048] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T21:45:37.215812] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-08. [2025-09-17T21:45:37.789674] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T21:45:37.960704] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-17T21:45:38.015742] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-07. [2025-09-17T21:45:38.688730] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T21:45:38.815836] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-02. [2025-09-17T21:45:39.615853] [INFO ] [REMOTE ] SNDR: Fetching primary data for 2025-09. [2025-09-17T21:45:40.362547] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T21:45:40.406630] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-17T21:45:40.417790] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-03. [2025-09-17T21:45:40.619604] [INFO ] [REMOTE ] SNDR: Incremental fetch complete for 2025-09 (1.00 seconds). [2025-09-17T21:45:40.624822] [INFO ] [REMOTE ] SNDR: Full fetch complete (58760 records). [2025-09-17T21:45:40.624921] [DEBUG] [VALIDATOR ] SNDR: Validating primary data. [2025-09-17T21:45:41.021783] [DEBUG] [VALIDATOR ] SNDR: All expected trading days are present. [2025-09-17T21:45:41.021895] [DEBUG] [VALIDATOR ] SNDR: Primary data validation passed. [2025-09-17T21:45:41.022830] [INFO ] [MAIN ] SNDR: Fetched primary data is valid. [2025-09-17T21:45:41.022875] [DEBUG] [LOCAL ] SNDR: Saving primary data. [2025-09-17T21:45:41.024459] [DEBUG] [LOCAL ] SNDR: Trimmed 58760 records to 40444 (keeping 200 days of data) [2025-09-17T21:45:41.224238] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-08. [2025-09-17T21:45:41.288668] [DEBUG] [LOCAL ] SNDR: Primary data saved (40444 records). [2025-09-17T21:45:41.288823] [INFO ] [MAIN ] SNDR: Full history saved. [2025-09-17T21:45:41.288927] [INFO ] [MAIN ] Update Progress: 1952/2371 symbols completed. SNDR took 30.6s. Estimated remaining: 1h 1m 19s. Rate: 6.8 symbols/min [2025-09-17T21:45:41.475532] [INFO ] [MAIN ] SNX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:45:41.520416] [DEBUG] [LOCAL ] SNX: Loaded 39615 existing records from primary storage. [2025-09-17T21:45:41.520560] [INFO ] [MAIN ] SNX: Loaded 39615 existing records. [2025-09-17T21:45:41.700483] [WARN ] [MAIN ] SNX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:45:41.700731] [INFO ] [MAIN ] SNX: Wiping existing primary data before full refresh. [2025-09-17T21:45:41.700778] [INFO ] [LOCAL ] SNX: Starting deletion of primary data. [2025-09-17T21:45:41.701560] [DEBUG] [LOCAL ] SNX: Deleted primary data file. [2025-09-17T21:45:41.701606] [INFO ] [MAIN ] SNX: Starting full primary refresh. [2025-09-17T21:45:42.016188] [INFO ] [REMOTE ] SNN: Fetching primary data for 2025-09. [2025-09-17T21:45:42.071653] [INFO ] [REMOTE ] SNX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:45:42.105560] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-03 (1.69 seconds). [2025-09-17T21:45:42.815784] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-04. [2025-09-17T21:45:43.233871] [INFO ] [REMOTE ] SNN: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T21:45:43.239765] [INFO ] [REMOTE ] SNN: Full fetch complete (55442 records). [2025-09-17T21:45:43.239910] [DEBUG] [VALIDATOR ] SNN: Validating primary data. [2025-09-17T21:45:43.375193] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-17T21:45:43.476999] [WARN ] [VALIDATOR ] SNN: Validation failed - insufficient historical data. Have 178 unique days, need 200 days [2025-09-17T21:45:43.477603] [FATAL] [MAIN ] SNN: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:45:43.477692] [WARN ] [MAIN ] SNN: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:45:43.477762] [INFO ] [LOCAL ] SNN: Starting deletion of primary data. [2025-09-17T21:45:43.477829] [DEBUG] [LOCAL ] SNN: No primary data file found to delete. [2025-09-17T21:45:43.477863] [INFO ] [LOCAL ] SNN: Starting deletion of derivative data. [2025-09-17T21:45:43.478182] [DEBUG] [LOCAL ] SNN: Deleted derivative data file. [2025-09-17T21:45:43.478262] [INFO ] [MAIN ] Update Progress: 1953/2371 symbols completed. SNN took 32.1s. Estimated remaining: 1h 1m 9s. Rate: 6.8 symbols/min [2025-09-17T21:45:43.620107] [INFO ] [REMOTE ] SNOW: Fetching primary data for 2025-09. [2025-09-17T21:45:43.651438] [INFO ] [MAIN ] SO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:45:43.704150] [DEBUG] [LOCAL ] SO: Loaded 53602 existing records from primary storage. [2025-09-17T21:45:43.704292] [INFO ] [MAIN ] SO: Loaded 53602 existing records. [2025-09-17T21:45:43.889555] [WARN ] [MAIN ] SO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:45:43.889837] [INFO ] [MAIN ] SO: Wiping existing primary data before full refresh. [2025-09-17T21:45:43.889887] [INFO ] [LOCAL ] SO: Starting deletion of primary data. [2025-09-17T21:45:43.890847] [DEBUG] [LOCAL ] SO: Deleted primary data file. [2025-09-17T21:45:43.890899] [INFO ] [MAIN ] SO: Starting full primary refresh. [2025-09-17T21:45:44.246236] [INFO ] [REMOTE ] SO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:45:44.415754] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-11. [2025-09-17T21:45:44.606954] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T21:45:45.215819] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-05. [2025-09-17T21:45:45.527053] [INFO ] [REMOTE ] SNOW: Incremental fetch complete for 2025-09 (1.91 seconds). [2025-09-17T21:45:45.533895] [INFO ] [REMOTE ] SNOW: Full fetch complete (77615 records). [2025-09-17T21:45:45.534013] [DEBUG] [VALIDATOR ] SNOW: Validating primary data. [2025-09-17T21:45:45.934745] [DEBUG] [VALIDATOR ] SNOW: All expected trading days are present. [2025-09-17T21:45:45.934939] [DEBUG] [VALIDATOR ] SNOW: Primary data validation passed. [2025-09-17T21:45:45.936121] [INFO ] [MAIN ] SNOW: Fetched primary data is valid. [2025-09-17T21:45:45.936227] [DEBUG] [LOCAL ] SNOW: Saving primary data. [2025-09-17T21:45:45.939983] [DEBUG] [LOCAL ] SNOW: Trimmed 77615 records to 53569 (keeping 200 days of data) [2025-09-17T21:45:46.033562] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-11. [2025-09-17T21:45:46.073149] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T21:45:46.317014] [DEBUG] [LOCAL ] SNOW: Primary data saved (53569 records). [2025-09-17T21:45:46.317161] [INFO ] [MAIN ] SNOW: Full history saved. [2025-09-17T21:45:46.317245] [INFO ] [MAIN ] Update Progress: 1954/2371 symbols completed. SNOW took 34.4s. Estimated remaining: 1h 0m 59s. Rate: 6.8 symbols/min [2025-09-17T21:45:46.487077] [INFO ] [MAIN ] SOBO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:45:46.523698] [DEBUG] [LOCAL ] SOBO: Loaded 40151 existing records from primary storage. [2025-09-17T21:45:46.523855] [INFO ] [MAIN ] SOBO: Loaded 40151 existing records. [2025-09-17T21:45:46.710875] [WARN ] [MAIN ] SOBO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:45:46.711483] [INFO ] [MAIN ] SOBO: Wiping existing primary data before full refresh. [2025-09-17T21:45:46.711590] [INFO ] [LOCAL ] SOBO: Starting deletion of primary data. [2025-09-17T21:45:46.712388] [DEBUG] [LOCAL ] SOBO: Deleted primary data file. [2025-09-17T21:45:46.712440] [INFO ] [MAIN ] SOBO: Starting full primary refresh. [2025-09-17T21:45:46.815975] [INFO ] [REMOTE ] SO: Fetching primary data for 2024-12. [2025-09-17T21:45:47.107434] [INFO ] [REMOTE ] SOBO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:45:47.109495] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T21:45:47.434464] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T21:45:47.615761] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-06. [2025-09-17T21:45:48.363489] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T21:45:48.415723] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-01. [2025-09-17T21:45:49.212667] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T21:45:49.216035] [INFO ] [REMOTE ] SNX: Fetching primary data for 2024-12. [2025-09-17T21:45:49.776897] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T21:45:50.015792] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-11. [2025-09-17T21:45:50.742718] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T21:45:50.815741] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-07. [2025-09-17T21:45:51.190040] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T21:45:51.615811] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2024-12. [2025-09-17T21:45:52.247850] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T21:45:52.415813] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-08. [2025-09-17T21:45:53.034384] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T21:45:53.215753] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-01. [2025-09-17T21:45:54.015775] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-02. [2025-09-17T21:45:54.133691] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T21:45:54.264332] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-01 (1.05 seconds). [2025-09-17T21:45:54.815773] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-02. [2025-09-17T21:45:55.615840] [INFO ] [REMOTE ] SNV: Fetching primary data for 2025-09. [2025-09-17T21:45:55.797060] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T21:45:55.851661] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T21:45:56.415772] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-03. [2025-09-17T21:45:56.849873] [INFO ] [REMOTE ] SNV: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T21:45:56.857179] [INFO ] [REMOTE ] SNV: Full fetch complete (70895 records). [2025-09-17T21:45:56.857382] [DEBUG] [VALIDATOR ] SNV: Validating primary data. [2025-09-17T21:45:57.221078] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-03. [2025-09-17T21:45:57.265063] [DEBUG] [VALIDATOR ] SNV: All expected trading days are present. [2025-09-17T21:45:57.265194] [DEBUG] [VALIDATOR ] SNV: Primary data validation passed. [2025-09-17T21:45:57.266843] [INFO ] [MAIN ] SNV: Fetched primary data is valid. [2025-09-17T21:45:57.266938] [DEBUG] [LOCAL ] SNV: Saving primary data. [2025-09-17T21:45:57.268619] [DEBUG] [LOCAL ] SNV: Trimmed 70895 records to 48944 (keeping 200 days of data) [2025-09-17T21:45:57.580194] [DEBUG] [LOCAL ] SNV: Primary data saved (48944 records). [2025-09-17T21:45:57.580333] [INFO ] [MAIN ] SNV: Full history saved. [2025-09-17T21:45:57.580434] [INFO ] [MAIN ] Update Progress: 1955/2371 symbols completed. SNV took 33.3s. Estimated remaining: 1h 0m 51s. Rate: 6.8 symbols/min [2025-09-17T21:45:57.751360] [INFO ] [MAIN ] SOC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:45:57.783736] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T21:45:57.836513] [DEBUG] [LOCAL ] SOC: Loaded 50117 existing records from primary storage. [2025-09-17T21:45:57.836715] [INFO ] [MAIN ] SOC: Loaded 50117 existing records. [2025-09-17T21:45:58.018403] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-04. [2025-09-17T21:45:58.018569] [WARN ] [MAIN ] SOC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:45:58.019107] [INFO ] [MAIN ] SOC: Wiping existing primary data before full refresh. [2025-09-17T21:45:58.019870] [INFO ] [LOCAL ] SOC: Starting deletion of primary data. [2025-09-17T21:45:58.020816] [DEBUG] [LOCAL ] SOC: Deleted primary data file. [2025-09-17T21:45:58.020871] [INFO ] [MAIN ] SOC: Starting full primary refresh. [2025-09-17T21:45:58.384010] [INFO ] [REMOTE ] SOC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:45:58.815848] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-11. [2025-09-17T21:45:59.287560] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-17T21:45:59.616699] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T21:45:59.615811] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-04. [2025-09-17T21:46:00.073762] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-11 (1.26 seconds). [2025-09-17T21:46:00.415779] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-01. [2025-09-17T21:46:01.218117] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-05. [2025-09-17T21:46:01.223135] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T21:46:01.719242] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T21:46:02.015804] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-05. [2025-09-17T21:46:02.723014] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T21:46:02.815759] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-06. [2025-09-17T21:46:03.574206] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T21:46:03.615739] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-06. [2025-09-17T21:46:04.369491] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T21:46:04.415780] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-07. [2025-09-17T21:46:05.215773] [INFO ] [REMOTE ] SOC: Fetching primary data for 2024-12. [2025-09-17T21:46:05.314618] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T21:46:05.441767] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T21:46:06.015790] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-02. [2025-09-17T21:46:06.815793] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-08. [2025-09-17T21:46:06.940708] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T21:46:07.615845] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-01. [2025-09-17T21:46:07.783172] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T21:46:07.911418] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T21:46:08.415814] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-03. [2025-09-17T21:46:08.916013] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-01 (1.30 seconds). [2025-09-17T21:46:09.215822] [INFO ] [REMOTE ] SOBO: Fetching primary data for 2025-09. [2025-09-17T21:46:10.015804] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-07. [2025-09-17T21:46:10.213306] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T21:46:10.571306] [INFO ] [REMOTE ] SOBO: Incremental fetch complete for 2025-09 (1.36 seconds). [2025-09-17T21:46:10.576491] [INFO ] [REMOTE ] SOBO: Full fetch complete (58720 records). [2025-09-17T21:46:10.576602] [DEBUG] [VALIDATOR ] SOBO: Validating primary data. [2025-09-17T21:46:10.825712] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-02. [2025-09-17T21:46:10.970816] [DEBUG] [VALIDATOR ] SOBO: All expected trading days are present. [2025-09-17T21:46:10.970903] [DEBUG] [VALIDATOR ] SOBO: Primary data validation passed. [2025-09-17T21:46:10.971809] [INFO ] [MAIN ] SOBO: Fetched primary data is valid. [2025-09-17T21:46:10.971873] [DEBUG] [LOCAL ] SOBO: Saving primary data. [2025-09-17T21:46:10.974220] [DEBUG] [LOCAL ] SOBO: Trimmed 58720 records to 40075 (keeping 200 days of data) [2025-09-17T21:46:11.216507] [DEBUG] [LOCAL ] SOBO: Primary data saved (40075 records). [2025-09-17T21:46:11.216777] [INFO ] [MAIN ] SOBO: Full history saved. [2025-09-17T21:46:11.217375] [INFO ] [MAIN ] Update Progress: 1956/2371 symbols completed. SOBO took 24.9s. Estimated remaining: 1h 0m 43s. Rate: 6.8 symbols/min [2025-09-17T21:46:11.399402] [INFO ] [MAIN ] SOJC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:46:11.407747] [DEBUG] [LOCAL ] SOJC: Loaded 5175 existing records from primary storage. [2025-09-17T21:46:11.407879] [INFO ] [MAIN ] SOJC: Loaded 5175 existing records. [2025-09-17T21:46:11.585062] [WARN ] [MAIN ] SOJC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:46:11.585477] [INFO ] [MAIN ] SOJC: Wiping existing primary data before full refresh. [2025-09-17T21:46:11.585615] [INFO ] [LOCAL ] SOJC: Starting deletion of primary data. [2025-09-17T21:46:11.585997] [DEBUG] [LOCAL ] SOJC: Deleted primary data file. [2025-09-17T21:46:11.586122] [INFO ] [MAIN ] SOJC: Starting full primary refresh. [2025-09-17T21:46:11.617703] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-04. [2025-09-17T21:46:11.977313] [INFO ] [REMOTE ] SOJC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:46:12.010539] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T21:46:12.415775] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-08. [2025-09-17T21:46:12.488857] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T21:46:13.033186] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T21:46:13.215815] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-11. [2025-09-17T21:46:13.724305] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T21:46:13.923782] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T21:46:14.015755] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2024-12. [2025-09-17T21:46:14.815814] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-05. [2025-09-17T21:46:14.885208] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T21:46:15.615790] [INFO ] [REMOTE ] SO: Fetching primary data for 2025-09. [2025-09-17T21:46:15.887261] [INFO ] [REMOTE ] SO: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-17T21:46:15.894234] [INFO ] [REMOTE ] SO: Full fetch complete (77425 records). [2025-09-17T21:46:15.894439] [DEBUG] [VALIDATOR ] SO: Validating primary data. [2025-09-17T21:46:16.293171] [DEBUG] [VALIDATOR ] SO: All expected trading days are present. [2025-09-17T21:46:16.293290] [DEBUG] [VALIDATOR ] SO: Primary data validation passed. [2025-09-17T21:46:16.294416] [INFO ] [MAIN ] SO: Fetched primary data is valid. [2025-09-17T21:46:16.294477] [DEBUG] [LOCAL ] SO: Saving primary data. [2025-09-17T21:46:16.296167] [DEBUG] [LOCAL ] SO: Trimmed 77425 records to 53603 (keeping 200 days of data) [2025-09-17T21:46:16.412819] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T21:46:16.417444] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-03. [2025-09-17T21:46:16.666495] [DEBUG] [LOCAL ] SO: Primary data saved (53603 records). [2025-09-17T21:46:16.666653] [INFO ] [MAIN ] SO: Full history saved. [2025-09-17T21:46:16.666757] [INFO ] [MAIN ] Update Progress: 1957/2371 symbols completed. SO took 33.2s. Estimated remaining: 1h 0m 33s. Rate: 6.8 symbols/min [2025-09-17T21:46:17.215862] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-06. [2025-09-17T21:46:18.015802] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-01. [2025-09-17T21:46:18.089974] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T21:46:18.714838] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T21:46:18.815739] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-07. [2025-09-17T21:46:18.852609] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T21:46:19.615835] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-02. [2025-09-17T21:46:19.859065] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-07 (1.04 seconds). [2025-09-17T21:46:20.236241] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T21:46:20.415796] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-08. [2025-09-17T21:46:21.215840] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-04. [2025-09-17T21:46:21.397031] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-08 (0.98 seconds). [2025-09-17T21:46:22.015819] [INFO ] [REMOTE ] SNX: Fetching primary data for 2025-09. [2025-09-17T21:46:22.647105] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T21:46:22.815780] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-05. [2025-09-17T21:46:23.035502] [INFO ] [REMOTE ] SNX: Incremental fetch complete for 2025-09 (1.02 seconds). [2025-09-17T21:46:23.040453] [INFO ] [REMOTE ] SNX: Full fetch complete (56063 records). [2025-09-17T21:46:23.040547] [DEBUG] [VALIDATOR ] SNX: Validating primary data. [2025-09-17T21:46:23.420904] [DEBUG] [VALIDATOR ] SNX: All expected trading days are present. [2025-09-17T21:46:23.420984] [DEBUG] [VALIDATOR ] SNX: Primary data validation passed. [2025-09-17T21:46:23.421857] [INFO ] [MAIN ] SNX: Fetched primary data is valid. [2025-09-17T21:46:23.421900] [DEBUG] [LOCAL ] SNX: Saving primary data. [2025-09-17T21:46:23.423100] [DEBUG] [LOCAL ] SNX: Trimmed 56063 records to 39572 (keeping 200 days of data) [2025-09-17T21:46:23.636520] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-03. [2025-09-17T21:46:23.674335] [DEBUG] [LOCAL ] SNX: Primary data saved (39572 records). [2025-09-17T21:46:23.674494] [INFO ] [MAIN ] SNX: Full history saved. [2025-09-17T21:46:23.674584] [INFO ] [MAIN ] Update Progress: 1958/2371 symbols completed. SNX took 42.4s. Estimated remaining: 1h 0m 24s. Rate: 6.8 symbols/min [2025-09-17T21:46:24.237370] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T21:46:24.391010] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T21:46:24.415732] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-06. [2025-09-17T21:46:25.215778] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-04. [2025-09-17T21:46:26.090334] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T21:46:26.101049] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-07. [2025-09-17T21:46:26.126223] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-04 (0.91 seconds). [2025-09-17T21:46:26.815782] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-05. [2025-09-17T21:46:27.199663] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T21:46:27.615826] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-06. [2025-09-17T21:46:27.968771] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T21:46:28.209406] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T21:46:28.415810] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-07. [2025-09-17T21:46:29.215821] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-08. [2025-09-17T21:46:29.279557] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T21:46:30.015824] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-08. [2025-09-17T21:46:30.443218] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T21:46:30.815767] [INFO ] [REMOTE ] SOJC: Fetching primary data for 2025-09. [2025-09-17T21:46:31.178494] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-08 (1.96 seconds). [2025-09-17T21:46:31.425481] [INFO ] [REMOTE ] SOJC: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T21:46:31.426843] [INFO ] [REMOTE ] SOJC: Full fetch complete (8218 records). [2025-09-17T21:46:31.426913] [DEBUG] [VALIDATOR ] SOJC: Validating primary data. [2025-09-17T21:46:31.628086] [INFO ] [REMOTE ] SOC: Fetching primary data for 2025-09. [2025-09-17T21:46:31.828229] [DEBUG] [VALIDATOR ] SOJC: All expected trading days are present. [2025-09-17T21:46:31.828307] [DEBUG] [VALIDATOR ] SOJC: Primary data validation passed. [2025-09-17T21:46:31.828536] [INFO ] [MAIN ] SOJC: Fetched primary data is valid. [2025-09-17T21:46:31.828578] [DEBUG] [LOCAL ] SOJC: Saving primary data. [2025-09-17T21:46:31.829004] [DEBUG] [LOCAL ] SOJC: Trimmed 8218 records to 5162 (keeping 200 days of data) [2025-09-17T21:46:31.861356] [DEBUG] [LOCAL ] SOJC: Primary data saved (5162 records). [2025-09-17T21:46:31.861433] [INFO ] [MAIN ] SOJC: Full history saved. [2025-09-17T21:46:31.861507] [INFO ] [MAIN ] Update Progress: 1959/2371 symbols completed. SOJC took 20.6s. Estimated remaining: 1h 0m 15s. Rate: 6.8 symbols/min [2025-09-17T21:46:33.473276] [INFO ] [REMOTE ] SOC: Incremental fetch complete for 2025-09 (1.85 seconds). [2025-09-17T21:46:33.480381] [INFO ] [REMOTE ] SOC: Full fetch complete (70962 records). [2025-09-17T21:46:33.480522] [DEBUG] [VALIDATOR ] SOC: Validating primary data. [2025-09-17T21:46:33.876184] [DEBUG] [VALIDATOR ] SOC: All expected trading days are present. [2025-09-17T21:46:33.876267] [DEBUG] [VALIDATOR ] SOC: Primary data validation passed. [2025-09-17T21:46:33.877259] [INFO ] [MAIN ] SOC: Fetched primary data is valid. [2025-09-17T21:46:33.877304] [DEBUG] [LOCAL ] SOC: Saving primary data. [2025-09-17T21:46:33.878659] [DEBUG] [LOCAL ] SOC: Trimmed 70962 records to 50212 (keeping 200 days of data) [2025-09-17T21:46:34.180135] [DEBUG] [LOCAL ] SOC: Primary data saved (50212 records). [2025-09-17T21:46:34.180276] [INFO ] [MAIN ] SOC: Full history saved. [2025-09-17T21:46:34.180364] [INFO ] [MAIN ] Update Progress: 1960/2371 symbols completed. SOC took 36.6s. Estimated remaining: 1h 0m 5s. Rate: 6.8 symbols/min [2025-09-17T21:46:34.803067] [INFO ] [MAIN ] SOL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:46:34.839104] [INFO ] [MAIN ] SOJD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:46:34.859328] [INFO ] [MAIN ] SOJE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:46:34.876367] [INFO ] [MAIN ] SOJF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:46:34.876990] [DEBUG] [LOCAL ] SOJF: No existing data file found in primary storage. [2025-09-17T21:46:34.877211] [WARN ] [MAIN ] SOJF: No existing data found, performing full refresh instead. [2025-09-17T21:46:34.877379] [INFO ] [MAIN ] SOJF: Wiping existing primary data before full refresh. [2025-09-17T21:46:34.878242] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-17T21:46:34.878403] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-17T21:46:34.878444] [INFO ] [MAIN ] SOJF: Starting full primary refresh. [2025-09-17T21:46:35.010757] [DEBUG] [LOCAL ] SOJE: Loaded 9503 existing records from primary storage. [2025-09-17T21:46:35.011158] [DEBUG] [LOCAL ] SOJD: Loaded 12980 existing records from primary storage. [2025-09-17T21:46:35.011398] [INFO ] [MAIN ] SOJE: Loaded 9503 existing records. [2025-09-17T21:46:35.011350] [INFO ] [MAIN ] SOJD: Loaded 12980 existing records. [2025-09-17T21:46:35.011702] [DEBUG] [LOCAL ] SOL: Loaded 13753 existing records from primary storage. [2025-09-17T21:46:35.017219] [INFO ] [MAIN ] SOL: Loaded 13753 existing records. [2025-09-17T21:46:35.682456] [WARN ] [MAIN ] SOJE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:46:35.737499] [INFO ] [MAIN ] SOJE: Wiping existing primary data before full refresh. [2025-09-17T21:46:35.769966] [INFO ] [LOCAL ] SOJE: Starting deletion of primary data. [2025-09-17T21:46:35.769823] [WARN ] [MAIN ] SOL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:46:35.764567] [WARN ] [MAIN ] SOJD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:46:35.794097] [INFO ] [MAIN ] SOL: Wiping existing primary data before full refresh. [2025-09-17T21:46:35.804065] [DEBUG] [LOCAL ] SOJE: Deleted primary data file. [2025-09-17T21:46:35.794209] [INFO ] [MAIN ] SOJD: Wiping existing primary data before full refresh. [2025-09-17T21:46:35.802734] [INFO ] [LOCAL ] SOL: Starting deletion of primary data. [2025-09-17T21:46:35.816433] [INFO ] [LOCAL ] SOJD: Starting deletion of primary data. [2025-09-17T21:46:35.816375] [INFO ] [MAIN ] SOJE: Starting full primary refresh. [2025-09-17T21:46:35.823913] [INFO ] [REMOTE ] SOJF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:46:35.824081] [DEBUG] [LOCAL ] SOJD: Deleted primary data file. [2025-09-17T21:46:35.824351] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-11. [2025-09-17T21:46:35.836288] [INFO ] [MAIN ] SOJD: Starting full primary refresh. [2025-09-17T21:46:35.824417] [DEBUG] [LOCAL ] SOL: Deleted primary data file. [2025-09-17T21:46:35.880543] [INFO ] [MAIN ] SOL: Starting full primary refresh. [2025-09-17T21:46:36.123062] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:46:36.226983] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-11 [2025-09-17T21:46:36.255193] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2024-12. [2025-09-17T21:46:36.689400] [DEBUG] [REMOTE ] SOJF: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:46:36.760495] [WARN ] [REMOTE ] SOJF: No data returned for month 2024-12 [2025-09-17T21:46:36.840371] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-01. [2025-09-17T21:46:36.914258] [INFO ] [REMOTE ] SOL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:46:36.919948] [INFO ] [REMOTE ] SOJE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:46:36.923143] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-11. [2025-09-17T21:46:36.922598] [INFO ] [REMOTE ] SOJD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:46:36.922896] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-11. [2025-09-17T21:46:36.924261] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-11. [2025-09-17T21:46:37.565792] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T21:46:37.570158] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-02. [2025-09-17T21:46:37.673521] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T21:46:37.755516] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T21:46:38.004497] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T21:46:38.015770] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2024-12. [2025-09-17T21:46:38.094086] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T21:46:38.815800] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2024-12. [2025-09-17T21:46:39.056071] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T21:46:39.529262] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T21:46:39.615724] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-01. [2025-09-17T21:46:40.239098] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T21:46:40.415787] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-03. [2025-09-17T21:46:41.180770] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T21:46:41.215740] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-04. [2025-09-17T21:46:42.015756] [INFO ] [REMOTE ] SOL: Fetching primary data for 2024-12. [2025-09-17T21:46:42.161449] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-04 (0.95 seconds). [2025-09-17T21:46:42.815785] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-05. [2025-09-17T21:46:43.250732] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T21:46:43.430313] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T21:46:43.615834] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-01. [2025-09-17T21:46:44.330176] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T21:46:44.415786] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-02. [2025-09-17T21:46:44.992149] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-02 (0.58 seconds). [2025-09-17T21:46:45.215792] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-01. [2025-09-17T21:46:46.015781] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-02. [2025-09-17T21:46:46.320923] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T21:46:46.815772] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-03. [2025-09-17T21:46:46.850638] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T21:46:47.615785] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-06. [2025-09-17T21:46:47.709487] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T21:46:48.415825] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-04. [2025-09-17T21:46:48.530591] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T21:46:49.215854] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-07. [2025-09-17T21:46:49.241479] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T21:46:50.015806] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-05. [2025-09-17T21:46:50.055083] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T21:46:50.789515] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T21:46:50.815715] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-06. [2025-09-17T21:46:51.590405] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T21:46:51.615815] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-07. [2025-09-17T21:46:52.379807] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T21:46:52.415828] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-08. [2025-09-17T21:46:52.881366] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T21:46:53.215795] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-02. [2025-09-17T21:46:54.015785] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-08. [2025-09-17T21:46:54.071169] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T21:46:54.540903] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T21:46:54.815769] [INFO ] [REMOTE ] SOJF: Fetching primary data for 2025-09. [2025-09-17T21:46:55.501353] [INFO ] [REMOTE ] SOJF: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T21:46:55.502884] [INFO ] [REMOTE ] SOJF: Full fetch complete (12945 records). [2025-09-17T21:46:55.502960] [DEBUG] [VALIDATOR ] SOJF: Validating primary data. [2025-09-17T21:46:55.620882] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-03. [2025-09-17T21:46:55.686905] [WARN ] [VALIDATOR ] SOJF: Validation failed - insufficient historical data. Have 168 unique days, need 200 days [2025-09-17T21:46:55.687158] [FATAL] [MAIN ] SOJF: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:46:55.687207] [WARN ] [MAIN ] SOJF: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:46:55.687252] [INFO ] [LOCAL ] SOJF: Starting deletion of primary data. [2025-09-17T21:46:55.687309] [DEBUG] [LOCAL ] SOJF: No primary data file found to delete. [2025-09-17T21:46:55.687343] [INFO ] [LOCAL ] SOJF: Starting deletion of derivative data. [2025-09-17T21:46:55.687401] [DEBUG] [LOCAL ] SOJF: No derivative data file found to delete. [2025-09-17T21:46:55.687463] [INFO ] [MAIN ] Update Progress: 1961/2371 symbols completed. SOJF took 21.5s. Estimated remaining: 59m 59s. Rate: 6.8 symbols/min [2025-09-17T21:46:55.860964] [INFO ] [MAIN ] SOLV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:46:55.905289] [DEBUG] [LOCAL ] SOLV: Loaded 44355 existing records from primary storage. [2025-09-17T21:46:55.905435] [INFO ] [MAIN ] SOLV: Loaded 44355 existing records. [2025-09-17T21:46:56.083636] [WARN ] [MAIN ] SOLV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:46:56.083932] [INFO ] [MAIN ] SOLV: Wiping existing primary data before full refresh. [2025-09-17T21:46:56.083981] [INFO ] [LOCAL ] SOLV: Starting deletion of primary data. [2025-09-17T21:46:56.084870] [DEBUG] [LOCAL ] SOLV: Deleted primary data file. [2025-09-17T21:46:56.084923] [INFO ] [MAIN ] SOLV: Starting full primary refresh. [2025-09-17T21:46:56.419022] [INFO ] [REMOTE ] SOJE: Fetching primary data for 2025-09. [2025-09-17T21:46:56.459050] [INFO ] [REMOTE ] SOLV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:46:56.468122] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T21:46:57.113400] [INFO ] [REMOTE ] SOJE: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T21:46:57.115042] [INFO ] [REMOTE ] SOJE: Full fetch complete (14705 records). [2025-09-17T21:46:57.115113] [DEBUG] [VALIDATOR ] SOJE: Validating primary data. [2025-09-17T21:46:57.221005] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-04. [2025-09-17T21:46:57.477407] [DEBUG] [VALIDATOR ] SOJE: All expected trading days are present. [2025-09-17T21:46:57.477493] [DEBUG] [VALIDATOR ] SOJE: Primary data validation passed. [2025-09-17T21:46:57.477953] [INFO ] [MAIN ] SOJE: Fetched primary data is valid. [2025-09-17T21:46:57.477999] [DEBUG] [LOCAL ] SOJE: Saving primary data. [2025-09-17T21:46:57.478516] [DEBUG] [LOCAL ] SOJE: Trimmed 14705 records to 9482 (keeping 200 days of data) [2025-09-17T21:46:57.537858] [DEBUG] [LOCAL ] SOJE: Primary data saved (9482 records). [2025-09-17T21:46:57.538022] [INFO ] [MAIN ] SOJE: Full history saved. [2025-09-17T21:46:57.538120] [INFO ] [MAIN ] Update Progress: 1962/2371 symbols completed. SOJE took 23.4s. Estimated remaining: 59m 49s. Rate: 6.8 symbols/min [2025-09-17T21:46:57.706323] [INFO ] [MAIN ] SON: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:46:57.746552] [DEBUG] [LOCAL ] SON: Loaded 42910 existing records from primary storage. [2025-09-17T21:46:57.746722] [INFO ] [MAIN ] SON: Loaded 42910 existing records. [2025-09-17T21:46:57.930741] [WARN ] [MAIN ] SON: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:46:57.931040] [INFO ] [MAIN ] SON: Wiping existing primary data before full refresh. [2025-09-17T21:46:57.931098] [INFO ] [LOCAL ] SON: Starting deletion of primary data. [2025-09-17T21:46:57.932030] [DEBUG] [LOCAL ] SON: Deleted primary data file. [2025-09-17T21:46:57.932092] [INFO ] [MAIN ] SON: Starting full primary refresh. [2025-09-17T21:46:58.023692] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-11. [2025-09-17T21:46:58.288613] [INFO ] [REMOTE ] SON: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:46:58.299516] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T21:46:58.815835] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-11. [2025-09-17T21:46:59.214292] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T21:46:59.615818] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-05. [2025-09-17T21:47:00.415801] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-03. [2025-09-17T21:47:00.449485] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T21:47:00.566799] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T21:47:01.122678] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T21:47:01.215810] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-04. [2025-09-17T21:47:02.015815] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2024-12. [2025-09-17T21:47:02.394559] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T21:47:02.815786] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-06. [2025-09-17T21:47:03.615785] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-05. [2025-09-17T21:47:03.663148] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T21:47:03.690583] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-06 (0.87 seconds). [2025-09-17T21:47:04.265899] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T21:47:04.415821] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-06. [2025-09-17T21:47:05.215791] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-07. [2025-09-17T21:47:05.295236] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T21:47:05.821602] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-07 (0.61 seconds). [2025-09-17T21:47:06.015817] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-08. [2025-09-17T21:47:06.815796] [INFO ] [REMOTE ] SON: Fetching primary data for 2024-12. [2025-09-17T21:47:06.847787] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T21:47:07.615777] [INFO ] [REMOTE ] SOJD: Fetching primary data for 2025-09. [2025-09-17T21:47:08.332862] [INFO ] [REMOTE ] SOJD: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T21:47:08.335748] [INFO ] [REMOTE ] SOJD: Full fetch complete (20299 records). [2025-09-17T21:47:08.335943] [DEBUG] [VALIDATOR ] SOJD: Validating primary data. [2025-09-17T21:47:08.416841] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-01. [2025-09-17T21:47:08.531096] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T21:47:08.787890] [DEBUG] [VALIDATOR ] SOJD: All expected trading days are present. [2025-09-17T21:47:08.787988] [DEBUG] [VALIDATOR ] SOJD: Primary data validation passed. [2025-09-17T21:47:08.788478] [INFO ] [MAIN ] SOJD: Fetched primary data is valid. [2025-09-17T21:47:08.788535] [DEBUG] [LOCAL ] SOJD: Saving primary data. [2025-09-17T21:47:08.789236] [DEBUG] [LOCAL ] SOJD: Trimmed 20299 records to 13004 (keeping 200 days of data) [2025-09-17T21:47:08.872383] [DEBUG] [LOCAL ] SOJD: Primary data saved (13004 records). [2025-09-17T21:47:08.872528] [INFO ] [MAIN ] SOJD: Full history saved. [2025-09-17T21:47:08.872707] [INFO ] [MAIN ] Update Progress: 1963/2371 symbols completed. SOJD took 34.7s. Estimated remaining: 59m 41s. Rate: 6.8 symbols/min [2025-09-17T21:47:09.039798] [INFO ] [MAIN ] SONY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:47:09.092979] [DEBUG] [LOCAL ] SONY: Loaded 53367 existing records from primary storage. [2025-09-17T21:47:09.093132] [INFO ] [MAIN ] SONY: Loaded 53367 existing records. [2025-09-17T21:47:09.232309] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-01. [2025-09-17T21:47:09.271979] [WARN ] [MAIN ] SONY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:47:09.272193] [INFO ] [MAIN ] SONY: Wiping existing primary data before full refresh. [2025-09-17T21:47:09.272246] [INFO ] [LOCAL ] SONY: Starting deletion of primary data. [2025-09-17T21:47:09.273272] [DEBUG] [LOCAL ] SONY: Deleted primary data file. [2025-09-17T21:47:09.273328] [INFO ] [MAIN ] SONY: Starting full primary refresh. [2025-09-17T21:47:09.633044] [INFO ] [REMOTE ] SONY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:47:10.020845] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-07. [2025-09-17T21:47:10.033412] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T21:47:10.810058] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T21:47:10.818592] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-02. [2025-09-17T21:47:10.992943] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T21:47:11.615812] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-08. [2025-09-17T21:47:12.107866] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T21:47:12.397593] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T21:47:12.415721] [INFO ] [REMOTE ] SOL: Fetching primary data for 2025-09. [2025-09-17T21:47:13.215787] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-11. [2025-09-17T21:47:13.265258] [INFO ] [REMOTE ] SOL: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T21:47:13.267403] [INFO ] [REMOTE ] SOL: Full fetch complete (22060 records). [2025-09-17T21:47:13.267489] [DEBUG] [VALIDATOR ] SOL: Validating primary data. [2025-09-17T21:47:13.638807] [DEBUG] [VALIDATOR ] SOL: All expected trading days are present. [2025-09-17T21:47:13.638967] [DEBUG] [VALIDATOR ] SOL: Primary data validation passed. [2025-09-17T21:47:13.639440] [INFO ] [MAIN ] SOL: Fetched primary data is valid. [2025-09-17T21:47:13.639478] [DEBUG] [LOCAL ] SOL: Saving primary data. [2025-09-17T21:47:13.640495] [DEBUG] [LOCAL ] SOL: Trimmed 22060 records to 13739 (keeping 200 days of data) [2025-09-17T21:47:13.724058] [DEBUG] [LOCAL ] SOL: Primary data saved (13739 records). [2025-09-17T21:47:13.724205] [INFO ] [MAIN ] SOL: Full history saved. [2025-09-17T21:47:13.724306] [INFO ] [MAIN ] Update Progress: 1964/2371 symbols completed. SOL took 39.5s. Estimated remaining: 59m 31s. Rate: 6.8 symbols/min [2025-09-17T21:47:13.901926] [INFO ] [MAIN ] SOR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:47:13.907283] [DEBUG] [LOCAL ] SOR: Loaded 2976 existing records from primary storage. [2025-09-17T21:47:13.907369] [INFO ] [MAIN ] SOR: Loaded 2976 existing records. [2025-09-17T21:47:14.020985] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-03. [2025-09-17T21:47:14.095748] [WARN ] [MAIN ] SOR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:47:14.095994] [INFO ] [MAIN ] SOR: Wiping existing primary data before full refresh. [2025-09-17T21:47:14.096041] [INFO ] [LOCAL ] SOR: Starting deletion of primary data. [2025-09-17T21:47:14.096291] [DEBUG] [LOCAL ] SOR: Deleted primary data file. [2025-09-17T21:47:14.096339] [INFO ] [MAIN ] SOR: Starting full primary refresh. [2025-09-17T21:47:14.466941] [INFO ] [REMOTE ] SOR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:47:14.815765] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-11. [2025-09-17T21:47:15.289101] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T21:47:15.363598] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T21:47:15.407953] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T21:47:15.615796] [INFO ] [REMOTE ] SONY: Fetching primary data for 2024-12. [2025-09-17T21:47:16.415809] [INFO ] [REMOTE ] SOR: Fetching primary data for 2024-12. [2025-09-17T21:47:16.777496] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2024-12 (0.36 seconds). [2025-09-17T21:47:17.215748] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-02. [2025-09-17T21:47:17.520241] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T21:47:18.015817] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-01. [2025-09-17T21:47:18.359382] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T21:47:18.815779] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-03. [2025-09-17T21:47:19.538430] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T21:47:19.615782] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-04. [2025-09-17T21:47:20.022808] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T21:47:20.415777] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-02. [2025-09-17T21:47:21.212017] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T21:47:21.221034] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-01. [2025-09-17T21:47:21.644881] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-01 (0.42 seconds). [2025-09-17T21:47:22.015815] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-04. [2025-09-17T21:47:22.397616] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T21:47:22.815827] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-02. [2025-09-17T21:47:23.313102] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T21:47:23.570821] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T21:47:23.615801] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-03. [2025-09-17T21:47:24.181034] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T21:47:24.415787] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-03. [2025-09-17T21:47:25.215811] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-05. [2025-09-17T21:47:25.900244] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T21:47:26.015737] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-04. [2025-09-17T21:47:26.760087] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T21:47:26.815749] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-06. [2025-09-17T21:47:27.615788] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-05. [2025-09-17T21:47:28.051364] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T21:47:28.257869] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T21:47:28.415768] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-07. [2025-09-17T21:47:28.775896] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T21:47:29.215774] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-05. [2025-09-17T21:47:29.696784] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T21:47:30.015785] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-08. [2025-09-17T21:47:30.815772] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-06. [2025-09-17T21:47:31.161415] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T21:47:31.233422] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T21:47:31.615822] [INFO ] [REMOTE ] SON: Fetching primary data for 2025-09. [2025-09-17T21:47:32.299510] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T21:47:32.415764] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-07. [2025-09-17T21:47:33.043485] [INFO ] [REMOTE ] SON: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T21:47:33.049719] [INFO ] [REMOTE ] SON: Full fetch complete (61508 records). [2025-09-17T21:47:33.049847] [DEBUG] [VALIDATOR ] SON: Validating primary data. [2025-09-17T21:47:33.230102] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-06. [2025-09-17T21:47:33.451178] [DEBUG] [VALIDATOR ] SON: All expected trading days are present. [2025-09-17T21:47:33.451304] [DEBUG] [VALIDATOR ] SON: Primary data validation passed. [2025-09-17T21:47:33.452252] [INFO ] [MAIN ] SON: Fetched primary data is valid. [2025-09-17T21:47:33.452297] [DEBUG] [LOCAL ] SON: Saving primary data. [2025-09-17T21:47:33.453709] [DEBUG] [LOCAL ] SON: Trimmed 61508 records to 42889 (keeping 200 days of data) [2025-09-17T21:47:33.729081] [DEBUG] [LOCAL ] SON: Primary data saved (42889 records). [2025-09-17T21:47:33.729228] [INFO ] [MAIN ] SON: Full history saved. [2025-09-17T21:47:33.729364] [INFO ] [MAIN ] Update Progress: 1965/2371 symbols completed. SON took 36.2s. Estimated remaining: 59m 25s. Rate: 6.8 symbols/min [2025-09-17T21:47:33.935682] [INFO ] [MAIN ] SOS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:47:33.945912] [DEBUG] [LOCAL ] SOS: Loaded 7354 existing records from primary storage. [2025-09-17T21:47:33.946015] [INFO ] [MAIN ] SOS: Loaded 7354 existing records. [2025-09-17T21:47:34.017982] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-04. [2025-09-17T21:47:34.129263] [WARN ] [MAIN ] SOS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:47:34.129585] [INFO ] [MAIN ] SOS: Wiping existing primary data before full refresh. [2025-09-17T21:47:34.129734] [INFO ] [LOCAL ] SOS: Starting deletion of primary data. [2025-09-17T21:47:34.130064] [DEBUG] [LOCAL ] SOS: Deleted primary data file. [2025-09-17T21:47:34.130128] [INFO ] [MAIN ] SOS: Starting full primary refresh. [2025-09-17T21:47:34.297432] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-07 (1.88 seconds). [2025-09-17T21:47:34.514709] [INFO ] [REMOTE ] SOS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:47:34.628178] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-04 (0.61 seconds). [2025-09-17T21:47:34.816734] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-05. [2025-09-17T21:47:34.822208] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T21:47:35.235420] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-05 (0.42 seconds). [2025-09-17T21:47:35.615993] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-11. [2025-09-17T21:47:36.415755] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-07. [2025-09-17T21:47:36.814120] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T21:47:37.215787] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-08. [2025-09-17T21:47:37.707095] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T21:47:38.015789] [INFO ] [REMOTE ] SOS: Fetching primary data for 2024-12. [2025-09-17T21:47:38.484592] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T21:47:38.815736] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-08. [2025-09-17T21:47:38.834496] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T21:47:39.615776] [INFO ] [REMOTE ] SOLV: Fetching primary data for 2025-09. [2025-09-17T21:47:40.415802] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-01. [2025-09-17T21:47:40.546890] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T21:47:40.817677] [INFO ] [REMOTE ] SOLV: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T21:47:40.827791] [INFO ] [REMOTE ] SOLV: Full fetch complete (63167 records). [2025-09-17T21:47:40.828029] [DEBUG] [VALIDATOR ] SOLV: Validating primary data. [2025-09-17T21:47:41.197391] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T21:47:41.217835] [INFO ] [REMOTE ] SONY: Fetching primary data for 2025-09. [2025-09-17T21:47:41.421921] [DEBUG] [VALIDATOR ] SOLV: All expected trading days are present. [2025-09-17T21:47:41.422041] [DEBUG] [VALIDATOR ] SOLV: Primary data validation passed. [2025-09-17T21:47:41.423478] [INFO ] [MAIN ] SOLV: Fetched primary data is valid. [2025-09-17T21:47:41.423549] [DEBUG] [LOCAL ] SOLV: Saving primary data. [2025-09-17T21:47:41.425928] [DEBUG] [LOCAL ] SOLV: Trimmed 63167 records to 44321 (keeping 200 days of data) [2025-09-17T21:47:41.733193] [DEBUG] [LOCAL ] SOLV: Primary data saved (44321 records). [2025-09-17T21:47:41.733360] [INFO ] [MAIN ] SOLV: Full history saved. [2025-09-17T21:47:41.734826] [INFO ] [MAIN ] Update Progress: 1966/2371 symbols completed. SOLV took 46.0s. Estimated remaining: 59m 16s. Rate: 6.8 symbols/min [2025-09-17T21:47:41.912621] [INFO ] [MAIN ] SPB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:47:41.949125] [DEBUG] [LOCAL ] SPB: Loaded 34191 existing records from primary storage. [2025-09-17T21:47:41.949265] [INFO ] [MAIN ] SPB: Loaded 34191 existing records. [2025-09-17T21:47:42.024129] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-02. [2025-09-17T21:47:42.132229] [WARN ] [MAIN ] SPB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:47:42.132524] [INFO ] [MAIN ] SPB: Wiping existing primary data before full refresh. [2025-09-17T21:47:42.132586] [INFO ] [LOCAL ] SPB: Starting deletion of primary data. [2025-09-17T21:47:42.133605] [DEBUG] [LOCAL ] SPB: Deleted primary data file. [2025-09-17T21:47:42.133691] [INFO ] [MAIN ] SPB: Starting full primary refresh. [2025-09-17T21:47:42.494069] [INFO ] [REMOTE ] SPB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:47:42.643548] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T21:47:42.645057] [INFO ] [REMOTE ] SONY: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T21:47:42.655801] [INFO ] [REMOTE ] SONY: Full fetch complete (77101 records). [2025-09-17T21:47:42.655954] [DEBUG] [VALIDATOR ] SONY: Validating primary data. [2025-09-17T21:47:42.829603] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-11. [2025-09-17T21:47:43.049992] [DEBUG] [VALIDATOR ] SONY: All expected trading days are present. [2025-09-17T21:47:43.050087] [DEBUG] [VALIDATOR ] SONY: Primary data validation passed. [2025-09-17T21:47:43.051288] [INFO ] [MAIN ] SONY: Fetched primary data is valid. [2025-09-17T21:47:43.051336] [DEBUG] [LOCAL ] SONY: Saving primary data. [2025-09-17T21:47:43.053019] [DEBUG] [LOCAL ] SONY: Trimmed 77101 records to 53366 (keeping 200 days of data) [2025-09-17T21:47:43.378891] [DEBUG] [LOCAL ] SONY: Primary data saved (53366 records). [2025-09-17T21:47:43.379060] [INFO ] [MAIN ] SONY: Full history saved. [2025-09-17T21:47:43.379166] [INFO ] [MAIN ] Update Progress: 1967/2371 symbols completed. SONY took 34.5s. Estimated remaining: 59m 5s. Rate: 6.8 symbols/min [2025-09-17T21:47:43.550034] [INFO ] [MAIN ] SPCE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:47:43.595925] [DEBUG] [LOCAL ] SPCE: Loaded 49815 existing records from primary storage. [2025-09-17T21:47:43.596087] [INFO ] [MAIN ] SPCE: Loaded 49815 existing records. [2025-09-17T21:47:43.626862] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-03. [2025-09-17T21:47:43.779164] [WARN ] [MAIN ] SPCE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:47:43.779407] [INFO ] [MAIN ] SPCE: Wiping existing primary data before full refresh. [2025-09-17T21:47:43.779462] [INFO ] [LOCAL ] SPCE: Starting deletion of primary data. [2025-09-17T21:47:43.780390] [DEBUG] [LOCAL ] SPCE: Deleted primary data file. [2025-09-17T21:47:43.780444] [INFO ] [MAIN ] SPCE: Starting full primary refresh. [2025-09-17T21:47:44.145055] [INFO ] [REMOTE ] SPCE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:47:44.180746] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T21:47:44.258011] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-11 (1.43 seconds). [2025-09-17T21:47:44.415768] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-11. [2025-09-17T21:47:45.215793] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-04. [2025-09-17T21:47:45.581242] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T21:47:46.015815] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-06. [2025-09-17T21:47:46.631215] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T21:47:46.632923] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T21:47:46.815780] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2024-12. [2025-09-17T21:47:47.615779] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-07. [2025-09-17T21:47:47.958439] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-07 (0.34 seconds). [2025-09-17T21:47:48.415776] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-08. [2025-09-17T21:47:48.869697] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T21:47:49.076266] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2024-12 (2.26 seconds). [2025-09-17T21:47:49.215764] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-01. [2025-09-17T21:47:50.015780] [INFO ] [REMOTE ] SOR: Fetching primary data for 2025-09. [2025-09-17T21:47:50.404015] [INFO ] [REMOTE ] SOR: Incremental fetch complete for 2025-09 (0.39 seconds). [2025-09-17T21:47:50.405146] [INFO ] [REMOTE ] SOR: Full fetch complete (4399 records). [2025-09-17T21:47:50.405225] [DEBUG] [VALIDATOR ] SOR: Validating primary data. [2025-09-17T21:47:50.780670] [DEBUG] [VALIDATOR ] SOR: All expected trading days are present. [2025-09-17T21:47:50.780757] [DEBUG] [VALIDATOR ] SOR: Primary data validation passed. [2025-09-17T21:47:50.780908] [INFO ] [MAIN ] SOR: Fetched primary data is valid. [2025-09-17T21:47:50.780948] [DEBUG] [LOCAL ] SOR: Saving primary data. [2025-09-17T21:47:50.781305] [DEBUG] [LOCAL ] SOR: Trimmed 4399 records to 2984 (keeping 200 days of data) [2025-09-17T21:47:50.800654] [DEBUG] [LOCAL ] SOR: Primary data saved (2984 records). [2025-09-17T21:47:50.800725] [INFO ] [MAIN ] SOR: Full history saved. [2025-09-17T21:47:50.800808] [INFO ] [MAIN ] Update Progress: 1968/2371 symbols completed. SOR took 37.1s. Estimated remaining: 58m 56s. Rate: 6.8 symbols/min [2025-09-17T21:47:50.821226] [INFO ] [REMOTE ] SPB: Fetching primary data for 2024-12. [2025-09-17T21:47:50.971350] [INFO ] [MAIN ] SPE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:47:50.982365] [DEBUG] [LOCAL ] SPE: Loaded 6381 existing records from primary storage. [2025-09-17T21:47:50.982488] [INFO ] [MAIN ] SPE: Loaded 6381 existing records. [2025-09-17T21:47:51.162236] [WARN ] [MAIN ] SPE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:47:51.162503] [INFO ] [MAIN ] SPE: Wiping existing primary data before full refresh. [2025-09-17T21:47:51.162549] [INFO ] [LOCAL ] SPE: Starting deletion of primary data. [2025-09-17T21:47:51.162819] [DEBUG] [LOCAL ] SPE: Deleted primary data file. [2025-09-17T21:47:51.162865] [INFO ] [MAIN ] SPE: Starting full primary refresh. [2025-09-17T21:47:51.530979] [INFO ] [REMOTE ] SPE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:47:51.560417] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-01 (2.34 seconds). [2025-09-17T21:47:51.615739] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-02. [2025-09-17T21:47:51.853072] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2024-12 (1.03 seconds). [2025-09-17T21:47:52.415763] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-01. [2025-09-17T21:47:52.978685] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T21:47:53.215682] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-11. [2025-09-17T21:47:53.310675] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-01 (0.89 seconds). [2025-09-17T21:47:53.671472] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-11 (0.46 seconds). [2025-09-17T21:47:54.015813] [INFO ] [REMOTE ] SPE: Fetching primary data for 2024-12. [2025-09-17T21:47:54.815808] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-02. [2025-09-17T21:47:54.834167] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T21:47:55.615767] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-03. [2025-09-17T21:47:55.722512] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T21:47:56.415773] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-05. [2025-09-17T21:47:56.871936] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T21:47:57.215791] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-03. [2025-09-17T21:47:57.643314] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T21:47:58.015789] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-06. [2025-09-17T21:47:58.260782] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T21:47:58.555303] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T21:47:58.815783] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-07. [2025-09-17T21:47:59.615744] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-04. [2025-09-17T21:47:59.703421] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T21:48:00.415804] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-01. [2025-09-17T21:48:00.883871] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T21:48:01.150251] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T21:48:01.215737] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-02. [2025-09-17T21:48:02.015770] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-08. [2025-09-17T21:48:02.815794] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-05. [2025-09-17T21:48:03.041580] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T21:48:03.615775] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-04. [2025-09-17T21:48:04.301680] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T21:48:04.415795] [INFO ] [REMOTE ] SOS: Fetching primary data for 2025-09. [2025-09-17T21:48:05.215778] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-03. [2025-09-17T21:48:05.291927] [INFO ] [REMOTE ] SOS: Incremental fetch complete for 2025-09 (0.88 seconds). [2025-09-17T21:48:05.294426] [INFO ] [REMOTE ] SOS: Full fetch complete (11600 records). [2025-09-17T21:48:05.294504] [DEBUG] [VALIDATOR ] SOS: Validating primary data. [2025-09-17T21:48:05.682419] [DEBUG] [VALIDATOR ] SOS: All expected trading days are present. [2025-09-17T21:48:05.690152] [DEBUG] [VALIDATOR ] SOS: Primary data validation passed. [2025-09-17T21:48:05.704194] [INFO ] [MAIN ] SOS: Fetched primary data is valid. [2025-09-17T21:48:05.704309] [DEBUG] [LOCAL ] SOS: Saving primary data. [2025-09-17T21:48:05.706240] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-05 (2.89 seconds). [2025-09-17T21:48:05.714297] [DEBUG] [LOCAL ] SOS: Trimmed 11600 records to 7406 (keeping 200 days of data) [2025-09-17T21:48:05.759564] [DEBUG] [LOCAL ] SOS: Primary data saved (7406 records). [2025-09-17T21:48:05.759737] [INFO ] [MAIN ] SOS: Full history saved. [2025-09-17T21:48:05.759838] [INFO ] [MAIN ] Update Progress: 1969/2371 symbols completed. SOS took 32.0s. Estimated remaining: 58m 49s. Rate: 6.8 symbols/min [2025-09-17T21:48:05.924138] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T21:48:05.949410] [INFO ] [MAIN ] SPG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:48:06.006213] [DEBUG] [LOCAL ] SPG: Loaded 50452 existing records from primary storage. [2025-09-17T21:48:06.006408] [INFO ] [MAIN ] SPG: Loaded 50452 existing records. [2025-09-17T21:48:06.020970] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-04. [2025-09-17T21:48:06.195951] [WARN ] [MAIN ] SPG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:48:06.196241] [INFO ] [MAIN ] SPG: Wiping existing primary data before full refresh. [2025-09-17T21:48:06.196290] [INFO ] [LOCAL ] SPG: Starting deletion of primary data. [2025-09-17T21:48:06.197329] [DEBUG] [LOCAL ] SPG: Deleted primary data file. [2025-09-17T21:48:06.197382] [INFO ] [MAIN ] SPG: Starting full primary refresh. [2025-09-17T21:48:06.565547] [INFO ] [REMOTE ] SPG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:48:06.574190] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T21:48:06.610053] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-04 (2.99 seconds). [2025-09-17T21:48:06.815817] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-05. [2025-09-17T21:48:07.615810] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-11. [2025-09-17T21:48:08.415797] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-05. [2025-09-17T21:48:08.588680] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T21:48:08.994588] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T21:48:09.215773] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-06. [2025-09-17T21:48:09.438875] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T21:48:10.015807] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-06. [2025-09-17T21:48:10.363226] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T21:48:10.727079] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T21:48:10.815737] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-06. [2025-09-17T21:48:11.615779] [INFO ] [REMOTE ] SPG: Fetching primary data for 2024-12. [2025-09-17T21:48:12.415765] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-07. [2025-09-17T21:48:12.577225] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T21:48:13.042340] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T21:48:13.215768] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-07. [2025-09-17T21:48:13.415102] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T21:48:14.015825] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-07. [2025-09-17T21:48:14.815845] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-08. [2025-09-17T21:48:15.615796] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-01. [2025-09-17T21:48:16.086481] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T21:48:16.106763] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T21:48:16.347011] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-07 (3.13 seconds). [2025-09-17T21:48:16.415766] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-08. [2025-09-17T21:48:17.202374] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T21:48:17.215718] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-02. [2025-09-17T21:48:18.015751] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-08. [2025-09-17T21:48:18.484433] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T21:48:18.815828] [INFO ] [REMOTE ] SPE: Fetching primary data for 2025-09. [2025-09-17T21:48:18.857664] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T21:48:19.040996] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T21:48:19.251281] [INFO ] [REMOTE ] SPE: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T21:48:19.252955] [INFO ] [REMOTE ] SPE: Full fetch complete (10159 records). [2025-09-17T21:48:19.253041] [DEBUG] [VALIDATOR ] SPE: Validating primary data. [2025-09-17T21:48:19.620912] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-03. [2025-09-17T21:48:19.628718] [DEBUG] [VALIDATOR ] SPE: All expected trading days are present. [2025-09-17T21:48:19.628811] [DEBUG] [VALIDATOR ] SPE: Primary data validation passed. [2025-09-17T21:48:19.629071] [INFO ] [MAIN ] SPE: Fetched primary data is valid. [2025-09-17T21:48:19.629108] [DEBUG] [LOCAL ] SPE: Saving primary data. [2025-09-17T21:48:19.629712] [DEBUG] [LOCAL ] SPE: Trimmed 10159 records to 6419 (keeping 200 days of data) [2025-09-17T21:48:19.670678] [DEBUG] [LOCAL ] SPE: Primary data saved (6419 records). [2025-09-17T21:48:19.670817] [INFO ] [MAIN ] SPE: Full history saved. [2025-09-17T21:48:19.670920] [INFO ] [MAIN ] Update Progress: 1970/2371 symbols completed. SPE took 28.9s. Estimated remaining: 58m 41s. Rate: 6.8 symbols/min [2025-09-17T21:48:19.841723] [INFO ] [MAIN ] SPGI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:48:19.884844] [DEBUG] [LOCAL ] SPGI: Loaded 45837 existing records from primary storage. [2025-09-17T21:48:19.885013] [INFO ] [MAIN ] SPGI: Loaded 45837 existing records. [2025-09-17T21:48:20.066681] [WARN ] [MAIN ] SPGI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:48:20.066951] [INFO ] [MAIN ] SPGI: Wiping existing primary data before full refresh. [2025-09-17T21:48:20.066995] [INFO ] [LOCAL ] SPGI: Starting deletion of primary data. [2025-09-17T21:48:20.067993] [DEBUG] [LOCAL ] SPGI: Deleted primary data file. [2025-09-17T21:48:20.068041] [INFO ] [MAIN ] SPGI: Starting full primary refresh. [2025-09-17T21:48:20.433504] [INFO ] [REMOTE ] SPGI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:48:20.428488] [INFO ] [REMOTE ] SPB: Fetching primary data for 2025-09. [2025-09-17T21:48:21.215740] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-11. [2025-09-17T21:48:21.528205] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T21:48:21.601134] [INFO ] [REMOTE ] SPB: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T21:48:21.605374] [INFO ] [REMOTE ] SPB: Full fetch complete (47276 records). [2025-09-17T21:48:21.605468] [DEBUG] [VALIDATOR ] SPB: Validating primary data. [2025-09-17T21:48:22.000854] [DEBUG] [VALIDATOR ] SPB: All expected trading days are present. [2025-09-17T21:48:22.000945] [DEBUG] [VALIDATOR ] SPB: Primary data validation passed. [2025-09-17T21:48:22.001832] [INFO ] [MAIN ] SPB: Fetched primary data is valid. [2025-09-17T21:48:22.001877] [DEBUG] [LOCAL ] SPB: Saving primary data. [2025-09-17T21:48:22.002986] [DEBUG] [LOCAL ] SPB: Trimmed 47276 records to 34205 (keeping 200 days of data) [2025-09-17T21:48:22.060266] [INFO ] [REMOTE ] SPCE: Fetching primary data for 2025-09. [2025-09-17T21:48:22.219016] [DEBUG] [LOCAL ] SPB: Primary data saved (34205 records). [2025-09-17T21:48:22.219190] [INFO ] [MAIN ] SPB: Full history saved. [2025-09-17T21:48:22.219832] [INFO ] [MAIN ] Update Progress: 1971/2371 symbols completed. SPB took 40.5s. Estimated remaining: 58m 31s. Rate: 6.8 symbols/min [2025-09-17T21:48:22.393360] [INFO ] [MAIN ] SPH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:48:22.417163] [DEBUG] [LOCAL ] SPH: Loaded 18605 existing records from primary storage. [2025-09-17T21:48:22.417301] [INFO ] [MAIN ] SPH: Loaded 18605 existing records. [2025-09-17T21:48:22.602080] [WARN ] [MAIN ] SPH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:48:22.602404] [INFO ] [MAIN ] SPH: Wiping existing primary data before full refresh. [2025-09-17T21:48:22.602472] [INFO ] [LOCAL ] SPH: Starting deletion of primary data. [2025-09-17T21:48:22.602991] [DEBUG] [LOCAL ] SPH: Deleted primary data file. [2025-09-17T21:48:22.603043] [INFO ] [MAIN ] SPH: Starting full primary refresh. [2025-09-17T21:48:22.825604] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-04. [2025-09-17T21:48:22.977811] [INFO ] [REMOTE ] SPH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:48:23.002089] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T21:48:23.615772] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-11. [2025-09-17T21:48:23.852455] [INFO ] [REMOTE ] SPCE: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T21:48:23.862467] [INFO ] [REMOTE ] SPCE: Full fetch complete (72260 records). [2025-09-17T21:48:23.862664] [DEBUG] [VALIDATOR ] SPCE: Validating primary data. [2025-09-17T21:48:24.269762] [DEBUG] [VALIDATOR ] SPCE: All expected trading days are present. [2025-09-17T21:48:24.269850] [DEBUG] [VALIDATOR ] SPCE: Primary data validation passed. [2025-09-17T21:48:24.270850] [INFO ] [MAIN ] SPCE: Fetched primary data is valid. [2025-09-17T21:48:24.270903] [DEBUG] [LOCAL ] SPCE: Saving primary data. [2025-09-17T21:48:24.272409] [DEBUG] [LOCAL ] SPCE: Trimmed 72260 records to 49826 (keeping 200 days of data) [2025-09-17T21:48:24.437503] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2024-12. [2025-09-17T21:48:24.501282] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T21:48:24.614224] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T21:48:24.628495] [DEBUG] [LOCAL ] SPCE: Primary data saved (49826 records). [2025-09-17T21:48:24.628925] [INFO ] [MAIN ] SPCE: Full history saved. [2025-09-17T21:48:24.630271] [INFO ] [MAIN ] Update Progress: 1972/2371 symbols completed. SPCE took 41.3s. Estimated remaining: 58m 21s. Rate: 6.8 symbols/min [2025-09-17T21:48:24.807611] [INFO ] [MAIN ] SPHR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:48:24.848874] [DEBUG] [LOCAL ] SPHR: Loaded 40044 existing records from primary storage. [2025-09-17T21:48:24.849039] [INFO ] [MAIN ] SPHR: Loaded 40044 existing records. [2025-09-17T21:48:25.028053] [WARN ] [MAIN ] SPHR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:48:25.028303] [INFO ] [MAIN ] SPHR: Wiping existing primary data before full refresh. [2025-09-17T21:48:25.028354] [INFO ] [LOCAL ] SPHR: Starting deletion of primary data. [2025-09-17T21:48:25.029145] [DEBUG] [LOCAL ] SPHR: Deleted primary data file. [2025-09-17T21:48:25.029208] [INFO ] [MAIN ] SPHR: Starting full primary refresh. [2025-09-17T21:48:25.222249] [INFO ] [REMOTE ] SPH: Fetching primary data for 2024-12. [2025-09-17T21:48:25.396321] [INFO ] [REMOTE ] SPHR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:48:25.746283] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T21:48:26.015749] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-11. [2025-09-17T21:48:26.395224] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T21:48:26.815847] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-01. [2025-09-17T21:48:27.615756] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-05. [2025-09-17T21:48:28.064607] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T21:48:28.415769] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2024-12. [2025-09-17T21:48:28.814305] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-01 (2.00 seconds). [2025-09-17T21:48:29.215819] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-01. [2025-09-17T21:48:29.454897] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T21:48:29.621808] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T21:48:30.015828] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-06. [2025-09-17T21:48:30.815771] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-01. [2025-09-17T21:48:30.917331] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T21:48:31.615791] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-02. [2025-09-17T21:48:31.784267] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T21:48:32.034538] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T21:48:32.415844] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-02. [2025-09-17T21:48:33.215773] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-02. [2025-09-17T21:48:33.335494] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T21:48:33.387334] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T21:48:34.015842] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-03. [2025-09-17T21:48:34.225808] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T21:48:34.815783] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-03. [2025-09-17T21:48:35.615793] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-03. [2025-09-17T21:48:35.952398] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T21:48:36.065952] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T21:48:36.415790] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-07. [2025-09-17T21:48:36.904032] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T21:48:37.215818] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-04. [2025-09-17T21:48:37.879685] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T21:48:38.015819] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-04. [2025-09-17T21:48:38.178062] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T21:48:38.815776] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-05. [2025-09-17T21:48:39.611425] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T21:48:39.621220] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-08. [2025-09-17T21:48:39.634229] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T21:48:40.415765] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-05. [2025-09-17T21:48:41.215766] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-06. [2025-09-17T21:48:41.422525] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T21:48:41.922104] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T21:48:42.015734] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-07. [2025-09-17T21:48:42.236070] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T21:48:42.691042] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-07 (0.68 seconds). [2025-09-17T21:48:42.815754] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-04. [2025-09-17T21:48:43.615768] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-06. [2025-09-17T21:48:44.046152] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T21:48:44.415800] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-08. [2025-09-17T21:48:44.993494] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T21:48:45.215758] [INFO ] [REMOTE ] SPG: Fetching primary data for 2025-09. [2025-09-17T21:48:45.536677] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T21:48:45.885001] [INFO ] [REMOTE ] SPG: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T21:48:45.891916] [INFO ] [REMOTE ] SPG: Full fetch complete (71863 records). [2025-09-17T21:48:45.892092] [DEBUG] [VALIDATOR ] SPG: Validating primary data. [2025-09-17T21:48:46.020920] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-05. [2025-09-17T21:48:46.304193] [DEBUG] [VALIDATOR ] SPG: All expected trading days are present. [2025-09-17T21:48:46.304292] [DEBUG] [VALIDATOR ] SPG: Primary data validation passed. [2025-09-17T21:48:46.305360] [INFO ] [MAIN ] SPG: Fetched primary data is valid. [2025-09-17T21:48:46.305407] [DEBUG] [LOCAL ] SPG: Saving primary data. [2025-09-17T21:48:46.306987] [DEBUG] [LOCAL ] SPG: Trimmed 71863 records to 50466 (keeping 200 days of data) [2025-09-17T21:48:46.627014] [DEBUG] [LOCAL ] SPG: Primary data saved (50466 records). [2025-09-17T21:48:46.627164] [INFO ] [MAIN ] SPG: Full history saved. [2025-09-17T21:48:46.627261] [INFO ] [MAIN ] Update Progress: 1973/2371 symbols completed. SPG took 40.9s. Estimated remaining: 58m 15s. Rate: 6.8 symbols/min [2025-09-17T21:48:46.794873] [INFO ] [MAIN ] SPIR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:48:46.815780] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-07. [2025-09-17T21:48:46.830903] [DEBUG] [LOCAL ] SPIR: Loaded 37514 existing records from primary storage. [2025-09-17T21:48:46.831028] [INFO ] [MAIN ] SPIR: Loaded 37514 existing records. [2025-09-17T21:48:47.013246] [WARN ] [MAIN ] SPIR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:48:47.013509] [INFO ] [MAIN ] SPIR: Wiping existing primary data before full refresh. [2025-09-17T21:48:47.013555] [INFO ] [LOCAL ] SPIR: Starting deletion of primary data. [2025-09-17T21:48:47.014225] [DEBUG] [LOCAL ] SPIR: Deleted primary data file. [2025-09-17T21:48:47.014274] [INFO ] [MAIN ] SPIR: Starting full primary refresh. [2025-09-17T21:48:47.408624] [INFO ] [REMOTE ] SPIR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:48:47.595126] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T21:48:47.615735] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-06. [2025-09-17T21:48:48.268684] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-07 (1.45 seconds). [2025-09-17T21:48:48.415738] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-08. [2025-09-17T21:48:49.019449] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-06 (1.40 seconds). [2025-09-17T21:48:49.215771] [INFO ] [REMOTE ] SPH: Fetching primary data for 2025-09. [2025-09-17T21:48:49.977938] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T21:48:50.015742] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-11. [2025-09-17T21:48:50.083000] [INFO ] [REMOTE ] SPH: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T21:48:50.085566] [INFO ] [REMOTE ] SPH: Full fetch complete (28689 records). [2025-09-17T21:48:50.085689] [DEBUG] [VALIDATOR ] SPH: Validating primary data. [2025-09-17T21:48:50.454063] [DEBUG] [VALIDATOR ] SPH: All expected trading days are present. [2025-09-17T21:48:50.454142] [DEBUG] [VALIDATOR ] SPH: Primary data validation passed. [2025-09-17T21:48:50.454767] [INFO ] [MAIN ] SPH: Fetched primary data is valid. [2025-09-17T21:48:50.454830] [DEBUG] [LOCAL ] SPH: Saving primary data. [2025-09-17T21:48:50.455917] [DEBUG] [LOCAL ] SPH: Trimmed 28689 records to 18549 (keeping 200 days of data) [2025-09-17T21:48:50.575174] [DEBUG] [LOCAL ] SPH: Primary data saved (18549 records). [2025-09-17T21:48:50.575331] [INFO ] [MAIN ] SPH: Full history saved. [2025-09-17T21:48:50.575419] [INFO ] [MAIN ] Update Progress: 1974/2371 symbols completed. SPH took 28.4s. Estimated remaining: 58m 5s. Rate: 6.8 symbols/min [2025-09-17T21:48:50.758144] [INFO ] [MAIN ] SPMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:48:50.767103] [DEBUG] [LOCAL ] SPMC: Loaded 5764 existing records from primary storage. [2025-09-17T21:48:50.767228] [INFO ] [MAIN ] SPMC: Loaded 5764 existing records. [2025-09-17T21:48:50.821584] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-07. [2025-09-17T21:48:50.947415] [WARN ] [MAIN ] SPMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:48:50.947637] [INFO ] [MAIN ] SPMC: Wiping existing primary data before full refresh. [2025-09-17T21:48:50.947702] [INFO ] [LOCAL ] SPMC: Starting deletion of primary data. [2025-09-17T21:48:50.947996] [DEBUG] [LOCAL ] SPMC: Deleted primary data file. [2025-09-17T21:48:50.948041] [INFO ] [MAIN ] SPMC: Starting full primary refresh. [2025-09-17T21:48:51.312953] [INFO ] [REMOTE ] SPMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:48:51.336439] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T21:48:51.615831] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2024-12. [2025-09-17T21:48:52.331946] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T21:48:52.415794] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-08. [2025-09-17T21:48:52.656908] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2024-12 (1.04 seconds). [2025-09-17T21:48:53.215790] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-01. [2025-09-17T21:48:53.693773] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T21:48:54.015810] [INFO ] [REMOTE ] SPGI: Fetching primary data for 2025-09. [2025-09-17T21:48:54.442337] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T21:48:54.622017] [INFO ] [REMOTE ] SPGI: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T21:48:54.629152] [INFO ] [REMOTE ] SPGI: Full fetch complete (66195 records). [2025-09-17T21:48:54.629267] [DEBUG] [VALIDATOR ] SPGI: Validating primary data. [2025-09-17T21:48:54.821961] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-11. [2025-09-17T21:48:55.020810] [DEBUG] [VALIDATOR ] SPGI: All expected trading days are present. [2025-09-17T21:48:55.020899] [DEBUG] [VALIDATOR ] SPGI: Primary data validation passed. [2025-09-17T21:48:55.021987] [INFO ] [MAIN ] SPGI: Fetched primary data is valid. [2025-09-17T21:48:55.022032] [DEBUG] [LOCAL ] SPGI: Saving primary data. [2025-09-17T21:48:55.023446] [DEBUG] [LOCAL ] SPGI: Trimmed 66195 records to 45808 (keeping 200 days of data) [2025-09-17T21:48:55.323069] [DEBUG] [LOCAL ] SPGI: Primary data saved (45808 records). [2025-09-17T21:48:55.323211] [INFO ] [MAIN ] SPGI: Full history saved. [2025-09-17T21:48:55.323303] [INFO ] [MAIN ] Update Progress: 1975/2371 symbols completed. SPGI took 35.7s. Estimated remaining: 57m 55s. Rate: 6.8 symbols/min [2025-09-17T21:48:55.494104] [INFO ] [MAIN ] SPME: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:48:55.494324] [DEBUG] [LOCAL ] SPME: No existing data file found in primary storage. [2025-09-17T21:48:55.494362] [WARN ] [MAIN ] SPME: No existing data found, performing full refresh instead. [2025-09-17T21:48:55.494518] [INFO ] [MAIN ] SPME: Wiping existing primary data before full refresh. [2025-09-17T21:48:55.494557] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-17T21:48:55.494601] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-17T21:48:55.494633] [INFO ] [MAIN ] SPME: Starting full primary refresh. [2025-09-17T21:48:55.628393] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-02. [2025-09-17T21:48:55.666294] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-11 (0.84 seconds). [2025-09-17T21:48:55.878047] [INFO ] [REMOTE ] SPME: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:48:56.415760] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2024-12. [2025-09-17T21:48:57.006524] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T21:48:57.215785] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-01. [2025-09-17T21:48:57.442880] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T21:48:57.845018] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T21:48:58.015801] [INFO ] [REMOTE ] SPHR: Fetching primary data for 2025-09. [2025-09-17T21:48:58.815810] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-11. [2025-09-17T21:48:59.017579] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:48:59.017946] [WARN ] [REMOTE ] SPME: No data returned for month 2024-11 [2025-09-17T21:48:59.091419] [INFO ] [REMOTE ] SPHR: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T21:48:59.097698] [INFO ] [REMOTE ] SPHR: Full fetch complete (57032 records). [2025-09-17T21:48:59.097824] [DEBUG] [VALIDATOR ] SPHR: Validating primary data. [2025-09-17T21:48:59.477965] [DEBUG] [VALIDATOR ] SPHR: All expected trading days are present. [2025-09-17T21:48:59.478048] [DEBUG] [VALIDATOR ] SPHR: Primary data validation passed. [2025-09-17T21:48:59.478874] [INFO ] [MAIN ] SPHR: Fetched primary data is valid. [2025-09-17T21:48:59.478918] [DEBUG] [LOCAL ] SPHR: Saving primary data. [2025-09-17T21:48:59.480138] [DEBUG] [LOCAL ] SPHR: Trimmed 57032 records to 40151 (keeping 200 days of data) [2025-09-17T21:48:59.653019] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-02. [2025-09-17T21:48:59.727032] [DEBUG] [LOCAL ] SPHR: Primary data saved (40151 records). [2025-09-17T21:48:59.727176] [INFO ] [MAIN ] SPHR: Full history saved. [2025-09-17T21:48:59.727260] [INFO ] [MAIN ] Update Progress: 1976/2371 symbols completed. SPHR took 35.1s. Estimated remaining: 57m 46s. Rate: 6.8 symbols/min [2025-09-17T21:48:59.900492] [INFO ] [MAIN ] SPNT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:48:59.941465] [DEBUG] [LOCAL ] SPNT: Loaded 34707 existing records from primary storage. [2025-09-17T21:48:59.941614] [INFO ] [MAIN ] SPNT: Loaded 34707 existing records. [2025-09-17T21:49:00.127378] [WARN ] [MAIN ] SPNT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:49:00.127683] [INFO ] [MAIN ] SPNT: Wiping existing primary data before full refresh. [2025-09-17T21:49:00.127730] [INFO ] [LOCAL ] SPNT: Starting deletion of primary data. [2025-09-17T21:49:00.128508] [DEBUG] [LOCAL ] SPNT: Deleted primary data file. [2025-09-17T21:49:00.128576] [INFO ] [MAIN ] SPNT: Starting full primary refresh. [2025-09-17T21:49:00.420916] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-03. [2025-09-17T21:49:00.485580] [INFO ] [REMOTE ] SPNT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:49:00.492578] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T21:49:01.215818] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-03. [2025-09-17T21:49:01.787330] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T21:49:02.015780] [INFO ] [REMOTE ] SPME: Fetching primary data for 2024-12. [2025-09-17T21:49:02.063193] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T21:49:02.265480] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:49:02.265897] [WARN ] [REMOTE ] SPME: No data returned for month 2024-12 [2025-09-17T21:49:02.815785] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-01. [2025-09-17T21:49:03.078459] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:49:03.078846] [WARN ] [REMOTE ] SPME: No data returned for month 2025-01 [2025-09-17T21:49:03.615798] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-11. [2025-09-17T21:49:04.415817] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-04. [2025-09-17T21:49:04.935067] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T21:49:05.215793] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-02. [2025-09-17T21:49:05.449998] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:49:05.450317] [WARN ] [REMOTE ] SPME: No data returned for month 2025-02 [2025-09-17T21:49:05.742839] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T21:49:06.015786] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-03. [2025-09-17T21:49:06.214784] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:49:06.215095] [WARN ] [REMOTE ] SPME: No data returned for month 2025-03 [2025-09-17T21:49:06.815822] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2024-12. [2025-09-17T21:49:07.615769] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-04. [2025-09-17T21:49:07.871777] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:49:07.872107] [WARN ] [REMOTE ] SPME: No data returned for month 2025-04 [2025-09-17T21:49:08.200535] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T21:49:08.415841] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-05. [2025-09-17T21:49:09.215834] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-01. [2025-09-17T21:49:09.625321] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T21:49:10.015795] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-06. [2025-09-17T21:49:10.494049] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T21:49:10.815793] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-05. [2025-09-17T21:49:11.045046] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:49:11.045246] [WARN ] [REMOTE ] SPME: No data returned for month 2025-05 [2025-09-17T21:49:11.230101] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T21:49:11.615800] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-07. [2025-09-17T21:49:12.415812] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-02. [2025-09-17T21:49:13.083812] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T21:49:13.215781] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-06. [2025-09-17T21:49:13.441491] [DEBUG] [REMOTE ] SPME: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:49:13.441847] [WARN ] [REMOTE ] SPME: No data returned for month 2025-06 [2025-09-17T21:49:13.790589] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T21:49:14.015824] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-04. [2025-09-17T21:49:14.786030] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T21:49:14.815727] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-05. [2025-09-17T21:49:15.297490] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T21:49:15.615837] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-06. [2025-09-17T21:49:16.036552] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T21:49:16.415782] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-07. [2025-09-17T21:49:16.861013] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T21:49:17.215788] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-07. [2025-09-17T21:49:17.831349] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T21:49:18.015772] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-08. [2025-09-17T21:49:18.601804] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T21:49:18.815794] [INFO ] [REMOTE ] SPMC: Fetching primary data for 2025-09. [2025-09-17T21:49:19.401371] [INFO ] [REMOTE ] SPMC: Incremental fetch complete for 2025-09 (0.59 seconds). [2025-09-17T21:49:19.402627] [INFO ] [REMOTE ] SPMC: Full fetch complete (8141 records). [2025-09-17T21:49:19.402724] [DEBUG] [VALIDATOR ] SPMC: Validating primary data. [2025-09-17T21:49:19.620973] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-08. [2025-09-17T21:49:19.771892] [DEBUG] [VALIDATOR ] SPMC: All expected trading days are present. [2025-09-17T21:49:19.771966] [DEBUG] [VALIDATOR ] SPMC: Primary data validation passed. [2025-09-17T21:49:19.772174] [INFO ] [MAIN ] SPMC: Fetched primary data is valid. [2025-09-17T21:49:19.772213] [DEBUG] [LOCAL ] SPMC: Saving primary data. [2025-09-17T21:49:19.772615] [DEBUG] [LOCAL ] SPMC: Trimmed 8141 records to 5744 (keeping 200 days of data) [2025-09-17T21:49:19.809625] [DEBUG] [LOCAL ] SPMC: Primary data saved (5744 records). [2025-09-17T21:49:19.809799] [INFO ] [MAIN ] SPMC: Full history saved. [2025-09-17T21:49:19.809891] [INFO ] [MAIN ] Update Progress: 1977/2371 symbols completed. SPMC took 29.2s. Estimated remaining: 57m 39s. Rate: 6.8 symbols/min [2025-09-17T21:49:19.980441] [INFO ] [MAIN ] SPOT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:49:20.013725] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-17T21:49:20.034281] [DEBUG] [LOCAL ] SPOT: Loaded 51116 existing records from primary storage. [2025-09-17T21:49:20.034433] [INFO ] [MAIN ] SPOT: Loaded 51116 existing records. [2025-09-17T21:49:20.231764] [WARN ] [MAIN ] SPOT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:49:20.232033] [INFO ] [MAIN ] SPOT: Wiping existing primary data before full refresh. [2025-09-17T21:49:20.232077] [INFO ] [LOCAL ] SPOT: Starting deletion of primary data. [2025-09-17T21:49:20.233090] [DEBUG] [LOCAL ] SPOT: Deleted primary data file. [2025-09-17T21:49:20.233168] [INFO ] [MAIN ] SPOT: Starting full primary refresh. [2025-09-17T21:49:20.422101] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-08. [2025-09-17T21:49:20.592564] [INFO ] [REMOTE ] SPOT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:49:21.215835] [INFO ] [REMOTE ] SPME: Fetching primary data for 2025-09. [2025-09-17T21:49:21.782702] [INFO ] [REMOTE ] SPME: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T21:49:21.783474] [INFO ] [REMOTE ] SPME: Full fetch complete (633 records). [2025-09-17T21:49:21.783543] [DEBUG] [VALIDATOR ] SPME: Validating primary data. [2025-09-17T21:49:21.971763] [WARN ] [VALIDATOR ] SPME: Validation failed - insufficient historical data. Have 43 unique days, need 200 days [2025-09-17T21:49:21.971944] [FATAL] [MAIN ] SPME: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:49:21.971999] [WARN ] [MAIN ] SPME: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:49:21.972137] [INFO ] [LOCAL ] SPME: Starting deletion of primary data. [2025-09-17T21:49:21.972268] [DEBUG] [LOCAL ] SPME: No primary data file found to delete. [2025-09-17T21:49:21.972307] [INFO ] [LOCAL ] SPME: Starting deletion of derivative data. [2025-09-17T21:49:21.972466] [DEBUG] [LOCAL ] SPME: No derivative data file found to delete. [2025-09-17T21:49:21.972536] [INFO ] [MAIN ] Update Progress: 1978/2371 symbols completed. SPME took 26.6s. Estimated remaining: 57m 29s. Rate: 6.8 symbols/min [2025-09-17T21:49:22.016791] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-03. [2025-09-17T21:49:22.168804] [INFO ] [MAIN ] SPR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:49:22.170824] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T21:49:22.213518] [DEBUG] [LOCAL ] SPR: Loaded 41447 existing records from primary storage. [2025-09-17T21:49:22.213683] [INFO ] [MAIN ] SPR: Loaded 41447 existing records. [2025-09-17T21:49:22.397523] [WARN ] [MAIN ] SPR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:49:22.397836] [INFO ] [MAIN ] SPR: Wiping existing primary data before full refresh. [2025-09-17T21:49:22.397895] [INFO ] [LOCAL ] SPR: Starting deletion of primary data. [2025-09-17T21:49:22.398689] [DEBUG] [LOCAL ] SPR: Deleted primary data file. [2025-09-17T21:49:22.398757] [INFO ] [MAIN ] SPR: Starting full primary refresh. [2025-09-17T21:49:22.749758] [INFO ] [REMOTE ] SPR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:49:22.815812] [INFO ] [REMOTE ] SPIR: Fetching primary data for 2025-09. [2025-09-17T21:49:23.195822] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-03 (1.18 seconds). [2025-09-17T21:49:23.615804] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-11. [2025-09-17T21:49:24.278477] [INFO ] [REMOTE ] SPIR: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T21:49:24.285909] [INFO ] [REMOTE ] SPIR: Full fetch complete (51954 records). [2025-09-17T21:49:24.286075] [DEBUG] [VALIDATOR ] SPIR: Validating primary data. [2025-09-17T21:49:24.427861] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-04. [2025-09-17T21:49:24.669814] [DEBUG] [VALIDATOR ] SPIR: All expected trading days are present. [2025-09-17T21:49:24.669891] [DEBUG] [VALIDATOR ] SPIR: Primary data validation passed. [2025-09-17T21:49:24.670716] [INFO ] [MAIN ] SPIR: Fetched primary data is valid. [2025-09-17T21:49:24.670760] [DEBUG] [LOCAL ] SPIR: Saving primary data. [2025-09-17T21:49:24.671867] [DEBUG] [LOCAL ] SPIR: Trimmed 51954 records to 37538 (keeping 200 days of data) [2025-09-17T21:49:24.900261] [DEBUG] [LOCAL ] SPIR: Primary data saved (37538 records). [2025-09-17T21:49:24.900514] [INFO ] [MAIN ] SPIR: Full history saved. [2025-09-17T21:49:24.900831] [INFO ] [MAIN ] Update Progress: 1979/2371 symbols completed. SPIR took 38.3s. Estimated remaining: 57m 19s. Rate: 6.8 symbols/min [2025-09-17T21:49:25.071363] [INFO ] [MAIN ] SPRU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:49:25.081302] [DEBUG] [LOCAL ] SPRU: Loaded 8280 existing records from primary storage. [2025-09-17T21:49:25.081410] [INFO ] [MAIN ] SPRU: Loaded 8280 existing records. [2025-09-17T21:49:25.222009] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-11. [2025-09-17T21:49:25.269444] [WARN ] [MAIN ] SPRU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:49:25.269717] [INFO ] [MAIN ] SPRU: Wiping existing primary data before full refresh. [2025-09-17T21:49:25.269784] [INFO ] [LOCAL ] SPRU: Starting deletion of primary data. [2025-09-17T21:49:25.270275] [DEBUG] [LOCAL ] SPRU: Deleted primary data file. [2025-09-17T21:49:25.270744] [INFO ] [MAIN ] SPRU: Starting full primary refresh. [2025-09-17T21:49:25.653161] [INFO ] [REMOTE ] SPRU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:49:25.684064] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-11 (2.07 seconds). [2025-09-17T21:49:25.948089] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T21:49:26.015773] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2024-12. [2025-09-17T21:49:26.594998] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T21:49:26.815786] [INFO ] [REMOTE ] SPR: Fetching primary data for 2024-12. [2025-09-17T21:49:27.615761] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-05. [2025-09-17T21:49:28.182388] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2024-12 (2.17 seconds). [2025-09-17T21:49:28.369874] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T21:49:28.415724] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-01. [2025-09-17T21:49:29.045580] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T21:49:29.215741] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-06. [2025-09-17T21:49:29.581363] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T21:49:30.015840] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-11. [2025-09-17T21:49:30.254575] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T21:49:30.745321] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-11 (0.73 seconds). [2025-09-17T21:49:30.815840] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-07. [2025-09-17T21:49:31.615793] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-01. [2025-09-17T21:49:31.897294] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T21:49:32.415770] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-08. [2025-09-17T21:49:33.215788] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2024-12. [2025-09-17T21:49:33.754172] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-17T21:49:34.002803] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T21:49:34.015746] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-02. [2025-09-17T21:49:34.095985] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2024-12 (0.88 seconds). [2025-09-17T21:49:34.815788] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-02. [2025-09-17T21:49:35.615785] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-01. [2025-09-17T21:49:35.989268] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T21:49:36.216389] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T21:49:36.268156] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T21:49:36.415758] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-03. [2025-09-17T21:49:37.215793] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-02. [2025-09-17T21:49:37.576965] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-02 (0.36 seconds). [2025-09-17T21:49:38.015797] [INFO ] [REMOTE ] SPNT: Fetching primary data for 2025-09. [2025-09-17T21:49:38.143173] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T21:49:38.815778] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-03. [2025-09-17T21:49:39.123620] [INFO ] [REMOTE ] SPNT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T21:49:39.130366] [INFO ] [REMOTE ] SPNT: Full fetch complete (48612 records). [2025-09-17T21:49:39.130489] [DEBUG] [VALIDATOR ] SPNT: Validating primary data. [2025-09-17T21:49:39.504226] [DEBUG] [VALIDATOR ] SPNT: All expected trading days are present. [2025-09-17T21:49:39.504304] [DEBUG] [VALIDATOR ] SPNT: Primary data validation passed. [2025-09-17T21:49:39.505098] [INFO ] [MAIN ] SPNT: Fetched primary data is valid. [2025-09-17T21:49:39.505142] [DEBUG] [LOCAL ] SPNT: Saving primary data. [2025-09-17T21:49:39.506127] [DEBUG] [LOCAL ] SPNT: Trimmed 48612 records to 34724 (keeping 200 days of data) [2025-09-17T21:49:39.615826] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-03. [2025-09-17T21:49:39.721012] [DEBUG] [LOCAL ] SPNT: Primary data saved (34724 records). [2025-09-17T21:49:39.721146] [INFO ] [MAIN ] SPNT: Full history saved. [2025-09-17T21:49:39.721231] [INFO ] [MAIN ] Update Progress: 1980/2371 symbols completed. SPNT took 40.0s. Estimated remaining: 57m 12s. Rate: 6.8 symbols/min [2025-09-17T21:49:39.889908] [INFO ] [MAIN ] SPXC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:49:39.913707] [DEBUG] [LOCAL ] SPXC: Loaded 23501 existing records from primary storage. [2025-09-17T21:49:39.913849] [INFO ] [MAIN ] SPXC: Loaded 23501 existing records. [2025-09-17T21:49:40.091750] [WARN ] [MAIN ] SPXC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:49:40.091995] [INFO ] [MAIN ] SPXC: Wiping existing primary data before full refresh. [2025-09-17T21:49:40.092040] [INFO ] [LOCAL ] SPXC: Starting deletion of primary data. [2025-09-17T21:49:40.092572] [DEBUG] [LOCAL ] SPXC: Deleted primary data file. [2025-09-17T21:49:40.092625] [INFO ] [MAIN ] SPXC: Starting full primary refresh. [2025-09-17T21:49:40.420809] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-04. [2025-09-17T21:49:40.449402] [INFO ] [REMOTE ] SPXC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:49:40.458442] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T21:49:41.151970] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-17T21:49:41.215724] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-04. [2025-09-17T21:49:42.015876] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-11. [2025-09-17T21:49:42.131208] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T21:49:42.815781] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-05. [2025-09-17T21:49:43.098928] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T21:49:43.272519] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T21:49:43.615788] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2024-12. [2025-09-17T21:49:44.032196] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T21:49:44.415796] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-05. [2025-09-17T21:49:44.779366] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T21:49:45.215873] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-04. [2025-09-17T21:49:45.762893] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T21:49:46.015789] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-06. [2025-09-17T21:49:46.477534] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T21:49:46.815836] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-05. [2025-09-17T21:49:47.321584] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T21:49:47.493287] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T21:49:47.615855] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-06. [2025-09-17T21:49:48.233743] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T21:49:48.415766] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-01. [2025-09-17T21:49:49.192855] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T21:49:49.215721] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-02. [2025-09-17T21:49:50.015784] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-07. [2025-09-17T21:49:50.361133] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T21:49:50.815780] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-03. [2025-09-17T21:49:51.530934] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T21:49:51.615728] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-08. [2025-09-17T21:49:52.015347] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T21:49:52.415758] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-04. [2025-09-17T21:49:52.690614] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T21:49:53.215829] [INFO ] [REMOTE ] SPR: Fetching primary data for 2025-09. [2025-09-17T21:49:53.747915] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T21:49:54.015782] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-07. [2025-09-17T21:49:54.591400] [INFO ] [REMOTE ] SPR: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T21:49:54.599032] [INFO ] [REMOTE ] SPR: Full fetch complete (59926 records). [2025-09-17T21:49:54.599175] [DEBUG] [VALIDATOR ] SPR: Validating primary data. [2025-09-17T21:49:54.826323] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T21:49:54.825579] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-06. [2025-09-17T21:49:55.001174] [DEBUG] [VALIDATOR ] SPR: All expected trading days are present. [2025-09-17T21:49:55.001260] [DEBUG] [VALIDATOR ] SPR: Primary data validation passed. [2025-09-17T21:49:55.002161] [INFO ] [MAIN ] SPR: Fetched primary data is valid. [2025-09-17T21:49:55.002208] [DEBUG] [LOCAL ] SPR: Saving primary data. [2025-09-17T21:49:55.003520] [DEBUG] [LOCAL ] SPR: Trimmed 59926 records to 41443 (keeping 200 days of data) [2025-09-17T21:49:55.253564] [DEBUG] [LOCAL ] SPR: Primary data saved (41443 records). [2025-09-17T21:49:55.253734] [INFO ] [MAIN ] SPR: Full history saved. [2025-09-17T21:49:55.253915] [INFO ] [MAIN ] Update Progress: 1981/2371 symbols completed. SPR took 33.3s. Estimated remaining: 57m 4s. Rate: 6.8 symbols/min [2025-09-17T21:49:55.423765] [INFO ] [MAIN ] SPXX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:49:55.436711] [DEBUG] [LOCAL ] SPXX: Loaded 8978 existing records from primary storage. [2025-09-17T21:49:55.436832] [INFO ] [MAIN ] SPXX: Loaded 8978 existing records. [2025-09-17T21:49:55.613621] [WARN ] [MAIN ] SPXX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:49:55.613913] [INFO ] [MAIN ] SPXX: Wiping existing primary data before full refresh. [2025-09-17T21:49:55.613968] [INFO ] [LOCAL ] SPXX: Starting deletion of primary data. [2025-09-17T21:49:55.614328] [DEBUG] [LOCAL ] SPXX: Deleted primary data file. [2025-09-17T21:49:55.614394] [INFO ] [MAIN ] SPXX: Starting full primary refresh. [2025-09-17T21:49:55.625918] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-08. [2025-09-17T21:49:56.012704] [INFO ] [REMOTE ] SPXX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:49:56.415811] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-05. [2025-09-17T21:49:56.586415] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T21:49:56.767470] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T21:49:57.172778] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T21:49:57.215726] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-06. [2025-09-17T21:49:58.015778] [INFO ] [REMOTE ] SPRU: Fetching primary data for 2025-09. [2025-09-17T21:49:58.249686] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-06 (1.03 seconds). [2025-09-17T21:49:58.566945] [INFO ] [REMOTE ] SPRU: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T21:49:58.568825] [INFO ] [REMOTE ] SPRU: Full fetch complete (11495 records). [2025-09-17T21:49:58.568901] [DEBUG] [VALIDATOR ] SPRU: Validating primary data. [2025-09-17T21:49:58.820935] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-07. [2025-09-17T21:49:58.933808] [DEBUG] [VALIDATOR ] SPRU: All expected trading days are present. [2025-09-17T21:49:58.933912] [DEBUG] [VALIDATOR ] SPRU: Primary data validation passed. [2025-09-17T21:49:58.934209] [INFO ] [MAIN ] SPRU: Fetched primary data is valid. [2025-09-17T21:49:58.934249] [DEBUG] [LOCAL ] SPRU: Saving primary data. [2025-09-17T21:49:58.934734] [DEBUG] [LOCAL ] SPRU: Trimmed 11495 records to 8337 (keeping 200 days of data) [2025-09-17T21:49:58.983556] [DEBUG] [LOCAL ] SPRU: Primary data saved (8337 records). [2025-09-17T21:49:58.983705] [INFO ] [MAIN ] SPRU: Full history saved. [2025-09-17T21:49:58.983808] [INFO ] [MAIN ] Update Progress: 1982/2371 symbols completed. SPRU took 34.1s. Estimated remaining: 56m 54s. Rate: 6.8 symbols/min [2025-09-17T21:49:59.152369] [INFO ] [MAIN ] SQM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:49:59.205417] [DEBUG] [LOCAL ] SQM: Loaded 48657 existing records from primary storage. [2025-09-17T21:49:59.205685] [INFO ] [MAIN ] SQM: Loaded 48657 existing records. [2025-09-17T21:49:59.383949] [WARN ] [MAIN ] SQM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:49:59.384234] [INFO ] [MAIN ] SQM: Wiping existing primary data before full refresh. [2025-09-17T21:49:59.384283] [INFO ] [LOCAL ] SQM: Starting deletion of primary data. [2025-09-17T21:49:59.385159] [DEBUG] [LOCAL ] SQM: Deleted primary data file. [2025-09-17T21:49:59.385211] [INFO ] [MAIN ] SQM: Starting full primary refresh. [2025-09-17T21:49:59.625240] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-11. [2025-09-17T21:49:59.743183] [INFO ] [REMOTE ] SQM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:49:59.985753] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T21:50:00.102900] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T21:50:00.415774] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-07. [2025-09-17T21:50:01.215820] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2024-12. [2025-09-17T21:50:01.964491] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2024-12 (0.75 seconds). [2025-09-17T21:50:02.015806] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-01. [2025-09-17T21:50:02.769543] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-01 (0.75 seconds). [2025-09-17T21:50:02.815820] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-02. [2025-09-17T21:50:03.064899] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-17T21:50:03.365195] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T21:50:03.615826] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-03. [2025-09-17T21:50:04.202241] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T21:50:04.415774] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-08. [2025-09-17T21:50:05.215772] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-11. [2025-09-17T21:50:05.898842] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T21:50:06.015794] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-08. [2025-09-17T21:50:06.697700] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T21:50:06.815809] [INFO ] [REMOTE ] SQM: Fetching primary data for 2024-12. [2025-09-17T21:50:07.615793] [INFO ] [REMOTE ] SPXC: Fetching primary data for 2025-09. [2025-09-17T21:50:08.079415] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T21:50:08.168229] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-08 (2.15 seconds). [2025-09-17T21:50:08.415792] [INFO ] [REMOTE ] SPOT: Fetching primary data for 2025-09. [2025-09-17T21:50:08.482838] [INFO ] [REMOTE ] SPXC: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T21:50:08.486343] [INFO ] [REMOTE ] SPXC: Full fetch complete (33786 records). [2025-09-17T21:50:08.486486] [DEBUG] [VALIDATOR ] SPXC: Validating primary data. [2025-09-17T21:50:08.872874] [DEBUG] [VALIDATOR ] SPXC: All expected trading days are present. [2025-09-17T21:50:08.872956] [DEBUG] [VALIDATOR ] SPXC: Primary data validation passed. [2025-09-17T21:50:08.873630] [INFO ] [MAIN ] SPXC: Fetched primary data is valid. [2025-09-17T21:50:08.873691] [DEBUG] [LOCAL ] SPXC: Saving primary data. [2025-09-17T21:50:08.874510] [DEBUG] [LOCAL ] SPXC: Trimmed 33786 records to 23398 (keeping 200 days of data) [2025-09-17T21:50:09.019280] [DEBUG] [LOCAL ] SPXC: Primary data saved (23398 records). [2025-09-17T21:50:09.019434] [INFO ] [MAIN ] SPXC: Full history saved. [2025-09-17T21:50:09.019534] [INFO ] [MAIN ] Update Progress: 1983/2371 symbols completed. SPXC took 29.3s. Estimated remaining: 56m 46s. Rate: 6.8 symbols/min [2025-09-17T21:50:09.193800] [INFO ] [MAIN ] SQNS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:50:09.219421] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-01. [2025-09-17T21:50:09.221006] [DEBUG] [LOCAL ] SQNS: Loaded 24998 existing records from primary storage. [2025-09-17T21:50:09.221079] [INFO ] [MAIN ] SQNS: Loaded 24998 existing records. [2025-09-17T21:50:09.416451] [WARN ] [MAIN ] SQNS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:50:09.416717] [INFO ] [MAIN ] SQNS: Wiping existing primary data before full refresh. [2025-09-17T21:50:09.416766] [INFO ] [LOCAL ] SQNS: Starting deletion of primary data. [2025-09-17T21:50:09.417358] [DEBUG] [LOCAL ] SQNS: Deleted primary data file. [2025-09-17T21:50:09.417407] [INFO ] [MAIN ] SQNS: Starting full primary refresh. [2025-09-17T21:50:09.777160] [INFO ] [REMOTE ] SQNS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:50:10.015776] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-11. [2025-09-17T21:50:10.304551] [INFO ] [REMOTE ] SPOT: Incremental fetch complete for 2025-09 (1.89 seconds). [2025-09-17T21:50:10.311746] [INFO ] [REMOTE ] SPOT: Full fetch complete (74121 records). [2025-09-17T21:50:10.311956] [DEBUG] [VALIDATOR ] SPOT: Validating primary data. [2025-09-17T21:50:10.722895] [DEBUG] [VALIDATOR ] SPOT: All expected trading days are present. [2025-09-17T21:50:10.723042] [DEBUG] [VALIDATOR ] SPOT: Primary data validation passed. [2025-09-17T21:50:10.724407] [INFO ] [MAIN ] SPOT: Fetched primary data is valid. [2025-09-17T21:50:10.724493] [DEBUG] [LOCAL ] SPOT: Saving primary data. [2025-09-17T21:50:10.748320] [DEBUG] [LOCAL ] SPOT: Trimmed 74121 records to 51070 (keeping 200 days of data) [2025-09-17T21:50:10.750681] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T21:50:10.825856] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-02. [2025-09-17T21:50:11.015963] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T21:50:11.115014] [DEBUG] [LOCAL ] SPOT: Primary data saved (51070 records). [2025-09-17T21:50:11.115163] [INFO ] [MAIN ] SPOT: Full history saved. [2025-09-17T21:50:11.116393] [INFO ] [MAIN ] Update Progress: 1984/2371 symbols completed. SPOT took 51.3s. Estimated remaining: 56m 36s. Rate: 6.8 symbols/min [2025-09-17T21:50:11.299128] [INFO ] [MAIN ] SR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:50:11.334872] [DEBUG] [LOCAL ] SR: Loaded 32597 existing records from primary storage. [2025-09-17T21:50:11.335017] [INFO ] [MAIN ] SR: Loaded 32597 existing records. [2025-09-17T21:50:11.523482] [WARN ] [MAIN ] SR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:50:11.523766] [INFO ] [MAIN ] SR: Wiping existing primary data before full refresh. [2025-09-17T21:50:11.523813] [INFO ] [LOCAL ] SR: Starting deletion of primary data. [2025-09-17T21:50:11.524533] [DEBUG] [LOCAL ] SR: Deleted primary data file. [2025-09-17T21:50:11.524582] [INFO ] [MAIN ] SR: Starting full primary refresh. [2025-09-17T21:50:11.620918] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2024-12. [2025-09-17T21:50:11.912941] [INFO ] [REMOTE ] SR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:50:12.031412] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T21:50:12.325764] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T21:50:12.415805] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-11. [2025-09-17T21:50:13.215817] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-04. [2025-09-17T21:50:13.615355] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T21:50:13.817592] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T21:50:14.015786] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-03. [2025-09-17T21:50:14.815782] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-01. [2025-09-17T21:50:15.615842] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-05. [2025-09-17T21:50:15.805981] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T21:50:15.826515] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-01 (1.01 seconds). [2025-09-17T21:50:16.158391] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T21:50:16.415804] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-02. [2025-09-17T21:50:17.215797] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-06. [2025-09-17T21:50:17.235402] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T21:50:17.979325] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T21:50:18.015728] [INFO ] [REMOTE ] SR: Fetching primary data for 2024-12. [2025-09-17T21:50:18.815735] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-07. [2025-09-17T21:50:19.280023] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T21:50:19.350849] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-17T21:50:19.615779] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-03. [2025-09-17T21:50:20.208095] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-03 (0.59 seconds). [2025-09-17T21:50:20.415803] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-01. [2025-09-17T21:50:21.215800] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-04. [2025-09-17T21:50:21.880949] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T21:50:21.928367] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-04 (0.71 seconds). [2025-09-17T21:50:22.015754] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-04. [2025-09-17T21:50:22.815800] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-02. [2025-09-17T21:50:23.615804] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-05. [2025-09-17T21:50:23.697012] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T21:50:23.759735] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-02 (0.94 seconds). [2025-09-17T21:50:24.167570] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T21:50:24.415774] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-06. [2025-09-17T21:50:25.215749] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-08. [2025-09-17T21:50:25.276102] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T21:50:25.992773] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T21:50:26.015743] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-03. [2025-09-17T21:50:26.815838] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-05. [2025-09-17T21:50:27.242170] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T21:50:27.615791] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-04. [2025-09-17T21:50:28.402720] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T21:50:28.415665] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-06. [2025-09-17T21:50:28.610748] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T21:50:29.215773] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-05. [2025-09-17T21:50:30.015831] [INFO ] [REMOTE ] SPXX: Fetching primary data for 2025-09. [2025-09-17T21:50:30.103282] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T21:50:30.592623] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T21:50:30.770619] [INFO ] [REMOTE ] SPXX: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T21:50:30.772637] [INFO ] [REMOTE ] SPXX: Full fetch complete (12208 records). [2025-09-17T21:50:30.772724] [DEBUG] [VALIDATOR ] SPXX: Validating primary data. [2025-09-17T21:50:30.826134] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-06. [2025-09-17T21:50:31.139249] [DEBUG] [VALIDATOR ] SPXX: All expected trading days are present. [2025-09-17T21:50:31.139335] [DEBUG] [VALIDATOR ] SPXX: Primary data validation passed. [2025-09-17T21:50:31.139660] [INFO ] [MAIN ] SPXX: Fetched primary data is valid. [2025-09-17T21:50:31.139703] [DEBUG] [LOCAL ] SPXX: Saving primary data. [2025-09-17T21:50:31.140215] [DEBUG] [LOCAL ] SPXX: Trimmed 12208 records to 8979 (keeping 200 days of data) [2025-09-17T21:50:31.195566] [DEBUG] [LOCAL ] SPXX: Primary data saved (8979 records). [2025-09-17T21:50:31.195718] [INFO ] [MAIN ] SPXX: Full history saved. [2025-09-17T21:50:31.195806] [INFO ] [MAIN ] Update Progress: 1985/2371 symbols completed. SPXX took 35.9s. Estimated remaining: 56m 29s. Rate: 6.8 symbols/min [2025-09-17T21:50:31.367346] [INFO ] [MAIN ] SRE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:50:31.417543] [DEBUG] [LOCAL ] SRE: Loaded 53422 existing records from primary storage. [2025-09-17T21:50:31.417715] [INFO ] [MAIN ] SRE: Loaded 53422 existing records. [2025-09-17T21:50:31.596526] [WARN ] [MAIN ] SRE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:50:31.596805] [INFO ] [MAIN ] SRE: Wiping existing primary data before full refresh. [2025-09-17T21:50:31.596874] [INFO ] [LOCAL ] SRE: Starting deletion of primary data. [2025-09-17T21:50:31.598068] [DEBUG] [LOCAL ] SRE: Deleted primary data file. [2025-09-17T21:50:31.598129] [INFO ] [MAIN ] SRE: Starting full primary refresh. [2025-09-17T21:50:31.621053] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-07. [2025-09-17T21:50:31.969631] [INFO ] [REMOTE ] SRE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:50:31.988535] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T21:50:32.415819] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-07. [2025-09-17T21:50:33.099923] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T21:50:33.215761] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-07. [2025-09-17T21:50:33.563173] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T21:50:34.015828] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-11. [2025-09-17T21:50:34.815821] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-08. [2025-09-17T21:50:35.408226] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T21:50:35.452766] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-07 (2.24 seconds). [2025-09-17T21:50:35.615785] [INFO ] [REMOTE ] SRE: Fetching primary data for 2024-12. [2025-09-17T21:50:36.174993] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T21:50:36.415772] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-08. [2025-09-17T21:50:37.216111] [INFO ] [REMOTE ] SQM: Fetching primary data for 2025-09. [2025-09-17T21:50:37.647075] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T21:50:37.697810] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T21:50:38.015829] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-01. [2025-09-17T21:50:38.815753] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-08. [2025-09-17T21:50:38.897950] [INFO ] [REMOTE ] SQM: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T21:50:38.904450] [INFO ] [REMOTE ] SQM: Full fetch complete (68830 records). [2025-09-17T21:50:38.904607] [DEBUG] [VALIDATOR ] SQM: Validating primary data. [2025-09-17T21:50:39.306986] [DEBUG] [VALIDATOR ] SQM: All expected trading days are present. [2025-09-17T21:50:39.307087] [DEBUG] [VALIDATOR ] SQM: Primary data validation passed. [2025-09-17T21:50:39.308336] [INFO ] [MAIN ] SQM: Fetched primary data is valid. [2025-09-17T21:50:39.308397] [DEBUG] [LOCAL ] SQM: Saving primary data. [2025-09-17T21:50:39.309993] [DEBUG] [LOCAL ] SQM: Trimmed 68830 records to 48675 (keeping 200 days of data) [2025-09-17T21:50:39.606651] [DEBUG] [LOCAL ] SQM: Primary data saved (48675 records). [2025-09-17T21:50:39.606801] [INFO ] [MAIN ] SQM: Full history saved. [2025-09-17T21:50:39.606930] [INFO ] [MAIN ] Update Progress: 1986/2371 symbols completed. SQM took 40.6s. Estimated remaining: 56m 20s. Rate: 6.8 symbols/min [2025-09-17T21:50:39.640208] [INFO ] [REMOTE ] SR: Fetching primary data for 2025-09. [2025-09-17T21:50:39.792288] [INFO ] [MAIN ] SREA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:50:39.804954] [DEBUG] [LOCAL ] SREA: Loaded 10434 existing records from primary storage. [2025-09-17T21:50:39.805087] [INFO ] [MAIN ] SREA: Loaded 10434 existing records. [2025-09-17T21:50:40.023370] [WARN ] [MAIN ] SREA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:50:40.023804] [INFO ] [MAIN ] SREA: Wiping existing primary data before full refresh. [2025-09-17T21:50:40.026535] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T21:50:40.024559] [INFO ] [LOCAL ] SREA: Starting deletion of primary data. [2025-09-17T21:50:40.037602] [DEBUG] [LOCAL ] SREA: Deleted primary data file. [2025-09-17T21:50:40.037716] [INFO ] [MAIN ] SREA: Starting full primary refresh. [2025-09-17T21:50:40.404080] [INFO ] [REMOTE ] SREA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:50:40.415760] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-11. [2025-09-17T21:50:40.571770] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T21:50:40.811278] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-11 (0.40 seconds). [2025-09-17T21:50:40.934389] [INFO ] [REMOTE ] SR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T21:50:40.938897] [INFO ] [REMOTE ] SR: Full fetch complete (45473 records). [2025-09-17T21:50:40.938995] [DEBUG] [VALIDATOR ] SR: Validating primary data. [2025-09-17T21:50:41.220919] [INFO ] [REMOTE ] SQNS: Fetching primary data for 2025-09. [2025-09-17T21:50:41.342358] [DEBUG] [VALIDATOR ] SR: All expected trading days are present. [2025-09-17T21:50:41.342465] [DEBUG] [VALIDATOR ] SR: Primary data validation passed. [2025-09-17T21:50:41.343352] [INFO ] [MAIN ] SR: Fetched primary data is valid. [2025-09-17T21:50:41.343403] [DEBUG] [LOCAL ] SR: Saving primary data. [2025-09-17T21:50:41.344746] [DEBUG] [LOCAL ] SR: Trimmed 45473 records to 32653 (keeping 200 days of data) [2025-09-17T21:50:41.556003] [DEBUG] [LOCAL ] SR: Primary data saved (32653 records). [2025-09-17T21:50:41.556175] [INFO ] [MAIN ] SR: Full history saved. [2025-09-17T21:50:41.557218] [INFO ] [MAIN ] Update Progress: 1987/2371 symbols completed. SR took 30.4s. Estimated remaining: 56m 10s. Rate: 6.8 symbols/min [2025-09-17T21:50:41.742216] [INFO ] [MAIN ] SRFM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:50:41.778752] [DEBUG] [LOCAL ] SRFM: Loaded 34615 existing records from primary storage. [2025-09-17T21:50:41.778917] [INFO ] [MAIN ] SRFM: Loaded 34615 existing records. [2025-09-17T21:50:41.962267] [WARN ] [MAIN ] SRFM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:50:41.962558] [INFO ] [MAIN ] SRFM: Wiping existing primary data before full refresh. [2025-09-17T21:50:41.962605] [INFO ] [LOCAL ] SRFM: Starting deletion of primary data. [2025-09-17T21:50:41.963306] [DEBUG] [LOCAL ] SRFM: Deleted primary data file. [2025-09-17T21:50:41.963358] [INFO ] [MAIN ] SRFM: Starting full primary refresh. [2025-09-17T21:50:42.027356] [INFO ] [REMOTE ] SREA: Fetching primary data for 2024-12. [2025-09-17T21:50:42.319850] [INFO ] [REMOTE ] SRFM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:50:42.815778] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-11. [2025-09-17T21:50:42.989993] [INFO ] [REMOTE ] SQNS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T21:50:42.998893] [INFO ] [REMOTE ] SQNS: Full fetch complete (31442 records). [2025-09-17T21:50:42.998999] [DEBUG] [VALIDATOR ] SQNS: Validating primary data. [2025-09-17T21:50:43.360618] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T21:50:43.392461] [DEBUG] [VALIDATOR ] SQNS: All expected trading days are present. [2025-09-17T21:50:43.392522] [DEBUG] [VALIDATOR ] SQNS: Primary data validation passed. [2025-09-17T21:50:43.393294] [INFO ] [MAIN ] SQNS: Fetched primary data is valid. [2025-09-17T21:50:43.393349] [DEBUG] [LOCAL ] SQNS: Saving primary data. [2025-09-17T21:50:43.394141] [DEBUG] [LOCAL ] SQNS: Trimmed 31442 records to 25148 (keeping 200 days of data) [2025-09-17T21:50:43.539884] [DEBUG] [LOCAL ] SQNS: Primary data saved (25148 records). [2025-09-17T21:50:43.540027] [INFO ] [MAIN ] SQNS: Full history saved. [2025-09-17T21:50:43.540125] [INFO ] [MAIN ] Update Progress: 1988/2371 symbols completed. SQNS took 34.5s. Estimated remaining: 56m 0s. Rate: 6.8 symbols/min [2025-09-17T21:50:43.620803] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-02. [2025-09-17T21:50:43.715697] [INFO ] [MAIN ] SRG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:50:43.731682] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T21:50:43.750825] [DEBUG] [LOCAL ] SRG: Loaded 16138 existing records from primary storage. [2025-09-17T21:50:43.750950] [INFO ] [MAIN ] SRG: Loaded 16138 existing records. [2025-09-17T21:50:43.928141] [WARN ] [MAIN ] SRG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:50:43.928387] [INFO ] [MAIN ] SRG: Wiping existing primary data before full refresh. [2025-09-17T21:50:43.928450] [INFO ] [LOCAL ] SRG: Starting deletion of primary data. [2025-09-17T21:50:43.928920] [DEBUG] [LOCAL ] SRG: Deleted primary data file. [2025-09-17T21:50:43.928983] [INFO ] [MAIN ] SRG: Starting full primary refresh. [2025-09-17T21:50:44.278070] [INFO ] [REMOTE ] SRG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:50:44.415732] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-11. [2025-09-17T21:50:45.169070] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T21:50:45.215721] [INFO ] [REMOTE ] SRG: Fetching primary data for 2024-12. [2025-09-17T21:50:45.437806] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-02 (1.82 seconds). [2025-09-17T21:50:46.015738] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-03. [2025-09-17T21:50:46.109206] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T21:50:46.815768] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-01. [2025-09-17T21:50:47.615739] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-01. [2025-09-17T21:50:47.712414] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T21:50:47.837188] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T21:50:48.214324] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T21:50:48.415742] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-02. [2025-09-17T21:50:49.215778] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-02. [2025-09-17T21:50:49.253286] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T21:50:50.015784] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-04. [2025-09-17T21:50:50.036984] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T21:50:50.815783] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2024-12. [2025-09-17T21:50:51.615786] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-03. [2025-09-17T21:50:51.989452] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T21:50:52.086768] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T21:50:52.415775] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-05. [2025-09-17T21:50:52.665903] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T21:50:53.215767] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-04. [2025-09-17T21:50:54.015775] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-01. [2025-09-17T21:50:54.257705] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T21:50:54.283942] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T21:50:54.815775] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-05. [2025-09-17T21:50:55.055319] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-01 (1.04 seconds). [2025-09-17T21:50:55.615770] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-03. [2025-09-17T21:50:55.875109] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T21:50:56.184455] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T21:50:56.415780] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-06. [2025-09-17T21:50:57.215774] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-02. [2025-09-17T21:50:57.299096] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T21:50:58.015804] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-06. [2025-09-17T21:50:58.144628] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T21:50:58.815823] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-07. [2025-09-17T21:50:59.615715] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-03. [2025-09-17T21:50:59.634063] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T21:50:59.777471] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T21:51:00.415803] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-04. [2025-09-17T21:51:00.864442] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T21:51:01.192835] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T21:51:01.215779] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-04. [2025-09-17T21:51:02.015808] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-07. [2025-09-17T21:51:02.745630] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T21:51:02.815837] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-08. [2025-09-17T21:51:03.615818] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-05. [2025-09-17T21:51:04.415830] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-05. [2025-09-17T21:51:04.463280] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T21:51:05.106538] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T21:51:05.209670] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-07 (3.19 seconds). [2025-09-17T21:51:05.220451] [INFO ] [REMOTE ] SRG: Fetching primary data for 2025-09. [2025-09-17T21:51:05.494676] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T21:51:06.015783] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-06. [2025-09-17T21:51:06.150742] [INFO ] [REMOTE ] SRG: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T21:51:06.154593] [INFO ] [REMOTE ] SRG: Full fetch complete (25785 records). [2025-09-17T21:51:06.154744] [DEBUG] [VALIDATOR ] SRG: Validating primary data. [2025-09-17T21:51:06.539415] [DEBUG] [VALIDATOR ] SRG: All expected trading days are present. [2025-09-17T21:51:06.539499] [DEBUG] [VALIDATOR ] SRG: Primary data validation passed. [2025-09-17T21:51:06.540074] [INFO ] [MAIN ] SRG: Fetched primary data is valid. [2025-09-17T21:51:06.540125] [DEBUG] [LOCAL ] SRG: Saving primary data. [2025-09-17T21:51:06.540903] [DEBUG] [LOCAL ] SRG: Trimmed 25785 records to 16123 (keeping 200 days of data) [2025-09-17T21:51:06.631184] [DEBUG] [LOCAL ] SRG: Primary data saved (16123 records). [2025-09-17T21:51:06.631341] [INFO ] [MAIN ] SRG: Full history saved. [2025-09-17T21:51:06.631446] [INFO ] [MAIN ] Update Progress: 1989/2371 symbols completed. SRG took 23.1s. Estimated remaining: 55m 54s. Rate: 6.8 symbols/min [2025-09-17T21:51:06.802229] [INFO ] [MAIN ] SRI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:51:06.822836] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-08. [2025-09-17T21:51:06.835873] [DEBUG] [LOCAL ] SRI: Loaded 28243 existing records from primary storage. [2025-09-17T21:51:06.836023] [INFO ] [MAIN ] SRI: Loaded 28243 existing records. [2025-09-17T21:51:07.057767] [WARN ] [MAIN ] SRI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:51:07.058008] [INFO ] [MAIN ] SRI: Wiping existing primary data before full refresh. [2025-09-17T21:51:07.058054] [INFO ] [LOCAL ] SRI: Starting deletion of primary data. [2025-09-17T21:51:07.058693] [DEBUG] [LOCAL ] SRI: Deleted primary data file. [2025-09-17T21:51:07.058741] [INFO ] [MAIN ] SRI: Starting full primary refresh. [2025-09-17T21:51:07.433730] [INFO ] [REMOTE ] SRI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:51:07.614056] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-06 (1.60 seconds). [2025-09-17T21:51:07.621420] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-11. [2025-09-17T21:51:08.295995] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T21:51:08.415824] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-06. [2025-09-17T21:51:08.517286] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T21:51:09.172857] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-06 (0.76 seconds). [2025-09-17T21:51:09.215768] [INFO ] [REMOTE ] SRE: Fetching primary data for 2025-09. [2025-09-17T21:51:09.575381] [INFO ] [REMOTE ] SRE: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T21:51:09.585470] [INFO ] [REMOTE ] SRE: Full fetch complete (77099 records). [2025-09-17T21:51:09.585693] [DEBUG] [VALIDATOR ] SRE: Validating primary data. [2025-09-17T21:51:10.017703] [INFO ] [REMOTE ] SRI: Fetching primary data for 2024-12. [2025-09-17T21:51:10.018975] [DEBUG] [VALIDATOR ] SRE: All expected trading days are present. [2025-09-17T21:51:10.019028] [DEBUG] [VALIDATOR ] SRE: Primary data validation passed. [2025-09-17T21:51:10.020074] [INFO ] [MAIN ] SRE: Fetched primary data is valid. [2025-09-17T21:51:10.020213] [DEBUG] [LOCAL ] SRE: Saving primary data. [2025-09-17T21:51:10.021695] [DEBUG] [LOCAL ] SRE: Trimmed 77099 records to 53422 (keeping 200 days of data) [2025-09-17T21:51:10.358852] [DEBUG] [LOCAL ] SRE: Primary data saved (53422 records). [2025-09-17T21:51:10.358991] [INFO ] [MAIN ] SRE: Full history saved. [2025-09-17T21:51:10.359090] [INFO ] [MAIN ] Update Progress: 1990/2371 symbols completed. SRE took 39.2s. Estimated remaining: 55m 44s. Rate: 6.8 symbols/min [2025-09-17T21:51:10.541931] [INFO ] [MAIN ] SRL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:51:10.542180] [DEBUG] [LOCAL ] SRL: No existing data file found in primary storage. [2025-09-17T21:51:10.542219] [WARN ] [MAIN ] SRL: No existing data found, performing full refresh instead. [2025-09-17T21:51:10.542415] [INFO ] [MAIN ] SRL: Wiping existing primary data before full refresh. [2025-09-17T21:51:10.542457] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-17T21:51:10.542504] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-17T21:51:10.542535] [INFO ] [MAIN ] SRL: Starting full primary refresh. [2025-09-17T21:51:10.820890] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-07. [2025-09-17T21:51:10.911097] [INFO ] [REMOTE ] SRL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:51:11.227513] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T21:51:11.615830] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-07. [2025-09-17T21:51:12.131157] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-07 (0.52 seconds). [2025-09-17T21:51:12.415782] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-08. [2025-09-17T21:51:13.186370] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T21:51:13.215730] [INFO ] [REMOTE ] SREA: Fetching primary data for 2025-09. [2025-09-17T21:51:13.562318] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-17T21:51:13.962688] [INFO ] [REMOTE ] SREA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T21:51:13.964329] [INFO ] [REMOTE ] SREA: Full fetch complete (16001 records). [2025-09-17T21:51:13.964398] [DEBUG] [VALIDATOR ] SREA: Validating primary data. [2025-09-17T21:51:14.020993] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-01. [2025-09-17T21:51:14.341550] [DEBUG] [VALIDATOR ] SREA: All expected trading days are present. [2025-09-17T21:51:14.341631] [DEBUG] [VALIDATOR ] SREA: Primary data validation passed. [2025-09-17T21:51:14.342012] [INFO ] [MAIN ] SREA: Fetched primary data is valid. [2025-09-17T21:51:14.342051] [DEBUG] [LOCAL ] SREA: Saving primary data. [2025-09-17T21:51:14.342557] [DEBUG] [LOCAL ] SREA: Trimmed 16001 records to 10455 (keeping 200 days of data) [2025-09-17T21:51:14.412568] [DEBUG] [LOCAL ] SREA: Primary data saved (10455 records). [2025-09-17T21:51:14.412768] [INFO ] [MAIN ] SREA: Full history saved. [2025-09-17T21:51:14.412896] [INFO ] [MAIN ] Update Progress: 1991/2371 symbols completed. SREA took 34.8s. Estimated remaining: 55m 35s. Rate: 6.8 symbols/min [2025-09-17T21:51:14.582616] [INFO ] [MAIN ] SRV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:51:14.592602] [DEBUG] [LOCAL ] SRV: Loaded 7807 existing records from primary storage. [2025-09-17T21:51:14.592771] [INFO ] [MAIN ] SRV: Loaded 7807 existing records. [2025-09-17T21:51:14.768040] [WARN ] [MAIN ] SRV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:51:14.768294] [INFO ] [MAIN ] SRV: Wiping existing primary data before full refresh. [2025-09-17T21:51:14.768347] [INFO ] [LOCAL ] SRV: Starting deletion of primary data. [2025-09-17T21:51:14.768682] [DEBUG] [LOCAL ] SRV: Deleted primary data file. [2025-09-17T21:51:14.768737] [INFO ] [MAIN ] SRV: Starting full primary refresh. [2025-09-17T21:51:14.822421] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-11. [2025-09-17T21:51:15.122076] [INFO ] [REMOTE ] SRV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:51:15.615834] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-11. [2025-09-17T21:51:16.233047] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T21:51:16.311696] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-01 (2.29 seconds). [2025-09-17T21:51:16.415829] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-08. [2025-09-17T21:51:16.685744] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T21:51:17.215779] [INFO ] [REMOTE ] SRL: Fetching primary data for 2024-12. [2025-09-17T21:51:17.843780] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T21:51:18.015805] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-01. [2025-09-17T21:51:18.455151] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T21:51:18.606566] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-08 (2.19 seconds). [2025-09-17T21:51:18.815796] [INFO ] [REMOTE ] SRV: Fetching primary data for 2024-12. [2025-09-17T21:51:19.615780] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-02. [2025-09-17T21:51:19.819911] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T21:51:20.415793] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-01. [2025-09-17T21:51:20.916742] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T21:51:21.179848] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-01 (0.76 seconds). [2025-09-17T21:51:21.215751] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-02. [2025-09-17T21:51:21.747074] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T21:51:22.015790] [INFO ] [REMOTE ] SRFM: Fetching primary data for 2025-09. [2025-09-17T21:51:22.815773] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-02. [2025-09-17T21:51:23.185719] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-17T21:51:23.615807] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-03. [2025-09-17T21:51:23.676345] [INFO ] [REMOTE ] SRFM: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T21:51:23.683147] [INFO ] [REMOTE ] SRFM: Full fetch complete (48203 records). [2025-09-17T21:51:23.683268] [DEBUG] [VALIDATOR ] SRFM: Validating primary data. [2025-09-17T21:51:24.072148] [DEBUG] [VALIDATOR ] SRFM: All expected trading days are present. [2025-09-17T21:51:24.072229] [DEBUG] [VALIDATOR ] SRFM: Primary data validation passed. [2025-09-17T21:51:24.073028] [INFO ] [MAIN ] SRFM: Fetched primary data is valid. [2025-09-17T21:51:24.073072] [DEBUG] [LOCAL ] SRFM: Saving primary data. [2025-09-17T21:51:24.074121] [DEBUG] [LOCAL ] SRFM: Trimmed 48203 records to 34848 (keeping 200 days of data) [2025-09-17T21:51:24.178008] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-03 (0.56 seconds). [2025-09-17T21:51:24.294179] [DEBUG] [LOCAL ] SRFM: Primary data saved (34848 records). [2025-09-17T21:51:24.294328] [INFO ] [MAIN ] SRFM: Full history saved. [2025-09-17T21:51:24.295085] [INFO ] [MAIN ] Update Progress: 1992/2371 symbols completed. SRFM took 42.7s. Estimated remaining: 55m 26s. Rate: 6.8 symbols/min [2025-09-17T21:51:24.420833] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-04. [2025-09-17T21:51:24.472146] [INFO ] [MAIN ] SSB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:51:24.523926] [DEBUG] [LOCAL ] SSB: Loaded 42892 existing records from primary storage. [2025-09-17T21:51:24.524066] [INFO ] [MAIN ] SSB: Loaded 42892 existing records. [2025-09-17T21:51:24.704162] [WARN ] [MAIN ] SSB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:51:24.704430] [INFO ] [MAIN ] SSB: Wiping existing primary data before full refresh. [2025-09-17T21:51:24.704476] [INFO ] [LOCAL ] SSB: Starting deletion of primary data. [2025-09-17T21:51:24.705402] [DEBUG] [LOCAL ] SSB: Deleted primary data file. [2025-09-17T21:51:24.705453] [INFO ] [MAIN ] SSB: Starting full primary refresh. [2025-09-17T21:51:25.058034] [INFO ] [REMOTE ] SSB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:51:25.215757] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-11. [2025-09-17T21:51:25.311866] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T21:51:26.015803] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-03. [2025-09-17T21:51:26.273948] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T21:51:26.815844] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-05. [2025-09-17T21:51:27.377260] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T21:51:27.615755] [INFO ] [REMOTE ] SSB: Fetching primary data for 2024-12. [2025-09-17T21:51:27.904057] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T21:51:28.415783] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-04. [2025-09-17T21:51:29.215842] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-03. [2025-09-17T21:51:29.397018] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T21:51:29.502363] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-03 (0.29 seconds). [2025-09-17T21:51:29.643666] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T21:51:30.015839] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-05. [2025-09-17T21:51:30.815736] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-04. [2025-09-17T21:51:30.955327] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T21:51:31.188772] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T21:51:31.615824] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-06. [2025-09-17T21:51:32.415774] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-06. [2025-09-17T21:51:32.865518] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T21:51:32.877409] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-06 (0.46 seconds). [2025-09-17T21:51:33.215777] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-07. [2025-09-17T21:51:33.682474] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-07 (0.47 seconds). [2025-09-17T21:51:34.015791] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-07. [2025-09-17T21:51:34.815883] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-05. [2025-09-17T21:51:34.971667] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-07 (0.96 seconds). [2025-09-17T21:51:35.259903] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T21:51:35.615799] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-01. [2025-09-17T21:51:36.415766] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-08. [2025-09-17T21:51:37.207208] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T21:51:37.216373] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-06. [2025-09-17T21:51:37.236105] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-08 (0.82 seconds). [2025-09-17T21:51:37.652261] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-06 (0.44 seconds). [2025-09-17T21:51:38.015826] [INFO ] [REMOTE ] SRI: Fetching primary data for 2025-09. [2025-09-17T21:51:38.815796] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-07. [2025-09-17T21:51:38.880363] [INFO ] [REMOTE ] SRI: Incremental fetch complete for 2025-09 (0.86 seconds). [2025-09-17T21:51:38.884256] [INFO ] [REMOTE ] SRI: Full fetch complete (41874 records). [2025-09-17T21:51:38.884356] [DEBUG] [VALIDATOR ] SRI: Validating primary data. [2025-09-17T21:51:38.949621] [DEBUG] [REMOTE ] SRL: Error fetching primary data for 2025-07: 'API call returned an empty response.' [2025-09-17T21:51:38.977234] [WARN ] [REMOTE ] SRL: No data returned for month 2025-07 [2025-09-17T21:51:39.260828] [DEBUG] [VALIDATOR ] SRI: All expected trading days are present. [2025-09-17T21:51:39.260944] [DEBUG] [VALIDATOR ] SRI: Primary data validation passed. [2025-09-17T21:51:39.261677] [INFO ] [MAIN ] SRI: Fetched primary data is valid. [2025-09-17T21:51:39.261737] [DEBUG] [LOCAL ] SRI: Saving primary data. [2025-09-17T21:51:39.262966] [DEBUG] [LOCAL ] SRI: Trimmed 41874 records to 28111 (keeping 200 days of data) [2025-09-17T21:51:39.428292] [DEBUG] [LOCAL ] SRI: Primary data saved (28111 records). [2025-09-17T21:51:39.428441] [INFO ] [MAIN ] SRI: Full history saved. [2025-09-17T21:51:39.428532] [INFO ] [MAIN ] Update Progress: 1993/2371 symbols completed. SRI took 32.8s. Estimated remaining: 55m 19s. Rate: 6.8 symbols/min [2025-09-17T21:51:39.602454] [INFO ] [MAIN ] SSD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:51:39.615770] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-08. [2025-09-17T21:51:39.625316] [DEBUG] [LOCAL ] SSD: Loaded 22476 existing records from primary storage. [2025-09-17T21:51:39.625418] [INFO ] [MAIN ] SSD: Loaded 22476 existing records. [2025-09-17T21:51:39.805976] [WARN ] [MAIN ] SSD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:51:39.806292] [INFO ] [MAIN ] SSD: Wiping existing primary data before full refresh. [2025-09-17T21:51:39.806387] [INFO ] [LOCAL ] SSD: Starting deletion of primary data. [2025-09-17T21:51:39.807044] [DEBUG] [LOCAL ] SSD: Deleted primary data file. [2025-09-17T21:51:39.807094] [INFO ] [MAIN ] SSD: Starting full primary refresh. [2025-09-17T21:51:40.082044] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T21:51:40.175989] [INFO ] [REMOTE ] SSD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:51:40.415808] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-08. [2025-09-17T21:51:41.159721] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T21:51:41.215735] [INFO ] [REMOTE ] SRV: Fetching primary data for 2025-09. [2025-09-17T21:51:41.892668] [INFO ] [REMOTE ] SRV: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T21:51:41.894097] [INFO ] [REMOTE ] SRV: Full fetch complete (11626 records). [2025-09-17T21:51:41.894169] [DEBUG] [VALIDATOR ] SRV: Validating primary data. [2025-09-17T21:51:42.020860] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-02. [2025-09-17T21:51:42.265232] [DEBUG] [VALIDATOR ] SRV: All expected trading days are present. [2025-09-17T21:51:42.265316] [DEBUG] [VALIDATOR ] SRV: Primary data validation passed. [2025-09-17T21:51:42.265604] [INFO ] [MAIN ] SRV: Fetched primary data is valid. [2025-09-17T21:51:42.265660] [DEBUG] [LOCAL ] SRV: Saving primary data. [2025-09-17T21:51:42.266130] [DEBUG] [LOCAL ] SRV: Trimmed 11626 records to 7809 (keeping 200 days of data) [2025-09-17T21:51:42.314310] [DEBUG] [LOCAL ] SRV: Primary data saved (7809 records). [2025-09-17T21:51:42.314432] [INFO ] [MAIN ] SRV: Full history saved. [2025-09-17T21:51:42.314517] [INFO ] [MAIN ] Update Progress: 1994/2371 symbols completed. SRV took 27.9s. Estimated remaining: 55m 9s. Rate: 6.8 symbols/min [2025-09-17T21:51:42.484416] [INFO ] [MAIN ] SSL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:51:42.522067] [DEBUG] [LOCAL ] SSL: Loaded 41100 existing records from primary storage. [2025-09-17T21:51:42.522223] [INFO ] [MAIN ] SSL: Loaded 41100 existing records. [2025-09-17T21:51:42.698579] [WARN ] [MAIN ] SSL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:51:42.698870] [INFO ] [MAIN ] SSL: Wiping existing primary data before full refresh. [2025-09-17T21:51:42.698916] [INFO ] [LOCAL ] SSL: Starting deletion of primary data. [2025-09-17T21:51:42.700249] [DEBUG] [LOCAL ] SSL: Deleted primary data file. [2025-09-17T21:51:42.700327] [INFO ] [MAIN ] SSL: Starting full primary refresh. [2025-09-17T21:51:42.820893] [INFO ] [REMOTE ] SRL: Fetching primary data for 2025-09. [2025-09-17T21:51:43.071429] [INFO ] [REMOTE ] SSL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:51:43.223801] [INFO ] [REMOTE ] SRL: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T21:51:43.224545] [INFO ] [REMOTE ] SRL: Full fetch complete (1808 records). [2025-09-17T21:51:43.224612] [DEBUG] [VALIDATOR ] SRL: Validating primary data. [2025-09-17T21:51:43.406123] [WARN ] [VALIDATOR ] SRL: Validation failed - insufficient historical data. Have 174 unique days, need 200 days [2025-09-17T21:51:43.406337] [FATAL] [MAIN ] SRL: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:51:43.406387] [WARN ] [MAIN ] SRL: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:51:43.406424] [INFO ] [LOCAL ] SRL: Starting deletion of primary data. [2025-09-17T21:51:43.406494] [DEBUG] [LOCAL ] SRL: No primary data file found to delete. [2025-09-17T21:51:43.406530] [INFO ] [LOCAL ] SRL: Starting deletion of derivative data. [2025-09-17T21:51:43.406578] [DEBUG] [LOCAL ] SRL: No derivative data file found to delete. [2025-09-17T21:51:43.406635] [INFO ] [MAIN ] Update Progress: 1995/2371 symbols completed. SRL took 33.0s. Estimated remaining: 54m 59s. Rate: 6.8 symbols/min [2025-09-17T21:51:43.577702] [INFO ] [MAIN ] SST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:51:43.603409] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T21:51:43.616038] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-03. [2025-09-17T21:51:43.617188] [DEBUG] [LOCAL ] SST: Loaded 12517 existing records from primary storage. [2025-09-17T21:51:43.617256] [INFO ] [MAIN ] SST: Loaded 12517 existing records. [2025-09-17T21:51:43.795663] [WARN ] [MAIN ] SST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:51:43.795885] [INFO ] [MAIN ] SST: Wiping existing primary data before full refresh. [2025-09-17T21:51:43.795930] [INFO ] [LOCAL ] SST: Starting deletion of primary data. [2025-09-17T21:51:43.796276] [DEBUG] [LOCAL ] SST: Deleted primary data file. [2025-09-17T21:51:43.796319] [INFO ] [MAIN ] SST: Starting full primary refresh. [2025-09-17T21:51:44.163122] [INFO ] [REMOTE ] SST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:51:44.415769] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-11. [2025-09-17T21:51:45.224488] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-11. [2025-09-17T21:51:45.231433] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T21:51:45.541005] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T21:51:46.015789] [INFO ] [REMOTE ] SSD: Fetching primary data for 2024-12. [2025-09-17T21:51:46.381261] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T21:51:46.823090] [INFO ] [REMOTE ] SSL: Fetching primary data for 2024-12. [2025-09-17T21:51:46.825366] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T21:51:47.615769] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-01. [2025-09-17T21:51:48.415776] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-11. [2025-09-17T21:51:48.505179] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T21:51:48.557963] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T21:51:49.216987] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-01. [2025-09-17T21:51:49.219131] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T21:51:50.015773] [INFO ] [REMOTE ] SST: Fetching primary data for 2024-12. [2025-09-17T21:51:50.803611] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T21:51:50.815678] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-01. [2025-09-17T21:51:50.907894] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T21:51:51.615811] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-02. [2025-09-17T21:51:51.947301] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T21:51:52.415735] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-02. [2025-09-17T21:51:52.451134] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T21:51:53.215797] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-03. [2025-09-17T21:51:53.242424] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T21:51:54.015734] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-03. [2025-09-17T21:51:54.050690] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-03 (0.83 seconds). [2025-09-17T21:51:54.815774] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-02. [2025-09-17T21:51:54.868384] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T21:51:55.615746] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-04. [2025-09-17T21:51:56.224590] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T21:51:56.307203] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-04 (0.69 seconds). [2025-09-17T21:51:56.415770] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-05. [2025-09-17T21:51:57.139439] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-05 (0.72 seconds). [2025-09-17T21:51:57.215836] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-04. [2025-09-17T21:51:58.015793] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-03. [2025-09-17T21:51:58.737226] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T21:51:58.815856] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-06. [2025-09-17T21:51:59.114211] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T21:51:59.615812] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-04. [2025-09-17T21:51:59.653007] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T21:52:00.415797] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-04. [2025-09-17T21:52:00.860129] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-04 (1.24 seconds). [2025-09-17T21:52:01.215973] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-07. [2025-09-17T21:52:01.517185] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T21:52:01.938958] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T21:52:02.015774] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-05. [2025-09-17T21:52:02.815827] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-08. [2025-09-17T21:52:03.319944] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T21:52:03.367503] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T21:52:03.615796] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-06. [2025-09-17T21:52:04.415798] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-05. [2025-09-17T21:52:04.884191] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T21:52:05.215802] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-07. [2025-09-17T21:52:05.755039] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T21:52:06.015754] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-05. [2025-09-17T21:52:06.340152] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T21:52:06.815803] [INFO ] [REMOTE ] SST: Fetching primary data for 2025-09. [2025-09-17T21:52:07.236672] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-05 (1.22 seconds). [2025-09-17T21:52:07.483539] [INFO ] [REMOTE ] SST: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T21:52:07.485477] [INFO ] [REMOTE ] SST: Full fetch complete (19109 records). [2025-09-17T21:52:07.485587] [DEBUG] [VALIDATOR ] SST: Validating primary data. [2025-09-17T21:52:07.621016] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-08. [2025-09-17T21:52:07.925941] [DEBUG] [VALIDATOR ] SST: All expected trading days are present. [2025-09-17T21:52:07.926097] [DEBUG] [VALIDATOR ] SST: Primary data validation passed. [2025-09-17T21:52:07.927022] [INFO ] [MAIN ] SST: Fetched primary data is valid. [2025-09-17T21:52:07.927106] [DEBUG] [LOCAL ] SST: Saving primary data. [2025-09-17T21:52:07.928215] [DEBUG] [LOCAL ] SST: Trimmed 19109 records to 12440 (keeping 200 days of data) [2025-09-17T21:52:08.019086] [DEBUG] [LOCAL ] SST: Primary data saved (12440 records). [2025-09-17T21:52:08.019331] [INFO ] [MAIN ] SST: Full history saved. [2025-09-17T21:52:08.019550] [INFO ] [MAIN ] Update Progress: 1996/2371 symbols completed. SST took 24.6s. Estimated remaining: 54m 53s. Rate: 6.8 symbols/min [2025-09-17T21:52:08.217157] [INFO ] [MAIN ] SSTK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:52:08.255913] [DEBUG] [LOCAL ] SSTK: Loaded 27284 existing records from primary storage. [2025-09-17T21:52:08.256153] [INFO ] [MAIN ] SSTK: Loaded 27284 existing records. [2025-09-17T21:52:08.420959] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-06. [2025-09-17T21:52:08.466553] [WARN ] [MAIN ] SSTK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:52:08.466958] [INFO ] [MAIN ] SSTK: Wiping existing primary data before full refresh. [2025-09-17T21:52:08.467009] [INFO ] [LOCAL ] SSTK: Starting deletion of primary data. [2025-09-17T21:52:08.467925] [DEBUG] [LOCAL ] SSTK: Deleted primary data file. [2025-09-17T21:52:08.467998] [INFO ] [MAIN ] SSTK: Starting full primary refresh. [2025-09-17T21:52:08.895197] [INFO ] [REMOTE ] SSTK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:52:08.961927] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-08 (1.34 seconds). [2025-09-17T21:52:09.215780] [INFO ] [REMOTE ] SSL: Fetching primary data for 2025-09. [2025-09-17T21:52:10.015828] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-11. [2025-09-17T21:52:10.133285] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T21:52:10.550365] [INFO ] [REMOTE ] SSL: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T21:52:10.556357] [INFO ] [REMOTE ] SSL: Full fetch complete (60210 records). [2025-09-17T21:52:10.556484] [DEBUG] [VALIDATOR ] SSL: Validating primary data. [2025-09-17T21:52:10.822944] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-07. [2025-09-17T21:52:10.951974] [DEBUG] [VALIDATOR ] SSL: All expected trading days are present. [2025-09-17T21:52:10.952066] [DEBUG] [VALIDATOR ] SSL: Primary data validation passed. [2025-09-17T21:52:10.953018] [INFO ] [MAIN ] SSL: Fetched primary data is valid. [2025-09-17T21:52:10.953099] [DEBUG] [LOCAL ] SSL: Saving primary data. [2025-09-17T21:52:10.954854] [DEBUG] [LOCAL ] SSL: Trimmed 60210 records to 41116 (keeping 200 days of data) [2025-09-17T21:52:11.208611] [DEBUG] [LOCAL ] SSL: Primary data saved (41116 records). [2025-09-17T21:52:11.208756] [INFO ] [MAIN ] SSL: Full history saved. [2025-09-17T21:52:11.208921] [INFO ] [MAIN ] Update Progress: 1997/2371 symbols completed. SSL took 28.9s. Estimated remaining: 54m 43s. Rate: 6.8 symbols/min [2025-09-17T21:52:11.373274] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T21:52:11.615803] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2024-12. [2025-09-17T21:52:12.415858] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-06. [2025-09-17T21:52:12.456801] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T21:52:12.960788] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T21:52:13.215775] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-01. [2025-09-17T21:52:13.541875] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T21:52:14.015865] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-07. [2025-09-17T21:52:14.737268] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T21:52:14.815788] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-08. [2025-09-17T21:52:15.257220] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T21:52:15.615808] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-08. [2025-09-17T21:52:16.305952] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T21:52:16.415805] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-02. [2025-09-17T21:52:16.755942] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T21:52:17.215801] [INFO ] [REMOTE ] SSD: Fetching primary data for 2025-09. [2025-09-17T21:52:17.880421] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T21:52:18.015822] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-03. [2025-09-17T21:52:18.271952] [INFO ] [REMOTE ] SSD: Incremental fetch complete for 2025-09 (1.06 seconds). [2025-09-17T21:52:18.275628] [INFO ] [REMOTE ] SSD: Full fetch complete (32086 records). [2025-09-17T21:52:18.275755] [DEBUG] [VALIDATOR ] SSD: Validating primary data. [2025-09-17T21:52:18.662571] [DEBUG] [VALIDATOR ] SSD: All expected trading days are present. [2025-09-17T21:52:18.662672] [DEBUG] [VALIDATOR ] SSD: Primary data validation passed. [2025-09-17T21:52:18.663294] [INFO ] [MAIN ] SSD: Fetched primary data is valid. [2025-09-17T21:52:18.663333] [DEBUG] [LOCAL ] SSD: Saving primary data. [2025-09-17T21:52:18.664263] [DEBUG] [LOCAL ] SSD: Trimmed 32086 records to 22468 (keeping 200 days of data) [2025-09-17T21:52:18.816277] [INFO ] [REMOTE ] SSB: Fetching primary data for 2025-09. [2025-09-17T21:52:18.825599] [DEBUG] [LOCAL ] SSD: Primary data saved (22468 records). [2025-09-17T21:52:18.825731] [INFO ] [MAIN ] SSD: Full history saved. [2025-09-17T21:52:18.825860] [INFO ] [MAIN ] Update Progress: 1998/2371 symbols completed. SSD took 39.4s. Estimated remaining: 54m 34s. Rate: 6.8 symbols/min [2025-09-17T21:52:19.352798] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T21:52:19.615771] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-04. [2025-09-17T21:52:20.125305] [INFO ] [REMOTE ] SSB: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T21:52:20.131437] [INFO ] [REMOTE ] SSB: Full fetch complete (60953 records). [2025-09-17T21:52:20.131600] [DEBUG] [VALIDATOR ] SSB: Validating primary data. [2025-09-17T21:52:20.539160] [DEBUG] [VALIDATOR ] SSB: All expected trading days are present. [2025-09-17T21:52:20.539310] [DEBUG] [VALIDATOR ] SSB: Primary data validation passed. [2025-09-17T21:52:20.540324] [INFO ] [MAIN ] SSB: Fetched primary data is valid. [2025-09-17T21:52:20.540379] [DEBUG] [LOCAL ] SSB: Saving primary data. [2025-09-17T21:52:20.541847] [DEBUG] [LOCAL ] SSB: Trimmed 60953 records to 42962 (keeping 200 days of data) [2025-09-17T21:52:20.828245] [DEBUG] [LOCAL ] SSB: Primary data saved (42962 records). [2025-09-17T21:52:20.828381] [INFO ] [MAIN ] SSB: Full history saved. [2025-09-17T21:52:20.829535] [INFO ] [MAIN ] Update Progress: 1999/2371 symbols completed. SSB took 56.5s. Estimated remaining: 54m 24s. Rate: 6.8 symbols/min [2025-09-17T21:52:21.001469] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T21:52:21.008841] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-05. [2025-09-17T21:52:21.915965] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T21:52:21.923450] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-06. [2025-09-17T21:52:23.089753] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T21:52:23.098157] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-07. [2025-09-17T21:52:24.294173] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-07 (1.20 seconds). [2025-09-17T21:52:24.300407] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-08. [2025-09-17T21:52:25.310626] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T21:52:25.316548] [INFO ] [REMOTE ] SSTK: Fetching primary data for 2025-09. [2025-09-17T21:52:26.408788] [INFO ] [REMOTE ] SSTK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T21:52:26.412103] [INFO ] [REMOTE ] SSTK: Full fetch complete (42440 records). [2025-09-17T21:52:26.412194] [DEBUG] [VALIDATOR ] SSTK: Validating primary data. [2025-09-17T21:52:26.796927] [DEBUG] [VALIDATOR ] SSTK: All expected trading days are present. [2025-09-17T21:52:26.797091] [DEBUG] [VALIDATOR ] SSTK: Primary data validation passed. [2025-09-17T21:52:26.798232] [INFO ] [MAIN ] SSTK: Fetched primary data is valid. [2025-09-17T21:52:26.798291] [DEBUG] [LOCAL ] SSTK: Saving primary data. [2025-09-17T21:52:26.799603] [DEBUG] [LOCAL ] SSTK: Trimmed 42440 records to 27109 (keeping 200 days of data) [2025-09-17T21:52:26.971865] [DEBUG] [LOCAL ] SSTK: Primary data saved (27109 records). [2025-09-17T21:52:26.972008] [INFO ] [MAIN ] SSTK: Full history saved. [2025-09-17T21:52:26.972119] [INFO ] [MAIN ] Update Progress: 2000/2371 symbols completed. SSTK took 19.0s. Estimated remaining: 54m 15s. Rate: 6.8 symbols/min [2025-09-17T21:52:27.667169] [INFO ] [MAIN ] STC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:52:27.666312] [INFO ] [MAIN ] STE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:52:27.663439] [INFO ] [MAIN ] ST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:52:27.645502] [INFO ] [MAIN ] STAG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:52:27.693377] [DEBUG] [LOCAL ] STC: Loaded 17853 existing records from primary storage. [2025-09-17T21:52:27.693588] [INFO ] [MAIN ] STC: Loaded 17853 existing records. [2025-09-17T21:52:27.880844] [DEBUG] [LOCAL ] STE: Loaded 35550 existing records from primary storage. [2025-09-17T21:52:27.936562] [INFO ] [MAIN ] STE: Loaded 35550 existing records. [2025-09-17T21:52:27.945455] [WARN ] [MAIN ] STC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:52:28.020677] [DEBUG] [LOCAL ] ST: Loaded 49890 existing records from primary storage. [2025-09-17T21:52:28.048555] [INFO ] [MAIN ] ST: Loaded 49890 existing records. [2025-09-17T21:52:28.048499] [INFO ] [MAIN ] STC: Wiping existing primary data before full refresh. [2025-09-17T21:52:28.048433] [DEBUG] [LOCAL ] STAG: Loaded 50011 existing records from primary storage. [2025-09-17T21:52:28.074694] [INFO ] [LOCAL ] STC: Starting deletion of primary data. [2025-09-17T21:52:28.108508] [DEBUG] [LOCAL ] STC: Deleted primary data file. [2025-09-17T21:52:28.103358] [INFO ] [MAIN ] STAG: Loaded 50011 existing records. [2025-09-17T21:52:28.116912] [INFO ] [MAIN ] STC: Starting full primary refresh. [2025-09-17T21:52:28.491089] [WARN ] [MAIN ] STE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:52:28.637665] [INFO ] [MAIN ] STE: Wiping existing primary data before full refresh. [2025-09-17T21:52:28.637533] [WARN ] [MAIN ] STAG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:52:28.706858] [INFO ] [LOCAL ] STE: Starting deletion of primary data. [2025-09-17T21:52:28.755863] [INFO ] [MAIN ] STAG: Wiping existing primary data before full refresh. [2025-09-17T21:52:28.764714] [DEBUG] [LOCAL ] STE: Deleted primary data file. [2025-09-17T21:52:28.746690] [WARN ] [MAIN ] ST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:52:28.764866] [INFO ] [LOCAL ] STAG: Starting deletion of primary data. [2025-09-17T21:52:28.766580] [INFO ] [MAIN ] STE: Starting full primary refresh. [2025-09-17T21:52:28.822172] [DEBUG] [LOCAL ] STAG: Deleted primary data file. [2025-09-17T21:52:28.809557] [INFO ] [MAIN ] ST: Wiping existing primary data before full refresh. [2025-09-17T21:52:28.835439] [INFO ] [LOCAL ] ST: Starting deletion of primary data. [2025-09-17T21:52:28.835294] [INFO ] [MAIN ] STAG: Starting full primary refresh. [2025-09-17T21:52:28.948982] [DEBUG] [LOCAL ] ST: Deleted primary data file. [2025-09-17T21:52:29.036009] [INFO ] [MAIN ] ST: Starting full primary refresh. [2025-09-17T21:52:29.373363] [INFO ] [REMOTE ] STC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:52:29.483254] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-11. [2025-09-17T21:52:30.019574] [INFO ] [REMOTE ] STE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:52:30.024190] [INFO ] [REMOTE ] STAG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:52:30.024685] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-11. [2025-09-17T21:52:30.026135] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-11. [2025-09-17T21:52:30.110437] [INFO ] [REMOTE ] ST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:52:30.110878] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-11. [2025-09-17T21:52:30.669558] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T21:52:30.672874] [INFO ] [REMOTE ] STC: Fetching primary data for 2024-12. [2025-09-17T21:52:31.152107] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T21:52:31.160082] [INFO ] [REMOTE ] STE: Fetching primary data for 2024-12. [2025-09-17T21:52:31.655905] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-11 (1.63 seconds). [2025-09-17T21:52:31.665441] [INFO ] [REMOTE ] STAG: Fetching primary data for 2024-12. [2025-09-17T21:52:31.770767] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T21:52:31.780487] [INFO ] [REMOTE ] ST: Fetching primary data for 2024-12. [2025-09-17T21:52:31.792052] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T21:52:31.796596] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-01. [2025-09-17T21:52:32.275723] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T21:52:32.282799] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-01. [2025-09-17T21:52:32.831412] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T21:52:32.835891] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-02. [2025-09-17T21:52:33.007124] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2024-12 (1.34 seconds). [2025-09-17T21:52:33.215784] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-01. [2025-09-17T21:52:33.581146] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T21:52:33.661083] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T21:52:33.808197] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T21:52:34.015783] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-03. [2025-09-17T21:52:34.559383] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-01 (1.34 seconds). [2025-09-17T21:52:34.815782] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-02. [2025-09-17T21:52:35.066996] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T21:52:35.615771] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-01. [2025-09-17T21:52:36.260765] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T21:52:36.415781] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-03. [2025-09-17T21:52:36.828776] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T21:52:37.215797] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-02. [2025-09-17T21:52:37.665038] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-03 (1.25 seconds). [2025-09-17T21:52:38.015839] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-04. [2025-09-17T21:52:38.562456] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T21:52:38.815800] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-03. [2025-09-17T21:52:38.852083] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T21:52:39.615824] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-05. [2025-09-17T21:52:40.415787] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-02. [2025-09-17T21:52:40.715884] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T21:52:40.759972] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T21:52:41.215854] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-06. [2025-09-17T21:52:42.017326] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T21:52:42.015880] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-04. [2025-09-17T21:52:42.044690] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-06 (0.83 seconds). [2025-09-17T21:52:42.815832] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-03. [2025-09-17T21:52:43.615793] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-04. [2025-09-17T21:52:43.814532] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T21:52:44.415794] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-07. [2025-09-17T21:52:44.624874] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T21:52:44.719164] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T21:52:45.157578] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T21:52:45.215751] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-08. [2025-09-17T21:52:46.015791] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-05. [2025-09-17T21:52:46.074779] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T21:52:46.815784] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-04. [2025-09-17T21:52:47.615831] [INFO ] [REMOTE ] STC: Fetching primary data for 2025-09. [2025-09-17T21:52:47.666919] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T21:52:48.286849] [INFO ] [REMOTE ] STC: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T21:52:48.290657] [INFO ] [REMOTE ] STC: Full fetch complete (25971 records). [2025-09-17T21:52:48.290772] [DEBUG] [VALIDATOR ] STC: Validating primary data. [2025-09-17T21:52:48.418485] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-05. [2025-09-17T21:52:48.677594] [DEBUG] [VALIDATOR ] STC: All expected trading days are present. [2025-09-17T21:52:48.677749] [DEBUG] [VALIDATOR ] STC: Primary data validation passed. [2025-09-17T21:52:48.678288] [INFO ] [MAIN ] STC: Fetched primary data is valid. [2025-09-17T21:52:48.678372] [DEBUG] [LOCAL ] STC: Saving primary data. [2025-09-17T21:52:48.707075] [DEBUG] [LOCAL ] STC: Trimmed 25971 records to 17858 (keeping 200 days of data) [2025-09-17T21:52:48.708132] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T21:52:48.841105] [DEBUG] [LOCAL ] STC: Primary data saved (17858 records). [2025-09-17T21:52:48.841264] [INFO ] [MAIN ] STC: Full history saved. [2025-09-17T21:52:48.841357] [INFO ] [MAIN ] Update Progress: 2001/2371 symbols completed. STC took 21.9s. Estimated remaining: 54m 8s. Rate: 6.8 symbols/min [2025-09-17T21:52:49.018663] [INFO ] [MAIN ] STEL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:52:49.041556] [DEBUG] [LOCAL ] STEL: Loaded 23747 existing records from primary storage. [2025-09-17T21:52:49.041707] [INFO ] [MAIN ] STEL: Loaded 23747 existing records. [2025-09-17T21:52:49.230006] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-05. [2025-09-17T21:52:49.235563] [WARN ] [MAIN ] STEL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:52:49.236526] [INFO ] [MAIN ] STEL: Wiping existing primary data before full refresh. [2025-09-17T21:52:49.236588] [INFO ] [LOCAL ] STEL: Starting deletion of primary data. [2025-09-17T21:52:49.237126] [DEBUG] [LOCAL ] STEL: Deleted primary data file. [2025-09-17T21:52:49.237174] [INFO ] [MAIN ] STEL: Starting full primary refresh. [2025-09-17T21:52:49.607822] [INFO ] [REMOTE ] STEL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:52:49.993683] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T21:52:50.015719] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-06. [2025-09-17T21:52:50.815760] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-11. [2025-09-17T21:52:51.246303] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T21:52:51.453306] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T21:52:51.586493] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-11 (0.77 seconds). [2025-09-17T21:52:51.615734] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-07. [2025-09-17T21:52:52.415776] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-06. [2025-09-17T21:52:53.204851] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T21:52:53.215730] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-08. [2025-09-17T21:52:54.015743] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-06. [2025-09-17T21:52:54.081738] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T21:52:54.679767] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T21:52:54.815796] [INFO ] [REMOTE ] STE: Fetching primary data for 2025-09. [2025-09-17T21:52:55.398247] [INFO ] [REMOTE ] STE: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T21:52:55.402774] [INFO ] [REMOTE ] STE: Full fetch complete (50640 records). [2025-09-17T21:52:55.402876] [DEBUG] [VALIDATOR ] STE: Validating primary data. [2025-09-17T21:52:55.621912] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-07. [2025-09-17T21:52:55.793144] [DEBUG] [VALIDATOR ] STE: All expected trading days are present. [2025-09-17T21:52:55.793270] [DEBUG] [VALIDATOR ] STE: Primary data validation passed. [2025-09-17T21:52:55.794242] [INFO ] [MAIN ] STE: Fetched primary data is valid. [2025-09-17T21:52:55.794310] [DEBUG] [LOCAL ] STE: Saving primary data. [2025-09-17T21:52:55.795706] [DEBUG] [LOCAL ] STE: Trimmed 50640 records to 35477 (keeping 200 days of data) [2025-09-17T21:52:55.923099] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T21:52:56.065576] [DEBUG] [LOCAL ] STE: Primary data saved (35477 records). [2025-09-17T21:52:56.065760] [INFO ] [MAIN ] STE: Full history saved. [2025-09-17T21:52:56.065858] [INFO ] [MAIN ] Update Progress: 2002/2371 symbols completed. STE took 29.1s. Estimated remaining: 53m 59s. Rate: 6.8 symbols/min [2025-09-17T21:52:56.234631] [INFO ] [MAIN ] STEM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:52:56.273916] [DEBUG] [LOCAL ] STEM: Loaded 40395 existing records from primary storage. [2025-09-17T21:52:56.274078] [INFO ] [MAIN ] STEM: Loaded 40395 existing records. [2025-09-17T21:52:56.424094] [INFO ] [REMOTE ] STEL: Fetching primary data for 2024-12. [2025-09-17T21:52:56.454894] [WARN ] [MAIN ] STEM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:52:56.455177] [INFO ] [MAIN ] STEM: Wiping existing primary data before full refresh. [2025-09-17T21:52:56.455224] [INFO ] [LOCAL ] STEM: Starting deletion of primary data. [2025-09-17T21:52:56.455986] [DEBUG] [LOCAL ] STEM: Deleted primary data file. [2025-09-17T21:52:56.456035] [INFO ] [MAIN ] STEM: Starting full primary refresh. [2025-09-17T21:52:56.812173] [INFO ] [REMOTE ] STEM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:52:57.215806] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-07. [2025-09-17T21:52:57.470043] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T21:52:57.508458] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2024-12 (1.08 seconds). [2025-09-17T21:52:58.015810] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-01. [2025-09-17T21:52:58.650540] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T21:52:58.821493] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-02. [2025-09-17T21:52:58.835264] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T21:52:59.615794] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-11. [2025-09-17T21:52:59.888635] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T21:53:00.415800] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-08. [2025-09-17T21:53:01.215844] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-03. [2025-09-17T21:53:01.498456] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T21:53:02.015818] [INFO ] [REMOTE ] STEM: Fetching primary data for 2024-12. [2025-09-17T21:53:02.198297] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T21:53:02.360032] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T21:53:02.815851] [INFO ] [REMOTE ] STAG: Fetching primary data for 2025-09. [2025-09-17T21:53:03.616034] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-08. [2025-09-17T21:53:04.140949] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2024-12 (2.13 seconds). [2025-09-17T21:53:04.191447] [INFO ] [REMOTE ] STAG: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T21:53:04.197788] [INFO ] [REMOTE ] STAG: Full fetch complete (71619 records). [2025-09-17T21:53:04.197963] [DEBUG] [VALIDATOR ] STAG: Validating primary data. [2025-09-17T21:53:04.426176] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-04. [2025-09-17T21:53:04.597269] [DEBUG] [VALIDATOR ] STAG: All expected trading days are present. [2025-09-17T21:53:04.597374] [DEBUG] [VALIDATOR ] STAG: Primary data validation passed. [2025-09-17T21:53:04.598423] [INFO ] [MAIN ] STAG: Fetched primary data is valid. [2025-09-17T21:53:04.598473] [DEBUG] [LOCAL ] STAG: Saving primary data. [2025-09-17T21:53:04.600009] [DEBUG] [LOCAL ] STAG: Trimmed 71619 records to 50025 (keeping 200 days of data) [2025-09-17T21:53:04.924403] [DEBUG] [LOCAL ] STAG: Primary data saved (50025 records). [2025-09-17T21:53:04.924634] [INFO ] [MAIN ] STAG: Full history saved. [2025-09-17T21:53:04.926513] [INFO ] [MAIN ] Update Progress: 2003/2371 symbols completed. STAG took 38.0s. Estimated remaining: 53m 50s. Rate: 6.8 symbols/min [2025-09-17T21:53:05.098013] [INFO ] [MAIN ] STEW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:53:05.128588] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-08 (1.51 seconds). [2025-09-17T21:53:05.150786] [DEBUG] [LOCAL ] STEW: Loaded 16424 existing records from primary storage. [2025-09-17T21:53:05.150923] [INFO ] [MAIN ] STEW: Loaded 16424 existing records. [2025-09-17T21:53:05.225002] [INFO ] [REMOTE ] ST: Fetching primary data for 2025-09. [2025-09-17T21:53:05.329252] [WARN ] [MAIN ] STEW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:53:05.329454] [INFO ] [MAIN ] STEW: Wiping existing primary data before full refresh. [2025-09-17T21:53:05.329498] [INFO ] [LOCAL ] STEW: Starting deletion of primary data. [2025-09-17T21:53:05.329918] [DEBUG] [LOCAL ] STEW: Deleted primary data file. [2025-09-17T21:53:05.329965] [INFO ] [MAIN ] STEW: Starting full primary refresh. [2025-09-17T21:53:05.689762] [INFO ] [REMOTE ] STEW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:53:05.861328] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T21:53:06.015759] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-11. [2025-09-17T21:53:06.514692] [INFO ] [REMOTE ] ST: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T21:53:06.520984] [INFO ] [REMOTE ] ST: Full fetch complete (71719 records). [2025-09-17T21:53:06.521093] [DEBUG] [VALIDATOR ] ST: Validating primary data. [2025-09-17T21:53:06.820867] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-01. [2025-09-17T21:53:06.912668] [DEBUG] [VALIDATOR ] ST: All expected trading days are present. [2025-09-17T21:53:06.912772] [DEBUG] [VALIDATOR ] ST: Primary data validation passed. [2025-09-17T21:53:06.913905] [INFO ] [MAIN ] ST: Fetched primary data is valid. [2025-09-17T21:53:06.913956] [DEBUG] [LOCAL ] ST: Saving primary data. [2025-09-17T21:53:06.915545] [DEBUG] [LOCAL ] ST: Trimmed 71719 records to 49888 (keeping 200 days of data) [2025-09-17T21:53:07.025702] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-11 (1.01 seconds). [2025-09-17T21:53:07.249525] [DEBUG] [LOCAL ] ST: Primary data saved (49888 records). [2025-09-17T21:53:07.249705] [INFO ] [MAIN ] ST: Full history saved. [2025-09-17T21:53:07.249804] [INFO ] [MAIN ] Update Progress: 2004/2371 symbols completed. ST took 40.3s. Estimated remaining: 53m 40s. Rate: 6.8 symbols/min [2025-09-17T21:53:07.420884] [INFO ] [MAIN ] STG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:53:07.421074] [DEBUG] [LOCAL ] STG: No existing data file found in primary storage. [2025-09-17T21:53:07.421115] [WARN ] [MAIN ] STG: No existing data found, performing full refresh instead. [2025-09-17T21:53:07.421239] [INFO ] [MAIN ] STG: Wiping existing primary data before full refresh. [2025-09-17T21:53:07.421336] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-17T21:53:07.421387] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-17T21:53:07.421423] [INFO ] [MAIN ] STG: Starting full primary refresh. [2025-09-17T21:53:07.620976] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-05. [2025-09-17T21:53:07.793666] [INFO ] [REMOTE ] STG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:53:08.415802] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-11. [2025-09-17T21:53:08.895826] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T21:53:08.912903] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T21:53:09.191152] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-01 (2.37 seconds). [2025-09-17T21:53:09.215735] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-02. [2025-09-17T21:53:10.015832] [INFO ] [REMOTE ] STG: Fetching primary data for 2024-12. [2025-09-17T21:53:10.358291] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2024-12 (0.34 seconds). [2025-09-17T21:53:10.815791] [INFO ] [REMOTE ] STEW: Fetching primary data for 2024-12. [2025-09-17T21:53:11.154717] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T21:53:11.615763] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-03. [2025-09-17T21:53:11.802497] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T21:53:12.415792] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-06. [2025-09-17T21:53:13.215776] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-01. [2025-09-17T21:53:13.492943] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-06 (1.08 seconds). [2025-09-17T21:53:13.547532] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T21:53:13.668448] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T21:53:14.015787] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-07. [2025-09-17T21:53:14.815809] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-04. [2025-09-17T21:53:15.319979] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T21:53:15.615873] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-02. [2025-09-17T21:53:15.962486] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T21:53:16.415823] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-03. [2025-09-17T21:53:16.755815] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T21:53:16.822596] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-17T21:53:17.215813] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-01. [2025-09-17T21:53:18.015836] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-04. [2025-09-17T21:53:18.040907] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-01 (0.83 seconds). [2025-09-17T21:53:18.290274] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-04 (0.27 seconds). [2025-09-17T21:53:18.815793] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-02. [2025-09-17T21:53:19.575511] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T21:53:19.615806] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-08. [2025-09-17T21:53:20.415776] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-03. [2025-09-17T21:53:20.661535] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T21:53:21.156687] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T21:53:21.215736] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-04. [2025-09-17T21:53:22.015790] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-05. [2025-09-17T21:53:22.314703] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T21:53:22.815845] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-05. [2025-09-17T21:53:23.163375] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-17T21:53:23.615817] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-06. [2025-09-17T21:53:23.957750] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T21:53:24.120681] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-05 (2.10 seconds). [2025-09-17T21:53:24.415810] [INFO ] [REMOTE ] STEL: Fetching primary data for 2025-09. [2025-09-17T21:53:25.215778] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-06. [2025-09-17T21:53:25.312600] [INFO ] [REMOTE ] STEL: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T21:53:25.316015] [INFO ] [REMOTE ] STEL: Full fetch complete (31952 records). [2025-09-17T21:53:25.316106] [DEBUG] [VALIDATOR ] STEL: Validating primary data. [2025-09-17T21:53:25.683468] [DEBUG] [VALIDATOR ] STEL: All expected trading days are present. [2025-09-17T21:53:25.683553] [DEBUG] [VALIDATOR ] STEL: Primary data validation passed. [2025-09-17T21:53:25.687330] [INFO ] [MAIN ] STEL: Fetched primary data is valid. [2025-09-17T21:53:25.687404] [DEBUG] [LOCAL ] STEL: Saving primary data. [2025-09-17T21:53:25.688390] [DEBUG] [LOCAL ] STEL: Trimmed 31952 records to 23806 (keeping 200 days of data) [2025-09-17T21:53:25.836216] [DEBUG] [LOCAL ] STEL: Primary data saved (23806 records). [2025-09-17T21:53:25.836360] [INFO ] [MAIN ] STEL: Full history saved. [2025-09-17T21:53:25.836460] [INFO ] [MAIN ] Update Progress: 2005/2371 symbols completed. STEL took 37.0s. Estimated remaining: 53m 33s. Rate: 6.8 symbols/min [2025-09-17T21:53:26.009043] [INFO ] [MAIN ] STK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:53:26.018829] [DEBUG] [LOCAL ] STK: Loaded 9356 existing records from primary storage. [2025-09-17T21:53:26.018919] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-07. [2025-09-17T21:53:26.019767] [INFO ] [MAIN ] STK: Loaded 9356 existing records. [2025-09-17T21:53:26.198922] [WARN ] [MAIN ] STK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:53:26.199150] [INFO ] [MAIN ] STK: Wiping existing primary data before full refresh. [2025-09-17T21:53:26.199195] [INFO ] [LOCAL ] STK: Starting deletion of primary data. [2025-09-17T21:53:26.199488] [DEBUG] [LOCAL ] STK: Deleted primary data file. [2025-09-17T21:53:26.199534] [INFO ] [MAIN ] STK: Starting full primary refresh. [2025-09-17T21:53:26.554015] [INFO ] [REMOTE ] STK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:53:26.815777] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-11. [2025-09-17T21:53:26.837965] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T21:53:26.967908] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T21:53:27.413224] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T21:53:27.615786] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-05. [2025-09-17T21:53:28.415799] [INFO ] [REMOTE ] STK: Fetching primary data for 2024-12. [2025-09-17T21:53:28.719404] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-05 (1.10 seconds). [2025-09-17T21:53:29.215824] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-08. [2025-09-17T21:53:29.234927] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T21:53:29.604272] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-17T21:53:30.015821] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-06. [2025-09-17T21:53:30.815779] [INFO ] [REMOTE ] STG: Fetching primary data for 2025-09. [2025-09-17T21:53:30.914568] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T21:53:31.115958] [INFO ] [REMOTE ] STG: Incremental fetch complete for 2025-09 (0.30 seconds). [2025-09-17T21:53:31.116847] [INFO ] [REMOTE ] STG: Full fetch complete (2449 records). [2025-09-17T21:53:31.116919] [DEBUG] [VALIDATOR ] STG: Validating primary data. [2025-09-17T21:53:31.304262] [WARN ] [VALIDATOR ] STG: Validation failed - insufficient historical data. Have 187 unique days, need 200 days [2025-09-17T21:53:31.304502] [FATAL] [MAIN ] STG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:53:31.304574] [WARN ] [MAIN ] STG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:53:31.304669] [INFO ] [LOCAL ] STG: Starting deletion of primary data. [2025-09-17T21:53:31.304751] [DEBUG] [LOCAL ] STG: No primary data file found to delete. [2025-09-17T21:53:31.304795] [INFO ] [LOCAL ] STG: Starting deletion of derivative data. [2025-09-17T21:53:31.304835] [DEBUG] [LOCAL ] STG: No derivative data file found to delete. [2025-09-17T21:53:31.304918] [INFO ] [MAIN ] Update Progress: 2006/2371 symbols completed. STG took 24.1s. Estimated remaining: 53m 24s. Rate: 6.8 symbols/min [2025-09-17T21:53:31.513932] [INFO ] [MAIN ] STLA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:53:31.514099] [DEBUG] [LOCAL ] STLA: No existing data file found in primary storage. [2025-09-17T21:53:31.514135] [WARN ] [MAIN ] STLA: No existing data found, performing full refresh instead. [2025-09-17T21:53:31.514285] [INFO ] [MAIN ] STLA: Wiping existing primary data before full refresh. [2025-09-17T21:53:31.514333] [INFO ] [LOCAL ] STLA: Starting deletion of primary data. [2025-09-17T21:53:31.514374] [DEBUG] [LOCAL ] STLA: No primary data file found to delete. [2025-09-17T21:53:31.514406] [INFO ] [MAIN ] STLA: Starting full primary refresh. [2025-09-17T21:53:31.620931] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-01. [2025-09-17T21:53:31.893476] [INFO ] [REMOTE ] STLA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:53:32.348357] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T21:53:32.415777] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-02. [2025-09-17T21:53:32.946314] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-02 (0.53 seconds). [2025-09-17T21:53:33.215849] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-07. [2025-09-17T21:53:34.015777] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-03. [2025-09-17T21:53:34.202800] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-07 (0.99 seconds). [2025-09-17T21:53:34.481466] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T21:53:34.815836] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-11. [2025-09-17T21:53:35.615812] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-08. [2025-09-17T21:53:36.415798] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-07. [2025-09-17T21:53:36.508580] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T21:53:36.693499] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T21:53:37.215780] [INFO ] [REMOTE ] STLA: Fetching primary data for 2024-12. [2025-09-17T21:53:37.857149] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T21:53:38.015778] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-08. [2025-09-17T21:53:38.815790] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-04. [2025-09-17T21:53:39.399527] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T21:53:39.508575] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2024-12 (2.29 seconds). [2025-09-17T21:53:39.555852] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T21:53:39.615787] [INFO ] [REMOTE ] STEM: Fetching primary data for 2025-09. [2025-09-17T21:53:40.415780] [INFO ] [REMOTE ] STEW: Fetching primary data for 2025-09. [2025-09-17T21:53:40.822970] [INFO ] [REMOTE ] STEM: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T21:53:40.827151] [INFO ] [REMOTE ] STEM: Full fetch complete (63138 records). [2025-09-17T21:53:40.827277] [DEBUG] [VALIDATOR ] STEM: Validating primary data. [2025-09-17T21:53:41.173941] [INFO ] [REMOTE ] STEW: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T21:53:41.209348] [INFO ] [REMOTE ] STEW: Full fetch complete (22133 records). [2025-09-17T21:53:41.223322] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-01. [2025-09-17T21:53:41.246043] [DEBUG] [VALIDATOR ] STEM: All expected trading days are present. [2025-09-17T21:53:41.244922] [DEBUG] [VALIDATOR ] STEW: Validating primary data. [2025-09-17T21:53:41.246179] [DEBUG] [VALIDATOR ] STEM: Primary data validation passed. [2025-09-17T21:53:41.247719] [INFO ] [MAIN ] STEM: Fetched primary data is valid. [2025-09-17T21:53:41.247844] [DEBUG] [LOCAL ] STEM: Saving primary data. [2025-09-17T21:53:41.351713] [DEBUG] [LOCAL ] STEM: Trimmed 63138 records to 40364 (keeping 200 days of data) [2025-09-17T21:53:41.727937] [DEBUG] [VALIDATOR ] STEW: All expected trading days are present. [2025-09-17T21:53:41.729309] [DEBUG] [VALIDATOR ] STEW: Primary data validation passed. [2025-09-17T21:53:41.731973] [INFO ] [MAIN ] STEW: Fetched primary data is valid. [2025-09-17T21:53:41.732046] [DEBUG] [LOCAL ] STEW: Saving primary data. [2025-09-17T21:53:41.735789] [DEBUG] [LOCAL ] STEW: Trimmed 22133 records to 16468 (keeping 200 days of data) [2025-09-17T21:53:41.955474] [DEBUG] [LOCAL ] STEW: Primary data saved (16468 records). [2025-09-17T21:53:41.958425] [INFO ] [MAIN ] STEW: Full history saved. [2025-09-17T21:53:41.958565] [INFO ] [MAIN ] Update Progress: 2007/2371 symbols completed. STEW took 37.0s. Estimated remaining: 53m 16s. Rate: 6.8 symbols/min [2025-09-17T21:53:42.018451] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-05. [2025-09-17T21:53:42.151867] [INFO ] [MAIN ] STM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:53:42.157887] [DEBUG] [LOCAL ] STEM: Primary data saved (40364 records). [2025-09-17T21:53:42.157977] [INFO ] [MAIN ] STEM: Full history saved. [2025-09-17T21:53:42.158059] [INFO ] [MAIN ] Update Progress: 2008/2371 symbols completed. STEM took 46.1s. Estimated remaining: 53m 5s. Rate: 6.8 symbols/min [2025-09-17T21:53:42.333914] [INFO ] [MAIN ] STN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:53:42.374303] [DEBUG] [LOCAL ] STM: Loaded 53590 existing records from primary storage. [2025-09-17T21:53:42.374459] [INFO ] [MAIN ] STM: Loaded 53590 existing records. [2025-09-17T21:53:42.484631] [DEBUG] [LOCAL ] STN: Loaded 23240 existing records from primary storage. [2025-09-17T21:53:42.495679] [INFO ] [MAIN ] STN: Loaded 23240 existing records. [2025-09-17T21:53:42.606159] [WARN ] [MAIN ] STM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:53:42.650431] [INFO ] [MAIN ] STM: Wiping existing primary data before full refresh. [2025-09-17T21:53:42.678420] [INFO ] [LOCAL ] STM: Starting deletion of primary data. [2025-09-17T21:53:42.687024] [DEBUG] [LOCAL ] STM: Deleted primary data file. [2025-09-17T21:53:42.697301] [INFO ] [MAIN ] STM: Starting full primary refresh. [2025-09-17T21:53:42.850288] [WARN ] [MAIN ] STN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:53:42.867234] [INFO ] [MAIN ] STN: Wiping existing primary data before full refresh. [2025-09-17T21:53:42.883471] [INFO ] [LOCAL ] STN: Starting deletion of primary data. [2025-09-17T21:53:42.884165] [DEBUG] [LOCAL ] STN: Deleted primary data file. [2025-09-17T21:53:42.889449] [INFO ] [MAIN ] STN: Starting full primary refresh. [2025-09-17T21:53:43.020137] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T21:53:43.172555] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-06. [2025-09-17T21:53:43.442498] [INFO ] [REMOTE ] STM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:53:43.524926] [INFO ] [REMOTE ] STN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:53:43.615737] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-11. [2025-09-17T21:53:43.705872] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-01 (2.48 seconds). [2025-09-17T21:53:44.014010] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T21:53:44.329579] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T21:53:44.415726] [INFO ] [REMOTE ] STN: Fetching primary data for 2024-12. [2025-09-17T21:53:45.127929] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T21:53:45.215814] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-11. [2025-09-17T21:53:46.015799] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-07. [2025-09-17T21:53:46.780624] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T21:53:46.815779] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-08. [2025-09-17T21:53:47.260342] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-11 (2.04 seconds). [2025-09-17T21:53:47.489179] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T21:53:47.615771] [INFO ] [REMOTE ] STM: Fetching primary data for 2024-12. [2025-09-17T21:53:48.415786] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-01. [2025-09-17T21:53:49.215807] [INFO ] [REMOTE ] STK: Fetching primary data for 2025-09. [2025-09-17T21:53:49.510047] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2024-12 (1.89 seconds). [2025-09-17T21:53:49.563915] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T21:53:50.015778] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-02. [2025-09-17T21:53:50.083369] [INFO ] [REMOTE ] STK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T21:53:50.085689] [INFO ] [REMOTE ] STK: Full fetch complete (13780 records). [2025-09-17T21:53:50.085791] [DEBUG] [VALIDATOR ] STK: Validating primary data. [2025-09-17T21:53:50.473798] [DEBUG] [VALIDATOR ] STK: All expected trading days are present. [2025-09-17T21:53:50.473914] [DEBUG] [VALIDATOR ] STK: Primary data validation passed. [2025-09-17T21:53:50.474259] [INFO ] [MAIN ] STK: Fetched primary data is valid. [2025-09-17T21:53:50.474302] [DEBUG] [LOCAL ] STK: Saving primary data. [2025-09-17T21:53:50.474897] [DEBUG] [LOCAL ] STK: Trimmed 13780 records to 9386 (keeping 200 days of data) [2025-09-17T21:53:50.538380] [DEBUG] [LOCAL ] STK: Primary data saved (9386 records). [2025-09-17T21:53:50.538546] [INFO ] [MAIN ] STK: Full history saved. [2025-09-17T21:53:50.538675] [INFO ] [MAIN ] Update Progress: 2009/2371 symbols completed. STK took 24.7s. Estimated remaining: 52m 56s. Rate: 6.8 symbols/min [2025-09-17T21:53:50.711933] [INFO ] [MAIN ] STNG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:53:50.758036] [DEBUG] [LOCAL ] STNG: Loaded 44153 existing records from primary storage. [2025-09-17T21:53:50.758212] [INFO ] [MAIN ] STNG: Loaded 44153 existing records. [2025-09-17T21:53:50.821003] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-01. [2025-09-17T21:53:50.945338] [WARN ] [MAIN ] STNG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:53:50.945596] [INFO ] [MAIN ] STNG: Wiping existing primary data before full refresh. [2025-09-17T21:53:50.945668] [INFO ] [LOCAL ] STNG: Starting deletion of primary data. [2025-09-17T21:53:50.946462] [DEBUG] [LOCAL ] STNG: Deleted primary data file. [2025-09-17T21:53:50.946524] [INFO ] [MAIN ] STNG: Starting full primary refresh. [2025-09-17T21:53:51.318731] [INFO ] [REMOTE ] STNG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:53:51.331844] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T21:53:51.615773] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-11. [2025-09-17T21:53:52.415735] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-03. [2025-09-17T21:53:52.944018] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T21:53:52.988273] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T21:53:53.200575] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T21:53:53.215787] [INFO ] [REMOTE ] STNG: Fetching primary data for 2024-12. [2025-09-17T21:53:54.015783] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-02. [2025-09-17T21:53:54.815794] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-02. [2025-09-17T21:53:54.852273] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T21:53:55.615713] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-04. [2025-09-17T21:53:55.681321] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T21:53:56.415689] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-03. [2025-09-17T21:53:56.485965] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T21:53:56.979374] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-02 (2.16 seconds). [2025-09-17T21:53:57.215791] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-01. [2025-09-17T21:53:58.015746] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-05. [2025-09-17T21:53:58.142032] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T21:53:58.815749] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-03. [2025-09-17T21:53:58.917464] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T21:53:59.219232] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T21:53:59.615790] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-02. [2025-09-17T21:54:00.415816] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-06. [2025-09-17T21:54:00.865023] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T21:54:01.056904] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T21:54:01.221615] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-03. [2025-09-17T21:54:01.225374] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T21:54:02.015818] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-07. [2025-09-17T21:54:02.815803] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-04. [2025-09-17T21:54:03.615764] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-04. [2025-09-17T21:54:03.692291] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-03 (2.47 seconds). [2025-09-17T21:54:04.311390] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-07 (2.30 seconds). [2025-09-17T21:54:04.415769] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-08. [2025-09-17T21:54:05.215883] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-04. [2025-09-17T21:54:05.570782] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-08 (1.16 seconds). [2025-09-17T21:54:05.683006] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-04 (2.87 seconds). [2025-09-17T21:54:06.015828] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-05. [2025-09-17T21:54:06.170364] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-17T21:54:06.501177] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T21:54:06.815836] [INFO ] [REMOTE ] STN: Fetching primary data for 2025-09. [2025-09-17T21:54:07.529084] [INFO ] [REMOTE ] STN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T21:54:07.533118] [INFO ] [REMOTE ] STN: Full fetch complete (32094 records). [2025-09-17T21:54:07.533285] [DEBUG] [VALIDATOR ] STN: Validating primary data. [2025-09-17T21:54:07.621093] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-05. [2025-09-17T21:54:07.926586] [DEBUG] [VALIDATOR ] STN: All expected trading days are present. [2025-09-17T21:54:07.926713] [DEBUG] [VALIDATOR ] STN: Primary data validation passed. [2025-09-17T21:54:07.927476] [INFO ] [MAIN ] STN: Fetched primary data is valid. [2025-09-17T21:54:07.927563] [DEBUG] [LOCAL ] STN: Saving primary data. [2025-09-17T21:54:07.961448] [DEBUG] [LOCAL ] STN: Trimmed 32094 records to 23143 (keeping 200 days of data) [2025-09-17T21:54:07.964120] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T21:54:08.124629] [DEBUG] [LOCAL ] STN: Primary data saved (23143 records). [2025-09-17T21:54:08.124790] [INFO ] [MAIN ] STN: Full history saved. [2025-09-17T21:54:08.124889] [INFO ] [MAIN ] Update Progress: 2010/2371 symbols completed. STN took 26.0s. Estimated remaining: 52m 49s. Rate: 6.8 symbols/min [2025-09-17T21:54:08.296160] [INFO ] [MAIN ] STRV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:54:08.309181] [DEBUG] [LOCAL ] STRV: Loaded 11753 existing records from primary storage. [2025-09-17T21:54:08.309304] [INFO ] [MAIN ] STRV: Loaded 11753 existing records. [2025-09-17T21:54:08.420980] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-05. [2025-09-17T21:54:08.496020] [WARN ] [MAIN ] STRV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:54:08.496347] [INFO ] [MAIN ] STRV: Wiping existing primary data before full refresh. [2025-09-17T21:54:08.496396] [INFO ] [LOCAL ] STRV: Starting deletion of primary data. [2025-09-17T21:54:08.496855] [DEBUG] [LOCAL ] STRV: Deleted primary data file. [2025-09-17T21:54:08.496904] [INFO ] [MAIN ] STRV: Starting full primary refresh. [2025-09-17T21:54:08.886127] [INFO ] [REMOTE ] STRV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:54:09.215771] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-06. [2025-09-17T21:54:09.756933] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-05 (2.14 seconds). [2025-09-17T21:54:10.019682] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-06. [2025-09-17T21:54:10.024207] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T21:54:10.815813] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-11. [2025-09-17T21:54:10.916933] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T21:54:11.540035] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T21:54:11.615746] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-07. [2025-09-17T21:54:11.684123] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-11 (0.87 seconds). [2025-09-17T21:54:12.415762] [INFO ] [REMOTE ] STRV: Fetching primary data for 2024-12. [2025-09-17T21:54:13.215762] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-07. [2025-09-17T21:54:13.429674] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T21:54:13.844451] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-07 (2.23 seconds). [2025-09-17T21:54:14.015782] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-08. [2025-09-17T21:54:14.815804] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-01. [2025-09-17T21:54:15.600472] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-07 (2.38 seconds). [2025-09-17T21:54:15.615672] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-08. [2025-09-17T21:54:15.685801] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T21:54:15.801878] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T21:54:16.415782] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-02. [2025-09-17T21:54:17.215780] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-06. [2025-09-17T21:54:17.561448] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-02 (1.15 seconds). [2025-09-17T21:54:18.015755] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-03. [2025-09-17T21:54:18.166189] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-08 (2.55 seconds). [2025-09-17T21:54:18.815783] [INFO ] [REMOTE ] STM: Fetching primary data for 2025-09. [2025-09-17T21:54:19.536683] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T21:54:19.615752] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-04. [2025-09-17T21:54:19.652066] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-06 (2.44 seconds). [2025-09-17T21:54:20.415702] [INFO ] [REMOTE ] STLA: Fetching primary data for 2025-09. [2025-09-17T21:54:20.437606] [INFO ] [REMOTE ] STM: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T21:54:20.445568] [INFO ] [REMOTE ] STM: Full fetch complete (77360 records). [2025-09-17T21:54:20.445820] [DEBUG] [VALIDATOR ] STM: Validating primary data. [2025-09-17T21:54:20.456932] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T21:54:20.868717] [DEBUG] [VALIDATOR ] STM: All expected trading days are present. [2025-09-17T21:54:20.868834] [DEBUG] [VALIDATOR ] STM: Primary data validation passed. [2025-09-17T21:54:20.870325] [INFO ] [MAIN ] STM: Fetched primary data is valid. [2025-09-17T21:54:20.870414] [DEBUG] [LOCAL ] STM: Saving primary data. [2025-09-17T21:54:20.872417] [DEBUG] [LOCAL ] STM: Trimmed 77360 records to 53589 (keeping 200 days of data) [2025-09-17T21:54:21.215805] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-07. [2025-09-17T21:54:21.232157] [DEBUG] [LOCAL ] STM: Primary data saved (53589 records). [2025-09-17T21:54:21.232310] [INFO ] [MAIN ] STM: Full history saved. [2025-09-17T21:54:21.234147] [INFO ] [MAIN ] Update Progress: 2011/2371 symbols completed. STM took 39.3s. Estimated remaining: 52m 41s. Rate: 6.8 symbols/min [2025-09-17T21:54:21.408639] [INFO ] [MAIN ] STT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:54:21.462528] [DEBUG] [LOCAL ] STT: Loaded 51275 existing records from primary storage. [2025-09-17T21:54:21.462710] [INFO ] [MAIN ] STT: Loaded 51275 existing records. [2025-09-17T21:54:21.642636] [WARN ] [MAIN ] STT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:54:21.642911] [INFO ] [MAIN ] STT: Wiping existing primary data before full refresh. [2025-09-17T21:54:21.642959] [INFO ] [LOCAL ] STT: Starting deletion of primary data. [2025-09-17T21:54:21.644050] [DEBUG] [LOCAL ] STT: Deleted primary data file. [2025-09-17T21:54:21.644124] [INFO ] [MAIN ] STT: Starting full primary refresh. [2025-09-17T21:54:22.005072] [INFO ] [REMOTE ] STT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:54:22.015745] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-05. [2025-09-17T21:54:22.499133] [INFO ] [REMOTE ] STLA: Incremental fetch complete for 2025-09 (2.08 seconds). [2025-09-17T21:54:22.506231] [INFO ] [REMOTE ] STLA: Full fetch complete (77396 records). [2025-09-17T21:54:22.506393] [DEBUG] [VALIDATOR ] STLA: Validating primary data. [2025-09-17T21:54:22.821015] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-11. [2025-09-17T21:54:22.907992] [DEBUG] [VALIDATOR ] STLA: All expected trading days are present. [2025-09-17T21:54:22.908389] [DEBUG] [VALIDATOR ] STLA: Primary data validation passed. [2025-09-17T21:54:22.909723] [INFO ] [MAIN ] STLA: Fetched primary data is valid. [2025-09-17T21:54:22.909962] [DEBUG] [LOCAL ] STLA: Saving primary data. [2025-09-17T21:54:22.919057] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T21:54:22.923248] [DEBUG] [LOCAL ] STLA: Trimmed 77396 records to 53547 (keeping 200 days of data) [2025-09-17T21:54:23.058164] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T21:54:23.285493] [DEBUG] [LOCAL ] STLA: Primary data saved (53547 records). [2025-09-17T21:54:23.285636] [INFO ] [MAIN ] STLA: Full history saved. [2025-09-17T21:54:23.285735] [INFO ] [MAIN ] Update Progress: 2012/2371 symbols completed. STLA took 52.0s. Estimated remaining: 52m 31s. Rate: 6.8 symbols/min [2025-09-17T21:54:23.453614] [INFO ] [MAIN ] STUB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:54:23.453851] [DEBUG] [LOCAL ] STUB: No existing data file found in primary storage. [2025-09-17T21:54:23.453901] [WARN ] [MAIN ] STUB: No existing data found, performing full refresh instead. [2025-09-17T21:54:23.454021] [INFO ] [MAIN ] STUB: Wiping existing primary data before full refresh. [2025-09-17T21:54:23.454063] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-17T21:54:23.454104] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-17T21:54:23.454136] [INFO ] [MAIN ] STUB: Starting full primary refresh. [2025-09-17T21:54:23.625462] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-08. [2025-09-17T21:54:23.809145] [INFO ] [REMOTE ] STUB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:54:24.415789] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-06. [2025-09-17T21:54:24.648010] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T21:54:24.885297] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-08 (1.26 seconds). [2025-09-17T21:54:25.215829] [INFO ] [REMOTE ] STNG: Fetching primary data for 2025-09. [2025-09-17T21:54:25.294371] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T21:54:26.015828] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-07. [2025-09-17T21:54:26.583056] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T21:54:26.658561] [INFO ] [REMOTE ] STNG: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T21:54:26.665091] [INFO ] [REMOTE ] STNG: Full fetch complete (64281 records). [2025-09-17T21:54:26.665352] [DEBUG] [VALIDATOR ] STNG: Validating primary data. [2025-09-17T21:54:26.820940] [INFO ] [REMOTE ] STT: Fetching primary data for 2024-12. [2025-09-17T21:54:27.096034] [DEBUG] [VALIDATOR ] STNG: All expected trading days are present. [2025-09-17T21:54:27.096162] [DEBUG] [VALIDATOR ] STNG: Primary data validation passed. [2025-09-17T21:54:27.097823] [INFO ] [MAIN ] STNG: Fetched primary data is valid. [2025-09-17T21:54:27.097951] [DEBUG] [LOCAL ] STNG: Saving primary data. [2025-09-17T21:54:27.100107] [DEBUG] [LOCAL ] STNG: Trimmed 64281 records to 44189 (keeping 200 days of data) [2025-09-17T21:54:27.403562] [DEBUG] [LOCAL ] STNG: Primary data saved (44189 records). [2025-09-17T21:54:27.403768] [INFO ] [MAIN ] STNG: Full history saved. [2025-09-17T21:54:27.404963] [INFO ] [MAIN ] Update Progress: 2013/2371 symbols completed. STNG took 36.9s. Estimated remaining: 52m 22s. Rate: 6.8 symbols/min [2025-09-17T21:54:27.587348] [INFO ] [MAIN ] STVN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:54:27.619753] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-11. [2025-09-17T21:54:27.621570] [DEBUG] [LOCAL ] STVN: Loaded 26636 existing records from primary storage. [2025-09-17T21:54:27.621793] [INFO ] [MAIN ] STVN: Loaded 26636 existing records. [2025-09-17T21:54:27.814881] [WARN ] [MAIN ] STVN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:54:27.815218] [INFO ] [MAIN ] STVN: Wiping existing primary data before full refresh. [2025-09-17T21:54:27.815270] [INFO ] [LOCAL ] STVN: Starting deletion of primary data. [2025-09-17T21:54:27.816011] [DEBUG] [LOCAL ] STVN: Deleted primary data file. [2025-09-17T21:54:27.816068] [INFO ] [MAIN ] STVN: Starting full primary refresh. [2025-09-17T21:54:27.926740] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:54:27.930443] [WARN ] [REMOTE ] STUB: No data returned for month 2024-11 [2025-09-17T21:54:28.206086] [INFO ] [REMOTE ] STVN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:54:28.415787] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-08. [2025-09-17T21:54:28.736861] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T21:54:29.215799] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-01. [2025-09-17T21:54:29.245981] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T21:54:30.015798] [INFO ] [REMOTE ] STRV: Fetching primary data for 2025-09. [2025-09-17T21:54:30.725216] [INFO ] [REMOTE ] STRV: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T21:54:30.726899] [INFO ] [REMOTE ] STRV: Full fetch complete (18698 records). [2025-09-17T21:54:30.726969] [DEBUG] [VALIDATOR ] STRV: Validating primary data. [2025-09-17T21:54:30.823101] [INFO ] [REMOTE ] STUB: Fetching primary data for 2024-12. [2025-09-17T21:54:31.091565] [DEBUG] [VALIDATOR ] STRV: All expected trading days are present. [2025-09-17T21:54:31.091671] [DEBUG] [VALIDATOR ] STRV: Primary data validation passed. [2025-09-17T21:54:31.092098] [INFO ] [MAIN ] STRV: Fetched primary data is valid. [2025-09-17T21:54:31.092140] [DEBUG] [LOCAL ] STRV: Saving primary data. [2025-09-17T21:54:31.092816] [DEBUG] [LOCAL ] STRV: Trimmed 18698 records to 11738 (keeping 200 days of data) [2025-09-17T21:54:31.173811] [DEBUG] [LOCAL ] STRV: Primary data saved (11738 records). [2025-09-17T21:54:31.174018] [INFO ] [MAIN ] STRV: Full history saved. [2025-09-17T21:54:31.174142] [INFO ] [MAIN ] Update Progress: 2014/2371 symbols completed. STRV took 23.0s. Estimated remaining: 52m 12s. Rate: 6.8 symbols/min [2025-09-17T21:54:31.384996] [INFO ] [MAIN ] STWD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:54:31.442766] [DEBUG] [LOCAL ] STWD: Loaded 51905 existing records from primary storage. [2025-09-17T21:54:31.442941] [INFO ] [MAIN ] STWD: Loaded 51905 existing records. [2025-09-17T21:54:31.619475] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-11. [2025-09-17T21:54:31.670731] [WARN ] [MAIN ] STWD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:54:31.677226] [INFO ] [MAIN ] STWD: Wiping existing primary data before full refresh. [2025-09-17T21:54:31.676970] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-01 (2.46 seconds). [2025-09-17T21:54:31.687839] [INFO ] [LOCAL ] STWD: Starting deletion of primary data. [2025-09-17T21:54:31.689677] [DEBUG] [LOCAL ] STWD: Deleted primary data file. [2025-09-17T21:54:31.689751] [INFO ] [MAIN ] STWD: Starting full primary refresh. [2025-09-17T21:54:31.839062] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:54:31.870321] [WARN ] [REMOTE ] STUB: No data returned for month 2024-12 [2025-09-17T21:54:32.055725] [INFO ] [REMOTE ] STWD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:54:32.415769] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-11. [2025-09-17T21:54:33.169332] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T21:54:33.215739] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-02. [2025-09-17T21:54:34.015783] [INFO ] [REMOTE ] STVN: Fetching primary data for 2024-12. [2025-09-17T21:54:34.109291] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T21:54:34.815787] [INFO ] [REMOTE ] STWD: Fetching primary data for 2024-12. [2025-09-17T21:54:34.911219] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T21:54:34.944923] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T21:54:35.615774] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-01. [2025-09-17T21:54:36.416172] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-03. [2025-09-17T21:54:36.620035] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T21:54:36.898949] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-01 (1.28 seconds). [2025-09-17T21:54:37.215771] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-01. [2025-09-17T21:54:37.421627] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:54:37.422020] [WARN ] [REMOTE ] STUB: No data returned for month 2025-01 [2025-09-17T21:54:38.015783] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-02. [2025-09-17T21:54:38.152489] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T21:54:38.809827] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T21:54:38.816174] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-04. [2025-09-17T21:54:39.615792] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-01. [2025-09-17T21:54:40.415784] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-03. [2025-09-17T21:54:40.484224] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T21:54:41.215778] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-05. [2025-09-17T21:54:41.355505] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T21:54:41.652318] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T21:54:42.015770] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-02. [2025-09-17T21:54:42.210983] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:54:42.211251] [WARN ] [REMOTE ] STUB: No data returned for month 2025-02 [2025-09-17T21:54:42.625527] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T21:54:42.815729] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-06. [2025-09-17T21:54:43.615781] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-04. [2025-09-17T21:54:44.096950] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T21:54:44.415761] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-07. [2025-09-17T21:54:44.907781] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T21:54:45.215772] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-02. [2025-09-17T21:54:46.015820] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-03. [2025-09-17T21:54:46.219274] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:54:46.219552] [WARN ] [REMOTE ] STUB: No data returned for month 2025-03 [2025-09-17T21:54:46.270915] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T21:54:46.815738] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-04. [2025-09-17T21:54:47.013678] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:54:47.014214] [WARN ] [REMOTE ] STUB: No data returned for month 2025-04 [2025-09-17T21:54:47.060463] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-02 (1.84 seconds). [2025-09-17T21:54:47.615769] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-03. [2025-09-17T21:54:48.415776] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-05. [2025-09-17T21:54:48.614886] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:54:48.615145] [WARN ] [REMOTE ] STUB: No data returned for month 2025-05 [2025-09-17T21:54:49.215780] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-06. [2025-09-17T21:54:49.424906] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:54:49.425258] [WARN ] [REMOTE ] STUB: No data returned for month 2025-06 [2025-09-17T21:54:49.457776] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T21:54:50.015776] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-04. [2025-09-17T21:54:50.815769] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-08. [2025-09-17T21:54:51.616504] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-05. [2025-09-17T21:54:51.619177] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T21:54:52.415771] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-05. [2025-09-17T21:54:52.539132] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T21:54:53.047167] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T21:54:53.215764] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-06. [2025-09-17T21:54:53.941391] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T21:54:54.015777] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-06. [2025-09-17T21:54:54.072307] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T21:54:54.815825] [INFO ] [REMOTE ] STT: Fetching primary data for 2025-09. [2025-09-17T21:54:55.615698] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-07. [2025-09-17T21:54:55.713567] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T21:54:55.740634] [INFO ] [REMOTE ] STT: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T21:54:55.747958] [INFO ] [REMOTE ] STT: Full fetch complete (74567 records). [2025-09-17T21:54:55.748090] [DEBUG] [VALIDATOR ] STT: Validating primary data. [2025-09-17T21:54:56.152268] [DEBUG] [VALIDATOR ] STT: All expected trading days are present. [2025-09-17T21:54:56.152376] [DEBUG] [VALIDATOR ] STT: Primary data validation passed. [2025-09-17T21:54:56.153444] [INFO ] [MAIN ] STT: Fetched primary data is valid. [2025-09-17T21:54:56.153511] [DEBUG] [LOCAL ] STT: Saving primary data. [2025-09-17T21:54:56.155697] [DEBUG] [LOCAL ] STT: Trimmed 74567 records to 51245 (keeping 200 days of data) [2025-09-17T21:54:56.444461] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-07. [2025-09-17T21:54:56.486155] [DEBUG] [LOCAL ] STT: Primary data saved (51245 records). [2025-09-17T21:54:56.486300] [INFO ] [MAIN ] STT: Full history saved. [2025-09-17T21:54:56.487068] [INFO ] [MAIN ] Update Progress: 2015/2371 symbols completed. STT took 35.3s. Estimated remaining: 52m 6s. Rate: 6.8 symbols/min [2025-09-17T21:54:56.660662] [INFO ] [MAIN ] STXD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:54:56.661898] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:54:56.662174] [WARN ] [REMOTE ] STUB: No data returned for month 2025-07 [2025-09-17T21:54:56.665367] [DEBUG] [LOCAL ] STXD: Loaded 1330 existing records from primary storage. [2025-09-17T21:54:56.665432] [INFO ] [MAIN ] STXD: Loaded 1330 existing records. [2025-09-17T21:54:56.844862] [WARN ] [MAIN ] STXD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:54:56.845135] [INFO ] [MAIN ] STXD: Wiping existing primary data before full refresh. [2025-09-17T21:54:56.845260] [INFO ] [LOCAL ] STXD: Starting deletion of primary data. [2025-09-17T21:54:56.845581] [DEBUG] [LOCAL ] STXD: Deleted primary data file. [2025-09-17T21:54:56.845732] [INFO ] [MAIN ] STXD: Starting full primary refresh. [2025-09-17T21:54:57.115015] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T21:54:57.216736] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-08. [2025-09-17T21:54:57.229611] [INFO ] [REMOTE ] STXD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:54:57.441941] [DEBUG] [REMOTE ] STUB: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T21:54:57.442233] [WARN ] [REMOTE ] STUB: No data returned for month 2025-08 [2025-09-17T21:54:58.015798] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-08. [2025-09-17T21:54:58.815784] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-07. [2025-09-17T21:54:58.886441] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T21:54:59.615805] [INFO ] [REMOTE ] STUB: Fetching primary data for 2025-09. [2025-09-17T21:55:00.040252] [INFO ] [REMOTE ] STUB: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T21:55:00.041349] [INFO ] [REMOTE ] STUB: Full fetch complete (225 records). [2025-09-17T21:55:00.041482] [DEBUG] [VALIDATOR ] STUB: Validating primary data. [2025-09-17T21:55:00.241062] [WARN ] [VALIDATOR ] STUB: Validation failed - insufficient historical data. Have 1 unique days, need 200 days [2025-09-17T21:55:00.241237] [FATAL] [MAIN ] STUB: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:55:00.241284] [WARN ] [MAIN ] STUB: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:55:00.241369] [INFO ] [LOCAL ] STUB: Starting deletion of primary data. [2025-09-17T21:55:00.241427] [DEBUG] [LOCAL ] STUB: No primary data file found to delete. [2025-09-17T21:55:00.241462] [INFO ] [LOCAL ] STUB: Starting deletion of derivative data. [2025-09-17T21:55:00.241566] [DEBUG] [LOCAL ] STUB: No derivative data file found to delete. [2025-09-17T21:55:00.241664] [INFO ] [MAIN ] Update Progress: 2016/2371 symbols completed. STUB took 37.0s. Estimated remaining: 51m 57s. Rate: 6.8 symbols/min [2025-09-17T21:55:00.410259] [INFO ] [MAIN ] STXE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:55:00.416040] [DEBUG] [LOCAL ] STXE: Loaded 2282 existing records from primary storage. [2025-09-17T21:55:00.416295] [INFO ] [MAIN ] STXE: Loaded 2282 existing records. [2025-09-17T21:55:00.416158] [INFO ] [REMOTE ] STVN: Fetching primary data for 2025-09. [2025-09-17T21:55:00.596126] [WARN ] [MAIN ] STXE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:55:00.596401] [INFO ] [MAIN ] STXE: Wiping existing primary data before full refresh. [2025-09-17T21:55:00.596446] [INFO ] [LOCAL ] STXE: Starting deletion of primary data. [2025-09-17T21:55:00.596623] [DEBUG] [LOCAL ] STXE: Deleted primary data file. [2025-09-17T21:55:00.596696] [INFO ] [MAIN ] STXE: Starting full primary refresh. [2025-09-17T21:55:00.966484] [INFO ] [REMOTE ] STXE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:55:01.000361] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T21:55:01.215783] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-11. [2025-09-17T21:55:01.584613] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-11 (0.37 seconds). [2025-09-17T21:55:01.812832] [INFO ] [REMOTE ] STVN: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T21:55:01.817205] [INFO ] [REMOTE ] STVN: Full fetch complete (39409 records). [2025-09-17T21:55:01.817311] [DEBUG] [VALIDATOR ] STVN: Validating primary data. [2025-09-17T21:55:02.020975] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-08. [2025-09-17T21:55:02.199453] [DEBUG] [VALIDATOR ] STVN: All expected trading days are present. [2025-09-17T21:55:02.199530] [DEBUG] [VALIDATOR ] STVN: Primary data validation passed. [2025-09-17T21:55:02.200270] [INFO ] [MAIN ] STVN: Fetched primary data is valid. [2025-09-17T21:55:02.200313] [DEBUG] [LOCAL ] STVN: Saving primary data. [2025-09-17T21:55:02.201200] [DEBUG] [LOCAL ] STVN: Trimmed 39409 records to 26565 (keeping 200 days of data) [2025-09-17T21:55:02.362452] [DEBUG] [LOCAL ] STVN: Primary data saved (26565 records). [2025-09-17T21:55:02.362586] [INFO ] [MAIN ] STVN: Full history saved. [2025-09-17T21:55:02.362717] [INFO ] [MAIN ] Update Progress: 2017/2371 symbols completed. STVN took 35.0s. Estimated remaining: 51m 47s. Rate: 6.8 symbols/min [2025-09-17T21:55:02.532540] [INFO ] [MAIN ] STXG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:55:02.536833] [DEBUG] [LOCAL ] STXG: Loaded 2663 existing records from primary storage. [2025-09-17T21:55:02.536920] [INFO ] [MAIN ] STXG: Loaded 2663 existing records. [2025-09-17T21:55:02.724529] [WARN ] [MAIN ] STXG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:55:02.724861] [INFO ] [MAIN ] STXG: Wiping existing primary data before full refresh. [2025-09-17T21:55:02.724912] [INFO ] [LOCAL ] STXG: Starting deletion of primary data. [2025-09-17T21:55:02.725370] [DEBUG] [LOCAL ] STXG: Deleted primary data file. [2025-09-17T21:55:02.725418] [INFO ] [MAIN ] STXG: Starting full primary refresh. [2025-09-17T21:55:02.824992] [INFO ] [REMOTE ] STXE: Fetching primary data for 2024-12. [2025-09-17T21:55:03.131626] [INFO ] [REMOTE ] STXG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:55:03.288172] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T21:55:03.486766] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T21:55:03.615788] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-11. [2025-09-17T21:55:03.961757] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-11 (0.35 seconds). [2025-09-17T21:55:04.415758] [INFO ] [REMOTE ] STXD: Fetching primary data for 2024-12. [2025-09-17T21:55:04.866379] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T21:55:05.215774] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-01. [2025-09-17T21:55:05.567602] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-01 (0.35 seconds). [2025-09-17T21:55:06.015783] [INFO ] [REMOTE ] STWD: Fetching primary data for 2025-09. [2025-09-17T21:55:06.815831] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-01. [2025-09-17T21:55:07.265793] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T21:55:07.615799] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-02. [2025-09-17T21:55:07.682314] [INFO ] [REMOTE ] STWD: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T21:55:07.689103] [INFO ] [REMOTE ] STWD: Full fetch complete (74726 records). [2025-09-17T21:55:07.689270] [DEBUG] [VALIDATOR ] STWD: Validating primary data. [2025-09-17T21:55:08.021209] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T21:55:08.096529] [DEBUG] [VALIDATOR ] STWD: All expected trading days are present. [2025-09-17T21:55:08.096616] [DEBUG] [VALIDATOR ] STWD: Primary data validation passed. [2025-09-17T21:55:08.097665] [INFO ] [MAIN ] STWD: Fetched primary data is valid. [2025-09-17T21:55:08.097711] [DEBUG] [LOCAL ] STWD: Saving primary data. [2025-09-17T21:55:08.099129] [DEBUG] [LOCAL ] STWD: Trimmed 74726 records to 51899 (keeping 200 days of data) [2025-09-17T21:55:08.418885] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-11. [2025-09-17T21:55:08.431620] [DEBUG] [LOCAL ] STWD: Primary data saved (51899 records). [2025-09-17T21:55:08.431791] [INFO ] [MAIN ] STWD: Full history saved. [2025-09-17T21:55:08.431917] [INFO ] [MAIN ] Update Progress: 2018/2371 symbols completed. STWD took 37.3s. Estimated remaining: 51m 37s. Rate: 6.8 symbols/min [2025-09-17T21:55:08.608164] [INFO ] [MAIN ] STXK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:55:08.611893] [DEBUG] [LOCAL ] STXK: Loaded 1518 existing records from primary storage. [2025-09-17T21:55:08.611995] [INFO ] [MAIN ] STXK: Loaded 1518 existing records. [2025-09-17T21:55:08.792879] [WARN ] [MAIN ] STXK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:55:08.793171] [INFO ] [MAIN ] STXK: Wiping existing primary data before full refresh. [2025-09-17T21:55:08.793220] [INFO ] [LOCAL ] STXK: Starting deletion of primary data. [2025-09-17T21:55:08.793416] [DEBUG] [LOCAL ] STXK: Deleted primary data file. [2025-09-17T21:55:08.793462] [INFO ] [MAIN ] STXK: Starting full primary refresh. [2025-09-17T21:55:09.165477] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T21:55:09.171351] [INFO ] [REMOTE ] STXK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:55:09.215788] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-02. [2025-09-17T21:55:09.715391] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-02 (0.50 seconds). [2025-09-17T21:55:10.015823] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-03. [2025-09-17T21:55:10.590638] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T21:55:10.815794] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-04. [2025-09-17T21:55:11.609275] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T21:55:11.615675] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-05. [2025-09-17T21:55:11.983486] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-05 (0.37 seconds). [2025-09-17T21:55:12.415754] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-06. [2025-09-17T21:55:12.925786] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T21:55:13.215805] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-11. [2025-09-17T21:55:13.560315] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-11 (0.34 seconds). [2025-09-17T21:55:14.015815] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-07. [2025-09-17T21:55:14.462524] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T21:55:14.815828] [INFO ] [REMOTE ] STXK: Fetching primary data for 2024-12. [2025-09-17T21:55:15.325712] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2024-12 (0.51 seconds). [2025-09-17T21:55:15.615756] [INFO ] [REMOTE ] STXG: Fetching primary data for 2024-12. [2025-09-17T21:55:16.165999] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T21:55:16.415758] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-08. [2025-09-17T21:55:16.861702] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T21:55:17.215763] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-01. [2025-09-17T21:55:17.663589] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T21:55:18.015842] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-01. [2025-09-17T21:55:18.585132] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T21:55:18.815827] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-02. [2025-09-17T21:55:19.234605] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-02 (0.42 seconds). [2025-09-17T21:55:19.615787] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-03. [2025-09-17T21:55:19.984447] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T21:55:20.415773] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-03. [2025-09-17T21:55:20.751223] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-03 (0.34 seconds). [2025-09-17T21:55:21.215824] [INFO ] [REMOTE ] STXE: Fetching primary data for 2025-09. [2025-09-17T21:55:21.588664] [INFO ] [REMOTE ] STXE: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T21:55:21.589615] [INFO ] [REMOTE ] STXE: Full fetch complete (3716 records). [2025-09-17T21:55:21.589708] [DEBUG] [VALIDATOR ] STXE: Validating primary data. [2025-09-17T21:55:21.958496] [DEBUG] [VALIDATOR ] STXE: All expected trading days are present. [2025-09-17T21:55:21.958581] [DEBUG] [VALIDATOR ] STXE: Primary data validation passed. [2025-09-17T21:55:21.958737] [INFO ] [MAIN ] STXE: Fetched primary data is valid. [2025-09-17T21:55:21.958779] [DEBUG] [LOCAL ] STXE: Saving primary data. [2025-09-17T21:55:21.959129] [DEBUG] [LOCAL ] STXE: Trimmed 3716 records to 2251 (keeping 200 days of data) [2025-09-17T21:55:21.973827] [DEBUG] [LOCAL ] STXE: Primary data saved (2251 records). [2025-09-17T21:55:21.973950] [INFO ] [MAIN ] STXE: Full history saved. [2025-09-17T21:55:21.974035] [INFO ] [MAIN ] Update Progress: 2019/2371 symbols completed. STXE took 21.7s. Estimated remaining: 51m 29s. Rate: 6.8 symbols/min [2025-09-17T21:55:22.020942] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-04. [2025-09-17T21:55:22.150307] [INFO ] [MAIN ] STXM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:55:22.150560] [DEBUG] [LOCAL ] STXM: No existing data file found in primary storage. [2025-09-17T21:55:22.150600] [WARN ] [MAIN ] STXM: No existing data found, performing full refresh instead. [2025-09-17T21:55:22.150739] [INFO ] [MAIN ] STXM: Wiping existing primary data before full refresh. [2025-09-17T21:55:22.150779] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-17T21:55:22.150820] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-17T21:55:22.150852] [INFO ] [MAIN ] STXM: Starting full primary refresh. [2025-09-17T21:55:22.515634] [INFO ] [REMOTE ] STXM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:55:22.566495] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T21:55:22.815802] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-11. [2025-09-17T21:55:23.123870] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-11 (0.31 seconds). [2025-09-17T21:55:23.615788] [INFO ] [REMOTE ] STXM: Fetching primary data for 2024-12. [2025-09-17T21:55:24.043970] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2024-12 (0.43 seconds). [2025-09-17T21:55:24.415772] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-01. [2025-09-17T21:55:24.908753] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T21:55:25.215788] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-02. [2025-09-17T21:55:25.647831] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-02 (0.43 seconds). [2025-09-17T21:55:26.015806] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-02. [2025-09-17T21:55:26.566612] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T21:55:26.815816] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-03. [2025-09-17T21:55:27.381939] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-03 (0.57 seconds). [2025-09-17T21:55:27.615777] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-04. [2025-09-17T21:55:28.087521] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-04 (0.47 seconds). [2025-09-17T21:55:28.415785] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-04. [2025-09-17T21:55:29.041306] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-04 (0.63 seconds). [2025-09-17T21:55:29.215784] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-05. [2025-09-17T21:55:29.502929] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-05 (0.29 seconds). [2025-09-17T21:55:30.015787] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-03. [2025-09-17T21:55:30.379790] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T21:55:30.815779] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-06. [2025-09-17T21:55:31.106348] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-06 (0.29 seconds). [2025-09-17T21:55:31.615783] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-04. [2025-09-17T21:55:32.054507] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-04 (0.44 seconds). [2025-09-17T21:55:32.415796] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-05. [2025-09-17T21:55:32.858168] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-05 (0.44 seconds). [2025-09-17T21:55:33.215781] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-06. [2025-09-17T21:55:33.637383] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-06 (0.42 seconds). [2025-09-17T21:55:34.015830] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-05. [2025-09-17T21:55:34.357263] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-05 (0.34 seconds). [2025-09-17T21:55:34.815809] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-06. [2025-09-17T21:55:35.152495] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-06 (0.34 seconds). [2025-09-17T21:55:35.615818] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-07. [2025-09-17T21:55:35.949639] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-07 (0.33 seconds). [2025-09-17T21:55:36.415785] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-07. [2025-09-17T21:55:36.769169] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T21:55:37.215778] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-08. [2025-09-17T21:55:37.549579] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-08 (0.33 seconds). [2025-09-17T21:55:38.015786] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-07. [2025-09-17T21:55:38.364873] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-07 (0.35 seconds). [2025-09-17T21:55:38.815743] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-05. [2025-09-17T21:55:39.279779] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T21:55:39.615776] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-08. [2025-09-17T21:55:40.062382] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T21:55:40.415782] [INFO ] [REMOTE ] STXM: Fetching primary data for 2025-09. [2025-09-17T21:55:40.746159] [INFO ] [REMOTE ] STXM: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-17T21:55:40.746921] [INFO ] [REMOTE ] STXM: Full fetch complete (1466 records). [2025-09-17T21:55:40.746989] [DEBUG] [VALIDATOR ] STXM: Validating primary data. [2025-09-17T21:55:40.926904] [WARN ] [VALIDATOR ] STXM: Validation failed - insufficient historical data. Have 197 unique days, need 200 days [2025-09-17T21:55:40.927112] [FATAL] [MAIN ] STXM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T21:55:40.927162] [WARN ] [MAIN ] STXM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T21:55:40.927216] [INFO ] [LOCAL ] STXM: Starting deletion of primary data. [2025-09-17T21:55:40.927275] [DEBUG] [LOCAL ] STXM: No primary data file found to delete. [2025-09-17T21:55:40.927311] [INFO ] [LOCAL ] STXM: Starting deletion of derivative data. [2025-09-17T21:55:40.927362] [DEBUG] [LOCAL ] STXM: No derivative data file found to delete. [2025-09-17T21:55:40.927422] [INFO ] [MAIN ] Update Progress: 2020/2371 symbols completed. STXM took 19.0s. Estimated remaining: 51m 22s. Rate: 6.8 symbols/min [2025-09-17T21:55:41.097066] [INFO ] [MAIN ] STXT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:55:41.101862] [DEBUG] [LOCAL ] STXT: Loaded 2625 existing records from primary storage. [2025-09-17T21:55:41.101949] [INFO ] [MAIN ] STXT: Loaded 2625 existing records. [2025-09-17T21:55:41.220875] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-08. [2025-09-17T21:55:41.291272] [WARN ] [MAIN ] STXT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:55:41.291535] [INFO ] [MAIN ] STXT: Wiping existing primary data before full refresh. [2025-09-17T21:55:41.291587] [INFO ] [LOCAL ] STXT: Starting deletion of primary data. [2025-09-17T21:55:41.291831] [DEBUG] [LOCAL ] STXT: Deleted primary data file. [2025-09-17T21:55:41.291880] [INFO ] [MAIN ] STXT: Starting full primary refresh. [2025-09-17T21:55:41.587884] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-08 (0.37 seconds). [2025-09-17T21:55:41.665450] [INFO ] [REMOTE ] STXT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:55:42.015827] [INFO ] [REMOTE ] STXD: Fetching primary data for 2025-09. [2025-09-17T21:55:42.361325] [INFO ] [REMOTE ] STXD: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T21:55:42.362152] [INFO ] [REMOTE ] STXD: Full fetch complete (2068 records). [2025-09-17T21:55:42.362280] [DEBUG] [VALIDATOR ] STXD: Validating primary data. [2025-09-17T21:55:42.778202] [DEBUG] [VALIDATOR ] STXD: All expected trading days are present. [2025-09-17T21:55:42.778285] [DEBUG] [VALIDATOR ] STXD: Primary data validation passed. [2025-09-17T21:55:42.778377] [INFO ] [MAIN ] STXD: Fetched primary data is valid. [2025-09-17T21:55:42.778414] [DEBUG] [LOCAL ] STXD: Saving primary data. [2025-09-17T21:55:42.778815] [DEBUG] [LOCAL ] STXD: Trimmed 2068 records to 1353 (keeping 200 days of data) [2025-09-17T21:55:42.789329] [DEBUG] [LOCAL ] STXD: Primary data saved (1353 records). [2025-09-17T21:55:42.789486] [INFO ] [MAIN ] STXD: Full history saved. [2025-09-17T21:55:42.789615] [INFO ] [MAIN ] Update Progress: 2021/2371 symbols completed. STXD took 46.3s. Estimated remaining: 51m 12s. Rate: 6.8 symbols/min [2025-09-17T21:55:42.824423] [INFO ] [REMOTE ] STXK: Fetching primary data for 2025-09. [2025-09-17T21:55:42.993348] [INFO ] [MAIN ] STXV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:55:42.997852] [DEBUG] [LOCAL ] STXV: Loaded 1694 existing records from primary storage. [2025-09-17T21:55:42.998049] [INFO ] [MAIN ] STXV: Loaded 1694 existing records. [2025-09-17T21:55:43.190841] [WARN ] [MAIN ] STXV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:55:43.191084] [INFO ] [MAIN ] STXV: Wiping existing primary data before full refresh. [2025-09-17T21:55:43.191129] [INFO ] [LOCAL ] STXV: Starting deletion of primary data. [2025-09-17T21:55:43.191326] [DEBUG] [LOCAL ] STXV: Deleted primary data file. [2025-09-17T21:55:43.191370] [INFO ] [MAIN ] STXV: Starting full primary refresh. [2025-09-17T21:55:43.288742] [INFO ] [REMOTE ] STXK: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T21:55:43.301853] [INFO ] [REMOTE ] STXK: Full fetch complete (2445 records). [2025-09-17T21:55:43.307888] [DEBUG] [VALIDATOR ] STXK: Validating primary data. [2025-09-17T21:55:43.620072] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-11. [2025-09-17T21:55:43.833516] [INFO ] [REMOTE ] STXV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:55:43.947901] [DEBUG] [VALIDATOR ] STXK: All expected trading days are present. [2025-09-17T21:55:43.947996] [DEBUG] [VALIDATOR ] STXK: Primary data validation passed. [2025-09-17T21:55:43.948111] [INFO ] [MAIN ] STXK: Fetched primary data is valid. [2025-09-17T21:55:43.948149] [DEBUG] [LOCAL ] STXK: Saving primary data. [2025-09-17T21:55:43.948519] [DEBUG] [LOCAL ] STXK: Trimmed 2445 records to 1526 (keeping 200 days of data) [2025-09-17T21:55:43.958281] [DEBUG] [LOCAL ] STXK: Primary data saved (1526 records). [2025-09-17T21:55:43.958343] [INFO ] [MAIN ] STXK: Full history saved. [2025-09-17T21:55:43.958414] [INFO ] [MAIN ] Update Progress: 2022/2371 symbols completed. STXK took 35.5s. Estimated remaining: 51m 2s. Rate: 6.8 symbols/min [2025-09-17T21:55:44.131462] [INFO ] [MAIN ] STZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:55:44.130380] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-11 (0.51 seconds). [2025-09-17T21:55:44.185867] [DEBUG] [LOCAL ] STZ: Loaded 52271 existing records from primary storage. [2025-09-17T21:55:44.186025] [INFO ] [MAIN ] STZ: Loaded 52271 existing records. [2025-09-17T21:55:44.362060] [WARN ] [MAIN ] STZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:55:44.362315] [INFO ] [MAIN ] STZ: Wiping existing primary data before full refresh. [2025-09-17T21:55:44.362359] [INFO ] [LOCAL ] STZ: Starting deletion of primary data. [2025-09-17T21:55:44.363807] [DEBUG] [LOCAL ] STZ: Deleted primary data file. [2025-09-17T21:55:44.363871] [INFO ] [MAIN ] STZ: Starting full primary refresh. [2025-09-17T21:55:44.424087] [INFO ] [REMOTE ] STXT: Fetching primary data for 2024-12. [2025-09-17T21:55:44.714929] [INFO ] [REMOTE ] STZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:55:45.052874] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2024-12 (0.63 seconds). [2025-09-17T21:55:45.215776] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-01. [2025-09-17T21:55:45.769122] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-01 (0.55 seconds). [2025-09-17T21:55:46.015770] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-11. [2025-09-17T21:55:46.815801] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-11. [2025-09-17T21:55:47.249661] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T21:55:47.615785] [INFO ] [REMOTE ] STXV: Fetching primary data for 2024-12. [2025-09-17T21:55:47.811122] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T21:55:48.060412] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2024-12 (0.44 seconds). [2025-09-17T21:55:48.415774] [INFO ] [REMOTE ] STZ: Fetching primary data for 2024-12. [2025-09-17T21:55:49.215780] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-06. [2025-09-17T21:55:49.662317] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T21:55:50.015773] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-01. [2025-09-17T21:55:50.168675] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T21:55:50.460240] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T21:55:50.815771] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-02. [2025-09-17T21:55:51.327718] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T21:55:51.615768] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-03. [2025-09-17T21:55:52.075264] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T21:55:52.415779] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-01. [2025-09-17T21:55:53.215784] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-04. [2025-09-17T21:55:53.583405] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-04 (0.37 seconds). [2025-09-17T21:55:53.949468] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T21:55:54.015828] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-07. [2025-09-17T21:55:54.465053] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T21:55:54.815827] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-08. [2025-09-17T21:55:55.266150] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T21:55:55.615801] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-02. [2025-09-17T21:55:56.415819] [INFO ] [REMOTE ] STXG: Fetching primary data for 2025-09. [2025-09-17T21:55:56.742511] [INFO ] [REMOTE ] STXG: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-17T21:55:56.743370] [INFO ] [REMOTE ] STXG: Full fetch complete (4211 records). [2025-09-17T21:55:56.743439] [DEBUG] [VALIDATOR ] STXG: Validating primary data. [2025-09-17T21:55:57.110379] [DEBUG] [VALIDATOR ] STXG: All expected trading days are present. [2025-09-17T21:55:57.110473] [DEBUG] [VALIDATOR ] STXG: Primary data validation passed. [2025-09-17T21:55:57.110632] [INFO ] [MAIN ] STXG: Fetched primary data is valid. [2025-09-17T21:55:57.110709] [DEBUG] [LOCAL ] STXG: Saving primary data. [2025-09-17T21:55:57.111115] [DEBUG] [LOCAL ] STXG: Trimmed 4211 records to 2661 (keeping 200 days of data) [2025-09-17T21:55:57.133031] [DEBUG] [LOCAL ] STXG: Primary data saved (2661 records). [2025-09-17T21:55:57.133223] [INFO ] [MAIN ] STXG: Full history saved. [2025-09-17T21:55:57.133332] [INFO ] [MAIN ] Update Progress: 2023/2371 symbols completed. STXG took 54.8s. Estimated remaining: 50m 54s. Rate: 6.8 symbols/min [2025-09-17T21:55:57.220983] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-05. [2025-09-17T21:55:57.326987] [INFO ] [MAIN ] SU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:55:57.385170] [DEBUG] [LOCAL ] SU: Loaded 53474 existing records from primary storage. [2025-09-17T21:55:57.385368] [INFO ] [MAIN ] SU: Loaded 53474 existing records. [2025-09-17T21:55:57.570041] [WARN ] [MAIN ] SU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:55:57.571212] [INFO ] [MAIN ] SU: Wiping existing primary data before full refresh. [2025-09-17T21:55:57.574407] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-17T21:55:57.574464] [INFO ] [LOCAL ] SU: Starting deletion of primary data. [2025-09-17T21:55:57.576551] [DEBUG] [LOCAL ] SU: Deleted primary data file. [2025-09-17T21:55:57.576609] [INFO ] [MAIN ] SU: Starting full primary refresh. [2025-09-17T21:55:57.962229] [INFO ] [REMOTE ] SU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:55:57.967444] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-02 (2.35 seconds). [2025-09-17T21:55:58.015809] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-03. [2025-09-17T21:55:58.815830] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-02. [2025-09-17T21:55:59.374130] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-02 (0.56 seconds). [2025-09-17T21:55:59.615752] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-06. [2025-09-17T21:55:59.924790] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-06 (0.31 seconds). [2025-09-17T21:56:00.183425] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-17T21:56:00.415817] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-03. [2025-09-17T21:56:00.968394] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-03 (0.55 seconds). [2025-09-17T21:56:01.215796] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-04. [2025-09-17T21:56:02.015823] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-11. [2025-09-17T21:56:02.815822] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-07. [2025-09-17T21:56:03.271287] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-07 (0.46 seconds). [2025-09-17T21:56:03.305419] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-04 (2.09 seconds). [2025-09-17T21:56:03.615814] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-04. [2025-09-17T21:56:03.802038] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T21:56:03.964582] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-04 (0.35 seconds). [2025-09-17T21:56:04.415819] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-05. [2025-09-17T21:56:04.896207] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-05 (0.48 seconds). [2025-09-17T21:56:05.215790] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-06. [2025-09-17T21:56:05.684211] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-06 (0.47 seconds). [2025-09-17T21:56:06.015786] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-07. [2025-09-17T21:56:06.583601] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-07 (0.57 seconds). [2025-09-17T21:56:06.815801] [INFO ] [REMOTE ] SU: Fetching primary data for 2024-12. [2025-09-17T21:56:07.615772] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-08. [2025-09-17T21:56:08.113202] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T21:56:08.415830] [INFO ] [REMOTE ] STXV: Fetching primary data for 2025-09. [2025-09-17T21:56:08.684013] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2024-12 (1.87 seconds). [2025-09-17T21:56:08.770754] [INFO ] [REMOTE ] STXV: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T21:56:08.771584] [INFO ] [REMOTE ] STXV: Full fetch complete (2647 records). [2025-09-17T21:56:08.771680] [DEBUG] [VALIDATOR ] STXV: Validating primary data. [2025-09-17T21:56:09.149618] [DEBUG] [VALIDATOR ] STXV: All expected trading days are present. [2025-09-17T21:56:09.149719] [DEBUG] [VALIDATOR ] STXV: Primary data validation passed. [2025-09-17T21:56:09.149837] [INFO ] [MAIN ] STXV: Fetched primary data is valid. [2025-09-17T21:56:09.149878] [DEBUG] [LOCAL ] STXV: Saving primary data. [2025-09-17T21:56:09.150238] [DEBUG] [LOCAL ] STXV: Trimmed 2647 records to 1694 (keeping 200 days of data) [2025-09-17T21:56:09.161592] [DEBUG] [LOCAL ] STXV: Primary data saved (1694 records). [2025-09-17T21:56:09.161665] [INFO ] [MAIN ] STXV: Full history saved. [2025-09-17T21:56:09.161736] [INFO ] [MAIN ] Update Progress: 2024/2371 symbols completed. STXV took 26.4s. Estimated remaining: 50m 46s. Rate: 6.8 symbols/min [2025-09-17T21:56:09.223388] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-01. [2025-09-17T21:56:09.332303] [INFO ] [MAIN ] SUI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:56:09.385294] [DEBUG] [LOCAL ] SUI: Loaded 42301 existing records from primary storage. [2025-09-17T21:56:09.385435] [INFO ] [MAIN ] SUI: Loaded 42301 existing records. [2025-09-17T21:56:09.569105] [WARN ] [MAIN ] SUI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:56:09.569340] [INFO ] [MAIN ] SUI: Wiping existing primary data before full refresh. [2025-09-17T21:56:09.569386] [INFO ] [LOCAL ] SUI: Starting deletion of primary data. [2025-09-17T21:56:09.570219] [DEBUG] [LOCAL ] SUI: Deleted primary data file. [2025-09-17T21:56:09.570268] [INFO ] [MAIN ] SUI: Starting full primary refresh. [2025-09-17T21:56:09.942682] [INFO ] [REMOTE ] SUI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:56:10.015825] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-11. [2025-09-17T21:56:10.599944] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T21:56:10.815780] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-05. [2025-09-17T21:56:11.615794] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-02. [2025-09-17T21:56:11.941228] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-11 (1.93 seconds). [2025-09-17T21:56:12.415810] [INFO ] [REMOTE ] SUI: Fetching primary data for 2024-12. [2025-09-17T21:56:12.754622] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T21:56:13.215832] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-08. [2025-09-17T21:56:13.354667] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T21:56:13.683611] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T21:56:13.950383] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T21:56:14.015797] [INFO ] [REMOTE ] STXT: Fetching primary data for 2025-09. [2025-09-17T21:56:14.463569] [INFO ] [REMOTE ] STXT: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T21:56:14.465119] [INFO ] [REMOTE ] STXT: Full fetch complete (4061 records). [2025-09-17T21:56:14.465236] [DEBUG] [VALIDATOR ] STXT: Validating primary data. [2025-09-17T21:56:14.830525] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-03. [2025-09-17T21:56:14.837678] [DEBUG] [VALIDATOR ] STXT: All expected trading days are present. [2025-09-17T21:56:14.837744] [DEBUG] [VALIDATOR ] STXT: Primary data validation passed. [2025-09-17T21:56:14.837924] [INFO ] [MAIN ] STXT: Fetched primary data is valid. [2025-09-17T21:56:14.837968] [DEBUG] [LOCAL ] STXT: Saving primary data. [2025-09-17T21:56:14.838443] [DEBUG] [LOCAL ] STXT: Trimmed 4061 records to 2617 (keeping 200 days of data) [2025-09-17T21:56:14.859405] [DEBUG] [LOCAL ] STXT: Primary data saved (2617 records). [2025-09-17T21:56:14.859520] [INFO ] [MAIN ] STXT: Full history saved. [2025-09-17T21:56:14.859628] [INFO ] [MAIN ] Update Progress: 2025/2371 symbols completed. STXT took 33.9s. Estimated remaining: 50m 37s. Rate: 6.8 symbols/min [2025-09-17T21:56:15.034900] [INFO ] [MAIN ] SUN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:56:15.082947] [DEBUG] [LOCAL ] SUN: Loaded 37234 existing records from primary storage. [2025-09-17T21:56:15.083105] [INFO ] [MAIN ] SUN: Loaded 37234 existing records. [2025-09-17T21:56:15.262555] [WARN ] [MAIN ] SUN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:56:15.262838] [INFO ] [MAIN ] SUN: Wiping existing primary data before full refresh. [2025-09-17T21:56:15.262903] [INFO ] [LOCAL ] SUN: Starting deletion of primary data. [2025-09-17T21:56:15.263716] [DEBUG] [LOCAL ] SUN: Deleted primary data file. [2025-09-17T21:56:15.263777] [INFO ] [MAIN ] SUN: Starting full primary refresh. [2025-09-17T21:56:15.616162] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-01. [2025-09-17T21:56:15.616080] [INFO ] [REMOTE ] SUN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:56:16.415880] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-06. [2025-09-17T21:56:16.788198] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T21:56:17.215895] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-04. [2025-09-17T21:56:17.347807] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T21:56:18.015759] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-02. [2025-09-17T21:56:18.045900] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T21:56:18.815780] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-11. [2025-09-17T21:56:19.119720] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T21:56:19.525536] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T21:56:19.615797] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-03. [2025-09-17T21:56:20.218857] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T21:56:20.415800] [INFO ] [REMOTE ] SUN: Fetching primary data for 2024-12. [2025-09-17T21:56:20.856899] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T21:56:21.215785] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-05. [2025-09-17T21:56:21.896474] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T21:56:22.015793] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-04. [2025-09-17T21:56:22.815824] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-07. [2025-09-17T21:56:23.002594] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T21:56:23.627913] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-06. [2025-09-17T21:56:23.630240] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T21:56:24.415778] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-05. [2025-09-17T21:56:24.819248] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T21:56:25.215852] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-08. [2025-09-17T21:56:25.398131] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T21:56:25.647632] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T21:56:26.015778] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-06. [2025-09-17T21:56:26.815833] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-07. [2025-09-17T21:56:27.195924] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T21:56:27.615748] [INFO ] [REMOTE ] STZ: Fetching primary data for 2025-09. [2025-09-17T21:56:27.700160] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T21:56:27.891925] [INFO ] [REMOTE ] STZ: Incremental fetch complete for 2025-09 (0.28 seconds). [2025-09-17T21:56:27.899104] [INFO ] [REMOTE ] STZ: Full fetch complete (75491 records). [2025-09-17T21:56:27.899244] [DEBUG] [VALIDATOR ] STZ: Validating primary data. [2025-09-17T21:56:28.291725] [DEBUG] [VALIDATOR ] STZ: All expected trading days are present. [2025-09-17T21:56:28.291811] [DEBUG] [VALIDATOR ] STZ: Primary data validation passed. [2025-09-17T21:56:28.292859] [INFO ] [MAIN ] STZ: Fetched primary data is valid. [2025-09-17T21:56:28.292905] [DEBUG] [LOCAL ] STZ: Saving primary data. [2025-09-17T21:56:28.294367] [DEBUG] [LOCAL ] STZ: Trimmed 75491 records to 52272 (keeping 200 days of data) [2025-09-17T21:56:28.415939] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-07. [2025-09-17T21:56:28.639087] [DEBUG] [LOCAL ] STZ: Primary data saved (52272 records). [2025-09-17T21:56:28.639229] [INFO ] [MAIN ] STZ: Full history saved. [2025-09-17T21:56:28.639359] [INFO ] [MAIN ] Update Progress: 2026/2371 symbols completed. STZ took 44.7s. Estimated remaining: 50m 29s. Rate: 6.8 symbols/min [2025-09-17T21:56:28.853956] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T21:56:28.851982] [INFO ] [MAIN ] SUPV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:56:28.914763] [DEBUG] [LOCAL ] SUPV: Loaded 46933 existing records from primary storage. [2025-09-17T21:56:28.914953] [INFO ] [MAIN ] SUPV: Loaded 46933 existing records. [2025-09-17T21:56:29.117427] [WARN ] [MAIN ] SUPV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:56:29.117779] [INFO ] [MAIN ] SUPV: Wiping existing primary data before full refresh. [2025-09-17T21:56:29.117840] [INFO ] [LOCAL ] SUPV: Starting deletion of primary data. [2025-09-17T21:56:29.118908] [DEBUG] [LOCAL ] SUPV: Deleted primary data file. [2025-09-17T21:56:29.118972] [INFO ] [MAIN ] SUPV: Starting full primary refresh. [2025-09-17T21:56:29.220975] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-08. [2025-09-17T21:56:29.600067] [INFO ] [REMOTE ] SUPV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:56:29.851867] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T21:56:30.015900] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-08. [2025-09-17T21:56:30.815791] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-01. [2025-09-17T21:56:31.076676] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T21:56:31.598805] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T21:56:31.615690] [INFO ] [REMOTE ] SU: Fetching primary data for 2025-09. [2025-09-17T21:56:31.956190] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T21:56:32.415769] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-02. [2025-09-17T21:56:32.848602] [INFO ] [REMOTE ] SU: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T21:56:32.856892] [INFO ] [REMOTE ] SU: Full fetch complete (77260 records). [2025-09-17T21:56:32.857043] [DEBUG] [VALIDATOR ] SU: Validating primary data. [2025-09-17T21:56:33.217362] [INFO ] [REMOTE ] SUI: Fetching primary data for 2025-09. [2025-09-17T21:56:33.258841] [DEBUG] [VALIDATOR ] SU: All expected trading days are present. [2025-09-17T21:56:33.258929] [DEBUG] [VALIDATOR ] SU: Primary data validation passed. [2025-09-17T21:56:33.259999] [INFO ] [MAIN ] SU: Fetched primary data is valid. [2025-09-17T21:56:33.260046] [DEBUG] [LOCAL ] SU: Saving primary data. [2025-09-17T21:56:33.261902] [DEBUG] [LOCAL ] SU: Trimmed 77260 records to 53469 (keeping 200 days of data) [2025-09-17T21:56:33.616484] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T21:56:33.642914] [DEBUG] [LOCAL ] SU: Primary data saved (53469 records). [2025-09-17T21:56:33.643101] [INFO ] [MAIN ] SU: Full history saved. [2025-09-17T21:56:33.643811] [INFO ] [MAIN ] Update Progress: 2027/2371 symbols completed. SU took 36.5s. Estimated remaining: 50m 19s. Rate: 6.8 symbols/min [2025-09-17T21:56:33.815781] [INFO ] [MAIN ] SUZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:56:33.864829] [DEBUG] [LOCAL ] SUZ: Loaded 46060 existing records from primary storage. [2025-09-17T21:56:33.864998] [INFO ] [MAIN ] SUZ: Loaded 46060 existing records. [2025-09-17T21:56:34.024687] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-03. [2025-09-17T21:56:34.082615] [WARN ] [MAIN ] SUZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:56:34.082885] [INFO ] [MAIN ] SUZ: Wiping existing primary data before full refresh. [2025-09-17T21:56:34.082932] [INFO ] [LOCAL ] SUZ: Starting deletion of primary data. [2025-09-17T21:56:34.083697] [DEBUG] [LOCAL ] SUZ: Deleted primary data file. [2025-09-17T21:56:34.083745] [INFO ] [MAIN ] SUZ: Starting full primary refresh. [2025-09-17T21:56:34.453830] [INFO ] [REMOTE ] SUZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:56:34.700440] [INFO ] [REMOTE ] SUI: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T21:56:34.706372] [INFO ] [REMOTE ] SUI: Full fetch complete (61099 records). [2025-09-17T21:56:34.706497] [DEBUG] [VALIDATOR ] SUI: Validating primary data. [2025-09-17T21:56:34.820942] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-11. [2025-09-17T21:56:35.097389] [DEBUG] [VALIDATOR ] SUI: All expected trading days are present. [2025-09-17T21:56:35.097468] [DEBUG] [VALIDATOR ] SUI: Primary data validation passed. [2025-09-17T21:56:35.098361] [INFO ] [MAIN ] SUI: Fetched primary data is valid. [2025-09-17T21:56:35.098407] [DEBUG] [LOCAL ] SUI: Saving primary data. [2025-09-17T21:56:35.099763] [DEBUG] [LOCAL ] SUI: Trimmed 61099 records to 42310 (keeping 200 days of data) [2025-09-17T21:56:35.369046] [DEBUG] [LOCAL ] SUI: Primary data saved (42310 records). [2025-09-17T21:56:35.369190] [INFO ] [MAIN ] SUI: Full history saved. [2025-09-17T21:56:35.369279] [INFO ] [MAIN ] Update Progress: 2028/2371 symbols completed. SUI took 26.2s. Estimated remaining: 50m 9s. Rate: 6.8 symbols/min [2025-09-17T21:56:35.540274] [INFO ] [MAIN ] SVV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:56:35.564205] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T21:56:35.605134] [DEBUG] [LOCAL ] SVV: Loaded 39392 existing records from primary storage. [2025-09-17T21:56:35.605272] [INFO ] [MAIN ] SVV: Loaded 39392 existing records. [2025-09-17T21:56:35.625890] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-04. [2025-09-17T21:56:35.786174] [WARN ] [MAIN ] SVV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:56:35.786457] [INFO ] [MAIN ] SVV: Wiping existing primary data before full refresh. [2025-09-17T21:56:35.786529] [INFO ] [LOCAL ] SVV: Starting deletion of primary data. [2025-09-17T21:56:35.787215] [DEBUG] [LOCAL ] SVV: Deleted primary data file. [2025-09-17T21:56:35.787265] [INFO ] [MAIN ] SVV: Starting full primary refresh. [2025-09-17T21:56:36.143690] [INFO ] [REMOTE ] SVV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:56:36.168552] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T21:56:36.415774] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-11. [2025-09-17T21:56:36.809862] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T21:56:37.215814] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-05. [2025-09-17T21:56:37.831106] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T21:56:38.015775] [INFO ] [REMOTE ] SVV: Fetching primary data for 2024-12. [2025-09-17T21:56:38.366585] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T21:56:38.815781] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-11. [2025-09-17T21:56:38.961945] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2024-12 (0.95 seconds). [2025-09-17T21:56:39.615773] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2024-12. [2025-09-17T21:56:40.043418] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-11 (1.23 seconds). [2025-09-17T21:56:40.415785] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-01. [2025-09-17T21:56:41.215795] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-06. [2025-09-17T21:56:41.280341] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T21:56:41.518381] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T21:56:42.015771] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-02. [2025-09-17T21:56:42.311270] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T21:56:42.815799] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-07. [2025-09-17T21:56:43.355603] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T21:56:43.615812] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2024-12. [2025-09-17T21:56:43.908895] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T21:56:44.415803] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-01. [2025-09-17T21:56:45.030418] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T21:56:45.215787] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-08. [2025-09-17T21:56:46.015714] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-03. [2025-09-17T21:56:46.265028] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T21:56:46.815778] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-02. [2025-09-17T21:56:46.850838] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T21:56:47.626403] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-01. [2025-09-17T21:56:47.629562] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T21:56:48.421966] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-04. [2025-09-17T21:56:48.427452] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T21:56:49.057509] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T21:56:49.215756] [INFO ] [REMOTE ] SUN: Fetching primary data for 2025-09. [2025-09-17T21:56:49.984947] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T21:56:50.015735] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-05. [2025-09-17T21:56:50.199902] [INFO ] [REMOTE ] SUN: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T21:56:50.207096] [INFO ] [REMOTE ] SUN: Full fetch complete (54101 records). [2025-09-17T21:56:50.207223] [DEBUG] [VALIDATOR ] SUN: Validating primary data. [2025-09-17T21:56:50.593772] [DEBUG] [VALIDATOR ] SUN: All expected trading days are present. [2025-09-17T21:56:50.593912] [DEBUG] [VALIDATOR ] SUN: Primary data validation passed. [2025-09-17T21:56:50.595454] [INFO ] [MAIN ] SUN: Fetched primary data is valid. [2025-09-17T21:56:50.595707] [DEBUG] [LOCAL ] SUN: Saving primary data. [2025-09-17T21:56:50.597109] [DEBUG] [LOCAL ] SUN: Trimmed 54101 records to 37221 (keeping 200 days of data) [2025-09-17T21:56:50.816024] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-02. [2025-09-17T21:56:50.831140] [DEBUG] [LOCAL ] SUN: Primary data saved (37221 records). [2025-09-17T21:56:50.831239] [INFO ] [MAIN ] SUN: Full history saved. [2025-09-17T21:56:50.831333] [INFO ] [MAIN ] Update Progress: 2029/2371 symbols completed. SUN took 36.0s. Estimated remaining: 50m 2s. Rate: 6.8 symbols/min [2025-09-17T21:56:50.999458] [INFO ] [MAIN ] SW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:56:51.049126] [DEBUG] [LOCAL ] SW: Loaded 53166 existing records from primary storage. [2025-09-17T21:56:51.049274] [INFO ] [MAIN ] SW: Loaded 53166 existing records. [2025-09-17T21:56:51.231475] [WARN ] [MAIN ] SW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:56:51.231860] [INFO ] [MAIN ] SW: Wiping existing primary data before full refresh. [2025-09-17T21:56:51.231977] [INFO ] [LOCAL ] SW: Starting deletion of primary data. [2025-09-17T21:56:51.241864] [DEBUG] [LOCAL ] SW: Deleted primary data file. [2025-09-17T21:56:51.254436] [INFO ] [MAIN ] SW: Starting full primary refresh. [2025-09-17T21:56:51.328040] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T21:56:51.615760] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-03. [2025-09-17T21:56:51.642187] [INFO ] [REMOTE ] SW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:56:52.200309] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T21:56:52.415767] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-03. [2025-09-17T21:56:52.822539] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T21:56:53.215827] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-11. [2025-09-17T21:56:54.009532] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T21:56:54.021875] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-06. [2025-09-17T21:56:54.815809] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-04. [2025-09-17T21:56:55.027163] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T21:56:55.309379] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T21:56:55.615794] [INFO ] [REMOTE ] SW: Fetching primary data for 2024-12. [2025-09-17T21:56:56.183673] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T21:56:56.415844] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-05. [2025-09-17T21:56:57.215877] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-07. [2025-09-17T21:56:57.463758] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T21:56:58.015765] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-04. [2025-09-17T21:56:58.151475] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T21:56:58.631810] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T21:56:58.815788] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-08. [2025-09-17T21:56:59.615779] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-01. [2025-09-17T21:56:59.797902] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T21:57:00.252841] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-08 (1.44 seconds). [2025-09-17T21:57:00.415801] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-05. [2025-09-17T21:57:01.042185] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T21:57:01.215773] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-06. [2025-09-17T21:57:02.015797] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-02. [2025-09-17T21:57:02.190551] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T21:57:02.815837] [INFO ] [REMOTE ] SVV: Fetching primary data for 2025-09. [2025-09-17T21:57:03.615773] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-06. [2025-09-17T21:57:04.301511] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-06 (3.09 seconds). [2025-09-17T21:57:04.415727] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-07. [2025-09-17T21:57:05.427833] [INFO ] [REMOTE ] SVV: Incremental fetch complete for 2025-09 (2.61 seconds). [2025-09-17T21:57:05.433834] [INFO ] [REMOTE ] SVV: Full fetch complete (55365 records). [2025-09-17T21:57:05.433964] [DEBUG] [VALIDATOR ] SVV: Validating primary data. [2025-09-17T21:57:05.812782] [DEBUG] [VALIDATOR ] SVV: All expected trading days are present. [2025-09-17T21:57:05.812860] [DEBUG] [VALIDATOR ] SVV: Primary data validation passed. [2025-09-17T21:57:05.813711] [INFO ] [MAIN ] SVV: Fetched primary data is valid. [2025-09-17T21:57:05.813756] [DEBUG] [LOCAL ] SVV: Saving primary data. [2025-09-17T21:57:05.814873] [DEBUG] [LOCAL ] SVV: Trimmed 55365 records to 39382 (keeping 200 days of data) [2025-09-17T21:57:06.065601] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T21:57:06.086025] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-08. [2025-09-17T21:57:06.090831] [DEBUG] [LOCAL ] SVV: Primary data saved (39382 records). [2025-09-17T21:57:06.091390] [INFO ] [MAIN ] SVV: Full history saved. [2025-09-17T21:57:06.091550] [INFO ] [MAIN ] Update Progress: 2030/2371 symbols completed. SVV took 30.7s. Estimated remaining: 49m 54s. Rate: 6.8 symbols/min [2025-09-17T21:57:06.229536] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-06 (2.61 seconds). [2025-09-17T21:57:06.309162] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-07. [2025-09-17T21:57:06.310608] [INFO ] [MAIN ] SWK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:57:06.342575] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-02 (4.33 seconds). [2025-09-17T21:57:06.397937] [DEBUG] [LOCAL ] SWK: Loaded 52524 existing records from primary storage. [2025-09-17T21:57:06.398072] [INFO ] [MAIN ] SWK: Loaded 52524 existing records. [2025-09-17T21:57:06.574424] [WARN ] [MAIN ] SWK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:57:06.574712] [INFO ] [MAIN ] SWK: Wiping existing primary data before full refresh. [2025-09-17T21:57:06.574760] [INFO ] [LOCAL ] SWK: Starting deletion of primary data. [2025-09-17T21:57:06.575905] [DEBUG] [LOCAL ] SWK: Deleted primary data file. [2025-09-17T21:57:06.575966] [INFO ] [MAIN ] SWK: Starting full primary refresh. [2025-09-17T21:57:06.821124] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-03. [2025-09-17T21:57:06.932140] [INFO ] [REMOTE ] SWK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:57:07.615789] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-11. [2025-09-17T21:57:07.847426] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T21:57:08.035950] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T21:57:08.402343] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T21:57:08.415729] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-04. [2025-09-17T21:57:09.215783] [INFO ] [REMOTE ] SUPV: Fetching primary data for 2025-09. [2025-09-17T21:57:09.606057] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T21:57:10.015780] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-08. [2025-09-17T21:57:10.388322] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T21:57:10.546714] [INFO ] [REMOTE ] SUPV: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T21:57:10.553813] [INFO ] [REMOTE ] SUPV: Full fetch complete (67894 records). [2025-09-17T21:57:10.553960] [DEBUG] [VALIDATOR ] SUPV: Validating primary data. [2025-09-17T21:57:10.820863] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-05. [2025-09-17T21:57:10.958250] [DEBUG] [VALIDATOR ] SUPV: All expected trading days are present. [2025-09-17T21:57:10.958346] [DEBUG] [VALIDATOR ] SUPV: Primary data validation passed. [2025-09-17T21:57:10.959336] [INFO ] [MAIN ] SUPV: Fetched primary data is valid. [2025-09-17T21:57:10.959384] [DEBUG] [LOCAL ] SUPV: Saving primary data. [2025-09-17T21:57:10.962250] [DEBUG] [LOCAL ] SUPV: Trimmed 67894 records to 46929 (keeping 200 days of data) [2025-09-17T21:57:11.258965] [DEBUG] [LOCAL ] SUPV: Primary data saved (46929 records). [2025-09-17T21:57:11.259139] [INFO ] [MAIN ] SUPV: Full history saved. [2025-09-17T21:57:11.259257] [INFO ] [MAIN ] Update Progress: 2031/2371 symbols completed. SUPV took 42.6s. Estimated remaining: 49m 45s. Rate: 6.8 symbols/min [2025-09-17T21:57:11.449916] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T21:57:11.484222] [INFO ] [MAIN ] SWX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:57:11.516493] [DEBUG] [LOCAL ] SWX: Loaded 31321 existing records from primary storage. [2025-09-17T21:57:11.516731] [INFO ] [MAIN ] SWX: Loaded 31321 existing records. [2025-09-17T21:57:11.621564] [INFO ] [REMOTE ] SWK: Fetching primary data for 2024-12. [2025-09-17T21:57:11.705510] [WARN ] [MAIN ] SWX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:57:11.705828] [INFO ] [MAIN ] SWX: Wiping existing primary data before full refresh. [2025-09-17T21:57:11.705882] [INFO ] [LOCAL ] SWX: Starting deletion of primary data. [2025-09-17T21:57:11.707327] [DEBUG] [LOCAL ] SWX: Deleted primary data file. [2025-09-17T21:57:11.707394] [INFO ] [MAIN ] SWX: Starting full primary refresh. [2025-09-17T21:57:12.079802] [INFO ] [REMOTE ] SWX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:57:12.415794] [INFO ] [REMOTE ] SUZ: Fetching primary data for 2025-09. [2025-09-17T21:57:12.687128] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T21:57:13.098834] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T21:57:13.215755] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-01. [2025-09-17T21:57:13.494926] [INFO ] [REMOTE ] SUZ: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T21:57:13.500689] [INFO ] [REMOTE ] SUZ: Full fetch complete (67128 records). [2025-09-17T21:57:13.500815] [DEBUG] [VALIDATOR ] SUZ: Validating primary data. [2025-09-17T21:57:13.900001] [DEBUG] [VALIDATOR ] SUZ: All expected trading days are present. [2025-09-17T21:57:13.900079] [DEBUG] [VALIDATOR ] SUZ: Primary data validation passed. [2025-09-17T21:57:13.901040] [INFO ] [MAIN ] SUZ: Fetched primary data is valid. [2025-09-17T21:57:13.901085] [DEBUG] [LOCAL ] SUZ: Saving primary data. [2025-09-17T21:57:13.902413] [DEBUG] [LOCAL ] SUZ: Trimmed 67128 records to 45992 (keeping 200 days of data) [2025-09-17T21:57:14.015831] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-06. [2025-09-17T21:57:14.180816] [DEBUG] [LOCAL ] SUZ: Primary data saved (45992 records). [2025-09-17T21:57:14.180991] [INFO ] [MAIN ] SUZ: Full history saved. [2025-09-17T21:57:14.182878] [INFO ] [MAIN ] Update Progress: 2032/2371 symbols completed. SUZ took 40.5s. Estimated remaining: 49m 35s. Rate: 6.8 symbols/min [2025-09-17T21:57:14.354982] [INFO ] [MAIN ] SWZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:57:14.364543] [DEBUG] [LOCAL ] SWZ: Loaded 6209 existing records from primary storage. [2025-09-17T21:57:14.364696] [INFO ] [MAIN ] SWZ: Loaded 6209 existing records. [2025-09-17T21:57:14.549637] [WARN ] [MAIN ] SWZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:57:14.549898] [INFO ] [MAIN ] SWZ: Wiping existing primary data before full refresh. [2025-09-17T21:57:14.549960] [INFO ] [LOCAL ] SWZ: Starting deletion of primary data. [2025-09-17T21:57:14.550270] [DEBUG] [LOCAL ] SWZ: Deleted primary data file. [2025-09-17T21:57:14.550350] [INFO ] [MAIN ] SWZ: Starting full primary refresh. [2025-09-17T21:57:14.821072] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-11. [2025-09-17T21:57:14.924437] [INFO ] [REMOTE ] SWZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:57:15.615780] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-11. [2025-09-17T21:57:16.251960] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-01 (3.04 seconds). [2025-09-17T21:57:16.415770] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-02. [2025-09-17T21:57:16.500791] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T21:57:16.504885] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-06 (2.49 seconds). [2025-09-17T21:57:17.138337] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-11 (2.32 seconds). [2025-09-17T21:57:17.215744] [INFO ] [REMOTE ] SWX: Fetching primary data for 2024-12. [2025-09-17T21:57:17.784621] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T21:57:18.015827] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2024-12. [2025-09-17T21:57:18.238322] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T21:57:18.683520] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T21:57:18.815802] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-07. [2025-09-17T21:57:19.615828] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-01. [2025-09-17T21:57:20.415793] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-03. [2025-09-17T21:57:20.791765] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T21:57:20.966121] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T21:57:21.215835] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-01. [2025-09-17T21:57:21.882003] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T21:57:22.015747] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-02. [2025-09-17T21:57:22.391315] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-02 (0.38 seconds). [2025-09-17T21:57:22.464191] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-03 (2.05 seconds). [2025-09-17T21:57:22.815850] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-02. [2025-09-17T21:57:23.615775] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-03. [2025-09-17T21:57:24.213086] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-02 (1.40 seconds). [2025-09-17T21:57:24.259268] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T21:57:24.415776] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-03. [2025-09-17T21:57:25.215830] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-04. [2025-09-17T21:57:25.730050] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-03 (1.31 seconds). [2025-09-17T21:57:26.015814] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-04. [2025-09-17T21:57:26.146335] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T21:57:26.815763] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-05. [2025-09-17T21:57:27.615775] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-08. [2025-09-17T21:57:28.207670] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T21:57:28.415786] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-06. [2025-09-17T21:57:28.911970] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-04 (2.90 seconds). [2025-09-17T21:57:28.969857] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T21:57:29.215775] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-04. [2025-09-17T21:57:29.701675] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-08 (2.09 seconds). [2025-09-17T21:57:30.015781] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-05. [2025-09-17T21:57:30.711064] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T21:57:30.815780] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-07. [2025-09-17T21:57:31.465980] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T21:57:31.615765] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-05. [2025-09-17T21:57:31.811961] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T21:57:32.415826] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-08. [2025-09-17T21:57:32.705436] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T21:57:33.210546] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T21:57:33.215676] [INFO ] [REMOTE ] SWZ: Fetching primary data for 2025-09. [2025-09-17T21:57:33.781961] [INFO ] [REMOTE ] SWZ: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T21:57:33.783060] [INFO ] [REMOTE ] SWZ: Full fetch complete (8073 records). [2025-09-17T21:57:33.783140] [DEBUG] [VALIDATOR ] SWZ: Validating primary data. [2025-09-17T21:57:34.021789] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-06. [2025-09-17T21:57:34.150309] [DEBUG] [VALIDATOR ] SWZ: All expected trading days are present. [2025-09-17T21:57:34.150387] [DEBUG] [VALIDATOR ] SWZ: Primary data validation passed. [2025-09-17T21:57:34.150591] [INFO ] [MAIN ] SWZ: Fetched primary data is valid. [2025-09-17T21:57:34.150658] [DEBUG] [LOCAL ] SWZ: Saving primary data. [2025-09-17T21:57:34.151076] [DEBUG] [LOCAL ] SWZ: Trimmed 8073 records to 6184 (keeping 200 days of data) [2025-09-17T21:57:34.186533] [DEBUG] [LOCAL ] SWZ: Primary data saved (6184 records). [2025-09-17T21:57:34.186617] [INFO ] [MAIN ] SWZ: Full history saved. [2025-09-17T21:57:34.186729] [INFO ] [MAIN ] Update Progress: 2033/2371 symbols completed. SWZ took 20.0s. Estimated remaining: 49m 28s. Rate: 6.8 symbols/min [2025-09-17T21:57:34.359296] [INFO ] [MAIN ] SXC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:57:34.399849] [DEBUG] [LOCAL ] SXC: Loaded 41817 existing records from primary storage. [2025-09-17T21:57:34.400009] [INFO ] [MAIN ] SXC: Loaded 41817 existing records. [2025-09-17T21:57:34.578207] [WARN ] [MAIN ] SXC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:57:34.578506] [INFO ] [MAIN ] SXC: Wiping existing primary data before full refresh. [2025-09-17T21:57:34.578552] [INFO ] [LOCAL ] SXC: Starting deletion of primary data. [2025-09-17T21:57:34.579318] [DEBUG] [LOCAL ] SXC: Deleted primary data file. [2025-09-17T21:57:34.579376] [INFO ] [MAIN ] SXC: Starting full primary refresh. [2025-09-17T21:57:34.820870] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-06. [2025-09-17T21:57:34.937393] [INFO ] [REMOTE ] SXC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:57:35.615793] [INFO ] [REMOTE ] SW: Fetching primary data for 2025-09. [2025-09-17T21:57:35.936265] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T21:57:35.966480] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T21:57:36.014562] [INFO ] [REMOTE ] SW: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T21:57:36.021424] [INFO ] [REMOTE ] SW: Full fetch complete (76543 records). [2025-09-17T21:57:36.021543] [DEBUG] [VALIDATOR ] SW: Validating primary data. [2025-09-17T21:57:36.413955] [DEBUG] [VALIDATOR ] SW: All expected trading days are present. [2025-09-17T21:57:36.414070] [DEBUG] [VALIDATOR ] SW: Primary data validation passed. [2025-09-17T21:57:36.415172] [INFO ] [MAIN ] SW: Fetched primary data is valid. [2025-09-17T21:57:36.415218] [DEBUG] [LOCAL ] SW: Saving primary data. [2025-09-17T21:57:36.415991] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-07. [2025-09-17T21:57:36.418311] [DEBUG] [LOCAL ] SW: Trimmed 76543 records to 53165 (keeping 200 days of data) [2025-09-17T21:57:36.751716] [DEBUG] [LOCAL ] SW: Primary data saved (53165 records). [2025-09-17T21:57:36.751861] [INFO ] [MAIN ] SW: Full history saved. [2025-09-17T21:57:36.751964] [INFO ] [MAIN ] Update Progress: 2034/2371 symbols completed. SW took 45.9s. Estimated remaining: 49m 18s. Rate: 6.8 symbols/min [2025-09-17T21:57:36.924877] [INFO ] [MAIN ] SXI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:57:36.937751] [DEBUG] [LOCAL ] SXI: Loaded 11371 existing records from primary storage. [2025-09-17T21:57:36.937864] [INFO ] [MAIN ] SXI: Loaded 11371 existing records. [2025-09-17T21:57:37.112992] [WARN ] [MAIN ] SXI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:57:37.113302] [INFO ] [MAIN ] SXI: Wiping existing primary data before full refresh. [2025-09-17T21:57:37.113363] [INFO ] [LOCAL ] SXI: Starting deletion of primary data. [2025-09-17T21:57:37.113883] [DEBUG] [LOCAL ] SXI: Deleted primary data file. [2025-09-17T21:57:37.113971] [INFO ] [MAIN ] SXI: Starting full primary refresh. [2025-09-17T21:57:37.220853] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-07. [2025-09-17T21:57:37.469522] [INFO ] [REMOTE ] SXI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:57:37.563378] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T21:57:38.015775] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-11. [2025-09-17T21:57:38.615271] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T21:57:38.748978] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T21:57:38.815737] [INFO ] [REMOTE ] SXI: Fetching primary data for 2024-12. [2025-09-17T21:57:39.269543] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T21:57:39.615803] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-01. [2025-09-17T21:57:40.390868] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T21:57:40.415726] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-02. [2025-09-17T21:57:41.215793] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-11. [2025-09-17T21:57:41.318989] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-02 (0.90 seconds). [2025-09-17T21:57:42.015777] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-03. [2025-09-17T21:57:42.710919] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T21:57:42.757936] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-03 (0.74 seconds). [2025-09-17T21:57:42.815720] [INFO ] [REMOTE ] SXC: Fetching primary data for 2024-12. [2025-09-17T21:57:43.615800] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-04. [2025-09-17T21:57:44.276317] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T21:57:44.294475] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T21:57:44.415762] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-05. [2025-09-17T21:57:45.215772] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-01. [2025-09-17T21:57:45.244772] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-05 (0.83 seconds). [2025-09-17T21:57:46.015798] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-06. [2025-09-17T21:57:46.563545] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T21:57:46.764385] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T21:57:46.815716] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-02. [2025-09-17T21:57:47.615773] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-08. [2025-09-17T21:57:48.367216] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T21:57:48.421165] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-03. [2025-09-17T21:57:48.441736] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T21:57:49.215792] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-07. [2025-09-17T21:57:49.741124] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T21:57:50.015769] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-08. [2025-09-17T21:57:50.217852] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T21:57:50.815775] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-04. [2025-09-17T21:57:51.164008] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T21:57:51.615774] [INFO ] [REMOTE ] SWX: Fetching primary data for 2025-09. [2025-09-17T21:57:52.417294] [INFO ] [REMOTE ] SWK: Fetching primary data for 2025-09. [2025-09-17T21:57:52.419972] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-04 (1.60 seconds). [2025-09-17T21:57:52.797373] [INFO ] [REMOTE ] SWX: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T21:57:52.801662] [INFO ] [REMOTE ] SWX: Full fetch complete (43582 records). [2025-09-17T21:57:52.801814] [DEBUG] [VALIDATOR ] SWX: Validating primary data. [2025-09-17T21:57:53.225867] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-05. [2025-09-17T21:57:53.243381] [DEBUG] [VALIDATOR ] SWX: All expected trading days are present. [2025-09-17T21:57:53.244519] [DEBUG] [VALIDATOR ] SWX: Primary data validation passed. [2025-09-17T21:57:53.245871] [INFO ] [MAIN ] SWX: Fetched primary data is valid. [2025-09-17T21:57:53.246417] [DEBUG] [LOCAL ] SWX: Saving primary data. [2025-09-17T21:57:53.247155] [INFO ] [REMOTE ] SWK: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T21:57:53.255463] [DEBUG] [LOCAL ] SWX: Trimmed 43582 records to 31355 (keeping 200 days of data) [2025-09-17T21:57:53.256222] [INFO ] [REMOTE ] SWK: Full fetch complete (75206 records). [2025-09-17T21:57:53.256352] [DEBUG] [VALIDATOR ] SWK: Validating primary data. [2025-09-17T21:57:53.772761] [DEBUG] [LOCAL ] SWX: Primary data saved (31355 records). [2025-09-17T21:57:53.788245] [INFO ] [MAIN ] SWX: Full history saved. [2025-09-17T21:57:53.804563] [INFO ] [MAIN ] Update Progress: 2035/2371 symbols completed. SWX took 42.5s. Estimated remaining: 49m 11s. Rate: 6.8 symbols/min [2025-09-17T21:57:53.958027] [DEBUG] [VALIDATOR ] SWK: All expected trading days are present. [2025-09-17T21:57:53.968661] [DEBUG] [VALIDATOR ] SWK: Primary data validation passed. [2025-09-17T21:57:53.969953] [INFO ] [MAIN ] SWK: Fetched primary data is valid. [2025-09-17T21:57:53.970295] [DEBUG] [LOCAL ] SWK: Saving primary data. [2025-09-17T21:57:54.024626] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-08. [2025-09-17T21:57:54.025241] [DEBUG] [LOCAL ] SWK: Trimmed 75206 records to 52532 (keeping 200 days of data) [2025-09-17T21:57:54.106485] [INFO ] [MAIN ] SXT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:57:54.183112] [DEBUG] [LOCAL ] SXT: Loaded 28811 existing records from primary storage. [2025-09-17T21:57:54.185211] [INFO ] [MAIN ] SXT: Loaded 28811 existing records. [2025-09-17T21:57:54.459007] [WARN ] [MAIN ] SXT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:57:54.493560] [INFO ] [MAIN ] SXT: Wiping existing primary data before full refresh. [2025-09-17T21:57:54.494418] [INFO ] [LOCAL ] SXT: Starting deletion of primary data. [2025-09-17T21:57:54.503070] [DEBUG] [LOCAL ] SXT: Deleted primary data file. [2025-09-17T21:57:54.503893] [INFO ] [MAIN ] SXT: Starting full primary refresh. [2025-09-17T21:57:54.915115] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-08 (0.89 seconds). [2025-09-17T21:57:54.928056] [INFO ] [REMOTE ] SXI: Fetching primary data for 2025-09. [2025-09-17T21:57:54.927232] [INFO ] [REMOTE ] SXT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:57:55.015926] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T21:57:55.044808] [DEBUG] [LOCAL ] SWK: Primary data saved (52532 records). [2025-09-17T21:57:55.044939] [INFO ] [MAIN ] SWK: Full history saved. [2025-09-17T21:57:55.045962] [INFO ] [MAIN ] Update Progress: 2036/2371 symbols completed. SWK took 49.0s. Estimated remaining: 49m 1s. Rate: 6.8 symbols/min [2025-09-17T21:57:55.223864] [INFO ] [MAIN ] SYF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:57:55.280251] [DEBUG] [LOCAL ] SYF: Loaded 53466 existing records from primary storage. [2025-09-17T21:57:55.280397] [INFO ] [MAIN ] SYF: Loaded 53466 existing records. [2025-09-17T21:57:55.465091] [WARN ] [MAIN ] SYF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:57:55.465332] [INFO ] [MAIN ] SYF: Wiping existing primary data before full refresh. [2025-09-17T21:57:55.465380] [INFO ] [LOCAL ] SYF: Starting deletion of primary data. [2025-09-17T21:57:55.466365] [DEBUG] [LOCAL ] SYF: Deleted primary data file. [2025-09-17T21:57:55.466416] [INFO ] [MAIN ] SYF: Starting full primary refresh. [2025-09-17T21:57:55.622181] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-11. [2025-09-17T21:57:55.838730] [INFO ] [REMOTE ] SXI: Incremental fetch complete for 2025-09 (0.91 seconds). [2025-09-17T21:57:55.838441] [INFO ] [REMOTE ] SYF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:57:55.841089] [INFO ] [REMOTE ] SXI: Full fetch complete (14347 records). [2025-09-17T21:57:55.841161] [DEBUG] [VALIDATOR ] SXI: Validating primary data. [2025-09-17T21:57:56.202834] [DEBUG] [VALIDATOR ] SXI: All expected trading days are present. [2025-09-17T21:57:56.202917] [DEBUG] [VALIDATOR ] SXI: Primary data validation passed. [2025-09-17T21:57:56.203236] [INFO ] [MAIN ] SXI: Fetched primary data is valid. [2025-09-17T21:57:56.203307] [DEBUG] [LOCAL ] SXI: Saving primary data. [2025-09-17T21:57:56.203837] [DEBUG] [LOCAL ] SXI: Trimmed 14347 records to 11414 (keeping 200 days of data) [2025-09-17T21:57:56.277093] [DEBUG] [LOCAL ] SXI: Primary data saved (11414 records). [2025-09-17T21:57:56.277230] [INFO ] [MAIN ] SXI: Full history saved. [2025-09-17T21:57:56.277313] [INFO ] [MAIN ] Update Progress: 2037/2371 symbols completed. SXI took 19.5s. Estimated remaining: 48m 51s. Rate: 6.8 symbols/min [2025-09-17T21:57:56.415754] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-06. [2025-09-17T21:57:56.589756] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T21:57:57.215803] [INFO ] [REMOTE ] SXT: Fetching primary data for 2024-12. [2025-09-17T21:57:57.606406] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T21:57:58.015748] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-07. [2025-09-17T21:57:58.226463] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T21:57:58.815777] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-01. [2025-09-17T21:57:59.615764] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-11. [2025-09-17T21:57:59.680760] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T21:57:59.908848] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T21:58:00.415780] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-08. [2025-09-17T21:58:01.215767] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-02. [2025-09-17T21:58:01.304097] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T21:58:01.949795] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T21:58:01.997244] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T21:58:02.015723] [INFO ] [REMOTE ] SXC: Fetching primary data for 2025-09. [2025-09-17T21:58:02.815777] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-03. [2025-09-17T21:58:03.327545] [INFO ] [REMOTE ] SXC: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T21:58:03.332805] [INFO ] [REMOTE ] SXC: Full fetch complete (61142 records). [2025-09-17T21:58:03.332930] [DEBUG] [VALIDATOR ] SXC: Validating primary data. [2025-09-17T21:58:03.620864] [INFO ] [REMOTE ] SYF: Fetching primary data for 2024-12. [2025-09-17T21:58:03.723887] [DEBUG] [VALIDATOR ] SXC: All expected trading days are present. [2025-09-17T21:58:03.723989] [DEBUG] [VALIDATOR ] SXC: Primary data validation passed. [2025-09-17T21:58:03.724944] [INFO ] [MAIN ] SXC: Fetched primary data is valid. [2025-09-17T21:58:03.724988] [DEBUG] [LOCAL ] SXC: Saving primary data. [2025-09-17T21:58:03.726261] [DEBUG] [LOCAL ] SXC: Trimmed 61142 records to 41823 (keeping 200 days of data) [2025-09-17T21:58:03.980156] [DEBUG] [LOCAL ] SXC: Primary data saved (41823 records). [2025-09-17T21:58:03.980288] [INFO ] [MAIN ] SXC: Full history saved. [2025-09-17T21:58:03.980991] [INFO ] [MAIN ] Update Progress: 2038/2371 symbols completed. SXC took 29.8s. Estimated remaining: 48m 42s. Rate: 6.8 symbols/min [2025-09-17T21:58:04.208908] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T21:58:04.415817] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-04. [2025-09-17T21:58:05.101261] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T21:58:05.215787] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-01. [2025-09-17T21:58:05.527252] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T21:58:06.015778] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-05. [2025-09-17T21:58:06.854697] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T21:58:06.860301] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-06. [2025-09-17T21:58:07.416989] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-01 (2.20 seconds). [2025-09-17T21:58:07.615740] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-02. [2025-09-17T21:58:08.089736] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T21:58:08.415822] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-07. [2025-09-17T21:58:09.522424] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-17T21:58:09.532976] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-03. [2025-09-17T21:58:09.643662] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T21:58:10.015829] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-08. [2025-09-17T21:58:10.943853] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-03 (1.41 seconds). [2025-09-17T21:58:10.955191] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-04. [2025-09-17T21:58:11.301169] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T21:58:11.615786] [INFO ] [REMOTE ] SXT: Fetching primary data for 2025-09. [2025-09-17T21:58:12.651003] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T21:58:12.666057] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-05. [2025-09-17T21:58:12.826000] [INFO ] [REMOTE ] SXT: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T21:58:12.830129] [INFO ] [REMOTE ] SXT: Full fetch complete (37189 records). [2025-09-17T21:58:12.830225] [DEBUG] [VALIDATOR ] SXT: Validating primary data. [2025-09-17T21:58:13.200683] [DEBUG] [VALIDATOR ] SXT: All expected trading days are present. [2025-09-17T21:58:13.200767] [DEBUG] [VALIDATOR ] SXT: Primary data validation passed. [2025-09-17T21:58:13.201518] [INFO ] [MAIN ] SXT: Fetched primary data is valid. [2025-09-17T21:58:13.201557] [DEBUG] [LOCAL ] SXT: Saving primary data. [2025-09-17T21:58:13.202429] [DEBUG] [LOCAL ] SXT: Trimmed 37189 records to 28864 (keeping 200 days of data) [2025-09-17T21:58:13.380871] [DEBUG] [LOCAL ] SXT: Primary data saved (28864 records). [2025-09-17T21:58:13.381007] [INFO ] [MAIN ] SXT: Full history saved. [2025-09-17T21:58:13.381107] [INFO ] [MAIN ] Update Progress: 2039/2371 symbols completed. SXT took 19.6s. Estimated remaining: 48m 33s. Rate: 6.8 symbols/min [2025-09-17T21:58:14.538190] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T21:58:14.550146] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-06. [2025-09-17T21:58:16.377021] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T21:58:16.388027] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-07. [2025-09-17T21:58:18.589457] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-07 (2.20 seconds). [2025-09-17T21:58:18.601596] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-08. [2025-09-17T21:58:20.489661] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-08 (1.89 seconds). [2025-09-17T21:58:20.501244] [INFO ] [REMOTE ] SYF: Fetching primary data for 2025-09. [2025-09-17T21:58:21.181787] [INFO ] [REMOTE ] SYF: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T21:58:21.188888] [INFO ] [REMOTE ] SYF: Full fetch complete (77172 records). [2025-09-17T21:58:21.189067] [DEBUG] [VALIDATOR ] SYF: Validating primary data. [2025-09-17T21:58:21.605615] [DEBUG] [VALIDATOR ] SYF: All expected trading days are present. [2025-09-17T21:58:21.605723] [DEBUG] [VALIDATOR ] SYF: Primary data validation passed. [2025-09-17T21:58:21.606785] [INFO ] [MAIN ] SYF: Fetched primary data is valid. [2025-09-17T21:58:21.606835] [DEBUG] [LOCAL ] SYF: Saving primary data. [2025-09-17T21:58:21.608382] [DEBUG] [LOCAL ] SYF: Trimmed 77172 records to 53466 (keeping 200 days of data) [2025-09-17T21:58:21.949160] [DEBUG] [LOCAL ] SYF: Primary data saved (53466 records). [2025-09-17T21:58:21.949323] [INFO ] [MAIN ] SYF: Full history saved. [2025-09-17T21:58:21.950025] [INFO ] [MAIN ] Update Progress: 2040/2371 symbols completed. SYF took 26.9s. Estimated remaining: 48m 24s. Rate: 6.8 symbols/min [2025-09-17T21:58:22.552974] [INFO ] [MAIN ] SYY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:58:22.637637] [INFO ] [MAIN ] SYK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:58:22.696363] [INFO ] [MAIN ] T: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:58:22.694573] [INFO ] [MAIN ] TAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:58:22.822822] [DEBUG] [LOCAL ] SYY: Loaded 53255 existing records from primary storage. [2025-09-17T21:58:22.825663] [DEBUG] [LOCAL ] SYK: Loaded 47201 existing records from primary storage. [2025-09-17T21:58:22.825759] [INFO ] [MAIN ] SYK: Loaded 47201 existing records. [2025-09-17T21:58:22.826831] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-17T21:58:22.857535] [INFO ] [MAIN ] T: Loaded 53798 existing records. [2025-09-17T21:58:22.848155] [INFO ] [MAIN ] SYY: Loaded 53255 existing records. [2025-09-17T21:58:23.173002] [DEBUG] [LOCAL ] TAC: Loaded 43006 existing records from primary storage. [2025-09-17T21:58:23.218395] [INFO ] [MAIN ] TAC: Loaded 43006 existing records. [2025-09-17T21:58:23.508232] [WARN ] [MAIN ] T: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:58:23.544276] [WARN ] [MAIN ] SYY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:58:23.562559] [INFO ] [MAIN ] SYY: Wiping existing primary data before full refresh. [2025-09-17T21:58:23.562696] [WARN ] [MAIN ] SYK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:58:23.563153] [INFO ] [MAIN ] SYK: Wiping existing primary data before full refresh. [2025-09-17T21:58:23.563089] [INFO ] [LOCAL ] SYY: Starting deletion of primary data. [2025-09-17T21:58:23.568787] [INFO ] [MAIN ] T: Wiping existing primary data before full refresh. [2025-09-17T21:58:23.573988] [INFO ] [LOCAL ] T: Starting deletion of primary data. [2025-09-17T21:58:23.574098] [DEBUG] [LOCAL ] SYY: Deleted primary data file. [2025-09-17T21:58:23.574053] [INFO ] [LOCAL ] SYK: Starting deletion of primary data. [2025-09-17T21:58:23.579408] [INFO ] [MAIN ] SYY: Starting full primary refresh. [2025-09-17T21:58:23.615268] [DEBUG] [LOCAL ] SYK: Deleted primary data file. [2025-09-17T21:58:23.635343] [DEBUG] [LOCAL ] T: Deleted primary data file. [2025-09-17T21:58:23.681468] [INFO ] [MAIN ] T: Starting full primary refresh. [2025-09-17T21:58:23.691869] [INFO ] [MAIN ] SYK: Starting full primary refresh. [2025-09-17T21:58:23.857718] [WARN ] [MAIN ] TAC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:58:23.950477] [INFO ] [MAIN ] TAC: Wiping existing primary data before full refresh. [2025-09-17T21:58:23.971124] [INFO ] [LOCAL ] TAC: Starting deletion of primary data. [2025-09-17T21:58:24.096084] [DEBUG] [LOCAL ] TAC: Deleted primary data file. [2025-09-17T21:58:24.130348] [INFO ] [MAIN ] TAC: Starting full primary refresh. [2025-09-17T21:58:24.857758] [INFO ] [REMOTE ] SYK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:58:24.874857] [INFO ] [REMOTE ] T: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:58:24.880342] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-11. [2025-09-17T21:58:24.923688] [INFO ] [REMOTE ] SYY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:58:24.901851] [INFO ] [REMOTE ] T: Fetching primary data for 2024-11. [2025-09-17T21:58:24.960762] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-11. [2025-09-17T21:58:25.153070] [INFO ] [REMOTE ] TAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:58:25.153404] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-11. [2025-09-17T21:58:26.331372] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T21:58:26.342400] [INFO ] [REMOTE ] SYK: Fetching primary data for 2024-12. [2025-09-17T21:58:26.682949] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T21:58:26.691665] [INFO ] [REMOTE ] TAC: Fetching primary data for 2024-12. [2025-09-17T21:58:26.769755] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T21:58:26.781107] [INFO ] [REMOTE ] SYY: Fetching primary data for 2024-12. [2025-09-17T21:58:27.364472] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-11 (2.46 seconds). [2025-09-17T21:58:27.375944] [INFO ] [REMOTE ] T: Fetching primary data for 2024-12. [2025-09-17T21:58:27.945486] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T21:58:27.955208] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-01. [2025-09-17T21:58:28.194895] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T21:58:28.205796] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-01. [2025-09-17T21:58:28.668448] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2024-12 (2.33 seconds). [2025-09-17T21:58:28.678038] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-01. [2025-09-17T21:58:29.617385] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T21:58:29.627418] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-02. [2025-09-17T21:58:29.761216] [INFO ] [REMOTE ] T: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-17T21:58:29.772404] [INFO ] [REMOTE ] T: Fetching primary data for 2025-01. [2025-09-17T21:58:29.812805] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T21:58:29.823680] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-02. [2025-09-17T21:58:30.774106] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-01 (2.10 seconds). [2025-09-17T21:58:30.784915] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-02. [2025-09-17T21:58:31.283385] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T21:58:31.292696] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-03. [2025-09-17T21:58:31.609691] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T21:58:31.620350] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-03. [2025-09-17T21:58:31.687139] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T21:58:31.698098] [INFO ] [REMOTE ] T: Fetching primary data for 2025-02. [2025-09-17T21:58:32.669295] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T21:58:32.679155] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-03. [2025-09-17T21:58:32.748310] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T21:58:32.757984] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-04. [2025-09-17T21:58:33.422152] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T21:58:33.433328] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-04. [2025-09-17T21:58:33.603865] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-17T21:58:33.614168] [INFO ] [REMOTE ] T: Fetching primary data for 2025-03. [2025-09-17T21:58:34.166877] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T21:58:34.177245] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-04. [2025-09-17T21:58:34.451708] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T21:58:34.815853] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-05. [2025-09-17T21:58:35.432887] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T21:58:35.615743] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-05. [2025-09-17T21:58:35.671732] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T21:58:36.147257] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T21:58:36.327176] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T21:58:36.415791] [INFO ] [REMOTE ] T: Fetching primary data for 2025-04. [2025-09-17T21:58:37.215780] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-05. [2025-09-17T21:58:37.305047] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T21:58:38.015770] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-06. [2025-09-17T21:58:38.518505] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-04 (2.10 seconds). [2025-09-17T21:58:38.629452] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-05 (1.41 seconds). [2025-09-17T21:58:38.815774] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-06. [2025-09-17T21:58:39.550597] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T21:58:39.615727] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-07. [2025-09-17T21:58:40.415772] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-06. [2025-09-17T21:58:40.528319] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T21:58:40.868910] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-07 (1.25 seconds). [2025-09-17T21:58:41.215792] [INFO ] [REMOTE ] T: Fetching primary data for 2025-05. [2025-09-17T21:58:42.015795] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-08. [2025-09-17T21:58:42.296427] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T21:58:42.815780] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-07. [2025-09-17T21:58:43.380888] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T21:58:43.615777] [INFO ] [REMOTE ] T: Fetching primary data for 2025-06. [2025-09-17T21:58:43.793107] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T21:58:44.365838] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T21:58:44.415754] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-08. [2025-09-17T21:58:45.215825] [INFO ] [REMOTE ] TAC: Fetching primary data for 2025-09. [2025-09-17T21:58:45.930447] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-17T21:58:46.015761] [INFO ] [REMOTE ] T: Fetching primary data for 2025-07. [2025-09-17T21:58:46.232473] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-08 (1.82 seconds). [2025-09-17T21:58:46.617351] [INFO ] [REMOTE ] TAC: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T21:58:46.622556] [INFO ] [REMOTE ] TAC: Full fetch complete (64129 records). [2025-09-17T21:58:46.622694] [DEBUG] [VALIDATOR ] TAC: Validating primary data. [2025-09-17T21:58:46.820865] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-07. [2025-09-17T21:58:47.015505] [DEBUG] [VALIDATOR ] TAC: All expected trading days are present. [2025-09-17T21:58:47.015589] [DEBUG] [VALIDATOR ] TAC: Primary data validation passed. [2025-09-17T21:58:47.016563] [INFO ] [MAIN ] TAC: Fetched primary data is valid. [2025-09-17T21:58:47.016611] [DEBUG] [LOCAL ] TAC: Saving primary data. [2025-09-17T21:58:47.017910] [DEBUG] [LOCAL ] TAC: Trimmed 64129 records to 43008 (keeping 200 days of data) [2025-09-17T21:58:47.285860] [DEBUG] [LOCAL ] TAC: Primary data saved (43008 records). [2025-09-17T21:58:47.286003] [INFO ] [MAIN ] TAC: Full history saved. [2025-09-17T21:58:47.286106] [INFO ] [MAIN ] Update Progress: 2041/2371 symbols completed. TAC took 25.3s. Estimated remaining: 48m 18s. Rate: 6.8 symbols/min [2025-09-17T21:58:47.460137] [INFO ] [MAIN ] TAK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:58:47.508360] [DEBUG] [LOCAL ] TAK: Loaded 49933 existing records from primary storage. [2025-09-17T21:58:47.508506] [INFO ] [MAIN ] TAK: Loaded 49933 existing records. [2025-09-17T21:58:47.620856] [INFO ] [REMOTE ] SYY: Fetching primary data for 2025-09. [2025-09-17T21:58:47.693449] [WARN ] [MAIN ] TAK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:58:47.693690] [INFO ] [MAIN ] TAK: Wiping existing primary data before full refresh. [2025-09-17T21:58:47.693737] [INFO ] [LOCAL ] TAK: Starting deletion of primary data. [2025-09-17T21:58:47.694687] [DEBUG] [LOCAL ] TAK: Deleted primary data file. [2025-09-17T21:58:47.694738] [INFO ] [MAIN ] TAK: Starting full primary refresh. [2025-09-17T21:58:48.067016] [INFO ] [REMOTE ] TAK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:58:48.085851] [INFO ] [REMOTE ] SYY: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T21:58:48.094146] [INFO ] [REMOTE ] SYY: Full fetch complete (76803 records). [2025-09-17T21:58:48.094277] [DEBUG] [VALIDATOR ] SYY: Validating primary data. [2025-09-17T21:58:48.431507] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-11. [2025-09-17T21:58:48.491266] [DEBUG] [VALIDATOR ] SYY: All expected trading days are present. [2025-09-17T21:58:48.491573] [DEBUG] [VALIDATOR ] SYY: Primary data validation passed. [2025-09-17T21:58:48.492780] [INFO ] [MAIN ] SYY: Fetched primary data is valid. [2025-09-17T21:58:48.492856] [DEBUG] [LOCAL ] SYY: Saving primary data. [2025-09-17T21:58:48.494466] [DEBUG] [LOCAL ] SYY: Trimmed 76803 records to 53252 (keeping 200 days of data) [2025-09-17T21:58:48.753522] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-07 (2.74 seconds). [2025-09-17T21:58:48.855887] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T21:58:48.918471] [DEBUG] [LOCAL ] SYY: Primary data saved (53252 records). [2025-09-17T21:58:48.918706] [INFO ] [MAIN ] SYY: Full history saved. [2025-09-17T21:58:48.919568] [INFO ] [MAIN ] Update Progress: 2042/2371 symbols completed. SYY took 27.0s. Estimated remaining: 48m 8s. Rate: 6.8 symbols/min [2025-09-17T21:58:49.089354] [INFO ] [MAIN ] TAL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:58:49.147290] [DEBUG] [LOCAL ] TAL: Loaded 52199 existing records from primary storage. [2025-09-17T21:58:49.147438] [INFO ] [MAIN ] TAL: Loaded 52199 existing records. [2025-09-17T21:58:49.222179] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-08. [2025-09-17T21:58:49.328057] [WARN ] [MAIN ] TAL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:58:49.328299] [INFO ] [MAIN ] TAL: Wiping existing primary data before full refresh. [2025-09-17T21:58:49.328344] [INFO ] [LOCAL ] TAL: Starting deletion of primary data. [2025-09-17T21:58:49.329280] [DEBUG] [LOCAL ] TAL: Deleted primary data file. [2025-09-17T21:58:49.329332] [INFO ] [MAIN ] TAL: Starting full primary refresh. [2025-09-17T21:58:49.694875] [INFO ] [REMOTE ] TAL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:58:49.814173] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-11 (1.38 seconds). [2025-09-17T21:58:50.015799] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-11. [2025-09-17T21:58:50.815757] [INFO ] [REMOTE ] TAK: Fetching primary data for 2024-12. [2025-09-17T21:58:50.896081] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-08 (1.67 seconds). [2025-09-17T21:58:51.615797] [INFO ] [REMOTE ] T: Fetching primary data for 2025-08. [2025-09-17T21:58:51.729438] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T21:58:52.412629] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T21:58:52.422039] [INFO ] [REMOTE ] SYK: Fetching primary data for 2025-09. [2025-09-17T21:58:52.818024] [INFO ] [REMOTE ] SYK: Incremental fetch complete for 2025-09 (0.40 seconds). [2025-09-17T21:58:52.823991] [INFO ] [REMOTE ] SYK: Full fetch complete (68523 records). [2025-09-17T21:58:52.824124] [DEBUG] [VALIDATOR ] SYK: Validating primary data. [2025-09-17T21:58:53.219356] [DEBUG] [VALIDATOR ] SYK: All expected trading days are present. [2025-09-17T21:58:53.219137] [INFO ] [REMOTE ] TAL: Fetching primary data for 2024-12. [2025-09-17T21:58:53.219493] [DEBUG] [VALIDATOR ] SYK: Primary data validation passed. [2025-09-17T21:58:53.221395] [INFO ] [MAIN ] SYK: Fetched primary data is valid. [2025-09-17T21:58:53.221575] [DEBUG] [LOCAL ] SYK: Saving primary data. [2025-09-17T21:58:53.223177] [DEBUG] [LOCAL ] SYK: Trimmed 68523 records to 47145 (keeping 200 days of data) [2025-09-17T21:58:53.529544] [DEBUG] [LOCAL ] SYK: Primary data saved (47145 records). [2025-09-17T21:58:53.529712] [INFO ] [MAIN ] SYK: Full history saved. [2025-09-17T21:58:53.529838] [INFO ] [MAIN ] Update Progress: 2043/2371 symbols completed. SYK took 31.6s. Estimated remaining: 47m 59s. Rate: 6.8 symbols/min [2025-09-17T21:58:53.701063] [INFO ] [MAIN ] TALO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:58:53.751082] [DEBUG] [LOCAL ] TALO: Loaded 50842 existing records from primary storage. [2025-09-17T21:58:53.751231] [INFO ] [MAIN ] TALO: Loaded 50842 existing records. [2025-09-17T21:58:53.931062] [WARN ] [MAIN ] TALO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:58:53.931363] [INFO ] [MAIN ] TALO: Wiping existing primary data before full refresh. [2025-09-17T21:58:53.931438] [INFO ] [LOCAL ] TALO: Starting deletion of primary data. [2025-09-17T21:58:53.932503] [DEBUG] [LOCAL ] TALO: Deleted primary data file. [2025-09-17T21:58:53.932566] [INFO ] [MAIN ] TALO: Starting full primary refresh. [2025-09-17T21:58:54.016212] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-01. [2025-09-17T21:58:54.319440] [INFO ] [REMOTE ] TALO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:58:54.354991] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-08 (2.74 seconds). [2025-09-17T21:58:54.815800] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-11. [2025-09-17T21:58:55.075571] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T21:58:55.615800] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-01. [2025-09-17T21:58:55.800590] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-01 (1.78 seconds). [2025-09-17T21:58:56.422011] [INFO ] [REMOTE ] T: Fetching primary data for 2025-09. [2025-09-17T21:58:56.428910] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T21:58:57.109850] [INFO ] [REMOTE ] T: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T21:58:57.117024] [INFO ] [REMOTE ] T: Full fetch complete (77910 records). [2025-09-17T21:58:57.117204] [DEBUG] [VALIDATOR ] T: Validating primary data. [2025-09-17T21:58:57.221133] [INFO ] [REMOTE ] TALO: Fetching primary data for 2024-12. [2025-09-17T21:58:57.529338] [DEBUG] [VALIDATOR ] T: All expected trading days are present. [2025-09-17T21:58:57.529540] [DEBUG] [VALIDATOR ] T: Primary data validation passed. [2025-09-17T21:58:57.530822] [INFO ] [MAIN ] T: Fetched primary data is valid. [2025-09-17T21:58:57.530923] [DEBUG] [LOCAL ] T: Saving primary data. [2025-09-17T21:58:57.544081] [DEBUG] [LOCAL ] T: Trimmed 77910 records to 53798 (keeping 200 days of data) [2025-09-17T21:58:57.563604] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T21:58:57.907464] [DEBUG] [LOCAL ] T: Primary data saved (53798 records). [2025-09-17T21:58:57.907629] [INFO ] [MAIN ] T: Full history saved. [2025-09-17T21:58:57.907774] [INFO ] [MAIN ] Update Progress: 2044/2371 symbols completed. T took 36.0s. Estimated remaining: 47m 49s. Rate: 6.8 symbols/min [2025-09-17T21:58:58.020924] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-02. [2025-09-17T21:58:58.079942] [INFO ] [MAIN ] TAP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:58:58.133151] [DEBUG] [LOCAL ] TAP: Loaded 52841 existing records from primary storage. [2025-09-17T21:58:58.133296] [INFO ] [MAIN ] TAP: Loaded 52841 existing records. [2025-09-17T21:58:58.313624] [WARN ] [MAIN ] TAP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:58:58.313966] [INFO ] [MAIN ] TAP: Wiping existing primary data before full refresh. [2025-09-17T21:58:58.314032] [INFO ] [LOCAL ] TAP: Starting deletion of primary data. [2025-09-17T21:58:58.315222] [DEBUG] [LOCAL ] TAP: Deleted primary data file. [2025-09-17T21:58:58.315283] [INFO ] [MAIN ] TAP: Starting full primary refresh. [2025-09-17T21:58:58.682186] [INFO ] [REMOTE ] TAP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:58:58.815812] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-02. [2025-09-17T21:58:58.909700] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T21:58:59.233737] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T21:58:59.615819] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-01. [2025-09-17T21:59:00.415792] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-11. [2025-09-17T21:59:00.669789] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T21:59:01.215826] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-03. [2025-09-17T21:59:01.344506] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T21:59:01.871764] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T21:59:02.015789] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-02. [2025-09-17T21:59:02.693673] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T21:59:02.815799] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-03. [2025-09-17T21:59:03.611531] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T21:59:03.620531] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-04. [2025-09-17T21:59:04.181251] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T21:59:04.415824] [INFO ] [REMOTE ] TAP: Fetching primary data for 2024-12. [2025-09-17T21:59:05.215791] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-03. [2025-09-17T21:59:05.278571] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T21:59:06.015804] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-05. [2025-09-17T21:59:06.136428] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T21:59:06.611244] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T21:59:06.815824] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-01. [2025-09-17T21:59:07.537010] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T21:59:07.615793] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-04. [2025-09-17T21:59:08.415739] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-04. [2025-09-17T21:59:08.572290] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T21:59:09.014619] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T21:59:09.215785] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-02. [2025-09-17T21:59:10.015791] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-05. [2025-09-17T21:59:10.168016] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T21:59:10.815849] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-06. [2025-09-17T21:59:10.969814] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T21:59:11.615824] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-03. [2025-09-17T21:59:12.121922] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-17T21:59:12.420910] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-05. [2025-09-17T21:59:12.445000] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T21:59:13.220911] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-07. [2025-09-17T21:59:13.237592] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-03 (1.62 seconds). [2025-09-17T21:59:13.992613] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T21:59:14.015747] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-06. [2025-09-17T21:59:14.815827] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-04. [2025-09-17T21:59:15.152559] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T21:59:15.272226] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-06 (1.26 seconds). [2025-09-17T21:59:15.615808] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-07. [2025-09-17T21:59:16.415695] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-06. [2025-09-17T21:59:16.488342] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T21:59:17.215819] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-08. [2025-09-17T21:59:17.339161] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T21:59:17.624876] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T21:59:18.015784] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-08. [2025-09-17T21:59:18.582987] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T21:59:18.815800] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-07. [2025-09-17T21:59:19.615820] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-05. [2025-09-17T21:59:19.854206] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-08 (1.84 seconds). [2025-09-17T21:59:20.127832] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-07 (1.31 seconds). [2025-09-17T21:59:20.415783] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-08. [2025-09-17T21:59:21.101398] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T21:59:21.215751] [INFO ] [REMOTE ] TALO: Fetching primary data for 2025-09. [2025-09-17T21:59:22.015776] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-06. [2025-09-17T21:59:22.192727] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-08 (1.78 seconds). [2025-09-17T21:59:22.600444] [INFO ] [REMOTE ] TALO: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T21:59:22.607131] [INFO ] [REMOTE ] TALO: Full fetch complete (72910 records). [2025-09-17T21:59:22.607259] [DEBUG] [VALIDATOR ] TALO: Validating primary data. [2025-09-17T21:59:22.822339] [INFO ] [REMOTE ] TAL: Fetching primary data for 2025-09. [2025-09-17T21:59:22.998211] [DEBUG] [VALIDATOR ] TALO: All expected trading days are present. [2025-09-17T21:59:22.998299] [DEBUG] [VALIDATOR ] TALO: Primary data validation passed. [2025-09-17T21:59:22.999320] [INFO ] [MAIN ] TALO: Fetched primary data is valid. [2025-09-17T21:59:22.999384] [DEBUG] [LOCAL ] TALO: Saving primary data. [2025-09-17T21:59:23.000869] [DEBUG] [LOCAL ] TALO: Trimmed 72910 records to 50840 (keeping 200 days of data) [2025-09-17T21:59:23.289696] [DEBUG] [LOCAL ] TALO: Primary data saved (50840 records). [2025-09-17T21:59:23.289836] [INFO ] [MAIN ] TALO: Full history saved. [2025-09-17T21:59:23.289928] [INFO ] [MAIN ] Update Progress: 2045/2371 symbols completed. TALO took 29.8s. Estimated remaining: 47m 43s. Rate: 6.8 symbols/min [2025-09-17T21:59:23.459249] [INFO ] [MAIN ] TBB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:59:23.472327] [DEBUG] [LOCAL ] TBB: Loaded 11757 existing records from primary storage. [2025-09-17T21:59:23.472447] [INFO ] [MAIN ] TBB: Loaded 11757 existing records. [2025-09-17T21:59:23.616973] [INFO ] [REMOTE ] TAK: Fetching primary data for 2025-09. [2025-09-17T21:59:23.652255] [WARN ] [MAIN ] TBB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:59:23.652490] [INFO ] [MAIN ] TBB: Wiping existing primary data before full refresh. [2025-09-17T21:59:23.652538] [INFO ] [LOCAL ] TBB: Starting deletion of primary data. [2025-09-17T21:59:23.652969] [DEBUG] [LOCAL ] TBB: Deleted primary data file. [2025-09-17T21:59:23.653029] [INFO ] [MAIN ] TBB: Starting full primary refresh. [2025-09-17T21:59:24.018237] [INFO ] [REMOTE ] TBB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:59:24.053796] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T21:59:24.415784] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-07. [2025-09-17T21:59:24.698049] [INFO ] [REMOTE ] TAL: Incremental fetch complete for 2025-09 (1.88 seconds). [2025-09-17T21:59:24.706719] [INFO ] [REMOTE ] TAL: Full fetch complete (75522 records). [2025-09-17T21:59:24.706886] [DEBUG] [VALIDATOR ] TAL: Validating primary data. [2025-09-17T21:59:25.095875] [DEBUG] [VALIDATOR ] TAL: All expected trading days are present. [2025-09-17T21:59:25.095970] [DEBUG] [VALIDATOR ] TAL: Primary data validation passed. [2025-09-17T21:59:25.097101] [INFO ] [MAIN ] TAL: Fetched primary data is valid. [2025-09-17T21:59:25.097169] [DEBUG] [LOCAL ] TAL: Saving primary data. [2025-09-17T21:59:25.098717] [DEBUG] [LOCAL ] TAL: Trimmed 75522 records to 52163 (keeping 200 days of data) [2025-09-17T21:59:25.215804] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-11. [2025-09-17T21:59:25.339411] [INFO ] [REMOTE ] TAK: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T21:59:25.349739] [INFO ] [REMOTE ] TAK: Full fetch complete (71348 records). [2025-09-17T21:59:25.351455] [DEBUG] [VALIDATOR ] TAK: Validating primary data. [2025-09-17T21:59:25.857987] [DEBUG] [VALIDATOR ] TAK: All expected trading days are present. [2025-09-17T21:59:25.858747] [DEBUG] [VALIDATOR ] TAK: Primary data validation passed. [2025-09-17T21:59:25.860529] [INFO ] [MAIN ] TAK: Fetched primary data is valid. [2025-09-17T21:59:25.860616] [DEBUG] [LOCAL ] TAK: Saving primary data. [2025-09-17T21:59:25.866130] [DEBUG] [LOCAL ] TAK: Trimmed 71348 records to 49995 (keeping 200 days of data) [2025-09-17T21:59:25.871828] [DEBUG] [LOCAL ] TAL: Primary data saved (52163 records). [2025-09-17T21:59:25.921112] [INFO ] [MAIN ] TAL: Full history saved. [2025-09-17T21:59:25.932529] [INFO ] [MAIN ] Update Progress: 2046/2371 symbols completed. TAL took 37.0s. Estimated remaining: 47m 34s. Rate: 6.8 symbols/min [2025-09-17T21:59:26.176175] [INFO ] [MAIN ] TBBB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:59:26.191954] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T21:59:26.196115] [INFO ] [REMOTE ] TBB: Fetching primary data for 2024-12. [2025-09-17T21:59:26.314489] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-07 (1.90 seconds). [2025-09-17T21:59:26.386891] [DEBUG] [LOCAL ] TBBB: Loaded 36156 existing records from primary storage. [2025-09-17T21:59:26.388978] [INFO ] [MAIN ] TBBB: Loaded 36156 existing records. [2025-09-17T21:59:26.596072] [WARN ] [MAIN ] TBBB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:59:26.597422] [INFO ] [MAIN ] TBBB: Wiping existing primary data before full refresh. [2025-09-17T21:59:26.599633] [INFO ] [LOCAL ] TBBB: Starting deletion of primary data. [2025-09-17T21:59:26.601860] [DEBUG] [LOCAL ] TBBB: Deleted primary data file. [2025-09-17T21:59:26.604071] [INFO ] [MAIN ] TBBB: Starting full primary refresh. [2025-09-17T21:59:26.819252] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-08. [2025-09-17T21:59:27.002691] [DEBUG] [LOCAL ] TAK: Primary data saved (49995 records). [2025-09-17T21:59:27.013400] [INFO ] [MAIN ] TAK: Full history saved. [2025-09-17T21:59:27.025181] [INFO ] [MAIN ] Update Progress: 2047/2371 symbols completed. TAK took 39.7s. Estimated remaining: 47m 24s. Rate: 6.8 symbols/min [2025-09-17T21:59:27.203061] [INFO ] [REMOTE ] TBBB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:59:27.290977] [INFO ] [MAIN ] TBI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:59:27.309680] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T21:59:27.335354] [DEBUG] [LOCAL ] TBI: Loaded 22761 existing records from primary storage. [2025-09-17T21:59:27.335501] [INFO ] [MAIN ] TBI: Loaded 22761 existing records. [2025-09-17T21:59:27.547911] [WARN ] [MAIN ] TBI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:59:27.548740] [INFO ] [MAIN ] TBI: Wiping existing primary data before full refresh. [2025-09-17T21:59:27.548858] [INFO ] [LOCAL ] TBI: Starting deletion of primary data. [2025-09-17T21:59:27.549596] [DEBUG] [LOCAL ] TBI: Deleted primary data file. [2025-09-17T21:59:27.549718] [INFO ] [MAIN ] TBI: Starting full primary refresh. [2025-09-17T21:59:27.620125] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-01. [2025-09-17T21:59:27.877569] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T21:59:27.998904] [INFO ] [REMOTE ] TBI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:59:28.415785] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-11. [2025-09-17T21:59:28.601598] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T21:59:29.215781] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-02. [2025-09-17T21:59:29.485364] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-11 (1.07 seconds). [2025-09-17T21:59:29.659520] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-02 (0.44 seconds). [2025-09-17T21:59:30.015789] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-03. [2025-09-17T21:59:30.815808] [INFO ] [REMOTE ] TAP: Fetching primary data for 2025-09. [2025-09-17T21:59:30.865150] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T21:59:31.504623] [INFO ] [REMOTE ] TAP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T21:59:31.512631] [INFO ] [REMOTE ] TAP: Full fetch complete (75971 records). [2025-09-17T21:59:31.512912] [DEBUG] [VALIDATOR ] TAP: Validating primary data. [2025-09-17T21:59:31.620893] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-04. [2025-09-17T21:59:31.955476] [DEBUG] [VALIDATOR ] TAP: All expected trading days are present. [2025-09-17T21:59:31.955567] [DEBUG] [VALIDATOR ] TAP: Primary data validation passed. [2025-09-17T21:59:31.956663] [INFO ] [MAIN ] TAP: Fetched primary data is valid. [2025-09-17T21:59:31.956752] [DEBUG] [LOCAL ] TAP: Saving primary data. [2025-09-17T21:59:31.959231] [DEBUG] [LOCAL ] TAP: Trimmed 75971 records to 52847 (keeping 200 days of data) [2025-09-17T21:59:32.300331] [DEBUG] [LOCAL ] TAP: Primary data saved (52847 records). [2025-09-17T21:59:32.300483] [INFO ] [MAIN ] TAP: Full history saved. [2025-09-17T21:59:32.300609] [INFO ] [MAIN ] Update Progress: 2048/2371 symbols completed. TAP took 34.4s. Estimated remaining: 47m 14s. Rate: 6.8 symbols/min [2025-09-17T21:59:32.420902] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-11. [2025-09-17T21:59:32.488704] [INFO ] [MAIN ] TBLU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:59:32.488875] [DEBUG] [LOCAL ] TBLU: No existing data file found in primary storage. [2025-09-17T21:59:32.488912] [WARN ] [MAIN ] TBLU: No existing data found, performing full refresh instead. [2025-09-17T21:59:32.489051] [INFO ] [MAIN ] TBLU: Wiping existing primary data before full refresh. [2025-09-17T21:59:32.489093] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-17T21:59:32.489133] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-17T21:59:32.489180] [INFO ] [MAIN ] TBLU: Starting full primary refresh. [2025-09-17T21:59:32.679890] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T21:59:32.872273] [INFO ] [REMOTE ] TBLU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:59:33.215789] [INFO ] [REMOTE ] TBI: Fetching primary data for 2024-12. [2025-09-17T21:59:33.531047] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T21:59:34.015788] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-05. [2025-09-17T21:59:34.330973] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T21:59:34.549313] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T21:59:34.815786] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-06. [2025-09-17T21:59:35.615803] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2024-12. [2025-09-17T21:59:35.628246] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T21:59:36.415800] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-01. [2025-09-17T21:59:36.521492] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2024-12 (0.91 seconds). [2025-09-17T21:59:37.215789] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-11. [2025-09-17T21:59:37.472049] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T21:59:37.536306] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-11 (0.32 seconds). [2025-09-17T21:59:38.015803] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-01. [2025-09-17T21:59:38.815795] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-02. [2025-09-17T21:59:39.348700] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T21:59:39.615770] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-02. [2025-09-17T21:59:39.851125] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T21:59:40.415784] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-07. [2025-09-17T21:59:41.033760] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T21:59:41.215788] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-03. [2025-09-17T21:59:41.257673] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-07 (0.84 seconds). [2025-09-17T21:59:42.015785] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-03. [2025-09-17T21:59:42.297341] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T21:59:42.815779] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2024-12. [2025-09-17T21:59:43.092627] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-03 (1.08 seconds). [2025-09-17T21:59:43.196097] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2024-12 (0.38 seconds). [2025-09-17T21:59:43.615776] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-04. [2025-09-17T21:59:44.415779] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-08. [2025-09-17T21:59:45.108639] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T21:59:45.154185] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T21:59:45.215778] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-01. [2025-09-17T21:59:45.496862] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-01 (0.28 seconds). [2025-09-17T21:59:46.015778] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-02. [2025-09-17T21:59:46.296995] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-02 (0.28 seconds). [2025-09-17T21:59:46.815824] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-04. [2025-09-17T21:59:47.615816] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-05. [2025-09-17T21:59:48.002921] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T21:59:48.415788] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-05. [2025-09-17T21:59:48.796126] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-05 (1.18 seconds). [2025-09-17T21:59:49.215781] [INFO ] [REMOTE ] TBB: Fetching primary data for 2025-09. [2025-09-17T21:59:49.696053] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T21:59:50.015786] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-06. [2025-09-17T21:59:50.050588] [INFO ] [REMOTE ] TBB: Incremental fetch complete for 2025-09 (0.83 seconds). [2025-09-17T21:59:50.052914] [INFO ] [REMOTE ] TBB: Full fetch complete (18384 records). [2025-09-17T21:59:50.052990] [DEBUG] [VALIDATOR ] TBB: Validating primary data. [2025-09-17T21:59:50.427413] [DEBUG] [VALIDATOR ] TBB: All expected trading days are present. [2025-09-17T21:59:50.427492] [DEBUG] [VALIDATOR ] TBB: Primary data validation passed. [2025-09-17T21:59:50.427923] [INFO ] [MAIN ] TBB: Fetched primary data is valid. [2025-09-17T21:59:50.427987] [DEBUG] [LOCAL ] TBB: Saving primary data. [2025-09-17T21:59:50.428576] [DEBUG] [LOCAL ] TBB: Trimmed 18384 records to 11751 (keeping 200 days of data) [2025-09-17T21:59:50.506980] [DEBUG] [LOCAL ] TBB: Primary data saved (11751 records). [2025-09-17T21:59:50.507116] [INFO ] [MAIN ] TBB: Full history saved. [2025-09-17T21:59:50.507237] [INFO ] [MAIN ] Update Progress: 2049/2371 symbols completed. TBB took 27.2s. Estimated remaining: 47m 7s. Rate: 6.8 symbols/min [2025-09-17T21:59:50.677768] [INFO ] [MAIN ] TBN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:59:50.683888] [DEBUG] [LOCAL ] TBN: Loaded 2988 existing records from primary storage. [2025-09-17T21:59:50.684046] [INFO ] [MAIN ] TBN: Loaded 2988 existing records. [2025-09-17T21:59:50.828266] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-03. [2025-09-17T21:59:50.872333] [WARN ] [MAIN ] TBN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T21:59:50.872638] [INFO ] [MAIN ] TBN: Wiping existing primary data before full refresh. [2025-09-17T21:59:50.872724] [INFO ] [LOCAL ] TBN: Starting deletion of primary data. [2025-09-17T21:59:50.873104] [DEBUG] [LOCAL ] TBN: Deleted primary data file. [2025-09-17T21:59:50.873173] [INFO ] [MAIN ] TBN: Starting full primary refresh. [2025-09-17T21:59:51.231114] [INFO ] [REMOTE ] TBN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T21:59:51.293174] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T21:59:51.326672] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T21:59:51.615804] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-06. [2025-09-17T21:59:52.415803] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-11. [2025-09-17T21:59:52.710790] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T21:59:53.215789] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-07. [2025-09-17T21:59:54.015797] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-07. [2025-09-17T21:59:54.751125] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T21:59:54.823962] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-04. [2025-09-17T21:59:54.828301] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T21:59:55.167545] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-04 (0.34 seconds). [2025-09-17T21:59:55.615778] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-05. [2025-09-17T21:59:55.962671] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-05 (0.35 seconds). [2025-09-17T21:59:56.313858] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-11 (3.90 seconds). [2025-09-17T21:59:56.415801] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-08. [2025-09-17T21:59:57.215788] [INFO ] [REMOTE ] TBN: Fetching primary data for 2024-12. [2025-09-17T21:59:57.494908] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T21:59:57.679977] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2024-12 (0.46 seconds). [2025-09-17T21:59:58.015793] [INFO ] [REMOTE ] TBI: Fetching primary data for 2025-09. [2025-09-17T21:59:58.815827] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-08. [2025-09-17T21:59:58.881052] [INFO ] [REMOTE ] TBI: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T21:59:58.885440] [INFO ] [REMOTE ] TBI: Full fetch complete (31570 records). [2025-09-17T21:59:58.885586] [DEBUG] [VALIDATOR ] TBI: Validating primary data. [2025-09-17T21:59:59.276691] [DEBUG] [VALIDATOR ] TBI: All expected trading days are present. [2025-09-17T21:59:59.276792] [DEBUG] [VALIDATOR ] TBI: Primary data validation passed. [2025-09-17T21:59:59.277480] [INFO ] [MAIN ] TBI: Fetched primary data is valid. [2025-09-17T21:59:59.277524] [DEBUG] [LOCAL ] TBI: Saving primary data. [2025-09-17T21:59:59.278453] [DEBUG] [LOCAL ] TBI: Trimmed 31570 records to 22751 (keeping 200 days of data) [2025-09-17T21:59:59.418968] [DEBUG] [LOCAL ] TBI: Primary data saved (22751 records). [2025-09-17T21:59:59.419126] [INFO ] [MAIN ] TBI: Full history saved. [2025-09-17T21:59:59.419337] [INFO ] [MAIN ] Update Progress: 2050/2371 symbols completed. TBI took 32.4s. Estimated remaining: 46m 58s. Rate: 6.8 symbols/min [2025-09-17T21:59:59.591327] [INFO ] [MAIN ] TCAI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T21:59:59.591572] [DEBUG] [LOCAL ] TCAI: No existing data file found in primary storage. [2025-09-17T21:59:59.591628] [WARN ] [MAIN ] TCAI: No existing data found, performing full refresh instead. [2025-09-17T21:59:59.591874] [INFO ] [MAIN ] TCAI: Wiping existing primary data before full refresh. [2025-09-17T21:59:59.591923] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-17T21:59:59.591965] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-17T21:59:59.592008] [INFO ] [MAIN ] TCAI: Starting full primary refresh. [2025-09-17T21:59:59.622678] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-01. [2025-09-17T21:59:59.960669] [INFO ] [REMOTE ] TCAI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:00:00.139761] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T22:00:00.305550] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T22:00:00.415812] [INFO ] [REMOTE ] TBBB: Fetching primary data for 2025-09. [2025-09-17T22:00:01.215810] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-06. [2025-09-17T22:00:01.746454] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-06 (0.53 seconds). [2025-09-17T22:00:02.015828] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-11. [2025-09-17T22:00:02.182833] [INFO ] [REMOTE ] TBBB: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T22:00:02.190073] [INFO ] [REMOTE ] TBBB: Full fetch complete (51547 records). [2025-09-17T22:00:02.190306] [DEBUG] [VALIDATOR ] TBBB: Validating primary data. [2025-09-17T22:00:02.300481] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:00:02.334546] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-11 [2025-09-17T22:00:02.621596] [DEBUG] [VALIDATOR ] TBBB: All expected trading days are present. [2025-09-17T22:00:02.621696] [DEBUG] [VALIDATOR ] TBBB: Primary data validation passed. [2025-09-17T22:00:02.622571] [INFO ] [MAIN ] TBBB: Fetched primary data is valid. [2025-09-17T22:00:02.622613] [DEBUG] [LOCAL ] TBBB: Saving primary data. [2025-09-17T22:00:02.623901] [DEBUG] [LOCAL ] TBBB: Trimmed 51547 records to 36050 (keeping 200 days of data) [2025-09-17T22:00:02.816847] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-07. [2025-09-17T22:00:02.851001] [DEBUG] [LOCAL ] TBBB: Primary data saved (36050 records). [2025-09-17T22:00:02.851424] [INFO ] [MAIN ] TBBB: Full history saved. [2025-09-17T22:00:02.852452] [INFO ] [MAIN ] Update Progress: 2051/2371 symbols completed. TBBB took 36.9s. Estimated remaining: 46m 49s. Rate: 6.8 symbols/min [2025-09-17T22:00:03.026922] [INFO ] [MAIN ] TD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:00:03.086477] [DEBUG] [LOCAL ] TD: Loaded 52304 existing records from primary storage. [2025-09-17T22:00:03.086636] [INFO ] [MAIN ] TD: Loaded 52304 existing records. [2025-09-17T22:00:03.266045] [WARN ] [MAIN ] TD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:00:03.266350] [INFO ] [MAIN ] TD: Wiping existing primary data before full refresh. [2025-09-17T22:00:03.266398] [INFO ] [LOCAL ] TD: Starting deletion of primary data. [2025-09-17T22:00:03.268075] [DEBUG] [LOCAL ] TD: Deleted primary data file. [2025-09-17T22:00:03.268144] [INFO ] [MAIN ] TD: Starting full primary refresh. [2025-09-17T22:00:03.620989] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2024-12. [2025-09-17T22:00:03.655593] [INFO ] [REMOTE ] TD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:00:03.770117] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T22:00:04.415863] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-02. [2025-09-17T22:00:04.736460] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:00:04.736841] [WARN ] [REMOTE ] TCAI: No data returned for month 2024-12 [2025-09-17T22:00:05.215791] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-08. [2025-09-17T22:00:05.894291] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T22:00:06.015797] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-01. [2025-09-17T22:00:06.231163] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:00:06.231520] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-01 [2025-09-17T22:00:06.387129] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-02 (1.97 seconds). [2025-09-17T22:00:06.815809] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-11. [2025-09-17T22:00:07.615851] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-03. [2025-09-17T22:00:07.978493] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-03 (0.36 seconds). [2025-09-17T22:00:08.374344] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T22:00:08.415815] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-04. [2025-09-17T22:00:09.215824] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-02. [2025-09-17T22:00:09.244851] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T22:00:09.434786] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:00:09.435306] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-02 [2025-09-17T22:00:10.015833] [INFO ] [REMOTE ] TD: Fetching primary data for 2024-12. [2025-09-17T22:00:10.815799] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-03. [2025-09-17T22:00:11.107497] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:00:11.107926] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-03 [2025-09-17T22:00:11.615793] [INFO ] [REMOTE ] TBLU: Fetching primary data for 2025-09. [2025-09-17T22:00:11.987274] [INFO ] [REMOTE ] TBLU: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T22:00:11.989206] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T22:00:11.990370] [INFO ] [REMOTE ] TBLU: Full fetch complete (1184 records). [2025-09-17T22:00:12.000426] [DEBUG] [VALIDATOR ] TBLU: Validating primary data. [2025-09-17T22:00:12.208184] [WARN ] [VALIDATOR ] TBLU: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T22:00:12.208398] [FATAL] [MAIN ] TBLU: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:00:12.208500] [WARN ] [MAIN ] TBLU: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:00:12.208587] [INFO ] [LOCAL ] TBLU: Starting deletion of primary data. [2025-09-17T22:00:12.208700] [DEBUG] [LOCAL ] TBLU: No primary data file found to delete. [2025-09-17T22:00:12.208777] [INFO ] [LOCAL ] TBLU: Starting deletion of derivative data. [2025-09-17T22:00:12.208875] [DEBUG] [LOCAL ] TBLU: No derivative data file found to delete. [2025-09-17T22:00:12.208985] [INFO ] [MAIN ] Update Progress: 2052/2371 symbols completed. TBLU took 39.9s. Estimated remaining: 46m 40s. Rate: 6.8 symbols/min [2025-09-17T22:00:12.394073] [INFO ] [MAIN ] TDC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:00:12.415780] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-04. [2025-09-17T22:00:12.450880] [DEBUG] [LOCAL ] TDC: Loaded 47071 existing records from primary storage. [2025-09-17T22:00:12.451119] [INFO ] [MAIN ] TDC: Loaded 47071 existing records. [2025-09-17T22:00:12.634941] [WARN ] [MAIN ] TDC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:00:12.635228] [INFO ] [MAIN ] TDC: Wiping existing primary data before full refresh. [2025-09-17T22:00:12.635287] [INFO ] [LOCAL ] TDC: Starting deletion of primary data. [2025-09-17T22:00:12.636531] [DEBUG] [LOCAL ] TDC: Deleted primary data file. [2025-09-17T22:00:12.636592] [INFO ] [MAIN ] TDC: Starting full primary refresh. [2025-09-17T22:00:12.676420] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:00:12.721164] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-04 [2025-09-17T22:00:13.076820] [INFO ] [REMOTE ] TDC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:00:13.215798] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-11. [2025-09-17T22:00:14.015835] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-01. [2025-09-17T22:00:14.788174] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T22:00:14.815757] [INFO ] [REMOTE ] TDC: Fetching primary data for 2024-12. [2025-09-17T22:00:15.506842] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T22:00:15.615786] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-05. [2025-09-17T22:00:15.841114] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:00:15.841445] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-05 [2025-09-17T22:00:16.415779] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-02. [2025-09-17T22:00:16.528456] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T22:00:17.215826] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-01. [2025-09-17T22:00:18.015820] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-06. [2025-09-17T22:00:18.653527] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:00:18.653909] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-06 [2025-09-17T22:00:18.815817] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-07. [2025-09-17T22:00:18.896321] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-17T22:00:19.022776] [DEBUG] [REMOTE ] TCAI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:00:19.023267] [WARN ] [REMOTE ] TCAI: No data returned for month 2025-07 [2025-09-17T22:00:19.625957] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-05. [2025-09-17T22:00:19.658971] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-01 (2.44 seconds). [2025-09-17T22:00:20.168553] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-05 (0.54 seconds). [2025-09-17T22:00:20.415844] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-06. [2025-09-17T22:00:20.898770] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T22:00:21.215843] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-03. [2025-09-17T22:00:22.015814] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-08. [2025-09-17T22:00:22.404984] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-08 (0.39 seconds). [2025-09-17T22:00:22.815818] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-02. [2025-09-17T22:00:23.101463] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T22:00:23.615788] [INFO ] [REMOTE ] TCAI: Fetching primary data for 2025-09. [2025-09-17T22:00:24.062851] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-02 (1.25 seconds). [2025-09-17T22:00:24.088146] [INFO ] [REMOTE ] TCAI: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T22:00:24.089309] [INFO ] [REMOTE ] TCAI: Full fetch complete (799 records). [2025-09-17T22:00:24.089381] [DEBUG] [VALIDATOR ] TCAI: Validating primary data. [2025-09-17T22:00:24.279951] [WARN ] [VALIDATOR ] TCAI: Validation failed - insufficient historical data. Have 31 unique days, need 200 days [2025-09-17T22:00:24.280164] [FATAL] [MAIN ] TCAI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:00:24.280236] [WARN ] [MAIN ] TCAI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:00:24.280309] [INFO ] [LOCAL ] TCAI: Starting deletion of primary data. [2025-09-17T22:00:24.280377] [DEBUG] [LOCAL ] TCAI: No primary data file found to delete. [2025-09-17T22:00:24.280414] [INFO ] [LOCAL ] TCAI: Starting deletion of derivative data. [2025-09-17T22:00:24.280469] [DEBUG] [LOCAL ] TCAI: No derivative data file found to delete. [2025-09-17T22:00:24.280550] [INFO ] [MAIN ] Update Progress: 2053/2371 symbols completed. TCAI took 24.9s. Estimated remaining: 46m 32s. Rate: 6.8 symbols/min [2025-09-17T22:00:24.425341] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-03. [2025-09-17T22:00:24.459370] [INFO ] [MAIN ] TDF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:00:24.470882] [DEBUG] [LOCAL ] TDF: Loaded 6480 existing records from primary storage. [2025-09-17T22:00:24.471026] [INFO ] [MAIN ] TDF: Loaded 6480 existing records. [2025-09-17T22:00:24.647098] [WARN ] [MAIN ] TDF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:00:24.647376] [INFO ] [MAIN ] TDF: Wiping existing primary data before full refresh. [2025-09-17T22:00:24.647426] [INFO ] [LOCAL ] TDF: Starting deletion of primary data. [2025-09-17T22:00:24.647755] [DEBUG] [LOCAL ] TDF: Deleted primary data file. [2025-09-17T22:00:24.647816] [INFO ] [MAIN ] TDF: Starting full primary refresh. [2025-09-17T22:00:25.017513] [INFO ] [REMOTE ] TDF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:00:25.215815] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-04. [2025-09-17T22:00:26.015820] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-07. [2025-09-17T22:00:26.357328] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T22:00:26.374547] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-17T22:00:26.613465] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T22:00:26.815777] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-05. [2025-09-17T22:00:27.615809] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-11. [2025-09-17T22:00:28.047487] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-11 (0.43 seconds). [2025-09-17T22:00:28.415793] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-04. [2025-09-17T22:00:28.627459] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T22:00:29.215791] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-06. [2025-09-17T22:00:30.015817] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-08. [2025-09-17T22:00:30.099684] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T22:00:30.591296] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T22:00:30.606412] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T22:00:30.815785] [INFO ] [REMOTE ] TBN: Fetching primary data for 2025-09. [2025-09-17T22:00:31.309187] [INFO ] [REMOTE ] TBN: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T22:00:31.310586] [INFO ] [REMOTE ] TBN: Full fetch complete (4686 records). [2025-09-17T22:00:31.310681] [DEBUG] [VALIDATOR ] TBN: Validating primary data. [2025-09-17T22:00:31.620951] [INFO ] [REMOTE ] TDF: Fetching primary data for 2024-12. [2025-09-17T22:00:31.683398] [DEBUG] [VALIDATOR ] TBN: All expected trading days are present. [2025-09-17T22:00:31.683488] [DEBUG] [VALIDATOR ] TBN: Primary data validation passed. [2025-09-17T22:00:31.683666] [INFO ] [MAIN ] TBN: Fetched primary data is valid. [2025-09-17T22:00:31.683729] [DEBUG] [LOCAL ] TBN: Saving primary data. [2025-09-17T22:00:31.684208] [DEBUG] [LOCAL ] TBN: Trimmed 4686 records to 3011 (keeping 200 days of data) [2025-09-17T22:00:31.704963] [DEBUG] [LOCAL ] TBN: Primary data saved (3011 records). [2025-09-17T22:00:31.705055] [INFO ] [MAIN ] TBN: Full history saved. [2025-09-17T22:00:31.705152] [INFO ] [MAIN ] Update Progress: 2054/2371 symbols completed. TBN took 41.2s. Estimated remaining: 46m 23s. Rate: 6.8 symbols/min [2025-09-17T22:00:31.884537] [INFO ] [MAIN ] TDG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:00:31.913192] [DEBUG] [LOCAL ] TDG: Loaded 22147 existing records from primary storage. [2025-09-17T22:00:31.913336] [INFO ] [MAIN ] TDG: Loaded 22147 existing records. [2025-09-17T22:00:32.109097] [WARN ] [MAIN ] TDG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:00:32.109382] [INFO ] [MAIN ] TDG: Wiping existing primary data before full refresh. [2025-09-17T22:00:32.109437] [INFO ] [LOCAL ] TDG: Starting deletion of primary data. [2025-09-17T22:00:32.110225] [DEBUG] [LOCAL ] TDG: Deleted primary data file. [2025-09-17T22:00:32.110290] [INFO ] [MAIN ] TDG: Starting full primary refresh. [2025-09-17T22:00:32.420935] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-07. [2025-09-17T22:00:32.420814] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T22:00:32.508144] [INFO ] [REMOTE ] TDG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:00:33.215787] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-11. [2025-09-17T22:00:34.015787] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-01. [2025-09-17T22:00:34.815785] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-05. [2025-09-17T22:00:35.195853] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-17T22:00:35.333322] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-11 (2.12 seconds). [2025-09-17T22:00:35.347381] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T22:00:35.615814] [INFO ] [REMOTE ] TDG: Fetching primary data for 2024-12. [2025-09-17T22:00:36.194540] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-05 (1.38 seconds). [2025-09-17T22:00:36.422073] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-08. [2025-09-17T22:00:36.425747] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2024-12 (0.81 seconds). [2025-09-17T22:00:37.215847] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-02. [2025-09-17T22:00:37.805033] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-02 (0.59 seconds). [2025-09-17T22:00:38.015819] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-01. [2025-09-17T22:00:38.175599] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T22:00:38.815773] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-06. [2025-09-17T22:00:39.108822] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-01 (1.09 seconds). [2025-09-17T22:00:39.615785] [INFO ] [REMOTE ] TD: Fetching primary data for 2025-09. [2025-09-17T22:00:40.367536] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T22:00:40.415731] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-07. [2025-09-17T22:00:41.215809] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-02. [2025-09-17T22:00:41.267172] [INFO ] [REMOTE ] TD: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T22:00:41.273969] [INFO ] [REMOTE ] TD: Full fetch complete (75654 records). [2025-09-17T22:00:41.274103] [DEBUG] [VALIDATOR ] TD: Validating primary data. [2025-09-17T22:00:41.686299] [DEBUG] [VALIDATOR ] TD: All expected trading days are present. [2025-09-17T22:00:41.686388] [DEBUG] [VALIDATOR ] TD: Primary data validation passed. [2025-09-17T22:00:41.687543] [INFO ] [MAIN ] TD: Fetched primary data is valid. [2025-09-17T22:00:41.687612] [DEBUG] [LOCAL ] TD: Saving primary data. [2025-09-17T22:00:41.689212] [DEBUG] [LOCAL ] TD: Trimmed 75654 records to 52297 (keeping 200 days of data) [2025-09-17T22:00:42.016120] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-03. [2025-09-17T22:00:42.028973] [DEBUG] [LOCAL ] TD: Primary data saved (52297 records). [2025-09-17T22:00:42.029083] [INFO ] [MAIN ] TD: Full history saved. [2025-09-17T22:00:42.030088] [INFO ] [MAIN ] Update Progress: 2055/2371 symbols completed. TD took 39.2s. Estimated remaining: 46m 14s. Rate: 6.8 symbols/min [2025-09-17T22:00:42.168532] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-02 (0.95 seconds). [2025-09-17T22:00:42.232425] [INFO ] [MAIN ] TDOC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:00:42.289192] [DEBUG] [LOCAL ] TDOC: Loaded 53358 existing records from primary storage. [2025-09-17T22:00:42.303830] [INFO ] [MAIN ] TDOC: Loaded 53358 existing records. [2025-09-17T22:00:42.393508] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T22:00:42.517488] [WARN ] [MAIN ] TDOC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:00:42.517772] [INFO ] [MAIN ] TDOC: Wiping existing primary data before full refresh. [2025-09-17T22:00:42.517829] [INFO ] [LOCAL ] TDOC: Starting deletion of primary data. [2025-09-17T22:00:42.518862] [DEBUG] [LOCAL ] TDOC: Deleted primary data file. [2025-09-17T22:00:42.518923] [INFO ] [MAIN ] TDOC: Starting full primary refresh. [2025-09-17T22:00:42.821989] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-03. [2025-09-17T22:00:42.839941] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-03 (0.82 seconds). [2025-09-17T22:00:42.898450] [INFO ] [REMOTE ] TDOC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:00:43.615787] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-04. [2025-09-17T22:00:44.101247] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T22:00:44.372623] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T22:00:44.415731] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-05. [2025-09-17T22:00:45.187249] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T22:00:45.215757] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-04. [2025-09-17T22:00:46.015790] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-11. [2025-09-17T22:00:46.509287] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T22:00:46.815765] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-06. [2025-09-17T22:00:47.410675] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T22:00:47.615742] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-05. [2025-09-17T22:00:47.851844] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T22:00:48.415817] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-08. [2025-09-17T22:00:48.911252] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T22:00:49.215821] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2024-12. [2025-09-17T22:00:50.025049] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-06. [2025-09-17T22:00:50.031253] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T22:00:50.815821] [INFO ] [REMOTE ] TDC: Fetching primary data for 2025-09. [2025-09-17T22:00:51.156780] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T22:00:51.458666] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-17T22:00:51.615821] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-07. [2025-09-17T22:00:52.361440] [INFO ] [REMOTE ] TDC: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T22:00:52.367632] [INFO ] [REMOTE ] TDC: Full fetch complete (66384 records). [2025-09-17T22:00:52.367771] [DEBUG] [VALIDATOR ] TDC: Validating primary data. [2025-09-17T22:00:52.424605] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-07. [2025-09-17T22:00:52.771205] [DEBUG] [VALIDATOR ] TDC: All expected trading days are present. [2025-09-17T22:00:52.771288] [DEBUG] [VALIDATOR ] TDC: Primary data validation passed. [2025-09-17T22:00:52.772247] [INFO ] [MAIN ] TDC: Fetched primary data is valid. [2025-09-17T22:00:52.772310] [DEBUG] [LOCAL ] TDC: Saving primary data. [2025-09-17T22:00:52.773636] [DEBUG] [LOCAL ] TDC: Trimmed 66384 records to 47027 (keeping 200 days of data) [2025-09-17T22:00:52.952273] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T22:00:53.071581] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T22:00:53.072326] [DEBUG] [LOCAL ] TDC: Primary data saved (47027 records). [2025-09-17T22:00:53.073961] [INFO ] [MAIN ] TDC: Full history saved. [2025-09-17T22:00:53.074506] [INFO ] [MAIN ] Update Progress: 2056/2371 symbols completed. TDC took 40.9s. Estimated remaining: 46m 6s. Rate: 6.8 symbols/min [2025-09-17T22:00:53.224239] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-08. [2025-09-17T22:00:53.250896] [INFO ] [MAIN ] TDS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:00:53.292567] [DEBUG] [LOCAL ] TDS: Loaded 42884 existing records from primary storage. [2025-09-17T22:00:53.292736] [INFO ] [MAIN ] TDS: Loaded 42884 existing records. [2025-09-17T22:00:53.485820] [WARN ] [MAIN ] TDS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:00:53.486086] [INFO ] [MAIN ] TDS: Wiping existing primary data before full refresh. [2025-09-17T22:00:53.486134] [INFO ] [LOCAL ] TDS: Starting deletion of primary data. [2025-09-17T22:00:53.487283] [DEBUG] [LOCAL ] TDS: Deleted primary data file. [2025-09-17T22:00:53.487343] [INFO ] [MAIN ] TDS: Starting full primary refresh. [2025-09-17T22:00:53.816975] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-08 (0.59 seconds). [2025-09-17T22:00:53.903223] [INFO ] [REMOTE ] TDS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:00:54.015803] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-08. [2025-09-17T22:00:54.815797] [INFO ] [REMOTE ] TDF: Fetching primary data for 2025-09. [2025-09-17T22:00:54.970276] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-08 (0.95 seconds). [2025-09-17T22:00:55.449391] [INFO ] [REMOTE ] TDF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T22:00:55.451608] [INFO ] [REMOTE ] TDF: Full fetch complete (10701 records). [2025-09-17T22:00:55.451705] [DEBUG] [VALIDATOR ] TDF: Validating primary data. [2025-09-17T22:00:55.629055] [INFO ] [REMOTE ] TDG: Fetching primary data for 2025-09. [2025-09-17T22:00:55.827585] [DEBUG] [VALIDATOR ] TDF: All expected trading days are present. [2025-09-17T22:00:55.827686] [DEBUG] [VALIDATOR ] TDF: Primary data validation passed. [2025-09-17T22:00:55.827951] [INFO ] [MAIN ] TDF: Fetched primary data is valid. [2025-09-17T22:00:55.828002] [DEBUG] [LOCAL ] TDF: Saving primary data. [2025-09-17T22:00:55.828478] [DEBUG] [LOCAL ] TDF: Trimmed 10701 records to 6464 (keeping 200 days of data) [2025-09-17T22:00:55.868551] [DEBUG] [LOCAL ] TDF: Primary data saved (6464 records). [2025-09-17T22:00:55.868695] [INFO ] [MAIN ] TDF: Full history saved. [2025-09-17T22:00:55.868795] [INFO ] [MAIN ] Update Progress: 2057/2371 symbols completed. TDF took 31.6s. Estimated remaining: 45m 56s. Rate: 6.8 symbols/min [2025-09-17T22:00:56.049754] [INFO ] [MAIN ] TDW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:00:56.101593] [DEBUG] [LOCAL ] TDW: Loaded 45810 existing records from primary storage. [2025-09-17T22:00:56.101761] [INFO ] [MAIN ] TDW: Loaded 45810 existing records. [2025-09-17T22:00:56.298464] [WARN ] [MAIN ] TDW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:00:56.299013] [INFO ] [MAIN ] TDW: Wiping existing primary data before full refresh. [2025-09-17T22:00:56.299164] [INFO ] [LOCAL ] TDW: Starting deletion of primary data. [2025-09-17T22:00:56.309370] [DEBUG] [LOCAL ] TDW: Deleted primary data file. [2025-09-17T22:00:56.310094] [INFO ] [MAIN ] TDW: Starting full primary refresh. [2025-09-17T22:00:56.310459] [INFO ] [REMOTE ] TDG: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T22:00:56.361808] [INFO ] [REMOTE ] TDG: Full fetch complete (32563 records). [2025-09-17T22:00:56.385091] [DEBUG] [VALIDATOR ] TDG: Validating primary data. [2025-09-17T22:00:56.415804] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-01. [2025-09-17T22:00:56.912050] [INFO ] [REMOTE ] TDW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:00:57.112689] [DEBUG] [VALIDATOR ] TDG: All expected trading days are present. [2025-09-17T22:00:57.112807] [DEBUG] [VALIDATOR ] TDG: Primary data validation passed. [2025-09-17T22:00:57.113660] [INFO ] [MAIN ] TDG: Fetched primary data is valid. [2025-09-17T22:00:57.113723] [DEBUG] [LOCAL ] TDG: Saving primary data. [2025-09-17T22:00:57.114607] [DEBUG] [LOCAL ] TDG: Trimmed 32563 records to 22189 (keeping 200 days of data) [2025-09-17T22:00:57.225485] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-11. [2025-09-17T22:00:57.278162] [DEBUG] [LOCAL ] TDG: Primary data saved (22189 records). [2025-09-17T22:00:57.278289] [INFO ] [MAIN ] TDG: Full history saved. [2025-09-17T22:00:57.278386] [INFO ] [MAIN ] Update Progress: 2058/2371 symbols completed. TDG took 25.6s. Estimated remaining: 45m 46s. Rate: 6.8 symbols/min [2025-09-17T22:00:57.476706] [INFO ] [MAIN ] TDY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:00:57.502295] [DEBUG] [LOCAL ] TDY: Loaded 23036 existing records from primary storage. [2025-09-17T22:00:57.502445] [INFO ] [MAIN ] TDY: Loaded 23036 existing records. [2025-09-17T22:00:57.682413] [WARN ] [MAIN ] TDY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:00:57.682753] [INFO ] [MAIN ] TDY: Wiping existing primary data before full refresh. [2025-09-17T22:00:57.682812] [INFO ] [LOCAL ] TDY: Starting deletion of primary data. [2025-09-17T22:00:57.683371] [DEBUG] [LOCAL ] TDY: Deleted primary data file. [2025-09-17T22:00:57.683435] [INFO ] [MAIN ] TDY: Starting full primary refresh. [2025-09-17T22:00:58.020982] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-11. [2025-09-17T22:00:58.080380] [INFO ] [REMOTE ] TDY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:00:58.554278] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-01 (2.14 seconds). [2025-09-17T22:00:58.745573] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T22:00:58.815730] [INFO ] [REMOTE ] TDS: Fetching primary data for 2024-12. [2025-09-17T22:00:59.419176] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T22:00:59.615821] [INFO ] [REMOTE ] TDW: Fetching primary data for 2024-12. [2025-09-17T22:01:00.334431] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T22:01:00.415828] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-01. [2025-09-17T22:01:01.064309] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T22:01:01.215789] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-11. [2025-09-17T22:01:01.950216] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T22:01:02.015806] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-02. [2025-09-17T22:01:02.516735] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T22:01:02.815809] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-01. [2025-09-17T22:01:03.576252] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T22:01:03.615782] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-03. [2025-09-17T22:01:04.415785] [INFO ] [REMOTE ] TDY: Fetching primary data for 2024-12. [2025-09-17T22:01:04.550897] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T22:01:04.858636] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T22:01:05.215759] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-02. [2025-09-17T22:01:05.592614] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T22:01:06.015788] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-02. [2025-09-17T22:01:06.783521] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T22:01:06.815769] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-04. [2025-09-17T22:01:07.615792] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-03. [2025-09-17T22:01:08.284404] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-02 (2.27 seconds). [2025-09-17T22:01:08.321454] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T22:01:08.415763] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-03. [2025-09-17T22:01:09.215783] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-01. [2025-09-17T22:01:09.335203] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T22:01:10.015800] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-04. [2025-09-17T22:01:10.410169] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T22:01:10.555255] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T22:01:10.815826] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-02. [2025-09-17T22:01:11.615704] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-04. [2025-09-17T22:01:11.969463] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T22:01:11.998875] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T22:01:12.416026] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-03. [2025-09-17T22:01:13.215737] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-05. [2025-09-17T22:01:13.253566] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T22:01:13.668854] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T22:01:14.015845] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-05. [2025-09-17T22:01:14.815824] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-04. [2025-09-17T22:01:14.877782] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T22:01:15.620985] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-05. [2025-09-17T22:01:15.635670] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T22:01:16.192210] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T22:01:16.415845] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-05. [2025-09-17T22:01:17.215828] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-06. [2025-09-17T22:01:17.586148] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T22:01:17.775003] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T22:01:18.015811] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-06. [2025-09-17T22:01:18.499042] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T22:01:18.815783] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-07. [2025-09-17T22:01:19.133194] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T22:01:19.615804] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-07. [2025-09-17T22:01:20.415823] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-06. [2025-09-17T22:01:20.447721] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T22:01:20.980926] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-07 (1.37 seconds). [2025-09-17T22:01:21.215789] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-06. [2025-09-17T22:01:22.015778] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-08. [2025-09-17T22:01:22.081840] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T22:01:22.815800] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-08. [2025-09-17T22:01:23.309431] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-17T22:01:23.363771] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T22:01:23.477914] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-08 (0.66 seconds). [2025-09-17T22:01:23.615846] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-07. [2025-09-17T22:01:24.415811] [INFO ] [REMOTE ] TDY: Fetching primary data for 2025-09. [2025-09-17T22:01:24.619614] [INFO ] [REMOTE ] TDY: Incremental fetch complete for 2025-09 (0.20 seconds). [2025-09-17T22:01:24.622502] [INFO ] [REMOTE ] TDY: Full fetch complete (32270 records). [2025-09-17T22:01:24.622596] [DEBUG] [VALIDATOR ] TDY: Validating primary data. [2025-09-17T22:01:25.028130] [DEBUG] [VALIDATOR ] TDY: All expected trading days are present. [2025-09-17T22:01:25.028227] [DEBUG] [VALIDATOR ] TDY: Primary data validation passed. [2025-09-17T22:01:25.029013] [INFO ] [MAIN ] TDY: Fetched primary data is valid. [2025-09-17T22:01:25.029077] [DEBUG] [LOCAL ] TDY: Saving primary data. [2025-09-17T22:01:25.029933] [DEBUG] [LOCAL ] TDY: Trimmed 32270 records to 23000 (keeping 200 days of data) [2025-09-17T22:01:25.175530] [DEBUG] [LOCAL ] TDY: Primary data saved (23000 records). [2025-09-17T22:01:25.175689] [INFO ] [MAIN ] TDY: Full history saved. [2025-09-17T22:01:25.175819] [INFO ] [MAIN ] Update Progress: 2059/2371 symbols completed. TDY took 27.9s. Estimated remaining: 45m 40s. Rate: 6.8 symbols/min [2025-09-17T22:01:25.219952] [INFO ] [REMOTE ] TDW: Fetching primary data for 2025-09. [2025-09-17T22:01:25.356920] [INFO ] [MAIN ] TE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:01:25.357103] [DEBUG] [LOCAL ] TE: No existing data file found in primary storage. [2025-09-17T22:01:25.357172] [WARN ] [MAIN ] TE: No existing data found, performing full refresh instead. [2025-09-17T22:01:25.357616] [INFO ] [MAIN ] TE: Wiping existing primary data before full refresh. [2025-09-17T22:01:25.357705] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-17T22:01:25.357764] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-17T22:01:25.375984] [INFO ] [MAIN ] TE: Starting full primary refresh. [2025-09-17T22:01:25.478946] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T22:01:25.763677] [INFO ] [REMOTE ] TE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:01:26.015800] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-07. [2025-09-17T22:01:26.677405] [INFO ] [REMOTE ] TDW: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T22:01:26.683212] [INFO ] [REMOTE ] TDW: Full fetch complete (67142 records). [2025-09-17T22:01:26.683373] [DEBUG] [VALIDATOR ] TDW: Validating primary data. [2025-09-17T22:01:26.820889] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-11. [2025-09-17T22:01:27.108557] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:01:27.125055] [DEBUG] [VALIDATOR ] TDW: All expected trading days are present. [2025-09-17T22:01:27.125131] [DEBUG] [VALIDATOR ] TDW: Primary data validation passed. [2025-09-17T22:01:27.126285] [INFO ] [MAIN ] TDW: Fetched primary data is valid. [2025-09-17T22:01:27.126373] [WARN ] [REMOTE ] TE: No data returned for month 2024-11 [2025-09-17T22:01:27.126904] [DEBUG] [LOCAL ] TDW: Saving primary data. [2025-09-17T22:01:27.128222] [DEBUG] [LOCAL ] TDW: Trimmed 67142 records to 45734 (keeping 200 days of data) [2025-09-17T22:01:27.419088] [DEBUG] [LOCAL ] TDW: Primary data saved (45734 records). [2025-09-17T22:01:27.419246] [INFO ] [MAIN ] TDW: Full history saved. [2025-09-17T22:01:27.420371] [INFO ] [MAIN ] Update Progress: 2060/2371 symbols completed. TDW took 31.6s. Estimated remaining: 45m 30s. Rate: 6.8 symbols/min [2025-09-17T22:01:27.621292] [INFO ] [REMOTE ] TE: Fetching primary data for 2024-12. [2025-09-17T22:01:27.624180] [INFO ] [MAIN ] TEAF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:01:27.636929] [DEBUG] [LOCAL ] TEAF: Loaded 7142 existing records from primary storage. [2025-09-17T22:01:27.637204] [INFO ] [MAIN ] TEAF: Loaded 7142 existing records. [2025-09-17T22:01:27.817967] [WARN ] [MAIN ] TEAF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:01:27.818187] [INFO ] [MAIN ] TEAF: Wiping existing primary data before full refresh. [2025-09-17T22:01:27.818236] [INFO ] [LOCAL ] TEAF: Starting deletion of primary data. [2025-09-17T22:01:27.818574] [DEBUG] [LOCAL ] TEAF: Deleted primary data file. [2025-09-17T22:01:27.818635] [INFO ] [MAIN ] TEAF: Starting full primary refresh. [2025-09-17T22:01:27.866713] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:01:27.916107] [WARN ] [REMOTE ] TE: No data returned for month 2024-12 [2025-09-17T22:01:28.183555] [INFO ] [REMOTE ] TEAF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:01:28.274047] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T22:01:28.415757] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-11. [2025-09-17T22:01:29.133310] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T22:01:29.215762] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2024-12. [2025-09-17T22:01:29.669345] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2024-12 (0.45 seconds). [2025-09-17T22:01:30.015779] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-01. [2025-09-17T22:01:30.712310] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T22:01:30.815790] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-08. [2025-09-17T22:01:31.615776] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-08. [2025-09-17T22:01:32.415786] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-01. [2025-09-17T22:01:32.517137] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T22:01:32.620215] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:01:32.620588] [WARN ] [REMOTE ] TE: No data returned for month 2025-01 [2025-09-17T22:01:32.782815] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T22:01:33.215784] [INFO ] [REMOTE ] TDS: Fetching primary data for 2025-09. [2025-09-17T22:01:34.015776] [INFO ] [REMOTE ] TDOC: Fetching primary data for 2025-09. [2025-09-17T22:01:34.678891] [INFO ] [REMOTE ] TDS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T22:01:34.684569] [INFO ] [REMOTE ] TDS: Full fetch complete (61274 records). [2025-09-17T22:01:34.684758] [DEBUG] [VALIDATOR ] TDS: Validating primary data. [2025-09-17T22:01:34.820958] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-02. [2025-09-17T22:01:35.105429] [DEBUG] [VALIDATOR ] TDS: All expected trading days are present. [2025-09-17T22:01:35.105110] [DEBUG] [REMOTE ] TE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:01:35.105598] [DEBUG] [VALIDATOR ] TDS: Primary data validation passed. [2025-09-17T22:01:35.106894] [INFO ] [MAIN ] TDS: Fetched primary data is valid. [2025-09-17T22:01:35.107161] [DEBUG] [LOCAL ] TDS: Saving primary data. [2025-09-17T22:01:35.107053] [WARN ] [REMOTE ] TE: No data returned for month 2025-02 [2025-09-17T22:01:35.109202] [DEBUG] [LOCAL ] TDS: Trimmed 61274 records to 42900 (keeping 200 days of data) [2025-09-17T22:01:35.381936] [DEBUG] [LOCAL ] TDS: Primary data saved (42900 records). [2025-09-17T22:01:35.382078] [INFO ] [MAIN ] TDS: Full history saved. [2025-09-17T22:01:35.382189] [INFO ] [MAIN ] Update Progress: 2061/2371 symbols completed. TDS took 42.3s. Estimated remaining: 45m 21s. Rate: 6.8 symbols/min [2025-09-17T22:01:35.556608] [INFO ] [MAIN ] TECK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:01:35.611368] [DEBUG] [LOCAL ] TECK: Loaded 53443 existing records from primary storage. [2025-09-17T22:01:35.611514] [INFO ] [MAIN ] TECK: Loaded 53443 existing records. [2025-09-17T22:01:35.623065] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-03. [2025-09-17T22:01:35.794220] [WARN ] [MAIN ] TECK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:01:35.794596] [INFO ] [MAIN ] TECK: Wiping existing primary data before full refresh. [2025-09-17T22:01:35.794694] [INFO ] [LOCAL ] TECK: Starting deletion of primary data. [2025-09-17T22:01:35.802603] [DEBUG] [LOCAL ] TECK: Deleted primary data file. [2025-09-17T22:01:35.813779] [INFO ] [MAIN ] TECK: Starting full primary refresh. [2025-09-17T22:01:35.847600] [INFO ] [REMOTE ] TDOC: Incremental fetch complete for 2025-09 (1.83 seconds). [2025-09-17T22:01:35.904217] [INFO ] [REMOTE ] TDOC: Full fetch complete (77189 records). [2025-09-17T22:01:35.923485] [DEBUG] [VALIDATOR ] TDOC: Validating primary data. [2025-09-17T22:01:36.424383] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-02. [2025-09-17T22:01:36.459585] [INFO ] [REMOTE ] TECK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:01:36.640480] [DEBUG] [VALIDATOR ] TDOC: All expected trading days are present. [2025-09-17T22:01:36.640580] [DEBUG] [VALIDATOR ] TDOC: Primary data validation passed. [2025-09-17T22:01:36.641697] [INFO ] [MAIN ] TDOC: Fetched primary data is valid. [2025-09-17T22:01:36.641769] [DEBUG] [LOCAL ] TDOC: Saving primary data. [2025-09-17T22:01:36.644783] [DEBUG] [LOCAL ] TDOC: Trimmed 77189 records to 53357 (keeping 200 days of data) [2025-09-17T22:01:36.982933] [DEBUG] [LOCAL ] TDOC: Primary data saved (53357 records). [2025-09-17T22:01:36.983149] [INFO ] [MAIN ] TDOC: Full history saved. [2025-09-17T22:01:36.983290] [INFO ] [MAIN ] Update Progress: 2062/2371 symbols completed. TDOC took 55.0s. Estimated remaining: 45m 12s. Rate: 6.8 symbols/min [2025-09-17T22:01:37.172100] [INFO ] [MAIN ] TEF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:01:37.178240] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T22:01:37.220922] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-11. [2025-09-17T22:01:37.223556] [DEBUG] [LOCAL ] TEF: Loaded 37615 existing records from primary storage. [2025-09-17T22:01:37.223830] [INFO ] [MAIN ] TEF: Loaded 37615 existing records. [2025-09-17T22:01:37.412353] [WARN ] [MAIN ] TEF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:01:37.413072] [INFO ] [MAIN ] TEF: Wiping existing primary data before full refresh. [2025-09-17T22:01:37.413376] [INFO ] [LOCAL ] TEF: Starting deletion of primary data. [2025-09-17T22:01:37.414405] [DEBUG] [LOCAL ] TEF: Deleted primary data file. [2025-09-17T22:01:37.414468] [INFO ] [MAIN ] TEF: Starting full primary refresh. [2025-09-17T22:01:37.622744] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T22:01:37.816445] [INFO ] [REMOTE ] TEF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:01:38.015781] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-04. [2025-09-17T22:01:38.815769] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-03. [2025-09-17T22:01:38.954779] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T22:01:39.235325] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T22:01:39.595771] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-03 (0.78 seconds). [2025-09-17T22:01:39.615733] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-05. [2025-09-17T22:01:40.415791] [INFO ] [REMOTE ] TECK: Fetching primary data for 2024-12. [2025-09-17T22:01:41.215796] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-11. [2025-09-17T22:01:41.267953] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T22:01:42.015790] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-04. [2025-09-17T22:01:42.226518] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T22:01:42.261513] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-11 (1.05 seconds). [2025-09-17T22:01:42.662787] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-04 (0.65 seconds). [2025-09-17T22:01:42.815782] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-05. [2025-09-17T22:01:43.615708] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-06. [2025-09-17T22:01:43.672415] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T22:01:44.415791] [INFO ] [REMOTE ] TEF: Fetching primary data for 2024-12. [2025-09-17T22:01:44.838969] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T22:01:45.215817] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-06. [2025-09-17T22:01:45.855830] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T22:01:46.015763] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-01. [2025-09-17T22:01:46.029112] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T22:01:46.815774] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-07. [2025-09-17T22:01:47.554193] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T22:01:47.599929] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T22:01:47.615772] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-08. [2025-09-17T22:01:48.321230] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T22:01:48.415774] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-01. [2025-09-17T22:01:49.215799] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-07. [2025-09-17T22:01:50.015830] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-02. [2025-09-17T22:01:50.327888] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-01 (1.91 seconds). [2025-09-17T22:01:50.455023] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T22:01:50.815839] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-02. [2025-09-17T22:01:51.524113] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T22:01:51.615777] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-03. [2025-09-17T22:01:52.415756] [INFO ] [REMOTE ] TEAF: Fetching primary data for 2025-09. [2025-09-17T22:01:52.790946] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T22:01:53.215707] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-08. [2025-09-17T22:01:53.220840] [INFO ] [REMOTE ] TEAF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T22:01:53.222707] [INFO ] [REMOTE ] TEAF: Full fetch complete (9640 records). [2025-09-17T22:01:53.222863] [DEBUG] [VALIDATOR ] TEAF: Validating primary data. [2025-09-17T22:01:53.557351] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T22:01:53.647057] [DEBUG] [VALIDATOR ] TEAF: All expected trading days are present. [2025-09-17T22:01:53.647136] [DEBUG] [VALIDATOR ] TEAF: Primary data validation passed. [2025-09-17T22:01:53.647385] [INFO ] [MAIN ] TEAF: Fetched primary data is valid. [2025-09-17T22:01:53.647424] [DEBUG] [LOCAL ] TEAF: Saving primary data. [2025-09-17T22:01:53.647897] [DEBUG] [LOCAL ] TEAF: Trimmed 9640 records to 7154 (keeping 200 days of data) [2025-09-17T22:01:53.691063] [DEBUG] [LOCAL ] TEAF: Primary data saved (7154 records). [2025-09-17T22:01:53.691173] [INFO ] [MAIN ] TEAF: Full history saved. [2025-09-17T22:01:53.691258] [INFO ] [MAIN ] Update Progress: 2063/2371 symbols completed. TEAF took 26.3s. Estimated remaining: 45m 4s. Rate: 6.8 symbols/min [2025-09-17T22:01:53.862214] [INFO ] [MAIN ] TEI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:01:53.889685] [DEBUG] [LOCAL ] TEI: Loaded 20309 existing records from primary storage. [2025-09-17T22:01:53.889843] [INFO ] [MAIN ] TEI: Loaded 20309 existing records. [2025-09-17T22:01:54.030285] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-03. [2025-09-17T22:01:54.071719] [WARN ] [MAIN ] TEI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:01:54.072005] [INFO ] [MAIN ] TEI: Wiping existing primary data before full refresh. [2025-09-17T22:01:54.072058] [INFO ] [LOCAL ] TEI: Starting deletion of primary data. [2025-09-17T22:01:54.072668] [DEBUG] [LOCAL ] TEI: Deleted primary data file. [2025-09-17T22:01:54.072728] [INFO ] [MAIN ] TEI: Starting full primary refresh. [2025-09-17T22:01:54.443014] [INFO ] [REMOTE ] TEI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:01:54.815837] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-04. [2025-09-17T22:01:54.943776] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T22:01:55.615845] [INFO ] [REMOTE ] TE: Fetching primary data for 2025-09. [2025-09-17T22:01:56.221065] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-03 (2.19 seconds). [2025-09-17T22:01:56.253712] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T22:01:56.415800] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-05. [2025-09-17T22:01:56.813718] [INFO ] [REMOTE ] TE: Incremental fetch complete for 2025-09 (1.20 seconds). [2025-09-17T22:01:56.820722] [INFO ] [REMOTE ] TE: Full fetch complete (44947 records). [2025-09-17T22:01:56.820896] [DEBUG] [VALIDATOR ] TE: Validating primary data. [2025-09-17T22:01:57.062129] [WARN ] [VALIDATOR ] TE: Validation failed - insufficient historical data. Have 138 unique days, need 200 days [2025-09-17T22:01:57.063176] [FATAL] [MAIN ] TE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:01:57.063283] [WARN ] [MAIN ] TE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:01:57.063355] [INFO ] [LOCAL ] TE: Starting deletion of primary data. [2025-09-17T22:01:57.063496] [DEBUG] [LOCAL ] TE: No primary data file found to delete. [2025-09-17T22:01:57.063572] [INFO ] [LOCAL ] TE: Starting deletion of derivative data. [2025-09-17T22:01:57.063675] [DEBUG] [LOCAL ] TE: No derivative data file found to delete. [2025-09-17T22:01:57.063802] [INFO ] [MAIN ] Update Progress: 2064/2371 symbols completed. TE took 31.9s. Estimated remaining: 44m 54s. Rate: 6.8 symbols/min [2025-09-17T22:01:57.221185] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-11. [2025-09-17T22:01:57.272699] [INFO ] [MAIN ] TEL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:01:57.346796] [DEBUG] [LOCAL ] TEL: Loaded 51197 existing records from primary storage. [2025-09-17T22:01:57.346957] [INFO ] [MAIN ] TEL: Loaded 51197 existing records. [2025-09-17T22:01:57.541456] [WARN ] [MAIN ] TEL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:01:57.541752] [INFO ] [MAIN ] TEL: Wiping existing primary data before full refresh. [2025-09-17T22:01:57.541813] [INFO ] [LOCAL ] TEL: Starting deletion of primary data. [2025-09-17T22:01:57.543102] [DEBUG] [LOCAL ] TEL: Deleted primary data file. [2025-09-17T22:01:57.543173] [INFO ] [MAIN ] TEL: Starting full primary refresh. [2025-09-17T22:01:57.948332] [INFO ] [REMOTE ] TEL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:01:57.982204] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T22:01:58.016548] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-04. [2025-09-17T22:01:58.025220] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T22:01:58.815819] [INFO ] [REMOTE ] TEI: Fetching primary data for 2024-12. [2025-09-17T22:01:59.615752] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-11. [2025-09-17T22:02:00.165088] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-17T22:02:00.171939] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T22:02:00.415780] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-05. [2025-09-17T22:02:01.215808] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-06. [2025-09-17T22:02:01.319786] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T22:02:02.015841] [INFO ] [REMOTE ] TEL: Fetching primary data for 2024-12. [2025-09-17T22:02:02.266907] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T22:02:02.816249] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-06. [2025-09-17T22:02:02.830633] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T22:02:03.615825] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-07. [2025-09-17T22:02:03.752806] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T22:02:04.415838] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-01. [2025-09-17T22:02:04.808913] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-06 (1.99 seconds). [2025-09-17T22:02:05.215879] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-01. [2025-09-17T22:02:05.314949] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T22:02:05.801190] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-01 (1.39 seconds). [2025-09-17T22:02:06.016034] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-02. [2025-09-17T22:02:06.366444] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T22:02:06.815851] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-02. [2025-09-17T22:02:07.313474] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T22:02:07.615825] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-07. [2025-09-17T22:02:07.946895] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T22:02:08.415837] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-03. [2025-09-17T22:02:09.094088] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T22:02:09.215823] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-08. [2025-09-17T22:02:09.878215] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T22:02:10.015799] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-03. [2025-09-17T22:02:10.815795] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-04. [2025-09-17T22:02:11.140169] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T22:02:11.165316] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-03 (1.15 seconds). [2025-09-17T22:02:11.615808] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-04. [2025-09-17T22:02:12.415769] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-08. [2025-09-17T22:02:12.707613] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T22:02:12.775709] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T22:02:13.215793] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-05. [2025-09-17T22:02:13.549582] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T22:02:14.015789] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-05. [2025-09-17T22:02:14.602715] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T22:02:14.815752] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-06. [2025-09-17T22:02:15.159775] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T22:02:15.615778] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-06. [2025-09-17T22:02:16.415778] [INFO ] [REMOTE ] TEF: Fetching primary data for 2025-09. [2025-09-17T22:02:16.570975] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T22:02:16.723753] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T22:02:17.215808] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-07. [2025-09-17T22:02:17.508847] [INFO ] [REMOTE ] TEF: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T22:02:17.514961] [INFO ] [REMOTE ] TEF: Full fetch complete (54303 records). [2025-09-17T22:02:17.515137] [DEBUG] [VALIDATOR ] TEF: Validating primary data. [2025-09-17T22:02:17.914838] [DEBUG] [VALIDATOR ] TEF: All expected trading days are present. [2025-09-17T22:02:17.914922] [DEBUG] [VALIDATOR ] TEF: Primary data validation passed. [2025-09-17T22:02:17.915815] [INFO ] [MAIN ] TEF: Fetched primary data is valid. [2025-09-17T22:02:17.915902] [DEBUG] [LOCAL ] TEF: Saving primary data. [2025-09-17T22:02:17.917070] [DEBUG] [LOCAL ] TEF: Trimmed 54303 records to 37568 (keeping 200 days of data) [2025-09-17T22:02:18.015956] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-07. [2025-09-17T22:02:18.155851] [DEBUG] [LOCAL ] TEF: Primary data saved (37568 records). [2025-09-17T22:02:18.156010] [INFO ] [MAIN ] TEF: Full history saved. [2025-09-17T22:02:18.157748] [INFO ] [MAIN ] Update Progress: 2065/2371 symbols completed. TEF took 41.2s. Estimated remaining: 44m 48s. Rate: 6.8 symbols/min [2025-09-17T22:02:18.331531] [INFO ] [MAIN ] TEN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:02:18.371316] [DEBUG] [LOCAL ] TEN: Loaded 31223 existing records from primary storage. [2025-09-17T22:02:18.371450] [INFO ] [MAIN ] TEN: Loaded 31223 existing records. [2025-09-17T22:02:18.555127] [WARN ] [MAIN ] TEN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:02:18.569925] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T22:02:18.569482] [INFO ] [MAIN ] TEN: Wiping existing primary data before full refresh. [2025-09-17T22:02:18.574374] [INFO ] [LOCAL ] TEN: Starting deletion of primary data. [2025-09-17T22:02:18.575672] [DEBUG] [LOCAL ] TEN: Deleted primary data file. [2025-09-17T22:02:18.575744] [INFO ] [MAIN ] TEN: Starting full primary refresh. [2025-09-17T22:02:18.823408] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-08. [2025-09-17T22:02:18.943914] [INFO ] [REMOTE ] TEN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:02:19.615801] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-11. [2025-09-17T22:02:19.996801] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T22:02:20.021544] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-08 (1.20 seconds). [2025-09-17T22:02:20.415756] [INFO ] [REMOTE ] TEI: Fetching primary data for 2025-09. [2025-09-17T22:02:20.549800] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-11 (0.93 seconds). [2025-09-17T22:02:21.215754] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-08. [2025-09-17T22:02:21.421189] [INFO ] [REMOTE ] TEI: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T22:02:21.425171] [INFO ] [REMOTE ] TEI: Full fetch complete (29757 records). [2025-09-17T22:02:21.425257] [DEBUG] [VALIDATOR ] TEI: Validating primary data. [2025-09-17T22:02:21.808666] [DEBUG] [VALIDATOR ] TEI: All expected trading days are present. [2025-09-17T22:02:21.808830] [DEBUG] [VALIDATOR ] TEI: Primary data validation passed. [2025-09-17T22:02:21.809455] [INFO ] [MAIN ] TEI: Fetched primary data is valid. [2025-09-17T22:02:21.809500] [DEBUG] [LOCAL ] TEI: Saving primary data. [2025-09-17T22:02:21.810331] [DEBUG] [LOCAL ] TEI: Trimmed 29757 records to 20379 (keeping 200 days of data) [2025-09-17T22:02:21.943767] [DEBUG] [LOCAL ] TEI: Primary data saved (20379 records). [2025-09-17T22:02:21.943902] [INFO ] [MAIN ] TEI: Full history saved. [2025-09-17T22:02:21.944080] [INFO ] [MAIN ] Update Progress: 2066/2371 symbols completed. TEI took 28.3s. Estimated remaining: 44m 38s. Rate: 6.8 symbols/min [2025-09-17T22:02:22.020909] [INFO ] [REMOTE ] TECK: Fetching primary data for 2025-09. [2025-09-17T22:02:22.118493] [INFO ] [MAIN ] TEO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:02:22.142273] [DEBUG] [LOCAL ] TEO: Loaded 21560 existing records from primary storage. [2025-09-17T22:02:22.142400] [INFO ] [MAIN ] TEO: Loaded 21560 existing records. [2025-09-17T22:02:22.332405] [WARN ] [MAIN ] TEO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:02:22.332868] [INFO ] [MAIN ] TEO: Wiping existing primary data before full refresh. [2025-09-17T22:02:22.332928] [INFO ] [LOCAL ] TEO: Starting deletion of primary data. [2025-09-17T22:02:22.333440] [DEBUG] [LOCAL ] TEO: Deleted primary data file. [2025-09-17T22:02:22.333498] [INFO ] [MAIN ] TEO: Starting full primary refresh. [2025-09-17T22:02:22.693014] [INFO ] [REMOTE ] TEO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:02:22.815773] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-11. [2025-09-17T22:02:23.072516] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T22:02:23.615821] [INFO ] [REMOTE ] TEL: Fetching primary data for 2025-09. [2025-09-17T22:02:23.890189] [INFO ] [REMOTE ] TECK: Incremental fetch complete for 2025-09 (1.87 seconds). [2025-09-17T22:02:23.897480] [INFO ] [REMOTE ] TECK: Full fetch complete (77138 records). [2025-09-17T22:02:23.897595] [DEBUG] [VALIDATOR ] TECK: Validating primary data. [2025-09-17T22:02:24.297714] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T22:02:24.337952] [DEBUG] [VALIDATOR ] TECK: All expected trading days are present. [2025-09-17T22:02:24.340138] [DEBUG] [VALIDATOR ] TECK: Primary data validation passed. [2025-09-17T22:02:24.345767] [INFO ] [MAIN ] TECK: Fetched primary data is valid. [2025-09-17T22:02:24.345957] [DEBUG] [LOCAL ] TECK: Saving primary data. [2025-09-17T22:02:24.365689] [INFO ] [REMOTE ] TEL: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T22:02:24.373775] [DEBUG] [LOCAL ] TECK: Trimmed 77138 records to 53441 (keeping 200 days of data) [2025-09-17T22:02:24.377186] [INFO ] [REMOTE ] TEL: Full fetch complete (73065 records). [2025-09-17T22:02:24.377385] [DEBUG] [VALIDATOR ] TEL: Validating primary data. [2025-09-17T22:02:24.465086] [INFO ] [REMOTE ] TEO: Fetching primary data for 2024-12. [2025-09-17T22:02:24.932831] [DEBUG] [VALIDATOR ] TEL: All expected trading days are present. [2025-09-17T22:02:24.933337] [DEBUG] [VALIDATOR ] TEL: Primary data validation passed. [2025-09-17T22:02:24.934878] [INFO ] [MAIN ] TEL: Fetched primary data is valid. [2025-09-17T22:02:24.935775] [DEBUG] [LOCAL ] TEL: Saving primary data. [2025-09-17T22:02:24.941225] [DEBUG] [LOCAL ] TEL: Trimmed 73065 records to 51190 (keeping 200 days of data) [2025-09-17T22:02:25.246635] [INFO ] [REMOTE ] TEN: Fetching primary data for 2024-12. [2025-09-17T22:02:25.510517] [DEBUG] [LOCAL ] TEL: Primary data saved (51190 records). [2025-09-17T22:02:25.511868] [INFO ] [MAIN ] TEL: Full history saved. [2025-09-17T22:02:25.512311] [INFO ] [MAIN ] Update Progress: 2067/2371 symbols completed. TEL took 28.4s. Estimated remaining: 44m 28s. Rate: 6.8 symbols/min [2025-09-17T22:02:25.717168] [INFO ] [MAIN ] TEVA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:02:25.729889] [DEBUG] [LOCAL ] TECK: Primary data saved (53441 records). [2025-09-17T22:02:25.730157] [INFO ] [MAIN ] TECK: Full history saved. [2025-09-17T22:02:25.730543] [INFO ] [MAIN ] Update Progress: 2068/2371 symbols completed. TECK took 50.3s. Estimated remaining: 44m 18s. Rate: 6.8 symbols/min [2025-09-17T22:02:25.812854] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T22:02:25.954073] [INFO ] [MAIN ] TEX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:02:25.971393] [DEBUG] [LOCAL ] TEVA: Loaded 53632 existing records from primary storage. [2025-09-17T22:02:25.972018] [INFO ] [MAIN ] TEVA: Loaded 53632 existing records. [2025-09-17T22:02:26.018387] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-01. [2025-09-17T22:02:26.178928] [WARN ] [MAIN ] TEVA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:02:26.179169] [INFO ] [MAIN ] TEVA: Wiping existing primary data before full refresh. [2025-09-17T22:02:26.179215] [INFO ] [LOCAL ] TEVA: Starting deletion of primary data. [2025-09-17T22:02:26.180562] [DEBUG] [LOCAL ] TEVA: Deleted primary data file. [2025-09-17T22:02:26.180715] [INFO ] [MAIN ] TEVA: Starting full primary refresh. [2025-09-17T22:02:26.318833] [DEBUG] [LOCAL ] TEX: Loaded 45043 existing records from primary storage. [2025-09-17T22:02:26.334424] [INFO ] [MAIN ] TEX: Loaded 45043 existing records. [2025-09-17T22:02:26.701037] [WARN ] [MAIN ] TEX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:02:26.714609] [INFO ] [MAIN ] TEX: Wiping existing primary data before full refresh. [2025-09-17T22:02:26.714804] [INFO ] [LOCAL ] TEX: Starting deletion of primary data. [2025-09-17T22:02:26.767466] [DEBUG] [LOCAL ] TEX: Deleted primary data file. [2025-09-17T22:02:26.808617] [INFO ] [REMOTE ] TEVA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:02:26.808810] [INFO ] [MAIN ] TEX: Starting full primary refresh. [2025-09-17T22:02:26.824912] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-11. [2025-09-17T22:02:26.937600] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T22:02:27.208847] [INFO ] [REMOTE ] TEX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:02:27.374332] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T22:02:27.615792] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-02. [2025-09-17T22:02:28.415787] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-01. [2025-09-17T22:02:28.679906] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-02 (1.06 seconds). [2025-09-17T22:02:28.871494] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-11 (2.05 seconds). [2025-09-17T22:02:29.215821] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-03. [2025-09-17T22:02:29.739869] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T22:02:30.015791] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2024-12. [2025-09-17T22:02:30.321765] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T22:02:30.815803] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-11. [2025-09-17T22:02:31.615913] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-02. [2025-09-17T22:02:31.968087] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T22:02:32.331062] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T22:02:32.415801] [INFO ] [REMOTE ] TEX: Fetching primary data for 2024-12. [2025-09-17T22:02:33.063801] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T22:02:33.215854] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-04. [2025-09-17T22:02:34.024020] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-01. [2025-09-17T22:02:34.029453] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T22:02:34.094835] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T22:02:34.815782] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-05. [2025-09-17T22:02:35.615909] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-01. [2025-09-17T22:02:35.925197] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T22:02:36.067209] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T22:02:36.415776] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-06. [2025-09-17T22:02:36.882925] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T22:02:37.120920] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T22:02:37.215779] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-02. [2025-09-17T22:02:38.015791] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-03. [2025-09-17T22:02:38.350223] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T22:02:38.815780] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-03. [2025-09-17T22:02:39.404142] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T22:02:39.615793] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-02. [2025-09-17T22:02:40.415834] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-07. [2025-09-17T22:02:40.493950] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-03 (1.68 seconds). [2025-09-17T22:02:41.221294] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-04. [2025-09-17T22:02:41.229191] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T22:02:41.628477] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-02 (2.01 seconds). [2025-09-17T22:02:42.015830] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-03. [2025-09-17T22:02:42.815794] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-04. [2025-09-17T22:02:42.907941] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T22:02:43.615820] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-05. [2025-09-17T22:02:44.160468] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T22:02:44.200556] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-04 (1.38 seconds). [2025-09-17T22:02:44.415818] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-08. [2025-09-17T22:02:44.902629] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T22:02:45.215794] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-05. [2025-09-17T22:02:45.466004] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-08 (1.05 seconds). [2025-09-17T22:02:46.015787] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-04. [2025-09-17T22:02:46.180048] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T22:02:46.815797] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-06. [2025-09-17T22:02:47.615730] [INFO ] [REMOTE ] TEO: Fetching primary data for 2025-09. [2025-09-17T22:02:47.658620] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T22:02:48.241368] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T22:02:48.415784] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-07. [2025-09-17T22:02:48.466959] [INFO ] [REMOTE ] TEO: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T22:02:48.471087] [INFO ] [REMOTE ] TEO: Full fetch complete (32453 records). [2025-09-17T22:02:48.471164] [DEBUG] [VALIDATOR ] TEO: Validating primary data. [2025-09-17T22:02:48.878811] [DEBUG] [VALIDATOR ] TEO: All expected trading days are present. [2025-09-17T22:02:48.878915] [DEBUG] [VALIDATOR ] TEO: Primary data validation passed. [2025-09-17T22:02:48.879957] [INFO ] [MAIN ] TEO: Fetched primary data is valid. [2025-09-17T22:02:48.880026] [DEBUG] [LOCAL ] TEO: Saving primary data. [2025-09-17T22:02:48.881046] [DEBUG] [LOCAL ] TEO: Trimmed 32453 records to 21530 (keeping 200 days of data) [2025-09-17T22:02:49.011730] [DEBUG] [LOCAL ] TEO: Primary data saved (21530 records). [2025-09-17T22:02:49.011879] [INFO ] [MAIN ] TEO: Full history saved. [2025-09-17T22:02:49.012031] [INFO ] [MAIN ] Update Progress: 2069/2371 symbols completed. TEO took 27.1s. Estimated remaining: 44m 12s. Rate: 6.8 symbols/min [2025-09-17T22:02:49.191527] [INFO ] [MAIN ] TFC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:02:49.215833] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-06. [2025-09-17T22:02:49.267166] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-17T22:02:49.267318] [INFO ] [MAIN ] TFC: Loaded 53667 existing records. [2025-09-17T22:02:49.448946] [WARN ] [MAIN ] TFC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:02:49.449227] [INFO ] [MAIN ] TFC: Wiping existing primary data before full refresh. [2025-09-17T22:02:49.449298] [INFO ] [LOCAL ] TFC: Starting deletion of primary data. [2025-09-17T22:02:49.450451] [DEBUG] [LOCAL ] TFC: Deleted primary data file. [2025-09-17T22:02:49.450513] [INFO ] [MAIN ] TFC: Starting full primary refresh. [2025-09-17T22:02:49.837098] [INFO ] [REMOTE ] TFC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:02:49.876912] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T22:02:50.015821] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-11. [2025-09-17T22:02:50.752481] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T22:02:50.815749] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-07. [2025-09-17T22:02:51.466601] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T22:02:51.615794] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-05. [2025-09-17T22:02:52.292320] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T22:02:52.415829] [INFO ] [REMOTE ] TFC: Fetching primary data for 2024-12. [2025-09-17T22:02:53.215903] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-08. [2025-09-17T22:02:53.885952] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-05 (2.27 seconds). [2025-09-17T22:02:54.015847] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-06. [2025-09-17T22:02:54.121909] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T22:02:54.191537] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T22:02:54.815841] [INFO ] [REMOTE ] TEN: Fetching primary data for 2025-09. [2025-09-17T22:02:55.615821] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-01. [2025-09-17T22:02:55.816450] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T22:02:56.072064] [INFO ] [REMOTE ] TEN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T22:02:56.077707] [INFO ] [REMOTE ] TEN: Full fetch complete (45105 records). [2025-09-17T22:02:56.077819] [DEBUG] [VALIDATOR ] TEN: Validating primary data. [2025-09-17T22:02:56.420876] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-07. [2025-09-17T22:02:56.461207] [DEBUG] [VALIDATOR ] TEN: All expected trading days are present. [2025-09-17T22:02:56.461289] [DEBUG] [VALIDATOR ] TEN: Primary data validation passed. [2025-09-17T22:02:56.462147] [INFO ] [MAIN ] TEN: Fetched primary data is valid. [2025-09-17T22:02:56.462208] [DEBUG] [LOCAL ] TEN: Saving primary data. [2025-09-17T22:02:56.463238] [DEBUG] [LOCAL ] TEN: Trimmed 45105 records to 31256 (keeping 200 days of data) [2025-09-17T22:02:56.657580] [DEBUG] [LOCAL ] TEN: Primary data saved (31256 records). [2025-09-17T22:02:56.657758] [INFO ] [MAIN ] TEN: Full history saved. [2025-09-17T22:02:56.657891] [INFO ] [MAIN ] Update Progress: 2070/2371 symbols completed. TEN took 38.5s. Estimated remaining: 44m 3s. Rate: 6.8 symbols/min [2025-09-17T22:02:56.838739] [INFO ] [MAIN ] TFII: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:02:56.886751] [DEBUG] [LOCAL ] TFII: Loaded 34947 existing records from primary storage. [2025-09-17T22:02:56.886938] [INFO ] [MAIN ] TFII: Loaded 34947 existing records. [2025-09-17T22:02:57.109038] [WARN ] [MAIN ] TFII: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:02:57.109392] [INFO ] [MAIN ] TFII: Wiping existing primary data before full refresh. [2025-09-17T22:02:57.109480] [INFO ] [LOCAL ] TFII: Starting deletion of primary data. [2025-09-17T22:02:57.110426] [DEBUG] [LOCAL ] TFII: Deleted primary data file. [2025-09-17T22:02:57.110490] [INFO ] [MAIN ] TFII: Starting full primary refresh. [2025-09-17T22:02:57.216894] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-08. [2025-09-17T22:02:57.735186] [INFO ] [REMOTE ] TFII: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:02:57.739913] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-01 (2.12 seconds). [2025-09-17T22:02:58.015835] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-11. [2025-09-17T22:02:58.596626] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-07 (2.18 seconds). [2025-09-17T22:02:58.798438] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T22:02:58.815736] [INFO ] [REMOTE ] TEX: Fetching primary data for 2025-09. [2025-09-17T22:02:58.876994] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T22:02:59.615769] [INFO ] [REMOTE ] TFII: Fetching primary data for 2024-12. [2025-09-17T22:02:59.900695] [INFO ] [REMOTE ] TEX: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T22:02:59.906303] [INFO ] [REMOTE ] TEX: Full fetch complete (64608 records). [2025-09-17T22:02:59.906403] [DEBUG] [VALIDATOR ] TEX: Validating primary data. [2025-09-17T22:03:00.305962] [DEBUG] [VALIDATOR ] TEX: All expected trading days are present. [2025-09-17T22:03:00.306111] [DEBUG] [VALIDATOR ] TEX: Primary data validation passed. [2025-09-17T22:03:00.307112] [INFO ] [MAIN ] TEX: Fetched primary data is valid. [2025-09-17T22:03:00.307217] [DEBUG] [LOCAL ] TEX: Saving primary data. [2025-09-17T22:03:00.308590] [DEBUG] [LOCAL ] TEX: Trimmed 64608 records to 45024 (keeping 200 days of data) [2025-09-17T22:03:00.426519] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-02. [2025-09-17T22:03:00.600555] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T22:03:00.613332] [DEBUG] [LOCAL ] TEX: Primary data saved (45024 records). [2025-09-17T22:03:00.613422] [INFO ] [MAIN ] TEX: Full history saved. [2025-09-17T22:03:00.613535] [INFO ] [MAIN ] Update Progress: 2071/2371 symbols completed. TEX took 34.9s. Estimated remaining: 43m 53s. Rate: 6.8 symbols/min [2025-09-17T22:03:00.782934] [INFO ] [MAIN ] TFIN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:03:00.805828] [DEBUG] [LOCAL ] TFIN: Loaded 23538 existing records from primary storage. [2025-09-17T22:03:00.805961] [INFO ] [MAIN ] TFIN: Loaded 23538 existing records. [2025-09-17T22:03:01.037352] [WARN ] [MAIN ] TFIN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:03:01.037734] [INFO ] [MAIN ] TFIN: Wiping existing primary data before full refresh. [2025-09-17T22:03:01.037790] [INFO ] [LOCAL ] TFIN: Starting deletion of primary data. [2025-09-17T22:03:01.038383] [DEBUG] [LOCAL ] TFIN: Deleted primary data file. [2025-09-17T22:03:01.038442] [INFO ] [MAIN ] TFIN: Starting full primary refresh. [2025-09-17T22:03:01.220880] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-01. [2025-09-17T22:03:01.404215] [INFO ] [REMOTE ] TFIN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:03:02.015809] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-11. [2025-09-17T22:03:02.501593] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T22:03:02.815808] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-08. [2025-09-17T22:03:03.408182] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-01 (2.19 seconds). [2025-09-17T22:03:03.615845] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-02. [2025-09-17T22:03:04.415833] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-03. [2025-09-17T22:03:04.600639] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-11 (2.58 seconds). [2025-09-17T22:03:05.205522] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T22:03:05.215689] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2024-12. [2025-09-17T22:03:05.333406] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-08 (2.52 seconds). [2025-09-17T22:03:06.015828] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-03. [2025-09-17T22:03:06.136412] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T22:03:06.360280] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-03 (1.94 seconds). [2025-09-17T22:03:06.815825] [INFO ] [REMOTE ] TEVA: Fetching primary data for 2025-09. [2025-09-17T22:03:07.598680] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T22:03:07.615729] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-04. [2025-09-17T22:03:08.415783] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-04. [2025-09-17T22:03:08.510474] [INFO ] [REMOTE ] TEVA: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T22:03:08.518026] [INFO ] [REMOTE ] TEVA: Full fetch complete (77519 records). [2025-09-17T22:03:08.518191] [DEBUG] [VALIDATOR ] TEVA: Validating primary data. [2025-09-17T22:03:08.961392] [DEBUG] [VALIDATOR ] TEVA: All expected trading days are present. [2025-09-17T22:03:08.961493] [DEBUG] [VALIDATOR ] TEVA: Primary data validation passed. [2025-09-17T22:03:08.962712] [INFO ] [MAIN ] TEVA: Fetched primary data is valid. [2025-09-17T22:03:08.962781] [DEBUG] [LOCAL ] TEVA: Saving primary data. [2025-09-17T22:03:08.964422] [DEBUG] [LOCAL ] TEVA: Trimmed 77519 records to 53632 (keeping 200 days of data) [2025-09-17T22:03:09.218087] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-01. [2025-09-17T22:03:09.275539] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T22:03:09.342716] [DEBUG] [LOCAL ] TEVA: Primary data saved (53632 records). [2025-09-17T22:03:09.342861] [INFO ] [MAIN ] TEVA: Full history saved. [2025-09-17T22:03:09.342963] [INFO ] [MAIN ] Update Progress: 2072/2371 symbols completed. TEVA took 43.8s. Estimated remaining: 43m 45s. Rate: 6.8 symbols/min [2025-09-17T22:03:09.525761] [INFO ] [MAIN ] TFPM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:03:09.563528] [DEBUG] [LOCAL ] TFPM: Loaded 36910 existing records from primary storage. [2025-09-17T22:03:09.563699] [INFO ] [MAIN ] TFPM: Loaded 36910 existing records. [2025-09-17T22:03:09.748175] [WARN ] [MAIN ] TFPM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:03:09.748437] [INFO ] [MAIN ] TFPM: Wiping existing primary data before full refresh. [2025-09-17T22:03:09.748484] [INFO ] [LOCAL ] TFPM: Starting deletion of primary data. [2025-09-17T22:03:09.749433] [DEBUG] [LOCAL ] TFPM: Deleted primary data file. [2025-09-17T22:03:09.749493] [INFO ] [MAIN ] TFPM: Starting full primary refresh. [2025-09-17T22:03:10.017692] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-05. [2025-09-17T22:03:10.131775] [INFO ] [REMOTE ] TFPM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:03:10.172035] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T22:03:10.294787] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-01 (1.08 seconds). [2025-09-17T22:03:10.815807] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-05. [2025-09-17T22:03:11.107554] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T22:03:11.615819] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-06. [2025-09-17T22:03:12.415801] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-11. [2025-09-17T22:03:13.215810] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-02. [2025-09-17T22:03:13.638025] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-06 (2.02 seconds). [2025-09-17T22:03:13.985696] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-05 (3.17 seconds). [2025-09-17T22:03:14.015741] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-06. [2025-09-17T22:03:14.663819] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-02 (1.45 seconds). [2025-09-17T22:03:14.815772] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-03. [2025-09-17T22:03:15.023714] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-11 (2.61 seconds). [2025-09-17T22:03:15.621342] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-07. [2025-09-17T22:03:15.645868] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T22:03:15.910364] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T22:03:16.415775] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-07. [2025-09-17T22:03:16.901166] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-07 (1.28 seconds). [2025-09-17T22:03:17.215822] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2024-12. [2025-09-17T22:03:18.015790] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-08. [2025-09-17T22:03:18.469314] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T22:03:18.526770] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T22:03:18.815785] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-01. [2025-09-17T22:03:18.914552] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T22:03:19.613840] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T22:03:19.619461] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-08. [2025-09-17T22:03:20.415787] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-02. [2025-09-17T22:03:21.215782] [INFO ] [REMOTE ] TFII: Fetching primary data for 2025-09. [2025-09-17T22:03:21.629835] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T22:03:21.660704] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T22:03:22.015807] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-04. [2025-09-17T22:03:22.350069] [INFO ] [REMOTE ] TFII: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T22:03:22.354233] [INFO ] [REMOTE ] TFII: Full fetch complete (47389 records). [2025-09-17T22:03:22.354412] [DEBUG] [VALIDATOR ] TFII: Validating primary data. [2025-09-17T22:03:22.749401] [DEBUG] [VALIDATOR ] TFII: All expected trading days are present. [2025-09-17T22:03:22.749518] [DEBUG] [VALIDATOR ] TFII: Primary data validation passed. [2025-09-17T22:03:22.750466] [INFO ] [MAIN ] TFII: Fetched primary data is valid. [2025-09-17T22:03:22.750545] [DEBUG] [LOCAL ] TFII: Saving primary data. [2025-09-17T22:03:22.751846] [DEBUG] [LOCAL ] TFII: Trimmed 47389 records to 34883 (keeping 200 days of data) [2025-09-17T22:03:22.818665] [INFO ] [REMOTE ] TFC: Fetching primary data for 2025-09. [2025-09-17T22:03:22.996884] [DEBUG] [LOCAL ] TFII: Primary data saved (34883 records). [2025-09-17T22:03:22.997069] [INFO ] [MAIN ] TFII: Full history saved. [2025-09-17T22:03:22.998092] [INFO ] [MAIN ] Update Progress: 2073/2371 symbols completed. TFII took 26.3s. Estimated remaining: 43m 36s. Rate: 6.8 symbols/min [2025-09-17T22:03:23.189338] [INFO ] [MAIN ] TFX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:03:23.239515] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T22:03:23.259669] [DEBUG] [LOCAL ] TFX: Loaded 37839 existing records from primary storage. [2025-09-17T22:03:23.259827] [INFO ] [MAIN ] TFX: Loaded 37839 existing records. [2025-09-17T22:03:23.450679] [WARN ] [MAIN ] TFX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:03:23.450985] [INFO ] [MAIN ] TFX: Wiping existing primary data before full refresh. [2025-09-17T22:03:23.451042] [INFO ] [LOCAL ] TFX: Starting deletion of primary data. [2025-09-17T22:03:23.452031] [DEBUG] [LOCAL ] TFX: Deleted primary data file. [2025-09-17T22:03:23.452096] [INFO ] [MAIN ] TFX: Starting full primary refresh. [2025-09-17T22:03:23.618919] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-05. [2025-09-17T22:03:23.987267] [INFO ] [REMOTE ] TFX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:03:23.996134] [INFO ] [REMOTE ] TFC: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T22:03:24.003770] [INFO ] [REMOTE ] TFC: Full fetch complete (77519 records). [2025-09-17T22:03:24.003871] [DEBUG] [VALIDATOR ] TFC: Validating primary data. [2025-09-17T22:03:24.401272] [DEBUG] [VALIDATOR ] TFC: All expected trading days are present. [2025-09-17T22:03:24.401357] [DEBUG] [VALIDATOR ] TFC: Primary data validation passed. [2025-09-17T22:03:24.402455] [INFO ] [MAIN ] TFC: Fetched primary data is valid. [2025-09-17T22:03:24.402521] [DEBUG] [LOCAL ] TFC: Saving primary data. [2025-09-17T22:03:24.404356] [DEBUG] [LOCAL ] TFC: Trimmed 77519 records to 53667 (keeping 200 days of data) [2025-09-17T22:03:24.415852] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-11. [2025-09-17T22:03:24.769345] [DEBUG] [LOCAL ] TFC: Primary data saved (53667 records). [2025-09-17T22:03:24.769538] [INFO ] [MAIN ] TFC: Full history saved. [2025-09-17T22:03:24.770944] [INFO ] [MAIN ] Update Progress: 2074/2371 symbols completed. TFC took 35.8s. Estimated remaining: 43m 27s. Rate: 6.8 symbols/min [2025-09-17T22:03:24.971026] [INFO ] [MAIN ] TG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:03:24.986759] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-05 (1.37 seconds). [2025-09-17T22:03:25.001895] [DEBUG] [LOCAL ] TG: Loaded 10281 existing records from primary storage. [2025-09-17T22:03:25.002037] [INFO ] [MAIN ] TG: Loaded 10281 existing records. [2025-09-17T22:03:25.203639] [WARN ] [MAIN ] TG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:03:25.204013] [INFO ] [MAIN ] TG: Wiping existing primary data before full refresh. [2025-09-17T22:03:25.204110] [INFO ] [LOCAL ] TG: Starting deletion of primary data. [2025-09-17T22:03:25.204459] [DEBUG] [LOCAL ] TG: Deleted primary data file. [2025-09-17T22:03:25.204520] [INFO ] [MAIN ] TG: Starting full primary refresh. [2025-09-17T22:03:25.221009] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-03. [2025-09-17T22:03:25.617254] [INFO ] [REMOTE ] TG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:03:26.015765] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-11. [2025-09-17T22:03:26.136147] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T22:03:26.657699] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T22:03:26.680514] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T22:03:26.815793] [INFO ] [REMOTE ] TFX: Fetching primary data for 2024-12. [2025-09-17T22:03:27.615795] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-06. [2025-09-17T22:03:28.302975] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T22:03:28.415762] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-01. [2025-09-17T22:03:28.639544] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T22:03:29.215785] [INFO ] [REMOTE ] TG: Fetching primary data for 2024-12. [2025-09-17T22:03:29.536511] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T22:03:30.015781] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-02. [2025-09-17T22:03:30.228366] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T22:03:30.815795] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-04. [2025-09-17T22:03:31.586055] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T22:03:31.615740] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-03. [2025-09-17T22:03:31.909502] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T22:03:32.415789] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-05. [2025-09-17T22:03:33.215785] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-07. [2025-09-17T22:03:33.476790] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T22:03:33.895520] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T22:03:34.015732] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-01. [2025-09-17T22:03:34.065196] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T22:03:34.815783] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-08. [2025-09-17T22:03:34.882862] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-01 (0.87 seconds). [2025-09-17T22:03:35.615763] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-04. [2025-09-17T22:03:35.938946] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T22:03:36.415778] [INFO ] [REMOTE ] TFIN: Fetching primary data for 2025-09. [2025-09-17T22:03:36.869998] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T22:03:37.215759] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-05. [2025-09-17T22:03:37.458012] [INFO ] [REMOTE ] TFIN: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T22:03:37.461830] [INFO ] [REMOTE ] TFIN: Full fetch complete (30488 records). [2025-09-17T22:03:37.462026] [DEBUG] [VALIDATOR ] TFIN: Validating primary data. [2025-09-17T22:03:37.861273] [DEBUG] [VALIDATOR ] TFIN: All expected trading days are present. [2025-09-17T22:03:37.861400] [DEBUG] [VALIDATOR ] TFIN: Primary data validation passed. [2025-09-17T22:03:37.862084] [INFO ] [MAIN ] TFIN: Fetched primary data is valid. [2025-09-17T22:03:37.862250] [DEBUG] [LOCAL ] TFIN: Saving primary data. [2025-09-17T22:03:37.863173] [DEBUG] [LOCAL ] TFIN: Trimmed 30488 records to 23553 (keeping 200 days of data) [2025-09-17T22:03:38.008972] [DEBUG] [LOCAL ] TFIN: Primary data saved (23553 records). [2025-09-17T22:03:38.009105] [INFO ] [MAIN ] TFIN: Full history saved. [2025-09-17T22:03:38.009188] [INFO ] [MAIN ] Update Progress: 2075/2371 symbols completed. TFIN took 37.4s. Estimated remaining: 43m 19s. Rate: 6.8 symbols/min [2025-09-17T22:03:38.020918] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-06. [2025-09-17T22:03:38.184413] [INFO ] [MAIN ] TGE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:03:38.184618] [DEBUG] [LOCAL ] TGE: No existing data file found in primary storage. [2025-09-17T22:03:38.184709] [WARN ] [MAIN ] TGE: No existing data found, performing full refresh instead. [2025-09-17T22:03:38.184921] [INFO ] [MAIN ] TGE: Wiping existing primary data before full refresh. [2025-09-17T22:03:38.184969] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-17T22:03:38.185016] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-17T22:03:38.185050] [INFO ] [MAIN ] TGE: Starting full primary refresh. [2025-09-17T22:03:38.591769] [INFO ] [REMOTE ] TGE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:03:38.653016] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T22:03:38.815795] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-11. [2025-09-17T22:03:39.052044] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:03:39.052402] [WARN ] [REMOTE ] TGE: No data returned for month 2024-11 [2025-09-17T22:03:39.615808] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-06. [2025-09-17T22:03:39.651397] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T22:03:40.415816] [INFO ] [REMOTE ] TGE: Fetching primary data for 2024-12. [2025-09-17T22:03:40.678554] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:03:40.678923] [WARN ] [REMOTE ] TGE: No data returned for month 2024-12 [2025-09-17T22:03:41.055213] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T22:03:41.215785] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-02. [2025-09-17T22:03:41.980673] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T22:03:42.015733] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-03. [2025-09-17T22:03:42.618244] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T22:03:42.815795] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-07. [2025-09-17T22:03:43.615807] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-07. [2025-09-17T22:03:44.415877] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-01. [2025-09-17T22:03:44.460728] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T22:03:44.622869] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:03:44.623251] [WARN ] [REMOTE ] TGE: No data returned for month 2025-01 [2025-09-17T22:03:45.215752] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-02. [2025-09-17T22:03:45.331699] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T22:03:45.446146] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:03:45.446625] [WARN ] [REMOTE ] TGE: No data returned for month 2025-02 [2025-09-17T22:03:46.015838] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-08. [2025-09-17T22:03:46.815807] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-04. [2025-09-17T22:03:47.204779] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T22:03:47.615793] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-08. [2025-09-17T22:03:47.744264] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T22:03:48.415808] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-05. [2025-09-17T22:03:49.190352] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T22:03:49.205324] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T22:03:49.215682] [INFO ] [REMOTE ] TFX: Fetching primary data for 2025-09. [2025-09-17T22:03:50.015808] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-03. [2025-09-17T22:03:50.299183] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:03:50.299597] [WARN ] [REMOTE ] TGE: No data returned for month 2025-03 [2025-09-17T22:03:50.612097] [INFO ] [REMOTE ] TFX: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T22:03:50.617562] [INFO ] [REMOTE ] TFX: Full fetch complete (53810 records). [2025-09-17T22:03:50.617715] [DEBUG] [VALIDATOR ] TFX: Validating primary data. [2025-09-17T22:03:50.822408] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-06. [2025-09-17T22:03:51.058408] [DEBUG] [VALIDATOR ] TFX: All expected trading days are present. [2025-09-17T22:03:51.058504] [DEBUG] [VALIDATOR ] TFX: Primary data validation passed. [2025-09-17T22:03:51.059487] [INFO ] [MAIN ] TFX: Fetched primary data is valid. [2025-09-17T22:03:51.059555] [DEBUG] [LOCAL ] TFX: Saving primary data. [2025-09-17T22:03:51.060875] [DEBUG] [LOCAL ] TFX: Trimmed 53810 records to 37745 (keeping 200 days of data) [2025-09-17T22:03:51.310104] [DEBUG] [LOCAL ] TFX: Primary data saved (37745 records). [2025-09-17T22:03:51.310265] [INFO ] [MAIN ] TFX: Full history saved. [2025-09-17T22:03:51.312108] [INFO ] [MAIN ] Update Progress: 2076/2371 symbols completed. TFX took 28.3s. Estimated remaining: 43m 10s. Rate: 6.8 symbols/min [2025-09-17T22:03:51.487455] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-06 (0.67 seconds). [2025-09-17T22:03:51.510280] [INFO ] [MAIN ] TGLS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:03:51.549815] [DEBUG] [LOCAL ] TGLS: Loaded 28570 existing records from primary storage. [2025-09-17T22:03:51.549953] [INFO ] [MAIN ] TGLS: Loaded 28570 existing records. [2025-09-17T22:03:51.620904] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-04. [2025-09-17T22:03:51.732376] [WARN ] [MAIN ] TGLS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:03:51.732714] [INFO ] [MAIN ] TGLS: Wiping existing primary data before full refresh. [2025-09-17T22:03:51.732773] [INFO ] [LOCAL ] TGLS: Starting deletion of primary data. [2025-09-17T22:03:51.733562] [DEBUG] [LOCAL ] TGLS: Deleted primary data file. [2025-09-17T22:03:51.733624] [INFO ] [MAIN ] TGLS: Starting full primary refresh. [2025-09-17T22:03:51.863088] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:03:51.910675] [WARN ] [REMOTE ] TGE: No data returned for month 2025-04 [2025-09-17T22:03:52.095402] [INFO ] [REMOTE ] TGLS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:03:52.415777] [INFO ] [REMOTE ] TFPM: Fetching primary data for 2025-09. [2025-09-17T22:03:53.215834] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-11. [2025-09-17T22:03:53.534758] [INFO ] [REMOTE ] TFPM: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T22:03:53.540154] [INFO ] [REMOTE ] TFPM: Full fetch complete (49755 records). [2025-09-17T22:03:53.540256] [DEBUG] [VALIDATOR ] TFPM: Validating primary data. [2025-09-17T22:03:53.959445] [DEBUG] [VALIDATOR ] TFPM: All expected trading days are present. [2025-09-17T22:03:53.959543] [DEBUG] [VALIDATOR ] TFPM: Primary data validation passed. [2025-09-17T22:03:53.960443] [INFO ] [MAIN ] TFPM: Fetched primary data is valid. [2025-09-17T22:03:53.960509] [DEBUG] [LOCAL ] TFPM: Saving primary data. [2025-09-17T22:03:53.961797] [DEBUG] [LOCAL ] TFPM: Trimmed 49755 records to 36949 (keeping 200 days of data) [2025-09-17T22:03:54.018367] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-05. [2025-09-17T22:03:54.207131] [DEBUG] [LOCAL ] TFPM: Primary data saved (36949 records). [2025-09-17T22:03:54.207286] [INFO ] [MAIN ] TFPM: Full history saved. [2025-09-17T22:03:54.207400] [INFO ] [MAIN ] Update Progress: 2077/2371 symbols completed. TFPM took 44.9s. Estimated remaining: 43m 1s. Rate: 6.8 symbols/min [2025-09-17T22:03:54.253061] [DEBUG] [REMOTE ] TGE: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:03:54.253625] [WARN ] [REMOTE ] TGE: No data returned for month 2025-05 [2025-09-17T22:03:54.560240] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-11 (1.34 seconds). [2025-09-17T22:03:54.815820] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-06. [2025-09-17T22:03:55.615856] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-07. [2025-09-17T22:03:56.415813] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2024-12. [2025-09-17T22:03:56.427089] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T22:03:56.471592] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T22:03:57.215827] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-07. [2025-09-17T22:03:57.489255] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T22:03:58.015836] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-01. [2025-09-17T22:03:58.137020] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T22:03:58.815800] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-08. [2025-09-17T22:03:59.073332] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T22:03:59.615793] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-02. [2025-09-17T22:03:59.776633] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T22:04:00.415803] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-08. [2025-09-17T22:04:00.827951] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T22:04:01.215833] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-03. [2025-09-17T22:04:01.542244] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T22:04:02.015838] [INFO ] [REMOTE ] TGE: Fetching primary data for 2025-09. [2025-09-17T22:04:02.275916] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T22:04:02.622047] [INFO ] [REMOTE ] TGE: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T22:04:02.624554] [INFO ] [REMOTE ] TGE: Full fetch complete (7895 records). [2025-09-17T22:04:02.624637] [DEBUG] [VALIDATOR ] TGE: Validating primary data. [2025-09-17T22:04:02.815951] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-04. [2025-09-17T22:04:02.815881] [WARN ] [VALIDATOR ] TGE: Validation failed - insufficient historical data. Have 72 unique days, need 200 days [2025-09-17T22:04:02.817024] [FATAL] [MAIN ] TGE: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:04:02.817096] [WARN ] [MAIN ] TGE: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:04:02.817150] [INFO ] [LOCAL ] TGE: Starting deletion of primary data. [2025-09-17T22:04:02.817206] [DEBUG] [LOCAL ] TGE: No primary data file found to delete. [2025-09-17T22:04:02.817240] [INFO ] [LOCAL ] TGE: Starting deletion of derivative data. [2025-09-17T22:04:02.817298] [DEBUG] [LOCAL ] TGE: No derivative data file found to delete. [2025-09-17T22:04:02.817379] [INFO ] [MAIN ] Update Progress: 2078/2371 symbols completed. TGE took 24.8s. Estimated remaining: 42m 52s. Rate: 6.8 symbols/min [2025-09-17T22:04:03.615823] [INFO ] [REMOTE ] TG: Fetching primary data for 2025-09. [2025-09-17T22:04:04.104766] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T22:04:04.408383] [INFO ] [REMOTE ] TG: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T22:04:04.410721] [INFO ] [REMOTE ] TG: Full fetch complete (15175 records). [2025-09-17T22:04:04.410800] [DEBUG] [VALIDATOR ] TG: Validating primary data. [2025-09-17T22:04:04.444560] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-05. [2025-09-17T22:04:04.798459] [DEBUG] [VALIDATOR ] TG: All expected trading days are present. [2025-09-17T22:04:04.798538] [DEBUG] [VALIDATOR ] TG: Primary data validation passed. [2025-09-17T22:04:04.798917] [INFO ] [MAIN ] TG: Fetched primary data is valid. [2025-09-17T22:04:04.798985] [DEBUG] [LOCAL ] TG: Saving primary data. [2025-09-17T22:04:04.799485] [DEBUG] [LOCAL ] TG: Trimmed 15175 records to 10344 (keeping 200 days of data) [2025-09-17T22:04:04.861083] [DEBUG] [LOCAL ] TG: Primary data saved (10344 records). [2025-09-17T22:04:04.861222] [INFO ] [MAIN ] TG: Full history saved. [2025-09-17T22:04:04.861307] [INFO ] [MAIN ] Update Progress: 2079/2371 symbols completed. TG took 40.1s. Estimated remaining: 42m 42s. Rate: 6.8 symbols/min [2025-09-17T22:04:05.498147] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T22:04:05.505110] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-06. [2025-09-17T22:04:06.418468] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T22:04:06.424240] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-07. [2025-09-17T22:04:07.587334] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-07 (1.16 seconds). [2025-09-17T22:04:07.593552] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-08. [2025-09-17T22:04:08.944403] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T22:04:08.951485] [INFO ] [REMOTE ] TGLS: Fetching primary data for 2025-09. [2025-09-17T22:04:10.138252] [INFO ] [REMOTE ] TGLS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T22:04:10.147097] [INFO ] [REMOTE ] TGLS: Full fetch complete (40130 records). [2025-09-17T22:04:10.147330] [DEBUG] [VALIDATOR ] TGLS: Validating primary data. [2025-09-17T22:04:10.768616] [DEBUG] [VALIDATOR ] TGLS: All expected trading days are present. [2025-09-17T22:04:10.768786] [DEBUG] [VALIDATOR ] TGLS: Primary data validation passed. [2025-09-17T22:04:10.770767] [INFO ] [MAIN ] TGLS: Fetched primary data is valid. [2025-09-17T22:04:10.770869] [DEBUG] [LOCAL ] TGLS: Saving primary data. [2025-09-17T22:04:10.772350] [DEBUG] [LOCAL ] TGLS: Trimmed 40130 records to 28588 (keeping 200 days of data) [2025-09-17T22:04:11.021818] [DEBUG] [LOCAL ] TGLS: Primary data saved (28588 records). [2025-09-17T22:04:11.022013] [INFO ] [MAIN ] TGLS: Full history saved. [2025-09-17T22:04:11.022189] [INFO ] [MAIN ] Update Progress: 2080/2371 symbols completed. TGLS took 19.7s. Estimated remaining: 42m 33s. Rate: 6.8 symbols/min [2025-09-17T22:04:11.747274] [INFO ] [MAIN ] TGNA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:04:11.797012] [INFO ] [MAIN ] THC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:04:11.918174] [INFO ] [MAIN ] TGS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:04:11.919315] [INFO ] [MAIN ] TGT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:04:12.005759] [DEBUG] [LOCAL ] TGNA: Loaded 48714 existing records from primary storage. [2025-09-17T22:04:12.019776] [INFO ] [MAIN ] TGNA: Loaded 48714 existing records. [2025-09-17T22:04:12.006615] [DEBUG] [LOCAL ] TGS: Loaded 32080 existing records from primary storage. [2025-09-17T22:04:12.025320] [INFO ] [MAIN ] TGS: Loaded 32080 existing records. [2025-09-17T22:04:12.152541] [DEBUG] [LOCAL ] THC: Loaded 48406 existing records from primary storage. [2025-09-17T22:04:12.203152] [INFO ] [MAIN ] THC: Loaded 48406 existing records. [2025-09-17T22:04:12.320040] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-17T22:04:12.336386] [INFO ] [MAIN ] TGT: Loaded 53778 existing records. [2025-09-17T22:04:12.746469] [WARN ] [MAIN ] TGNA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:04:12.732253] [WARN ] [MAIN ] TGS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:04:12.834254] [WARN ] [MAIN ] THC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:04:12.839612] [INFO ] [MAIN ] TGNA: Wiping existing primary data before full refresh. [2025-09-17T22:04:12.863776] [INFO ] [LOCAL ] TGNA: Starting deletion of primary data. [2025-09-17T22:04:12.863673] [INFO ] [MAIN ] TGS: Wiping existing primary data before full refresh. [2025-09-17T22:04:12.878410] [INFO ] [MAIN ] THC: Wiping existing primary data before full refresh. [2025-09-17T22:04:12.898766] [DEBUG] [LOCAL ] TGNA: Deleted primary data file. [2025-09-17T22:04:12.902516] [INFO ] [MAIN ] TGNA: Starting full primary refresh. [2025-09-17T22:04:12.902059] [INFO ] [LOCAL ] TGS: Starting deletion of primary data. [2025-09-17T22:04:12.902407] [WARN ] [MAIN ] TGT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:04:12.902677] [INFO ] [LOCAL ] THC: Starting deletion of primary data. [2025-09-17T22:04:12.938914] [DEBUG] [LOCAL ] TGS: Deleted primary data file. [2025-09-17T22:04:12.940792] [INFO ] [MAIN ] TGS: Starting full primary refresh. [2025-09-17T22:04:12.952637] [DEBUG] [LOCAL ] THC: Deleted primary data file. [2025-09-17T22:04:12.958207] [INFO ] [MAIN ] TGT: Wiping existing primary data before full refresh. [2025-09-17T22:04:13.000371] [INFO ] [LOCAL ] TGT: Starting deletion of primary data. [2025-09-17T22:04:12.985749] [INFO ] [MAIN ] THC: Starting full primary refresh. [2025-09-17T22:04:13.085191] [DEBUG] [LOCAL ] TGT: Deleted primary data file. [2025-09-17T22:04:13.196743] [INFO ] [MAIN ] TGT: Starting full primary refresh. [2025-09-17T22:04:14.303244] [INFO ] [REMOTE ] TGNA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:04:14.338501] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-11. [2025-09-17T22:04:14.446213] [INFO ] [REMOTE ] TGS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:04:14.462144] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-11. [2025-09-17T22:04:14.589371] [INFO ] [REMOTE ] THC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:04:14.596482] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-11. [2025-09-17T22:04:14.595967] [INFO ] [REMOTE ] TGT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:04:14.597706] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-11. [2025-09-17T22:04:15.911195] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T22:04:15.917615] [INFO ] [REMOTE ] TGS: Fetching primary data for 2024-12. [2025-09-17T22:04:16.027450] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T22:04:16.037861] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2024-12. [2025-09-17T22:04:16.099869] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T22:04:16.109569] [INFO ] [REMOTE ] THC: Fetching primary data for 2024-12. [2025-09-17T22:04:16.419299] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T22:04:16.429993] [INFO ] [REMOTE ] TGT: Fetching primary data for 2024-12. [2025-09-17T22:04:17.179329] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T22:04:17.186111] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-01. [2025-09-17T22:04:17.656773] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2024-12 (1.55 seconds). [2025-09-17T22:04:17.666871] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-01. [2025-09-17T22:04:17.702141] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T22:04:17.712585] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-01. [2025-09-17T22:04:18.691159] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T22:04:18.703702] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-02. [2025-09-17T22:04:18.736476] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-17T22:04:18.747496] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-01. [2025-09-17T22:04:19.252627] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T22:04:19.262395] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-02. [2025-09-17T22:04:19.355952] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T22:04:19.615753] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-02. [2025-09-17T22:04:19.782062] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-02 (1.08 seconds). [2025-09-17T22:04:20.415756] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-03. [2025-09-17T22:04:20.479417] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T22:04:20.819740] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-17T22:04:21.215792] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-03. [2025-09-17T22:04:21.408420] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T22:04:21.718196] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-03 (1.30 seconds). [2025-09-17T22:04:22.015778] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-04. [2025-09-17T22:04:22.815795] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-02. [2025-09-17T22:04:22.921027] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T22:04:23.363325] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T22:04:23.615775] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-03. [2025-09-17T22:04:24.415784] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-04. [2025-09-17T22:04:24.948372] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-17T22:04:25.035796] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T22:04:25.215773] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-04. [2025-09-17T22:04:25.695763] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T22:04:26.015787] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-05. [2025-09-17T22:04:26.815799] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-05. [2025-09-17T22:04:27.149912] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T22:04:27.317351] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T22:04:27.615780] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-06. [2025-09-17T22:04:28.325207] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T22:04:28.415815] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-06. [2025-09-17T22:04:29.186516] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T22:04:29.215741] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-05. [2025-09-17T22:04:29.310820] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-06 (0.90 seconds). [2025-09-17T22:04:30.015787] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-07. [2025-09-17T22:04:30.815790] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-03. [2025-09-17T22:04:30.993088] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T22:04:31.064688] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T22:04:31.615785] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-08. [2025-09-17T22:04:32.415787] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-07. [2025-09-17T22:04:33.023930] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-08 (1.41 seconds). [2025-09-17T22:04:33.117318] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-03 (2.30 seconds). [2025-09-17T22:04:33.215749] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-04. [2025-09-17T22:04:34.015787] [INFO ] [REMOTE ] TGS: Fetching primary data for 2025-09. [2025-09-17T22:04:34.250904] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T22:04:34.815787] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-08. [2025-09-17T22:04:34.987929] [INFO ] [REMOTE ] TGS: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T22:04:34.993309] [INFO ] [REMOTE ] TGS: Full fetch complete (46779 records). [2025-09-17T22:04:34.993418] [DEBUG] [VALIDATOR ] TGS: Validating primary data. [2025-09-17T22:04:35.376076] [DEBUG] [VALIDATOR ] TGS: All expected trading days are present. [2025-09-17T22:04:35.376258] [DEBUG] [VALIDATOR ] TGS: Primary data validation passed. [2025-09-17T22:04:35.377160] [INFO ] [MAIN ] TGS: Fetched primary data is valid. [2025-09-17T22:04:35.377362] [DEBUG] [LOCAL ] TGS: Saving primary data. [2025-09-17T22:04:35.378722] [DEBUG] [LOCAL ] TGS: Trimmed 46779 records to 32159 (keeping 200 days of data) [2025-09-17T22:04:35.531264] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-04 (2.32 seconds). [2025-09-17T22:04:35.614582] [DEBUG] [LOCAL ] TGS: Primary data saved (32159 records). [2025-09-17T22:04:35.614754] [INFO ] [MAIN ] TGS: Full history saved. [2025-09-17T22:04:35.614928] [INFO ] [MAIN ] Update Progress: 2081/2371 symbols completed. TGS took 24.6s. Estimated remaining: 42m 27s. Rate: 6.8 symbols/min [2025-09-17T22:04:35.626533] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-06. [2025-09-17T22:04:35.789365] [INFO ] [MAIN ] THG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:04:35.814274] [DEBUG] [LOCAL ] THG: Loaded 22228 existing records from primary storage. [2025-09-17T22:04:35.814420] [INFO ] [MAIN ] THG: Loaded 22228 existing records. [2025-09-17T22:04:35.994073] [WARN ] [MAIN ] THG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:04:35.994377] [INFO ] [MAIN ] THG: Wiping existing primary data before full refresh. [2025-09-17T22:04:35.994423] [INFO ] [LOCAL ] THG: Starting deletion of primary data. [2025-09-17T22:04:35.995121] [DEBUG] [LOCAL ] THG: Deleted primary data file. [2025-09-17T22:04:35.995192] [INFO ] [MAIN ] THG: Starting full primary refresh. [2025-09-17T22:04:36.360267] [INFO ] [REMOTE ] THG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:04:36.415800] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-05. [2025-09-17T22:04:36.610174] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T22:04:37.215770] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-11. [2025-09-17T22:04:37.308717] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T22:04:38.015834] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-07. [2025-09-17T22:04:38.079268] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-11 (0.86 seconds). [2025-09-17T22:04:38.384756] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T22:04:38.815800] [INFO ] [REMOTE ] TGNA: Fetching primary data for 2025-09. [2025-09-17T22:04:39.413810] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T22:04:39.615789] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-08. [2025-09-17T22:04:40.421311] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-06. [2025-09-17T22:04:40.434061] [INFO ] [REMOTE ] TGNA: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T22:04:40.441240] [INFO ] [REMOTE ] TGNA: Full fetch complete (69644 records). [2025-09-17T22:04:40.441385] [DEBUG] [VALIDATOR ] TGNA: Validating primary data. [2025-09-17T22:04:40.862032] [DEBUG] [VALIDATOR ] TGNA: All expected trading days are present. [2025-09-17T22:04:40.862238] [DEBUG] [VALIDATOR ] TGNA: Primary data validation passed. [2025-09-17T22:04:40.863545] [INFO ] [MAIN ] TGNA: Fetched primary data is valid. [2025-09-17T22:04:40.863620] [DEBUG] [LOCAL ] TGNA: Saving primary data. [2025-09-17T22:04:40.865373] [DEBUG] [LOCAL ] TGNA: Trimmed 69644 records to 48676 (keeping 200 days of data) [2025-09-17T22:04:41.195592] [DEBUG] [LOCAL ] TGNA: Primary data saved (48676 records). [2025-09-17T22:04:41.195797] [INFO ] [MAIN ] TGNA: Full history saved. [2025-09-17T22:04:41.195954] [INFO ] [MAIN ] Update Progress: 2082/2371 symbols completed. TGNA took 30.2s. Estimated remaining: 42m 17s. Rate: 6.8 symbols/min [2025-09-17T22:04:41.220892] [INFO ] [REMOTE ] THG: Fetching primary data for 2024-12. [2025-09-17T22:04:41.382043] [INFO ] [MAIN ] THIR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:04:41.410847] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T22:04:41.423894] [DEBUG] [LOCAL ] THIR: Loaded 2128 existing records from primary storage. [2025-09-17T22:04:41.424273] [INFO ] [MAIN ] THIR: Loaded 2128 existing records. [2025-09-17T22:04:41.615947] [WARN ] [MAIN ] THIR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:04:41.616242] [INFO ] [MAIN ] THIR: Wiping existing primary data before full refresh. [2025-09-17T22:04:41.616298] [INFO ] [LOCAL ] THIR: Starting deletion of primary data. [2025-09-17T22:04:41.616539] [DEBUG] [LOCAL ] THIR: Deleted primary data file. [2025-09-17T22:04:41.616600] [INFO ] [MAIN ] THIR: Starting full primary refresh. [2025-09-17T22:04:41.993092] [INFO ] [REMOTE ] THIR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:04:42.015763] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-11. [2025-09-17T22:04:42.315633] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-11 (0.30 seconds). [2025-09-17T22:04:42.374457] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T22:04:42.636498] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-06 (2.22 seconds). [2025-09-17T22:04:42.815803] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-07. [2025-09-17T22:04:43.615828] [INFO ] [REMOTE ] THC: Fetching primary data for 2025-09. [2025-09-17T22:04:44.415796] [INFO ] [REMOTE ] THIR: Fetching primary data for 2024-12. [2025-09-17T22:04:45.003210] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T22:04:45.027793] [INFO ] [REMOTE ] THC: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T22:04:45.034352] [INFO ] [REMOTE ] THC: Full fetch complete (69550 records). [2025-09-17T22:04:45.034502] [DEBUG] [VALIDATOR ] THC: Validating primary data. [2025-09-17T22:04:45.227942] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-01. [2025-09-17T22:04:45.379313] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-07 (2.56 seconds). [2025-09-17T22:04:45.513984] [DEBUG] [VALIDATOR ] THC: All expected trading days are present. [2025-09-17T22:04:45.514076] [DEBUG] [VALIDATOR ] THC: Primary data validation passed. [2025-09-17T22:04:45.515181] [INFO ] [MAIN ] THC: Fetched primary data is valid. [2025-09-17T22:04:45.515247] [DEBUG] [LOCAL ] THC: Saving primary data. [2025-09-17T22:04:45.516767] [DEBUG] [LOCAL ] THC: Trimmed 69550 records to 48343 (keeping 200 days of data) [2025-09-17T22:04:45.848731] [DEBUG] [LOCAL ] THC: Primary data saved (48343 records). [2025-09-17T22:04:45.848916] [INFO ] [MAIN ] THC: Full history saved. [2025-09-17T22:04:45.849145] [INFO ] [MAIN ] Update Progress: 2083/2371 symbols completed. THC took 34.8s. Estimated remaining: 42m 8s. Rate: 6.8 symbols/min [2025-09-17T22:04:45.940711] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T22:04:46.030943] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-08. [2025-09-17T22:04:46.034445] [INFO ] [MAIN ] THLV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:04:46.035602] [DEBUG] [LOCAL ] THLV: No existing data file found in primary storage. [2025-09-17T22:04:46.035679] [WARN ] [MAIN ] THLV: No existing data found, performing full refresh instead. [2025-09-17T22:04:46.035884] [INFO ] [MAIN ] THLV: Wiping existing primary data before full refresh. [2025-09-17T22:04:46.035942] [INFO ] [LOCAL ] THLV: Starting deletion of primary data. [2025-09-17T22:04:46.035987] [DEBUG] [LOCAL ] THLV: No primary data file found to delete. [2025-09-17T22:04:46.036020] [INFO ] [MAIN ] THLV: Starting full primary refresh. [2025-09-17T22:04:46.409395] [INFO ] [REMOTE ] THLV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:04:46.815800] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-01. [2025-09-17T22:04:47.615794] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-11. [2025-09-17T22:04:47.849760] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T22:04:47.971187] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-11 (0.36 seconds). [2025-09-17T22:04:48.391100] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-08 (2.36 seconds). [2025-09-17T22:04:48.415743] [INFO ] [REMOTE ] TGT: Fetching primary data for 2025-09. [2025-09-17T22:04:49.078477] [INFO ] [REMOTE ] TGT: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T22:04:49.085491] [INFO ] [REMOTE ] TGT: Full fetch complete (77834 records). [2025-09-17T22:04:49.085639] [DEBUG] [VALIDATOR ] TGT: Validating primary data. [2025-09-17T22:04:49.220950] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-02. [2025-09-17T22:04:49.493820] [DEBUG] [VALIDATOR ] TGT: All expected trading days are present. [2025-09-17T22:04:49.493921] [DEBUG] [VALIDATOR ] TGT: Primary data validation passed. [2025-09-17T22:04:49.495114] [INFO ] [MAIN ] TGT: Fetched primary data is valid. [2025-09-17T22:04:49.495180] [DEBUG] [LOCAL ] TGT: Saving primary data. [2025-09-17T22:04:49.496824] [DEBUG] [LOCAL ] TGT: Trimmed 77834 records to 53778 (keeping 200 days of data) [2025-09-17T22:04:49.624538] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-02 (0.40 seconds). [2025-09-17T22:04:49.864147] [DEBUG] [LOCAL ] TGT: Primary data saved (53778 records). [2025-09-17T22:04:49.864287] [INFO ] [MAIN ] TGT: Full history saved. [2025-09-17T22:04:49.866572] [INFO ] [MAIN ] Update Progress: 2084/2371 symbols completed. TGT took 38.8s. Estimated remaining: 41m 59s. Rate: 6.8 symbols/min [2025-09-17T22:04:50.021303] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-03. [2025-09-17T22:04:50.045825] [INFO ] [MAIN ] THO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:04:50.095841] [DEBUG] [LOCAL ] THO: Loaded 42393 existing records from primary storage. [2025-09-17T22:04:50.096000] [INFO ] [MAIN ] THO: Loaded 42393 existing records. [2025-09-17T22:04:50.277381] [WARN ] [MAIN ] THO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:04:50.277623] [INFO ] [MAIN ] THO: Wiping existing primary data before full refresh. [2025-09-17T22:04:50.277722] [INFO ] [LOCAL ] THO: Starting deletion of primary data. [2025-09-17T22:04:50.278942] [DEBUG] [LOCAL ] THO: Deleted primary data file. [2025-09-17T22:04:50.279004] [INFO ] [MAIN ] THO: Starting full primary refresh. [2025-09-17T22:04:50.433887] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-03 (0.41 seconds). [2025-09-17T22:04:50.644456] [INFO ] [REMOTE ] THO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:04:50.815757] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-11. [2025-09-17T22:04:51.615786] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-02. [2025-09-17T22:04:52.363812] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T22:04:52.415739] [INFO ] [REMOTE ] THO: Fetching primary data for 2024-12. [2025-09-17T22:04:52.797390] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-02 (1.18 seconds). [2025-09-17T22:04:53.215787] [INFO ] [REMOTE ] THLV: Fetching primary data for 2024-12. [2025-09-17T22:04:53.685705] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T22:04:53.825240] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T22:04:54.015764] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-01. [2025-09-17T22:04:54.815801] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-01. [2025-09-17T22:04:55.267076] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T22:04:55.557810] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T22:04:55.615748] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-02. [2025-09-17T22:04:56.415829] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-02. [2025-09-17T22:04:56.715057] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-02 (0.30 seconds). [2025-09-17T22:04:57.215841] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-03. [2025-09-17T22:04:57.239557] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T22:04:57.698380] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-03 (0.48 seconds). [2025-09-17T22:04:58.015825] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-04. [2025-09-17T22:04:58.447774] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-04 (0.43 seconds). [2025-09-17T22:04:58.815859] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-03. [2025-09-17T22:04:59.615828] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-03. [2025-09-17T22:05:00.415781] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-04. [2025-09-17T22:05:00.790936] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-04 (0.38 seconds). [2025-09-17T22:05:00.812559] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T22:05:01.154454] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-03 (2.34 seconds). [2025-09-17T22:05:01.215736] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-04. [2025-09-17T22:05:02.015799] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-05. [2025-09-17T22:05:02.475718] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-05 (0.46 seconds). [2025-09-17T22:05:02.815851] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-04. [2025-09-17T22:05:03.095670] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T22:05:03.615835] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-05. [2025-09-17T22:05:03.842010] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-04 (1.03 seconds). [2025-09-17T22:05:04.415824] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-05. [2025-09-17T22:05:05.214291] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T22:05:05.217405] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-06. [2025-09-17T22:05:05.585018] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T22:05:05.619221] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T22:05:06.015855] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-05. [2025-09-17T22:05:06.465329] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T22:05:06.815817] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-06. [2025-09-17T22:05:07.615788] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-07. [2025-09-17T22:05:07.977750] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-07 (0.36 seconds). [2025-09-17T22:05:08.415828] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-08. [2025-09-17T22:05:08.459008] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T22:05:08.715094] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-08 (0.30 seconds). [2025-09-17T22:05:09.215819] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-06. [2025-09-17T22:05:09.562104] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-06 (0.35 seconds). [2025-09-17T22:05:10.015793] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-06. [2025-09-17T22:05:10.815780] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-07. [2025-09-17T22:05:11.155892] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T22:05:11.363142] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-07 (0.55 seconds). [2025-09-17T22:05:11.615799] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-08. [2025-09-17T22:05:12.187769] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T22:05:12.415788] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-07. [2025-09-17T22:05:13.215789] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-07. [2025-09-17T22:05:14.015772] [INFO ] [REMOTE ] THLV: Fetching primary data for 2025-09. [2025-09-17T22:05:14.166674] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T22:05:14.364512] [INFO ] [REMOTE ] THLV: Incremental fetch complete for 2025-09 (0.35 seconds). [2025-09-17T22:05:14.365390] [INFO ] [REMOTE ] THLV: Full fetch complete (2713 records). [2025-09-17T22:05:14.365485] [DEBUG] [VALIDATOR ] THLV: Validating primary data. [2025-09-17T22:05:14.763145] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T22:05:14.763257] [DEBUG] [VALIDATOR ] THLV: All expected trading days are present. [2025-09-17T22:05:14.763396] [DEBUG] [VALIDATOR ] THLV: Primary data validation passed. [2025-09-17T22:05:14.768931] [INFO ] [MAIN ] THLV: Fetched primary data is valid. [2025-09-17T22:05:14.769363] [DEBUG] [LOCAL ] THLV: Saving primary data. [2025-09-17T22:05:14.770164] [DEBUG] [LOCAL ] THLV: Trimmed 2713 records to 1683 (keeping 200 days of data) [2025-09-17T22:05:14.780445] [DEBUG] [LOCAL ] THLV: Primary data saved (1683 records). [2025-09-17T22:05:14.780506] [INFO ] [MAIN ] THLV: Full history saved. [2025-09-17T22:05:14.780602] [INFO ] [MAIN ] Update Progress: 2085/2371 symbols completed. THLV took 28.9s. Estimated remaining: 41m 52s. Rate: 6.8 symbols/min [2025-09-17T22:05:14.820904] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-08. [2025-09-17T22:05:14.954595] [INFO ] [MAIN ] THQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:05:14.980408] [DEBUG] [LOCAL ] THQ: Loaded 24343 existing records from primary storage. [2025-09-17T22:05:14.980544] [INFO ] [MAIN ] THQ: Loaded 24343 existing records. [2025-09-17T22:05:15.162297] [WARN ] [MAIN ] THQ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:05:15.162600] [INFO ] [MAIN ] THQ: Wiping existing primary data before full refresh. [2025-09-17T22:05:15.162682] [INFO ] [LOCAL ] THQ: Starting deletion of primary data. [2025-09-17T22:05:15.163383] [DEBUG] [LOCAL ] THQ: Deleted primary data file. [2025-09-17T22:05:15.163454] [INFO ] [MAIN ] THQ: Starting full primary refresh. [2025-09-17T22:05:15.610867] [INFO ] [REMOTE ] THQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:05:15.615778] [INFO ] [REMOTE ] THIR: Fetching primary data for 2025-09. [2025-09-17T22:05:16.110006] [INFO ] [REMOTE ] THIR: Incremental fetch complete for 2025-09 (0.49 seconds). [2025-09-17T22:05:16.110973] [INFO ] [REMOTE ] THIR: Full fetch complete (2588 records). [2025-09-17T22:05:16.111042] [DEBUG] [VALIDATOR ] THIR: Validating primary data. [2025-09-17T22:05:16.427780] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-08. [2025-09-17T22:05:16.472548] [DEBUG] [VALIDATOR ] THIR: All expected trading days are present. [2025-09-17T22:05:16.472678] [DEBUG] [VALIDATOR ] THIR: Primary data validation passed. [2025-09-17T22:05:16.472837] [INFO ] [MAIN ] THIR: Fetched primary data is valid. [2025-09-17T22:05:16.473013] [DEBUG] [LOCAL ] THIR: Saving primary data. [2025-09-17T22:05:16.473862] [DEBUG] [LOCAL ] THIR: Trimmed 2588 records to 2143 (keeping 200 days of data) [2025-09-17T22:05:16.497384] [DEBUG] [LOCAL ] THIR: Primary data saved (2143 records). [2025-09-17T22:05:16.503312] [INFO ] [MAIN ] THIR: Full history saved. [2025-09-17T22:05:16.503432] [INFO ] [MAIN ] Update Progress: 2086/2371 symbols completed. THIR took 35.3s. Estimated remaining: 41m 42s. Rate: 6.8 symbols/min [2025-09-17T22:05:16.586763] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T22:05:16.702329] [INFO ] [MAIN ] THR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:05:16.725020] [DEBUG] [LOCAL ] THR: Loaded 20002 existing records from primary storage. [2025-09-17T22:05:16.725158] [INFO ] [MAIN ] THR: Loaded 20002 existing records. [2025-09-17T22:05:16.905401] [WARN ] [MAIN ] THR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:05:16.905667] [INFO ] [MAIN ] THR: Wiping existing primary data before full refresh. [2025-09-17T22:05:16.905774] [INFO ] [LOCAL ] THR: Starting deletion of primary data. [2025-09-17T22:05:16.906265] [DEBUG] [LOCAL ] THR: Deleted primary data file. [2025-09-17T22:05:16.906326] [INFO ] [MAIN ] THR: Starting full primary refresh. [2025-09-17T22:05:17.222212] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-11. [2025-09-17T22:05:17.268637] [INFO ] [REMOTE ] THR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:05:17.283588] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T22:05:18.015790] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-11. [2025-09-17T22:05:18.552622] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T22:05:18.815772] [INFO ] [REMOTE ] THG: Fetching primary data for 2025-09. [2025-09-17T22:05:19.095768] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T22:05:19.542627] [INFO ] [REMOTE ] THG: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T22:05:19.545547] [INFO ] [REMOTE ] THG: Full fetch complete (31079 records). [2025-09-17T22:05:19.545632] [DEBUG] [VALIDATOR ] THG: Validating primary data. [2025-09-17T22:05:19.620897] [INFO ] [REMOTE ] THO: Fetching primary data for 2025-09. [2025-09-17T22:05:19.925877] [DEBUG] [VALIDATOR ] THG: All expected trading days are present. [2025-09-17T22:05:19.925967] [DEBUG] [VALIDATOR ] THG: Primary data validation passed. [2025-09-17T22:05:19.926639] [INFO ] [MAIN ] THG: Fetched primary data is valid. [2025-09-17T22:05:19.926723] [DEBUG] [LOCAL ] THG: Saving primary data. [2025-09-17T22:05:19.927455] [DEBUG] [LOCAL ] THG: Trimmed 31079 records to 22174 (keeping 200 days of data) [2025-09-17T22:05:20.065313] [DEBUG] [LOCAL ] THG: Primary data saved (22174 records). [2025-09-17T22:05:20.065446] [INFO ] [MAIN ] THG: Full history saved. [2025-09-17T22:05:20.065531] [INFO ] [MAIN ] Update Progress: 2087/2371 symbols completed. THG took 44.5s. Estimated remaining: 41m 33s. Rate: 6.8 symbols/min [2025-09-17T22:05:20.234836] [INFO ] [MAIN ] THS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:05:20.276119] [DEBUG] [LOCAL ] THS: Loaded 37914 existing records from primary storage. [2025-09-17T22:05:20.276270] [INFO ] [MAIN ] THS: Loaded 37914 existing records. [2025-09-17T22:05:20.425544] [INFO ] [REMOTE ] THR: Fetching primary data for 2024-12. [2025-09-17T22:05:20.456752] [WARN ] [MAIN ] THS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:05:20.456982] [INFO ] [MAIN ] THS: Wiping existing primary data before full refresh. [2025-09-17T22:05:20.457051] [INFO ] [LOCAL ] THS: Starting deletion of primary data. [2025-09-17T22:05:20.457826] [DEBUG] [LOCAL ] THS: Deleted primary data file. [2025-09-17T22:05:20.457886] [INFO ] [MAIN ] THS: Starting full primary refresh. [2025-09-17T22:05:20.828585] [INFO ] [REMOTE ] THS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:05:21.086242] [INFO ] [REMOTE ] THO: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T22:05:21.091723] [INFO ] [REMOTE ] THO: Full fetch complete (59840 records). [2025-09-17T22:05:21.091843] [DEBUG] [VALIDATOR ] THO: Validating primary data. [2025-09-17T22:05:21.216382] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-11. [2025-09-17T22:05:21.422618] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T22:05:21.503030] [DEBUG] [VALIDATOR ] THO: All expected trading days are present. [2025-09-17T22:05:21.503127] [DEBUG] [VALIDATOR ] THO: Primary data validation passed. [2025-09-17T22:05:21.504054] [INFO ] [MAIN ] THO: Fetched primary data is valid. [2025-09-17T22:05:21.504175] [DEBUG] [LOCAL ] THO: Saving primary data. [2025-09-17T22:05:21.505541] [DEBUG] [LOCAL ] THO: Trimmed 59840 records to 42467 (keeping 200 days of data) [2025-09-17T22:05:21.780125] [DEBUG] [LOCAL ] THO: Primary data saved (42467 records). [2025-09-17T22:05:21.780263] [INFO ] [MAIN ] THO: Full history saved. [2025-09-17T22:05:21.780379] [INFO ] [MAIN ] Update Progress: 2088/2371 symbols completed. THO took 31.9s. Estimated remaining: 41m 23s. Rate: 6.8 symbols/min [2025-09-17T22:05:21.957205] [INFO ] [MAIN ] THW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:05:21.977013] [DEBUG] [LOCAL ] THW: Loaded 19191 existing records from primary storage. [2025-09-17T22:05:21.977167] [INFO ] [MAIN ] THW: Loaded 19191 existing records. [2025-09-17T22:05:22.020901] [INFO ] [REMOTE ] THQ: Fetching primary data for 2024-12. [2025-09-17T22:05:22.158576] [WARN ] [MAIN ] THW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:05:22.158842] [INFO ] [MAIN ] THW: Wiping existing primary data before full refresh. [2025-09-17T22:05:22.158890] [INFO ] [LOCAL ] THW: Starting deletion of primary data. [2025-09-17T22:05:22.159371] [DEBUG] [LOCAL ] THW: Deleted primary data file. [2025-09-17T22:05:22.159432] [INFO ] [MAIN ] THW: Starting full primary refresh. [2025-09-17T22:05:22.522106] [INFO ] [REMOTE ] THW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:05:22.815804] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-01. [2025-09-17T22:05:22.977617] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T22:05:23.258489] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2024-12 (1.24 seconds). [2025-09-17T22:05:23.615794] [INFO ] [REMOTE ] THS: Fetching primary data for 2024-12. [2025-09-17T22:05:23.850478] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T22:05:24.415785] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-02. [2025-09-17T22:05:24.735815] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T22:05:25.215774] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-01. [2025-09-17T22:05:25.531926] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T22:05:26.015763] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-03. [2025-09-17T22:05:26.542042] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T22:05:26.815816] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-11. [2025-09-17T22:05:27.151235] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T22:05:27.615696] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-04. [2025-09-17T22:05:27.649813] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T22:05:28.415769] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-01. [2025-09-17T22:05:28.751145] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T22:05:29.215823] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-05. [2025-09-17T22:05:29.746902] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-01 (1.33 seconds). [2025-09-17T22:05:30.015790] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-02. [2025-09-17T22:05:30.358111] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T22:05:30.815772] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-02. [2025-09-17T22:05:31.041502] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T22:05:31.615828] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-03. [2025-09-17T22:05:32.287038] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T22:05:32.415750] [INFO ] [REMOTE ] THW: Fetching primary data for 2024-12. [2025-09-17T22:05:32.631360] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T22:05:33.215791] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-03. [2025-09-17T22:05:33.795484] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T22:05:34.015831] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-01. [2025-09-17T22:05:34.815818] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-04. [2025-09-17T22:05:34.868537] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T22:05:35.160263] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T22:05:35.615788] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-06. [2025-09-17T22:05:35.954513] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T22:05:36.415900] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-05. [2025-09-17T22:05:36.610005] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-06 (0.99 seconds). [2025-09-17T22:05:37.215787] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-07. [2025-09-17T22:05:37.725212] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-05 (1.31 seconds). [2025-09-17T22:05:38.015776] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-04. [2025-09-17T22:05:38.263924] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-07 (1.05 seconds). [2025-09-17T22:05:38.815824] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-08. [2025-09-17T22:05:39.596524] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-04 (1.58 seconds). [2025-09-17T22:05:39.615740] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-05. [2025-09-17T22:05:39.665690] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T22:05:40.415814] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-02. [2025-09-17T22:05:41.097635] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T22:05:41.215772] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-06. [2025-09-17T22:05:41.461216] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T22:05:42.015792] [INFO ] [REMOTE ] THR: Fetching primary data for 2025-09. [2025-09-17T22:05:42.661546] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T22:05:42.806713] [INFO ] [REMOTE ] THR: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T22:05:42.810086] [INFO ] [REMOTE ] THR: Full fetch complete (28824 records). [2025-09-17T22:05:42.810180] [DEBUG] [VALIDATOR ] THR: Validating primary data. [2025-09-17T22:05:42.822348] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-03. [2025-09-17T22:05:43.230589] [DEBUG] [VALIDATOR ] THR: All expected trading days are present. [2025-09-17T22:05:43.230722] [DEBUG] [VALIDATOR ] THR: Primary data validation passed. [2025-09-17T22:05:43.231470] [INFO ] [MAIN ] THR: Fetched primary data is valid. [2025-09-17T22:05:43.231551] [DEBUG] [LOCAL ] THR: Saving primary data. [2025-09-17T22:05:43.232510] [DEBUG] [LOCAL ] THR: Trimmed 28824 records to 20031 (keeping 200 days of data) [2025-09-17T22:05:43.350271] [DEBUG] [LOCAL ] THR: Primary data saved (20031 records). [2025-09-17T22:05:43.350401] [INFO ] [MAIN ] THR: Full history saved. [2025-09-17T22:05:43.350499] [INFO ] [MAIN ] Update Progress: 2089/2371 symbols completed. THR took 26.8s. Estimated remaining: 41m 16s. Rate: 6.8 symbols/min [2025-09-17T22:05:43.533180] [INFO ] [MAIN ] TIC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:05:43.533349] [DEBUG] [LOCAL ] TIC: No existing data file found in primary storage. [2025-09-17T22:05:43.533390] [WARN ] [MAIN ] TIC: No existing data found, performing full refresh instead. [2025-09-17T22:05:43.533587] [INFO ] [MAIN ] TIC: Wiping existing primary data before full refresh. [2025-09-17T22:05:43.533686] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-17T22:05:43.533748] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-17T22:05:43.533783] [INFO ] [MAIN ] TIC: Starting full primary refresh. [2025-09-17T22:05:43.621676] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-07. [2025-09-17T22:05:43.921878] [INFO ] [REMOTE ] TIC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:05:43.933070] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T22:05:44.415790] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-11. [2025-09-17T22:05:44.700103] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:05:44.700456] [WARN ] [REMOTE ] TIC: No data returned for month 2024-11 [2025-09-17T22:05:44.944803] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-07 (1.32 seconds). [2025-09-17T22:05:45.215788] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-08. [2025-09-17T22:05:46.015788] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-04. [2025-09-17T22:05:46.815786] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-06. [2025-09-17T22:05:46.901937] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-08 (1.69 seconds). [2025-09-17T22:05:47.148860] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T22:05:47.615781] [INFO ] [REMOTE ] TIC: Fetching primary data for 2024-12. [2025-09-17T22:05:47.835537] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:05:47.835927] [WARN ] [REMOTE ] TIC: No data returned for month 2024-12 [2025-09-17T22:05:47.930398] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T22:05:48.415796] [INFO ] [REMOTE ] THS: Fetching primary data for 2025-09. [2025-09-17T22:05:49.215803] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-01. [2025-09-17T22:05:49.723451] [DEBUG] [REMOTE ] TIC: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:05:49.723833] [WARN ] [REMOTE ] TIC: No data returned for month 2025-01 [2025-09-17T22:05:49.745917] [INFO ] [REMOTE ] THS: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T22:05:49.751451] [INFO ] [REMOTE ] THS: Full fetch complete (53236 records). [2025-09-17T22:05:49.751625] [DEBUG] [VALIDATOR ] THS: Validating primary data. [2025-09-17T22:05:50.021001] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-05. [2025-09-17T22:05:50.155401] [DEBUG] [VALIDATOR ] THS: All expected trading days are present. [2025-09-17T22:05:50.155520] [DEBUG] [VALIDATOR ] THS: Primary data validation passed. [2025-09-17T22:05:50.156601] [INFO ] [MAIN ] THS: Fetched primary data is valid. [2025-09-17T22:05:50.156695] [DEBUG] [LOCAL ] THS: Saving primary data. [2025-09-17T22:05:50.158058] [DEBUG] [LOCAL ] THS: Trimmed 53236 records to 37954 (keeping 200 days of data) [2025-09-17T22:05:50.384588] [DEBUG] [LOCAL ] THS: Primary data saved (37954 records). [2025-09-17T22:05:50.384771] [INFO ] [MAIN ] THS: Full history saved. [2025-09-17T22:05:50.384947] [INFO ] [MAIN ] Update Progress: 2090/2371 symbols completed. THS took 30.3s. Estimated remaining: 41m 7s. Rate: 6.8 symbols/min [2025-09-17T22:05:50.559867] [INFO ] [MAIN ] TIMB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:05:50.598614] [DEBUG] [LOCAL ] TIMB: Loaded 37199 existing records from primary storage. [2025-09-17T22:05:50.598812] [INFO ] [MAIN ] TIMB: Loaded 37199 existing records. [2025-09-17T22:05:50.792453] [WARN ] [MAIN ] TIMB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:05:50.792724] [INFO ] [MAIN ] TIMB: Wiping existing primary data before full refresh. [2025-09-17T22:05:50.792789] [INFO ] [LOCAL ] TIMB: Starting deletion of primary data. [2025-09-17T22:05:50.793868] [DEBUG] [LOCAL ] TIMB: Deleted primary data file. [2025-09-17T22:05:50.793970] [INFO ] [MAIN ] TIMB: Starting full primary refresh. [2025-09-17T22:05:50.825261] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-02. [2025-09-17T22:05:51.197499] [INFO ] [REMOTE ] TIMB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:05:51.210915] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T22:05:51.304101] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-02 (0.48 seconds). [2025-09-17T22:05:51.615785] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-06. [2025-09-17T22:05:52.415801] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-11. [2025-09-17T22:05:52.714930] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T22:05:53.215809] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-07. [2025-09-17T22:05:53.900402] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T22:05:54.015822] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2024-12. [2025-09-17T22:05:54.437783] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T22:05:54.815793] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-03. [2025-09-17T22:05:55.222605] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T22:05:55.615833] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-08. [2025-09-17T22:05:55.781582] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-03 (0.97 seconds). [2025-09-17T22:05:56.415871] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-07. [2025-09-17T22:05:56.727620] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-08 (1.11 seconds). [2025-09-17T22:05:57.215837] [INFO ] [REMOTE ] THW: Fetching primary data for 2025-09. [2025-09-17T22:05:57.442315] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T22:05:58.015835] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-08. [2025-09-17T22:05:58.192767] [INFO ] [REMOTE ] THW: Incremental fetch complete for 2025-09 (0.98 seconds). [2025-09-17T22:05:58.196278] [INFO ] [REMOTE ] THW: Full fetch complete (29452 records). [2025-09-17T22:05:58.196376] [DEBUG] [VALIDATOR ] THW: Validating primary data. [2025-09-17T22:05:58.577539] [DEBUG] [VALIDATOR ] THW: All expected trading days are present. [2025-09-17T22:05:58.577662] [DEBUG] [VALIDATOR ] THW: Primary data validation passed. [2025-09-17T22:05:58.578237] [INFO ] [MAIN ] THW: Fetched primary data is valid. [2025-09-17T22:05:58.578281] [DEBUG] [LOCAL ] THW: Saving primary data. [2025-09-17T22:05:58.579076] [DEBUG] [LOCAL ] THW: Trimmed 29452 records to 19172 (keeping 200 days of data) [2025-09-17T22:05:58.713193] [DEBUG] [LOCAL ] THW: Primary data saved (19172 records). [2025-09-17T22:05:58.713348] [INFO ] [MAIN ] THW: Full history saved. [2025-09-17T22:05:58.713439] [INFO ] [MAIN ] Update Progress: 2091/2371 symbols completed. THW took 36.9s. Estimated remaining: 40m 58s. Rate: 6.8 symbols/min [2025-09-17T22:05:58.817621] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-04. [2025-09-17T22:05:58.892480] [INFO ] [MAIN ] TISI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:05:58.898786] [DEBUG] [LOCAL ] TISI: Loaded 3869 existing records from primary storage. [2025-09-17T22:05:58.898892] [INFO ] [MAIN ] TISI: Loaded 3869 existing records. [2025-09-17T22:05:59.079876] [WARN ] [MAIN ] TISI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:05:59.080159] [INFO ] [MAIN ] TISI: Wiping existing primary data before full refresh. [2025-09-17T22:05:59.080211] [INFO ] [LOCAL ] TISI: Starting deletion of primary data. [2025-09-17T22:05:59.080452] [DEBUG] [LOCAL ] TISI: Deleted primary data file. [2025-09-17T22:05:59.080512] [INFO ] [MAIN ] TISI: Starting full primary refresh. [2025-09-17T22:05:59.453186] [INFO ] [REMOTE ] TISI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:05:59.473246] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T22:05:59.615819] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-11. [2025-09-17T22:05:59.908745] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T22:06:00.415790] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-01. [2025-09-17T22:06:00.442428] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-11 (0.83 seconds). [2025-09-17T22:06:01.215795] [INFO ] [REMOTE ] THQ: Fetching primary data for 2025-09. [2025-09-17T22:06:02.015799] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-05. [2025-09-17T22:06:02.298908] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T22:06:02.815813] [INFO ] [REMOTE ] TISI: Fetching primary data for 2024-12. [2025-09-17T22:06:03.060377] [INFO ] [REMOTE ] THQ: Incremental fetch complete for 2025-09 (1.84 seconds). [2025-09-17T22:06:03.063922] [INFO ] [REMOTE ] THQ: Full fetch complete (34605 records). [2025-09-17T22:06:03.064036] [DEBUG] [VALIDATOR ] THQ: Validating primary data. [2025-09-17T22:06:03.448636] [DEBUG] [VALIDATOR ] THQ: All expected trading days are present. [2025-09-17T22:06:03.448745] [DEBUG] [VALIDATOR ] THQ: Primary data validation passed. [2025-09-17T22:06:03.449424] [INFO ] [MAIN ] THQ: Fetched primary data is valid. [2025-09-17T22:06:03.449483] [DEBUG] [LOCAL ] THQ: Saving primary data. [2025-09-17T22:06:03.450361] [DEBUG] [LOCAL ] THQ: Trimmed 34605 records to 24329 (keeping 200 days of data) [2025-09-17T22:06:03.603353] [DEBUG] [LOCAL ] THQ: Primary data saved (24329 records). [2025-09-17T22:06:03.603481] [INFO ] [MAIN ] THQ: Full history saved. [2025-09-17T22:06:03.603566] [INFO ] [MAIN ] Update Progress: 2092/2371 symbols completed. THQ took 48.8s. Estimated remaining: 40m 49s. Rate: 6.8 symbols/min [2025-09-17T22:06:03.627756] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-02. [2025-09-17T22:06:03.787196] [INFO ] [MAIN ] TIXT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:06:03.817227] [DEBUG] [LOCAL ] TIXT: Loaded 30994 existing records from primary storage. [2025-09-17T22:06:03.817355] [INFO ] [MAIN ] TIXT: Loaded 30994 existing records. [2025-09-17T22:06:03.993387] [WARN ] [MAIN ] TIXT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:06:03.993711] [INFO ] [MAIN ] TIXT: Wiping existing primary data before full refresh. [2025-09-17T22:06:03.993769] [INFO ] [LOCAL ] TIXT: Starting deletion of primary data. [2025-09-17T22:06:03.994525] [DEBUG] [LOCAL ] TIXT: Deleted primary data file. [2025-09-17T22:06:03.994585] [INFO ] [MAIN ] TIXT: Starting full primary refresh. [2025-09-17T22:06:04.368816] [INFO ] [REMOTE ] TIXT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:06:04.415779] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-11. [2025-09-17T22:06:04.715358] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2024-12 (1.90 seconds). [2025-09-17T22:06:04.913715] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-05 (2.90 seconds). [2025-09-17T22:06:05.215782] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-06. [2025-09-17T22:06:05.262677] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T22:06:05.319353] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T22:06:06.015807] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-03. [2025-09-17T22:06:06.609346] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T22:06:06.815793] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2024-12. [2025-09-17T22:06:07.483586] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T22:06:07.615750] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-01. [2025-09-17T22:06:08.063191] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-01 (0.45 seconds). [2025-09-17T22:06:08.081938] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2024-12 (1.27 seconds). [2025-09-17T22:06:08.415852] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-04. [2025-09-17T22:06:09.215794] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-07. [2025-09-17T22:06:09.924884] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T22:06:10.015758] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-01. [2025-09-17T22:06:10.815798] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-02. [2025-09-17T22:06:10.861450] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T22:06:11.277328] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-02 (0.46 seconds). [2025-09-17T22:06:11.336257] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T22:06:11.615801] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-02. [2025-09-17T22:06:12.415797] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-05. [2025-09-17T22:06:12.999352] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T22:06:13.215786] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-03. [2025-09-17T22:06:14.015787] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-08. [2025-09-17T22:06:14.255751] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T22:06:14.564927] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T22:06:14.815780] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-04. [2025-09-17T22:06:15.615827] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-06. [2025-09-17T22:06:15.744528] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T22:06:15.802260] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T22:06:16.415790] [INFO ] [REMOTE ] TIC: Fetching primary data for 2025-09. [2025-09-17T22:06:17.126393] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T22:06:17.215792] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-07. [2025-09-17T22:06:18.015809] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-05. [2025-09-17T22:06:18.139260] [INFO ] [REMOTE ] TIC: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T22:06:18.145537] [INFO ] [REMOTE ] TIC: Full fetch complete (36385 records). [2025-09-17T22:06:18.145910] [DEBUG] [VALIDATOR ] TIC: Validating primary data. [2025-09-17T22:06:18.355558] [WARN ] [VALIDATOR ] TIC: Validation failed - insufficient historical data. Have 145 unique days, need 200 days [2025-09-17T22:06:18.356133] [FATAL] [MAIN ] TIC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:06:18.356210] [WARN ] [MAIN ] TIC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:06:18.356328] [INFO ] [LOCAL ] TIC: Starting deletion of primary data. [2025-09-17T22:06:18.356413] [DEBUG] [LOCAL ] TIC: No primary data file found to delete. [2025-09-17T22:06:18.356454] [INFO ] [LOCAL ] TIC: Starting deletion of derivative data. [2025-09-17T22:06:18.356509] [DEBUG] [LOCAL ] TIC: No derivative data file found to delete. [2025-09-17T22:06:18.356599] [INFO ] [MAIN ] Update Progress: 2093/2371 symbols completed. TIC took 35.0s. Estimated remaining: 40m 41s. Rate: 6.8 symbols/min [2025-09-17T22:06:18.536055] [INFO ] [MAIN ] TJX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:06:18.596751] [DEBUG] [LOCAL ] TJX: Loaded 53676 existing records from primary storage. [2025-09-17T22:06:18.596930] [INFO ] [MAIN ] TJX: Loaded 53676 existing records. [2025-09-17T22:06:18.794248] [WARN ] [MAIN ] TJX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:06:18.794779] [INFO ] [MAIN ] TJX: Wiping existing primary data before full refresh. [2025-09-17T22:06:18.794857] [INFO ] [LOCAL ] TJX: Starting deletion of primary data. [2025-09-17T22:06:18.805567] [DEBUG] [LOCAL ] TJX: Deleted primary data file. [2025-09-17T22:06:18.820637] [INFO ] [MAIN ] TJX: Starting full primary refresh. [2025-09-17T22:06:18.820498] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-03. [2025-09-17T22:06:18.837569] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T22:06:18.992273] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-05 (0.98 seconds). [2025-09-17T22:06:19.227042] [INFO ] [REMOTE ] TJX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:06:19.530025] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T22:06:19.615791] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-08. [2025-09-17T22:06:20.415790] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-11. [2025-09-17T22:06:21.079806] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T22:06:21.215770] [INFO ] [REMOTE ] TIMB: Fetching primary data for 2025-09. [2025-09-17T22:06:22.015778] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-04. [2025-09-17T22:06:22.356561] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-11 (1.94 seconds). [2025-09-17T22:06:22.408967] [INFO ] [REMOTE ] TIMB: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T22:06:22.413880] [INFO ] [REMOTE ] TIMB: Full fetch complete (55372 records). [2025-09-17T22:06:22.414033] [DEBUG] [VALIDATOR ] TIMB: Validating primary data. [2025-09-17T22:06:22.768888] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-04 (0.75 seconds). [2025-09-17T22:06:22.822829] [INFO ] [REMOTE ] TJX: Fetching primary data for 2024-12. [2025-09-17T22:06:22.879359] [DEBUG] [VALIDATOR ] TIMB: All expected trading days are present. [2025-09-17T22:06:22.879447] [DEBUG] [VALIDATOR ] TIMB: Primary data validation passed. [2025-09-17T22:06:22.880494] [INFO ] [MAIN ] TIMB: Fetched primary data is valid. [2025-09-17T22:06:22.880558] [DEBUG] [LOCAL ] TIMB: Saving primary data. [2025-09-17T22:06:22.881736] [DEBUG] [LOCAL ] TIMB: Trimmed 55372 records to 37186 (keeping 200 days of data) [2025-09-17T22:06:23.117079] [DEBUG] [LOCAL ] TIMB: Primary data saved (37186 records). [2025-09-17T22:06:23.117259] [INFO ] [MAIN ] TIMB: Full history saved. [2025-09-17T22:06:23.117369] [INFO ] [MAIN ] Update Progress: 2094/2371 symbols completed. TIMB took 32.7s. Estimated remaining: 40m 32s. Rate: 6.8 symbols/min [2025-09-17T22:06:23.294314] [INFO ] [MAIN ] TK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:06:23.332759] [DEBUG] [LOCAL ] TK: Loaded 39986 existing records from primary storage. [2025-09-17T22:06:23.332971] [INFO ] [MAIN ] TK: Loaded 39986 existing records. [2025-09-17T22:06:23.528279] [WARN ] [MAIN ] TK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:06:23.528535] [INFO ] [MAIN ] TK: Wiping existing primary data before full refresh. [2025-09-17T22:06:23.528586] [INFO ] [LOCAL ] TK: Starting deletion of primary data. [2025-09-17T22:06:23.529519] [DEBUG] [LOCAL ] TK: Deleted primary data file. [2025-09-17T22:06:23.529581] [INFO ] [MAIN ] TK: Starting full primary refresh. [2025-09-17T22:06:23.624034] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-06. [2025-09-17T22:06:23.897745] [INFO ] [REMOTE ] TK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:06:24.415800] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-11. [2025-09-17T22:06:24.765022] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2024-12 (1.94 seconds). [2025-09-17T22:06:24.833402] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T22:06:25.215790] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-01. [2025-09-17T22:06:25.892043] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T22:06:26.015772] [INFO ] [REMOTE ] TK: Fetching primary data for 2024-12. [2025-09-17T22:06:26.471863] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T22:06:26.815781] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-02. [2025-09-17T22:06:27.616982] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-05. [2025-09-17T22:06:27.623758] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T22:06:28.069437] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-05 (0.45 seconds). [2025-09-17T22:06:28.231779] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T22:06:28.415800] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-07. [2025-09-17T22:06:29.215849] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-01. [2025-09-17T22:06:29.779742] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T22:06:30.015790] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-08. [2025-09-17T22:06:30.660325] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T22:06:30.815781] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-02. [2025-09-17T22:06:30.883675] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-08 (0.87 seconds). [2025-09-17T22:06:31.615786] [INFO ] [REMOTE ] TIXT: Fetching primary data for 2025-09. [2025-09-17T22:06:31.930317] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T22:06:32.415802] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-06. [2025-09-17T22:06:32.657948] [INFO ] [REMOTE ] TIXT: Incremental fetch complete for 2025-09 (1.04 seconds). [2025-09-17T22:06:32.664325] [INFO ] [REMOTE ] TIXT: Full fetch complete (45154 records). [2025-09-17T22:06:32.664476] [DEBUG] [VALIDATOR ] TIXT: Validating primary data. [2025-09-17T22:06:33.062395] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-06 (0.65 seconds). [2025-09-17T22:06:33.062776] [DEBUG] [VALIDATOR ] TIXT: All expected trading days are present. [2025-09-17T22:06:33.064865] [DEBUG] [VALIDATOR ] TIXT: Primary data validation passed. [2025-09-17T22:06:33.065790] [INFO ] [MAIN ] TIXT: Fetched primary data is valid. [2025-09-17T22:06:33.065856] [DEBUG] [LOCAL ] TIXT: Saving primary data. [2025-09-17T22:06:33.067049] [DEBUG] [LOCAL ] TIXT: Trimmed 45154 records to 31119 (keeping 200 days of data) [2025-09-17T22:06:33.220466] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-03. [2025-09-17T22:06:33.240613] [DEBUG] [LOCAL ] TIXT: Primary data saved (31119 records). [2025-09-17T22:06:33.240741] [INFO ] [MAIN ] TIXT: Full history saved. [2025-09-17T22:06:33.240833] [INFO ] [MAIN ] Update Progress: 2095/2371 symbols completed. TIXT took 29.6s. Estimated remaining: 40m 23s. Rate: 6.8 symbols/min [2025-09-17T22:06:33.411042] [INFO ] [MAIN ] TKC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:06:33.451234] [DEBUG] [LOCAL ] TKC: Loaded 37674 existing records from primary storage. [2025-09-17T22:06:33.451405] [INFO ] [MAIN ] TKC: Loaded 37674 existing records. [2025-09-17T22:06:33.691541] [WARN ] [MAIN ] TKC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:06:33.691835] [INFO ] [MAIN ] TKC: Wiping existing primary data before full refresh. [2025-09-17T22:06:33.691886] [INFO ] [LOCAL ] TKC: Starting deletion of primary data. [2025-09-17T22:06:33.692856] [DEBUG] [LOCAL ] TKC: Deleted primary data file. [2025-09-17T22:06:33.692918] [INFO ] [MAIN ] TKC: Starting full primary refresh. [2025-09-17T22:06:34.021290] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-07. [2025-09-17T22:06:34.053683] [INFO ] [REMOTE ] TKC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:06:34.497769] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-07 (0.48 seconds). [2025-09-17T22:06:34.815785] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-08. [2025-09-17T22:06:35.288028] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-08 (0.47 seconds). [2025-09-17T22:06:35.546009] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-03 (2.33 seconds). [2025-09-17T22:06:35.615795] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-03. [2025-09-17T22:06:36.415827] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-11. [2025-09-17T22:06:36.903858] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-03 (1.29 seconds). [2025-09-17T22:06:37.215749] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-04. [2025-09-17T22:06:37.577025] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-11 (1.16 seconds). [2025-09-17T22:06:38.015789] [INFO ] [REMOTE ] TKC: Fetching primary data for 2024-12. [2025-09-17T22:06:38.721305] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T22:06:38.815816] [INFO ] [REMOTE ] TISI: Fetching primary data for 2025-09. [2025-09-17T22:06:39.177955] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2024-12 (1.16 seconds). [2025-09-17T22:06:39.188277] [INFO ] [REMOTE ] TISI: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T22:06:39.189408] [INFO ] [REMOTE ] TISI: Full fetch complete (5058 records). [2025-09-17T22:06:39.189486] [DEBUG] [VALIDATOR ] TISI: Validating primary data. [2025-09-17T22:06:39.588295] [DEBUG] [VALIDATOR ] TISI: All expected trading days are present. [2025-09-17T22:06:39.588390] [DEBUG] [VALIDATOR ] TISI: Primary data validation passed. [2025-09-17T22:06:39.588574] [INFO ] [MAIN ] TISI: Fetched primary data is valid. [2025-09-17T22:06:39.588615] [DEBUG] [LOCAL ] TISI: Saving primary data. [2025-09-17T22:06:39.589372] [DEBUG] [LOCAL ] TISI: Trimmed 5058 records to 3865 (keeping 200 days of data) [2025-09-17T22:06:39.612140] [DEBUG] [LOCAL ] TISI: Primary data saved (3865 records). [2025-09-17T22:06:39.612260] [INFO ] [MAIN ] TISI: Full history saved. [2025-09-17T22:06:39.612368] [INFO ] [MAIN ] Update Progress: 2096/2371 symbols completed. TISI took 40.9s. Estimated remaining: 40m 14s. Rate: 6.8 symbols/min [2025-09-17T22:06:39.622833] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-04. [2025-09-17T22:06:39.795082] [INFO ] [MAIN ] TKO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:06:39.854505] [DEBUG] [LOCAL ] TKO: Loaded 44448 existing records from primary storage. [2025-09-17T22:06:39.854706] [INFO ] [MAIN ] TKO: Loaded 44448 existing records. [2025-09-17T22:06:40.048354] [WARN ] [MAIN ] TKO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:06:40.048756] [INFO ] [MAIN ] TKO: Wiping existing primary data before full refresh. [2025-09-17T22:06:40.048842] [INFO ] [LOCAL ] TKO: Starting deletion of primary data. [2025-09-17T22:06:40.050017] [DEBUG] [LOCAL ] TKO: Deleted primary data file. [2025-09-17T22:06:40.050096] [INFO ] [MAIN ] TKO: Starting full primary refresh. [2025-09-17T22:06:40.417206] [INFO ] [REMOTE ] TKO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:06:40.417373] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-05. [2025-09-17T22:06:41.215789] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-01. [2025-09-17T22:06:41.367608] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T22:06:41.931908] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T22:06:42.015760] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-06. [2025-09-17T22:06:42.668436] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T22:06:42.815794] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-05. [2025-09-17T22:06:43.498542] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T22:06:43.615779] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-07. [2025-09-17T22:06:44.415795] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-02. [2025-09-17T22:06:44.836766] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-05 (2.02 seconds). [2025-09-17T22:06:45.157174] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T22:06:45.215736] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-08. [2025-09-17T22:06:45.644003] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T22:06:46.015780] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-03. [2025-09-17T22:06:46.689146] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T22:06:46.815779] [INFO ] [REMOTE ] TK: Fetching primary data for 2025-09. [2025-09-17T22:06:47.625192] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-11. [2025-09-17T22:06:47.630294] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T22:06:47.901297] [INFO ] [REMOTE ] TK: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T22:06:47.907901] [INFO ] [REMOTE ] TK: Full fetch complete (57338 records). [2025-09-17T22:06:47.908019] [DEBUG] [VALIDATOR ] TK: Validating primary data. [2025-09-17T22:06:48.302710] [DEBUG] [VALIDATOR ] TK: All expected trading days are present. [2025-09-17T22:06:48.302800] [DEBUG] [VALIDATOR ] TK: Primary data validation passed. [2025-09-17T22:06:48.303718] [INFO ] [MAIN ] TK: Fetched primary data is valid. [2025-09-17T22:06:48.303793] [DEBUG] [LOCAL ] TK: Saving primary data. [2025-09-17T22:06:48.305115] [DEBUG] [LOCAL ] TK: Trimmed 57338 records to 39998 (keeping 200 days of data) [2025-09-17T22:06:48.418890] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-04. [2025-09-17T22:06:48.538620] [DEBUG] [LOCAL ] TK: Primary data saved (39998 records). [2025-09-17T22:06:48.538831] [INFO ] [MAIN ] TK: Full history saved. [2025-09-17T22:06:48.539035] [INFO ] [MAIN ] Update Progress: 2097/2371 symbols completed. TK took 25.4s. Estimated remaining: 40m 5s. Rate: 6.8 symbols/min [2025-09-17T22:06:48.714070] [INFO ] [MAIN ] TKR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:06:48.756615] [DEBUG] [LOCAL ] TKR: Loaded 40115 existing records from primary storage. [2025-09-17T22:06:48.756881] [INFO ] [MAIN ] TKR: Loaded 40115 existing records. [2025-09-17T22:06:48.964699] [WARN ] [MAIN ] TKR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:06:48.965393] [INFO ] [MAIN ] TKR: Wiping existing primary data before full refresh. [2025-09-17T22:06:48.965460] [INFO ] [LOCAL ] TKR: Starting deletion of primary data. [2025-09-17T22:06:48.966637] [DEBUG] [LOCAL ] TKR: Deleted primary data file. [2025-09-17T22:06:48.966833] [INFO ] [MAIN ] TKR: Starting full primary refresh. [2025-09-17T22:06:49.223262] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-06. [2025-09-17T22:06:49.478465] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T22:06:49.578566] [INFO ] [REMOTE ] TKR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:06:50.021281] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-11. [2025-09-17T22:06:50.032001] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T22:06:50.815797] [INFO ] [REMOTE ] TKO: Fetching primary data for 2024-12. [2025-09-17T22:06:50.881553] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T22:06:51.615843] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-05. [2025-09-17T22:06:51.747177] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T22:06:52.415830] [INFO ] [REMOTE ] TKR: Fetching primary data for 2024-12. [2025-09-17T22:06:52.489108] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T22:06:52.695918] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T22:06:53.215804] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-06. [2025-09-17T22:06:53.515412] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T22:06:54.015801] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-07. [2025-09-17T22:06:54.713074] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T22:06:54.815748] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-07. [2025-09-17T22:06:55.615756] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-01. [2025-09-17T22:06:55.931711] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T22:06:56.312232] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-07 (1.50 seconds). [2025-09-17T22:06:56.415774] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-08. [2025-09-17T22:06:57.215794] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-01. [2025-09-17T22:06:57.546299] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-01 (1.93 seconds). [2025-09-17T22:06:57.980530] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T22:06:58.015734] [INFO ] [REMOTE ] TKC: Fetching primary data for 2025-09. [2025-09-17T22:06:58.680558] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-01 (1.46 seconds). [2025-09-17T22:06:58.815777] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-02. [2025-09-17T22:06:59.108195] [INFO ] [REMOTE ] TKC: Incremental fetch complete for 2025-09 (1.09 seconds). [2025-09-17T22:06:59.114066] [INFO ] [REMOTE ] TKC: Full fetch complete (50743 records). [2025-09-17T22:06:59.114191] [DEBUG] [VALIDATOR ] TKC: Validating primary data. [2025-09-17T22:06:59.510919] [DEBUG] [VALIDATOR ] TKC: All expected trading days are present. [2025-09-17T22:06:59.511006] [DEBUG] [VALIDATOR ] TKC: Primary data validation passed. [2025-09-17T22:06:59.512010] [INFO ] [MAIN ] TKC: Fetched primary data is valid. [2025-09-17T22:06:59.512077] [DEBUG] [LOCAL ] TKC: Saving primary data. [2025-09-17T22:06:59.513317] [DEBUG] [LOCAL ] TKC: Trimmed 50743 records to 37765 (keeping 200 days of data) [2025-09-17T22:06:59.616874] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-02. [2025-09-17T22:06:59.755158] [DEBUG] [LOCAL ] TKC: Primary data saved (37765 records). [2025-09-17T22:06:59.755337] [INFO ] [MAIN ] TKC: Full history saved. [2025-09-17T22:06:59.756852] [INFO ] [MAIN ] Update Progress: 2098/2371 symbols completed. TKC took 26.5s. Estimated remaining: 39m 57s. Rate: 6.8 symbols/min [2025-09-17T22:06:59.927890] [INFO ] [MAIN ] TLK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:06:59.928055] [DEBUG] [LOCAL ] TLK: No existing data file found in primary storage. [2025-09-17T22:06:59.928091] [WARN ] [MAIN ] TLK: No existing data found, performing full refresh instead. [2025-09-17T22:06:59.928270] [INFO ] [MAIN ] TLK: Wiping existing primary data before full refresh. [2025-09-17T22:06:59.928312] [INFO ] [LOCAL ] TLK: Starting deletion of primary data. [2025-09-17T22:06:59.928352] [DEBUG] [LOCAL ] TLK: No primary data file found to delete. [2025-09-17T22:06:59.928397] [INFO ] [MAIN ] TLK: Starting full primary refresh. [2025-09-17T22:07:00.283045] [INFO ] [REMOTE ] TLK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:07:00.402918] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T22:07:00.415735] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-03. [2025-09-17T22:07:01.215811] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-08. [2025-09-17T22:07:01.608533] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T22:07:02.015844] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-11. [2025-09-17T22:07:02.142920] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-03 (1.73 seconds). [2025-09-17T22:07:02.815811] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-03. [2025-09-17T22:07:03.089617] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T22:07:03.515070] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T22:07:03.615762] [INFO ] [REMOTE ] TLK: Fetching primary data for 2024-12. [2025-09-17T22:07:04.415791] [INFO ] [REMOTE ] TJX: Fetching primary data for 2025-09. [2025-09-17T22:07:04.629118] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T22:07:04.687402] [INFO ] [REMOTE ] TJX: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-17T22:07:04.695462] [INFO ] [REMOTE ] TJX: Full fetch complete (77542 records). [2025-09-17T22:07:04.695634] [DEBUG] [VALIDATOR ] TJX: Validating primary data. [2025-09-17T22:07:05.111942] [DEBUG] [VALIDATOR ] TJX: All expected trading days are present. [2025-09-17T22:07:05.112077] [DEBUG] [VALIDATOR ] TJX: Primary data validation passed. [2025-09-17T22:07:05.113290] [INFO ] [MAIN ] TJX: Fetched primary data is valid. [2025-09-17T22:07:05.113412] [DEBUG] [LOCAL ] TJX: Saving primary data. [2025-09-17T22:07:05.137823] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2024-12 (1.52 seconds). [2025-09-17T22:07:05.146157] [DEBUG] [LOCAL ] TJX: Trimmed 77542 records to 53676 (keeping 200 days of data) [2025-09-17T22:07:05.220158] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-01. [2025-09-17T22:07:05.516192] [DEBUG] [LOCAL ] TJX: Primary data saved (53676 records). [2025-09-17T22:07:05.516525] [INFO ] [MAIN ] TJX: Full history saved. [2025-09-17T22:07:05.516669] [INFO ] [MAIN ] Update Progress: 2099/2371 symbols completed. TJX took 47.2s. Estimated remaining: 39m 47s. Rate: 6.8 symbols/min [2025-09-17T22:07:05.687319] [INFO ] [MAIN ] TLYS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:07:05.708556] [DEBUG] [LOCAL ] TLYS: Loaded 17143 existing records from primary storage. [2025-09-17T22:07:05.708796] [INFO ] [MAIN ] TLYS: Loaded 17143 existing records. [2025-09-17T22:07:05.887273] [WARN ] [MAIN ] TLYS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:07:05.887586] [INFO ] [MAIN ] TLYS: Wiping existing primary data before full refresh. [2025-09-17T22:07:05.887634] [INFO ] [LOCAL ] TLYS: Starting deletion of primary data. [2025-09-17T22:07:05.888621] [DEBUG] [LOCAL ] TLYS: Deleted primary data file. [2025-09-17T22:07:05.888711] [INFO ] [MAIN ] TLYS: Starting full primary refresh. [2025-09-17T22:07:06.021040] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-04. [2025-09-17T22:07:06.253865] [INFO ] [REMOTE ] TLYS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:07:06.744009] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-01 (1.52 seconds). [2025-09-17T22:07:06.815774] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-02. [2025-09-17T22:07:07.615755] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-04. [2025-09-17T22:07:07.955667] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T22:07:08.075370] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-04 (2.05 seconds). [2025-09-17T22:07:08.415756] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-05. [2025-09-17T22:07:09.215844] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-03. [2025-09-17T22:07:09.272246] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T22:07:09.743342] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T22:07:10.015802] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-11. [2025-09-17T22:07:10.765071] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T22:07:10.815742] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-05. [2025-09-17T22:07:10.955991] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T22:07:11.615770] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2024-12. [2025-09-17T22:07:12.209762] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2024-12 (0.59 seconds). [2025-09-17T22:07:12.310565] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T22:07:12.415759] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-01. [2025-09-17T22:07:13.212068] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T22:07:13.215680] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-02. [2025-09-17T22:07:13.993447] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-02 (0.78 seconds). [2025-09-17T22:07:14.015733] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-03. [2025-09-17T22:07:14.815751] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-06. [2025-09-17T22:07:14.922277] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T22:07:15.615785] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-04. [2025-09-17T22:07:16.202963] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T22:07:16.415772] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-04. [2025-09-17T22:07:16.469607] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-04 (0.85 seconds). [2025-09-17T22:07:17.215778] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-05. [2025-09-17T22:07:17.969741] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T22:07:18.015759] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-06. [2025-09-17T22:07:18.340762] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-05 (1.12 seconds). [2025-09-17T22:07:18.815800] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-06. [2025-09-17T22:07:19.259609] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T22:07:19.615777] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-07. [2025-09-17T22:07:20.257376] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-06 (1.44 seconds). [2025-09-17T22:07:20.415774] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-07. [2025-09-17T22:07:21.215779] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-07. [2025-09-17T22:07:21.255954] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T22:07:21.933529] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T22:07:22.002923] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T22:07:22.015678] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-08. [2025-09-17T22:07:22.815788] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-05. [2025-09-17T22:07:22.859793] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T22:07:23.615803] [INFO ] [REMOTE ] TLYS: Fetching primary data for 2025-09. [2025-09-17T22:07:24.250373] [INFO ] [REMOTE ] TLYS: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T22:07:24.253193] [INFO ] [REMOTE ] TLYS: Full fetch complete (21975 records). [2025-09-17T22:07:24.253277] [DEBUG] [VALIDATOR ] TLYS: Validating primary data. [2025-09-17T22:07:24.418269] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-08. [2025-09-17T22:07:24.698436] [DEBUG] [VALIDATOR ] TLYS: All expected trading days are present. [2025-09-17T22:07:24.697731] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-05 (1.88 seconds). [2025-09-17T22:07:24.698598] [DEBUG] [VALIDATOR ] TLYS: Primary data validation passed. [2025-09-17T22:07:24.707227] [INFO ] [MAIN ] TLYS: Fetched primary data is valid. [2025-09-17T22:07:24.707550] [DEBUG] [LOCAL ] TLYS: Saving primary data. [2025-09-17T22:07:24.708784] [DEBUG] [LOCAL ] TLYS: Trimmed 21975 records to 17016 (keeping 200 days of data) [2025-09-17T22:07:24.811468] [DEBUG] [LOCAL ] TLYS: Primary data saved (17016 records). [2025-09-17T22:07:24.811611] [INFO ] [MAIN ] TLYS: Full history saved. [2025-09-17T22:07:24.811721] [INFO ] [MAIN ] Update Progress: 2100/2371 symbols completed. TLYS took 19.3s. Estimated remaining: 39m 40s. Rate: 6.8 symbols/min [2025-09-17T22:07:24.981720] [INFO ] [MAIN ] TM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:07:25.021127] [DEBUG] [LOCAL ] TM: Loaded 37137 existing records from primary storage. [2025-09-17T22:07:25.021264] [INFO ] [MAIN ] TM: Loaded 37137 existing records. [2025-09-17T22:07:25.200284] [WARN ] [MAIN ] TM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:07:25.200576] [INFO ] [MAIN ] TM: Wiping existing primary data before full refresh. [2025-09-17T22:07:25.200663] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-17T22:07:25.201604] [DEBUG] [LOCAL ] TM: Deleted primary data file. [2025-09-17T22:07:25.201700] [INFO ] [MAIN ] TM: Starting full primary refresh. [2025-09-17T22:07:25.221045] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-08. [2025-09-17T22:07:25.567097] [INFO ] [REMOTE ] TM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:07:26.016145] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-11. [2025-09-17T22:07:26.019117] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T22:07:26.054807] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T22:07:26.815779] [INFO ] [REMOTE ] TKR: Fetching primary data for 2025-09. [2025-09-17T22:07:27.615783] [INFO ] [REMOTE ] TKO: Fetching primary data for 2025-09. [2025-09-17T22:07:27.680263] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T22:07:28.212069] [INFO ] [REMOTE ] TKO: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T22:07:28.218090] [INFO ] [REMOTE ] TKO: Full fetch complete (64470 records). [2025-09-17T22:07:28.218222] [DEBUG] [VALIDATOR ] TKO: Validating primary data. [2025-09-17T22:07:28.421838] [INFO ] [REMOTE ] TM: Fetching primary data for 2024-12. [2025-09-17T22:07:28.517039] [INFO ] [REMOTE ] TKR: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T22:07:28.561255] [INFO ] [REMOTE ] TKR: Full fetch complete (57091 records). [2025-09-17T22:07:28.571682] [DEBUG] [VALIDATOR ] TKR: Validating primary data. [2025-09-17T22:07:28.763560] [DEBUG] [VALIDATOR ] TKO: All expected trading days are present. [2025-09-17T22:07:28.791932] [DEBUG] [VALIDATOR ] TKO: Primary data validation passed. [2025-09-17T22:07:28.811503] [INFO ] [MAIN ] TKO: Fetched primary data is valid. [2025-09-17T22:07:28.812366] [DEBUG] [LOCAL ] TKO: Saving primary data. [2025-09-17T22:07:28.917846] [DEBUG] [LOCAL ] TKO: Trimmed 64470 records to 44407 (keeping 200 days of data) [2025-09-17T22:07:29.158275] [DEBUG] [VALIDATOR ] TKR: All expected trading days are present. [2025-09-17T22:07:29.158669] [DEBUG] [VALIDATOR ] TKR: Primary data validation passed. [2025-09-17T22:07:29.160149] [INFO ] [MAIN ] TKR: Fetched primary data is valid. [2025-09-17T22:07:29.160228] [DEBUG] [LOCAL ] TKR: Saving primary data. [2025-09-17T22:07:29.165358] [DEBUG] [LOCAL ] TKR: Trimmed 57091 records to 40203 (keeping 200 days of data) [2025-09-17T22:07:29.222614] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-06. [2025-09-17T22:07:29.573282] [DEBUG] [LOCAL ] TKR: Primary data saved (40203 records). [2025-09-17T22:07:29.574047] [INFO ] [MAIN ] TKR: Full history saved. [2025-09-17T22:07:29.574219] [INFO ] [MAIN ] Update Progress: 2101/2371 symbols completed. TKR took 41.0s. Estimated remaining: 39m 31s. Rate: 6.8 symbols/min [2025-09-17T22:07:29.771389] [INFO ] [MAIN ] TME: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:07:29.820837] [DEBUG] [LOCAL ] TKO: Primary data saved (44407 records). [2025-09-17T22:07:29.821077] [INFO ] [MAIN ] TKO: Full history saved. [2025-09-17T22:07:29.821303] [INFO ] [MAIN ] Update Progress: 2102/2371 symbols completed. TKO took 50.2s. Estimated remaining: 39m 21s. Rate: 6.8 symbols/min [2025-09-17T22:07:30.033792] [INFO ] [MAIN ] TMHC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:07:30.032278] [DEBUG] [LOCAL ] TME: Loaded 53201 existing records from primary storage. [2025-09-17T22:07:30.033938] [INFO ] [MAIN ] TME: Loaded 53201 existing records. [2025-09-17T22:07:30.221202] [WARN ] [MAIN ] TME: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:07:30.221717] [INFO ] [MAIN ] TME: Wiping existing primary data before full refresh. [2025-09-17T22:07:30.221792] [INFO ] [LOCAL ] TME: Starting deletion of primary data. [2025-09-17T22:07:30.223079] [DEBUG] [LOCAL ] TME: Deleted primary data file. [2025-09-17T22:07:30.223139] [INFO ] [MAIN ] TME: Starting full primary refresh. [2025-09-17T22:07:30.391556] [DEBUG] [LOCAL ] TMHC: Loaded 45641 existing records from primary storage. [2025-09-17T22:07:30.380247] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T22:07:30.396909] [INFO ] [MAIN ] TMHC: Loaded 45641 existing records. [2025-09-17T22:07:30.445250] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-01. [2025-09-17T22:07:30.848055] [WARN ] [MAIN ] TMHC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:07:30.853904] [INFO ] [REMOTE ] TME: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:07:30.854623] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-11. [2025-09-17T22:07:30.854365] [INFO ] [MAIN ] TMHC: Wiping existing primary data before full refresh. [2025-09-17T22:07:30.854825] [INFO ] [LOCAL ] TMHC: Starting deletion of primary data. [2025-09-17T22:07:30.856855] [DEBUG] [LOCAL ] TMHC: Deleted primary data file. [2025-09-17T22:07:30.856920] [INFO ] [MAIN ] TMHC: Starting full primary refresh. [2025-09-17T22:07:31.060917] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T22:07:31.253872] [INFO ] [REMOTE ] TMHC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:07:31.615753] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-07. [2025-09-17T22:07:32.016523] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T22:07:32.210820] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T22:07:32.415785] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-11. [2025-09-17T22:07:32.908105] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T22:07:33.215849] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-02. [2025-09-17T22:07:34.015973] [INFO ] [REMOTE ] TME: Fetching primary data for 2024-12. [2025-09-17T22:07:34.016886] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T22:07:34.746961] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T22:07:34.815790] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-08. [2025-09-17T22:07:35.615851] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2024-12. [2025-09-17T22:07:35.837167] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T22:07:36.415754] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-03. [2025-09-17T22:07:36.442178] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T22:07:37.182749] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T22:07:37.215788] [INFO ] [REMOTE ] TLK: Fetching primary data for 2025-09. [2025-09-17T22:07:37.922255] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T22:07:38.015782] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-01. [2025-09-17T22:07:38.503523] [INFO ] [REMOTE ] TLK: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T22:07:38.509382] [INFO ] [REMOTE ] TLK: Full fetch complete (57444 records). [2025-09-17T22:07:38.509579] [DEBUG] [VALIDATOR ] TLK: Validating primary data. [2025-09-17T22:07:38.824407] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-04. [2025-09-17T22:07:38.956745] [DEBUG] [VALIDATOR ] TLK: All expected trading days are present. [2025-09-17T22:07:38.956838] [DEBUG] [VALIDATOR ] TLK: Primary data validation passed. [2025-09-17T22:07:38.957800] [INFO ] [MAIN ] TLK: Fetched primary data is valid. [2025-09-17T22:07:38.957865] [DEBUG] [LOCAL ] TLK: Saving primary data. [2025-09-17T22:07:38.959166] [DEBUG] [LOCAL ] TLK: Trimmed 57444 records to 39982 (keeping 200 days of data) [2025-09-17T22:07:39.222685] [DEBUG] [LOCAL ] TLK: Primary data saved (39982 records). [2025-09-17T22:07:39.222845] [INFO ] [MAIN ] TLK: Full history saved. [2025-09-17T22:07:39.222951] [INFO ] [MAIN ] Update Progress: 2103/2371 symbols completed. TLK took 39.5s. Estimated remaining: 39m 12s. Rate: 6.8 symbols/min [2025-09-17T22:07:39.412975] [INFO ] [MAIN ] TMO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:07:39.444336] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T22:07:39.511817] [DEBUG] [LOCAL ] TMO: Loaded 52386 existing records from primary storage. [2025-09-17T22:07:39.512052] [INFO ] [MAIN ] TMO: Loaded 52386 existing records. [2025-09-17T22:07:39.621911] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-02. [2025-09-17T22:07:39.704806] [WARN ] [MAIN ] TMO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:07:39.705082] [INFO ] [MAIN ] TMO: Wiping existing primary data before full refresh. [2025-09-17T22:07:39.705131] [INFO ] [LOCAL ] TMO: Starting deletion of primary data. [2025-09-17T22:07:39.706507] [DEBUG] [LOCAL ] TMO: Deleted primary data file. [2025-09-17T22:07:39.706568] [INFO ] [MAIN ] TMO: Starting full primary refresh. [2025-09-17T22:07:40.082472] [INFO ] [REMOTE ] TMO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:07:40.415780] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-11. [2025-09-17T22:07:40.535353] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T22:07:40.813220] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T22:07:41.215807] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-03. [2025-09-17T22:07:42.015800] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-05. [2025-09-17T22:07:42.233774] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T22:07:42.815873] [INFO ] [REMOTE ] TMO: Fetching primary data for 2024-12. [2025-09-17T22:07:42.928543] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T22:07:43.218216] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-05 (1.20 seconds). [2025-09-17T22:07:43.615814] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-04. [2025-09-17T22:07:44.415785] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-01. [2025-09-17T22:07:44.698547] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T22:07:45.215839] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-06. [2025-09-17T22:07:45.321124] [DEBUG] [REMOTE ] TM: Error fetching primary data for 2025-06: 'API call returned an empty response.' [2025-09-17T22:07:45.321470] [WARN ] [REMOTE ] TM: No data returned for month 2025-06 [2025-09-17T22:07:45.355116] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T22:07:46.015862] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-07. [2025-09-17T22:07:46.203411] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T22:07:46.815839] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-05. [2025-09-17T22:07:47.615772] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-01. [2025-09-17T22:07:47.826613] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T22:07:47.989432] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-05 (1.17 seconds). [2025-09-17T22:07:48.415778] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-08. [2025-09-17T22:07:49.142039] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T22:07:49.215737] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-02. [2025-09-17T22:07:49.992767] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T22:07:50.015734] [INFO ] [REMOTE ] TM: Fetching primary data for 2025-09. [2025-09-17T22:07:50.815767] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-02. [2025-09-17T22:07:50.899199] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-02 (1.68 seconds). [2025-09-17T22:07:51.364030] [INFO ] [REMOTE ] TM: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T22:07:51.368143] [INFO ] [REMOTE ] TM: Full fetch complete (47581 records). [2025-09-17T22:07:51.368249] [DEBUG] [VALIDATOR ] TM: Validating primary data. [2025-09-17T22:07:51.562801] [WARN ] [VALIDATOR ] TM: Validation failed - insufficient historical data. Have 180 unique days, need 200 days [2025-09-17T22:07:51.563509] [FATAL] [MAIN ] TM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:07:51.563588] [WARN ] [MAIN ] TM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:07:51.563684] [INFO ] [LOCAL ] TM: Starting deletion of primary data. [2025-09-17T22:07:51.563769] [DEBUG] [LOCAL ] TM: No primary data file found to delete. [2025-09-17T22:07:51.563809] [INFO ] [LOCAL ] TM: Starting deletion of derivative data. [2025-09-17T22:07:51.564299] [DEBUG] [LOCAL ] TM: Deleted derivative data file. [2025-09-17T22:07:51.564434] [INFO ] [MAIN ] Update Progress: 2104/2371 symbols completed. TM took 26.8s. Estimated remaining: 39m 4s. Rate: 6.8 symbols/min [2025-09-17T22:07:51.622489] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-03. [2025-09-17T22:07:51.762772] [INFO ] [MAIN ] TNC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:07:51.782047] [DEBUG] [LOCAL ] TNC: Loaded 15540 existing records from primary storage. [2025-09-17T22:07:51.782192] [INFO ] [MAIN ] TNC: Loaded 15540 existing records. [2025-09-17T22:07:51.980588] [WARN ] [MAIN ] TNC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:07:51.980906] [INFO ] [MAIN ] TNC: Wiping existing primary data before full refresh. [2025-09-17T22:07:51.980962] [INFO ] [LOCAL ] TNC: Starting deletion of primary data. [2025-09-17T22:07:51.981403] [DEBUG] [LOCAL ] TNC: Deleted primary data file. [2025-09-17T22:07:51.981476] [INFO ] [MAIN ] TNC: Starting full primary refresh. [2025-09-17T22:07:52.345932] [INFO ] [REMOTE ] TNC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:07:52.415977] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-06. [2025-09-17T22:07:52.421450] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T22:07:53.215794] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-03. [2025-09-17T22:07:53.293476] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T22:07:53.807102] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T22:07:54.015804] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-11. [2025-09-17T22:07:54.815786] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-04. [2025-09-17T22:07:54.974864] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T22:07:55.121376] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T22:07:55.615790] [INFO ] [REMOTE ] TNC: Fetching primary data for 2024-12. [2025-09-17T22:07:56.415765] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-04. [2025-09-17T22:07:56.516761] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2024-12 (0.90 seconds). [2025-09-17T22:07:56.835755] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-04 (2.02 seconds). [2025-09-17T22:07:57.215792] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-05. [2025-09-17T22:07:57.824863] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-04 (1.41 seconds). [2025-09-17T22:07:58.015804] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-01. [2025-09-17T22:07:58.806611] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T22:07:58.817292] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-07. [2025-09-17T22:07:59.164077] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-01 (1.15 seconds). [2025-09-17T22:07:59.615795] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-06. [2025-09-17T22:08:00.415726] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-05. [2025-09-17T22:08:00.723436] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T22:08:01.215842] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-02. [2025-09-17T22:08:01.531289] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T22:08:02.015810] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-08. [2025-09-17T22:08:02.175233] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-02 (0.96 seconds). [2025-09-17T22:08:02.452075] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-17T22:08:02.815795] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-06. [2025-09-17T22:08:03.323799] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T22:08:03.615777] [INFO ] [REMOTE ] TMHC: Fetching primary data for 2025-09. [2025-09-17T22:08:04.415775] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-07. [2025-09-17T22:08:04.921002] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T22:08:05.045718] [INFO ] [REMOTE ] TMHC: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T22:08:05.052040] [INFO ] [REMOTE ] TMHC: Full fetch complete (65552 records). [2025-09-17T22:08:05.052198] [DEBUG] [VALIDATOR ] TMHC: Validating primary data. [2025-09-17T22:08:05.216256] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-07. [2025-09-17T22:08:05.484893] [DEBUG] [VALIDATOR ] TMHC: All expected trading days are present. [2025-09-17T22:08:05.485023] [DEBUG] [VALIDATOR ] TMHC: Primary data validation passed. [2025-09-17T22:08:05.486391] [INFO ] [MAIN ] TMHC: Fetched primary data is valid. [2025-09-17T22:08:05.486488] [DEBUG] [LOCAL ] TMHC: Saving primary data. [2025-09-17T22:08:05.491838] [DEBUG] [LOCAL ] TMHC: Trimmed 65552 records to 45617 (keeping 200 days of data) [2025-09-17T22:08:05.783577] [DEBUG] [LOCAL ] TMHC: Primary data saved (45617 records). [2025-09-17T22:08:05.783739] [INFO ] [MAIN ] TMHC: Full history saved. [2025-09-17T22:08:05.785377] [INFO ] [MAIN ] Update Progress: 2105/2371 symbols completed. TMHC took 36.0s. Estimated remaining: 38m 56s. Rate: 6.8 symbols/min [2025-09-17T22:08:06.022136] [INFO ] [MAIN ] TNET: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:08:06.022266] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-03. [2025-09-17T22:08:06.062442] [DEBUG] [LOCAL ] TNET: Loaded 29245 existing records from primary storage. [2025-09-17T22:08:06.062727] [INFO ] [MAIN ] TNET: Loaded 29245 existing records. [2025-09-17T22:08:06.250534] [WARN ] [MAIN ] TNET: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:08:06.250979] [INFO ] [MAIN ] TNET: Wiping existing primary data before full refresh. [2025-09-17T22:08:06.251130] [INFO ] [LOCAL ] TNET: Starting deletion of primary data. [2025-09-17T22:08:06.252023] [DEBUG] [LOCAL ] TNET: Deleted primary data file. [2025-09-17T22:08:06.252087] [INFO ] [MAIN ] TNET: Starting full primary refresh. [2025-09-17T22:08:06.580024] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-07 (2.16 seconds). [2025-09-17T22:08:06.667374] [INFO ] [REMOTE ] TNET: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:08:06.815790] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-11. [2025-09-17T22:08:06.965958] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T22:08:07.076072] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T22:08:07.615789] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-04. [2025-09-17T22:08:07.732301] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T22:08:08.415794] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-08. [2025-09-17T22:08:08.755909] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T22:08:09.215798] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-05. [2025-09-17T22:08:10.015768] [INFO ] [REMOTE ] TNET: Fetching primary data for 2024-12. [2025-09-17T22:08:10.146933] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-17T22:08:10.312154] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-08 (1.90 seconds). [2025-09-17T22:08:10.815795] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-06. [2025-09-17T22:08:10.871585] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T22:08:11.474884] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T22:08:11.615756] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-01. [2025-09-17T22:08:12.415755] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-08. [2025-09-17T22:08:12.791138] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T22:08:13.215797] [INFO ] [REMOTE ] TMO: Fetching primary data for 2025-09. [2025-09-17T22:08:13.885519] [INFO ] [REMOTE ] TMO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T22:08:13.892781] [INFO ] [REMOTE ] TMO: Full fetch complete (75384 records). [2025-09-17T22:08:13.892938] [DEBUG] [VALIDATOR ] TMO: Validating primary data. [2025-09-17T22:08:14.018362] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-07. [2025-09-17T22:08:14.305740] [DEBUG] [VALIDATOR ] TMO: All expected trading days are present. [2025-09-17T22:08:14.305847] [DEBUG] [VALIDATOR ] TMO: Primary data validation passed. [2025-09-17T22:08:14.307216] [INFO ] [MAIN ] TMO: Fetched primary data is valid. [2025-09-17T22:08:14.307328] [DEBUG] [LOCAL ] TMO: Saving primary data. [2025-09-17T22:08:14.339928] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-08 (1.92 seconds). [2025-09-17T22:08:14.338437] [DEBUG] [LOCAL ] TMO: Trimmed 75384 records to 52380 (keeping 200 days of data) [2025-09-17T22:08:14.689398] [DEBUG] [LOCAL ] TMO: Primary data saved (52380 records). [2025-09-17T22:08:14.689534] [INFO ] [MAIN ] TMO: Full history saved. [2025-09-17T22:08:14.690533] [INFO ] [MAIN ] Update Progress: 2106/2371 symbols completed. TMO took 35.5s. Estimated remaining: 38m 47s. Rate: 6.8 symbols/min [2025-09-17T22:08:14.820918] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-02. [2025-09-17T22:08:14.864443] [INFO ] [MAIN ] TNGY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:08:14.864568] [DEBUG] [LOCAL ] TNGY: No existing data file found in primary storage. [2025-09-17T22:08:14.864623] [WARN ] [MAIN ] TNGY: No existing data found, performing full refresh instead. [2025-09-17T22:08:14.864791] [INFO ] [MAIN ] TNGY: Wiping existing primary data before full refresh. [2025-09-17T22:08:14.864837] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-17T22:08:14.864879] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-17T22:08:14.864911] [INFO ] [MAIN ] TNGY: Starting full primary refresh. [2025-09-17T22:08:15.232684] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T22:08:15.232216] [INFO ] [REMOTE ] TNGY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:08:15.615821] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-11. [2025-09-17T22:08:16.224787] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:08:16.225520] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-11 [2025-09-17T22:08:16.247501] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T22:08:16.415841] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-08. [2025-09-17T22:08:17.215774] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2024-12. [2025-09-17T22:08:17.322153] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T22:08:17.445076] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:08:17.445414] [WARN ] [REMOTE ] TNGY: No data returned for month 2024-12 [2025-09-17T22:08:18.015781] [INFO ] [REMOTE ] TNC: Fetching primary data for 2025-09. [2025-09-17T22:08:18.784089] [INFO ] [REMOTE ] TNC: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T22:08:18.786557] [INFO ] [REMOTE ] TNC: Full fetch complete (23311 records). [2025-09-17T22:08:18.786633] [DEBUG] [VALIDATOR ] TNC: Validating primary data. [2025-09-17T22:08:18.820841] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-01. [2025-09-17T22:08:19.110499] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:08:19.130836] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-01 [2025-09-17T22:08:19.156857] [DEBUG] [VALIDATOR ] TNC: All expected trading days are present. [2025-09-17T22:08:19.156918] [DEBUG] [VALIDATOR ] TNC: Primary data validation passed. [2025-09-17T22:08:19.157401] [INFO ] [MAIN ] TNC: Fetched primary data is valid. [2025-09-17T22:08:19.157441] [DEBUG] [LOCAL ] TNC: Saving primary data. [2025-09-17T22:08:19.158086] [DEBUG] [LOCAL ] TNC: Trimmed 23311 records to 15489 (keeping 200 days of data) [2025-09-17T22:08:19.260278] [DEBUG] [LOCAL ] TNC: Primary data saved (15489 records). [2025-09-17T22:08:19.260451] [INFO ] [MAIN ] TNC: Full history saved. [2025-09-17T22:08:19.260561] [INFO ] [MAIN ] Update Progress: 2107/2371 symbols completed. TNC took 27.7s. Estimated remaining: 38m 38s. Rate: 6.8 symbols/min [2025-09-17T22:08:19.437084] [INFO ] [MAIN ] TNK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:08:19.474256] [DEBUG] [LOCAL ] TNK: Loaded 35484 existing records from primary storage. [2025-09-17T22:08:19.474400] [INFO ] [MAIN ] TNK: Loaded 35484 existing records. [2025-09-17T22:08:19.620868] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-03. [2025-09-17T22:08:19.663239] [WARN ] [MAIN ] TNK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:08:19.663460] [INFO ] [MAIN ] TNK: Wiping existing primary data before full refresh. [2025-09-17T22:08:19.663525] [INFO ] [LOCAL ] TNK: Starting deletion of primary data. [2025-09-17T22:08:19.664569] [DEBUG] [LOCAL ] TNK: Deleted primary data file. [2025-09-17T22:08:19.664631] [INFO ] [MAIN ] TNK: Starting full primary refresh. [2025-09-17T22:08:20.044771] [INFO ] [REMOTE ] TNK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:08:20.415782] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-11. [2025-09-17T22:08:21.141021] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-03 (1.52 seconds). [2025-09-17T22:08:21.215746] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-04. [2025-09-17T22:08:22.015755] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-02. [2025-09-17T22:08:22.228850] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:08:22.232440] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-02 [2025-09-17T22:08:22.233475] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T22:08:22.715331] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T22:08:22.815761] [INFO ] [REMOTE ] TME: Fetching primary data for 2025-09. [2025-09-17T22:08:23.615794] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-03. [2025-09-17T22:08:23.818072] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:08:23.818639] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-03 [2025-09-17T22:08:24.415777] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-04. [2025-09-17T22:08:24.508135] [INFO ] [REMOTE ] TME: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T22:08:24.517411] [INFO ] [REMOTE ] TME: Full fetch complete (76754 records). [2025-09-17T22:08:24.517585] [DEBUG] [VALIDATOR ] TME: Validating primary data. [2025-09-17T22:08:24.637149] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:08:24.641163] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-04 [2025-09-17T22:08:24.935837] [DEBUG] [VALIDATOR ] TME: All expected trading days are present. [2025-09-17T22:08:24.935928] [DEBUG] [VALIDATOR ] TME: Primary data validation passed. [2025-09-17T22:08:24.936984] [INFO ] [MAIN ] TME: Fetched primary data is valid. [2025-09-17T22:08:24.937054] [DEBUG] [LOCAL ] TME: Saving primary data. [2025-09-17T22:08:24.938557] [DEBUG] [LOCAL ] TME: Trimmed 76754 records to 53200 (keeping 200 days of data) [2025-09-17T22:08:25.227893] [INFO ] [REMOTE ] TNK: Fetching primary data for 2024-12. [2025-09-17T22:08:25.281678] [DEBUG] [LOCAL ] TME: Primary data saved (53200 records). [2025-09-17T22:08:25.281864] [INFO ] [MAIN ] TME: Full history saved. [2025-09-17T22:08:25.281969] [INFO ] [MAIN ] Update Progress: 2108/2371 symbols completed. TME took 55.7s. Estimated remaining: 38m 29s. Rate: 6.8 symbols/min [2025-09-17T22:08:25.457515] [INFO ] [MAIN ] TNL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:08:25.498713] [DEBUG] [LOCAL ] TNL: Loaded 42031 existing records from primary storage. [2025-09-17T22:08:25.498881] [INFO ] [MAIN ] TNL: Loaded 42031 existing records. [2025-09-17T22:08:25.682416] [WARN ] [MAIN ] TNL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:08:25.682754] [INFO ] [MAIN ] TNL: Wiping existing primary data before full refresh. [2025-09-17T22:08:25.682811] [INFO ] [LOCAL ] TNL: Starting deletion of primary data. [2025-09-17T22:08:25.683851] [DEBUG] [LOCAL ] TNL: Deleted primary data file. [2025-09-17T22:08:25.683913] [INFO ] [MAIN ] TNL: Starting full primary refresh. [2025-09-17T22:08:26.041682] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-05. [2025-09-17T22:08:26.047897] [INFO ] [REMOTE ] TNL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:08:26.638522] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T22:08:26.815790] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-01. [2025-09-17T22:08:26.900908] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-05 (0.86 seconds). [2025-09-17T22:08:27.615781] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-06. [2025-09-17T22:08:28.295324] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T22:08:28.415758] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-02. [2025-09-17T22:08:28.727024] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T22:08:29.215802] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-11. [2025-09-17T22:08:29.909291] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T22:08:30.015785] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-05. [2025-09-17T22:08:30.226507] [DEBUG] [REMOTE ] TNGY: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:08:30.226962] [WARN ] [REMOTE ] TNGY: No data returned for month 2025-05 [2025-09-17T22:08:30.608029] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-11 (1.39 seconds). [2025-09-17T22:08:30.815798] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-07. [2025-09-17T22:08:31.615847] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-06. [2025-09-17T22:08:32.061352] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-06 (0.45 seconds). [2025-09-17T22:08:32.172959] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-07 (1.36 seconds). [2025-09-17T22:08:32.415784] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-07. [2025-09-17T22:08:32.818881] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-07 (0.40 seconds). [2025-09-17T22:08:33.215801] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-08. [2025-09-17T22:08:33.717594] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T22:08:34.015789] [INFO ] [REMOTE ] TNL: Fetching primary data for 2024-12. [2025-09-17T22:08:34.815796] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-08. [2025-09-17T22:08:35.416892] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T22:08:35.615781] [INFO ] [REMOTE ] TNGY: Fetching primary data for 2025-09. [2025-09-17T22:08:35.736891] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-08 (0.92 seconds). [2025-09-17T22:08:36.237904] [INFO ] [REMOTE ] TNGY: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T22:08:36.239402] [INFO ] [REMOTE ] TNGY: Full fetch complete (3029 records). [2025-09-17T22:08:36.239473] [DEBUG] [VALIDATOR ] TNGY: Validating primary data. [2025-09-17T22:08:36.418937] [WARN ] [VALIDATOR ] TNGY: Validation failed - insufficient historical data. Have 65 unique days, need 200 days [2025-09-17T22:08:36.419092] [INFO ] [REMOTE ] TNET: Fetching primary data for 2025-09. [2025-09-17T22:08:36.419713] [FATAL] [MAIN ] TNGY: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:08:36.420472] [WARN ] [MAIN ] TNGY: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:08:36.420550] [INFO ] [LOCAL ] TNGY: Starting deletion of primary data. [2025-09-17T22:08:36.420631] [DEBUG] [LOCAL ] TNGY: No primary data file found to delete. [2025-09-17T22:08:36.420718] [INFO ] [LOCAL ] TNGY: Starting deletion of derivative data. [2025-09-17T22:08:36.420781] [DEBUG] [LOCAL ] TNGY: No derivative data file found to delete. [2025-09-17T22:08:36.420870] [INFO ] [MAIN ] Update Progress: 2109/2371 symbols completed. TNGY took 21.7s. Estimated remaining: 38m 20s. Rate: 6.8 symbols/min [2025-09-17T22:08:36.594534] [INFO ] [MAIN ] TOL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:08:36.659461] [DEBUG] [LOCAL ] TOL: Loaded 51126 existing records from primary storage. [2025-09-17T22:08:36.659606] [INFO ] [MAIN ] TOL: Loaded 51126 existing records. [2025-09-17T22:08:36.837180] [WARN ] [MAIN ] TOL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:08:36.837422] [INFO ] [MAIN ] TOL: Wiping existing primary data before full refresh. [2025-09-17T22:08:36.837470] [INFO ] [LOCAL ] TOL: Starting deletion of primary data. [2025-09-17T22:08:36.838741] [DEBUG] [LOCAL ] TOL: Deleted primary data file. [2025-09-17T22:08:36.838801] [INFO ] [MAIN ] TOL: Starting full primary refresh. [2025-09-17T22:08:37.205421] [INFO ] [REMOTE ] TOL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:08:37.215727] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-11. [2025-09-17T22:08:37.602431] [INFO ] [REMOTE ] TNET: Incremental fetch complete for 2025-09 (1.18 seconds). [2025-09-17T22:08:37.606412] [INFO ] [REMOTE ] TNET: Full fetch complete (41523 records). [2025-09-17T22:08:37.606561] [DEBUG] [VALIDATOR ] TNET: Validating primary data. [2025-09-17T22:08:37.996045] [DEBUG] [VALIDATOR ] TNET: All expected trading days are present. [2025-09-17T22:08:37.996135] [DEBUG] [VALIDATOR ] TNET: Primary data validation passed. [2025-09-17T22:08:37.997010] [INFO ] [MAIN ] TNET: Fetched primary data is valid. [2025-09-17T22:08:37.997073] [DEBUG] [LOCAL ] TNET: Saving primary data. [2025-09-17T22:08:37.998150] [DEBUG] [LOCAL ] TNET: Trimmed 41523 records to 29173 (keeping 200 days of data) [2025-09-17T22:08:38.079133] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-01. [2025-09-17T22:08:38.209420] [DEBUG] [LOCAL ] TNET: Primary data saved (29173 records). [2025-09-17T22:08:38.209604] [INFO ] [MAIN ] TNET: Full history saved. [2025-09-17T22:08:38.209844] [INFO ] [MAIN ] Update Progress: 2110/2371 symbols completed. TNET took 32.4s. Estimated remaining: 38m 10s. Rate: 6.8 symbols/min [2025-09-17T22:08:38.391769] [INFO ] [MAIN ] TOST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:08:38.453387] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-17T22:08:38.453540] [INFO ] [MAIN ] TOST: Loaded 53681 existing records. [2025-09-17T22:08:38.634895] [WARN ] [MAIN ] TOST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:08:38.635152] [INFO ] [MAIN ] TOST: Wiping existing primary data before full refresh. [2025-09-17T22:08:38.635200] [INFO ] [LOCAL ] TOST: Starting deletion of primary data. [2025-09-17T22:08:38.636361] [DEBUG] [LOCAL ] TOST: Deleted primary data file. [2025-09-17T22:08:38.636433] [INFO ] [MAIN ] TOST: Starting full primary refresh. [2025-09-17T22:08:38.831725] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-03. [2025-09-17T22:08:39.016086] [INFO ] [REMOTE ] TOST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:08:39.046939] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-11 (1.83 seconds). [2025-09-17T22:08:39.075964] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T22:08:39.615808] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-11. [2025-09-17T22:08:40.253435] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T22:08:40.415779] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-04. [2025-09-17T22:08:41.136826] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T22:08:41.215740] [INFO ] [REMOTE ] TOST: Fetching primary data for 2024-12. [2025-09-17T22:08:41.989396] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-04 (1.57 seconds). [2025-09-17T22:08:42.015745] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-02. [2025-09-17T22:08:42.523556] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T22:08:42.815801] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-01. [2025-09-17T22:08:43.527358] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T22:08:43.615780] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-03. [2025-09-17T22:08:44.415809] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-05. [2025-09-17T22:08:44.679375] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T22:08:44.884395] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T22:08:45.215800] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-04. [2025-09-17T22:08:46.003211] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T22:08:46.015735] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-06. [2025-09-17T22:08:46.815800] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-02. [2025-09-17T22:08:46.971603] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T22:08:47.133276] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-06 (1.12 seconds). [2025-09-17T22:08:47.615782] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-05. [2025-09-17T22:08:48.415774] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-07. [2025-09-17T22:08:48.799492] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T22:08:48.884370] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T22:08:49.215788] [INFO ] [REMOTE ] TOL: Fetching primary data for 2024-12. [2025-09-17T22:08:49.760036] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T22:08:50.015799] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-06. [2025-09-17T22:08:50.815821] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-08. [2025-09-17T22:08:51.067439] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T22:08:51.550136] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T22:08:51.615749] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-07. [2025-09-17T22:08:51.844310] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T22:08:52.415786] [INFO ] [REMOTE ] TNK: Fetching primary data for 2025-09. [2025-09-17T22:08:52.951040] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T22:08:53.215798] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-08. [2025-09-17T22:08:53.287165] [INFO ] [REMOTE ] TNK: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T22:08:53.292033] [INFO ] [REMOTE ] TNK: Full fetch complete (51901 records). [2025-09-17T22:08:53.292155] [DEBUG] [VALIDATOR ] TNK: Validating primary data. [2025-09-17T22:08:53.760321] [DEBUG] [VALIDATOR ] TNK: All expected trading days are present. [2025-09-17T22:08:53.760475] [DEBUG] [VALIDATOR ] TNK: Primary data validation passed. [2025-09-17T22:08:53.761513] [INFO ] [MAIN ] TNK: Fetched primary data is valid. [2025-09-17T22:08:53.761608] [DEBUG] [LOCAL ] TNK: Saving primary data. [2025-09-17T22:08:53.763122] [DEBUG] [LOCAL ] TNK: Trimmed 51901 records to 35499 (keeping 200 days of data) [2025-09-17T22:08:54.016471] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-03. [2025-09-17T22:08:54.056392] [DEBUG] [LOCAL ] TNK: Primary data saved (35499 records). [2025-09-17T22:08:54.056619] [INFO ] [MAIN ] TNK: Full history saved. [2025-09-17T22:08:54.056841] [INFO ] [MAIN ] Update Progress: 2111/2371 symbols completed. TNK took 34.8s. Estimated remaining: 38m 3s. Rate: 6.8 symbols/min [2025-09-17T22:08:54.347200] [INFO ] [MAIN ] TPB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:08:54.398322] [DEBUG] [LOCAL ] TPB: Loaded 24918 existing records from primary storage. [2025-09-17T22:08:54.398525] [INFO ] [MAIN ] TPB: Loaded 24918 existing records. [2025-09-17T22:08:54.653274] [WARN ] [MAIN ] TPB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:08:54.653779] [INFO ] [MAIN ] TPB: Wiping existing primary data before full refresh. [2025-09-17T22:08:54.653878] [INFO ] [LOCAL ] TPB: Starting deletion of primary data. [2025-09-17T22:08:54.654585] [DEBUG] [LOCAL ] TPB: Deleted primary data file. [2025-09-17T22:08:54.654789] [INFO ] [MAIN ] TPB: Starting full primary refresh. [2025-09-17T22:08:54.824138] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-01. [2025-09-17T22:08:55.021422] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T22:08:55.110347] [INFO ] [REMOTE ] TPB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:08:55.615761] [INFO ] [REMOTE ] TNL: Fetching primary data for 2025-09. [2025-09-17T22:08:56.174302] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-03 (2.16 seconds). [2025-09-17T22:08:56.415774] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-11. [2025-09-17T22:08:56.659486] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T22:08:57.009355] [INFO ] [REMOTE ] TNL: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T22:08:57.014710] [INFO ] [REMOTE ] TNL: Full fetch complete (58598 records). [2025-09-17T22:08:57.014811] [DEBUG] [VALIDATOR ] TNL: Validating primary data. [2025-09-17T22:08:57.219765] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-04. [2025-09-17T22:08:57.457974] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T22:08:57.466891] [DEBUG] [VALIDATOR ] TNL: All expected trading days are present. [2025-09-17T22:08:57.467028] [DEBUG] [VALIDATOR ] TNL: Primary data validation passed. [2025-09-17T22:08:57.468852] [INFO ] [MAIN ] TNL: Fetched primary data is valid. [2025-09-17T22:08:57.468929] [DEBUG] [LOCAL ] TNL: Saving primary data. [2025-09-17T22:08:57.471612] [DEBUG] [LOCAL ] TNL: Trimmed 58598 records to 42043 (keeping 200 days of data) [2025-09-17T22:08:57.754710] [DEBUG] [LOCAL ] TNL: Primary data saved (42043 records). [2025-09-17T22:08:57.754843] [INFO ] [MAIN ] TNL: Full history saved. [2025-09-17T22:08:57.754949] [INFO ] [MAIN ] Update Progress: 2112/2371 symbols completed. TNL took 32.5s. Estimated remaining: 37m 53s. Rate: 6.8 symbols/min [2025-09-17T22:08:57.929486] [INFO ] [MAIN ] TPC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:08:57.973484] [DEBUG] [LOCAL ] TPC: Loaded 39019 existing records from primary storage. [2025-09-17T22:08:57.973662] [INFO ] [MAIN ] TPC: Loaded 39019 existing records. [2025-09-17T22:08:58.021011] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-02. [2025-09-17T22:08:58.154213] [WARN ] [MAIN ] TPC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:08:58.154474] [INFO ] [MAIN ] TPC: Wiping existing primary data before full refresh. [2025-09-17T22:08:58.154521] [INFO ] [LOCAL ] TPC: Starting deletion of primary data. [2025-09-17T22:08:58.155289] [DEBUG] [LOCAL ] TPC: Deleted primary data file. [2025-09-17T22:08:58.155370] [INFO ] [MAIN ] TPC: Starting full primary refresh. [2025-09-17T22:08:58.511824] [INFO ] [REMOTE ] TPC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:08:58.815853] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-11. [2025-09-17T22:08:59.167048] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T22:08:59.615784] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-05. [2025-09-17T22:08:59.802818] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-02 (1.78 seconds). [2025-09-17T22:09:00.017556] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-11 (1.20 seconds). [2025-09-17T22:09:00.415785] [INFO ] [REMOTE ] TPB: Fetching primary data for 2024-12. [2025-09-17T22:09:01.215782] [INFO ] [REMOTE ] TPC: Fetching primary data for 2024-12. [2025-09-17T22:09:01.651696] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-17T22:09:01.770913] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T22:09:02.015838] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-01. [2025-09-17T22:09:02.815853] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-06. [2025-09-17T22:09:03.289316] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2024-12 (2.07 seconds). [2025-09-17T22:09:03.615789] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-01. [2025-09-17T22:09:03.845762] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-01 (1.83 seconds). [2025-09-17T22:09:04.415822] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-02. [2025-09-17T22:09:04.931799] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-06 (2.12 seconds). [2025-09-17T22:09:05.215766] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-07. [2025-09-17T22:09:05.624452] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T22:09:05.695694] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-02 (1.28 seconds). [2025-09-17T22:09:06.015795] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-03. [2025-09-17T22:09:06.815817] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-02. [2025-09-17T22:09:07.107703] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T22:09:07.340438] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T22:09:07.615772] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-08. [2025-09-17T22:09:08.158085] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T22:09:08.415785] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-03. [2025-09-17T22:09:09.215790] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-03. [2025-09-17T22:09:09.530367] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T22:09:09.876792] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T22:09:10.015803] [INFO ] [REMOTE ] TOST: Fetching primary data for 2025-09. [2025-09-17T22:09:10.815790] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-04. [2025-09-17T22:09:10.996179] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T22:09:11.615790] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-04. [2025-09-17T22:09:11.801010] [INFO ] [REMOTE ] TOST: Incremental fetch complete for 2025-09 (1.79 seconds). [2025-09-17T22:09:11.808555] [INFO ] [REMOTE ] TOST: Full fetch complete (77554 records). [2025-09-17T22:09:11.809100] [DEBUG] [VALIDATOR ] TOST: Validating primary data. [2025-09-17T22:09:11.869240] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-04 (1.05 seconds). [2025-09-17T22:09:12.244220] [DEBUG] [VALIDATOR ] TOST: All expected trading days are present. [2025-09-17T22:09:12.244318] [DEBUG] [VALIDATOR ] TOST: Primary data validation passed. [2025-09-17T22:09:12.245683] [INFO ] [MAIN ] TOST: Fetched primary data is valid. [2025-09-17T22:09:12.245752] [DEBUG] [LOCAL ] TOST: Saving primary data. [2025-09-17T22:09:12.247581] [DEBUG] [LOCAL ] TOST: Trimmed 77554 records to 53681 (keeping 200 days of data) [2025-09-17T22:09:12.434045] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-05. [2025-09-17T22:09:12.594831] [DEBUG] [LOCAL ] TOST: Primary data saved (53681 records). [2025-09-17T22:09:12.594982] [INFO ] [MAIN ] TOST: Full history saved. [2025-09-17T22:09:12.595169] [INFO ] [MAIN ] Update Progress: 2113/2371 symbols completed. TOST took 34.4s. Estimated remaining: 37m 45s. Rate: 6.8 symbols/min [2025-09-17T22:09:12.782866] [INFO ] [MAIN ] TPH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:09:12.829829] [DEBUG] [LOCAL ] TPH: Loaded 45377 existing records from primary storage. [2025-09-17T22:09:12.829981] [INFO ] [MAIN ] TPH: Loaded 45377 existing records. [2025-09-17T22:09:13.027750] [WARN ] [MAIN ] TPH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:09:13.028054] [INFO ] [MAIN ] TPH: Wiping existing primary data before full refresh. [2025-09-17T22:09:13.028104] [INFO ] [LOCAL ] TPH: Starting deletion of primary data. [2025-09-17T22:09:13.029026] [DEBUG] [LOCAL ] TPH: Deleted primary data file. [2025-09-17T22:09:13.029090] [INFO ] [MAIN ] TPH: Starting full primary refresh. [2025-09-17T22:09:13.228846] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-04. [2025-09-17T22:09:13.430277] [INFO ] [REMOTE ] TPH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:09:14.015798] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-11. [2025-09-17T22:09:14.502782] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-04 (2.89 seconds). [2025-09-17T22:09:14.584447] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T22:09:14.675774] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-05 (2.24 seconds). [2025-09-17T22:09:14.815787] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-05. [2025-09-17T22:09:15.593765] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T22:09:15.615755] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-06. [2025-09-17T22:09:16.309472] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-05 (1.49 seconds). [2025-09-17T22:09:16.415789] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-06. [2025-09-17T22:09:16.836035] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-06 (1.22 seconds). [2025-09-17T22:09:17.215816] [INFO ] [REMOTE ] TPH: Fetching primary data for 2024-12. [2025-09-17T22:09:18.015816] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-05. [2025-09-17T22:09:18.156860] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T22:09:18.815753] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-07. [2025-09-17T22:09:18.900336] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T22:09:19.542979] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T22:09:19.615774] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-07. [2025-09-17T22:09:20.415773] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-01. [2025-09-17T22:09:20.681947] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-07 (1.87 seconds). [2025-09-17T22:09:20.740807] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T22:09:21.215789] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-08. [2025-09-17T22:09:21.944206] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T22:09:22.015695] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-02. [2025-09-17T22:09:22.059312] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T22:09:22.815789] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-08. [2025-09-17T22:09:23.615778] [INFO ] [REMOTE ] TPB: Fetching primary data for 2025-09. [2025-09-17T22:09:23.920706] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-02 (1.91 seconds). [2025-09-17T22:09:24.415766] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-03. [2025-09-17T22:09:24.694114] [INFO ] [REMOTE ] TPB: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T22:09:24.698842] [INFO ] [REMOTE ] TPB: Full fetch complete (34495 records). [2025-09-17T22:09:24.699270] [DEBUG] [VALIDATOR ] TPB: Validating primary data. [2025-09-17T22:09:25.107792] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T22:09:25.148613] [DEBUG] [VALIDATOR ] TPB: All expected trading days are present. [2025-09-17T22:09:25.148757] [DEBUG] [VALIDATOR ] TPB: Primary data validation passed. [2025-09-17T22:09:25.149901] [INFO ] [MAIN ] TPB: Fetched primary data is valid. [2025-09-17T22:09:25.150006] [DEBUG] [LOCAL ] TPB: Saving primary data. [2025-09-17T22:09:25.151430] [DEBUG] [LOCAL ] TPB: Trimmed 34495 records to 24996 (keeping 200 days of data) [2025-09-17T22:09:25.239433] [INFO ] [REMOTE ] TOL: Fetching primary data for 2025-09. [2025-09-17T22:09:25.312684] [DEBUG] [LOCAL ] TPB: Primary data saved (24996 records). [2025-09-17T22:09:25.312838] [INFO ] [MAIN ] TPB: Full history saved. [2025-09-17T22:09:25.312929] [INFO ] [MAIN ] Update Progress: 2114/2371 symbols completed. TPB took 31.3s. Estimated remaining: 37m 37s. Rate: 6.8 symbols/min [2025-09-17T22:09:25.484924] [INFO ] [MAIN ] TPL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:09:25.499316] [DEBUG] [LOCAL ] TPL: Loaded 12498 existing records from primary storage. [2025-09-17T22:09:25.499435] [INFO ] [MAIN ] TPL: Loaded 12498 existing records. [2025-09-17T22:09:25.679706] [WARN ] [MAIN ] TPL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:09:25.679987] [INFO ] [MAIN ] TPL: Wiping existing primary data before full refresh. [2025-09-17T22:09:25.680085] [INFO ] [LOCAL ] TPL: Starting deletion of primary data. [2025-09-17T22:09:25.680614] [DEBUG] [LOCAL ] TPL: Deleted primary data file. [2025-09-17T22:09:25.680717] [INFO ] [MAIN ] TPL: Starting full primary refresh. [2025-09-17T22:09:26.020210] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-06. [2025-09-17T22:09:26.059243] [INFO ] [REMOTE ] TPL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:09:26.087676] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T22:09:26.815807] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-04. [2025-09-17T22:09:26.999408] [INFO ] [REMOTE ] TOL: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T22:09:27.006752] [INFO ] [REMOTE ] TOL: Full fetch complete (73644 records). [2025-09-17T22:09:27.006926] [DEBUG] [VALIDATOR ] TOL: Validating primary data. [2025-09-17T22:09:27.417851] [DEBUG] [VALIDATOR ] TOL: All expected trading days are present. [2025-09-17T22:09:27.418036] [DEBUG] [VALIDATOR ] TOL: Primary data validation passed. [2025-09-17T22:09:27.419205] [INFO ] [MAIN ] TOL: Fetched primary data is valid. [2025-09-17T22:09:27.419385] [DEBUG] [LOCAL ] TOL: Saving primary data. [2025-09-17T22:09:27.431488] [DEBUG] [LOCAL ] TOL: Trimmed 73644 records to 51126 (keeping 200 days of data) [2025-09-17T22:09:27.451325] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T22:09:27.648183] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-07. [2025-09-17T22:09:27.793989] [DEBUG] [LOCAL ] TOL: Primary data saved (51126 records). [2025-09-17T22:09:27.794157] [INFO ] [MAIN ] TOL: Full history saved. [2025-09-17T22:09:27.795067] [INFO ] [MAIN ] Update Progress: 2115/2371 symbols completed. TOL took 51.4s. Estimated remaining: 37m 27s. Rate: 6.8 symbols/min [2025-09-17T22:09:27.965079] [INFO ] [MAIN ] TPR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:09:28.030315] [DEBUG] [LOCAL ] TPR: Loaded 53489 existing records from primary storage. [2025-09-17T22:09:28.030469] [INFO ] [MAIN ] TPR: Loaded 53489 existing records. [2025-09-17T22:09:28.217480] [WARN ] [MAIN ] TPR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:09:28.217989] [INFO ] [MAIN ] TPR: Wiping existing primary data before full refresh. [2025-09-17T22:09:28.218064] [INFO ] [LOCAL ] TPR: Starting deletion of primary data. [2025-09-17T22:09:28.219763] [DEBUG] [LOCAL ] TPR: Deleted primary data file. [2025-09-17T22:09:28.219840] [INFO ] [MAIN ] TPR: Starting full primary refresh. [2025-09-17T22:09:28.430948] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T22:09:28.427199] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-11. [2025-09-17T22:09:28.627975] [INFO ] [REMOTE ] TPR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:09:29.215806] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-11. [2025-09-17T22:09:29.360801] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T22:09:29.425623] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-11 (1.00 seconds). [2025-09-17T22:09:30.015808] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-08. [2025-09-17T22:09:30.825141] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-05. [2025-09-17T22:09:30.852230] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T22:09:31.140620] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T22:09:31.615778] [INFO ] [REMOTE ] TPR: Fetching primary data for 2024-12. [2025-09-17T22:09:32.189985] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T22:09:32.415795] [INFO ] [REMOTE ] TPC: Fetching primary data for 2025-09. [2025-09-17T22:09:32.978507] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2024-12 (1.36 seconds). [2025-09-17T22:09:33.215807] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-01. [2025-09-17T22:09:33.746997] [INFO ] [REMOTE ] TPC: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T22:09:33.752447] [INFO ] [REMOTE ] TPC: Full fetch complete (54361 records). [2025-09-17T22:09:33.752579] [DEBUG] [VALIDATOR ] TPC: Validating primary data. [2025-09-17T22:09:34.021113] [INFO ] [REMOTE ] TPL: Fetching primary data for 2024-12. [2025-09-17T22:09:34.164167] [DEBUG] [VALIDATOR ] TPC: All expected trading days are present. [2025-09-17T22:09:34.164259] [DEBUG] [VALIDATOR ] TPC: Primary data validation passed. [2025-09-17T22:09:34.165141] [INFO ] [MAIN ] TPC: Fetched primary data is valid. [2025-09-17T22:09:34.165205] [DEBUG] [LOCAL ] TPC: Saving primary data. [2025-09-17T22:09:34.166390] [DEBUG] [LOCAL ] TPC: Trimmed 54361 records to 38922 (keeping 200 days of data) [2025-09-17T22:09:34.405623] [DEBUG] [LOCAL ] TPC: Primary data saved (38922 records). [2025-09-17T22:09:34.405811] [INFO ] [MAIN ] TPC: Full history saved. [2025-09-17T22:09:34.405979] [INFO ] [MAIN ] Update Progress: 2116/2371 symbols completed. TPC took 36.7s. Estimated remaining: 37m 18s. Rate: 6.8 symbols/min [2025-09-17T22:09:34.583326] [INFO ] [MAIN ] TPVG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:09:34.612031] [DEBUG] [LOCAL ] TPVG: Loaded 27104 existing records from primary storage. [2025-09-17T22:09:34.612177] [INFO ] [MAIN ] TPVG: Loaded 27104 existing records. [2025-09-17T22:09:34.809219] [WARN ] [MAIN ] TPVG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:09:34.809464] [INFO ] [MAIN ] TPVG: Wiping existing primary data before full refresh. [2025-09-17T22:09:34.809514] [INFO ] [LOCAL ] TPVG: Starting deletion of primary data. [2025-09-17T22:09:34.810333] [DEBUG] [LOCAL ] TPVG: Deleted primary data file. [2025-09-17T22:09:34.810397] [INFO ] [MAIN ] TPVG: Starting full primary refresh. [2025-09-17T22:09:34.833735] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-06. [2025-09-17T22:09:35.258299] [INFO ] [REMOTE ] TPVG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:09:35.270036] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T22:09:35.302924] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-01 (2.09 seconds). [2025-09-17T22:09:35.615775] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-01. [2025-09-17T22:09:36.133532] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-06 (1.30 seconds). [2025-09-17T22:09:36.415787] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-11. [2025-09-17T22:09:36.608966] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-01 (0.99 seconds). [2025-09-17T22:09:37.215793] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-07. [2025-09-17T22:09:37.584297] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T22:09:38.015798] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2024-12. [2025-09-17T22:09:38.815803] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-02. [2025-09-17T22:09:38.952991] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T22:09:39.546379] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T22:09:39.615743] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-01. [2025-09-17T22:09:39.696077] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-02 (0.88 seconds). [2025-09-17T22:09:40.415783] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-02. [2025-09-17T22:09:40.819438] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T22:09:41.215825] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-02. [2025-09-17T22:09:41.949225] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-02 (0.73 seconds). [2025-09-17T22:09:42.015782] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-03. [2025-09-17T22:09:42.266599] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T22:09:42.815783] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-08. [2025-09-17T22:09:42.958722] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T22:09:43.615786] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-04. [2025-09-17T22:09:44.420926] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-03. [2025-09-17T22:09:44.446355] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T22:09:44.600536] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T22:09:45.215796] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-05. [2025-09-17T22:09:46.015967] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-03. [2025-09-17T22:09:46.345481] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T22:09:46.430376] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-05 (1.21 seconds). [2025-09-17T22:09:46.816020] [INFO ] [REMOTE ] TPH: Fetching primary data for 2025-09. [2025-09-17T22:09:47.044874] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T22:09:47.615811] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-04. [2025-09-17T22:09:48.220599] [INFO ] [REMOTE ] TPH: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T22:09:48.226312] [INFO ] [REMOTE ] TPH: Full fetch complete (64613 records). [2025-09-17T22:09:48.226443] [DEBUG] [VALIDATOR ] TPH: Validating primary data. [2025-09-17T22:09:48.419247] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-04. [2025-09-17T22:09:48.635418] [DEBUG] [VALIDATOR ] TPH: All expected trading days are present. [2025-09-17T22:09:48.635526] [DEBUG] [VALIDATOR ] TPH: Primary data validation passed. [2025-09-17T22:09:48.636677] [INFO ] [MAIN ] TPH: Fetched primary data is valid. [2025-09-17T22:09:48.636747] [DEBUG] [LOCAL ] TPH: Saving primary data. [2025-09-17T22:09:48.638375] [DEBUG] [LOCAL ] TPH: Trimmed 64613 records to 45324 (keeping 200 days of data) [2025-09-17T22:09:48.905545] [DEBUG] [LOCAL ] TPH: Primary data saved (45324 records). [2025-09-17T22:09:48.905721] [INFO ] [MAIN ] TPH: Full history saved. [2025-09-17T22:09:48.907452] [INFO ] [MAIN ] Update Progress: 2117/2371 symbols completed. TPH took 36.3s. Estimated remaining: 37m 10s. Rate: 6.8 symbols/min [2025-09-17T22:09:49.215846] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-06. [2025-09-17T22:09:49.500241] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T22:09:49.589959] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-04 (1.17 seconds). [2025-09-17T22:09:50.015837] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-05. [2025-09-17T22:09:50.371283] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T22:09:50.815849] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-07. [2025-09-17T22:09:50.834803] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-05 (0.82 seconds). [2025-09-17T22:09:51.615758] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-06. [2025-09-17T22:09:51.763628] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T22:09:52.415810] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-08. [2025-09-17T22:09:52.564448] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-06 (0.95 seconds). [2025-09-17T22:09:53.215786] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-07. [2025-09-17T22:09:53.609761] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T22:09:54.015782] [INFO ] [REMOTE ] TPVG: Fetching primary data for 2025-09. [2025-09-17T22:09:54.248321] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-07 (1.03 seconds). [2025-09-17T22:09:54.815829] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-08. [2025-09-17T22:09:54.978188] [INFO ] [REMOTE ] TPVG: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T22:09:54.982154] [INFO ] [REMOTE ] TPVG: Full fetch complete (40127 records). [2025-09-17T22:09:54.982236] [DEBUG] [VALIDATOR ] TPVG: Validating primary data. [2025-09-17T22:09:55.360009] [DEBUG] [VALIDATOR ] TPVG: All expected trading days are present. [2025-09-17T22:09:55.360087] [DEBUG] [VALIDATOR ] TPVG: Primary data validation passed. [2025-09-17T22:09:55.360884] [INFO ] [MAIN ] TPVG: Fetched primary data is valid. [2025-09-17T22:09:55.360947] [DEBUG] [LOCAL ] TPVG: Saving primary data. [2025-09-17T22:09:55.361811] [DEBUG] [LOCAL ] TPVG: Trimmed 40127 records to 27116 (keeping 200 days of data) [2025-09-17T22:09:55.518293] [DEBUG] [LOCAL ] TPVG: Primary data saved (27116 records). [2025-09-17T22:09:55.518540] [INFO ] [MAIN ] TPVG: Full history saved. [2025-09-17T22:09:55.518718] [INFO ] [MAIN ] Update Progress: 2118/2371 symbols completed. TPVG took 21.1s. Estimated remaining: 37m 1s. Rate: 6.8 symbols/min [2025-09-17T22:09:55.526622] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T22:09:55.615734] [INFO ] [REMOTE ] TPL: Fetching primary data for 2025-09. [2025-09-17T22:09:55.979370] [INFO ] [REMOTE ] TPL: Incremental fetch complete for 2025-09 (0.36 seconds). [2025-09-17T22:09:55.981733] [INFO ] [REMOTE ] TPL: Full fetch complete (18740 records). [2025-09-17T22:09:55.981816] [DEBUG] [VALIDATOR ] TPL: Validating primary data. [2025-09-17T22:09:56.353093] [DEBUG] [VALIDATOR ] TPL: All expected trading days are present. [2025-09-17T22:09:56.353172] [DEBUG] [VALIDATOR ] TPL: Primary data validation passed. [2025-09-17T22:09:56.353559] [INFO ] [MAIN ] TPL: Fetched primary data is valid. [2025-09-17T22:09:56.353598] [DEBUG] [LOCAL ] TPL: Saving primary data. [2025-09-17T22:09:56.354221] [DEBUG] [LOCAL ] TPL: Trimmed 18740 records to 12466 (keeping 200 days of data) [2025-09-17T22:09:56.415768] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-05. [2025-09-17T22:09:56.440317] [DEBUG] [LOCAL ] TPL: Primary data saved (12466 records). [2025-09-17T22:09:56.440454] [INFO ] [MAIN ] TPL: Full history saved. [2025-09-17T22:09:56.440618] [INFO ] [MAIN ] Update Progress: 2119/2371 symbols completed. TPL took 31.1s. Estimated remaining: 36m 51s. Rate: 6.8 symbols/min [2025-09-17T22:09:57.960625] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T22:09:57.975815] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-06. [2025-09-17T22:09:59.313713] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T22:09:59.324451] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-07. [2025-09-17T22:10:01.382493] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T22:10:01.394721] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-08. [2025-09-17T22:10:02.828607] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T22:10:02.840495] [INFO ] [REMOTE ] TPR: Fetching primary data for 2025-09. [2025-09-17T22:10:03.534750] [INFO ] [REMOTE ] TPR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T22:10:03.544955] [INFO ] [REMOTE ] TPR: Full fetch complete (77296 records). [2025-09-17T22:10:03.545121] [DEBUG] [VALIDATOR ] TPR: Validating primary data. [2025-09-17T22:10:03.955526] [DEBUG] [VALIDATOR ] TPR: All expected trading days are present. [2025-09-17T22:10:03.955625] [DEBUG] [VALIDATOR ] TPR: Primary data validation passed. [2025-09-17T22:10:03.956794] [INFO ] [MAIN ] TPR: Fetched primary data is valid. [2025-09-17T22:10:03.956863] [DEBUG] [LOCAL ] TPR: Saving primary data. [2025-09-17T22:10:03.958515] [DEBUG] [LOCAL ] TPR: Trimmed 77296 records to 53485 (keeping 200 days of data) [2025-09-17T22:10:04.334725] [DEBUG] [LOCAL ] TPR: Primary data saved (53485 records). [2025-09-17T22:10:04.334908] [INFO ] [MAIN ] TPR: Full history saved. [2025-09-17T22:10:04.335738] [INFO ] [MAIN ] Update Progress: 2120/2371 symbols completed. TPR took 36.5s. Estimated remaining: 36m 42s. Rate: 6.8 symbols/min [2025-09-17T22:10:04.952895] [INFO ] [MAIN ] TR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:10:04.987188] [INFO ] [MAIN ] TPYP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:10:05.100333] [INFO ] [MAIN ] TRAK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:10:05.125550] [INFO ] [MAIN ] TPZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:10:05.130516] [DEBUG] [LOCAL ] TPYP: Loaded 8038 existing records from primary storage. [2025-09-17T22:10:05.130784] [INFO ] [MAIN ] TPYP: Loaded 8038 existing records. [2025-09-17T22:10:05.202579] [DEBUG] [LOCAL ] TR: Loaded 18117 existing records from primary storage. [2025-09-17T22:10:05.217602] [INFO ] [MAIN ] TR: Loaded 18117 existing records. [2025-09-17T22:10:05.239568] [DEBUG] [LOCAL ] TRAK: Loaded 9431 existing records from primary storage. [2025-09-17T22:10:05.263025] [DEBUG] [LOCAL ] TPZ: Loaded 5319 existing records from primary storage. [2025-09-17T22:10:05.272295] [INFO ] [MAIN ] TRAK: Loaded 9431 existing records. [2025-09-17T22:10:05.293188] [INFO ] [MAIN ] TPZ: Loaded 5319 existing records. [2025-09-17T22:10:05.585251] [WARN ] [MAIN ] TPYP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:10:05.655229] [INFO ] [MAIN ] TPYP: Wiping existing primary data before full refresh. [2025-09-17T22:10:05.725828] [INFO ] [LOCAL ] TPYP: Starting deletion of primary data. [2025-09-17T22:10:05.808578] [DEBUG] [LOCAL ] TPYP: Deleted primary data file. [2025-09-17T22:10:05.818486] [WARN ] [MAIN ] TR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:10:05.850784] [WARN ] [MAIN ] TPZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:10:05.845762] [INFO ] [MAIN ] TPYP: Starting full primary refresh. [2025-09-17T22:10:05.891885] [INFO ] [MAIN ] TR: Wiping existing primary data before full refresh. [2025-09-17T22:10:05.933711] [INFO ] [LOCAL ] TR: Starting deletion of primary data. [2025-09-17T22:10:05.921417] [INFO ] [MAIN ] TPZ: Wiping existing primary data before full refresh. [2025-09-17T22:10:05.934703] [INFO ] [LOCAL ] TPZ: Starting deletion of primary data. [2025-09-17T22:10:05.952440] [WARN ] [MAIN ] TRAK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:10:05.958355] [DEBUG] [LOCAL ] TR: Deleted primary data file. [2025-09-17T22:10:05.982091] [DEBUG] [LOCAL ] TPZ: Deleted primary data file. [2025-09-17T22:10:05.982266] [INFO ] [MAIN ] TPZ: Starting full primary refresh. [2025-09-17T22:10:05.987603] [INFO ] [MAIN ] TR: Starting full primary refresh. [2025-09-17T22:10:06.039611] [INFO ] [MAIN ] TRAK: Wiping existing primary data before full refresh. [2025-09-17T22:10:06.060773] [INFO ] [LOCAL ] TRAK: Starting deletion of primary data. [2025-09-17T22:10:06.165541] [DEBUG] [LOCAL ] TRAK: Deleted primary data file. [2025-09-17T22:10:06.181616] [INFO ] [MAIN ] TRAK: Starting full primary refresh. [2025-09-17T22:10:07.127187] [INFO ] [REMOTE ] TPYP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:10:07.166526] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-11. [2025-09-17T22:10:07.372711] [INFO ] [REMOTE ] TR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:10:07.368976] [INFO ] [REMOTE ] TPZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:10:07.373554] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-11. [2025-09-17T22:10:07.396810] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-11. [2025-09-17T22:10:07.523447] [INFO ] [REMOTE ] TRAK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:10:07.523808] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-11. [2025-09-17T22:10:07.764288] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T22:10:07.766348] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2024-12. [2025-09-17T22:10:08.056513] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T22:10:08.059663] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2024-12. [2025-09-17T22:10:08.111196] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T22:10:08.112566] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2024-12. [2025-09-17T22:10:08.237801] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T22:10:08.241395] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-01. [2025-09-17T22:10:08.454041] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T22:10:08.457953] [INFO ] [REMOTE ] TR: Fetching primary data for 2024-12. [2025-09-17T22:10:08.668803] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T22:10:08.671518] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-01. [2025-09-17T22:10:08.937142] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T22:10:08.940257] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-01. [2025-09-17T22:10:09.125572] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T22:10:09.200889] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T22:10:09.215715] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-01. [2025-09-17T22:10:09.266388] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-01 (0.59 seconds). [2025-09-17T22:10:09.571815] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-01 (0.63 seconds). [2025-09-17T22:10:09.821754] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T22:10:10.015796] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-02. [2025-09-17T22:10:10.664461] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T22:10:10.815830] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-03. [2025-09-17T22:10:11.290203] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T22:10:11.615772] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-02. [2025-09-17T22:10:12.357263] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T22:10:12.415794] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-03. [2025-09-17T22:10:13.215748] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-02. [2025-09-17T22:10:13.394780] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-03 (0.98 seconds). [2025-09-17T22:10:14.015739] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-04. [2025-09-17T22:10:14.209928] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T22:10:14.815790] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-03. [2025-09-17T22:10:14.879468] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-04 (0.86 seconds). [2025-09-17T22:10:15.615774] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-05. [2025-09-17T22:10:15.693259] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T22:10:16.150702] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-05 (0.53 seconds). [2025-09-17T22:10:16.415794] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-04. [2025-09-17T22:10:17.213422] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T22:10:17.215910] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-04. [2025-09-17T22:10:18.015798] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-06. [2025-09-17T22:10:18.151295] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T22:10:18.792198] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T22:10:18.815774] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-07. [2025-09-17T22:10:19.563095] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T22:10:19.615804] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-05. [2025-09-17T22:10:20.415799] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-08. [2025-09-17T22:10:20.754223] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T22:10:21.215746] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-06. [2025-09-17T22:10:21.440781] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T22:10:21.989795] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T22:10:22.015731] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-07. [2025-09-17T22:10:22.815775] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-05. [2025-09-17T22:10:23.144572] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T22:10:23.369851] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T22:10:23.615791] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-02. [2025-09-17T22:10:24.411271] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T22:10:24.415678] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-03. [2025-09-17T22:10:25.163262] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T22:10:25.215895] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-04. [2025-09-17T22:10:25.953324] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T22:10:26.015842] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-08. [2025-09-17T22:10:26.815746] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-06. [2025-09-17T22:10:27.208690] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T22:10:27.326868] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T22:10:27.615801] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-05. [2025-09-17T22:10:28.243889] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T22:10:28.415815] [INFO ] [REMOTE ] TRAK: Fetching primary data for 2025-09. [2025-09-17T22:10:29.174383] [INFO ] [REMOTE ] TRAK: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T22:10:29.177039] [INFO ] [REMOTE ] TRAK: Full fetch complete (13358 records). [2025-09-17T22:10:29.177110] [DEBUG] [VALIDATOR ] TRAK: Validating primary data. [2025-09-17T22:10:29.222415] [INFO ] [REMOTE ] TR: Fetching primary data for 2025-09. [2025-09-17T22:10:29.553857] [DEBUG] [VALIDATOR ] TRAK: All expected trading days are present. [2025-09-17T22:10:29.553938] [DEBUG] [VALIDATOR ] TRAK: Primary data validation passed. [2025-09-17T22:10:29.554295] [INFO ] [MAIN ] TRAK: Fetched primary data is valid. [2025-09-17T22:10:29.554356] [DEBUG] [LOCAL ] TRAK: Saving primary data. [2025-09-17T22:10:29.554894] [DEBUG] [LOCAL ] TRAK: Trimmed 13358 records to 9421 (keeping 200 days of data) [2025-09-17T22:10:29.613923] [DEBUG] [LOCAL ] TRAK: Primary data saved (9421 records). [2025-09-17T22:10:29.614074] [INFO ] [MAIN ] TRAK: Full history saved. [2025-09-17T22:10:29.614198] [INFO ] [MAIN ] Update Progress: 2121/2371 symbols completed. TRAK took 25.3s. Estimated remaining: 36m 36s. Rate: 6.8 symbols/min [2025-09-17T22:10:29.791618] [INFO ] [MAIN ] TRC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:10:29.809776] [DEBUG] [LOCAL ] TRC: Loaded 15940 existing records from primary storage. [2025-09-17T22:10:29.809936] [INFO ] [MAIN ] TRC: Loaded 15940 existing records. [2025-09-17T22:10:29.989152] [WARN ] [MAIN ] TRC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:10:29.989418] [INFO ] [MAIN ] TRC: Wiping existing primary data before full refresh. [2025-09-17T22:10:29.989514] [INFO ] [LOCAL ] TRC: Starting deletion of primary data. [2025-09-17T22:10:29.990061] [DEBUG] [LOCAL ] TRC: Deleted primary data file. [2025-09-17T22:10:29.990122] [INFO ] [MAIN ] TRC: Starting full primary refresh. [2025-09-17T22:10:30.024498] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-06. [2025-09-17T22:10:30.358726] [INFO ] [REMOTE ] TRC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:10:30.367756] [INFO ] [REMOTE ] TR: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T22:10:30.370945] [INFO ] [REMOTE ] TR: Full fetch complete (24502 records). [2025-09-17T22:10:30.371024] [DEBUG] [VALIDATOR ] TR: Validating primary data. [2025-09-17T22:10:30.637886] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T22:10:30.761268] [DEBUG] [VALIDATOR ] TR: All expected trading days are present. [2025-09-17T22:10:30.761351] [DEBUG] [VALIDATOR ] TR: Primary data validation passed. [2025-09-17T22:10:30.761903] [INFO ] [MAIN ] TR: Fetched primary data is valid. [2025-09-17T22:10:30.761966] [DEBUG] [LOCAL ] TR: Saving primary data. [2025-09-17T22:10:30.762821] [DEBUG] [LOCAL ] TR: Trimmed 24502 records to 18171 (keeping 200 days of data) [2025-09-17T22:10:30.816822] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-07. [2025-09-17T22:10:30.875131] [DEBUG] [LOCAL ] TR: Primary data saved (18171 records). [2025-09-17T22:10:30.875288] [INFO ] [MAIN ] TR: Full history saved. [2025-09-17T22:10:30.875401] [INFO ] [MAIN ] Update Progress: 2122/2371 symbols completed. TR took 26.5s. Estimated remaining: 36m 26s. Rate: 6.8 symbols/min [2025-09-17T22:10:31.043560] [INFO ] [MAIN ] TREX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:10:31.090694] [DEBUG] [LOCAL ] TREX: Loaded 49979 existing records from primary storage. [2025-09-17T22:10:31.090868] [INFO ] [MAIN ] TREX: Loaded 49979 existing records. [2025-09-17T22:10:31.273876] [WARN ] [MAIN ] TREX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:10:31.274233] [INFO ] [MAIN ] TREX: Wiping existing primary data before full refresh. [2025-09-17T22:10:31.274291] [INFO ] [LOCAL ] TREX: Starting deletion of primary data. [2025-09-17T22:10:31.275477] [DEBUG] [LOCAL ] TREX: Deleted primary data file. [2025-09-17T22:10:31.275537] [INFO ] [MAIN ] TREX: Starting full primary refresh. [2025-09-17T22:10:31.570260] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T22:10:31.619362] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-11. [2025-09-17T22:10:31.648762] [INFO ] [REMOTE ] TREX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:10:32.415801] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-08. [2025-09-17T22:10:32.581716] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T22:10:32.793171] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T22:10:33.215788] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-07. [2025-09-17T22:10:33.957151] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T22:10:34.015820] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-08. [2025-09-17T22:10:34.761487] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T22:10:34.815780] [INFO ] [REMOTE ] TPYP: Fetching primary data for 2025-09. [2025-09-17T22:10:35.468974] [INFO ] [REMOTE ] TPYP: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T22:10:35.470491] [INFO ] [REMOTE ] TPYP: Full fetch complete (12489 records). [2025-09-17T22:10:35.470567] [DEBUG] [VALIDATOR ] TPYP: Validating primary data. [2025-09-17T22:10:35.620929] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-11. [2025-09-17T22:10:35.844926] [DEBUG] [VALIDATOR ] TPYP: All expected trading days are present. [2025-09-17T22:10:35.845004] [DEBUG] [VALIDATOR ] TPYP: Primary data validation passed. [2025-09-17T22:10:35.845311] [INFO ] [MAIN ] TPYP: Fetched primary data is valid. [2025-09-17T22:10:35.845385] [DEBUG] [LOCAL ] TPYP: Saving primary data. [2025-09-17T22:10:35.845973] [DEBUG] [LOCAL ] TPYP: Trimmed 12489 records to 7993 (keeping 200 days of data) [2025-09-17T22:10:35.903627] [DEBUG] [LOCAL ] TPYP: Primary data saved (7993 records). [2025-09-17T22:10:35.903983] [INFO ] [MAIN ] TPYP: Full history saved. [2025-09-17T22:10:35.904141] [INFO ] [MAIN ] Update Progress: 2123/2371 symbols completed. TPYP took 31.6s. Estimated remaining: 36m 17s. Rate: 6.8 symbols/min [2025-09-17T22:10:36.076615] [INFO ] [MAIN ] TRGP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:10:36.143740] [DEBUG] [LOCAL ] TRGP: Loaded 50889 existing records from primary storage. [2025-09-17T22:10:36.143903] [INFO ] [MAIN ] TRGP: Loaded 50889 existing records. [2025-09-17T22:10:36.323044] [WARN ] [MAIN ] TRGP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:10:36.323365] [INFO ] [MAIN ] TRGP: Wiping existing primary data before full refresh. [2025-09-17T22:10:36.323419] [INFO ] [LOCAL ] TRGP: Starting deletion of primary data. [2025-09-17T22:10:36.324692] [DEBUG] [LOCAL ] TRGP: Deleted primary data file. [2025-09-17T22:10:36.324753] [INFO ] [MAIN ] TRGP: Starting full primary refresh. [2025-09-17T22:10:36.421121] [INFO ] [REMOTE ] TPZ: Fetching primary data for 2025-09. [2025-09-17T22:10:36.693267] [INFO ] [REMOTE ] TRGP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:10:36.955839] [INFO ] [REMOTE ] TPZ: Incremental fetch complete for 2025-09 (0.53 seconds). [2025-09-17T22:10:36.957049] [INFO ] [REMOTE ] TPZ: Full fetch complete (9311 records). [2025-09-17T22:10:36.957119] [DEBUG] [VALIDATOR ] TPZ: Validating primary data. [2025-09-17T22:10:37.216901] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-11. [2025-09-17T22:10:37.338309] [DEBUG] [VALIDATOR ] TPZ: All expected trading days are present. [2025-09-17T22:10:37.338435] [DEBUG] [VALIDATOR ] TPZ: Primary data validation passed. [2025-09-17T22:10:37.338804] [INFO ] [MAIN ] TPZ: Fetched primary data is valid. [2025-09-17T22:10:37.338969] [DEBUG] [LOCAL ] TPZ: Saving primary data. [2025-09-17T22:10:37.339787] [DEBUG] [LOCAL ] TPZ: Trimmed 9311 records to 5302 (keeping 200 days of data) [2025-09-17T22:10:37.394267] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T22:10:37.411518] [DEBUG] [LOCAL ] TPZ: Primary data saved (5302 records). [2025-09-17T22:10:37.411710] [INFO ] [MAIN ] TPZ: Full history saved. [2025-09-17T22:10:37.411849] [INFO ] [MAIN ] Update Progress: 2124/2371 symbols completed. TPZ took 33.1s. Estimated remaining: 36m 7s. Rate: 6.8 symbols/min [2025-09-17T22:10:37.596122] [INFO ] [MAIN ] TRN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:10:37.596409] [DEBUG] [LOCAL ] TRN: No existing data file found in primary storage. [2025-09-17T22:10:37.596475] [WARN ] [MAIN ] TRN: No existing data found, performing full refresh instead. [2025-09-17T22:10:37.596688] [INFO ] [MAIN ] TRN: Wiping existing primary data before full refresh. [2025-09-17T22:10:37.596752] [INFO ] [LOCAL ] TRN: Starting deletion of primary data. [2025-09-17T22:10:37.596809] [DEBUG] [LOCAL ] TRN: No primary data file found to delete. [2025-09-17T22:10:37.596932] [INFO ] [MAIN ] TRN: Starting full primary refresh. [2025-09-17T22:10:38.014279] [INFO ] [REMOTE ] TRN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:10:38.015741] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-11. [2025-09-17T22:10:38.698472] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T22:10:38.815820] [INFO ] [REMOTE ] TREX: Fetching primary data for 2024-12. [2025-09-17T22:10:39.498600] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T22:10:39.615870] [INFO ] [REMOTE ] TRN: Fetching primary data for 2024-12. [2025-09-17T22:10:40.415801] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2024-12. [2025-09-17T22:10:40.621308] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T22:10:40.690062] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2024-12 (1.07 seconds). [2025-09-17T22:10:41.215793] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-01. [2025-09-17T22:10:41.844495] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T22:10:42.015787] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-01. [2025-09-17T22:10:42.824405] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-01. [2025-09-17T22:10:42.852063] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T22:10:43.615775] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-02. [2025-09-17T22:10:43.786205] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T22:10:44.186123] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T22:10:44.415837] [INFO ] [REMOTE ] TRC: Fetching primary data for 2024-12. [2025-09-17T22:10:45.215745] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-02. [2025-09-17T22:10:45.285012] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T22:10:45.316591] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T22:10:46.015811] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-01. [2025-09-17T22:10:46.281992] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T22:10:46.815738] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-02. [2025-09-17T22:10:46.816074] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T22:10:47.615772] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-03. [2025-09-17T22:10:48.415816] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-02. [2025-09-17T22:10:48.481458] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-02 (1.67 seconds). [2025-09-17T22:10:48.988458] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-02 (0.57 seconds). [2025-09-17T22:10:49.153737] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T22:10:49.215730] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-04. [2025-09-17T22:10:50.015791] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-03. [2025-09-17T22:10:50.359730] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-04 (1.14 seconds). [2025-09-17T22:10:50.815791] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-05. [2025-09-17T22:10:51.615751] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-03. [2025-09-17T22:10:51.863421] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T22:10:51.985902] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T22:10:52.415775] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-03. [2025-09-17T22:10:52.601418] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T22:10:53.215782] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-04. [2025-09-17T22:10:54.015803] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-06. [2025-09-17T22:10:54.234071] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T22:10:54.815822] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-04. [2025-09-17T22:10:55.157224] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T22:10:55.214308] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-06 (1.20 seconds). [2025-09-17T22:10:55.615802] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-05. [2025-09-17T22:10:56.415779] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-07. [2025-09-17T22:10:56.497264] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T22:10:57.215782] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-05. [2025-09-17T22:10:57.411637] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T22:10:57.885315] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T22:10:58.015795] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-04. [2025-09-17T22:10:58.640147] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T22:10:58.815783] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-08. [2025-09-17T22:10:59.089278] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-04 (1.07 seconds). [2025-09-17T22:10:59.615773] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-05. [2025-09-17T22:11:00.421842] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-06. [2025-09-17T22:11:00.427249] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T22:11:00.501298] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T22:11:01.215794] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-06. [2025-09-17T22:11:02.015798] [INFO ] [REMOTE ] TRN: Fetching primary data for 2025-09. [2025-09-17T22:11:02.127420] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T22:11:02.815803] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-06. [2025-09-17T22:11:02.995571] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T22:11:03.277494] [INFO ] [REMOTE ] TRN: Incremental fetch complete for 2025-09 (1.26 seconds). [2025-09-17T22:11:03.282339] [INFO ] [REMOTE ] TRN: Full fetch complete (52652 records). [2025-09-17T22:11:03.282475] [DEBUG] [VALIDATOR ] TRN: Validating primary data. [2025-09-17T22:11:03.620563] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-07. [2025-09-17T22:11:03.673686] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T22:11:03.749158] [DEBUG] [VALIDATOR ] TRN: All expected trading days are present. [2025-09-17T22:11:03.749254] [DEBUG] [VALIDATOR ] TRN: Primary data validation passed. [2025-09-17T22:11:03.750250] [INFO ] [MAIN ] TRN: Fetched primary data is valid. [2025-09-17T22:11:03.750319] [DEBUG] [LOCAL ] TRN: Saving primary data. [2025-09-17T22:11:03.751633] [DEBUG] [LOCAL ] TRN: Trimmed 52652 records to 37514 (keeping 200 days of data) [2025-09-17T22:11:03.999766] [DEBUG] [LOCAL ] TRN: Primary data saved (37514 records). [2025-09-17T22:11:03.999968] [INFO ] [MAIN ] TRN: Full history saved. [2025-09-17T22:11:04.000059] [INFO ] [MAIN ] Update Progress: 2125/2371 symbols completed. TRN took 26.6s. Estimated remaining: 36m 0s. Rate: 6.8 symbols/min [2025-09-17T22:11:04.194735] [INFO ] [MAIN ] TRNO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:11:04.240094] [DEBUG] [LOCAL ] TRNO: Loaded 44293 existing records from primary storage. [2025-09-17T22:11:04.240256] [INFO ] [MAIN ] TRNO: Loaded 44293 existing records. [2025-09-17T22:11:04.420928] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-07. [2025-09-17T22:11:04.426920] [WARN ] [MAIN ] TRNO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:11:04.427176] [INFO ] [MAIN ] TRNO: Wiping existing primary data before full refresh. [2025-09-17T22:11:04.427226] [INFO ] [LOCAL ] TRNO: Starting deletion of primary data. [2025-09-17T22:11:04.428318] [DEBUG] [LOCAL ] TRNO: Deleted primary data file. [2025-09-17T22:11:04.428382] [INFO ] [MAIN ] TRNO: Starting full primary refresh. [2025-09-17T22:11:04.832504] [INFO ] [REMOTE ] TRNO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:11:05.215781] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-11. [2025-09-17T22:11:05.394817] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T22:11:05.524735] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T22:11:06.015785] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-08. [2025-09-17T22:11:06.359323] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-11 (1.14 seconds). [2025-09-17T22:11:06.815782] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2024-12. [2025-09-17T22:11:07.390553] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T22:11:07.615793] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-07. [2025-09-17T22:11:08.415755] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-08. [2025-09-17T22:11:08.514887] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T22:11:08.991817] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-08 (0.58 seconds). [2025-09-17T22:11:09.215816] [INFO ] [REMOTE ] TREX: Fetching primary data for 2025-09. [2025-09-17T22:11:09.336078] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T22:11:10.015785] [INFO ] [REMOTE ] TRC: Fetching primary data for 2025-09. [2025-09-17T22:11:10.453809] [INFO ] [REMOTE ] TREX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T22:11:10.460835] [INFO ] [REMOTE ] TREX: Full fetch complete (70506 records). [2025-09-17T22:11:10.461028] [DEBUG] [VALIDATOR ] TREX: Validating primary data. [2025-09-17T22:11:10.664329] [INFO ] [REMOTE ] TRC: Incremental fetch complete for 2025-09 (0.65 seconds). [2025-09-17T22:11:10.759338] [INFO ] [REMOTE ] TRC: Full fetch complete (21889 records). [2025-09-17T22:11:10.770701] [DEBUG] [VALIDATOR ] TRC: Validating primary data. [2025-09-17T22:11:10.836957] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-08. [2025-09-17T22:11:11.068612] [DEBUG] [VALIDATOR ] TREX: All expected trading days are present. [2025-09-17T22:11:11.080746] [DEBUG] [VALIDATOR ] TREX: Primary data validation passed. [2025-09-17T22:11:11.093721] [INFO ] [MAIN ] TREX: Fetched primary data is valid. [2025-09-17T22:11:11.095616] [DEBUG] [LOCAL ] TREX: Saving primary data. [2025-09-17T22:11:11.243048] [DEBUG] [LOCAL ] TREX: Trimmed 70506 records to 49969 (keeping 200 days of data) [2025-09-17T22:11:11.423548] [DEBUG] [VALIDATOR ] TRC: All expected trading days are present. [2025-09-17T22:11:11.438509] [DEBUG] [VALIDATOR ] TRC: Primary data validation passed. [2025-09-17T22:11:11.458105] [INFO ] [MAIN ] TRC: Fetched primary data is valid. [2025-09-17T22:11:11.458312] [DEBUG] [LOCAL ] TRC: Saving primary data. [2025-09-17T22:11:11.544941] [DEBUG] [LOCAL ] TRC: Trimmed 21889 records to 15990 (keeping 200 days of data) [2025-09-17T22:11:11.637767] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-01. [2025-09-17T22:11:11.733766] [DEBUG] [LOCAL ] TRC: Primary data saved (15990 records). [2025-09-17T22:11:11.735787] [INFO ] [MAIN ] TRC: Full history saved. [2025-09-17T22:11:11.736366] [INFO ] [MAIN ] Update Progress: 2126/2371 symbols completed. TRC took 42.1s. Estimated remaining: 35m 52s. Rate: 6.8 symbols/min [2025-09-17T22:11:11.933832] [INFO ] [MAIN ] TROX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:11:11.939259] [DEBUG] [LOCAL ] TREX: Primary data saved (49969 records). [2025-09-17T22:11:11.939372] [INFO ] [MAIN ] TREX: Full history saved. [2025-09-17T22:11:11.939542] [INFO ] [MAIN ] Update Progress: 2127/2371 symbols completed. TREX took 41.1s. Estimated remaining: 35m 42s. Rate: 6.8 symbols/min [2025-09-17T22:11:12.116496] [INFO ] [MAIN ] TRP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:11:12.165688] [DEBUG] [LOCAL ] TROX: Loaded 51715 existing records from primary storage. [2025-09-17T22:11:12.165851] [INFO ] [MAIN ] TROX: Loaded 51715 existing records. [2025-09-17T22:11:12.385187] [WARN ] [MAIN ] TROX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:11:12.385437] [INFO ] [MAIN ] TROX: Wiping existing primary data before full refresh. [2025-09-17T22:11:12.385490] [INFO ] [LOCAL ] TROX: Starting deletion of primary data. [2025-09-17T22:11:12.386538] [DEBUG] [LOCAL ] TROX: Deleted primary data file. [2025-09-17T22:11:12.386613] [INFO ] [MAIN ] TROX: Starting full primary refresh. [2025-09-17T22:11:12.420047] [DEBUG] [LOCAL ] TRP: Loaded 52181 existing records from primary storage. [2025-09-17T22:11:12.459055] [INFO ] [MAIN ] TRP: Loaded 52181 existing records. [2025-09-17T22:11:12.948529] [WARN ] [MAIN ] TRP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:11:12.993496] [INFO ] [REMOTE ] TROX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:11:12.989807] [INFO ] [MAIN ] TRP: Wiping existing primary data before full refresh. [2025-09-17T22:11:12.993717] [INFO ] [LOCAL ] TRP: Starting deletion of primary data. [2025-09-17T22:11:12.994070] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-11. [2025-09-17T22:11:12.996466] [DEBUG] [LOCAL ] TRP: Deleted primary data file. [2025-09-17T22:11:12.996700] [INFO ] [MAIN ] TRP: Starting full primary refresh. [2025-09-17T22:11:13.158327] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-08 (2.32 seconds). [2025-09-17T22:11:13.308585] [INFO ] [REMOTE ] TRGP: Fetching primary data for 2025-09. [2025-09-17T22:11:13.418582] [INFO ] [REMOTE ] TRP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:11:13.441607] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T22:11:14.022421] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-02. [2025-09-17T22:11:14.034835] [INFO ] [REMOTE ] TRGP: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T22:11:14.043689] [INFO ] [REMOTE ] TRGP: Full fetch complete (73345 records). [2025-09-17T22:11:14.043807] [DEBUG] [VALIDATOR ] TRGP: Validating primary data. [2025-09-17T22:11:14.468395] [DEBUG] [VALIDATOR ] TRGP: All expected trading days are present. [2025-09-17T22:11:14.468588] [DEBUG] [VALIDATOR ] TRGP: Primary data validation passed. [2025-09-17T22:11:14.470221] [INFO ] [MAIN ] TRGP: Fetched primary data is valid. [2025-09-17T22:11:14.470342] [DEBUG] [LOCAL ] TRGP: Saving primary data. [2025-09-17T22:11:14.498531] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T22:11:14.497123] [DEBUG] [LOCAL ] TRGP: Trimmed 73345 records to 50883 (keeping 200 days of data) [2025-09-17T22:11:14.821450] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-11. [2025-09-17T22:11:14.845138] [DEBUG] [LOCAL ] TRGP: Primary data saved (50883 records). [2025-09-17T22:11:14.845243] [INFO ] [MAIN ] TRGP: Full history saved. [2025-09-17T22:11:14.847714] [INFO ] [MAIN ] Update Progress: 2128/2371 symbols completed. TRGP took 38.9s. Estimated remaining: 35m 32s. Rate: 6.8 symbols/min [2025-09-17T22:11:15.018248] [INFO ] [MAIN ] TRTX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:11:15.072359] [DEBUG] [LOCAL ] TRTX: Loaded 37314 existing records from primary storage. [2025-09-17T22:11:15.072503] [INFO ] [MAIN ] TRTX: Loaded 37314 existing records. [2025-09-17T22:11:15.253814] [WARN ] [MAIN ] TRTX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:11:15.254139] [INFO ] [MAIN ] TRTX: Wiping existing primary data before full refresh. [2025-09-17T22:11:15.254193] [INFO ] [LOCAL ] TRTX: Starting deletion of primary data. [2025-09-17T22:11:15.255000] [DEBUG] [LOCAL ] TRTX: Deleted primary data file. [2025-09-17T22:11:15.255071] [INFO ] [MAIN ] TRTX: Starting full primary refresh. [2025-09-17T22:11:15.634726] [INFO ] [REMOTE ] TRTX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:11:15.627814] [INFO ] [REMOTE ] TROX: Fetching primary data for 2024-12. [2025-09-17T22:11:15.663932] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T22:11:16.415777] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-03. [2025-09-17T22:11:16.646220] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T22:11:17.215763] [INFO ] [REMOTE ] TRP: Fetching primary data for 2024-12. [2025-09-17T22:11:17.373030] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T22:11:17.856606] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T22:11:18.015757] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-04. [2025-09-17T22:11:18.815831] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-01. [2025-09-17T22:11:19.056021] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T22:11:19.615760] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-11. [2025-09-17T22:11:19.674143] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T22:11:20.080219] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T22:11:20.415774] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-05. [2025-09-17T22:11:20.903110] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T22:11:21.215792] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-02. [2025-09-17T22:11:22.015712] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2024-12. [2025-09-17T22:11:22.070410] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T22:11:22.741536] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T22:11:22.815802] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-06. [2025-09-17T22:11:23.453938] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T22:11:23.615798] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-03. [2025-09-17T22:11:24.194565] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T22:11:24.415797] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-01. [2025-09-17T22:11:24.984990] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T22:11:25.215789] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-07. [2025-09-17T22:11:25.767584] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-01 (1.35 seconds). [2025-09-17T22:11:26.015798] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-04. [2025-09-17T22:11:26.565172] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-07 (1.35 seconds). [2025-09-17T22:11:26.815785] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-01. [2025-09-17T22:11:27.615772] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-08. [2025-09-17T22:11:27.672546] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T22:11:28.415768] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-02. [2025-09-17T22:11:28.487235] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-01 (1.67 seconds). [2025-09-17T22:11:28.923580] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T22:11:29.215791] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-02. [2025-09-17T22:11:29.755973] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-02 (1.34 seconds). [2025-09-17T22:11:30.015782] [INFO ] [REMOTE ] TRNO: Fetching primary data for 2025-09. [2025-09-17T22:11:30.815822] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-05. [2025-09-17T22:11:30.953766] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T22:11:31.041604] [INFO ] [REMOTE ] TRNO: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T22:11:31.049583] [INFO ] [REMOTE ] TRNO: Full fetch complete (63903 records). [2025-09-17T22:11:31.049740] [DEBUG] [VALIDATOR ] TRNO: Validating primary data. [2025-09-17T22:11:31.453168] [DEBUG] [VALIDATOR ] TRNO: All expected trading days are present. [2025-09-17T22:11:31.453340] [DEBUG] [VALIDATOR ] TRNO: Primary data validation passed. [2025-09-17T22:11:31.454361] [INFO ] [MAIN ] TRNO: Fetched primary data is valid. [2025-09-17T22:11:31.454427] [DEBUG] [LOCAL ] TRNO: Saving primary data. [2025-09-17T22:11:31.455759] [DEBUG] [LOCAL ] TRNO: Trimmed 63903 records to 44243 (keeping 200 days of data) [2025-09-17T22:11:31.629718] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-03. [2025-09-17T22:11:31.725932] [DEBUG] [LOCAL ] TRNO: Primary data saved (44243 records). [2025-09-17T22:11:31.726086] [INFO ] [MAIN ] TRNO: Full history saved. [2025-09-17T22:11:31.726229] [INFO ] [MAIN ] Update Progress: 2129/2371 symbols completed. TRNO took 27.7s. Estimated remaining: 35m 24s. Rate: 6.8 symbols/min [2025-09-17T22:11:31.914412] [INFO ] [MAIN ] TRU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:11:31.968235] [DEBUG] [LOCAL ] TRU: Loaded 51160 existing records from primary storage. [2025-09-17T22:11:31.968386] [INFO ] [MAIN ] TRU: Loaded 51160 existing records. [2025-09-17T22:11:32.155281] [WARN ] [MAIN ] TRU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:11:32.155632] [INFO ] [MAIN ] TRU: Wiping existing primary data before full refresh. [2025-09-17T22:11:32.155718] [INFO ] [LOCAL ] TRU: Starting deletion of primary data. [2025-09-17T22:11:32.156976] [DEBUG] [LOCAL ] TRU: Deleted primary data file. [2025-09-17T22:11:32.157041] [INFO ] [MAIN ] TRU: Starting full primary refresh. [2025-09-17T22:11:32.420874] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-03. [2025-09-17T22:11:32.534674] [INFO ] [REMOTE ] TRU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:11:32.641671] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T22:11:33.215808] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-06. [2025-09-17T22:11:33.430661] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T22:11:33.700923] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T22:11:34.015784] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-04. [2025-09-17T22:11:34.643822] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T22:11:34.815781] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-07. [2025-09-17T22:11:35.531128] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-04 (1.52 seconds). [2025-09-17T22:11:35.615768] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-05. [2025-09-17T22:11:36.415784] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-04. [2025-09-17T22:11:36.640584] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T22:11:36.975009] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T22:11:37.215782] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-08. [2025-09-17T22:11:38.015757] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-06. [2025-09-17T22:11:38.106336] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T22:11:38.815766] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-11. [2025-09-17T22:11:39.061519] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-08 (1.85 seconds). [2025-09-17T22:11:39.127962] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T22:11:39.615778] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-07. [2025-09-17T22:11:40.126478] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T22:11:40.415769] [INFO ] [REMOTE ] TRU: Fetching primary data for 2024-12. [2025-09-17T22:11:40.713066] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T22:11:41.215825] [INFO ] [REMOTE ] TROX: Fetching primary data for 2025-09. [2025-09-17T22:11:42.015752] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-08. [2025-09-17T22:11:42.189447] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T22:11:42.815779] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-05. [2025-09-17T22:11:42.861951] [INFO ] [REMOTE ] TROX: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T22:11:42.868826] [INFO ] [REMOTE ] TROX: Full fetch complete (71985 records). [2025-09-17T22:11:42.868944] [DEBUG] [VALIDATOR ] TROX: Validating primary data. [2025-09-17T22:11:43.278429] [DEBUG] [VALIDATOR ] TROX: All expected trading days are present. [2025-09-17T22:11:43.278533] [DEBUG] [VALIDATOR ] TROX: Primary data validation passed. [2025-09-17T22:11:43.279592] [INFO ] [MAIN ] TROX: Fetched primary data is valid. [2025-09-17T22:11:43.279702] [DEBUG] [LOCAL ] TROX: Saving primary data. [2025-09-17T22:11:43.300582] [DEBUG] [LOCAL ] TROX: Trimmed 71985 records to 51751 (keeping 200 days of data) [2025-09-17T22:11:43.300452] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T22:11:43.608748] [DEBUG] [LOCAL ] TROX: Primary data saved (51751 records). [2025-09-17T22:11:43.608882] [INFO ] [MAIN ] TROX: Full history saved. [2025-09-17T22:11:43.610690] [INFO ] [MAIN ] Update Progress: 2130/2371 symbols completed. TROX took 31.9s. Estimated remaining: 35m 16s. Rate: 6.8 symbols/min [2025-09-17T22:11:43.622714] [INFO ] [REMOTE ] TRTX: Fetching primary data for 2025-09. [2025-09-17T22:11:43.795545] [INFO ] [MAIN ] TRV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:11:43.850049] [DEBUG] [LOCAL ] TRV: Loaded 48449 existing records from primary storage. [2025-09-17T22:11:43.850206] [INFO ] [MAIN ] TRV: Loaded 48449 existing records. [2025-09-17T22:11:44.033163] [WARN ] [MAIN ] TRV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:11:44.033472] [INFO ] [MAIN ] TRV: Wiping existing primary data before full refresh. [2025-09-17T22:11:44.033544] [INFO ] [LOCAL ] TRV: Starting deletion of primary data. [2025-09-17T22:11:44.034972] [DEBUG] [LOCAL ] TRV: Deleted primary data file. [2025-09-17T22:11:44.035033] [INFO ] [MAIN ] TRV: Starting full primary refresh. [2025-09-17T22:11:44.407919] [INFO ] [REMOTE ] TRV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:11:44.420848] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-01. [2025-09-17T22:11:44.439550] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T22:11:45.044758] [INFO ] [REMOTE ] TRTX: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T22:11:45.050024] [INFO ] [REMOTE ] TRTX: Full fetch complete (52645 records). [2025-09-17T22:11:45.050156] [DEBUG] [VALIDATOR ] TRTX: Validating primary data. [2025-09-17T22:11:45.233160] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-11. [2025-09-17T22:11:45.448704] [DEBUG] [VALIDATOR ] TRTX: All expected trading days are present. [2025-09-17T22:11:45.448788] [DEBUG] [VALIDATOR ] TRTX: Primary data validation passed. [2025-09-17T22:11:45.449639] [INFO ] [MAIN ] TRTX: Fetched primary data is valid. [2025-09-17T22:11:45.449723] [DEBUG] [LOCAL ] TRTX: Saving primary data. [2025-09-17T22:11:45.450839] [DEBUG] [LOCAL ] TRTX: Trimmed 52645 records to 37363 (keeping 200 days of data) [2025-09-17T22:11:45.672815] [DEBUG] [LOCAL ] TRTX: Primary data saved (37363 records). [2025-09-17T22:11:45.672961] [INFO ] [MAIN ] TRTX: Full history saved. [2025-09-17T22:11:45.673061] [INFO ] [MAIN ] Update Progress: 2131/2371 symbols completed. TRTX took 30.8s. Estimated remaining: 35m 6s. Rate: 6.8 symbols/min [2025-09-17T22:11:45.848817] [INFO ] [MAIN ] TS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:11:45.903923] [DEBUG] [LOCAL ] TS: Loaded 51706 existing records from primary storage. [2025-09-17T22:11:45.904106] [INFO ] [MAIN ] TS: Loaded 51706 existing records. [2025-09-17T22:11:46.019040] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-06. [2025-09-17T22:11:46.098465] [WARN ] [MAIN ] TS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:11:46.108038] [INFO ] [MAIN ] TS: Wiping existing primary data before full refresh. [2025-09-17T22:11:46.115035] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-17T22:11:46.125699] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T22:11:46.125755] [DEBUG] [LOCAL ] TS: Deleted primary data file. [2025-09-17T22:11:46.135212] [INFO ] [MAIN ] TS: Starting full primary refresh. [2025-09-17T22:11:46.516854] [INFO ] [REMOTE ] TS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:11:46.683762] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T22:11:46.815801] [INFO ] [REMOTE ] TRV: Fetching primary data for 2024-12. [2025-09-17T22:11:47.615768] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-11. [2025-09-17T22:11:47.745452] [DEBUG] [REMOTE ] TS: Error fetching primary data for 2024-11: 'API call returned an empty response.' [2025-09-17T22:11:47.745888] [WARN ] [REMOTE ] TS: No data returned for month 2024-11 [2025-09-17T22:11:47.798741] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T22:11:48.415837] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-02. [2025-09-17T22:11:48.542176] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2024-12 (1.73 seconds). [2025-09-17T22:11:49.215794] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-01. [2025-09-17T22:11:50.015783] [INFO ] [REMOTE ] TS: Fetching primary data for 2024-12. [2025-09-17T22:11:50.103142] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T22:11:50.815855] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-03. [2025-09-17T22:11:51.208792] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T22:11:51.615861] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-02. [2025-09-17T22:11:51.949447] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2024-12 (1.93 seconds). [2025-09-17T22:11:52.415854] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-07. [2025-09-17T22:11:52.659492] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-03 (1.84 seconds). [2025-09-17T22:11:53.146580] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T22:11:53.215776] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-03. [2025-09-17T22:11:54.015819] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-01. [2025-09-17T22:11:54.115556] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T22:11:54.815823] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-08. [2025-09-17T22:11:55.064677] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-03 (1.85 seconds). [2025-09-17T22:11:55.617683] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-04. [2025-09-17T22:11:55.693065] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T22:11:56.415751] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-02. [2025-09-17T22:11:56.535429] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-08 (1.72 seconds). [2025-09-17T22:11:57.215783] [INFO ] [REMOTE ] TRP: Fetching primary data for 2025-09. [2025-09-17T22:11:57.475677] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-04 (1.86 seconds). [2025-09-17T22:11:58.018585] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-05. [2025-09-17T22:11:58.023775] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T22:11:58.741048] [INFO ] [REMOTE ] TRP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T22:11:58.748420] [INFO ] [REMOTE ] TRP: Full fetch complete (75449 records). [2025-09-17T22:11:58.748622] [DEBUG] [VALIDATOR ] TRP: Validating primary data. [2025-09-17T22:11:58.821106] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-03. [2025-09-17T22:11:59.187701] [DEBUG] [VALIDATOR ] TRP: All expected trading days are present. [2025-09-17T22:11:59.187813] [DEBUG] [VALIDATOR ] TRP: Primary data validation passed. [2025-09-17T22:11:59.189002] [INFO ] [MAIN ] TRP: Fetched primary data is valid. [2025-09-17T22:11:59.189068] [DEBUG] [LOCAL ] TRP: Saving primary data. [2025-09-17T22:11:59.190898] [DEBUG] [LOCAL ] TRP: Trimmed 75449 records to 52167 (keeping 200 days of data) [2025-09-17T22:11:59.520035] [DEBUG] [LOCAL ] TRP: Primary data saved (52167 records). [2025-09-17T22:11:59.520196] [INFO ] [MAIN ] TRP: Full history saved. [2025-09-17T22:11:59.520339] [INFO ] [MAIN ] Update Progress: 2132/2371 symbols completed. TRP took 47.6s. Estimated remaining: 34m 58s. Rate: 6.8 symbols/min [2025-09-17T22:11:59.620926] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-04. [2025-09-17T22:11:59.696623] [INFO ] [MAIN ] TSE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:11:59.731932] [DEBUG] [LOCAL ] TSE: Loaded 29040 existing records from primary storage. [2025-09-17T22:11:59.732086] [INFO ] [MAIN ] TSE: Loaded 29040 existing records. [2025-09-17T22:11:59.937175] [WARN ] [MAIN ] TSE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:11:59.953624] [INFO ] [MAIN ] TSE: Wiping existing primary data before full refresh. [2025-09-17T22:11:59.955500] [INFO ] [LOCAL ] TSE: Starting deletion of primary data. [2025-09-17T22:11:59.955340] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T22:11:59.966343] [DEBUG] [LOCAL ] TSE: Deleted primary data file. [2025-09-17T22:11:59.967127] [INFO ] [MAIN ] TSE: Starting full primary refresh. [2025-09-17T22:12:00.375286] [INFO ] [REMOTE ] TSE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:12:00.415794] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-06. [2025-09-17T22:12:00.694444] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T22:12:01.215784] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-04. [2025-09-17T22:12:02.015834] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-11. [2025-09-17T22:12:02.619691] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-04 (3.00 seconds). [2025-09-17T22:12:02.826501] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-05. [2025-09-17T22:12:02.831831] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-06 (2.42 seconds). [2025-09-17T22:12:03.615800] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-07. [2025-09-17T22:12:04.386916] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-04 (3.17 seconds). [2025-09-17T22:12:04.415754] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-05. [2025-09-17T22:12:04.813603] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-11 (2.80 seconds). [2025-09-17T22:12:05.215801] [INFO ] [REMOTE ] TSE: Fetching primary data for 2024-12. [2025-09-17T22:12:05.745289] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T22:12:05.824412] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-05 (3.00 seconds). [2025-09-17T22:12:06.015795] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-08. [2025-09-17T22:12:06.428297] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-05 (2.01 seconds). [2025-09-17T22:12:06.496348] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T22:12:06.815825] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-06. [2025-09-17T22:12:07.489740] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T22:12:07.615764] [INFO ] [REMOTE ] TRU: Fetching primary data for 2025-09. [2025-09-17T22:12:08.415763] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-01. [2025-09-17T22:12:08.454610] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T22:12:08.869863] [INFO ] [REMOTE ] TRU: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T22:12:08.878503] [INFO ] [REMOTE ] TRU: Full fetch complete (72730 records). [2025-09-17T22:12:08.878759] [DEBUG] [VALIDATOR ] TRU: Validating primary data. [2025-09-17T22:12:09.222559] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-06. [2025-09-17T22:12:09.332390] [DEBUG] [VALIDATOR ] TRU: All expected trading days are present. [2025-09-17T22:12:09.332529] [DEBUG] [VALIDATOR ] TRU: Primary data validation passed. [2025-09-17T22:12:09.333988] [INFO ] [MAIN ] TRU: Fetched primary data is valid. [2025-09-17T22:12:09.334073] [DEBUG] [LOCAL ] TRU: Saving primary data. [2025-09-17T22:12:09.350987] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T22:12:09.356635] [DEBUG] [LOCAL ] TRU: Trimmed 72730 records to 51175 (keeping 200 days of data) [2025-09-17T22:12:09.698360] [DEBUG] [LOCAL ] TRU: Primary data saved (51175 records). [2025-09-17T22:12:09.698533] [INFO ] [MAIN ] TRU: Full history saved. [2025-09-17T22:12:09.698671] [INFO ] [MAIN ] Update Progress: 2133/2371 symbols completed. TRU took 38.0s. Estimated remaining: 34m 50s. Rate: 6.8 symbols/min [2025-09-17T22:12:09.885996] [INFO ] [MAIN ] TSI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:12:09.897086] [DEBUG] [LOCAL ] TSI: Loaded 8680 existing records from primary storage. [2025-09-17T22:12:09.897222] [INFO ] [MAIN ] TSI: Loaded 8680 existing records. [2025-09-17T22:12:10.020914] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-07. [2025-09-17T22:12:10.092726] [WARN ] [MAIN ] TSI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:12:10.092967] [INFO ] [MAIN ] TSI: Wiping existing primary data before full refresh. [2025-09-17T22:12:10.093015] [INFO ] [LOCAL ] TSI: Starting deletion of primary data. [2025-09-17T22:12:10.093353] [DEBUG] [LOCAL ] TSI: Deleted primary data file. [2025-09-17T22:12:10.093411] [INFO ] [MAIN ] TSI: Starting full primary refresh. [2025-09-17T22:12:10.476589] [INFO ] [REMOTE ] TSI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:12:10.815793] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-02. [2025-09-17T22:12:11.061086] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-06 (1.84 seconds). [2025-09-17T22:12:11.615777] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-07. [2025-09-17T22:12:11.952915] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-07 (1.93 seconds). [2025-09-17T22:12:12.015583] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T22:12:12.415789] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-03. [2025-09-17T22:12:13.220919] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-11. [2025-09-17T22:12:13.252777] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T22:12:13.862242] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-03 (1.45 seconds). [2025-09-17T22:12:13.922135] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-17T22:12:14.015792] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-04. [2025-09-17T22:12:14.815775] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-08. [2025-09-17T22:12:15.615782] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-08. [2025-09-17T22:12:16.079112] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T22:12:16.415789] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-05. [2025-09-17T22:12:17.215768] [INFO ] [REMOTE ] TSI: Fetching primary data for 2024-12. [2025-09-17T22:12:17.364276] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T22:12:17.681961] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T22:12:17.721809] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-08 (2.91 seconds). [2025-09-17T22:12:17.999418] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2024-12 (0.78 seconds). [2025-09-17T22:12:18.015746] [INFO ] [REMOTE ] TS: Fetching primary data for 2025-09. [2025-09-17T22:12:18.815777] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-01. [2025-09-17T22:12:19.557201] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T22:12:19.615751] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-02. [2025-09-17T22:12:19.634510] [INFO ] [REMOTE ] TS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T22:12:19.641401] [INFO ] [REMOTE ] TS: Full fetch complete (73704 records). [2025-09-17T22:12:19.641538] [DEBUG] [VALIDATOR ] TS: Validating primary data. [2025-09-17T22:12:19.844258] [WARN ] [VALIDATOR ] TS: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T22:12:19.845044] [FATAL] [MAIN ] TS: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:12:19.845118] [WARN ] [MAIN ] TS: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:12:19.845198] [INFO ] [LOCAL ] TS: Starting deletion of primary data. [2025-09-17T22:12:19.845271] [DEBUG] [LOCAL ] TS: No primary data file found to delete. [2025-09-17T22:12:19.845307] [INFO ] [LOCAL ] TS: Starting deletion of derivative data. [2025-09-17T22:12:19.845735] [DEBUG] [LOCAL ] TS: Deleted derivative data file. [2025-09-17T22:12:19.846667] [INFO ] [MAIN ] Update Progress: 2134/2371 symbols completed. TS took 34.2s. Estimated remaining: 34m 41s. Rate: 6.8 symbols/min [2025-09-17T22:12:20.016002] [INFO ] [MAIN ] TSLX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:12:20.056053] [DEBUG] [LOCAL ] TSLX: Loaded 35436 existing records from primary storage. [2025-09-17T22:12:20.056194] [INFO ] [MAIN ] TSLX: Loaded 35436 existing records. [2025-09-17T22:12:20.239800] [WARN ] [MAIN ] TSLX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:12:20.240049] [INFO ] [MAIN ] TSLX: Wiping existing primary data before full refresh. [2025-09-17T22:12:20.240104] [INFO ] [LOCAL ] TSLX: Starting deletion of primary data. [2025-09-17T22:12:20.241064] [DEBUG] [LOCAL ] TSLX: Deleted primary data file. [2025-09-17T22:12:20.241132] [INFO ] [MAIN ] TSLX: Starting full primary refresh. [2025-09-17T22:12:20.422798] [INFO ] [REMOTE ] TRV: Fetching primary data for 2025-09. [2025-09-17T22:12:20.624938] [INFO ] [REMOTE ] TSLX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:12:20.660544] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T22:12:20.930325] [INFO ] [REMOTE ] TRV: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T22:12:20.936466] [INFO ] [REMOTE ] TRV: Full fetch complete (69999 records). [2025-09-17T22:12:20.936623] [DEBUG] [VALIDATOR ] TRV: Validating primary data. [2025-09-17T22:12:21.220926] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-06. [2025-09-17T22:12:21.333092] [DEBUG] [VALIDATOR ] TRV: All expected trading days are present. [2025-09-17T22:12:21.333172] [DEBUG] [VALIDATOR ] TRV: Primary data validation passed. [2025-09-17T22:12:21.334193] [INFO ] [MAIN ] TRV: Fetched primary data is valid. [2025-09-17T22:12:21.334268] [DEBUG] [LOCAL ] TRV: Saving primary data. [2025-09-17T22:12:21.335632] [DEBUG] [LOCAL ] TRV: Trimmed 69999 records to 48413 (keeping 200 days of data) [2025-09-17T22:12:21.636934] [DEBUG] [LOCAL ] TRV: Primary data saved (48413 records). [2025-09-17T22:12:21.637062] [INFO ] [MAIN ] TRV: Full history saved. [2025-09-17T22:12:21.638177] [INFO ] [MAIN ] Update Progress: 2135/2371 symbols completed. TRV took 38.0s. Estimated remaining: 34m 31s. Rate: 6.8 symbols/min [2025-09-17T22:12:21.815921] [INFO ] [MAIN ] TSM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:12:21.880341] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-17T22:12:21.880487] [INFO ] [MAIN ] TSM: Loaded 53819 existing records. [2025-09-17T22:12:22.023812] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-11. [2025-09-17T22:12:22.069111] [WARN ] [MAIN ] TSM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:12:22.069429] [INFO ] [MAIN ] TSM: Wiping existing primary data before full refresh. [2025-09-17T22:12:22.069517] [INFO ] [LOCAL ] TSM: Starting deletion of primary data. [2025-09-17T22:12:22.070848] [DEBUG] [LOCAL ] TSM: Deleted primary data file. [2025-09-17T22:12:22.070910] [INFO ] [MAIN ] TSM: Starting full primary refresh. [2025-09-17T22:12:22.447478] [INFO ] [REMOTE ] TSM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:12:22.610016] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T22:12:22.815755] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-11. [2025-09-17T22:12:23.499216] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-11 (1.48 seconds). [2025-09-17T22:12:23.615763] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2024-12. [2025-09-17T22:12:24.415796] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-07. [2025-09-17T22:12:24.994609] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T22:12:25.154085] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-17T22:12:25.215810] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-01. [2025-09-17T22:12:26.015791] [INFO ] [REMOTE ] TSM: Fetching primary data for 2024-12. [2025-09-17T22:12:26.081224] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T22:12:26.155804] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-01 (0.94 seconds). [2025-09-17T22:12:26.815838] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-02. [2025-09-17T22:12:27.615779] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-03. [2025-09-17T22:12:28.138866] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-02 (1.32 seconds). [2025-09-17T22:12:28.415759] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-03. [2025-09-17T22:12:28.463626] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-17T22:12:28.632920] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-03 (1.02 seconds). [2025-09-17T22:12:29.215799] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-01. [2025-09-17T22:12:29.658554] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-03 (1.24 seconds). [2025-09-17T22:12:30.015773] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-08. [2025-09-17T22:12:30.815802] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-04. [2025-09-17T22:12:31.305785] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T22:12:31.523181] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-01 (2.31 seconds). [2025-09-17T22:12:31.615764] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-04. [2025-09-17T22:12:32.347683] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T22:12:32.399124] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T22:12:32.415726] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-05. [2025-09-17T22:12:32.888211] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-05 (0.47 seconds). [2025-09-17T22:12:33.215788] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-05. [2025-09-17T22:12:34.015782] [INFO ] [REMOTE ] TSE: Fetching primary data for 2025-09. [2025-09-17T22:12:34.260783] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T22:12:34.815822] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-06. [2025-09-17T22:12:34.980568] [INFO ] [REMOTE ] TSE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T22:12:34.984042] [INFO ] [REMOTE ] TSE: Full fetch complete (42078 records). [2025-09-17T22:12:34.984150] [DEBUG] [VALIDATOR ] TSE: Validating primary data. [2025-09-17T22:12:35.379871] [DEBUG] [VALIDATOR ] TSE: All expected trading days are present. [2025-09-17T22:12:35.379968] [DEBUG] [VALIDATOR ] TSE: Primary data validation passed. [2025-09-17T22:12:35.380802] [INFO ] [MAIN ] TSE: Fetched primary data is valid. [2025-09-17T22:12:35.380864] [DEBUG] [LOCAL ] TSE: Saving primary data. [2025-09-17T22:12:35.381886] [DEBUG] [LOCAL ] TSE: Trimmed 42078 records to 28997 (keeping 200 days of data) [2025-09-17T22:12:35.551848] [DEBUG] [LOCAL ] TSE: Primary data saved (28997 records). [2025-09-17T22:12:35.551982] [INFO ] [MAIN ] TSE: Full history saved. [2025-09-17T22:12:35.552100] [INFO ] [MAIN ] Update Progress: 2136/2371 symbols completed. TSE took 36.0s. Estimated remaining: 34m 23s. Rate: 6.8 symbols/min [2025-09-17T22:12:35.620943] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-06. [2025-09-17T22:12:35.738796] [INFO ] [MAIN ] TSN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:12:35.792818] [DEBUG] [LOCAL ] TSN: Loaded 52836 existing records from primary storage. [2025-09-17T22:12:35.792974] [INFO ] [MAIN ] TSN: Loaded 52836 existing records. [2025-09-17T22:12:35.989028] [WARN ] [MAIN ] TSN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:12:35.989305] [INFO ] [MAIN ] TSN: Wiping existing primary data before full refresh. [2025-09-17T22:12:35.989407] [INFO ] [LOCAL ] TSN: Starting deletion of primary data. [2025-09-17T22:12:35.990563] [DEBUG] [LOCAL ] TSN: Deleted primary data file. [2025-09-17T22:12:35.990623] [INFO ] [MAIN ] TSN: Starting full primary refresh. [2025-09-17T22:12:36.279750] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T22:12:36.366757] [INFO ] [REMOTE ] TSN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:12:36.389613] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T22:12:36.415734] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-11. [2025-09-17T22:12:37.215806] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-07. [2025-09-17T22:12:37.967055] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T22:12:38.015757] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-08. [2025-09-17T22:12:38.220070] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T22:12:38.471723] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T22:12:38.815814] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-02. [2025-09-17T22:12:39.615784] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-07. [2025-09-17T22:12:40.415819] [INFO ] [REMOTE ] TSI: Fetching primary data for 2025-09. [2025-09-17T22:12:40.676308] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T22:12:41.051399] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-17T22:12:41.147587] [INFO ] [REMOTE ] TSI: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T22:12:41.150051] [INFO ] [REMOTE ] TSI: Full fetch complete (13286 records). [2025-09-17T22:12:41.150124] [DEBUG] [VALIDATOR ] TSI: Validating primary data. [2025-09-17T22:12:41.223010] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-03. [2025-09-17T22:12:41.540704] [DEBUG] [VALIDATOR ] TSI: All expected trading days are present. [2025-09-17T22:12:41.540806] [DEBUG] [VALIDATOR ] TSI: Primary data validation passed. [2025-09-17T22:12:41.541205] [INFO ] [MAIN ] TSI: Fetched primary data is valid. [2025-09-17T22:12:41.541266] [DEBUG] [LOCAL ] TSI: Saving primary data. [2025-09-17T22:12:41.541812] [DEBUG] [LOCAL ] TSI: Trimmed 13286 records to 8689 (keeping 200 days of data) [2025-09-17T22:12:41.590612] [DEBUG] [LOCAL ] TSI: Primary data saved (8689 records). [2025-09-17T22:12:41.590753] [INFO ] [MAIN ] TSI: Full history saved. [2025-09-17T22:12:41.590845] [INFO ] [MAIN ] Update Progress: 2137/2371 symbols completed. TSI took 31.9s. Estimated remaining: 34m 14s. Rate: 6.8 symbols/min [2025-09-17T22:12:41.762787] [INFO ] [MAIN ] TSQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:12:41.776043] [DEBUG] [LOCAL ] TSQ: Loaded 12055 existing records from primary storage. [2025-09-17T22:12:41.776158] [INFO ] [MAIN ] TSQ: Loaded 12055 existing records. [2025-09-17T22:12:41.957212] [WARN ] [MAIN ] TSQ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:12:41.957474] [INFO ] [MAIN ] TSQ: Wiping existing primary data before full refresh. [2025-09-17T22:12:41.957523] [INFO ] [LOCAL ] TSQ: Starting deletion of primary data. [2025-09-17T22:12:41.957893] [DEBUG] [LOCAL ] TSQ: Deleted primary data file. [2025-09-17T22:12:41.957954] [INFO ] [MAIN ] TSQ: Starting full primary refresh. [2025-09-17T22:12:42.024149] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-08. [2025-09-17T22:12:42.326079] [INFO ] [REMOTE ] TSQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:12:42.815832] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-11. [2025-09-17T22:12:43.483859] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-11 (0.67 seconds). [2025-09-17T22:12:43.522036] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-08 (1.50 seconds). [2025-09-17T22:12:43.615878] [INFO ] [REMOTE ] TSLX: Fetching primary data for 2025-09. [2025-09-17T22:12:44.134244] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-03 (2.91 seconds). [2025-09-17T22:12:44.415825] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2024-12. [2025-09-17T22:12:44.866335] [INFO ] [REMOTE ] TSLX: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T22:12:44.870785] [INFO ] [REMOTE ] TSLX: Full fetch complete (48914 records). [2025-09-17T22:12:44.870882] [DEBUG] [VALIDATOR ] TSLX: Validating primary data. [2025-09-17T22:12:45.221016] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-04. [2025-09-17T22:12:45.274891] [DEBUG] [VALIDATOR ] TSLX: All expected trading days are present. [2025-09-17T22:12:45.275541] [DEBUG] [VALIDATOR ] TSLX: Primary data validation passed. [2025-09-17T22:12:45.276682] [INFO ] [MAIN ] TSLX: Fetched primary data is valid. [2025-09-17T22:12:45.276802] [DEBUG] [LOCAL ] TSLX: Saving primary data. [2025-09-17T22:12:45.284842] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T22:12:45.288545] [DEBUG] [LOCAL ] TSLX: Trimmed 48914 records to 35446 (keeping 200 days of data) [2025-09-17T22:12:45.516262] [DEBUG] [LOCAL ] TSLX: Primary data saved (35446 records). [2025-09-17T22:12:45.516540] [INFO ] [MAIN ] TSLX: Full history saved. [2025-09-17T22:12:45.516723] [INFO ] [MAIN ] Update Progress: 2138/2371 symbols completed. TSLX took 25.7s. Estimated remaining: 34m 5s. Rate: 6.8 symbols/min [2025-09-17T22:12:45.701099] [INFO ] [MAIN ] TT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:12:45.751019] [DEBUG] [LOCAL ] TT: Loaded 48061 existing records from primary storage. [2025-09-17T22:12:45.751211] [INFO ] [MAIN ] TT: Loaded 48061 existing records. [2025-09-17T22:12:45.941794] [WARN ] [MAIN ] TT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:12:45.942080] [INFO ] [MAIN ] TT: Wiping existing primary data before full refresh. [2025-09-17T22:12:45.942129] [INFO ] [LOCAL ] TT: Starting deletion of primary data. [2025-09-17T22:12:45.943190] [DEBUG] [LOCAL ] TT: Deleted primary data file. [2025-09-17T22:12:45.943250] [INFO ] [MAIN ] TT: Starting full primary refresh. [2025-09-17T22:12:46.020938] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-01. [2025-09-17T22:12:46.315979] [INFO ] [REMOTE ] TT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:12:46.815789] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-11. [2025-09-17T22:12:46.968374] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-01 (0.95 seconds). [2025-09-17T22:12:47.615794] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-02. [2025-09-17T22:12:47.880526] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-17T22:12:48.378959] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T22:12:48.415710] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-03. [2025-09-17T22:12:48.504208] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T22:12:49.215773] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-05. [2025-09-17T22:12:49.422288] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-03 (1.01 seconds). [2025-09-17T22:12:50.015801] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-04. [2025-09-17T22:12:50.815810] [INFO ] [REMOTE ] TT: Fetching primary data for 2024-12. [2025-09-17T22:12:50.833378] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T22:12:51.615791] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-05. [2025-09-17T22:12:52.217863] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T22:12:52.269959] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-05 (0.65 seconds). [2025-09-17T22:12:52.260858] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-05 (3.05 seconds). [2025-09-17T22:12:52.415775] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-01. [2025-09-17T22:12:53.215788] [INFO ] [REMOTE ] TSN: Fetching primary data for 2024-12. [2025-09-17T22:12:54.015806] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-06. [2025-09-17T22:12:54.276686] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T22:12:54.815797] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-06. [2025-09-17T22:12:54.956145] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2024-12 (1.74 seconds). [2025-09-17T22:12:54.976420] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T22:12:55.615782] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-07. [2025-09-17T22:12:56.360094] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-07 (0.74 seconds). [2025-09-17T22:12:56.415767] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-02. [2025-09-17T22:12:57.215778] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-01. [2025-09-17T22:12:57.585384] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-06 (2.77 seconds). [2025-09-17T22:12:58.015758] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-08. [2025-09-17T22:12:58.141744] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T22:12:58.640562] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T22:12:58.815814] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-07. [2025-09-17T22:12:59.250218] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-01 (2.03 seconds). [2025-09-17T22:12:59.615785] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-03. [2025-09-17T22:13:00.415787] [INFO ] [REMOTE ] TSQ: Fetching primary data for 2025-09. [2025-09-17T22:13:01.079608] [INFO ] [REMOTE ] TSQ: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T22:13:01.081521] [INFO ] [REMOTE ] TSQ: Full fetch complete (16682 records). [2025-09-17T22:13:01.081607] [DEBUG] [VALIDATOR ] TSQ: Validating primary data. [2025-09-17T22:13:01.216616] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-02. [2025-09-17T22:13:01.491094] [DEBUG] [VALIDATOR ] TSQ: All expected trading days are present. [2025-09-17T22:13:01.491227] [DEBUG] [VALIDATOR ] TSQ: Primary data validation passed. [2025-09-17T22:13:01.491776] [INFO ] [MAIN ] TSQ: Fetched primary data is valid. [2025-09-17T22:13:01.491858] [DEBUG] [LOCAL ] TSQ: Saving primary data. [2025-09-17T22:13:01.492718] [DEBUG] [LOCAL ] TSQ: Trimmed 16682 records to 12062 (keeping 200 days of data) [2025-09-17T22:13:01.583578] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-03 (1.97 seconds). [2025-09-17T22:13:01.611424] [DEBUG] [LOCAL ] TSQ: Primary data saved (12062 records). [2025-09-17T22:13:01.611572] [INFO ] [MAIN ] TSQ: Full history saved. [2025-09-17T22:13:01.611688] [INFO ] [MAIN ] Update Progress: 2139/2371 symbols completed. TSQ took 20.0s. Estimated remaining: 33m 57s. Rate: 6.8 symbols/min [2025-09-17T22:13:01.841829] [INFO ] [MAIN ] TTAM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:13:01.842065] [DEBUG] [LOCAL ] TTAM: No existing data file found in primary storage. [2025-09-17T22:13:01.842146] [WARN ] [MAIN ] TTAM: No existing data found, performing full refresh instead. [2025-09-17T22:13:01.842598] [INFO ] [MAIN ] TTAM: Wiping existing primary data before full refresh. [2025-09-17T22:13:01.842751] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-17T22:13:01.842907] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-17T22:13:01.843037] [INFO ] [MAIN ] TTAM: Starting full primary refresh. [2025-09-17T22:13:02.051420] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-04. [2025-09-17T22:13:02.245720] [INFO ] [REMOTE ] TTAM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:13:02.278690] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-07 (3.46 seconds). [2025-09-17T22:13:02.815779] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-11. [2025-09-17T22:13:03.022562] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:13:03.022936] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-11 [2025-09-17T22:13:03.116400] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T22:13:03.615770] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2024-12. [2025-09-17T22:13:03.818813] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:13:03.819136] [WARN ] [REMOTE ] TTAM: No data returned for month 2024-12 [2025-09-17T22:13:03.855630] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T22:13:04.415783] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-01. [2025-09-17T22:13:04.623130] [DEBUG] [REMOTE ] TTAM: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:13:04.623460] [WARN ] [REMOTE ] TTAM: No data returned for month 2025-01 [2025-09-17T22:13:05.215782] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-08. [2025-09-17T22:13:06.015779] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-02. [2025-09-17T22:13:06.815784] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-05. [2025-09-17T22:13:07.089997] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-02 (1.07 seconds). [2025-09-17T22:13:07.615754] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-03. [2025-09-17T22:13:08.074535] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-08 (2.86 seconds). [2025-09-17T22:13:08.415781] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-03. [2025-09-17T22:13:08.621215] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-05 (1.81 seconds). [2025-09-17T22:13:09.154086] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T22:13:09.215747] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-06. [2025-09-17T22:13:09.467743] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-03 (1.05 seconds). [2025-09-17T22:13:10.015779] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-04. [2025-09-17T22:13:10.660796] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T22:13:10.815762] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-07. [2025-09-17T22:13:10.846873] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T22:13:11.615821] [INFO ] [REMOTE ] TSM: Fetching primary data for 2025-09. [2025-09-17T22:13:12.415763] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-04. [2025-09-17T22:13:12.539358] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T22:13:13.215785] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-05. [2025-09-17T22:13:13.966052] [INFO ] [REMOTE ] TSM: Incremental fetch complete for 2025-09 (2.35 seconds). [2025-09-17T22:13:13.974360] [INFO ] [REMOTE ] TSM: Full fetch complete (77974 records). [2025-09-17T22:13:13.974493] [DEBUG] [VALIDATOR ] TSM: Validating primary data. [2025-09-17T22:13:14.022160] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-08. [2025-09-17T22:13:14.260605] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T22:13:14.415999] [DEBUG] [VALIDATOR ] TSM: All expected trading days are present. [2025-09-17T22:13:14.416184] [DEBUG] [VALIDATOR ] TSM: Primary data validation passed. [2025-09-17T22:13:14.417339] [INFO ] [MAIN ] TSM: Fetched primary data is valid. [2025-09-17T22:13:14.417523] [DEBUG] [LOCAL ] TSM: Saving primary data. [2025-09-17T22:13:14.419448] [DEBUG] [LOCAL ] TSM: Trimmed 77974 records to 53819 (keeping 200 days of data) [2025-09-17T22:13:14.550475] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-04 (2.13 seconds). [2025-09-17T22:13:14.808146] [DEBUG] [LOCAL ] TSM: Primary data saved (53819 records). [2025-09-17T22:13:14.808286] [INFO ] [MAIN ] TSM: Full history saved. [2025-09-17T22:13:14.810582] [INFO ] [MAIN ] Update Progress: 2140/2371 symbols completed. TSM took 53.2s. Estimated remaining: 33m 49s. Rate: 6.8 symbols/min [2025-09-17T22:13:14.822438] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-05. [2025-09-17T22:13:14.986414] [INFO ] [MAIN ] TTC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:13:15.043807] [DEBUG] [LOCAL ] TTC: Loaded 43142 existing records from primary storage. [2025-09-17T22:13:15.044031] [INFO ] [MAIN ] TTC: Loaded 43142 existing records. [2025-09-17T22:13:15.231468] [WARN ] [MAIN ] TTC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:13:15.231826] [INFO ] [MAIN ] TTC: Wiping existing primary data before full refresh. [2025-09-17T22:13:15.231888] [INFO ] [LOCAL ] TTC: Starting deletion of primary data. [2025-09-17T22:13:15.232953] [DEBUG] [LOCAL ] TTC: Deleted primary data file. [2025-09-17T22:13:15.233032] [INFO ] [MAIN ] TTC: Starting full primary refresh. [2025-09-17T22:13:15.597246] [INFO ] [REMOTE ] TTC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:13:15.615738] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-11. [2025-09-17T22:13:15.782376] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T22:13:16.415796] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-06. [2025-09-17T22:13:16.586575] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T22:13:17.222992] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-06. [2025-09-17T22:13:17.237727] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T22:13:17.757443] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T22:13:18.015768] [INFO ] [REMOTE ] TTC: Fetching primary data for 2024-12. [2025-09-17T22:13:18.815693] [INFO ] [REMOTE ] TT: Fetching primary data for 2025-09. [2025-09-17T22:13:18.923192] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T22:13:19.434436] [INFO ] [REMOTE ] TT: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T22:13:19.441476] [INFO ] [REMOTE ] TT: Full fetch complete (69638 records). [2025-09-17T22:13:19.441777] [DEBUG] [VALIDATOR ] TT: Validating primary data. [2025-09-17T22:13:19.616281] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-07. [2025-09-17T22:13:19.849160] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T22:13:19.917249] [DEBUG] [VALIDATOR ] TT: All expected trading days are present. [2025-09-17T22:13:19.917342] [DEBUG] [VALIDATOR ] TT: Primary data validation passed. [2025-09-17T22:13:19.918381] [INFO ] [MAIN ] TT: Fetched primary data is valid. [2025-09-17T22:13:19.918472] [DEBUG] [LOCAL ] TT: Saving primary data. [2025-09-17T22:13:19.920576] [DEBUG] [LOCAL ] TT: Trimmed 69638 records to 48052 (keeping 200 days of data) [2025-09-17T22:13:20.225218] [DEBUG] [LOCAL ] TT: Primary data saved (48052 records). [2025-09-17T22:13:20.225364] [INFO ] [MAIN ] TT: Full history saved. [2025-09-17T22:13:20.228368] [INFO ] [MAIN ] Update Progress: 2141/2371 symbols completed. TT took 34.7s. Estimated remaining: 33m 39s. Rate: 6.8 symbols/min [2025-09-17T22:13:20.397880] [INFO ] [MAIN ] TTE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:13:20.415791] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-01. [2025-09-17T22:13:20.462155] [DEBUG] [LOCAL ] TTE: Loaded 51677 existing records from primary storage. [2025-09-17T22:13:20.462324] [INFO ] [MAIN ] TTE: Loaded 51677 existing records. [2025-09-17T22:13:20.651155] [WARN ] [MAIN ] TTE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:13:20.651436] [INFO ] [MAIN ] TTE: Wiping existing primary data before full refresh. [2025-09-17T22:13:20.651484] [INFO ] [LOCAL ] TTE: Starting deletion of primary data. [2025-09-17T22:13:20.652709] [DEBUG] [LOCAL ] TTE: Deleted primary data file. [2025-09-17T22:13:20.652781] [INFO ] [MAIN ] TTE: Starting full primary refresh. [2025-09-17T22:13:21.009569] [INFO ] [REMOTE ] TTE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:13:21.215786] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-07. [2025-09-17T22:13:21.942342] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-07 (2.33 seconds). [2025-09-17T22:13:21.994947] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-01 (1.58 seconds). [2025-09-17T22:13:22.015728] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-02. [2025-09-17T22:13:22.825151] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-11. [2025-09-17T22:13:22.830294] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T22:13:23.571292] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T22:13:23.615745] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-03. [2025-09-17T22:13:24.228348] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T22:13:24.415831] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-08. [2025-09-17T22:13:25.130546] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T22:13:25.215791] [INFO ] [REMOTE ] TTE: Fetching primary data for 2024-12. [2025-09-17T22:13:26.015752] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-04. [2025-09-17T22:13:26.469617] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T22:13:26.815755] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-08. [2025-09-17T22:13:27.191117] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2024-12 (1.98 seconds). [2025-09-17T22:13:27.615750] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-01. [2025-09-17T22:13:27.643147] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T22:13:28.129376] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-08 (1.31 seconds). [2025-09-17T22:13:28.415810] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-05. [2025-09-17T22:13:29.215836] [INFO ] [REMOTE ] TSN: Fetching primary data for 2025-09. [2025-09-17T22:13:29.384079] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T22:13:30.015784] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-02. [2025-09-17T22:13:30.069621] [INFO ] [REMOTE ] TSN: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T22:13:30.077627] [INFO ] [REMOTE ] TSN: Full fetch complete (76015 records). [2025-09-17T22:13:30.092853] [DEBUG] [VALIDATOR ] TSN: Validating primary data. [2025-09-17T22:13:30.105771] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T22:13:30.530061] [DEBUG] [VALIDATOR ] TSN: All expected trading days are present. [2025-09-17T22:13:30.530160] [DEBUG] [VALIDATOR ] TSN: Primary data validation passed. [2025-09-17T22:13:30.531233] [INFO ] [MAIN ] TSN: Fetched primary data is valid. [2025-09-17T22:13:30.531303] [DEBUG] [LOCAL ] TSN: Saving primary data. [2025-09-17T22:13:30.534247] [DEBUG] [LOCAL ] TSN: Trimmed 76015 records to 52836 (keeping 200 days of data) [2025-09-17T22:13:30.840038] [INFO ] [REMOTE ] TTAM: Fetching primary data for 2025-09. [2025-09-17T22:13:30.888369] [DEBUG] [LOCAL ] TSN: Primary data saved (52836 records). [2025-09-17T22:13:30.888510] [INFO ] [MAIN ] TSN: Full history saved. [2025-09-17T22:13:30.888670] [INFO ] [MAIN ] Update Progress: 2142/2371 symbols completed. TSN took 55.3s. Estimated remaining: 33m 31s. Rate: 6.8 symbols/min [2025-09-17T22:13:31.061853] [INFO ] [MAIN ] TTI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:13:31.113449] [DEBUG] [LOCAL ] TTI: Loaded 45236 existing records from primary storage. [2025-09-17T22:13:31.113672] [INFO ] [MAIN ] TTI: Loaded 45236 existing records. [2025-09-17T22:13:31.291087] [WARN ] [MAIN ] TTI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:13:31.291351] [INFO ] [MAIN ] TTI: Wiping existing primary data before full refresh. [2025-09-17T22:13:31.291398] [INFO ] [LOCAL ] TTI: Starting deletion of primary data. [2025-09-17T22:13:31.292328] [DEBUG] [LOCAL ] TTI: Deleted primary data file. [2025-09-17T22:13:31.292399] [INFO ] [MAIN ] TTI: Starting full primary refresh. [2025-09-17T22:13:31.621007] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-06. [2025-09-17T22:13:31.695842] [INFO ] [REMOTE ] TTI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:13:32.012053] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T22:13:32.056476] [INFO ] [REMOTE ] TTAM: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T22:13:32.060869] [INFO ] [REMOTE ] TTAM: Full fetch complete (31995 records). [2025-09-17T22:13:32.060968] [DEBUG] [VALIDATOR ] TTAM: Validating primary data. [2025-09-17T22:13:32.265007] [WARN ] [VALIDATOR ] TTAM: Validation failed - insufficient historical data. Have 153 unique days, need 200 days [2025-09-17T22:13:32.265497] [FATAL] [MAIN ] TTAM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:13:32.265586] [WARN ] [MAIN ] TTAM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:13:32.265688] [INFO ] [LOCAL ] TTAM: Starting deletion of primary data. [2025-09-17T22:13:32.265765] [DEBUG] [LOCAL ] TTAM: No primary data file found to delete. [2025-09-17T22:13:32.265815] [INFO ] [LOCAL ] TTAM: Starting deletion of derivative data. [2025-09-17T22:13:32.265899] [DEBUG] [LOCAL ] TTAM: No derivative data file found to delete. [2025-09-17T22:13:32.266003] [INFO ] [MAIN ] Update Progress: 2143/2371 symbols completed. TTAM took 30.7s. Estimated remaining: 33m 21s. Rate: 6.8 symbols/min [2025-09-17T22:13:32.420861] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-03. [2025-09-17T22:13:32.446388] [INFO ] [MAIN ] TU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:13:32.506021] [DEBUG] [LOCAL ] TU: Loaded 49987 existing records from primary storage. [2025-09-17T22:13:32.506176] [INFO ] [MAIN ] TU: Loaded 49987 existing records. [2025-09-17T22:13:32.690777] [WARN ] [MAIN ] TU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:13:32.691068] [INFO ] [MAIN ] TU: Wiping existing primary data before full refresh. [2025-09-17T22:13:32.691123] [INFO ] [LOCAL ] TU: Starting deletion of primary data. [2025-09-17T22:13:32.692368] [DEBUG] [LOCAL ] TU: Deleted primary data file. [2025-09-17T22:13:32.692431] [INFO ] [MAIN ] TU: Starting full primary refresh. [2025-09-17T22:13:33.066127] [INFO ] [REMOTE ] TU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:13:33.215806] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-11. [2025-09-17T22:13:33.423252] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T22:13:34.015866] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-07. [2025-09-17T22:13:34.287179] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T22:13:34.815765] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-04. [2025-09-17T22:13:34.939359] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T22:13:35.224292] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-07 (1.21 seconds). [2025-09-17T22:13:35.615823] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-08. [2025-09-17T22:13:36.415859] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-11. [2025-09-17T22:13:36.770384] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T22:13:37.214019] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T22:13:37.217180] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-05. [2025-09-17T22:13:37.767749] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-11 (1.35 seconds). [2025-09-17T22:13:38.015800] [INFO ] [REMOTE ] TTI: Fetching primary data for 2024-12. [2025-09-17T22:13:38.815795] [INFO ] [REMOTE ] TTC: Fetching primary data for 2025-09. [2025-09-17T22:13:39.054384] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T22:13:39.122444] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T22:13:39.615784] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-06. [2025-09-17T22:13:40.252229] [INFO ] [REMOTE ] TTC: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T22:13:40.257949] [INFO ] [REMOTE ] TTC: Full fetch complete (62086 records). [2025-09-17T22:13:40.258068] [DEBUG] [VALIDATOR ] TTC: Validating primary data. [2025-09-17T22:13:40.417218] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-01. [2025-09-17T22:13:40.653920] [DEBUG] [VALIDATOR ] TTC: All expected trading days are present. [2025-09-17T22:13:40.654043] [DEBUG] [VALIDATOR ] TTC: Primary data validation passed. [2025-09-17T22:13:40.655130] [INFO ] [MAIN ] TTC: Fetched primary data is valid. [2025-09-17T22:13:40.655221] [DEBUG] [LOCAL ] TTC: Saving primary data. [2025-09-17T22:13:40.656949] [DEBUG] [LOCAL ] TTC: Trimmed 62086 records to 43035 (keeping 200 days of data) [2025-09-17T22:13:40.938715] [DEBUG] [LOCAL ] TTC: Primary data saved (43035 records). [2025-09-17T22:13:40.938840] [INFO ] [MAIN ] TTC: Full history saved. [2025-09-17T22:13:40.939710] [INFO ] [MAIN ] Update Progress: 2144/2371 symbols completed. TTC took 26.1s. Estimated remaining: 33m 13s. Rate: 6.8 symbols/min [2025-09-17T22:13:41.111457] [INFO ] [MAIN ] TUYA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:13:41.161332] [DEBUG] [LOCAL ] TUYA: Loaded 46709 existing records from primary storage. [2025-09-17T22:13:41.161692] [INFO ] [MAIN ] TUYA: Loaded 46709 existing records. [2025-09-17T22:13:41.231490] [INFO ] [REMOTE ] TU: Fetching primary data for 2024-12. [2025-09-17T22:13:41.370198] [WARN ] [MAIN ] TUYA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:13:41.384507] [INFO ] [MAIN ] TUYA: Wiping existing primary data before full refresh. [2025-09-17T22:13:41.385189] [INFO ] [LOCAL ] TUYA: Starting deletion of primary data. [2025-09-17T22:13:41.386616] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-06 (1.77 seconds). [2025-09-17T22:13:41.390630] [DEBUG] [LOCAL ] TUYA: Deleted primary data file. [2025-09-17T22:13:41.397197] [INFO ] [MAIN ] TUYA: Starting full primary refresh. [2025-09-17T22:13:41.764514] [INFO ] [REMOTE ] TUYA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:13:42.015937] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-07. [2025-09-17T22:13:42.018058] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T22:13:42.815786] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-11. [2025-09-17T22:13:43.013992] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T22:13:43.615845] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-02. [2025-09-17T22:13:43.838492] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-07 (1.82 seconds). [2025-09-17T22:13:43.923723] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T22:13:44.415786] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2024-12. [2025-09-17T22:13:44.980962] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T22:13:45.215772] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-03. [2025-09-17T22:13:45.923867] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T22:13:46.015809] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-08. [2025-09-17T22:13:46.801727] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T22:13:46.815742] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-04. [2025-09-17T22:13:47.562461] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T22:13:47.615746] [INFO ] [REMOTE ] TTE: Fetching primary data for 2025-09. [2025-09-17T22:13:48.415812] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-01. [2025-09-17T22:13:48.481227] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T22:13:49.215917] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-01. [2025-09-17T22:13:49.340748] [INFO ] [REMOTE ] TTE: Incremental fetch complete for 2025-09 (1.72 seconds). [2025-09-17T22:13:49.348997] [INFO ] [REMOTE ] TTE: Full fetch complete (74941 records). [2025-09-17T22:13:49.349148] [DEBUG] [VALIDATOR ] TTE: Validating primary data. [2025-09-17T22:13:49.762897] [DEBUG] [VALIDATOR ] TTE: All expected trading days are present. [2025-09-17T22:13:49.763080] [DEBUG] [VALIDATOR ] TTE: Primary data validation passed. [2025-09-17T22:13:49.764500] [INFO ] [MAIN ] TTE: Fetched primary data is valid. [2025-09-17T22:13:49.764627] [DEBUG] [LOCAL ] TTE: Saving primary data. [2025-09-17T22:13:49.766707] [DEBUG] [LOCAL ] TTE: Trimmed 74941 records to 51669 (keeping 200 days of data) [2025-09-17T22:13:49.891291] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T22:13:50.025091] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-02. [2025-09-17T22:13:50.150946] [DEBUG] [LOCAL ] TTE: Primary data saved (51669 records). [2025-09-17T22:13:50.151105] [INFO ] [MAIN ] TTE: Full history saved. [2025-09-17T22:13:50.152276] [INFO ] [MAIN ] Update Progress: 2145/2371 symbols completed. TTE took 29.9s. Estimated remaining: 33m 4s. Rate: 6.8 symbols/min [2025-09-17T22:13:50.333347] [INFO ] [MAIN ] TV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:13:50.383602] [DEBUG] [LOCAL ] TV: Loaded 43171 existing records from primary storage. [2025-09-17T22:13:50.383783] [INFO ] [MAIN ] TV: Loaded 43171 existing records. [2025-09-17T22:13:50.577816] [WARN ] [MAIN ] TV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:13:50.578359] [INFO ] [MAIN ] TV: Wiping existing primary data before full refresh. [2025-09-17T22:13:50.578534] [INFO ] [LOCAL ] TV: Starting deletion of primary data. [2025-09-17T22:13:50.586947] [DEBUG] [LOCAL ] TV: Deleted primary data file. [2025-09-17T22:13:50.599120] [INFO ] [MAIN ] TV: Starting full primary refresh. [2025-09-17T22:13:50.682786] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-01 (1.47 seconds). [2025-09-17T22:13:50.820863] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-02. [2025-09-17T22:13:51.016033] [INFO ] [REMOTE ] TV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:13:51.615751] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-11. [2025-09-17T22:13:51.710115] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-02 (1.69 seconds). [2025-09-17T22:13:52.415771] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-03. [2025-09-17T22:13:52.898850] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-02 (2.08 seconds). [2025-09-17T22:13:53.036865] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-11 (1.42 seconds). [2025-09-17T22:13:53.215790] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-03. [2025-09-17T22:13:54.015839] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-05. [2025-09-17T22:13:54.317353] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T22:13:54.815775] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-04. [2025-09-17T22:13:55.050781] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T22:13:55.615825] [INFO ] [REMOTE ] TV: Fetching primary data for 2024-12. [2025-09-17T22:13:55.864488] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T22:13:56.415829] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-06. [2025-09-17T22:13:56.688819] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T22:13:56.764894] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2024-12 (1.15 seconds). [2025-09-17T22:13:57.215801] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-05. [2025-09-17T22:13:58.015750] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-01. [2025-09-17T22:13:58.041953] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T22:13:58.815761] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-07. [2025-09-17T22:13:58.967796] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T22:13:59.615805] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-04. [2025-09-17T22:13:59.730193] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T22:14:00.415781] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-02. [2025-09-17T22:14:00.559830] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T22:14:01.056196] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T22:14:01.215793] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-05. [2025-09-17T22:14:02.009383] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-02 (1.59 seconds). [2025-09-17T22:14:02.016999] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-08. [2025-09-17T22:14:02.815790] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-06. [2025-09-17T22:14:03.162576] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T22:14:03.615791] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-03. [2025-09-17T22:14:03.774456] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-08 (1.76 seconds). [2025-09-17T22:14:04.415831] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-06. [2025-09-17T22:14:04.481953] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-06 (1.67 seconds). [2025-09-17T22:14:04.981200] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T22:14:05.215792] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-07. [2025-09-17T22:14:05.905379] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T22:14:06.015798] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-07. [2025-09-17T22:14:06.815850] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-04. [2025-09-17T22:14:06.994618] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T22:14:07.618134] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-08. [2025-09-17T22:14:07.624698] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T22:14:08.231299] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T22:14:08.415845] [INFO ] [REMOTE ] TTI: Fetching primary data for 2025-09. [2025-09-17T22:14:09.215855] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-08. [2025-09-17T22:14:09.389161] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T22:14:10.015854] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-05. [2025-09-17T22:14:10.089516] [INFO ] [REMOTE ] TTI: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T22:14:10.096790] [INFO ] [REMOTE ] TTI: Full fetch complete (64540 records). [2025-09-17T22:14:10.097036] [DEBUG] [VALIDATOR ] TTI: Validating primary data. [2025-09-17T22:14:10.533161] [DEBUG] [VALIDATOR ] TTI: All expected trading days are present. [2025-09-17T22:14:10.533320] [DEBUG] [VALIDATOR ] TTI: Primary data validation passed. [2025-09-17T22:14:10.538605] [INFO ] [MAIN ] TTI: Fetched primary data is valid. [2025-09-17T22:14:10.538775] [DEBUG] [LOCAL ] TTI: Saving primary data. [2025-09-17T22:14:10.540940] [DEBUG] [LOCAL ] TTI: Trimmed 64540 records to 45239 (keeping 200 days of data) [2025-09-17T22:14:10.818096] [INFO ] [REMOTE ] TU: Fetching primary data for 2025-09. [2025-09-17T22:14:10.838746] [DEBUG] [LOCAL ] TTI: Primary data saved (45239 records). [2025-09-17T22:14:10.838971] [INFO ] [MAIN ] TTI: Full history saved. [2025-09-17T22:14:10.839290] [INFO ] [MAIN ] Update Progress: 2146/2371 symbols completed. TTI took 40.0s. Estimated remaining: 32m 56s. Rate: 6.8 symbols/min [2025-09-17T22:14:11.038067] [INFO ] [MAIN ] TVC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:14:11.045384] [DEBUG] [LOCAL ] TVC: Loaded 3570 existing records from primary storage. [2025-09-17T22:14:11.045538] [INFO ] [MAIN ] TVC: Loaded 3570 existing records. [2025-09-17T22:14:11.260049] [WARN ] [MAIN ] TVC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:14:11.261024] [INFO ] [MAIN ] TVC: Wiping existing primary data before full refresh. [2025-09-17T22:14:11.261153] [INFO ] [LOCAL ] TVC: Starting deletion of primary data. [2025-09-17T22:14:11.261740] [DEBUG] [LOCAL ] TVC: Deleted primary data file. [2025-09-17T22:14:11.261816] [INFO ] [MAIN ] TVC: Starting full primary refresh. [2025-09-17T22:14:11.394523] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-08 (2.18 seconds). [2025-09-17T22:14:11.621267] [INFO ] [REMOTE ] TUYA: Fetching primary data for 2025-09. [2025-09-17T22:14:11.782004] [INFO ] [REMOTE ] TVC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:14:11.813725] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T22:14:12.350475] [INFO ] [REMOTE ] TU: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T22:14:12.356969] [INFO ] [REMOTE ] TU: Full fetch complete (72828 records). [2025-09-17T22:14:12.357087] [DEBUG] [VALIDATOR ] TU: Validating primary data. [2025-09-17T22:14:12.422111] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-11. [2025-09-17T22:14:12.769116] [DEBUG] [VALIDATOR ] TU: All expected trading days are present. [2025-09-17T22:14:12.769225] [DEBUG] [VALIDATOR ] TU: Primary data validation passed. [2025-09-17T22:14:12.770380] [INFO ] [MAIN ] TU: Fetched primary data is valid. [2025-09-17T22:14:12.770450] [DEBUG] [LOCAL ] TU: Saving primary data. [2025-09-17T22:14:12.772175] [DEBUG] [LOCAL ] TU: Trimmed 72828 records to 49968 (keeping 200 days of data) [2025-09-17T22:14:13.081298] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T22:14:13.101925] [DEBUG] [LOCAL ] TU: Primary data saved (49968 records). [2025-09-17T22:14:13.102030] [INFO ] [MAIN ] TU: Full history saved. [2025-09-17T22:14:13.102133] [INFO ] [MAIN ] Update Progress: 2147/2371 symbols completed. TU took 40.8s. Estimated remaining: 32m 47s. Rate: 6.8 symbols/min [2025-09-17T22:14:13.220920] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-06. [2025-09-17T22:14:13.277864] [INFO ] [MAIN ] TVE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:14:13.298288] [INFO ] [REMOTE ] TUYA: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T22:14:13.302572] [DEBUG] [LOCAL ] TVE: Loaded 2870 existing records from primary storage. [2025-09-17T22:14:13.309382] [INFO ] [MAIN ] TVE: Loaded 2870 existing records. [2025-09-17T22:14:13.347903] [INFO ] [REMOTE ] TUYA: Full fetch complete (65756 records). [2025-09-17T22:14:13.380275] [DEBUG] [VALIDATOR ] TUYA: Validating primary data. [2025-09-17T22:14:13.641366] [WARN ] [MAIN ] TVE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:14:13.675364] [INFO ] [MAIN ] TVE: Wiping existing primary data before full refresh. [2025-09-17T22:14:13.676992] [INFO ] [LOCAL ] TVE: Starting deletion of primary data. [2025-09-17T22:14:13.697365] [DEBUG] [LOCAL ] TVE: Deleted primary data file. [2025-09-17T22:14:13.719442] [INFO ] [MAIN ] TVE: Starting full primary refresh. [2025-09-17T22:14:14.017904] [INFO ] [REMOTE ] TVC: Fetching primary data for 2024-12. [2025-09-17T22:14:14.129466] [DEBUG] [VALIDATOR ] TUYA: All expected trading days are present. [2025-09-17T22:14:14.148267] [DEBUG] [VALIDATOR ] TUYA: Primary data validation passed. [2025-09-17T22:14:14.149474] [INFO ] [MAIN ] TUYA: Fetched primary data is valid. [2025-09-17T22:14:14.175593] [DEBUG] [LOCAL ] TUYA: Saving primary data. [2025-09-17T22:14:14.242395] [DEBUG] [LOCAL ] TUYA: Trimmed 65756 records to 46687 (keeping 200 days of data) [2025-09-17T22:14:14.378838] [INFO ] [REMOTE ] TVE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:14:14.448416] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T22:14:14.618668] [DEBUG] [LOCAL ] TUYA: Primary data saved (46687 records). [2025-09-17T22:14:14.618814] [INFO ] [MAIN ] TUYA: Full history saved. [2025-09-17T22:14:14.619576] [INFO ] [MAIN ] Update Progress: 2148/2371 symbols completed. TUYA took 33.7s. Estimated remaining: 32m 37s. Rate: 6.8 symbols/min [2025-09-17T22:14:14.794122] [INFO ] [MAIN ] TWI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:14:14.815857] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-11. [2025-09-17T22:14:14.832532] [DEBUG] [LOCAL ] TWI: Loaded 35061 existing records from primary storage. [2025-09-17T22:14:14.832720] [INFO ] [MAIN ] TWI: Loaded 35061 existing records. [2025-09-17T22:14:15.016826] [WARN ] [MAIN ] TWI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:14:15.022996] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2024-12 (1.01 seconds). [2025-09-17T22:14:15.022728] [INFO ] [MAIN ] TWI: Wiping existing primary data before full refresh. [2025-09-17T22:14:15.025539] [INFO ] [LOCAL ] TWI: Starting deletion of primary data. [2025-09-17T22:14:15.026331] [DEBUG] [LOCAL ] TWI: Deleted primary data file. [2025-09-17T22:14:15.026392] [INFO ] [MAIN ] TWI: Starting full primary refresh. [2025-09-17T22:14:15.392376] [INFO ] [REMOTE ] TWI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:14:15.395962] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-11 (0.58 seconds). [2025-09-17T22:14:15.615774] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-11. [2025-09-17T22:14:16.415787] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-01. [2025-09-17T22:14:16.813601] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-01 (0.40 seconds). [2025-09-17T22:14:16.984598] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T22:14:17.215778] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-02. [2025-09-17T22:14:17.953128] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T22:14:18.015769] [INFO ] [REMOTE ] TWI: Fetching primary data for 2024-12. [2025-09-17T22:14:18.815805] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-07. [2025-09-17T22:14:19.587596] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2024-12 (1.57 seconds). [2025-09-17T22:14:19.615753] [INFO ] [REMOTE ] TVE: Fetching primary data for 2024-12. [2025-09-17T22:14:20.279836] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2024-12 (0.66 seconds). [2025-09-17T22:14:20.327215] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-07 (1.51 seconds). [2025-09-17T22:14:20.415774] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-08. [2025-09-17T22:14:21.215822] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-01. [2025-09-17T22:14:21.933961] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T22:14:21.973720] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T22:14:22.015746] [INFO ] [REMOTE ] TV: Fetching primary data for 2025-09. [2025-09-17T22:14:22.815802] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-03. [2025-09-17T22:14:23.352446] [INFO ] [REMOTE ] TV: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T22:14:23.358137] [INFO ] [REMOTE ] TV: Full fetch complete (62728 records). [2025-09-17T22:14:23.358252] [DEBUG] [VALIDATOR ] TV: Validating primary data. [2025-09-17T22:14:23.482482] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T22:14:23.624082] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-01. [2025-09-17T22:14:23.782062] [DEBUG] [VALIDATOR ] TV: All expected trading days are present. [2025-09-17T22:14:23.782183] [DEBUG] [VALIDATOR ] TV: Primary data validation passed. [2025-09-17T22:14:23.783367] [INFO ] [MAIN ] TV: Fetched primary data is valid. [2025-09-17T22:14:23.783437] [DEBUG] [LOCAL ] TV: Saving primary data. [2025-09-17T22:14:23.784989] [DEBUG] [LOCAL ] TV: Trimmed 62728 records to 43149 (keeping 200 days of data) [2025-09-17T22:14:24.059997] [DEBUG] [LOCAL ] TV: Primary data saved (43149 records). [2025-09-17T22:14:24.060165] [INFO ] [MAIN ] TV: Full history saved. [2025-09-17T22:14:24.060322] [INFO ] [MAIN ] Update Progress: 2149/2371 symbols completed. TV took 33.9s. Estimated remaining: 32m 29s. Rate: 6.8 symbols/min [2025-09-17T22:14:24.259418] [INFO ] [MAIN ] TWLO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:14:24.320954] [DEBUG] [LOCAL ] TWLO: Loaded 52726 existing records from primary storage. [2025-09-17T22:14:24.321119] [INFO ] [MAIN ] TWLO: Loaded 52726 existing records. [2025-09-17T22:14:24.420919] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-04. [2025-09-17T22:14:24.511794] [WARN ] [MAIN ] TWLO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:14:24.512027] [INFO ] [MAIN ] TWLO: Wiping existing primary data before full refresh. [2025-09-17T22:14:24.512075] [INFO ] [LOCAL ] TWLO: Starting deletion of primary data. [2025-09-17T22:14:24.513147] [DEBUG] [LOCAL ] TWLO: Deleted primary data file. [2025-09-17T22:14:24.513209] [INFO ] [MAIN ] TWLO: Starting full primary refresh. [2025-09-17T22:14:24.899752] [INFO ] [REMOTE ] TWLO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:14:25.005291] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T22:14:25.097377] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-04 (0.68 seconds). [2025-09-17T22:14:25.215810] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-05. [2025-09-17T22:14:25.781147] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-05 (0.57 seconds). [2025-09-17T22:14:26.015785] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-11. [2025-09-17T22:14:26.815822] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-02. [2025-09-17T22:14:27.615793] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-02. [2025-09-17T22:14:28.090892] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T22:14:28.167597] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T22:14:28.426039] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-06. [2025-09-17T22:14:28.430766] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-02 (1.61 seconds). [2025-09-17T22:14:29.128823] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-06 (0.70 seconds). [2025-09-17T22:14:29.215840] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-07. [2025-09-17T22:14:29.775132] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-07 (0.56 seconds). [2025-09-17T22:14:30.015807] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2024-12. [2025-09-17T22:14:30.815796] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-03. [2025-09-17T22:14:31.487602] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T22:14:31.615801] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-04. [2025-09-17T22:14:32.038076] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2024-12 (2.02 seconds). [2025-09-17T22:14:32.178231] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-04 (0.56 seconds). [2025-09-17T22:14:32.415776] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-08. [2025-09-17T22:14:32.905202] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T22:14:33.215781] [INFO ] [REMOTE ] TVC: Fetching primary data for 2025-09. [2025-09-17T22:14:33.693188] [INFO ] [REMOTE ] TVC: Incremental fetch complete for 2025-09 (0.48 seconds). [2025-09-17T22:14:33.694302] [INFO ] [REMOTE ] TVC: Full fetch complete (5781 records). [2025-09-17T22:14:33.694372] [DEBUG] [VALIDATOR ] TVC: Validating primary data. [2025-09-17T22:14:34.020994] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-03. [2025-09-17T22:14:34.093847] [DEBUG] [VALIDATOR ] TVC: All expected trading days are present. [2025-09-17T22:14:34.093941] [DEBUG] [VALIDATOR ] TVC: Primary data validation passed. [2025-09-17T22:14:34.094176] [INFO ] [MAIN ] TVC: Fetched primary data is valid. [2025-09-17T22:14:34.094257] [DEBUG] [LOCAL ] TVC: Saving primary data. [2025-09-17T22:14:34.094700] [DEBUG] [LOCAL ] TVC: Trimmed 5781 records to 3552 (keeping 200 days of data) [2025-09-17T22:14:34.117700] [DEBUG] [LOCAL ] TVC: Primary data saved (3552 records). [2025-09-17T22:14:34.117790] [INFO ] [MAIN ] TVC: Full history saved. [2025-09-17T22:14:34.117919] [INFO ] [MAIN ] Update Progress: 2150/2371 symbols completed. TVC took 23.3s. Estimated remaining: 32m 20s. Rate: 6.8 symbols/min [2025-09-17T22:14:34.310742] [INFO ] [MAIN ] TWN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:14:34.316042] [DEBUG] [LOCAL ] TWN: Loaded 3344 existing records from primary storage. [2025-09-17T22:14:34.316126] [INFO ] [MAIN ] TWN: Loaded 3344 existing records. [2025-09-17T22:14:34.504300] [WARN ] [MAIN ] TWN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:14:34.504550] [INFO ] [MAIN ] TWN: Wiping existing primary data before full refresh. [2025-09-17T22:14:34.504600] [INFO ] [LOCAL ] TWN: Starting deletion of primary data. [2025-09-17T22:14:34.504889] [DEBUG] [LOCAL ] TWN: Deleted primary data file. [2025-09-17T22:14:34.504959] [INFO ] [MAIN ] TWN: Starting full primary refresh. [2025-09-17T22:14:34.817330] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-01. [2025-09-17T22:14:34.896963] [INFO ] [REMOTE ] TWN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:14:35.615786] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-05. [2025-09-17T22:14:35.666600] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T22:14:36.124148] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T22:14:36.415766] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-11. [2025-09-17T22:14:36.522378] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T22:14:37.011844] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T22:14:37.215817] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-02. [2025-09-17T22:14:38.015782] [INFO ] [REMOTE ] TWN: Fetching primary data for 2024-12. [2025-09-17T22:14:38.695838] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2024-12 (0.68 seconds). [2025-09-17T22:14:38.815749] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-06. [2025-09-17T22:14:39.069328] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T22:14:39.194548] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-06 (0.38 seconds). [2025-09-17T22:14:39.615901] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-03. [2025-09-17T22:14:40.415834] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-07. [2025-09-17T22:14:40.955178] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-07 (0.54 seconds). [2025-09-17T22:14:41.215764] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-08. [2025-09-17T22:14:41.332556] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T22:14:41.668734] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-08 (0.45 seconds). [2025-09-17T22:14:42.015835] [INFO ] [REMOTE ] TVE: Fetching primary data for 2025-09. [2025-09-17T22:14:42.437271] [INFO ] [REMOTE ] TVE: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T22:14:42.438273] [INFO ] [REMOTE ] TVE: Full fetch complete (4475 records). [2025-09-17T22:14:42.438354] [DEBUG] [VALIDATOR ] TVE: Validating primary data. [2025-09-17T22:14:42.799680] [DEBUG] [VALIDATOR ] TVE: All expected trading days are present. [2025-09-17T22:14:42.799767] [DEBUG] [VALIDATOR ] TVE: Primary data validation passed. [2025-09-17T22:14:42.799910] [INFO ] [MAIN ] TVE: Fetched primary data is valid. [2025-09-17T22:14:42.799947] [DEBUG] [LOCAL ] TVE: Saving primary data. [2025-09-17T22:14:42.800314] [DEBUG] [LOCAL ] TVE: Trimmed 4475 records to 2855 (keeping 200 days of data) [2025-09-17T22:14:42.815846] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-04. [2025-09-17T22:14:42.819448] [DEBUG] [LOCAL ] TVE: Primary data saved (2855 records). [2025-09-17T22:14:42.819527] [INFO ] [MAIN ] TVE: Full history saved. [2025-09-17T22:14:42.819617] [INFO ] [MAIN ] Update Progress: 2151/2371 symbols completed. TVE took 29.7s. Estimated remaining: 32m 11s. Rate: 6.8 symbols/min [2025-09-17T22:14:42.999019] [INFO ] [MAIN ] TWO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:14:43.049391] [DEBUG] [LOCAL ] TWO: Loaded 48191 existing records from primary storage. [2025-09-17T22:14:43.049549] [INFO ] [MAIN ] TWO: Loaded 48191 existing records. [2025-09-17T22:14:43.226123] [WARN ] [MAIN ] TWO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:14:43.226453] [INFO ] [MAIN ] TWO: Wiping existing primary data before full refresh. [2025-09-17T22:14:43.226514] [INFO ] [LOCAL ] TWO: Starting deletion of primary data. [2025-09-17T22:14:43.227478] [DEBUG] [LOCAL ] TWO: Deleted primary data file. [2025-09-17T22:14:43.227548] [INFO ] [MAIN ] TWO: Starting full primary refresh. [2025-09-17T22:14:43.580778] [INFO ] [REMOTE ] TWO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:14:43.615735] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-11. [2025-09-17T22:14:44.341100] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-04 (1.53 seconds). [2025-09-17T22:14:44.415769] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-01. [2025-09-17T22:14:45.033925] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T22:14:45.215828] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-04. [2025-09-17T22:14:45.306761] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T22:14:46.015780] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-05. [2025-09-17T22:14:46.728871] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T22:14:46.815792] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-02. [2025-09-17T22:14:47.372859] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-05 (1.36 seconds). [2025-09-17T22:14:47.524238] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-02 (0.71 seconds). [2025-09-17T22:14:47.615793] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-05. [2025-09-17T22:14:48.415827] [INFO ] [REMOTE ] TWO: Fetching primary data for 2024-12. [2025-09-17T22:14:49.215829] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-06. [2025-09-17T22:14:49.560520] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T22:14:50.007279] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T22:14:50.016732] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-06. [2025-09-17T22:14:50.723312] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-06 (1.51 seconds). [2025-09-17T22:14:50.815752] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-07. [2025-09-17T22:14:51.466961] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T22:14:51.615783] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-01. [2025-09-17T22:14:52.058896] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-07 (1.24 seconds). [2025-09-17T22:14:52.415797] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-03. [2025-09-17T22:14:52.871503] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-03 (0.46 seconds). [2025-09-17T22:14:53.215819] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-07. [2025-09-17T22:14:53.341405] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T22:14:54.015829] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-04. [2025-09-17T22:14:54.520600] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-04 (0.50 seconds). [2025-09-17T22:14:54.815791] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-02. [2025-09-17T22:14:55.028752] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T22:14:55.615812] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-05. [2025-09-17T22:14:56.199119] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T22:14:56.406740] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-05 (0.79 seconds). [2025-09-17T22:14:56.415705] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-08. [2025-09-17T22:14:57.215793] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-08. [2025-09-17T22:14:57.700024] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T22:14:58.015797] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-03. [2025-09-17T22:14:58.815774] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-06. [2025-09-17T22:14:59.249403] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-03 (1.23 seconds). [2025-09-17T22:14:59.294999] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-06 (0.48 seconds). [2025-09-17T22:14:59.299106] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T22:14:59.615791] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-04. [2025-09-17T22:15:00.415811] [INFO ] [REMOTE ] TWLO: Fetching primary data for 2025-09. [2025-09-17T22:15:01.215836] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-07. [2025-09-17T22:15:01.562846] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T22:15:02.015816] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-05. [2025-09-17T22:15:02.550491] [INFO ] [REMOTE ] TWLO: Incremental fetch complete for 2025-09 (2.13 seconds). [2025-09-17T22:15:02.559097] [INFO ] [REMOTE ] TWLO: Full fetch complete (76269 records). [2025-09-17T22:15:02.559419] [DEBUG] [VALIDATOR ] TWLO: Validating primary data. [2025-09-17T22:15:02.860315] [INFO ] [REMOTE ] TWI: Fetching primary data for 2025-09. [2025-09-17T22:15:03.156398] [DEBUG] [VALIDATOR ] TWLO: All expected trading days are present. [2025-09-17T22:15:03.156525] [DEBUG] [VALIDATOR ] TWLO: Primary data validation passed. [2025-09-17T22:15:03.157806] [INFO ] [MAIN ] TWLO: Fetched primary data is valid. [2025-09-17T22:15:03.157897] [DEBUG] [LOCAL ] TWLO: Saving primary data. [2025-09-17T22:15:03.160064] [DEBUG] [LOCAL ] TWLO: Trimmed 76269 records to 52722 (keeping 200 days of data) [2025-09-17T22:15:03.216795] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T22:15:03.504021] [DEBUG] [LOCAL ] TWLO: Primary data saved (52722 records). [2025-09-17T22:15:03.504188] [INFO ] [MAIN ] TWLO: Full history saved. [2025-09-17T22:15:03.504942] [INFO ] [MAIN ] Update Progress: 2152/2371 symbols completed. TWLO took 39.4s. Estimated remaining: 32m 4s. Rate: 6.8 symbols/min [2025-09-17T22:15:03.620971] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-08. [2025-09-17T22:15:03.683478] [INFO ] [MAIN ] TWOD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:15:03.683707] [DEBUG] [LOCAL ] TWOD: No existing data file found in primary storage. [2025-09-17T22:15:03.683762] [WARN ] [MAIN ] TWOD: No existing data found, performing full refresh instead. [2025-09-17T22:15:03.683918] [INFO ] [MAIN ] TWOD: Wiping existing primary data before full refresh. [2025-09-17T22:15:03.683960] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-17T22:15:03.684053] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-17T22:15:03.684093] [INFO ] [MAIN ] TWOD: Starting full primary refresh. [2025-09-17T22:15:04.065050] [INFO ] [REMOTE ] TWOD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:15:04.415797] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-11. [2025-09-17T22:15:04.462814] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-08 (0.84 seconds). [2025-09-17T22:15:04.969118] [INFO ] [REMOTE ] TWI: Incremental fetch complete for 2025-09 (2.11 seconds). [2025-09-17T22:15:04.973511] [INFO ] [REMOTE ] TWI: Full fetch complete (53390 records). [2025-09-17T22:15:04.973634] [DEBUG] [VALIDATOR ] TWI: Validating primary data. [2025-09-17T22:15:05.244140] [INFO ] [REMOTE ] TWN: Fetching primary data for 2025-09. [2025-09-17T22:15:05.420890] [DEBUG] [VALIDATOR ] TWI: All expected trading days are present. [2025-09-17T22:15:05.421002] [DEBUG] [VALIDATOR ] TWI: Primary data validation passed. [2025-09-17T22:15:05.422145] [INFO ] [MAIN ] TWI: Fetched primary data is valid. [2025-09-17T22:15:05.422216] [DEBUG] [LOCAL ] TWI: Saving primary data. [2025-09-17T22:15:05.423786] [DEBUG] [LOCAL ] TWI: Trimmed 53390 records to 34927 (keeping 200 days of data) [2025-09-17T22:15:05.633008] [DEBUG] [LOCAL ] TWI: Primary data saved (34927 records). [2025-09-17T22:15:05.633389] [INFO ] [MAIN ] TWI: Full history saved. [2025-09-17T22:15:05.635183] [INFO ] [MAIN ] Update Progress: 2153/2371 symbols completed. TWI took 51.0s. Estimated remaining: 31m 54s. Rate: 6.8 symbols/min [2025-09-17T22:15:05.749221] [INFO ] [REMOTE ] TWN: Incremental fetch complete for 2025-09 (0.51 seconds). [2025-09-17T22:15:05.766914] [INFO ] [REMOTE ] TWN: Full fetch complete (5361 records). [2025-09-17T22:15:05.819908] [DEBUG] [VALIDATOR ] TWN: Validating primary data. [2025-09-17T22:15:05.822558] [INFO ] [MAIN ] TX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:15:05.829501] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:15:05.852125] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-11 [2025-09-17T22:15:06.035863] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2024-12. [2025-09-17T22:15:06.091718] [DEBUG] [LOCAL ] TX: Loaded 23964 existing records from primary storage. [2025-09-17T22:15:06.143182] [INFO ] [MAIN ] TX: Loaded 23964 existing records. [2025-09-17T22:15:06.404698] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:15:06.405013] [DEBUG] [VALIDATOR ] TWN: All expected trading days are present. [2025-09-17T22:15:06.417629] [DEBUG] [VALIDATOR ] TWN: Primary data validation passed. [2025-09-17T22:15:06.423094] [WARN ] [REMOTE ] TWOD: No data returned for month 2024-12 [2025-09-17T22:15:06.432314] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-05 (4.42 seconds). [2025-09-17T22:15:06.439081] [INFO ] [MAIN ] TWN: Fetched primary data is valid. [2025-09-17T22:15:06.469485] [DEBUG] [LOCAL ] TWN: Saving primary data. [2025-09-17T22:15:06.512348] [WARN ] [MAIN ] TX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:15:06.512525] [DEBUG] [LOCAL ] TWN: Trimmed 5361 records to 3347 (keeping 200 days of data) [2025-09-17T22:15:06.513574] [INFO ] [MAIN ] TX: Wiping existing primary data before full refresh. [2025-09-17T22:15:06.513808] [INFO ] [LOCAL ] TX: Starting deletion of primary data. [2025-09-17T22:15:06.522497] [DEBUG] [LOCAL ] TX: Deleted primary data file. [2025-09-17T22:15:06.522581] [INFO ] [MAIN ] TX: Starting full primary refresh. [2025-09-17T22:15:06.643346] [DEBUG] [LOCAL ] TWN: Primary data saved (3347 records). [2025-09-17T22:15:06.643527] [INFO ] [MAIN ] TWN: Full history saved. [2025-09-17T22:15:06.643633] [INFO ] [MAIN ] Update Progress: 2154/2371 symbols completed. TWN took 32.5s. Estimated remaining: 31m 45s. Rate: 6.8 symbols/min [2025-09-17T22:15:06.827752] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-01. [2025-09-17T22:15:07.071565] [INFO ] [MAIN ] TXNM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:15:07.137141] [INFO ] [REMOTE ] TX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:15:07.129977] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:15:07.137986] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-01 [2025-09-17T22:15:07.176610] [DEBUG] [LOCAL ] TXNM: Loaded 44157 existing records from primary storage. [2025-09-17T22:15:07.176793] [INFO ] [MAIN ] TXNM: Loaded 44157 existing records. [2025-09-17T22:15:07.369452] [WARN ] [MAIN ] TXNM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:15:07.369792] [INFO ] [MAIN ] TXNM: Wiping existing primary data before full refresh. [2025-09-17T22:15:07.369892] [INFO ] [LOCAL ] TXNM: Starting deletion of primary data. [2025-09-17T22:15:07.370897] [DEBUG] [LOCAL ] TXNM: Deleted primary data file. [2025-09-17T22:15:07.370959] [INFO ] [MAIN ] TXNM: Starting full primary refresh. [2025-09-17T22:15:07.625100] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-02. [2025-09-17T22:15:07.753199] [INFO ] [REMOTE ] TXNM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:15:07.869378] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:15:07.869771] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-02 [2025-09-17T22:15:08.415783] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-03. [2025-09-17T22:15:08.635269] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:15:08.635683] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-03 [2025-09-17T22:15:09.215805] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-04. [2025-09-17T22:15:09.426154] [DEBUG] [REMOTE ] TWOD: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:15:09.426522] [WARN ] [REMOTE ] TWOD: No data returned for month 2025-04 [2025-09-17T22:15:10.015784] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-06. [2025-09-17T22:15:10.815806] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-05. [2025-09-17T22:15:11.570003] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T22:15:11.615755] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-11. [2025-09-17T22:15:11.726509] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T22:15:12.415778] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-07. [2025-09-17T22:15:12.785812] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T22:15:13.215778] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-11. [2025-09-17T22:15:14.015774] [INFO ] [REMOTE ] TX: Fetching primary data for 2024-12. [2025-09-17T22:15:14.338473] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T22:15:14.774850] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T22:15:14.815771] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2024-12. [2025-09-17T22:15:15.528500] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T22:15:15.615774] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-06. [2025-09-17T22:15:16.415760] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-08. [2025-09-17T22:15:16.616687] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-06 (1.00 seconds). [2025-09-17T22:15:17.122393] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2024-12 (2.31 seconds). [2025-09-17T22:15:17.215747] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-01. [2025-09-17T22:15:18.015782] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-01. [2025-09-17T22:15:18.357370] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T22:15:18.383630] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T22:15:18.815803] [INFO ] [REMOTE ] TWO: Fetching primary data for 2025-09. [2025-09-17T22:15:19.205784] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T22:15:19.615827] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-02. [2025-09-17T22:15:20.416115] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-07. [2025-09-17T22:15:20.420515] [INFO ] [REMOTE ] TWO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T22:15:20.427579] [INFO ] [REMOTE ] TWO: Full fetch complete (68443 records). [2025-09-17T22:15:20.427714] [DEBUG] [VALIDATOR ] TWO: Validating primary data. [2025-09-17T22:15:20.853380] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-07 (0.44 seconds). [2025-09-17T22:15:20.878463] [DEBUG] [VALIDATOR ] TWO: All expected trading days are present. [2025-09-17T22:15:20.878573] [DEBUG] [VALIDATOR ] TWO: Primary data validation passed. [2025-09-17T22:15:20.879915] [INFO ] [MAIN ] TWO: Fetched primary data is valid. [2025-09-17T22:15:20.880081] [DEBUG] [LOCAL ] TWO: Saving primary data. [2025-09-17T22:15:20.902104] [DEBUG] [LOCAL ] TWO: Trimmed 68443 records to 48207 (keeping 200 days of data) [2025-09-17T22:15:20.904191] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T22:15:21.210591] [DEBUG] [LOCAL ] TWO: Primary data saved (48207 records). [2025-09-17T22:15:21.210763] [INFO ] [MAIN ] TWO: Full history saved. [2025-09-17T22:15:21.210856] [INFO ] [MAIN ] Update Progress: 2155/2371 symbols completed. TWO took 38.4s. Estimated remaining: 31m 36s. Rate: 6.8 symbols/min [2025-09-17T22:15:21.222059] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-03. [2025-09-17T22:15:21.405962] [INFO ] [MAIN ] TXO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:15:21.430115] [DEBUG] [LOCAL ] TXO: Loaded 18636 existing records from primary storage. [2025-09-17T22:15:21.430271] [INFO ] [MAIN ] TXO: Loaded 18636 existing records. [2025-09-17T22:15:21.611818] [WARN ] [MAIN ] TXO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:15:21.612137] [INFO ] [MAIN ] TXO: Wiping existing primary data before full refresh. [2025-09-17T22:15:21.612198] [INFO ] [LOCAL ] TXO: Starting deletion of primary data. [2025-09-17T22:15:21.612852] [DEBUG] [LOCAL ] TXO: Deleted primary data file. [2025-09-17T22:15:21.612921] [INFO ] [MAIN ] TXO: Starting full primary refresh. [2025-09-17T22:15:22.017041] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-02. [2025-09-17T22:15:22.020924] [INFO ] [REMOTE ] TXO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:15:22.815800] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-08. [2025-09-17T22:15:22.960156] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T22:15:22.989226] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T22:15:23.423660] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-08 (0.61 seconds). [2025-09-17T22:15:23.615825] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-04. [2025-09-17T22:15:24.415819] [INFO ] [REMOTE ] TWOD: Fetching primary data for 2025-09. [2025-09-17T22:15:25.018353] [INFO ] [REMOTE ] TWOD: Incremental fetch complete for 2025-09 (0.60 seconds). [2025-09-17T22:15:25.019904] [INFO ] [REMOTE ] TWOD: Full fetch complete (4195 records). [2025-09-17T22:15:25.019986] [DEBUG] [VALIDATOR ] TWOD: Validating primary data. [2025-09-17T22:15:25.200133] [WARN ] [VALIDATOR ] TWOD: Validation failed - insufficient historical data. Have 85 unique days, need 200 days [2025-09-17T22:15:25.200373] [FATAL] [MAIN ] TWOD: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:15:25.200575] [WARN ] [MAIN ] TWOD: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:15:25.200755] [INFO ] [LOCAL ] TWOD: Starting deletion of primary data. [2025-09-17T22:15:25.200960] [DEBUG] [LOCAL ] TWOD: No primary data file found to delete. [2025-09-17T22:15:25.201059] [INFO ] [LOCAL ] TWOD: Starting deletion of derivative data. [2025-09-17T22:15:25.201301] [DEBUG] [LOCAL ] TWOD: No derivative data file found to delete. [2025-09-17T22:15:25.201430] [INFO ] [MAIN ] Update Progress: 2156/2371 symbols completed. TWOD took 21.7s. Estimated remaining: 31m 27s. Rate: 6.8 symbols/min [2025-09-17T22:15:25.222362] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-03. [2025-09-17T22:15:25.379604] [INFO ] [MAIN ] TXT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:15:25.408887] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-04 (1.79 seconds). [2025-09-17T22:15:25.467962] [DEBUG] [LOCAL ] TXT: Loaded 49827 existing records from primary storage. [2025-09-17T22:15:25.468112] [INFO ] [MAIN ] TXT: Loaded 49827 existing records. [2025-09-17T22:15:25.669617] [WARN ] [MAIN ] TXT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:15:25.670016] [INFO ] [MAIN ] TXT: Wiping existing primary data before full refresh. [2025-09-17T22:15:25.670125] [INFO ] [LOCAL ] TXT: Starting deletion of primary data. [2025-09-17T22:15:25.671322] [DEBUG] [LOCAL ] TXT: Deleted primary data file. [2025-09-17T22:15:25.671396] [INFO ] [MAIN ] TXT: Starting full primary refresh. [2025-09-17T22:15:26.020938] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-11. [2025-09-17T22:15:26.060568] [INFO ] [REMOTE ] TXT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:15:26.696473] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T22:15:26.815807] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-04. [2025-09-17T22:15:26.844305] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T22:15:27.615975] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-11. [2025-09-17T22:15:28.324061] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T22:15:28.415783] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-05. [2025-09-17T22:15:29.215780] [INFO ] [REMOTE ] TXO: Fetching primary data for 2024-12. [2025-09-17T22:15:29.490637] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-11 (1.87 seconds). [2025-09-17T22:15:29.567613] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T22:15:30.015811] [INFO ] [REMOTE ] TXT: Fetching primary data for 2024-12. [2025-09-17T22:15:30.156683] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2024-12 (0.94 seconds). [2025-09-17T22:15:30.815823] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-01. [2025-09-17T22:15:31.615818] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-05. [2025-09-17T22:15:31.694825] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-01 (0.88 seconds). [2025-09-17T22:15:31.857099] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T22:15:32.415812] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-06. [2025-09-17T22:15:33.215815] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-01. [2025-09-17T22:15:33.347956] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T22:15:33.486836] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T22:15:34.015793] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-07. [2025-09-17T22:15:34.785191] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T22:15:34.815741] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-02. [2025-09-17T22:15:35.184438] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T22:15:35.615785] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-06. [2025-09-17T22:15:36.415764] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-02. [2025-09-17T22:15:36.515843] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-02 (1.70 seconds). [2025-09-17T22:15:37.046537] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T22:15:37.215773] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-08. [2025-09-17T22:15:37.381737] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-02 (0.97 seconds). [2025-09-17T22:15:38.015813] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-03. [2025-09-17T22:15:38.334105] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T22:15:38.815803] [INFO ] [REMOTE ] TX: Fetching primary data for 2025-09. [2025-09-17T22:15:38.881572] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T22:15:39.587663] [INFO ] [REMOTE ] TX: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T22:15:39.592295] [INFO ] [REMOTE ] TX: Full fetch complete (35741 records). [2025-09-17T22:15:39.592466] [DEBUG] [VALIDATOR ] TX: Validating primary data. [2025-09-17T22:15:39.620947] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-07. [2025-09-17T22:15:40.179145] [DEBUG] [VALIDATOR ] TX: All expected trading days are present. [2025-09-17T22:15:40.179270] [DEBUG] [VALIDATOR ] TX: Primary data validation passed. [2025-09-17T22:15:40.181075] [INFO ] [MAIN ] TX: Fetched primary data is valid. [2025-09-17T22:15:40.181226] [DEBUG] [LOCAL ] TX: Saving primary data. [2025-09-17T22:15:40.182814] [DEBUG] [LOCAL ] TX: Trimmed 35741 records to 23871 (keeping 200 days of data) [2025-09-17T22:15:40.415866] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-04. [2025-09-17T22:15:40.422398] [DEBUG] [LOCAL ] TX: Primary data saved (23871 records). [2025-09-17T22:15:40.422558] [INFO ] [MAIN ] TX: Full history saved. [2025-09-17T22:15:40.422735] [INFO ] [MAIN ] Update Progress: 2157/2371 symbols completed. TX took 34.8s. Estimated remaining: 31m 19s. Rate: 6.8 symbols/min [2025-09-17T22:15:41.215913] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-03. [2025-09-17T22:15:41.304950] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-04 (0.89 seconds). [2025-09-17T22:15:41.360117] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T22:15:42.015902] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-05. [2025-09-17T22:15:42.815923] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-08. [2025-09-17T22:15:43.025461] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T22:15:43.177679] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T22:15:43.615862] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-06. [2025-09-17T22:15:44.108752] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T22:15:44.415839] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-04. [2025-09-17T22:15:44.771599] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-06 (1.16 seconds). [2025-09-17T22:15:45.215816] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-07. [2025-09-17T22:15:45.875606] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T22:15:46.015758] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-08. [2025-09-17T22:15:46.199638] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T22:15:46.815791] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-05. [2025-09-17T22:15:47.072911] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T22:15:47.615837] [INFO ] [REMOTE ] TXNM: Fetching primary data for 2025-09. [2025-09-17T22:15:48.415794] [INFO ] [REMOTE ] TXO: Fetching primary data for 2025-09. [2025-09-17T22:15:48.590600] [INFO ] [REMOTE ] TXNM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T22:15:48.595871] [INFO ] [REMOTE ] TXNM: Full fetch complete (62740 records). [2025-09-17T22:15:48.596035] [DEBUG] [VALIDATOR ] TXNM: Validating primary data. [2025-09-17T22:15:48.973625] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-05 (2.16 seconds). [2025-09-17T22:15:49.075611] [DEBUG] [VALIDATOR ] TXNM: All expected trading days are present. [2025-09-17T22:15:49.075873] [DEBUG] [VALIDATOR ] TXNM: Primary data validation passed. [2025-09-17T22:15:49.077130] [INFO ] [MAIN ] TXNM: Fetched primary data is valid. [2025-09-17T22:15:49.077255] [DEBUG] [LOCAL ] TXNM: Saving primary data. [2025-09-17T22:15:49.081542] [DEBUG] [LOCAL ] TXNM: Trimmed 62740 records to 44151 (keeping 200 days of data) [2025-09-17T22:15:49.090128] [INFO ] [REMOTE ] TXO: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T22:15:49.093394] [INFO ] [REMOTE ] TXO: Full fetch complete (25577 records). [2025-09-17T22:15:49.093502] [DEBUG] [VALIDATOR ] TXO: Validating primary data. [2025-09-17T22:15:49.225202] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-06. [2025-09-17T22:15:49.605687] [DEBUG] [VALIDATOR ] TXO: All expected trading days are present. [2025-09-17T22:15:49.606074] [DEBUG] [VALIDATOR ] TXO: Primary data validation passed. [2025-09-17T22:15:49.607089] [INFO ] [MAIN ] TXO: Fetched primary data is valid. [2025-09-17T22:15:49.607394] [DEBUG] [LOCAL ] TXO: Saving primary data. [2025-09-17T22:15:49.610858] [DEBUG] [LOCAL ] TXO: Trimmed 25577 records to 18662 (keeping 200 days of data) [2025-09-17T22:15:49.848437] [DEBUG] [LOCAL ] TXO: Primary data saved (18662 records). [2025-09-17T22:15:49.849316] [INFO ] [MAIN ] TXO: Full history saved. [2025-09-17T22:15:49.849689] [INFO ] [MAIN ] Update Progress: 2158/2371 symbols completed. TXO took 28.6s. Estimated remaining: 31m 10s. Rate: 6.8 symbols/min [2025-09-17T22:15:49.896278] [DEBUG] [LOCAL ] TXNM: Primary data saved (44151 records). [2025-09-17T22:15:49.896403] [INFO ] [MAIN ] TXNM: Full history saved. [2025-09-17T22:15:49.896509] [INFO ] [MAIN ] Update Progress: 2159/2371 symbols completed. TXNM took 43.3s. Estimated remaining: 31m 1s. Rate: 6.8 symbols/min [2025-09-17T22:15:51.094910] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T22:15:51.105174] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-07. [2025-09-17T22:15:52.919865] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T22:15:52.931245] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-08. [2025-09-17T22:15:54.738058] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-08 (1.81 seconds). [2025-09-17T22:15:54.748871] [INFO ] [REMOTE ] TXT: Fetching primary data for 2025-09. [2025-09-17T22:15:55.421678] [INFO ] [REMOTE ] TXT: Incremental fetch complete for 2025-09 (0.67 seconds). [2025-09-17T22:15:55.428238] [INFO ] [REMOTE ] TXT: Full fetch complete (71942 records). [2025-09-17T22:15:55.428367] [DEBUG] [VALIDATOR ] TXT: Validating primary data. [2025-09-17T22:15:55.873502] [DEBUG] [VALIDATOR ] TXT: All expected trading days are present. [2025-09-17T22:15:55.873707] [DEBUG] [VALIDATOR ] TXT: Primary data validation passed. [2025-09-17T22:15:55.874867] [INFO ] [MAIN ] TXT: Fetched primary data is valid. [2025-09-17T22:15:55.874934] [DEBUG] [LOCAL ] TXT: Saving primary data. [2025-09-17T22:15:55.876528] [DEBUG] [LOCAL ] TXT: Trimmed 71942 records to 49819 (keeping 200 days of data) [2025-09-17T22:15:56.211562] [DEBUG] [LOCAL ] TXT: Primary data saved (49819 records). [2025-09-17T22:15:56.211771] [INFO ] [MAIN ] TXT: Full history saved. [2025-09-17T22:15:56.212835] [INFO ] [MAIN ] Update Progress: 2160/2371 symbols completed. TXT took 31.0s. Estimated remaining: 30m 52s. Rate: 6.8 symbols/min [2025-09-17T22:15:56.834480] [INFO ] [MAIN ] TY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:15:56.916200] [INFO ] [MAIN ] U: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:15:56.945343] [INFO ] [MAIN ] TYL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:15:56.973836] [INFO ] [MAIN ] TYG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:15:56.984121] [DEBUG] [LOCAL ] TY: Loaded 7680 existing records from primary storage. [2025-09-17T22:15:56.984526] [INFO ] [MAIN ] TY: Loaded 7680 existing records. [2025-09-17T22:15:57.130268] [DEBUG] [LOCAL ] TYG: Loaded 14549 existing records from primary storage. [2025-09-17T22:15:57.157464] [DEBUG] [LOCAL ] TYL: Loaded 22399 existing records from primary storage. [2025-09-17T22:15:57.157951] [INFO ] [MAIN ] TYG: Loaded 14549 existing records. [2025-09-17T22:15:57.158123] [INFO ] [MAIN ] TYL: Loaded 22399 existing records. [2025-09-17T22:15:57.370933] [WARN ] [MAIN ] TY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:15:57.404176] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-17T22:15:57.409527] [INFO ] [MAIN ] TY: Wiping existing primary data before full refresh. [2025-09-17T22:15:57.409666] [INFO ] [LOCAL ] TY: Starting deletion of primary data. [2025-09-17T22:15:57.409763] [INFO ] [MAIN ] U: Loaded 53799 existing records. [2025-09-17T22:15:57.473362] [DEBUG] [LOCAL ] TY: Deleted primary data file. [2025-09-17T22:15:57.477506] [INFO ] [MAIN ] TY: Starting full primary refresh. [2025-09-17T22:15:57.857779] [WARN ] [MAIN ] TYL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:15:57.863027] [WARN ] [MAIN ] TYG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:15:57.953430] [INFO ] [MAIN ] TYL: Wiping existing primary data before full refresh. [2025-09-17T22:15:58.010889] [INFO ] [MAIN ] TYG: Wiping existing primary data before full refresh. [2025-09-17T22:15:57.985109] [INFO ] [LOCAL ] TYL: Starting deletion of primary data. [2025-09-17T22:15:58.023854] [INFO ] [LOCAL ] TYG: Starting deletion of primary data. [2025-09-17T22:15:58.062602] [WARN ] [MAIN ] U: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:15:58.103671] [DEBUG] [LOCAL ] TYL: Deleted primary data file. [2025-09-17T22:15:58.079091] [DEBUG] [LOCAL ] TYG: Deleted primary data file. [2025-09-17T22:15:58.112856] [INFO ] [MAIN ] TYG: Starting full primary refresh. [2025-09-17T22:15:58.122046] [INFO ] [MAIN ] TYL: Starting full primary refresh. [2025-09-17T22:15:58.158422] [INFO ] [MAIN ] U: Wiping existing primary data before full refresh. [2025-09-17T22:15:58.210476] [INFO ] [LOCAL ] U: Starting deletion of primary data. [2025-09-17T22:15:58.239850] [DEBUG] [LOCAL ] U: Deleted primary data file. [2025-09-17T22:15:58.366611] [INFO ] [MAIN ] U: Starting full primary refresh. [2025-09-17T22:15:58.487172] [INFO ] [REMOTE ] TY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:15:58.528949] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-11. [2025-09-17T22:15:59.192596] [INFO ] [REMOTE ] TYG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:15:59.207022] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-11. [2025-09-17T22:15:59.315126] [INFO ] [REMOTE ] TYL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:15:59.336335] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-11. [2025-09-17T22:15:59.397804] [INFO ] [REMOTE ] U: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:15:59.398132] [INFO ] [REMOTE ] U: Fetching primary data for 2024-11. [2025-09-17T22:15:59.488567] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-11 (0.96 seconds). [2025-09-17T22:15:59.490825] [INFO ] [REMOTE ] TY: Fetching primary data for 2024-12. [2025-09-17T22:15:59.757541] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T22:15:59.759999] [INFO ] [REMOTE ] TYG: Fetching primary data for 2024-12. [2025-09-17T22:16:00.347842] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T22:16:00.350496] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-01. [2025-09-17T22:16:00.629528] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T22:16:00.636745] [INFO ] [REMOTE ] TYL: Fetching primary data for 2024-12. [2025-09-17T22:16:00.720814] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2024-12 (0.96 seconds). [2025-09-17T22:16:00.724268] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-01. [2025-09-17T22:16:00.836746] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-01 (0.49 seconds). [2025-09-17T22:16:00.839417] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-02. [2025-09-17T22:16:01.389097] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-02 (0.55 seconds). [2025-09-17T22:16:01.391550] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-03. [2025-09-17T22:16:01.746803] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-11 (2.35 seconds). [2025-09-17T22:16:01.758274] [INFO ] [REMOTE ] U: Fetching primary data for 2024-12. [2025-09-17T22:16:01.813716] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T22:16:01.903474] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T22:16:02.015842] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-02. [2025-09-17T22:16:02.141589] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-03 (0.75 seconds). [2025-09-17T22:16:02.814296] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T22:16:02.817865] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-04. [2025-09-17T22:16:03.615800] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-03. [2025-09-17T22:16:03.690685] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-04 (0.87 seconds). [2025-09-17T22:16:04.150718] [INFO ] [REMOTE ] U: Incremental fetch complete for 2024-12 (2.39 seconds). [2025-09-17T22:16:04.415792] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-05. [2025-09-17T22:16:04.776514] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-03 (1.16 seconds). [2025-09-17T22:16:05.174745] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-05 (0.76 seconds). [2025-09-17T22:16:05.215799] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-06. [2025-09-17T22:16:06.012148] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-06 (0.80 seconds). [2025-09-17T22:16:06.015675] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-07. [2025-09-17T22:16:06.796952] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-07 (0.78 seconds). [2025-09-17T22:16:06.815729] [INFO ] [REMOTE ] U: Fetching primary data for 2025-01. [2025-09-17T22:16:07.615777] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-04. [2025-09-17T22:16:08.313944] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T22:16:08.415771] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-05. [2025-09-17T22:16:08.967449] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T22:16:09.215787] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-01. [2025-09-17T22:16:09.229315] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T22:16:10.004313] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T22:16:10.015678] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-02. [2025-09-17T22:16:10.815773] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-08. [2025-09-17T22:16:11.171910] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T22:16:11.610922] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-08 (0.80 seconds). [2025-09-17T22:16:11.615681] [INFO ] [REMOTE ] TY: Fetching primary data for 2025-09. [2025-09-17T22:16:12.333707] [INFO ] [REMOTE ] TY: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T22:16:12.335303] [INFO ] [REMOTE ] TY: Full fetch complete (11747 records). [2025-09-17T22:16:12.335374] [DEBUG] [VALIDATOR ] TY: Validating primary data. [2025-09-17T22:16:12.420996] [INFO ] [REMOTE ] U: Fetching primary data for 2025-02. [2025-09-17T22:16:12.739547] [DEBUG] [VALIDATOR ] TY: All expected trading days are present. [2025-09-17T22:16:12.739626] [DEBUG] [VALIDATOR ] TY: Primary data validation passed. [2025-09-17T22:16:12.739933] [INFO ] [MAIN ] TY: Fetched primary data is valid. [2025-09-17T22:16:12.739982] [DEBUG] [LOCAL ] TY: Saving primary data. [2025-09-17T22:16:12.740443] [DEBUG] [LOCAL ] TY: Trimmed 11747 records to 7682 (keeping 200 days of data) [2025-09-17T22:16:12.789039] [DEBUG] [LOCAL ] TY: Primary data saved (7682 records). [2025-09-17T22:16:12.789194] [INFO ] [MAIN ] TY: Full history saved. [2025-09-17T22:16:12.789289] [INFO ] [MAIN ] Update Progress: 2161/2371 symbols completed. TY took 16.6s. Estimated remaining: 30m 44s. Rate: 6.8 symbols/min [2025-09-17T22:16:12.971860] [INFO ] [MAIN ] UA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:16:13.023276] [DEBUG] [LOCAL ] UA: Loaded 50324 existing records from primary storage. [2025-09-17T22:16:13.023500] [INFO ] [MAIN ] UA: Loaded 50324 existing records. [2025-09-17T22:16:13.208524] [WARN ] [MAIN ] UA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:16:13.208871] [INFO ] [MAIN ] UA: Wiping existing primary data before full refresh. [2025-09-17T22:16:13.208961] [INFO ] [LOCAL ] UA: Starting deletion of primary data. [2025-09-17T22:16:13.210355] [DEBUG] [LOCAL ] UA: Deleted primary data file. [2025-09-17T22:16:13.210420] [INFO ] [MAIN ] UA: Starting full primary refresh. [2025-09-17T22:16:13.222311] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-03. [2025-09-17T22:16:13.589876] [INFO ] [REMOTE ] UA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:16:14.015827] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-06. [2025-09-17T22:16:14.543089] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T22:16:14.749973] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-02 (2.33 seconds). [2025-09-17T22:16:14.789040] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-06 (0.77 seconds). [2025-09-17T22:16:14.815754] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-11. [2025-09-17T22:16:15.615812] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-04. [2025-09-17T22:16:16.415790] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-07. [2025-09-17T22:16:16.479970] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T22:16:17.031854] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T22:16:17.172527] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T22:16:17.215814] [INFO ] [REMOTE ] U: Fetching primary data for 2025-03. [2025-09-17T22:16:18.015786] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-05. [2025-09-17T22:16:18.815749] [INFO ] [REMOTE ] UA: Fetching primary data for 2024-12. [2025-09-17T22:16:19.071318] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T22:16:19.537186] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-03 (2.32 seconds). [2025-09-17T22:16:19.615792] [INFO ] [REMOTE ] U: Fetching primary data for 2025-04. [2025-09-17T22:16:20.415814] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-06. [2025-09-17T22:16:20.665611] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T22:16:21.215771] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-08. [2025-09-17T22:16:21.464812] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T22:16:21.599413] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T22:16:22.015811] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-07. [2025-09-17T22:16:22.185620] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T22:16:22.815808] [INFO ] [REMOTE ] TYG: Fetching primary data for 2025-09. [2025-09-17T22:16:23.170768] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T22:16:23.615813] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-08. [2025-09-17T22:16:23.627715] [INFO ] [REMOTE ] TYG: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T22:16:23.630004] [INFO ] [REMOTE ] TYG: Full fetch complete (22428 records). [2025-09-17T22:16:23.630107] [DEBUG] [VALIDATOR ] TYG: Validating primary data. [2025-09-17T22:16:24.020988] [DEBUG] [VALIDATOR ] TYG: All expected trading days are present. [2025-09-17T22:16:24.021091] [DEBUG] [VALIDATOR ] TYG: Primary data validation passed. [2025-09-17T22:16:24.021622] [INFO ] [MAIN ] TYG: Fetched primary data is valid. [2025-09-17T22:16:24.021705] [DEBUG] [LOCAL ] TYG: Saving primary data. [2025-09-17T22:16:24.022333] [DEBUG] [LOCAL ] TYG: Trimmed 22428 records to 14507 (keeping 200 days of data) [2025-09-17T22:16:24.116760] [DEBUG] [LOCAL ] TYG: Primary data saved (14507 records). [2025-09-17T22:16:24.116909] [INFO ] [MAIN ] TYG: Full history saved. [2025-09-17T22:16:24.116995] [INFO ] [MAIN ] Update Progress: 2162/2371 symbols completed. TYG took 27.9s. Estimated remaining: 30m 35s. Rate: 6.8 symbols/min [2025-09-17T22:16:24.288592] [INFO ] [MAIN ] UAA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:16:24.341924] [DEBUG] [LOCAL ] UAA: Loaded 53514 existing records from primary storage. [2025-09-17T22:16:24.342075] [INFO ] [MAIN ] UAA: Loaded 53514 existing records. [2025-09-17T22:16:24.420884] [INFO ] [REMOTE ] U: Fetching primary data for 2025-05. [2025-09-17T22:16:24.532940] [WARN ] [MAIN ] UAA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:16:24.533183] [INFO ] [MAIN ] UAA: Wiping existing primary data before full refresh. [2025-09-17T22:16:24.533253] [INFO ] [LOCAL ] UAA: Starting deletion of primary data. [2025-09-17T22:16:24.534368] [DEBUG] [LOCAL ] UAA: Deleted primary data file. [2025-09-17T22:16:24.534432] [INFO ] [MAIN ] UAA: Starting full primary refresh. [2025-09-17T22:16:24.931999] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T22:16:24.973001] [INFO ] [REMOTE ] UAA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:16:25.215791] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-01. [2025-09-17T22:16:26.015843] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-11. [2025-09-17T22:16:26.815788] [INFO ] [REMOTE ] TYL: Fetching primary data for 2025-09. [2025-09-17T22:16:26.911987] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T22:16:26.963935] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-05 (2.54 seconds). [2025-09-17T22:16:27.284426] [INFO ] [REMOTE ] TYL: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T22:16:27.287733] [INFO ] [REMOTE ] TYL: Full fetch complete (31270 records). [2025-09-17T22:16:27.287822] [DEBUG] [VALIDATOR ] TYL: Validating primary data. [2025-09-17T22:16:27.618129] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-02. [2025-09-17T22:16:27.697835] [DEBUG] [VALIDATOR ] TYL: All expected trading days are present. [2025-09-17T22:16:27.697969] [DEBUG] [VALIDATOR ] TYL: Primary data validation passed. [2025-09-17T22:16:27.698804] [INFO ] [MAIN ] TYL: Fetched primary data is valid. [2025-09-17T22:16:27.698888] [DEBUG] [LOCAL ] TYL: Saving primary data. [2025-09-17T22:16:27.700373] [DEBUG] [LOCAL ] TYL: Trimmed 31270 records to 22466 (keeping 200 days of data) [2025-09-17T22:16:27.820598] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-11 (1.80 seconds). [2025-09-17T22:16:27.879308] [DEBUG] [LOCAL ] TYL: Primary data saved (22466 records). [2025-09-17T22:16:27.879437] [INFO ] [MAIN ] TYL: Full history saved. [2025-09-17T22:16:27.879535] [INFO ] [MAIN ] Update Progress: 2163/2371 symbols completed. TYL took 31.7s. Estimated remaining: 30m 26s. Rate: 6.8 symbols/min [2025-09-17T22:16:28.049898] [INFO ] [MAIN ] UAN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:16:28.057234] [DEBUG] [LOCAL ] UAN: Loaded 5534 existing records from primary storage. [2025-09-17T22:16:28.057343] [INFO ] [MAIN ] UAN: Loaded 5534 existing records. [2025-09-17T22:16:28.235588] [WARN ] [MAIN ] UAN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:16:28.235883] [INFO ] [MAIN ] UAN: Wiping existing primary data before full refresh. [2025-09-17T22:16:28.235931] [INFO ] [LOCAL ] UAN: Starting deletion of primary data. [2025-09-17T22:16:28.236192] [DEBUG] [LOCAL ] UAN: Deleted primary data file. [2025-09-17T22:16:28.236250] [INFO ] [MAIN ] UAN: Starting full primary refresh. [2025-09-17T22:16:28.421423] [INFO ] [REMOTE ] U: Fetching primary data for 2025-06. [2025-09-17T22:16:28.603226] [INFO ] [REMOTE ] UAN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:16:29.215804] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-11. [2025-09-17T22:16:29.468670] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T22:16:29.694027] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T22:16:30.015834] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-03. [2025-09-17T22:16:30.796035] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-06 (2.37 seconds). [2025-09-17T22:16:30.815744] [INFO ] [REMOTE ] U: Fetching primary data for 2025-07. [2025-09-17T22:16:31.615835] [INFO ] [REMOTE ] UAA: Fetching primary data for 2024-12. [2025-09-17T22:16:31.844513] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T22:16:32.415854] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-04. [2025-09-17T22:16:33.216253] [INFO ] [REMOTE ] UAN: Fetching primary data for 2024-12. [2025-09-17T22:16:33.392268] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-07 (2.58 seconds). [2025-09-17T22:16:33.572216] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T22:16:33.726422] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T22:16:33.951922] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2024-12 (0.74 seconds). [2025-09-17T22:16:34.015817] [INFO ] [REMOTE ] U: Fetching primary data for 2025-08. [2025-09-17T22:16:34.815799] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-01. [2025-09-17T22:16:35.615824] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-01. [2025-09-17T22:16:36.050022] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-08 (2.03 seconds). [2025-09-17T22:16:36.258993] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T22:16:36.415793] [INFO ] [REMOTE ] U: Fetching primary data for 2025-09. [2025-09-17T22:16:36.539425] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T22:16:37.215789] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-05. [2025-09-17T22:16:38.015801] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-02. [2025-09-17T22:16:38.667872] [INFO ] [REMOTE ] U: Incremental fetch complete for 2025-09 (2.25 seconds). [2025-09-17T22:16:38.675404] [INFO ] [REMOTE ] U: Full fetch complete (77872 records). [2025-09-17T22:16:38.675568] [DEBUG] [VALIDATOR ] U: Validating primary data. [2025-09-17T22:16:38.821078] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-02. [2025-09-17T22:16:39.133463] [DEBUG] [VALIDATOR ] U: All expected trading days are present. [2025-09-17T22:16:39.133728] [DEBUG] [VALIDATOR ] U: Primary data validation passed. [2025-09-17T22:16:39.135015] [INFO ] [MAIN ] U: Fetched primary data is valid. [2025-09-17T22:16:39.135226] [DEBUG] [LOCAL ] U: Saving primary data. [2025-09-17T22:16:39.137247] [DEBUG] [LOCAL ] U: Trimmed 77872 records to 53799 (keeping 200 days of data) [2025-09-17T22:16:39.168912] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-05 (1.95 seconds). [2025-09-17T22:16:39.525849] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-02 (1.51 seconds). [2025-09-17T22:16:39.543996] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-02 (0.72 seconds). [2025-09-17T22:16:39.566373] [DEBUG] [LOCAL ] U: Primary data saved (53799 records). [2025-09-17T22:16:39.566573] [INFO ] [MAIN ] U: Full history saved. [2025-09-17T22:16:39.566779] [INFO ] [MAIN ] Update Progress: 2164/2371 symbols completed. U took 43.3s. Estimated remaining: 30m 17s. Rate: 6.8 symbols/min [2025-09-17T22:16:39.620881] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-03. [2025-09-17T22:16:39.781447] [INFO ] [MAIN ] UBER: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:16:39.838199] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-17T22:16:39.838353] [INFO ] [MAIN ] UBER: Loaded 53806 existing records. [2025-09-17T22:16:40.068329] [WARN ] [MAIN ] UBER: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:16:40.068636] [INFO ] [MAIN ] UBER: Wiping existing primary data before full refresh. [2025-09-17T22:16:40.068719] [INFO ] [LOCAL ] UBER: Starting deletion of primary data. [2025-09-17T22:16:40.069946] [DEBUG] [LOCAL ] UBER: Deleted primary data file. [2025-09-17T22:16:40.070007] [INFO ] [MAIN ] UBER: Starting full primary refresh. [2025-09-17T22:16:40.385782] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-03 (0.76 seconds). [2025-09-17T22:16:40.426020] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-04. [2025-09-17T22:16:40.459556] [INFO ] [REMOTE ] UBER: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:16:41.201298] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-04 (0.78 seconds). [2025-09-17T22:16:41.215681] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-05. [2025-09-17T22:16:41.959276] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T22:16:42.015826] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-06. [2025-09-17T22:16:42.632588] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-06 (0.62 seconds). [2025-09-17T22:16:42.815798] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-06. [2025-09-17T22:16:43.615783] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-07. [2025-09-17T22:16:44.220156] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-07 (0.60 seconds). [2025-09-17T22:16:44.415768] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-08. [2025-09-17T22:16:44.565017] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T22:16:45.081158] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-08 (0.67 seconds). [2025-09-17T22:16:45.215793] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-11. [2025-09-17T22:16:46.015800] [INFO ] [REMOTE ] UAN: Fetching primary data for 2025-09. [2025-09-17T22:16:46.556220] [INFO ] [REMOTE ] UAN: Incremental fetch complete for 2025-09 (0.54 seconds). [2025-09-17T22:16:46.557382] [INFO ] [REMOTE ] UAN: Full fetch complete (8618 records). [2025-09-17T22:16:46.557449] [DEBUG] [VALIDATOR ] UAN: Validating primary data. [2025-09-17T22:16:46.820886] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-07. [2025-09-17T22:16:46.943221] [DEBUG] [VALIDATOR ] UAN: All expected trading days are present. [2025-09-17T22:16:46.943311] [DEBUG] [VALIDATOR ] UAN: Primary data validation passed. [2025-09-17T22:16:46.943562] [INFO ] [MAIN ] UAN: Fetched primary data is valid. [2025-09-17T22:16:46.943621] [DEBUG] [LOCAL ] UAN: Saving primary data. [2025-09-17T22:16:46.944145] [DEBUG] [LOCAL ] UAN: Trimmed 8618 records to 5544 (keeping 200 days of data) [2025-09-17T22:16:46.979755] [DEBUG] [LOCAL ] UAN: Primary data saved (5544 records). [2025-09-17T22:16:46.979884] [INFO ] [MAIN ] UAN: Full history saved. [2025-09-17T22:16:46.979970] [INFO ] [MAIN ] Update Progress: 2165/2371 symbols completed. UAN took 19.1s. Estimated remaining: 30m 8s. Rate: 6.8 symbols/min [2025-09-17T22:16:47.155532] [INFO ] [MAIN ] UBS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:16:47.211063] [DEBUG] [LOCAL ] UBS: Loaded 52518 existing records from primary storage. [2025-09-17T22:16:47.211235] [INFO ] [MAIN ] UBS: Loaded 52518 existing records. [2025-09-17T22:16:47.418101] [WARN ] [MAIN ] UBS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:16:47.418379] [INFO ] [MAIN ] UBS: Wiping existing primary data before full refresh. [2025-09-17T22:16:47.418428] [INFO ] [LOCAL ] UBS: Starting deletion of primary data. [2025-09-17T22:16:47.419737] [DEBUG] [LOCAL ] UBS: Deleted primary data file. [2025-09-17T22:16:47.419829] [INFO ] [MAIN ] UBS: Starting full primary refresh. [2025-09-17T22:16:47.633449] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-03. [2025-09-17T22:16:47.831424] [INFO ] [REMOTE ] UBS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:16:47.865049] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-11 (2.65 seconds). [2025-09-17T22:16:48.415844] [INFO ] [REMOTE ] UBER: Fetching primary data for 2024-12. [2025-09-17T22:16:48.862535] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-07 (2.04 seconds). [2025-09-17T22:16:49.220883] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-08. [2025-09-17T22:16:49.243091] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T22:16:50.015825] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-11. [2025-09-17T22:16:50.609938] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-17T22:16:50.815753] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-01. [2025-09-17T22:16:51.186460] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T22:16:51.615798] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-04. [2025-09-17T22:16:51.838529] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T22:16:52.415793] [INFO ] [REMOTE ] UBS: Fetching primary data for 2024-12. [2025-09-17T22:16:53.215803] [INFO ] [REMOTE ] UA: Fetching primary data for 2025-09. [2025-09-17T22:16:53.349268] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T22:16:53.597681] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-01 (2.78 seconds). [2025-09-17T22:16:54.015785] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-02. [2025-09-17T22:16:54.297668] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T22:16:54.641635] [INFO ] [REMOTE ] UA: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T22:16:54.648376] [INFO ] [REMOTE ] UA: Full fetch complete (72699 records). [2025-09-17T22:16:54.648507] [DEBUG] [VALIDATOR ] UA: Validating primary data. [2025-09-17T22:16:54.829687] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-05. [2025-09-17T22:16:55.053285] [DEBUG] [VALIDATOR ] UA: All expected trading days are present. [2025-09-17T22:16:55.053373] [DEBUG] [VALIDATOR ] UA: Primary data validation passed. [2025-09-17T22:16:55.054461] [INFO ] [MAIN ] UA: Fetched primary data is valid. [2025-09-17T22:16:55.054540] [DEBUG] [LOCAL ] UA: Saving primary data. [2025-09-17T22:16:55.056039] [DEBUG] [LOCAL ] UA: Trimmed 72699 records to 50372 (keeping 200 days of data) [2025-09-17T22:16:55.344447] [DEBUG] [LOCAL ] UA: Primary data saved (50372 records). [2025-09-17T22:16:55.345111] [INFO ] [MAIN ] UA: Full history saved. [2025-09-17T22:16:55.346708] [INFO ] [MAIN ] Update Progress: 2166/2371 symbols completed. UA took 42.6s. Estimated remaining: 29m 60s. Rate: 6.8 symbols/min [2025-09-17T22:16:55.522686] [INFO ] [MAIN ] UCB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:16:55.570261] [DEBUG] [LOCAL ] UCB: Loaded 38163 existing records from primary storage. [2025-09-17T22:16:55.570416] [INFO ] [MAIN ] UCB: Loaded 38163 existing records. [2025-09-17T22:16:55.631147] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-01. [2025-09-17T22:16:55.806035] [WARN ] [MAIN ] UCB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:16:55.806323] [INFO ] [MAIN ] UCB: Wiping existing primary data before full refresh. [2025-09-17T22:16:55.806372] [INFO ] [LOCAL ] UCB: Starting deletion of primary data. [2025-09-17T22:16:55.807250] [DEBUG] [LOCAL ] UCB: Deleted primary data file. [2025-09-17T22:16:55.807309] [INFO ] [MAIN ] UCB: Starting full primary refresh. [2025-09-17T22:16:56.185148] [INFO ] [REMOTE ] UCB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:16:56.415760] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-11. [2025-09-17T22:16:56.499716] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-02 (2.48 seconds). [2025-09-17T22:16:56.604689] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T22:16:57.215798] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-03. [2025-09-17T22:16:57.592091] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-01 (1.96 seconds). [2025-09-17T22:16:57.714074] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-11 (1.30 seconds). [2025-09-17T22:16:58.015778] [INFO ] [REMOTE ] UCB: Fetching primary data for 2024-12. [2025-09-17T22:16:58.815798] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-02. [2025-09-17T22:16:59.569425] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-03 (2.35 seconds). [2025-09-17T22:16:59.624550] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-06. [2025-09-17T22:16:59.626077] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2024-12 (1.61 seconds). [2025-09-17T22:17:00.415704] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-01. [2025-09-17T22:17:00.544194] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T22:17:01.215757] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-04. [2025-09-17T22:17:01.288190] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T22:17:01.529670] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T22:17:02.015782] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-03. [2025-09-17T22:17:02.815802] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-02. [2025-09-17T22:17:03.615833] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-07. [2025-09-17T22:17:03.727146] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-04 (2.51 seconds). [2025-09-17T22:17:03.802584] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-02 (0.99 seconds). [2025-09-17T22:17:03.838570] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T22:17:04.415826] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-03. [2025-09-17T22:17:05.215813] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-04. [2025-09-17T22:17:05.612782] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T22:17:05.664522] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-07 (2.05 seconds). [2025-09-17T22:17:06.015799] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-05. [2025-09-17T22:17:06.815781] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-08. [2025-09-17T22:17:07.121177] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T22:17:07.615775] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-04. [2025-09-17T22:17:08.341572] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-05 (2.33 seconds). [2025-09-17T22:17:08.415741] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-06. [2025-09-17T22:17:08.450103] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T22:17:08.849165] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T22:17:09.215805] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-05. [2025-09-17T22:17:10.015783] [INFO ] [REMOTE ] UAA: Fetching primary data for 2025-09. [2025-09-17T22:17:10.646506] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-05 (1.43 seconds). [2025-09-17T22:17:10.815848] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-05. [2025-09-17T22:17:10.874934] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-06 (2.46 seconds). [2025-09-17T22:17:11.615790] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-07. [2025-09-17T22:17:11.789896] [INFO ] [REMOTE ] UAA: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T22:17:11.797098] [INFO ] [REMOTE ] UAA: Full fetch complete (77321 records). [2025-09-17T22:17:11.797274] [DEBUG] [VALIDATOR ] UAA: Validating primary data. [2025-09-17T22:17:12.212385] [DEBUG] [VALIDATOR ] UAA: All expected trading days are present. [2025-09-17T22:17:12.212477] [DEBUG] [VALIDATOR ] UAA: Primary data validation passed. [2025-09-17T22:17:12.213709] [INFO ] [MAIN ] UAA: Fetched primary data is valid. [2025-09-17T22:17:12.213778] [DEBUG] [LOCAL ] UAA: Saving primary data. [2025-09-17T22:17:12.215311] [DEBUG] [LOCAL ] UAA: Trimmed 77321 records to 53510 (keeping 200 days of data) [2025-09-17T22:17:12.428917] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-06. [2025-09-17T22:17:12.543408] [DEBUG] [LOCAL ] UAA: Primary data saved (53510 records). [2025-09-17T22:17:12.543559] [INFO ] [MAIN ] UAA: Full history saved. [2025-09-17T22:17:12.543713] [INFO ] [MAIN ] Update Progress: 2167/2371 symbols completed. UAA took 48.4s. Estimated remaining: 29m 52s. Rate: 6.8 symbols/min [2025-09-17T22:17:12.737174] [INFO ] [MAIN ] UDR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:17:12.772938] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-05 (1.96 seconds). [2025-09-17T22:17:12.830541] [DEBUG] [LOCAL ] UDR: Loaded 51800 existing records from primary storage. [2025-09-17T22:17:12.830751] [INFO ] [MAIN ] UDR: Loaded 51800 existing records. [2025-09-17T22:17:13.016419] [WARN ] [MAIN ] UDR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:17:13.016718] [INFO ] [MAIN ] UDR: Wiping existing primary data before full refresh. [2025-09-17T22:17:13.016775] [INFO ] [LOCAL ] UDR: Starting deletion of primary data. [2025-09-17T22:17:13.017862] [DEBUG] [LOCAL ] UDR: Deleted primary data file. [2025-09-17T22:17:13.017925] [INFO ] [MAIN ] UDR: Starting full primary refresh. [2025-09-17T22:17:13.225414] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-06. [2025-09-17T22:17:13.376842] [INFO ] [REMOTE ] UDR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:17:13.818499] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T22:17:14.015809] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-07. [2025-09-17T22:17:14.266905] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-07 (2.65 seconds). [2025-09-17T22:17:14.815798] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-08. [2025-09-17T22:17:15.182540] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T22:17:15.496584] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T22:17:15.615783] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-11. [2025-09-17T22:17:16.415810] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-08. [2025-09-17T22:17:17.215774] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-07. [2025-09-17T22:17:17.297317] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-08 (2.48 seconds). [2025-09-17T22:17:17.338742] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T22:17:17.894780] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T22:17:18.015797] [INFO ] [REMOTE ] UDR: Fetching primary data for 2024-12. [2025-09-17T22:17:18.815858] [INFO ] [REMOTE ] UCB: Fetching primary data for 2025-09. [2025-09-17T22:17:19.047303] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-07 (1.83 seconds). [2025-09-17T22:17:19.422965] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2024-12 (1.41 seconds). [2025-09-17T22:17:19.615804] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-01. [2025-09-17T22:17:20.296242] [INFO ] [REMOTE ] UCB: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T22:17:20.301224] [INFO ] [REMOTE ] UCB: Full fetch complete (54567 records). [2025-09-17T22:17:20.301337] [DEBUG] [VALIDATOR ] UCB: Validating primary data. [2025-09-17T22:17:20.420877] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-08. [2025-09-17T22:17:20.716127] [DEBUG] [VALIDATOR ] UCB: All expected trading days are present. [2025-09-17T22:17:20.716278] [DEBUG] [VALIDATOR ] UCB: Primary data validation passed. [2025-09-17T22:17:20.717321] [INFO ] [MAIN ] UCB: Fetched primary data is valid. [2025-09-17T22:17:20.717407] [DEBUG] [LOCAL ] UCB: Saving primary data. [2025-09-17T22:17:20.718788] [DEBUG] [LOCAL ] UCB: Trimmed 54567 records to 38155 (keeping 200 days of data) [2025-09-17T22:17:20.971621] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T22:17:21.002840] [DEBUG] [LOCAL ] UCB: Primary data saved (38155 records). [2025-09-17T22:17:21.003001] [INFO ] [MAIN ] UCB: Full history saved. [2025-09-17T22:17:21.005905] [INFO ] [MAIN ] Update Progress: 2168/2371 symbols completed. UCB took 25.7s. Estimated remaining: 29m 43s. Rate: 6.8 symbols/min [2025-09-17T22:17:21.175623] [INFO ] [MAIN ] UE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:17:21.220060] [INFO ] [REMOTE ] UBER: Fetching primary data for 2025-09. [2025-09-17T22:17:21.222417] [DEBUG] [LOCAL ] UE: Loaded 43085 existing records from primary storage. [2025-09-17T22:17:21.222598] [INFO ] [MAIN ] UE: Loaded 43085 existing records. [2025-09-17T22:17:21.406594] [WARN ] [MAIN ] UE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:17:21.406985] [INFO ] [MAIN ] UE: Wiping existing primary data before full refresh. [2025-09-17T22:17:21.407042] [INFO ] [LOCAL ] UE: Starting deletion of primary data. [2025-09-17T22:17:21.408419] [DEBUG] [LOCAL ] UE: Deleted primary data file. [2025-09-17T22:17:21.408479] [INFO ] [MAIN ] UE: Starting full primary refresh. [2025-09-17T22:17:21.763002] [INFO ] [REMOTE ] UE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:17:21.989702] [INFO ] [REMOTE ] UBER: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T22:17:21.996751] [INFO ] [REMOTE ] UBER: Full fetch complete (77952 records). [2025-09-17T22:17:21.996884] [DEBUG] [VALIDATOR ] UBER: Validating primary data. [2025-09-17T22:17:22.020892] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-02. [2025-09-17T22:17:22.402278] [DEBUG] [VALIDATOR ] UBER: All expected trading days are present. [2025-09-17T22:17:22.402386] [DEBUG] [VALIDATOR ] UBER: Primary data validation passed. [2025-09-17T22:17:22.403613] [INFO ] [MAIN ] UBER: Fetched primary data is valid. [2025-09-17T22:17:22.403720] [DEBUG] [LOCAL ] UBER: Saving primary data. [2025-09-17T22:17:22.405589] [DEBUG] [LOCAL ] UBER: Trimmed 77952 records to 53806 (keeping 200 days of data) [2025-09-17T22:17:22.531271] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-08 (2.11 seconds). [2025-09-17T22:17:22.767172] [DEBUG] [LOCAL ] UBER: Primary data saved (53806 records). [2025-09-17T22:17:22.767320] [INFO ] [MAIN ] UBER: Full history saved. [2025-09-17T22:17:22.769347] [INFO ] [MAIN ] Update Progress: 2169/2371 symbols completed. UBER took 43.2s. Estimated remaining: 29m 33s. Rate: 6.8 symbols/min [2025-09-17T22:17:22.825008] [INFO ] [REMOTE ] UBS: Fetching primary data for 2025-09. [2025-09-17T22:17:22.944280] [INFO ] [MAIN ] UFI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:17:22.956387] [DEBUG] [LOCAL ] UFI: Loaded 8273 existing records from primary storage. [2025-09-17T22:17:22.956523] [INFO ] [MAIN ] UFI: Loaded 8273 existing records. [2025-09-17T22:17:23.134214] [WARN ] [MAIN ] UFI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:17:23.134503] [INFO ] [MAIN ] UFI: Wiping existing primary data before full refresh. [2025-09-17T22:17:23.134552] [INFO ] [LOCAL ] UFI: Starting deletion of primary data. [2025-09-17T22:17:23.134862] [DEBUG] [LOCAL ] UFI: Deleted primary data file. [2025-09-17T22:17:23.134922] [INFO ] [MAIN ] UFI: Starting full primary refresh. [2025-09-17T22:17:23.509476] [INFO ] [REMOTE ] UFI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:17:23.615792] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-11. [2025-09-17T22:17:23.738130] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T22:17:24.132766] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T22:17:24.229953] [INFO ] [REMOTE ] UBS: Incremental fetch complete for 2025-09 (1.40 seconds). [2025-09-17T22:17:24.236829] [INFO ] [REMOTE ] UBS: Full fetch complete (75410 records). [2025-09-17T22:17:24.236961] [DEBUG] [VALIDATOR ] UBS: Validating primary data. [2025-09-17T22:17:24.424731] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-03. [2025-09-17T22:17:24.660541] [DEBUG] [VALIDATOR ] UBS: All expected trading days are present. [2025-09-17T22:17:24.660622] [DEBUG] [VALIDATOR ] UBS: Primary data validation passed. [2025-09-17T22:17:24.661737] [INFO ] [MAIN ] UBS: Fetched primary data is valid. [2025-09-17T22:17:24.661804] [DEBUG] [LOCAL ] UBS: Saving primary data. [2025-09-17T22:17:24.663278] [DEBUG] [LOCAL ] UBS: Trimmed 75410 records to 52509 (keeping 200 days of data) [2025-09-17T22:17:24.993480] [DEBUG] [LOCAL ] UBS: Primary data saved (52509 records). [2025-09-17T22:17:24.993665] [INFO ] [MAIN ] UBS: Full history saved. [2025-09-17T22:17:24.993782] [INFO ] [MAIN ] Update Progress: 2170/2371 symbols completed. UBS took 38.0s. Estimated remaining: 29m 24s. Rate: 6.8 symbols/min [2025-09-17T22:17:25.196837] [INFO ] [MAIN ] UGI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:17:25.230796] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-11. [2025-09-17T22:17:25.257856] [DEBUG] [LOCAL ] UGI: Loaded 50537 existing records from primary storage. [2025-09-17T22:17:25.258058] [INFO ] [MAIN ] UGI: Loaded 50537 existing records. [2025-09-17T22:17:25.554179] [WARN ] [MAIN ] UGI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:17:25.554598] [INFO ] [MAIN ] UGI: Wiping existing primary data before full refresh. [2025-09-17T22:17:25.554702] [INFO ] [LOCAL ] UGI: Starting deletion of primary data. [2025-09-17T22:17:25.556303] [DEBUG] [LOCAL ] UGI: Deleted primary data file. [2025-09-17T22:17:25.556392] [INFO ] [MAIN ] UGI: Starting full primary refresh. [2025-09-17T22:17:26.022400] [INFO ] [REMOTE ] UFI: Fetching primary data for 2024-12. [2025-09-17T22:17:26.136289] [INFO ] [REMOTE ] UGI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:17:26.381336] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T22:17:26.811392] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2024-12 (0.79 seconds). [2025-09-17T22:17:26.824976] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-01. [2025-09-17T22:17:26.843191] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T22:17:27.594064] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-01 (0.77 seconds). [2025-09-17T22:17:27.615736] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-02. [2025-09-17T22:17:28.415910] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-11. [2025-09-17T22:17:28.427132] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-02 (0.81 seconds). [2025-09-17T22:17:29.215811] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-03. [2025-09-17T22:17:30.008519] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-03 (0.79 seconds). [2025-09-17T22:17:30.015674] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-04. [2025-09-17T22:17:30.103222] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T22:17:30.815810] [INFO ] [REMOTE ] UGI: Fetching primary data for 2024-12. [2025-09-17T22:17:30.991518] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T22:17:31.615793] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-05. [2025-09-17T22:17:32.415804] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-04. [2025-09-17T22:17:32.566094] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-05 (0.95 seconds). [2025-09-17T22:17:32.627701] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2024-12 (1.81 seconds). [2025-09-17T22:17:33.215779] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-01. [2025-09-17T22:17:34.015869] [INFO ] [REMOTE ] UE: Fetching primary data for 2024-12. [2025-09-17T22:17:34.182817] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-04 (1.77 seconds). [2025-09-17T22:17:34.408392] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T22:17:34.815795] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-05. [2025-09-17T22:17:35.145724] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T22:17:35.615783] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-02. [2025-09-17T22:17:36.415802] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-01. [2025-09-17T22:17:36.670674] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T22:17:37.104555] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T22:17:37.215747] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-03. [2025-09-17T22:17:37.953359] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-01 (1.54 seconds). [2025-09-17T22:17:38.015774] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-02. [2025-09-17T22:17:38.759995] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T22:17:38.815782] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-06. [2025-09-17T22:17:39.435934] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T22:17:39.615790] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-03. [2025-09-17T22:17:40.415787] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-04. [2025-09-17T22:17:40.491089] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T22:17:41.084163] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T22:17:41.215793] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-07. [2025-09-17T22:17:42.015771] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-06. [2025-09-17T22:17:42.429066] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T22:17:42.694920] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-06 (0.68 seconds). [2025-09-17T22:17:42.815801] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-05. [2025-09-17T22:17:43.125930] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T22:17:43.615796] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-08. [2025-09-17T22:17:44.420470] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-04. [2025-09-17T22:17:44.426914] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T22:17:44.866227] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-05 (2.05 seconds). [2025-09-17T22:17:45.215791] [INFO ] [REMOTE ] UDR: Fetching primary data for 2025-09. [2025-09-17T22:17:45.892708] [INFO ] [REMOTE ] UDR: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T22:17:45.899547] [INFO ] [REMOTE ] UDR: Full fetch complete (74122 records). [2025-09-17T22:17:45.899744] [DEBUG] [VALIDATOR ] UDR: Validating primary data. [2025-09-17T22:17:46.018912] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-06. [2025-09-17T22:17:46.323811] [DEBUG] [VALIDATOR ] UDR: All expected trading days are present. [2025-09-17T22:17:46.335037] [DEBUG] [VALIDATOR ] UDR: Primary data validation passed. [2025-09-17T22:17:46.336241] [INFO ] [MAIN ] UDR: Fetched primary data is valid. [2025-09-17T22:17:46.336325] [DEBUG] [LOCAL ] UDR: Saving primary data. [2025-09-17T22:17:46.338248] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-04 (1.92 seconds). [2025-09-17T22:17:46.348712] [DEBUG] [LOCAL ] UDR: Trimmed 74122 records to 51801 (keeping 200 days of data) [2025-09-17T22:17:46.654950] [DEBUG] [LOCAL ] UDR: Primary data saved (51801 records). [2025-09-17T22:17:46.655090] [INFO ] [MAIN ] UDR: Full history saved. [2025-09-17T22:17:46.655190] [INFO ] [MAIN ] Update Progress: 2171/2371 symbols completed. UDR took 34.1s. Estimated remaining: 29m 16s. Rate: 6.8 symbols/min [2025-09-17T22:17:46.827460] [INFO ] [MAIN ] UGP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:17:46.824929] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-07. [2025-09-17T22:17:46.867966] [DEBUG] [LOCAL ] UGP: Loaded 42658 existing records from primary storage. [2025-09-17T22:17:46.868110] [INFO ] [MAIN ] UGP: Loaded 42658 existing records. [2025-09-17T22:17:47.044743] [WARN ] [MAIN ] UGP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:17:47.044994] [INFO ] [MAIN ] UGP: Wiping existing primary data before full refresh. [2025-09-17T22:17:47.045050] [INFO ] [LOCAL ] UGP: Starting deletion of primary data. [2025-09-17T22:17:47.045981] [DEBUG] [LOCAL ] UGP: Deleted primary data file. [2025-09-17T22:17:47.046040] [INFO ] [MAIN ] UGP: Starting full primary refresh. [2025-09-17T22:17:47.413199] [INFO ] [REMOTE ] UGP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:17:47.541888] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T22:17:47.615741] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-11. [2025-09-17T22:17:48.194680] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-06 (2.18 seconds). [2025-09-17T22:17:48.415796] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-07. [2025-09-17T22:17:49.215821] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-05. [2025-09-17T22:17:49.433624] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T22:17:49.899526] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T22:17:50.015758] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-08. [2025-09-17T22:17:50.815806] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-08. [2025-09-17T22:17:50.845390] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-05 (1.63 seconds). [2025-09-17T22:17:51.507273] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-08 (0.69 seconds). [2025-09-17T22:17:51.616397] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-06. [2025-09-17T22:17:51.623557] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-08 (1.61 seconds). [2025-09-17T22:17:52.415817] [INFO ] [REMOTE ] UFI: Fetching primary data for 2025-09. [2025-09-17T22:17:53.132425] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-06 (1.52 seconds). [2025-09-17T22:17:53.207523] [INFO ] [REMOTE ] UFI: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T22:17:53.209127] [INFO ] [REMOTE ] UFI: Full fetch complete (12320 records). [2025-09-17T22:17:53.209275] [DEBUG] [VALIDATOR ] UFI: Validating primary data. [2025-09-17T22:17:53.220894] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-07. [2025-09-17T22:17:53.585106] [DEBUG] [VALIDATOR ] UFI: All expected trading days are present. [2025-09-17T22:17:53.585395] [DEBUG] [VALIDATOR ] UFI: Primary data validation passed. [2025-09-17T22:17:53.585906] [INFO ] [MAIN ] UFI: Fetched primary data is valid. [2025-09-17T22:17:53.586009] [DEBUG] [LOCAL ] UFI: Saving primary data. [2025-09-17T22:17:53.587071] [DEBUG] [LOCAL ] UFI: Trimmed 12320 records to 8299 (keeping 200 days of data) [2025-09-17T22:17:53.633637] [DEBUG] [LOCAL ] UFI: Primary data saved (8299 records). [2025-09-17T22:17:53.633814] [INFO ] [MAIN ] UFI: Full history saved. [2025-09-17T22:17:53.634059] [INFO ] [MAIN ] Update Progress: 2172/2371 symbols completed. UFI took 30.9s. Estimated remaining: 29m 7s. Rate: 6.8 symbols/min [2025-09-17T22:17:53.809264] [INFO ] [MAIN ] UHAL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:17:53.831143] [DEBUG] [LOCAL ] UHAL: Loaded 16291 existing records from primary storage. [2025-09-17T22:17:53.831281] [INFO ] [MAIN ] UHAL: Loaded 16291 existing records. [2025-09-17T22:17:54.008962] [WARN ] [MAIN ] UHAL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:17:54.009257] [INFO ] [MAIN ] UHAL: Wiping existing primary data before full refresh. [2025-09-17T22:17:54.009402] [INFO ] [LOCAL ] UHAL: Starting deletion of primary data. [2025-09-17T22:17:54.009942] [DEBUG] [LOCAL ] UHAL: Deleted primary data file. [2025-09-17T22:17:54.010017] [INFO ] [MAIN ] UHAL: Starting full primary refresh. [2025-09-17T22:17:54.021519] [INFO ] [REMOTE ] UGI: Fetching primary data for 2025-09. [2025-09-17T22:17:54.373378] [INFO ] [REMOTE ] UHAL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:17:54.815792] [INFO ] [REMOTE ] UGP: Fetching primary data for 2024-12. [2025-09-17T22:17:55.013674] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T22:17:55.615835] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-08. [2025-09-17T22:17:55.706155] [INFO ] [REMOTE ] UGI: Incremental fetch complete for 2025-09 (1.68 seconds). [2025-09-17T22:17:55.712857] [INFO ] [REMOTE ] UGI: Full fetch complete (73300 records). [2025-09-17T22:17:55.713034] [DEBUG] [VALIDATOR ] UGI: Validating primary data. [2025-09-17T22:17:56.113424] [DEBUG] [VALIDATOR ] UGI: All expected trading days are present. [2025-09-17T22:17:56.113554] [DEBUG] [VALIDATOR ] UGI: Primary data validation passed. [2025-09-17T22:17:56.114925] [INFO ] [MAIN ] UGI: Fetched primary data is valid. [2025-09-17T22:17:56.115080] [DEBUG] [LOCAL ] UGI: Saving primary data. [2025-09-17T22:17:56.119459] [DEBUG] [LOCAL ] UGI: Trimmed 73300 records to 50542 (keeping 200 days of data) [2025-09-17T22:17:56.258929] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T22:17:56.415837] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-01. [2025-09-17T22:17:56.488125] [DEBUG] [LOCAL ] UGI: Primary data saved (50542 records). [2025-09-17T22:17:56.488305] [INFO ] [MAIN ] UGI: Full history saved. [2025-09-17T22:17:56.488452] [INFO ] [MAIN ] Update Progress: 2173/2371 symbols completed. UGI took 31.5s. Estimated remaining: 28m 58s. Rate: 6.8 symbols/min [2025-09-17T22:17:56.658809] [INFO ] [MAIN ] UHS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:17:56.708730] [DEBUG] [LOCAL ] UHS: Loaded 41601 existing records from primary storage. [2025-09-17T22:17:56.708883] [INFO ] [MAIN ] UHS: Loaded 41601 existing records. [2025-09-17T22:17:56.895597] [WARN ] [MAIN ] UHS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:17:56.895883] [INFO ] [MAIN ] UHS: Wiping existing primary data before full refresh. [2025-09-17T22:17:56.895931] [INFO ] [LOCAL ] UHS: Starting deletion of primary data. [2025-09-17T22:17:56.896888] [DEBUG] [LOCAL ] UHS: Deleted primary data file. [2025-09-17T22:17:56.896971] [INFO ] [MAIN ] UHS: Starting full primary refresh. [2025-09-17T22:17:57.224313] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-11. [2025-09-17T22:17:57.255411] [INFO ] [REMOTE ] UHS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:17:57.294708] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T22:17:58.021212] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-11. [2025-09-17T22:17:58.038713] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T22:17:58.075405] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T22:17:58.815781] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2024-12. [2025-09-17T22:17:59.615861] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-02. [2025-09-17T22:17:59.704075] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T22:17:59.744891] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2024-12 (0.93 seconds). [2025-09-17T22:18:00.415805] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-01. [2025-09-17T22:18:00.805448] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T22:18:01.215748] [INFO ] [REMOTE ] UHS: Fetching primary data for 2024-12. [2025-09-17T22:18:01.394274] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T22:18:02.015788] [INFO ] [REMOTE ] UE: Fetching primary data for 2025-09. [2025-09-17T22:18:02.815784] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-03. [2025-09-17T22:18:03.615813] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-02. [2025-09-17T22:18:04.199667] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2024-12 (2.98 seconds). [2025-09-17T22:18:04.415793] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-01. [2025-09-17T22:18:05.047474] [INFO ] [REMOTE ] UE: Incremental fetch complete for 2025-09 (3.03 seconds). [2025-09-17T22:18:05.053112] [INFO ] [REMOTE ] UE: Full fetch complete (61503 records). [2025-09-17T22:18:05.053240] [DEBUG] [VALIDATOR ] UE: Validating primary data. [2025-09-17T22:18:05.475596] [DEBUG] [VALIDATOR ] UE: All expected trading days are present. [2025-09-17T22:18:05.475808] [DEBUG] [VALIDATOR ] UE: Primary data validation passed. [2025-09-17T22:18:05.477225] [INFO ] [MAIN ] UE: Fetched primary data is valid. [2025-09-17T22:18:05.477294] [DEBUG] [LOCAL ] UE: Saving primary data. [2025-09-17T22:18:05.479044] [DEBUG] [LOCAL ] UE: Trimmed 61503 records to 43092 (keeping 200 days of data) [2025-09-17T22:18:05.762535] [DEBUG] [LOCAL ] UE: Primary data saved (43092 records). [2025-09-17T22:18:05.762714] [INFO ] [MAIN ] UE: Full history saved. [2025-09-17T22:18:05.763711] [INFO ] [MAIN ] Update Progress: 2174/2371 symbols completed. UE took 44.8s. Estimated remaining: 28m 49s. Rate: 6.8 symbols/min [2025-09-17T22:18:05.941333] [INFO ] [MAIN ] UHT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:18:05.959747] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-02 (2.34 seconds). [2025-09-17T22:18:05.967758] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-03. [2025-09-17T22:18:05.974722] [DEBUG] [LOCAL ] UHT: Loaded 10008 existing records from primary storage. [2025-09-17T22:18:05.974877] [INFO ] [MAIN ] UHT: Loaded 10008 existing records. [2025-09-17T22:18:06.182967] [WARN ] [MAIN ] UHT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:18:06.184043] [INFO ] [MAIN ] UHT: Wiping existing primary data before full refresh. [2025-09-17T22:18:06.212486] [INFO ] [LOCAL ] UHT: Starting deletion of primary data. [2025-09-17T22:18:06.213505] [DEBUG] [LOCAL ] UHT: Deleted primary data file. [2025-09-17T22:18:06.213590] [INFO ] [MAIN ] UHT: Starting full primary refresh. [2025-09-17T22:18:06.214890] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T22:18:06.252104] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-02. [2025-09-17T22:18:06.526694] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-03 (3.71 seconds). [2025-09-17T22:18:06.648019] [INFO ] [REMOTE ] UHT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:18:06.815788] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-11. [2025-09-17T22:18:07.084934] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T22:18:07.349386] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-11 (0.53 seconds). [2025-09-17T22:18:07.615773] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-04. [2025-09-17T22:18:07.971205] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T22:18:08.415779] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-03. [2025-09-17T22:18:08.948441] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T22:18:09.215782] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-04. [2025-09-17T22:18:10.015795] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-05. [2025-09-17T22:18:10.217483] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T22:18:10.237826] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-04 (1.02 seconds). [2025-09-17T22:18:10.815806] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-04. [2025-09-17T22:18:11.544463] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T22:18:11.615767] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-06. [2025-09-17T22:18:12.415821] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-05. [2025-09-17T22:18:12.548400] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-04 (1.73 seconds). [2025-09-17T22:18:13.215786] [INFO ] [REMOTE ] UHT: Fetching primary data for 2024-12. [2025-09-17T22:18:13.357922] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T22:18:13.462060] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-05 (1.05 seconds). [2025-09-17T22:18:13.905874] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T22:18:14.015813] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-01. [2025-09-17T22:18:14.815781] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-05. [2025-09-17T22:18:15.227936] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-01 (1.21 seconds). [2025-09-17T22:18:15.615796] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-02. [2025-09-17T22:18:16.415788] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-06. [2025-09-17T22:18:16.642639] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T22:18:17.044706] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-05 (2.23 seconds). [2025-09-17T22:18:17.215761] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-06. [2025-09-17T22:18:17.501739] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-06 (1.09 seconds). [2025-09-17T22:18:18.015841] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-03. [2025-09-17T22:18:18.534970] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-06 (1.32 seconds). [2025-09-17T22:18:18.815829] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-07. [2025-09-17T22:18:18.903060] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-03 (0.89 seconds). [2025-09-17T22:18:19.615859] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-04. [2025-09-17T22:18:20.400045] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T22:18:20.415756] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-08. [2025-09-17T22:18:20.514628] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T22:18:21.128009] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-08 (0.71 seconds). [2025-09-17T22:18:21.215817] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-07. [2025-09-17T22:18:22.015833] [INFO ] [REMOTE ] UHS: Fetching primary data for 2025-09. [2025-09-17T22:18:22.771834] [INFO ] [REMOTE ] UHS: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T22:18:22.777366] [INFO ] [REMOTE ] UHS: Full fetch complete (58326 records). [2025-09-17T22:18:22.777502] [DEBUG] [VALIDATOR ] UHS: Validating primary data. [2025-09-17T22:18:22.821089] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-05. [2025-09-17T22:18:23.170133] [DEBUG] [VALIDATOR ] UHS: All expected trading days are present. [2025-09-17T22:18:23.170239] [DEBUG] [VALIDATOR ] UHS: Primary data validation passed. [2025-09-17T22:18:23.171264] [INFO ] [MAIN ] UHS: Fetched primary data is valid. [2025-09-17T22:18:23.171346] [DEBUG] [LOCAL ] UHS: Saving primary data. [2025-09-17T22:18:23.197669] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-07 (1.98 seconds). [2025-09-17T22:18:23.196403] [DEBUG] [LOCAL ] UHS: Trimmed 58326 records to 41525 (keeping 200 days of data) [2025-09-17T22:18:23.480079] [DEBUG] [LOCAL ] UHS: Primary data saved (41525 records). [2025-09-17T22:18:23.480231] [INFO ] [MAIN ] UHS: Full history saved. [2025-09-17T22:18:23.480336] [INFO ] [MAIN ] Update Progress: 2175/2371 symbols completed. UHS took 27.0s. Estimated remaining: 28m 41s. Rate: 6.8 symbols/min [2025-09-17T22:18:23.618450] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-07. [2025-09-17T22:18:23.694338] [INFO ] [MAIN ] UI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:18:23.708521] [DEBUG] [LOCAL ] UI: Loaded 12584 existing records from primary storage. [2025-09-17T22:18:23.708671] [INFO ] [MAIN ] UI: Loaded 12584 existing records. [2025-09-17T22:18:23.863241] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-05 (1.04 seconds). [2025-09-17T22:18:23.905489] [WARN ] [MAIN ] UI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:18:23.905726] [INFO ] [MAIN ] UI: Wiping existing primary data before full refresh. [2025-09-17T22:18:23.905781] [INFO ] [LOCAL ] UI: Starting deletion of primary data. [2025-09-17T22:18:23.906349] [DEBUG] [LOCAL ] UI: Deleted primary data file. [2025-09-17T22:18:23.906409] [INFO ] [MAIN ] UI: Starting full primary refresh. [2025-09-17T22:18:24.262138] [INFO ] [REMOTE ] UI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:18:24.415738] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-11. [2025-09-17T22:18:24.700912] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T22:18:25.127856] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T22:18:25.215806] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-08. [2025-09-17T22:18:26.015809] [INFO ] [REMOTE ] UI: Fetching primary data for 2024-12. [2025-09-17T22:18:26.709115] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T22:18:26.815839] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-06. [2025-09-17T22:18:27.041826] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T22:18:27.615811] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-08. [2025-09-17T22:18:27.781910] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-06 (0.97 seconds). [2025-09-17T22:18:28.415825] [INFO ] [REMOTE ] UGP: Fetching primary data for 2025-09. [2025-09-17T22:18:28.648498] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T22:18:29.215821] [INFO ] [REMOTE ] UHAL: Fetching primary data for 2025-09. [2025-09-17T22:18:29.794202] [INFO ] [REMOTE ] UGP: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T22:18:29.800819] [INFO ] [REMOTE ] UGP: Full fetch complete (62047 records). [2025-09-17T22:18:29.801005] [DEBUG] [VALIDATOR ] UGP: Validating primary data. [2025-09-17T22:18:30.026336] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-01. [2025-09-17T22:18:30.228144] [DEBUG] [VALIDATOR ] UGP: All expected trading days are present. [2025-09-17T22:18:30.228235] [DEBUG] [VALIDATOR ] UGP: Primary data validation passed. [2025-09-17T22:18:30.229556] [INFO ] [MAIN ] UGP: Fetched primary data is valid. [2025-09-17T22:18:30.229636] [DEBUG] [LOCAL ] UGP: Saving primary data. [2025-09-17T22:18:30.231061] [DEBUG] [LOCAL ] UGP: Trimmed 62047 records to 42579 (keeping 200 days of data) [2025-09-17T22:18:30.338491] [INFO ] [REMOTE ] UHAL: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T22:18:30.343187] [INFO ] [REMOTE ] UHAL: Full fetch complete (22869 records). [2025-09-17T22:18:30.344138] [DEBUG] [VALIDATOR ] UHAL: Validating primary data. [2025-09-17T22:18:30.819084] [DEBUG] [VALIDATOR ] UHAL: All expected trading days are present. [2025-09-17T22:18:30.817977] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-07. [2025-09-17T22:18:30.819953] [DEBUG] [VALIDATOR ] UHAL: Primary data validation passed. [2025-09-17T22:18:30.821195] [INFO ] [MAIN ] UHAL: Fetched primary data is valid. [2025-09-17T22:18:30.821874] [DEBUG] [LOCAL ] UHAL: Saving primary data. [2025-09-17T22:18:30.825590] [DEBUG] [LOCAL ] UHAL: Trimmed 22869 records to 16361 (keeping 200 days of data) [2025-09-17T22:18:31.025949] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-01 (1.00 seconds). [2025-09-17T22:18:31.068361] [DEBUG] [LOCAL ] UHAL: Primary data saved (16361 records). [2025-09-17T22:18:31.069225] [INFO ] [MAIN ] UHAL: Full history saved. [2025-09-17T22:18:31.070376] [INFO ] [MAIN ] Update Progress: 2176/2371 symbols completed. UHAL took 37.4s. Estimated remaining: 28m 32s. Rate: 6.8 symbols/min [2025-09-17T22:18:31.270487] [INFO ] [MAIN ] UIS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:18:31.294843] [DEBUG] [LOCAL ] UGP: Primary data saved (42579 records). [2025-09-17T22:18:31.295004] [INFO ] [MAIN ] UGP: Full history saved. [2025-09-17T22:18:31.295132] [INFO ] [MAIN ] Update Progress: 2177/2371 symbols completed. UGP took 44.6s. Estimated remaining: 28m 23s. Rate: 6.8 symbols/min [2025-09-17T22:18:31.502539] [INFO ] [MAIN ] UL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:18:31.503771] [DEBUG] [LOCAL ] UIS: Loaded 37298 existing records from primary storage. [2025-09-17T22:18:31.507677] [INFO ] [MAIN ] UIS: Loaded 37298 existing records. [2025-09-17T22:18:31.627456] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-02. [2025-09-17T22:18:31.643793] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T22:18:31.726617] [WARN ] [MAIN ] UIS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:18:31.727189] [INFO ] [MAIN ] UIS: Wiping existing primary data before full refresh. [2025-09-17T22:18:31.727280] [INFO ] [LOCAL ] UIS: Starting deletion of primary data. [2025-09-17T22:18:31.741664] [DEBUG] [LOCAL ] UIS: Deleted primary data file. [2025-09-17T22:18:31.741882] [INFO ] [MAIN ] UIS: Starting full primary refresh. [2025-09-17T22:18:31.893773] [DEBUG] [LOCAL ] UL: Loaded 53076 existing records from primary storage. [2025-09-17T22:18:31.919129] [INFO ] [MAIN ] UL: Loaded 53076 existing records. [2025-09-17T22:18:32.301593] [WARN ] [MAIN ] UL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:18:32.318562] [INFO ] [MAIN ] UL: Wiping existing primary data before full refresh. [2025-09-17T22:18:32.326881] [INFO ] [LOCAL ] UL: Starting deletion of primary data. [2025-09-17T22:18:32.340449] [INFO ] [REMOTE ] UIS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:18:32.342066] [DEBUG] [LOCAL ] UL: Deleted primary data file. [2025-09-17T22:18:32.342131] [INFO ] [MAIN ] UL: Starting full primary refresh. [2025-09-17T22:18:32.420786] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-08. [2025-09-17T22:18:32.639524] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-02 (1.01 seconds). [2025-09-17T22:18:32.736025] [INFO ] [REMOTE ] UL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:18:33.215844] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-03. [2025-09-17T22:18:33.318312] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-08 (0.90 seconds). [2025-09-17T22:18:34.015835] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-11. [2025-09-17T22:18:34.124033] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-03 (0.91 seconds). [2025-09-17T22:18:34.815824] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-04. [2025-09-17T22:18:35.615809] [INFO ] [REMOTE ] UHT: Fetching primary data for 2025-09. [2025-09-17T22:18:35.711386] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-04 (0.90 seconds). [2025-09-17T22:18:35.851030] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T22:18:36.089065] [INFO ] [REMOTE ] UHT: Incremental fetch complete for 2025-09 (0.47 seconds). [2025-09-17T22:18:36.090974] [INFO ] [REMOTE ] UHT: Full fetch complete (15151 records). [2025-09-17T22:18:36.091052] [DEBUG] [VALIDATOR ] UHT: Validating primary data. [2025-09-17T22:18:36.420957] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-11. [2025-09-17T22:18:36.487814] [DEBUG] [VALIDATOR ] UHT: All expected trading days are present. [2025-09-17T22:18:36.487916] [DEBUG] [VALIDATOR ] UHT: Primary data validation passed. [2025-09-17T22:18:36.488458] [INFO ] [MAIN ] UHT: Fetched primary data is valid. [2025-09-17T22:18:36.488505] [DEBUG] [LOCAL ] UHT: Saving primary data. [2025-09-17T22:18:36.489786] [DEBUG] [LOCAL ] UHT: Trimmed 15151 records to 9994 (keeping 200 days of data) [2025-09-17T22:18:36.563137] [DEBUG] [LOCAL ] UHT: Primary data saved (9994 records). [2025-09-17T22:18:36.563315] [INFO ] [MAIN ] UHT: Full history saved. [2025-09-17T22:18:36.563427] [INFO ] [MAIN ] Update Progress: 2178/2371 symbols completed. UHT took 30.8s. Estimated remaining: 28m 14s. Rate: 6.8 symbols/min [2025-09-17T22:18:36.750615] [INFO ] [MAIN ] ULS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:18:36.796511] [DEBUG] [LOCAL ] ULS: Loaded 39229 existing records from primary storage. [2025-09-17T22:18:36.796754] [INFO ] [MAIN ] ULS: Loaded 39229 existing records. [2025-09-17T22:18:36.997234] [WARN ] [MAIN ] ULS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:18:36.997522] [INFO ] [MAIN ] ULS: Wiping existing primary data before full refresh. [2025-09-17T22:18:36.997582] [INFO ] [LOCAL ] ULS: Starting deletion of primary data. [2025-09-17T22:18:36.998590] [DEBUG] [LOCAL ] ULS: Deleted primary data file. [2025-09-17T22:18:36.998686] [INFO ] [MAIN ] ULS: Starting full primary refresh. [2025-09-17T22:18:37.220966] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-05. [2025-09-17T22:18:37.389466] [INFO ] [REMOTE ] ULS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:18:38.022211] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-11. [2025-09-17T22:18:38.025090] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T22:18:38.164543] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-05 (0.94 seconds). [2025-09-17T22:18:38.815802] [INFO ] [REMOTE ] UIS: Fetching primary data for 2024-12. [2025-09-17T22:18:39.615778] [INFO ] [REMOTE ] UL: Fetching primary data for 2024-12. [2025-09-17T22:18:39.697353] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T22:18:40.231247] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2024-12 (1.42 seconds). [2025-09-17T22:18:40.415785] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-06. [2025-09-17T22:18:41.176474] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T22:18:41.215761] [INFO ] [REMOTE ] ULS: Fetching primary data for 2024-12. [2025-09-17T22:18:41.396762] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-06 (0.98 seconds). [2025-09-17T22:18:42.015827] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-01. [2025-09-17T22:18:42.749492] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T22:18:42.815819] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-01. [2025-09-17T22:18:43.208139] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T22:18:43.615818] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-07. [2025-09-17T22:18:43.794136] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-01 (0.98 seconds). [2025-09-17T22:18:44.415805] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-02. [2025-09-17T22:18:44.615276] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T22:18:45.215823] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-01. [2025-09-17T22:18:45.778861] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-02 (1.36 seconds). [2025-09-17T22:18:46.015777] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-08. [2025-09-17T22:18:46.815792] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-03. [2025-09-17T22:18:47.103601] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-08 (1.09 seconds). [2025-09-17T22:18:47.204300] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-01 (1.99 seconds). [2025-09-17T22:18:47.615786] [INFO ] [REMOTE ] UI: Fetching primary data for 2025-09. [2025-09-17T22:18:48.310623] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T22:18:48.415759] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-02. [2025-09-17T22:18:48.577116] [INFO ] [REMOTE ] UI: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T22:18:48.580447] [INFO ] [REMOTE ] UI: Full fetch complete (17854 records). [2025-09-17T22:18:48.580771] [DEBUG] [VALIDATOR ] UI: Validating primary data. [2025-09-17T22:18:48.962093] [DEBUG] [VALIDATOR ] UI: All expected trading days are present. [2025-09-17T22:18:48.962186] [DEBUG] [VALIDATOR ] UI: Primary data validation passed. [2025-09-17T22:18:48.962601] [INFO ] [MAIN ] UI: Fetched primary data is valid. [2025-09-17T22:18:48.962639] [DEBUG] [LOCAL ] UI: Saving primary data. [2025-09-17T22:18:48.963326] [DEBUG] [LOCAL ] UI: Trimmed 17854 records to 12568 (keeping 200 days of data) [2025-09-17T22:18:49.042586] [DEBUG] [LOCAL ] UI: Primary data saved (12568 records). [2025-09-17T22:18:49.042759] [INFO ] [MAIN ] UI: Full history saved. [2025-09-17T22:18:49.042856] [INFO ] [MAIN ] Update Progress: 2179/2371 symbols completed. UI took 25.6s. Estimated remaining: 28m 5s. Rate: 6.8 symbols/min [2025-09-17T22:18:49.216719] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-04. [2025-09-17T22:18:49.218461] [INFO ] [MAIN ] UMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:18:49.272306] [DEBUG] [LOCAL ] UMC: Loaded 52736 existing records from primary storage. [2025-09-17T22:18:49.272471] [INFO ] [MAIN ] UMC: Loaded 52736 existing records. [2025-09-17T22:18:49.474530] [WARN ] [MAIN ] UMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:18:49.474837] [INFO ] [MAIN ] UMC: Wiping existing primary data before full refresh. [2025-09-17T22:18:49.474889] [INFO ] [LOCAL ] UMC: Starting deletion of primary data. [2025-09-17T22:18:49.476219] [DEBUG] [LOCAL ] UMC: Deleted primary data file. [2025-09-17T22:18:49.476281] [INFO ] [MAIN ] UMC: Starting full primary refresh. [2025-09-17T22:18:49.844299] [INFO ] [REMOTE ] UMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:18:50.015805] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-02. [2025-09-17T22:18:50.267701] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-02 (1.85 seconds). [2025-09-17T22:18:50.301557] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-04 (1.08 seconds). [2025-09-17T22:18:50.815824] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-03. [2025-09-17T22:18:51.386313] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T22:18:51.615801] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-03. [2025-09-17T22:18:52.415784] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-05. [2025-09-17T22:18:52.794965] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T22:18:53.033729] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-03 (1.42 seconds). [2025-09-17T22:18:53.215787] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-04. [2025-09-17T22:18:53.552432] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T22:18:54.015842] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-11. [2025-09-17T22:18:54.769861] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-04 (1.55 seconds). [2025-09-17T22:18:54.815761] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-05. [2025-09-17T22:18:55.615786] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-06. [2025-09-17T22:18:55.868157] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-11 (1.85 seconds). [2025-09-17T22:18:56.415783] [INFO ] [REMOTE ] UMC: Fetching primary data for 2024-12. [2025-09-17T22:18:56.550556] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-05 (1.73 seconds). [2025-09-17T22:18:56.903287] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T22:18:57.215779] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-06. [2025-09-17T22:18:58.013333] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T22:18:58.023442] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-04. [2025-09-17T22:18:58.760236] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T22:18:58.815739] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-01. [2025-09-17T22:18:59.615787] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-07. [2025-09-17T22:18:59.978732] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T22:19:00.415994] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-05. [2025-09-17T22:19:01.057182] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-17T22:19:01.090230] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-07 (1.47 seconds). [2025-09-17T22:19:01.215793] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-08. [2025-09-17T22:19:02.015785] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-07. [2025-09-17T22:19:02.163112] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T22:19:02.766610] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T22:19:02.815755] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-06. [2025-09-17T22:19:03.494616] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-07 (1.48 seconds). [2025-09-17T22:19:03.615789] [INFO ] [REMOTE ] ULS: Fetching primary data for 2025-09. [2025-09-17T22:19:04.293680] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T22:19:04.415765] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-07. [2025-09-17T22:19:04.909408] [INFO ] [REMOTE ] ULS: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T22:19:04.914762] [INFO ] [REMOTE ] ULS: Full fetch complete (54280 records). [2025-09-17T22:19:04.914884] [DEBUG] [VALIDATOR ] ULS: Validating primary data. [2025-09-17T22:19:05.220851] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-08. [2025-09-17T22:19:05.315534] [DEBUG] [VALIDATOR ] ULS: All expected trading days are present. [2025-09-17T22:19:05.315631] [DEBUG] [VALIDATOR ] ULS: Primary data validation passed. [2025-09-17T22:19:05.316872] [INFO ] [MAIN ] ULS: Fetched primary data is valid. [2025-09-17T22:19:05.316935] [DEBUG] [LOCAL ] ULS: Saving primary data. [2025-09-17T22:19:05.318511] [DEBUG] [LOCAL ] ULS: Trimmed 54280 records to 39196 (keeping 200 days of data) [2025-09-17T22:19:05.570607] [DEBUG] [LOCAL ] ULS: Primary data saved (39196 records). [2025-09-17T22:19:05.570787] [INFO ] [MAIN ] ULS: Full history saved. [2025-09-17T22:19:05.571502] [INFO ] [MAIN ] Update Progress: 2180/2371 symbols completed. ULS took 29.0s. Estimated remaining: 27m 57s. Rate: 6.8 symbols/min [2025-09-17T22:19:05.749383] [INFO ] [MAIN ] UMH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:19:05.794115] [DEBUG] [LOCAL ] UMH: Loaded 32897 existing records from primary storage. [2025-09-17T22:19:05.794283] [INFO ] [MAIN ] UMH: Loaded 32897 existing records. [2025-09-17T22:19:05.991971] [WARN ] [MAIN ] UMH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:19:05.992232] [INFO ] [MAIN ] UMH: Wiping existing primary data before full refresh. [2025-09-17T22:19:05.992282] [INFO ] [LOCAL ] UMH: Starting deletion of primary data. [2025-09-17T22:19:05.993139] [DEBUG] [LOCAL ] UMH: Deleted primary data file. [2025-09-17T22:19:05.993202] [INFO ] [MAIN ] UMH: Starting full primary refresh. [2025-09-17T22:19:06.027235] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-02. [2025-09-17T22:19:06.385391] [INFO ] [REMOTE ] UMH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:19:06.475376] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T22:19:06.705485] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T22:19:06.815743] [INFO ] [REMOTE ] UIS: Fetching primary data for 2025-09. [2025-09-17T22:19:07.615742] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-11. [2025-09-17T22:19:07.929984] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T22:19:07.988175] [INFO ] [REMOTE ] UIS: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T22:19:07.992848] [INFO ] [REMOTE ] UIS: Full fetch complete (51797 records). [2025-09-17T22:19:07.992965] [DEBUG] [VALIDATOR ] UIS: Validating primary data. [2025-09-17T22:19:08.378991] [DEBUG] [VALIDATOR ] UIS: All expected trading days are present. [2025-09-17T22:19:08.379096] [DEBUG] [VALIDATOR ] UIS: Primary data validation passed. [2025-09-17T22:19:08.379983] [INFO ] [MAIN ] UIS: Fetched primary data is valid. [2025-09-17T22:19:08.380057] [DEBUG] [LOCAL ] UIS: Saving primary data. [2025-09-17T22:19:08.381270] [DEBUG] [LOCAL ] UIS: Trimmed 51797 records to 37205 (keeping 200 days of data) [2025-09-17T22:19:08.427438] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-03. [2025-09-17T22:19:08.598572] [DEBUG] [LOCAL ] UIS: Primary data saved (37205 records). [2025-09-17T22:19:08.615348] [INFO ] [MAIN ] UIS: Full history saved. [2025-09-17T22:19:08.617701] [INFO ] [MAIN ] Update Progress: 2181/2371 symbols completed. UIS took 37.5s. Estimated remaining: 27m 48s. Rate: 6.8 symbols/min [2025-09-17T22:19:08.712674] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T22:19:08.830859] [INFO ] [MAIN ] UNF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:19:08.844458] [DEBUG] [LOCAL ] UNF: Loaded 11770 existing records from primary storage. [2025-09-17T22:19:08.844587] [INFO ] [MAIN ] UNF: Loaded 11770 existing records. [2025-09-17T22:19:09.033135] [WARN ] [MAIN ] UNF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:19:09.033723] [INFO ] [MAIN ] UNF: Wiping existing primary data before full refresh. [2025-09-17T22:19:09.033788] [INFO ] [LOCAL ] UNF: Starting deletion of primary data. [2025-09-17T22:19:09.034332] [DEBUG] [LOCAL ] UNF: Deleted primary data file. [2025-09-17T22:19:09.034421] [INFO ] [MAIN ] UNF: Starting full primary refresh. [2025-09-17T22:19:09.224510] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-08. [2025-09-17T22:19:09.398120] [INFO ] [REMOTE ] UNF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:19:10.015831] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-11. [2025-09-17T22:19:10.256200] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T22:19:10.805745] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-11 (0.79 seconds). [2025-09-17T22:19:10.815722] [INFO ] [REMOTE ] UNF: Fetching primary data for 2024-12. [2025-09-17T22:19:11.240384] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T22:19:11.615806] [INFO ] [REMOTE ] UL: Fetching primary data for 2025-09. [2025-09-17T22:19:11.638689] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T22:19:12.415837] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-04. [2025-09-17T22:19:13.215828] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-01. [2025-09-17T22:19:13.424221] [INFO ] [REMOTE ] UL: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T22:19:13.431327] [INFO ] [REMOTE ] UL: Full fetch complete (76665 records). [2025-09-17T22:19:13.431526] [DEBUG] [VALIDATOR ] UL: Validating primary data. [2025-09-17T22:19:13.840599] [DEBUG] [VALIDATOR ] UL: All expected trading days are present. [2025-09-17T22:19:13.840748] [DEBUG] [VALIDATOR ] UL: Primary data validation passed. [2025-09-17T22:19:13.841816] [INFO ] [MAIN ] UL: Fetched primary data is valid. [2025-09-17T22:19:13.841902] [DEBUG] [LOCAL ] UL: Saving primary data. [2025-09-17T22:19:13.843396] [DEBUG] [LOCAL ] UL: Trimmed 76665 records to 53076 (keeping 200 days of data) [2025-09-17T22:19:14.031601] [INFO ] [REMOTE ] UMH: Fetching primary data for 2024-12. [2025-09-17T22:19:14.189034] [DEBUG] [LOCAL ] UL: Primary data saved (53076 records). [2025-09-17T22:19:14.189204] [INFO ] [MAIN ] UL: Full history saved. [2025-09-17T22:19:14.189375] [INFO ] [MAIN ] Update Progress: 2182/2371 symbols completed. UL took 42.9s. Estimated remaining: 27m 39s. Rate: 6.8 symbols/min [2025-09-17T22:19:14.375906] [INFO ] [MAIN ] UNFI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:19:14.391896] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T22:19:14.449031] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-04 (2.03 seconds). [2025-09-17T22:19:14.501972] [DEBUG] [LOCAL ] UNFI: Loaded 41886 existing records from primary storage. [2025-09-17T22:19:14.502143] [INFO ] [MAIN ] UNFI: Loaded 41886 existing records. [2025-09-17T22:19:14.690614] [WARN ] [MAIN ] UNFI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:19:14.690923] [INFO ] [MAIN ] UNFI: Wiping existing primary data before full refresh. [2025-09-17T22:19:14.690975] [INFO ] [LOCAL ] UNFI: Starting deletion of primary data. [2025-09-17T22:19:14.692054] [DEBUG] [LOCAL ] UNFI: Deleted primary data file. [2025-09-17T22:19:14.692118] [INFO ] [MAIN ] UNFI: Starting full primary refresh. [2025-09-17T22:19:14.821037] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-02. [2025-09-17T22:19:15.087023] [INFO ] [REMOTE ] UNFI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:19:15.132623] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T22:19:15.615804] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-05. [2025-09-17T22:19:15.820481] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-02 (1.00 seconds). [2025-09-17T22:19:16.415814] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-11. [2025-09-17T22:19:17.215801] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-03. [2025-09-17T22:19:17.360465] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-05 (1.74 seconds). [2025-09-17T22:19:17.827569] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-03 (0.61 seconds). [2025-09-17T22:19:17.878325] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-11 (1.46 seconds). [2025-09-17T22:19:18.015849] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-01. [2025-09-17T22:19:18.815828] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-06. [2025-09-17T22:19:19.271304] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T22:19:19.615809] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-04. [2025-09-17T22:19:20.415838] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2024-12. [2025-09-17T22:19:20.506200] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T22:19:20.559338] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-04 (0.94 seconds). [2025-09-17T22:19:21.215803] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-07. [2025-09-17T22:19:21.603057] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T22:19:22.015790] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-05. [2025-09-17T22:19:22.815770] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-01. [2025-09-17T22:19:22.909428] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T22:19:23.212578] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T22:19:23.615783] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-08. [2025-09-17T22:19:24.302232] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T22:19:24.415789] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-02. [2025-09-17T22:19:25.215817] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-02. [2025-09-17T22:19:25.471819] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T22:19:25.549338] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T22:19:26.015773] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-06. [2025-09-17T22:19:26.244626] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T22:19:26.815770] [INFO ] [REMOTE ] UMC: Fetching primary data for 2025-09. [2025-09-17T22:19:27.086266] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T22:19:27.615787] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-07. [2025-09-17T22:19:28.415761] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-03. [2025-09-17T22:19:28.483247] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-07 (0.87 seconds). [2025-09-17T22:19:28.612297] [INFO ] [REMOTE ] UMC: Incremental fetch complete for 2025-09 (1.80 seconds). [2025-09-17T22:19:28.619557] [INFO ] [REMOTE ] UMC: Full fetch complete (76463 records). [2025-09-17T22:19:28.619732] [DEBUG] [VALIDATOR ] UMC: Validating primary data. [2025-09-17T22:19:29.066465] [DEBUG] [VALIDATOR ] UMC: All expected trading days are present. [2025-09-17T22:19:29.066562] [DEBUG] [VALIDATOR ] UMC: Primary data validation passed. [2025-09-17T22:19:29.067758] [INFO ] [MAIN ] UMC: Fetched primary data is valid. [2025-09-17T22:19:29.067829] [DEBUG] [LOCAL ] UMC: Saving primary data. [2025-09-17T22:19:29.069732] [DEBUG] [LOCAL ] UMC: Trimmed 76463 records to 52732 (keeping 200 days of data) [2025-09-17T22:19:29.240198] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-08. [2025-09-17T22:19:29.380084] [DEBUG] [LOCAL ] UMC: Primary data saved (52732 records). [2025-09-17T22:19:29.380241] [INFO ] [MAIN ] UMC: Full history saved. [2025-09-17T22:19:29.380341] [INFO ] [MAIN ] Update Progress: 2183/2371 symbols completed. UMC took 40.3s. Estimated remaining: 27m 31s. Rate: 6.8 symbols/min [2025-09-17T22:19:29.551903] [INFO ] [MAIN ] UNH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:19:29.624787] [DEBUG] [LOCAL ] UNH: Loaded 53793 existing records from primary storage. [2025-09-17T22:19:29.626324] [INFO ] [MAIN ] UNH: Loaded 53793 existing records. [2025-09-17T22:19:29.626206] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T22:19:29.816937] [WARN ] [MAIN ] UNH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:19:29.817368] [INFO ] [MAIN ] UNH: Wiping existing primary data before full refresh. [2025-09-17T22:19:29.817533] [INFO ] [LOCAL ] UNH: Starting deletion of primary data. [2025-09-17T22:19:29.825189] [DEBUG] [LOCAL ] UNH: Deleted primary data file. [2025-09-17T22:19:29.825341] [INFO ] [MAIN ] UNH: Starting full primary refresh. [2025-09-17T22:19:29.858819] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-08 (0.62 seconds). [2025-09-17T22:19:30.026671] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-04. [2025-09-17T22:19:30.214184] [INFO ] [REMOTE ] UNH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:19:30.815837] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-11. [2025-09-17T22:19:31.379731] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-04 (1.35 seconds). [2025-09-17T22:19:31.615858] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-05. [2025-09-17T22:19:32.415823] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-03. [2025-09-17T22:19:32.880763] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-11 (2.06 seconds). [2025-09-17T22:19:33.008048] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T22:19:33.215827] [INFO ] [REMOTE ] UNH: Fetching primary data for 2024-12. [2025-09-17T22:19:33.761379] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-03 (1.35 seconds). [2025-09-17T22:19:34.015812] [INFO ] [REMOTE ] UNF: Fetching primary data for 2025-09. [2025-09-17T22:19:34.783789] [INFO ] [REMOTE ] UNF: Incremental fetch complete for 2025-09 (0.77 seconds). [2025-09-17T22:19:34.785861] [INFO ] [REMOTE ] UNF: Full fetch complete (16924 records). [2025-09-17T22:19:34.785984] [DEBUG] [VALIDATOR ] UNF: Validating primary data. [2025-09-17T22:19:34.820894] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-04. [2025-09-17T22:19:35.172092] [DEBUG] [VALIDATOR ] UNF: All expected trading days are present. [2025-09-17T22:19:35.172191] [DEBUG] [VALIDATOR ] UNF: Primary data validation passed. [2025-09-17T22:19:35.172583] [INFO ] [MAIN ] UNF: Fetched primary data is valid. [2025-09-17T22:19:35.172625] [DEBUG] [LOCAL ] UNF: Saving primary data. [2025-09-17T22:19:35.173423] [DEBUG] [LOCAL ] UNF: Trimmed 16924 records to 11792 (keeping 200 days of data) [2025-09-17T22:19:35.249951] [DEBUG] [LOCAL ] UNF: Primary data saved (11792 records). [2025-09-17T22:19:35.250096] [INFO ] [MAIN ] UNF: Full history saved. [2025-09-17T22:19:35.250182] [INFO ] [MAIN ] Update Progress: 2184/2371 symbols completed. UNF took 26.6s. Estimated remaining: 27m 22s. Rate: 6.8 symbols/min [2025-09-17T22:19:35.423572] [INFO ] [MAIN ] UNM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:19:35.476082] [DEBUG] [LOCAL ] UNM: Loaded 48832 existing records from primary storage. [2025-09-17T22:19:35.476227] [INFO ] [MAIN ] UNM: Loaded 48832 existing records. [2025-09-17T22:19:35.620475] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-06. [2025-09-17T22:19:35.661777] [WARN ] [MAIN ] UNM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:19:35.662118] [INFO ] [MAIN ] UNM: Wiping existing primary data before full refresh. [2025-09-17T22:19:35.662187] [INFO ] [LOCAL ] UNM: Starting deletion of primary data. [2025-09-17T22:19:35.663417] [DEBUG] [LOCAL ] UNM: Deleted primary data file. [2025-09-17T22:19:35.663501] [INFO ] [MAIN ] UNM: Starting full primary refresh. [2025-09-17T22:19:36.081015] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2024-12 (2.87 seconds). [2025-09-17T22:19:36.087491] [INFO ] [REMOTE ] UNM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:19:36.125536] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-04 (1.30 seconds). [2025-09-17T22:19:36.415827] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-11. [2025-09-17T22:19:37.007043] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T22:19:37.215879] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-07. [2025-09-17T22:19:38.015785] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-01. [2025-09-17T22:19:38.099669] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T22:19:38.609788] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-07 (1.39 seconds). [2025-09-17T22:19:38.815806] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-05. [2025-09-17T22:19:39.615831] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-08. [2025-09-17T22:19:40.253737] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-01 (2.24 seconds). [2025-09-17T22:19:40.337349] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-05 (1.52 seconds). [2025-09-17T22:19:40.415781] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-06. [2025-09-17T22:19:40.992414] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-08 (1.38 seconds). [2025-09-17T22:19:41.215837] [INFO ] [REMOTE ] UNM: Fetching primary data for 2024-12. [2025-09-17T22:19:42.015798] [INFO ] [REMOTE ] UMH: Fetching primary data for 2025-09. [2025-09-17T22:19:42.147436] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T22:19:42.449943] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2024-12 (1.23 seconds). [2025-09-17T22:19:42.815786] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-02. [2025-09-17T22:19:42.904442] [INFO ] [REMOTE ] UMH: Incremental fetch complete for 2025-09 (0.89 seconds). [2025-09-17T22:19:42.909529] [INFO ] [REMOTE ] UMH: Full fetch complete (46142 records). [2025-09-17T22:19:42.909638] [DEBUG] [VALIDATOR ] UMH: Validating primary data. [2025-09-17T22:19:43.285004] [DEBUG] [VALIDATOR ] UMH: All expected trading days are present. [2025-09-17T22:19:43.285090] [DEBUG] [VALIDATOR ] UMH: Primary data validation passed. [2025-09-17T22:19:43.285927] [INFO ] [MAIN ] UMH: Fetched primary data is valid. [2025-09-17T22:19:43.285990] [DEBUG] [LOCAL ] UMH: Saving primary data. [2025-09-17T22:19:43.287088] [DEBUG] [LOCAL ] UMH: Trimmed 46142 records to 32980 (keeping 200 days of data) [2025-09-17T22:19:43.498673] [DEBUG] [LOCAL ] UMH: Primary data saved (32980 records). [2025-09-17T22:19:43.498829] [INFO ] [MAIN ] UMH: Full history saved. [2025-09-17T22:19:43.499811] [INFO ] [MAIN ] Update Progress: 2185/2371 symbols completed. UMH took 37.9s. Estimated remaining: 27m 13s. Rate: 6.8 symbols/min [2025-09-17T22:19:43.620826] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-07. [2025-09-17T22:19:43.671397] [INFO ] [MAIN ] UNMA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:19:43.685174] [DEBUG] [LOCAL ] UNMA: Loaded 3766 existing records from primary storage. [2025-09-17T22:19:43.685664] [INFO ] [MAIN ] UNMA: Loaded 3766 existing records. [2025-09-17T22:19:43.864089] [WARN ] [MAIN ] UNMA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:19:43.864380] [INFO ] [MAIN ] UNMA: Wiping existing primary data before full refresh. [2025-09-17T22:19:43.864428] [INFO ] [LOCAL ] UNMA: Starting deletion of primary data. [2025-09-17T22:19:43.864747] [DEBUG] [LOCAL ] UNMA: Deleted primary data file. [2025-09-17T22:19:43.864807] [INFO ] [MAIN ] UNMA: Starting full primary refresh. [2025-09-17T22:19:44.229108] [INFO ] [REMOTE ] UNMA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:19:44.415775] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-01. [2025-09-17T22:19:44.854712] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-17T22:19:45.215813] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-11. [2025-09-17T22:19:45.288178] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T22:19:45.730872] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T22:19:46.015774] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-03. [2025-09-17T22:19:46.119092] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T22:19:46.815800] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-02. [2025-09-17T22:19:47.615805] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-08. [2025-09-17T22:19:48.189787] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-17T22:19:48.270811] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-02 (1.46 seconds). [2025-09-17T22:19:48.415769] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-03. [2025-09-17T22:19:49.156540] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T22:19:49.215762] [INFO ] [REMOTE ] UNFI: Fetching primary data for 2025-09. [2025-09-17T22:19:50.015813] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-04. [2025-09-17T22:19:50.271611] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-03 (1.86 seconds). [2025-09-17T22:19:50.362658] [INFO ] [REMOTE ] UNFI: Incremental fetch complete for 2025-09 (1.15 seconds). [2025-09-17T22:19:50.367992] [INFO ] [REMOTE ] UNFI: Full fetch complete (58534 records). [2025-09-17T22:19:50.368087] [DEBUG] [VALIDATOR ] UNFI: Validating primary data. [2025-09-17T22:19:50.761840] [DEBUG] [VALIDATOR ] UNFI: All expected trading days are present. [2025-09-17T22:19:50.761926] [DEBUG] [VALIDATOR ] UNFI: Primary data validation passed. [2025-09-17T22:19:50.762767] [INFO ] [MAIN ] UNFI: Fetched primary data is valid. [2025-09-17T22:19:50.762829] [DEBUG] [LOCAL ] UNFI: Saving primary data. [2025-09-17T22:19:50.764266] [DEBUG] [LOCAL ] UNFI: Trimmed 58534 records to 41923 (keeping 200 days of data) [2025-09-17T22:19:50.818763] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2024-12. [2025-09-17T22:19:51.012397] [DEBUG] [LOCAL ] UNFI: Primary data saved (41923 records). [2025-09-17T22:19:51.012526] [INFO ] [MAIN ] UNFI: Full history saved. [2025-09-17T22:19:51.012630] [INFO ] [MAIN ] Update Progress: 2186/2371 symbols completed. UNFI took 36.8s. Estimated remaining: 27m 4s. Rate: 6.8 symbols/min [2025-09-17T22:19:51.191821] [INFO ] [MAIN ] UNP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:19:51.254161] [DEBUG] [LOCAL ] UNP: Loaded 53215 existing records from primary storage. [2025-09-17T22:19:51.254402] [INFO ] [MAIN ] UNP: Loaded 53215 existing records. [2025-09-17T22:19:51.392499] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T22:19:51.445508] [WARN ] [MAIN ] UNP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:19:51.445773] [INFO ] [MAIN ] UNP: Wiping existing primary data before full refresh. [2025-09-17T22:19:51.445832] [INFO ] [LOCAL ] UNP: Starting deletion of primary data. [2025-09-17T22:19:51.447156] [DEBUG] [LOCAL ] UNP: Deleted primary data file. [2025-09-17T22:19:51.447225] [INFO ] [MAIN ] UNP: Starting full primary refresh. [2025-09-17T22:19:51.627133] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-01. [2025-09-17T22:19:51.804141] [INFO ] [REMOTE ] UNP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:19:52.408386] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T22:19:52.415685] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-02. [2025-09-17T22:19:52.678813] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-04 (2.66 seconds). [2025-09-17T22:19:53.064454] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-02 (0.65 seconds). [2025-09-17T22:19:53.215827] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-03. [2025-09-17T22:19:53.814210] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-03 (0.60 seconds). [2025-09-17T22:19:54.015782] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-05. [2025-09-17T22:19:54.815838] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-04. [2025-09-17T22:19:55.407275] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-04 (0.59 seconds). [2025-09-17T22:19:55.615777] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-11. [2025-09-17T22:19:56.415795] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-05. [2025-09-17T22:19:56.625742] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-05 (2.61 seconds). [2025-09-17T22:19:56.742380] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-05 (0.33 seconds). [2025-09-17T22:19:57.215780] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-06. [2025-09-17T22:19:57.432186] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T22:19:57.795284] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T22:19:58.015788] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-04. [2025-09-17T22:19:58.815774] [INFO ] [REMOTE ] UNP: Fetching primary data for 2024-12. [2025-09-17T22:19:59.615781] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-07. [2025-09-17T22:19:59.834511] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T22:20:00.343536] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-07 (0.73 seconds). [2025-09-17T22:20:00.415787] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-05. [2025-09-17T22:20:00.803044] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2024-12 (1.99 seconds). [2025-09-17T22:20:01.215812] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-06. [2025-09-17T22:20:01.956968] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T22:20:02.015803] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-06. [2025-09-17T22:20:02.815796] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-08. [2025-09-17T22:20:03.313428] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-08 (0.50 seconds). [2025-09-17T22:20:03.615778] [INFO ] [REMOTE ] UNMA: Fetching primary data for 2025-09. [2025-09-17T22:20:03.811479] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T22:20:03.952253] [INFO ] [REMOTE ] UNMA: Incremental fetch complete for 2025-09 (0.34 seconds). [2025-09-17T22:20:03.953384] [INFO ] [REMOTE ] UNMA: Full fetch complete (5844 records). [2025-09-17T22:20:03.953485] [DEBUG] [VALIDATOR ] UNMA: Validating primary data. [2025-09-17T22:20:04.353772] [DEBUG] [VALIDATOR ] UNMA: All expected trading days are present. [2025-09-17T22:20:04.361326] [DEBUG] [VALIDATOR ] UNMA: Primary data validation passed. [2025-09-17T22:20:04.361590] [INFO ] [MAIN ] UNMA: Fetched primary data is valid. [2025-09-17T22:20:04.364754] [DEBUG] [LOCAL ] UNMA: Saving primary data. [2025-09-17T22:20:04.367334] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-06 (3.15 seconds). [2025-09-17T22:20:04.366242] [DEBUG] [LOCAL ] UNMA: Trimmed 5844 records to 3745 (keeping 200 days of data) [2025-09-17T22:20:04.401907] [DEBUG] [LOCAL ] UNMA: Primary data saved (3745 records). [2025-09-17T22:20:04.402012] [INFO ] [MAIN ] UNMA: Full history saved. [2025-09-17T22:20:04.402163] [INFO ] [MAIN ] Update Progress: 2187/2371 symbols completed. UNMA took 20.9s. Estimated remaining: 26m 56s. Rate: 6.8 symbols/min [2025-09-17T22:20:04.423325] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-07. [2025-09-17T22:20:04.586724] [INFO ] [MAIN ] UP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:20:04.586930] [DEBUG] [LOCAL ] UP: No existing data file found in primary storage. [2025-09-17T22:20:04.586984] [WARN ] [MAIN ] UP: No existing data found, performing full refresh instead. [2025-09-17T22:20:04.587139] [INFO ] [MAIN ] UP: Wiping existing primary data before full refresh. [2025-09-17T22:20:04.587210] [INFO ] [LOCAL ] UP: Starting deletion of primary data. [2025-09-17T22:20:04.587275] [DEBUG] [LOCAL ] UP: No primary data file found to delete. [2025-09-17T22:20:04.587321] [INFO ] [MAIN ] UP: Starting full primary refresh. [2025-09-17T22:20:04.951911] [INFO ] [REMOTE ] UP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:20:05.215818] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-01. [2025-09-17T22:20:06.015803] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-07. [2025-09-17T22:20:06.815867] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-11. [2025-09-17T22:20:07.197323] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-01 (1.98 seconds). [2025-09-17T22:20:07.528445] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-07 (3.11 seconds). [2025-09-17T22:20:07.615804] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-02. [2025-09-17T22:20:07.813202] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T22:20:08.397923] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-11 (1.58 seconds). [2025-09-17T22:20:08.415680] [INFO ] [REMOTE ] UP: Fetching primary data for 2024-12. [2025-09-17T22:20:09.003439] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T22:20:09.215795] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-03. [2025-09-17T22:20:10.015851] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-08. [2025-09-17T22:20:10.122613] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T22:20:10.815831] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-01. [2025-09-17T22:20:11.116048] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T22:20:11.615797] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-08. [2025-09-17T22:20:12.415825] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-04. [2025-09-17T22:20:12.454399] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T22:20:12.785572] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-08 (2.77 seconds). [2025-09-17T22:20:13.133204] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-08 (1.52 seconds). [2025-09-17T22:20:13.215736] [INFO ] [REMOTE ] UNM: Fetching primary data for 2025-09. [2025-09-17T22:20:14.015870] [INFO ] [REMOTE ] UNH: Fetching primary data for 2025-09. [2025-09-17T22:20:14.421663] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-04 (2.01 seconds). [2025-09-17T22:20:14.461420] [INFO ] [REMOTE ] UNM: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T22:20:14.468906] [INFO ] [REMOTE ] UNM: Full fetch complete (69911 records). [2025-09-17T22:20:14.469109] [DEBUG] [VALIDATOR ] UNM: Validating primary data. [2025-09-17T22:20:14.818211] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-02. [2025-09-17T22:20:14.891458] [DEBUG] [VALIDATOR ] UNM: All expected trading days are present. [2025-09-17T22:20:14.891571] [DEBUG] [VALIDATOR ] UNM: Primary data validation passed. [2025-09-17T22:20:14.892688] [INFO ] [MAIN ] UNM: Fetched primary data is valid. [2025-09-17T22:20:14.892767] [DEBUG] [LOCAL ] UNM: Saving primary data. [2025-09-17T22:20:14.913677] [INFO ] [REMOTE ] UNH: Incremental fetch complete for 2025-09 (0.90 seconds). [2025-09-17T22:20:14.920314] [DEBUG] [LOCAL ] UNM: Trimmed 69911 records to 48808 (keeping 200 days of data) [2025-09-17T22:20:14.921689] [INFO ] [REMOTE ] UNH: Full fetch complete (77719 records). [2025-09-17T22:20:14.921848] [DEBUG] [VALIDATOR ] UNH: Validating primary data. [2025-09-17T22:20:15.536815] [DEBUG] [LOCAL ] UNM: Primary data saved (48808 records). [2025-09-17T22:20:15.555981] [INFO ] [MAIN ] UNM: Full history saved. [2025-09-17T22:20:15.560122] [INFO ] [MAIN ] Update Progress: 2188/2371 symbols completed. UNM took 40.3s. Estimated remaining: 26m 47s. Rate: 6.8 symbols/min [2025-09-17T22:20:15.639836] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-05. [2025-09-17T22:20:15.785450] [DEBUG] [VALIDATOR ] UNH: All expected trading days are present. [2025-09-17T22:20:15.785924] [DEBUG] [VALIDATOR ] UNH: Primary data validation passed. [2025-09-17T22:20:15.813470] [INFO ] [MAIN ] UNH: Fetched primary data is valid. [2025-09-17T22:20:15.842455] [DEBUG] [LOCAL ] UNH: Saving primary data. [2025-09-17T22:20:15.870536] [INFO ] [MAIN ] UPS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:20:15.875493] [DEBUG] [LOCAL ] UNH: Trimmed 77719 records to 53793 (keeping 200 days of data) [2025-09-17T22:20:16.059980] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T22:20:16.089753] [DEBUG] [LOCAL ] UPS: Loaded 53710 existing records from primary storage. [2025-09-17T22:20:16.090442] [INFO ] [MAIN ] UPS: Loaded 53710 existing records. [2025-09-17T22:20:16.286799] [WARN ] [MAIN ] UPS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:20:16.289089] [INFO ] [MAIN ] UPS: Wiping existing primary data before full refresh. [2025-09-17T22:20:16.289430] [INFO ] [LOCAL ] UPS: Starting deletion of primary data. [2025-09-17T22:20:16.291315] [DEBUG] [LOCAL ] UPS: Deleted primary data file. [2025-09-17T22:20:16.291721] [INFO ] [MAIN ] UPS: Starting full primary refresh. [2025-09-17T22:20:16.417622] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-03. [2025-09-17T22:20:16.786868] [INFO ] [REMOTE ] UPS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:20:16.919886] [DEBUG] [LOCAL ] UNH: Primary data saved (53793 records). [2025-09-17T22:20:16.920049] [INFO ] [MAIN ] UNH: Full history saved. [2025-09-17T22:20:16.920166] [INFO ] [MAIN ] Update Progress: 2189/2371 symbols completed. UNH took 47.5s. Estimated remaining: 26m 38s. Rate: 6.8 symbols/min [2025-09-17T22:20:17.100707] [INFO ] [MAIN ] URI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:20:17.148899] [DEBUG] [LOCAL ] URI: Loaded 36877 existing records from primary storage. [2025-09-17T22:20:17.149079] [INFO ] [MAIN ] URI: Loaded 36877 existing records. [2025-09-17T22:20:17.221065] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-11. [2025-09-17T22:20:17.348003] [WARN ] [MAIN ] URI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:20:17.348249] [INFO ] [MAIN ] URI: Wiping existing primary data before full refresh. [2025-09-17T22:20:17.348297] [INFO ] [LOCAL ] URI: Starting deletion of primary data. [2025-09-17T22:20:17.349081] [DEBUG] [LOCAL ] URI: Deleted primary data file. [2025-09-17T22:20:17.349171] [INFO ] [MAIN ] URI: Starting full primary refresh. [2025-09-17T22:20:17.721849] [INFO ] [REMOTE ] URI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:20:17.759218] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T22:20:17.914072] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-03 (1.50 seconds). [2025-09-17T22:20:18.015823] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-06. [2025-09-17T22:20:18.815841] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-04. [2025-09-17T22:20:19.222298] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T22:20:19.615777] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-11. [2025-09-17T22:20:19.779631] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T22:20:19.948578] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T22:20:20.415773] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-07. [2025-09-17T22:20:21.136230] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T22:20:21.215770] [INFO ] [REMOTE ] URI: Fetching primary data for 2024-12. [2025-09-17T22:20:22.015756] [INFO ] [REMOTE ] UPS: Fetching primary data for 2024-12. [2025-09-17T22:20:22.435611] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T22:20:22.807452] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2024-12 (1.59 seconds). [2025-09-17T22:20:22.815698] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-08. [2025-09-17T22:20:23.615794] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-01. [2025-09-17T22:20:23.988810] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2024-12 (1.97 seconds). [2025-09-17T22:20:24.242142] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T22:20:24.416010] [INFO ] [REMOTE ] UNP: Fetching primary data for 2025-09. [2025-09-17T22:20:25.105254] [INFO ] [REMOTE ] UNP: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T22:20:25.112600] [INFO ] [REMOTE ] UNP: Full fetch complete (76715 records). [2025-09-17T22:20:25.112837] [DEBUG] [VALIDATOR ] UNP: Validating primary data. [2025-09-17T22:20:25.220974] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-05. [2025-09-17T22:20:25.551780] [DEBUG] [VALIDATOR ] UNP: All expected trading days are present. [2025-09-17T22:20:25.552052] [DEBUG] [VALIDATOR ] UNP: Primary data validation passed. [2025-09-17T22:20:25.553314] [INFO ] [MAIN ] UNP: Fetched primary data is valid. [2025-09-17T22:20:25.553417] [DEBUG] [LOCAL ] UNP: Saving primary data. [2025-09-17T22:20:25.555134] [DEBUG] [LOCAL ] UNP: Trimmed 76715 records to 53220 (keeping 200 days of data) [2025-09-17T22:20:25.683430] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-17T22:20:25.947059] [DEBUG] [LOCAL ] UNP: Primary data saved (53220 records). [2025-09-17T22:20:25.947216] [INFO ] [MAIN ] UNP: Full history saved. [2025-09-17T22:20:25.947379] [INFO ] [MAIN ] Update Progress: 2190/2371 symbols completed. UNP took 34.9s. Estimated remaining: 26m 29s. Rate: 6.8 symbols/min [2025-09-17T22:20:26.023131] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-02. [2025-09-17T22:20:26.121551] [INFO ] [MAIN ] USA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:20:26.157688] [DEBUG] [LOCAL ] USA: Loaded 36134 existing records from primary storage. [2025-09-17T22:20:26.157844] [INFO ] [MAIN ] USA: Loaded 36134 existing records. [2025-09-17T22:20:26.351550] [WARN ] [MAIN ] USA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:20:26.351895] [INFO ] [MAIN ] USA: Wiping existing primary data before full refresh. [2025-09-17T22:20:26.351952] [INFO ] [LOCAL ] USA: Starting deletion of primary data. [2025-09-17T22:20:26.352754] [DEBUG] [LOCAL ] USA: Deleted primary data file. [2025-09-17T22:20:26.352817] [INFO ] [MAIN ] USA: Starting full primary refresh. [2025-09-17T22:20:26.773960] [INFO ] [REMOTE ] USA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:20:26.815794] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-01. [2025-09-17T22:20:27.065944] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T22:20:27.581403] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T22:20:27.615778] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-11. [2025-09-17T22:20:28.415769] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-06. [2025-09-17T22:20:28.823483] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T22:20:29.109261] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-11 (1.49 seconds). [2025-09-17T22:20:29.215789] [INFO ] [REMOTE ] USA: Fetching primary data for 2024-12. [2025-09-17T22:20:29.985955] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T22:20:30.015772] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-07. [2025-09-17T22:20:30.612697] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2024-12 (1.40 seconds). [2025-09-17T22:20:30.815790] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-02. [2025-09-17T22:20:31.615852] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-01. [2025-09-17T22:20:31.667240] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T22:20:32.415786] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-03. [2025-09-17T22:20:32.713292] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-01 (1.10 seconds). [2025-09-17T22:20:32.855729] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-02 (2.04 seconds). [2025-09-17T22:20:33.215823] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-08. [2025-09-17T22:20:34.015796] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-03. [2025-09-17T22:20:34.219151] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-03 (1.80 seconds). [2025-09-17T22:20:34.815785] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-04. [2025-09-17T22:20:35.122525] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T22:20:35.615745] [INFO ] [REMOTE ] UP: Fetching primary data for 2025-09. [2025-09-17T22:20:36.119182] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-03 (2.10 seconds). [2025-09-17T22:20:36.415791] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-04. [2025-09-17T22:20:36.623511] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-04 (1.81 seconds). [2025-09-17T22:20:37.142086] [INFO ] [REMOTE ] UP: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T22:20:37.148877] [INFO ] [REMOTE ] UP: Full fetch complete (61690 records). [2025-09-17T22:20:37.148989] [DEBUG] [VALIDATOR ] UP: Validating primary data. [2025-09-17T22:20:37.220855] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-02. [2025-09-17T22:20:37.560391] [DEBUG] [VALIDATOR ] UP: All expected trading days are present. [2025-09-17T22:20:37.560495] [DEBUG] [VALIDATOR ] UP: Primary data validation passed. [2025-09-17T22:20:37.561470] [INFO ] [MAIN ] UP: Fetched primary data is valid. [2025-09-17T22:20:37.561539] [DEBUG] [LOCAL ] UP: Saving primary data. [2025-09-17T22:20:37.563236] [DEBUG] [LOCAL ] UP: Trimmed 61690 records to 42932 (keeping 200 days of data) [2025-09-17T22:20:37.814593] [DEBUG] [LOCAL ] UP: Primary data saved (42932 records). [2025-09-17T22:20:37.814752] [INFO ] [MAIN ] UP: Full history saved. [2025-09-17T22:20:37.814877] [INFO ] [MAIN ] Update Progress: 2191/2371 symbols completed. UP took 33.4s. Estimated remaining: 26m 20s. Rate: 6.8 symbols/min [2025-09-17T22:20:37.995177] [INFO ] [MAIN ] USAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:20:38.020282] [DEBUG] [LOCAL ] USAC: Loaded 22930 existing records from primary storage. [2025-09-17T22:20:38.019793] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-05. [2025-09-17T22:20:38.020455] [INFO ] [MAIN ] USAC: Loaded 22930 existing records. [2025-09-17T22:20:38.208366] [WARN ] [MAIN ] USAC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:20:38.208722] [INFO ] [MAIN ] USAC: Wiping existing primary data before full refresh. [2025-09-17T22:20:38.208784] [INFO ] [LOCAL ] USAC: Starting deletion of primary data. [2025-09-17T22:20:38.209889] [DEBUG] [LOCAL ] USAC: Deleted primary data file. [2025-09-17T22:20:38.209949] [INFO ] [MAIN ] USAC: Starting full primary refresh. [2025-09-17T22:20:38.580834] [INFO ] [REMOTE ] USAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:20:38.663201] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T22:20:38.710916] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-04 (2.30 seconds). [2025-09-17T22:20:38.815796] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-03. [2025-09-17T22:20:39.530635] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-05 (1.51 seconds). [2025-09-17T22:20:39.615804] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-11. [2025-09-17T22:20:40.415783] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-06. [2025-09-17T22:20:40.575419] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T22:20:40.692340] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-11 (1.08 seconds). [2025-09-17T22:20:41.215855] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-05. [2025-09-17T22:20:41.914399] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T22:20:42.015807] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-04. [2025-09-17T22:20:42.815794] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-07. [2025-09-17T22:20:43.273873] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T22:20:43.325094] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T22:20:43.615803] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-05. [2025-09-17T22:20:44.415801] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-06. [2025-09-17T22:20:44.443678] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-07 (1.63 seconds). [2025-09-17T22:20:44.612999] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-05 (1.00 seconds). [2025-09-17T22:20:45.215795] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-06. [2025-09-17T22:20:46.015767] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-08. [2025-09-17T22:20:46.368999] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-06 (1.95 seconds). [2025-09-17T22:20:46.595776] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T22:20:46.815785] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-07. [2025-09-17T22:20:47.450541] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T22:20:47.615790] [INFO ] [REMOTE ] USAC: Fetching primary data for 2024-12. [2025-09-17T22:20:48.415801] [INFO ] [REMOTE ] URI: Fetching primary data for 2025-09. [2025-09-17T22:20:48.466431] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T22:20:48.792561] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T22:20:48.991397] [INFO ] [REMOTE ] URI: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T22:20:48.997106] [INFO ] [REMOTE ] URI: Full fetch complete (53584 records). [2025-09-17T22:20:48.997334] [DEBUG] [VALIDATOR ] URI: Validating primary data. [2025-09-17T22:20:49.217427] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-08. [2025-09-17T22:20:49.465384] [DEBUG] [VALIDATOR ] URI: All expected trading days are present. [2025-09-17T22:20:49.465517] [DEBUG] [VALIDATOR ] URI: Primary data validation passed. [2025-09-17T22:20:49.466489] [INFO ] [MAIN ] URI: Fetched primary data is valid. [2025-09-17T22:20:49.466557] [DEBUG] [LOCAL ] URI: Saving primary data. [2025-09-17T22:20:49.467947] [DEBUG] [LOCAL ] URI: Trimmed 53584 records to 36854 (keeping 200 days of data) [2025-09-17T22:20:49.728571] [DEBUG] [LOCAL ] URI: Primary data saved (36854 records). [2025-09-17T22:20:49.728794] [INFO ] [MAIN ] URI: Full history saved. [2025-09-17T22:20:49.728905] [INFO ] [MAIN ] Update Progress: 2192/2371 symbols completed. URI took 32.8s. Estimated remaining: 26m 12s. Rate: 6.8 symbols/min [2025-09-17T22:20:49.901387] [INFO ] [MAIN ] USB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:20:49.954129] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-17T22:20:49.954282] [INFO ] [MAIN ] USB: Loaded 53688 existing records. [2025-09-17T22:20:50.020937] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-07. [2025-09-17T22:20:50.134828] [WARN ] [MAIN ] USB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:20:50.135060] [INFO ] [MAIN ] USB: Wiping existing primary data before full refresh. [2025-09-17T22:20:50.135120] [INFO ] [LOCAL ] USB: Starting deletion of primary data. [2025-09-17T22:20:50.136686] [DEBUG] [LOCAL ] USB: Deleted primary data file. [2025-09-17T22:20:50.136746] [INFO ] [MAIN ] USB: Starting full primary refresh. [2025-09-17T22:20:50.497779] [INFO ] [REMOTE ] USB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:20:50.711345] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T22:20:50.815785] [INFO ] [REMOTE ] USA: Fetching primary data for 2025-09. [2025-09-17T22:20:51.615786] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-01. [2025-09-17T22:20:52.162055] [INFO ] [REMOTE ] USA: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T22:20:52.167536] [INFO ] [REMOTE ] USA: Full fetch complete (51327 records). [2025-09-17T22:20:52.167718] [DEBUG] [VALIDATOR ] USA: Validating primary data. [2025-09-17T22:20:52.426621] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-11. [2025-09-17T22:20:52.620416] [DEBUG] [VALIDATOR ] USA: All expected trading days are present. [2025-09-17T22:20:52.620541] [DEBUG] [VALIDATOR ] USA: Primary data validation passed. [2025-09-17T22:20:52.621452] [INFO ] [MAIN ] USA: Fetched primary data is valid. [2025-09-17T22:20:52.621530] [DEBUG] [LOCAL ] USA: Saving primary data. [2025-09-17T22:20:52.623006] [DEBUG] [LOCAL ] USA: Trimmed 51327 records to 36201 (keeping 200 days of data) [2025-09-17T22:20:52.786491] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-07 (2.77 seconds). [2025-09-17T22:20:52.908400] [DEBUG] [LOCAL ] USA: Primary data saved (36201 records). [2025-09-17T22:20:52.908554] [INFO ] [MAIN ] USA: Full history saved. [2025-09-17T22:20:52.908683] [INFO ] [MAIN ] Update Progress: 2193/2371 symbols completed. USA took 27.0s. Estimated remaining: 26m 3s. Rate: 6.8 symbols/min [2025-09-17T22:20:53.082355] [INFO ] [MAIN ] USFD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:20:53.101564] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T22:20:53.154297] [DEBUG] [LOCAL ] USFD: Loaded 51317 existing records from primary storage. [2025-09-17T22:20:53.154452] [INFO ] [MAIN ] USFD: Loaded 51317 existing records. [2025-09-17T22:20:53.221961] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-02. [2025-09-17T22:20:53.342027] [WARN ] [MAIN ] USFD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:20:53.342343] [INFO ] [MAIN ] USFD: Wiping existing primary data before full refresh. [2025-09-17T22:20:53.342409] [INFO ] [LOCAL ] USFD: Starting deletion of primary data. [2025-09-17T22:20:53.343827] [DEBUG] [LOCAL ] USFD: Deleted primary data file. [2025-09-17T22:20:53.343892] [INFO ] [MAIN ] USFD: Starting full primary refresh. [2025-09-17T22:20:53.757600] [INFO ] [REMOTE ] USFD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:20:54.015786] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-11. [2025-09-17T22:20:54.309538] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-11 (1.88 seconds). [2025-09-17T22:20:54.611319] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T22:20:54.815779] [INFO ] [REMOTE ] USB: Fetching primary data for 2024-12. [2025-09-17T22:20:55.460350] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T22:20:55.615771] [INFO ] [REMOTE ] USFD: Fetching primary data for 2024-12. [2025-09-17T22:20:56.415780] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-03. [2025-09-17T22:20:56.660460] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2024-12 (1.84 seconds). [2025-09-17T22:20:57.215736] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-01. [2025-09-17T22:20:57.291019] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2024-12 (1.68 seconds). [2025-09-17T22:20:57.688564] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T22:20:58.015780] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-04. [2025-09-17T22:20:58.815788] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-08. [2025-09-17T22:20:59.063848] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-01 (1.85 seconds). [2025-09-17T22:20:59.278186] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-04 (1.26 seconds). [2025-09-17T22:20:59.615775] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-01. [2025-09-17T22:21:00.415777] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-05. [2025-09-17T22:21:01.215786] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-02. [2025-09-17T22:21:01.417381] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-08 (2.60 seconds). [2025-09-17T22:21:01.501818] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T22:21:01.554549] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T22:21:02.015777] [INFO ] [REMOTE ] UPS: Fetching primary data for 2025-09. [2025-09-17T22:21:02.815798] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-02. [2025-09-17T22:21:03.615805] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-06. [2025-09-17T22:21:03.873440] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-02 (2.66 seconds). [2025-09-17T22:21:04.334338] [INFO ] [REMOTE ] UPS: Incremental fetch complete for 2025-09 (2.32 seconds). [2025-09-17T22:21:04.343762] [INFO ] [REMOTE ] UPS: Full fetch complete (77651 records). [2025-09-17T22:21:04.343912] [DEBUG] [VALIDATOR ] UPS: Validating primary data. [2025-09-17T22:21:04.421096] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-03. [2025-09-17T22:21:04.740089] [DEBUG] [VALIDATOR ] UPS: All expected trading days are present. [2025-09-17T22:21:04.740175] [DEBUG] [VALIDATOR ] UPS: Primary data validation passed. [2025-09-17T22:21:04.741230] [INFO ] [MAIN ] UPS: Fetched primary data is valid. [2025-09-17T22:21:04.741343] [DEBUG] [LOCAL ] UPS: Saving primary data. [2025-09-17T22:21:04.742796] [DEBUG] [LOCAL ] UPS: Trimmed 77651 records to 53710 (keeping 200 days of data) [2025-09-17T22:21:05.085516] [DEBUG] [LOCAL ] UPS: Primary data saved (53710 records). [2025-09-17T22:21:05.085729] [INFO ] [MAIN ] UPS: Full history saved. [2025-09-17T22:21:05.086753] [INFO ] [MAIN ] Update Progress: 2194/2371 symbols completed. UPS took 49.5s. Estimated remaining: 25m 54s. Rate: 6.8 symbols/min [2025-09-17T22:21:05.260192] [INFO ] [MAIN ] USNA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:21:05.278125] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-06 (1.66 seconds). [2025-09-17T22:21:05.284377] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-07. [2025-09-17T22:21:05.298762] [DEBUG] [LOCAL ] USNA: Loaded 18532 existing records from primary storage. [2025-09-17T22:21:05.298870] [INFO ] [MAIN ] USNA: Loaded 18532 existing records. [2025-09-17T22:21:05.480766] [WARN ] [MAIN ] USNA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:21:05.481176] [INFO ] [MAIN ] USNA: Wiping existing primary data before full refresh. [2025-09-17T22:21:05.481318] [INFO ] [LOCAL ] USNA: Starting deletion of primary data. [2025-09-17T22:21:05.490459] [DEBUG] [LOCAL ] USNA: Deleted primary data file. [2025-09-17T22:21:05.503323] [INFO ] [MAIN ] USNA: Starting full primary refresh. [2025-09-17T22:21:05.600727] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-02 (2.78 seconds). [2025-09-17T22:21:05.878890] [INFO ] [REMOTE ] USNA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:21:06.015763] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-03. [2025-09-17T22:21:06.401732] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-07 (1.12 seconds). [2025-09-17T22:21:06.484091] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T22:21:06.815871] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-08. [2025-09-17T22:21:07.615794] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-04. [2025-09-17T22:21:07.799564] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T22:21:08.060484] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T22:21:08.415809] [INFO ] [REMOTE ] USAC: Fetching primary data for 2025-09. [2025-09-17T22:21:09.215868] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-04. [2025-09-17T22:21:09.482680] [INFO ] [REMOTE ] USAC: Incremental fetch complete for 2025-09 (1.07 seconds). [2025-09-17T22:21:09.486612] [INFO ] [REMOTE ] USAC: Full fetch complete (35330 records). [2025-09-17T22:21:09.486741] [DEBUG] [VALIDATOR ] USAC: Validating primary data. [2025-09-17T22:21:09.882360] [DEBUG] [VALIDATOR ] USAC: All expected trading days are present. [2025-09-17T22:21:09.882473] [DEBUG] [VALIDATOR ] USAC: Primary data validation passed. [2025-09-17T22:21:09.883303] [INFO ] [MAIN ] USAC: Fetched primary data is valid. [2025-09-17T22:21:09.883385] [DEBUG] [LOCAL ] USAC: Saving primary data. [2025-09-17T22:21:09.884608] [DEBUG] [LOCAL ] USAC: Trimmed 35330 records to 22957 (keeping 200 days of data) [2025-09-17T22:21:10.029119] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-11. [2025-09-17T22:21:10.051590] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-04 (2.44 seconds). [2025-09-17T22:21:10.068853] [DEBUG] [LOCAL ] USAC: Primary data saved (22957 records). [2025-09-17T22:21:10.069039] [INFO ] [MAIN ] USAC: Full history saved. [2025-09-17T22:21:10.069166] [INFO ] [MAIN ] Update Progress: 2195/2371 symbols completed. USAC took 32.3s. Estimated remaining: 25m 45s. Rate: 6.8 symbols/min [2025-09-17T22:21:10.246094] [INFO ] [MAIN ] USPH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:21:10.264627] [DEBUG] [LOCAL ] USPH: Loaded 16762 existing records from primary storage. [2025-09-17T22:21:10.264809] [INFO ] [MAIN ] USPH: Loaded 16762 existing records. [2025-09-17T22:21:10.467781] [WARN ] [MAIN ] USPH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:21:10.468047] [INFO ] [MAIN ] USPH: Wiping existing primary data before full refresh. [2025-09-17T22:21:10.468095] [INFO ] [LOCAL ] USPH: Starting deletion of primary data. [2025-09-17T22:21:10.468674] [DEBUG] [LOCAL ] USPH: Deleted primary data file. [2025-09-17T22:21:10.468757] [INFO ] [MAIN ] USPH: Starting full primary refresh. [2025-09-17T22:21:10.821810] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-05. [2025-09-17T22:21:10.875374] [INFO ] [REMOTE ] USPH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:21:10.913255] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T22:21:11.058829] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-11 (1.03 seconds). [2025-09-17T22:21:11.615793] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-11. [2025-09-17T22:21:12.415821] [INFO ] [REMOTE ] USNA: Fetching primary data for 2024-12. [2025-09-17T22:21:12.591784] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T22:21:13.004378] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-05 (2.18 seconds). [2025-09-17T22:21:13.215736] [INFO ] [REMOTE ] USPH: Fetching primary data for 2024-12. [2025-09-17T22:21:13.286154] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2024-12 (0.87 seconds). [2025-09-17T22:21:14.015788] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-01. [2025-09-17T22:21:14.213344] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T22:21:14.815811] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-05. [2025-09-17T22:21:15.141981] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T22:21:15.615821] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-02. [2025-09-17T22:21:16.415775] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-01. [2025-09-17T22:21:16.513726] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T22:21:16.738869] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T22:21:17.215817] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-06. [2025-09-17T22:21:17.348715] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T22:21:18.015824] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-06. [2025-09-17T22:21:18.815870] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-03. [2025-09-17T22:21:18.970849] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T22:21:19.185266] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T22:21:19.615870] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-07. [2025-09-17T22:21:20.075137] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-03 (1.26 seconds). [2025-09-17T22:21:20.415828] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-04. [2025-09-17T22:21:21.216979] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-07. [2025-09-17T22:21:21.223542] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-07 (1.61 seconds). [2025-09-17T22:21:21.526233] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-04 (1.11 seconds). [2025-09-17T22:21:22.015838] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-05. [2025-09-17T22:21:22.815848] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-08. [2025-09-17T22:21:23.615777] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-02. [2025-09-17T22:21:23.764581] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T22:21:24.084763] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-07 (2.87 seconds). [2025-09-17T22:21:24.415793] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-08. [2025-09-17T22:21:24.526669] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-02 (0.91 seconds). [2025-09-17T22:21:24.783073] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T22:21:25.215780] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-03. [2025-09-17T22:21:26.015809] [INFO ] [REMOTE ] USFD: Fetching primary data for 2025-09. [2025-09-17T22:21:26.247439] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-03 (1.03 seconds). [2025-09-17T22:21:26.463276] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-08 (2.05 seconds). [2025-09-17T22:21:26.815815] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-06. [2025-09-17T22:21:27.601398] [INFO ] [REMOTE ] USFD: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T22:21:27.608305] [INFO ] [REMOTE ] USFD: Full fetch complete (73786 records). [2025-09-17T22:21:27.608476] [DEBUG] [VALIDATOR ] USFD: Validating primary data. [2025-09-17T22:21:27.620989] [INFO ] [REMOTE ] USB: Fetching primary data for 2025-09. [2025-09-17T22:21:27.984025] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-06 (1.17 seconds). [2025-09-17T22:21:28.094924] [DEBUG] [VALIDATOR ] USFD: All expected trading days are present. [2025-09-17T22:21:28.095069] [DEBUG] [VALIDATOR ] USFD: Primary data validation passed. [2025-09-17T22:21:28.096611] [INFO ] [MAIN ] USFD: Fetched primary data is valid. [2025-09-17T22:21:28.096725] [DEBUG] [LOCAL ] USFD: Saving primary data. [2025-09-17T22:21:28.098454] [DEBUG] [LOCAL ] USFD: Trimmed 73786 records to 51295 (keeping 200 days of data) [2025-09-17T22:21:28.430735] [INFO ] [REMOTE ] USB: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T22:21:28.427260] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-04. [2025-09-17T22:21:28.444489] [INFO ] [REMOTE ] USB: Full fetch complete (77606 records). [2025-09-17T22:21:28.445952] [DEBUG] [VALIDATOR ] USB: Validating primary data. [2025-09-17T22:21:28.830185] [DEBUG] [LOCAL ] USFD: Primary data saved (51295 records). [2025-09-17T22:21:28.841296] [INFO ] [MAIN ] USFD: Full history saved. [2025-09-17T22:21:28.841481] [INFO ] [MAIN ] Update Progress: 2196/2371 symbols completed. USFD took 35.9s. Estimated remaining: 25m 37s. Rate: 6.8 symbols/min [2025-09-17T22:21:29.047289] [DEBUG] [VALIDATOR ] USB: All expected trading days are present. [2025-09-17T22:21:29.047433] [DEBUG] [VALIDATOR ] USB: Primary data validation passed. [2025-09-17T22:21:29.048905] [INFO ] [MAIN ] USB: Fetched primary data is valid. [2025-09-17T22:21:29.054397] [DEBUG] [LOCAL ] USB: Saving primary data. [2025-09-17T22:21:29.109064] [DEBUG] [LOCAL ] USB: Trimmed 77606 records to 53688 (keeping 200 days of data) [2025-09-17T22:21:29.127081] [INFO ] [MAIN ] UTF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:21:29.222576] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-07. [2025-09-17T22:21:29.287340] [DEBUG] [LOCAL ] UTF: Loaded 28029 existing records from primary storage. [2025-09-17T22:21:29.291021] [INFO ] [MAIN ] UTF: Loaded 28029 existing records. [2025-09-17T22:21:29.650041] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T22:21:29.650214] [WARN ] [MAIN ] UTF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:21:29.656693] [INFO ] [MAIN ] UTF: Wiping existing primary data before full refresh. [2025-09-17T22:21:29.657013] [INFO ] [LOCAL ] UTF: Starting deletion of primary data. [2025-09-17T22:21:29.659331] [DEBUG] [LOCAL ] UTF: Deleted primary data file. [2025-09-17T22:21:29.659757] [INFO ] [MAIN ] UTF: Starting full primary refresh. [2025-09-17T22:21:30.030265] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-05. [2025-09-17T22:21:30.176588] [INFO ] [REMOTE ] UTF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:21:30.196369] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T22:21:30.224038] [DEBUG] [LOCAL ] USB: Primary data saved (53688 records). [2025-09-17T22:21:30.224312] [INFO ] [MAIN ] USB: Full history saved. [2025-09-17T22:21:30.224465] [INFO ] [MAIN ] Update Progress: 2197/2371 symbols completed. USB took 40.5s. Estimated remaining: 25m 28s. Rate: 6.8 symbols/min [2025-09-17T22:21:30.815759] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-08. [2025-09-17T22:21:30.964708] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-05 (0.93 seconds). [2025-09-17T22:21:31.615870] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-06. [2025-09-17T22:21:31.780548] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T22:21:32.415777] [INFO ] [REMOTE ] USNA: Fetching primary data for 2025-09. [2025-09-17T22:21:32.635357] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T22:21:33.215751] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-07. [2025-09-17T22:21:33.585774] [INFO ] [REMOTE ] USNA: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T22:21:33.588627] [INFO ] [REMOTE ] USNA: Full fetch complete (26429 records). [2025-09-17T22:21:33.588737] [DEBUG] [VALIDATOR ] USNA: Validating primary data. [2025-09-17T22:21:34.011765] [DEBUG] [VALIDATOR ] USNA: All expected trading days are present. [2025-09-17T22:21:34.011845] [DEBUG] [VALIDATOR ] USNA: Primary data validation passed. [2025-09-17T22:21:34.012536] [INFO ] [MAIN ] USNA: Fetched primary data is valid. [2025-09-17T22:21:34.012575] [DEBUG] [LOCAL ] USNA: Saving primary data. [2025-09-17T22:21:34.013253] [DEBUG] [LOCAL ] USNA: Trimmed 26429 records to 18431 (keeping 200 days of data) [2025-09-17T22:21:34.015770] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-11. [2025-09-17T22:21:34.136379] [DEBUG] [LOCAL ] USNA: Primary data saved (18431 records). [2025-09-17T22:21:34.136528] [INFO ] [MAIN ] USNA: Full history saved. [2025-09-17T22:21:34.136614] [INFO ] [MAIN ] Update Progress: 2198/2371 symbols completed. USNA took 29.0s. Estimated remaining: 25m 18s. Rate: 6.8 symbols/min [2025-09-17T22:21:34.299237] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T22:21:34.815748] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-08. [2025-09-17T22:21:34.906251] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-11 (0.89 seconds). [2025-09-17T22:21:35.615792] [INFO ] [REMOTE ] UTF: Fetching primary data for 2024-12. [2025-09-17T22:21:35.945724] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-08 (1.13 seconds). [2025-09-17T22:21:36.415899] [INFO ] [REMOTE ] USPH: Fetching primary data for 2025-09. [2025-09-17T22:21:37.193282] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2024-12 (1.58 seconds). [2025-09-17T22:21:37.215774] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-01. [2025-09-17T22:21:37.332407] [INFO ] [REMOTE ] USPH: Incremental fetch complete for 2025-09 (0.92 seconds). [2025-09-17T22:21:37.335418] [INFO ] [REMOTE ] USPH: Full fetch complete (22354 records). [2025-09-17T22:21:37.335603] [DEBUG] [VALIDATOR ] USPH: Validating primary data. [2025-09-17T22:21:37.719424] [DEBUG] [VALIDATOR ] USPH: All expected trading days are present. [2025-09-17T22:21:37.719533] [DEBUG] [VALIDATOR ] USPH: Primary data validation passed. [2025-09-17T22:21:37.720125] [INFO ] [MAIN ] USPH: Fetched primary data is valid. [2025-09-17T22:21:37.720199] [DEBUG] [LOCAL ] USPH: Saving primary data. [2025-09-17T22:21:37.721158] [DEBUG] [LOCAL ] USPH: Trimmed 22354 records to 16649 (keeping 200 days of data) [2025-09-17T22:21:37.832182] [DEBUG] [LOCAL ] USPH: Primary data saved (16649 records). [2025-09-17T22:21:37.832326] [INFO ] [MAIN ] USPH: Full history saved. [2025-09-17T22:21:37.832427] [INFO ] [MAIN ] Update Progress: 2199/2371 symbols completed. USPH took 27.8s. Estimated remaining: 25m 9s. Rate: 6.8 symbols/min [2025-09-17T22:21:38.482196] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T22:21:38.488807] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-02. [2025-09-17T22:21:39.904204] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T22:21:39.909964] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-03. [2025-09-17T22:21:41.187682] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-03 (1.28 seconds). [2025-09-17T22:21:41.201266] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-04. [2025-09-17T22:21:42.667380] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-04 (1.47 seconds). [2025-09-17T22:21:42.674859] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-05. [2025-09-17T22:21:44.528825] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T22:21:44.536126] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-06. [2025-09-17T22:21:46.216313] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T22:21:46.222396] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-07. [2025-09-17T22:21:47.518302] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-07 (1.30 seconds). [2025-09-17T22:21:47.524673] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-08. [2025-09-17T22:21:48.737836] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T22:21:48.743797] [INFO ] [REMOTE ] UTF: Fetching primary data for 2025-09. [2025-09-17T22:21:49.990242] [INFO ] [REMOTE ] UTF: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T22:21:49.995050] [INFO ] [REMOTE ] UTF: Full fetch complete (40348 records). [2025-09-17T22:21:49.995161] [DEBUG] [VALIDATOR ] UTF: Validating primary data. [2025-09-17T22:21:50.389014] [DEBUG] [VALIDATOR ] UTF: All expected trading days are present. [2025-09-17T22:21:50.389112] [DEBUG] [VALIDATOR ] UTF: Primary data validation passed. [2025-09-17T22:21:50.390027] [INFO ] [MAIN ] UTF: Fetched primary data is valid. [2025-09-17T22:21:50.390116] [DEBUG] [LOCAL ] UTF: Saving primary data. [2025-09-17T22:21:50.391344] [DEBUG] [LOCAL ] UTF: Trimmed 40348 records to 28177 (keeping 200 days of data) [2025-09-17T22:21:50.583001] [DEBUG] [LOCAL ] UTF: Primary data saved (28177 records). [2025-09-17T22:21:50.583183] [INFO ] [MAIN ] UTF: Full history saved. [2025-09-17T22:21:50.583311] [INFO ] [MAIN ] Update Progress: 2200/2371 symbols completed. UTF took 21.7s. Estimated remaining: 25m 1s. Rate: 6.8 symbols/min [2025-09-17T22:21:51.251912] [INFO ] [MAIN ] UTI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:21:51.303435] [INFO ] [MAIN ] UVE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:21:51.347264] [INFO ] [MAIN ] UTL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:21:51.344902] [INFO ] [MAIN ] UTZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:21:51.348355] [DEBUG] [LOCAL ] UTZ: No existing data file found in primary storage. [2025-09-17T22:21:51.348719] [WARN ] [MAIN ] UTZ: No existing data found, performing full refresh instead. [2025-09-17T22:21:51.349020] [INFO ] [MAIN ] UTZ: Wiping existing primary data before full refresh. [2025-09-17T22:21:51.349150] [INFO ] [LOCAL ] UTZ: Starting deletion of primary data. [2025-09-17T22:21:51.349685] [DEBUG] [LOCAL ] UTZ: No primary data file found to delete. [2025-09-17T22:21:51.350271] [INFO ] [MAIN ] UTZ: Starting full primary refresh. [2025-09-17T22:21:51.502532] [DEBUG] [LOCAL ] UTL: Loaded 10762 existing records from primary storage. [2025-09-17T22:21:51.538182] [INFO ] [MAIN ] UTL: Loaded 10762 existing records. [2025-09-17T22:21:51.544130] [DEBUG] [LOCAL ] UVE: Loaded 21898 existing records from primary storage. [2025-09-17T22:21:51.605485] [INFO ] [MAIN ] UVE: Loaded 21898 existing records. [2025-09-17T22:21:51.732892] [DEBUG] [LOCAL ] UTI: Loaded 40724 existing records from primary storage. [2025-09-17T22:21:51.823480] [INFO ] [MAIN ] UTI: Loaded 40724 existing records. [2025-09-17T22:21:52.083293] [WARN ] [MAIN ] UTL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:21:52.118175] [INFO ] [MAIN ] UTL: Wiping existing primary data before full refresh. [2025-09-17T22:21:52.160128] [INFO ] [LOCAL ] UTL: Starting deletion of primary data. [2025-09-17T22:21:52.241730] [WARN ] [MAIN ] UVE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:21:52.242379] [DEBUG] [LOCAL ] UTL: Deleted primary data file. [2025-09-17T22:21:52.266376] [INFO ] [REMOTE ] UTZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:21:52.266814] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-11. [2025-09-17T22:21:52.267080] [INFO ] [MAIN ] UTL: Starting full primary refresh. [2025-09-17T22:21:52.350696] [INFO ] [MAIN ] UVE: Wiping existing primary data before full refresh. [2025-09-17T22:21:52.372451] [INFO ] [LOCAL ] UVE: Starting deletion of primary data. [2025-09-17T22:21:52.437873] [DEBUG] [LOCAL ] UVE: Deleted primary data file. [2025-09-17T22:21:52.437802] [WARN ] [MAIN ] UTI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:21:52.456401] [INFO ] [MAIN ] UVE: Starting full primary refresh. [2025-09-17T22:21:52.456494] [INFO ] [MAIN ] UTI: Wiping existing primary data before full refresh. [2025-09-17T22:21:52.478004] [INFO ] [LOCAL ] UTI: Starting deletion of primary data. [2025-09-17T22:21:52.506063] [DEBUG] [LOCAL ] UTI: Deleted primary data file. [2025-09-17T22:21:52.580023] [INFO ] [MAIN ] UTI: Starting full primary refresh. [2025-09-17T22:21:53.342318] [INFO ] [REMOTE ] UTL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:21:53.378273] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-11. [2025-09-17T22:21:53.593458] [INFO ] [REMOTE ] UTI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:21:53.587896] [INFO ] [REMOTE ] UVE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:21:53.593919] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-11. [2025-09-17T22:21:53.594202] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-11. [2025-09-17T22:21:53.623125] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T22:21:53.631789] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2024-12. [2025-09-17T22:21:54.223949] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T22:21:54.226700] [INFO ] [REMOTE ] UTL: Fetching primary data for 2024-12. [2025-09-17T22:21:54.560534] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T22:21:54.564170] [INFO ] [REMOTE ] UVE: Fetching primary data for 2024-12. [2025-09-17T22:21:54.927942] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T22:21:54.935857] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-01. [2025-09-17T22:21:54.943580] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2024-12 (0.72 seconds). [2025-09-17T22:21:54.946164] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-01. [2025-09-17T22:21:55.037024] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T22:21:55.044028] [INFO ] [REMOTE ] UTI: Fetching primary data for 2024-12. [2025-09-17T22:21:55.136204] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2024-12 (0.57 seconds). [2025-09-17T22:21:55.140078] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-01. [2025-09-17T22:21:55.518828] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T22:21:55.521766] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-02. [2025-09-17T22:21:55.933083] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T22:21:55.937242] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-02. [2025-09-17T22:21:56.029495] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-02 (0.51 seconds). [2025-09-17T22:21:56.032220] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-03. [2025-09-17T22:21:56.390713] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T22:21:56.399973] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-02. [2025-09-17T22:21:56.539884] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T22:21:56.547595] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-01. [2025-09-17T22:21:56.706190] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-02 (0.77 seconds). [2025-09-17T22:21:56.879828] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T22:21:57.215789] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-03. [2025-09-17T22:21:57.807951] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-01 (1.26 seconds). [2025-09-17T22:21:57.871076] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T22:21:58.015760] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-03. [2025-09-17T22:21:58.327560] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T22:21:58.815786] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-04. [2025-09-17T22:21:59.585365] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T22:21:59.615741] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-04. [2025-09-17T22:21:59.905884] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T22:22:00.415777] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-05. [2025-09-17T22:22:01.215785] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-02. [2025-09-17T22:22:01.444629] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-04 (1.83 seconds). [2025-09-17T22:22:01.664601] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-05 (1.25 seconds). [2025-09-17T22:22:02.015824] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-06. [2025-09-17T22:22:02.379260] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T22:22:02.815834] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-05. [2025-09-17T22:22:03.229104] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T22:22:03.615794] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-03. [2025-09-17T22:22:04.415763] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-07. [2025-09-17T22:22:04.505930] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T22:22:04.721969] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-03 (1.11 seconds). [2025-09-17T22:22:05.215818] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-04. [2025-09-17T22:22:05.751919] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T22:22:06.015799] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-04. [2025-09-17T22:22:06.397463] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-04 (1.18 seconds). [2025-09-17T22:22:06.631270] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-04 (0.62 seconds). [2025-09-17T22:22:06.815799] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-05. [2025-09-17T22:22:07.615776] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-05. [2025-09-17T22:22:07.729413] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T22:22:08.415801] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-06. [2025-09-17T22:22:09.140323] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T22:22:09.193694] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T22:22:09.215812] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-06. [2025-09-17T22:22:10.015832] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-07. [2025-09-17T22:22:10.816253] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-06. [2025-09-17T22:22:10.848366] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T22:22:10.870869] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T22:22:11.615856] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-08. [2025-09-17T22:22:12.359929] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T22:22:12.415708] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-07. [2025-09-17T22:22:12.549480] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-08 (0.93 seconds). [2025-09-17T22:22:13.215822] [INFO ] [REMOTE ] UTL: Fetching primary data for 2025-09. [2025-09-17T22:22:13.811138] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-07 (1.40 seconds). [2025-09-17T22:22:14.015811] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-08. [2025-09-17T22:22:14.148143] [INFO ] [REMOTE ] UTL: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T22:22:14.151118] [INFO ] [REMOTE ] UTL: Full fetch complete (14858 records). [2025-09-17T22:22:14.151200] [DEBUG] [VALIDATOR ] UTL: Validating primary data. [2025-09-17T22:22:14.606330] [DEBUG] [VALIDATOR ] UTL: All expected trading days are present. [2025-09-17T22:22:14.606440] [DEBUG] [VALIDATOR ] UTL: Primary data validation passed. [2025-09-17T22:22:14.606885] [INFO ] [MAIN ] UTL: Fetched primary data is valid. [2025-09-17T22:22:14.606948] [DEBUG] [LOCAL ] UTL: Saving primary data. [2025-09-17T22:22:14.607530] [DEBUG] [LOCAL ] UTL: Trimmed 14858 records to 10793 (keeping 200 days of data) [2025-09-17T22:22:14.680362] [DEBUG] [LOCAL ] UTL: Primary data saved (10793 records). [2025-09-17T22:22:14.680524] [INFO ] [MAIN ] UTL: Full history saved. [2025-09-17T22:22:14.680635] [INFO ] [MAIN ] Update Progress: 2201/2371 symbols completed. UTL took 24.1s. Estimated remaining: 24m 53s. Rate: 6.8 symbols/min [2025-09-17T22:22:14.825947] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-07. [2025-09-17T22:22:14.859434] [INFO ] [MAIN ] UVV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:22:14.881706] [DEBUG] [LOCAL ] UVV: Loaded 22132 existing records from primary storage. [2025-09-17T22:22:14.881870] [INFO ] [MAIN ] UVV: Loaded 22132 existing records. [2025-09-17T22:22:15.072304] [WARN ] [MAIN ] UVV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:22:15.072566] [INFO ] [MAIN ] UVV: Wiping existing primary data before full refresh. [2025-09-17T22:22:15.072688] [INFO ] [LOCAL ] UVV: Starting deletion of primary data. [2025-09-17T22:22:15.073236] [DEBUG] [LOCAL ] UVV: Deleted primary data file. [2025-09-17T22:22:15.073298] [INFO ] [MAIN ] UVV: Starting full primary refresh. [2025-09-17T22:22:15.452488] [INFO ] [REMOTE ] UVV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:22:15.570000] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T22:22:15.615754] [INFO ] [REMOTE ] UTI: Fetching primary data for 2025-09. [2025-09-17T22:22:16.415780] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-11. [2025-09-17T22:22:16.623269] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-07 (1.80 seconds). [2025-09-17T22:22:16.944108] [INFO ] [REMOTE ] UTI: Incremental fetch complete for 2025-09 (1.33 seconds). [2025-09-17T22:22:16.952981] [INFO ] [REMOTE ] UTI: Full fetch complete (57931 records). [2025-09-17T22:22:16.953166] [DEBUG] [VALIDATOR ] UTI: Validating primary data. [2025-09-17T22:22:17.219772] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-08. [2025-09-17T22:22:17.395837] [DEBUG] [VALIDATOR ] UTI: All expected trading days are present. [2025-09-17T22:22:17.395507] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T22:22:17.396213] [DEBUG] [VALIDATOR ] UTI: Primary data validation passed. [2025-09-17T22:22:17.397440] [INFO ] [MAIN ] UTI: Fetched primary data is valid. [2025-09-17T22:22:17.402676] [DEBUG] [LOCAL ] UTI: Saving primary data. [2025-09-17T22:22:17.404547] [DEBUG] [LOCAL ] UTI: Trimmed 57931 records to 40683 (keeping 200 days of data) [2025-09-17T22:22:17.651090] [DEBUG] [LOCAL ] UTI: Primary data saved (40683 records). [2025-09-17T22:22:17.651242] [INFO ] [MAIN ] UTI: Full history saved. [2025-09-17T22:22:17.651397] [INFO ] [MAIN ] Update Progress: 2202/2371 symbols completed. UTI took 27.1s. Estimated remaining: 24m 44s. Rate: 6.8 symbols/min [2025-09-17T22:22:17.829870] [INFO ] [MAIN ] UWMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:22:17.888119] [DEBUG] [LOCAL ] UWMC: Loaded 52705 existing records from primary storage. [2025-09-17T22:22:17.888507] [INFO ] [MAIN ] UWMC: Loaded 52705 existing records. [2025-09-17T22:22:18.021110] [INFO ] [REMOTE ] UVV: Fetching primary data for 2024-12. [2025-09-17T22:22:18.104908] [WARN ] [MAIN ] UWMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:22:18.105264] [INFO ] [MAIN ] UWMC: Wiping existing primary data before full refresh. [2025-09-17T22:22:18.105340] [INFO ] [LOCAL ] UWMC: Starting deletion of primary data. [2025-09-17T22:22:18.106534] [DEBUG] [LOCAL ] UWMC: Deleted primary data file. [2025-09-17T22:22:18.106613] [INFO ] [MAIN ] UWMC: Starting full primary refresh. [2025-09-17T22:22:18.549513] [INFO ] [REMOTE ] UWMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:22:18.579119] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-08 (1.36 seconds). [2025-09-17T22:22:18.815713] [INFO ] [REMOTE ] UTZ: Fetching primary data for 2025-09. [2025-09-17T22:22:19.129476] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2024-12 (1.11 seconds). [2025-09-17T22:22:19.615788] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-01. [2025-09-17T22:22:20.367319] [INFO ] [REMOTE ] UTZ: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T22:22:20.372752] [INFO ] [REMOTE ] UTZ: Full fetch complete (63285 records). [2025-09-17T22:22:20.372874] [DEBUG] [VALIDATOR ] UTZ: Validating primary data. [2025-09-17T22:22:20.420855] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-11. [2025-09-17T22:22:20.818864] [DEBUG] [VALIDATOR ] UTZ: All expected trading days are present. [2025-09-17T22:22:20.819049] [DEBUG] [VALIDATOR ] UTZ: Primary data validation passed. [2025-09-17T22:22:20.825361] [INFO ] [MAIN ] UTZ: Fetched primary data is valid. [2025-09-17T22:22:20.826174] [DEBUG] [LOCAL ] UTZ: Saving primary data. [2025-09-17T22:22:20.831778] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T22:22:20.836567] [DEBUG] [LOCAL ] UTZ: Trimmed 63285 records to 44821 (keeping 200 days of data) [2025-09-17T22:22:21.125705] [DEBUG] [LOCAL ] UTZ: Primary data saved (44821 records). [2025-09-17T22:22:21.125840] [INFO ] [MAIN ] UTZ: Full history saved. [2025-09-17T22:22:21.125966] [INFO ] [MAIN ] Update Progress: 2203/2371 symbols completed. UTZ took 30.5s. Estimated remaining: 24m 35s. Rate: 6.8 symbols/min [2025-09-17T22:22:21.220871] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-02. [2025-09-17T22:22:21.302361] [INFO ] [MAIN ] UZD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:22:21.311364] [DEBUG] [LOCAL ] UZD: Loaded 6403 existing records from primary storage. [2025-09-17T22:22:21.311456] [INFO ] [MAIN ] UZD: Loaded 6403 existing records. [2025-09-17T22:22:21.495626] [WARN ] [MAIN ] UZD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:22:21.495907] [INFO ] [MAIN ] UZD: Wiping existing primary data before full refresh. [2025-09-17T22:22:21.495956] [INFO ] [LOCAL ] UZD: Starting deletion of primary data. [2025-09-17T22:22:21.496344] [DEBUG] [LOCAL ] UZD: Deleted primary data file. [2025-09-17T22:22:21.496600] [INFO ] [MAIN ] UZD: Starting full primary refresh. [2025-09-17T22:22:21.953840] [INFO ] [REMOTE ] UZD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:22:22.015755] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-11. [2025-09-17T22:22:22.234975] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T22:22:22.258056] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-02 (1.04 seconds). [2025-09-17T22:22:22.814210] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-11 (0.80 seconds). [2025-09-17T22:22:22.816625] [INFO ] [REMOTE ] UZD: Fetching primary data for 2024-12. [2025-09-17T22:22:23.543473] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T22:22:23.615819] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-08. [2025-09-17T22:22:24.415788] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-03. [2025-09-17T22:22:24.611965] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T22:22:25.215797] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2024-12. [2025-09-17T22:22:25.505193] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T22:22:26.015820] [INFO ] [REMOTE ] UVE: Fetching primary data for 2025-09. [2025-09-17T22:22:26.708451] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T22:22:26.815782] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-04. [2025-09-17T22:22:26.942717] [INFO ] [REMOTE ] UVE: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T22:22:26.946595] [INFO ] [REMOTE ] UVE: Full fetch complete (29320 records). [2025-09-17T22:22:26.946819] [DEBUG] [VALIDATOR ] UVE: Validating primary data. [2025-09-17T22:22:27.377850] [DEBUG] [VALIDATOR ] UVE: All expected trading days are present. [2025-09-17T22:22:27.377967] [DEBUG] [VALIDATOR ] UVE: Primary data validation passed. [2025-09-17T22:22:27.378965] [INFO ] [MAIN ] UVE: Fetched primary data is valid. [2025-09-17T22:22:27.379038] [DEBUG] [LOCAL ] UVE: Saving primary data. [2025-09-17T22:22:27.380804] [DEBUG] [LOCAL ] UVE: Trimmed 29320 records to 21847 (keeping 200 days of data) [2025-09-17T22:22:27.534105] [DEBUG] [LOCAL ] UVE: Primary data saved (21847 records). [2025-09-17T22:22:27.534321] [INFO ] [MAIN ] UVE: Full history saved. [2025-09-17T22:22:27.534521] [INFO ] [MAIN ] Update Progress: 2204/2371 symbols completed. UVE took 36.9s. Estimated remaining: 24m 26s. Rate: 6.8 symbols/min [2025-09-17T22:22:27.621020] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-01. [2025-09-17T22:22:27.735210] [INFO ] [MAIN ] UZE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:22:27.750016] [DEBUG] [LOCAL ] UZE: Loaded 7506 existing records from primary storage. [2025-09-17T22:22:27.750264] [INFO ] [MAIN ] UZE: Loaded 7506 existing records. [2025-09-17T22:22:28.032297] [WARN ] [MAIN ] UZE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:22:28.032874] [INFO ] [MAIN ] UZE: Wiping existing primary data before full refresh. [2025-09-17T22:22:28.032940] [INFO ] [LOCAL ] UZE: Starting deletion of primary data. [2025-09-17T22:22:28.033556] [DEBUG] [LOCAL ] UZE: Deleted primary data file. [2025-09-17T22:22:28.033623] [INFO ] [MAIN ] UZE: Starting full primary refresh. [2025-09-17T22:22:28.416054] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-01. [2025-09-17T22:22:28.423269] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T22:22:28.475025] [INFO ] [REMOTE ] UZE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:22:29.209377] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-01 (0.79 seconds). [2025-09-17T22:22:29.215731] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-11. [2025-09-17T22:22:29.363404] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T22:22:29.939518] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T22:22:30.015839] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-02. [2025-09-17T22:22:30.652940] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T22:22:30.815777] [INFO ] [REMOTE ] UZE: Fetching primary data for 2024-12. [2025-09-17T22:22:31.611418] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T22:22:31.615685] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-03. [2025-09-17T22:22:32.284688] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T22:22:32.415825] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-01. [2025-09-17T22:22:33.150384] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T22:22:33.215822] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-04. [2025-09-17T22:22:33.953753] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-04 (0.74 seconds). [2025-09-17T22:22:34.016006] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-05. [2025-09-17T22:22:34.815753] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-02. [2025-09-17T22:22:35.208775] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-05 (1.19 seconds). [2025-09-17T22:22:35.615830] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-05. [2025-09-17T22:22:36.165300] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-05 (0.55 seconds). [2025-09-17T22:22:36.421112] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-06. [2025-09-17T22:22:36.435191] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-02 (1.62 seconds). [2025-09-17T22:22:37.138028] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-06 (0.72 seconds). [2025-09-17T22:22:37.215801] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-07. [2025-09-17T22:22:37.609057] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-07 (0.39 seconds). [2025-09-17T22:22:38.015998] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-06. [2025-09-17T22:22:38.815856] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-08. [2025-09-17T22:22:39.145443] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T22:22:39.615791] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-07. [2025-09-17T22:22:39.772456] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-08 (0.96 seconds). [2025-09-17T22:22:40.415813] [INFO ] [REMOTE ] UZD: Fetching primary data for 2025-09. [2025-09-17T22:22:40.839111] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T22:22:40.860315] [INFO ] [REMOTE ] UZD: Incremental fetch complete for 2025-09 (0.44 seconds). [2025-09-17T22:22:40.861908] [INFO ] [REMOTE ] UZD: Full fetch complete (9715 records). [2025-09-17T22:22:40.861993] [DEBUG] [VALIDATOR ] UZD: Validating primary data. [2025-09-17T22:22:41.226856] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-08. [2025-09-17T22:22:41.277031] [DEBUG] [VALIDATOR ] UZD: All expected trading days are present. [2025-09-17T22:22:41.277126] [DEBUG] [VALIDATOR ] UZD: Primary data validation passed. [2025-09-17T22:22:41.277392] [INFO ] [MAIN ] UZD: Fetched primary data is valid. [2025-09-17T22:22:41.277431] [DEBUG] [LOCAL ] UZD: Saving primary data. [2025-09-17T22:22:41.277995] [DEBUG] [LOCAL ] UZD: Trimmed 9715 records to 6377 (keeping 200 days of data) [2025-09-17T22:22:41.323967] [DEBUG] [LOCAL ] UZD: Primary data saved (6377 records). [2025-09-17T22:22:41.324146] [INFO ] [MAIN ] UZD: Full history saved. [2025-09-17T22:22:41.324260] [INFO ] [MAIN ] Update Progress: 2205/2371 symbols completed. UZD took 20.2s. Estimated remaining: 24m 17s. Rate: 6.8 symbols/min [2025-09-17T22:22:41.508026] [INFO ] [MAIN ] UZF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:22:41.517576] [DEBUG] [LOCAL ] UZF: Loaded 6559 existing records from primary storage. [2025-09-17T22:22:41.517738] [INFO ] [MAIN ] UZF: Loaded 6559 existing records. [2025-09-17T22:22:41.709989] [WARN ] [MAIN ] UZF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:22:41.710285] [INFO ] [MAIN ] UZF: Wiping existing primary data before full refresh. [2025-09-17T22:22:41.710333] [INFO ] [LOCAL ] UZF: Starting deletion of primary data. [2025-09-17T22:22:41.710636] [DEBUG] [LOCAL ] UZF: Deleted primary data file. [2025-09-17T22:22:41.710926] [INFO ] [MAIN ] UZF: Starting full primary refresh. [2025-09-17T22:22:42.021344] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-03. [2025-09-17T22:22:42.108325] [INFO ] [REMOTE ] UZF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:22:42.445864] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-08 (1.22 seconds). [2025-09-17T22:22:42.815785] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-02. [2025-09-17T22:22:43.438292] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T22:22:43.615781] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-03. [2025-09-17T22:22:43.931856] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-03 (1.91 seconds). [2025-09-17T22:22:44.338091] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-03 (0.72 seconds). [2025-09-17T22:22:44.415795] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-04. [2025-09-17T22:22:45.215782] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-04. [2025-09-17T22:22:45.980715] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-04 (0.76 seconds). [2025-09-17T22:22:46.015742] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-05. [2025-09-17T22:22:46.053678] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T22:22:46.815830] [INFO ] [REMOTE ] UVV: Fetching primary data for 2025-09. [2025-09-17T22:22:46.925489] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T22:22:47.615788] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-06. [2025-09-17T22:22:47.654234] [INFO ] [REMOTE ] UVV: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T22:22:47.657398] [INFO ] [REMOTE ] UVV: Full fetch complete (29435 records). [2025-09-17T22:22:47.657484] [DEBUG] [VALIDATOR ] UVV: Validating primary data. [2025-09-17T22:22:48.055763] [DEBUG] [VALIDATOR ] UVV: All expected trading days are present. [2025-09-17T22:22:48.055849] [DEBUG] [VALIDATOR ] UVV: Primary data validation passed. [2025-09-17T22:22:48.056715] [INFO ] [MAIN ] UVV: Fetched primary data is valid. [2025-09-17T22:22:48.056778] [DEBUG] [LOCAL ] UVV: Saving primary data. [2025-09-17T22:22:48.057544] [DEBUG] [LOCAL ] UVV: Trimmed 29435 records to 22239 (keeping 200 days of data) [2025-09-17T22:22:48.205834] [DEBUG] [LOCAL ] UVV: Primary data saved (22239 records). [2025-09-17T22:22:48.205996] [INFO ] [MAIN ] UVV: Full history saved. [2025-09-17T22:22:48.206121] [INFO ] [MAIN ] Update Progress: 2206/2371 symbols completed. UVV took 33.5s. Estimated remaining: 24m 9s. Rate: 6.8 symbols/min [2025-09-17T22:22:48.324745] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-06 (0.71 seconds). [2025-09-17T22:22:48.410149] [INFO ] [MAIN ] V: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:22:48.415819] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-11. [2025-09-17T22:22:48.471466] [DEBUG] [LOCAL ] V: Loaded 53763 existing records from primary storage. [2025-09-17T22:22:48.471686] [INFO ] [MAIN ] V: Loaded 53763 existing records. [2025-09-17T22:22:48.658865] [WARN ] [MAIN ] V: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:22:48.659175] [INFO ] [MAIN ] V: Wiping existing primary data before full refresh. [2025-09-17T22:22:48.659226] [INFO ] [LOCAL ] V: Starting deletion of primary data. [2025-09-17T22:22:48.660602] [DEBUG] [LOCAL ] V: Deleted primary data file. [2025-09-17T22:22:48.660691] [INFO ] [MAIN ] V: Starting full primary refresh. [2025-09-17T22:22:49.029196] [INFO ] [REMOTE ] V: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:22:49.132600] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-11 (0.72 seconds). [2025-09-17T22:22:49.215784] [INFO ] [REMOTE ] UZF: Fetching primary data for 2024-12. [2025-09-17T22:22:49.859878] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T22:22:50.015784] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-01. [2025-09-17T22:22:50.618159] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T22:22:50.815789] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-02. [2025-09-17T22:22:51.434695] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-02 (0.62 seconds). [2025-09-17T22:22:51.615815] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-03. [2025-09-17T22:22:52.344096] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-03 (0.73 seconds). [2025-09-17T22:22:52.415784] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-05. [2025-09-17T22:22:53.215792] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-04. [2025-09-17T22:22:54.015823] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-07. [2025-09-17T22:22:54.815784] [INFO ] [REMOTE ] V: Fetching primary data for 2024-11. [2025-09-17T22:22:54.995574] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T22:22:55.489940] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-05 (3.07 seconds). [2025-09-17T22:22:55.615771] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-06. [2025-09-17T22:22:56.025509] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T22:22:56.415790] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-08. [2025-09-17T22:22:57.215800] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-05. [2025-09-17T22:22:57.330608] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-08 (0.91 seconds). [2025-09-17T22:22:57.522881] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-06 (1.91 seconds). [2025-09-17T22:22:57.566015] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-11 (2.75 seconds). [2025-09-17T22:22:57.904114] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T22:22:58.015783] [INFO ] [REMOTE ] UZE: Fetching primary data for 2025-09. [2025-09-17T22:22:58.815823] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-06. [2025-09-17T22:22:59.615825] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-07. [2025-09-17T22:23:00.415828] [INFO ] [REMOTE ] V: Fetching primary data for 2024-12. [2025-09-17T22:23:01.524164] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-07 (1.91 seconds). [2025-09-17T22:23:01.537944] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-08. [2025-09-17T22:23:02.693514] [INFO ] [REMOTE ] V: Incremental fetch complete for 2024-12 (2.28 seconds). [2025-09-17T22:23:02.705204] [INFO ] [REMOTE ] V: Fetching primary data for 2025-01. [2025-09-17T22:23:03.748085] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-06 (4.93 seconds). [2025-09-17T22:23:03.750180] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-07. [2025-09-17T22:23:04.125737] [INFO ] [REMOTE ] UZE: Incremental fetch complete for 2025-09 (6.11 seconds). [2025-09-17T22:23:04.127579] [INFO ] [REMOTE ] UZE: Full fetch complete (10271 records). [2025-09-17T22:23:04.127686] [DEBUG] [VALIDATOR ] UZE: Validating primary data. [2025-09-17T22:23:04.395398] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-07 (0.65 seconds). [2025-09-17T22:23:04.415006] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-08. [2025-09-17T22:23:04.511220] [DEBUG] [VALIDATOR ] UZE: All expected trading days are present. [2025-09-17T22:23:04.511312] [DEBUG] [VALIDATOR ] UZE: Primary data validation passed. [2025-09-17T22:23:04.511571] [INFO ] [MAIN ] UZE: Fetched primary data is valid. [2025-09-17T22:23:04.511612] [DEBUG] [LOCAL ] UZE: Saving primary data. [2025-09-17T22:23:04.512085] [DEBUG] [LOCAL ] UZE: Trimmed 10271 records to 7507 (keeping 200 days of data) [2025-09-17T22:23:04.561694] [DEBUG] [LOCAL ] UZE: Primary data saved (7507 records). [2025-09-17T22:23:04.561845] [INFO ] [MAIN ] UZE: Full history saved. [2025-09-17T22:23:04.561952] [INFO ] [MAIN ] Update Progress: 2207/2371 symbols completed. UZE took 37.0s. Estimated remaining: 24m 0s. Rate: 6.8 symbols/min [2025-09-17T22:23:04.769976] [INFO ] [MAIN ] VAC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:23:04.810995] [DEBUG] [LOCAL ] VAC: Loaded 34869 existing records from primary storage. [2025-09-17T22:23:04.811151] [INFO ] [MAIN ] VAC: Loaded 34869 existing records. [2025-09-17T22:23:05.015287] [WARN ] [MAIN ] VAC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:23:05.015631] [INFO ] [MAIN ] VAC: Wiping existing primary data before full refresh. [2025-09-17T22:23:05.015735] [INFO ] [LOCAL ] VAC: Starting deletion of primary data. [2025-09-17T22:23:05.016706] [DEBUG] [LOCAL ] VAC: Deleted primary data file. [2025-09-17T22:23:05.016770] [INFO ] [MAIN ] VAC: Starting full primary refresh. [2025-09-17T22:23:05.447951] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T22:23:05.451509] [INFO ] [REMOTE ] VAC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:23:05.486072] [INFO ] [REMOTE ] UZF: Fetching primary data for 2025-09. [2025-09-17T22:23:05.489287] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-08 (3.95 seconds). [2025-09-17T22:23:05.490255] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-11. [2025-09-17T22:23:06.015774] [INFO ] [REMOTE ] UWMC: Fetching primary data for 2025-09. [2025-09-17T22:23:06.116096] [INFO ] [REMOTE ] UZF: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T22:23:06.117366] [INFO ] [REMOTE ] UZF: Full fetch complete (8823 records). [2025-09-17T22:23:06.117437] [DEBUG] [VALIDATOR ] UZF: Validating primary data. [2025-09-17T22:23:06.459523] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-01 (3.75 seconds). [2025-09-17T22:23:06.547397] [DEBUG] [VALIDATOR ] UZF: All expected trading days are present. [2025-09-17T22:23:06.547487] [DEBUG] [VALIDATOR ] UZF: Primary data validation passed. [2025-09-17T22:23:06.547723] [INFO ] [MAIN ] UZF: Fetched primary data is valid. [2025-09-17T22:23:06.547784] [DEBUG] [LOCAL ] UZF: Saving primary data. [2025-09-17T22:23:06.548248] [DEBUG] [LOCAL ] UZF: Trimmed 8823 records to 6519 (keeping 200 days of data) [2025-09-17T22:23:06.589815] [DEBUG] [LOCAL ] UZF: Primary data saved (6519 records). [2025-09-17T22:23:06.589947] [INFO ] [MAIN ] UZF: Full history saved. [2025-09-17T22:23:06.590035] [INFO ] [MAIN ] Update Progress: 2208/2371 symbols completed. UZF took 25.3s. Estimated remaining: 23m 51s. Rate: 6.8 symbols/min [2025-09-17T22:23:06.765528] [INFO ] [MAIN ] VAL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:23:06.765769] [DEBUG] [LOCAL ] VAL: No existing data file found in primary storage. [2025-09-17T22:23:06.765824] [WARN ] [MAIN ] VAL: No existing data found, performing full refresh instead. [2025-09-17T22:23:06.765983] [INFO ] [MAIN ] VAL: Wiping existing primary data before full refresh. [2025-09-17T22:23:06.766037] [INFO ] [LOCAL ] VAL: Starting deletion of primary data. [2025-09-17T22:23:06.766110] [DEBUG] [LOCAL ] VAL: No primary data file found to delete. [2025-09-17T22:23:06.766145] [INFO ] [MAIN ] VAL: Starting full primary refresh. [2025-09-17T22:23:06.822170] [INFO ] [REMOTE ] V: Fetching primary data for 2025-02. [2025-09-17T22:23:07.157599] [INFO ] [REMOTE ] VAL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:23:07.175360] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T22:23:07.615794] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-11. [2025-09-17T22:23:08.415767] [INFO ] [REMOTE ] VAC: Fetching primary data for 2024-12. [2025-09-17T22:23:08.553726] [INFO ] [REMOTE ] UWMC: Incremental fetch complete for 2025-09 (2.54 seconds). [2025-09-17T22:23:08.560751] [INFO ] [REMOTE ] UWMC: Full fetch complete (75209 records). [2025-09-17T22:23:08.560897] [DEBUG] [VALIDATOR ] UWMC: Validating primary data. [2025-09-17T22:23:08.971443] [DEBUG] [VALIDATOR ] UWMC: All expected trading days are present. [2025-09-17T22:23:08.971536] [DEBUG] [VALIDATOR ] UWMC: Primary data validation passed. [2025-09-17T22:23:08.972843] [INFO ] [MAIN ] UWMC: Fetched primary data is valid. [2025-09-17T22:23:08.972922] [DEBUG] [LOCAL ] UWMC: Saving primary data. [2025-09-17T22:23:08.975429] [DEBUG] [LOCAL ] UWMC: Trimmed 75209 records to 52717 (keeping 200 days of data) [2025-09-17T22:23:09.314632] [DEBUG] [LOCAL ] UWMC: Primary data saved (52717 records). [2025-09-17T22:23:09.314854] [INFO ] [MAIN ] UWMC: Full history saved. [2025-09-17T22:23:09.315004] [INFO ] [MAIN ] Update Progress: 2209/2371 symbols completed. UWMC took 51.7s. Estimated remaining: 23m 42s. Rate: 6.8 symbols/min [2025-09-17T22:23:09.516533] [INFO ] [MAIN ] VALE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:23:09.583163] [DEBUG] [LOCAL ] VALE: Loaded 53695 existing records from primary storage. [2025-09-17T22:23:09.583388] [INFO ] [MAIN ] VALE: Loaded 53695 existing records. [2025-09-17T22:23:09.795758] [WARN ] [MAIN ] VALE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:23:09.796453] [INFO ] [MAIN ] VALE: Wiping existing primary data before full refresh. [2025-09-17T22:23:09.796796] [INFO ] [LOCAL ] VALE: Starting deletion of primary data. [2025-09-17T22:23:09.798019] [DEBUG] [LOCAL ] VALE: Deleted primary data file. [2025-09-17T22:23:09.798088] [INFO ] [MAIN ] VALE: Starting full primary refresh. [2025-09-17T22:23:10.263840] [INFO ] [REMOTE ] VALE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:23:10.282357] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-02 (3.46 seconds). [2025-09-17T22:23:10.283202] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-11. [2025-09-17T22:23:10.301051] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-11 (2.69 seconds). [2025-09-17T22:23:10.312467] [INFO ] [REMOTE ] VAL: Fetching primary data for 2024-12. [2025-09-17T22:23:10.329394] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T22:23:10.815773] [INFO ] [REMOTE ] V: Fetching primary data for 2025-03. [2025-09-17T22:23:11.615851] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-01. [2025-09-17T22:23:12.066546] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2024-12 (1.75 seconds). [2025-09-17T22:23:12.415796] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-01. [2025-09-17T22:23:12.587804] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-11 (2.30 seconds). [2025-09-17T22:23:12.850467] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-01 (1.23 seconds). [2025-09-17T22:23:13.090468] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-03 (2.27 seconds). [2025-09-17T22:23:13.215766] [INFO ] [REMOTE ] V: Fetching primary data for 2025-04. [2025-09-17T22:23:13.979568] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T22:23:14.015772] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-02. [2025-09-17T22:23:14.815783] [INFO ] [REMOTE ] VALE: Fetching primary data for 2024-12. [2025-09-17T22:23:15.632010] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-02. [2025-09-17T22:23:15.635232] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-04 (2.42 seconds). [2025-09-17T22:23:15.677097] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T22:23:16.415795] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-03. [2025-09-17T22:23:16.995339] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2024-12 (2.18 seconds). [2025-09-17T22:23:17.066168] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T22:23:17.215807] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-01. [2025-09-17T22:23:17.888560] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T22:23:18.015797] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-04. [2025-09-17T22:23:18.815793] [INFO ] [REMOTE ] V: Fetching primary data for 2025-05. [2025-09-17T22:23:19.615777] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-03. [2025-09-17T22:23:19.881197] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-01 (2.67 seconds). [2025-09-17T22:23:19.952732] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-04 (1.94 seconds). [2025-09-17T22:23:20.415873] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-02. [2025-09-17T22:23:21.121872] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-05 (2.31 seconds). [2025-09-17T22:23:21.186527] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T22:23:21.215733] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-04. [2025-09-17T22:23:22.015778] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-05. [2025-09-17T22:23:22.395067] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-02 (1.98 seconds). [2025-09-17T22:23:22.815797] [INFO ] [REMOTE ] V: Fetching primary data for 2025-06. [2025-09-17T22:23:22.959263] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-04 (1.74 seconds). [2025-09-17T22:23:23.615891] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-03. [2025-09-17T22:23:23.725204] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T22:23:24.415803] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-06. [2025-09-17T22:23:25.158595] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-17T22:23:25.215855] [INFO ] [REMOTE ] V: Fetching primary data for 2025-07. [2025-09-17T22:23:25.740305] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-03 (2.12 seconds). [2025-09-17T22:23:26.015854] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-04. [2025-09-17T22:23:26.331475] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-06 (1.92 seconds). [2025-09-17T22:23:26.815864] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-07. [2025-09-17T22:23:27.478824] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T22:23:27.615788] [INFO ] [REMOTE ] V: Fetching primary data for 2025-08. [2025-09-17T22:23:28.237667] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-04 (2.22 seconds). [2025-09-17T22:23:28.415732] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-05. [2025-09-17T22:23:28.528841] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-07 (1.71 seconds). [2025-09-17T22:23:29.215786] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-08. [2025-09-17T22:23:29.957587] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-17T22:23:30.015740] [INFO ] [REMOTE ] V: Fetching primary data for 2025-09. [2025-09-17T22:23:30.452552] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-05 (2.04 seconds). [2025-09-17T22:23:30.703919] [INFO ] [REMOTE ] V: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T22:23:30.710821] [INFO ] [REMOTE ] V: Full fetch complete (77725 records). [2025-09-17T22:23:30.710945] [DEBUG] [VALIDATOR ] V: Validating primary data. [2025-09-17T22:23:30.815774] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-06. [2025-09-17T22:23:31.119914] [DEBUG] [VALIDATOR ] V: All expected trading days are present. [2025-09-17T22:23:31.120032] [DEBUG] [VALIDATOR ] V: Primary data validation passed. [2025-09-17T22:23:31.121142] [INFO ] [MAIN ] V: Fetched primary data is valid. [2025-09-17T22:23:31.121231] [DEBUG] [LOCAL ] V: Saving primary data. [2025-09-17T22:23:31.122883] [DEBUG] [LOCAL ] V: Trimmed 77725 records to 53763 (keeping 200 days of data) [2025-09-17T22:23:31.258997] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-08 (2.04 seconds). [2025-09-17T22:23:31.528446] [DEBUG] [LOCAL ] V: Primary data saved (53763 records). [2025-09-17T22:23:31.528590] [INFO ] [MAIN ] V: Full history saved. [2025-09-17T22:23:31.528696] [INFO ] [MAIN ] Update Progress: 2210/2371 symbols completed. V took 43.3s. Estimated remaining: 23m 34s. Rate: 6.8 symbols/min [2025-09-17T22:23:31.622314] [INFO ] [REMOTE ] VAL: Fetching primary data for 2025-09. [2025-09-17T22:23:31.710017] [INFO ] [MAIN ] VATE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:23:31.718521] [DEBUG] [LOCAL ] VATE: Loaded 5853 existing records from primary storage. [2025-09-17T22:23:31.718671] [INFO ] [MAIN ] VATE: Loaded 5853 existing records. [2025-09-17T22:23:31.902838] [WARN ] [MAIN ] VATE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:23:31.903127] [INFO ] [MAIN ] VATE: Wiping existing primary data before full refresh. [2025-09-17T22:23:31.903252] [INFO ] [LOCAL ] VATE: Starting deletion of primary data. [2025-09-17T22:23:31.903578] [DEBUG] [LOCAL ] VATE: Deleted primary data file. [2025-09-17T22:23:31.903675] [INFO ] [MAIN ] VATE: Starting full primary refresh. [2025-09-17T22:23:32.264865] [INFO ] [REMOTE ] VATE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:23:32.415799] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-11. [2025-09-17T22:23:32.857604] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-06 (2.04 seconds). [2025-09-17T22:23:32.891222] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T22:23:33.052716] [INFO ] [REMOTE ] VAL: Incremental fetch complete for 2025-09 (1.43 seconds). [2025-09-17T22:23:33.059079] [INFO ] [REMOTE ] VAL: Full fetch complete (73067 records). [2025-09-17T22:23:33.059224] [DEBUG] [VALIDATOR ] VAL: Validating primary data. [2025-09-17T22:23:33.217157] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-07. [2025-09-17T22:23:33.477491] [DEBUG] [VALIDATOR ] VAL: All expected trading days are present. [2025-09-17T22:23:33.477595] [DEBUG] [VALIDATOR ] VAL: Primary data validation passed. [2025-09-17T22:23:33.478735] [INFO ] [MAIN ] VAL: Fetched primary data is valid. [2025-09-17T22:23:33.478815] [DEBUG] [LOCAL ] VAL: Saving primary data. [2025-09-17T22:23:33.480432] [DEBUG] [LOCAL ] VAL: Trimmed 73067 records to 50555 (keeping 200 days of data) [2025-09-17T22:23:33.786395] [DEBUG] [LOCAL ] VAL: Primary data saved (50555 records). [2025-09-17T22:23:33.786559] [INFO ] [MAIN ] VAL: Full history saved. [2025-09-17T22:23:33.786666] [INFO ] [MAIN ] Update Progress: 2211/2371 symbols completed. VAL took 27.2s. Estimated remaining: 23m 25s. Rate: 6.8 symbols/min [2025-09-17T22:23:33.963884] [INFO ] [MAIN ] VBF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:23:33.972948] [DEBUG] [LOCAL ] VBF: Loaded 7160 existing records from primary storage. [2025-09-17T22:23:33.973044] [INFO ] [MAIN ] VBF: Loaded 7160 existing records. [2025-09-17T22:23:34.028175] [INFO ] [REMOTE ] VATE: Fetching primary data for 2024-12. [2025-09-17T22:23:34.155768] [WARN ] [MAIN ] VBF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:23:34.156020] [INFO ] [MAIN ] VBF: Wiping existing primary data before full refresh. [2025-09-17T22:23:34.156068] [INFO ] [LOCAL ] VBF: Starting deletion of primary data. [2025-09-17T22:23:34.156484] [DEBUG] [LOCAL ] VBF: Deleted primary data file. [2025-09-17T22:23:34.156545] [INFO ] [MAIN ] VBF: Starting full primary refresh. [2025-09-17T22:23:34.540914] [INFO ] [REMOTE ] VBF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:23:34.733380] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2024-12 (0.71 seconds). [2025-09-17T22:23:34.815807] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-01. [2025-09-17T22:23:35.478288] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-07 (2.26 seconds). [2025-09-17T22:23:35.615791] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-08. [2025-09-17T22:23:35.943263] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-01 (1.13 seconds). [2025-09-17T22:23:36.415802] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-05. [2025-09-17T22:23:37.215693] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-02. [2025-09-17T22:23:37.405426] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T22:23:37.987765] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T22:23:38.015738] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-06. [2025-09-17T22:23:38.042335] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-02 (0.83 seconds). [2025-09-17T22:23:38.815778] [INFO ] [REMOTE ] VALE: Fetching primary data for 2025-09. [2025-09-17T22:23:39.410119] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-06 (1.39 seconds). [2025-09-17T22:23:39.615816] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-11. [2025-09-17T22:23:40.362241] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-11 (0.75 seconds). [2025-09-17T22:23:40.415791] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-07. [2025-09-17T22:23:40.518465] [INFO ] [REMOTE ] VALE: Incremental fetch complete for 2025-09 (1.70 seconds). [2025-09-17T22:23:40.525491] [INFO ] [REMOTE ] VALE: Full fetch complete (77711 records). [2025-09-17T22:23:40.525633] [DEBUG] [VALIDATOR ] VALE: Validating primary data. [2025-09-17T22:23:40.929337] [DEBUG] [VALIDATOR ] VALE: All expected trading days are present. [2025-09-17T22:23:40.929486] [DEBUG] [VALIDATOR ] VALE: Primary data validation passed. [2025-09-17T22:23:40.930611] [INFO ] [MAIN ] VALE: Fetched primary data is valid. [2025-09-17T22:23:40.930704] [DEBUG] [LOCAL ] VALE: Saving primary data. [2025-09-17T22:23:40.932506] [DEBUG] [LOCAL ] VALE: Trimmed 77711 records to 53694 (keeping 200 days of data) [2025-09-17T22:23:41.223983] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-03. [2025-09-17T22:23:41.281052] [DEBUG] [LOCAL ] VALE: Primary data saved (53694 records). [2025-09-17T22:23:41.281216] [INFO ] [MAIN ] VALE: Full history saved. [2025-09-17T22:23:41.281324] [INFO ] [MAIN ] Update Progress: 2212/2371 symbols completed. VALE took 32.0s. Estimated remaining: 23m 16s. Rate: 6.8 symbols/min [2025-09-17T22:23:41.464015] [INFO ] [MAIN ] VCV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:23:41.479730] [DEBUG] [LOCAL ] VCV: Loaded 13449 existing records from primary storage. [2025-09-17T22:23:41.479885] [INFO ] [MAIN ] VCV: Loaded 13449 existing records. [2025-09-17T22:23:41.658901] [WARN ] [MAIN ] VCV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:23:41.659250] [INFO ] [MAIN ] VCV: Wiping existing primary data before full refresh. [2025-09-17T22:23:41.659310] [INFO ] [LOCAL ] VCV: Starting deletion of primary data. [2025-09-17T22:23:41.659811] [DEBUG] [LOCAL ] VCV: Deleted primary data file. [2025-09-17T22:23:41.659880] [INFO ] [MAIN ] VCV: Starting full primary refresh. [2025-09-17T22:23:42.029002] [INFO ] [REMOTE ] VCV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:23:42.021174] [INFO ] [REMOTE ] VBF: Fetching primary data for 2024-12. [2025-09-17T22:23:42.055302] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T22:23:42.101184] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-03 (0.88 seconds). [2025-09-17T22:23:42.815776] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-11. [2025-09-17T22:23:42.823565] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T22:23:43.615802] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-04. [2025-09-17T22:23:44.090924] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-11 (1.28 seconds). [2025-09-17T22:23:44.347122] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T22:23:44.415763] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-01. [2025-09-17T22:23:45.084487] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T22:23:45.215791] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-05. [2025-09-17T22:23:45.825737] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-05 (0.61 seconds). [2025-09-17T22:23:46.015789] [INFO ] [REMOTE ] VCV: Fetching primary data for 2024-12. [2025-09-17T22:23:46.815780] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-06. [2025-09-17T22:23:47.068692] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T22:23:47.445472] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-06 (0.63 seconds). [2025-09-17T22:23:47.615783] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-01. [2025-09-17T22:23:48.416730] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-07. [2025-09-17T22:23:48.420118] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T22:23:48.915186] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-07 (0.50 seconds). [2025-09-17T22:23:49.215793] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-02. [2025-09-17T22:23:50.015772] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-02. [2025-09-17T22:23:50.059847] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T22:23:50.780405] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T22:23:50.815733] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-08. [2025-09-17T22:23:51.195568] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-08 (0.38 seconds). [2025-09-17T22:23:51.615771] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-03. [2025-09-17T22:23:52.381332] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-03 (0.77 seconds). [2025-09-17T22:23:52.415740] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-04. [2025-09-17T22:23:53.079111] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-04 (0.66 seconds). [2025-09-17T22:23:53.215754] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-08. [2025-09-17T22:23:54.015794] [INFO ] [REMOTE ] VATE: Fetching primary data for 2025-09. [2025-09-17T22:23:54.548329] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T22:23:54.651820] [INFO ] [REMOTE ] VATE: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T22:23:54.653361] [INFO ] [REMOTE ] VATE: Full fetch complete (10446 records). [2025-09-17T22:23:54.653432] [DEBUG] [VALIDATOR ] VATE: Validating primary data. [2025-09-17T22:23:54.815840] [INFO ] [REMOTE ] VAC: Fetching primary data for 2025-09. [2025-09-17T22:23:55.058532] [DEBUG] [VALIDATOR ] VATE: All expected trading days are present. [2025-09-17T22:23:55.058634] [DEBUG] [VALIDATOR ] VATE: Primary data validation passed. [2025-09-17T22:23:55.058980] [INFO ] [MAIN ] VATE: Fetched primary data is valid. [2025-09-17T22:23:55.059043] [DEBUG] [LOCAL ] VATE: Saving primary data. [2025-09-17T22:23:55.059493] [DEBUG] [LOCAL ] VATE: Trimmed 10446 records to 5840 (keeping 200 days of data) [2025-09-17T22:23:55.094147] [DEBUG] [LOCAL ] VATE: Primary data saved (5840 records). [2025-09-17T22:23:55.094263] [INFO ] [MAIN ] VATE: Full history saved. [2025-09-17T22:23:55.094370] [INFO ] [MAIN ] Update Progress: 2213/2371 symbols completed. VATE took 23.6s. Estimated remaining: 23m 7s. Rate: 6.8 symbols/min [2025-09-17T22:23:55.267098] [INFO ] [MAIN ] VEEV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:23:55.326590] [DEBUG] [LOCAL ] VEEV: Loaded 47556 existing records from primary storage. [2025-09-17T22:23:55.326783] [INFO ] [MAIN ] VEEV: Loaded 47556 existing records. [2025-09-17T22:23:55.511829] [WARN ] [MAIN ] VEEV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:23:55.512114] [INFO ] [MAIN ] VEEV: Wiping existing primary data before full refresh. [2025-09-17T22:23:55.512163] [INFO ] [LOCAL ] VEEV: Starting deletion of primary data. [2025-09-17T22:23:55.513265] [DEBUG] [LOCAL ] VEEV: Deleted primary data file. [2025-09-17T22:23:55.513330] [INFO ] [MAIN ] VEEV: Starting full primary refresh. [2025-09-17T22:23:55.616418] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-03. [2025-09-17T22:23:55.885977] [INFO ] [REMOTE ] VEEV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:23:56.054193] [INFO ] [REMOTE ] VAC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T22:23:56.058531] [INFO ] [REMOTE ] VAC: Full fetch complete (47423 records). [2025-09-17T22:23:56.058675] [DEBUG] [VALIDATOR ] VAC: Validating primary data. [2025-09-17T22:23:56.419114] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-11. [2025-09-17T22:23:56.459148] [DEBUG] [VALIDATOR ] VAC: All expected trading days are present. [2025-09-17T22:23:56.459307] [DEBUG] [VALIDATOR ] VAC: Primary data validation passed. [2025-09-17T22:23:56.460353] [INFO ] [MAIN ] VAC: Fetched primary data is valid. [2025-09-17T22:23:56.460671] [DEBUG] [LOCAL ] VAC: Saving primary data. [2025-09-17T22:23:56.468977] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-03 (0.85 seconds). [2025-09-17T22:23:56.472590] [DEBUG] [LOCAL ] VAC: Trimmed 47423 records to 34824 (keeping 200 days of data) [2025-09-17T22:23:56.705421] [DEBUG] [LOCAL ] VAC: Primary data saved (34824 records). [2025-09-17T22:23:56.705563] [INFO ] [MAIN ] VAC: Full history saved. [2025-09-17T22:23:56.705671] [INFO ] [MAIN ] Update Progress: 2214/2371 symbols completed. VAC took 52.1s. Estimated remaining: 22m 58s. Rate: 6.8 symbols/min [2025-09-17T22:23:56.877758] [INFO ] [MAIN ] VEL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:23:56.893156] [DEBUG] [LOCAL ] VEL: Loaded 12933 existing records from primary storage. [2025-09-17T22:23:56.893280] [INFO ] [MAIN ] VEL: Loaded 12933 existing records. [2025-09-17T22:23:57.072592] [WARN ] [MAIN ] VEL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:23:57.072983] [INFO ] [MAIN ] VEL: Wiping existing primary data before full refresh. [2025-09-17T22:23:57.073059] [INFO ] [LOCAL ] VEL: Starting deletion of primary data. [2025-09-17T22:23:57.073531] [DEBUG] [LOCAL ] VEL: Deleted primary data file. [2025-09-17T22:23:57.073612] [INFO ] [MAIN ] VEL: Starting full primary refresh. [2025-09-17T22:23:57.220886] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-05. [2025-09-17T22:23:57.447153] [INFO ] [REMOTE ] VEL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:23:57.819567] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T22:23:58.017990] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T22:23:58.018119] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-11. [2025-09-17T22:23:58.631235] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T22:23:58.815851] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2024-12. [2025-09-17T22:23:59.615833] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-06. [2025-09-17T22:24:00.415821] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-04. [2025-09-17T22:24:00.497448] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T22:24:00.597087] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T22:24:01.215754] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-01. [2025-09-17T22:24:01.254703] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-04 (0.84 seconds). [2025-09-17T22:24:02.015790] [INFO ] [REMOTE ] VEL: Fetching primary data for 2024-12. [2025-09-17T22:24:02.815809] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-07. [2025-09-17T22:24:03.615886] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-05. [2025-09-17T22:24:03.671267] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2024-12 (1.66 seconds). [2025-09-17T22:24:03.986916] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-01 (2.77 seconds). [2025-09-17T22:24:04.240485] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T22:24:04.415817] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-01. [2025-09-17T22:24:05.215829] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-02. [2025-09-17T22:24:05.337376] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T22:24:05.655903] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-01 (1.24 seconds). [2025-09-17T22:24:06.015797] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-06. [2025-09-17T22:24:06.800170] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T22:24:06.815684] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-03. [2025-09-17T22:24:07.054489] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T22:24:07.615797] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-07. [2025-09-17T22:24:08.361777] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-07 (0.75 seconds). [2025-09-17T22:24:08.396636] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T22:24:08.415735] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-04. [2025-09-17T22:24:09.215834] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-02. [2025-09-17T22:24:09.954293] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T22:24:10.021958] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-08. [2025-09-17T22:24:10.027662] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T22:24:10.815803] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-03. [2025-09-17T22:24:11.029498] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T22:24:11.615804] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-05. [2025-09-17T22:24:11.887186] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-03 (1.07 seconds). [2025-09-17T22:24:12.415789] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-04. [2025-09-17T22:24:13.215778] [INFO ] [REMOTE ] VCV: Fetching primary data for 2025-09. [2025-09-17T22:24:13.956137] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T22:24:14.015742] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-05. [2025-09-17T22:24:14.517523] [INFO ] [REMOTE ] VCV: Incremental fetch complete for 2025-09 (1.30 seconds). [2025-09-17T22:24:14.520170] [INFO ] [REMOTE ] VCV: Full fetch complete (19805 records). [2025-09-17T22:24:14.520254] [DEBUG] [VALIDATOR ] VCV: Validating primary data. [2025-09-17T22:24:14.800101] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T22:24:14.820863] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-06. [2025-09-17T22:24:14.904098] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-05 (3.29 seconds). [2025-09-17T22:24:14.955074] [DEBUG] [VALIDATOR ] VCV: All expected trading days are present. [2025-09-17T22:24:14.955158] [DEBUG] [VALIDATOR ] VCV: Primary data validation passed. [2025-09-17T22:24:14.955698] [INFO ] [MAIN ] VCV: Fetched primary data is valid. [2025-09-17T22:24:14.955762] [DEBUG] [LOCAL ] VCV: Saving primary data. [2025-09-17T22:24:14.956421] [DEBUG] [LOCAL ] VCV: Trimmed 19805 records to 13450 (keeping 200 days of data) [2025-09-17T22:24:15.039315] [DEBUG] [LOCAL ] VCV: Primary data saved (13450 records). [2025-09-17T22:24:15.039443] [INFO ] [MAIN ] VCV: Full history saved. [2025-09-17T22:24:15.039527] [INFO ] [MAIN ] Update Progress: 2215/2371 symbols completed. VCV took 33.8s. Estimated remaining: 22m 50s. Rate: 6.8 symbols/min [2025-09-17T22:24:15.252927] [INFO ] [MAIN ] VET: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:24:15.295584] [DEBUG] [LOCAL ] VET: Loaded 44421 existing records from primary storage. [2025-09-17T22:24:15.295779] [INFO ] [MAIN ] VET: Loaded 44421 existing records. [2025-09-17T22:24:15.478900] [WARN ] [MAIN ] VET: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:24:15.479135] [INFO ] [MAIN ] VET: Wiping existing primary data before full refresh. [2025-09-17T22:24:15.479186] [INFO ] [LOCAL ] VET: Starting deletion of primary data. [2025-09-17T22:24:15.480332] [DEBUG] [LOCAL ] VET: Deleted primary data file. [2025-09-17T22:24:15.480395] [INFO ] [MAIN ] VET: Starting full primary refresh. [2025-09-17T22:24:15.622023] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-06. [2025-09-17T22:24:15.849752] [INFO ] [REMOTE ] VET: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:24:15.858981] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-06 (1.04 seconds). [2025-09-17T22:24:16.415772] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-07. [2025-09-17T22:24:17.215829] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-08. [2025-09-17T22:24:17.237571] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-07 (0.82 seconds). [2025-09-17T22:24:17.412299] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T22:24:17.783107] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-08 (0.57 seconds). [2025-09-17T22:24:18.015846] [INFO ] [REMOTE ] VBF: Fetching primary data for 2025-09. [2025-09-17T22:24:18.815828] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-11. [2025-09-17T22:24:18.949584] [INFO ] [REMOTE ] VBF: Incremental fetch complete for 2025-09 (0.93 seconds). [2025-09-17T22:24:18.952415] [INFO ] [REMOTE ] VBF: Full fetch complete (10491 records). [2025-09-17T22:24:18.952637] [DEBUG] [VALIDATOR ] VBF: Validating primary data. [2025-09-17T22:24:19.321823] [DEBUG] [VALIDATOR ] VBF: All expected trading days are present. [2025-09-17T22:24:19.321906] [DEBUG] [VALIDATOR ] VBF: Primary data validation passed. [2025-09-17T22:24:19.322188] [INFO ] [MAIN ] VBF: Fetched primary data is valid. [2025-09-17T22:24:19.322226] [DEBUG] [LOCAL ] VBF: Saving primary data. [2025-09-17T22:24:19.322700] [DEBUG] [LOCAL ] VBF: Trimmed 10491 records to 7163 (keeping 200 days of data) [2025-09-17T22:24:19.372900] [DEBUG] [LOCAL ] VBF: Primary data saved (7163 records). [2025-09-17T22:24:19.373052] [INFO ] [MAIN ] VBF: Full history saved. [2025-09-17T22:24:19.373144] [INFO ] [MAIN ] Update Progress: 2216/2371 symbols completed. VBF took 45.6s. Estimated remaining: 22m 41s. Rate: 6.8 symbols/min [2025-09-17T22:24:19.543637] [INFO ] [MAIN ] VFC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:24:19.608439] [DEBUG] [LOCAL ] VFC: Loaded 53609 existing records from primary storage. [2025-09-17T22:24:19.608695] [INFO ] [MAIN ] VFC: Loaded 53609 existing records. [2025-09-17T22:24:19.621885] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-07. [2025-09-17T22:24:19.791896] [WARN ] [MAIN ] VFC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:24:19.792164] [INFO ] [MAIN ] VFC: Wiping existing primary data before full refresh. [2025-09-17T22:24:19.792213] [INFO ] [LOCAL ] VFC: Starting deletion of primary data. [2025-09-17T22:24:19.793485] [DEBUG] [LOCAL ] VFC: Deleted primary data file. [2025-09-17T22:24:19.793546] [INFO ] [MAIN ] VFC: Starting full primary refresh. [2025-09-17T22:24:20.168005] [INFO ] [REMOTE ] VFC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:24:20.425795] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-08. [2025-09-17T22:24:20.427861] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T22:24:21.215807] [INFO ] [REMOTE ] VET: Fetching primary data for 2024-12. [2025-09-17T22:24:21.281667] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-08 (0.86 seconds). [2025-09-17T22:24:21.326639] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T22:24:22.015781] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-08. [2025-09-17T22:24:22.775386] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T22:24:22.815786] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-01. [2025-09-17T22:24:23.615860] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-11. [2025-09-17T22:24:23.884328] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T22:24:24.420872] [INFO ] [REMOTE ] VEEV: Fetching primary data for 2025-09. [2025-09-17T22:24:24.440203] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-01 (1.62 seconds). [2025-09-17T22:24:25.215782] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-02. [2025-09-17T22:24:25.322558] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T22:24:26.015796] [INFO ] [REMOTE ] VFC: Fetching primary data for 2024-12. [2025-09-17T22:24:26.133935] [INFO ] [REMOTE ] VEEV: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T22:24:26.140334] [INFO ] [REMOTE ] VEEV: Full fetch complete (68496 records). [2025-09-17T22:24:26.140463] [DEBUG] [VALIDATOR ] VEEV: Validating primary data. [2025-09-17T22:24:26.549289] [DEBUG] [VALIDATOR ] VEEV: All expected trading days are present. [2025-09-17T22:24:26.549377] [DEBUG] [VALIDATOR ] VEEV: Primary data validation passed. [2025-09-17T22:24:26.550385] [INFO ] [MAIN ] VEEV: Fetched primary data is valid. [2025-09-17T22:24:26.550452] [DEBUG] [LOCAL ] VEEV: Saving primary data. [2025-09-17T22:24:26.551921] [DEBUG] [LOCAL ] VEEV: Trimmed 68496 records to 47534 (keeping 200 days of data) [2025-09-17T22:24:26.816922] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T22:24:26.816078] [INFO ] [REMOTE ] VEL: Fetching primary data for 2025-09. [2025-09-17T22:24:26.917007] [DEBUG] [LOCAL ] VEEV: Primary data saved (47534 records). [2025-09-17T22:24:26.917256] [INFO ] [MAIN ] VEEV: Full history saved. [2025-09-17T22:24:26.919658] [INFO ] [MAIN ] Update Progress: 2217/2371 symbols completed. VEEV took 31.8s. Estimated remaining: 22m 32s. Rate: 6.8 symbols/min [2025-09-17T22:24:27.122303] [INFO ] [MAIN ] VG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:24:27.122567] [DEBUG] [LOCAL ] VG: No existing data file found in primary storage. [2025-09-17T22:24:27.122625] [WARN ] [MAIN ] VG: No existing data found, performing full refresh instead. [2025-09-17T22:24:27.122816] [INFO ] [MAIN ] VG: Wiping existing primary data before full refresh. [2025-09-17T22:24:27.122868] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-17T22:24:27.122916] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-17T22:24:27.122955] [INFO ] [MAIN ] VG: Starting full primary refresh. [2025-09-17T22:24:27.458376] [INFO ] [REMOTE ] VEL: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T22:24:27.504821] [INFO ] [REMOTE ] VEL: Full fetch complete (16427 records). [2025-09-17T22:24:27.511521] [DEBUG] [VALIDATOR ] VEL: Validating primary data. [2025-09-17T22:24:27.557422] [INFO ] [REMOTE ] VG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:24:27.618949] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-03. [2025-09-17T22:24:27.930023] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T22:24:28.018101] [DEBUG] [VALIDATOR ] VEL: All expected trading days are present. [2025-09-17T22:24:28.018265] [DEBUG] [VALIDATOR ] VEL: Primary data validation passed. [2025-09-17T22:24:28.018733] [INFO ] [MAIN ] VEL: Fetched primary data is valid. [2025-09-17T22:24:28.018818] [DEBUG] [LOCAL ] VEL: Saving primary data. [2025-09-17T22:24:28.019442] [DEBUG] [LOCAL ] VEL: Trimmed 16427 records to 12987 (keeping 200 days of data) [2025-09-17T22:24:28.100782] [DEBUG] [LOCAL ] VEL: Primary data saved (12987 records). [2025-09-17T22:24:28.100943] [INFO ] [MAIN ] VEL: Full history saved. [2025-09-17T22:24:28.101142] [INFO ] [MAIN ] Update Progress: 2218/2371 symbols completed. VEL took 31.4s. Estimated remaining: 22m 23s. Rate: 6.8 symbols/min [2025-09-17T22:24:28.276793] [INFO ] [MAIN ] VGI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:24:28.287022] [DEBUG] [LOCAL ] VGI: Loaded 5227 existing records from primary storage. [2025-09-17T22:24:28.287164] [INFO ] [MAIN ] VGI: Loaded 5227 existing records. [2025-09-17T22:24:28.420902] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-11. [2025-09-17T22:24:28.488363] [WARN ] [MAIN ] VGI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:24:28.488765] [INFO ] [MAIN ] VGI: Wiping existing primary data before full refresh. [2025-09-17T22:24:28.488848] [INFO ] [LOCAL ] VGI: Starting deletion of primary data. [2025-09-17T22:24:28.489134] [DEBUG] [LOCAL ] VGI: Deleted primary data file. [2025-09-17T22:24:28.489217] [INFO ] [MAIN ] VGI: Starting full primary refresh. [2025-09-17T22:24:28.739256] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:24:28.772518] [WARN ] [REMOTE ] VG: No data returned for month 2024-11 [2025-09-17T22:24:28.849623] [INFO ] [REMOTE ] VGI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:24:29.215805] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-01. [2025-09-17T22:24:29.451436] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T22:24:30.015786] [INFO ] [REMOTE ] VG: Fetching primary data for 2024-12. [2025-09-17T22:24:30.227599] [DEBUG] [REMOTE ] VG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:24:30.227969] [WARN ] [REMOTE ] VG: No data returned for month 2024-12 [2025-09-17T22:24:30.815821] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-04. [2025-09-17T22:24:31.110026] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T22:24:31.615777] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-11. [2025-09-17T22:24:32.209015] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-11 (0.59 seconds). [2025-09-17T22:24:32.415788] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-01. [2025-09-17T22:24:32.468499] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T22:24:33.215789] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-02. [2025-09-17T22:24:33.435179] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T22:24:34.015783] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-02. [2025-09-17T22:24:34.762386] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T22:24:34.815797] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-03. [2025-09-17T22:24:35.615754] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-05. [2025-09-17T22:24:35.784263] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T22:24:36.415808] [INFO ] [REMOTE ] VGI: Fetching primary data for 2024-12. [2025-09-17T22:24:36.626054] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-03 (1.81 seconds). [2025-09-17T22:24:37.026041] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T22:24:37.208331] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-05 (1.59 seconds). [2025-09-17T22:24:37.217832] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-03. [2025-09-17T22:24:38.015773] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-04. [2025-09-17T22:24:38.815776] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-06. [2025-09-17T22:24:39.246066] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T22:24:39.615790] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-04. [2025-09-17T22:24:40.198833] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-17T22:24:40.267936] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T22:24:40.415791] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-05. [2025-09-17T22:24:41.215807] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-01. [2025-09-17T22:24:41.697914] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T22:24:41.948943] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-01 (0.73 seconds). [2025-09-17T22:24:42.015789] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-07. [2025-09-17T22:24:42.534629] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-05 (2.12 seconds). [2025-09-17T22:24:42.815810] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-02. [2025-09-17T22:24:43.429968] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T22:24:43.615705] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-05. [2025-09-17T22:24:43.805123] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T22:24:44.415871] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-06. [2025-09-17T22:24:45.215755] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-03. [2025-09-17T22:24:45.675751] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T22:24:45.832251] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T22:24:45.910352] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T22:24:46.015735] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-07. [2025-09-17T22:24:46.815785] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-06. [2025-09-17T22:24:47.615800] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-04. [2025-09-17T22:24:48.049141] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T22:24:48.381554] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-04 (0.77 seconds). [2025-09-17T22:24:48.415741] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-05. [2025-09-17T22:24:48.980815] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-06 (2.17 seconds). [2025-09-17T22:24:49.003934] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-05 (0.59 seconds). [2025-09-17T22:24:49.215818] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-06. [2025-09-17T22:24:49.796508] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-06 (0.58 seconds). [2025-09-17T22:24:50.015799] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-07. [2025-09-17T22:24:50.633575] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-07 (0.62 seconds). [2025-09-17T22:24:50.815790] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-08. [2025-09-17T22:24:51.551687] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-08 (0.74 seconds). [2025-09-17T22:24:51.615761] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-08. [2025-09-17T22:24:52.415780] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-07. [2025-09-17T22:24:53.193205] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T22:24:53.215737] [INFO ] [REMOTE ] VET: Fetching primary data for 2025-09. [2025-09-17T22:24:54.015804] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-08. [2025-09-17T22:24:54.530740] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-07 (2.11 seconds). [2025-09-17T22:24:54.609862] [INFO ] [REMOTE ] VET: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T22:24:54.615460] [INFO ] [REMOTE ] VET: Full fetch complete (64240 records). [2025-09-17T22:24:54.615569] [DEBUG] [VALIDATOR ] VET: Validating primary data. [2025-09-17T22:24:54.820888] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-08. [2025-09-17T22:24:55.030317] [DEBUG] [VALIDATOR ] VET: All expected trading days are present. [2025-09-17T22:24:55.030401] [DEBUG] [VALIDATOR ] VET: Primary data validation passed. [2025-09-17T22:24:55.031355] [INFO ] [MAIN ] VET: Fetched primary data is valid. [2025-09-17T22:24:55.031420] [DEBUG] [LOCAL ] VET: Saving primary data. [2025-09-17T22:24:55.033531] [DEBUG] [LOCAL ] VET: Trimmed 64240 records to 44395 (keeping 200 days of data) [2025-09-17T22:24:55.307993] [DEBUG] [LOCAL ] VET: Primary data saved (44395 records). [2025-09-17T22:24:55.308161] [INFO ] [MAIN ] VET: Full history saved. [2025-09-17T22:24:55.308364] [INFO ] [MAIN ] Update Progress: 2219/2371 symbols completed. VET took 40.3s. Estimated remaining: 22m 15s. Rate: 6.8 symbols/min [2025-09-17T22:24:55.484912] [INFO ] [MAIN ] VGM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:24:55.506542] [DEBUG] [LOCAL ] VGM: Loaded 18287 existing records from primary storage. [2025-09-17T22:24:55.506694] [INFO ] [MAIN ] VGM: Loaded 18287 existing records. [2025-09-17T22:24:55.622978] [INFO ] [REMOTE ] VGI: Fetching primary data for 2025-09. [2025-09-17T22:24:55.708957] [WARN ] [MAIN ] VGM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:24:55.709288] [INFO ] [MAIN ] VGM: Wiping existing primary data before full refresh. [2025-09-17T22:24:55.709387] [INFO ] [LOCAL ] VGM: Starting deletion of primary data. [2025-09-17T22:24:55.710017] [DEBUG] [LOCAL ] VGM: Deleted primary data file. [2025-09-17T22:24:55.710084] [INFO ] [MAIN ] VGM: Starting full primary refresh. [2025-09-17T22:24:56.028210] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-08 (2.01 seconds). [2025-09-17T22:24:56.133631] [INFO ] [REMOTE ] VGM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:24:56.380633] [INFO ] [REMOTE ] VGI: Incremental fetch complete for 2025-09 (0.76 seconds). [2025-09-17T22:24:56.383252] [INFO ] [REMOTE ] VGI: Full fetch complete (7732 records). [2025-09-17T22:24:56.383327] [DEBUG] [VALIDATOR ] VGI: Validating primary data. [2025-09-17T22:24:56.420926] [INFO ] [REMOTE ] VFC: Fetching primary data for 2025-09. [2025-09-17T22:24:56.751055] [DEBUG] [VALIDATOR ] VGI: All expected trading days are present. [2025-09-17T22:24:56.751135] [DEBUG] [VALIDATOR ] VGI: Primary data validation passed. [2025-09-17T22:24:56.751331] [INFO ] [MAIN ] VGI: Fetched primary data is valid. [2025-09-17T22:24:56.751369] [DEBUG] [LOCAL ] VGI: Saving primary data. [2025-09-17T22:24:56.751838] [DEBUG] [LOCAL ] VGI: Trimmed 7732 records to 5240 (keeping 200 days of data) [2025-09-17T22:24:56.785934] [DEBUG] [LOCAL ] VGI: Primary data saved (5240 records). [2025-09-17T22:24:56.786059] [INFO ] [MAIN ] VGI: Full history saved. [2025-09-17T22:24:56.786177] [INFO ] [MAIN ] Update Progress: 2220/2371 symbols completed. VGI took 28.7s. Estimated remaining: 22m 6s. Rate: 6.8 symbols/min [2025-09-17T22:24:56.966348] [INFO ] [MAIN ] VHC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:24:56.967515] [DEBUG] [LOCAL ] VHC: No existing data file found in primary storage. [2025-09-17T22:24:56.967570] [WARN ] [MAIN ] VHC: No existing data found, performing full refresh instead. [2025-09-17T22:24:56.967929] [INFO ] [MAIN ] VHC: Wiping existing primary data before full refresh. [2025-09-17T22:24:56.968017] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-17T22:24:56.968104] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-17T22:24:56.968161] [INFO ] [MAIN ] VHC: Starting full primary refresh. [2025-09-17T22:24:57.106494] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-08 (2.29 seconds). [2025-09-17T22:24:57.227558] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-11. [2025-09-17T22:24:57.381175] [INFO ] [REMOTE ] VHC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:24:58.015745] [INFO ] [REMOTE ] VG: Fetching primary data for 2025-09. [2025-09-17T22:24:58.354192] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-11 (1.13 seconds). [2025-09-17T22:24:58.398567] [INFO ] [REMOTE ] VFC: Incremental fetch complete for 2025-09 (1.98 seconds). [2025-09-17T22:24:58.405555] [INFO ] [REMOTE ] VFC: Full fetch complete (77426 records). [2025-09-17T22:24:58.405708] [DEBUG] [VALIDATOR ] VFC: Validating primary data. [2025-09-17T22:24:58.803589] [DEBUG] [VALIDATOR ] VFC: All expected trading days are present. [2025-09-17T22:24:58.803695] [DEBUG] [VALIDATOR ] VFC: Primary data validation passed. [2025-09-17T22:24:58.804875] [INFO ] [MAIN ] VFC: Fetched primary data is valid. [2025-09-17T22:24:58.804941] [DEBUG] [LOCAL ] VFC: Saving primary data. [2025-09-17T22:24:58.806513] [DEBUG] [LOCAL ] VFC: Trimmed 77426 records to 53610 (keeping 200 days of data) [2025-09-17T22:24:58.815748] [INFO ] [REMOTE ] VGM: Fetching primary data for 2024-12. [2025-09-17T22:24:59.153896] [DEBUG] [LOCAL ] VFC: Primary data saved (53610 records). [2025-09-17T22:24:59.154346] [INFO ] [MAIN ] VFC: Full history saved. [2025-09-17T22:24:59.156459] [INFO ] [MAIN ] Update Progress: 2221/2371 symbols completed. VFC took 39.8s. Estimated remaining: 21m 57s. Rate: 6.8 symbols/min [2025-09-17T22:24:59.331477] [INFO ] [MAIN ] VHI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:24:59.338528] [DEBUG] [LOCAL ] VHI: Loaded 2980 existing records from primary storage. [2025-09-17T22:24:59.338673] [INFO ] [MAIN ] VHI: Loaded 2980 existing records. [2025-09-17T22:24:59.521145] [WARN ] [MAIN ] VHI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:24:59.521412] [INFO ] [MAIN ] VHI: Wiping existing primary data before full refresh. [2025-09-17T22:24:59.521458] [INFO ] [LOCAL ] VHI: Starting deletion of primary data. [2025-09-17T22:24:59.521750] [DEBUG] [LOCAL ] VHI: Deleted primary data file. [2025-09-17T22:24:59.521810] [INFO ] [MAIN ] VHI: Starting full primary refresh. [2025-09-17T22:24:59.622613] [INFO ] [REMOTE ] VHC: Fetching primary data for 2024-11. [2025-09-17T22:24:59.895543] [INFO ] [REMOTE ] VHI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:24:59.908729] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T22:24:59.932220] [INFO ] [REMOTE ] VG: Incremental fetch complete for 2025-09 (1.92 seconds). [2025-09-17T22:24:59.939867] [INFO ] [REMOTE ] VG: Full fetch complete (62953 records). [2025-09-17T22:24:59.939986] [DEBUG] [VALIDATOR ] VG: Validating primary data. [2025-09-17T22:25:00.139882] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2024-11 (0.52 seconds). [2025-09-17T22:25:00.161690] [WARN ] [VALIDATOR ] VG: Validation failed - insufficient historical data. Have 163 unique days, need 200 days [2025-09-17T22:25:00.162368] [FATAL] [MAIN ] VG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:25:00.162468] [WARN ] [MAIN ] VG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:25:00.162554] [INFO ] [LOCAL ] VG: Starting deletion of primary data. [2025-09-17T22:25:00.162624] [DEBUG] [LOCAL ] VG: No primary data file found to delete. [2025-09-17T22:25:00.162702] [INFO ] [LOCAL ] VG: Starting deletion of derivative data. [2025-09-17T22:25:00.162783] [DEBUG] [LOCAL ] VG: No derivative data file found to delete. [2025-09-17T22:25:00.162892] [INFO ] [MAIN ] Update Progress: 2222/2371 symbols completed. VG took 33.2s. Estimated remaining: 21m 47s. Rate: 6.8 symbols/min [2025-09-17T22:25:00.334469] [INFO ] [MAIN ] VIA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:25:00.334615] [DEBUG] [LOCAL ] VIA: No existing data file found in primary storage. [2025-09-17T22:25:00.334679] [WARN ] [MAIN ] VIA: No existing data found, performing full refresh instead. [2025-09-17T22:25:00.334825] [INFO ] [MAIN ] VIA: Wiping existing primary data before full refresh. [2025-09-17T22:25:00.334867] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-17T22:25:00.334908] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-17T22:25:00.334939] [INFO ] [MAIN ] VIA: Starting full primary refresh. [2025-09-17T22:25:00.420866] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-01. [2025-09-17T22:25:00.734782] [INFO ] [REMOTE ] VIA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:25:01.215820] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-11. [2025-09-17T22:25:01.328872] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T22:25:01.447016] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:25:01.447360] [WARN ] [REMOTE ] VIA: No data returned for month 2024-11 [2025-09-17T22:25:02.015818] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-11. [2025-09-17T22:25:02.756747] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-11 (0.74 seconds). [2025-09-17T22:25:02.815781] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-02. [2025-09-17T22:25:03.615756] [INFO ] [REMOTE ] VHC: Fetching primary data for 2024-12. [2025-09-17T22:25:03.931976] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T22:25:04.227055] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2024-12 (0.61 seconds). [2025-09-17T22:25:04.415780] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-01. [2025-09-17T22:25:05.140026] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-01 (0.72 seconds). [2025-09-17T22:25:05.215800] [INFO ] [REMOTE ] VHI: Fetching primary data for 2024-12. [2025-09-17T22:25:05.912471] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2024-12 (0.70 seconds). [2025-09-17T22:25:06.015847] [INFO ] [REMOTE ] VIA: Fetching primary data for 2024-12. [2025-09-17T22:25:06.226350] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:25:06.226709] [WARN ] [REMOTE ] VIA: No data returned for month 2024-12 [2025-09-17T22:25:06.815829] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-02. [2025-09-17T22:25:07.183077] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-02 (0.37 seconds). [2025-09-17T22:25:07.615803] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-03. [2025-09-17T22:25:08.415775] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-01. [2025-09-17T22:25:08.559376] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-03 (0.94 seconds). [2025-09-17T22:25:09.084990] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-01 (0.67 seconds). [2025-09-17T22:25:09.215851] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-03. [2025-09-17T22:25:09.680919] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-03 (0.47 seconds). [2025-09-17T22:25:10.015850] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-01. [2025-09-17T22:25:10.223531] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:25:10.223920] [WARN ] [REMOTE ] VIA: No data returned for month 2025-01 [2025-09-17T22:25:10.815856] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-02. [2025-09-17T22:25:11.331499] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T22:25:11.615870] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-04. [2025-09-17T22:25:12.415789] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-04. [2025-09-17T22:25:12.733592] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-04 (0.32 seconds). [2025-09-17T22:25:12.735310] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-04 (1.12 seconds). [2025-09-17T22:25:13.215777] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-05. [2025-09-17T22:25:14.015793] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-05. [2025-09-17T22:25:14.394292] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-05 (0.38 seconds). [2025-09-17T22:25:14.486367] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T22:25:14.815794] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-06. [2025-09-17T22:25:15.615790] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-02. [2025-09-17T22:25:15.824187] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:25:15.824528] [WARN ] [REMOTE ] VIA: No data returned for month 2025-02 [2025-09-17T22:25:15.959409] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T22:25:16.415797] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-06. [2025-09-17T22:25:17.215759] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-07. [2025-09-17T22:25:17.253755] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T22:25:18.015760] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-07. [2025-09-17T22:25:18.307083] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T22:25:18.426329] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-07 (0.41 seconds). [2025-09-17T22:25:18.815790] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-03. [2025-09-17T22:25:19.435303] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T22:25:19.615804] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-08. [2025-09-17T22:25:20.142258] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T22:25:20.415780] [INFO ] [REMOTE ] VHC: Fetching primary data for 2025-09. [2025-09-17T22:25:20.867679] [INFO ] [REMOTE ] VHC: Incremental fetch complete for 2025-09 (0.45 seconds). [2025-09-17T22:25:20.868621] [INFO ] [REMOTE ] VHC: Full fetch complete (3750 records). [2025-09-17T22:25:20.868716] [DEBUG] [VALIDATOR ] VHC: Validating primary data. [2025-09-17T22:25:21.073674] [WARN ] [VALIDATOR ] VHC: Validation failed - insufficient historical data. Have 199 unique days, need 200 days [2025-09-17T22:25:21.073898] [FATAL] [MAIN ] VHC: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:25:21.073969] [WARN ] [MAIN ] VHC: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:25:21.074143] [INFO ] [LOCAL ] VHC: Starting deletion of primary data. [2025-09-17T22:25:21.074237] [DEBUG] [LOCAL ] VHC: No primary data file found to delete. [2025-09-17T22:25:21.074292] [INFO ] [LOCAL ] VHC: Starting deletion of derivative data. [2025-09-17T22:25:21.074343] [DEBUG] [LOCAL ] VHC: No derivative data file found to delete. [2025-09-17T22:25:21.074406] [INFO ] [MAIN ] Update Progress: 2223/2371 symbols completed. VHC took 24.3s. Estimated remaining: 21m 40s. Rate: 6.8 symbols/min [2025-09-17T22:25:21.226560] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-03. [2025-09-17T22:25:21.262314] [INFO ] [MAIN ] VICI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:25:21.320887] [DEBUG] [LOCAL ] VICI: Loaded 53647 existing records from primary storage. [2025-09-17T22:25:21.321058] [INFO ] [MAIN ] VICI: Loaded 53647 existing records. [2025-09-17T22:25:21.481683] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:25:21.491516] [WARN ] [REMOTE ] VIA: No data returned for month 2025-03 [2025-09-17T22:25:21.510532] [WARN ] [MAIN ] VICI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:25:21.510798] [INFO ] [MAIN ] VICI: Wiping existing primary data before full refresh. [2025-09-17T22:25:21.510881] [INFO ] [LOCAL ] VICI: Starting deletion of primary data. [2025-09-17T22:25:21.512547] [DEBUG] [LOCAL ] VICI: Deleted primary data file. [2025-09-17T22:25:21.512608] [INFO ] [MAIN ] VICI: Starting full primary refresh. [2025-09-17T22:25:21.876126] [INFO ] [REMOTE ] VICI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:25:22.015747] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-11. [2025-09-17T22:25:22.815812] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-04. [2025-09-17T22:25:23.386145] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T22:25:23.615820] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-04. [2025-09-17T22:25:23.744206] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-11 (1.73 seconds). [2025-09-17T22:25:23.831367] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:25:23.831808] [WARN ] [REMOTE ] VIA: No data returned for month 2025-04 [2025-09-17T22:25:24.415795] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-05. [2025-09-17T22:25:24.706128] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:25:24.706476] [WARN ] [REMOTE ] VIA: No data returned for month 2025-05 [2025-09-17T22:25:25.215816] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-05. [2025-09-17T22:25:25.709132] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-05 (0.49 seconds). [2025-09-17T22:25:26.015821] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-06. [2025-09-17T22:25:26.226345] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:25:26.226735] [WARN ] [REMOTE ] VIA: No data returned for month 2025-06 [2025-09-17T22:25:26.815786] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-07. [2025-09-17T22:25:27.032688] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:25:27.033085] [WARN ] [REMOTE ] VIA: No data returned for month 2025-07 [2025-09-17T22:25:27.615789] [INFO ] [REMOTE ] VICI: Fetching primary data for 2024-12. [2025-09-17T22:25:28.415804] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-08. [2025-09-17T22:25:29.215772] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-06. [2025-09-17T22:25:29.389560] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-08 (0.97 seconds). [2025-09-17T22:25:29.621413] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2024-12 (2.01 seconds). [2025-09-17T22:25:29.730608] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-06 (0.51 seconds). [2025-09-17T22:25:30.015818] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-08. [2025-09-17T22:25:30.225712] [DEBUG] [REMOTE ] VIA: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:25:30.226253] [WARN ] [REMOTE ] VIA: No data returned for month 2025-08 [2025-09-17T22:25:30.815808] [INFO ] [REMOTE ] VIA: Fetching primary data for 2025-09. [2025-09-17T22:25:31.566194] [INFO ] [REMOTE ] VIA: Incremental fetch complete for 2025-09 (0.75 seconds). [2025-09-17T22:25:31.568334] [INFO ] [REMOTE ] VIA: Full fetch complete (1155 records). [2025-09-17T22:25:31.568406] [DEBUG] [VALIDATOR ] VIA: Validating primary data. [2025-09-17T22:25:31.623532] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-01. [2025-09-17T22:25:31.774309] [WARN ] [VALIDATOR ] VIA: Validation failed - insufficient historical data. Have 4 unique days, need 200 days [2025-09-17T22:25:31.774535] [FATAL] [MAIN ] VIA: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:25:31.774607] [WARN ] [MAIN ] VIA: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:25:31.774703] [INFO ] [LOCAL ] VIA: Starting deletion of primary data. [2025-09-17T22:25:31.774776] [DEBUG] [LOCAL ] VIA: No primary data file found to delete. [2025-09-17T22:25:31.774814] [INFO ] [LOCAL ] VIA: Starting deletion of derivative data. [2025-09-17T22:25:31.774879] [DEBUG] [LOCAL ] VIA: No derivative data file found to delete. [2025-09-17T22:25:31.774988] [INFO ] [MAIN ] Update Progress: 2224/2371 symbols completed. VIA took 31.6s. Estimated remaining: 21m 31s. Rate: 6.8 symbols/min [2025-09-17T22:25:31.965585] [INFO ] [MAIN ] VIK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:25:32.034214] [DEBUG] [LOCAL ] VIK: Loaded 52545 existing records from primary storage. [2025-09-17T22:25:32.034384] [INFO ] [MAIN ] VIK: Loaded 52545 existing records. [2025-09-17T22:25:32.223509] [WARN ] [MAIN ] VIK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:25:32.223844] [INFO ] [MAIN ] VIK: Wiping existing primary data before full refresh. [2025-09-17T22:25:32.223902] [INFO ] [LOCAL ] VIK: Starting deletion of primary data. [2025-09-17T22:25:32.225929] [DEBUG] [LOCAL ] VIK: Deleted primary data file. [2025-09-17T22:25:32.225992] [INFO ] [MAIN ] VIK: Starting full primary refresh. [2025-09-17T22:25:32.424058] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-07. [2025-09-17T22:25:32.609629] [INFO ] [REMOTE ] VIK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:25:33.089830] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-07 (0.67 seconds). [2025-09-17T22:25:33.215835] [INFO ] [REMOTE ] VGM: Fetching primary data for 2025-09. [2025-09-17T22:25:33.576264] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-01 (1.95 seconds). [2025-09-17T22:25:34.015783] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-11. [2025-09-17T22:25:34.183522] [INFO ] [REMOTE ] VGM: Incremental fetch complete for 2025-09 (0.97 seconds). [2025-09-17T22:25:34.186915] [INFO ] [REMOTE ] VGM: Full fetch complete (26152 records). [2025-09-17T22:25:34.186995] [DEBUG] [VALIDATOR ] VGM: Validating primary data. [2025-09-17T22:25:34.567581] [DEBUG] [VALIDATOR ] VGM: All expected trading days are present. [2025-09-17T22:25:34.567706] [DEBUG] [VALIDATOR ] VGM: Primary data validation passed. [2025-09-17T22:25:34.568268] [INFO ] [MAIN ] VGM: Fetched primary data is valid. [2025-09-17T22:25:34.568329] [DEBUG] [LOCAL ] VGM: Saving primary data. [2025-09-17T22:25:34.569712] [DEBUG] [LOCAL ] VGM: Trimmed 26152 records to 18294 (keeping 200 days of data) [2025-09-17T22:25:34.688706] [DEBUG] [LOCAL ] VGM: Primary data saved (18294 records). [2025-09-17T22:25:34.688860] [INFO ] [MAIN ] VGM: Full history saved. [2025-09-17T22:25:34.688950] [INFO ] [MAIN ] Update Progress: 2225/2371 symbols completed. VGM took 39.4s. Estimated remaining: 21m 22s. Rate: 6.8 symbols/min [2025-09-17T22:25:34.821028] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-08. [2025-09-17T22:25:34.883351] [INFO ] [MAIN ] VIPS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:25:34.941437] [DEBUG] [LOCAL ] VIPS: Loaded 51406 existing records from primary storage. [2025-09-17T22:25:34.941592] [INFO ] [MAIN ] VIPS: Loaded 51406 existing records. [2025-09-17T22:25:35.144544] [WARN ] [MAIN ] VIPS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:25:35.144842] [INFO ] [MAIN ] VIPS: Wiping existing primary data before full refresh. [2025-09-17T22:25:35.144901] [INFO ] [LOCAL ] VIPS: Starting deletion of primary data. [2025-09-17T22:25:35.145995] [DEBUG] [LOCAL ] VIPS: Deleted primary data file. [2025-09-17T22:25:35.146057] [INFO ] [MAIN ] VIPS: Starting full primary refresh. [2025-09-17T22:25:35.451942] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T22:25:35.568249] [INFO ] [REMOTE ] VIPS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:25:35.615782] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-11. [2025-09-17T22:25:35.764613] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T22:25:36.415786] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-02. [2025-09-17T22:25:37.215761] [INFO ] [REMOTE ] VHI: Fetching primary data for 2025-09. [2025-09-17T22:25:37.314312] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T22:25:37.588105] [INFO ] [REMOTE ] VHI: Incremental fetch complete for 2025-09 (0.37 seconds). [2025-09-17T22:25:37.589088] [INFO ] [REMOTE ] VHI: Full fetch complete (4729 records). [2025-09-17T22:25:37.589157] [DEBUG] [VALIDATOR ] VHI: Validating primary data. [2025-09-17T22:25:37.970397] [DEBUG] [VALIDATOR ] VHI: All expected trading days are present. [2025-09-17T22:25:37.970497] [DEBUG] [VALIDATOR ] VHI: Primary data validation passed. [2025-09-17T22:25:37.970687] [INFO ] [MAIN ] VHI: Fetched primary data is valid. [2025-09-17T22:25:37.970752] [DEBUG] [LOCAL ] VHI: Saving primary data. [2025-09-17T22:25:37.971137] [DEBUG] [LOCAL ] VHI: Trimmed 4729 records to 2988 (keeping 200 days of data) [2025-09-17T22:25:37.991693] [DEBUG] [LOCAL ] VHI: Primary data saved (2988 records). [2025-09-17T22:25:37.991807] [INFO ] [MAIN ] VHI: Full history saved. [2025-09-17T22:25:37.991893] [INFO ] [MAIN ] Update Progress: 2226/2371 symbols completed. VHI took 38.8s. Estimated remaining: 21m 13s. Rate: 6.8 symbols/min [2025-09-17T22:25:38.023011] [INFO ] [REMOTE ] VIK: Fetching primary data for 2024-12. [2025-09-17T22:25:38.241324] [INFO ] [MAIN ] VIRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:25:38.293984] [DEBUG] [LOCAL ] VIRT: Loaded 47139 existing records from primary storage. [2025-09-17T22:25:38.294351] [INFO ] [MAIN ] VIRT: Loaded 47139 existing records. [2025-09-17T22:25:38.475377] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-17T22:25:38.532229] [WARN ] [MAIN ] VIRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:25:38.532540] [INFO ] [MAIN ] VIRT: Wiping existing primary data before full refresh. [2025-09-17T22:25:38.532601] [INFO ] [LOCAL ] VIRT: Starting deletion of primary data. [2025-09-17T22:25:38.533817] [DEBUG] [LOCAL ] VIRT: Deleted primary data file. [2025-09-17T22:25:38.533880] [INFO ] [MAIN ] VIRT: Starting full primary refresh. [2025-09-17T22:25:38.820891] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2024-12. [2025-09-17T22:25:38.934391] [INFO ] [REMOTE ] VIRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:25:39.615817] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-11. [2025-09-17T22:25:39.838937] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T22:25:40.415795] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-01. [2025-09-17T22:25:40.618049] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T22:25:40.784546] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-11 (1.17 seconds). [2025-09-17T22:25:41.215784] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-01. [2025-09-17T22:25:42.015790] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2024-12. [2025-09-17T22:25:42.119471] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T22:25:42.815784] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-03. [2025-09-17T22:25:42.896683] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-01 (1.68 seconds). [2025-09-17T22:25:43.203951] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2024-12 (1.19 seconds). [2025-09-17T22:25:43.615783] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-01. [2025-09-17T22:25:44.415782] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-02. [2025-09-17T22:25:44.465353] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T22:25:44.752810] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T22:25:45.215777] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-04. [2025-09-17T22:25:46.015784] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-02. [2025-09-17T22:25:46.217506] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T22:25:46.815787] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-03. [2025-09-17T22:25:47.272996] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T22:25:47.615802] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-05. [2025-09-17T22:25:47.658108] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T22:25:48.423870] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-02. [2025-09-17T22:25:48.427478] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-03 (1.61 seconds). [2025-09-17T22:25:49.215808] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-03. [2025-09-17T22:25:49.560223] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-05 (1.94 seconds). [2025-09-17T22:25:50.015781] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-06. [2025-09-17T22:25:50.227603] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T22:25:50.615322] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T22:25:50.815786] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-03. [2025-09-17T22:25:51.615816] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-04. [2025-09-17T22:25:51.974687] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-06 (1.96 seconds). [2025-09-17T22:25:52.415759] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-07. [2025-09-17T22:25:52.520553] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T22:25:53.215839] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-04. [2025-09-17T22:25:53.364270] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-04 (1.75 seconds). [2025-09-17T22:25:54.015821] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-05. [2025-09-17T22:25:54.265700] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T22:25:54.815787] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-08. [2025-09-17T22:25:54.997627] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T22:25:55.615805] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-05. [2025-09-17T22:25:55.670203] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T22:25:56.415830] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-06. [2025-09-17T22:25:56.724948] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T22:25:57.215818] [INFO ] [REMOTE ] VICI: Fetching primary data for 2025-09. [2025-09-17T22:25:57.401049] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-05 (1.79 seconds). [2025-09-17T22:25:57.787220] [INFO ] [REMOTE ] VICI: Incremental fetch complete for 2025-09 (0.57 seconds). [2025-09-17T22:25:57.794693] [INFO ] [REMOTE ] VICI: Full fetch complete (77505 records). [2025-09-17T22:25:57.794826] [DEBUG] [VALIDATOR ] VICI: Validating primary data. [2025-09-17T22:25:58.021023] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-04. [2025-09-17T22:25:58.219381] [DEBUG] [VALIDATOR ] VICI: All expected trading days are present. [2025-09-17T22:25:58.219493] [DEBUG] [VALIDATOR ] VICI: Primary data validation passed. [2025-09-17T22:25:58.220612] [INFO ] [MAIN ] VICI: Fetched primary data is valid. [2025-09-17T22:25:58.220791] [DEBUG] [LOCAL ] VICI: Saving primary data. [2025-09-17T22:25:58.237042] [DEBUG] [LOCAL ] VICI: Trimmed 77505 records to 53648 (keeping 200 days of data) [2025-09-17T22:25:58.248346] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T22:25:58.594225] [DEBUG] [LOCAL ] VICI: Primary data saved (53648 records). [2025-09-17T22:25:58.594402] [INFO ] [MAIN ] VICI: Full history saved. [2025-09-17T22:25:58.594526] [INFO ] [MAIN ] Update Progress: 2227/2371 symbols completed. VICI took 37.5s. Estimated remaining: 21m 5s. Rate: 6.8 symbols/min [2025-09-17T22:25:58.784507] [INFO ] [MAIN ] VIST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:25:58.827699] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-07. [2025-09-17T22:25:58.830731] [DEBUG] [LOCAL ] VIST: Loaded 45918 existing records from primary storage. [2025-09-17T22:25:58.830910] [INFO ] [MAIN ] VIST: Loaded 45918 existing records. [2025-09-17T22:25:59.029048] [WARN ] [MAIN ] VIST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:25:59.029342] [INFO ] [MAIN ] VIST: Wiping existing primary data before full refresh. [2025-09-17T22:25:59.029401] [INFO ] [LOCAL ] VIST: Starting deletion of primary data. [2025-09-17T22:25:59.030719] [DEBUG] [LOCAL ] VIST: Deleted primary data file. [2025-09-17T22:25:59.030800] [INFO ] [MAIN ] VIST: Starting full primary refresh. [2025-09-17T22:25:59.428426] [INFO ] [REMOTE ] VIST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:25:59.615800] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-11. [2025-09-17T22:25:59.903844] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-04 (1.88 seconds). [2025-09-17T22:26:00.415831] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-05. [2025-09-17T22:26:00.672800] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T22:26:01.215785] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-08. [2025-09-17T22:26:01.393841] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T22:26:02.015908] [INFO ] [REMOTE ] VIST: Fetching primary data for 2024-12. [2025-09-17T22:26:02.323887] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T22:26:02.819929] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-06. [2025-09-17T22:26:02.833756] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T22:26:03.297053] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T22:26:03.615853] [INFO ] [REMOTE ] VIRT: Fetching primary data for 2025-09. [2025-09-17T22:26:04.415783] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-01. [2025-09-17T22:26:04.709810] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T22:26:05.149250] [INFO ] [REMOTE ] VIRT: Incremental fetch complete for 2025-09 (1.53 seconds). [2025-09-17T22:26:05.155809] [INFO ] [REMOTE ] VIRT: Full fetch complete (66734 records). [2025-09-17T22:26:05.155981] [DEBUG] [VALIDATOR ] VIRT: Validating primary data. [2025-09-17T22:26:05.229143] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-07. [2025-09-17T22:26:05.573271] [DEBUG] [VALIDATOR ] VIRT: All expected trading days are present. [2025-09-17T22:26:05.573376] [DEBUG] [VALIDATOR ] VIRT: Primary data validation passed. [2025-09-17T22:26:05.574520] [INFO ] [MAIN ] VIRT: Fetched primary data is valid. [2025-09-17T22:26:05.574607] [DEBUG] [LOCAL ] VIRT: Saving primary data. [2025-09-17T22:26:05.576177] [DEBUG] [LOCAL ] VIRT: Trimmed 66734 records to 47088 (keeping 200 days of data) [2025-09-17T22:26:05.889404] [DEBUG] [LOCAL ] VIRT: Primary data saved (47088 records). [2025-09-17T22:26:05.889548] [INFO ] [MAIN ] VIRT: Full history saved. [2025-09-17T22:26:05.890485] [INFO ] [MAIN ] Update Progress: 2228/2371 symbols completed. VIRT took 27.9s. Estimated remaining: 20m 56s. Rate: 6.8 symbols/min [2025-09-17T22:26:06.017051] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-06. [2025-09-17T22:26:06.083683] [INFO ] [MAIN ] VIV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:26:06.117944] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T22:26:06.178137] [DEBUG] [LOCAL ] VIV: Loaded 45523 existing records from primary storage. [2025-09-17T22:26:06.178316] [INFO ] [MAIN ] VIV: Loaded 45523 existing records. [2025-09-17T22:26:06.361405] [WARN ] [MAIN ] VIV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:26:06.361725] [INFO ] [MAIN ] VIV: Wiping existing primary data before full refresh. [2025-09-17T22:26:06.361789] [INFO ] [LOCAL ] VIV: Starting deletion of primary data. [2025-09-17T22:26:06.362803] [DEBUG] [LOCAL ] VIV: Deleted primary data file. [2025-09-17T22:26:06.362864] [INFO ] [MAIN ] VIV: Starting full primary refresh. [2025-09-17T22:26:06.735930] [INFO ] [REMOTE ] VIV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:26:06.815833] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-11. [2025-09-17T22:26:07.081113] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T22:26:07.310330] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-06 (1.29 seconds). [2025-09-17T22:26:07.615805] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-08. [2025-09-17T22:26:08.354405] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T22:26:08.415738] [INFO ] [REMOTE ] VIV: Fetching primary data for 2024-12. [2025-09-17T22:26:09.215834] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-02. [2025-09-17T22:26:09.482108] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T22:26:10.015829] [INFO ] [REMOTE ] VIK: Fetching primary data for 2025-09. [2025-09-17T22:26:10.063577] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T22:26:10.815811] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-01. [2025-09-17T22:26:10.857309] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T22:26:11.569954] [INFO ] [REMOTE ] VIK: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T22:26:11.578773] [INFO ] [REMOTE ] VIK: Full fetch complete (75710 records). [2025-09-17T22:26:11.578967] [DEBUG] [VALIDATOR ] VIK: Validating primary data. [2025-09-17T22:26:11.624455] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-07. [2025-09-17T22:26:12.001227] [DEBUG] [VALIDATOR ] VIK: All expected trading days are present. [2025-09-17T22:26:12.001315] [DEBUG] [VALIDATOR ] VIK: Primary data validation passed. [2025-09-17T22:26:12.002569] [INFO ] [MAIN ] VIK: Fetched primary data is valid. [2025-09-17T22:26:12.002665] [DEBUG] [LOCAL ] VIK: Saving primary data. [2025-09-17T22:26:12.004491] [DEBUG] [LOCAL ] VIK: Trimmed 75710 records to 52526 (keeping 200 days of data) [2025-09-17T22:26:12.371347] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T22:26:12.387840] [DEBUG] [LOCAL ] VIK: Primary data saved (52526 records). [2025-09-17T22:26:12.387959] [INFO ] [MAIN ] VIK: Full history saved. [2025-09-17T22:26:12.388844] [INFO ] [MAIN ] Update Progress: 2229/2371 symbols completed. VIK took 40.6s. Estimated remaining: 20m 47s. Rate: 6.8 symbols/min [2025-09-17T22:26:12.423161] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-03. [2025-09-17T22:26:12.581315] [INFO ] [MAIN ] VKQ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:26:12.606739] [DEBUG] [LOCAL ] VKQ: Loaded 17541 existing records from primary storage. [2025-09-17T22:26:12.606919] [INFO ] [MAIN ] VKQ: Loaded 17541 existing records. [2025-09-17T22:26:12.806312] [WARN ] [MAIN ] VKQ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:26:12.806685] [INFO ] [MAIN ] VKQ: Wiping existing primary data before full refresh. [2025-09-17T22:26:12.806754] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-17T22:26:12.807351] [DEBUG] [LOCAL ] VKQ: Deleted primary data file. [2025-09-17T22:26:12.807434] [INFO ] [MAIN ] VKQ: Starting full primary refresh. [2025-09-17T22:26:13.212002] [INFO ] [REMOTE ] VKQ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:26:13.215751] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-02. [2025-09-17T22:26:13.725614] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T22:26:14.015801] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-11. [2025-09-17T22:26:14.251482] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T22:26:14.320706] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-02 (1.10 seconds). [2025-09-17T22:26:14.715907] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-11 (0.70 seconds). [2025-09-17T22:26:14.815774] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2024-12. [2025-09-17T22:26:15.615818] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-08. [2025-09-17T22:26:15.799378] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2024-12 (0.98 seconds). [2025-09-17T22:26:16.415820] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-04. [2025-09-17T22:26:17.215791] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-03. [2025-09-17T22:26:17.323048] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-08 (1.71 seconds). [2025-09-17T22:26:18.015776] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-01. [2025-09-17T22:26:18.100593] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-04 (1.68 seconds). [2025-09-17T22:26:18.332463] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T22:26:18.815780] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-04. [2025-09-17T22:26:18.941612] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T22:26:19.615828] [INFO ] [REMOTE ] VIPS: Fetching primary data for 2025-09. [2025-09-17T22:26:20.415794] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-05. [2025-09-17T22:26:20.446317] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T22:26:21.215795] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-02. [2025-09-17T22:26:21.386101] [INFO ] [REMOTE ] VIPS: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T22:26:21.392915] [INFO ] [REMOTE ] VIPS: Full fetch complete (74459 records). [2025-09-17T22:26:21.393062] [DEBUG] [VALIDATOR ] VIPS: Validating primary data. [2025-09-17T22:26:21.807586] [DEBUG] [VALIDATOR ] VIPS: All expected trading days are present. [2025-09-17T22:26:21.807767] [DEBUG] [VALIDATOR ] VIPS: Primary data validation passed. [2025-09-17T22:26:21.809198] [INFO ] [MAIN ] VIPS: Fetched primary data is valid. [2025-09-17T22:26:21.809292] [DEBUG] [LOCAL ] VIPS: Saving primary data. [2025-09-17T22:26:21.811255] [DEBUG] [LOCAL ] VIPS: Trimmed 74459 records to 51401 (keeping 200 days of data) [2025-09-17T22:26:22.030887] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-05. [2025-09-17T22:26:22.069919] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-05 (1.65 seconds). [2025-09-17T22:26:22.173390] [DEBUG] [LOCAL ] VIPS: Primary data saved (51401 records). [2025-09-17T22:26:22.173532] [INFO ] [MAIN ] VIPS: Full history saved. [2025-09-17T22:26:22.173616] [INFO ] [MAIN ] Update Progress: 2230/2371 symbols completed. VIPS took 47.5s. Estimated remaining: 20m 38s. Rate: 6.8 symbols/min [2025-09-17T22:26:22.179582] [DEBUG] [REMOTE ] VKQ: Error fetching primary data for 2025-02: Server request status code is 503. [2025-09-17T22:26:22.244633] [WARN ] [REMOTE ] VKQ: No data returned for month 2025-02 [2025-09-17T22:26:22.352589] [INFO ] [MAIN ] VLN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:26:22.380373] [DEBUG] [LOCAL ] VLN: Loaded 27959 existing records from primary storage. [2025-09-17T22:26:22.380541] [INFO ] [MAIN ] VLN: Loaded 27959 existing records. [2025-09-17T22:26:22.557286] [WARN ] [MAIN ] VLN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:26:22.557591] [INFO ] [MAIN ] VLN: Wiping existing primary data before full refresh. [2025-09-17T22:26:22.557689] [INFO ] [LOCAL ] VLN: Starting deletion of primary data. [2025-09-17T22:26:22.558417] [DEBUG] [LOCAL ] VLN: Deleted primary data file. [2025-09-17T22:26:22.558478] [INFO ] [MAIN ] VLN: Starting full primary refresh. [2025-09-17T22:26:22.820862] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-06. [2025-09-17T22:26:22.925877] [INFO ] [REMOTE ] VLN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:26:23.265319] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T22:26:23.615777] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-11. [2025-09-17T22:26:24.423317] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-03. [2025-09-17T22:26:24.428503] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T22:26:24.852716] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T22:26:25.215789] [INFO ] [REMOTE ] VLN: Fetching primary data for 2024-12. [2025-09-17T22:26:25.409051] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T22:26:26.015792] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-04. [2025-09-17T22:26:26.815788] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-06. [2025-09-17T22:26:26.847768] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2024-12 (1.63 seconds). [2025-09-17T22:26:27.146325] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T22:26:27.615786] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-01. [2025-09-17T22:26:28.415822] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-07. [2025-09-17T22:26:28.491132] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T22:26:28.683045] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T22:26:29.215805] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-07. [2025-09-17T22:26:30.015771] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-02. [2025-09-17T22:26:30.115212] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T22:26:30.596594] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-07 (1.38 seconds). [2025-09-17T22:26:30.815789] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-05. [2025-09-17T22:26:31.130276] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T22:26:31.615806] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-03. [2025-09-17T22:26:31.782755] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T22:26:32.415751] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-06. [2025-09-17T22:26:32.790169] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T22:26:33.016498] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T22:26:33.215786] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-08. [2025-09-17T22:26:34.015781] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-04. [2025-09-17T22:26:34.815769] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-08. [2025-09-17T22:26:34.863298] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T22:26:35.270737] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T22:26:35.615795] [INFO ] [REMOTE ] VIV: Fetching primary data for 2025-09. [2025-09-17T22:26:36.415780] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-07. [2025-09-17T22:26:36.452439] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T22:26:37.081636] [INFO ] [REMOTE ] VIV: Incremental fetch complete for 2025-09 (1.47 seconds). [2025-09-17T22:26:37.088317] [INFO ] [REMOTE ] VIV: Full fetch complete (64830 records). [2025-09-17T22:26:37.088554] [DEBUG] [VALIDATOR ] VIV: Validating primary data. [2025-09-17T22:26:37.220853] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-05. [2025-09-17T22:26:37.494395] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T22:26:37.527372] [DEBUG] [VALIDATOR ] VIV: All expected trading days are present. [2025-09-17T22:26:37.527457] [DEBUG] [VALIDATOR ] VIV: Primary data validation passed. [2025-09-17T22:26:37.528517] [INFO ] [MAIN ] VIV: Fetched primary data is valid. [2025-09-17T22:26:37.528582] [DEBUG] [LOCAL ] VIV: Saving primary data. [2025-09-17T22:26:37.529853] [DEBUG] [LOCAL ] VIV: Trimmed 64830 records to 45466 (keeping 200 days of data) [2025-09-17T22:26:37.810444] [DEBUG] [LOCAL ] VIV: Primary data saved (45466 records). [2025-09-17T22:26:37.810600] [INFO ] [MAIN ] VIV: Full history saved. [2025-09-17T22:26:37.812099] [INFO ] [MAIN ] Update Progress: 2231/2371 symbols completed. VIV took 31.9s. Estimated remaining: 20m 30s. Rate: 6.8 symbols/min [2025-09-17T22:26:37.988258] [INFO ] [MAIN ] VLO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:26:38.015784] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-08. [2025-09-17T22:26:38.055580] [DEBUG] [LOCAL ] VLO: Loaded 53110 existing records from primary storage. [2025-09-17T22:26:38.055754] [INFO ] [MAIN ] VLO: Loaded 53110 existing records. [2025-09-17T22:26:38.241855] [WARN ] [MAIN ] VLO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:26:38.242097] [INFO ] [MAIN ] VLO: Wiping existing primary data before full refresh. [2025-09-17T22:26:38.242148] [INFO ] [LOCAL ] VLO: Starting deletion of primary data. [2025-09-17T22:26:38.243483] [DEBUG] [LOCAL ] VLO: Deleted primary data file. [2025-09-17T22:26:38.243544] [INFO ] [MAIN ] VLO: Starting full primary refresh. [2025-09-17T22:26:38.611633] [INFO ] [REMOTE ] VLO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:26:38.624635] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T22:26:38.815758] [INFO ] [REMOTE ] VIST: Fetching primary data for 2025-09. [2025-09-17T22:26:39.043433] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-08 (1.03 seconds). [2025-09-17T22:26:39.615776] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-06. [2025-09-17T22:26:40.237479] [INFO ] [REMOTE ] VIST: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T22:26:40.244085] [INFO ] [REMOTE ] VIST: Full fetch complete (66485 records). [2025-09-17T22:26:40.244207] [DEBUG] [VALIDATOR ] VIST: Validating primary data. [2025-09-17T22:26:40.426068] [INFO ] [REMOTE ] VKQ: Fetching primary data for 2025-09. [2025-09-17T22:26:40.685990] [DEBUG] [VALIDATOR ] VIST: All expected trading days are present. [2025-09-17T22:26:40.686072] [DEBUG] [VALIDATOR ] VIST: Primary data validation passed. [2025-09-17T22:26:40.687111] [INFO ] [MAIN ] VIST: Fetched primary data is valid. [2025-09-17T22:26:40.687175] [DEBUG] [LOCAL ] VIST: Saving primary data. [2025-09-17T22:26:40.688466] [DEBUG] [LOCAL ] VIST: Trimmed 66485 records to 45954 (keeping 200 days of data) [2025-09-17T22:26:40.802122] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T22:26:41.000011] [DEBUG] [LOCAL ] VIST: Primary data saved (45954 records). [2025-09-17T22:26:41.000189] [INFO ] [MAIN ] VIST: Full history saved. [2025-09-17T22:26:41.000306] [INFO ] [MAIN ] Update Progress: 2232/2371 symbols completed. VIST took 42.4s. Estimated remaining: 20m 21s. Rate: 6.8 symbols/min [2025-09-17T22:26:41.192499] [INFO ] [MAIN ] VLRS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:26:41.215701] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-07. [2025-09-17T22:26:41.232555] [DEBUG] [LOCAL ] VLRS: Loaded 41064 existing records from primary storage. [2025-09-17T22:26:41.232733] [INFO ] [MAIN ] VLRS: Loaded 41064 existing records. [2025-09-17T22:26:41.435967] [WARN ] [MAIN ] VLRS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:26:41.436245] [INFO ] [MAIN ] VLRS: Wiping existing primary data before full refresh. [2025-09-17T22:26:41.436296] [INFO ] [LOCAL ] VLRS: Starting deletion of primary data. [2025-09-17T22:26:41.437167] [DEBUG] [LOCAL ] VLRS: Deleted primary data file. [2025-09-17T22:26:41.437230] [INFO ] [MAIN ] VLRS: Starting full primary refresh. [2025-09-17T22:26:41.596561] [INFO ] [REMOTE ] VKQ: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T22:26:41.623049] [INFO ] [REMOTE ] VKQ: Full fetch complete (22466 records). [2025-09-17T22:26:41.640600] [DEBUG] [VALIDATOR ] VKQ: Validating primary data. [2025-09-17T22:26:42.024441] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-11. [2025-09-17T22:26:42.056731] [WARN ] [VALIDATOR ] VKQ: Validation failed - insufficient historical data. Have 181 unique days, need 200 days [2025-09-17T22:26:42.065618] [FATAL] [MAIN ] VKQ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:26:42.063601] [INFO ] [REMOTE ] VLRS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:26:42.065819] [WARN ] [MAIN ] VKQ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:26:42.066308] [INFO ] [LOCAL ] VKQ: Starting deletion of primary data. [2025-09-17T22:26:42.066404] [DEBUG] [LOCAL ] VKQ: No primary data file found to delete. [2025-09-17T22:26:42.066483] [INFO ] [LOCAL ] VKQ: Starting deletion of derivative data. [2025-09-17T22:26:42.066964] [DEBUG] [LOCAL ] VKQ: Deleted derivative data file. [2025-09-17T22:26:42.067125] [INFO ] [MAIN ] Update Progress: 2233/2371 symbols completed. VKQ took 29.7s. Estimated remaining: 20m 11s. Rate: 6.8 symbols/min [2025-09-17T22:26:42.242509] [INFO ] [MAIN ] VLT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:26:42.250102] [DEBUG] [LOCAL ] VLT: Loaded 4731 existing records from primary storage. [2025-09-17T22:26:42.250214] [INFO ] [MAIN ] VLT: Loaded 4731 existing records. [2025-09-17T22:26:42.432083] [WARN ] [MAIN ] VLT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:26:42.432317] [INFO ] [MAIN ] VLT: Wiping existing primary data before full refresh. [2025-09-17T22:26:42.432364] [INFO ] [LOCAL ] VLT: Starting deletion of primary data. [2025-09-17T22:26:42.432732] [DEBUG] [LOCAL ] VLT: Deleted primary data file. [2025-09-17T22:26:42.432813] [INFO ] [MAIN ] VLT: Starting full primary refresh. [2025-09-17T22:26:42.796893] [INFO ] [REMOTE ] VLT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:26:42.815742] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-11. [2025-09-17T22:26:42.868838] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T22:26:43.426345] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T22:26:43.615762] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-08. [2025-09-17T22:26:44.020288] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-11 (2.00 seconds). [2025-09-17T22:26:44.415769] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-11. [2025-09-17T22:26:45.004444] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T22:26:45.215784] [INFO ] [REMOTE ] VLT: Fetching primary data for 2024-12. [2025-09-17T22:26:45.812929] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T22:26:45.977503] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T22:26:46.015746] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2024-12. [2025-09-17T22:26:46.815818] [INFO ] [REMOTE ] VLO: Fetching primary data for 2024-12. [2025-09-17T22:26:47.518416] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T22:26:47.615792] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-01. [2025-09-17T22:26:48.085221] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-01 (0.47 seconds). [2025-09-17T22:26:48.415793] [INFO ] [REMOTE ] VLN: Fetching primary data for 2025-09. [2025-09-17T22:26:48.771709] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2024-12 (1.96 seconds). [2025-09-17T22:26:49.215789] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-01. [2025-09-17T22:26:49.709472] [INFO ] [REMOTE ] VLN: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T22:26:49.715104] [INFO ] [REMOTE ] VLN: Full fetch complete (43407 records). [2025-09-17T22:26:49.715208] [DEBUG] [VALIDATOR ] VLN: Validating primary data. [2025-09-17T22:26:50.020982] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-02. [2025-09-17T22:26:50.108699] [DEBUG] [VALIDATOR ] VLN: All expected trading days are present. [2025-09-17T22:26:50.108803] [DEBUG] [VALIDATOR ] VLN: Primary data validation passed. [2025-09-17T22:26:50.109689] [INFO ] [MAIN ] VLN: Fetched primary data is valid. [2025-09-17T22:26:50.109776] [DEBUG] [LOCAL ] VLN: Saving primary data. [2025-09-17T22:26:50.111407] [DEBUG] [LOCAL ] VLN: Trimmed 43407 records to 28076 (keeping 200 days of data) [2025-09-17T22:26:50.300255] [DEBUG] [LOCAL ] VLN: Primary data saved (28076 records). [2025-09-17T22:26:50.300441] [INFO ] [MAIN ] VLN: Full history saved. [2025-09-17T22:26:50.300601] [INFO ] [MAIN ] Update Progress: 2234/2371 symbols completed. VLN took 28.1s. Estimated remaining: 20m 2s. Rate: 6.8 symbols/min [2025-09-17T22:26:50.496175] [INFO ] [MAIN ] VLTO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:26:50.496402] [DEBUG] [LOCAL ] VLTO: No existing data file found in primary storage. [2025-09-17T22:26:50.496459] [WARN ] [MAIN ] VLTO: No existing data found, performing full refresh instead. [2025-09-17T22:26:50.496608] [INFO ] [MAIN ] VLTO: Wiping existing primary data before full refresh. [2025-09-17T22:26:50.496708] [INFO ] [LOCAL ] VLTO: Starting deletion of primary data. [2025-09-17T22:26:50.496773] [DEBUG] [LOCAL ] VLTO: No primary data file found to delete. [2025-09-17T22:26:50.496819] [INFO ] [MAIN ] VLTO: Starting full primary refresh. [2025-09-17T22:26:50.631606] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T22:26:50.820166] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-01. [2025-09-17T22:26:50.928918] [INFO ] [REMOTE ] VLTO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:26:50.945731] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T22:26:51.615827] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-03. [2025-09-17T22:26:52.262345] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-03 (0.65 seconds). [2025-09-17T22:26:52.415820] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-02. [2025-09-17T22:26:52.971407] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-01 (2.15 seconds). [2025-09-17T22:26:53.215885] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-02. [2025-09-17T22:26:53.704370] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T22:26:54.015858] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-04. [2025-09-17T22:26:54.814498] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-04 (0.80 seconds). [2025-09-17T22:26:54.816295] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-11. [2025-09-17T22:26:55.009986] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T22:26:55.615839] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-05. [2025-09-17T22:26:56.246156] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-05 (0.63 seconds). [2025-09-17T22:26:56.415833] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-03. [2025-09-17T22:26:56.453270] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-11 (1.64 seconds). [2025-09-17T22:26:57.215797] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2024-12. [2025-09-17T22:26:58.015836] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-06. [2025-09-17T22:26:58.304620] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-03 (1.89 seconds). [2025-09-17T22:26:58.476756] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2024-12 (1.26 seconds). [2025-09-17T22:26:58.601084] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-06 (0.59 seconds). [2025-09-17T22:26:58.815783] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-01. [2025-09-17T22:26:59.615793] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-03. [2025-09-17T22:27:00.415784] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-07. [2025-09-17T22:27:00.458154] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T22:27:01.173413] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-07 (0.76 seconds). [2025-09-17T22:27:01.215820] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-02. [2025-09-17T22:27:01.267755] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-03 (1.65 seconds). [2025-09-17T22:27:02.015814] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-04. [2025-09-17T22:27:02.815766] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-04. [2025-09-17T22:27:03.615787] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-08. [2025-09-17T22:27:03.815174] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-02 (2.60 seconds). [2025-09-17T22:27:04.361525] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T22:27:04.415774] [INFO ] [REMOTE ] VLT: Fetching primary data for 2025-09. [2025-09-17T22:27:04.947816] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-04 (2.93 seconds). [2025-09-17T22:27:04.994923] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-04 (2.18 seconds). [2025-09-17T22:27:05.192573] [INFO ] [REMOTE ] VLT: Incremental fetch complete for 2025-09 (0.78 seconds). [2025-09-17T22:27:05.194094] [INFO ] [REMOTE ] VLT: Full fetch complete (7535 records). [2025-09-17T22:27:05.194169] [DEBUG] [VALIDATOR ] VLT: Validating primary data. [2025-09-17T22:27:05.225233] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-05. [2025-09-17T22:27:05.592191] [DEBUG] [VALIDATOR ] VLT: All expected trading days are present. [2025-09-17T22:27:05.592331] [DEBUG] [VALIDATOR ] VLT: Primary data validation passed. [2025-09-17T22:27:05.592553] [INFO ] [MAIN ] VLT: Fetched primary data is valid. [2025-09-17T22:27:05.592595] [DEBUG] [LOCAL ] VLT: Saving primary data. [2025-09-17T22:27:05.593025] [DEBUG] [LOCAL ] VLT: Trimmed 7535 records to 4716 (keeping 200 days of data) [2025-09-17T22:27:05.623067] [DEBUG] [LOCAL ] VLT: Primary data saved (4716 records). [2025-09-17T22:27:05.623185] [INFO ] [MAIN ] VLT: Full history saved. [2025-09-17T22:27:05.623404] [INFO ] [MAIN ] Update Progress: 2235/2371 symbols completed. VLT took 23.6s. Estimated remaining: 19m 54s. Rate: 6.8 symbols/min [2025-09-17T22:27:05.792025] [INFO ] [MAIN ] VMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:27:05.848108] [DEBUG] [LOCAL ] VMC: Loaded 44136 existing records from primary storage. [2025-09-17T22:27:05.848277] [INFO ] [MAIN ] VMC: Loaded 44136 existing records. [2025-09-17T22:27:06.021515] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-03. [2025-09-17T22:27:06.024738] [WARN ] [MAIN ] VMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:27:06.025906] [INFO ] [MAIN ] VMC: Wiping existing primary data before full refresh. [2025-09-17T22:27:06.025965] [INFO ] [LOCAL ] VMC: Starting deletion of primary data. [2025-09-17T22:27:06.027417] [DEBUG] [LOCAL ] VMC: Deleted primary data file. [2025-09-17T22:27:06.027478] [INFO ] [MAIN ] VMC: Starting full primary refresh. [2025-09-17T22:27:06.402459] [INFO ] [REMOTE ] VMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:27:06.815819] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-05. [2025-09-17T22:27:06.923282] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T22:27:07.460344] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-03 (1.44 seconds). [2025-09-17T22:27:07.615845] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-11. [2025-09-17T22:27:08.298375] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-05 (1.48 seconds). [2025-09-17T22:27:08.415790] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-04. [2025-09-17T22:27:08.800626] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T22:27:09.215849] [INFO ] [REMOTE ] VMC: Fetching primary data for 2024-12. [2025-09-17T22:27:09.863467] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-04 (1.45 seconds). [2025-09-17T22:27:10.015800] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-06. [2025-09-17T22:27:10.703034] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T22:27:10.815784] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-01. [2025-09-17T22:27:11.257728] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-06 (1.24 seconds). [2025-09-17T22:27:11.615834] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-07. [2025-09-17T22:27:12.415801] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-05. [2025-09-17T22:27:13.215788] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-06. [2025-09-17T22:27:13.461564] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-01 (2.65 seconds). [2025-09-17T22:27:14.015796] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-02. [2025-09-17T22:27:14.112017] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-17T22:27:14.662143] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-17T22:27:14.815859] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-06. [2025-09-17T22:27:15.302514] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-06 (2.09 seconds). [2025-09-17T22:27:15.612472] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T22:27:15.621025] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-07. [2025-09-17T22:27:16.007256] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-06 (1.19 seconds). [2025-09-17T22:27:16.415829] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-08. [2025-09-17T22:27:17.215868] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-03. [2025-09-17T22:27:17.557595] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T22:27:17.765222] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T22:27:18.015788] [INFO ] [REMOTE ] VLRS: Fetching primary data for 2025-09. [2025-09-17T22:27:18.721852] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-03 (1.51 seconds). [2025-09-17T22:27:18.815763] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-08. [2025-09-17T22:27:19.203496] [INFO ] [REMOTE ] VLRS: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T22:27:19.208987] [INFO ] [REMOTE ] VLRS: Full fetch complete (58764 records). [2025-09-17T22:27:19.209104] [DEBUG] [VALIDATOR ] VLRS: Validating primary data. [2025-09-17T22:27:19.598926] [DEBUG] [VALIDATOR ] VLRS: All expected trading days are present. [2025-09-17T22:27:19.599028] [DEBUG] [VALIDATOR ] VLRS: Primary data validation passed. [2025-09-17T22:27:19.599983] [INFO ] [MAIN ] VLRS: Fetched primary data is valid. [2025-09-17T22:27:19.600046] [DEBUG] [LOCAL ] VLRS: Saving primary data. [2025-09-17T22:27:19.601281] [DEBUG] [LOCAL ] VLRS: Trimmed 58764 records to 41047 (keeping 200 days of data) [2025-09-17T22:27:19.646392] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-07. [2025-09-17T22:27:19.836770] [DEBUG] [LOCAL ] VLRS: Primary data saved (41047 records). [2025-09-17T22:27:19.836931] [INFO ] [MAIN ] VLRS: Full history saved. [2025-09-17T22:27:19.837046] [INFO ] [MAIN ] Update Progress: 2236/2371 symbols completed. VLRS took 38.8s. Estimated remaining: 19m 46s. Rate: 6.8 symbols/min [2025-09-17T22:27:20.007394] [INFO ] [MAIN ] VMI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:27:20.026703] [DEBUG] [LOCAL ] VMI: Loaded 15524 existing records from primary storage. [2025-09-17T22:27:20.026834] [INFO ] [MAIN ] VMI: Loaded 15524 existing records. [2025-09-17T22:27:20.213464] [WARN ] [MAIN ] VMI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:27:20.214507] [INFO ] [MAIN ] VMI: Wiping existing primary data before full refresh. [2025-09-17T22:27:20.214563] [INFO ] [LOCAL ] VMI: Starting deletion of primary data. [2025-09-17T22:27:20.215557] [DEBUG] [LOCAL ] VMI: Deleted primary data file. [2025-09-17T22:27:20.215616] [INFO ] [MAIN ] VMI: Starting full primary refresh. [2025-09-17T22:27:20.424300] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-04. [2025-09-17T22:27:20.577180] [INFO ] [REMOTE ] VMI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:27:20.614604] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T22:27:21.215815] [INFO ] [REMOTE ] VLO: Fetching primary data for 2025-09. [2025-09-17T22:27:21.340786] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-07 (1.69 seconds). [2025-09-17T22:27:21.892615] [INFO ] [REMOTE ] VLO: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T22:27:21.899602] [INFO ] [REMOTE ] VLO: Full fetch complete (76778 records). [2025-09-17T22:27:21.899748] [DEBUG] [VALIDATOR ] VLO: Validating primary data. [2025-09-17T22:27:22.020953] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-11. [2025-09-17T22:27:22.319919] [DEBUG] [VALIDATOR ] VLO: All expected trading days are present. [2025-09-17T22:27:22.320118] [DEBUG] [VALIDATOR ] VLO: Primary data validation passed. [2025-09-17T22:27:22.321437] [INFO ] [MAIN ] VLO: Fetched primary data is valid. [2025-09-17T22:27:22.321677] [DEBUG] [LOCAL ] VLO: Saving primary data. [2025-09-17T22:27:22.323505] [DEBUG] [LOCAL ] VLO: Trimmed 76778 records to 53098 (keeping 200 days of data) [2025-09-17T22:27:22.488439] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-04 (2.06 seconds). [2025-09-17T22:27:22.731756] [DEBUG] [LOCAL ] VLO: Primary data saved (53098 records). [2025-09-17T22:27:22.731910] [INFO ] [MAIN ] VLO: Full history saved. [2025-09-17T22:27:22.732945] [INFO ] [MAIN ] Update Progress: 2237/2371 symbols completed. VLO took 44.9s. Estimated remaining: 19m 37s. Rate: 6.8 symbols/min [2025-09-17T22:27:22.815798] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-05. [2025-09-17T22:27:23.123899] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-11 (1.10 seconds). [2025-09-17T22:27:23.615824] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-08. [2025-09-17T22:27:24.415794] [INFO ] [REMOTE ] VMI: Fetching primary data for 2024-12. [2025-09-17T22:27:24.614534] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-05 (1.80 seconds). [2025-09-17T22:27:25.071562] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-08 (1.46 seconds). [2025-09-17T22:27:25.215749] [INFO ] [REMOTE ] VLTO: Fetching primary data for 2025-09. [2025-09-17T22:27:25.411687] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T22:27:25.772079] [INFO ] [REMOTE ] VLTO: Incremental fetch complete for 2025-09 (0.56 seconds). [2025-09-17T22:27:25.778145] [INFO ] [REMOTE ] VLTO: Full fetch complete (66518 records). [2025-09-17T22:27:25.778264] [DEBUG] [VALIDATOR ] VLTO: Validating primary data. [2025-09-17T22:27:26.020945] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-06. [2025-09-17T22:27:26.178090] [DEBUG] [VALIDATOR ] VLTO: All expected trading days are present. [2025-09-17T22:27:26.178189] [DEBUG] [VALIDATOR ] VLTO: Primary data validation passed. [2025-09-17T22:27:26.179361] [INFO ] [MAIN ] VLTO: Fetched primary data is valid. [2025-09-17T22:27:26.179444] [DEBUG] [LOCAL ] VLTO: Saving primary data. [2025-09-17T22:27:26.181744] [DEBUG] [LOCAL ] VLTO: Trimmed 66518 records to 46059 (keeping 200 days of data) [2025-09-17T22:27:26.470389] [DEBUG] [LOCAL ] VLTO: Primary data saved (46059 records). [2025-09-17T22:27:26.470527] [INFO ] [MAIN ] VLTO: Full history saved. [2025-09-17T22:27:26.470603] [INFO ] [MAIN ] Update Progress: 2238/2371 symbols completed. VLTO took 36.2s. Estimated remaining: 19m 27s. Rate: 6.8 symbols/min [2025-09-17T22:27:26.815784] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-01. [2025-09-17T22:27:27.726632] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T22:27:27.736165] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-07. [2025-09-17T22:27:27.744967] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-01 (0.93 seconds). [2025-09-17T22:27:28.415775] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-02. [2025-09-17T22:27:29.233101] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T22:27:29.236509] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-03. [2025-09-17T22:27:29.261416] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-07 (1.53 seconds). [2025-09-17T22:27:30.015768] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-08. [2025-09-17T22:27:30.327439] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T22:27:30.815780] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-04. [2025-09-17T22:27:31.620519] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-08 (1.60 seconds). [2025-09-17T22:27:31.630798] [INFO ] [REMOTE ] VMC: Fetching primary data for 2025-09. [2025-09-17T22:27:31.732989] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T22:27:32.209037] [INFO ] [REMOTE ] VMC: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T22:27:32.214457] [INFO ] [REMOTE ] VMC: Full fetch complete (62413 records). [2025-09-17T22:27:32.214573] [DEBUG] [VALIDATOR ] VMC: Validating primary data. [2025-09-17T22:27:32.444188] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-05. [2025-09-17T22:27:32.617043] [DEBUG] [VALIDATOR ] VMC: All expected trading days are present. [2025-09-17T22:27:32.617133] [DEBUG] [VALIDATOR ] VMC: Primary data validation passed. [2025-09-17T22:27:32.618323] [INFO ] [MAIN ] VMC: Fetched primary data is valid. [2025-09-17T22:27:32.618390] [DEBUG] [LOCAL ] VMC: Saving primary data. [2025-09-17T22:27:32.619820] [DEBUG] [LOCAL ] VMC: Trimmed 62413 records to 44086 (keeping 200 days of data) [2025-09-17T22:27:32.901031] [DEBUG] [LOCAL ] VMC: Primary data saved (44086 records). [2025-09-17T22:27:32.901165] [INFO ] [MAIN ] VMC: Full history saved. [2025-09-17T22:27:32.901253] [INFO ] [MAIN ] Update Progress: 2239/2371 symbols completed. VMC took 27.3s. Estimated remaining: 19m 19s. Rate: 6.8 symbols/min [2025-09-17T22:27:33.459747] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-05 (1.02 seconds). [2025-09-17T22:27:33.463138] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-06. [2025-09-17T22:27:34.645462] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-06 (1.18 seconds). [2025-09-17T22:27:34.649605] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-07. [2025-09-17T22:27:35.617435] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-07 (0.97 seconds). [2025-09-17T22:27:35.621409] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-08. [2025-09-17T22:27:36.448029] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T22:27:36.451847] [INFO ] [REMOTE ] VMI: Fetching primary data for 2025-09. [2025-09-17T22:27:37.583836] [INFO ] [REMOTE ] VMI: Incremental fetch complete for 2025-09 (1.13 seconds). [2025-09-17T22:27:37.590187] [INFO ] [REMOTE ] VMI: Full fetch complete (21148 records). [2025-09-17T22:27:37.590315] [DEBUG] [VALIDATOR ] VMI: Validating primary data. [2025-09-17T22:27:37.970821] [DEBUG] [VALIDATOR ] VMI: All expected trading days are present. [2025-09-17T22:27:37.970902] [DEBUG] [VALIDATOR ] VMI: Primary data validation passed. [2025-09-17T22:27:37.971353] [INFO ] [MAIN ] VMI: Fetched primary data is valid. [2025-09-17T22:27:37.971396] [DEBUG] [LOCAL ] VMI: Saving primary data. [2025-09-17T22:27:37.972024] [DEBUG] [LOCAL ] VMI: Trimmed 21148 records to 15552 (keeping 200 days of data) [2025-09-17T22:27:38.069875] [DEBUG] [LOCAL ] VMI: Primary data saved (15552 records). [2025-09-17T22:27:38.070023] [INFO ] [MAIN ] VMI: Full history saved. [2025-09-17T22:27:38.070121] [INFO ] [MAIN ] Update Progress: 2240/2371 symbols completed. VMI took 18.2s. Estimated remaining: 19m 10s. Rate: 6.8 symbols/min [2025-09-17T22:27:38.737142] [INFO ] [MAIN ] VNO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:27:38.733419] [INFO ] [MAIN ] VNCE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:27:38.815804] [INFO ] [MAIN ] VMO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:27:38.833401] [INFO ] [MAIN ] VNT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:27:38.847363] [DEBUG] [LOCAL ] VNCE: Loaded 6051 existing records from primary storage. [2025-09-17T22:27:38.847495] [INFO ] [MAIN ] VNCE: Loaded 6051 existing records. [2025-09-17T22:27:38.991388] [DEBUG] [LOCAL ] VMO: Loaded 20891 existing records from primary storage. [2025-09-17T22:27:39.019670] [INFO ] [MAIN ] VMO: Loaded 20891 existing records. [2025-09-17T22:27:39.125310] [WARN ] [MAIN ] VNCE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:27:39.136420] [DEBUG] [LOCAL ] VNT: Loaded 44405 existing records from primary storage. [2025-09-17T22:27:39.141972] [INFO ] [MAIN ] VNT: Loaded 44405 existing records. [2025-09-17T22:27:39.143049] [INFO ] [MAIN ] VNCE: Wiping existing primary data before full refresh. [2025-09-17T22:27:39.142967] [DEBUG] [LOCAL ] VNO: Loaded 48987 existing records from primary storage. [2025-09-17T22:27:39.154333] [INFO ] [MAIN ] VNO: Loaded 48987 existing records. [2025-09-17T22:27:39.148379] [INFO ] [LOCAL ] VNCE: Starting deletion of primary data. [2025-09-17T22:27:39.224406] [DEBUG] [LOCAL ] VNCE: Deleted primary data file. [2025-09-17T22:27:39.268882] [INFO ] [MAIN ] VNCE: Starting full primary refresh. [2025-09-17T22:27:39.779213] [WARN ] [MAIN ] VNO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:27:39.779079] [WARN ] [MAIN ] VMO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:27:39.803353] [INFO ] [MAIN ] VNO: Wiping existing primary data before full refresh. [2025-09-17T22:27:39.802869] [WARN ] [MAIN ] VNT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:27:39.809041] [INFO ] [LOCAL ] VNO: Starting deletion of primary data. [2025-09-17T22:27:39.809333] [INFO ] [MAIN ] VMO: Wiping existing primary data before full refresh. [2025-09-17T22:27:39.820004] [INFO ] [MAIN ] VNT: Wiping existing primary data before full refresh. [2025-09-17T22:27:39.830382] [DEBUG] [LOCAL ] VNO: Deleted primary data file. [2025-09-17T22:27:39.850058] [INFO ] [LOCAL ] VMO: Starting deletion of primary data. [2025-09-17T22:27:39.850160] [INFO ] [LOCAL ] VNT: Starting deletion of primary data. [2025-09-17T22:27:39.850263] [INFO ] [MAIN ] VNO: Starting full primary refresh. [2025-09-17T22:27:39.870423] [DEBUG] [LOCAL ] VMO: Deleted primary data file. [2025-09-17T22:27:39.870537] [DEBUG] [LOCAL ] VNT: Deleted primary data file. [2025-09-17T22:27:39.887377] [INFO ] [MAIN ] VMO: Starting full primary refresh. [2025-09-17T22:27:39.922917] [INFO ] [MAIN ] VNT: Starting full primary refresh. [2025-09-17T22:27:40.823665] [INFO ] [REMOTE ] VNCE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:27:40.880163] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-11. [2025-09-17T22:27:41.269203] [INFO ] [REMOTE ] VMO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:27:41.275271] [INFO ] [REMOTE ] VNO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:27:41.286543] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-11. [2025-09-17T22:27:41.308023] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-11. [2025-09-17T22:27:41.347309] [INFO ] [REMOTE ] VNT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:27:41.347784] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-11. [2025-09-17T22:27:41.432788] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-11 (0.55 seconds). [2025-09-17T22:27:41.433928] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2024-12. [2025-09-17T22:27:42.472263] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-11 (1.19 seconds). [2025-09-17T22:27:42.478227] [INFO ] [REMOTE ] VMO: Fetching primary data for 2024-12. [2025-09-17T22:27:42.537279] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T22:27:42.542537] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-01. [2025-09-17T22:27:42.722116] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T22:27:42.731769] [INFO ] [REMOTE ] VNT: Fetching primary data for 2024-12. [2025-09-17T22:27:43.059103] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T22:27:43.068887] [INFO ] [REMOTE ] VNO: Fetching primary data for 2024-12. [2025-09-17T22:27:43.577049] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2024-12 (1.10 seconds). [2025-09-17T22:27:43.615756] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-01. [2025-09-17T22:27:43.926824] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-01 (1.38 seconds). [2025-09-17T22:27:44.077777] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T22:27:44.263719] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T22:27:44.415802] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-01. [2025-09-17T22:27:44.691702] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T22:27:45.215840] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-01. [2025-09-17T22:27:46.015790] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-02. [2025-09-17T22:27:46.061278] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-01 (1.65 seconds). [2025-09-17T22:27:46.418394] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-01 (1.20 seconds). [2025-09-17T22:27:46.815769] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-02. [2025-09-17T22:27:46.932073] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-02 (0.92 seconds). [2025-09-17T22:27:47.615786] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-02. [2025-09-17T22:27:48.380794] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-02 (1.57 seconds). [2025-09-17T22:27:48.415737] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-03. [2025-09-17T22:27:48.759750] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T22:27:49.215783] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-03. [2025-09-17T22:27:49.819241] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T22:27:49.924337] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-03 (0.71 seconds). [2025-09-17T22:27:50.015814] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-03. [2025-09-17T22:27:50.815819] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-04. [2025-09-17T22:27:51.202000] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T22:27:51.615795] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-04. [2025-09-17T22:27:52.415779] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-04. [2025-09-17T22:27:52.540547] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T22:27:52.803730] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T22:27:53.215817] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-05. [2025-09-17T22:27:53.238036] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T22:27:54.015803] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-05. [2025-09-17T22:27:54.748075] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T22:27:54.815793] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-02. [2025-09-17T22:27:55.469232] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-05 (1.45 seconds). [2025-09-17T22:27:55.615793] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-06. [2025-09-17T22:27:56.391563] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T22:27:56.415686] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-03. [2025-09-17T22:27:57.097767] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T22:27:57.215776] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-07. [2025-09-17T22:27:58.015762] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-06. [2025-09-17T22:27:58.125163] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T22:27:58.796713] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-06 (0.78 seconds). [2025-09-17T22:27:58.798314] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-07 (1.58 seconds). [2025-09-17T22:27:58.815702] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-05. [2025-09-17T22:27:59.615794] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-04. [2025-09-17T22:27:59.958159] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-05 (1.14 seconds). [2025-09-17T22:28:00.415791] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-07. [2025-09-17T22:28:01.133705] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-07 (0.72 seconds). [2025-09-17T22:28:01.215821] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-08. [2025-09-17T22:28:01.700997] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-08 (0.49 seconds). [2025-09-17T22:28:01.813329] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-04 (2.20 seconds). [2025-09-17T22:28:02.015781] [INFO ] [REMOTE ] VNCE: Fetching primary data for 2025-09. [2025-09-17T22:28:02.815757] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-08. [2025-09-17T22:28:02.978938] [INFO ] [REMOTE ] VNCE: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T22:28:02.981997] [INFO ] [REMOTE ] VNCE: Full fetch complete (14079 records). [2025-09-17T22:28:02.982073] [DEBUG] [VALIDATOR ] VNCE: Validating primary data. [2025-09-17T22:28:03.362207] [DEBUG] [VALIDATOR ] VNCE: All expected trading days are present. [2025-09-17T22:28:03.362376] [DEBUG] [VALIDATOR ] VNCE: Primary data validation passed. [2025-09-17T22:28:03.362790] [INFO ] [MAIN ] VNCE: Fetched primary data is valid. [2025-09-17T22:28:03.362867] [DEBUG] [LOCAL ] VNCE: Saving primary data. [2025-09-17T22:28:03.363373] [DEBUG] [LOCAL ] VNCE: Trimmed 14079 records to 6181 (keeping 200 days of data) [2025-09-17T22:28:03.397866] [DEBUG] [LOCAL ] VNCE: Primary data saved (6181 records). [2025-09-17T22:28:03.397970] [INFO ] [MAIN ] VNCE: Full history saved. [2025-09-17T22:28:03.398052] [INFO ] [MAIN ] Update Progress: 2241/2371 symbols completed. VNCE took 25.3s. Estimated remaining: 19m 2s. Rate: 6.8 symbols/min [2025-09-17T22:28:03.576470] [INFO ] [MAIN ] VOC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:28:03.587212] [DEBUG] [LOCAL ] VOC: Loaded 8980 existing records from primary storage. [2025-09-17T22:28:03.587348] [INFO ] [MAIN ] VOC: Loaded 8980 existing records. [2025-09-17T22:28:03.620899] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-06. [2025-09-17T22:28:03.775050] [WARN ] [MAIN ] VOC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:28:03.775323] [INFO ] [MAIN ] VOC: Wiping existing primary data before full refresh. [2025-09-17T22:28:03.775374] [INFO ] [LOCAL ] VOC: Starting deletion of primary data. [2025-09-17T22:28:03.775757] [DEBUG] [LOCAL ] VOC: Deleted primary data file. [2025-09-17T22:28:03.775819] [INFO ] [MAIN ] VOC: Starting full primary refresh. [2025-09-17T22:28:04.142079] [INFO ] [REMOTE ] VOC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:28:04.426196] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-11. [2025-09-17T22:28:04.432586] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T22:28:04.637050] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T22:28:05.215837] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-07. [2025-09-17T22:28:05.391614] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-11 (0.97 seconds). [2025-09-17T22:28:06.015761] [INFO ] [REMOTE ] VNT: Fetching primary data for 2025-09. [2025-09-17T22:28:06.297895] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T22:28:06.815805] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-05. [2025-09-17T22:28:07.126811] [INFO ] [REMOTE ] VNT: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T22:28:07.132961] [INFO ] [REMOTE ] VNT: Full fetch complete (63426 records). [2025-09-17T22:28:07.133136] [DEBUG] [VALIDATOR ] VNT: Validating primary data. [2025-09-17T22:28:07.630338] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-08. [2025-09-17T22:28:07.710427] [DEBUG] [VALIDATOR ] VNT: All expected trading days are present. [2025-09-17T22:28:07.710567] [DEBUG] [VALIDATOR ] VNT: Primary data validation passed. [2025-09-17T22:28:07.713332] [INFO ] [MAIN ] VNT: Fetched primary data is valid. [2025-09-17T22:28:07.713445] [DEBUG] [LOCAL ] VNT: Saving primary data. [2025-09-17T22:28:07.715503] [DEBUG] [LOCAL ] VNT: Trimmed 63426 records to 44364 (keeping 200 days of data) [2025-09-17T22:28:08.116854] [DEBUG] [LOCAL ] VNT: Primary data saved (44364 records). [2025-09-17T22:28:08.117020] [INFO ] [MAIN ] VNT: Full history saved. [2025-09-17T22:28:08.117144] [INFO ] [MAIN ] Update Progress: 2242/2371 symbols completed. VNT took 30.0s. Estimated remaining: 18m 53s. Rate: 6.8 symbols/min [2025-09-17T22:28:08.374701] [INFO ] [MAIN ] VOYA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:28:08.410997] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T22:28:08.420806] [INFO ] [REMOTE ] VOC: Fetching primary data for 2024-12. [2025-09-17T22:28:08.463804] [DEBUG] [LOCAL ] VOYA: Loaded 43015 existing records from primary storage. [2025-09-17T22:28:08.463986] [INFO ] [MAIN ] VOYA: Loaded 43015 existing records. [2025-09-17T22:28:08.652917] [WARN ] [MAIN ] VOYA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:28:08.653159] [INFO ] [MAIN ] VOYA: Wiping existing primary data before full refresh. [2025-09-17T22:28:08.653207] [INFO ] [LOCAL ] VOYA: Starting deletion of primary data. [2025-09-17T22:28:08.654212] [DEBUG] [LOCAL ] VOYA: Deleted primary data file. [2025-09-17T22:28:08.654273] [INFO ] [MAIN ] VOYA: Starting full primary refresh. [2025-09-17T22:28:08.845211] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T22:28:09.054889] [INFO ] [REMOTE ] VOYA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:28:09.087214] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2024-12 (0.67 seconds). [2025-09-17T22:28:09.215806] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-11. [2025-09-17T22:28:10.015807] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-01. [2025-09-17T22:28:10.815780] [INFO ] [REMOTE ] VMO: Fetching primary data for 2025-09. [2025-09-17T22:28:10.923798] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-01 (0.91 seconds). [2025-09-17T22:28:11.023996] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T22:28:11.615797] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-06. [2025-09-17T22:28:12.049188] [INFO ] [REMOTE ] VMO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T22:28:12.053931] [INFO ] [REMOTE ] VMO: Full fetch complete (31515 records). [2025-09-17T22:28:12.054136] [DEBUG] [VALIDATOR ] VMO: Validating primary data. [2025-09-17T22:28:12.421105] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-02. [2025-09-17T22:28:12.474090] [DEBUG] [VALIDATOR ] VMO: All expected trading days are present. [2025-09-17T22:28:12.474211] [DEBUG] [VALIDATOR ] VMO: Primary data validation passed. [2025-09-17T22:28:12.475583] [INFO ] [MAIN ] VMO: Fetched primary data is valid. [2025-09-17T22:28:12.475677] [DEBUG] [LOCAL ] VMO: Saving primary data. [2025-09-17T22:28:12.477694] [DEBUG] [LOCAL ] VMO: Trimmed 31515 records to 21032 (keeping 200 days of data) [2025-09-17T22:28:12.622676] [DEBUG] [LOCAL ] VMO: Primary data saved (21032 records). [2025-09-17T22:28:12.622870] [INFO ] [MAIN ] VMO: Full history saved. [2025-09-17T22:28:12.623011] [INFO ] [MAIN ] Update Progress: 2243/2371 symbols completed. VMO took 34.6s. Estimated remaining: 18m 44s. Rate: 6.8 symbols/min [2025-09-17T22:28:12.801006] [INFO ] [MAIN ] VOYG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:28:12.801242] [DEBUG] [LOCAL ] VOYG: No existing data file found in primary storage. [2025-09-17T22:28:12.801280] [WARN ] [MAIN ] VOYG: No existing data found, performing full refresh instead. [2025-09-17T22:28:12.801453] [INFO ] [MAIN ] VOYG: Wiping existing primary data before full refresh. [2025-09-17T22:28:12.801498] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-17T22:28:12.801539] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-17T22:28:12.801572] [INFO ] [MAIN ] VOYG: Starting full primary refresh. [2025-09-17T22:28:13.186517] [INFO ] [REMOTE ] VOYG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:28:13.215846] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2024-12. [2025-09-17T22:28:13.276281] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T22:28:13.442085] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-06 (1.83 seconds). [2025-09-17T22:28:14.015818] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-03. [2025-09-17T22:28:14.538968] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T22:28:14.556777] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-03 (0.54 seconds). [2025-09-17T22:28:14.815766] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-04. [2025-09-17T22:28:15.615831] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-11. [2025-09-17T22:28:15.745175] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T22:28:15.838106] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:28:15.838499] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-11 [2025-09-17T22:28:16.415825] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-07. [2025-09-17T22:28:17.215816] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-05. [2025-09-17T22:28:18.015820] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2024-12. [2025-09-17T22:28:18.053022] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-05 (0.84 seconds). [2025-09-17T22:28:18.148535] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T22:28:18.224950] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:28:18.225270] [WARN ] [REMOTE ] VOYG: No data returned for month 2024-12 [2025-09-17T22:28:18.815782] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-06. [2025-09-17T22:28:19.609213] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-06 (0.79 seconds). [2025-09-17T22:28:19.615682] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-07. [2025-09-17T22:28:20.415760] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-01. [2025-09-17T22:28:20.531614] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-07 (0.92 seconds). [2025-09-17T22:28:21.215794] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-08. [2025-09-17T22:28:22.016262] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-01. [2025-09-17T22:28:22.023330] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T22:28:22.229223] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:28:22.229573] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-01 [2025-09-17T22:28:22.815775] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-02. [2025-09-17T22:28:22.898428] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T22:28:23.019447] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:28:23.019799] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-02 [2025-09-17T22:28:23.615803] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-03. [2025-09-17T22:28:23.999693] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:28:24.000061] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-03 [2025-09-17T22:28:24.415782] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-08. [2025-09-17T22:28:25.215847] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-02. [2025-09-17T22:28:25.226530] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T22:28:26.015785] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-04. [2025-09-17T22:28:26.226542] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:28:26.226954] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-04 [2025-09-17T22:28:26.520308] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T22:28:26.815786] [INFO ] [REMOTE ] VOC: Fetching primary data for 2025-09. [2025-09-17T22:28:27.615722] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-05. [2025-09-17T22:28:27.808678] [INFO ] [REMOTE ] VOC: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T22:28:27.810322] [INFO ] [REMOTE ] VOC: Full fetch complete (13203 records). [2025-09-17T22:28:27.810420] [DEBUG] [VALIDATOR ] VOC: Validating primary data. [2025-09-17T22:28:27.838561] [DEBUG] [REMOTE ] VOYG: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:28:27.894910] [WARN ] [REMOTE ] VOYG: No data returned for month 2025-05 [2025-09-17T22:28:28.216324] [DEBUG] [VALIDATOR ] VOC: All expected trading days are present. [2025-09-17T22:28:28.216411] [DEBUG] [VALIDATOR ] VOC: Primary data validation passed. [2025-09-17T22:28:28.216758] [INFO ] [MAIN ] VOC: Fetched primary data is valid. [2025-09-17T22:28:28.216829] [DEBUG] [LOCAL ] VOC: Saving primary data. [2025-09-17T22:28:28.217387] [DEBUG] [LOCAL ] VOC: Trimmed 13203 records to 8996 (keeping 200 days of data) [2025-09-17T22:28:28.273488] [DEBUG] [LOCAL ] VOC: Primary data saved (8996 records). [2025-09-17T22:28:28.273679] [INFO ] [MAIN ] VOC: Full history saved. [2025-09-17T22:28:28.273812] [INFO ] [MAIN ] Update Progress: 2244/2371 symbols completed. VOC took 24.9s. Estimated remaining: 18m 35s. Rate: 6.8 symbols/min [2025-09-17T22:28:28.421201] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-06. [2025-09-17T22:28:28.456889] [INFO ] [MAIN ] VPG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:28:28.475823] [DEBUG] [LOCAL ] VPG: Loaded 17220 existing records from primary storage. [2025-09-17T22:28:28.475943] [INFO ] [MAIN ] VPG: Loaded 17220 existing records. [2025-09-17T22:28:28.655590] [WARN ] [MAIN ] VPG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:28:28.655877] [INFO ] [MAIN ] VPG: Wiping existing primary data before full refresh. [2025-09-17T22:28:28.655926] [INFO ] [LOCAL ] VPG: Starting deletion of primary data. [2025-09-17T22:28:28.656488] [DEBUG] [LOCAL ] VPG: Deleted primary data file. [2025-09-17T22:28:28.656549] [INFO ] [MAIN ] VPG: Starting full primary refresh. [2025-09-17T22:28:29.014698] [INFO ] [REMOTE ] VPG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:28:29.215778] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-11. [2025-09-17T22:28:30.015754] [INFO ] [REMOTE ] VNO: Fetching primary data for 2025-09. [2025-09-17T22:28:30.057984] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T22:28:30.325279] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-11 (1.11 seconds). [2025-09-17T22:28:30.815794] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-07. [2025-09-17T22:28:31.617230] [INFO ] [REMOTE ] VNO: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T22:28:31.616194] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-03. [2025-09-17T22:28:31.627693] [INFO ] [REMOTE ] VNO: Full fetch complete (70263 records). [2025-09-17T22:28:31.628040] [DEBUG] [VALIDATOR ] VNO: Validating primary data. [2025-09-17T22:28:32.031183] [DEBUG] [VALIDATOR ] VNO: All expected trading days are present. [2025-09-17T22:28:32.031345] [DEBUG] [VALIDATOR ] VNO: Primary data validation passed. [2025-09-17T22:28:32.032603] [INFO ] [MAIN ] VNO: Fetched primary data is valid. [2025-09-17T22:28:32.032697] [DEBUG] [LOCAL ] VNO: Saving primary data. [2025-09-17T22:28:32.034338] [DEBUG] [LOCAL ] VNO: Trimmed 70263 records to 48996 (keeping 200 days of data) [2025-09-17T22:28:32.333582] [DEBUG] [LOCAL ] VNO: Primary data saved (48996 records). [2025-09-17T22:28:32.333781] [INFO ] [MAIN ] VNO: Full history saved. [2025-09-17T22:28:32.334612] [INFO ] [MAIN ] Update Progress: 2245/2371 symbols completed. VNO took 54.3s. Estimated remaining: 18m 26s. Rate: 6.8 symbols/min [2025-09-17T22:28:32.428046] [INFO ] [REMOTE ] VPG: Fetching primary data for 2024-12. [2025-09-17T22:28:32.514809] [INFO ] [MAIN ] VPV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:28:32.525993] [DEBUG] [LOCAL ] VPV: Loaded 5391 existing records from primary storage. [2025-09-17T22:28:32.526133] [INFO ] [MAIN ] VPV: Loaded 5391 existing records. [2025-09-17T22:28:32.720162] [WARN ] [MAIN ] VPV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:28:32.720727] [INFO ] [MAIN ] VPV: Wiping existing primary data before full refresh. [2025-09-17T22:28:32.720829] [INFO ] [LOCAL ] VPV: Starting deletion of primary data. [2025-09-17T22:28:32.721294] [DEBUG] [LOCAL ] VPV: Deleted primary data file. [2025-09-17T22:28:32.721373] [INFO ] [MAIN ] VPV: Starting full primary refresh. [2025-09-17T22:28:33.098579] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-07 (2.28 seconds). [2025-09-17T22:28:33.157989] [INFO ] [REMOTE ] VPV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:28:33.195333] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-03 (1.58 seconds). [2025-09-17T22:28:33.215737] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-08. [2025-09-17T22:28:33.429545] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2024-12 (1.00 seconds). [2025-09-17T22:28:34.015795] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-11. [2025-09-17T22:28:34.612514] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-11 (0.60 seconds). [2025-09-17T22:28:34.815790] [INFO ] [REMOTE ] VPV: Fetching primary data for 2024-12. [2025-09-17T22:28:34.981959] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T22:28:35.366778] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2024-12 (0.55 seconds). [2025-09-17T22:28:35.615775] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-01. [2025-09-17T22:28:36.411433] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-01 (0.80 seconds). [2025-09-17T22:28:36.415694] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-02. [2025-09-17T22:28:37.175783] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T22:28:37.215752] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-03. [2025-09-17T22:28:37.832228] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T22:28:38.015792] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-01. [2025-09-17T22:28:38.815773] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-04. [2025-09-17T22:28:38.981348] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-01 (0.97 seconds). [2025-09-17T22:28:39.615772] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-04. [2025-09-17T22:28:39.642257] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-04 (0.83 seconds). [2025-09-17T22:28:40.415781] [INFO ] [REMOTE ] VOYG: Fetching primary data for 2025-09. [2025-09-17T22:28:41.215784] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-02. [2025-09-17T22:28:41.280338] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T22:28:41.924831] [INFO ] [REMOTE ] VOYG: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T22:28:41.930314] [INFO ] [REMOTE ] VOYG: Full fetch complete (22351 records). [2025-09-17T22:28:41.930391] [DEBUG] [VALIDATOR ] VOYG: Validating primary data. [2025-09-17T22:28:42.020795] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-05. [2025-09-17T22:28:42.149873] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-02 (0.93 seconds). [2025-09-17T22:28:42.160963] [WARN ] [VALIDATOR ] VOYG: Validation failed - insufficient historical data. Have 68 unique days, need 200 days [2025-09-17T22:28:42.165299] [FATAL] [MAIN ] VOYG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:28:42.165375] [WARN ] [MAIN ] VOYG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:28:42.165428] [INFO ] [LOCAL ] VOYG: Starting deletion of primary data. [2025-09-17T22:28:42.165491] [DEBUG] [LOCAL ] VOYG: No primary data file found to delete. [2025-09-17T22:28:42.165528] [INFO ] [LOCAL ] VOYG: Starting deletion of derivative data. [2025-09-17T22:28:42.165584] [DEBUG] [LOCAL ] VOYG: No derivative data file found to delete. [2025-09-17T22:28:42.165708] [INFO ] [MAIN ] Update Progress: 2246/2371 symbols completed. VOYG took 29.5s. Estimated remaining: 18m 18s. Rate: 6.8 symbols/min [2025-09-17T22:28:42.344350] [INFO ] [MAIN ] VRE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:28:42.383299] [DEBUG] [LOCAL ] VRE: Loaded 34620 existing records from primary storage. [2025-09-17T22:28:42.383497] [INFO ] [MAIN ] VRE: Loaded 34620 existing records. [2025-09-17T22:28:42.578366] [WARN ] [MAIN ] VRE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:28:42.578619] [INFO ] [MAIN ] VRE: Wiping existing primary data before full refresh. [2025-09-17T22:28:42.578700] [INFO ] [LOCAL ] VRE: Starting deletion of primary data. [2025-09-17T22:28:42.579632] [DEBUG] [LOCAL ] VRE: Deleted primary data file. [2025-09-17T22:28:42.579744] [INFO ] [MAIN ] VRE: Starting full primary refresh. [2025-09-17T22:28:42.746670] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-05 (0.73 seconds). [2025-09-17T22:28:42.820888] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-03. [2025-09-17T22:28:42.981635] [INFO ] [REMOTE ] VRE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:28:43.615787] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-06. [2025-09-17T22:28:44.091818] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T22:28:44.221353] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-06 (0.61 seconds). [2025-09-17T22:28:44.415793] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-04. [2025-09-17T22:28:45.215818] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-05. [2025-09-17T22:28:45.681411] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T22:28:46.015821] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-11. [2025-09-17T22:28:46.815779] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-05. [2025-09-17T22:28:46.881635] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T22:28:47.415876] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-11 (1.40 seconds). [2025-09-17T22:28:47.504099] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-05 (0.69 seconds). [2025-09-17T22:28:47.615787] [INFO ] [REMOTE ] VRE: Fetching primary data for 2024-12. [2025-09-17T22:28:48.415800] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-06. [2025-09-17T22:28:48.969282] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T22:28:49.215707] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-06. [2025-09-17T22:28:49.324004] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T22:28:50.015819] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-07. [2025-09-17T22:28:50.714984] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T22:28:50.815776] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-07. [2025-09-17T22:28:50.995526] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T22:28:51.615795] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-08. [2025-09-17T22:28:52.415750] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-01. [2025-09-17T22:28:52.568133] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-07 (1.75 seconds). [2025-09-17T22:28:52.767010] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-08 (1.15 seconds). [2025-09-17T22:28:53.215788] [INFO ] [REMOTE ] VPG: Fetching primary data for 2025-09. [2025-09-17T22:28:53.680937] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T22:28:54.015752] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-07. [2025-09-17T22:28:54.248066] [INFO ] [REMOTE ] VPG: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T22:28:54.250364] [INFO ] [REMOTE ] VPG: Full fetch complete (23141 records). [2025-09-17T22:28:54.250449] [DEBUG] [VALIDATOR ] VPG: Validating primary data. [2025-09-17T22:28:54.655624] [DEBUG] [VALIDATOR ] VPG: All expected trading days are present. [2025-09-17T22:28:54.655525] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-07 (0.64 seconds). [2025-09-17T22:28:54.655779] [DEBUG] [VALIDATOR ] VPG: Primary data validation passed. [2025-09-17T22:28:54.657759] [INFO ] [MAIN ] VPG: Fetched primary data is valid. [2025-09-17T22:28:54.658075] [DEBUG] [LOCAL ] VPG: Saving primary data. [2025-09-17T22:28:54.658750] [DEBUG] [LOCAL ] VPG: Trimmed 23141 records to 17231 (keeping 200 days of data) [2025-09-17T22:28:54.760576] [DEBUG] [LOCAL ] VPG: Primary data saved (17231 records). [2025-09-17T22:28:54.760743] [INFO ] [MAIN ] VPG: Full history saved. [2025-09-17T22:28:54.760859] [INFO ] [MAIN ] Update Progress: 2247/2371 symbols completed. VPG took 26.5s. Estimated remaining: 18m 9s. Rate: 6.8 symbols/min [2025-09-17T22:28:54.820893] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-08. [2025-09-17T22:28:54.948988] [INFO ] [MAIN ] VRT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:28:55.005742] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-17T22:28:55.005896] [INFO ] [MAIN ] VRT: Loaded 53753 existing records. [2025-09-17T22:28:55.204826] [WARN ] [MAIN ] VRT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:28:55.205092] [INFO ] [MAIN ] VRT: Wiping existing primary data before full refresh. [2025-09-17T22:28:55.205141] [INFO ] [LOCAL ] VRT: Starting deletion of primary data. [2025-09-17T22:28:55.206507] [DEBUG] [LOCAL ] VRT: Deleted primary data file. [2025-09-17T22:28:55.206570] [INFO ] [MAIN ] VRT: Starting full primary refresh. [2025-09-17T22:28:55.597525] [INFO ] [REMOTE ] VRT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:28:55.615728] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-11. [2025-09-17T22:28:56.415804] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-02. [2025-09-17T22:28:56.451029] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T22:28:57.215828] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-08. [2025-09-17T22:28:57.626862] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T22:28:57.742049] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T22:28:57.810549] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-11 (2.19 seconds). [2025-09-17T22:28:58.015815] [INFO ] [REMOTE ] VPV: Fetching primary data for 2025-09. [2025-09-17T22:28:58.647400] [INFO ] [REMOTE ] VPV: Incremental fetch complete for 2025-09 (0.63 seconds). [2025-09-17T22:28:58.649018] [INFO ] [REMOTE ] VPV: Full fetch complete (9404 records). [2025-09-17T22:28:58.649100] [DEBUG] [VALIDATOR ] VPV: Validating primary data. [2025-09-17T22:28:58.820867] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-03. [2025-09-17T22:28:59.058891] [DEBUG] [VALIDATOR ] VPV: All expected trading days are present. [2025-09-17T22:28:59.058979] [DEBUG] [VALIDATOR ] VPV: Primary data validation passed. [2025-09-17T22:28:59.059228] [INFO ] [MAIN ] VPV: Fetched primary data is valid. [2025-09-17T22:28:59.059294] [DEBUG] [LOCAL ] VPV: Saving primary data. [2025-09-17T22:28:59.059829] [DEBUG] [LOCAL ] VPV: Trimmed 9404 records to 5389 (keeping 200 days of data) [2025-09-17T22:28:59.094580] [DEBUG] [LOCAL ] VPV: Primary data saved (5389 records). [2025-09-17T22:28:59.094750] [INFO ] [MAIN ] VPV: Full history saved. [2025-09-17T22:28:59.094873] [INFO ] [MAIN ] Update Progress: 2248/2371 symbols completed. VPV took 26.8s. Estimated remaining: 17m 60s. Rate: 6.8 symbols/min [2025-09-17T22:28:59.292177] [INFO ] [MAIN ] VRTS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:28:59.292377] [DEBUG] [LOCAL ] VRTS: No existing data file found in primary storage. [2025-09-17T22:28:59.292421] [WARN ] [MAIN ] VRTS: No existing data found, performing full refresh instead. [2025-09-17T22:28:59.292600] [INFO ] [MAIN ] VRTS: Wiping existing primary data before full refresh. [2025-09-17T22:28:59.292682] [INFO ] [LOCAL ] VRTS: Starting deletion of primary data. [2025-09-17T22:28:59.292851] [DEBUG] [LOCAL ] VRTS: No primary data file found to delete. [2025-09-17T22:28:59.292894] [INFO ] [MAIN ] VRTS: Starting full primary refresh. [2025-09-17T22:28:59.620969] [INFO ] [REMOTE ] VRT: Fetching primary data for 2024-12. [2025-09-17T22:28:59.703278] [INFO ] [REMOTE ] VRTS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:28:59.940355] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-03 (1.12 seconds). [2025-09-17T22:29:00.415859] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-11. [2025-09-17T22:29:01.126296] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-11 (0.71 seconds). [2025-09-17T22:29:01.215854] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-04. [2025-09-17T22:29:02.015840] [INFO ] [REMOTE ] VOYA: Fetching primary data for 2025-09. [2025-09-17T22:29:02.145447] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2024-12 (2.52 seconds). [2025-09-17T22:29:02.438402] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T22:29:02.815784] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-05. [2025-09-17T22:29:03.065398] [INFO ] [REMOTE ] VOYA: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T22:29:03.071140] [INFO ] [REMOTE ] VOYA: Full fetch complete (61938 records). [2025-09-17T22:29:03.071250] [DEBUG] [VALIDATOR ] VOYA: Validating primary data. [2025-09-17T22:29:03.460000] [DEBUG] [VALIDATOR ] VOYA: All expected trading days are present. [2025-09-17T22:29:03.460099] [DEBUG] [VALIDATOR ] VOYA: Primary data validation passed. [2025-09-17T22:29:03.461119] [INFO ] [MAIN ] VOYA: Fetched primary data is valid. [2025-09-17T22:29:03.461187] [DEBUG] [LOCAL ] VOYA: Saving primary data. [2025-09-17T22:29:03.462596] [DEBUG] [LOCAL ] VOYA: Trimmed 61938 records to 42978 (keeping 200 days of data) [2025-09-17T22:29:03.655012] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-01. [2025-09-17T22:29:03.762613] [DEBUG] [LOCAL ] VOYA: Primary data saved (42978 records). [2025-09-17T22:29:03.762859] [INFO ] [MAIN ] VOYA: Full history saved. [2025-09-17T22:29:03.763083] [INFO ] [MAIN ] Update Progress: 2249/2371 symbols completed. VOYA took 55.6s. Estimated remaining: 17m 51s. Rate: 6.8 symbols/min [2025-09-17T22:29:03.952209] [INFO ] [MAIN ] VSCO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:29:03.977796] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-05 (1.16 seconds). [2025-09-17T22:29:04.039224] [DEBUG] [LOCAL ] VSCO: Loaded 52905 existing records from primary storage. [2025-09-17T22:29:04.039378] [INFO ] [MAIN ] VSCO: Loaded 52905 existing records. [2025-09-17T22:29:04.226215] [WARN ] [MAIN ] VSCO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:29:04.226507] [INFO ] [MAIN ] VSCO: Wiping existing primary data before full refresh. [2025-09-17T22:29:04.226562] [INFO ] [LOCAL ] VSCO: Starting deletion of primary data. [2025-09-17T22:29:04.227827] [DEBUG] [LOCAL ] VSCO: Deleted primary data file. [2025-09-17T22:29:04.227901] [INFO ] [MAIN ] VSCO: Starting full primary refresh. [2025-09-17T22:29:04.426726] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2024-12. [2025-09-17T22:29:04.613758] [INFO ] [REMOTE ] VSCO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:29:05.155259] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2024-12 (0.73 seconds). [2025-09-17T22:29:05.215806] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-01. [2025-09-17T22:29:05.892771] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-01 (0.68 seconds). [2025-09-17T22:29:06.015752] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-06. [2025-09-17T22:29:06.228914] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-01 (2.57 seconds). [2025-09-17T22:29:06.815841] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-02. [2025-09-17T22:29:07.351271] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-02 (0.54 seconds). [2025-09-17T22:29:07.567155] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T22:29:07.615757] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-07. [2025-09-17T22:29:08.415803] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-03. [2025-09-17T22:29:09.089237] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-03 (0.67 seconds). [2025-09-17T22:29:09.215787] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-04. [2025-09-17T22:29:09.266022] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T22:29:10.015803] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-11. [2025-09-17T22:29:10.037125] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T22:29:10.815770] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-08. [2025-09-17T22:29:11.585031] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-11 (1.57 seconds). [2025-09-17T22:29:11.615819] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-05. [2025-09-17T22:29:12.205183] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-08 (1.39 seconds). [2025-09-17T22:29:12.321763] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-05 (0.71 seconds). [2025-09-17T22:29:12.415808] [INFO ] [REMOTE ] VRE: Fetching primary data for 2025-09. [2025-09-17T22:29:13.215801] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-02. [2025-09-17T22:29:13.810619] [INFO ] [REMOTE ] VRE: Incremental fetch complete for 2025-09 (1.39 seconds). [2025-09-17T22:29:13.816680] [INFO ] [REMOTE ] VRE: Full fetch complete (47499 records). [2025-09-17T22:29:13.816810] [DEBUG] [VALIDATOR ] VRE: Validating primary data. [2025-09-17T22:29:14.020952] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-06. [2025-09-17T22:29:14.218149] [DEBUG] [VALIDATOR ] VRE: All expected trading days are present. [2025-09-17T22:29:14.218242] [DEBUG] [VALIDATOR ] VRE: Primary data validation passed. [2025-09-17T22:29:14.219118] [INFO ] [MAIN ] VRE: Fetched primary data is valid. [2025-09-17T22:29:14.219209] [DEBUG] [LOCAL ] VRE: Saving primary data. [2025-09-17T22:29:14.220452] [DEBUG] [LOCAL ] VRE: Trimmed 47499 records to 34705 (keeping 200 days of data) [2025-09-17T22:29:14.444575] [DEBUG] [LOCAL ] VRE: Primary data saved (34705 records). [2025-09-17T22:29:14.444767] [INFO ] [MAIN ] VRE: Full history saved. [2025-09-17T22:29:14.446029] [INFO ] [MAIN ] Update Progress: 2250/2371 symbols completed. VRE took 32.3s. Estimated remaining: 17m 42s. Rate: 6.8 symbols/min [2025-09-17T22:29:14.624595] [INFO ] [MAIN ] VSH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:29:14.683893] [DEBUG] [LOCAL ] VSH: Loaded 48836 existing records from primary storage. [2025-09-17T22:29:14.684069] [INFO ] [MAIN ] VSH: Loaded 48836 existing records. [2025-09-17T22:29:14.837712] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2024-12. [2025-09-17T22:29:14.869710] [WARN ] [MAIN ] VSH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:29:14.869968] [INFO ] [MAIN ] VSH: Wiping existing primary data before full refresh. [2025-09-17T22:29:14.870014] [INFO ] [LOCAL ] VSH: Starting deletion of primary data. [2025-09-17T22:29:14.871095] [DEBUG] [LOCAL ] VSH: Deleted primary data file. [2025-09-17T22:29:14.871218] [INFO ] [MAIN ] VSH: Starting full primary refresh. [2025-09-17T22:29:15.254822] [INFO ] [REMOTE ] VSH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:29:15.249187] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T22:29:15.623822] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-07. [2025-09-17T22:29:15.646528] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-02 (2.43 seconds). [2025-09-17T22:29:16.415813] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-03. [2025-09-17T22:29:16.603072] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T22:29:16.787380] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2024-12 (1.95 seconds). [2025-09-17T22:29:17.215791] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-08. [2025-09-17T22:29:18.018801] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-01. [2025-09-17T22:29:18.022771] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-08 (0.81 seconds). [2025-09-17T22:29:18.815795] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-11. [2025-09-17T22:29:18.968222] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-03 (2.55 seconds). [2025-09-17T22:29:19.571704] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T22:29:19.615765] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-02. [2025-09-17T22:29:20.415787] [INFO ] [REMOTE ] VRTS: Fetching primary data for 2025-09. [2025-09-17T22:29:20.473041] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T22:29:21.141099] [INFO ] [REMOTE ] VRTS: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T22:29:21.143557] [INFO ] [REMOTE ] VRTS: Full fetch complete (11099 records). [2025-09-17T22:29:21.143669] [DEBUG] [VALIDATOR ] VRTS: Validating primary data. [2025-09-17T22:29:21.218136] [INFO ] [REMOTE ] VSH: Fetching primary data for 2024-12. [2025-09-17T22:29:21.559575] [DEBUG] [VALIDATOR ] VRTS: All expected trading days are present. [2025-09-17T22:29:21.559707] [DEBUG] [VALIDATOR ] VRTS: Primary data validation passed. [2025-09-17T22:29:21.560015] [INFO ] [MAIN ] VRTS: Fetched primary data is valid. [2025-09-17T22:29:21.560250] [DEBUG] [LOCAL ] VRTS: Saving primary data. [2025-09-17T22:29:21.561231] [DEBUG] [LOCAL ] VRTS: Trimmed 11099 records to 9066 (keeping 200 days of data) [2025-09-17T22:29:21.617980] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T22:29:21.664901] [DEBUG] [LOCAL ] VRTS: Primary data saved (9066 records). [2025-09-17T22:29:21.665084] [INFO ] [MAIN ] VRTS: Full history saved. [2025-09-17T22:29:21.665197] [INFO ] [MAIN ] Update Progress: 2251/2371 symbols completed. VRTS took 22.6s. Estimated remaining: 17m 33s. Rate: 6.8 symbols/min [2025-09-17T22:29:21.856500] [INFO ] [MAIN ] VST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:29:21.933762] [DEBUG] [LOCAL ] VST: Loaded 53723 existing records from primary storage. [2025-09-17T22:29:21.933932] [INFO ] [MAIN ] VST: Loaded 53723 existing records. [2025-09-17T22:29:22.020929] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-04. [2025-09-17T22:29:22.122973] [WARN ] [MAIN ] VST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:29:22.123302] [INFO ] [MAIN ] VST: Wiping existing primary data before full refresh. [2025-09-17T22:29:22.123355] [INFO ] [LOCAL ] VST: Starting deletion of primary data. [2025-09-17T22:29:22.124803] [DEBUG] [LOCAL ] VST: Deleted primary data file. [2025-09-17T22:29:22.124877] [INFO ] [MAIN ] VST: Starting full primary refresh. [2025-09-17T22:29:22.510995] [INFO ] [REMOTE ] VST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:29:22.815799] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-03. [2025-09-17T22:29:22.996633] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T22:29:23.615797] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-01. [2025-09-17T22:29:24.415841] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-11. [2025-09-17T22:29:24.572605] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-04 (2.55 seconds). [2025-09-17T22:29:24.649408] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T22:29:25.215785] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-05. [2025-09-17T22:29:25.279738] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-01 (1.66 seconds). [2025-09-17T22:29:26.015791] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-02. [2025-09-17T22:29:26.815775] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-04. [2025-09-17T22:29:27.027912] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-11 (2.61 seconds). [2025-09-17T22:29:27.213780] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T22:29:27.615804] [INFO ] [REMOTE ] VST: Fetching primary data for 2024-12. [2025-09-17T22:29:27.683467] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-05 (2.47 seconds). [2025-09-17T22:29:28.415779] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-06. [2025-09-17T22:29:28.467914] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T22:29:29.215848] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-03. [2025-09-17T22:29:30.015824] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-05. [2025-09-17T22:29:30.148815] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2024-12 (2.53 seconds). [2025-09-17T22:29:30.819756] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-01. [2025-09-17T22:29:30.823042] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-06 (2.41 seconds). [2025-09-17T22:29:31.043300] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-03 (1.83 seconds). [2025-09-17T22:29:31.563761] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-05 (1.55 seconds). [2025-09-17T22:29:31.615806] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-06. [2025-09-17T22:29:32.415777] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-04. [2025-09-17T22:29:33.215781] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-07. [2025-09-17T22:29:33.431439] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-01 (2.61 seconds). [2025-09-17T22:29:33.476694] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-06 (1.86 seconds). [2025-09-17T22:29:34.015785] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-07. [2025-09-17T22:29:34.177567] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T22:29:34.815797] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-05. [2025-09-17T22:29:35.622523] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-02. [2025-09-17T22:29:35.625671] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-17T22:29:36.026999] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-07 (2.01 seconds). [2025-09-17T22:29:36.415778] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-08. [2025-09-17T22:29:36.484258] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T22:29:37.215779] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-06. [2025-09-17T22:29:38.015771] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-08. [2025-09-17T22:29:38.076411] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T22:29:38.166745] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-02 (2.54 seconds). [2025-09-17T22:29:38.440850] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T22:29:38.815779] [INFO ] [REMOTE ] VSCO: Fetching primary data for 2025-09. [2025-09-17T22:29:39.615782] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-03. [2025-09-17T22:29:40.319479] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-08 (2.30 seconds). [2025-09-17T22:29:40.415840] [INFO ] [REMOTE ] VRT: Fetching primary data for 2025-09. [2025-09-17T22:29:40.574209] [INFO ] [REMOTE ] VSCO: Incremental fetch complete for 2025-09 (1.76 seconds). [2025-09-17T22:29:40.581413] [INFO ] [REMOTE ] VSCO: Full fetch complete (76104 records). [2025-09-17T22:29:40.581543] [DEBUG] [VALIDATOR ] VSCO: Validating primary data. [2025-09-17T22:29:41.015269] [DEBUG] [VALIDATOR ] VSCO: All expected trading days are present. [2025-09-17T22:29:41.015367] [DEBUG] [VALIDATOR ] VSCO: Primary data validation passed. [2025-09-17T22:29:41.016474] [INFO ] [MAIN ] VSCO: Fetched primary data is valid. [2025-09-17T22:29:41.016538] [DEBUG] [LOCAL ] VSCO: Saving primary data. [2025-09-17T22:29:41.018162] [DEBUG] [LOCAL ] VSCO: Trimmed 76104 records to 52903 (keeping 200 days of data) [2025-09-17T22:29:41.226170] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-07. [2025-09-17T22:29:41.341771] [DEBUG] [LOCAL ] VSCO: Primary data saved (52903 records). [2025-09-17T22:29:41.341942] [INFO ] [MAIN ] VSCO: Full history saved. [2025-09-17T22:29:41.342081] [INFO ] [MAIN ] Update Progress: 2252/2371 symbols completed. VSCO took 37.6s. Estimated remaining: 17m 25s. Rate: 6.8 symbols/min [2025-09-17T22:29:41.522405] [INFO ] [MAIN ] VSTS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:29:41.568438] [DEBUG] [LOCAL ] VSTS: Loaded 48963 existing records from primary storage. [2025-09-17T22:29:41.568585] [INFO ] [MAIN ] VSTS: Loaded 48963 existing records. [2025-09-17T22:29:41.748414] [WARN ] [MAIN ] VSTS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:29:41.748637] [INFO ] [MAIN ] VSTS: Wiping existing primary data before full refresh. [2025-09-17T22:29:41.748719] [INFO ] [LOCAL ] VSTS: Starting deletion of primary data. [2025-09-17T22:29:41.749819] [DEBUG] [LOCAL ] VSTS: Deleted primary data file. [2025-09-17T22:29:41.749903] [INFO ] [MAIN ] VSTS: Starting full primary refresh. [2025-09-17T22:29:42.111906] [INFO ] [REMOTE ] VSTS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:29:42.112220] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-11. [2025-09-17T22:29:42.322624] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-03 (2.71 seconds). [2025-09-17T22:29:42.354421] [INFO ] [REMOTE ] VRT: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T22:29:42.361485] [INFO ] [REMOTE ] VRT: Full fetch complete (77786 records). [2025-09-17T22:29:42.361680] [DEBUG] [VALIDATOR ] VRT: Validating primary data. [2025-09-17T22:29:42.772456] [DEBUG] [VALIDATOR ] VRT: All expected trading days are present. [2025-09-17T22:29:42.772542] [DEBUG] [VALIDATOR ] VRT: Primary data validation passed. [2025-09-17T22:29:42.773639] [INFO ] [MAIN ] VRT: Fetched primary data is valid. [2025-09-17T22:29:42.773725] [DEBUG] [LOCAL ] VRT: Saving primary data. [2025-09-17T22:29:42.775622] [DEBUG] [LOCAL ] VRT: Trimmed 77786 records to 53753 (keeping 200 days of data) [2025-09-17T22:29:42.852569] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-04. [2025-09-17T22:29:43.155318] [DEBUG] [LOCAL ] VRT: Primary data saved (53753 records). [2025-09-17T22:29:43.156115] [INFO ] [MAIN ] VRT: Full history saved. [2025-09-17T22:29:43.156308] [INFO ] [MAIN ] Update Progress: 2253/2371 symbols completed. VRT took 48.4s. Estimated remaining: 17m 16s. Rate: 6.8 symbols/min [2025-09-17T22:29:43.343528] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-07 (2.12 seconds). [2025-09-17T22:29:43.405036] [INFO ] [MAIN ] VTEX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:29:43.458442] [DEBUG] [LOCAL ] VTEX: Loaded 43460 existing records from primary storage. [2025-09-17T22:29:43.458676] [INFO ] [MAIN ] VTEX: Loaded 43460 existing records. [2025-09-17T22:29:43.617884] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-08. [2025-09-17T22:29:43.649796] [WARN ] [MAIN ] VTEX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:29:43.651280] [INFO ] [MAIN ] VTEX: Wiping existing primary data before full refresh. [2025-09-17T22:29:43.651419] [INFO ] [LOCAL ] VTEX: Starting deletion of primary data. [2025-09-17T22:29:43.652327] [DEBUG] [LOCAL ] VTEX: Deleted primary data file. [2025-09-17T22:29:43.652404] [INFO ] [MAIN ] VTEX: Starting full primary refresh. [2025-09-17T22:29:43.783632] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T22:29:44.041883] [INFO ] [REMOTE ] VTEX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:29:44.415832] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-11. [2025-09-17T22:29:45.222190] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2024-12. [2025-09-17T22:29:45.228146] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-04 (2.38 seconds). [2025-09-17T22:29:45.367953] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T22:29:45.727582] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-11 (1.31 seconds). [2025-09-17T22:29:46.015790] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2024-12. [2025-09-17T22:29:46.758349] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T22:29:46.815785] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-05. [2025-09-17T22:29:47.458974] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2024-12 (1.44 seconds). [2025-09-17T22:29:47.615794] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-01. [2025-09-17T22:29:48.415794] [INFO ] [REMOTE ] VSH: Fetching primary data for 2025-09. [2025-09-17T22:29:49.141129] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T22:29:49.215773] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-02. [2025-09-17T22:29:49.362414] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-05 (2.55 seconds). [2025-09-17T22:29:49.892062] [INFO ] [REMOTE ] VSH: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T22:29:49.898557] [INFO ] [REMOTE ] VSH: Full fetch complete (71354 records). [2025-09-17T22:29:49.898718] [DEBUG] [VALIDATOR ] VSH: Validating primary data. [2025-09-17T22:29:50.016094] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-06. [2025-09-17T22:29:50.344988] [DEBUG] [VALIDATOR ] VSH: All expected trading days are present. [2025-09-17T22:29:50.345106] [DEBUG] [VALIDATOR ] VSH: Primary data validation passed. [2025-09-17T22:29:50.346196] [INFO ] [MAIN ] VSH: Fetched primary data is valid. [2025-09-17T22:29:50.346263] [DEBUG] [LOCAL ] VSH: Saving primary data. [2025-09-17T22:29:50.347908] [DEBUG] [LOCAL ] VSH: Trimmed 71354 records to 48785 (keeping 200 days of data) [2025-09-17T22:29:50.483344] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T22:29:50.694276] [DEBUG] [LOCAL ] VSH: Primary data saved (48785 records). [2025-09-17T22:29:50.694423] [INFO ] [MAIN ] VSH: Full history saved. [2025-09-17T22:29:50.695203] [INFO ] [MAIN ] Update Progress: 2254/2371 symbols completed. VSH took 36.2s. Estimated remaining: 17m 7s. Rate: 6.8 symbols/min [2025-09-17T22:29:50.820987] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-03. [2025-09-17T22:29:50.871639] [INFO ] [MAIN ] VTLE: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:29:50.925944] [DEBUG] [LOCAL ] VTLE: Loaded 48752 existing records from primary storage. [2025-09-17T22:29:50.926109] [INFO ] [MAIN ] VTLE: Loaded 48752 existing records. [2025-09-17T22:29:51.105747] [WARN ] [MAIN ] VTLE: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:29:51.106029] [INFO ] [MAIN ] VTLE: Wiping existing primary data before full refresh. [2025-09-17T22:29:51.106078] [INFO ] [LOCAL ] VTLE: Starting deletion of primary data. [2025-09-17T22:29:51.107136] [DEBUG] [LOCAL ] VTLE: Deleted primary data file. [2025-09-17T22:29:51.107197] [INFO ] [MAIN ] VTLE: Starting full primary refresh. [2025-09-17T22:29:51.462191] [INFO ] [REMOTE ] VTLE: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:29:51.615841] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-11. [2025-09-17T22:29:52.366899] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-17T22:29:52.407045] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T22:29:52.416699] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-01. [2025-09-17T22:29:52.975011] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-11 (1.36 seconds). [2025-09-17T22:29:53.215824] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-04. [2025-09-17T22:29:53.785986] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T22:29:54.015867] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-07. [2025-09-17T22:29:54.611857] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-04 (1.40 seconds). [2025-09-17T22:29:54.815795] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2024-12. [2025-09-17T22:29:55.615783] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-05. [2025-09-17T22:29:56.373385] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T22:29:56.415775] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-02. [2025-09-17T22:29:56.508635] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-07 (2.49 seconds). [2025-09-17T22:29:57.215822] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-01. [2025-09-17T22:29:57.371451] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T22:29:57.885204] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T22:29:58.015778] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-06. [2025-09-17T22:29:58.815795] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-08. [2025-09-17T22:29:59.071551] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-01 (1.86 seconds). [2025-09-17T22:29:59.615795] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-02. [2025-09-17T22:29:59.654743] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-06 (1.64 seconds). [2025-09-17T22:30:00.415797] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-03. [2025-09-17T22:30:00.996726] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T22:30:01.215766] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-03. [2025-09-17T22:30:01.272830] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-08 (2.46 seconds). [2025-09-17T22:30:02.015795] [INFO ] [REMOTE ] VST: Fetching primary data for 2025-09. [2025-09-17T22:30:02.281395] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T22:30:02.815786] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-04. [2025-09-17T22:30:03.615777] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-07. [2025-09-17T22:30:03.740986] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-03 (2.53 seconds). [2025-09-17T22:30:04.105440] [INFO ] [REMOTE ] VST: Incremental fetch complete for 2025-09 (2.09 seconds). [2025-09-17T22:30:04.112504] [INFO ] [REMOTE ] VST: Full fetch complete (77732 records). [2025-09-17T22:30:04.112701] [DEBUG] [VALIDATOR ] VST: Validating primary data. [2025-09-17T22:30:04.420891] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-04. [2025-09-17T22:30:04.559215] [DEBUG] [VALIDATOR ] VST: All expected trading days are present. [2025-09-17T22:30:04.559326] [DEBUG] [VALIDATOR ] VST: Primary data validation passed. [2025-09-17T22:30:04.560685] [INFO ] [MAIN ] VST: Fetched primary data is valid. [2025-09-17T22:30:04.560758] [DEBUG] [LOCAL ] VST: Saving primary data. [2025-09-17T22:30:04.562777] [DEBUG] [LOCAL ] VST: Trimmed 77732 records to 53722 (keeping 200 days of data) [2025-09-17T22:30:04.942998] [DEBUG] [LOCAL ] VST: Primary data saved (53722 records). [2025-09-17T22:30:04.943161] [INFO ] [MAIN ] VST: Full history saved. [2025-09-17T22:30:04.944834] [INFO ] [MAIN ] Update Progress: 2255/2371 symbols completed. VST took 43.3s. Estimated remaining: 16m 59s. Rate: 6.8 symbols/min [2025-09-17T22:30:05.131431] [INFO ] [MAIN ] VTMX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:30:05.151518] [DEBUG] [LOCAL ] VTMX: Loaded 17366 existing records from primary storage. [2025-09-17T22:30:05.151716] [INFO ] [MAIN ] VTMX: Loaded 17366 existing records. [2025-09-17T22:30:05.328454] [WARN ] [MAIN ] VTMX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:30:05.328876] [INFO ] [MAIN ] VTMX: Wiping existing primary data before full refresh. [2025-09-17T22:30:05.328934] [INFO ] [LOCAL ] VTMX: Starting deletion of primary data. [2025-09-17T22:30:05.329747] [DEBUG] [LOCAL ] VTMX: Deleted primary data file. [2025-09-17T22:30:05.329810] [INFO ] [MAIN ] VTMX: Starting full primary refresh. [2025-09-17T22:30:05.695880] [INFO ] [REMOTE ] VTMX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:30:05.696279] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-11. [2025-09-17T22:30:05.734486] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-04 (2.92 seconds). [2025-09-17T22:30:06.006754] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-07 (2.39 seconds). [2025-09-17T22:30:06.017065] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-05. [2025-09-17T22:30:06.271799] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-04 (1.85 seconds). [2025-09-17T22:30:06.579481] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-11 (0.88 seconds). [2025-09-17T22:30:06.815827] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-05. [2025-09-17T22:30:07.587060] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T22:30:07.615787] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-06. [2025-09-17T22:30:08.415830] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-08. [2025-09-17T22:30:08.638541] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-05 (1.82 seconds). [2025-09-17T22:30:09.150594] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T22:30:09.215791] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-07. [2025-09-17T22:30:10.021688] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-06. [2025-09-17T22:30:10.050240] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T22:30:10.658290] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T22:30:10.815855] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-08. [2025-09-17T22:30:11.615805] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2024-12. [2025-09-17T22:30:11.734678] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T22:30:12.060488] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-08 (1.24 seconds). [2025-09-17T22:30:12.415806] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-07. [2025-09-17T22:30:12.676979] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2024-12 (1.06 seconds). [2025-09-17T22:30:13.215827] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-01. [2025-09-17T22:30:13.954191] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T22:30:14.015751] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-08. [2025-09-17T22:30:14.390369] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T22:30:14.815791] [INFO ] [REMOTE ] VSTS: Fetching primary data for 2025-09. [2025-09-17T22:30:15.615818] [INFO ] [REMOTE ] VTEX: Fetching primary data for 2025-09. [2025-09-17T22:30:16.351423] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-08 (2.34 seconds). [2025-09-17T22:30:16.415818] [INFO ] [REMOTE ] VTLE: Fetching primary data for 2025-09. [2025-09-17T22:30:17.022438] [INFO ] [REMOTE ] VTEX: Incremental fetch complete for 2025-09 (1.41 seconds). [2025-09-17T22:30:17.028502] [INFO ] [REMOTE ] VTEX: Full fetch complete (60469 records). [2025-09-17T22:30:17.028688] [DEBUG] [VALIDATOR ] VTEX: Validating primary data. [2025-09-17T22:30:17.221747] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-02. [2025-09-17T22:30:17.425734] [DEBUG] [VALIDATOR ] VTEX: All expected trading days are present. [2025-09-17T22:30:17.425900] [DEBUG] [VALIDATOR ] VTEX: Primary data validation passed. [2025-09-17T22:30:17.436106] [INFO ] [MAIN ] VTEX: Fetched primary data is valid. [2025-09-17T22:30:17.442536] [DEBUG] [LOCAL ] VTEX: Saving primary data. [2025-09-17T22:30:17.444153] [INFO ] [REMOTE ] VSTS: Incremental fetch complete for 2025-09 (2.63 seconds). [2025-09-17T22:30:17.451230] [INFO ] [REMOTE ] VSTS: Full fetch complete (69743 records). [2025-09-17T22:30:17.451371] [DEBUG] [VALIDATOR ] VSTS: Validating primary data. [2025-09-17T22:30:17.451485] [DEBUG] [LOCAL ] VTEX: Trimmed 60469 records to 43487 (keeping 200 days of data) [2025-09-17T22:30:18.009024] [DEBUG] [VALIDATOR ] VSTS: All expected trading days are present. [2025-09-17T22:30:18.009851] [DEBUG] [VALIDATOR ] VSTS: Primary data validation passed. [2025-09-17T22:30:18.015240] [INFO ] [MAIN ] VSTS: Fetched primary data is valid. [2025-09-17T22:30:18.016423] [DEBUG] [LOCAL ] VSTS: Saving primary data. [2025-09-17T22:30:18.027198] [DEBUG] [LOCAL ] VSTS: Trimmed 69743 records to 49016 (keeping 200 days of data) [2025-09-17T22:30:18.052861] [INFO ] [REMOTE ] VTLE: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T22:30:18.184800] [INFO ] [REMOTE ] VTLE: Full fetch complete (68464 records). [2025-09-17T22:30:18.195742] [DEBUG] [VALIDATOR ] VTLE: Validating primary data. [2025-09-17T22:30:18.746819] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-02 (1.53 seconds). [2025-09-17T22:30:18.807345] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-03. [2025-09-17T22:30:18.842352] [DEBUG] [VALIDATOR ] VTLE: All expected trading days are present. [2025-09-17T22:30:18.843726] [DEBUG] [VALIDATOR ] VTLE: Primary data validation passed. [2025-09-17T22:30:18.845575] [INFO ] [MAIN ] VTLE: Fetched primary data is valid. [2025-09-17T22:30:18.845977] [DEBUG] [LOCAL ] VTLE: Saving primary data. [2025-09-17T22:30:18.856022] [DEBUG] [LOCAL ] VTLE: Trimmed 68464 records to 48717 (keeping 200 days of data) [2025-09-17T22:30:18.980583] [DEBUG] [LOCAL ] VTEX: Primary data saved (43487 records). [2025-09-17T22:30:18.981801] [INFO ] [MAIN ] VTEX: Full history saved. [2025-09-17T22:30:18.983178] [INFO ] [MAIN ] Update Progress: 2256/2371 symbols completed. VTEX took 35.8s. Estimated remaining: 16m 50s. Rate: 6.8 symbols/min [2025-09-17T22:30:19.183350] [INFO ] [MAIN ] VTN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:30:19.244968] [DEBUG] [LOCAL ] VSTS: Primary data saved (49016 records). [2025-09-17T22:30:19.246087] [INFO ] [MAIN ] VSTS: Full history saved. [2025-09-17T22:30:19.246276] [INFO ] [MAIN ] Update Progress: 2257/2371 symbols completed. VSTS took 37.9s. Estimated remaining: 16m 41s. Rate: 6.8 symbols/min [2025-09-17T22:30:19.255977] [DEBUG] [LOCAL ] VTN: Loaded 7161 existing records from primary storage. [2025-09-17T22:30:19.256680] [INFO ] [MAIN ] VTN: Loaded 7161 existing records. [2025-09-17T22:30:19.627316] [WARN ] [MAIN ] VTN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:30:19.631221] [INFO ] [MAIN ] VTOL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:30:19.633344] [INFO ] [MAIN ] VTN: Wiping existing primary data before full refresh. [2025-09-17T22:30:19.635938] [INFO ] [LOCAL ] VTN: Starting deletion of primary data. [2025-09-17T22:30:19.636578] [DEBUG] [LOCAL ] VTN: Deleted primary data file. [2025-09-17T22:30:19.636744] [INFO ] [MAIN ] VTN: Starting full primary refresh. [2025-09-17T22:30:19.844075] [DEBUG] [LOCAL ] VTOL: Loaded 19916 existing records from primary storage. [2025-09-17T22:30:19.865412] [INFO ] [MAIN ] VTOL: Loaded 19916 existing records. [2025-09-17T22:30:20.146876] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T22:30:20.239011] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-04. [2025-09-17T22:30:20.302307] [WARN ] [MAIN ] VTOL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:30:20.340944] [INFO ] [MAIN ] VTOL: Wiping existing primary data before full refresh. [2025-09-17T22:30:20.344251] [INFO ] [REMOTE ] VTN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:30:20.345462] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-11. [2025-09-17T22:30:20.345970] [INFO ] [LOCAL ] VTOL: Starting deletion of primary data. [2025-09-17T22:30:20.349471] [DEBUG] [LOCAL ] VTOL: Deleted primary data file. [2025-09-17T22:30:20.350693] [INFO ] [MAIN ] VTOL: Starting full primary refresh. [2025-09-17T22:30:20.692431] [DEBUG] [LOCAL ] VTLE: Primary data saved (48717 records). [2025-09-17T22:30:20.704466] [INFO ] [MAIN ] VTLE: Full history saved. [2025-09-17T22:30:20.718632] [INFO ] [MAIN ] Update Progress: 2258/2371 symbols completed. VTLE took 30.0s. Estimated remaining: 16m 32s. Rate: 6.8 symbols/min [2025-09-17T22:30:20.949434] [INFO ] [REMOTE ] VTOL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:30:20.965194] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-11. [2025-09-17T22:30:21.014794] [INFO ] [MAIN ] VTR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:30:21.072372] [DEBUG] [LOCAL ] VTR: Loaded 52829 existing records from primary storage. [2025-09-17T22:30:21.072518] [INFO ] [MAIN ] VTR: Loaded 52829 existing records. [2025-09-17T22:30:21.195778] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-11 (0.85 seconds). [2025-09-17T22:30:21.221590] [INFO ] [REMOTE ] VTN: Fetching primary data for 2024-12. [2025-09-17T22:30:21.261941] [WARN ] [MAIN ] VTR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:30:21.262137] [INFO ] [MAIN ] VTR: Wiping existing primary data before full refresh. [2025-09-17T22:30:21.262184] [INFO ] [LOCAL ] VTR: Starting deletion of primary data. [2025-09-17T22:30:21.263294] [DEBUG] [LOCAL ] VTR: Deleted primary data file. [2025-09-17T22:30:21.263357] [INFO ] [MAIN ] VTR: Starting full primary refresh. [2025-09-17T22:30:21.640583] [INFO ] [REMOTE ] VTR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:30:21.678326] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T22:30:21.908262] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T22:30:22.015796] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-11. [2025-09-17T22:30:22.053634] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2024-12 (0.83 seconds). [2025-09-17T22:30:22.815796] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-01. [2025-09-17T22:30:23.505028] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-01 (0.69 seconds). [2025-09-17T22:30:23.615793] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-02. [2025-09-17T22:30:23.809841] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T22:30:24.229365] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-02 (0.61 seconds). [2025-09-17T22:30:24.415814] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2024-12. [2025-09-17T22:30:25.215779] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-03. [2025-09-17T22:30:25.332606] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T22:30:26.015818] [INFO ] [REMOTE ] VTR: Fetching primary data for 2024-12. [2025-09-17T22:30:26.029192] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-03 (0.81 seconds). [2025-09-17T22:30:26.815818] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-05. [2025-09-17T22:30:27.615789] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-04. [2025-09-17T22:30:28.111866] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2024-12 (2.10 seconds). [2025-09-17T22:30:28.158521] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T22:30:28.212806] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-04 (0.60 seconds). [2025-09-17T22:30:28.415784] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-05. [2025-09-17T22:30:29.052554] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-05 (0.64 seconds). [2025-09-17T22:30:29.215794] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-01. [2025-09-17T22:30:30.015788] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-06. [2025-09-17T22:30:30.815777] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-01. [2025-09-17T22:30:31.030687] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-01 (1.81 seconds). [2025-09-17T22:30:31.067095] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-06 (1.05 seconds). [2025-09-17T22:30:31.435565] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T22:30:31.615792] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-02. [2025-09-17T22:30:32.415783] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-02. [2025-09-17T22:30:32.750245] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-02 (1.13 seconds). [2025-09-17T22:30:33.215815] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-06. [2025-09-17T22:30:33.871432] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-06 (0.66 seconds). [2025-09-17T22:30:34.015797] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-07. [2025-09-17T22:30:34.161037] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T22:30:34.801906] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T22:30:34.815743] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-08. [2025-09-17T22:30:35.615769] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-03. [2025-09-17T22:30:35.669872] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T22:30:36.415781] [INFO ] [REMOTE ] VTMX: Fetching primary data for 2025-09. [2025-09-17T22:30:36.703600] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-03 (1.09 seconds). [2025-09-17T22:30:37.206425] [INFO ] [REMOTE ] VTMX: Incremental fetch complete for 2025-09 (0.79 seconds). [2025-09-17T22:30:37.209474] [INFO ] [REMOTE ] VTMX: Full fetch complete (26132 records). [2025-09-17T22:30:37.209807] [DEBUG] [VALIDATOR ] VTMX: Validating primary data. [2025-09-17T22:30:37.222717] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-04. [2025-09-17T22:30:37.596028] [DEBUG] [VALIDATOR ] VTMX: All expected trading days are present. [2025-09-17T22:30:37.596121] [DEBUG] [VALIDATOR ] VTMX: Primary data validation passed. [2025-09-17T22:30:37.596699] [INFO ] [MAIN ] VTMX: Fetched primary data is valid. [2025-09-17T22:30:37.596761] [DEBUG] [LOCAL ] VTMX: Saving primary data. [2025-09-17T22:30:37.597435] [DEBUG] [LOCAL ] VTMX: Trimmed 26132 records to 17367 (keeping 200 days of data) [2025-09-17T22:30:37.704617] [DEBUG] [LOCAL ] VTMX: Primary data saved (17367 records). [2025-09-17T22:30:37.704804] [INFO ] [MAIN ] VTMX: Full history saved. [2025-09-17T22:30:37.704897] [INFO ] [MAIN ] Update Progress: 2259/2371 symbols completed. VTMX took 32.8s. Estimated remaining: 16m 23s. Rate: 6.8 symbols/min [2025-09-17T22:30:37.880383] [INFO ] [MAIN ] VTS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:30:37.930093] [DEBUG] [LOCAL ] VTS: Loaded 30206 existing records from primary storage. [2025-09-17T22:30:37.930261] [INFO ] [MAIN ] VTS: Loaded 30206 existing records. [2025-09-17T22:30:38.021941] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-03. [2025-09-17T22:30:38.118634] [WARN ] [MAIN ] VTS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:30:38.119013] [INFO ] [MAIN ] VTS: Wiping existing primary data before full refresh. [2025-09-17T22:30:38.119075] [INFO ] [LOCAL ] VTS: Starting deletion of primary data. [2025-09-17T22:30:38.119835] [DEBUG] [LOCAL ] VTS: Deleted primary data file. [2025-09-17T22:30:38.119898] [INFO ] [MAIN ] VTS: Starting full primary refresh. [2025-09-17T22:30:38.498357] [INFO ] [REMOTE ] VTS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:30:38.508928] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-04 (1.29 seconds). [2025-09-17T22:30:38.815827] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-11. [2025-09-17T22:30:39.615815] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-05. [2025-09-17T22:30:40.058622] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T22:30:40.097895] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T22:30:40.368800] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-05 (0.75 seconds). [2025-09-17T22:30:40.415844] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-07. [2025-09-17T22:30:41.215776] [INFO ] [REMOTE ] VTS: Fetching primary data for 2024-12. [2025-09-17T22:30:41.267224] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-07 (0.85 seconds). [2025-09-17T22:30:42.015757] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-04. [2025-09-17T22:30:42.135697] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T22:30:42.815809] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-06. [2025-09-17T22:30:43.615761] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-01. [2025-09-17T22:30:43.886680] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-06 (1.07 seconds). [2025-09-17T22:30:43.976768] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-04 (1.96 seconds). [2025-09-17T22:30:44.415837] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-07. [2025-09-17T22:30:44.982692] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-01 (1.37 seconds). [2025-09-17T22:30:45.215831] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-08. [2025-09-17T22:30:45.479566] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-07 (1.06 seconds). [2025-09-17T22:30:45.648552] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-08 (0.43 seconds). [2025-09-17T22:30:46.015783] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-08. [2025-09-17T22:30:46.815761] [INFO ] [REMOTE ] VTN: Fetching primary data for 2025-09. [2025-09-17T22:30:47.082263] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-08 (1.07 seconds). [2025-09-17T22:30:47.497584] [INFO ] [REMOTE ] VTN: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T22:30:47.499413] [INFO ] [REMOTE ] VTN: Full fetch complete (11517 records). [2025-09-17T22:30:47.499484] [DEBUG] [VALIDATOR ] VTN: Validating primary data. [2025-09-17T22:30:47.620924] [INFO ] [REMOTE ] VTOL: Fetching primary data for 2025-09. [2025-09-17T22:30:47.888147] [DEBUG] [VALIDATOR ] VTN: All expected trading days are present. [2025-09-17T22:30:47.888225] [DEBUG] [VALIDATOR ] VTN: Primary data validation passed. [2025-09-17T22:30:47.888496] [INFO ] [MAIN ] VTN: Fetched primary data is valid. [2025-09-17T22:30:47.888534] [DEBUG] [LOCAL ] VTN: Saving primary data. [2025-09-17T22:30:47.889039] [DEBUG] [LOCAL ] VTN: Trimmed 11517 records to 7183 (keeping 200 days of data) [2025-09-17T22:30:47.932171] [DEBUG] [LOCAL ] VTN: Primary data saved (7183 records). [2025-09-17T22:30:47.932304] [INFO ] [MAIN ] VTN: Full history saved. [2025-09-17T22:30:47.932409] [INFO ] [MAIN ] Update Progress: 2260/2371 symbols completed. VTN took 28.9s. Estimated remaining: 16m 15s. Rate: 6.8 symbols/min [2025-09-17T22:30:48.127785] [INFO ] [MAIN ] VVR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:30:48.162225] [DEBUG] [LOCAL ] VVR: Loaded 30198 existing records from primary storage. [2025-09-17T22:30:48.162395] [INFO ] [MAIN ] VVR: Loaded 30198 existing records. [2025-09-17T22:30:48.341705] [WARN ] [MAIN ] VVR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:30:48.341982] [INFO ] [MAIN ] VVR: Wiping existing primary data before full refresh. [2025-09-17T22:30:48.342065] [INFO ] [LOCAL ] VVR: Starting deletion of primary data. [2025-09-17T22:30:48.342791] [DEBUG] [LOCAL ] VVR: Deleted primary data file. [2025-09-17T22:30:48.342852] [INFO ] [MAIN ] VVR: Starting full primary refresh. [2025-09-17T22:30:48.420920] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-05. [2025-09-17T22:30:48.675445] [INFO ] [REMOTE ] VTOL: Incremental fetch complete for 2025-09 (1.05 seconds). [2025-09-17T22:30:48.708719] [INFO ] [REMOTE ] VTOL: Full fetch complete (26010 records). [2025-09-17T22:30:48.715427] [DEBUG] [VALIDATOR ] VTOL: Validating primary data. [2025-09-17T22:30:48.736475] [INFO ] [REMOTE ] VVR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:30:49.118241] [DEBUG] [VALIDATOR ] VTOL: All expected trading days are present. [2025-09-17T22:30:49.118360] [DEBUG] [VALIDATOR ] VTOL: Primary data validation passed. [2025-09-17T22:30:49.119029] [INFO ] [MAIN ] VTOL: Fetched primary data is valid. [2025-09-17T22:30:49.119098] [DEBUG] [LOCAL ] VTOL: Saving primary data. [2025-09-17T22:30:49.120104] [DEBUG] [LOCAL ] VTOL: Trimmed 26010 records to 19850 (keeping 200 days of data) [2025-09-17T22:30:49.216027] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-11. [2025-09-17T22:30:49.248188] [DEBUG] [LOCAL ] VTOL: Primary data saved (19850 records). [2025-09-17T22:30:49.248352] [INFO ] [MAIN ] VTOL: Full history saved. [2025-09-17T22:30:49.248445] [INFO ] [MAIN ] Update Progress: 2261/2371 symbols completed. VTOL took 30.0s. Estimated remaining: 16m 6s. Rate: 6.8 symbols/min [2025-09-17T22:30:49.430223] [INFO ] [MAIN ] VVV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:30:49.486201] [DEBUG] [LOCAL ] VVV: Loaded 50151 existing records from primary storage. [2025-09-17T22:30:49.486384] [INFO ] [MAIN ] VVV: Loaded 50151 existing records. [2025-09-17T22:30:49.682546] [WARN ] [MAIN ] VVV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:30:49.682830] [INFO ] [MAIN ] VVV: Wiping existing primary data before full refresh. [2025-09-17T22:30:49.682882] [INFO ] [LOCAL ] VVV: Starting deletion of primary data. [2025-09-17T22:30:49.683961] [DEBUG] [LOCAL ] VVV: Deleted primary data file. [2025-09-17T22:30:49.684027] [INFO ] [MAIN ] VVV: Starting full primary refresh. [2025-09-17T22:30:50.020967] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-02. [2025-09-17T22:30:50.078762] [INFO ] [REMOTE ] VVV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:30:50.671053] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-05 (2.25 seconds). [2025-09-17T22:30:50.815781] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-06. [2025-09-17T22:30:51.112040] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T22:30:51.159170] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-02 (1.14 seconds). [2025-09-17T22:30:51.615791] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-11. [2025-09-17T22:30:52.415831] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-03. [2025-09-17T22:30:52.685700] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T22:30:53.081207] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T22:30:53.215779] [INFO ] [REMOTE ] VVV: Fetching primary data for 2024-12. [2025-09-17T22:30:53.346913] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-03 (0.93 seconds). [2025-09-17T22:30:54.015787] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-04. [2025-09-17T22:30:54.815808] [INFO ] [REMOTE ] VVR: Fetching primary data for 2024-12. [2025-09-17T22:30:54.855826] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T22:30:55.521048] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T22:30:55.615799] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-01. [2025-09-17T22:30:56.261502] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2024-12 (1.45 seconds). [2025-09-17T22:30:56.415788] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-07. [2025-09-17T22:30:57.222323] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-01. [2025-09-17T22:30:57.246985] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-01 (1.63 seconds). [2025-09-17T22:30:58.015801] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-05. [2025-09-17T22:30:58.471941] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-07 (2.06 seconds). [2025-09-17T22:30:58.698995] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-01 (1.48 seconds). [2025-09-17T22:30:58.815799] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-02. [2025-09-17T22:30:58.888578] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T22:30:59.615835] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-06. [2025-09-17T22:31:00.145566] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-02 (1.33 seconds). [2025-09-17T22:31:00.415820] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-03. [2025-09-17T22:31:01.043273] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-06 (1.43 seconds). [2025-09-17T22:31:01.215781] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-07. [2025-09-17T22:31:01.773148] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T22:31:02.015834] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-02. [2025-09-17T22:31:02.733160] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-07 (1.52 seconds). [2025-09-17T22:31:02.815830] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-08. [2025-09-17T22:31:03.557386] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T22:31:03.615783] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-08. [2025-09-17T22:31:03.666772] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-08 (0.85 seconds). [2025-09-17T22:31:04.415856] [INFO ] [REMOTE ] VTS: Fetching primary data for 2025-09. [2025-09-17T22:31:05.156217] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T22:31:05.215755] [INFO ] [REMOTE ] VTR: Fetching primary data for 2025-09. [2025-09-17T22:31:05.661606] [INFO ] [REMOTE ] VTS: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T22:31:05.668830] [INFO ] [REMOTE ] VTS: Full fetch complete (40211 records). [2025-09-17T22:31:05.669501] [DEBUG] [VALIDATOR ] VTS: Validating primary data. [2025-09-17T22:31:06.021275] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-04. [2025-09-17T22:31:06.326739] [DEBUG] [VALIDATOR ] VTS: All expected trading days are present. [2025-09-17T22:31:06.328179] [INFO ] [REMOTE ] VTR: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T22:31:06.336595] [DEBUG] [VALIDATOR ] VTS: Primary data validation passed. [2025-09-17T22:31:06.338310] [INFO ] [MAIN ] VTS: Fetched primary data is valid. [2025-09-17T22:31:06.338715] [DEBUG] [LOCAL ] VTS: Saving primary data. [2025-09-17T22:31:06.338566] [INFO ] [REMOTE ] VTR: Full fetch complete (76129 records). [2025-09-17T22:31:06.338968] [DEBUG] [VALIDATOR ] VTR: Validating primary data. [2025-09-17T22:31:06.418438] [DEBUG] [LOCAL ] VTS: Trimmed 40211 records to 30328 (keeping 200 days of data) [2025-09-17T22:31:06.820926] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-03. [2025-09-17T22:31:06.987519] [DEBUG] [VALIDATOR ] VTR: All expected trading days are present. [2025-09-17T22:31:06.988760] [DEBUG] [VALIDATOR ] VTR: Primary data validation passed. [2025-09-17T22:31:06.991179] [INFO ] [MAIN ] VTR: Fetched primary data is valid. [2025-09-17T22:31:06.991877] [DEBUG] [LOCAL ] VTR: Saving primary data. [2025-09-17T22:31:07.056425] [DEBUG] [LOCAL ] VTR: Trimmed 76129 records to 52831 (keeping 200 days of data) [2025-09-17T22:31:07.185917] [DEBUG] [LOCAL ] VTS: Primary data saved (30328 records). [2025-09-17T22:31:07.187113] [INFO ] [MAIN ] VTS: Full history saved. [2025-09-17T22:31:07.187491] [INFO ] [MAIN ] Update Progress: 2262/2371 symbols completed. VTS took 29.5s. Estimated remaining: 15m 57s. Rate: 6.8 symbols/min [2025-09-17T22:31:07.371638] [INFO ] [MAIN ] VVX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:31:07.398636] [DEBUG] [LOCAL ] VVX: Loaded 23239 existing records from primary storage. [2025-09-17T22:31:07.399026] [INFO ] [MAIN ] VVX: Loaded 23239 existing records. [2025-09-17T22:31:07.591867] [WARN ] [MAIN ] VVX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:31:07.593391] [INFO ] [MAIN ] VVX: Wiping existing primary data before full refresh. [2025-09-17T22:31:07.593781] [INFO ] [LOCAL ] VVX: Starting deletion of primary data. [2025-09-17T22:31:07.594855] [DEBUG] [LOCAL ] VVX: Deleted primary data file. [2025-09-17T22:31:07.595712] [INFO ] [MAIN ] VVX: Starting full primary refresh. [2025-09-17T22:31:07.844790] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T22:31:07.972411] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-05. [2025-09-17T22:31:08.116756] [INFO ] [REMOTE ] VVX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:31:08.211998] [DEBUG] [LOCAL ] VTR: Primary data saved (52831 records). [2025-09-17T22:31:08.212153] [INFO ] [MAIN ] VTR: Full history saved. [2025-09-17T22:31:08.212265] [INFO ] [MAIN ] Update Progress: 2263/2371 symbols completed. VTR took 47.5s. Estimated remaining: 15m 48s. Rate: 6.8 symbols/min [2025-09-17T22:31:08.395816] [INFO ] [MAIN ] VYX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:31:08.421235] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-11. [2025-09-17T22:31:08.443531] [DEBUG] [LOCAL ] VYX: Loaded 49292 existing records from primary storage. [2025-09-17T22:31:08.443703] [INFO ] [MAIN ] VYX: Loaded 49292 existing records. [2025-09-17T22:31:08.633801] [WARN ] [MAIN ] VYX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:31:08.634099] [INFO ] [MAIN ] VYX: Wiping existing primary data before full refresh. [2025-09-17T22:31:08.634158] [INFO ] [LOCAL ] VYX: Starting deletion of primary data. [2025-09-17T22:31:08.635710] [DEBUG] [LOCAL ] VYX: Deleted primary data file. [2025-09-17T22:31:08.635777] [INFO ] [MAIN ] VYX: Starting full primary refresh. [2025-09-17T22:31:09.029066] [INFO ] [REMOTE ] VYX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:31:09.058833] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-03 (2.24 seconds). [2025-09-17T22:31:09.215792] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-11. [2025-09-17T22:31:09.301244] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-05 (1.33 seconds). [2025-09-17T22:31:09.326178] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-11 (0.90 seconds). [2025-09-17T22:31:10.015825] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-06. [2025-09-17T22:31:10.815812] [INFO ] [REMOTE ] VVX: Fetching primary data for 2024-12. [2025-09-17T22:31:10.917104] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-11 (1.70 seconds). [2025-09-17T22:31:11.325816] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-06 (1.31 seconds). [2025-09-17T22:31:11.615794] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-04. [2025-09-17T22:31:11.790206] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2024-12 (0.97 seconds). [2025-09-17T22:31:12.415791] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-07. [2025-09-17T22:31:13.111927] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T22:31:13.215807] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-01. [2025-09-17T22:31:13.494284] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-07 (1.08 seconds). [2025-09-17T22:31:14.015769] [INFO ] [REMOTE ] VYX: Fetching primary data for 2024-12. [2025-09-17T22:31:14.386439] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-01 (1.17 seconds). [2025-09-17T22:31:14.815817] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-02. [2025-09-17T22:31:15.620885] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-05. [2025-09-17T22:31:15.637523] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T22:31:16.002360] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-02 (1.19 seconds). [2025-09-17T22:31:16.415796] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-08. [2025-09-17T22:31:17.226787] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-01. [2025-09-17T22:31:17.232965] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T22:31:17.746507] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T22:31:18.015784] [INFO ] [REMOTE ] VVR: Fetching primary data for 2025-09. [2025-09-17T22:31:18.815856] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-06. [2025-09-17T22:31:18.962764] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T22:31:19.309250] [INFO ] [REMOTE ] VVR: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T22:31:19.314186] [INFO ] [REMOTE ] VVR: Full fetch complete (45703 records). [2025-09-17T22:31:19.314302] [DEBUG] [VALIDATOR ] VVR: Validating primary data. [2025-09-17T22:31:19.620915] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-02. [2025-09-17T22:31:19.699084] [DEBUG] [VALIDATOR ] VVR: All expected trading days are present. [2025-09-17T22:31:19.699182] [DEBUG] [VALIDATOR ] VVR: Primary data validation passed. [2025-09-17T22:31:19.700059] [INFO ] [MAIN ] VVR: Fetched primary data is valid. [2025-09-17T22:31:19.700125] [DEBUG] [LOCAL ] VVR: Saving primary data. [2025-09-17T22:31:19.701277] [DEBUG] [LOCAL ] VVR: Trimmed 45703 records to 30214 (keeping 200 days of data) [2025-09-17T22:31:19.878668] [DEBUG] [LOCAL ] VVR: Primary data saved (30214 records). [2025-09-17T22:31:19.878812] [INFO ] [MAIN ] VVR: Full history saved. [2025-09-17T22:31:19.878898] [INFO ] [MAIN ] Update Progress: 2264/2371 symbols completed. VVR took 31.9s. Estimated remaining: 15m 39s. Rate: 6.8 symbols/min [2025-09-17T22:31:20.056340] [INFO ] [MAIN ] VZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:31:20.112878] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-17T22:31:20.113025] [INFO ] [MAIN ] VZ: Loaded 53791 existing records. [2025-09-17T22:31:20.296858] [WARN ] [MAIN ] VZ: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:31:20.297392] [INFO ] [MAIN ] VZ: Wiping existing primary data before full refresh. [2025-09-17T22:31:20.297518] [INFO ] [LOCAL ] VZ: Starting deletion of primary data. [2025-09-17T22:31:20.298836] [DEBUG] [LOCAL ] VZ: Deleted primary data file. [2025-09-17T22:31:20.298903] [INFO ] [MAIN ] VZ: Starting full primary refresh. [2025-09-17T22:31:20.419433] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-03. [2025-09-17T22:31:20.614331] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T22:31:20.724857] [INFO ] [REMOTE ] VZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:31:21.215708] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-07. [2025-09-17T22:31:21.246968] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T22:31:21.988390] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-03 (1.57 seconds). [2025-09-17T22:31:22.015771] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-03. [2025-09-17T22:31:22.815785] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-04. [2025-09-17T22:31:22.983445] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-07 (1.77 seconds). [2025-09-17T22:31:23.615788] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-08. [2025-09-17T22:31:23.630844] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-04 (0.82 seconds). [2025-09-17T22:31:23.805827] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-03 (1.79 seconds). [2025-09-17T22:31:24.415780] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-04. [2025-09-17T22:31:25.093414] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T22:31:25.215804] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-05. [2025-09-17T22:31:26.015796] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-11. [2025-09-17T22:31:26.216832] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T22:31:26.556295] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T22:31:26.815790] [INFO ] [REMOTE ] VVV: Fetching primary data for 2025-09. [2025-09-17T22:31:27.615786] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-06. [2025-09-17T22:31:28.354412] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-11 (2.34 seconds). [2025-09-17T22:31:28.415795] [INFO ] [REMOTE ] VZ: Fetching primary data for 2024-12. [2025-09-17T22:31:28.752762] [INFO ] [REMOTE ] VVV: Incremental fetch complete for 2025-09 (1.94 seconds). [2025-09-17T22:31:28.759393] [INFO ] [REMOTE ] VVV: Full fetch complete (72080 records). [2025-09-17T22:31:28.759566] [DEBUG] [VALIDATOR ] VVV: Validating primary data. [2025-09-17T22:31:29.155763] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-06 (1.54 seconds). [2025-09-17T22:31:29.200809] [DEBUG] [VALIDATOR ] VVV: All expected trading days are present. [2025-09-17T22:31:29.201054] [DEBUG] [VALIDATOR ] VVV: Primary data validation passed. [2025-09-17T22:31:29.202163] [INFO ] [MAIN ] VVV: Fetched primary data is valid. [2025-09-17T22:31:29.202749] [DEBUG] [LOCAL ] VVV: Saving primary data. [2025-09-17T22:31:29.204780] [DEBUG] [LOCAL ] VVV: Trimmed 72080 records to 50149 (keeping 200 days of data) [2025-09-17T22:31:29.215801] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-05. [2025-09-17T22:31:29.515383] [DEBUG] [LOCAL ] VVV: Primary data saved (50149 records). [2025-09-17T22:31:29.515535] [INFO ] [MAIN ] VVV: Full history saved. [2025-09-17T22:31:29.515766] [INFO ] [MAIN ] Update Progress: 2265/2371 symbols completed. VVV took 40.3s. Estimated remaining: 15m 31s. Rate: 6.8 symbols/min [2025-09-17T22:31:29.698348] [INFO ] [MAIN ] W: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:31:29.753049] [DEBUG] [LOCAL ] W: Loaded 53533 existing records from primary storage. [2025-09-17T22:31:29.753282] [INFO ] [MAIN ] W: Loaded 53533 existing records. [2025-09-17T22:31:29.932476] [WARN ] [MAIN ] W: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:31:29.932763] [INFO ] [MAIN ] W: Wiping existing primary data before full refresh. [2025-09-17T22:31:29.932817] [INFO ] [LOCAL ] W: Starting deletion of primary data. [2025-09-17T22:31:29.933930] [DEBUG] [LOCAL ] W: Deleted primary data file. [2025-09-17T22:31:29.934015] [INFO ] [MAIN ] W: Starting full primary refresh. [2025-09-17T22:31:30.025012] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-07. [2025-09-17T22:31:30.300523] [INFO ] [REMOTE ] W: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:31:30.756091] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-05 (1.54 seconds). [2025-09-17T22:31:30.815761] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-06. [2025-09-17T22:31:30.862676] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2024-12 (2.45 seconds). [2025-09-17T22:31:31.127708] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-07 (1.10 seconds). [2025-09-17T22:31:31.615793] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-01. [2025-09-17T22:31:32.399400] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T22:31:32.415739] [INFO ] [REMOTE ] W: Fetching primary data for 2024-11. [2025-09-17T22:31:33.215797] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-07. [2025-09-17T22:31:34.016821] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-08. [2025-09-17T22:31:34.022634] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-01 (2.41 seconds). [2025-09-17T22:31:34.446120] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-11 (2.03 seconds). [2025-09-17T22:31:34.751087] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T22:31:34.815766] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-08. [2025-09-17T22:31:35.034871] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-08 (1.02 seconds). [2025-09-17T22:31:35.615789] [INFO ] [REMOTE ] VVX: Fetching primary data for 2025-09. [2025-09-17T22:31:36.415756] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-02. [2025-09-17T22:31:36.454193] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T22:31:36.801420] [INFO ] [REMOTE ] VVX: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T22:31:36.807343] [INFO ] [REMOTE ] VVX: Full fetch complete (33235 records). [2025-09-17T22:31:36.807535] [DEBUG] [VALIDATOR ] VVX: Validating primary data. [2025-09-17T22:31:37.223613] [INFO ] [REMOTE ] VYX: Fetching primary data for 2025-09. [2025-09-17T22:31:37.239623] [DEBUG] [VALIDATOR ] VVX: All expected trading days are present. [2025-09-17T22:31:37.239759] [DEBUG] [VALIDATOR ] VVX: Primary data validation passed. [2025-09-17T22:31:37.240451] [INFO ] [MAIN ] VVX: Fetched primary data is valid. [2025-09-17T22:31:37.240512] [DEBUG] [LOCAL ] VVX: Saving primary data. [2025-09-17T22:31:37.243437] [DEBUG] [LOCAL ] VVX: Trimmed 33235 records to 23315 (keeping 200 days of data) [2025-09-17T22:31:37.387986] [DEBUG] [LOCAL ] VVX: Primary data saved (23315 records). [2025-09-17T22:31:37.388135] [INFO ] [MAIN ] VVX: Full history saved. [2025-09-17T22:31:37.388264] [INFO ] [MAIN ] Update Progress: 2266/2371 symbols completed. VVX took 30.2s. Estimated remaining: 15m 22s. Rate: 6.8 symbols/min [2025-09-17T22:31:37.564147] [INFO ] [MAIN ] WAB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:31:37.623755] [DEBUG] [LOCAL ] WAB: Loaded 44433 existing records from primary storage. [2025-09-17T22:31:37.623933] [INFO ] [MAIN ] WAB: Loaded 44433 existing records. [2025-09-17T22:31:37.807346] [WARN ] [MAIN ] WAB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:31:37.807633] [INFO ] [MAIN ] WAB: Wiping existing primary data before full refresh. [2025-09-17T22:31:37.807720] [INFO ] [LOCAL ] WAB: Starting deletion of primary data. [2025-09-17T22:31:37.808818] [DEBUG] [LOCAL ] WAB: Deleted primary data file. [2025-09-17T22:31:37.808892] [INFO ] [MAIN ] WAB: Starting full primary refresh. [2025-09-17T22:31:38.025575] [INFO ] [REMOTE ] W: Fetching primary data for 2024-12. [2025-09-17T22:31:38.178310] [INFO ] [REMOTE ] WAB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:31:38.727558] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-02 (2.31 seconds). [2025-09-17T22:31:38.795862] [INFO ] [REMOTE ] VYX: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T22:31:38.805964] [INFO ] [REMOTE ] VYX: Full fetch complete (70132 records). [2025-09-17T22:31:38.806173] [DEBUG] [VALIDATOR ] VYX: Validating primary data. [2025-09-17T22:31:38.821381] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-11. [2025-09-17T22:31:39.215919] [DEBUG] [VALIDATOR ] VYX: All expected trading days are present. [2025-09-17T22:31:39.216004] [DEBUG] [VALIDATOR ] VYX: Primary data validation passed. [2025-09-17T22:31:39.217037] [INFO ] [MAIN ] VYX: Fetched primary data is valid. [2025-09-17T22:31:39.217102] [DEBUG] [LOCAL ] VYX: Saving primary data. [2025-09-17T22:31:39.218516] [DEBUG] [LOCAL ] VYX: Trimmed 70132 records to 49231 (keeping 200 days of data) [2025-09-17T22:31:39.522143] [DEBUG] [LOCAL ] VYX: Primary data saved (49231 records). [2025-09-17T22:31:39.522285] [INFO ] [MAIN ] VYX: Full history saved. [2025-09-17T22:31:39.523922] [INFO ] [MAIN ] Update Progress: 2267/2371 symbols completed. VYX took 31.3s. Estimated remaining: 15m 13s. Rate: 6.8 symbols/min [2025-09-17T22:31:39.620899] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-03. [2025-09-17T22:31:39.710972] [INFO ] [MAIN ] WAL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:31:39.759003] [DEBUG] [LOCAL ] WAL: Loaded 45495 existing records from primary storage. [2025-09-17T22:31:39.759168] [INFO ] [MAIN ] WAL: Loaded 45495 existing records. [2025-09-17T22:31:39.954036] [WARN ] [MAIN ] WAL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:31:39.954967] [INFO ] [MAIN ] WAL: Wiping existing primary data before full refresh. [2025-09-17T22:31:39.955131] [INFO ] [LOCAL ] WAL: Starting deletion of primary data. [2025-09-17T22:31:39.956456] [DEBUG] [LOCAL ] WAL: Deleted primary data file. [2025-09-17T22:31:39.956521] [INFO ] [MAIN ] WAL: Starting full primary refresh. [2025-09-17T22:31:40.326152] [INFO ] [REMOTE ] W: Incremental fetch complete for 2024-12 (2.30 seconds). [2025-09-17T22:31:40.367493] [INFO ] [REMOTE ] WAL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:31:40.415729] [INFO ] [REMOTE ] W: Fetching primary data for 2025-01. [2025-09-17T22:31:41.038028] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T22:31:41.215818] [INFO ] [REMOTE ] WAB: Fetching primary data for 2024-12. [2025-09-17T22:31:42.015834] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-11. [2025-09-17T22:31:42.131267] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-03 (2.51 seconds). [2025-09-17T22:31:42.214003] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T22:31:42.426702] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2024-12 (1.21 seconds). [2025-09-17T22:31:42.815782] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-04. [2025-09-17T22:31:43.615815] [INFO ] [REMOTE ] W: Fetching primary data for 2025-02. [2025-09-17T22:31:43.783456] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T22:31:44.415834] [INFO ] [REMOTE ] WAL: Fetching primary data for 2024-12. [2025-09-17T22:31:45.106857] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-04 (2.29 seconds). [2025-09-17T22:31:45.215870] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-01. [2025-09-17T22:31:45.420943] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T22:31:45.633993] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2024-12 (1.22 seconds). [2025-09-17T22:31:46.015807] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-05. [2025-09-17T22:31:46.579613] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T22:31:46.815794] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-02. [2025-09-17T22:31:47.615826] [INFO ] [REMOTE ] W: Fetching primary data for 2025-03. [2025-09-17T22:31:48.165432] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-05 (2.15 seconds). [2025-09-17T22:31:48.415808] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-01. [2025-09-17T22:31:48.533816] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-02 (1.72 seconds). [2025-09-17T22:31:49.215805] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-06. [2025-09-17T22:31:49.545867] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-03 (1.93 seconds). [2025-09-17T22:31:49.864721] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T22:31:50.015850] [INFO ] [REMOTE ] W: Fetching primary data for 2025-04. [2025-09-17T22:31:50.815774] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-02. [2025-09-17T22:31:51.521345] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-06 (2.31 seconds). [2025-09-17T22:31:51.615883] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-07. [2025-09-17T22:31:52.045858] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T22:31:52.093777] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T22:31:52.415845] [INFO ] [REMOTE ] W: Fetching primary data for 2025-05. [2025-09-17T22:31:53.215800] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-03. [2025-09-17T22:31:54.022389] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-03. [2025-09-17T22:31:54.025267] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-07 (2.41 seconds). [2025-09-17T22:31:54.580967] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T22:31:54.815757] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-08. [2025-09-17T22:31:55.210215] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T22:31:55.615796] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-04. [2025-09-17T22:31:55.799695] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T22:31:56.415834] [INFO ] [REMOTE ] W: Fetching primary data for 2025-06. [2025-09-17T22:31:57.117812] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-04 (1.50 seconds). [2025-09-17T22:31:57.221262] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-05. [2025-09-17T22:31:57.230872] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-08 (2.42 seconds). [2025-09-17T22:31:58.015851] [INFO ] [REMOTE ] VZ: Fetching primary data for 2025-09. [2025-09-17T22:31:58.293237] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T22:31:58.729202] [INFO ] [REMOTE ] VZ: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T22:31:58.741882] [INFO ] [REMOTE ] VZ: Full fetch complete (77905 records). [2025-09-17T22:31:58.742121] [DEBUG] [VALIDATOR ] VZ: Validating primary data. [2025-09-17T22:31:58.820041] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-04. [2025-09-17T22:31:59.088102] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-05 (1.87 seconds). [2025-09-17T22:31:59.342111] [DEBUG] [VALIDATOR ] VZ: All expected trading days are present. [2025-09-17T22:31:59.342219] [DEBUG] [VALIDATOR ] VZ: Primary data validation passed. [2025-09-17T22:31:59.343505] [INFO ] [MAIN ] VZ: Fetched primary data is valid. [2025-09-17T22:31:59.343596] [DEBUG] [LOCAL ] VZ: Saving primary data. [2025-09-17T22:31:59.346078] [DEBUG] [LOCAL ] VZ: Trimmed 77905 records to 53791 (keeping 200 days of data) [2025-09-17T22:31:59.617153] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-06. [2025-09-17T22:31:59.709792] [DEBUG] [LOCAL ] VZ: Primary data saved (53791 records). [2025-09-17T22:31:59.709947] [INFO ] [MAIN ] VZ: Full history saved. [2025-09-17T22:31:59.710075] [INFO ] [MAIN ] Update Progress: 2268/2371 symbols completed. VZ took 39.8s. Estimated remaining: 15m 5s. Rate: 6.8 symbols/min [2025-09-17T22:31:59.885587] [INFO ] [MAIN ] WAT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:31:59.927890] [DEBUG] [LOCAL ] WAT: Loaded 35149 existing records from primary storage. [2025-09-17T22:31:59.928047] [INFO ] [MAIN ] WAT: Loaded 35149 existing records. [2025-09-17T22:32:00.105702] [WARN ] [MAIN ] WAT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:32:00.106018] [INFO ] [MAIN ] WAT: Wiping existing primary data before full refresh. [2025-09-17T22:32:00.106066] [INFO ] [LOCAL ] WAT: Starting deletion of primary data. [2025-09-17T22:32:00.107365] [DEBUG] [LOCAL ] WAT: Deleted primary data file. [2025-09-17T22:32:00.107448] [INFO ] [MAIN ] WAT: Starting full primary refresh. [2025-09-17T22:32:00.420903] [INFO ] [REMOTE ] W: Fetching primary data for 2025-07. [2025-09-17T22:32:00.514151] [INFO ] [REMOTE ] WAT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:32:00.706614] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T22:32:01.215778] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-11. [2025-09-17T22:32:01.583840] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T22:32:02.015798] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-05. [2025-09-17T22:32:02.458131] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-11 (1.24 seconds). [2025-09-17T22:32:02.518578] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T22:32:02.815798] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-07. [2025-09-17T22:32:03.615783] [INFO ] [REMOTE ] W: Fetching primary data for 2025-08. [2025-09-17T22:32:03.698336] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T22:32:04.229050] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-07 (1.41 seconds). [2025-09-17T22:32:04.415817] [INFO ] [REMOTE ] WAT: Fetching primary data for 2024-12. [2025-09-17T22:32:05.174201] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-08 (1.56 seconds). [2025-09-17T22:32:05.215758] [INFO ] [REMOTE ] W: Fetching primary data for 2025-09. [2025-09-17T22:32:05.800706] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2024-12 (1.38 seconds). [2025-09-17T22:32:06.015807] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-01. [2025-09-17T22:32:06.815792] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-06. [2025-09-17T22:32:07.020936] [INFO ] [REMOTE ] W: Incremental fetch complete for 2025-09 (1.81 seconds). [2025-09-17T22:32:07.028109] [INFO ] [REMOTE ] W: Full fetch complete (77292 records). [2025-09-17T22:32:07.028260] [DEBUG] [VALIDATOR ] W: Validating primary data. [2025-09-17T22:32:07.437476] [DEBUG] [VALIDATOR ] W: All expected trading days are present. [2025-09-17T22:32:07.437668] [DEBUG] [VALIDATOR ] W: Primary data validation passed. [2025-09-17T22:32:07.439277] [INFO ] [MAIN ] W: Fetched primary data is valid. [2025-09-17T22:32:07.439518] [DEBUG] [LOCAL ] W: Saving primary data. [2025-09-17T22:32:07.442016] [DEBUG] [LOCAL ] W: Trimmed 77292 records to 53511 (keeping 200 days of data) [2025-09-17T22:32:07.585728] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T22:32:07.636918] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-08. [2025-09-17T22:32:07.802429] [DEBUG] [LOCAL ] W: Primary data saved (53511 records). [2025-09-17T22:32:07.802576] [INFO ] [MAIN ] W: Full history saved. [2025-09-17T22:32:07.802719] [INFO ] [MAIN ] Update Progress: 2269/2371 symbols completed. W took 38.3s. Estimated remaining: 14m 56s. Rate: 6.8 symbols/min [2025-09-17T22:32:07.975937] [INFO ] [MAIN ] WBI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:32:07.976211] [DEBUG] [LOCAL ] WBI: No existing data file found in primary storage. [2025-09-17T22:32:07.976266] [WARN ] [MAIN ] WBI: No existing data found, performing full refresh instead. [2025-09-17T22:32:07.976405] [INFO ] [MAIN ] WBI: Wiping existing primary data before full refresh. [2025-09-17T22:32:07.976459] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-17T22:32:07.976526] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-17T22:32:07.976561] [INFO ] [MAIN ] WBI: Starting full primary refresh. [2025-09-17T22:32:08.363040] [INFO ] [REMOTE ] WBI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:32:08.388612] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T22:32:08.415736] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-07. [2025-09-17T22:32:09.118186] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-08 (1.48 seconds). [2025-09-17T22:32:09.215797] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-02. [2025-09-17T22:32:09.753408] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-07 (1.34 seconds). [2025-09-17T22:32:10.015806] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-08. [2025-09-17T22:32:10.693374] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T22:32:10.815769] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-03. [2025-09-17T22:32:11.331606] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-08 (1.32 seconds). [2025-09-17T22:32:11.615772] [INFO ] [REMOTE ] WAL: Fetching primary data for 2025-09. [2025-09-17T22:32:12.293777] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-03 (1.48 seconds). [2025-09-17T22:32:12.415797] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-11. [2025-09-17T22:32:12.648835] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:32:12.649198] [WARN ] [REMOTE ] WBI: No data returned for month 2024-11 [2025-09-17T22:32:13.203952] [INFO ] [REMOTE ] WAL: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T22:32:13.210339] [INFO ] [REMOTE ] WAL: Full fetch complete (66089 records). [2025-09-17T22:32:13.210490] [DEBUG] [VALIDATOR ] WAL: Validating primary data. [2025-09-17T22:32:13.222514] [INFO ] [REMOTE ] WBI: Fetching primary data for 2024-12. [2025-09-17T22:32:13.531353] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:32:13.544862] [WARN ] [REMOTE ] WBI: No data returned for month 2024-12 [2025-09-17T22:32:13.652089] [DEBUG] [VALIDATOR ] WAL: All expected trading days are present. [2025-09-17T22:32:13.652217] [DEBUG] [VALIDATOR ] WAL: Primary data validation passed. [2025-09-17T22:32:13.653514] [INFO ] [MAIN ] WAL: Fetched primary data is valid. [2025-09-17T22:32:13.653585] [DEBUG] [LOCAL ] WAL: Saving primary data. [2025-09-17T22:32:13.655233] [DEBUG] [LOCAL ] WAL: Trimmed 66089 records to 45527 (keeping 200 days of data) [2025-09-17T22:32:13.961078] [DEBUG] [LOCAL ] WAL: Primary data saved (45527 records). [2025-09-17T22:32:13.961251] [INFO ] [MAIN ] WAL: Full history saved. [2025-09-17T22:32:13.962912] [INFO ] [MAIN ] Update Progress: 2270/2371 symbols completed. WAL took 34.4s. Estimated remaining: 14m 47s. Rate: 6.8 symbols/min [2025-09-17T22:32:14.026520] [INFO ] [REMOTE ] WAB: Fetching primary data for 2025-09. [2025-09-17T22:32:14.141518] [INFO ] [MAIN ] WBS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:32:14.189069] [DEBUG] [LOCAL ] WBS: Loaded 48884 existing records from primary storage. [2025-09-17T22:32:14.189242] [INFO ] [MAIN ] WBS: Loaded 48884 existing records. [2025-09-17T22:32:14.367370] [WARN ] [MAIN ] WBS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:32:14.367605] [INFO ] [MAIN ] WBS: Wiping existing primary data before full refresh. [2025-09-17T22:32:14.367679] [INFO ] [LOCAL ] WBS: Starting deletion of primary data. [2025-09-17T22:32:14.368757] [DEBUG] [LOCAL ] WBS: Deleted primary data file. [2025-09-17T22:32:14.368823] [INFO ] [MAIN ] WBS: Starting full primary refresh. [2025-09-17T22:32:14.737340] [INFO ] [REMOTE ] WBS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:32:14.755628] [INFO ] [REMOTE ] WAB: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T22:32:14.762011] [INFO ] [REMOTE ] WAB: Full fetch complete (64295 records). [2025-09-17T22:32:14.762186] [DEBUG] [VALIDATOR ] WAB: Validating primary data. [2025-09-17T22:32:14.820977] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-01. [2025-09-17T22:32:15.097035] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:32:15.125450] [WARN ] [REMOTE ] WBI: No data returned for month 2025-01 [2025-09-17T22:32:15.179299] [DEBUG] [VALIDATOR ] WAB: All expected trading days are present. [2025-09-17T22:32:15.179391] [DEBUG] [VALIDATOR ] WAB: Primary data validation passed. [2025-09-17T22:32:15.180361] [INFO ] [MAIN ] WAB: Fetched primary data is valid. [2025-09-17T22:32:15.180428] [DEBUG] [LOCAL ] WAB: Saving primary data. [2025-09-17T22:32:15.181857] [DEBUG] [LOCAL ] WAB: Trimmed 64295 records to 44409 (keeping 200 days of data) [2025-09-17T22:32:15.492994] [DEBUG] [LOCAL ] WAB: Primary data saved (44409 records). [2025-09-17T22:32:15.493155] [INFO ] [MAIN ] WAB: Full history saved. [2025-09-17T22:32:15.493301] [INFO ] [MAIN ] Update Progress: 2271/2371 symbols completed. WAB took 38.1s. Estimated remaining: 14m 38s. Rate: 6.8 symbols/min [2025-09-17T22:32:15.620870] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-04. [2025-09-17T22:32:15.672771] [INFO ] [MAIN ] WBX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:32:15.687854] [DEBUG] [LOCAL ] WBX: Loaded 13601 existing records from primary storage. [2025-09-17T22:32:15.688035] [INFO ] [MAIN ] WBX: Loaded 13601 existing records. [2025-09-17T22:32:15.866136] [WARN ] [MAIN ] WBX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:32:15.866404] [INFO ] [MAIN ] WBX: Wiping existing primary data before full refresh. [2025-09-17T22:32:15.866452] [INFO ] [LOCAL ] WBX: Starting deletion of primary data. [2025-09-17T22:32:15.866868] [DEBUG] [LOCAL ] WBX: Deleted primary data file. [2025-09-17T22:32:15.866927] [INFO ] [MAIN ] WBX: Starting full primary refresh. [2025-09-17T22:32:16.225314] [INFO ] [REMOTE ] WBX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:32:16.415818] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-02. [2025-09-17T22:32:16.629989] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-02: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:32:16.630348] [WARN ] [REMOTE ] WBI: No data returned for month 2025-02 [2025-09-17T22:32:17.215801] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-11. [2025-09-17T22:32:17.244081] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-04 (1.62 seconds). [2025-09-17T22:32:18.015809] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-05. [2025-09-17T22:32:18.719767] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T22:32:18.815816] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-03. [2025-09-17T22:32:19.186426] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-03: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:32:19.186781] [WARN ] [REMOTE ] WBI: No data returned for month 2025-03 [2025-09-17T22:32:19.479773] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-05 (1.46 seconds). [2025-09-17T22:32:19.615794] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-06. [2025-09-17T22:32:20.415796] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-04. [2025-09-17T22:32:20.631421] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-04: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:32:20.631756] [WARN ] [REMOTE ] WBI: No data returned for month 2025-04 [2025-09-17T22:32:20.948777] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-06 (1.33 seconds). [2025-09-17T22:32:21.215789] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-07. [2025-09-17T22:32:22.015791] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-11. [2025-09-17T22:32:22.815828] [INFO ] [REMOTE ] WBX: Fetching primary data for 2024-12. [2025-09-17T22:32:22.870008] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T22:32:23.615763] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-08. [2025-09-17T22:32:23.704961] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-11 (1.69 seconds). [2025-09-17T22:32:24.307771] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2024-12 (1.49 seconds). [2025-09-17T22:32:24.415763] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-01. [2025-09-17T22:32:24.906292] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T22:32:25.215774] [INFO ] [REMOTE ] WAT: Fetching primary data for 2025-09. [2025-09-17T22:32:25.663709] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T22:32:25.738291] [INFO ] [REMOTE ] WAT: Incremental fetch complete for 2025-09 (0.52 seconds). [2025-09-17T22:32:25.743110] [INFO ] [REMOTE ] WAT: Full fetch complete (49719 records). [2025-09-17T22:32:25.743218] [DEBUG] [VALIDATOR ] WAT: Validating primary data. [2025-09-17T22:32:26.020907] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-02. [2025-09-17T22:32:26.132784] [DEBUG] [VALIDATOR ] WAT: All expected trading days are present. [2025-09-17T22:32:26.132862] [DEBUG] [VALIDATOR ] WAT: Primary data validation passed. [2025-09-17T22:32:26.133722] [INFO ] [MAIN ] WAT: Fetched primary data is valid. [2025-09-17T22:32:26.133784] [DEBUG] [LOCAL ] WAT: Saving primary data. [2025-09-17T22:32:26.134901] [DEBUG] [LOCAL ] WAT: Trimmed 49719 records to 35144 (keeping 200 days of data) [2025-09-17T22:32:26.352145] [DEBUG] [LOCAL ] WAT: Primary data saved (35144 records). [2025-09-17T22:32:26.352307] [INFO ] [MAIN ] WAT: Full history saved. [2025-09-17T22:32:26.352426] [INFO ] [MAIN ] Update Progress: 2272/2371 symbols completed. WAT took 26.6s. Estimated remaining: 14m 29s. Rate: 6.8 symbols/min [2025-09-17T22:32:26.550755] [INFO ] [MAIN ] WCC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:32:26.594866] [DEBUG] [LOCAL ] WCC: Loaded 40293 existing records from primary storage. [2025-09-17T22:32:26.595039] [INFO ] [MAIN ] WCC: Loaded 40293 existing records. [2025-09-17T22:32:26.798493] [WARN ] [MAIN ] WCC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:32:26.798797] [INFO ] [MAIN ] WCC: Wiping existing primary data before full refresh. [2025-09-17T22:32:26.798856] [INFO ] [LOCAL ] WCC: Starting deletion of primary data. [2025-09-17T22:32:26.799745] [DEBUG] [LOCAL ] WCC: Deleted primary data file. [2025-09-17T22:32:26.799806] [INFO ] [MAIN ] WCC: Starting full primary refresh. [2025-09-17T22:32:26.821580] [INFO ] [REMOTE ] WBS: Fetching primary data for 2024-12. [2025-09-17T22:32:27.161212] [INFO ] [REMOTE ] WCC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:32:27.248911] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T22:32:27.615782] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-11. [2025-09-17T22:32:28.415699] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-05. [2025-09-17T22:32:28.520364] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2024-12 (1.70 seconds). [2025-09-17T22:32:28.617504] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-05: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:32:28.617908] [WARN ] [REMOTE ] WBI: No data returned for month 2025-05 [2025-09-17T22:32:29.029872] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T22:32:29.215790] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-01. [2025-09-17T22:32:30.015787] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-03. [2025-09-17T22:32:30.815788] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-06. [2025-09-17T22:32:31.018183] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T22:32:31.034855] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-06: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:32:31.035175] [WARN ] [REMOTE ] WBI: No data returned for month 2025-06 [2025-09-17T22:32:31.285452] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T22:32:31.615772] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-07. [2025-09-17T22:32:31.844778] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-07: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:32:31.845110] [WARN ] [REMOTE ] WBI: No data returned for month 2025-07 [2025-09-17T22:32:32.415779] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-02. [2025-09-17T22:32:33.215806] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-08. [2025-09-17T22:32:33.424012] [DEBUG] [REMOTE ] WBI: Error fetching primary data for 2025-08: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:32:33.424411] [WARN ] [REMOTE ] WBI: No data returned for month 2025-08 [2025-09-17T22:32:34.015803] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-04. [2025-09-17T22:32:34.047191] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-02 (1.63 seconds). [2025-09-17T22:32:34.815777] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-03. [2025-09-17T22:32:35.109868] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-04 (1.09 seconds). [2025-09-17T22:32:35.615775] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-05. [2025-09-17T22:32:36.373724] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T22:32:36.415786] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-04. [2025-09-17T22:32:36.641597] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-05 (1.03 seconds). [2025-09-17T22:32:37.215825] [INFO ] [REMOTE ] WCC: Fetching primary data for 2024-12. [2025-09-17T22:32:38.015807] [INFO ] [REMOTE ] WBI: Fetching primary data for 2025-09. [2025-09-17T22:32:38.078946] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T22:32:38.348440] [INFO ] [REMOTE ] WBI: Incremental fetch complete for 2025-09 (0.33 seconds). [2025-09-17T22:32:38.349313] [INFO ] [REMOTE ] WBI: Full fetch complete (183 records). [2025-09-17T22:32:38.349381] [DEBUG] [VALIDATOR ] WBI: Validating primary data. [2025-09-17T22:32:38.559161] [WARN ] [VALIDATOR ] WBI: Validation failed - insufficient historical data. Have 1 unique days, need 200 days [2025-09-17T22:32:38.559473] [FATAL] [MAIN ] WBI: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:32:38.559620] [WARN ] [MAIN ] WBI: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:32:38.559835] [INFO ] [LOCAL ] WBI: Starting deletion of primary data. [2025-09-17T22:32:38.560026] [DEBUG] [LOCAL ] WBI: No primary data file found to delete. [2025-09-17T22:32:38.560234] [INFO ] [LOCAL ] WBI: Starting deletion of derivative data. [2025-09-17T22:32:38.560555] [DEBUG] [LOCAL ] WBI: No derivative data file found to delete. [2025-09-17T22:32:38.560747] [INFO ] [MAIN ] Update Progress: 2273/2371 symbols completed. WBI took 30.8s. Estimated remaining: 14m 20s. Rate: 6.8 symbols/min [2025-09-17T22:32:38.756323] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T22:32:38.823160] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-05. [2025-09-17T22:32:38.856542] [INFO ] [MAIN ] WCN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:32:38.905688] [DEBUG] [LOCAL ] WCN: Loaded 48138 existing records from primary storage. [2025-09-17T22:32:38.905845] [INFO ] [MAIN ] WCN: Loaded 48138 existing records. [2025-09-17T22:32:39.086101] [WARN ] [MAIN ] WCN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:32:39.086423] [INFO ] [MAIN ] WCN: Wiping existing primary data before full refresh. [2025-09-17T22:32:39.086481] [INFO ] [LOCAL ] WCN: Starting deletion of primary data. [2025-09-17T22:32:39.087826] [DEBUG] [LOCAL ] WCN: Deleted primary data file. [2025-09-17T22:32:39.087888] [INFO ] [MAIN ] WCN: Starting full primary refresh. [2025-09-17T22:32:39.444111] [INFO ] [REMOTE ] WCN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:32:39.615796] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-11. [2025-09-17T22:32:40.415777] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-01. [2025-09-17T22:32:40.711000] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-05 (1.89 seconds). [2025-09-17T22:32:41.215792] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-06. [2025-09-17T22:32:41.846686] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-11 (2.23 seconds). [2025-09-17T22:32:41.989527] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T22:32:42.015675] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-02. [2025-09-17T22:32:42.065990] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-06 (0.85 seconds). [2025-09-17T22:32:42.815786] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-07. [2025-09-17T22:32:43.558623] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-02 (1.54 seconds). [2025-09-17T22:32:43.615796] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-03. [2025-09-17T22:32:43.679293] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T22:32:44.415822] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-06. [2025-09-17T22:32:45.215760] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-08. [2025-09-17T22:32:45.329880] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-03 (1.71 seconds). [2025-09-17T22:32:45.760685] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-06 (1.34 seconds). [2025-09-17T22:32:45.857401] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-08 (0.64 seconds). [2025-09-17T22:32:46.015800] [INFO ] [REMOTE ] WCN: Fetching primary data for 2024-12. [2025-09-17T22:32:46.815791] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-07. [2025-09-17T22:32:47.577771] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T22:32:47.615733] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-01. [2025-09-17T22:32:48.415795] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-04. [2025-09-17T22:32:48.601371] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-07 (1.79 seconds). [2025-09-17T22:32:49.215795] [INFO ] [REMOTE ] WBX: Fetching primary data for 2025-09. [2025-09-17T22:32:49.384197] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T22:32:49.770194] [INFO ] [REMOTE ] WBX: Incremental fetch complete for 2025-09 (0.55 seconds). [2025-09-17T22:32:49.771352] [INFO ] [REMOTE ] WBX: Full fetch complete (26702 records). [2025-09-17T22:32:49.771428] [DEBUG] [VALIDATOR ] WBX: Validating primary data. [2025-09-17T22:32:50.020941] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-02. [2025-09-17T22:32:50.160755] [DEBUG] [VALIDATOR ] WBX: All expected trading days are present. [2025-09-17T22:32:50.160855] [DEBUG] [VALIDATOR ] WBX: Primary data validation passed. [2025-09-17T22:32:50.161518] [INFO ] [MAIN ] WBX: Fetched primary data is valid. [2025-09-17T22:32:50.161594] [DEBUG] [LOCAL ] WBX: Saving primary data. [2025-09-17T22:32:50.162348] [DEBUG] [LOCAL ] WBX: Trimmed 26702 records to 13440 (keeping 200 days of data) [2025-09-17T22:32:50.251853] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-04 (1.84 seconds). [2025-09-17T22:32:50.276801] [DEBUG] [LOCAL ] WBX: Primary data saved (13440 records). [2025-09-17T22:32:50.276953] [INFO ] [MAIN ] WBX: Full history saved. [2025-09-17T22:32:50.277044] [INFO ] [MAIN ] Update Progress: 2274/2371 symbols completed. WBX took 34.8s. Estimated remaining: 14m 12s. Rate: 6.8 symbols/min [2025-09-17T22:32:50.454536] [INFO ] [MAIN ] WD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:32:50.478179] [DEBUG] [LOCAL ] WD: Loaded 23478 existing records from primary storage. [2025-09-17T22:32:50.478313] [INFO ] [MAIN ] WD: Loaded 23478 existing records. [2025-09-17T22:32:50.662981] [WARN ] [MAIN ] WD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:32:50.663229] [INFO ] [MAIN ] WD: Wiping existing primary data before full refresh. [2025-09-17T22:32:50.663276] [INFO ] [LOCAL ] WD: Starting deletion of primary data. [2025-09-17T22:32:50.664032] [DEBUG] [LOCAL ] WD: Deleted primary data file. [2025-09-17T22:32:50.664113] [INFO ] [MAIN ] WD: Starting full primary refresh. [2025-09-17T22:32:50.825672] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-05. [2025-09-17T22:32:51.030531] [INFO ] [REMOTE ] WD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:32:51.615846] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-11. [2025-09-17T22:32:51.823821] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T22:32:52.224968] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-11 (0.61 seconds). [2025-09-17T22:32:52.415818] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-08. [2025-09-17T22:32:52.684413] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T22:32:53.215784] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-06. [2025-09-17T22:32:54.015821] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-03. [2025-09-17T22:32:54.155280] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T22:32:54.354216] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-06 (1.14 seconds). [2025-09-17T22:32:54.815817] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-07. [2025-09-17T22:32:55.615776] [INFO ] [REMOTE ] WD: Fetching primary data for 2024-12. [2025-09-17T22:32:55.883233] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T22:32:56.415795] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-04. [2025-09-17T22:32:56.669912] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2024-12 (1.05 seconds). [2025-09-17T22:32:56.703680] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T22:32:57.215815] [INFO ] [REMOTE ] WBS: Fetching primary data for 2025-09. [2025-09-17T22:32:58.015787] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-08. [2025-09-17T22:32:58.289190] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-04 (1.87 seconds). [2025-09-17T22:32:58.821031] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-05. [2025-09-17T22:32:58.837377] [INFO ] [REMOTE ] WBS: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T22:32:58.844495] [INFO ] [REMOTE ] WBS: Full fetch complete (69166 records). [2025-09-17T22:32:58.844606] [DEBUG] [VALIDATOR ] WBS: Validating primary data. [2025-09-17T22:32:59.255138] [DEBUG] [VALIDATOR ] WBS: All expected trading days are present. [2025-09-17T22:32:59.255218] [DEBUG] [VALIDATOR ] WBS: Primary data validation passed. [2025-09-17T22:32:59.256214] [INFO ] [MAIN ] WBS: Fetched primary data is valid. [2025-09-17T22:32:59.256289] [DEBUG] [LOCAL ] WBS: Saving primary data. [2025-09-17T22:32:59.257629] [DEBUG] [LOCAL ] WBS: Trimmed 69166 records to 48893 (keeping 200 days of data) [2025-09-17T22:32:59.575555] [DEBUG] [LOCAL ] WBS: Primary data saved (48893 records). [2025-09-17T22:32:59.576010] [INFO ] [MAIN ] WBS: Full history saved. [2025-09-17T22:32:59.577132] [INFO ] [MAIN ] Update Progress: 2275/2371 symbols completed. WBS took 45.6s. Estimated remaining: 14m 3s. Rate: 6.8 symbols/min [2025-09-17T22:32:59.625266] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-01. [2025-09-17T22:32:59.763707] [INFO ] [MAIN ] WDH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:32:59.787291] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T22:32:59.807756] [DEBUG] [LOCAL ] WDH: Loaded 16065 existing records from primary storage. [2025-09-17T22:32:59.807887] [INFO ] [MAIN ] WDH: Loaded 16065 existing records. [2025-09-17T22:32:59.984800] [WARN ] [MAIN ] WDH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:32:59.985049] [INFO ] [MAIN ] WDH: Wiping existing primary data before full refresh. [2025-09-17T22:32:59.985099] [INFO ] [LOCAL ] WDH: Starting deletion of primary data. [2025-09-17T22:32:59.985493] [DEBUG] [LOCAL ] WDH: Deleted primary data file. [2025-09-17T22:32:59.985551] [INFO ] [MAIN ] WDH: Starting full primary refresh. [2025-09-17T22:33:00.363818] [INFO ] [REMOTE ] WDH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:33:00.397194] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T22:33:00.415740] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-06. [2025-09-17T22:33:00.879509] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T22:33:01.215801] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-11. [2025-09-17T22:33:01.977255] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-11 (0.76 seconds). [2025-09-17T22:33:02.015743] [INFO ] [REMOTE ] WDH: Fetching primary data for 2024-12. [2025-09-17T22:33:02.091486] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T22:33:02.815841] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-07. [2025-09-17T22:33:03.324435] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T22:33:03.615797] [INFO ] [REMOTE ] WCC: Fetching primary data for 2025-09. [2025-09-17T22:33:04.415827] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-02. [2025-09-17T22:33:05.215810] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-01. [2025-09-17T22:33:05.392929] [INFO ] [REMOTE ] WCC: Incremental fetch complete for 2025-09 (1.78 seconds). [2025-09-17T22:33:05.398501] [INFO ] [REMOTE ] WCC: Full fetch complete (57584 records). [2025-09-17T22:33:05.398726] [DEBUG] [VALIDATOR ] WCC: Validating primary data. [2025-09-17T22:33:05.824301] [DEBUG] [VALIDATOR ] WCC: All expected trading days are present. [2025-09-17T22:33:05.824549] [DEBUG] [VALIDATOR ] WCC: Primary data validation passed. [2025-09-17T22:33:05.825892] [INFO ] [MAIN ] WCC: Fetched primary data is valid. [2025-09-17T22:33:05.826114] [DEBUG] [LOCAL ] WCC: Saving primary data. [2025-09-17T22:33:05.834502] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-01 (0.62 seconds). [2025-09-17T22:33:05.838566] [DEBUG] [LOCAL ] WCC: Trimmed 57584 records to 40333 (keeping 200 days of data) [2025-09-17T22:33:05.967200] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-07 (3.15 seconds). [2025-09-17T22:33:06.016246] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-08. [2025-09-17T22:33:06.151791] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T22:33:06.172280] [DEBUG] [LOCAL ] WCC: Primary data saved (40333 records). [2025-09-17T22:33:06.172433] [INFO ] [MAIN ] WCC: Full history saved. [2025-09-17T22:33:06.172543] [INFO ] [MAIN ] Update Progress: 2276/2371 symbols completed. WCC took 39.8s. Estimated remaining: 13m 54s. Rate: 6.8 symbols/min [2025-09-17T22:33:06.348034] [INFO ] [MAIN ] WDI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:33:06.348223] [DEBUG] [LOCAL ] WDI: No existing data file found in primary storage. [2025-09-17T22:33:06.348262] [WARN ] [MAIN ] WDI: No existing data found, performing full refresh instead. [2025-09-17T22:33:06.348433] [INFO ] [MAIN ] WDI: Wiping existing primary data before full refresh. [2025-09-17T22:33:06.348477] [INFO ] [LOCAL ] WDI: Starting deletion of primary data. [2025-09-17T22:33:06.348518] [DEBUG] [LOCAL ] WDI: No primary data file found to delete. [2025-09-17T22:33:06.348552] [INFO ] [MAIN ] WDI: Starting full primary refresh. [2025-09-17T22:33:06.711201] [INFO ] [REMOTE ] WDI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:33:06.815803] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-02. [2025-09-17T22:33:07.615790] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-11. [2025-09-17T22:33:07.663472] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T22:33:07.806017] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T22:33:08.415790] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-03. [2025-09-17T22:33:08.597544] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-11 (0.98 seconds). [2025-09-17T22:33:09.215824] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-03. [2025-09-17T22:33:09.519869] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-03 (1.10 seconds). [2025-09-17T22:33:10.015801] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-04. [2025-09-17T22:33:10.424307] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-03 (1.21 seconds). [2025-09-17T22:33:10.815807] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-04. [2025-09-17T22:33:10.949079] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-04 (0.93 seconds). [2025-09-17T22:33:11.615780] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-05. [2025-09-17T22:33:12.086382] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-04 (1.27 seconds). [2025-09-17T22:33:12.381478] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-05 (0.77 seconds). [2025-09-17T22:33:12.415734] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-06. [2025-09-17T22:33:13.215816] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-05. [2025-09-17T22:33:13.271693] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T22:33:14.015801] [INFO ] [REMOTE ] WCN: Fetching primary data for 2025-09. [2025-09-17T22:33:14.483937] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-05 (1.27 seconds). [2025-09-17T22:33:14.815792] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-06. [2025-09-17T22:33:15.611601] [INFO ] [REMOTE ] WCN: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T22:33:15.617464] [INFO ] [REMOTE ] WDI: Fetching primary data for 2024-12. [2025-09-17T22:33:15.619753] [INFO ] [REMOTE ] WCN: Full fetch complete (69092 records). [2025-09-17T22:33:15.619892] [DEBUG] [VALIDATOR ] WCN: Validating primary data. [2025-09-17T22:33:16.028877] [DEBUG] [VALIDATOR ] WCN: All expected trading days are present. [2025-09-17T22:33:16.034202] [DEBUG] [VALIDATOR ] WCN: Primary data validation passed. [2025-09-17T22:33:16.042858] [INFO ] [MAIN ] WCN: Fetched primary data is valid. [2025-09-17T22:33:16.043021] [DEBUG] [LOCAL ] WCN: Saving primary data. [2025-09-17T22:33:16.044357] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-06 (1.23 seconds). [2025-09-17T22:33:16.051083] [DEBUG] [LOCAL ] WCN: Trimmed 69092 records to 48091 (keeping 200 days of data) [2025-09-17T22:33:16.368555] [DEBUG] [LOCAL ] WCN: Primary data saved (48091 records). [2025-09-17T22:33:16.368744] [INFO ] [MAIN ] WCN: Full history saved. [2025-09-17T22:33:16.368856] [INFO ] [MAIN ] Update Progress: 2277/2371 symbols completed. WCN took 37.8s. Estimated remaining: 13m 45s. Rate: 6.8 symbols/min [2025-09-17T22:33:16.415796] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-07. [2025-09-17T22:33:17.215703] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-07. [2025-09-17T22:33:17.381002] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T22:33:18.015781] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-01. [2025-09-17T22:33:18.511627] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-07 (2.10 seconds). [2025-09-17T22:33:18.815747] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-08. [2025-09-17T22:33:18.851954] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-01 (0.84 seconds). [2025-09-17T22:33:18.949304] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T22:33:19.615791] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-08. [2025-09-17T22:33:19.879381] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T22:33:20.415805] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-02. [2025-09-17T22:33:20.696724] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-08 (1.08 seconds). [2025-09-17T22:33:21.215783] [INFO ] [REMOTE ] WD: Fetching primary data for 2025-09. [2025-09-17T22:33:21.438485] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-02 (1.02 seconds). [2025-09-17T22:33:22.015782] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-03. [2025-09-17T22:33:22.328004] [INFO ] [REMOTE ] WD: Incremental fetch complete for 2025-09 (1.11 seconds). [2025-09-17T22:33:22.331889] [INFO ] [REMOTE ] WD: Full fetch complete (32400 records). [2025-09-17T22:33:22.331999] [DEBUG] [VALIDATOR ] WD: Validating primary data. [2025-09-17T22:33:22.717007] [DEBUG] [VALIDATOR ] WD: All expected trading days are present. [2025-09-17T22:33:22.717164] [DEBUG] [VALIDATOR ] WD: Primary data validation passed. [2025-09-17T22:33:22.717836] [INFO ] [MAIN ] WD: Fetched primary data is valid. [2025-09-17T22:33:22.717916] [DEBUG] [LOCAL ] WD: Saving primary data. [2025-09-17T22:33:22.718720] [DEBUG] [LOCAL ] WD: Trimmed 32400 records to 23480 (keeping 200 days of data) [2025-09-17T22:33:22.816698] [INFO ] [REMOTE ] WDH: Fetching primary data for 2025-09. [2025-09-17T22:33:22.869341] [DEBUG] [LOCAL ] WD: Primary data saved (23480 records). [2025-09-17T22:33:22.869474] [INFO ] [MAIN ] WD: Full history saved. [2025-09-17T22:33:22.869580] [INFO ] [MAIN ] Update Progress: 2278/2371 symbols completed. WD took 32.6s. Estimated remaining: 13m 37s. Rate: 6.8 symbols/min [2025-09-17T22:33:23.147965] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T22:33:23.615804] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-04. [2025-09-17T22:33:24.418538] [INFO ] [REMOTE ] WDH: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T22:33:24.424361] [INFO ] [REMOTE ] WDH: Full fetch complete (21908 records). [2025-09-17T22:33:24.424527] [DEBUG] [VALIDATOR ] WDH: Validating primary data. [2025-09-17T22:33:24.822270] [DEBUG] [VALIDATOR ] WDH: All expected trading days are present. [2025-09-17T22:33:24.823355] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T22:33:24.823527] [DEBUG] [VALIDATOR ] WDH: Primary data validation passed. [2025-09-17T22:33:24.829411] [INFO ] [MAIN ] WDH: Fetched primary data is valid. [2025-09-17T22:33:24.830015] [DEBUG] [LOCAL ] WDH: Saving primary data. [2025-09-17T22:33:24.830349] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-05. [2025-09-17T22:33:24.832417] [DEBUG] [LOCAL ] WDH: Trimmed 21908 records to 16292 (keeping 200 days of data) [2025-09-17T22:33:24.931423] [DEBUG] [LOCAL ] WDH: Primary data saved (16292 records). [2025-09-17T22:33:24.931587] [INFO ] [MAIN ] WDH: Full history saved. [2025-09-17T22:33:24.931704] [INFO ] [MAIN ] Update Progress: 2279/2371 symbols completed. WDH took 25.4s. Estimated remaining: 13m 27s. Rate: 6.8 symbols/min [2025-09-17T22:33:26.062384] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-05 (1.23 seconds). [2025-09-17T22:33:26.067440] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-06. [2025-09-17T22:33:27.175065] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T22:33:27.180064] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-07. [2025-09-17T22:33:28.314945] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-07 (1.13 seconds). [2025-09-17T22:33:28.320098] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-08. [2025-09-17T22:33:29.424325] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-08 (1.10 seconds). [2025-09-17T22:33:29.429154] [INFO ] [REMOTE ] WDI: Fetching primary data for 2025-09. [2025-09-17T22:33:30.510704] [INFO ] [REMOTE ] WDI: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T22:33:30.513457] [INFO ] [REMOTE ] WDI: Full fetch complete (30886 records). [2025-09-17T22:33:30.513536] [DEBUG] [VALIDATOR ] WDI: Validating primary data. [2025-09-17T22:33:30.892933] [DEBUG] [VALIDATOR ] WDI: All expected trading days are present. [2025-09-17T22:33:30.893032] [DEBUG] [VALIDATOR ] WDI: Primary data validation passed. [2025-09-17T22:33:30.893754] [INFO ] [MAIN ] WDI: Fetched primary data is valid. [2025-09-17T22:33:30.893820] [DEBUG] [LOCAL ] WDI: Saving primary data. [2025-09-17T22:33:30.894603] [DEBUG] [LOCAL ] WDI: Trimmed 30886 records to 21348 (keeping 200 days of data) [2025-09-17T22:33:31.030377] [DEBUG] [LOCAL ] WDI: Primary data saved (21348 records). [2025-09-17T22:33:31.030523] [INFO ] [MAIN ] WDI: Full history saved. [2025-09-17T22:33:31.030617] [INFO ] [MAIN ] Update Progress: 2280/2371 symbols completed. WDI took 24.9s. Estimated remaining: 13m 19s. Rate: 6.8 symbols/min [2025-09-17T22:33:31.630141] [INFO ] [MAIN ] WEAV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:33:31.725405] [INFO ] [MAIN ] WEC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:33:31.729844] [INFO ] [MAIN ] WDS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:33:31.765209] [INFO ] [MAIN ] WEA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:33:31.786186] [DEBUG] [LOCAL ] WEA: Loaded 7463 existing records from primary storage. [2025-09-17T22:33:31.786503] [INFO ] [MAIN ] WEA: Loaded 7463 existing records. [2025-09-17T22:33:31.956002] [DEBUG] [LOCAL ] WEAV: Loaded 42016 existing records from primary storage. [2025-09-17T22:33:31.972306] [INFO ] [MAIN ] WEAV: Loaded 42016 existing records. [2025-09-17T22:33:32.073549] [WARN ] [MAIN ] WEA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:33:32.114259] [DEBUG] [LOCAL ] WDS: Loaded 43801 existing records from primary storage. [2025-09-17T22:33:32.141694] [INFO ] [MAIN ] WEA: Wiping existing primary data before full refresh. [2025-09-17T22:33:32.142613] [DEBUG] [LOCAL ] WEC: Loaded 52248 existing records from primary storage. [2025-09-17T22:33:32.142763] [INFO ] [LOCAL ] WEA: Starting deletion of primary data. [2025-09-17T22:33:32.147999] [INFO ] [MAIN ] WDS: Loaded 43801 existing records. [2025-09-17T22:33:32.163573] [INFO ] [MAIN ] WEC: Loaded 52248 existing records. [2025-09-17T22:33:32.180475] [DEBUG] [LOCAL ] WEA: Deleted primary data file. [2025-09-17T22:33:32.226745] [INFO ] [MAIN ] WEA: Starting full primary refresh. [2025-09-17T22:33:32.705172] [WARN ] [MAIN ] WEC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:33:32.757440] [WARN ] [MAIN ] WEAV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:33:32.789296] [WARN ] [MAIN ] WDS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:33:32.802345] [INFO ] [MAIN ] WEC: Wiping existing primary data before full refresh. [2025-09-17T22:33:32.850472] [INFO ] [LOCAL ] WEC: Starting deletion of primary data. [2025-09-17T22:33:32.859373] [INFO ] [MAIN ] WEAV: Wiping existing primary data before full refresh. [2025-09-17T22:33:32.876426] [DEBUG] [LOCAL ] WEC: Deleted primary data file. [2025-09-17T22:33:32.876368] [INFO ] [LOCAL ] WEAV: Starting deletion of primary data. [2025-09-17T22:33:32.878827] [INFO ] [MAIN ] WDS: Wiping existing primary data before full refresh. [2025-09-17T22:33:32.878697] [INFO ] [MAIN ] WEC: Starting full primary refresh. [2025-09-17T22:33:32.893031] [DEBUG] [LOCAL ] WEAV: Deleted primary data file. [2025-09-17T22:33:32.893125] [INFO ] [LOCAL ] WDS: Starting deletion of primary data. [2025-09-17T22:33:32.898394] [INFO ] [MAIN ] WEAV: Starting full primary refresh. [2025-09-17T22:33:32.963895] [DEBUG] [LOCAL ] WDS: Deleted primary data file. [2025-09-17T22:33:32.969146] [INFO ] [MAIN ] WDS: Starting full primary refresh. [2025-09-17T22:33:33.339158] [INFO ] [REMOTE ] WEA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:33:33.370263] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-11. [2025-09-17T22:33:33.993190] [INFO ] [REMOTE ] WEAV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:33:34.124600] [INFO ] [REMOTE ] WEC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:33:34.063732] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-11. [2025-09-17T22:33:34.146908] [INFO ] [REMOTE ] WDS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:33:34.148277] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-11. [2025-09-17T22:33:34.147165] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-11. [2025-09-17T22:33:34.183797] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-11 (0.81 seconds). [2025-09-17T22:33:34.185435] [INFO ] [REMOTE ] WEA: Fetching primary data for 2024-12. [2025-09-17T22:33:34.873886] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2024-12 (0.69 seconds). [2025-09-17T22:33:34.875922] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-01. [2025-09-17T22:33:35.577977] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-01 (0.70 seconds). [2025-09-17T22:33:35.579819] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-02. [2025-09-17T22:33:35.677777] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T22:33:35.686807] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2024-12. [2025-09-17T22:33:35.796803] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-11 (1.65 seconds). [2025-09-17T22:33:35.806747] [INFO ] [REMOTE ] WEC: Fetching primary data for 2024-12. [2025-09-17T22:33:35.933091] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T22:33:35.942170] [INFO ] [REMOTE ] WDS: Fetching primary data for 2024-12. [2025-09-17T22:33:36.340249] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T22:33:36.415742] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-03. [2025-09-17T22:33:36.814668] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-03 (0.40 seconds). [2025-09-17T22:33:36.996633] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2024-12 (1.31 seconds). [2025-09-17T22:33:37.215803] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-01. [2025-09-17T22:33:37.608874] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T22:33:37.697239] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2024-12 (1.76 seconds). [2025-09-17T22:33:38.015776] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-01. [2025-09-17T22:33:38.636053] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T22:33:38.815814] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-02. [2025-09-17T22:33:39.615761] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-01. [2025-09-17T22:33:39.708953] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T22:33:40.375370] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T22:33:40.415795] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-03. [2025-09-17T22:33:41.215859] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-02. [2025-09-17T22:33:41.256308] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-01 (1.64 seconds). [2025-09-17T22:33:41.956419] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-03 (1.54 seconds). [2025-09-17T22:33:42.015801] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-02. [2025-09-17T22:33:42.815780] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-04. [2025-09-17T22:33:43.011453] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T22:33:43.574924] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-02 (1.56 seconds). [2025-09-17T22:33:43.615845] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-03. [2025-09-17T22:33:43.871558] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-04 (1.06 seconds). [2025-09-17T22:33:44.415990] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-03. [2025-09-17T22:33:45.215805] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-05. [2025-09-17T22:33:45.701788] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-03 (2.09 seconds). [2025-09-17T22:33:46.015787] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-04. [2025-09-17T22:33:46.378502] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T22:33:46.817759] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-04. [2025-09-17T22:33:46.820164] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T22:33:47.560010] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-04 (1.54 seconds). [2025-09-17T22:33:47.615812] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-04. [2025-09-17T22:33:48.146698] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T22:33:48.415754] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-05. [2025-09-17T22:33:48.619232] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T22:33:49.215794] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-05. [2025-09-17T22:33:50.015778] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-05. [2025-09-17T22:33:50.136438] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T22:33:50.184763] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-05 (0.97 seconds). [2025-09-17T22:33:50.815782] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-06. [2025-09-17T22:33:51.615785] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-06. [2025-09-17T22:33:52.078465] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-05 (2.06 seconds). [2025-09-17T22:33:52.415790] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-06. [2025-09-17T22:33:52.687316] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-06 (1.87 seconds). [2025-09-17T22:33:53.150236] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T22:33:53.165534] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-06 (0.75 seconds). [2025-09-17T22:33:53.215750] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-07. [2025-09-17T22:33:54.015808] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-07. [2025-09-17T22:33:54.821035] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-07. [2025-09-17T22:33:54.832596] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T22:33:54.998868] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-07 (0.98 seconds). [2025-09-17T22:33:55.615791] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-08. [2025-09-17T22:33:56.385439] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-08 (0.77 seconds). [2025-09-17T22:33:56.415739] [INFO ] [REMOTE ] WEA: Fetching primary data for 2025-09. [2025-09-17T22:33:56.466021] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T22:33:57.052594] [INFO ] [REMOTE ] WEA: Incremental fetch complete for 2025-09 (0.64 seconds). [2025-09-17T22:33:57.054410] [INFO ] [REMOTE ] WEA: Full fetch complete (9966 records). [2025-09-17T22:33:57.054530] [DEBUG] [VALIDATOR ] WEA: Validating primary data. [2025-09-17T22:33:57.239185] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-08. [2025-09-17T22:33:57.431534] [DEBUG] [VALIDATOR ] WEA: All expected trading days are present. [2025-09-17T22:33:57.431610] [DEBUG] [VALIDATOR ] WEA: Primary data validation passed. [2025-09-17T22:33:57.431858] [INFO ] [MAIN ] WEA: Fetched primary data is valid. [2025-09-17T22:33:57.431938] [DEBUG] [LOCAL ] WEA: Saving primary data. [2025-09-17T22:33:57.432430] [DEBUG] [LOCAL ] WEA: Trimmed 9966 records to 7497 (keeping 200 days of data) [2025-09-17T22:33:57.479572] [DEBUG] [LOCAL ] WEA: Primary data saved (7497 records). [2025-09-17T22:33:57.479728] [INFO ] [MAIN ] WEA: Full history saved. [2025-09-17T22:33:57.479904] [INFO ] [MAIN ] Update Progress: 2281/2371 symbols completed. WEA took 26.4s. Estimated remaining: 13m 11s. Rate: 6.8 symbols/min [2025-09-17T22:33:57.649860] [INFO ] [MAIN ] WELL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:33:57.724759] [DEBUG] [LOCAL ] WELL: Loaded 52362 existing records from primary storage. [2025-09-17T22:33:57.724982] [INFO ] [MAIN ] WELL: Loaded 52362 existing records. [2025-09-17T22:33:57.906775] [WARN ] [MAIN ] WELL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:33:57.907087] [INFO ] [MAIN ] WELL: Wiping existing primary data before full refresh. [2025-09-17T22:33:57.907162] [INFO ] [LOCAL ] WELL: Starting deletion of primary data. [2025-09-17T22:33:57.908887] [DEBUG] [LOCAL ] WELL: Deleted primary data file. [2025-09-17T22:33:57.908969] [INFO ] [MAIN ] WELL: Starting full primary refresh. [2025-09-17T22:33:58.020990] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-08. [2025-09-17T22:33:58.283416] [INFO ] [REMOTE ] WELL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:33:58.815835] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-11. [2025-09-17T22:33:58.921385] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-08 (1.68 seconds). [2025-09-17T22:33:59.156062] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T22:33:59.615813] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-06. [2025-09-17T22:34:00.415813] [INFO ] [REMOTE ] WEAV: Fetching primary data for 2025-09. [2025-09-17T22:34:01.115452] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-11 (2.30 seconds). [2025-09-17T22:34:01.215831] [INFO ] [REMOTE ] WDS: Fetching primary data for 2025-09. [2025-09-17T22:34:01.712999] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-06 (2.10 seconds). [2025-09-17T22:34:01.986020] [INFO ] [REMOTE ] WEAV: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T22:34:01.993254] [INFO ] [REMOTE ] WEAV: Full fetch complete (61416 records). [2025-09-17T22:34:01.993435] [DEBUG] [VALIDATOR ] WEAV: Validating primary data. [2025-09-17T22:34:02.021111] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-07. [2025-09-17T22:34:02.437148] [DEBUG] [VALIDATOR ] WEAV: All expected trading days are present. [2025-09-17T22:34:02.437257] [DEBUG] [VALIDATOR ] WEAV: Primary data validation passed. [2025-09-17T22:34:02.438277] [INFO ] [MAIN ] WEAV: Fetched primary data is valid. [2025-09-17T22:34:02.438342] [DEBUG] [LOCAL ] WEAV: Saving primary data. [2025-09-17T22:34:02.440633] [DEBUG] [LOCAL ] WEAV: Trimmed 61416 records to 42014 (keeping 200 days of data) [2025-09-17T22:34:02.688794] [DEBUG] [LOCAL ] WEAV: Primary data saved (42014 records). [2025-09-17T22:34:02.688931] [INFO ] [MAIN ] WEAV: Full history saved. [2025-09-17T22:34:02.689834] [INFO ] [MAIN ] Update Progress: 2282/2371 symbols completed. WEAV took 31.7s. Estimated remaining: 13m 2s. Rate: 6.8 symbols/min [2025-09-17T22:34:02.846629] [INFO ] [REMOTE ] WELL: Fetching primary data for 2024-12. [2025-09-17T22:34:02.868557] [INFO ] [MAIN ] WES: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:34:02.890115] [INFO ] [REMOTE ] WDS: Incremental fetch complete for 2025-09 (1.67 seconds). [2025-09-17T22:34:02.898337] [INFO ] [REMOTE ] WDS: Full fetch complete (64739 records). [2025-09-17T22:34:02.898516] [DEBUG] [VALIDATOR ] WDS: Validating primary data. [2025-09-17T22:34:03.255495] [DEBUG] [LOCAL ] WES: Loaded 48111 existing records from primary storage. [2025-09-17T22:34:03.258777] [INFO ] [MAIN ] WES: Loaded 48111 existing records. [2025-09-17T22:34:03.509503] [DEBUG] [VALIDATOR ] WDS: All expected trading days are present. [2025-09-17T22:34:03.528931] [DEBUG] [VALIDATOR ] WDS: Primary data validation passed. [2025-09-17T22:34:03.531203] [INFO ] [MAIN ] WDS: Fetched primary data is valid. [2025-09-17T22:34:03.538908] [DEBUG] [LOCAL ] WDS: Saving primary data. [2025-09-17T22:34:03.552312] [WARN ] [MAIN ] WES: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:34:03.552742] [INFO ] [MAIN ] WES: Wiping existing primary data before full refresh. [2025-09-17T22:34:03.552811] [INFO ] [LOCAL ] WES: Starting deletion of primary data. [2025-09-17T22:34:03.553486] [DEBUG] [LOCAL ] WDS: Trimmed 64739 records to 43801 (keeping 200 days of data) [2025-09-17T22:34:03.554110] [DEBUG] [LOCAL ] WES: Deleted primary data file. [2025-09-17T22:34:03.554190] [INFO ] [MAIN ] WES: Starting full primary refresh. [2025-09-17T22:34:04.039729] [INFO ] [REMOTE ] WES: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:34:04.041189] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-11. [2025-09-17T22:34:04.098247] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-07 (2.08 seconds). [2025-09-17T22:34:04.253730] [DEBUG] [LOCAL ] WDS: Primary data saved (43801 records). [2025-09-17T22:34:04.253886] [INFO ] [MAIN ] WDS: Full history saved. [2025-09-17T22:34:04.254023] [INFO ] [MAIN ] Update Progress: 2283/2371 symbols completed. WDS took 33.2s. Estimated remaining: 12m 53s. Rate: 6.8 symbols/min [2025-09-17T22:34:04.431849] [INFO ] [MAIN ] WEX: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:34:04.430318] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-08. [2025-09-17T22:34:04.476030] [DEBUG] [LOCAL ] WEX: Loaded 35787 existing records from primary storage. [2025-09-17T22:34:04.476268] [INFO ] [MAIN ] WEX: Loaded 35787 existing records. [2025-09-17T22:34:04.633811] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T22:34:04.710782] [WARN ] [MAIN ] WEX: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:34:04.711029] [INFO ] [MAIN ] WEX: Wiping existing primary data before full refresh. [2025-09-17T22:34:04.711076] [INFO ] [LOCAL ] WEX: Starting deletion of primary data. [2025-09-17T22:34:04.711934] [DEBUG] [LOCAL ] WEX: Deleted primary data file. [2025-09-17T22:34:04.712002] [INFO ] [MAIN ] WEX: Starting full primary refresh. [2025-09-17T22:34:05.073791] [INFO ] [REMOTE ] WEX: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:34:05.215772] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-11. [2025-09-17T22:34:05.945887] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-11 (1.90 seconds). [2025-09-17T22:34:06.016015] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-01. [2025-09-17T22:34:06.050986] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-08 (1.62 seconds). [2025-09-17T22:34:06.815810] [INFO ] [REMOTE ] WEC: Fetching primary data for 2025-09. [2025-09-17T22:34:06.839217] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T22:34:07.539227] [INFO ] [REMOTE ] WEC: Incremental fetch complete for 2025-09 (0.72 seconds). [2025-09-17T22:34:07.546149] [INFO ] [REMOTE ] WEC: Full fetch complete (75262 records). [2025-09-17T22:34:07.546293] [DEBUG] [VALIDATOR ] WEC: Validating primary data. [2025-09-17T22:34:07.623853] [INFO ] [REMOTE ] WEX: Fetching primary data for 2024-12. [2025-09-17T22:34:07.988697] [DEBUG] [VALIDATOR ] WEC: All expected trading days are present. [2025-09-17T22:34:07.988924] [DEBUG] [VALIDATOR ] WEC: Primary data validation passed. [2025-09-17T22:34:07.990205] [INFO ] [MAIN ] WEC: Fetched primary data is valid. [2025-09-17T22:34:07.990436] [DEBUG] [LOCAL ] WEC: Saving primary data. [2025-09-17T22:34:07.994672] [DEBUG] [LOCAL ] WEC: Trimmed 75262 records to 52233 (keeping 200 days of data) [2025-09-17T22:34:08.025679] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-01 (2.01 seconds). [2025-09-17T22:34:08.371363] [DEBUG] [LOCAL ] WEC: Primary data saved (52233 records). [2025-09-17T22:34:08.371515] [INFO ] [MAIN ] WEC: Full history saved. [2025-09-17T22:34:08.373347] [INFO ] [MAIN ] Update Progress: 2284/2371 symbols completed. WEC took 37.3s. Estimated remaining: 12m 44s. Rate: 6.8 symbols/min [2025-09-17T22:34:08.420897] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-02. [2025-09-17T22:34:08.553585] [INFO ] [MAIN ] WF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:34:08.571481] [DEBUG] [LOCAL ] WF: Loaded 11170 existing records from primary storage. [2025-09-17T22:34:08.571609] [INFO ] [MAIN ] WF: Loaded 11170 existing records. [2025-09-17T22:34:08.761936] [WARN ] [MAIN ] WF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:34:08.762202] [INFO ] [MAIN ] WF: Wiping existing primary data before full refresh. [2025-09-17T22:34:08.762251] [INFO ] [LOCAL ] WF: Starting deletion of primary data. [2025-09-17T22:34:08.762584] [DEBUG] [LOCAL ] WF: Deleted primary data file. [2025-09-17T22:34:08.762672] [INFO ] [MAIN ] WF: Starting full primary refresh. [2025-09-17T22:34:09.142982] [INFO ] [REMOTE ] WF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:34:09.161135] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2024-12 (1.54 seconds). [2025-09-17T22:34:09.215799] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-11. [2025-09-17T22:34:10.015822] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-01. [2025-09-17T22:34:10.307011] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T22:34:10.418564] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-02 (2.00 seconds). [2025-09-17T22:34:10.815794] [INFO ] [REMOTE ] WF: Fetching primary data for 2024-12. [2025-09-17T22:34:11.425137] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-01 (1.41 seconds). [2025-09-17T22:34:11.615780] [INFO ] [REMOTE ] WES: Fetching primary data for 2024-12. [2025-09-17T22:34:11.675019] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2024-12 (0.86 seconds). [2025-09-17T22:34:12.415793] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-01. [2025-09-17T22:34:13.215789] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-03. [2025-09-17T22:34:13.414703] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T22:34:13.435614] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T22:34:14.015779] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-02. [2025-09-17T22:34:14.815803] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-01. [2025-09-17T22:34:15.089610] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T22:34:15.487540] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T22:34:15.615845] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-02. [2025-09-17T22:34:16.415831] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-03. [2025-09-17T22:34:16.467362] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-02 (0.85 seconds). [2025-09-17T22:34:16.704120] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T22:34:17.215791] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-02. [2025-09-17T22:34:18.015779] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-04. [2025-09-17T22:34:18.156089] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T22:34:18.815766] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-03. [2025-09-17T22:34:18.874574] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T22:34:19.615757] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-03. [2025-09-17T22:34:19.686457] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T22:34:19.838338] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-04 (1.82 seconds). [2025-09-17T22:34:20.415799] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-05. [2025-09-17T22:34:21.215759] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-04. [2025-09-17T22:34:21.518116] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T22:34:22.015774] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-04. [2025-09-17T22:34:22.311779] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-05 (1.90 seconds). [2025-09-17T22:34:22.815779] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-06. [2025-09-17T22:34:22.875959] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-04 (1.66 seconds). [2025-09-17T22:34:23.615780] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-05. [2025-09-17T22:34:23.918607] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-04 (1.90 seconds). [2025-09-17T22:34:24.415787] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-04. [2025-09-17T22:34:25.058966] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-05 (1.44 seconds). [2025-09-17T22:34:25.174240] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-06 (2.36 seconds). [2025-09-17T22:34:25.215733] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-07. [2025-09-17T22:34:25.411392] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-04 (1.00 seconds). [2025-09-17T22:34:26.015792] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-05. [2025-09-17T22:34:26.797001] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-05 (0.78 seconds). [2025-09-17T22:34:26.815739] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-06. [2025-09-17T22:34:27.065678] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T22:34:27.615777] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-05. [2025-09-17T22:34:27.729602] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-06 (0.91 seconds). [2025-09-17T22:34:28.415780] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-06. [2025-09-17T22:34:29.003408] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T22:34:29.215792] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-08. [2025-09-17T22:34:29.905566] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-06 (1.49 seconds). [2025-09-17T22:34:30.015781] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-07. [2025-09-17T22:34:30.815812] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-07. [2025-09-17T22:34:31.049753] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T22:34:31.453558] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-07 (1.44 seconds). [2025-09-17T22:34:31.615729] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-06. [2025-09-17T22:34:31.710981] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-07 (0.90 seconds). [2025-09-17T22:34:32.415782] [INFO ] [REMOTE ] WELL: Fetching primary data for 2025-09. [2025-09-17T22:34:33.093858] [INFO ] [REMOTE ] WELL: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T22:34:33.103040] [INFO ] [REMOTE ] WELL: Full fetch complete (75528 records). [2025-09-17T22:34:33.103188] [DEBUG] [VALIDATOR ] WELL: Validating primary data. [2025-09-17T22:34:33.220757] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-08. [2025-09-17T22:34:33.583531] [DEBUG] [VALIDATOR ] WELL: All expected trading days are present. [2025-09-17T22:34:33.584352] [DEBUG] [VALIDATOR ] WELL: Primary data validation passed. [2025-09-17T22:34:33.585420] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T22:34:33.587582] [INFO ] [MAIN ] WELL: Fetched primary data is valid. [2025-09-17T22:34:33.597366] [DEBUG] [LOCAL ] WELL: Saving primary data. [2025-09-17T22:34:33.599958] [DEBUG] [LOCAL ] WELL: Trimmed 75528 records to 52360 (keeping 200 days of data) [2025-09-17T22:34:33.945507] [DEBUG] [LOCAL ] WELL: Primary data saved (52360 records). [2025-09-17T22:34:33.945705] [INFO ] [MAIN ] WELL: Full history saved. [2025-09-17T22:34:33.947131] [INFO ] [MAIN ] Update Progress: 2285/2371 symbols completed. WELL took 36.5s. Estimated remaining: 12m 35s. Rate: 6.8 symbols/min [2025-09-17T22:34:34.025684] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-07. [2025-09-17T22:34:34.124721] [INFO ] [MAIN ] WFC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:34:34.194208] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-17T22:34:34.194415] [INFO ] [MAIN ] WFC: Loaded 53748 existing records. [2025-09-17T22:34:34.409537] [WARN ] [MAIN ] WFC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:34:34.409886] [INFO ] [MAIN ] WFC: Wiping existing primary data before full refresh. [2025-09-17T22:34:34.409935] [INFO ] [LOCAL ] WFC: Starting deletion of primary data. [2025-09-17T22:34:34.411516] [DEBUG] [LOCAL ] WFC: Deleted primary data file. [2025-09-17T22:34:34.411580] [INFO ] [MAIN ] WFC: Starting full primary refresh. [2025-09-17T22:34:34.833581] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-08. [2025-09-17T22:34:34.840611] [INFO ] [REMOTE ] WFC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:34:34.861546] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T22:34:35.615755] [INFO ] [REMOTE ] WEX: Fetching primary data for 2025-09. [2025-09-17T22:34:35.623503] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-08 (0.79 seconds). [2025-09-17T22:34:35.979936] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-07 (1.95 seconds). [2025-09-17T22:34:36.415832] [INFO ] [REMOTE ] WF: Fetching primary data for 2025-09. [2025-09-17T22:34:36.857005] [INFO ] [REMOTE ] WEX: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T22:34:36.861414] [INFO ] [REMOTE ] WEX: Full fetch complete (50625 records). [2025-09-17T22:34:36.861571] [DEBUG] [VALIDATOR ] WEX: Validating primary data. [2025-09-17T22:34:37.221972] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-08. [2025-09-17T22:34:37.221846] [INFO ] [REMOTE ] WF: Incremental fetch complete for 2025-09 (0.81 seconds). [2025-09-17T22:34:37.271061] [DEBUG] [VALIDATOR ] WEX: All expected trading days are present. [2025-09-17T22:34:37.271358] [DEBUG] [VALIDATOR ] WEX: Primary data validation passed. [2025-09-17T22:34:37.272639] [INFO ] [MAIN ] WEX: Fetched primary data is valid. [2025-09-17T22:34:37.272763] [DEBUG] [LOCAL ] WEX: Saving primary data. [2025-09-17T22:34:37.271251] [INFO ] [REMOTE ] WF: Full fetch complete (16902 records). [2025-09-17T22:34:37.273130] [DEBUG] [VALIDATOR ] WF: Validating primary data. [2025-09-17T22:34:37.321138] [DEBUG] [LOCAL ] WEX: Trimmed 50625 records to 35736 (keeping 200 days of data) [2025-09-17T22:34:37.780755] [DEBUG] [VALIDATOR ] WF: All expected trading days are present. [2025-09-17T22:34:37.781153] [DEBUG] [VALIDATOR ] WF: Primary data validation passed. [2025-09-17T22:34:37.781871] [INFO ] [MAIN ] WF: Fetched primary data is valid. [2025-09-17T22:34:37.781953] [DEBUG] [LOCAL ] WF: Saving primary data. [2025-09-17T22:34:37.784496] [DEBUG] [LOCAL ] WF: Trimmed 16902 records to 11123 (keeping 200 days of data) [2025-09-17T22:34:37.921195] [DEBUG] [LOCAL ] WF: Primary data saved (11123 records). [2025-09-17T22:34:37.941039] [INFO ] [MAIN ] WF: Full history saved. [2025-09-17T22:34:37.941567] [INFO ] [MAIN ] Update Progress: 2286/2371 symbols completed. WF took 29.6s. Estimated remaining: 12m 26s. Rate: 6.8 symbols/min [2025-09-17T22:34:38.018303] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-11. [2025-09-17T22:34:38.135717] [INFO ] [MAIN ] WFG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:34:38.177581] [DEBUG] [LOCAL ] WEX: Primary data saved (35736 records). [2025-09-17T22:34:38.177798] [INFO ] [MAIN ] WEX: Full history saved. [2025-09-17T22:34:38.178852] [INFO ] [MAIN ] Update Progress: 2287/2371 symbols completed. WEX took 33.9s. Estimated remaining: 12m 17s. Rate: 6.8 symbols/min [2025-09-17T22:34:38.178613] [DEBUG] [LOCAL ] WFG: Loaded 25080 existing records from primary storage. [2025-09-17T22:34:38.223451] [INFO ] [MAIN ] WFG: Loaded 25080 existing records. [2025-09-17T22:34:38.525234] [INFO ] [MAIN ] WGO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:34:38.547578] [WARN ] [MAIN ] WFG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:34:38.547859] [INFO ] [MAIN ] WFG: Wiping existing primary data before full refresh. [2025-09-17T22:34:38.547921] [INFO ] [LOCAL ] WFG: Starting deletion of primary data. [2025-09-17T22:34:38.548958] [DEBUG] [LOCAL ] WFG: Deleted primary data file. [2025-09-17T22:34:38.549056] [INFO ] [MAIN ] WFG: Starting full primary refresh. [2025-09-17T22:34:38.860841] [DEBUG] [LOCAL ] WGO: Loaded 39661 existing records from primary storage. [2025-09-17T22:34:38.871614] [INFO ] [MAIN ] WGO: Loaded 39661 existing records. [2025-09-17T22:34:39.009584] [INFO ] [REMOTE ] WFG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:34:39.027136] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-11. [2025-09-17T22:34:39.135210] [WARN ] [MAIN ] WGO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:34:39.135787] [INFO ] [MAIN ] WGO: Wiping existing primary data before full refresh. [2025-09-17T22:34:39.135859] [INFO ] [LOCAL ] WGO: Starting deletion of primary data. [2025-09-17T22:34:39.137188] [DEBUG] [LOCAL ] WGO: Deleted primary data file. [2025-09-17T22:34:39.137359] [INFO ] [MAIN ] WGO: Starting full primary refresh. [2025-09-17T22:34:39.295597] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T22:34:39.571347] [INFO ] [REMOTE ] WGO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:34:39.615831] [INFO ] [REMOTE ] WES: Fetching primary data for 2025-09. [2025-09-17T22:34:40.328737] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-11 (2.31 seconds). [2025-09-17T22:34:40.354515] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-11 (1.33 seconds). [2025-09-17T22:34:40.415770] [INFO ] [REMOTE ] WFC: Fetching primary data for 2024-12. [2025-09-17T22:34:41.215823] [INFO ] [REMOTE ] WFG: Fetching primary data for 2024-12. [2025-09-17T22:34:41.328526] [INFO ] [REMOTE ] WES: Incremental fetch complete for 2025-09 (1.71 seconds). [2025-09-17T22:34:41.334947] [INFO ] [REMOTE ] WES: Full fetch complete (69538 records). [2025-09-17T22:34:41.335080] [DEBUG] [VALIDATOR ] WES: Validating primary data. [2025-09-17T22:34:41.744924] [DEBUG] [VALIDATOR ] WES: All expected trading days are present. [2025-09-17T22:34:41.745027] [DEBUG] [VALIDATOR ] WES: Primary data validation passed. [2025-09-17T22:34:41.746073] [INFO ] [MAIN ] WES: Fetched primary data is valid. [2025-09-17T22:34:41.746142] [DEBUG] [LOCAL ] WES: Saving primary data. [2025-09-17T22:34:41.747821] [DEBUG] [LOCAL ] WES: Trimmed 69538 records to 48094 (keeping 200 days of data) [2025-09-17T22:34:42.026708] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-11. [2025-09-17T22:34:42.058167] [DEBUG] [LOCAL ] WES: Primary data saved (48094 records). [2025-09-17T22:34:42.058292] [INFO ] [MAIN ] WES: Full history saved. [2025-09-17T22:34:42.059071] [INFO ] [MAIN ] Update Progress: 2288/2371 symbols completed. WES took 39.4s. Estimated remaining: 12m 8s. Rate: 6.8 symbols/min [2025-09-17T22:34:42.247879] [INFO ] [MAIN ] WH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:34:42.295951] [DEBUG] [LOCAL ] WH: Loaded 45949 existing records from primary storage. [2025-09-17T22:34:42.296111] [INFO ] [MAIN ] WH: Loaded 45949 existing records. [2025-09-17T22:34:42.498386] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T22:34:42.498626] [WARN ] [MAIN ] WH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:34:42.503957] [INFO ] [MAIN ] WH: Wiping existing primary data before full refresh. [2025-09-17T22:34:42.504141] [INFO ] [LOCAL ] WH: Starting deletion of primary data. [2025-09-17T22:34:42.505415] [DEBUG] [LOCAL ] WH: Deleted primary data file. [2025-09-17T22:34:42.505480] [INFO ] [MAIN ] WH: Starting full primary refresh. [2025-09-17T22:34:42.751271] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2024-12 (2.34 seconds). [2025-09-17T22:34:42.820909] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-01. [2025-09-17T22:34:43.006998] [INFO ] [REMOTE ] WH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:34:43.615778] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-01. [2025-09-17T22:34:43.790051] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T22:34:44.066130] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-01 (1.25 seconds). [2025-09-17T22:34:44.415777] [INFO ] [REMOTE ] WGO: Fetching primary data for 2024-12. [2025-09-17T22:34:45.215779] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-11. [2025-09-17T22:34:45.416679] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-01 (1.80 seconds). [2025-09-17T22:34:45.918914] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T22:34:46.015729] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-01. [2025-09-17T22:34:46.815842] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-02. [2025-09-17T22:34:46.963342] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T22:34:47.529742] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T22:34:47.615745] [INFO ] [REMOTE ] WH: Fetching primary data for 2024-12. [2025-09-17T22:34:47.676996] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T22:34:48.415788] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-02. [2025-09-17T22:34:49.215778] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-02. [2025-09-17T22:34:49.524849] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T22:34:49.853779] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-02 (1.44 seconds). [2025-09-17T22:34:50.015739] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-03. [2025-09-17T22:34:50.815815] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-03. [2025-09-17T22:34:51.208807] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-02 (1.99 seconds). [2025-09-17T22:34:51.615793] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-03. [2025-09-17T22:34:51.672482] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-03 (1.66 seconds). [2025-09-17T22:34:51.773442] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-03 (0.96 seconds). [2025-09-17T22:34:52.415821] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-01. [2025-09-17T22:34:53.215775] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-04. [2025-09-17T22:34:53.789274] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-03 (2.17 seconds). [2025-09-17T22:34:54.016699] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-04. [2025-09-17T22:34:54.019300] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T22:34:54.558844] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-04 (1.34 seconds). [2025-09-17T22:34:54.815788] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-05. [2025-09-17T22:34:55.615805] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-02. [2025-09-17T22:34:55.651596] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-04 (1.63 seconds). [2025-09-17T22:34:55.904416] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-05 (1.09 seconds). [2025-09-17T22:34:56.415852] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-05. [2025-09-17T22:34:56.987817] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-02 (1.37 seconds). [2025-09-17T22:34:57.215797] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-06. [2025-09-17T22:34:57.835842] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-05 (1.42 seconds). [2025-09-17T22:34:58.015806] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-03. [2025-09-17T22:34:58.425456] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-06 (1.21 seconds). [2025-09-17T22:34:58.815780] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-04. [2025-09-17T22:34:59.615786] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-06. [2025-09-17T22:34:59.655254] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-03 (1.64 seconds). [2025-09-17T22:35:00.415778] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-04. [2025-09-17T22:35:01.164977] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-04 (2.35 seconds). [2025-09-17T22:35:01.215726] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-05. [2025-09-17T22:35:01.507609] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-06 (1.89 seconds). [2025-09-17T22:35:01.805841] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-04 (1.39 seconds). [2025-09-17T22:35:02.015795] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-07. [2025-09-17T22:35:02.815803] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-07. [2025-09-17T22:35:03.187755] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-05 (1.97 seconds). [2025-09-17T22:35:03.589285] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T22:35:03.615808] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-06. [2025-09-17T22:35:04.039536] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-07 (1.22 seconds). [2025-09-17T22:35:04.415844] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-08. [2025-09-17T22:35:05.215848] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-05. [2025-09-17T22:35:05.822543] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-06 (2.21 seconds). [2025-09-17T22:35:05.884364] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-08 (1.47 seconds). [2025-09-17T22:35:06.015789] [INFO ] [REMOTE ] WGO: Fetching primary data for 2025-09. [2025-09-17T22:35:06.611075] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-05 (1.40 seconds). [2025-09-17T22:35:06.815795] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-06. [2025-09-17T22:35:07.248816] [INFO ] [REMOTE ] WGO: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T22:35:07.253785] [INFO ] [REMOTE ] WGO: Full fetch complete (57084 records). [2025-09-17T22:35:07.253885] [DEBUG] [VALIDATOR ] WGO: Validating primary data. [2025-09-17T22:35:07.622879] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-07. [2025-09-17T22:35:07.641489] [DEBUG] [VALIDATOR ] WGO: All expected trading days are present. [2025-09-17T22:35:07.641593] [DEBUG] [VALIDATOR ] WGO: Primary data validation passed. [2025-09-17T22:35:07.643488] [INFO ] [MAIN ] WGO: Fetched primary data is valid. [2025-09-17T22:35:07.643553] [DEBUG] [LOCAL ] WGO: Saving primary data. [2025-09-17T22:35:07.644980] [DEBUG] [LOCAL ] WGO: Trimmed 57084 records to 39627 (keeping 200 days of data) [2025-09-17T22:35:07.890619] [DEBUG] [LOCAL ] WGO: Primary data saved (39627 records). [2025-09-17T22:35:07.890833] [INFO ] [MAIN ] WGO: Full history saved. [2025-09-17T22:35:07.890963] [INFO ] [MAIN ] Update Progress: 2289/2371 symbols completed. WGO took 29.7s. Estimated remaining: 12m 0s. Rate: 6.8 symbols/min [2025-09-17T22:35:08.087899] [INFO ] [MAIN ] WHD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:35:08.130342] [DEBUG] [LOCAL ] WHD: Loaded 40896 existing records from primary storage. [2025-09-17T22:35:08.130527] [INFO ] [MAIN ] WHD: Loaded 40896 existing records. [2025-09-17T22:35:08.336065] [WARN ] [MAIN ] WHD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:35:08.336502] [INFO ] [MAIN ] WHD: Wiping existing primary data before full refresh. [2025-09-17T22:35:08.336678] [INFO ] [LOCAL ] WHD: Starting deletion of primary data. [2025-09-17T22:35:08.337742] [DEBUG] [LOCAL ] WHD: Deleted primary data file. [2025-09-17T22:35:08.337804] [INFO ] [MAIN ] WHD: Starting full primary refresh. [2025-09-17T22:35:08.427572] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-08. [2025-09-17T22:35:08.553020] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T22:35:08.766717] [INFO ] [REMOTE ] WHD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:35:09.215819] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-07. [2025-09-17T22:35:09.777733] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-07 (2.15 seconds). [2025-09-17T22:35:09.778960] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-08 (1.35 seconds). [2025-09-17T22:35:10.015787] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-08. [2025-09-17T22:35:10.815820] [INFO ] [REMOTE ] WFG: Fetching primary data for 2025-09. [2025-09-17T22:35:11.051452] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-07 (1.84 seconds). [2025-09-17T22:35:11.615793] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-11. [2025-09-17T22:35:11.841474] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-08 (1.83 seconds). [2025-09-17T22:35:12.020857] [INFO ] [REMOTE ] WFG: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T22:35:12.024635] [INFO ] [REMOTE ] WFG: Full fetch complete (35361 records). [2025-09-17T22:35:12.024761] [DEBUG] [VALIDATOR ] WFG: Validating primary data. [2025-09-17T22:35:12.408756] [DEBUG] [VALIDATOR ] WFG: All expected trading days are present. [2025-09-17T22:35:12.408846] [DEBUG] [VALIDATOR ] WFG: Primary data validation passed. [2025-09-17T22:35:12.409572] [INFO ] [MAIN ] WFG: Fetched primary data is valid. [2025-09-17T22:35:12.409663] [DEBUG] [LOCAL ] WFG: Saving primary data. [2025-09-17T22:35:12.410688] [DEBUG] [LOCAL ] WFG: Trimmed 35361 records to 25115 (keeping 200 days of data) [2025-09-17T22:35:12.415766] [INFO ] [REMOTE ] WFC: Fetching primary data for 2025-09. [2025-09-17T22:35:12.581925] [DEBUG] [LOCAL ] WFG: Primary data saved (25115 records). [2025-09-17T22:35:12.582072] [INFO ] [MAIN ] WFG: Full history saved. [2025-09-17T22:35:12.582162] [INFO ] [MAIN ] Update Progress: 2290/2371 symbols completed. WFG took 34.6s. Estimated remaining: 11m 51s. Rate: 6.8 symbols/min [2025-09-17T22:35:12.752914] [INFO ] [MAIN ] WHG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:35:12.758380] [DEBUG] [LOCAL ] WHG: Loaded 3423 existing records from primary storage. [2025-09-17T22:35:12.758476] [INFO ] [MAIN ] WHG: Loaded 3423 existing records. [2025-09-17T22:35:12.945186] [WARN ] [MAIN ] WHG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:35:12.945767] [INFO ] [MAIN ] WHG: Wiping existing primary data before full refresh. [2025-09-17T22:35:12.945845] [INFO ] [LOCAL ] WHG: Starting deletion of primary data. [2025-09-17T22:35:12.946109] [DEBUG] [LOCAL ] WHG: Deleted primary data file. [2025-09-17T22:35:12.946170] [INFO ] [MAIN ] WHG: Starting full primary refresh. [2025-09-17T22:35:13.232445] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-08. [2025-09-17T22:35:13.322029] [INFO ] [REMOTE ] WHG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:35:13.365176] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-11 (1.75 seconds). [2025-09-17T22:35:13.366581] [INFO ] [REMOTE ] WFC: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T22:35:13.383952] [INFO ] [REMOTE ] WFC: Full fetch complete (77755 records). [2025-09-17T22:35:13.384114] [DEBUG] [VALIDATOR ] WFC: Validating primary data. [2025-09-17T22:35:13.796221] [DEBUG] [VALIDATOR ] WFC: All expected trading days are present. [2025-09-17T22:35:13.796373] [DEBUG] [VALIDATOR ] WFC: Primary data validation passed. [2025-09-17T22:35:13.797796] [INFO ] [MAIN ] WFC: Fetched primary data is valid. [2025-09-17T22:35:13.797867] [DEBUG] [LOCAL ] WFC: Saving primary data. [2025-09-17T22:35:13.799537] [DEBUG] [LOCAL ] WFC: Trimmed 77755 records to 53748 (keeping 200 days of data) [2025-09-17T22:35:14.020116] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-11. [2025-09-17T22:35:14.145708] [DEBUG] [LOCAL ] WFC: Primary data saved (53748 records). [2025-09-17T22:35:14.145871] [INFO ] [MAIN ] WFC: Full history saved. [2025-09-17T22:35:14.146697] [INFO ] [MAIN ] Update Progress: 2291/2371 symbols completed. WFC took 40.2s. Estimated remaining: 11m 42s. Rate: 6.8 symbols/min [2025-09-17T22:35:14.318399] [INFO ] [MAIN ] WHR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:35:14.367416] [DEBUG] [LOCAL ] WHR: Loaded 48127 existing records from primary storage. [2025-09-17T22:35:14.367591] [INFO ] [MAIN ] WHR: Loaded 48127 existing records. [2025-09-17T22:35:14.552303] [WARN ] [MAIN ] WHR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:35:14.552637] [INFO ] [MAIN ] WHR: Wiping existing primary data before full refresh. [2025-09-17T22:35:14.552720] [INFO ] [LOCAL ] WHR: Starting deletion of primary data. [2025-09-17T22:35:14.553855] [DEBUG] [LOCAL ] WHR: Deleted primary data file. [2025-09-17T22:35:14.553924] [INFO ] [MAIN ] WHR: Starting full primary refresh. [2025-09-17T22:35:14.824632] [INFO ] [REMOTE ] WHD: Fetching primary data for 2024-12. [2025-09-17T22:35:14.841565] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-11 (0.82 seconds). [2025-09-17T22:35:14.926834] [INFO ] [REMOTE ] WHR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:35:14.963341] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T22:35:15.615794] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-11. [2025-09-17T22:35:16.384521] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2024-12 (1.56 seconds). [2025-09-17T22:35:16.415774] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-01. [2025-09-17T22:35:17.215814] [INFO ] [REMOTE ] WH: Fetching primary data for 2025-09. [2025-09-17T22:35:17.329573] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-11 (1.71 seconds). [2025-09-17T22:35:17.869414] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-01 (1.45 seconds). [2025-09-17T22:35:18.015807] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-02. [2025-09-17T22:35:18.595398] [INFO ] [REMOTE ] WH: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T22:35:18.601558] [INFO ] [REMOTE ] WH: Full fetch complete (64925 records). [2025-09-17T22:35:18.601729] [DEBUG] [VALIDATOR ] WH: Validating primary data. [2025-09-17T22:35:18.824711] [INFO ] [REMOTE ] WHG: Fetching primary data for 2024-12. [2025-09-17T22:35:19.028521] [DEBUG] [VALIDATOR ] WH: All expected trading days are present. [2025-09-17T22:35:19.028608] [DEBUG] [VALIDATOR ] WH: Primary data validation passed. [2025-09-17T22:35:19.029729] [INFO ] [MAIN ] WH: Fetched primary data is valid. [2025-09-17T22:35:19.029796] [DEBUG] [LOCAL ] WH: Saving primary data. [2025-09-17T22:35:19.031302] [DEBUG] [LOCAL ] WH: Trimmed 64925 records to 45998 (keeping 200 days of data) [2025-09-17T22:35:19.328064] [DEBUG] [LOCAL ] WH: Primary data saved (45998 records). [2025-09-17T22:35:19.328219] [INFO ] [MAIN ] WH: Full history saved. [2025-09-17T22:35:19.328973] [INFO ] [MAIN ] Update Progress: 2292/2371 symbols completed. WH took 37.3s. Estimated remaining: 11m 33s. Rate: 6.8 symbols/min [2025-09-17T22:35:19.422871] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2024-12 (0.60 seconds). [2025-09-17T22:35:19.535856] [INFO ] [MAIN ] WIA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:35:19.537370] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T22:35:19.552943] [DEBUG] [LOCAL ] WIA: Loaded 4865 existing records from primary storage. [2025-09-17T22:35:19.553080] [INFO ] [MAIN ] WIA: Loaded 4865 existing records. [2025-09-17T22:35:19.620936] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-01. [2025-09-17T22:35:19.735911] [WARN ] [MAIN ] WIA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:35:19.736169] [INFO ] [MAIN ] WIA: Wiping existing primary data before full refresh. [2025-09-17T22:35:19.736217] [INFO ] [LOCAL ] WIA: Starting deletion of primary data. [2025-09-17T22:35:19.736493] [DEBUG] [LOCAL ] WIA: Deleted primary data file. [2025-09-17T22:35:19.736551] [INFO ] [MAIN ] WIA: Starting full primary refresh. [2025-09-17T22:35:20.093770] [INFO ] [REMOTE ] WIA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:35:20.186119] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-01 (0.57 seconds). [2025-09-17T22:35:20.415753] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-11. [2025-09-17T22:35:21.215786] [INFO ] [REMOTE ] WHR: Fetching primary data for 2024-12. [2025-09-17T22:35:21.409076] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-11 (0.99 seconds). [2025-09-17T22:35:22.015794] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-03. [2025-09-17T22:35:22.815811] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-02. [2025-09-17T22:35:22.930414] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T22:35:23.231978] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-03 (1.22 seconds). [2025-09-17T22:35:23.332721] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-02 (0.52 seconds). [2025-09-17T22:35:23.615782] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-03. [2025-09-17T22:35:24.243333] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-03 (0.63 seconds). [2025-09-17T22:35:24.415803] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-04. [2025-09-17T22:35:25.114538] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-04 (0.70 seconds). [2025-09-17T22:35:25.215783] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-05. [2025-09-17T22:35:25.813746] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-05 (0.60 seconds). [2025-09-17T22:35:26.015774] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-01. [2025-09-17T22:35:26.815778] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-04. [2025-09-17T22:35:27.615784] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-06. [2025-09-17T22:35:28.083514] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-01 (2.07 seconds). [2025-09-17T22:35:28.255939] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-06 (0.64 seconds). [2025-09-17T22:35:28.290830] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-04 (1.48 seconds). [2025-09-17T22:35:28.415774] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-07. [2025-09-17T22:35:29.001443] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-07 (0.59 seconds). [2025-09-17T22:35:29.215788] [INFO ] [REMOTE ] WIA: Fetching primary data for 2024-12. [2025-09-17T22:35:30.015813] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-05. [2025-09-17T22:35:30.208161] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2024-12 (0.99 seconds). [2025-09-17T22:35:30.815881] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-08. [2025-09-17T22:35:31.280680] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-08 (0.46 seconds). [2025-09-17T22:35:31.519522] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T22:35:31.615788] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-06. [2025-09-17T22:35:32.415805] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-01. [2025-09-17T22:35:33.030404] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-01 (0.61 seconds). [2025-09-17T22:35:33.061011] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T22:35:33.215737] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-07. [2025-09-17T22:35:34.015807] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-02. [2025-09-17T22:35:34.770437] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T22:35:34.815767] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-08. [2025-09-17T22:35:35.369832] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-02 (1.35 seconds). [2025-09-17T22:35:35.615819] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-02. [2025-09-17T22:35:36.253951] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-02 (0.64 seconds). [2025-09-17T22:35:36.361828] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T22:35:36.415819] [INFO ] [REMOTE ] WHG: Fetching primary data for 2025-09. [2025-09-17T22:35:36.709001] [INFO ] [REMOTE ] WHG: Incremental fetch complete for 2025-09 (0.29 seconds). [2025-09-17T22:35:36.709870] [INFO ] [REMOTE ] WHG: Full fetch complete (4708 records). [2025-09-17T22:35:36.709938] [DEBUG] [VALIDATOR ] WHG: Validating primary data. [2025-09-17T22:35:37.076207] [DEBUG] [VALIDATOR ] WHG: All expected trading days are present. [2025-09-17T22:35:37.076350] [DEBUG] [VALIDATOR ] WHG: Primary data validation passed. [2025-09-17T22:35:37.076510] [INFO ] [MAIN ] WHG: Fetched primary data is valid. [2025-09-17T22:35:37.076572] [DEBUG] [LOCAL ] WHG: Saving primary data. [2025-09-17T22:35:37.076987] [DEBUG] [LOCAL ] WHG: Trimmed 4708 records to 3421 (keeping 200 days of data) [2025-09-17T22:35:37.098592] [DEBUG] [LOCAL ] WHG: Primary data saved (3421 records). [2025-09-17T22:35:37.098708] [INFO ] [MAIN ] WHG: Full history saved. [2025-09-17T22:35:37.098801] [INFO ] [MAIN ] Update Progress: 2293/2371 symbols completed. WHG took 24.5s. Estimated remaining: 11m 25s. Rate: 6.8 symbols/min [2025-09-17T22:35:37.220896] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-03. [2025-09-17T22:35:37.275023] [INFO ] [MAIN ] WINN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:35:37.289987] [DEBUG] [LOCAL ] WINN: Loaded 11989 existing records from primary storage. [2025-09-17T22:35:37.290134] [INFO ] [MAIN ] WINN: Loaded 11989 existing records. [2025-09-17T22:35:37.467607] [WARN ] [MAIN ] WINN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:35:37.468021] [INFO ] [MAIN ] WINN: Wiping existing primary data before full refresh. [2025-09-17T22:35:37.468090] [INFO ] [LOCAL ] WINN: Starting deletion of primary data. [2025-09-17T22:35:37.468582] [DEBUG] [LOCAL ] WINN: Deleted primary data file. [2025-09-17T22:35:37.468753] [INFO ] [MAIN ] WINN: Starting full primary refresh. [2025-09-17T22:35:37.824701] [INFO ] [REMOTE ] WINN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:35:38.015783] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-11. [2025-09-17T22:35:38.815763] [INFO ] [REMOTE ] WHD: Fetching primary data for 2025-09. [2025-09-17T22:35:38.936969] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-11 (0.92 seconds). [2025-09-17T22:35:39.043637] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T22:35:39.615781] [INFO ] [REMOTE ] WINN: Fetching primary data for 2024-12. [2025-09-17T22:35:40.065307] [INFO ] [REMOTE ] WHD: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T22:35:40.070835] [INFO ] [REMOTE ] WHD: Full fetch complete (56996 records). [2025-09-17T22:35:40.071000] [DEBUG] [VALIDATOR ] WHD: Validating primary data. [2025-09-17T22:35:40.420887] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-04. [2025-09-17T22:35:40.498840] [DEBUG] [VALIDATOR ] WHD: All expected trading days are present. [2025-09-17T22:35:40.498947] [DEBUG] [VALIDATOR ] WHD: Primary data validation passed. [2025-09-17T22:35:40.500915] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T22:35:40.500420] [INFO ] [MAIN ] WHD: Fetched primary data is valid. [2025-09-17T22:35:40.503891] [DEBUG] [LOCAL ] WHD: Saving primary data. [2025-09-17T22:35:40.506164] [DEBUG] [LOCAL ] WHD: Trimmed 56996 records to 40825 (keeping 200 days of data) [2025-09-17T22:35:40.764381] [DEBUG] [LOCAL ] WHD: Primary data saved (40825 records). [2025-09-17T22:35:40.764519] [INFO ] [MAIN ] WHD: Full history saved. [2025-09-17T22:35:40.764616] [INFO ] [MAIN ] Update Progress: 2294/2371 symbols completed. WHD took 32.9s. Estimated remaining: 11m 16s. Rate: 6.8 symbols/min [2025-09-17T22:35:40.934774] [INFO ] [MAIN ] WIT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:35:40.987807] [DEBUG] [LOCAL ] WIT: Loaded 52254 existing records from primary storage. [2025-09-17T22:35:40.988021] [INFO ] [MAIN ] WIT: Loaded 52254 existing records. [2025-09-17T22:35:41.169497] [WARN ] [MAIN ] WIT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:35:41.169815] [INFO ] [MAIN ] WIT: Wiping existing primary data before full refresh. [2025-09-17T22:35:41.169867] [INFO ] [LOCAL ] WIT: Starting deletion of primary data. [2025-09-17T22:35:41.171080] [DEBUG] [LOCAL ] WIT: Deleted primary data file. [2025-09-17T22:35:41.171141] [INFO ] [MAIN ] WIT: Starting full primary refresh. [2025-09-17T22:35:41.226015] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-03. [2025-09-17T22:35:41.531204] [INFO ] [REMOTE ] WIT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:35:41.868634] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-03 (0.64 seconds). [2025-09-17T22:35:42.015798] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-01. [2025-09-17T22:35:42.425479] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T22:35:42.815796] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-11. [2025-09-17T22:35:43.080405] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T22:35:43.615798] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-05. [2025-09-17T22:35:44.415759] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-02. [2025-09-17T22:35:44.804756] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-11 (1.99 seconds). [2025-09-17T22:35:45.215821] [INFO ] [REMOTE ] WIT: Fetching primary data for 2024-12. [2025-09-17T22:35:45.236576] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-02 (0.82 seconds). [2025-09-17T22:35:45.453547] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-05 (1.84 seconds). [2025-09-17T22:35:46.015835] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-06. [2025-09-17T22:35:46.815858] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-04. [2025-09-17T22:35:47.069189] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T22:35:47.607933] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-04 (0.79 seconds). [2025-09-17T22:35:47.615710] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-05. [2025-09-17T22:35:47.986188] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-06 (1.97 seconds). [2025-09-17T22:35:48.178635] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-05 (0.56 seconds). [2025-09-17T22:35:48.415837] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-01. [2025-09-17T22:35:49.215851] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-07. [2025-09-17T22:35:50.015721] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-03. [2025-09-17T22:35:50.137259] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-01 (1.72 seconds). [2025-09-17T22:35:50.815846] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-02. [2025-09-17T22:35:50.881316] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T22:35:51.156804] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T22:35:51.615829] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-04. [2025-09-17T22:35:52.286623] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-02 (1.47 seconds). [2025-09-17T22:35:52.415793] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-08. [2025-09-17T22:35:52.610503] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-04 (0.99 seconds). [2025-09-17T22:35:53.215793] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-06. [2025-09-17T22:35:53.754996] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-06 (0.54 seconds). [2025-09-17T22:35:53.956311] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-08 (1.54 seconds). [2025-09-17T22:35:54.015817] [INFO ] [REMOTE ] WHR: Fetching primary data for 2025-09. [2025-09-17T22:35:54.815831] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-07. [2025-09-17T22:35:55.447484] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-07 (0.63 seconds). [2025-09-17T22:35:55.615799] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-05. [2025-09-17T22:35:55.746451] [INFO ] [REMOTE ] WHR: Incremental fetch complete for 2025-09 (1.73 seconds). [2025-09-17T22:35:55.752794] [INFO ] [REMOTE ] WHR: Full fetch complete (67944 records). [2025-09-17T22:35:55.752958] [DEBUG] [VALIDATOR ] WHR: Validating primary data. [2025-09-17T22:35:56.172293] [DEBUG] [VALIDATOR ] WHR: All expected trading days are present. [2025-09-17T22:35:56.172389] [DEBUG] [VALIDATOR ] WHR: Primary data validation passed. [2025-09-17T22:35:56.173500] [INFO ] [MAIN ] WHR: Fetched primary data is valid. [2025-09-17T22:35:56.173568] [DEBUG] [LOCAL ] WHR: Saving primary data. [2025-09-17T22:35:56.175118] [DEBUG] [LOCAL ] WHR: Trimmed 67944 records to 48142 (keeping 200 days of data) [2025-09-17T22:35:56.416015] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-08. [2025-09-17T22:35:56.503020] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-05 (0.89 seconds). [2025-09-17T22:35:56.521993] [DEBUG] [LOCAL ] WHR: Primary data saved (48142 records). [2025-09-17T22:35:56.522288] [INFO ] [MAIN ] WHR: Full history saved. [2025-09-17T22:35:56.523835] [INFO ] [MAIN ] Update Progress: 2295/2371 symbols completed. WHR took 42.4s. Estimated remaining: 11m 7s. Rate: 6.8 symbols/min [2025-09-17T22:35:56.707591] [INFO ] [MAIN ] WIW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:35:56.730413] [DEBUG] [LOCAL ] WIW: Loaded 20830 existing records from primary storage. [2025-09-17T22:35:56.730562] [INFO ] [MAIN ] WIW: Loaded 20830 existing records. [2025-09-17T22:35:56.926391] [WARN ] [MAIN ] WIW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:35:56.926716] [INFO ] [MAIN ] WIW: Wiping existing primary data before full refresh. [2025-09-17T22:35:56.926797] [INFO ] [LOCAL ] WIW: Starting deletion of primary data. [2025-09-17T22:35:56.927405] [DEBUG] [LOCAL ] WIW: Deleted primary data file. [2025-09-17T22:35:56.927474] [INFO ] [MAIN ] WIW: Starting full primary refresh. [2025-09-17T22:35:57.200747] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-08 (0.78 seconds). [2025-09-17T22:35:57.225232] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-03. [2025-09-17T22:35:57.342474] [INFO ] [REMOTE ] WIW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:35:58.015819] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-06. [2025-09-17T22:35:58.815806] [INFO ] [REMOTE ] WIA: Fetching primary data for 2025-09. [2025-09-17T22:35:58.874235] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T22:35:59.181796] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-03 (1.96 seconds). [2025-09-17T22:35:59.241743] [INFO ] [REMOTE ] WIA: Incremental fetch complete for 2025-09 (0.43 seconds). [2025-09-17T22:35:59.243248] [INFO ] [REMOTE ] WIA: Full fetch complete (7399 records). [2025-09-17T22:35:59.243320] [DEBUG] [VALIDATOR ] WIA: Validating primary data. [2025-09-17T22:35:59.612497] [DEBUG] [VALIDATOR ] WIA: All expected trading days are present. [2025-09-17T22:35:59.612597] [DEBUG] [VALIDATOR ] WIA: Primary data validation passed. [2025-09-17T22:35:59.612838] [INFO ] [MAIN ] WIA: Fetched primary data is valid. [2025-09-17T22:35:59.612896] [DEBUG] [LOCAL ] WIA: Saving primary data. [2025-09-17T22:35:59.613317] [DEBUG] [LOCAL ] WIA: Trimmed 7399 records to 4887 (keeping 200 days of data) [2025-09-17T22:35:59.625918] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-07. [2025-09-17T22:35:59.644534] [DEBUG] [LOCAL ] WIA: Primary data saved (4887 records). [2025-09-17T22:35:59.644681] [INFO ] [MAIN ] WIA: Full history saved. [2025-09-17T22:35:59.644787] [INFO ] [MAIN ] Update Progress: 2296/2371 symbols completed. WIA took 40.3s. Estimated remaining: 10m 58s. Rate: 6.8 symbols/min [2025-09-17T22:35:59.820248] [INFO ] [MAIN ] WK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:35:59.862525] [DEBUG] [LOCAL ] WK: Loaded 36517 existing records from primary storage. [2025-09-17T22:35:59.862710] [INFO ] [MAIN ] WK: Loaded 36517 existing records. [2025-09-17T22:36:00.058399] [WARN ] [MAIN ] WK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:36:00.058922] [INFO ] [MAIN ] WK: Wiping existing primary data before full refresh. [2025-09-17T22:36:00.058975] [INFO ] [LOCAL ] WK: Starting deletion of primary data. [2025-09-17T22:36:00.059795] [DEBUG] [LOCAL ] WK: Deleted primary data file. [2025-09-17T22:36:00.059857] [INFO ] [MAIN ] WK: Starting full primary refresh. [2025-09-17T22:36:00.422855] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-11. [2025-09-17T22:36:00.429985] [INFO ] [REMOTE ] WK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:36:00.641562] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-07 (1.02 seconds). [2025-09-17T22:36:01.215815] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-11. [2025-09-17T22:36:02.015828] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-04. [2025-09-17T22:36:02.246397] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T22:36:02.815791] [INFO ] [REMOTE ] WIW: Fetching primary data for 2024-12. [2025-09-17T22:36:03.615809] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-08. [2025-09-17T22:36:03.858031] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-11 (2.64 seconds). [2025-09-17T22:36:04.415830] [INFO ] [REMOTE ] WK: Fetching primary data for 2024-12. [2025-09-17T22:36:04.613341] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-08 (1.00 seconds). [2025-09-17T22:36:04.969053] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2024-12 (2.15 seconds). [2025-09-17T22:36:05.144681] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-04 (3.13 seconds). [2025-09-17T22:36:05.215777] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-05. [2025-09-17T22:36:05.810236] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2024-12 (1.39 seconds). [2025-09-17T22:36:06.015761] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-01. [2025-09-17T22:36:06.815827] [INFO ] [REMOTE ] WINN: Fetching primary data for 2025-09. [2025-09-17T22:36:07.076476] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-05 (1.86 seconds). [2025-09-17T22:36:07.154486] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-01 (1.14 seconds). [2025-09-17T22:36:07.521978] [INFO ] [REMOTE ] WINN: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T22:36:07.523945] [INFO ] [REMOTE ] WINN: Full fetch complete (17683 records). [2025-09-17T22:36:07.524020] [DEBUG] [VALIDATOR ] WINN: Validating primary data. [2025-09-17T22:36:07.620939] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-06. [2025-09-17T22:36:07.922136] [DEBUG] [VALIDATOR ] WINN: All expected trading days are present. [2025-09-17T22:36:07.922228] [DEBUG] [VALIDATOR ] WINN: Primary data validation passed. [2025-09-17T22:36:07.922706] [INFO ] [MAIN ] WINN: Fetched primary data is valid. [2025-09-17T22:36:07.922795] [DEBUG] [LOCAL ] WINN: Saving primary data. [2025-09-17T22:36:07.923746] [DEBUG] [LOCAL ] WINN: Trimmed 17683 records to 11950 (keeping 200 days of data) [2025-09-17T22:36:08.001162] [DEBUG] [LOCAL ] WINN: Primary data saved (11950 records). [2025-09-17T22:36:08.001622] [INFO ] [MAIN ] WINN: Full history saved. [2025-09-17T22:36:08.001801] [INFO ] [MAIN ] Update Progress: 2297/2371 symbols completed. WINN took 30.9s. Estimated remaining: 10m 50s. Rate: 6.8 symbols/min [2025-09-17T22:36:08.226437] [INFO ] [MAIN ] WKC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:36:08.263717] [DEBUG] [LOCAL ] WKC: Loaded 35368 existing records from primary storage. [2025-09-17T22:36:08.263862] [INFO ] [MAIN ] WKC: Loaded 35368 existing records. [2025-09-17T22:36:08.425696] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-01. [2025-09-17T22:36:08.461503] [WARN ] [MAIN ] WKC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:36:08.461895] [INFO ] [MAIN ] WKC: Wiping existing primary data before full refresh. [2025-09-17T22:36:08.461961] [INFO ] [LOCAL ] WKC: Starting deletion of primary data. [2025-09-17T22:36:08.462831] [DEBUG] [LOCAL ] WKC: Deleted primary data file. [2025-09-17T22:36:08.462899] [INFO ] [MAIN ] WKC: Starting full primary refresh. [2025-09-17T22:36:08.820172] [INFO ] [REMOTE ] WKC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:36:09.215749] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-11. [2025-09-17T22:36:09.322465] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T22:36:09.613533] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T22:36:10.015807] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-07. [2025-09-17T22:36:10.365814] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T22:36:10.815799] [INFO ] [REMOTE ] WKC: Fetching primary data for 2024-12. [2025-09-17T22:36:11.615857] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-02. [2025-09-17T22:36:12.415829] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-02. [2025-09-17T22:36:13.328397] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-07 (3.31 seconds). [2025-09-17T22:36:13.340866] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-08. [2025-09-17T22:36:13.370905] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2024-12 (2.56 seconds). [2025-09-17T22:36:13.491003] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-02 (1.88 seconds). [2025-09-17T22:36:14.015799] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-01. [2025-09-17T22:36:14.584301] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-02 (2.17 seconds). [2025-09-17T22:36:14.815769] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-03. [2025-09-17T22:36:14.876100] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T22:36:14.996697] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T22:36:15.615778] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-02. [2025-09-17T22:36:16.378064] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-03 (1.56 seconds). [2025-09-17T22:36:16.415751] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-04. [2025-09-17T22:36:17.003539] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T22:36:17.215786] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-03. [2025-09-17T22:36:17.978028] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T22:36:18.015760] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-05. [2025-09-17T22:36:18.256953] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-03 (1.04 seconds). [2025-09-17T22:36:18.815785] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-03. [2025-09-17T22:36:19.296159] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T22:36:19.615786] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-04. [2025-09-17T22:36:20.283544] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-03 (1.47 seconds). [2025-09-17T22:36:20.415737] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-04. [2025-09-17T22:36:20.741001] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-04 (1.13 seconds). [2025-09-17T22:36:21.215795] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-05. [2025-09-17T22:36:22.015783] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-06. [2025-09-17T22:36:22.778985] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-04 (2.36 seconds). [2025-09-17T22:36:22.815834] [INFO ] [REMOTE ] WIT: Fetching primary data for 2025-09. [2025-09-17T22:36:22.831879] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T22:36:23.592138] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T22:36:23.615772] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-06. [2025-09-17T22:36:24.415798] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-05. [2025-09-17T22:36:24.468818] [INFO ] [REMOTE ] WIT: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T22:36:24.490330] [INFO ] [REMOTE ] WIT: Full fetch complete (75376 records). [2025-09-17T22:36:24.490625] [DEBUG] [VALIDATOR ] WIT: Validating primary data. [2025-09-17T22:36:24.491905] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-06 (0.88 seconds). [2025-09-17T22:36:24.930096] [DEBUG] [VALIDATOR ] WIT: All expected trading days are present. [2025-09-17T22:36:24.930184] [DEBUG] [VALIDATOR ] WIT: Primary data validation passed. [2025-09-17T22:36:24.931519] [INFO ] [MAIN ] WIT: Fetched primary data is valid. [2025-09-17T22:36:24.931589] [DEBUG] [LOCAL ] WIT: Saving primary data. [2025-09-17T22:36:24.934533] [DEBUG] [LOCAL ] WIT: Trimmed 75376 records to 52266 (keeping 200 days of data) [2025-09-17T22:36:25.225912] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-07. [2025-09-17T22:36:25.249258] [DEBUG] [LOCAL ] WIT: Primary data saved (52266 records). [2025-09-17T22:36:25.249406] [INFO ] [MAIN ] WIT: Full history saved. [2025-09-17T22:36:25.249563] [INFO ] [MAIN ] Update Progress: 2298/2371 symbols completed. WIT took 44.5s. Estimated remaining: 10m 41s. Rate: 6.8 symbols/min [2025-09-17T22:36:25.429359] [INFO ] [MAIN ] WLK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:36:25.476332] [DEBUG] [LOCAL ] WLK: Loaded 45219 existing records from primary storage. [2025-09-17T22:36:25.476539] [INFO ] [MAIN ] WLK: Loaded 45219 existing records. [2025-09-17T22:36:25.668392] [WARN ] [MAIN ] WLK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:36:25.668763] [INFO ] [MAIN ] WLK: Wiping existing primary data before full refresh. [2025-09-17T22:36:25.668825] [INFO ] [LOCAL ] WLK: Starting deletion of primary data. [2025-09-17T22:36:25.670213] [DEBUG] [LOCAL ] WLK: Deleted primary data file. [2025-09-17T22:36:25.670288] [INFO ] [MAIN ] WLK: Starting full primary refresh. [2025-09-17T22:36:26.016189] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-07. [2025-09-17T22:36:26.053257] [INFO ] [REMOTE ] WLK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:36:26.076009] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-05 (1.66 seconds). [2025-09-17T22:36:26.775146] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-07 (1.55 seconds). [2025-09-17T22:36:26.815786] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-06. [2025-09-17T22:36:26.844392] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-07 (0.83 seconds). [2025-09-17T22:36:27.615786] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-08. [2025-09-17T22:36:28.189860] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T22:36:28.415761] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-07. [2025-09-17T22:36:28.759737] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-08 (1.14 seconds). [2025-09-17T22:36:29.215799] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-08. [2025-09-17T22:36:29.556376] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-07 (1.14 seconds). [2025-09-17T22:36:30.015827] [INFO ] [REMOTE ] WIW: Fetching primary data for 2025-09. [2025-09-17T22:36:30.806276] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T22:36:30.815732] [INFO ] [REMOTE ] WK: Fetching primary data for 2025-09. [2025-09-17T22:36:30.857382] [INFO ] [REMOTE ] WIW: Incremental fetch complete for 2025-09 (0.84 seconds). [2025-09-17T22:36:30.861098] [INFO ] [REMOTE ] WIW: Full fetch complete (30509 records). [2025-09-17T22:36:30.861263] [DEBUG] [VALIDATOR ] WIW: Validating primary data. [2025-09-17T22:36:31.245049] [DEBUG] [VALIDATOR ] WIW: All expected trading days are present. [2025-09-17T22:36:31.245141] [DEBUG] [VALIDATOR ] WIW: Primary data validation passed. [2025-09-17T22:36:31.245910] [INFO ] [MAIN ] WIW: Fetched primary data is valid. [2025-09-17T22:36:31.245978] [DEBUG] [LOCAL ] WIW: Saving primary data. [2025-09-17T22:36:31.246886] [DEBUG] [LOCAL ] WIW: Trimmed 30509 records to 20861 (keeping 200 days of data) [2025-09-17T22:36:31.400747] [DEBUG] [LOCAL ] WIW: Primary data saved (20861 records). [2025-09-17T22:36:31.401278] [INFO ] [MAIN ] WIW: Full history saved. [2025-09-17T22:36:31.401523] [INFO ] [MAIN ] Update Progress: 2299/2371 symbols completed. WIW took 34.9s. Estimated remaining: 10m 32s. Rate: 6.8 symbols/min [2025-09-17T22:36:31.582707] [INFO ] [MAIN ] WLKP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:36:31.593775] [DEBUG] [LOCAL ] WLKP: Loaded 6539 existing records from primary storage. [2025-09-17T22:36:31.593922] [INFO ] [MAIN ] WLKP: Loaded 6539 existing records. [2025-09-17T22:36:31.626861] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-08. [2025-09-17T22:36:31.784292] [WARN ] [MAIN ] WLKP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:36:31.784555] [INFO ] [MAIN ] WLKP: Wiping existing primary data before full refresh. [2025-09-17T22:36:31.784603] [INFO ] [LOCAL ] WLKP: Starting deletion of primary data. [2025-09-17T22:36:31.784972] [DEBUG] [LOCAL ] WLKP: Deleted primary data file. [2025-09-17T22:36:31.785033] [INFO ] [MAIN ] WLKP: Starting full primary refresh. [2025-09-17T22:36:32.149662] [INFO ] [REMOTE ] WLKP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:36:32.164860] [INFO ] [REMOTE ] WK: Incremental fetch complete for 2025-09 (1.35 seconds). [2025-09-17T22:36:32.171132] [INFO ] [REMOTE ] WK: Full fetch complete (51566 records). [2025-09-17T22:36:32.171258] [DEBUG] [VALIDATOR ] WK: Validating primary data. [2025-09-17T22:36:32.427694] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-11. [2025-09-17T22:36:32.558234] [DEBUG] [VALIDATOR ] WK: All expected trading days are present. [2025-09-17T22:36:32.558325] [DEBUG] [VALIDATOR ] WK: Primary data validation passed. [2025-09-17T22:36:32.559311] [INFO ] [MAIN ] WK: Fetched primary data is valid. [2025-09-17T22:36:32.559376] [DEBUG] [LOCAL ] WK: Saving primary data. [2025-09-17T22:36:32.560552] [DEBUG] [LOCAL ] WK: Trimmed 51566 records to 36494 (keeping 200 days of data) [2025-09-17T22:36:32.798181] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T22:36:32.835623] [DEBUG] [LOCAL ] WK: Primary data saved (36494 records). [2025-09-17T22:36:32.835814] [INFO ] [MAIN ] WK: Full history saved. [2025-09-17T22:36:32.836858] [INFO ] [MAIN ] Update Progress: 2300/2371 symbols completed. WK took 33.2s. Estimated remaining: 10m 23s. Rate: 6.8 symbols/min [2025-09-17T22:36:33.011345] [INFO ] [MAIN ] WLTG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:36:33.011553] [DEBUG] [LOCAL ] WLTG: No existing data file found in primary storage. [2025-09-17T22:36:33.011612] [WARN ] [MAIN ] WLTG: No existing data found, performing full refresh instead. [2025-09-17T22:36:33.011785] [INFO ] [MAIN ] WLTG: Wiping existing primary data before full refresh. [2025-09-17T22:36:33.011830] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-17T22:36:33.011873] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-17T22:36:33.011906] [INFO ] [MAIN ] WLTG: Starting full primary refresh. [2025-09-17T22:36:33.221796] [INFO ] [REMOTE ] WKC: Fetching primary data for 2025-09. [2025-09-17T22:36:33.373937] [INFO ] [REMOTE ] WLTG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:36:33.981151] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T22:36:34.015729] [INFO ] [REMOTE ] WLK: Fetching primary data for 2024-12. [2025-09-17T22:36:34.564200] [INFO ] [REMOTE ] WKC: Incremental fetch complete for 2025-09 (1.34 seconds). [2025-09-17T22:36:34.569546] [INFO ] [REMOTE ] WKC: Full fetch complete (51337 records). [2025-09-17T22:36:34.569729] [DEBUG] [VALIDATOR ] WKC: Validating primary data. [2025-09-17T22:36:34.824067] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-11. [2025-09-17T22:36:34.954846] [DEBUG] [VALIDATOR ] WKC: All expected trading days are present. [2025-09-17T22:36:34.954923] [DEBUG] [VALIDATOR ] WKC: Primary data validation passed. [2025-09-17T22:36:34.955867] [INFO ] [MAIN ] WKC: Fetched primary data is valid. [2025-09-17T22:36:34.955945] [DEBUG] [LOCAL ] WKC: Saving primary data. [2025-09-17T22:36:34.957120] [DEBUG] [LOCAL ] WKC: Trimmed 51337 records to 35307 (keeping 200 days of data) [2025-09-17T22:36:35.183969] [DEBUG] [LOCAL ] WKC: Primary data saved (35307 records). [2025-09-17T22:36:35.184157] [INFO ] [MAIN ] WKC: Full history saved. [2025-09-17T22:36:35.184290] [INFO ] [MAIN ] Update Progress: 2301/2371 symbols completed. WKC took 27.2s. Estimated remaining: 10m 14s. Rate: 6.8 symbols/min [2025-09-17T22:36:35.291887] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-11 (0.47 seconds). [2025-09-17T22:36:35.361610] [INFO ] [MAIN ] WLY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:36:35.401891] [DEBUG] [LOCAL ] WLY: Loaded 30570 existing records from primary storage. [2025-09-17T22:36:35.402033] [INFO ] [MAIN ] WLY: Loaded 30570 existing records. [2025-09-17T22:36:35.584037] [WARN ] [MAIN ] WLY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:36:35.584542] [INFO ] [MAIN ] WLY: Wiping existing primary data before full refresh. [2025-09-17T22:36:35.584736] [INFO ] [LOCAL ] WLY: Starting deletion of primary data. [2025-09-17T22:36:35.585625] [DEBUG] [LOCAL ] WLY: Deleted primary data file. [2025-09-17T22:36:35.585726] [INFO ] [MAIN ] WLY: Starting full primary refresh. [2025-09-17T22:36:35.620931] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-11. [2025-09-17T22:36:35.869098] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2024-12 (1.85 seconds). [2025-09-17T22:36:35.988538] [INFO ] [REMOTE ] WLY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:36:36.415779] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-11. [2025-09-17T22:36:36.643181] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-11 (1.02 seconds). [2025-09-17T22:36:37.215783] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2024-12. [2025-09-17T22:36:37.958895] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-11 (1.54 seconds). [2025-09-17T22:36:38.016778] [INFO ] [REMOTE ] WLY: Fetching primary data for 2024-12. [2025-09-17T22:36:38.017672] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2024-12 (0.80 seconds). [2025-09-17T22:36:38.815821] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-01. [2025-09-17T22:36:39.371348] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2024-12 (1.35 seconds). [2025-09-17T22:36:39.615792] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-01. [2025-09-17T22:36:40.344973] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T22:36:40.357842] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-01 (0.74 seconds). [2025-09-17T22:36:40.415736] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-02. [2025-09-17T22:36:41.157247] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-02 (0.74 seconds). [2025-09-17T22:36:41.215822] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2024-12. [2025-09-17T22:36:41.563818] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2024-12 (0.35 seconds). [2025-09-17T22:36:42.015848] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-03. [2025-09-17T22:36:42.634966] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T22:36:42.815857] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-01. [2025-09-17T22:36:43.615888] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-02. [2025-09-17T22:36:44.102523] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-01 (1.29 seconds). [2025-09-17T22:36:44.415835] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-01. [2025-09-17T22:36:44.775407] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-01 (0.36 seconds). [2025-09-17T22:36:45.050254] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-02 (1.43 seconds). [2025-09-17T22:36:45.215774] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-04. [2025-09-17T22:36:45.948188] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-04 (0.73 seconds). [2025-09-17T22:36:46.015733] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-05. [2025-09-17T22:36:46.755089] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-05 (0.74 seconds). [2025-09-17T22:36:46.815744] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-06. [2025-09-17T22:36:47.615803] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-02. [2025-09-17T22:36:47.625613] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-06 (0.81 seconds). [2025-09-17T22:36:48.415811] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-03. [2025-09-17T22:36:48.914150] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T22:36:49.215789] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-02. [2025-09-17T22:36:49.563002] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-02 (0.35 seconds). [2025-09-17T22:36:49.682004] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T22:36:50.015783] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-04. [2025-09-17T22:36:50.815811] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-07. [2025-09-17T22:36:51.476457] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-07 (0.66 seconds). [2025-09-17T22:36:51.615761] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-03. [2025-09-17T22:36:51.703413] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-04 (1.69 seconds). [2025-09-17T22:36:52.415800] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-08. [2025-09-17T22:36:53.170687] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T22:36:53.170412] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-03 (1.55 seconds). [2025-09-17T22:36:53.215728] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-04. [2025-09-17T22:36:54.015762] [INFO ] [REMOTE ] WLKP: Fetching primary data for 2025-09. [2025-09-17T22:36:54.575509] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-04 (1.36 seconds). [2025-09-17T22:36:54.635637] [INFO ] [REMOTE ] WLKP: Incremental fetch complete for 2025-09 (0.62 seconds). [2025-09-17T22:36:54.637134] [INFO ] [REMOTE ] WLKP: Full fetch complete (10095 records). [2025-09-17T22:36:54.637220] [DEBUG] [VALIDATOR ] WLKP: Validating primary data. [2025-09-17T22:36:54.823246] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-03. [2025-09-17T22:36:55.008879] [DEBUG] [VALIDATOR ] WLKP: All expected trading days are present. [2025-09-17T22:36:55.008973] [DEBUG] [VALIDATOR ] WLKP: Primary data validation passed. [2025-09-17T22:36:55.009224] [INFO ] [MAIN ] WLKP: Fetched primary data is valid. [2025-09-17T22:36:55.009263] [DEBUG] [LOCAL ] WLKP: Saving primary data. [2025-09-17T22:36:55.009741] [DEBUG] [LOCAL ] WLKP: Trimmed 10095 records to 6523 (keeping 200 days of data) [2025-09-17T22:36:55.048753] [DEBUG] [LOCAL ] WLKP: Primary data saved (6523 records). [2025-09-17T22:36:55.048838] [INFO ] [MAIN ] WLKP: Full history saved. [2025-09-17T22:36:55.048965] [INFO ] [MAIN ] Update Progress: 2302/2371 symbols completed. WLKP took 23.6s. Estimated remaining: 10m 6s. Rate: 6.8 symbols/min [2025-09-17T22:36:55.219415] [INFO ] [MAIN ] WM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:36:55.257878] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-03 (0.43 seconds). [2025-09-17T22:36:55.277472] [DEBUG] [LOCAL ] WM: Loaded 51022 existing records from primary storage. [2025-09-17T22:36:55.277601] [INFO ] [MAIN ] WM: Loaded 51022 existing records. [2025-09-17T22:36:55.457277] [WARN ] [MAIN ] WM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:36:55.457551] [INFO ] [MAIN ] WM: Wiping existing primary data before full refresh. [2025-09-17T22:36:55.457612] [INFO ] [LOCAL ] WM: Starting deletion of primary data. [2025-09-17T22:36:55.458960] [DEBUG] [LOCAL ] WM: Deleted primary data file. [2025-09-17T22:36:55.459021] [INFO ] [MAIN ] WM: Starting full primary refresh. [2025-09-17T22:36:55.633775] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-04. [2025-09-17T22:36:55.824152] [INFO ] [REMOTE ] WM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:36:56.142867] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-04 (0.51 seconds). [2025-09-17T22:36:56.415814] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-05. [2025-09-17T22:36:57.215789] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-11. [2025-09-17T22:36:57.762526] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-05 (1.35 seconds). [2025-09-17T22:36:58.015771] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-06. [2025-09-17T22:36:58.815789] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-05. [2025-09-17T22:36:59.024142] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-11 (1.81 seconds). [2025-09-17T22:36:59.494072] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-06 (1.48 seconds). [2025-09-17T22:36:59.615777] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-07. [2025-09-17T22:37:00.420931] [INFO ] [REMOTE ] WM: Fetching primary data for 2024-12. [2025-09-17T22:37:00.433781] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-05 (1.62 seconds). [2025-09-17T22:37:01.217890] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-06. [2025-09-17T22:37:01.220515] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-07 (1.60 seconds). [2025-09-17T22:37:02.015759] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-05. [2025-09-17T22:37:02.501560] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2024-12 (2.08 seconds). [2025-09-17T22:37:02.517687] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-05 (0.50 seconds). [2025-09-17T22:37:02.815755] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-06. [2025-09-17T22:37:02.908480] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-06 (1.69 seconds). [2025-09-17T22:37:03.183348] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-06 (0.37 seconds). [2025-09-17T22:37:03.615794] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-08. [2025-09-17T22:37:04.415799] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-01. [2025-09-17T22:37:04.988627] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-08 (1.37 seconds). [2025-09-17T22:37:05.215798] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-07. [2025-09-17T22:37:06.015777] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-07. [2025-09-17T22:37:06.177769] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T22:37:06.464575] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-07 (0.45 seconds). [2025-09-17T22:37:06.820803] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-08. [2025-09-17T22:37:06.837083] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T22:37:07.453180] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-08 (0.63 seconds). [2025-09-17T22:37:07.615777] [INFO ] [REMOTE ] WLTG: Fetching primary data for 2025-09. [2025-09-17T22:37:08.031997] [INFO ] [REMOTE ] WLTG: Incremental fetch complete for 2025-09 (0.42 seconds). [2025-09-17T22:37:08.032796] [INFO ] [REMOTE ] WLTG: Full fetch complete (1657 records). [2025-09-17T22:37:08.032865] [DEBUG] [VALIDATOR ] WLTG: Validating primary data. [2025-09-17T22:37:08.210518] [WARN ] [VALIDATOR ] WLTG: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T22:37:08.210718] [FATAL] [MAIN ] WLTG: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:37:08.210787] [WARN ] [MAIN ] WLTG: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:37:08.210856] [INFO ] [LOCAL ] WLTG: Starting deletion of primary data. [2025-09-17T22:37:08.210920] [DEBUG] [LOCAL ] WLTG: No primary data file found to delete. [2025-09-17T22:37:08.210955] [INFO ] [LOCAL ] WLTG: Starting deletion of derivative data. [2025-09-17T22:37:08.210994] [DEBUG] [LOCAL ] WLTG: No derivative data file found to delete. [2025-09-17T22:37:08.211088] [INFO ] [MAIN ] Update Progress: 2303/2371 symbols completed. WLTG took 35.4s. Estimated remaining: 9m 57s. Rate: 6.8 symbols/min [2025-09-17T22:37:08.385331] [INFO ] [MAIN ] WMB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:37:08.426083] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-08. [2025-09-17T22:37:08.448549] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-17T22:37:08.448721] [INFO ] [MAIN ] WMB: Loaded 53671 existing records. [2025-09-17T22:37:08.625693] [WARN ] [MAIN ] WMB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:37:08.625939] [INFO ] [MAIN ] WMB: Wiping existing primary data before full refresh. [2025-09-17T22:37:08.625986] [INFO ] [LOCAL ] WMB: Starting deletion of primary data. [2025-09-17T22:37:08.627390] [DEBUG] [LOCAL ] WMB: Deleted primary data file. [2025-09-17T22:37:08.627451] [INFO ] [MAIN ] WMB: Starting full primary refresh. [2025-09-17T22:37:08.986825] [INFO ] [REMOTE ] WMB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:37:09.215805] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-02. [2025-09-17T22:37:10.015844] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-11. [2025-09-17T22:37:10.220183] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T22:37:10.815764] [INFO ] [REMOTE ] WLK: Fetching primary data for 2025-09. [2025-09-17T22:37:11.088685] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T22:37:11.621585] [INFO ] [REMOTE ] WLY: Fetching primary data for 2025-09. [2025-09-17T22:37:11.634889] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-11 (1.62 seconds). [2025-09-17T22:37:12.393006] [INFO ] [REMOTE ] WLK: Incremental fetch complete for 2025-09 (1.58 seconds). [2025-09-17T22:37:12.399318] [INFO ] [REMOTE ] WLK: Full fetch complete (62334 records). [2025-09-17T22:37:12.399467] [DEBUG] [VALIDATOR ] WLK: Validating primary data. [2025-09-17T22:37:12.422518] [INFO ] [REMOTE ] WMB: Fetching primary data for 2024-12. [2025-09-17T22:37:12.830899] [DEBUG] [VALIDATOR ] WLK: All expected trading days are present. [2025-09-17T22:37:12.830992] [DEBUG] [VALIDATOR ] WLK: Primary data validation passed. [2025-09-17T22:37:12.831957] [INFO ] [MAIN ] WLK: Fetched primary data is valid. [2025-09-17T22:37:12.832021] [DEBUG] [LOCAL ] WLK: Saving primary data. [2025-09-17T22:37:12.833422] [DEBUG] [LOCAL ] WLK: Trimmed 62334 records to 45252 (keeping 200 days of data) [2025-09-17T22:37:13.037513] [INFO ] [REMOTE ] WLY: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T22:37:13.084943] [INFO ] [REMOTE ] WLY: Full fetch complete (43084 records). [2025-09-17T22:37:13.087398] [DEBUG] [VALIDATOR ] WLY: Validating primary data. [2025-09-17T22:37:13.216312] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-03. [2025-09-17T22:37:13.548559] [DEBUG] [VALIDATOR ] WLY: All expected trading days are present. [2025-09-17T22:37:13.555840] [DEBUG] [VALIDATOR ] WLY: Primary data validation passed. [2025-09-17T22:37:13.556781] [INFO ] [MAIN ] WLY: Fetched primary data is valid. [2025-09-17T22:37:13.556863] [DEBUG] [LOCAL ] WLY: Saving primary data. [2025-09-17T22:37:13.560850] [DEBUG] [LOCAL ] WLY: Trimmed 43084 records to 30559 (keeping 200 days of data) [2025-09-17T22:37:13.664461] [DEBUG] [LOCAL ] WLK: Primary data saved (45252 records). [2025-09-17T22:37:13.665694] [INFO ] [MAIN ] WLK: Full history saved. [2025-09-17T22:37:13.666076] [INFO ] [MAIN ] Update Progress: 2304/2371 symbols completed. WLK took 48.4s. Estimated remaining: 9m 48s. Rate: 6.8 symbols/min [2025-09-17T22:37:13.870977] [INFO ] [MAIN ] WMK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:37:13.940913] [DEBUG] [LOCAL ] WMK: Loaded 14403 existing records from primary storage. [2025-09-17T22:37:13.941618] [INFO ] [MAIN ] WMK: Loaded 14403 existing records. [2025-09-17T22:37:14.139703] [WARN ] [MAIN ] WMK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:37:14.141883] [INFO ] [MAIN ] WMK: Wiping existing primary data before full refresh. [2025-09-17T22:37:14.141960] [INFO ] [LOCAL ] WMK: Starting deletion of primary data. [2025-09-17T22:37:14.143514] [DEBUG] [LOCAL ] WMK: Deleted primary data file. [2025-09-17T22:37:14.143945] [INFO ] [MAIN ] WMK: Starting full primary refresh. [2025-09-17T22:37:14.216355] [DEBUG] [LOCAL ] WLY: Primary data saved (30559 records). [2025-09-17T22:37:14.237453] [INFO ] [MAIN ] WLY: Full history saved. [2025-09-17T22:37:14.248263] [INFO ] [MAIN ] Update Progress: 2305/2371 symbols completed. WLY took 39.1s. Estimated remaining: 9m 39s. Rate: 6.8 symbols/min [2025-09-17T22:37:14.689380] [INFO ] [MAIN ] WMS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:37:14.790858] [INFO ] [REMOTE ] WMK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:37:14.791422] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-11. [2025-09-17T22:37:14.828573] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-17T22:37:14.840817] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-01. [2025-09-17T22:37:14.873932] [DEBUG] [LOCAL ] WMS: Loaded 39558 existing records from primary storage. [2025-09-17T22:37:14.874173] [INFO ] [MAIN ] WMS: Loaded 39558 existing records. [2025-09-17T22:37:15.059750] [WARN ] [MAIN ] WMS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:37:15.060085] [INFO ] [MAIN ] WMS: Wiping existing primary data before full refresh. [2025-09-17T22:37:15.060187] [INFO ] [LOCAL ] WMS: Starting deletion of primary data. [2025-09-17T22:37:15.061321] [DEBUG] [LOCAL ] WMS: Deleted primary data file. [2025-09-17T22:37:15.061386] [INFO ] [MAIN ] WMS: Starting full primary refresh. [2025-09-17T22:37:15.473114] [INFO ] [REMOTE ] WMS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:37:15.504522] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-03 (2.29 seconds). [2025-09-17T22:37:15.615798] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-04. [2025-09-17T22:37:15.941353] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-11 (1.15 seconds). [2025-09-17T22:37:16.415791] [INFO ] [REMOTE ] WMK: Fetching primary data for 2024-12. [2025-09-17T22:37:16.728738] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-01 (1.89 seconds). [2025-09-17T22:37:17.215782] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-02. [2025-09-17T22:37:17.239763] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2024-12 (0.82 seconds). [2025-09-17T22:37:17.700451] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-04 (2.08 seconds). [2025-09-17T22:37:18.015787] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-01. [2025-09-17T22:37:18.815803] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-11. [2025-09-17T22:37:18.877481] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-01 (0.86 seconds). [2025-09-17T22:37:19.275733] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-02 (2.06 seconds). [2025-09-17T22:37:19.615809] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-02. [2025-09-17T22:37:20.260151] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-11 (1.44 seconds). [2025-09-17T22:37:20.415781] [INFO ] [REMOTE ] WMS: Fetching primary data for 2024-12. [2025-09-17T22:37:20.459799] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-02 (0.84 seconds). [2025-09-17T22:37:21.215774] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-03. [2025-09-17T22:37:22.015802] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-03. [2025-09-17T22:37:22.053855] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2024-12 (1.64 seconds). [2025-09-17T22:37:22.207509] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-03 (0.99 seconds). [2025-09-17T22:37:22.815821] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-01. [2025-09-17T22:37:23.615806] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-04. [2025-09-17T22:37:23.962411] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T22:37:23.996166] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T22:37:24.415763] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-05. [2025-09-17T22:37:24.720579] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-04 (1.10 seconds). [2025-09-17T22:37:25.215800] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-05. [2025-09-17T22:37:26.015743] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-04. [2025-09-17T22:37:26.296509] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-05 (1.08 seconds). [2025-09-17T22:37:26.528361] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-05 (2.11 seconds). [2025-09-17T22:37:26.815817] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-06. [2025-09-17T22:37:27.615804] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-06. [2025-09-17T22:37:28.005495] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-04 (1.99 seconds). [2025-09-17T22:37:28.415815] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-02. [2025-09-17T22:37:28.504325] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-06 (0.89 seconds). [2025-09-17T22:37:28.752414] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T22:37:29.215813] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-07. [2025-09-17T22:37:29.621338] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-02 (1.21 seconds). [2025-09-17T22:37:30.015713] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-03. [2025-09-17T22:37:30.078518] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-07 (0.86 seconds). [2025-09-17T22:37:30.815793] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-08. [2025-09-17T22:37:31.508453] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-03 (1.49 seconds). [2025-09-17T22:37:31.615781] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-07. [2025-09-17T22:37:31.829470] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-08 (1.01 seconds). [2025-09-17T22:37:32.415787] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-05. [2025-09-17T22:37:33.215719] [INFO ] [REMOTE ] WMK: Fetching primary data for 2025-09. [2025-09-17T22:37:33.746437] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-07 (2.13 seconds). [2025-09-17T22:37:34.015786] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-04. [2025-09-17T22:37:34.065739] [INFO ] [REMOTE ] WMK: Incremental fetch complete for 2025-09 (0.85 seconds). [2025-09-17T22:37:34.068746] [INFO ] [REMOTE ] WMK: Full fetch complete (19065 records). [2025-09-17T22:37:34.068880] [DEBUG] [VALIDATOR ] WMK: Validating primary data. [2025-09-17T22:37:34.486573] [DEBUG] [VALIDATOR ] WMK: All expected trading days are present. [2025-09-17T22:37:34.486737] [DEBUG] [VALIDATOR ] WMK: Primary data validation passed. [2025-09-17T22:37:34.487315] [INFO ] [MAIN ] WMK: Fetched primary data is valid. [2025-09-17T22:37:34.487405] [DEBUG] [LOCAL ] WMK: Saving primary data. [2025-09-17T22:37:34.488808] [DEBUG] [LOCAL ] WMK: Trimmed 19065 records to 14480 (keeping 200 days of data) [2025-09-17T22:37:34.587551] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-05 (2.17 seconds). [2025-09-17T22:37:34.625761] [DEBUG] [LOCAL ] WMK: Primary data saved (14480 records). [2025-09-17T22:37:34.626118] [INFO ] [MAIN ] WMK: Full history saved. [2025-09-17T22:37:34.626285] [INFO ] [MAIN ] Update Progress: 2306/2371 symbols completed. WMK took 21.0s. Estimated remaining: 9m 31s. Rate: 6.8 symbols/min [2025-09-17T22:37:34.800578] [INFO ] [MAIN ] WMT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:37:34.815826] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-08. [2025-09-17T22:37:34.864934] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-09-17T22:37:34.865129] [INFO ] [MAIN ] WMT: Loaded 53800 existing records. [2025-09-17T22:37:35.074858] [WARN ] [MAIN ] WMT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:37:35.075151] [INFO ] [MAIN ] WMT: Wiping existing primary data before full refresh. [2025-09-17T22:37:35.075201] [INFO ] [LOCAL ] WMT: Starting deletion of primary data. [2025-09-17T22:37:35.076622] [DEBUG] [LOCAL ] WMT: Deleted primary data file. [2025-09-17T22:37:35.076714] [INFO ] [MAIN ] WMT: Starting full primary refresh. [2025-09-17T22:37:35.538099] [INFO ] [REMOTE ] WMT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:37:35.576802] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T22:37:35.615880] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-06. [2025-09-17T22:37:36.415796] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-05. [2025-09-17T22:37:36.944717] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-08 (2.13 seconds). [2025-09-17T22:37:37.088712] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-06 (1.47 seconds). [2025-09-17T22:37:37.215735] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-07. [2025-09-17T22:37:37.949207] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-05 (1.53 seconds). [2025-09-17T22:37:38.015752] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-06. [2025-09-17T22:37:38.815778] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-11. [2025-09-17T22:37:39.234311] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-07 (2.02 seconds). [2025-09-17T22:37:39.388871] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T22:37:39.615842] [INFO ] [REMOTE ] WM: Fetching primary data for 2025-09. [2025-09-17T22:37:40.291637] [INFO ] [REMOTE ] WM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T22:37:40.298476] [INFO ] [REMOTE ] WM: Full fetch complete (73527 records). [2025-09-17T22:37:40.298619] [DEBUG] [VALIDATOR ] WM: Validating primary data. [2025-09-17T22:37:40.420924] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-08. [2025-09-17T22:37:40.715088] [DEBUG] [VALIDATOR ] WM: All expected trading days are present. [2025-09-17T22:37:40.715223] [DEBUG] [VALIDATOR ] WM: Primary data validation passed. [2025-09-17T22:37:40.716290] [INFO ] [MAIN ] WM: Fetched primary data is valid. [2025-09-17T22:37:40.716364] [DEBUG] [LOCAL ] WM: Saving primary data. [2025-09-17T22:37:40.717824] [DEBUG] [LOCAL ] WM: Trimmed 73527 records to 51033 (keeping 200 days of data) [2025-09-17T22:37:41.045037] [DEBUG] [LOCAL ] WM: Primary data saved (51033 records). [2025-09-17T22:37:41.045325] [INFO ] [MAIN ] WM: Full history saved. [2025-09-17T22:37:41.046512] [INFO ] [MAIN ] Update Progress: 2307/2371 symbols completed. WM took 46.0s. Estimated remaining: 9m 22s. Rate: 6.8 symbols/min [2025-09-17T22:37:41.232551] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-07. [2025-09-17T22:37:41.232345] [INFO ] [MAIN ] WNC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:37:41.297156] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-11 (2.48 seconds). [2025-09-17T22:37:41.321992] [DEBUG] [LOCAL ] WNC: Loaded 40771 existing records from primary storage. [2025-09-17T22:37:41.322150] [INFO ] [MAIN ] WNC: Loaded 40771 existing records. [2025-09-17T22:37:41.501888] [WARN ] [MAIN ] WNC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:37:41.502252] [INFO ] [MAIN ] WNC: Wiping existing primary data before full refresh. [2025-09-17T22:37:41.502315] [INFO ] [LOCAL ] WNC: Starting deletion of primary data. [2025-09-17T22:37:41.503208] [DEBUG] [LOCAL ] WNC: Deleted primary data file. [2025-09-17T22:37:41.503269] [INFO ] [MAIN ] WNC: Starting full primary refresh. [2025-09-17T22:37:41.861168] [INFO ] [REMOTE ] WNC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:37:42.015776] [INFO ] [REMOTE ] WMT: Fetching primary data for 2024-12. [2025-09-17T22:37:42.487308] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-08 (2.07 seconds). [2025-09-17T22:37:42.527443] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-07 (1.29 seconds). [2025-09-17T22:37:42.815816] [INFO ] [REMOTE ] WMB: Fetching primary data for 2025-09. [2025-09-17T22:37:43.273866] [INFO ] [REMOTE ] WMB: Incremental fetch complete for 2025-09 (0.46 seconds). [2025-09-17T22:37:43.281160] [INFO ] [REMOTE ] WMB: Full fetch complete (77535 records). [2025-09-17T22:37:43.281313] [DEBUG] [VALIDATOR ] WMB: Validating primary data. [2025-09-17T22:37:43.620901] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-11. [2025-09-17T22:37:43.704997] [DEBUG] [VALIDATOR ] WMB: All expected trading days are present. [2025-09-17T22:37:43.705124] [DEBUG] [VALIDATOR ] WMB: Primary data validation passed. [2025-09-17T22:37:43.706928] [INFO ] [MAIN ] WMB: Fetched primary data is valid. [2025-09-17T22:37:43.706999] [DEBUG] [LOCAL ] WMB: Saving primary data. [2025-09-17T22:37:43.708736] [DEBUG] [LOCAL ] WMB: Trimmed 77535 records to 53671 (keeping 200 days of data) [2025-09-17T22:37:44.052534] [DEBUG] [LOCAL ] WMB: Primary data saved (53671 records). [2025-09-17T22:37:44.052704] [INFO ] [MAIN ] WMB: Full history saved. [2025-09-17T22:37:44.053702] [INFO ] [MAIN ] Update Progress: 2308/2371 symbols completed. WMB took 35.8s. Estimated remaining: 9m 13s. Rate: 6.8 symbols/min [2025-09-17T22:37:44.230786] [INFO ] [MAIN ] WNS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:37:44.271036] [DEBUG] [LOCAL ] WNS: Loaded 39684 existing records from primary storage. [2025-09-17T22:37:44.271178] [INFO ] [MAIN ] WNS: Loaded 39684 existing records. [2025-09-17T22:37:44.422977] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-08. [2025-09-17T22:37:44.461556] [WARN ] [MAIN ] WNS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:37:44.462148] [INFO ] [MAIN ] WNS: Wiping existing primary data before full refresh. [2025-09-17T22:37:44.462326] [INFO ] [LOCAL ] WNS: Starting deletion of primary data. [2025-09-17T22:37:44.463560] [DEBUG] [LOCAL ] WNS: Deleted primary data file. [2025-09-17T22:37:44.463626] [INFO ] [MAIN ] WNS: Starting full primary refresh. [2025-09-17T22:37:44.873678] [INFO ] [REMOTE ] WNS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:37:44.876830] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2024-12 (2.86 seconds). [2025-09-17T22:37:45.144991] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-11 (1.52 seconds). [2025-09-17T22:37:45.215751] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-11. [2025-09-17T22:37:46.015803] [INFO ] [REMOTE ] WNC: Fetching primary data for 2024-12. [2025-09-17T22:37:46.222611] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T22:37:46.583794] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-11 (1.37 seconds). [2025-09-17T22:37:46.815818] [INFO ] [REMOTE ] WMS: Fetching primary data for 2025-09. [2025-09-17T22:37:47.497623] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2024-12 (1.48 seconds). [2025-09-17T22:37:47.615790] [INFO ] [REMOTE ] WNS: Fetching primary data for 2024-12. [2025-09-17T22:37:48.273123] [INFO ] [REMOTE ] WMS: Incremental fetch complete for 2025-09 (1.46 seconds). [2025-09-17T22:37:48.278906] [INFO ] [REMOTE ] WMS: Full fetch complete (57172 records). [2025-09-17T22:37:48.279037] [DEBUG] [VALIDATOR ] WMS: Validating primary data. [2025-09-17T22:37:48.420925] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-01. [2025-09-17T22:37:48.699676] [DEBUG] [VALIDATOR ] WMS: All expected trading days are present. [2025-09-17T22:37:48.699785] [DEBUG] [VALIDATOR ] WMS: Primary data validation passed. [2025-09-17T22:37:48.700831] [INFO ] [MAIN ] WMS: Fetched primary data is valid. [2025-09-17T22:37:48.700897] [DEBUG] [LOCAL ] WMS: Saving primary data. [2025-09-17T22:37:48.702266] [DEBUG] [LOCAL ] WMS: Trimmed 57172 records to 39601 (keeping 200 days of data) [2025-09-17T22:37:48.952623] [DEBUG] [LOCAL ] WMS: Primary data saved (39601 records). [2025-09-17T22:37:48.952974] [INFO ] [MAIN ] WMS: Full history saved. [2025-09-17T22:37:48.953126] [INFO ] [MAIN ] Update Progress: 2309/2371 symbols completed. WMS took 34.7s. Estimated remaining: 9m 4s. Rate: 6.8 symbols/min [2025-09-17T22:37:49.111597] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2024-12 (1.50 seconds). [2025-09-17T22:37:49.161884] [INFO ] [MAIN ] WOLF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:37:49.215486] [DEBUG] [LOCAL ] WOLF: Loaded 53532 existing records from primary storage. [2025-09-17T22:37:49.215689] [INFO ] [MAIN ] WOLF: Loaded 53532 existing records. [2025-09-17T22:37:49.215762] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-01. [2025-09-17T22:37:49.400368] [WARN ] [MAIN ] WOLF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:37:49.400637] [INFO ] [MAIN ] WOLF: Wiping existing primary data before full refresh. [2025-09-17T22:37:49.400723] [INFO ] [LOCAL ] WOLF: Starting deletion of primary data. [2025-09-17T22:37:49.401808] [DEBUG] [LOCAL ] WOLF: Deleted primary data file. [2025-09-17T22:37:49.401871] [INFO ] [MAIN ] WOLF: Starting full primary refresh. [2025-09-17T22:37:49.759355] [INFO ] [REMOTE ] WOLF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:37:50.015778] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-01. [2025-09-17T22:37:50.703132] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T22:37:50.815739] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-02. [2025-09-17T22:37:50.964399] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-01 (2.54 seconds). [2025-09-17T22:37:51.089091] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-01 (1.07 seconds). [2025-09-17T22:37:51.615788] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-02. [2025-09-17T22:37:52.123120] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-02 (1.31 seconds). [2025-09-17T22:37:52.415807] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-11. [2025-09-17T22:37:53.215789] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-03. [2025-09-17T22:37:54.015786] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-02. [2025-09-17T22:37:54.089940] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-02 (2.47 seconds). [2025-09-17T22:37:54.639854] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T22:37:54.678077] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T22:37:54.815794] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2024-12. [2025-09-17T22:37:55.211827] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-02 (1.20 seconds). [2025-09-17T22:37:55.615802] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-03. [2025-09-17T22:37:56.415782] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-03. [2025-09-17T22:37:57.003669] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2024-12 (2.19 seconds). [2025-09-17T22:37:57.215787] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-04. [2025-09-17T22:37:58.015837] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-01. [2025-09-17T22:37:58.088462] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-03 (1.67 seconds). [2025-09-17T22:37:58.366147] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-03 (2.75 seconds). [2025-09-17T22:37:58.405715] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-04 (1.19 seconds). [2025-09-17T22:37:58.815786] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-04. [2025-09-17T22:37:59.615795] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-04. [2025-09-17T22:38:00.375268] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-01 (2.36 seconds). [2025-09-17T22:38:00.415771] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-02. [2025-09-17T22:38:00.455580] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T22:38:01.215784] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-05. [2025-09-17T22:38:02.015837] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-05. [2025-09-17T22:38:02.402565] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-04 (2.79 seconds). [2025-09-17T22:38:02.687975] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-05 (1.47 seconds). [2025-09-17T22:38:02.815754] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-06. [2025-09-17T22:38:02.879487] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-02 (2.46 seconds). [2025-09-17T22:38:03.596872] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-05 (1.58 seconds). [2025-09-17T22:38:03.615751] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-06. [2025-09-17T22:38:03.924157] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-06 (1.11 seconds). [2025-09-17T22:38:04.415776] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-05. [2025-09-17T22:38:04.884290] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-06 (1.27 seconds). [2025-09-17T22:38:05.215784] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-07. [2025-09-17T22:38:06.015777] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-07. [2025-09-17T22:38:06.803189] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-07 (1.59 seconds). [2025-09-17T22:38:06.815736] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-08. [2025-09-17T22:38:07.278569] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-05 (2.86 seconds). [2025-09-17T22:38:07.615856] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-06. [2025-09-17T22:38:07.683842] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-07 (1.67 seconds). [2025-09-17T22:38:08.433480] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-03. [2025-09-17T22:38:08.451132] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T22:38:09.215783] [INFO ] [REMOTE ] WNC: Fetching primary data for 2025-09. [2025-09-17T22:38:10.015759] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-08. [2025-09-17T22:38:10.083544] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-06 (2.47 seconds). [2025-09-17T22:38:10.430981] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-03 (2.00 seconds). [2025-09-17T22:38:10.457800] [INFO ] [REMOTE ] WNC: Incremental fetch complete for 2025-09 (1.24 seconds). [2025-09-17T22:38:10.462371] [INFO ] [REMOTE ] WNC: Full fetch complete (57533 records). [2025-09-17T22:38:10.462518] [DEBUG] [VALIDATOR ] WNC: Validating primary data. [2025-09-17T22:38:10.820933] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-07. [2025-09-17T22:38:10.867381] [DEBUG] [VALIDATOR ] WNC: All expected trading days are present. [2025-09-17T22:38:10.867475] [DEBUG] [VALIDATOR ] WNC: Primary data validation passed. [2025-09-17T22:38:10.868490] [INFO ] [MAIN ] WNC: Fetched primary data is valid. [2025-09-17T22:38:10.868555] [DEBUG] [LOCAL ] WNC: Saving primary data. [2025-09-17T22:38:10.869846] [DEBUG] [LOCAL ] WNC: Trimmed 57533 records to 40654 (keeping 200 days of data) [2025-09-17T22:38:11.127264] [DEBUG] [LOCAL ] WNC: Primary data saved (40654 records). [2025-09-17T22:38:11.127418] [INFO ] [MAIN ] WNC: Full history saved. [2025-09-17T22:38:11.129259] [INFO ] [MAIN ] Update Progress: 2310/2371 symbols completed. WNC took 30.1s. Estimated remaining: 8m 56s. Rate: 6.8 symbols/min [2025-09-17T22:38:11.318994] [INFO ] [MAIN ] WOR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:38:11.347363] [DEBUG] [LOCAL ] WOR: Loaded 24797 existing records from primary storage. [2025-09-17T22:38:11.347545] [INFO ] [MAIN ] WOR: Loaded 24797 existing records. [2025-09-17T22:38:11.548272] [WARN ] [MAIN ] WOR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:38:11.548567] [INFO ] [MAIN ] WOR: Wiping existing primary data before full refresh. [2025-09-17T22:38:11.548618] [INFO ] [LOCAL ] WOR: Starting deletion of primary data. [2025-09-17T22:38:11.550201] [DEBUG] [LOCAL ] WOR: Deleted primary data file. [2025-09-17T22:38:11.550264] [INFO ] [MAIN ] WOR: Starting full primary refresh. [2025-09-17T22:38:11.622041] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-04. [2025-09-17T22:38:11.956632] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-08 (1.94 seconds). [2025-09-17T22:38:12.004316] [INFO ] [REMOTE ] WOR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:38:12.415783] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-11. [2025-09-17T22:38:13.215799] [INFO ] [REMOTE ] WNS: Fetching primary data for 2025-09. [2025-09-17T22:38:13.500189] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-07 (2.68 seconds). [2025-09-17T22:38:13.735151] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T22:38:14.015762] [INFO ] [REMOTE ] WOR: Fetching primary data for 2024-12. [2025-09-17T22:38:14.167064] [INFO ] [REMOTE ] WNS: Incremental fetch complete for 2025-09 (0.95 seconds). [2025-09-17T22:38:14.173290] [INFO ] [REMOTE ] WNS: Full fetch complete (54658 records). [2025-09-17T22:38:14.173483] [DEBUG] [VALIDATOR ] WNS: Validating primary data. [2025-09-17T22:38:14.360575] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-04 (2.74 seconds). [2025-09-17T22:38:14.619178] [DEBUG] [VALIDATOR ] WNS: All expected trading days are present. [2025-09-17T22:38:14.619262] [DEBUG] [VALIDATOR ] WNS: Primary data validation passed. [2025-09-17T22:38:14.620245] [INFO ] [MAIN ] WNS: Fetched primary data is valid. [2025-09-17T22:38:14.620310] [DEBUG] [LOCAL ] WNS: Saving primary data. [2025-09-17T22:38:14.621681] [DEBUG] [LOCAL ] WNS: Trimmed 54658 records to 39829 (keeping 200 days of data) [2025-09-17T22:38:14.826705] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-08. [2025-09-17T22:38:14.862862] [DEBUG] [LOCAL ] WNS: Primary data saved (39829 records). [2025-09-17T22:38:14.863014] [INFO ] [MAIN ] WNS: Full history saved. [2025-09-17T22:38:14.864235] [INFO ] [MAIN ] Update Progress: 2311/2371 symbols completed. WNS took 30.8s. Estimated remaining: 8m 47s. Rate: 6.8 symbols/min [2025-09-17T22:38:15.034935] [INFO ] [MAIN ] WOW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:38:15.074129] [DEBUG] [LOCAL ] WOW: Loaded 29596 existing records from primary storage. [2025-09-17T22:38:15.074274] [INFO ] [MAIN ] WOW: Loaded 29596 existing records. [2025-09-17T22:38:15.255294] [WARN ] [MAIN ] WOW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:38:15.255777] [INFO ] [MAIN ] WOW: Wiping existing primary data before full refresh. [2025-09-17T22:38:15.255880] [INFO ] [LOCAL ] WOW: Starting deletion of primary data. [2025-09-17T22:38:15.261828] [DEBUG] [LOCAL ] WOW: Deleted primary data file. [2025-09-17T22:38:15.269896] [INFO ] [MAIN ] WOW: Starting full primary refresh. [2025-09-17T22:38:15.304567] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2024-12 (1.29 seconds). [2025-09-17T22:38:15.618230] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-01. [2025-09-17T22:38:15.644060] [INFO ] [REMOTE ] WOW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:38:16.415798] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-05. [2025-09-17T22:38:16.811017] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-01 (1.19 seconds). [2025-09-17T22:38:17.215770] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-11. [2025-09-17T22:38:17.453277] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-08 (2.63 seconds). [2025-09-17T22:38:18.015759] [INFO ] [REMOTE ] WMT: Fetching primary data for 2025-09. [2025-09-17T22:38:18.395779] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-11 (1.18 seconds). [2025-09-17T22:38:18.691212] [INFO ] [REMOTE ] WMT: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T22:38:18.698136] [INFO ] [REMOTE ] WMT: Full fetch complete (77964 records). [2025-09-17T22:38:18.698255] [DEBUG] [VALIDATOR ] WMT: Validating primary data. [2025-09-17T22:38:18.820859] [INFO ] [REMOTE ] WOW: Fetching primary data for 2024-12. [2025-09-17T22:38:19.098522] [DEBUG] [VALIDATOR ] WMT: All expected trading days are present. [2025-09-17T22:38:19.098636] [DEBUG] [VALIDATOR ] WMT: Primary data validation passed. [2025-09-17T22:38:19.100034] [INFO ] [MAIN ] WMT: Fetched primary data is valid. [2025-09-17T22:38:19.100122] [DEBUG] [LOCAL ] WMT: Saving primary data. [2025-09-17T22:38:19.101614] [DEBUG] [LOCAL ] WMT: Trimmed 77964 records to 53800 (keeping 200 days of data) [2025-09-17T22:38:19.240769] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-05 (2.82 seconds). [2025-09-17T22:38:19.502204] [DEBUG] [LOCAL ] WMT: Primary data saved (53800 records). [2025-09-17T22:38:19.502383] [INFO ] [MAIN ] WMT: Full history saved. [2025-09-17T22:38:19.502489] [INFO ] [MAIN ] Update Progress: 2312/2371 symbols completed. WMT took 44.9s. Estimated remaining: 8m 38s. Rate: 6.8 symbols/min [2025-09-17T22:38:19.620985] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-02. [2025-09-17T22:38:19.678216] [INFO ] [MAIN ] WPC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:38:19.723765] [DEBUG] [LOCAL ] WPC: Loaded 48812 existing records from primary storage. [2025-09-17T22:38:19.723914] [INFO ] [MAIN ] WPC: Loaded 48812 existing records. [2025-09-17T22:38:19.902455] [WARN ] [MAIN ] WPC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:38:19.902746] [INFO ] [MAIN ] WPC: Wiping existing primary data before full refresh. [2025-09-17T22:38:19.902802] [INFO ] [LOCAL ] WPC: Starting deletion of primary data. [2025-09-17T22:38:19.903871] [DEBUG] [LOCAL ] WPC: Deleted primary data file. [2025-09-17T22:38:19.903932] [INFO ] [MAIN ] WPC: Starting full primary refresh. [2025-09-17T22:38:20.278352] [INFO ] [REMOTE ] WPC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:38:20.279867] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T22:38:20.415779] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-11. [2025-09-17T22:38:20.776243] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T22:38:21.215758] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-03. [2025-09-17T22:38:22.015827] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-06. [2025-09-17T22:38:22.253251] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-11 (1.84 seconds). [2025-09-17T22:38:22.617153] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-03 (1.40 seconds). [2025-09-17T22:38:22.815793] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-01. [2025-09-17T22:38:23.615783] [INFO ] [REMOTE ] WPC: Fetching primary data for 2024-12. [2025-09-17T22:38:23.733345] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-01 (0.92 seconds). [2025-09-17T22:38:23.944798] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-06 (1.93 seconds). [2025-09-17T22:38:24.415798] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-02. [2025-09-17T22:38:25.215775] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-04. [2025-09-17T22:38:25.671261] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2024-12 (2.06 seconds). [2025-09-17T22:38:25.712322] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-02 (1.30 seconds). [2025-09-17T22:38:26.015800] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-03. [2025-09-17T22:38:26.367019] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-04 (1.15 seconds). [2025-09-17T22:38:26.815851] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-07. [2025-09-17T22:38:27.352538] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T22:38:27.615791] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-04. [2025-09-17T22:38:28.415856] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-01. [2025-09-17T22:38:28.943441] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-04 (1.33 seconds). [2025-09-17T22:38:29.215809] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-05. [2025-09-17T22:38:29.548339] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-07 (2.73 seconds). [2025-09-17T22:38:30.015876] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-05. [2025-09-17T22:38:30.286448] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T22:38:30.480355] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-01 (2.06 seconds). [2025-09-17T22:38:30.815796] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-02. [2025-09-17T22:38:31.317553] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-05 (1.30 seconds). [2025-09-17T22:38:31.615797] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-08. [2025-09-17T22:38:32.415789] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-06. [2025-09-17T22:38:32.686670] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-02 (1.87 seconds). [2025-09-17T22:38:33.215825] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-06. [2025-09-17T22:38:33.661003] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-06 (1.25 seconds). [2025-09-17T22:38:34.015761] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-07. [2025-09-17T22:38:34.085563] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-08 (2.47 seconds). [2025-09-17T22:38:34.496479] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-06 (1.28 seconds). [2025-09-17T22:38:34.815844] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-03. [2025-09-17T22:38:35.107744] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-07 (1.09 seconds). [2025-09-17T22:38:35.615788] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-07. [2025-09-17T22:38:36.415778] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-08. [2025-09-17T22:38:36.589806] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-03 (1.77 seconds). [2025-09-17T22:38:36.887435] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-07 (1.27 seconds). [2025-09-17T22:38:37.215828] [INFO ] [REMOTE ] WOLF: Fetching primary data for 2025-09. [2025-09-17T22:38:37.475949] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T22:38:38.015817] [INFO ] [REMOTE ] WOR: Fetching primary data for 2025-09. [2025-09-17T22:38:38.815775] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-04. [2025-09-17T22:38:39.046510] [INFO ] [REMOTE ] WOR: Incremental fetch complete for 2025-09 (1.03 seconds). [2025-09-17T22:38:39.049747] [INFO ] [REMOTE ] WOR: Full fetch complete (35441 records). [2025-09-17T22:38:39.049836] [DEBUG] [VALIDATOR ] WOR: Validating primary data. [2025-09-17T22:38:39.460920] [DEBUG] [VALIDATOR ] WOR: All expected trading days are present. [2025-09-17T22:38:39.461025] [DEBUG] [VALIDATOR ] WOR: Primary data validation passed. [2025-09-17T22:38:39.461772] [INFO ] [MAIN ] WOR: Fetched primary data is valid. [2025-09-17T22:38:39.461945] [DEBUG] [LOCAL ] WOR: Saving primary data. [2025-09-17T22:38:39.482195] [DEBUG] [LOCAL ] WOR: Trimmed 35441 records to 24771 (keeping 200 days of data) [2025-09-17T22:38:39.483832] [INFO ] [REMOTE ] WOLF: Incremental fetch complete for 2025-09 (2.27 seconds). [2025-09-17T22:38:39.494546] [INFO ] [REMOTE ] WOLF: Full fetch complete (77532 records). [2025-09-17T22:38:39.494710] [DEBUG] [VALIDATOR ] WOLF: Validating primary data. [2025-09-17T22:38:39.620451] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-08. [2025-09-17T22:38:40.070686] [DEBUG] [VALIDATOR ] WOLF: All expected trading days are present. [2025-09-17T22:38:40.070824] [DEBUG] [VALIDATOR ] WOLF: Primary data validation passed. [2025-09-17T22:38:40.073015] [INFO ] [MAIN ] WOLF: Fetched primary data is valid. [2025-09-17T22:38:40.086098] [DEBUG] [LOCAL ] WOLF: Saving primary data. [2025-09-17T22:38:40.104466] [DEBUG] [LOCAL ] WOR: Primary data saved (24771 records). [2025-09-17T22:38:40.104699] [INFO ] [MAIN ] WOR: Full history saved. [2025-09-17T22:38:40.105127] [INFO ] [MAIN ] Update Progress: 2313/2371 symbols completed. WOR took 29.0s. Estimated remaining: 8m 29s. Rate: 6.8 symbols/min [2025-09-17T22:38:40.151750] [DEBUG] [LOCAL ] WOLF: Trimmed 77532 records to 53532 (keeping 200 days of data) [2025-09-17T22:38:40.371991] [INFO ] [MAIN ] WPM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:38:40.441457] [DEBUG] [LOCAL ] WPM: Loaded 52724 existing records from primary storage. [2025-09-17T22:38:40.442145] [INFO ] [MAIN ] WPM: Loaded 52724 existing records. [2025-09-17T22:38:40.726366] [WARN ] [MAIN ] WPM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:38:40.729024] [INFO ] [MAIN ] WPM: Wiping existing primary data before full refresh. [2025-09-17T22:38:40.731959] [INFO ] [LOCAL ] WPM: Starting deletion of primary data. [2025-09-17T22:38:40.748634] [DEBUG] [LOCAL ] WPM: Deleted primary data file. [2025-09-17T22:38:40.760184] [INFO ] [MAIN ] WPM: Starting full primary refresh. [2025-09-17T22:38:40.813583] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-04 (2.00 seconds). [2025-09-17T22:38:40.874919] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-05. [2025-09-17T22:38:41.269268] [INFO ] [REMOTE ] WPM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:38:41.266035] [DEBUG] [LOCAL ] WOLF: Primary data saved (53532 records). [2025-09-17T22:38:41.269759] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-11. [2025-09-17T22:38:41.269475] [INFO ] [MAIN ] WOLF: Full history saved. [2025-09-17T22:38:41.270833] [INFO ] [MAIN ] Update Progress: 2314/2371 symbols completed. WOLF took 52.3s. Estimated remaining: 8m 21s. Rate: 6.8 symbols/min [2025-09-17T22:38:41.477729] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T22:38:41.476410] [INFO ] [MAIN ] WPP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:38:41.521056] [DEBUG] [LOCAL ] WPP: Loaded 33614 existing records from primary storage. [2025-09-17T22:38:41.521277] [INFO ] [MAIN ] WPP: Loaded 33614 existing records. [2025-09-17T22:38:41.702507] [WARN ] [MAIN ] WPP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:38:41.702797] [INFO ] [MAIN ] WPP: Wiping existing primary data before full refresh. [2025-09-17T22:38:41.702848] [INFO ] [LOCAL ] WPP: Starting deletion of primary data. [2025-09-17T22:38:41.703574] [DEBUG] [LOCAL ] WPP: Deleted primary data file. [2025-09-17T22:38:41.703634] [INFO ] [MAIN ] WPP: Starting full primary refresh. [2025-09-17T22:38:42.027071] [INFO ] [REMOTE ] WOW: Fetching primary data for 2025-09. [2025-09-17T22:38:42.067956] [INFO ] [REMOTE ] WPP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:38:42.815810] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-11. [2025-09-17T22:38:42.947144] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T22:38:43.221824] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-17T22:38:43.341361] [INFO ] [REMOTE ] WOW: Incremental fetch complete for 2025-09 (1.31 seconds). [2025-09-17T22:38:43.347094] [INFO ] [REMOTE ] WOW: Full fetch complete (41071 records). [2025-09-17T22:38:43.347221] [DEBUG] [VALIDATOR ] WOW: Validating primary data. [2025-09-17T22:38:43.621148] [INFO ] [REMOTE ] WPM: Fetching primary data for 2024-12. [2025-09-17T22:38:43.728431] [DEBUG] [VALIDATOR ] WOW: All expected trading days are present. [2025-09-17T22:38:43.728518] [DEBUG] [VALIDATOR ] WOW: Primary data validation passed. [2025-09-17T22:38:43.729356] [INFO ] [MAIN ] WOW: Fetched primary data is valid. [2025-09-17T22:38:43.729418] [DEBUG] [LOCAL ] WOW: Saving primary data. [2025-09-17T22:38:43.730347] [DEBUG] [LOCAL ] WOW: Trimmed 41071 records to 29671 (keeping 200 days of data) [2025-09-17T22:38:43.907854] [DEBUG] [LOCAL ] WOW: Primary data saved (29671 records). [2025-09-17T22:38:43.908000] [INFO ] [MAIN ] WOW: Full history saved. [2025-09-17T22:38:43.908132] [INFO ] [MAIN ] Update Progress: 2315/2371 symbols completed. WOW took 29.0s. Estimated remaining: 8m 12s. Rate: 6.8 symbols/min [2025-09-17T22:38:44.078292] [INFO ] [MAIN ] WRB: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:38:44.131492] [DEBUG] [LOCAL ] WRB: Loaded 50593 existing records from primary storage. [2025-09-17T22:38:44.131697] [INFO ] [MAIN ] WRB: Loaded 50593 existing records. [2025-09-17T22:38:44.315724] [WARN ] [MAIN ] WRB: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:38:44.316400] [INFO ] [MAIN ] WRB: Wiping existing primary data before full refresh. [2025-09-17T22:38:44.316476] [INFO ] [LOCAL ] WRB: Starting deletion of primary data. [2025-09-17T22:38:44.322926] [DEBUG] [LOCAL ] WRB: Deleted primary data file. [2025-09-17T22:38:44.331169] [INFO ] [MAIN ] WRB: Starting full primary refresh. [2025-09-17T22:38:44.369800] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-11 (1.55 seconds). [2025-09-17T22:38:44.422015] [INFO ] [REMOTE ] WPP: Fetching primary data for 2024-12. [2025-09-17T22:38:44.716959] [INFO ] [REMOTE ] WRB: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:38:45.215771] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-06. [2025-09-17T22:38:45.652510] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2024-12 (2.03 seconds). [2025-09-17T22:38:45.675793] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2024-12 (1.25 seconds). [2025-09-17T22:38:46.015821] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-01. [2025-09-17T22:38:46.815866] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-11. [2025-09-17T22:38:46.894633] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-06 (1.68 seconds). [2025-09-17T22:38:47.432078] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T22:38:47.615807] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-01. [2025-09-17T22:38:48.417933] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-07. [2025-09-17T22:38:48.420663] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-11 (1.60 seconds). [2025-09-17T22:38:49.215826] [INFO ] [REMOTE ] WRB: Fetching primary data for 2024-12. [2025-09-17T22:38:49.410686] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T22:38:50.015787] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-02. [2025-09-17T22:38:50.143429] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T22:38:50.815793] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-08. [2025-09-17T22:38:50.939737] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T22:38:51.103944] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T22:38:51.615803] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-02. [2025-09-17T22:38:52.396263] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-08 (1.58 seconds). [2025-09-17T22:38:52.415734] [INFO ] [REMOTE ] WPC: Fetching primary data for 2025-09. [2025-09-17T22:38:53.215823] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-01. [2025-09-17T22:38:53.428833] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T22:38:53.499527] [INFO ] [REMOTE ] WPC: Incremental fetch complete for 2025-09 (1.08 seconds). [2025-09-17T22:38:53.508253] [INFO ] [REMOTE ] WPC: Full fetch complete (70902 records). [2025-09-17T22:38:53.508478] [DEBUG] [VALIDATOR ] WPC: Validating primary data. [2025-09-17T22:38:53.906822] [DEBUG] [VALIDATOR ] WPC: All expected trading days are present. [2025-09-17T22:38:53.906968] [DEBUG] [VALIDATOR ] WPC: Primary data validation passed. [2025-09-17T22:38:53.908054] [INFO ] [MAIN ] WPC: Fetched primary data is valid. [2025-09-17T22:38:53.908119] [DEBUG] [LOCAL ] WPC: Saving primary data. [2025-09-17T22:38:53.909577] [DEBUG] [LOCAL ] WPC: Trimmed 70902 records to 48777 (keeping 200 days of data) [2025-09-17T22:38:54.026711] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-03. [2025-09-17T22:38:54.203202] [DEBUG] [LOCAL ] WPC: Primary data saved (48777 records). [2025-09-17T22:38:54.203342] [INFO ] [MAIN ] WPC: Full history saved. [2025-09-17T22:38:54.203473] [INFO ] [MAIN ] Update Progress: 2316/2371 symbols completed. WPC took 34.7s. Estimated remaining: 8m 3s. Rate: 6.8 symbols/min [2025-09-17T22:38:54.374530] [INFO ] [MAIN ] WRBY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:38:54.429119] [DEBUG] [LOCAL ] WRBY: Loaded 50932 existing records from primary storage. [2025-09-17T22:38:54.429294] [INFO ] [MAIN ] WRBY: Loaded 50932 existing records. [2025-09-17T22:38:54.672045] [WARN ] [MAIN ] WRBY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:38:54.674157] [INFO ] [MAIN ] WRBY: Wiping existing primary data before full refresh. [2025-09-17T22:38:54.674297] [INFO ] [LOCAL ] WRBY: Starting deletion of primary data. [2025-09-17T22:38:54.686105] [DEBUG] [LOCAL ] WRBY: Deleted primary data file. [2025-09-17T22:38:54.700740] [INFO ] [MAIN ] WRBY: Starting full primary refresh. [2025-09-17T22:38:54.783433] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T22:38:54.820269] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-03. [2025-09-17T22:38:55.105581] [INFO ] [REMOTE ] WRBY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:38:55.615782] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-11. [2025-09-17T22:38:55.776622] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-03 (1.75 seconds). [2025-09-17T22:38:56.415819] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-02. [2025-09-17T22:38:56.886815] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-03 (2.07 seconds). [2025-09-17T22:38:57.215790] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-04. [2025-09-17T22:38:57.385194] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T22:38:57.643571] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-02 (1.23 seconds). [2025-09-17T22:38:58.015814] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2024-12. [2025-09-17T22:38:58.815797] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-03. [2025-09-17T22:38:59.196496] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-04 (1.98 seconds). [2025-09-17T22:38:59.615857] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-05. [2025-09-17T22:38:59.690285] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T22:39:00.178569] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-03 (1.36 seconds). [2025-09-17T22:39:00.415818] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-01. [2025-09-17T22:39:01.215839] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-04. [2025-09-17T22:39:01.599077] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-05 (1.98 seconds). [2025-09-17T22:39:02.015873] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-06. [2025-09-17T22:39:02.116183] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-01 (1.70 seconds). [2025-09-17T22:39:02.815798] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-02. [2025-09-17T22:39:03.615853] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-04. [2025-09-17T22:39:05.009154] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-04 (3.79 seconds). [2025-09-17T22:39:05.020584] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-05. [2025-09-17T22:39:05.046411] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T22:39:05.194447] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-06 (3.18 seconds). [2025-09-17T22:39:05.215736] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-07. [2025-09-17T22:39:05.577509] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-02 (2.76 seconds). [2025-09-17T22:39:06.015839] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-03. [2025-09-17T22:39:06.815767] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-05. [2025-09-17T22:39:07.110756] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-05 (2.09 seconds). [2025-09-17T22:39:07.201921] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-07 (1.99 seconds). [2025-09-17T22:39:07.615796] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-08. [2025-09-17T22:39:07.915157] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-03 (1.90 seconds). [2025-09-17T22:39:08.206888] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-05 (1.39 seconds). [2025-09-17T22:39:08.415832] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-06. [2025-09-17T22:39:09.215825] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-06. [2025-09-17T22:39:09.264206] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-08 (1.65 seconds). [2025-09-17T22:39:10.015805] [INFO ] [REMOTE ] WPM: Fetching primary data for 2025-09. [2025-09-17T22:39:10.044507] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T22:39:10.640354] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-06 (1.42 seconds). [2025-09-17T22:39:10.815775] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-07. [2025-09-17T22:39:11.615794] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-07. [2025-09-17T22:39:11.788634] [INFO ] [REMOTE ] WPM: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T22:39:11.797057] [INFO ] [REMOTE ] WPM: Full fetch complete (75594 records). [2025-09-17T22:39:11.797223] [DEBUG] [VALIDATOR ] WPM: Validating primary data. [2025-09-17T22:39:12.226365] [DEBUG] [VALIDATOR ] WPM: All expected trading days are present. [2025-09-17T22:39:12.226483] [DEBUG] [VALIDATOR ] WPM: Primary data validation passed. [2025-09-17T22:39:12.227768] [INFO ] [MAIN ] WPM: Fetched primary data is valid. [2025-09-17T22:39:12.227836] [DEBUG] [LOCAL ] WPM: Saving primary data. [2025-09-17T22:39:12.229502] [DEBUG] [LOCAL ] WPM: Trimmed 75594 records to 52721 (keeping 200 days of data) [2025-09-17T22:39:12.421183] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-04. [2025-09-17T22:39:12.565799] [DEBUG] [LOCAL ] WPM: Primary data saved (52721 records). [2025-09-17T22:39:12.565941] [INFO ] [MAIN ] WPM: Full history saved. [2025-09-17T22:39:12.567892] [INFO ] [MAIN ] Update Progress: 2317/2371 symbols completed. WPM took 32.5s. Estimated remaining: 7m 54s. Rate: 6.8 symbols/min [2025-09-17T22:39:13.784790] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-07 (2.97 seconds). [2025-09-17T22:39:13.793520] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-08. [2025-09-17T22:39:14.754426] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-07 (3.14 seconds). [2025-09-17T22:39:14.766299] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-08. [2025-09-17T22:39:15.660878] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-08 (1.87 seconds). [2025-09-17T22:39:15.669000] [INFO ] [REMOTE ] WPP: Fetching primary data for 2025-09. [2025-09-17T22:39:15.741771] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-04 (3.32 seconds). [2025-09-17T22:39:15.753200] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-05. [2025-09-17T22:39:16.188849] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-08 (1.42 seconds). [2025-09-17T22:39:16.415785] [INFO ] [REMOTE ] WRB: Fetching primary data for 2025-09. [2025-09-17T22:39:16.686900] [INFO ] [REMOTE ] WRB: Incremental fetch complete for 2025-09 (0.27 seconds). [2025-09-17T22:39:16.693704] [INFO ] [REMOTE ] WRB: Full fetch complete (72840 records). [2025-09-17T22:39:16.693895] [DEBUG] [VALIDATOR ] WRB: Validating primary data. [2025-09-17T22:39:17.093607] [DEBUG] [VALIDATOR ] WRB: All expected trading days are present. [2025-09-17T22:39:17.093839] [DEBUG] [VALIDATOR ] WRB: Primary data validation passed. [2025-09-17T22:39:17.100330] [INFO ] [MAIN ] WRB: Fetched primary data is valid. [2025-09-17T22:39:17.107115] [DEBUG] [LOCAL ] WRB: Saving primary data. [2025-09-17T22:39:17.108902] [INFO ] [REMOTE ] WPP: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T22:39:17.114141] [INFO ] [REMOTE ] WPP: Full fetch complete (44476 records). [2025-09-17T22:39:17.114406] [DEBUG] [VALIDATOR ] WPP: Validating primary data. [2025-09-17T22:39:17.114685] [DEBUG] [LOCAL ] WRB: Trimmed 72840 records to 50611 (keeping 200 days of data) [2025-09-17T22:39:17.661449] [DEBUG] [VALIDATOR ] WPP: All expected trading days are present. [2025-09-17T22:39:17.664548] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T22:39:17.664664] [DEBUG] [VALIDATOR ] WPP: Primary data validation passed. [2025-09-17T22:39:17.678115] [INFO ] [MAIN ] WPP: Fetched primary data is valid. [2025-09-17T22:39:17.678486] [DEBUG] [LOCAL ] WPP: Saving primary data. [2025-09-17T22:39:17.681375] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-06. [2025-09-17T22:39:17.683348] [DEBUG] [LOCAL ] WPP: Trimmed 44476 records to 33606 (keeping 200 days of data) [2025-09-17T22:39:18.079121] [DEBUG] [LOCAL ] WPP: Primary data saved (33606 records). [2025-09-17T22:39:18.086954] [INFO ] [MAIN ] WPP: Full history saved. [2025-09-17T22:39:18.087128] [INFO ] [MAIN ] Update Progress: 2318/2371 symbols completed. WPP took 36.8s. Estimated remaining: 7m 45s. Rate: 6.8 symbols/min [2025-09-17T22:39:18.086858] [DEBUG] [LOCAL ] WRB: Primary data saved (50611 records). [2025-09-17T22:39:18.087386] [INFO ] [MAIN ] WRB: Full history saved. [2025-09-17T22:39:18.088271] [INFO ] [MAIN ] Update Progress: 2319/2371 symbols completed. WRB took 34.2s. Estimated remaining: 7m 36s. Rate: 6.8 symbols/min [2025-09-17T22:39:19.411214] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-06 (1.73 seconds). [2025-09-17T22:39:19.421668] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-07. [2025-09-17T22:39:21.228243] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-07 (1.81 seconds). [2025-09-17T22:39:21.239210] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-08. [2025-09-17T22:39:23.263292] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T22:39:23.273855] [INFO ] [REMOTE ] WRBY: Fetching primary data for 2025-09. [2025-09-17T22:39:24.881404] [INFO ] [REMOTE ] WRBY: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T22:39:24.887765] [INFO ] [REMOTE ] WRBY: Full fetch complete (73175 records). [2025-09-17T22:39:24.887899] [DEBUG] [VALIDATOR ] WRBY: Validating primary data. [2025-09-17T22:39:25.298282] [DEBUG] [VALIDATOR ] WRBY: All expected trading days are present. [2025-09-17T22:39:25.298400] [DEBUG] [VALIDATOR ] WRBY: Primary data validation passed. [2025-09-17T22:39:25.299665] [INFO ] [MAIN ] WRBY: Fetched primary data is valid. [2025-09-17T22:39:25.299732] [DEBUG] [LOCAL ] WRBY: Saving primary data. [2025-09-17T22:39:25.301730] [DEBUG] [LOCAL ] WRBY: Trimmed 73175 records to 50921 (keeping 200 days of data) [2025-09-17T22:39:25.597637] [DEBUG] [LOCAL ] WRBY: Primary data saved (50921 records). [2025-09-17T22:39:25.597804] [INFO ] [MAIN ] WRBY: Full history saved. [2025-09-17T22:39:25.597905] [INFO ] [MAIN ] Update Progress: 2320/2371 symbols completed. WRBY took 31.4s. Estimated remaining: 7m 28s. Rate: 6.8 symbols/min [2025-09-17T22:39:26.273945] [INFO ] [MAIN ] WSR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:39:26.217857] [INFO ] [MAIN ] WSO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:39:26.288484] [INFO ] [MAIN ] WS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:39:26.344424] [INFO ] [MAIN ] WSM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:39:26.376098] [DEBUG] [LOCAL ] WSR: Loaded 23492 existing records from primary storage. [2025-09-17T22:39:26.376382] [INFO ] [MAIN ] WSR: Loaded 23492 existing records. [2025-09-17T22:39:26.470432] [DEBUG] [LOCAL ] WSO: Loaded 24633 existing records from primary storage. [2025-09-17T22:39:26.481136] [INFO ] [MAIN ] WSO: Loaded 24633 existing records. [2025-09-17T22:39:26.611875] [DEBUG] [LOCAL ] WS: Loaded 23971 existing records from primary storage. [2025-09-17T22:39:26.662612] [INFO ] [MAIN ] WS: Loaded 23971 existing records. [2025-09-17T22:39:26.737030] [DEBUG] [LOCAL ] WSM: Loaded 50190 existing records from primary storage. [2025-09-17T22:39:26.809325] [INFO ] [MAIN ] WSM: Loaded 50190 existing records. [2025-09-17T22:39:26.836941] [WARN ] [MAIN ] WSR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:39:26.852211] [INFO ] [MAIN ] WSR: Wiping existing primary data before full refresh. [2025-09-17T22:39:26.996018] [INFO ] [LOCAL ] WSR: Starting deletion of primary data. [2025-09-17T22:39:26.957470] [WARN ] [MAIN ] WSO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:39:27.033347] [DEBUG] [LOCAL ] WSR: Deleted primary data file. [2025-09-17T22:39:27.090293] [INFO ] [MAIN ] WSO: Wiping existing primary data before full refresh. [2025-09-17T22:39:27.079843] [INFO ] [MAIN ] WSR: Starting full primary refresh. [2025-09-17T22:39:27.095638] [INFO ] [LOCAL ] WSO: Starting deletion of primary data. [2025-09-17T22:39:27.151827] [DEBUG] [LOCAL ] WSO: Deleted primary data file. [2025-09-17T22:39:27.188322] [INFO ] [MAIN ] WSO: Starting full primary refresh. [2025-09-17T22:39:27.356088] [WARN ] [MAIN ] WS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:39:27.345500] [WARN ] [MAIN ] WSM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:39:27.371139] [INFO ] [MAIN ] WS: Wiping existing primary data before full refresh. [2025-09-17T22:39:27.405622] [INFO ] [LOCAL ] WS: Starting deletion of primary data. [2025-09-17T22:39:27.439783] [DEBUG] [LOCAL ] WS: Deleted primary data file. [2025-09-17T22:39:27.455578] [INFO ] [MAIN ] WS: Starting full primary refresh. [2025-09-17T22:39:27.460857] [INFO ] [MAIN ] WSM: Wiping existing primary data before full refresh. [2025-09-17T22:39:27.509669] [INFO ] [LOCAL ] WSM: Starting deletion of primary data. [2025-09-17T22:39:27.607609] [DEBUG] [LOCAL ] WSM: Deleted primary data file. [2025-09-17T22:39:27.634503] [INFO ] [MAIN ] WSM: Starting full primary refresh. [2025-09-17T22:39:28.400343] [INFO ] [REMOTE ] WSO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:39:28.432261] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-11. [2025-09-17T22:39:28.495073] [INFO ] [REMOTE ] WSR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:39:28.524508] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-11. [2025-09-17T22:39:28.778153] [INFO ] [REMOTE ] WS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:39:28.781980] [INFO ] [REMOTE ] WSM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:39:28.782327] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-11. [2025-09-17T22:39:28.782556] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-11. [2025-09-17T22:39:29.940453] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T22:39:29.945045] [INFO ] [REMOTE ] WSO: Fetching primary data for 2024-12. [2025-09-17T22:39:29.990605] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-11 (1.21 seconds). [2025-09-17T22:39:29.995162] [INFO ] [REMOTE ] WS: Fetching primary data for 2024-12. [2025-09-17T22:39:30.083027] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T22:39:30.088433] [INFO ] [REMOTE ] WSR: Fetching primary data for 2024-12. [2025-09-17T22:39:31.061585] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-11 (2.28 seconds). [2025-09-17T22:39:31.071903] [INFO ] [REMOTE ] WSM: Fetching primary data for 2024-12. [2025-09-17T22:39:31.116614] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2024-12 (1.17 seconds). [2025-09-17T22:39:31.120768] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-01. [2025-09-17T22:39:31.222972] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2024-12 (1.13 seconds). [2025-09-17T22:39:31.228396] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-01. [2025-09-17T22:39:31.299552] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T22:39:31.305860] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-01. [2025-09-17T22:39:32.239140] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-01 (1.12 seconds). [2025-09-17T22:39:32.243707] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-02. [2025-09-17T22:39:32.330936] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T22:39:32.337886] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-02. [2025-09-17T22:39:32.337597] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-01 (1.11 seconds). [2025-09-17T22:39:32.343199] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-02. [2025-09-17T22:39:32.786857] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2024-12 (1.71 seconds). [2025-09-17T22:39:32.797630] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-01. [2025-09-17T22:39:33.093068] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-02 (0.76 seconds). [2025-09-17T22:39:33.098482] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-03. [2025-09-17T22:39:33.433018] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-02 (1.09 seconds). [2025-09-17T22:39:33.437521] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-03. [2025-09-17T22:39:33.531974] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-02 (1.29 seconds). [2025-09-17T22:39:34.015783] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-03. [2025-09-17T22:39:34.364470] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T22:39:34.431383] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-03 (1.33 seconds). [2025-09-17T22:39:34.634479] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-03 (1.20 seconds). [2025-09-17T22:39:34.815799] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-02. [2025-09-17T22:39:34.883048] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-03 (0.87 seconds). [2025-09-17T22:39:35.615827] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-04. [2025-09-17T22:39:36.415773] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-04. [2025-09-17T22:39:36.480286] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T22:39:36.537865] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-04 (0.92 seconds). [2025-09-17T22:39:37.215787] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-05. [2025-09-17T22:39:37.644728] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-04 (1.23 seconds). [2025-09-17T22:39:38.015776] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-03. [2025-09-17T22:39:38.286530] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-05 (1.07 seconds). [2025-09-17T22:39:38.816028] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-05. [2025-09-17T22:39:39.615848] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-04. [2025-09-17T22:39:40.072592] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-03 (2.06 seconds). [2025-09-17T22:39:40.101800] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-05 (1.29 seconds). [2025-09-17T22:39:40.415844] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-06. [2025-09-17T22:39:40.867875] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-04 (1.25 seconds). [2025-09-17T22:39:41.215779] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-05. [2025-09-17T22:39:41.436163] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-06 (1.02 seconds). [2025-09-17T22:39:42.015690] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-07. [2025-09-17T22:39:42.122435] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-05 (0.91 seconds). [2025-09-17T22:39:42.815746] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-06. [2025-09-17T22:39:42.906329] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-07 (0.89 seconds). [2025-09-17T22:39:43.615784] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-04. [2025-09-17T22:39:43.961782] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T22:39:44.415791] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-06. [2025-09-17T22:39:45.215835] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-07. [2025-09-17T22:39:45.524592] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T22:39:45.550243] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T22:39:46.018513] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-08. [2025-09-17T22:39:46.023043] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-07 (0.81 seconds). [2025-09-17T22:39:46.815775] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-07. [2025-09-17T22:39:47.076005] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-08 (1.06 seconds). [2025-09-17T22:39:47.615790] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-08. [2025-09-17T22:39:47.929935] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-07 (1.11 seconds). [2025-09-17T22:39:48.415695] [INFO ] [REMOTE ] WS: Fetching primary data for 2025-09. [2025-09-17T22:39:48.825483] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T22:39:49.215826] [INFO ] [REMOTE ] WSO: Fetching primary data for 2025-09. [2025-09-17T22:39:49.376142] [INFO ] [REMOTE ] WS: Incremental fetch complete for 2025-09 (0.96 seconds). [2025-09-17T22:39:49.379381] [INFO ] [REMOTE ] WS: Full fetch complete (36074 records). [2025-09-17T22:39:49.379476] [DEBUG] [VALIDATOR ] WS: Validating primary data. [2025-09-17T22:39:49.805531] [DEBUG] [VALIDATOR ] WS: All expected trading days are present. [2025-09-17T22:39:49.805625] [DEBUG] [VALIDATOR ] WS: Primary data validation passed. [2025-09-17T22:39:49.806528] [INFO ] [MAIN ] WS: Fetched primary data is valid. [2025-09-17T22:39:49.806615] [DEBUG] [LOCAL ] WS: Saving primary data. [2025-09-17T22:39:49.807557] [DEBUG] [LOCAL ] WS: Trimmed 36074 records to 23952 (keeping 200 days of data) [2025-09-17T22:39:49.974852] [DEBUG] [LOCAL ] WS: Primary data saved (23952 records). [2025-09-17T22:39:49.974996] [INFO ] [MAIN ] WS: Full history saved. [2025-09-17T22:39:49.975127] [INFO ] [MAIN ] Update Progress: 2321/2371 symbols completed. WS took 24.4s. Estimated remaining: 7m 19s. Rate: 6.8 symbols/min [2025-09-17T22:39:50.021064] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-08. [2025-09-17T22:39:50.151792] [INFO ] [MAIN ] WST: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:39:50.194330] [DEBUG] [LOCAL ] WST: Loaded 38122 existing records from primary storage. [2025-09-17T22:39:50.194485] [INFO ] [MAIN ] WST: Loaded 38122 existing records. [2025-09-17T22:39:50.374803] [WARN ] [MAIN ] WST: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:39:50.375052] [INFO ] [MAIN ] WST: Wiping existing primary data before full refresh. [2025-09-17T22:39:50.375099] [INFO ] [LOCAL ] WST: Starting deletion of primary data. [2025-09-17T22:39:50.376144] [DEBUG] [LOCAL ] WST: Deleted primary data file. [2025-09-17T22:39:50.376203] [INFO ] [MAIN ] WST: Starting full primary refresh. [2025-09-17T22:39:50.704879] [INFO ] [REMOTE ] WSO: Incremental fetch complete for 2025-09 (1.49 seconds). [2025-09-17T22:39:50.747980] [INFO ] [REMOTE ] WSO: Full fetch complete (33548 records). [2025-09-17T22:39:50.764596] [DEBUG] [VALIDATOR ] WSO: Validating primary data. [2025-09-17T22:39:50.770724] [INFO ] [REMOTE ] WST: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:39:50.818063] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-05. [2025-09-17T22:39:51.158176] [DEBUG] [VALIDATOR ] WSO: All expected trading days are present. [2025-09-17T22:39:51.158269] [DEBUG] [VALIDATOR ] WSO: Primary data validation passed. [2025-09-17T22:39:51.159049] [INFO ] [MAIN ] WSO: Fetched primary data is valid. [2025-09-17T22:39:51.159111] [DEBUG] [LOCAL ] WSO: Saving primary data. [2025-09-17T22:39:51.160002] [DEBUG] [LOCAL ] WSO: Trimmed 33548 records to 24680 (keeping 200 days of data) [2025-09-17T22:39:51.271321] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-08 (1.25 seconds). [2025-09-17T22:39:51.336844] [DEBUG] [LOCAL ] WSO: Primary data saved (24680 records). [2025-09-17T22:39:51.336998] [INFO ] [MAIN ] WSO: Full history saved. [2025-09-17T22:39:51.337094] [INFO ] [MAIN ] Update Progress: 2322/2371 symbols completed. WSO took 25.7s. Estimated remaining: 7m 10s. Rate: 6.8 symbols/min [2025-09-17T22:39:51.512025] [INFO ] [MAIN ] WT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:39:51.561226] [DEBUG] [LOCAL ] WT: Loaded 47538 existing records from primary storage. [2025-09-17T22:39:51.561375] [INFO ] [MAIN ] WT: Loaded 47538 existing records. [2025-09-17T22:39:51.625357] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-11. [2025-09-17T22:39:51.746244] [WARN ] [MAIN ] WT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:39:51.746512] [INFO ] [MAIN ] WT: Wiping existing primary data before full refresh. [2025-09-17T22:39:51.746559] [INFO ] [LOCAL ] WT: Starting deletion of primary data. [2025-09-17T22:39:51.747910] [DEBUG] [LOCAL ] WT: Deleted primary data file. [2025-09-17T22:39:51.747971] [INFO ] [MAIN ] WT: Starting full primary refresh. [2025-09-17T22:39:52.106525] [INFO ] [REMOTE ] WT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:39:52.415791] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-11. [2025-09-17T22:39:52.725696] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-05 (1.91 seconds). [2025-09-17T22:39:53.215813] [INFO ] [REMOTE ] WSR: Fetching primary data for 2025-09. [2025-09-17T22:39:53.443728] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-11 (1.82 seconds). [2025-09-17T22:39:54.016813] [INFO ] [REMOTE ] WST: Fetching primary data for 2024-12. [2025-09-17T22:39:54.022554] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T22:39:54.090747] [INFO ] [REMOTE ] WSR: Incremental fetch complete for 2025-09 (0.87 seconds). [2025-09-17T22:39:54.093728] [INFO ] [REMOTE ] WSR: Full fetch complete (32715 records). [2025-09-17T22:39:54.093856] [DEBUG] [VALIDATOR ] WSR: Validating primary data. [2025-09-17T22:39:54.490386] [DEBUG] [VALIDATOR ] WSR: All expected trading days are present. [2025-09-17T22:39:54.490464] [DEBUG] [VALIDATOR ] WSR: Primary data validation passed. [2025-09-17T22:39:54.491140] [INFO ] [MAIN ] WSR: Fetched primary data is valid. [2025-09-17T22:39:54.491203] [DEBUG] [LOCAL ] WSR: Saving primary data. [2025-09-17T22:39:54.491975] [DEBUG] [LOCAL ] WSR: Trimmed 32715 records to 23511 (keeping 200 days of data) [2025-09-17T22:39:54.635298] [DEBUG] [LOCAL ] WSR: Primary data saved (23511 records). [2025-09-17T22:39:54.635434] [INFO ] [MAIN ] WSR: Full history saved. [2025-09-17T22:39:54.635519] [INFO ] [MAIN ] Update Progress: 2323/2371 symbols completed. WSR took 29.0s. Estimated remaining: 7m 1s. Rate: 6.8 symbols/min [2025-09-17T22:39:54.811264] [INFO ] [MAIN ] WTI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:39:54.815822] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-06. [2025-09-17T22:39:54.854324] [DEBUG] [LOCAL ] WTI: Loaded 43681 existing records from primary storage. [2025-09-17T22:39:54.854471] [INFO ] [MAIN ] WTI: Loaded 43681 existing records. [2025-09-17T22:39:55.034365] [WARN ] [MAIN ] WTI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:39:55.034619] [INFO ] [MAIN ] WTI: Wiping existing primary data before full refresh. [2025-09-17T22:39:55.034696] [INFO ] [LOCAL ] WTI: Starting deletion of primary data. [2025-09-17T22:39:55.035617] [DEBUG] [LOCAL ] WTI: Deleted primary data file. [2025-09-17T22:39:55.035705] [INFO ] [MAIN ] WTI: Starting full primary refresh. [2025-09-17T22:39:55.426586] [INFO ] [REMOTE ] WTI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:39:55.444292] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2024-12 (1.43 seconds). [2025-09-17T22:39:55.615744] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-01. [2025-09-17T22:39:56.415811] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-11. [2025-09-17T22:39:56.604256] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T22:39:56.936385] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-01 (1.32 seconds). [2025-09-17T22:39:57.215786] [INFO ] [REMOTE ] WT: Fetching primary data for 2024-12. [2025-09-17T22:39:58.015815] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-02. [2025-09-17T22:39:58.138828] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-11 (1.72 seconds). [2025-09-17T22:39:58.815779] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-07. [2025-09-17T22:39:59.128257] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2024-12 (1.91 seconds). [2025-09-17T22:39:59.615805] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-01. [2025-09-17T22:39:59.757263] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T22:40:00.415796] [INFO ] [REMOTE ] WTI: Fetching primary data for 2024-12. [2025-09-17T22:40:00.541003] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T22:40:01.215789] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-08. [2025-09-17T22:40:01.404515] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-01 (1.79 seconds). [2025-09-17T22:40:02.015845] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-02. [2025-09-17T22:40:02.335595] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2024-12 (1.92 seconds). [2025-09-17T22:40:02.815833] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-03. [2025-09-17T22:40:02.950689] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T22:40:03.596273] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-02 (1.58 seconds). [2025-09-17T22:40:03.615735] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-03. [2025-09-17T22:40:04.415753] [INFO ] [REMOTE ] WSM: Fetching primary data for 2025-09. [2025-09-17T22:40:04.520236] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T22:40:05.093904] [INFO ] [REMOTE ] WSM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T22:40:05.100035] [INFO ] [REMOTE ] WSM: Full fetch complete (72328 records). [2025-09-17T22:40:05.100241] [DEBUG] [VALIDATOR ] WSM: Validating primary data. [2025-09-17T22:40:05.216767] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-04. [2025-09-17T22:40:05.530826] [DEBUG] [VALIDATOR ] WSM: All expected trading days are present. [2025-09-17T22:40:05.540955] [DEBUG] [VALIDATOR ] WSM: Primary data validation passed. [2025-09-17T22:40:05.559963] [INFO ] [MAIN ] WSM: Fetched primary data is valid. [2025-09-17T22:40:05.560183] [DEBUG] [LOCAL ] WSM: Saving primary data. [2025-09-17T22:40:05.562851] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-03 (1.95 seconds). [2025-09-17T22:40:05.573930] [DEBUG] [LOCAL ] WSM: Trimmed 72328 records to 50153 (keeping 200 days of data) [2025-09-17T22:40:05.890992] [DEBUG] [LOCAL ] WSM: Primary data saved (50153 records). [2025-09-17T22:40:05.891160] [INFO ] [MAIN ] WSM: Full history saved. [2025-09-17T22:40:05.891283] [INFO ] [MAIN ] Update Progress: 2324/2371 symbols completed. WSM took 40.3s. Estimated remaining: 6m 53s. Rate: 6.8 symbols/min [2025-09-17T22:40:06.020928] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-01. [2025-09-17T22:40:06.077388] [INFO ] [MAIN ] WTM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:40:06.077569] [DEBUG] [LOCAL ] WTM: No existing data file found in primary storage. [2025-09-17T22:40:06.077613] [WARN ] [MAIN ] WTM: No existing data found, performing full refresh instead. [2025-09-17T22:40:06.077811] [INFO ] [MAIN ] WTM: Wiping existing primary data before full refresh. [2025-09-17T22:40:06.077856] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-17T22:40:06.077900] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-17T22:40:06.077935] [INFO ] [MAIN ] WTM: Starting full primary refresh. [2025-09-17T22:40:06.454593] [INFO ] [REMOTE ] WTM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:40:06.815758] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-11. [2025-09-17T22:40:07.014870] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T22:40:07.461933] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-11 (0.65 seconds). [2025-09-17T22:40:07.615772] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-05. [2025-09-17T22:40:08.073238] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-01 (2.05 seconds). [2025-09-17T22:40:08.415722] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-02. [2025-09-17T22:40:09.215839] [INFO ] [REMOTE ] WTM: Fetching primary data for 2024-12. [2025-09-17T22:40:09.447373] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-05 (1.83 seconds). [2025-09-17T22:40:09.615492] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2024-12 (0.40 seconds). [2025-09-17T22:40:09.908526] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-02 (1.49 seconds). [2025-09-17T22:40:10.015775] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-03. [2025-09-17T22:40:10.815778] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-01. [2025-09-17T22:40:11.255599] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-01 (0.44 seconds). [2025-09-17T22:40:11.402783] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-03 (1.39 seconds). [2025-09-17T22:40:11.615795] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-02. [2025-09-17T22:40:12.025161] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-02 (0.41 seconds). [2025-09-17T22:40:12.415783] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-04. [2025-09-17T22:40:13.215792] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-06. [2025-09-17T22:40:14.015784] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-04. [2025-09-17T22:40:14.121448] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-04 (1.71 seconds). [2025-09-17T22:40:14.745290] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-06 (1.53 seconds). [2025-09-17T22:40:14.815793] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-05. [2025-09-17T22:40:15.438619] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T22:40:15.615781] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-05. [2025-09-17T22:40:16.415782] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-03. [2025-09-17T22:40:16.572706] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-05 (1.76 seconds). [2025-09-17T22:40:16.785377] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-03 (0.37 seconds). [2025-09-17T22:40:17.112833] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T22:40:17.215751] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-06. [2025-09-17T22:40:18.015795] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-06. [2025-09-17T22:40:18.815807] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-04. [2025-09-17T22:40:18.961556] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T22:40:19.364174] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-04 (0.55 seconds). [2025-09-17T22:40:19.615827] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-07. [2025-09-17T22:40:19.892956] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-06 (1.88 seconds). [2025-09-17T22:40:20.415809] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-07. [2025-09-17T22:40:20.780880] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-07 (1.17 seconds). [2025-09-17T22:40:21.215801] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-08. [2025-09-17T22:40:21.985318] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T22:40:22.015745] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-08. [2025-09-17T22:40:22.619758] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-08 (1.40 seconds). [2025-09-17T22:40:22.815836] [INFO ] [REMOTE ] WST: Fetching primary data for 2025-09. [2025-09-17T22:40:23.392429] [INFO ] [REMOTE ] WST: Incremental fetch complete for 2025-09 (0.58 seconds). [2025-09-17T22:40:23.397993] [INFO ] [REMOTE ] WST: Full fetch complete (53270 records). [2025-09-17T22:40:23.398307] [DEBUG] [VALIDATOR ] WST: Validating primary data. [2025-09-17T22:40:23.620980] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-05. [2025-09-17T22:40:23.755979] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-08 (1.74 seconds). [2025-09-17T22:40:23.871637] [DEBUG] [VALIDATOR ] WST: All expected trading days are present. [2025-09-17T22:40:23.871768] [DEBUG] [VALIDATOR ] WST: Primary data validation passed. [2025-09-17T22:40:23.873043] [INFO ] [MAIN ] WST: Fetched primary data is valid. [2025-09-17T22:40:23.873117] [DEBUG] [LOCAL ] WST: Saving primary data. [2025-09-17T22:40:23.874521] [DEBUG] [LOCAL ] WST: Trimmed 53270 records to 38034 (keeping 200 days of data) [2025-09-17T22:40:24.129283] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-05 (0.51 seconds). [2025-09-17T22:40:24.146916] [DEBUG] [LOCAL ] WST: Primary data saved (38034 records). [2025-09-17T22:40:24.147081] [INFO ] [MAIN ] WST: Full history saved. [2025-09-17T22:40:24.147987] [INFO ] [MAIN ] Update Progress: 2325/2371 symbols completed. WST took 34.2s. Estimated remaining: 6m 44s. Rate: 6.8 symbols/min [2025-09-17T22:40:24.331167] [INFO ] [MAIN ] WTRG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:40:24.395047] [DEBUG] [LOCAL ] WTRG: Loaded 50955 existing records from primary storage. [2025-09-17T22:40:24.395224] [INFO ] [MAIN ] WTRG: Loaded 50955 existing records. [2025-09-17T22:40:24.422617] [INFO ] [REMOTE ] WTI: Fetching primary data for 2025-09. [2025-09-17T22:40:24.587519] [WARN ] [MAIN ] WTRG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:40:24.587827] [INFO ] [MAIN ] WTRG: Wiping existing primary data before full refresh. [2025-09-17T22:40:24.587887] [INFO ] [LOCAL ] WTRG: Starting deletion of primary data. [2025-09-17T22:40:24.589099] [DEBUG] [LOCAL ] WTRG: Deleted primary data file. [2025-09-17T22:40:24.589160] [INFO ] [MAIN ] WTRG: Starting full primary refresh. [2025-09-17T22:40:25.026102] [INFO ] [REMOTE ] WTRG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:40:25.215795] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-06. [2025-09-17T22:40:25.762580] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-06 (0.55 seconds). [2025-09-17T22:40:26.015794] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-11. [2025-09-17T22:40:26.045551] [INFO ] [REMOTE ] WTI: Incremental fetch complete for 2025-09 (1.62 seconds). [2025-09-17T22:40:26.053449] [INFO ] [REMOTE ] WTI: Full fetch complete (63961 records). [2025-09-17T22:40:26.053614] [DEBUG] [VALIDATOR ] WTI: Validating primary data. [2025-09-17T22:40:26.487880] [DEBUG] [VALIDATOR ] WTI: All expected trading days are present. [2025-09-17T22:40:26.487995] [DEBUG] [VALIDATOR ] WTI: Primary data validation passed. [2025-09-17T22:40:26.489153] [INFO ] [MAIN ] WTI: Fetched primary data is valid. [2025-09-17T22:40:26.489226] [DEBUG] [LOCAL ] WTI: Saving primary data. [2025-09-17T22:40:26.491157] [DEBUG] [LOCAL ] WTI: Trimmed 63961 records to 43725 (keeping 200 days of data) [2025-09-17T22:40:26.757379] [DEBUG] [LOCAL ] WTI: Primary data saved (43725 records). [2025-09-17T22:40:26.757523] [INFO ] [MAIN ] WTI: Full history saved. [2025-09-17T22:40:26.757617] [INFO ] [MAIN ] Update Progress: 2326/2371 symbols completed. WTI took 32.1s. Estimated remaining: 6m 35s. Rate: 6.8 symbols/min [2025-09-17T22:40:26.827223] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-07. [2025-09-17T22:40:26.949734] [INFO ] [MAIN ] WTS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:40:26.971517] [DEBUG] [LOCAL ] WTS: Loaded 18759 existing records from primary storage. [2025-09-17T22:40:26.971727] [INFO ] [MAIN ] WTS: Loaded 18759 existing records. [2025-09-17T22:40:27.176774] [WARN ] [MAIN ] WTS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:40:27.177100] [INFO ] [MAIN ] WTS: Wiping existing primary data before full refresh. [2025-09-17T22:40:27.177157] [INFO ] [LOCAL ] WTS: Starting deletion of primary data. [2025-09-17T22:40:27.177769] [DEBUG] [LOCAL ] WTS: Deleted primary data file. [2025-09-17T22:40:27.177832] [INFO ] [MAIN ] WTS: Starting full primary refresh. [2025-09-17T22:40:27.407837] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-07 (0.58 seconds). [2025-09-17T22:40:27.558630] [INFO ] [REMOTE ] WTS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:40:27.615734] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-11. [2025-09-17T22:40:27.929216] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T22:40:28.415801] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-07. [2025-09-17T22:40:28.882578] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T22:40:29.215794] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2024-12. [2025-09-17T22:40:30.015829] [INFO ] [REMOTE ] WTS: Fetching primary data for 2024-12. [2025-09-17T22:40:30.380533] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-07 (1.96 seconds). [2025-09-17T22:40:30.815757] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-08. [2025-09-17T22:40:30.904088] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2024-12 (0.89 seconds). [2025-09-17T22:40:31.007412] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2024-12 (1.79 seconds). [2025-09-17T22:40:31.615873] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-01. [2025-09-17T22:40:32.415921] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-01. [2025-09-17T22:40:32.642487] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-01 (1.03 seconds). [2025-09-17T22:40:32.762494] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-08 (1.95 seconds). [2025-09-17T22:40:33.215798] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-08. [2025-09-17T22:40:33.746477] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-08 (0.53 seconds). [2025-09-17T22:40:34.015792] [INFO ] [REMOTE ] WT: Fetching primary data for 2025-09. [2025-09-17T22:40:34.106339] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-01 (1.69 seconds). [2025-09-17T22:40:34.815783] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-02. [2025-09-17T22:40:35.603689] [INFO ] [REMOTE ] WT: Incremental fetch complete for 2025-09 (1.59 seconds). [2025-09-17T22:40:35.610577] [INFO ] [REMOTE ] WT: Full fetch complete (68900 records). [2025-09-17T22:40:35.610763] [DEBUG] [VALIDATOR ] WT: Validating primary data. [2025-09-17T22:40:35.623519] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-02. [2025-09-17T22:40:36.021843] [DEBUG] [VALIDATOR ] WT: All expected trading days are present. [2025-09-17T22:40:36.021975] [DEBUG] [VALIDATOR ] WT: Primary data validation passed. [2025-09-17T22:40:36.023097] [INFO ] [MAIN ] WT: Fetched primary data is valid. [2025-09-17T22:40:36.023185] [DEBUG] [LOCAL ] WT: Saving primary data. [2025-09-17T22:40:36.024848] [DEBUG] [LOCAL ] WT: Trimmed 68900 records to 47526 (keeping 200 days of data) [2025-09-17T22:40:36.323669] [DEBUG] [LOCAL ] WT: Primary data saved (47526 records). [2025-09-17T22:40:36.323841] [INFO ] [MAIN ] WT: Full history saved. [2025-09-17T22:40:36.325930] [INFO ] [MAIN ] Update Progress: 2327/2371 symbols completed. WT took 45.0s. Estimated remaining: 6m 26s. Rate: 6.8 symbols/min [2025-09-17T22:40:36.423050] [INFO ] [REMOTE ] WTM: Fetching primary data for 2025-09. [2025-09-17T22:40:36.508298] [INFO ] [MAIN ] WTTR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:40:36.544849] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-02 (1.73 seconds). [2025-09-17T22:40:36.599841] [DEBUG] [LOCAL ] WTTR: Loaded 45096 existing records from primary storage. [2025-09-17T22:40:36.599996] [INFO ] [MAIN ] WTTR: Loaded 45096 existing records. [2025-09-17T22:40:36.778068] [WARN ] [MAIN ] WTTR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:40:36.778376] [INFO ] [MAIN ] WTTR: Wiping existing primary data before full refresh. [2025-09-17T22:40:36.778423] [INFO ] [LOCAL ] WTTR: Starting deletion of primary data. [2025-09-17T22:40:36.779412] [DEBUG] [LOCAL ] WTTR: Deleted primary data file. [2025-09-17T22:40:36.779472] [INFO ] [MAIN ] WTTR: Starting full primary refresh. [2025-09-17T22:40:37.032221] [INFO ] [REMOTE ] WTM: Incremental fetch complete for 2025-09 (0.61 seconds). [2025-09-17T22:40:37.063663] [INFO ] [REMOTE ] WTM: Full fetch complete (2119 records). [2025-09-17T22:40:37.074849] [DEBUG] [VALIDATOR ] WTM: Validating primary data. [2025-09-17T22:40:37.243493] [INFO ] [REMOTE ] WTTR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:40:37.216493] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-03. [2025-09-17T22:40:37.283596] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-02 (1.66 seconds). [2025-09-17T22:40:37.376210] [WARN ] [VALIDATOR ] WTM: Validation failed - insufficient historical data. Have 198 unique days, need 200 days [2025-09-17T22:40:37.376453] [FATAL] [MAIN ] WTM: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:40:37.376525] [WARN ] [MAIN ] WTM: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:40:37.376598] [INFO ] [LOCAL ] WTM: Starting deletion of primary data. [2025-09-17T22:40:37.376689] [DEBUG] [LOCAL ] WTM: No primary data file found to delete. [2025-09-17T22:40:37.376745] [INFO ] [LOCAL ] WTM: Starting deletion of derivative data. [2025-09-17T22:40:37.376816] [DEBUG] [LOCAL ] WTM: No derivative data file found to delete. [2025-09-17T22:40:37.376898] [INFO ] [MAIN ] Update Progress: 2328/2371 symbols completed. WTM took 31.5s. Estimated remaining: 6m 17s. Rate: 6.8 symbols/min [2025-09-17T22:40:37.556720] [INFO ] [MAIN ] WU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:40:37.608414] [DEBUG] [LOCAL ] WU: Loaded 53445 existing records from primary storage. [2025-09-17T22:40:37.608623] [INFO ] [MAIN ] WU: Loaded 53445 existing records. [2025-09-17T22:40:37.796541] [WARN ] [MAIN ] WU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:40:37.796894] [INFO ] [MAIN ] WU: Wiping existing primary data before full refresh. [2025-09-17T22:40:37.796956] [INFO ] [LOCAL ] WU: Starting deletion of primary data. [2025-09-17T22:40:37.798094] [DEBUG] [LOCAL ] WU: Deleted primary data file. [2025-09-17T22:40:37.798179] [INFO ] [MAIN ] WU: Starting full primary refresh. [2025-09-17T22:40:38.020878] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-11. [2025-09-17T22:40:38.164308] [INFO ] [REMOTE ] WU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:40:38.815797] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-03. [2025-09-17T22:40:39.100519] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-03 (1.88 seconds). [2025-09-17T22:40:39.272296] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-11 (1.25 seconds). [2025-09-17T22:40:39.615815] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2024-12. [2025-09-17T22:40:39.954856] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-03 (1.14 seconds). [2025-09-17T22:40:40.415830] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-04. [2025-09-17T22:40:41.215785] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-11. [2025-09-17T22:40:41.310341] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2024-12 (1.69 seconds). [2025-09-17T22:40:41.576460] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-04 (1.16 seconds). [2025-09-17T22:40:42.015808] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-04. [2025-09-17T22:40:42.815838] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-01. [2025-09-17T22:40:43.170727] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-11 (1.95 seconds). [2025-09-17T22:40:43.388965] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-04 (1.37 seconds). [2025-09-17T22:40:43.615806] [INFO ] [REMOTE ] WU: Fetching primary data for 2024-12. [2025-09-17T22:40:44.382190] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-01 (1.57 seconds). [2025-09-17T22:40:44.415791] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-02. [2025-09-17T22:40:45.150531] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T22:40:45.215781] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-05. [2025-09-17T22:40:46.015781] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-01. [2025-09-17T22:40:46.158906] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-02 (1.74 seconds). [2025-09-17T22:40:46.815778] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-05. [2025-09-17T22:40:46.902968] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T22:40:47.615835] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-06. [2025-09-17T22:40:47.859373] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-01 (1.84 seconds). [2025-09-17T22:40:47.945409] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-05 (1.13 seconds). [2025-09-17T22:40:48.415782] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-02. [2025-09-17T22:40:49.215786] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-03. [2025-09-17T22:40:49.370245] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-06 (1.75 seconds). [2025-09-17T22:40:50.017177] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-06. [2025-09-17T22:40:50.019967] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-02 (1.60 seconds). [2025-09-17T22:40:50.815584] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T22:40:50.815771] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-07. [2025-09-17T22:40:51.025773] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-06 (1.01 seconds). [2025-09-17T22:40:51.615778] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-03. [2025-09-17T22:40:52.415788] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-04. [2025-09-17T22:40:52.661340] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-07 (1.85 seconds). [2025-09-17T22:40:53.215818] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-07. [2025-09-17T22:40:53.642773] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-03 (2.03 seconds). [2025-09-17T22:40:54.015754] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-08. [2025-09-17T22:40:54.064527] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-04 (1.65 seconds). [2025-09-17T22:40:54.362794] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T22:40:54.815835] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-04. [2025-09-17T22:40:55.615826] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-08. [2025-09-17T22:40:55.807716] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-08 (1.79 seconds). [2025-09-17T22:40:56.244087] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-04 (1.43 seconds). [2025-09-17T22:40:56.370172] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-08 (0.75 seconds). [2025-09-17T22:40:56.415812] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-05. [2025-09-17T22:40:57.215804] [INFO ] [REMOTE ] WTRG: Fetching primary data for 2025-09. [2025-09-17T22:40:58.015784] [INFO ] [REMOTE ] WTS: Fetching primary data for 2025-09. [2025-09-17T22:40:58.127385] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T22:40:58.815757] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-06. [2025-09-17T22:40:58.874575] [INFO ] [REMOTE ] WTRG: Incremental fetch complete for 2025-09 (1.66 seconds). [2025-09-17T22:40:58.883770] [INFO ] [REMOTE ] WTRG: Full fetch complete (72986 records). [2025-09-17T22:40:58.884141] [DEBUG] [VALIDATOR ] WTRG: Validating primary data. [2025-09-17T22:40:59.003819] [INFO ] [REMOTE ] WTS: Incremental fetch complete for 2025-09 (0.99 seconds). [2025-09-17T22:40:59.033440] [INFO ] [REMOTE ] WTS: Full fetch complete (26395 records). [2025-09-17T22:40:59.047449] [DEBUG] [VALIDATOR ] WTS: Validating primary data. [2025-09-17T22:40:59.619013] [DEBUG] [VALIDATOR ] WTRG: All expected trading days are present. [2025-09-17T22:40:59.637999] [DEBUG] [VALIDATOR ] WTRG: Primary data validation passed. [2025-09-17T22:40:59.639348] [INFO ] [MAIN ] WTRG: Fetched primary data is valid. [2025-09-17T22:40:59.643497] [DEBUG] [LOCAL ] WTRG: Saving primary data. [2025-09-17T22:40:59.637897] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-05. [2025-09-17T22:40:59.709520] [DEBUG] [LOCAL ] WTRG: Trimmed 72986 records to 50962 (keeping 200 days of data) [2025-09-17T22:40:59.738734] [DEBUG] [VALIDATOR ] WTS: All expected trading days are present. [2025-09-17T22:40:59.738816] [DEBUG] [VALIDATOR ] WTS: Primary data validation passed. [2025-09-17T22:40:59.739100] [INFO ] [MAIN ] WTS: Fetched primary data is valid. [2025-09-17T22:40:59.739141] [DEBUG] [LOCAL ] WTS: Saving primary data. [2025-09-17T22:40:59.739917] [DEBUG] [LOCAL ] WTS: Trimmed 26395 records to 18753 (keeping 200 days of data) [2025-09-17T22:41:00.103775] [DEBUG] [LOCAL ] WTS: Primary data saved (18753 records). [2025-09-17T22:41:00.104461] [INFO ] [MAIN ] WTS: Full history saved. [2025-09-17T22:41:00.105090] [INFO ] [MAIN ] Update Progress: 2329/2371 symbols completed. WTS took 33.3s. Estimated remaining: 6m 9s. Rate: 6.8 symbols/min [2025-09-17T22:41:00.307260] [INFO ] [MAIN ] WWW: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:41:00.408513] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-06 (1.59 seconds). [2025-09-17T22:41:00.432111] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-07. [2025-09-17T22:41:00.443065] [DEBUG] [LOCAL ] WTRG: Primary data saved (50962 records). [2025-09-17T22:41:00.457549] [INFO ] [MAIN ] WTRG: Full history saved. [2025-09-17T22:41:00.460267] [INFO ] [MAIN ] Update Progress: 2330/2371 symbols completed. WTRG took 36.3s. Estimated remaining: 6m 0s. Rate: 6.8 symbols/min [2025-09-17T22:41:00.495310] [DEBUG] [LOCAL ] WWW: Loaded 49115 existing records from primary storage. [2025-09-17T22:41:00.535705] [INFO ] [MAIN ] WWW: Loaded 49115 existing records. [2025-09-17T22:41:00.797380] [INFO ] [MAIN ] WY: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:41:00.862412] [WARN ] [MAIN ] WWW: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:41:00.862733] [INFO ] [MAIN ] WWW: Wiping existing primary data before full refresh. [2025-09-17T22:41:00.862801] [INFO ] [LOCAL ] WWW: Starting deletion of primary data. [2025-09-17T22:41:00.863940] [DEBUG] [LOCAL ] WWW: Deleted primary data file. [2025-09-17T22:41:00.864007] [INFO ] [MAIN ] WWW: Starting full primary refresh. [2025-09-17T22:41:01.251567] [DEBUG] [LOCAL ] WY: Loaded 53109 existing records from primary storage. [2025-09-17T22:41:01.287234] [INFO ] [MAIN ] WY: Loaded 53109 existing records. [2025-09-17T22:41:01.350054] [INFO ] [REMOTE ] WWW: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:41:01.365432] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-11. [2025-09-17T22:41:01.547518] [WARN ] [MAIN ] WY: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:41:01.547889] [INFO ] [MAIN ] WY: Wiping existing primary data before full refresh. [2025-09-17T22:41:01.547955] [INFO ] [LOCAL ] WY: Starting deletion of primary data. [2025-09-17T22:41:01.549164] [DEBUG] [LOCAL ] WY: Deleted primary data file. [2025-09-17T22:41:01.549236] [INFO ] [MAIN ] WY: Starting full primary refresh. [2025-09-17T22:41:01.965918] [INFO ] [REMOTE ] WY: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:41:02.008509] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-05 (2.37 seconds). [2025-09-17T22:41:02.021051] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-11. [2025-09-17T22:41:02.077071] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-07 (1.64 seconds). [2025-09-17T22:41:02.815786] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-08. [2025-09-17T22:41:03.441000] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-11 (2.08 seconds). [2025-09-17T22:41:03.615825] [INFO ] [REMOTE ] WWW: Fetching primary data for 2024-12. [2025-09-17T22:41:03.696459] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-11 (1.68 seconds). [2025-09-17T22:41:03.932067] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-08 (1.12 seconds). [2025-09-17T22:41:04.415782] [INFO ] [REMOTE ] WTTR: Fetching primary data for 2025-09. [2025-09-17T22:41:05.220849] [INFO ] [REMOTE ] WY: Fetching primary data for 2024-12. [2025-09-17T22:41:05.240669] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2024-12 (1.62 seconds). [2025-09-17T22:41:05.930466] [INFO ] [REMOTE ] WTTR: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T22:41:05.937016] [INFO ] [REMOTE ] WTTR: Full fetch complete (65338 records). [2025-09-17T22:41:05.937177] [DEBUG] [VALIDATOR ] WTTR: Validating primary data. [2025-09-17T22:41:06.020867] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-06. [2025-09-17T22:41:06.341430] [DEBUG] [VALIDATOR ] WTTR: All expected trading days are present. [2025-09-17T22:41:06.341524] [DEBUG] [VALIDATOR ] WTTR: Primary data validation passed. [2025-09-17T22:41:06.342530] [INFO ] [MAIN ] WTTR: Fetched primary data is valid. [2025-09-17T22:41:06.342595] [DEBUG] [LOCAL ] WTTR: Saving primary data. [2025-09-17T22:41:06.343978] [DEBUG] [LOCAL ] WTTR: Trimmed 65338 records to 45093 (keeping 200 days of data) [2025-09-17T22:41:06.633678] [DEBUG] [LOCAL ] WTTR: Primary data saved (45093 records). [2025-09-17T22:41:06.633914] [INFO ] [MAIN ] WTTR: Full history saved. [2025-09-17T22:41:06.634758] [INFO ] [MAIN ] Update Progress: 2331/2371 symbols completed. WTTR took 30.3s. Estimated remaining: 5m 51s. Rate: 6.8 symbols/min [2025-09-17T22:41:06.822972] [INFO ] [MAIN ] XFLT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:41:06.819077] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-01. [2025-09-17T22:41:06.867985] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T22:41:06.903113] [DEBUG] [LOCAL ] XFLT: Loaded 29797 existing records from primary storage. [2025-09-17T22:41:06.903286] [INFO ] [MAIN ] XFLT: Loaded 29797 existing records. [2025-09-17T22:41:07.086775] [WARN ] [MAIN ] XFLT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:41:07.087053] [INFO ] [MAIN ] XFLT: Wiping existing primary data before full refresh. [2025-09-17T22:41:07.087101] [INFO ] [LOCAL ] XFLT: Starting deletion of primary data. [2025-09-17T22:41:07.087846] [DEBUG] [LOCAL ] XFLT: Deleted primary data file. [2025-09-17T22:41:07.087918] [INFO ] [MAIN ] XFLT: Starting full primary refresh. [2025-09-17T22:41:07.547583] [INFO ] [REMOTE ] XFLT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:41:07.615765] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-11. [2025-09-17T22:41:07.962065] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-06 (1.94 seconds). [2025-09-17T22:41:08.415873] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-01. [2025-09-17T22:41:08.558082] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-01 (1.74 seconds). [2025-09-17T22:41:08.934170] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-11 (1.32 seconds). [2025-09-17T22:41:09.215821] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-02. [2025-09-17T22:41:10.013192] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T22:41:10.023103] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-07. [2025-09-17T22:41:10.455849] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T22:41:10.815780] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2024-12. [2025-09-17T22:41:11.615749] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-03. [2025-09-17T22:41:12.024485] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-07 (2.00 seconds). [2025-09-17T22:41:12.346694] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T22:41:12.415780] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-01. [2025-09-17T22:41:12.983753] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-03 (1.37 seconds). [2025-09-17T22:41:13.215771] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-02. [2025-09-17T22:41:13.472998] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-01 (1.06 seconds). [2025-09-17T22:41:14.015819] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-04. [2025-09-17T22:41:14.815849] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-08. [2025-09-17T22:41:15.010341] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-02 (1.79 seconds). [2025-09-17T22:41:15.615794] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-03. [2025-09-17T22:41:15.774021] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T22:41:16.415834] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-02. [2025-09-17T22:41:16.790584] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-08 (1.97 seconds). [2025-09-17T22:41:17.215837] [INFO ] [REMOTE ] WU: Fetching primary data for 2025-09. [2025-09-17T22:41:17.333477] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-03 (1.72 seconds). [2025-09-17T22:41:17.532432] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-02 (1.12 seconds). [2025-09-17T22:41:18.015787] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-03. [2025-09-17T22:41:18.652258] [INFO ] [REMOTE ] WU: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T22:41:18.659484] [INFO ] [REMOTE ] WU: Full fetch complete (77150 records). [2025-09-17T22:41:18.659629] [DEBUG] [VALIDATOR ] WU: Validating primary data. [2025-09-17T22:41:18.838152] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-05. [2025-09-17T22:41:19.088712] [DEBUG] [VALIDATOR ] WU: All expected trading days are present. [2025-09-17T22:41:19.088811] [DEBUG] [VALIDATOR ] WU: Primary data validation passed. [2025-09-17T22:41:19.090112] [INFO ] [MAIN ] WU: Fetched primary data is valid. [2025-09-17T22:41:19.090182] [DEBUG] [LOCAL ] WU: Saving primary data. [2025-09-17T22:41:19.093381] [DEBUG] [LOCAL ] WU: Trimmed 77150 records to 53445 (keeping 200 days of data) [2025-09-17T22:41:19.453845] [DEBUG] [LOCAL ] WU: Primary data saved (53445 records). [2025-09-17T22:41:19.454197] [INFO ] [MAIN ] WU: Full history saved. [2025-09-17T22:41:19.454351] [INFO ] [MAIN ] Update Progress: 2332/2371 symbols completed. WU took 42.1s. Estimated remaining: 5m 42s. Rate: 6.8 symbols/min [2025-09-17T22:41:19.615901] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-03 (1.60 seconds). [2025-09-17T22:41:19.638915] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-04. [2025-09-17T22:41:19.675465] [INFO ] [MAIN ] XHR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:41:19.730073] [DEBUG] [LOCAL ] XHR: Loaded 44490 existing records from primary storage. [2025-09-17T22:41:19.730232] [INFO ] [MAIN ] XHR: Loaded 44490 existing records. [2025-09-17T22:41:19.923406] [WARN ] [MAIN ] XHR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:41:19.923714] [INFO ] [MAIN ] XHR: Wiping existing primary data before full refresh. [2025-09-17T22:41:19.923774] [INFO ] [LOCAL ] XHR: Starting deletion of primary data. [2025-09-17T22:41:19.924786] [DEBUG] [LOCAL ] XHR: Deleted primary data file. [2025-09-17T22:41:19.924856] [INFO ] [MAIN ] XHR: Starting full primary refresh. [2025-09-17T22:41:20.297232] [INFO ] [REMOTE ] XHR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:41:20.415776] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-11. [2025-09-17T22:41:20.763393] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-05 (1.93 seconds). [2025-09-17T22:41:21.196375] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T22:41:21.215730] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-05. [2025-09-17T22:41:21.470975] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-11 (1.06 seconds). [2025-09-17T22:41:22.015808] [INFO ] [REMOTE ] XHR: Fetching primary data for 2024-12. [2025-09-17T22:41:22.815799] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-04. [2025-09-17T22:41:22.989844] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T22:41:23.542559] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2024-12 (1.53 seconds). [2025-09-17T22:41:23.615838] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-01. [2025-09-17T22:41:24.259782] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-04 (1.44 seconds). [2025-09-17T22:41:24.415870] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-06. [2025-09-17T22:41:25.120339] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-01 (1.50 seconds). [2025-09-17T22:41:25.215794] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-06. [2025-09-17T22:41:26.015837] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-05. [2025-09-17T22:41:26.392161] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-06 (1.98 seconds). [2025-09-17T22:41:26.815781] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-02. [2025-09-17T22:41:26.929248] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-06 (1.71 seconds). [2025-09-17T22:41:26.977324] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-05 (0.96 seconds). [2025-09-17T22:41:27.615797] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-07. [2025-09-17T22:41:27.864725] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-02 (1.05 seconds). [2025-09-17T22:41:28.415790] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-03. [2025-09-17T22:41:29.215823] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-07. [2025-09-17T22:41:29.532332] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T22:41:30.015784] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-06. [2025-09-17T22:41:30.151854] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T22:41:30.756833] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T22:41:30.815747] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-08. [2025-09-17T22:41:30.860163] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-06 (0.84 seconds). [2025-09-17T22:41:31.615741] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-07. [2025-09-17T22:41:32.415822] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-04. [2025-09-17T22:41:32.612266] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-08 (1.80 seconds). [2025-09-17T22:41:33.031355] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-07 (1.42 seconds). [2025-09-17T22:41:33.215796] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-08. [2025-09-17T22:41:34.017847] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-08. [2025-09-17T22:41:34.021182] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-04 (1.61 seconds). [2025-09-17T22:41:34.544418] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-08 (1.33 seconds). [2025-09-17T22:41:34.815776] [INFO ] [REMOTE ] XFLT: Fetching primary data for 2025-09. [2025-09-17T22:41:35.608235] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T22:41:35.619289] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-05. [2025-09-17T22:41:36.048616] [INFO ] [REMOTE ] XFLT: Incremental fetch complete for 2025-09 (1.23 seconds). [2025-09-17T22:41:36.053479] [INFO ] [REMOTE ] XFLT: Full fetch complete (44553 records). [2025-09-17T22:41:36.053630] [DEBUG] [VALIDATOR ] XFLT: Validating primary data. [2025-09-17T22:41:36.429262] [INFO ] [REMOTE ] WWW: Fetching primary data for 2025-09. [2025-09-17T22:41:36.447029] [DEBUG] [VALIDATOR ] XFLT: All expected trading days are present. [2025-09-17T22:41:36.448145] [DEBUG] [VALIDATOR ] XFLT: Primary data validation passed. [2025-09-17T22:41:36.449167] [INFO ] [MAIN ] XFLT: Fetched primary data is valid. [2025-09-17T22:41:36.449367] [DEBUG] [LOCAL ] XFLT: Saving primary data. [2025-09-17T22:41:36.450625] [DEBUG] [LOCAL ] XFLT: Trimmed 44553 records to 29852 (keeping 200 days of data) [2025-09-17T22:41:36.634051] [DEBUG] [LOCAL ] XFLT: Primary data saved (29852 records). [2025-09-17T22:41:36.634244] [INFO ] [MAIN ] XFLT: Full history saved. [2025-09-17T22:41:36.634356] [INFO ] [MAIN ] Update Progress: 2333/2371 symbols completed. XFLT took 30.0s. Estimated remaining: 5m 34s. Rate: 6.8 symbols/min [2025-09-17T22:41:36.804630] [INFO ] [MAIN ] XIFR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:41:36.804834] [DEBUG] [LOCAL ] XIFR: No existing data file found in primary storage. [2025-09-17T22:41:36.804874] [WARN ] [MAIN ] XIFR: No existing data found, performing full refresh instead. [2025-09-17T22:41:36.805112] [INFO ] [MAIN ] XIFR: Wiping existing primary data before full refresh. [2025-09-17T22:41:36.805173] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-17T22:41:36.805221] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-17T22:41:36.805254] [INFO ] [MAIN ] XIFR: Starting full primary refresh. [2025-09-17T22:41:37.164827] [INFO ] [REMOTE ] XIFR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:41:37.215742] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-11. [2025-09-17T22:41:37.330735] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-05 (1.71 seconds). [2025-09-17T22:41:37.588808] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:41:37.589134] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-11 [2025-09-17T22:41:37.801202] [INFO ] [REMOTE ] WWW: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T22:41:37.807755] [INFO ] [REMOTE ] WWW: Full fetch complete (69574 records). [2025-09-17T22:41:37.807894] [DEBUG] [VALIDATOR ] WWW: Validating primary data. [2025-09-17T22:41:38.023629] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2024-12. [2025-09-17T22:41:38.201425] [DEBUG] [VALIDATOR ] WWW: All expected trading days are present. [2025-09-17T22:41:38.201508] [DEBUG] [VALIDATOR ] WWW: Primary data validation passed. [2025-09-17T22:41:38.202550] [INFO ] [MAIN ] WWW: Fetched primary data is valid. [2025-09-17T22:41:38.202616] [DEBUG] [LOCAL ] WWW: Saving primary data. [2025-09-17T22:41:38.203978] [DEBUG] [LOCAL ] WWW: Trimmed 69574 records to 49141 (keeping 200 days of data) [2025-09-17T22:41:38.323989] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:41:38.325051] [WARN ] [REMOTE ] XIFR: No data returned for month 2024-12 [2025-09-17T22:41:38.502732] [DEBUG] [LOCAL ] WWW: Primary data saved (49141 records). [2025-09-17T22:41:38.502924] [INFO ] [MAIN ] WWW: Full history saved. [2025-09-17T22:41:38.503061] [INFO ] [MAIN ] Update Progress: 2334/2371 symbols completed. WWW took 38.4s. Estimated remaining: 5m 25s. Rate: 6.8 symbols/min [2025-09-17T22:41:38.675154] [INFO ] [MAIN ] XOM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:41:38.738910] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-17T22:41:38.739121] [INFO ] [MAIN ] XOM: Loaded 53793 existing records. [2025-09-17T22:41:38.820921] [INFO ] [REMOTE ] WY: Fetching primary data for 2025-09. [2025-09-17T22:41:38.933186] [WARN ] [MAIN ] XOM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:41:38.933497] [INFO ] [MAIN ] XOM: Wiping existing primary data before full refresh. [2025-09-17T22:41:38.933546] [INFO ] [LOCAL ] XOM: Starting deletion of primary data. [2025-09-17T22:41:38.935215] [DEBUG] [LOCAL ] XOM: Deleted primary data file. [2025-09-17T22:41:38.935275] [INFO ] [MAIN ] XOM: Starting full primary refresh. [2025-09-17T22:41:39.303092] [INFO ] [REMOTE ] XOM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:41:39.564617] [INFO ] [REMOTE ] WY: Incremental fetch complete for 2025-09 (0.74 seconds). [2025-09-17T22:41:39.571785] [INFO ] [REMOTE ] WY: Full fetch complete (76624 records). [2025-09-17T22:41:39.571931] [DEBUG] [VALIDATOR ] WY: Validating primary data. [2025-09-17T22:41:39.620917] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-01. [2025-09-17T22:41:39.913532] [DEBUG] [REMOTE ] XIFR: Error fetching primary data for 2025-01: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:41:39.943310] [WARN ] [REMOTE ] XIFR: No data returned for month 2025-01 [2025-09-17T22:41:39.991812] [DEBUG] [VALIDATOR ] WY: All expected trading days are present. [2025-09-17T22:41:39.991898] [DEBUG] [VALIDATOR ] WY: Primary data validation passed. [2025-09-17T22:41:39.992990] [INFO ] [MAIN ] WY: Fetched primary data is valid. [2025-09-17T22:41:39.993055] [DEBUG] [LOCAL ] WY: Saving primary data. [2025-09-17T22:41:39.994600] [DEBUG] [LOCAL ] WY: Trimmed 76624 records to 53114 (keeping 200 days of data) [2025-09-17T22:41:40.358877] [DEBUG] [LOCAL ] WY: Primary data saved (53114 records). [2025-09-17T22:41:40.359084] [INFO ] [MAIN ] WY: Full history saved. [2025-09-17T22:41:40.359219] [INFO ] [MAIN ] Update Progress: 2335/2371 symbols completed. WY took 39.9s. Estimated remaining: 5m 16s. Rate: 6.8 symbols/min [2025-09-17T22:41:40.423384] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-06. [2025-09-17T22:41:40.546226] [INFO ] [MAIN ] XPER: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:41:40.583457] [DEBUG] [LOCAL ] XPER: Loaded 29576 existing records from primary storage. [2025-09-17T22:41:40.583619] [INFO ] [MAIN ] XPER: Loaded 29576 existing records. [2025-09-17T22:41:40.771661] [WARN ] [MAIN ] XPER: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:41:40.771941] [INFO ] [MAIN ] XPER: Wiping existing primary data before full refresh. [2025-09-17T22:41:40.772001] [INFO ] [LOCAL ] XPER: Starting deletion of primary data. [2025-09-17T22:41:40.772762] [DEBUG] [LOCAL ] XPER: Deleted primary data file. [2025-09-17T22:41:40.772823] [INFO ] [MAIN ] XPER: Starting full primary refresh. [2025-09-17T22:41:41.160069] [INFO ] [REMOTE ] XPER: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:41:41.215763] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-11. [2025-09-17T22:41:42.020911] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-11. [2025-09-17T22:41:42.038345] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-06 (1.61 seconds). [2025-09-17T22:41:42.689840] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-11 (1.47 seconds). [2025-09-17T22:41:42.815803] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-07. [2025-09-17T22:41:43.615822] [INFO ] [REMOTE ] XPER: Fetching primary data for 2024-12. [2025-09-17T22:41:44.420958] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-02. [2025-09-17T22:41:44.443207] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-11 (2.42 seconds). [2025-09-17T22:41:44.498995] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T22:41:44.540530] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2024-12 (0.92 seconds). [2025-09-17T22:41:45.215800] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-08. [2025-09-17T22:41:46.015800] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-01. [2025-09-17T22:41:46.194431] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-02 (1.77 seconds). [2025-09-17T22:41:46.815800] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-03. [2025-09-17T22:41:46.857434] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T22:41:47.235105] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T22:41:47.615789] [INFO ] [REMOTE ] XOM: Fetching primary data for 2024-12. [2025-09-17T22:41:48.415773] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-02. [2025-09-17T22:41:48.731406] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-03 (1.92 seconds). [2025-09-17T22:41:49.215721] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-04. [2025-09-17T22:41:49.573577] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-02 (1.16 seconds). [2025-09-17T22:41:50.024729] [INFO ] [REMOTE ] XHR: Fetching primary data for 2025-09. [2025-09-17T22:41:50.030370] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2024-12 (2.41 seconds). [2025-09-17T22:41:50.729808] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T22:41:50.815758] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-05. [2025-09-17T22:41:51.035907] [INFO ] [REMOTE ] XHR: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T22:41:51.041602] [INFO ] [REMOTE ] XHR: Full fetch complete (61367 records). [2025-09-17T22:41:51.041756] [DEBUG] [VALIDATOR ] XHR: Validating primary data. [2025-09-17T22:41:51.438208] [DEBUG] [VALIDATOR ] XHR: All expected trading days are present. [2025-09-17T22:41:51.438294] [DEBUG] [VALIDATOR ] XHR: Primary data validation passed. [2025-09-17T22:41:51.439452] [INFO ] [MAIN ] XHR: Fetched primary data is valid. [2025-09-17T22:41:51.439521] [DEBUG] [LOCAL ] XHR: Saving primary data. [2025-09-17T22:41:51.442413] [DEBUG] [LOCAL ] XHR: Trimmed 61367 records to 44461 (keeping 200 days of data) [2025-09-17T22:41:51.629264] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-03. [2025-09-17T22:41:51.740491] [DEBUG] [LOCAL ] XHR: Primary data saved (44461 records). [2025-09-17T22:41:51.740709] [INFO ] [MAIN ] XHR: Full history saved. [2025-09-17T22:41:51.740873] [INFO ] [MAIN ] Update Progress: 2336/2371 symbols completed. XHR took 32.3s. Estimated remaining: 5m 7s. Rate: 6.8 symbols/min [2025-09-17T22:41:51.924000] [INFO ] [MAIN ] XPEV: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:41:51.982239] [DEBUG] [LOCAL ] XPEV: Loaded 53647 existing records from primary storage. [2025-09-17T22:41:51.982423] [INFO ] [MAIN ] XPEV: Loaded 53647 existing records. [2025-09-17T22:41:52.164678] [WARN ] [MAIN ] XPEV: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:41:52.164945] [INFO ] [MAIN ] XPEV: Wiping existing primary data before full refresh. [2025-09-17T22:41:52.164993] [INFO ] [LOCAL ] XPEV: Starting deletion of primary data. [2025-09-17T22:41:52.166124] [DEBUG] [LOCAL ] XPEV: Deleted primary data file. [2025-09-17T22:41:52.166196] [INFO ] [MAIN ] XPEV: Starting full primary refresh. [2025-09-17T22:41:52.421121] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-01. [2025-09-17T22:41:52.539799] [INFO ] [REMOTE ] XPEV: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:41:52.565989] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T22:41:52.944813] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-03 (1.32 seconds). [2025-09-17T22:41:53.215789] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-06. [2025-09-17T22:41:54.015784] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-04. [2025-09-17T22:41:54.641971] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-01 (2.22 seconds). [2025-09-17T22:41:54.764043] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T22:41:54.815758] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-07. [2025-09-17T22:41:54.897958] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-04 (0.88 seconds). [2025-09-17T22:41:55.615818] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-02. [2025-09-17T22:41:56.415784] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-05. [2025-09-17T22:41:56.553673] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T22:41:57.215796] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-11. [2025-09-17T22:41:57.523726] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-05 (1.11 seconds). [2025-09-17T22:41:57.561950] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-02 (1.95 seconds). [2025-09-17T22:41:58.015795] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-03. [2025-09-17T22:41:58.815794] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-06. [2025-09-17T22:41:59.524402] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-11 (2.31 seconds). [2025-09-17T22:41:59.615805] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2024-12. [2025-09-17T22:41:59.964443] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T22:42:00.152030] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-03 (2.14 seconds). [2025-09-17T22:42:00.415789] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-04. [2025-09-17T22:42:01.215777] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-08. [2025-09-17T22:42:02.015789] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-07. [2025-09-17T22:42:02.343510] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2024-12 (2.73 seconds). [2025-09-17T22:42:02.815789] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-01. [2025-09-17T22:42:03.728001] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-04 (3.31 seconds). [2025-09-17T22:42:03.739432] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-05. [2025-09-17T22:42:04.322210] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-08 (3.11 seconds). [2025-09-17T22:42:04.415769] [INFO ] [REMOTE ] XIFR: Fetching primary data for 2025-09. [2025-09-17T22:42:04.687221] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-07 (2.67 seconds). [2025-09-17T22:42:04.860263] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-01 (2.04 seconds). [2025-09-17T22:42:05.215793] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-02. [2025-09-17T22:42:05.628381] [INFO ] [REMOTE ] XIFR: Incremental fetch complete for 2025-09 (1.21 seconds). [2025-09-17T22:42:05.634330] [INFO ] [REMOTE ] XIFR: Full fetch complete (52941 records). [2025-09-17T22:42:05.634501] [DEBUG] [VALIDATOR ] XIFR: Validating primary data. [2025-09-17T22:42:05.829182] [WARN ] [VALIDATOR ] XIFR: Validation failed - insufficient historical data. Have 157 unique days, need 200 days [2025-09-17T22:42:05.829781] [FATAL] [MAIN ] XIFR: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:42:05.829853] [WARN ] [MAIN ] XIFR: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:42:05.829946] [INFO ] [LOCAL ] XIFR: Starting deletion of primary data. [2025-09-17T22:42:05.830012] [DEBUG] [LOCAL ] XIFR: No primary data file found to delete. [2025-09-17T22:42:05.830048] [INFO ] [LOCAL ] XIFR: Starting deletion of derivative data. [2025-09-17T22:42:05.830110] [DEBUG] [LOCAL ] XIFR: No derivative data file found to delete. [2025-09-17T22:42:05.830191] [INFO ] [MAIN ] Update Progress: 2337/2371 symbols completed. XIFR took 29.2s. Estimated remaining: 4m 59s. Rate: 6.8 symbols/min [2025-09-17T22:42:06.001484] [INFO ] [MAIN ] XPO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:42:06.015812] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-08. [2025-09-17T22:42:06.059535] [DEBUG] [LOCAL ] XPO: Loaded 48336 existing records from primary storage. [2025-09-17T22:42:06.059716] [INFO ] [MAIN ] XPO: Loaded 48336 existing records. [2025-09-17T22:42:06.247682] [WARN ] [MAIN ] XPO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:42:06.247941] [INFO ] [MAIN ] XPO: Wiping existing primary data before full refresh. [2025-09-17T22:42:06.247997] [INFO ] [LOCAL ] XPO: Starting deletion of primary data. [2025-09-17T22:42:06.249141] [DEBUG] [LOCAL ] XPO: Deleted primary data file. [2025-09-17T22:42:06.249202] [INFO ] [MAIN ] XPO: Starting full primary refresh. [2025-09-17T22:42:06.618416] [INFO ] [REMOTE ] XPO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:42:06.648898] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-05 (2.91 seconds). [2025-09-17T22:42:06.815734] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-06. [2025-09-17T22:42:07.310381] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-08 (1.29 seconds). [2025-09-17T22:42:07.455406] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-02 (2.24 seconds). [2025-09-17T22:42:07.615746] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-11. [2025-09-17T22:42:08.415789] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-03. [2025-09-17T22:42:09.215797] [INFO ] [REMOTE ] XPER: Fetching primary data for 2025-09. [2025-09-17T22:42:09.388093] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-11 (1.77 seconds). [2025-09-17T22:42:09.472481] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-06 (2.66 seconds). [2025-09-17T22:42:10.015743] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-07. [2025-09-17T22:42:10.387952] [INFO ] [REMOTE ] XPER: Incremental fetch complete for 2025-09 (1.17 seconds). [2025-09-17T22:42:10.392299] [INFO ] [REMOTE ] XPER: Full fetch complete (43116 records). [2025-09-17T22:42:10.392386] [DEBUG] [VALIDATOR ] XPER: Validating primary data. [2025-09-17T22:42:10.787577] [DEBUG] [VALIDATOR ] XPER: All expected trading days are present. [2025-09-17T22:42:10.787713] [DEBUG] [VALIDATOR ] XPER: Primary data validation passed. [2025-09-17T22:42:10.788506] [INFO ] [MAIN ] XPER: Fetched primary data is valid. [2025-09-17T22:42:10.788585] [DEBUG] [LOCAL ] XPER: Saving primary data. [2025-09-17T22:42:10.789900] [DEBUG] [LOCAL ] XPER: Trimmed 43116 records to 29548 (keeping 200 days of data) [2025-09-17T22:42:10.834183] [INFO ] [REMOTE ] XPO: Fetching primary data for 2024-12. [2025-09-17T22:42:10.975841] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-03 (2.56 seconds). [2025-09-17T22:42:11.026742] [DEBUG] [LOCAL ] XPER: Primary data saved (29548 records). [2025-09-17T22:42:11.026926] [INFO ] [MAIN ] XPER: Full history saved. [2025-09-17T22:42:11.027025] [INFO ] [MAIN ] Update Progress: 2338/2371 symbols completed. XPER took 30.7s. Estimated remaining: 4m 50s. Rate: 6.8 symbols/min [2025-09-17T22:42:11.214510] [INFO ] [MAIN ] XPOF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:42:11.254839] [DEBUG] [LOCAL ] XPOF: Loaded 38918 existing records from primary storage. [2025-09-17T22:42:11.254997] [INFO ] [MAIN ] XPOF: Loaded 38918 existing records. [2025-09-17T22:42:11.439502] [WARN ] [MAIN ] XPOF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:42:11.439852] [INFO ] [MAIN ] XPOF: Wiping existing primary data before full refresh. [2025-09-17T22:42:11.439905] [INFO ] [LOCAL ] XPOF: Starting deletion of primary data. [2025-09-17T22:42:11.440861] [DEBUG] [LOCAL ] XPOF: Deleted primary data file. [2025-09-17T22:42:11.440921] [INFO ] [MAIN ] XPOF: Starting full primary refresh. [2025-09-17T22:42:11.630480] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-04. [2025-09-17T22:42:11.821028] [INFO ] [REMOTE ] XPOF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:42:12.415805] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-11. [2025-09-17T22:42:13.632396] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2024-12 (2.80 seconds). [2025-09-17T22:42:13.642627] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-01. [2025-09-17T22:42:14.249507] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-07 (4.23 seconds). [2025-09-17T22:42:14.261551] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-08. [2025-09-17T22:42:14.631800] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-11 (2.22 seconds). [2025-09-17T22:42:14.815789] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2024-12. [2025-09-17T22:42:15.513618] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T22:42:15.615764] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-04 (3.99 seconds). [2025-09-17T22:42:15.615831] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-02. [2025-09-17T22:42:16.110907] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2024-12 (1.30 seconds). [2025-09-17T22:42:16.250519] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-08 (1.99 seconds). [2025-09-17T22:42:16.415739] [INFO ] [REMOTE ] XOM: Fetching primary data for 2025-09. [2025-09-17T22:42:17.095386] [INFO ] [REMOTE ] XOM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T22:42:17.102217] [INFO ] [REMOTE ] XOM: Full fetch complete (77880 records). [2025-09-17T22:42:17.102342] [DEBUG] [VALIDATOR ] XOM: Validating primary data. [2025-09-17T22:42:17.220923] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-01. [2025-09-17T22:42:17.505307] [DEBUG] [VALIDATOR ] XOM: All expected trading days are present. [2025-09-17T22:42:17.505419] [DEBUG] [VALIDATOR ] XOM: Primary data validation passed. [2025-09-17T22:42:17.506552] [INFO ] [MAIN ] XOM: Fetched primary data is valid. [2025-09-17T22:42:17.506675] [DEBUG] [LOCAL ] XOM: Saving primary data. [2025-09-17T22:42:17.508325] [DEBUG] [LOCAL ] XOM: Trimmed 77880 records to 53793 (keeping 200 days of data) [2025-09-17T22:42:17.643708] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-02 (2.03 seconds). [2025-09-17T22:42:17.893786] [DEBUG] [LOCAL ] XOM: Primary data saved (53793 records). [2025-09-17T22:42:17.893937] [INFO ] [MAIN ] XOM: Full history saved. [2025-09-17T22:42:17.894022] [INFO ] [MAIN ] Update Progress: 2339/2371 symbols completed. XOM took 39.4s. Estimated remaining: 4m 41s. Rate: 6.8 symbols/min [2025-09-17T22:42:18.020928] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-03. [2025-09-17T22:42:18.073018] [INFO ] [MAIN ] XPRO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:42:18.073221] [DEBUG] [LOCAL ] XPRO: No existing data file found in primary storage. [2025-09-17T22:42:18.073264] [WARN ] [MAIN ] XPRO: No existing data found, performing full refresh instead. [2025-09-17T22:42:18.073453] [INFO ] [MAIN ] XPRO: Wiping existing primary data before full refresh. [2025-09-17T22:42:18.073562] [INFO ] [LOCAL ] XPRO: Starting deletion of primary data. [2025-09-17T22:42:18.073628] [DEBUG] [LOCAL ] XPRO: No primary data file found to delete. [2025-09-17T22:42:18.073707] [INFO ] [MAIN ] XPRO: Starting full primary refresh. [2025-09-17T22:42:18.448414] [INFO ] [REMOTE ] XPRO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:42:18.584304] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-01 (1.36 seconds). [2025-09-17T22:42:18.815832] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-02. [2025-09-17T22:42:19.615758] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-05. [2025-09-17T22:42:20.011686] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-03 (1.99 seconds). [2025-09-17T22:42:20.039838] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-02 (1.22 seconds). [2025-09-17T22:42:20.415778] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-04. [2025-09-17T22:42:21.215808] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-11. [2025-09-17T22:42:22.015975] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-03. [2025-09-17T22:42:22.653715] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-05 (3.04 seconds). [2025-09-17T22:42:22.745817] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-04 (2.33 seconds). [2025-09-17T22:42:22.820728] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-05. [2025-09-17T22:42:22.826151] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-11 (1.61 seconds). [2025-09-17T22:42:23.615760] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-06. [2025-09-17T22:42:23.646088] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T22:42:24.415821] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2024-12. [2025-09-17T22:42:24.572732] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-05 (1.75 seconds). [2025-09-17T22:42:25.215868] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-06. [2025-09-17T22:42:25.961218] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-06 (2.35 seconds). [2025-09-17T22:42:26.015798] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-07. [2025-09-17T22:42:26.065473] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2024-12 (1.65 seconds). [2025-09-17T22:42:26.815886] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-04. [2025-09-17T22:42:26.960090] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-06 (1.74 seconds). [2025-09-17T22:42:27.615823] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-07. [2025-09-17T22:42:28.327815] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T22:42:28.415892] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-01. [2025-09-17T22:42:28.514855] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-07 (2.50 seconds). [2025-09-17T22:42:29.215700] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-08. [2025-09-17T22:42:29.337383] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T22:42:29.927487] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-01 (1.51 seconds). [2025-09-17T22:42:30.015743] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-02. [2025-09-17T22:42:30.815790] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-08. [2025-09-17T22:42:31.511300] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-02 (1.50 seconds). [2025-09-17T22:42:31.615823] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-03. [2025-09-17T22:42:32.172068] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-08 (2.96 seconds). [2025-09-17T22:42:32.415757] [INFO ] [REMOTE ] XPEV: Fetching primary data for 2025-09. [2025-09-17T22:42:32.452872] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T22:42:33.215783] [INFO ] [REMOTE ] XPO: Fetching primary data for 2025-09. [2025-09-17T22:42:33.376208] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T22:42:34.015775] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-04. [2025-09-17T22:42:34.815801] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-05. [2025-09-17T22:42:34.909305] [INFO ] [REMOTE ] XPO: Incremental fetch complete for 2025-09 (1.69 seconds). [2025-09-17T22:42:34.917824] [INFO ] [REMOTE ] XPO: Full fetch complete (70152 records). [2025-09-17T22:42:34.917976] [DEBUG] [VALIDATOR ] XPO: Validating primary data. [2025-09-17T22:42:35.354706] [DEBUG] [VALIDATOR ] XPO: All expected trading days are present. [2025-09-17T22:42:35.354843] [DEBUG] [VALIDATOR ] XPO: Primary data validation passed. [2025-09-17T22:42:35.355932] [INFO ] [MAIN ] XPO: Fetched primary data is valid. [2025-09-17T22:42:35.356008] [DEBUG] [LOCAL ] XPO: Saving primary data. [2025-09-17T22:42:35.362415] [DEBUG] [LOCAL ] XPO: Trimmed 70152 records to 48354 (keeping 200 days of data) [2025-09-17T22:42:35.508699] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-04 (1.49 seconds). [2025-09-17T22:42:35.627404] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-05. [2025-09-17T22:42:35.722351] [DEBUG] [LOCAL ] XPO: Primary data saved (48354 records). [2025-09-17T22:42:35.722492] [INFO ] [MAIN ] XPO: Full history saved. [2025-09-17T22:42:35.723228] [INFO ] [MAIN ] Update Progress: 2340/2371 symbols completed. XPO took 29.9s. Estimated remaining: 4m 32s. Rate: 6.8 symbols/min [2025-09-17T22:42:35.919955] [INFO ] [REMOTE ] XPEV: Incremental fetch complete for 2025-09 (3.50 seconds). [2025-09-17T22:42:35.973868] [INFO ] [MAIN ] XYF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:42:35.974016] [INFO ] [REMOTE ] XPEV: Full fetch complete (77601 records). [2025-09-17T22:42:35.974328] [DEBUG] [VALIDATOR ] XPEV: Validating primary data. [2025-09-17T22:42:36.213764] [DEBUG] [LOCAL ] XYF: Loaded 27636 existing records from primary storage. [2025-09-17T22:42:36.267021] [INFO ] [MAIN ] XYF: Loaded 27636 existing records. [2025-09-17T22:42:36.625340] [DEBUG] [VALIDATOR ] XPEV: All expected trading days are present. [2025-09-17T22:42:36.631945] [WARN ] [MAIN ] XYF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:42:36.632084] [DEBUG] [VALIDATOR ] XPEV: Primary data validation passed. [2025-09-17T22:42:36.633525] [INFO ] [MAIN ] XPEV: Fetched primary data is valid. [2025-09-17T22:42:36.633699] [DEBUG] [LOCAL ] XPEV: Saving primary data. [2025-09-17T22:42:36.634422] [INFO ] [MAIN ] XYF: Wiping existing primary data before full refresh. [2025-09-17T22:42:36.634638] [INFO ] [LOCAL ] XYF: Starting deletion of primary data. [2025-09-17T22:42:36.649551] [DEBUG] [LOCAL ] XPEV: Trimmed 77601 records to 53645 (keeping 200 days of data) [2025-09-17T22:42:36.644211] [DEBUG] [LOCAL ] XYF: Deleted primary data file. [2025-09-17T22:42:36.661006] [INFO ] [MAIN ] XYF: Starting full primary refresh. [2025-09-17T22:42:36.662727] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-05 (1.85 seconds). [2025-09-17T22:42:36.829734] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-06. [2025-09-17T22:42:37.163214] [INFO ] [REMOTE ] XYF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:42:37.229570] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-11. [2025-09-17T22:42:37.324872] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-05 (1.70 seconds). [2025-09-17T22:42:37.444976] [DEBUG] [LOCAL ] XPEV: Primary data saved (53645 records). [2025-09-17T22:42:37.445199] [INFO ] [MAIN ] XPEV: Full history saved. [2025-09-17T22:42:37.445379] [INFO ] [MAIN ] Update Progress: 2341/2371 symbols completed. XPEV took 45.7s. Estimated remaining: 4m 23s. Rate: 6.8 symbols/min [2025-09-17T22:42:37.655865] [INFO ] [MAIN ] XYL: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:42:37.707467] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-11 (0.48 seconds). [2025-09-17T22:42:37.744720] [DEBUG] [LOCAL ] XYL: Loaded 48228 existing records from primary storage. [2025-09-17T22:42:37.744937] [INFO ] [MAIN ] XYL: Loaded 48228 existing records. [2025-09-17T22:42:37.934213] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-06 (1.10 seconds). [2025-09-17T22:42:38.020985] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-06. [2025-09-17T22:42:38.125461] [WARN ] [MAIN ] XYL: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:42:38.125844] [INFO ] [MAIN ] XYL: Wiping existing primary data before full refresh. [2025-09-17T22:42:38.125919] [INFO ] [LOCAL ] XYL: Starting deletion of primary data. [2025-09-17T22:42:38.127494] [DEBUG] [LOCAL ] XYL: Deleted primary data file. [2025-09-17T22:42:38.127579] [INFO ] [MAIN ] XYL: Starting full primary refresh. [2025-09-17T22:42:38.632316] [INFO ] [REMOTE ] XYL: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:42:38.815811] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-11. [2025-09-17T22:42:39.615795] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-07. [2025-09-17T22:42:39.805426] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-06 (1.78 seconds). [2025-09-17T22:42:40.415802] [INFO ] [REMOTE ] XYF: Fetching primary data for 2024-12. [2025-09-17T22:42:40.727205] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-11 (1.91 seconds). [2025-09-17T22:42:41.051309] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2024-12 (0.64 seconds). [2025-09-17T22:42:41.215713] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-01. [2025-09-17T22:42:41.395119] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-07 (1.78 seconds). [2025-09-17T22:42:41.927710] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-01 (0.71 seconds). [2025-09-17T22:42:42.015778] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-02. [2025-09-17T22:42:42.815800] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-07. [2025-09-17T22:42:42.872135] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-02 (0.86 seconds). [2025-09-17T22:42:43.615797] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-03. [2025-09-17T22:42:44.415753] [INFO ] [REMOTE ] XYL: Fetching primary data for 2024-12. [2025-09-17T22:42:44.542148] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T22:42:44.809889] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-03 (1.19 seconds). [2025-09-17T22:42:45.215787] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-04. [2025-09-17T22:42:46.015809] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-08. [2025-09-17T22:42:46.292234] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2024-12 (1.88 seconds). [2025-09-17T22:42:46.492121] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-04 (1.28 seconds). [2025-09-17T22:42:46.815838] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-05. [2025-09-17T22:42:47.283260] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-08 (1.27 seconds). [2025-09-17T22:42:47.615794] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-08. [2025-09-17T22:42:47.877419] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-05 (1.06 seconds). [2025-09-17T22:42:48.415812] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-06. [2025-09-17T22:42:49.170256] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T22:42:49.215753] [INFO ] [REMOTE ] XPRO: Fetching primary data for 2025-09. [2025-09-17T22:42:50.015809] [INFO ] [REMOTE ] XPOF: Fetching primary data for 2025-09. [2025-09-17T22:42:50.215261] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-06 (1.80 seconds). [2025-09-17T22:42:50.724399] [INFO ] [REMOTE ] XPRO: Incremental fetch complete for 2025-09 (1.51 seconds). [2025-09-17T22:42:50.730380] [INFO ] [REMOTE ] XPRO: Full fetch complete (66620 records). [2025-09-17T22:42:50.730490] [DEBUG] [VALIDATOR ] XPRO: Validating primary data. [2025-09-17T22:42:50.824350] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-01. [2025-09-17T22:42:51.142995] [DEBUG] [VALIDATOR ] XPRO: All expected trading days are present. [2025-09-17T22:42:51.143100] [DEBUG] [VALIDATOR ] XPRO: Primary data validation passed. [2025-09-17T22:42:51.144182] [INFO ] [MAIN ] XPRO: Fetched primary data is valid. [2025-09-17T22:42:51.144265] [DEBUG] [LOCAL ] XPRO: Saving primary data. [2025-09-17T22:42:51.145806] [DEBUG] [LOCAL ] XPRO: Trimmed 66620 records to 46239 (keeping 200 days of data) [2025-09-17T22:42:51.429440] [DEBUG] [LOCAL ] XPRO: Primary data saved (46239 records). [2025-09-17T22:42:51.429582] [INFO ] [MAIN ] XPRO: Full history saved. [2025-09-17T22:42:51.429682] [INFO ] [MAIN ] Update Progress: 2342/2371 symbols completed. XPRO took 33.5s. Estimated remaining: 4m 15s. Rate: 6.8 symbols/min [2025-09-17T22:42:51.607139] [INFO ] [MAIN ] XYZ: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:42:51.618437] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-07. [2025-09-17T22:42:51.616775] [DEBUG] [LOCAL ] XYZ: No existing data file found in primary storage. [2025-09-17T22:42:51.618603] [WARN ] [MAIN ] XYZ: No existing data found, performing full refresh instead. [2025-09-17T22:42:51.620483] [INFO ] [REMOTE ] XPOF: Incremental fetch complete for 2025-09 (1.60 seconds). [2025-09-17T22:42:51.620709] [INFO ] [MAIN ] XYZ: Wiping existing primary data before full refresh. [2025-09-17T22:42:51.625920] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-17T22:42:51.626062] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-17T22:42:51.626110] [INFO ] [MAIN ] XYZ: Starting full primary refresh. [2025-09-17T22:42:51.626211] [INFO ] [REMOTE ] XPOF: Full fetch complete (52056 records). [2025-09-17T22:42:51.650039] [DEBUG] [VALIDATOR ] XPOF: Validating primary data. [2025-09-17T22:42:52.425463] [INFO ] [REMOTE ] XYZ: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:42:52.464418] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-11. [2025-09-17T22:42:52.467236] [DEBUG] [VALIDATOR ] XPOF: All expected trading days are present. [2025-09-17T22:42:52.467542] [DEBUG] [VALIDATOR ] XPOF: Primary data validation passed. [2025-09-17T22:42:52.469227] [INFO ] [MAIN ] XPOF: Fetched primary data is valid. [2025-09-17T22:42:52.469406] [DEBUG] [LOCAL ] XPOF: Saving primary data. [2025-09-17T22:42:52.470746] [DEBUG] [LOCAL ] XPOF: Trimmed 52056 records to 38919 (keeping 200 days of data) [2025-09-17T22:42:52.708897] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-01 (1.88 seconds). [2025-09-17T22:42:52.723374] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-11: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:42:52.728153] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-11 [2025-09-17T22:42:52.745735] [DEBUG] [LOCAL ] XPOF: Primary data saved (38919 records). [2025-09-17T22:42:52.745908] [INFO ] [MAIN ] XPOF: Full history saved. [2025-09-17T22:42:52.746062] [INFO ] [MAIN ] Update Progress: 2343/2371 symbols completed. XPOF took 41.7s. Estimated remaining: 4m 6s. Rate: 6.8 symbols/min [2025-09-17T22:42:52.945049] [INFO ] [MAIN ] YALA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:42:52.983366] [DEBUG] [LOCAL ] YALA: Loaded 37282 existing records from primary storage. [2025-09-17T22:42:52.983548] [INFO ] [MAIN ] YALA: Loaded 37282 existing records. [2025-09-17T22:42:53.173450] [WARN ] [MAIN ] YALA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:42:53.173968] [INFO ] [MAIN ] YALA: Wiping existing primary data before full refresh. [2025-09-17T22:42:53.174296] [INFO ] [LOCAL ] YALA: Starting deletion of primary data. [2025-09-17T22:42:53.175524] [DEBUG] [LOCAL ] YALA: Deleted primary data file. [2025-09-17T22:42:53.175593] [INFO ] [MAIN ] YALA: Starting full primary refresh. [2025-09-17T22:42:53.219466] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-02. [2025-09-17T22:42:53.348600] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-07 (1.73 seconds). [2025-09-17T22:42:53.616413] [INFO ] [REMOTE ] YALA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:42:54.015772] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-11. [2025-09-17T22:42:54.815753] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-08. [2025-09-17T22:42:54.981585] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-02 (1.76 seconds). [2025-09-17T22:42:55.106703] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-11 (1.09 seconds). [2025-09-17T22:42:55.615807] [INFO ] [REMOTE ] YALA: Fetching primary data for 2024-12. [2025-09-17T22:42:56.415759] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-03. [2025-09-17T22:42:56.476052] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-08 (1.66 seconds). [2025-09-17T22:42:56.733597] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T22:42:57.215816] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2024-12. [2025-09-17T22:42:57.469699] [DEBUG] [REMOTE ] XYZ: Error fetching primary data for 2024-12: Invalid API call. Please retry or visit the documentation (https://www.alphavantage.co/documentation/) for TIME_SERIES_INTRADAY. [2025-09-17T22:42:57.470048] [WARN ] [REMOTE ] XYZ: No data returned for month 2024-12 [2025-09-17T22:42:58.015797] [INFO ] [REMOTE ] XYF: Fetching primary data for 2025-09. [2025-09-17T22:42:58.198405] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-03 (1.78 seconds). [2025-09-17T22:42:58.815784] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-01. [2025-09-17T22:42:59.239512] [INFO ] [REMOTE ] XYF: Incremental fetch complete for 2025-09 (1.22 seconds). [2025-09-17T22:42:59.242809] [INFO ] [REMOTE ] XYF: Full fetch complete (31024 records). [2025-09-17T22:42:59.242885] [DEBUG] [VALIDATOR ] XYF: Validating primary data. [2025-09-17T22:42:59.618685] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-04. [2025-09-17T22:42:59.627491] [DEBUG] [VALIDATOR ] XYF: All expected trading days are present. [2025-09-17T22:42:59.627548] [DEBUG] [VALIDATOR ] XYF: Primary data validation passed. [2025-09-17T22:42:59.628298] [INFO ] [MAIN ] XYF: Fetched primary data is valid. [2025-09-17T22:42:59.628363] [DEBUG] [LOCAL ] XYF: Saving primary data. [2025-09-17T22:42:59.629250] [DEBUG] [LOCAL ] XYF: Trimmed 31024 records to 27743 (keeping 200 days of data) [2025-09-17T22:42:59.805073] [DEBUG] [LOCAL ] XYF: Primary data saved (27743 records). [2025-09-17T22:42:59.805220] [INFO ] [MAIN ] XYF: Full history saved. [2025-09-17T22:42:59.805312] [INFO ] [MAIN ] Update Progress: 2344/2371 symbols completed. XYF took 24.1s. Estimated remaining: 3m 57s. Rate: 6.8 symbols/min [2025-09-17T22:42:59.994765] [INFO ] [MAIN ] YELP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:43:00.046057] [DEBUG] [LOCAL ] YELP: Loaded 45380 existing records from primary storage. [2025-09-17T22:43:00.046280] [INFO ] [MAIN ] YELP: Loaded 45380 existing records. [2025-09-17T22:43:00.234436] [WARN ] [MAIN ] YELP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:43:00.235350] [INFO ] [MAIN ] YELP: Wiping existing primary data before full refresh. [2025-09-17T22:43:00.235432] [INFO ] [LOCAL ] YELP: Starting deletion of primary data. [2025-09-17T22:43:00.251755] [DEBUG] [LOCAL ] YELP: Deleted primary data file. [2025-09-17T22:43:00.251667] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-01 (1.44 seconds). [2025-09-17T22:43:00.251938] [INFO ] [MAIN ] YELP: Starting full primary refresh. [2025-09-17T22:43:00.420552] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-02. [2025-09-17T22:43:00.630975] [INFO ] [REMOTE ] YELP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:43:01.215786] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-11. [2025-09-17T22:43:02.015793] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-01. [2025-09-17T22:43:02.216176] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-04 (2.60 seconds). [2025-09-17T22:43:02.324000] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-02 (1.90 seconds). [2025-09-17T22:43:02.815785] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-03. [2025-09-17T22:43:03.003546] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-11 (1.79 seconds). [2025-09-17T22:43:03.040595] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-01 (1.02 seconds). [2025-09-17T22:43:03.615790] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-05. [2025-09-17T22:43:04.415782] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-02. [2025-09-17T22:43:05.215180] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-03 (2.40 seconds). [2025-09-17T22:43:05.226004] [INFO ] [REMOTE ] YELP: Fetching primary data for 2024-12. [2025-09-17T22:43:05.395035] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-05 (1.78 seconds). [2025-09-17T22:43:05.526433] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-02 (1.11 seconds). [2025-09-17T22:43:06.015775] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-04. [2025-09-17T22:43:06.559934] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2024-12 (1.33 seconds). [2025-09-17T22:43:06.815777] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-01. [2025-09-17T22:43:07.615789] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-06. [2025-09-17T22:43:08.138128] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-04 (2.12 seconds). [2025-09-17T22:43:08.417468] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-03. [2025-09-17T22:43:08.419853] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-01 (1.60 seconds). [2025-09-17T22:43:08.989691] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T22:43:09.215779] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-02. [2025-09-17T22:43:09.845957] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T22:43:10.015769] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-05. [2025-09-17T22:43:10.626036] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-02 (1.41 seconds). [2025-09-17T22:43:10.815775] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-03. [2025-09-17T22:43:11.615813] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-07. [2025-09-17T22:43:12.404876] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-05 (2.39 seconds). [2025-09-17T22:43:12.416162] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-04. [2025-09-17T22:43:12.450466] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-03 (1.63 seconds). [2025-09-17T22:43:13.215759] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-04. [2025-09-17T22:43:13.265741] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-07 (1.65 seconds). [2025-09-17T22:43:14.015776] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-06. [2025-09-17T22:43:14.132573] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T22:43:14.815803] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-05. [2025-09-17T22:43:14.860276] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-04 (1.64 seconds). [2025-09-17T22:43:15.615784] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-08. [2025-09-17T22:43:16.359072] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-06 (2.34 seconds). [2025-09-17T22:43:16.415815] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-05. [2025-09-17T22:43:16.489273] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-05 (1.67 seconds). [2025-09-17T22:43:17.215768] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-06. [2025-09-17T22:43:17.313744] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-08 (1.70 seconds). [2025-09-17T22:43:17.986223] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T22:43:18.015731] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-06. [2025-09-17T22:43:18.765979] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-06 (1.55 seconds). [2025-09-17T22:43:18.815730] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-07. [2025-09-17T22:43:19.615831] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-07. [2025-09-17T22:43:19.648404] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T22:43:19.761297] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-07 (0.95 seconds). [2025-09-17T22:43:20.415823] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-07. [2025-09-17T22:43:21.215846] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-08. [2025-09-17T22:43:21.990187] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-07 (1.57 seconds). [2025-09-17T22:43:22.015729] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-08. [2025-09-17T22:43:22.073972] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-17T22:43:22.427186] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-08 (1.21 seconds). [2025-09-17T22:43:22.815832] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-08. [2025-09-17T22:43:23.564112] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-08 (1.55 seconds). [2025-09-17T22:43:23.615761] [INFO ] [REMOTE ] YELP: Fetching primary data for 2025-09. [2025-09-17T22:43:24.415843] [INFO ] [REMOTE ] YALA: Fetching primary data for 2025-09. [2025-09-17T22:43:24.866518] [INFO ] [REMOTE ] YELP: Incremental fetch complete for 2025-09 (1.25 seconds). [2025-09-17T22:43:24.872371] [INFO ] [REMOTE ] YELP: Full fetch complete (63982 records). [2025-09-17T22:43:24.872483] [DEBUG] [VALIDATOR ] YELP: Validating primary data. [2025-09-17T22:43:25.224437] [INFO ] [REMOTE ] XYL: Fetching primary data for 2025-09. [2025-09-17T22:43:25.282236] [DEBUG] [VALIDATOR ] YELP: All expected trading days are present. [2025-09-17T22:43:25.282351] [DEBUG] [VALIDATOR ] YELP: Primary data validation passed. [2025-09-17T22:43:25.283420] [INFO ] [MAIN ] YELP: Fetched primary data is valid. [2025-09-17T22:43:25.283485] [DEBUG] [LOCAL ] YELP: Saving primary data. [2025-09-17T22:43:25.284997] [DEBUG] [LOCAL ] YELP: Trimmed 63982 records to 45369 (keeping 200 days of data) [2025-09-17T22:43:25.404210] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-08 (2.59 seconds). [2025-09-17T22:43:25.603934] [INFO ] [REMOTE ] YALA: Incremental fetch complete for 2025-09 (1.19 seconds). [2025-09-17T22:43:25.611139] [DEBUG] [LOCAL ] YELP: Primary data saved (45369 records). [2025-09-17T22:43:25.611239] [INFO ] [MAIN ] YELP: Full history saved. [2025-09-17T22:43:25.612457] [INFO ] [MAIN ] Update Progress: 2345/2371 symbols completed. YELP took 25.8s. Estimated remaining: 3m 48s. Rate: 6.8 symbols/min [2025-09-17T22:43:25.612565] [INFO ] [REMOTE ] YALA: Full fetch complete (46579 records). [2025-09-17T22:43:25.612952] [DEBUG] [VALIDATOR ] YALA: Validating primary data. [2025-09-17T22:43:25.949697] [INFO ] [MAIN ] YETI: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:43:26.028946] [INFO ] [REMOTE ] XYZ: Fetching primary data for 2025-09. [2025-09-17T22:43:26.216321] [DEBUG] [VALIDATOR ] YALA: All expected trading days are present. [2025-09-17T22:43:26.230486] [DEBUG] [VALIDATOR ] YALA: Primary data validation passed. [2025-09-17T22:43:26.230323] [INFO ] [REMOTE ] XYL: Incremental fetch complete for 2025-09 (1.01 seconds). [2025-09-17T22:43:26.237726] [INFO ] [MAIN ] YALA: Fetched primary data is valid. [2025-09-17T22:43:26.238029] [DEBUG] [LOCAL ] YALA: Saving primary data. [2025-09-17T22:43:26.238431] [INFO ] [REMOTE ] XYL: Full fetch complete (69795 records). [2025-09-17T22:43:26.238881] [DEBUG] [VALIDATOR ] XYL: Validating primary data. [2025-09-17T22:43:26.239895] [DEBUG] [LOCAL ] YALA: Trimmed 46579 records to 37334 (keeping 200 days of data) [2025-09-17T22:43:26.445390] [DEBUG] [LOCAL ] YETI: Loaded 52519 existing records from primary storage. [2025-09-17T22:43:26.456575] [INFO ] [MAIN ] YETI: Loaded 52519 existing records. [2025-09-17T22:43:26.902291] [WARN ] [MAIN ] YETI: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:43:26.962548] [INFO ] [MAIN ] YETI: Wiping existing primary data before full refresh. [2025-09-17T22:43:26.966938] [DEBUG] [VALIDATOR ] XYL: All expected trading days are present. [2025-09-17T22:43:26.966102] [INFO ] [LOCAL ] YETI: Starting deletion of primary data. [2025-09-17T22:43:26.968178] [DEBUG] [VALIDATOR ] XYL: Primary data validation passed. [2025-09-17T22:43:26.970244] [INFO ] [MAIN ] XYL: Fetched primary data is valid. [2025-09-17T22:43:26.970469] [DEBUG] [LOCAL ] YETI: Deleted primary data file. [2025-09-17T22:43:26.971283] [INFO ] [MAIN ] YETI: Starting full primary refresh. [2025-09-17T22:43:26.971221] [DEBUG] [LOCAL ] XYL: Saving primary data. [2025-09-17T22:43:27.075855] [DEBUG] [LOCAL ] XYL: Trimmed 69795 records to 48208 (keeping 200 days of data) [2025-09-17T22:43:27.323472] [INFO ] [REMOTE ] XYZ: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T22:43:27.417130] [INFO ] [REMOTE ] XYZ: Full fetch complete (64667 records). [2025-09-17T22:43:27.491002] [DEBUG] [VALIDATOR ] XYZ: Validating primary data. [2025-09-17T22:43:27.881273] [INFO ] [REMOTE ] YETI: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:43:27.897187] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-11. [2025-09-17T22:43:27.991419] [WARN ] [VALIDATOR ] XYZ: Validation failed - insufficient historical data. Have 166 unique days, need 200 days [2025-09-17T22:43:27.995242] [FATAL] [MAIN ] XYZ: Fetched primary data is invalid. Refusing to save it. [2025-09-17T22:43:27.996422] [WARN ] [MAIN ] XYZ: Deleting existing primary and derivative data due to validation failure. [2025-09-17T22:43:27.997191] [INFO ] [LOCAL ] XYZ: Starting deletion of primary data. [2025-09-17T22:43:27.998376] [DEBUG] [LOCAL ] XYZ: No primary data file found to delete. [2025-09-17T22:43:27.999392] [INFO ] [LOCAL ] XYZ: Starting deletion of derivative data. [2025-09-17T22:43:28.001013] [DEBUG] [LOCAL ] XYZ: No derivative data file found to delete. [2025-09-17T22:43:28.002115] [INFO ] [MAIN ] Update Progress: 2346/2371 symbols completed. XYZ took 36.6s. Estimated remaining: 3m 40s. Rate: 6.8 symbols/min [2025-09-17T22:43:28.241540] [INFO ] [MAIN ] YEXT: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:43:28.285381] [DEBUG] [LOCAL ] YALA: Primary data saved (37334 records). [2025-09-17T22:43:28.288145] [INFO ] [MAIN ] YALA: Full history saved. [2025-09-17T22:43:28.288694] [INFO ] [MAIN ] Update Progress: 2347/2371 symbols completed. YALA took 35.5s. Estimated remaining: 3m 31s. Rate: 6.8 symbols/min [2025-09-17T22:43:28.382337] [DEBUG] [LOCAL ] XYL: Primary data saved (48208 records). [2025-09-17T22:43:28.383047] [DEBUG] [LOCAL ] YEXT: Loaded 43384 existing records from primary storage. [2025-09-17T22:43:28.393589] [INFO ] [MAIN ] XYL: Full history saved. [2025-09-17T22:43:28.399959] [INFO ] [MAIN ] YEXT: Loaded 43384 existing records. [2025-09-17T22:43:28.407770] [INFO ] [MAIN ] Update Progress: 2348/2371 symbols completed. XYL took 51.0s. Estimated remaining: 3m 22s. Rate: 6.8 symbols/min [2025-09-17T22:43:28.689695] [INFO ] [MAIN ] YMM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:43:28.873152] [WARN ] [MAIN ] YEXT: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:43:28.891143] [INFO ] [MAIN ] YEXT: Wiping existing primary data before full refresh. [2025-09-17T22:43:28.898202] [INFO ] [LOCAL ] YEXT: Starting deletion of primary data. [2025-09-17T22:43:28.909688] [DEBUG] [LOCAL ] YEXT: Deleted primary data file. [2025-09-17T22:43:28.910608] [INFO ] [MAIN ] YEXT: Starting full primary refresh. [2025-09-17T22:43:28.965010] [INFO ] [MAIN ] YOU: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:43:29.124460] [DEBUG] [LOCAL ] YMM: Loaded 52714 existing records from primary storage. [2025-09-17T22:43:29.133361] [INFO ] [MAIN ] YMM: Loaded 52714 existing records. [2025-09-17T22:43:29.548165] [WARN ] [MAIN ] YMM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:43:29.557671] [DEBUG] [LOCAL ] YOU: Loaded 49976 existing records from primary storage. [2025-09-17T22:43:29.574848] [INFO ] [MAIN ] YOU: Loaded 49976 existing records. [2025-09-17T22:43:29.578417] [INFO ] [MAIN ] YMM: Wiping existing primary data before full refresh. [2025-09-17T22:43:29.590774] [INFO ] [LOCAL ] YMM: Starting deletion of primary data. [2025-09-17T22:43:29.578250] [INFO ] [REMOTE ] YEXT: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:43:29.610467] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-11. [2025-09-17T22:43:29.628392] [DEBUG] [LOCAL ] YMM: Deleted primary data file. [2025-09-17T22:43:29.628696] [INFO ] [MAIN ] YMM: Starting full primary refresh. [2025-09-17T22:43:29.999296] [WARN ] [MAIN ] YOU: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:43:30.055635] [INFO ] [MAIN ] YOU: Wiping existing primary data before full refresh. [2025-09-17T22:43:30.069336] [INFO ] [LOCAL ] YOU: Starting deletion of primary data. [2025-09-17T22:43:30.078868] [DEBUG] [LOCAL ] YOU: Deleted primary data file. [2025-09-17T22:43:30.084109] [INFO ] [MAIN ] YOU: Starting full primary refresh. [2025-09-17T22:43:30.234745] [INFO ] [REMOTE ] YMM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:43:30.293717] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-11. [2025-09-17T22:43:30.321330] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-11 (2.42 seconds). [2025-09-17T22:43:30.370617] [INFO ] [REMOTE ] YETI: Fetching primary data for 2024-12. [2025-09-17T22:43:30.619438] [INFO ] [REMOTE ] YOU: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:43:30.619837] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-11. [2025-09-17T22:43:31.269407] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-11 (1.66 seconds). [2025-09-17T22:43:31.278816] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2024-12. [2025-09-17T22:43:32.072472] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-11 (1.78 seconds). [2025-09-17T22:43:32.083356] [INFO ] [REMOTE ] YMM: Fetching primary data for 2024-12. [2025-09-17T22:43:32.179469] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-11 (1.56 seconds). [2025-09-17T22:43:32.227383] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2024-12 (1.86 seconds). [2025-09-17T22:43:32.415778] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-01. [2025-09-17T22:43:32.949823] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2024-12 (1.67 seconds). [2025-09-17T22:43:33.215784] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-01. [2025-09-17T22:43:33.807845] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2024-12 (1.72 seconds). [2025-09-17T22:43:33.846364] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-01 (1.43 seconds). [2025-09-17T22:43:34.015779] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-02. [2025-09-17T22:43:34.823220] [INFO ] [REMOTE ] YOU: Fetching primary data for 2024-12. [2025-09-17T22:43:34.828811] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-01 (1.61 seconds). [2025-09-17T22:43:35.615779] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-01. [2025-09-17T22:43:35.661390] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-02 (1.65 seconds). [2025-09-17T22:43:36.415815] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-03. [2025-09-17T22:43:36.626557] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2024-12 (1.80 seconds). [2025-09-17T22:43:37.039961] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-01 (1.42 seconds). [2025-09-17T22:43:37.215776] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-02. [2025-09-17T22:43:38.015778] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-02. [2025-09-17T22:43:38.160166] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-03 (1.74 seconds). [2025-09-17T22:43:38.815786] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-04. [2025-09-17T22:43:39.014119] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-02 (1.80 seconds). [2025-09-17T22:43:39.438246] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-02 (1.42 seconds). [2025-09-17T22:43:39.615775] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-03. [2025-09-17T22:43:40.232859] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-04 (1.42 seconds). [2025-09-17T22:43:40.415785] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-05. [2025-09-17T22:43:40.952410] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-03 (1.34 seconds). [2025-09-17T22:43:41.215806] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-04. [2025-09-17T22:43:42.015790] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-03. [2025-09-17T22:43:42.190470] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-05 (1.77 seconds). [2025-09-17T22:43:42.776992] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-04 (1.56 seconds). [2025-09-17T22:43:42.815762] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-06. [2025-09-17T22:43:43.615791] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-01. [2025-09-17T22:43:43.991058] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-03 (1.98 seconds). [2025-09-17T22:43:44.415889] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-04. [2025-09-17T22:43:44.514384] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-06 (1.70 seconds). [2025-09-17T22:43:45.215807] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-07. [2025-09-17T22:43:45.349278] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-01 (1.73 seconds). [2025-09-17T22:43:46.015823] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-02. [2025-09-17T22:43:46.322522] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-04 (1.91 seconds). [2025-09-17T22:43:46.815808] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-05. [2025-09-17T22:43:47.107948] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-07 (1.89 seconds). [2025-09-17T22:43:47.393680] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-02 (1.38 seconds). [2025-09-17T22:43:47.615776] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-08. [2025-09-17T22:43:48.160707] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-05 (1.34 seconds). [2025-09-17T22:43:48.415783] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-05. [2025-09-17T22:43:49.215836] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-06. [2025-09-17T22:43:49.616785] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-08 (2.00 seconds). [2025-09-17T22:43:50.010849] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-05 (1.60 seconds). [2025-09-17T22:43:50.018800] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-03. [2025-09-17T22:43:50.815771] [INFO ] [REMOTE ] YETI: Fetching primary data for 2025-09. [2025-09-17T22:43:50.870553] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-06 (1.65 seconds). [2025-09-17T22:43:51.475037] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T22:43:51.615797] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-06. [2025-09-17T22:43:52.415795] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-07. [2025-09-17T22:43:52.463806] [INFO ] [REMOTE ] YETI: Incremental fetch complete for 2025-09 (1.65 seconds). [2025-09-17T22:43:52.470598] [INFO ] [REMOTE ] YETI: Full fetch complete (75256 records). [2025-09-17T22:43:52.470752] [DEBUG] [VALIDATOR ] YETI: Validating primary data. [2025-09-17T22:43:52.880755] [DEBUG] [VALIDATOR ] YETI: All expected trading days are present. [2025-09-17T22:43:52.881022] [DEBUG] [VALIDATOR ] YETI: Primary data validation passed. [2025-09-17T22:43:52.882259] [INFO ] [MAIN ] YETI: Fetched primary data is valid. [2025-09-17T22:43:52.882327] [DEBUG] [LOCAL ] YETI: Saving primary data. [2025-09-17T22:43:52.884107] [DEBUG] [LOCAL ] YETI: Trimmed 75256 records to 52527 (keeping 200 days of data) [2025-09-17T22:43:53.223298] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-04. [2025-09-17T22:43:53.250614] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-06 (1.63 seconds). [2025-09-17T22:43:53.255330] [DEBUG] [LOCAL ] YETI: Primary data saved (52527 records). [2025-09-17T22:43:53.265228] [INFO ] [MAIN ] YETI: Full history saved. [2025-09-17T22:43:53.266298] [INFO ] [MAIN ] Update Progress: 2349/2371 symbols completed. YETI took 27.7s. Estimated remaining: 3m 13s. Rate: 6.8 symbols/min [2025-09-17T22:43:53.441690] [INFO ] [MAIN ] YPF: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:43:53.494640] [DEBUG] [LOCAL ] YPF: Loaded 50473 existing records from primary storage. [2025-09-17T22:43:53.494833] [INFO ] [MAIN ] YPF: Loaded 50473 existing records. [2025-09-17T22:43:53.697595] [WARN ] [MAIN ] YPF: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:43:53.697932] [INFO ] [MAIN ] YPF: Wiping existing primary data before full refresh. [2025-09-17T22:43:53.698004] [INFO ] [LOCAL ] YPF: Starting deletion of primary data. [2025-09-17T22:43:53.699406] [DEBUG] [LOCAL ] YPF: Deleted primary data file. [2025-09-17T22:43:53.699501] [INFO ] [MAIN ] YPF: Starting full primary refresh. [2025-09-17T22:43:54.016738] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-07. [2025-09-17T22:43:54.101616] [INFO ] [REMOTE ] YPF: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:43:54.136075] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-07 (1.72 seconds). [2025-09-17T22:43:54.815774] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-08. [2025-09-17T22:43:55.025451] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-04 (1.80 seconds). [2025-09-17T22:43:55.615797] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-05. [2025-09-17T22:43:55.715428] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-07 (1.70 seconds). [2025-09-17T22:43:56.415778] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-11. [2025-09-17T22:43:56.836711] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-08 (2.02 seconds). [2025-09-17T22:43:57.215783] [INFO ] [REMOTE ] YMM: Fetching primary data for 2025-09. [2025-09-17T22:43:57.339666] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T22:43:58.015756] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-06. [2025-09-17T22:43:58.522166] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-11 (2.11 seconds). [2025-09-17T22:43:58.590449] [INFO ] [REMOTE ] YMM: Incremental fetch complete for 2025-09 (1.37 seconds). [2025-09-17T22:43:58.598712] [INFO ] [REMOTE ] YMM: Full fetch complete (76301 records). [2025-09-17T22:43:58.598847] [DEBUG] [VALIDATOR ] YMM: Validating primary data. [2025-09-17T22:43:58.820922] [INFO ] [REMOTE ] YPF: Fetching primary data for 2024-12. [2025-09-17T22:43:59.011599] [DEBUG] [VALIDATOR ] YMM: All expected trading days are present. [2025-09-17T22:43:59.011972] [DEBUG] [VALIDATOR ] YMM: Primary data validation passed. [2025-09-17T22:43:59.013240] [INFO ] [MAIN ] YMM: Fetched primary data is valid. [2025-09-17T22:43:59.013307] [DEBUG] [LOCAL ] YMM: Saving primary data. [2025-09-17T22:43:59.014993] [DEBUG] [LOCAL ] YMM: Trimmed 76301 records to 52713 (keeping 200 days of data) [2025-09-17T22:43:59.359020] [DEBUG] [LOCAL ] YMM: Primary data saved (52713 records). [2025-09-17T22:43:59.359162] [INFO ] [MAIN ] YMM: Full history saved. [2025-09-17T22:43:59.359249] [INFO ] [MAIN ] Update Progress: 2350/2371 symbols completed. YMM took 31.1s. Estimated remaining: 3m 4s. Rate: 6.8 symbols/min [2025-09-17T22:43:59.545751] [INFO ] [MAIN ] YRD: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:43:59.582417] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-06 (1.57 seconds). [2025-09-17T22:43:59.597846] [DEBUG] [LOCAL ] YRD: Loaded 12652 existing records from primary storage. [2025-09-17T22:43:59.598131] [INFO ] [MAIN ] YRD: Loaded 12652 existing records. [2025-09-17T22:43:59.629242] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-08. [2025-09-17T22:43:59.785054] [WARN ] [MAIN ] YRD: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:43:59.785319] [INFO ] [MAIN ] YRD: Wiping existing primary data before full refresh. [2025-09-17T22:43:59.785367] [INFO ] [LOCAL ] YRD: Starting deletion of primary data. [2025-09-17T22:43:59.785868] [DEBUG] [LOCAL ] YRD: Deleted primary data file. [2025-09-17T22:43:59.785928] [INFO ] [MAIN ] YRD: Starting full primary refresh. [2025-09-17T22:44:00.148952] [INFO ] [REMOTE ] YRD: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:44:00.415770] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-11. [2025-09-17T22:44:01.061260] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2024-12 (2.24 seconds). [2025-09-17T22:44:01.215796] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-01. [2025-09-17T22:44:01.327437] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-11 (0.91 seconds). [2025-09-17T22:44:01.356460] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-08 (1.73 seconds). [2025-09-17T22:44:02.015778] [INFO ] [REMOTE ] YRD: Fetching primary data for 2024-12. [2025-09-17T22:44:02.815770] [INFO ] [REMOTE ] YEXT: Fetching primary data for 2025-09. [2025-09-17T22:44:02.982876] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-01 (1.77 seconds). [2025-09-17T22:44:03.036358] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2024-12 (1.02 seconds). [2025-09-17T22:44:03.615801] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-02. [2025-09-17T22:44:04.234581] [INFO ] [REMOTE ] YEXT: Incremental fetch complete for 2025-09 (1.42 seconds). [2025-09-17T22:44:04.240451] [INFO ] [REMOTE ] YEXT: Full fetch complete (63291 records). [2025-09-17T22:44:04.240558] [DEBUG] [VALIDATOR ] YEXT: Validating primary data. [2025-09-17T22:44:04.428232] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-01. [2025-09-17T22:44:04.642462] [DEBUG] [VALIDATOR ] YEXT: All expected trading days are present. [2025-09-17T22:44:04.642563] [DEBUG] [VALIDATOR ] YEXT: Primary data validation passed. [2025-09-17T22:44:04.643597] [INFO ] [MAIN ] YEXT: Fetched primary data is valid. [2025-09-17T22:44:04.643716] [DEBUG] [LOCAL ] YEXT: Saving primary data. [2025-09-17T22:44:04.645383] [DEBUG] [LOCAL ] YEXT: Trimmed 63291 records to 43383 (keeping 200 days of data) [2025-09-17T22:44:04.894592] [DEBUG] [LOCAL ] YEXT: Primary data saved (43383 records). [2025-09-17T22:44:04.894753] [INFO ] [MAIN ] YEXT: Full history saved. [2025-09-17T22:44:04.894880] [INFO ] [MAIN ] Update Progress: 2351/2371 symbols completed. YEXT took 36.9s. Estimated remaining: 2m 56s. Rate: 6.8 symbols/min [2025-09-17T22:44:05.071133] [INFO ] [MAIN ] YSG: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:44:05.095851] [DEBUG] [LOCAL ] YSG: Loaded 24539 existing records from primary storage. [2025-09-17T22:44:05.095989] [INFO ] [MAIN ] YSG: Loaded 24539 existing records. [2025-09-17T22:44:05.228009] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-07. [2025-09-17T22:44:05.253088] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-02 (1.64 seconds). [2025-09-17T22:44:05.329946] [WARN ] [MAIN ] YSG: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:44:05.330228] [INFO ] [MAIN ] YSG: Wiping existing primary data before full refresh. [2025-09-17T22:44:05.330298] [INFO ] [LOCAL ] YSG: Starting deletion of primary data. [2025-09-17T22:44:05.331270] [DEBUG] [LOCAL ] YSG: Deleted primary data file. [2025-09-17T22:44:05.331344] [INFO ] [MAIN ] YSG: Starting full primary refresh. [2025-09-17T22:44:05.604766] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-01 (1.18 seconds). [2025-09-17T22:44:05.720141] [INFO ] [REMOTE ] YSG: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:44:06.015769] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-02. [2025-09-17T22:44:06.770536] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-02 (0.75 seconds). [2025-09-17T22:44:06.815750] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-11. [2025-09-17T22:44:06.990842] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-07 (1.76 seconds). [2025-09-17T22:44:07.615779] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-03. [2025-09-17T22:44:08.266421] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-11 (1.45 seconds). [2025-09-17T22:44:08.415762] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-03. [2025-09-17T22:44:09.215805] [INFO ] [REMOTE ] YSG: Fetching primary data for 2024-12. [2025-09-17T22:44:09.380013] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T22:44:09.546690] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T22:44:10.015787] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-04. [2025-09-17T22:44:10.540329] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2024-12 (1.32 seconds). [2025-09-17T22:44:10.815833] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-08. [2025-09-17T22:44:11.615790] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-04. [2025-09-17T22:44:11.908747] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-04 (1.89 seconds). [2025-09-17T22:44:12.415829] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-05. [2025-09-17T22:44:12.600358] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-04 (0.98 seconds). [2025-09-17T22:44:12.679943] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-08 (1.86 seconds). [2025-09-17T22:44:13.215811] [INFO ] [REMOTE ] YOU: Fetching primary data for 2025-09. [2025-09-17T22:44:14.015762] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-05. [2025-09-17T22:44:14.095801] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-05 (1.68 seconds). [2025-09-17T22:44:14.768991] [INFO ] [REMOTE ] YOU: Incremental fetch complete for 2025-09 (1.55 seconds). [2025-09-17T22:44:14.779292] [INFO ] [REMOTE ] YOU: Full fetch complete (72117 records). [2025-09-17T22:44:14.779443] [DEBUG] [VALIDATOR ] YOU: Validating primary data. [2025-09-17T22:44:14.820830] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-06. [2025-09-17T22:44:14.883197] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-05 (0.87 seconds). [2025-09-17T22:44:15.204451] [DEBUG] [VALIDATOR ] YOU: All expected trading days are present. [2025-09-17T22:44:15.204537] [DEBUG] [VALIDATOR ] YOU: Primary data validation passed. [2025-09-17T22:44:15.205606] [INFO ] [MAIN ] YOU: Fetched primary data is valid. [2025-09-17T22:44:15.205691] [DEBUG] [LOCAL ] YOU: Saving primary data. [2025-09-17T22:44:15.207179] [DEBUG] [LOCAL ] YOU: Trimmed 72117 records to 49955 (keeping 200 days of data) [2025-09-17T22:44:15.529864] [DEBUG] [LOCAL ] YOU: Primary data saved (49955 records). [2025-09-17T22:44:15.530003] [INFO ] [MAIN ] YOU: Full history saved. [2025-09-17T22:44:15.530267] [INFO ] [MAIN ] Update Progress: 2352/2371 symbols completed. YOU took 47.1s. Estimated remaining: 2m 47s. Rate: 6.8 symbols/min [2025-09-17T22:44:15.625374] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-06. [2025-09-17T22:44:15.707828] [INFO ] [MAIN ] YUM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:44:15.766154] [DEBUG] [LOCAL ] YUM: Loaded 51307 existing records from primary storage. [2025-09-17T22:44:15.766324] [INFO ] [MAIN ] YUM: Loaded 51307 existing records. [2025-09-17T22:44:15.944066] [WARN ] [MAIN ] YUM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:44:15.944350] [INFO ] [MAIN ] YUM: Wiping existing primary data before full refresh. [2025-09-17T22:44:15.944398] [INFO ] [LOCAL ] YUM: Starting deletion of primary data. [2025-09-17T22:44:15.945810] [DEBUG] [LOCAL ] YUM: Deleted primary data file. [2025-09-17T22:44:15.945874] [INFO ] [MAIN ] YUM: Starting full primary refresh. [2025-09-17T22:44:16.304836] [INFO ] [REMOTE ] YUM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:44:16.415742] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-11. [2025-09-17T22:44:16.484253] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-06 (0.86 seconds). [2025-09-17T22:44:16.581074] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-06 (1.76 seconds). [2025-09-17T22:44:17.215835] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-07. [2025-09-17T22:44:17.916859] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-11 (1.50 seconds). [2025-09-17T22:44:18.007788] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-07 (0.79 seconds). [2025-09-17T22:44:18.015674] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-08. [2025-09-17T22:44:18.815789] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-01. [2025-09-17T22:44:18.850666] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-08 (0.83 seconds). [2025-09-17T22:44:19.419591] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-01 (0.60 seconds). [2025-09-17T22:44:19.615772] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-02. [2025-09-17T22:44:20.409674] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-02 (0.79 seconds). [2025-09-17T22:44:20.415682] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-03. [2025-09-17T22:44:21.215795] [INFO ] [REMOTE ] YRD: Fetching primary data for 2025-09. [2025-09-17T22:44:21.550509] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-03 (1.13 seconds). [2025-09-17T22:44:21.946203] [INFO ] [REMOTE ] YRD: Incremental fetch complete for 2025-09 (0.73 seconds). [2025-09-17T22:44:21.949214] [INFO ] [REMOTE ] YRD: Full fetch complete (19487 records). [2025-09-17T22:44:21.949515] [DEBUG] [VALIDATOR ] YRD: Validating primary data. [2025-09-17T22:44:22.021011] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-04. [2025-09-17T22:44:22.345456] [DEBUG] [VALIDATOR ] YRD: All expected trading days are present. [2025-09-17T22:44:22.345566] [DEBUG] [VALIDATOR ] YRD: Primary data validation passed. [2025-09-17T22:44:22.346255] [INFO ] [MAIN ] YRD: Fetched primary data is valid. [2025-09-17T22:44:22.346325] [DEBUG] [LOCAL ] YRD: Saving primary data. [2025-09-17T22:44:22.347186] [DEBUG] [LOCAL ] YRD: Trimmed 19487 records to 12651 (keeping 200 days of data) [2025-09-17T22:44:22.425312] [DEBUG] [LOCAL ] YRD: Primary data saved (12651 records). [2025-09-17T22:44:22.425468] [INFO ] [MAIN ] YRD: Full history saved. [2025-09-17T22:44:22.425602] [INFO ] [MAIN ] Update Progress: 2353/2371 symbols completed. YRD took 23.1s. Estimated remaining: 2m 38s. Rate: 6.8 symbols/min [2025-09-17T22:44:22.615030] [INFO ] [MAIN ] YUMC: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:44:22.670347] [DEBUG] [LOCAL ] YUMC: Loaded 52731 existing records from primary storage. [2025-09-17T22:44:22.670507] [INFO ] [MAIN ] YUMC: Loaded 52731 existing records. [2025-09-17T22:44:22.820922] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-07. [2025-09-17T22:44:22.878959] [WARN ] [MAIN ] YUMC: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:44:22.879204] [INFO ] [MAIN ] YUMC: Wiping existing primary data before full refresh. [2025-09-17T22:44:22.879252] [INFO ] [LOCAL ] YUMC: Starting deletion of primary data. [2025-09-17T22:44:22.880377] [DEBUG] [LOCAL ] YUMC: Deleted primary data file. [2025-09-17T22:44:22.880438] [INFO ] [MAIN ] YUMC: Starting full primary refresh. [2025-09-17T22:44:23.236577] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-04 (1.22 seconds). [2025-09-17T22:44:23.301207] [INFO ] [REMOTE ] YUMC: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:44:23.615843] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-11. [2025-09-17T22:44:24.415926] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-05. [2025-09-17T22:44:24.736174] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-07 (1.92 seconds). [2025-09-17T22:44:24.901066] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-11 (1.29 seconds). [2025-09-17T22:44:25.215791] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2024-12. [2025-09-17T22:44:25.317708] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-05 (0.90 seconds). [2025-09-17T22:44:26.015774] [INFO ] [REMOTE ] YUM: Fetching primary data for 2024-12. [2025-09-17T22:44:26.815829] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-06. [2025-09-17T22:44:26.994353] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2024-12 (1.78 seconds). [2025-09-17T22:44:27.615800] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-01. [2025-09-17T22:44:27.788177] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2024-12 (1.77 seconds). [2025-09-17T22:44:28.265346] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-06 (1.45 seconds). [2025-09-17T22:44:28.415779] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-07. [2025-09-17T22:44:29.144745] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-01 (1.53 seconds). [2025-09-17T22:44:29.215788] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-02. [2025-09-17T22:44:29.871335] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-07 (1.46 seconds). [2025-09-17T22:44:30.015766] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-08. [2025-09-17T22:44:30.815709] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-08. [2025-09-17T22:44:31.026564] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-02 (1.81 seconds). [2025-09-17T22:44:31.297407] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-08 (1.28 seconds). [2025-09-17T22:44:31.615831] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-01. [2025-09-17T22:44:32.415792] [INFO ] [REMOTE ] YSG: Fetching primary data for 2025-09. [2025-09-17T22:44:32.447991] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-08 (1.63 seconds). [2025-09-17T22:44:33.215764] [INFO ] [REMOTE ] YPF: Fetching primary data for 2025-09. [2025-09-17T22:44:33.485944] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-01 (1.87 seconds). [2025-09-17T22:44:33.577177] [INFO ] [REMOTE ] YSG: Incremental fetch complete for 2025-09 (1.16 seconds). [2025-09-17T22:44:33.581176] [INFO ] [REMOTE ] YSG: Full fetch complete (32999 records). [2025-09-17T22:44:33.581313] [DEBUG] [VALIDATOR ] YSG: Validating primary data. [2025-09-17T22:44:34.016516] [DEBUG] [VALIDATOR ] YSG: All expected trading days are present. [2025-09-17T22:44:34.016198] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-02. [2025-09-17T22:44:34.016637] [DEBUG] [VALIDATOR ] YSG: Primary data validation passed. [2025-09-17T22:44:34.017708] [INFO ] [MAIN ] YSG: Fetched primary data is valid. [2025-09-17T22:44:34.018019] [DEBUG] [LOCAL ] YSG: Saving primary data. [2025-09-17T22:44:34.019796] [DEBUG] [LOCAL ] YSG: Trimmed 32999 records to 24658 (keeping 200 days of data) [2025-09-17T22:44:34.165531] [DEBUG] [LOCAL ] YSG: Primary data saved (24658 records). [2025-09-17T22:44:34.165701] [INFO ] [MAIN ] YSG: Full history saved. [2025-09-17T22:44:34.165809] [INFO ] [MAIN ] Update Progress: 2354/2371 symbols completed. YSG took 29.3s. Estimated remaining: 2m 29s. Rate: 6.8 symbols/min [2025-09-17T22:44:34.358497] [INFO ] [MAIN ] ZBH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:44:34.414294] [DEBUG] [LOCAL ] ZBH: Loaded 51201 existing records from primary storage. [2025-09-17T22:44:34.414469] [INFO ] [MAIN ] ZBH: Loaded 51201 existing records. [2025-09-17T22:44:34.601680] [WARN ] [MAIN ] ZBH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:44:34.601964] [INFO ] [MAIN ] ZBH: Wiping existing primary data before full refresh. [2025-09-17T22:44:34.602013] [INFO ] [LOCAL ] ZBH: Starting deletion of primary data. [2025-09-17T22:44:34.603183] [DEBUG] [LOCAL ] ZBH: Deleted primary data file. [2025-09-17T22:44:34.603244] [INFO ] [MAIN ] ZBH: Starting full primary refresh. [2025-09-17T22:44:34.817545] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-03. [2025-09-17T22:44:34.978153] [INFO ] [REMOTE ] ZBH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:44:34.990267] [INFO ] [REMOTE ] YPF: Incremental fetch complete for 2025-09 (1.77 seconds). [2025-09-17T22:44:34.996998] [INFO ] [REMOTE ] YPF: Full fetch complete (73357 records). [2025-09-17T22:44:34.997120] [DEBUG] [VALIDATOR ] YPF: Validating primary data. [2025-09-17T22:44:35.430674] [DEBUG] [VALIDATOR ] YPF: All expected trading days are present. [2025-09-17T22:44:35.430766] [DEBUG] [VALIDATOR ] YPF: Primary data validation passed. [2025-09-17T22:44:35.432407] [INFO ] [MAIN ] YPF: Fetched primary data is valid. [2025-09-17T22:44:35.432489] [DEBUG] [LOCAL ] YPF: Saving primary data. [2025-09-17T22:44:35.434033] [DEBUG] [LOCAL ] YPF: Trimmed 73357 records to 50452 (keeping 200 days of data) [2025-09-17T22:44:35.639339] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-11. [2025-09-17T22:44:35.766787] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-02 (1.75 seconds). [2025-09-17T22:44:35.779608] [DEBUG] [LOCAL ] YPF: Primary data saved (50452 records). [2025-09-17T22:44:35.780145] [INFO ] [MAIN ] YPF: Full history saved. [2025-09-17T22:44:35.781296] [INFO ] [MAIN ] Update Progress: 2355/2371 symbols completed. YPF took 42.5s. Estimated remaining: 2m 20s. Rate: 6.8 symbols/min [2025-09-17T22:44:35.954335] [INFO ] [MAIN ] ZEPP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:44:35.972665] [DEBUG] [LOCAL ] ZEPP: Loaded 15909 existing records from primary storage. [2025-09-17T22:44:35.972806] [INFO ] [MAIN ] ZEPP: Loaded 15909 existing records. [2025-09-17T22:44:36.160800] [WARN ] [MAIN ] ZEPP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:44:36.161368] [INFO ] [MAIN ] ZEPP: Wiping existing primary data before full refresh. [2025-09-17T22:44:36.161434] [INFO ] [LOCAL ] ZEPP: Starting deletion of primary data. [2025-09-17T22:44:36.161898] [DEBUG] [LOCAL ] ZEPP: Deleted primary data file. [2025-09-17T22:44:36.161955] [INFO ] [MAIN ] ZEPP: Starting full primary refresh. [2025-09-17T22:44:36.421010] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-03. [2025-09-17T22:44:36.525258] [INFO ] [REMOTE ] ZEPP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:44:36.689887] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-03 (1.87 seconds). [2025-09-17T22:44:37.215793] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-11. [2025-09-17T22:44:37.383580] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-11 (1.74 seconds). [2025-09-17T22:44:37.876123] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-11 (0.66 seconds). [2025-09-17T22:44:38.015765] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2024-12. [2025-09-17T22:44:38.119818] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T22:44:38.815819] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2024-12. [2025-09-17T22:44:39.285170] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2024-12 (0.47 seconds). [2025-09-17T22:44:39.615775] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-01. [2025-09-17T22:44:39.849919] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T22:44:40.263870] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-01 (0.65 seconds). [2025-09-17T22:44:40.415837] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-01. [2025-09-17T22:44:41.215792] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-04. [2025-09-17T22:44:42.015828] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-04. [2025-09-17T22:44:42.173181] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-01 (1.76 seconds). [2025-09-17T22:44:42.815798] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-02. [2025-09-17T22:44:43.164923] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-04 (1.95 seconds). [2025-09-17T22:44:43.615794] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-05. [2025-09-17T22:44:43.738198] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T22:44:44.415804] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-05. [2025-09-17T22:44:44.644445] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-02 (1.83 seconds). [2025-09-17T22:44:45.186883] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-05 (1.57 seconds). [2025-09-17T22:44:45.215741] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-06. [2025-09-17T22:44:46.015790] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-03. [2025-09-17T22:44:46.138210] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T22:44:46.815806] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-06. [2025-09-17T22:44:47.263786] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-06 (2.05 seconds). [2025-09-17T22:44:47.615787] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-07. [2025-09-17T22:44:48.091400] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-03 (2.08 seconds). [2025-09-17T22:44:48.415710] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-04. [2025-09-17T22:44:48.533264] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-06 (1.72 seconds). [2025-09-17T22:44:49.215704] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-07. [2025-09-17T22:44:49.473718] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-07 (1.86 seconds). [2025-09-17T22:44:50.015777] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-08. [2025-09-17T22:44:50.383853] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-04 (1.97 seconds). [2025-09-17T22:44:50.815787] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-05. [2025-09-17T22:44:51.242231] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-07 (2.03 seconds). [2025-09-17T22:44:51.615822] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-08. [2025-09-17T22:44:51.928921] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-08 (1.91 seconds). [2025-09-17T22:44:52.415786] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-02. [2025-09-17T22:44:52.533440] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-05 (1.72 seconds). [2025-09-17T22:44:52.737020] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-02 (0.32 seconds). [2025-09-17T22:44:53.048243] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-08 (1.43 seconds). [2025-09-17T22:44:53.215813] [INFO ] [REMOTE ] YUM: Fetching primary data for 2025-09. [2025-09-17T22:44:53.895554] [INFO ] [REMOTE ] YUM: Incremental fetch complete for 2025-09 (0.68 seconds). [2025-09-17T22:44:53.902169] [INFO ] [REMOTE ] YUM: Full fetch complete (74171 records). [2025-09-17T22:44:53.902312] [DEBUG] [VALIDATOR ] YUM: Validating primary data. [2025-09-17T22:44:54.020864] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-03. [2025-09-17T22:44:54.303459] [DEBUG] [VALIDATOR ] YUM: All expected trading days are present. [2025-09-17T22:44:54.303562] [DEBUG] [VALIDATOR ] YUM: Primary data validation passed. [2025-09-17T22:44:54.304886] [INFO ] [MAIN ] YUM: Fetched primary data is valid. [2025-09-17T22:44:54.304960] [DEBUG] [LOCAL ] YUM: Saving primary data. [2025-09-17T22:44:54.306586] [DEBUG] [LOCAL ] YUM: Trimmed 74171 records to 51314 (keeping 200 days of data) [2025-09-17T22:44:54.637046] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-03 (0.62 seconds). [2025-09-17T22:44:54.647754] [DEBUG] [LOCAL ] YUM: Primary data saved (51314 records). [2025-09-17T22:44:54.647841] [INFO ] [MAIN ] YUM: Full history saved. [2025-09-17T22:44:54.647936] [INFO ] [MAIN ] Update Progress: 2356/2371 symbols completed. YUM took 39.1s. Estimated remaining: 2m 12s. Rate: 6.8 symbols/min [2025-09-17T22:44:54.825928] [INFO ] [REMOTE ] YUMC: Fetching primary data for 2025-09. [2025-09-17T22:44:54.830685] [INFO ] [MAIN ] ZETA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:44:54.887367] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-17T22:44:54.887539] [INFO ] [MAIN ] ZETA: Loaded 53595 existing records. [2025-09-17T22:44:55.065680] [WARN ] [MAIN ] ZETA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:44:55.065998] [INFO ] [MAIN ] ZETA: Wiping existing primary data before full refresh. [2025-09-17T22:44:55.066074] [INFO ] [LOCAL ] ZETA: Starting deletion of primary data. [2025-09-17T22:44:55.067180] [DEBUG] [LOCAL ] ZETA: Deleted primary data file. [2025-09-17T22:44:55.067243] [INFO ] [MAIN ] ZETA: Starting full primary refresh. [2025-09-17T22:44:55.437376] [INFO ] [REMOTE ] ZETA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:44:55.615769] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-06. [2025-09-17T22:44:56.415768] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-04. [2025-09-17T22:44:56.468507] [INFO ] [REMOTE ] YUMC: Incremental fetch complete for 2025-09 (1.64 seconds). [2025-09-17T22:44:56.475598] [INFO ] [REMOTE ] YUMC: Full fetch complete (75935 records). [2025-09-17T22:44:56.475798] [DEBUG] [VALIDATOR ] YUMC: Validating primary data. [2025-09-17T22:44:56.884736] [DEBUG] [VALIDATOR ] YUMC: All expected trading days are present. [2025-09-17T22:44:56.884840] [DEBUG] [VALIDATOR ] YUMC: Primary data validation passed. [2025-09-17T22:44:56.886045] [INFO ] [MAIN ] YUMC: Fetched primary data is valid. [2025-09-17T22:44:56.886133] [DEBUG] [LOCAL ] YUMC: Saving primary data. [2025-09-17T22:44:56.887666] [DEBUG] [LOCAL ] YUMC: Trimmed 75935 records to 52730 (keeping 200 days of data) [2025-09-17T22:44:56.983102] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-04 (0.57 seconds). [2025-09-17T22:44:57.215969] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-05. [2025-09-17T22:44:57.225482] [DEBUG] [LOCAL ] YUMC: Primary data saved (52730 records). [2025-09-17T22:44:57.225583] [INFO ] [MAIN ] YUMC: Full history saved. [2025-09-17T22:44:57.225713] [INFO ] [MAIN ] Update Progress: 2357/2371 symbols completed. YUMC took 34.8s. Estimated remaining: 2m 3s. Rate: 6.8 symbols/min [2025-09-17T22:44:57.409856] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-06 (1.79 seconds). [2025-09-17T22:44:57.887939] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-05 (0.67 seconds). [2025-09-17T22:44:58.015754] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-06. [2025-09-17T22:44:58.749904] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-06 (0.73 seconds). [2025-09-17T22:44:58.815794] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-07. [2025-09-17T22:44:59.615807] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-07. [2025-09-17T22:45:00.351914] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-07 (1.54 seconds). [2025-09-17T22:45:00.415758] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-08. [2025-09-17T22:45:01.215794] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-11. [2025-09-17T22:45:01.558061] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-07 (1.94 seconds). [2025-09-17T22:45:02.015750] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-08. [2025-09-17T22:45:02.498721] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-08 (2.08 seconds). [2025-09-17T22:45:02.815793] [INFO ] [REMOTE ] ZEPP: Fetching primary data for 2025-09. [2025-09-17T22:45:05.041960] [INFO ] [REMOTE ] ZEPP: Incremental fetch complete for 2025-09 (2.23 seconds). [2025-09-17T22:45:05.046702] [INFO ] [REMOTE ] ZEPP: Full fetch complete (17316 records). [2025-09-17T22:45:05.046798] [DEBUG] [VALIDATOR ] ZEPP: Validating primary data. [2025-09-17T22:45:05.493478] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-11 (4.28 seconds). [2025-09-17T22:45:05.490045] [DEBUG] [VALIDATOR ] ZEPP: All expected trading days are present. [2025-09-17T22:45:05.494206] [DEBUG] [VALIDATOR ] ZEPP: Primary data validation passed. [2025-09-17T22:45:05.505986] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2024-12. [2025-09-17T22:45:05.506774] [INFO ] [MAIN ] ZEPP: Fetched primary data is valid. [2025-09-17T22:45:05.508090] [DEBUG] [LOCAL ] ZEPP: Saving primary data. [2025-09-17T22:45:05.509688] [DEBUG] [LOCAL ] ZEPP: Trimmed 17316 records to 16029 (keeping 200 days of data) [2025-09-17T22:45:05.617944] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-08 (3.60 seconds). [2025-09-17T22:45:05.635063] [INFO ] [REMOTE ] ZBH: Fetching primary data for 2025-09. [2025-09-17T22:45:05.655972] [DEBUG] [LOCAL ] ZEPP: Primary data saved (16029 records). [2025-09-17T22:45:05.656121] [INFO ] [MAIN ] ZEPP: Full history saved. [2025-09-17T22:45:05.656212] [INFO ] [MAIN ] Update Progress: 2358/2371 symbols completed. ZEPP took 29.9s. Estimated remaining: 1m 54s. Rate: 6.8 symbols/min [2025-09-17T22:45:06.298471] [INFO ] [REMOTE ] ZBH: Incremental fetch complete for 2025-09 (0.66 seconds). [2025-09-17T22:45:06.305059] [INFO ] [REMOTE ] ZBH: Full fetch complete (73528 records). [2025-09-17T22:45:06.305252] [DEBUG] [VALIDATOR ] ZBH: Validating primary data. [2025-09-17T22:45:06.711680] [DEBUG] [VALIDATOR ] ZBH: All expected trading days are present. [2025-09-17T22:45:06.711800] [DEBUG] [VALIDATOR ] ZBH: Primary data validation passed. [2025-09-17T22:45:06.712885] [INFO ] [MAIN ] ZBH: Fetched primary data is valid. [2025-09-17T22:45:06.712948] [DEBUG] [LOCAL ] ZBH: Saving primary data. [2025-09-17T22:45:06.714431] [DEBUG] [LOCAL ] ZBH: Trimmed 73528 records to 51212 (keeping 200 days of data) [2025-09-17T22:45:07.067438] [DEBUG] [LOCAL ] ZBH: Primary data saved (51212 records). [2025-09-17T22:45:07.067588] [INFO ] [MAIN ] ZBH: Full history saved. [2025-09-17T22:45:07.067701] [INFO ] [MAIN ] Update Progress: 2359/2371 symbols completed. ZBH took 32.9s. Estimated remaining: 1m 45s. Rate: 6.8 symbols/min [2025-09-17T22:45:08.181635] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2024-12 (2.68 seconds). [2025-09-17T22:45:08.193191] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-01. [2025-09-17T22:45:10.270595] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-01 (2.08 seconds). [2025-09-17T22:45:10.281719] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-02. [2025-09-17T22:45:13.635940] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-02 (3.35 seconds). [2025-09-17T22:45:13.646412] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-03. [2025-09-17T22:45:16.217228] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-03 (2.57 seconds). [2025-09-17T22:45:16.235519] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-04. [2025-09-17T22:45:18.384124] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-04 (2.15 seconds). [2025-09-17T22:45:18.395393] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-05. [2025-09-17T22:45:20.463045] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-05 (2.07 seconds). [2025-09-17T22:45:20.474578] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-06. [2025-09-17T22:45:22.871696] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-06 (2.40 seconds). [2025-09-17T22:45:22.883382] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-07. [2025-09-17T22:45:25.496261] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-07 (2.61 seconds). [2025-09-17T22:45:25.509041] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-08. [2025-09-17T22:45:28.072155] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-08 (2.56 seconds). [2025-09-17T22:45:28.084114] [INFO ] [REMOTE ] ZETA: Fetching primary data for 2025-09. [2025-09-17T22:45:30.291252] [INFO ] [REMOTE ] ZETA: Incremental fetch complete for 2025-09 (2.21 seconds). [2025-09-17T22:45:30.298423] [INFO ] [REMOTE ] ZETA: Full fetch complete (77640 records). [2025-09-17T22:45:30.298568] [DEBUG] [VALIDATOR ] ZETA: Validating primary data. [2025-09-17T22:45:30.707989] [DEBUG] [VALIDATOR ] ZETA: All expected trading days are present. [2025-09-17T22:45:30.708085] [DEBUG] [VALIDATOR ] ZETA: Primary data validation passed. [2025-09-17T22:45:30.709341] [INFO ] [MAIN ] ZETA: Fetched primary data is valid. [2025-09-17T22:45:30.709476] [DEBUG] [LOCAL ] ZETA: Saving primary data. [2025-09-17T22:45:30.711278] [DEBUG] [LOCAL ] ZETA: Trimmed 77640 records to 53595 (keeping 200 days of data) [2025-09-17T22:45:31.046824] [DEBUG] [LOCAL ] ZETA: Primary data saved (53595 records). [2025-09-17T22:45:31.046981] [INFO ] [MAIN ] ZETA: Full history saved. [2025-09-17T22:45:31.047069] [INFO ] [MAIN ] Update Progress: 2360/2371 symbols completed. ZETA took 36.4s. Estimated remaining: 1m 37s. Rate: 6.8 symbols/min [2025-09-17T22:45:31.754453] [INFO ] [MAIN ] ZH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:45:31.791411] [INFO ] [MAIN ] ZGN: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:45:31.817404] [INFO ] [MAIN ] ZIM: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:45:31.796084] [INFO ] [MAIN ] ZIP: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:45:31.871948] [DEBUG] [LOCAL ] ZH: Loaded 27365 existing records from primary storage. [2025-09-17T22:45:31.872296] [INFO ] [MAIN ] ZH: Loaded 27365 existing records. [2025-09-17T22:45:32.040633] [DEBUG] [LOCAL ] ZIP: Loaded 44671 existing records from primary storage. [2025-09-17T22:45:32.040907] [INFO ] [MAIN ] ZIP: Loaded 44671 existing records. [2025-09-17T22:45:32.043076] [DEBUG] [LOCAL ] ZGN: Loaded 40934 existing records from primary storage. [2025-09-17T22:45:32.053663] [INFO ] [MAIN ] ZGN: Loaded 40934 existing records. [2025-09-17T22:45:32.175295] [DEBUG] [LOCAL ] ZIM: Loaded 53554 existing records from primary storage. [2025-09-17T22:45:32.235988] [INFO ] [MAIN ] ZIM: Loaded 53554 existing records. [2025-09-17T22:45:32.375790] [WARN ] [MAIN ] ZH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:45:32.434123] [INFO ] [MAIN ] ZH: Wiping existing primary data before full refresh. [2025-09-17T22:45:32.460155] [INFO ] [LOCAL ] ZH: Starting deletion of primary data. [2025-09-17T22:45:32.636765] [DEBUG] [LOCAL ] ZH: Deleted primary data file. [2025-09-17T22:45:32.647869] [WARN ] [MAIN ] ZIP: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:45:32.648115] [INFO ] [MAIN ] ZH: Starting full primary refresh. [2025-09-17T22:45:32.648277] [WARN ] [MAIN ] ZGN: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:45:32.659893] [INFO ] [MAIN ] ZGN: Wiping existing primary data before full refresh. [2025-09-17T22:45:32.679158] [INFO ] [LOCAL ] ZGN: Starting deletion of primary data. [2025-09-17T22:45:32.689732] [INFO ] [MAIN ] ZIP: Wiping existing primary data before full refresh. [2025-09-17T22:45:32.695427] [DEBUG] [LOCAL ] ZGN: Deleted primary data file. [2025-09-17T22:45:32.710256] [INFO ] [LOCAL ] ZIP: Starting deletion of primary data. [2025-09-17T22:45:32.740266] [INFO ] [MAIN ] ZGN: Starting full primary refresh. [2025-09-17T22:45:32.797695] [DEBUG] [LOCAL ] ZIP: Deleted primary data file. [2025-09-17T22:45:32.901021] [INFO ] [MAIN ] ZIP: Starting full primary refresh. [2025-09-17T22:45:32.889121] [WARN ] [MAIN ] ZIM: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:45:33.044279] [INFO ] [MAIN ] ZIM: Wiping existing primary data before full refresh. [2025-09-17T22:45:33.104540] [INFO ] [LOCAL ] ZIM: Starting deletion of primary data. [2025-09-17T22:45:33.151912] [DEBUG] [LOCAL ] ZIM: Deleted primary data file. [2025-09-17T22:45:33.166873] [INFO ] [MAIN ] ZIM: Starting full primary refresh. [2025-09-17T22:45:33.877516] [INFO ] [REMOTE ] ZH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:45:33.941981] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-11. [2025-09-17T22:45:34.066030] [INFO ] [REMOTE ] ZGN: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:45:34.108678] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-11. [2025-09-17T22:45:34.211620] [INFO ] [REMOTE ] ZIP: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:45:34.228883] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-11. [2025-09-17T22:45:34.321848] [INFO ] [REMOTE ] ZIM: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:45:34.322193] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-11. [2025-09-17T22:45:35.349248] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-11 (1.41 seconds). [2025-09-17T22:45:35.355162] [INFO ] [REMOTE ] ZH: Fetching primary data for 2024-12. [2025-09-17T22:45:35.737045] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T22:45:35.744388] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2024-12. [2025-09-17T22:45:35.774691] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-11 (1.67 seconds). [2025-09-17T22:45:35.783799] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2024-12. [2025-09-17T22:45:36.444734] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2024-12 (1.09 seconds). [2025-09-17T22:45:36.449884] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-01. [2025-09-17T22:45:36.852961] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-11 (2.53 seconds). [2025-09-17T22:45:36.863556] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2024-12. [2025-09-17T22:45:37.203282] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2024-12 (1.46 seconds). [2025-09-17T22:45:37.210315] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-01. [2025-09-17T22:45:37.297293] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2024-12 (1.51 seconds). [2025-09-17T22:45:37.305992] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-01. [2025-09-17T22:45:37.667933] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T22:45:37.674879] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-02. [2025-09-17T22:45:38.476959] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-01 (1.27 seconds). [2025-09-17T22:45:38.483822] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-02. [2025-09-17T22:45:38.689697] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2024-12 (1.83 seconds). [2025-09-17T22:45:38.700898] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-01. [2025-09-17T22:45:38.855718] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-01 (1.55 seconds). [2025-09-17T22:45:38.864125] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-02. [2025-09-17T22:45:38.940681] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-02 (1.27 seconds). [2025-09-17T22:45:38.949170] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-03. [2025-09-17T22:45:39.877413] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-02 (1.39 seconds). [2025-09-17T22:45:39.885470] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-03. [2025-09-17T22:45:40.379231] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-03 (1.43 seconds). [2025-09-17T22:45:40.387939] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-04. [2025-09-17T22:45:40.409272] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-02 (1.55 seconds). [2025-09-17T22:45:40.417171] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-03. [2025-09-17T22:45:40.962581] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-01 (2.26 seconds). [2025-09-17T22:45:40.973577] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-02. [2025-09-17T22:45:41.051328] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-03 (1.17 seconds). [2025-09-17T22:45:41.061443] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-04. [2025-09-17T22:45:41.897305] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-04 (1.51 seconds). [2025-09-17T22:45:41.904551] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-05. [2025-09-17T22:45:42.008716] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-03 (1.59 seconds). [2025-09-17T22:45:42.017787] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-04. [2025-09-17T22:45:42.729302] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-04 (1.67 seconds). [2025-09-17T22:45:42.739481] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-05. [2025-09-17T22:45:43.024210] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-02 (2.05 seconds). [2025-09-17T22:45:43.039970] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-03. [2025-09-17T22:45:43.050438] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-05 (1.15 seconds). [2025-09-17T22:45:43.055234] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-06. [2025-09-17T22:45:43.799034] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-04 (1.78 seconds). [2025-09-17T22:45:43.808362] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-05. [2025-09-17T22:45:44.188748] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-06 (1.13 seconds). [2025-09-17T22:45:44.194328] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-07. [2025-09-17T22:45:44.300815] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-05 (1.56 seconds). [2025-09-17T22:45:44.310958] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-06. [2025-09-17T22:45:45.046896] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T22:45:45.058275] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-06. [2025-09-17T22:45:45.208414] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-07 (1.01 seconds). [2025-09-17T22:45:45.215566] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-08. [2025-09-17T22:45:45.426989] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-03 (2.39 seconds). [2025-09-17T22:45:45.438907] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-04. [2025-09-17T22:45:45.465499] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-06 (1.15 seconds). [2025-09-17T22:45:45.475218] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-07. [2025-09-17T22:45:46.404022] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-08 (1.19 seconds). [2025-09-17T22:45:46.409522] [INFO ] [REMOTE ] ZH: Fetching primary data for 2025-09. [2025-09-17T22:45:46.557794] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-06 (1.50 seconds). [2025-09-17T22:45:46.566259] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-07. [2025-09-17T22:45:47.099536] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-07 (1.62 seconds). [2025-09-17T22:45:47.114577] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-08. [2025-09-17T22:45:47.479259] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-04 (2.04 seconds). [2025-09-17T22:45:47.491319] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-05. [2025-09-17T22:45:47.525965] [INFO ] [REMOTE ] ZH: Incremental fetch complete for 2025-09 (1.12 seconds). [2025-09-17T22:45:47.530037] [INFO ] [REMOTE ] ZH: Full fetch complete (39659 records). [2025-09-17T22:45:47.530156] [DEBUG] [VALIDATOR ] ZH: Validating primary data. [2025-09-17T22:45:47.933622] [DEBUG] [VALIDATOR ] ZH: All expected trading days are present. [2025-09-17T22:45:47.933750] [DEBUG] [VALIDATOR ] ZH: Primary data validation passed. [2025-09-17T22:45:47.934565] [INFO ] [MAIN ] ZH: Fetched primary data is valid. [2025-09-17T22:45:47.934628] [DEBUG] [LOCAL ] ZH: Saving primary data. [2025-09-17T22:45:47.935721] [DEBUG] [LOCAL ] ZH: Trimmed 39659 records to 27184 (keeping 200 days of data) [2025-09-17T22:45:48.090468] [DEBUG] [LOCAL ] ZH: Primary data saved (27184 records). [2025-09-17T22:45:48.090612] [INFO ] [MAIN ] ZH: Full history saved. [2025-09-17T22:45:48.090747] [INFO ] [MAIN ] Update Progress: 2361/2371 symbols completed. ZH took 17.0s. Estimated remaining: 1m 28s. Rate: 6.8 symbols/min [2025-09-17T22:45:48.274015] [INFO ] [MAIN ] ZK: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:45:48.308458] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-07 (1.74 seconds). [2025-09-17T22:45:48.322522] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-08. [2025-09-17T22:45:48.357228] [DEBUG] [LOCAL ] ZK: Loaded 40092 existing records from primary storage. [2025-09-17T22:45:48.357385] [INFO ] [MAIN ] ZK: Loaded 40092 existing records. [2025-09-17T22:45:48.553337] [WARN ] [MAIN ] ZK: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:45:48.553841] [INFO ] [MAIN ] ZK: Wiping existing primary data before full refresh. [2025-09-17T22:45:48.553957] [INFO ] [LOCAL ] ZK: Starting deletion of primary data. [2025-09-17T22:45:48.555765] [DEBUG] [LOCAL ] ZK: Deleted primary data file. [2025-09-17T22:45:48.555967] [INFO ] [MAIN ] ZK: Starting full primary refresh. [2025-09-17T22:45:48.699639] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-08 (1.59 seconds). [2025-09-17T22:45:48.774852] [INFO ] [REMOTE ] ZIP: Fetching primary data for 2025-09. [2025-09-17T22:45:48.987506] [INFO ] [REMOTE ] ZK: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:45:48.987892] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-11. [2025-09-17T22:45:49.807558] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-08 (1.49 seconds). [2025-09-17T22:45:49.816735] [INFO ] [REMOTE ] ZGN: Fetching primary data for 2025-09. [2025-09-17T22:45:49.921201] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-05 (2.43 seconds). [2025-09-17T22:45:49.932357] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-06. [2025-09-17T22:45:50.254542] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-11 (1.27 seconds). [2025-09-17T22:45:50.263681] [INFO ] [REMOTE ] ZK: Fetching primary data for 2024-12. [2025-09-17T22:45:50.384722] [INFO ] [REMOTE ] ZIP: Incremental fetch complete for 2025-09 (1.61 seconds). [2025-09-17T22:45:50.390249] [INFO ] [REMOTE ] ZIP: Full fetch complete (59047 records). [2025-09-17T22:45:50.390427] [DEBUG] [VALIDATOR ] ZIP: Validating primary data. [2025-09-17T22:45:50.798480] [DEBUG] [VALIDATOR ] ZIP: All expected trading days are present. [2025-09-17T22:45:50.798633] [DEBUG] [VALIDATOR ] ZIP: Primary data validation passed. [2025-09-17T22:45:50.799623] [INFO ] [MAIN ] ZIP: Fetched primary data is valid. [2025-09-17T22:45:50.799706] [DEBUG] [LOCAL ] ZIP: Saving primary data. [2025-09-17T22:45:50.802017] [DEBUG] [LOCAL ] ZIP: Trimmed 59047 records to 44608 (keeping 200 days of data) [2025-09-17T22:45:51.076947] [DEBUG] [LOCAL ] ZIP: Primary data saved (44608 records). [2025-09-17T22:45:51.077100] [INFO ] [MAIN ] ZIP: Full history saved. [2025-09-17T22:45:51.077276] [INFO ] [MAIN ] Update Progress: 2362/2371 symbols completed. ZIP took 20.0s. Estimated remaining: 1m 19s. Rate: 6.8 symbols/min [2025-09-17T22:45:51.289144] [INFO ] [MAIN ] ZKH: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:45:51.300506] [INFO ] [REMOTE ] ZGN: Incremental fetch complete for 2025-09 (1.48 seconds). [2025-09-17T22:45:51.307303] [INFO ] [REMOTE ] ZGN: Full fetch complete (58267 records). [2025-09-17T22:45:51.307490] [DEBUG] [VALIDATOR ] ZGN: Validating primary data. [2025-09-17T22:45:51.410965] [DEBUG] [LOCAL ] ZKH: Loaded 7984 existing records from primary storage. [2025-09-17T22:45:51.422939] [INFO ] [MAIN ] ZKH: Loaded 7984 existing records. [2025-09-17T22:45:51.845975] [WARN ] [MAIN ] ZKH: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:45:51.852452] [INFO ] [MAIN ] ZKH: Wiping existing primary data before full refresh. [2025-09-17T22:45:51.858234] [INFO ] [LOCAL ] ZKH: Starting deletion of primary data. [2025-09-17T22:45:51.895850] [DEBUG] [LOCAL ] ZKH: Deleted primary data file. [2025-09-17T22:45:51.906883] [INFO ] [MAIN ] ZKH: Starting full primary refresh. [2025-09-17T22:45:52.010385] [DEBUG] [VALIDATOR ] ZGN: All expected trading days are present. [2025-09-17T22:45:52.035391] [DEBUG] [VALIDATOR ] ZGN: Primary data validation passed. [2025-09-17T22:45:52.085081] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2024-12 (1.82 seconds). [2025-09-17T22:45:52.092178] [INFO ] [MAIN ] ZGN: Fetched primary data is valid. [2025-09-17T22:45:52.113413] [DEBUG] [LOCAL ] ZGN: Saving primary data. [2025-09-17T22:45:52.126543] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-01. [2025-09-17T22:45:52.195025] [DEBUG] [LOCAL ] ZGN: Trimmed 58267 records to 40911 (keeping 200 days of data) [2025-09-17T22:45:52.412843] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-06 (2.48 seconds). [2025-09-17T22:45:52.503623] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-07. [2025-09-17T22:45:52.555890] [INFO ] [REMOTE ] ZKH: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:45:52.565200] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-11. [2025-09-17T22:45:52.726375] [DEBUG] [LOCAL ] ZGN: Primary data saved (40911 records). [2025-09-17T22:45:52.726517] [INFO ] [MAIN ] ZGN: Full history saved. [2025-09-17T22:45:52.726626] [INFO ] [MAIN ] Update Progress: 2363/2371 symbols completed. ZGN took 21.7s. Estimated remaining: 1m 10s. Rate: 6.8 symbols/min [2025-09-17T22:45:52.900015] [INFO ] [MAIN ] ZTO: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:45:52.959755] [DEBUG] [LOCAL ] ZTO: Loaded 50213 existing records from primary storage. [2025-09-17T22:45:52.959928] [INFO ] [MAIN ] ZTO: Loaded 50213 existing records. [2025-09-17T22:45:53.148729] [WARN ] [MAIN ] ZTO: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:45:53.149742] [INFO ] [MAIN ] ZTO: Wiping existing primary data before full refresh. [2025-09-17T22:45:53.149802] [INFO ] [LOCAL ] ZTO: Starting deletion of primary data. [2025-09-17T22:45:53.151314] [DEBUG] [LOCAL ] ZTO: Deleted primary data file. [2025-09-17T22:45:53.151375] [INFO ] [MAIN ] ZTO: Starting full primary refresh. [2025-09-17T22:45:53.501370] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-11 (0.94 seconds). [2025-09-17T22:45:53.514821] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2024-12. [2025-09-17T22:45:53.540376] [INFO ] [REMOTE ] ZTO: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:45:53.541875] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-11. [2025-09-17T22:45:53.621441] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-01 (1.49 seconds). [2025-09-17T22:45:53.632582] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-02. [2025-09-17T22:45:54.134963] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2024-12 (0.62 seconds). [2025-09-17T22:45:54.136864] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-01. [2025-09-17T22:45:54.876492] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-02 (1.24 seconds). [2025-09-17T22:45:54.884837] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-03. [2025-09-17T22:45:54.912604] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-01 (0.78 seconds). [2025-09-17T22:45:54.915237] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-02. [2025-09-17T22:45:54.968374] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-07 (2.46 seconds). [2025-09-17T22:45:54.981299] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-08. [2025-09-17T22:45:55.071412] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-11 (1.53 seconds). [2025-09-17T22:45:55.081503] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2024-12. [2025-09-17T22:45:55.712468] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-02 (0.80 seconds). [2025-09-17T22:45:55.715637] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-03. [2025-09-17T22:45:56.553368] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-03 (0.84 seconds). [2025-09-17T22:45:56.556359] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-04. [2025-09-17T22:45:56.588722] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-03 (1.70 seconds). [2025-09-17T22:45:56.684227] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2024-12 (1.60 seconds). [2025-09-17T22:45:56.969144] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-04 (0.41 seconds). [2025-09-17T22:45:57.224459] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-01. [2025-09-17T22:45:57.227574] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-08 (2.25 seconds). [2025-09-17T22:45:58.015769] [INFO ] [REMOTE ] ZIM: Fetching primary data for 2025-09. [2025-09-17T22:45:58.815782] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-05. [2025-09-17T22:45:58.937733] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-01 (1.71 seconds). [2025-09-17T22:45:59.615778] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-02. [2025-09-17T22:45:59.627275] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-05 (0.81 seconds). [2025-09-17T22:46:00.118796] [INFO ] [REMOTE ] ZIM: Incremental fetch complete for 2025-09 (2.10 seconds). [2025-09-17T22:46:00.125855] [INFO ] [REMOTE ] ZIM: Full fetch complete (77512 records). [2025-09-17T22:46:00.125998] [DEBUG] [VALIDATOR ] ZIM: Validating primary data. [2025-09-17T22:46:00.420922] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-04. [2025-09-17T22:46:00.535587] [DEBUG] [VALIDATOR ] ZIM: All expected trading days are present. [2025-09-17T22:46:00.535705] [DEBUG] [VALIDATOR ] ZIM: Primary data validation passed. [2025-09-17T22:46:00.536921] [INFO ] [MAIN ] ZIM: Fetched primary data is valid. [2025-09-17T22:46:00.536989] [DEBUG] [LOCAL ] ZIM: Saving primary data. [2025-09-17T22:46:00.538545] [DEBUG] [LOCAL ] ZIM: Trimmed 77512 records to 53551 (keeping 200 days of data) [2025-09-17T22:46:00.896396] [DEBUG] [LOCAL ] ZIM: Primary data saved (53551 records). [2025-09-17T22:46:00.896544] [INFO ] [MAIN ] ZIM: Full history saved. [2025-09-17T22:46:00.896635] [INFO ] [MAIN ] Update Progress: 2364/2371 symbols completed. ZIM took 29.8s. Estimated remaining: 1m 1s. Rate: 6.8 symbols/min [2025-09-17T22:46:01.088601] [INFO ] [MAIN ] ZTR: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:46:01.107042] [DEBUG] [LOCAL ] ZTR: Loaded 16939 existing records from primary storage. [2025-09-17T22:46:01.107208] [INFO ] [MAIN ] ZTR: Loaded 16939 existing records. [2025-09-17T22:46:01.221034] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-06. [2025-09-17T22:46:01.312900] [WARN ] [MAIN ] ZTR: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:46:01.313148] [INFO ] [MAIN ] ZTR: Wiping existing primary data before full refresh. [2025-09-17T22:46:01.313196] [INFO ] [LOCAL ] ZTR: Starting deletion of primary data. [2025-09-17T22:46:01.313725] [DEBUG] [LOCAL ] ZTR: Deleted primary data file. [2025-09-17T22:46:01.313786] [INFO ] [MAIN ] ZTR: Starting full primary refresh. [2025-09-17T22:46:01.714111] [INFO ] [REMOTE ] ZTR: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:46:01.743639] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-02 (2.13 seconds). [2025-09-17T22:46:01.824971] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-06 (0.60 seconds). [2025-09-17T22:46:02.015768] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-03. [2025-09-17T22:46:02.144770] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-04 (1.72 seconds). [2025-09-17T22:46:02.815785] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-05. [2025-09-17T22:46:03.615793] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-07. [2025-09-17T22:46:03.771155] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-03 (1.76 seconds). [2025-09-17T22:46:04.052671] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-05 (1.24 seconds). [2025-09-17T22:46:04.415791] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-06. [2025-09-17T22:46:04.610904] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-07 (1.00 seconds). [2025-09-17T22:46:05.215771] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-04. [2025-09-17T22:46:05.800055] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-06 (1.38 seconds). [2025-09-17T22:46:06.015787] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-07. [2025-09-17T22:46:06.815839] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-08. [2025-09-17T22:46:06.912207] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-04 (1.70 seconds). [2025-09-17T22:46:06.958322] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-07 (0.94 seconds). [2025-09-17T22:46:07.497532] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-08 (0.68 seconds). [2025-09-17T22:46:07.615799] [INFO ] [REMOTE ] ZKH: Fetching primary data for 2025-09. [2025-09-17T22:46:08.325472] [INFO ] [REMOTE ] ZKH: Incremental fetch complete for 2025-09 (0.71 seconds). [2025-09-17T22:46:08.327418] [INFO ] [REMOTE ] ZKH: Full fetch complete (11800 records). [2025-09-17T22:46:08.327494] [DEBUG] [VALIDATOR ] ZKH: Validating primary data. [2025-09-17T22:46:08.420977] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-08. [2025-09-17T22:46:08.738458] [DEBUG] [VALIDATOR ] ZKH: All expected trading days are present. [2025-09-17T22:46:08.738550] [DEBUG] [VALIDATOR ] ZKH: Primary data validation passed. [2025-09-17T22:46:08.738908] [INFO ] [MAIN ] ZKH: Fetched primary data is valid. [2025-09-17T22:46:08.738977] [DEBUG] [LOCAL ] ZKH: Saving primary data. [2025-09-17T22:46:08.739544] [DEBUG] [LOCAL ] ZKH: Trimmed 11800 records to 8027 (keeping 200 days of data) [2025-09-17T22:46:08.787176] [DEBUG] [LOCAL ] ZKH: Primary data saved (8027 records). [2025-09-17T22:46:08.787314] [INFO ] [MAIN ] ZKH: Full history saved. [2025-09-17T22:46:08.787470] [INFO ] [MAIN ] Update Progress: 2365/2371 symbols completed. ZKH took 17.7s. Estimated remaining: 52.7s. Rate: 6.8 symbols/min [2025-09-17T22:46:08.968531] [INFO ] [MAIN ] ZTS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:46:09.029826] [DEBUG] [LOCAL ] ZTS: Loaded 52999 existing records from primary storage. [2025-09-17T22:46:09.030001] [INFO ] [MAIN ] ZTS: Loaded 52999 existing records. [2025-09-17T22:46:09.211005] [WARN ] [MAIN ] ZTS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:46:09.211276] [INFO ] [MAIN ] ZTS: Wiping existing primary data before full refresh. [2025-09-17T22:46:09.211346] [INFO ] [LOCAL ] ZTS: Starting deletion of primary data. [2025-09-17T22:46:09.212534] [DEBUG] [LOCAL ] ZTS: Deleted primary data file. [2025-09-17T22:46:09.212596] [INFO ] [MAIN ] ZTS: Starting full primary refresh. [2025-09-17T22:46:09.223947] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-05. [2025-09-17T22:46:09.587879] [INFO ] [REMOTE ] ZTS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:46:10.015775] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-11. [2025-09-17T22:46:10.056220] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-08 (1.64 seconds). [2025-09-17T22:46:10.820866] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-11. [2025-09-17T22:46:10.837899] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-05 (1.61 seconds). [2025-09-17T22:46:11.055070] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-11 (1.04 seconds). [2025-09-17T22:46:11.615788] [INFO ] [REMOTE ] ZK: Fetching primary data for 2025-09. [2025-09-17T22:46:12.415791] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2024-12. [2025-09-17T22:46:12.582022] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-11 (1.76 seconds). [2025-09-17T22:46:13.057833] [INFO ] [REMOTE ] ZK: Incremental fetch complete for 2025-09 (1.44 seconds). [2025-09-17T22:46:13.063569] [INFO ] [REMOTE ] ZK: Full fetch complete (57193 records). [2025-09-17T22:46:13.063733] [DEBUG] [VALIDATOR ] ZK: Validating primary data. [2025-09-17T22:46:13.220890] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-06. [2025-09-17T22:46:13.463093] [DEBUG] [VALIDATOR ] ZK: All expected trading days are present. [2025-09-17T22:46:13.463178] [DEBUG] [VALIDATOR ] ZK: Primary data validation passed. [2025-09-17T22:46:13.464184] [INFO ] [MAIN ] ZK: Fetched primary data is valid. [2025-09-17T22:46:13.464250] [DEBUG] [LOCAL ] ZK: Saving primary data. [2025-09-17T22:46:13.465586] [DEBUG] [LOCAL ] ZK: Trimmed 57193 records to 40105 (keeping 200 days of data) [2025-09-17T22:46:13.591234] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2024-12 (1.18 seconds). [2025-09-17T22:46:13.752712] [DEBUG] [LOCAL ] ZK: Primary data saved (40105 records). [2025-09-17T22:46:13.752863] [INFO ] [MAIN ] ZK: Full history saved. [2025-09-17T22:46:13.754013] [INFO ] [MAIN ] Update Progress: 2366/2371 symbols completed. ZK took 25.7s. Estimated remaining: 43.9s. Rate: 6.8 symbols/min [2025-09-17T22:46:13.929678] [INFO ] [MAIN ] ZVIA: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:46:13.966340] [DEBUG] [LOCAL ] ZVIA: Loaded 35478 existing records from primary storage. [2025-09-17T22:46:13.966490] [INFO ] [MAIN ] ZVIA: Loaded 35478 existing records. [2025-09-17T22:46:14.021518] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-01. [2025-09-17T22:46:14.155416] [WARN ] [MAIN ] ZVIA: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:46:14.155740] [INFO ] [MAIN ] ZVIA: Wiping existing primary data before full refresh. [2025-09-17T22:46:14.155798] [INFO ] [LOCAL ] ZVIA: Starting deletion of primary data. [2025-09-17T22:46:14.156469] [DEBUG] [LOCAL ] ZVIA: Deleted primary data file. [2025-09-17T22:46:14.156532] [INFO ] [MAIN ] ZVIA: Starting full primary refresh. [2025-09-17T22:46:14.521184] [INFO ] [REMOTE ] ZVIA: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:46:14.815812] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-11. [2025-09-17T22:46:15.029225] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-06 (1.81 seconds). [2025-09-17T22:46:15.245361] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-01 (1.22 seconds). [2025-09-17T22:46:15.615881] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2024-12. [2025-09-17T22:46:15.769410] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-11 (0.95 seconds). [2025-09-17T22:46:16.415807] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-07. [2025-09-17T22:46:17.215788] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2024-12. [2025-09-17T22:46:17.619392] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2024-12 (2.00 seconds). [2025-09-17T22:46:17.848692] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-07 (1.43 seconds). [2025-09-17T22:46:18.015811] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-01. [2025-09-17T22:46:18.496769] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2024-12 (1.28 seconds). [2025-09-17T22:46:18.815781] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-08. [2025-09-17T22:46:19.615781] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-02. [2025-09-17T22:46:19.835957] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-01 (1.82 seconds). [2025-09-17T22:46:20.415823] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-01. [2025-09-17T22:46:20.584780] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-08 (1.77 seconds). [2025-09-17T22:46:20.646997] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-02 (1.03 seconds). [2025-09-17T22:46:21.215804] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-03. [2025-09-17T22:46:22.002719] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-01 (1.59 seconds). [2025-09-17T22:46:22.015685] [INFO ] [REMOTE ] ZTO: Fetching primary data for 2025-09. [2025-09-17T22:46:22.275467] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-03 (1.06 seconds). [2025-09-17T22:46:22.815813] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-02. [2025-09-17T22:46:23.589284] [INFO ] [REMOTE ] ZTO: Incremental fetch complete for 2025-09 (1.57 seconds). [2025-09-17T22:46:23.595568] [INFO ] [REMOTE ] ZTO: Full fetch complete (73152 records). [2025-09-17T22:46:23.595758] [DEBUG] [VALIDATOR ] ZTO: Validating primary data. [2025-09-17T22:46:23.620951] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-04. [2025-09-17T22:46:24.028280] [DEBUG] [VALIDATOR ] ZTO: All expected trading days are present. [2025-09-17T22:46:24.028373] [DEBUG] [VALIDATOR ] ZTO: Primary data validation passed. [2025-09-17T22:46:24.029575] [INFO ] [MAIN ] ZTO: Fetched primary data is valid. [2025-09-17T22:46:24.029670] [DEBUG] [LOCAL ] ZTO: Saving primary data. [2025-09-17T22:46:24.031337] [DEBUG] [LOCAL ] ZTO: Trimmed 73152 records to 50213 (keeping 200 days of data) [2025-09-17T22:46:24.295932] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-02 (1.48 seconds). [2025-09-17T22:46:24.393006] [DEBUG] [LOCAL ] ZTO: Primary data saved (50213 records). [2025-09-17T22:46:24.393154] [INFO ] [MAIN ] ZTO: Full history saved. [2025-09-17T22:46:24.394044] [INFO ] [MAIN ] Update Progress: 2367/2371 symbols completed. ZTO took 31.7s. Estimated remaining: 35.1s. Rate: 6.8 symbols/min [2025-09-17T22:46:24.426221] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-02. [2025-09-17T22:46:24.575075] [INFO ] [MAIN ] ZWS: Starting incremental primary update from 2025-09-09 to 2025-09-17. [2025-09-17T22:46:24.625636] [DEBUG] [LOCAL ] ZWS: Loaded 42622 existing records from primary storage. [2025-09-17T22:46:24.625824] [INFO ] [MAIN ] ZWS: Loaded 42622 existing records. [2025-09-17T22:46:24.815227] [WARN ] [MAIN ] ZWS: Insufficient historical data. Have data from 2025-02-28, but need from 2024-11-27 for 200 day retention. Performing full refresh. [2025-09-17T22:46:24.821209] [INFO ] [MAIN ] ZWS: Wiping existing primary data before full refresh. [2025-09-17T22:46:24.826050] [INFO ] [LOCAL ] ZWS: Starting deletion of primary data. [2025-09-17T22:46:24.827382] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-04 (1.21 seconds). [2025-09-17T22:46:24.827508] [DEBUG] [LOCAL ] ZWS: Deleted primary data file. [2025-09-17T22:46:24.831882] [INFO ] [MAIN ] ZWS: Starting full primary refresh. [2025-09-17T22:46:25.193405] [INFO ] [REMOTE ] ZWS: Fetching primary data covering 200 trading days from 2024-11-27 to 2025-09-17 (requires 11 months of data pull). [2025-09-17T22:46:25.215814] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-11. [2025-09-17T22:46:26.015775] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-03. [2025-09-17T22:46:26.365446] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-02 (1.94 seconds). [2025-09-17T22:46:26.725093] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-11 (1.51 seconds). [2025-09-17T22:46:26.815810] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2024-12. [2025-09-17T22:46:27.472985] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-03 (1.46 seconds). [2025-09-17T22:46:27.615849] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-04. [2025-09-17T22:46:27.932910] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2024-12 (1.12 seconds). [2025-09-17T22:46:28.415835] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-05. [2025-09-17T22:46:28.923602] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-04 (1.31 seconds). [2025-09-17T22:46:29.215771] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-05. [2025-09-17T22:46:29.268875] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-05 (0.85 seconds). [2025-09-17T22:46:30.015781] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-03. [2025-09-17T22:46:30.815772] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-01. [2025-09-17T22:46:30.903814] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-05 (1.69 seconds). [2025-09-17T22:46:31.615782] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-06. [2025-09-17T22:46:31.830927] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-03 (1.82 seconds). [2025-09-17T22:46:32.371128] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-01 (1.56 seconds). [2025-09-17T22:46:32.415754] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-02. [2025-09-17T22:46:32.988552] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-06 (1.37 seconds). [2025-09-17T22:46:33.215860] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-07. [2025-09-17T22:46:33.931679] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-02 (1.52 seconds). [2025-09-17T22:46:34.015797] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-03. [2025-09-17T22:46:34.444819] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-07 (1.23 seconds). [2025-09-17T22:46:34.815800] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-08. [2025-09-17T22:46:35.282691] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-03 (1.27 seconds). [2025-09-17T22:46:35.615801] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-06. [2025-09-17T22:46:36.382434] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-08 (1.57 seconds). [2025-09-17T22:46:36.415742] [INFO ] [REMOTE ] ZVIA: Fetching primary data for 2025-09. [2025-09-17T22:46:36.576153] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-06 (0.96 seconds). [2025-09-17T22:46:37.215784] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-04. [2025-09-17T22:46:37.702029] [INFO ] [REMOTE ] ZVIA: Incremental fetch complete for 2025-09 (1.29 seconds). [2025-09-17T22:46:37.708760] [INFO ] [REMOTE ] ZVIA: Full fetch complete (52254 records). [2025-09-17T22:46:37.709049] [DEBUG] [VALIDATOR ] ZVIA: Validating primary data. [2025-09-17T22:46:38.024792] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-07. [2025-09-17T22:46:38.160616] [DEBUG] [VALIDATOR ] ZVIA: All expected trading days are present. [2025-09-17T22:46:38.160740] [DEBUG] [VALIDATOR ] ZVIA: Primary data validation passed. [2025-09-17T22:46:38.162005] [INFO ] [MAIN ] ZVIA: Fetched primary data is valid. [2025-09-17T22:46:38.162070] [DEBUG] [LOCAL ] ZVIA: Saving primary data. [2025-09-17T22:46:38.163101] [DEBUG] [LOCAL ] ZVIA: Trimmed 52254 records to 35388 (keeping 200 days of data) [2025-09-17T22:46:38.358985] [DEBUG] [LOCAL ] ZVIA: Primary data saved (35388 records). [2025-09-17T22:46:38.359123] [INFO ] [MAIN ] ZVIA: Full history saved. [2025-09-17T22:46:38.359751] [INFO ] [MAIN ] Update Progress: 2368/2371 symbols completed. ZVIA took 24.6s. Estimated remaining: 26.3s. Rate: 6.8 symbols/min [2025-09-17T22:46:38.815846] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-04. [2025-09-17T22:46:39.144133] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-04 (1.93 seconds). [2025-09-17T22:46:39.172963] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-07 (1.15 seconds). [2025-09-17T22:46:39.615793] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-05. [2025-09-17T22:46:40.415800] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-08. [2025-09-17T22:46:40.574343] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-04 (1.76 seconds). [2025-09-17T22:46:41.119603] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-05 (1.50 seconds). [2025-09-17T22:46:41.215772] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-05. [2025-09-17T22:46:41.589885] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-08 (1.17 seconds). [2025-09-17T22:46:42.015779] [INFO ] [REMOTE ] ZTR: Fetching primary data for 2025-09. [2025-09-17T22:46:42.499308] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-05 (1.28 seconds). [2025-09-17T22:46:42.702469] [INFO ] [REMOTE ] ZTR: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T22:46:42.705145] [INFO ] [REMOTE ] ZTR: Full fetch complete (27021 records). [2025-09-17T22:46:42.705234] [DEBUG] [VALIDATOR ] ZTR: Validating primary data. [2025-09-17T22:46:42.820866] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-06. [2025-09-17T22:46:43.091218] [DEBUG] [VALIDATOR ] ZTR: All expected trading days are present. [2025-09-17T22:46:43.091300] [DEBUG] [VALIDATOR ] ZTR: Primary data validation passed. [2025-09-17T22:46:43.092044] [INFO ] [MAIN ] ZTR: Fetched primary data is valid. [2025-09-17T22:46:43.092117] [DEBUG] [LOCAL ] ZTR: Saving primary data. [2025-09-17T22:46:43.092820] [DEBUG] [LOCAL ] ZTR: Trimmed 27021 records to 16881 (keeping 200 days of data) [2025-09-17T22:46:43.193228] [DEBUG] [LOCAL ] ZTR: Primary data saved (16881 records). [2025-09-17T22:46:43.193383] [INFO ] [MAIN ] ZTR: Full history saved. [2025-09-17T22:46:43.193471] [INFO ] [MAIN ] Update Progress: 2369/2371 symbols completed. ZTR took 42.3s. Estimated remaining: 17.6s. Rate: 6.8 symbols/min [2025-09-17T22:46:43.615840] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-06. [2025-09-17T22:46:44.403383] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-06 (1.58 seconds). [2025-09-17T22:46:44.415764] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-07. [2025-09-17T22:46:45.725975] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-06 (2.11 seconds). [2025-09-17T22:46:45.737243] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-07. [2025-09-17T22:46:46.095054] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-07 (1.68 seconds). [2025-09-17T22:46:46.104959] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-08. [2025-09-17T22:46:47.811311] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-07 (2.07 seconds). [2025-09-17T22:46:47.823756] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-08. [2025-09-17T22:46:47.852806] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-08 (1.75 seconds). [2025-09-17T22:46:47.862635] [INFO ] [REMOTE ] ZWS: Fetching primary data for 2025-09. [2025-09-17T22:46:49.246306] [INFO ] [REMOTE ] ZWS: Incremental fetch complete for 2025-09 (1.38 seconds). [2025-09-17T22:46:49.252390] [INFO ] [REMOTE ] ZWS: Full fetch complete (61724 records). [2025-09-17T22:46:49.252532] [DEBUG] [VALIDATOR ] ZWS: Validating primary data. [2025-09-17T22:46:49.650807] [DEBUG] [VALIDATOR ] ZWS: All expected trading days are present. [2025-09-17T22:46:49.651047] [DEBUG] [VALIDATOR ] ZWS: Primary data validation passed. [2025-09-17T22:46:49.652468] [INFO ] [MAIN ] ZWS: Fetched primary data is valid. [2025-09-17T22:46:49.652672] [DEBUG] [LOCAL ] ZWS: Saving primary data. [2025-09-17T22:46:49.654713] [DEBUG] [LOCAL ] ZWS: Trimmed 61724 records to 42567 (keeping 200 days of data) [2025-09-17T22:46:49.802048] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-08 (1.98 seconds). [2025-09-17T22:46:49.815811] [INFO ] [REMOTE ] ZTS: Fetching primary data for 2025-09. [2025-09-17T22:46:49.982046] [DEBUG] [LOCAL ] ZWS: Primary data saved (42567 records). [2025-09-17T22:46:49.982185] [INFO ] [MAIN ] ZWS: Full history saved. [2025-09-17T22:46:49.982959] [INFO ] [MAIN ] Update Progress: 2370/2371 symbols completed. ZWS took 25.6s. Estimated remaining: 8.8s. Rate: 6.8 symbols/min [2025-09-17T22:46:50.500857] [INFO ] [REMOTE ] ZTS: Incremental fetch complete for 2025-09 (0.69 seconds). [2025-09-17T22:46:50.507711] [INFO ] [REMOTE ] ZTS: Full fetch complete (76525 records). [2025-09-17T22:46:50.507848] [DEBUG] [VALIDATOR ] ZTS: Validating primary data. [2025-09-17T22:46:50.929826] [DEBUG] [VALIDATOR ] ZTS: All expected trading days are present. [2025-09-17T22:46:50.929924] [DEBUG] [VALIDATOR ] ZTS: Primary data validation passed. [2025-09-17T22:46:50.931469] [INFO ] [MAIN ] ZTS: Fetched primary data is valid. [2025-09-17T22:46:50.931544] [DEBUG] [LOCAL ] ZTS: Saving primary data. [2025-09-17T22:46:50.933389] [DEBUG] [LOCAL ] ZTS: Trimmed 76525 records to 52987 (keeping 200 days of data) [2025-09-17T22:46:51.285631] [DEBUG] [LOCAL ] ZTS: Primary data saved (52987 records). [2025-09-17T22:46:51.285817] [INFO ] [MAIN ] ZTS: Full history saved. [2025-09-17T22:46:51.285938] [INFO ] [MAIN ] Update Progress: 2371/2371 symbols completed. ZTS took 42.5s. Estimated remaining: 0.0s. Rate: 6.8 symbols/min [2025-09-17T22:46:51.288468] [INFO ] [MAIN ] Parallel update completed in 5h 46m 49s [2025-09-17T22:46:51.288761] [WARN ] [MAIN ] Failed symbols (286): AAM, AACT, AAMI, A, AAUC, ACV, AD, ADCT, ADX, ADNT... [2025-09-17T22:46:51.288852] [INFO ] [MAIN ] Update success rate: 87.9% (2085/2371 symbols) [2025-09-17T22:46:51.855516] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Primary Update Completed (2085/2371 @ 87.94%)' [2025-09-17T22:46:51.856866] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-17T22:46:51.857147] [INFO ] [STATE ] Last completion updated: 2025-09-17T22:46:51.856945 [2025-09-17T22:46:51.857462] [WARN ] [STATE ] State set to: RUNNING [2025-09-17T22:46:51.857533] [INFO ] [MAIN ] Running derivative generation in parallel mode [2025-09-17T22:46:51.857682] [INFO ] [MAIN ] Wiping all existing derivative data before regeneration. [2025-09-17T22:46:51.857746] [INFO ] [LOCAL ] Starting deletion of all local derivative data. [2025-09-17T22:46:51.859780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CINT.csv [2025-09-17T22:46:51.860125] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMC.csv [2025-09-17T22:46:51.860426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FF.csv [2025-09-17T22:46:51.860753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLOW.csv [2025-09-17T22:46:51.861097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTN.csv [2025-09-17T22:46:51.861458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBR.csv [2025-09-17T22:46:51.861788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTI.csv [2025-09-17T22:46:51.862111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TX.csv [2025-09-17T22:46:51.862403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTZ.csv [2025-09-17T22:46:51.862739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERO.csv [2025-09-17T22:46:51.863040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPP.csv [2025-09-17T22:46:51.863324] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBDC.csv [2025-09-17T22:46:51.863571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLL.csv [2025-09-17T22:46:51.863901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HII.csv [2025-09-17T22:46:51.864190] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MX.csv [2025-09-17T22:46:51.864499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSI.csv [2025-09-17T22:46:51.865340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGD.csv [2025-09-17T22:46:51.865713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMWL.csv [2025-09-17T22:46:51.865972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDST.csv [2025-09-17T22:46:51.866258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEN.csv [2025-09-17T22:46:51.866531] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGO.csv [2025-09-17T22:46:51.866806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRK.csv [2025-09-17T22:46:51.867097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRL.csv [2025-09-17T22:46:51.867332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPFD.csv [2025-09-17T22:46:51.867607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMX.csv [2025-09-17T22:46:51.868709] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BV.csv [2025-09-17T22:46:51.868959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYN.csv [2025-09-17T22:46:51.869296] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHE.csv [2025-09-17T22:46:51.869594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/D.csv [2025-09-17T22:46:51.869829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZC.csv [2025-09-17T22:46:51.870013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NABL.csv [2025-09-17T22:46:51.870293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SII.csv [2025-09-17T22:46:51.870521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCV.csv [2025-09-17T22:46:51.870828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNK.csv [2025-09-17T22:46:51.871169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADM.csv [2025-09-17T22:46:51.871438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIN.csv [2025-09-17T22:46:51.871781] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNX.csv [2025-09-17T22:46:51.872110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TREX.csv [2025-09-17T22:46:51.872364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTST.csv [2025-09-17T22:46:51.872567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKM.csv [2025-09-17T22:46:51.873014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCF.csv [2025-09-17T22:46:51.873250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITC.csv [2025-09-17T22:46:51.873461] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLGN.csv [2025-09-17T22:46:51.873695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVN.csv [2025-09-17T22:46:51.874184] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGI.csv [2025-09-17T22:46:51.874434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEPU.csv [2025-09-17T22:46:51.874674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMPX.csv [2025-09-17T22:46:51.875256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTB.csv [2025-09-17T22:46:51.875447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAT.csv [2025-09-17T22:46:51.875785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEN.csv [2025-09-17T22:46:51.876089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMS.csv [2025-09-17T22:46:51.876387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSV.csv [2025-09-17T22:46:51.876631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNNE.csv [2025-09-17T22:46:51.876997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVX.csv [2025-09-17T22:46:51.877288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLNK.csv [2025-09-17T22:46:51.877565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINV.csv [2025-09-17T22:46:51.877806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/S.csv [2025-09-17T22:46:51.878069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSS.csv [2025-09-17T22:46:51.878305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JELD.csv [2025-09-17T22:46:51.878499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JKS.csv [2025-09-17T22:46:51.878756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOS.csv [2025-09-17T22:46:51.878959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCA.csv [2025-09-17T22:46:51.879222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAT.csv [2025-09-17T22:46:51.879452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QUAD.csv [2025-09-17T22:46:51.879688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUR.csv [2025-09-17T22:46:51.879923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNB.csv [2025-09-17T22:46:51.880132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRMB.csv [2025-09-17T22:46:51.880349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTE.csv [2025-09-17T22:46:51.880635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPI.csv [2025-09-17T22:46:51.880956] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAZ.csv [2025-09-17T22:46:51.881258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDS.csv [2025-09-17T22:46:51.881548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YPF.csv [2025-09-17T22:46:51.881874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTL.csv [2025-09-17T22:46:51.882092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UFI.csv [2025-09-17T22:46:51.882450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFC.csv [2025-09-17T22:46:51.882681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEO.csv [2025-09-17T22:46:51.882901] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTHY.csv [2025-09-17T22:46:51.883168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPHR.csv [2025-09-17T22:46:51.883404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCV.csv [2025-09-17T22:46:51.883825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNW.csv [2025-09-17T22:46:51.884051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BB.csv [2025-09-17T22:46:51.884314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDOT.csv [2025-09-17T22:46:51.884542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVS.csv [2025-09-17T22:46:51.884810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVR.csv [2025-09-17T22:46:51.885049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNST.csv [2025-09-17T22:46:51.885236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVGS.csv [2025-09-17T22:46:51.885445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMF.csv [2025-09-17T22:46:51.885758] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALL.csv [2025-09-17T22:46:51.886071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVB.csv [2025-09-17T22:46:51.886259] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OR.csv [2025-09-17T22:46:51.886495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIPR.csv [2025-09-17T22:46:51.886793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMR.csv [2025-09-17T22:46:51.887006] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVH.csv [2025-09-17T22:46:51.887283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLCO.csv [2025-09-17T22:46:51.887515] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVI.csv [2025-09-17T22:46:51.887818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WY.csv [2025-09-17T22:46:51.888128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BR.csv [2025-09-17T22:46:51.888360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGLS.csv [2025-09-17T22:46:51.888595] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TD.csv [2025-09-17T22:46:51.888853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAG.csv [2025-09-17T22:46:51.889086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMU.csv [2025-09-17T22:46:51.889334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYL.csv [2025-09-17T22:46:51.889558] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUMN.csv [2025-09-17T22:46:51.890030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIX.csv [2025-09-17T22:46:51.890288] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMA.csv [2025-09-17T22:46:51.890467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPFI.csv [2025-09-17T22:46:51.890697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGR.csv [2025-09-17T22:46:51.890921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGD.csv [2025-09-17T22:46:51.891095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHF.csv [2025-09-17T22:46:51.891307] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBX.csv [2025-09-17T22:46:51.891490] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENO.csv [2025-09-17T22:46:51.891721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPB.csv [2025-09-17T22:46:51.892060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBC.csv [2025-09-17T22:46:51.892325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTY.csv [2025-09-17T22:46:51.892557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPG.csv [2025-09-17T22:46:51.892991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUZ.csv [2025-09-17T22:46:51.893295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRX.csv [2025-09-17T22:46:51.893507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIPO.csv [2025-09-17T22:46:51.893768] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPI.csv [2025-09-17T22:46:51.894070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/H.csv [2025-09-17T22:46:51.894300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNQ.csv [2025-09-17T22:46:51.894526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAY.csv [2025-09-17T22:46:51.894763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEQ.csv [2025-09-17T22:46:51.895054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSM.csv [2025-09-17T22:46:51.895334] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIT.csv [2025-09-17T22:46:51.895545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTRG.csv [2025-09-17T22:46:51.895912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UGP.csv [2025-09-17T22:46:51.896189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPOR.csv [2025-09-17T22:46:51.896434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVTR.csv [2025-09-17T22:46:51.896705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRH.csv [2025-09-17T22:46:51.896951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCPT.csv [2025-09-17T22:46:51.897144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFN.csv [2025-09-17T22:46:51.897328] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAE.csv [2025-09-17T22:46:51.897965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOL.csv [2025-09-17T22:46:51.898189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYB.csv [2025-09-17T22:46:51.898392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNF.csv [2025-09-17T22:46:51.898615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOR.csv [2025-09-17T22:46:51.898984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IMAX.csv [2025-09-17T22:46:51.899185] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZN.csv [2025-09-17T22:46:51.899388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WS.csv [2025-09-17T22:46:51.899591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAL.csv [2025-09-17T22:46:51.899802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLR.csv [2025-09-17T22:46:51.900040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BK.csv [2025-09-17T22:46:51.900241] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIM.csv [2025-09-17T22:46:51.900412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCN.csv [2025-09-17T22:46:51.900682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNY.csv [2025-09-17T22:46:51.900968] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLO.csv [2025-09-17T22:46:51.901189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMPR.csv [2025-09-17T22:46:51.901423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTL.csv [2025-09-17T22:46:51.901696] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KWR.csv [2025-09-17T22:46:51.902012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AORT.csv [2025-09-17T22:46:51.902251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWNB.csv [2025-09-17T22:46:51.902476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGN.csv [2025-09-17T22:46:51.902799] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAPL.csv [2025-09-17T22:46:51.903022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USB.csv [2025-09-17T22:46:51.903236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGT.csv [2025-09-17T22:46:51.903497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMY.csv [2025-09-17T22:46:51.903705] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLO.csv [2025-09-17T22:46:51.903922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCS.csv [2025-09-17T22:46:51.904085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YSG.csv [2025-09-17T22:46:51.904348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATO.csv [2025-09-17T22:46:51.904543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSL.csv [2025-09-17T22:46:51.904761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NREF.csv [2025-09-17T22:46:51.905016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFG.csv [2025-09-17T22:46:51.905464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIVI.csv [2025-09-17T22:46:51.905825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNT.csv [2025-09-17T22:46:51.906035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIM.csv [2025-09-17T22:46:51.906322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRT.csv [2025-09-17T22:46:51.906524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAI.csv [2025-09-17T22:46:51.906773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMO.csv [2025-09-17T22:46:51.906945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRB.csv [2025-09-17T22:46:51.907124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTH.csv [2025-09-17T22:46:51.907319] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRO.csv [2025-09-17T22:46:51.907513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCN.csv [2025-09-17T22:46:51.907796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDT.csv [2025-09-17T22:46:51.907969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFSI.csv [2025-09-17T22:46:51.908167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNG.csv [2025-09-17T22:46:51.908349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXU.csv [2025-09-17T22:46:51.908527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRGP.csv [2025-09-17T22:46:51.908767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMEZ.csv [2025-09-17T22:46:51.908946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHAL.csv [2025-09-17T22:46:51.909136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOB.csv [2025-09-17T22:46:51.909329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEA.csv [2025-09-17T22:46:51.909545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPER.csv [2025-09-17T22:46:51.909790] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPH.csv [2025-09-17T22:46:51.909989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WST.csv [2025-09-17T22:46:51.910223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPK.csv [2025-09-17T22:46:51.910426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GL.csv [2025-09-17T22:46:51.910668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRS.csv [2025-09-17T22:46:51.910845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FR.csv [2025-09-17T22:46:51.911039] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PIM.csv [2025-09-17T22:46:51.911205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTR.csv [2025-09-17T22:46:51.911407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MD.csv [2025-09-17T22:46:51.911635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFJ.csv [2025-09-17T22:46:51.911859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FHI.csv [2025-09-17T22:46:51.912069] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRG.csv [2025-09-17T22:46:51.912254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHW.csv [2025-09-17T22:46:51.912511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACM.csv [2025-09-17T22:46:51.912721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKE.csv [2025-09-17T22:46:51.912933] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWAN.csv [2025-09-17T22:46:51.913152] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEE.csv [2025-09-17T22:46:51.913412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTR.csv [2025-09-17T22:46:51.913585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFA.csv [2025-09-17T22:46:51.913947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNV.csv [2025-09-17T22:46:51.914194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNOW.csv [2025-09-17T22:46:51.914428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBZ.csv [2025-09-17T22:46:51.914601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPMC.csv [2025-09-17T22:46:51.914834] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIO.csv [2025-09-17T22:46:51.915122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWA.csv [2025-09-17T22:46:51.915344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYE.csv [2025-09-17T22:46:51.915582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNY.csv [2025-09-17T22:46:51.915841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGG.csv [2025-09-17T22:46:51.916063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARR.csv [2025-09-17T22:46:51.916300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYT.csv [2025-09-17T22:46:51.916473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPC.csv [2025-09-17T22:46:51.916669] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUT.csv [2025-09-17T22:46:51.916875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSD.csv [2025-09-17T22:46:51.917056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLB.csv [2025-09-17T22:46:51.917485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNED.csv [2025-09-17T22:46:51.918027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DXC.csv [2025-09-17T22:46:51.918179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWLP.csv [2025-09-17T22:46:51.918380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNA.csv [2025-09-17T22:46:51.918564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFG.csv [2025-09-17T22:46:51.918762] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NU.csv [2025-09-17T22:46:51.918950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXNM.csv [2025-09-17T22:46:51.919236] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGI.csv [2025-09-17T22:46:51.919428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ULS.csv [2025-09-17T22:46:51.919587] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNI.csv [2025-09-17T22:46:51.919856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFS.csv [2025-09-17T22:46:51.920114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BC.csv [2025-09-17T22:46:51.920322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSD.csv [2025-09-17T22:46:51.920529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYL.csv [2025-09-17T22:46:51.920771] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIMB.csv [2025-09-17T22:46:51.920944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EE.csv [2025-09-17T22:46:51.921148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPS.csv [2025-09-17T22:46:51.921389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIZ.csv [2025-09-17T22:46:51.922064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAC.csv [2025-09-17T22:46:51.922292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVEO.csv [2025-09-17T22:46:51.922466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HI.csv [2025-09-17T22:46:51.922697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSCI.csv [2025-09-17T22:46:51.922898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNG.csv [2025-09-17T22:46:51.923122] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLNG.csv [2025-09-17T22:46:51.923260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRD.csv [2025-09-17T22:46:51.923433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNN.csv [2025-09-17T22:46:51.923721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABEV.csv [2025-09-17T22:46:51.923960] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAC.csv [2025-09-17T22:46:51.924143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRBR.csv [2025-09-17T22:46:51.924351] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTO.csv [2025-09-17T22:46:51.924573] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SF.csv [2025-09-17T22:46:51.924936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMI.csv [2025-09-17T22:46:51.925132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGZ.csv [2025-09-17T22:46:51.925363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAN.csv [2025-09-17T22:46:51.925559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMBT.csv [2025-09-17T22:46:51.925777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QD.csv [2025-09-17T22:46:51.926003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VICI.csv [2025-09-17T22:46:51.926292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACI.csv [2025-09-17T22:46:51.926630] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHG.csv [2025-09-17T22:46:51.926827] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRDY.csv [2025-09-17T22:46:51.927053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDN.csv [2025-09-17T22:46:51.927252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AX.csv [2025-09-17T22:46:51.927439] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHK.csv [2025-09-17T22:46:51.927638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPC.csv [2025-09-17T22:46:51.927836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRC.csv [2025-09-17T22:46:51.928028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAM.csv [2025-09-17T22:46:51.928257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHE.csv [2025-09-17T22:46:51.928473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBER.csv [2025-09-17T22:46:51.928722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEO.csv [2025-09-17T22:46:51.928940] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEI.csv [2025-09-17T22:46:51.929134] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RXO.csv [2025-09-17T22:46:51.929356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AJG.csv [2025-09-17T22:46:51.929548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTN.csv [2025-09-17T22:46:51.929914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTT.csv [2025-09-17T22:46:51.930127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFB.csv [2025-09-17T22:46:51.930383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFLY.csv [2025-09-17T22:46:51.930588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBU.csv [2025-09-17T22:46:51.930804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHY.csv [2025-09-17T22:46:51.931022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BH.csv [2025-09-17T22:46:51.931414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITGR.csv [2025-09-17T22:46:51.931613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRV.csv [2025-09-17T22:46:51.931836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MRC.csv [2025-09-17T22:46:51.932045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOR.csv [2025-09-17T22:46:51.932237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGL.csv [2025-09-17T22:46:51.932441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUS.csv [2025-09-17T22:46:51.932683] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFZ.csv [2025-09-17T22:46:51.932844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WD.csv [2025-09-17T22:46:51.933020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BVN.csv [2025-09-17T22:46:51.933227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEAV.csv [2025-09-17T22:46:51.933374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHN.csv [2025-09-17T22:46:51.933557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WK.csv [2025-09-17T22:46:51.933753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHWY.csv [2025-09-17T22:46:51.933953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSL.csv [2025-09-17T22:46:51.934183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMR.csv [2025-09-17T22:46:51.934369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLY.csv [2025-09-17T22:46:51.934577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGF.csv [2025-09-17T22:46:51.934784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEL.csv [2025-09-17T22:46:51.934981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRBK.csv [2025-09-17T22:46:51.935165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOLV.csv [2025-09-17T22:46:51.935385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TIXT.csv [2025-09-17T22:46:51.935593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBRK.csv [2025-09-17T22:46:51.935788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOG.csv [2025-09-17T22:46:51.935962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COMP.csv [2025-09-17T22:46:51.936140] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LRN.csv [2025-09-17T22:46:51.936303] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGA.csv [2025-09-17T22:46:51.936548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXC.csv [2025-09-17T22:46:51.936815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUN.csv [2025-09-17T22:46:51.937010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHI.csv [2025-09-17T22:46:51.937180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEG.csv [2025-09-17T22:46:51.937348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMT.csv [2025-09-17T22:46:51.937536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LC.csv [2025-09-17T22:46:51.938054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ES.csv [2025-09-17T22:46:51.938240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYTR.csv [2025-09-17T22:46:51.938412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHG.csv [2025-09-17T22:46:51.938586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OKE.csv [2025-09-17T22:46:51.938806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HESM.csv [2025-09-17T22:46:51.938982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XHR.csv [2025-09-17T22:46:51.939204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TROX.csv [2025-09-17T22:46:51.939417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNW.csv [2025-09-17T22:46:51.939572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDV.csv [2025-09-17T22:46:51.939983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BILL.csv [2025-09-17T22:46:51.940158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFD.csv [2025-09-17T22:46:51.940383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHX.csv [2025-09-17T22:46:51.940576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRBY.csv [2025-09-17T22:46:51.941020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REZI.csv [2025-09-17T22:46:51.941249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STC.csv [2025-09-17T22:46:51.941426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQI.csv [2025-09-17T22:46:51.941706] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCI.csv [2025-09-17T22:46:51.941929] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCX.csv [2025-09-17T22:46:51.942217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOC.csv [2025-09-17T22:46:51.942400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIC.csv [2025-09-17T22:46:51.942588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATGE.csv [2025-09-17T22:46:51.942990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPC.csv [2025-09-17T22:46:51.943200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRI.csv [2025-09-17T22:46:51.943363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CEE.csv [2025-09-17T22:46:51.943567] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHK.csv [2025-09-17T22:46:51.943750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLD.csv [2025-09-17T22:46:51.943942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKE.csv [2025-09-17T22:46:51.944146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLXR.csv [2025-09-17T22:46:51.944382] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPM.csv [2025-09-17T22:46:51.944560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTS.csv [2025-09-17T22:46:51.944831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDI.csv [2025-09-17T22:46:51.945032] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APTV.csv [2025-09-17T22:46:51.945232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLI.csv [2025-09-17T22:46:51.945436] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QSR.csv [2025-09-17T22:46:51.945594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAA.csv [2025-09-17T22:46:51.945959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THS.csv [2025-09-17T22:46:51.946141] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDIV.csv [2025-09-17T22:46:51.946337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BALL.csv [2025-09-17T22:46:51.946713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IR.csv [2025-09-17T22:46:51.946912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODV.csv [2025-09-17T22:46:51.947079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDL.csv [2025-09-17T22:46:51.947246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVLG.csv [2025-09-17T22:46:51.947395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMI.csv [2025-09-17T22:46:51.947559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FNF.csv [2025-09-17T22:46:51.947757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBCI.csv [2025-09-17T22:46:51.947948] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRDN.csv [2025-09-17T22:46:51.948107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACK.csv [2025-09-17T22:46:51.948251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COP.csv [2025-09-17T22:46:51.948403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMT.csv [2025-09-17T22:46:51.948576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PLYM.csv [2025-09-17T22:46:51.948810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DINO.csv [2025-09-17T22:46:51.949056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VAC.csv [2025-09-17T22:46:51.949262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMG.csv [2025-09-17T22:46:51.949449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AU.csv [2025-09-17T22:46:51.949624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPG.csv [2025-09-17T22:46:51.949828] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHF.csv [2025-09-17T22:46:51.949981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADT.csv [2025-09-17T22:46:51.950212] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLDR.csv [2025-09-17T22:46:51.950380] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIT.csv [2025-09-17T22:46:51.950566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTS.csv [2025-09-17T22:46:51.950761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBF.csv [2025-09-17T22:46:51.950916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARCO.csv [2025-09-17T22:46:51.951095] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBHC.csv [2025-09-17T22:46:51.951277] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHC.csv [2025-09-17T22:46:51.951457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SG.csv [2025-09-17T22:46:51.951633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PPT.csv [2025-09-17T22:46:51.951899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXTA.csv [2025-09-17T22:46:51.952075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDDT.csv [2025-09-17T22:46:51.952232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MA.csv [2025-09-17T22:46:51.952409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ADC.csv [2025-09-17T22:46:51.952593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIRT.csv [2025-09-17T22:46:51.952822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAR.csv [2025-09-17T22:46:51.952996] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIG.csv [2025-09-17T22:46:51.953395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTG.csv [2025-09-17T22:46:51.953580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BW.csv [2025-09-17T22:46:51.953903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRA.csv [2025-09-17T22:46:51.954090] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATUS.csv [2025-09-17T22:46:51.954284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MODG.csv [2025-09-17T22:46:51.954472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQNB.csv [2025-09-17T22:46:51.954703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STK.csv [2025-09-17T22:46:51.954859] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWZ.csv [2025-09-17T22:46:51.955043] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABR.csv [2025-09-17T22:46:51.955220] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARIS.csv [2025-09-17T22:46:51.955397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATR.csv [2025-09-17T22:46:51.955584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFXT.csv [2025-09-17T22:46:51.955770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CF.csv [2025-09-17T22:46:51.955952] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTBB.csv [2025-09-17T22:46:51.956142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GROV.csv [2025-09-17T22:46:51.956365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLX.csv [2025-09-17T22:46:51.956518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRGY.csv [2025-09-17T22:46:51.956721] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLVT.csv [2025-09-17T22:46:51.956913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HHH.csv [2025-09-17T22:46:51.957154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTO.csv [2025-09-17T22:46:51.957327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEA.csv [2025-09-17T22:46:51.957517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OXM.csv [2025-09-17T22:46:51.957740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUD.csv [2025-09-17T22:46:51.957918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRAK.csv [2025-09-17T22:46:51.958116] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPG.csv [2025-09-17T22:46:51.958322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EIG.csv [2025-09-17T22:46:51.958509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDC.csv [2025-09-17T22:46:51.958711] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVV.csv [2025-09-17T22:46:51.958888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPC.csv [2025-09-17T22:46:51.959086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IH.csv [2025-09-17T22:46:51.959285] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VZ.csv [2025-09-17T22:46:51.959475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECL.csv [2025-09-17T22:46:51.959667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTH.csv [2025-09-17T22:46:51.959845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUM.csv [2025-09-17T22:46:51.959998] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTVA.csv [2025-09-17T22:46:51.960176] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXT.csv [2025-09-17T22:46:51.960359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSTS.csv [2025-09-17T22:46:51.960546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESS.csv [2025-09-17T22:46:51.960788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALK.csv [2025-09-17T22:46:51.960951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FICO.csv [2025-09-17T22:46:51.961103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USA.csv [2025-09-17T22:46:51.961265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNC.csv [2025-09-17T22:46:51.961429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSB.csv [2025-09-17T22:46:51.961607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSCO.csv [2025-09-17T22:46:51.961894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KF.csv [2025-09-17T22:46:51.962058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVA.csv [2025-09-17T22:46:51.962255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPRU.csv [2025-09-17T22:46:51.962419] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFN.csv [2025-09-17T22:46:51.962592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPB.csv [2025-09-17T22:46:51.962817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXK.csv [2025-09-17T22:46:51.962992] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKKT.csv [2025-09-17T22:46:51.963182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIS.csv [2025-09-17T22:46:51.963528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHOC.csv [2025-09-17T22:46:51.963728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBGS.csv [2025-09-17T22:46:51.963882] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKV.csv [2025-09-17T22:46:51.964108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVD.csv [2025-09-17T22:46:51.964280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLC.csv [2025-09-17T22:46:51.964434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLQT.csv [2025-09-17T22:46:51.964586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FVRR.csv [2025-09-17T22:46:51.964801] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASBA.csv [2025-09-17T22:46:51.964975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVNA.csv [2025-09-17T22:46:51.965124] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGR.csv [2025-09-17T22:46:51.965290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBXG.csv [2025-09-17T22:46:51.965451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BZH.csv [2025-09-17T22:46:51.965702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACA.csv [2025-09-17T22:46:51.965873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRA.csv [2025-09-17T22:46:51.966037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPP.csv [2025-09-17T22:46:51.966213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGR.csv [2025-09-17T22:46:51.966391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HEI.csv [2025-09-17T22:46:51.966556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KB.csv [2025-09-17T22:46:51.966750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGL.csv [2025-09-17T22:46:51.966938] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUI.csv [2025-09-17T22:46:51.967100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAI.csv [2025-09-17T22:46:51.967284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHEL.csv [2025-09-17T22:46:51.967475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNT.csv [2025-09-17T22:46:51.967671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETV.csv [2025-09-17T22:46:51.967832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WM.csv [2025-09-17T22:46:51.968004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDW.csv [2025-09-17T22:46:51.968178] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COLD.csv [2025-09-17T22:46:51.968354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYH.csv [2025-09-17T22:46:51.968493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BJ.csv [2025-09-17T22:46:51.968902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THW.csv [2025-09-17T22:46:51.969063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAGS.csv [2025-09-17T22:46:51.969215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNO.csv [2025-09-17T22:46:51.969377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXG.csv [2025-09-17T22:46:51.969597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COUR.csv [2025-09-17T22:46:51.969867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CP.csv [2025-09-17T22:46:51.970070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCK.csv [2025-09-17T22:46:51.970276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVT.csv [2025-09-17T22:46:51.970483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHR.csv [2025-09-17T22:46:51.970685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDN.csv [2025-09-17T22:46:51.970869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSA.csv [2025-09-17T22:46:51.971094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHC.csv [2025-09-17T22:46:51.971291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTU.csv [2025-09-17T22:46:51.971489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEI.csv [2025-09-17T22:46:51.971691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBM.csv [2025-09-17T22:46:51.971842] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXR.csv [2025-09-17T22:46:51.972089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAT.csv [2025-09-17T22:46:51.972237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LION.csv [2025-09-17T22:46:51.972400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXC.csv [2025-09-17T22:46:51.972579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVX.csv [2025-09-17T22:46:51.972824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPOT.csv [2025-09-17T22:46:51.972991] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEM.csv [2025-09-17T22:46:51.973138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWP.csv [2025-09-17T22:46:51.973329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLTY.csv [2025-09-17T22:46:51.973526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBAN.csv [2025-09-17T22:46:51.973899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHI.csv [2025-09-17T22:46:51.974040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HXL.csv [2025-09-17T22:46:51.974209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHT.csv [2025-09-17T22:46:51.974387] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AQN.csv [2025-09-17T22:46:51.974551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROG.csv [2025-09-17T22:46:51.974746] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VALE.csv [2025-09-17T22:46:51.974927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRM.csv [2025-09-17T22:46:51.975107] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CION.csv [2025-09-17T22:46:51.975271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMS.csv [2025-09-17T22:46:51.975432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWR.csv [2025-09-17T22:46:51.975632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CFR.csv [2025-09-17T22:46:51.975843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFC.csv [2025-09-17T22:46:51.976017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRT.csv [2025-09-17T22:46:51.976197] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GENI.csv [2025-09-17T22:46:51.976361] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VFC.csv [2025-09-17T22:46:51.976506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMFG.csv [2025-09-17T22:46:51.976707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECC.csv [2025-09-17T22:46:51.976848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGTY.csv [2025-09-17T22:46:51.977017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NJR.csv [2025-09-17T22:46:51.977165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CR.csv [2025-09-17T22:46:51.977329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENFY.csv [2025-09-17T22:46:51.977552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFI.csv [2025-09-17T22:46:51.977728] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OC.csv [2025-09-17T22:46:51.977899] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SM.csv [2025-09-17T22:46:51.978044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHD.csv [2025-09-17T22:46:51.978210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CB.csv [2025-09-17T22:46:51.978373] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGG.csv [2025-09-17T22:46:51.978540] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APO.csv [2025-09-17T22:46:51.978704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDT.csv [2025-09-17T22:46:51.978865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TJX.csv [2025-09-17T22:46:51.979013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMN.csv [2025-09-17T22:46:51.979356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHH.csv [2025-09-17T22:46:51.979551] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HYI.csv [2025-09-17T22:46:51.979730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBDC.csv [2025-09-17T22:46:51.979884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOAH.csv [2025-09-17T22:46:51.980060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPR.csv [2025-09-17T22:46:51.980246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTG.csv [2025-09-17T22:46:51.980392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARI.csv [2025-09-17T22:46:51.980563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOS.csv [2025-09-17T22:46:51.980753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GETY.csv [2025-09-17T22:46:51.980915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKH.csv [2025-09-17T22:46:51.981074] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRH.csv [2025-09-17T22:46:51.981223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAB.csv [2025-09-17T22:46:51.981392] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REVG.csv [2025-09-17T22:46:51.981577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SIG.csv [2025-09-17T22:46:51.981846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZZ.csv [2025-09-17T22:46:51.981997] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRT.csv [2025-09-17T22:46:51.982146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITUB.csv [2025-09-17T22:46:51.982305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXP.csv [2025-09-17T22:46:51.982452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HASI.csv [2025-09-17T22:46:51.982631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNS.csv [2025-09-17T22:46:51.982796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SILA.csv [2025-09-17T22:46:51.982958] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIW.csv [2025-09-17T22:46:51.983121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NX.csv [2025-09-17T22:46:51.983258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGRE.csv [2025-09-17T22:46:51.983417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNC.csv [2025-09-17T22:46:51.983572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCDL.csv [2025-09-17T22:46:51.983803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HR.csv [2025-09-17T22:46:51.983973] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBE.csv [2025-09-17T22:46:51.984142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRND.csv [2025-09-17T22:46:51.984326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCTS.csv [2025-09-17T22:46:51.984498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNX.csv [2025-09-17T22:46:51.984720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBX.csv [2025-09-17T22:46:51.984916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACCO.csv [2025-09-17T22:46:51.985065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTEX.csv [2025-09-17T22:46:51.985242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AL.csv [2025-09-17T22:46:51.985442] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEX.csv [2025-09-17T22:46:51.985572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NC.csv [2025-09-17T22:46:51.985766] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNL.csv [2025-09-17T22:46:51.985919] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VATE.csv [2025-09-17T22:46:51.986075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFS.csv [2025-09-17T22:46:51.986336] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDS.csv [2025-09-17T22:46:51.986474] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWK.csv [2025-09-17T22:46:51.986682] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EARN.csv [2025-09-17T22:46:51.986848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOI.csv [2025-09-17T22:46:51.987004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSB.csv [2025-09-17T22:46:51.987161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FG.csv [2025-09-17T22:46:51.987312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKT.csv [2025-09-17T22:46:51.987469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVE.csv [2025-09-17T22:46:51.987609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNR.csv [2025-09-17T22:46:51.987778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LUV.csv [2025-09-17T22:46:51.987950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RL.csv [2025-09-17T22:46:51.988136] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXT.csv [2025-09-17T22:46:51.988282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLE.csv [2025-09-17T22:46:51.988445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHMI.csv [2025-09-17T22:46:51.988608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LW.csv [2025-09-17T22:46:51.988792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTWO.csv [2025-09-17T22:46:51.988947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/J.csv [2025-09-17T22:46:51.989098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAE.csv [2025-09-17T22:46:51.989260] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXS.csv [2025-09-17T22:46:51.989426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONON.csv [2025-09-17T22:46:51.989608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFY.csv [2025-09-17T22:46:51.989846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSN.csv [2025-09-17T22:46:51.990021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TLYS.csv [2025-09-17T22:46:51.990196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBRE.csv [2025-09-17T22:46:51.990353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWO.csv [2025-09-17T22:46:51.990524] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFB.csv [2025-09-17T22:46:51.990697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSA.csv [2025-09-17T22:46:51.990866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDY.csv [2025-09-17T22:46:51.991047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLG.csv [2025-09-17T22:46:51.991305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIA.csv [2025-09-17T22:46:51.991460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNGR.csv [2025-09-17T22:46:51.991597] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNET.csv [2025-09-17T22:46:51.991777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNL.csv [2025-09-17T22:46:51.991934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBND.csv [2025-09-17T22:46:51.992079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTB.csv [2025-09-17T22:46:51.992231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBI.csv [2025-09-17T22:46:51.992401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDJ.csv [2025-09-17T22:46:51.992555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SONY.csv [2025-09-17T22:46:51.992735] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOC.csv [2025-09-17T22:46:51.992904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAC.csv [2025-09-17T22:46:51.993083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PD.csv [2025-09-17T22:46:51.993250] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JXN.csv [2025-09-17T22:46:51.993398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOT.csv [2025-09-17T22:46:51.993572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDI.csv [2025-09-17T22:46:51.993730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABM.csv [2025-09-17T22:46:51.993895] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCUS.csv [2025-09-17T22:46:51.994044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNRC.csv [2025-09-17T22:46:51.994238] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIY.csv [2025-09-17T22:46:51.994390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WIA.csv [2025-09-17T22:46:51.994527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITP.csv [2025-09-17T22:46:51.994769] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DG.csv [2025-09-17T22:46:51.994914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MANU.csv [2025-09-17T22:46:51.995077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHD.csv [2025-09-17T22:46:51.995217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXE.csv [2025-09-17T22:46:51.995404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELME.csv [2025-09-17T22:46:51.995559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XOM.csv [2025-09-17T22:46:51.995912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIPS.csv [2025-09-17T22:46:51.996070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOL.csv [2025-09-17T22:46:51.996231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPO.csv [2025-09-17T22:46:51.996377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GD.csv [2025-09-17T22:46:51.996556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPYP.csv [2025-09-17T22:46:51.996908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRGV.csv [2025-09-17T22:46:51.997089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTF.csv [2025-09-17T22:46:51.997257] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVRI.csv [2025-09-17T22:46:51.997441] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDP.csv [2025-09-17T22:46:51.997598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RERE.csv [2025-09-17T22:46:51.997907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMO.csv [2025-09-17T22:46:51.998111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STNG.csv [2025-09-17T22:46:51.998290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHT.csv [2025-09-17T22:46:51.998443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAC.csv [2025-09-17T22:46:51.998623] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VYX.csv [2025-09-17T22:46:51.998811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NNI.csv [2025-09-17T22:46:51.998974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETO.csv [2025-09-17T22:46:51.999133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCO.csv [2025-09-17T22:46:51.999308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUK.csv [2025-09-17T22:46:51.999458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVS.csv [2025-09-17T22:46:51.999604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JFR.csv [2025-09-17T22:46:51.999780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RELX.csv [2025-09-17T22:46:51.999928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IEX.csv [2025-09-17T22:46:52.000077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MET.csv [2025-09-17T22:46:52.000228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLN.csv [2025-09-17T22:46:52.000389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UBS.csv [2025-09-17T22:46:52.000560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAI.csv [2025-09-17T22:46:52.000753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQNS.csv [2025-09-17T22:46:52.000918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETN.csv [2025-09-17T22:46:52.001082] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVYO.csv [2025-09-17T22:46:52.001258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVR.csv [2025-09-17T22:46:52.001397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMI.csv [2025-09-17T22:46:52.001555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECVT.csv [2025-09-17T22:46:52.001737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VET.csv [2025-09-17T22:46:52.001926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENIC.csv [2025-09-17T22:46:52.002112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBS.csv [2025-09-17T22:46:52.002289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTV.csv [2025-09-17T22:46:52.002483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STM.csv [2025-09-17T22:46:52.002628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CII.csv [2025-09-17T22:46:52.002848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALTG.csv [2025-09-17T22:46:52.002995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOCL.csv [2025-09-17T22:46:52.003155] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBC.csv [2025-09-17T22:46:52.003329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSE.csv [2025-09-17T22:46:52.003686] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAL.csv [2025-09-17T22:46:52.003878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHH.csv [2025-09-17T22:46:52.004014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXC.csv [2025-09-17T22:46:52.004195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUKB.csv [2025-09-17T22:46:52.004360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ED.csv [2025-09-17T22:46:52.004518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JGH.csv [2025-09-17T22:46:52.004750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMT.csv [2025-09-17T22:46:52.004926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RWT.csv [2025-09-17T22:46:52.005091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QGEN.csv [2025-09-17T22:46:52.005243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MC.csv [2025-09-17T22:46:52.005448] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBTA.csv [2025-09-17T22:46:52.005607] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWI.csv [2025-09-17T22:46:52.005913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAO.csv [2025-09-17T22:46:52.006067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UWMC.csv [2025-09-17T22:46:52.006213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFY.csv [2025-09-17T22:46:52.006371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEEV.csv [2025-09-17T22:46:52.006576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOC.csv [2025-09-17T22:46:52.006757] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WES.csv [2025-09-17T22:46:52.006910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JRS.csv [2025-09-17T22:46:52.007080] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIPR.csv [2025-09-17T22:46:52.007226] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMHI.csv [2025-09-17T22:46:52.007376] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDD.csv [2025-09-17T22:46:52.007590] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEM.csv [2025-09-17T22:46:52.007779] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YETI.csv [2025-09-17T22:46:52.007950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/U.csv [2025-09-17T22:46:52.008130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAC.csv [2025-09-17T22:46:52.008290] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KR.csv [2025-09-17T22:46:52.008444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JCE.csv [2025-09-17T22:46:52.008609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNP.csv [2025-09-17T22:46:52.008829] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBP.csv [2025-09-17T22:46:52.008995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEN.csv [2025-09-17T22:46:52.009156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAA.csv [2025-09-17T22:46:52.009300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXRT.csv [2025-09-17T22:46:52.009470] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKD.csv [2025-09-17T22:46:52.009626] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUA.csv [2025-09-17T22:46:52.009872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SO.csv [2025-09-17T22:46:52.010017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JNJ.csv [2025-09-17T22:46:52.010164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGY.csv [2025-09-17T22:46:52.010312] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LH.csv [2025-09-17T22:46:52.010452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGS.csv [2025-09-17T22:46:52.010629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOOT.csv [2025-09-17T22:46:52.010823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHS.csv [2025-09-17T22:46:52.010971] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DNA.csv [2025-09-17T22:46:52.011137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSTM.csv [2025-09-17T22:46:52.011332] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUMP.csv [2025-09-17T22:46:52.011495] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPH.csv [2025-09-17T22:46:52.011664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLX.csv [2025-09-17T22:46:52.011849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGE.csv [2025-09-17T22:46:52.012040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAC.csv [2025-09-17T22:46:52.012199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVO.csv [2025-09-17T22:46:52.012348] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTZ.csv [2025-09-17T22:46:52.012514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENVA.csv [2025-09-17T22:46:52.012720] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAG.csv [2025-09-17T22:46:52.012873] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWF.csv [2025-09-17T22:46:52.013035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYY.csv [2025-09-17T22:46:52.013186] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AP.csv [2025-09-17T22:46:52.013356] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVR.csv [2025-09-17T22:46:52.013501] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFAN.csv [2025-09-17T22:46:52.013695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMN.csv [2025-09-17T22:46:52.013881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZH.csv [2025-09-17T22:46:52.014108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMAI.csv [2025-09-17T22:46:52.014289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMP.csv [2025-09-17T22:46:52.014488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLF.csv [2025-09-17T22:46:52.014667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SD.csv [2025-09-17T22:46:52.014806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKLZ.csv [2025-09-17T22:46:52.014949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FINS.csv [2025-09-17T22:46:52.015085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LANV.csv [2025-09-17T22:46:52.015254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALX.csv [2025-09-17T22:46:52.015404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBN.csv [2025-09-17T22:46:52.015556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFA.csv [2025-09-17T22:46:52.015732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDO.csv [2025-09-17T22:46:52.015883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYN.csv [2025-09-17T22:46:52.016033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKR.csv [2025-09-17T22:46:52.016177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CURB.csv [2025-09-17T22:46:52.016401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HP.csv [2025-09-17T22:46:52.016562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCQ.csv [2025-09-17T22:46:52.016754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPR.csv [2025-09-17T22:46:52.016944] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVT.csv [2025-09-17T22:46:52.017076] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIPJ.csv [2025-09-17T22:46:52.017368] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRIM.csv [2025-09-17T22:46:52.017525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBH.csv [2025-09-17T22:46:52.017845] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWK.csv [2025-09-17T22:46:52.018010] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PGP.csv [2025-09-17T22:46:52.018170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYAM.csv [2025-09-17T22:46:52.018326] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHC.csv [2025-09-17T22:46:52.018492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTI.csv [2025-09-17T22:46:52.018681] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOLE.csv [2025-09-17T22:46:52.018840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHD.csv [2025-09-17T22:46:52.018985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMCM.csv [2025-09-17T22:46:52.019130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMO.csv [2025-09-17T22:46:52.019275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WWW.csv [2025-09-17T22:46:52.019450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AI.csv [2025-09-17T22:46:52.019730] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIO.csv [2025-09-17T22:46:52.019925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFP.csv [2025-09-17T22:46:52.020078] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USFD.csv [2025-09-17T22:46:52.020289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOV.csv [2025-09-17T22:46:52.020473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVO.csv [2025-09-17T22:46:52.020613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDP.csv [2025-09-17T22:46:52.020818] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSDL.csv [2025-09-17T22:46:52.020983] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIGS.csv [2025-09-17T22:46:52.021115] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MG.csv [2025-09-17T22:46:52.021263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ODC.csv [2025-09-17T22:46:52.021405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOBY.csv [2025-09-17T22:46:52.021574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKR.csv [2025-09-17T22:46:52.021770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONL.csv [2025-09-17T22:46:52.021934] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRI.csv [2025-09-17T22:46:52.022089] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSL.csv [2025-09-17T22:46:52.022275] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGSF.csv [2025-09-17T22:46:52.022432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TNK.csv [2025-09-17T22:46:52.022575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/M.csv [2025-09-17T22:46:52.022748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCS.csv [2025-09-17T22:46:52.022909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGX.csv [2025-09-17T22:46:52.023097] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIST.csv [2025-09-17T22:46:52.023263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMAX.csv [2025-09-17T22:46:52.023412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDC.csv [2025-09-17T22:46:52.023569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STE.csv [2025-09-17T22:46:52.023763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUPV.csv [2025-09-17T22:46:52.023912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAF.csv [2025-09-17T22:46:52.024087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAP.csv [2025-09-17T22:46:52.024248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPR.csv [2025-09-17T22:46:52.024390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AYI.csv [2025-09-17T22:46:52.024542] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LU.csv [2025-09-17T22:46:52.024857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPQ.csv [2025-09-17T22:46:52.025015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALV.csv [2025-09-17T22:46:52.025171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAXS.csv [2025-09-17T22:46:52.025317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMT.csv [2025-09-17T22:46:52.025481] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEF.csv [2025-09-17T22:46:52.025617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVL.csv [2025-09-17T22:46:52.025861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMBP.csv [2025-09-17T22:46:52.026026] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHT.csv [2025-09-17T22:46:52.026193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGD.csv [2025-09-17T22:46:52.026352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LITB.csv [2025-09-17T22:46:52.026498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUN.csv [2025-09-17T22:46:52.026674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSKD.csv [2025-09-17T22:46:52.026874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UL.csv [2025-09-17T22:46:52.027021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXG.csv [2025-09-17T22:46:52.027158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATV.csv [2025-09-17T22:46:52.027311] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOUR.csv [2025-09-17T22:46:52.027469] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAZ.csv [2025-09-17T22:46:52.027631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AB.csv [2025-09-17T22:46:52.027824] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBI.csv [2025-09-17T22:46:52.027977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUL.csv [2025-09-17T22:46:52.028137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLS.csv [2025-09-17T22:46:52.028316] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELP.csv [2025-09-17T22:46:52.028486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DQ.csv [2025-09-17T22:46:52.028680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMG.csv [2025-09-17T22:46:52.028862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHG.csv [2025-09-17T22:46:52.029036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPNG.csv [2025-09-17T22:46:52.029397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NDMO.csv [2025-09-17T22:46:52.029560] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AZO.csv [2025-09-17T22:46:52.029737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COOK.csv [2025-09-17T22:46:52.029890] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHR.csv [2025-09-17T22:46:52.030049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUMC.csv [2025-09-17T22:46:52.030208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSBD.csv [2025-09-17T22:46:52.030362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOC.csv [2025-09-17T22:46:52.030564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKO.csv [2025-09-17T22:46:52.030759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSC.csv [2025-09-17T22:46:52.030909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGHC.csv [2025-09-17T22:46:52.031071] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTW.csv [2025-09-17T22:46:52.031265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMK.csv [2025-09-17T22:46:52.031399] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SID.csv [2025-09-17T22:46:52.031545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFPM.csv [2025-09-17T22:46:52.031702] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPIR.csv [2025-09-17T22:46:52.031853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOF.csv [2025-09-17T22:46:52.032049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GYLD.csv [2025-09-17T22:46:52.032196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NYT.csv [2025-09-17T22:46:52.032322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMM.csv [2025-09-17T22:46:52.032452] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMP.csv [2025-09-17T22:46:52.032608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DPG.csv [2025-09-17T22:46:52.032784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMO.csv [2025-09-17T22:46:52.032970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HE.csv [2025-09-17T22:46:52.033127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBW.csv [2025-09-17T22:46:52.033282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTRN.csv [2025-09-17T22:46:52.033418] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WKC.csv [2025-09-17T22:46:52.033591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOS.csv [2025-09-17T22:46:52.033912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOF.csv [2025-09-17T22:46:52.034064] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETR.csv [2025-09-17T22:46:52.034270] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMT.csv [2025-09-17T22:46:52.034433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZVIA.csv [2025-09-17T22:46:52.034603] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEVA.csv [2025-09-17T22:46:52.034785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOMD.csv [2025-09-17T22:46:52.034947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CL.csv [2025-09-17T22:46:52.035083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNF.csv [2025-09-17T22:46:52.035274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRW.csv [2025-09-17T22:46:52.035425] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SST.csv [2025-09-17T22:46:52.035566] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VNCE.csv [2025-09-17T22:46:52.035850] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNS.csv [2025-09-17T22:46:52.036003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SUZ.csv [2025-09-17T22:46:52.036144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGV.csv [2025-09-17T22:46:52.036272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WT.csv [2025-09-17T22:46:52.036414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBI.csv [2025-09-17T22:46:52.036564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELAN.csv [2025-09-17T22:46:52.036767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCAT.csv [2025-09-17T22:46:52.036918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMS.csv [2025-09-17T22:46:52.037059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KOP.csv [2025-09-17T22:46:52.037224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CX.csv [2025-09-17T22:46:52.037365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KO.csv [2025-09-17T22:46:52.037530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WRB.csv [2025-09-17T22:46:52.037693] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTB.csv [2025-09-17T22:46:52.037843] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RH.csv [2025-09-17T22:46:52.038063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BROS.csv [2025-09-17T22:46:52.038204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PNNT.csv [2025-09-17T22:46:52.038360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSN.csv [2025-09-17T22:46:52.038514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXT.csv [2025-09-17T22:46:52.038694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTES.csv [2025-09-17T22:46:52.038848] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPRK.csv [2025-09-17T22:46:52.038994] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVF.csv [2025-09-17T22:46:52.039146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMN.csv [2025-09-17T22:46:52.039329] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OTIS.csv [2025-09-17T22:46:52.039486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCO.csv [2025-09-17T22:46:52.039663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZTS.csv [2025-09-17T22:46:52.039844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRD.csv [2025-09-17T22:46:52.040002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRC.csv [2025-09-17T22:46:52.040162] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFR.csv [2025-09-17T22:46:52.040338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BURL.csv [2025-09-17T22:46:52.040530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTD.csv [2025-09-17T22:46:52.040751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHG.csv [2025-09-17T22:46:52.040902] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LLY.csv [2025-09-17T22:46:52.041045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CALX.csv [2025-09-17T22:46:52.041187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DVN.csv [2025-09-17T22:46:52.041340] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIW.csv [2025-09-17T22:46:52.041498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCO.csv [2025-09-17T22:46:52.041791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SREA.csv [2025-09-17T22:46:52.041941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDG.csv [2025-09-17T22:46:52.042067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBR.csv [2025-09-17T22:46:52.042193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEA.csv [2025-09-17T22:46:52.042337] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSR.csv [2025-09-17T22:46:52.042460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VMC.csv [2025-09-17T22:46:52.042596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXV.csv [2025-09-17T22:46:52.042775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLOB.csv [2025-09-17T22:46:52.043092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMG.csv [2025-09-17T22:46:52.043231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVA.csv [2025-09-17T22:46:52.043395] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YMM.csv [2025-09-17T22:46:52.043535] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YALA.csv [2025-09-17T22:46:52.043713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IP.csv [2025-09-17T22:46:52.043917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVY.csv [2025-09-17T22:46:52.044058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEXA.csv [2025-09-17T22:46:52.044215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TMHC.csv [2025-09-17T22:46:52.044371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPC.csv [2025-09-17T22:46:52.044518] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/K.csv [2025-09-17T22:46:52.044715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HDB.csv [2025-09-17T22:46:52.044869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAFE.csv [2025-09-17T22:46:52.045025] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATHM.csv [2025-09-17T22:46:52.045177] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QTWO.csv [2025-09-17T22:46:52.045327] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOK.csv [2025-09-17T22:46:52.045487] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPCE.csv [2025-09-17T22:46:52.045627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOAR.csv [2025-09-17T22:46:52.045831] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPF.csv [2025-09-17T22:46:52.046016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLIO.csv [2025-09-17T22:46:52.046195] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDR.csv [2025-09-17T22:46:52.046342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMX.csv [2025-09-17T22:46:52.046502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTO.csv [2025-09-17T22:46:52.046674] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTO.csv [2025-09-17T22:46:52.046814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOA.csv [2025-09-17T22:46:52.046967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JLS.csv [2025-09-17T22:46:52.047130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ERJ.csv [2025-09-17T22:46:52.047283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WNC.csv [2025-09-17T22:46:52.047412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPLX.csv [2025-09-17T22:46:52.047543] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PX.csv [2025-09-17T22:46:52.047719] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MED.csv [2025-09-17T22:46:52.047892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPE.csv [2025-09-17T22:46:52.048050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIK.csv [2025-09-17T22:46:52.048214] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGR.csv [2025-09-17T22:46:52.048352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFWM.csv [2025-09-17T22:46:52.048496] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPF.csv [2025-09-17T22:46:52.048806] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSI.csv [2025-09-17T22:46:52.048957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MDU.csv [2025-09-17T22:46:52.049117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTMX.csv [2025-09-17T22:46:52.049263] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBM.csv [2025-09-17T22:46:52.049407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUR.csv [2025-09-17T22:46:52.049546] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECG.csv [2025-09-17T22:46:52.049776] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EFT.csv [2025-09-17T22:46:52.049917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CANG.csv [2025-09-17T22:46:52.050101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTI.csv [2025-09-17T22:46:52.050255] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UIS.csv [2025-09-17T22:46:52.050409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RC.csv [2025-09-17T22:46:52.050569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/C.csv [2025-09-17T22:46:52.050750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LII.csv [2025-09-17T22:46:52.050900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INVH.csv [2025-09-17T22:46:52.051063] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPRT.csv [2025-09-17T22:46:52.051217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GCI.csv [2025-09-17T22:46:52.051367] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIO.csv [2025-09-17T22:46:52.051497] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOTE.csv [2025-09-17T22:46:52.051663] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SABA.csv [2025-09-17T22:46:52.051867] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSH.csv [2025-09-17T22:46:52.052027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCOR.csv [2025-09-17T22:46:52.052182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVK.csv [2025-09-17T22:46:52.052426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHLD.csv [2025-09-17T22:46:52.052581] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESE.csv [2025-09-17T22:46:52.052760] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GF.csv [2025-09-17T22:46:52.052908] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GE.csv [2025-09-17T22:46:52.053056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSI.csv [2025-09-17T22:46:52.053204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEN.csv [2025-09-17T22:46:52.053364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGV.csv [2025-09-17T22:46:52.053536] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KGC.csv [2025-09-17T22:46:52.053708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FT.csv [2025-09-17T22:46:52.053860] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQY.csv [2025-09-17T22:46:52.054023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOOS.csv [2025-09-17T22:46:52.054213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNMA.csv [2025-09-17T22:46:52.054365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSAC.csv [2025-09-17T22:46:52.054504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIP.csv [2025-09-17T22:46:52.054704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EB.csv [2025-09-17T22:46:52.054852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKIL.csv [2025-09-17T22:46:52.055000] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSM.csv [2025-09-17T22:46:52.055165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFH.csv [2025-09-17T22:46:52.055294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIV.csv [2025-09-17T22:46:52.055484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTOL.csv [2025-09-17T22:46:52.055619] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATMU.csv [2025-09-17T22:46:52.055795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AXL.csv [2025-09-17T22:46:52.056031] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLI.csv [2025-09-17T22:46:52.056188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUC.csv [2025-09-17T22:46:52.056455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEE.csv [2025-09-17T22:46:52.056634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENS.csv [2025-09-17T22:46:52.056836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AA.csv [2025-09-17T22:46:52.056965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWRE.csv [2025-09-17T22:46:52.057067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFL.csv [2025-09-17T22:46:52.057191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WINN.csv [2025-09-17T22:46:52.057333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UE.csv [2025-09-17T22:46:52.057468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PEB.csv [2025-09-17T22:46:52.057629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEL.csv [2025-09-17T22:46:52.057876] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QS.csv [2025-09-17T22:46:52.058017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHI.csv [2025-09-17T22:46:52.058156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGM.csv [2025-09-17T22:46:52.058320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTD.csv [2025-09-17T22:46:52.058472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASX.csv [2025-09-17T22:46:52.058609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOLF.csv [2025-09-17T22:46:52.058773] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWH.csv [2025-09-17T22:46:52.058915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVST.csv [2025-09-17T22:46:52.059044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LCII.csv [2025-09-17T22:46:52.059187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOS.csv [2025-09-17T22:46:52.059330] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNOP.csv [2025-09-17T22:46:52.059509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIM.csv [2025-09-17T22:46:52.059664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBC.csv [2025-09-17T22:46:52.059814] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLF.csv [2025-09-17T22:46:52.059964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMI.csv [2025-09-17T22:46:52.060100] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAIN.csv [2025-09-17T22:46:52.060248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAK.csv [2025-09-17T22:46:52.060391] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLG.csv [2025-09-17T22:46:52.060565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEAF.csv [2025-09-17T22:46:52.060789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSM.csv [2025-09-17T22:46:52.060921] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVR.csv [2025-09-17T22:46:52.061041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EME.csv [2025-09-17T22:46:52.061205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELS.csv [2025-09-17T22:46:52.061355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WH.csv [2025-09-17T22:46:52.061638] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPV.csv [2025-09-17T22:46:52.061822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGNA.csv [2025-09-17T22:46:52.061969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CC.csv [2025-09-17T22:46:52.062128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAM.csv [2025-09-17T22:46:52.062283] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFH.csv [2025-09-17T22:46:52.062444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAY.csv [2025-09-17T22:46:52.062673] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMWB.csv [2025-09-17T22:46:52.062804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBF.csv [2025-09-17T22:46:52.062920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOUS.csv [2025-09-17T22:46:52.063051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRO.csv [2025-09-17T22:46:52.063202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOG.csv [2025-09-17T22:46:52.063375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHIN.csv [2025-09-17T22:46:52.063527] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPL.csv [2025-09-17T22:46:52.063695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDN.csv [2025-09-17T22:46:52.063835] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOTU.csv [2025-09-17T22:46:52.063980] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAD.csv [2025-09-17T22:46:52.064139] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYD.csv [2025-09-17T22:46:52.064345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSTZ.csv [2025-09-17T22:46:52.064499] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOX.csv [2025-09-17T22:46:52.064685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEW.csv [2025-09-17T22:46:52.064853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIN.csv [2025-09-17T22:46:52.064995] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOF.csv [2025-09-17T22:46:52.065142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OMC.csv [2025-09-17T22:46:52.065301] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THR.csv [2025-09-17T22:46:52.065449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NE.csv [2025-09-17T22:46:52.065577] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WHR.csv [2025-09-17T22:46:52.065808] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DSX.csv [2025-09-17T22:46:52.065961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTG.csv [2025-09-17T22:46:52.066085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCM.csv [2025-09-17T22:46:52.066217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AM.csv [2025-09-17T22:46:52.066365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEG.csv [2025-09-17T22:46:52.066534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASA.csv [2025-09-17T22:46:52.066703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNSO.csv [2025-09-17T22:46:52.066888] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLI.csv [2025-09-17T22:46:52.067055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARW.csv [2025-09-17T22:46:52.067217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHM.csv [2025-09-17T22:46:52.067389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EW.csv [2025-09-17T22:46:52.067534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPWR.csv [2025-09-17T22:46:52.067688] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FGN.csv [2025-09-17T22:46:52.067841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTO.csv [2025-09-17T22:46:52.068117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PH.csv [2025-09-17T22:46:52.068274] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APOS.csv [2025-09-17T22:46:52.068414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CWEN.csv [2025-09-17T22:46:52.068563] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWLO.csv [2025-09-17T22:46:52.068785] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRNO.csv [2025-09-17T22:46:52.068943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSO.csv [2025-09-17T22:46:52.069083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBT.csv [2025-09-17T22:46:52.069215] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UDR.csv [2025-09-17T22:46:52.069343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETG.csv [2025-09-17T22:46:52.069492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTGC.csv [2025-09-17T22:46:52.069635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAAP.csv [2025-09-17T22:46:52.069893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSL.csv [2025-09-17T22:46:52.070046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ISD.csv [2025-09-17T22:46:52.070202] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THG.csv [2025-09-17T22:46:52.070360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETB.csv [2025-09-17T22:46:52.070506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AROC.csv [2025-09-17T22:46:52.070672] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNK.csv [2025-09-17T22:46:52.070812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOV.csv [2025-09-17T22:46:52.070953] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRE.csv [2025-09-17T22:46:52.071092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RYI.csv [2025-09-17T22:46:52.071246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FE.csv [2025-09-17T22:46:52.071385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXK.csv [2025-09-17T22:46:52.071510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDY.csv [2025-09-17T22:46:52.071695] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IFF.csv [2025-09-17T22:46:52.071854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGM.csv [2025-09-17T22:46:52.072016] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTI.csv [2025-09-17T22:46:52.072153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMP.csv [2025-09-17T22:46:52.072280] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRG.csv [2025-09-17T22:46:52.072426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCS.csv [2025-09-17T22:46:52.072574] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCS.csv [2025-09-17T22:46:52.072749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAM.csv [2025-09-17T22:46:52.072894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCC.csv [2025-09-17T22:46:52.073044] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNT.csv [2025-09-17T22:46:52.073204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COF.csv [2025-09-17T22:46:52.073353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VIV.csv [2025-09-17T22:46:52.073504] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNH.csv [2025-09-17T22:46:52.073699] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXM.csv [2025-09-17T22:46:52.073868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRL.csv [2025-09-17T22:46:52.074021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGT.csv [2025-09-17T22:46:52.074200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CACI.csv [2025-09-17T22:46:52.074349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJM.csv [2025-09-17T22:46:52.074514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SN.csv [2025-09-17T22:46:52.074788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PERF.csv [2025-09-17T22:46:52.074936] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DV.csv [2025-09-17T22:46:52.075104] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGC.csv [2025-09-17T22:46:52.075243] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPCT.csv [2025-09-17T22:46:52.075397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHAK.csv [2025-09-17T22:46:52.075556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALSN.csv [2025-09-17T22:46:52.075718] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UPS.csv [2025-09-17T22:46:52.075875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNC.csv [2025-09-17T22:46:52.076034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IQV.csv [2025-09-17T22:46:52.076172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESI.csv [2025-09-17T22:46:52.076294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCJ.csv [2025-09-17T22:46:52.076390] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TG.csv [2025-09-17T22:46:52.076526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSM.csv [2025-09-17T22:46:52.076708] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDH.csv [2025-09-17T22:46:52.076849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBNA.csv [2025-09-17T22:46:52.076999] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REXR.csv [2025-09-17T22:46:52.077138] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RKT.csv [2025-09-17T22:46:52.077300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/G.csv [2025-09-17T22:46:52.077429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VCV.csv [2025-09-17T22:46:52.077575] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESNT.csv [2025-09-17T22:46:52.077791] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNH.csv [2025-09-17T22:46:52.077984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOE.csv [2025-09-17T22:46:52.078148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRNT.csv [2025-09-17T22:46:52.078300] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETW.csv [2025-09-17T22:46:52.078455] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSW.csv [2025-09-17T22:46:52.078710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATS.csv [2025-09-17T22:46:52.078852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGY.csv [2025-09-17T22:46:52.079007] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VEL.csv [2025-09-17T22:46:52.079160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KT.csv [2025-09-17T22:46:52.079308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GS.csv [2025-09-17T22:46:52.079468] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARS.csv [2025-09-17T22:46:52.079624] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEO.csv [2025-09-17T22:46:52.079811] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPG.csv [2025-09-17T22:46:52.079965] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPC.csv [2025-09-17T22:46:52.080117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LFT.csv [2025-09-17T22:46:52.080273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPI.csv [2025-09-17T22:46:52.080449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPJA.csv [2025-09-17T22:46:52.080613] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKU.csv [2025-09-17T22:46:52.080841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIIN.csv [2025-09-17T22:46:52.081014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAC.csv [2025-09-17T22:46:52.081169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTE.csv [2025-09-17T22:46:52.081299] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TK.csv [2025-09-17T22:46:52.081433] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQH.csv [2025-09-17T22:46:52.081602] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEO.csv [2025-09-17T22:46:52.081775] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RHP.csv [2025-09-17T22:46:52.081925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLP.csv [2025-09-17T22:46:52.082081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBH.csv [2025-09-17T22:46:52.082232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USAC.csv [2025-09-17T22:46:52.082383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BYM.csv [2025-09-17T22:46:52.082538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLT.csv [2025-09-17T22:46:52.082815] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDT.csv [2025-09-17T22:46:52.082967] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSM.csv [2025-09-17T22:46:52.083123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDO.csv [2025-09-17T22:46:52.083281] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLY.csv [2025-09-17T22:46:52.083443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAVA.csv [2025-09-17T22:46:52.083589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KBR.csv [2025-09-17T22:46:52.083765] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOG.csv [2025-09-17T22:46:52.083922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZKH.csv [2025-09-17T22:46:52.084070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/T.csv [2025-09-17T22:46:52.084240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RSG.csv [2025-09-17T22:46:52.084400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OBK.csv [2025-09-17T22:46:52.084556] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HZO.csv [2025-09-17T22:46:52.084748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STRV.csv [2025-09-17T22:46:52.084930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLX.csv [2025-09-17T22:46:52.085057] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FXED.csv [2025-09-17T22:46:52.085209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THQ.csv [2025-09-17T22:46:52.085378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCU.csv [2025-09-17T22:46:52.085528] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWH.csv [2025-09-17T22:46:52.085984] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMR.csv [2025-09-17T22:46:52.086170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOUG.csv [2025-09-17T22:46:52.086318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEGI.csv [2025-09-17T22:46:52.086493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMND.csv [2025-09-17T22:46:52.086635] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LNN.csv [2025-09-17T22:46:52.086807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DHI.csv [2025-09-17T22:46:52.086987] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMG.csv [2025-09-17T22:46:52.087161] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PML.csv [2025-09-17T22:46:52.087355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIG.csv [2025-09-17T22:46:52.087519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OUT.csv [2025-09-17T22:46:52.087685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUE.csv [2025-09-17T22:46:52.087833] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCCO.csv [2025-09-17T22:46:52.087988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FFC.csv [2025-09-17T22:46:52.088151] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPK.csv [2025-09-17T22:46:52.088314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEX.csv [2025-09-17T22:46:52.088492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASB.csv [2025-09-17T22:46:52.088697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTA.csv [2025-09-17T22:46:52.089053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMC.csv [2025-09-17T22:46:52.089187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RGA.csv [2025-09-17T22:46:52.089294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SES.csv [2025-09-17T22:46:52.089422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVAL.csv [2025-09-17T22:46:52.089572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGS.csv [2025-09-17T22:46:52.089749] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFL.csv [2025-09-17T22:46:52.089900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWX.csv [2025-09-17T22:46:52.090035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSBD.csv [2025-09-17T22:46:52.090252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXE.csv [2025-09-17T22:46:52.090394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEP.csv [2025-09-17T22:46:52.090534] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LDOS.csv [2025-09-17T22:46:52.090713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFMZ.csv [2025-09-17T22:46:52.090868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EC.csv [2025-09-17T22:46:52.091029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LPX.csv [2025-09-17T22:46:52.091199] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOBO.csv [2025-09-17T22:46:52.091342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POR.csv [2025-09-17T22:46:52.091477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEC.csv [2025-09-17T22:46:52.091621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CI.csv [2025-09-17T22:46:52.091805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VOYA.csv [2025-09-17T22:46:52.091961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEU.csv [2025-09-17T22:46:52.092102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NFG.csv [2025-09-17T22:46:52.092269] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENR.csv [2025-09-17T22:46:52.092400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMX.csv [2025-09-17T22:46:52.092507] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VST.csv [2025-09-17T22:46:52.092617] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRO.csv [2025-09-17T22:46:52.092823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZK.csv [2025-09-17T22:46:52.092963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNFI.csv [2025-09-17T22:46:52.093114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/E.csv [2025-09-17T22:46:52.093249] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NET.csv [2025-09-17T22:46:52.093384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRC.csv [2025-09-17T22:46:52.093553] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBWI.csv [2025-09-17T22:46:52.093800] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TR.csv [2025-09-17T22:46:52.093966] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RM.csv [2025-09-17T22:46:52.094130] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGER.csv [2025-09-17T22:46:52.094282] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEL.csv [2025-09-17T22:46:52.094421] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEX.csv [2025-09-17T22:46:52.094564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKT.csv [2025-09-17T22:46:52.094724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARMK.csv [2025-09-17T22:46:52.094875] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPE.csv [2025-09-17T22:46:52.095101] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SGU.csv [2025-09-17T22:46:52.095230] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTUS.csv [2025-09-17T22:46:52.095359] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWLT.csv [2025-09-17T22:46:52.095510] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARE.csv [2025-09-17T22:46:52.095677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AFGB.csv [2025-09-17T22:46:52.095837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXMX.csv [2025-09-17T22:46:52.095986] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTTR.csv [2025-09-17T22:46:52.096148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAN.csv [2025-09-17T22:46:52.096315] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOW.csv [2025-09-17T22:46:52.096477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFRC.csv [2025-09-17T22:46:52.096629] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSF.csv [2025-09-17T22:46:52.096841] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GME.csv [2025-09-17T22:46:52.097028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCC.csv [2025-09-17T22:46:52.097183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGB.csv [2025-09-17T22:46:52.097346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGI.csv [2025-09-17T22:46:52.097486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UCB.csv [2025-09-17T22:46:52.097608] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLT.csv [2025-09-17T22:46:52.097759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MGRE.csv [2025-09-17T22:46:52.097886] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMI.csv [2025-09-17T22:46:52.098004] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USPH.csv [2025-09-17T22:46:52.098154] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTC.csv [2025-09-17T22:46:52.098317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKS.csv [2025-09-17T22:46:52.098440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUI.csv [2025-09-17T22:46:52.098571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFH.csv [2025-09-17T22:46:52.098715] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETX.csv [2025-09-17T22:46:52.098861] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IRT.csv [2025-09-17T22:46:52.099023] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACN.csv [2025-09-17T22:46:52.099175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVTY.csv [2025-09-17T22:46:52.099343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPJ.csv [2025-09-17T22:46:52.099493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHD.csv [2025-09-17T22:46:52.099772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KD.csv [2025-09-17T22:46:52.099907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNJ.csv [2025-09-17T22:46:52.100029] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOLF.csv [2025-09-17T22:46:52.100129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPGI.csv [2025-09-17T22:46:52.100227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NATL.csv [2025-09-17T22:46:52.100362] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBSW.csv [2025-09-17T22:46:52.100491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SITE.csv [2025-09-17T22:46:52.100684] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AG.csv [2025-09-17T22:46:52.100844] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAH.csv [2025-09-17T22:46:52.101005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRG.csv [2025-09-17T22:46:52.101194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEO.csv [2025-09-17T22:46:52.101345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KIO.csv [2025-09-17T22:46:52.101488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KN.csv [2025-09-17T22:46:52.101820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COHR.csv [2025-09-17T22:46:52.101981] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCT.csv [2025-09-17T22:46:52.102142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRC.csv [2025-09-17T22:46:52.102304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GATX.csv [2025-09-17T22:46:52.102434] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJC.csv [2025-09-17T22:46:52.102564] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEC.csv [2025-09-17T22:46:52.102740] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PARR.csv [2025-09-17T22:46:52.102883] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HD.csv [2025-09-17T22:46:52.103037] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAN.csv [2025-09-17T22:46:52.103170] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WGO.csv [2025-09-17T22:46:52.103309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CARR.csv [2025-09-17T22:46:52.103450] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHX.csv [2025-09-17T22:46:52.103612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GKOS.csv [2025-09-17T22:46:52.103788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QVCD.csv [2025-09-17T22:46:52.103935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKE.csv [2025-09-17T22:46:52.104065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSD.csv [2025-09-17T22:46:52.104210] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MMD.csv [2025-09-17T22:46:52.104360] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICL.csv [2025-09-17T22:46:52.104529] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSR.csv [2025-09-17T22:46:52.104710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MQT.csv [2025-09-17T22:46:52.105041] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTR.csv [2025-09-17T22:46:52.105191] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INGM.csv [2025-09-17T22:46:52.105335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCO.csv [2025-09-17T22:46:52.105512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GLW.csv [2025-09-17T22:46:52.105704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MITT.csv [2025-09-17T22:46:52.105849] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQT.csv [2025-09-17T22:46:52.106014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALE.csv [2025-09-17T22:46:52.106160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBI.csv [2025-09-17T22:46:52.106317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIE.csv [2025-09-17T22:46:52.106494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPS.csv [2025-09-17T22:46:52.106670] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LB.csv [2025-09-17T22:46:52.106840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPL.csv [2025-09-17T22:46:52.106982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNSL.csv [2025-09-17T22:46:52.107144] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STVN.csv [2025-09-17T22:46:52.107293] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CON.csv [2025-09-17T22:46:52.107443] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WAL.csv [2025-09-17T22:46:52.107600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROK.csv [2025-09-17T22:46:52.107759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTA.csv [2025-09-17T22:46:52.107904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LND.csv [2025-09-17T22:46:52.108028] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFF.csv [2025-09-17T22:46:52.108169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMTG.csv [2025-09-17T22:46:52.108317] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JILL.csv [2025-09-17T22:46:52.108489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRU.csv [2025-09-17T22:46:52.108707] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SB.csv [2025-09-17T22:46:52.108865] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RF.csv [2025-09-17T22:46:52.109002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JMIA.csv [2025-09-17T22:46:52.109133] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIC.csv [2025-09-17T22:46:52.109252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMC.csv [2025-09-17T22:46:52.109408] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONIT.csv [2025-09-17T22:46:52.109555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TGS.csv [2025-09-17T22:46:52.109862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TU.csv [2025-09-17T22:46:52.110013] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIO.csv [2025-09-17T22:46:52.110160] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IGI.csv [2025-09-17T22:46:52.110302] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASPN.csv [2025-09-17T22:46:52.110437] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWG.csv [2025-09-17T22:46:52.110582] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RJF.csv [2025-09-17T22:46:52.110754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRI.csv [2025-09-17T22:46:52.110906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMY.csv [2025-09-17T22:46:52.111055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TV.csv [2025-09-17T22:46:52.111338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBB.csv [2025-09-17T22:46:52.111494] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNDA.csv [2025-09-17T22:46:52.111691] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCK.csv [2025-09-17T22:46:52.111857] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAH.csv [2025-09-17T22:46:52.112132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HL.csv [2025-09-17T22:46:52.112278] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FND.csv [2025-09-17T22:46:52.112422] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRT.csv [2025-09-17T22:46:52.112552] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TISI.csv [2025-09-17T22:46:52.112716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SRFM.csv [2025-09-17T22:46:52.112894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMO.csv [2025-09-17T22:46:52.113058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCN.csv [2025-09-17T22:46:52.113206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKST.csv [2025-09-17T22:46:52.113365] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMH.csv [2025-09-17T22:46:52.113506] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KNTK.csv [2025-09-17T22:46:52.113678] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATI.csv [2025-09-17T22:46:52.113832] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STT.csv [2025-09-17T22:46:52.114036] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPC.csv [2025-09-17T22:46:52.114201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNM.csv [2025-09-17T22:46:52.114354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDA.csv [2025-09-17T22:46:52.114503] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNI.csv [2025-09-17T22:46:52.114666] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETD.csv [2025-09-17T22:46:52.114813] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHK.csv [2025-09-17T22:46:52.114975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEI.csv [2025-09-17T22:46:52.115132] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SE.csv [2025-09-17T22:46:52.115272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMS.csv [2025-09-17T22:46:52.115409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TALO.csv [2025-09-17T22:46:52.115539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LMT.csv [2025-09-17T22:46:52.115714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDLR.csv [2025-09-17T22:46:52.115855] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TKC.csv [2025-09-17T22:46:52.116055] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRSP.csv [2025-09-17T22:46:52.116223] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKYH.csv [2025-09-17T22:46:52.116366] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MXF.csv [2025-09-17T22:46:52.116530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIHL.csv [2025-09-17T22:46:52.116738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DKL.csv [2025-09-17T22:46:52.116894] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVT.csv [2025-09-17T22:46:52.117054] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHR.csv [2025-09-17T22:46:52.117196] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDF.csv [2025-09-17T22:46:52.117322] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZIP.csv [2025-09-17T22:46:52.117444] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAAS.csv [2025-09-17T22:46:52.117568] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHCO.csv [2025-09-17T22:46:52.117809] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HY.csv [2025-09-17T22:46:52.117947] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGS.csv [2025-09-17T22:46:52.118114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TOST.csv [2025-09-17T22:46:52.118354] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOND.csv [2025-09-17T22:46:52.118478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPG.csv [2025-09-17T22:46:52.118631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AON.csv [2025-09-17T22:46:52.118795] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXW.csv [2025-09-17T22:46:52.118917] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLOP.csv [2025-09-17T22:46:52.119014] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JPI.csv [2025-09-17T22:46:52.119143] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RDW.csv [2025-09-17T22:46:52.119306] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KSS.csv [2025-09-17T22:46:52.119428] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEF.csv [2025-09-17T22:46:52.119544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DEC.csv [2025-09-17T22:46:52.119710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NQP.csv [2025-09-17T22:46:52.119869] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNV.csv [2025-09-17T22:46:52.120019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBY.csv [2025-09-17T22:46:52.120166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VRE.csv [2025-09-17T22:46:52.120345] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTM.csv [2025-09-17T22:46:52.120498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBA.csv [2025-09-17T22:46:52.120671] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LBRT.csv [2025-09-17T22:46:52.120825] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGT.csv [2025-09-17T22:46:52.121021] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAK.csv [2025-09-17T22:46:52.121171] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMI.csv [2025-09-17T22:46:52.121341] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDX.csv [2025-09-17T22:46:52.121467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VHI.csv [2025-09-17T22:46:52.121571] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNOW.csv [2025-09-17T22:46:52.121881] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FI.csv [2025-09-17T22:46:52.122034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YOU.csv [2025-09-17T22:46:52.122179] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EHAB.csv [2025-09-17T22:46:52.122333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ONTF.csv [2025-09-17T22:46:52.122483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBAR.csv [2025-09-17T22:46:52.122620] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNTY.csv [2025-09-17T22:46:52.122772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENOV.csv [2025-09-17T22:46:52.122870] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KORE.csv [2025-09-17T22:46:52.122982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBS.csv [2025-09-17T22:46:52.123135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVV.csv [2025-09-17T22:46:52.123273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSFE.csv [2025-09-17T22:46:52.123407] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TEN.csv [2025-09-17T22:46:52.123562] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YEXT.csv [2025-09-17T22:46:52.123742] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HNI.csv [2025-09-17T22:46:52.123928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KMI.csv [2025-09-17T22:46:52.124088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHCT.csv [2025-09-17T22:46:52.124262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KTB.csv [2025-09-17T22:46:52.124394] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IIF.csv [2025-09-17T22:46:52.124525] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUB.csv [2025-09-17T22:46:52.124680] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVEX.csv [2025-09-17T22:46:52.124863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACVA.csv [2025-09-17T22:46:52.125002] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PACS.csv [2025-09-17T22:46:52.125168] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAN.csv [2025-09-17T22:46:52.125309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMMZ.csv [2025-09-17T22:46:52.125473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINE.csv [2025-09-17T22:46:52.125622] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GXO.csv [2025-09-17T22:46:52.125915] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMF.csv [2025-09-17T22:46:52.126035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STXD.csv [2025-09-17T22:46:52.126208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BA.csv [2025-09-17T22:46:52.126342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YUM.csv [2025-09-17T22:46:52.126478] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLN.csv [2025-09-17T22:46:52.126628] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SQM.csv [2025-09-17T22:46:52.126807] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FIX.csv [2025-09-17T22:46:52.126963] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PINS.csv [2025-09-17T22:46:52.127111] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLNG.csv [2025-09-17T22:46:52.127254] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLY.csv [2025-09-17T22:46:52.127396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PII.csv [2025-09-17T22:46:52.127555] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFL.csv [2025-09-17T22:46:52.127710] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOS.csv [2025-09-17T22:46:52.127837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNX.csv [2025-09-17T22:46:52.127942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSLY.csv [2025-09-17T22:46:52.128070] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GWW.csv [2025-09-17T22:46:52.128228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVG.csv [2025-09-17T22:46:52.128358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNA.csv [2025-09-17T22:46:52.128473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XFLT.csv [2025-09-17T22:46:52.128610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DUK.csv [2025-09-17T22:46:52.128816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIB.csv [2025-09-17T22:46:52.128969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HTH.csv [2025-09-17T22:46:52.129129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAL.csv [2025-09-17T22:46:52.129284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/USNA.csv [2025-09-17T22:46:52.129447] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRV.csv [2025-09-17T22:46:52.129585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYK.csv [2025-09-17T22:46:52.129752] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RNP.csv [2025-09-17T22:46:52.130047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FET.csv [2025-09-17T22:46:52.130194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMN.csv [2025-09-17T22:46:52.130338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMCR.csv [2025-09-17T22:46:52.130458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THIR.csv [2025-09-17T22:46:52.130593] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OPAD.csv [2025-09-17T22:46:52.130767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCE.csv [2025-09-17T22:46:52.130926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACP.csv [2025-09-17T22:46:52.131093] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSHP.csv [2025-09-17T22:46:52.131252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRP.csv [2025-09-17T22:46:52.131405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYG.csv [2025-09-17T22:46:52.131545] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BOH.csv [2025-09-17T22:46:52.131725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKL.csv [2025-09-17T22:46:52.131872] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDT.csv [2025-09-17T22:46:52.132030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/W.csv [2025-09-17T22:46:52.132174] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WU.csv [2025-09-17T22:46:52.132331] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASAN.csv [2025-09-17T22:46:52.132457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSP.csv [2025-09-17T22:46:52.132583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCN.csv [2025-09-17T22:46:52.132770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLH.csv [2025-09-17T22:46:52.132926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMP.csv [2025-09-17T22:46:52.133077] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RLJ.csv [2025-09-17T22:46:52.133216] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASC.csv [2025-09-17T22:46:52.133371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BTCM.csv [2025-09-17T22:46:52.133523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WTS.csv [2025-09-17T22:46:52.134020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCC.csv [2025-09-17T22:46:52.134217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBB.csv [2025-09-17T22:46:52.134383] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TUYA.csv [2025-09-17T22:46:52.134514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PUK.csv [2025-09-17T22:46:52.134618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MSGE.csv [2025-09-17T22:46:52.134798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RCI.csv [2025-09-17T22:46:52.134937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FAF.csv [2025-09-17T22:46:52.135088] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAR.csv [2025-09-17T22:46:52.135265] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HGLB.csv [2025-09-17T22:46:52.135405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMC.csv [2025-09-17T22:46:52.135557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAP.csv [2025-09-17T22:46:52.135732] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFAM.csv [2025-09-17T22:46:52.135910] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGE.csv [2025-09-17T22:46:52.136096] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/F.csv [2025-09-17T22:46:52.136247] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSQH.csv [2025-09-17T22:46:52.136403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UVE.csv [2025-09-17T22:46:52.136549] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EEX.csv [2025-09-17T22:46:52.136739] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRM.csv [2025-09-17T22:46:52.136880] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRTG.csv [2025-09-17T22:46:52.137030] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KEYS.csv [2025-09-17T22:46:52.137213] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRI.csv [2025-09-17T22:46:52.137355] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SXI.csv [2025-09-17T22:46:52.137484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MOH.csv [2025-09-17T22:46:52.137609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBT.csv [2025-09-17T22:46:52.137906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GSK.csv [2025-09-17T22:46:52.138068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AVNT.csv [2025-09-17T22:46:52.138219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HWM.csv [2025-09-17T22:46:52.138375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSY.csv [2025-09-17T22:46:52.138513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHI.csv [2025-09-17T22:46:52.138668] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PTY.csv [2025-09-17T22:46:52.138803] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMSA.csv [2025-09-17T22:46:52.138969] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ST.csv [2025-09-17T22:46:52.139127] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALG.csv [2025-09-17T22:46:52.139271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWG.csv [2025-09-17T22:46:52.139404] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IPI.csv [2025-09-17T22:46:52.139514] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRT.csv [2025-09-17T22:46:52.139667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOW.csv [2025-09-17T22:46:52.139810] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/V.csv [2025-09-17T22:46:52.139959] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTDR.csv [2025-09-17T22:46:52.140103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLPR.csv [2025-09-17T22:46:52.140239] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDHY.csv [2025-09-17T22:46:52.140405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CUBI.csv [2025-09-17T22:46:52.140792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TY.csv [2025-09-17T22:46:52.140925] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HOMB.csv [2025-09-17T22:46:52.141047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WEA.csv [2025-09-17T22:46:52.141188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLW.csv [2025-09-17T22:46:52.141338] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KYN.csv [2025-09-17T22:46:52.141488] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCS.csv [2025-09-17T22:46:52.141611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEPI.csv [2025-09-17T22:46:52.141764] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LYV.csv [2025-09-17T22:46:52.141889] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXX.csv [2025-09-17T22:46:52.142005] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMCO.csv [2025-09-17T22:46:52.142187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FRGE.csv [2025-09-17T22:46:52.142347] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPEV.csv [2025-09-17T22:46:52.142500] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YRD.csv [2025-09-17T22:46:52.142789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESRT.csv [2025-09-17T22:46:52.142930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMM.csv [2025-09-17T22:46:52.143075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ENB.csv [2025-09-17T22:46:52.143231] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITW.csv [2025-09-17T22:46:52.143371] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SVV.csv [2025-09-17T22:46:52.143491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLF.csv [2025-09-17T22:46:52.143627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPV.csv [2025-09-17T22:46:52.143777] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTX.csv [2025-09-17T22:46:52.143916] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLB.csv [2025-09-17T22:46:52.144056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSM.csv [2025-09-17T22:46:52.144252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANF.csv [2025-09-17T22:46:52.144406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCHW.csv [2025-09-17T22:46:52.144583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANET.csv [2025-09-17T22:46:52.144754] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQV.csv [2025-09-17T22:46:52.144903] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THC.csv [2025-09-17T22:46:52.145040] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BUXX.csv [2025-09-17T22:46:52.145175] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLN.csv [2025-09-17T22:46:52.145298] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WBS.csv [2025-09-17T22:46:52.145427] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZEPP.csv [2025-09-17T22:46:52.145570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIA.csv [2025-09-17T22:46:52.145820] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UNM.csv [2025-09-17T22:46:52.145972] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PK.csv [2025-09-17T22:46:52.146094] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VLRS.csv [2025-09-17T22:46:52.146204] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OEC.csv [2025-09-17T22:46:52.146352] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IT.csv [2025-09-17T22:46:52.146493] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DBRG.csv [2025-09-17T22:46:52.146632] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVTC.csv [2025-09-17T22:46:52.146819] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CVE.csv [2025-09-17T22:46:52.146954] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DFIN.csv [2025-09-17T22:46:52.147081] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCI.csv [2025-09-17T22:46:52.147251] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CATO.csv [2025-09-17T22:46:52.147401] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGX.csv [2025-09-17T22:46:52.147561] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IX.csv [2025-09-17T22:46:52.147724] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/L.csv [2025-09-17T22:46:52.148145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EGY.csv [2025-09-17T22:46:52.148308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSX.csv [2025-09-17T22:46:52.148451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAX.csv [2025-09-17T22:46:52.148576] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MYD.csv [2025-09-17T22:46:52.148918] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDS.csv [2025-09-17T22:46:52.149073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AR.csv [2025-09-17T22:46:52.149200] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCL.csv [2025-09-17T22:46:52.149304] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBR.csv [2025-09-17T22:46:52.149429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPAY.csv [2025-09-17T22:46:52.149583] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEG.csv [2025-09-17T22:46:52.149761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIEN.csv [2025-09-17T22:46:52.149904] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWMX.csv [2025-09-17T22:46:52.150034] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RTX.csv [2025-09-17T22:46:52.150164] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AER.csv [2025-09-17T22:46:52.150308] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BRCC.csv [2025-09-17T22:46:52.150449] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SU.csv [2025-09-17T22:46:52.150592] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AWI.csv [2025-09-17T22:46:52.150767] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMC.csv [2025-09-17T22:46:52.150907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNS.csv [2025-09-17T22:46:52.151053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAYC.csv [2025-09-17T22:46:52.151192] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MNR.csv [2025-09-17T22:46:52.151333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CMRE.csv [2025-09-17T22:46:52.151475] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLR.csv [2025-09-17T22:46:52.151618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GM.csv [2025-09-17T22:46:52.151786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFL.csv [2025-09-17T22:46:52.151909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SKY.csv [2025-09-17T22:46:52.152008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXG.csv [2025-09-17T22:46:52.152135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIO.csv [2025-09-17T22:46:52.152271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAYW.csv [2025-09-17T22:46:52.152400] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORA.csv [2025-09-17T22:46:52.152526] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLUT.csv [2025-09-17T22:46:52.152712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUFG.csv [2025-09-17T22:46:52.152840] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SLVM.csv [2025-09-17T22:46:52.153158] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPT.csv [2025-09-17T22:46:52.153295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZE.csv [2025-09-17T22:46:52.153405] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXH.csv [2025-09-17T22:46:52.153544] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIS.csv [2025-09-17T22:46:52.153755] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRP.csv [2025-09-17T22:46:52.153892] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEA.csv [2025-09-17T22:46:52.154058] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAS.csv [2025-09-17T22:46:52.154209] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LVWR.csv [2025-09-17T22:46:52.154346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INSP.csv [2025-09-17T22:46:52.154466] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEP.csv [2025-09-17T22:46:52.154565] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUVB.csv [2025-09-17T22:46:52.154694] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTS.csv [2025-09-17T22:46:52.154830] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCI.csv [2025-09-17T22:46:52.154949] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PWR.csv [2025-09-17T22:46:52.155045] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GBTG.csv [2025-09-17T22:46:52.155166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TWN.csv [2025-09-17T22:46:52.155314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CGAU.csv [2025-09-17T22:46:52.155454] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SR.csv [2025-09-17T22:46:52.155612] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNH.csv [2025-09-17T22:46:52.155784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IHS.csv [2025-09-17T22:46:52.155930] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLK.csv [2025-09-17T22:46:52.156068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPOF.csv [2025-09-17T22:46:52.156208] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BME.csv [2025-09-17T22:46:52.156343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DDT.csv [2025-09-17T22:46:52.156486] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GTLS.csv [2025-09-17T22:46:52.156610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CYD.csv [2025-09-17T22:46:52.156797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PL.csv [2025-09-17T22:46:52.156937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDS.csv [2025-09-17T22:46:52.157108] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VSCO.csv [2025-09-17T22:46:52.157264] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NZF.csv [2025-09-17T22:46:52.157403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLX.csv [2025-09-17T22:46:52.157538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OWL.csv [2025-09-17T22:46:52.157714] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BKSY.csv [2025-09-17T22:46:52.157866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GES.csv [2025-09-17T22:46:52.157988] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAX.csv [2025-09-17T22:46:52.158112] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OLP.csv [2025-09-17T22:46:52.158242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLP.csv [2025-09-17T22:46:52.158384] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMTB.csv [2025-09-17T22:46:52.158516] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INN.csv [2025-09-17T22:46:52.158675] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHR.csv [2025-09-17T22:46:52.158823] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NCZ.csv [2025-09-17T22:46:52.158979] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCA.csv [2025-09-17T22:46:52.159110] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPXC.csv [2025-09-17T22:46:52.159228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FSK.csv [2025-09-17T22:46:52.159374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CQP.csv [2025-09-17T22:46:52.159492] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STWD.csv [2025-09-17T22:46:52.159609] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGRO.csv [2025-09-17T22:46:52.159792] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACR.csv [2025-09-17T22:46:52.159935] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CDRE.csv [2025-09-17T22:46:52.160065] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LSPD.csv [2025-09-17T22:46:52.160167] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LGI.csv [2025-09-17T22:46:52.160287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CHN.csv [2025-09-17T22:46:52.160414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SEMR.csv [2025-09-17T22:46:52.160519] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JOE.csv [2025-09-17T22:46:52.160627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PSTL.csv [2025-09-17T22:46:52.160851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFR.csv [2025-09-17T22:46:52.160989] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NSA.csv [2025-09-17T22:46:52.161129] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/URI.csv [2025-09-17T22:46:52.161358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHP.csv [2025-09-17T22:46:52.161457] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VGI.csv [2025-09-17T22:46:52.161588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBN.csv [2025-09-17T22:46:52.161836] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZWS.csv [2025-09-17T22:46:52.161970] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAD.csv [2025-09-17T22:46:52.162128] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RS.csv [2025-09-17T22:46:52.162252] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBIN.csv [2025-09-17T22:46:52.162369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HLLY.csv [2025-09-17T22:46:52.162512] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GFL.csv [2025-09-17T22:46:52.162698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBA.csv [2025-09-17T22:46:52.162837] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABG.csv [2025-09-17T22:46:52.162977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/YELP.csv [2025-09-17T22:46:52.163121] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UI.csv [2025-09-17T22:46:52.163253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NTR.csv [2025-09-17T22:46:52.163403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ITT.csv [2025-09-17T22:46:52.163538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EG.csv [2025-09-17T22:46:52.163884] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PATH.csv [2025-09-17T22:46:52.164051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLK.csv [2025-09-17T22:46:52.164227] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQL.csv [2025-09-17T22:46:52.164353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CPA.csv [2025-09-17T22:46:52.164453] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJE.csv [2025-09-17T22:46:52.164570] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGCO.csv [2025-09-17T22:46:52.164748] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXP.csv [2025-09-17T22:46:52.164871] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFIN.csv [2025-09-17T22:46:52.165015] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUYA.csv [2025-09-17T22:46:52.165142] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MATX.csv [2025-09-17T22:46:52.165258] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PB.csv [2025-09-17T22:46:52.165417] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRTX.csv [2025-09-17T22:46:52.165572] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EBR.csv [2025-09-17T22:46:52.165723] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NPK.csv [2025-09-17T22:46:52.165853] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMY.csv [2025-09-17T22:46:52.165990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/COR.csv [2025-09-17T22:46:52.166183] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AEG.csv [2025-09-17T22:46:52.166325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZD.csv [2025-09-17T22:46:52.166460] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LADR.csv [2025-09-17T22:46:52.166594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HUBS.csv [2025-09-17T22:46:52.166891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMRT.csv [2025-09-17T22:46:52.167012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ESTC.csv [2025-09-17T22:46:52.167153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OVV.csv [2025-09-17T22:46:52.167297] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLM.csv [2025-09-17T22:46:52.167440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARLO.csv [2025-09-17T22:46:52.167615] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SNAP.csv [2025-09-17T22:46:52.167926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHS.csv [2025-09-17T22:46:52.168067] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCR.csv [2025-09-17T22:46:52.168222] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CSAN.csv [2025-09-17T22:46:52.168358] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CXE.csv [2025-09-17T22:46:52.168477] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCRD.csv [2025-09-17T22:46:52.168604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RAMP.csv [2025-09-17T22:46:52.168805] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AHT.csv [2025-09-17T22:46:52.168943] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RIG.csv [2025-09-17T22:46:52.169075] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OOMA.csv [2025-09-17T22:46:52.169173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AGO.csv [2025-09-17T22:46:52.169289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RA.csv [2025-09-17T22:46:52.169432] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DT.csv [2025-09-17T22:46:52.169559] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HSBC.csv [2025-09-17T22:46:52.169786] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LAW.csv [2025-09-17T22:46:52.169914] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SW.csv [2025-09-17T22:46:52.170033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELF.csv [2025-09-17T22:46:52.170157] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KLG.csv [2025-09-17T22:46:52.170272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRS.csv [2025-09-17T22:46:52.170409] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TME.csv [2025-09-17T22:46:52.170812] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TYG.csv [2025-09-17T22:46:52.170964] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AES.csv [2025-09-17T22:46:52.171083] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KAI.csv [2025-09-17T22:46:52.171206] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXPD.csv [2025-09-17T22:46:52.171333] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBI.csv [2025-09-17T22:46:52.171445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UA.csv [2025-09-17T22:46:52.171569] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTOS.csv [2025-09-17T22:46:52.171896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NKX.csv [2025-09-17T22:46:52.172018] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVC.csv [2025-09-17T22:46:52.172153] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WOW.csv [2025-09-17T22:46:52.172273] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUW.csv [2025-09-17T22:46:52.172385] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPX.csv [2025-09-17T22:46:52.172877] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFS.csv [2025-09-17T22:46:52.173027] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SFBS.csv [2025-09-17T22:46:52.173172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXP.csv [2025-09-17T22:46:52.173314] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSL.csv [2025-09-17T22:46:52.173479] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BFK.csv [2025-09-17T22:46:52.173601] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HVT.csv [2025-09-17T22:46:52.173750] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTRE.csv [2025-09-17T22:46:52.173906] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DELL.csv [2025-09-17T22:46:52.174047] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/THO.csv [2025-09-17T22:46:52.174237] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAP.csv [2025-09-17T22:46:52.174388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NGVC.csv [2025-09-17T22:46:52.174522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFLT.csv [2025-09-17T22:46:52.174664] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NEUE.csv [2025-09-17T22:46:52.174804] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQBK.csv [2025-09-17T22:46:52.174942] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLB.csv [2025-09-17T22:46:52.175091] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCD.csv [2025-09-17T22:46:52.175232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALLE.csv [2025-09-17T22:46:52.175398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLCO.csv [2025-09-17T22:46:52.175539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UMH.csv [2025-09-17T22:46:52.175698] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ROL.csv [2025-09-17T22:46:52.175866] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JBL.csv [2025-09-17T22:46:52.176020] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOCS.csv [2025-09-17T22:46:52.176165] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUN.csv [2025-09-17T22:46:52.176287] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BN.csv [2025-09-17T22:46:52.176403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQNR.csv [2025-09-17T22:46:52.176537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAE.csv [2025-09-17T22:46:52.176722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MHO.csv [2025-09-17T22:46:52.176864] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MPW.csv [2025-09-17T22:46:52.177059] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AOMR.csv [2025-09-17T22:46:52.177205] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SMBK.csv [2025-09-17T22:46:52.177343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MAGN.csv [2025-09-17T22:46:52.177467] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPH.csv [2025-09-17T22:46:52.177580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TVC.csv [2025-09-17T22:46:52.177816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HMN.csv [2025-09-17T22:46:52.177945] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WSO.csv [2025-09-17T22:46:52.178046] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STZ.csv [2025-09-17T22:46:52.178305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIO.csv [2025-09-17T22:46:52.178451] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVX.csv [2025-09-17T22:46:52.178596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IDE.csv [2025-09-17T22:46:52.178778] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WDS.csv [2025-09-17T22:46:52.178922] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FERG.csv [2025-09-17T22:46:52.179066] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FBK.csv [2025-09-17T22:46:52.179224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASIX.csv [2025-09-17T22:46:52.179349] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FOR.csv [2025-09-17T22:46:52.179464] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EOD.csv [2025-09-17T22:46:52.179611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPC.csv [2025-09-17T22:46:52.179788] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XYF.csv [2025-09-17T22:46:52.179907] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MBI.csv [2025-09-17T22:46:52.180019] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TECK.csv [2025-09-17T22:46:52.180156] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCB.csv [2025-09-17T22:46:52.180292] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFM.csv [2025-09-17T22:46:52.180412] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MKC.csv [2025-09-17T22:46:52.180538] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DLX.csv [2025-09-17T22:46:52.180729] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IVZ.csv [2025-09-17T22:46:52.180854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/R.csv [2025-09-17T22:46:52.180955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FDX.csv [2025-09-17T22:46:52.181049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MCN.csv [2025-09-17T22:46:52.181148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LHX.csv [2025-09-17T22:46:52.181267] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARDC.csv [2025-09-17T22:46:52.181388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WF.csv [2025-09-17T22:46:52.181484] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMRE.csv [2025-09-17T22:46:52.181580] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AS.csv [2025-09-17T22:46:52.181713] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NUV.csv [2025-09-17T22:46:52.181852] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTN.csv [2025-09-17T22:46:52.181982] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BWXT.csv [2025-09-17T22:46:52.182126] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RPM.csv [2025-09-17T22:46:52.182272] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANRO.csv [2025-09-17T22:46:52.182489] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACEL.csv [2025-09-17T22:46:52.182633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPVG.csv [2025-09-17T22:46:52.182797] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFC.csv [2025-09-17T22:46:52.182927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GNE.csv [2025-09-17T22:46:52.183053] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VPV.csv [2025-09-17T22:46:52.183163] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SARO.csv [2025-09-17T22:46:52.183262] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NWN.csv [2025-09-17T22:46:52.183482] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIG.csv [2025-09-17T22:46:52.183618] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MVF.csv [2025-09-17T22:46:52.183821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BLND.csv [2025-09-17T22:46:52.183955] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNF.csv [2025-09-17T22:46:52.184098] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MLR.csv [2025-09-17T22:46:52.184253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NHI.csv [2025-09-17T22:46:52.184369] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPAM.csv [2025-09-17T22:46:52.184473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPZ.csv [2025-09-17T22:46:52.184621] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRLL.csv [2025-09-17T22:46:52.184802] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STEM.csv [2025-09-17T22:46:52.184950] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBN.csv [2025-09-17T22:46:52.185086] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCF.csv [2025-09-17T22:46:52.185242] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETY.csv [2025-09-17T22:46:52.185377] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZETA.csv [2025-09-17T22:46:52.185522] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBLX.csv [2025-09-17T22:46:52.185759] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFC.csv [2025-09-17T22:46:52.185898] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLS.csv [2025-09-17T22:46:52.186049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACHR.csv [2025-09-17T22:46:52.186189] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STAG.csv [2025-09-17T22:46:52.186310] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CCIF.csv [2025-09-17T22:46:52.186459] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KODK.csv [2025-09-17T22:46:52.186600] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALB.csv [2025-09-17T22:46:52.186763] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLDT.csv [2025-09-17T22:46:52.186900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ARES.csv [2025-09-17T22:46:52.187038] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PJT.csv [2025-09-17T22:46:52.187166] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HCI.csv [2025-09-17T22:46:52.187284] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NLY.csv [2025-09-17T22:46:52.187423] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VBF.csv [2025-09-17T22:46:52.187547] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RY.csv [2025-09-17T22:46:52.187685] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SDRL.csv [2025-09-17T22:46:52.187856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ATKR.csv [2025-09-17T22:46:52.188003] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BX.csv [2025-09-17T22:46:52.188145] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MWA.csv [2025-09-17T22:46:52.188291] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GVA.csv [2025-09-17T22:46:52.188438] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IBP.csv [2025-09-17T22:46:52.188751] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OFG.csv [2025-09-17T22:46:52.188926] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BIRK.csv [2025-09-17T22:46:52.189060] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MS.csv [2025-09-17T22:46:52.189182] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RMM.csv [2025-09-17T22:46:52.189305] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LOMA.csv [2025-09-17T22:46:52.189429] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BST.csv [2025-09-17T22:46:52.189579] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNS.csv [2025-09-17T22:46:52.189737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EQR.csv [2025-09-17T22:46:52.189878] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECO.csv [2025-09-17T22:46:52.190022] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SBI.csv [2025-09-17T22:46:52.190180] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HRB.csv [2025-09-17T22:46:52.190320] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DRI.csv [2025-09-17T22:46:52.190440] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RBOT.csv [2025-09-17T22:46:52.190557] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GEV.csv [2025-09-17T22:46:52.190712] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GAB.csv [2025-09-17T22:46:52.190862] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALC.csv [2025-09-17T22:46:52.191042] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMRC.csv [2025-09-17T22:46:52.191188] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HQH.csv [2025-09-17T22:46:52.191325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CNMD.csv [2025-09-17T22:46:52.191458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/QXO.csv [2025-09-17T22:46:52.191604] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DY.csv [2025-09-17T22:46:52.191780] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BMA.csv [2025-09-17T22:46:52.191927] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HFRO.csv [2025-09-17T22:46:52.192068] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NBB.csv [2025-09-17T22:46:52.192246] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ALIT.csv [2025-09-17T22:46:52.192505] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UAN.csv [2025-09-17T22:46:52.192677] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRM.csv [2025-09-17T22:46:52.192893] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AME.csv [2025-09-17T22:46:52.193017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZB.csv [2025-09-17T22:46:52.193119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CABO.csv [2025-09-17T22:46:52.193232] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KKRS.csv [2025-09-17T22:46:52.193589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXN.csv [2025-09-17T22:46:52.193817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SOJD.csv [2025-09-17T22:46:52.193976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HBB.csv [2025-09-17T22:46:52.194119] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PDM.csv [2025-09-17T22:46:52.194276] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRC.csv [2025-09-17T22:46:52.194403] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRA.csv [2025-09-17T22:46:52.194539] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASG.csv [2025-09-17T22:46:52.194697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OII.csv [2025-09-17T22:46:52.194816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OCFT.csv [2025-09-17T22:46:52.194928] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGB.csv [2025-09-17T22:46:52.195056] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LTM.csv [2025-09-17T22:46:52.195193] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BANC.csv [2025-09-17T22:46:52.195339] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SSTK.csv [2025-09-17T22:46:52.195473] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FC.csv [2025-09-17T22:46:52.195627] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ECAT.csv [2025-09-17T22:46:52.195784] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GMED.csv [2025-09-17T22:46:52.195941] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EL.csv [2025-09-17T22:46:52.196087] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBVA.csv [2025-09-17T22:46:52.196219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SJT.csv [2025-09-17T22:46:52.196344] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MEI.csv [2025-09-17T22:46:52.196445] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXDT.csv [2025-09-17T22:46:52.196589] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BEKE.csv [2025-09-17T22:46:52.196772] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGS.csv [2025-09-17T22:46:52.196912] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUSA.csv [2025-09-17T22:46:52.197102] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASGN.csv [2025-09-17T22:46:52.197228] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OHI.csv [2025-09-17T22:46:52.197353] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTI.csv [2025-09-17T22:46:52.197483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VTLE.csv [2025-09-17T22:46:52.197605] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ELV.csv [2025-09-17T22:46:52.197770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAH.csv [2025-09-17T22:46:52.197909] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSQ.csv [2025-09-17T22:46:52.198061] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIAX.csv [2025-09-17T22:46:52.198224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBDC.csv [2025-09-17T22:46:52.198343] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NRUC.csv [2025-09-17T22:46:52.198458] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GIL.csv [2025-09-17T22:46:52.198594] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BHVN.csv [2025-09-17T22:46:52.198770] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UHS.csv [2025-09-17T22:46:52.198913] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BSX.csv [2025-09-17T22:46:52.199049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DTE.csv [2025-09-17T22:46:52.199201] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IAG.csv [2025-09-17T22:46:52.199350] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHG.csv [2025-09-17T22:46:52.199509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PVH.csv [2025-09-17T22:46:52.199725] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABCB.csv [2025-09-17T22:46:52.199868] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KFS.csv [2025-09-17T22:46:52.200008] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APD.csv [2025-09-17T22:46:52.200148] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NOV.csv [2025-09-17T22:46:52.200294] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BORR.csv [2025-09-17T22:46:52.200426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BY.csv [2025-09-17T22:46:52.200584] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IONQ.csv [2025-09-17T22:46:52.200756] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TBBB.csv [2025-09-17T22:46:52.200977] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JEQ.csv [2025-09-17T22:46:52.201103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UZF.csv [2025-09-17T22:46:52.201224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPH.csv [2025-09-17T22:46:52.201346] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/REX.csv [2025-09-17T22:46:52.201462] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFII.csv [2025-09-17T22:46:52.201585] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SHO.csv [2025-09-17T22:46:52.201822] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NIM.csv [2025-09-17T22:46:52.201951] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/XPO.csv [2025-09-17T22:46:52.202049] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RZB.csv [2025-09-17T22:46:52.202173] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LXFR.csv [2025-09-17T22:46:52.202342] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CBL.csv [2025-09-17T22:46:52.202511] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BCSF.csv [2025-09-17T22:46:52.202633] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WFG.csv [2025-09-17T22:46:52.202798] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DOC.csv [2025-09-17T22:46:52.202937] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TSLX.csv [2025-09-17T22:46:52.203050] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AUNA.csv [2025-09-17T22:46:52.203146] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVG.csv [2025-09-17T22:46:52.203253] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JHG.csv [2025-09-17T22:46:52.203375] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PFO.csv [2025-09-17T22:46:52.203476] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/VVR.csv [2025-09-17T22:46:52.203591] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EPD.csv [2025-09-17T22:46:52.203761] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ANVS.csv [2025-09-17T22:46:52.203900] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FUBO.csv [2025-09-17T22:46:52.204051] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/IOT.csv [2025-09-17T22:46:52.204218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NXJ.csv [2025-09-17T22:46:52.204378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CLW.csv [2025-09-17T22:46:52.204509] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PBH.csv [2025-09-17T22:46:52.204611] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORN.csv [2025-09-17T22:46:52.204957] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OGS.csv [2025-09-17T22:46:52.205117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GOF.csv [2025-09-17T22:46:52.205256] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ORC.csv [2025-09-17T22:46:52.205378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TAL.csv [2025-09-17T22:46:52.205485] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EMR.csv [2025-09-17T22:46:52.205610] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GHI.csv [2025-09-17T22:46:52.205753] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DIS.csv [2025-09-17T22:46:52.205874] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUX.csv [2025-09-17T22:46:52.205974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NVT.csv [2025-09-17T22:46:52.206073] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ICE.csv [2025-09-17T22:46:52.206172] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SPNT.csv [2025-09-17T22:46:52.206289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CODI.csv [2025-09-17T22:46:52.206426] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRLB.csv [2025-09-17T22:46:52.206588] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKG.csv [2025-09-17T22:46:52.206738] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LZM.csv [2025-09-17T22:46:52.206854] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CAT.csv [2025-09-17T22:46:52.206974] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HAFN.csv [2025-09-17T22:46:52.207105] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMZ.csv [2025-09-17T22:46:52.207244] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAND.csv [2025-09-17T22:46:52.207378] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EAF.csv [2025-09-17T22:46:52.207523] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRH.csv [2025-09-17T22:46:52.207704] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABT.csv [2025-09-17T22:46:52.207851] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CRBG.csv [2025-09-17T22:46:52.207978] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GRMN.csv [2025-09-17T22:46:52.208092] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CIB.csv [2025-09-17T22:46:52.208218] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TPB.csv [2025-09-17T22:46:52.208325] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/JQC.csv [2025-09-17T22:46:52.208472] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDDY.csv [2025-09-17T22:46:52.208596] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PMT.csv [2025-09-17T22:46:52.208737] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FN.csv [2025-09-17T22:46:52.208863] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MFM.csv [2025-09-17T22:46:52.209001] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/INFA.csv [2025-09-17T22:46:52.209123] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RACE.csv [2025-09-17T22:46:52.209245] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BAM.csv [2025-09-17T22:46:52.209398] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MIN.csv [2025-09-17T22:46:52.209517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIX.csv [2025-09-17T22:46:52.209793] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ABBV.csv [2025-09-17T22:46:52.209923] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TFX.csv [2025-09-17T22:46:52.210017] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMS.csv [2025-09-17T22:46:52.210137] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RFI.csv [2025-09-17T22:46:52.210271] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PCM.csv [2025-09-17T22:46:52.210389] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TDOC.csv [2025-09-17T22:46:52.210491] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMT.csv [2025-09-17T22:46:52.210586] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PKX.csv [2025-09-17T22:46:52.210716] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EDU.csv [2025-09-17T22:46:52.210847] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BXSL.csv [2025-09-17T22:46:52.210975] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WPM.csv [2025-09-17T22:46:52.211103] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZGN.csv [2025-09-17T22:46:52.211240] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/POST.csv [2025-09-17T22:46:52.211397] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AIR.csv [2025-09-17T22:46:52.211517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DAVA.csv [2025-09-17T22:46:52.211631] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ETJ.csv [2025-09-17T22:46:52.211796] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FLC.csv [2025-09-17T22:46:52.212012] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NINE.csv [2025-09-17T22:46:52.212114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/LEVI.csv [2025-09-17T22:46:52.212219] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NAT.csv [2025-09-17T22:46:52.212364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BBUC.csv [2025-09-17T22:46:52.212521] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WMB.csv [2025-09-17T22:46:52.212697] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FTK.csv [2025-09-17T22:46:52.212817] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BABA.csv [2025-09-17T22:46:52.212946] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GGZ.csv [2025-09-17T22:46:52.213085] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ET.csv [2025-09-17T22:46:52.213224] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/UTF.csv [2025-09-17T22:46:52.213363] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AMT.csv [2025-09-17T22:46:52.213498] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ZBH.csv [2025-09-17T22:46:52.213616] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/STN.csv [2025-09-17T22:46:52.213856] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GUG.csv [2025-09-17T22:46:52.213990] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BGT.csv [2025-09-17T22:46:52.214135] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HPP.csv [2025-09-17T22:46:52.214295] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTD.csv [2025-09-17T22:46:52.214414] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OI.csv [2025-09-17T22:46:52.214548] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MTAL.csv [2025-09-17T22:46:52.214703] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GDV.csv [2025-09-17T22:46:52.214821] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPI.csv [2025-09-17T22:46:52.214920] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WELL.csv [2025-09-17T22:46:52.215033] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FMC.csv [2025-09-17T22:46:52.215187] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ASH.csv [2025-09-17T22:46:52.215335] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RVLV.csv [2025-09-17T22:46:52.215456] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EVT.csv [2025-09-17T22:46:52.215722] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/ACRE.csv [2025-09-17T22:46:52.215846] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TT.csv [2025-09-17T22:46:52.215962] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SYF.csv [2025-09-17T22:46:52.216079] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PR.csv [2025-09-17T22:46:52.216194] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PAR.csv [2025-09-17T22:46:52.216309] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MT.csv [2025-09-17T22:46:52.216406] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WCC.csv [2025-09-17T22:46:52.216517] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/OIS.csv [2025-09-17T22:46:52.216634] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RES.csv [2025-09-17T22:46:52.216789] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BDX.csv [2025-09-17T22:46:52.216891] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KREF.csv [2025-09-17T22:46:52.216985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/MUJ.csv [2025-09-17T22:46:52.217114] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRGO.csv [2025-09-17T22:46:52.217233] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KRO.csv [2025-09-17T22:46:52.217374] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/AAP.csv [2025-09-17T22:46:52.217513] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PHT.csv [2025-09-17T22:46:52.217667] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FCX.csv [2025-09-17T22:46:52.217783] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/NMI.csv [2025-09-17T22:46:52.217896] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/GPMT.csv [2025-09-17T22:46:52.218035] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SON.csv [2025-09-17T22:46:52.218169] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXP.csv [2025-09-17T22:46:52.218289] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/FPF.csv [2025-09-17T22:46:52.218388] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SAP.csv [2025-09-17T22:46:52.218483] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/WLKP.csv [2025-09-17T22:46:52.218598] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SCD.csv [2025-09-17T22:46:52.218961] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/DCO.csv [2025-09-17T22:46:52.219364] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRP.csv [2025-09-17T22:46:52.219502] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TTC.csv [2025-09-17T22:46:52.219625] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RITM.csv [2025-09-17T22:46:52.219985] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/APLE.csv [2025-09-17T22:46:52.220117] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/KVUE.csv [2025-09-17T22:46:52.220217] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SWK.csv [2025-09-17T22:46:52.220318] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/EXR.csv [2025-09-17T22:46:52.220413] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/PRKS.csv [2025-09-17T22:46:52.220537] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CTDD.csv [2025-09-17T22:46:52.220736] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/SA.csv [2025-09-17T22:46:52.220976] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/BNL.csv [2025-09-17T22:46:52.221120] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TXO.csv [2025-09-17T22:46:52.221248] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/RRX.csv [2025-09-17T22:46:52.221396] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/TRU.csv [2025-09-17T22:46:52.221530] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/HIMS.csv [2025-09-17T22:46:52.221816] [DEBUG] [LOCAL ] Deleted: /opt/tdm/output/data/derivative_storage/CM.csv [2025-09-17T22:46:52.221933] [INFO ] [LOCAL ] Deleted 2045 derivative data files. [2025-09-17T22:46:52.221983] [INFO ] [LOCAL ] Scanning primary storage for available symbols. [2025-09-17T22:46:52.224116] [INFO ] [LOCAL ] Found 2085 symbols with primary data. [2025-09-17T22:46:52.224421] [INFO ] [MAIN ] Starting parallel derivative generation with 3 worker threads for 2085 symbols [2025-09-17T22:46:52.225775] [INFO ] [MAIN ] AAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:52.225124] [INFO ] [MAIN ] AA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:52.226347] [INFO ] [MAIN ] AAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:52.297509] [DEBUG] [LOCAL ] AAP: Loaded 52189 existing records from primary storage. [2025-09-17T22:46:52.297843] [INFO ] [MAIN ] AAP: Loaded 52189 primary data records. [2025-09-17T22:46:52.298577] [DEBUG] [LOCAL ] AAT: Loaded 30591 existing records from primary storage. [2025-09-17T22:46:52.358234] [INFO ] [MAIN ] AAT: Loaded 30591 primary data records. [2025-09-17T22:46:52.810579] [DEBUG] [LOCAL ] AA: Loaded 53585 existing records from primary storage. [2025-09-17T22:46:52.842472] [INFO ] [MAIN ] AA: Loaded 53585 primary data records. [2025-09-17T22:46:53.361992] [DEBUG] [MAIN ] AAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:53.363251] [INFO ] [MAIN ] AAP: Generated 1794 derivative records from 52189 primary records. [2025-09-17T22:46:53.363519] [DEBUG] [LOCAL ] AAP: Saving derivative data. [2025-09-17T22:46:53.384518] [DEBUG] [LOCAL ] AAP: Derivative data saved (1794 records). [2025-09-17T22:46:53.385364] [INFO ] [MAIN ] AAP: Successfully saved derivative data. [2025-09-17T22:46:53.387933] [INFO ] [MAIN ] Derivative Progress: 1/2085 symbols completed. AAP took 1.2s. Estimated remaining: 40m 25s. Rate: 51.6 symbols/min [2025-09-17T22:46:53.403158] [DEBUG] [MAIN ] AAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:53.403284] [INFO ] [MAIN ] AB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:53.404338] [INFO ] [MAIN ] AAT: Generated 1794 derivative records from 30591 primary records. [2025-09-17T22:46:53.404925] [DEBUG] [LOCAL ] AAT: Saving derivative data. [2025-09-17T22:46:53.439805] [DEBUG] [LOCAL ] AAT: Derivative data saved (1794 records). [2025-09-17T22:46:53.439680] [DEBUG] [MAIN ] AA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:53.439932] [INFO ] [MAIN ] AAT: Successfully saved derivative data. [2025-09-17T22:46:53.442835] [INFO ] [MAIN ] Derivative Progress: 2/2085 symbols completed. AAT took 1.2s. Estimated remaining: 21m 9s. Rate: 98.5 symbols/min [2025-09-17T22:46:53.440776] [INFO ] [MAIN ] AA: Generated 1794 derivative records from 53585 primary records. [2025-09-17T22:46:53.443282] [INFO ] [MAIN ] ABBV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:53.443241] [DEBUG] [LOCAL ] AA: Saving derivative data. [2025-09-17T22:46:53.477710] [DEBUG] [LOCAL ] AB: Loaded 29113 existing records from primary storage. [2025-09-17T22:46:53.478457] [DEBUG] [LOCAL ] AA: Derivative data saved (1794 records). [2025-09-17T22:46:53.478570] [INFO ] [MAIN ] AB: Loaded 29113 primary data records. [2025-09-17T22:46:53.478681] [INFO ] [MAIN ] AA: Successfully saved derivative data. [2025-09-17T22:46:53.481766] [INFO ] [MAIN ] Derivative Progress: 3/2085 symbols completed. AA took 1.3s. Estimated remaining: 14m 33s. Rate: 143.1 symbols/min [2025-09-17T22:46:53.482166] [INFO ] [MAIN ] ABCB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:53.826174] [DEBUG] [LOCAL ] ABCB: Loaded 30743 existing records from primary storage. [2025-09-17T22:46:53.826460] [INFO ] [MAIN ] ABCB: Loaded 30743 primary data records. [2025-09-17T22:46:53.908286] [DEBUG] [LOCAL ] ABBV: Loaded 53689 existing records from primary storage. [2025-09-17T22:46:53.921487] [INFO ] [MAIN ] ABBV: Loaded 53689 primary data records. [2025-09-17T22:46:54.547075] [DEBUG] [MAIN ] AB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:54.548150] [INFO ] [MAIN ] AB: Generated 1794 derivative records from 29113 primary records. [2025-09-17T22:46:54.548244] [DEBUG] [LOCAL ] AB: Saving derivative data. [2025-09-17T22:46:54.567782] [DEBUG] [LOCAL ] AB: Derivative data saved (1794 records). [2025-09-17T22:46:54.568129] [INFO ] [MAIN ] AB: Successfully saved derivative data. [2025-09-17T22:46:54.570216] [INFO ] [MAIN ] Derivative Progress: 4/2085 symbols completed. AB took 1.2s. Estimated remaining: 20m 21s. Rate: 102.3 symbols/min [2025-09-17T22:46:54.571038] [INFO ] [MAIN ] ABEV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:54.591099] [DEBUG] [MAIN ] ABCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:54.592050] [INFO ] [MAIN ] ABCB: Generated 1794 derivative records from 30743 primary records. [2025-09-17T22:46:54.592347] [DEBUG] [LOCAL ] ABCB: Saving derivative data. [2025-09-17T22:46:54.622693] [DEBUG] [MAIN ] ABBV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:54.624262] [INFO ] [MAIN ] ABBV: Generated 1794 derivative records from 53689 primary records. [2025-09-17T22:46:54.624590] [DEBUG] [LOCAL ] ABBV: Saving derivative data. [2025-09-17T22:46:54.626462] [DEBUG] [LOCAL ] ABCB: Derivative data saved (1794 records). [2025-09-17T22:46:54.637344] [INFO ] [MAIN ] ABCB: Successfully saved derivative data. [2025-09-17T22:46:54.654479] [INFO ] [MAIN ] Derivative Progress: 5/2085 symbols completed. ABCB took 1.2s. Estimated remaining: 16m 51s. Rate: 123.4 symbols/min [2025-09-17T22:46:54.655171] [INFO ] [MAIN ] ABG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:54.657620] [DEBUG] [LOCAL ] ABBV: Derivative data saved (1794 records). [2025-09-17T22:46:54.657800] [INFO ] [MAIN ] ABBV: Successfully saved derivative data. [2025-09-17T22:46:54.660352] [INFO ] [MAIN ] Derivative Progress: 6/2085 symbols completed. ABBV took 1.2s. Estimated remaining: 14m 4s. Rate: 147.8 symbols/min [2025-09-17T22:46:54.660709] [INFO ] [MAIN ] ABM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:54.678701] [DEBUG] [LOCAL ] ABEV: Loaded 53272 existing records from primary storage. [2025-09-17T22:46:54.683634] [INFO ] [MAIN ] ABEV: Loaded 53272 primary data records. [2025-09-17T22:46:54.813231] [DEBUG] [LOCAL ] ABG: Loaded 18939 existing records from primary storage. [2025-09-17T22:46:54.813549] [INFO ] [MAIN ] ABG: Loaded 18939 primary data records. [2025-09-17T22:46:55.131449] [DEBUG] [LOCAL ] ABM: Loaded 32236 existing records from primary storage. [2025-09-17T22:46:55.132279] [INFO ] [MAIN ] ABM: Loaded 32236 primary data records. [2025-09-17T22:46:55.668949] [DEBUG] [MAIN ] ABEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:55.670142] [INFO ] [MAIN ] ABEV: Generated 1794 derivative records from 53272 primary records. [2025-09-17T22:46:55.677918] [DEBUG] [LOCAL ] ABEV: Saving derivative data. [2025-09-17T22:46:55.684557] [DEBUG] [MAIN ] ABG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:55.686076] [INFO ] [MAIN ] ABG: Generated 1794 derivative records from 18939 primary records. [2025-09-17T22:46:55.686269] [DEBUG] [LOCAL ] ABG: Saving derivative data. [2025-09-17T22:46:55.734320] [DEBUG] [MAIN ] ABM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:55.733683] [DEBUG] [LOCAL ] ABEV: Derivative data saved (1794 records). [2025-09-17T22:46:55.735238] [INFO ] [MAIN ] ABEV: Successfully saved derivative data. [2025-09-17T22:46:55.737068] [DEBUG] [LOCAL ] ABG: Derivative data saved (1794 records). [2025-09-17T22:46:55.739062] [INFO ] [MAIN ] ABG: Successfully saved derivative data. [2025-09-17T22:46:55.738962] [INFO ] [MAIN ] Derivative Progress: 7/2085 symbols completed. ABEV took 1.2s. Estimated remaining: 17m 23s. Rate: 119.5 symbols/min [2025-09-17T22:46:55.736781] [INFO ] [MAIN ] ABM: Generated 1794 derivative records from 32236 primary records. [2025-09-17T22:46:55.741508] [DEBUG] [LOCAL ] ABM: Saving derivative data. [2025-09-17T22:46:55.741183] [INFO ] [MAIN ] ABR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:55.741330] [INFO ] [MAIN ] Derivative Progress: 8/2085 symbols completed. ABG took 1.1s. Estimated remaining: 15m 13s. Rate: 136.5 symbols/min [2025-09-17T22:46:55.742343] [INFO ] [MAIN ] ABT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:55.760581] [DEBUG] [LOCAL ] ABM: Derivative data saved (1794 records). [2025-09-17T22:46:55.760789] [INFO ] [MAIN ] ABM: Successfully saved derivative data. [2025-09-17T22:46:55.763178] [INFO ] [MAIN ] Derivative Progress: 9/2085 symbols completed. ABM took 1.1s. Estimated remaining: 13m 36s. Rate: 152.6 symbols/min [2025-09-17T22:46:55.763628] [INFO ] [MAIN ] ACA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:55.816545] [DEBUG] [LOCAL ] ACA: Loaded 24269 existing records from primary storage. [2025-09-17T22:46:55.816796] [INFO ] [MAIN ] ACA: Loaded 24269 primary data records. [2025-09-17T22:46:55.956100] [DEBUG] [LOCAL ] ABT: Loaded 53621 existing records from primary storage. [2025-09-17T22:46:55.967082] [INFO ] [MAIN ] ABT: Loaded 53621 primary data records. [2025-09-17T22:46:56.112519] [DEBUG] [LOCAL ] ABR: Loaded 52166 existing records from primary storage. [2025-09-17T22:46:56.124402] [INFO ] [MAIN ] ABR: Loaded 52166 primary data records. [2025-09-17T22:46:56.862570] [DEBUG] [MAIN ] ACA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:56.863808] [INFO ] [MAIN ] ACA: Generated 1794 derivative records from 24269 primary records. [2025-09-17T22:46:56.863997] [DEBUG] [LOCAL ] ACA: Saving derivative data. [2025-09-17T22:46:56.897197] [DEBUG] [MAIN ] ABT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:56.899053] [INFO ] [MAIN ] ABT: Generated 1794 derivative records from 53621 primary records. [2025-09-17T22:46:56.899394] [DEBUG] [LOCAL ] ABT: Saving derivative data. [2025-09-17T22:46:56.900339] [DEBUG] [LOCAL ] ACA: Derivative data saved (1794 records). [2025-09-17T22:46:56.900631] [INFO ] [MAIN ] ACA: Successfully saved derivative data. [2025-09-17T22:46:56.902833] [INFO ] [MAIN ] Derivative Progress: 10/2085 symbols completed. ACA took 1.1s. Estimated remaining: 16m 11s. Rate: 128.2 symbols/min [2025-09-17T22:46:56.903545] [INFO ] [MAIN ] ACCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:56.936103] [DEBUG] [LOCAL ] ABT: Derivative data saved (1794 records). [2025-09-17T22:46:56.936450] [INFO ] [MAIN ] ABT: Successfully saved derivative data. [2025-09-17T22:46:56.939767] [DEBUG] [MAIN ] ABR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:56.939476] [INFO ] [MAIN ] Derivative Progress: 11/2085 symbols completed. ABT took 1.2s. Estimated remaining: 14m 49s. Rate: 140.0 symbols/min [2025-09-17T22:46:56.940606] [INFO ] [MAIN ] ABR: Generated 1794 derivative records from 52166 primary records. [2025-09-17T22:46:56.940917] [INFO ] [MAIN ] ACEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:56.941118] [DEBUG] [LOCAL ] ABR: Saving derivative data. [2025-09-17T22:46:56.966822] [DEBUG] [LOCAL ] ABR: Derivative data saved (1794 records). [2025-09-17T22:46:56.967001] [INFO ] [MAIN ] ABR: Successfully saved derivative data. [2025-09-17T22:46:56.969451] [INFO ] [MAIN ] Derivative Progress: 12/2085 symbols completed. ABR took 1.2s. Estimated remaining: 13m 40s. Rate: 151.7 symbols/min [2025-09-17T22:46:56.969752] [INFO ] [MAIN ] ACHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:56.992351] [DEBUG] [LOCAL ] ACCO: Loaded 38079 existing records from primary storage. [2025-09-17T22:46:56.992606] [INFO ] [MAIN ] ACCO: Loaded 38079 primary data records. [2025-09-17T22:46:57.109820] [DEBUG] [LOCAL ] ACEL: Loaded 27453 existing records from primary storage. [2025-09-17T22:46:57.110146] [INFO ] [MAIN ] ACEL: Loaded 27453 primary data records. [2025-09-17T22:46:57.446016] [DEBUG] [LOCAL ] ACHR: Loaded 53818 existing records from primary storage. [2025-09-17T22:46:57.446933] [INFO ] [MAIN ] ACHR: Loaded 53818 primary data records. [2025-09-17T22:46:58.036192] [DEBUG] [MAIN ] ACCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:58.038202] [INFO ] [MAIN ] ACCO: Generated 1794 derivative records from 38079 primary records. [2025-09-17T22:46:58.038406] [DEBUG] [LOCAL ] ACCO: Saving derivative data. [2025-09-17T22:46:58.057469] [DEBUG] [LOCAL ] ACCO: Derivative data saved (1794 records). [2025-09-17T22:46:58.059699] [INFO ] [MAIN ] ACCO: Successfully saved derivative data. [2025-09-17T22:46:58.061777] [INFO ] [MAIN ] Derivative Progress: 13/2085 symbols completed. ACCO took 1.2s. Estimated remaining: 15m 30s. Rate: 133.6 symbols/min [2025-09-17T22:46:58.074878] [DEBUG] [MAIN ] ACEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:58.075823] [INFO ] [MAIN ] ACEL: Generated 1794 derivative records from 27453 primary records. [2025-09-17T22:46:58.075974] [DEBUG] [LOCAL ] ACEL: Saving derivative data. [2025-09-17T22:46:58.106388] [DEBUG] [MAIN ] ACHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:58.107419] [INFO ] [MAIN ] ACHR: Generated 1794 derivative records from 53818 primary records. [2025-09-17T22:46:58.107920] [DEBUG] [LOCAL ] ACEL: Derivative data saved (1794 records). [2025-09-17T22:46:58.107994] [DEBUG] [LOCAL ] ACHR: Saving derivative data. [2025-09-17T22:46:58.108603] [INFO ] [MAIN ] ACEL: Successfully saved derivative data. [2025-09-17T22:46:58.110417] [INFO ] [MAIN ] Derivative Progress: 14/2085 symbols completed. ACEL took 1.2s. Estimated remaining: 14m 31s. Rate: 142.7 symbols/min [2025-09-17T22:46:58.125149] [DEBUG] [LOCAL ] ACHR: Derivative data saved (1794 records). [2025-09-17T22:46:58.125212] [INFO ] [MAIN ] ACHR: Successfully saved derivative data. [2025-09-17T22:46:58.127131] [INFO ] [MAIN ] Derivative Progress: 15/2085 symbols completed. ACHR took 1.2s. Estimated remaining: 13m 35s. Rate: 152.5 symbols/min [2025-09-17T22:46:58.127967] [INFO ] [MAIN ] ACN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:58.127777] [INFO ] [MAIN ] ACI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:58.128151] [INFO ] [MAIN ] ACM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:58.199476] [DEBUG] [LOCAL ] ACM: Loaded 43121 existing records from primary storage. [2025-09-17T22:46:58.199706] [INFO ] [MAIN ] ACM: Loaded 43121 primary data records. [2025-09-17T22:46:58.336745] [DEBUG] [LOCAL ] ACN: Loaded 53419 existing records from primary storage. [2025-09-17T22:46:58.343449] [INFO ] [MAIN ] ACN: Loaded 53419 primary data records. [2025-09-17T22:46:58.343310] [DEBUG] [LOCAL ] ACI: Loaded 53274 existing records from primary storage. [2025-09-17T22:46:58.354171] [INFO ] [MAIN ] ACI: Loaded 53274 primary data records. [2025-09-17T22:46:59.207826] [DEBUG] [MAIN ] ACM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:59.209047] [INFO ] [MAIN ] ACM: Generated 1794 derivative records from 43121 primary records. [2025-09-17T22:46:59.209414] [DEBUG] [LOCAL ] ACM: Saving derivative data. [2025-09-17T22:46:59.230637] [DEBUG] [LOCAL ] ACM: Derivative data saved (1794 records). [2025-09-17T22:46:59.230799] [INFO ] [MAIN ] ACM: Successfully saved derivative data. [2025-09-17T22:46:59.235507] [INFO ] [MAIN ] Derivative Progress: 16/2085 symbols completed. ACM took 1.1s. Estimated remaining: 15m 7s. Rate: 136.9 symbols/min [2025-09-17T22:46:59.236134] [INFO ] [MAIN ] ACP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:59.250477] [DEBUG] [MAIN ] ACN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:59.251344] [INFO ] [MAIN ] ACN: Generated 1794 derivative records from 53419 primary records. [2025-09-17T22:46:59.252524] [DEBUG] [LOCAL ] ACN: Saving derivative data. [2025-09-17T22:46:59.283543] [DEBUG] [MAIN ] ACI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:46:59.285267] [INFO ] [MAIN ] ACI: Generated 1794 derivative records from 53274 primary records. [2025-09-17T22:46:59.285474] [DEBUG] [LOCAL ] ACI: Saving derivative data. [2025-09-17T22:46:59.304014] [DEBUG] [LOCAL ] ACN: Derivative data saved (1794 records). [2025-09-17T22:46:59.305249] [INFO ] [MAIN ] ACN: Successfully saved derivative data. [2025-09-17T22:46:59.307548] [INFO ] [MAIN ] Derivative Progress: 17/2085 symbols completed. ACN took 1.2s. Estimated remaining: 14m 22s. Rate: 144.0 symbols/min [2025-09-17T22:46:59.308775] [INFO ] [MAIN ] ACR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:59.317765] [DEBUG] [LOCAL ] ACI: Derivative data saved (1794 records). [2025-09-17T22:46:59.317930] [INFO ] [MAIN ] ACI: Successfully saved derivative data. [2025-09-17T22:46:59.320014] [INFO ] [MAIN ] Derivative Progress: 18/2085 symbols completed. ACI took 1.2s. Estimated remaining: 13m 35s. Rate: 152.2 symbols/min [2025-09-17T22:46:59.320489] [INFO ] [MAIN ] ACRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:46:59.327152] [DEBUG] [LOCAL ] ACR: Loaded 6484 existing records from primary storage. [2025-09-17T22:46:59.327738] [INFO ] [MAIN ] ACR: Loaded 6484 primary data records. [2025-09-17T22:46:59.407465] [DEBUG] [LOCAL ] ACP: Loaded 31453 existing records from primary storage. [2025-09-17T22:46:59.439231] [INFO ] [MAIN ] ACP: Loaded 31453 primary data records. [2025-09-17T22:46:59.786279] [DEBUG] [LOCAL ] ACRE: Loaded 33725 existing records from primary storage. [2025-09-17T22:46:59.795217] [INFO ] [MAIN ] ACRE: Loaded 33725 primary data records. [2025-09-17T22:47:00.382227] [DEBUG] [MAIN ] ACR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:00.383199] [INFO ] [MAIN ] ACR: Generated 1794 derivative records from 6484 primary records. [2025-09-17T22:47:00.383466] [DEBUG] [LOCAL ] ACR: Saving derivative data. [2025-09-17T22:47:00.413952] [DEBUG] [LOCAL ] ACR: Derivative data saved (1794 records). [2025-09-17T22:47:00.414254] [INFO ] [MAIN ] ACR: Successfully saved derivative data. [2025-09-17T22:47:00.416112] [INFO ] [MAIN ] Derivative Progress: 19/2085 symbols completed. ACR took 1.1s. Estimated remaining: 14m 51s. Rate: 139.2 symbols/min [2025-09-17T22:47:00.416503] [DEBUG] [MAIN ] ACP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:00.417597] [INFO ] [MAIN ] ACP: Generated 1794 derivative records from 31453 primary records. [2025-09-17T22:47:00.417882] [INFO ] [MAIN ] ACVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:00.418145] [DEBUG] [LOCAL ] ACP: Saving derivative data. [2025-09-17T22:47:00.444743] [DEBUG] [LOCAL ] ACP: Derivative data saved (1794 records). [2025-09-17T22:47:00.449669] [INFO ] [MAIN ] ACP: Successfully saved derivative data. [2025-09-17T22:47:00.452831] [INFO ] [MAIN ] Derivative Progress: 20/2085 symbols completed. ACP took 1.2s. Estimated remaining: 14m 10s. Rate: 145.8 symbols/min [2025-09-17T22:47:00.449950] [DEBUG] [MAIN ] ACRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:00.453196] [INFO ] [MAIN ] ADC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:00.454009] [INFO ] [MAIN ] ACRE: Generated 1794 derivative records from 33725 primary records. [2025-09-17T22:47:00.454258] [DEBUG] [LOCAL ] ACRE: Saving derivative data. [2025-09-17T22:47:00.471337] [DEBUG] [LOCAL ] ACRE: Derivative data saved (1794 records). [2025-09-17T22:47:00.471508] [INFO ] [MAIN ] ACRE: Successfully saved derivative data. [2025-09-17T22:47:00.474299] [INFO ] [MAIN ] Derivative Progress: 21/2085 symbols completed. ACRE took 1.2s. Estimated remaining: 13m 31s. Rate: 152.7 symbols/min [2025-09-17T22:47:00.474600] [INFO ] [MAIN ] ADM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:00.519061] [DEBUG] [LOCAL ] ACVA: Loaded 49377 existing records from primary storage. [2025-09-17T22:47:00.519315] [INFO ] [MAIN ] ACVA: Loaded 49377 primary data records. [2025-09-17T22:47:00.663929] [DEBUG] [LOCAL ] ADC: Loaded 46645 existing records from primary storage. [2025-09-17T22:47:00.664693] [INFO ] [MAIN ] ADC: Loaded 46645 primary data records. [2025-09-17T22:47:00.959823] [DEBUG] [LOCAL ] ADM: Loaded 53399 existing records from primary storage. [2025-09-17T22:47:00.992046] [INFO ] [MAIN ] ADM: Loaded 53399 primary data records. [2025-09-17T22:47:01.537898] [DEBUG] [MAIN ] ACVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:01.539198] [INFO ] [MAIN ] ACVA: Generated 1794 derivative records from 49377 primary records. [2025-09-17T22:47:01.539495] [DEBUG] [LOCAL ] ACVA: Saving derivative data. [2025-09-17T22:47:01.559233] [DEBUG] [LOCAL ] ACVA: Derivative data saved (1794 records). [2025-09-17T22:47:01.561040] [INFO ] [MAIN ] ACVA: Successfully saved derivative data. [2025-09-17T22:47:01.563331] [INFO ] [MAIN ] Derivative Progress: 22/2085 symbols completed. ACVA took 1.1s. Estimated remaining: 14m 36s. Rate: 141.3 symbols/min [2025-09-17T22:47:01.563793] [INFO ] [MAIN ] ADT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:01.578833] [DEBUG] [MAIN ] ADC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:01.579706] [INFO ] [MAIN ] ADC: Generated 1794 derivative records from 46645 primary records. [2025-09-17T22:47:01.579999] [DEBUG] [LOCAL ] ADC: Saving derivative data. [2025-09-17T22:47:01.600368] [DEBUG] [LOCAL ] ADC: Derivative data saved (1794 records). [2025-09-17T22:47:01.613804] [INFO ] [MAIN ] ADC: Successfully saved derivative data. [2025-09-17T22:47:01.613729] [DEBUG] [MAIN ] ADM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:01.614697] [INFO ] [MAIN ] ADM: Generated 1794 derivative records from 53399 primary records. [2025-09-17T22:47:01.617037] [INFO ] [MAIN ] Derivative Progress: 23/2085 symbols completed. ADC took 1.2s. Estimated remaining: 14m 2s. Rate: 146.9 symbols/min [2025-09-17T22:47:01.617454] [INFO ] [MAIN ] AEE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:01.617687] [DEBUG] [LOCAL ] ADM: Saving derivative data. [2025-09-17T22:47:01.639078] [DEBUG] [LOCAL ] ADM: Derivative data saved (1794 records). [2025-09-17T22:47:01.639238] [INFO ] [MAIN ] ADM: Successfully saved derivative data. [2025-09-17T22:47:01.641944] [INFO ] [MAIN ] Derivative Progress: 24/2085 symbols completed. ADM took 1.2s. Estimated remaining: 13m 29s. Rate: 152.9 symbols/min [2025-09-17T22:47:01.642558] [INFO ] [MAIN ] AEG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:01.700779] [DEBUG] [LOCAL ] ADT: Loaded 53454 existing records from primary storage. [2025-09-17T22:47:01.701128] [INFO ] [MAIN ] ADT: Loaded 53454 primary data records. [2025-09-17T22:47:01.956935] [DEBUG] [LOCAL ] AEE: Loaded 50329 existing records from primary storage. [2025-09-17T22:47:02.085227] [INFO ] [MAIN ] AEE: Loaded 50329 primary data records. [2025-09-17T22:47:02.085106] [DEBUG] [LOCAL ] AEG: Loaded 49607 existing records from primary storage. [2025-09-17T22:47:02.085368] [INFO ] [MAIN ] AEG: Loaded 49607 primary data records. [2025-09-17T22:47:02.786894] [DEBUG] [MAIN ] ADT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:02.788221] [INFO ] [MAIN ] ADT: Generated 1794 derivative records from 53454 primary records. [2025-09-17T22:47:02.789956] [DEBUG] [LOCAL ] ADT: Saving derivative data. [2025-09-17T22:47:02.810109] [DEBUG] [LOCAL ] ADT: Derivative data saved (1794 records). [2025-09-17T22:47:02.810546] [INFO ] [MAIN ] ADT: Successfully saved derivative data. [2025-09-17T22:47:02.812988] [INFO ] [MAIN ] Derivative Progress: 25/2085 symbols completed. ADT took 1.2s. Estimated remaining: 14m 33s. Rate: 141.7 symbols/min [2025-09-17T22:47:02.813311] [INFO ] [MAIN ] AEM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:02.833216] [DEBUG] [MAIN ] AEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:02.834219] [INFO ] [MAIN ] AEE: Generated 1794 derivative records from 50329 primary records. [2025-09-17T22:47:02.846261] [DEBUG] [LOCAL ] AEE: Saving derivative data. [2025-09-17T22:47:02.847028] [DEBUG] [MAIN ] AEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:02.848219] [INFO ] [MAIN ] AEG: Generated 1794 derivative records from 49607 primary records. [2025-09-17T22:47:02.848513] [DEBUG] [LOCAL ] AEG: Saving derivative data. [2025-09-17T22:47:02.876695] [DEBUG] [LOCAL ] AEG: Derivative data saved (1794 records). [2025-09-17T22:47:02.877334] [INFO ] [MAIN ] AEG: Successfully saved derivative data. [2025-09-17T22:47:02.879717] [INFO ] [MAIN ] Derivative Progress: 26/2085 symbols completed. AEG took 1.2s. Estimated remaining: 14m 4s. Rate: 146.4 symbols/min [2025-09-17T22:47:02.880429] [INFO ] [MAIN ] AEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:02.883967] [DEBUG] [LOCAL ] AEE: Derivative data saved (1794 records). [2025-09-17T22:47:02.884098] [INFO ] [MAIN ] AEE: Successfully saved derivative data. [2025-09-17T22:47:02.885942] [INFO ] [MAIN ] Derivative Progress: 27/2085 symbols completed. AEE took 1.3s. Estimated remaining: 13m 33s. Rate: 151.9 symbols/min [2025-09-17T22:47:02.886473] [INFO ] [MAIN ] AER: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:02.929321] [DEBUG] [LOCAL ] AEM: Loaded 53464 existing records from primary storage. [2025-09-17T22:47:02.929630] [INFO ] [MAIN ] AEM: Loaded 53464 primary data records. [2025-09-17T22:47:03.295541] [DEBUG] [LOCAL ] AER: Loaded 48860 existing records from primary storage. [2025-09-17T22:47:03.297160] [DEBUG] [LOCAL ] AEO: Loaded 53557 existing records from primary storage. [2025-09-17T22:47:03.297472] [INFO ] [MAIN ] AER: Loaded 48860 primary data records. [2025-09-17T22:47:03.297828] [INFO ] [MAIN ] AEO: Loaded 53557 primary data records. [2025-09-17T22:47:03.957177] [DEBUG] [MAIN ] AEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:03.958276] [INFO ] [MAIN ] AEM: Generated 1794 derivative records from 53464 primary records. [2025-09-17T22:47:03.959979] [DEBUG] [LOCAL ] AEM: Saving derivative data. [2025-09-17T22:47:03.978283] [DEBUG] [LOCAL ] AEM: Derivative data saved (1794 records). [2025-09-17T22:47:03.978464] [INFO ] [MAIN ] AEM: Successfully saved derivative data. [2025-09-17T22:47:03.980696] [INFO ] [MAIN ] Derivative Progress: 28/2085 symbols completed. AEM took 1.2s. Estimated remaining: 14m 24s. Rate: 142.9 symbols/min [2025-09-17T22:47:03.999772] [DEBUG] [MAIN ] AER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:04.012619] [INFO ] [MAIN ] AER: Generated 1794 derivative records from 48860 primary records. [2025-09-17T22:47:04.011921] [DEBUG] [MAIN ] AEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:04.012797] [DEBUG] [LOCAL ] AER: Saving derivative data. [2025-09-17T22:47:04.013341] [INFO ] [MAIN ] AEO: Generated 1794 derivative records from 53557 primary records. [2025-09-17T22:47:04.013834] [DEBUG] [LOCAL ] AEO: Saving derivative data. [2025-09-17T22:47:04.041753] [DEBUG] [LOCAL ] AEO: Derivative data saved (1794 records). [2025-09-17T22:47:04.042003] [INFO ] [MAIN ] AEO: Successfully saved derivative data. [2025-09-17T22:47:04.045001] [INFO ] [MAIN ] Derivative Progress: 29/2085 symbols completed. AEO took 1.2s. Estimated remaining: 13m 58s. Rate: 147.2 symbols/min [2025-09-17T22:47:04.047796] [DEBUG] [LOCAL ] AER: Derivative data saved (1794 records). [2025-09-17T22:47:04.047866] [INFO ] [MAIN ] AER: Successfully saved derivative data. [2025-09-17T22:47:04.050256] [INFO ] [MAIN ] Derivative Progress: 30/2085 symbols completed. AER took 1.2s. Estimated remaining: 13m 30s. Rate: 152.2 symbols/min [2025-09-17T22:47:04.051119] [INFO ] [MAIN ] AFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:04.050809] [INFO ] [MAIN ] AES: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:04.051043] [INFO ] [MAIN ] AFB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:04.067156] [DEBUG] [LOCAL ] AFB: Loaded 11493 existing records from primary storage. [2025-09-17T22:47:04.067295] [INFO ] [MAIN ] AFB: Loaded 11493 primary data records. [2025-09-17T22:47:04.214559] [DEBUG] [LOCAL ] AFG: Loaded 32758 existing records from primary storage. [2025-09-17T22:47:04.225460] [INFO ] [MAIN ] AFG: Loaded 32758 primary data records. [2025-09-17T22:47:04.599252] [DEBUG] [LOCAL ] AES: Loaded 53674 existing records from primary storage. [2025-09-17T22:47:04.605537] [INFO ] [MAIN ] AES: Loaded 53674 primary data records. [2025-09-17T22:47:05.187568] [DEBUG] [MAIN ] AFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:05.188453] [INFO ] [MAIN ] AFB: Generated 1794 derivative records from 11493 primary records. [2025-09-17T22:47:05.188703] [DEBUG] [LOCAL ] AFB: Saving derivative data. [2025-09-17T22:47:05.219456] [DEBUG] [MAIN ] AFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:05.221456] [INFO ] [MAIN ] AFG: Generated 1794 derivative records from 32758 primary records. [2025-09-17T22:47:05.222572] [DEBUG] [LOCAL ] AFG: Saving derivative data. [2025-09-17T22:47:05.224515] [DEBUG] [LOCAL ] AFB: Derivative data saved (1794 records). [2025-09-17T22:47:05.231751] [INFO ] [MAIN ] AFB: Successfully saved derivative data. [2025-09-17T22:47:05.234026] [INFO ] [MAIN ] Derivative Progress: 31/2085 symbols completed. AFB took 1.2s. Estimated remaining: 14m 22s. Rate: 143.0 symbols/min [2025-09-17T22:47:05.235973] [INFO ] [MAIN ] AFGB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:05.261181] [DEBUG] [MAIN ] AES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:05.262388] [INFO ] [MAIN ] AES: Generated 1794 derivative records from 53674 primary records. [2025-09-17T22:47:05.262956] [DEBUG] [LOCAL ] AES: Saving derivative data. [2025-09-17T22:47:05.283115] [DEBUG] [LOCAL ] AFGB: Loaded 2510 existing records from primary storage. [2025-09-17T22:47:05.284301] [DEBUG] [LOCAL ] AES: Derivative data saved (1794 records). [2025-09-17T22:47:05.284751] [DEBUG] [LOCAL ] AFG: Derivative data saved (1794 records). [2025-09-17T22:47:05.284916] [INFO ] [MAIN ] AES: Successfully saved derivative data. [2025-09-17T22:47:05.284683] [INFO ] [MAIN ] AFGB: Loaded 2510 primary data records. [2025-09-17T22:47:05.287101] [INFO ] [MAIN ] Derivative Progress: 32/2085 symbols completed. AES took 1.2s. Estimated remaining: 13m 58s. Rate: 147.0 symbols/min [2025-09-17T22:47:05.284997] [INFO ] [MAIN ] AFG: Successfully saved derivative data. [2025-09-17T22:47:05.313799] [INFO ] [MAIN ] Derivative Progress: 33/2085 symbols completed. AFG took 1.3s. Estimated remaining: 13m 34s. Rate: 151.3 symbols/min [2025-09-17T22:47:05.310089] [INFO ] [MAIN ] AFGC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:05.330375] [INFO ] [MAIN ] AFGD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:05.386066] [DEBUG] [LOCAL ] AFGC: Loaded 2530 existing records from primary storage. [2025-09-17T22:47:05.405537] [DEBUG] [LOCAL ] AFGD: Loaded 1882 existing records from primary storage. [2025-09-17T22:47:05.405979] [INFO ] [MAIN ] AFGD: Loaded 1882 primary data records. [2025-09-17T22:47:05.403881] [INFO ] [MAIN ] AFGC: Loaded 2530 primary data records. [2025-09-17T22:47:06.260744] [DEBUG] [MAIN ] AFGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:06.261896] [INFO ] [MAIN ] AFGB: Generated 1794 derivative records from 2510 primary records. [2025-09-17T22:47:06.262077] [DEBUG] [LOCAL ] AFGB: Saving derivative data. [2025-09-17T22:47:06.281424] [DEBUG] [LOCAL ] AFGB: Derivative data saved (1794 records). [2025-09-17T22:47:06.294753] [INFO ] [MAIN ] AFGB: Successfully saved derivative data. [2025-09-17T22:47:06.295724] [DEBUG] [MAIN ] AFGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:06.299256] [INFO ] [MAIN ] AFGD: Generated 1794 derivative records from 1882 primary records. [2025-09-17T22:47:06.298351] [INFO ] [MAIN ] Derivative Progress: 34/2085 symbols completed. AFGB took 1.1s. Estimated remaining: 14m 9s. Rate: 144.9 symbols/min [2025-09-17T22:47:06.299394] [DEBUG] [LOCAL ] AFGD: Saving derivative data. [2025-09-17T22:47:06.300587] [INFO ] [MAIN ] AFGE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:06.326454] [DEBUG] [MAIN ] AFGC: Filtered 6931 bins outside market hours, 7730 incomplete bins [2025-09-17T22:47:06.326135] [DEBUG] [LOCAL ] AFGD: Derivative data saved (1794 records). [2025-09-17T22:47:06.327276] [INFO ] [MAIN ] AFGC: Generated 1788 derivative records from 2530 primary records. [2025-09-17T22:47:06.327954] [DEBUG] [LOCAL ] AFGC: Saving derivative data. [2025-09-17T22:47:06.328034] [INFO ] [MAIN ] AFGD: Successfully saved derivative data. [2025-09-17T22:47:06.330704] [INFO ] [MAIN ] Derivative Progress: 35/2085 symbols completed. AFGD took 1.0s. Estimated remaining: 13m 46s. Rate: 148.9 symbols/min [2025-09-17T22:47:06.339579] [INFO ] [MAIN ] AFL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:06.339753] [DEBUG] [LOCAL ] AFGE: Loaded 2507 existing records from primary storage. [2025-09-17T22:47:06.346658] [INFO ] [MAIN ] AFGE: Loaded 2507 primary data records. [2025-09-17T22:47:06.358258] [DEBUG] [LOCAL ] AFGC: Derivative data saved (1788 records). [2025-09-17T22:47:06.378354] [INFO ] [MAIN ] AFGC: Successfully saved derivative data. [2025-09-17T22:47:06.385753] [INFO ] [MAIN ] Derivative Progress: 36/2085 symbols completed. AFGC took 1.1s. Estimated remaining: 13m 26s. Rate: 152.5 symbols/min [2025-09-17T22:47:06.405379] [INFO ] [MAIN ] AG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:06.752077] [DEBUG] [MAIN ] AFGE: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-17T22:47:06.753555] [INFO ] [MAIN ] AFGE: Generated 1792 derivative records from 2507 primary records. [2025-09-17T22:47:06.768832] [DEBUG] [LOCAL ] AFGE: Saving derivative data. [2025-09-17T22:47:06.794893] [DEBUG] [LOCAL ] AFL: Loaded 53148 existing records from primary storage. [2025-09-17T22:47:06.798830] [INFO ] [MAIN ] AFL: Loaded 53148 primary data records. [2025-09-17T22:47:06.799564] [DEBUG] [LOCAL ] AG: Loaded 53641 existing records from primary storage. [2025-09-17T22:47:06.802248] [DEBUG] [LOCAL ] AFGE: Derivative data saved (1792 records). [2025-09-17T22:47:06.802326] [INFO ] [MAIN ] AG: Loaded 53641 primary data records. [2025-09-17T22:47:06.814293] [INFO ] [MAIN ] AFGE: Successfully saved derivative data. [2025-09-17T22:47:06.853447] [INFO ] [MAIN ] Derivative Progress: 37/2085 symbols completed. AFGE took 0.6s. Estimated remaining: 13m 30s. Rate: 151.8 symbols/min [2025-09-17T22:47:06.905940] [INFO ] [MAIN ] AGCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:07.442897] [DEBUG] [LOCAL ] AGCO: Loaded 42813 existing records from primary storage. [2025-09-17T22:47:07.443721] [INFO ] [MAIN ] AGCO: Loaded 42813 primary data records. [2025-09-17T22:47:07.787588] [DEBUG] [MAIN ] AFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:07.793773] [INFO ] [MAIN ] AFL: Generated 1794 derivative records from 53148 primary records. [2025-09-17T22:47:07.794325] [DEBUG] [LOCAL ] AFL: Saving derivative data. [2025-09-17T22:47:07.795373] [DEBUG] [MAIN ] AG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:07.797379] [INFO ] [MAIN ] AG: Generated 1794 derivative records from 53641 primary records. [2025-09-17T22:47:07.808949] [DEBUG] [LOCAL ] AG: Saving derivative data. [2025-09-17T22:47:07.815522] [DEBUG] [LOCAL ] AFL: Derivative data saved (1794 records). [2025-09-17T22:47:07.815987] [INFO ] [MAIN ] AFL: Successfully saved derivative data. [2025-09-17T22:47:07.818470] [INFO ] [MAIN ] Derivative Progress: 38/2085 symbols completed. AFL took 1.5s. Estimated remaining: 14m 0s. Rate: 146.2 symbols/min [2025-09-17T22:47:07.818945] [INFO ] [MAIN ] AGD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:07.835821] [DEBUG] [LOCAL ] AG: Derivative data saved (1794 records). [2025-09-17T22:47:07.836127] [INFO ] [MAIN ] AG: Successfully saved derivative data. [2025-09-17T22:47:07.837981] [INFO ] [MAIN ] Derivative Progress: 39/2085 symbols completed. AG took 1.4s. Estimated remaining: 13m 39s. Rate: 149.9 symbols/min [2025-09-17T22:47:07.838564] [INFO ] [MAIN ] AGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:07.869030] [DEBUG] [MAIN ] AGCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:07.869919] [DEBUG] [LOCAL ] AGD: Loaded 17614 existing records from primary storage. [2025-09-17T22:47:07.870792] [INFO ] [MAIN ] AGCO: Generated 1794 derivative records from 42813 primary records. [2025-09-17T22:47:07.870993] [DEBUG] [LOCAL ] AGCO: Saving derivative data. [2025-09-17T22:47:07.870934] [INFO ] [MAIN ] AGD: Loaded 17614 primary data records. [2025-09-17T22:47:08.202869] [DEBUG] [LOCAL ] AGCO: Derivative data saved (1794 records). [2025-09-17T22:47:08.203694] [INFO ] [MAIN ] AGCO: Successfully saved derivative data. [2025-09-17T22:47:08.207461] [INFO ] [MAIN ] Derivative Progress: 40/2085 symbols completed. AGCO took 1.3s. Estimated remaining: 13m 37s. Rate: 150.2 symbols/min [2025-09-17T22:47:08.207873] [INFO ] [MAIN ] AGL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:08.228879] [DEBUG] [LOCAL ] AGI: Loaded 53412 existing records from primary storage. [2025-09-17T22:47:08.229137] [INFO ] [MAIN ] AGI: Loaded 53412 primary data records. [2025-09-17T22:47:08.599323] [DEBUG] [LOCAL ] AGL: Loaded 52408 existing records from primary storage. [2025-09-17T22:47:08.600980] [INFO ] [MAIN ] AGL: Loaded 52408 primary data records. [2025-09-17T22:47:08.651119] [DEBUG] [MAIN ] AGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:08.680280] [INFO ] [MAIN ] AGD: Generated 1794 derivative records from 17614 primary records. [2025-09-17T22:47:08.685499] [DEBUG] [LOCAL ] AGD: Saving derivative data. [2025-09-17T22:47:08.747082] [DEBUG] [LOCAL ] AGD: Derivative data saved (1794 records). [2025-09-17T22:47:08.783944] [INFO ] [MAIN ] AGD: Successfully saved derivative data. [2025-09-17T22:47:08.922135] [INFO ] [MAIN ] Derivative Progress: 41/2085 symbols completed. AGD took 1.1s. Estimated remaining: 13m 52s. Rate: 147.3 symbols/min [2025-09-17T22:47:08.935920] [INFO ] [MAIN ] AGM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:08.965631] [DEBUG] [LOCAL ] AGM: Loaded 9839 existing records from primary storage. [2025-09-17T22:47:08.965366] [DEBUG] [MAIN ] AGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:08.965862] [INFO ] [MAIN ] AGM: Loaded 9839 primary data records. [2025-09-17T22:47:08.966550] [INFO ] [MAIN ] AGI: Generated 1794 derivative records from 53412 primary records. [2025-09-17T22:47:08.966635] [DEBUG] [LOCAL ] AGI: Saving derivative data. [2025-09-17T22:47:09.071738] [DEBUG] [LOCAL ] AGI: Derivative data saved (1794 records). [2025-09-17T22:47:09.078052] [INFO ] [MAIN ] AGI: Successfully saved derivative data. [2025-09-17T22:47:09.091192] [INFO ] [MAIN ] Derivative Progress: 42/2085 symbols completed. AGI took 1.3s. Estimated remaining: 13m 40s. Rate: 149.4 symbols/min [2025-09-17T22:47:09.091668] [INFO ] [MAIN ] AGO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:09.315306] [DEBUG] [MAIN ] AGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:09.316322] [INFO ] [MAIN ] AGL: Generated 1794 derivative records from 52408 primary records. [2025-09-17T22:47:09.317075] [DEBUG] [LOCAL ] AGL: Saving derivative data. [2025-09-17T22:47:09.344231] [DEBUG] [LOCAL ] AGL: Derivative data saved (1794 records). [2025-09-17T22:47:09.344560] [INFO ] [MAIN ] AGL: Successfully saved derivative data. [2025-09-17T22:47:09.345148] [DEBUG] [LOCAL ] AGO: Loaded 28188 existing records from primary storage. [2025-09-17T22:47:09.345635] [INFO ] [MAIN ] AGO: Loaded 28188 primary data records. [2025-09-17T22:47:09.347911] [INFO ] [MAIN ] Derivative Progress: 43/2085 symbols completed. AGL took 1.1s. Estimated remaining: 13m 33s. Rate: 150.7 symbols/min [2025-09-17T22:47:09.649794] [DEBUG] [MAIN ] AGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:09.662260] [INFO ] [MAIN ] AGM: Generated 1794 derivative records from 9839 primary records. [2025-09-17T22:47:09.662379] [DEBUG] [LOCAL ] AGM: Saving derivative data. [2025-09-17T22:47:09.681514] [DEBUG] [LOCAL ] AGM: Derivative data saved (1794 records). [2025-09-17T22:47:09.681601] [INFO ] [MAIN ] AGM: Successfully saved derivative data. [2025-09-17T22:47:09.683723] [INFO ] [MAIN ] Derivative Progress: 44/2085 symbols completed. AGM took 0.7s. Estimated remaining: 13m 30s. Rate: 151.2 symbols/min [2025-09-17T22:47:09.703208] [DEBUG] [MAIN ] AGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:09.703913] [INFO ] [MAIN ] AGO: Generated 1794 derivative records from 28188 primary records. [2025-09-17T22:47:09.704013] [DEBUG] [LOCAL ] AGO: Saving derivative data. [2025-09-17T22:47:09.719204] [DEBUG] [LOCAL ] AGO: Derivative data saved (1794 records). [2025-09-17T22:47:09.719265] [INFO ] [MAIN ] AGO: Successfully saved derivative data. [2025-09-17T22:47:09.721282] [INFO ] [MAIN ] Derivative Progress: 45/2085 symbols completed. AGO took 0.6s. Estimated remaining: 13m 13s. Rate: 154.3 symbols/min [2025-09-17T22:47:09.722228] [INFO ] [MAIN ] AHH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:09.722406] [INFO ] [MAIN ] AGX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:09.722073] [INFO ] [MAIN ] AGRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:09.788156] [DEBUG] [LOCAL ] AGX: Loaded 33538 existing records from primary storage. [2025-09-17T22:47:09.788633] [DEBUG] [LOCAL ] AGRO: Loaded 34065 existing records from primary storage. [2025-09-17T22:47:09.788786] [INFO ] [MAIN ] AGRO: Loaded 34065 primary data records. [2025-09-17T22:47:09.788871] [INFO ] [MAIN ] AGX: Loaded 33538 primary data records. [2025-09-17T22:47:09.965497] [DEBUG] [LOCAL ] AHH: Loaded 41658 existing records from primary storage. [2025-09-17T22:47:09.995731] [INFO ] [MAIN ] AHH: Loaded 41658 primary data records. [2025-09-17T22:47:10.790012] [DEBUG] [MAIN ] AGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:10.795374] [DEBUG] [MAIN ] AGRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:10.796354] [INFO ] [MAIN ] AGRO: Generated 1794 derivative records from 34065 primary records. [2025-09-17T22:47:10.797376] [INFO ] [MAIN ] AGX: Generated 1794 derivative records from 33538 primary records. [2025-09-17T22:47:10.796812] [DEBUG] [LOCAL ] AGRO: Saving derivative data. [2025-09-17T22:47:10.797474] [DEBUG] [LOCAL ] AGX: Saving derivative data. [2025-09-17T22:47:10.842998] [DEBUG] [LOCAL ] AGRO: Derivative data saved (1794 records). [2025-09-17T22:47:10.849271] [INFO ] [MAIN ] AGRO: Successfully saved derivative data. [2025-09-17T22:47:10.852140] [INFO ] [MAIN ] Derivative Progress: 46/2085 symbols completed. AGRO took 1.1s. Estimated remaining: 13m 46s. Rate: 148.2 symbols/min [2025-09-17T22:47:10.852702] [INFO ] [MAIN ] AHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:10.854193] [DEBUG] [MAIN ] AHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:10.856018] [INFO ] [MAIN ] AHH: Generated 1794 derivative records from 41658 primary records. [2025-09-17T22:47:10.856772] [DEBUG] [LOCAL ] AHH: Saving derivative data. [2025-09-17T22:47:10.875681] [DEBUG] [LOCAL ] AGX: Derivative data saved (1794 records). [2025-09-17T22:47:10.876434] [INFO ] [MAIN ] AGX: Successfully saved derivative data. [2025-09-17T22:47:10.879034] [INFO ] [MAIN ] Derivative Progress: 47/2085 symbols completed. AGX took 1.2s. Estimated remaining: 13m 29s. Rate: 151.2 symbols/min [2025-09-17T22:47:10.879609] [INFO ] [MAIN ] AHT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:10.885266] [DEBUG] [LOCAL ] AHH: Derivative data saved (1794 records). [2025-09-17T22:47:10.885581] [INFO ] [MAIN ] AHH: Successfully saved derivative data. [2025-09-17T22:47:10.890617] [INFO ] [MAIN ] Derivative Progress: 48/2085 symbols completed. AHH took 1.2s. Estimated remaining: 13m 12s. Rate: 154.3 symbols/min [2025-09-17T22:47:10.891033] [INFO ] [MAIN ] AI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:10.899906] [DEBUG] [LOCAL ] AHT: Loaded 5934 existing records from primary storage. [2025-09-17T22:47:10.900046] [INFO ] [MAIN ] AHT: Loaded 5934 primary data records. [2025-09-17T22:47:11.238525] [DEBUG] [LOCAL ] AHR: Loaded 49378 existing records from primary storage. [2025-09-17T22:47:11.238900] [INFO ] [MAIN ] AHR: Loaded 49378 primary data records. [2025-09-17T22:47:11.437531] [DEBUG] [LOCAL ] AI: Loaded 53749 existing records from primary storage. [2025-09-17T22:47:11.448765] [INFO ] [MAIN ] AI: Loaded 53749 primary data records. [2025-09-17T22:47:11.913444] [DEBUG] [MAIN ] AHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:11.929380] [INFO ] [MAIN ] AHT: Generated 1794 derivative records from 5934 primary records. [2025-09-17T22:47:11.929883] [DEBUG] [LOCAL ] AHT: Saving derivative data. [2025-09-17T22:47:11.946620] [DEBUG] [LOCAL ] AHT: Derivative data saved (1794 records). [2025-09-17T22:47:11.947156] [INFO ] [MAIN ] AHT: Successfully saved derivative data. [2025-09-17T22:47:11.949122] [INFO ] [MAIN ] Derivative Progress: 49/2085 symbols completed. AHT took 1.1s. Estimated remaining: 13m 40s. Rate: 149.1 symbols/min [2025-09-17T22:47:11.950005] [INFO ] [MAIN ] AIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:11.968727] [DEBUG] [MAIN ] AHR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:47:11.969690] [INFO ] [MAIN ] AHR: Generated 1793 derivative records from 49378 primary records. [2025-09-17T22:47:11.969916] [DEBUG] [LOCAL ] AHR: Saving derivative data. [2025-09-17T22:47:11.986801] [DEBUG] [LOCAL ] AHR: Derivative data saved (1793 records). [2025-09-17T22:47:11.987136] [INFO ] [MAIN ] AHR: Successfully saved derivative data. [2025-09-17T22:47:11.989434] [INFO ] [MAIN ] Derivative Progress: 50/2085 symbols completed. AHR took 1.1s. Estimated remaining: 13m 24s. Rate: 151.8 symbols/min [2025-09-17T22:47:11.990019] [INFO ] [MAIN ] AIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:12.006776] [DEBUG] [MAIN ] AI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:12.007493] [INFO ] [MAIN ] AI: Generated 1794 derivative records from 53749 primary records. [2025-09-17T22:47:12.007629] [DEBUG] [LOCAL ] AI: Saving derivative data. [2025-09-17T22:47:12.043246] [DEBUG] [LOCAL ] AI: Derivative data saved (1794 records). [2025-09-17T22:47:12.043387] [INFO ] [MAIN ] AI: Successfully saved derivative data. [2025-09-17T22:47:12.045899] [INFO ] [MAIN ] Derivative Progress: 51/2085 symbols completed. AI took 1.2s. Estimated remaining: 13m 11s. Rate: 154.4 symbols/min [2025-09-17T22:47:12.047199] [INFO ] [MAIN ] AIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:12.055247] [DEBUG] [LOCAL ] AIN: Loaded 24588 existing records from primary storage. [2025-09-17T22:47:12.055820] [INFO ] [MAIN ] AIN: Loaded 24588 primary data records. [2025-09-17T22:47:12.107916] [DEBUG] [LOCAL ] AIG: Loaded 53477 existing records from primary storage. [2025-09-17T22:47:12.127436] [INFO ] [MAIN ] AIG: Loaded 53477 primary data records. [2025-09-17T22:47:12.258510] [DEBUG] [LOCAL ] AIO: Loaded 13406 existing records from primary storage. [2025-09-17T22:47:12.296847] [INFO ] [MAIN ] AIO: Loaded 13406 primary data records. [2025-09-17T22:47:13.099766] [DEBUG] [MAIN ] AIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:13.101247] [INFO ] [MAIN ] AIN: Generated 1794 derivative records from 24588 primary records. [2025-09-17T22:47:13.101747] [DEBUG] [LOCAL ] AIN: Saving derivative data. [2025-09-17T22:47:13.123755] [DEBUG] [LOCAL ] AIN: Derivative data saved (1794 records). [2025-09-17T22:47:13.146286] [INFO ] [MAIN ] AIN: Successfully saved derivative data. [2025-09-17T22:47:13.146085] [DEBUG] [MAIN ] AIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:13.153221] [INFO ] [MAIN ] Derivative Progress: 52/2085 symbols completed. AIN took 1.2s. Estimated remaining: 13m 38s. Rate: 149.1 symbols/min [2025-09-17T22:47:13.153551] [INFO ] [MAIN ] AIR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:13.154391] [INFO ] [MAIN ] AIO: Generated 1794 derivative records from 13406 primary records. [2025-09-17T22:47:13.154957] [DEBUG] [LOCAL ] AIO: Saving derivative data. [2025-09-17T22:47:13.155467] [DEBUG] [MAIN ] AIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:13.157318] [INFO ] [MAIN ] AIG: Generated 1794 derivative records from 53477 primary records. [2025-09-17T22:47:13.157535] [DEBUG] [LOCAL ] AIG: Saving derivative data. [2025-09-17T22:47:13.185027] [DEBUG] [LOCAL ] AIO: Derivative data saved (1794 records). [2025-09-17T22:47:13.189449] [DEBUG] [LOCAL ] AIG: Derivative data saved (1794 records). [2025-09-17T22:47:13.188803] [INFO ] [MAIN ] AIO: Successfully saved derivative data. [2025-09-17T22:47:13.191869] [INFO ] [MAIN ] Derivative Progress: 53/2085 symbols completed. AIO took 1.1s. Estimated remaining: 13m 24s. Rate: 151.7 symbols/min [2025-09-17T22:47:13.189614] [INFO ] [MAIN ] AIG: Successfully saved derivative data. [2025-09-17T22:47:13.194593] [INFO ] [MAIN ] Derivative Progress: 54/2085 symbols completed. AIG took 1.2s. Estimated remaining: 13m 9s. Rate: 154.5 symbols/min [2025-09-17T22:47:13.192289] [INFO ] [MAIN ] AIT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:13.195487] [INFO ] [MAIN ] AIV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:13.218630] [DEBUG] [LOCAL ] AIR: Loaded 26996 existing records from primary storage. [2025-09-17T22:47:13.218841] [INFO ] [MAIN ] AIR: Loaded 26996 primary data records. [2025-09-17T22:47:13.407437] [DEBUG] [LOCAL ] AIV: Loaded 40154 existing records from primary storage. [2025-09-17T22:47:13.401661] [DEBUG] [LOCAL ] AIT: Loaded 28515 existing records from primary storage. [2025-09-17T22:47:13.412748] [INFO ] [MAIN ] AIV: Loaded 40154 primary data records. [2025-09-17T22:47:13.438975] [INFO ] [MAIN ] AIT: Loaded 28515 primary data records. [2025-09-17T22:47:14.233976] [DEBUG] [MAIN ] AIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:14.235795] [INFO ] [MAIN ] AIR: Generated 1794 derivative records from 26996 primary records. [2025-09-17T22:47:14.236070] [DEBUG] [LOCAL ] AIR: Saving derivative data. [2025-09-17T22:47:14.255431] [DEBUG] [LOCAL ] AIR: Derivative data saved (1794 records). [2025-09-17T22:47:14.257310] [INFO ] [MAIN ] AIR: Successfully saved derivative data. [2025-09-17T22:47:14.259276] [INFO ] [MAIN ] Derivative Progress: 55/2085 symbols completed. AIR took 1.1s. Estimated remaining: 13m 33s. Rate: 149.8 symbols/min [2025-09-17T22:47:14.259684] [INFO ] [MAIN ] AIZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:14.274721] [DEBUG] [MAIN ] AIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:14.275484] [INFO ] [MAIN ] AIV: Generated 1794 derivative records from 40154 primary records. [2025-09-17T22:47:14.275848] [DEBUG] [LOCAL ] AIV: Saving derivative data. [2025-09-17T22:47:14.292437] [DEBUG] [LOCAL ] AIV: Derivative data saved (1794 records). [2025-09-17T22:47:14.292533] [INFO ] [MAIN ] AIV: Successfully saved derivative data. [2025-09-17T22:47:14.296767] [INFO ] [MAIN ] Derivative Progress: 56/2085 symbols completed. AIV took 1.1s. Estimated remaining: 13m 20s. Rate: 152.2 symbols/min [2025-09-17T22:47:14.298701] [INFO ] [MAIN ] AIZN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:14.315151] [DEBUG] [MAIN ] AIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:14.316004] [INFO ] [MAIN ] AIT: Generated 1794 derivative records from 28515 primary records. [2025-09-17T22:47:14.316086] [DEBUG] [LOCAL ] AIT: Saving derivative data. [2025-09-17T22:47:14.319791] [DEBUG] [LOCAL ] AIZN: Loaded 3965 existing records from primary storage. [2025-09-17T22:47:14.329086] [INFO ] [MAIN ] AIZN: Loaded 3965 primary data records. [2025-09-17T22:47:14.475319] [DEBUG] [LOCAL ] AIZ: Loaded 30418 existing records from primary storage. [2025-09-17T22:47:14.474041] [DEBUG] [LOCAL ] AIT: Derivative data saved (1794 records). [2025-09-17T22:47:14.475529] [INFO ] [MAIN ] AIZ: Loaded 30418 primary data records. [2025-09-17T22:47:14.475678] [INFO ] [MAIN ] AIT: Successfully saved derivative data. [2025-09-17T22:47:14.478479] [INFO ] [MAIN ] Derivative Progress: 57/2085 symbols completed. AIT took 1.3s. Estimated remaining: 13m 12s. Rate: 153.7 symbols/min [2025-09-17T22:47:14.538701] [INFO ] [MAIN ] AJG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:15.109052] [DEBUG] [LOCAL ] AJG: Loaded 47156 existing records from primary storage. [2025-09-17T22:47:15.109934] [INFO ] [MAIN ] AJG: Loaded 47156 primary data records. [2025-09-17T22:47:15.109452] [DEBUG] [MAIN ] AIZN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:15.110957] [INFO ] [MAIN ] AIZN: Generated 1794 derivative records from 3965 primary records. [2025-09-17T22:47:15.128904] [DEBUG] [LOCAL ] AIZN: Saving derivative data. [2025-09-17T22:47:15.188800] [DEBUG] [LOCAL ] AIZN: Derivative data saved (1794 records). [2025-09-17T22:47:15.210230] [INFO ] [MAIN ] AIZN: Successfully saved derivative data. [2025-09-17T22:47:15.222960] [INFO ] [MAIN ] Derivative Progress: 58/2085 symbols completed. AIZN took 0.9s. Estimated remaining: 13m 24s. Rate: 151.3 symbols/min [2025-09-17T22:47:15.344040] [DEBUG] [MAIN ] AIZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:15.458957] [INFO ] [MAIN ] AIZ: Generated 1794 derivative records from 30418 primary records. [2025-09-17T22:47:15.467572] [DEBUG] [LOCAL ] AIZ: Saving derivative data. [2025-09-17T22:47:15.484919] [DEBUG] [LOCAL ] AIZ: Derivative data saved (1794 records). [2025-09-17T22:47:15.485450] [INFO ] [MAIN ] AIZ: Successfully saved derivative data. [2025-09-17T22:47:15.487976] [INFO ] [MAIN ] Derivative Progress: 59/2085 symbols completed. AIZ took 1.2s. Estimated remaining: 13m 19s. Rate: 152.2 symbols/min [2025-09-17T22:47:15.508570] [DEBUG] [MAIN ] AJG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:15.509223] [INFO ] [MAIN ] AJG: Generated 1794 derivative records from 47156 primary records. [2025-09-17T22:47:15.509289] [DEBUG] [LOCAL ] AJG: Saving derivative data. [2025-09-17T22:47:15.524820] [DEBUG] [LOCAL ] AJG: Derivative data saved (1794 records). [2025-09-17T22:47:15.524879] [INFO ] [MAIN ] AJG: Successfully saved derivative data. [2025-09-17T22:47:15.526832] [INFO ] [MAIN ] Derivative Progress: 60/2085 symbols completed. AJG took 1.0s. Estimated remaining: 13m 6s. Rate: 154.5 symbols/min [2025-09-17T22:47:15.527541] [INFO ] [MAIN ] ALB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:15.527603] [INFO ] [MAIN ] ALC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:15.527324] [INFO ] [MAIN ] AL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:15.603158] [DEBUG] [LOCAL ] ALB: Loaded 53252 existing records from primary storage. [2025-09-17T22:47:15.603447] [INFO ] [MAIN ] ALB: Loaded 53252 primary data records. [2025-09-17T22:47:15.734598] [DEBUG] [LOCAL ] AL: Loaded 43915 existing records from primary storage. [2025-09-17T22:47:15.735367] [DEBUG] [LOCAL ] ALC: Loaded 50811 existing records from primary storage. [2025-09-17T22:47:15.735883] [INFO ] [MAIN ] AL: Loaded 43915 primary data records. [2025-09-17T22:47:15.735995] [INFO ] [MAIN ] ALC: Loaded 50811 primary data records. [2025-09-17T22:47:16.596297] [DEBUG] [MAIN ] ALB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:16.597127] [INFO ] [MAIN ] ALB: Generated 1794 derivative records from 53252 primary records. [2025-09-17T22:47:16.597361] [DEBUG] [LOCAL ] ALB: Saving derivative data. [2025-09-17T22:47:16.614018] [DEBUG] [LOCAL ] ALB: Derivative data saved (1794 records). [2025-09-17T22:47:16.617959] [INFO ] [MAIN ] ALB: Successfully saved derivative data. [2025-09-17T22:47:16.620462] [INFO ] [MAIN ] Derivative Progress: 61/2085 symbols completed. ALB took 1.1s. Estimated remaining: 13m 29s. Rate: 150.0 symbols/min [2025-09-17T22:47:16.620933] [INFO ] [MAIN ] ALE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:16.641408] [DEBUG] [MAIN ] AL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:16.647029] [INFO ] [MAIN ] AL: Generated 1794 derivative records from 43915 primary records. [2025-09-17T22:47:16.647297] [DEBUG] [MAIN ] ALC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:16.647422] [DEBUG] [LOCAL ] AL: Saving derivative data. [2025-09-17T22:47:16.648676] [INFO ] [MAIN ] ALC: Generated 1794 derivative records from 50811 primary records. [2025-09-17T22:47:16.648929] [DEBUG] [LOCAL ] ALC: Saving derivative data. [2025-09-17T22:47:16.679244] [DEBUG] [LOCAL ] ALC: Derivative data saved (1794 records). [2025-09-17T22:47:16.678700] [DEBUG] [LOCAL ] AL: Derivative data saved (1794 records). [2025-09-17T22:47:16.679526] [INFO ] [MAIN ] ALC: Successfully saved derivative data. [2025-09-17T22:47:16.679466] [INFO ] [MAIN ] AL: Successfully saved derivative data. [2025-09-17T22:47:16.683322] [INFO ] [MAIN ] Derivative Progress: 62/2085 symbols completed. AL took 1.2s. Estimated remaining: 13m 18s. Rate: 152.1 symbols/min [2025-09-17T22:47:16.685775] [INFO ] [MAIN ] Derivative Progress: 63/2085 symbols completed. ALC took 1.2s. Estimated remaining: 13m 5s. Rate: 154.5 symbols/min [2025-09-17T22:47:16.683612] [INFO ] [MAIN ] ALG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:16.686165] [INFO ] [MAIN ] ALIT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:16.708743] [DEBUG] [LOCAL ] ALG: Loaded 10693 existing records from primary storage. [2025-09-17T22:47:16.717682] [INFO ] [MAIN ] ALG: Loaded 10693 primary data records. [2025-09-17T22:47:16.740878] [DEBUG] [LOCAL ] ALE: Loaded 30063 existing records from primary storage. [2025-09-17T22:47:16.784471] [INFO ] [MAIN ] ALE: Loaded 30063 primary data records. [2025-09-17T22:47:17.177860] [DEBUG] [LOCAL ] ALIT: Loaded 52727 existing records from primary storage. [2025-09-17T22:47:17.198092] [INFO ] [MAIN ] ALIT: Loaded 52727 primary data records. [2025-09-17T22:47:17.694568] [DEBUG] [MAIN ] ALG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:17.695629] [INFO ] [MAIN ] ALG: Generated 1794 derivative records from 10693 primary records. [2025-09-17T22:47:17.695843] [DEBUG] [LOCAL ] ALG: Saving derivative data. [2025-09-17T22:47:17.728215] [DEBUG] [LOCAL ] ALG: Derivative data saved (1794 records). [2025-09-17T22:47:17.728469] [INFO ] [MAIN ] ALG: Successfully saved derivative data. [2025-09-17T22:47:17.730462] [INFO ] [MAIN ] Derivative Progress: 64/2085 symbols completed. ALG took 1.0s. Estimated remaining: 13m 25s. Rate: 150.6 symbols/min [2025-09-17T22:47:17.731328] [INFO ] [MAIN ] ALK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:17.731794] [DEBUG] [MAIN ] ALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:17.733171] [INFO ] [MAIN ] ALE: Generated 1794 derivative records from 30063 primary records. [2025-09-17T22:47:17.733359] [DEBUG] [LOCAL ] ALE: Saving derivative data. [2025-09-17T22:47:17.752947] [DEBUG] [LOCAL ] ALE: Derivative data saved (1794 records). [2025-09-17T22:47:17.753160] [INFO ] [MAIN ] ALE: Successfully saved derivative data. [2025-09-17T22:47:17.755292] [INFO ] [MAIN ] Derivative Progress: 65/2085 symbols completed. ALE took 1.1s. Estimated remaining: 13m 13s. Rate: 152.8 symbols/min [2025-09-17T22:47:17.768127] [DEBUG] [MAIN ] ALIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:17.768269] [INFO ] [MAIN ] ALL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:17.769173] [INFO ] [MAIN ] ALIT: Generated 1794 derivative records from 52727 primary records. [2025-09-17T22:47:17.769488] [DEBUG] [LOCAL ] ALIT: Saving derivative data. [2025-09-17T22:47:17.786723] [DEBUG] [LOCAL ] ALIT: Derivative data saved (1794 records). [2025-09-17T22:47:17.786935] [INFO ] [MAIN ] ALIT: Successfully saved derivative data. [2025-09-17T22:47:17.789361] [INFO ] [MAIN ] Derivative Progress: 66/2085 symbols completed. ALIT took 1.1s. Estimated remaining: 13m 2s. Rate: 154.9 symbols/min [2025-09-17T22:47:17.789706] [INFO ] [MAIN ] ALLE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:17.840953] [DEBUG] [LOCAL ] ALK: Loaded 53066 existing records from primary storage. [2025-09-17T22:47:17.841169] [INFO ] [MAIN ] ALK: Loaded 53066 primary data records. [2025-09-17T22:47:17.971546] [DEBUG] [LOCAL ] ALL: Loaded 50203 existing records from primary storage. [2025-09-17T22:47:17.976317] [INFO ] [MAIN ] ALL: Loaded 50203 primary data records. [2025-09-17T22:47:18.102310] [DEBUG] [LOCAL ] ALLE: Loaded 45276 existing records from primary storage. [2025-09-17T22:47:18.176067] [INFO ] [MAIN ] ALLE: Loaded 45276 primary data records. [2025-09-17T22:47:18.904921] [DEBUG] [MAIN ] ALK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:18.906110] [INFO ] [MAIN ] ALK: Generated 1794 derivative records from 53066 primary records. [2025-09-17T22:47:18.907316] [DEBUG] [LOCAL ] ALK: Saving derivative data. [2025-09-17T22:47:18.938422] [DEBUG] [LOCAL ] ALK: Derivative data saved (1794 records). [2025-09-17T22:47:18.938714] [INFO ] [MAIN ] ALK: Successfully saved derivative data. [2025-09-17T22:47:18.941619] [INFO ] [MAIN ] Derivative Progress: 67/2085 symbols completed. ALK took 1.2s. Estimated remaining: 13m 25s. Rate: 150.5 symbols/min [2025-09-17T22:47:18.942132] [INFO ] [MAIN ] ALLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:18.942971] [DEBUG] [MAIN ] ALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:18.947465] [INFO ] [MAIN ] ALL: Generated 1794 derivative records from 50203 primary records. [2025-09-17T22:47:18.948798] [DEBUG] [LOCAL ] ALL: Saving derivative data. [2025-09-17T22:47:18.974813] [DEBUG] [MAIN ] ALLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:18.976573] [INFO ] [MAIN ] ALLE: Generated 1794 derivative records from 45276 primary records. [2025-09-17T22:47:18.976980] [DEBUG] [LOCAL ] ALLE: Saving derivative data. [2025-09-17T22:47:18.982053] [DEBUG] [LOCAL ] ALL: Derivative data saved (1794 records). [2025-09-17T22:47:18.982460] [INFO ] [MAIN ] ALL: Successfully saved derivative data. [2025-09-17T22:47:18.984749] [INFO ] [MAIN ] Derivative Progress: 68/2085 symbols completed. ALL took 1.2s. Estimated remaining: 13m 14s. Rate: 152.5 symbols/min [2025-09-17T22:47:18.996547] [INFO ] [MAIN ] ALSN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:19.001816] [DEBUG] [LOCAL ] ALLE: Derivative data saved (1794 records). [2025-09-17T22:47:19.002394] [INFO ] [MAIN ] ALLE: Successfully saved derivative data. [2025-09-17T22:47:19.004909] [INFO ] [MAIN ] Derivative Progress: 69/2085 symbols completed. ALLE took 1.2s. Estimated remaining: 13m 2s. Rate: 154.6 symbols/min [2025-09-17T22:47:19.005486] [INFO ] [MAIN ] ALTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:19.059539] [DEBUG] [LOCAL ] ALLY: Loaded 53219 existing records from primary storage. [2025-09-17T22:47:19.060808] [INFO ] [MAIN ] ALLY: Loaded 53219 primary data records. [2025-09-17T22:47:19.061401] [DEBUG] [LOCAL ] ALTG: Loaded 24306 existing records from primary storage. [2025-09-17T22:47:19.075037] [INFO ] [MAIN ] ALTG: Loaded 24306 primary data records. [2025-09-17T22:47:19.398803] [DEBUG] [LOCAL ] ALSN: Loaded 43370 existing records from primary storage. [2025-09-17T22:47:19.409775] [INFO ] [MAIN ] ALSN: Loaded 43370 primary data records. [2025-09-17T22:47:20.091343] [DEBUG] [MAIN ] ALLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:20.094539] [INFO ] [MAIN ] ALLY: Generated 1794 derivative records from 53219 primary records. [2025-09-17T22:47:20.103541] [DEBUG] [LOCAL ] ALLY: Saving derivative data. [2025-09-17T22:47:20.109721] [DEBUG] [MAIN ] ALTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:20.111737] [INFO ] [MAIN ] ALTG: Generated 1794 derivative records from 24306 primary records. [2025-09-17T22:47:20.112420] [DEBUG] [LOCAL ] ALTG: Saving derivative data. [2025-09-17T22:47:20.136039] [DEBUG] [LOCAL ] ALLY: Derivative data saved (1794 records). [2025-09-17T22:47:20.151713] [INFO ] [MAIN ] ALLY: Successfully saved derivative data. [2025-09-17T22:47:20.155191] [INFO ] [MAIN ] Derivative Progress: 70/2085 symbols completed. ALLY took 1.2s. Estimated remaining: 13m 24s. Rate: 150.4 symbols/min [2025-09-17T22:47:20.157126] [INFO ] [MAIN ] ALV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:20.165904] [DEBUG] [LOCAL ] ALTG: Derivative data saved (1794 records). [2025-09-17T22:47:20.166510] [INFO ] [MAIN ] ALTG: Successfully saved derivative data. [2025-09-17T22:47:20.170114] [INFO ] [MAIN ] Derivative Progress: 71/2085 symbols completed. ALTG took 1.2s. Estimated remaining: 13m 13s. Rate: 152.4 symbols/min [2025-09-17T22:47:20.177052] [INFO ] [MAIN ] ALX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:20.190002] [DEBUG] [MAIN ] ALSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:20.191069] [INFO ] [MAIN ] ALSN: Generated 1794 derivative records from 43370 primary records. [2025-09-17T22:47:20.191493] [DEBUG] [LOCAL ] ALSN: Saving derivative data. [2025-09-17T22:47:20.214426] [DEBUG] [LOCAL ] ALSN: Derivative data saved (1794 records). [2025-09-17T22:47:20.214725] [INFO ] [MAIN ] ALSN: Successfully saved derivative data. [2025-09-17T22:47:20.218218] [INFO ] [MAIN ] Derivative Progress: 72/2085 symbols completed. ALSN took 1.2s. Estimated remaining: 13m 3s. Rate: 154.3 symbols/min [2025-09-17T22:47:20.222713] [DEBUG] [LOCAL ] ALX: Loaded 5780 existing records from primary storage. [2025-09-17T22:47:20.222978] [INFO ] [MAIN ] AM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:20.223684] [INFO ] [MAIN ] ALX: Loaded 5780 primary data records. [2025-09-17T22:47:20.426677] [DEBUG] [LOCAL ] ALV: Loaded 42962 existing records from primary storage. [2025-09-17T22:47:20.432462] [INFO ] [MAIN ] ALV: Loaded 42962 primary data records. [2025-09-17T22:47:20.931094] [DEBUG] [LOCAL ] AM: Loaded 52178 existing records from primary storage. [2025-09-17T22:47:20.953639] [INFO ] [MAIN ] AM: Loaded 52178 primary data records. [2025-09-17T22:47:21.587171] [DEBUG] [MAIN ] ALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:21.589251] [INFO ] [MAIN ] ALX: Generated 1794 derivative records from 5780 primary records. [2025-09-17T22:47:21.589529] [DEBUG] [LOCAL ] ALX: Saving derivative data. [2025-09-17T22:47:21.610860] [DEBUG] [LOCAL ] ALX: Derivative data saved (1794 records). [2025-09-17T22:47:21.623298] [INFO ] [MAIN ] ALX: Successfully saved derivative data. [2025-09-17T22:47:21.623811] [DEBUG] [MAIN ] ALV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:21.624613] [INFO ] [MAIN ] ALV: Generated 1794 derivative records from 42962 primary records. [2025-09-17T22:47:21.626926] [INFO ] [MAIN ] Derivative Progress: 73/2085 symbols completed. ALX took 1.5s. Estimated remaining: 13m 30s. Rate: 149.0 symbols/min [2025-09-17T22:47:21.627257] [DEBUG] [LOCAL ] ALV: Saving derivative data. [2025-09-17T22:47:21.644558] [DEBUG] [LOCAL ] ALV: Derivative data saved (1794 records). [2025-09-17T22:47:21.644844] [INFO ] [MAIN ] ALV: Successfully saved derivative data. [2025-09-17T22:47:21.647593] [INFO ] [MAIN ] Derivative Progress: 74/2085 symbols completed. ALV took 1.5s. Estimated remaining: 13m 20s. Rate: 150.9 symbols/min [2025-09-17T22:47:21.663321] [DEBUG] [MAIN ] AM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:21.663942] [INFO ] [MAIN ] AM: Generated 1794 derivative records from 52178 primary records. [2025-09-17T22:47:21.664004] [DEBUG] [LOCAL ] AM: Saving derivative data. [2025-09-17T22:47:21.679808] [DEBUG] [LOCAL ] AM: Derivative data saved (1794 records). [2025-09-17T22:47:21.679869] [INFO ] [MAIN ] AM: Successfully saved derivative data. [2025-09-17T22:47:21.682154] [INFO ] [MAIN ] Derivative Progress: 75/2085 symbols completed. AM took 1.5s. Estimated remaining: 13m 9s. Rate: 152.8 symbols/min [2025-09-17T22:47:21.682939] [INFO ] [MAIN ] AMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:21.682754] [INFO ] [MAIN ] AMBP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:21.683916] [INFO ] [MAIN ] AMBC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:21.762522] [DEBUG] [LOCAL ] AMBP: Loaded 45300 existing records from primary storage. [2025-09-17T22:47:21.762743] [INFO ] [MAIN ] AMBP: Loaded 45300 primary data records. [2025-09-17T22:47:21.775195] [DEBUG] [LOCAL ] AMBC: Loaded 37673 existing records from primary storage. [2025-09-17T22:47:21.795576] [INFO ] [MAIN ] AMBC: Loaded 37673 primary data records. [2025-09-17T22:47:21.999506] [DEBUG] [LOCAL ] AMC: Loaded 53757 existing records from primary storage. [2025-09-17T22:47:22.004002] [INFO ] [MAIN ] AMC: Loaded 53757 primary data records. [2025-09-17T22:47:22.792589] [DEBUG] [MAIN ] AMBC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:47:22.794633] [INFO ] [MAIN ] AMBC: Generated 1793 derivative records from 37673 primary records. [2025-09-17T22:47:22.793442] [DEBUG] [MAIN ] AMBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:22.796257] [INFO ] [MAIN ] AMBP: Generated 1794 derivative records from 45300 primary records. [2025-09-17T22:47:22.796737] [DEBUG] [LOCAL ] AMBP: Saving derivative data. [2025-09-17T22:47:22.795458] [DEBUG] [LOCAL ] AMBC: Saving derivative data. [2025-09-17T22:47:22.841061] [DEBUG] [LOCAL ] AMBP: Derivative data saved (1794 records). [2025-09-17T22:47:22.843939] [INFO ] [MAIN ] AMBP: Successfully saved derivative data. [2025-09-17T22:47:22.848195] [INFO ] [MAIN ] Derivative Progress: 76/2085 symbols completed. AMBP took 1.2s. Estimated remaining: 13m 30s. Rate: 148.9 symbols/min [2025-09-17T22:47:22.850609] [INFO ] [MAIN ] AMCR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:22.848892] [DEBUG] [MAIN ] AMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:22.851765] [DEBUG] [LOCAL ] AMBC: Derivative data saved (1793 records). [2025-09-17T22:47:22.852548] [INFO ] [MAIN ] AMC: Generated 1794 derivative records from 53757 primary records. [2025-09-17T22:47:22.853021] [DEBUG] [LOCAL ] AMC: Saving derivative data. [2025-09-17T22:47:22.853082] [INFO ] [MAIN ] AMBC: Successfully saved derivative data. [2025-09-17T22:47:22.854958] [INFO ] [MAIN ] Derivative Progress: 77/2085 symbols completed. AMBC took 1.2s. Estimated remaining: 13m 19s. Rate: 150.8 symbols/min [2025-09-17T22:47:22.856267] [INFO ] [MAIN ] AME: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:22.872498] [DEBUG] [LOCAL ] AMC: Derivative data saved (1794 records). [2025-09-17T22:47:22.872679] [INFO ] [MAIN ] AMC: Successfully saved derivative data. [2025-09-17T22:47:22.875030] [INFO ] [MAIN ] Derivative Progress: 78/2085 symbols completed. AMC took 1.2s. Estimated remaining: 13m 9s. Rate: 152.7 symbols/min [2025-09-17T22:47:22.875323] [INFO ] [MAIN ] AMG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:22.898248] [DEBUG] [LOCAL ] AMG: Loaded 20838 existing records from primary storage. [2025-09-17T22:47:22.898467] [INFO ] [MAIN ] AMG: Loaded 20838 primary data records. [2025-09-17T22:47:23.146270] [DEBUG] [LOCAL ] AME: Loaded 48614 existing records from primary storage. [2025-09-17T22:47:23.151880] [INFO ] [MAIN ] AME: Loaded 48614 primary data records. [2025-09-17T22:47:23.227221] [DEBUG] [LOCAL ] AMCR: Loaded 53669 existing records from primary storage. [2025-09-17T22:47:23.234702] [INFO ] [MAIN ] AMCR: Loaded 53669 primary data records. [2025-09-17T22:47:23.941147] [DEBUG] [MAIN ] AMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:23.942853] [INFO ] [MAIN ] AMG: Generated 1794 derivative records from 20838 primary records. [2025-09-17T22:47:23.943048] [DEBUG] [LOCAL ] AMG: Saving derivative data. [2025-09-17T22:47:23.966543] [DEBUG] [LOCAL ] AMG: Derivative data saved (1794 records). [2025-09-17T22:47:23.978893] [INFO ] [MAIN ] AMG: Successfully saved derivative data. [2025-09-17T22:47:23.981002] [INFO ] [MAIN ] Derivative Progress: 79/2085 symbols completed. AMG took 1.1s. Estimated remaining: 13m 26s. Rate: 149.3 symbols/min [2025-09-17T22:47:23.981297] [DEBUG] [MAIN ] AME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:23.993334] [INFO ] [MAIN ] AMH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:23.995074] [INFO ] [MAIN ] AME: Generated 1794 derivative records from 48614 primary records. [2025-09-17T22:47:23.995270] [DEBUG] [LOCAL ] AME: Saving derivative data. [2025-09-17T22:47:23.993963] [DEBUG] [MAIN ] AMCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:23.996479] [INFO ] [MAIN ] AMCR: Generated 1794 derivative records from 53669 primary records. [2025-09-17T22:47:23.996860] [DEBUG] [LOCAL ] AMCR: Saving derivative data. [2025-09-17T22:47:24.025983] [DEBUG] [LOCAL ] AME: Derivative data saved (1794 records). [2025-09-17T22:47:24.026581] [INFO ] [MAIN ] AME: Successfully saved derivative data. [2025-09-17T22:47:24.029076] [INFO ] [MAIN ] Derivative Progress: 80/2085 symbols completed. AME took 1.2s. Estimated remaining: 13m 17s. Rate: 150.9 symbols/min [2025-09-17T22:47:24.029475] [INFO ] [MAIN ] AMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:24.033271] [DEBUG] [LOCAL ] AMCR: Derivative data saved (1794 records). [2025-09-17T22:47:24.033530] [INFO ] [MAIN ] AMCR: Successfully saved derivative data. [2025-09-17T22:47:24.036026] [INFO ] [MAIN ] Derivative Progress: 81/2085 symbols completed. AMCR took 1.2s. Estimated remaining: 13m 7s. Rate: 152.8 symbols/min [2025-09-17T22:47:24.036387] [INFO ] [MAIN ] AMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:24.083270] [DEBUG] [LOCAL ] AMH: Loaded 51699 existing records from primary storage. [2025-09-17T22:47:24.083535] [INFO ] [MAIN ] AMH: Loaded 51699 primary data records. [2025-09-17T22:47:24.224941] [DEBUG] [LOCAL ] AMN: Loaded 42222 existing records from primary storage. [2025-09-17T22:47:24.231383] [DEBUG] [LOCAL ] AMP: Loaded 32920 existing records from primary storage. [2025-09-17T22:47:24.225526] [INFO ] [MAIN ] AMN: Loaded 42222 primary data records. [2025-09-17T22:47:24.231606] [INFO ] [MAIN ] AMP: Loaded 32920 primary data records. [2025-09-17T22:47:25.121343] [DEBUG] [MAIN ] AMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:25.122229] [INFO ] [MAIN ] AMH: Generated 1794 derivative records from 51699 primary records. [2025-09-17T22:47:25.122579] [DEBUG] [LOCAL ] AMH: Saving derivative data. [2025-09-17T22:47:25.142981] [DEBUG] [LOCAL ] AMH: Derivative data saved (1794 records). [2025-09-17T22:47:25.156167] [INFO ] [MAIN ] AMH: Successfully saved derivative data. [2025-09-17T22:47:25.156886] [DEBUG] [MAIN ] AMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:25.170398] [INFO ] [MAIN ] Derivative Progress: 82/2085 symbols completed. AMH took 1.2s. Estimated remaining: 13m 25s. Rate: 149.3 symbols/min [2025-09-17T22:47:25.171429] [DEBUG] [MAIN ] AMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:25.172214] [INFO ] [MAIN ] AMN: Generated 1794 derivative records from 42222 primary records. [2025-09-17T22:47:25.172420] [INFO ] [MAIN ] AMPX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:25.173315] [INFO ] [MAIN ] AMP: Generated 1794 derivative records from 32920 primary records. [2025-09-17T22:47:25.172744] [DEBUG] [LOCAL ] AMN: Saving derivative data. [2025-09-17T22:47:25.173970] [DEBUG] [LOCAL ] AMP: Saving derivative data. [2025-09-17T22:47:25.208584] [DEBUG] [LOCAL ] AMN: Derivative data saved (1794 records). [2025-09-17T22:47:25.209901] [DEBUG] [LOCAL ] AMP: Derivative data saved (1794 records). [2025-09-17T22:47:25.209295] [INFO ] [MAIN ] AMN: Successfully saved derivative data. [2025-09-17T22:47:25.212497] [INFO ] [MAIN ] Derivative Progress: 83/2085 symbols completed. AMN took 1.2s. Estimated remaining: 13m 16s. Rate: 151.0 symbols/min [2025-09-17T22:47:25.212988] [INFO ] [MAIN ] AMP: Successfully saved derivative data. [2025-09-17T22:47:25.212900] [INFO ] [MAIN ] AMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:25.215499] [INFO ] [MAIN ] Derivative Progress: 84/2085 symbols completed. AMP took 1.2s. Estimated remaining: 13m 6s. Rate: 152.8 symbols/min [2025-09-17T22:47:25.216142] [INFO ] [MAIN ] AMRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:25.275866] [DEBUG] [LOCAL ] AMPX: Loaded 52068 existing records from primary storage. [2025-09-17T22:47:25.276105] [INFO ] [MAIN ] AMPX: Loaded 52068 primary data records. [2025-09-17T22:47:25.381314] [DEBUG] [LOCAL ] AMR: Loaded 29290 existing records from primary storage. [2025-09-17T22:47:25.404960] [INFO ] [MAIN ] AMR: Loaded 29290 primary data records. [2025-09-17T22:47:25.405494] [DEBUG] [LOCAL ] AMRC: Loaded 38695 existing records from primary storage. [2025-09-17T22:47:25.421636] [INFO ] [MAIN ] AMRC: Loaded 38695 primary data records. [2025-09-17T22:47:26.240898] [DEBUG] [MAIN ] AMPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:26.241628] [INFO ] [MAIN ] AMPX: Generated 1794 derivative records from 52068 primary records. [2025-09-17T22:47:26.241932] [DEBUG] [LOCAL ] AMPX: Saving derivative data. [2025-09-17T22:47:26.277609] [DEBUG] [MAIN ] AMRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:26.278388] [DEBUG] [LOCAL ] AMPX: Derivative data saved (1794 records). [2025-09-17T22:47:26.278565] [INFO ] [MAIN ] AMPX: Successfully saved derivative data. [2025-09-17T22:47:26.293312] [INFO ] [MAIN ] Derivative Progress: 85/2085 symbols completed. AMPX took 1.1s. Estimated remaining: 13m 22s. Rate: 149.7 symbols/min [2025-09-17T22:47:26.291463] [INFO ] [MAIN ] AMRC: Generated 1794 derivative records from 38695 primary records. [2025-09-17T22:47:26.293599] [DEBUG] [LOCAL ] AMRC: Saving derivative data. [2025-09-17T22:47:26.294295] [DEBUG] [MAIN ] AMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:26.295750] [INFO ] [MAIN ] AMR: Generated 1794 derivative records from 29290 primary records. [2025-09-17T22:47:26.296015] [DEBUG] [LOCAL ] AMR: Saving derivative data. [2025-09-17T22:47:26.295900] [INFO ] [MAIN ] AMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:26.325856] [DEBUG] [LOCAL ] AMR: Derivative data saved (1794 records). [2025-09-17T22:47:26.326203] [INFO ] [MAIN ] AMR: Successfully saved derivative data. [2025-09-17T22:47:26.329535] [INFO ] [MAIN ] Derivative Progress: 86/2085 symbols completed. AMR took 1.1s. Estimated remaining: 13m 13s. Rate: 151.3 symbols/min [2025-09-17T22:47:26.330620] [INFO ] [MAIN ] AMTB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:26.332943] [DEBUG] [LOCAL ] AMRC: Derivative data saved (1794 records). [2025-09-17T22:47:26.333197] [INFO ] [MAIN ] AMRC: Successfully saved derivative data. [2025-09-17T22:47:26.336420] [INFO ] [MAIN ] Derivative Progress: 87/2085 symbols completed. AMRC took 1.1s. Estimated remaining: 13m 3s. Rate: 153.0 symbols/min [2025-09-17T22:47:26.336778] [INFO ] [MAIN ] AMTD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:26.342314] [DEBUG] [LOCAL ] AMTD: Loaded 3497 existing records from primary storage. [2025-09-17T22:47:26.342418] [INFO ] [MAIN ] AMTD: Loaded 3497 primary data records. [2025-09-17T22:47:26.477410] [DEBUG] [LOCAL ] AMTB: Loaded 20596 existing records from primary storage. [2025-09-17T22:47:26.483179] [INFO ] [MAIN ] AMTB: Loaded 20596 primary data records. [2025-09-17T22:47:26.768407] [DEBUG] [LOCAL ] AMT: Loaded 52461 existing records from primary storage. [2025-09-17T22:47:26.790379] [INFO ] [MAIN ] AMT: Loaded 52461 primary data records. [2025-09-17T22:47:27.392999] [DEBUG] [MAIN ] AMTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:27.394533] [INFO ] [MAIN ] AMTD: Generated 1794 derivative records from 3497 primary records. [2025-09-17T22:47:27.395263] [DEBUG] [LOCAL ] AMTD: Saving derivative data. [2025-09-17T22:47:27.413027] [DEBUG] [LOCAL ] AMTD: Derivative data saved (1794 records). [2025-09-17T22:47:27.413290] [INFO ] [MAIN ] AMTD: Successfully saved derivative data. [2025-09-17T22:47:27.415541] [INFO ] [MAIN ] Derivative Progress: 88/2085 symbols completed. AMTD took 1.1s. Estimated remaining: 13m 19s. Rate: 150.0 symbols/min [2025-09-17T22:47:27.432187] [DEBUG] [MAIN ] AMTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:27.432858] [INFO ] [MAIN ] AMTB: Generated 1794 derivative records from 20596 primary records. [2025-09-17T22:47:27.433037] [DEBUG] [LOCAL ] AMTB: Saving derivative data. [2025-09-17T22:47:27.451762] [DEBUG] [LOCAL ] AMTB: Derivative data saved (1794 records). [2025-09-17T22:47:27.452035] [INFO ] [MAIN ] AMTB: Successfully saved derivative data. [2025-09-17T22:47:27.466424] [INFO ] [MAIN ] Derivative Progress: 89/2085 symbols completed. AMTB took 1.1s. Estimated remaining: 13m 10s. Rate: 151.5 symbols/min [2025-09-17T22:47:27.466949] [DEBUG] [MAIN ] AMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:27.467594] [INFO ] [MAIN ] AMT: Generated 1794 derivative records from 52461 primary records. [2025-09-17T22:47:27.467686] [DEBUG] [LOCAL ] AMT: Saving derivative data. [2025-09-17T22:47:27.483436] [DEBUG] [LOCAL ] AMT: Derivative data saved (1794 records). [2025-09-17T22:47:27.483498] [INFO ] [MAIN ] AMT: Successfully saved derivative data. [2025-09-17T22:47:27.486309] [INFO ] [MAIN ] Derivative Progress: 90/2085 symbols completed. AMT took 1.2s. Estimated remaining: 13m 2s. Rate: 153.1 symbols/min [2025-09-17T22:47:27.487131] [INFO ] [MAIN ] AMWL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:27.487302] [INFO ] [MAIN ] AMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:27.487839] [INFO ] [MAIN ] AMTM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:27.501529] [DEBUG] [LOCAL ] AMWL: Loaded 8625 existing records from primary storage. [2025-09-17T22:47:27.501755] [INFO ] [MAIN ] AMWL: Loaded 8625 primary data records. [2025-09-17T22:47:27.744077] [DEBUG] [LOCAL ] AMTM: Loaded 50741 existing records from primary storage. [2025-09-17T22:47:27.875401] [INFO ] [MAIN ] AMTM: Loaded 50741 primary data records. [2025-09-17T22:47:27.889223] [DEBUG] [LOCAL ] AMX: Loaded 49066 existing records from primary storage. [2025-09-17T22:47:27.929019] [INFO ] [MAIN ] AMX: Loaded 49066 primary data records. [2025-09-17T22:47:28.538710] [DEBUG] [MAIN ] AMWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:28.540748] [INFO ] [MAIN ] AMWL: Generated 1794 derivative records from 8625 primary records. [2025-09-17T22:47:28.541040] [DEBUG] [LOCAL ] AMWL: Saving derivative data. [2025-09-17T22:47:28.561195] [DEBUG] [LOCAL ] AMWL: Derivative data saved (1794 records). [2025-09-17T22:47:28.562129] [INFO ] [MAIN ] AMWL: Successfully saved derivative data. [2025-09-17T22:47:28.570824] [INFO ] [MAIN ] Derivative Progress: 91/2085 symbols completed. AMWL took 1.1s. Estimated remaining: 13m 16s. Rate: 150.2 symbols/min [2025-09-17T22:47:28.573741] [INFO ] [MAIN ] ANET: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:28.599074] [DEBUG] [MAIN ] AMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:28.599320] [DEBUG] [MAIN ] AMTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:28.600209] [INFO ] [MAIN ] AMX: Generated 1794 derivative records from 49066 primary records. [2025-09-17T22:47:28.600335] [DEBUG] [LOCAL ] AMX: Saving derivative data. [2025-09-17T22:47:28.601684] [INFO ] [MAIN ] AMTM: Generated 1794 derivative records from 50741 primary records. [2025-09-17T22:47:28.602049] [DEBUG] [LOCAL ] AMTM: Saving derivative data. [2025-09-17T22:47:28.631133] [DEBUG] [LOCAL ] AMTM: Derivative data saved (1794 records). [2025-09-17T22:47:28.632586] [INFO ] [MAIN ] AMTM: Successfully saved derivative data. [2025-09-17T22:47:28.635870] [INFO ] [MAIN ] Derivative Progress: 92/2085 symbols completed. AMTM took 1.1s. Estimated remaining: 13m 9s. Rate: 151.6 symbols/min [2025-09-17T22:47:28.636665] [INFO ] [MAIN ] ANF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:28.638228] [DEBUG] [LOCAL ] AMX: Derivative data saved (1794 records). [2025-09-17T22:47:28.638464] [INFO ] [MAIN ] AMX: Successfully saved derivative data. [2025-09-17T22:47:28.642116] [INFO ] [MAIN ] Derivative Progress: 93/2085 symbols completed. AMX took 1.2s. Estimated remaining: 13m 0s. Rate: 153.2 symbols/min [2025-09-17T22:47:28.642547] [INFO ] [MAIN ] ANRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:28.678589] [DEBUG] [LOCAL ] ANRO: Loaded 20319 existing records from primary storage. [2025-09-17T22:47:28.678798] [INFO ] [MAIN ] ANRO: Loaded 20319 primary data records. [2025-09-17T22:47:28.800740] [DEBUG] [LOCAL ] ANET: Loaded 53766 existing records from primary storage. [2025-09-17T22:47:28.828534] [INFO ] [MAIN ] ANET: Loaded 53766 primary data records. [2025-09-17T22:47:29.003325] [DEBUG] [LOCAL ] ANF: Loaded 52287 existing records from primary storage. [2025-09-17T22:47:29.060605] [INFO ] [MAIN ] ANF: Loaded 52287 primary data records. [2025-09-17T22:47:29.730975] [DEBUG] [MAIN ] ANRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:29.732003] [INFO ] [MAIN ] ANRO: Generated 1794 derivative records from 20319 primary records. [2025-09-17T22:47:29.732107] [DEBUG] [LOCAL ] ANRO: Saving derivative data. [2025-09-17T22:47:29.765214] [DEBUG] [MAIN ] ANET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:29.766307] [INFO ] [MAIN ] ANET: Generated 1794 derivative records from 53766 primary records. [2025-09-17T22:47:29.765311] [DEBUG] [LOCAL ] ANRO: Derivative data saved (1794 records). [2025-09-17T22:47:29.766521] [DEBUG] [LOCAL ] ANET: Saving derivative data. [2025-09-17T22:47:29.766447] [INFO ] [MAIN ] ANRO: Successfully saved derivative data. [2025-09-17T22:47:29.769098] [INFO ] [MAIN ] Derivative Progress: 94/2085 symbols completed. ANRO took 1.1s. Estimated remaining: 13m 15s. Rate: 150.2 symbols/min [2025-09-17T22:47:29.769777] [INFO ] [MAIN ] ANVS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:29.802172] [DEBUG] [LOCAL ] ANET: Derivative data saved (1794 records). [2025-09-17T22:47:29.802093] [DEBUG] [MAIN ] ANF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:29.802281] [INFO ] [MAIN ] ANET: Successfully saved derivative data. [2025-09-17T22:47:29.805538] [INFO ] [MAIN ] ANF: Generated 1794 derivative records from 52287 primary records. [2025-09-17T22:47:29.804787] [INFO ] [MAIN ] Derivative Progress: 95/2085 symbols completed. ANET took 1.2s. Estimated remaining: 13m 7s. Rate: 151.7 symbols/min [2025-09-17T22:47:29.805945] [INFO ] [MAIN ] AOMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:29.806029] [DEBUG] [LOCAL ] ANF: Saving derivative data. [2025-09-17T22:47:29.828130] [DEBUG] [LOCAL ] ANF: Derivative data saved (1794 records). [2025-09-17T22:47:29.828380] [INFO ] [MAIN ] ANF: Successfully saved derivative data. [2025-09-17T22:47:29.830955] [INFO ] [MAIN ] Derivative Progress: 96/2085 symbols completed. ANF took 1.2s. Estimated remaining: 12m 59s. Rate: 153.2 symbols/min [2025-09-17T22:47:29.831266] [INFO ] [MAIN ] AON: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:29.844104] [DEBUG] [LOCAL ] ANVS: Loaded 23443 existing records from primary storage. [2025-09-17T22:47:29.844287] [INFO ] [MAIN ] ANVS: Loaded 23443 primary data records. [2025-09-17T22:47:29.916367] [DEBUG] [LOCAL ] AOMR: Loaded 17076 existing records from primary storage. [2025-09-17T22:47:29.928614] [INFO ] [MAIN ] AOMR: Loaded 17076 primary data records. [2025-09-17T22:47:30.415784] [DEBUG] [LOCAL ] AON: Loaded 45682 existing records from primary storage. [2025-09-17T22:47:30.490678] [INFO ] [MAIN ] AON: Loaded 45682 primary data records. [2025-09-17T22:47:30.823240] [DEBUG] [MAIN ] ANVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:30.824872] [INFO ] [MAIN ] ANVS: Generated 1794 derivative records from 23443 primary records. [2025-09-17T22:47:30.825206] [DEBUG] [LOCAL ] ANVS: Saving derivative data. [2025-09-17T22:47:30.846954] [DEBUG] [LOCAL ] ANVS: Derivative data saved (1794 records). [2025-09-17T22:47:30.859825] [INFO ] [MAIN ] ANVS: Successfully saved derivative data. [2025-09-17T22:47:30.860524] [DEBUG] [MAIN ] AOMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:30.861343] [INFO ] [MAIN ] AOMR: Generated 1794 derivative records from 17076 primary records. [2025-09-17T22:47:30.861681] [DEBUG] [LOCAL ] AOMR: Saving derivative data. [2025-09-17T22:47:30.863939] [INFO ] [MAIN ] Derivative Progress: 97/2085 symbols completed. ANVS took 1.1s. Estimated remaining: 13m 12s. Rate: 150.6 symbols/min [2025-09-17T22:47:30.865482] [INFO ] [MAIN ] AORT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:30.883536] [DEBUG] [LOCAL ] AOMR: Derivative data saved (1794 records). [2025-09-17T22:47:30.885068] [INFO ] [MAIN ] AOMR: Successfully saved derivative data. [2025-09-17T22:47:30.887524] [INFO ] [MAIN ] Derivative Progress: 98/2085 symbols completed. AOMR took 1.1s. Estimated remaining: 13m 4s. Rate: 152.1 symbols/min [2025-09-17T22:47:30.887796] [INFO ] [MAIN ] AOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:30.901519] [DEBUG] [MAIN ] AON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:30.902364] [INFO ] [MAIN ] AON: Generated 1794 derivative records from 45682 primary records. [2025-09-17T22:47:30.902428] [DEBUG] [LOCAL ] AON: Saving derivative data. [2025-09-17T22:47:30.940809] [DEBUG] [LOCAL ] AORT: Loaded 29956 existing records from primary storage. [2025-09-17T22:47:30.942141] [INFO ] [MAIN ] AORT: Loaded 29956 primary data records. [2025-09-17T22:47:30.942800] [DEBUG] [LOCAL ] AON: Derivative data saved (1794 records). [2025-09-17T22:47:30.943055] [INFO ] [MAIN ] AON: Successfully saved derivative data. [2025-09-17T22:47:30.951991] [INFO ] [MAIN ] Derivative Progress: 99/2085 symbols completed. AON took 1.1s. Estimated remaining: 12m 57s. Rate: 153.4 symbols/min [2025-09-17T22:47:30.974836] [INFO ] [MAIN ] AP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:31.138222] [DEBUG] [LOCAL ] AOS: Loaded 49460 existing records from primary storage. [2025-09-17T22:47:31.158098] [DEBUG] [LOCAL ] AP: Loaded 6801 existing records from primary storage. [2025-09-17T22:47:31.163929] [INFO ] [MAIN ] AOS: Loaded 49460 primary data records. [2025-09-17T22:47:31.267889] [INFO ] [MAIN ] AP: Loaded 6801 primary data records. [2025-09-17T22:47:31.940214] [DEBUG] [MAIN ] AORT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:31.942204] [INFO ] [MAIN ] AORT: Generated 1794 derivative records from 29956 primary records. [2025-09-17T22:47:31.942698] [DEBUG] [LOCAL ] AORT: Saving derivative data. [2025-09-17T22:47:31.962759] [DEBUG] [LOCAL ] AORT: Derivative data saved (1794 records). [2025-09-17T22:47:31.965157] [INFO ] [MAIN ] AORT: Successfully saved derivative data. [2025-09-17T22:47:31.969221] [INFO ] [MAIN ] Derivative Progress: 100/2085 symbols completed. AORT took 1.1s. Estimated remaining: 13m 9s. Rate: 151.0 symbols/min [2025-09-17T22:47:31.969873] [INFO ] [MAIN ] APD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:31.990200] [DEBUG] [MAIN ] AP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:31.995414] [DEBUG] [MAIN ] AOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:31.996133] [INFO ] [MAIN ] AP: Generated 1794 derivative records from 6801 primary records. [2025-09-17T22:47:31.996225] [DEBUG] [LOCAL ] AP: Saving derivative data. [2025-09-17T22:47:31.997243] [INFO ] [MAIN ] AOS: Generated 1794 derivative records from 49460 primary records. [2025-09-17T22:47:31.997422] [DEBUG] [LOCAL ] AOS: Saving derivative data. [2025-09-17T22:47:32.027749] [DEBUG] [LOCAL ] AP: Derivative data saved (1794 records). [2025-09-17T22:47:32.029536] [DEBUG] [LOCAL ] AOS: Derivative data saved (1794 records). [2025-09-17T22:47:32.028181] [INFO ] [MAIN ] AP: Successfully saved derivative data. [2025-09-17T22:47:32.032689] [INFO ] [MAIN ] Derivative Progress: 101/2085 symbols completed. AP took 1.1s. Estimated remaining: 13m 2s. Rate: 152.2 symbols/min [2025-09-17T22:47:32.033034] [INFO ] [MAIN ] APG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:32.029617] [INFO ] [MAIN ] AOS: Successfully saved derivative data. [2025-09-17T22:47:32.036018] [INFO ] [MAIN ] Derivative Progress: 102/2085 symbols completed. AOS took 1.1s. Estimated remaining: 12m 54s. Rate: 153.7 symbols/min [2025-09-17T22:47:32.036459] [INFO ] [MAIN ] APLE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:32.074267] [DEBUG] [LOCAL ] APD: Loaded 45572 existing records from primary storage. [2025-09-17T22:47:32.074413] [INFO ] [MAIN ] APD: Loaded 45572 primary data records. [2025-09-17T22:47:32.449019] [DEBUG] [LOCAL ] APG: Loaded 50240 existing records from primary storage. [2025-09-17T22:47:32.450405] [INFO ] [MAIN ] APG: Loaded 50240 primary data records. [2025-09-17T22:47:32.463051] [DEBUG] [LOCAL ] APLE: Loaded 52075 existing records from primary storage. [2025-09-17T22:47:32.464696] [INFO ] [MAIN ] APLE: Loaded 52075 primary data records. [2025-09-17T22:47:33.082111] [DEBUG] [MAIN ] APD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:33.083396] [INFO ] [MAIN ] APD: Generated 1794 derivative records from 45572 primary records. [2025-09-17T22:47:33.083667] [DEBUG] [LOCAL ] APD: Saving derivative data. [2025-09-17T22:47:33.101459] [DEBUG] [LOCAL ] APD: Derivative data saved (1794 records). [2025-09-17T22:47:33.101729] [INFO ] [MAIN ] APD: Successfully saved derivative data. [2025-09-17T22:47:33.104500] [INFO ] [MAIN ] Derivative Progress: 103/2085 symbols completed. APD took 1.1s. Estimated remaining: 13m 7s. Rate: 151.2 symbols/min [2025-09-17T22:47:33.127715] [DEBUG] [MAIN ] APG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:33.128477] [INFO ] [MAIN ] APG: Generated 1794 derivative records from 50240 primary records. [2025-09-17T22:47:33.128602] [DEBUG] [LOCAL ] APG: Saving derivative data. [2025-09-17T22:47:33.141157] [DEBUG] [MAIN ] APLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:33.141938] [INFO ] [MAIN ] APLE: Generated 1794 derivative records from 52075 primary records. [2025-09-17T22:47:33.154073] [DEBUG] [LOCAL ] APLE: Saving derivative data. [2025-09-17T22:47:33.173460] [DEBUG] [LOCAL ] APG: Derivative data saved (1794 records). [2025-09-17T22:47:33.173772] [INFO ] [MAIN ] APG: Successfully saved derivative data. [2025-09-17T22:47:33.177039] [INFO ] [MAIN ] Derivative Progress: 104/2085 symbols completed. APG took 1.1s. Estimated remaining: 13m 0s. Rate: 152.4 symbols/min [2025-09-17T22:47:33.180254] [DEBUG] [LOCAL ] APLE: Derivative data saved (1794 records). [2025-09-17T22:47:33.180319] [INFO ] [MAIN ] APLE: Successfully saved derivative data. [2025-09-17T22:47:33.182637] [INFO ] [MAIN ] Derivative Progress: 105/2085 symbols completed. APLE took 1.1s. Estimated remaining: 12m 52s. Rate: 153.8 symbols/min [2025-09-17T22:47:33.183163] [INFO ] [MAIN ] APO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:33.183435] [INFO ] [MAIN ] APTV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:33.183284] [INFO ] [MAIN ] APOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:33.193757] [DEBUG] [LOCAL ] APOS: Loaded 7464 existing records from primary storage. [2025-09-17T22:47:33.193887] [INFO ] [MAIN ] APOS: Loaded 7464 primary data records. [2025-09-17T22:47:33.561718] [DEBUG] [LOCAL ] APTV: Loaded 52265 existing records from primary storage. [2025-09-17T22:47:33.575224] [INFO ] [MAIN ] APTV: Loaded 52265 primary data records. [2025-09-17T22:47:33.588938] [DEBUG] [LOCAL ] APO: Loaded 53385 existing records from primary storage. [2025-09-17T22:47:33.599568] [INFO ] [MAIN ] APO: Loaded 53385 primary data records. [2025-09-17T22:47:34.217163] [DEBUG] [MAIN ] APOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:34.218572] [INFO ] [MAIN ] APOS: Generated 1794 derivative records from 7464 primary records. [2025-09-17T22:47:34.218864] [DEBUG] [LOCAL ] APOS: Saving derivative data. [2025-09-17T22:47:34.238848] [DEBUG] [LOCAL ] APOS: Derivative data saved (1794 records). [2025-09-17T22:47:34.239225] [INFO ] [MAIN ] APOS: Successfully saved derivative data. [2025-09-17T22:47:34.241929] [INFO ] [MAIN ] Derivative Progress: 106/2085 symbols completed. APOS took 1.1s. Estimated remaining: 13m 4s. Rate: 151.4 symbols/min [2025-09-17T22:47:34.242225] [INFO ] [MAIN ] AQN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:34.260971] [DEBUG] [MAIN ] APO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:34.262811] [INFO ] [MAIN ] APO: Generated 1794 derivative records from 53385 primary records. [2025-09-17T22:47:34.263568] [DEBUG] [LOCAL ] APO: Saving derivative data. [2025-09-17T22:47:34.284566] [DEBUG] [MAIN ] APTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:34.285460] [INFO ] [MAIN ] APTV: Generated 1794 derivative records from 52265 primary records. [2025-09-17T22:47:34.289149] [DEBUG] [LOCAL ] APTV: Saving derivative data. [2025-09-17T22:47:34.294530] [DEBUG] [LOCAL ] APO: Derivative data saved (1794 records). [2025-09-17T22:47:34.294944] [INFO ] [MAIN ] APO: Successfully saved derivative data. [2025-09-17T22:47:34.297486] [INFO ] [MAIN ] Derivative Progress: 107/2085 symbols completed. APO took 1.1s. Estimated remaining: 12m 58s. Rate: 152.6 symbols/min [2025-09-17T22:47:34.305775] [INFO ] [MAIN ] AQNB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:34.327998] [DEBUG] [LOCAL ] APTV: Derivative data saved (1794 records). [2025-09-17T22:47:34.331138] [DEBUG] [LOCAL ] AQNB: Loaded 4234 existing records from primary storage. [2025-09-17T22:47:34.331326] [INFO ] [MAIN ] AQNB: Loaded 4234 primary data records. [2025-09-17T22:47:34.331437] [INFO ] [MAIN ] APTV: Successfully saved derivative data. [2025-09-17T22:47:34.344971] [INFO ] [MAIN ] Derivative Progress: 108/2085 symbols completed. APTV took 1.2s. Estimated remaining: 12m 51s. Rate: 153.8 symbols/min [2025-09-17T22:47:34.355396] [INFO ] [MAIN ] AR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:34.462309] [DEBUG] [LOCAL ] AQN: Loaded 51981 existing records from primary storage. [2025-09-17T22:47:34.462573] [INFO ] [MAIN ] AQN: Loaded 51981 primary data records. [2025-09-17T22:47:35.023087] [DEBUG] [LOCAL ] AR: Loaded 53585 existing records from primary storage. [2025-09-17T22:47:35.023903] [INFO ] [MAIN ] AR: Loaded 53585 primary data records. [2025-09-17T22:47:35.401088] [DEBUG] [MAIN ] AQNB: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-17T22:47:35.402565] [INFO ] [MAIN ] AQNB: Generated 1792 derivative records from 4234 primary records. [2025-09-17T22:47:35.403353] [DEBUG] [LOCAL ] AQNB: Saving derivative data. [2025-09-17T22:47:35.423240] [DEBUG] [LOCAL ] AQNB: Derivative data saved (1792 records). [2025-09-17T22:47:35.423566] [INFO ] [MAIN ] AQNB: Successfully saved derivative data. [2025-09-17T22:47:35.425920] [INFO ] [MAIN ] Derivative Progress: 109/2085 symbols completed. AQNB took 1.1s. Estimated remaining: 13m 3s. Rate: 151.4 symbols/min [2025-09-17T22:47:35.439484] [DEBUG] [MAIN ] AQN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:35.440445] [INFO ] [MAIN ] AQN: Generated 1794 derivative records from 51981 primary records. [2025-09-17T22:47:35.440690] [DEBUG] [LOCAL ] AQN: Saving derivative data. [2025-09-17T22:47:35.439578] [INFO ] [MAIN ] ARCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:35.473744] [DEBUG] [LOCAL ] AQN: Derivative data saved (1794 records). [2025-09-17T22:47:35.474079] [DEBUG] [MAIN ] AR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:35.474389] [INFO ] [MAIN ] AQN: Successfully saved derivative data. [2025-09-17T22:47:35.477194] [INFO ] [MAIN ] Derivative Progress: 110/2085 symbols completed. AQN took 1.2s. Estimated remaining: 12m 57s. Rate: 152.6 symbols/min [2025-09-17T22:47:35.478000] [INFO ] [MAIN ] AR: Generated 1794 derivative records from 53585 primary records. [2025-09-17T22:47:35.478220] [DEBUG] [LOCAL ] AR: Saving derivative data. [2025-09-17T22:47:35.478511] [INFO ] [MAIN ] ARDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:35.505550] [DEBUG] [LOCAL ] AR: Derivative data saved (1794 records). [2025-09-17T22:47:35.505719] [INFO ] [MAIN ] AR: Successfully saved derivative data. [2025-09-17T22:47:35.508017] [INFO ] [MAIN ] Derivative Progress: 111/2085 symbols completed. AR took 1.2s. Estimated remaining: 12m 50s. Rate: 153.9 symbols/min [2025-09-17T22:47:35.512141] [INFO ] [MAIN ] ARDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:35.519608] [DEBUG] [LOCAL ] ARDC: Loaded 14669 existing records from primary storage. [2025-09-17T22:47:35.520372] [INFO ] [MAIN ] ARDC: Loaded 14669 primary data records. [2025-09-17T22:47:35.590854] [DEBUG] [LOCAL ] ARCO: Loaded 44755 existing records from primary storage. [2025-09-17T22:47:35.600227] [INFO ] [MAIN ] ARCO: Loaded 44755 primary data records. [2025-09-17T22:47:35.837707] [DEBUG] [LOCAL ] ARDT: Loaded 28681 existing records from primary storage. [2025-09-17T22:47:35.959532] [INFO ] [MAIN ] ARDT: Loaded 28681 primary data records. [2025-09-17T22:47:36.488752] [DEBUG] [MAIN ] ARDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:36.489689] [INFO ] [MAIN ] ARDC: Generated 1794 derivative records from 14669 primary records. [2025-09-17T22:47:36.489975] [DEBUG] [LOCAL ] ARDC: Saving derivative data. [2025-09-17T22:47:36.519044] [DEBUG] [LOCAL ] ARDC: Derivative data saved (1794 records). [2025-09-17T22:47:36.523619] [INFO ] [MAIN ] ARDC: Successfully saved derivative data. [2025-09-17T22:47:36.524082] [DEBUG] [MAIN ] ARCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:36.524841] [INFO ] [MAIN ] ARCO: Generated 1794 derivative records from 44755 primary records. [2025-09-17T22:47:36.527196] [INFO ] [MAIN ] Derivative Progress: 112/2085 symbols completed. ARDC took 1.0s. Estimated remaining: 13m 0s. Rate: 151.7 symbols/min [2025-09-17T22:47:36.525139] [DEBUG] [LOCAL ] ARCO: Saving derivative data. [2025-09-17T22:47:36.529262] [INFO ] [MAIN ] ARE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:36.553828] [DEBUG] [LOCAL ] ARCO: Derivative data saved (1794 records). [2025-09-17T22:47:36.558611] [INFO ] [MAIN ] ARCO: Successfully saved derivative data. [2025-09-17T22:47:36.561205] [INFO ] [MAIN ] Derivative Progress: 113/2085 symbols completed. ARCO took 1.1s. Estimated remaining: 12m 54s. Rate: 152.9 symbols/min [2025-09-17T22:47:36.561486] [INFO ] [MAIN ] ARES: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:36.561843] [DEBUG] [MAIN ] ARDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:36.562994] [INFO ] [MAIN ] ARDT: Generated 1794 derivative records from 28681 primary records. [2025-09-17T22:47:36.563254] [DEBUG] [LOCAL ] ARDT: Saving derivative data. [2025-09-17T22:47:36.582189] [DEBUG] [LOCAL ] ARDT: Derivative data saved (1794 records). [2025-09-17T22:47:36.582396] [INFO ] [MAIN ] ARDT: Successfully saved derivative data. [2025-09-17T22:47:36.584974] [INFO ] [MAIN ] Derivative Progress: 114/2085 symbols completed. ARDT took 1.1s. Estimated remaining: 12m 47s. Rate: 154.2 symbols/min [2025-09-17T22:47:36.585328] [INFO ] [MAIN ] ARI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:36.621366] [DEBUG] [LOCAL ] ARE: Loaded 50585 existing records from primary storage. [2025-09-17T22:47:36.621688] [INFO ] [MAIN ] ARE: Loaded 50585 primary data records. [2025-09-17T22:47:36.802149] [DEBUG] [LOCAL ] ARES: Loaded 49745 existing records from primary storage. [2025-09-17T22:47:36.811797] [INFO ] [MAIN ] ARES: Loaded 49745 primary data records. [2025-09-17T22:47:37.039254] [DEBUG] [LOCAL ] ARI: Loaded 43285 existing records from primary storage. [2025-09-17T22:47:37.061600] [INFO ] [MAIN ] ARI: Loaded 43285 primary data records. [2025-09-17T22:47:37.645745] [DEBUG] [MAIN ] ARE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:37.648247] [INFO ] [MAIN ] ARE: Generated 1794 derivative records from 50585 primary records. [2025-09-17T22:47:37.648546] [DEBUG] [LOCAL ] ARE: Saving derivative data. [2025-09-17T22:47:37.676893] [DEBUG] [MAIN ] ARES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:37.678402] [INFO ] [MAIN ] ARES: Generated 1794 derivative records from 49745 primary records. [2025-09-17T22:47:37.678612] [DEBUG] [LOCAL ] ARES: Saving derivative data. [2025-09-17T22:47:37.689460] [DEBUG] [LOCAL ] ARE: Derivative data saved (1794 records). [2025-09-17T22:47:37.691786] [INFO ] [MAIN ] ARE: Successfully saved derivative data. [2025-09-17T22:47:37.696939] [INFO ] [MAIN ] Derivative Progress: 115/2085 symbols completed. ARE took 1.2s. Estimated remaining: 12m 59s. Rate: 151.7 symbols/min [2025-09-17T22:47:37.698008] [INFO ] [MAIN ] ARIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:37.712305] [DEBUG] [MAIN ] ARI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:37.713496] [INFO ] [MAIN ] ARI: Generated 1794 derivative records from 43285 primary records. [2025-09-17T22:47:37.714416] [DEBUG] [LOCAL ] ARI: Saving derivative data. [2025-09-17T22:47:37.727559] [DEBUG] [LOCAL ] ARES: Derivative data saved (1794 records). [2025-09-17T22:47:37.727699] [INFO ] [MAIN ] ARES: Successfully saved derivative data. [2025-09-17T22:47:37.731590] [INFO ] [MAIN ] Derivative Progress: 116/2085 symbols completed. ARES took 1.2s. Estimated remaining: 12m 52s. Rate: 152.9 symbols/min [2025-09-17T22:47:37.732951] [INFO ] [MAIN ] ARLO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:37.735151] [DEBUG] [LOCAL ] ARI: Derivative data saved (1794 records). [2025-09-17T22:47:37.735340] [INFO ] [MAIN ] ARI: Successfully saved derivative data. [2025-09-17T22:47:37.738423] [INFO ] [MAIN ] Derivative Progress: 117/2085 symbols completed. ARI took 1.2s. Estimated remaining: 12m 46s. Rate: 154.2 symbols/min [2025-09-17T22:47:37.738882] [INFO ] [MAIN ] ARMK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:37.771551] [DEBUG] [LOCAL ] ARIS: Loaded 42025 existing records from primary storage. [2025-09-17T22:47:37.771862] [INFO ] [MAIN ] ARIS: Loaded 42025 primary data records. [2025-09-17T22:47:37.951946] [DEBUG] [LOCAL ] ARLO: Loaded 44192 existing records from primary storage. [2025-09-17T22:47:37.955764] [INFO ] [MAIN ] ARLO: Loaded 44192 primary data records. [2025-09-17T22:47:38.184349] [DEBUG] [LOCAL ] ARMK: Loaded 50320 existing records from primary storage. [2025-09-17T22:47:38.199913] [INFO ] [MAIN ] ARMK: Loaded 50320 primary data records. [2025-09-17T22:47:38.789897] [DEBUG] [MAIN ] ARIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:38.791407] [INFO ] [MAIN ] ARIS: Generated 1794 derivative records from 42025 primary records. [2025-09-17T22:47:38.791728] [DEBUG] [LOCAL ] ARIS: Saving derivative data. [2025-09-17T22:47:38.815800] [DEBUG] [LOCAL ] ARIS: Derivative data saved (1794 records). [2025-09-17T22:47:38.815999] [INFO ] [MAIN ] ARIS: Successfully saved derivative data. [2025-09-17T22:47:38.818447] [INFO ] [MAIN ] Derivative Progress: 118/2085 symbols completed. ARIS took 1.1s. Estimated remaining: 12m 57s. Rate: 152.0 symbols/min [2025-09-17T22:47:38.833036] [DEBUG] [MAIN ] ARLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:38.834068] [INFO ] [MAIN ] ARLO: Generated 1794 derivative records from 44192 primary records. [2025-09-17T22:47:38.834260] [DEBUG] [LOCAL ] ARLO: Saving derivative data. [2025-09-17T22:47:38.865776] [DEBUG] [MAIN ] ARMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:38.867136] [INFO ] [MAIN ] ARMK: Generated 1794 derivative records from 50320 primary records. [2025-09-17T22:47:38.867611] [DEBUG] [LOCAL ] ARMK: Saving derivative data. [2025-09-17T22:47:38.883421] [DEBUG] [LOCAL ] ARLO: Derivative data saved (1794 records). [2025-09-17T22:47:38.886698] [INFO ] [MAIN ] ARLO: Successfully saved derivative data. [2025-09-17T22:47:38.889585] [DEBUG] [LOCAL ] ARMK: Derivative data saved (1794 records). [2025-09-17T22:47:38.888876] [INFO ] [MAIN ] Derivative Progress: 119/2085 symbols completed. ARLO took 1.2s. Estimated remaining: 12m 51s. Rate: 153.0 symbols/min [2025-09-17T22:47:38.889769] [INFO ] [MAIN ] ARMK: Successfully saved derivative data. [2025-09-17T22:47:38.892958] [INFO ] [MAIN ] Derivative Progress: 120/2085 symbols completed. ARMK took 1.2s. Estimated remaining: 12m 44s. Rate: 154.3 symbols/min [2025-09-17T22:47:38.893774] [INFO ] [MAIN ] AROC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:38.894011] [INFO ] [MAIN ] ARW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:38.894102] [INFO ] [MAIN ] ARR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:38.956517] [DEBUG] [LOCAL ] ARW: Loaded 33210 existing records from primary storage. [2025-09-17T22:47:38.956762] [INFO ] [MAIN ] ARW: Loaded 33210 primary data records. [2025-09-17T22:47:39.095245] [DEBUG] [LOCAL ] AROC: Loaded 49007 existing records from primary storage. [2025-09-17T22:47:39.096313] [INFO ] [MAIN ] AROC: Loaded 49007 primary data records. [2025-09-17T22:47:39.096172] [DEBUG] [LOCAL ] ARR: Loaded 52032 existing records from primary storage. [2025-09-17T22:47:39.096617] [INFO ] [MAIN ] ARR: Loaded 52032 primary data records. [2025-09-17T22:47:39.998481] [DEBUG] [MAIN ] ARW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:40.013140] [INFO ] [MAIN ] ARW: Generated 1794 derivative records from 33210 primary records. [2025-09-17T22:47:40.013568] [DEBUG] [LOCAL ] ARW: Saving derivative data. [2025-09-17T22:47:40.014478] [DEBUG] [MAIN ] AROC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:40.016180] [INFO ] [MAIN ] AROC: Generated 1794 derivative records from 49007 primary records. [2025-09-17T22:47:40.026459] [DEBUG] [LOCAL ] AROC: Saving derivative data. [2025-09-17T22:47:40.035474] [DEBUG] [LOCAL ] ARW: Derivative data saved (1794 records). [2025-09-17T22:47:40.043162] [INFO ] [MAIN ] ARW: Successfully saved derivative data. [2025-09-17T22:47:40.059787] [INFO ] [MAIN ] Derivative Progress: 121/2085 symbols completed. ARW took 1.2s. Estimated remaining: 12m 56s. Rate: 151.8 symbols/min [2025-09-17T22:47:40.067763] [DEBUG] [MAIN ] ARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:40.070480] [INFO ] [MAIN ] ARR: Generated 1794 derivative records from 52032 primary records. [2025-09-17T22:47:40.070666] [DEBUG] [LOCAL ] AROC: Derivative data saved (1794 records). [2025-09-17T22:47:40.069261] [INFO ] [MAIN ] AS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:40.070884] [INFO ] [MAIN ] AROC: Successfully saved derivative data. [2025-09-17T22:47:40.074353] [DEBUG] [LOCAL ] ARR: Saving derivative data. [2025-09-17T22:47:40.074248] [INFO ] [MAIN ] Derivative Progress: 122/2085 symbols completed. AROC took 1.2s. Estimated remaining: 12m 50s. Rate: 153.0 symbols/min [2025-09-17T22:47:40.075074] [INFO ] [MAIN ] ASA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:40.093616] [DEBUG] [LOCAL ] ARR: Derivative data saved (1794 records). [2025-09-17T22:47:40.093808] [INFO ] [MAIN ] ARR: Successfully saved derivative data. [2025-09-17T22:47:40.096858] [INFO ] [MAIN ] Derivative Progress: 123/2085 symbols completed. ARR took 1.2s. Estimated remaining: 12m 44s. Rate: 154.2 symbols/min [2025-09-17T22:47:40.097245] [INFO ] [MAIN ] ASAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:40.111057] [DEBUG] [LOCAL ] ASA: Loaded 13428 existing records from primary storage. [2025-09-17T22:47:40.111199] [INFO ] [MAIN ] ASA: Loaded 13428 primary data records. [2025-09-17T22:47:40.448980] [DEBUG] [LOCAL ] AS: Loaded 53066 existing records from primary storage. [2025-09-17T22:47:40.460337] [INFO ] [MAIN ] AS: Loaded 53066 primary data records. [2025-09-17T22:47:40.585999] [DEBUG] [LOCAL ] ASAN: Loaded 52762 existing records from primary storage. [2025-09-17T22:47:40.592368] [INFO ] [MAIN ] ASAN: Loaded 52762 primary data records. [2025-09-17T22:47:41.128491] [DEBUG] [MAIN ] ASA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:41.129529] [INFO ] [MAIN ] ASA: Generated 1794 derivative records from 13428 primary records. [2025-09-17T22:47:41.131165] [DEBUG] [LOCAL ] ASA: Saving derivative data. [2025-09-17T22:47:41.163689] [DEBUG] [LOCAL ] ASA: Derivative data saved (1794 records). [2025-09-17T22:47:41.164179] [INFO ] [MAIN ] ASA: Successfully saved derivative data. [2025-09-17T22:47:41.164395] [DEBUG] [MAIN ] AS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:41.168157] [INFO ] [MAIN ] AS: Generated 1794 derivative records from 53066 primary records. [2025-09-17T22:47:41.167306] [INFO ] [MAIN ] Derivative Progress: 124/2085 symbols completed. ASA took 1.1s. Estimated remaining: 12m 54s. Rate: 152.0 symbols/min [2025-09-17T22:47:41.168381] [DEBUG] [LOCAL ] AS: Saving derivative data. [2025-09-17T22:47:41.169170] [INFO ] [MAIN ] ASB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:41.189679] [DEBUG] [LOCAL ] AS: Derivative data saved (1794 records). [2025-09-17T22:47:41.189942] [INFO ] [MAIN ] AS: Successfully saved derivative data. [2025-09-17T22:47:41.192327] [INFO ] [MAIN ] Derivative Progress: 125/2085 symbols completed. AS took 1.1s. Estimated remaining: 12m 48s. Rate: 153.2 symbols/min [2025-09-17T22:47:41.192621] [INFO ] [MAIN ] ASBA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:41.206735] [DEBUG] [MAIN ] ASAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:41.208591] [INFO ] [MAIN ] ASAN: Generated 1794 derivative records from 52762 primary records. [2025-09-17T22:47:41.208864] [DEBUG] [LOCAL ] ASAN: Saving derivative data. [2025-09-17T22:47:41.212446] [DEBUG] [LOCAL ] ASBA: Loaded 3435 existing records from primary storage. [2025-09-17T22:47:41.220110] [INFO ] [MAIN ] ASBA: Loaded 3435 primary data records. [2025-09-17T22:47:41.361903] [DEBUG] [LOCAL ] ASAN: Derivative data saved (1794 records). [2025-09-17T22:47:41.389324] [INFO ] [MAIN ] ASAN: Successfully saved derivative data. [2025-09-17T22:47:41.389193] [DEBUG] [LOCAL ] ASB: Loaded 49645 existing records from primary storage. [2025-09-17T22:47:41.442138] [INFO ] [MAIN ] Derivative Progress: 126/2085 symbols completed. ASAN took 1.3s. Estimated remaining: 12m 45s. Rate: 153.6 symbols/min [2025-09-17T22:47:41.445848] [INFO ] [MAIN ] ASC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:41.451289] [INFO ] [MAIN ] ASB: Loaded 49645 primary data records. [2025-09-17T22:47:41.977900] [DEBUG] [LOCAL ] ASC: Loaded 38150 existing records from primary storage. [2025-09-17T22:47:41.978348] [INFO ] [MAIN ] ASC: Loaded 38150 primary data records. [2025-09-17T22:47:42.126146] [DEBUG] [MAIN ] ASBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:42.150516] [INFO ] [MAIN ] ASBA: Generated 1794 derivative records from 3435 primary records. [2025-09-17T22:47:42.187724] [DEBUG] [LOCAL ] ASBA: Saving derivative data. [2025-09-17T22:47:42.322553] [DEBUG] [LOCAL ] ASBA: Derivative data saved (1794 records). [2025-09-17T22:47:42.322723] [INFO ] [MAIN ] ASBA: Successfully saved derivative data. [2025-09-17T22:47:42.324764] [INFO ] [MAIN ] Derivative Progress: 127/2085 symbols completed. ASBA took 1.1s. Estimated remaining: 12m 52s. Rate: 152.1 symbols/min [2025-09-17T22:47:42.326004] [INFO ] [MAIN ] ASG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:42.345463] [DEBUG] [MAIN ] ASB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:42.346365] [INFO ] [MAIN ] ASB: Generated 1794 derivative records from 49645 primary records. [2025-09-17T22:47:42.346557] [DEBUG] [LOCAL ] ASB: Saving derivative data. [2025-09-17T22:47:42.378117] [DEBUG] [LOCAL ] ASG: Loaded 21091 existing records from primary storage. [2025-09-17T22:47:42.379849] [DEBUG] [LOCAL ] ASB: Derivative data saved (1794 records). [2025-09-17T22:47:42.380154] [INFO ] [MAIN ] ASB: Successfully saved derivative data. [2025-09-17T22:47:42.380252] [INFO ] [MAIN ] ASG: Loaded 21091 primary data records. [2025-09-17T22:47:42.383063] [INFO ] [MAIN ] Derivative Progress: 128/2085 symbols completed. ASB took 1.2s. Estimated remaining: 12m 47s. Rate: 153.1 symbols/min [2025-09-17T22:47:42.389804] [INFO ] [MAIN ] ASGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:42.485097] [DEBUG] [MAIN ] ASC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:42.509358] [INFO ] [MAIN ] ASC: Generated 1794 derivative records from 38150 primary records. [2025-09-17T22:47:42.509615] [DEBUG] [LOCAL ] ASC: Saving derivative data. [2025-09-17T22:47:42.620036] [DEBUG] [LOCAL ] ASC: Derivative data saved (1794 records). [2025-09-17T22:47:42.620201] [INFO ] [MAIN ] ASC: Successfully saved derivative data. [2025-09-17T22:47:42.619184] [DEBUG] [LOCAL ] ASGI: Loaded 22162 existing records from primary storage. [2025-09-17T22:47:42.730217] [INFO ] [MAIN ] Derivative Progress: 129/2085 symbols completed. ASC took 1.3s. Estimated remaining: 12m 46s. Rate: 153.2 symbols/min [2025-09-17T22:47:42.739213] [INFO ] [MAIN ] ASGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:42.739323] [INFO ] [MAIN ] ASGI: Loaded 22162 primary data records. [2025-09-17T22:47:43.069888] [DEBUG] [LOCAL ] ASGN: Loaded 35955 existing records from primary storage. [2025-09-17T22:47:43.070228] [INFO ] [MAIN ] ASGN: Loaded 35955 primary data records. [2025-09-17T22:47:43.206404] [DEBUG] [MAIN ] ASG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:43.229002] [INFO ] [MAIN ] ASG: Generated 1794 derivative records from 21091 primary records. [2025-09-17T22:47:43.259038] [DEBUG] [LOCAL ] ASG: Saving derivative data. [2025-09-17T22:47:43.484500] [DEBUG] [MAIN ] ASGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:43.484102] [DEBUG] [LOCAL ] ASG: Derivative data saved (1794 records). [2025-09-17T22:47:43.486276] [INFO ] [MAIN ] ASGI: Generated 1794 derivative records from 22162 primary records. [2025-09-17T22:47:43.486973] [DEBUG] [LOCAL ] ASGI: Saving derivative data. [2025-09-17T22:47:43.486554] [INFO ] [MAIN ] ASG: Successfully saved derivative data. [2025-09-17T22:47:43.490843] [INFO ] [MAIN ] Derivative Progress: 130/2085 symbols completed. ASG took 1.2s. Estimated remaining: 12m 51s. Rate: 152.1 symbols/min [2025-09-17T22:47:43.507073] [DEBUG] [LOCAL ] ASGI: Derivative data saved (1794 records). [2025-09-17T22:47:43.507894] [INFO ] [MAIN ] ASGI: Successfully saved derivative data. [2025-09-17T22:47:43.507193] [INFO ] [MAIN ] ASH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:43.511200] [INFO ] [MAIN ] Derivative Progress: 131/2085 symbols completed. ASGI took 1.1s. Estimated remaining: 12m 45s. Rate: 153.3 symbols/min [2025-09-17T22:47:43.511801] [INFO ] [MAIN ] ASIX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:43.531263] [DEBUG] [MAIN ] ASGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:43.532052] [INFO ] [MAIN ] ASGN: Generated 1794 derivative records from 35955 primary records. [2025-09-17T22:47:43.532240] [DEBUG] [LOCAL ] ASGN: Saving derivative data. [2025-09-17T22:47:43.554270] [DEBUG] [LOCAL ] ASGN: Derivative data saved (1794 records). [2025-09-17T22:47:43.554475] [INFO ] [MAIN ] ASGN: Successfully saved derivative data. [2025-09-17T22:47:43.557258] [INFO ] [MAIN ] Derivative Progress: 132/2085 symbols completed. ASGN took 0.8s. Estimated remaining: 12m 39s. Rate: 154.3 symbols/min [2025-09-17T22:47:43.557731] [INFO ] [MAIN ] ASPN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:43.567247] [DEBUG] [LOCAL ] ASIX: Loaded 22393 existing records from primary storage. [2025-09-17T22:47:43.575925] [INFO ] [MAIN ] ASIX: Loaded 22393 primary data records. [2025-09-17T22:47:43.699258] [DEBUG] [LOCAL ] ASH: Loaded 38062 existing records from primary storage. [2025-09-17T22:47:43.705386] [INFO ] [MAIN ] ASH: Loaded 38062 primary data records. [2025-09-17T22:47:44.078198] [DEBUG] [LOCAL ] ASPN: Loaded 49657 existing records from primary storage. [2025-09-17T22:47:44.082698] [INFO ] [MAIN ] ASPN: Loaded 49657 primary data records. [2025-09-17T22:47:44.571667] [DEBUG] [MAIN ] ASIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:44.573008] [INFO ] [MAIN ] ASIX: Generated 1794 derivative records from 22393 primary records. [2025-09-17T22:47:44.573324] [DEBUG] [LOCAL ] ASIX: Saving derivative data. [2025-09-17T22:47:44.594819] [DEBUG] [LOCAL ] ASIX: Derivative data saved (1794 records). [2025-09-17T22:47:44.595290] [INFO ] [MAIN ] ASIX: Successfully saved derivative data. [2025-09-17T22:47:44.597828] [INFO ] [MAIN ] Derivative Progress: 133/2085 symbols completed. ASIX took 1.1s. Estimated remaining: 12m 49s. Rate: 152.4 symbols/min [2025-09-17T22:47:44.611205] [DEBUG] [MAIN ] ASH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:44.611894] [INFO ] [MAIN ] ASH: Generated 1794 derivative records from 38062 primary records. [2025-09-17T22:47:44.612042] [DEBUG] [LOCAL ] ASH: Saving derivative data. [2025-09-17T22:47:44.641052] [DEBUG] [MAIN ] ASPN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:44.642168] [INFO ] [MAIN ] ASPN: Generated 1794 derivative records from 49657 primary records. [2025-09-17T22:47:44.642696] [DEBUG] [LOCAL ] ASPN: Saving derivative data. [2025-09-17T22:47:44.644215] [DEBUG] [LOCAL ] ASH: Derivative data saved (1794 records). [2025-09-17T22:47:44.650926] [INFO ] [MAIN ] ASH: Successfully saved derivative data. [2025-09-17T22:47:44.654014] [INFO ] [MAIN ] Derivative Progress: 134/2085 symbols completed. ASH took 1.2s. Estimated remaining: 12m 43s. Rate: 153.3 symbols/min [2025-09-17T22:47:44.661219] [DEBUG] [LOCAL ] ASPN: Derivative data saved (1794 records). [2025-09-17T22:47:44.661283] [INFO ] [MAIN ] ASPN: Successfully saved derivative data. [2025-09-17T22:47:44.663965] [INFO ] [MAIN ] Derivative Progress: 135/2085 symbols completed. ASPN took 1.1s. Estimated remaining: 12m 37s. Rate: 154.5 symbols/min [2025-09-17T22:47:44.664636] [INFO ] [MAIN ] ASX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:44.664806] [INFO ] [MAIN ] ATHM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:44.664460] [INFO ] [MAIN ] ATGE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:44.718515] [DEBUG] [LOCAL ] ATHM: Loaded 33171 existing records from primary storage. [2025-09-17T22:47:44.718722] [INFO ] [MAIN ] ATHM: Loaded 33171 primary data records. [2025-09-17T22:47:44.719264] [DEBUG] [LOCAL ] ATGE: Loaded 32168 existing records from primary storage. [2025-09-17T22:47:44.719606] [INFO ] [MAIN ] ATGE: Loaded 32168 primary data records. [2025-09-17T22:47:45.023760] [DEBUG] [LOCAL ] ASX: Loaded 52930 existing records from primary storage. [2025-09-17T22:47:45.112300] [INFO ] [MAIN ] ASX: Loaded 52930 primary data records. [2025-09-17T22:47:45.737146] [DEBUG] [MAIN ] ATGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:45.749683] [INFO ] [MAIN ] ATGE: Generated 1794 derivative records from 32168 primary records. [2025-09-17T22:47:45.749845] [DEBUG] [LOCAL ] ATGE: Saving derivative data. [2025-09-17T22:47:45.768148] [DEBUG] [LOCAL ] ATGE: Derivative data saved (1794 records). [2025-09-17T22:47:45.768255] [INFO ] [MAIN ] ATGE: Successfully saved derivative data. [2025-09-17T22:47:45.760244] [DEBUG] [MAIN ] ATHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:45.771793] [INFO ] [MAIN ] ATHM: Generated 1794 derivative records from 33171 primary records. [2025-09-17T22:47:45.770833] [INFO ] [MAIN ] Derivative Progress: 136/2085 symbols completed. ATGE took 1.1s. Estimated remaining: 12m 47s. Rate: 152.4 symbols/min [2025-09-17T22:47:45.772090] [DEBUG] [LOCAL ] ATHM: Saving derivative data. [2025-09-17T22:47:45.772465] [INFO ] [MAIN ] ATHS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:45.792557] [DEBUG] [LOCAL ] ATHM: Derivative data saved (1794 records). [2025-09-17T22:47:45.792722] [INFO ] [MAIN ] ATHM: Successfully saved derivative data. [2025-09-17T22:47:45.794916] [INFO ] [MAIN ] Derivative Progress: 137/2085 symbols completed. ATHM took 1.1s. Estimated remaining: 12m 42s. Rate: 153.4 symbols/min [2025-09-17T22:47:45.798972] [DEBUG] [LOCAL ] ATHS: Loaded 7178 existing records from primary storage. [2025-09-17T22:47:45.799377] [INFO ] [MAIN ] ATHS: Loaded 7178 primary data records. [2025-09-17T22:47:45.799160] [INFO ] [MAIN ] ATI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:45.923520] [DEBUG] [MAIN ] ASX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:45.950697] [INFO ] [MAIN ] ASX: Generated 1794 derivative records from 52930 primary records. [2025-09-17T22:47:46.003612] [DEBUG] [LOCAL ] ASX: Saving derivative data. [2025-09-17T22:47:46.144388] [DEBUG] [LOCAL ] ASX: Derivative data saved (1794 records). [2025-09-17T22:47:46.144763] [INFO ] [MAIN ] ASX: Successfully saved derivative data. [2025-09-17T22:47:46.148025] [INFO ] [MAIN ] Derivative Progress: 138/2085 symbols completed. ASX took 1.5s. Estimated remaining: 12m 41s. Rate: 153.6 symbols/min [2025-09-17T22:47:46.149497] [INFO ] [MAIN ] ATKR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:46.186483] [DEBUG] [LOCAL ] ATI: Loaded 51695 existing records from primary storage. [2025-09-17T22:47:46.186922] [INFO ] [MAIN ] ATI: Loaded 51695 primary data records. [2025-09-17T22:47:46.327177] [DEBUG] [MAIN ] ATHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:46.349342] [INFO ] [MAIN ] ATHS: Generated 1794 derivative records from 7178 primary records. [2025-09-17T22:47:46.392008] [DEBUG] [LOCAL ] ATHS: Saving derivative data. [2025-09-17T22:47:46.416462] [DEBUG] [LOCAL ] ATKR: Loaded 35859 existing records from primary storage. [2025-09-17T22:47:46.417000] [INFO ] [MAIN ] ATKR: Loaded 35859 primary data records. [2025-09-17T22:47:46.608861] [DEBUG] [LOCAL ] ATHS: Derivative data saved (1794 records). [2025-09-17T22:47:46.636764] [INFO ] [MAIN ] ATHS: Successfully saved derivative data. [2025-09-17T22:47:46.645868] [INFO ] [MAIN ] Derivative Progress: 139/2085 symbols completed. ATHS took 0.9s. Estimated remaining: 12m 42s. Rate: 153.2 symbols/min [2025-09-17T22:47:46.668307] [INFO ] [MAIN ] ATMU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:46.924281] [DEBUG] [LOCAL ] ATMU: Loaded 39701 existing records from primary storage. [2025-09-17T22:47:46.923275] [DEBUG] [MAIN ] ATI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:46.926500] [INFO ] [MAIN ] ATMU: Loaded 39701 primary data records. [2025-09-17T22:47:46.925344] [INFO ] [MAIN ] ATI: Generated 1794 derivative records from 51695 primary records. [2025-09-17T22:47:46.926888] [DEBUG] [LOCAL ] ATI: Saving derivative data. [2025-09-17T22:47:47.062727] [DEBUG] [LOCAL ] ATI: Derivative data saved (1794 records). [2025-09-17T22:47:47.083738] [INFO ] [MAIN ] ATI: Successfully saved derivative data. [2025-09-17T22:47:47.140633] [INFO ] [MAIN ] Derivative Progress: 140/2085 symbols completed. ATI took 1.3s. Estimated remaining: 12m 43s. Rate: 153.0 symbols/min [2025-09-17T22:47:47.259713] [INFO ] [MAIN ] ATO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:47.274345] [DEBUG] [MAIN ] ATKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:47.276043] [INFO ] [MAIN ] ATKR: Generated 1794 derivative records from 35859 primary records. [2025-09-17T22:47:47.276379] [DEBUG] [LOCAL ] ATKR: Saving derivative data. [2025-09-17T22:47:47.295412] [DEBUG] [LOCAL ] ATKR: Derivative data saved (1794 records). [2025-09-17T22:47:47.295909] [INFO ] [MAIN ] ATKR: Successfully saved derivative data. [2025-09-17T22:47:47.297919] [INFO ] [MAIN ] Derivative Progress: 141/2085 symbols completed. ATKR took 1.1s. Estimated remaining: 12m 39s. Rate: 153.6 symbols/min [2025-09-17T22:47:47.298331] [INFO ] [MAIN ] ATR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:47.337417] [DEBUG] [MAIN ] ATMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:47.338741] [INFO ] [MAIN ] ATMU: Generated 1794 derivative records from 39701 primary records. [2025-09-17T22:47:47.342530] [DEBUG] [LOCAL ] ATMU: Saving derivative data. [2025-09-17T22:47:47.367053] [DEBUG] [LOCAL ] ATMU: Derivative data saved (1794 records). [2025-09-17T22:47:47.367327] [INFO ] [MAIN ] ATMU: Successfully saved derivative data. [2025-09-17T22:47:47.370070] [INFO ] [MAIN ] Derivative Progress: 142/2085 symbols completed. ATMU took 0.7s. Estimated remaining: 12m 35s. Rate: 154.5 symbols/min [2025-09-17T22:47:47.370564] [INFO ] [MAIN ] ATS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:47.385584] [DEBUG] [LOCAL ] ATO: Loaded 42098 existing records from primary storage. [2025-09-17T22:47:47.385831] [INFO ] [MAIN ] ATO: Loaded 42098 primary data records. [2025-09-17T22:47:47.460783] [DEBUG] [LOCAL ] ATR: Loaded 30528 existing records from primary storage. [2025-09-17T22:47:47.483178] [INFO ] [MAIN ] ATR: Loaded 30528 primary data records. [2025-09-17T22:47:47.538272] [DEBUG] [LOCAL ] ATS: Loaded 18287 existing records from primary storage. [2025-09-17T22:47:47.583964] [INFO ] [MAIN ] ATS: Loaded 18287 primary data records. [2025-09-17T22:47:48.377892] [DEBUG] [MAIN ] ATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:48.379290] [INFO ] [MAIN ] ATO: Generated 1794 derivative records from 42098 primary records. [2025-09-17T22:47:48.395773] [DEBUG] [LOCAL ] ATO: Saving derivative data. [2025-09-17T22:47:48.397587] [DEBUG] [MAIN ] ATR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:48.398344] [INFO ] [MAIN ] ATR: Generated 1794 derivative records from 30528 primary records. [2025-09-17T22:47:48.417362] [DEBUG] [LOCAL ] ATR: Saving derivative data. [2025-09-17T22:47:48.434616] [DEBUG] [MAIN ] ATS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:48.435469] [INFO ] [MAIN ] ATS: Generated 1794 derivative records from 18287 primary records. [2025-09-17T22:47:48.436099] [DEBUG] [LOCAL ] ATS: Saving derivative data. [2025-09-17T22:47:48.455216] [DEBUG] [LOCAL ] ATO: Derivative data saved (1794 records). [2025-09-17T22:47:48.455901] [INFO ] [MAIN ] ATO: Successfully saved derivative data. [2025-09-17T22:47:48.458539] [INFO ] [MAIN ] Derivative Progress: 143/2085 symbols completed. ATO took 1.2s. Estimated remaining: 12m 44s. Rate: 152.6 symbols/min [2025-09-17T22:47:48.460117] [DEBUG] [LOCAL ] ATR: Derivative data saved (1794 records). [2025-09-17T22:47:48.460862] [INFO ] [MAIN ] ATUS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:48.463217] [INFO ] [MAIN ] ATR: Successfully saved derivative data. [2025-09-17T22:47:48.465957] [INFO ] [MAIN ] Derivative Progress: 144/2085 symbols completed. ATR took 1.2s. Estimated remaining: 12m 38s. Rate: 153.6 symbols/min [2025-09-17T22:47:48.467924] [DEBUG] [LOCAL ] ATS: Derivative data saved (1794 records). [2025-09-17T22:47:48.468169] [INFO ] [MAIN ] ATS: Successfully saved derivative data. [2025-09-17T22:47:48.467117] [INFO ] [MAIN ] AU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:48.471378] [INFO ] [MAIN ] Derivative Progress: 145/2085 symbols completed. ATS took 1.1s. Estimated remaining: 12m 33s. Rate: 154.7 symbols/min [2025-09-17T22:47:48.472047] [INFO ] [MAIN ] AUB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:48.542881] [DEBUG] [LOCAL ] AUB: Loaded 46522 existing records from primary storage. [2025-09-17T22:47:48.555559] [INFO ] [MAIN ] AUB: Loaded 46522 primary data records. [2025-09-17T22:47:48.578948] [DEBUG] [LOCAL ] ATUS: Loaded 49186 existing records from primary storage. [2025-09-17T22:47:48.602597] [INFO ] [MAIN ] ATUS: Loaded 49186 primary data records. [2025-09-17T22:47:48.745026] [DEBUG] [LOCAL ] AU: Loaded 52903 existing records from primary storage. [2025-09-17T22:47:48.779461] [INFO ] [MAIN ] AU: Loaded 52903 primary data records. [2025-09-17T22:47:49.589056] [DEBUG] [MAIN ] AUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:49.590116] [INFO ] [MAIN ] AUB: Generated 1794 derivative records from 46522 primary records. [2025-09-17T22:47:49.590379] [DEBUG] [LOCAL ] AUB: Saving derivative data. [2025-09-17T22:47:49.623367] [DEBUG] [MAIN ] ATUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:49.632233] [INFO ] [MAIN ] ATUS: Generated 1794 derivative records from 49186 primary records. [2025-09-17T22:47:49.637675] [DEBUG] [LOCAL ] ATUS: Saving derivative data. [2025-09-17T22:47:49.639625] [DEBUG] [MAIN ] AU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:49.639153] [DEBUG] [LOCAL ] AUB: Derivative data saved (1794 records). [2025-09-17T22:47:49.640433] [INFO ] [MAIN ] AUB: Successfully saved derivative data. [2025-09-17T22:47:49.640364] [INFO ] [MAIN ] AU: Generated 1794 derivative records from 52903 primary records. [2025-09-17T22:47:49.640558] [DEBUG] [LOCAL ] AU: Saving derivative data. [2025-09-17T22:47:49.642786] [INFO ] [MAIN ] Derivative Progress: 146/2085 symbols completed. AUB took 1.2s. Estimated remaining: 12m 43s. Rate: 152.6 symbols/min [2025-09-17T22:47:49.657421] [INFO ] [MAIN ] AUNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:49.671311] [DEBUG] [LOCAL ] ATUS: Derivative data saved (1794 records). [2025-09-17T22:47:49.671677] [INFO ] [MAIN ] ATUS: Successfully saved derivative data. [2025-09-17T22:47:49.674152] [INFO ] [MAIN ] Derivative Progress: 147/2085 symbols completed. ATUS took 1.2s. Estimated remaining: 12m 37s. Rate: 153.5 symbols/min [2025-09-17T22:47:49.675953] [INFO ] [MAIN ] AVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:49.680861] [DEBUG] [LOCAL ] AUNA: Loaded 4613 existing records from primary storage. [2025-09-17T22:47:49.681066] [INFO ] [MAIN ] AUNA: Loaded 4613 primary data records. [2025-09-17T22:47:49.726784] [DEBUG] [LOCAL ] AU: Derivative data saved (1794 records). [2025-09-17T22:47:49.734385] [INFO ] [MAIN ] AU: Successfully saved derivative data. [2025-09-17T22:47:49.744504] [INFO ] [MAIN ] Derivative Progress: 148/2085 symbols completed. AU took 1.3s. Estimated remaining: 12m 33s. Rate: 154.4 symbols/min [2025-09-17T22:47:50.020691] [DEBUG] [LOCAL ] AVA: Loaded 39697 existing records from primary storage. [2025-09-17T22:47:50.020993] [INFO ] [MAIN ] AVA: Loaded 39697 primary data records. [2025-09-17T22:47:50.352582] [DEBUG] [MAIN ] AUNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:50.353461] [INFO ] [MAIN ] AUNA: Generated 1794 derivative records from 4613 primary records. [2025-09-17T22:47:50.354490] [DEBUG] [LOCAL ] AUNA: Saving derivative data. [2025-09-17T22:47:50.369467] [DEBUG] [LOCAL ] AUNA: Derivative data saved (1794 records). [2025-09-17T22:47:50.369639] [INFO ] [MAIN ] AUNA: Successfully saved derivative data. [2025-09-17T22:47:50.371988] [INFO ] [MAIN ] Derivative Progress: 149/2085 symbols completed. AUNA took 0.7s. Estimated remaining: 12m 36s. Rate: 153.7 symbols/min [2025-09-17T22:47:50.387669] [DEBUG] [MAIN ] AVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:50.388304] [INFO ] [MAIN ] AVA: Generated 1794 derivative records from 39697 primary records. [2025-09-17T22:47:50.388366] [DEBUG] [LOCAL ] AVA: Saving derivative data. [2025-09-17T22:47:50.403507] [DEBUG] [LOCAL ] AVA: Derivative data saved (1794 records). [2025-09-17T22:47:50.403570] [INFO ] [MAIN ] AVA: Successfully saved derivative data. [2025-09-17T22:47:50.405695] [INFO ] [MAIN ] Derivative Progress: 150/2085 symbols completed. AVA took 0.7s. Estimated remaining: 12m 31s. Rate: 154.7 symbols/min [2025-09-17T22:47:50.407120] [INFO ] [MAIN ] AVB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:50.407029] [INFO ] [MAIN ] AVAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:50.406870] [INFO ] [MAIN ] AVD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:50.419392] [DEBUG] [LOCAL ] AVAL: Loaded 9561 existing records from primary storage. [2025-09-17T22:47:50.419539] [INFO ] [MAIN ] AVAL: Loaded 9561 primary data records. [2025-09-17T22:47:50.572241] [DEBUG] [LOCAL ] AVD: Loaded 23294 existing records from primary storage. [2025-09-17T22:47:50.586611] [INFO ] [MAIN ] AVD: Loaded 23294 primary data records. [2025-09-17T22:47:50.891550] [DEBUG] [LOCAL ] AVB: Loaded 41534 existing records from primary storage. [2025-09-17T22:47:50.892029] [INFO ] [MAIN ] AVB: Loaded 41534 primary data records. [2025-09-17T22:47:51.491668] [DEBUG] [MAIN ] AVAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:51.493122] [INFO ] [MAIN ] AVAL: Generated 1794 derivative records from 9561 primary records. [2025-09-17T22:47:51.495394] [DEBUG] [LOCAL ] AVAL: Saving derivative data. [2025-09-17T22:47:51.519914] [DEBUG] [LOCAL ] AVAL: Derivative data saved (1794 records). [2025-09-17T22:47:51.520407] [INFO ] [MAIN ] AVAL: Successfully saved derivative data. [2025-09-17T22:47:51.527418] [INFO ] [MAIN ] Derivative Progress: 151/2085 symbols completed. AVAL took 1.1s. Estimated remaining: 12m 40s. Rate: 152.8 symbols/min [2025-09-17T22:47:51.527964] [INFO ] [MAIN ] AVK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:51.528536] [DEBUG] [MAIN ] AVD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:51.529748] [INFO ] [MAIN ] AVD: Generated 1794 derivative records from 23294 primary records. [2025-09-17T22:47:51.530028] [DEBUG] [LOCAL ] AVD: Saving derivative data. [2025-09-17T22:47:51.546531] [DEBUG] [LOCAL ] AVD: Derivative data saved (1794 records). [2025-09-17T22:47:51.546754] [INFO ] [MAIN ] AVD: Successfully saved derivative data. [2025-09-17T22:47:51.549255] [INFO ] [MAIN ] Derivative Progress: 152/2085 symbols completed. AVD took 1.1s. Estimated remaining: 12m 34s. Rate: 153.7 symbols/min [2025-09-17T22:47:51.549555] [INFO ] [MAIN ] AVNS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:51.570763] [DEBUG] [MAIN ] AVB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:51.571520] [INFO ] [MAIN ] AVB: Generated 1794 derivative records from 41534 primary records. [2025-09-17T22:47:51.571765] [DEBUG] [LOCAL ] AVB: Saving derivative data. [2025-09-17T22:47:51.579088] [DEBUG] [LOCAL ] AVK: Loaded 18237 existing records from primary storage. [2025-09-17T22:47:51.579539] [INFO ] [MAIN ] AVK: Loaded 18237 primary data records. [2025-09-17T22:47:51.744569] [DEBUG] [LOCAL ] AVB: Derivative data saved (1794 records). [2025-09-17T22:47:51.791548] [INFO ] [MAIN ] AVB: Successfully saved derivative data. [2025-09-17T22:47:51.822690] [INFO ] [MAIN ] Derivative Progress: 153/2085 symbols completed. AVB took 1.4s. Estimated remaining: 12m 33s. Rate: 154.0 symbols/min [2025-09-17T22:47:51.823709] [DEBUG] [LOCAL ] AVNS: Loaded 33712 existing records from primary storage. [2025-09-17T22:47:51.824016] [INFO ] [MAIN ] AVNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:51.861751] [INFO ] [MAIN ] AVNS: Loaded 33712 primary data records. [2025-09-17T22:47:52.270544] [DEBUG] [LOCAL ] AVNT: Loaded 39593 existing records from primary storage. [2025-09-17T22:47:52.274313] [INFO ] [MAIN ] AVNT: Loaded 39593 primary data records. [2025-09-17T22:47:52.325463] [DEBUG] [MAIN ] AVK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:52.371186] [INFO ] [MAIN ] AVK: Generated 1794 derivative records from 18237 primary records. [2025-09-17T22:47:52.382705] [DEBUG] [LOCAL ] AVK: Saving derivative data. [2025-09-17T22:47:52.458822] [DEBUG] [LOCAL ] AVK: Derivative data saved (1794 records). [2025-09-17T22:47:52.482713] [INFO ] [MAIN ] AVK: Successfully saved derivative data. [2025-09-17T22:47:52.489888] [INFO ] [MAIN ] Derivative Progress: 154/2085 symbols completed. AVK took 1.0s. Estimated remaining: 12m 36s. Rate: 153.3 symbols/min [2025-09-17T22:47:52.490358] [INFO ] [MAIN ] AVTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:52.624906] [DEBUG] [MAIN ] AVNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:52.625977] [INFO ] [MAIN ] AVNS: Generated 1794 derivative records from 33712 primary records. [2025-09-17T22:47:52.626076] [DEBUG] [LOCAL ] AVNS: Saving derivative data. [2025-09-17T22:47:52.645767] [DEBUG] [LOCAL ] AVNS: Derivative data saved (1794 records). [2025-09-17T22:47:52.646000] [INFO ] [MAIN ] AVNS: Successfully saved derivative data. [2025-09-17T22:47:52.648556] [INFO ] [MAIN ] Derivative Progress: 155/2085 symbols completed. AVNS took 1.1s. Estimated remaining: 12m 32s. Rate: 153.9 symbols/min [2025-09-17T22:47:52.649033] [INFO ] [MAIN ] AVY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:52.665464] [DEBUG] [MAIN ] AVNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:52.666289] [INFO ] [MAIN ] AVNT: Generated 1794 derivative records from 39593 primary records. [2025-09-17T22:47:52.666479] [DEBUG] [LOCAL ] AVNT: Saving derivative data. [2025-09-17T22:47:52.695736] [DEBUG] [LOCAL ] AVNT: Derivative data saved (1794 records). [2025-09-17T22:47:52.695882] [INFO ] [MAIN ] AVNT: Successfully saved derivative data. [2025-09-17T22:47:52.697972] [INFO ] [MAIN ] Derivative Progress: 156/2085 symbols completed. AVNT took 0.9s. Estimated remaining: 12m 28s. Rate: 154.8 symbols/min [2025-09-17T22:47:52.698374] [INFO ] [MAIN ] AWF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:52.719453] [DEBUG] [LOCAL ] AVTR: Loaded 53571 existing records from primary storage. [2025-09-17T22:47:52.728165] [INFO ] [MAIN ] AVTR: Loaded 53571 primary data records. [2025-09-17T22:47:52.862511] [DEBUG] [LOCAL ] AVY: Loaded 37771 existing records from primary storage. [2025-09-17T22:47:52.883625] [DEBUG] [LOCAL ] AWF: Loaded 24198 existing records from primary storage. [2025-09-17T22:47:52.883845] [INFO ] [MAIN ] AVY: Loaded 37771 primary data records. [2025-09-17T22:47:52.883951] [INFO ] [MAIN ] AWF: Loaded 24198 primary data records. [2025-09-17T22:47:53.746077] [DEBUG] [MAIN ] AVTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:53.747737] [INFO ] [MAIN ] AVTR: Generated 1794 derivative records from 53571 primary records. [2025-09-17T22:47:53.747879] [DEBUG] [LOCAL ] AVTR: Saving derivative data. [2025-09-17T22:47:53.766202] [DEBUG] [LOCAL ] AVTR: Derivative data saved (1794 records). [2025-09-17T22:47:53.766393] [INFO ] [MAIN ] AVTR: Successfully saved derivative data. [2025-09-17T22:47:53.768390] [INFO ] [MAIN ] Derivative Progress: 157/2085 symbols completed. AVTR took 1.3s. Estimated remaining: 12m 36s. Rate: 153.1 symbols/min [2025-09-17T22:47:53.769222] [INFO ] [MAIN ] AWI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:53.785560] [DEBUG] [MAIN ] AWF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:53.786235] [INFO ] [MAIN ] AWF: Generated 1794 derivative records from 24198 primary records. [2025-09-17T22:47:53.786324] [DEBUG] [LOCAL ] AWF: Saving derivative data. [2025-09-17T22:47:53.815424] [DEBUG] [MAIN ] AVY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:53.823565] [INFO ] [MAIN ] AVY: Generated 1794 derivative records from 37771 primary records. [2025-09-17T22:47:53.824916] [DEBUG] [LOCAL ] AWF: Derivative data saved (1794 records). [2025-09-17T22:47:53.824965] [DEBUG] [LOCAL ] AVY: Saving derivative data. [2025-09-17T22:47:53.825830] [INFO ] [MAIN ] AWF: Successfully saved derivative data. [2025-09-17T22:47:53.828322] [INFO ] [MAIN ] Derivative Progress: 158/2085 symbols completed. AWF took 1.1s. Estimated remaining: 12m 31s. Rate: 153.9 symbols/min [2025-09-17T22:47:53.828727] [INFO ] [MAIN ] AWK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:53.850929] [DEBUG] [LOCAL ] AWI: Loaded 26270 existing records from primary storage. [2025-09-17T22:47:53.851952] [INFO ] [MAIN ] AWI: Loaded 26270 primary data records. [2025-09-17T22:47:53.885078] [DEBUG] [LOCAL ] AVY: Derivative data saved (1794 records). [2025-09-17T22:47:53.897614] [INFO ] [MAIN ] AVY: Successfully saved derivative data. [2025-09-17T22:47:53.923949] [INFO ] [MAIN ] Derivative Progress: 159/2085 symbols completed. AVY took 1.3s. Estimated remaining: 12m 27s. Rate: 154.6 symbols/min [2025-09-17T22:47:53.941683] [INFO ] [MAIN ] AWP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:54.198259] [DEBUG] [LOCAL ] AWP: Loaded 22217 existing records from primary storage. [2025-09-17T22:47:54.197813] [DEBUG] [LOCAL ] AWK: Loaded 48887 existing records from primary storage. [2025-09-17T22:47:54.198448] [INFO ] [MAIN ] AWP: Loaded 22217 primary data records. [2025-09-17T22:47:54.198515] [INFO ] [MAIN ] AWK: Loaded 48887 primary data records. [2025-09-17T22:47:54.828205] [DEBUG] [MAIN ] AWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:54.829417] [INFO ] [MAIN ] AWI: Generated 1794 derivative records from 26270 primary records. [2025-09-17T22:47:54.830076] [DEBUG] [LOCAL ] AWI: Saving derivative data. [2025-09-17T22:47:54.849315] [DEBUG] [LOCAL ] AWI: Derivative data saved (1794 records). [2025-09-17T22:47:54.849537] [INFO ] [MAIN ] AWI: Successfully saved derivative data. [2025-09-17T22:47:54.852297] [INFO ] [MAIN ] Derivative Progress: 160/2085 symbols completed. AWI took 1.1s. Estimated remaining: 12m 33s. Rate: 153.3 symbols/min [2025-09-17T22:47:54.853007] [INFO ] [MAIN ] AWR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:54.885820] [DEBUG] [MAIN ] AWP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:54.886830] [INFO ] [MAIN ] AWP: Generated 1794 derivative records from 22217 primary records. [2025-09-17T22:47:54.886896] [DEBUG] [LOCAL ] AWP: Saving derivative data. [2025-09-17T22:47:54.886077] [DEBUG] [MAIN ] AWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:54.893116] [INFO ] [MAIN ] AWK: Generated 1794 derivative records from 48887 primary records. [2025-09-17T22:47:54.893657] [DEBUG] [LOCAL ] AWK: Saving derivative data. [2025-09-17T22:47:54.920156] [DEBUG] [LOCAL ] AWP: Derivative data saved (1794 records). [2025-09-17T22:47:54.920671] [INFO ] [MAIN ] AWP: Successfully saved derivative data. [2025-09-17T22:47:54.931921] [DEBUG] [LOCAL ] AWR: Loaded 22425 existing records from primary storage. [2025-09-17T22:47:54.930345] [INFO ] [MAIN ] Derivative Progress: 161/2085 symbols completed. AWP took 1.0s. Estimated remaining: 12m 29s. Rate: 154.1 symbols/min [2025-09-17T22:47:54.933472] [INFO ] [MAIN ] AWR: Loaded 22425 primary data records. [2025-09-17T22:47:54.934893] [DEBUG] [LOCAL ] AWK: Derivative data saved (1794 records). [2025-09-17T22:47:54.934990] [INFO ] [MAIN ] AWK: Successfully saved derivative data. [2025-09-17T22:47:54.967507] [INFO ] [MAIN ] Derivative Progress: 162/2085 symbols completed. AWK took 1.1s. Estimated remaining: 12m 25s. Rate: 154.9 symbols/min [2025-09-17T22:47:54.981610] [INFO ] [MAIN ] AX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:54.994520] [INFO ] [MAIN ] AXL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:55.265490] [DEBUG] [LOCAL ] AX: Loaded 28759 existing records from primary storage. [2025-09-17T22:47:55.265755] [INFO ] [MAIN ] AX: Loaded 28759 primary data records. [2025-09-17T22:47:55.417986] [DEBUG] [LOCAL ] AXL: Loaded 50542 existing records from primary storage. [2025-09-17T22:47:55.493414] [INFO ] [MAIN ] AXL: Loaded 50542 primary data records. [2025-09-17T22:47:55.970254] [DEBUG] [MAIN ] AWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:55.971273] [INFO ] [MAIN ] AWR: Generated 1794 derivative records from 22425 primary records. [2025-09-17T22:47:55.971910] [DEBUG] [LOCAL ] AWR: Saving derivative data. [2025-09-17T22:47:55.991174] [DEBUG] [LOCAL ] AWR: Derivative data saved (1794 records). [2025-09-17T22:47:55.992233] [INFO ] [MAIN ] AWR: Successfully saved derivative data. [2025-09-17T22:47:55.994990] [INFO ] [MAIN ] Derivative Progress: 163/2085 symbols completed. AWR took 1.1s. Estimated remaining: 12m 32s. Rate: 153.4 symbols/min [2025-09-17T22:47:56.011110] [DEBUG] [MAIN ] AX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:56.011938] [INFO ] [MAIN ] AX: Generated 1794 derivative records from 28759 primary records. [2025-09-17T22:47:56.012207] [DEBUG] [LOCAL ] AX: Saving derivative data. [2025-09-17T22:47:56.028791] [DEBUG] [LOCAL ] AX: Derivative data saved (1794 records). [2025-09-17T22:47:56.029676] [INFO ] [MAIN ] AX: Successfully saved derivative data. [2025-09-17T22:47:56.032999] [INFO ] [MAIN ] Derivative Progress: 164/2085 symbols completed. AX took 1.1s. Estimated remaining: 12m 27s. Rate: 154.2 symbols/min [2025-09-17T22:47:56.046417] [DEBUG] [MAIN ] AXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:56.047024] [INFO ] [MAIN ] AXL: Generated 1794 derivative records from 50542 primary records. [2025-09-17T22:47:56.047087] [DEBUG] [LOCAL ] AXL: Saving derivative data. [2025-09-17T22:47:56.061971] [DEBUG] [LOCAL ] AXL: Derivative data saved (1794 records). [2025-09-17T22:47:56.062029] [INFO ] [MAIN ] AXL: Successfully saved derivative data. [2025-09-17T22:47:56.064385] [INFO ] [MAIN ] Derivative Progress: 165/2085 symbols completed. AXL took 1.1s. Estimated remaining: 12m 23s. Rate: 155.1 symbols/min [2025-09-17T22:47:56.065060] [INFO ] [MAIN ] AXP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:56.065008] [INFO ] [MAIN ] AXS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:56.065243] [INFO ] [MAIN ] AXR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:56.071226] [DEBUG] [LOCAL ] AXR: Loaded 3129 existing records from primary storage. [2025-09-17T22:47:56.071345] [INFO ] [MAIN ] AXR: Loaded 3129 primary data records. [2025-09-17T22:47:56.419681] [DEBUG] [LOCAL ] AXS: Loaded 38300 existing records from primary storage. [2025-09-17T22:47:56.420763] [INFO ] [MAIN ] AXS: Loaded 38300 primary data records. [2025-09-17T22:47:56.473255] [DEBUG] [LOCAL ] AXP: Loaded 53266 existing records from primary storage. [2025-09-17T22:47:56.493297] [INFO ] [MAIN ] AXP: Loaded 53266 primary data records. [2025-09-17T22:47:57.077482] [DEBUG] [MAIN ] AXR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:47:57.078898] [INFO ] [MAIN ] AXR: Generated 1793 derivative records from 3129 primary records. [2025-09-17T22:47:57.079119] [DEBUG] [LOCAL ] AXR: Saving derivative data. [2025-09-17T22:47:57.098467] [DEBUG] [LOCAL ] AXR: Derivative data saved (1793 records). [2025-09-17T22:47:57.098819] [INFO ] [MAIN ] AXR: Successfully saved derivative data. [2025-09-17T22:47:57.101926] [INFO ] [MAIN ] Derivative Progress: 166/2085 symbols completed. AXR took 1.0s. Estimated remaining: 12m 30s. Rate: 153.5 symbols/min [2025-09-17T22:47:57.102721] [INFO ] [MAIN ] AXTA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:57.135555] [DEBUG] [MAIN ] AXS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:57.136093] [DEBUG] [MAIN ] AXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:57.137016] [INFO ] [MAIN ] AXS: Generated 1794 derivative records from 38300 primary records. [2025-09-17T22:47:57.137981] [INFO ] [MAIN ] AXP: Generated 1794 derivative records from 53266 primary records. [2025-09-17T22:47:57.138186] [DEBUG] [LOCAL ] AXP: Saving derivative data. [2025-09-17T22:47:57.138276] [DEBUG] [LOCAL ] AXS: Saving derivative data. [2025-09-17T22:47:57.168582] [DEBUG] [LOCAL ] AXS: Derivative data saved (1794 records). [2025-09-17T22:47:57.169466] [INFO ] [MAIN ] AXS: Successfully saved derivative data. [2025-09-17T22:47:57.172335] [INFO ] [MAIN ] Derivative Progress: 167/2085 symbols completed. AXS took 1.1s. Estimated remaining: 12m 26s. Rate: 154.3 symbols/min [2025-09-17T22:47:57.173391] [INFO ] [MAIN ] AYI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:57.188667] [DEBUG] [LOCAL ] AXP: Derivative data saved (1794 records). [2025-09-17T22:47:57.189023] [INFO ] [MAIN ] AXP: Successfully saved derivative data. [2025-09-17T22:47:57.192338] [INFO ] [MAIN ] Derivative Progress: 168/2085 symbols completed. AXP took 1.1s. Estimated remaining: 12m 21s. Rate: 155.2 symbols/min [2025-09-17T22:47:57.192845] [INFO ] [MAIN ] AZO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:57.215857] [DEBUG] [LOCAL ] AXTA: Loaded 52041 existing records from primary storage. [2025-09-17T22:47:57.216103] [INFO ] [MAIN ] AXTA: Loaded 52041 primary data records. [2025-09-17T22:47:57.243494] [DEBUG] [LOCAL ] AZO: Loaded 11607 existing records from primary storage. [2025-09-17T22:47:57.289940] [INFO ] [MAIN ] AZO: Loaded 11607 primary data records. [2025-09-17T22:47:57.437944] [DEBUG] [LOCAL ] AYI: Loaded 25640 existing records from primary storage. [2025-09-17T22:47:57.487002] [INFO ] [MAIN ] AYI: Loaded 25640 primary data records. [2025-09-17T22:47:58.256479] [DEBUG] [MAIN ] AZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:58.256079] [DEBUG] [MAIN ] AXTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:58.257461] [INFO ] [MAIN ] AZO: Generated 1794 derivative records from 11607 primary records. [2025-09-17T22:47:58.258284] [INFO ] [MAIN ] AXTA: Generated 1794 derivative records from 52041 primary records. [2025-09-17T22:47:58.258407] [DEBUG] [LOCAL ] AZO: Saving derivative data. [2025-09-17T22:47:58.259433] [DEBUG] [LOCAL ] AXTA: Saving derivative data. [2025-09-17T22:47:58.301971] [DEBUG] [MAIN ] AYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:58.304481] [INFO ] [MAIN ] AYI: Generated 1794 derivative records from 25640 primary records. [2025-09-17T22:47:58.305268] [DEBUG] [LOCAL ] AYI: Saving derivative data. [2025-09-17T22:47:58.307140] [DEBUG] [LOCAL ] AZO: Derivative data saved (1794 records). [2025-09-17T22:47:58.307914] [INFO ] [MAIN ] AZO: Successfully saved derivative data. [2025-09-17T22:47:58.318507] [INFO ] [MAIN ] Derivative Progress: 169/2085 symbols completed. AZO took 1.1s. Estimated remaining: 12m 29s. Rate: 153.4 symbols/min [2025-09-17T22:47:58.320252] [DEBUG] [LOCAL ] AXTA: Derivative data saved (1794 records). [2025-09-17T22:47:58.324191] [INFO ] [MAIN ] AXTA: Successfully saved derivative data. [2025-09-17T22:47:58.324984] [INFO ] [MAIN ] AZZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:58.328125] [INFO ] [MAIN ] Derivative Progress: 170/2085 symbols completed. AXTA took 1.2s. Estimated remaining: 12m 25s. Rate: 154.3 symbols/min [2025-09-17T22:47:58.329231] [INFO ] [MAIN ] BA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:58.331237] [DEBUG] [LOCAL ] AYI: Derivative data saved (1794 records). [2025-09-17T22:47:58.331618] [INFO ] [MAIN ] AYI: Successfully saved derivative data. [2025-09-17T22:47:58.334005] [INFO ] [MAIN ] Derivative Progress: 171/2085 symbols completed. AYI took 1.2s. Estimated remaining: 12m 20s. Rate: 155.2 symbols/min [2025-09-17T22:47:58.334516] [INFO ] [MAIN ] BABA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:58.358137] [DEBUG] [LOCAL ] AZZ: Loaded 22182 existing records from primary storage. [2025-09-17T22:47:58.358630] [INFO ] [MAIN ] AZZ: Loaded 22182 primary data records. [2025-09-17T22:47:58.709408] [DEBUG] [LOCAL ] BA: Loaded 53791 existing records from primary storage. [2025-09-17T22:47:58.710369] [INFO ] [MAIN ] BA: Loaded 53791 primary data records. [2025-09-17T22:47:58.838799] [DEBUG] [LOCAL ] BABA: Loaded 53820 existing records from primary storage. [2025-09-17T22:47:58.855018] [INFO ] [MAIN ] BABA: Loaded 53820 primary data records. [2025-09-17T22:47:59.410910] [DEBUG] [MAIN ] AZZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:59.412503] [INFO ] [MAIN ] AZZ: Generated 1794 derivative records from 22182 primary records. [2025-09-17T22:47:59.412873] [DEBUG] [LOCAL ] AZZ: Saving derivative data. [2025-09-17T22:47:59.448826] [DEBUG] [LOCAL ] AZZ: Derivative data saved (1794 records). [2025-09-17T22:47:59.449937] [INFO ] [MAIN ] AZZ: Successfully saved derivative data. [2025-09-17T22:47:59.450121] [DEBUG] [MAIN ] BA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:59.450995] [INFO ] [MAIN ] BA: Generated 1794 derivative records from 53791 primary records. [2025-09-17T22:47:59.453563] [INFO ] [MAIN ] Derivative Progress: 172/2085 symbols completed. AZZ took 1.1s. Estimated remaining: 12m 28s. Rate: 153.5 symbols/min [2025-09-17T22:47:59.454052] [DEBUG] [LOCAL ] BA: Saving derivative data. [2025-09-17T22:47:59.454548] [INFO ] [MAIN ] BAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:59.487290] [DEBUG] [MAIN ] BABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:47:59.488692] [INFO ] [MAIN ] BABA: Generated 1794 derivative records from 53820 primary records. [2025-09-17T22:47:59.489048] [DEBUG] [LOCAL ] BABA: Saving derivative data. [2025-09-17T22:47:59.503707] [DEBUG] [LOCAL ] BA: Derivative data saved (1794 records). [2025-09-17T22:47:59.504316] [INFO ] [MAIN ] BA: Successfully saved derivative data. [2025-09-17T22:47:59.506370] [INFO ] [MAIN ] Derivative Progress: 173/2085 symbols completed. BA took 1.2s. Estimated remaining: 12m 24s. Rate: 154.3 symbols/min [2025-09-17T22:47:59.507347] [INFO ] [MAIN ] BAH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:59.513665] [DEBUG] [LOCAL ] BABA: Derivative data saved (1794 records). [2025-09-17T22:47:59.513825] [INFO ] [MAIN ] BABA: Successfully saved derivative data. [2025-09-17T22:47:59.517275] [INFO ] [MAIN ] Derivative Progress: 174/2085 symbols completed. BABA took 1.2s. Estimated remaining: 12m 19s. Rate: 155.1 symbols/min [2025-09-17T22:47:59.517764] [INFO ] [MAIN ] BAK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:47:59.557841] [DEBUG] [LOCAL ] BAC: Loaded 53808 existing records from primary storage. [2025-09-17T22:47:59.565959] [INFO ] [MAIN ] BAC: Loaded 53808 primary data records. [2025-09-17T22:47:59.737843] [DEBUG] [LOCAL ] BAK: Loaded 38862 existing records from primary storage. [2025-09-17T22:47:59.761155] [INFO ] [MAIN ] BAK: Loaded 38862 primary data records. [2025-09-17T22:47:59.803292] [DEBUG] [LOCAL ] BAH: Loaded 51794 existing records from primary storage. [2025-09-17T22:47:59.957472] [INFO ] [MAIN ] BAH: Loaded 51794 primary data records. [2025-09-17T22:48:00.570583] [DEBUG] [MAIN ] BAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:00.573101] [INFO ] [MAIN ] BAC: Generated 1794 derivative records from 53808 primary records. [2025-09-17T22:48:00.573359] [DEBUG] [LOCAL ] BAC: Saving derivative data. [2025-09-17T22:48:00.606093] [DEBUG] [MAIN ] BAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:00.605608] [DEBUG] [LOCAL ] BAC: Derivative data saved (1794 records). [2025-09-17T22:48:00.607392] [INFO ] [MAIN ] BAC: Successfully saved derivative data. [2025-09-17T22:48:00.607279] [INFO ] [MAIN ] BAK: Generated 1794 derivative records from 38862 primary records. [2025-09-17T22:48:00.609527] [INFO ] [MAIN ] Derivative Progress: 175/2085 symbols completed. BAC took 1.2s. Estimated remaining: 12m 26s. Rate: 153.5 symbols/min [2025-09-17T22:48:00.607568] [DEBUG] [LOCAL ] BAK: Saving derivative data. [2025-09-17T22:48:00.610893] [INFO ] [MAIN ] BALL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:00.644294] [DEBUG] [MAIN ] BAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:00.646122] [INFO ] [MAIN ] BAH: Generated 1794 derivative records from 51794 primary records. [2025-09-17T22:48:00.646326] [DEBUG] [LOCAL ] BAH: Saving derivative data. [2025-09-17T22:48:00.648942] [DEBUG] [LOCAL ] BAK: Derivative data saved (1794 records). [2025-09-17T22:48:00.649178] [INFO ] [MAIN ] BAK: Successfully saved derivative data. [2025-09-17T22:48:00.652543] [INFO ] [MAIN ] Derivative Progress: 176/2085 symbols completed. BAK took 1.1s. Estimated remaining: 12m 22s. Rate: 154.3 symbols/min [2025-09-17T22:48:00.660466] [INFO ] [MAIN ] BAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:00.669277] [DEBUG] [LOCAL ] BAH: Derivative data saved (1794 records). [2025-09-17T22:48:00.669492] [INFO ] [MAIN ] BAH: Successfully saved derivative data. [2025-09-17T22:48:00.672666] [INFO ] [MAIN ] Derivative Progress: 177/2085 symbols completed. BAH took 1.2s. Estimated remaining: 12m 18s. Rate: 155.2 symbols/min [2025-09-17T22:48:00.673167] [INFO ] [MAIN ] BANC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:00.714710] [DEBUG] [LOCAL ] BALL: Loaded 51854 existing records from primary storage. [2025-09-17T22:48:00.715043] [INFO ] [MAIN ] BALL: Loaded 51854 primary data records. [2025-09-17T22:48:01.095527] [DEBUG] [LOCAL ] BAM: Loaded 52019 existing records from primary storage. [2025-09-17T22:48:01.097735] [INFO ] [MAIN ] BAM: Loaded 52019 primary data records. [2025-09-17T22:48:01.097576] [DEBUG] [LOCAL ] BANC: Loaded 51275 existing records from primary storage. [2025-09-17T22:48:01.098051] [INFO ] [MAIN ] BANC: Loaded 51275 primary data records. [2025-09-17T22:48:01.811803] [DEBUG] [MAIN ] BALL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:01.812923] [INFO ] [MAIN ] BALL: Generated 1794 derivative records from 51854 primary records. [2025-09-17T22:48:01.813676] [DEBUG] [LOCAL ] BALL: Saving derivative data. [2025-09-17T22:48:01.838360] [DEBUG] [LOCAL ] BALL: Derivative data saved (1794 records). [2025-09-17T22:48:01.838688] [INFO ] [MAIN ] BALL: Successfully saved derivative data. [2025-09-17T22:48:01.841327] [INFO ] [MAIN ] Derivative Progress: 178/2085 symbols completed. BALL took 1.2s. Estimated remaining: 12m 26s. Rate: 153.4 symbols/min [2025-09-17T22:48:01.856099] [DEBUG] [MAIN ] BANC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:01.858751] [INFO ] [MAIN ] BANC: Generated 1794 derivative records from 51275 primary records. [2025-09-17T22:48:01.859010] [DEBUG] [LOCAL ] BANC: Saving derivative data. [2025-09-17T22:48:01.880557] [DEBUG] [MAIN ] BAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:01.885443] [INFO ] [MAIN ] BAM: Generated 1794 derivative records from 52019 primary records. [2025-09-17T22:48:01.888750] [DEBUG] [LOCAL ] BAM: Saving derivative data. [2025-09-17T22:48:01.890232] [DEBUG] [LOCAL ] BANC: Derivative data saved (1794 records). [2025-09-17T22:48:01.890618] [INFO ] [MAIN ] BANC: Successfully saved derivative data. [2025-09-17T22:48:01.893280] [INFO ] [MAIN ] Derivative Progress: 179/2085 symbols completed. BANC took 1.2s. Estimated remaining: 12m 22s. Rate: 154.2 symbols/min [2025-09-17T22:48:01.909199] [DEBUG] [LOCAL ] BAM: Derivative data saved (1794 records). [2025-09-17T22:48:01.909327] [INFO ] [MAIN ] BAM: Successfully saved derivative data. [2025-09-17T22:48:01.911995] [INFO ] [MAIN ] Derivative Progress: 180/2085 symbols completed. BAM took 1.3s. Estimated remaining: 12m 18s. Rate: 155.0 symbols/min [2025-09-17T22:48:01.913005] [INFO ] [MAIN ] BAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:01.912903] [INFO ] [MAIN ] BB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:01.912695] [INFO ] [MAIN ] BAX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:01.945529] [DEBUG] [LOCAL ] BAP: Loaded 26470 existing records from primary storage. [2025-09-17T22:48:01.945768] [INFO ] [MAIN ] BAP: Loaded 26470 primary data records. [2025-09-17T22:48:02.106060] [DEBUG] [LOCAL ] BAX: Loaded 53489 existing records from primary storage. [2025-09-17T22:48:02.112226] [INFO ] [MAIN ] BAX: Loaded 53489 primary data records. [2025-09-17T22:48:02.281687] [DEBUG] [LOCAL ] BB: Loaded 52925 existing records from primary storage. [2025-09-17T22:48:02.423748] [INFO ] [MAIN ] BB: Loaded 52925 primary data records. [2025-09-17T22:48:02.995717] [DEBUG] [MAIN ] BAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:02.998389] [INFO ] [MAIN ] BAP: Generated 1794 derivative records from 26470 primary records. [2025-09-17T22:48:02.998889] [DEBUG] [LOCAL ] BAP: Saving derivative data. [2025-09-17T22:48:03.019691] [DEBUG] [LOCAL ] BAP: Derivative data saved (1794 records). [2025-09-17T22:48:03.020368] [INFO ] [MAIN ] BAP: Successfully saved derivative data. [2025-09-17T22:48:03.035608] [INFO ] [MAIN ] Derivative Progress: 181/2085 symbols completed. BAP took 1.1s. Estimated remaining: 12m 25s. Rate: 153.4 symbols/min [2025-09-17T22:48:03.036475] [DEBUG] [MAIN ] BAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:03.037424] [INFO ] [MAIN ] BAX: Generated 1794 derivative records from 53489 primary records. [2025-09-17T22:48:03.038151] [DEBUG] [LOCAL ] BAX: Saving derivative data. [2025-09-17T22:48:03.037832] [INFO ] [MAIN ] BBAI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:03.069193] [DEBUG] [MAIN ] BB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:03.070901] [INFO ] [MAIN ] BB: Generated 1794 derivative records from 52925 primary records. [2025-09-17T22:48:03.071264] [DEBUG] [LOCAL ] BB: Saving derivative data. [2025-09-17T22:48:03.082598] [DEBUG] [LOCAL ] BAX: Derivative data saved (1794 records). [2025-09-17T22:48:03.086518] [INFO ] [MAIN ] BAX: Successfully saved derivative data. [2025-09-17T22:48:03.089709] [INFO ] [MAIN ] Derivative Progress: 182/2085 symbols completed. BAX took 1.2s. Estimated remaining: 12m 21s. Rate: 154.1 symbols/min [2025-09-17T22:48:03.091453] [INFO ] [MAIN ] BBAR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:03.093532] [DEBUG] [LOCAL ] BB: Derivative data saved (1794 records). [2025-09-17T22:48:03.094090] [INFO ] [MAIN ] BB: Successfully saved derivative data. [2025-09-17T22:48:03.096792] [INFO ] [MAIN ] Derivative Progress: 183/2085 symbols completed. BB took 1.2s. Estimated remaining: 12m 17s. Rate: 154.9 symbols/min [2025-09-17T22:48:03.097215] [INFO ] [MAIN ] BBDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:03.162997] [DEBUG] [LOCAL ] BBAI: Loaded 53820 existing records from primary storage. [2025-09-17T22:48:03.163309] [INFO ] [MAIN ] BBAI: Loaded 53820 primary data records. [2025-09-17T22:48:03.272464] [DEBUG] [LOCAL ] BBDC: Loaded 33531 existing records from primary storage. [2025-09-17T22:48:03.288937] [INFO ] [MAIN ] BBDC: Loaded 33531 primary data records. [2025-09-17T22:48:03.306010] [DEBUG] [LOCAL ] BBAR: Loaded 40968 existing records from primary storage. [2025-09-17T22:48:03.338715] [INFO ] [MAIN ] BBAR: Loaded 40968 primary data records. [2025-09-17T22:48:04.167153] [DEBUG] [MAIN ] BBAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:04.168127] [INFO ] [MAIN ] BBAI: Generated 1794 derivative records from 53820 primary records. [2025-09-17T22:48:04.169201] [DEBUG] [LOCAL ] BBAI: Saving derivative data. [2025-09-17T22:48:04.196111] [DEBUG] [MAIN ] BBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:04.197339] [INFO ] [MAIN ] BBDC: Generated 1794 derivative records from 33531 primary records. [2025-09-17T22:48:04.197445] [DEBUG] [LOCAL ] BBDC: Saving derivative data. [2025-09-17T22:48:04.217252] [DEBUG] [LOCAL ] BBDC: Derivative data saved (1794 records). [2025-09-17T22:48:04.217445] [INFO ] [MAIN ] BBDC: Successfully saved derivative data. [2025-09-17T22:48:04.231152] [INFO ] [MAIN ] Derivative Progress: 184/2085 symbols completed. BBDC took 1.1s. Estimated remaining: 12m 24s. Rate: 153.3 symbols/min [2025-09-17T22:48:04.237188] [DEBUG] [MAIN ] BBAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:04.238055] [INFO ] [MAIN ] BBAR: Generated 1794 derivative records from 40968 primary records. [2025-09-17T22:48:04.236889] [DEBUG] [LOCAL ] BBAI: Derivative data saved (1794 records). [2025-09-17T22:48:04.238205] [INFO ] [MAIN ] BBAI: Successfully saved derivative data. [2025-09-17T22:48:04.240201] [INFO ] [MAIN ] BBDO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:04.240139] [INFO ] [MAIN ] Derivative Progress: 185/2085 symbols completed. BBAI took 1.2s. Estimated remaining: 12m 20s. Rate: 154.1 symbols/min [2025-09-17T22:48:04.240441] [DEBUG] [LOCAL ] BBAR: Saving derivative data. [2025-09-17T22:48:04.240590] [INFO ] [MAIN ] BBN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:04.258253] [DEBUG] [LOCAL ] BBAR: Derivative data saved (1794 records). [2025-09-17T22:48:04.258396] [INFO ] [MAIN ] BBAR: Successfully saved derivative data. [2025-09-17T22:48:04.261045] [INFO ] [MAIN ] Derivative Progress: 186/2085 symbols completed. BBAR took 1.2s. Estimated remaining: 12m 15s. Rate: 154.9 symbols/min [2025-09-17T22:48:04.261358] [INFO ] [MAIN ] BBUC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:04.265184] [DEBUG] [LOCAL ] BBDO: Loaded 5073 existing records from primary storage. [2025-09-17T22:48:04.265332] [INFO ] [MAIN ] BBDO: Loaded 5073 primary data records. [2025-09-17T22:48:04.375738] [DEBUG] [LOCAL ] BBN: Loaded 18050 existing records from primary storage. [2025-09-17T22:48:04.392233] [DEBUG] [LOCAL ] BBUC: Loaded 13228 existing records from primary storage. [2025-09-17T22:48:04.391958] [INFO ] [MAIN ] BBN: Loaded 18050 primary data records. [2025-09-17T22:48:04.392349] [INFO ] [MAIN ] BBUC: Loaded 13228 primary data records. [2025-09-17T22:48:05.250321] [DEBUG] [MAIN ] BBDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:05.253012] [INFO ] [MAIN ] BBDO: Generated 1794 derivative records from 5073 primary records. [2025-09-17T22:48:05.254009] [DEBUG] [LOCAL ] BBDO: Saving derivative data. [2025-09-17T22:48:05.286998] [DEBUG] [MAIN ] BBUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:05.289449] [INFO ] [MAIN ] BBUC: Generated 1794 derivative records from 13228 primary records. [2025-09-17T22:48:05.293412] [DEBUG] [MAIN ] BBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:05.292604] [DEBUG] [LOCAL ] BBUC: Saving derivative data. [2025-09-17T22:48:05.297280] [DEBUG] [LOCAL ] BBDO: Derivative data saved (1794 records). [2025-09-17T22:48:05.298598] [INFO ] [MAIN ] BBN: Generated 1794 derivative records from 18050 primary records. [2025-09-17T22:48:05.299123] [INFO ] [MAIN ] BBDO: Successfully saved derivative data. [2025-09-17T22:48:05.299229] [DEBUG] [LOCAL ] BBN: Saving derivative data. [2025-09-17T22:48:05.301430] [INFO ] [MAIN ] Derivative Progress: 187/2085 symbols completed. BBDO took 1.1s. Estimated remaining: 12m 22s. Rate: 153.5 symbols/min [2025-09-17T22:48:05.327152] [DEBUG] [LOCAL ] BBUC: Derivative data saved (1794 records). [2025-09-17T22:48:05.322686] [INFO ] [MAIN ] BBVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:05.330128] [INFO ] [MAIN ] BBUC: Successfully saved derivative data. [2025-09-17T22:48:05.333316] [INFO ] [MAIN ] Derivative Progress: 188/2085 symbols completed. BBUC took 1.1s. Estimated remaining: 12m 18s. Rate: 154.3 symbols/min [2025-09-17T22:48:05.335929] [INFO ] [MAIN ] BBW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:05.342443] [DEBUG] [LOCAL ] BBN: Derivative data saved (1794 records). [2025-09-17T22:48:05.342784] [INFO ] [MAIN ] BBN: Successfully saved derivative data. [2025-09-17T22:48:05.345211] [INFO ] [MAIN ] Derivative Progress: 189/2085 symbols completed. BBN took 1.1s. Estimated remaining: 12m 14s. Rate: 155.1 symbols/min [2025-09-17T22:48:05.345607] [INFO ] [MAIN ] BBWI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:05.373188] [DEBUG] [LOCAL ] BBW: Loaded 26466 existing records from primary storage. [2025-09-17T22:48:05.373321] [INFO ] [MAIN ] BBW: Loaded 26466 primary data records. [2025-09-17T22:48:05.597357] [DEBUG] [LOCAL ] BBVA: Loaded 49617 existing records from primary storage. [2025-09-17T22:48:05.613455] [INFO ] [MAIN ] BBVA: Loaded 49617 primary data records. [2025-09-17T22:48:05.794193] [DEBUG] [LOCAL ] BBWI: Loaded 53574 existing records from primary storage. [2025-09-17T22:48:05.852823] [INFO ] [MAIN ] BBWI: Loaded 53574 primary data records. [2025-09-17T22:48:06.453280] [DEBUG] [MAIN ] BBW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:06.454231] [INFO ] [MAIN ] BBW: Generated 1794 derivative records from 26466 primary records. [2025-09-17T22:48:06.454789] [DEBUG] [LOCAL ] BBW: Saving derivative data. [2025-09-17T22:48:06.489027] [DEBUG] [LOCAL ] BBW: Derivative data saved (1794 records). [2025-09-17T22:48:06.488936] [DEBUG] [MAIN ] BBVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:06.489511] [INFO ] [MAIN ] BBW: Successfully saved derivative data. [2025-09-17T22:48:06.490337] [INFO ] [MAIN ] BBVA: Generated 1794 derivative records from 49617 primary records. [2025-09-17T22:48:06.493691] [INFO ] [MAIN ] Derivative Progress: 190/2085 symbols completed. BBW took 1.2s. Estimated remaining: 12m 21s. Rate: 153.5 symbols/min [2025-09-17T22:48:06.490903] [DEBUG] [LOCAL ] BBVA: Saving derivative data. [2025-09-17T22:48:06.495182] [INFO ] [MAIN ] BBY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:06.518375] [DEBUG] [LOCAL ] BBVA: Derivative data saved (1794 records). [2025-09-17T22:48:06.526269] [INFO ] [MAIN ] BBVA: Successfully saved derivative data. [2025-09-17T22:48:06.533068] [INFO ] [MAIN ] Derivative Progress: 191/2085 symbols completed. BBVA took 1.2s. Estimated remaining: 12m 17s. Rate: 154.2 symbols/min [2025-09-17T22:48:06.533942] [INFO ] [MAIN ] BC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:06.533822] [DEBUG] [MAIN ] BBWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:06.535332] [INFO ] [MAIN ] BBWI: Generated 1794 derivative records from 53574 primary records. [2025-09-17T22:48:06.535632] [DEBUG] [LOCAL ] BBWI: Saving derivative data. [2025-09-17T22:48:06.554494] [DEBUG] [LOCAL ] BBWI: Derivative data saved (1794 records). [2025-09-17T22:48:06.554722] [INFO ] [MAIN ] BBWI: Successfully saved derivative data. [2025-09-17T22:48:06.557560] [INFO ] [MAIN ] Derivative Progress: 192/2085 symbols completed. BBWI took 1.2s. Estimated remaining: 12m 13s. Rate: 155.0 symbols/min [2025-09-17T22:48:06.557930] [INFO ] [MAIN ] BCAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:06.616973] [DEBUG] [LOCAL ] BBY: Loaded 53487 existing records from primary storage. [2025-09-17T22:48:06.617301] [INFO ] [MAIN ] BBY: Loaded 53487 primary data records. [2025-09-17T22:48:06.741323] [DEBUG] [LOCAL ] BC: Loaded 44725 existing records from primary storage. [2025-09-17T22:48:06.745789] [INFO ] [MAIN ] BC: Loaded 44725 primary data records. [2025-09-17T22:48:06.818437] [DEBUG] [LOCAL ] BCAT: Loaded 34660 existing records from primary storage. [2025-09-17T22:48:06.872516] [INFO ] [MAIN ] BCAT: Loaded 34660 primary data records. [2025-09-17T22:48:07.651800] [DEBUG] [MAIN ] BBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:07.653074] [INFO ] [MAIN ] BBY: Generated 1794 derivative records from 53487 primary records. [2025-09-17T22:48:07.653175] [DEBUG] [LOCAL ] BBY: Saving derivative data. [2025-09-17T22:48:07.674950] [DEBUG] [LOCAL ] BBY: Derivative data saved (1794 records). [2025-09-17T22:48:07.675430] [INFO ] [MAIN ] BBY: Successfully saved derivative data. [2025-09-17T22:48:07.691981] [INFO ] [MAIN ] Derivative Progress: 193/2085 symbols completed. BBY took 1.2s. Estimated remaining: 12m 20s. Rate: 153.4 symbols/min [2025-09-17T22:48:07.692961] [DEBUG] [MAIN ] BC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:07.693907] [INFO ] [MAIN ] BC: Generated 1794 derivative records from 44725 primary records. [2025-09-17T22:48:07.694112] [DEBUG] [LOCAL ] BC: Saving derivative data. [2025-09-17T22:48:07.712414] [DEBUG] [LOCAL ] BC: Derivative data saved (1794 records). [2025-09-17T22:48:07.713534] [INFO ] [MAIN ] BC: Successfully saved derivative data. [2025-09-17T22:48:07.716912] [INFO ] [MAIN ] Derivative Progress: 194/2085 symbols completed. BC took 1.2s. Estimated remaining: 12m 16s. Rate: 154.2 symbols/min [2025-09-17T22:48:07.731413] [DEBUG] [MAIN ] BCAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:07.732212] [INFO ] [MAIN ] BCAT: Generated 1794 derivative records from 34660 primary records. [2025-09-17T22:48:07.732291] [DEBUG] [LOCAL ] BCAT: Saving derivative data. [2025-09-17T22:48:07.749401] [DEBUG] [LOCAL ] BCAT: Derivative data saved (1794 records). [2025-09-17T22:48:07.749490] [INFO ] [MAIN ] BCAT: Successfully saved derivative data. [2025-09-17T22:48:07.753490] [INFO ] [MAIN ] Derivative Progress: 195/2085 symbols completed. BCAT took 1.2s. Estimated remaining: 12m 12s. Rate: 154.9 symbols/min [2025-09-17T22:48:07.754328] [INFO ] [MAIN ] BCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:07.754047] [INFO ] [MAIN ] BCC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:07.754252] [INFO ] [MAIN ] BCE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:07.821890] [DEBUG] [LOCAL ] BCC: Loaded 28375 existing records from primary storage. [2025-09-17T22:48:07.820807] [DEBUG] [LOCAL ] BCO: Loaded 26474 existing records from primary storage. [2025-09-17T22:48:07.822234] [INFO ] [MAIN ] BCO: Loaded 26474 primary data records. [2025-09-17T22:48:07.822331] [INFO ] [MAIN ] BCC: Loaded 28375 primary data records. [2025-09-17T22:48:08.089033] [DEBUG] [LOCAL ] BCE: Loaded 52372 existing records from primary storage. [2025-09-17T22:48:08.101038] [INFO ] [MAIN ] BCE: Loaded 52372 primary data records. [2025-09-17T22:48:08.884921] [DEBUG] [MAIN ] BCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:08.898803] [INFO ] [MAIN ] BCC: Generated 1794 derivative records from 28375 primary records. [2025-09-17T22:48:08.899942] [DEBUG] [MAIN ] BCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:08.901010] [INFO ] [MAIN ] BCO: Generated 1794 derivative records from 26474 primary records. [2025-09-17T22:48:08.899443] [DEBUG] [LOCAL ] BCC: Saving derivative data. [2025-09-17T22:48:08.902171] [DEBUG] [LOCAL ] BCO: Saving derivative data. [2025-09-17T22:48:08.932633] [DEBUG] [LOCAL ] BCC: Derivative data saved (1794 records). [2025-09-17T22:48:08.937328] [DEBUG] [LOCAL ] BCO: Derivative data saved (1794 records). [2025-09-17T22:48:08.937595] [INFO ] [MAIN ] BCC: Successfully saved derivative data. [2025-09-17T22:48:08.945266] [INFO ] [MAIN ] BCO: Successfully saved derivative data. [2025-09-17T22:48:08.952145] [INFO ] [MAIN ] Derivative Progress: 196/2085 symbols completed. BCC took 1.2s. Estimated remaining: 12m 19s. Rate: 153.3 symbols/min [2025-09-17T22:48:08.955342] [INFO ] [MAIN ] Derivative Progress: 197/2085 symbols completed. BCO took 1.2s. Estimated remaining: 12m 15s. Rate: 154.0 symbols/min [2025-09-17T22:48:08.955261] [INFO ] [MAIN ] BCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:08.955148] [DEBUG] [MAIN ] BCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:08.956352] [INFO ] [MAIN ] BCE: Generated 1794 derivative records from 52372 primary records. [2025-09-17T22:48:08.956862] [INFO ] [MAIN ] BCSF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:08.957097] [DEBUG] [LOCAL ] BCE: Saving derivative data. [2025-09-17T22:48:08.973874] [DEBUG] [LOCAL ] BCE: Derivative data saved (1794 records). [2025-09-17T22:48:08.973942] [INFO ] [MAIN ] BCE: Successfully saved derivative data. [2025-09-17T22:48:08.976448] [INFO ] [MAIN ] Derivative Progress: 198/2085 symbols completed. BCE took 1.2s. Estimated remaining: 12m 11s. Rate: 154.8 symbols/min [2025-09-17T22:48:08.976959] [INFO ] [MAIN ] BCX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:09.009027] [DEBUG] [LOCAL ] BCX: Loaded 22046 existing records from primary storage. [2025-09-17T22:48:09.009221] [INFO ] [MAIN ] BCX: Loaded 22046 primary data records. [2025-09-17T22:48:09.076700] [DEBUG] [LOCAL ] BCSF: Loaded 27950 existing records from primary storage. [2025-09-17T22:48:09.088975] [INFO ] [MAIN ] BCSF: Loaded 27950 primary data records. [2025-09-17T22:48:09.322118] [DEBUG] [LOCAL ] BCS: Loaded 53479 existing records from primary storage. [2025-09-17T22:48:09.342860] [INFO ] [MAIN ] BCS: Loaded 53479 primary data records. [2025-09-17T22:48:10.110185] [DEBUG] [MAIN ] BCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:10.112263] [INFO ] [MAIN ] BCX: Generated 1794 derivative records from 22046 primary records. [2025-09-17T22:48:10.125633] [DEBUG] [LOCAL ] BCX: Saving derivative data. [2025-09-17T22:48:10.126584] [DEBUG] [MAIN ] BCSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:10.128462] [INFO ] [MAIN ] BCSF: Generated 1794 derivative records from 27950 primary records. [2025-09-17T22:48:10.135845] [DEBUG] [LOCAL ] BCSF: Saving derivative data. [2025-09-17T22:48:10.146505] [DEBUG] [LOCAL ] BCX: Derivative data saved (1794 records). [2025-09-17T22:48:10.153999] [INFO ] [MAIN ] BCX: Successfully saved derivative data. [2025-09-17T22:48:10.156089] [INFO ] [MAIN ] Derivative Progress: 199/2085 symbols completed. BCX took 1.2s. Estimated remaining: 12m 19s. Rate: 153.2 symbols/min [2025-09-17T22:48:10.158011] [INFO ] [MAIN ] BDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:10.166217] [DEBUG] [LOCAL ] BCSF: Derivative data saved (1794 records). [2025-09-17T22:48:10.166493] [INFO ] [MAIN ] BCSF: Successfully saved derivative data. [2025-09-17T22:48:10.169305] [INFO ] [MAIN ] Derivative Progress: 200/2085 symbols completed. BCSF took 1.2s. Estimated remaining: 12m 15s. Rate: 154.0 symbols/min [2025-09-17T22:48:10.170055] [INFO ] [MAIN ] BDJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:10.189372] [DEBUG] [MAIN ] BCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:10.190216] [INFO ] [MAIN ] BCS: Generated 1794 derivative records from 53479 primary records. [2025-09-17T22:48:10.190380] [DEBUG] [LOCAL ] BCS: Saving derivative data. [2025-09-17T22:48:10.212789] [DEBUG] [LOCAL ] BCS: Derivative data saved (1794 records). [2025-09-17T22:48:10.221231] [INFO ] [MAIN ] BCS: Successfully saved derivative data. [2025-09-17T22:48:10.231823] [DEBUG] [LOCAL ] BDC: Loaded 25058 existing records from primary storage. [2025-09-17T22:48:10.231032] [INFO ] [MAIN ] Derivative Progress: 201/2085 symbols completed. BCS took 1.3s. Estimated remaining: 12m 11s. Rate: 154.6 symbols/min [2025-09-17T22:48:10.232052] [INFO ] [MAIN ] BDC: Loaded 25058 primary data records. [2025-09-17T22:48:10.232363] [INFO ] [MAIN ] BDN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:10.320887] [DEBUG] [LOCAL ] BDJ: Loaded 29274 existing records from primary storage. [2025-09-17T22:48:10.331397] [INFO ] [MAIN ] BDJ: Loaded 29274 primary data records. [2025-09-17T22:48:10.909930] [DEBUG] [LOCAL ] BDN: Loaded 47693 existing records from primary storage. [2025-09-17T22:48:10.910311] [INFO ] [MAIN ] BDN: Loaded 47693 primary data records. [2025-09-17T22:48:11.245343] [DEBUG] [MAIN ] BDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:11.248007] [INFO ] [MAIN ] BDC: Generated 1794 derivative records from 25058 primary records. [2025-09-17T22:48:11.248439] [DEBUG] [LOCAL ] BDC: Saving derivative data. [2025-09-17T22:48:11.279755] [DEBUG] [MAIN ] BDJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:11.282118] [INFO ] [MAIN ] BDJ: Generated 1794 derivative records from 29274 primary records. [2025-09-17T22:48:11.282926] [DEBUG] [LOCAL ] BDJ: Saving derivative data. [2025-09-17T22:48:11.299009] [DEBUG] [LOCAL ] BDC: Derivative data saved (1794 records). [2025-09-17T22:48:11.304311] [DEBUG] [LOCAL ] BDJ: Derivative data saved (1794 records). [2025-09-17T22:48:11.304549] [INFO ] [MAIN ] BDJ: Successfully saved derivative data. [2025-09-17T22:48:11.304706] [INFO ] [MAIN ] BDC: Successfully saved derivative data. [2025-09-17T22:48:11.307419] [INFO ] [MAIN ] Derivative Progress: 202/2085 symbols completed. BDC took 1.1s. Estimated remaining: 12m 17s. Rate: 153.3 symbols/min [2025-09-17T22:48:11.311796] [INFO ] [MAIN ] BDX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:11.311560] [INFO ] [MAIN ] Derivative Progress: 203/2085 symbols completed. BDJ took 1.1s. Estimated remaining: 12m 13s. Rate: 154.0 symbols/min [2025-09-17T22:48:11.313034] [INFO ] [MAIN ] BEKE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:11.331034] [DEBUG] [MAIN ] BDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:11.331853] [INFO ] [MAIN ] BDN: Generated 1794 derivative records from 47693 primary records. [2025-09-17T22:48:11.331917] [DEBUG] [LOCAL ] BDN: Saving derivative data. [2025-09-17T22:48:11.349313] [DEBUG] [LOCAL ] BDN: Derivative data saved (1794 records). [2025-09-17T22:48:11.349676] [INFO ] [MAIN ] BDN: Successfully saved derivative data. [2025-09-17T22:48:11.352022] [INFO ] [MAIN ] Derivative Progress: 204/2085 symbols completed. BDN took 1.1s. Estimated remaining: 12m 10s. Rate: 154.7 symbols/min [2025-09-17T22:48:11.352391] [INFO ] [MAIN ] BEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:11.410030] [DEBUG] [LOCAL ] BDX: Loaded 52531 existing records from primary storage. [2025-09-17T22:48:11.424818] [INFO ] [MAIN ] BDX: Loaded 52531 primary data records. [2025-09-17T22:48:11.425896] [DEBUG] [LOCAL ] BEKE: Loaded 53267 existing records from primary storage. [2025-09-17T22:48:11.460535] [INFO ] [MAIN ] BEKE: Loaded 53267 primary data records. [2025-09-17T22:48:11.652282] [DEBUG] [LOCAL ] BEN: Loaded 53082 existing records from primary storage. [2025-09-17T22:48:11.690857] [INFO ] [MAIN ] BEN: Loaded 53082 primary data records. [2025-09-17T22:48:12.469311] [DEBUG] [MAIN ] BDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:12.470725] [INFO ] [MAIN ] BDX: Generated 1794 derivative records from 52531 primary records. [2025-09-17T22:48:12.471170] [DEBUG] [LOCAL ] BDX: Saving derivative data. [2025-09-17T22:48:12.522257] [DEBUG] [MAIN ] BEKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:12.532540] [DEBUG] [MAIN ] BEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:12.533417] [INFO ] [MAIN ] BEN: Generated 1794 derivative records from 53082 primary records. [2025-09-17T22:48:12.530986] [DEBUG] [LOCAL ] BDX: Derivative data saved (1794 records). [2025-09-17T22:48:12.533730] [INFO ] [MAIN ] BDX: Successfully saved derivative data. [2025-09-17T22:48:12.536529] [INFO ] [MAIN ] Derivative Progress: 205/2085 symbols completed. BDX took 1.2s. Estimated remaining: 12m 17s. Rate: 153.2 symbols/min [2025-09-17T22:48:12.532161] [INFO ] [MAIN ] BEKE: Generated 1794 derivative records from 53267 primary records. [2025-09-17T22:48:12.533585] [DEBUG] [LOCAL ] BEN: Saving derivative data. [2025-09-17T22:48:12.537667] [DEBUG] [LOCAL ] BEKE: Saving derivative data. [2025-09-17T22:48:12.537901] [INFO ] [MAIN ] BEP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:12.578767] [DEBUG] [LOCAL ] BEKE: Derivative data saved (1794 records). [2025-09-17T22:48:12.580714] [INFO ] [MAIN ] BEKE: Successfully saved derivative data. [2025-09-17T22:48:12.585425] [INFO ] [MAIN ] Derivative Progress: 206/2085 symbols completed. BEKE took 1.3s. Estimated remaining: 12m 13s. Rate: 153.8 symbols/min [2025-09-17T22:48:12.587594] [DEBUG] [LOCAL ] BEN: Derivative data saved (1794 records). [2025-09-17T22:48:12.587949] [INFO ] [MAIN ] BEPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:12.588819] [INFO ] [MAIN ] BEN: Successfully saved derivative data. [2025-09-17T22:48:12.592234] [INFO ] [MAIN ] Derivative Progress: 207/2085 symbols completed. BEN took 1.2s. Estimated remaining: 12m 9s. Rate: 154.5 symbols/min [2025-09-17T22:48:12.592897] [INFO ] [MAIN ] BEPH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:12.616341] [DEBUG] [LOCAL ] BEPH: Loaded 5228 existing records from primary storage. [2025-09-17T22:48:12.630550] [INFO ] [MAIN ] BEPH: Loaded 5228 primary data records. [2025-09-17T22:48:12.780925] [DEBUG] [LOCAL ] BEP: Loaded 38801 existing records from primary storage. [2025-09-17T22:48:12.810119] [INFO ] [MAIN ] BEP: Loaded 38801 primary data records. [2025-09-17T22:48:13.163594] [DEBUG] [LOCAL ] BEPC: Loaded 46641 existing records from primary storage. [2025-09-17T22:48:13.208216] [INFO ] [MAIN ] BEPC: Loaded 46641 primary data records. [2025-09-17T22:48:13.936556] [DEBUG] [MAIN ] BEPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:13.938023] [INFO ] [MAIN ] BEPH: Generated 1794 derivative records from 5228 primary records. [2025-09-17T22:48:13.938782] [DEBUG] [LOCAL ] BEPH: Saving derivative data. [2025-09-17T22:48:13.957422] [DEBUG] [LOCAL ] BEPH: Derivative data saved (1794 records). [2025-09-17T22:48:13.957600] [INFO ] [MAIN ] BEPH: Successfully saved derivative data. [2025-09-17T22:48:13.959802] [INFO ] [MAIN ] Derivative Progress: 208/2085 symbols completed. BEPH took 1.4s. Estimated remaining: 12m 18s. Rate: 152.7 symbols/min [2025-09-17T22:48:13.998318] [DEBUG] [MAIN ] BEPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:13.998688] [DEBUG] [MAIN ] BEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:13.999711] [INFO ] [MAIN ] BEP: Generated 1794 derivative records from 38801 primary records. [2025-09-17T22:48:13.999824] [DEBUG] [LOCAL ] BEP: Saving derivative data. [2025-09-17T22:48:14.000570] [INFO ] [MAIN ] BEPC: Generated 1794 derivative records from 46641 primary records. [2025-09-17T22:48:14.001210] [DEBUG] [LOCAL ] BEPC: Saving derivative data. [2025-09-17T22:48:14.034361] [DEBUG] [LOCAL ] BEPC: Derivative data saved (1794 records). [2025-09-17T22:48:14.034917] [INFO ] [MAIN ] BEPC: Successfully saved derivative data. [2025-09-17T22:48:14.034711] [DEBUG] [LOCAL ] BEP: Derivative data saved (1794 records). [2025-09-17T22:48:14.037700] [INFO ] [MAIN ] Derivative Progress: 209/2085 symbols completed. BEPC took 1.4s. Estimated remaining: 12m 14s. Rate: 153.3 symbols/min [2025-09-17T22:48:14.037980] [INFO ] [MAIN ] BEP: Successfully saved derivative data. [2025-09-17T22:48:14.040612] [INFO ] [MAIN ] Derivative Progress: 210/2085 symbols completed. BEP took 1.5s. Estimated remaining: 12m 11s. Rate: 154.0 symbols/min [2025-09-17T22:48:14.041238] [INFO ] [MAIN ] BEPJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:14.041745] [INFO ] [MAIN ] BEPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:14.041637] [INFO ] [MAIN ] BFAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:14.047552] [DEBUG] [LOCAL ] BEPJ: Loaded 3292 existing records from primary storage. [2025-09-17T22:48:14.048786] [INFO ] [MAIN ] BEPJ: Loaded 3292 primary data records. [2025-09-17T22:48:14.109085] [DEBUG] [LOCAL ] BEPI: Loaded 3429 existing records from primary storage. [2025-09-17T22:48:14.130997] [INFO ] [MAIN ] BEPI: Loaded 3429 primary data records. [2025-09-17T22:48:14.377491] [DEBUG] [LOCAL ] BFAM: Loaded 32892 existing records from primary storage. [2025-09-17T22:48:14.532319] [INFO ] [MAIN ] BFAM: Loaded 32892 primary data records. [2025-09-17T22:48:15.066519] [DEBUG] [MAIN ] BEPJ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:48:15.068278] [INFO ] [MAIN ] BEPJ: Generated 1793 derivative records from 3292 primary records. [2025-09-17T22:48:15.068582] [DEBUG] [LOCAL ] BEPJ: Saving derivative data. [2025-09-17T22:48:15.082911] [DEBUG] [MAIN ] BEPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:15.084187] [INFO ] [MAIN ] BEPI: Generated 1794 derivative records from 3429 primary records. [2025-09-17T22:48:15.084299] [DEBUG] [LOCAL ] BEPI: Saving derivative data. [2025-09-17T22:48:15.111579] [DEBUG] [LOCAL ] BEPI: Derivative data saved (1794 records). [2025-09-17T22:48:15.112517] [INFO ] [MAIN ] BEPI: Successfully saved derivative data. [2025-09-17T22:48:15.115125] [INFO ] [MAIN ] Derivative Progress: 211/2085 symbols completed. BEPI took 1.1s. Estimated remaining: 12m 16s. Rate: 152.7 symbols/min [2025-09-17T22:48:15.116389] [INFO ] [MAIN ] BFH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:15.117092] [DEBUG] [LOCAL ] BEPJ: Derivative data saved (1793 records). [2025-09-17T22:48:15.117381] [INFO ] [MAIN ] BEPJ: Successfully saved derivative data. [2025-09-17T22:48:15.119778] [INFO ] [MAIN ] Derivative Progress: 212/2085 symbols completed. BEPJ took 1.1s. Estimated remaining: 12m 12s. Rate: 153.4 symbols/min [2025-09-17T22:48:15.120255] [INFO ] [MAIN ] BFK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:15.139115] [DEBUG] [MAIN ] BFAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:15.140101] [INFO ] [MAIN ] BFAM: Generated 1794 derivative records from 32892 primary records. [2025-09-17T22:48:15.140196] [DEBUG] [LOCAL ] BFAM: Saving derivative data. [2025-09-17T22:48:15.161235] [DEBUG] [LOCAL ] BFAM: Derivative data saved (1794 records). [2025-09-17T22:48:15.166413] [INFO ] [MAIN ] BFAM: Successfully saved derivative data. [2025-09-17T22:48:15.169629] [DEBUG] [LOCAL ] BFK: Loaded 13965 existing records from primary storage. [2025-09-17T22:48:15.169224] [INFO ] [MAIN ] Derivative Progress: 213/2085 symbols completed. BFAM took 1.1s. Estimated remaining: 12m 9s. Rate: 154.1 symbols/min [2025-09-17T22:48:15.169803] [INFO ] [MAIN ] BFK: Loaded 13965 primary data records. [2025-09-17T22:48:15.170009] [INFO ] [MAIN ] BFLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:15.511634] [DEBUG] [LOCAL ] BFH: Loaded 42029 existing records from primary storage. [2025-09-17T22:48:15.525767] [INFO ] [MAIN ] BFH: Loaded 42029 primary data records. [2025-09-17T22:48:15.658056] [DEBUG] [LOCAL ] BFLY: Loaded 51833 existing records from primary storage. [2025-09-17T22:48:15.684556] [INFO ] [MAIN ] BFLY: Loaded 51833 primary data records. [2025-09-17T22:48:16.192018] [DEBUG] [MAIN ] BFK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:16.193597] [INFO ] [MAIN ] BFK: Generated 1794 derivative records from 13965 primary records. [2025-09-17T22:48:16.194298] [DEBUG] [LOCAL ] BFK: Saving derivative data. [2025-09-17T22:48:16.212587] [DEBUG] [LOCAL ] BFK: Derivative data saved (1794 records). [2025-09-17T22:48:16.212935] [INFO ] [MAIN ] BFK: Successfully saved derivative data. [2025-09-17T22:48:16.216409] [INFO ] [MAIN ] Derivative Progress: 214/2085 symbols completed. BFK took 1.1s. Estimated remaining: 12m 14s. Rate: 152.9 symbols/min [2025-09-17T22:48:16.217722] [INFO ] [MAIN ] BFS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:16.236920] [DEBUG] [MAIN ] BFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:16.238502] [INFO ] [MAIN ] BFH: Generated 1794 derivative records from 42029 primary records. [2025-09-17T22:48:16.242397] [DEBUG] [LOCAL ] BFH: Saving derivative data. [2025-09-17T22:48:16.243828] [DEBUG] [LOCAL ] BFS: Loaded 9033 existing records from primary storage. [2025-09-17T22:48:16.244005] [INFO ] [MAIN ] BFS: Loaded 9033 primary data records. [2025-09-17T22:48:16.321546] [DEBUG] [LOCAL ] BFH: Derivative data saved (1794 records). [2025-09-17T22:48:16.356223] [INFO ] [MAIN ] BFH: Successfully saved derivative data. [2025-09-17T22:48:16.369081] [INFO ] [MAIN ] Derivative Progress: 215/2085 symbols completed. BFH took 1.3s. Estimated remaining: 12m 12s. Rate: 153.3 symbols/min [2025-09-17T22:48:16.399274] [INFO ] [MAIN ] BFZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:16.399832] [DEBUG] [MAIN ] BFLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:16.400757] [INFO ] [MAIN ] BFLY: Generated 1794 derivative records from 51833 primary records. [2025-09-17T22:48:16.406198] [DEBUG] [LOCAL ] BFLY: Saving derivative data. [2025-09-17T22:48:16.500841] [DEBUG] [LOCAL ] BFLY: Derivative data saved (1794 records). [2025-09-17T22:48:16.660431] [INFO ] [MAIN ] BFLY: Successfully saved derivative data. [2025-09-17T22:48:16.664196] [INFO ] [MAIN ] Derivative Progress: 216/2085 symbols completed. BFLY took 1.5s. Estimated remaining: 12m 11s. Rate: 153.5 symbols/min [2025-09-17T22:48:16.669195] [DEBUG] [LOCAL ] BFZ: Loaded 11444 existing records from primary storage. [2025-09-17T22:48:16.669428] [INFO ] [MAIN ] BGB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:16.669537] [INFO ] [MAIN ] BFZ: Loaded 11444 primary data records. [2025-09-17T22:48:16.876013] [DEBUG] [LOCAL ] BGB: Loaded 17659 existing records from primary storage. [2025-09-17T22:48:16.999204] [INFO ] [MAIN ] BGB: Loaded 17659 primary data records. [2025-09-17T22:48:17.205171] [DEBUG] [MAIN ] BFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:17.216815] [INFO ] [MAIN ] BFS: Generated 1794 derivative records from 9033 primary records. [2025-09-17T22:48:17.335629] [DEBUG] [LOCAL ] BFS: Saving derivative data. [2025-09-17T22:48:17.382392] [DEBUG] [LOCAL ] BFS: Derivative data saved (1794 records). [2025-09-17T22:48:17.382228] [DEBUG] [MAIN ] BFZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:17.382591] [INFO ] [MAIN ] BFS: Successfully saved derivative data. [2025-09-17T22:48:17.384089] [INFO ] [MAIN ] BFZ: Generated 1794 derivative records from 11444 primary records. [2025-09-17T22:48:17.386638] [INFO ] [MAIN ] Derivative Progress: 217/2085 symbols completed. BFS took 1.2s. Estimated remaining: 12m 13s. Rate: 152.9 symbols/min [2025-09-17T22:48:17.386767] [DEBUG] [LOCAL ] BFZ: Saving derivative data. [2025-09-17T22:48:17.387845] [INFO ] [MAIN ] BGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:17.404109] [DEBUG] [LOCAL ] BFZ: Derivative data saved (1794 records). [2025-09-17T22:48:17.404535] [INFO ] [MAIN ] BFZ: Successfully saved derivative data. [2025-09-17T22:48:17.407219] [INFO ] [MAIN ] Derivative Progress: 218/2085 symbols completed. BFZ took 1.0s. Estimated remaining: 12m 10s. Rate: 153.6 symbols/min [2025-09-17T22:48:17.408040] [INFO ] [MAIN ] BGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:17.435993] [DEBUG] [LOCAL ] BGR: Loaded 13572 existing records from primary storage. [2025-09-17T22:48:17.436431] [DEBUG] [MAIN ] BGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:17.437361] [INFO ] [MAIN ] BGB: Generated 1794 derivative records from 17659 primary records. [2025-09-17T22:48:17.437514] [INFO ] [MAIN ] BGR: Loaded 13572 primary data records. [2025-09-17T22:48:17.437603] [DEBUG] [LOCAL ] BGB: Saving derivative data. [2025-09-17T22:48:17.542692] [DEBUG] [LOCAL ] BGB: Derivative data saved (1794 records). [2025-09-17T22:48:17.557217] [INFO ] [MAIN ] BGB: Successfully saved derivative data. [2025-09-17T22:48:17.582036] [INFO ] [MAIN ] Derivative Progress: 219/2085 symbols completed. BGB took 0.9s. Estimated remaining: 12m 7s. Rate: 153.9 symbols/min [2025-09-17T22:48:17.583066] [INFO ] [MAIN ] BGSF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:17.805383] [DEBUG] [LOCAL ] BGSF: Loaded 5983 existing records from primary storage. [2025-09-17T22:48:17.801864] [DEBUG] [LOCAL ] BGS: Loaded 50410 existing records from primary storage. [2025-09-17T22:48:17.805552] [INFO ] [MAIN ] BGSF: Loaded 5983 primary data records. [2025-09-17T22:48:17.805733] [INFO ] [MAIN ] BGS: Loaded 50410 primary data records. [2025-09-17T22:48:18.528818] [DEBUG] [MAIN ] BGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:18.529757] [INFO ] [MAIN ] BGR: Generated 1794 derivative records from 13572 primary records. [2025-09-17T22:48:18.529863] [DEBUG] [LOCAL ] BGR: Saving derivative data. [2025-09-17T22:48:18.550124] [DEBUG] [LOCAL ] BGR: Derivative data saved (1794 records). [2025-09-17T22:48:18.550375] [INFO ] [MAIN ] BGR: Successfully saved derivative data. [2025-09-17T22:48:18.553026] [INFO ] [MAIN ] Derivative Progress: 220/2085 symbols completed. BGR took 1.2s. Estimated remaining: 12m 12s. Rate: 152.9 symbols/min [2025-09-17T22:48:18.554038] [INFO ] [MAIN ] BGT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:18.583926] [DEBUG] [MAIN ] BGSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:18.584205] [DEBUG] [MAIN ] BGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:18.585577] [INFO ] [MAIN ] BGS: Generated 1794 derivative records from 50410 primary records. [2025-09-17T22:48:18.584997] [INFO ] [MAIN ] BGSF: Generated 1794 derivative records from 5983 primary records. [2025-09-17T22:48:18.585710] [DEBUG] [LOCAL ] BGSF: Saving derivative data. [2025-09-17T22:48:18.586120] [DEBUG] [LOCAL ] BGS: Saving derivative data. [2025-09-17T22:48:18.625595] [DEBUG] [LOCAL ] BGSF: Derivative data saved (1794 records). [2025-09-17T22:48:18.627313] [DEBUG] [LOCAL ] BGS: Derivative data saved (1794 records). [2025-09-17T22:48:18.626032] [DEBUG] [LOCAL ] BGT: Loaded 16731 existing records from primary storage. [2025-09-17T22:48:18.627458] [INFO ] [MAIN ] BGSF: Successfully saved derivative data. [2025-09-17T22:48:18.630278] [INFO ] [MAIN ] Derivative Progress: 221/2085 symbols completed. BGSF took 1.0s. Estimated remaining: 12m 9s. Rate: 153.5 symbols/min [2025-09-17T22:48:18.627560] [INFO ] [MAIN ] BGS: Successfully saved derivative data. [2025-09-17T22:48:18.630379] [INFO ] [MAIN ] BGT: Loaded 16731 primary data records. [2025-09-17T22:48:18.633125] [INFO ] [MAIN ] Derivative Progress: 222/2085 symbols completed. BGS took 1.2s. Estimated remaining: 12m 5s. Rate: 154.2 symbols/min [2025-09-17T22:48:18.633221] [INFO ] [MAIN ] BGX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:18.655856] [INFO ] [MAIN ] BGY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:18.812855] [DEBUG] [LOCAL ] BGX: Loaded 10883 existing records from primary storage. [2025-09-17T22:48:18.844294] [INFO ] [MAIN ] BGX: Loaded 10883 primary data records. [2025-09-17T22:48:19.028086] [DEBUG] [LOCAL ] BGY: Loaded 23166 existing records from primary storage. [2025-09-17T22:48:19.061762] [INFO ] [MAIN ] BGY: Loaded 23166 primary data records. [2025-09-17T22:48:19.615301] [DEBUG] [MAIN ] BGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:19.616780] [INFO ] [MAIN ] BGT: Generated 1794 derivative records from 16731 primary records. [2025-09-17T22:48:19.616996] [DEBUG] [LOCAL ] BGT: Saving derivative data. [2025-09-17T22:48:19.635374] [DEBUG] [LOCAL ] BGT: Derivative data saved (1794 records). [2025-09-17T22:48:19.637319] [INFO ] [MAIN ] BGT: Successfully saved derivative data. [2025-09-17T22:48:19.640620] [INFO ] [MAIN ] Derivative Progress: 223/2085 symbols completed. BGT took 1.1s. Estimated remaining: 12m 10s. Rate: 153.1 symbols/min [2025-09-17T22:48:19.654836] [DEBUG] [MAIN ] BGX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:19.655672] [INFO ] [MAIN ] BGX: Generated 1794 derivative records from 10883 primary records. [2025-09-17T22:48:19.655819] [DEBUG] [LOCAL ] BGX: Saving derivative data. [2025-09-17T22:48:19.672939] [DEBUG] [LOCAL ] BGX: Derivative data saved (1794 records). [2025-09-17T22:48:19.673719] [INFO ] [MAIN ] BGX: Successfully saved derivative data. [2025-09-17T22:48:19.676075] [INFO ] [MAIN ] Derivative Progress: 224/2085 symbols completed. BGX took 1.0s. Estimated remaining: 12m 7s. Rate: 153.7 symbols/min [2025-09-17T22:48:19.688383] [DEBUG] [MAIN ] BGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:19.689080] [INFO ] [MAIN ] BGY: Generated 1794 derivative records from 23166 primary records. [2025-09-17T22:48:19.689141] [DEBUG] [LOCAL ] BGY: Saving derivative data. [2025-09-17T22:48:19.704955] [DEBUG] [LOCAL ] BGY: Derivative data saved (1794 records). [2025-09-17T22:48:19.705019] [INFO ] [MAIN ] BGY: Successfully saved derivative data. [2025-09-17T22:48:19.707918] [INFO ] [MAIN ] Derivative Progress: 225/2085 symbols completed. BGY took 1.1s. Estimated remaining: 12m 3s. Rate: 154.3 symbols/min [2025-09-17T22:48:19.708569] [INFO ] [MAIN ] BH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:19.708680] [INFO ] [MAIN ] BHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:19.708512] [INFO ] [MAIN ] BHE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:19.725718] [DEBUG] [LOCAL ] BH: Loaded 15256 existing records from primary storage. [2025-09-17T22:48:19.725896] [INFO ] [MAIN ] BH: Loaded 15256 primary data records. [2025-09-17T22:48:19.863056] [DEBUG] [LOCAL ] BHE: Loaded 25395 existing records from primary storage. [2025-09-17T22:48:19.868917] [INFO ] [MAIN ] BHE: Loaded 25395 primary data records. [2025-09-17T22:48:20.048785] [DEBUG] [LOCAL ] BHC: Loaded 46813 existing records from primary storage. [2025-09-17T22:48:20.061613] [INFO ] [MAIN ] BHC: Loaded 46813 primary data records. [2025-09-17T22:48:20.773033] [DEBUG] [MAIN ] BH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:20.773969] [INFO ] [MAIN ] BH: Generated 1794 derivative records from 15256 primary records. [2025-09-17T22:48:20.775135] [DEBUG] [LOCAL ] BH: Saving derivative data. [2025-09-17T22:48:20.803833] [DEBUG] [MAIN ] BHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:20.805460] [INFO ] [MAIN ] BHE: Generated 1794 derivative records from 25395 primary records. [2025-09-17T22:48:20.805937] [DEBUG] [LOCAL ] BHE: Saving derivative data. [2025-09-17T22:48:20.825680] [DEBUG] [LOCAL ] BHE: Derivative data saved (1794 records). [2025-09-17T22:48:20.826506] [INFO ] [MAIN ] BHE: Successfully saved derivative data. [2025-09-17T22:48:20.826399] [DEBUG] [LOCAL ] BH: Derivative data saved (1794 records). [2025-09-17T22:48:20.829241] [INFO ] [MAIN ] Derivative Progress: 226/2085 symbols completed. BHE took 1.1s. Estimated remaining: 12m 9s. Rate: 153.0 symbols/min [2025-09-17T22:48:20.829531] [INFO ] [MAIN ] BHK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:20.829709] [INFO ] [MAIN ] BH: Successfully saved derivative data. [2025-09-17T22:48:20.845127] [DEBUG] [MAIN ] BHC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:48:20.843660] [INFO ] [MAIN ] Derivative Progress: 227/2085 symbols completed. BH took 1.1s. Estimated remaining: 12m 5s. Rate: 153.7 symbols/min [2025-09-17T22:48:20.846191] [INFO ] [MAIN ] BHC: Generated 1793 derivative records from 46813 primary records. [2025-09-17T22:48:20.846369] [INFO ] [MAIN ] BHP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:20.846448] [DEBUG] [LOCAL ] BHC: Saving derivative data. [2025-09-17T22:48:20.868812] [DEBUG] [LOCAL ] BHC: Derivative data saved (1793 records). [2025-09-17T22:48:20.869015] [INFO ] [MAIN ] BHC: Successfully saved derivative data. [2025-09-17T22:48:20.871997] [INFO ] [MAIN ] Derivative Progress: 228/2085 symbols completed. BHC took 1.2s. Estimated remaining: 12m 2s. Rate: 154.3 symbols/min [2025-09-17T22:48:20.872452] [INFO ] [MAIN ] BHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:20.882854] [DEBUG] [LOCAL ] BHK: Loaded 22454 existing records from primary storage. [2025-09-17T22:48:20.883002] [INFO ] [MAIN ] BHK: Loaded 22454 primary data records. [2025-09-17T22:48:21.094019] [DEBUG] [LOCAL ] BHR: Loaded 21399 existing records from primary storage. [2025-09-17T22:48:21.108058] [INFO ] [MAIN ] BHR: Loaded 21399 primary data records. [2025-09-17T22:48:21.245834] [DEBUG] [LOCAL ] BHP: Loaded 53391 existing records from primary storage. [2025-09-17T22:48:21.293048] [INFO ] [MAIN ] BHP: Loaded 53391 primary data records. [2025-09-17T22:48:21.886999] [DEBUG] [MAIN ] BHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:21.887984] [INFO ] [MAIN ] BHK: Generated 1794 derivative records from 22454 primary records. [2025-09-17T22:48:21.888158] [DEBUG] [LOCAL ] BHK: Saving derivative data. [2025-09-17T22:48:21.905088] [DEBUG] [LOCAL ] BHK: Derivative data saved (1794 records). [2025-09-17T22:48:21.905436] [INFO ] [MAIN ] BHK: Successfully saved derivative data. [2025-09-17T22:48:21.908447] [INFO ] [MAIN ] Derivative Progress: 229/2085 symbols completed. BHK took 1.1s. Estimated remaining: 12m 7s. Rate: 153.2 symbols/min [2025-09-17T22:48:21.909977] [INFO ] [MAIN ] BHVN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:21.928395] [DEBUG] [MAIN ] BHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:21.941334] [DEBUG] [MAIN ] BHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:21.941136] [INFO ] [MAIN ] BHR: Generated 1794 derivative records from 21399 primary records. [2025-09-17T22:48:21.942253] [DEBUG] [LOCAL ] BHR: Saving derivative data. [2025-09-17T22:48:21.941961] [INFO ] [MAIN ] BHP: Generated 1794 derivative records from 53391 primary records. [2025-09-17T22:48:21.942340] [DEBUG] [LOCAL ] BHP: Saving derivative data. [2025-09-17T22:48:21.970085] [DEBUG] [LOCAL ] BHR: Derivative data saved (1794 records). [2025-09-17T22:48:21.970819] [INFO ] [MAIN ] BHR: Successfully saved derivative data. [2025-09-17T22:48:21.973103] [INFO ] [MAIN ] Derivative Progress: 230/2085 symbols completed. BHR took 1.1s. Estimated remaining: 12m 4s. Rate: 153.8 symbols/min [2025-09-17T22:48:21.976018] [INFO ] [MAIN ] BILL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:21.978523] [DEBUG] [LOCAL ] BHP: Derivative data saved (1794 records). [2025-09-17T22:48:21.978600] [INFO ] [MAIN ] BHP: Successfully saved derivative data. [2025-09-17T22:48:21.981197] [INFO ] [MAIN ] Derivative Progress: 231/2085 symbols completed. BHP took 1.1s. Estimated remaining: 12m 0s. Rate: 154.4 symbols/min [2025-09-17T22:48:21.981621] [INFO ] [MAIN ] BIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:22.032594] [DEBUG] [LOCAL ] BIO: Loaded 25809 existing records from primary storage. [2025-09-17T22:48:22.032888] [INFO ] [MAIN ] BIO: Loaded 25809 primary data records. [2025-09-17T22:48:22.034001] [DEBUG] [LOCAL ] BHVN: Loaded 49553 existing records from primary storage. [2025-09-17T22:48:22.046243] [INFO ] [MAIN ] BHVN: Loaded 49553 primary data records. [2025-09-17T22:48:22.384749] [DEBUG] [LOCAL ] BILL: Loaded 52319 existing records from primary storage. [2025-09-17T22:48:22.413701] [INFO ] [MAIN ] BILL: Loaded 52319 primary data records. [2025-09-17T22:48:23.116797] [DEBUG] [MAIN ] BIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:23.118009] [INFO ] [MAIN ] BIO: Generated 1794 derivative records from 25809 primary records. [2025-09-17T22:48:23.118379] [DEBUG] [LOCAL ] BIO: Saving derivative data. [2025-09-17T22:48:23.132196] [DEBUG] [MAIN ] BHVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:23.145163] [INFO ] [MAIN ] BHVN: Generated 1794 derivative records from 49553 primary records. [2025-09-17T22:48:23.145548] [DEBUG] [LOCAL ] BHVN: Saving derivative data. [2025-09-17T22:48:23.151071] [DEBUG] [LOCAL ] BIO: Derivative data saved (1794 records). [2025-09-17T22:48:23.152062] [INFO ] [MAIN ] BIO: Successfully saved derivative data. [2025-09-17T22:48:23.165561] [INFO ] [MAIN ] Derivative Progress: 232/2085 symbols completed. BIO took 1.2s. Estimated remaining: 12m 6s. Rate: 153.1 symbols/min [2025-09-17T22:48:23.166540] [INFO ] [MAIN ] BIP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:23.181125] [DEBUG] [MAIN ] BILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:23.185231] [DEBUG] [LOCAL ] BHVN: Derivative data saved (1794 records). [2025-09-17T22:48:23.185531] [INFO ] [MAIN ] BHVN: Successfully saved derivative data. [2025-09-17T22:48:23.184826] [INFO ] [MAIN ] BILL: Generated 1794 derivative records from 52319 primary records. [2025-09-17T22:48:23.185677] [DEBUG] [LOCAL ] BILL: Saving derivative data. [2025-09-17T22:48:23.188678] [INFO ] [MAIN ] Derivative Progress: 233/2085 symbols completed. BHVN took 1.3s. Estimated remaining: 12m 3s. Rate: 153.7 symbols/min [2025-09-17T22:48:23.189413] [INFO ] [MAIN ] BIPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:23.206617] [DEBUG] [LOCAL ] BILL: Derivative data saved (1794 records). [2025-09-17T22:48:23.206785] [INFO ] [MAIN ] BILL: Successfully saved derivative data. [2025-09-17T22:48:23.209521] [INFO ] [MAIN ] Derivative Progress: 234/2085 symbols completed. BILL took 1.2s. Estimated remaining: 11m 60s. Rate: 154.3 symbols/min [2025-09-17T22:48:23.209948] [INFO ] [MAIN ] BIPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:23.216246] [DEBUG] [LOCAL ] BIPI: Loaded 3432 existing records from primary storage. [2025-09-17T22:48:23.216985] [INFO ] [MAIN ] BIPI: Loaded 3432 primary data records. [2025-09-17T22:48:23.444564] [DEBUG] [LOCAL ] BIP: Loaded 39777 existing records from primary storage. [2025-09-17T22:48:23.444832] [INFO ] [MAIN ] BIP: Loaded 39777 primary data records. [2025-09-17T22:48:23.601857] [DEBUG] [LOCAL ] BIPC: Loaded 41820 existing records from primary storage. [2025-09-17T22:48:23.618396] [INFO ] [MAIN ] BIPC: Loaded 41820 primary data records. [2025-09-17T22:48:24.220115] [DEBUG] [MAIN ] BIPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:24.221735] [INFO ] [MAIN ] BIPI: Generated 1794 derivative records from 3432 primary records. [2025-09-17T22:48:24.222926] [DEBUG] [LOCAL ] BIPI: Saving derivative data. [2025-09-17T22:48:24.258151] [DEBUG] [MAIN ] BIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:24.259885] [INFO ] [MAIN ] BIP: Generated 1794 derivative records from 39777 primary records. [2025-09-17T22:48:24.257915] [DEBUG] [LOCAL ] BIPI: Derivative data saved (1794 records). [2025-09-17T22:48:24.260121] [DEBUG] [LOCAL ] BIP: Saving derivative data. [2025-09-17T22:48:24.260635] [INFO ] [MAIN ] BIPI: Successfully saved derivative data. [2025-09-17T22:48:24.275957] [INFO ] [MAIN ] Derivative Progress: 235/2085 symbols completed. BIPI took 1.1s. Estimated remaining: 12m 5s. Rate: 153.2 symbols/min [2025-09-17T22:48:24.277374] [INFO ] [MAIN ] BIPJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:24.285019] [DEBUG] [MAIN ] BIPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:24.290842] [INFO ] [MAIN ] BIPC: Generated 1794 derivative records from 41820 primary records. [2025-09-17T22:48:24.293737] [DEBUG] [LOCAL ] BIPC: Saving derivative data. [2025-09-17T22:48:24.295555] [DEBUG] [LOCAL ] BIP: Derivative data saved (1794 records). [2025-09-17T22:48:24.296597] [INFO ] [MAIN ] BIP: Successfully saved derivative data. [2025-09-17T22:48:24.298830] [INFO ] [MAIN ] Derivative Progress: 236/2085 symbols completed. BIP took 1.1s. Estimated remaining: 12m 1s. Rate: 153.8 symbols/min [2025-09-17T22:48:24.307174] [INFO ] [MAIN ] BIRK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:24.314928] [DEBUG] [LOCAL ] BIPJ: Loaded 2883 existing records from primary storage. [2025-09-17T22:48:24.315698] [INFO ] [MAIN ] BIPJ: Loaded 2883 primary data records. [2025-09-17T22:48:24.427168] [DEBUG] [LOCAL ] BIPC: Derivative data saved (1794 records). [2025-09-17T22:48:24.431665] [INFO ] [MAIN ] BIPC: Successfully saved derivative data. [2025-09-17T22:48:24.450907] [INFO ] [MAIN ] Derivative Progress: 237/2085 symbols completed. BIPC took 1.3s. Estimated remaining: 11m 59s. Rate: 154.2 symbols/min [2025-09-17T22:48:24.529481] [INFO ] [MAIN ] BIT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:24.700388] [DEBUG] [LOCAL ] BIRK: Loaded 50805 existing records from primary storage. [2025-09-17T22:48:24.701446] [INFO ] [MAIN ] BIRK: Loaded 50805 primary data records. [2025-09-17T22:48:24.831183] [DEBUG] [LOCAL ] BIT: Loaded 21819 existing records from primary storage. [2025-09-17T22:48:24.837457] [INFO ] [MAIN ] BIT: Loaded 21819 primary data records. [2025-09-17T22:48:25.239133] [DEBUG] [MAIN ] BIPJ: Filtered 6931 bins outside market hours, 7727 incomplete bins [2025-09-17T22:48:25.372551] [INFO ] [MAIN ] BIPJ: Generated 1791 derivative records from 2883 primary records. [2025-09-17T22:48:25.382077] [DEBUG] [LOCAL ] BIPJ: Saving derivative data. [2025-09-17T22:48:25.402879] [DEBUG] [LOCAL ] BIPJ: Derivative data saved (1791 records). [2025-09-17T22:48:25.403145] [INFO ] [MAIN ] BIPJ: Successfully saved derivative data. [2025-09-17T22:48:25.407618] [INFO ] [MAIN ] Derivative Progress: 238/2085 symbols completed. BIPJ took 1.1s. Estimated remaining: 12m 3s. Rate: 153.2 symbols/min [2025-09-17T22:48:25.423858] [DEBUG] [MAIN ] BIRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:25.424523] [INFO ] [MAIN ] BIRK: Generated 1794 derivative records from 50805 primary records. [2025-09-17T22:48:25.424787] [DEBUG] [LOCAL ] BIRK: Saving derivative data. [2025-09-17T22:48:25.443096] [DEBUG] [LOCAL ] BIRK: Derivative data saved (1794 records). [2025-09-17T22:48:25.443233] [INFO ] [MAIN ] BIRK: Successfully saved derivative data. [2025-09-17T22:48:25.446670] [INFO ] [MAIN ] Derivative Progress: 239/2085 symbols completed. BIRK took 1.1s. Estimated remaining: 12m 0s. Rate: 153.8 symbols/min [2025-09-17T22:48:25.459267] [DEBUG] [MAIN ] BIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:25.459875] [INFO ] [MAIN ] BIT: Generated 1794 derivative records from 21819 primary records. [2025-09-17T22:48:25.459938] [DEBUG] [LOCAL ] BIT: Saving derivative data. [2025-09-17T22:48:25.475758] [DEBUG] [LOCAL ] BIT: Derivative data saved (1794 records). [2025-09-17T22:48:25.475818] [INFO ] [MAIN ] BIT: Successfully saved derivative data. [2025-09-17T22:48:25.478909] [INFO ] [MAIN ] Derivative Progress: 240/2085 symbols completed. BIT took 0.9s. Estimated remaining: 11m 57s. Rate: 154.4 symbols/min [2025-09-17T22:48:25.479629] [INFO ] [MAIN ] BKD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:25.479768] [INFO ] [MAIN ] BJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:25.479500] [INFO ] [MAIN ] BK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:25.552144] [DEBUG] [LOCAL ] BKD: Loaded 50107 existing records from primary storage. [2025-09-17T22:48:25.552410] [INFO ] [MAIN ] BKD: Loaded 50107 primary data records. [2025-09-17T22:48:25.681234] [DEBUG] [LOCAL ] BJ: Loaded 51438 existing records from primary storage. [2025-09-17T22:48:25.694530] [INFO ] [MAIN ] BJ: Loaded 51438 primary data records. [2025-09-17T22:48:25.711206] [DEBUG] [LOCAL ] BK: Loaded 53566 existing records from primary storage. [2025-09-17T22:48:25.721670] [INFO ] [MAIN ] BK: Loaded 53566 primary data records. [2025-09-17T22:48:26.625378] [DEBUG] [MAIN ] BKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:26.627072] [INFO ] [MAIN ] BKD: Generated 1794 derivative records from 50107 primary records. [2025-09-17T22:48:26.627854] [DEBUG] [LOCAL ] BKD: Saving derivative data. [2025-09-17T22:48:26.653073] [DEBUG] [MAIN ] BJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:26.658546] [INFO ] [MAIN ] BJ: Generated 1794 derivative records from 51438 primary records. [2025-09-17T22:48:26.658854] [DEBUG] [LOCAL ] BJ: Saving derivative data. [2025-09-17T22:48:26.657618] [DEBUG] [LOCAL ] BKD: Derivative data saved (1794 records). [2025-09-17T22:48:26.659381] [INFO ] [MAIN ] BKD: Successfully saved derivative data. [2025-09-17T22:48:26.676044] [INFO ] [MAIN ] Derivative Progress: 241/2085 symbols completed. BKD took 1.2s. Estimated remaining: 12m 3s. Rate: 153.1 symbols/min [2025-09-17T22:48:26.678993] [INFO ] [MAIN ] BKE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:26.696016] [DEBUG] [LOCAL ] BJ: Derivative data saved (1794 records). [2025-09-17T22:48:26.696247] [INFO ] [MAIN ] BJ: Successfully saved derivative data. [2025-09-17T22:48:26.699049] [INFO ] [MAIN ] Derivative Progress: 242/2085 symbols completed. BJ took 1.2s. Estimated remaining: 11m 59s. Rate: 153.7 symbols/min [2025-09-17T22:48:26.699821] [INFO ] [MAIN ] BKH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:26.699537] [DEBUG] [MAIN ] BK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:26.700747] [INFO ] [MAIN ] BK: Generated 1794 derivative records from 53566 primary records. [2025-09-17T22:48:26.701158] [DEBUG] [LOCAL ] BK: Saving derivative data. [2025-09-17T22:48:26.718978] [DEBUG] [LOCAL ] BK: Derivative data saved (1794 records). [2025-09-17T22:48:26.719180] [INFO ] [MAIN ] BK: Successfully saved derivative data. [2025-09-17T22:48:26.721803] [INFO ] [MAIN ] Derivative Progress: 243/2085 symbols completed. BK took 1.2s. Estimated remaining: 11m 56s. Rate: 154.3 symbols/min [2025-09-17T22:48:26.722196] [INFO ] [MAIN ] BKKT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:26.752765] [DEBUG] [LOCAL ] BKE: Loaded 34983 existing records from primary storage. [2025-09-17T22:48:26.753034] [INFO ] [MAIN ] BKE: Loaded 34983 primary data records. [2025-09-17T22:48:26.905949] [DEBUG] [LOCAL ] BKH: Loaded 36722 existing records from primary storage. [2025-09-17T22:48:26.912396] [INFO ] [MAIN ] BKH: Loaded 36722 primary data records. [2025-09-17T22:48:27.020022] [DEBUG] [LOCAL ] BKKT: Loaded 33950 existing records from primary storage. [2025-09-17T22:48:27.064254] [INFO ] [MAIN ] BKKT: Loaded 33950 primary data records. [2025-09-17T22:48:27.852940] [DEBUG] [MAIN ] BKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:27.854245] [INFO ] [MAIN ] BKE: Generated 1794 derivative records from 34983 primary records. [2025-09-17T22:48:27.854388] [DEBUG] [LOCAL ] BKE: Saving derivative data. [2025-09-17T22:48:27.872595] [DEBUG] [LOCAL ] BKE: Derivative data saved (1794 records). [2025-09-17T22:48:27.875222] [INFO ] [MAIN ] BKE: Successfully saved derivative data. [2025-09-17T22:48:27.877043] [INFO ] [MAIN ] Derivative Progress: 244/2085 symbols completed. BKE took 1.2s. Estimated remaining: 12m 2s. Rate: 153.1 symbols/min [2025-09-17T22:48:27.877494] [INFO ] [MAIN ] BKN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:27.892445] [DEBUG] [MAIN ] BKH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:27.893301] [INFO ] [MAIN ] BKH: Generated 1794 derivative records from 36722 primary records. [2025-09-17T22:48:27.893479] [DEBUG] [LOCAL ] BKH: Saving derivative data. [2025-09-17T22:48:27.930402] [DEBUG] [LOCAL ] BKH: Derivative data saved (1794 records). [2025-09-17T22:48:27.929205] [DEBUG] [LOCAL ] BKN: Loaded 7692 existing records from primary storage. [2025-09-17T22:48:27.931044] [DEBUG] [MAIN ] BKKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:27.930753] [INFO ] [MAIN ] BKN: Loaded 7692 primary data records. [2025-09-17T22:48:27.952860] [INFO ] [MAIN ] BKKT: Generated 1794 derivative records from 33950 primary records. [2025-09-17T22:48:27.952172] [INFO ] [MAIN ] BKH: Successfully saved derivative data. [2025-09-17T22:48:27.968705] [DEBUG] [LOCAL ] BKKT: Saving derivative data. [2025-09-17T22:48:27.978137] [INFO ] [MAIN ] Derivative Progress: 245/2085 symbols completed. BKH took 1.3s. Estimated remaining: 11m 59s. Rate: 153.5 symbols/min [2025-09-17T22:48:28.011115] [INFO ] [MAIN ] BKSY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:28.073780] [DEBUG] [LOCAL ] BKKT: Derivative data saved (1794 records). [2025-09-17T22:48:28.105395] [INFO ] [MAIN ] BKKT: Successfully saved derivative data. [2025-09-17T22:48:28.200638] [INFO ] [MAIN ] Derivative Progress: 246/2085 symbols completed. BKKT took 1.5s. Estimated remaining: 11m 57s. Rate: 153.8 symbols/min [2025-09-17T22:48:28.261700] [INFO ] [MAIN ] BKT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:28.289431] [DEBUG] [LOCAL ] BKT: Loaded 10553 existing records from primary storage. [2025-09-17T22:48:28.291285] [INFO ] [MAIN ] BKT: Loaded 10553 primary data records. [2025-09-17T22:48:28.403988] [DEBUG] [MAIN ] BKN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:28.431051] [INFO ] [MAIN ] BKN: Generated 1794 derivative records from 7692 primary records. [2025-09-17T22:48:28.430301] [DEBUG] [LOCAL ] BKSY: Loaded 48297 existing records from primary storage. [2025-09-17T22:48:28.435486] [DEBUG] [LOCAL ] BKN: Saving derivative data. [2025-09-17T22:48:28.435886] [INFO ] [MAIN ] BKSY: Loaded 48297 primary data records. [2025-09-17T22:48:28.722891] [DEBUG] [LOCAL ] BKN: Derivative data saved (1794 records). [2025-09-17T22:48:28.740338] [INFO ] [MAIN ] BKN: Successfully saved derivative data. [2025-09-17T22:48:28.749129] [INFO ] [MAIN ] Derivative Progress: 247/2085 symbols completed. BKN took 0.9s. Estimated remaining: 11m 58s. Rate: 153.5 symbols/min [2025-09-17T22:48:28.761083] [INFO ] [MAIN ] BKU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:29.030866] [DEBUG] [MAIN ] BKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:29.031670] [INFO ] [MAIN ] BKT: Generated 1794 derivative records from 10553 primary records. [2025-09-17T22:48:29.031968] [DEBUG] [LOCAL ] BKT: Saving derivative data. [2025-09-17T22:48:29.061371] [DEBUG] [LOCAL ] BKT: Derivative data saved (1794 records). [2025-09-17T22:48:29.060825] [DEBUG] [LOCAL ] BKU: Loaded 42104 existing records from primary storage. [2025-09-17T22:48:29.062465] [INFO ] [MAIN ] BKT: Successfully saved derivative data. [2025-09-17T22:48:29.062553] [INFO ] [MAIN ] BKU: Loaded 42104 primary data records. [2025-09-17T22:48:29.064812] [INFO ] [MAIN ] Derivative Progress: 248/2085 symbols completed. BKT took 0.8s. Estimated remaining: 11m 57s. Rate: 153.7 symbols/min [2025-09-17T22:48:29.077993] [INFO ] [MAIN ] BKV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:29.136917] [DEBUG] [MAIN ] BKSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:29.152004] [INFO ] [MAIN ] BKSY: Generated 1794 derivative records from 48297 primary records. [2025-09-17T22:48:29.152188] [DEBUG] [LOCAL ] BKSY: Saving derivative data. [2025-09-17T22:48:29.413243] [DEBUG] [LOCAL ] BKSY: Derivative data saved (1794 records). [2025-09-17T22:48:29.413861] [DEBUG] [LOCAL ] BKV: Loaded 30233 existing records from primary storage. [2025-09-17T22:48:29.413968] [INFO ] [MAIN ] BKSY: Successfully saved derivative data. [2025-09-17T22:48:29.416290] [INFO ] [MAIN ] Derivative Progress: 249/2085 symbols completed. BKSY took 1.4s. Estimated remaining: 11m 57s. Rate: 153.7 symbols/min [2025-09-17T22:48:29.416763] [INFO ] [MAIN ] BLCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:29.416437] [INFO ] [MAIN ] BKV: Loaded 30233 primary data records. [2025-09-17T22:48:29.744798] [DEBUG] [LOCAL ] BLCO: Loaded 36348 existing records from primary storage. [2025-09-17T22:48:29.746014] [INFO ] [MAIN ] BLCO: Loaded 36348 primary data records. [2025-09-17T22:48:29.895241] [DEBUG] [MAIN ] BKU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:29.958144] [INFO ] [MAIN ] BKU: Generated 1794 derivative records from 42104 primary records. [2025-09-17T22:48:29.958327] [DEBUG] [LOCAL ] BKU: Saving derivative data. [2025-09-17T22:48:30.098950] [DEBUG] [LOCAL ] BKU: Derivative data saved (1794 records). [2025-09-17T22:48:30.099447] [INFO ] [MAIN ] BKU: Successfully saved derivative data. [2025-09-17T22:48:30.103336] [INFO ] [MAIN ] Derivative Progress: 250/2085 symbols completed. BKU took 1.3s. Estimated remaining: 11m 58s. Rate: 153.3 symbols/min [2025-09-17T22:48:30.104239] [INFO ] [MAIN ] BLDR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:30.119976] [DEBUG] [MAIN ] BKV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:30.120888] [INFO ] [MAIN ] BKV: Generated 1794 derivative records from 30233 primary records. [2025-09-17T22:48:30.121389] [DEBUG] [LOCAL ] BKV: Saving derivative data. [2025-09-17T22:48:30.138522] [DEBUG] [LOCAL ] BKV: Derivative data saved (1794 records). [2025-09-17T22:48:30.138735] [INFO ] [MAIN ] BKV: Successfully saved derivative data. [2025-09-17T22:48:30.140877] [INFO ] [MAIN ] Derivative Progress: 251/2085 symbols completed. BKV took 1.1s. Estimated remaining: 11m 55s. Rate: 153.8 symbols/min [2025-09-17T22:48:30.141268] [INFO ] [MAIN ] BLE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:30.159925] [DEBUG] [MAIN ] BLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:30.164712] [INFO ] [MAIN ] BLCO: Generated 1794 derivative records from 36348 primary records. [2025-09-17T22:48:30.164888] [DEBUG] [LOCAL ] BLCO: Saving derivative data. [2025-09-17T22:48:30.182972] [DEBUG] [LOCAL ] BLE: Loaded 14756 existing records from primary storage. [2025-09-17T22:48:30.183763] [INFO ] [MAIN ] BLE: Loaded 14756 primary data records. [2025-09-17T22:48:30.327223] [DEBUG] [LOCAL ] BLDR: Loaded 51629 existing records from primary storage. [2025-09-17T22:48:30.326320] [DEBUG] [LOCAL ] BLCO: Derivative data saved (1794 records). [2025-09-17T22:48:30.343234] [INFO ] [MAIN ] BLDR: Loaded 51629 primary data records. [2025-09-17T22:48:30.338068] [INFO ] [MAIN ] BLCO: Successfully saved derivative data. [2025-09-17T22:48:30.351492] [INFO ] [MAIN ] Derivative Progress: 252/2085 symbols completed. BLCO took 0.9s. Estimated remaining: 11m 54s. Rate: 154.1 symbols/min [2025-09-17T22:48:30.357018] [INFO ] [MAIN ] BLK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:30.912766] [DEBUG] [LOCAL ] BLK: Loaded 35384 existing records from primary storage. [2025-09-17T22:48:30.913196] [INFO ] [MAIN ] BLK: Loaded 35384 primary data records. [2025-09-17T22:48:31.041179] [DEBUG] [MAIN ] BLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:31.046354] [INFO ] [MAIN ] BLE: Generated 1794 derivative records from 14756 primary records. [2025-09-17T22:48:31.047089] [DEBUG] [LOCAL ] BLE: Saving derivative data. [2025-09-17T22:48:31.276414] [DEBUG] [LOCAL ] BLE: Derivative data saved (1794 records). [2025-09-17T22:48:31.276612] [INFO ] [MAIN ] BLE: Successfully saved derivative data. [2025-09-17T22:48:31.278902] [INFO ] [MAIN ] Derivative Progress: 253/2085 symbols completed. BLE took 1.1s. Estimated remaining: 11m 57s. Rate: 153.2 symbols/min [2025-09-17T22:48:31.275742] [DEBUG] [MAIN ] BLDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:31.280551] [INFO ] [MAIN ] BLDR: Generated 1794 derivative records from 51629 primary records. [2025-09-17T22:48:31.280760] [DEBUG] [LOCAL ] BLDR: Saving derivative data. [2025-09-17T22:48:31.298621] [DEBUG] [LOCAL ] BLDR: Derivative data saved (1794 records). [2025-09-17T22:48:31.298838] [INFO ] [MAIN ] BLDR: Successfully saved derivative data. [2025-09-17T22:48:31.302602] [INFO ] [MAIN ] Derivative Progress: 254/2085 symbols completed. BLDR took 1.2s. Estimated remaining: 11m 54s. Rate: 153.8 symbols/min [2025-09-17T22:48:31.321445] [DEBUG] [MAIN ] BLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:31.322038] [INFO ] [MAIN ] BLK: Generated 1794 derivative records from 35384 primary records. [2025-09-17T22:48:31.322101] [DEBUG] [LOCAL ] BLK: Saving derivative data. [2025-09-17T22:48:31.337814] [DEBUG] [LOCAL ] BLK: Derivative data saved (1794 records). [2025-09-17T22:48:31.337891] [INFO ] [MAIN ] BLK: Successfully saved derivative data. [2025-09-17T22:48:31.340807] [INFO ] [MAIN ] Derivative Progress: 255/2085 symbols completed. BLK took 1.0s. Estimated remaining: 11m 51s. Rate: 154.4 symbols/min [2025-09-17T22:48:31.341556] [INFO ] [MAIN ] BLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:31.341398] [INFO ] [MAIN ] BLW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:31.341510] [INFO ] [MAIN ] BLND: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:31.362582] [DEBUG] [LOCAL ] BLX: Loaded 16000 existing records from primary storage. [2025-09-17T22:48:31.362897] [INFO ] [MAIN ] BLX: Loaded 16000 primary data records. [2025-09-17T22:48:31.424866] [DEBUG] [LOCAL ] BLW: Loaded 12955 existing records from primary storage. [2025-09-17T22:48:31.439581] [INFO ] [MAIN ] BLW: Loaded 12955 primary data records. [2025-09-17T22:48:31.813609] [DEBUG] [LOCAL ] BLND: Loaded 49533 existing records from primary storage. [2025-09-17T22:48:31.830160] [INFO ] [MAIN ] BLND: Loaded 49533 primary data records. [2025-09-17T22:48:32.368131] [DEBUG] [MAIN ] BLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:32.369735] [INFO ] [MAIN ] BLX: Generated 1794 derivative records from 16000 primary records. [2025-09-17T22:48:32.369948] [DEBUG] [LOCAL ] BLX: Saving derivative data. [2025-09-17T22:48:32.390314] [DEBUG] [LOCAL ] BLX: Derivative data saved (1794 records). [2025-09-17T22:48:32.390856] [INFO ] [MAIN ] BLX: Successfully saved derivative data. [2025-09-17T22:48:32.393698] [INFO ] [MAIN ] Derivative Progress: 256/2085 symbols completed. BLX took 1.1s. Estimated remaining: 11m 56s. Rate: 153.3 symbols/min [2025-09-17T22:48:32.407057] [INFO ] [MAIN ] BMA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:32.407901] [DEBUG] [MAIN ] BLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:32.408911] [INFO ] [MAIN ] BLW: Generated 1794 derivative records from 12955 primary records. [2025-09-17T22:48:32.409079] [DEBUG] [LOCAL ] BLW: Saving derivative data. [2025-09-17T22:48:32.439770] [DEBUG] [LOCAL ] BLW: Derivative data saved (1794 records). [2025-09-17T22:48:32.439868] [INFO ] [MAIN ] BLW: Successfully saved derivative data. [2025-09-17T22:48:32.442254] [INFO ] [MAIN ] Derivative Progress: 257/2085 symbols completed. BLW took 1.1s. Estimated remaining: 11m 53s. Rate: 153.9 symbols/min [2025-09-17T22:48:32.439407] [DEBUG] [MAIN ] BLND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:32.442508] [INFO ] [MAIN ] BME: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:32.443497] [INFO ] [MAIN ] BLND: Generated 1794 derivative records from 49533 primary records. [2025-09-17T22:48:32.443862] [DEBUG] [LOCAL ] BLND: Saving derivative data. [2025-09-17T22:48:32.464817] [DEBUG] [LOCAL ] BLND: Derivative data saved (1794 records). [2025-09-17T22:48:32.464998] [INFO ] [MAIN ] BLND: Successfully saved derivative data. [2025-09-17T22:48:32.467725] [INFO ] [MAIN ] Derivative Progress: 258/2085 symbols completed. BLND took 1.1s. Estimated remaining: 11m 50s. Rate: 154.4 symbols/min [2025-09-17T22:48:32.478072] [INFO ] [MAIN ] BMEZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:32.483121] [DEBUG] [LOCAL ] BME: Loaded 10845 existing records from primary storage. [2025-09-17T22:48:32.483677] [INFO ] [MAIN ] BME: Loaded 10845 primary data records. [2025-09-17T22:48:32.613789] [DEBUG] [LOCAL ] BMA: Loaded 34425 existing records from primary storage. [2025-09-17T22:48:32.634578] [INFO ] [MAIN ] BMA: Loaded 34425 primary data records. [2025-09-17T22:48:32.776778] [DEBUG] [LOCAL ] BMEZ: Loaded 26163 existing records from primary storage. [2025-09-17T22:48:32.948563] [INFO ] [MAIN ] BMEZ: Loaded 26163 primary data records. [2025-09-17T22:48:33.493192] [DEBUG] [MAIN ] BME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:33.494239] [INFO ] [MAIN ] BME: Generated 1794 derivative records from 10845 primary records. [2025-09-17T22:48:33.494508] [DEBUG] [LOCAL ] BME: Saving derivative data. [2025-09-17T22:48:33.530716] [DEBUG] [MAIN ] BMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:33.532731] [INFO ] [MAIN ] BMA: Generated 1794 derivative records from 34425 primary records. [2025-09-17T22:48:33.533521] [DEBUG] [LOCAL ] BME: Derivative data saved (1794 records). [2025-09-17T22:48:33.533925] [INFO ] [MAIN ] BME: Successfully saved derivative data. [2025-09-17T22:48:33.536207] [INFO ] [MAIN ] Derivative Progress: 259/2085 symbols completed. BME took 1.1s. Estimated remaining: 11m 54s. Rate: 153.4 symbols/min [2025-09-17T22:48:33.533627] [DEBUG] [LOCAL ] BMA: Saving derivative data. [2025-09-17T22:48:33.537158] [INFO ] [MAIN ] BMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:33.570624] [DEBUG] [LOCAL ] BMA: Derivative data saved (1794 records). [2025-09-17T22:48:33.571187] [INFO ] [MAIN ] BMA: Successfully saved derivative data. [2025-09-17T22:48:33.574220] [DEBUG] [MAIN ] BMEZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:33.575161] [INFO ] [MAIN ] BMEZ: Generated 1794 derivative records from 26163 primary records. [2025-09-17T22:48:33.573877] [INFO ] [MAIN ] Derivative Progress: 260/2085 symbols completed. BMA took 1.2s. Estimated remaining: 11m 51s. Rate: 153.9 symbols/min [2025-09-17T22:48:33.575340] [DEBUG] [LOCAL ] BMEZ: Saving derivative data. [2025-09-17T22:48:33.576012] [INFO ] [MAIN ] BMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:33.599427] [DEBUG] [LOCAL ] BMN: Loaded 2576 existing records from primary storage. [2025-09-17T22:48:33.600095] [INFO ] [MAIN ] BMN: Loaded 2576 primary data records. [2025-09-17T22:48:33.690623] [DEBUG] [LOCAL ] BMEZ: Derivative data saved (1794 records). [2025-09-17T22:48:33.683019] [DEBUG] [LOCAL ] BMI: Loaded 23942 existing records from primary storage. [2025-09-17T22:48:33.690787] [INFO ] [MAIN ] BMEZ: Successfully saved derivative data. [2025-09-17T22:48:33.701201] [INFO ] [MAIN ] BMI: Loaded 23942 primary data records. [2025-09-17T22:48:33.722676] [INFO ] [MAIN ] Derivative Progress: 261/2085 symbols completed. BMEZ took 1.2s. Estimated remaining: 11m 49s. Rate: 154.3 symbols/min [2025-09-17T22:48:33.763959] [INFO ] [MAIN ] BMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:34.307116] [DEBUG] [LOCAL ] BMO: Loaded 41463 existing records from primary storage. [2025-09-17T22:48:34.315943] [INFO ] [MAIN ] BMO: Loaded 41463 primary data records. [2025-09-17T22:48:34.322417] [DEBUG] [MAIN ] BMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:34.329253] [INFO ] [MAIN ] BMN: Generated 1794 derivative records from 2576 primary records. [2025-09-17T22:48:34.362578] [DEBUG] [LOCAL ] BMN: Saving derivative data. [2025-09-17T22:48:34.488503] [DEBUG] [MAIN ] BMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:34.506018] [INFO ] [MAIN ] BMI: Generated 1794 derivative records from 23942 primary records. [2025-09-17T22:48:34.491639] [DEBUG] [LOCAL ] BMN: Derivative data saved (1794 records). [2025-09-17T22:48:34.522228] [INFO ] [MAIN ] BMN: Successfully saved derivative data. [2025-09-17T22:48:34.545950] [DEBUG] [LOCAL ] BMI: Saving derivative data. [2025-09-17T22:48:34.548092] [INFO ] [MAIN ] Derivative Progress: 262/2085 symbols completed. BMN took 1.0s. Estimated remaining: 11m 52s. Rate: 153.6 symbols/min [2025-09-17T22:48:34.664416] [INFO ] [MAIN ] BMY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:34.684895] [DEBUG] [LOCAL ] BMI: Derivative data saved (1794 records). [2025-09-17T22:48:34.685378] [INFO ] [MAIN ] BMI: Successfully saved derivative data. [2025-09-17T22:48:34.688298] [INFO ] [MAIN ] Derivative Progress: 263/2085 symbols completed. BMI took 1.2s. Estimated remaining: 11m 50s. Rate: 154.0 symbols/min [2025-09-17T22:48:34.688701] [INFO ] [MAIN ] BN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:34.723484] [DEBUG] [MAIN ] BMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:34.724468] [INFO ] [MAIN ] BMO: Generated 1794 derivative records from 41463 primary records. [2025-09-17T22:48:34.724687] [DEBUG] [LOCAL ] BMO: Saving derivative data. [2025-09-17T22:48:34.757968] [DEBUG] [LOCAL ] BMO: Derivative data saved (1794 records). [2025-09-17T22:48:34.758130] [INFO ] [MAIN ] BMO: Successfully saved derivative data. [2025-09-17T22:48:34.761619] [DEBUG] [LOCAL ] BMY: Loaded 53757 existing records from primary storage. [2025-09-17T22:48:34.760336] [INFO ] [MAIN ] Derivative Progress: 264/2085 symbols completed. BMO took 1.0s. Estimated remaining: 11m 47s. Rate: 154.5 symbols/min [2025-09-17T22:48:34.775218] [INFO ] [MAIN ] BNED: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:34.774908] [INFO ] [MAIN ] BMY: Loaded 53757 primary data records. [2025-09-17T22:48:34.909637] [DEBUG] [LOCAL ] BN: Loaded 53015 existing records from primary storage. [2025-09-17T22:48:34.920722] [INFO ] [MAIN ] BN: Loaded 53015 primary data records. [2025-09-17T22:48:35.111528] [DEBUG] [LOCAL ] BNED: Loaded 30101 existing records from primary storage. [2025-09-17T22:48:35.125244] [INFO ] [MAIN ] BNED: Loaded 30101 primary data records. [2025-09-17T22:48:35.786430] [DEBUG] [MAIN ] BMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:35.787739] [INFO ] [MAIN ] BMY: Generated 1794 derivative records from 53757 primary records. [2025-09-17T22:48:35.787871] [DEBUG] [LOCAL ] BMY: Saving derivative data. [2025-09-17T22:48:35.807268] [DEBUG] [LOCAL ] BMY: Derivative data saved (1794 records). [2025-09-17T22:48:35.819712] [INFO ] [MAIN ] BMY: Successfully saved derivative data. [2025-09-17T22:48:35.821622] [INFO ] [MAIN ] Derivative Progress: 265/2085 symbols completed. BMY took 1.2s. Estimated remaining: 11m 51s. Rate: 153.5 symbols/min [2025-09-17T22:48:35.822068] [INFO ] [MAIN ] BNH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:35.822529] [DEBUG] [MAIN ] BN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:35.823603] [INFO ] [MAIN ] BN: Generated 1794 derivative records from 53015 primary records. [2025-09-17T22:48:35.824377] [DEBUG] [LOCAL ] BN: Saving derivative data. [2025-09-17T22:48:35.854258] [DEBUG] [LOCAL ] BN: Derivative data saved (1794 records). [2025-09-17T22:48:35.845586] [DEBUG] [LOCAL ] BNH: Loaded 4836 existing records from primary storage. [2025-09-17T22:48:35.859165] [INFO ] [MAIN ] BN: Successfully saved derivative data. [2025-09-17T22:48:35.859473] [DEBUG] [MAIN ] BNED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:35.858962] [INFO ] [MAIN ] BNH: Loaded 4836 primary data records. [2025-09-17T22:48:35.860183] [INFO ] [MAIN ] BNED: Generated 1794 derivative records from 30101 primary records. [2025-09-17T22:48:35.871522] [DEBUG] [LOCAL ] BNED: Saving derivative data. [2025-09-17T22:48:35.899539] [INFO ] [MAIN ] Derivative Progress: 266/2085 symbols completed. BN took 1.2s. Estimated remaining: 11m 49s. Rate: 153.9 symbols/min [2025-09-17T22:48:35.945274] [INFO ] [MAIN ] BNJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:36.025492] [DEBUG] [LOCAL ] BNJ: Loaded 2629 existing records from primary storage. [2025-09-17T22:48:36.071270] [INFO ] [MAIN ] BNJ: Loaded 2629 primary data records. [2025-09-17T22:48:36.071429] [DEBUG] [LOCAL ] BNED: Derivative data saved (1794 records). [2025-09-17T22:48:36.071676] [INFO ] [MAIN ] BNED: Successfully saved derivative data. [2025-09-17T22:48:36.215872] [INFO ] [MAIN ] Derivative Progress: 267/2085 symbols completed. BNED took 1.4s. Estimated remaining: 11m 48s. Rate: 154.1 symbols/min [2025-09-17T22:48:36.241834] [INFO ] [MAIN ] BNL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:36.557829] [DEBUG] [LOCAL ] BNL: Loaded 46963 existing records from primary storage. [2025-09-17T22:48:36.558666] [INFO ] [MAIN ] BNL: Loaded 46963 primary data records. [2025-09-17T22:48:36.564449] [DEBUG] [MAIN ] BNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:36.565607] [INFO ] [MAIN ] BNH: Generated 1794 derivative records from 4836 primary records. [2025-09-17T22:48:36.592906] [DEBUG] [LOCAL ] BNH: Saving derivative data. [2025-09-17T22:48:36.683861] [DEBUG] [LOCAL ] BNH: Derivative data saved (1794 records). [2025-09-17T22:48:36.722049] [DEBUG] [MAIN ] BNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:36.716608] [INFO ] [MAIN ] BNH: Successfully saved derivative data. [2025-09-17T22:48:36.735614] [INFO ] [MAIN ] BNJ: Generated 1794 derivative records from 2629 primary records. [2025-09-17T22:48:36.744275] [DEBUG] [LOCAL ] BNJ: Saving derivative data. [2025-09-17T22:48:36.753954] [INFO ] [MAIN ] Derivative Progress: 268/2085 symbols completed. BNH took 0.9s. Estimated remaining: 11m 49s. Rate: 153.8 symbols/min [2025-09-17T22:48:36.949457] [DEBUG] [LOCAL ] BNJ: Derivative data saved (1794 records). [2025-09-17T22:48:36.949596] [INFO ] [MAIN ] BNJ: Successfully saved derivative data. [2025-09-17T22:48:36.951857] [INFO ] [MAIN ] Derivative Progress: 269/2085 symbols completed. BNJ took 1.0s. Estimated remaining: 11m 47s. Rate: 154.1 symbols/min [2025-09-17T22:48:36.973338] [DEBUG] [MAIN ] BNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:36.973967] [INFO ] [MAIN ] BNL: Generated 1794 derivative records from 46963 primary records. [2025-09-17T22:48:36.974030] [DEBUG] [LOCAL ] BNL: Saving derivative data. [2025-09-17T22:48:36.989443] [DEBUG] [LOCAL ] BNL: Derivative data saved (1794 records). [2025-09-17T22:48:36.989505] [INFO ] [MAIN ] BNL: Successfully saved derivative data. [2025-09-17T22:48:36.991744] [INFO ] [MAIN ] Derivative Progress: 270/2085 symbols completed. BNL took 0.8s. Estimated remaining: 11m 44s. Rate: 154.6 symbols/min [2025-09-17T22:48:36.992413] [INFO ] [MAIN ] BNY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:36.992288] [INFO ] [MAIN ] BNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:36.992465] [INFO ] [MAIN ] BNS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:37.004332] [DEBUG] [LOCAL ] BNY: Loaded 7432 existing records from primary storage. [2025-09-17T22:48:37.004087] [DEBUG] [LOCAL ] BNT: Loaded 3356 existing records from primary storage. [2025-09-17T22:48:37.004671] [INFO ] [MAIN ] BNY: Loaded 7432 primary data records. [2025-09-17T22:48:37.004614] [INFO ] [MAIN ] BNT: Loaded 3356 primary data records. [2025-09-17T22:48:37.643439] [DEBUG] [LOCAL ] BNS: Loaded 51515 existing records from primary storage. [2025-09-17T22:48:37.644849] [INFO ] [MAIN ] BNS: Loaded 51515 primary data records. [2025-09-17T22:48:37.984145] [DEBUG] [MAIN ] BNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:37.985436] [INFO ] [MAIN ] BNY: Generated 1794 derivative records from 7432 primary records. [2025-09-17T22:48:37.985838] [DEBUG] [LOCAL ] BNY: Saving derivative data. [2025-09-17T22:48:37.984610] [DEBUG] [MAIN ] BNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:37.988153] [INFO ] [MAIN ] BNT: Generated 1794 derivative records from 3356 primary records. [2025-09-17T22:48:37.998699] [DEBUG] [LOCAL ] BNT: Saving derivative data. [2025-09-17T22:48:38.003031] [DEBUG] [LOCAL ] BNY: Derivative data saved (1794 records). [2025-09-17T22:48:38.003523] [INFO ] [MAIN ] BNY: Successfully saved derivative data. [2025-09-17T22:48:38.011986] [INFO ] [MAIN ] Derivative Progress: 271/2085 symbols completed. BNY took 1.0s. Estimated remaining: 11m 48s. Rate: 153.7 symbols/min [2025-09-17T22:48:38.016760] [INFO ] [MAIN ] BOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:38.021024] [DEBUG] [LOCAL ] BNT: Derivative data saved (1794 records). [2025-09-17T22:48:38.021176] [INFO ] [MAIN ] BNT: Successfully saved derivative data. [2025-09-17T22:48:38.023393] [INFO ] [MAIN ] Derivative Progress: 272/2085 symbols completed. BNT took 1.0s. Estimated remaining: 11m 45s. Rate: 154.3 symbols/min [2025-09-17T22:48:38.024662] [INFO ] [MAIN ] BOE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:38.039819] [DEBUG] [MAIN ] BNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:38.040509] [INFO ] [MAIN ] BNS: Generated 1794 derivative records from 51515 primary records. [2025-09-17T22:48:38.040705] [DEBUG] [LOCAL ] BNS: Saving derivative data. [2025-09-17T22:48:38.066764] [DEBUG] [LOCAL ] BOC: Loaded 18429 existing records from primary storage. [2025-09-17T22:48:38.067760] [INFO ] [MAIN ] BOC: Loaded 18429 primary data records. [2025-09-17T22:48:38.154366] [DEBUG] [LOCAL ] BOE: Loaded 17634 existing records from primary storage. [2025-09-17T22:48:38.148873] [DEBUG] [LOCAL ] BNS: Derivative data saved (1794 records). [2025-09-17T22:48:38.173309] [INFO ] [MAIN ] BOE: Loaded 17634 primary data records. [2025-09-17T22:48:38.173366] [INFO ] [MAIN ] BNS: Successfully saved derivative data. [2025-09-17T22:48:38.195295] [INFO ] [MAIN ] Derivative Progress: 273/2085 symbols completed. BNS took 1.2s. Estimated remaining: 11m 43s. Rate: 154.6 symbols/min [2025-09-17T22:48:38.244616] [INFO ] [MAIN ] BOH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:38.758869] [DEBUG] [LOCAL ] BOH: Loaded 31444 existing records from primary storage. [2025-09-17T22:48:38.759537] [INFO ] [MAIN ] BOH: Loaded 31444 primary data records. [2025-09-17T22:48:39.070912] [DEBUG] [MAIN ] BOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:39.085628] [INFO ] [MAIN ] BOC: Generated 1794 derivative records from 18429 primary records. [2025-09-17T22:48:39.085825] [DEBUG] [LOCAL ] BOC: Saving derivative data. [2025-09-17T22:48:39.119787] [DEBUG] [LOCAL ] BOC: Derivative data saved (1794 records). [2025-09-17T22:48:39.120110] [DEBUG] [MAIN ] BOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:39.121407] [INFO ] [MAIN ] BOE: Generated 1794 derivative records from 17634 primary records. [2025-09-17T22:48:39.121477] [INFO ] [MAIN ] BOC: Successfully saved derivative data. [2025-09-17T22:48:39.124091] [INFO ] [MAIN ] Derivative Progress: 274/2085 symbols completed. BOC took 1.1s. Estimated remaining: 11m 47s. Rate: 153.8 symbols/min [2025-09-17T22:48:39.124232] [DEBUG] [LOCAL ] BOE: Saving derivative data. [2025-09-17T22:48:39.125451] [INFO ] [MAIN ] BOND: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:39.145148] [DEBUG] [LOCAL ] BOE: Derivative data saved (1794 records). [2025-09-17T22:48:39.145328] [INFO ] [MAIN ] BOE: Successfully saved derivative data. [2025-09-17T22:48:39.148125] [INFO ] [MAIN ] Derivative Progress: 275/2085 symbols completed. BOE took 1.1s. Estimated remaining: 11m 44s. Rate: 154.3 symbols/min [2025-09-17T22:48:39.148873] [INFO ] [MAIN ] BOOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:39.166323] [DEBUG] [MAIN ] BOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:39.167070] [INFO ] [MAIN ] BOH: Generated 1794 derivative records from 31444 primary records. [2025-09-17T22:48:39.167255] [DEBUG] [LOCAL ] BOH: Saving derivative data. [2025-09-17T22:48:39.201292] [DEBUG] [LOCAL ] BOH: Derivative data saved (1794 records). [2025-09-17T22:48:39.201444] [INFO ] [MAIN ] BOH: Successfully saved derivative data. [2025-09-17T22:48:39.203072] [DEBUG] [LOCAL ] BOND: Loaded 32173 existing records from primary storage. [2025-09-17T22:48:39.205783] [INFO ] [MAIN ] Derivative Progress: 276/2085 symbols completed. BOH took 1.0s. Estimated remaining: 11m 41s. Rate: 154.8 symbols/min [2025-09-17T22:48:39.214715] [INFO ] [MAIN ] BORR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:39.214422] [INFO ] [MAIN ] BOND: Loaded 32173 primary data records. [2025-09-17T22:48:39.334492] [DEBUG] [LOCAL ] BOOT: Loaded 41430 existing records from primary storage. [2025-09-17T22:48:39.345617] [INFO ] [MAIN ] BOOT: Loaded 41430 primary data records. [2025-09-17T22:48:39.718678] [DEBUG] [LOCAL ] BORR: Loaded 51196 existing records from primary storage. [2025-09-17T22:48:39.724010] [INFO ] [MAIN ] BORR: Loaded 51196 primary data records. [2025-09-17T22:48:40.202030] [DEBUG] [MAIN ] BOND: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:48:40.204228] [INFO ] [MAIN ] BOND: Generated 1793 derivative records from 32173 primary records. [2025-09-17T22:48:40.204457] [DEBUG] [LOCAL ] BOND: Saving derivative data. [2025-09-17T22:48:40.238470] [DEBUG] [MAIN ] BOOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:40.237937] [DEBUG] [LOCAL ] BOND: Derivative data saved (1793 records). [2025-09-17T22:48:40.239158] [INFO ] [MAIN ] BOND: Successfully saved derivative data. [2025-09-17T22:48:40.242058] [INFO ] [MAIN ] Derivative Progress: 277/2085 symbols completed. BOND took 1.1s. Estimated remaining: 11m 45s. Rate: 153.9 symbols/min [2025-09-17T22:48:40.242993] [INFO ] [MAIN ] BOOT: Generated 1794 derivative records from 41430 primary records. [2025-09-17T22:48:40.243293] [INFO ] [MAIN ] BOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:40.243848] [DEBUG] [LOCAL ] BOOT: Saving derivative data. [2025-09-17T22:48:40.261119] [DEBUG] [LOCAL ] BOOT: Derivative data saved (1794 records). [2025-09-17T22:48:40.262849] [INFO ] [MAIN ] BOOT: Successfully saved derivative data. [2025-09-17T22:48:40.265896] [INFO ] [MAIN ] Derivative Progress: 278/2085 symbols completed. BOOT took 1.1s. Estimated remaining: 11m 42s. Rate: 154.4 symbols/min [2025-09-17T22:48:40.266333] [INFO ] [MAIN ] BOX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:40.285786] [DEBUG] [MAIN ] BORR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:40.286508] [INFO ] [MAIN ] BORR: Generated 1794 derivative records from 51196 primary records. [2025-09-17T22:48:40.286707] [DEBUG] [LOCAL ] BORR: Saving derivative data. [2025-09-17T22:48:40.308492] [DEBUG] [LOCAL ] BOW: Loaded 23746 existing records from primary storage. [2025-09-17T22:48:40.310835] [INFO ] [MAIN ] BOW: Loaded 23746 primary data records. [2025-09-17T22:48:40.310935] [DEBUG] [LOCAL ] BORR: Derivative data saved (1794 records). [2025-09-17T22:48:40.332472] [INFO ] [MAIN ] BORR: Successfully saved derivative data. [2025-09-17T22:48:40.350494] [INFO ] [MAIN ] Derivative Progress: 279/2085 symbols completed. BORR took 1.1s. Estimated remaining: 11m 40s. Rate: 154.8 symbols/min [2025-09-17T22:48:40.382420] [INFO ] [MAIN ] BR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:40.661258] [DEBUG] [LOCAL ] BOX: Loaded 50373 existing records from primary storage. [2025-09-17T22:48:40.674893] [INFO ] [MAIN ] BOX: Loaded 50373 primary data records. [2025-09-17T22:48:40.804366] [DEBUG] [LOCAL ] BR: Loaded 34774 existing records from primary storage. [2025-09-17T22:48:40.804585] [INFO ] [MAIN ] BR: Loaded 34774 primary data records. [2025-09-17T22:48:41.330150] [DEBUG] [MAIN ] BOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:41.331214] [INFO ] [MAIN ] BOW: Generated 1794 derivative records from 23746 primary records. [2025-09-17T22:48:41.331321] [DEBUG] [LOCAL ] BOW: Saving derivative data. [2025-09-17T22:48:41.354519] [DEBUG] [LOCAL ] BOW: Derivative data saved (1794 records). [2025-09-17T22:48:41.355934] [INFO ] [MAIN ] BOW: Successfully saved derivative data. [2025-09-17T22:48:41.359358] [INFO ] [MAIN ] Derivative Progress: 280/2085 symbols completed. BOW took 1.1s. Estimated remaining: 11m 44s. Rate: 153.9 symbols/min [2025-09-17T22:48:41.360534] [INFO ] [MAIN ] BRBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:41.374528] [DEBUG] [MAIN ] BOX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:41.375266] [INFO ] [MAIN ] BOX: Generated 1794 derivative records from 50373 primary records. [2025-09-17T22:48:41.375447] [DEBUG] [LOCAL ] BOX: Saving derivative data. [2025-09-17T22:48:41.403501] [DEBUG] [LOCAL ] BOX: Derivative data saved (1794 records). [2025-09-17T22:48:41.403938] [INFO ] [MAIN ] BOX: Successfully saved derivative data. [2025-09-17T22:48:41.406613] [INFO ] [MAIN ] Derivative Progress: 281/2085 symbols completed. BOX took 1.1s. Estimated remaining: 11m 41s. Rate: 154.4 symbols/min [2025-09-17T22:48:41.414622] [INFO ] [MAIN ] BRCC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:41.420487] [DEBUG] [MAIN ] BR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:41.421467] [INFO ] [MAIN ] BR: Generated 1794 derivative records from 34774 primary records. [2025-09-17T22:48:41.421698] [DEBUG] [LOCAL ] BR: Saving derivative data. [2025-09-17T22:48:41.460513] [DEBUG] [LOCAL ] BR: Derivative data saved (1794 records). [2025-09-17T22:48:41.460885] [INFO ] [MAIN ] BR: Successfully saved derivative data. [2025-09-17T22:48:41.464427] [INFO ] [MAIN ] Derivative Progress: 282/2085 symbols completed. BR took 1.1s. Estimated remaining: 11m 38s. Rate: 154.9 symbols/min [2025-09-17T22:48:41.464973] [INFO ] [MAIN ] BRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:41.491050] [DEBUG] [LOCAL ] BRBR: Loaded 51205 existing records from primary storage. [2025-09-17T22:48:41.491396] [INFO ] [MAIN ] BRBR: Loaded 51205 primary data records. [2025-09-17T22:48:41.610715] [DEBUG] [LOCAL ] BRCC: Loaded 40428 existing records from primary storage. [2025-09-17T22:48:41.633117] [INFO ] [MAIN ] BRCC: Loaded 40428 primary data records. [2025-09-17T22:48:42.032213] [DEBUG] [LOCAL ] BRO: Loaded 51917 existing records from primary storage. [2025-09-17T22:48:42.063445] [INFO ] [MAIN ] BRO: Loaded 51917 primary data records. [2025-09-17T22:48:42.556336] [DEBUG] [MAIN ] BRCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:42.555942] [DEBUG] [MAIN ] BRBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:42.557166] [INFO ] [MAIN ] BRCC: Generated 1794 derivative records from 40428 primary records. [2025-09-17T22:48:42.558145] [INFO ] [MAIN ] BRBR: Generated 1794 derivative records from 51205 primary records. [2025-09-17T22:48:42.558690] [DEBUG] [LOCAL ] BRBR: Saving derivative data. [2025-09-17T22:48:42.559720] [DEBUG] [LOCAL ] BRCC: Saving derivative data. [2025-09-17T22:48:42.587716] [DEBUG] [LOCAL ] BRBR: Derivative data saved (1794 records). [2025-09-17T22:48:42.589027] [INFO ] [MAIN ] BRBR: Successfully saved derivative data. [2025-09-17T22:48:42.592948] [INFO ] [MAIN ] Derivative Progress: 283/2085 symbols completed. BRBR took 1.2s. Estimated remaining: 11m 43s. Rate: 153.8 symbols/min [2025-09-17T22:48:42.597269] [DEBUG] [LOCAL ] BRCC: Derivative data saved (1794 records). [2025-09-17T22:48:42.597424] [INFO ] [MAIN ] BRCC: Successfully saved derivative data. [2025-09-17T22:48:42.599991] [INFO ] [MAIN ] Derivative Progress: 284/2085 symbols completed. BRCC took 1.2s. Estimated remaining: 11m 40s. Rate: 154.4 symbols/min [2025-09-17T22:48:42.616421] [DEBUG] [MAIN ] BRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:42.617074] [INFO ] [MAIN ] BRO: Generated 1794 derivative records from 51917 primary records. [2025-09-17T22:48:42.617137] [DEBUG] [LOCAL ] BRO: Saving derivative data. [2025-09-17T22:48:42.632491] [DEBUG] [LOCAL ] BRO: Derivative data saved (1794 records). [2025-09-17T22:48:42.632552] [INFO ] [MAIN ] BRO: Successfully saved derivative data. [2025-09-17T22:48:42.635240] [INFO ] [MAIN ] Derivative Progress: 285/2085 symbols completed. BRO took 1.2s. Estimated remaining: 11m 37s. Rate: 154.9 symbols/min [2025-09-17T22:48:42.635864] [INFO ] [MAIN ] BROS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:42.636094] [INFO ] [MAIN ] BRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:42.635916] [INFO ] [MAIN ] BRSP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:42.645335] [DEBUG] [LOCAL ] BRT: Loaded 4809 existing records from primary storage. [2025-09-17T22:48:42.645503] [INFO ] [MAIN ] BRT: Loaded 4809 primary data records. [2025-09-17T22:48:43.014704] [DEBUG] [LOCAL ] BRSP: Loaded 36975 existing records from primary storage. [2025-09-17T22:48:43.014988] [INFO ] [MAIN ] BRSP: Loaded 36975 primary data records. [2025-09-17T22:48:43.136915] [DEBUG] [LOCAL ] BROS: Loaded 53282 existing records from primary storage. [2025-09-17T22:48:43.140576] [INFO ] [MAIN ] BROS: Loaded 53282 primary data records. [2025-09-17T22:48:43.667026] [DEBUG] [MAIN ] BRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:43.667815] [INFO ] [MAIN ] BRT: Generated 1794 derivative records from 4809 primary records. [2025-09-17T22:48:43.667981] [DEBUG] [LOCAL ] BRT: Saving derivative data. [2025-09-17T22:48:43.686397] [DEBUG] [LOCAL ] BRT: Derivative data saved (1794 records). [2025-09-17T22:48:43.687536] [INFO ] [MAIN ] BRT: Successfully saved derivative data. [2025-09-17T22:48:43.691571] [INFO ] [MAIN ] Derivative Progress: 286/2085 symbols completed. BRT took 1.1s. Estimated remaining: 11m 41s. Rate: 153.9 symbols/min [2025-09-17T22:48:43.692153] [INFO ] [MAIN ] BRW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:43.706675] [DEBUG] [MAIN ] BRSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:43.707610] [INFO ] [MAIN ] BRSP: Generated 1794 derivative records from 36975 primary records. [2025-09-17T22:48:43.707917] [DEBUG] [LOCAL ] BRSP: Saving derivative data. [2025-09-17T22:48:43.723628] [DEBUG] [LOCAL ] BRSP: Derivative data saved (1794 records). [2025-09-17T22:48:43.723953] [INFO ] [MAIN ] BRSP: Successfully saved derivative data. [2025-09-17T22:48:43.726034] [INFO ] [MAIN ] Derivative Progress: 287/2085 symbols completed. BRSP took 1.1s. Estimated remaining: 11m 39s. Rate: 154.4 symbols/min [2025-09-17T22:48:43.730899] [INFO ] [MAIN ] BSAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:43.743184] [DEBUG] [LOCAL ] BRW: Loaded 19085 existing records from primary storage. [2025-09-17T22:48:43.756018] [INFO ] [MAIN ] BRW: Loaded 19085 primary data records. [2025-09-17T22:48:43.756925] [DEBUG] [MAIN ] BROS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:43.800900] [INFO ] [MAIN ] BROS: Generated 1794 derivative records from 53282 primary records. [2025-09-17T22:48:43.847813] [DEBUG] [LOCAL ] BROS: Saving derivative data. [2025-09-17T22:48:44.093841] [DEBUG] [LOCAL ] BSAC: Loaded 33099 existing records from primary storage. [2025-09-17T22:48:44.095038] [INFO ] [MAIN ] BSAC: Loaded 33099 primary data records. [2025-09-17T22:48:44.182892] [DEBUG] [LOCAL ] BROS: Derivative data saved (1794 records). [2025-09-17T22:48:44.194824] [INFO ] [MAIN ] BROS: Successfully saved derivative data. [2025-09-17T22:48:44.208893] [INFO ] [MAIN ] Derivative Progress: 288/2085 symbols completed. BROS took 1.6s. Estimated remaining: 11m 39s. Rate: 154.3 symbols/min [2025-09-17T22:48:44.210060] [INFO ] [MAIN ] BSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:44.404677] [DEBUG] [LOCAL ] BSL: Loaded 7950 existing records from primary storage. [2025-09-17T22:48:44.413828] [INFO ] [MAIN ] BSL: Loaded 7950 primary data records. [2025-09-17T22:48:44.818971] [DEBUG] [MAIN ] BRW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:44.819960] [INFO ] [MAIN ] BRW: Generated 1794 derivative records from 19085 primary records. [2025-09-17T22:48:44.820176] [DEBUG] [LOCAL ] BRW: Saving derivative data. [2025-09-17T22:48:44.854543] [DEBUG] [MAIN ] BSAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:44.856066] [INFO ] [MAIN ] BSAC: Generated 1794 derivative records from 33099 primary records. [2025-09-17T22:48:44.856159] [DEBUG] [LOCAL ] BSAC: Saving derivative data. [2025-09-17T22:48:44.858933] [DEBUG] [LOCAL ] BRW: Derivative data saved (1794 records). [2025-09-17T22:48:44.872523] [INFO ] [MAIN ] BRW: Successfully saved derivative data. [2025-09-17T22:48:44.874882] [INFO ] [MAIN ] Derivative Progress: 289/2085 symbols completed. BRW took 1.2s. Estimated remaining: 11m 40s. Rate: 153.9 symbols/min [2025-09-17T22:48:44.877467] [DEBUG] [LOCAL ] BSAC: Derivative data saved (1794 records). [2025-09-17T22:48:44.875872] [INFO ] [MAIN ] BSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:44.877858] [INFO ] [MAIN ] BSAC: Successfully saved derivative data. [2025-09-17T22:48:44.880355] [INFO ] [MAIN ] Derivative Progress: 290/2085 symbols completed. BSAC took 1.1s. Estimated remaining: 11m 37s. Rate: 154.5 symbols/min [2025-09-17T22:48:44.880587] [INFO ] [MAIN ] BST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:44.899908] [DEBUG] [MAIN ] BSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:44.900744] [INFO ] [MAIN ] BSL: Generated 1794 derivative records from 7950 primary records. [2025-09-17T22:48:44.900908] [DEBUG] [LOCAL ] BSL: Saving derivative data. [2025-09-17T22:48:44.941130] [DEBUG] [LOCAL ] BSL: Derivative data saved (1794 records). [2025-09-17T22:48:44.940449] [DEBUG] [LOCAL ] BST: Loaded 19479 existing records from primary storage. [2025-09-17T22:48:44.941382] [INFO ] [MAIN ] BSL: Successfully saved derivative data. [2025-09-17T22:48:44.941516] [INFO ] [MAIN ] BST: Loaded 19479 primary data records. [2025-09-17T22:48:44.944529] [INFO ] [MAIN ] Derivative Progress: 291/2085 symbols completed. BSL took 0.7s. Estimated remaining: 11m 35s. Rate: 154.9 symbols/min [2025-09-17T22:48:44.965990] [INFO ] [MAIN ] BSTZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:45.056455] [DEBUG] [LOCAL ] BSM: Loaded 32599 existing records from primary storage. [2025-09-17T22:48:45.060144] [INFO ] [MAIN ] BSM: Loaded 32599 primary data records. [2025-09-17T22:48:45.470781] [DEBUG] [LOCAL ] BSTZ: Loaded 25095 existing records from primary storage. [2025-09-17T22:48:45.514831] [INFO ] [MAIN ] BSTZ: Loaded 25095 primary data records. [2025-09-17T22:48:45.931065] [DEBUG] [MAIN ] BSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:45.944481] [INFO ] [MAIN ] BSM: Generated 1794 derivative records from 32599 primary records. [2025-09-17T22:48:45.945425] [DEBUG] [LOCAL ] BSM: Saving derivative data. [2025-09-17T22:48:45.945351] [DEBUG] [MAIN ] BST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:45.948295] [INFO ] [MAIN ] BST: Generated 1794 derivative records from 19479 primary records. [2025-09-17T22:48:45.959668] [DEBUG] [LOCAL ] BST: Saving derivative data. [2025-09-17T22:48:45.982094] [DEBUG] [LOCAL ] BST: Derivative data saved (1794 records). [2025-09-17T22:48:45.983361] [DEBUG] [LOCAL ] BSM: Derivative data saved (1794 records). [2025-09-17T22:48:45.983750] [INFO ] [MAIN ] BSM: Successfully saved derivative data. [2025-09-17T22:48:45.983579] [INFO ] [MAIN ] BST: Successfully saved derivative data. [2025-09-17T22:48:45.987225] [INFO ] [MAIN ] Derivative Progress: 292/2085 symbols completed. BSM took 1.1s. Estimated remaining: 11m 39s. Rate: 154.0 symbols/min [2025-09-17T22:48:45.992574] [INFO ] [MAIN ] Derivative Progress: 293/2085 symbols completed. BST took 1.1s. Estimated remaining: 11m 36s. Rate: 154.5 symbols/min [2025-09-17T22:48:45.992502] [INFO ] [MAIN ] BSX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:45.993751] [INFO ] [MAIN ] BTA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:46.007858] [DEBUG] [MAIN ] BSTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:46.008737] [INFO ] [MAIN ] BSTZ: Generated 1794 derivative records from 25095 primary records. [2025-09-17T22:48:46.008861] [DEBUG] [LOCAL ] BSTZ: Saving derivative data. [2025-09-17T22:48:46.026759] [DEBUG] [LOCAL ] BTA: Loaded 5311 existing records from primary storage. [2025-09-17T22:48:46.029325] [INFO ] [MAIN ] BTA: Loaded 5311 primary data records. [2025-09-17T22:48:46.030469] [DEBUG] [LOCAL ] BSTZ: Derivative data saved (1794 records). [2025-09-17T22:48:46.063528] [INFO ] [MAIN ] BSTZ: Successfully saved derivative data. [2025-09-17T22:48:46.083844] [INFO ] [MAIN ] Derivative Progress: 294/2085 symbols completed. BSTZ took 1.1s. Estimated remaining: 11m 34s. Rate: 154.9 symbols/min [2025-09-17T22:48:46.101272] [INFO ] [MAIN ] BTCM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:46.240844] [DEBUG] [LOCAL ] BTCM: Loaded 14125 existing records from primary storage. [2025-09-17T22:48:46.261413] [INFO ] [MAIN ] BTCM: Loaded 14125 primary data records. [2025-09-17T22:48:46.390974] [DEBUG] [LOCAL ] BSX: Loaded 53688 existing records from primary storage. [2025-09-17T22:48:46.416349] [INFO ] [MAIN ] BSX: Loaded 53688 primary data records. [2025-09-17T22:48:47.052306] [DEBUG] [MAIN ] BTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:47.054006] [INFO ] [MAIN ] BTA: Generated 1794 derivative records from 5311 primary records. [2025-09-17T22:48:47.054480] [DEBUG] [LOCAL ] BTA: Saving derivative data. [2025-09-17T22:48:47.071819] [DEBUG] [LOCAL ] BTA: Derivative data saved (1794 records). [2025-09-17T22:48:47.072389] [INFO ] [MAIN ] BTA: Successfully saved derivative data. [2025-09-17T22:48:47.075067] [INFO ] [MAIN ] Derivative Progress: 295/2085 symbols completed. BTA took 1.1s. Estimated remaining: 11m 37s. Rate: 154.1 symbols/min [2025-09-17T22:48:47.076016] [INFO ] [MAIN ] BTE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:47.109211] [DEBUG] [MAIN ] BTCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:47.109449] [DEBUG] [MAIN ] BSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:47.110407] [INFO ] [MAIN ] BTCM: Generated 1794 derivative records from 14125 primary records. [2025-09-17T22:48:47.111278] [INFO ] [MAIN ] BSX: Generated 1794 derivative records from 53688 primary records. [2025-09-17T22:48:47.111469] [DEBUG] [LOCAL ] BSX: Saving derivative data. [2025-09-17T22:48:47.111539] [DEBUG] [LOCAL ] BTCM: Saving derivative data. [2025-09-17T22:48:47.140876] [DEBUG] [LOCAL ] BTCM: Derivative data saved (1794 records). [2025-09-17T22:48:47.141835] [INFO ] [MAIN ] BTCM: Successfully saved derivative data. [2025-09-17T22:48:47.144751] [INFO ] [MAIN ] Derivative Progress: 296/2085 symbols completed. BTCM took 1.0s. Estimated remaining: 11m 35s. Rate: 154.5 symbols/min [2025-09-17T22:48:47.148191] [INFO ] [MAIN ] BTI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:47.148300] [DEBUG] [LOCAL ] BSX: Derivative data saved (1794 records). [2025-09-17T22:48:47.148416] [INFO ] [MAIN ] BSX: Successfully saved derivative data. [2025-09-17T22:48:47.150995] [INFO ] [MAIN ] Derivative Progress: 297/2085 symbols completed. BSX took 1.2s. Estimated remaining: 11m 32s. Rate: 155.1 symbols/min [2025-09-17T22:48:47.151601] [INFO ] [MAIN ] BTO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:47.176026] [DEBUG] [LOCAL ] BTO: Loaded 9038 existing records from primary storage. [2025-09-17T22:48:47.176238] [INFO ] [MAIN ] BTO: Loaded 9038 primary data records. [2025-09-17T22:48:47.302139] [DEBUG] [LOCAL ] BTE: Loaded 52762 existing records from primary storage. [2025-09-17T22:48:47.308114] [INFO ] [MAIN ] BTE: Loaded 52762 primary data records. [2025-09-17T22:48:47.661059] [DEBUG] [LOCAL ] BTI: Loaded 53553 existing records from primary storage. [2025-09-17T22:48:47.708413] [INFO ] [MAIN ] BTI: Loaded 53553 primary data records. [2025-09-17T22:48:48.209177] [DEBUG] [MAIN ] BTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:48.223350] [INFO ] [MAIN ] BTO: Generated 1794 derivative records from 9038 primary records. [2025-09-17T22:48:48.223956] [DEBUG] [LOCAL ] BTO: Saving derivative data. [2025-09-17T22:48:48.224393] [DEBUG] [MAIN ] BTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:48.226458] [INFO ] [MAIN ] BTE: Generated 1794 derivative records from 52762 primary records. [2025-09-17T22:48:48.235064] [DEBUG] [LOCAL ] BTE: Saving derivative data. [2025-09-17T22:48:48.254467] [DEBUG] [LOCAL ] BTO: Derivative data saved (1794 records). [2025-09-17T22:48:48.254629] [INFO ] [MAIN ] BTO: Successfully saved derivative data. [2025-09-17T22:48:48.257571] [INFO ] [MAIN ] Derivative Progress: 298/2085 symbols completed. BTO took 1.1s. Estimated remaining: 11m 36s. Rate: 154.1 symbols/min [2025-09-17T22:48:48.264828] [DEBUG] [LOCAL ] BTE: Derivative data saved (1794 records). [2025-09-17T22:48:48.265507] [INFO ] [MAIN ] BTE: Successfully saved derivative data. [2025-09-17T22:48:48.268130] [INFO ] [MAIN ] Derivative Progress: 299/2085 symbols completed. BTE took 1.2s. Estimated remaining: 11m 33s. Rate: 154.6 symbols/min [2025-09-17T22:48:48.280756] [DEBUG] [MAIN ] BTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:48.281341] [INFO ] [MAIN ] BTI: Generated 1794 derivative records from 53553 primary records. [2025-09-17T22:48:48.281400] [DEBUG] [LOCAL ] BTI: Saving derivative data. [2025-09-17T22:48:48.296776] [DEBUG] [LOCAL ] BTI: Derivative data saved (1794 records). [2025-09-17T22:48:48.296837] [INFO ] [MAIN ] BTI: Successfully saved derivative data. [2025-09-17T22:48:48.299560] [INFO ] [MAIN ] Derivative Progress: 300/2085 symbols completed. BTI took 1.2s. Estimated remaining: 11m 31s. Rate: 155.1 symbols/min [2025-09-17T22:48:48.300188] [INFO ] [MAIN ] BTT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:48.300432] [INFO ] [MAIN ] BTZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:48.300509] [INFO ] [MAIN ] BTU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:48.324079] [DEBUG] [LOCAL ] BTT: Loaded 16123 existing records from primary storage. [2025-09-17T22:48:48.324275] [INFO ] [MAIN ] BTT: Loaded 16123 primary data records. [2025-09-17T22:48:48.383218] [DEBUG] [LOCAL ] BTZ: Loaded 23132 existing records from primary storage. [2025-09-17T22:48:48.406187] [INFO ] [MAIN ] BTZ: Loaded 23132 primary data records. [2025-09-17T22:48:48.820790] [DEBUG] [LOCAL ] BTU: Loaded 53302 existing records from primary storage. [2025-09-17T22:48:48.837375] [INFO ] [MAIN ] BTU: Loaded 53302 primary data records. [2025-09-17T22:48:49.399072] [DEBUG] [MAIN ] BTT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:49.400731] [INFO ] [MAIN ] BTT: Generated 1794 derivative records from 16123 primary records. [2025-09-17T22:48:49.401677] [DEBUG] [LOCAL ] BTT: Saving derivative data. [2025-09-17T22:48:49.432817] [DEBUG] [MAIN ] BTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:49.435763] [INFO ] [MAIN ] BTZ: Generated 1794 derivative records from 23132 primary records. [2025-09-17T22:48:49.436564] [DEBUG] [LOCAL ] BTZ: Saving derivative data. [2025-09-17T22:48:49.438114] [DEBUG] [LOCAL ] BTT: Derivative data saved (1794 records). [2025-09-17T22:48:49.447115] [INFO ] [MAIN ] BTT: Successfully saved derivative data. [2025-09-17T22:48:49.453112] [INFO ] [MAIN ] Derivative Progress: 301/2085 symbols completed. BTT took 1.2s. Estimated remaining: 11m 35s. Rate: 154.1 symbols/min [2025-09-17T22:48:49.458122] [DEBUG] [LOCAL ] BTZ: Derivative data saved (1794 records). [2025-09-17T22:48:49.458362] [INFO ] [MAIN ] BTZ: Successfully saved derivative data. [2025-09-17T22:48:49.455825] [INFO ] [MAIN ] BUD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:49.460688] [INFO ] [MAIN ] Derivative Progress: 302/2085 symbols completed. BTZ took 1.2s. Estimated remaining: 11m 32s. Rate: 154.6 symbols/min [2025-09-17T22:48:49.461372] [INFO ] [MAIN ] BUI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:49.483242] [DEBUG] [MAIN ] BTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:49.484134] [INFO ] [MAIN ] BTU: Generated 1794 derivative records from 53302 primary records. [2025-09-17T22:48:49.488833] [DEBUG] [LOCAL ] BTU: Saving derivative data. [2025-09-17T22:48:49.489213] [DEBUG] [LOCAL ] BUI: Loaded 11484 existing records from primary storage. [2025-09-17T22:48:49.490181] [INFO ] [MAIN ] BUI: Loaded 11484 primary data records. [2025-09-17T22:48:49.668743] [DEBUG] [LOCAL ] BTU: Derivative data saved (1794 records). [2025-09-17T22:48:49.704503] [INFO ] [MAIN ] BTU: Successfully saved derivative data. [2025-09-17T22:48:49.824593] [INFO ] [MAIN ] Derivative Progress: 303/2085 symbols completed. BTU took 1.5s. Estimated remaining: 11m 32s. Rate: 154.6 symbols/min [2025-09-17T22:48:49.838976] [INFO ] [MAIN ] BUR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:49.840622] [DEBUG] [LOCAL ] BUD: Loaded 52766 existing records from primary storage. [2025-09-17T22:48:49.841046] [INFO ] [MAIN ] BUD: Loaded 52766 primary data records. [2025-09-17T22:48:50.176980] [DEBUG] [LOCAL ] BUR: Loaded 45131 existing records from primary storage. [2025-09-17T22:48:50.177928] [INFO ] [MAIN ] BUR: Loaded 45131 primary data records. [2025-09-17T22:48:50.305000] [DEBUG] [MAIN ] BUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:50.327703] [INFO ] [MAIN ] BUI: Generated 1794 derivative records from 11484 primary records. [2025-09-17T22:48:50.356554] [DEBUG] [LOCAL ] BUI: Saving derivative data. [2025-09-17T22:48:50.523200] [DEBUG] [LOCAL ] BUI: Derivative data saved (1794 records). [2025-09-17T22:48:50.523660] [INFO ] [MAIN ] BUI: Successfully saved derivative data. [2025-09-17T22:48:50.526358] [INFO ] [MAIN ] Derivative Progress: 304/2085 symbols completed. BUI took 1.1s. Estimated remaining: 11m 33s. Rate: 154.2 symbols/min [2025-09-17T22:48:50.527351] [INFO ] [MAIN ] BURL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:50.541979] [DEBUG] [MAIN ] BUD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:50.543312] [INFO ] [MAIN ] BUD: Generated 1794 derivative records from 52766 primary records. [2025-09-17T22:48:50.543555] [DEBUG] [LOCAL ] BUD: Saving derivative data. [2025-09-17T22:48:50.561116] [DEBUG] [LOCAL ] BUD: Derivative data saved (1794 records). [2025-09-17T22:48:50.561406] [INFO ] [MAIN ] BUD: Successfully saved derivative data. [2025-09-17T22:48:50.564436] [INFO ] [MAIN ] Derivative Progress: 305/2085 symbols completed. BUD took 1.1s. Estimated remaining: 11m 31s. Rate: 154.6 symbols/min [2025-09-17T22:48:50.564763] [INFO ] [MAIN ] BUXX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:50.587097] [DEBUG] [MAIN ] BUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:50.587975] [INFO ] [MAIN ] BUR: Generated 1794 derivative records from 45131 primary records. [2025-09-17T22:48:50.588124] [DEBUG] [LOCAL ] BUR: Saving derivative data. [2025-09-17T22:48:50.616968] [DEBUG] [LOCAL ] BUXX: Loaded 15219 existing records from primary storage. [2025-09-17T22:48:50.619869] [INFO ] [MAIN ] BUXX: Loaded 15219 primary data records. [2025-09-17T22:48:50.620922] [DEBUG] [LOCAL ] BUR: Derivative data saved (1794 records). [2025-09-17T22:48:50.642149] [INFO ] [MAIN ] BUR: Successfully saved derivative data. [2025-09-17T22:48:50.686364] [INFO ] [MAIN ] Derivative Progress: 306/2085 symbols completed. BUR took 0.8s. Estimated remaining: 11m 29s. Rate: 155.0 symbols/min [2025-09-17T22:48:50.716870] [INFO ] [MAIN ] BV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:50.716999] [DEBUG] [LOCAL ] BURL: Loaded 46560 existing records from primary storage. [2025-09-17T22:48:50.742577] [INFO ] [MAIN ] BURL: Loaded 46560 primary data records. [2025-09-17T22:48:51.337522] [DEBUG] [LOCAL ] BV: Loaded 38644 existing records from primary storage. [2025-09-17T22:48:51.338226] [INFO ] [MAIN ] BV: Loaded 38644 primary data records. [2025-09-17T22:48:51.679055] [DEBUG] [MAIN ] BUXX: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:48:51.680369] [INFO ] [MAIN ] BUXX: Generated 1793 derivative records from 15219 primary records. [2025-09-17T22:48:51.680482] [DEBUG] [LOCAL ] BUXX: Saving derivative data. [2025-09-17T22:48:51.707079] [DEBUG] [MAIN ] BURL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:51.710471] [INFO ] [MAIN ] BURL: Generated 1794 derivative records from 46560 primary records. [2025-09-17T22:48:51.712393] [DEBUG] [LOCAL ] BUXX: Derivative data saved (1793 records). [2025-09-17T22:48:51.712446] [DEBUG] [LOCAL ] BURL: Saving derivative data. [2025-09-17T22:48:51.712586] [INFO ] [MAIN ] BUXX: Successfully saved derivative data. [2025-09-17T22:48:51.715466] [INFO ] [MAIN ] Derivative Progress: 307/2085 symbols completed. BUXX took 1.2s. Estimated remaining: 11m 32s. Rate: 154.2 symbols/min [2025-09-17T22:48:51.716193] [INFO ] [MAIN ] BVN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:51.733476] [DEBUG] [LOCAL ] BURL: Derivative data saved (1794 records). [2025-09-17T22:48:51.733810] [INFO ] [MAIN ] BURL: Successfully saved derivative data. [2025-09-17T22:48:51.736592] [INFO ] [MAIN ] Derivative Progress: 308/2085 symbols completed. BURL took 1.2s. Estimated remaining: 11m 30s. Rate: 154.6 symbols/min [2025-09-17T22:48:51.738355] [INFO ] [MAIN ] BW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:51.755297] [DEBUG] [MAIN ] BV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:51.756159] [INFO ] [MAIN ] BV: Generated 1794 derivative records from 38644 primary records. [2025-09-17T22:48:51.756257] [DEBUG] [LOCAL ] BV: Saving derivative data. [2025-09-17T22:48:51.784064] [DEBUG] [LOCAL ] BV: Derivative data saved (1794 records). [2025-09-17T22:48:51.792675] [INFO ] [MAIN ] BV: Successfully saved derivative data. [2025-09-17T22:48:51.795429] [INFO ] [MAIN ] Derivative Progress: 309/2085 symbols completed. BV took 1.1s. Estimated remaining: 11m 27s. Rate: 155.1 symbols/min [2025-09-17T22:48:51.795854] [INFO ] [MAIN ] BWA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:51.812029] [DEBUG] [LOCAL ] BVN: Loaded 43498 existing records from primary storage. [2025-09-17T22:48:51.812207] [INFO ] [MAIN ] BVN: Loaded 43498 primary data records. [2025-09-17T22:48:51.903316] [DEBUG] [LOCAL ] BW: Loaded 39420 existing records from primary storage. [2025-09-17T22:48:51.927834] [INFO ] [MAIN ] BW: Loaded 39420 primary data records. [2025-09-17T22:48:52.327802] [DEBUG] [LOCAL ] BWA: Loaded 52274 existing records from primary storage. [2025-09-17T22:48:52.353294] [INFO ] [MAIN ] BWA: Loaded 52274 primary data records. [2025-09-17T22:48:52.887159] [DEBUG] [MAIN ] BVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:52.889766] [INFO ] [MAIN ] BVN: Generated 1794 derivative records from 43498 primary records. [2025-09-17T22:48:52.891378] [DEBUG] [LOCAL ] BVN: Saving derivative data. [2025-09-17T22:48:52.919712] [DEBUG] [MAIN ] BW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:52.924925] [INFO ] [MAIN ] BW: Generated 1794 derivative records from 39420 primary records. [2025-09-17T22:48:52.925162] [DEBUG] [LOCAL ] BW: Saving derivative data. [2025-09-17T22:48:52.923892] [DEBUG] [LOCAL ] BVN: Derivative data saved (1794 records). [2025-09-17T22:48:52.925401] [INFO ] [MAIN ] BVN: Successfully saved derivative data. [2025-09-17T22:48:52.928453] [INFO ] [MAIN ] Derivative Progress: 310/2085 symbols completed. BVN took 1.2s. Estimated remaining: 11m 31s. Rate: 154.1 symbols/min [2025-09-17T22:48:52.929223] [INFO ] [MAIN ] BWG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:52.946898] [DEBUG] [LOCAL ] BW: Derivative data saved (1794 records). [2025-09-17T22:48:52.947104] [INFO ] [MAIN ] BW: Successfully saved derivative data. [2025-09-17T22:48:52.950963] [INFO ] [MAIN ] Derivative Progress: 311/2085 symbols completed. BW took 1.2s. Estimated remaining: 11m 29s. Rate: 154.6 symbols/min [2025-09-17T22:48:52.952370] [INFO ] [MAIN ] BWLP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:52.972230] [DEBUG] [MAIN ] BWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:52.978390] [INFO ] [MAIN ] BWA: Generated 1794 derivative records from 52274 primary records. [2025-09-17T22:48:52.978786] [DEBUG] [LOCAL ] BWG: Loaded 12306 existing records from primary storage. [2025-09-17T22:48:52.978978] [DEBUG] [LOCAL ] BWA: Saving derivative data. [2025-09-17T22:48:52.979172] [INFO ] [MAIN ] BWG: Loaded 12306 primary data records. [2025-09-17T22:48:53.214414] [DEBUG] [LOCAL ] BWA: Derivative data saved (1794 records). [2025-09-17T22:48:53.332060] [INFO ] [MAIN ] BWA: Successfully saved derivative data. [2025-09-17T22:48:53.322861] [DEBUG] [LOCAL ] BWLP: Loaded 33011 existing records from primary storage. [2025-09-17T22:48:53.335150] [INFO ] [MAIN ] Derivative Progress: 312/2085 symbols completed. BWA took 1.5s. Estimated remaining: 11m 28s. Rate: 154.6 symbols/min [2025-09-17T22:48:53.335285] [INFO ] [MAIN ] BWLP: Loaded 33011 primary data records. [2025-09-17T22:48:53.335589] [INFO ] [MAIN ] BWMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:53.443704] [DEBUG] [LOCAL ] BWMX: Loaded 7579 existing records from primary storage. [2025-09-17T22:48:53.452140] [INFO ] [MAIN ] BWMX: Loaded 7579 primary data records. [2025-09-17T22:48:53.996947] [DEBUG] [MAIN ] BWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:53.999398] [INFO ] [MAIN ] BWG: Generated 1794 derivative records from 12306 primary records. [2025-09-17T22:48:54.000032] [DEBUG] [LOCAL ] BWG: Saving derivative data. [2025-09-17T22:48:54.021351] [DEBUG] [LOCAL ] BWG: Derivative data saved (1794 records). [2025-09-17T22:48:54.021938] [INFO ] [MAIN ] BWG: Successfully saved derivative data. [2025-09-17T22:48:54.024470] [INFO ] [MAIN ] Derivative Progress: 313/2085 symbols completed. BWG took 1.1s. Estimated remaining: 11m 30s. Rate: 154.2 symbols/min [2025-09-17T22:48:54.041195] [DEBUG] [MAIN ] BWLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:54.042055] [INFO ] [MAIN ] BWLP: Generated 1794 derivative records from 33011 primary records. [2025-09-17T22:48:54.042202] [DEBUG] [LOCAL ] BWLP: Saving derivative data. [2025-09-17T22:48:54.073498] [DEBUG] [LOCAL ] BWLP: Derivative data saved (1794 records). [2025-09-17T22:48:54.073431] [DEBUG] [MAIN ] BWMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:54.073611] [INFO ] [MAIN ] BWLP: Successfully saved derivative data. [2025-09-17T22:48:54.074408] [INFO ] [MAIN ] BWMX: Generated 1794 derivative records from 7579 primary records. [2025-09-17T22:48:54.076752] [INFO ] [MAIN ] Derivative Progress: 314/2085 symbols completed. BWLP took 1.1s. Estimated remaining: 11m 27s. Rate: 154.6 symbols/min [2025-09-17T22:48:54.076838] [DEBUG] [LOCAL ] BWMX: Saving derivative data. [2025-09-17T22:48:54.092862] [DEBUG] [LOCAL ] BWMX: Derivative data saved (1794 records). [2025-09-17T22:48:54.092935] [INFO ] [MAIN ] BWMX: Successfully saved derivative data. [2025-09-17T22:48:54.095921] [INFO ] [MAIN ] Derivative Progress: 315/2085 symbols completed. BWMX took 0.8s. Estimated remaining: 11m 25s. Rate: 155.1 symbols/min [2025-09-17T22:48:54.096675] [INFO ] [MAIN ] BWNB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:54.096754] [INFO ] [MAIN ] BX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:54.096878] [INFO ] [MAIN ] BWXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:54.104554] [DEBUG] [LOCAL ] BWNB: Loaded 4492 existing records from primary storage. [2025-09-17T22:48:54.104724] [INFO ] [MAIN ] BWNB: Loaded 4492 primary data records. [2025-09-17T22:48:54.456561] [DEBUG] [LOCAL ] BWXT: Loaded 46675 existing records from primary storage. [2025-09-17T22:48:54.457870] [INFO ] [MAIN ] BWXT: Loaded 46675 primary data records. [2025-09-17T22:48:54.543208] [DEBUG] [LOCAL ] BX: Loaded 53505 existing records from primary storage. [2025-09-17T22:48:54.580494] [INFO ] [MAIN ] BX: Loaded 53505 primary data records. [2025-09-17T22:48:55.169822] [DEBUG] [MAIN ] BWNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:55.170901] [INFO ] [MAIN ] BWNB: Generated 1794 derivative records from 4492 primary records. [2025-09-17T22:48:55.171071] [DEBUG] [LOCAL ] BWNB: Saving derivative data. [2025-09-17T22:48:55.194572] [DEBUG] [LOCAL ] BWNB: Derivative data saved (1794 records). [2025-09-17T22:48:55.194930] [INFO ] [MAIN ] BWNB: Successfully saved derivative data. [2025-09-17T22:48:55.197434] [INFO ] [MAIN ] Derivative Progress: 316/2085 symbols completed. BWNB took 1.1s. Estimated remaining: 11m 28s. Rate: 154.2 symbols/min [2025-09-17T22:48:55.197912] [INFO ] [MAIN ] BXC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:55.216247] [DEBUG] [MAIN ] BWXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:55.221200] [INFO ] [MAIN ] BWXT: Generated 1794 derivative records from 46675 primary records. [2025-09-17T22:48:55.221379] [DEBUG] [LOCAL ] BWXT: Saving derivative data. [2025-09-17T22:48:55.241224] [DEBUG] [LOCAL ] BXC: Loaded 13601 existing records from primary storage. [2025-09-17T22:48:55.241471] [INFO ] [MAIN ] BXC: Loaded 13601 primary data records. [2025-09-17T22:48:55.245697] [DEBUG] [LOCAL ] BWXT: Derivative data saved (1794 records). [2025-09-17T22:48:55.257205] [INFO ] [MAIN ] BWXT: Successfully saved derivative data. [2025-09-17T22:48:55.269743] [INFO ] [MAIN ] Derivative Progress: 317/2085 symbols completed. BWXT took 1.2s. Estimated remaining: 11m 26s. Rate: 154.6 symbols/min [2025-09-17T22:48:55.311354] [INFO ] [MAIN ] BXMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:55.341253] [DEBUG] [MAIN ] BX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:55.353454] [INFO ] [MAIN ] BX: Generated 1794 derivative records from 53505 primary records. [2025-09-17T22:48:55.367701] [DEBUG] [LOCAL ] BX: Saving derivative data. [2025-09-17T22:48:55.600840] [DEBUG] [LOCAL ] BX: Derivative data saved (1794 records). [2025-09-17T22:48:55.601021] [INFO ] [MAIN ] BX: Successfully saved derivative data. [2025-09-17T22:48:55.603876] [INFO ] [MAIN ] Derivative Progress: 318/2085 symbols completed. BX took 1.5s. Estimated remaining: 11m 26s. Rate: 154.6 symbols/min [2025-09-17T22:48:55.604353] [INFO ] [MAIN ] BXMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:55.627030] [DEBUG] [LOCAL ] BXMT: Loaded 47253 existing records from primary storage. [2025-09-17T22:48:55.627534] [INFO ] [MAIN ] BXMT: Loaded 47253 primary data records. [2025-09-17T22:48:55.742985] [DEBUG] [LOCAL ] BXMX: Loaded 19632 existing records from primary storage. [2025-09-17T22:48:55.762483] [INFO ] [MAIN ] BXMX: Loaded 19632 primary data records. [2025-09-17T22:48:55.809807] [DEBUG] [MAIN ] BXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:55.898819] [INFO ] [MAIN ] BXC: Generated 1794 derivative records from 13601 primary records. [2025-09-17T22:48:56.035047] [DEBUG] [LOCAL ] BXC: Saving derivative data. [2025-09-17T22:48:56.146496] [DEBUG] [LOCAL ] BXC: Derivative data saved (1794 records). [2025-09-17T22:48:56.177342] [INFO ] [MAIN ] BXC: Successfully saved derivative data. [2025-09-17T22:48:56.288571] [INFO ] [MAIN ] Derivative Progress: 319/2085 symbols completed. BXC took 1.1s. Estimated remaining: 11m 27s. Rate: 154.3 symbols/min [2025-09-17T22:48:56.297758] [INFO ] [MAIN ] BXP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:56.322035] [DEBUG] [MAIN ] BXMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:56.322966] [INFO ] [MAIN ] BXMT: Generated 1794 derivative records from 47253 primary records. [2025-09-17T22:48:56.323116] [DEBUG] [LOCAL ] BXMT: Saving derivative data. [2025-09-17T22:48:56.339567] [DEBUG] [LOCAL ] BXMT: Derivative data saved (1794 records). [2025-09-17T22:48:56.339830] [INFO ] [MAIN ] BXMT: Successfully saved derivative data. [2025-09-17T22:48:56.342553] [INFO ] [MAIN ] Derivative Progress: 320/2085 symbols completed. BXMT took 1.0s. Estimated remaining: 11m 25s. Rate: 154.7 symbols/min [2025-09-17T22:48:56.342943] [INFO ] [MAIN ] BXSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:56.370389] [DEBUG] [MAIN ] BXMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:56.371167] [INFO ] [MAIN ] BXMX: Generated 1794 derivative records from 19632 primary records. [2025-09-17T22:48:56.371379] [DEBUG] [LOCAL ] BXMX: Saving derivative data. [2025-09-17T22:48:56.400430] [DEBUG] [LOCAL ] BXMX: Derivative data saved (1794 records). [2025-09-17T22:48:56.401787] [INFO ] [MAIN ] BXMX: Successfully saved derivative data. [2025-09-17T22:48:56.404005] [INFO ] [MAIN ] Derivative Progress: 321/2085 symbols completed. BXMX took 0.8s. Estimated remaining: 11m 22s. Rate: 155.1 symbols/min [2025-09-17T22:48:56.405338] [INFO ] [MAIN ] BY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:56.405069] [DEBUG] [LOCAL ] BXP: Loaded 49903 existing records from primary storage. [2025-09-17T22:48:56.406066] [INFO ] [MAIN ] BXP: Loaded 49903 primary data records. [2025-09-17T22:48:56.630682] [DEBUG] [LOCAL ] BY: Loaded 21446 existing records from primary storage. [2025-09-17T22:48:56.632094] [INFO ] [MAIN ] BY: Loaded 21446 primary data records. [2025-09-17T22:48:56.632009] [DEBUG] [LOCAL ] BXSL: Loaded 47370 existing records from primary storage. [2025-09-17T22:48:56.632287] [INFO ] [MAIN ] BXSL: Loaded 47370 primary data records. [2025-09-17T22:48:57.440177] [DEBUG] [MAIN ] BXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:57.441241] [INFO ] [MAIN ] BXP: Generated 1794 derivative records from 49903 primary records. [2025-09-17T22:48:57.441590] [DEBUG] [LOCAL ] BXP: Saving derivative data. [2025-09-17T22:48:57.464725] [DEBUG] [LOCAL ] BXP: Derivative data saved (1794 records). [2025-09-17T22:48:57.464948] [INFO ] [MAIN ] BXP: Successfully saved derivative data. [2025-09-17T22:48:57.480740] [INFO ] [MAIN ] Derivative Progress: 322/2085 symbols completed. BXP took 1.2s. Estimated remaining: 11m 26s. Rate: 154.2 symbols/min [2025-09-17T22:48:57.481007] [INFO ] [MAIN ] BYD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:57.481349] [DEBUG] [MAIN ] BXSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:57.495286] [INFO ] [MAIN ] BXSL: Generated 1794 derivative records from 47370 primary records. [2025-09-17T22:48:57.495429] [DEBUG] [LOCAL ] BXSL: Saving derivative data. [2025-09-17T22:48:57.496561] [DEBUG] [MAIN ] BY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:57.497721] [INFO ] [MAIN ] BY: Generated 1794 derivative records from 21446 primary records. [2025-09-17T22:48:57.497895] [DEBUG] [LOCAL ] BY: Saving derivative data. [2025-09-17T22:48:57.527580] [DEBUG] [LOCAL ] BY: Derivative data saved (1794 records). [2025-09-17T22:48:57.527804] [INFO ] [MAIN ] BY: Successfully saved derivative data. [2025-09-17T22:48:57.531966] [INFO ] [MAIN ] Derivative Progress: 323/2085 symbols completed. BY took 1.1s. Estimated remaining: 11m 24s. Rate: 154.7 symbols/min [2025-09-17T22:48:57.533405] [DEBUG] [LOCAL ] BXSL: Derivative data saved (1794 records). [2025-09-17T22:48:57.533838] [INFO ] [MAIN ] BXSL: Successfully saved derivative data. [2025-09-17T22:48:57.533763] [INFO ] [MAIN ] BYM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:57.536794] [INFO ] [MAIN ] Derivative Progress: 324/2085 symbols completed. BXSL took 1.2s. Estimated remaining: 11m 21s. Rate: 155.1 symbols/min [2025-09-17T22:48:57.537407] [INFO ] [MAIN ] BZH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:57.565794] [DEBUG] [LOCAL ] BYM: Loaded 12343 existing records from primary storage. [2025-09-17T22:48:57.566063] [INFO ] [MAIN ] BYM: Loaded 12343 primary data records. [2025-09-17T22:48:57.624041] [DEBUG] [LOCAL ] BYD: Loaded 45423 existing records from primary storage. [2025-09-17T22:48:57.657343] [INFO ] [MAIN ] BYD: Loaded 45423 primary data records. [2025-09-17T22:48:57.750241] [DEBUG] [LOCAL ] BZH: Loaded 32957 existing records from primary storage. [2025-09-17T22:48:57.777680] [INFO ] [MAIN ] BZH: Loaded 32957 primary data records. [2025-09-17T22:48:58.584865] [DEBUG] [MAIN ] BYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:58.593789] [INFO ] [MAIN ] BYM: Generated 1794 derivative records from 12343 primary records. [2025-09-17T22:48:58.599145] [DEBUG] [LOCAL ] BYM: Saving derivative data. [2025-09-17T22:48:58.600526] [DEBUG] [MAIN ] BYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:58.602019] [INFO ] [MAIN ] BYD: Generated 1794 derivative records from 45423 primary records. [2025-09-17T22:48:58.602320] [DEBUG] [LOCAL ] BYD: Saving derivative data. [2025-09-17T22:48:58.632422] [DEBUG] [LOCAL ] BYD: Derivative data saved (1794 records). [2025-09-17T22:48:58.636991] [INFO ] [MAIN ] BYD: Successfully saved derivative data. [2025-09-17T22:48:58.636834] [DEBUG] [LOCAL ] BYM: Derivative data saved (1794 records). [2025-09-17T22:48:58.637474] [INFO ] [MAIN ] BYM: Successfully saved derivative data. [2025-09-17T22:48:58.640984] [INFO ] [MAIN ] Derivative Progress: 325/2085 symbols completed. BYD took 1.2s. Estimated remaining: 11m 25s. Rate: 154.3 symbols/min [2025-09-17T22:48:58.645068] [INFO ] [MAIN ] Derivative Progress: 326/2085 symbols completed. BYM took 1.1s. Estimated remaining: 11m 22s. Rate: 154.7 symbols/min [2025-09-17T22:48:58.644917] [INFO ] [MAIN ] C: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:58.646452] [INFO ] [MAIN ] CAAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:58.661850] [DEBUG] [MAIN ] BZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:58.662857] [INFO ] [MAIN ] BZH: Generated 1794 derivative records from 32957 primary records. [2025-09-17T22:48:58.663006] [DEBUG] [LOCAL ] BZH: Saving derivative data. [2025-09-17T22:48:58.695439] [DEBUG] [LOCAL ] CAAP: Loaded 19057 existing records from primary storage. [2025-09-17T22:48:58.701884] [INFO ] [MAIN ] CAAP: Loaded 19057 primary data records. [2025-09-17T22:48:58.702312] [DEBUG] [LOCAL ] BZH: Derivative data saved (1794 records). [2025-09-17T22:48:58.724745] [INFO ] [MAIN ] BZH: Successfully saved derivative data. [2025-09-17T22:48:58.745749] [INFO ] [MAIN ] Derivative Progress: 327/2085 symbols completed. BZH took 1.2s. Estimated remaining: 11m 20s. Rate: 155.1 symbols/min [2025-09-17T22:48:58.751839] [INFO ] [MAIN ] CABO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:58.903667] [DEBUG] [LOCAL ] CABO: Loaded 17771 existing records from primary storage. [2025-09-17T22:48:58.926733] [INFO ] [MAIN ] CABO: Loaded 17771 primary data records. [2025-09-17T22:48:59.132596] [DEBUG] [LOCAL ] C: Loaded 53741 existing records from primary storage. [2025-09-17T22:48:59.153297] [INFO ] [MAIN ] C: Loaded 53741 primary data records. [2025-09-17T22:48:59.732602] [DEBUG] [MAIN ] CAAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:59.733500] [INFO ] [MAIN ] CAAP: Generated 1794 derivative records from 19057 primary records. [2025-09-17T22:48:59.733742] [DEBUG] [LOCAL ] CAAP: Saving derivative data. [2025-09-17T22:48:59.751220] [DEBUG] [LOCAL ] CAAP: Derivative data saved (1794 records). [2025-09-17T22:48:59.752406] [INFO ] [MAIN ] CAAP: Successfully saved derivative data. [2025-09-17T22:48:59.755945] [INFO ] [MAIN ] Derivative Progress: 328/2085 symbols completed. CAAP took 1.1s. Estimated remaining: 11m 23s. Rate: 154.3 symbols/min [2025-09-17T22:48:59.772546] [DEBUG] [MAIN ] CABO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:59.773443] [INFO ] [MAIN ] CABO: Generated 1794 derivative records from 17771 primary records. [2025-09-17T22:48:59.785505] [DEBUG] [MAIN ] C: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:48:59.785568] [DEBUG] [LOCAL ] CABO: Saving derivative data. [2025-09-17T22:48:59.786207] [INFO ] [MAIN ] C: Generated 1794 derivative records from 53741 primary records. [2025-09-17T22:48:59.786960] [DEBUG] [LOCAL ] C: Saving derivative data. [2025-09-17T22:48:59.815463] [DEBUG] [LOCAL ] CABO: Derivative data saved (1794 records). [2025-09-17T22:48:59.816003] [INFO ] [MAIN ] CABO: Successfully saved derivative data. [2025-09-17T22:48:59.818889] [INFO ] [MAIN ] Derivative Progress: 329/2085 symbols completed. CABO took 1.1s. Estimated remaining: 11m 21s. Rate: 154.7 symbols/min [2025-09-17T22:48:59.820212] [DEBUG] [LOCAL ] C: Derivative data saved (1794 records). [2025-09-17T22:48:59.820277] [INFO ] [MAIN ] C: Successfully saved derivative data. [2025-09-17T22:48:59.822683] [INFO ] [MAIN ] Derivative Progress: 330/2085 symbols completed. C took 1.2s. Estimated remaining: 11m 19s. Rate: 155.2 symbols/min [2025-09-17T22:48:59.823381] [INFO ] [MAIN ] CACI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:59.823268] [INFO ] [MAIN ] CAE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:59.823431] [INFO ] [MAIN ] CAF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:48:59.830217] [DEBUG] [LOCAL ] CAF: Loaded 3421 existing records from primary storage. [2025-09-17T22:48:59.830360] [INFO ] [MAIN ] CAF: Loaded 3421 primary data records. [2025-09-17T22:49:00.169104] [DEBUG] [LOCAL ] CACI: Loaded 26038 existing records from primary storage. [2025-09-17T22:49:00.189553] [INFO ] [MAIN ] CACI: Loaded 26038 primary data records. [2025-09-17T22:49:00.190462] [DEBUG] [LOCAL ] CAE: Loaded 38927 existing records from primary storage. [2025-09-17T22:49:00.202410] [INFO ] [MAIN ] CAE: Loaded 38927 primary data records. [2025-09-17T22:49:00.900797] [DEBUG] [MAIN ] CAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:00.901825] [INFO ] [MAIN ] CAF: Generated 1794 derivative records from 3421 primary records. [2025-09-17T22:49:00.902204] [DEBUG] [LOCAL ] CAF: Saving derivative data. [2025-09-17T22:49:00.918793] [DEBUG] [LOCAL ] CAF: Derivative data saved (1794 records). [2025-09-17T22:49:00.919310] [INFO ] [MAIN ] CAF: Successfully saved derivative data. [2025-09-17T22:49:00.921908] [INFO ] [MAIN ] Derivative Progress: 331/2085 symbols completed. CAF took 1.1s. Estimated remaining: 11m 22s. Rate: 154.3 symbols/min [2025-09-17T22:49:00.922624] [INFO ] [MAIN ] CAG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:00.943601] [DEBUG] [MAIN ] CACI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:49:00.944478] [INFO ] [MAIN ] CACI: Generated 1793 derivative records from 26038 primary records. [2025-09-17T22:49:00.944806] [DEBUG] [LOCAL ] CACI: Saving derivative data. [2025-09-17T22:49:00.958871] [DEBUG] [MAIN ] CAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:00.960118] [INFO ] [MAIN ] CAE: Generated 1794 derivative records from 38927 primary records. [2025-09-17T22:49:00.960476] [DEBUG] [LOCAL ] CAE: Saving derivative data. [2025-09-17T22:49:00.993952] [DEBUG] [LOCAL ] CAE: Derivative data saved (1794 records). [2025-09-17T22:49:00.993237] [DEBUG] [LOCAL ] CACI: Derivative data saved (1793 records). [2025-09-17T22:49:00.994217] [INFO ] [MAIN ] CAE: Successfully saved derivative data. [2025-09-17T22:49:00.994318] [INFO ] [MAIN ] CACI: Successfully saved derivative data. [2025-09-17T22:49:01.009384] [INFO ] [MAIN ] Derivative Progress: 332/2085 symbols completed. CACI took 1.2s. Estimated remaining: 11m 20s. Rate: 154.7 symbols/min [2025-09-17T22:49:01.013783] [INFO ] [MAIN ] CAH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:01.013960] [INFO ] [MAIN ] Derivative Progress: 333/2085 symbols completed. CAE took 1.2s. Estimated remaining: 11m 18s. Rate: 155.1 symbols/min [2025-09-17T22:49:01.014490] [INFO ] [MAIN ] CAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:01.039985] [DEBUG] [LOCAL ] CAG: Loaded 53658 existing records from primary storage. [2025-09-17T22:49:01.040309] [INFO ] [MAIN ] CAG: Loaded 53658 primary data records. [2025-09-17T22:49:01.423443] [DEBUG] [LOCAL ] CAH: Loaded 51548 existing records from primary storage. [2025-09-17T22:49:01.424937] [INFO ] [MAIN ] CAH: Loaded 51548 primary data records. [2025-09-17T22:49:01.463270] [DEBUG] [LOCAL ] CAL: Loaded 43368 existing records from primary storage. [2025-09-17T22:49:01.493158] [INFO ] [MAIN ] CAL: Loaded 43368 primary data records. [2025-09-17T22:49:02.125526] [DEBUG] [MAIN ] CAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:02.127124] [INFO ] [MAIN ] CAG: Generated 1794 derivative records from 53658 primary records. [2025-09-17T22:49:02.127754] [DEBUG] [LOCAL ] CAG: Saving derivative data. [2025-09-17T22:49:02.147473] [DEBUG] [LOCAL ] CAG: Derivative data saved (1794 records). [2025-09-17T22:49:02.148795] [INFO ] [MAIN ] CAG: Successfully saved derivative data. [2025-09-17T22:49:02.152368] [INFO ] [MAIN ] Derivative Progress: 334/2085 symbols completed. CAG took 1.2s. Estimated remaining: 11m 21s. Rate: 154.2 symbols/min [2025-09-17T22:49:02.153573] [INFO ] [MAIN ] CALX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:02.168471] [DEBUG] [MAIN ] CAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:02.169242] [INFO ] [MAIN ] CAH: Generated 1794 derivative records from 51548 primary records. [2025-09-17T22:49:02.169464] [DEBUG] [LOCAL ] CAH: Saving derivative data. [2025-09-17T22:49:02.197812] [DEBUG] [LOCAL ] CAH: Derivative data saved (1794 records). [2025-09-17T22:49:02.203810] [DEBUG] [MAIN ] CAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:02.203325] [INFO ] [MAIN ] CAH: Successfully saved derivative data. [2025-09-17T22:49:02.204817] [INFO ] [MAIN ] CAL: Generated 1794 derivative records from 43368 primary records. [2025-09-17T22:49:02.204964] [DEBUG] [LOCAL ] CAL: Saving derivative data. [2025-09-17T22:49:02.207632] [INFO ] [MAIN ] Derivative Progress: 335/2085 symbols completed. CAH took 1.2s. Estimated remaining: 11m 19s. Rate: 154.6 symbols/min [2025-09-17T22:49:02.208957] [INFO ] [MAIN ] CANG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:02.244936] [DEBUG] [LOCAL ] CAL: Derivative data saved (1794 records). [2025-09-17T22:49:02.245244] [INFO ] [MAIN ] CAL: Successfully saved derivative data. [2025-09-17T22:49:02.248732] [INFO ] [MAIN ] Derivative Progress: 336/2085 symbols completed. CAL took 1.2s. Estimated remaining: 11m 17s. Rate: 155.0 symbols/min [2025-09-17T22:49:02.250145] [INFO ] [MAIN ] CAPL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:02.271003] [DEBUG] [LOCAL ] CALX: Loaded 38843 existing records from primary storage. [2025-09-17T22:49:02.271407] [INFO ] [MAIN ] CALX: Loaded 38843 primary data records. [2025-09-17T22:49:02.397115] [DEBUG] [LOCAL ] CAPL: Loaded 5944 existing records from primary storage. [2025-09-17T22:49:02.396795] [DEBUG] [LOCAL ] CANG: Loaded 26652 existing records from primary storage. [2025-09-17T22:49:02.397549] [INFO ] [MAIN ] CAPL: Loaded 5944 primary data records. [2025-09-17T22:49:02.408195] [INFO ] [MAIN ] CANG: Loaded 26652 primary data records. [2025-09-17T22:49:03.296028] [DEBUG] [MAIN ] CALX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:03.297023] [INFO ] [MAIN ] CALX: Generated 1794 derivative records from 38843 primary records. [2025-09-17T22:49:03.297240] [DEBUG] [LOCAL ] CALX: Saving derivative data. [2025-09-17T22:49:03.315742] [DEBUG] [LOCAL ] CALX: Derivative data saved (1794 records). [2025-09-17T22:49:03.316786] [INFO ] [MAIN ] CALX: Successfully saved derivative data. [2025-09-17T22:49:03.318979] [INFO ] [MAIN ] Derivative Progress: 337/2085 symbols completed. CALX took 1.2s. Estimated remaining: 11m 20s. Rate: 154.2 symbols/min [2025-09-17T22:49:03.319430] [INFO ] [MAIN ] CARR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:03.334377] [DEBUG] [MAIN ] CAPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:03.336889] [INFO ] [MAIN ] CAPL: Generated 1794 derivative records from 5944 primary records. [2025-09-17T22:49:03.337200] [DEBUG] [LOCAL ] CAPL: Saving derivative data. [2025-09-17T22:49:03.359274] [DEBUG] [MAIN ] CANG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:03.363528] [INFO ] [MAIN ] CANG: Generated 1794 derivative records from 26652 primary records. [2025-09-17T22:49:03.363918] [DEBUG] [LOCAL ] CANG: Saving derivative data. [2025-09-17T22:49:03.368037] [DEBUG] [LOCAL ] CAPL: Derivative data saved (1794 records). [2025-09-17T22:49:03.368223] [INFO ] [MAIN ] CAPL: Successfully saved derivative data. [2025-09-17T22:49:03.371387] [INFO ] [MAIN ] Derivative Progress: 338/2085 symbols completed. CAPL took 1.1s. Estimated remaining: 11m 18s. Rate: 154.6 symbols/min [2025-09-17T22:49:03.383230] [INFO ] [MAIN ] CARS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:03.389665] [DEBUG] [LOCAL ] CANG: Derivative data saved (1794 records). [2025-09-17T22:49:03.389834] [INFO ] [MAIN ] CANG: Successfully saved derivative data. [2025-09-17T22:49:03.392302] [INFO ] [MAIN ] Derivative Progress: 339/2085 symbols completed. CANG took 1.2s. Estimated remaining: 11m 16s. Rate: 155.1 symbols/min [2025-09-17T22:49:03.392858] [INFO ] [MAIN ] CAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:03.430756] [DEBUG] [LOCAL ] CARR: Loaded 53598 existing records from primary storage. [2025-09-17T22:49:03.431751] [INFO ] [MAIN ] CARR: Loaded 53598 primary data records. [2025-09-17T22:49:03.598911] [DEBUG] [LOCAL ] CARS: Loaded 40470 existing records from primary storage. [2025-09-17T22:49:03.658158] [INFO ] [MAIN ] CARS: Loaded 40470 primary data records. [2025-09-17T22:49:03.862123] [DEBUG] [LOCAL ] CAT: Loaded 52932 existing records from primary storage. [2025-09-17T22:49:03.883230] [INFO ] [MAIN ] CAT: Loaded 52932 primary data records. [2025-09-17T22:49:04.437563] [DEBUG] [MAIN ] CARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:04.438498] [INFO ] [MAIN ] CARR: Generated 1794 derivative records from 53598 primary records. [2025-09-17T22:49:04.439755] [DEBUG] [LOCAL ] CARR: Saving derivative data. [2025-09-17T22:49:04.471843] [DEBUG] [MAIN ] CARS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:04.473795] [INFO ] [MAIN ] CARS: Generated 1794 derivative records from 40470 primary records. [2025-09-17T22:49:04.473893] [DEBUG] [LOCAL ] CARS: Saving derivative data. [2025-09-17T22:49:04.474775] [DEBUG] [LOCAL ] CARR: Derivative data saved (1794 records). [2025-09-17T22:49:04.475836] [INFO ] [MAIN ] CARR: Successfully saved derivative data. [2025-09-17T22:49:04.486163] [INFO ] [MAIN ] Derivative Progress: 340/2085 symbols completed. CARR took 1.2s. Estimated remaining: 11m 19s. Rate: 154.2 symbols/min [2025-09-17T22:49:04.491326] [INFO ] [MAIN ] CATO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:04.508434] [DEBUG] [LOCAL ] CARS: Derivative data saved (1794 records). [2025-09-17T22:49:04.508577] [INFO ] [MAIN ] CARS: Successfully saved derivative data. [2025-09-17T22:49:04.507856] [DEBUG] [MAIN ] CAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:04.511117] [INFO ] [MAIN ] Derivative Progress: 341/2085 symbols completed. CARS took 1.1s. Estimated remaining: 11m 17s. Rate: 154.7 symbols/min [2025-09-17T22:49:04.513746] [INFO ] [MAIN ] CAT: Generated 1794 derivative records from 52932 primary records. [2025-09-17T22:49:04.514108] [DEBUG] [LOCAL ] CAT: Saving derivative data. [2025-09-17T22:49:04.514327] [INFO ] [MAIN ] CAVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:04.518852] [DEBUG] [LOCAL ] CATO: Loaded 7429 existing records from primary storage. [2025-09-17T22:49:04.526416] [INFO ] [MAIN ] CATO: Loaded 7429 primary data records. [2025-09-17T22:49:04.671543] [DEBUG] [LOCAL ] CAT: Derivative data saved (1794 records). [2025-09-17T22:49:04.685417] [INFO ] [MAIN ] CAT: Successfully saved derivative data. [2025-09-17T22:49:04.691393] [INFO ] [MAIN ] Derivative Progress: 342/2085 symbols completed. CAT took 1.3s. Estimated remaining: 11m 15s. Rate: 154.9 symbols/min [2025-09-17T22:49:04.740845] [INFO ] [MAIN ] CB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:04.878107] [DEBUG] [LOCAL ] CAVA: Loaded 53553 existing records from primary storage. [2025-09-17T22:49:04.878910] [INFO ] [MAIN ] CAVA: Loaded 53553 primary data records. [2025-09-17T22:49:05.257600] [DEBUG] [LOCAL ] CB: Loaded 50120 existing records from primary storage. [2025-09-17T22:49:05.258170] [INFO ] [MAIN ] CB: Loaded 50120 primary data records. [2025-09-17T22:49:05.432130] [DEBUG] [MAIN ] CATO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:05.463973] [INFO ] [MAIN ] CATO: Generated 1794 derivative records from 7429 primary records. [2025-09-17T22:49:05.464425] [DEBUG] [LOCAL ] CATO: Saving derivative data. [2025-09-17T22:49:05.626273] [DEBUG] [MAIN ] CAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:05.627112] [INFO ] [MAIN ] CAVA: Generated 1794 derivative records from 53553 primary records. [2025-09-17T22:49:05.627244] [DEBUG] [LOCAL ] CAVA: Saving derivative data. [2025-09-17T22:49:05.625960] [DEBUG] [LOCAL ] CATO: Derivative data saved (1794 records). [2025-09-17T22:49:05.628522] [INFO ] [MAIN ] CATO: Successfully saved derivative data. [2025-09-17T22:49:05.631945] [INFO ] [MAIN ] Derivative Progress: 343/2085 symbols completed. CATO took 1.1s. Estimated remaining: 11m 18s. Rate: 154.3 symbols/min [2025-09-17T22:49:05.652059] [DEBUG] [LOCAL ] CAVA: Derivative data saved (1794 records). [2025-09-17T22:49:05.652207] [INFO ] [MAIN ] CAVA: Successfully saved derivative data. [2025-09-17T22:49:05.655019] [INFO ] [MAIN ] Derivative Progress: 344/2085 symbols completed. CAVA took 1.1s. Estimated remaining: 11m 15s. Rate: 154.7 symbols/min [2025-09-17T22:49:05.673093] [DEBUG] [MAIN ] CB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:05.673832] [INFO ] [MAIN ] CB: Generated 1794 derivative records from 50120 primary records. [2025-09-17T22:49:05.673897] [DEBUG] [LOCAL ] CB: Saving derivative data. [2025-09-17T22:49:05.689773] [DEBUG] [LOCAL ] CB: Derivative data saved (1794 records). [2025-09-17T22:49:05.689894] [INFO ] [MAIN ] CB: Successfully saved derivative data. [2025-09-17T22:49:05.692361] [INFO ] [MAIN ] Derivative Progress: 345/2085 symbols completed. CB took 1.0s. Estimated remaining: 11m 13s. Rate: 155.1 symbols/min [2025-09-17T22:49:05.693214] [INFO ] [MAIN ] CBAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:05.693139] [INFO ] [MAIN ] CBL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:05.693854] [INFO ] [MAIN ] CBNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:05.701382] [DEBUG] [LOCAL ] CBNA: Loaded 2963 existing records from primary storage. [2025-09-17T22:49:05.701575] [INFO ] [MAIN ] CBNA: Loaded 2963 primary data records. [2025-09-17T22:49:05.810551] [DEBUG] [LOCAL ] CBAN: Loaded 11202 existing records from primary storage. [2025-09-17T22:49:05.842881] [INFO ] [MAIN ] CBAN: Loaded 11202 primary data records. [2025-09-17T22:49:05.842788] [DEBUG] [LOCAL ] CBL: Loaded 16876 existing records from primary storage. [2025-09-17T22:49:05.843094] [INFO ] [MAIN ] CBL: Loaded 16876 primary data records. [2025-09-17T22:49:07.029594] [DEBUG] [MAIN ] CBNA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:49:07.030367] [INFO ] [MAIN ] CBNA: Generated 1793 derivative records from 2963 primary records. [2025-09-17T22:49:07.030535] [DEBUG] [LOCAL ] CBNA: Saving derivative data. [2025-09-17T22:49:07.047393] [DEBUG] [LOCAL ] CBNA: Derivative data saved (1793 records). [2025-09-17T22:49:07.048941] [INFO ] [MAIN ] CBNA: Successfully saved derivative data. [2025-09-17T22:49:07.052037] [INFO ] [MAIN ] Derivative Progress: 346/2085 symbols completed. CBNA took 1.4s. Estimated remaining: 11m 18s. Rate: 154.0 symbols/min [2025-09-17T22:49:07.053389] [INFO ] [MAIN ] CBRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:07.080597] [DEBUG] [MAIN ] CBAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:07.080964] [DEBUG] [MAIN ] CBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:07.081788] [INFO ] [MAIN ] CBAN: Generated 1794 derivative records from 11202 primary records. [2025-09-17T22:49:07.082407] [INFO ] [MAIN ] CBL: Generated 1794 derivative records from 16876 primary records. [2025-09-17T22:49:07.082502] [DEBUG] [LOCAL ] CBAN: Saving derivative data. [2025-09-17T22:49:07.082603] [DEBUG] [LOCAL ] CBL: Saving derivative data. [2025-09-17T22:49:07.109838] [DEBUG] [LOCAL ] CBL: Derivative data saved (1794 records). [2025-09-17T22:49:07.112733] [INFO ] [MAIN ] CBL: Successfully saved derivative data. [2025-09-17T22:49:07.115774] [INFO ] [MAIN ] Derivative Progress: 347/2085 symbols completed. CBL took 1.4s. Estimated remaining: 11m 16s. Rate: 154.3 symbols/min [2025-09-17T22:49:07.116404] [INFO ] [MAIN ] CBT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:07.118467] [DEBUG] [LOCAL ] CBAN: Derivative data saved (1794 records). [2025-09-17T22:49:07.118631] [INFO ] [MAIN ] CBAN: Successfully saved derivative data. [2025-09-17T22:49:07.121574] [INFO ] [MAIN ] Derivative Progress: 348/2085 symbols completed. CBAN took 1.4s. Estimated remaining: 11m 13s. Rate: 154.8 symbols/min [2025-09-17T22:49:07.121917] [INFO ] [MAIN ] CBU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:07.166498] [DEBUG] [LOCAL ] CBU: Loaded 22866 existing records from primary storage. [2025-09-17T22:49:07.190428] [INFO ] [MAIN ] CBU: Loaded 22866 primary data records. [2025-09-17T22:49:07.191049] [DEBUG] [LOCAL ] CBT: Loaded 31409 existing records from primary storage. [2025-09-17T22:49:07.191180] [INFO ] [MAIN ] CBT: Loaded 31409 primary data records. [2025-09-17T22:49:07.203868] [DEBUG] [LOCAL ] CBRE: Loaded 50749 existing records from primary storage. [2025-09-17T22:49:07.224739] [INFO ] [MAIN ] CBRE: Loaded 50749 primary data records. [2025-09-17T22:49:08.165229] [DEBUG] [MAIN ] CBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:08.166416] [INFO ] [MAIN ] CBT: Generated 1794 derivative records from 31409 primary records. [2025-09-17T22:49:08.173822] [DEBUG] [LOCAL ] CBT: Saving derivative data. [2025-09-17T22:49:08.191249] [DEBUG] [MAIN ] CBRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:08.192251] [DEBUG] [MAIN ] CBU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:08.191985] [INFO ] [MAIN ] CBRE: Generated 1794 derivative records from 50749 primary records. [2025-09-17T22:49:08.193122] [INFO ] [MAIN ] CBU: Generated 1794 derivative records from 22866 primary records. [2025-09-17T22:49:08.200202] [DEBUG] [LOCAL ] CBRE: Saving derivative data. [2025-09-17T22:49:08.204316] [DEBUG] [LOCAL ] CBU: Saving derivative data. [2025-09-17T22:49:08.208589] [DEBUG] [LOCAL ] CBT: Derivative data saved (1794 records). [2025-09-17T22:49:08.215828] [INFO ] [MAIN ] CBT: Successfully saved derivative data. [2025-09-17T22:49:08.222748] [INFO ] [MAIN ] Derivative Progress: 349/2085 symbols completed. CBT took 1.1s. Estimated remaining: 11m 16s. Rate: 154.0 symbols/min [2025-09-17T22:49:08.232475] [INFO ] [MAIN ] CBZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:08.234289] [DEBUG] [LOCAL ] CBRE: Derivative data saved (1794 records). [2025-09-17T22:49:08.237552] [INFO ] [MAIN ] CBRE: Successfully saved derivative data. [2025-09-17T22:49:08.241272] [DEBUG] [LOCAL ] CBU: Derivative data saved (1794 records). [2025-09-17T22:49:08.243873] [INFO ] [MAIN ] Derivative Progress: 350/2085 symbols completed. CBRE took 1.2s. Estimated remaining: 11m 14s. Rate: 154.4 symbols/min [2025-09-17T22:49:08.244197] [INFO ] [MAIN ] CC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:08.244260] [INFO ] [MAIN ] CBU: Successfully saved derivative data. [2025-09-17T22:49:08.247263] [INFO ] [MAIN ] Derivative Progress: 351/2085 symbols completed. CBU took 1.1s. Estimated remaining: 11m 12s. Rate: 154.8 symbols/min [2025-09-17T22:49:08.247815] [INFO ] [MAIN ] CCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:08.279775] [DEBUG] [LOCAL ] CBZ: Loaded 33282 existing records from primary storage. [2025-09-17T22:49:08.279923] [INFO ] [MAIN ] CBZ: Loaded 33282 primary data records. [2025-09-17T22:49:08.652317] [DEBUG] [LOCAL ] CC: Loaded 53037 existing records from primary storage. [2025-09-17T22:49:08.653844] [INFO ] [MAIN ] CC: Loaded 53037 primary data records. [2025-09-17T22:49:08.653634] [DEBUG] [LOCAL ] CCI: Loaded 53166 existing records from primary storage. [2025-09-17T22:49:08.654213] [INFO ] [MAIN ] CCI: Loaded 53166 primary data records. [2025-09-17T22:49:09.326722] [DEBUG] [MAIN ] CBZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:09.327615] [INFO ] [MAIN ] CBZ: Generated 1794 derivative records from 33282 primary records. [2025-09-17T22:49:09.329477] [DEBUG] [LOCAL ] CBZ: Saving derivative data. [2025-09-17T22:49:09.347880] [DEBUG] [LOCAL ] CBZ: Derivative data saved (1794 records). [2025-09-17T22:49:09.348122] [INFO ] [MAIN ] CBZ: Successfully saved derivative data. [2025-09-17T22:49:09.350669] [INFO ] [MAIN ] Derivative Progress: 352/2085 symbols completed. CBZ took 1.1s. Estimated remaining: 11m 15s. Rate: 154.0 symbols/min [2025-09-17T22:49:09.351777] [INFO ] [MAIN ] CCIF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:09.372261] [DEBUG] [MAIN ] CC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:09.389906] [INFO ] [MAIN ] CC: Generated 1794 derivative records from 53037 primary records. [2025-09-17T22:49:09.390246] [DEBUG] [MAIN ] CCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:09.390472] [DEBUG] [LOCAL ] CC: Saving derivative data. [2025-09-17T22:49:09.391281] [INFO ] [MAIN ] CCI: Generated 1794 derivative records from 53166 primary records. [2025-09-17T22:49:09.391426] [DEBUG] [LOCAL ] CCI: Saving derivative data. [2025-09-17T22:49:09.399080] [DEBUG] [LOCAL ] CCIF: Loaded 15299 existing records from primary storage. [2025-09-17T22:49:09.409929] [INFO ] [MAIN ] CCIF: Loaded 15299 primary data records. [2025-09-17T22:49:09.501853] [DEBUG] [LOCAL ] CCI: Derivative data saved (1794 records). [2025-09-17T22:49:09.527667] [INFO ] [MAIN ] CCI: Successfully saved derivative data. [2025-09-17T22:49:09.533119] [INFO ] [MAIN ] Derivative Progress: 353/2085 symbols completed. CCI took 1.3s. Estimated remaining: 11m 14s. Rate: 154.3 symbols/min [2025-09-17T22:49:09.545873] [INFO ] [MAIN ] CCJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:09.547404] [DEBUG] [LOCAL ] CC: Derivative data saved (1794 records). [2025-09-17T22:49:09.547571] [INFO ] [MAIN ] CC: Successfully saved derivative data. [2025-09-17T22:49:09.549517] [INFO ] [MAIN ] Derivative Progress: 354/2085 symbols completed. CC took 1.3s. Estimated remaining: 11m 11s. Rate: 154.7 symbols/min [2025-09-17T22:49:09.561973] [INFO ] [MAIN ] CCK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:09.843577] [DEBUG] [MAIN ] CCIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:09.855504] [INFO ] [MAIN ] CCIF: Generated 1794 derivative records from 15299 primary records. [2025-09-17T22:49:09.854596] [DEBUG] [LOCAL ] CCJ: Loaded 53675 existing records from primary storage. [2025-09-17T22:49:09.855686] [DEBUG] [LOCAL ] CCIF: Saving derivative data. [2025-09-17T22:49:09.855884] [INFO ] [MAIN ] CCJ: Loaded 53675 primary data records. [2025-09-17T22:49:09.988147] [DEBUG] [LOCAL ] CCK: Loaded 46609 existing records from primary storage. [2025-09-17T22:49:09.999226] [INFO ] [MAIN ] CCK: Loaded 46609 primary data records. [2025-09-17T22:49:10.280318] [DEBUG] [LOCAL ] CCIF: Derivative data saved (1794 records). [2025-09-17T22:49:10.301747] [INFO ] [MAIN ] CCIF: Successfully saved derivative data. [2025-09-17T22:49:10.303822] [INFO ] [MAIN ] Derivative Progress: 355/2085 symbols completed. CCIF took 1.0s. Estimated remaining: 11m 13s. Rate: 154.3 symbols/min [2025-09-17T22:49:10.304825] [INFO ] [MAIN ] CCL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:10.537913] [DEBUG] [MAIN ] CCJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:10.538996] [INFO ] [MAIN ] CCJ: Generated 1794 derivative records from 53675 primary records. [2025-09-17T22:49:10.539253] [DEBUG] [LOCAL ] CCJ: Saving derivative data. [2025-09-17T22:49:10.572530] [DEBUG] [LOCAL ] CCJ: Derivative data saved (1794 records). [2025-09-17T22:49:10.572861] [INFO ] [MAIN ] CCJ: Successfully saved derivative data. [2025-09-17T22:49:10.575071] [INFO ] [MAIN ] Derivative Progress: 356/2085 symbols completed. CCJ took 1.0s. Estimated remaining: 11m 12s. Rate: 154.4 symbols/min [2025-09-17T22:49:10.576619] [INFO ] [MAIN ] CCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:10.608868] [DEBUG] [MAIN ] CCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:10.611212] [INFO ] [MAIN ] CCK: Generated 1794 derivative records from 46609 primary records. [2025-09-17T22:49:10.610207] [DEBUG] [LOCAL ] CCL: Loaded 53800 existing records from primary storage. [2025-09-17T22:49:10.611563] [INFO ] [MAIN ] CCL: Loaded 53800 primary data records. [2025-09-17T22:49:10.611487] [DEBUG] [LOCAL ] CCK: Saving derivative data. [2025-09-17T22:49:10.789515] [DEBUG] [LOCAL ] CCK: Derivative data saved (1794 records). [2025-09-17T22:49:10.805155] [INFO ] [MAIN ] CCK: Successfully saved derivative data. [2025-09-17T22:49:10.807239] [INFO ] [MAIN ] Derivative Progress: 357/2085 symbols completed. CCK took 1.2s. Estimated remaining: 11m 11s. Rate: 154.6 symbols/min [2025-09-17T22:49:10.811352] [INFO ] [MAIN ] CCRD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:10.967822] [DEBUG] [LOCAL ] CCO: Loaded 47506 existing records from primary storage. [2025-09-17T22:49:10.968168] [INFO ] [MAIN ] CCO: Loaded 47506 primary data records. [2025-09-17T22:49:11.058770] [DEBUG] [LOCAL ] CCRD: Loaded 8924 existing records from primary storage. [2025-09-17T22:49:11.088829] [INFO ] [MAIN ] CCRD: Loaded 8924 primary data records. [2025-09-17T22:49:11.663451] [DEBUG] [MAIN ] CCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:11.664522] [INFO ] [MAIN ] CCL: Generated 1794 derivative records from 53800 primary records. [2025-09-17T22:49:11.664703] [DEBUG] [LOCAL ] CCL: Saving derivative data. [2025-09-17T22:49:11.687880] [DEBUG] [LOCAL ] CCL: Derivative data saved (1794 records). [2025-09-17T22:49:11.688447] [INFO ] [MAIN ] CCL: Successfully saved derivative data. [2025-09-17T22:49:11.691270] [INFO ] [MAIN ] Derivative Progress: 358/2085 symbols completed. CCL took 1.4s. Estimated remaining: 11m 13s. Rate: 154.0 symbols/min [2025-09-17T22:49:11.704504] [DEBUG] [MAIN ] CCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:11.705229] [INFO ] [MAIN ] CCO: Generated 1794 derivative records from 47506 primary records. [2025-09-17T22:49:11.705410] [DEBUG] [LOCAL ] CCO: Saving derivative data. [2025-09-17T22:49:11.722210] [DEBUG] [LOCAL ] CCO: Derivative data saved (1794 records). [2025-09-17T22:49:11.722342] [INFO ] [MAIN ] CCO: Successfully saved derivative data. [2025-09-17T22:49:11.724404] [INFO ] [MAIN ] Derivative Progress: 359/2085 symbols completed. CCO took 1.1s. Estimated remaining: 11m 11s. Rate: 154.4 symbols/min [2025-09-17T22:49:11.739932] [DEBUG] [MAIN ] CCRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:11.740531] [INFO ] [MAIN ] CCRD: Generated 1794 derivative records from 8924 primary records. [2025-09-17T22:49:11.740594] [DEBUG] [LOCAL ] CCRD: Saving derivative data. [2025-09-17T22:49:11.756792] [DEBUG] [LOCAL ] CCRD: Derivative data saved (1794 records). [2025-09-17T22:49:11.756921] [INFO ] [MAIN ] CCRD: Successfully saved derivative data. [2025-09-17T22:49:11.760064] [INFO ] [MAIN ] Derivative Progress: 360/2085 symbols completed. CCRD took 1.0s. Estimated remaining: 11m 9s. Rate: 154.8 symbols/min [2025-09-17T22:49:11.760994] [INFO ] [MAIN ] CCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:11.760806] [INFO ] [MAIN ] CCU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:11.761225] [INFO ] [MAIN ] CDLR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:11.775400] [DEBUG] [LOCAL ] CDLR: Loaded 10281 existing records from primary storage. [2025-09-17T22:49:11.775537] [INFO ] [MAIN ] CDLR: Loaded 10281 primary data records. [2025-09-17T22:49:11.917384] [DEBUG] [LOCAL ] CCU: Loaded 24062 existing records from primary storage. [2025-09-17T22:49:11.995871] [DEBUG] [LOCAL ] CCS: Loaded 30629 existing records from primary storage. [2025-09-17T22:49:11.977870] [INFO ] [MAIN ] CCU: Loaded 24062 primary data records. [2025-09-17T22:49:12.002082] [INFO ] [MAIN ] CCS: Loaded 30629 primary data records. [2025-09-17T22:49:12.763995] [DEBUG] [MAIN ] CDLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:12.765190] [INFO ] [MAIN ] CDLR: Generated 1794 derivative records from 10281 primary records. [2025-09-17T22:49:12.765359] [DEBUG] [LOCAL ] CDLR: Saving derivative data. [2025-09-17T22:49:12.787438] [DEBUG] [LOCAL ] CDLR: Derivative data saved (1794 records). [2025-09-17T22:49:12.788019] [INFO ] [MAIN ] CDLR: Successfully saved derivative data. [2025-09-17T22:49:12.790449] [INFO ] [MAIN ] Derivative Progress: 361/2085 symbols completed. CDLR took 1.0s. Estimated remaining: 11m 11s. Rate: 154.1 symbols/min [2025-09-17T22:49:12.803557] [DEBUG] [MAIN ] CCU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:12.804305] [INFO ] [MAIN ] CCU: Generated 1794 derivative records from 24062 primary records. [2025-09-17T22:49:12.803130] [INFO ] [MAIN ] CDRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:12.804677] [DEBUG] [LOCAL ] CCU: Saving derivative data. [2025-09-17T22:49:12.823675] [DEBUG] [LOCAL ] CCU: Derivative data saved (1794 records). [2025-09-17T22:49:12.824577] [INFO ] [MAIN ] CCU: Successfully saved derivative data. [2025-09-17T22:49:12.826709] [INFO ] [MAIN ] Derivative Progress: 362/2085 symbols completed. CCU took 1.1s. Estimated remaining: 11m 9s. Rate: 154.5 symbols/min [2025-09-17T22:49:12.827167] [INFO ] [MAIN ] CEE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:12.840088] [DEBUG] [MAIN ] CCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:12.840835] [INFO ] [MAIN ] CCS: Generated 1794 derivative records from 30629 primary records. [2025-09-17T22:49:12.841064] [DEBUG] [LOCAL ] CCS: Saving derivative data. [2025-09-17T22:49:12.869453] [DEBUG] [LOCAL ] CCS: Derivative data saved (1794 records). [2025-09-17T22:49:12.880189] [INFO ] [MAIN ] CCS: Successfully saved derivative data. [2025-09-17T22:49:12.880454] [DEBUG] [LOCAL ] CEE: Loaded 7025 existing records from primary storage. [2025-09-17T22:49:12.880940] [DEBUG] [LOCAL ] CDRE: Loaded 25156 existing records from primary storage. [2025-09-17T22:49:12.881063] [INFO ] [MAIN ] CDRE: Loaded 25156 primary data records. [2025-09-17T22:49:12.884056] [INFO ] [MAIN ] Derivative Progress: 363/2085 symbols completed. CCS took 1.1s. Estimated remaining: 11m 7s. Rate: 154.8 symbols/min [2025-09-17T22:49:12.881131] [INFO ] [MAIN ] CEE: Loaded 7025 primary data records. [2025-09-17T22:49:12.884515] [INFO ] [MAIN ] CEPU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:13.450490] [DEBUG] [LOCAL ] CEPU: Loaded 25568 existing records from primary storage. [2025-09-17T22:49:13.540588] [INFO ] [MAIN ] CEPU: Loaded 25568 primary data records. [2025-09-17T22:49:13.885161] [DEBUG] [MAIN ] CEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:13.885632] [DEBUG] [MAIN ] CDRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:13.886360] [INFO ] [MAIN ] CEE: Generated 1794 derivative records from 7025 primary records. [2025-09-17T22:49:13.887196] [INFO ] [MAIN ] CDRE: Generated 1794 derivative records from 25156 primary records. [2025-09-17T22:49:13.886546] [DEBUG] [LOCAL ] CEE: Saving derivative data. [2025-09-17T22:49:13.888932] [DEBUG] [LOCAL ] CDRE: Saving derivative data. [2025-09-17T22:49:13.914609] [DEBUG] [LOCAL ] CEE: Derivative data saved (1794 records). [2025-09-17T22:49:13.918942] [DEBUG] [LOCAL ] CDRE: Derivative data saved (1794 records). [2025-09-17T22:49:13.919150] [INFO ] [MAIN ] CDRE: Successfully saved derivative data. [2025-09-17T22:49:13.919332] [INFO ] [MAIN ] CEE: Successfully saved derivative data. [2025-09-17T22:49:13.921771] [INFO ] [MAIN ] Derivative Progress: 364/2085 symbols completed. CEE took 1.1s. Estimated remaining: 11m 10s. Rate: 154.1 symbols/min [2025-09-17T22:49:13.924428] [INFO ] [MAIN ] CF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:13.924857] [INFO ] [MAIN ] Derivative Progress: 365/2085 symbols completed. CDRE took 1.1s. Estimated remaining: 11m 8s. Rate: 154.6 symbols/min [2025-09-17T22:49:13.925232] [INFO ] [MAIN ] CFR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:13.942909] [DEBUG] [MAIN ] CEPU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:13.943729] [INFO ] [MAIN ] CEPU: Generated 1794 derivative records from 25568 primary records. [2025-09-17T22:49:13.943848] [DEBUG] [LOCAL ] CEPU: Saving derivative data. [2025-09-17T22:49:13.964348] [DEBUG] [LOCAL ] CEPU: Derivative data saved (1794 records). [2025-09-17T22:49:13.964622] [INFO ] [MAIN ] CEPU: Successfully saved derivative data. [2025-09-17T22:49:13.966855] [INFO ] [MAIN ] Derivative Progress: 366/2085 symbols completed. CEPU took 1.1s. Estimated remaining: 11m 6s. Rate: 154.9 symbols/min [2025-09-17T22:49:13.967332] [INFO ] [MAIN ] CGAU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:14.003858] [DEBUG] [LOCAL ] CFR: Loaded 33711 existing records from primary storage. [2025-09-17T22:49:14.004160] [INFO ] [MAIN ] CFR: Loaded 33711 primary data records. [2025-09-17T22:49:14.133397] [DEBUG] [LOCAL ] CF: Loaded 52258 existing records from primary storage. [2025-09-17T22:49:14.137183] [INFO ] [MAIN ] CF: Loaded 52258 primary data records. [2025-09-17T22:49:14.314562] [DEBUG] [LOCAL ] CGAU: Loaded 42449 existing records from primary storage. [2025-09-17T22:49:14.453145] [INFO ] [MAIN ] CGAU: Loaded 42449 primary data records. [2025-09-17T22:49:15.023059] [DEBUG] [MAIN ] CFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:15.024095] [INFO ] [MAIN ] CFR: Generated 1794 derivative records from 33711 primary records. [2025-09-17T22:49:15.024229] [DEBUG] [LOCAL ] CFR: Saving derivative data. [2025-09-17T22:49:15.057512] [DEBUG] [MAIN ] CF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:15.059815] [INFO ] [MAIN ] CF: Generated 1794 derivative records from 52258 primary records. [2025-09-17T22:49:15.060008] [DEBUG] [LOCAL ] CF: Saving derivative data. [2025-09-17T22:49:15.059087] [DEBUG] [LOCAL ] CFR: Derivative data saved (1794 records). [2025-09-17T22:49:15.060677] [INFO ] [MAIN ] CFR: Successfully saved derivative data. [2025-09-17T22:49:15.062951] [INFO ] [MAIN ] Derivative Progress: 367/2085 symbols completed. CFR took 1.1s. Estimated remaining: 11m 9s. Rate: 154.2 symbols/min [2025-09-17T22:49:15.063558] [INFO ] [MAIN ] CGV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:15.082949] [DEBUG] [LOCAL ] CF: Derivative data saved (1794 records). [2025-09-17T22:49:15.083226] [INFO ] [MAIN ] CF: Successfully saved derivative data. [2025-09-17T22:49:15.085573] [INFO ] [MAIN ] Derivative Progress: 368/2085 symbols completed. CF took 1.2s. Estimated remaining: 11m 7s. Rate: 154.6 symbols/min [2025-09-17T22:49:15.086009] [INFO ] [MAIN ] CHCT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:15.095960] [DEBUG] [LOCAL ] CGV: Loaded 1429 existing records from primary storage. [2025-09-17T22:49:15.100692] [INFO ] [MAIN ] CGV: Loaded 1429 primary data records. [2025-09-17T22:49:15.113275] [DEBUG] [MAIN ] CGAU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:15.141356] [INFO ] [MAIN ] CGAU: Generated 1794 derivative records from 42449 primary records. [2025-09-17T22:49:15.170589] [DEBUG] [LOCAL ] CGAU: Saving derivative data. [2025-09-17T22:49:15.272994] [DEBUG] [LOCAL ] CGAU: Derivative data saved (1794 records). [2025-09-17T22:49:15.320393] [INFO ] [MAIN ] CGAU: Successfully saved derivative data. [2025-09-17T22:49:15.437600] [DEBUG] [LOCAL ] CHCT: Loaded 24105 existing records from primary storage. [2025-09-17T22:49:15.441196] [INFO ] [MAIN ] Derivative Progress: 369/2085 symbols completed. CGAU took 1.5s. Estimated remaining: 11m 6s. Rate: 154.6 symbols/min [2025-09-17T22:49:15.441808] [INFO ] [MAIN ] CHCT: Loaded 24105 primary data records. [2025-09-17T22:49:15.441908] [INFO ] [MAIN ] CHE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:15.624160] [DEBUG] [LOCAL ] CHE: Loaded 14583 existing records from primary storage. [2025-09-17T22:49:15.644842] [INFO ] [MAIN ] CHE: Loaded 14583 primary data records. [2025-09-17T22:49:16.124795] [DEBUG] [MAIN ] CGV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:49:16.125989] [INFO ] [MAIN ] CGV: Generated 1793 derivative records from 1429 primary records. [2025-09-17T22:49:16.126771] [DEBUG] [LOCAL ] CGV: Saving derivative data. [2025-09-17T22:49:16.147781] [DEBUG] [LOCAL ] CGV: Derivative data saved (1793 records). [2025-09-17T22:49:16.148928] [INFO ] [MAIN ] CGV: Successfully saved derivative data. [2025-09-17T22:49:16.151807] [INFO ] [MAIN ] Derivative Progress: 370/2085 symbols completed. CGV took 1.1s. Estimated remaining: 11m 7s. Rate: 154.2 symbols/min [2025-09-17T22:49:16.152707] [INFO ] [MAIN ] CHH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:16.166870] [DEBUG] [MAIN ] CHCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:16.167593] [INFO ] [MAIN ] CHCT: Generated 1794 derivative records from 24105 primary records. [2025-09-17T22:49:16.167900] [DEBUG] [LOCAL ] CHCT: Saving derivative data. [2025-09-17T22:49:16.186145] [DEBUG] [LOCAL ] CHCT: Derivative data saved (1794 records). [2025-09-17T22:49:16.186811] [INFO ] [MAIN ] CHCT: Successfully saved derivative data. [2025-09-17T22:49:16.189943] [INFO ] [MAIN ] Derivative Progress: 371/2085 symbols completed. CHCT took 1.1s. Estimated remaining: 11m 5s. Rate: 154.6 symbols/min [2025-09-17T22:49:16.190491] [INFO ] [MAIN ] CHMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:16.205300] [DEBUG] [MAIN ] CHE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:16.214394] [INFO ] [MAIN ] CHE: Generated 1794 derivative records from 14583 primary records. [2025-09-17T22:49:16.214596] [DEBUG] [LOCAL ] CHE: Saving derivative data. [2025-09-17T22:49:16.231100] [DEBUG] [LOCAL ] CHE: Derivative data saved (1794 records). [2025-09-17T22:49:16.231810] [INFO ] [MAIN ] CHE: Successfully saved derivative data. [2025-09-17T22:49:16.242739] [INFO ] [MAIN ] Derivative Progress: 372/2085 symbols completed. CHE took 0.8s. Estimated remaining: 11m 3s. Rate: 155.0 symbols/min [2025-09-17T22:49:16.248631] [INFO ] [MAIN ] CHN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:16.249466] [DEBUG] [LOCAL ] CHH: Loaded 32453 existing records from primary storage. [2025-09-17T22:49:16.249750] [INFO ] [MAIN ] CHH: Loaded 32453 primary data records. [2025-09-17T22:49:16.358789] [DEBUG] [LOCAL ] CHMI: Loaded 22064 existing records from primary storage. [2025-09-17T22:49:16.353230] [DEBUG] [LOCAL ] CHN: Loaded 4806 existing records from primary storage. [2025-09-17T22:49:16.364195] [INFO ] [MAIN ] CHMI: Loaded 22064 primary data records. [2025-09-17T22:49:16.371949] [INFO ] [MAIN ] CHN: Loaded 4806 primary data records. [2025-09-17T22:49:17.228049] [DEBUG] [MAIN ] CHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:17.231093] [INFO ] [MAIN ] CHH: Generated 1794 derivative records from 32453 primary records. [2025-09-17T22:49:17.231332] [DEBUG] [LOCAL ] CHH: Saving derivative data. [2025-09-17T22:49:17.245999] [DEBUG] [MAIN ] CHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:17.255331] [INFO ] [MAIN ] CHN: Generated 1794 derivative records from 4806 primary records. [2025-09-17T22:49:17.261276] [DEBUG] [LOCAL ] CHN: Saving derivative data. [2025-09-17T22:49:17.262488] [DEBUG] [LOCAL ] CHH: Derivative data saved (1794 records). [2025-09-17T22:49:17.263358] [INFO ] [MAIN ] CHH: Successfully saved derivative data. [2025-09-17T22:49:17.265952] [INFO ] [MAIN ] Derivative Progress: 373/2085 symbols completed. CHH took 1.1s. Estimated remaining: 11m 6s. Rate: 154.3 symbols/min [2025-09-17T22:49:17.280129] [DEBUG] [LOCAL ] CHN: Derivative data saved (1794 records). [2025-09-17T22:49:17.280394] [INFO ] [MAIN ] CHN: Successfully saved derivative data. [2025-09-17T22:49:17.282749] [INFO ] [MAIN ] Derivative Progress: 374/2085 symbols completed. CHN took 1.0s. Estimated remaining: 11m 4s. Rate: 154.7 symbols/min [2025-09-17T22:49:17.298331] [DEBUG] [MAIN ] CHMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:17.298927] [INFO ] [MAIN ] CHMI: Generated 1794 derivative records from 22064 primary records. [2025-09-17T22:49:17.298991] [DEBUG] [LOCAL ] CHMI: Saving derivative data. [2025-09-17T22:49:17.313881] [DEBUG] [LOCAL ] CHMI: Derivative data saved (1794 records). [2025-09-17T22:49:17.313938] [INFO ] [MAIN ] CHMI: Successfully saved derivative data. [2025-09-17T22:49:17.316442] [INFO ] [MAIN ] Derivative Progress: 375/2085 symbols completed. CHMI took 1.1s. Estimated remaining: 11m 2s. Rate: 155.1 symbols/min [2025-09-17T22:49:17.317168] [INFO ] [MAIN ] CHT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:17.317285] [INFO ] [MAIN ] CI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:17.317130] [INFO ] [MAIN ] CHWY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:17.339035] [DEBUG] [LOCAL ] CHT: Loaded 19812 existing records from primary storage. [2025-09-17T22:49:17.339316] [INFO ] [MAIN ] CHT: Loaded 19812 primary data records. [2025-09-17T22:49:17.745819] [DEBUG] [LOCAL ] CHWY: Loaded 53626 existing records from primary storage. [2025-09-17T22:49:17.755160] [INFO ] [MAIN ] CHWY: Loaded 53626 primary data records. [2025-09-17T22:49:17.767822] [DEBUG] [LOCAL ] CI: Loaded 50011 existing records from primary storage. [2025-09-17T22:49:17.802695] [INFO ] [MAIN ] CI: Loaded 50011 primary data records. [2025-09-17T22:49:18.405175] [DEBUG] [MAIN ] CHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:18.406247] [INFO ] [MAIN ] CHT: Generated 1794 derivative records from 19812 primary records. [2025-09-17T22:49:18.406342] [DEBUG] [LOCAL ] CHT: Saving derivative data. [2025-09-17T22:49:18.423959] [DEBUG] [LOCAL ] CHT: Derivative data saved (1794 records). [2025-09-17T22:49:18.424908] [INFO ] [MAIN ] CHT: Successfully saved derivative data. [2025-09-17T22:49:18.427338] [INFO ] [MAIN ] Derivative Progress: 376/2085 symbols completed. CHT took 1.1s. Estimated remaining: 11m 5s. Rate: 154.3 symbols/min [2025-09-17T22:49:18.427879] [INFO ] [MAIN ] CIA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:18.451775] [DEBUG] [MAIN ] CHWY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:18.452765] [INFO ] [MAIN ] CHWY: Generated 1794 derivative records from 53626 primary records. [2025-09-17T22:49:18.453032] [DEBUG] [LOCAL ] CHWY: Saving derivative data. [2025-09-17T22:49:18.480276] [DEBUG] [LOCAL ] CHWY: Derivative data saved (1794 records). [2025-09-17T22:49:18.480427] [INFO ] [MAIN ] CHWY: Successfully saved derivative data. [2025-09-17T22:49:18.478931] [DEBUG] [LOCAL ] CIA: Loaded 16809 existing records from primary storage. [2025-09-17T22:49:18.489988] [INFO ] [MAIN ] Derivative Progress: 377/2085 symbols completed. CHWY took 1.2s. Estimated remaining: 11m 3s. Rate: 154.7 symbols/min [2025-09-17T22:49:18.494686] [INFO ] [MAIN ] CIA: Loaded 16809 primary data records. [2025-09-17T22:49:18.501080] [INFO ] [MAIN ] CIB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:18.501015] [DEBUG] [MAIN ] CI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:18.520953] [INFO ] [MAIN ] CI: Generated 1794 derivative records from 50011 primary records. [2025-09-17T22:49:18.538671] [DEBUG] [LOCAL ] CI: Saving derivative data. [2025-09-17T22:49:18.631712] [DEBUG] [LOCAL ] CI: Derivative data saved (1794 records). [2025-09-17T22:49:18.631882] [INFO ] [MAIN ] CI: Successfully saved derivative data. [2025-09-17T22:49:18.634671] [INFO ] [MAIN ] Derivative Progress: 378/2085 symbols completed. CI took 1.3s. Estimated remaining: 11m 1s. Rate: 154.9 symbols/min [2025-09-17T22:49:18.635378] [INFO ] [MAIN ] CIEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:18.851829] [DEBUG] [LOCAL ] CIB: Loaded 31166 existing records from primary storage. [2025-09-17T22:49:18.852673] [INFO ] [MAIN ] CIB: Loaded 31166 primary data records. [2025-09-17T22:49:19.198142] [DEBUG] [LOCAL ] CIEN: Loaded 52111 existing records from primary storage. [2025-09-17T22:49:19.198719] [INFO ] [MAIN ] CIEN: Loaded 52111 primary data records. [2025-09-17T22:49:19.367481] [DEBUG] [MAIN ] CIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:19.389208] [INFO ] [MAIN ] CIA: Generated 1794 derivative records from 16809 primary records. [2025-09-17T22:49:19.417673] [DEBUG] [LOCAL ] CIA: Saving derivative data. [2025-09-17T22:49:19.624356] [DEBUG] [LOCAL ] CIA: Derivative data saved (1794 records). [2025-09-17T22:49:19.624749] [INFO ] [MAIN ] CIA: Successfully saved derivative data. [2025-09-17T22:49:19.627281] [INFO ] [MAIN ] Derivative Progress: 379/2085 symbols completed. CIA took 1.2s. Estimated remaining: 11m 4s. Rate: 154.3 symbols/min [2025-09-17T22:49:19.628829] [INFO ] [MAIN ] CIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:19.646541] [DEBUG] [MAIN ] CIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:19.647821] [INFO ] [MAIN ] CIB: Generated 1794 derivative records from 31166 primary records. [2025-09-17T22:49:19.648625] [DEBUG] [LOCAL ] CIB: Saving derivative data. [2025-09-17T22:49:19.665926] [DEBUG] [LOCAL ] CIB: Derivative data saved (1794 records). [2025-09-17T22:49:19.666132] [INFO ] [MAIN ] CIB: Successfully saved derivative data. [2025-09-17T22:49:19.669943] [INFO ] [MAIN ] Derivative Progress: 380/2085 symbols completed. CIB took 1.2s. Estimated remaining: 11m 2s. Rate: 154.6 symbols/min [2025-09-17T22:49:19.670526] [INFO ] [MAIN ] CII: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:19.688883] [DEBUG] [MAIN ] CIEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:19.689866] [INFO ] [MAIN ] CIEN: Generated 1794 derivative records from 52111 primary records. [2025-09-17T22:49:19.690008] [DEBUG] [LOCAL ] CIEN: Saving derivative data. [2025-09-17T22:49:19.727219] [DEBUG] [LOCAL ] CII: Loaded 15798 existing records from primary storage. [2025-09-17T22:49:19.727885] [INFO ] [MAIN ] CII: Loaded 15798 primary data records. [2025-09-17T22:49:19.774286] [DEBUG] [LOCAL ] CIEN: Derivative data saved (1794 records). [2025-09-17T22:49:19.801967] [INFO ] [MAIN ] CIEN: Successfully saved derivative data. [2025-09-17T22:49:19.829821] [INFO ] [MAIN ] Derivative Progress: 381/2085 symbols completed. CIEN took 1.2s. Estimated remaining: 11m 0s. Rate: 154.9 symbols/min [2025-09-17T22:49:19.853771] [INFO ] [MAIN ] CIMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:19.855223] [DEBUG] [LOCAL ] CIG: Loaded 43706 existing records from primary storage. [2025-09-17T22:49:19.855378] [INFO ] [MAIN ] CIG: Loaded 43706 primary data records. [2025-09-17T22:49:20.159211] [DEBUG] [LOCAL ] CIMN: Loaded 2658 existing records from primary storage. [2025-09-17T22:49:20.184609] [INFO ] [MAIN ] CIMN: Loaded 2658 primary data records. [2025-09-17T22:49:20.708594] [DEBUG] [MAIN ] CII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:20.709573] [INFO ] [MAIN ] CII: Generated 1794 derivative records from 15798 primary records. [2025-09-17T22:49:20.711023] [DEBUG] [LOCAL ] CII: Saving derivative data. [2025-09-17T22:49:20.728134] [DEBUG] [LOCAL ] CII: Derivative data saved (1794 records). [2025-09-17T22:49:20.728677] [INFO ] [MAIN ] CII: Successfully saved derivative data. [2025-09-17T22:49:20.730602] [INFO ] [MAIN ] Derivative Progress: 382/2085 symbols completed. CII took 1.1s. Estimated remaining: 11m 2s. Rate: 154.3 symbols/min [2025-09-17T22:49:20.731564] [INFO ] [MAIN ] CINT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:20.756296] [DEBUG] [MAIN ] CIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:20.761712] [INFO ] [MAIN ] CIG: Generated 1794 derivative records from 43706 primary records. [2025-09-17T22:49:20.761993] [DEBUG] [MAIN ] CIMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:20.762687] [INFO ] [MAIN ] CIMN: Generated 1794 derivative records from 2658 primary records. [2025-09-17T22:49:20.762103] [DEBUG] [LOCAL ] CIG: Saving derivative data. [2025-09-17T22:49:20.762807] [DEBUG] [LOCAL ] CIMN: Saving derivative data. [2025-09-17T22:49:20.792939] [DEBUG] [LOCAL ] CIG: Derivative data saved (1794 records). [2025-09-17T22:49:20.796590] [DEBUG] [LOCAL ] CIMN: Derivative data saved (1794 records). [2025-09-17T22:49:20.796753] [INFO ] [MAIN ] CIG: Successfully saved derivative data. [2025-09-17T22:49:20.798997] [INFO ] [MAIN ] Derivative Progress: 383/2085 symbols completed. CIG took 1.2s. Estimated remaining: 11m 0s. Rate: 154.7 symbols/min [2025-09-17T22:49:20.796836] [INFO ] [MAIN ] CIMN: Successfully saved derivative data. [2025-09-17T22:49:20.802008] [INFO ] [MAIN ] Derivative Progress: 384/2085 symbols completed. CIMN took 0.9s. Estimated remaining: 10m 58s. Rate: 155.1 symbols/min [2025-09-17T22:49:20.802089] [INFO ] [MAIN ] CIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:20.802243] [INFO ] [MAIN ] CION: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:20.809448] [DEBUG] [LOCAL ] CINT: Loaded 18038 existing records from primary storage. [2025-09-17T22:49:20.810031] [INFO ] [MAIN ] CINT: Loaded 18038 primary data records. [2025-09-17T22:49:20.961013] [DEBUG] [LOCAL ] CIO: Loaded 19929 existing records from primary storage. [2025-09-17T22:49:21.011857] [INFO ] [MAIN ] CIO: Loaded 19929 primary data records. [2025-09-17T22:49:21.191720] [DEBUG] [LOCAL ] CION: Loaded 29296 existing records from primary storage. [2025-09-17T22:49:21.213311] [INFO ] [MAIN ] CION: Loaded 29296 primary data records. [2025-09-17T22:49:21.834036] [DEBUG] [MAIN ] CINT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:21.835336] [INFO ] [MAIN ] CINT: Generated 1794 derivative records from 18038 primary records. [2025-09-17T22:49:21.835686] [DEBUG] [LOCAL ] CINT: Saving derivative data. [2025-09-17T22:49:21.853133] [DEBUG] [LOCAL ] CINT: Derivative data saved (1794 records). [2025-09-17T22:49:21.853506] [INFO ] [MAIN ] CINT: Successfully saved derivative data. [2025-09-17T22:49:21.856615] [INFO ] [MAIN ] Derivative Progress: 385/2085 symbols completed. CINT took 1.1s. Estimated remaining: 11m 1s. Rate: 154.4 symbols/min [2025-09-17T22:49:21.858571] [INFO ] [MAIN ] CIVI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:21.872247] [DEBUG] [MAIN ] CIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:21.873151] [INFO ] [MAIN ] CIO: Generated 1794 derivative records from 19929 primary records. [2025-09-17T22:49:21.873360] [DEBUG] [LOCAL ] CIO: Saving derivative data. [2025-09-17T22:49:21.889817] [DEBUG] [LOCAL ] CIO: Derivative data saved (1794 records). [2025-09-17T22:49:21.891516] [INFO ] [MAIN ] CIO: Successfully saved derivative data. [2025-09-17T22:49:21.893740] [INFO ] [MAIN ] Derivative Progress: 386/2085 symbols completed. CIO took 1.1s. Estimated remaining: 10m 59s. Rate: 154.7 symbols/min [2025-09-17T22:49:21.894043] [INFO ] [MAIN ] CL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:21.907900] [DEBUG] [MAIN ] CION: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:21.908728] [INFO ] [MAIN ] CION: Generated 1794 derivative records from 29296 primary records. [2025-09-17T22:49:21.908837] [DEBUG] [LOCAL ] CION: Saving derivative data. [2025-09-17T22:49:21.926788] [DEBUG] [LOCAL ] CION: Derivative data saved (1794 records). [2025-09-17T22:49:21.927011] [INFO ] [MAIN ] CION: Successfully saved derivative data. [2025-09-17T22:49:21.930006] [INFO ] [MAIN ] Derivative Progress: 387/2085 symbols completed. CION took 1.1s. Estimated remaining: 10m 57s. Rate: 155.1 symbols/min [2025-09-17T22:49:21.930282] [INFO ] [MAIN ] CLB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:21.980118] [DEBUG] [LOCAL ] CIVI: Loaded 52586 existing records from primary storage. [2025-09-17T22:49:21.980488] [INFO ] [MAIN ] CIVI: Loaded 52586 primary data records. [2025-09-17T22:49:22.120462] [DEBUG] [LOCAL ] CL: Loaded 53644 existing records from primary storage. [2025-09-17T22:49:22.124823] [INFO ] [MAIN ] CL: Loaded 53644 primary data records. [2025-09-17T22:49:22.326138] [DEBUG] [LOCAL ] CLB: Loaded 33294 existing records from primary storage. [2025-09-17T22:49:22.451169] [INFO ] [MAIN ] CLB: Loaded 33294 primary data records. [2025-09-17T22:49:23.030986] [DEBUG] [MAIN ] CIVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:23.031906] [INFO ] [MAIN ] CIVI: Generated 1794 derivative records from 52586 primary records. [2025-09-17T22:49:23.032308] [DEBUG] [LOCAL ] CIVI: Saving derivative data. [2025-09-17T22:49:23.052627] [DEBUG] [LOCAL ] CIVI: Derivative data saved (1794 records). [2025-09-17T22:49:23.065844] [INFO ] [MAIN ] CIVI: Successfully saved derivative data. [2025-09-17T22:49:23.068541] [INFO ] [MAIN ] Derivative Progress: 388/2085 symbols completed. CIVI took 1.2s. Estimated remaining: 10m 60s. Rate: 154.3 symbols/min [2025-09-17T22:49:23.069042] [DEBUG] [MAIN ] CL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:23.070196] [INFO ] [MAIN ] CL: Generated 1794 derivative records from 53644 primary records. [2025-09-17T22:49:23.070297] [DEBUG] [LOCAL ] CL: Saving derivative data. [2025-09-17T22:49:23.087871] [DEBUG] [LOCAL ] CL: Derivative data saved (1794 records). [2025-09-17T22:49:23.088188] [INFO ] [MAIN ] CL: Successfully saved derivative data. [2025-09-17T22:49:23.091487] [INFO ] [MAIN ] Derivative Progress: 389/2085 symbols completed. CL took 1.2s. Estimated remaining: 10m 58s. Rate: 154.7 symbols/min [2025-09-17T22:49:23.105569] [DEBUG] [MAIN ] CLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:23.106185] [INFO ] [MAIN ] CLB: Generated 1794 derivative records from 33294 primary records. [2025-09-17T22:49:23.106248] [DEBUG] [LOCAL ] CLB: Saving derivative data. [2025-09-17T22:49:23.121658] [DEBUG] [LOCAL ] CLB: Derivative data saved (1794 records). [2025-09-17T22:49:23.121731] [INFO ] [MAIN ] CLB: Successfully saved derivative data. [2025-09-17T22:49:23.124022] [INFO ] [MAIN ] Derivative Progress: 390/2085 symbols completed. CLB took 1.2s. Estimated remaining: 10m 56s. Rate: 155.1 symbols/min [2025-09-17T22:49:23.124799] [INFO ] [MAIN ] CLF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:23.124716] [INFO ] [MAIN ] CLDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:23.125002] [INFO ] [MAIN ] CLCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:23.140347] [DEBUG] [LOCAL ] CLCO: Loaded 13549 existing records from primary storage. [2025-09-17T22:49:23.140474] [INFO ] [MAIN ] CLCO: Loaded 13549 primary data records. [2025-09-17T22:49:23.473149] [DEBUG] [LOCAL ] CLDT: Loaded 26202 existing records from primary storage. [2025-09-17T22:49:23.473684] [INFO ] [MAIN ] CLDT: Loaded 26202 primary data records. [2025-09-17T22:49:23.605344] [DEBUG] [LOCAL ] CLF: Loaded 53741 existing records from primary storage. [2025-09-17T22:49:23.609704] [INFO ] [MAIN ] CLF: Loaded 53741 primary data records. [2025-09-17T22:49:24.212595] [DEBUG] [MAIN ] CLCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:24.214926] [INFO ] [MAIN ] CLCO: Generated 1794 derivative records from 13549 primary records. [2025-09-17T22:49:24.215138] [DEBUG] [LOCAL ] CLCO: Saving derivative data. [2025-09-17T22:49:24.231560] [DEBUG] [LOCAL ] CLCO: Derivative data saved (1794 records). [2025-09-17T22:49:24.233056] [INFO ] [MAIN ] CLCO: Successfully saved derivative data. [2025-09-17T22:49:24.235785] [INFO ] [MAIN ] Derivative Progress: 391/2085 symbols completed. CLCO took 1.1s. Estimated remaining: 10m 59s. Rate: 154.3 symbols/min [2025-09-17T22:49:24.236581] [INFO ] [MAIN ] CLH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:24.256618] [DEBUG] [MAIN ] CLDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:24.257584] [INFO ] [MAIN ] CLDT: Generated 1794 derivative records from 26202 primary records. [2025-09-17T22:49:24.258686] [DEBUG] [LOCAL ] CLDT: Saving derivative data. [2025-09-17T22:49:24.298248] [DEBUG] [MAIN ] CLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:24.302313] [DEBUG] [LOCAL ] CLDT: Derivative data saved (1794 records). [2025-09-17T22:49:24.303342] [INFO ] [MAIN ] CLF: Generated 1794 derivative records from 53741 primary records. [2025-09-17T22:49:24.303712] [INFO ] [MAIN ] CLDT: Successfully saved derivative data. [2025-09-17T22:49:24.303612] [DEBUG] [LOCAL ] CLF: Saving derivative data. [2025-09-17T22:49:24.306051] [INFO ] [MAIN ] Derivative Progress: 392/2085 symbols completed. CLDT took 1.2s. Estimated remaining: 10m 57s. Rate: 154.7 symbols/min [2025-09-17T22:49:24.307459] [INFO ] [MAIN ] CLPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:24.332711] [DEBUG] [LOCAL ] CLF: Derivative data saved (1794 records). [2025-09-17T22:49:24.332841] [INFO ] [MAIN ] CLF: Successfully saved derivative data. [2025-09-17T22:49:24.336407] [INFO ] [MAIN ] Derivative Progress: 393/2085 symbols completed. CLF took 1.2s. Estimated remaining: 10m 55s. Rate: 155.0 symbols/min [2025-09-17T22:49:24.333418] [DEBUG] [LOCAL ] CLH: Loaded 28629 existing records from primary storage. [2025-09-17T22:49:24.336892] [INFO ] [MAIN ] CLH: Loaded 28629 primary data records. [2025-09-17T22:49:24.336973] [INFO ] [MAIN ] CLS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:24.460333] [DEBUG] [LOCAL ] CLPR: Loaded 11669 existing records from primary storage. [2025-09-17T22:49:24.464728] [INFO ] [MAIN ] CLPR: Loaded 11669 primary data records. [2025-09-17T22:49:25.076426] [DEBUG] [LOCAL ] CLS: Loaded 53646 existing records from primary storage. [2025-09-17T22:49:25.076846] [INFO ] [MAIN ] CLS: Loaded 53646 primary data records. [2025-09-17T22:49:25.416966] [DEBUG] [MAIN ] CLH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:25.417986] [INFO ] [MAIN ] CLH: Generated 1794 derivative records from 28629 primary records. [2025-09-17T22:49:25.418110] [DEBUG] [LOCAL ] CLH: Saving derivative data. [2025-09-17T22:49:25.448867] [DEBUG] [LOCAL ] CLH: Derivative data saved (1794 records). [2025-09-17T22:49:25.449222] [INFO ] [MAIN ] CLH: Successfully saved derivative data. [2025-09-17T22:49:25.444239] [DEBUG] [MAIN ] CLPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:25.452772] [INFO ] [MAIN ] Derivative Progress: 394/2085 symbols completed. CLH took 1.2s. Estimated remaining: 10m 58s. Rate: 154.3 symbols/min [2025-09-17T22:49:25.453310] [INFO ] [MAIN ] CLVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:25.450493] [INFO ] [MAIN ] CLPR: Generated 1794 derivative records from 11669 primary records. [2025-09-17T22:49:25.453677] [DEBUG] [LOCAL ] CLPR: Saving derivative data. [2025-09-17T22:49:25.474203] [DEBUG] [LOCAL ] CLPR: Derivative data saved (1794 records). [2025-09-17T22:49:25.474489] [INFO ] [MAIN ] CLPR: Successfully saved derivative data. [2025-09-17T22:49:25.477248] [INFO ] [MAIN ] Derivative Progress: 395/2085 symbols completed. CLPR took 1.2s. Estimated remaining: 10m 56s. Rate: 154.6 symbols/min [2025-09-17T22:49:25.477668] [INFO ] [MAIN ] CLW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:25.497741] [DEBUG] [MAIN ] CLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:25.517004] [INFO ] [MAIN ] CLS: Generated 1794 derivative records from 53646 primary records. [2025-09-17T22:49:25.517267] [DEBUG] [LOCAL ] CLS: Saving derivative data. [2025-09-17T22:49:25.542460] [DEBUG] [LOCAL ] CLS: Derivative data saved (1794 records). [2025-09-17T22:49:25.537957] [DEBUG] [LOCAL ] CLW: Loaded 22071 existing records from primary storage. [2025-09-17T22:49:25.542634] [INFO ] [MAIN ] CLS: Successfully saved derivative data. [2025-09-17T22:49:25.543314] [INFO ] [MAIN ] CLW: Loaded 22071 primary data records. [2025-09-17T22:49:25.545959] [INFO ] [MAIN ] Derivative Progress: 396/2085 symbols completed. CLS took 1.2s. Estimated remaining: 10m 54s. Rate: 155.0 symbols/min [2025-09-17T22:49:25.580209] [INFO ] [MAIN ] CLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:25.678099] [DEBUG] [LOCAL ] CLVT: Loaded 52026 existing records from primary storage. [2025-09-17T22:49:25.684038] [INFO ] [MAIN ] CLVT: Loaded 52026 primary data records. [2025-09-17T22:49:26.258353] [DEBUG] [LOCAL ] CLX: Loaded 51407 existing records from primary storage. [2025-09-17T22:49:26.258898] [INFO ] [MAIN ] CLX: Loaded 51407 primary data records. [2025-09-17T22:49:26.440419] [DEBUG] [MAIN ] CLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:26.462882] [INFO ] [MAIN ] CLW: Generated 1794 derivative records from 22071 primary records. [2025-09-17T22:49:26.499826] [DEBUG] [LOCAL ] CLW: Saving derivative data. [2025-09-17T22:49:26.649965] [DEBUG] [LOCAL ] CLW: Derivative data saved (1794 records). [2025-09-17T22:49:26.650834] [INFO ] [MAIN ] CLW: Successfully saved derivative data. [2025-09-17T22:49:26.653137] [INFO ] [MAIN ] Derivative Progress: 397/2085 symbols completed. CLW took 1.2s. Estimated remaining: 10m 57s. Rate: 154.2 symbols/min [2025-09-17T22:49:26.653890] [INFO ] [MAIN ] CM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:26.670943] [DEBUG] [MAIN ] CLVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:26.672320] [INFO ] [MAIN ] CLVT: Generated 1794 derivative records from 52026 primary records. [2025-09-17T22:49:26.672453] [DEBUG] [LOCAL ] CLVT: Saving derivative data. [2025-09-17T22:49:26.692352] [DEBUG] [LOCAL ] CLVT: Derivative data saved (1794 records). [2025-09-17T22:49:26.692881] [INFO ] [MAIN ] CLVT: Successfully saved derivative data. [2025-09-17T22:49:26.696026] [INFO ] [MAIN ] Derivative Progress: 398/2085 symbols completed. CLVT took 1.2s. Estimated remaining: 10m 55s. Rate: 154.6 symbols/min [2025-09-17T22:49:26.697058] [INFO ] [MAIN ] CMA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:26.717017] [DEBUG] [MAIN ] CLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:26.717885] [INFO ] [MAIN ] CLX: Generated 1794 derivative records from 51407 primary records. [2025-09-17T22:49:26.718049] [DEBUG] [LOCAL ] CLX: Saving derivative data. [2025-09-17T22:49:26.748696] [DEBUG] [LOCAL ] CLX: Derivative data saved (1794 records). [2025-09-17T22:49:26.749889] [INFO ] [MAIN ] CLX: Successfully saved derivative data. [2025-09-17T22:49:26.764562] [INFO ] [MAIN ] Derivative Progress: 399/2085 symbols completed. CLX took 1.2s. Estimated remaining: 10m 53s. Rate: 154.9 symbols/min [2025-09-17T22:49:26.766231] [INFO ] [MAIN ] CMBT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:26.767120] [DEBUG] [LOCAL ] CM: Loaded 48663 existing records from primary storage. [2025-09-17T22:49:26.767716] [INFO ] [MAIN ] CM: Loaded 48663 primary data records. [2025-09-17T22:49:26.989268] [DEBUG] [LOCAL ] CMA: Loaded 50303 existing records from primary storage. [2025-09-17T22:49:26.989715] [DEBUG] [LOCAL ] CMBT: Loaded 21060 existing records from primary storage. [2025-09-17T22:49:26.995341] [INFO ] [MAIN ] CMBT: Loaded 21060 primary data records. [2025-09-17T22:49:26.995238] [INFO ] [MAIN ] CMA: Loaded 50303 primary data records. [2025-09-17T22:49:27.835099] [DEBUG] [MAIN ] CM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:27.836342] [INFO ] [MAIN ] CM: Generated 1794 derivative records from 48663 primary records. [2025-09-17T22:49:27.836734] [DEBUG] [LOCAL ] CM: Saving derivative data. [2025-09-17T22:49:27.859084] [DEBUG] [LOCAL ] CM: Derivative data saved (1794 records). [2025-09-17T22:49:27.859675] [INFO ] [MAIN ] CM: Successfully saved derivative data. [2025-09-17T22:49:27.861976] [INFO ] [MAIN ] Derivative Progress: 400/2085 symbols completed. CM took 1.2s. Estimated remaining: 10m 56s. Rate: 154.2 symbols/min [2025-09-17T22:49:27.874819] [INFO ] [MAIN ] CMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:27.875149] [DEBUG] [MAIN ] CMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:27.876513] [INFO ] [MAIN ] CMA: Generated 1794 derivative records from 50303 primary records. [2025-09-17T22:49:27.876943] [DEBUG] [LOCAL ] CMA: Saving derivative data. [2025-09-17T22:49:27.894117] [DEBUG] [LOCAL ] CMA: Derivative data saved (1794 records). [2025-09-17T22:49:27.894346] [INFO ] [MAIN ] CMA: Successfully saved derivative data. [2025-09-17T22:49:27.896926] [INFO ] [MAIN ] Derivative Progress: 401/2085 symbols completed. CMA took 1.2s. Estimated remaining: 10m 54s. Rate: 154.6 symbols/min [2025-09-17T22:49:27.898406] [INFO ] [MAIN ] CMCM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:27.914934] [DEBUG] [MAIN ] CMBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:27.916003] [INFO ] [MAIN ] CMBT: Generated 1794 derivative records from 21060 primary records. [2025-09-17T22:49:27.916237] [DEBUG] [LOCAL ] CMBT: Saving derivative data. [2025-09-17T22:49:27.920073] [DEBUG] [LOCAL ] CMCM: Loaded 4637 existing records from primary storage. [2025-09-17T22:49:27.920227] [INFO ] [MAIN ] CMCM: Loaded 4637 primary data records. [2025-09-17T22:49:28.020199] [DEBUG] [LOCAL ] CMBT: Derivative data saved (1794 records). [2025-09-17T22:49:28.032252] [INFO ] [MAIN ] CMBT: Successfully saved derivative data. [2025-09-17T22:49:28.058456] [INFO ] [MAIN ] Derivative Progress: 402/2085 symbols completed. CMBT took 1.3s. Estimated remaining: 10m 52s. Rate: 154.8 symbols/min [2025-09-17T22:49:28.076999] [INFO ] [MAIN ] CMG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:28.083005] [DEBUG] [LOCAL ] CMC: Loaded 45786 existing records from primary storage. [2025-09-17T22:49:28.099116] [INFO ] [MAIN ] CMC: Loaded 45786 primary data records. [2025-09-17T22:49:28.643243] [DEBUG] [LOCAL ] CMG: Loaded 53720 existing records from primary storage. [2025-09-17T22:49:28.644451] [INFO ] [MAIN ] CMG: Loaded 53720 primary data records. [2025-09-17T22:49:28.816485] [DEBUG] [MAIN ] CMCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:28.847806] [INFO ] [MAIN ] CMCM: Generated 1794 derivative records from 4637 primary records. [2025-09-17T22:49:28.968826] [DEBUG] [LOCAL ] CMCM: Saving derivative data. [2025-09-17T22:49:28.995763] [DEBUG] [MAIN ] CMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:29.001206] [INFO ] [MAIN ] CMC: Generated 1794 derivative records from 45786 primary records. [2025-09-17T22:49:29.005730] [DEBUG] [LOCAL ] CMC: Saving derivative data. [2025-09-17T22:49:29.005625] [DEBUG] [LOCAL ] CMCM: Derivative data saved (1794 records). [2025-09-17T22:49:29.006863] [INFO ] [MAIN ] CMCM: Successfully saved derivative data. [2025-09-17T22:49:29.009365] [INFO ] [MAIN ] Derivative Progress: 403/2085 symbols completed. CMCM took 1.1s. Estimated remaining: 10m 54s. Rate: 154.2 symbols/min [2025-09-17T22:49:29.027442] [DEBUG] [LOCAL ] CMC: Derivative data saved (1794 records). [2025-09-17T22:49:29.027811] [INFO ] [MAIN ] CMC: Successfully saved derivative data. [2025-09-17T22:49:29.030585] [INFO ] [MAIN ] Derivative Progress: 404/2085 symbols completed. CMC took 1.2s. Estimated remaining: 10m 52s. Rate: 154.6 symbols/min [2025-09-17T22:49:29.051242] [DEBUG] [MAIN ] CMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:29.051861] [INFO ] [MAIN ] CMG: Generated 1794 derivative records from 53720 primary records. [2025-09-17T22:49:29.051922] [DEBUG] [LOCAL ] CMG: Saving derivative data. [2025-09-17T22:49:29.066799] [DEBUG] [LOCAL ] CMG: Derivative data saved (1794 records). [2025-09-17T22:49:29.066857] [INFO ] [MAIN ] CMG: Successfully saved derivative data. [2025-09-17T22:49:29.069606] [INFO ] [MAIN ] Derivative Progress: 405/2085 symbols completed. CMG took 1.0s. Estimated remaining: 10m 51s. Rate: 154.9 symbols/min [2025-09-17T22:49:29.070223] [INFO ] [MAIN ] CMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:29.070371] [INFO ] [MAIN ] CMRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:29.070500] [INFO ] [MAIN ] CMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:29.118883] [DEBUG] [LOCAL ] CMRE: Loaded 35727 existing records from primary storage. [2025-09-17T22:49:29.119045] [INFO ] [MAIN ] CMRE: Loaded 35727 primary data records. [2025-09-17T22:49:29.249376] [DEBUG] [LOCAL ] CMP: Loaded 36678 existing records from primary storage. [2025-09-17T22:49:29.255158] [INFO ] [MAIN ] CMP: Loaded 36678 primary data records. [2025-09-17T22:49:29.519255] [DEBUG] [LOCAL ] CMI: Loaded 41930 existing records from primary storage. [2025-09-17T22:49:29.545973] [INFO ] [MAIN ] CMI: Loaded 41930 primary data records. [2025-09-17T22:49:30.148338] [DEBUG] [MAIN ] CMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:30.149286] [INFO ] [MAIN ] CMRE: Generated 1794 derivative records from 35727 primary records. [2025-09-17T22:49:30.149517] [DEBUG] [LOCAL ] CMRE: Saving derivative data. [2025-09-17T22:49:30.166833] [DEBUG] [LOCAL ] CMRE: Derivative data saved (1794 records). [2025-09-17T22:49:30.167504] [INFO ] [MAIN ] CMRE: Successfully saved derivative data. [2025-09-17T22:49:30.170131] [INFO ] [MAIN ] Derivative Progress: 406/2085 symbols completed. CMRE took 1.1s. Estimated remaining: 10m 53s. Rate: 154.2 symbols/min [2025-09-17T22:49:30.170410] [INFO ] [MAIN ] CMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:30.186180] [DEBUG] [MAIN ] CMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:30.187004] [INFO ] [MAIN ] CMP: Generated 1794 derivative records from 36678 primary records. [2025-09-17T22:49:30.187238] [DEBUG] [LOCAL ] CMP: Saving derivative data. [2025-09-17T22:49:30.206358] [DEBUG] [LOCAL ] CMP: Derivative data saved (1794 records). [2025-09-17T22:49:30.206630] [INFO ] [MAIN ] CMP: Successfully saved derivative data. [2025-09-17T22:49:30.208927] [INFO ] [MAIN ] Derivative Progress: 407/2085 symbols completed. CMP took 1.1s. Estimated remaining: 10m 51s. Rate: 154.6 symbols/min [2025-09-17T22:49:30.209307] [INFO ] [MAIN ] CMSA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:30.222269] [DEBUG] [MAIN ] CMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:30.223397] [INFO ] [MAIN ] CMI: Generated 1794 derivative records from 41930 primary records. [2025-09-17T22:49:30.223495] [DEBUG] [LOCAL ] CMI: Saving derivative data. [2025-09-17T22:49:30.239463] [DEBUG] [LOCAL ] CMSA: Loaded 3344 existing records from primary storage. [2025-09-17T22:49:30.240169] [INFO ] [MAIN ] CMSA: Loaded 3344 primary data records. [2025-09-17T22:49:30.383095] [DEBUG] [LOCAL ] CMS: Loaded 52651 existing records from primary storage. [2025-09-17T22:49:30.381560] [DEBUG] [LOCAL ] CMI: Derivative data saved (1794 records). [2025-09-17T22:49:30.388565] [INFO ] [MAIN ] CMS: Loaded 52651 primary data records. [2025-09-17T22:49:30.393736] [INFO ] [MAIN ] CMI: Successfully saved derivative data. [2025-09-17T22:49:30.419063] [INFO ] [MAIN ] Derivative Progress: 408/2085 symbols completed. CMI took 1.3s. Estimated remaining: 10m 50s. Rate: 154.7 symbols/min [2025-09-17T22:49:30.512484] [INFO ] [MAIN ] CMSC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:30.880565] [DEBUG] [LOCAL ] CMSC: Loaded 5121 existing records from primary storage. [2025-09-17T22:49:30.894443] [INFO ] [MAIN ] CMSC: Loaded 5121 primary data records. [2025-09-17T22:49:31.232293] [DEBUG] [MAIN ] CMSA: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:49:31.234021] [INFO ] [MAIN ] CMSA: Generated 1793 derivative records from 3344 primary records. [2025-09-17T22:49:31.234325] [DEBUG] [LOCAL ] CMSA: Saving derivative data. [2025-09-17T22:49:31.254467] [DEBUG] [MAIN ] CMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:31.255307] [INFO ] [MAIN ] CMS: Generated 1794 derivative records from 52651 primary records. [2025-09-17T22:49:31.263692] [DEBUG] [LOCAL ] CMS: Saving derivative data. [2025-09-17T22:49:31.265412] [DEBUG] [LOCAL ] CMSA: Derivative data saved (1793 records). [2025-09-17T22:49:31.273715] [INFO ] [MAIN ] CMSA: Successfully saved derivative data. [2025-09-17T22:49:31.278959] [INFO ] [MAIN ] Derivative Progress: 409/2085 symbols completed. CMSA took 1.1s. Estimated remaining: 10m 52s. Rate: 154.3 symbols/min [2025-09-17T22:49:31.283038] [DEBUG] [LOCAL ] CMS: Derivative data saved (1794 records). [2025-09-17T22:49:31.283246] [INFO ] [MAIN ] CMSD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:31.284009] [INFO ] [MAIN ] CMS: Successfully saved derivative data. [2025-09-17T22:49:31.286494] [INFO ] [MAIN ] Derivative Progress: 410/2085 symbols completed. CMS took 1.1s. Estimated remaining: 10m 50s. Rate: 154.7 symbols/min [2025-09-17T22:49:31.287637] [INFO ] [MAIN ] CMTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:31.311403] [DEBUG] [LOCAL ] CMSD: Loaded 8164 existing records from primary storage. [2025-09-17T22:49:31.311707] [DEBUG] [MAIN ] CMSC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:31.312452] [INFO ] [MAIN ] CMSC: Generated 1794 derivative records from 5121 primary records. [2025-09-17T22:49:31.312599] [INFO ] [MAIN ] CMSD: Loaded 8164 primary data records. [2025-09-17T22:49:31.312636] [DEBUG] [LOCAL ] CMSC: Saving derivative data. [2025-09-17T22:49:31.511902] [DEBUG] [LOCAL ] CMSC: Derivative data saved (1794 records). [2025-09-17T22:49:31.521423] [DEBUG] [LOCAL ] CMTG: Loaded 37816 existing records from primary storage. [2025-09-17T22:49:31.551441] [INFO ] [MAIN ] CMSC: Successfully saved derivative data. [2025-09-17T22:49:31.553673] [INFO ] [MAIN ] Derivative Progress: 411/2085 symbols completed. CMSC took 1.1s. Estimated remaining: 10m 49s. Rate: 154.8 symbols/min [2025-09-17T22:49:31.553902] [INFO ] [MAIN ] CMTG: Loaded 37816 primary data records. [2025-09-17T22:49:31.554043] [INFO ] [MAIN ] CNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:32.038043] [DEBUG] [LOCAL ] CNA: Loaded 32829 existing records from primary storage. [2025-09-17T22:49:32.039833] [INFO ] [MAIN ] CNA: Loaded 32829 primary data records. [2025-09-17T22:49:32.189188] [DEBUG] [MAIN ] CMSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:32.208988] [INFO ] [MAIN ] CMSD: Generated 1794 derivative records from 8164 primary records. [2025-09-17T22:49:32.249289] [DEBUG] [LOCAL ] CMSD: Saving derivative data. [2025-09-17T22:49:32.398857] [DEBUG] [MAIN ] CMTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:32.401588] [INFO ] [MAIN ] CMTG: Generated 1794 derivative records from 37816 primary records. [2025-09-17T22:49:32.405538] [DEBUG] [LOCAL ] CMSD: Derivative data saved (1794 records). [2025-09-17T22:49:32.404766] [DEBUG] [LOCAL ] CMTG: Saving derivative data. [2025-09-17T22:49:32.406882] [INFO ] [MAIN ] CMSD: Successfully saved derivative data. [2025-09-17T22:49:32.409304] [INFO ] [MAIN ] Derivative Progress: 412/2085 symbols completed. CMSD took 1.1s. Estimated remaining: 10m 50s. Rate: 154.3 symbols/min [2025-09-17T22:49:32.410147] [INFO ] [MAIN ] CNC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:32.427673] [DEBUG] [LOCAL ] CMTG: Derivative data saved (1794 records). [2025-09-17T22:49:32.427956] [INFO ] [MAIN ] CMTG: Successfully saved derivative data. [2025-09-17T22:49:32.430237] [INFO ] [MAIN ] Derivative Progress: 413/2085 symbols completed. CMTG took 1.1s. Estimated remaining: 10m 49s. Rate: 154.7 symbols/min [2025-09-17T22:49:32.430827] [INFO ] [MAIN ] CNF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:32.443278] [DEBUG] [LOCAL ] CNF: Loaded 10708 existing records from primary storage. [2025-09-17T22:49:32.444310] [INFO ] [MAIN ] CNF: Loaded 10708 primary data records. [2025-09-17T22:49:32.584011] [DEBUG] [MAIN ] CNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:32.601060] [INFO ] [MAIN ] CNA: Generated 1794 derivative records from 32829 primary records. [2025-09-17T22:49:32.640385] [DEBUG] [LOCAL ] CNA: Saving derivative data. [2025-09-17T22:49:32.795191] [DEBUG] [LOCAL ] CNC: Loaded 53729 existing records from primary storage. [2025-09-17T22:49:32.802827] [INFO ] [MAIN ] CNC: Loaded 53729 primary data records. [2025-09-17T22:49:32.929692] [DEBUG] [LOCAL ] CNA: Derivative data saved (1794 records). [2025-09-17T22:49:32.958718] [INFO ] [MAIN ] CNA: Successfully saved derivative data. [2025-09-17T22:49:32.996689] [INFO ] [MAIN ] Derivative Progress: 414/2085 symbols completed. CNA took 1.4s. Estimated remaining: 10m 49s. Rate: 154.5 symbols/min [2025-09-17T22:49:33.117363] [INFO ] [MAIN ] CNH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:33.139959] [DEBUG] [MAIN ] CNF: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:49:33.141537] [INFO ] [MAIN ] CNF: Generated 1793 derivative records from 10708 primary records. [2025-09-17T22:49:33.145021] [DEBUG] [LOCAL ] CNF: Saving derivative data. [2025-09-17T22:49:33.161434] [DEBUG] [LOCAL ] CNF: Derivative data saved (1793 records). [2025-09-17T22:49:33.161713] [INFO ] [MAIN ] CNF: Successfully saved derivative data. [2025-09-17T22:49:33.164004] [INFO ] [MAIN ] Derivative Progress: 415/2085 symbols completed. CNF took 0.7s. Estimated remaining: 10m 48s. Rate: 154.7 symbols/min [2025-09-17T22:49:33.164552] [INFO ] [MAIN ] CNI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:33.181370] [DEBUG] [MAIN ] CNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:33.182121] [INFO ] [MAIN ] CNC: Generated 1794 derivative records from 53729 primary records. [2025-09-17T22:49:33.195879] [DEBUG] [LOCAL ] CNC: Saving derivative data. [2025-09-17T22:49:33.212214] [DEBUG] [LOCAL ] CNC: Derivative data saved (1794 records). [2025-09-17T22:49:33.212415] [INFO ] [MAIN ] CNC: Successfully saved derivative data. [2025-09-17T22:49:33.214852] [INFO ] [MAIN ] Derivative Progress: 416/2085 symbols completed. CNC took 0.8s. Estimated remaining: 10m 46s. Rate: 155.0 symbols/min [2025-09-17T22:49:33.216290] [INFO ] [MAIN ] CNK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:33.232518] [DEBUG] [LOCAL ] CNH: Loaded 53561 existing records from primary storage. [2025-09-17T22:49:33.232755] [INFO ] [MAIN ] CNH: Loaded 53561 primary data records. [2025-09-17T22:49:33.606724] [DEBUG] [LOCAL ] CNI: Loaded 51663 existing records from primary storage. [2025-09-17T22:49:33.607009] [INFO ] [MAIN ] CNI: Loaded 51663 primary data records. [2025-09-17T22:49:33.735101] [DEBUG] [LOCAL ] CNK: Loaded 52910 existing records from primary storage. [2025-09-17T22:49:33.772702] [INFO ] [MAIN ] CNK: Loaded 52910 primary data records. [2025-09-17T22:49:34.366682] [DEBUG] [MAIN ] CNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:34.367719] [INFO ] [MAIN ] CNH: Generated 1794 derivative records from 53561 primary records. [2025-09-17T22:49:34.369032] [DEBUG] [LOCAL ] CNH: Saving derivative data. [2025-09-17T22:49:34.388869] [DEBUG] [LOCAL ] CNH: Derivative data saved (1794 records). [2025-09-17T22:49:34.389634] [INFO ] [MAIN ] CNH: Successfully saved derivative data. [2025-09-17T22:49:34.392028] [INFO ] [MAIN ] Derivative Progress: 417/2085 symbols completed. CNH took 1.3s. Estimated remaining: 10m 49s. Rate: 154.3 symbols/min [2025-09-17T22:49:34.392597] [INFO ] [MAIN ] CNM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:34.412965] [DEBUG] [MAIN ] CNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:34.413859] [INFO ] [MAIN ] CNI: Generated 1794 derivative records from 51663 primary records. [2025-09-17T22:49:34.413987] [DEBUG] [LOCAL ] CNI: Saving derivative data. [2025-09-17T22:49:34.432495] [DEBUG] [LOCAL ] CNI: Derivative data saved (1794 records). [2025-09-17T22:49:34.433592] [INFO ] [MAIN ] CNI: Successfully saved derivative data. [2025-09-17T22:49:34.435618] [INFO ] [MAIN ] Derivative Progress: 418/2085 symbols completed. CNI took 1.3s. Estimated remaining: 10m 47s. Rate: 154.6 symbols/min [2025-09-17T22:49:34.448877] [DEBUG] [MAIN ] CNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:34.449613] [INFO ] [MAIN ] CNK: Generated 1794 derivative records from 52910 primary records. [2025-09-17T22:49:34.449703] [DEBUG] [LOCAL ] CNK: Saving derivative data. [2025-09-17T22:49:34.479517] [DEBUG] [LOCAL ] CNK: Derivative data saved (1794 records). [2025-09-17T22:49:34.479695] [INFO ] [MAIN ] CNK: Successfully saved derivative data. [2025-09-17T22:49:34.482281] [INFO ] [MAIN ] Derivative Progress: 419/2085 symbols completed. CNK took 1.3s. Estimated remaining: 10m 45s. Rate: 154.9 symbols/min [2025-09-17T22:49:34.500534] [DEBUG] [LOCAL ] CNM: Loaded 50949 existing records from primary storage. [2025-09-17T22:49:34.500711] [INFO ] [MAIN ] CNM: Loaded 50949 primary data records. [2025-09-17T22:49:34.822331] [DEBUG] [MAIN ] CNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:34.822995] [INFO ] [MAIN ] CNM: Generated 1794 derivative records from 50949 primary records. [2025-09-17T22:49:34.823059] [DEBUG] [LOCAL ] CNM: Saving derivative data. [2025-09-17T22:49:34.838279] [DEBUG] [LOCAL ] CNM: Derivative data saved (1794 records). [2025-09-17T22:49:34.838343] [INFO ] [MAIN ] CNM: Successfully saved derivative data. [2025-09-17T22:49:34.840457] [INFO ] [MAIN ] Derivative Progress: 420/2085 symbols completed. CNM took 0.4s. Estimated remaining: 10m 45s. Rate: 155.0 symbols/min [2025-09-17T22:49:34.841215] [INFO ] [MAIN ] CNNE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:34.841518] [INFO ] [MAIN ] CNMD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:34.842189] [INFO ] [MAIN ] CNQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:34.890845] [DEBUG] [LOCAL ] CNMD: Loaded 32668 existing records from primary storage. [2025-09-17T22:49:34.905451] [INFO ] [MAIN ] CNMD: Loaded 32668 primary data records. [2025-09-17T22:49:34.948982] [DEBUG] [LOCAL ] CNNE: Loaded 36931 existing records from primary storage. [2025-09-17T22:49:34.997479] [INFO ] [MAIN ] CNNE: Loaded 36931 primary data records. [2025-09-17T22:49:35.102278] [DEBUG] [LOCAL ] CNQ: Loaded 53583 existing records from primary storage. [2025-09-17T22:49:35.129842] [INFO ] [MAIN ] CNQ: Loaded 53583 primary data records. [2025-09-17T22:49:35.918836] [DEBUG] [MAIN ] CNMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:35.921109] [INFO ] [MAIN ] CNMD: Generated 1794 derivative records from 32668 primary records. [2025-09-17T22:49:35.921337] [DEBUG] [LOCAL ] CNMD: Saving derivative data. [2025-09-17T22:49:35.949410] [DEBUG] [MAIN ] CNNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:35.951942] [INFO ] [MAIN ] CNNE: Generated 1794 derivative records from 36931 primary records. [2025-09-17T22:49:35.952599] [DEBUG] [LOCAL ] CNNE: Saving derivative data. [2025-09-17T22:49:35.967897] [DEBUG] [LOCAL ] CNMD: Derivative data saved (1794 records). [2025-09-17T22:49:35.968281] [DEBUG] [MAIN ] CNQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:35.968466] [INFO ] [MAIN ] CNMD: Successfully saved derivative data. [2025-09-17T22:49:35.969156] [INFO ] [MAIN ] CNQ: Generated 1794 derivative records from 53583 primary records. [2025-09-17T22:49:35.971261] [INFO ] [MAIN ] Derivative Progress: 421/2085 symbols completed. CNMD took 1.1s. Estimated remaining: 10m 47s. Rate: 154.3 symbols/min [2025-09-17T22:49:35.978861] [DEBUG] [LOCAL ] CNQ: Saving derivative data. [2025-09-17T22:49:35.978787] [INFO ] [MAIN ] CNS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:36.000111] [DEBUG] [LOCAL ] CNNE: Derivative data saved (1794 records). [2025-09-17T22:49:36.000225] [INFO ] [MAIN ] CNNE: Successfully saved derivative data. [2025-09-17T22:49:36.002544] [INFO ] [MAIN ] Derivative Progress: 422/2085 symbols completed. CNNE took 1.2s. Estimated remaining: 10m 45s. Rate: 154.6 symbols/min [2025-09-17T22:49:36.003304] [INFO ] [MAIN ] CNX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:36.013114] [DEBUG] [LOCAL ] CNQ: Derivative data saved (1794 records). [2025-09-17T22:49:36.013359] [INFO ] [MAIN ] CNQ: Successfully saved derivative data. [2025-09-17T22:49:36.016576] [INFO ] [MAIN ] Derivative Progress: 423/2085 symbols completed. CNQ took 1.2s. Estimated remaining: 10m 44s. Rate: 155.0 symbols/min [2025-09-17T22:49:36.016975] [INFO ] [MAIN ] CODI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:36.026179] [DEBUG] [LOCAL ] CNS: Loaded 21185 existing records from primary storage. [2025-09-17T22:49:36.026383] [INFO ] [MAIN ] CNS: Loaded 21185 primary data records. [2025-09-17T22:49:36.405910] [DEBUG] [LOCAL ] CODI: Loaded 39600 existing records from primary storage. [2025-09-17T22:49:36.407514] [INFO ] [MAIN ] CODI: Loaded 39600 primary data records. [2025-09-17T22:49:36.407291] [DEBUG] [LOCAL ] CNX: Loaded 51373 existing records from primary storage. [2025-09-17T22:49:36.426571] [INFO ] [MAIN ] CNX: Loaded 51373 primary data records. [2025-09-17T22:49:37.103077] [DEBUG] [MAIN ] CNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:37.105003] [INFO ] [MAIN ] CNS: Generated 1794 derivative records from 21185 primary records. [2025-09-17T22:49:37.105378] [DEBUG] [LOCAL ] CNS: Saving derivative data. [2025-09-17T22:49:37.124789] [DEBUG] [LOCAL ] CNS: Derivative data saved (1794 records). [2025-09-17T22:49:37.125544] [INFO ] [MAIN ] CNS: Successfully saved derivative data. [2025-09-17T22:49:37.128726] [INFO ] [MAIN ] Derivative Progress: 424/2085 symbols completed. CNS took 1.2s. Estimated remaining: 10m 46s. Rate: 154.3 symbols/min [2025-09-17T22:49:37.130770] [INFO ] [MAIN ] COF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:37.145571] [DEBUG] [MAIN ] CODI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:37.146412] [INFO ] [MAIN ] CODI: Generated 1794 derivative records from 39600 primary records. [2025-09-17T22:49:37.146705] [DEBUG] [LOCAL ] CODI: Saving derivative data. [2025-09-17T22:49:37.177140] [DEBUG] [MAIN ] CNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:37.179376] [INFO ] [MAIN ] CNX: Generated 1794 derivative records from 51373 primary records. [2025-09-17T22:49:37.179820] [DEBUG] [LOCAL ] CNX: Saving derivative data. [2025-09-17T22:49:37.196277] [DEBUG] [LOCAL ] CODI: Derivative data saved (1794 records). [2025-09-17T22:49:37.196726] [INFO ] [MAIN ] CODI: Successfully saved derivative data. [2025-09-17T22:49:37.199014] [INFO ] [MAIN ] Derivative Progress: 425/2085 symbols completed. CODI took 1.2s. Estimated remaining: 10m 44s. Rate: 154.6 symbols/min [2025-09-17T22:49:37.200016] [INFO ] [MAIN ] COHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:37.203263] [DEBUG] [LOCAL ] CNX: Derivative data saved (1794 records). [2025-09-17T22:49:37.203378] [INFO ] [MAIN ] CNX: Successfully saved derivative data. [2025-09-17T22:49:37.206172] [INFO ] [MAIN ] Derivative Progress: 426/2085 symbols completed. CNX took 1.2s. Estimated remaining: 10m 43s. Rate: 154.9 symbols/min [2025-09-17T22:49:37.206477] [INFO ] [MAIN ] COLD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:37.254305] [DEBUG] [LOCAL ] COF: Loaded 53610 existing records from primary storage. [2025-09-17T22:49:37.254525] [INFO ] [MAIN ] COF: Loaded 53610 primary data records. [2025-09-17T22:49:37.430514] [DEBUG] [LOCAL ] COHR: Loaded 53373 existing records from primary storage. [2025-09-17T22:49:37.449328] [INFO ] [MAIN ] COHR: Loaded 53373 primary data records. [2025-09-17T22:49:37.681045] [DEBUG] [LOCAL ] COLD: Loaded 51890 existing records from primary storage. [2025-09-17T22:49:37.695635] [INFO ] [MAIN ] COLD: Loaded 51890 primary data records. [2025-09-17T22:49:38.348430] [DEBUG] [MAIN ] COF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:38.349685] [INFO ] [MAIN ] COF: Generated 1794 derivative records from 53610 primary records. [2025-09-17T22:49:38.350162] [DEBUG] [LOCAL ] COF: Saving derivative data. [2025-09-17T22:49:38.370404] [DEBUG] [LOCAL ] COF: Derivative data saved (1794 records). [2025-09-17T22:49:38.370592] [INFO ] [MAIN ] COF: Successfully saved derivative data. [2025-09-17T22:49:38.373080] [INFO ] [MAIN ] Derivative Progress: 427/2085 symbols completed. COF took 1.2s. Estimated remaining: 10m 45s. Rate: 154.2 symbols/min [2025-09-17T22:49:38.373911] [INFO ] [MAIN ] COMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:38.387369] [DEBUG] [MAIN ] COHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:38.388521] [INFO ] [MAIN ] COHR: Generated 1794 derivative records from 53373 primary records. [2025-09-17T22:49:38.388743] [DEBUG] [LOCAL ] COHR: Saving derivative data. [2025-09-17T22:49:38.420032] [DEBUG] [MAIN ] COLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:38.421523] [INFO ] [MAIN ] COLD: Generated 1794 derivative records from 51890 primary records. [2025-09-17T22:49:38.422280] [DEBUG] [LOCAL ] COLD: Saving derivative data. [2025-09-17T22:49:38.422095] [DEBUG] [LOCAL ] COHR: Derivative data saved (1794 records). [2025-09-17T22:49:38.422780] [INFO ] [MAIN ] COHR: Successfully saved derivative data. [2025-09-17T22:49:38.425168] [INFO ] [MAIN ] Derivative Progress: 428/2085 symbols completed. COHR took 1.2s. Estimated remaining: 10m 43s. Rate: 154.5 symbols/min [2025-09-17T22:49:38.425457] [INFO ] [MAIN ] CON: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:38.441749] [DEBUG] [LOCAL ] COLD: Derivative data saved (1794 records). [2025-09-17T22:49:38.441836] [INFO ] [MAIN ] COLD: Successfully saved derivative data. [2025-09-17T22:49:38.445240] [INFO ] [MAIN ] Derivative Progress: 429/2085 symbols completed. COLD took 1.2s. Estimated remaining: 10m 42s. Rate: 154.9 symbols/min [2025-09-17T22:49:38.445682] [INFO ] [MAIN ] COOK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:38.501986] [DEBUG] [LOCAL ] COMP: Loaded 53381 existing records from primary storage. [2025-09-17T22:49:38.502300] [INFO ] [MAIN ] COMP: Loaded 53381 primary data records. [2025-09-17T22:49:38.587902] [DEBUG] [LOCAL ] CON: Loaded 38889 existing records from primary storage. [2025-09-17T22:49:38.596843] [INFO ] [MAIN ] CON: Loaded 38889 primary data records. [2025-09-17T22:49:38.597625] [DEBUG] [LOCAL ] COOK: Loaded 24122 existing records from primary storage. [2025-09-17T22:49:38.649106] [INFO ] [MAIN ] COOK: Loaded 24122 primary data records. [2025-09-17T22:49:39.513206] [DEBUG] [MAIN ] COMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:39.527400] [INFO ] [MAIN ] COMP: Generated 1794 derivative records from 53381 primary records. [2025-09-17T22:49:39.528557] [DEBUG] [LOCAL ] COMP: Saving derivative data. [2025-09-17T22:49:39.530442] [DEBUG] [MAIN ] CON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:39.531574] [INFO ] [MAIN ] CON: Generated 1794 derivative records from 38889 primary records. [2025-09-17T22:49:39.531704] [DEBUG] [LOCAL ] CON: Saving derivative data. [2025-09-17T22:49:39.564329] [DEBUG] [MAIN ] COOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:39.575507] [DEBUG] [LOCAL ] CON: Derivative data saved (1794 records). [2025-09-17T22:49:39.570796] [INFO ] [MAIN ] COOK: Generated 1794 derivative records from 24122 primary records. [2025-09-17T22:49:39.577377] [DEBUG] [LOCAL ] COMP: Derivative data saved (1794 records). [2025-09-17T22:49:39.577629] [INFO ] [MAIN ] COMP: Successfully saved derivative data. [2025-09-17T22:49:39.579991] [INFO ] [MAIN ] Derivative Progress: 430/2085 symbols completed. COMP took 1.2s. Estimated remaining: 10m 44s. Rate: 154.2 symbols/min [2025-09-17T22:49:39.577521] [DEBUG] [LOCAL ] COOK: Saving derivative data. [2025-09-17T22:49:39.581409] [INFO ] [MAIN ] CON: Successfully saved derivative data. [2025-09-17T22:49:39.580279] [INFO ] [MAIN ] COP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:39.583707] [INFO ] [MAIN ] Derivative Progress: 431/2085 symbols completed. CON took 1.2s. Estimated remaining: 10m 42s. Rate: 154.5 symbols/min [2025-09-17T22:49:39.599947] [DEBUG] [LOCAL ] COOK: Derivative data saved (1794 records). [2025-09-17T22:49:39.600194] [INFO ] [MAIN ] COOK: Successfully saved derivative data. [2025-09-17T22:49:39.600247] [INFO ] [MAIN ] COR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:39.602934] [INFO ] [MAIN ] Derivative Progress: 432/2085 symbols completed. COOK took 1.2s. Estimated remaining: 10m 40s. Rate: 154.9 symbols/min [2025-09-17T22:49:39.603268] [INFO ] [MAIN ] COTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:39.704334] [DEBUG] [LOCAL ] COR: Loaded 47343 existing records from primary storage. [2025-09-17T22:49:39.706868] [DEBUG] [LOCAL ] COP: Loaded 53727 existing records from primary storage. [2025-09-17T22:49:39.705815] [INFO ] [MAIN ] COR: Loaded 47343 primary data records. [2025-09-17T22:49:39.706976] [INFO ] [MAIN ] COP: Loaded 53727 primary data records. [2025-09-17T22:49:39.707858] [DEBUG] [LOCAL ] COTY: Loaded 53266 existing records from primary storage. [2025-09-17T22:49:39.746319] [INFO ] [MAIN ] COTY: Loaded 53266 primary data records. [2025-09-17T22:49:40.729858] [DEBUG] [MAIN ] COR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:40.730713] [INFO ] [MAIN ] COR: Generated 1794 derivative records from 47343 primary records. [2025-09-17T22:49:40.738296] [DEBUG] [LOCAL ] COR: Saving derivative data. [2025-09-17T22:49:40.729318] [DEBUG] [MAIN ] COP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:40.744106] [INFO ] [MAIN ] COP: Generated 1794 derivative records from 53727 primary records. [2025-09-17T22:49:40.745014] [DEBUG] [MAIN ] COTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:40.744751] [DEBUG] [LOCAL ] COP: Saving derivative data. [2025-09-17T22:49:40.746071] [INFO ] [MAIN ] COTY: Generated 1794 derivative records from 53266 primary records. [2025-09-17T22:49:40.746469] [DEBUG] [LOCAL ] COTY: Saving derivative data. [2025-09-17T22:49:40.783438] [DEBUG] [LOCAL ] COP: Derivative data saved (1794 records). [2025-09-17T22:49:40.786859] [INFO ] [MAIN ] COP: Successfully saved derivative data. [2025-09-17T22:49:40.789372] [INFO ] [MAIN ] Derivative Progress: 433/2085 symbols completed. COP took 1.2s. Estimated remaining: 10m 43s. Rate: 154.1 symbols/min [2025-09-17T22:49:40.790229] [DEBUG] [LOCAL ] COR: Derivative data saved (1794 records). [2025-09-17T22:49:40.790314] [INFO ] [MAIN ] COR: Successfully saved derivative data. [2025-09-17T22:49:40.792495] [INFO ] [MAIN ] Derivative Progress: 434/2085 symbols completed. COR took 1.2s. Estimated remaining: 10m 41s. Rate: 154.5 symbols/min [2025-09-17T22:49:40.796259] [DEBUG] [LOCAL ] COTY: Derivative data saved (1794 records). [2025-09-17T22:49:40.796323] [INFO ] [MAIN ] COTY: Successfully saved derivative data. [2025-09-17T22:49:40.798828] [INFO ] [MAIN ] Derivative Progress: 435/2085 symbols completed. COTY took 1.2s. Estimated remaining: 10m 39s. Rate: 154.8 symbols/min [2025-09-17T22:49:40.799335] [INFO ] [MAIN ] CPA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:40.799816] [INFO ] [MAIN ] COUR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:40.799627] [INFO ] [MAIN ] CP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:40.853196] [DEBUG] [LOCAL ] CPA: Loaded 29179 existing records from primary storage. [2025-09-17T22:49:40.853468] [INFO ] [MAIN ] CPA: Loaded 29179 primary data records. [2025-09-17T22:49:40.989557] [DEBUG] [LOCAL ] COUR: Loaded 48861 existing records from primary storage. [2025-09-17T22:49:40.990138] [INFO ] [MAIN ] COUR: Loaded 48861 primary data records. [2025-09-17T22:49:41.058029] [DEBUG] [LOCAL ] CP: Loaded 53294 existing records from primary storage. [2025-09-17T22:49:41.100849] [INFO ] [MAIN ] CP: Loaded 53294 primary data records. [2025-09-17T22:49:41.864813] [DEBUG] [MAIN ] CPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:41.866064] [INFO ] [MAIN ] CPA: Generated 1794 derivative records from 29179 primary records. [2025-09-17T22:49:41.866250] [DEBUG] [LOCAL ] CPA: Saving derivative data. [2025-09-17T22:49:41.883926] [DEBUG] [LOCAL ] CPA: Derivative data saved (1794 records). [2025-09-17T22:49:41.885093] [INFO ] [MAIN ] CPA: Successfully saved derivative data. [2025-09-17T22:49:41.887753] [INFO ] [MAIN ] Derivative Progress: 436/2085 symbols completed. CPA took 1.1s. Estimated remaining: 10m 42s. Rate: 154.2 symbols/min [2025-09-17T22:49:41.888880] [INFO ] [MAIN ] CPAY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:41.904964] [DEBUG] [MAIN ] CP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:41.917483] [INFO ] [MAIN ] CP: Generated 1794 derivative records from 53294 primary records. [2025-09-17T22:49:41.917868] [DEBUG] [LOCAL ] CP: Saving derivative data. [2025-09-17T22:49:41.918387] [DEBUG] [MAIN ] COUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:41.919612] [INFO ] [MAIN ] COUR: Generated 1794 derivative records from 48861 primary records. [2025-09-17T22:49:41.930477] [DEBUG] [LOCAL ] COUR: Saving derivative data. [2025-09-17T22:49:41.934574] [DEBUG] [LOCAL ] CP: Derivative data saved (1794 records). [2025-09-17T22:49:41.934758] [INFO ] [MAIN ] CP: Successfully saved derivative data. [2025-09-17T22:49:41.938095] [INFO ] [MAIN ] Derivative Progress: 437/2085 symbols completed. CP took 1.1s. Estimated remaining: 10m 40s. Rate: 154.5 symbols/min [2025-09-17T22:49:41.938390] [INFO ] [MAIN ] CPF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:41.964045] [DEBUG] [LOCAL ] COUR: Derivative data saved (1794 records). [2025-09-17T22:49:41.964268] [INFO ] [MAIN ] COUR: Successfully saved derivative data. [2025-09-17T22:49:41.966703] [INFO ] [MAIN ] Derivative Progress: 438/2085 symbols completed. COUR took 1.2s. Estimated remaining: 10m 38s. Rate: 154.8 symbols/min [2025-09-17T22:49:41.967173] [INFO ] [MAIN ] CPK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:41.978510] [DEBUG] [LOCAL ] CPAY: Loaded 31370 existing records from primary storage. [2025-09-17T22:49:41.978759] [INFO ] [MAIN ] CPAY: Loaded 31370 primary data records. [2025-09-17T22:49:42.057438] [DEBUG] [LOCAL ] CPF: Loaded 15587 existing records from primary storage. [2025-09-17T22:49:42.084807] [INFO ] [MAIN ] CPF: Loaded 15587 primary data records. [2025-09-17T22:49:42.099099] [DEBUG] [LOCAL ] CPK: Loaded 13134 existing records from primary storage. [2025-09-17T22:49:42.113588] [INFO ] [MAIN ] CPK: Loaded 13134 primary data records. [2025-09-17T22:49:42.985169] [DEBUG] [MAIN ] CPAY: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:49:42.986593] [INFO ] [MAIN ] CPAY: Generated 1793 derivative records from 31370 primary records. [2025-09-17T22:49:42.987504] [DEBUG] [LOCAL ] CPAY: Saving derivative data. [2025-09-17T22:49:43.018031] [DEBUG] [LOCAL ] CPAY: Derivative data saved (1793 records). [2025-09-17T22:49:43.018148] [INFO ] [MAIN ] CPAY: Successfully saved derivative data. [2025-09-17T22:49:43.017959] [DEBUG] [MAIN ] CPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:43.020158] [INFO ] [MAIN ] Derivative Progress: 439/2085 symbols completed. CPAY took 1.1s. Estimated remaining: 10m 40s. Rate: 154.2 symbols/min [2025-09-17T22:49:43.022176] [INFO ] [MAIN ] CPNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:43.023842] [INFO ] [MAIN ] CPF: Generated 1794 derivative records from 15587 primary records. [2025-09-17T22:49:43.024297] [DEBUG] [LOCAL ] CPF: Saving derivative data. [2025-09-17T22:49:43.038345] [DEBUG] [MAIN ] CPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:43.050578] [INFO ] [MAIN ] CPK: Generated 1794 derivative records from 13134 primary records. [2025-09-17T22:49:43.051223] [DEBUG] [LOCAL ] CPK: Saving derivative data. [2025-09-17T22:49:43.067478] [DEBUG] [LOCAL ] CPF: Derivative data saved (1794 records). [2025-09-17T22:49:43.071763] [INFO ] [MAIN ] CPF: Successfully saved derivative data. [2025-09-17T22:49:43.071531] [DEBUG] [LOCAL ] CPK: Derivative data saved (1794 records). [2025-09-17T22:49:43.074292] [INFO ] [MAIN ] Derivative Progress: 440/2085 symbols completed. CPF took 1.1s. Estimated remaining: 10m 39s. Rate: 154.5 symbols/min [2025-09-17T22:49:43.074597] [INFO ] [MAIN ] CPK: Successfully saved derivative data. [2025-09-17T22:49:43.074706] [INFO ] [MAIN ] CPS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:43.077117] [INFO ] [MAIN ] Derivative Progress: 441/2085 symbols completed. CPK took 1.1s. Estimated remaining: 10m 37s. Rate: 154.9 symbols/min [2025-09-17T22:49:43.077604] [INFO ] [MAIN ] CPT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:43.120090] [DEBUG] [LOCAL ] CPS: Loaded 26389 existing records from primary storage. [2025-09-17T22:49:43.135233] [INFO ] [MAIN ] CPS: Loaded 26389 primary data records. [2025-09-17T22:49:43.156762] [DEBUG] [LOCAL ] CPNG: Loaded 53671 existing records from primary storage. [2025-09-17T22:49:43.190881] [INFO ] [MAIN ] CPNG: Loaded 53671 primary data records. [2025-09-17T22:49:43.308597] [DEBUG] [LOCAL ] CPT: Loaded 44362 existing records from primary storage. [2025-09-17T22:49:43.341864] [INFO ] [MAIN ] CPT: Loaded 44362 primary data records. [2025-09-17T22:49:44.120251] [DEBUG] [MAIN ] CPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:44.121959] [INFO ] [MAIN ] CPS: Generated 1794 derivative records from 26389 primary records. [2025-09-17T22:49:44.122309] [DEBUG] [LOCAL ] CPS: Saving derivative data. [2025-09-17T22:49:44.156256] [DEBUG] [MAIN ] CPNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:44.157175] [INFO ] [MAIN ] CPNG: Generated 1794 derivative records from 53671 primary records. [2025-09-17T22:49:44.155887] [DEBUG] [LOCAL ] CPS: Derivative data saved (1794 records). [2025-09-17T22:49:44.157408] [DEBUG] [LOCAL ] CPNG: Saving derivative data. [2025-09-17T22:49:44.157745] [INFO ] [MAIN ] CPS: Successfully saved derivative data. [2025-09-17T22:49:44.160143] [INFO ] [MAIN ] Derivative Progress: 442/2085 symbols completed. CPS took 1.1s. Estimated remaining: 10m 39s. Rate: 154.2 symbols/min [2025-09-17T22:49:44.161141] [INFO ] [MAIN ] CQP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:44.193987] [DEBUG] [LOCAL ] CPNG: Derivative data saved (1794 records). [2025-09-17T22:49:44.194270] [INFO ] [MAIN ] CPNG: Successfully saved derivative data. [2025-09-17T22:49:44.194588] [DEBUG] [MAIN ] CPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:44.195453] [INFO ] [MAIN ] CPT: Generated 1794 derivative records from 44362 primary records. [2025-09-17T22:49:44.198309] [INFO ] [MAIN ] Derivative Progress: 443/2085 symbols completed. CPNG took 1.2s. Estimated remaining: 10m 37s. Rate: 154.6 symbols/min [2025-09-17T22:49:44.198783] [INFO ] [MAIN ] CR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:44.198694] [DEBUG] [LOCAL ] CPT: Saving derivative data. [2025-09-17T22:49:44.222629] [DEBUG] [LOCAL ] CPT: Derivative data saved (1794 records). [2025-09-17T22:49:44.222806] [INFO ] [MAIN ] CPT: Successfully saved derivative data. [2025-09-17T22:49:44.225190] [INFO ] [MAIN ] Derivative Progress: 444/2085 symbols completed. CPT took 1.1s. Estimated remaining: 10m 36s. Rate: 154.9 symbols/min [2025-09-17T22:49:44.225562] [INFO ] [MAIN ] CRBG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:44.238850] [DEBUG] [LOCAL ] CQP: Loaded 20089 existing records from primary storage. [2025-09-17T22:49:44.239117] [INFO ] [MAIN ] CQP: Loaded 20089 primary data records. [2025-09-17T22:49:44.353535] [DEBUG] [LOCAL ] CR: Loaded 24730 existing records from primary storage. [2025-09-17T22:49:44.353818] [INFO ] [MAIN ] CR: Loaded 24730 primary data records. [2025-09-17T22:49:44.916503] [DEBUG] [LOCAL ] CRBG: Loaded 52342 existing records from primary storage. [2025-09-17T22:49:44.931329] [INFO ] [MAIN ] CRBG: Loaded 52342 primary data records. [2025-09-17T22:49:45.293229] [DEBUG] [MAIN ] CQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:45.300316] [INFO ] [MAIN ] CQP: Generated 1794 derivative records from 20089 primary records. [2025-09-17T22:49:45.300962] [DEBUG] [MAIN ] CR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:45.301610] [INFO ] [MAIN ] CR: Generated 1794 derivative records from 24730 primary records. [2025-09-17T22:49:45.301705] [DEBUG] [LOCAL ] CQP: Saving derivative data. [2025-09-17T22:49:45.301871] [DEBUG] [LOCAL ] CR: Saving derivative data. [2025-09-17T22:49:45.331718] [DEBUG] [LOCAL ] CQP: Derivative data saved (1794 records). [2025-09-17T22:49:45.335565] [INFO ] [MAIN ] CQP: Successfully saved derivative data. [2025-09-17T22:49:45.338320] [INFO ] [MAIN ] Derivative Progress: 445/2085 symbols completed. CQP took 1.2s. Estimated remaining: 10m 38s. Rate: 154.2 symbols/min [2025-09-17T22:49:45.339063] [INFO ] [MAIN ] CRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:45.344880] [DEBUG] [LOCAL ] CR: Derivative data saved (1794 records). [2025-09-17T22:49:45.344967] [INFO ] [MAIN ] CR: Successfully saved derivative data. [2025-09-17T22:49:45.347552] [INFO ] [MAIN ] Derivative Progress: 446/2085 symbols completed. CR took 1.1s. Estimated remaining: 10m 36s. Rate: 154.6 symbols/min [2025-09-17T22:49:45.348227] [INFO ] [MAIN ] CRGY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:45.364745] [DEBUG] [MAIN ] CRBG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:45.365544] [INFO ] [MAIN ] CRBG: Generated 1794 derivative records from 52342 primary records. [2025-09-17T22:49:45.365868] [DEBUG] [LOCAL ] CRBG: Saving derivative data. [2025-09-17T22:49:45.382495] [DEBUG] [LOCAL ] CRBG: Derivative data saved (1794 records). [2025-09-17T22:49:45.382680] [INFO ] [MAIN ] CRBG: Successfully saved derivative data. [2025-09-17T22:49:45.385024] [INFO ] [MAIN ] Derivative Progress: 447/2085 symbols completed. CRBG took 1.2s. Estimated remaining: 10m 35s. Rate: 154.9 symbols/min [2025-09-17T22:49:45.385452] [INFO ] [MAIN ] CRH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:45.427188] [DEBUG] [LOCAL ] CRC: Loaded 44532 existing records from primary storage. [2025-09-17T22:49:45.427484] [INFO ] [MAIN ] CRC: Loaded 44532 primary data records. [2025-09-17T22:49:45.548278] [DEBUG] [LOCAL ] CRGY: Loaded 52521 existing records from primary storage. [2025-09-17T22:49:45.577871] [INFO ] [MAIN ] CRGY: Loaded 52521 primary data records. [2025-09-17T22:49:45.884431] [DEBUG] [LOCAL ] CRH: Loaded 53472 existing records from primary storage. [2025-09-17T22:49:45.889031] [INFO ] [MAIN ] CRH: Loaded 53472 primary data records. [2025-09-17T22:49:46.476337] [DEBUG] [MAIN ] CRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:46.477925] [INFO ] [MAIN ] CRC: Generated 1794 derivative records from 44532 primary records. [2025-09-17T22:49:46.478200] [DEBUG] [LOCAL ] CRC: Saving derivative data. [2025-09-17T22:49:46.497294] [DEBUG] [LOCAL ] CRC: Derivative data saved (1794 records). [2025-09-17T22:49:46.497606] [INFO ] [MAIN ] CRC: Successfully saved derivative data. [2025-09-17T22:49:46.500228] [INFO ] [MAIN ] Derivative Progress: 448/2085 symbols completed. CRC took 1.2s. Estimated remaining: 10m 37s. Rate: 154.2 symbols/min [2025-09-17T22:49:46.516842] [DEBUG] [MAIN ] CRGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:46.517837] [INFO ] [MAIN ] CRGY: Generated 1794 derivative records from 52521 primary records. [2025-09-17T22:49:46.517955] [DEBUG] [LOCAL ] CRGY: Saving derivative data. [2025-09-17T22:49:46.536240] [DEBUG] [LOCAL ] CRGY: Derivative data saved (1794 records). [2025-09-17T22:49:46.536372] [INFO ] [MAIN ] CRGY: Successfully saved derivative data. [2025-09-17T22:49:46.538755] [INFO ] [MAIN ] Derivative Progress: 449/2085 symbols completed. CRGY took 1.2s. Estimated remaining: 10m 35s. Rate: 154.5 symbols/min [2025-09-17T22:49:46.551245] [DEBUG] [MAIN ] CRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:46.551926] [INFO ] [MAIN ] CRH: Generated 1794 derivative records from 53472 primary records. [2025-09-17T22:49:46.551989] [DEBUG] [LOCAL ] CRH: Saving derivative data. [2025-09-17T22:49:46.567937] [DEBUG] [LOCAL ] CRH: Derivative data saved (1794 records). [2025-09-17T22:49:46.567999] [INFO ] [MAIN ] CRH: Successfully saved derivative data. [2025-09-17T22:49:46.570391] [INFO ] [MAIN ] Derivative Progress: 450/2085 symbols completed. CRH took 1.2s. Estimated remaining: 10m 33s. Rate: 154.9 symbols/min [2025-09-17T22:49:46.571129] [INFO ] [MAIN ] CRM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:46.571299] [INFO ] [MAIN ] CRL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:46.571174] [INFO ] [MAIN ] CRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:46.640234] [DEBUG] [LOCAL ] CRL: Loaded 43772 existing records from primary storage. [2025-09-17T22:49:46.640409] [INFO ] [MAIN ] CRL: Loaded 43772 primary data records. [2025-09-17T22:49:46.764133] [DEBUG] [LOCAL ] CRI: Loaded 49995 existing records from primary storage. [2025-09-17T22:49:46.782531] [DEBUG] [LOCAL ] CRM: Loaded 53770 existing records from primary storage. [2025-09-17T22:49:46.788378] [INFO ] [MAIN ] CRI: Loaded 49995 primary data records. [2025-09-17T22:49:46.793089] [INFO ] [MAIN ] CRM: Loaded 53770 primary data records. [2025-09-17T22:49:47.657274] [DEBUG] [MAIN ] CRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:47.659906] [INFO ] [MAIN ] CRL: Generated 1794 derivative records from 43772 primary records. [2025-09-17T22:49:47.660298] [DEBUG] [LOCAL ] CRL: Saving derivative data. [2025-09-17T22:49:47.693511] [DEBUG] [LOCAL ] CRL: Derivative data saved (1794 records). [2025-09-17T22:49:47.693994] [DEBUG] [MAIN ] CRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:47.695239] [INFO ] [MAIN ] CRL: Successfully saved derivative data. [2025-09-17T22:49:47.694993] [INFO ] [MAIN ] CRI: Generated 1794 derivative records from 49995 primary records. [2025-09-17T22:49:47.704728] [INFO ] [MAIN ] Derivative Progress: 451/2085 symbols completed. CRL took 1.1s. Estimated remaining: 10m 36s. Rate: 154.2 symbols/min [2025-09-17T22:49:47.704850] [DEBUG] [LOCAL ] CRI: Saving derivative data. [2025-09-17T22:49:47.709515] [INFO ] [MAIN ] CRS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:47.711511] [DEBUG] [MAIN ] CRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:47.712307] [INFO ] [MAIN ] CRM: Generated 1794 derivative records from 53770 primary records. [2025-09-17T22:49:47.712629] [DEBUG] [LOCAL ] CRM: Saving derivative data. [2025-09-17T22:49:47.742740] [DEBUG] [LOCAL ] CRM: Derivative data saved (1794 records). [2025-09-17T22:49:47.744488] [INFO ] [MAIN ] CRM: Successfully saved derivative data. [2025-09-17T22:49:47.747342] [INFO ] [MAIN ] Derivative Progress: 452/2085 symbols completed. CRM took 1.2s. Estimated remaining: 10m 34s. Rate: 154.5 symbols/min [2025-09-17T22:49:47.748079] [INFO ] [MAIN ] CSAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:47.747796] [DEBUG] [LOCAL ] CRI: Derivative data saved (1794 records). [2025-09-17T22:49:47.748232] [INFO ] [MAIN ] CRI: Successfully saved derivative data. [2025-09-17T22:49:47.751047] [INFO ] [MAIN ] Derivative Progress: 453/2085 symbols completed. CRI took 1.2s. Estimated remaining: 10m 32s. Rate: 154.8 symbols/min [2025-09-17T22:49:47.751536] [INFO ] [MAIN ] CSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:47.803683] [DEBUG] [LOCAL ] CRS: Loaded 43581 existing records from primary storage. [2025-09-17T22:49:47.803887] [INFO ] [MAIN ] CRS: Loaded 43581 primary data records. [2025-09-17T22:49:47.908528] [DEBUG] [LOCAL ] CSL: Loaded 31435 existing records from primary storage. [2025-09-17T22:49:47.925359] [INFO ] [MAIN ] CSL: Loaded 31435 primary data records. [2025-09-17T22:49:47.945400] [DEBUG] [LOCAL ] CSAN: Loaded 42065 existing records from primary storage. [2025-09-17T22:49:47.999699] [INFO ] [MAIN ] CSAN: Loaded 42065 primary data records. [2025-09-17T22:49:48.847793] [DEBUG] [MAIN ] CRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:48.849738] [INFO ] [MAIN ] CRS: Generated 1794 derivative records from 43581 primary records. [2025-09-17T22:49:48.849983] [DEBUG] [LOCAL ] CRS: Saving derivative data. [2025-09-17T22:49:48.883147] [DEBUG] [MAIN ] CSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:48.886599] [DEBUG] [LOCAL ] CRS: Derivative data saved (1794 records). [2025-09-17T22:49:48.885921] [INFO ] [MAIN ] CSL: Generated 1794 derivative records from 31435 primary records. [2025-09-17T22:49:48.886734] [INFO ] [MAIN ] CRS: Successfully saved derivative data. [2025-09-17T22:49:48.886886] [DEBUG] [LOCAL ] CSL: Saving derivative data. [2025-09-17T22:49:48.888774] [INFO ] [MAIN ] Derivative Progress: 454/2085 symbols completed. CRS took 1.2s. Estimated remaining: 10m 35s. Rate: 154.2 symbols/min [2025-09-17T22:49:48.898996] [INFO ] [MAIN ] CSR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:48.919272] [DEBUG] [LOCAL ] CSL: Derivative data saved (1794 records). [2025-09-17T22:49:48.928050] [INFO ] [MAIN ] CSL: Successfully saved derivative data. [2025-09-17T22:49:48.927921] [DEBUG] [MAIN ] CSAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:48.930460] [INFO ] [MAIN ] Derivative Progress: 455/2085 symbols completed. CSL took 1.2s. Estimated remaining: 10m 33s. Rate: 154.5 symbols/min [2025-09-17T22:49:48.931823] [INFO ] [MAIN ] CSAN: Generated 1794 derivative records from 42065 primary records. [2025-09-17T22:49:48.931992] [INFO ] [MAIN ] CSTM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:48.937036] [DEBUG] [LOCAL ] CSAN: Saving derivative data. [2025-09-17T22:49:48.938446] [DEBUG] [LOCAL ] CSR: Loaded 12384 existing records from primary storage. [2025-09-17T22:49:48.938968] [INFO ] [MAIN ] CSR: Loaded 12384 primary data records. [2025-09-17T22:49:49.061090] [DEBUG] [LOCAL ] CSAN: Derivative data saved (1794 records). [2025-09-17T22:49:49.067067] [INFO ] [MAIN ] CSAN: Successfully saved derivative data. [2025-09-17T22:49:49.070057] [INFO ] [MAIN ] Derivative Progress: 456/2085 symbols completed. CSAN took 1.3s. Estimated remaining: 10m 32s. Rate: 154.7 symbols/min [2025-09-17T22:49:49.080839] [INFO ] [MAIN ] CSV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:49.280428] [DEBUG] [LOCAL ] CSV: Loaded 13078 existing records from primary storage. [2025-09-17T22:49:49.280571] [INFO ] [MAIN ] CSV: Loaded 13078 primary data records. [2025-09-17T22:49:49.401172] [DEBUG] [LOCAL ] CSTM: Loaded 47803 existing records from primary storage. [2025-09-17T22:49:49.411040] [INFO ] [MAIN ] CSTM: Loaded 47803 primary data records. [2025-09-17T22:49:49.927368] [DEBUG] [MAIN ] CSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:49.928833] [INFO ] [MAIN ] CSR: Generated 1794 derivative records from 12384 primary records. [2025-09-17T22:49:49.928945] [DEBUG] [LOCAL ] CSR: Saving derivative data. [2025-09-17T22:49:49.946789] [DEBUG] [LOCAL ] CSR: Derivative data saved (1794 records). [2025-09-17T22:49:49.947106] [INFO ] [MAIN ] CSR: Successfully saved derivative data. [2025-09-17T22:49:49.949409] [INFO ] [MAIN ] Derivative Progress: 457/2085 symbols completed. CSR took 1.1s. Estimated remaining: 10m 33s. Rate: 154.3 symbols/min [2025-09-17T22:49:49.950842] [INFO ] [MAIN ] CTBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:49.973931] [DEBUG] [MAIN ] CSV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:49.978407] [INFO ] [MAIN ] CSV: Generated 1794 derivative records from 13078 primary records. [2025-09-17T22:49:49.977568] [DEBUG] [LOCAL ] CTBB: Loaded 7279 existing records from primary storage. [2025-09-17T22:49:49.979318] [INFO ] [MAIN ] CTBB: Loaded 7279 primary data records. [2025-09-17T22:49:49.979556] [DEBUG] [LOCAL ] CSV: Saving derivative data. [2025-09-17T22:49:50.063621] [DEBUG] [MAIN ] CSTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:50.091364] [INFO ] [MAIN ] CSTM: Generated 1794 derivative records from 47803 primary records. [2025-09-17T22:49:50.096854] [DEBUG] [LOCAL ] CSTM: Saving derivative data. [2025-09-17T22:49:50.134204] [DEBUG] [LOCAL ] CSV: Derivative data saved (1794 records). [2025-09-17T22:49:50.145445] [INFO ] [MAIN ] CSV: Successfully saved derivative data. [2025-09-17T22:49:50.163636] [INFO ] [MAIN ] Derivative Progress: 458/2085 symbols completed. CSV took 1.1s. Estimated remaining: 10m 32s. Rate: 154.4 symbols/min [2025-09-17T22:49:50.214948] [INFO ] [MAIN ] CTDD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:50.342634] [DEBUG] [LOCAL ] CSTM: Derivative data saved (1794 records). [2025-09-17T22:49:50.344152] [INFO ] [MAIN ] CSTM: Successfully saved derivative data. [2025-09-17T22:49:50.352720] [INFO ] [MAIN ] Derivative Progress: 459/2085 symbols completed. CSTM took 1.4s. Estimated remaining: 10m 31s. Rate: 154.6 symbols/min [2025-09-17T22:49:50.353221] [INFO ] [MAIN ] CTO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:50.358399] [DEBUG] [LOCAL ] CTDD: Loaded 5877 existing records from primary storage. [2025-09-17T22:49:50.359007] [INFO ] [MAIN ] CTDD: Loaded 5877 primary data records. [2025-09-17T22:49:50.744958] [DEBUG] [LOCAL ] CTO: Loaded 28505 existing records from primary storage. [2025-09-17T22:49:50.745191] [INFO ] [MAIN ] CTO: Loaded 28505 primary data records. [2025-09-17T22:49:50.847555] [DEBUG] [MAIN ] CTBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:50.860546] [INFO ] [MAIN ] CTBB: Generated 1794 derivative records from 7279 primary records. [2025-09-17T22:49:50.872280] [DEBUG] [LOCAL ] CTBB: Saving derivative data. [2025-09-17T22:49:50.955787] [DEBUG] [LOCAL ] CTBB: Derivative data saved (1794 records). [2025-09-17T22:49:50.981020] [INFO ] [MAIN ] CTBB: Successfully saved derivative data. [2025-09-17T22:49:50.983757] [INFO ] [MAIN ] Derivative Progress: 460/2085 symbols completed. CTBB took 1.0s. Estimated remaining: 10m 31s. Rate: 154.4 symbols/min [2025-09-17T22:49:51.106702] [INFO ] [MAIN ] CTOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:51.128403] [DEBUG] [MAIN ] CTDD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:49:51.129375] [INFO ] [MAIN ] CTDD: Generated 1793 derivative records from 5877 primary records. [2025-09-17T22:49:51.129514] [DEBUG] [LOCAL ] CTDD: Saving derivative data. [2025-09-17T22:49:51.157079] [DEBUG] [LOCAL ] CTDD: Derivative data saved (1793 records). [2025-09-17T22:49:51.157327] [INFO ] [MAIN ] CTDD: Successfully saved derivative data. [2025-09-17T22:49:51.159497] [INFO ] [MAIN ] Derivative Progress: 461/2085 symbols completed. CTDD took 1.0s. Estimated remaining: 10m 30s. Rate: 154.6 symbols/min [2025-09-17T22:49:51.160139] [INFO ] [MAIN ] CTRA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:51.177832] [DEBUG] [LOCAL ] CTOS: Loaded 37050 existing records from primary storage. [2025-09-17T22:49:51.178220] [INFO ] [MAIN ] CTOS: Loaded 37050 primary data records. [2025-09-17T22:49:51.213541] [DEBUG] [MAIN ] CTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:51.244510] [INFO ] [MAIN ] CTO: Generated 1794 derivative records from 28505 primary records. [2025-09-17T22:49:51.263026] [DEBUG] [LOCAL ] CTO: Saving derivative data. [2025-09-17T22:49:51.543083] [DEBUG] [LOCAL ] CTO: Derivative data saved (1794 records). [2025-09-17T22:49:51.543320] [INFO ] [MAIN ] CTO: Successfully saved derivative data. [2025-09-17T22:49:51.545682] [INFO ] [MAIN ] Derivative Progress: 462/2085 symbols completed. CTO took 1.2s. Estimated remaining: 10m 30s. Rate: 154.6 symbols/min [2025-09-17T22:49:51.546241] [INFO ] [MAIN ] CTRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:51.567282] [DEBUG] [LOCAL ] CTRA: Loaded 53649 existing records from primary storage. [2025-09-17T22:49:51.567689] [INFO ] [MAIN ] CTRA: Loaded 53649 primary data records. [2025-09-17T22:49:51.910395] [DEBUG] [MAIN ] CTOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:51.912456] [INFO ] [MAIN ] CTOS: Generated 1794 derivative records from 37050 primary records. [2025-09-17T22:49:51.912705] [DEBUG] [LOCAL ] CTOS: Saving derivative data. [2025-09-17T22:49:51.931133] [DEBUG] [LOCAL ] CTRE: Loaded 49196 existing records from primary storage. [2025-09-17T22:49:51.942446] [INFO ] [MAIN ] CTRE: Loaded 49196 primary data records. [2025-09-17T22:49:51.978832] [DEBUG] [LOCAL ] CTOS: Derivative data saved (1794 records). [2025-09-17T22:49:52.003761] [INFO ] [MAIN ] CTOS: Successfully saved derivative data. [2025-09-17T22:49:52.027302] [INFO ] [MAIN ] Derivative Progress: 463/2085 symbols completed. CTOS took 0.9s. Estimated remaining: 10m 30s. Rate: 154.5 symbols/min [2025-09-17T22:49:52.143081] [DEBUG] [MAIN ] CTRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:52.148201] [INFO ] [MAIN ] CTRA: Generated 1794 derivative records from 53649 primary records. [2025-09-17T22:49:52.268106] [DEBUG] [LOCAL ] CTRA: Saving derivative data. [2025-09-17T22:49:52.301101] [DEBUG] [LOCAL ] CTRA: Derivative data saved (1794 records). [2025-09-17T22:49:52.301887] [INFO ] [MAIN ] CTRA: Successfully saved derivative data. [2025-09-17T22:49:52.304870] [INFO ] [MAIN ] Derivative Progress: 464/2085 symbols completed. CTRA took 1.1s. Estimated remaining: 10m 29s. Rate: 154.6 symbols/min [2025-09-17T22:49:52.327426] [DEBUG] [MAIN ] CTRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:52.328166] [INFO ] [MAIN ] CTRE: Generated 1794 derivative records from 49196 primary records. [2025-09-17T22:49:52.328229] [DEBUG] [LOCAL ] CTRE: Saving derivative data. [2025-09-17T22:49:52.344118] [DEBUG] [LOCAL ] CTRE: Derivative data saved (1794 records). [2025-09-17T22:49:52.344227] [INFO ] [MAIN ] CTRE: Successfully saved derivative data. [2025-09-17T22:49:52.346539] [INFO ] [MAIN ] Derivative Progress: 465/2085 symbols completed. CTRE took 0.8s. Estimated remaining: 10m 28s. Rate: 154.9 symbols/min [2025-09-17T22:49:52.347567] [INFO ] [MAIN ] CTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:52.347766] [INFO ] [MAIN ] CUBE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:52.347435] [INFO ] [MAIN ] CTVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:52.374216] [DEBUG] [LOCAL ] CTS: Loaded 19336 existing records from primary storage. [2025-09-17T22:49:52.374482] [INFO ] [MAIN ] CTS: Loaded 19336 primary data records. [2025-09-17T22:49:52.553142] [DEBUG] [LOCAL ] CUBE: Loaded 50754 existing records from primary storage. [2025-09-17T22:49:52.608227] [INFO ] [MAIN ] CUBE: Loaded 50754 primary data records. [2025-09-17T22:49:52.872746] [DEBUG] [LOCAL ] CTVA: Loaded 53231 existing records from primary storage. [2025-09-17T22:49:52.895077] [INFO ] [MAIN ] CTVA: Loaded 53231 primary data records. [2025-09-17T22:49:53.441083] [DEBUG] [MAIN ] CTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:53.442406] [INFO ] [MAIN ] CTS: Generated 1794 derivative records from 19336 primary records. [2025-09-17T22:49:53.442620] [DEBUG] [LOCAL ] CTS: Saving derivative data. [2025-09-17T22:49:53.461438] [DEBUG] [LOCAL ] CTS: Derivative data saved (1794 records). [2025-09-17T22:49:53.461877] [INFO ] [MAIN ] CTS: Successfully saved derivative data. [2025-09-17T22:49:53.464338] [INFO ] [MAIN ] Derivative Progress: 466/2085 symbols completed. CTS took 1.1s. Estimated remaining: 10m 30s. Rate: 154.3 symbols/min [2025-09-17T22:49:53.464806] [INFO ] [MAIN ] CUBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:53.484201] [DEBUG] [MAIN ] CUBE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:53.496793] [INFO ] [MAIN ] CUBE: Generated 1794 derivative records from 50754 primary records. [2025-09-17T22:49:53.497530] [DEBUG] [MAIN ] CTVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:53.498156] [INFO ] [MAIN ] CTVA: Generated 1794 derivative records from 53231 primary records. [2025-09-17T22:49:53.497311] [DEBUG] [LOCAL ] CUBE: Saving derivative data. [2025-09-17T22:49:53.498245] [DEBUG] [LOCAL ] CTVA: Saving derivative data. [2025-09-17T22:49:53.534511] [DEBUG] [LOCAL ] CUBE: Derivative data saved (1794 records). [2025-09-17T22:49:53.544058] [INFO ] [MAIN ] CUBE: Successfully saved derivative data. [2025-09-17T22:49:53.547543] [INFO ] [MAIN ] Derivative Progress: 467/2085 symbols completed. CUBE took 1.2s. Estimated remaining: 10m 28s. Rate: 154.5 symbols/min [2025-09-17T22:49:53.549294] [DEBUG] [LOCAL ] CUBI: Loaded 27280 existing records from primary storage. [2025-09-17T22:49:53.548161] [INFO ] [MAIN ] CUK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:53.550124] [INFO ] [MAIN ] CUBI: Loaded 27280 primary data records. [2025-09-17T22:49:53.575157] [DEBUG] [LOCAL ] CTVA: Derivative data saved (1794 records). [2025-09-17T22:49:53.615682] [INFO ] [MAIN ] CTVA: Successfully saved derivative data. [2025-09-17T22:49:53.653934] [INFO ] [MAIN ] Derivative Progress: 468/2085 symbols completed. CTVA took 1.3s. Estimated remaining: 10m 27s. Rate: 154.8 symbols/min [2025-09-17T22:49:53.677129] [INFO ] [MAIN ] CURB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:53.921143] [DEBUG] [LOCAL ] CURB: Loaded 33031 existing records from primary storage. [2025-09-17T22:49:53.935305] [INFO ] [MAIN ] CURB: Loaded 33031 primary data records. [2025-09-17T22:49:53.971404] [DEBUG] [LOCAL ] CUK: Loaded 51042 existing records from primary storage. [2025-09-17T22:49:53.990444] [INFO ] [MAIN ] CUK: Loaded 51042 primary data records. [2025-09-17T22:49:54.580666] [DEBUG] [MAIN ] CUBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:54.582241] [INFO ] [MAIN ] CUBI: Generated 1794 derivative records from 27280 primary records. [2025-09-17T22:49:54.582910] [DEBUG] [LOCAL ] CUBI: Saving derivative data. [2025-09-17T22:49:54.602033] [DEBUG] [LOCAL ] CUBI: Derivative data saved (1794 records). [2025-09-17T22:49:54.602266] [INFO ] [MAIN ] CUBI: Successfully saved derivative data. [2025-09-17T22:49:54.604263] [INFO ] [MAIN ] Derivative Progress: 469/2085 symbols completed. CUBI took 1.1s. Estimated remaining: 10m 28s. Rate: 154.3 symbols/min [2025-09-17T22:49:54.604831] [INFO ] [MAIN ] CUZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:54.625420] [DEBUG] [MAIN ] CURB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:54.627884] [INFO ] [MAIN ] CURB: Generated 1794 derivative records from 33031 primary records. [2025-09-17T22:49:54.628087] [DEBUG] [LOCAL ] CURB: Saving derivative data. [2025-09-17T22:49:54.655995] [DEBUG] [MAIN ] CUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:54.657140] [DEBUG] [LOCAL ] CURB: Derivative data saved (1794 records). [2025-09-17T22:49:54.658138] [INFO ] [MAIN ] CUK: Generated 1794 derivative records from 51042 primary records. [2025-09-17T22:49:54.657323] [INFO ] [MAIN ] CURB: Successfully saved derivative data. [2025-09-17T22:49:54.660402] [INFO ] [MAIN ] Derivative Progress: 470/2085 symbols completed. CURB took 1.0s. Estimated remaining: 10m 27s. Rate: 154.6 symbols/min [2025-09-17T22:49:54.660617] [DEBUG] [LOCAL ] CUK: Saving derivative data. [2025-09-17T22:49:54.660811] [INFO ] [MAIN ] CVE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:54.694769] [DEBUG] [LOCAL ] CUK: Derivative data saved (1794 records). [2025-09-17T22:49:54.695058] [INFO ] [MAIN ] CUK: Successfully saved derivative data. [2025-09-17T22:49:54.698033] [INFO ] [MAIN ] Derivative Progress: 471/2085 symbols completed. CUK took 1.1s. Estimated remaining: 10m 25s. Rate: 154.9 symbols/min [2025-09-17T22:49:54.698605] [INFO ] [MAIN ] CVEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:54.716371] [DEBUG] [LOCAL ] CUZ: Loaded 49356 existing records from primary storage. [2025-09-17T22:49:54.716526] [INFO ] [MAIN ] CUZ: Loaded 49356 primary data records. [2025-09-17T22:49:54.841695] [DEBUG] [LOCAL ] CVEO: Loaded 15638 existing records from primary storage. [2025-09-17T22:49:54.868377] [INFO ] [MAIN ] CVEO: Loaded 15638 primary data records. [2025-09-17T22:49:55.233882] [DEBUG] [LOCAL ] CVE: Loaded 53558 existing records from primary storage. [2025-09-17T22:49:55.253179] [INFO ] [MAIN ] CVE: Loaded 53558 primary data records. [2025-09-17T22:49:55.759952] [DEBUG] [MAIN ] CUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:55.761472] [INFO ] [MAIN ] CUZ: Generated 1794 derivative records from 49356 primary records. [2025-09-17T22:49:55.761787] [DEBUG] [LOCAL ] CUZ: Saving derivative data. [2025-09-17T22:49:55.779821] [DEBUG] [LOCAL ] CUZ: Derivative data saved (1794 records). [2025-09-17T22:49:55.780077] [INFO ] [MAIN ] CUZ: Successfully saved derivative data. [2025-09-17T22:49:55.782498] [INFO ] [MAIN ] Derivative Progress: 472/2085 symbols completed. CUZ took 1.2s. Estimated remaining: 10m 27s. Rate: 154.3 symbols/min [2025-09-17T22:49:55.782982] [INFO ] [MAIN ] CVI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:55.801910] [DEBUG] [MAIN ] CVEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:55.802967] [INFO ] [MAIN ] CVEO: Generated 1794 derivative records from 15638 primary records. [2025-09-17T22:49:55.805146] [DEBUG] [LOCAL ] CVEO: Saving derivative data. [2025-09-17T22:49:55.835982] [DEBUG] [LOCAL ] CVEO: Derivative data saved (1794 records). [2025-09-17T22:49:55.836874] [INFO ] [MAIN ] CVEO: Successfully saved derivative data. [2025-09-17T22:49:55.836760] [DEBUG] [MAIN ] CVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:55.839690] [INFO ] [MAIN ] Derivative Progress: 473/2085 symbols completed. CVEO took 1.1s. Estimated remaining: 10m 26s. Rate: 154.6 symbols/min [2025-09-17T22:49:55.841324] [INFO ] [MAIN ] CVLG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:55.840976] [INFO ] [MAIN ] CVE: Generated 1794 derivative records from 53558 primary records. [2025-09-17T22:49:55.841993] [DEBUG] [LOCAL ] CVE: Saving derivative data. [2025-09-17T22:49:55.873280] [DEBUG] [LOCAL ] CVE: Derivative data saved (1794 records). [2025-09-17T22:49:55.873415] [INFO ] [MAIN ] CVE: Successfully saved derivative data. [2025-09-17T22:49:55.875570] [INFO ] [MAIN ] Derivative Progress: 474/2085 symbols completed. CVE took 1.2s. Estimated remaining: 10m 24s. Rate: 154.9 symbols/min [2025-09-17T22:49:55.875962] [INFO ] [MAIN ] CVNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:55.883233] [DEBUG] [LOCAL ] CVLG: Loaded 15413 existing records from primary storage. [2025-09-17T22:49:55.883373] [INFO ] [MAIN ] CVLG: Loaded 15413 primary data records. [2025-09-17T22:49:56.011027] [DEBUG] [LOCAL ] CVI: Loaded 46415 existing records from primary storage. [2025-09-17T22:49:56.028071] [INFO ] [MAIN ] CVI: Loaded 46415 primary data records. [2025-09-17T22:49:56.387602] [DEBUG] [LOCAL ] CVNA: Loaded 53072 existing records from primary storage. [2025-09-17T22:49:56.444409] [INFO ] [MAIN ] CVNA: Loaded 53072 primary data records. [2025-09-17T22:49:56.972322] [DEBUG] [MAIN ] CVLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:56.975229] [INFO ] [MAIN ] CVLG: Generated 1794 derivative records from 15413 primary records. [2025-09-17T22:49:56.975860] [DEBUG] [LOCAL ] CVLG: Saving derivative data. [2025-09-17T22:49:56.998858] [DEBUG] [MAIN ] CVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:57.002505] [INFO ] [MAIN ] CVI: Generated 1794 derivative records from 46415 primary records. [2025-09-17T22:49:57.006892] [DEBUG] [LOCAL ] CVI: Saving derivative data. [2025-09-17T22:49:57.007907] [DEBUG] [LOCAL ] CVLG: Derivative data saved (1794 records). [2025-09-17T22:49:57.008986] [INFO ] [MAIN ] CVLG: Successfully saved derivative data. [2025-09-17T22:49:57.011231] [INFO ] [MAIN ] Derivative Progress: 475/2085 symbols completed. CVLG took 1.2s. Estimated remaining: 10m 26s. Rate: 154.2 symbols/min [2025-09-17T22:49:57.020316] [INFO ] [MAIN ] CVX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:57.028432] [DEBUG] [LOCAL ] CVI: Derivative data saved (1794 records). [2025-09-17T22:49:57.028548] [INFO ] [MAIN ] CVI: Successfully saved derivative data. [2025-09-17T22:49:57.031138] [INFO ] [MAIN ] Derivative Progress: 476/2085 symbols completed. CVI took 1.2s. Estimated remaining: 10m 25s. Rate: 154.5 symbols/min [2025-09-17T22:49:57.031719] [INFO ] [MAIN ] CWAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:57.049804] [DEBUG] [MAIN ] CVNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:57.050603] [INFO ] [MAIN ] CVNA: Generated 1794 derivative records from 53072 primary records. [2025-09-17T22:49:57.050707] [DEBUG] [LOCAL ] CVNA: Saving derivative data. [2025-09-17T22:49:57.068542] [DEBUG] [LOCAL ] CVNA: Derivative data saved (1794 records). [2025-09-17T22:49:57.068716] [INFO ] [MAIN ] CVNA: Successfully saved derivative data. [2025-09-17T22:49:57.071194] [INFO ] [MAIN ] Derivative Progress: 477/2085 symbols completed. CVNA took 1.2s. Estimated remaining: 10m 23s. Rate: 154.8 symbols/min [2025-09-17T22:49:57.071590] [INFO ] [MAIN ] CWEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:57.136889] [DEBUG] [LOCAL ] CVX: Loaded 53760 existing records from primary storage. [2025-09-17T22:49:57.138055] [INFO ] [MAIN ] CVX: Loaded 53760 primary data records. [2025-09-17T22:49:57.150247] [DEBUG] [LOCAL ] CWAN: Loaded 52384 existing records from primary storage. [2025-09-17T22:49:57.176401] [INFO ] [MAIN ] CWAN: Loaded 52384 primary data records. [2025-09-17T22:49:57.447069] [DEBUG] [LOCAL ] CWEN: Loaded 45031 existing records from primary storage. [2025-09-17T22:49:57.524721] [INFO ] [MAIN ] CWEN: Loaded 45031 primary data records. [2025-09-17T22:49:58.173704] [DEBUG] [MAIN ] CWAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:58.174306] [DEBUG] [MAIN ] CVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:58.175413] [INFO ] [MAIN ] CWAN: Generated 1794 derivative records from 52384 primary records. [2025-09-17T22:49:58.176772] [DEBUG] [LOCAL ] CWAN: Saving derivative data. [2025-09-17T22:49:58.178487] [INFO ] [MAIN ] CVX: Generated 1794 derivative records from 53760 primary records. [2025-09-17T22:49:58.178947] [DEBUG] [LOCAL ] CVX: Saving derivative data. [2025-09-17T22:49:58.206949] [DEBUG] [LOCAL ] CWAN: Derivative data saved (1794 records). [2025-09-17T22:49:58.210492] [INFO ] [MAIN ] CWAN: Successfully saved derivative data. [2025-09-17T22:49:58.212622] [INFO ] [MAIN ] Derivative Progress: 478/2085 symbols completed. CWAN took 1.2s. Estimated remaining: 10m 25s. Rate: 154.2 symbols/min [2025-09-17T22:49:58.213613] [DEBUG] [LOCAL ] CVX: Derivative data saved (1794 records). [2025-09-17T22:49:58.214010] [INFO ] [MAIN ] CVX: Successfully saved derivative data. [2025-09-17T22:49:58.217273] [INFO ] [MAIN ] Derivative Progress: 479/2085 symbols completed. CVX took 1.2s. Estimated remaining: 10m 24s. Rate: 154.5 symbols/min [2025-09-17T22:49:58.232738] [DEBUG] [MAIN ] CWEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:58.233400] [INFO ] [MAIN ] CWEN: Generated 1794 derivative records from 45031 primary records. [2025-09-17T22:49:58.233462] [DEBUG] [LOCAL ] CWEN: Saving derivative data. [2025-09-17T22:49:58.248535] [DEBUG] [LOCAL ] CWEN: Derivative data saved (1794 records). [2025-09-17T22:49:58.248593] [INFO ] [MAIN ] CWEN: Successfully saved derivative data. [2025-09-17T22:49:58.250820] [INFO ] [MAIN ] Derivative Progress: 480/2085 symbols completed. CWEN took 1.2s. Estimated remaining: 10m 22s. Rate: 154.8 symbols/min [2025-09-17T22:49:58.251365] [INFO ] [MAIN ] CWH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:58.251627] [INFO ] [MAIN ] CX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:58.252117] [INFO ] [MAIN ] CWK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:58.340090] [DEBUG] [LOCAL ] CX: Loaded 52839 existing records from primary storage. [2025-09-17T22:49:58.342060] [INFO ] [MAIN ] CX: Loaded 52839 primary data records. [2025-09-17T22:49:58.405345] [DEBUG] [LOCAL ] CWK: Loaded 49420 existing records from primary storage. [2025-09-17T22:49:58.428729] [INFO ] [MAIN ] CWK: Loaded 49420 primary data records. [2025-09-17T22:49:58.458193] [DEBUG] [LOCAL ] CWH: Loaded 51416 existing records from primary storage. [2025-09-17T22:49:58.522928] [INFO ] [MAIN ] CWH: Loaded 51416 primary data records. [2025-09-17T22:49:59.346844] [DEBUG] [MAIN ] CX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:59.349684] [INFO ] [MAIN ] CX: Generated 1794 derivative records from 52839 primary records. [2025-09-17T22:49:59.349912] [DEBUG] [LOCAL ] CX: Saving derivative data. [2025-09-17T22:49:59.389049] [DEBUG] [MAIN ] CWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:59.389418] [DEBUG] [MAIN ] CWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:49:59.396676] [DEBUG] [LOCAL ] CX: Derivative data saved (1794 records). [2025-09-17T22:49:59.397501] [INFO ] [MAIN ] CWK: Generated 1794 derivative records from 49420 primary records. [2025-09-17T22:49:59.397602] [INFO ] [MAIN ] CX: Successfully saved derivative data. [2025-09-17T22:49:59.398414] [INFO ] [MAIN ] CWH: Generated 1794 derivative records from 51416 primary records. [2025-09-17T22:49:59.400568] [DEBUG] [LOCAL ] CWH: Saving derivative data. [2025-09-17T22:49:59.400481] [INFO ] [MAIN ] Derivative Progress: 481/2085 symbols completed. CX took 1.1s. Estimated remaining: 10m 24s. Rate: 154.2 symbols/min [2025-09-17T22:49:59.398565] [DEBUG] [LOCAL ] CWK: Saving derivative data. [2025-09-17T22:49:59.401299] [INFO ] [MAIN ] CXE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:59.433044] [DEBUG] [LOCAL ] CWH: Derivative data saved (1794 records). [2025-09-17T22:49:59.435311] [INFO ] [MAIN ] CWH: Successfully saved derivative data. [2025-09-17T22:49:59.435201] [DEBUG] [LOCAL ] CWK: Derivative data saved (1794 records). [2025-09-17T22:49:59.439341] [INFO ] [MAIN ] Derivative Progress: 482/2085 symbols completed. CWH took 1.2s. Estimated remaining: 10m 23s. Rate: 154.5 symbols/min [2025-09-17T22:49:59.439546] [INFO ] [MAIN ] CWK: Successfully saved derivative data. [2025-09-17T22:49:59.442407] [INFO ] [MAIN ] CXH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:59.442283] [INFO ] [MAIN ] Derivative Progress: 483/2085 symbols completed. CWK took 1.2s. Estimated remaining: 10m 21s. Rate: 154.8 symbols/min [2025-09-17T22:49:59.447475] [DEBUG] [LOCAL ] CXE: Loaded 7257 existing records from primary storage. [2025-09-17T22:49:59.446956] [INFO ] [MAIN ] CXM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:49:59.447620] [INFO ] [MAIN ] CXE: Loaded 7257 primary data records. [2025-09-17T22:49:59.537484] [DEBUG] [LOCAL ] CXH: Loaded 4420 existing records from primary storage. [2025-09-17T22:49:59.556966] [INFO ] [MAIN ] CXH: Loaded 4420 primary data records. [2025-09-17T22:50:00.074890] [DEBUG] [LOCAL ] CXM: Loaded 47981 existing records from primary storage. [2025-09-17T22:50:00.084220] [INFO ] [MAIN ] CXM: Loaded 47981 primary data records. [2025-09-17T22:50:00.440283] [DEBUG] [MAIN ] CXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:00.441165] [INFO ] [MAIN ] CXE: Generated 1794 derivative records from 7257 primary records. [2025-09-17T22:50:00.442740] [DEBUG] [LOCAL ] CXE: Saving derivative data. [2025-09-17T22:50:00.477917] [DEBUG] [LOCAL ] CXE: Derivative data saved (1794 records). [2025-09-17T22:50:00.478390] [DEBUG] [MAIN ] CXH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:00.479385] [INFO ] [MAIN ] CXE: Successfully saved derivative data. [2025-09-17T22:50:00.479291] [INFO ] [MAIN ] CXH: Generated 1794 derivative records from 4420 primary records. [2025-09-17T22:50:00.481621] [DEBUG] [LOCAL ] CXH: Saving derivative data. [2025-09-17T22:50:00.481508] [INFO ] [MAIN ] Derivative Progress: 484/2085 symbols completed. CXE took 1.1s. Estimated remaining: 10m 23s. Rate: 154.3 symbols/min [2025-09-17T22:50:00.483710] [INFO ] [MAIN ] CXW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:00.500211] [DEBUG] [LOCAL ] CXH: Derivative data saved (1794 records). [2025-09-17T22:50:00.500389] [INFO ] [MAIN ] CXH: Successfully saved derivative data. [2025-09-17T22:50:00.502976] [INFO ] [MAIN ] Derivative Progress: 485/2085 symbols completed. CXH took 1.1s. Estimated remaining: 10m 21s. Rate: 154.6 symbols/min [2025-09-17T22:50:00.503843] [INFO ] [MAIN ] CYD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:00.523501] [DEBUG] [MAIN ] CXM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:00.524463] [INFO ] [MAIN ] CXM: Generated 1794 derivative records from 47981 primary records. [2025-09-17T22:50:00.524550] [DEBUG] [LOCAL ] CXM: Saving derivative data. [2025-09-17T22:50:00.540438] [DEBUG] [LOCAL ] CXM: Derivative data saved (1794 records). [2025-09-17T22:50:00.540527] [INFO ] [MAIN ] CXM: Successfully saved derivative data. [2025-09-17T22:50:00.542719] [INFO ] [MAIN ] Derivative Progress: 486/2085 symbols completed. CXM took 1.1s. Estimated remaining: 10m 20s. Rate: 154.8 symbols/min [2025-09-17T22:50:00.543197] [INFO ] [MAIN ] CYH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:00.577811] [DEBUG] [LOCAL ] CYD: Loaded 26862 existing records from primary storage. [2025-09-17T22:50:00.578009] [INFO ] [MAIN ] CYD: Loaded 26862 primary data records. [2025-09-17T22:50:00.699755] [DEBUG] [LOCAL ] CXW: Loaded 44602 existing records from primary storage. [2025-09-17T22:50:00.732230] [INFO ] [MAIN ] CXW: Loaded 44602 primary data records. [2025-09-17T22:50:00.837773] [DEBUG] [LOCAL ] CYH: Loaded 48029 existing records from primary storage. [2025-09-17T22:50:01.011552] [INFO ] [MAIN ] CYH: Loaded 48029 primary data records. [2025-09-17T22:50:01.677616] [DEBUG] [MAIN ] CYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:01.679723] [INFO ] [MAIN ] CYD: Generated 1794 derivative records from 26862 primary records. [2025-09-17T22:50:01.680317] [DEBUG] [LOCAL ] CYD: Saving derivative data. [2025-09-17T22:50:01.708536] [DEBUG] [LOCAL ] CYD: Derivative data saved (1794 records). [2025-09-17T22:50:01.710039] [INFO ] [MAIN ] CYD: Successfully saved derivative data. [2025-09-17T22:50:01.714671] [INFO ] [MAIN ] Derivative Progress: 487/2085 symbols completed. CYD took 1.2s. Estimated remaining: 10m 22s. Rate: 154.2 symbols/min [2025-09-17T22:50:01.715542] [INFO ] [MAIN ] D: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:01.730762] [DEBUG] [MAIN ] CXW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:01.732607] [INFO ] [MAIN ] CXW: Generated 1794 derivative records from 44602 primary records. [2025-09-17T22:50:01.734367] [DEBUG] [LOCAL ] CXW: Saving derivative data. [2025-09-17T22:50:01.761930] [DEBUG] [MAIN ] CYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:01.764726] [INFO ] [MAIN ] CYH: Generated 1794 derivative records from 48029 primary records. [2025-09-17T22:50:01.764924] [DEBUG] [LOCAL ] CYH: Saving derivative data. [2025-09-17T22:50:01.786769] [DEBUG] [LOCAL ] CYH: Derivative data saved (1794 records). [2025-09-17T22:50:01.788338] [DEBUG] [LOCAL ] CXW: Derivative data saved (1794 records). [2025-09-17T22:50:01.788712] [INFO ] [MAIN ] CXW: Successfully saved derivative data. [2025-09-17T22:50:01.788612] [INFO ] [MAIN ] CYH: Successfully saved derivative data. [2025-09-17T22:50:01.792564] [INFO ] [MAIN ] Derivative Progress: 488/2085 symbols completed. CYH took 1.2s. Estimated remaining: 10m 20s. Rate: 154.5 symbols/min [2025-09-17T22:50:01.797100] [INFO ] [MAIN ] DAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:01.796903] [INFO ] [MAIN ] Derivative Progress: 489/2085 symbols completed. CXW took 1.3s. Estimated remaining: 10m 19s. Rate: 154.8 symbols/min [2025-09-17T22:50:01.797910] [INFO ] [MAIN ] DAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:01.847585] [DEBUG] [LOCAL ] D: Loaded 53647 existing records from primary storage. [2025-09-17T22:50:01.847924] [INFO ] [MAIN ] D: Loaded 53647 primary data records. [2025-09-17T22:50:02.061527] [DEBUG] [LOCAL ] DAN: Loaded 49034 existing records from primary storage. [2025-09-17T22:50:02.098766] [INFO ] [MAIN ] DAN: Loaded 49034 primary data records. [2025-09-17T22:50:02.121794] [DEBUG] [LOCAL ] DAL: Loaded 53753 existing records from primary storage. [2025-09-17T22:50:02.279637] [INFO ] [MAIN ] DAL: Loaded 53753 primary data records. [2025-09-17T22:50:02.924694] [DEBUG] [MAIN ] D: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:02.925962] [INFO ] [MAIN ] D: Generated 1794 derivative records from 53647 primary records. [2025-09-17T22:50:02.926087] [DEBUG] [LOCAL ] D: Saving derivative data. [2025-09-17T22:50:02.946439] [DEBUG] [LOCAL ] D: Derivative data saved (1794 records). [2025-09-17T22:50:02.946938] [INFO ] [MAIN ] D: Successfully saved derivative data. [2025-09-17T22:50:02.949582] [INFO ] [MAIN ] Derivative Progress: 490/2085 symbols completed. D took 1.2s. Estimated remaining: 10m 21s. Rate: 154.1 symbols/min [2025-09-17T22:50:02.950938] [INFO ] [MAIN ] DAVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:02.970451] [DEBUG] [MAIN ] DAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:02.971616] [INFO ] [MAIN ] DAN: Generated 1794 derivative records from 49034 primary records. [2025-09-17T22:50:02.971726] [DEBUG] [LOCAL ] DAN: Saving derivative data. [2025-09-17T22:50:03.004830] [DEBUG] [LOCAL ] DAN: Derivative data saved (1794 records). [2025-09-17T22:50:03.014838] [INFO ] [MAIN ] DAN: Successfully saved derivative data. [2025-09-17T22:50:03.014546] [DEBUG] [MAIN ] DAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:03.018864] [INFO ] [MAIN ] Derivative Progress: 491/2085 symbols completed. DAN took 1.2s. Estimated remaining: 10m 19s. Rate: 154.4 symbols/min [2025-09-17T22:50:03.016015] [INFO ] [MAIN ] DAL: Generated 1794 derivative records from 53753 primary records. [2025-09-17T22:50:03.019336] [INFO ] [MAIN ] DAY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:03.019436] [DEBUG] [LOCAL ] DAL: Saving derivative data. [2025-09-17T22:50:03.037264] [DEBUG] [LOCAL ] DAL: Derivative data saved (1794 records). [2025-09-17T22:50:03.048323] [INFO ] [MAIN ] DAL: Successfully saved derivative data. [2025-09-17T22:50:03.052838] [INFO ] [MAIN ] Derivative Progress: 492/2085 symbols completed. DAL took 1.3s. Estimated remaining: 10m 18s. Rate: 154.7 symbols/min [2025-09-17T22:50:03.053452] [INFO ] [MAIN ] DBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:03.054869] [DEBUG] [LOCAL ] DAVA: Loaded 40308 existing records from primary storage. [2025-09-17T22:50:03.055166] [INFO ] [MAIN ] DAVA: Loaded 40308 primary data records. [2025-09-17T22:50:03.433467] [DEBUG] [LOCAL ] DAY: Loaded 50042 existing records from primary storage. [2025-09-17T22:50:03.433826] [INFO ] [MAIN ] DAY: Loaded 50042 primary data records. [2025-09-17T22:50:03.557256] [DEBUG] [LOCAL ] DBI: Loaded 45297 existing records from primary storage. [2025-09-17T22:50:03.557550] [INFO ] [MAIN ] DBI: Loaded 45297 primary data records. [2025-09-17T22:50:04.099945] [DEBUG] [MAIN ] DAVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:04.101390] [INFO ] [MAIN ] DAVA: Generated 1794 derivative records from 40308 primary records. [2025-09-17T22:50:04.101809] [DEBUG] [LOCAL ] DAVA: Saving derivative data. [2025-09-17T22:50:04.120359] [DEBUG] [LOCAL ] DAVA: Derivative data saved (1794 records). [2025-09-17T22:50:04.120591] [INFO ] [MAIN ] DAVA: Successfully saved derivative data. [2025-09-17T22:50:04.122724] [INFO ] [MAIN ] Derivative Progress: 493/2085 symbols completed. DAVA took 1.2s. Estimated remaining: 10m 20s. Rate: 154.1 symbols/min [2025-09-17T22:50:04.140051] [DEBUG] [MAIN ] DAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:04.141039] [INFO ] [MAIN ] DAY: Generated 1794 derivative records from 50042 primary records. [2025-09-17T22:50:04.141195] [DEBUG] [LOCAL ] DAY: Saving derivative data. [2025-09-17T22:50:04.165904] [DEBUG] [LOCAL ] DAY: Derivative data saved (1794 records). [2025-09-17T22:50:04.179236] [DEBUG] [MAIN ] DBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:04.178943] [INFO ] [MAIN ] DAY: Successfully saved derivative data. [2025-09-17T22:50:04.180032] [INFO ] [MAIN ] DBI: Generated 1794 derivative records from 45297 primary records. [2025-09-17T22:50:04.182718] [INFO ] [MAIN ] Derivative Progress: 494/2085 symbols completed. DAY took 1.2s. Estimated remaining: 10m 18s. Rate: 154.4 symbols/min [2025-09-17T22:50:04.182785] [DEBUG] [LOCAL ] DBI: Saving derivative data. [2025-09-17T22:50:04.199421] [DEBUG] [LOCAL ] DBI: Derivative data saved (1794 records). [2025-09-17T22:50:04.199492] [INFO ] [MAIN ] DBI: Successfully saved derivative data. [2025-09-17T22:50:04.202392] [INFO ] [MAIN ] Derivative Progress: 495/2085 symbols completed. DBI took 1.1s. Estimated remaining: 10m 17s. Rate: 154.7 symbols/min [2025-09-17T22:50:04.203087] [INFO ] [MAIN ] DBRG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:04.203290] [INFO ] [MAIN ] DDD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:04.203732] [INFO ] [MAIN ] DCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:04.225760] [DEBUG] [LOCAL ] DCO: Loaded 13509 existing records from primary storage. [2025-09-17T22:50:04.225985] [INFO ] [MAIN ] DCO: Loaded 13509 primary data records. [2025-09-17T22:50:04.581196] [DEBUG] [LOCAL ] DDD: Loaded 50817 existing records from primary storage. [2025-09-17T22:50:04.595825] [INFO ] [MAIN ] DDD: Loaded 50817 primary data records. [2025-09-17T22:50:04.595690] [DEBUG] [LOCAL ] DBRG: Loaded 49831 existing records from primary storage. [2025-09-17T22:50:04.596064] [INFO ] [MAIN ] DBRG: Loaded 49831 primary data records. [2025-09-17T22:50:05.279713] [DEBUG] [MAIN ] DCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:05.281256] [INFO ] [MAIN ] DCO: Generated 1794 derivative records from 13509 primary records. [2025-09-17T22:50:05.282300] [DEBUG] [LOCAL ] DCO: Saving derivative data. [2025-09-17T22:50:05.304112] [DEBUG] [LOCAL ] DCO: Derivative data saved (1794 records). [2025-09-17T22:50:05.305590] [INFO ] [MAIN ] DCO: Successfully saved derivative data. [2025-09-17T22:50:05.307934] [INFO ] [MAIN ] Derivative Progress: 496/2085 symbols completed. DCO took 1.1s. Estimated remaining: 10m 19s. Rate: 154.1 symbols/min [2025-09-17T22:50:05.308384] [INFO ] [MAIN ] DDL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:05.325085] [DEBUG] [MAIN ] DDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:05.326606] [INFO ] [MAIN ] DDD: Generated 1794 derivative records from 50817 primary records. [2025-09-17T22:50:05.326822] [DEBUG] [LOCAL ] DDD: Saving derivative data. [2025-09-17T22:50:05.356229] [DEBUG] [LOCAL ] DDD: Derivative data saved (1794 records). [2025-09-17T22:50:05.355099] [DEBUG] [MAIN ] DBRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:05.356382] [INFO ] [MAIN ] DDD: Successfully saved derivative data. [2025-09-17T22:50:05.357123] [INFO ] [MAIN ] DBRG: Generated 1794 derivative records from 49831 primary records. [2025-09-17T22:50:05.359963] [INFO ] [MAIN ] Derivative Progress: 497/2085 symbols completed. DDD took 1.2s. Estimated remaining: 10m 17s. Rate: 154.4 symbols/min [2025-09-17T22:50:05.360412] [INFO ] [MAIN ] DDS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:05.360366] [DEBUG] [LOCAL ] DBRG: Saving derivative data. [2025-09-17T22:50:05.386702] [DEBUG] [LOCAL ] DBRG: Derivative data saved (1794 records). [2025-09-17T22:50:05.386948] [INFO ] [MAIN ] DBRG: Successfully saved derivative data. [2025-09-17T22:50:05.389477] [INFO ] [MAIN ] Derivative Progress: 498/2085 symbols completed. DBRG took 1.2s. Estimated remaining: 10m 16s. Rate: 154.7 symbols/min [2025-09-17T22:50:05.389773] [INFO ] [MAIN ] DDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:05.406500] [DEBUG] [LOCAL ] DDL: Loaded 36306 existing records from primary storage. [2025-09-17T22:50:05.408664] [DEBUG] [LOCAL ] DDT: Loaded 2079 existing records from primary storage. [2025-09-17T22:50:05.408896] [INFO ] [MAIN ] DDL: Loaded 36306 primary data records. [2025-09-17T22:50:05.408983] [INFO ] [MAIN ] DDT: Loaded 2079 primary data records. [2025-09-17T22:50:05.468983] [DEBUG] [LOCAL ] DDS: Loaded 13559 existing records from primary storage. [2025-09-17T22:50:05.581957] [INFO ] [MAIN ] DDS: Loaded 13559 primary data records. [2025-09-17T22:50:06.438311] [DEBUG] [MAIN ] DDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:06.450962] [INFO ] [MAIN ] DDL: Generated 1794 derivative records from 36306 primary records. [2025-09-17T22:50:06.451267] [DEBUG] [LOCAL ] DDL: Saving derivative data. [2025-09-17T22:50:06.452512] [DEBUG] [MAIN ] DDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:06.453414] [INFO ] [MAIN ] DDT: Generated 1794 derivative records from 2079 primary records. [2025-09-17T22:50:06.453731] [DEBUG] [LOCAL ] DDT: Saving derivative data. [2025-09-17T22:50:06.482437] [DEBUG] [LOCAL ] DDT: Derivative data saved (1794 records). [2025-09-17T22:50:06.491044] [INFO ] [MAIN ] DDT: Successfully saved derivative data. [2025-09-17T22:50:06.498922] [INFO ] [MAIN ] Derivative Progress: 499/2085 symbols completed. DDT took 1.1s. Estimated remaining: 10m 17s. Rate: 154.1 symbols/min [2025-09-17T22:50:06.499301] [DEBUG] [MAIN ] DDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:06.500587] [INFO ] [MAIN ] DDS: Generated 1794 derivative records from 13559 primary records. [2025-09-17T22:50:06.499565] [INFO ] [MAIN ] DEA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:06.501001] [DEBUG] [LOCAL ] DDS: Saving derivative data. [2025-09-17T22:50:06.502891] [DEBUG] [LOCAL ] DDL: Derivative data saved (1794 records). [2025-09-17T22:50:06.503157] [INFO ] [MAIN ] DDL: Successfully saved derivative data. [2025-09-17T22:50:06.505447] [INFO ] [MAIN ] Derivative Progress: 500/2085 symbols completed. DDL took 1.2s. Estimated remaining: 10m 16s. Rate: 154.4 symbols/min [2025-09-17T22:50:06.517028] [INFO ] [MAIN ] DEC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:06.522041] [DEBUG] [LOCAL ] DDS: Derivative data saved (1794 records). [2025-09-17T22:50:06.522222] [INFO ] [MAIN ] DDS: Successfully saved derivative data. [2025-09-17T22:50:06.525014] [INFO ] [MAIN ] Derivative Progress: 501/2085 symbols completed. DDS took 1.2s. Estimated remaining: 10m 14s. Rate: 154.7 symbols/min [2025-09-17T22:50:06.525381] [INFO ] [MAIN ] DEI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:06.565492] [DEBUG] [LOCAL ] DEC: Loaded 31026 existing records from primary storage. [2025-09-17T22:50:06.565688] [INFO ] [MAIN ] DEC: Loaded 31026 primary data records. [2025-09-17T22:50:06.648812] [DEBUG] [LOCAL ] DEA: Loaded 41744 existing records from primary storage. [2025-09-17T22:50:06.672079] [INFO ] [MAIN ] DEA: Loaded 41744 primary data records. [2025-09-17T22:50:06.872387] [DEBUG] [LOCAL ] DEI: Loaded 48536 existing records from primary storage. [2025-09-17T22:50:07.025327] [INFO ] [MAIN ] DEI: Loaded 48536 primary data records. [2025-09-17T22:50:07.635597] [DEBUG] [MAIN ] DEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:07.637000] [INFO ] [MAIN ] DEC: Generated 1794 derivative records from 31026 primary records. [2025-09-17T22:50:07.638634] [DEBUG] [LOCAL ] DEC: Saving derivative data. [2025-09-17T22:50:07.673377] [DEBUG] [MAIN ] DEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:07.675251] [INFO ] [MAIN ] DEA: Generated 1794 derivative records from 41744 primary records. [2025-09-17T22:50:07.674416] [DEBUG] [LOCAL ] DEC: Derivative data saved (1794 records). [2025-09-17T22:50:07.675562] [DEBUG] [LOCAL ] DEA: Saving derivative data. [2025-09-17T22:50:07.675611] [INFO ] [MAIN ] DEC: Successfully saved derivative data. [2025-09-17T22:50:07.678659] [INFO ] [MAIN ] Derivative Progress: 502/2085 symbols completed. DEC took 1.2s. Estimated remaining: 10m 16s. Rate: 154.1 symbols/min [2025-09-17T22:50:07.689277] [INFO ] [MAIN ] DELL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:07.710591] [DEBUG] [LOCAL ] DEA: Derivative data saved (1794 records). [2025-09-17T22:50:07.711618] [INFO ] [MAIN ] DEA: Successfully saved derivative data. [2025-09-17T22:50:07.713862] [INFO ] [MAIN ] Derivative Progress: 503/2085 symbols completed. DEA took 1.2s. Estimated remaining: 10m 15s. Rate: 154.4 symbols/min [2025-09-17T22:50:07.714210] [INFO ] [MAIN ] DEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:07.711424] [DEBUG] [MAIN ] DEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:07.715558] [INFO ] [MAIN ] DEI: Generated 1794 derivative records from 48536 primary records. [2025-09-17T22:50:07.715799] [DEBUG] [LOCAL ] DEI: Saving derivative data. [2025-09-17T22:50:07.737971] [DEBUG] [LOCAL ] DEI: Derivative data saved (1794 records). [2025-09-17T22:50:07.738135] [INFO ] [MAIN ] DEI: Successfully saved derivative data. [2025-09-17T22:50:07.741616] [INFO ] [MAIN ] Derivative Progress: 504/2085 symbols completed. DEI took 1.2s. Estimated remaining: 10m 13s. Rate: 154.7 symbols/min [2025-09-17T22:50:07.741975] [INFO ] [MAIN ] DFH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:07.794690] [DEBUG] [LOCAL ] DEO: Loaded 48969 existing records from primary storage. [2025-09-17T22:50:07.818674] [INFO ] [MAIN ] DEO: Loaded 48969 primary data records. [2025-09-17T22:50:07.831796] [DEBUG] [LOCAL ] DELL: Loaded 53736 existing records from primary storage. [2025-09-17T22:50:07.866762] [INFO ] [MAIN ] DELL: Loaded 53736 primary data records. [2025-09-17T22:50:07.892512] [DEBUG] [LOCAL ] DFH: Loaded 33130 existing records from primary storage. [2025-09-17T22:50:07.902964] [INFO ] [MAIN ] DFH: Loaded 33130 primary data records. [2025-09-17T22:50:08.817356] [DEBUG] [MAIN ] DEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:08.818519] [INFO ] [MAIN ] DEO: Generated 1794 derivative records from 48969 primary records. [2025-09-17T22:50:08.819228] [DEBUG] [LOCAL ] DEO: Saving derivative data. [2025-09-17T22:50:08.868546] [DEBUG] [MAIN ] DFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:08.868031] [DEBUG] [MAIN ] DELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:08.869415] [INFO ] [MAIN ] DELL: Generated 1794 derivative records from 53736 primary records. [2025-09-17T22:50:08.870567] [INFO ] [MAIN ] DFH: Generated 1794 derivative records from 33130 primary records. [2025-09-17T22:50:08.869795] [DEBUG] [LOCAL ] DELL: Saving derivative data. [2025-09-17T22:50:08.871794] [DEBUG] [LOCAL ] DFH: Saving derivative data. [2025-09-17T22:50:08.871869] [DEBUG] [LOCAL ] DEO: Derivative data saved (1794 records). [2025-09-17T22:50:08.880081] [INFO ] [MAIN ] DEO: Successfully saved derivative data. [2025-09-17T22:50:08.885534] [INFO ] [MAIN ] Derivative Progress: 505/2085 symbols completed. DEO took 1.2s. Estimated remaining: 10m 15s. Rate: 154.1 symbols/min [2025-09-17T22:50:08.888736] [INFO ] [MAIN ] DFIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:08.900238] [DEBUG] [LOCAL ] DELL: Derivative data saved (1794 records). [2025-09-17T22:50:08.900450] [INFO ] [MAIN ] DELL: Successfully saved derivative data. [2025-09-17T22:50:08.904415] [INFO ] [MAIN ] Derivative Progress: 506/2085 symbols completed. DELL took 1.2s. Estimated remaining: 10m 14s. Rate: 154.4 symbols/min [2025-09-17T22:50:08.910706] [INFO ] [MAIN ] DFP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:08.916150] [DEBUG] [LOCAL ] DFH: Derivative data saved (1794 records). [2025-09-17T22:50:08.916361] [INFO ] [MAIN ] DFH: Successfully saved derivative data. [2025-09-17T22:50:08.919850] [INFO ] [MAIN ] Derivative Progress: 507/2085 symbols completed. DFH took 1.2s. Estimated remaining: 10m 12s. Rate: 154.7 symbols/min [2025-09-17T22:50:08.923282] [INFO ] [MAIN ] DG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:08.937570] [DEBUG] [LOCAL ] DFP: Loaded 11799 existing records from primary storage. [2025-09-17T22:50:08.937745] [INFO ] [MAIN ] DFP: Loaded 11799 primary data records. [2025-09-17T22:50:09.021269] [DEBUG] [LOCAL ] DFIN: Loaded 23550 existing records from primary storage. [2025-09-17T22:50:09.033377] [INFO ] [MAIN ] DFIN: Loaded 23550 primary data records. [2025-09-17T22:50:09.554226] [DEBUG] [LOCAL ] DG: Loaded 53309 existing records from primary storage. [2025-09-17T22:50:09.648119] [INFO ] [MAIN ] DG: Loaded 53309 primary data records. [2025-09-17T22:50:09.995567] [DEBUG] [MAIN ] DFP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:09.996973] [INFO ] [MAIN ] DFP: Generated 1794 derivative records from 11799 primary records. [2025-09-17T22:50:09.997194] [DEBUG] [LOCAL ] DFP: Saving derivative data. [2025-09-17T22:50:10.027202] [DEBUG] [LOCAL ] DFP: Derivative data saved (1794 records). [2025-09-17T22:50:10.026452] [DEBUG] [MAIN ] DFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:10.028560] [INFO ] [MAIN ] DFP: Successfully saved derivative data. [2025-09-17T22:50:10.028285] [INFO ] [MAIN ] DFIN: Generated 1794 derivative records from 23550 primary records. [2025-09-17T22:50:10.028706] [DEBUG] [LOCAL ] DFIN: Saving derivative data. [2025-09-17T22:50:10.030748] [INFO ] [MAIN ] Derivative Progress: 508/2085 symbols completed. DFP took 1.1s. Estimated remaining: 10m 14s. Rate: 154.1 symbols/min [2025-09-17T22:50:10.047969] [DEBUG] [LOCAL ] DFIN: Derivative data saved (1794 records). [2025-09-17T22:50:10.048213] [INFO ] [MAIN ] DFIN: Successfully saved derivative data. [2025-09-17T22:50:10.050672] [INFO ] [MAIN ] Derivative Progress: 509/2085 symbols completed. DFIN took 1.2s. Estimated remaining: 10m 13s. Rate: 154.4 symbols/min [2025-09-17T22:50:10.066176] [DEBUG] [MAIN ] DG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:10.066792] [INFO ] [MAIN ] DG: Generated 1794 derivative records from 53309 primary records. [2025-09-17T22:50:10.066855] [DEBUG] [LOCAL ] DG: Saving derivative data. [2025-09-17T22:50:10.082331] [DEBUG] [LOCAL ] DG: Derivative data saved (1794 records). [2025-09-17T22:50:10.082391] [INFO ] [MAIN ] DG: Successfully saved derivative data. [2025-09-17T22:50:10.085512] [INFO ] [MAIN ] Derivative Progress: 510/2085 symbols completed. DG took 1.2s. Estimated remaining: 10m 11s. Rate: 154.7 symbols/min [2025-09-17T22:50:10.086045] [INFO ] [MAIN ] DHF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:10.086522] [INFO ] [MAIN ] DHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:10.086334] [INFO ] [MAIN ] DHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:10.114508] [DEBUG] [LOCAL ] DHF: Loaded 21199 existing records from primary storage. [2025-09-17T22:50:10.114701] [INFO ] [MAIN ] DHF: Loaded 21199 primary data records. [2025-09-17T22:50:10.467927] [DEBUG] [LOCAL ] DHI: Loaded 53375 existing records from primary storage. [2025-09-17T22:50:10.466679] [DEBUG] [LOCAL ] DHR: Loaded 53371 existing records from primary storage. [2025-09-17T22:50:10.473337] [INFO ] [MAIN ] DHI: Loaded 53375 primary data records. [2025-09-17T22:50:10.473268] [INFO ] [MAIN ] DHR: Loaded 53371 primary data records. [2025-09-17T22:50:11.123987] [DEBUG] [MAIN ] DHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:11.125580] [INFO ] [MAIN ] DHF: Generated 1794 derivative records from 21199 primary records. [2025-09-17T22:50:11.126687] [DEBUG] [LOCAL ] DHF: Saving derivative data. [2025-09-17T22:50:11.145286] [DEBUG] [LOCAL ] DHF: Derivative data saved (1794 records). [2025-09-17T22:50:11.145791] [INFO ] [MAIN ] DHF: Successfully saved derivative data. [2025-09-17T22:50:11.148439] [INFO ] [MAIN ] Derivative Progress: 511/2085 symbols completed. DHF took 1.1s. Estimated remaining: 10m 13s. Rate: 154.1 symbols/min [2025-09-17T22:50:11.149200] [INFO ] [MAIN ] DHT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:11.167945] [DEBUG] [MAIN ] DHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:11.171426] [INFO ] [MAIN ] DHI: Generated 1794 derivative records from 53375 primary records. [2025-09-17T22:50:11.171873] [DEBUG] [LOCAL ] DHI: Saving derivative data. [2025-09-17T22:50:11.198833] [DEBUG] [MAIN ] DHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:11.201538] [INFO ] [MAIN ] DHR: Generated 1794 derivative records from 53371 primary records. [2025-09-17T22:50:11.204449] [DEBUG] [LOCAL ] DHI: Derivative data saved (1794 records). [2025-09-17T22:50:11.204541] [DEBUG] [LOCAL ] DHR: Saving derivative data. [2025-09-17T22:50:11.205469] [INFO ] [MAIN ] DHI: Successfully saved derivative data. [2025-09-17T22:50:11.207586] [INFO ] [MAIN ] Derivative Progress: 512/2085 symbols completed. DHI took 1.1s. Estimated remaining: 10m 11s. Rate: 154.4 symbols/min [2025-09-17T22:50:11.207932] [INFO ] [MAIN ] DHX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:11.234589] [DEBUG] [LOCAL ] DHR: Derivative data saved (1794 records). [2025-09-17T22:50:11.234826] [INFO ] [MAIN ] DHR: Successfully saved derivative data. [2025-09-17T22:50:11.237836] [INFO ] [MAIN ] Derivative Progress: 513/2085 symbols completed. DHR took 1.2s. Estimated remaining: 10m 10s. Rate: 154.7 symbols/min [2025-09-17T22:50:11.238291] [INFO ] [MAIN ] DIAX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:11.250931] [DEBUG] [LOCAL ] DHX: Loaded 13221 existing records from primary storage. [2025-09-17T22:50:11.251193] [INFO ] [MAIN ] DHX: Loaded 13221 primary data records. [2025-09-17T22:50:11.320488] [DEBUG] [LOCAL ] DHT: Loaded 48062 existing records from primary storage. [2025-09-17T22:50:11.365485] [INFO ] [MAIN ] DHT: Loaded 48062 primary data records. [2025-09-17T22:50:11.373589] [DEBUG] [LOCAL ] DIAX: Loaded 12293 existing records from primary storage. [2025-09-17T22:50:11.385822] [INFO ] [MAIN ] DIAX: Loaded 12293 primary data records. [2025-09-17T22:50:12.273877] [DEBUG] [MAIN ] DHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:12.284909] [INFO ] [MAIN ] DHX: Generated 1794 derivative records from 13221 primary records. [2025-09-17T22:50:12.285496] [DEBUG] [LOCAL ] DHX: Saving derivative data. [2025-09-17T22:50:12.292770] [DEBUG] [MAIN ] DIAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:12.308191] [INFO ] [MAIN ] DIAX: Generated 1794 derivative records from 12293 primary records. [2025-09-17T22:50:12.322293] [DEBUG] [LOCAL ] DHX: Derivative data saved (1794 records). [2025-09-17T22:50:12.321846] [DEBUG] [LOCAL ] DIAX: Saving derivative data. [2025-09-17T22:50:12.323513] [INFO ] [MAIN ] DHX: Successfully saved derivative data. [2025-09-17T22:50:12.322204] [DEBUG] [MAIN ] DHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:12.324485] [INFO ] [MAIN ] DHT: Generated 1794 derivative records from 48062 primary records. [2025-09-17T22:50:12.326930] [INFO ] [MAIN ] Derivative Progress: 514/2085 symbols completed. DHX took 1.1s. Estimated remaining: 10m 12s. Rate: 154.1 symbols/min [2025-09-17T22:50:12.334040] [INFO ] [MAIN ] DIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:12.335585] [DEBUG] [LOCAL ] DHT: Saving derivative data. [2025-09-17T22:50:12.344228] [DEBUG] [LOCAL ] DIAX: Derivative data saved (1794 records). [2025-09-17T22:50:12.351857] [INFO ] [MAIN ] DIAX: Successfully saved derivative data. [2025-09-17T22:50:12.355952] [INFO ] [MAIN ] Derivative Progress: 515/2085 symbols completed. DIAX took 1.1s. Estimated remaining: 10m 10s. Rate: 154.4 symbols/min [2025-09-17T22:50:12.359759] [INFO ] [MAIN ] DINO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:12.364669] [DEBUG] [LOCAL ] DHT: Derivative data saved (1794 records). [2025-09-17T22:50:12.364935] [INFO ] [MAIN ] DHT: Successfully saved derivative data. [2025-09-17T22:50:12.367412] [INFO ] [MAIN ] Derivative Progress: 516/2085 symbols completed. DHT took 1.2s. Estimated remaining: 10m 9s. Rate: 154.7 symbols/min [2025-09-17T22:50:12.367693] [INFO ] [MAIN ] DIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:12.415344] [DEBUG] [LOCAL ] DIN: Loaded 37411 existing records from primary storage. [2025-09-17T22:50:12.415530] [INFO ] [MAIN ] DIN: Loaded 37411 primary data records. [2025-09-17T22:50:12.563860] [DEBUG] [LOCAL ] DINO: Loaded 52974 existing records from primary storage. [2025-09-17T22:50:12.564210] [INFO ] [MAIN ] DINO: Loaded 52974 primary data records. [2025-09-17T22:50:12.966887] [DEBUG] [LOCAL ] DIS: Loaded 53788 existing records from primary storage. [2025-09-17T22:50:13.016857] [INFO ] [MAIN ] DIS: Loaded 53788 primary data records. [2025-09-17T22:50:13.568066] [DEBUG] [MAIN ] DIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:13.570035] [INFO ] [MAIN ] DIN: Generated 1794 derivative records from 37411 primary records. [2025-09-17T22:50:13.570171] [DEBUG] [LOCAL ] DIN: Saving derivative data. [2025-09-17T22:50:13.591066] [DEBUG] [LOCAL ] DIN: Derivative data saved (1794 records). [2025-09-17T22:50:13.603565] [INFO ] [MAIN ] DIN: Successfully saved derivative data. [2025-09-17T22:50:13.604392] [DEBUG] [MAIN ] DINO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:13.607204] [INFO ] [MAIN ] Derivative Progress: 517/2085 symbols completed. DIN took 1.3s. Estimated remaining: 10m 11s. Rate: 154.0 symbols/min [2025-09-17T22:50:13.605177] [INFO ] [MAIN ] DINO: Generated 1794 derivative records from 52974 primary records. [2025-09-17T22:50:13.607798] [INFO ] [MAIN ] DKL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:13.608305] [DEBUG] [LOCAL ] DINO: Saving derivative data. [2025-09-17T22:50:13.628144] [DEBUG] [LOCAL ] DINO: Derivative data saved (1794 records). [2025-09-17T22:50:13.628336] [INFO ] [MAIN ] DINO: Successfully saved derivative data. [2025-09-17T22:50:13.648283] [INFO ] [MAIN ] Derivative Progress: 518/2085 symbols completed. DINO took 1.3s. Estimated remaining: 10m 9s. Rate: 154.3 symbols/min [2025-09-17T22:50:13.645433] [DEBUG] [MAIN ] DIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:13.649504] [INFO ] [MAIN ] DIS: Generated 1794 derivative records from 53788 primary records. [2025-09-17T22:50:13.649677] [INFO ] [MAIN ] DKS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:13.649781] [DEBUG] [LOCAL ] DIS: Saving derivative data. [2025-09-17T22:50:13.672941] [DEBUG] [LOCAL ] DIS: Derivative data saved (1794 records). [2025-09-17T22:50:13.674099] [INFO ] [MAIN ] DIS: Successfully saved derivative data. [2025-09-17T22:50:13.677247] [INFO ] [MAIN ] Derivative Progress: 519/2085 symbols completed. DIS took 1.3s. Estimated remaining: 10m 8s. Rate: 154.6 symbols/min [2025-09-17T22:50:13.677535] [INFO ] [MAIN ] DLB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:13.674495] [DEBUG] [LOCAL ] DKL: Loaded 19568 existing records from primary storage. [2025-09-17T22:50:13.678173] [INFO ] [MAIN ] DKL: Loaded 19568 primary data records. [2025-09-17T22:50:14.015590] [DEBUG] [LOCAL ] DLB: Loaded 32282 existing records from primary storage. [2025-09-17T22:50:14.016981] [INFO ] [MAIN ] DLB: Loaded 32282 primary data records. [2025-09-17T22:50:14.123001] [DEBUG] [LOCAL ] DKS: Loaded 49985 existing records from primary storage. [2025-09-17T22:50:14.144470] [INFO ] [MAIN ] DKS: Loaded 49985 primary data records. [2025-09-17T22:50:14.720435] [DEBUG] [MAIN ] DKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:14.723204] [INFO ] [MAIN ] DKL: Generated 1794 derivative records from 19568 primary records. [2025-09-17T22:50:14.723808] [DEBUG] [LOCAL ] DKL: Saving derivative data. [2025-09-17T22:50:14.745951] [DEBUG] [LOCAL ] DKL: Derivative data saved (1794 records). [2025-09-17T22:50:14.747873] [INFO ] [MAIN ] DKL: Successfully saved derivative data. [2025-09-17T22:50:14.750681] [INFO ] [MAIN ] Derivative Progress: 520/2085 symbols completed. DKL took 1.1s. Estimated remaining: 10m 10s. Rate: 154.1 symbols/min [2025-09-17T22:50:14.751416] [INFO ] [MAIN ] DLNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:14.782510] [DEBUG] [MAIN ] DLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:14.782133] [DEBUG] [LOCAL ] DLNG: Loaded 6311 existing records from primary storage. [2025-09-17T22:50:14.783639] [INFO ] [MAIN ] DLB: Generated 1794 derivative records from 32282 primary records. [2025-09-17T22:50:14.784543] [INFO ] [MAIN ] DLNG: Loaded 6311 primary data records. [2025-09-17T22:50:14.806733] [DEBUG] [LOCAL ] DLB: Saving derivative data. [2025-09-17T22:50:14.924543] [DEBUG] [MAIN ] DKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:14.937024] [INFO ] [MAIN ] DKS: Generated 1794 derivative records from 49985 primary records. [2025-09-17T22:50:14.947919] [DEBUG] [LOCAL ] DKS: Saving derivative data. [2025-09-17T22:50:15.136782] [DEBUG] [LOCAL ] DKS: Derivative data saved (1794 records). [2025-09-17T22:50:15.146946] [INFO ] [MAIN ] DKS: Successfully saved derivative data. [2025-09-17T22:50:15.150791] [INFO ] [MAIN ] Derivative Progress: 521/2085 symbols completed. DKS took 1.5s. Estimated remaining: 10m 9s. Rate: 154.0 symbols/min [2025-09-17T22:50:15.150990] [DEBUG] [LOCAL ] DLB: Derivative data saved (1794 records). [2025-09-17T22:50:15.151293] [INFO ] [MAIN ] DLR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:15.152131] [INFO ] [MAIN ] DLB: Successfully saved derivative data. [2025-09-17T22:50:15.155081] [INFO ] [MAIN ] Derivative Progress: 522/2085 symbols completed. DLB took 1.5s. Estimated remaining: 10m 8s. Rate: 154.3 symbols/min [2025-09-17T22:50:15.155558] [INFO ] [MAIN ] DLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:15.200575] [DEBUG] [MAIN ] DLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:15.201394] [INFO ] [MAIN ] DLNG: Generated 1794 derivative records from 6311 primary records. [2025-09-17T22:50:15.210960] [DEBUG] [LOCAL ] DLNG: Saving derivative data. [2025-09-17T22:50:15.225479] [DEBUG] [LOCAL ] DLX: Loaded 29317 existing records from primary storage. [2025-09-17T22:50:15.236144] [INFO ] [MAIN ] DLX: Loaded 29317 primary data records. [2025-09-17T22:50:15.300226] [DEBUG] [LOCAL ] DLNG: Derivative data saved (1794 records). [2025-09-17T22:50:15.314751] [INFO ] [MAIN ] DLNG: Successfully saved derivative data. [2025-09-17T22:50:15.350385] [INFO ] [MAIN ] Derivative Progress: 523/2085 symbols completed. DLNG took 0.6s. Estimated remaining: 10m 7s. Rate: 154.5 symbols/min [2025-09-17T22:50:15.375457] [DEBUG] [LOCAL ] DLR: Loaded 51265 existing records from primary storage. [2025-09-17T22:50:15.396347] [INFO ] [MAIN ] DLR: Loaded 51265 primary data records. [2025-09-17T22:50:15.993261] [DEBUG] [MAIN ] DLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:15.994460] [INFO ] [MAIN ] DLX: Generated 1794 derivative records from 29317 primary records. [2025-09-17T22:50:15.995481] [DEBUG] [LOCAL ] DLX: Saving derivative data. [2025-09-17T22:50:16.024599] [DEBUG] [MAIN ] DLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:16.027685] [INFO ] [MAIN ] DLR: Generated 1794 derivative records from 51265 primary records. [2025-09-17T22:50:16.027776] [DEBUG] [LOCAL ] DLR: Saving derivative data. [2025-09-17T22:50:16.026852] [DEBUG] [LOCAL ] DLX: Derivative data saved (1794 records). [2025-09-17T22:50:16.028237] [INFO ] [MAIN ] DLX: Successfully saved derivative data. [2025-09-17T22:50:16.030438] [INFO ] [MAIN ] Derivative Progress: 524/2085 symbols completed. DLX took 0.9s. Estimated remaining: 10m 7s. Rate: 154.3 symbols/min [2025-09-17T22:50:16.046155] [DEBUG] [LOCAL ] DLR: Derivative data saved (1794 records). [2025-09-17T22:50:16.046260] [INFO ] [MAIN ] DLR: Successfully saved derivative data. [2025-09-17T22:50:16.049001] [INFO ] [MAIN ] Derivative Progress: 525/2085 symbols completed. DLR took 0.9s. Estimated remaining: 10m 6s. Rate: 154.5 symbols/min [2025-09-17T22:50:16.049907] [INFO ] [MAIN ] DLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:16.049724] [INFO ] [MAIN ] DMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:16.050417] [INFO ] [MAIN ] DNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:16.062219] [DEBUG] [LOCAL ] DMO: Loaded 9862 existing records from primary storage. [2025-09-17T22:50:16.062353] [INFO ] [MAIN ] DMO: Loaded 9862 primary data records. [2025-09-17T22:50:16.196592] [DEBUG] [LOCAL ] DLY: Loaded 19271 existing records from primary storage. [2025-09-17T22:50:16.246336] [INFO ] [MAIN ] DLY: Loaded 19271 primary data records. [2025-09-17T22:50:16.502668] [DEBUG] [LOCAL ] DNA: Loaded 48544 existing records from primary storage. [2025-09-17T22:50:16.521204] [INFO ] [MAIN ] DNA: Loaded 48544 primary data records. [2025-09-17T22:50:17.091175] [DEBUG] [MAIN ] DMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:17.095056] [INFO ] [MAIN ] DMO: Generated 1794 derivative records from 9862 primary records. [2025-09-17T22:50:17.095772] [DEBUG] [LOCAL ] DMO: Saving derivative data. [2025-09-17T22:50:17.114921] [DEBUG] [LOCAL ] DMO: Derivative data saved (1794 records). [2025-09-17T22:50:17.115423] [INFO ] [MAIN ] DMO: Successfully saved derivative data. [2025-09-17T22:50:17.117738] [INFO ] [MAIN ] Derivative Progress: 526/2085 symbols completed. DMO took 1.1s. Estimated remaining: 10m 7s. Rate: 154.0 symbols/min [2025-09-17T22:50:17.127030] [INFO ] [MAIN ] DNOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:17.132825] [DEBUG] [MAIN ] DLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:17.133982] [INFO ] [MAIN ] DLY: Generated 1794 derivative records from 19271 primary records. [2025-09-17T22:50:17.134194] [DEBUG] [LOCAL ] DLY: Saving derivative data. [2025-09-17T22:50:17.155874] [DEBUG] [LOCAL ] DLY: Derivative data saved (1794 records). [2025-09-17T22:50:17.156235] [INFO ] [MAIN ] DLY: Successfully saved derivative data. [2025-09-17T22:50:17.158984] [INFO ] [MAIN ] Derivative Progress: 527/2085 symbols completed. DLY took 1.1s. Estimated remaining: 10m 6s. Rate: 154.3 symbols/min [2025-09-17T22:50:17.171919] [DEBUG] [MAIN ] DNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:17.172015] [INFO ] [MAIN ] DOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:17.172991] [INFO ] [MAIN ] DNA: Generated 1794 derivative records from 48544 primary records. [2025-09-17T22:50:17.173166] [DEBUG] [LOCAL ] DNA: Saving derivative data. [2025-09-17T22:50:17.200825] [DEBUG] [LOCAL ] DNA: Derivative data saved (1794 records). [2025-09-17T22:50:17.200950] [INFO ] [MAIN ] DNA: Successfully saved derivative data. [2025-09-17T22:50:17.203565] [INFO ] [MAIN ] Derivative Progress: 528/2085 symbols completed. DNA took 1.2s. Estimated remaining: 10m 4s. Rate: 154.6 symbols/min [2025-09-17T22:50:17.203967] [INFO ] [MAIN ] DOCN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:17.223124] [DEBUG] [LOCAL ] DNOW: Loaded 43483 existing records from primary storage. [2025-09-17T22:50:17.223388] [INFO ] [MAIN ] DNOW: Loaded 43483 primary data records. [2025-09-17T22:50:17.617212] [DEBUG] [LOCAL ] DOC: Loaded 53537 existing records from primary storage. [2025-09-17T22:50:17.618902] [INFO ] [MAIN ] DOC: Loaded 53537 primary data records. [2025-09-17T22:50:17.618687] [DEBUG] [LOCAL ] DOCN: Loaded 50400 existing records from primary storage. [2025-09-17T22:50:17.624677] [INFO ] [MAIN ] DOCN: Loaded 50400 primary data records. [2025-09-17T22:50:18.338489] [DEBUG] [MAIN ] DNOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:18.463820] [INFO ] [MAIN ] DNOW: Generated 1794 derivative records from 43483 primary records. [2025-09-17T22:50:18.604143] [DEBUG] [LOCAL ] DNOW: Saving derivative data. [2025-09-17T22:50:18.636288] [DEBUG] [LOCAL ] DNOW: Derivative data saved (1794 records). [2025-09-17T22:50:18.638049] [INFO ] [MAIN ] DNOW: Successfully saved derivative data. [2025-09-17T22:50:18.641343] [INFO ] [MAIN ] Derivative Progress: 529/2085 symbols completed. DNOW took 1.5s. Estimated remaining: 10m 7s. Rate: 153.8 symbols/min [2025-09-17T22:50:18.642663] [INFO ] [MAIN ] DOCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:18.680067] [DEBUG] [MAIN ] DOCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:18.686546] [INFO ] [MAIN ] DOCN: Generated 1794 derivative records from 50400 primary records. [2025-09-17T22:50:18.686670] [DEBUG] [LOCAL ] DOCN: Saving derivative data. [2025-09-17T22:50:18.685560] [DEBUG] [MAIN ] DOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:18.688149] [INFO ] [MAIN ] DOC: Generated 1794 derivative records from 53537 primary records. [2025-09-17T22:50:18.688342] [DEBUG] [LOCAL ] DOC: Saving derivative data. [2025-09-17T22:50:18.719286] [DEBUG] [LOCAL ] DOC: Derivative data saved (1794 records). [2025-09-17T22:50:18.734223] [INFO ] [MAIN ] DOC: Successfully saved derivative data. [2025-09-17T22:50:18.738733] [INFO ] [MAIN ] Derivative Progress: 530/2085 symbols completed. DOC took 1.6s. Estimated remaining: 10m 6s. Rate: 154.0 symbols/min [2025-09-17T22:50:18.741181] [DEBUG] [LOCAL ] DOCN: Derivative data saved (1794 records). [2025-09-17T22:50:18.741338] [INFO ] [MAIN ] DOCN: Successfully saved derivative data. [2025-09-17T22:50:18.740582] [INFO ] [MAIN ] DOLE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:18.744146] [INFO ] [MAIN ] Derivative Progress: 531/2085 symbols completed. DOCN took 1.5s. Estimated remaining: 10m 4s. Rate: 154.3 symbols/min [2025-09-17T22:50:18.744625] [INFO ] [MAIN ] DOUG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:18.764964] [DEBUG] [LOCAL ] DOCS: Loaded 51388 existing records from primary storage. [2025-09-17T22:50:18.765294] [INFO ] [MAIN ] DOCS: Loaded 51388 primary data records. [2025-09-17T22:50:19.140604] [DEBUG] [LOCAL ] DOUG: Loaded 34861 existing records from primary storage. [2025-09-17T22:50:19.141893] [INFO ] [MAIN ] DOUG: Loaded 34861 primary data records. [2025-09-17T22:50:19.164105] [DEBUG] [LOCAL ] DOLE: Loaded 37792 existing records from primary storage. [2025-09-17T22:50:19.187960] [INFO ] [MAIN ] DOLE: Loaded 37792 primary data records. [2025-09-17T22:50:19.787403] [DEBUG] [MAIN ] DOCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:19.789453] [INFO ] [MAIN ] DOCS: Generated 1794 derivative records from 51388 primary records. [2025-09-17T22:50:19.790445] [DEBUG] [LOCAL ] DOCS: Saving derivative data. [2025-09-17T22:50:19.810021] [DEBUG] [LOCAL ] DOCS: Derivative data saved (1794 records). [2025-09-17T22:50:19.810557] [INFO ] [MAIN ] DOCS: Successfully saved derivative data. [2025-09-17T22:50:19.812992] [INFO ] [MAIN ] Derivative Progress: 532/2085 symbols completed. DOCS took 1.2s. Estimated remaining: 10m 6s. Rate: 153.8 symbols/min [2025-09-17T22:50:19.813451] [INFO ] [MAIN ] DPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:19.857526] [DEBUG] [LOCAL ] DPG: Loaded 13284 existing records from primary storage. [2025-09-17T22:50:19.857880] [DEBUG] [MAIN ] DOUG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:19.858829] [DEBUG] [MAIN ] DOLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:19.859721] [INFO ] [MAIN ] DOLE: Generated 1794 derivative records from 37792 primary records. [2025-09-17T22:50:19.860517] [INFO ] [MAIN ] DOUG: Generated 1794 derivative records from 34861 primary records. [2025-09-17T22:50:19.859831] [DEBUG] [LOCAL ] DOLE: Saving derivative data. [2025-09-17T22:50:19.860637] [DEBUG] [LOCAL ] DOUG: Saving derivative data. [2025-09-17T22:50:19.858502] [INFO ] [MAIN ] DPG: Loaded 13284 primary data records. [2025-09-17T22:50:19.994306] [DEBUG] [LOCAL ] DOUG: Derivative data saved (1794 records). [2025-09-17T22:50:19.994404] [DEBUG] [LOCAL ] DOLE: Derivative data saved (1794 records). [2025-09-17T22:50:20.006060] [INFO ] [MAIN ] DOUG: Successfully saved derivative data. [2025-09-17T22:50:20.006232] [INFO ] [MAIN ] DOLE: Successfully saved derivative data. [2025-09-17T22:50:20.009978] [INFO ] [MAIN ] Derivative Progress: 533/2085 symbols completed. DOUG took 1.3s. Estimated remaining: 10m 5s. Rate: 153.9 symbols/min [2025-09-17T22:50:20.018570] [INFO ] [MAIN ] DQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:20.024007] [INFO ] [MAIN ] Derivative Progress: 534/2085 symbols completed. DOLE took 1.3s. Estimated remaining: 10m 4s. Rate: 154.2 symbols/min [2025-09-17T22:50:20.034671] [INFO ] [MAIN ] DRD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:20.291240] [DEBUG] [MAIN ] DPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:20.292106] [INFO ] [MAIN ] DPG: Generated 1794 derivative records from 13284 primary records. [2025-09-17T22:50:20.292274] [DEBUG] [LOCAL ] DPG: Saving derivative data. [2025-09-17T22:50:20.305183] [DEBUG] [LOCAL ] DRD: Loaded 36296 existing records from primary storage. [2025-09-17T22:50:20.316715] [INFO ] [MAIN ] DRD: Loaded 36296 primary data records. [2025-09-17T22:50:20.344746] [DEBUG] [LOCAL ] DPG: Derivative data saved (1794 records). [2025-09-17T22:50:20.370282] [INFO ] [MAIN ] DPG: Successfully saved derivative data. [2025-09-17T22:50:20.380123] [INFO ] [MAIN ] Derivative Progress: 535/2085 symbols completed. DPG took 0.6s. Estimated remaining: 10m 3s. Rate: 154.2 symbols/min [2025-09-17T22:50:20.381183] [DEBUG] [LOCAL ] DQ: Loaded 43073 existing records from primary storage. [2025-09-17T22:50:20.386418] [INFO ] [MAIN ] DRH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:20.415282] [INFO ] [MAIN ] DQ: Loaded 43073 primary data records. [2025-09-17T22:50:20.988496] [DEBUG] [LOCAL ] DRH: Loaded 50435 existing records from primary storage. [2025-09-17T22:50:20.989935] [INFO ] [MAIN ] DRH: Loaded 50435 primary data records. [2025-09-17T22:50:21.314065] [DEBUG] [MAIN ] DRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:21.315338] [INFO ] [MAIN ] DRD: Generated 1794 derivative records from 36296 primary records. [2025-09-17T22:50:21.315984] [DEBUG] [LOCAL ] DRD: Saving derivative data. [2025-09-17T22:50:21.335999] [DEBUG] [LOCAL ] DRD: Derivative data saved (1794 records). [2025-09-17T22:50:21.349387] [INFO ] [MAIN ] DRD: Successfully saved derivative data. [2025-09-17T22:50:21.351786] [INFO ] [MAIN ] Derivative Progress: 536/2085 symbols completed. DRD took 1.3s. Estimated remaining: 10m 4s. Rate: 153.8 symbols/min [2025-09-17T22:50:21.352445] [INFO ] [MAIN ] DRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:21.352821] [DEBUG] [MAIN ] DQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:21.353885] [INFO ] [MAIN ] DQ: Generated 1794 derivative records from 43073 primary records. [2025-09-17T22:50:21.354342] [DEBUG] [LOCAL ] DQ: Saving derivative data. [2025-09-17T22:50:21.377546] [DEBUG] [LOCAL ] DQ: Derivative data saved (1794 records). [2025-09-17T22:50:21.377924] [INFO ] [MAIN ] DQ: Successfully saved derivative data. [2025-09-17T22:50:21.381075] [INFO ] [MAIN ] Derivative Progress: 537/2085 symbols completed. DQ took 1.4s. Estimated remaining: 10m 3s. Rate: 154.0 symbols/min [2025-09-17T22:50:21.394982] [DEBUG] [MAIN ] DRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:21.394506] [INFO ] [MAIN ] DRLL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:21.396171] [INFO ] [MAIN ] DRH: Generated 1794 derivative records from 50435 primary records. [2025-09-17T22:50:21.396369] [DEBUG] [LOCAL ] DRH: Saving derivative data. [2025-09-17T22:50:21.416007] [DEBUG] [LOCAL ] DRH: Derivative data saved (1794 records). [2025-09-17T22:50:21.426250] [INFO ] [MAIN ] DRH: Successfully saved derivative data. [2025-09-17T22:50:21.428828] [INFO ] [MAIN ] Derivative Progress: 538/2085 symbols completed. DRH took 1.0s. Estimated remaining: 10m 2s. Rate: 154.3 symbols/min [2025-09-17T22:50:21.436464] [DEBUG] [LOCAL ] DRLL: Loaded 10062 existing records from primary storage. [2025-09-17T22:50:21.436574] [INFO ] [MAIN ] DRLL: Loaded 10062 primary data records. [2025-09-17T22:50:21.561529] [DEBUG] [LOCAL ] DRI: Loaded 47796 existing records from primary storage. [2025-09-17T22:50:21.571949] [INFO ] [MAIN ] DRI: Loaded 47796 primary data records. [2025-09-17T22:50:22.083972] [DEBUG] [MAIN ] DRLL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:22.084918] [INFO ] [MAIN ] DRLL: Generated 1794 derivative records from 10062 primary records. [2025-09-17T22:50:22.085091] [DEBUG] [LOCAL ] DRLL: Saving derivative data. [2025-09-17T22:50:22.102262] [DEBUG] [LOCAL ] DRLL: Derivative data saved (1794 records). [2025-09-17T22:50:22.103188] [INFO ] [MAIN ] DRLL: Successfully saved derivative data. [2025-09-17T22:50:22.105918] [INFO ] [MAIN ] Derivative Progress: 539/2085 symbols completed. DRLL took 0.7s. Estimated remaining: 10m 2s. Rate: 154.1 symbols/min [2025-09-17T22:50:22.118814] [DEBUG] [MAIN ] DRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:22.119384] [INFO ] [MAIN ] DRI: Generated 1794 derivative records from 47796 primary records. [2025-09-17T22:50:22.119444] [DEBUG] [LOCAL ] DRI: Saving derivative data. [2025-09-17T22:50:22.134995] [DEBUG] [LOCAL ] DRI: Derivative data saved (1794 records). [2025-09-17T22:50:22.135097] [INFO ] [MAIN ] DRI: Successfully saved derivative data. [2025-09-17T22:50:22.137519] [INFO ] [MAIN ] Derivative Progress: 540/2085 symbols completed. DRI took 0.8s. Estimated remaining: 10m 1s. Rate: 154.3 symbols/min [2025-09-17T22:50:22.138347] [INFO ] [MAIN ] DSX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:22.138223] [INFO ] [MAIN ] DSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:22.138432] [INFO ] [MAIN ] DSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:22.169894] [DEBUG] [LOCAL ] DSM: Loaded 15865 existing records from primary storage. [2025-09-17T22:50:22.170044] [INFO ] [MAIN ] DSM: Loaded 15865 primary data records. [2025-09-17T22:50:22.252527] [DEBUG] [LOCAL ] DSX: Loaded 24715 existing records from primary storage. [2025-09-17T22:50:22.270140] [INFO ] [MAIN ] DSX: Loaded 24715 primary data records. [2025-09-17T22:50:22.319553] [DEBUG] [LOCAL ] DSL: Loaded 28148 existing records from primary storage. [2025-09-17T22:50:22.361072] [INFO ] [MAIN ] DSL: Loaded 28148 primary data records. [2025-09-17T22:50:23.179588] [DEBUG] [MAIN ] DSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:23.180720] [INFO ] [MAIN ] DSM: Generated 1794 derivative records from 15865 primary records. [2025-09-17T22:50:23.180908] [DEBUG] [LOCAL ] DSM: Saving derivative data. [2025-09-17T22:50:23.201707] [DEBUG] [LOCAL ] DSM: Derivative data saved (1794 records). [2025-09-17T22:50:23.202247] [INFO ] [MAIN ] DSM: Successfully saved derivative data. [2025-09-17T22:50:23.212091] [INFO ] [MAIN ] Derivative Progress: 541/2085 symbols completed. DSM took 1.1s. Estimated remaining: 10m 2s. Rate: 153.8 symbols/min [2025-09-17T22:50:23.229719] [INFO ] [MAIN ] DT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:23.230766] [DEBUG] [MAIN ] DSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:23.230089] [DEBUG] [MAIN ] DSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:23.233149] [INFO ] [MAIN ] DSL: Generated 1794 derivative records from 28148 primary records. [2025-09-17T22:50:23.232116] [INFO ] [MAIN ] DSX: Generated 1794 derivative records from 24715 primary records. [2025-09-17T22:50:23.233343] [DEBUG] [LOCAL ] DSL: Saving derivative data. [2025-09-17T22:50:23.234122] [DEBUG] [LOCAL ] DSX: Saving derivative data. [2025-09-17T22:50:23.264262] [DEBUG] [LOCAL ] DSL: Derivative data saved (1794 records). [2025-09-17T22:50:23.265350] [INFO ] [MAIN ] DSL: Successfully saved derivative data. [2025-09-17T22:50:23.268008] [INFO ] [MAIN ] Derivative Progress: 542/2085 symbols completed. DSL took 1.1s. Estimated remaining: 10m 1s. Rate: 154.1 symbols/min [2025-09-17T22:50:23.269011] [INFO ] [MAIN ] DTB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:23.270344] [DEBUG] [LOCAL ] DSX: Derivative data saved (1794 records). [2025-09-17T22:50:23.270558] [INFO ] [MAIN ] DSX: Successfully saved derivative data. [2025-09-17T22:50:23.273142] [INFO ] [MAIN ] Derivative Progress: 543/2085 symbols completed. DSX took 1.1s. Estimated remaining: 9m 59s. Rate: 154.4 symbols/min [2025-09-17T22:50:23.273532] [INFO ] [MAIN ] DTE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:23.279235] [DEBUG] [LOCAL ] DTB: Loaded 4684 existing records from primary storage. [2025-09-17T22:50:23.279447] [INFO ] [MAIN ] DTB: Loaded 4684 primary data records. [2025-09-17T22:50:23.625553] [DEBUG] [LOCAL ] DT: Loaded 52956 existing records from primary storage. [2025-09-17T22:50:23.625842] [INFO ] [MAIN ] DT: Loaded 52956 primary data records. [2025-09-17T22:50:23.750359] [DEBUG] [LOCAL ] DTE: Loaded 47994 existing records from primary storage. [2025-09-17T22:50:23.771879] [INFO ] [MAIN ] DTE: Loaded 47994 primary data records. [2025-09-17T22:50:24.337235] [DEBUG] [MAIN ] DTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:24.338611] [INFO ] [MAIN ] DTB: Generated 1794 derivative records from 4684 primary records. [2025-09-17T22:50:24.339210] [DEBUG] [LOCAL ] DTB: Saving derivative data. [2025-09-17T22:50:24.355587] [DEBUG] [LOCAL ] DTB: Derivative data saved (1794 records). [2025-09-17T22:50:24.355956] [INFO ] [MAIN ] DTB: Successfully saved derivative data. [2025-09-17T22:50:24.358482] [INFO ] [MAIN ] Derivative Progress: 544/2085 symbols completed. DTB took 1.1s. Estimated remaining: 10m 1s. Rate: 153.9 symbols/min [2025-09-17T22:50:24.359137] [INFO ] [MAIN ] DTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:24.370135] [DEBUG] [LOCAL ] DTG: Loaded 5889 existing records from primary storage. [2025-09-17T22:50:24.382862] [DEBUG] [MAIN ] DT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:24.382545] [INFO ] [MAIN ] DTG: Loaded 5889 primary data records. [2025-09-17T22:50:24.395705] [INFO ] [MAIN ] DT: Generated 1794 derivative records from 52956 primary records. [2025-09-17T22:50:24.405882] [DEBUG] [LOCAL ] DT: Saving derivative data. [2025-09-17T22:50:24.505749] [DEBUG] [LOCAL ] DT: Derivative data saved (1794 records). [2025-09-17T22:50:24.511075] [INFO ] [MAIN ] DT: Successfully saved derivative data. [2025-09-17T22:50:24.528830] [INFO ] [MAIN ] Derivative Progress: 545/2085 symbols completed. DT took 1.3s. Estimated remaining: 9m 60s. Rate: 154.0 symbols/min [2025-09-17T22:50:24.540716] [INFO ] [MAIN ] DUK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:24.546714] [DEBUG] [MAIN ] DTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:24.564128] [INFO ] [MAIN ] DTE: Generated 1794 derivative records from 47994 primary records. [2025-09-17T22:50:24.587833] [DEBUG] [LOCAL ] DTE: Saving derivative data. [2025-09-17T22:50:24.767291] [DEBUG] [LOCAL ] DTE: Derivative data saved (1794 records). [2025-09-17T22:50:24.767616] [INFO ] [MAIN ] DTE: Successfully saved derivative data. [2025-09-17T22:50:24.770830] [INFO ] [MAIN ] Derivative Progress: 546/2085 symbols completed. DTE took 1.5s. Estimated remaining: 9m 59s. Rate: 154.1 symbols/min [2025-09-17T22:50:24.771357] [INFO ] [MAIN ] DUKB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:24.782705] [DEBUG] [LOCAL ] DUKB: Loaded 6452 existing records from primary storage. [2025-09-17T22:50:24.798756] [INFO ] [MAIN ] DUKB: Loaded 6452 primary data records. [2025-09-17T22:50:24.882290] [DEBUG] [MAIN ] DTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:24.918030] [INFO ] [MAIN ] DTG: Generated 1794 derivative records from 5889 primary records. [2025-09-17T22:50:24.945694] [DEBUG] [LOCAL ] DTG: Saving derivative data. [2025-09-17T22:50:24.945152] [DEBUG] [LOCAL ] DUK: Loaded 53477 existing records from primary storage. [2025-09-17T22:50:24.956991] [INFO ] [MAIN ] DUK: Loaded 53477 primary data records. [2025-09-17T22:50:25.276843] [DEBUG] [LOCAL ] DTG: Derivative data saved (1794 records). [2025-09-17T22:50:25.295125] [INFO ] [MAIN ] DTG: Successfully saved derivative data. [2025-09-17T22:50:25.297361] [INFO ] [MAIN ] Derivative Progress: 547/2085 symbols completed. DTG took 0.9s. Estimated remaining: 9m 59s. Rate: 154.0 symbols/min [2025-09-17T22:50:25.298154] [INFO ] [MAIN ] DV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:25.531410] [DEBUG] [MAIN ] DUKB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:25.532419] [INFO ] [MAIN ] DUKB: Generated 1794 derivative records from 6452 primary records. [2025-09-17T22:50:25.532694] [DEBUG] [LOCAL ] DUKB: Saving derivative data. [2025-09-17T22:50:25.570954] [DEBUG] [LOCAL ] DUKB: Derivative data saved (1794 records). [2025-09-17T22:50:25.584215] [INFO ] [MAIN ] DUKB: Successfully saved derivative data. [2025-09-17T22:50:25.587979] [DEBUG] [MAIN ] DUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:25.587357] [INFO ] [MAIN ] Derivative Progress: 548/2085 symbols completed. DUKB took 0.8s. Estimated remaining: 9m 58s. Rate: 154.1 symbols/min [2025-09-17T22:50:25.589218] [INFO ] [MAIN ] DUK: Generated 1794 derivative records from 53477 primary records. [2025-09-17T22:50:25.589326] [INFO ] [MAIN ] DVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:25.603485] [DEBUG] [LOCAL ] DUK: Saving derivative data. [2025-09-17T22:50:25.606905] [DEBUG] [LOCAL ] DV: Loaded 51293 existing records from primary storage. [2025-09-17T22:50:25.607391] [INFO ] [MAIN ] DV: Loaded 51293 primary data records. [2025-09-17T22:50:25.816662] [DEBUG] [LOCAL ] DUK: Derivative data saved (1794 records). [2025-09-17T22:50:25.867241] [INFO ] [MAIN ] DUK: Successfully saved derivative data. [2025-09-17T22:50:25.983994] [INFO ] [MAIN ] Derivative Progress: 549/2085 symbols completed. DUK took 1.4s. Estimated remaining: 9m 58s. Rate: 154.1 symbols/min [2025-09-17T22:50:26.006002] [INFO ] [MAIN ] DVN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:26.007432] [DEBUG] [LOCAL ] DVA: Loaded 41749 existing records from primary storage. [2025-09-17T22:50:26.007516] [INFO ] [MAIN ] DVA: Loaded 41749 primary data records. [2025-09-17T22:50:26.387256] [DEBUG] [MAIN ] DV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:26.388098] [INFO ] [MAIN ] DV: Generated 1794 derivative records from 51293 primary records. [2025-09-17T22:50:26.388183] [DEBUG] [LOCAL ] DV: Saving derivative data. [2025-09-17T22:50:26.421229] [DEBUG] [LOCAL ] DV: Derivative data saved (1794 records). [2025-09-17T22:50:26.422341] [DEBUG] [LOCAL ] DVN: Loaded 53699 existing records from primary storage. [2025-09-17T22:50:26.422557] [INFO ] [MAIN ] DVN: Loaded 53699 primary data records. [2025-09-17T22:50:26.421436] [INFO ] [MAIN ] DV: Successfully saved derivative data. [2025-09-17T22:50:26.424948] [INFO ] [MAIN ] Derivative Progress: 550/2085 symbols completed. DV took 1.1s. Estimated remaining: 9m 58s. Rate: 154.1 symbols/min [2025-09-17T22:50:26.425325] [INFO ] [MAIN ] DXC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:26.774225] [DEBUG] [MAIN ] DVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:26.775164] [INFO ] [MAIN ] DVA: Generated 1794 derivative records from 41749 primary records. [2025-09-17T22:50:26.775449] [DEBUG] [LOCAL ] DVA: Saving derivative data. [2025-09-17T22:50:26.795254] [DEBUG] [LOCAL ] DVA: Derivative data saved (1794 records). [2025-09-17T22:50:26.795567] [INFO ] [MAIN ] DVA: Successfully saved derivative data. [2025-09-17T22:50:26.811483] [INFO ] [MAIN ] Derivative Progress: 551/2085 symbols completed. DVA took 1.2s. Estimated remaining: 9m 57s. Rate: 154.1 symbols/min [2025-09-17T22:50:26.811870] [INFO ] [MAIN ] DY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:26.813333] [DEBUG] [LOCAL ] DXC: Loaded 49456 existing records from primary storage. [2025-09-17T22:50:26.815212] [INFO ] [MAIN ] DXC: Loaded 49456 primary data records. [2025-09-17T22:50:27.132377] [DEBUG] [LOCAL ] DY: Loaded 30174 existing records from primary storage. [2025-09-17T22:50:27.160959] [INFO ] [MAIN ] DY: Loaded 30174 primary data records. [2025-09-17T22:50:27.160861] [DEBUG] [MAIN ] DVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:27.161852] [INFO ] [MAIN ] DVN: Generated 1794 derivative records from 53699 primary records. [2025-09-17T22:50:27.161988] [DEBUG] [LOCAL ] DVN: Saving derivative data. [2025-09-17T22:50:27.292433] [DEBUG] [LOCAL ] DVN: Derivative data saved (1794 records). [2025-09-17T22:50:27.304015] [INFO ] [MAIN ] DVN: Successfully saved derivative data. [2025-09-17T22:50:27.322100] [INFO ] [MAIN ] Derivative Progress: 552/2085 symbols completed. DVN took 1.3s. Estimated remaining: 9m 57s. Rate: 154.0 symbols/min [2025-09-17T22:50:27.352043] [INFO ] [MAIN ] E: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:27.525103] [DEBUG] [MAIN ] DXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:27.536616] [INFO ] [MAIN ] DXC: Generated 1794 derivative records from 49456 primary records. [2025-09-17T22:50:27.536951] [DEBUG] [LOCAL ] DXC: Saving derivative data. [2025-09-17T22:50:27.564078] [DEBUG] [LOCAL ] E: Loaded 33690 existing records from primary storage. [2025-09-17T22:50:27.564807] [INFO ] [MAIN ] E: Loaded 33690 primary data records. [2025-09-17T22:50:27.630333] [DEBUG] [LOCAL ] DXC: Derivative data saved (1794 records). [2025-09-17T22:50:27.670400] [DEBUG] [MAIN ] DY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:27.682278] [INFO ] [MAIN ] DXC: Successfully saved derivative data. [2025-09-17T22:50:27.693319] [INFO ] [MAIN ] Derivative Progress: 553/2085 symbols completed. DXC took 1.3s. Estimated remaining: 9m 57s. Rate: 154.0 symbols/min [2025-09-17T22:50:27.691111] [INFO ] [MAIN ] DY: Generated 1794 derivative records from 30174 primary records. [2025-09-17T22:50:27.697884] [DEBUG] [LOCAL ] DY: Saving derivative data. [2025-09-17T22:50:27.901918] [DEBUG] [LOCAL ] DY: Derivative data saved (1794 records). [2025-09-17T22:50:27.910381] [INFO ] [MAIN ] DY: Successfully saved derivative data. [2025-09-17T22:50:27.912660] [INFO ] [MAIN ] Derivative Progress: 554/2085 symbols completed. DY took 1.1s. Estimated remaining: 9m 56s. Rate: 154.1 symbols/min [2025-09-17T22:50:27.939204] [DEBUG] [MAIN ] E: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:27.939888] [INFO ] [MAIN ] E: Generated 1794 derivative records from 33690 primary records. [2025-09-17T22:50:27.939950] [DEBUG] [LOCAL ] E: Saving derivative data. [2025-09-17T22:50:27.955626] [DEBUG] [LOCAL ] E: Derivative data saved (1794 records). [2025-09-17T22:50:27.955717] [INFO ] [MAIN ] E: Successfully saved derivative data. [2025-09-17T22:50:27.958131] [INFO ] [MAIN ] Derivative Progress: 555/2085 symbols completed. E took 0.6s. Estimated remaining: 9m 55s. Rate: 154.4 symbols/min [2025-09-17T22:50:27.958850] [INFO ] [MAIN ] EAF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:27.958926] [INFO ] [MAIN ] EAI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:27.959349] [INFO ] [MAIN ] EARN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:27.966498] [DEBUG] [LOCAL ] EAI: Loaded 4011 existing records from primary storage. [2025-09-17T22:50:27.966673] [INFO ] [MAIN ] EAI: Loaded 4011 primary data records. [2025-09-17T22:50:28.297212] [DEBUG] [LOCAL ] EARN: Loaded 30842 existing records from primary storage. [2025-09-17T22:50:28.310083] [INFO ] [MAIN ] EARN: Loaded 30842 primary data records. [2025-09-17T22:50:28.310835] [DEBUG] [LOCAL ] EAF: Loaded 44299 existing records from primary storage. [2025-09-17T22:50:28.310969] [INFO ] [MAIN ] EAF: Loaded 44299 primary data records. [2025-09-17T22:50:28.982592] [DEBUG] [MAIN ] EAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:28.984001] [INFO ] [MAIN ] EAI: Generated 1794 derivative records from 4011 primary records. [2025-09-17T22:50:28.984428] [DEBUG] [LOCAL ] EAI: Saving derivative data. [2025-09-17T22:50:29.003400] [DEBUG] [LOCAL ] EAI: Derivative data saved (1794 records). [2025-09-17T22:50:29.003795] [INFO ] [MAIN ] EAI: Successfully saved derivative data. [2025-09-17T22:50:29.006292] [INFO ] [MAIN ] Derivative Progress: 556/2085 symbols completed. EAI took 1.0s. Estimated remaining: 9m 56s. Rate: 153.9 symbols/min [2025-09-17T22:50:29.006762] [INFO ] [MAIN ] EAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:29.024394] [DEBUG] [MAIN ] EARN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:29.025235] [INFO ] [MAIN ] EARN: Generated 1794 derivative records from 30842 primary records. [2025-09-17T22:50:29.025373] [DEBUG] [LOCAL ] EARN: Saving derivative data. [2025-09-17T22:50:29.056912] [DEBUG] [LOCAL ] EARN: Derivative data saved (1794 records). [2025-09-17T22:50:29.057350] [INFO ] [MAIN ] EARN: Successfully saved derivative data. [2025-09-17T22:50:29.057264] [DEBUG] [MAIN ] EAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:29.059240] [INFO ] [MAIN ] Derivative Progress: 557/2085 symbols completed. EARN took 1.1s. Estimated remaining: 9m 55s. Rate: 154.1 symbols/min [2025-09-17T22:50:29.060317] [INFO ] [MAIN ] EAF: Generated 1794 derivative records from 44299 primary records. [2025-09-17T22:50:29.060488] [DEBUG] [LOCAL ] EAF: Saving derivative data. [2025-09-17T22:50:29.060426] [INFO ] [MAIN ] EB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:29.087866] [DEBUG] [LOCAL ] EAF: Derivative data saved (1794 records). [2025-09-17T22:50:29.087993] [INFO ] [MAIN ] EAF: Successfully saved derivative data. [2025-09-17T22:50:29.090345] [INFO ] [MAIN ] Derivative Progress: 558/2085 symbols completed. EAF took 1.1s. Estimated remaining: 9m 53s. Rate: 154.4 symbols/min [2025-09-17T22:50:29.090836] [INFO ] [MAIN ] EBF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:29.123293] [DEBUG] [LOCAL ] EAT: Loaded 49826 existing records from primary storage. [2025-09-17T22:50:29.123566] [INFO ] [MAIN ] EAT: Loaded 49826 primary data records. [2025-09-17T22:50:29.177987] [DEBUG] [LOCAL ] EBF: Loaded 19679 existing records from primary storage. [2025-09-17T22:50:29.241250] [DEBUG] [LOCAL ] EB: Loaded 38136 existing records from primary storage. [2025-09-17T22:50:29.252935] [INFO ] [MAIN ] EBF: Loaded 19679 primary data records. [2025-09-17T22:50:29.253075] [INFO ] [MAIN ] EB: Loaded 38136 primary data records. [2025-09-17T22:50:30.092187] [DEBUG] [MAIN ] EAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:30.093742] [INFO ] [MAIN ] EAT: Generated 1794 derivative records from 49826 primary records. [2025-09-17T22:50:30.094079] [DEBUG] [LOCAL ] EAT: Saving derivative data. [2025-09-17T22:50:30.114779] [DEBUG] [LOCAL ] EAT: Derivative data saved (1794 records). [2025-09-17T22:50:30.122810] [INFO ] [MAIN ] EAT: Successfully saved derivative data. [2025-09-17T22:50:30.124856] [INFO ] [MAIN ] Derivative Progress: 559/2085 symbols completed. EAT took 1.1s. Estimated remaining: 9m 55s. Rate: 153.9 symbols/min [2025-09-17T22:50:30.125166] [INFO ] [MAIN ] EBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:30.132895] [DEBUG] [MAIN ] EB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:30.133883] [INFO ] [MAIN ] EB: Generated 1794 derivative records from 38136 primary records. [2025-09-17T22:50:30.134056] [DEBUG] [LOCAL ] EB: Saving derivative data. [2025-09-17T22:50:30.156519] [DEBUG] [MAIN ] EBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:30.161449] [INFO ] [MAIN ] EBF: Generated 1794 derivative records from 19679 primary records. [2025-09-17T22:50:30.162749] [DEBUG] [LOCAL ] EBF: Saving derivative data. [2025-09-17T22:50:30.185499] [DEBUG] [LOCAL ] EBF: Derivative data saved (1794 records). [2025-09-17T22:50:30.184804] [DEBUG] [LOCAL ] EB: Derivative data saved (1794 records). [2025-09-17T22:50:30.185830] [INFO ] [MAIN ] EB: Successfully saved derivative data. [2025-09-17T22:50:30.185758] [INFO ] [MAIN ] EBF: Successfully saved derivative data. [2025-09-17T22:50:30.188543] [INFO ] [MAIN ] Derivative Progress: 560/2085 symbols completed. EBF took 1.1s. Estimated remaining: 9m 54s. Rate: 154.2 symbols/min [2025-09-17T22:50:30.191482] [INFO ] [MAIN ] Derivative Progress: 561/2085 symbols completed. EB took 1.1s. Estimated remaining: 9m 52s. Rate: 154.4 symbols/min [2025-09-17T22:50:30.191410] [INFO ] [MAIN ] EBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:30.192179] [INFO ] [MAIN ] EC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:30.221807] [DEBUG] [LOCAL ] EBR: Loaded 43136 existing records from primary storage. [2025-09-17T22:50:30.222078] [INFO ] [MAIN ] EBR: Loaded 43136 primary data records. [2025-09-17T22:50:30.592385] [DEBUG] [LOCAL ] EC: Loaded 49474 existing records from primary storage. [2025-09-17T22:50:30.605663] [INFO ] [MAIN ] EC: Loaded 49474 primary data records. [2025-09-17T22:50:30.460803] [DEBUG] [LOCAL ] EBS: Loaded 47008 existing records from primary storage. [2025-09-17T22:50:30.606143] [INFO ] [MAIN ] EBS: Loaded 47008 primary data records. [2025-09-17T22:50:31.289824] [DEBUG] [MAIN ] EBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:31.291316] [INFO ] [MAIN ] EBR: Generated 1794 derivative records from 43136 primary records. [2025-09-17T22:50:31.291432] [DEBUG] [LOCAL ] EBR: Saving derivative data. [2025-09-17T22:50:31.310734] [DEBUG] [LOCAL ] EBR: Derivative data saved (1794 records). [2025-09-17T22:50:31.311049] [INFO ] [MAIN ] EBR: Successfully saved derivative data. [2025-09-17T22:50:31.313377] [INFO ] [MAIN ] Derivative Progress: 562/2085 symbols completed. EBR took 1.2s. Estimated remaining: 9m 54s. Rate: 153.9 symbols/min [2025-09-17T22:50:31.314447] [INFO ] [MAIN ] ECAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:31.351983] [DEBUG] [MAIN ] EBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:31.352440] [DEBUG] [MAIN ] EC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:31.361724] [INFO ] [MAIN ] EBS: Generated 1794 derivative records from 47008 primary records. [2025-09-17T22:50:31.362710] [INFO ] [MAIN ] EC: Generated 1794 derivative records from 49474 primary records. [2025-09-17T22:50:31.363099] [DEBUG] [LOCAL ] EC: Saving derivative data. [2025-09-17T22:50:31.362905] [DEBUG] [LOCAL ] EBS: Saving derivative data. [2025-09-17T22:50:31.406568] [DEBUG] [LOCAL ] EBS: Derivative data saved (1794 records). [2025-09-17T22:50:31.407190] [INFO ] [MAIN ] EBS: Successfully saved derivative data. [2025-09-17T22:50:31.410089] [INFO ] [MAIN ] Derivative Progress: 563/2085 symbols completed. EBS took 1.2s. Estimated remaining: 9m 53s. Rate: 154.1 symbols/min [2025-09-17T22:50:31.411367] [DEBUG] [LOCAL ] ECAT: Loaded 29877 existing records from primary storage. [2025-09-17T22:50:31.412514] [INFO ] [MAIN ] ECC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:31.412959] [DEBUG] [LOCAL ] EC: Derivative data saved (1794 records). [2025-09-17T22:50:31.413381] [INFO ] [MAIN ] EC: Successfully saved derivative data. [2025-09-17T22:50:31.412042] [INFO ] [MAIN ] ECAT: Loaded 29877 primary data records. [2025-09-17T22:50:31.416215] [INFO ] [MAIN ] Derivative Progress: 564/2085 symbols completed. EC took 1.2s. Estimated remaining: 9m 51s. Rate: 154.4 symbols/min [2025-09-17T22:50:31.416735] [INFO ] [MAIN ] ECG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:31.768988] [DEBUG] [LOCAL ] ECG: Loaded 34704 existing records from primary storage. [2025-09-17T22:50:31.769784] [INFO ] [MAIN ] ECG: Loaded 34704 primary data records. [2025-09-17T22:50:31.857621] [DEBUG] [LOCAL ] ECC: Loaded 43441 existing records from primary storage. [2025-09-17T22:50:31.889938] [INFO ] [MAIN ] ECC: Loaded 43441 primary data records. [2025-09-17T22:50:32.479353] [DEBUG] [MAIN ] ECAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:32.481213] [INFO ] [MAIN ] ECAT: Generated 1794 derivative records from 29877 primary records. [2025-09-17T22:50:32.481425] [DEBUG] [LOCAL ] ECAT: Saving derivative data. [2025-09-17T22:50:32.500988] [DEBUG] [LOCAL ] ECAT: Derivative data saved (1794 records). [2025-09-17T22:50:32.501331] [INFO ] [MAIN ] ECAT: Successfully saved derivative data. [2025-09-17T22:50:32.503535] [INFO ] [MAIN ] Derivative Progress: 565/2085 symbols completed. ECAT took 1.2s. Estimated remaining: 9m 53s. Rate: 153.9 symbols/min [2025-09-17T22:50:32.504070] [INFO ] [MAIN ] ECL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:32.521203] [DEBUG] [MAIN ] ECG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:32.522111] [INFO ] [MAIN ] ECG: Generated 1794 derivative records from 34704 primary records. [2025-09-17T22:50:32.522360] [DEBUG] [LOCAL ] ECG: Saving derivative data. [2025-09-17T22:50:32.552907] [DEBUG] [MAIN ] ECC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:32.553969] [INFO ] [MAIN ] ECC: Generated 1794 derivative records from 43441 primary records. [2025-09-17T22:50:32.554311] [DEBUG] [LOCAL ] ECG: Derivative data saved (1794 records). [2025-09-17T22:50:32.554471] [INFO ] [MAIN ] ECG: Successfully saved derivative data. [2025-09-17T22:50:32.554411] [DEBUG] [LOCAL ] ECC: Saving derivative data. [2025-09-17T22:50:32.556973] [INFO ] [MAIN ] Derivative Progress: 566/2085 symbols completed. ECG took 1.1s. Estimated remaining: 9m 51s. Rate: 154.1 symbols/min [2025-09-17T22:50:32.557403] [INFO ] [MAIN ] ECO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:32.573884] [DEBUG] [LOCAL ] ECC: Derivative data saved (1794 records). [2025-09-17T22:50:32.574040] [INFO ] [MAIN ] ECC: Successfully saved derivative data. [2025-09-17T22:50:32.576555] [INFO ] [MAIN ] Derivative Progress: 567/2085 symbols completed. ECC took 1.2s. Estimated remaining: 9m 50s. Rate: 154.4 symbols/min [2025-09-17T22:50:32.576970] [INFO ] [MAIN ] ECVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:32.602584] [DEBUG] [LOCAL ] ECO: Loaded 18677 existing records from primary storage. [2025-09-17T22:50:32.602926] [INFO ] [MAIN ] ECO: Loaded 18677 primary data records. [2025-09-17T22:50:32.713788] [DEBUG] [LOCAL ] ECL: Loaded 46721 existing records from primary storage. [2025-09-17T22:50:32.719893] [INFO ] [MAIN ] ECL: Loaded 46721 primary data records. [2025-09-17T22:50:32.918978] [DEBUG] [LOCAL ] ECVT: Loaded 43123 existing records from primary storage. [2025-09-17T22:50:32.926696] [INFO ] [MAIN ] ECVT: Loaded 43123 primary data records. [2025-09-17T22:50:33.602216] [DEBUG] [MAIN ] ECO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:33.603930] [INFO ] [MAIN ] ECO: Generated 1794 derivative records from 18677 primary records. [2025-09-17T22:50:33.604273] [DEBUG] [LOCAL ] ECO: Saving derivative data. [2025-09-17T22:50:33.629828] [DEBUG] [MAIN ] ECL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:33.633410] [DEBUG] [LOCAL ] ECO: Derivative data saved (1794 records). [2025-09-17T22:50:33.634206] [INFO ] [MAIN ] ECL: Generated 1794 derivative records from 46721 primary records. [2025-09-17T22:50:33.634496] [DEBUG] [LOCAL ] ECL: Saving derivative data. [2025-09-17T22:50:33.634537] [INFO ] [MAIN ] ECO: Successfully saved derivative data. [2025-09-17T22:50:33.636558] [INFO ] [MAIN ] Derivative Progress: 568/2085 symbols completed. ECO took 1.1s. Estimated remaining: 9m 51s. Rate: 153.9 symbols/min [2025-09-17T22:50:33.667205] [DEBUG] [MAIN ] ECVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:33.668803] [DEBUG] [LOCAL ] ECL: Derivative data saved (1794 records). [2025-09-17T22:50:33.669586] [INFO ] [MAIN ] ECL: Successfully saved derivative data. [2025-09-17T22:50:33.669489] [INFO ] [MAIN ] ECVT: Generated 1794 derivative records from 43123 primary records. [2025-09-17T22:50:33.669707] [DEBUG] [LOCAL ] ECVT: Saving derivative data. [2025-09-17T22:50:33.671793] [INFO ] [MAIN ] Derivative Progress: 569/2085 symbols completed. ECL took 1.2s. Estimated remaining: 9m 50s. Rate: 154.2 symbols/min [2025-09-17T22:50:33.688203] [DEBUG] [LOCAL ] ECVT: Derivative data saved (1794 records). [2025-09-17T22:50:33.688299] [INFO ] [MAIN ] ECVT: Successfully saved derivative data. [2025-09-17T22:50:33.690822] [INFO ] [MAIN ] Derivative Progress: 570/2085 symbols completed. ECVT took 1.1s. Estimated remaining: 9m 49s. Rate: 154.4 symbols/min [2025-09-17T22:50:33.691525] [INFO ] [MAIN ] ED: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:33.691354] [INFO ] [MAIN ] EDN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:33.691460] [INFO ] [MAIN ] EDD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:33.711409] [DEBUG] [LOCAL ] EDN: Loaded 17653 existing records from primary storage. [2025-09-17T22:50:33.718902] [INFO ] [MAIN ] EDN: Loaded 17653 primary data records. [2025-09-17T22:50:33.843956] [DEBUG] [LOCAL ] EDD: Loaded 27235 existing records from primary storage. [2025-09-17T22:50:33.897106] [INFO ] [MAIN ] EDD: Loaded 27235 primary data records. [2025-09-17T22:50:34.128236] [DEBUG] [LOCAL ] ED: Loaded 52827 existing records from primary storage. [2025-09-17T22:50:34.154063] [INFO ] [MAIN ] ED: Loaded 52827 primary data records. [2025-09-17T22:50:34.759235] [DEBUG] [MAIN ] EDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:34.761451] [INFO ] [MAIN ] EDN: Generated 1794 derivative records from 17653 primary records. [2025-09-17T22:50:34.763838] [DEBUG] [LOCAL ] EDN: Saving derivative data. [2025-09-17T22:50:34.788487] [DEBUG] [MAIN ] EDD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:34.792422] [INFO ] [MAIN ] EDD: Generated 1794 derivative records from 27235 primary records. [2025-09-17T22:50:34.792916] [DEBUG] [LOCAL ] EDD: Saving derivative data. [2025-09-17T22:50:34.799196] [DEBUG] [LOCAL ] EDN: Derivative data saved (1794 records). [2025-09-17T22:50:34.799377] [INFO ] [MAIN ] EDN: Successfully saved derivative data. [2025-09-17T22:50:34.808610] [INFO ] [MAIN ] Derivative Progress: 571/2085 symbols completed. EDN took 1.1s. Estimated remaining: 9m 50s. Rate: 153.9 symbols/min [2025-09-17T22:50:34.819526] [INFO ] [MAIN ] EDU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:34.818120] [DEBUG] [LOCAL ] EDD: Derivative data saved (1794 records). [2025-09-17T22:50:34.820666] [INFO ] [MAIN ] EDD: Successfully saved derivative data. [2025-09-17T22:50:34.823064] [INFO ] [MAIN ] Derivative Progress: 572/2085 symbols completed. EDD took 1.1s. Estimated remaining: 9m 49s. Rate: 154.2 symbols/min [2025-09-17T22:50:34.824000] [INFO ] [MAIN ] EE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:34.840538] [DEBUG] [MAIN ] ED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:34.841713] [INFO ] [MAIN ] ED: Generated 1794 derivative records from 52827 primary records. [2025-09-17T22:50:34.841967] [DEBUG] [LOCAL ] ED: Saving derivative data. [2025-09-17T22:50:34.863285] [DEBUG] [LOCAL ] ED: Derivative data saved (1794 records). [2025-09-17T22:50:34.863432] [INFO ] [MAIN ] ED: Successfully saved derivative data. [2025-09-17T22:50:34.866061] [INFO ] [MAIN ] Derivative Progress: 573/2085 symbols completed. ED took 1.2s. Estimated remaining: 9m 47s. Rate: 154.4 symbols/min [2025-09-17T22:50:34.866506] [INFO ] [MAIN ] EEA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:34.873175] [DEBUG] [LOCAL ] EEA: Loaded 2830 existing records from primary storage. [2025-09-17T22:50:34.873357] [INFO ] [MAIN ] EEA: Loaded 2830 primary data records. [2025-09-17T22:50:35.074095] [DEBUG] [LOCAL ] EE: Loaded 32569 existing records from primary storage. [2025-09-17T22:50:35.133468] [INFO ] [MAIN ] EE: Loaded 32569 primary data records. [2025-09-17T22:50:35.146227] [DEBUG] [LOCAL ] EDU: Loaded 45331 existing records from primary storage. [2025-09-17T22:50:35.294540] [INFO ] [MAIN ] EDU: Loaded 45331 primary data records. [2025-09-17T22:50:35.904462] [DEBUG] [MAIN ] EEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:35.905483] [INFO ] [MAIN ] EEA: Generated 1794 derivative records from 2830 primary records. [2025-09-17T22:50:35.905716] [DEBUG] [LOCAL ] EEA: Saving derivative data. [2025-09-17T22:50:35.922843] [DEBUG] [LOCAL ] EEA: Derivative data saved (1794 records). [2025-09-17T22:50:35.923140] [INFO ] [MAIN ] EEA: Successfully saved derivative data. [2025-09-17T22:50:35.926346] [INFO ] [MAIN ] Derivative Progress: 574/2085 symbols completed. EEA took 1.1s. Estimated remaining: 9m 49s. Rate: 154.0 symbols/min [2025-09-17T22:50:35.926739] [INFO ] [MAIN ] EEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:35.942730] [DEBUG] [MAIN ] EE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:35.943484] [INFO ] [MAIN ] EE: Generated 1794 derivative records from 32569 primary records. [2025-09-17T22:50:35.943745] [DEBUG] [LOCAL ] EE: Saving derivative data. [2025-09-17T22:50:35.968435] [DEBUG] [LOCAL ] EEX: Loaded 12320 existing records from primary storage. [2025-09-17T22:50:35.969084] [INFO ] [MAIN ] EEX: Loaded 12320 primary data records. [2025-09-17T22:50:35.971501] [DEBUG] [LOCAL ] EE: Derivative data saved (1794 records). [2025-09-17T22:50:35.972430] [INFO ] [MAIN ] EE: Successfully saved derivative data. [2025-09-17T22:50:35.980015] [INFO ] [MAIN ] Derivative Progress: 575/2085 symbols completed. EE took 1.2s. Estimated remaining: 9m 48s. Rate: 154.2 symbols/min [2025-09-17T22:50:35.997947] [INFO ] [MAIN ] EFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:36.043066] [DEBUG] [MAIN ] EDU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:36.079759] [INFO ] [MAIN ] EDU: Generated 1794 derivative records from 45331 primary records. [2025-09-17T22:50:36.091106] [DEBUG] [LOCAL ] EDU: Saving derivative data. [2025-09-17T22:50:36.206971] [DEBUG] [LOCAL ] EDU: Derivative data saved (1794 records). [2025-09-17T22:50:36.321039] [INFO ] [MAIN ] EDU: Successfully saved derivative data. [2025-09-17T22:50:36.326479] [INFO ] [MAIN ] Derivative Progress: 576/2085 symbols completed. EDU took 1.5s. Estimated remaining: 9m 47s. Rate: 154.2 symbols/min [2025-09-17T22:50:36.327066] [INFO ] [MAIN ] EFR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:36.359508] [DEBUG] [LOCAL ] EFR: Loaded 14091 existing records from primary storage. [2025-09-17T22:50:36.362256] [INFO ] [MAIN ] EFR: Loaded 14091 primary data records. [2025-09-17T22:50:36.433480] [DEBUG] [LOCAL ] EFC: Loaded 46247 existing records from primary storage. [2025-09-17T22:50:36.455834] [INFO ] [MAIN ] EFC: Loaded 46247 primary data records. [2025-09-17T22:50:36.490004] [DEBUG] [MAIN ] EEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:36.511831] [INFO ] [MAIN ] EEX: Generated 1794 derivative records from 12320 primary records. [2025-09-17T22:50:36.524205] [DEBUG] [LOCAL ] EEX: Saving derivative data. [2025-09-17T22:50:36.749292] [DEBUG] [LOCAL ] EEX: Derivative data saved (1794 records). [2025-09-17T22:50:36.938689] [INFO ] [MAIN ] EEX: Successfully saved derivative data. [2025-09-17T22:50:36.941163] [INFO ] [MAIN ] Derivative Progress: 577/2085 symbols completed. EEX took 1.0s. Estimated remaining: 9m 47s. Rate: 154.1 symbols/min [2025-09-17T22:50:37.064723] [INFO ] [MAIN ] EFT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:37.093616] [DEBUG] [LOCAL ] EFT: Loaded 12511 existing records from primary storage. [2025-09-17T22:50:37.094213] [INFO ] [MAIN ] EFT: Loaded 12511 primary data records. [2025-09-17T22:50:37.313860] [DEBUG] [MAIN ] EFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:37.429342] [DEBUG] [MAIN ] EFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:37.431114] [INFO ] [MAIN ] EFR: Generated 1794 derivative records from 14091 primary records. [2025-09-17T22:50:37.431377] [DEBUG] [LOCAL ] EFR: Saving derivative data. [2025-09-17T22:50:37.432776] [INFO ] [MAIN ] EFC: Generated 1794 derivative records from 46247 primary records. [2025-09-17T22:50:37.433073] [DEBUG] [LOCAL ] EFC: Saving derivative data. [2025-09-17T22:50:37.468223] [DEBUG] [LOCAL ] EFR: Derivative data saved (1794 records). [2025-09-17T22:50:37.470858] [DEBUG] [LOCAL ] EFC: Derivative data saved (1794 records). [2025-09-17T22:50:37.471750] [INFO ] [MAIN ] EFC: Successfully saved derivative data. [2025-09-17T22:50:37.471311] [INFO ] [MAIN ] EFR: Successfully saved derivative data. [2025-09-17T22:50:37.474239] [INFO ] [MAIN ] Derivative Progress: 578/2085 symbols completed. EFC took 1.5s. Estimated remaining: 9m 47s. Rate: 154.0 symbols/min [2025-09-17T22:50:37.477090] [INFO ] [MAIN ] EFX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:37.477418] [INFO ] [MAIN ] Derivative Progress: 579/2085 symbols completed. EFR took 1.1s. Estimated remaining: 9m 46s. Rate: 154.2 symbols/min [2025-09-17T22:50:37.478321] [INFO ] [MAIN ] EFXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:37.499233] [DEBUG] [MAIN ] EFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:37.499982] [INFO ] [MAIN ] EFT: Generated 1794 derivative records from 12511 primary records. [2025-09-17T22:50:37.500047] [DEBUG] [LOCAL ] EFT: Saving derivative data. [2025-09-17T22:50:37.525984] [DEBUG] [LOCAL ] EFT: Derivative data saved (1794 records). [2025-09-17T22:50:37.526049] [INFO ] [MAIN ] EFT: Successfully saved derivative data. [2025-09-17T22:50:37.528430] [INFO ] [MAIN ] Derivative Progress: 580/2085 symbols completed. EFT took 0.6s. Estimated remaining: 9m 45s. Rate: 154.5 symbols/min [2025-09-17T22:50:37.528798] [INFO ] [MAIN ] EG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:37.550259] [DEBUG] [LOCAL ] EFXT: Loaded 29710 existing records from primary storage. [2025-09-17T22:50:37.550448] [INFO ] [MAIN ] EFXT: Loaded 29710 primary data records. [2025-09-17T22:50:37.685429] [DEBUG] [LOCAL ] EFX: Loaded 45022 existing records from primary storage. [2025-09-17T22:50:37.728088] [INFO ] [MAIN ] EFX: Loaded 45022 primary data records. [2025-09-17T22:50:37.817839] [DEBUG] [LOCAL ] EG: Loaded 29074 existing records from primary storage. [2025-09-17T22:50:37.834599] [INFO ] [MAIN ] EG: Loaded 29074 primary data records. [2025-09-17T22:50:38.660637] [DEBUG] [MAIN ] EFXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:38.662172] [INFO ] [MAIN ] EFXT: Generated 1794 derivative records from 29710 primary records. [2025-09-17T22:50:38.663104] [DEBUG] [LOCAL ] EFXT: Saving derivative data. [2025-09-17T22:50:38.695212] [DEBUG] [MAIN ] EFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:38.697930] [DEBUG] [LOCAL ] EFXT: Derivative data saved (1794 records). [2025-09-17T22:50:38.698161] [INFO ] [MAIN ] EFXT: Successfully saved derivative data. [2025-09-17T22:50:38.701294] [INFO ] [MAIN ] Derivative Progress: 581/2085 symbols completed. EFXT took 1.2s. Estimated remaining: 9m 46s. Rate: 153.9 symbols/min [2025-09-17T22:50:38.698997] [INFO ] [MAIN ] EFX: Generated 1794 derivative records from 45022 primary records. [2025-09-17T22:50:38.701479] [DEBUG] [LOCAL ] EFX: Saving derivative data. [2025-09-17T22:50:38.702571] [INFO ] [MAIN ] EGO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:38.719852] [DEBUG] [LOCAL ] EFX: Derivative data saved (1794 records). [2025-09-17T22:50:38.720088] [INFO ] [MAIN ] EFX: Successfully saved derivative data. [2025-09-17T22:50:38.722325] [INFO ] [MAIN ] Derivative Progress: 582/2085 symbols completed. EFX took 1.2s. Estimated remaining: 9m 45s. Rate: 154.2 symbols/min [2025-09-17T22:50:38.722891] [INFO ] [MAIN ] EGP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:38.739310] [DEBUG] [MAIN ] EG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:38.740197] [INFO ] [MAIN ] EG: Generated 1794 derivative records from 29074 primary records. [2025-09-17T22:50:38.740355] [DEBUG] [LOCAL ] EG: Saving derivative data. [2025-09-17T22:50:38.757194] [DEBUG] [LOCAL ] EG: Derivative data saved (1794 records). [2025-09-17T22:50:38.757398] [INFO ] [MAIN ] EG: Successfully saved derivative data. [2025-09-17T22:50:38.760409] [INFO ] [MAIN ] Derivative Progress: 583/2085 symbols completed. EG took 1.2s. Estimated remaining: 9m 44s. Rate: 154.4 symbols/min [2025-09-17T22:50:38.800059] [DEBUG] [LOCAL ] EGP: Loaded 31484 existing records from primary storage. [2025-09-17T22:50:38.800683] [INFO ] [MAIN ] EGP: Loaded 31484 primary data records. [2025-09-17T22:50:38.918839] [DEBUG] [LOCAL ] EGO: Loaded 51404 existing records from primary storage. [2025-09-17T22:50:38.919065] [INFO ] [MAIN ] EGO: Loaded 51404 primary data records. [2025-09-17T22:50:39.451171] [DEBUG] [MAIN ] EGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:39.452158] [INFO ] [MAIN ] EGP: Generated 1794 derivative records from 31484 primary records. [2025-09-17T22:50:39.452253] [DEBUG] [LOCAL ] EGP: Saving derivative data. [2025-09-17T22:50:39.470088] [DEBUG] [LOCAL ] EGP: Derivative data saved (1794 records). [2025-09-17T22:50:39.470225] [INFO ] [MAIN ] EGP: Successfully saved derivative data. [2025-09-17T22:50:39.473003] [INFO ] [MAIN ] Derivative Progress: 584/2085 symbols completed. EGP took 0.8s. Estimated remaining: 9m 44s. Rate: 154.2 symbols/min [2025-09-17T22:50:39.486318] [DEBUG] [MAIN ] EGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:39.486929] [INFO ] [MAIN ] EGO: Generated 1794 derivative records from 51404 primary records. [2025-09-17T22:50:39.486991] [DEBUG] [LOCAL ] EGO: Saving derivative data. [2025-09-17T22:50:39.502058] [DEBUG] [LOCAL ] EGO: Derivative data saved (1794 records). [2025-09-17T22:50:39.502119] [INFO ] [MAIN ] EGO: Successfully saved derivative data. [2025-09-17T22:50:39.504419] [INFO ] [MAIN ] Derivative Progress: 585/2085 symbols completed. EGO took 0.8s. Estimated remaining: 9m 43s. Rate: 154.4 symbols/min [2025-09-17T22:50:39.505170] [INFO ] [MAIN ] EHAB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:39.504980] [INFO ] [MAIN ] EGY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:39.505253] [INFO ] [MAIN ] EHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:39.550983] [DEBUG] [LOCAL ] EHAB: Loaded 30202 existing records from primary storage. [2025-09-17T22:50:39.551247] [INFO ] [MAIN ] EHAB: Loaded 30202 primary data records. [2025-09-17T22:50:39.668519] [DEBUG] [LOCAL ] EHC: Loaded 41624 existing records from primary storage. [2025-09-17T22:50:39.674077] [INFO ] [MAIN ] EHC: Loaded 41624 primary data records. [2025-09-17T22:50:39.744534] [DEBUG] [LOCAL ] EGY: Loaded 42412 existing records from primary storage. [2025-09-17T22:50:39.763119] [INFO ] [MAIN ] EGY: Loaded 42412 primary data records. [2025-09-17T22:50:40.612432] [DEBUG] [MAIN ] EHAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:40.613529] [INFO ] [MAIN ] EHAB: Generated 1794 derivative records from 30202 primary records. [2025-09-17T22:50:40.613747] [DEBUG] [LOCAL ] EHAB: Saving derivative data. [2025-09-17T22:50:40.631517] [DEBUG] [LOCAL ] EHAB: Derivative data saved (1794 records). [2025-09-17T22:50:40.631930] [INFO ] [MAIN ] EHAB: Successfully saved derivative data. [2025-09-17T22:50:40.633994] [INFO ] [MAIN ] Derivative Progress: 586/2085 symbols completed. EHAB took 1.1s. Estimated remaining: 9m 44s. Rate: 153.9 symbols/min [2025-09-17T22:50:40.637345] [INFO ] [MAIN ] EHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:40.654466] [DEBUG] [MAIN ] EGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:40.671052] [INFO ] [MAIN ] EGY: Generated 1794 derivative records from 42412 primary records. [2025-09-17T22:50:40.671583] [DEBUG] [LOCAL ] EGY: Saving derivative data. [2025-09-17T22:50:40.671402] [DEBUG] [MAIN ] EHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:40.673312] [INFO ] [MAIN ] EHC: Generated 1794 derivative records from 41624 primary records. [2025-09-17T22:50:40.677316] [DEBUG] [LOCAL ] EHC: Saving derivative data. [2025-09-17T22:50:40.677898] [DEBUG] [LOCAL ] EHI: Loaded 10163 existing records from primary storage. [2025-09-17T22:50:40.690140] [INFO ] [MAIN ] EHI: Loaded 10163 primary data records. [2025-09-17T22:50:40.694682] [DEBUG] [LOCAL ] EGY: Derivative data saved (1794 records). [2025-09-17T22:50:40.701980] [INFO ] [MAIN ] EGY: Successfully saved derivative data. [2025-09-17T22:50:40.718293] [INFO ] [MAIN ] Derivative Progress: 587/2085 symbols completed. EGY took 1.2s. Estimated remaining: 9m 43s. Rate: 154.1 symbols/min [2025-09-17T22:50:40.768989] [INFO ] [MAIN ] EIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:40.785384] [DEBUG] [LOCAL ] EHC: Derivative data saved (1794 records). [2025-09-17T22:50:40.785724] [INFO ] [MAIN ] EHC: Successfully saved derivative data. [2025-09-17T22:50:40.795600] [INFO ] [MAIN ] Derivative Progress: 588/2085 symbols completed. EHC took 1.3s. Estimated remaining: 9m 42s. Rate: 154.4 symbols/min [2025-09-17T22:50:40.802070] [INFO ] [MAIN ] EIX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:41.042089] [DEBUG] [LOCAL ] EIG: Loaded 20254 existing records from primary storage. [2025-09-17T22:50:41.042387] [INFO ] [MAIN ] EIG: Loaded 20254 primary data records. [2025-09-17T22:50:41.408050] [DEBUG] [LOCAL ] EIX: Loaded 53359 existing records from primary storage. [2025-09-17T22:50:41.408547] [INFO ] [MAIN ] EIX: Loaded 53359 primary data records. [2025-09-17T22:50:41.530134] [DEBUG] [MAIN ] EHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:41.542595] [INFO ] [MAIN ] EHI: Generated 1794 derivative records from 10163 primary records. [2025-09-17T22:50:41.548262] [DEBUG] [LOCAL ] EHI: Saving derivative data. [2025-09-17T22:50:41.747042] [DEBUG] [LOCAL ] EHI: Derivative data saved (1794 records). [2025-09-17T22:50:41.755817] [INFO ] [MAIN ] EHI: Successfully saved derivative data. [2025-09-17T22:50:41.757941] [INFO ] [MAIN ] Derivative Progress: 589/2085 symbols completed. EHI took 1.1s. Estimated remaining: 9m 43s. Rate: 154.0 symbols/min [2025-09-17T22:50:41.758799] [INFO ] [MAIN ] EL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:41.779710] [DEBUG] [MAIN ] EIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:41.780614] [INFO ] [MAIN ] EIG: Generated 1794 derivative records from 20254 primary records. [2025-09-17T22:50:41.782586] [DEBUG] [LOCAL ] EIG: Saving derivative data. [2025-09-17T22:50:41.800776] [DEBUG] [LOCAL ] EIG: Derivative data saved (1794 records). [2025-09-17T22:50:41.801133] [INFO ] [MAIN ] EIG: Successfully saved derivative data. [2025-09-17T22:50:41.803713] [INFO ] [MAIN ] Derivative Progress: 590/2085 symbols completed. EIG took 1.0s. Estimated remaining: 9m 42s. Rate: 154.2 symbols/min [2025-09-17T22:50:41.804215] [INFO ] [MAIN ] ELAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:41.837878] [DEBUG] [MAIN ] EIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:41.838582] [INFO ] [MAIN ] EIX: Generated 1794 derivative records from 53359 primary records. [2025-09-17T22:50:41.838763] [DEBUG] [LOCAL ] EIX: Saving derivative data. [2025-09-17T22:50:41.855608] [DEBUG] [LOCAL ] EIX: Derivative data saved (1794 records). [2025-09-17T22:50:41.870969] [INFO ] [MAIN ] EIX: Successfully saved derivative data. [2025-09-17T22:50:41.873351] [INFO ] [MAIN ] Derivative Progress: 591/2085 symbols completed. EIX took 1.1s. Estimated remaining: 9m 41s. Rate: 154.4 symbols/min [2025-09-17T22:50:41.874976] [DEBUG] [LOCAL ] EL: Loaded 53462 existing records from primary storage. [2025-09-17T22:50:41.875101] [INFO ] [MAIN ] ELF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:41.875165] [INFO ] [MAIN ] EL: Loaded 53462 primary data records. [2025-09-17T22:50:42.091691] [DEBUG] [LOCAL ] ELAN: Loaded 53180 existing records from primary storage. [2025-09-17T22:50:42.222533] [INFO ] [MAIN ] ELAN: Loaded 53180 primary data records. [2025-09-17T22:50:42.347419] [DEBUG] [LOCAL ] ELF: Loaded 52337 existing records from primary storage. [2025-09-17T22:50:42.351638] [INFO ] [MAIN ] ELF: Loaded 52337 primary data records. [2025-09-17T22:50:42.944754] [DEBUG] [MAIN ] EL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:42.945981] [INFO ] [MAIN ] EL: Generated 1794 derivative records from 53462 primary records. [2025-09-17T22:50:42.946466] [DEBUG] [LOCAL ] EL: Saving derivative data. [2025-09-17T22:50:42.964418] [DEBUG] [LOCAL ] EL: Derivative data saved (1794 records). [2025-09-17T22:50:42.964770] [INFO ] [MAIN ] EL: Successfully saved derivative data. [2025-09-17T22:50:42.966918] [INFO ] [MAIN ] Derivative Progress: 592/2085 symbols completed. EL took 1.2s. Estimated remaining: 9m 42s. Rate: 153.9 symbols/min [2025-09-17T22:50:42.968424] [INFO ] [MAIN ] ELME: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:42.985274] [DEBUG] [MAIN ] ELAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:42.986220] [INFO ] [MAIN ] ELAN: Generated 1794 derivative records from 53180 primary records. [2025-09-17T22:50:42.986495] [DEBUG] [LOCAL ] ELAN: Saving derivative data. [2025-09-17T22:50:43.004329] [DEBUG] [LOCAL ] ELAN: Derivative data saved (1794 records). [2025-09-17T22:50:43.006183] [INFO ] [MAIN ] ELAN: Successfully saved derivative data. [2025-09-17T22:50:43.008620] [INFO ] [MAIN ] Derivative Progress: 593/2085 symbols completed. ELAN took 1.2s. Estimated remaining: 9m 41s. Rate: 154.2 symbols/min [2025-09-17T22:50:43.008921] [INFO ] [MAIN ] ELP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:43.022999] [DEBUG] [MAIN ] ELF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:43.023805] [INFO ] [MAIN ] ELF: Generated 1794 derivative records from 52337 primary records. [2025-09-17T22:50:43.024004] [DEBUG] [LOCAL ] ELF: Saving derivative data. [2025-09-17T22:50:43.055941] [DEBUG] [LOCAL ] ELF: Derivative data saved (1794 records). [2025-09-17T22:50:43.056839] [INFO ] [MAIN ] ELF: Successfully saved derivative data. [2025-09-17T22:50:43.060960] [INFO ] [MAIN ] Derivative Progress: 594/2085 symbols completed. ELF took 1.2s. Estimated remaining: 9m 39s. Rate: 154.4 symbols/min [2025-09-17T22:50:43.073326] [INFO ] [MAIN ] ELS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:43.074578] [DEBUG] [LOCAL ] ELME: Loaded 39237 existing records from primary storage. [2025-09-17T22:50:43.074801] [INFO ] [MAIN ] ELME: Loaded 39237 primary data records. [2025-09-17T22:50:43.179877] [DEBUG] [LOCAL ] ELP: Loaded 26024 existing records from primary storage. [2025-09-17T22:50:43.188685] [INFO ] [MAIN ] ELP: Loaded 26024 primary data records. [2025-09-17T22:50:43.612442] [DEBUG] [LOCAL ] ELS: Loaded 49360 existing records from primary storage. [2025-09-17T22:50:43.613292] [INFO ] [MAIN ] ELS: Loaded 49360 primary data records. [2025-09-17T22:50:44.064212] [DEBUG] [MAIN ] ELME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:44.065968] [INFO ] [MAIN ] ELME: Generated 1794 derivative records from 39237 primary records. [2025-09-17T22:50:44.066573] [DEBUG] [LOCAL ] ELME: Saving derivative data. [2025-09-17T22:50:44.100418] [DEBUG] [LOCAL ] ELME: Derivative data saved (1794 records). [2025-09-17T22:50:44.100618] [INFO ] [MAIN ] ELME: Successfully saved derivative data. [2025-09-17T22:50:44.102988] [INFO ] [MAIN ] Derivative Progress: 595/2085 symbols completed. ELME took 1.1s. Estimated remaining: 9m 41s. Rate: 154.0 symbols/min [2025-09-17T22:50:44.103306] [DEBUG] [MAIN ] ELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:44.103957] [INFO ] [MAIN ] ELV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:44.104835] [INFO ] [MAIN ] ELP: Generated 1794 derivative records from 26024 primary records. [2025-09-17T22:50:44.105160] [DEBUG] [LOCAL ] ELP: Saving derivative data. [2025-09-17T22:50:44.122216] [DEBUG] [LOCAL ] ELP: Derivative data saved (1794 records). [2025-09-17T22:50:44.123016] [INFO ] [MAIN ] ELP: Successfully saved derivative data. [2025-09-17T22:50:44.125989] [INFO ] [MAIN ] Derivative Progress: 596/2085 symbols completed. ELP took 1.1s. Estimated remaining: 9m 39s. Rate: 154.2 symbols/min [2025-09-17T22:50:44.127384] [INFO ] [MAIN ] EME: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:44.142720] [DEBUG] [MAIN ] ELS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:44.143393] [INFO ] [MAIN ] ELS: Generated 1794 derivative records from 49360 primary records. [2025-09-17T22:50:44.143509] [DEBUG] [LOCAL ] ELS: Saving derivative data. [2025-09-17T22:50:44.159556] [DEBUG] [LOCAL ] ELS: Derivative data saved (1794 records). [2025-09-17T22:50:44.159616] [INFO ] [MAIN ] ELS: Successfully saved derivative data. [2025-09-17T22:50:44.161932] [INFO ] [MAIN ] Derivative Progress: 597/2085 symbols completed. ELS took 1.1s. Estimated remaining: 9m 38s. Rate: 154.4 symbols/min [2025-09-17T22:50:44.162327] [INFO ] [MAIN ] EMF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:44.167561] [DEBUG] [LOCAL ] EMF: Loaded 3676 existing records from primary storage. [2025-09-17T22:50:44.167757] [INFO ] [MAIN ] EMF: Loaded 3676 primary data records. [2025-09-17T22:50:44.293939] [DEBUG] [LOCAL ] EME: Loaded 31825 existing records from primary storage. [2025-09-17T22:50:44.306251] [INFO ] [MAIN ] EME: Loaded 31825 primary data records. [2025-09-17T22:50:44.370446] [DEBUG] [LOCAL ] ELV: Loaded 50472 existing records from primary storage. [2025-09-17T22:50:44.388204] [INFO ] [MAIN ] ELV: Loaded 50472 primary data records. [2025-09-17T22:50:45.238473] [DEBUG] [MAIN ] EMF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:45.239725] [INFO ] [MAIN ] EMF: Generated 1794 derivative records from 3676 primary records. [2025-09-17T22:50:45.239874] [DEBUG] [LOCAL ] EMF: Saving derivative data. [2025-09-17T22:50:45.272347] [DEBUG] [LOCAL ] EMF: Derivative data saved (1794 records). [2025-09-17T22:50:45.272835] [DEBUG] [MAIN ] EME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:45.273169] [INFO ] [MAIN ] EMF: Successfully saved derivative data. [2025-09-17T22:50:45.276444] [INFO ] [MAIN ] EME: Generated 1794 derivative records from 31825 primary records. [2025-09-17T22:50:45.275506] [INFO ] [MAIN ] Derivative Progress: 598/2085 symbols completed. EMF took 1.1s. Estimated remaining: 9m 40s. Rate: 154.0 symbols/min [2025-09-17T22:50:45.277019] [DEBUG] [LOCAL ] EME: Saving derivative data. [2025-09-17T22:50:45.295905] [DEBUG] [LOCAL ] EME: Derivative data saved (1794 records). [2025-09-17T22:50:45.296087] [INFO ] [MAIN ] EME: Successfully saved derivative data. [2025-09-17T22:50:45.302117] [INFO ] [MAIN ] Derivative Progress: 599/2085 symbols completed. EME took 1.2s. Estimated remaining: 9m 38s. Rate: 154.2 symbols/min [2025-09-17T22:50:45.314866] [DEBUG] [MAIN ] ELV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:45.315444] [INFO ] [MAIN ] ELV: Generated 1794 derivative records from 50472 primary records. [2025-09-17T22:50:45.315504] [DEBUG] [LOCAL ] ELV: Saving derivative data. [2025-09-17T22:50:45.330805] [DEBUG] [LOCAL ] ELV: Derivative data saved (1794 records). [2025-09-17T22:50:45.330866] [INFO ] [MAIN ] ELV: Successfully saved derivative data. [2025-09-17T22:50:45.333827] [INFO ] [MAIN ] Derivative Progress: 600/2085 symbols completed. ELV took 1.2s. Estimated remaining: 9m 37s. Rate: 154.4 symbols/min [2025-09-17T22:50:45.334599] [INFO ] [MAIN ] EMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:45.334662] [INFO ] [MAIN ] EMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:45.334843] [INFO ] [MAIN ] EMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:45.341128] [DEBUG] [LOCAL ] EMP: Loaded 3004 existing records from primary storage. [2025-09-17T22:50:45.341289] [INFO ] [MAIN ] EMP: Loaded 3004 primary data records. [2025-09-17T22:50:45.447285] [DEBUG] [LOCAL ] EMO: Loaded 12281 existing records from primary storage. [2025-09-17T22:50:45.458793] [INFO ] [MAIN ] EMO: Loaded 12281 primary data records. [2025-09-17T22:50:45.833689] [DEBUG] [LOCAL ] EMN: Loaded 50259 existing records from primary storage. [2025-09-17T22:50:45.867101] [INFO ] [MAIN ] EMN: Loaded 50259 primary data records. [2025-09-17T22:50:46.310931] [DEBUG] [MAIN ] EMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:46.312387] [INFO ] [MAIN ] EMP: Generated 1794 derivative records from 3004 primary records. [2025-09-17T22:50:46.312620] [DEBUG] [LOCAL ] EMP: Saving derivative data. [2025-09-17T22:50:46.329418] [DEBUG] [LOCAL ] EMP: Derivative data saved (1794 records). [2025-09-17T22:50:46.331434] [INFO ] [MAIN ] EMP: Successfully saved derivative data. [2025-09-17T22:50:46.334874] [INFO ] [MAIN ] Derivative Progress: 601/2085 symbols completed. EMP took 1.0s. Estimated remaining: 9m 38s. Rate: 154.0 symbols/min [2025-09-17T22:50:46.335337] [INFO ] [MAIN ] EMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:46.351558] [DEBUG] [MAIN ] EMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:46.352458] [INFO ] [MAIN ] EMO: Generated 1794 derivative records from 12281 primary records. [2025-09-17T22:50:46.352819] [DEBUG] [LOCAL ] EMO: Saving derivative data. [2025-09-17T22:50:46.370447] [DEBUG] [LOCAL ] EMO: Derivative data saved (1794 records). [2025-09-17T22:50:46.370812] [INFO ] [MAIN ] EMO: Successfully saved derivative data. [2025-09-17T22:50:46.373225] [INFO ] [MAIN ] Derivative Progress: 602/2085 symbols completed. EMO took 1.0s. Estimated remaining: 9m 37s. Rate: 154.3 symbols/min [2025-09-17T22:50:46.373676] [INFO ] [MAIN ] ENB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:46.389567] [DEBUG] [MAIN ] EMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:46.390284] [INFO ] [MAIN ] EMN: Generated 1794 derivative records from 50259 primary records. [2025-09-17T22:50:46.390367] [DEBUG] [LOCAL ] EMN: Saving derivative data. [2025-09-17T22:50:46.406951] [DEBUG] [LOCAL ] EMN: Derivative data saved (1794 records). [2025-09-17T22:50:46.407071] [INFO ] [MAIN ] EMN: Successfully saved derivative data. [2025-09-17T22:50:46.409391] [INFO ] [MAIN ] Derivative Progress: 603/2085 symbols completed. EMN took 1.1s. Estimated remaining: 9m 36s. Rate: 154.5 symbols/min [2025-09-17T22:50:46.409687] [INFO ] [MAIN ] ENFY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:46.414738] [DEBUG] [LOCAL ] ENFY: Loaded 3066 existing records from primary storage. [2025-09-17T22:50:46.414860] [INFO ] [MAIN ] ENFY: Loaded 3066 primary data records. [2025-09-17T22:50:46.643468] [DEBUG] [LOCAL ] EMR: Loaded 53262 existing records from primary storage. [2025-09-17T22:50:46.792787] [INFO ] [MAIN ] EMR: Loaded 53262 primary data records. [2025-09-17T22:50:46.910530] [DEBUG] [LOCAL ] ENB: Loaded 53527 existing records from primary storage. [2025-09-17T22:50:46.945515] [INFO ] [MAIN ] ENB: Loaded 53527 primary data records. [2025-09-17T22:50:47.503368] [DEBUG] [MAIN ] ENFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:47.504871] [INFO ] [MAIN ] ENFY: Generated 1794 derivative records from 3066 primary records. [2025-09-17T22:50:47.505401] [DEBUG] [LOCAL ] ENFY: Saving derivative data. [2025-09-17T22:50:47.522161] [DEBUG] [LOCAL ] ENFY: Derivative data saved (1794 records). [2025-09-17T22:50:47.522366] [INFO ] [MAIN ] ENFY: Successfully saved derivative data. [2025-09-17T22:50:47.524883] [INFO ] [MAIN ] Derivative Progress: 604/2085 symbols completed. ENFY took 1.1s. Estimated remaining: 9m 37s. Rate: 154.0 symbols/min [2025-09-17T22:50:47.526552] [INFO ] [MAIN ] ENIC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:47.543912] [DEBUG] [MAIN ] EMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:47.545170] [INFO ] [MAIN ] EMR: Generated 1794 derivative records from 53262 primary records. [2025-09-17T22:50:47.545415] [DEBUG] [LOCAL ] EMR: Saving derivative data. [2025-09-17T22:50:47.566375] [DEBUG] [LOCAL ] EMR: Derivative data saved (1794 records). [2025-09-17T22:50:47.566617] [INFO ] [MAIN ] EMR: Successfully saved derivative data. [2025-09-17T22:50:47.568935] [INFO ] [MAIN ] Derivative Progress: 605/2085 symbols completed. EMR took 1.2s. Estimated remaining: 9m 36s. Rate: 154.2 symbols/min [2025-09-17T22:50:47.569361] [INFO ] [MAIN ] ENO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:47.582985] [DEBUG] [MAIN ] ENB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:47.584576] [INFO ] [MAIN ] ENB: Generated 1794 derivative records from 53527 primary records. [2025-09-17T22:50:47.584758] [DEBUG] [LOCAL ] ENB: Saving derivative data. [2025-09-17T22:50:47.610633] [DEBUG] [LOCAL ] ENO: Loaded 2000 existing records from primary storage. [2025-09-17T22:50:47.613205] [INFO ] [MAIN ] ENO: Loaded 2000 primary data records. [2025-09-17T22:50:47.684784] [DEBUG] [LOCAL ] ENIC: Loaded 36947 existing records from primary storage. [2025-09-17T22:50:47.699428] [DEBUG] [LOCAL ] ENB: Derivative data saved (1794 records). [2025-09-17T22:50:47.711741] [INFO ] [MAIN ] ENB: Successfully saved derivative data. [2025-09-17T22:50:47.719397] [INFO ] [MAIN ] Derivative Progress: 606/2085 symbols completed. ENB took 1.3s. Estimated remaining: 9m 35s. Rate: 154.4 symbols/min [2025-09-17T22:50:47.706557] [INFO ] [MAIN ] ENIC: Loaded 36947 primary data records. [2025-09-17T22:50:47.739606] [INFO ] [MAIN ] ENOV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:48.300609] [DEBUG] [LOCAL ] ENOV: Loaded 45339 existing records from primary storage. [2025-09-17T22:50:48.300940] [INFO ] [MAIN ] ENOV: Loaded 45339 primary data records. [2025-09-17T22:50:48.372109] [DEBUG] [MAIN ] ENO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:48.387279] [INFO ] [MAIN ] ENO: Generated 1794 derivative records from 2000 primary records. [2025-09-17T22:50:48.387476] [DEBUG] [LOCAL ] ENO: Saving derivative data. [2025-09-17T22:50:48.439040] [DEBUG] [LOCAL ] ENO: Derivative data saved (1794 records). [2025-09-17T22:50:48.439522] [INFO ] [MAIN ] ENO: Successfully saved derivative data. [2025-09-17T22:50:48.452131] [INFO ] [MAIN ] Derivative Progress: 607/2085 symbols completed. ENO took 0.9s. Estimated remaining: 9m 35s. Rate: 154.2 symbols/min [2025-09-17T22:50:48.452592] [INFO ] [MAIN ] ENR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:48.655919] [DEBUG] [MAIN ] ENIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:48.657458] [INFO ] [MAIN ] ENIC: Generated 1794 derivative records from 36947 primary records. [2025-09-17T22:50:48.657788] [DEBUG] [LOCAL ] ENIC: Saving derivative data. [2025-09-17T22:50:48.676964] [DEBUG] [LOCAL ] ENIC: Derivative data saved (1794 records). [2025-09-17T22:50:48.677141] [INFO ] [MAIN ] ENIC: Successfully saved derivative data. [2025-09-17T22:50:48.679632] [INFO ] [MAIN ] Derivative Progress: 608/2085 symbols completed. ENIC took 1.2s. Estimated remaining: 9m 34s. Rate: 154.3 symbols/min [2025-09-17T22:50:48.680155] [INFO ] [MAIN ] ENS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:48.713845] [DEBUG] [LOCAL ] ENR: Loaded 42554 existing records from primary storage. [2025-09-17T22:50:48.714251] [INFO ] [MAIN ] ENR: Loaded 42554 primary data records. [2025-09-17T22:50:48.756864] [DEBUG] [MAIN ] ENOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:48.782956] [INFO ] [MAIN ] ENOV: Generated 1794 derivative records from 45339 primary records. [2025-09-17T22:50:48.805743] [DEBUG] [LOCAL ] ENOV: Saving derivative data. [2025-09-17T22:50:48.865374] [DEBUG] [LOCAL ] ENS: Loaded 29302 existing records from primary storage. [2025-09-17T22:50:48.871062] [INFO ] [MAIN ] ENS: Loaded 29302 primary data records. [2025-09-17T22:50:48.950966] [DEBUG] [LOCAL ] ENOV: Derivative data saved (1794 records). [2025-09-17T22:50:48.962962] [INFO ] [MAIN ] ENOV: Successfully saved derivative data. [2025-09-17T22:50:48.973899] [INFO ] [MAIN ] Derivative Progress: 609/2085 symbols completed. ENOV took 1.2s. Estimated remaining: 9m 34s. Rate: 154.3 symbols/min [2025-09-17T22:50:49.031351] [INFO ] [MAIN ] ENVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:49.437757] [DEBUG] [LOCAL ] ENVA: Loaded 25745 existing records from primary storage. [2025-09-17T22:50:49.439187] [INFO ] [MAIN ] ENVA: Loaded 25745 primary data records. [2025-09-17T22:50:49.615063] [DEBUG] [MAIN ] ENR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:49.626480] [INFO ] [MAIN ] ENR: Generated 1794 derivative records from 42554 primary records. [2025-09-17T22:50:49.631782] [DEBUG] [LOCAL ] ENR: Saving derivative data. [2025-09-17T22:50:49.709411] [DEBUG] [LOCAL ] ENR: Derivative data saved (1794 records). [2025-09-17T22:50:49.709726] [INFO ] [MAIN ] ENR: Successfully saved derivative data. [2025-09-17T22:50:49.711941] [INFO ] [MAIN ] Derivative Progress: 610/2085 symbols completed. ENR took 1.3s. Estimated remaining: 9m 34s. Rate: 154.1 symbols/min [2025-09-17T22:50:49.833391] [INFO ] [MAIN ] EOD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:49.848608] [DEBUG] [MAIN ] ENS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:49.849361] [INFO ] [MAIN ] ENS: Generated 1794 derivative records from 29302 primary records. [2025-09-17T22:50:49.849721] [DEBUG] [LOCAL ] ENS: Saving derivative data. [2025-09-17T22:50:49.872159] [DEBUG] [LOCAL ] ENS: Derivative data saved (1794 records). [2025-09-17T22:50:49.878842] [INFO ] [MAIN ] ENS: Successfully saved derivative data. [2025-09-17T22:50:49.881408] [INFO ] [MAIN ] Derivative Progress: 611/2085 symbols completed. ENS took 1.2s. Estimated remaining: 9m 33s. Rate: 154.3 symbols/min [2025-09-17T22:50:49.878717] [DEBUG] [LOCAL ] EOD: Loaded 14181 existing records from primary storage. [2025-09-17T22:50:49.881637] [INFO ] [MAIN ] EOD: Loaded 14181 primary data records. [2025-09-17T22:50:49.881914] [INFO ] [MAIN ] EOG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:50.223831] [DEBUG] [MAIN ] ENVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:50.239233] [INFO ] [MAIN ] ENVA: Generated 1794 derivative records from 25745 primary records. [2025-09-17T22:50:50.239965] [DEBUG] [LOCAL ] ENVA: Saving derivative data. [2025-09-17T22:50:50.257774] [DEBUG] [LOCAL ] ENVA: Derivative data saved (1794 records). [2025-09-17T22:50:50.258973] [INFO ] [MAIN ] ENVA: Successfully saved derivative data. [2025-09-17T22:50:50.261045] [INFO ] [MAIN ] Derivative Progress: 612/2085 symbols completed. ENVA took 1.3s. Estimated remaining: 9m 33s. Rate: 154.3 symbols/min [2025-09-17T22:50:50.262189] [INFO ] [MAIN ] EOI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:50.279605] [DEBUG] [LOCAL ] EOG: Loaded 53342 existing records from primary storage. [2025-09-17T22:50:50.279917] [INFO ] [MAIN ] EOG: Loaded 53342 primary data records. [2025-09-17T22:50:50.393977] [DEBUG] [LOCAL ] EOI: Loaded 10674 existing records from primary storage. [2025-09-17T22:50:50.396048] [INFO ] [MAIN ] EOI: Loaded 10674 primary data records. [2025-09-17T22:50:50.519992] [DEBUG] [MAIN ] EOD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:50.574492] [INFO ] [MAIN ] EOD: Generated 1794 derivative records from 14181 primary records. [2025-09-17T22:50:50.656757] [DEBUG] [LOCAL ] EOD: Saving derivative data. [2025-09-17T22:50:50.836958] [DEBUG] [LOCAL ] EOD: Derivative data saved (1794 records). [2025-09-17T22:50:50.841117] [INFO ] [MAIN ] EOD: Successfully saved derivative data. [2025-09-17T22:50:50.945241] [INFO ] [MAIN ] Derivative Progress: 613/2085 symbols completed. EOD took 1.1s. Estimated remaining: 9m 33s. Rate: 154.1 symbols/min [2025-09-17T22:50:51.042635] [DEBUG] [MAIN ] EOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:51.043341] [INFO ] [MAIN ] EOG: Generated 1794 derivative records from 53342 primary records. [2025-09-17T22:50:51.043492] [DEBUG] [LOCAL ] EOG: Saving derivative data. [2025-09-17T22:50:51.062093] [DEBUG] [LOCAL ] EOG: Derivative data saved (1794 records). [2025-09-17T22:50:51.062914] [INFO ] [MAIN ] EOG: Successfully saved derivative data. [2025-09-17T22:50:51.065140] [INFO ] [MAIN ] Derivative Progress: 614/2085 symbols completed. EOG took 1.2s. Estimated remaining: 9m 32s. Rate: 154.2 symbols/min [2025-09-17T22:50:51.078252] [DEBUG] [MAIN ] EOI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:51.078878] [INFO ] [MAIN ] EOI: Generated 1794 derivative records from 10674 primary records. [2025-09-17T22:50:51.078943] [DEBUG] [LOCAL ] EOI: Saving derivative data. [2025-09-17T22:50:51.094784] [DEBUG] [LOCAL ] EOI: Derivative data saved (1794 records). [2025-09-17T22:50:51.094863] [INFO ] [MAIN ] EOI: Successfully saved derivative data. [2025-09-17T22:50:51.097293] [INFO ] [MAIN ] Derivative Progress: 615/2085 symbols completed. EOI took 0.8s. Estimated remaining: 9m 31s. Rate: 154.5 symbols/min [2025-09-17T22:50:51.098000] [INFO ] [MAIN ] EOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:51.098086] [INFO ] [MAIN ] EOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:51.098143] [INFO ] [MAIN ] EPAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:51.108829] [DEBUG] [LOCAL ] EOT: Loaded 6861 existing records from primary storage. [2025-09-17T22:50:51.108991] [INFO ] [MAIN ] EOT: Loaded 6861 primary data records. [2025-09-17T22:50:51.212567] [DEBUG] [LOCAL ] EOS: Loaded 15560 existing records from primary storage. [2025-09-17T22:50:51.244288] [INFO ] [MAIN ] EOS: Loaded 15560 primary data records. [2025-09-17T22:50:51.439007] [DEBUG] [LOCAL ] EPAC: Loaded 26971 existing records from primary storage. [2025-09-17T22:50:51.565965] [INFO ] [MAIN ] EPAC: Loaded 26971 primary data records. [2025-09-17T22:50:52.125499] [DEBUG] [MAIN ] EOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:52.127032] [INFO ] [MAIN ] EOT: Generated 1794 derivative records from 6861 primary records. [2025-09-17T22:50:52.128126] [DEBUG] [LOCAL ] EOT: Saving derivative data. [2025-09-17T22:50:52.146001] [DEBUG] [LOCAL ] EOT: Derivative data saved (1794 records). [2025-09-17T22:50:52.161339] [DEBUG] [MAIN ] EOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:52.161565] [INFO ] [MAIN ] EOT: Successfully saved derivative data. [2025-09-17T22:50:52.163939] [INFO ] [MAIN ] Derivative Progress: 616/2085 symbols completed. EOT took 1.1s. Estimated remaining: 9m 32s. Rate: 154.0 symbols/min [2025-09-17T22:50:52.165232] [INFO ] [MAIN ] EOS: Generated 1794 derivative records from 15560 primary records. [2025-09-17T22:50:52.165427] [INFO ] [MAIN ] EPAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:52.177405] [DEBUG] [LOCAL ] EOS: Saving derivative data. [2025-09-17T22:50:52.178233] [DEBUG] [MAIN ] EPAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:52.179494] [INFO ] [MAIN ] EPAC: Generated 1794 derivative records from 26971 primary records. [2025-09-17T22:50:52.180095] [DEBUG] [LOCAL ] EPAC: Saving derivative data. [2025-09-17T22:50:52.209339] [DEBUG] [LOCAL ] EOS: Derivative data saved (1794 records). [2025-09-17T22:50:52.213467] [DEBUG] [LOCAL ] EPAC: Derivative data saved (1794 records). [2025-09-17T22:50:52.212889] [INFO ] [MAIN ] EOS: Successfully saved derivative data. [2025-09-17T22:50:52.213611] [INFO ] [MAIN ] EPAC: Successfully saved derivative data. [2025-09-17T22:50:52.216358] [INFO ] [MAIN ] Derivative Progress: 617/2085 symbols completed. EPAC took 1.1s. Estimated remaining: 9m 31s. Rate: 154.3 symbols/min [2025-09-17T22:50:52.219106] [INFO ] [MAIN ] Derivative Progress: 618/2085 symbols completed. EOS took 1.1s. Estimated remaining: 9m 30s. Rate: 154.5 symbols/min [2025-09-17T22:50:52.219209] [INFO ] [MAIN ] EPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:52.219435] [INFO ] [MAIN ] EPD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:52.253925] [DEBUG] [LOCAL ] EPAM: Loaded 39739 existing records from primary storage. [2025-09-17T22:50:52.254206] [INFO ] [MAIN ] EPAM: Loaded 39739 primary data records. [2025-09-17T22:50:52.422473] [DEBUG] [LOCAL ] EPC: Loaded 39929 existing records from primary storage. [2025-09-17T22:50:52.446881] [INFO ] [MAIN ] EPC: Loaded 39929 primary data records. [2025-09-17T22:50:52.690515] [DEBUG] [LOCAL ] EPD: Loaded 53616 existing records from primary storage. [2025-09-17T22:50:52.701667] [INFO ] [MAIN ] EPD: Loaded 53616 primary data records. [2025-09-17T22:50:53.270909] [DEBUG] [MAIN ] EPAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:53.272605] [INFO ] [MAIN ] EPAM: Generated 1794 derivative records from 39739 primary records. [2025-09-17T22:50:53.272912] [DEBUG] [LOCAL ] EPAM: Saving derivative data. [2025-09-17T22:50:53.291818] [DEBUG] [LOCAL ] EPAM: Derivative data saved (1794 records). [2025-09-17T22:50:53.292137] [INFO ] [MAIN ] EPAM: Successfully saved derivative data. [2025-09-17T22:50:53.294832] [INFO ] [MAIN ] Derivative Progress: 619/2085 symbols completed. EPAM took 1.1s. Estimated remaining: 9m 31s. Rate: 154.1 symbols/min [2025-09-17T22:50:53.307704] [INFO ] [MAIN ] EPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:53.308367] [DEBUG] [MAIN ] EPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:53.309155] [INFO ] [MAIN ] EPC: Generated 1794 derivative records from 39929 primary records. [2025-09-17T22:50:53.309383] [DEBUG] [LOCAL ] EPC: Saving derivative data. [2025-09-17T22:50:53.335377] [DEBUG] [LOCAL ] EPC: Derivative data saved (1794 records). [2025-09-17T22:50:53.339799] [INFO ] [MAIN ] EPC: Successfully saved derivative data. [2025-09-17T22:50:53.342607] [INFO ] [MAIN ] Derivative Progress: 620/2085 symbols completed. EPC took 1.1s. Estimated remaining: 9m 30s. Rate: 154.3 symbols/min [2025-09-17T22:50:53.343086] [INFO ] [MAIN ] EPRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:53.344140] [DEBUG] [MAIN ] EPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:53.344904] [INFO ] [MAIN ] EPD: Generated 1794 derivative records from 53616 primary records. [2025-09-17T22:50:53.345063] [DEBUG] [LOCAL ] EPD: Saving derivative data. [2025-09-17T22:50:53.361690] [DEBUG] [LOCAL ] EPD: Derivative data saved (1794 records). [2025-09-17T22:50:53.361853] [INFO ] [MAIN ] EPD: Successfully saved derivative data. [2025-09-17T22:50:53.364047] [INFO ] [MAIN ] Derivative Progress: 621/2085 symbols completed. EPD took 1.1s. Estimated remaining: 9m 28s. Rate: 154.5 symbols/min [2025-09-17T22:50:53.364396] [INFO ] [MAIN ] EQBK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:53.386075] [DEBUG] [LOCAL ] EQBK: Loaded 10882 existing records from primary storage. [2025-09-17T22:50:53.386252] [INFO ] [MAIN ] EQBK: Loaded 10882 primary data records. [2025-09-17T22:50:53.464483] [DEBUG] [LOCAL ] EPR: Loaded 44439 existing records from primary storage. [2025-09-17T22:50:53.481731] [INFO ] [MAIN ] EPR: Loaded 44439 primary data records. [2025-09-17T22:50:53.842424] [DEBUG] [LOCAL ] EPRT: Loaded 48708 existing records from primary storage. [2025-09-17T22:50:53.843380] [INFO ] [MAIN ] EPRT: Loaded 48708 primary data records. [2025-09-17T22:50:54.394627] [DEBUG] [MAIN ] EQBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:54.395779] [INFO ] [MAIN ] EQBK: Generated 1794 derivative records from 10882 primary records. [2025-09-17T22:50:54.395989] [DEBUG] [LOCAL ] EQBK: Saving derivative data. [2025-09-17T22:50:54.414628] [DEBUG] [LOCAL ] EQBK: Derivative data saved (1794 records). [2025-09-17T22:50:54.414911] [INFO ] [MAIN ] EQBK: Successfully saved derivative data. [2025-09-17T22:50:54.417245] [INFO ] [MAIN ] Derivative Progress: 622/2085 symbols completed. EQBK took 1.1s. Estimated remaining: 9m 30s. Rate: 154.1 symbols/min [2025-09-17T22:50:54.418632] [INFO ] [MAIN ] EQH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:54.436625] [DEBUG] [MAIN ] EPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:54.437452] [INFO ] [MAIN ] EPR: Generated 1794 derivative records from 44439 primary records. [2025-09-17T22:50:54.437759] [DEBUG] [LOCAL ] EPR: Saving derivative data. [2025-09-17T22:50:54.456183] [DEBUG] [LOCAL ] EPR: Derivative data saved (1794 records). [2025-09-17T22:50:54.457075] [INFO ] [MAIN ] EPR: Successfully saved derivative data. [2025-09-17T22:50:54.459586] [INFO ] [MAIN ] Derivative Progress: 623/2085 symbols completed. EPR took 1.2s. Estimated remaining: 9m 28s. Rate: 154.3 symbols/min [2025-09-17T22:50:54.467862] [INFO ] [MAIN ] EQNR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:54.473599] [DEBUG] [MAIN ] EPRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:54.474905] [INFO ] [MAIN ] EPRT: Generated 1794 derivative records from 48708 primary records. [2025-09-17T22:50:54.475213] [DEBUG] [LOCAL ] EPRT: Saving derivative data. [2025-09-17T22:50:54.499101] [DEBUG] [LOCAL ] EPRT: Derivative data saved (1794 records). [2025-09-17T22:50:54.499322] [INFO ] [MAIN ] EPRT: Successfully saved derivative data. [2025-09-17T22:50:54.503764] [INFO ] [MAIN ] Derivative Progress: 624/2085 symbols completed. EPRT took 1.2s. Estimated remaining: 9m 27s. Rate: 154.5 symbols/min [2025-09-17T22:50:54.504454] [INFO ] [MAIN ] EQR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:54.541540] [DEBUG] [LOCAL ] EQH: Loaded 52667 existing records from primary storage. [2025-09-17T22:50:54.541883] [INFO ] [MAIN ] EQH: Loaded 52667 primary data records. [2025-09-17T22:50:54.708869] [DEBUG] [LOCAL ] EQNR: Loaded 53049 existing records from primary storage. [2025-09-17T22:50:54.744044] [INFO ] [MAIN ] EQNR: Loaded 53049 primary data records. [2025-09-17T22:50:55.027518] [DEBUG] [LOCAL ] EQR: Loaded 51365 existing records from primary storage. [2025-09-17T22:50:55.039631] [INFO ] [MAIN ] EQR: Loaded 51365 primary data records. [2025-09-17T22:50:55.603028] [DEBUG] [MAIN ] EQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:55.603870] [INFO ] [MAIN ] EQH: Generated 1794 derivative records from 52667 primary records. [2025-09-17T22:50:55.604053] [DEBUG] [LOCAL ] EQH: Saving derivative data. [2025-09-17T22:50:55.624221] [DEBUG] [LOCAL ] EQH: Derivative data saved (1794 records). [2025-09-17T22:50:55.624677] [INFO ] [MAIN ] EQH: Successfully saved derivative data. [2025-09-17T22:50:55.627062] [INFO ] [MAIN ] Derivative Progress: 625/2085 symbols completed. EQH took 1.2s. Estimated remaining: 9m 29s. Rate: 154.1 symbols/min [2025-09-17T22:50:55.631696] [INFO ] [MAIN ] EQT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:55.641140] [DEBUG] [MAIN ] EQNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:55.642041] [INFO ] [MAIN ] EQNR: Generated 1794 derivative records from 53049 primary records. [2025-09-17T22:50:55.642417] [DEBUG] [LOCAL ] EQNR: Saving derivative data. [2025-09-17T22:50:55.659512] [DEBUG] [LOCAL ] EQNR: Derivative data saved (1794 records). [2025-09-17T22:50:55.660181] [INFO ] [MAIN ] EQNR: Successfully saved derivative data. [2025-09-17T22:50:55.663084] [INFO ] [MAIN ] Derivative Progress: 626/2085 symbols completed. EQNR took 1.2s. Estimated remaining: 9m 27s. Rate: 154.3 symbols/min [2025-09-17T22:50:55.663432] [INFO ] [MAIN ] EQV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:55.682335] [DEBUG] [LOCAL ] EQV: Loaded 2920 existing records from primary storage. [2025-09-17T22:50:55.679991] [DEBUG] [MAIN ] EQR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:55.683135] [INFO ] [MAIN ] EQR: Generated 1794 derivative records from 51365 primary records. [2025-09-17T22:50:55.683368] [DEBUG] [LOCAL ] EQR: Saving derivative data. [2025-09-17T22:50:55.683310] [INFO ] [MAIN ] EQV: Loaded 2920 primary data records. [2025-09-17T22:50:55.795344] [DEBUG] [LOCAL ] EQR: Derivative data saved (1794 records). [2025-09-17T22:50:55.820748] [INFO ] [MAIN ] EQR: Successfully saved derivative data. [2025-09-17T22:50:55.833957] [INFO ] [MAIN ] Derivative Progress: 627/2085 symbols completed. EQR took 1.3s. Estimated remaining: 9m 26s. Rate: 154.4 symbols/min [2025-09-17T22:50:55.945908] [INFO ] [MAIN ] ERJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:56.050266] [DEBUG] [LOCAL ] EQT: Loaded 53682 existing records from primary storage. [2025-09-17T22:50:56.050737] [INFO ] [MAIN ] EQT: Loaded 53682 primary data records. [2025-09-17T22:50:56.393672] [DEBUG] [LOCAL ] ERJ: Loaded 50957 existing records from primary storage. [2025-09-17T22:50:56.395857] [INFO ] [MAIN ] ERJ: Loaded 50957 primary data records. [2025-09-17T22:50:56.482799] [DEBUG] [MAIN ] EQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:56.520274] [INFO ] [MAIN ] EQV: Generated 1794 derivative records from 2920 primary records. [2025-09-17T22:50:56.526830] [DEBUG] [LOCAL ] EQV: Saving derivative data. [2025-09-17T22:50:56.740840] [DEBUG] [LOCAL ] EQV: Derivative data saved (1794 records). [2025-09-17T22:50:56.741285] [INFO ] [MAIN ] EQV: Successfully saved derivative data. [2025-09-17T22:50:56.743518] [INFO ] [MAIN ] Derivative Progress: 628/2085 symbols completed. EQV took 1.1s. Estimated remaining: 9m 27s. Rate: 154.1 symbols/min [2025-09-17T22:50:56.761791] [DEBUG] [MAIN ] EQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:56.762497] [INFO ] [MAIN ] EQT: Generated 1794 derivative records from 53682 primary records. [2025-09-17T22:50:56.762575] [DEBUG] [LOCAL ] EQT: Saving derivative data. [2025-09-17T22:50:56.779453] [DEBUG] [LOCAL ] EQT: Derivative data saved (1794 records). [2025-09-17T22:50:56.779522] [INFO ] [MAIN ] EQT: Successfully saved derivative data. [2025-09-17T22:50:56.781973] [INFO ] [MAIN ] Derivative Progress: 629/2085 symbols completed. EQT took 1.2s. Estimated remaining: 9m 26s. Rate: 154.3 symbols/min [2025-09-17T22:50:56.799940] [DEBUG] [MAIN ] ERJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:56.800584] [INFO ] [MAIN ] ERJ: Generated 1794 derivative records from 50957 primary records. [2025-09-17T22:50:56.800668] [DEBUG] [LOCAL ] ERJ: Saving derivative data. [2025-09-17T22:50:56.816422] [DEBUG] [LOCAL ] ERJ: Derivative data saved (1794 records). [2025-09-17T22:50:56.816555] [INFO ] [MAIN ] ERJ: Successfully saved derivative data. [2025-09-17T22:50:56.819638] [INFO ] [MAIN ] Derivative Progress: 630/2085 symbols completed. ERJ took 0.9s. Estimated remaining: 9m 25s. Rate: 154.5 symbols/min [2025-09-17T22:50:56.820577] [INFO ] [MAIN ] ES: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:56.820891] [INFO ] [MAIN ] ESE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:56.820835] [INFO ] [MAIN ] ERO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:56.853798] [DEBUG] [LOCAL ] ESE: Loaded 16612 existing records from primary storage. [2025-09-17T22:50:56.853987] [INFO ] [MAIN ] ESE: Loaded 16612 primary data records. [2025-09-17T22:50:57.023884] [DEBUG] [LOCAL ] ERO: Loaded 41129 existing records from primary storage. [2025-09-17T22:50:57.071753] [INFO ] [MAIN ] ERO: Loaded 41129 primary data records. [2025-09-17T22:50:57.260998] [DEBUG] [LOCAL ] ES: Loaded 52516 existing records from primary storage. [2025-09-17T22:50:57.285336] [INFO ] [MAIN ] ES: Loaded 52516 primary data records. [2025-09-17T22:50:57.895008] [DEBUG] [MAIN ] ESE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:57.896086] [INFO ] [MAIN ] ESE: Generated 1794 derivative records from 16612 primary records. [2025-09-17T22:50:57.896256] [DEBUG] [LOCAL ] ESE: Saving derivative data. [2025-09-17T22:50:57.915513] [DEBUG] [LOCAL ] ESE: Derivative data saved (1794 records). [2025-09-17T22:50:57.915715] [INFO ] [MAIN ] ESE: Successfully saved derivative data. [2025-09-17T22:50:57.918151] [INFO ] [MAIN ] Derivative Progress: 631/2085 symbols completed. ESE took 1.1s. Estimated remaining: 9m 26s. Rate: 154.1 symbols/min [2025-09-17T22:50:57.918464] [INFO ] [MAIN ] ESI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:57.931535] [DEBUG] [MAIN ] ERO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:57.932391] [INFO ] [MAIN ] ERO: Generated 1794 derivative records from 41129 primary records. [2025-09-17T22:50:57.932829] [DEBUG] [LOCAL ] ERO: Saving derivative data. [2025-09-17T22:50:57.949217] [DEBUG] [LOCAL ] ERO: Derivative data saved (1794 records). [2025-09-17T22:50:57.949527] [INFO ] [MAIN ] ERO: Successfully saved derivative data. [2025-09-17T22:50:57.951676] [INFO ] [MAIN ] Derivative Progress: 632/2085 symbols completed. ERO took 1.1s. Estimated remaining: 9m 25s. Rate: 154.3 symbols/min [2025-09-17T22:50:57.952092] [INFO ] [MAIN ] ESNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:57.968602] [DEBUG] [MAIN ] ES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:57.969374] [INFO ] [MAIN ] ES: Generated 1794 derivative records from 52516 primary records. [2025-09-17T22:50:57.969476] [DEBUG] [LOCAL ] ES: Saving derivative data. [2025-09-17T22:50:57.985283] [DEBUG] [LOCAL ] ES: Derivative data saved (1794 records). [2025-09-17T22:50:57.985465] [INFO ] [MAIN ] ES: Successfully saved derivative data. [2025-09-17T22:50:57.988037] [INFO ] [MAIN ] Derivative Progress: 633/2085 symbols completed. ES took 1.2s. Estimated remaining: 9m 24s. Rate: 154.5 symbols/min [2025-09-17T22:50:57.988351] [INFO ] [MAIN ] ESRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:58.031209] [DEBUG] [LOCAL ] ESI: Loaded 50860 existing records from primary storage. [2025-09-17T22:50:58.031812] [INFO ] [MAIN ] ESI: Loaded 50860 primary data records. [2025-09-17T22:50:58.141621] [DEBUG] [LOCAL ] ESNT: Loaded 38756 existing records from primary storage. [2025-09-17T22:50:58.158761] [INFO ] [MAIN ] ESNT: Loaded 38756 primary data records. [2025-09-17T22:50:58.356862] [DEBUG] [LOCAL ] ESRT: Loaded 46440 existing records from primary storage. [2025-09-17T22:50:58.467692] [INFO ] [MAIN ] ESRT: Loaded 46440 primary data records. [2025-09-17T22:50:59.043923] [DEBUG] [MAIN ] ESI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:59.044771] [INFO ] [MAIN ] ESI: Generated 1794 derivative records from 50860 primary records. [2025-09-17T22:50:59.044948] [DEBUG] [LOCAL ] ESI: Saving derivative data. [2025-09-17T22:50:59.064409] [DEBUG] [LOCAL ] ESI: Derivative data saved (1794 records). [2025-09-17T22:50:59.064801] [INFO ] [MAIN ] ESI: Successfully saved derivative data. [2025-09-17T22:50:59.075076] [INFO ] [MAIN ] Derivative Progress: 634/2085 symbols completed. ESI took 1.2s. Estimated remaining: 9m 25s. Rate: 154.1 symbols/min [2025-09-17T22:50:59.080529] [DEBUG] [MAIN ] ESNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:59.080252] [INFO ] [MAIN ] ESS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:59.081336] [INFO ] [MAIN ] ESNT: Generated 1794 derivative records from 38756 primary records. [2025-09-17T22:50:59.081781] [DEBUG] [LOCAL ] ESNT: Saving derivative data. [2025-09-17T22:50:59.098775] [DEBUG] [LOCAL ] ESNT: Derivative data saved (1794 records). [2025-09-17T22:50:59.099900] [INFO ] [MAIN ] ESNT: Successfully saved derivative data. [2025-09-17T22:50:59.104556] [INFO ] [MAIN ] Derivative Progress: 635/2085 symbols completed. ESNT took 1.2s. Estimated remaining: 9m 24s. Rate: 154.3 symbols/min [2025-09-17T22:50:59.104920] [INFO ] [MAIN ] ESTC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:59.118704] [DEBUG] [MAIN ] ESRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:50:59.119387] [INFO ] [MAIN ] ESRT: Generated 1794 derivative records from 46440 primary records. [2025-09-17T22:50:59.127143] [DEBUG] [LOCAL ] ESRT: Saving derivative data. [2025-09-17T22:50:59.142896] [DEBUG] [LOCAL ] ESRT: Derivative data saved (1794 records). [2025-09-17T22:50:59.152849] [DEBUG] [LOCAL ] ESS: Loaded 30078 existing records from primary storage. [2025-09-17T22:50:59.151350] [INFO ] [MAIN ] ESRT: Successfully saved derivative data. [2025-09-17T22:50:59.155511] [INFO ] [MAIN ] Derivative Progress: 636/2085 symbols completed. ESRT took 1.2s. Estimated remaining: 9m 23s. Rate: 154.5 symbols/min [2025-09-17T22:50:59.155883] [INFO ] [MAIN ] ET: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:50:59.155775] [INFO ] [MAIN ] ESS: Loaded 30078 primary data records. [2025-09-17T22:50:59.498146] [DEBUG] [LOCAL ] ESTC: Loaded 50222 existing records from primary storage. [2025-09-17T22:50:59.498408] [INFO ] [MAIN ] ESTC: Loaded 50222 primary data records. [2025-09-17T22:50:59.630814] [DEBUG] [LOCAL ] ET: Loaded 53789 existing records from primary storage. [2025-09-17T22:50:59.662790] [INFO ] [MAIN ] ET: Loaded 53789 primary data records. [2025-09-17T22:51:00.162187] [DEBUG] [MAIN ] ESS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:00.164151] [INFO ] [MAIN ] ESS: Generated 1794 derivative records from 30078 primary records. [2025-09-17T22:51:00.164431] [DEBUG] [LOCAL ] ESS: Saving derivative data. [2025-09-17T22:51:00.182625] [DEBUG] [LOCAL ] ESS: Derivative data saved (1794 records). [2025-09-17T22:51:00.182783] [INFO ] [MAIN ] ESS: Successfully saved derivative data. [2025-09-17T22:51:00.185346] [INFO ] [MAIN ] Derivative Progress: 637/2085 symbols completed. ESS took 1.1s. Estimated remaining: 9m 24s. Rate: 154.1 symbols/min [2025-09-17T22:51:00.187442] [INFO ] [MAIN ] ETB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:00.203049] [DEBUG] [MAIN ] ESTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:00.204014] [INFO ] [MAIN ] ESTC: Generated 1794 derivative records from 50222 primary records. [2025-09-17T22:51:00.208324] [DEBUG] [LOCAL ] ESTC: Saving derivative data. [2025-09-17T22:51:00.240139] [DEBUG] [MAIN ] ET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:00.244721] [DEBUG] [LOCAL ] ESTC: Derivative data saved (1794 records). [2025-09-17T22:51:00.245482] [INFO ] [MAIN ] ET: Generated 1794 derivative records from 53789 primary records. [2025-09-17T22:51:00.245775] [INFO ] [MAIN ] ESTC: Successfully saved derivative data. [2025-09-17T22:51:00.245821] [DEBUG] [LOCAL ] ET: Saving derivative data. [2025-09-17T22:51:00.248693] [INFO ] [MAIN ] Derivative Progress: 638/2085 symbols completed. ESTC took 1.1s. Estimated remaining: 9m 23s. Rate: 154.3 symbols/min [2025-09-17T22:51:00.249898] [INFO ] [MAIN ] ETD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:00.269429] [DEBUG] [LOCAL ] ETB: Loaded 12220 existing records from primary storage. [2025-09-17T22:51:00.272944] [INFO ] [MAIN ] ETB: Loaded 12220 primary data records. [2025-09-17T22:51:00.304914] [DEBUG] [LOCAL ] ET: Derivative data saved (1794 records). [2025-09-17T22:51:00.305137] [INFO ] [MAIN ] ET: Successfully saved derivative data. [2025-09-17T22:51:00.320336] [INFO ] [MAIN ] Derivative Progress: 639/2085 symbols completed. ET took 1.2s. Estimated remaining: 9m 21s. Rate: 154.5 symbols/min [2025-09-17T22:51:00.343115] [INFO ] [MAIN ] ETG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:00.487512] [DEBUG] [LOCAL ] ETD: Loaded 27396 existing records from primary storage. [2025-09-17T22:51:00.487847] [INFO ] [MAIN ] ETD: Loaded 27396 primary data records. [2025-09-17T22:51:00.647174] [DEBUG] [LOCAL ] ETG: Loaded 17040 existing records from primary storage. [2025-09-17T22:51:00.659818] [INFO ] [MAIN ] ETG: Loaded 17040 primary data records. [2025-09-17T22:51:01.286237] [DEBUG] [MAIN ] ETB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:01.287820] [INFO ] [MAIN ] ETB: Generated 1794 derivative records from 12220 primary records. [2025-09-17T22:51:01.288193] [DEBUG] [LOCAL ] ETB: Saving derivative data. [2025-09-17T22:51:01.306884] [DEBUG] [LOCAL ] ETB: Derivative data saved (1794 records). [2025-09-17T22:51:01.307227] [INFO ] [MAIN ] ETB: Successfully saved derivative data. [2025-09-17T22:51:01.309350] [INFO ] [MAIN ] Derivative Progress: 640/2085 symbols completed. ETB took 1.1s. Estimated remaining: 9m 22s. Rate: 154.2 symbols/min [2025-09-17T22:51:01.309741] [INFO ] [MAIN ] ETJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:01.330425] [DEBUG] [MAIN ] ETD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:01.335579] [INFO ] [MAIN ] ETD: Generated 1794 derivative records from 27396 primary records. [2025-09-17T22:51:01.347913] [DEBUG] [MAIN ] ETG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:01.348559] [INFO ] [MAIN ] ETG: Generated 1794 derivative records from 17040 primary records. [2025-09-17T22:51:01.347681] [DEBUG] [LOCAL ] ETD: Saving derivative data. [2025-09-17T22:51:01.349124] [DEBUG] [LOCAL ] ETG: Saving derivative data. [2025-09-17T22:51:01.366890] [DEBUG] [LOCAL ] ETJ: Loaded 16934 existing records from primary storage. [2025-09-17T22:51:01.376427] [INFO ] [MAIN ] ETJ: Loaded 16934 primary data records. [2025-09-17T22:51:01.384527] [DEBUG] [LOCAL ] ETD: Derivative data saved (1794 records). [2025-09-17T22:51:01.416972] [INFO ] [MAIN ] ETD: Successfully saved derivative data. [2025-09-17T22:51:01.406550] [DEBUG] [LOCAL ] ETG: Derivative data saved (1794 records). [2025-09-17T22:51:01.419422] [INFO ] [MAIN ] Derivative Progress: 641/2085 symbols completed. ETD took 1.2s. Estimated remaining: 9m 21s. Rate: 154.3 symbols/min [2025-09-17T22:51:01.424716] [INFO ] [MAIN ] ETG: Successfully saved derivative data. [2025-09-17T22:51:01.446392] [INFO ] [MAIN ] Derivative Progress: 642/2085 symbols completed. ETG took 1.1s. Estimated remaining: 9m 20s. Rate: 154.6 symbols/min [2025-09-17T22:51:01.459250] [INFO ] [MAIN ] ETO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:01.444008] [INFO ] [MAIN ] ETN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:01.559865] [DEBUG] [LOCAL ] ETO: Loaded 6633 existing records from primary storage. [2025-09-17T22:51:01.694328] [INFO ] [MAIN ] ETO: Loaded 6633 primary data records. [2025-09-17T22:51:02.046200] [DEBUG] [LOCAL ] ETN: Loaded 52875 existing records from primary storage. [2025-09-17T22:51:02.046685] [INFO ] [MAIN ] ETN: Loaded 52875 primary data records. [2025-09-17T22:51:02.252865] [DEBUG] [MAIN ] ETJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:02.374932] [INFO ] [MAIN ] ETJ: Generated 1794 derivative records from 16934 primary records. [2025-09-17T22:51:02.375457] [DEBUG] [LOCAL ] ETJ: Saving derivative data. [2025-09-17T22:51:02.395005] [DEBUG] [LOCAL ] ETJ: Derivative data saved (1794 records). [2025-09-17T22:51:02.395393] [INFO ] [MAIN ] ETJ: Successfully saved derivative data. [2025-09-17T22:51:02.398468] [INFO ] [MAIN ] Derivative Progress: 643/2085 symbols completed. ETJ took 1.1s. Estimated remaining: 9m 21s. Rate: 154.2 symbols/min [2025-09-17T22:51:02.415605] [DEBUG] [MAIN ] ETO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:02.416320] [INFO ] [MAIN ] ETO: Generated 1794 derivative records from 6633 primary records. [2025-09-17T22:51:02.416491] [DEBUG] [LOCAL ] ETO: Saving derivative data. [2025-09-17T22:51:02.432077] [DEBUG] [LOCAL ] ETO: Derivative data saved (1794 records). [2025-09-17T22:51:02.432317] [INFO ] [MAIN ] ETO: Successfully saved derivative data. [2025-09-17T22:51:02.434548] [INFO ] [MAIN ] Derivative Progress: 644/2085 symbols completed. ETO took 1.0s. Estimated remaining: 9m 20s. Rate: 154.4 symbols/min [2025-09-17T22:51:02.449971] [DEBUG] [MAIN ] ETN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:02.450520] [INFO ] [MAIN ] ETN: Generated 1794 derivative records from 52875 primary records. [2025-09-17T22:51:02.450590] [DEBUG] [LOCAL ] ETN: Saving derivative data. [2025-09-17T22:51:02.466283] [DEBUG] [LOCAL ] ETN: Derivative data saved (1794 records). [2025-09-17T22:51:02.466343] [INFO ] [MAIN ] ETN: Successfully saved derivative data. [2025-09-17T22:51:02.468624] [INFO ] [MAIN ] Derivative Progress: 645/2085 symbols completed. ETN took 1.0s. Estimated remaining: 9m 19s. Rate: 154.6 symbols/min [2025-09-17T22:51:02.469447] [INFO ] [MAIN ] ETR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:02.469702] [INFO ] [MAIN ] ETV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:02.469585] [INFO ] [MAIN ] ETW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:02.503353] [DEBUG] [LOCAL ] ETW: Loaded 25306 existing records from primary storage. [2025-09-17T22:51:02.503548] [INFO ] [MAIN ] ETW: Loaded 25306 primary data records. [2025-09-17T22:51:02.568250] [DEBUG] [LOCAL ] ETV: Loaded 21538 existing records from primary storage. [2025-09-17T22:51:02.594469] [INFO ] [MAIN ] ETV: Loaded 21538 primary data records. [2025-09-17T22:51:02.954691] [DEBUG] [LOCAL ] ETR: Loaded 53245 existing records from primary storage. [2025-09-17T22:51:02.992727] [INFO ] [MAIN ] ETR: Loaded 53245 primary data records. [2025-09-17T22:51:03.550827] [DEBUG] [MAIN ] ETW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:03.551810] [INFO ] [MAIN ] ETW: Generated 1794 derivative records from 25306 primary records. [2025-09-17T22:51:03.552257] [DEBUG] [LOCAL ] ETW: Saving derivative data. [2025-09-17T22:51:03.587873] [DEBUG] [MAIN ] ETV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:03.588794] [DEBUG] [LOCAL ] ETW: Derivative data saved (1794 records). [2025-09-17T22:51:03.589119] [INFO ] [MAIN ] ETW: Successfully saved derivative data. [2025-09-17T22:51:03.591472] [INFO ] [MAIN ] Derivative Progress: 646/2085 symbols completed. ETW took 1.1s. Estimated remaining: 9m 20s. Rate: 154.2 symbols/min [2025-09-17T22:51:03.592698] [INFO ] [MAIN ] ETV: Generated 1794 derivative records from 21538 primary records. [2025-09-17T22:51:03.592947] [DEBUG] [LOCAL ] ETV: Saving derivative data. [2025-09-17T22:51:03.593314] [INFO ] [MAIN ] ETX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:03.626583] [DEBUG] [LOCAL ] ETX: Loaded 4905 existing records from primary storage. [2025-09-17T22:51:03.625408] [DEBUG] [LOCAL ] ETV: Derivative data saved (1794 records). [2025-09-17T22:51:03.627535] [INFO ] [MAIN ] ETV: Successfully saved derivative data. [2025-09-17T22:51:03.627819] [INFO ] [MAIN ] ETX: Loaded 4905 primary data records. [2025-09-17T22:51:03.630688] [INFO ] [MAIN ] Derivative Progress: 647/2085 symbols completed. ETV took 1.2s. Estimated remaining: 9m 19s. Rate: 154.4 symbols/min [2025-09-17T22:51:03.674955] [DEBUG] [MAIN ] ETR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:03.675064] [INFO ] [MAIN ] ETY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:03.714037] [INFO ] [MAIN ] ETR: Generated 1794 derivative records from 53245 primary records. [2025-09-17T22:51:03.719440] [DEBUG] [LOCAL ] ETR: Saving derivative data. [2025-09-17T22:51:03.822391] [DEBUG] [LOCAL ] ETR: Derivative data saved (1794 records). [2025-09-17T22:51:03.848426] [INFO ] [MAIN ] ETR: Successfully saved derivative data. [2025-09-17T22:51:03.856984] [INFO ] [MAIN ] Derivative Progress: 648/2085 symbols completed. ETR took 1.4s. Estimated remaining: 9m 18s. Rate: 154.5 symbols/min [2025-09-17T22:51:03.863221] [INFO ] [MAIN ] EVC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:03.988689] [DEBUG] [LOCAL ] ETY: Loaded 23047 existing records from primary storage. [2025-09-17T22:51:03.989270] [INFO ] [MAIN ] ETY: Loaded 23047 primary data records. [2025-09-17T22:51:04.106428] [DEBUG] [LOCAL ] EVC: Loaded 20341 existing records from primary storage. [2025-09-17T22:51:04.110220] [INFO ] [MAIN ] EVC: Loaded 20341 primary data records. [2025-09-17T22:51:04.689852] [DEBUG] [MAIN ] ETX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:04.691332] [INFO ] [MAIN ] ETX: Generated 1794 derivative records from 4905 primary records. [2025-09-17T22:51:04.692848] [DEBUG] [LOCAL ] ETX: Saving derivative data. [2025-09-17T22:51:04.714841] [DEBUG] [LOCAL ] ETX: Derivative data saved (1794 records). [2025-09-17T22:51:04.715360] [INFO ] [MAIN ] ETX: Successfully saved derivative data. [2025-09-17T22:51:04.717562] [INFO ] [MAIN ] Derivative Progress: 649/2085 symbols completed. ETX took 1.1s. Estimated remaining: 9m 19s. Rate: 154.2 symbols/min [2025-09-17T22:51:04.718325] [INFO ] [MAIN ] EVEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:04.743163] [DEBUG] [MAIN ] ETY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:04.764229] [INFO ] [MAIN ] ETY: Generated 1794 derivative records from 23047 primary records. [2025-09-17T22:51:04.764857] [DEBUG] [LOCAL ] ETY: Saving derivative data. [2025-09-17T22:51:04.764790] [DEBUG] [MAIN ] EVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:04.766250] [INFO ] [MAIN ] EVC: Generated 1794 derivative records from 20341 primary records. [2025-09-17T22:51:04.766507] [DEBUG] [LOCAL ] EVC: Saving derivative data. [2025-09-17T22:51:04.807210] [DEBUG] [LOCAL ] EVC: Derivative data saved (1794 records). [2025-09-17T22:51:04.805290] [DEBUG] [LOCAL ] ETY: Derivative data saved (1794 records). [2025-09-17T22:51:04.807509] [INFO ] [MAIN ] ETY: Successfully saved derivative data. [2025-09-17T22:51:04.807429] [INFO ] [MAIN ] EVC: Successfully saved derivative data. [2025-09-17T22:51:04.806244] [DEBUG] [LOCAL ] EVEX: Loaded 29040 existing records from primary storage. [2025-09-17T22:51:04.810806] [INFO ] [MAIN ] Derivative Progress: 650/2085 symbols completed. ETY took 1.2s. Estimated remaining: 9m 18s. Rate: 154.4 symbols/min [2025-09-17T22:51:04.814424] [INFO ] [MAIN ] EVF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:04.814094] [INFO ] [MAIN ] EVEX: Loaded 29040 primary data records. [2025-09-17T22:51:04.814600] [INFO ] [MAIN ] Derivative Progress: 651/2085 symbols completed. EVC took 1.0s. Estimated remaining: 9m 16s. Rate: 154.6 symbols/min [2025-09-17T22:51:04.815377] [INFO ] [MAIN ] EVG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:04.911545] [DEBUG] [LOCAL ] EVF: Loaded 9070 existing records from primary storage. [2025-09-17T22:51:04.923841] [INFO ] [MAIN ] EVF: Loaded 9070 primary data records. [2025-09-17T22:51:04.998860] [DEBUG] [LOCAL ] EVG: Loaded 5837 existing records from primary storage. [2025-09-17T22:51:05.072471] [INFO ] [MAIN ] EVG: Loaded 5837 primary data records. [2025-09-17T22:51:05.838668] [DEBUG] [MAIN ] EVEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:05.840050] [INFO ] [MAIN ] EVEX: Generated 1794 derivative records from 29040 primary records. [2025-09-17T22:51:05.840255] [DEBUG] [LOCAL ] EVEX: Saving derivative data. [2025-09-17T22:51:05.857408] [DEBUG] [LOCAL ] EVEX: Derivative data saved (1794 records). [2025-09-17T22:51:05.857592] [INFO ] [MAIN ] EVEX: Successfully saved derivative data. [2025-09-17T22:51:05.859730] [INFO ] [MAIN ] Derivative Progress: 652/2085 symbols completed. EVEX took 1.1s. Estimated remaining: 9m 17s. Rate: 154.2 symbols/min [2025-09-17T22:51:05.860281] [INFO ] [MAIN ] EVH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:05.887591] [DEBUG] [MAIN ] EVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:05.893988] [DEBUG] [MAIN ] EVF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:05.894819] [INFO ] [MAIN ] EVF: Generated 1794 derivative records from 9070 primary records. [2025-09-17T22:51:05.895004] [DEBUG] [LOCAL ] EVF: Saving derivative data. [2025-09-17T22:51:05.893617] [INFO ] [MAIN ] EVG: Generated 1794 derivative records from 5837 primary records. [2025-09-17T22:51:05.895515] [DEBUG] [LOCAL ] EVG: Saving derivative data. [2025-09-17T22:51:05.922731] [DEBUG] [LOCAL ] EVF: Derivative data saved (1794 records). [2025-09-17T22:51:05.925487] [INFO ] [MAIN ] EVF: Successfully saved derivative data. [2025-09-17T22:51:05.926266] [DEBUG] [LOCAL ] EVG: Derivative data saved (1794 records). [2025-09-17T22:51:05.926418] [INFO ] [MAIN ] EVG: Successfully saved derivative data. [2025-09-17T22:51:05.928952] [INFO ] [MAIN ] Derivative Progress: 653/2085 symbols completed. EVF took 1.1s. Estimated remaining: 9m 16s. Rate: 154.4 symbols/min [2025-09-17T22:51:05.931940] [INFO ] [MAIN ] EVN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:05.931820] [INFO ] [MAIN ] Derivative Progress: 654/2085 symbols completed. EVG took 1.1s. Estimated remaining: 9m 15s. Rate: 154.7 symbols/min [2025-09-17T22:51:05.932776] [INFO ] [MAIN ] EVR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:05.965622] [DEBUG] [LOCAL ] EVH: Loaded 49333 existing records from primary storage. [2025-09-17T22:51:05.965841] [INFO ] [MAIN ] EVH: Loaded 49333 primary data records. [2025-09-17T22:51:06.007927] [DEBUG] [LOCAL ] EVN: Loaded 10928 existing records from primary storage. [2025-09-17T22:51:06.036435] [INFO ] [MAIN ] EVN: Loaded 10928 primary data records. [2025-09-17T22:51:06.309612] [DEBUG] [LOCAL ] EVR: Loaded 35950 existing records from primary storage. [2025-09-17T22:51:06.331725] [INFO ] [MAIN ] EVR: Loaded 35950 primary data records. [2025-09-17T22:51:07.015089] [DEBUG] [MAIN ] EVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:07.016517] [INFO ] [MAIN ] EVH: Generated 1794 derivative records from 49333 primary records. [2025-09-17T22:51:07.016777] [DEBUG] [LOCAL ] EVH: Saving derivative data. [2025-09-17T22:51:07.042227] [DEBUG] [MAIN ] EVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:07.047459] [INFO ] [MAIN ] EVN: Generated 1794 derivative records from 10928 primary records. [2025-09-17T22:51:07.047964] [DEBUG] [LOCAL ] EVH: Derivative data saved (1794 records). [2025-09-17T22:51:07.048720] [INFO ] [MAIN ] EVH: Successfully saved derivative data. [2025-09-17T22:51:07.050999] [INFO ] [MAIN ] Derivative Progress: 655/2085 symbols completed. EVH took 1.2s. Estimated remaining: 9m 16s. Rate: 154.2 symbols/min [2025-09-17T22:51:07.051589] [INFO ] [MAIN ] EVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:07.051340] [DEBUG] [LOCAL ] EVN: Saving derivative data. [2025-09-17T22:51:07.070305] [DEBUG] [LOCAL ] EVN: Derivative data saved (1794 records). [2025-09-17T22:51:07.070557] [INFO ] [MAIN ] EVN: Successfully saved derivative data. [2025-09-17T22:51:07.073101] [INFO ] [MAIN ] Derivative Progress: 656/2085 symbols completed. EVN took 1.1s. Estimated remaining: 9m 15s. Rate: 154.4 symbols/min [2025-09-17T22:51:07.073816] [INFO ] [MAIN ] EVTC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:07.089961] [DEBUG] [LOCAL ] EVT: Loaded 17711 existing records from primary storage. [2025-09-17T22:51:07.090368] [INFO ] [MAIN ] EVT: Loaded 17711 primary data records. [2025-09-17T22:51:07.141147] [DEBUG] [MAIN ] EVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:07.160596] [INFO ] [MAIN ] EVR: Generated 1794 derivative records from 35950 primary records. [2025-09-17T22:51:07.188974] [DEBUG] [LOCAL ] EVR: Saving derivative data. [2025-09-17T22:51:07.263347] [DEBUG] [LOCAL ] EVTC: Loaded 26671 existing records from primary storage. [2025-09-17T22:51:07.314713] [INFO ] [MAIN ] EVTC: Loaded 26671 primary data records. [2025-09-17T22:51:07.435355] [DEBUG] [LOCAL ] EVR: Derivative data saved (1794 records). [2025-09-17T22:51:07.459174] [INFO ] [MAIN ] EVR: Successfully saved derivative data. [2025-09-17T22:51:07.480516] [INFO ] [MAIN ] Derivative Progress: 657/2085 symbols completed. EVR took 1.5s. Estimated remaining: 9m 15s. Rate: 154.4 symbols/min [2025-09-17T22:51:07.498338] [INFO ] [MAIN ] EVTL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:07.818790] [DEBUG] [LOCAL ] EVTL: Loaded 36355 existing records from primary storage. [2025-09-17T22:51:07.821341] [INFO ] [MAIN ] EVTL: Loaded 36355 primary data records. [2025-09-17T22:51:07.905397] [DEBUG] [MAIN ] EVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:07.929325] [INFO ] [MAIN ] EVT: Generated 1794 derivative records from 17711 primary records. [2025-09-17T22:51:07.948713] [DEBUG] [LOCAL ] EVT: Saving derivative data. [2025-09-17T22:51:08.204830] [DEBUG] [MAIN ] EVTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:08.207910] [DEBUG] [LOCAL ] EVT: Derivative data saved (1794 records). [2025-09-17T22:51:08.207101] [INFO ] [MAIN ] EVTC: Generated 1794 derivative records from 26671 primary records. [2025-09-17T22:51:08.208023] [DEBUG] [LOCAL ] EVTC: Saving derivative data. [2025-09-17T22:51:08.208088] [INFO ] [MAIN ] EVT: Successfully saved derivative data. [2025-09-17T22:51:08.211054] [INFO ] [MAIN ] Derivative Progress: 658/2085 symbols completed. EVT took 1.2s. Estimated remaining: 9m 15s. Rate: 154.2 symbols/min [2025-09-17T22:51:08.232512] [DEBUG] [LOCAL ] EVTC: Derivative data saved (1794 records). [2025-09-17T22:51:08.232743] [INFO ] [MAIN ] EVTC: Successfully saved derivative data. [2025-09-17T22:51:08.235470] [INFO ] [MAIN ] Derivative Progress: 659/2085 symbols completed. EVTC took 1.2s. Estimated remaining: 9m 14s. Rate: 154.4 symbols/min [2025-09-17T22:51:08.258711] [DEBUG] [MAIN ] EVTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:08.259485] [INFO ] [MAIN ] EVTL: Generated 1794 derivative records from 36355 primary records. [2025-09-17T22:51:08.259552] [DEBUG] [LOCAL ] EVTL: Saving derivative data. [2025-09-17T22:51:08.275134] [DEBUG] [LOCAL ] EVTL: Derivative data saved (1794 records). [2025-09-17T22:51:08.275271] [INFO ] [MAIN ] EVTL: Successfully saved derivative data. [2025-09-17T22:51:08.278022] [INFO ] [MAIN ] Derivative Progress: 660/2085 symbols completed. EVTL took 0.8s. Estimated remaining: 9m 13s. Rate: 154.7 symbols/min [2025-09-17T22:51:08.278628] [INFO ] [MAIN ] EVTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:08.278832] [INFO ] [MAIN ] EXG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:08.278955] [INFO ] [MAIN ] EW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:08.309386] [DEBUG] [LOCAL ] EVTR: Loaded 22776 existing records from primary storage. [2025-09-17T22:51:08.309627] [INFO ] [MAIN ] EVTR: Loaded 22776 primary data records. [2025-09-17T22:51:08.546134] [DEBUG] [LOCAL ] EXG: Loaded 34879 existing records from primary storage. [2025-09-17T22:51:08.707976] [DEBUG] [LOCAL ] EW: Loaded 53397 existing records from primary storage. [2025-09-17T22:51:08.722899] [INFO ] [MAIN ] EW: Loaded 53397 primary data records. [2025-09-17T22:51:08.564108] [INFO ] [MAIN ] EXG: Loaded 34879 primary data records. [2025-09-17T22:51:09.560948] [DEBUG] [MAIN ] EVTR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:51:09.562464] [INFO ] [MAIN ] EVTR: Generated 1793 derivative records from 22776 primary records. [2025-09-17T22:51:09.562898] [DEBUG] [LOCAL ] EVTR: Saving derivative data. [2025-09-17T22:51:09.581559] [DEBUG] [LOCAL ] EVTR: Derivative data saved (1793 records). [2025-09-17T22:51:09.581966] [INFO ] [MAIN ] EVTR: Successfully saved derivative data. [2025-09-17T22:51:09.584607] [INFO ] [MAIN ] Derivative Progress: 661/2085 symbols completed. EVTR took 1.3s. Estimated remaining: 9m 14s. Rate: 154.1 symbols/min [2025-09-17T22:51:09.585406] [INFO ] [MAIN ] EXK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:09.615687] [DEBUG] [MAIN ] EXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:09.621777] [INFO ] [MAIN ] EXG: Generated 1794 derivative records from 34879 primary records. [2025-09-17T22:51:09.620916] [DEBUG] [MAIN ] EW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:09.622427] [INFO ] [MAIN ] EW: Generated 1794 derivative records from 53397 primary records. [2025-09-17T22:51:09.622598] [DEBUG] [LOCAL ] EXG: Saving derivative data. [2025-09-17T22:51:09.622965] [DEBUG] [LOCAL ] EW: Saving derivative data. [2025-09-17T22:51:09.664454] [DEBUG] [LOCAL ] EXG: Derivative data saved (1794 records). [2025-09-17T22:51:09.665099] [INFO ] [MAIN ] EXG: Successfully saved derivative data. [2025-09-17T22:51:09.667710] [INFO ] [MAIN ] Derivative Progress: 662/2085 symbols completed. EXG took 1.4s. Estimated remaining: 9m 13s. Rate: 154.3 symbols/min [2025-09-17T22:51:09.668814] [INFO ] [MAIN ] EXP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:09.673572] [DEBUG] [LOCAL ] EW: Derivative data saved (1794 records). [2025-09-17T22:51:09.673765] [INFO ] [MAIN ] EW: Successfully saved derivative data. [2025-09-17T22:51:09.677509] [INFO ] [MAIN ] Derivative Progress: 663/2085 symbols completed. EW took 1.4s. Estimated remaining: 9m 12s. Rate: 154.5 symbols/min [2025-09-17T22:51:09.678261] [INFO ] [MAIN ] EXPD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:09.698073] [DEBUG] [LOCAL ] EXK: Loaded 53075 existing records from primary storage. [2025-09-17T22:51:09.698348] [INFO ] [MAIN ] EXK: Loaded 53075 primary data records. [2025-09-17T22:51:09.927898] [DEBUG] [LOCAL ] EXP: Loaded 30344 existing records from primary storage. [2025-09-17T22:51:09.947915] [INFO ] [MAIN ] EXP: Loaded 30344 primary data records. [2025-09-17T22:51:10.311241] [DEBUG] [LOCAL ] EXPD: Loaded 48206 existing records from primary storage. [2025-09-17T22:51:10.325963] [INFO ] [MAIN ] EXPD: Loaded 48206 primary data records. [2025-09-17T22:51:10.727270] [DEBUG] [MAIN ] EXK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:10.728344] [INFO ] [MAIN ] EXK: Generated 1794 derivative records from 53075 primary records. [2025-09-17T22:51:10.739132] [DEBUG] [LOCAL ] EXK: Saving derivative data. [2025-09-17T22:51:11.033510] [DEBUG] [LOCAL ] EXK: Derivative data saved (1794 records). [2025-09-17T22:51:11.040499] [INFO ] [MAIN ] EXK: Successfully saved derivative data. [2025-09-17T22:51:11.190993] [INFO ] [MAIN ] Derivative Progress: 664/2085 symbols completed. EXK took 1.6s. Estimated remaining: 9m 14s. Rate: 153.8 symbols/min [2025-09-17T22:51:11.193209] [INFO ] [MAIN ] EXR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:11.219107] [DEBUG] [MAIN ] EXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:11.220806] [INFO ] [MAIN ] EXP: Generated 1794 derivative records from 30344 primary records. [2025-09-17T22:51:11.221396] [DEBUG] [LOCAL ] EXP: Saving derivative data. [2025-09-17T22:51:11.265523] [DEBUG] [MAIN ] EXPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:11.267481] [INFO ] [MAIN ] EXPD: Generated 1794 derivative records from 48206 primary records. [2025-09-17T22:51:11.267719] [DEBUG] [LOCAL ] EXP: Derivative data saved (1794 records). [2025-09-17T22:51:11.267815] [DEBUG] [LOCAL ] EXPD: Saving derivative data. [2025-09-17T22:51:11.267897] [INFO ] [MAIN ] EXP: Successfully saved derivative data. [2025-09-17T22:51:11.272186] [INFO ] [MAIN ] Derivative Progress: 665/2085 symbols completed. EXP took 1.6s. Estimated remaining: 9m 13s. Rate: 154.0 symbols/min [2025-09-17T22:51:11.280390] [INFO ] [MAIN ] F: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:11.303524] [DEBUG] [LOCAL ] EXR: Loaded 45616 existing records from primary storage. [2025-09-17T22:51:11.304429] [INFO ] [MAIN ] EXR: Loaded 45616 primary data records. [2025-09-17T22:51:11.341398] [DEBUG] [LOCAL ] EXPD: Derivative data saved (1794 records). [2025-09-17T22:51:11.367709] [INFO ] [MAIN ] EXPD: Successfully saved derivative data. [2025-09-17T22:51:11.403308] [INFO ] [MAIN ] Derivative Progress: 666/2085 symbols completed. EXPD took 1.7s. Estimated remaining: 9m 12s. Rate: 154.2 symbols/min [2025-09-17T22:51:11.421077] [INFO ] [MAIN ] FAF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:11.692161] [DEBUG] [LOCAL ] F: Loaded 53820 existing records from primary storage. [2025-09-17T22:51:11.692493] [INFO ] [MAIN ] F: Loaded 53820 primary data records. [2025-09-17T22:51:11.749705] [DEBUG] [MAIN ] EXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:11.751579] [INFO ] [MAIN ] EXR: Generated 1794 derivative records from 45616 primary records. [2025-09-17T22:51:11.751734] [DEBUG] [LOCAL ] EXR: Saving derivative data. [2025-09-17T22:51:11.750707] [DEBUG] [LOCAL ] FAF: Loaded 42079 existing records from primary storage. [2025-09-17T22:51:11.771135] [INFO ] [MAIN ] FAF: Loaded 42079 primary data records. [2025-09-17T22:51:12.041408] [DEBUG] [LOCAL ] EXR: Derivative data saved (1794 records). [2025-09-17T22:51:12.219438] [INFO ] [MAIN ] EXR: Successfully saved derivative data. [2025-09-17T22:51:12.226937] [INFO ] [MAIN ] Derivative Progress: 667/2085 symbols completed. EXR took 1.0s. Estimated remaining: 9m 13s. Rate: 153.9 symbols/min [2025-09-17T22:51:12.263125] [INFO ] [MAIN ] FBIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:12.436264] [DEBUG] [MAIN ] F: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:12.437159] [INFO ] [MAIN ] F: Generated 1794 derivative records from 53820 primary records. [2025-09-17T22:51:12.437335] [DEBUG] [LOCAL ] F: Saving derivative data. [2025-09-17T22:51:12.486425] [DEBUG] [LOCAL ] F: Derivative data saved (1794 records). [2025-09-17T22:51:12.487388] [INFO ] [MAIN ] F: Successfully saved derivative data. [2025-09-17T22:51:12.487315] [DEBUG] [MAIN ] FAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:12.490608] [INFO ] [MAIN ] Derivative Progress: 668/2085 symbols completed. F took 1.2s. Estimated remaining: 9m 12s. Rate: 154.0 symbols/min [2025-09-17T22:51:12.491893] [INFO ] [MAIN ] FAF: Generated 1794 derivative records from 42079 primary records. [2025-09-17T22:51:12.492229] [INFO ] [MAIN ] FBK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:12.492048] [DEBUG] [LOCAL ] FAF: Saving derivative data. [2025-09-17T22:51:12.525423] [DEBUG] [LOCAL ] FAF: Derivative data saved (1794 records). [2025-09-17T22:51:12.526485] [DEBUG] [LOCAL ] FBIN: Loaded 50468 existing records from primary storage. [2025-09-17T22:51:12.525571] [INFO ] [MAIN ] FAF: Successfully saved derivative data. [2025-09-17T22:51:12.526704] [INFO ] [MAIN ] FBIN: Loaded 50468 primary data records. [2025-09-17T22:51:12.528984] [INFO ] [MAIN ] Derivative Progress: 669/2085 symbols completed. FAF took 1.1s. Estimated remaining: 9m 11s. Rate: 154.2 symbols/min [2025-09-17T22:51:12.529353] [INFO ] [MAIN ] FBP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:12.681691] [DEBUG] [LOCAL ] FBK: Loaded 25283 existing records from primary storage. [2025-09-17T22:51:12.712391] [INFO ] [MAIN ] FBK: Loaded 25283 primary data records. [2025-09-17T22:51:13.043258] [DEBUG] [LOCAL ] FBP: Loaded 46391 existing records from primary storage. [2025-09-17T22:51:13.052950] [INFO ] [MAIN ] FBP: Loaded 46391 primary data records. [2025-09-17T22:51:13.534703] [DEBUG] [MAIN ] FBIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:13.535990] [INFO ] [MAIN ] FBIN: Generated 1794 derivative records from 50468 primary records. [2025-09-17T22:51:13.536183] [DEBUG] [LOCAL ] FBIN: Saving derivative data. [2025-09-17T22:51:13.553499] [DEBUG] [LOCAL ] FBIN: Derivative data saved (1794 records). [2025-09-17T22:51:13.553996] [INFO ] [MAIN ] FBIN: Successfully saved derivative data. [2025-09-17T22:51:13.556264] [INFO ] [MAIN ] Derivative Progress: 670/2085 symbols completed. FBIN took 1.3s. Estimated remaining: 9m 12s. Rate: 153.8 symbols/min [2025-09-17T22:51:13.556820] [INFO ] [MAIN ] FBRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:13.574352] [DEBUG] [MAIN ] FBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:13.575258] [INFO ] [MAIN ] FBK: Generated 1794 derivative records from 25283 primary records. [2025-09-17T22:51:13.575411] [DEBUG] [LOCAL ] FBK: Saving derivative data. [2025-09-17T22:51:13.594951] [DEBUG] [LOCAL ] FBK: Derivative data saved (1794 records). [2025-09-17T22:51:13.595578] [INFO ] [MAIN ] FBK: Successfully saved derivative data. [2025-09-17T22:51:13.598549] [INFO ] [MAIN ] Derivative Progress: 671/2085 symbols completed. FBK took 1.1s. Estimated remaining: 9m 11s. Rate: 154.0 symbols/min [2025-09-17T22:51:13.600027] [INFO ] [MAIN ] FC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:13.622377] [DEBUG] [MAIN ] FBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:13.623168] [INFO ] [MAIN ] FBP: Generated 1794 derivative records from 46391 primary records. [2025-09-17T22:51:13.623307] [DEBUG] [LOCAL ] FBP: Saving derivative data. [2025-09-17T22:51:13.654729] [DEBUG] [LOCAL ] FBP: Derivative data saved (1794 records). [2025-09-17T22:51:13.654876] [INFO ] [MAIN ] FBP: Successfully saved derivative data. [2025-09-17T22:51:13.657322] [INFO ] [MAIN ] Derivative Progress: 672/2085 symbols completed. FBP took 1.1s. Estimated remaining: 9m 10s. Rate: 154.2 symbols/min [2025-09-17T22:51:13.657616] [INFO ] [MAIN ] FCF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:13.658730] [DEBUG] [LOCAL ] FBRT: Loaded 34325 existing records from primary storage. [2025-09-17T22:51:13.659208] [INFO ] [MAIN ] FBRT: Loaded 34325 primary data records. [2025-09-17T22:51:13.713371] [DEBUG] [LOCAL ] FC: Loaded 15420 existing records from primary storage. [2025-09-17T22:51:13.741073] [INFO ] [MAIN ] FC: Loaded 15420 primary data records. [2025-09-17T22:51:14.245182] [DEBUG] [LOCAL ] FCF: Loaded 39938 existing records from primary storage. [2025-09-17T22:51:14.245999] [INFO ] [MAIN ] FCF: Loaded 39938 primary data records. [2025-09-17T22:51:14.729844] [DEBUG] [MAIN ] FBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:14.731230] [INFO ] [MAIN ] FBRT: Generated 1794 derivative records from 34325 primary records. [2025-09-17T22:51:14.744104] [DEBUG] [LOCAL ] FBRT: Saving derivative data. [2025-09-17T22:51:14.745782] [DEBUG] [MAIN ] FC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:14.747472] [INFO ] [MAIN ] FC: Generated 1794 derivative records from 15420 primary records. [2025-09-17T22:51:14.754917] [DEBUG] [LOCAL ] FC: Saving derivative data. [2025-09-17T22:51:14.764365] [DEBUG] [LOCAL ] FBRT: Derivative data saved (1794 records). [2025-09-17T22:51:14.764557] [INFO ] [MAIN ] FBRT: Successfully saved derivative data. [2025-09-17T22:51:14.767683] [INFO ] [MAIN ] Derivative Progress: 673/2085 symbols completed. FBRT took 1.2s. Estimated remaining: 9m 11s. Rate: 153.8 symbols/min [2025-09-17T22:51:14.784550] [DEBUG] [LOCAL ] FC: Derivative data saved (1794 records). [2025-09-17T22:51:14.785007] [INFO ] [MAIN ] FC: Successfully saved derivative data. [2025-09-17T22:51:14.787347] [INFO ] [MAIN ] Derivative Progress: 674/2085 symbols completed. FC took 1.2s. Estimated remaining: 9m 10s. Rate: 154.0 symbols/min [2025-09-17T22:51:14.805682] [DEBUG] [MAIN ] FCF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:14.806301] [INFO ] [MAIN ] FCF: Generated 1794 derivative records from 39938 primary records. [2025-09-17T22:51:14.806364] [DEBUG] [LOCAL ] FCF: Saving derivative data. [2025-09-17T22:51:14.822822] [DEBUG] [LOCAL ] FCF: Derivative data saved (1794 records). [2025-09-17T22:51:14.822891] [INFO ] [MAIN ] FCF: Successfully saved derivative data. [2025-09-17T22:51:14.825194] [INFO ] [MAIN ] Derivative Progress: 675/2085 symbols completed. FCF took 1.2s. Estimated remaining: 9m 9s. Rate: 154.2 symbols/min [2025-09-17T22:51:14.825741] [INFO ] [MAIN ] FCN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:14.825960] [INFO ] [MAIN ] FCPT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:14.826565] [INFO ] [MAIN ] FCT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:14.852332] [DEBUG] [LOCAL ] FCT: Loaded 14380 existing records from primary storage. [2025-09-17T22:51:14.852555] [INFO ] [MAIN ] FCT: Loaded 14380 primary data records. [2025-09-17T22:51:14.964587] [DEBUG] [LOCAL ] FCN: Loaded 26361 existing records from primary storage. [2025-09-17T22:51:14.985287] [INFO ] [MAIN ] FCN: Loaded 26361 primary data records. [2025-09-17T22:51:15.054421] [DEBUG] [LOCAL ] FCPT: Loaded 37547 existing records from primary storage. [2025-09-17T22:51:15.096214] [INFO ] [MAIN ] FCPT: Loaded 37547 primary data records. [2025-09-17T22:51:15.853041] [DEBUG] [MAIN ] FCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:15.855405] [INFO ] [MAIN ] FCT: Generated 1794 derivative records from 14380 primary records. [2025-09-17T22:51:15.855738] [DEBUG] [LOCAL ] FCT: Saving derivative data. [2025-09-17T22:51:15.881099] [DEBUG] [MAIN ] FCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:15.890957] [INFO ] [MAIN ] FCN: Generated 1794 derivative records from 26361 primary records. [2025-09-17T22:51:15.894493] [DEBUG] [LOCAL ] FCN: Saving derivative data. [2025-09-17T22:51:15.896759] [DEBUG] [LOCAL ] FCT: Derivative data saved (1794 records). [2025-09-17T22:51:15.897102] [INFO ] [MAIN ] FCT: Successfully saved derivative data. [2025-09-17T22:51:15.900372] [INFO ] [MAIN ] Derivative Progress: 676/2085 symbols completed. FCT took 1.1s. Estimated remaining: 9m 10s. Rate: 153.8 symbols/min [2025-09-17T22:51:15.910854] [INFO ] [MAIN ] FCX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:15.927979] [DEBUG] [LOCAL ] FCN: Derivative data saved (1794 records). [2025-09-17T22:51:15.933125] [INFO ] [MAIN ] FCN: Successfully saved derivative data. [2025-09-17T22:51:15.935747] [INFO ] [MAIN ] Derivative Progress: 677/2085 symbols completed. FCN took 1.1s. Estimated remaining: 9m 8s. Rate: 154.0 symbols/min [2025-09-17T22:51:15.936003] [INFO ] [MAIN ] FDP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:15.933444] [DEBUG] [MAIN ] FCPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:15.937092] [INFO ] [MAIN ] FCPT: Generated 1794 derivative records from 37547 primary records. [2025-09-17T22:51:15.937399] [DEBUG] [LOCAL ] FCPT: Saving derivative data. [2025-09-17T22:51:15.954828] [DEBUG] [LOCAL ] FCPT: Derivative data saved (1794 records). [2025-09-17T22:51:15.954981] [INFO ] [MAIN ] FCPT: Successfully saved derivative data. [2025-09-17T22:51:15.957637] [INFO ] [MAIN ] Derivative Progress: 678/2085 symbols completed. FCPT took 1.1s. Estimated remaining: 9m 7s. Rate: 154.2 symbols/min [2025-09-17T22:51:15.958166] [INFO ] [MAIN ] FDS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:16.005507] [DEBUG] [LOCAL ] FDP: Loaded 30436 existing records from primary storage. [2025-09-17T22:51:16.005738] [INFO ] [MAIN ] FDP: Loaded 30436 primary data records. [2025-09-17T22:51:16.112457] [DEBUG] [LOCAL ] FCX: Loaded 53700 existing records from primary storage. [2025-09-17T22:51:16.117864] [INFO ] [MAIN ] FCX: Loaded 53700 primary data records. [2025-09-17T22:51:16.103714] [DEBUG] [LOCAL ] FDS: Loaded 25522 existing records from primary storage. [2025-09-17T22:51:16.135079] [INFO ] [MAIN ] FDS: Loaded 25522 primary data records. [2025-09-17T22:51:17.072010] [DEBUG] [MAIN ] FDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:17.073233] [INFO ] [MAIN ] FDP: Generated 1794 derivative records from 30436 primary records. [2025-09-17T22:51:17.073466] [DEBUG] [LOCAL ] FDP: Saving derivative data. [2025-09-17T22:51:17.106958] [DEBUG] [LOCAL ] FDP: Derivative data saved (1794 records). [2025-09-17T22:51:17.108267] [DEBUG] [MAIN ] FCX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:17.111341] [INFO ] [MAIN ] FCX: Generated 1794 derivative records from 53700 primary records. [2025-09-17T22:51:17.108982] [INFO ] [MAIN ] FDP: Successfully saved derivative data. [2025-09-17T22:51:17.111857] [DEBUG] [LOCAL ] FCX: Saving derivative data. [2025-09-17T22:51:17.114143] [INFO ] [MAIN ] Derivative Progress: 679/2085 symbols completed. FDP took 1.2s. Estimated remaining: 9m 9s. Rate: 153.8 symbols/min [2025-09-17T22:51:17.127470] [INFO ] [MAIN ] FDX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:17.139595] [DEBUG] [MAIN ] FDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:17.140603] [INFO ] [MAIN ] FDS: Generated 1794 derivative records from 25522 primary records. [2025-09-17T22:51:17.141395] [DEBUG] [LOCAL ] FDS: Saving derivative data. [2025-09-17T22:51:17.156959] [DEBUG] [LOCAL ] FCX: Derivative data saved (1794 records). [2025-09-17T22:51:17.163049] [INFO ] [MAIN ] FCX: Successfully saved derivative data. [2025-09-17T22:51:17.167282] [INFO ] [MAIN ] Derivative Progress: 680/2085 symbols completed. FCX took 1.3s. Estimated remaining: 9m 7s. Rate: 154.0 symbols/min [2025-09-17T22:51:17.168521] [DEBUG] [LOCAL ] FDS: Derivative data saved (1794 records). [2025-09-17T22:51:17.168726] [INFO ] [MAIN ] FDS: Successfully saved derivative data. [2025-09-17T22:51:17.168950] [INFO ] [MAIN ] FE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:17.172247] [INFO ] [MAIN ] Derivative Progress: 681/2085 symbols completed. FDS took 1.2s. Estimated remaining: 9m 6s. Rate: 154.2 symbols/min [2025-09-17T22:51:17.172547] [INFO ] [MAIN ] FERG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:17.227343] [DEBUG] [LOCAL ] FDX: Loaded 51558 existing records from primary storage. [2025-09-17T22:51:17.227712] [INFO ] [MAIN ] FDX: Loaded 51558 primary data records. [2025-09-17T22:51:17.364322] [DEBUG] [LOCAL ] FERG: Loaded 49048 existing records from primary storage. [2025-09-17T22:51:17.370154] [INFO ] [MAIN ] FERG: Loaded 49048 primary data records. [2025-09-17T22:51:17.572701] [DEBUG] [LOCAL ] FE: Loaded 53448 existing records from primary storage. [2025-09-17T22:51:17.723945] [INFO ] [MAIN ] FE: Loaded 53448 primary data records. [2025-09-17T22:51:18.365268] [DEBUG] [MAIN ] FDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:18.366624] [INFO ] [MAIN ] FDX: Generated 1794 derivative records from 51558 primary records. [2025-09-17T22:51:18.366881] [DEBUG] [LOCAL ] FDX: Saving derivative data. [2025-09-17T22:51:18.390375] [DEBUG] [LOCAL ] FDX: Derivative data saved (1794 records). [2025-09-17T22:51:18.392381] [INFO ] [MAIN ] FDX: Successfully saved derivative data. [2025-09-17T22:51:18.394704] [INFO ] [MAIN ] Derivative Progress: 682/2085 symbols completed. FDX took 1.3s. Estimated remaining: 9m 8s. Rate: 153.7 symbols/min [2025-09-17T22:51:18.403672] [INFO ] [MAIN ] FET: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:18.409556] [DEBUG] [MAIN ] FERG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:18.410428] [INFO ] [MAIN ] FERG: Generated 1794 derivative records from 49048 primary records. [2025-09-17T22:51:18.410604] [DEBUG] [LOCAL ] FERG: Saving derivative data. [2025-09-17T22:51:18.430486] [DEBUG] [LOCAL ] FERG: Derivative data saved (1794 records). [2025-09-17T22:51:18.434015] [INFO ] [MAIN ] FERG: Successfully saved derivative data. [2025-09-17T22:51:18.447237] [DEBUG] [MAIN ] FE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:51:18.450620] [INFO ] [MAIN ] Derivative Progress: 683/2085 symbols completed. FERG took 1.3s. Estimated remaining: 9m 6s. Rate: 153.9 symbols/min [2025-09-17T22:51:18.451671] [INFO ] [MAIN ] FE: Generated 1793 derivative records from 53448 primary records. [2025-09-17T22:51:18.452082] [DEBUG] [LOCAL ] FE: Saving derivative data. [2025-09-17T22:51:18.451925] [INFO ] [MAIN ] FF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:18.458208] [DEBUG] [LOCAL ] FET: Loaded 12646 existing records from primary storage. [2025-09-17T22:51:18.465503] [INFO ] [MAIN ] FET: Loaded 12646 primary data records. [2025-09-17T22:51:18.625553] [DEBUG] [LOCAL ] FE: Derivative data saved (1793 records). [2025-09-17T22:51:18.637287] [INFO ] [MAIN ] FE: Successfully saved derivative data. [2025-09-17T22:51:18.669786] [INFO ] [MAIN ] Derivative Progress: 684/2085 symbols completed. FE took 1.5s. Estimated remaining: 9m 6s. Rate: 154.0 symbols/min [2025-09-17T22:51:18.677560] [DEBUG] [LOCAL ] FF: Loaded 25939 existing records from primary storage. [2025-09-17T22:51:18.680570] [INFO ] [MAIN ] FFA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:18.704831] [INFO ] [MAIN ] FF: Loaded 25939 primary data records. [2025-09-17T22:51:18.927333] [DEBUG] [LOCAL ] FFA: Loaded 5597 existing records from primary storage. [2025-09-17T22:51:18.939588] [INFO ] [MAIN ] FFA: Loaded 5597 primary data records. [2025-09-17T22:51:19.469264] [DEBUG] [MAIN ] FET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:19.470784] [INFO ] [MAIN ] FET: Generated 1794 derivative records from 12646 primary records. [2025-09-17T22:51:19.471174] [DEBUG] [LOCAL ] FET: Saving derivative data. [2025-09-17T22:51:19.496075] [DEBUG] [LOCAL ] FET: Derivative data saved (1794 records). [2025-09-17T22:51:19.496948] [INFO ] [MAIN ] FET: Successfully saved derivative data. [2025-09-17T22:51:19.500211] [INFO ] [MAIN ] Derivative Progress: 685/2085 symbols completed. FET took 1.1s. Estimated remaining: 9m 6s. Rate: 153.8 symbols/min [2025-09-17T22:51:19.502738] [INFO ] [MAIN ] FFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:19.518227] [DEBUG] [MAIN ] FF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:19.519389] [INFO ] [MAIN ] FF: Generated 1794 derivative records from 25939 primary records. [2025-09-17T22:51:19.520537] [DEBUG] [LOCAL ] FF: Saving derivative data. [2025-09-17T22:51:19.553153] [DEBUG] [MAIN ] FFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:19.556485] [INFO ] [MAIN ] FFA: Generated 1794 derivative records from 5597 primary records. [2025-09-17T22:51:19.564339] [DEBUG] [LOCAL ] FF: Derivative data saved (1794 records). [2025-09-17T22:51:19.564969] [DEBUG] [LOCAL ] FFA: Saving derivative data. [2025-09-17T22:51:19.564487] [INFO ] [MAIN ] FF: Successfully saved derivative data. [2025-09-17T22:51:19.567272] [INFO ] [MAIN ] Derivative Progress: 686/2085 symbols completed. FF took 1.1s. Estimated remaining: 9m 5s. Rate: 154.0 symbols/min [2025-09-17T22:51:19.564874] [DEBUG] [LOCAL ] FFC: Loaded 16631 existing records from primary storage. [2025-09-17T22:51:19.568305] [INFO ] [MAIN ] FFC: Loaded 16631 primary data records. [2025-09-17T22:51:19.568209] [INFO ] [MAIN ] FFWM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:19.653228] [DEBUG] [LOCAL ] FFA: Derivative data saved (1794 records). [2025-09-17T22:51:19.658528] [INFO ] [MAIN ] FFA: Successfully saved derivative data. [2025-09-17T22:51:19.673346] [INFO ] [MAIN ] Derivative Progress: 687/2085 symbols completed. FFA took 1.0s. Estimated remaining: 9m 4s. Rate: 154.1 symbols/min [2025-09-17T22:51:19.691784] [INFO ] [MAIN ] FG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:19.938393] [DEBUG] [LOCAL ] FG: Loaded 22201 existing records from primary storage. [2025-09-17T22:51:19.939910] [INFO ] [MAIN ] FG: Loaded 22201 primary data records. [2025-09-17T22:51:19.941080] [DEBUG] [LOCAL ] FFWM: Loaded 36246 existing records from primary storage. [2025-09-17T22:51:19.967152] [INFO ] [MAIN ] FFWM: Loaded 36246 primary data records. [2025-09-17T22:51:20.655780] [DEBUG] [MAIN ] FFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:20.656970] [INFO ] [MAIN ] FFC: Generated 1794 derivative records from 16631 primary records. [2025-09-17T22:51:20.657072] [DEBUG] [LOCAL ] FFC: Saving derivative data. [2025-09-17T22:51:20.674467] [DEBUG] [LOCAL ] FFC: Derivative data saved (1794 records). [2025-09-17T22:51:20.674774] [INFO ] [MAIN ] FFC: Successfully saved derivative data. [2025-09-17T22:51:20.676906] [INFO ] [MAIN ] Derivative Progress: 688/2085 symbols completed. FFC took 1.2s. Estimated remaining: 9m 5s. Rate: 153.8 symbols/min [2025-09-17T22:51:20.713802] [DEBUG] [MAIN ] FFWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:20.714988] [INFO ] [MAIN ] FFWM: Generated 1794 derivative records from 36246 primary records. [2025-09-17T22:51:20.714240] [DEBUG] [MAIN ] FG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:20.715168] [DEBUG] [LOCAL ] FFWM: Saving derivative data. [2025-09-17T22:51:20.716022] [INFO ] [MAIN ] FG: Generated 1794 derivative records from 22201 primary records. [2025-09-17T22:51:20.716114] [DEBUG] [LOCAL ] FG: Saving derivative data. [2025-09-17T22:51:20.748138] [DEBUG] [LOCAL ] FFWM: Derivative data saved (1794 records). [2025-09-17T22:51:20.747333] [DEBUG] [LOCAL ] FG: Derivative data saved (1794 records). [2025-09-17T22:51:20.748295] [INFO ] [MAIN ] FFWM: Successfully saved derivative data. [2025-09-17T22:51:20.750750] [INFO ] [MAIN ] Derivative Progress: 689/2085 symbols completed. FFWM took 1.2s. Estimated remaining: 9m 4s. Rate: 154.0 symbols/min [2025-09-17T22:51:20.751009] [INFO ] [MAIN ] FG: Successfully saved derivative data. [2025-09-17T22:51:20.753387] [INFO ] [MAIN ] Derivative Progress: 690/2085 symbols completed. FG took 1.1s. Estimated remaining: 9m 3s. Rate: 154.2 symbols/min [2025-09-17T22:51:20.754156] [INFO ] [MAIN ] FHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:20.753969] [INFO ] [MAIN ] FGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:20.754948] [INFO ] [MAIN ] FI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:20.762222] [DEBUG] [LOCAL ] FGN: Loaded 4061 existing records from primary storage. [2025-09-17T22:51:20.762373] [INFO ] [MAIN ] FGN: Loaded 4061 primary data records. [2025-09-17T22:51:21.148813] [DEBUG] [LOCAL ] FHI: Loaded 40835 existing records from primary storage. [2025-09-17T22:51:21.149196] [INFO ] [MAIN ] FHI: Loaded 40835 primary data records. [2025-09-17T22:51:21.271986] [DEBUG] [LOCAL ] FI: Loaded 53498 existing records from primary storage. [2025-09-17T22:51:21.272938] [INFO ] [MAIN ] FI: Loaded 53498 primary data records. [2025-09-17T22:51:21.808759] [DEBUG] [MAIN ] FGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:21.810034] [INFO ] [MAIN ] FGN: Generated 1794 derivative records from 4061 primary records. [2025-09-17T22:51:21.810523] [DEBUG] [LOCAL ] FGN: Saving derivative data. [2025-09-17T22:51:21.827747] [DEBUG] [LOCAL ] FGN: Derivative data saved (1794 records). [2025-09-17T22:51:21.827894] [INFO ] [MAIN ] FGN: Successfully saved derivative data. [2025-09-17T22:51:21.830087] [INFO ] [MAIN ] Derivative Progress: 691/2085 symbols completed. FGN took 1.1s. Estimated remaining: 9m 4s. Rate: 153.8 symbols/min [2025-09-17T22:51:21.830777] [INFO ] [MAIN ] FICO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:21.851128] [DEBUG] [MAIN ] FHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:21.852429] [INFO ] [MAIN ] FHI: Generated 1794 derivative records from 40835 primary records. [2025-09-17T22:51:21.852721] [DEBUG] [LOCAL ] FHI: Saving derivative data. [2025-09-17T22:51:21.900320] [DEBUG] [MAIN ] FI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:21.902572] [INFO ] [MAIN ] FI: Generated 1794 derivative records from 53498 primary records. [2025-09-17T22:51:21.903752] [DEBUG] [LOCAL ] FI: Saving derivative data. [2025-09-17T22:51:21.901459] [DEBUG] [LOCAL ] FICO: Loaded 20419 existing records from primary storage. [2025-09-17T22:51:21.905037] [DEBUG] [LOCAL ] FHI: Derivative data saved (1794 records). [2025-09-17T22:51:21.905800] [INFO ] [MAIN ] FHI: Successfully saved derivative data. [2025-09-17T22:51:21.907976] [INFO ] [MAIN ] Derivative Progress: 692/2085 symbols completed. FHI took 1.2s. Estimated remaining: 9m 3s. Rate: 154.0 symbols/min [2025-09-17T22:51:21.905452] [INFO ] [MAIN ] FICO: Loaded 20419 primary data records. [2025-09-17T22:51:21.919939] [INFO ] [MAIN ] FIGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:21.974964] [DEBUG] [LOCAL ] FI: Derivative data saved (1794 records). [2025-09-17T22:51:21.996683] [INFO ] [MAIN ] FI: Successfully saved derivative data. [2025-09-17T22:51:22.006404] [INFO ] [MAIN ] Derivative Progress: 693/2085 symbols completed. FI took 1.3s. Estimated remaining: 9m 2s. Rate: 154.1 symbols/min [2025-09-17T22:51:22.023077] [INFO ] [MAIN ] FIHL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:22.304172] [DEBUG] [LOCAL ] FIHL: Loaded 40536 existing records from primary storage. [2025-09-17T22:51:22.302804] [DEBUG] [MAIN ] FICO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:22.305282] [INFO ] [MAIN ] FIHL: Loaded 40536 primary data records. [2025-09-17T22:51:22.305209] [INFO ] [MAIN ] FICO: Generated 1794 derivative records from 20419 primary records. [2025-09-17T22:51:22.305515] [DEBUG] [LOCAL ] FICO: Saving derivative data. [2025-09-17T22:51:22.442068] [DEBUG] [LOCAL ] FIGS: Loaded 49098 existing records from primary storage. [2025-09-17T22:51:22.472601] [INFO ] [MAIN ] FIGS: Loaded 49098 primary data records. [2025-09-17T22:51:22.637739] [DEBUG] [LOCAL ] FICO: Derivative data saved (1794 records). [2025-09-17T22:51:22.672375] [INFO ] [MAIN ] FICO: Successfully saved derivative data. [2025-09-17T22:51:22.831604] [INFO ] [MAIN ] Derivative Progress: 694/2085 symbols completed. FICO took 1.0s. Estimated remaining: 9m 2s. Rate: 153.9 symbols/min [2025-09-17T22:51:22.833613] [INFO ] [MAIN ] FINS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:22.929691] [DEBUG] [LOCAL ] FINS: Loaded 8196 existing records from primary storage. [2025-09-17T22:51:23.050364] [INFO ] [MAIN ] FINS: Loaded 8196 primary data records. [2025-09-17T22:51:23.393890] [DEBUG] [MAIN ] FIHL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:23.395721] [INFO ] [MAIN ] FIHL: Generated 1794 derivative records from 40536 primary records. [2025-09-17T22:51:23.397701] [DEBUG] [LOCAL ] FIHL: Saving derivative data. [2025-09-17T22:51:23.424706] [DEBUG] [MAIN ] FIGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:23.426832] [INFO ] [MAIN ] FIGS: Generated 1794 derivative records from 49098 primary records. [2025-09-17T22:51:23.428001] [DEBUG] [LOCAL ] FIGS: Saving derivative data. [2025-09-17T22:51:23.444220] [DEBUG] [LOCAL ] FIHL: Derivative data saved (1794 records). [2025-09-17T22:51:23.445411] [INFO ] [MAIN ] FIHL: Successfully saved derivative data. [2025-09-17T22:51:23.449024] [INFO ] [MAIN ] Derivative Progress: 695/2085 symbols completed. FIHL took 1.4s. Estimated remaining: 9m 2s. Rate: 153.7 symbols/min [2025-09-17T22:51:23.450452] [DEBUG] [LOCAL ] FIGS: Derivative data saved (1794 records). [2025-09-17T22:51:23.450800] [INFO ] [MAIN ] FIGS: Successfully saved derivative data. [2025-09-17T22:51:23.453626] [INFO ] [MAIN ] Derivative Progress: 696/2085 symbols completed. FIGS took 1.5s. Estimated remaining: 9m 1s. Rate: 154.0 symbols/min [2025-09-17T22:51:23.451392] [INFO ] [MAIN ] FINV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:23.454673] [INFO ] [MAIN ] FIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:23.474951] [DEBUG] [MAIN ] FINS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:23.475941] [INFO ] [MAIN ] FINS: Generated 1794 derivative records from 8196 primary records. [2025-09-17T22:51:23.476088] [DEBUG] [LOCAL ] FINS: Saving derivative data. [2025-09-17T22:51:23.504481] [DEBUG] [LOCAL ] FINS: Derivative data saved (1794 records). [2025-09-17T22:51:23.504669] [INFO ] [MAIN ] FINS: Successfully saved derivative data. [2025-09-17T22:51:23.507492] [INFO ] [MAIN ] Derivative Progress: 697/2085 symbols completed. FINS took 0.7s. Estimated remaining: 9m 0s. Rate: 154.2 symbols/min [2025-09-17T22:51:23.507997] [INFO ] [MAIN ] FIX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:23.527421] [DEBUG] [LOCAL ] FINV: Loaded 44930 existing records from primary storage. [2025-09-17T22:51:23.528089] [INFO ] [MAIN ] FINV: Loaded 44930 primary data records. [2025-09-17T22:51:23.688207] [DEBUG] [LOCAL ] FIS: Loaded 53372 existing records from primary storage. [2025-09-17T22:51:23.699163] [INFO ] [MAIN ] FIS: Loaded 53372 primary data records. [2025-09-17T22:51:23.800548] [DEBUG] [LOCAL ] FIX: Loaded 30992 existing records from primary storage. [2025-09-17T22:51:23.839290] [INFO ] [MAIN ] FIX: Loaded 30992 primary data records. [2025-09-17T22:51:24.612941] [DEBUG] [MAIN ] FINV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:24.614025] [INFO ] [MAIN ] FINV: Generated 1794 derivative records from 44930 primary records. [2025-09-17T22:51:24.615597] [DEBUG] [LOCAL ] FINV: Saving derivative data. [2025-09-17T22:51:24.635828] [DEBUG] [LOCAL ] FINV: Derivative data saved (1794 records). [2025-09-17T22:51:24.636203] [INFO ] [MAIN ] FINV: Successfully saved derivative data. [2025-09-17T22:51:24.638164] [INFO ] [MAIN ] Derivative Progress: 698/2085 symbols completed. FINV took 1.2s. Estimated remaining: 9m 1s. Rate: 153.7 symbols/min [2025-09-17T22:51:24.651437] [DEBUG] [MAIN ] FIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:24.652748] [INFO ] [MAIN ] FIS: Generated 1794 derivative records from 53372 primary records. [2025-09-17T22:51:24.651532] [INFO ] [MAIN ] FLC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:24.652922] [DEBUG] [LOCAL ] FIS: Saving derivative data. [2025-09-17T22:51:24.683950] [DEBUG] [LOCAL ] FLC: Loaded 5754 existing records from primary storage. [2025-09-17T22:51:24.691836] [DEBUG] [MAIN ] FIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:24.692714] [DEBUG] [LOCAL ] FIS: Derivative data saved (1794 records). [2025-09-17T22:51:24.691941] [INFO ] [MAIN ] FLC: Loaded 5754 primary data records. [2025-09-17T22:51:24.706008] [INFO ] [MAIN ] FIS: Successfully saved derivative data. [2025-09-17T22:51:24.708349] [INFO ] [MAIN ] Derivative Progress: 699/2085 symbols completed. FIS took 1.3s. Estimated remaining: 9m 0s. Rate: 153.9 symbols/min [2025-09-17T22:51:24.698976] [INFO ] [MAIN ] FIX: Generated 1794 derivative records from 30992 primary records. [2025-09-17T22:51:24.729382] [INFO ] [MAIN ] FLG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:24.729099] [DEBUG] [LOCAL ] FIX: Saving derivative data. [2025-09-17T22:51:24.824428] [DEBUG] [LOCAL ] FIX: Derivative data saved (1794 records). [2025-09-17T22:51:24.824744] [INFO ] [MAIN ] FIX: Successfully saved derivative data. [2025-09-17T22:51:24.827886] [INFO ] [MAIN ] Derivative Progress: 700/2085 symbols completed. FIX took 1.3s. Estimated remaining: 8m 59s. Rate: 154.1 symbols/min [2025-09-17T22:51:24.849057] [INFO ] [MAIN ] FLNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:25.083033] [DEBUG] [MAIN ] FLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:25.083792] [INFO ] [MAIN ] FLC: Generated 1794 derivative records from 5754 primary records. [2025-09-17T22:51:25.083947] [DEBUG] [LOCAL ] FLC: Saving derivative data. [2025-09-17T22:51:25.128158] [DEBUG] [LOCAL ] FLNG: Loaded 34240 existing records from primary storage. [2025-09-17T22:51:25.126770] [DEBUG] [LOCAL ] FLG: Loaded 53341 existing records from primary storage. [2025-09-17T22:51:25.129042] [INFO ] [MAIN ] FLG: Loaded 53341 primary data records. [2025-09-17T22:51:25.129190] [INFO ] [MAIN ] FLNG: Loaded 34240 primary data records. [2025-09-17T22:51:25.194520] [DEBUG] [LOCAL ] FLC: Derivative data saved (1794 records). [2025-09-17T22:51:25.230924] [INFO ] [MAIN ] FLC: Successfully saved derivative data. [2025-09-17T22:51:25.249054] [INFO ] [MAIN ] Derivative Progress: 701/2085 symbols completed. FLC took 0.6s. Estimated remaining: 8m 59s. Rate: 154.1 symbols/min [2025-09-17T22:51:25.287740] [INFO ] [MAIN ] FLO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:25.850162] [DEBUG] [LOCAL ] FLO: Loaded 51858 existing records from primary storage. [2025-09-17T22:51:25.850965] [DEBUG] [MAIN ] FLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:25.851985] [INFO ] [MAIN ] FLG: Generated 1794 derivative records from 53341 primary records. [2025-09-17T22:51:25.852187] [INFO ] [MAIN ] FLO: Loaded 51858 primary data records. [2025-09-17T22:51:25.852276] [DEBUG] [LOCAL ] FLG: Saving derivative data. [2025-09-17T22:51:25.943808] [DEBUG] [LOCAL ] FLG: Derivative data saved (1794 records). [2025-09-17T22:51:25.977760] [INFO ] [MAIN ] FLG: Successfully saved derivative data. [2025-09-17T22:51:25.980565] [INFO ] [MAIN ] Derivative Progress: 702/2085 symbols completed. FLG took 1.3s. Estimated remaining: 8m 59s. Rate: 153.9 symbols/min [2025-09-17T22:51:25.986254] [INFO ] [MAIN ] FLR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:26.050589] [DEBUG] [MAIN ] FLNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:26.074297] [INFO ] [MAIN ] FLNG: Generated 1794 derivative records from 34240 primary records. [2025-09-17T22:51:26.074428] [DEBUG] [LOCAL ] FLNG: Saving derivative data. [2025-09-17T22:51:26.210574] [DEBUG] [LOCAL ] FLNG: Derivative data saved (1794 records). [2025-09-17T22:51:26.211511] [INFO ] [MAIN ] FLNG: Successfully saved derivative data. [2025-09-17T22:51:26.213731] [INFO ] [MAIN ] Derivative Progress: 703/2085 symbols completed. FLNG took 1.4s. Estimated remaining: 8m 59s. Rate: 153.9 symbols/min [2025-09-17T22:51:26.248313] [DEBUG] [MAIN ] FLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:26.248976] [INFO ] [MAIN ] FLO: Generated 1794 derivative records from 51858 primary records. [2025-09-17T22:51:26.249063] [DEBUG] [LOCAL ] FLO: Saving derivative data. [2025-09-17T22:51:26.280846] [DEBUG] [LOCAL ] FLR: Loaded 53121 existing records from primary storage. [2025-09-17T22:51:26.281729] [INFO ] [MAIN ] FLR: Loaded 53121 primary data records. [2025-09-17T22:51:26.319259] [DEBUG] [LOCAL ] FLO: Derivative data saved (1794 records). [2025-09-17T22:51:26.360764] [INFO ] [MAIN ] FLO: Successfully saved derivative data. [2025-09-17T22:51:26.374967] [INFO ] [MAIN ] Derivative Progress: 704/2085 symbols completed. FLO took 1.1s. Estimated remaining: 8m 58s. Rate: 154.1 symbols/min [2025-09-17T22:51:26.654398] [DEBUG] [MAIN ] FLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:26.655179] [INFO ] [MAIN ] FLR: Generated 1794 derivative records from 53121 primary records. [2025-09-17T22:51:26.655246] [DEBUG] [LOCAL ] FLR: Saving derivative data. [2025-09-17T22:51:26.672302] [DEBUG] [LOCAL ] FLR: Derivative data saved (1794 records). [2025-09-17T22:51:26.672443] [INFO ] [MAIN ] FLR: Successfully saved derivative data. [2025-09-17T22:51:26.675471] [INFO ] [MAIN ] Derivative Progress: 705/2085 symbols completed. FLR took 0.7s. Estimated remaining: 8m 57s. Rate: 154.1 symbols/min [2025-09-17T22:51:26.676258] [INFO ] [MAIN ] FLXR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:26.676523] [INFO ] [MAIN ] FLUT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:26.676335] [INFO ] [MAIN ] FLS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:26.704442] [DEBUG] [LOCAL ] FLXR: Loaded 19568 existing records from primary storage. [2025-09-17T22:51:26.704605] [INFO ] [MAIN ] FLXR: Loaded 19568 primary data records. [2025-09-17T22:51:26.908209] [DEBUG] [LOCAL ] FLUT: Loaded 51037 existing records from primary storage. [2025-09-17T22:51:26.923726] [INFO ] [MAIN ] FLUT: Loaded 51037 primary data records. [2025-09-17T22:51:27.098323] [DEBUG] [LOCAL ] FLS: Loaded 50150 existing records from primary storage. [2025-09-17T22:51:27.130052] [INFO ] [MAIN ] FLS: Loaded 50150 primary data records. [2025-09-17T22:51:27.770931] [DEBUG] [MAIN ] FLXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:27.772154] [INFO ] [MAIN ] FLXR: Generated 1794 derivative records from 19568 primary records. [2025-09-17T22:51:27.772605] [DEBUG] [LOCAL ] FLXR: Saving derivative data. [2025-09-17T22:51:27.791749] [DEBUG] [LOCAL ] FLXR: Derivative data saved (1794 records). [2025-09-17T22:51:27.792114] [INFO ] [MAIN ] FLXR: Successfully saved derivative data. [2025-09-17T22:51:27.798218] [INFO ] [MAIN ] Derivative Progress: 706/2085 symbols completed. FLXR took 1.1s. Estimated remaining: 8m 58s. Rate: 153.7 symbols/min [2025-09-17T22:51:27.798912] [INFO ] [MAIN ] FMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:27.813246] [DEBUG] [MAIN ] FLUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:27.821486] [INFO ] [MAIN ] FLUT: Generated 1794 derivative records from 51037 primary records. [2025-09-17T22:51:27.826302] [DEBUG] [LOCAL ] FLUT: Saving derivative data. [2025-09-17T22:51:27.826745] [DEBUG] [MAIN ] FLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:27.827414] [INFO ] [MAIN ] FLS: Generated 1794 derivative records from 50150 primary records. [2025-09-17T22:51:27.827998] [DEBUG] [LOCAL ] FLS: Saving derivative data. [2025-09-17T22:51:27.858570] [DEBUG] [LOCAL ] FLUT: Derivative data saved (1794 records). [2025-09-17T22:51:27.859697] [INFO ] [MAIN ] FLUT: Successfully saved derivative data. [2025-09-17T22:51:27.862194] [INFO ] [MAIN ] Derivative Progress: 707/2085 symbols completed. FLUT took 1.2s. Estimated remaining: 8m 57s. Rate: 153.9 symbols/min [2025-09-17T22:51:27.862553] [INFO ] [MAIN ] FMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:27.865442] [DEBUG] [LOCAL ] FLS: Derivative data saved (1794 records). [2025-09-17T22:51:27.865532] [INFO ] [MAIN ] FLS: Successfully saved derivative data. [2025-09-17T22:51:27.867753] [INFO ] [MAIN ] Derivative Progress: 708/2085 symbols completed. FLS took 1.2s. Estimated remaining: 8m 56s. Rate: 154.1 symbols/min [2025-09-17T22:51:27.868122] [INFO ] [MAIN ] FMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:27.875303] [DEBUG] [LOCAL ] FMN: Loaded 6213 existing records from primary storage. [2025-09-17T22:51:27.875547] [INFO ] [MAIN ] FMN: Loaded 6213 primary data records. [2025-09-17T22:51:28.046973] [DEBUG] [LOCAL ] FMC: Loaded 51832 existing records from primary storage. [2025-09-17T22:51:28.113497] [INFO ] [MAIN ] FMC: Loaded 51832 primary data records. [2025-09-17T22:51:28.243297] [DEBUG] [LOCAL ] FMS: Loaded 30559 existing records from primary storage. [2025-09-17T22:51:28.283662] [INFO ] [MAIN ] FMS: Loaded 30559 primary data records. [2025-09-17T22:51:28.971112] [DEBUG] [MAIN ] FMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:28.972209] [INFO ] [MAIN ] FMN: Generated 1794 derivative records from 6213 primary records. [2025-09-17T22:51:28.973225] [DEBUG] [LOCAL ] FMN: Saving derivative data. [2025-09-17T22:51:28.991977] [DEBUG] [LOCAL ] FMN: Derivative data saved (1794 records). [2025-09-17T22:51:28.992362] [INFO ] [MAIN ] FMN: Successfully saved derivative data. [2025-09-17T22:51:28.994315] [INFO ] [MAIN ] Derivative Progress: 709/2085 symbols completed. FMN took 1.1s. Estimated remaining: 8m 57s. Rate: 153.7 symbols/min [2025-09-17T22:51:28.994816] [INFO ] [MAIN ] FMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:29.015130] [DEBUG] [MAIN ] FMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:29.016219] [INFO ] [MAIN ] FMC: Generated 1794 derivative records from 51832 primary records. [2025-09-17T22:51:29.016333] [DEBUG] [LOCAL ] FMC: Saving derivative data. [2025-09-17T22:51:29.037276] [DEBUG] [MAIN ] FMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:29.038151] [INFO ] [MAIN ] FMS: Generated 1794 derivative records from 30559 primary records. [2025-09-17T22:51:29.046568] [DEBUG] [LOCAL ] FMC: Derivative data saved (1794 records). [2025-09-17T22:51:29.046502] [DEBUG] [LOCAL ] FMS: Saving derivative data. [2025-09-17T22:51:29.046729] [INFO ] [MAIN ] FMC: Successfully saved derivative data. [2025-09-17T22:51:29.049497] [INFO ] [MAIN ] Derivative Progress: 710/2085 symbols completed. FMC took 1.3s. Estimated remaining: 8m 56s. Rate: 153.9 symbols/min [2025-09-17T22:51:29.050187] [INFO ] [MAIN ] FMY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:29.076011] [DEBUG] [LOCAL ] FMY: Loaded 1348 existing records from primary storage. [2025-09-17T22:51:29.076444] [INFO ] [MAIN ] FMY: Loaded 1348 primary data records. [2025-09-17T22:51:29.180000] [DEBUG] [LOCAL ] FMS: Derivative data saved (1794 records). [2025-09-17T22:51:29.186130] [DEBUG] [LOCAL ] FMX: Loaded 40729 existing records from primary storage. [2025-09-17T22:51:29.191424] [INFO ] [MAIN ] FMS: Successfully saved derivative data. [2025-09-17T22:51:29.209722] [INFO ] [MAIN ] FMX: Loaded 40729 primary data records. [2025-09-17T22:51:29.212271] [INFO ] [MAIN ] Derivative Progress: 711/2085 symbols completed. FMS took 1.3s. Estimated remaining: 8m 55s. Rate: 154.0 symbols/min [2025-09-17T22:51:29.237696] [INFO ] [MAIN ] FN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:29.757212] [DEBUG] [LOCAL ] FN: Loaded 39736 existing records from primary storage. [2025-09-17T22:51:29.757849] [INFO ] [MAIN ] FN: Loaded 39736 primary data records. [2025-09-17T22:51:29.963896] [DEBUG] [MAIN ] FMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:30.086628] [INFO ] [MAIN ] FMY: Generated 1794 derivative records from 1348 primary records. [2025-09-17T22:51:30.088023] [DEBUG] [LOCAL ] FMY: Saving derivative data. [2025-09-17T22:51:30.121346] [DEBUG] [LOCAL ] FMY: Derivative data saved (1794 records). [2025-09-17T22:51:30.121564] [INFO ] [MAIN ] FMY: Successfully saved derivative data. [2025-09-17T22:51:30.121261] [DEBUG] [MAIN ] FMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:30.122489] [INFO ] [MAIN ] FMX: Generated 1794 derivative records from 40729 primary records. [2025-09-17T22:51:30.124532] [INFO ] [MAIN ] Derivative Progress: 712/2085 symbols completed. FMY took 1.1s. Estimated remaining: 8m 56s. Rate: 153.7 symbols/min [2025-09-17T22:51:30.124930] [INFO ] [MAIN ] FNB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:30.124694] [DEBUG] [LOCAL ] FMX: Saving derivative data. [2025-09-17T22:51:30.145360] [DEBUG] [LOCAL ] FMX: Derivative data saved (1794 records). [2025-09-17T22:51:30.145755] [INFO ] [MAIN ] FMX: Successfully saved derivative data. [2025-09-17T22:51:30.148224] [INFO ] [MAIN ] Derivative Progress: 713/2085 symbols completed. FMX took 1.2s. Estimated remaining: 8m 55s. Rate: 153.9 symbols/min [2025-09-17T22:51:30.148576] [INFO ] [MAIN ] FND: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:30.166846] [DEBUG] [MAIN ] FN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:30.167827] [INFO ] [MAIN ] FN: Generated 1794 derivative records from 39736 primary records. [2025-09-17T22:51:30.167953] [DEBUG] [LOCAL ] FN: Saving derivative data. [2025-09-17T22:51:30.199323] [DEBUG] [LOCAL ] FN: Derivative data saved (1794 records). [2025-09-17T22:51:30.199519] [INFO ] [MAIN ] FN: Successfully saved derivative data. [2025-09-17T22:51:30.202187] [INFO ] [MAIN ] Derivative Progress: 714/2085 symbols completed. FN took 1.0s. Estimated remaining: 8m 54s. Rate: 154.1 symbols/min [2025-09-17T22:51:30.202621] [INFO ] [MAIN ] FNF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:30.234527] [DEBUG] [LOCAL ] FNB: Loaded 52454 existing records from primary storage. [2025-09-17T22:51:30.234827] [INFO ] [MAIN ] FNB: Loaded 52454 primary data records. [2025-09-17T22:51:30.360810] [DEBUG] [LOCAL ] FND: Loaded 52174 existing records from primary storage. [2025-09-17T22:51:30.371632] [INFO ] [MAIN ] FND: Loaded 52174 primary data records. [2025-09-17T22:51:30.693263] [DEBUG] [LOCAL ] FNF: Loaded 49332 existing records from primary storage. [2025-09-17T22:51:30.714678] [INFO ] [MAIN ] FNF: Loaded 49332 primary data records. [2025-09-17T22:51:31.266675] [DEBUG] [MAIN ] FNB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:31.268038] [INFO ] [MAIN ] FNB: Generated 1794 derivative records from 52454 primary records. [2025-09-17T22:51:31.268416] [DEBUG] [LOCAL ] FNB: Saving derivative data. [2025-09-17T22:51:31.289267] [DEBUG] [LOCAL ] FNB: Derivative data saved (1794 records). [2025-09-17T22:51:31.297282] [INFO ] [MAIN ] FNB: Successfully saved derivative data. [2025-09-17T22:51:31.304359] [DEBUG] [MAIN ] FND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:31.307860] [INFO ] [MAIN ] Derivative Progress: 715/2085 symbols completed. FNB took 1.2s. Estimated remaining: 8m 55s. Rate: 153.7 symbols/min [2025-09-17T22:51:31.305231] [INFO ] [MAIN ] FND: Generated 1794 derivative records from 52174 primary records. [2025-09-17T22:51:31.308571] [INFO ] [MAIN ] FNV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:31.308165] [DEBUG] [LOCAL ] FND: Saving derivative data. [2025-09-17T22:51:31.322852] [DEBUG] [MAIN ] FNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:31.330777] [INFO ] [MAIN ] FNF: Generated 1794 derivative records from 49332 primary records. [2025-09-17T22:51:31.334832] [DEBUG] [LOCAL ] FNF: Saving derivative data. [2025-09-17T22:51:31.352849] [DEBUG] [LOCAL ] FND: Derivative data saved (1794 records). [2025-09-17T22:51:31.353457] [INFO ] [MAIN ] FND: Successfully saved derivative data. [2025-09-17T22:51:31.355854] [INFO ] [MAIN ] Derivative Progress: 716/2085 symbols completed. FND took 1.2s. Estimated remaining: 8m 54s. Rate: 153.9 symbols/min [2025-09-17T22:51:31.356503] [INFO ] [MAIN ] FOF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:31.360947] [DEBUG] [LOCAL ] FNF: Derivative data saved (1794 records). [2025-09-17T22:51:31.361183] [INFO ] [MAIN ] FNF: Successfully saved derivative data. [2025-09-17T22:51:31.363774] [INFO ] [MAIN ] Derivative Progress: 717/2085 symbols completed. FNF took 1.2s. Estimated remaining: 8m 53s. Rate: 154.1 symbols/min [2025-09-17T22:51:31.366273] [INFO ] [MAIN ] FOR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:31.372255] [DEBUG] [LOCAL ] FOF: Loaded 8360 existing records from primary storage. [2025-09-17T22:51:31.372499] [INFO ] [MAIN ] FOF: Loaded 8360 primary data records. [2025-09-17T22:51:31.511903] [DEBUG] [LOCAL ] FOR: Loaded 20288 existing records from primary storage. [2025-09-17T22:51:31.517716] [INFO ] [MAIN ] FOR: Loaded 20288 primary data records. [2025-09-17T22:51:31.698962] [DEBUG] [LOCAL ] FNV: Loaded 46493 existing records from primary storage. [2025-09-17T22:51:31.713137] [INFO ] [MAIN ] FNV: Loaded 46493 primary data records. [2025-09-17T22:51:32.380409] [DEBUG] [MAIN ] FOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:32.381786] [INFO ] [MAIN ] FOF: Generated 1794 derivative records from 8360 primary records. [2025-09-17T22:51:32.382341] [DEBUG] [LOCAL ] FOF: Saving derivative data. [2025-09-17T22:51:32.416584] [DEBUG] [LOCAL ] FOF: Derivative data saved (1794 records). [2025-09-17T22:51:32.417291] [DEBUG] [MAIN ] FOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:32.418367] [INFO ] [MAIN ] FOR: Generated 1794 derivative records from 20288 primary records. [2025-09-17T22:51:32.418600] [DEBUG] [LOCAL ] FOR: Saving derivative data. [2025-09-17T22:51:32.418751] [INFO ] [MAIN ] FOF: Successfully saved derivative data. [2025-09-17T22:51:32.421596] [INFO ] [MAIN ] Derivative Progress: 718/2085 symbols completed. FOF took 1.1s. Estimated remaining: 8m 53s. Rate: 153.7 symbols/min [2025-09-17T22:51:32.457708] [DEBUG] [MAIN ] FNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:32.459112] [INFO ] [MAIN ] FNV: Generated 1794 derivative records from 46493 primary records. [2025-09-17T22:51:32.459427] [DEBUG] [LOCAL ] FNV: Saving derivative data. [2025-09-17T22:51:32.460535] [DEBUG] [LOCAL ] FOR: Derivative data saved (1794 records). [2025-09-17T22:51:32.460943] [INFO ] [MAIN ] FOR: Successfully saved derivative data. [2025-09-17T22:51:32.463162] [INFO ] [MAIN ] Derivative Progress: 719/2085 symbols completed. FOR took 1.1s. Estimated remaining: 8m 52s. Rate: 153.9 symbols/min [2025-09-17T22:51:32.480385] [DEBUG] [LOCAL ] FNV: Derivative data saved (1794 records). [2025-09-17T22:51:32.480538] [INFO ] [MAIN ] FNV: Successfully saved derivative data. [2025-09-17T22:51:32.484063] [INFO ] [MAIN ] Derivative Progress: 720/2085 symbols completed. FNV took 1.2s. Estimated remaining: 8m 51s. Rate: 154.1 symbols/min [2025-09-17T22:51:32.484712] [INFO ] [MAIN ] FOUR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:32.484862] [INFO ] [MAIN ] FPH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:32.484996] [INFO ] [MAIN ] FPF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:32.511629] [DEBUG] [LOCAL ] FPH: Loaded 19832 existing records from primary storage. [2025-09-17T22:51:32.512009] [INFO ] [MAIN ] FPH: Loaded 19832 primary data records. [2025-09-17T22:51:32.593100] [DEBUG] [LOCAL ] FPF: Loaded 17669 existing records from primary storage. [2025-09-17T22:51:32.640257] [INFO ] [MAIN ] FPF: Loaded 17669 primary data records. [2025-09-17T22:51:32.995072] [DEBUG] [LOCAL ] FOUR: Loaded 49528 existing records from primary storage. [2025-09-17T22:51:33.022118] [INFO ] [MAIN ] FOUR: Loaded 49528 primary data records. [2025-09-17T22:51:33.537589] [DEBUG] [MAIN ] FPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:33.538441] [INFO ] [MAIN ] FPH: Generated 1794 derivative records from 19832 primary records. [2025-09-17T22:51:33.539424] [DEBUG] [LOCAL ] FPH: Saving derivative data. [2025-09-17T22:51:33.571099] [DEBUG] [MAIN ] FPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:33.572275] [INFO ] [MAIN ] FPF: Generated 1794 derivative records from 17669 primary records. [2025-09-17T22:51:33.572542] [DEBUG] [LOCAL ] FPF: Saving derivative data. [2025-09-17T22:51:33.573015] [DEBUG] [LOCAL ] FPH: Derivative data saved (1794 records). [2025-09-17T22:51:33.573736] [INFO ] [MAIN ] FPH: Successfully saved derivative data. [2025-09-17T22:51:33.575983] [INFO ] [MAIN ] Derivative Progress: 721/2085 symbols completed. FPH took 1.1s. Estimated remaining: 8m 52s. Rate: 153.8 symbols/min [2025-09-17T22:51:33.584418] [INFO ] [MAIN ] FPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:33.594548] [DEBUG] [LOCAL ] FPF: Derivative data saved (1794 records). [2025-09-17T22:51:33.594766] [INFO ] [MAIN ] FPF: Successfully saved derivative data. [2025-09-17T22:51:33.597149] [INFO ] [MAIN ] Derivative Progress: 722/2085 symbols completed. FPF took 1.1s. Estimated remaining: 8m 51s. Rate: 154.0 symbols/min [2025-09-17T22:51:33.606283] [INFO ] [MAIN ] FR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:33.611924] [DEBUG] [MAIN ] FOUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:33.613042] [INFO ] [MAIN ] FOUR: Generated 1794 derivative records from 49528 primary records. [2025-09-17T22:51:33.613248] [DEBUG] [LOCAL ] FOUR: Saving derivative data. [2025-09-17T22:51:33.638730] [DEBUG] [LOCAL ] FOUR: Derivative data saved (1794 records). [2025-09-17T22:51:33.639004] [INFO ] [MAIN ] FOUR: Successfully saved derivative data. [2025-09-17T22:51:33.641695] [INFO ] [MAIN ] Derivative Progress: 723/2085 symbols completed. FOUR took 1.2s. Estimated remaining: 8m 50s. Rate: 154.1 symbols/min [2025-09-17T22:51:33.642192] [INFO ] [MAIN ] FRA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:33.654942] [DEBUG] [LOCAL ] FPI: Loaded 31251 existing records from primary storage. [2025-09-17T22:51:33.664688] [INFO ] [MAIN ] FPI: Loaded 31251 primary data records. [2025-09-17T22:51:33.757370] [DEBUG] [LOCAL ] FRA: Loaded 14810 existing records from primary storage. [2025-09-17T22:51:33.776372] [INFO ] [MAIN ] FRA: Loaded 14810 primary data records. [2025-09-17T22:51:33.831058] [DEBUG] [LOCAL ] FR: Loaded 46824 existing records from primary storage. [2025-09-17T22:51:33.861132] [INFO ] [MAIN ] FR: Loaded 46824 primary data records. [2025-09-17T22:51:34.690989] [DEBUG] [MAIN ] FPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:34.692039] [INFO ] [MAIN ] FPI: Generated 1794 derivative records from 31251 primary records. [2025-09-17T22:51:34.694566] [DEBUG] [LOCAL ] FPI: Saving derivative data. [2025-09-17T22:51:34.717813] [DEBUG] [MAIN ] FRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:34.727332] [INFO ] [MAIN ] FRA: Generated 1794 derivative records from 14810 primary records. [2025-09-17T22:51:34.726604] [DEBUG] [LOCAL ] FPI: Derivative data saved (1794 records). [2025-09-17T22:51:34.727436] [DEBUG] [LOCAL ] FRA: Saving derivative data. [2025-09-17T22:51:34.727814] [INFO ] [MAIN ] FPI: Successfully saved derivative data. [2025-09-17T22:51:34.730670] [INFO ] [MAIN ] Derivative Progress: 724/2085 symbols completed. FPI took 1.1s. Estimated remaining: 8m 51s. Rate: 153.8 symbols/min [2025-09-17T22:51:34.753353] [INFO ] [MAIN ] FRGE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:34.757983] [DEBUG] [LOCAL ] FRA: Derivative data saved (1794 records). [2025-09-17T22:51:34.758369] [DEBUG] [MAIN ] FR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:34.759288] [INFO ] [MAIN ] FR: Generated 1794 derivative records from 46824 primary records. [2025-09-17T22:51:34.759460] [DEBUG] [LOCAL ] FR: Saving derivative data. [2025-09-17T22:51:34.758483] [INFO ] [MAIN ] FRA: Successfully saved derivative data. [2025-09-17T22:51:34.762035] [INFO ] [MAIN ] Derivative Progress: 725/2085 symbols completed. FRA took 1.1s. Estimated remaining: 8m 50s. Rate: 154.0 symbols/min [2025-09-17T22:51:34.763059] [INFO ] [MAIN ] FRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:34.784052] [DEBUG] [LOCAL ] FR: Derivative data saved (1794 records). [2025-09-17T22:51:34.784314] [INFO ] [MAIN ] FR: Successfully saved derivative data. [2025-09-17T22:51:34.786527] [INFO ] [MAIN ] Derivative Progress: 726/2085 symbols completed. FR took 1.2s. Estimated remaining: 8m 49s. Rate: 154.2 symbols/min [2025-09-17T22:51:34.786865] [INFO ] [MAIN ] FRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:34.794710] [DEBUG] [LOCAL ] FRGE: Loaded 19024 existing records from primary storage. [2025-09-17T22:51:34.794860] [INFO ] [MAIN ] FRGE: Loaded 19024 primary data records. [2025-09-17T22:51:35.152240] [DEBUG] [LOCAL ] FRO: Loaded 51944 existing records from primary storage. [2025-09-17T22:51:35.153900] [INFO ] [MAIN ] FRO: Loaded 51944 primary data records. [2025-09-17T22:51:35.159900] [DEBUG] [LOCAL ] FRT: Loaded 42429 existing records from primary storage. [2025-09-17T22:51:35.160081] [INFO ] [MAIN ] FRT: Loaded 42429 primary data records. [2025-09-17T22:51:35.794369] [DEBUG] [MAIN ] FRGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:35.796491] [INFO ] [MAIN ] FRGE: Generated 1794 derivative records from 19024 primary records. [2025-09-17T22:51:35.797033] [DEBUG] [LOCAL ] FRGE: Saving derivative data. [2025-09-17T22:51:35.813800] [DEBUG] [LOCAL ] FRGE: Derivative data saved (1794 records). [2025-09-17T22:51:35.813960] [INFO ] [MAIN ] FRGE: Successfully saved derivative data. [2025-09-17T22:51:35.816345] [INFO ] [MAIN ] Derivative Progress: 727/2085 symbols completed. FRGE took 1.1s. Estimated remaining: 8m 50s. Rate: 153.8 symbols/min [2025-09-17T22:51:35.817282] [INFO ] [MAIN ] FSCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:35.837494] [DEBUG] [MAIN ] FRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:35.838258] [INFO ] [MAIN ] FRO: Generated 1794 derivative records from 51944 primary records. [2025-09-17T22:51:35.838346] [DEBUG] [LOCAL ] FRO: Saving derivative data. [2025-09-17T22:51:35.866365] [DEBUG] [LOCAL ] FRO: Derivative data saved (1794 records). [2025-09-17T22:51:35.880571] [INFO ] [MAIN ] FRO: Successfully saved derivative data. [2025-09-17T22:51:35.882848] [INFO ] [MAIN ] Derivative Progress: 728/2085 symbols completed. FRO took 1.1s. Estimated remaining: 8m 49s. Rate: 154.0 symbols/min [2025-09-17T22:51:35.883190] [INFO ] [MAIN ] FSK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:35.880894] [DEBUG] [MAIN ] FRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:35.884789] [INFO ] [MAIN ] FRT: Generated 1794 derivative records from 42429 primary records. [2025-09-17T22:51:35.885126] [DEBUG] [LOCAL ] FRT: Saving derivative data. [2025-09-17T22:51:35.909720] [DEBUG] [LOCAL ] FSCO: Loaded 36795 existing records from primary storage. [2025-09-17T22:51:35.913408] [INFO ] [MAIN ] FSCO: Loaded 36795 primary data records. [2025-09-17T22:51:35.926420] [DEBUG] [LOCAL ] FRT: Derivative data saved (1794 records). [2025-09-17T22:51:35.947414] [INFO ] [MAIN ] FRT: Successfully saved derivative data. [2025-09-17T22:51:35.975988] [INFO ] [MAIN ] Derivative Progress: 729/2085 symbols completed. FRT took 1.2s. Estimated remaining: 8m 48s. Rate: 154.1 symbols/min [2025-09-17T22:51:35.991565] [INFO ] [MAIN ] FSLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:36.258947] [DEBUG] [LOCAL ] FSK: Loaded 49334 existing records from primary storage. [2025-09-17T22:51:36.259373] [INFO ] [MAIN ] FSK: Loaded 49334 primary data records. [2025-09-17T22:51:36.494732] [DEBUG] [LOCAL ] FSLY: Loaded 51273 existing records from primary storage. [2025-09-17T22:51:36.617090] [INFO ] [MAIN ] FSLY: Loaded 51273 primary data records. [2025-09-17T22:51:36.821925] [DEBUG] [MAIN ] FSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:36.823036] [INFO ] [MAIN ] FSCO: Generated 1794 derivative records from 36795 primary records. [2025-09-17T22:51:36.906864] [DEBUG] [LOCAL ] FSCO: Saving derivative data. [2025-09-17T22:51:37.011868] [DEBUG] [LOCAL ] FSCO: Derivative data saved (1794 records). [2025-09-17T22:51:37.012208] [INFO ] [MAIN ] FSCO: Successfully saved derivative data. [2025-09-17T22:51:37.014688] [INFO ] [MAIN ] Derivative Progress: 730/2085 symbols completed. FSCO took 1.2s. Estimated remaining: 8m 49s. Rate: 153.8 symbols/min [2025-09-17T22:51:37.015715] [INFO ] [MAIN ] FSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:37.033348] [DEBUG] [MAIN ] FSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:37.034380] [INFO ] [MAIN ] FSK: Generated 1794 derivative records from 49334 primary records. [2025-09-17T22:51:37.034581] [DEBUG] [LOCAL ] FSK: Saving derivative data. [2025-09-17T22:51:37.056021] [DEBUG] [LOCAL ] FSK: Derivative data saved (1794 records). [2025-09-17T22:51:37.056565] [INFO ] [MAIN ] FSK: Successfully saved derivative data. [2025-09-17T22:51:37.058976] [INFO ] [MAIN ] Derivative Progress: 731/2085 symbols completed. FSK took 1.2s. Estimated remaining: 8m 48s. Rate: 154.0 symbols/min [2025-09-17T22:51:37.060434] [INFO ] [MAIN ] FSS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:37.080364] [DEBUG] [MAIN ] FSLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:37.081380] [INFO ] [MAIN ] FSLY: Generated 1794 derivative records from 51273 primary records. [2025-09-17T22:51:37.081578] [DEBUG] [LOCAL ] FSLY: Saving derivative data. [2025-09-17T22:51:37.113786] [DEBUG] [LOCAL ] FSLY: Derivative data saved (1794 records). [2025-09-17T22:51:37.114811] [INFO ] [MAIN ] FSLY: Successfully saved derivative data. [2025-09-17T22:51:37.117758] [INFO ] [MAIN ] Derivative Progress: 732/2085 symbols completed. FSLY took 1.1s. Estimated remaining: 8m 47s. Rate: 154.2 symbols/min [2025-09-17T22:51:37.118171] [INFO ] [MAIN ] FT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:37.158918] [DEBUG] [LOCAL ] FSM: Loaded 53281 existing records from primary storage. [2025-09-17T22:51:37.161940] [INFO ] [MAIN ] FSM: Loaded 53281 primary data records. [2025-09-17T22:51:37.162193] [DEBUG] [LOCAL ] FT: Loaded 6339 existing records from primary storage. [2025-09-17T22:51:37.162391] [INFO ] [MAIN ] FT: Loaded 6339 primary data records. [2025-09-17T22:51:37.162975] [DEBUG] [LOCAL ] FSS: Loaded 34976 existing records from primary storage. [2025-09-17T22:51:37.179945] [INFO ] [MAIN ] FSS: Loaded 34976 primary data records. [2025-09-17T22:51:38.124224] [DEBUG] [MAIN ] FSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:38.125038] [DEBUG] [MAIN ] FT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:38.126466] [INFO ] [MAIN ] FSM: Generated 1794 derivative records from 53281 primary records. [2025-09-17T22:51:38.125864] [INFO ] [MAIN ] FT: Generated 1794 derivative records from 6339 primary records. [2025-09-17T22:51:38.126636] [DEBUG] [LOCAL ] FSM: Saving derivative data. [2025-09-17T22:51:38.126581] [DEBUG] [LOCAL ] FT: Saving derivative data. [2025-09-17T22:51:38.155943] [DEBUG] [LOCAL ] FT: Derivative data saved (1794 records). [2025-09-17T22:51:38.164590] [INFO ] [MAIN ] FT: Successfully saved derivative data. [2025-09-17T22:51:38.173144] [INFO ] [MAIN ] Derivative Progress: 733/2085 symbols completed. FT took 1.1s. Estimated remaining: 8m 47s. Rate: 153.8 symbols/min [2025-09-17T22:51:38.173467] [DEBUG] [MAIN ] FSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:38.175174] [DEBUG] [LOCAL ] FSM: Derivative data saved (1794 records). [2025-09-17T22:51:38.176366] [INFO ] [MAIN ] FSS: Generated 1794 derivative records from 34976 primary records. [2025-09-17T22:51:38.176488] [INFO ] [MAIN ] FSM: Successfully saved derivative data. [2025-09-17T22:51:38.176695] [DEBUG] [LOCAL ] FSS: Saving derivative data. [2025-09-17T22:51:38.179338] [INFO ] [MAIN ] Derivative Progress: 734/2085 symbols completed. FSM took 1.2s. Estimated remaining: 8m 46s. Rate: 154.0 symbols/min [2025-09-17T22:51:38.195340] [DEBUG] [LOCAL ] FSS: Derivative data saved (1794 records). [2025-09-17T22:51:38.195413] [INFO ] [MAIN ] FSS: Successfully saved derivative data. [2025-09-17T22:51:38.197954] [INFO ] [MAIN ] Derivative Progress: 735/2085 symbols completed. FSS took 1.1s. Estimated remaining: 8m 45s. Rate: 154.2 symbols/min [2025-09-17T22:51:38.198529] [INFO ] [MAIN ] FTHY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:38.198587] [INFO ] [MAIN ] FTI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:38.199314] [INFO ] [MAIN ] FTK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:38.213752] [DEBUG] [LOCAL ] FTHY: Loaded 11739 existing records from primary storage. [2025-09-17T22:51:38.213907] [INFO ] [MAIN ] FTHY: Loaded 11739 primary data records. [2025-09-17T22:51:38.374397] [DEBUG] [LOCAL ] FTK: Loaded 31916 existing records from primary storage. [2025-09-17T22:51:38.385085] [INFO ] [MAIN ] FTK: Loaded 31916 primary data records. [2025-09-17T22:51:38.703025] [DEBUG] [LOCAL ] FTI: Loaded 53305 existing records from primary storage. [2025-09-17T22:51:38.714719] [INFO ] [MAIN ] FTI: Loaded 53305 primary data records. [2025-09-17T22:51:39.343351] [DEBUG] [MAIN ] FTHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:39.344447] [INFO ] [MAIN ] FTHY: Generated 1794 derivative records from 11739 primary records. [2025-09-17T22:51:39.344740] [DEBUG] [LOCAL ] FTHY: Saving derivative data. [2025-09-17T22:51:39.366601] [DEBUG] [LOCAL ] FTHY: Derivative data saved (1794 records). [2025-09-17T22:51:39.368537] [INFO ] [MAIN ] FTHY: Successfully saved derivative data. [2025-09-17T22:51:39.372682] [INFO ] [MAIN ] Derivative Progress: 736/2085 symbols completed. FTHY took 1.2s. Estimated remaining: 8m 46s. Rate: 153.8 symbols/min [2025-09-17T22:51:39.373456] [INFO ] [MAIN ] FTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:39.388841] [DEBUG] [MAIN ] FTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:39.390469] [INFO ] [MAIN ] FTK: Generated 1794 derivative records from 31916 primary records. [2025-09-17T22:51:39.390614] [DEBUG] [LOCAL ] FTK: Saving derivative data. [2025-09-17T22:51:39.416206] [DEBUG] [MAIN ] FTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:39.420825] [INFO ] [MAIN ] FTI: Generated 1794 derivative records from 53305 primary records. [2025-09-17T22:51:39.421518] [DEBUG] [LOCAL ] FTK: Derivative data saved (1794 records). [2025-09-17T22:51:39.421717] [INFO ] [MAIN ] FTK: Successfully saved derivative data. [2025-09-17T22:51:39.421666] [DEBUG] [LOCAL ] FTI: Saving derivative data. [2025-09-17T22:51:39.424844] [INFO ] [MAIN ] Derivative Progress: 737/2085 symbols completed. FTK took 1.2s. Estimated remaining: 8m 45s. Rate: 154.0 symbols/min [2025-09-17T22:51:39.426343] [INFO ] [MAIN ] FTV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:39.443775] [DEBUG] [LOCAL ] FTI: Derivative data saved (1794 records). [2025-09-17T22:51:39.444018] [INFO ] [MAIN ] FTI: Successfully saved derivative data. [2025-09-17T22:51:39.446842] [INFO ] [MAIN ] Derivative Progress: 738/2085 symbols completed. FTI took 1.2s. Estimated remaining: 8m 44s. Rate: 154.2 symbols/min [2025-09-17T22:51:39.447266] [INFO ] [MAIN ] FTWO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:39.451713] [DEBUG] [LOCAL ] FTWO: Loaded 1788 existing records from primary storage. [2025-09-17T22:51:39.464516] [INFO ] [MAIN ] FTWO: Loaded 1788 primary data records. [2025-09-17T22:51:39.592239] [DEBUG] [LOCAL ] FTS: Loaded 42176 existing records from primary storage. [2025-09-17T22:51:39.628789] [INFO ] [MAIN ] FTS: Loaded 42176 primary data records. [2025-09-17T22:51:39.910545] [DEBUG] [LOCAL ] FTV: Loaded 52896 existing records from primary storage. [2025-09-17T22:51:39.921388] [INFO ] [MAIN ] FTV: Loaded 52896 primary data records. [2025-09-17T22:51:40.499429] [DEBUG] [MAIN ] FTWO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:51:40.500670] [INFO ] [MAIN ] FTWO: Generated 1793 derivative records from 1788 primary records. [2025-09-17T22:51:40.500869] [DEBUG] [LOCAL ] FTWO: Saving derivative data. [2025-09-17T22:51:40.517388] [DEBUG] [LOCAL ] FTWO: Derivative data saved (1793 records). [2025-09-17T22:51:40.518689] [INFO ] [MAIN ] FTWO: Successfully saved derivative data. [2025-09-17T22:51:40.521734] [INFO ] [MAIN ] Derivative Progress: 739/2085 symbols completed. FTWO took 1.1s. Estimated remaining: 8m 45s. Rate: 153.8 symbols/min [2025-09-17T22:51:40.522437] [INFO ] [MAIN ] FUBO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:40.535519] [DEBUG] [MAIN ] FTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:40.536918] [INFO ] [MAIN ] FTS: Generated 1794 derivative records from 42176 primary records. [2025-09-17T22:51:40.537123] [DEBUG] [LOCAL ] FTS: Saving derivative data. [2025-09-17T22:51:40.564293] [DEBUG] [LOCAL ] FTS: Derivative data saved (1794 records). [2025-09-17T22:51:40.568730] [INFO ] [MAIN ] FTS: Successfully saved derivative data. [2025-09-17T22:51:40.571463] [INFO ] [MAIN ] Derivative Progress: 740/2085 symbols completed. FTS took 1.2s. Estimated remaining: 8m 44s. Rate: 154.0 symbols/min [2025-09-17T22:51:40.572557] [INFO ] [MAIN ] FUL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:40.572487] [DEBUG] [MAIN ] FTV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:40.573694] [INFO ] [MAIN ] FTV: Generated 1794 derivative records from 52896 primary records. [2025-09-17T22:51:40.573903] [DEBUG] [LOCAL ] FTV: Saving derivative data. [2025-09-17T22:51:40.590961] [DEBUG] [LOCAL ] FTV: Derivative data saved (1794 records). [2025-09-17T22:51:40.604577] [INFO ] [MAIN ] FTV: Successfully saved derivative data. [2025-09-17T22:51:40.607219] [INFO ] [MAIN ] Derivative Progress: 741/2085 symbols completed. FTV took 1.2s. Estimated remaining: 8m 43s. Rate: 154.2 symbols/min [2025-09-17T22:51:40.607789] [INFO ] [MAIN ] FUN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:40.646075] [DEBUG] [LOCAL ] FUBO: Loaded 53699 existing records from primary storage. [2025-09-17T22:51:40.646337] [INFO ] [MAIN ] FUBO: Loaded 53699 primary data records. [2025-09-17T22:51:40.646943] [DEBUG] [LOCAL ] FUL: Loaded 33020 existing records from primary storage. [2025-09-17T22:51:40.679135] [INFO ] [MAIN ] FUL: Loaded 33020 primary data records. [2025-09-17T22:51:41.032171] [DEBUG] [LOCAL ] FUN: Loaded 51534 existing records from primary storage. [2025-09-17T22:51:41.067566] [INFO ] [MAIN ] FUN: Loaded 51534 primary data records. [2025-09-17T22:51:41.715419] [DEBUG] [MAIN ] FUBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:41.724787] [INFO ] [MAIN ] FUBO: Generated 1794 derivative records from 53699 primary records. [2025-09-17T22:51:41.725060] [DEBUG] [LOCAL ] FUBO: Saving derivative data. [2025-09-17T22:51:41.731003] [DEBUG] [MAIN ] FUL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:41.732170] [INFO ] [MAIN ] FUL: Generated 1794 derivative records from 33020 primary records. [2025-09-17T22:51:41.740117] [DEBUG] [LOCAL ] FUL: Saving derivative data. [2025-09-17T22:51:41.770522] [DEBUG] [LOCAL ] FUL: Derivative data saved (1794 records). [2025-09-17T22:51:41.771854] [INFO ] [MAIN ] FUL: Successfully saved derivative data. [2025-09-17T22:51:41.774623] [INFO ] [MAIN ] Derivative Progress: 742/2085 symbols completed. FUL took 1.2s. Estimated remaining: 8m 44s. Rate: 153.8 symbols/min [2025-09-17T22:51:41.775088] [INFO ] [MAIN ] FVR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:41.776985] [DEBUG] [LOCAL ] FUBO: Derivative data saved (1794 records). [2025-09-17T22:51:41.777558] [INFO ] [MAIN ] FUBO: Successfully saved derivative data. [2025-09-17T22:51:41.780344] [INFO ] [MAIN ] Derivative Progress: 743/2085 symbols completed. FUBO took 1.3s. Estimated remaining: 8m 43s. Rate: 154.0 symbols/min [2025-09-17T22:51:41.780760] [INFO ] [MAIN ] FVRR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:41.799110] [DEBUG] [MAIN ] FUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:41.800037] [INFO ] [MAIN ] FUN: Generated 1794 derivative records from 51534 primary records. [2025-09-17T22:51:41.800316] [DEBUG] [LOCAL ] FUN: Saving derivative data. [2025-09-17T22:51:41.832195] [DEBUG] [LOCAL ] FUN: Derivative data saved (1794 records). [2025-09-17T22:51:41.832885] [INFO ] [MAIN ] FUN: Successfully saved derivative data. [2025-09-17T22:51:41.832621] [DEBUG] [LOCAL ] FVR: Loaded 21936 existing records from primary storage. [2025-09-17T22:51:41.836861] [INFO ] [MAIN ] Derivative Progress: 744/2085 symbols completed. FUN took 1.2s. Estimated remaining: 8m 42s. Rate: 154.1 symbols/min [2025-09-17T22:51:41.837382] [INFO ] [MAIN ] FVR: Loaded 21936 primary data records. [2025-09-17T22:51:41.837471] [INFO ] [MAIN ] FXED: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:41.947741] [DEBUG] [LOCAL ] FXED: Loaded 1206 existing records from primary storage. [2025-09-17T22:51:41.960179] [INFO ] [MAIN ] FXED: Loaded 1206 primary data records. [2025-09-17T22:51:42.098234] [DEBUG] [LOCAL ] FVRR: Loaded 40164 existing records from primary storage. [2025-09-17T22:51:42.139088] [INFO ] [MAIN ] FVRR: Loaded 40164 primary data records. [2025-09-17T22:51:42.893438] [DEBUG] [MAIN ] FVR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:51:42.896024] [INFO ] [MAIN ] FVR: Generated 1793 derivative records from 21936 primary records. [2025-09-17T22:51:42.896320] [DEBUG] [LOCAL ] FVR: Saving derivative data. [2025-09-17T22:51:42.925833] [DEBUG] [MAIN ] FXED: Filtered 6931 bins outside market hours, 7729 incomplete bins [2025-09-17T22:51:42.927611] [INFO ] [MAIN ] FXED: Generated 1789 derivative records from 1206 primary records. [2025-09-17T22:51:42.927729] [DEBUG] [LOCAL ] FXED: Saving derivative data. [2025-09-17T22:51:42.947338] [DEBUG] [LOCAL ] FXED: Derivative data saved (1789 records). [2025-09-17T22:51:42.947907] [INFO ] [MAIN ] FXED: Successfully saved derivative data. [2025-09-17T22:51:42.951144] [INFO ] [MAIN ] Derivative Progress: 745/2085 symbols completed. FXED took 1.1s. Estimated remaining: 8m 43s. Rate: 153.8 symbols/min [2025-09-17T22:51:42.959751] [INFO ] [MAIN ] G: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:42.965796] [DEBUG] [LOCAL ] FVR: Derivative data saved (1793 records). [2025-09-17T22:51:42.966318] [INFO ] [MAIN ] FVR: Successfully saved derivative data. [2025-09-17T22:51:42.968633] [INFO ] [MAIN ] Derivative Progress: 746/2085 symbols completed. FVR took 1.2s. Estimated remaining: 8m 42s. Rate: 153.9 symbols/min [2025-09-17T22:51:42.966519] [DEBUG] [MAIN ] FVRR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:42.970384] [INFO ] [MAIN ] FVRR: Generated 1794 derivative records from 40164 primary records. [2025-09-17T22:51:42.970594] [INFO ] [MAIN ] GAB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:42.970758] [DEBUG] [LOCAL ] FVRR: Saving derivative data. [2025-09-17T22:51:42.988031] [DEBUG] [LOCAL ] FVRR: Derivative data saved (1794 records). [2025-09-17T22:51:42.988107] [INFO ] [MAIN ] FVRR: Successfully saved derivative data. [2025-09-17T22:51:42.990582] [INFO ] [MAIN ] Derivative Progress: 747/2085 symbols completed. FVRR took 1.2s. Estimated remaining: 8m 41s. Rate: 154.1 symbols/min [2025-09-17T22:51:42.990974] [INFO ] [MAIN ] GAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:43.005276] [DEBUG] [LOCAL ] GAM: Loaded 4375 existing records from primary storage. [2025-09-17T22:51:43.005669] [INFO ] [MAIN ] GAM: Loaded 4375 primary data records. [2025-09-17T22:51:43.134343] [DEBUG] [LOCAL ] GAB: Loaded 27752 existing records from primary storage. [2025-09-17T22:51:43.150183] [INFO ] [MAIN ] GAB: Loaded 27752 primary data records. [2025-09-17T22:51:43.294689] [DEBUG] [LOCAL ] G: Loaded 49757 existing records from primary storage. [2025-09-17T22:51:43.305883] [INFO ] [MAIN ] G: Loaded 49757 primary data records. [2025-09-17T22:51:44.070323] [DEBUG] [MAIN ] GAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:44.072006] [INFO ] [MAIN ] GAM: Generated 1794 derivative records from 4375 primary records. [2025-09-17T22:51:44.073174] [DEBUG] [LOCAL ] GAM: Saving derivative data. [2025-09-17T22:51:44.093172] [DEBUG] [LOCAL ] GAM: Derivative data saved (1794 records). [2025-09-17T22:51:44.093323] [INFO ] [MAIN ] GAM: Successfully saved derivative data. [2025-09-17T22:51:44.096157] [INFO ] [MAIN ] Derivative Progress: 748/2085 symbols completed. GAM took 1.1s. Estimated remaining: 8m 42s. Rate: 153.8 symbols/min [2025-09-17T22:51:44.110704] [DEBUG] [MAIN ] GAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:44.111503] [INFO ] [MAIN ] GAB: Generated 1794 derivative records from 27752 primary records. [2025-09-17T22:51:44.111597] [DEBUG] [LOCAL ] GAB: Saving derivative data. [2025-09-17T22:51:44.139537] [DEBUG] [MAIN ] G: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:44.140679] [INFO ] [MAIN ] G: Generated 1794 derivative records from 49757 primary records. [2025-09-17T22:51:44.141114] [DEBUG] [LOCAL ] G: Saving derivative data. [2025-09-17T22:51:44.155453] [DEBUG] [LOCAL ] GAB: Derivative data saved (1794 records). [2025-09-17T22:51:44.156466] [INFO ] [MAIN ] GAB: Successfully saved derivative data. [2025-09-17T22:51:44.159224] [INFO ] [MAIN ] Derivative Progress: 749/2085 symbols completed. GAB took 1.2s. Estimated remaining: 8m 41s. Rate: 153.9 symbols/min [2025-09-17T22:51:44.162942] [DEBUG] [LOCAL ] G: Derivative data saved (1794 records). [2025-09-17T22:51:44.163008] [INFO ] [MAIN ] G: Successfully saved derivative data. [2025-09-17T22:51:44.165949] [INFO ] [MAIN ] Derivative Progress: 750/2085 symbols completed. G took 1.2s. Estimated remaining: 8m 40s. Rate: 154.1 symbols/min [2025-09-17T22:51:44.166505] [INFO ] [MAIN ] GAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:44.166691] [INFO ] [MAIN ] GATX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:44.167169] [INFO ] [MAIN ] GBAB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:44.188200] [DEBUG] [LOCAL ] GBAB: Loaded 13082 existing records from primary storage. [2025-09-17T22:51:44.188341] [INFO ] [MAIN ] GBAB: Loaded 13082 primary data records. [2025-09-17T22:51:44.281427] [DEBUG] [LOCAL ] GATX: Loaded 17983 existing records from primary storage. [2025-09-17T22:51:44.309927] [INFO ] [MAIN ] GATX: Loaded 17983 primary data records. [2025-09-17T22:51:44.544342] [DEBUG] [LOCAL ] GAP: Loaded 53655 existing records from primary storage. [2025-09-17T22:51:44.544622] [INFO ] [MAIN ] GAP: Loaded 53655 primary data records. [2025-09-17T22:51:45.266403] [DEBUG] [MAIN ] GBAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:45.268022] [INFO ] [MAIN ] GBAB: Generated 1794 derivative records from 13082 primary records. [2025-09-17T22:51:45.268432] [DEBUG] [LOCAL ] GBAB: Saving derivative data. [2025-09-17T22:51:45.291124] [DEBUG] [LOCAL ] GBAB: Derivative data saved (1794 records). [2025-09-17T22:51:45.291492] [INFO ] [MAIN ] GBAB: Successfully saved derivative data. [2025-09-17T22:51:45.304692] [INFO ] [MAIN ] Derivative Progress: 751/2085 symbols completed. GBAB took 1.1s. Estimated remaining: 8m 41s. Rate: 153.7 symbols/min [2025-09-17T22:51:45.311663] [DEBUG] [MAIN ] GATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:45.312554] [INFO ] [MAIN ] GATX: Generated 1794 derivative records from 17983 primary records. [2025-09-17T22:51:45.313075] [DEBUG] [LOCAL ] GATX: Saving derivative data. [2025-09-17T22:51:45.314536] [INFO ] [MAIN ] GBCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:45.347806] [DEBUG] [MAIN ] GAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:45.348377] [DEBUG] [LOCAL ] GATX: Derivative data saved (1794 records). [2025-09-17T22:51:45.349313] [INFO ] [MAIN ] GAP: Generated 1794 derivative records from 53655 primary records. [2025-09-17T22:51:45.349417] [INFO ] [MAIN ] GATX: Successfully saved derivative data. [2025-09-17T22:51:45.352277] [INFO ] [MAIN ] Derivative Progress: 752/2085 symbols completed. GATX took 1.2s. Estimated remaining: 8m 40s. Rate: 153.9 symbols/min [2025-09-17T22:51:45.352482] [DEBUG] [LOCAL ] GAP: Saving derivative data. [2025-09-17T22:51:45.352853] [INFO ] [MAIN ] GBTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:45.381471] [DEBUG] [LOCAL ] GAP: Derivative data saved (1794 records). [2025-09-17T22:51:45.381578] [INFO ] [MAIN ] GAP: Successfully saved derivative data. [2025-09-17T22:51:45.385288] [INFO ] [MAIN ] Derivative Progress: 753/2085 symbols completed. GAP took 1.2s. Estimated remaining: 8m 39s. Rate: 154.1 symbols/min [2025-09-17T22:51:45.385714] [INFO ] [MAIN ] GBX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:45.402536] [DEBUG] [LOCAL ] GBCI: Loaded 40027 existing records from primary storage. [2025-09-17T22:51:45.402753] [INFO ] [MAIN ] GBCI: Loaded 40027 primary data records. [2025-09-17T22:51:45.561305] [DEBUG] [LOCAL ] GBTG: Loaded 40710 existing records from primary storage. [2025-09-17T22:51:45.600302] [DEBUG] [LOCAL ] GBX: Loaded 29517 existing records from primary storage. [2025-09-17T22:51:45.600799] [INFO ] [MAIN ] GBX: Loaded 29517 primary data records. [2025-09-17T22:51:45.600494] [INFO ] [MAIN ] GBTG: Loaded 40710 primary data records. [2025-09-17T22:51:46.433128] [DEBUG] [MAIN ] GBCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:46.434849] [INFO ] [MAIN ] GBCI: Generated 1794 derivative records from 40027 primary records. [2025-09-17T22:51:46.435022] [DEBUG] [LOCAL ] GBCI: Saving derivative data. [2025-09-17T22:51:46.471361] [DEBUG] [LOCAL ] GBCI: Derivative data saved (1794 records). [2025-09-17T22:51:46.471241] [DEBUG] [MAIN ] GBTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:46.472496] [INFO ] [MAIN ] GBTG: Generated 1794 derivative records from 40710 primary records. [2025-09-17T22:51:46.471582] [INFO ] [MAIN ] GBCI: Successfully saved derivative data. [2025-09-17T22:51:46.475285] [INFO ] [MAIN ] Derivative Progress: 754/2085 symbols completed. GBCI took 1.2s. Estimated remaining: 8m 39s. Rate: 153.7 symbols/min [2025-09-17T22:51:46.475526] [DEBUG] [LOCAL ] GBTG: Saving derivative data. [2025-09-17T22:51:46.489165] [DEBUG] [MAIN ] GBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:46.488957] [INFO ] [MAIN ] GCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:46.490955] [INFO ] [MAIN ] GBX: Generated 1794 derivative records from 29517 primary records. [2025-09-17T22:51:46.498374] [DEBUG] [LOCAL ] GBX: Saving derivative data. [2025-09-17T22:51:46.521344] [DEBUG] [LOCAL ] GBX: Derivative data saved (1794 records). [2025-09-17T22:51:46.522286] [INFO ] [MAIN ] GBX: Successfully saved derivative data. [2025-09-17T22:51:46.524864] [INFO ] [MAIN ] Derivative Progress: 755/2085 symbols completed. GBX took 1.1s. Estimated remaining: 8m 38s. Rate: 153.9 symbols/min [2025-09-17T22:51:46.525904] [INFO ] [MAIN ] GCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:46.527346] [DEBUG] [LOCAL ] GBTG: Derivative data saved (1794 records). [2025-09-17T22:51:46.527505] [INFO ] [MAIN ] GBTG: Successfully saved derivative data. [2025-09-17T22:51:46.530485] [INFO ] [MAIN ] Derivative Progress: 756/2085 symbols completed. GBTG took 1.2s. Estimated remaining: 8m 37s. Rate: 154.1 symbols/min [2025-09-17T22:51:46.530992] [INFO ] [MAIN ] GCTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:46.571010] [DEBUG] [LOCAL ] GCO: Loaded 25980 existing records from primary storage. [2025-09-17T22:51:46.578325] [INFO ] [MAIN ] GCO: Loaded 25980 primary data records. [2025-09-17T22:51:46.584209] [DEBUG] [LOCAL ] GCTS: Loaded 19389 existing records from primary storage. [2025-09-17T22:51:46.587850] [INFO ] [MAIN ] GCTS: Loaded 19389 primary data records. [2025-09-17T22:51:46.781166] [DEBUG] [LOCAL ] GCI: Loaded 44264 existing records from primary storage. [2025-09-17T22:51:46.813152] [INFO ] [MAIN ] GCI: Loaded 44264 primary data records. [2025-09-17T22:51:47.650530] [DEBUG] [MAIN ] GCTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:47.652175] [INFO ] [MAIN ] GCTS: Generated 1794 derivative records from 19389 primary records. [2025-09-17T22:51:47.651435] [DEBUG] [MAIN ] GCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:47.653469] [INFO ] [MAIN ] GCO: Generated 1794 derivative records from 25980 primary records. [2025-09-17T22:51:47.652556] [DEBUG] [LOCAL ] GCTS: Saving derivative data. [2025-09-17T22:51:47.654546] [DEBUG] [LOCAL ] GCO: Saving derivative data. [2025-09-17T22:51:47.699610] [DEBUG] [MAIN ] GCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:47.701604] [INFO ] [MAIN ] GCI: Generated 1794 derivative records from 44264 primary records. [2025-09-17T22:51:47.702401] [DEBUG] [LOCAL ] GCI: Saving derivative data. [2025-09-17T22:51:47.705634] [DEBUG] [LOCAL ] GCTS: Derivative data saved (1794 records). [2025-09-17T22:51:47.707028] [INFO ] [MAIN ] GCTS: Successfully saved derivative data. [2025-09-17T22:51:47.718563] [DEBUG] [LOCAL ] GCO: Derivative data saved (1794 records). [2025-09-17T22:51:47.716787] [INFO ] [MAIN ] Derivative Progress: 757/2085 symbols completed. GCTS took 1.2s. Estimated remaining: 8m 38s. Rate: 153.7 symbols/min [2025-09-17T22:51:47.721688] [INFO ] [MAIN ] GCO: Successfully saved derivative data. [2025-09-17T22:51:47.724193] [INFO ] [MAIN ] GCV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:47.724797] [INFO ] [MAIN ] Derivative Progress: 758/2085 symbols completed. GCO took 1.2s. Estimated remaining: 8m 37s. Rate: 153.9 symbols/min [2025-09-17T22:51:47.725351] [INFO ] [MAIN ] GD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:47.729281] [DEBUG] [LOCAL ] GCI: Derivative data saved (1794 records). [2025-09-17T22:51:47.729630] [INFO ] [MAIN ] GCI: Successfully saved derivative data. [2025-09-17T22:51:47.732322] [INFO ] [MAIN ] Derivative Progress: 759/2085 symbols completed. GCI took 1.2s. Estimated remaining: 8m 36s. Rate: 154.1 symbols/min [2025-09-17T22:51:47.733502] [INFO ] [MAIN ] GDDY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:47.741612] [DEBUG] [LOCAL ] GCV: Loaded 7064 existing records from primary storage. [2025-09-17T22:51:47.741834] [INFO ] [MAIN ] GCV: Loaded 7064 primary data records. [2025-09-17T22:51:48.090461] [DEBUG] [LOCAL ] GD: Loaded 47504 existing records from primary storage. [2025-09-17T22:51:48.092629] [INFO ] [MAIN ] GD: Loaded 47504 primary data records. [2025-09-17T22:51:48.157968] [DEBUG] [LOCAL ] GDDY: Loaded 49844 existing records from primary storage. [2025-09-17T22:51:48.204219] [INFO ] [MAIN ] GDDY: Loaded 49844 primary data records. [2025-09-17T22:51:48.764272] [DEBUG] [MAIN ] GCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:48.766727] [INFO ] [MAIN ] GCV: Generated 1794 derivative records from 7064 primary records. [2025-09-17T22:51:48.766923] [DEBUG] [LOCAL ] GCV: Saving derivative data. [2025-09-17T22:51:48.788449] [DEBUG] [LOCAL ] GCV: Derivative data saved (1794 records). [2025-09-17T22:51:48.788998] [INFO ] [MAIN ] GCV: Successfully saved derivative data. [2025-09-17T22:51:48.791783] [INFO ] [MAIN ] Derivative Progress: 760/2085 symbols completed. GCV took 1.1s. Estimated remaining: 8m 37s. Rate: 153.8 symbols/min [2025-09-17T22:51:48.792290] [INFO ] [MAIN ] GDIV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:48.806738] [DEBUG] [MAIN ] GD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:48.808975] [INFO ] [MAIN ] GD: Generated 1794 derivative records from 47504 primary records. [2025-09-17T22:51:48.809194] [DEBUG] [LOCAL ] GD: Saving derivative data. [2025-09-17T22:51:48.826722] [DEBUG] [LOCAL ] GDIV: Loaded 3778 existing records from primary storage. [2025-09-17T22:51:48.827817] [INFO ] [MAIN ] GDIV: Loaded 3778 primary data records. [2025-09-17T22:51:48.879051] [DEBUG] [MAIN ] GDDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:48.915915] [INFO ] [MAIN ] GDDY: Generated 1794 derivative records from 49844 primary records. [2025-09-17T22:51:48.923731] [DEBUG] [LOCAL ] GD: Derivative data saved (1794 records). [2025-09-17T22:51:48.923849] [DEBUG] [LOCAL ] GDDY: Saving derivative data. [2025-09-17T22:51:48.929618] [INFO ] [MAIN ] GD: Successfully saved derivative data. [2025-09-17T22:51:48.943332] [INFO ] [MAIN ] Derivative Progress: 761/2085 symbols completed. GD took 1.2s. Estimated remaining: 8m 36s. Rate: 153.9 symbols/min [2025-09-17T22:51:48.951706] [INFO ] [MAIN ] GDO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:48.989072] [DEBUG] [LOCAL ] GDDY: Derivative data saved (1794 records). [2025-09-17T22:51:48.994441] [INFO ] [MAIN ] GDDY: Successfully saved derivative data. [2025-09-17T22:51:48.997540] [INFO ] [MAIN ] Derivative Progress: 762/2085 symbols completed. GDDY took 1.3s. Estimated remaining: 8m 35s. Rate: 154.1 symbols/min [2025-09-17T22:51:49.018092] [INFO ] [MAIN ] GDOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:49.061085] [DEBUG] [LOCAL ] GDO: Loaded 6050 existing records from primary storage. [2025-09-17T22:51:49.167033] [INFO ] [MAIN ] GDO: Loaded 6050 primary data records. [2025-09-17T22:51:49.400540] [DEBUG] [LOCAL ] GDOT: Loaded 38613 existing records from primary storage. [2025-09-17T22:51:49.451032] [INFO ] [MAIN ] GDOT: Loaded 38613 primary data records. [2025-09-17T22:51:49.896740] [DEBUG] [MAIN ] GDIV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:51:49.898481] [INFO ] [MAIN ] GDIV: Generated 1793 derivative records from 3778 primary records. [2025-09-17T22:51:49.899038] [DEBUG] [LOCAL ] GDIV: Saving derivative data. [2025-09-17T22:51:49.924702] [DEBUG] [LOCAL ] GDIV: Derivative data saved (1793 records). [2025-09-17T22:51:49.926358] [INFO ] [MAIN ] GDIV: Successfully saved derivative data. [2025-09-17T22:51:49.928821] [INFO ] [MAIN ] Derivative Progress: 763/2085 symbols completed. GDIV took 1.1s. Estimated remaining: 8m 36s. Rate: 153.8 symbols/min [2025-09-17T22:51:49.943123] [DEBUG] [MAIN ] GDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:49.944267] [INFO ] [MAIN ] GDO: Generated 1794 derivative records from 6050 primary records. [2025-09-17T22:51:49.944354] [DEBUG] [LOCAL ] GDO: Saving derivative data. [2025-09-17T22:51:49.963388] [DEBUG] [LOCAL ] GDO: Derivative data saved (1794 records). [2025-09-17T22:51:49.963552] [INFO ] [MAIN ] GDO: Successfully saved derivative data. [2025-09-17T22:51:49.966253] [INFO ] [MAIN ] Derivative Progress: 764/2085 symbols completed. GDO took 1.0s. Estimated remaining: 8m 35s. Rate: 154.0 symbols/min [2025-09-17T22:51:49.984504] [DEBUG] [MAIN ] GDOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:49.985439] [INFO ] [MAIN ] GDOT: Generated 1794 derivative records from 38613 primary records. [2025-09-17T22:51:49.985509] [DEBUG] [LOCAL ] GDOT: Saving derivative data. [2025-09-17T22:51:50.001942] [DEBUG] [LOCAL ] GDOT: Derivative data saved (1794 records). [2025-09-17T22:51:50.002072] [INFO ] [MAIN ] GDOT: Successfully saved derivative data. [2025-09-17T22:51:50.005107] [INFO ] [MAIN ] Derivative Progress: 765/2085 symbols completed. GDOT took 1.0s. Estimated remaining: 8m 34s. Rate: 154.1 symbols/min [2025-09-17T22:51:50.006382] [INFO ] [MAIN ] GE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:50.006188] [INFO ] [MAIN ] GDV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:50.006502] [INFO ] [MAIN ] GEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:50.035579] [DEBUG] [LOCAL ] GDV: Loaded 20008 existing records from primary storage. [2025-09-17T22:51:50.035755] [INFO ] [MAIN ] GDV: Loaded 20008 primary data records. [2025-09-17T22:51:50.192499] [DEBUG] [LOCAL ] GEL: Loaded 34632 existing records from primary storage. [2025-09-17T22:51:50.226815] [INFO ] [MAIN ] GEL: Loaded 34632 primary data records. [2025-09-17T22:51:50.500391] [DEBUG] [LOCAL ] GE: Loaded 53715 existing records from primary storage. [2025-09-17T22:51:50.512440] [INFO ] [MAIN ] GE: Loaded 53715 primary data records. [2025-09-17T22:51:51.086185] [DEBUG] [MAIN ] GDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:51.087190] [INFO ] [MAIN ] GDV: Generated 1794 derivative records from 20008 primary records. [2025-09-17T22:51:51.087616] [DEBUG] [LOCAL ] GDV: Saving derivative data. [2025-09-17T22:51:51.108514] [DEBUG] [LOCAL ] GDV: Derivative data saved (1794 records). [2025-09-17T22:51:51.111085] [INFO ] [MAIN ] GDV: Successfully saved derivative data. [2025-09-17T22:51:51.114216] [INFO ] [MAIN ] Derivative Progress: 766/2085 symbols completed. GDV took 1.1s. Estimated remaining: 8m 35s. Rate: 153.8 symbols/min [2025-09-17T22:51:51.114756] [INFO ] [MAIN ] GENI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:51.127964] [DEBUG] [MAIN ] GEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:51.128684] [INFO ] [MAIN ] GEL: Generated 1794 derivative records from 34632 primary records. [2025-09-17T22:51:51.128861] [DEBUG] [LOCAL ] GEL: Saving derivative data. [2025-09-17T22:51:51.148457] [DEBUG] [LOCAL ] GEL: Derivative data saved (1794 records). [2025-09-17T22:51:51.162096] [INFO ] [MAIN ] GEL: Successfully saved derivative data. [2025-09-17T22:51:51.162028] [DEBUG] [MAIN ] GE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:51.164284] [INFO ] [MAIN ] Derivative Progress: 767/2085 symbols completed. GEL took 1.2s. Estimated remaining: 8m 34s. Rate: 153.9 symbols/min [2025-09-17T22:51:51.165257] [INFO ] [MAIN ] GE: Generated 1794 derivative records from 53715 primary records. [2025-09-17T22:51:51.165479] [DEBUG] [LOCAL ] GE: Saving derivative data. [2025-09-17T22:51:51.166197] [INFO ] [MAIN ] GEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:51.184792] [DEBUG] [LOCAL ] GE: Derivative data saved (1794 records). [2025-09-17T22:51:51.185074] [INFO ] [MAIN ] GE: Successfully saved derivative data. [2025-09-17T22:51:51.188852] [INFO ] [MAIN ] Derivative Progress: 768/2085 symbols completed. GE took 1.2s. Estimated remaining: 8m 33s. Rate: 154.1 symbols/min [2025-09-17T22:51:51.189224] [INFO ] [MAIN ] GES: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:51.234854] [DEBUG] [LOCAL ] GENI: Loaded 52914 existing records from primary storage. [2025-09-17T22:51:51.249142] [INFO ] [MAIN ] GENI: Loaded 52914 primary data records. [2025-09-17T22:51:51.407984] [DEBUG] [LOCAL ] GES: Loaded 40626 existing records from primary storage. [2025-09-17T22:51:51.408154] [INFO ] [MAIN ] GES: Loaded 40626 primary data records. [2025-09-17T22:51:51.396960] [DEBUG] [LOCAL ] GEO: Loaded 52241 existing records from primary storage. [2025-09-17T22:51:51.418553] [INFO ] [MAIN ] GEO: Loaded 52241 primary data records. [2025-09-17T22:51:52.325472] [DEBUG] [MAIN ] GENI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:52.327209] [INFO ] [MAIN ] GENI: Generated 1794 derivative records from 52914 primary records. [2025-09-17T22:51:52.327323] [DEBUG] [LOCAL ] GENI: Saving derivative data. [2025-09-17T22:51:52.348516] [DEBUG] [LOCAL ] GENI: Derivative data saved (1794 records). [2025-09-17T22:51:52.349700] [INFO ] [MAIN ] GENI: Successfully saved derivative data. [2025-09-17T22:51:52.352202] [INFO ] [MAIN ] Derivative Progress: 769/2085 symbols completed. GENI took 1.2s. Estimated remaining: 8m 34s. Rate: 153.7 symbols/min [2025-09-17T22:51:52.355280] [INFO ] [MAIN ] GETY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:52.370667] [DEBUG] [MAIN ] GEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:52.379044] [INFO ] [MAIN ] GEO: Generated 1794 derivative records from 52241 primary records. [2025-09-17T22:51:52.384015] [DEBUG] [LOCAL ] GEO: Saving derivative data. [2025-09-17T22:51:52.384840] [DEBUG] [MAIN ] GES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:52.385920] [INFO ] [MAIN ] GES: Generated 1794 derivative records from 40626 primary records. [2025-09-17T22:51:52.386298] [DEBUG] [LOCAL ] GES: Saving derivative data. [2025-09-17T22:51:52.417345] [DEBUG] [LOCAL ] GES: Derivative data saved (1794 records). [2025-09-17T22:51:52.418118] [INFO ] [MAIN ] GES: Successfully saved derivative data. [2025-09-17T22:51:52.422111] [INFO ] [MAIN ] Derivative Progress: 770/2085 symbols completed. GES took 1.2s. Estimated remaining: 8m 33s. Rate: 153.9 symbols/min [2025-09-17T22:51:52.431438] [INFO ] [MAIN ] GEV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:52.433135] [DEBUG] [LOCAL ] GEO: Derivative data saved (1794 records). [2025-09-17T22:51:52.433278] [INFO ] [MAIN ] GEO: Successfully saved derivative data. [2025-09-17T22:51:52.435998] [INFO ] [MAIN ] Derivative Progress: 771/2085 symbols completed. GEO took 1.3s. Estimated remaining: 8m 32s. Rate: 154.1 symbols/min [2025-09-17T22:51:52.436511] [INFO ] [MAIN ] GF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:52.454344] [DEBUG] [LOCAL ] GF: Loaded 3513 existing records from primary storage. [2025-09-17T22:51:52.451953] [DEBUG] [LOCAL ] GETY: Loaded 36392 existing records from primary storage. [2025-09-17T22:51:52.454556] [INFO ] [MAIN ] GF: Loaded 3513 primary data records. [2025-09-17T22:51:52.454674] [INFO ] [MAIN ] GETY: Loaded 36392 primary data records. [2025-09-17T22:51:53.101992] [DEBUG] [LOCAL ] GEV: Loaded 53169 existing records from primary storage. [2025-09-17T22:51:53.102930] [INFO ] [MAIN ] GEV: Loaded 53169 primary data records. [2025-09-17T22:51:53.509041] [DEBUG] [MAIN ] GF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:53.510934] [INFO ] [MAIN ] GF: Generated 1794 derivative records from 3513 primary records. [2025-09-17T22:51:53.511233] [DEBUG] [LOCAL ] GF: Saving derivative data. [2025-09-17T22:51:53.533662] [DEBUG] [MAIN ] GETY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:53.537416] [INFO ] [MAIN ] GETY: Generated 1794 derivative records from 36392 primary records. [2025-09-17T22:51:53.537627] [DEBUG] [LOCAL ] GETY: Saving derivative data. [2025-09-17T22:51:53.551287] [DEBUG] [LOCAL ] GF: Derivative data saved (1794 records). [2025-09-17T22:51:53.554433] [INFO ] [MAIN ] GF: Successfully saved derivative data. [2025-09-17T22:51:53.557412] [INFO ] [MAIN ] Derivative Progress: 772/2085 symbols completed. GF took 1.1s. Estimated remaining: 8m 33s. Rate: 153.7 symbols/min [2025-09-17T22:51:53.558471] [INFO ] [MAIN ] GFF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:53.566041] [DEBUG] [LOCAL ] GETY: Derivative data saved (1794 records). [2025-09-17T22:51:53.569022] [INFO ] [MAIN ] GETY: Successfully saved derivative data. [2025-09-17T22:51:53.571488] [INFO ] [MAIN ] Derivative Progress: 773/2085 symbols completed. GETY took 1.2s. Estimated remaining: 8m 31s. Rate: 153.9 symbols/min [2025-09-17T22:51:53.571964] [INFO ] [MAIN ] GFI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:53.585110] [DEBUG] [MAIN ] GEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:53.585858] [INFO ] [MAIN ] GEV: Generated 1794 derivative records from 53169 primary records. [2025-09-17T22:51:53.586059] [DEBUG] [LOCAL ] GEV: Saving derivative data. [2025-09-17T22:51:53.611695] [DEBUG] [LOCAL ] GEV: Derivative data saved (1794 records). [2025-09-17T22:51:53.611842] [INFO ] [MAIN ] GEV: Successfully saved derivative data. [2025-09-17T22:51:53.615076] [INFO ] [MAIN ] Derivative Progress: 774/2085 symbols completed. GEV took 1.2s. Estimated remaining: 8m 30s. Rate: 154.1 symbols/min [2025-09-17T22:51:53.624557] [INFO ] [MAIN ] GFL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:53.626749] [DEBUG] [LOCAL ] GFF: Loaded 31214 existing records from primary storage. [2025-09-17T22:51:53.627011] [INFO ] [MAIN ] GFF: Loaded 31214 primary data records. [2025-09-17T22:51:54.011810] [DEBUG] [LOCAL ] GFI: Loaded 53094 existing records from primary storage. [2025-09-17T22:51:54.012605] [DEBUG] [LOCAL ] GFL: Loaded 48221 existing records from primary storage. [2025-09-17T22:51:54.013049] [INFO ] [MAIN ] GFI: Loaded 53094 primary data records. [2025-09-17T22:51:54.013309] [INFO ] [MAIN ] GFL: Loaded 48221 primary data records. [2025-09-17T22:51:54.673119] [DEBUG] [MAIN ] GFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:54.674630] [INFO ] [MAIN ] GFF: Generated 1794 derivative records from 31214 primary records. [2025-09-17T22:51:54.675056] [DEBUG] [LOCAL ] GFF: Saving derivative data. [2025-09-17T22:51:54.698027] [DEBUG] [LOCAL ] GFF: Derivative data saved (1794 records). [2025-09-17T22:51:54.698272] [INFO ] [MAIN ] GFF: Successfully saved derivative data. [2025-09-17T22:51:54.702866] [INFO ] [MAIN ] Derivative Progress: 775/2085 symbols completed. GFF took 1.1s. Estimated remaining: 8m 31s. Rate: 153.7 symbols/min [2025-09-17T22:51:54.703400] [INFO ] [MAIN ] GFR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:54.719922] [DEBUG] [MAIN ] GFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:54.721064] [INFO ] [MAIN ] GFL: Generated 1794 derivative records from 48221 primary records. [2025-09-17T22:51:54.735517] [DEBUG] [LOCAL ] GFL: Saving derivative data. [2025-09-17T22:51:54.737043] [DEBUG] [MAIN ] GFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:54.749512] [INFO ] [MAIN ] GFI: Generated 1794 derivative records from 53094 primary records. [2025-09-17T22:51:54.753519] [DEBUG] [LOCAL ] GFI: Saving derivative data. [2025-09-17T22:51:54.754260] [DEBUG] [LOCAL ] GFR: Loaded 8558 existing records from primary storage. [2025-09-17T22:51:54.756609] [INFO ] [MAIN ] GFR: Loaded 8558 primary data records. [2025-09-17T22:51:54.805968] [DEBUG] [LOCAL ] GFL: Derivative data saved (1794 records). [2025-09-17T22:51:54.806154] [INFO ] [MAIN ] GFL: Successfully saved derivative data. [2025-09-17T22:51:54.810086] [INFO ] [MAIN ] Derivative Progress: 776/2085 symbols completed. GFL took 1.2s. Estimated remaining: 8m 30s. Rate: 153.9 symbols/min [2025-09-17T22:51:54.828248] [INFO ] [MAIN ] GGB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:54.883288] [DEBUG] [LOCAL ] GFI: Derivative data saved (1794 records). [2025-09-17T22:51:54.894763] [INFO ] [MAIN ] GFI: Successfully saved derivative data. [2025-09-17T22:51:54.913139] [INFO ] [MAIN ] Derivative Progress: 777/2085 symbols completed. GFI took 1.3s. Estimated remaining: 8m 30s. Rate: 154.0 symbols/min [2025-09-17T22:51:54.913469] [INFO ] [MAIN ] GGG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:55.124617] [DEBUG] [LOCAL ] GGB: Loaded 50997 existing records from primary storage. [2025-09-17T22:51:55.125092] [INFO ] [MAIN ] GGB: Loaded 50997 primary data records. [2025-09-17T22:51:55.281734] [DEBUG] [LOCAL ] GGG: Loaded 41146 existing records from primary storage. [2025-09-17T22:51:55.292154] [INFO ] [MAIN ] GGG: Loaded 41146 primary data records. [2025-09-17T22:51:55.414969] [DEBUG] [MAIN ] GFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:55.436509] [INFO ] [MAIN ] GFR: Generated 1794 derivative records from 8558 primary records. [2025-09-17T22:51:55.552900] [DEBUG] [LOCAL ] GFR: Saving derivative data. [2025-09-17T22:51:55.838858] [DEBUG] [LOCAL ] GFR: Derivative data saved (1794 records). [2025-09-17T22:51:55.839227] [INFO ] [MAIN ] GFR: Successfully saved derivative data. [2025-09-17T22:51:55.841504] [INFO ] [MAIN ] Derivative Progress: 778/2085 symbols completed. GFR took 1.1s. Estimated remaining: 8m 30s. Rate: 153.7 symbols/min [2025-09-17T22:51:55.864062] [DEBUG] [MAIN ] GGB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:55.865031] [INFO ] [MAIN ] GGB: Generated 1794 derivative records from 50997 primary records. [2025-09-17T22:51:55.865123] [DEBUG] [LOCAL ] GGB: Saving derivative data. [2025-09-17T22:51:55.881299] [DEBUG] [LOCAL ] GGB: Derivative data saved (1794 records). [2025-09-17T22:51:55.882936] [INFO ] [MAIN ] GGB: Successfully saved derivative data. [2025-09-17T22:51:55.885989] [INFO ] [MAIN ] Derivative Progress: 779/2085 symbols completed. GGB took 1.1s. Estimated remaining: 8m 29s. Rate: 153.9 symbols/min [2025-09-17T22:51:55.898576] [DEBUG] [MAIN ] GGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:55.899206] [INFO ] [MAIN ] GGG: Generated 1794 derivative records from 41146 primary records. [2025-09-17T22:51:55.899268] [DEBUG] [LOCAL ] GGG: Saving derivative data. [2025-09-17T22:51:55.914299] [DEBUG] [LOCAL ] GGG: Derivative data saved (1794 records). [2025-09-17T22:51:55.914358] [INFO ] [MAIN ] GGG: Successfully saved derivative data. [2025-09-17T22:51:55.917292] [INFO ] [MAIN ] Derivative Progress: 780/2085 symbols completed. GGG took 1.0s. Estimated remaining: 8m 28s. Rate: 154.1 symbols/min [2025-09-17T22:51:55.917910] [INFO ] [MAIN ] GGT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:55.917953] [INFO ] [MAIN ] GGZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:55.917846] [INFO ] [MAIN ] GHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:55.925778] [DEBUG] [LOCAL ] GHC: Loaded 2583 existing records from primary storage. [2025-09-17T22:51:55.925609] [DEBUG] [LOCAL ] GGZ: Loaded 2481 existing records from primary storage. [2025-09-17T22:51:55.925917] [INFO ] [MAIN ] GGZ: Loaded 2481 primary data records. [2025-09-17T22:51:55.956877] [INFO ] [MAIN ] GHC: Loaded 2583 primary data records. [2025-09-17T22:51:56.075884] [DEBUG] [LOCAL ] GGT: Loaded 14143 existing records from primary storage. [2025-09-17T22:51:56.086351] [INFO ] [MAIN ] GGT: Loaded 14143 primary data records. [2025-09-17T22:51:56.857558] [DEBUG] [MAIN ] GGZ: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:51:56.870583] [INFO ] [MAIN ] GGZ: Generated 1793 derivative records from 2481 primary records. [2025-09-17T22:51:56.870795] [DEBUG] [LOCAL ] GGZ: Saving derivative data. [2025-09-17T22:51:56.871300] [DEBUG] [MAIN ] GHC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:51:56.872449] [INFO ] [MAIN ] GHC: Generated 1793 derivative records from 2583 primary records. [2025-09-17T22:51:56.879870] [DEBUG] [LOCAL ] GHC: Saving derivative data. [2025-09-17T22:51:56.888946] [DEBUG] [LOCAL ] GGZ: Derivative data saved (1793 records). [2025-09-17T22:51:56.902427] [INFO ] [MAIN ] GGZ: Successfully saved derivative data. [2025-09-17T22:51:56.909519] [INFO ] [MAIN ] Derivative Progress: 781/2085 symbols completed. GGZ took 1.0s. Estimated remaining: 8m 29s. Rate: 153.8 symbols/min [2025-09-17T22:51:56.913767] [DEBUG] [MAIN ] GGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:56.913880] [INFO ] [MAIN ] GHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:56.914902] [INFO ] [MAIN ] GGT: Generated 1794 derivative records from 14143 primary records. [2025-09-17T22:51:56.915688] [DEBUG] [LOCAL ] GGT: Saving derivative data. [2025-09-17T22:51:56.933982] [DEBUG] [LOCAL ] GHC: Derivative data saved (1793 records). [2025-09-17T22:51:56.934839] [DEBUG] [LOCAL ] GGT: Derivative data saved (1794 records). [2025-09-17T22:51:56.937436] [DEBUG] [LOCAL ] GHG: Loaded 3138 existing records from primary storage. [2025-09-17T22:51:56.935102] [INFO ] [MAIN ] GHC: Successfully saved derivative data. [2025-09-17T22:51:56.937491] [INFO ] [MAIN ] GGT: Successfully saved derivative data. [2025-09-17T22:51:56.939927] [INFO ] [MAIN ] Derivative Progress: 782/2085 symbols completed. GHC took 1.0s. Estimated remaining: 8m 28s. Rate: 154.0 symbols/min [2025-09-17T22:51:56.942586] [INFO ] [MAIN ] GHG: Loaded 3138 primary data records. [2025-09-17T22:51:56.942811] [INFO ] [MAIN ] GHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:56.948198] [INFO ] [MAIN ] Derivative Progress: 783/2085 symbols completed. GGT took 1.0s. Estimated remaining: 8m 27s. Rate: 154.2 symbols/min [2025-09-17T22:51:56.982884] [INFO ] [MAIN ] GHLD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:57.099446] [DEBUG] [LOCAL ] GHI: Loaded 6993 existing records from primary storage. [2025-09-17T22:51:57.115688] [INFO ] [MAIN ] GHI: Loaded 6993 primary data records. [2025-09-17T22:51:57.099639] [DEBUG] [LOCAL ] GHLD: Loaded 4031 existing records from primary storage. [2025-09-17T22:51:57.132700] [INFO ] [MAIN ] GHLD: Loaded 4031 primary data records. [2025-09-17T22:51:57.925727] [DEBUG] [MAIN ] GHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:57.926603] [INFO ] [MAIN ] GHG: Generated 1794 derivative records from 3138 primary records. [2025-09-17T22:51:57.926820] [DEBUG] [LOCAL ] GHG: Saving derivative data. [2025-09-17T22:51:57.942726] [DEBUG] [LOCAL ] GHG: Derivative data saved (1794 records). [2025-09-17T22:51:57.943046] [INFO ] [MAIN ] GHG: Successfully saved derivative data. [2025-09-17T22:51:57.945608] [INFO ] [MAIN ] Derivative Progress: 784/2085 symbols completed. GHG took 1.0s. Estimated remaining: 8m 27s. Rate: 153.9 symbols/min [2025-09-17T22:51:57.946150] [INFO ] [MAIN ] GHM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:57.971928] [DEBUG] [MAIN ] GHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:57.973040] [INFO ] [MAIN ] GHI: Generated 1794 derivative records from 6993 primary records. [2025-09-17T22:51:57.973290] [DEBUG] [LOCAL ] GHI: Saving derivative data. [2025-09-17T22:51:58.002710] [DEBUG] [LOCAL ] GHM: Loaded 14280 existing records from primary storage. [2025-09-17T22:51:58.002837] [INFO ] [MAIN ] GHM: Loaded 14280 primary data records. [2025-09-17T22:51:57.993877] [DEBUG] [MAIN ] GHLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:58.003897] [INFO ] [MAIN ] GHLD: Generated 1794 derivative records from 4031 primary records. [2025-09-17T22:51:58.036752] [DEBUG] [LOCAL ] GHLD: Saving derivative data. [2025-09-17T22:51:58.064276] [DEBUG] [LOCAL ] GHI: Derivative data saved (1794 records). [2025-09-17T22:51:58.085168] [INFO ] [MAIN ] GHI: Successfully saved derivative data. [2025-09-17T22:51:58.098214] [INFO ] [MAIN ] Derivative Progress: 785/2085 symbols completed. GHI took 1.2s. Estimated remaining: 8m 27s. Rate: 154.0 symbols/min [2025-09-17T22:51:58.116585] [INFO ] [MAIN ] GHY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:58.130048] [DEBUG] [LOCAL ] GHLD: Derivative data saved (1794 records). [2025-09-17T22:51:58.130797] [INFO ] [MAIN ] GHLD: Successfully saved derivative data. [2025-09-17T22:51:58.149793] [INFO ] [MAIN ] Derivative Progress: 786/2085 symbols completed. GHLD took 1.2s. Estimated remaining: 8m 26s. Rate: 154.2 symbols/min [2025-09-17T22:51:58.173204] [INFO ] [MAIN ] GIB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:58.340073] [DEBUG] [LOCAL ] GHY: Loaded 21197 existing records from primary storage. [2025-09-17T22:51:58.341078] [INFO ] [MAIN ] GHY: Loaded 21197 primary data records. [2025-09-17T22:51:58.646604] [DEBUG] [LOCAL ] GIB: Loaded 32454 existing records from primary storage. [2025-09-17T22:51:58.660398] [INFO ] [MAIN ] GIB: Loaded 32454 primary data records. [2025-09-17T22:51:58.979155] [DEBUG] [MAIN ] GHM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:58.980085] [INFO ] [MAIN ] GHM: Generated 1794 derivative records from 14280 primary records. [2025-09-17T22:51:58.980427] [DEBUG] [LOCAL ] GHM: Saving derivative data. [2025-09-17T22:51:58.999018] [DEBUG] [LOCAL ] GHM: Derivative data saved (1794 records). [2025-09-17T22:51:58.999412] [INFO ] [MAIN ] GHM: Successfully saved derivative data. [2025-09-17T22:51:59.002997] [INFO ] [MAIN ] Derivative Progress: 787/2085 symbols completed. GHM took 1.1s. Estimated remaining: 8m 26s. Rate: 153.9 symbols/min [2025-09-17T22:51:59.004881] [INFO ] [MAIN ] GIC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:59.018787] [DEBUG] [MAIN ] GHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:59.019688] [INFO ] [MAIN ] GHY: Generated 1794 derivative records from 21197 primary records. [2025-09-17T22:51:59.020626] [DEBUG] [LOCAL ] GHY: Saving derivative data. [2025-09-17T22:51:59.045832] [DEBUG] [LOCAL ] GIC: Loaded 13876 existing records from primary storage. [2025-09-17T22:51:59.046490] [INFO ] [MAIN ] GIC: Loaded 13876 primary data records. [2025-09-17T22:51:59.048002] [DEBUG] [LOCAL ] GHY: Derivative data saved (1794 records). [2025-09-17T22:51:59.079047] [INFO ] [MAIN ] GHY: Successfully saved derivative data. [2025-09-17T22:51:59.081940] [INFO ] [MAIN ] Derivative Progress: 788/2085 symbols completed. GHY took 1.0s. Estimated remaining: 8m 25s. Rate: 154.1 symbols/min [2025-09-17T22:51:59.093309] [INFO ] [MAIN ] GIL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:59.173440] [DEBUG] [MAIN ] GIB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:59.185283] [INFO ] [MAIN ] GIB: Generated 1794 derivative records from 32454 primary records. [2025-09-17T22:51:59.195622] [DEBUG] [LOCAL ] GIB: Saving derivative data. [2025-09-17T22:51:59.440870] [DEBUG] [LOCAL ] GIB: Derivative data saved (1794 records). [2025-09-17T22:51:59.441166] [INFO ] [MAIN ] GIB: Successfully saved derivative data. [2025-09-17T22:51:59.443931] [INFO ] [MAIN ] Derivative Progress: 789/2085 symbols completed. GIB took 1.3s. Estimated remaining: 8m 25s. Rate: 154.1 symbols/min [2025-09-17T22:51:59.445088] [INFO ] [MAIN ] GIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:51:59.479074] [DEBUG] [LOCAL ] GIL: Loaded 43027 existing records from primary storage. [2025-09-17T22:51:59.479504] [INFO ] [MAIN ] GIL: Loaded 43027 primary data records. [2025-09-17T22:51:59.633309] [DEBUG] [MAIN ] GIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:51:59.645851] [INFO ] [MAIN ] GIC: Generated 1794 derivative records from 13876 primary records. [2025-09-17T22:51:59.646059] [DEBUG] [LOCAL ] GIC: Saving derivative data. [2025-09-17T22:51:59.855009] [DEBUG] [LOCAL ] GIS: Loaded 53674 existing records from primary storage. [2025-09-17T22:51:59.856295] [DEBUG] [LOCAL ] GIC: Derivative data saved (1794 records). [2025-09-17T22:51:59.856207] [INFO ] [MAIN ] GIS: Loaded 53674 primary data records. [2025-09-17T22:51:59.856629] [INFO ] [MAIN ] GIC: Successfully saved derivative data. [2025-09-17T22:51:59.871103] [INFO ] [MAIN ] Derivative Progress: 790/2085 symbols completed. GIC took 0.9s. Estimated remaining: 8m 24s. Rate: 154.1 symbols/min [2025-09-17T22:51:59.916254] [INFO ] [MAIN ] GKOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:00.204431] [DEBUG] [MAIN ] GIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:00.219334] [DEBUG] [LOCAL ] GKOS: Loaded 43146 existing records from primary storage. [2025-09-17T22:52:00.217704] [INFO ] [MAIN ] GIL: Generated 1794 derivative records from 43027 primary records. [2025-09-17T22:52:00.219687] [INFO ] [MAIN ] GKOS: Loaded 43146 primary data records. [2025-09-17T22:52:00.220102] [DEBUG] [LOCAL ] GIL: Saving derivative data. [2025-09-17T22:52:00.357976] [DEBUG] [LOCAL ] GIL: Derivative data saved (1794 records). [2025-09-17T22:52:00.369366] [DEBUG] [MAIN ] GIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:00.370289] [INFO ] [MAIN ] GIS: Generated 1794 derivative records from 53674 primary records. [2025-09-17T22:52:00.380685] [INFO ] [MAIN ] GIL: Successfully saved derivative data. [2025-09-17T22:52:00.388533] [INFO ] [MAIN ] Derivative Progress: 791/2085 symbols completed. GIL took 1.3s. Estimated remaining: 8m 24s. Rate: 154.0 symbols/min [2025-09-17T22:52:00.388676] [DEBUG] [LOCAL ] GIS: Saving derivative data. [2025-09-17T22:52:00.389458] [INFO ] [MAIN ] GL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:00.587791] [DEBUG] [LOCAL ] GIS: Derivative data saved (1794 records). [2025-09-17T22:52:00.588020] [INFO ] [MAIN ] GIS: Successfully saved derivative data. [2025-09-17T22:52:00.590762] [INFO ] [MAIN ] Derivative Progress: 792/2085 symbols completed. GIS took 1.1s. Estimated remaining: 8m 23s. Rate: 154.1 symbols/min [2025-09-17T22:52:00.591626] [INFO ] [MAIN ] GLOB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:00.620761] [DEBUG] [LOCAL ] GL: Loaded 38287 existing records from primary storage. [2025-09-17T22:52:00.621899] [INFO ] [MAIN ] GL: Loaded 38287 primary data records. [2025-09-17T22:52:00.726848] [DEBUG] [MAIN ] GKOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:00.755824] [INFO ] [MAIN ] GKOS: Generated 1794 derivative records from 43146 primary records. [2025-09-17T22:52:00.756103] [DEBUG] [LOCAL ] GKOS: Saving derivative data. [2025-09-17T22:52:00.990226] [DEBUG] [LOCAL ] GKOS: Derivative data saved (1794 records). [2025-09-17T22:52:00.991458] [DEBUG] [LOCAL ] GLOB: Loaded 47160 existing records from primary storage. [2025-09-17T22:52:00.991622] [INFO ] [MAIN ] GLOB: Loaded 47160 primary data records. [2025-09-17T22:52:01.003282] [INFO ] [MAIN ] GKOS: Successfully saved derivative data. [2025-09-17T22:52:01.016693] [INFO ] [MAIN ] Derivative Progress: 793/2085 symbols completed. GKOS took 1.1s. Estimated remaining: 8m 23s. Rate: 154.1 symbols/min [2025-09-17T22:52:01.319240] [DEBUG] [MAIN ] GL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:01.320379] [INFO ] [MAIN ] GL: Generated 1794 derivative records from 38287 primary records. [2025-09-17T22:52:01.320491] [DEBUG] [LOCAL ] GL: Saving derivative data. [2025-09-17T22:52:01.339802] [DEBUG] [LOCAL ] GL: Derivative data saved (1794 records). [2025-09-17T22:52:01.339919] [INFO ] [MAIN ] GL: Successfully saved derivative data. [2025-09-17T22:52:01.343209] [INFO ] [MAIN ] Derivative Progress: 794/2085 symbols completed. GL took 1.0s. Estimated remaining: 8m 23s. Rate: 154.1 symbols/min [2025-09-17T22:52:01.361130] [DEBUG] [MAIN ] GLOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:01.361709] [INFO ] [MAIN ] GLOB: Generated 1794 derivative records from 47160 primary records. [2025-09-17T22:52:01.361771] [DEBUG] [LOCAL ] GLOB: Saving derivative data. [2025-09-17T22:52:01.377485] [DEBUG] [LOCAL ] GLOB: Derivative data saved (1794 records). [2025-09-17T22:52:01.377546] [INFO ] [MAIN ] GLOB: Successfully saved derivative data. [2025-09-17T22:52:01.379778] [INFO ] [MAIN ] Derivative Progress: 795/2085 symbols completed. GLOB took 0.8s. Estimated remaining: 8m 22s. Rate: 154.3 symbols/min [2025-09-17T22:52:01.380637] [INFO ] [MAIN ] GLW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:01.380802] [INFO ] [MAIN ] GM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:01.381163] [INFO ] [MAIN ] GLP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:01.395392] [DEBUG] [LOCAL ] GLP: Loaded 9580 existing records from primary storage. [2025-09-17T22:52:01.395519] [INFO ] [MAIN ] GLP: Loaded 9580 primary data records. [2025-09-17T22:52:01.788486] [DEBUG] [LOCAL ] GLW: Loaded 53635 existing records from primary storage. [2025-09-17T22:52:01.786897] [DEBUG] [LOCAL ] GM: Loaded 53728 existing records from primary storage. [2025-09-17T22:52:01.789093] [INFO ] [MAIN ] GLW: Loaded 53635 primary data records. [2025-09-17T22:52:01.810444] [INFO ] [MAIN ] GM: Loaded 53728 primary data records. [2025-09-17T22:52:02.437672] [DEBUG] [MAIN ] GLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:02.439625] [INFO ] [MAIN ] GLP: Generated 1794 derivative records from 9580 primary records. [2025-09-17T22:52:02.439858] [DEBUG] [LOCAL ] GLP: Saving derivative data. [2025-09-17T22:52:02.457774] [DEBUG] [LOCAL ] GLP: Derivative data saved (1794 records). [2025-09-17T22:52:02.458474] [INFO ] [MAIN ] GLP: Successfully saved derivative data. [2025-09-17T22:52:02.461804] [INFO ] [MAIN ] Derivative Progress: 796/2085 symbols completed. GLP took 1.1s. Estimated remaining: 8m 22s. Rate: 153.9 symbols/min [2025-09-17T22:52:02.462159] [INFO ] [MAIN ] GME: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:02.486087] [DEBUG] [MAIN ] GLW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:02.487440] [INFO ] [MAIN ] GLW: Generated 1794 derivative records from 53635 primary records. [2025-09-17T22:52:02.487609] [DEBUG] [LOCAL ] GLW: Saving derivative data. [2025-09-17T22:52:02.518505] [DEBUG] [MAIN ] GM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:02.521013] [INFO ] [MAIN ] GM: Generated 1794 derivative records from 53728 primary records. [2025-09-17T22:52:02.521463] [DEBUG] [LOCAL ] GLW: Derivative data saved (1794 records). [2025-09-17T22:52:02.521598] [DEBUG] [LOCAL ] GM: Saving derivative data. [2025-09-17T22:52:02.535458] [INFO ] [MAIN ] GLW: Successfully saved derivative data. [2025-09-17T22:52:02.537470] [INFO ] [MAIN ] Derivative Progress: 797/2085 symbols completed. GLW took 1.2s. Estimated remaining: 8m 21s. Rate: 154.1 symbols/min [2025-09-17T22:52:02.538315] [INFO ] [MAIN ] GMED: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:02.556620] [DEBUG] [LOCAL ] GM: Derivative data saved (1794 records). [2025-09-17T22:52:02.556982] [INFO ] [MAIN ] GM: Successfully saved derivative data. [2025-09-17T22:52:02.559744] [INFO ] [MAIN ] Derivative Progress: 798/2085 symbols completed. GM took 1.2s. Estimated remaining: 8m 21s. Rate: 154.3 symbols/min [2025-09-17T22:52:02.575090] [INFO ] [MAIN ] GMRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:02.576340] [DEBUG] [LOCAL ] GME: Loaded 53761 existing records from primary storage. [2025-09-17T22:52:02.576484] [INFO ] [MAIN ] GME: Loaded 53761 primary data records. [2025-09-17T22:52:02.926385] [DEBUG] [LOCAL ] GMED: Loaded 48260 existing records from primary storage. [2025-09-17T22:52:02.926779] [INFO ] [MAIN ] GMED: Loaded 48260 primary data records. [2025-09-17T22:52:02.927463] [DEBUG] [LOCAL ] GMRE: Loaded 37641 existing records from primary storage. [2025-09-17T22:52:02.951208] [INFO ] [MAIN ] GMRE: Loaded 37641 primary data records. [2025-09-17T22:52:03.835531] [DEBUG] [MAIN ] GME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:03.837231] [INFO ] [MAIN ] GME: Generated 1794 derivative records from 53761 primary records. [2025-09-17T22:52:03.837678] [DEBUG] [LOCAL ] GME: Saving derivative data. [2025-09-17T22:52:03.872427] [DEBUG] [LOCAL ] GME: Derivative data saved (1794 records). [2025-09-17T22:52:03.873433] [INFO ] [MAIN ] GME: Successfully saved derivative data. [2025-09-17T22:52:03.878705] [INFO ] [MAIN ] Derivative Progress: 799/2085 symbols completed. GME took 1.4s. Estimated remaining: 8m 22s. Rate: 153.8 symbols/min [2025-09-17T22:52:03.879815] [INFO ] [MAIN ] GNE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:03.917528] [DEBUG] [MAIN ] GMED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:03.920411] [INFO ] [MAIN ] GMED: Generated 1794 derivative records from 48260 primary records. [2025-09-17T22:52:03.920755] [DEBUG] [LOCAL ] GMED: Saving derivative data. [2025-09-17T22:52:03.949897] [DEBUG] [MAIN ] GMRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:03.958453] [DEBUG] [LOCAL ] GNE: Loaded 17363 existing records from primary storage. [2025-09-17T22:52:03.959000] [INFO ] [MAIN ] GNE: Loaded 17363 primary data records. [2025-09-17T22:52:03.957190] [INFO ] [MAIN ] GMRE: Generated 1794 derivative records from 37641 primary records. [2025-09-17T22:52:03.964906] [DEBUG] [LOCAL ] GMED: Derivative data saved (1794 records). [2025-09-17T22:52:03.970257] [INFO ] [MAIN ] GMED: Successfully saved derivative data. [2025-09-17T22:52:03.964996] [DEBUG] [LOCAL ] GMRE: Saving derivative data. [2025-09-17T22:52:03.995417] [INFO ] [MAIN ] Derivative Progress: 800/2085 symbols completed. GMED took 1.5s. Estimated remaining: 8m 21s. Rate: 154.0 symbols/min [2025-09-17T22:52:04.009144] [INFO ] [MAIN ] GNK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:04.140375] [DEBUG] [LOCAL ] GMRE: Derivative data saved (1794 records). [2025-09-17T22:52:04.140737] [INFO ] [MAIN ] GMRE: Successfully saved derivative data. [2025-09-17T22:52:04.144111] [INFO ] [MAIN ] Derivative Progress: 801/2085 symbols completed. GMRE took 1.6s. Estimated remaining: 8m 20s. Rate: 154.1 symbols/min [2025-09-17T22:52:04.160482] [INFO ] [MAIN ] GNL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:04.379923] [DEBUG] [LOCAL ] GNK: Loaded 40939 existing records from primary storage. [2025-09-17T22:52:04.380737] [INFO ] [MAIN ] GNK: Loaded 40939 primary data records. [2025-09-17T22:52:04.519205] [DEBUG] [LOCAL ] GNL: Loaded 47570 existing records from primary storage. [2025-09-17T22:52:04.530356] [INFO ] [MAIN ] GNL: Loaded 47570 primary data records. [2025-09-17T22:52:04.926988] [DEBUG] [MAIN ] GNE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:04.928109] [INFO ] [MAIN ] GNE: Generated 1794 derivative records from 17363 primary records. [2025-09-17T22:52:04.928602] [DEBUG] [LOCAL ] GNE: Saving derivative data. [2025-09-17T22:52:05.062134] [DEBUG] [LOCAL ] GNE: Derivative data saved (1794 records). [2025-09-17T22:52:05.062585] [INFO ] [MAIN ] GNE: Successfully saved derivative data. [2025-09-17T22:52:05.064818] [INFO ] [MAIN ] Derivative Progress: 802/2085 symbols completed. GNE took 1.2s. Estimated remaining: 8m 20s. Rate: 153.8 symbols/min [2025-09-17T22:52:05.065344] [INFO ] [MAIN ] GNRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:05.086404] [DEBUG] [MAIN ] GNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:05.087204] [INFO ] [MAIN ] GNK: Generated 1794 derivative records from 40939 primary records. [2025-09-17T22:52:05.087370] [DEBUG] [LOCAL ] GNK: Saving derivative data. [2025-09-17T22:52:05.131777] [DEBUG] [MAIN ] GNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:05.132427] [DEBUG] [LOCAL ] GNK: Derivative data saved (1794 records). [2025-09-17T22:52:05.132706] [INFO ] [MAIN ] GNK: Successfully saved derivative data. [2025-09-17T22:52:05.133607] [INFO ] [MAIN ] GNL: Generated 1794 derivative records from 47570 primary records. [2025-09-17T22:52:05.136275] [INFO ] [MAIN ] Derivative Progress: 803/2085 symbols completed. GNK took 1.1s. Estimated remaining: 8m 20s. Rate: 154.0 symbols/min [2025-09-17T22:52:05.136482] [DEBUG] [LOCAL ] GNL: Saving derivative data. [2025-09-17T22:52:05.136730] [INFO ] [MAIN ] GNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:05.178276] [DEBUG] [LOCAL ] GNT: Loaded 7821 existing records from primary storage. [2025-09-17T22:52:05.180509] [DEBUG] [LOCAL ] GNRC: Loaded 45119 existing records from primary storage. [2025-09-17T22:52:05.180627] [INFO ] [MAIN ] GNRC: Loaded 45119 primary data records. [2025-09-17T22:52:05.180760] [INFO ] [MAIN ] GNT: Loaded 7821 primary data records. [2025-09-17T22:52:05.186712] [DEBUG] [LOCAL ] GNL: Derivative data saved (1794 records). [2025-09-17T22:52:05.193124] [INFO ] [MAIN ] GNL: Successfully saved derivative data. [2025-09-17T22:52:05.237071] [INFO ] [MAIN ] Derivative Progress: 804/2085 symbols completed. GNL took 1.1s. Estimated remaining: 8m 19s. Rate: 154.1 symbols/min [2025-09-17T22:52:05.283828] [INFO ] [MAIN ] GNTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:05.472407] [DEBUG] [LOCAL ] GNTY: Loaded 6954 existing records from primary storage. [2025-09-17T22:52:05.523113] [INFO ] [MAIN ] GNTY: Loaded 6954 primary data records. [2025-09-17T22:52:06.183142] [DEBUG] [MAIN ] GNRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:06.184314] [INFO ] [MAIN ] GNRC: Generated 1794 derivative records from 45119 primary records. [2025-09-17T22:52:06.184410] [DEBUG] [LOCAL ] GNRC: Saving derivative data. [2025-09-17T22:52:06.210210] [DEBUG] [MAIN ] GNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:06.214337] [INFO ] [MAIN ] GNT: Generated 1794 derivative records from 7821 primary records. [2025-09-17T22:52:06.214722] [DEBUG] [LOCAL ] GNT: Saving derivative data. [2025-09-17T22:52:06.217801] [DEBUG] [LOCAL ] GNRC: Derivative data saved (1794 records). [2025-09-17T22:52:06.218017] [INFO ] [MAIN ] GNRC: Successfully saved derivative data. [2025-09-17T22:52:06.230706] [INFO ] [MAIN ] Derivative Progress: 805/2085 symbols completed. GNRC took 1.2s. Estimated remaining: 8m 19s. Rate: 153.8 symbols/min [2025-09-17T22:52:06.234601] [INFO ] [MAIN ] GNW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:06.236146] [DEBUG] [LOCAL ] GNT: Derivative data saved (1794 records). [2025-09-17T22:52:06.237757] [INFO ] [MAIN ] GNT: Successfully saved derivative data. [2025-09-17T22:52:06.240454] [INFO ] [MAIN ] Derivative Progress: 806/2085 symbols completed. GNT took 1.1s. Estimated remaining: 8m 18s. Rate: 154.0 symbols/min [2025-09-17T22:52:06.241245] [INFO ] [MAIN ] GOF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:06.255242] [DEBUG] [MAIN ] GNTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:06.256261] [INFO ] [MAIN ] GNTY: Generated 1794 derivative records from 6954 primary records. [2025-09-17T22:52:06.256372] [DEBUG] [LOCAL ] GNTY: Saving derivative data. [2025-09-17T22:52:06.272460] [DEBUG] [LOCAL ] GNTY: Derivative data saved (1794 records). [2025-09-17T22:52:06.272536] [INFO ] [MAIN ] GNTY: Successfully saved derivative data. [2025-09-17T22:52:06.275465] [INFO ] [MAIN ] Derivative Progress: 807/2085 symbols completed. GNTY took 1.0s. Estimated remaining: 8m 17s. Rate: 154.2 symbols/min [2025-09-17T22:52:06.275802] [INFO ] [MAIN ] GOLF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:06.337595] [DEBUG] [LOCAL ] GOF: Loaded 43087 existing records from primary storage. [2025-09-17T22:52:06.352962] [INFO ] [MAIN ] GOF: Loaded 43087 primary data records. [2025-09-17T22:52:06.365075] [DEBUG] [LOCAL ] GNW: Loaded 51331 existing records from primary storage. [2025-09-17T22:52:06.365192] [INFO ] [MAIN ] GNW: Loaded 51331 primary data records. [2025-09-17T22:52:06.515467] [DEBUG] [LOCAL ] GOLF: Loaded 32073 existing records from primary storage. [2025-09-17T22:52:06.546020] [INFO ] [MAIN ] GOLF: Loaded 32073 primary data records. [2025-09-17T22:52:07.357374] [DEBUG] [MAIN ] GOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:07.359795] [INFO ] [MAIN ] GOF: Generated 1794 derivative records from 43087 primary records. [2025-09-17T22:52:07.359907] [DEBUG] [LOCAL ] GOF: Saving derivative data. [2025-09-17T22:52:07.386397] [DEBUG] [MAIN ] GNW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:07.387713] [INFO ] [MAIN ] GNW: Generated 1794 derivative records from 51331 primary records. [2025-09-17T22:52:07.388429] [DEBUG] [LOCAL ] GNW: Saving derivative data. [2025-09-17T22:52:07.420359] [DEBUG] [MAIN ] GOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:07.420452] [DEBUG] [LOCAL ] GOF: Derivative data saved (1794 records). [2025-09-17T22:52:07.421749] [INFO ] [MAIN ] GOLF: Generated 1794 derivative records from 32073 primary records. [2025-09-17T22:52:07.421853] [DEBUG] [LOCAL ] GOLF: Saving derivative data. [2025-09-17T22:52:07.421937] [INFO ] [MAIN ] GOF: Successfully saved derivative data. [2025-09-17T22:52:07.425157] [INFO ] [MAIN ] Derivative Progress: 808/2085 symbols completed. GOF took 1.2s. Estimated remaining: 8m 18s. Rate: 153.8 symbols/min [2025-09-17T22:52:07.440991] [DEBUG] [LOCAL ] GNW: Derivative data saved (1794 records). [2025-09-17T22:52:07.441761] [DEBUG] [LOCAL ] GOLF: Derivative data saved (1794 records). [2025-09-17T22:52:07.441844] [INFO ] [MAIN ] GNW: Successfully saved derivative data. [2025-09-17T22:52:07.445123] [INFO ] [MAIN ] Derivative Progress: 809/2085 symbols completed. GNW took 1.2s. Estimated remaining: 8m 17s. Rate: 154.0 symbols/min [2025-09-17T22:52:07.445236] [INFO ] [MAIN ] GOLF: Successfully saved derivative data. [2025-09-17T22:52:07.448025] [INFO ] [MAIN ] Derivative Progress: 810/2085 symbols completed. GOLF took 1.2s. Estimated remaining: 8m 16s. Rate: 154.2 symbols/min [2025-09-17T22:52:07.448626] [INFO ] [MAIN ] GPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:07.448842] [INFO ] [MAIN ] GOOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:07.448505] [INFO ] [MAIN ] GOTU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:07.509699] [DEBUG] [LOCAL ] GOTU: Loaded 39534 existing records from primary storage. [2025-09-17T22:52:07.510368] [INFO ] [MAIN ] GOTU: Loaded 39534 primary data records. [2025-09-17T22:52:07.586562] [DEBUG] [LOCAL ] GOOS: Loaded 45905 existing records from primary storage. [2025-09-17T22:52:07.627892] [DEBUG] [LOCAL ] GPC: Loaded 46846 existing records from primary storage. [2025-09-17T22:52:07.604524] [INFO ] [MAIN ] GOOS: Loaded 45905 primary data records. [2025-09-17T22:52:07.640384] [INFO ] [MAIN ] GPC: Loaded 46846 primary data records. [2025-09-17T22:52:08.550788] [DEBUG] [MAIN ] GOTU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:08.551845] [INFO ] [MAIN ] GOTU: Generated 1794 derivative records from 39534 primary records. [2025-09-17T22:52:08.552110] [DEBUG] [LOCAL ] GOTU: Saving derivative data. [2025-09-17T22:52:08.600563] [DEBUG] [LOCAL ] GOTU: Derivative data saved (1794 records). [2025-09-17T22:52:08.599887] [DEBUG] [MAIN ] GPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:08.602172] [DEBUG] [MAIN ] GOOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:08.601837] [INFO ] [MAIN ] GPC: Generated 1794 derivative records from 46846 primary records. [2025-09-17T22:52:08.602970] [INFO ] [MAIN ] GOOS: Generated 1794 derivative records from 45905 primary records. [2025-09-17T22:52:08.603132] [DEBUG] [LOCAL ] GPC: Saving derivative data. [2025-09-17T22:52:08.600871] [INFO ] [MAIN ] GOTU: Successfully saved derivative data. [2025-09-17T22:52:08.605855] [INFO ] [MAIN ] Derivative Progress: 811/2085 symbols completed. GOTU took 1.2s. Estimated remaining: 8m 17s. Rate: 153.8 symbols/min [2025-09-17T22:52:08.603619] [DEBUG] [LOCAL ] GOOS: Saving derivative data. [2025-09-17T22:52:08.607704] [INFO ] [MAIN ] GPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:08.637348] [DEBUG] [LOCAL ] GPC: Derivative data saved (1794 records). [2025-09-17T22:52:08.638244] [INFO ] [MAIN ] GPC: Successfully saved derivative data. [2025-09-17T22:52:08.642058] [INFO ] [MAIN ] Derivative Progress: 812/2085 symbols completed. GPC took 1.2s. Estimated remaining: 8m 16s. Rate: 154.0 symbols/min [2025-09-17T22:52:08.642950] [INFO ] [MAIN ] GPJA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:08.644104] [DEBUG] [LOCAL ] GOOS: Derivative data saved (1794 records). [2025-09-17T22:52:08.644765] [INFO ] [MAIN ] GOOS: Successfully saved derivative data. [2025-09-17T22:52:08.647566] [INFO ] [MAIN ] Derivative Progress: 813/2085 symbols completed. GOOS took 1.2s. Estimated remaining: 8m 15s. Rate: 154.2 symbols/min [2025-09-17T22:52:08.648068] [INFO ] [MAIN ] GPK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:08.662236] [DEBUG] [LOCAL ] GPJA: Loaded 4030 existing records from primary storage. [2025-09-17T22:52:08.667688] [INFO ] [MAIN ] GPJA: Loaded 4030 primary data records. [2025-09-17T22:52:08.667611] [DEBUG] [LOCAL ] GPI: Loaded 15189 existing records from primary storage. [2025-09-17T22:52:08.667802] [INFO ] [MAIN ] GPI: Loaded 15189 primary data records. [2025-09-17T22:52:09.364348] [DEBUG] [LOCAL ] GPK: Loaded 52677 existing records from primary storage. [2025-09-17T22:52:09.365524] [INFO ] [MAIN ] GPK: Loaded 52677 primary data records. [2025-09-17T22:52:09.730319] [DEBUG] [MAIN ] GPJA: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-17T22:52:09.739314] [INFO ] [MAIN ] GPJA: Generated 1792 derivative records from 4030 primary records. [2025-09-17T22:52:09.744083] [DEBUG] [LOCAL ] GPJA: Saving derivative data. [2025-09-17T22:52:09.744757] [DEBUG] [MAIN ] GPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:09.745448] [INFO ] [MAIN ] GPI: Generated 1794 derivative records from 15189 primary records. [2025-09-17T22:52:09.747157] [DEBUG] [LOCAL ] GPI: Saving derivative data. [2025-09-17T22:52:09.774168] [DEBUG] [LOCAL ] GPJA: Derivative data saved (1792 records). [2025-09-17T22:52:09.774581] [INFO ] [MAIN ] GPJA: Successfully saved derivative data. [2025-09-17T22:52:09.778069] [INFO ] [MAIN ] Derivative Progress: 814/2085 symbols completed. GPJA took 1.1s. Estimated remaining: 8m 16s. Rate: 153.8 symbols/min [2025-09-17T22:52:09.779085] [INFO ] [MAIN ] GPMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:09.784822] [DEBUG] [LOCAL ] GPI: Derivative data saved (1794 records). [2025-09-17T22:52:09.786748] [INFO ] [MAIN ] GPI: Successfully saved derivative data. [2025-09-17T22:52:09.788830] [INFO ] [MAIN ] Derivative Progress: 815/2085 symbols completed. GPI took 1.2s. Estimated remaining: 8m 15s. Rate: 154.0 symbols/min [2025-09-17T22:52:09.789078] [INFO ] [MAIN ] GPOR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:09.804080] [DEBUG] [MAIN ] GPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:09.805502] [INFO ] [MAIN ] GPK: Generated 1794 derivative records from 52677 primary records. [2025-09-17T22:52:09.805757] [DEBUG] [LOCAL ] GPK: Saving derivative data. [2025-09-17T22:52:09.834835] [DEBUG] [LOCAL ] GPK: Derivative data saved (1794 records). [2025-09-17T22:52:09.835071] [INFO ] [MAIN ] GPK: Successfully saved derivative data. [2025-09-17T22:52:09.837518] [INFO ] [MAIN ] Derivative Progress: 816/2085 symbols completed. GPK took 1.2s. Estimated remaining: 8m 14s. Rate: 154.1 symbols/min [2025-09-17T22:52:09.837895] [INFO ] [MAIN ] GPRK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:09.856232] [DEBUG] [LOCAL ] GPOR: Loaded 23033 existing records from primary storage. [2025-09-17T22:52:09.855892] [DEBUG] [LOCAL ] GPMT: Loaded 26887 existing records from primary storage. [2025-09-17T22:52:09.856449] [INFO ] [MAIN ] GPMT: Loaded 26887 primary data records. [2025-09-17T22:52:09.856533] [INFO ] [MAIN ] GPOR: Loaded 23033 primary data records. [2025-09-17T22:52:10.201167] [DEBUG] [LOCAL ] GPRK: Loaded 39196 existing records from primary storage. [2025-09-17T22:52:10.389566] [INFO ] [MAIN ] GPRK: Loaded 39196 primary data records. [2025-09-17T22:52:10.911149] [DEBUG] [MAIN ] GPOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:10.912453] [INFO ] [MAIN ] GPOR: Generated 1794 derivative records from 23033 primary records. [2025-09-17T22:52:10.912711] [DEBUG] [LOCAL ] GPOR: Saving derivative data. [2025-09-17T22:52:10.933004] [DEBUG] [MAIN ] GPMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:10.946150] [INFO ] [MAIN ] GPMT: Generated 1794 derivative records from 26887 primary records. [2025-09-17T22:52:10.953313] [DEBUG] [LOCAL ] GPMT: Saving derivative data. [2025-09-17T22:52:10.959395] [DEBUG] [LOCAL ] GPOR: Derivative data saved (1794 records). [2025-09-17T22:52:10.960178] [INFO ] [MAIN ] GPOR: Successfully saved derivative data. [2025-09-17T22:52:10.963398] [INFO ] [MAIN ] Derivative Progress: 817/2085 symbols completed. GPOR took 1.2s. Estimated remaining: 8m 15s. Rate: 153.8 symbols/min [2025-09-17T22:52:10.964076] [INFO ] [MAIN ] GRBK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:10.997705] [DEBUG] [LOCAL ] GPMT: Derivative data saved (1794 records). [2025-09-17T22:52:10.998038] [INFO ] [MAIN ] GPMT: Successfully saved derivative data. [2025-09-17T22:52:10.998362] [DEBUG] [MAIN ] GPRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:11.002045] [INFO ] [MAIN ] GPRK: Generated 1794 derivative records from 39196 primary records. [2025-09-17T22:52:11.001091] [INFO ] [MAIN ] Derivative Progress: 818/2085 symbols completed. GPMT took 1.2s. Estimated remaining: 8m 14s. Rate: 154.0 symbols/min [2025-09-17T22:52:11.002463] [INFO ] [MAIN ] GRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:11.002525] [DEBUG] [LOCAL ] GPRK: Saving derivative data. [2025-09-17T22:52:11.027541] [DEBUG] [LOCAL ] GPRK: Derivative data saved (1794 records). [2025-09-17T22:52:11.029662] [INFO ] [MAIN ] GPRK: Successfully saved derivative data. [2025-09-17T22:52:11.044555] [INFO ] [MAIN ] Derivative Progress: 819/2085 symbols completed. GPRK took 1.2s. Estimated remaining: 8m 13s. Rate: 154.1 symbols/min [2025-09-17T22:52:11.046523] [INFO ] [MAIN ] GRDN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:11.047913] [DEBUG] [LOCAL ] GRBK: Loaded 27273 existing records from primary storage. [2025-09-17T22:52:11.048261] [INFO ] [MAIN ] GRBK: Loaded 27273 primary data records. [2025-09-17T22:52:11.087159] [DEBUG] [LOCAL ] GRC: Loaded 8807 existing records from primary storage. [2025-09-17T22:52:11.109053] [INFO ] [MAIN ] GRC: Loaded 8807 primary data records. [2025-09-17T22:52:11.322219] [DEBUG] [LOCAL ] GRDN: Loaded 19111 existing records from primary storage. [2025-09-17T22:52:11.349799] [INFO ] [MAIN ] GRDN: Loaded 19111 primary data records. [2025-09-17T22:52:12.183848] [DEBUG] [MAIN ] GRBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:12.186302] [INFO ] [MAIN ] GRBK: Generated 1794 derivative records from 27273 primary records. [2025-09-17T22:52:12.187528] [DEBUG] [LOCAL ] GRBK: Saving derivative data. [2025-09-17T22:52:12.217026] [DEBUG] [MAIN ] GRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:12.218590] [DEBUG] [LOCAL ] GRBK: Derivative data saved (1794 records). [2025-09-17T22:52:12.218762] [INFO ] [MAIN ] GRBK: Successfully saved derivative data. [2025-09-17T22:52:12.221926] [INFO ] [MAIN ] Derivative Progress: 820/2085 symbols completed. GRBK took 1.3s. Estimated remaining: 8m 14s. Rate: 153.8 symbols/min [2025-09-17T22:52:12.219695] [INFO ] [MAIN ] GRC: Generated 1794 derivative records from 8807 primary records. [2025-09-17T22:52:12.222096] [DEBUG] [LOCAL ] GRC: Saving derivative data. [2025-09-17T22:52:12.223239] [INFO ] [MAIN ] GRMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:12.242968] [DEBUG] [LOCAL ] GRC: Derivative data saved (1794 records). [2025-09-17T22:52:12.243141] [INFO ] [MAIN ] GRC: Successfully saved derivative data. [2025-09-17T22:52:12.246048] [INFO ] [MAIN ] Derivative Progress: 821/2085 symbols completed. GRC took 1.2s. Estimated remaining: 8m 13s. Rate: 153.9 symbols/min [2025-09-17T22:52:12.253967] [INFO ] [MAIN ] GRND: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:12.259323] [DEBUG] [MAIN ] GRDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:12.260097] [INFO ] [MAIN ] GRDN: Generated 1794 derivative records from 19111 primary records. [2025-09-17T22:52:12.260333] [DEBUG] [LOCAL ] GRDN: Saving derivative data. [2025-09-17T22:52:12.281100] [DEBUG] [LOCAL ] GRDN: Derivative data saved (1794 records). [2025-09-17T22:52:12.281211] [INFO ] [MAIN ] GRDN: Successfully saved derivative data. [2025-09-17T22:52:12.283884] [INFO ] [MAIN ] Derivative Progress: 822/2085 symbols completed. GRDN took 1.2s. Estimated remaining: 8m 12s. Rate: 154.1 symbols/min [2025-09-17T22:52:12.284232] [INFO ] [MAIN ] GRNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:12.314844] [DEBUG] [LOCAL ] GRMN: Loaded 41725 existing records from primary storage. [2025-09-17T22:52:12.315148] [INFO ] [MAIN ] GRMN: Loaded 41725 primary data records. [2025-09-17T22:52:12.500697] [DEBUG] [LOCAL ] GRNT: Loaded 33999 existing records from primary storage. [2025-09-17T22:52:12.556759] [INFO ] [MAIN ] GRNT: Loaded 33999 primary data records. [2025-09-17T22:52:12.589286] [DEBUG] [LOCAL ] GRND: Loaded 50183 existing records from primary storage. [2025-09-17T22:52:12.723911] [INFO ] [MAIN ] GRND: Loaded 50183 primary data records. [2025-09-17T22:52:13.359226] [DEBUG] [MAIN ] GRMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:13.361025] [INFO ] [MAIN ] GRMN: Generated 1794 derivative records from 41725 primary records. [2025-09-17T22:52:13.361534] [DEBUG] [LOCAL ] GRMN: Saving derivative data. [2025-09-17T22:52:13.387835] [DEBUG] [LOCAL ] GRMN: Derivative data saved (1794 records). [2025-09-17T22:52:13.403213] [DEBUG] [MAIN ] GRNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:13.402812] [INFO ] [MAIN ] GRMN: Successfully saved derivative data. [2025-09-17T22:52:13.404168] [INFO ] [MAIN ] GRNT: Generated 1794 derivative records from 33999 primary records. [2025-09-17T22:52:13.404544] [DEBUG] [LOCAL ] GRNT: Saving derivative data. [2025-09-17T22:52:13.419302] [INFO ] [MAIN ] Derivative Progress: 823/2085 symbols completed. GRMN took 1.2s. Estimated remaining: 8m 13s. Rate: 153.7 symbols/min [2025-09-17T22:52:13.420497] [DEBUG] [MAIN ] GRND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:13.421595] [INFO ] [MAIN ] GRND: Generated 1794 derivative records from 50183 primary records. [2025-09-17T22:52:13.421868] [DEBUG] [LOCAL ] GRND: Saving derivative data. [2025-09-17T22:52:13.451725] [DEBUG] [LOCAL ] GRNT: Derivative data saved (1794 records). [2025-09-17T22:52:13.452257] [INFO ] [MAIN ] GRNT: Successfully saved derivative data. [2025-09-17T22:52:13.454943] [INFO ] [MAIN ] Derivative Progress: 824/2085 symbols completed. GRNT took 1.2s. Estimated remaining: 8m 12s. Rate: 153.9 symbols/min [2025-09-17T22:52:13.452336] [DEBUG] [LOCAL ] GRND: Derivative data saved (1794 records). [2025-09-17T22:52:13.455073] [INFO ] [MAIN ] GRND: Successfully saved derivative data. [2025-09-17T22:52:13.457742] [INFO ] [MAIN ] Derivative Progress: 825/2085 symbols completed. GRND took 1.2s. Estimated remaining: 8m 11s. Rate: 154.1 symbols/min [2025-09-17T22:52:13.458261] [INFO ] [MAIN ] GROV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:13.458415] [INFO ] [MAIN ] GS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:13.458527] [INFO ] [MAIN ] GRX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:13.468578] [DEBUG] [LOCAL ] GRX: Loaded 4339 existing records from primary storage. [2025-09-17T22:52:13.468806] [INFO ] [MAIN ] GRX: Loaded 4339 primary data records. [2025-09-17T22:52:13.558108] [DEBUG] [LOCAL ] GROV: Loaded 9217 existing records from primary storage. [2025-09-17T22:52:13.584820] [INFO ] [MAIN ] GROV: Loaded 9217 primary data records. [2025-09-17T22:52:13.969779] [DEBUG] [LOCAL ] GS: Loaded 52186 existing records from primary storage. [2025-09-17T22:52:13.997611] [INFO ] [MAIN ] GS: Loaded 52186 primary data records. [2025-09-17T22:52:14.549440] [DEBUG] [MAIN ] GRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:14.551127] [INFO ] [MAIN ] GRX: Generated 1794 derivative records from 4339 primary records. [2025-09-17T22:52:14.551531] [DEBUG] [LOCAL ] GRX: Saving derivative data. [2025-09-17T22:52:14.582410] [DEBUG] [MAIN ] GROV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:14.584035] [INFO ] [MAIN ] GROV: Generated 1794 derivative records from 9217 primary records. [2025-09-17T22:52:14.584306] [DEBUG] [LOCAL ] GROV: Saving derivative data. [2025-09-17T22:52:14.598119] [DEBUG] [LOCAL ] GRX: Derivative data saved (1794 records). [2025-09-17T22:52:14.598374] [INFO ] [MAIN ] GRX: Successfully saved derivative data. [2025-09-17T22:52:14.601093] [INFO ] [MAIN ] Derivative Progress: 826/2085 symbols completed. GRX took 1.1s. Estimated remaining: 8m 11s. Rate: 153.7 symbols/min [2025-09-17T22:52:14.602355] [INFO ] [MAIN ] GSBD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:14.610678] [DEBUG] [LOCAL ] GROV: Derivative data saved (1794 records). [2025-09-17T22:52:14.610883] [INFO ] [MAIN ] GROV: Successfully saved derivative data. [2025-09-17T22:52:14.613282] [INFO ] [MAIN ] Derivative Progress: 827/2085 symbols completed. GROV took 1.2s. Estimated remaining: 8m 10s. Rate: 153.9 symbols/min [2025-09-17T22:52:14.627115] [DEBUG] [MAIN ] GS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:14.628100] [INFO ] [MAIN ] GS: Generated 1794 derivative records from 52186 primary records. [2025-09-17T22:52:14.628338] [DEBUG] [LOCAL ] GS: Saving derivative data. [2025-09-17T22:52:14.628426] [INFO ] [MAIN ] GSK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:14.649157] [DEBUG] [LOCAL ] GS: Derivative data saved (1794 records). [2025-09-17T22:52:14.649319] [INFO ] [MAIN ] GS: Successfully saved derivative data. [2025-09-17T22:52:14.652247] [INFO ] [MAIN ] Derivative Progress: 828/2085 symbols completed. GS took 1.2s. Estimated remaining: 8m 9s. Rate: 154.1 symbols/min [2025-09-17T22:52:14.662036] [INFO ] [MAIN ] GSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:14.685307] [DEBUG] [LOCAL ] GSBD: Loaded 39249 existing records from primary storage. [2025-09-17T22:52:14.685551] [INFO ] [MAIN ] GSBD: Loaded 39249 primary data records. [2025-09-17T22:52:14.882072] [DEBUG] [LOCAL ] GSL: Loaded 33924 existing records from primary storage. [2025-09-17T22:52:14.930935] [INFO ] [MAIN ] GSL: Loaded 33924 primary data records. [2025-09-17T22:52:15.049028] [DEBUG] [LOCAL ] GSK: Loaded 53504 existing records from primary storage. [2025-09-17T22:52:15.061203] [INFO ] [MAIN ] GSK: Loaded 53504 primary data records. [2025-09-17T22:52:15.719622] [DEBUG] [MAIN ] GSBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:15.720446] [INFO ] [MAIN ] GSBD: Generated 1794 derivative records from 39249 primary records. [2025-09-17T22:52:15.720639] [DEBUG] [LOCAL ] GSBD: Saving derivative data. [2025-09-17T22:52:15.742327] [DEBUG] [LOCAL ] GSBD: Derivative data saved (1794 records). [2025-09-17T22:52:15.742739] [INFO ] [MAIN ] GSBD: Successfully saved derivative data. [2025-09-17T22:52:15.758016] [DEBUG] [MAIN ] GSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:15.757581] [INFO ] [MAIN ] Derivative Progress: 829/2085 symbols completed. GSBD took 1.2s. Estimated remaining: 8m 10s. Rate: 153.7 symbols/min [2025-09-17T22:52:15.760075] [INFO ] [MAIN ] GSL: Generated 1794 derivative records from 33924 primary records. [2025-09-17T22:52:15.762475] [INFO ] [MAIN ] GTES: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:15.762733] [DEBUG] [LOCAL ] GSL: Saving derivative data. [2025-09-17T22:52:15.785579] [DEBUG] [MAIN ] GSK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:15.790298] [INFO ] [MAIN ] GSK: Generated 1794 derivative records from 53504 primary records. [2025-09-17T22:52:15.790729] [DEBUG] [LOCAL ] GSK: Saving derivative data. [2025-09-17T22:52:15.797553] [DEBUG] [LOCAL ] GSL: Derivative data saved (1794 records). [2025-09-17T22:52:15.797999] [INFO ] [MAIN ] GSL: Successfully saved derivative data. [2025-09-17T22:52:15.808244] [INFO ] [MAIN ] Derivative Progress: 830/2085 symbols completed. GSL took 1.1s. Estimated remaining: 8m 9s. Rate: 153.9 symbols/min [2025-09-17T22:52:15.813280] [INFO ] [MAIN ] GTLS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:15.819572] [DEBUG] [LOCAL ] GSK: Derivative data saved (1794 records). [2025-09-17T22:52:15.819735] [INFO ] [MAIN ] GSK: Successfully saved derivative data. [2025-09-17T22:52:15.822616] [INFO ] [MAIN ] Derivative Progress: 831/2085 symbols completed. GSK took 1.2s. Estimated remaining: 8m 8s. Rate: 154.1 symbols/min [2025-09-17T22:52:15.822971] [INFO ] [MAIN ] GTN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:15.876790] [DEBUG] [LOCAL ] GTES: Loaded 50736 existing records from primary storage. [2025-09-17T22:52:15.877084] [INFO ] [MAIN ] GTES: Loaded 50736 primary data records. [2025-09-17T22:52:16.002671] [DEBUG] [LOCAL ] GTLS: Loaded 43187 existing records from primary storage. [2025-09-17T22:52:16.006911] [INFO ] [MAIN ] GTLS: Loaded 43187 primary data records. [2025-09-17T22:52:16.197736] [DEBUG] [LOCAL ] GTN: Loaded 45848 existing records from primary storage. [2025-09-17T22:52:16.330497] [INFO ] [MAIN ] GTN: Loaded 45848 primary data records. [2025-09-17T22:52:16.955736] [DEBUG] [MAIN ] GTES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:16.957705] [INFO ] [MAIN ] GTES: Generated 1794 derivative records from 50736 primary records. [2025-09-17T22:52:16.957995] [DEBUG] [LOCAL ] GTES: Saving derivative data. [2025-09-17T22:52:16.985234] [DEBUG] [MAIN ] GTLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:16.987217] [INFO ] [MAIN ] GTLS: Generated 1794 derivative records from 43187 primary records. [2025-09-17T22:52:16.987575] [DEBUG] [LOCAL ] GTLS: Saving derivative data. [2025-09-17T22:52:16.998820] [DEBUG] [LOCAL ] GTES: Derivative data saved (1794 records). [2025-09-17T22:52:17.006245] [INFO ] [MAIN ] GTES: Successfully saved derivative data. [2025-09-17T22:52:17.008566] [INFO ] [MAIN ] Derivative Progress: 832/2085 symbols completed. GTES took 1.2s. Estimated remaining: 8m 9s. Rate: 153.7 symbols/min [2025-09-17T22:52:17.009944] [INFO ] [MAIN ] GTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:17.010925] [DEBUG] [LOCAL ] GTLS: Derivative data saved (1794 records). [2025-09-17T22:52:17.011512] [INFO ] [MAIN ] GTLS: Successfully saved derivative data. [2025-09-17T22:52:17.014699] [INFO ] [MAIN ] Derivative Progress: 833/2085 symbols completed. GTLS took 1.2s. Estimated remaining: 8m 8s. Rate: 153.9 symbols/min [2025-09-17T22:52:17.023307] [INFO ] [MAIN ] GUG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:17.029920] [DEBUG] [MAIN ] GTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:17.031779] [INFO ] [MAIN ] GTN: Generated 1794 derivative records from 45848 primary records. [2025-09-17T22:52:17.031932] [DEBUG] [LOCAL ] GTN: Saving derivative data. [2025-09-17T22:52:17.063128] [DEBUG] [LOCAL ] GTN: Derivative data saved (1794 records). [2025-09-17T22:52:17.068924] [DEBUG] [LOCAL ] GUG: Loaded 12274 existing records from primary storage. [2025-09-17T22:52:17.068567] [INFO ] [MAIN ] GTN: Successfully saved derivative data. [2025-09-17T22:52:17.069121] [INFO ] [MAIN ] GUG: Loaded 12274 primary data records. [2025-09-17T22:52:17.071985] [INFO ] [MAIN ] Derivative Progress: 834/2085 symbols completed. GTN took 1.2s. Estimated remaining: 8m 7s. Rate: 154.0 symbols/min [2025-09-17T22:52:17.077999] [INFO ] [MAIN ] GUT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:17.127975] [DEBUG] [LOCAL ] GTY: Loaded 30408 existing records from primary storage. [2025-09-17T22:52:17.134100] [INFO ] [MAIN ] GTY: Loaded 30408 primary data records. [2025-09-17T22:52:17.386349] [DEBUG] [LOCAL ] GUT: Loaded 15620 existing records from primary storage. [2025-09-17T22:52:17.427687] [INFO ] [MAIN ] GUT: Loaded 15620 primary data records. [2025-09-17T22:52:18.088628] [DEBUG] [MAIN ] GUG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:52:18.091101] [INFO ] [MAIN ] GUG: Generated 1793 derivative records from 12274 primary records. [2025-09-17T22:52:18.091719] [DEBUG] [LOCAL ] GUG: Saving derivative data. [2025-09-17T22:52:18.120272] [DEBUG] [LOCAL ] GUG: Derivative data saved (1793 records). [2025-09-17T22:52:18.116235] [DEBUG] [MAIN ] GTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:18.121156] [INFO ] [MAIN ] GTY: Generated 1794 derivative records from 30408 primary records. [2025-09-17T22:52:18.121270] [DEBUG] [LOCAL ] GTY: Saving derivative data. [2025-09-17T22:52:18.121340] [INFO ] [MAIN ] GUG: Successfully saved derivative data. [2025-09-17T22:52:18.124545] [INFO ] [MAIN ] Derivative Progress: 835/2085 symbols completed. GUG took 1.1s. Estimated remaining: 8m 8s. Rate: 153.7 symbols/min [2025-09-17T22:52:18.137738] [INFO ] [MAIN ] GVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:18.147140] [DEBUG] [LOCAL ] GTY: Derivative data saved (1794 records). [2025-09-17T22:52:18.147316] [INFO ] [MAIN ] GTY: Successfully saved derivative data. [2025-09-17T22:52:18.150096] [INFO ] [MAIN ] Derivative Progress: 836/2085 symbols completed. GTY took 1.1s. Estimated remaining: 8m 7s. Rate: 153.9 symbols/min [2025-09-17T22:52:18.158829] [INFO ] [MAIN ] GWH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:18.164993] [DEBUG] [MAIN ] GUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:18.166048] [INFO ] [MAIN ] GUT: Generated 1794 derivative records from 15620 primary records. [2025-09-17T22:52:18.166271] [DEBUG] [LOCAL ] GUT: Saving derivative data. [2025-09-17T22:52:18.202475] [DEBUG] [LOCAL ] GUT: Derivative data saved (1794 records). [2025-09-17T22:52:18.202866] [DEBUG] [LOCAL ] GWH: Loaded 15043 existing records from primary storage. [2025-09-17T22:52:18.202970] [INFO ] [MAIN ] GUT: Successfully saved derivative data. [2025-09-17T22:52:18.203030] [INFO ] [MAIN ] GWH: Loaded 15043 primary data records. [2025-09-17T22:52:18.205958] [INFO ] [MAIN ] Derivative Progress: 837/2085 symbols completed. GUT took 1.1s. Estimated remaining: 8m 6s. Rate: 154.1 symbols/min [2025-09-17T22:52:18.211548] [INFO ] [MAIN ] GWRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:18.321185] [DEBUG] [LOCAL ] GVA: Loaded 34125 existing records from primary storage. [2025-09-17T22:52:18.325824] [INFO ] [MAIN ] GVA: Loaded 34125 primary data records. [2025-09-17T22:52:18.914036] [DEBUG] [LOCAL ] GWRE: Loaded 41449 existing records from primary storage. [2025-09-17T22:52:18.914438] [INFO ] [MAIN ] GWRE: Loaded 41449 primary data records. [2025-09-17T22:52:19.275589] [DEBUG] [MAIN ] GWH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:19.277401] [INFO ] [MAIN ] GWH: Generated 1794 derivative records from 15043 primary records. [2025-09-17T22:52:19.277501] [DEBUG] [LOCAL ] GWH: Saving derivative data. [2025-09-17T22:52:19.311854] [DEBUG] [LOCAL ] GWH: Derivative data saved (1794 records). [2025-09-17T22:52:19.312155] [INFO ] [MAIN ] GWH: Successfully saved derivative data. [2025-09-17T22:52:19.314256] [INFO ] [MAIN ] Derivative Progress: 838/2085 symbols completed. GWH took 1.2s. Estimated remaining: 8m 7s. Rate: 153.7 symbols/min [2025-09-17T22:52:19.315552] [DEBUG] [MAIN ] GVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:19.317276] [INFO ] [MAIN ] GVA: Generated 1794 derivative records from 34125 primary records. [2025-09-17T22:52:19.317527] [DEBUG] [LOCAL ] GVA: Saving derivative data. [2025-09-17T22:52:19.337318] [DEBUG] [LOCAL ] GVA: Derivative data saved (1794 records). [2025-09-17T22:52:19.337456] [INFO ] [MAIN ] GVA: Successfully saved derivative data. [2025-09-17T22:52:19.340303] [INFO ] [MAIN ] Derivative Progress: 839/2085 symbols completed. GVA took 1.2s. Estimated remaining: 8m 6s. Rate: 153.9 symbols/min [2025-09-17T22:52:19.352884] [DEBUG] [MAIN ] GWRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:19.353535] [INFO ] [MAIN ] GWRE: Generated 1794 derivative records from 41449 primary records. [2025-09-17T22:52:19.353595] [DEBUG] [LOCAL ] GWRE: Saving derivative data. [2025-09-17T22:52:19.370024] [DEBUG] [LOCAL ] GWRE: Derivative data saved (1794 records). [2025-09-17T22:52:19.370101] [INFO ] [MAIN ] GWRE: Successfully saved derivative data. [2025-09-17T22:52:19.373322] [INFO ] [MAIN ] Derivative Progress: 840/2085 symbols completed. GWRE took 1.2s. Estimated remaining: 8m 5s. Rate: 154.1 symbols/min [2025-09-17T22:52:19.373960] [INFO ] [MAIN ] GXO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:19.374245] [INFO ] [MAIN ] GYLD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:19.374695] [INFO ] [MAIN ] GWW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:19.379797] [DEBUG] [LOCAL ] GYLD: Loaded 1528 existing records from primary storage. [2025-09-17T22:52:19.379962] [INFO ] [MAIN ] GYLD: Loaded 1528 primary data records. [2025-09-17T22:52:19.571710] [DEBUG] [LOCAL ] GWW: Loaded 20089 existing records from primary storage. [2025-09-17T22:52:19.597585] [INFO ] [MAIN ] GWW: Loaded 20089 primary data records. [2025-09-17T22:52:19.829722] [DEBUG] [LOCAL ] GXO: Loaded 47860 existing records from primary storage. [2025-09-17T22:52:19.846859] [INFO ] [MAIN ] GXO: Loaded 47860 primary data records. [2025-09-17T22:52:20.467186] [DEBUG] [MAIN ] GYLD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:52:20.468635] [INFO ] [MAIN ] GYLD: Generated 1793 derivative records from 1528 primary records. [2025-09-17T22:52:20.468895] [DEBUG] [LOCAL ] GYLD: Saving derivative data. [2025-09-17T22:52:20.486488] [DEBUG] [LOCAL ] GYLD: Derivative data saved (1793 records). [2025-09-17T22:52:20.486875] [INFO ] [MAIN ] GYLD: Successfully saved derivative data. [2025-09-17T22:52:20.490369] [INFO ] [MAIN ] Derivative Progress: 841/2085 symbols completed. GYLD took 1.1s. Estimated remaining: 8m 6s. Rate: 153.7 symbols/min [2025-09-17T22:52:20.492063] [INFO ] [MAIN ] H: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:20.506173] [DEBUG] [MAIN ] GWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:20.507023] [INFO ] [MAIN ] GWW: Generated 1794 derivative records from 20089 primary records. [2025-09-17T22:52:20.507264] [DEBUG] [LOCAL ] GWW: Saving derivative data. [2025-09-17T22:52:20.526057] [DEBUG] [LOCAL ] GWW: Derivative data saved (1794 records). [2025-09-17T22:52:20.526430] [INFO ] [MAIN ] GWW: Successfully saved derivative data. [2025-09-17T22:52:20.528872] [INFO ] [MAIN ] Derivative Progress: 842/2085 symbols completed. GWW took 1.2s. Estimated remaining: 8m 5s. Rate: 153.9 symbols/min [2025-09-17T22:52:20.529338] [INFO ] [MAIN ] HAE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:20.542306] [DEBUG] [MAIN ] GXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:20.543012] [INFO ] [MAIN ] GXO: Generated 1794 derivative records from 47860 primary records. [2025-09-17T22:52:20.543194] [DEBUG] [LOCAL ] GXO: Saving derivative data. [2025-09-17T22:52:20.559939] [DEBUG] [LOCAL ] GXO: Derivative data saved (1794 records). [2025-09-17T22:52:20.560072] [INFO ] [MAIN ] GXO: Successfully saved derivative data. [2025-09-17T22:52:20.563059] [INFO ] [MAIN ] Derivative Progress: 843/2085 symbols completed. GXO took 1.2s. Estimated remaining: 8m 4s. Rate: 154.0 symbols/min [2025-09-17T22:52:20.573382] [INFO ] [MAIN ] HAFN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:20.595860] [DEBUG] [LOCAL ] H: Loaded 45097 existing records from primary storage. [2025-09-17T22:52:20.596072] [INFO ] [MAIN ] H: Loaded 45097 primary data records. [2025-09-17T22:52:20.737049] [DEBUG] [LOCAL ] HAE: Loaded 39466 existing records from primary storage. [2025-09-17T22:52:20.758295] [INFO ] [MAIN ] HAE: Loaded 39466 primary data records. [2025-09-17T22:52:20.896522] [DEBUG] [LOCAL ] HAFN: Loaded 43919 existing records from primary storage. [2025-09-17T22:52:21.010695] [INFO ] [MAIN ] HAFN: Loaded 43919 primary data records. [2025-09-17T22:52:21.611264] [DEBUG] [MAIN ] H: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:21.612992] [INFO ] [MAIN ] H: Generated 1794 derivative records from 45097 primary records. [2025-09-17T22:52:21.613184] [DEBUG] [LOCAL ] H: Saving derivative data. [2025-09-17T22:52:21.649131] [DEBUG] [LOCAL ] H: Derivative data saved (1794 records). [2025-09-17T22:52:21.648524] [DEBUG] [MAIN ] HAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:21.650759] [INFO ] [MAIN ] HAE: Generated 1794 derivative records from 39466 primary records. [2025-09-17T22:52:21.651687] [DEBUG] [LOCAL ] HAE: Saving derivative data. [2025-09-17T22:52:21.650884] [INFO ] [MAIN ] H: Successfully saved derivative data. [2025-09-17T22:52:21.656172] [INFO ] [MAIN ] Derivative Progress: 844/2085 symbols completed. H took 1.2s. Estimated remaining: 8m 4s. Rate: 153.7 symbols/min [2025-09-17T22:52:21.664221] [INFO ] [MAIN ] HAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:21.686447] [DEBUG] [LOCAL ] HAE: Derivative data saved (1794 records). [2025-09-17T22:52:21.686583] [INFO ] [MAIN ] HAE: Successfully saved derivative data. [2025-09-17T22:52:21.685409] [DEBUG] [MAIN ] HAFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:21.690135] [INFO ] [MAIN ] Derivative Progress: 845/2085 symbols completed. HAE took 1.2s. Estimated remaining: 8m 3s. Rate: 153.9 symbols/min [2025-09-17T22:52:21.690470] [INFO ] [MAIN ] HASI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:21.691731] [INFO ] [MAIN ] HAFN: Generated 1794 derivative records from 43919 primary records. [2025-09-17T22:52:21.691953] [DEBUG] [LOCAL ] HAFN: Saving derivative data. [2025-09-17T22:52:21.709924] [DEBUG] [LOCAL ] HAFN: Derivative data saved (1794 records). [2025-09-17T22:52:21.710149] [INFO ] [MAIN ] HAFN: Successfully saved derivative data. [2025-09-17T22:52:21.712810] [INFO ] [MAIN ] Derivative Progress: 846/2085 symbols completed. HAFN took 1.1s. Estimated remaining: 8m 3s. Rate: 154.1 symbols/min [2025-09-17T22:52:21.714042] [INFO ] [MAIN ] HAYW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:21.814886] [DEBUG] [LOCAL ] HAL: Loaded 53718 existing records from primary storage. [2025-09-17T22:52:21.815116] [INFO ] [MAIN ] HAL: Loaded 53718 primary data records. [2025-09-17T22:52:21.816582] [DEBUG] [LOCAL ] HASI: Loaded 47267 existing records from primary storage. [2025-09-17T22:52:21.815787] [DEBUG] [LOCAL ] HAYW: Loaded 48738 existing records from primary storage. [2025-09-17T22:52:21.838371] [INFO ] [MAIN ] HAYW: Loaded 48738 primary data records. [2025-09-17T22:52:21.866188] [INFO ] [MAIN ] HASI: Loaded 47267 primary data records. [2025-09-17T22:52:22.869814] [DEBUG] [MAIN ] HAYW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:22.883726] [INFO ] [MAIN ] HAYW: Generated 1794 derivative records from 48738 primary records. [2025-09-17T22:52:22.884203] [DEBUG] [MAIN ] HAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:22.884355] [DEBUG] [LOCAL ] HAYW: Saving derivative data. [2025-09-17T22:52:22.897861] [INFO ] [MAIN ] HAL: Generated 1794 derivative records from 53718 primary records. [2025-09-17T22:52:22.906634] [DEBUG] [MAIN ] HASI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:22.905280] [DEBUG] [LOCAL ] HAL: Saving derivative data. [2025-09-17T22:52:22.912613] [INFO ] [MAIN ] HASI: Generated 1794 derivative records from 47267 primary records. [2025-09-17T22:52:22.913077] [DEBUG] [LOCAL ] HASI: Saving derivative data. [2025-09-17T22:52:22.922289] [DEBUG] [LOCAL ] HAYW: Derivative data saved (1794 records). [2025-09-17T22:52:22.925680] [INFO ] [MAIN ] HAYW: Successfully saved derivative data. [2025-09-17T22:52:22.932701] [INFO ] [MAIN ] Derivative Progress: 847/2085 symbols completed. HAYW took 1.2s. Estimated remaining: 8m 3s. Rate: 153.7 symbols/min [2025-09-17T22:52:22.930208] [DEBUG] [LOCAL ] HAL: Derivative data saved (1794 records). [2025-09-17T22:52:22.933402] [INFO ] [MAIN ] HBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:22.933324] [INFO ] [MAIN ] HAL: Successfully saved derivative data. [2025-09-17T22:52:22.935585] [INFO ] [MAIN ] Derivative Progress: 848/2085 symbols completed. HAL took 1.3s. Estimated remaining: 8m 2s. Rate: 153.9 symbols/min [2025-09-17T22:52:22.944629] [INFO ] [MAIN ] HBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:22.955268] [DEBUG] [LOCAL ] HASI: Derivative data saved (1794 records). [2025-09-17T22:52:22.955474] [INFO ] [MAIN ] HASI: Successfully saved derivative data. [2025-09-17T22:52:22.958438] [INFO ] [MAIN ] Derivative Progress: 849/2085 symbols completed. HASI took 1.3s. Estimated remaining: 8m 1s. Rate: 154.0 symbols/min [2025-09-17T22:52:22.958834] [INFO ] [MAIN ] HBM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:22.963046] [DEBUG] [LOCAL ] HBB: Loaded 6974 existing records from primary storage. [2025-09-17T22:52:22.963184] [INFO ] [MAIN ] HBB: Loaded 6974 primary data records. [2025-09-17T22:52:23.309184] [DEBUG] [LOCAL ] HBI: Loaded 53042 existing records from primary storage. [2025-09-17T22:52:23.309491] [INFO ] [MAIN ] HBI: Loaded 53042 primary data records. [2025-09-17T22:52:23.436240] [DEBUG] [LOCAL ] HBM: Loaded 52913 existing records from primary storage. [2025-09-17T22:52:23.448306] [INFO ] [MAIN ] HBM: Loaded 52913 primary data records. [2025-09-17T22:52:23.622292] [DEBUG] [MAIN ] HBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:23.743864] [INFO ] [MAIN ] HBB: Generated 1794 derivative records from 6974 primary records. [2025-09-17T22:52:23.782451] [DEBUG] [LOCAL ] HBB: Saving derivative data. [2025-09-17T22:52:23.869995] [DEBUG] [LOCAL ] HBB: Derivative data saved (1794 records). [2025-09-17T22:52:23.898687] [INFO ] [MAIN ] HBB: Successfully saved derivative data. [2025-09-17T22:52:23.916988] [INFO ] [MAIN ] Derivative Progress: 850/2085 symbols completed. HBB took 1.0s. Estimated remaining: 8m 2s. Rate: 153.8 symbols/min [2025-09-17T22:52:23.992524] [INFO ] [MAIN ] HCA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:24.022477] [DEBUG] [MAIN ] HBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:24.023288] [INFO ] [MAIN ] HBI: Generated 1794 derivative records from 53042 primary records. [2025-09-17T22:52:24.023424] [DEBUG] [LOCAL ] HBI: Saving derivative data. [2025-09-17T22:52:24.041849] [DEBUG] [LOCAL ] HBI: Derivative data saved (1794 records). [2025-09-17T22:52:24.064436] [INFO ] [MAIN ] HBI: Successfully saved derivative data. [2025-09-17T22:52:24.065059] [DEBUG] [MAIN ] HBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:24.067091] [INFO ] [MAIN ] Derivative Progress: 851/2085 symbols completed. HBI took 1.1s. Estimated remaining: 8m 1s. Rate: 153.9 symbols/min [2025-09-17T22:52:24.068026] [INFO ] [MAIN ] HBM: Generated 1794 derivative records from 52913 primary records. [2025-09-17T22:52:24.068261] [INFO ] [MAIN ] HCC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:24.068378] [DEBUG] [LOCAL ] HBM: Saving derivative data. [2025-09-17T22:52:24.098863] [DEBUG] [LOCAL ] HBM: Derivative data saved (1794 records). [2025-09-17T22:52:24.099000] [INFO ] [MAIN ] HBM: Successfully saved derivative data. [2025-09-17T22:52:24.101187] [INFO ] [MAIN ] Derivative Progress: 852/2085 symbols completed. HBM took 1.1s. Estimated remaining: 8m 0s. Rate: 154.0 symbols/min [2025-09-17T22:52:24.102516] [DEBUG] [LOCAL ] HCA: Loaded 47402 existing records from primary storage. [2025-09-17T22:52:24.102706] [INFO ] [MAIN ] HCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:24.102940] [INFO ] [MAIN ] HCA: Loaded 47402 primary data records. [2025-09-17T22:52:24.308543] [DEBUG] [LOCAL ] HCI: Loaded 13942 existing records from primary storage. [2025-09-17T22:52:24.422531] [INFO ] [MAIN ] HCI: Loaded 13942 primary data records. [2025-09-17T22:52:24.522128] [DEBUG] [LOCAL ] HCC: Loaded 45426 existing records from primary storage. [2025-09-17T22:52:24.534458] [INFO ] [MAIN ] HCC: Loaded 45426 primary data records. [2025-09-17T22:52:25.167892] [DEBUG] [MAIN ] HCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:25.169569] [INFO ] [MAIN ] HCA: Generated 1794 derivative records from 47402 primary records. [2025-09-17T22:52:25.170007] [DEBUG] [LOCAL ] HCA: Saving derivative data. [2025-09-17T22:52:25.191447] [DEBUG] [LOCAL ] HCA: Derivative data saved (1794 records). [2025-09-17T22:52:25.191801] [INFO ] [MAIN ] HCA: Successfully saved derivative data. [2025-09-17T22:52:25.195436] [INFO ] [MAIN ] Derivative Progress: 853/2085 symbols completed. HCA took 1.2s. Estimated remaining: 8m 1s. Rate: 153.7 symbols/min [2025-09-17T22:52:25.212035] [DEBUG] [MAIN ] HCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:25.212992] [INFO ] [MAIN ] HCI: Generated 1794 derivative records from 13942 primary records. [2025-09-17T22:52:25.213157] [DEBUG] [LOCAL ] HCI: Saving derivative data. [2025-09-17T22:52:25.232491] [DEBUG] [LOCAL ] HCI: Derivative data saved (1794 records). [2025-09-17T22:52:25.232677] [INFO ] [MAIN ] HCI: Successfully saved derivative data. [2025-09-17T22:52:25.234863] [INFO ] [MAIN ] Derivative Progress: 854/2085 symbols completed. HCI took 1.1s. Estimated remaining: 8m 0s. Rate: 153.9 symbols/min [2025-09-17T22:52:25.248138] [DEBUG] [MAIN ] HCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:25.248862] [INFO ] [MAIN ] HCC: Generated 1794 derivative records from 45426 primary records. [2025-09-17T22:52:25.248926] [DEBUG] [LOCAL ] HCC: Saving derivative data. [2025-09-17T22:52:25.265557] [DEBUG] [LOCAL ] HCC: Derivative data saved (1794 records). [2025-09-17T22:52:25.265859] [INFO ] [MAIN ] HCC: Successfully saved derivative data. [2025-09-17T22:52:25.269203] [INFO ] [MAIN ] Derivative Progress: 855/2085 symbols completed. HCC took 1.2s. Estimated remaining: 7m 59s. Rate: 154.0 symbols/min [2025-09-17T22:52:25.270148] [INFO ] [MAIN ] HE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:25.270016] [INFO ] [MAIN ] HD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:25.270301] [INFO ] [MAIN ] HDB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:25.354527] [DEBUG] [LOCAL ] HDB: Loaded 51931 existing records from primary storage. [2025-09-17T22:52:25.356087] [DEBUG] [LOCAL ] HE: Loaded 49328 existing records from primary storage. [2025-09-17T22:52:25.356734] [INFO ] [MAIN ] HE: Loaded 49328 primary data records. [2025-09-17T22:52:25.356819] [INFO ] [MAIN ] HDB: Loaded 51931 primary data records. [2025-09-17T22:52:25.631258] [DEBUG] [LOCAL ] HD: Loaded 53521 existing records from primary storage. [2025-09-17T22:52:25.647252] [INFO ] [MAIN ] HD: Loaded 53521 primary data records. [2025-09-17T22:52:26.377084] [DEBUG] [MAIN ] HE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:26.378382] [INFO ] [MAIN ] HE: Generated 1794 derivative records from 49328 primary records. [2025-09-17T22:52:26.391221] [DEBUG] [MAIN ] HDB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:26.391368] [DEBUG] [LOCAL ] HE: Saving derivative data. [2025-09-17T22:52:26.393909] [INFO ] [MAIN ] HDB: Generated 1794 derivative records from 51931 primary records. [2025-09-17T22:52:26.394032] [DEBUG] [LOCAL ] HDB: Saving derivative data. [2025-09-17T22:52:26.411792] [DEBUG] [LOCAL ] HE: Derivative data saved (1794 records). [2025-09-17T22:52:26.412085] [INFO ] [MAIN ] HE: Successfully saved derivative data. [2025-09-17T22:52:26.421537] [INFO ] [MAIN ] Derivative Progress: 856/2085 symbols completed. HE took 1.2s. Estimated remaining: 7m 60s. Rate: 153.7 symbols/min [2025-09-17T22:52:26.443580] [INFO ] [MAIN ] HEI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:26.438082] [DEBUG] [MAIN ] HD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:26.446542] [INFO ] [MAIN ] HD: Generated 1794 derivative records from 53521 primary records. [2025-09-17T22:52:26.446668] [DEBUG] [LOCAL ] HD: Saving derivative data. [2025-09-17T22:52:26.468527] [DEBUG] [LOCAL ] HDB: Derivative data saved (1794 records). [2025-09-17T22:52:26.468780] [INFO ] [MAIN ] HDB: Successfully saved derivative data. [2025-09-17T22:52:26.468617] [DEBUG] [LOCAL ] HD: Derivative data saved (1794 records). [2025-09-17T22:52:26.471691] [INFO ] [MAIN ] Derivative Progress: 857/2085 symbols completed. HDB took 1.2s. Estimated remaining: 7m 59s. Rate: 153.8 symbols/min [2025-09-17T22:52:26.468906] [INFO ] [MAIN ] HD: Successfully saved derivative data. [2025-09-17T22:52:26.475025] [INFO ] [MAIN ] Derivative Progress: 858/2085 symbols completed. HD took 1.2s. Estimated remaining: 7m 58s. Rate: 154.0 symbols/min [2025-09-17T22:52:26.475403] [INFO ] [MAIN ] HEQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:26.475513] [INFO ] [MAIN ] HESM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:26.496183] [DEBUG] [LOCAL ] HEQ: Loaded 6138 existing records from primary storage. [2025-09-17T22:52:26.496345] [INFO ] [MAIN ] HEQ: Loaded 6138 primary data records. [2025-09-17T22:52:26.639590] [DEBUG] [LOCAL ] HEI: Loaded 33027 existing records from primary storage. [2025-09-17T22:52:26.650306] [INFO ] [MAIN ] HEI: Loaded 33027 primary data records. [2025-09-17T22:52:27.008639] [DEBUG] [LOCAL ] HESM: Loaded 48152 existing records from primary storage. [2025-09-17T22:52:27.024029] [INFO ] [MAIN ] HESM: Loaded 48152 primary data records. [2025-09-17T22:52:27.564638] [DEBUG] [MAIN ] HEQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:27.567945] [INFO ] [MAIN ] HEQ: Generated 1794 derivative records from 6138 primary records. [2025-09-17T22:52:27.568126] [DEBUG] [LOCAL ] HEQ: Saving derivative data. [2025-09-17T22:52:27.593383] [DEBUG] [MAIN ] HEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:27.594712] [INFO ] [MAIN ] HEI: Generated 1794 derivative records from 33027 primary records. [2025-09-17T22:52:27.595243] [DEBUG] [LOCAL ] HEI: Saving derivative data. [2025-09-17T22:52:27.612794] [DEBUG] [LOCAL ] HEI: Derivative data saved (1794 records). [2025-09-17T22:52:27.613907] [INFO ] [MAIN ] HEI: Successfully saved derivative data. [2025-09-17T22:52:27.617953] [INFO ] [MAIN ] Derivative Progress: 859/2085 symbols completed. HEI took 1.2s. Estimated remaining: 7m 59s. Rate: 153.7 symbols/min [2025-09-17T22:52:27.618933] [DEBUG] [LOCAL ] HEQ: Derivative data saved (1794 records). [2025-09-17T22:52:27.619859] [INFO ] [MAIN ] HEQ: Successfully saved derivative data. [2025-09-17T22:52:27.622103] [INFO ] [MAIN ] HFRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:27.622176] [INFO ] [MAIN ] Derivative Progress: 860/2085 symbols completed. HEQ took 1.1s. Estimated remaining: 7m 58s. Rate: 153.8 symbols/min [2025-09-17T22:52:27.630759] [INFO ] [MAIN ] HGER: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:27.636888] [DEBUG] [MAIN ] HESM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:27.637588] [INFO ] [MAIN ] HESM: Generated 1794 derivative records from 48152 primary records. [2025-09-17T22:52:27.637795] [DEBUG] [LOCAL ] HESM: Saving derivative data. [2025-09-17T22:52:27.658740] [DEBUG] [LOCAL ] HESM: Derivative data saved (1794 records). [2025-09-17T22:52:27.658947] [INFO ] [MAIN ] HESM: Successfully saved derivative data. [2025-09-17T22:52:27.661569] [INFO ] [MAIN ] Derivative Progress: 861/2085 symbols completed. HESM took 1.2s. Estimated remaining: 7m 57s. Rate: 154.0 symbols/min [2025-09-17T22:52:27.662068] [INFO ] [MAIN ] HGLB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:27.682001] [DEBUG] [LOCAL ] HFRO: Loaded 17516 existing records from primary storage. [2025-09-17T22:52:27.682699] [INFO ] [MAIN ] HFRO: Loaded 17516 primary data records. [2025-09-17T22:52:27.682308] [DEBUG] [LOCAL ] HGER: Loaded 12589 existing records from primary storage. [2025-09-17T22:52:27.688079] [INFO ] [MAIN ] HGER: Loaded 12589 primary data records. [2025-09-17T22:52:27.735035] [DEBUG] [LOCAL ] HGLB: Loaded 9738 existing records from primary storage. [2025-09-17T22:52:27.754387] [INFO ] [MAIN ] HGLB: Loaded 9738 primary data records. [2025-09-17T22:52:28.690896] [DEBUG] [MAIN ] HGER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:28.690317] [DEBUG] [MAIN ] HFRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:28.692378] [INFO ] [MAIN ] HFRO: Generated 1794 derivative records from 17516 primary records. [2025-09-17T22:52:28.691796] [INFO ] [MAIN ] HGER: Generated 1794 derivative records from 12589 primary records. [2025-09-17T22:52:28.692539] [DEBUG] [LOCAL ] HFRO: Saving derivative data. [2025-09-17T22:52:28.693443] [DEBUG] [LOCAL ] HGER: Saving derivative data. [2025-09-17T22:52:28.724920] [DEBUG] [MAIN ] HGLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:28.734397] [DEBUG] [LOCAL ] HGER: Derivative data saved (1794 records). [2025-09-17T22:52:28.734791] [INFO ] [MAIN ] HGER: Successfully saved derivative data. [2025-09-17T22:52:28.733273] [INFO ] [MAIN ] HGLB: Generated 1794 derivative records from 9738 primary records. [2025-09-17T22:52:28.735610] [DEBUG] [LOCAL ] HGLB: Saving derivative data. [2025-09-17T22:52:28.738158] [INFO ] [MAIN ] Derivative Progress: 862/2085 symbols completed. HGER took 1.1s. Estimated remaining: 7m 57s. Rate: 153.7 symbols/min [2025-09-17T22:52:28.739211] [INFO ] [MAIN ] HGTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:28.753392] [DEBUG] [LOCAL ] HFRO: Derivative data saved (1794 records). [2025-09-17T22:52:28.757535] [DEBUG] [LOCAL ] HGLB: Derivative data saved (1794 records). [2025-09-17T22:52:28.756738] [INFO ] [MAIN ] HFRO: Successfully saved derivative data. [2025-09-17T22:52:28.757712] [INFO ] [MAIN ] HGLB: Successfully saved derivative data. [2025-09-17T22:52:28.760030] [INFO ] [MAIN ] Derivative Progress: 863/2085 symbols completed. HGLB took 1.1s. Estimated remaining: 7m 57s. Rate: 153.9 symbols/min [2025-09-17T22:52:28.762393] [INFO ] [MAIN ] HGV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:28.762579] [INFO ] [MAIN ] Derivative Progress: 864/2085 symbols completed. HFRO took 1.1s. Estimated remaining: 7m 56s. Rate: 154.0 symbols/min [2025-09-17T22:52:28.766548] [INFO ] [MAIN ] HHH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:28.773913] [DEBUG] [LOCAL ] HGTY: Loaded 12830 existing records from primary storage. [2025-09-17T22:52:28.774091] [INFO ] [MAIN ] HGTY: Loaded 12830 primary data records. [2025-09-17T22:52:29.179613] [DEBUG] [LOCAL ] HHH: Loaded 32891 existing records from primary storage. [2025-09-17T22:52:29.179972] [INFO ] [MAIN ] HHH: Loaded 32891 primary data records. [2025-09-17T22:52:29.186049] [DEBUG] [LOCAL ] HGV: Loaded 47129 existing records from primary storage. [2025-09-17T22:52:29.214360] [INFO ] [MAIN ] HGV: Loaded 47129 primary data records. [2025-09-17T22:52:29.843038] [DEBUG] [MAIN ] HGTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:29.843984] [INFO ] [MAIN ] HGTY: Generated 1794 derivative records from 12830 primary records. [2025-09-17T22:52:29.844256] [DEBUG] [LOCAL ] HGTY: Saving derivative data. [2025-09-17T22:52:29.867728] [DEBUG] [LOCAL ] HGTY: Derivative data saved (1794 records). [2025-09-17T22:52:29.868336] [INFO ] [MAIN ] HGTY: Successfully saved derivative data. [2025-09-17T22:52:29.870905] [INFO ] [MAIN ] Derivative Progress: 865/2085 symbols completed. HGTY took 1.1s. Estimated remaining: 7m 56s. Rate: 153.7 symbols/min [2025-09-17T22:52:29.871315] [INFO ] [MAIN ] HI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:29.884882] [DEBUG] [MAIN ] HHH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:29.885760] [INFO ] [MAIN ] HHH: Generated 1794 derivative records from 32891 primary records. [2025-09-17T22:52:29.886876] [DEBUG] [LOCAL ] HHH: Saving derivative data. [2025-09-17T22:52:29.918067] [DEBUG] [MAIN ] HGV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:29.919245] [DEBUG] [LOCAL ] HHH: Derivative data saved (1794 records). [2025-09-17T22:52:29.920275] [INFO ] [MAIN ] HGV: Generated 1794 derivative records from 47129 primary records. [2025-09-17T22:52:29.920495] [INFO ] [MAIN ] HHH: Successfully saved derivative data. [2025-09-17T22:52:29.920410] [DEBUG] [LOCAL ] HGV: Saving derivative data. [2025-09-17T22:52:29.923973] [INFO ] [MAIN ] Derivative Progress: 866/2085 symbols completed. HHH took 1.2s. Estimated remaining: 7m 55s. Rate: 153.9 symbols/min [2025-09-17T22:52:29.924605] [INFO ] [MAIN ] HIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:29.949324] [DEBUG] [LOCAL ] HGV: Derivative data saved (1794 records). [2025-09-17T22:52:29.949513] [INFO ] [MAIN ] HGV: Successfully saved derivative data. [2025-09-17T22:52:29.952075] [INFO ] [MAIN ] Derivative Progress: 867/2085 symbols completed. HGV took 1.2s. Estimated remaining: 7m 54s. Rate: 154.0 symbols/min [2025-09-17T22:52:29.952558] [INFO ] [MAIN ] HII: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:29.969218] [DEBUG] [LOCAL ] HI: Loaded 35077 existing records from primary storage. [2025-09-17T22:52:29.969544] [INFO ] [MAIN ] HI: Loaded 35077 primary data records. [2025-09-17T22:52:30.226525] [DEBUG] [LOCAL ] HIG: Loaded 51306 existing records from primary storage. [2025-09-17T22:52:30.248795] [INFO ] [MAIN ] HIG: Loaded 51306 primary data records. [2025-09-17T22:52:30.250038] [DEBUG] [LOCAL ] HII: Loaded 35736 existing records from primary storage. [2025-09-17T22:52:30.383767] [INFO ] [MAIN ] HII: Loaded 35736 primary data records. [2025-09-17T22:52:31.091077] [DEBUG] [MAIN ] HI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:31.093974] [INFO ] [MAIN ] HI: Generated 1794 derivative records from 35077 primary records. [2025-09-17T22:52:31.094258] [DEBUG] [LOCAL ] HI: Saving derivative data. [2025-09-17T22:52:31.118341] [DEBUG] [LOCAL ] HI: Derivative data saved (1794 records). [2025-09-17T22:52:31.118756] [INFO ] [MAIN ] HI: Successfully saved derivative data. [2025-09-17T22:52:31.121063] [INFO ] [MAIN ] Derivative Progress: 868/2085 symbols completed. HI took 1.2s. Estimated remaining: 7m 55s. Rate: 153.7 symbols/min [2025-09-17T22:52:31.135928] [DEBUG] [MAIN ] HII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:31.136818] [INFO ] [MAIN ] HII: Generated 1794 derivative records from 35736 primary records. [2025-09-17T22:52:31.137221] [DEBUG] [LOCAL ] HII: Saving derivative data. [2025-09-17T22:52:31.170240] [DEBUG] [MAIN ] HIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:31.171750] [INFO ] [MAIN ] HIG: Generated 1794 derivative records from 51306 primary records. [2025-09-17T22:52:31.172089] [DEBUG] [LOCAL ] HIG: Saving derivative data. [2025-09-17T22:52:31.182192] [DEBUG] [LOCAL ] HII: Derivative data saved (1794 records). [2025-09-17T22:52:31.189327] [INFO ] [MAIN ] HII: Successfully saved derivative data. [2025-09-17T22:52:31.192574] [INFO ] [MAIN ] Derivative Progress: 869/2085 symbols completed. HII took 1.2s. Estimated remaining: 7m 54s. Rate: 153.8 symbols/min [2025-09-17T22:52:31.192719] [DEBUG] [LOCAL ] HIG: Derivative data saved (1794 records). [2025-09-17T22:52:31.193025] [INFO ] [MAIN ] HIG: Successfully saved derivative data. [2025-09-17T22:52:31.195669] [INFO ] [MAIN ] Derivative Progress: 870/2085 symbols completed. HIG took 1.3s. Estimated remaining: 7m 53s. Rate: 154.0 symbols/min [2025-09-17T22:52:31.196285] [INFO ] [MAIN ] HIMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:31.196502] [INFO ] [MAIN ] HIPO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:31.196358] [INFO ] [MAIN ] HIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:31.220767] [DEBUG] [LOCAL ] HIPO: Loaded 22987 existing records from primary storage. [2025-09-17T22:52:31.220963] [INFO ] [MAIN ] HIPO: Loaded 22987 primary data records. [2025-09-17T22:52:31.341301] [DEBUG] [LOCAL ] HIO: Loaded 24117 existing records from primary storage. [2025-09-17T22:52:31.345127] [INFO ] [MAIN ] HIO: Loaded 24117 primary data records. [2025-09-17T22:52:31.558107] [DEBUG] [LOCAL ] HIMS: Loaded 53817 existing records from primary storage. [2025-09-17T22:52:31.599479] [INFO ] [MAIN ] HIMS: Loaded 53817 primary data records. [2025-09-17T22:52:32.249769] [DEBUG] [MAIN ] HIPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:32.250924] [INFO ] [MAIN ] HIPO: Generated 1794 derivative records from 22987 primary records. [2025-09-17T22:52:32.251110] [DEBUG] [LOCAL ] HIPO: Saving derivative data. [2025-09-17T22:52:32.276989] [DEBUG] [MAIN ] HIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:32.291478] [DEBUG] [LOCAL ] HIPO: Derivative data saved (1794 records). [2025-09-17T22:52:32.290015] [INFO ] [MAIN ] HIO: Generated 1794 derivative records from 24117 primary records. [2025-09-17T22:52:32.291594] [INFO ] [MAIN ] HIPO: Successfully saved derivative data. [2025-09-17T22:52:32.291850] [DEBUG] [LOCAL ] HIO: Saving derivative data. [2025-09-17T22:52:32.294587] [INFO ] [MAIN ] Derivative Progress: 871/2085 symbols completed. HIPO took 1.1s. Estimated remaining: 7m 54s. Rate: 153.7 symbols/min [2025-09-17T22:52:32.310383] [INFO ] [MAIN ] HIW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:32.329277] [DEBUG] [LOCAL ] HIO: Derivative data saved (1794 records). [2025-09-17T22:52:32.328286] [DEBUG] [MAIN ] HIMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:32.330184] [INFO ] [MAIN ] HIMS: Generated 1794 derivative records from 53817 primary records. [2025-09-17T22:52:32.329472] [INFO ] [MAIN ] HIO: Successfully saved derivative data. [2025-09-17T22:52:32.332904] [INFO ] [MAIN ] Derivative Progress: 872/2085 symbols completed. HIO took 1.1s. Estimated remaining: 7m 53s. Rate: 153.8 symbols/min [2025-09-17T22:52:32.332994] [DEBUG] [LOCAL ] HIMS: Saving derivative data. [2025-09-17T22:52:32.334136] [INFO ] [MAIN ] HIX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:32.353144] [DEBUG] [LOCAL ] HIMS: Derivative data saved (1794 records). [2025-09-17T22:52:32.353453] [INFO ] [MAIN ] HIMS: Successfully saved derivative data. [2025-09-17T22:52:32.356049] [INFO ] [MAIN ] Derivative Progress: 873/2085 symbols completed. HIMS took 1.2s. Estimated remaining: 7m 52s. Rate: 154.0 symbols/min [2025-09-17T22:52:32.361913] [INFO ] [MAIN ] HKD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:32.372540] [DEBUG] [LOCAL ] HIX: Loaded 20273 existing records from primary storage. [2025-09-17T22:52:32.372768] [INFO ] [MAIN ] HIX: Loaded 20273 primary data records. [2025-09-17T22:52:32.570756] [DEBUG] [LOCAL ] HIW: Loaded 44886 existing records from primary storage. [2025-09-17T22:52:32.576982] [DEBUG] [LOCAL ] HKD: Loaded 17934 existing records from primary storage. [2025-09-17T22:52:32.579186] [INFO ] [MAIN ] HIW: Loaded 44886 primary data records. [2025-09-17T22:52:32.595539] [INFO ] [MAIN ] HKD: Loaded 17934 primary data records. [2025-09-17T22:52:33.407459] [DEBUG] [MAIN ] HIX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:33.408328] [INFO ] [MAIN ] HIX: Generated 1794 derivative records from 20273 primary records. [2025-09-17T22:52:33.409684] [DEBUG] [LOCAL ] HIX: Saving derivative data. [2025-09-17T22:52:33.428916] [DEBUG] [LOCAL ] HIX: Derivative data saved (1794 records). [2025-09-17T22:52:33.429269] [INFO ] [MAIN ] HIX: Successfully saved derivative data. [2025-09-17T22:52:33.431438] [INFO ] [MAIN ] Derivative Progress: 874/2085 symbols completed. HIX took 1.1s. Estimated remaining: 7m 53s. Rate: 153.7 symbols/min [2025-09-17T22:52:33.431919] [INFO ] [MAIN ] HL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:33.453520] [DEBUG] [MAIN ] HIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:33.466530] [INFO ] [MAIN ] HIW: Generated 1794 derivative records from 44886 primary records. [2025-09-17T22:52:33.467182] [DEBUG] [MAIN ] HKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:33.468132] [INFO ] [MAIN ] HKD: Generated 1794 derivative records from 17934 primary records. [2025-09-17T22:52:33.466896] [DEBUG] [LOCAL ] HIW: Saving derivative data. [2025-09-17T22:52:33.468352] [DEBUG] [LOCAL ] HKD: Saving derivative data. [2025-09-17T22:52:33.499668] [DEBUG] [LOCAL ] HIW: Derivative data saved (1794 records). [2025-09-17T22:52:33.500543] [INFO ] [MAIN ] HIW: Successfully saved derivative data. [2025-09-17T22:52:33.503467] [INFO ] [MAIN ] Derivative Progress: 875/2085 symbols completed. HIW took 1.2s. Estimated remaining: 7m 52s. Rate: 153.8 symbols/min [2025-09-17T22:52:33.504480] [INFO ] [MAIN ] HLF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:33.509190] [DEBUG] [LOCAL ] HKD: Derivative data saved (1794 records). [2025-09-17T22:52:33.509385] [INFO ] [MAIN ] HKD: Successfully saved derivative data. [2025-09-17T22:52:33.512080] [INFO ] [MAIN ] Derivative Progress: 876/2085 symbols completed. HKD took 1.2s. Estimated remaining: 7m 51s. Rate: 154.0 symbols/min [2025-09-17T22:52:33.527037] [INFO ] [MAIN ] HLI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:33.551635] [DEBUG] [LOCAL ] HL: Loaded 53670 existing records from primary storage. [2025-09-17T22:52:33.551944] [INFO ] [MAIN ] HL: Loaded 53670 primary data records. [2025-09-17T22:52:33.720714] [DEBUG] [LOCAL ] HLF: Loaded 48939 existing records from primary storage. [2025-09-17T22:52:33.739414] [DEBUG] [LOCAL ] HLI: Loaded 31485 existing records from primary storage. [2025-09-17T22:52:33.748050] [INFO ] [MAIN ] HLF: Loaded 48939 primary data records. [2025-09-17T22:52:33.748294] [INFO ] [MAIN ] HLI: Loaded 31485 primary data records. [2025-09-17T22:52:34.549842] [DEBUG] [MAIN ] HL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:34.553135] [INFO ] [MAIN ] HL: Generated 1794 derivative records from 53670 primary records. [2025-09-17T22:52:34.553295] [DEBUG] [LOCAL ] HL: Saving derivative data. [2025-09-17T22:52:34.580132] [DEBUG] [MAIN ] HLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:34.583967] [DEBUG] [LOCAL ] HL: Derivative data saved (1794 records). [2025-09-17T22:52:34.584941] [INFO ] [MAIN ] HLF: Generated 1794 derivative records from 48939 primary records. [2025-09-17T22:52:34.585206] [INFO ] [MAIN ] HL: Successfully saved derivative data. [2025-09-17T22:52:34.587284] [DEBUG] [LOCAL ] HLF: Saving derivative data. [2025-09-17T22:52:34.587204] [INFO ] [MAIN ] Derivative Progress: 877/2085 symbols completed. HL took 1.2s. Estimated remaining: 7m 52s. Rate: 153.7 symbols/min [2025-09-17T22:52:34.588857] [INFO ] [MAIN ] HLIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:34.608444] [DEBUG] [LOCAL ] HLF: Derivative data saved (1794 records). [2025-09-17T22:52:34.608753] [INFO ] [MAIN ] HLF: Successfully saved derivative data. [2025-09-17T22:52:34.619917] [INFO ] [MAIN ] Derivative Progress: 878/2085 symbols completed. HLF took 1.1s. Estimated remaining: 7m 51s. Rate: 153.9 symbols/min [2025-09-17T22:52:34.625352] [INFO ] [MAIN ] HLLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:34.626388] [DEBUG] [MAIN ] HLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:34.627357] [INFO ] [MAIN ] HLI: Generated 1794 derivative records from 31485 primary records. [2025-09-17T22:52:34.627602] [DEBUG] [LOCAL ] HLI: Saving derivative data. [2025-09-17T22:52:34.663310] [DEBUG] [LOCAL ] HLI: Derivative data saved (1794 records). [2025-09-17T22:52:34.663537] [INFO ] [MAIN ] HLI: Successfully saved derivative data. [2025-09-17T22:52:34.666418] [INFO ] [MAIN ] Derivative Progress: 879/2085 symbols completed. HLI took 1.1s. Estimated remaining: 7m 50s. Rate: 154.0 symbols/min [2025-09-17T22:52:34.667293] [DEBUG] [LOCAL ] HLIO: Loaded 28187 existing records from primary storage. [2025-09-17T22:52:34.667382] [INFO ] [MAIN ] HLIO: Loaded 28187 primary data records. [2025-09-17T22:52:34.667624] [INFO ] [MAIN ] HLN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:34.826699] [DEBUG] [LOCAL ] HLLY: Loaded 33095 existing records from primary storage. [2025-09-17T22:52:34.853543] [INFO ] [MAIN ] HLLY: Loaded 33095 primary data records. [2025-09-17T22:52:35.241572] [DEBUG] [LOCAL ] HLN: Loaded 53084 existing records from primary storage. [2025-09-17T22:52:35.285603] [INFO ] [MAIN ] HLN: Loaded 53084 primary data records. [2025-09-17T22:52:35.736472] [DEBUG] [MAIN ] HLIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:35.739457] [INFO ] [MAIN ] HLIO: Generated 1794 derivative records from 28187 primary records. [2025-09-17T22:52:35.739789] [DEBUG] [LOCAL ] HLIO: Saving derivative data. [2025-09-17T22:52:35.762906] [DEBUG] [MAIN ] HLLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:35.767628] [INFO ] [MAIN ] HLLY: Generated 1794 derivative records from 33095 primary records. [2025-09-17T22:52:35.767962] [DEBUG] [LOCAL ] HLLY: Saving derivative data. [2025-09-17T22:52:35.786130] [DEBUG] [LOCAL ] HLLY: Derivative data saved (1794 records). [2025-09-17T22:52:35.786667] [INFO ] [MAIN ] HLLY: Successfully saved derivative data. [2025-09-17T22:52:35.789712] [INFO ] [MAIN ] Derivative Progress: 880/2085 symbols completed. HLLY took 1.2s. Estimated remaining: 7m 50s. Rate: 153.7 symbols/min [2025-09-17T22:52:35.790634] [INFO ] [MAIN ] HLT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:35.794483] [DEBUG] [LOCAL ] HLIO: Derivative data saved (1794 records). [2025-09-17T22:52:35.794766] [INFO ] [MAIN ] HLIO: Successfully saved derivative data. [2025-09-17T22:52:35.797408] [INFO ] [MAIN ] Derivative Progress: 881/2085 symbols completed. HLIO took 1.2s. Estimated remaining: 7m 50s. Rate: 153.9 symbols/min [2025-09-17T22:52:35.797710] [INFO ] [MAIN ] HLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:35.816341] [DEBUG] [MAIN ] HLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:35.817398] [INFO ] [MAIN ] HLN: Generated 1794 derivative records from 53084 primary records. [2025-09-17T22:52:35.817522] [DEBUG] [LOCAL ] HLN: Saving derivative data. [2025-09-17T22:52:35.836985] [DEBUG] [LOCAL ] HLN: Derivative data saved (1794 records). [2025-09-17T22:52:35.837199] [INFO ] [MAIN ] HLN: Successfully saved derivative data. [2025-09-17T22:52:35.840187] [INFO ] [MAIN ] Derivative Progress: 882/2085 symbols completed. HLN took 1.2s. Estimated remaining: 7m 49s. Rate: 154.0 symbols/min [2025-09-17T22:52:35.840632] [INFO ] [MAIN ] HMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:35.889996] [DEBUG] [LOCAL ] HLT: Loaded 50795 existing records from primary storage. [2025-09-17T22:52:35.904350] [INFO ] [MAIN ] HLT: Loaded 50795 primary data records. [2025-09-17T22:52:35.905199] [DEBUG] [LOCAL ] HLX: Loaded 48180 existing records from primary storage. [2025-09-17T22:52:35.927340] [INFO ] [MAIN ] HLX: Loaded 48180 primary data records. [2025-09-17T22:52:36.189488] [DEBUG] [LOCAL ] HMC: Loaded 47041 existing records from primary storage. [2025-09-17T22:52:36.225847] [INFO ] [MAIN ] HMC: Loaded 47041 primary data records. [2025-09-17T22:52:36.904320] [DEBUG] [MAIN ] HLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:36.906274] [INFO ] [MAIN ] HLT: Generated 1794 derivative records from 50795 primary records. [2025-09-17T22:52:36.906412] [DEBUG] [LOCAL ] HLT: Saving derivative data. [2025-09-17T22:52:36.938280] [DEBUG] [LOCAL ] HLT: Derivative data saved (1794 records). [2025-09-17T22:52:36.938521] [DEBUG] [MAIN ] HLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:36.939236] [INFO ] [MAIN ] HLT: Successfully saved derivative data. [2025-09-17T22:52:36.942627] [INFO ] [MAIN ] HLX: Generated 1794 derivative records from 48180 primary records. [2025-09-17T22:52:36.942773] [DEBUG] [LOCAL ] HLX: Saving derivative data. [2025-09-17T22:52:36.941834] [INFO ] [MAIN ] Derivative Progress: 883/2085 symbols completed. HLT took 1.2s. Estimated remaining: 7m 49s. Rate: 153.7 symbols/min [2025-09-17T22:52:36.977176] [DEBUG] [LOCAL ] HLX: Derivative data saved (1794 records). [2025-09-17T22:52:36.977291] [INFO ] [MAIN ] HLX: Successfully saved derivative data. [2025-09-17T22:52:36.977101] [DEBUG] [MAIN ] HMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:36.980938] [INFO ] [MAIN ] Derivative Progress: 884/2085 symbols completed. HLX took 1.2s. Estimated remaining: 7m 48s. Rate: 153.8 symbols/min [2025-09-17T22:52:36.978148] [INFO ] [MAIN ] HMC: Generated 1794 derivative records from 47041 primary records. [2025-09-17T22:52:36.981288] [DEBUG] [LOCAL ] HMC: Saving derivative data. [2025-09-17T22:52:36.997488] [DEBUG] [LOCAL ] HMC: Derivative data saved (1794 records). [2025-09-17T22:52:36.997558] [INFO ] [MAIN ] HMC: Successfully saved derivative data. [2025-09-17T22:52:37.000339] [INFO ] [MAIN ] Derivative Progress: 885/2085 symbols completed. HMC took 1.2s. Estimated remaining: 7m 47s. Rate: 154.0 symbols/min [2025-09-17T22:52:37.000958] [INFO ] [MAIN ] HMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:37.001127] [INFO ] [MAIN ] HMY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:37.001830] [INFO ] [MAIN ] HNI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:37.035121] [DEBUG] [LOCAL ] HMN: Loaded 23228 existing records from primary storage. [2025-09-17T22:52:37.035288] [INFO ] [MAIN ] HMN: Loaded 23228 primary data records. [2025-09-17T22:52:37.076398] [DEBUG] [LOCAL ] HNI: Loaded 28800 existing records from primary storage. [2025-09-17T22:52:37.142317] [INFO ] [MAIN ] HNI: Loaded 28800 primary data records. [2025-09-17T22:52:37.354499] [DEBUG] [LOCAL ] HMY: Loaded 53125 existing records from primary storage. [2025-09-17T22:52:37.372905] [INFO ] [MAIN ] HMY: Loaded 53125 primary data records. [2025-09-17T22:52:38.120039] [DEBUG] [MAIN ] HMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:38.122676] [INFO ] [MAIN ] HMN: Generated 1794 derivative records from 23228 primary records. [2025-09-17T22:52:38.122887] [DEBUG] [LOCAL ] HMN: Saving derivative data. [2025-09-17T22:52:38.151630] [DEBUG] [MAIN ] HNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:38.154466] [INFO ] [MAIN ] HNI: Generated 1794 derivative records from 28800 primary records. [2025-09-17T22:52:38.154738] [DEBUG] [LOCAL ] HNI: Saving derivative data. [2025-09-17T22:52:38.156884] [DEBUG] [LOCAL ] HMN: Derivative data saved (1794 records). [2025-09-17T22:52:38.157155] [INFO ] [MAIN ] HMN: Successfully saved derivative data. [2025-09-17T22:52:38.168024] [INFO ] [MAIN ] Derivative Progress: 886/2085 symbols completed. HMN took 1.2s. Estimated remaining: 7m 48s. Rate: 153.7 symbols/min [2025-09-17T22:52:38.171058] [INFO ] [MAIN ] HOG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:38.180725] [DEBUG] [LOCAL ] HNI: Derivative data saved (1794 records). [2025-09-17T22:52:38.180879] [INFO ] [MAIN ] HNI: Successfully saved derivative data. [2025-09-17T22:52:38.183591] [INFO ] [MAIN ] Derivative Progress: 887/2085 symbols completed. HNI took 1.2s. Estimated remaining: 7m 47s. Rate: 153.8 symbols/min [2025-09-17T22:52:38.183952] [INFO ] [MAIN ] HOMB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:38.199456] [DEBUG] [MAIN ] HMY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:38.200368] [INFO ] [MAIN ] HMY: Generated 1794 derivative records from 53125 primary records. [2025-09-17T22:52:38.200621] [DEBUG] [LOCAL ] HMY: Saving derivative data. [2025-09-17T22:52:38.218933] [DEBUG] [LOCAL ] HMY: Derivative data saved (1794 records). [2025-09-17T22:52:38.219147] [INFO ] [MAIN ] HMY: Successfully saved derivative data. [2025-09-17T22:52:38.222078] [INFO ] [MAIN ] Derivative Progress: 888/2085 symbols completed. HMY took 1.2s. Estimated remaining: 7m 46s. Rate: 154.0 symbols/min [2025-09-17T22:52:38.222511] [INFO ] [MAIN ] HOUS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:38.270749] [DEBUG] [LOCAL ] HOG: Loaded 51295 existing records from primary storage. [2025-09-17T22:52:38.270901] [INFO ] [MAIN ] HOG: Loaded 51295 primary data records. [2025-09-17T22:52:38.373350] [DEBUG] [LOCAL ] HOMB: Loaded 43727 existing records from primary storage. [2025-09-17T22:52:38.404104] [INFO ] [MAIN ] HOMB: Loaded 43727 primary data records. [2025-09-17T22:52:38.542190] [DEBUG] [LOCAL ] HOUS: Loaded 43946 existing records from primary storage. [2025-09-17T22:52:38.566217] [INFO ] [MAIN ] HOUS: Loaded 43946 primary data records. [2025-09-17T22:52:39.416531] [DEBUG] [MAIN ] HOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:39.417549] [INFO ] [MAIN ] HOG: Generated 1794 derivative records from 51295 primary records. [2025-09-17T22:52:39.417707] [DEBUG] [LOCAL ] HOG: Saving derivative data. [2025-09-17T22:52:39.439833] [DEBUG] [LOCAL ] HOG: Derivative data saved (1794 records). [2025-09-17T22:52:39.440298] [INFO ] [MAIN ] HOG: Successfully saved derivative data. [2025-09-17T22:52:39.442435] [INFO ] [MAIN ] Derivative Progress: 889/2085 symbols completed. HOG took 1.3s. Estimated remaining: 7m 47s. Rate: 153.6 symbols/min [2025-09-17T22:52:39.443091] [INFO ] [MAIN ] HOV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:39.462859] [DEBUG] [MAIN ] HOMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:39.476802] [INFO ] [MAIN ] HOMB: Generated 1794 derivative records from 43727 primary records. [2025-09-17T22:52:39.480775] [DEBUG] [LOCAL ] HOMB: Saving derivative data. [2025-09-17T22:52:39.482523] [DEBUG] [MAIN ] HOUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:39.494098] [INFO ] [MAIN ] HOUS: Generated 1794 derivative records from 43946 primary records. [2025-09-17T22:52:39.498111] [DEBUG] [LOCAL ] HOUS: Saving derivative data. [2025-09-17T22:52:39.508596] [DEBUG] [LOCAL ] HOMB: Derivative data saved (1794 records). [2025-09-17T22:52:39.509267] [DEBUG] [LOCAL ] HOV: Loaded 13751 existing records from primary storage. [2025-09-17T22:52:39.509835] [INFO ] [MAIN ] HOV: Loaded 13751 primary data records. [2025-09-17T22:52:39.509461] [INFO ] [MAIN ] HOMB: Successfully saved derivative data. [2025-09-17T22:52:39.524070] [INFO ] [MAIN ] Derivative Progress: 890/2085 symbols completed. HOMB took 1.3s. Estimated remaining: 7m 46s. Rate: 153.8 symbols/min [2025-09-17T22:52:39.580826] [INFO ] [MAIN ] HP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:39.584699] [DEBUG] [LOCAL ] HOUS: Derivative data saved (1794 records). [2025-09-17T22:52:39.606840] [INFO ] [MAIN ] HOUS: Successfully saved derivative data. [2025-09-17T22:52:39.614860] [INFO ] [MAIN ] Derivative Progress: 891/2085 symbols completed. HOUS took 1.4s. Estimated remaining: 7m 46s. Rate: 153.9 symbols/min [2025-09-17T22:52:39.634292] [INFO ] [MAIN ] HPE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:39.906993] [DEBUG] [LOCAL ] HP: Loaded 51644 existing records from primary storage. [2025-09-17T22:52:39.907371] [INFO ] [MAIN ] HP: Loaded 51644 primary data records. [2025-09-17T22:52:39.943327] [DEBUG] [MAIN ] HOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:39.988398] [INFO ] [MAIN ] HOV: Generated 1794 derivative records from 13751 primary records. [2025-09-17T22:52:40.005267] [DEBUG] [LOCAL ] HOV: Saving derivative data. [2025-09-17T22:52:40.035926] [DEBUG] [LOCAL ] HPE: Loaded 53697 existing records from primary storage. [2025-09-17T22:52:40.058628] [INFO ] [MAIN ] HPE: Loaded 53697 primary data records. [2025-09-17T22:52:40.370990] [DEBUG] [LOCAL ] HOV: Derivative data saved (1794 records). [2025-09-17T22:52:40.381952] [INFO ] [MAIN ] HOV: Successfully saved derivative data. [2025-09-17T22:52:40.389963] [INFO ] [MAIN ] Derivative Progress: 892/2085 symbols completed. HOV took 0.9s. Estimated remaining: 7m 46s. Rate: 153.7 symbols/min [2025-09-17T22:52:40.419129] [INFO ] [MAIN ] HPF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:40.584689] [DEBUG] [LOCAL ] HPF: Loaded 7238 existing records from primary storage. [2025-09-17T22:52:40.585943] [INFO ] [MAIN ] HPF: Loaded 7238 primary data records. [2025-09-17T22:52:40.917823] [DEBUG] [MAIN ] HP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:40.919365] [INFO ] [MAIN ] HP: Generated 1794 derivative records from 51644 primary records. [2025-09-17T22:52:40.919606] [DEBUG] [LOCAL ] HP: Saving derivative data. [2025-09-17T22:52:40.941175] [DEBUG] [LOCAL ] HP: Derivative data saved (1794 records). [2025-09-17T22:52:40.949281] [INFO ] [MAIN ] HP: Successfully saved derivative data. [2025-09-17T22:52:40.951296] [INFO ] [MAIN ] Derivative Progress: 893/2085 symbols completed. HP took 1.4s. Estimated remaining: 7m 45s. Rate: 153.6 symbols/min [2025-09-17T22:52:40.957145] [DEBUG] [MAIN ] HPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:40.956823] [INFO ] [MAIN ] HPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:40.958022] [INFO ] [MAIN ] HPE: Generated 1794 derivative records from 53697 primary records. [2025-09-17T22:52:40.958183] [DEBUG] [LOCAL ] HPE: Saving derivative data. [2025-09-17T22:52:40.984570] [DEBUG] [LOCAL ] HPI: Loaded 9976 existing records from primary storage. [2025-09-17T22:52:40.985286] [INFO ] [MAIN ] HPI: Loaded 9976 primary data records. [2025-09-17T22:52:41.008619] [DEBUG] [LOCAL ] HPE: Derivative data saved (1794 records). [2025-09-17T22:52:41.024482] [INFO ] [MAIN ] HPE: Successfully saved derivative data. [2025-09-17T22:52:41.067795] [INFO ] [MAIN ] Derivative Progress: 894/2085 symbols completed. HPE took 1.4s. Estimated remaining: 7m 45s. Rate: 153.8 symbols/min [2025-09-17T22:52:41.096895] [INFO ] [MAIN ] HPP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:41.194086] [DEBUG] [MAIN ] HPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:41.316842] [INFO ] [MAIN ] HPF: Generated 1794 derivative records from 7238 primary records. [2025-09-17T22:52:41.317768] [DEBUG] [LOCAL ] HPF: Saving derivative data. [2025-09-17T22:52:41.340444] [DEBUG] [LOCAL ] HPF: Derivative data saved (1794 records). [2025-09-17T22:52:41.341334] [INFO ] [MAIN ] HPF: Successfully saved derivative data. [2025-09-17T22:52:41.344250] [INFO ] [MAIN ] Derivative Progress: 895/2085 symbols completed. HPF took 0.9s. Estimated remaining: 7m 44s. Rate: 153.8 symbols/min [2025-09-17T22:52:41.344689] [INFO ] [MAIN ] HPQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:41.382004] [DEBUG] [MAIN ] HPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:41.383709] [INFO ] [MAIN ] HPI: Generated 1794 derivative records from 9976 primary records. [2025-09-17T22:52:41.383906] [DEBUG] [LOCAL ] HPI: Saving derivative data. [2025-09-17T22:52:41.411431] [DEBUG] [LOCAL ] HPP: Loaded 50736 existing records from primary storage. [2025-09-17T22:52:41.412150] [INFO ] [MAIN ] HPP: Loaded 50736 primary data records. [2025-09-17T22:52:41.460311] [DEBUG] [LOCAL ] HPI: Derivative data saved (1794 records). [2025-09-17T22:52:41.488913] [INFO ] [MAIN ] HPI: Successfully saved derivative data. [2025-09-17T22:52:41.491598] [INFO ] [MAIN ] Derivative Progress: 896/2085 symbols completed. HPI took 0.5s. Estimated remaining: 7m 43s. Rate: 153.9 symbols/min [2025-09-17T22:52:41.549605] [INFO ] [MAIN ] HPS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:41.663910] [DEBUG] [LOCAL ] HPQ: Loaded 53669 existing records from primary storage. [2025-09-17T22:52:41.670268] [INFO ] [MAIN ] HPQ: Loaded 53669 primary data records. [2025-09-17T22:52:41.908565] [DEBUG] [LOCAL ] HPS: Loaded 10274 existing records from primary storage. [2025-09-17T22:52:41.916946] [INFO ] [MAIN ] HPS: Loaded 10274 primary data records. [2025-09-17T22:52:42.503923] [DEBUG] [MAIN ] HPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:42.505250] [INFO ] [MAIN ] HPP: Generated 1794 derivative records from 50736 primary records. [2025-09-17T22:52:42.505364] [DEBUG] [LOCAL ] HPP: Saving derivative data. [2025-09-17T22:52:42.527559] [DEBUG] [LOCAL ] HPP: Derivative data saved (1794 records). [2025-09-17T22:52:42.527880] [INFO ] [MAIN ] HPP: Successfully saved derivative data. [2025-09-17T22:52:42.530107] [INFO ] [MAIN ] Derivative Progress: 897/2085 symbols completed. HPP took 1.4s. Estimated remaining: 7m 44s. Rate: 153.6 symbols/min [2025-09-17T22:52:42.538296] [INFO ] [MAIN ] HQH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:42.544260] [DEBUG] [MAIN ] HPQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:42.545133] [INFO ] [MAIN ] HPQ: Generated 1794 derivative records from 53669 primary records. [2025-09-17T22:52:42.545342] [DEBUG] [LOCAL ] HPQ: Saving derivative data. [2025-09-17T22:52:42.576920] [DEBUG] [MAIN ] HPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:42.584638] [INFO ] [MAIN ] HPS: Generated 1794 derivative records from 10274 primary records. [2025-09-17T22:52:42.585513] [DEBUG] [LOCAL ] HPQ: Derivative data saved (1794 records). [2025-09-17T22:52:42.585740] [DEBUG] [LOCAL ] HPS: Saving derivative data. [2025-09-17T22:52:42.586331] [INFO ] [MAIN ] HPQ: Successfully saved derivative data. [2025-09-17T22:52:42.589305] [INFO ] [MAIN ] Derivative Progress: 898/2085 symbols completed. HPQ took 1.2s. Estimated remaining: 7m 43s. Rate: 153.8 symbols/min [2025-09-17T22:52:42.614078] [DEBUG] [LOCAL ] HPS: Derivative data saved (1794 records). [2025-09-17T22:52:42.612956] [DEBUG] [LOCAL ] HQH: Loaded 24920 existing records from primary storage. [2025-09-17T22:52:42.614293] [INFO ] [MAIN ] HQH: Loaded 24920 primary data records. [2025-09-17T22:52:42.614465] [INFO ] [MAIN ] HPS: Successfully saved derivative data. [2025-09-17T22:52:42.617093] [INFO ] [MAIN ] Derivative Progress: 899/2085 symbols completed. HPS took 1.1s. Estimated remaining: 7m 42s. Rate: 153.9 symbols/min [2025-09-17T22:52:42.934147] [DEBUG] [MAIN ] HQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:42.934886] [INFO ] [MAIN ] HQH: Generated 1794 derivative records from 24920 primary records. [2025-09-17T22:52:42.934954] [DEBUG] [LOCAL ] HQH: Saving derivative data. [2025-09-17T22:52:42.951093] [DEBUG] [LOCAL ] HQH: Derivative data saved (1794 records). [2025-09-17T22:52:42.951180] [INFO ] [MAIN ] HQH: Successfully saved derivative data. [2025-09-17T22:52:42.953186] [INFO ] [MAIN ] Derivative Progress: 900/2085 symbols completed. HQH took 0.4s. Estimated remaining: 7m 42s. Rate: 154.0 symbols/min [2025-09-17T22:52:42.953806] [INFO ] [MAIN ] HR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:42.954349] [INFO ] [MAIN ] HQL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:42.954558] [INFO ] [MAIN ] HRB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:43.000110] [DEBUG] [LOCAL ] HQL: Loaded 16166 existing records from primary storage. [2025-09-17T22:52:43.000396] [INFO ] [MAIN ] HQL: Loaded 16166 primary data records. [2025-09-17T22:52:43.151068] [DEBUG] [LOCAL ] HRB: Loaded 48638 existing records from primary storage. [2025-09-17T22:52:43.156862] [INFO ] [MAIN ] HRB: Loaded 48638 primary data records. [2025-09-17T22:52:43.503832] [DEBUG] [LOCAL ] HR: Loaded 51970 existing records from primary storage. [2025-09-17T22:52:43.508258] [INFO ] [MAIN ] HR: Loaded 51970 primary data records. [2025-09-17T22:52:44.068628] [DEBUG] [MAIN ] HQL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:44.069876] [INFO ] [MAIN ] HQL: Generated 1794 derivative records from 16166 primary records. [2025-09-17T22:52:44.070167] [DEBUG] [LOCAL ] HQL: Saving derivative data. [2025-09-17T22:52:44.087265] [DEBUG] [LOCAL ] HQL: Derivative data saved (1794 records). [2025-09-17T22:52:44.087458] [INFO ] [MAIN ] HQL: Successfully saved derivative data. [2025-09-17T22:52:44.089575] [INFO ] [MAIN ] Derivative Progress: 901/2085 symbols completed. HQL took 1.1s. Estimated remaining: 7m 42s. Rate: 153.6 symbols/min [2025-09-17T22:52:44.090232] [INFO ] [MAIN ] HRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:44.109175] [DEBUG] [MAIN ] HRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:44.110075] [INFO ] [MAIN ] HRB: Generated 1794 derivative records from 48638 primary records. [2025-09-17T22:52:44.110184] [DEBUG] [LOCAL ] HRB: Saving derivative data. [2025-09-17T22:52:44.127876] [DEBUG] [LOCAL ] HRB: Derivative data saved (1794 records). [2025-09-17T22:52:44.128078] [INFO ] [MAIN ] HRB: Successfully saved derivative data. [2025-09-17T22:52:44.131618] [INFO ] [MAIN ] Derivative Progress: 902/2085 symbols completed. HRB took 1.2s. Estimated remaining: 7m 42s. Rate: 153.8 symbols/min [2025-09-17T22:52:44.133890] [INFO ] [MAIN ] HRL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:44.155977] [DEBUG] [MAIN ] HR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:44.157018] [INFO ] [MAIN ] HR: Generated 1794 derivative records from 51970 primary records. [2025-09-17T22:52:44.157096] [DEBUG] [LOCAL ] HR: Saving derivative data. [2025-09-17T22:52:44.183286] [DEBUG] [LOCAL ] HRI: Loaded 33291 existing records from primary storage. [2025-09-17T22:52:44.184312] [INFO ] [MAIN ] HRI: Loaded 33291 primary data records. [2025-09-17T22:52:44.270832] [DEBUG] [LOCAL ] HR: Derivative data saved (1794 records). [2025-09-17T22:52:44.293447] [INFO ] [MAIN ] HR: Successfully saved derivative data. [2025-09-17T22:52:44.296072] [INFO ] [MAIN ] Derivative Progress: 903/2085 symbols completed. HR took 1.3s. Estimated remaining: 7m 41s. Rate: 153.9 symbols/min [2025-09-17T22:52:44.296715] [INFO ] [MAIN ] HRTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:44.523311] [DEBUG] [LOCAL ] HRL: Loaded 53082 existing records from primary storage. [2025-09-17T22:52:44.524411] [INFO ] [MAIN ] HRL: Loaded 53082 primary data records. [2025-09-17T22:52:44.740728] [DEBUG] [LOCAL ] HRTG: Loaded 32250 existing records from primary storage. [2025-09-17T22:52:44.871466] [INFO ] [MAIN ] HRTG: Loaded 32250 primary data records. [2025-09-17T22:52:45.005930] [DEBUG] [MAIN ] HRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:45.017487] [INFO ] [MAIN ] HRI: Generated 1794 derivative records from 33291 primary records. [2025-09-17T22:52:45.038135] [DEBUG] [LOCAL ] HRI: Saving derivative data. [2025-09-17T22:52:45.234428] [DEBUG] [LOCAL ] HRI: Derivative data saved (1794 records). [2025-09-17T22:52:45.234983] [INFO ] [MAIN ] HRI: Successfully saved derivative data. [2025-09-17T22:52:45.237252] [INFO ] [MAIN ] Derivative Progress: 904/2085 symbols completed. HRI took 1.1s. Estimated remaining: 7m 41s. Rate: 153.6 symbols/min [2025-09-17T22:52:45.237804] [INFO ] [MAIN ] HSBC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:45.252106] [DEBUG] [MAIN ] HRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:45.253255] [INFO ] [MAIN ] HRL: Generated 1794 derivative records from 53082 primary records. [2025-09-17T22:52:45.253589] [DEBUG] [LOCAL ] HRL: Saving derivative data. [2025-09-17T22:52:45.271501] [DEBUG] [LOCAL ] HRL: Derivative data saved (1794 records). [2025-09-17T22:52:45.271769] [INFO ] [MAIN ] HRL: Successfully saved derivative data. [2025-09-17T22:52:45.274064] [INFO ] [MAIN ] Derivative Progress: 905/2085 symbols completed. HRL took 1.1s. Estimated remaining: 7m 40s. Rate: 153.8 symbols/min [2025-09-17T22:52:45.274419] [INFO ] [MAIN ] HSHP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:45.291481] [DEBUG] [MAIN ] HRTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:45.292297] [INFO ] [MAIN ] HRTG: Generated 1794 derivative records from 32250 primary records. [2025-09-17T22:52:45.292485] [DEBUG] [LOCAL ] HRTG: Saving derivative data. [2025-09-17T22:52:45.320476] [DEBUG] [LOCAL ] HSHP: Loaded 15651 existing records from primary storage. [2025-09-17T22:52:45.321622] [INFO ] [MAIN ] HSHP: Loaded 15651 primary data records. [2025-09-17T22:52:45.322115] [DEBUG] [LOCAL ] HRTG: Derivative data saved (1794 records). [2025-09-17T22:52:45.327676] [INFO ] [MAIN ] HRTG: Successfully saved derivative data. [2025-09-17T22:52:45.364365] [INFO ] [MAIN ] Derivative Progress: 906/2085 symbols completed. HRTG took 1.1s. Estimated remaining: 7m 40s. Rate: 153.9 symbols/min [2025-09-17T22:52:45.427622] [INFO ] [MAIN ] HSY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:45.519074] [DEBUG] [LOCAL ] HSBC: Loaded 51268 existing records from primary storage. [2025-09-17T22:52:45.543046] [INFO ] [MAIN ] HSBC: Loaded 51268 primary data records. [2025-09-17T22:52:45.999771] [DEBUG] [LOCAL ] HSY: Loaded 50499 existing records from primary storage. [2025-09-17T22:52:46.000034] [INFO ] [MAIN ] HSY: Loaded 50499 primary data records. [2025-09-17T22:52:46.376175] [DEBUG] [MAIN ] HSHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:46.377865] [INFO ] [MAIN ] HSHP: Generated 1794 derivative records from 15651 primary records. [2025-09-17T22:52:46.378180] [DEBUG] [LOCAL ] HSHP: Saving derivative data. [2025-09-17T22:52:46.396787] [DEBUG] [LOCAL ] HSHP: Derivative data saved (1794 records). [2025-09-17T22:52:46.397310] [INFO ] [MAIN ] HSHP: Successfully saved derivative data. [2025-09-17T22:52:46.400755] [INFO ] [MAIN ] Derivative Progress: 907/2085 symbols completed. HSHP took 1.1s. Estimated remaining: 7m 40s. Rate: 153.7 symbols/min [2025-09-17T22:52:46.403706] [INFO ] [MAIN ] HTD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:46.423152] [DEBUG] [MAIN ] HSBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:46.424271] [INFO ] [MAIN ] HSBC: Generated 1794 derivative records from 51268 primary records. [2025-09-17T22:52:46.424490] [DEBUG] [LOCAL ] HSBC: Saving derivative data. [2025-09-17T22:52:46.447684] [DEBUG] [LOCAL ] HSBC: Derivative data saved (1794 records). [2025-09-17T22:52:46.447980] [INFO ] [MAIN ] HSBC: Successfully saved derivative data. [2025-09-17T22:52:46.456904] [DEBUG] [LOCAL ] HTD: Loaded 13433 existing records from primary storage. [2025-09-17T22:52:46.456191] [INFO ] [MAIN ] Derivative Progress: 908/2085 symbols completed. HSBC took 1.2s. Estimated remaining: 7m 39s. Rate: 153.8 symbols/min [2025-09-17T22:52:46.457514] [INFO ] [MAIN ] HTGC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:46.457886] [INFO ] [MAIN ] HTD: Loaded 13433 primary data records. [2025-09-17T22:52:46.588369] [DEBUG] [MAIN ] HSY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:46.589434] [INFO ] [MAIN ] HSY: Generated 1794 derivative records from 50499 primary records. [2025-09-17T22:52:46.589665] [DEBUG] [LOCAL ] HSY: Saving derivative data. [2025-09-17T22:52:46.826292] [DEBUG] [LOCAL ] HSY: Derivative data saved (1794 records). [2025-09-17T22:52:46.826451] [INFO ] [MAIN ] HSY: Successfully saved derivative data. [2025-09-17T22:52:46.829122] [INFO ] [MAIN ] Derivative Progress: 909/2085 symbols completed. HSY took 1.4s. Estimated remaining: 7m 39s. Rate: 153.8 symbols/min [2025-09-17T22:52:46.829582] [INFO ] [MAIN ] HTH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:46.851010] [DEBUG] [LOCAL ] HTGC: Loaded 47767 existing records from primary storage. [2025-09-17T22:52:46.851596] [INFO ] [MAIN ] HTGC: Loaded 47767 primary data records. [2025-09-17T22:52:47.178001] [DEBUG] [LOCAL ] HTH: Loaded 32885 existing records from primary storage. [2025-09-17T22:52:47.188473] [INFO ] [MAIN ] HTH: Loaded 32885 primary data records. [2025-09-17T22:52:47.272423] [DEBUG] [MAIN ] HTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:47.285920] [INFO ] [MAIN ] HTD: Generated 1794 derivative records from 13433 primary records. [2025-09-17T22:52:47.286202] [DEBUG] [LOCAL ] HTD: Saving derivative data. [2025-09-17T22:52:47.523330] [DEBUG] [LOCAL ] HTD: Derivative data saved (1794 records). [2025-09-17T22:52:47.523793] [INFO ] [MAIN ] HTD: Successfully saved derivative data. [2025-09-17T22:52:47.526020] [INFO ] [MAIN ] Derivative Progress: 910/2085 symbols completed. HTD took 1.1s. Estimated remaining: 7m 39s. Rate: 153.7 symbols/min [2025-09-17T22:52:47.526985] [INFO ] [MAIN ] HUBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:47.547515] [DEBUG] [MAIN ] HTGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:47.548322] [INFO ] [MAIN ] HTGC: Generated 1794 derivative records from 47767 primary records. [2025-09-17T22:52:47.548601] [DEBUG] [LOCAL ] HTGC: Saving derivative data. [2025-09-17T22:52:47.567391] [DEBUG] [LOCAL ] HTGC: Derivative data saved (1794 records). [2025-09-17T22:52:47.568556] [INFO ] [MAIN ] HTGC: Successfully saved derivative data. [2025-09-17T22:52:47.572456] [INFO ] [MAIN ] Derivative Progress: 911/2085 symbols completed. HTGC took 1.1s. Estimated remaining: 7m 38s. Rate: 153.8 symbols/min [2025-09-17T22:52:47.581960] [INFO ] [MAIN ] HUBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:47.595894] [DEBUG] [MAIN ] HTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:47.596618] [INFO ] [MAIN ] HTH: Generated 1794 derivative records from 32885 primary records. [2025-09-17T22:52:47.596799] [DEBUG] [LOCAL ] HTH: Saving derivative data. [2025-09-17T22:52:47.622778] [DEBUG] [LOCAL ] HUBB: Loaded 37613 existing records from primary storage. [2025-09-17T22:52:47.623446] [INFO ] [MAIN ] HUBB: Loaded 37613 primary data records. [2025-09-17T22:52:47.698609] [DEBUG] [LOCAL ] HTH: Derivative data saved (1794 records). [2025-09-17T22:52:47.716026] [INFO ] [MAIN ] HTH: Successfully saved derivative data. [2025-09-17T22:52:47.718504] [INFO ] [MAIN ] Derivative Progress: 912/2085 symbols completed. HTH took 0.9s. Estimated remaining: 7m 37s. Rate: 153.9 symbols/min [2025-09-17T22:52:47.735688] [INFO ] [MAIN ] HUM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:47.978230] [DEBUG] [LOCAL ] HUBS: Loaded 39848 existing records from primary storage. [2025-09-17T22:52:47.978473] [INFO ] [MAIN ] HUBS: Loaded 39848 primary data records. [2025-09-17T22:52:48.347580] [DEBUG] [LOCAL ] HUM: Loaded 48841 existing records from primary storage. [2025-09-17T22:52:48.348700] [INFO ] [MAIN ] HUM: Loaded 48841 primary data records. [2025-09-17T22:52:48.509025] [DEBUG] [MAIN ] HUBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:48.515497] [INFO ] [MAIN ] HUBB: Generated 1794 derivative records from 37613 primary records. [2025-09-17T22:52:48.526162] [DEBUG] [LOCAL ] HUBB: Saving derivative data. [2025-09-17T22:52:48.752181] [DEBUG] [LOCAL ] HUBB: Derivative data saved (1794 records). [2025-09-17T22:52:48.752603] [INFO ] [MAIN ] HUBB: Successfully saved derivative data. [2025-09-17T22:52:48.755059] [INFO ] [MAIN ] Derivative Progress: 913/2085 symbols completed. HUBB took 1.2s. Estimated remaining: 7m 38s. Rate: 153.6 symbols/min [2025-09-17T22:52:48.769632] [DEBUG] [MAIN ] HUBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:48.771085] [INFO ] [MAIN ] HUBS: Generated 1794 derivative records from 39848 primary records. [2025-09-17T22:52:48.771169] [DEBUG] [LOCAL ] HUBS: Saving derivative data. [2025-09-17T22:52:48.790327] [DEBUG] [LOCAL ] HUBS: Derivative data saved (1794 records). [2025-09-17T22:52:48.790455] [INFO ] [MAIN ] HUBS: Successfully saved derivative data. [2025-09-17T22:52:48.794036] [INFO ] [MAIN ] Derivative Progress: 914/2085 symbols completed. HUBS took 1.2s. Estimated remaining: 7m 37s. Rate: 153.8 symbols/min [2025-09-17T22:52:48.811337] [DEBUG] [MAIN ] HUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:48.811976] [INFO ] [MAIN ] HUM: Generated 1794 derivative records from 48841 primary records. [2025-09-17T22:52:48.812038] [DEBUG] [LOCAL ] HUM: Saving derivative data. [2025-09-17T22:52:48.827390] [DEBUG] [LOCAL ] HUM: Derivative data saved (1794 records). [2025-09-17T22:52:48.827456] [INFO ] [MAIN ] HUM: Successfully saved derivative data. [2025-09-17T22:52:48.829803] [INFO ] [MAIN ] Derivative Progress: 915/2085 symbols completed. HUM took 1.1s. Estimated remaining: 7m 36s. Rate: 154.0 symbols/min [2025-09-17T22:52:48.830371] [INFO ] [MAIN ] HUN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:48.830810] [INFO ] [MAIN ] HVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:48.830741] [INFO ] [MAIN ] HUYA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:48.851119] [DEBUG] [LOCAL ] HVT: Loaded 16284 existing records from primary storage. [2025-09-17T22:52:48.851359] [INFO ] [MAIN ] HVT: Loaded 16284 primary data records. [2025-09-17T22:52:49.210079] [DEBUG] [LOCAL ] HUYA: Loaded 44401 existing records from primary storage. [2025-09-17T22:52:49.224549] [INFO ] [MAIN ] HUYA: Loaded 44401 primary data records. [2025-09-17T22:52:49.257606] [DEBUG] [LOCAL ] HUN: Loaded 53201 existing records from primary storage. [2025-09-17T22:52:49.284474] [INFO ] [MAIN ] HUN: Loaded 53201 primary data records. [2025-09-17T22:52:49.918897] [DEBUG] [MAIN ] HVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:49.920009] [INFO ] [MAIN ] HVT: Generated 1794 derivative records from 16284 primary records. [2025-09-17T22:52:49.920116] [DEBUG] [LOCAL ] HVT: Saving derivative data. [2025-09-17T22:52:49.939100] [DEBUG] [LOCAL ] HVT: Derivative data saved (1794 records). [2025-09-17T22:52:49.940805] [INFO ] [MAIN ] HVT: Successfully saved derivative data. [2025-09-17T22:52:49.943365] [INFO ] [MAIN ] Derivative Progress: 916/2085 symbols completed. HVT took 1.1s. Estimated remaining: 7m 37s. Rate: 153.6 symbols/min [2025-09-17T22:52:49.943940] [INFO ] [MAIN ] HWM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:49.957511] [DEBUG] [MAIN ] HUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:49.958188] [INFO ] [MAIN ] HUYA: Generated 1794 derivative records from 44401 primary records. [2025-09-17T22:52:49.958371] [DEBUG] [LOCAL ] HUYA: Saving derivative data. [2025-09-17T22:52:49.988629] [DEBUG] [LOCAL ] HUYA: Derivative data saved (1794 records). [2025-09-17T22:52:49.989185] [DEBUG] [MAIN ] HUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:49.988995] [INFO ] [MAIN ] HUYA: Successfully saved derivative data. [2025-09-17T22:52:49.989954] [INFO ] [MAIN ] HUN: Generated 1794 derivative records from 53201 primary records. [2025-09-17T22:52:49.992724] [INFO ] [MAIN ] Derivative Progress: 917/2085 symbols completed. HUYA took 1.2s. Estimated remaining: 7m 36s. Rate: 153.8 symbols/min [2025-09-17T22:52:49.993122] [INFO ] [MAIN ] HXL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:49.992844] [DEBUG] [LOCAL ] HUN: Saving derivative data. [2025-09-17T22:52:50.010384] [DEBUG] [LOCAL ] HUN: Derivative data saved (1794 records). [2025-09-17T22:52:50.010574] [INFO ] [MAIN ] HUN: Successfully saved derivative data. [2025-09-17T22:52:50.013167] [INFO ] [MAIN ] Derivative Progress: 918/2085 symbols completed. HUN took 1.2s. Estimated remaining: 7m 35s. Rate: 153.9 symbols/min [2025-09-17T22:52:50.013435] [INFO ] [MAIN ] HY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:50.041588] [DEBUG] [LOCAL ] HY: Loaded 10419 existing records from primary storage. [2025-09-17T22:52:50.041746] [INFO ] [MAIN ] HY: Loaded 10419 primary data records. [2025-09-17T22:52:50.173638] [DEBUG] [LOCAL ] HWM: Loaded 53039 existing records from primary storage. [2025-09-17T22:52:50.179610] [INFO ] [MAIN ] HWM: Loaded 53039 primary data records. [2025-09-17T22:52:50.346338] [DEBUG] [LOCAL ] HXL: Loaded 46239 existing records from primary storage. [2025-09-17T22:52:50.365580] [INFO ] [MAIN ] HXL: Loaded 46239 primary data records. [2025-09-17T22:52:51.048421] [DEBUG] [MAIN ] HWM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:51.050040] [INFO ] [MAIN ] HWM: Generated 1794 derivative records from 53039 primary records. [2025-09-17T22:52:51.050158] [DEBUG] [LOCAL ] HWM: Saving derivative data. [2025-09-17T22:52:51.048093] [DEBUG] [MAIN ] HY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:51.052391] [INFO ] [MAIN ] HY: Generated 1794 derivative records from 10419 primary records. [2025-09-17T22:52:51.052586] [DEBUG] [LOCAL ] HY: Saving derivative data. [2025-09-17T22:52:51.089141] [DEBUG] [MAIN ] HXL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:51.089946] [INFO ] [MAIN ] HXL: Generated 1794 derivative records from 46239 primary records. [2025-09-17T22:52:51.092807] [DEBUG] [LOCAL ] HXL: Saving derivative data. [2025-09-17T22:52:51.095944] [DEBUG] [LOCAL ] HWM: Derivative data saved (1794 records). [2025-09-17T22:52:51.097213] [INFO ] [MAIN ] HWM: Successfully saved derivative data. [2025-09-17T22:52:51.106696] [INFO ] [MAIN ] Derivative Progress: 919/2085 symbols completed. HWM took 1.2s. Estimated remaining: 7m 35s. Rate: 153.6 symbols/min [2025-09-17T22:52:51.110929] [INFO ] [MAIN ] HYI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:51.114403] [DEBUG] [LOCAL ] HY: Derivative data saved (1794 records). [2025-09-17T22:52:51.114753] [INFO ] [MAIN ] HY: Successfully saved derivative data. [2025-09-17T22:52:51.116997] [INFO ] [MAIN ] Derivative Progress: 920/2085 symbols completed. HY took 1.1s. Estimated remaining: 7m 34s. Rate: 153.8 symbols/min [2025-09-17T22:52:51.118411] [INFO ] [MAIN ] HYT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:51.123629] [DEBUG] [LOCAL ] HXL: Derivative data saved (1794 records). [2025-09-17T22:52:51.123838] [INFO ] [MAIN ] HXL: Successfully saved derivative data. [2025-09-17T22:52:51.126760] [INFO ] [MAIN ] Derivative Progress: 921/2085 symbols completed. HXL took 1.1s. Estimated remaining: 7m 34s. Rate: 154.0 symbols/min [2025-09-17T22:52:51.127432] [INFO ] [MAIN ] HYTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:51.131726] [DEBUG] [LOCAL ] HYI: Loaded 8918 existing records from primary storage. [2025-09-17T22:52:51.131962] [INFO ] [MAIN ] HYI: Loaded 8918 primary data records. [2025-09-17T22:52:51.225702] [DEBUG] [LOCAL ] HYTR: Loaded 3209 existing records from primary storage. [2025-09-17T22:52:51.243500] [INFO ] [MAIN ] HYTR: Loaded 3209 primary data records. [2025-09-17T22:52:51.459698] [DEBUG] [LOCAL ] HYT: Loaded 33259 existing records from primary storage. [2025-09-17T22:52:51.570092] [INFO ] [MAIN ] HYT: Loaded 33259 primary data records. [2025-09-17T22:52:52.182204] [DEBUG] [MAIN ] HYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:52.183310] [INFO ] [MAIN ] HYI: Generated 1794 derivative records from 8918 primary records. [2025-09-17T22:52:52.183593] [DEBUG] [LOCAL ] HYI: Saving derivative data. [2025-09-17T22:52:52.214379] [DEBUG] [MAIN ] HYTR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:52:52.216293] [INFO ] [MAIN ] HYTR: Generated 1793 derivative records from 3209 primary records. [2025-09-17T22:52:52.217476] [DEBUG] [LOCAL ] HYI: Derivative data saved (1794 records). [2025-09-17T22:52:52.217731] [INFO ] [MAIN ] HYI: Successfully saved derivative data. [2025-09-17T22:52:52.220727] [INFO ] [MAIN ] Derivative Progress: 922/2085 symbols completed. HYI took 1.1s. Estimated remaining: 7m 34s. Rate: 153.7 symbols/min [2025-09-17T22:52:52.217681] [DEBUG] [LOCAL ] HYTR: Saving derivative data. [2025-09-17T22:52:52.229846] [INFO ] [MAIN ] HZO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:52.248837] [DEBUG] [MAIN ] HYT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:52.249755] [INFO ] [MAIN ] HYT: Generated 1794 derivative records from 33259 primary records. [2025-09-17T22:52:52.249820] [DEBUG] [LOCAL ] HYT: Saving derivative data. [2025-09-17T22:52:52.267187] [DEBUG] [LOCAL ] HYT: Derivative data saved (1794 records). [2025-09-17T22:52:52.269809] [INFO ] [MAIN ] HYT: Successfully saved derivative data. [2025-09-17T22:52:52.272688] [INFO ] [MAIN ] Derivative Progress: 923/2085 symbols completed. HYT took 1.2s. Estimated remaining: 7m 33s. Rate: 153.8 symbols/min [2025-09-17T22:52:52.269666] [DEBUG] [LOCAL ] HYTR: Derivative data saved (1793 records). [2025-09-17T22:52:52.273213] [INFO ] [MAIN ] HYTR: Successfully saved derivative data. [2025-09-17T22:52:52.272968] [INFO ] [MAIN ] IAE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:52.275817] [INFO ] [MAIN ] Derivative Progress: 924/2085 symbols completed. HYTR took 1.1s. Estimated remaining: 7m 32s. Rate: 154.0 symbols/min [2025-09-17T22:52:52.276334] [INFO ] [MAIN ] IAG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:52.292817] [DEBUG] [LOCAL ] IAE: Loaded 5729 existing records from primary storage. [2025-09-17T22:52:52.292955] [INFO ] [MAIN ] IAE: Loaded 5729 primary data records. [2025-09-17T22:52:52.398699] [DEBUG] [LOCAL ] HZO: Loaded 29399 existing records from primary storage. [2025-09-17T22:52:52.414782] [INFO ] [MAIN ] HZO: Loaded 29399 primary data records. [2025-09-17T22:52:52.960098] [DEBUG] [LOCAL ] IAG: Loaded 53433 existing records from primary storage. [2025-09-17T22:52:52.960479] [INFO ] [MAIN ] IAG: Loaded 53433 primary data records. [2025-09-17T22:52:53.309250] [DEBUG] [MAIN ] HZO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:53.318173] [INFO ] [MAIN ] HZO: Generated 1794 derivative records from 29399 primary records. [2025-09-17T22:52:53.318296] [DEBUG] [LOCAL ] HZO: Saving derivative data. [2025-09-17T22:52:53.324491] [DEBUG] [MAIN ] IAE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:53.326693] [INFO ] [MAIN ] IAE: Generated 1794 derivative records from 5729 primary records. [2025-09-17T22:52:53.333976] [DEBUG] [LOCAL ] IAE: Saving derivative data. [2025-09-17T22:52:53.356484] [DEBUG] [LOCAL ] IAE: Derivative data saved (1794 records). [2025-09-17T22:52:53.356670] [INFO ] [MAIN ] IAE: Successfully saved derivative data. [2025-09-17T22:52:53.359323] [INFO ] [MAIN ] Derivative Progress: 925/2085 symbols completed. IAE took 1.1s. Estimated remaining: 7m 33s. Rate: 153.7 symbols/min [2025-09-17T22:52:53.360398] [INFO ] [MAIN ] IBM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:53.364536] [DEBUG] [LOCAL ] HZO: Derivative data saved (1794 records). [2025-09-17T22:52:53.364824] [INFO ] [MAIN ] HZO: Successfully saved derivative data. [2025-09-17T22:52:53.369340] [INFO ] [MAIN ] Derivative Progress: 926/2085 symbols completed. HZO took 1.1s. Estimated remaining: 7m 32s. Rate: 153.8 symbols/min [2025-09-17T22:52:53.370791] [INFO ] [MAIN ] IBN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:53.387606] [DEBUG] [MAIN ] IAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:53.388528] [INFO ] [MAIN ] IAG: Generated 1794 derivative records from 53433 primary records. [2025-09-17T22:52:53.388742] [DEBUG] [LOCAL ] IAG: Saving derivative data. [2025-09-17T22:52:53.407575] [DEBUG] [LOCAL ] IAG: Derivative data saved (1794 records). [2025-09-17T22:52:53.407843] [INFO ] [MAIN ] IAG: Successfully saved derivative data. [2025-09-17T22:52:53.412869] [INFO ] [MAIN ] Derivative Progress: 927/2085 symbols completed. IAG took 1.1s. Estimated remaining: 7m 31s. Rate: 154.0 symbols/min [2025-09-17T22:52:53.413387] [INFO ] [MAIN ] IBP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:53.476022] [DEBUG] [LOCAL ] IBN: Loaded 52931 existing records from primary storage. [2025-09-17T22:52:53.476334] [INFO ] [MAIN ] IBN: Loaded 52931 primary data records. [2025-09-17T22:52:53.609125] [DEBUG] [LOCAL ] IBP: Loaded 29531 existing records from primary storage. [2025-09-17T22:52:53.609955] [DEBUG] [LOCAL ] IBM: Loaded 53609 existing records from primary storage. [2025-09-17T22:52:53.610112] [INFO ] [MAIN ] IBM: Loaded 53609 primary data records. [2025-09-17T22:52:53.610571] [INFO ] [MAIN ] IBP: Loaded 29531 primary data records. [2025-09-17T22:52:54.494586] [DEBUG] [MAIN ] IBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:54.507484] [INFO ] [MAIN ] IBN: Generated 1794 derivative records from 52931 primary records. [2025-09-17T22:52:54.508067] [DEBUG] [LOCAL ] IBN: Saving derivative data. [2025-09-17T22:52:54.509193] [DEBUG] [MAIN ] IBP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:54.519674] [INFO ] [MAIN ] IBP: Generated 1794 derivative records from 29531 primary records. [2025-09-17T22:52:54.523918] [DEBUG] [LOCAL ] IBP: Saving derivative data. [2025-09-17T22:52:54.545333] [DEBUG] [MAIN ] IBM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:54.552555] [INFO ] [MAIN ] IBM: Generated 1794 derivative records from 53609 primary records. [2025-09-17T22:52:54.553731] [DEBUG] [LOCAL ] IBM: Saving derivative data. [2025-09-17T22:52:54.557220] [DEBUG] [LOCAL ] IBP: Derivative data saved (1794 records). [2025-09-17T22:52:54.565191] [INFO ] [MAIN ] IBP: Successfully saved derivative data. [2025-09-17T22:52:54.568367] [INFO ] [MAIN ] Derivative Progress: 928/2085 symbols completed. IBP took 1.2s. Estimated remaining: 7m 32s. Rate: 153.7 symbols/min [2025-09-17T22:52:54.578409] [DEBUG] [LOCAL ] IBM: Derivative data saved (1794 records). [2025-09-17T22:52:54.578506] [INFO ] [MAIN ] IBM: Successfully saved derivative data. [2025-09-17T22:52:54.576918] [DEBUG] [LOCAL ] IBN: Derivative data saved (1794 records). [2025-09-17T22:52:54.581719] [INFO ] [MAIN ] Derivative Progress: 929/2085 symbols completed. IBM took 1.2s. Estimated remaining: 7m 31s. Rate: 153.8 symbols/min [2025-09-17T22:52:54.581988] [INFO ] [MAIN ] IBN: Successfully saved derivative data. [2025-09-17T22:52:54.584137] [INFO ] [MAIN ] Derivative Progress: 930/2085 symbols completed. IBN took 1.2s. Estimated remaining: 7m 30s. Rate: 154.0 symbols/min [2025-09-17T22:52:54.584782] [INFO ] [MAIN ] ICL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:54.584846] [INFO ] [MAIN ] IBTA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:54.584980] [INFO ] [MAIN ] ICE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:54.638432] [DEBUG] [LOCAL ] ICL: Loaded 39017 existing records from primary storage. [2025-09-17T22:52:54.638689] [INFO ] [MAIN ] ICL: Loaded 39017 primary data records. [2025-09-17T22:52:54.770273] [DEBUG] [LOCAL ] IBTA: Loaded 38303 existing records from primary storage. [2025-09-17T22:52:54.770505] [INFO ] [MAIN ] IBTA: Loaded 38303 primary data records. [2025-09-17T22:52:55.092028] [DEBUG] [LOCAL ] ICE: Loaded 53026 existing records from primary storage. [2025-09-17T22:52:55.098066] [INFO ] [MAIN ] ICE: Loaded 53026 primary data records. [2025-09-17T22:52:55.699929] [DEBUG] [MAIN ] ICL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:55.701258] [INFO ] [MAIN ] ICL: Generated 1794 derivative records from 39017 primary records. [2025-09-17T22:52:55.701425] [DEBUG] [LOCAL ] ICL: Saving derivative data. [2025-09-17T22:52:55.747470] [DEBUG] [LOCAL ] ICL: Derivative data saved (1794 records). [2025-09-17T22:52:55.747785] [INFO ] [MAIN ] ICL: Successfully saved derivative data. [2025-09-17T22:52:55.750351] [INFO ] [MAIN ] Derivative Progress: 931/2085 symbols completed. ICL took 1.2s. Estimated remaining: 7m 31s. Rate: 153.7 symbols/min [2025-09-17T22:52:55.751485] [INFO ] [MAIN ] IDA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:55.752005] [DEBUG] [MAIN ] IBTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:55.753200] [INFO ] [MAIN ] IBTA: Generated 1794 derivative records from 38303 primary records. [2025-09-17T22:52:55.753632] [DEBUG] [LOCAL ] IBTA: Saving derivative data. [2025-09-17T22:52:55.777895] [DEBUG] [LOCAL ] IBTA: Derivative data saved (1794 records). [2025-09-17T22:52:55.779548] [INFO ] [MAIN ] IBTA: Successfully saved derivative data. [2025-09-17T22:52:55.783558] [INFO ] [MAIN ] Derivative Progress: 932/2085 symbols completed. IBTA took 1.2s. Estimated remaining: 7m 30s. Rate: 153.8 symbols/min [2025-09-17T22:52:55.784634] [INFO ] [MAIN ] IDE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:55.802896] [DEBUG] [MAIN ] ICE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:55.803817] [INFO ] [MAIN ] ICE: Generated 1794 derivative records from 53026 primary records. [2025-09-17T22:52:55.804074] [DEBUG] [LOCAL ] ICE: Saving derivative data. [2025-09-17T22:52:55.840295] [DEBUG] [LOCAL ] ICE: Derivative data saved (1794 records). [2025-09-17T22:52:55.841122] [INFO ] [MAIN ] ICE: Successfully saved derivative data. [2025-09-17T22:52:55.845727] [INFO ] [MAIN ] Derivative Progress: 933/2085 symbols completed. ICE took 1.3s. Estimated remaining: 7m 29s. Rate: 154.0 symbols/min [2025-09-17T22:52:55.852384] [INFO ] [MAIN ] IDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:55.852278] [DEBUG] [LOCAL ] IDE: Loaded 8365 existing records from primary storage. [2025-09-17T22:52:55.852974] [INFO ] [MAIN ] IDE: Loaded 8365 primary data records. [2025-09-17T22:52:56.004947] [DEBUG] [LOCAL ] IDA: Loaded 32074 existing records from primary storage. [2025-09-17T22:52:56.025201] [INFO ] [MAIN ] IDA: Loaded 32074 primary data records. [2025-09-17T22:52:56.092486] [DEBUG] [LOCAL ] IDT: Loaded 17478 existing records from primary storage. [2025-09-17T22:52:56.120509] [INFO ] [MAIN ] IDT: Loaded 17478 primary data records. [2025-09-17T22:52:57.116577] [DEBUG] [MAIN ] IDE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:57.117534] [INFO ] [MAIN ] IDE: Generated 1794 derivative records from 8365 primary records. [2025-09-17T22:52:57.117880] [DEBUG] [LOCAL ] IDE: Saving derivative data. [2025-09-17T22:52:57.137348] [DEBUG] [LOCAL ] IDE: Derivative data saved (1794 records). [2025-09-17T22:52:57.138450] [INFO ] [MAIN ] IDE: Successfully saved derivative data. [2025-09-17T22:52:57.155350] [DEBUG] [MAIN ] IDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:57.153903] [INFO ] [MAIN ] Derivative Progress: 934/2085 symbols completed. IDE took 1.4s. Estimated remaining: 7m 30s. Rate: 153.6 symbols/min [2025-09-17T22:52:57.156425] [INFO ] [MAIN ] IDT: Generated 1794 derivative records from 17478 primary records. [2025-09-17T22:52:57.156608] [DEBUG] [LOCAL ] IDT: Saving derivative data. [2025-09-17T22:52:57.164179] [INFO ] [MAIN ] IEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:57.177540] [DEBUG] [MAIN ] IDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:57.178411] [INFO ] [MAIN ] IDA: Generated 1794 derivative records from 32074 primary records. [2025-09-17T22:52:57.182284] [DEBUG] [LOCAL ] IDA: Saving derivative data. [2025-09-17T22:52:57.194666] [DEBUG] [LOCAL ] IDT: Derivative data saved (1794 records). [2025-09-17T22:52:57.199757] [INFO ] [MAIN ] IDT: Successfully saved derivative data. [2025-09-17T22:52:57.204804] [INFO ] [MAIN ] Derivative Progress: 935/2085 symbols completed. IDT took 1.4s. Estimated remaining: 7m 29s. Rate: 153.7 symbols/min [2025-09-17T22:52:57.205347] [INFO ] [MAIN ] IFF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:57.205604] [DEBUG] [LOCAL ] IDA: Derivative data saved (1794 records). [2025-09-17T22:52:57.205955] [INFO ] [MAIN ] IDA: Successfully saved derivative data. [2025-09-17T22:52:57.208462] [INFO ] [MAIN ] Derivative Progress: 936/2085 symbols completed. IDA took 1.5s. Estimated remaining: 7m 28s. Rate: 153.9 symbols/min [2025-09-17T22:52:57.209031] [INFO ] [MAIN ] IFN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:57.240084] [DEBUG] [LOCAL ] IFN: Loaded 18298 existing records from primary storage. [2025-09-17T22:52:57.240276] [INFO ] [MAIN ] IFN: Loaded 18298 primary data records. [2025-09-17T22:52:57.371126] [DEBUG] [LOCAL ] IEX: Loaded 38392 existing records from primary storage. [2025-09-17T22:52:57.375370] [INFO ] [MAIN ] IEX: Loaded 38392 primary data records. [2025-09-17T22:52:57.557955] [DEBUG] [LOCAL ] IFF: Loaded 50946 existing records from primary storage. [2025-09-17T22:52:57.588709] [INFO ] [MAIN ] IFF: Loaded 50946 primary data records. [2025-09-17T22:52:58.298819] [DEBUG] [MAIN ] IFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:58.300052] [INFO ] [MAIN ] IFN: Generated 1794 derivative records from 18298 primary records. [2025-09-17T22:52:58.300589] [DEBUG] [LOCAL ] IFN: Saving derivative data. [2025-09-17T22:52:58.333859] [DEBUG] [MAIN ] IEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:58.336342] [INFO ] [MAIN ] IEX: Generated 1794 derivative records from 38392 primary records. [2025-09-17T22:52:58.336742] [DEBUG] [LOCAL ] IEX: Saving derivative data. [2025-09-17T22:52:58.336402] [DEBUG] [LOCAL ] IFN: Derivative data saved (1794 records). [2025-09-17T22:52:58.337099] [INFO ] [MAIN ] IFN: Successfully saved derivative data. [2025-09-17T22:52:58.340398] [INFO ] [MAIN ] Derivative Progress: 937/2085 symbols completed. IFN took 1.1s. Estimated remaining: 7m 29s. Rate: 153.6 symbols/min [2025-09-17T22:52:58.348922] [INFO ] [MAIN ] IFS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:58.362209] [DEBUG] [LOCAL ] IEX: Derivative data saved (1794 records). [2025-09-17T22:52:58.362422] [INFO ] [MAIN ] IEX: Successfully saved derivative data. [2025-09-17T22:52:58.365093] [INFO ] [MAIN ] Derivative Progress: 938/2085 symbols completed. IEX took 1.2s. Estimated remaining: 7m 28s. Rate: 153.7 symbols/min [2025-09-17T22:52:58.373155] [INFO ] [MAIN ] IGA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:58.385672] [DEBUG] [MAIN ] IFF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:58.386575] [INFO ] [MAIN ] IFF: Generated 1794 derivative records from 50946 primary records. [2025-09-17T22:52:58.386860] [DEBUG] [LOCAL ] IFF: Saving derivative data. [2025-09-17T22:52:58.413962] [DEBUG] [LOCAL ] IFS: Loaded 22968 existing records from primary storage. [2025-09-17T22:52:58.418831] [DEBUG] [LOCAL ] IGA: Loaded 9709 existing records from primary storage. [2025-09-17T22:52:58.421359] [DEBUG] [LOCAL ] IFF: Derivative data saved (1794 records). [2025-09-17T22:52:58.420922] [INFO ] [MAIN ] IFS: Loaded 22968 primary data records. [2025-09-17T22:52:58.421621] [INFO ] [MAIN ] IFF: Successfully saved derivative data. [2025-09-17T22:52:58.421535] [INFO ] [MAIN ] IGA: Loaded 9709 primary data records. [2025-09-17T22:52:58.429881] [INFO ] [MAIN ] Derivative Progress: 939/2085 symbols completed. IFF took 1.2s. Estimated remaining: 7m 27s. Rate: 153.8 symbols/min [2025-09-17T22:52:58.489406] [INFO ] [MAIN ] IGD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:58.810433] [DEBUG] [LOCAL ] IGD: Loaded 19315 existing records from primary storage. [2025-09-17T22:52:58.834430] [INFO ] [MAIN ] IGD: Loaded 19315 primary data records. [2025-09-17T22:52:59.452832] [DEBUG] [MAIN ] IFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:59.454217] [INFO ] [MAIN ] IFS: Generated 1794 derivative records from 22968 primary records. [2025-09-17T22:52:59.454628] [DEBUG] [MAIN ] IGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:59.455566] [INFO ] [MAIN ] IGA: Generated 1794 derivative records from 9709 primary records. [2025-09-17T22:52:59.454759] [DEBUG] [LOCAL ] IFS: Saving derivative data. [2025-09-17T22:52:59.455891] [DEBUG] [LOCAL ] IGA: Saving derivative data. [2025-09-17T22:52:59.489848] [DEBUG] [LOCAL ] IFS: Derivative data saved (1794 records). [2025-09-17T22:52:59.491057] [INFO ] [MAIN ] IFS: Successfully saved derivative data. [2025-09-17T22:52:59.494083] [INFO ] [MAIN ] Derivative Progress: 940/2085 symbols completed. IFS took 1.1s. Estimated remaining: 7m 27s. Rate: 153.6 symbols/min [2025-09-17T22:52:59.495557] [INFO ] [MAIN ] IGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:59.495292] [DEBUG] [LOCAL ] IGA: Derivative data saved (1794 records). [2025-09-17T22:52:59.497627] [INFO ] [MAIN ] IGA: Successfully saved derivative data. [2025-09-17T22:52:59.500437] [INFO ] [MAIN ] Derivative Progress: 941/2085 symbols completed. IGA took 1.1s. Estimated remaining: 7m 27s. Rate: 153.7 symbols/min [2025-09-17T22:52:59.501745] [INFO ] [MAIN ] IGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:59.516632] [DEBUG] [MAIN ] IGD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:52:59.520784] [INFO ] [MAIN ] IGD: Generated 1794 derivative records from 19315 primary records. [2025-09-17T22:52:59.520975] [DEBUG] [LOCAL ] IGD: Saving derivative data. [2025-09-17T22:52:59.519969] [DEBUG] [LOCAL ] IGI: Loaded 3745 existing records from primary storage. [2025-09-17T22:52:59.522054] [INFO ] [MAIN ] IGI: Loaded 3745 primary data records. [2025-09-17T22:52:59.611891] [DEBUG] [LOCAL ] IGD: Derivative data saved (1794 records). [2025-09-17T22:52:59.611991] [INFO ] [MAIN ] IGD: Successfully saved derivative data. [2025-09-17T22:52:59.625938] [INFO ] [MAIN ] Derivative Progress: 942/2085 symbols completed. IGD took 1.1s. Estimated remaining: 7m 26s. Rate: 153.8 symbols/min [2025-09-17T22:52:59.663484] [INFO ] [MAIN ] IH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:52:59.869492] [DEBUG] [LOCAL ] IH: Loaded 3585 existing records from primary storage. [2025-09-17T22:52:59.882669] [INFO ] [MAIN ] IH: Loaded 3585 primary data records. [2025-09-17T22:52:59.895966] [DEBUG] [LOCAL ] IGR: Loaded 30557 existing records from primary storage. [2025-09-17T22:52:59.921989] [INFO ] [MAIN ] IGR: Loaded 30557 primary data records. [2025-09-17T22:53:00.579573] [DEBUG] [MAIN ] IGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:00.581088] [INFO ] [MAIN ] IGI: Generated 1794 derivative records from 3745 primary records. [2025-09-17T22:53:00.581306] [DEBUG] [LOCAL ] IGI: Saving derivative data. [2025-09-17T22:53:00.598907] [DEBUG] [LOCAL ] IGI: Derivative data saved (1794 records). [2025-09-17T22:53:00.600352] [INFO ] [MAIN ] IGI: Successfully saved derivative data. [2025-09-17T22:53:00.603262] [INFO ] [MAIN ] Derivative Progress: 943/2085 symbols completed. IGI took 1.1s. Estimated remaining: 7m 26s. Rate: 153.6 symbols/min [2025-09-17T22:53:00.618982] [DEBUG] [MAIN ] IH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:00.619871] [INFO ] [MAIN ] IH: Generated 1794 derivative records from 3585 primary records. [2025-09-17T22:53:00.632282] [DEBUG] [LOCAL ] IH: Saving derivative data. [2025-09-17T22:53:00.632197] [DEBUG] [MAIN ] IGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:00.634074] [INFO ] [MAIN ] IGR: Generated 1794 derivative records from 30557 primary records. [2025-09-17T22:53:00.634441] [DEBUG] [LOCAL ] IGR: Saving derivative data. [2025-09-17T22:53:00.664540] [DEBUG] [LOCAL ] IH: Derivative data saved (1794 records). [2025-09-17T22:53:00.665223] [INFO ] [MAIN ] IH: Successfully saved derivative data. [2025-09-17T22:53:00.668446] [INFO ] [MAIN ] Derivative Progress: 944/2085 symbols completed. IH took 1.0s. Estimated remaining: 7m 25s. Rate: 153.7 symbols/min [2025-09-17T22:53:00.671941] [DEBUG] [LOCAL ] IGR: Derivative data saved (1794 records). [2025-09-17T22:53:00.672023] [INFO ] [MAIN ] IGR: Successfully saved derivative data. [2025-09-17T22:53:00.675567] [INFO ] [MAIN ] Derivative Progress: 945/2085 symbols completed. IGR took 1.2s. Estimated remaining: 7m 24s. Rate: 153.9 symbols/min [2025-09-17T22:53:00.676421] [INFO ] [MAIN ] IHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:00.676346] [INFO ] [MAIN ] IHD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:00.676710] [INFO ] [MAIN ] IHS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:00.692306] [DEBUG] [LOCAL ] IHD: Loaded 7223 existing records from primary storage. [2025-09-17T22:53:00.692563] [INFO ] [MAIN ] IHD: Loaded 7223 primary data records. [2025-09-17T22:53:00.878893] [DEBUG] [LOCAL ] IHG: Loaded 24901 existing records from primary storage. [2025-09-17T22:53:00.912318] [INFO ] [MAIN ] IHG: Loaded 24901 primary data records. [2025-09-17T22:53:01.017676] [DEBUG] [LOCAL ] IHS: Loaded 39155 existing records from primary storage. [2025-09-17T22:53:01.031464] [INFO ] [MAIN ] IHS: Loaded 39155 primary data records. [2025-09-17T22:53:01.662903] [DEBUG] [MAIN ] IHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:01.664918] [INFO ] [MAIN ] IHD: Generated 1794 derivative records from 7223 primary records. [2025-09-17T22:53:01.665023] [DEBUG] [LOCAL ] IHD: Saving derivative data. [2025-09-17T22:53:01.686041] [DEBUG] [LOCAL ] IHD: Derivative data saved (1794 records). [2025-09-17T22:53:01.686596] [INFO ] [MAIN ] IHD: Successfully saved derivative data. [2025-09-17T22:53:01.689238] [INFO ] [MAIN ] Derivative Progress: 946/2085 symbols completed. IHD took 1.0s. Estimated remaining: 7m 25s. Rate: 153.6 symbols/min [2025-09-17T22:53:01.689737] [INFO ] [MAIN ] IIF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:01.709574] [DEBUG] [MAIN ] IHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:01.713490] [DEBUG] [LOCAL ] IIF: Loaded 5841 existing records from primary storage. [2025-09-17T22:53:01.714448] [INFO ] [MAIN ] IHS: Generated 1794 derivative records from 39155 primary records. [2025-09-17T22:53:01.714695] [DEBUG] [LOCAL ] IHS: Saving derivative data. [2025-09-17T22:53:01.715801] [INFO ] [MAIN ] IIF: Loaded 5841 primary data records. [2025-09-17T22:53:01.853102] [DEBUG] [LOCAL ] IHS: Derivative data saved (1794 records). [2025-09-17T22:53:01.863392] [INFO ] [MAIN ] IHS: Successfully saved derivative data. [2025-09-17T22:53:01.867086] [INFO ] [MAIN ] Derivative Progress: 947/2085 symbols completed. IHS took 1.2s. Estimated remaining: 7m 24s. Rate: 153.7 symbols/min [2025-09-17T22:53:01.863631] [DEBUG] [MAIN ] IHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:01.872031] [INFO ] [MAIN ] IHG: Generated 1794 derivative records from 24901 primary records. [2025-09-17T22:53:01.872123] [INFO ] [MAIN ] IIIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:01.872375] [DEBUG] [LOCAL ] IHG: Saving derivative data. [2025-09-17T22:53:02.096213] [DEBUG] [LOCAL ] IHG: Derivative data saved (1794 records). [2025-09-17T22:53:02.104351] [INFO ] [MAIN ] IHG: Successfully saved derivative data. [2025-09-17T22:53:02.106988] [INFO ] [MAIN ] Derivative Progress: 948/2085 symbols completed. IHG took 1.4s. Estimated remaining: 7m 24s. Rate: 153.8 symbols/min [2025-09-17T22:53:02.108322] [DEBUG] [LOCAL ] IIIN: Loaded 16975 existing records from primary storage. [2025-09-17T22:53:02.107747] [INFO ] [MAIN ] IIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:02.108734] [INFO ] [MAIN ] IIIN: Loaded 16975 primary data records. [2025-09-17T22:53:02.311747] [DEBUG] [LOCAL ] IIM: Loaded 15936 existing records from primary storage. [2025-09-17T22:53:02.317462] [INFO ] [MAIN ] IIM: Loaded 15936 primary data records. [2025-09-17T22:53:02.644068] [DEBUG] [MAIN ] IIF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:02.705819] [INFO ] [MAIN ] IIF: Generated 1794 derivative records from 5841 primary records. [2025-09-17T22:53:02.706167] [DEBUG] [LOCAL ] IIF: Saving derivative data. [2025-09-17T22:53:02.855058] [DEBUG] [LOCAL ] IIF: Derivative data saved (1794 records). [2025-09-17T22:53:02.855551] [INFO ] [MAIN ] IIF: Successfully saved derivative data. [2025-09-17T22:53:02.858222] [INFO ] [MAIN ] Derivative Progress: 949/2085 symbols completed. IIF took 1.2s. Estimated remaining: 7m 24s. Rate: 153.6 symbols/min [2025-09-17T22:53:02.859700] [INFO ] [MAIN ] IIPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:02.877866] [DEBUG] [MAIN ] IIIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:02.878691] [INFO ] [MAIN ] IIIN: Generated 1794 derivative records from 16975 primary records. [2025-09-17T22:53:02.880007] [DEBUG] [LOCAL ] IIIN: Saving derivative data. [2025-09-17T22:53:02.897346] [DEBUG] [LOCAL ] IIIN: Derivative data saved (1794 records). [2025-09-17T22:53:02.897776] [INFO ] [MAIN ] IIIN: Successfully saved derivative data. [2025-09-17T22:53:02.900437] [INFO ] [MAIN ] Derivative Progress: 950/2085 symbols completed. IIIN took 1.0s. Estimated remaining: 7m 23s. Rate: 153.8 symbols/min [2025-09-17T22:53:02.908625] [INFO ] [MAIN ] IMAX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:02.925374] [DEBUG] [LOCAL ] IIPR: Loaded 29606 existing records from primary storage. [2025-09-17T22:53:02.925746] [INFO ] [MAIN ] IIPR: Loaded 29606 primary data records. [2025-09-17T22:53:02.951027] [DEBUG] [MAIN ] IIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:02.981590] [INFO ] [MAIN ] IIM: Generated 1794 derivative records from 15936 primary records. [2025-09-17T22:53:02.995711] [DEBUG] [LOCAL ] IIM: Saving derivative data. [2025-09-17T22:53:03.166333] [DEBUG] [LOCAL ] IMAX: Loaded 42683 existing records from primary storage. [2025-09-17T22:53:03.285933] [INFO ] [MAIN ] IMAX: Loaded 42683 primary data records. [2025-09-17T22:53:03.295589] [DEBUG] [LOCAL ] IIM: Derivative data saved (1794 records). [2025-09-17T22:53:03.301068] [INFO ] [MAIN ] IIM: Successfully saved derivative data. [2025-09-17T22:53:03.315608] [INFO ] [MAIN ] Derivative Progress: 951/2085 symbols completed. IIM took 1.2s. Estimated remaining: 7m 23s. Rate: 153.8 symbols/min [2025-09-17T22:53:03.328045] [INFO ] [MAIN ] INFA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:03.667682] [DEBUG] [MAIN ] IIPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:03.668924] [INFO ] [MAIN ] IIPR: Generated 1794 derivative records from 29606 primary records. [2025-09-17T22:53:03.669194] [DEBUG] [LOCAL ] IIPR: Saving derivative data. [2025-09-17T22:53:03.700942] [DEBUG] [LOCAL ] IIPR: Derivative data saved (1794 records). [2025-09-17T22:53:03.702494] [INFO ] [MAIN ] IIPR: Successfully saved derivative data. [2025-09-17T22:53:03.705286] [INFO ] [MAIN ] Derivative Progress: 952/2085 symbols completed. IIPR took 0.8s. Estimated remaining: 7m 22s. Rate: 153.8 symbols/min [2025-09-17T22:53:03.705610] [INFO ] [MAIN ] INFY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:03.706820] [DEBUG] [LOCAL ] INFA: Loaded 50192 existing records from primary storage. [2025-09-17T22:53:03.707878] [INFO ] [MAIN ] INFA: Loaded 50192 primary data records. [2025-09-17T22:53:03.894316] [DEBUG] [MAIN ] IMAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:03.919109] [INFO ] [MAIN ] IMAX: Generated 1794 derivative records from 42683 primary records. [2025-09-17T22:53:03.919288] [DEBUG] [LOCAL ] IMAX: Saving derivative data. [2025-09-17T22:53:04.079032] [DEBUG] [LOCAL ] IMAX: Derivative data saved (1794 records). [2025-09-17T22:53:04.080430] [INFO ] [MAIN ] IMAX: Successfully saved derivative data. [2025-09-17T22:53:04.084084] [INFO ] [MAIN ] Derivative Progress: 953/2085 symbols completed. IMAX took 1.2s. Estimated remaining: 7m 22s. Rate: 153.8 symbols/min [2025-09-17T22:53:04.084539] [INFO ] [MAIN ] INGM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:04.104037] [DEBUG] [LOCAL ] INFY: Loaded 53598 existing records from primary storage. [2025-09-17T22:53:04.104376] [INFO ] [MAIN ] INFY: Loaded 53598 primary data records. [2025-09-17T22:53:04.345245] [DEBUG] [LOCAL ] INGM: Loaded 29340 existing records from primary storage. [2025-09-17T22:53:04.508863] [INFO ] [MAIN ] INGM: Loaded 29340 primary data records. [2025-09-17T22:53:04.517927] [DEBUG] [MAIN ] INFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:04.524117] [INFO ] [MAIN ] INFA: Generated 1794 derivative records from 50192 primary records. [2025-09-17T22:53:04.524762] [DEBUG] [LOCAL ] INFA: Saving derivative data. [2025-09-17T22:53:04.712054] [DEBUG] [LOCAL ] INFA: Derivative data saved (1794 records). [2025-09-17T22:53:04.736765] [INFO ] [MAIN ] INFA: Successfully saved derivative data. [2025-09-17T22:53:04.740115] [INFO ] [MAIN ] Derivative Progress: 954/2085 symbols completed. INFA took 1.4s. Estimated remaining: 7m 22s. Rate: 153.7 symbols/min [2025-09-17T22:53:04.857292] [INFO ] [MAIN ] INGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:04.880530] [DEBUG] [MAIN ] INFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:04.882308] [INFO ] [MAIN ] INFY: Generated 1794 derivative records from 53598 primary records. [2025-09-17T22:53:04.882388] [DEBUG] [LOCAL ] INFY: Saving derivative data. [2025-09-17T22:53:04.902927] [DEBUG] [LOCAL ] INFY: Derivative data saved (1794 records). [2025-09-17T22:53:04.903039] [INFO ] [MAIN ] INFY: Successfully saved derivative data. [2025-09-17T22:53:04.909391] [INFO ] [MAIN ] Derivative Progress: 955/2085 symbols completed. INFY took 1.2s. Estimated remaining: 7m 21s. Rate: 153.7 symbols/min [2025-09-17T22:53:04.909745] [INFO ] [MAIN ] INN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:04.950570] [DEBUG] [MAIN ] INGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:04.951321] [DEBUG] [LOCAL ] INGR: Loaded 33355 existing records from primary storage. [2025-09-17T22:53:04.952293] [INFO ] [MAIN ] INGM: Generated 1794 derivative records from 29340 primary records. [2025-09-17T22:53:04.952615] [INFO ] [MAIN ] INGR: Loaded 33355 primary data records. [2025-09-17T22:53:04.952530] [DEBUG] [LOCAL ] INGM: Saving derivative data. [2025-09-17T22:53:05.103898] [DEBUG] [LOCAL ] INGM: Derivative data saved (1794 records). [2025-09-17T22:53:05.153384] [INFO ] [MAIN ] INGM: Successfully saved derivative data. [2025-09-17T22:53:05.201339] [INFO ] [MAIN ] Derivative Progress: 956/2085 symbols completed. INGM took 1.1s. Estimated remaining: 7m 20s. Rate: 153.8 symbols/min [2025-09-17T22:53:05.203058] [DEBUG] [LOCAL ] INN: Loaded 41983 existing records from primary storage. [2025-09-17T22:53:05.203430] [INFO ] [MAIN ] INN: Loaded 41983 primary data records. [2025-09-17T22:53:05.203543] [INFO ] [MAIN ] INSP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:05.689424] [DEBUG] [LOCAL ] INSP: Loaded 36566 existing records from primary storage. [2025-09-17T22:53:05.690583] [INFO ] [MAIN ] INSP: Loaded 36566 primary data records. [2025-09-17T22:53:05.812595] [DEBUG] [MAIN ] INGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:05.813747] [INFO ] [MAIN ] INGR: Generated 1794 derivative records from 33355 primary records. [2025-09-17T22:53:05.830414] [DEBUG] [LOCAL ] INGR: Saving derivative data. [2025-09-17T22:53:06.026570] [DEBUG] [LOCAL ] INGR: Derivative data saved (1794 records). [2025-09-17T22:53:06.026980] [INFO ] [MAIN ] INGR: Successfully saved derivative data. [2025-09-17T22:53:06.029294] [INFO ] [MAIN ] Derivative Progress: 957/2085 symbols completed. INGR took 1.2s. Estimated remaining: 7m 21s. Rate: 153.6 symbols/min [2025-09-17T22:53:06.029937] [INFO ] [MAIN ] INSW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:06.048601] [DEBUG] [MAIN ] INN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:06.049451] [INFO ] [MAIN ] INN: Generated 1794 derivative records from 41983 primary records. [2025-09-17T22:53:06.049637] [DEBUG] [LOCAL ] INN: Saving derivative data. [2025-09-17T22:53:06.070061] [DEBUG] [LOCAL ] INN: Derivative data saved (1794 records). [2025-09-17T22:53:06.070200] [INFO ] [MAIN ] INN: Successfully saved derivative data. [2025-09-17T22:53:06.072904] [INFO ] [MAIN ] Derivative Progress: 958/2085 symbols completed. INN took 1.2s. Estimated remaining: 7m 20s. Rate: 153.8 symbols/min [2025-09-17T22:53:06.099797] [DEBUG] [MAIN ] INSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:06.100547] [INFO ] [MAIN ] INSP: Generated 1794 derivative records from 36566 primary records. [2025-09-17T22:53:06.100704] [DEBUG] [LOCAL ] INSP: Saving derivative data. [2025-09-17T22:53:06.127232] [DEBUG] [LOCAL ] INSW: Loaded 40716 existing records from primary storage. [2025-09-17T22:53:06.127787] [INFO ] [MAIN ] INSW: Loaded 40716 primary data records. [2025-09-17T22:53:06.207701] [DEBUG] [LOCAL ] INSP: Derivative data saved (1794 records). [2025-09-17T22:53:06.219567] [INFO ] [MAIN ] INSP: Successfully saved derivative data. [2025-09-17T22:53:06.229878] [INFO ] [MAIN ] Derivative Progress: 959/2085 symbols completed. INSP took 1.0s. Estimated remaining: 7m 19s. Rate: 153.8 symbols/min [2025-09-17T22:53:06.509902] [DEBUG] [MAIN ] INSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:06.510681] [INFO ] [MAIN ] INSW: Generated 1794 derivative records from 40716 primary records. [2025-09-17T22:53:06.510751] [DEBUG] [LOCAL ] INSW: Saving derivative data. [2025-09-17T22:53:06.526133] [DEBUG] [LOCAL ] INSW: Derivative data saved (1794 records). [2025-09-17T22:53:06.526195] [INFO ] [MAIN ] INSW: Successfully saved derivative data. [2025-09-17T22:53:06.528534] [INFO ] [MAIN ] Derivative Progress: 960/2085 symbols completed. INSW took 0.5s. Estimated remaining: 7m 19s. Rate: 153.9 symbols/min [2025-09-17T22:53:06.529387] [INFO ] [MAIN ] INVH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:06.529830] [INFO ] [MAIN ] IONQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:06.529715] [INFO ] [MAIN ] INVX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:06.564440] [DEBUG] [LOCAL ] INVX: Loaded 29305 existing records from primary storage. [2025-09-17T22:53:06.564688] [INFO ] [MAIN ] INVX: Loaded 29305 primary data records. [2025-09-17T22:53:06.797865] [DEBUG] [LOCAL ] INVH: Loaded 53144 existing records from primary storage. [2025-09-17T22:53:06.824972] [DEBUG] [LOCAL ] IONQ: Loaded 53788 existing records from primary storage. [2025-09-17T22:53:06.831142] [INFO ] [MAIN ] IONQ: Loaded 53788 primary data records. [2025-09-17T22:53:06.825065] [INFO ] [MAIN ] INVH: Loaded 53144 primary data records. [2025-09-17T22:53:07.604264] [DEBUG] [MAIN ] INVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:07.605586] [INFO ] [MAIN ] INVX: Generated 1794 derivative records from 29305 primary records. [2025-09-17T22:53:07.605793] [DEBUG] [LOCAL ] INVX: Saving derivative data. [2025-09-17T22:53:07.624026] [DEBUG] [LOCAL ] INVX: Derivative data saved (1794 records). [2025-09-17T22:53:07.624721] [INFO ] [MAIN ] INVX: Successfully saved derivative data. [2025-09-17T22:53:07.627146] [INFO ] [MAIN ] Derivative Progress: 961/2085 symbols completed. INVX took 1.1s. Estimated remaining: 7m 19s. Rate: 153.6 symbols/min [2025-09-17T22:53:07.628403] [INFO ] [MAIN ] IOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:07.658495] [DEBUG] [MAIN ] IONQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:07.659879] [DEBUG] [MAIN ] INVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:07.659603] [INFO ] [MAIN ] IONQ: Generated 1794 derivative records from 53788 primary records. [2025-09-17T22:53:07.660081] [DEBUG] [LOCAL ] IONQ: Saving derivative data. [2025-09-17T22:53:07.661349] [INFO ] [MAIN ] INVH: Generated 1794 derivative records from 53144 primary records. [2025-09-17T22:53:07.661877] [DEBUG] [LOCAL ] INVH: Saving derivative data. [2025-09-17T22:53:07.694033] [DEBUG] [LOCAL ] INVH: Derivative data saved (1794 records). [2025-09-17T22:53:07.695195] [INFO ] [MAIN ] INVH: Successfully saved derivative data. [2025-09-17T22:53:07.696178] [DEBUG] [LOCAL ] IONQ: Derivative data saved (1794 records). [2025-09-17T22:53:07.699005] [INFO ] [MAIN ] Derivative Progress: 962/2085 symbols completed. INVH took 1.2s. Estimated remaining: 7m 18s. Rate: 153.7 symbols/min [2025-09-17T22:53:07.699413] [INFO ] [MAIN ] IP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:07.699518] [INFO ] [MAIN ] IONQ: Successfully saved derivative data. [2025-09-17T22:53:07.702575] [INFO ] [MAIN ] Derivative Progress: 963/2085 symbols completed. IONQ took 1.2s. Estimated remaining: 7m 17s. Rate: 153.9 symbols/min [2025-09-17T22:53:07.703274] [INFO ] [MAIN ] IPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:07.746564] [DEBUG] [LOCAL ] IOT: Loaded 53473 existing records from primary storage. [2025-09-17T22:53:07.746806] [INFO ] [MAIN ] IOT: Loaded 53473 primary data records. [2025-09-17T22:53:08.131014] [DEBUG] [LOCAL ] IP: Loaded 53330 existing records from primary storage. [2025-09-17T22:53:08.131878] [INFO ] [MAIN ] IP: Loaded 53330 primary data records. [2025-09-17T22:53:08.129522] [DEBUG] [LOCAL ] IPG: Loaded 53333 existing records from primary storage. [2025-09-17T22:53:08.132100] [INFO ] [MAIN ] IPG: Loaded 53333 primary data records. [2025-09-17T22:53:08.816805] [DEBUG] [MAIN ] IOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:08.818018] [INFO ] [MAIN ] IOT: Generated 1794 derivative records from 53473 primary records. [2025-09-17T22:53:08.818631] [DEBUG] [LOCAL ] IOT: Saving derivative data. [2025-09-17T22:53:08.839845] [DEBUG] [LOCAL ] IOT: Derivative data saved (1794 records). [2025-09-17T22:53:08.841270] [INFO ] [MAIN ] IOT: Successfully saved derivative data. [2025-09-17T22:53:08.844957] [INFO ] [MAIN ] Derivative Progress: 964/2085 symbols completed. IOT took 1.2s. Estimated remaining: 7m 18s. Rate: 153.6 symbols/min [2025-09-17T22:53:08.845271] [INFO ] [MAIN ] IPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:08.875816] [DEBUG] [MAIN ] IPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:08.876081] [DEBUG] [MAIN ] IP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:08.877493] [INFO ] [MAIN ] IPG: Generated 1794 derivative records from 53333 primary records. [2025-09-17T22:53:08.876892] [INFO ] [MAIN ] IP: Generated 1794 derivative records from 53330 primary records. [2025-09-17T22:53:08.877762] [DEBUG] [LOCAL ] IP: Saving derivative data. [2025-09-17T22:53:08.877705] [DEBUG] [LOCAL ] IPG: Saving derivative data. [2025-09-17T22:53:08.912942] [DEBUG] [LOCAL ] IPG: Derivative data saved (1794 records). [2025-09-17T22:53:08.913843] [INFO ] [MAIN ] IPG: Successfully saved derivative data. [2025-09-17T22:53:08.918326] [INFO ] [MAIN ] Derivative Progress: 965/2085 symbols completed. IPG took 1.2s. Estimated remaining: 7m 17s. Rate: 153.7 symbols/min [2025-09-17T22:53:08.918687] [INFO ] [MAIN ] IQI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:08.929955] [DEBUG] [LOCAL ] IP: Derivative data saved (1794 records). [2025-09-17T22:53:08.930226] [INFO ] [MAIN ] IP: Successfully saved derivative data. [2025-09-17T22:53:08.932323] [INFO ] [MAIN ] Derivative Progress: 966/2085 symbols completed. IP took 1.2s. Estimated remaining: 7m 16s. Rate: 153.9 symbols/min [2025-09-17T22:53:08.932998] [DEBUG] [LOCAL ] IPI: Loaded 21425 existing records from primary storage. [2025-09-17T22:53:08.933128] [INFO ] [MAIN ] IPI: Loaded 21425 primary data records. [2025-09-17T22:53:08.933329] [INFO ] [MAIN ] IQV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:09.066057] [DEBUG] [LOCAL ] IQI: Loaded 17965 existing records from primary storage. [2025-09-17T22:53:09.066588] [INFO ] [MAIN ] IQI: Loaded 17965 primary data records. [2025-09-17T22:53:09.470354] [DEBUG] [LOCAL ] IQV: Loaded 50554 existing records from primary storage. [2025-09-17T22:53:09.498590] [INFO ] [MAIN ] IQV: Loaded 50554 primary data records. [2025-09-17T22:53:09.967143] [DEBUG] [MAIN ] IPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:09.968791] [INFO ] [MAIN ] IPI: Generated 1794 derivative records from 21425 primary records. [2025-09-17T22:53:09.969133] [DEBUG] [LOCAL ] IPI: Saving derivative data. [2025-09-17T22:53:09.990253] [DEBUG] [LOCAL ] IPI: Derivative data saved (1794 records). [2025-09-17T22:53:09.998691] [INFO ] [MAIN ] IPI: Successfully saved derivative data. [2025-09-17T22:53:10.006330] [INFO ] [MAIN ] Derivative Progress: 967/2085 symbols completed. IPI took 1.2s. Estimated remaining: 7m 17s. Rate: 153.6 symbols/min [2025-09-17T22:53:10.006672] [INFO ] [MAIN ] IR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:10.004055] [DEBUG] [MAIN ] IQI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:10.007715] [INFO ] [MAIN ] IQI: Generated 1794 derivative records from 17965 primary records. [2025-09-17T22:53:10.007916] [DEBUG] [LOCAL ] IQI: Saving derivative data. [2025-09-17T22:53:10.027311] [DEBUG] [LOCAL ] IQI: Derivative data saved (1794 records). [2025-09-17T22:53:10.027607] [INFO ] [MAIN ] IQI: Successfully saved derivative data. [2025-09-17T22:53:10.030249] [INFO ] [MAIN ] Derivative Progress: 968/2085 symbols completed. IQI took 1.1s. Estimated remaining: 7m 16s. Rate: 153.7 symbols/min [2025-09-17T22:53:10.030920] [INFO ] [MAIN ] IRM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:10.051041] [DEBUG] [MAIN ] IQV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:10.051982] [INFO ] [MAIN ] IQV: Generated 1794 derivative records from 50554 primary records. [2025-09-17T22:53:10.052175] [DEBUG] [LOCAL ] IQV: Saving derivative data. [2025-09-17T22:53:10.087148] [DEBUG] [LOCAL ] IQV: Derivative data saved (1794 records). [2025-09-17T22:53:10.087345] [INFO ] [MAIN ] IQV: Successfully saved derivative data. [2025-09-17T22:53:10.090782] [INFO ] [MAIN ] Derivative Progress: 969/2085 symbols completed. IQV took 1.2s. Estimated remaining: 7m 15s. Rate: 153.9 symbols/min [2025-09-17T22:53:10.091277] [INFO ] [MAIN ] IRS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:10.110021] [DEBUG] [LOCAL ] IR: Loaded 52699 existing records from primary storage. [2025-09-17T22:53:10.110281] [INFO ] [MAIN ] IR: Loaded 52699 primary data records. [2025-09-17T22:53:10.286951] [DEBUG] [LOCAL ] IRS: Loaded 21140 existing records from primary storage. [2025-09-17T22:53:10.339517] [INFO ] [MAIN ] IRS: Loaded 21140 primary data records. [2025-09-17T22:53:10.395038] [DEBUG] [LOCAL ] IRM: Loaded 49577 existing records from primary storage. [2025-09-17T22:53:10.416489] [INFO ] [MAIN ] IRM: Loaded 49577 primary data records. [2025-09-17T22:53:11.143144] [DEBUG] [MAIN ] IR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:11.144097] [INFO ] [MAIN ] IR: Generated 1794 derivative records from 52699 primary records. [2025-09-17T22:53:11.144532] [DEBUG] [LOCAL ] IR: Saving derivative data. [2025-09-17T22:53:11.174987] [DEBUG] [MAIN ] IRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:11.176705] [INFO ] [MAIN ] IRS: Generated 1794 derivative records from 21140 primary records. [2025-09-17T22:53:11.177034] [DEBUG] [LOCAL ] IRS: Saving derivative data. [2025-09-17T22:53:11.192150] [DEBUG] [LOCAL ] IR: Derivative data saved (1794 records). [2025-09-17T22:53:11.192978] [INFO ] [MAIN ] IR: Successfully saved derivative data. [2025-09-17T22:53:11.198265] [INFO ] [MAIN ] Derivative Progress: 970/2085 symbols completed. IR took 1.2s. Estimated remaining: 7m 16s. Rate: 153.6 symbols/min [2025-09-17T22:53:11.199336] [INFO ] [MAIN ] IRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:11.208495] [DEBUG] [LOCAL ] IRS: Derivative data saved (1794 records). [2025-09-17T22:53:11.214031] [DEBUG] [MAIN ] IRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:11.214899] [INFO ] [MAIN ] IRM: Generated 1794 derivative records from 49577 primary records. [2025-09-17T22:53:11.213725] [INFO ] [MAIN ] IRS: Successfully saved derivative data. [2025-09-17T22:53:11.217673] [INFO ] [MAIN ] Derivative Progress: 971/2085 symbols completed. IRS took 1.1s. Estimated remaining: 7m 15s. Rate: 153.7 symbols/min [2025-09-17T22:53:11.217818] [DEBUG] [LOCAL ] IRM: Saving derivative data. [2025-09-17T22:53:11.218476] [INFO ] [MAIN ] ISD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:11.239622] [DEBUG] [LOCAL ] IRM: Derivative data saved (1794 records). [2025-09-17T22:53:11.239910] [INFO ] [MAIN ] IRM: Successfully saved derivative data. [2025-09-17T22:53:11.245011] [INFO ] [MAIN ] Derivative Progress: 972/2085 symbols completed. IRM took 1.2s. Estimated remaining: 7m 14s. Rate: 153.9 symbols/min [2025-09-17T22:53:11.245422] [INFO ] [MAIN ] IT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:11.259159] [DEBUG] [LOCAL ] ISD: Loaded 15835 existing records from primary storage. [2025-09-17T22:53:11.259300] [INFO ] [MAIN ] ISD: Loaded 15835 primary data records. [2025-09-17T22:53:11.456948] [DEBUG] [LOCAL ] IRT: Loaded 50419 existing records from primary storage. [2025-09-17T22:53:11.496691] [INFO ] [MAIN ] IRT: Loaded 50419 primary data records. [2025-09-17T22:53:11.695196] [DEBUG] [LOCAL ] IT: Loaded 41079 existing records from primary storage. [2025-09-17T22:53:11.710731] [INFO ] [MAIN ] IT: Loaded 41079 primary data records. [2025-09-17T22:53:12.281469] [DEBUG] [MAIN ] ISD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:12.282749] [INFO ] [MAIN ] ISD: Generated 1794 derivative records from 15835 primary records. [2025-09-17T22:53:12.282863] [DEBUG] [LOCAL ] ISD: Saving derivative data. [2025-09-17T22:53:12.314858] [DEBUG] [MAIN ] IRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:12.316166] [INFO ] [MAIN ] IRT: Generated 1794 derivative records from 50419 primary records. [2025-09-17T22:53:12.316816] [DEBUG] [LOCAL ] IRT: Saving derivative data. [2025-09-17T22:53:12.317414] [DEBUG] [LOCAL ] ISD: Derivative data saved (1794 records). [2025-09-17T22:53:12.318179] [INFO ] [MAIN ] ISD: Successfully saved derivative data. [2025-09-17T22:53:12.320793] [INFO ] [MAIN ] Derivative Progress: 973/2085 symbols completed. ISD took 1.1s. Estimated remaining: 7m 14s. Rate: 153.6 symbols/min [2025-09-17T22:53:12.338039] [DEBUG] [LOCAL ] IRT: Derivative data saved (1794 records). [2025-09-17T22:53:12.338174] [INFO ] [MAIN ] IRT: Successfully saved derivative data. [2025-09-17T22:53:12.340855] [INFO ] [MAIN ] Derivative Progress: 974/2085 symbols completed. IRT took 1.1s. Estimated remaining: 7m 14s. Rate: 153.7 symbols/min [2025-09-17T22:53:12.353315] [DEBUG] [MAIN ] IT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:12.353954] [INFO ] [MAIN ] IT: Generated 1794 derivative records from 41079 primary records. [2025-09-17T22:53:12.354020] [DEBUG] [LOCAL ] IT: Saving derivative data. [2025-09-17T22:53:12.370053] [DEBUG] [LOCAL ] IT: Derivative data saved (1794 records). [2025-09-17T22:53:12.370126] [INFO ] [MAIN ] IT: Successfully saved derivative data. [2025-09-17T22:53:12.372712] [INFO ] [MAIN ] Derivative Progress: 975/2085 symbols completed. IT took 1.1s. Estimated remaining: 7m 13s. Rate: 153.9 symbols/min [2025-09-17T22:53:12.373469] [INFO ] [MAIN ] ITT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:12.373340] [INFO ] [MAIN ] ITGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:12.373409] [INFO ] [MAIN ] ITUB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:12.428230] [DEBUG] [LOCAL ] ITGR: Loaded 31638 existing records from primary storage. [2025-09-17T22:53:12.437804] [INFO ] [MAIN ] ITGR: Loaded 31638 primary data records. [2025-09-17T22:53:12.449737] [DEBUG] [LOCAL ] ITT: Loaded 33505 existing records from primary storage. [2025-09-17T22:53:12.475446] [INFO ] [MAIN ] ITT: Loaded 33505 primary data records. [2025-09-17T22:53:12.634912] [DEBUG] [LOCAL ] ITUB: Loaded 53303 existing records from primary storage. [2025-09-17T22:53:12.658962] [INFO ] [MAIN ] ITUB: Loaded 53303 primary data records. [2025-09-17T22:53:13.408770] [DEBUG] [MAIN ] ITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:13.417244] [INFO ] [MAIN ] ITT: Generated 1794 derivative records from 33505 primary records. [2025-09-17T22:53:13.421774] [DEBUG] [LOCAL ] ITT: Saving derivative data. [2025-09-17T22:53:13.424441] [DEBUG] [MAIN ] ITGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:13.435324] [INFO ] [MAIN ] ITGR: Generated 1794 derivative records from 31638 primary records. [2025-09-17T22:53:13.438103] [DEBUG] [LOCAL ] ITGR: Saving derivative data. [2025-09-17T22:53:13.442380] [DEBUG] [LOCAL ] ITT: Derivative data saved (1794 records). [2025-09-17T22:53:13.442550] [INFO ] [MAIN ] ITT: Successfully saved derivative data. [2025-09-17T22:53:13.453491] [INFO ] [MAIN ] Derivative Progress: 976/2085 symbols completed. ITT took 1.1s. Estimated remaining: 7m 13s. Rate: 153.6 symbols/min [2025-09-17T22:53:13.469340] [INFO ] [MAIN ] ITW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:13.473002] [DEBUG] [MAIN ] ITUB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:13.475638] [DEBUG] [LOCAL ] ITGR: Derivative data saved (1794 records). [2025-09-17T22:53:13.474638] [INFO ] [MAIN ] ITUB: Generated 1794 derivative records from 53303 primary records. [2025-09-17T22:53:13.475916] [INFO ] [MAIN ] ITGR: Successfully saved derivative data. [2025-09-17T22:53:13.476023] [DEBUG] [LOCAL ] ITUB: Saving derivative data. [2025-09-17T22:53:13.478060] [INFO ] [MAIN ] Derivative Progress: 977/2085 symbols completed. ITGR took 1.1s. Estimated remaining: 7m 12s. Rate: 153.8 symbols/min [2025-09-17T22:53:13.478463] [INFO ] [MAIN ] IVR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:13.495672] [DEBUG] [LOCAL ] ITUB: Derivative data saved (1794 records). [2025-09-17T22:53:13.495913] [INFO ] [MAIN ] ITUB: Successfully saved derivative data. [2025-09-17T22:53:13.498535] [INFO ] [MAIN ] Derivative Progress: 978/2085 symbols completed. ITUB took 1.1s. Estimated remaining: 7m 12s. Rate: 153.9 symbols/min [2025-09-17T22:53:13.498875] [INFO ] [MAIN ] IVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:13.541344] [DEBUG] [LOCAL ] IVT: Loaded 31017 existing records from primary storage. [2025-09-17T22:53:13.541568] [INFO ] [MAIN ] IVT: Loaded 31017 primary data records. [2025-09-17T22:53:13.686850] [DEBUG] [LOCAL ] IVR: Loaded 47721 existing records from primary storage. [2025-09-17T22:53:13.708616] [DEBUG] [LOCAL ] ITW: Loaded 46540 existing records from primary storage. [2025-09-17T22:53:13.713907] [INFO ] [MAIN ] IVR: Loaded 47721 primary data records. [2025-09-17T22:53:13.714089] [INFO ] [MAIN ] ITW: Loaded 46540 primary data records. [2025-09-17T22:53:14.553030] [DEBUG] [MAIN ] IVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:14.553819] [INFO ] [MAIN ] IVT: Generated 1794 derivative records from 31017 primary records. [2025-09-17T22:53:14.554073] [DEBUG] [LOCAL ] IVT: Saving derivative data. [2025-09-17T22:53:14.571017] [DEBUG] [LOCAL ] IVT: Derivative data saved (1794 records). [2025-09-17T22:53:14.571319] [INFO ] [MAIN ] IVT: Successfully saved derivative data. [2025-09-17T22:53:14.573443] [INFO ] [MAIN ] Derivative Progress: 979/2085 symbols completed. IVT took 1.1s. Estimated remaining: 7m 12s. Rate: 153.6 symbols/min [2025-09-17T22:53:14.573926] [INFO ] [MAIN ] IVZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:14.605526] [DEBUG] [MAIN ] ITW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:14.606012] [DEBUG] [MAIN ] IVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:14.607345] [INFO ] [MAIN ] IVR: Generated 1794 derivative records from 47721 primary records. [2025-09-17T22:53:14.607499] [DEBUG] [LOCAL ] IVR: Saving derivative data. [2025-09-17T22:53:14.606785] [INFO ] [MAIN ] ITW: Generated 1794 derivative records from 46540 primary records. [2025-09-17T22:53:14.608000] [DEBUG] [LOCAL ] ITW: Saving derivative data. [2025-09-17T22:53:14.635929] [DEBUG] [LOCAL ] IVR: Derivative data saved (1794 records). [2025-09-17T22:53:14.636582] [INFO ] [MAIN ] IVR: Successfully saved derivative data. [2025-09-17T22:53:14.639553] [INFO ] [MAIN ] Derivative Progress: 980/2085 symbols completed. IVR took 1.2s. Estimated remaining: 7m 11s. Rate: 153.8 symbols/min [2025-09-17T22:53:14.640500] [INFO ] [MAIN ] IX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:14.644129] [DEBUG] [LOCAL ] ITW: Derivative data saved (1794 records). [2025-09-17T22:53:14.644311] [INFO ] [MAIN ] ITW: Successfully saved derivative data. [2025-09-17T22:53:14.647237] [INFO ] [MAIN ] Derivative Progress: 981/2085 symbols completed. ITW took 1.2s. Estimated remaining: 7m 10s. Rate: 153.9 symbols/min [2025-09-17T22:53:14.661147] [INFO ] [MAIN ] J: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:14.698741] [DEBUG] [LOCAL ] IX: Loaded 22870 existing records from primary storage. [2025-09-17T22:53:14.698200] [DEBUG] [LOCAL ] IVZ: Loaded 53146 existing records from primary storage. [2025-09-17T22:53:14.698995] [INFO ] [MAIN ] IX: Loaded 22870 primary data records. [2025-09-17T22:53:14.698916] [INFO ] [MAIN ] IVZ: Loaded 53146 primary data records. [2025-09-17T22:53:14.995100] [DEBUG] [LOCAL ] J: Loaded 40617 existing records from primary storage. [2025-09-17T22:53:15.024156] [INFO ] [MAIN ] J: Loaded 40617 primary data records. [2025-09-17T22:53:15.710520] [DEBUG] [MAIN ] IX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:15.724205] [DEBUG] [MAIN ] IVZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:15.725160] [INFO ] [MAIN ] IX: Generated 1794 derivative records from 22870 primary records. [2025-09-17T22:53:15.725781] [INFO ] [MAIN ] IVZ: Generated 1794 derivative records from 53146 primary records. [2025-09-17T22:53:15.725990] [DEBUG] [LOCAL ] IX: Saving derivative data. [2025-09-17T22:53:15.726527] [DEBUG] [LOCAL ] IVZ: Saving derivative data. [2025-09-17T22:53:15.751857] [DEBUG] [LOCAL ] IVZ: Derivative data saved (1794 records). [2025-09-17T22:53:15.754561] [INFO ] [MAIN ] IVZ: Successfully saved derivative data. [2025-09-17T22:53:15.757507] [INFO ] [MAIN ] Derivative Progress: 982/2085 symbols completed. IVZ took 1.2s. Estimated remaining: 7m 11s. Rate: 153.6 symbols/min [2025-09-17T22:53:15.762109] [DEBUG] [LOCAL ] IX: Derivative data saved (1794 records). [2025-09-17T22:53:15.760910] [INFO ] [MAIN ] JBGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:15.762328] [INFO ] [MAIN ] IX: Successfully saved derivative data. [2025-09-17T22:53:15.764820] [INFO ] [MAIN ] Derivative Progress: 983/2085 symbols completed. IX took 1.1s. Estimated remaining: 7m 10s. Rate: 153.8 symbols/min [2025-09-17T22:53:15.765295] [INFO ] [MAIN ] JBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:15.782497] [DEBUG] [MAIN ] J: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:15.783326] [INFO ] [MAIN ] J: Generated 1794 derivative records from 40617 primary records. [2025-09-17T22:53:15.783391] [DEBUG] [LOCAL ] J: Saving derivative data. [2025-09-17T22:53:15.800859] [DEBUG] [LOCAL ] J: Derivative data saved (1794 records). [2025-09-17T22:53:15.800932] [INFO ] [MAIN ] J: Successfully saved derivative data. [2025-09-17T22:53:15.804321] [INFO ] [MAIN ] Derivative Progress: 984/2085 symbols completed. J took 1.2s. Estimated remaining: 7m 9s. Rate: 153.9 symbols/min [2025-09-17T22:53:15.804792] [INFO ] [MAIN ] JBL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:15.854931] [DEBUG] [LOCAL ] JBGS: Loaded 42400 existing records from primary storage. [2025-09-17T22:53:15.855093] [INFO ] [MAIN ] JBGS: Loaded 42400 primary data records. [2025-09-17T22:53:15.855620] [DEBUG] [LOCAL ] JBI: Loaded 44221 existing records from primary storage. [2025-09-17T22:53:15.861004] [INFO ] [MAIN ] JBI: Loaded 44221 primary data records. [2025-09-17T22:53:16.469139] [DEBUG] [LOCAL ] JBL: Loaded 48361 existing records from primary storage. [2025-09-17T22:53:16.474451] [INFO ] [MAIN ] JBL: Loaded 48361 primary data records. [2025-09-17T22:53:16.884286] [DEBUG] [MAIN ] JBGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:16.898703] [INFO ] [MAIN ] JBGS: Generated 1794 derivative records from 42400 primary records. [2025-09-17T22:53:16.898951] [DEBUG] [LOCAL ] JBGS: Saving derivative data. [2025-09-17T22:53:16.899626] [DEBUG] [MAIN ] JBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:16.901117] [INFO ] [MAIN ] JBI: Generated 1794 derivative records from 44221 primary records. [2025-09-17T22:53:16.902124] [DEBUG] [LOCAL ] JBI: Saving derivative data. [2025-09-17T22:53:16.919926] [DEBUG] [LOCAL ] JBGS: Derivative data saved (1794 records). [2025-09-17T22:53:16.920938] [INFO ] [MAIN ] JBGS: Successfully saved derivative data. [2025-09-17T22:53:16.930580] [INFO ] [MAIN ] Derivative Progress: 985/2085 symbols completed. JBGS took 1.2s. Estimated remaining: 7m 10s. Rate: 153.6 symbols/min [2025-09-17T22:53:16.938807] [INFO ] [MAIN ] JBND: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:16.944206] [DEBUG] [LOCAL ] JBI: Derivative data saved (1794 records). [2025-09-17T22:53:16.953079] [INFO ] [MAIN ] JBI: Successfully saved derivative data. [2025-09-17T22:53:16.955932] [INFO ] [MAIN ] Derivative Progress: 986/2085 symbols completed. JBI took 1.2s. Estimated remaining: 7m 9s. Rate: 153.8 symbols/min [2025-09-17T22:53:16.961195] [INFO ] [MAIN ] JCE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:16.962136] [DEBUG] [MAIN ] JBL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:16.962991] [INFO ] [MAIN ] JBL: Generated 1794 derivative records from 48361 primary records. [2025-09-17T22:53:16.963349] [DEBUG] [LOCAL ] JBL: Saving derivative data. [2025-09-17T22:53:16.983133] [DEBUG] [LOCAL ] JCE: Loaded 6333 existing records from primary storage. [2025-09-17T22:53:16.989457] [INFO ] [MAIN ] JCE: Loaded 6333 primary data records. [2025-09-17T22:53:17.078211] [DEBUG] [LOCAL ] JBND: Loaded 25102 existing records from primary storage. [2025-09-17T22:53:17.098665] [INFO ] [MAIN ] JBND: Loaded 25102 primary data records. [2025-09-17T22:53:17.098557] [DEBUG] [LOCAL ] JBL: Derivative data saved (1794 records). [2025-09-17T22:53:17.120138] [INFO ] [MAIN ] JBL: Successfully saved derivative data. [2025-09-17T22:53:17.129093] [INFO ] [MAIN ] Derivative Progress: 987/2085 symbols completed. JBL took 1.3s. Estimated remaining: 7m 8s. Rate: 153.9 symbols/min [2025-09-17T22:53:17.134521] [INFO ] [MAIN ] JCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:17.679169] [DEBUG] [LOCAL ] JCI: Loaded 53550 existing records from primary storage. [2025-09-17T22:53:17.679637] [INFO ] [MAIN ] JCI: Loaded 53550 primary data records. [2025-09-17T22:53:17.776414] [DEBUG] [MAIN ] JCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:17.795701] [INFO ] [MAIN ] JCE: Generated 1794 derivative records from 6333 primary records. [2025-09-17T22:53:17.808972] [DEBUG] [LOCAL ] JCE: Saving derivative data. [2025-09-17T22:53:18.044624] [DEBUG] [MAIN ] JBND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:18.046437] [INFO ] [MAIN ] JBND: Generated 1794 derivative records from 25102 primary records. [2025-09-17T22:53:18.046726] [DEBUG] [LOCAL ] JBND: Saving derivative data. [2025-09-17T22:53:18.046585] [DEBUG] [LOCAL ] JCE: Derivative data saved (1794 records). [2025-09-17T22:53:18.048398] [INFO ] [MAIN ] JCE: Successfully saved derivative data. [2025-09-17T22:53:18.051024] [INFO ] [MAIN ] Derivative Progress: 988/2085 symbols completed. JCE took 1.1s. Estimated remaining: 7m 8s. Rate: 153.6 symbols/min [2025-09-17T22:53:18.068055] [DEBUG] [LOCAL ] JBND: Derivative data saved (1794 records). [2025-09-17T22:53:18.068205] [INFO ] [MAIN ] JBND: Successfully saved derivative data. [2025-09-17T22:53:18.071426] [INFO ] [MAIN ] Derivative Progress: 989/2085 symbols completed. JBND took 1.1s. Estimated remaining: 7m 8s. Rate: 153.8 symbols/min [2025-09-17T22:53:18.092401] [DEBUG] [MAIN ] JCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:18.093106] [INFO ] [MAIN ] JCI: Generated 1794 derivative records from 53550 primary records. [2025-09-17T22:53:18.093195] [DEBUG] [LOCAL ] JCI: Saving derivative data. [2025-09-17T22:53:18.110474] [DEBUG] [LOCAL ] JCI: Derivative data saved (1794 records). [2025-09-17T22:53:18.110548] [INFO ] [MAIN ] JCI: Successfully saved derivative data. [2025-09-17T22:53:18.113168] [INFO ] [MAIN ] Derivative Progress: 990/2085 symbols completed. JCI took 1.0s. Estimated remaining: 7m 7s. Rate: 153.9 symbols/min [2025-09-17T22:53:18.113917] [INFO ] [MAIN ] JELD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:18.114139] [INFO ] [MAIN ] JEQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:18.114450] [INFO ] [MAIN ] JEF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:18.127332] [DEBUG] [LOCAL ] JEQ: Loaded 8997 existing records from primary storage. [2025-09-17T22:53:18.127513] [INFO ] [MAIN ] JEQ: Loaded 8997 primary data records. [2025-09-17T22:53:18.491189] [DEBUG] [LOCAL ] JELD: Loaded 46226 existing records from primary storage. [2025-09-17T22:53:18.491569] [INFO ] [MAIN ] JELD: Loaded 46226 primary data records. [2025-09-17T22:53:18.565288] [DEBUG] [LOCAL ] JEF: Loaded 50005 existing records from primary storage. [2025-09-17T22:53:18.588870] [INFO ] [MAIN ] JEF: Loaded 50005 primary data records. [2025-09-17T22:53:19.191535] [DEBUG] [MAIN ] JEQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:19.193454] [INFO ] [MAIN ] JEQ: Generated 1794 derivative records from 8997 primary records. [2025-09-17T22:53:19.193798] [DEBUG] [LOCAL ] JEQ: Saving derivative data. [2025-09-17T22:53:19.212753] [DEBUG] [LOCAL ] JEQ: Derivative data saved (1794 records). [2025-09-17T22:53:19.213073] [INFO ] [MAIN ] JEQ: Successfully saved derivative data. [2025-09-17T22:53:19.215756] [INFO ] [MAIN ] Derivative Progress: 991/2085 symbols completed. JEQ took 1.1s. Estimated remaining: 7m 7s. Rate: 153.6 symbols/min [2025-09-17T22:53:19.216580] [INFO ] [MAIN ] JFR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:19.237450] [DEBUG] [MAIN ] JEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:19.238435] [INFO ] [MAIN ] JEF: Generated 1794 derivative records from 50005 primary records. [2025-09-17T22:53:19.245857] [DEBUG] [LOCAL ] JEF: Saving derivative data. [2025-09-17T22:53:19.251955] [DEBUG] [MAIN ] JELD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:19.254099] [INFO ] [MAIN ] JELD: Generated 1794 derivative records from 46226 primary records. [2025-09-17T22:53:19.262369] [DEBUG] [LOCAL ] JELD: Saving derivative data. [2025-09-17T22:53:19.278246] [DEBUG] [LOCAL ] JEF: Derivative data saved (1794 records). [2025-09-17T22:53:19.278402] [INFO ] [MAIN ] JEF: Successfully saved derivative data. [2025-09-17T22:53:19.280826] [INFO ] [MAIN ] Derivative Progress: 992/2085 symbols completed. JEF took 1.2s. Estimated remaining: 7m 6s. Rate: 153.8 symbols/min [2025-09-17T22:53:19.291585] [INFO ] [MAIN ] JGH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:19.296354] [DEBUG] [LOCAL ] JELD: Derivative data saved (1794 records). [2025-09-17T22:53:19.296445] [INFO ] [MAIN ] JELD: Successfully saved derivative data. [2025-09-17T22:53:19.299013] [INFO ] [MAIN ] Derivative Progress: 993/2085 symbols completed. JELD took 1.2s. Estimated remaining: 7m 6s. Rate: 153.9 symbols/min [2025-09-17T22:53:19.299908] [INFO ] [MAIN ] JHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:19.311790] [DEBUG] [LOCAL ] JFR: Loaded 30653 existing records from primary storage. [2025-09-17T22:53:19.314369] [INFO ] [MAIN ] JFR: Loaded 30653 primary data records. [2025-09-17T22:53:19.390306] [DEBUG] [LOCAL ] JGH: Loaded 10962 existing records from primary storage. [2025-09-17T22:53:19.402447] [INFO ] [MAIN ] JGH: Loaded 10962 primary data records. [2025-09-17T22:53:19.997069] [DEBUG] [LOCAL ] JHG: Loaded 48220 existing records from primary storage. [2025-09-17T22:53:19.997398] [INFO ] [MAIN ] JHG: Loaded 48220 primary data records. [2025-09-17T22:53:20.337418] [DEBUG] [MAIN ] JFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:20.339463] [INFO ] [MAIN ] JFR: Generated 1794 derivative records from 30653 primary records. [2025-09-17T22:53:20.340514] [DEBUG] [LOCAL ] JFR: Saving derivative data. [2025-09-17T22:53:20.369869] [DEBUG] [MAIN ] JGH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:20.371879] [DEBUG] [LOCAL ] JFR: Derivative data saved (1794 records). [2025-09-17T22:53:20.372180] [INFO ] [MAIN ] JFR: Successfully saved derivative data. [2025-09-17T22:53:20.372110] [INFO ] [MAIN ] JGH: Generated 1794 derivative records from 10962 primary records. [2025-09-17T22:53:20.375018] [INFO ] [MAIN ] Derivative Progress: 994/2085 symbols completed. JFR took 1.2s. Estimated remaining: 7m 6s. Rate: 153.7 symbols/min [2025-09-17T22:53:20.373003] [DEBUG] [LOCAL ] JGH: Saving derivative data. [2025-09-17T22:53:20.376711] [INFO ] [MAIN ] JHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:20.396324] [DEBUG] [LOCAL ] JHI: Loaded 3756 existing records from primary storage. [2025-09-17T22:53:20.397049] [INFO ] [MAIN ] JHI: Loaded 3756 primary data records. [2025-09-17T22:53:20.478212] [DEBUG] [LOCAL ] JGH: Derivative data saved (1794 records). [2025-09-17T22:53:20.500818] [INFO ] [MAIN ] JGH: Successfully saved derivative data. [2025-09-17T22:53:20.526863] [INFO ] [MAIN ] Derivative Progress: 995/2085 symbols completed. JGH took 1.2s. Estimated remaining: 7m 5s. Rate: 153.7 symbols/min [2025-09-17T22:53:20.540292] [INFO ] [MAIN ] JHS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:20.540046] [DEBUG] [MAIN ] JHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:20.551899] [INFO ] [MAIN ] JHG: Generated 1794 derivative records from 48220 primary records. [2025-09-17T22:53:20.552160] [DEBUG] [LOCAL ] JHG: Saving derivative data. [2025-09-17T22:53:20.823115] [DEBUG] [LOCAL ] JHS: Loaded 2928 existing records from primary storage. [2025-09-17T22:53:20.824680] [INFO ] [MAIN ] JHS: Loaded 2928 primary data records. [2025-09-17T22:53:20.875682] [DEBUG] [LOCAL ] JHG: Derivative data saved (1794 records). [2025-09-17T22:53:20.898188] [INFO ] [MAIN ] JHG: Successfully saved derivative data. [2025-09-17T22:53:20.913700] [INFO ] [MAIN ] Derivative Progress: 996/2085 symbols completed. JHG took 1.6s. Estimated remaining: 7m 5s. Rate: 153.7 symbols/min [2025-09-17T22:53:20.940405] [INFO ] [MAIN ] JHX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:21.169729] [DEBUG] [MAIN ] JHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:21.170857] [INFO ] [MAIN ] JHI: Generated 1794 derivative records from 3756 primary records. [2025-09-17T22:53:21.171302] [DEBUG] [LOCAL ] JHI: Saving derivative data. [2025-09-17T22:53:21.204387] [DEBUG] [LOCAL ] JHI: Derivative data saved (1794 records). [2025-09-17T22:53:21.219108] [INFO ] [MAIN ] JHI: Successfully saved derivative data. [2025-09-17T22:53:21.228183] [DEBUG] [LOCAL ] JHX: Loaded 48946 existing records from primary storage. [2025-09-17T22:53:21.233052] [INFO ] [MAIN ] JHX: Loaded 48946 primary data records. [2025-09-17T22:53:21.235408] [INFO ] [MAIN ] Derivative Progress: 997/2085 symbols completed. JHI took 0.9s. Estimated remaining: 7m 5s. Rate: 153.8 symbols/min [2025-09-17T22:53:21.236398] [DEBUG] [MAIN ] JHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:21.258396] [INFO ] [MAIN ] JILL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:21.275109] [INFO ] [MAIN ] JHS: Generated 1794 derivative records from 2928 primary records. [2025-09-17T22:53:21.304990] [DEBUG] [LOCAL ] JHS: Saving derivative data. [2025-09-17T22:53:21.394932] [DEBUG] [LOCAL ] JHS: Derivative data saved (1794 records). [2025-09-17T22:53:21.418304] [INFO ] [MAIN ] JHS: Successfully saved derivative data. [2025-09-17T22:53:21.430522] [INFO ] [MAIN ] Derivative Progress: 998/2085 symbols completed. JHS took 0.9s. Estimated remaining: 7m 4s. Rate: 153.9 symbols/min [2025-09-17T22:53:21.455052] [INFO ] [MAIN ] JKS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:21.456126] [DEBUG] [LOCAL ] JILL: Loaded 16690 existing records from primary storage. [2025-09-17T22:53:21.462696] [INFO ] [MAIN ] JILL: Loaded 16690 primary data records. [2025-09-17T22:53:21.932961] [DEBUG] [LOCAL ] JKS: Loaded 40240 existing records from primary storage. [2025-09-17T22:53:21.933507] [INFO ] [MAIN ] JKS: Loaded 40240 primary data records. [2025-09-17T22:53:22.145895] [DEBUG] [MAIN ] JHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:22.153743] [INFO ] [MAIN ] JHX: Generated 1794 derivative records from 48946 primary records. [2025-09-17T22:53:22.278761] [DEBUG] [LOCAL ] JHX: Saving derivative data. [2025-09-17T22:53:22.305001] [DEBUG] [LOCAL ] JHX: Derivative data saved (1794 records). [2025-09-17T22:53:22.306206] [INFO ] [MAIN ] JHX: Successfully saved derivative data. [2025-09-17T22:53:22.308431] [INFO ] [MAIN ] Derivative Progress: 999/2085 symbols completed. JHX took 1.4s. Estimated remaining: 7m 4s. Rate: 153.7 symbols/min [2025-09-17T22:53:22.321162] [INFO ] [MAIN ] JLL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:22.321745] [DEBUG] [MAIN ] JILL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:22.323794] [INFO ] [MAIN ] JILL: Generated 1794 derivative records from 16690 primary records. [2025-09-17T22:53:22.324490] [DEBUG] [LOCAL ] JILL: Saving derivative data. [2025-09-17T22:53:22.341725] [DEBUG] [LOCAL ] JILL: Derivative data saved (1794 records). [2025-09-17T22:53:22.342189] [INFO ] [MAIN ] JILL: Successfully saved derivative data. [2025-09-17T22:53:22.344744] [INFO ] [MAIN ] Derivative Progress: 1000/2085 symbols completed. JILL took 1.1s. Estimated remaining: 7m 3s. Rate: 153.8 symbols/min [2025-09-17T22:53:22.345270] [INFO ] [MAIN ] JLS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:22.355156] [DEBUG] [LOCAL ] JLS: Loaded 4110 existing records from primary storage. [2025-09-17T22:53:22.355304] [INFO ] [MAIN ] JLS: Loaded 4110 primary data records. [2025-09-17T22:53:22.445112] [DEBUG] [MAIN ] JKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:22.492732] [INFO ] [MAIN ] JKS: Generated 1794 derivative records from 40240 primary records. [2025-09-17T22:53:22.519526] [DEBUG] [LOCAL ] JKS: Saving derivative data. [2025-09-17T22:53:22.530911] [DEBUG] [LOCAL ] JLL: Loaded 32337 existing records from primary storage. [2025-09-17T22:53:22.550828] [INFO ] [MAIN ] JLL: Loaded 32337 primary data records. [2025-09-17T22:53:22.771255] [DEBUG] [LOCAL ] JKS: Derivative data saved (1794 records). [2025-09-17T22:53:22.787781] [INFO ] [MAIN ] JKS: Successfully saved derivative data. [2025-09-17T22:53:22.802375] [INFO ] [MAIN ] Derivative Progress: 1001/2085 symbols completed. JKS took 1.4s. Estimated remaining: 7m 3s. Rate: 153.8 symbols/min [2025-09-17T22:53:22.831147] [INFO ] [MAIN ] JMIA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:23.100314] [DEBUG] [MAIN ] JLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:23.101288] [INFO ] [MAIN ] JLS: Generated 1794 derivative records from 4110 primary records. [2025-09-17T22:53:23.101605] [DEBUG] [LOCAL ] JLS: Saving derivative data. [2025-09-17T22:53:23.119771] [DEBUG] [LOCAL ] JLS: Derivative data saved (1794 records). [2025-09-17T22:53:23.120763] [INFO ] [MAIN ] JLS: Successfully saved derivative data. [2025-09-17T22:53:23.123040] [INFO ] [MAIN ] Derivative Progress: 1002/2085 symbols completed. JLS took 0.8s. Estimated remaining: 7m 2s. Rate: 153.8 symbols/min [2025-09-17T22:53:23.123732] [INFO ] [MAIN ] JNJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:23.142597] [DEBUG] [LOCAL ] JMIA: Loaded 50432 existing records from primary storage. [2025-09-17T22:53:23.143058] [INFO ] [MAIN ] JMIA: Loaded 50432 primary data records. [2025-09-17T22:53:23.155844] [DEBUG] [MAIN ] JLL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:23.156669] [INFO ] [MAIN ] JLL: Generated 1794 derivative records from 32337 primary records. [2025-09-17T22:53:23.168766] [DEBUG] [LOCAL ] JLL: Saving derivative data. [2025-09-17T22:53:23.343782] [DEBUG] [LOCAL ] JLL: Derivative data saved (1794 records). [2025-09-17T22:53:23.377058] [INFO ] [MAIN ] JLL: Successfully saved derivative data. [2025-09-17T22:53:23.495677] [INFO ] [MAIN ] Derivative Progress: 1003/2085 symbols completed. JLL took 1.2s. Estimated remaining: 7m 2s. Rate: 153.8 symbols/min [2025-09-17T22:53:23.534637] [DEBUG] [LOCAL ] JNJ: Loaded 53753 existing records from primary storage. [2025-09-17T22:53:23.535006] [INFO ] [MAIN ] JNJ: Loaded 53753 primary data records. [2025-09-17T22:53:23.856797] [DEBUG] [MAIN ] JMIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:23.857523] [INFO ] [MAIN ] JMIA: Generated 1794 derivative records from 50432 primary records. [2025-09-17T22:53:23.857885] [DEBUG] [LOCAL ] JMIA: Saving derivative data. [2025-09-17T22:53:23.877975] [DEBUG] [LOCAL ] JMIA: Derivative data saved (1794 records). [2025-09-17T22:53:23.878296] [INFO ] [MAIN ] JMIA: Successfully saved derivative data. [2025-09-17T22:53:23.881233] [INFO ] [MAIN ] Derivative Progress: 1004/2085 symbols completed. JMIA took 1.1s. Estimated remaining: 7m 2s. Rate: 153.8 symbols/min [2025-09-17T22:53:23.901114] [DEBUG] [MAIN ] JNJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:23.901857] [INFO ] [MAIN ] JNJ: Generated 1794 derivative records from 53753 primary records. [2025-09-17T22:53:23.901921] [DEBUG] [LOCAL ] JNJ: Saving derivative data. [2025-09-17T22:53:23.917634] [DEBUG] [LOCAL ] JNJ: Derivative data saved (1794 records). [2025-09-17T22:53:23.917766] [INFO ] [MAIN ] JNJ: Successfully saved derivative data. [2025-09-17T22:53:23.920048] [INFO ] [MAIN ] Derivative Progress: 1005/2085 symbols completed. JNJ took 0.8s. Estimated remaining: 7m 1s. Rate: 153.9 symbols/min [2025-09-17T22:53:23.920733] [INFO ] [MAIN ] JOF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:23.920678] [INFO ] [MAIN ] JOBY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:23.921103] [INFO ] [MAIN ] JOE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:23.931787] [DEBUG] [LOCAL ] JOF: Loaded 7194 existing records from primary storage. [2025-09-17T22:53:23.931916] [INFO ] [MAIN ] JOF: Loaded 7194 primary data records. [2025-09-17T22:53:24.123139] [DEBUG] [LOCAL ] JOE: Loaded 24848 existing records from primary storage. [2025-09-17T22:53:24.145270] [INFO ] [MAIN ] JOE: Loaded 24848 primary data records. [2025-09-17T22:53:24.376335] [DEBUG] [LOCAL ] JOBY: Loaded 53798 existing records from primary storage. [2025-09-17T22:53:24.400184] [INFO ] [MAIN ] JOBY: Loaded 53798 primary data records. [2025-09-17T22:53:24.997611] [DEBUG] [MAIN ] JOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:24.998847] [INFO ] [MAIN ] JOF: Generated 1794 derivative records from 7194 primary records. [2025-09-17T22:53:25.000110] [DEBUG] [LOCAL ] JOF: Saving derivative data. [2025-09-17T22:53:25.021738] [DEBUG] [LOCAL ] JOF: Derivative data saved (1794 records). [2025-09-17T22:53:25.021870] [INFO ] [MAIN ] JOF: Successfully saved derivative data. [2025-09-17T22:53:25.024912] [INFO ] [MAIN ] Derivative Progress: 1006/2085 symbols completed. JOF took 1.1s. Estimated remaining: 7m 1s. Rate: 153.7 symbols/min [2025-09-17T22:53:25.032964] [INFO ] [MAIN ] JPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:25.041000] [DEBUG] [MAIN ] JOE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:25.042747] [INFO ] [MAIN ] JOE: Generated 1794 derivative records from 24848 primary records. [2025-09-17T22:53:25.042892] [DEBUG] [LOCAL ] JOE: Saving derivative data. [2025-09-17T22:53:25.068682] [DEBUG] [MAIN ] JOBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:25.070823] [INFO ] [MAIN ] JOBY: Generated 1794 derivative records from 53798 primary records. [2025-09-17T22:53:25.070917] [DEBUG] [LOCAL ] JOBY: Saving derivative data. [2025-09-17T22:53:25.094043] [DEBUG] [LOCAL ] JOE: Derivative data saved (1794 records). [2025-09-17T22:53:25.094606] [INFO ] [MAIN ] JOE: Successfully saved derivative data. [2025-09-17T22:53:25.097595] [INFO ] [MAIN ] Derivative Progress: 1007/2085 symbols completed. JOE took 1.2s. Estimated remaining: 7m 1s. Rate: 153.8 symbols/min [2025-09-17T22:53:25.098249] [INFO ] [MAIN ] JPI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:25.110589] [DEBUG] [LOCAL ] JOBY: Derivative data saved (1794 records). [2025-09-17T22:53:25.110753] [INFO ] [MAIN ] JOBY: Successfully saved derivative data. [2025-09-17T22:53:25.113301] [INFO ] [MAIN ] Derivative Progress: 1008/2085 symbols completed. JOBY took 1.2s. Estimated remaining: 6m 60s. Rate: 153.9 symbols/min [2025-09-17T22:53:25.113747] [INFO ] [MAIN ] JPM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:25.120829] [DEBUG] [LOCAL ] JPI: Loaded 5451 existing records from primary storage. [2025-09-17T22:53:25.121002] [INFO ] [MAIN ] JPI: Loaded 5451 primary data records. [2025-09-17T22:53:25.240858] [DEBUG] [LOCAL ] JPC: Loaded 37319 existing records from primary storage. [2025-09-17T22:53:25.245297] [INFO ] [MAIN ] JPC: Loaded 37319 primary data records. [2025-09-17T22:53:25.778346] [DEBUG] [LOCAL ] JPM: Loaded 53794 existing records from primary storage. [2025-09-17T22:53:25.793637] [INFO ] [MAIN ] JPM: Loaded 53794 primary data records. [2025-09-17T22:53:26.121162] [DEBUG] [MAIN ] JPI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:26.122618] [INFO ] [MAIN ] JPI: Generated 1794 derivative records from 5451 primary records. [2025-09-17T22:53:26.122879] [DEBUG] [LOCAL ] JPI: Saving derivative data. [2025-09-17T22:53:26.142775] [DEBUG] [LOCAL ] JPI: Derivative data saved (1794 records). [2025-09-17T22:53:26.142945] [INFO ] [MAIN ] JPI: Successfully saved derivative data. [2025-09-17T22:53:26.145482] [INFO ] [MAIN ] Derivative Progress: 1009/2085 symbols completed. JPI took 1.0s. Estimated remaining: 7m 0s. Rate: 153.7 symbols/min [2025-09-17T22:53:26.159766] [INFO ] [MAIN ] JQC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:26.162133] [DEBUG] [MAIN ] JPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:26.162980] [INFO ] [MAIN ] JPC: Generated 1794 derivative records from 37319 primary records. [2025-09-17T22:53:26.163195] [DEBUG] [LOCAL ] JPC: Saving derivative data. [2025-09-17T22:53:26.186099] [DEBUG] [LOCAL ] JPC: Derivative data saved (1794 records). [2025-09-17T22:53:26.186387] [INFO ] [MAIN ] JPC: Successfully saved derivative data. [2025-09-17T22:53:26.189393] [INFO ] [MAIN ] Derivative Progress: 1010/2085 symbols completed. JPC took 1.2s. Estimated remaining: 6m 59s. Rate: 153.8 symbols/min [2025-09-17T22:53:26.211504] [DEBUG] [MAIN ] JPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:26.211085] [INFO ] [MAIN ] JRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:26.212614] [INFO ] [MAIN ] JPM: Generated 1794 derivative records from 53794 primary records. [2025-09-17T22:53:26.212797] [DEBUG] [LOCAL ] JPM: Saving derivative data. [2025-09-17T22:53:26.242198] [DEBUG] [LOCAL ] JQC: Loaded 33859 existing records from primary storage. [2025-09-17T22:53:26.243027] [INFO ] [MAIN ] JQC: Loaded 33859 primary data records. [2025-09-17T22:53:26.293131] [DEBUG] [LOCAL ] JRI: Loaded 15147 existing records from primary storage. [2025-09-17T22:53:26.292841] [DEBUG] [LOCAL ] JPM: Derivative data saved (1794 records). [2025-09-17T22:53:26.320229] [INFO ] [MAIN ] JRI: Loaded 15147 primary data records. [2025-09-17T22:53:26.337456] [INFO ] [MAIN ] JPM: Successfully saved derivative data. [2025-09-17T22:53:26.377247] [INFO ] [MAIN ] Derivative Progress: 1011/2085 symbols completed. JPM took 1.3s. Estimated remaining: 6m 59s. Rate: 153.9 symbols/min [2025-09-17T22:53:26.432750] [INFO ] [MAIN ] JRS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:26.750851] [DEBUG] [LOCAL ] JRS: Loaded 11014 existing records from primary storage. [2025-09-17T22:53:26.911098] [INFO ] [MAIN ] JRS: Loaded 11014 primary data records. [2025-09-17T22:53:27.249589] [DEBUG] [MAIN ] JQC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:27.251420] [INFO ] [MAIN ] JQC: Generated 1794 derivative records from 33859 primary records. [2025-09-17T22:53:27.251575] [DEBUG] [LOCAL ] JQC: Saving derivative data. [2025-09-17T22:53:27.276537] [DEBUG] [MAIN ] JRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:27.278078] [INFO ] [MAIN ] JRI: Generated 1794 derivative records from 15147 primary records. [2025-09-17T22:53:27.278195] [DEBUG] [LOCAL ] JRI: Saving derivative data. [2025-09-17T22:53:27.296905] [DEBUG] [LOCAL ] JRI: Derivative data saved (1794 records). [2025-09-17T22:53:27.297111] [INFO ] [MAIN ] JRI: Successfully saved derivative data. [2025-09-17T22:53:27.298287] [DEBUG] [LOCAL ] JQC: Derivative data saved (1794 records). [2025-09-17T22:53:27.300885] [INFO ] [MAIN ] JQC: Successfully saved derivative data. [2025-09-17T22:53:27.300772] [INFO ] [MAIN ] Derivative Progress: 1012/2085 symbols completed. JRI took 1.1s. Estimated remaining: 6m 59s. Rate: 153.7 symbols/min [2025-09-17T22:53:27.303169] [INFO ] [MAIN ] JXN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:27.303328] [INFO ] [MAIN ] Derivative Progress: 1013/2085 symbols completed. JQC took 1.1s. Estimated remaining: 6m 58s. Rate: 153.8 symbols/min [2025-09-17T22:53:27.304026] [INFO ] [MAIN ] K: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:27.320783] [DEBUG] [MAIN ] JRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:27.321534] [INFO ] [MAIN ] JRS: Generated 1794 derivative records from 11014 primary records. [2025-09-17T22:53:27.321601] [DEBUG] [LOCAL ] JRS: Saving derivative data. [2025-09-17T22:53:27.339004] [DEBUG] [LOCAL ] JRS: Derivative data saved (1794 records). [2025-09-17T22:53:27.339193] [INFO ] [MAIN ] JRS: Successfully saved derivative data. [2025-09-17T22:53:27.341810] [INFO ] [MAIN ] Derivative Progress: 1014/2085 symbols completed. JRS took 0.9s. Estimated remaining: 6m 57s. Rate: 154.0 symbols/min [2025-09-17T22:53:27.342148] [INFO ] [MAIN ] KAI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:27.376539] [DEBUG] [LOCAL ] KAI: Loaded 13671 existing records from primary storage. [2025-09-17T22:53:27.376705] [INFO ] [MAIN ] KAI: Loaded 13671 primary data records. [2025-09-17T22:53:27.511586] [DEBUG] [LOCAL ] JXN: Loaded 46064 existing records from primary storage. [2025-09-17T22:53:27.515133] [INFO ] [MAIN ] JXN: Loaded 46064 primary data records. [2025-09-17T22:53:27.563468] [DEBUG] [LOCAL ] K: Loaded 49762 existing records from primary storage. [2025-09-17T22:53:27.581082] [INFO ] [MAIN ] K: Loaded 49762 primary data records. [2025-09-17T22:53:28.395108] [DEBUG] [MAIN ] KAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:28.395942] [INFO ] [MAIN ] KAI: Generated 1794 derivative records from 13671 primary records. [2025-09-17T22:53:28.396289] [DEBUG] [LOCAL ] KAI: Saving derivative data. [2025-09-17T22:53:28.418321] [DEBUG] [LOCAL ] KAI: Derivative data saved (1794 records). [2025-09-17T22:53:28.418630] [INFO ] [MAIN ] KAI: Successfully saved derivative data. [2025-09-17T22:53:28.420808] [INFO ] [MAIN ] Derivative Progress: 1015/2085 symbols completed. KAI took 1.1s. Estimated remaining: 6m 58s. Rate: 153.7 symbols/min [2025-09-17T22:53:28.429009] [INFO ] [MAIN ] KAR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:28.447977] [DEBUG] [MAIN ] JXN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:28.448430] [DEBUG] [MAIN ] K: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:28.449526] [INFO ] [MAIN ] JXN: Generated 1794 derivative records from 46064 primary records. [2025-09-17T22:53:28.450440] [INFO ] [MAIN ] K: Generated 1794 derivative records from 49762 primary records. [2025-09-17T22:53:28.450728] [DEBUG] [LOCAL ] K: Saving derivative data. [2025-09-17T22:53:28.450638] [DEBUG] [LOCAL ] JXN: Saving derivative data. [2025-09-17T22:53:28.480537] [DEBUG] [LOCAL ] JXN: Derivative data saved (1794 records). [2025-09-17T22:53:28.481500] [INFO ] [MAIN ] JXN: Successfully saved derivative data. [2025-09-17T22:53:28.485017] [INFO ] [MAIN ] Derivative Progress: 1016/2085 symbols completed. JXN took 1.2s. Estimated remaining: 6m 57s. Rate: 153.8 symbols/min [2025-09-17T22:53:28.485423] [INFO ] [MAIN ] KB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:28.489688] [DEBUG] [LOCAL ] K: Derivative data saved (1794 records). [2025-09-17T22:53:28.489775] [INFO ] [MAIN ] K: Successfully saved derivative data. [2025-09-17T22:53:28.492466] [INFO ] [MAIN ] Derivative Progress: 1017/2085 symbols completed. K took 1.2s. Estimated remaining: 6m 56s. Rate: 154.0 symbols/min [2025-09-17T22:53:28.492793] [INFO ] [MAIN ] KBDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:28.537694] [DEBUG] [LOCAL ] KAR: Loaded 40104 existing records from primary storage. [2025-09-17T22:53:28.538827] [INFO ] [MAIN ] KAR: Loaded 40104 primary data records. [2025-09-17T22:53:28.539166] [DEBUG] [LOCAL ] KB: Loaded 24487 existing records from primary storage. [2025-09-17T22:53:28.539344] [INFO ] [MAIN ] KB: Loaded 24487 primary data records. [2025-09-17T22:53:28.648592] [DEBUG] [LOCAL ] KBDC: Loaded 20545 existing records from primary storage. [2025-09-17T22:53:28.665775] [INFO ] [MAIN ] KBDC: Loaded 20545 primary data records. [2025-09-17T22:53:29.569478] [DEBUG] [MAIN ] KAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:29.582901] [INFO ] [MAIN ] KAR: Generated 1794 derivative records from 40104 primary records. [2025-09-17T22:53:29.594482] [DEBUG] [LOCAL ] KAR: Saving derivative data. [2025-09-17T22:53:29.594761] [DEBUG] [MAIN ] KBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:29.600831] [INFO ] [MAIN ] KBDC: Generated 1794 derivative records from 20545 primary records. [2025-09-17T22:53:29.599958] [DEBUG] [MAIN ] KB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:29.601788] [DEBUG] [LOCAL ] KBDC: Saving derivative data. [2025-09-17T22:53:29.602610] [INFO ] [MAIN ] KB: Generated 1794 derivative records from 24487 primary records. [2025-09-17T22:53:29.612340] [DEBUG] [LOCAL ] KB: Saving derivative data. [2025-09-17T22:53:29.628137] [DEBUG] [LOCAL ] KAR: Derivative data saved (1794 records). [2025-09-17T22:53:29.631560] [INFO ] [MAIN ] KAR: Successfully saved derivative data. [2025-09-17T22:53:29.642379] [INFO ] [MAIN ] Derivative Progress: 1018/2085 symbols completed. KAR took 1.2s. Estimated remaining: 6m 57s. Rate: 153.7 symbols/min [2025-09-17T22:53:29.651594] [DEBUG] [LOCAL ] KB: Derivative data saved (1794 records). [2025-09-17T22:53:29.652012] [INFO ] [MAIN ] KB: Successfully saved derivative data. [2025-09-17T22:53:29.654983] [INFO ] [MAIN ] Derivative Progress: 1019/2085 symbols completed. KB took 1.2s. Estimated remaining: 6m 56s. Rate: 153.8 symbols/min [2025-09-17T22:53:29.657256] [DEBUG] [LOCAL ] KBDC: Derivative data saved (1794 records). [2025-09-17T22:53:29.657423] [INFO ] [MAIN ] KBDC: Successfully saved derivative data. [2025-09-17T22:53:29.660156] [INFO ] [MAIN ] Derivative Progress: 1020/2085 symbols completed. KBDC took 1.2s. Estimated remaining: 6m 55s. Rate: 154.0 symbols/min [2025-09-17T22:53:29.660691] [INFO ] [MAIN ] KBH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:29.661012] [INFO ] [MAIN ] KD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:29.660940] [INFO ] [MAIN ] KBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:29.719338] [DEBUG] [LOCAL ] KBH: Loaded 48842 existing records from primary storage. [2025-09-17T22:53:29.737251] [INFO ] [MAIN ] KBH: Loaded 48842 primary data records. [2025-09-17T22:53:29.802084] [DEBUG] [LOCAL ] KBR: Loaded 48362 existing records from primary storage. [2025-09-17T22:53:29.810449] [INFO ] [MAIN ] KBR: Loaded 48362 primary data records. [2025-09-17T22:53:29.954245] [DEBUG] [LOCAL ] KD: Loaded 52300 existing records from primary storage. [2025-09-17T22:53:29.959895] [INFO ] [MAIN ] KD: Loaded 52300 primary data records. [2025-09-17T22:53:30.714670] [DEBUG] [MAIN ] KBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:30.715715] [INFO ] [MAIN ] KBH: Generated 1794 derivative records from 48842 primary records. [2025-09-17T22:53:30.715964] [DEBUG] [LOCAL ] KBH: Saving derivative data. [2025-09-17T22:53:30.751012] [DEBUG] [LOCAL ] KBH: Derivative data saved (1794 records). [2025-09-17T22:53:30.753216] [INFO ] [MAIN ] KBH: Successfully saved derivative data. [2025-09-17T22:53:30.754157] [DEBUG] [MAIN ] KBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:30.756666] [INFO ] [MAIN ] Derivative Progress: 1021/2085 symbols completed. KBH took 1.1s. Estimated remaining: 6m 55s. Rate: 153.7 symbols/min [2025-09-17T22:53:30.757784] [INFO ] [MAIN ] KBR: Generated 1794 derivative records from 48362 primary records. [2025-09-17T22:53:30.759058] [INFO ] [MAIN ] KEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:30.758971] [DEBUG] [LOCAL ] KBR: Saving derivative data. [2025-09-17T22:53:30.798563] [DEBUG] [LOCAL ] KBR: Derivative data saved (1794 records). [2025-09-17T22:53:30.807547] [DEBUG] [LOCAL ] KEN: Loaded 4724 existing records from primary storage. [2025-09-17T22:53:30.809184] [INFO ] [MAIN ] KEN: Loaded 4724 primary data records. [2025-09-17T22:53:30.809090] [INFO ] [MAIN ] KBR: Successfully saved derivative data. [2025-09-17T22:53:30.811880] [INFO ] [MAIN ] Derivative Progress: 1022/2085 symbols completed. KBR took 1.2s. Estimated remaining: 6m 55s. Rate: 153.8 symbols/min [2025-09-17T22:53:30.823566] [INFO ] [MAIN ] KEP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:30.834043] [DEBUG] [MAIN ] KD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:30.852057] [INFO ] [MAIN ] KD: Generated 1794 derivative records from 52300 primary records. [2025-09-17T22:53:30.893767] [DEBUG] [LOCAL ] KD: Saving derivative data. [2025-09-17T22:53:31.201913] [DEBUG] [LOCAL ] KD: Derivative data saved (1794 records). [2025-09-17T22:53:31.202897] [INFO ] [MAIN ] KD: Successfully saved derivative data. [2025-09-17T22:53:31.207687] [INFO ] [MAIN ] Derivative Progress: 1023/2085 symbols completed. KD took 1.5s. Estimated remaining: 6m 54s. Rate: 153.8 symbols/min [2025-09-17T22:53:31.209471] [INFO ] [MAIN ] KEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:31.208422] [DEBUG] [LOCAL ] KEP: Loaded 30243 existing records from primary storage. [2025-09-17T22:53:31.210706] [INFO ] [MAIN ] KEP: Loaded 30243 primary data records. [2025-09-17T22:53:31.544876] [DEBUG] [LOCAL ] KEX: Loaded 37719 existing records from primary storage. [2025-09-17T22:53:31.545307] [INFO ] [MAIN ] KEX: Loaded 37719 primary data records. [2025-09-17T22:53:31.657329] [DEBUG] [MAIN ] KEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:31.666258] [INFO ] [MAIN ] KEN: Generated 1794 derivative records from 4724 primary records. [2025-09-17T22:53:31.670337] [DEBUG] [LOCAL ] KEN: Saving derivative data. [2025-09-17T22:53:31.766266] [DEBUG] [LOCAL ] KEN: Derivative data saved (1794 records). [2025-09-17T22:53:31.769682] [INFO ] [MAIN ] KEN: Successfully saved derivative data. [2025-09-17T22:53:31.899171] [INFO ] [MAIN ] Derivative Progress: 1024/2085 symbols completed. KEN took 1.1s. Estimated remaining: 6m 54s. Rate: 153.7 symbols/min [2025-09-17T22:53:31.901260] [INFO ] [MAIN ] KEYS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:31.922463] [DEBUG] [MAIN ] KEP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:31.923533] [INFO ] [MAIN ] KEP: Generated 1794 derivative records from 30243 primary records. [2025-09-17T22:53:31.924888] [DEBUG] [LOCAL ] KEP: Saving derivative data. [2025-09-17T22:53:31.949068] [DEBUG] [LOCAL ] KEP: Derivative data saved (1794 records). [2025-09-17T22:53:31.949262] [INFO ] [MAIN ] KEP: Successfully saved derivative data. [2025-09-17T22:53:31.951902] [INFO ] [MAIN ] Derivative Progress: 1025/2085 symbols completed. KEP took 1.1s. Estimated remaining: 6m 53s. Rate: 153.9 symbols/min [2025-09-17T22:53:31.952448] [INFO ] [MAIN ] KF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:31.961257] [DEBUG] [LOCAL ] KF: Loaded 2507 existing records from primary storage. [2025-09-17T22:53:31.961773] [INFO ] [MAIN ] KF: Loaded 2507 primary data records. [2025-09-17T22:53:32.048325] [DEBUG] [MAIN ] KEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:32.071443] [INFO ] [MAIN ] KEX: Generated 1794 derivative records from 37719 primary records. [2025-09-17T22:53:32.076817] [DEBUG] [LOCAL ] KEX: Saving derivative data. [2025-09-17T22:53:32.138820] [DEBUG] [LOCAL ] KEYS: Loaded 43452 existing records from primary storage. [2025-09-17T22:53:32.152122] [INFO ] [MAIN ] KEYS: Loaded 43452 primary data records. [2025-09-17T22:53:32.206751] [DEBUG] [LOCAL ] KEX: Derivative data saved (1794 records). [2025-09-17T22:53:32.251148] [INFO ] [MAIN ] KEX: Successfully saved derivative data. [2025-09-17T22:53:32.269049] [INFO ] [MAIN ] Derivative Progress: 1026/2085 symbols completed. KEX took 1.1s. Estimated remaining: 6m 53s. Rate: 153.9 symbols/min [2025-09-17T22:53:32.444379] [INFO ] [MAIN ] KFRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:32.681545] [DEBUG] [LOCAL ] KFRC: Loaded 19132 existing records from primary storage. [2025-09-17T22:53:32.682102] [INFO ] [MAIN ] KFRC: Loaded 19132 primary data records. [2025-09-17T22:53:33.105885] [DEBUG] [MAIN ] KF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:33.106773] [INFO ] [MAIN ] KF: Generated 1794 derivative records from 2507 primary records. [2025-09-17T22:53:33.107081] [DEBUG] [LOCAL ] KF: Saving derivative data. [2025-09-17T22:53:33.128781] [DEBUG] [LOCAL ] KF: Derivative data saved (1794 records). [2025-09-17T22:53:33.129421] [INFO ] [MAIN ] KF: Successfully saved derivative data. [2025-09-17T22:53:33.131935] [INFO ] [MAIN ] Derivative Progress: 1027/2085 symbols completed. KF took 1.2s. Estimated remaining: 6m 53s. Rate: 153.7 symbols/min [2025-09-17T22:53:33.139795] [INFO ] [MAIN ] KFS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:33.145684] [DEBUG] [MAIN ] KEYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:33.148066] [INFO ] [MAIN ] KEYS: Generated 1794 derivative records from 43452 primary records. [2025-09-17T22:53:33.148349] [DEBUG] [LOCAL ] KEYS: Saving derivative data. [2025-09-17T22:53:33.168084] [DEBUG] [LOCAL ] KEYS: Derivative data saved (1794 records). [2025-09-17T22:53:33.168259] [INFO ] [MAIN ] KEYS: Successfully saved derivative data. [2025-09-17T22:53:33.170776] [INFO ] [MAIN ] Derivative Progress: 1028/2085 symbols completed. KEYS took 1.3s. Estimated remaining: 6m 52s. Rate: 153.8 symbols/min [2025-09-17T22:53:33.171441] [INFO ] [MAIN ] KFY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:33.176862] [DEBUG] [LOCAL ] KFS: Loaded 8100 existing records from primary storage. [2025-09-17T22:53:33.178005] [INFO ] [MAIN ] KFS: Loaded 8100 primary data records. [2025-09-17T22:53:33.300424] [DEBUG] [MAIN ] KFRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:33.312604] [INFO ] [MAIN ] KFRC: Generated 1794 derivative records from 19132 primary records. [2025-09-17T22:53:33.312791] [DEBUG] [LOCAL ] KFRC: Saving derivative data. [2025-09-17T22:53:33.357614] [DEBUG] [LOCAL ] KFY: Loaded 30780 existing records from primary storage. [2025-09-17T22:53:33.381748] [INFO ] [MAIN ] KFY: Loaded 30780 primary data records. [2025-09-17T22:53:33.679455] [DEBUG] [LOCAL ] KFRC: Derivative data saved (1794 records). [2025-09-17T22:53:33.702511] [INFO ] [MAIN ] KFRC: Successfully saved derivative data. [2025-09-17T22:53:33.735776] [INFO ] [MAIN ] Derivative Progress: 1029/2085 symbols completed. KFRC took 1.3s. Estimated remaining: 6m 52s. Rate: 153.8 symbols/min [2025-09-17T22:53:33.847224] [INFO ] [MAIN ] KGC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:33.883797] [DEBUG] [MAIN ] KFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:33.884832] [INFO ] [MAIN ] KFS: Generated 1794 derivative records from 8100 primary records. [2025-09-17T22:53:33.885101] [DEBUG] [LOCAL ] KFS: Saving derivative data. [2025-09-17T22:53:33.902002] [DEBUG] [LOCAL ] KFS: Derivative data saved (1794 records). [2025-09-17T22:53:33.903592] [INFO ] [MAIN ] KFS: Successfully saved derivative data. [2025-09-17T22:53:33.905969] [INFO ] [MAIN ] Derivative Progress: 1030/2085 symbols completed. KFS took 0.8s. Estimated remaining: 6m 51s. Rate: 153.9 symbols/min [2025-09-17T22:53:33.906535] [INFO ] [MAIN ] KGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:33.934900] [DEBUG] [MAIN ] KFY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:33.935775] [INFO ] [MAIN ] KFY: Generated 1794 derivative records from 30780 primary records. [2025-09-17T22:53:33.935970] [DEBUG] [LOCAL ] KFY: Saving derivative data. [2025-09-17T22:53:33.951757] [DEBUG] [LOCAL ] KFY: Derivative data saved (1794 records). [2025-09-17T22:53:33.952059] [INFO ] [MAIN ] KFY: Successfully saved derivative data. [2025-09-17T22:53:33.955455] [INFO ] [MAIN ] Derivative Progress: 1031/2085 symbols completed. KFY took 0.8s. Estimated remaining: 6m 51s. Rate: 154.0 symbols/min [2025-09-17T22:53:33.955782] [INFO ] [MAIN ] KIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:33.973316] [DEBUG] [LOCAL ] KGC: Loaded 53699 existing records from primary storage. [2025-09-17T22:53:33.973670] [INFO ] [MAIN ] KGC: Loaded 53699 primary data records. [2025-09-17T22:53:34.354446] [DEBUG] [LOCAL ] KGS: Loaded 45768 existing records from primary storage. [2025-09-17T22:53:34.354814] [INFO ] [MAIN ] KGS: Loaded 45768 primary data records. [2025-09-17T22:53:34.490787] [DEBUG] [LOCAL ] KIM: Loaded 53074 existing records from primary storage. [2025-09-17T22:53:34.497214] [INFO ] [MAIN ] KIM: Loaded 53074 primary data records. [2025-09-17T22:53:35.028099] [DEBUG] [MAIN ] KGC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:35.029042] [INFO ] [MAIN ] KGC: Generated 1794 derivative records from 53699 primary records. [2025-09-17T22:53:35.029392] [DEBUG] [LOCAL ] KGC: Saving derivative data. [2025-09-17T22:53:35.066942] [DEBUG] [LOCAL ] KGC: Derivative data saved (1794 records). [2025-09-17T22:53:35.067381] [INFO ] [MAIN ] KGC: Successfully saved derivative data. [2025-09-17T22:53:35.069714] [INFO ] [MAIN ] Derivative Progress: 1032/2085 symbols completed. KGC took 1.2s. Estimated remaining: 6m 51s. Rate: 153.7 symbols/min [2025-09-17T22:53:35.070796] [INFO ] [MAIN ] KIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:35.071071] [DEBUG] [MAIN ] KGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:35.072481] [INFO ] [MAIN ] KGS: Generated 1794 derivative records from 45768 primary records. [2025-09-17T22:53:35.073171] [DEBUG] [LOCAL ] KGS: Saving derivative data. [2025-09-17T22:53:35.095087] [DEBUG] [LOCAL ] KGS: Derivative data saved (1794 records). [2025-09-17T22:53:35.095224] [INFO ] [MAIN ] KGS: Successfully saved derivative data. [2025-09-17T22:53:35.097291] [INFO ] [MAIN ] Derivative Progress: 1033/2085 symbols completed. KGS took 1.2s. Estimated remaining: 6m 50s. Rate: 153.8 symbols/min [2025-09-17T22:53:35.119946] [DEBUG] [MAIN ] KIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:35.120722] [INFO ] [MAIN ] KIM: Generated 1794 derivative records from 53074 primary records. [2025-09-17T22:53:35.120867] [DEBUG] [LOCAL ] KIM: Saving derivative data. [2025-09-17T22:53:35.145195] [DEBUG] [LOCAL ] KIM: Derivative data saved (1794 records). [2025-09-17T22:53:35.145900] [INFO ] [MAIN ] KIM: Successfully saved derivative data. [2025-09-17T22:53:35.148710] [INFO ] [MAIN ] Derivative Progress: 1034/2085 symbols completed. KIM took 1.2s. Estimated remaining: 6m 50s. Rate: 154.0 symbols/min [2025-09-17T22:53:35.145804] [DEBUG] [LOCAL ] KIO: Loaded 21432 existing records from primary storage. [2025-09-17T22:53:35.149034] [INFO ] [MAIN ] KIO: Loaded 21432 primary data records. [2025-09-17T22:53:35.515269] [DEBUG] [MAIN ] KIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:35.516085] [INFO ] [MAIN ] KIO: Generated 1794 derivative records from 21432 primary records. [2025-09-17T22:53:35.516161] [DEBUG] [LOCAL ] KIO: Saving derivative data. [2025-09-17T22:53:35.532840] [DEBUG] [LOCAL ] KIO: Derivative data saved (1794 records). [2025-09-17T22:53:35.532929] [INFO ] [MAIN ] KIO: Successfully saved derivative data. [2025-09-17T22:53:35.535242] [INFO ] [MAIN ] Derivative Progress: 1035/2085 symbols completed. KIO took 0.5s. Estimated remaining: 6m 49s. Rate: 154.0 symbols/min [2025-09-17T22:53:35.535930] [INFO ] [MAIN ] KKRS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:35.536358] [INFO ] [MAIN ] KKR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:35.536912] [INFO ] [MAIN ] KLC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:35.556341] [DEBUG] [LOCAL ] KKRS: Loaded 5742 existing records from primary storage. [2025-09-17T22:53:35.556565] [INFO ] [MAIN ] KKRS: Loaded 5742 primary data records. [2025-09-17T22:53:35.727811] [DEBUG] [LOCAL ] KLC: Loaded 36209 existing records from primary storage. [2025-09-17T22:53:35.752362] [INFO ] [MAIN ] KLC: Loaded 36209 primary data records. [2025-09-17T22:53:36.071298] [DEBUG] [LOCAL ] KKR: Loaded 53514 existing records from primary storage. [2025-09-17T22:53:36.128194] [INFO ] [MAIN ] KKR: Loaded 53514 primary data records. [2025-09-17T22:53:36.595981] [DEBUG] [MAIN ] KKRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:36.597465] [INFO ] [MAIN ] KKRS: Generated 1794 derivative records from 5742 primary records. [2025-09-17T22:53:36.598144] [DEBUG] [LOCAL ] KKRS: Saving derivative data. [2025-09-17T22:53:36.618167] [DEBUG] [LOCAL ] KKRS: Derivative data saved (1794 records). [2025-09-17T22:53:36.626406] [INFO ] [MAIN ] KKRS: Successfully saved derivative data. [2025-09-17T22:53:36.628612] [INFO ] [MAIN ] Derivative Progress: 1036/2085 symbols completed. KKRS took 1.1s. Estimated remaining: 6m 49s. Rate: 153.7 symbols/min [2025-09-17T22:53:36.633915] [INFO ] [MAIN ] KLG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:36.634257] [DEBUG] [MAIN ] KLC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:36.636003] [INFO ] [MAIN ] KLC: Generated 1794 derivative records from 36209 primary records. [2025-09-17T22:53:36.636262] [DEBUG] [LOCAL ] KLC: Saving derivative data. [2025-09-17T22:53:36.655993] [DEBUG] [LOCAL ] KLC: Derivative data saved (1794 records). [2025-09-17T22:53:36.656195] [INFO ] [MAIN ] KLC: Successfully saved derivative data. [2025-09-17T22:53:36.658622] [INFO ] [MAIN ] Derivative Progress: 1037/2085 symbols completed. KLC took 1.1s. Estimated remaining: 6m 49s. Rate: 153.8 symbols/min [2025-09-17T22:53:36.659052] [INFO ] [MAIN ] KMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:36.672337] [DEBUG] [MAIN ] KKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:36.674804] [INFO ] [MAIN ] KKR: Generated 1794 derivative records from 53514 primary records. [2025-09-17T22:53:36.675057] [DEBUG] [LOCAL ] KKR: Saving derivative data. [2025-09-17T22:53:36.691843] [DEBUG] [LOCAL ] KKR: Derivative data saved (1794 records). [2025-09-17T22:53:36.692062] [INFO ] [MAIN ] KKR: Successfully saved derivative data. [2025-09-17T22:53:36.694811] [INFO ] [MAIN ] Derivative Progress: 1038/2085 symbols completed. KKR took 1.2s. Estimated remaining: 6m 48s. Rate: 154.0 symbols/min [2025-09-17T22:53:36.704541] [INFO ] [MAIN ] KMPB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:36.710498] [DEBUG] [LOCAL ] KMPB: Loaded 3628 existing records from primary storage. [2025-09-17T22:53:36.710724] [INFO ] [MAIN ] KMPB: Loaded 3628 primary data records. [2025-09-17T22:53:36.829879] [DEBUG] [LOCAL ] KLG: Loaded 41953 existing records from primary storage. [2025-09-17T22:53:36.846734] [INFO ] [MAIN ] KLG: Loaded 41953 primary data records. [2025-09-17T22:53:37.179524] [DEBUG] [LOCAL ] KMI: Loaded 53693 existing records from primary storage. [2025-09-17T22:53:37.196272] [INFO ] [MAIN ] KMI: Loaded 53693 primary data records. [2025-09-17T22:53:37.777051] [DEBUG] [MAIN ] KMPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:37.780689] [INFO ] [MAIN ] KMPB: Generated 1794 derivative records from 3628 primary records. [2025-09-17T22:53:37.781006] [DEBUG] [LOCAL ] KMPB: Saving derivative data. [2025-09-17T22:53:37.805548] [DEBUG] [MAIN ] KLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:37.809389] [INFO ] [MAIN ] KLG: Generated 1794 derivative records from 41953 primary records. [2025-09-17T22:53:37.809737] [DEBUG] [LOCAL ] KLG: Saving derivative data. [2025-09-17T22:53:37.810170] [DEBUG] [LOCAL ] KMPB: Derivative data saved (1794 records). [2025-09-17T22:53:37.811208] [INFO ] [MAIN ] KMPB: Successfully saved derivative data. [2025-09-17T22:53:37.813675] [INFO ] [MAIN ] Derivative Progress: 1039/2085 symbols completed. KMPB took 1.1s. Estimated remaining: 6m 48s. Rate: 153.7 symbols/min [2025-09-17T22:53:37.825705] [INFO ] [MAIN ] KMPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:37.830883] [DEBUG] [LOCAL ] KLG: Derivative data saved (1794 records). [2025-09-17T22:53:37.832607] [INFO ] [MAIN ] KLG: Successfully saved derivative data. [2025-09-17T22:53:37.835371] [INFO ] [MAIN ] Derivative Progress: 1040/2085 symbols completed. KLG took 1.2s. Estimated remaining: 6m 48s. Rate: 153.8 symbols/min [2025-09-17T22:53:37.836362] [INFO ] [MAIN ] KMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:37.849699] [DEBUG] [MAIN ] KMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:37.850505] [INFO ] [MAIN ] KMI: Generated 1794 derivative records from 53693 primary records. [2025-09-17T22:53:37.850715] [DEBUG] [LOCAL ] KMI: Saving derivative data. [2025-09-17T22:53:37.867721] [DEBUG] [LOCAL ] KMI: Derivative data saved (1794 records). [2025-09-17T22:53:37.867909] [INFO ] [MAIN ] KMI: Successfully saved derivative data. [2025-09-17T22:53:37.870619] [INFO ] [MAIN ] Derivative Progress: 1041/2085 symbols completed. KMI took 1.2s. Estimated remaining: 6m 47s. Rate: 154.0 symbols/min [2025-09-17T22:53:37.870991] [INFO ] [MAIN ] KMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:37.919583] [DEBUG] [LOCAL ] KMPR: Loaded 37775 existing records from primary storage. [2025-09-17T22:53:37.919792] [INFO ] [MAIN ] KMPR: Loaded 37775 primary data records. [2025-09-17T22:53:38.054768] [DEBUG] [LOCAL ] KMT: Loaded 43208 existing records from primary storage. [2025-09-17T22:53:38.070787] [INFO ] [MAIN ] KMT: Loaded 43208 primary data records. [2025-09-17T22:53:38.211944] [DEBUG] [LOCAL ] KMX: Loaded 53095 existing records from primary storage. [2025-09-17T22:53:38.360820] [INFO ] [MAIN ] KMX: Loaded 53095 primary data records. [2025-09-17T22:53:38.969557] [DEBUG] [MAIN ] KMPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:38.971107] [INFO ] [MAIN ] KMPR: Generated 1794 derivative records from 37775 primary records. [2025-09-17T22:53:38.971304] [DEBUG] [LOCAL ] KMPR: Saving derivative data. [2025-09-17T22:53:38.991170] [DEBUG] [LOCAL ] KMPR: Derivative data saved (1794 records). [2025-09-17T22:53:38.993824] [INFO ] [MAIN ] KMPR: Successfully saved derivative data. [2025-09-17T22:53:38.996260] [INFO ] [MAIN ] Derivative Progress: 1042/2085 symbols completed. KMPR took 1.2s. Estimated remaining: 6m 47s. Rate: 153.7 symbols/min [2025-09-17T22:53:38.996925] [INFO ] [MAIN ] KN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:39.011127] [DEBUG] [MAIN ] KMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:39.014045] [INFO ] [MAIN ] KMT: Generated 1794 derivative records from 43208 primary records. [2025-09-17T22:53:39.014797] [DEBUG] [LOCAL ] KMT: Saving derivative data. [2025-09-17T22:53:39.040132] [DEBUG] [MAIN ] KMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:39.041944] [INFO ] [MAIN ] KMX: Generated 1794 derivative records from 53095 primary records. [2025-09-17T22:53:39.045800] [DEBUG] [LOCAL ] KMT: Derivative data saved (1794 records). [2025-09-17T22:53:39.045952] [DEBUG] [LOCAL ] KMX: Saving derivative data. [2025-09-17T22:53:39.046144] [INFO ] [MAIN ] KMT: Successfully saved derivative data. [2025-09-17T22:53:39.048875] [INFO ] [MAIN ] Derivative Progress: 1043/2085 symbols completed. KMT took 1.2s. Estimated remaining: 6m 46s. Rate: 153.8 symbols/min [2025-09-17T22:53:39.049634] [INFO ] [MAIN ] KNF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:39.075398] [DEBUG] [LOCAL ] KMX: Derivative data saved (1794 records). [2025-09-17T22:53:39.075579] [INFO ] [MAIN ] KMX: Successfully saved derivative data. [2025-09-17T22:53:39.078335] [INFO ] [MAIN ] Derivative Progress: 1044/2085 symbols completed. KMX took 1.2s. Estimated remaining: 6m 46s. Rate: 154.0 symbols/min [2025-09-17T22:53:39.078796] [INFO ] [MAIN ] KNOP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:39.096499] [DEBUG] [LOCAL ] KN: Loaded 39090 existing records from primary storage. [2025-09-17T22:53:39.096709] [INFO ] [MAIN ] KN: Loaded 39090 primary data records. [2025-09-17T22:53:39.132890] [DEBUG] [LOCAL ] KNOP: Loaded 9935 existing records from primary storage. [2025-09-17T22:53:39.176684] [INFO ] [MAIN ] KNOP: Loaded 9935 primary data records. [2025-09-17T22:53:39.293582] [DEBUG] [LOCAL ] KNF: Loaded 35717 existing records from primary storage. [2025-09-17T22:53:39.311609] [INFO ] [MAIN ] KNF: Loaded 35717 primary data records. [2025-09-17T22:53:40.123005] [DEBUG] [MAIN ] KN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:40.123992] [INFO ] [MAIN ] KN: Generated 1794 derivative records from 39090 primary records. [2025-09-17T22:53:40.124326] [DEBUG] [LOCAL ] KN: Saving derivative data. [2025-09-17T22:53:40.148868] [DEBUG] [MAIN ] KNOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:40.149779] [INFO ] [MAIN ] KNOP: Generated 1794 derivative records from 9935 primary records. [2025-09-17T22:53:40.166965] [DEBUG] [MAIN ] KNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:40.168854] [DEBUG] [LOCAL ] KNOP: Saving derivative data. [2025-09-17T22:53:40.171668] [INFO ] [MAIN ] KNF: Generated 1794 derivative records from 35717 primary records. [2025-09-17T22:53:40.170850] [DEBUG] [LOCAL ] KN: Derivative data saved (1794 records). [2025-09-17T22:53:40.171929] [DEBUG] [LOCAL ] KNF: Saving derivative data. [2025-09-17T22:53:40.171863] [INFO ] [MAIN ] KN: Successfully saved derivative data. [2025-09-17T22:53:40.183683] [INFO ] [MAIN ] Derivative Progress: 1045/2085 symbols completed. KN took 1.2s. Estimated remaining: 6m 46s. Rate: 153.7 symbols/min [2025-09-17T22:53:40.205251] [INFO ] [MAIN ] KNSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:40.207066] [DEBUG] [LOCAL ] KNOP: Derivative data saved (1794 records). [2025-09-17T22:53:40.207219] [INFO ] [MAIN ] KNOP: Successfully saved derivative data. [2025-09-17T22:53:40.211035] [INFO ] [MAIN ] Derivative Progress: 1046/2085 symbols completed. KNOP took 1.1s. Estimated remaining: 6m 45s. Rate: 153.8 symbols/min [2025-09-17T22:53:40.211782] [DEBUG] [LOCAL ] KNF: Derivative data saved (1794 records). [2025-09-17T22:53:40.211989] [INFO ] [MAIN ] KNTK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:40.212379] [INFO ] [MAIN ] KNF: Successfully saved derivative data. [2025-09-17T22:53:40.215297] [INFO ] [MAIN ] Derivative Progress: 1047/2085 symbols completed. KNF took 1.2s. Estimated remaining: 6m 44s. Rate: 154.0 symbols/min [2025-09-17T22:53:40.215851] [INFO ] [MAIN ] KNX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:40.233759] [DEBUG] [LOCAL ] KNSL: Loaded 18097 existing records from primary storage. [2025-09-17T22:53:40.233952] [INFO ] [MAIN ] KNSL: Loaded 18097 primary data records. [2025-09-17T22:53:40.591133] [DEBUG] [LOCAL ] KNTK: Loaded 46122 existing records from primary storage. [2025-09-17T22:53:40.591604] [INFO ] [MAIN ] KNTK: Loaded 46122 primary data records. [2025-09-17T22:53:40.592453] [DEBUG] [LOCAL ] KNX: Loaded 52589 existing records from primary storage. [2025-09-17T22:53:40.604973] [INFO ] [MAIN ] KNX: Loaded 52589 primary data records. [2025-09-17T22:53:41.239518] [DEBUG] [MAIN ] KNSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:41.240400] [INFO ] [MAIN ] KNSL: Generated 1794 derivative records from 18097 primary records. [2025-09-17T22:53:41.240663] [DEBUG] [LOCAL ] KNSL: Saving derivative data. [2025-09-17T22:53:41.258776] [DEBUG] [LOCAL ] KNSL: Derivative data saved (1794 records). [2025-09-17T22:53:41.259149] [INFO ] [MAIN ] KNSL: Successfully saved derivative data. [2025-09-17T22:53:41.261539] [INFO ] [MAIN ] Derivative Progress: 1048/2085 symbols completed. KNSL took 1.1s. Estimated remaining: 6m 45s. Rate: 153.7 symbols/min [2025-09-17T22:53:41.281469] [DEBUG] [MAIN ] KNTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:41.282959] [INFO ] [MAIN ] KNTK: Generated 1794 derivative records from 46122 primary records. [2025-09-17T22:53:41.283076] [DEBUG] [LOCAL ] KNTK: Saving derivative data. [2025-09-17T22:53:41.305762] [DEBUG] [MAIN ] KNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:41.309170] [INFO ] [MAIN ] KNX: Generated 1794 derivative records from 52589 primary records. [2025-09-17T22:53:41.309967] [DEBUG] [LOCAL ] KNX: Saving derivative data. [2025-09-17T22:53:41.314608] [DEBUG] [LOCAL ] KNTK: Derivative data saved (1794 records). [2025-09-17T22:53:41.314864] [INFO ] [MAIN ] KNTK: Successfully saved derivative data. [2025-09-17T22:53:41.324225] [INFO ] [MAIN ] Derivative Progress: 1049/2085 symbols completed. KNTK took 1.1s. Estimated remaining: 6m 44s. Rate: 153.8 symbols/min [2025-09-17T22:53:41.332240] [DEBUG] [LOCAL ] KNX: Derivative data saved (1794 records). [2025-09-17T22:53:41.332504] [INFO ] [MAIN ] KNX: Successfully saved derivative data. [2025-09-17T22:53:41.335486] [INFO ] [MAIN ] Derivative Progress: 1050/2085 symbols completed. KNX took 1.1s. Estimated remaining: 6m 43s. Rate: 154.0 symbols/min [2025-09-17T22:53:41.336100] [INFO ] [MAIN ] KO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:41.336268] [INFO ] [MAIN ] KODK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:41.337195] [INFO ] [MAIN ] KOF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:41.369885] [DEBUG] [LOCAL ] KOF: Loaded 25967 existing records from primary storage. [2025-09-17T22:53:41.370898] [INFO ] [MAIN ] KOF: Loaded 25967 primary data records. [2025-09-17T22:53:41.564534] [DEBUG] [LOCAL ] KODK: Loaded 43470 existing records from primary storage. [2025-09-17T22:53:41.586963] [DEBUG] [LOCAL ] KO: Loaded 53818 existing records from primary storage. [2025-09-17T22:53:41.622207] [INFO ] [MAIN ] KODK: Loaded 43470 primary data records. [2025-09-17T22:53:41.622498] [INFO ] [MAIN ] KO: Loaded 53818 primary data records. [2025-09-17T22:53:42.424994] [DEBUG] [MAIN ] KOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:42.429103] [INFO ] [MAIN ] KOF: Generated 1794 derivative records from 25967 primary records. [2025-09-17T22:53:42.429261] [DEBUG] [LOCAL ] KOF: Saving derivative data. [2025-09-17T22:53:42.445475] [DEBUG] [MAIN ] KO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:42.455305] [INFO ] [MAIN ] KO: Generated 1794 derivative records from 53818 primary records. [2025-09-17T22:53:42.455714] [DEBUG] [LOCAL ] KO: Saving derivative data. [2025-09-17T22:53:42.485742] [DEBUG] [MAIN ] KODK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:42.491394] [DEBUG] [LOCAL ] KO: Derivative data saved (1794 records). [2025-09-17T22:53:42.491844] [INFO ] [MAIN ] KO: Successfully saved derivative data. [2025-09-17T22:53:42.490128] [INFO ] [MAIN ] KODK: Generated 1794 derivative records from 43470 primary records. [2025-09-17T22:53:42.492289] [DEBUG] [LOCAL ] KODK: Saving derivative data. [2025-09-17T22:53:42.495835] [INFO ] [MAIN ] Derivative Progress: 1051/2085 symbols completed. KO took 1.2s. Estimated remaining: 6m 44s. Rate: 153.7 symbols/min [2025-09-17T22:53:42.497871] [INFO ] [MAIN ] KOP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:42.516719] [DEBUG] [LOCAL ] KOF: Derivative data saved (1794 records). [2025-09-17T22:53:42.516809] [DEBUG] [LOCAL ] KODK: Derivative data saved (1794 records). [2025-09-17T22:53:42.517033] [INFO ] [MAIN ] KODK: Successfully saved derivative data. [2025-09-17T22:53:42.517150] [INFO ] [MAIN ] KOF: Successfully saved derivative data. [2025-09-17T22:53:42.519249] [INFO ] [MAIN ] Derivative Progress: 1052/2085 symbols completed. KOF took 1.2s. Estimated remaining: 6m 43s. Rate: 153.8 symbols/min [2025-09-17T22:53:42.522230] [INFO ] [MAIN ] Derivative Progress: 1053/2085 symbols completed. KODK took 1.2s. Estimated remaining: 6m 42s. Rate: 154.0 symbols/min [2025-09-17T22:53:42.519678] [INFO ] [MAIN ] KORE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:42.522698] [INFO ] [MAIN ] KOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:42.532829] [DEBUG] [LOCAL ] KORE: Loaded 1946 existing records from primary storage. [2025-09-17T22:53:42.532975] [INFO ] [MAIN ] KORE: Loaded 1946 primary data records. [2025-09-17T22:53:42.608631] [DEBUG] [LOCAL ] KOP: Loaded 18043 existing records from primary storage. [2025-09-17T22:53:42.614097] [INFO ] [MAIN ] KOP: Loaded 18043 primary data records. [2025-09-17T22:53:43.200882] [DEBUG] [LOCAL ] KOS: Loaded 53069 existing records from primary storage. [2025-09-17T22:53:43.201748] [INFO ] [MAIN ] KOS: Loaded 53069 primary data records. [2025-09-17T22:53:43.582853] [DEBUG] [MAIN ] KORE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:43.584859] [INFO ] [MAIN ] KORE: Generated 1794 derivative records from 1946 primary records. [2025-09-17T22:53:43.586211] [DEBUG] [LOCAL ] KORE: Saving derivative data. [2025-09-17T22:53:43.611086] [DEBUG] [MAIN ] KOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:43.612808] [INFO ] [MAIN ] KOP: Generated 1794 derivative records from 18043 primary records. [2025-09-17T22:53:43.613822] [DEBUG] [LOCAL ] KOP: Saving derivative data. [2025-09-17T22:53:43.616262] [DEBUG] [LOCAL ] KORE: Derivative data saved (1794 records). [2025-09-17T22:53:43.616560] [INFO ] [MAIN ] KORE: Successfully saved derivative data. [2025-09-17T22:53:43.625813] [INFO ] [MAIN ] Derivative Progress: 1054/2085 symbols completed. KORE took 1.1s. Estimated remaining: 6m 42s. Rate: 153.7 symbols/min [2025-09-17T22:53:43.634920] [INFO ] [MAIN ] KR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:43.635253] [DEBUG] [LOCAL ] KOP: Derivative data saved (1794 records). [2025-09-17T22:53:43.635630] [INFO ] [MAIN ] KOP: Successfully saved derivative data. [2025-09-17T22:53:43.638455] [INFO ] [MAIN ] Derivative Progress: 1055/2085 symbols completed. KOP took 1.1s. Estimated remaining: 6m 42s. Rate: 153.9 symbols/min [2025-09-17T22:53:43.638982] [INFO ] [MAIN ] KRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:43.659868] [DEBUG] [MAIN ] KOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:43.660724] [INFO ] [MAIN ] KOS: Generated 1794 derivative records from 53069 primary records. [2025-09-17T22:53:43.660863] [DEBUG] [LOCAL ] KOS: Saving derivative data. [2025-09-17T22:53:43.678155] [DEBUG] [LOCAL ] KOS: Derivative data saved (1794 records). [2025-09-17T22:53:43.678407] [INFO ] [MAIN ] KOS: Successfully saved derivative data. [2025-09-17T22:53:43.681250] [INFO ] [MAIN ] Derivative Progress: 1056/2085 symbols completed. KOS took 1.2s. Estimated remaining: 6m 41s. Rate: 154.0 symbols/min [2025-09-17T22:53:43.681562] [INFO ] [MAIN ] KREF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:43.753812] [DEBUG] [LOCAL ] KRC: Loaded 48440 existing records from primary storage. [2025-09-17T22:53:43.754123] [INFO ] [MAIN ] KRC: Loaded 48440 primary data records. [2025-09-17T22:53:43.754944] [DEBUG] [LOCAL ] KR: Loaded 53682 existing records from primary storage. [2025-09-17T22:53:43.767066] [INFO ] [MAIN ] KR: Loaded 53682 primary data records. [2025-09-17T22:53:43.957398] [DEBUG] [LOCAL ] KREF: Loaded 36950 existing records from primary storage. [2025-09-17T22:53:44.028466] [INFO ] [MAIN ] KREF: Loaded 36950 primary data records. [2025-09-17T22:53:44.712721] [DEBUG] [MAIN ] KRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:44.714287] [INFO ] [MAIN ] KRC: Generated 1794 derivative records from 48440 primary records. [2025-09-17T22:53:44.716809] [DEBUG] [LOCAL ] KRC: Saving derivative data. [2025-09-17T22:53:44.746574] [DEBUG] [LOCAL ] KRC: Derivative data saved (1794 records). [2025-09-17T22:53:44.746513] [DEBUG] [MAIN ] KR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:44.747179] [INFO ] [MAIN ] KRC: Successfully saved derivative data. [2025-09-17T22:53:44.749819] [INFO ] [MAIN ] Derivative Progress: 1057/2085 symbols completed. KRC took 1.1s. Estimated remaining: 6m 41s. Rate: 153.7 symbols/min [2025-09-17T22:53:44.747859] [INFO ] [MAIN ] KR: Generated 1794 derivative records from 53682 primary records. [2025-09-17T22:53:44.749959] [DEBUG] [LOCAL ] KR: Saving derivative data. [2025-09-17T22:53:44.750971] [INFO ] [MAIN ] KRG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:44.770345] [DEBUG] [LOCAL ] KR: Derivative data saved (1794 records). [2025-09-17T22:53:44.770528] [INFO ] [MAIN ] KR: Successfully saved derivative data. [2025-09-17T22:53:44.773035] [INFO ] [MAIN ] Derivative Progress: 1058/2085 symbols completed. KR took 1.1s. Estimated remaining: 6m 40s. Rate: 153.9 symbols/min [2025-09-17T22:53:44.786488] [INFO ] [MAIN ] KRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:44.786406] [DEBUG] [MAIN ] KREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:44.787714] [INFO ] [MAIN ] KREF: Generated 1794 derivative records from 36950 primary records. [2025-09-17T22:53:44.787804] [DEBUG] [LOCAL ] KREF: Saving derivative data. [2025-09-17T22:53:44.806101] [DEBUG] [LOCAL ] KREF: Derivative data saved (1794 records). [2025-09-17T22:53:44.806274] [INFO ] [MAIN ] KREF: Successfully saved derivative data. [2025-09-17T22:53:44.809197] [INFO ] [MAIN ] Derivative Progress: 1059/2085 symbols completed. KREF took 1.1s. Estimated remaining: 6m 40s. Rate: 154.0 symbols/min [2025-09-17T22:53:44.817229] [INFO ] [MAIN ] KRP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:44.838239] [DEBUG] [LOCAL ] KRO: Loaded 25757 existing records from primary storage. [2025-09-17T22:53:44.838388] [INFO ] [MAIN ] KRO: Loaded 25757 primary data records. [2025-09-17T22:53:44.957162] [DEBUG] [LOCAL ] KRG: Loaded 49169 existing records from primary storage. [2025-09-17T22:53:44.968374] [INFO ] [MAIN ] KRG: Loaded 49169 primary data records. [2025-09-17T22:53:45.310780] [DEBUG] [LOCAL ] KRP: Loaded 38029 existing records from primary storage. [2025-09-17T22:53:45.316382] [INFO ] [MAIN ] KRP: Loaded 38029 primary data records. [2025-09-17T22:53:45.875997] [DEBUG] [MAIN ] KRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:45.878025] [INFO ] [MAIN ] KRO: Generated 1794 derivative records from 25757 primary records. [2025-09-17T22:53:45.878726] [DEBUG] [LOCAL ] KRO: Saving derivative data. [2025-09-17T22:53:45.901121] [DEBUG] [LOCAL ] KRO: Derivative data saved (1794 records). [2025-09-17T22:53:45.902727] [INFO ] [MAIN ] KRO: Successfully saved derivative data. [2025-09-17T22:53:45.905851] [INFO ] [MAIN ] Derivative Progress: 1060/2085 symbols completed. KRO took 1.1s. Estimated remaining: 6m 40s. Rate: 153.7 symbols/min [2025-09-17T22:53:45.906518] [INFO ] [MAIN ] KSS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:45.922026] [DEBUG] [MAIN ] KRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:45.924697] [INFO ] [MAIN ] KRG: Generated 1794 derivative records from 49169 primary records. [2025-09-17T22:53:45.925042] [DEBUG] [LOCAL ] KRG: Saving derivative data. [2025-09-17T22:53:45.946479] [DEBUG] [MAIN ] KRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:45.952257] [INFO ] [MAIN ] KRP: Generated 1794 derivative records from 38029 primary records. [2025-09-17T22:53:45.952931] [DEBUG] [LOCAL ] KRP: Saving derivative data. [2025-09-17T22:53:45.957560] [DEBUG] [LOCAL ] KRG: Derivative data saved (1794 records). [2025-09-17T22:53:45.965149] [INFO ] [MAIN ] KRG: Successfully saved derivative data. [2025-09-17T22:53:45.967984] [INFO ] [MAIN ] Derivative Progress: 1061/2085 symbols completed. KRG took 1.2s. Estimated remaining: 6m 39s. Rate: 153.9 symbols/min [2025-09-17T22:53:45.972340] [INFO ] [MAIN ] KT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:45.981317] [DEBUG] [LOCAL ] KRP: Derivative data saved (1794 records). [2025-09-17T22:53:45.994916] [INFO ] [MAIN ] KRP: Successfully saved derivative data. [2025-09-17T22:53:45.997909] [INFO ] [MAIN ] Derivative Progress: 1062/2085 symbols completed. KRP took 1.2s. Estimated remaining: 6m 39s. Rate: 154.0 symbols/min [2025-09-17T22:53:45.998443] [INFO ] [MAIN ] KTB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:46.020800] [DEBUG] [LOCAL ] KSS: Loaded 53612 existing records from primary storage. [2025-09-17T22:53:46.021090] [INFO ] [MAIN ] KSS: Loaded 53612 primary data records. [2025-09-17T22:53:46.224080] [DEBUG] [LOCAL ] KT: Loaded 45715 existing records from primary storage. [2025-09-17T22:53:46.249543] [INFO ] [MAIN ] KT: Loaded 45715 primary data records. [2025-09-17T22:53:46.303887] [DEBUG] [LOCAL ] KTB: Loaded 41325 existing records from primary storage. [2025-09-17T22:53:46.464113] [INFO ] [MAIN ] KTB: Loaded 41325 primary data records. [2025-09-17T22:53:47.036184] [DEBUG] [MAIN ] KSS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:47.040551] [INFO ] [MAIN ] KSS: Generated 1794 derivative records from 53612 primary records. [2025-09-17T22:53:47.040687] [DEBUG] [LOCAL ] KSS: Saving derivative data. [2025-09-17T22:53:47.069584] [DEBUG] [MAIN ] KT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:47.071853] [INFO ] [MAIN ] KT: Generated 1794 derivative records from 45715 primary records. [2025-09-17T22:53:47.078886] [DEBUG] [LOCAL ] KT: Saving derivative data. [2025-09-17T22:53:47.091861] [DEBUG] [LOCAL ] KSS: Derivative data saved (1794 records). [2025-09-17T22:53:47.095965] [INFO ] [MAIN ] KSS: Successfully saved derivative data. [2025-09-17T22:53:47.098543] [INFO ] [MAIN ] Derivative Progress: 1063/2085 symbols completed. KSS took 1.2s. Estimated remaining: 6m 39s. Rate: 153.7 symbols/min [2025-09-17T22:53:47.112563] [DEBUG] [MAIN ] KTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:47.114564] [INFO ] [MAIN ] KTB: Generated 1794 derivative records from 41325 primary records. [2025-09-17T22:53:47.114666] [DEBUG] [LOCAL ] KTB: Saving derivative data. [2025-09-17T22:53:47.125795] [DEBUG] [LOCAL ] KT: Derivative data saved (1794 records). [2025-09-17T22:53:47.128487] [INFO ] [MAIN ] KT: Successfully saved derivative data. [2025-09-17T22:53:47.132102] [INFO ] [MAIN ] Derivative Progress: 1064/2085 symbols completed. KT took 1.2s. Estimated remaining: 6m 38s. Rate: 153.9 symbols/min [2025-09-17T22:53:47.135799] [DEBUG] [LOCAL ] KTB: Derivative data saved (1794 records). [2025-09-17T22:53:47.135874] [INFO ] [MAIN ] KTB: Successfully saved derivative data. [2025-09-17T22:53:47.138627] [INFO ] [MAIN ] Derivative Progress: 1065/2085 symbols completed. KTB took 1.1s. Estimated remaining: 6m 37s. Rate: 154.0 symbols/min [2025-09-17T22:53:47.139668] [INFO ] [MAIN ] KVUE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:47.139589] [INFO ] [MAIN ] KTF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:47.139939] [INFO ] [MAIN ] KVYO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:47.164289] [DEBUG] [LOCAL ] KTF: Loaded 13205 existing records from primary storage. [2025-09-17T22:53:47.164555] [INFO ] [MAIN ] KTF: Loaded 13205 primary data records. [2025-09-17T22:53:47.417895] [DEBUG] [LOCAL ] KVUE: Loaded 53667 existing records from primary storage. [2025-09-17T22:53:47.417016] [DEBUG] [LOCAL ] KVYO: Loaded 49801 existing records from primary storage. [2025-09-17T22:53:47.418040] [INFO ] [MAIN ] KVUE: Loaded 53667 primary data records. [2025-09-17T22:53:47.418137] [INFO ] [MAIN ] KVYO: Loaded 49801 primary data records. [2025-09-17T22:53:48.227752] [DEBUG] [MAIN ] KTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:48.229161] [INFO ] [MAIN ] KTF: Generated 1794 derivative records from 13205 primary records. [2025-09-17T22:53:48.229903] [DEBUG] [LOCAL ] KTF: Saving derivative data. [2025-09-17T22:53:48.247157] [DEBUG] [LOCAL ] KTF: Derivative data saved (1794 records). [2025-09-17T22:53:48.247244] [INFO ] [MAIN ] KTF: Successfully saved derivative data. [2025-09-17T22:53:48.249275] [INFO ] [MAIN ] Derivative Progress: 1066/2085 symbols completed. KTF took 1.1s. Estimated remaining: 6m 38s. Rate: 153.7 symbols/min [2025-09-17T22:53:48.249922] [INFO ] [MAIN ] KWR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:48.277627] [DEBUG] [MAIN ] KVYO: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:53:48.278526] [INFO ] [MAIN ] KVYO: Generated 1793 derivative records from 49801 primary records. [2025-09-17T22:53:48.297413] [DEBUG] [LOCAL ] KVYO: Saving derivative data. [2025-09-17T22:53:48.297911] [DEBUG] [MAIN ] KVUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:48.298246] [DEBUG] [LOCAL ] KWR: Loaded 16961 existing records from primary storage. [2025-09-17T22:53:48.299809] [INFO ] [MAIN ] KVUE: Generated 1794 derivative records from 53667 primary records. [2025-09-17T22:53:48.299942] [DEBUG] [LOCAL ] KVUE: Saving derivative data. [2025-09-17T22:53:48.300446] [INFO ] [MAIN ] KWR: Loaded 16961 primary data records. [2025-09-17T22:53:48.406255] [DEBUG] [LOCAL ] KVYO: Derivative data saved (1793 records). [2025-09-17T22:53:48.417722] [INFO ] [MAIN ] KVYO: Successfully saved derivative data. [2025-09-17T22:53:48.433875] [INFO ] [MAIN ] Derivative Progress: 1067/2085 symbols completed. KVYO took 1.3s. Estimated remaining: 6m 37s. Rate: 153.8 symbols/min [2025-09-17T22:53:48.439077] [INFO ] [MAIN ] KYN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:48.497065] [DEBUG] [LOCAL ] KVUE: Derivative data saved (1794 records). [2025-09-17T22:53:48.516920] [INFO ] [MAIN ] KVUE: Successfully saved derivative data. [2025-09-17T22:53:48.523115] [INFO ] [MAIN ] Derivative Progress: 1068/2085 symbols completed. KVUE took 1.4s. Estimated remaining: 6m 36s. Rate: 153.9 symbols/min [2025-09-17T22:53:48.523676] [INFO ] [MAIN ] L: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:48.670207] [DEBUG] [LOCAL ] KYN: Loaded 30453 existing records from primary storage. [2025-09-17T22:53:48.670581] [INFO ] [MAIN ] KYN: Loaded 30453 primary data records. [2025-09-17T22:53:48.801920] [DEBUG] [MAIN ] KWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:48.834773] [INFO ] [MAIN ] KWR: Generated 1794 derivative records from 16961 primary records. [2025-09-17T22:53:48.870290] [DEBUG] [LOCAL ] KWR: Saving derivative data. [2025-09-17T22:53:48.893794] [DEBUG] [LOCAL ] L: Loaded 40964 existing records from primary storage. [2025-09-17T22:53:48.894216] [INFO ] [MAIN ] L: Loaded 40964 primary data records. [2025-09-17T22:53:49.037261] [DEBUG] [LOCAL ] KWR: Derivative data saved (1794 records). [2025-09-17T22:53:49.076187] [INFO ] [MAIN ] KWR: Successfully saved derivative data. [2025-09-17T22:53:49.100754] [INFO ] [MAIN ] Derivative Progress: 1069/2085 symbols completed. KWR took 0.9s. Estimated remaining: 6m 36s. Rate: 153.9 symbols/min [2025-09-17T22:53:49.125197] [INFO ] [MAIN ] LAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:49.359918] [DEBUG] [MAIN ] KYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:49.360802] [INFO ] [MAIN ] KYN: Generated 1794 derivative records from 30453 primary records. [2025-09-17T22:53:49.361132] [DEBUG] [LOCAL ] KYN: Saving derivative data. [2025-09-17T22:53:49.394928] [DEBUG] [LOCAL ] KYN: Derivative data saved (1794 records). [2025-09-17T22:53:49.396814] [INFO ] [MAIN ] KYN: Successfully saved derivative data. [2025-09-17T22:53:49.400177] [INFO ] [MAIN ] Derivative Progress: 1070/2085 symbols completed. KYN took 1.0s. Estimated remaining: 6m 36s. Rate: 153.9 symbols/min [2025-09-17T22:53:49.401277] [INFO ] [MAIN ] LAD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:49.429505] [DEBUG] [MAIN ] L: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:49.430603] [DEBUG] [LOCAL ] LAC: Loaded 52283 existing records from primary storage. [2025-09-17T22:53:49.430847] [INFO ] [MAIN ] LAC: Loaded 52283 primary data records. [2025-09-17T22:53:49.431637] [INFO ] [MAIN ] L: Generated 1794 derivative records from 40964 primary records. [2025-09-17T22:53:49.436889] [DEBUG] [LOCAL ] L: Saving derivative data. [2025-09-17T22:53:49.606739] [DEBUG] [LOCAL ] LAD: Loaded 24135 existing records from primary storage. [2025-09-17T22:53:49.636803] [INFO ] [MAIN ] LAD: Loaded 24135 primary data records. [2025-09-17T22:53:49.659442] [DEBUG] [LOCAL ] L: Derivative data saved (1794 records). [2025-09-17T22:53:49.663273] [INFO ] [MAIN ] L: Successfully saved derivative data. [2025-09-17T22:53:49.858854] [INFO ] [MAIN ] Derivative Progress: 1071/2085 symbols completed. L took 1.3s. Estimated remaining: 6m 35s. Rate: 153.9 symbols/min [2025-09-17T22:53:49.873257] [INFO ] [MAIN ] LADR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:50.168216] [DEBUG] [LOCAL ] LADR: Loaded 38617 existing records from primary storage. [2025-09-17T22:53:50.169066] [DEBUG] [MAIN ] LAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:50.169149] [INFO ] [MAIN ] LADR: Loaded 38617 primary data records. [2025-09-17T22:53:50.169863] [INFO ] [MAIN ] LAC: Generated 1794 derivative records from 52283 primary records. [2025-09-17T22:53:50.170125] [DEBUG] [LOCAL ] LAC: Saving derivative data. [2025-09-17T22:53:50.352008] [DEBUG] [LOCAL ] LAC: Derivative data saved (1794 records). [2025-09-17T22:53:50.369374] [INFO ] [MAIN ] LAC: Successfully saved derivative data. [2025-09-17T22:53:50.377577] [INFO ] [MAIN ] Derivative Progress: 1072/2085 symbols completed. LAC took 1.3s. Estimated remaining: 6m 35s. Rate: 153.8 symbols/min [2025-09-17T22:53:50.511017] [INFO ] [MAIN ] LANV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:50.510725] [DEBUG] [MAIN ] LAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:50.511811] [INFO ] [MAIN ] LAD: Generated 1794 derivative records from 24135 primary records. [2025-09-17T22:53:50.512293] [DEBUG] [LOCAL ] LAD: Saving derivative data. [2025-09-17T22:53:50.530894] [DEBUG] [LOCAL ] LANV: Loaded 2637 existing records from primary storage. [2025-09-17T22:53:50.531903] [INFO ] [MAIN ] LANV: Loaded 2637 primary data records. [2025-09-17T22:53:50.587634] [DEBUG] [LOCAL ] LAD: Derivative data saved (1794 records). [2025-09-17T22:53:50.605253] [INFO ] [MAIN ] LAD: Successfully saved derivative data. [2025-09-17T22:53:50.607381] [INFO ] [MAIN ] Derivative Progress: 1073/2085 symbols completed. LAD took 1.2s. Estimated remaining: 6m 35s. Rate: 153.9 symbols/min [2025-09-17T22:53:50.632117] [INFO ] [MAIN ] LAW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:50.865950] [DEBUG] [LOCAL ] LAW: Loaded 13850 existing records from primary storage. [2025-09-17T22:53:50.867567] [INFO ] [MAIN ] LAW: Loaded 13850 primary data records. [2025-09-17T22:53:50.927916] [DEBUG] [MAIN ] LADR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:50.969533] [INFO ] [MAIN ] LADR: Generated 1794 derivative records from 38617 primary records. [2025-09-17T22:53:50.982285] [DEBUG] [LOCAL ] LADR: Saving derivative data. [2025-09-17T22:53:51.218463] [DEBUG] [LOCAL ] LADR: Derivative data saved (1794 records). [2025-09-17T22:53:51.218902] [INFO ] [MAIN ] LADR: Successfully saved derivative data. [2025-09-17T22:53:51.222563] [INFO ] [MAIN ] Derivative Progress: 1074/2085 symbols completed. LADR took 1.3s. Estimated remaining: 6m 34s. Rate: 153.8 symbols/min [2025-09-17T22:53:51.224007] [INFO ] [MAIN ] LAZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:51.243356] [DEBUG] [MAIN ] LANV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:53:51.244535] [INFO ] [MAIN ] LANV: Generated 1793 derivative records from 2637 primary records. [2025-09-17T22:53:51.244627] [DEBUG] [LOCAL ] LANV: Saving derivative data. [2025-09-17T22:53:51.259373] [DEBUG] [LOCAL ] LANV: Derivative data saved (1793 records). [2025-09-17T22:53:51.259720] [INFO ] [MAIN ] LANV: Successfully saved derivative data. [2025-09-17T22:53:51.262088] [INFO ] [MAIN ] Derivative Progress: 1075/2085 symbols completed. LANV took 0.8s. Estimated remaining: 6m 34s. Rate: 153.9 symbols/min [2025-09-17T22:53:51.262474] [INFO ] [MAIN ] LB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:51.290301] [DEBUG] [MAIN ] LAW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:51.291218] [INFO ] [MAIN ] LAW: Generated 1794 derivative records from 13850 primary records. [2025-09-17T22:53:51.291469] [DEBUG] [LOCAL ] LAW: Saving derivative data. [2025-09-17T22:53:51.308415] [DEBUG] [LOCAL ] LAW: Derivative data saved (1794 records). [2025-09-17T22:53:51.308571] [INFO ] [MAIN ] LAW: Successfully saved derivative data. [2025-09-17T22:53:51.311304] [INFO ] [MAIN ] Derivative Progress: 1076/2085 symbols completed. LAW took 0.7s. Estimated remaining: 6m 33s. Rate: 154.0 symbols/min [2025-09-17T22:53:51.311762] [INFO ] [MAIN ] LBRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:51.326538] [DEBUG] [LOCAL ] LAZ: Loaded 45461 existing records from primary storage. [2025-09-17T22:53:51.326898] [INFO ] [MAIN ] LAZ: Loaded 45461 primary data records. [2025-09-17T22:53:51.478572] [DEBUG] [LOCAL ] LB: Loaded 37916 existing records from primary storage. [2025-09-17T22:53:51.504502] [INFO ] [MAIN ] LB: Loaded 37916 primary data records. [2025-09-17T22:53:52.032068] [DEBUG] [LOCAL ] LBRT: Loaded 52924 existing records from primary storage. [2025-09-17T22:53:52.033019] [INFO ] [MAIN ] LBRT: Loaded 52924 primary data records. [2025-09-17T22:53:52.359348] [DEBUG] [MAIN ] LAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:52.360428] [INFO ] [MAIN ] LAZ: Generated 1794 derivative records from 45461 primary records. [2025-09-17T22:53:52.360716] [DEBUG] [LOCAL ] LAZ: Saving derivative data. [2025-09-17T22:53:52.395176] [DEBUG] [LOCAL ] LAZ: Derivative data saved (1794 records). [2025-09-17T22:53:52.395482] [DEBUG] [MAIN ] LB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:52.397412] [INFO ] [MAIN ] LB: Generated 1794 derivative records from 37916 primary records. [2025-09-17T22:53:52.395681] [INFO ] [MAIN ] LAZ: Successfully saved derivative data. [2025-09-17T22:53:52.397532] [DEBUG] [LOCAL ] LB: Saving derivative data. [2025-09-17T22:53:52.401559] [INFO ] [MAIN ] Derivative Progress: 1077/2085 symbols completed. LAZ took 1.2s. Estimated remaining: 6m 33s. Rate: 153.8 symbols/min [2025-09-17T22:53:52.402474] [INFO ] [MAIN ] LC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:52.419587] [DEBUG] [LOCAL ] LB: Derivative data saved (1794 records). [2025-09-17T22:53:52.419898] [INFO ] [MAIN ] LB: Successfully saved derivative data. [2025-09-17T22:53:52.422440] [INFO ] [MAIN ] Derivative Progress: 1078/2085 symbols completed. LB took 1.2s. Estimated remaining: 6m 33s. Rate: 153.9 symbols/min [2025-09-17T22:53:52.437824] [DEBUG] [MAIN ] LBRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:52.438468] [INFO ] [MAIN ] LBRT: Generated 1794 derivative records from 52924 primary records. [2025-09-17T22:53:52.438530] [DEBUG] [LOCAL ] LBRT: Saving derivative data. [2025-09-17T22:53:52.454887] [DEBUG] [LOCAL ] LBRT: Derivative data saved (1794 records). [2025-09-17T22:53:52.455004] [INFO ] [MAIN ] LBRT: Successfully saved derivative data. [2025-09-17T22:53:52.457495] [INFO ] [MAIN ] Derivative Progress: 1079/2085 symbols completed. LBRT took 1.1s. Estimated remaining: 6m 32s. Rate: 154.1 symbols/min [2025-09-17T22:53:52.489251] [DEBUG] [LOCAL ] LC: Loaded 48027 existing records from primary storage. [2025-09-17T22:53:52.489424] [INFO ] [MAIN ] LC: Loaded 48027 primary data records. [2025-09-17T22:53:52.813364] [DEBUG] [MAIN ] LC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:52.814128] [INFO ] [MAIN ] LC: Generated 1794 derivative records from 48027 primary records. [2025-09-17T22:53:52.814225] [DEBUG] [LOCAL ] LC: Saving derivative data. [2025-09-17T22:53:52.829520] [DEBUG] [LOCAL ] LC: Derivative data saved (1794 records). [2025-09-17T22:53:52.829579] [INFO ] [MAIN ] LC: Successfully saved derivative data. [2025-09-17T22:53:52.831590] [INFO ] [MAIN ] Derivative Progress: 1080/2085 symbols completed. LC took 0.4s. Estimated remaining: 6m 31s. Rate: 154.1 symbols/min [2025-09-17T22:53:52.832792] [INFO ] [MAIN ] LDOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:52.832466] [INFO ] [MAIN ] LCII: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:52.833239] [INFO ] [MAIN ] LDI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:52.875794] [DEBUG] [LOCAL ] LCII: Loaded 28782 existing records from primary storage. [2025-09-17T22:53:52.876197] [INFO ] [MAIN ] LCII: Loaded 28782 primary data records. [2025-09-17T22:53:53.024458] [DEBUG] [LOCAL ] LDI: Loaded 43355 existing records from primary storage. [2025-09-17T22:53:53.036205] [DEBUG] [LOCAL ] LDOS: Loaded 46034 existing records from primary storage. [2025-09-17T22:53:53.051880] [INFO ] [MAIN ] LDOS: Loaded 46034 primary data records. [2025-09-17T22:53:53.051800] [INFO ] [MAIN ] LDI: Loaded 43355 primary data records. [2025-09-17T22:53:53.896860] [DEBUG] [MAIN ] LCII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:53.897950] [INFO ] [MAIN ] LCII: Generated 1794 derivative records from 28782 primary records. [2025-09-17T22:53:53.898200] [DEBUG] [LOCAL ] LCII: Saving derivative data. [2025-09-17T22:53:53.918743] [DEBUG] [LOCAL ] LCII: Derivative data saved (1794 records). [2025-09-17T22:53:53.919632] [INFO ] [MAIN ] LCII: Successfully saved derivative data. [2025-09-17T22:53:53.921994] [INFO ] [MAIN ] Derivative Progress: 1081/2085 symbols completed. LCII took 1.1s. Estimated remaining: 6m 32s. Rate: 153.8 symbols/min [2025-09-17T22:53:53.923371] [INFO ] [MAIN ] LDP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:53.942183] [DEBUG] [MAIN ] LDOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:53.943460] [INFO ] [MAIN ] LDOS: Generated 1794 derivative records from 46034 primary records. [2025-09-17T22:53:53.943764] [DEBUG] [LOCAL ] LDOS: Saving derivative data. [2025-09-17T22:53:53.972200] [DEBUG] [MAIN ] LDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:53.973767] [DEBUG] [LOCAL ] LDOS: Derivative data saved (1794 records). [2025-09-17T22:53:53.977231] [INFO ] [MAIN ] LDOS: Successfully saved derivative data. [2025-09-17T22:53:53.980723] [INFO ] [MAIN ] Derivative Progress: 1082/2085 symbols completed. LDOS took 1.1s. Estimated remaining: 6m 31s. Rate: 153.9 symbols/min [2025-09-17T22:53:53.977985] [INFO ] [MAIN ] LDI: Generated 1794 derivative records from 43355 primary records. [2025-09-17T22:53:53.981129] [DEBUG] [LOCAL ] LDI: Saving derivative data. [2025-09-17T22:53:53.982067] [INFO ] [MAIN ] LEA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:53.995159] [DEBUG] [LOCAL ] LDP: Loaded 13223 existing records from primary storage. [2025-09-17T22:53:53.999944] [INFO ] [MAIN ] LDP: Loaded 13223 primary data records. [2025-09-17T22:53:54.081107] [DEBUG] [LOCAL ] LDI: Derivative data saved (1794 records). [2025-09-17T22:53:54.106950] [INFO ] [MAIN ] LDI: Successfully saved derivative data. [2025-09-17T22:53:54.113274] [INFO ] [MAIN ] Derivative Progress: 1083/2085 symbols completed. LDI took 1.3s. Estimated remaining: 6m 30s. Rate: 154.0 symbols/min [2025-09-17T22:53:54.119447] [INFO ] [MAIN ] LEG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:54.336926] [DEBUG] [LOCAL ] LEA: Loaded 41916 existing records from primary storage. [2025-09-17T22:53:54.337101] [INFO ] [MAIN ] LEA: Loaded 41916 primary data records. [2025-09-17T22:53:54.680993] [DEBUG] [LOCAL ] LEG: Loaded 50409 existing records from primary storage. [2025-09-17T22:53:54.681527] [INFO ] [MAIN ] LEG: Loaded 50409 primary data records. [2025-09-17T22:53:54.867210] [DEBUG] [MAIN ] LDP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:54.889876] [INFO ] [MAIN ] LDP: Generated 1794 derivative records from 13223 primary records. [2025-09-17T22:53:54.890340] [DEBUG] [LOCAL ] LDP: Saving derivative data. [2025-09-17T22:53:55.045397] [DEBUG] [LOCAL ] LDP: Derivative data saved (1794 records). [2025-09-17T22:53:55.046315] [INFO ] [MAIN ] LDP: Successfully saved derivative data. [2025-09-17T22:53:55.046223] [DEBUG] [MAIN ] LEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:55.047041] [INFO ] [MAIN ] LEA: Generated 1794 derivative records from 41916 primary records. [2025-09-17T22:53:55.047200] [DEBUG] [LOCAL ] LEA: Saving derivative data. [2025-09-17T22:53:55.049411] [INFO ] [MAIN ] Derivative Progress: 1084/2085 symbols completed. LDP took 1.1s. Estimated remaining: 6m 30s. Rate: 153.8 symbols/min [2025-09-17T22:53:55.051006] [INFO ] [MAIN ] LEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:55.067501] [DEBUG] [LOCAL ] LEA: Derivative data saved (1794 records). [2025-09-17T22:53:55.067849] [INFO ] [MAIN ] LEA: Successfully saved derivative data. [2025-09-17T22:53:55.070324] [INFO ] [MAIN ] Derivative Progress: 1085/2085 symbols completed. LEA took 1.1s. Estimated remaining: 6m 30s. Rate: 154.0 symbols/min [2025-09-17T22:53:55.070820] [INFO ] [MAIN ] LEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:55.088594] [DEBUG] [MAIN ] LEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:55.089435] [INFO ] [MAIN ] LEG: Generated 1794 derivative records from 50409 primary records. [2025-09-17T22:53:55.094035] [DEBUG] [LOCAL ] LEG: Saving derivative data. [2025-09-17T22:53:55.113183] [DEBUG] [LOCAL ] LEO: Loaded 17756 existing records from primary storage. [2025-09-17T22:53:55.113767] [INFO ] [MAIN ] LEO: Loaded 17756 primary data records. [2025-09-17T22:53:55.220280] [DEBUG] [LOCAL ] LEG: Derivative data saved (1794 records). [2025-09-17T22:53:55.237965] [INFO ] [MAIN ] LEG: Successfully saved derivative data. [2025-09-17T22:53:55.240282] [INFO ] [MAIN ] Derivative Progress: 1086/2085 symbols completed. LEG took 1.1s. Estimated remaining: 6m 29s. Rate: 154.0 symbols/min [2025-09-17T22:53:55.246286] [INFO ] [MAIN ] LEVI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:55.457566] [DEBUG] [LOCAL ] LEN: Loaded 53184 existing records from primary storage. [2025-09-17T22:53:55.457945] [INFO ] [MAIN ] LEN: Loaded 53184 primary data records. [2025-09-17T22:53:55.866437] [DEBUG] [LOCAL ] LEVI: Loaded 51482 existing records from primary storage. [2025-09-17T22:53:55.871749] [INFO ] [MAIN ] LEVI: Loaded 51482 primary data records. [2025-09-17T22:53:55.872216] [DEBUG] [MAIN ] LEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:55.873124] [INFO ] [MAIN ] LEO: Generated 1794 derivative records from 17756 primary records. [2025-09-17T22:53:55.894384] [DEBUG] [LOCAL ] LEO: Saving derivative data. [2025-09-17T22:53:55.971798] [DEBUG] [LOCAL ] LEO: Derivative data saved (1794 records). [2025-09-17T22:53:55.992378] [INFO ] [MAIN ] LEO: Successfully saved derivative data. [2025-09-17T22:53:55.998241] [INFO ] [MAIN ] Derivative Progress: 1087/2085 symbols completed. LEO took 0.9s. Estimated remaining: 6m 29s. Rate: 153.9 symbols/min [2025-09-17T22:53:56.015161] [INFO ] [MAIN ] LFT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:56.225438] [DEBUG] [MAIN ] LEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:56.227191] [INFO ] [MAIN ] LEN: Generated 1794 derivative records from 53184 primary records. [2025-09-17T22:53:56.227321] [DEBUG] [LOCAL ] LEN: Saving derivative data. [2025-09-17T22:53:56.226341] [DEBUG] [LOCAL ] LFT: Loaded 17835 existing records from primary storage. [2025-09-17T22:53:56.227876] [INFO ] [MAIN ] LFT: Loaded 17835 primary data records. [2025-09-17T22:53:56.341853] [DEBUG] [LOCAL ] LEN: Derivative data saved (1794 records). [2025-09-17T22:53:56.353626] [INFO ] [MAIN ] LEN: Successfully saved derivative data. [2025-09-17T22:53:56.361909] [INFO ] [MAIN ] Derivative Progress: 1088/2085 symbols completed. LEN took 1.3s. Estimated remaining: 6m 29s. Rate: 153.9 symbols/min [2025-09-17T22:53:56.367823] [INFO ] [MAIN ] LGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:56.572050] [DEBUG] [MAIN ] LEVI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:56.577701] [INFO ] [MAIN ] LEVI: Generated 1794 derivative records from 51482 primary records. [2025-09-17T22:53:56.578176] [DEBUG] [LOCAL ] LEVI: Saving derivative data. [2025-09-17T22:53:56.576549] [DEBUG] [LOCAL ] LGI: Loaded 10182 existing records from primary storage. [2025-09-17T22:53:56.578684] [INFO ] [MAIN ] LGI: Loaded 10182 primary data records. [2025-09-17T22:53:56.727969] [DEBUG] [LOCAL ] LEVI: Derivative data saved (1794 records). [2025-09-17T22:53:56.741312] [INFO ] [MAIN ] LEVI: Successfully saved derivative data. [2025-09-17T22:53:56.781770] [INFO ] [MAIN ] Derivative Progress: 1089/2085 symbols completed. LEVI took 1.5s. Estimated remaining: 6m 28s. Rate: 153.9 symbols/min [2025-09-17T22:53:56.901915] [INFO ] [MAIN ] LH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:56.920493] [DEBUG] [MAIN ] LFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:56.921557] [INFO ] [MAIN ] LFT: Generated 1794 derivative records from 17835 primary records. [2025-09-17T22:53:56.921825] [DEBUG] [LOCAL ] LFT: Saving derivative data. [2025-09-17T22:53:56.940114] [DEBUG] [LOCAL ] LFT: Derivative data saved (1794 records). [2025-09-17T22:53:56.940429] [INFO ] [MAIN ] LFT: Successfully saved derivative data. [2025-09-17T22:53:56.943939] [INFO ] [MAIN ] Derivative Progress: 1090/2085 symbols completed. LFT took 0.9s. Estimated remaining: 6m 28s. Rate: 154.0 symbols/min [2025-09-17T22:53:56.944862] [INFO ] [MAIN ] LHX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:56.971633] [DEBUG] [MAIN ] LGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:56.972481] [INFO ] [MAIN ] LGI: Generated 1794 derivative records from 10182 primary records. [2025-09-17T22:53:56.972679] [DEBUG] [LOCAL ] LGI: Saving derivative data. [2025-09-17T22:53:56.999886] [DEBUG] [LOCAL ] LH: Loaded 38870 existing records from primary storage. [2025-09-17T22:53:57.003760] [INFO ] [MAIN ] LH: Loaded 38870 primary data records. [2025-09-17T22:53:57.016755] [DEBUG] [LOCAL ] LGI: Derivative data saved (1794 records). [2025-09-17T22:53:57.037013] [INFO ] [MAIN ] LGI: Successfully saved derivative data. [2025-09-17T22:53:57.045331] [INFO ] [MAIN ] Derivative Progress: 1091/2085 symbols completed. LGI took 0.7s. Estimated remaining: 6m 27s. Rate: 154.1 symbols/min [2025-09-17T22:53:57.078172] [INFO ] [MAIN ] LII: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:57.320929] [DEBUG] [LOCAL ] LHX: Loaded 49075 existing records from primary storage. [2025-09-17T22:53:57.334711] [INFO ] [MAIN ] LHX: Loaded 49075 primary data records. [2025-09-17T22:53:57.488766] [DEBUG] [LOCAL ] LII: Loaded 28705 existing records from primary storage. [2025-09-17T22:53:57.536829] [INFO ] [MAIN ] LII: Loaded 28705 primary data records. [2025-09-17T22:53:58.022079] [DEBUG] [MAIN ] LH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:58.023804] [INFO ] [MAIN ] LH: Generated 1794 derivative records from 38870 primary records. [2025-09-17T22:53:58.024060] [DEBUG] [LOCAL ] LH: Saving derivative data. [2025-09-17T22:53:58.046555] [DEBUG] [LOCAL ] LH: Derivative data saved (1794 records). [2025-09-17T22:53:58.046800] [INFO ] [MAIN ] LH: Successfully saved derivative data. [2025-09-17T22:53:58.049044] [INFO ] [MAIN ] Derivative Progress: 1092/2085 symbols completed. LH took 1.1s. Estimated remaining: 6m 27s. Rate: 153.9 symbols/min [2025-09-17T22:53:58.049425] [INFO ] [MAIN ] LION: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:58.062905] [DEBUG] [MAIN ] LHX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:58.063909] [INFO ] [MAIN ] LHX: Generated 1794 derivative records from 49075 primary records. [2025-09-17T22:53:58.064090] [DEBUG] [LOCAL ] LHX: Saving derivative data. [2025-09-17T22:53:58.096450] [DEBUG] [MAIN ] LII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:58.097453] [INFO ] [MAIN ] LII: Generated 1794 derivative records from 28705 primary records. [2025-09-17T22:53:58.097871] [DEBUG] [LOCAL ] LII: Saving derivative data. [2025-09-17T22:53:58.099508] [DEBUG] [LOCAL ] LHX: Derivative data saved (1794 records). [2025-09-17T22:53:58.099778] [INFO ] [MAIN ] LHX: Successfully saved derivative data. [2025-09-17T22:53:58.109778] [INFO ] [MAIN ] Derivative Progress: 1093/2085 symbols completed. LHX took 1.2s. Estimated remaining: 6m 27s. Rate: 154.0 symbols/min [2025-09-17T22:53:58.127458] [DEBUG] [LOCAL ] LII: Derivative data saved (1794 records). [2025-09-17T22:53:58.127577] [INFO ] [MAIN ] LII: Successfully saved derivative data. [2025-09-17T22:53:58.130416] [INFO ] [MAIN ] Derivative Progress: 1094/2085 symbols completed. LII took 1.1s. Estimated remaining: 6m 26s. Rate: 154.1 symbols/min [2025-09-17T22:53:58.143371] [DEBUG] [LOCAL ] LION: Loaded 42314 existing records from primary storage. [2025-09-17T22:53:58.143472] [INFO ] [MAIN ] LION: Loaded 42314 primary data records. [2025-09-17T22:53:58.458619] [DEBUG] [MAIN ] LION: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:58.459254] [INFO ] [MAIN ] LION: Generated 1794 derivative records from 42314 primary records. [2025-09-17T22:53:58.459317] [DEBUG] [LOCAL ] LION: Saving derivative data. [2025-09-17T22:53:58.474291] [DEBUG] [LOCAL ] LION: Derivative data saved (1794 records). [2025-09-17T22:53:58.474360] [INFO ] [MAIN ] LION: Successfully saved derivative data. [2025-09-17T22:53:58.476571] [INFO ] [MAIN ] Derivative Progress: 1095/2085 symbols completed. LION took 0.4s. Estimated remaining: 6m 25s. Rate: 154.1 symbols/min [2025-09-17T22:53:58.477089] [INFO ] [MAIN ] LMND: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:58.477274] [INFO ] [MAIN ] LITB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:58.477384] [INFO ] [MAIN ] LLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:58.485613] [DEBUG] [LOCAL ] LITB: Loaded 4260 existing records from primary storage. [2025-09-17T22:53:58.485768] [INFO ] [MAIN ] LITB: Loaded 4260 primary data records. [2025-09-17T22:53:58.861295] [DEBUG] [LOCAL ] LMND: Loaded 51874 existing records from primary storage. [2025-09-17T22:53:58.862477] [INFO ] [MAIN ] LMND: Loaded 51874 primary data records. [2025-09-17T22:53:58.897027] [DEBUG] [LOCAL ] LLY: Loaded 53302 existing records from primary storage. [2025-09-17T22:53:58.922196] [INFO ] [MAIN ] LLY: Loaded 53302 primary data records. [2025-09-17T22:53:59.307017] [DEBUG] [MAIN ] LITB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:59.549305] [INFO ] [MAIN ] LITB: Generated 1794 derivative records from 4260 primary records. [2025-09-17T22:53:59.558446] [DEBUG] [LOCAL ] LITB: Saving derivative data. [2025-09-17T22:53:59.579227] [DEBUG] [LOCAL ] LITB: Derivative data saved (1794 records). [2025-09-17T22:53:59.579492] [INFO ] [MAIN ] LITB: Successfully saved derivative data. [2025-09-17T22:53:59.582071] [INFO ] [MAIN ] Derivative Progress: 1096/2085 symbols completed. LITB took 1.1s. Estimated remaining: 6m 26s. Rate: 153.9 symbols/min [2025-09-17T22:53:59.584604] [INFO ] [MAIN ] LMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:59.622123] [DEBUG] [MAIN ] LLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:59.623461] [INFO ] [MAIN ] LLY: Generated 1794 derivative records from 53302 primary records. [2025-09-17T22:53:59.623894] [DEBUG] [MAIN ] LMND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:53:59.624050] [DEBUG] [LOCAL ] LLY: Saving derivative data. [2025-09-17T22:53:59.625309] [INFO ] [MAIN ] LMND: Generated 1794 derivative records from 51874 primary records. [2025-09-17T22:53:59.625486] [DEBUG] [LOCAL ] LMND: Saving derivative data. [2025-09-17T22:53:59.657272] [DEBUG] [LOCAL ] LLY: Derivative data saved (1794 records). [2025-09-17T22:53:59.658671] [INFO ] [MAIN ] LLY: Successfully saved derivative data. [2025-09-17T22:53:59.661320] [INFO ] [MAIN ] Derivative Progress: 1097/2085 symbols completed. LLY took 1.2s. Estimated remaining: 6m 25s. Rate: 154.0 symbols/min [2025-09-17T22:53:59.662445] [INFO ] [MAIN ] LNC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:59.664117] [DEBUG] [LOCAL ] LMND: Derivative data saved (1794 records). [2025-09-17T22:53:59.664350] [INFO ] [MAIN ] LMND: Successfully saved derivative data. [2025-09-17T22:53:59.667483] [INFO ] [MAIN ] Derivative Progress: 1098/2085 symbols completed. LMND took 1.2s. Estimated remaining: 6m 24s. Rate: 154.1 symbols/min [2025-09-17T22:53:59.668111] [INFO ] [MAIN ] LND: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:53:59.687187] [DEBUG] [LOCAL ] LND: Loaded 5207 existing records from primary storage. [2025-09-17T22:53:59.687433] [INFO ] [MAIN ] LND: Loaded 5207 primary data records. [2025-09-17T22:53:59.816180] [DEBUG] [LOCAL ] LMT: Loaded 50008 existing records from primary storage. [2025-09-17T22:53:59.832867] [INFO ] [MAIN ] LMT: Loaded 50008 primary data records. [2025-09-17T22:54:00.174615] [DEBUG] [LOCAL ] LNC: Loaded 51636 existing records from primary storage. [2025-09-17T22:54:00.190865] [INFO ] [MAIN ] LNC: Loaded 51636 primary data records. [2025-09-17T22:54:00.710491] [DEBUG] [MAIN ] LND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:00.712889] [INFO ] [MAIN ] LND: Generated 1794 derivative records from 5207 primary records. [2025-09-17T22:54:00.714625] [DEBUG] [LOCAL ] LND: Saving derivative data. [2025-09-17T22:54:00.735982] [DEBUG] [MAIN ] LMT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:54:00.739515] [INFO ] [MAIN ] LMT: Generated 1793 derivative records from 50008 primary records. [2025-09-17T22:54:00.740797] [DEBUG] [LOCAL ] LMT: Saving derivative data. [2025-09-17T22:54:00.744290] [DEBUG] [LOCAL ] LND: Derivative data saved (1794 records). [2025-09-17T22:54:00.744546] [INFO ] [MAIN ] LND: Successfully saved derivative data. [2025-09-17T22:54:00.757492] [INFO ] [MAIN ] Derivative Progress: 1099/2085 symbols completed. LND took 1.1s. Estimated remaining: 6m 24s. Rate: 153.9 symbols/min [2025-09-17T22:54:00.758235] [INFO ] [MAIN ] LNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:00.766574] [DEBUG] [LOCAL ] LMT: Derivative data saved (1793 records). [2025-09-17T22:54:00.766830] [INFO ] [MAIN ] LMT: Successfully saved derivative data. [2025-09-17T22:54:00.781039] [INFO ] [MAIN ] Derivative Progress: 1100/2085 symbols completed. LMT took 1.2s. Estimated remaining: 6m 24s. Rate: 154.0 symbols/min [2025-09-17T22:54:00.781804] [INFO ] [MAIN ] LNN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:00.781507] [DEBUG] [MAIN ] LNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:00.782558] [INFO ] [MAIN ] LNC: Generated 1794 derivative records from 51636 primary records. [2025-09-17T22:54:00.782936] [DEBUG] [LOCAL ] LNC: Saving derivative data. [2025-09-17T22:54:00.802182] [DEBUG] [LOCAL ] LNC: Derivative data saved (1794 records). [2025-09-17T22:54:00.802333] [INFO ] [MAIN ] LNC: Successfully saved derivative data. [2025-09-17T22:54:00.804796] [INFO ] [MAIN ] Derivative Progress: 1101/2085 symbols completed. LNC took 1.1s. Estimated remaining: 6m 23s. Rate: 154.1 symbols/min [2025-09-17T22:54:00.805208] [INFO ] [MAIN ] LOAR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:00.811680] [DEBUG] [LOCAL ] LNN: Loaded 11224 existing records from primary storage. [2025-09-17T22:54:00.824597] [INFO ] [MAIN ] LNN: Loaded 11224 primary data records. [2025-09-17T22:54:00.970548] [DEBUG] [LOCAL ] LNG: Loaded 51576 existing records from primary storage. [2025-09-17T22:54:00.991560] [INFO ] [MAIN ] LNG: Loaded 51576 primary data records. [2025-09-17T22:54:01.121811] [DEBUG] [LOCAL ] LOAR: Loaded 41556 existing records from primary storage. [2025-09-17T22:54:01.251055] [INFO ] [MAIN ] LOAR: Loaded 41556 primary data records. [2025-09-17T22:54:01.861945] [DEBUG] [MAIN ] LNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:01.863406] [INFO ] [MAIN ] LNN: Generated 1794 derivative records from 11224 primary records. [2025-09-17T22:54:01.863765] [DEBUG] [LOCAL ] LNN: Saving derivative data. [2025-09-17T22:54:01.881152] [DEBUG] [LOCAL ] LNN: Derivative data saved (1794 records). [2025-09-17T22:54:01.884315] [INFO ] [MAIN ] LNN: Successfully saved derivative data. [2025-09-17T22:54:01.886627] [INFO ] [MAIN ] Derivative Progress: 1102/2085 symbols completed. LNN took 1.1s. Estimated remaining: 6m 23s. Rate: 153.9 symbols/min [2025-09-17T22:54:01.887239] [INFO ] [MAIN ] LOB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:01.901023] [DEBUG] [MAIN ] LNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:01.902265] [INFO ] [MAIN ] LNG: Generated 1794 derivative records from 51576 primary records. [2025-09-17T22:54:01.902493] [DEBUG] [LOCAL ] LNG: Saving derivative data. [2025-09-17T22:54:01.925717] [DEBUG] [LOCAL ] LNG: Derivative data saved (1794 records). [2025-09-17T22:54:01.927725] [INFO ] [MAIN ] LNG: Successfully saved derivative data. [2025-09-17T22:54:01.930312] [INFO ] [MAIN ] Derivative Progress: 1103/2085 symbols completed. LNG took 1.2s. Estimated remaining: 6m 23s. Rate: 154.0 symbols/min [2025-09-17T22:54:01.931020] [INFO ] [MAIN ] LOCL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:01.955899] [DEBUG] [MAIN ] LOAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:01.957362] [INFO ] [MAIN ] LOAR: Generated 1794 derivative records from 41556 primary records. [2025-09-17T22:54:01.957786] [DEBUG] [LOCAL ] LOAR: Saving derivative data. [2025-09-17T22:54:01.984279] [DEBUG] [LOCAL ] LOCL: Loaded 3441 existing records from primary storage. [2025-09-17T22:54:01.994938] [INFO ] [MAIN ] LOCL: Loaded 3441 primary data records. [2025-09-17T22:54:01.997932] [DEBUG] [LOCAL ] LOB: Loaded 27410 existing records from primary storage. [2025-09-17T22:54:01.997212] [DEBUG] [LOCAL ] LOAR: Derivative data saved (1794 records). [2025-09-17T22:54:01.998227] [INFO ] [MAIN ] LOAR: Successfully saved derivative data. [2025-09-17T22:54:02.001973] [INFO ] [MAIN ] Derivative Progress: 1104/2085 symbols completed. LOAR took 1.2s. Estimated remaining: 6m 22s. Rate: 154.1 symbols/min [2025-09-17T22:54:02.007311] [INFO ] [MAIN ] LOB: Loaded 27410 primary data records. [2025-09-17T22:54:02.074719] [INFO ] [MAIN ] LOMA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:02.661352] [DEBUG] [LOCAL ] LOMA: Loaded 31289 existing records from primary storage. [2025-09-17T22:54:02.661878] [INFO ] [MAIN ] LOMA: Loaded 31289 primary data records. [2025-09-17T22:54:03.006150] [DEBUG] [MAIN ] LOCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:03.007320] [INFO ] [MAIN ] LOCL: Generated 1794 derivative records from 3441 primary records. [2025-09-17T22:54:03.007576] [DEBUG] [LOCAL ] LOCL: Saving derivative data. [2025-09-17T22:54:03.026635] [DEBUG] [LOCAL ] LOCL: Derivative data saved (1794 records). [2025-09-17T22:54:03.029670] [INFO ] [MAIN ] LOCL: Successfully saved derivative data. [2025-09-17T22:54:03.032699] [INFO ] [MAIN ] Derivative Progress: 1105/2085 symbols completed. LOCL took 1.1s. Estimated remaining: 6m 22s. Rate: 153.9 symbols/min [2025-09-17T22:54:03.033867] [INFO ] [MAIN ] LOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:03.047974] [DEBUG] [MAIN ] LOB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:03.049173] [INFO ] [MAIN ] LOB: Generated 1794 derivative records from 27410 primary records. [2025-09-17T22:54:03.049530] [DEBUG] [LOCAL ] LOB: Saving derivative data. [2025-09-17T22:54:03.066512] [DEBUG] [LOCAL ] LOB: Derivative data saved (1794 records). [2025-09-17T22:54:03.066761] [INFO ] [MAIN ] LOB: Successfully saved derivative data. [2025-09-17T22:54:03.069362] [INFO ] [MAIN ] Derivative Progress: 1106/2085 symbols completed. LOB took 1.2s. Estimated remaining: 6m 21s. Rate: 154.0 symbols/min [2025-09-17T22:54:03.069941] [INFO ] [MAIN ] LPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:03.086258] [DEBUG] [MAIN ] LOMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:03.087085] [INFO ] [MAIN ] LOMA: Generated 1794 derivative records from 31289 primary records. [2025-09-17T22:54:03.087236] [DEBUG] [LOCAL ] LOMA: Saving derivative data. [2025-09-17T22:54:03.118824] [DEBUG] [LOCAL ] LOMA: Derivative data saved (1794 records). [2025-09-17T22:54:03.118966] [INFO ] [MAIN ] LOMA: Successfully saved derivative data. [2025-09-17T22:54:03.121484] [INFO ] [MAIN ] Derivative Progress: 1107/2085 symbols completed. LOMA took 1.1s. Estimated remaining: 6m 21s. Rate: 154.1 symbols/min [2025-09-17T22:54:03.121805] [INFO ] [MAIN ] LPL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:03.150034] [DEBUG] [LOCAL ] LOW: Loaded 52965 existing records from primary storage. [2025-09-17T22:54:03.150445] [INFO ] [MAIN ] LOW: Loaded 52965 primary data records. [2025-09-17T22:54:03.242404] [DEBUG] [LOCAL ] LPG: Loaded 40417 existing records from primary storage. [2025-09-17T22:54:03.254321] [INFO ] [MAIN ] LPG: Loaded 40417 primary data records. [2025-09-17T22:54:03.486707] [DEBUG] [LOCAL ] LPL: Loaded 25017 existing records from primary storage. [2025-09-17T22:54:03.495704] [INFO ] [MAIN ] LPL: Loaded 25017 primary data records. [2025-09-17T22:54:04.218855] [DEBUG] [MAIN ] LOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:04.219967] [INFO ] [MAIN ] LOW: Generated 1794 derivative records from 52965 primary records. [2025-09-17T22:54:04.222297] [DEBUG] [LOCAL ] LOW: Saving derivative data. [2025-09-17T22:54:04.255090] [DEBUG] [LOCAL ] LOW: Derivative data saved (1794 records). [2025-09-17T22:54:04.255400] [INFO ] [MAIN ] LOW: Successfully saved derivative data. [2025-09-17T22:54:04.257498] [INFO ] [MAIN ] Derivative Progress: 1108/2085 symbols completed. LOW took 1.2s. Estimated remaining: 6m 21s. Rate: 153.9 symbols/min [2025-09-17T22:54:04.258367] [DEBUG] [MAIN ] LPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:04.259577] [INFO ] [MAIN ] LPG: Generated 1794 derivative records from 40417 primary records. [2025-09-17T22:54:04.259725] [DEBUG] [LOCAL ] LPG: Saving derivative data. [2025-09-17T22:54:04.289810] [DEBUG] [MAIN ] LPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:04.291279] [INFO ] [MAIN ] LPL: Generated 1794 derivative records from 25017 primary records. [2025-09-17T22:54:04.292506] [DEBUG] [LOCAL ] LPL: Saving derivative data. [2025-09-17T22:54:04.293008] [DEBUG] [LOCAL ] LPG: Derivative data saved (1794 records). [2025-09-17T22:54:04.293270] [INFO ] [MAIN ] LPG: Successfully saved derivative data. [2025-09-17T22:54:04.296509] [INFO ] [MAIN ] Derivative Progress: 1109/2085 symbols completed. LPG took 1.2s. Estimated remaining: 6m 20s. Rate: 154.0 symbols/min [2025-09-17T22:54:04.311843] [DEBUG] [LOCAL ] LPL: Derivative data saved (1794 records). [2025-09-17T22:54:04.311911] [INFO ] [MAIN ] LPL: Successfully saved derivative data. [2025-09-17T22:54:04.314163] [INFO ] [MAIN ] Derivative Progress: 1110/2085 symbols completed. LPL took 1.2s. Estimated remaining: 6m 20s. Rate: 154.1 symbols/min [2025-09-17T22:54:04.314787] [INFO ] [MAIN ] LSPD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:04.314675] [INFO ] [MAIN ] LPX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:04.315538] [INFO ] [MAIN ] LRN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:04.382917] [DEBUG] [LOCAL ] LSPD: Loaded 43687 existing records from primary storage. [2025-09-17T22:54:04.384547] [INFO ] [MAIN ] LSPD: Loaded 43687 primary data records. [2025-09-17T22:54:04.406474] [DEBUG] [LOCAL ] LPX: Loaded 39725 existing records from primary storage. [2025-09-17T22:54:04.440430] [INFO ] [MAIN ] LPX: Loaded 39725 primary data records. [2025-09-17T22:54:04.474741] [DEBUG] [LOCAL ] LRN: Loaded 40094 existing records from primary storage. [2025-09-17T22:54:04.535304] [INFO ] [MAIN ] LRN: Loaded 40094 primary data records. [2025-09-17T22:54:05.342135] [DEBUG] [MAIN ] LSPD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:05.355694] [DEBUG] [MAIN ] LPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:05.356884] [INFO ] [MAIN ] LSPD: Generated 1794 derivative records from 43687 primary records. [2025-09-17T22:54:05.357516] [INFO ] [MAIN ] LPX: Generated 1794 derivative records from 39725 primary records. [2025-09-17T22:54:05.358601] [DEBUG] [LOCAL ] LPX: Saving derivative data. [2025-09-17T22:54:05.358694] [DEBUG] [LOCAL ] LSPD: Saving derivative data. [2025-09-17T22:54:05.397978] [DEBUG] [LOCAL ] LPX: Derivative data saved (1794 records). [2025-09-17T22:54:05.392881] [DEBUG] [MAIN ] LRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:05.401824] [INFO ] [MAIN ] LPX: Successfully saved derivative data. [2025-09-17T22:54:05.405765] [INFO ] [MAIN ] Derivative Progress: 1111/2085 symbols completed. LPX took 1.1s. Estimated remaining: 6m 20s. Rate: 153.9 symbols/min [2025-09-17T22:54:05.402953] [INFO ] [MAIN ] LRN: Generated 1794 derivative records from 40094 primary records. [2025-09-17T22:54:05.409147] [DEBUG] [LOCAL ] LSPD: Derivative data saved (1794 records). [2025-09-17T22:54:05.409532] [DEBUG] [LOCAL ] LRN: Saving derivative data. [2025-09-17T22:54:05.409442] [INFO ] [MAIN ] LTC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:05.409676] [INFO ] [MAIN ] LSPD: Successfully saved derivative data. [2025-09-17T22:54:05.412320] [INFO ] [MAIN ] Derivative Progress: 1112/2085 symbols completed. LSPD took 1.1s. Estimated remaining: 6m 19s. Rate: 154.0 symbols/min [2025-09-17T22:54:05.413153] [INFO ] [MAIN ] LTH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:05.432463] [DEBUG] [LOCAL ] LRN: Derivative data saved (1794 records). [2025-09-17T22:54:05.432693] [INFO ] [MAIN ] LRN: Successfully saved derivative data. [2025-09-17T22:54:05.434895] [INFO ] [MAIN ] Derivative Progress: 1113/2085 symbols completed. LRN took 1.1s. Estimated remaining: 6m 18s. Rate: 154.2 symbols/min [2025-09-17T22:54:05.435333] [INFO ] [MAIN ] LTM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:05.462178] [DEBUG] [LOCAL ] LTC: Loaded 29977 existing records from primary storage. [2025-09-17T22:54:05.462323] [INFO ] [MAIN ] LTC: Loaded 29977 primary data records. [2025-09-17T22:54:05.652550] [DEBUG] [LOCAL ] LTH: Loaded 51937 existing records from primary storage. [2025-09-17T22:54:05.706349] [INFO ] [MAIN ] LTH: Loaded 51937 primary data records. [2025-09-17T22:54:05.678481] [DEBUG] [LOCAL ] LTM: Loaded 35608 existing records from primary storage. [2025-09-17T22:54:05.706680] [INFO ] [MAIN ] LTM: Loaded 35608 primary data records. [2025-09-17T22:54:06.572744] [DEBUG] [MAIN ] LTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:06.575783] [INFO ] [MAIN ] LTC: Generated 1794 derivative records from 29977 primary records. [2025-09-17T22:54:06.576369] [DEBUG] [LOCAL ] LTC: Saving derivative data. [2025-09-17T22:54:06.603091] [DEBUG] [LOCAL ] LTC: Derivative data saved (1794 records). [2025-09-17T22:54:06.604558] [INFO ] [MAIN ] LTC: Successfully saved derivative data. [2025-09-17T22:54:06.606777] [INFO ] [MAIN ] Derivative Progress: 1114/2085 symbols completed. LTC took 1.2s. Estimated remaining: 6m 19s. Rate: 153.9 symbols/min [2025-09-17T22:54:06.609117] [INFO ] [MAIN ] LU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:06.660088] [DEBUG] [MAIN ] LTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:06.662391] [DEBUG] [MAIN ] LTM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:06.663591] [INFO ] [MAIN ] LTH: Generated 1794 derivative records from 51937 primary records. [2025-09-17T22:54:06.664600] [DEBUG] [LOCAL ] LTH: Saving derivative data. [2025-09-17T22:54:06.665881] [INFO ] [MAIN ] LTM: Generated 1794 derivative records from 35608 primary records. [2025-09-17T22:54:06.666128] [DEBUG] [LOCAL ] LTM: Saving derivative data. [2025-09-17T22:54:06.715699] [DEBUG] [LOCAL ] LTH: Derivative data saved (1794 records). [2025-09-17T22:54:06.720499] [DEBUG] [LOCAL ] LTM: Derivative data saved (1794 records). [2025-09-17T22:54:06.721110] [INFO ] [MAIN ] LTM: Successfully saved derivative data. [2025-09-17T22:54:06.724739] [INFO ] [MAIN ] Derivative Progress: 1115/2085 symbols completed. LTM took 1.3s. Estimated remaining: 6m 18s. Rate: 154.0 symbols/min [2025-09-17T22:54:06.721252] [INFO ] [MAIN ] LTH: Successfully saved derivative data. [2025-09-17T22:54:06.743778] [INFO ] [MAIN ] LUMN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:06.744365] [INFO ] [MAIN ] Derivative Progress: 1116/2085 symbols completed. LTH took 1.3s. Estimated remaining: 6m 17s. Rate: 154.1 symbols/min [2025-09-17T22:54:06.745360] [INFO ] [MAIN ] LUV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:06.784699] [DEBUG] [LOCAL ] LU: Loaded 48955 existing records from primary storage. [2025-09-17T22:54:06.784924] [INFO ] [MAIN ] LU: Loaded 48955 primary data records. [2025-09-17T22:54:07.040458] [DEBUG] [LOCAL ] LUMN: Loaded 53634 existing records from primary storage. [2025-09-17T22:54:07.069421] [INFO ] [MAIN ] LUMN: Loaded 53634 primary data records. [2025-09-17T22:54:07.209821] [DEBUG] [LOCAL ] LUV: Loaded 53689 existing records from primary storage. [2025-09-17T22:54:07.302528] [INFO ] [MAIN ] LUV: Loaded 53689 primary data records. [2025-09-17T22:54:08.066669] [DEBUG] [MAIN ] LU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:08.070879] [INFO ] [MAIN ] LU: Generated 1794 derivative records from 48955 primary records. [2025-09-17T22:54:08.071344] [DEBUG] [LOCAL ] LU: Saving derivative data. [2025-09-17T22:54:08.098231] [DEBUG] [MAIN ] LUMN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:08.102423] [DEBUG] [LOCAL ] LU: Derivative data saved (1794 records). [2025-09-17T22:54:08.103444] [INFO ] [MAIN ] LUMN: Generated 1794 derivative records from 53634 primary records. [2025-09-17T22:54:08.103568] [DEBUG] [LOCAL ] LUMN: Saving derivative data. [2025-09-17T22:54:08.104219] [INFO ] [MAIN ] LU: Successfully saved derivative data. [2025-09-17T22:54:08.107032] [INFO ] [MAIN ] Derivative Progress: 1117/2085 symbols completed. LU took 1.5s. Estimated remaining: 6m 18s. Rate: 153.8 symbols/min [2025-09-17T22:54:08.114546] [INFO ] [MAIN ] LVS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:08.123713] [DEBUG] [LOCAL ] LUMN: Derivative data saved (1794 records). [2025-09-17T22:54:08.123937] [INFO ] [MAIN ] LUMN: Successfully saved derivative data. [2025-09-17T22:54:08.126698] [INFO ] [MAIN ] Derivative Progress: 1118/2085 symbols completed. LUMN took 1.4s. Estimated remaining: 6m 17s. Rate: 153.9 symbols/min [2025-09-17T22:54:08.127047] [INFO ] [MAIN ] LVWR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:08.145607] [DEBUG] [MAIN ] LUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:08.146431] [INFO ] [MAIN ] LUV: Generated 1794 derivative records from 53689 primary records. [2025-09-17T22:54:08.146499] [DEBUG] [LOCAL ] LUV: Saving derivative data. [2025-09-17T22:54:08.175602] [DEBUG] [LOCAL ] LVWR: Loaded 17030 existing records from primary storage. [2025-09-17T22:54:08.177966] [INFO ] [MAIN ] LVWR: Loaded 17030 primary data records. [2025-09-17T22:54:08.177873] [DEBUG] [LOCAL ] LUV: Derivative data saved (1794 records). [2025-09-17T22:54:08.178112] [INFO ] [MAIN ] LUV: Successfully saved derivative data. [2025-09-17T22:54:08.212170] [INFO ] [MAIN ] Derivative Progress: 1119/2085 symbols completed. LUV took 1.5s. Estimated remaining: 6m 16s. Rate: 154.0 symbols/min [2025-09-17T22:54:08.244349] [INFO ] [MAIN ] LW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:08.398271] [DEBUG] [LOCAL ] LVS: Loaded 53567 existing records from primary storage. [2025-09-17T22:54:08.533899] [INFO ] [MAIN ] LVS: Loaded 53567 primary data records. [2025-09-17T22:54:08.919353] [DEBUG] [LOCAL ] LW: Loaded 51313 existing records from primary storage. [2025-09-17T22:54:08.920752] [INFO ] [MAIN ] LW: Loaded 51313 primary data records. [2025-09-17T22:54:09.141943] [DEBUG] [MAIN ] LVWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:09.261037] [INFO ] [MAIN ] LVWR: Generated 1794 derivative records from 17030 primary records. [2025-09-17T22:54:09.275240] [DEBUG] [LOCAL ] LVWR: Saving derivative data. [2025-09-17T22:54:09.297252] [DEBUG] [LOCAL ] LVWR: Derivative data saved (1794 records). [2025-09-17T22:54:09.299978] [INFO ] [MAIN ] LVWR: Successfully saved derivative data. [2025-09-17T22:54:09.303109] [INFO ] [MAIN ] Derivative Progress: 1120/2085 symbols completed. LVWR took 1.2s. Estimated remaining: 6m 17s. Rate: 153.7 symbols/min [2025-09-17T22:54:09.303549] [INFO ] [MAIN ] LXFR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:09.319537] [DEBUG] [MAIN ] LVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:09.320524] [INFO ] [MAIN ] LVS: Generated 1794 derivative records from 53567 primary records. [2025-09-17T22:54:09.320947] [DEBUG] [LOCAL ] LVS: Saving derivative data. [2025-09-17T22:54:09.338905] [DEBUG] [LOCAL ] LVS: Derivative data saved (1794 records). [2025-09-17T22:54:09.343591] [INFO ] [MAIN ] LVS: Successfully saved derivative data. [2025-09-17T22:54:09.346588] [INFO ] [MAIN ] Derivative Progress: 1121/2085 symbols completed. LVS took 1.2s. Estimated remaining: 6m 16s. Rate: 153.9 symbols/min [2025-09-17T22:54:09.347294] [INFO ] [MAIN ] LXU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:09.357270] [DEBUG] [LOCAL ] LXFR: Loaded 17168 existing records from primary storage. [2025-09-17T22:54:09.365061] [INFO ] [MAIN ] LXFR: Loaded 17168 primary data records. [2025-09-17T22:54:09.392598] [DEBUG] [MAIN ] LW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:09.433803] [INFO ] [MAIN ] LW: Generated 1794 derivative records from 51313 primary records. [2025-09-17T22:54:09.467619] [DEBUG] [LOCAL ] LW: Saving derivative data. [2025-09-17T22:54:09.596411] [DEBUG] [LOCAL ] LW: Derivative data saved (1794 records). [2025-09-17T22:54:09.602952] [INFO ] [MAIN ] LW: Successfully saved derivative data. [2025-09-17T22:54:09.702782] [DEBUG] [LOCAL ] LXU: Loaded 32285 existing records from primary storage. [2025-09-17T22:54:09.728550] [INFO ] [MAIN ] Derivative Progress: 1122/2085 symbols completed. LW took 1.5s. Estimated remaining: 6m 16s. Rate: 153.9 symbols/min [2025-09-17T22:54:09.730150] [INFO ] [MAIN ] LYB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:09.730269] [INFO ] [MAIN ] LXU: Loaded 32285 primary data records. [2025-09-17T22:54:10.079291] [DEBUG] [MAIN ] LXFR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:10.094412] [INFO ] [MAIN ] LXFR: Generated 1794 derivative records from 17168 primary records. [2025-09-17T22:54:10.095541] [DEBUG] [LOCAL ] LXFR: Saving derivative data. [2025-09-17T22:54:10.097470] [DEBUG] [LOCAL ] LYB: Loaded 53600 existing records from primary storage. [2025-09-17T22:54:10.107101] [INFO ] [MAIN ] LYB: Loaded 53600 primary data records. [2025-09-17T22:54:10.146589] [DEBUG] [LOCAL ] LXFR: Derivative data saved (1794 records). [2025-09-17T22:54:10.146965] [INFO ] [MAIN ] LXFR: Successfully saved derivative data. [2025-09-17T22:54:10.161284] [INFO ] [MAIN ] Derivative Progress: 1123/2085 symbols completed. LXFR took 0.9s. Estimated remaining: 6m 15s. Rate: 153.9 symbols/min [2025-09-17T22:54:10.287995] [DEBUG] [MAIN ] LXU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:10.298250] [INFO ] [MAIN ] LXU: Generated 1794 derivative records from 32285 primary records. [2025-09-17T22:54:10.314162] [DEBUG] [LOCAL ] LXU: Saving derivative data. [2025-09-17T22:54:10.499473] [DEBUG] [LOCAL ] LXU: Derivative data saved (1794 records). [2025-09-17T22:54:10.499776] [INFO ] [MAIN ] LXU: Successfully saved derivative data. [2025-09-17T22:54:10.502440] [INFO ] [MAIN ] Derivative Progress: 1124/2085 symbols completed. LXU took 1.2s. Estimated remaining: 6m 15s. Rate: 153.9 symbols/min [2025-09-17T22:54:10.523869] [DEBUG] [MAIN ] LYB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:10.524534] [INFO ] [MAIN ] LYB: Generated 1794 derivative records from 53600 primary records. [2025-09-17T22:54:10.524598] [DEBUG] [LOCAL ] LYB: Saving derivative data. [2025-09-17T22:54:10.539852] [DEBUG] [LOCAL ] LYB: Derivative data saved (1794 records). [2025-09-17T22:54:10.539941] [INFO ] [MAIN ] LYB: Successfully saved derivative data. [2025-09-17T22:54:10.542196] [INFO ] [MAIN ] Derivative Progress: 1125/2085 symbols completed. LYB took 0.8s. Estimated remaining: 6m 14s. Rate: 154.0 symbols/min [2025-09-17T22:54:10.542967] [INFO ] [MAIN ] LZB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:10.542858] [INFO ] [MAIN ] LYG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:10.543110] [INFO ] [MAIN ] LYV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:10.609799] [DEBUG] [LOCAL ] LZB: Loaded 35504 existing records from primary storage. [2025-09-17T22:54:10.610110] [INFO ] [MAIN ] LZB: Loaded 35504 primary data records. [2025-09-17T22:54:10.683452] [DEBUG] [LOCAL ] LYG: Loaded 52937 existing records from primary storage. [2025-09-17T22:54:10.692604] [INFO ] [MAIN ] LYG: Loaded 52937 primary data records. [2025-09-17T22:54:10.823322] [DEBUG] [LOCAL ] LYV: Loaded 51304 existing records from primary storage. [2025-09-17T22:54:10.842755] [INFO ] [MAIN ] LYV: Loaded 51304 primary data records. [2025-09-17T22:54:11.609281] [DEBUG] [MAIN ] LZB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:11.610498] [INFO ] [MAIN ] LZB: Generated 1794 derivative records from 35504 primary records. [2025-09-17T22:54:11.611743] [DEBUG] [LOCAL ] LZB: Saving derivative data. [2025-09-17T22:54:11.641884] [DEBUG] [MAIN ] LYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:11.644071] [INFO ] [MAIN ] LYG: Generated 1794 derivative records from 52937 primary records. [2025-09-17T22:54:11.646222] [DEBUG] [LOCAL ] LYG: Saving derivative data. [2025-09-17T22:54:11.647423] [DEBUG] [LOCAL ] LZB: Derivative data saved (1794 records). [2025-09-17T22:54:11.649581] [INFO ] [MAIN ] LZB: Successfully saved derivative data. [2025-09-17T22:54:11.652113] [INFO ] [MAIN ] Derivative Progress: 1126/2085 symbols completed. LZB took 1.1s. Estimated remaining: 6m 14s. Rate: 153.7 symbols/min [2025-09-17T22:54:11.652810] [INFO ] [MAIN ] LZM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:11.680477] [DEBUG] [LOCAL ] LYG: Derivative data saved (1794 records). [2025-09-17T22:54:11.680876] [INFO ] [MAIN ] LYG: Successfully saved derivative data. [2025-09-17T22:54:11.681209] [DEBUG] [MAIN ] LYV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:11.683810] [INFO ] [MAIN ] Derivative Progress: 1127/2085 symbols completed. LYG took 1.1s. Estimated remaining: 6m 14s. Rate: 153.9 symbols/min [2025-09-17T22:54:11.684414] [INFO ] [MAIN ] M: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:11.685210] [INFO ] [MAIN ] LYV: Generated 1794 derivative records from 51304 primary records. [2025-09-17T22:54:11.685638] [DEBUG] [LOCAL ] LYV: Saving derivative data. [2025-09-17T22:54:11.710082] [DEBUG] [LOCAL ] LZM: Loaded 13420 existing records from primary storage. [2025-09-17T22:54:11.711077] [INFO ] [MAIN ] LZM: Loaded 13420 primary data records. [2025-09-17T22:54:11.746987] [DEBUG] [LOCAL ] LYV: Derivative data saved (1794 records). [2025-09-17T22:54:11.760673] [INFO ] [MAIN ] LYV: Successfully saved derivative data. [2025-09-17T22:54:11.768361] [INFO ] [MAIN ] Derivative Progress: 1128/2085 symbols completed. LYV took 1.2s. Estimated remaining: 6m 13s. Rate: 154.0 symbols/min [2025-09-17T22:54:11.786218] [INFO ] [MAIN ] MA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:12.058993] [DEBUG] [LOCAL ] M: Loaded 53536 existing records from primary storage. [2025-09-17T22:54:12.059503] [INFO ] [MAIN ] M: Loaded 53536 primary data records. [2025-09-17T22:54:12.243681] [DEBUG] [LOCAL ] MA: Loaded 52595 existing records from primary storage. [2025-09-17T22:54:12.438336] [INFO ] [MAIN ] MA: Loaded 52595 primary data records. [2025-09-17T22:54:12.606689] [DEBUG] [MAIN ] LZM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:12.662187] [INFO ] [MAIN ] LZM: Generated 1794 derivative records from 13420 primary records. [2025-09-17T22:54:12.773709] [DEBUG] [LOCAL ] LZM: Saving derivative data. [2025-09-17T22:54:12.805942] [DEBUG] [LOCAL ] LZM: Derivative data saved (1794 records). [2025-09-17T22:54:12.806607] [INFO ] [MAIN ] LZM: Successfully saved derivative data. [2025-09-17T22:54:12.810033] [INFO ] [MAIN ] Derivative Progress: 1129/2085 symbols completed. LZM took 1.2s. Estimated remaining: 6m 13s. Rate: 153.7 symbols/min [2025-09-17T22:54:12.812840] [INFO ] [MAIN ] MAA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:12.827806] [DEBUG] [MAIN ] M: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:12.829508] [INFO ] [MAIN ] M: Generated 1794 derivative records from 53536 primary records. [2025-09-17T22:54:12.829840] [DEBUG] [LOCAL ] M: Saving derivative data. [2025-09-17T22:54:12.847089] [DEBUG] [LOCAL ] M: Derivative data saved (1794 records). [2025-09-17T22:54:12.847353] [INFO ] [MAIN ] M: Successfully saved derivative data. [2025-09-17T22:54:12.850337] [INFO ] [MAIN ] Derivative Progress: 1130/2085 symbols completed. M took 1.2s. Estimated remaining: 6m 12s. Rate: 153.9 symbols/min [2025-09-17T22:54:12.850883] [INFO ] [MAIN ] MAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:12.869580] [DEBUG] [MAIN ] MA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:12.870397] [INFO ] [MAIN ] MA: Generated 1794 derivative records from 52595 primary records. [2025-09-17T22:54:12.870515] [DEBUG] [LOCAL ] MA: Saving derivative data. [2025-09-17T22:54:12.896472] [DEBUG] [LOCAL ] MA: Derivative data saved (1794 records). [2025-09-17T22:54:12.896714] [INFO ] [MAIN ] MA: Successfully saved derivative data. [2025-09-17T22:54:12.899299] [INFO ] [MAIN ] Derivative Progress: 1131/2085 symbols completed. MA took 1.1s. Estimated remaining: 6m 12s. Rate: 154.0 symbols/min [2025-09-17T22:54:12.899742] [INFO ] [MAIN ] MAGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:12.914745] [DEBUG] [LOCAL ] MAA: Loaded 43047 existing records from primary storage. [2025-09-17T22:54:12.915010] [INFO ] [MAIN ] MAA: Loaded 43047 primary data records. [2025-09-17T22:54:13.257286] [DEBUG] [LOCAL ] MAC: Loaded 49752 existing records from primary storage. [2025-09-17T22:54:13.270773] [INFO ] [MAIN ] MAC: Loaded 49752 primary data records. [2025-09-17T22:54:13.283043] [DEBUG] [LOCAL ] MAGN: Loaded 35003 existing records from primary storage. [2025-09-17T22:54:13.310319] [INFO ] [MAIN ] MAGN: Loaded 35003 primary data records. [2025-09-17T22:54:13.915243] [DEBUG] [MAIN ] MAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:13.916317] [INFO ] [MAIN ] MAA: Generated 1794 derivative records from 43047 primary records. [2025-09-17T22:54:13.916467] [DEBUG] [LOCAL ] MAA: Saving derivative data. [2025-09-17T22:54:13.934739] [DEBUG] [LOCAL ] MAA: Derivative data saved (1794 records). [2025-09-17T22:54:13.934920] [INFO ] [MAIN ] MAA: Successfully saved derivative data. [2025-09-17T22:54:13.937470] [INFO ] [MAIN ] Derivative Progress: 1132/2085 symbols completed. MAA took 1.1s. Estimated remaining: 6m 12s. Rate: 153.8 symbols/min [2025-09-17T22:54:13.938041] [INFO ] [MAIN ] MAIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:13.959153] [DEBUG] [MAIN ] MAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:13.960068] [INFO ] [MAIN ] MAC: Generated 1794 derivative records from 49752 primary records. [2025-09-17T22:54:13.972438] [DEBUG] [LOCAL ] MAC: Saving derivative data. [2025-09-17T22:54:13.973561] [DEBUG] [MAIN ] MAGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:13.974560] [INFO ] [MAIN ] MAGN: Generated 1794 derivative records from 35003 primary records. [2025-09-17T22:54:13.974695] [DEBUG] [LOCAL ] MAGN: Saving derivative data. [2025-09-17T22:54:14.002722] [DEBUG] [LOCAL ] MAC: Derivative data saved (1794 records). [2025-09-17T22:54:14.003120] [INFO ] [MAIN ] MAC: Successfully saved derivative data. [2025-09-17T22:54:14.007580] [INFO ] [MAIN ] Derivative Progress: 1133/2085 symbols completed. MAC took 1.2s. Estimated remaining: 6m 11s. Rate: 153.9 symbols/min [2025-09-17T22:54:14.008364] [INFO ] [MAIN ] MAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:14.020049] [DEBUG] [LOCAL ] MAGN: Derivative data saved (1794 records). [2025-09-17T22:54:14.020207] [INFO ] [MAIN ] MAGN: Successfully saved derivative data. [2025-09-17T22:54:14.022738] [INFO ] [MAIN ] Derivative Progress: 1134/2085 symbols completed. MAGN took 1.1s. Estimated remaining: 6m 11s. Rate: 154.0 symbols/min [2025-09-17T22:54:14.023082] [INFO ] [MAIN ] MANU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:14.039907] [DEBUG] [LOCAL ] MAIN: Loaded 41395 existing records from primary storage. [2025-09-17T22:54:14.040117] [INFO ] [MAIN ] MAIN: Loaded 41395 primary data records. [2025-09-17T22:54:14.378405] [DEBUG] [LOCAL ] MANU: Loaded 27155 existing records from primary storage. [2025-09-17T22:54:14.378702] [INFO ] [MAIN ] MANU: Loaded 27155 primary data records. [2025-09-17T22:54:14.500757] [DEBUG] [LOCAL ] MAN: Loaded 43676 existing records from primary storage. [2025-09-17T22:54:14.505866] [INFO ] [MAIN ] MAN: Loaded 43676 primary data records. [2025-09-17T22:54:15.075557] [DEBUG] [MAIN ] MAIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:15.077585] [INFO ] [MAIN ] MAIN: Generated 1794 derivative records from 41395 primary records. [2025-09-17T22:54:15.077986] [DEBUG] [LOCAL ] MAIN: Saving derivative data. [2025-09-17T22:54:15.099168] [DEBUG] [LOCAL ] MAIN: Derivative data saved (1794 records). [2025-09-17T22:54:15.099743] [INFO ] [MAIN ] MAIN: Successfully saved derivative data. [2025-09-17T22:54:15.101945] [INFO ] [MAIN ] Derivative Progress: 1135/2085 symbols completed. MAIN took 1.2s. Estimated remaining: 6m 11s. Rate: 153.8 symbols/min [2025-09-17T22:54:15.102671] [INFO ] [MAIN ] MAS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:15.123582] [DEBUG] [MAIN ] MANU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:15.124993] [INFO ] [MAIN ] MANU: Generated 1794 derivative records from 27155 primary records. [2025-09-17T22:54:15.132676] [DEBUG] [LOCAL ] MANU: Saving derivative data. [2025-09-17T22:54:15.146471] [DEBUG] [MAIN ] MAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:15.154688] [INFO ] [MAIN ] MAN: Generated 1794 derivative records from 43676 primary records. [2025-09-17T22:54:15.154796] [DEBUG] [LOCAL ] MAN: Saving derivative data. [2025-09-17T22:54:15.158485] [DEBUG] [LOCAL ] MANU: Derivative data saved (1794 records). [2025-09-17T22:54:15.166018] [INFO ] [MAIN ] MANU: Successfully saved derivative data. [2025-09-17T22:54:15.172611] [INFO ] [MAIN ] Derivative Progress: 1136/2085 symbols completed. MANU took 1.1s. Estimated remaining: 6m 10s. Rate: 153.9 symbols/min [2025-09-17T22:54:15.173302] [INFO ] [MAIN ] MATV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:15.179058] [DEBUG] [LOCAL ] MAN: Derivative data saved (1794 records). [2025-09-17T22:54:15.179229] [INFO ] [MAIN ] MAN: Successfully saved derivative data. [2025-09-17T22:54:15.181824] [INFO ] [MAIN ] Derivative Progress: 1137/2085 symbols completed. MAN took 1.2s. Estimated remaining: 6m 9s. Rate: 154.0 symbols/min [2025-09-17T22:54:15.182179] [INFO ] [MAIN ] MATX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:15.241890] [DEBUG] [LOCAL ] MAS: Loaded 52371 existing records from primary storage. [2025-09-17T22:54:15.242227] [INFO ] [MAIN ] MAS: Loaded 52371 primary data records. [2025-09-17T22:54:15.327345] [DEBUG] [LOCAL ] MATX: Loaded 31582 existing records from primary storage. [2025-09-17T22:54:15.341215] [INFO ] [MAIN ] MATX: Loaded 31582 primary data records. [2025-09-17T22:54:15.452165] [DEBUG] [LOCAL ] MATV: Loaded 37940 existing records from primary storage. [2025-09-17T22:54:15.473305] [INFO ] [MAIN ] MATV: Loaded 37940 primary data records. [2025-09-17T22:54:16.242507] [DEBUG] [MAIN ] MAS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:16.243451] [INFO ] [MAIN ] MAS: Generated 1794 derivative records from 52371 primary records. [2025-09-17T22:54:16.243678] [DEBUG] [LOCAL ] MAS: Saving derivative data. [2025-09-17T22:54:16.261970] [DEBUG] [LOCAL ] MAS: Derivative data saved (1794 records). [2025-09-17T22:54:16.262085] [INFO ] [MAIN ] MAS: Successfully saved derivative data. [2025-09-17T22:54:16.264300] [INFO ] [MAIN ] Derivative Progress: 1138/2085 symbols completed. MAS took 1.2s. Estimated remaining: 6m 10s. Rate: 153.8 symbols/min [2025-09-17T22:54:16.281051] [DEBUG] [MAIN ] MATX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:16.281839] [INFO ] [MAIN ] MATX: Generated 1794 derivative records from 31582 primary records. [2025-09-17T22:54:16.281986] [DEBUG] [LOCAL ] MATX: Saving derivative data. [2025-09-17T22:54:16.294467] [DEBUG] [MAIN ] MATV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:16.295719] [INFO ] [MAIN ] MATV: Generated 1794 derivative records from 37940 primary records. [2025-09-17T22:54:16.295967] [DEBUG] [LOCAL ] MATV: Saving derivative data. [2025-09-17T22:54:16.323883] [DEBUG] [LOCAL ] MATX: Derivative data saved (1794 records). [2025-09-17T22:54:16.324759] [INFO ] [MAIN ] MATX: Successfully saved derivative data. [2025-09-17T22:54:16.327722] [INFO ] [MAIN ] Derivative Progress: 1139/2085 symbols completed. MATX took 1.1s. Estimated remaining: 6m 9s. Rate: 153.9 symbols/min [2025-09-17T22:54:16.328957] [DEBUG] [LOCAL ] MATV: Derivative data saved (1794 records). [2025-09-17T22:54:16.329024] [INFO ] [MAIN ] MATV: Successfully saved derivative data. [2025-09-17T22:54:16.331345] [INFO ] [MAIN ] Derivative Progress: 1140/2085 symbols completed. MATV took 1.2s. Estimated remaining: 6m 8s. Rate: 154.0 symbols/min [2025-09-17T22:54:16.332032] [INFO ] [MAIN ] MBC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:16.332142] [INFO ] [MAIN ] MAX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:16.332565] [INFO ] [MAIN ] MBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:16.368413] [DEBUG] [LOCAL ] MBI: Loaded 25048 existing records from primary storage. [2025-09-17T22:54:16.376867] [INFO ] [MAIN ] MBI: Loaded 25048 primary data records. [2025-09-17T22:54:16.417365] [DEBUG] [LOCAL ] MAX: Loaded 31090 existing records from primary storage. [2025-09-17T22:54:16.432277] [INFO ] [MAIN ] MAX: Loaded 31090 primary data records. [2025-09-17T22:54:16.611638] [DEBUG] [LOCAL ] MBC: Loaded 43058 existing records from primary storage. [2025-09-17T22:54:16.636092] [INFO ] [MAIN ] MBC: Loaded 43058 primary data records. [2025-09-17T22:54:17.454370] [DEBUG] [MAIN ] MBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:17.459953] [DEBUG] [MAIN ] MAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:17.461571] [INFO ] [MAIN ] MAX: Generated 1794 derivative records from 31090 primary records. [2025-09-17T22:54:17.462041] [DEBUG] [LOCAL ] MAX: Saving derivative data. [2025-09-17T22:54:17.460974] [INFO ] [MAIN ] MBI: Generated 1794 derivative records from 25048 primary records. [2025-09-17T22:54:17.463166] [DEBUG] [LOCAL ] MBI: Saving derivative data. [2025-09-17T22:54:17.513759] [DEBUG] [LOCAL ] MBI: Derivative data saved (1794 records). [2025-09-17T22:54:17.513903] [INFO ] [MAIN ] MBI: Successfully saved derivative data. [2025-09-17T22:54:17.514248] [DEBUG] [MAIN ] MBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:17.516281] [INFO ] [MAIN ] Derivative Progress: 1141/2085 symbols completed. MBI took 1.2s. Estimated remaining: 6m 8s. Rate: 153.7 symbols/min [2025-09-17T22:54:17.517390] [INFO ] [MAIN ] MBC: Generated 1794 derivative records from 43058 primary records. [2025-09-17T22:54:17.517528] [INFO ] [MAIN ] MC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:17.512751] [DEBUG] [LOCAL ] MAX: Derivative data saved (1794 records). [2025-09-17T22:54:17.517819] [INFO ] [MAIN ] MAX: Successfully saved derivative data. [2025-09-17T22:54:17.520445] [INFO ] [MAIN ] Derivative Progress: 1142/2085 symbols completed. MAX took 1.2s. Estimated remaining: 6m 8s. Rate: 153.9 symbols/min [2025-09-17T22:54:17.520963] [DEBUG] [LOCAL ] MBC: Saving derivative data. [2025-09-17T22:54:17.522028] [INFO ] [MAIN ] MCB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:17.538741] [DEBUG] [LOCAL ] MBC: Derivative data saved (1794 records). [2025-09-17T22:54:17.538907] [INFO ] [MAIN ] MBC: Successfully saved derivative data. [2025-09-17T22:54:17.541489] [INFO ] [MAIN ] Derivative Progress: 1143/2085 symbols completed. MBC took 1.2s. Estimated remaining: 6m 7s. Rate: 154.0 symbols/min [2025-09-17T22:54:17.541889] [INFO ] [MAIN ] MCD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:17.552237] [DEBUG] [LOCAL ] MCB: Loaded 11743 existing records from primary storage. [2025-09-17T22:54:17.552498] [INFO ] [MAIN ] MCB: Loaded 11743 primary data records. [2025-09-17T22:54:17.875531] [DEBUG] [LOCAL ] MC: Loaded 44467 existing records from primary storage. [2025-09-17T22:54:17.903529] [INFO ] [MAIN ] MC: Loaded 44467 primary data records. [2025-09-17T22:54:18.039093] [DEBUG] [LOCAL ] MCD: Loaded 53467 existing records from primary storage. [2025-09-17T22:54:18.045360] [INFO ] [MAIN ] MCD: Loaded 53467 primary data records. [2025-09-17T22:54:18.646760] [DEBUG] [MAIN ] MCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:18.648029] [INFO ] [MAIN ] MCB: Generated 1794 derivative records from 11743 primary records. [2025-09-17T22:54:18.648427] [DEBUG] [LOCAL ] MCB: Saving derivative data. [2025-09-17T22:54:18.665474] [DEBUG] [LOCAL ] MCB: Derivative data saved (1794 records). [2025-09-17T22:54:18.666461] [INFO ] [MAIN ] MCB: Successfully saved derivative data. [2025-09-17T22:54:18.668466] [INFO ] [MAIN ] Derivative Progress: 1144/2085 symbols completed. MCB took 1.1s. Estimated remaining: 6m 7s. Rate: 153.7 symbols/min [2025-09-17T22:54:18.669040] [INFO ] [MAIN ] MCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:18.689322] [DEBUG] [MAIN ] MC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:18.693339] [DEBUG] [LOCAL ] MCI: Loaded 6336 existing records from primary storage. [2025-09-17T22:54:18.693742] [INFO ] [MAIN ] MCI: Loaded 6336 primary data records. [2025-09-17T22:54:18.705879] [INFO ] [MAIN ] MC: Generated 1794 derivative records from 44467 primary records. [2025-09-17T22:54:18.705980] [DEBUG] [LOCAL ] MC: Saving derivative data. [2025-09-17T22:54:18.851953] [DEBUG] [LOCAL ] MC: Derivative data saved (1794 records). [2025-09-17T22:54:18.852092] [INFO ] [MAIN ] MC: Successfully saved derivative data. [2025-09-17T22:54:18.854480] [INFO ] [MAIN ] Derivative Progress: 1145/2085 symbols completed. MC took 1.3s. Estimated remaining: 6m 7s. Rate: 153.8 symbols/min [2025-09-17T22:54:18.845738] [DEBUG] [MAIN ] MCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:18.883244] [INFO ] [MAIN ] MCD: Generated 1794 derivative records from 53467 primary records. [2025-09-17T22:54:18.889904] [DEBUG] [LOCAL ] MCD: Saving derivative data. [2025-09-17T22:54:18.894522] [INFO ] [MAIN ] MCK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:19.058411] [DEBUG] [LOCAL ] MCD: Derivative data saved (1794 records). [2025-09-17T22:54:19.059170] [INFO ] [MAIN ] MCD: Successfully saved derivative data. [2025-09-17T22:54:19.061951] [INFO ] [MAIN ] Derivative Progress: 1146/2085 symbols completed. MCD took 1.5s. Estimated remaining: 6m 6s. Rate: 153.9 symbols/min [2025-09-17T22:54:19.062560] [INFO ] [MAIN ] MCN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:19.076322] [DEBUG] [LOCAL ] MCN: Loaded 8222 existing records from primary storage. [2025-09-17T22:54:19.076541] [INFO ] [MAIN ] MCN: Loaded 8222 primary data records. [2025-09-17T22:54:19.235676] [DEBUG] [LOCAL ] MCK: Loaded 39599 existing records from primary storage. [2025-09-17T22:54:19.264295] [INFO ] [MAIN ] MCK: Loaded 39599 primary data records. [2025-09-17T22:54:19.418005] [DEBUG] [MAIN ] MCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:19.433690] [INFO ] [MAIN ] MCI: Generated 1794 derivative records from 6336 primary records. [2025-09-17T22:54:19.441753] [DEBUG] [LOCAL ] MCI: Saving derivative data. [2025-09-17T22:54:19.562459] [DEBUG] [LOCAL ] MCI: Derivative data saved (1794 records). [2025-09-17T22:54:19.566970] [INFO ] [MAIN ] MCI: Successfully saved derivative data. [2025-09-17T22:54:19.569233] [INFO ] [MAIN ] Derivative Progress: 1147/2085 symbols completed. MCI took 0.9s. Estimated remaining: 6m 6s. Rate: 153.8 symbols/min [2025-09-17T22:54:19.569917] [INFO ] [MAIN ] MCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:19.799542] [DEBUG] [MAIN ] MCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:19.801142] [INFO ] [MAIN ] MCN: Generated 1794 derivative records from 8222 primary records. [2025-09-17T22:54:19.801789] [DEBUG] [LOCAL ] MCN: Saving derivative data. [2025-09-17T22:54:19.831216] [DEBUG] [LOCAL ] MCN: Derivative data saved (1794 records). [2025-09-17T22:54:19.831470] [INFO ] [MAIN ] MCN: Successfully saved derivative data. [2025-09-17T22:54:19.833841] [INFO ] [MAIN ] Derivative Progress: 1148/2085 symbols completed. MCN took 0.8s. Estimated remaining: 6m 5s. Rate: 153.9 symbols/min [2025-09-17T22:54:19.834516] [INFO ] [MAIN ] MCR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:19.867344] [DEBUG] [MAIN ] MCK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:19.869497] [INFO ] [MAIN ] MCK: Generated 1794 derivative records from 39599 primary records. [2025-09-17T22:54:19.873934] [DEBUG] [LOCAL ] MCK: Saving derivative data. [2025-09-17T22:54:19.868545] [DEBUG] [LOCAL ] MCO: Loaded 39609 existing records from primary storage. [2025-09-17T22:54:19.875135] [DEBUG] [LOCAL ] MCR: Loaded 8977 existing records from primary storage. [2025-09-17T22:54:19.883926] [INFO ] [MAIN ] MCR: Loaded 8977 primary data records. [2025-09-17T22:54:19.882711] [INFO ] [MAIN ] MCO: Loaded 39609 primary data records. [2025-09-17T22:54:20.045748] [DEBUG] [LOCAL ] MCK: Derivative data saved (1794 records). [2025-09-17T22:54:20.084719] [INFO ] [MAIN ] MCK: Successfully saved derivative data. [2025-09-17T22:54:20.100890] [INFO ] [MAIN ] Derivative Progress: 1149/2085 symbols completed. MCK took 1.2s. Estimated remaining: 6m 5s. Rate: 153.9 symbols/min [2025-09-17T22:54:20.125989] [INFO ] [MAIN ] MCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:20.546288] [DEBUG] [LOCAL ] MCS: Loaded 21471 existing records from primary storage. [2025-09-17T22:54:20.547808] [INFO ] [MAIN ] MCS: Loaded 21471 primary data records. [2025-09-17T22:54:20.929144] [DEBUG] [MAIN ] MCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:20.931257] [INFO ] [MAIN ] MCO: Generated 1794 derivative records from 39609 primary records. [2025-09-17T22:54:20.931639] [DEBUG] [LOCAL ] MCO: Saving derivative data. [2025-09-17T22:54:20.967340] [DEBUG] [LOCAL ] MCO: Derivative data saved (1794 records). [2025-09-17T22:54:20.968029] [DEBUG] [MAIN ] MCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:20.969062] [INFO ] [MAIN ] MCR: Generated 1794 derivative records from 8977 primary records. [2025-09-17T22:54:20.969158] [INFO ] [MAIN ] MCO: Successfully saved derivative data. [2025-09-17T22:54:20.971631] [INFO ] [MAIN ] Derivative Progress: 1150/2085 symbols completed. MCO took 1.4s. Estimated remaining: 6m 5s. Rate: 153.8 symbols/min [2025-09-17T22:54:20.972487] [DEBUG] [LOCAL ] MCR: Saving derivative data. [2025-09-17T22:54:20.972305] [INFO ] [MAIN ] MCY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:20.990726] [DEBUG] [LOCAL ] MCR: Derivative data saved (1794 records). [2025-09-17T22:54:20.994059] [INFO ] [MAIN ] MCR: Successfully saved derivative data. [2025-09-17T22:54:20.996716] [INFO ] [MAIN ] Derivative Progress: 1151/2085 symbols completed. MCR took 1.2s. Estimated remaining: 6m 4s. Rate: 153.9 symbols/min [2025-09-17T22:54:20.997488] [INFO ] [MAIN ] MD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:21.018678] [DEBUG] [MAIN ] MCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:21.019521] [INFO ] [MAIN ] MCS: Generated 1794 derivative records from 21471 primary records. [2025-09-17T22:54:21.019735] [DEBUG] [LOCAL ] MCS: Saving derivative data. [2025-09-17T22:54:21.044788] [DEBUG] [LOCAL ] MCY: Loaded 25667 existing records from primary storage. [2025-09-17T22:54:21.045989] [DEBUG] [LOCAL ] MCS: Derivative data saved (1794 records). [2025-09-17T22:54:21.046307] [INFO ] [MAIN ] MCY: Loaded 25667 primary data records. [2025-09-17T22:54:21.046446] [INFO ] [MAIN ] MCS: Successfully saved derivative data. [2025-09-17T22:54:21.054574] [INFO ] [MAIN ] Derivative Progress: 1152/2085 symbols completed. MCS took 0.9s. Estimated remaining: 6m 4s. Rate: 154.0 symbols/min [2025-09-17T22:54:21.075767] [INFO ] [MAIN ] MDST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:21.190940] [DEBUG] [LOCAL ] MDST: Loaded 5430 existing records from primary storage. [2025-09-17T22:54:21.253977] [DEBUG] [LOCAL ] MD: Loaded 38815 existing records from primary storage. [2025-09-17T22:54:21.229278] [INFO ] [MAIN ] MDST: Loaded 5430 primary data records. [2025-09-17T22:54:21.265706] [INFO ] [MAIN ] MD: Loaded 38815 primary data records. [2025-09-17T22:54:22.062268] [DEBUG] [MAIN ] MCY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:22.063577] [INFO ] [MAIN ] MCY: Generated 1794 derivative records from 25667 primary records. [2025-09-17T22:54:22.063892] [DEBUG] [LOCAL ] MCY: Saving derivative data. [2025-09-17T22:54:22.083060] [DEBUG] [LOCAL ] MCY: Derivative data saved (1794 records). [2025-09-17T22:54:22.083198] [INFO ] [MAIN ] MCY: Successfully saved derivative data. [2025-09-17T22:54:22.085416] [INFO ] [MAIN ] Derivative Progress: 1153/2085 symbols completed. MCY took 1.1s. Estimated remaining: 6m 4s. Rate: 153.8 symbols/min [2025-09-17T22:54:22.117061] [DEBUG] [MAIN ] MDST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:22.118525] [INFO ] [MAIN ] MDST: Generated 1794 derivative records from 5430 primary records. [2025-09-17T22:54:22.117855] [DEBUG] [MAIN ] MD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:22.119161] [INFO ] [MAIN ] MD: Generated 1794 derivative records from 38815 primary records. [2025-09-17T22:54:22.119238] [DEBUG] [LOCAL ] MDST: Saving derivative data. [2025-09-17T22:54:22.119783] [DEBUG] [LOCAL ] MD: Saving derivative data. [2025-09-17T22:54:22.148157] [DEBUG] [LOCAL ] MDST: Derivative data saved (1794 records). [2025-09-17T22:54:22.148448] [INFO ] [MAIN ] MDST: Successfully saved derivative data. [2025-09-17T22:54:22.150750] [INFO ] [MAIN ] Derivative Progress: 1154/2085 symbols completed. MDST took 1.1s. Estimated remaining: 6m 3s. Rate: 153.9 symbols/min [2025-09-17T22:54:22.154007] [DEBUG] [LOCAL ] MD: Derivative data saved (1794 records). [2025-09-17T22:54:22.154075] [INFO ] [MAIN ] MD: Successfully saved derivative data. [2025-09-17T22:54:22.157005] [INFO ] [MAIN ] Derivative Progress: 1155/2085 symbols completed. MD took 1.2s. Estimated remaining: 6m 2s. Rate: 154.0 symbols/min [2025-09-17T22:54:22.157613] [INFO ] [MAIN ] MDU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:22.157498] [INFO ] [MAIN ] MDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:22.158286] [INFO ] [MAIN ] MDV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:22.170251] [DEBUG] [LOCAL ] MDV: Loaded 8837 existing records from primary storage. [2025-09-17T22:54:22.170378] [INFO ] [MAIN ] MDV: Loaded 8837 primary data records. [2025-09-17T22:54:22.529039] [DEBUG] [LOCAL ] MDU: Loaded 47853 existing records from primary storage. [2025-09-17T22:54:22.529827] [INFO ] [MAIN ] MDU: Loaded 47853 primary data records. [2025-09-17T22:54:22.562914] [DEBUG] [LOCAL ] MDT: Loaded 53678 existing records from primary storage. [2025-09-17T22:54:22.596781] [INFO ] [MAIN ] MDT: Loaded 53678 primary data records. [2025-09-17T22:54:23.185721] [DEBUG] [MAIN ] MDV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:23.187047] [INFO ] [MAIN ] MDV: Generated 1794 derivative records from 8837 primary records. [2025-09-17T22:54:23.187326] [DEBUG] [LOCAL ] MDV: Saving derivative data. [2025-09-17T22:54:23.207692] [DEBUG] [LOCAL ] MDV: Derivative data saved (1794 records). [2025-09-17T22:54:23.209453] [INFO ] [MAIN ] MDV: Successfully saved derivative data. [2025-09-17T22:54:23.213315] [INFO ] [MAIN ] Derivative Progress: 1156/2085 symbols completed. MDV took 1.1s. Estimated remaining: 6m 2s. Rate: 153.8 symbols/min [2025-09-17T22:54:23.213812] [INFO ] [MAIN ] MEC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:23.228127] [DEBUG] [MAIN ] MDU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:23.229495] [INFO ] [MAIN ] MDU: Generated 1794 derivative records from 47853 primary records. [2025-09-17T22:54:23.229573] [DEBUG] [LOCAL ] MDU: Saving derivative data. [2025-09-17T22:54:23.254152] [DEBUG] [LOCAL ] MDU: Derivative data saved (1794 records). [2025-09-17T22:54:23.255175] [INFO ] [MAIN ] MDU: Successfully saved derivative data. [2025-09-17T22:54:23.257261] [INFO ] [MAIN ] Derivative Progress: 1157/2085 symbols completed. MDU took 1.1s. Estimated remaining: 6m 2s. Rate: 153.9 symbols/min [2025-09-17T22:54:23.257637] [INFO ] [MAIN ] MED: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:23.278333] [DEBUG] [LOCAL ] MEC: Loaded 16704 existing records from primary storage. [2025-09-17T22:54:23.278744] [DEBUG] [MAIN ] MDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:23.279054] [INFO ] [MAIN ] MEC: Loaded 16704 primary data records. [2025-09-17T22:54:23.293935] [INFO ] [MAIN ] MDT: Generated 1794 derivative records from 53678 primary records. [2025-09-17T22:54:23.324536] [DEBUG] [LOCAL ] MDT: Saving derivative data. [2025-09-17T22:54:23.421199] [DEBUG] [LOCAL ] MDT: Derivative data saved (1794 records). [2025-09-17T22:54:23.425929] [INFO ] [MAIN ] MDT: Successfully saved derivative data. [2025-09-17T22:54:23.428495] [INFO ] [MAIN ] Derivative Progress: 1158/2085 symbols completed. MDT took 1.3s. Estimated remaining: 6m 1s. Rate: 154.0 symbols/min [2025-09-17T22:54:23.429297] [INFO ] [MAIN ] MEG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:23.425691] [DEBUG] [LOCAL ] MED: Loaded 21925 existing records from primary storage. [2025-09-17T22:54:23.440116] [INFO ] [MAIN ] MED: Loaded 21925 primary data records. [2025-09-17T22:54:23.967547] [DEBUG] [LOCAL ] MEG: Loaded 32122 existing records from primary storage. [2025-09-17T22:54:23.968094] [INFO ] [MAIN ] MEG: Loaded 32122 primary data records. [2025-09-17T22:54:24.307350] [DEBUG] [MAIN ] MEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:24.308619] [INFO ] [MAIN ] MEC: Generated 1794 derivative records from 16704 primary records. [2025-09-17T22:54:24.309042] [DEBUG] [LOCAL ] MEC: Saving derivative data. [2025-09-17T22:54:24.336524] [DEBUG] [LOCAL ] MEC: Derivative data saved (1794 records). [2025-09-17T22:54:24.337722] [INFO ] [MAIN ] MEC: Successfully saved derivative data. [2025-09-17T22:54:24.339821] [INFO ] [MAIN ] Derivative Progress: 1159/2085 symbols completed. MEC took 1.1s. Estimated remaining: 6m 1s. Rate: 153.8 symbols/min [2025-09-17T22:54:24.340597] [INFO ] [MAIN ] MEGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:24.354741] [DEBUG] [MAIN ] MED: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:24.355692] [INFO ] [MAIN ] MED: Generated 1794 derivative records from 21925 primary records. [2025-09-17T22:54:24.355831] [DEBUG] [LOCAL ] MED: Saving derivative data. [2025-09-17T22:54:24.386872] [DEBUG] [LOCAL ] MED: Derivative data saved (1794 records). [2025-09-17T22:54:24.387101] [INFO ] [MAIN ] MED: Successfully saved derivative data. [2025-09-17T22:54:24.391662] [INFO ] [MAIN ] Derivative Progress: 1160/2085 symbols completed. MED took 1.1s. Estimated remaining: 6m 1s. Rate: 153.9 symbols/min [2025-09-17T22:54:24.394094] [INFO ] [MAIN ] MEI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:24.393994] [DEBUG] [LOCAL ] MEGI: Loaded 20616 existing records from primary storage. [2025-09-17T22:54:24.394995] [INFO ] [MAIN ] MEGI: Loaded 20616 primary data records. [2025-09-17T22:54:24.445627] [DEBUG] [MAIN ] MEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:24.480258] [INFO ] [MAIN ] MEG: Generated 1794 derivative records from 32122 primary records. [2025-09-17T22:54:24.497803] [DEBUG] [LOCAL ] MEG: Saving derivative data. [2025-09-17T22:54:24.792776] [DEBUG] [LOCAL ] MEG: Derivative data saved (1794 records). [2025-09-17T22:54:24.792898] [INFO ] [MAIN ] MEG: Successfully saved derivative data. [2025-09-17T22:54:24.795212] [INFO ] [MAIN ] Derivative Progress: 1161/2085 symbols completed. MEG took 1.4s. Estimated remaining: 6m 0s. Rate: 153.9 symbols/min [2025-09-17T22:54:24.792613] [DEBUG] [LOCAL ] MEI: Loaded 32663 existing records from primary storage. [2025-09-17T22:54:24.795700] [INFO ] [MAIN ] MEI: Loaded 32663 primary data records. [2025-09-17T22:54:24.796005] [INFO ] [MAIN ] MET: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:25.177845] [DEBUG] [MAIN ] MEGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:25.193181] [INFO ] [MAIN ] MEGI: Generated 1794 derivative records from 20616 primary records. [2025-09-17T22:54:25.193326] [DEBUG] [LOCAL ] MEGI: Saving derivative data. [2025-09-17T22:54:25.195897] [DEBUG] [LOCAL ] MET: Loaded 53314 existing records from primary storage. [2025-09-17T22:54:25.196281] [INFO ] [MAIN ] MET: Loaded 53314 primary data records. [2025-09-17T22:54:25.251993] [DEBUG] [LOCAL ] MEGI: Derivative data saved (1794 records). [2025-09-17T22:54:25.265217] [INFO ] [MAIN ] MEGI: Successfully saved derivative data. [2025-09-17T22:54:25.285259] [INFO ] [MAIN ] Derivative Progress: 1162/2085 symbols completed. MEGI took 0.9s. Estimated remaining: 5m 60s. Rate: 153.9 symbols/min [2025-09-17T22:54:25.291086] [INFO ] [MAIN ] MFA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:25.552962] [DEBUG] [MAIN ] MEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:25.553688] [INFO ] [MAIN ] MEI: Generated 1794 derivative records from 32663 primary records. [2025-09-17T22:54:25.553844] [DEBUG] [LOCAL ] MEI: Saving derivative data. [2025-09-17T22:54:25.584711] [DEBUG] [LOCAL ] MEI: Derivative data saved (1794 records). [2025-09-17T22:54:25.584955] [INFO ] [MAIN ] MEI: Successfully saved derivative data. [2025-09-17T22:54:25.587287] [INFO ] [MAIN ] Derivative Progress: 1163/2085 symbols completed. MEI took 1.2s. Estimated remaining: 5m 59s. Rate: 153.9 symbols/min [2025-09-17T22:54:25.588472] [INFO ] [MAIN ] MFAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:25.603741] [DEBUG] [LOCAL ] MFA: Loaded 45140 existing records from primary storage. [2025-09-17T22:54:25.605369] [INFO ] [MAIN ] MFA: Loaded 45140 primary data records. [2025-09-17T22:54:25.630213] [DEBUG] [LOCAL ] MFAN: Loaded 4281 existing records from primary storage. [2025-09-17T22:54:25.641310] [INFO ] [MAIN ] MFAN: Loaded 4281 primary data records. [2025-09-17T22:54:25.862022] [DEBUG] [MAIN ] MET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:25.914783] [INFO ] [MAIN ] MET: Generated 1794 derivative records from 53314 primary records. [2025-09-17T22:54:25.978194] [DEBUG] [LOCAL ] MET: Saving derivative data. [2025-09-17T22:54:26.263892] [DEBUG] [LOCAL ] MET: Derivative data saved (1794 records). [2025-09-17T22:54:26.264462] [INFO ] [MAIN ] MET: Successfully saved derivative data. [2025-09-17T22:54:26.266932] [INFO ] [MAIN ] Derivative Progress: 1164/2085 symbols completed. MET took 1.5s. Estimated remaining: 5m 59s. Rate: 153.8 symbols/min [2025-09-17T22:54:26.267491] [INFO ] [MAIN ] MFAO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:26.278071] [DEBUG] [LOCAL ] MFAO: Loaded 3834 existing records from primary storage. [2025-09-17T22:54:26.278733] [INFO ] [MAIN ] MFAO: Loaded 3834 primary data records. [2025-09-17T22:54:26.432941] [DEBUG] [MAIN ] MFA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:26.457169] [INFO ] [MAIN ] MFA: Generated 1794 derivative records from 45140 primary records. [2025-09-17T22:54:26.500250] [DEBUG] [MAIN ] MFAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:26.499405] [DEBUG] [LOCAL ] MFA: Saving derivative data. [2025-09-17T22:54:26.618835] [INFO ] [MAIN ] MFAN: Generated 1794 derivative records from 4281 primary records. [2025-09-17T22:54:26.626854] [DEBUG] [LOCAL ] MFAN: Saving derivative data. [2025-09-17T22:54:26.647099] [DEBUG] [LOCAL ] MFA: Derivative data saved (1794 records). [2025-09-17T22:54:26.647578] [INFO ] [MAIN ] MFA: Successfully saved derivative data. [2025-09-17T22:54:26.650207] [INFO ] [MAIN ] Derivative Progress: 1165/2085 symbols completed. MFA took 1.4s. Estimated remaining: 5m 59s. Rate: 153.8 symbols/min [2025-09-17T22:54:26.650789] [INFO ] [MAIN ] MFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:26.657673] [DEBUG] [LOCAL ] MFAN: Derivative data saved (1794 records). [2025-09-17T22:54:26.658000] [INFO ] [MAIN ] MFAN: Successfully saved derivative data. [2025-09-17T22:54:26.660610] [INFO ] [MAIN ] Derivative Progress: 1166/2085 symbols completed. MFAN took 1.1s. Estimated remaining: 5m 58s. Rate: 153.9 symbols/min [2025-09-17T22:54:26.661056] [INFO ] [MAIN ] MFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:26.680322] [DEBUG] [MAIN ] MFAO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:26.681166] [INFO ] [MAIN ] MFAO: Generated 1794 derivative records from 3834 primary records. [2025-09-17T22:54:26.681340] [DEBUG] [LOCAL ] MFAO: Saving derivative data. [2025-09-17T22:54:26.709540] [DEBUG] [LOCAL ] MFAO: Derivative data saved (1794 records). [2025-09-17T22:54:26.709796] [INFO ] [MAIN ] MFAO: Successfully saved derivative data. [2025-09-17T22:54:26.712082] [INFO ] [MAIN ] Derivative Progress: 1167/2085 symbols completed. MFAO took 0.4s. Estimated remaining: 5m 58s. Rate: 154.1 symbols/min [2025-09-17T22:54:26.712593] [INFO ] [MAIN ] MFM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:26.749630] [DEBUG] [LOCAL ] MFC: Loaded 51406 existing records from primary storage. [2025-09-17T22:54:26.755137] [INFO ] [MAIN ] MFC: Loaded 51406 primary data records. [2025-09-17T22:54:26.755431] [DEBUG] [LOCAL ] MFM: Loaded 14344 existing records from primary storage. [2025-09-17T22:54:26.755679] [INFO ] [MAIN ] MFM: Loaded 14344 primary data records. [2025-09-17T22:54:26.868040] [DEBUG] [LOCAL ] MFG: Loaded 48945 existing records from primary storage. [2025-09-17T22:54:26.954396] [INFO ] [MAIN ] MFG: Loaded 48945 primary data records. [2025-09-17T22:54:27.773064] [DEBUG] [MAIN ] MFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:27.773438] [DEBUG] [MAIN ] MFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:27.774923] [INFO ] [MAIN ] MFM: Generated 1794 derivative records from 14344 primary records. [2025-09-17T22:54:27.774177] [INFO ] [MAIN ] MFC: Generated 1794 derivative records from 51406 primary records. [2025-09-17T22:54:27.775133] [DEBUG] [LOCAL ] MFC: Saving derivative data. [2025-09-17T22:54:27.775301] [DEBUG] [LOCAL ] MFM: Saving derivative data. [2025-09-17T22:54:27.809636] [DEBUG] [LOCAL ] MFM: Derivative data saved (1794 records). [2025-09-17T22:54:27.808540] [DEBUG] [LOCAL ] MFC: Derivative data saved (1794 records). [2025-09-17T22:54:27.822013] [INFO ] [MAIN ] MFM: Successfully saved derivative data. [2025-09-17T22:54:27.824692] [INFO ] [MAIN ] MFC: Successfully saved derivative data. [2025-09-17T22:54:27.824370] [INFO ] [MAIN ] Derivative Progress: 1168/2085 symbols completed. MFM took 1.1s. Estimated remaining: 5m 58s. Rate: 153.8 symbols/min [2025-09-17T22:54:27.825066] [DEBUG] [MAIN ] MFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:27.827244] [INFO ] [MAIN ] Derivative Progress: 1169/2085 symbols completed. MFC took 1.2s. Estimated remaining: 5m 57s. Rate: 153.9 symbols/min [2025-09-17T22:54:27.828063] [INFO ] [MAIN ] MFG: Generated 1794 derivative records from 48945 primary records. [2025-09-17T22:54:27.828226] [DEBUG] [LOCAL ] MFG: Saving derivative data. [2025-09-17T22:54:27.843160] [DEBUG] [LOCAL ] MFG: Derivative data saved (1794 records). [2025-09-17T22:54:27.843218] [INFO ] [MAIN ] MFG: Successfully saved derivative data. [2025-09-17T22:54:27.845525] [INFO ] [MAIN ] Derivative Progress: 1170/2085 symbols completed. MFG took 1.2s. Estimated remaining: 5m 56s. Rate: 154.1 symbols/min [2025-09-17T22:54:27.846054] [INFO ] [MAIN ] MG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:27.846219] [INFO ] [MAIN ] MGA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:27.846157] [INFO ] [MAIN ] MGF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:27.852542] [DEBUG] [LOCAL ] MGF: Loaded 4157 existing records from primary storage. [2025-09-17T22:54:27.852704] [INFO ] [MAIN ] MGF: Loaded 4157 primary data records. [2025-09-17T22:54:27.997398] [DEBUG] [LOCAL ] MG: Loaded 16904 existing records from primary storage. [2025-09-17T22:54:28.039774] [INFO ] [MAIN ] MG: Loaded 16904 primary data records. [2025-09-17T22:54:28.310134] [DEBUG] [LOCAL ] MGA: Loaded 50683 existing records from primary storage. [2025-09-17T22:54:28.326294] [INFO ] [MAIN ] MGA: Loaded 50683 primary data records. [2025-09-17T22:54:28.899625] [DEBUG] [MAIN ] MGF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:28.900832] [INFO ] [MAIN ] MGF: Generated 1794 derivative records from 4157 primary records. [2025-09-17T22:54:28.901047] [DEBUG] [LOCAL ] MGF: Saving derivative data. [2025-09-17T22:54:28.918671] [DEBUG] [LOCAL ] MGF: Derivative data saved (1794 records). [2025-09-17T22:54:28.919088] [INFO ] [MAIN ] MGF: Successfully saved derivative data. [2025-09-17T22:54:28.934110] [DEBUG] [MAIN ] MG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:28.933157] [INFO ] [MAIN ] Derivative Progress: 1171/2085 symbols completed. MGF took 1.1s. Estimated remaining: 5m 56s. Rate: 153.8 symbols/min [2025-09-17T22:54:28.934934] [INFO ] [MAIN ] MG: Generated 1794 derivative records from 16904 primary records. [2025-09-17T22:54:28.935148] [INFO ] [MAIN ] MGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:28.935446] [DEBUG] [LOCAL ] MG: Saving derivative data. [2025-09-17T22:54:28.953961] [DEBUG] [LOCAL ] MG: Derivative data saved (1794 records). [2025-09-17T22:54:28.955555] [INFO ] [MAIN ] MG: Successfully saved derivative data. [2025-09-17T22:54:28.961402] [DEBUG] [LOCAL ] MGR: Loaded 5656 existing records from primary storage. [2025-09-17T22:54:28.957989] [INFO ] [MAIN ] Derivative Progress: 1172/2085 symbols completed. MG took 1.1s. Estimated remaining: 5m 56s. Rate: 154.0 symbols/min [2025-09-17T22:54:28.961783] [INFO ] [MAIN ] MGR: Loaded 5656 primary data records. [2025-09-17T22:54:28.969594] [INFO ] [MAIN ] MGRB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:29.018950] [DEBUG] [MAIN ] MGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:29.040975] [INFO ] [MAIN ] MGA: Generated 1794 derivative records from 50683 primary records. [2025-09-17T22:54:29.071186] [DEBUG] [LOCAL ] MGA: Saving derivative data. [2025-09-17T22:54:29.103489] [DEBUG] [LOCAL ] MGRB: Loaded 4119 existing records from primary storage. [2025-09-17T22:54:29.113880] [INFO ] [MAIN ] MGRB: Loaded 4119 primary data records. [2025-09-17T22:54:29.147897] [DEBUG] [LOCAL ] MGA: Derivative data saved (1794 records). [2025-09-17T22:54:29.159077] [INFO ] [MAIN ] MGA: Successfully saved derivative data. [2025-09-17T22:54:29.169123] [INFO ] [MAIN ] Derivative Progress: 1173/2085 symbols completed. MGA took 1.3s. Estimated remaining: 5m 55s. Rate: 154.0 symbols/min [2025-09-17T22:54:29.216791] [INFO ] [MAIN ] MGRD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:29.509345] [DEBUG] [LOCAL ] MGRD: Loaded 2250 existing records from primary storage. [2025-09-17T22:54:29.563711] [INFO ] [MAIN ] MGRD: Loaded 2250 primary data records. [2025-09-17T22:54:29.945365] [DEBUG] [MAIN ] MGR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:54:29.946533] [INFO ] [MAIN ] MGR: Generated 1793 derivative records from 5656 primary records. [2025-09-17T22:54:29.946920] [DEBUG] [LOCAL ] MGR: Saving derivative data. [2025-09-17T22:54:29.967215] [DEBUG] [LOCAL ] MGR: Derivative data saved (1793 records). [2025-09-17T22:54:29.967637] [INFO ] [MAIN ] MGR: Successfully saved derivative data. [2025-09-17T22:54:29.969880] [INFO ] [MAIN ] Derivative Progress: 1174/2085 symbols completed. MGR took 1.0s. Estimated remaining: 5m 55s. Rate: 153.9 symbols/min [2025-09-17T22:54:29.977569] [INFO ] [MAIN ] MGRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:29.983132] [DEBUG] [MAIN ] MGRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:29.984100] [INFO ] [MAIN ] MGRB: Generated 1794 derivative records from 4119 primary records. [2025-09-17T22:54:29.984366] [DEBUG] [LOCAL ] MGRB: Saving derivative data. [2025-09-17T22:54:30.002423] [DEBUG] [LOCAL ] MGRB: Derivative data saved (1794 records). [2025-09-17T22:54:30.006192] [INFO ] [MAIN ] MGRB: Successfully saved derivative data. [2025-09-17T22:54:30.008717] [INFO ] [MAIN ] Derivative Progress: 1175/2085 symbols completed. MGRB took 1.0s. Estimated remaining: 5m 55s. Rate: 154.0 symbols/min [2025-09-17T22:54:30.009013] [DEBUG] [LOCAL ] MGRE: Loaded 6503 existing records from primary storage. [2025-09-17T22:54:30.009144] [INFO ] [MAIN ] MGRE: Loaded 6503 primary data records. [2025-09-17T22:54:30.015300] [INFO ] [MAIN ] MGY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:30.101269] [DEBUG] [MAIN ] MGRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:30.129710] [INFO ] [MAIN ] MGRD: Generated 1794 derivative records from 2250 primary records. [2025-09-17T22:54:30.140614] [DEBUG] [LOCAL ] MGRD: Saving derivative data. [2025-09-17T22:54:30.326870] [DEBUG] [LOCAL ] MGRD: Derivative data saved (1794 records). [2025-09-17T22:54:30.335420] [INFO ] [MAIN ] MGRD: Successfully saved derivative data. [2025-09-17T22:54:30.338228] [INFO ] [MAIN ] Derivative Progress: 1176/2085 symbols completed. MGRD took 1.1s. Estimated remaining: 5m 54s. Rate: 154.0 symbols/min [2025-09-17T22:54:30.338851] [INFO ] [MAIN ] MHD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:30.367589] [DEBUG] [LOCAL ] MHD: Loaded 12269 existing records from primary storage. [2025-09-17T22:54:30.368528] [INFO ] [MAIN ] MHD: Loaded 12269 primary data records. [2025-09-17T22:54:30.492364] [DEBUG] [LOCAL ] MGY: Loaded 52448 existing records from primary storage. [2025-09-17T22:54:30.504045] [INFO ] [MAIN ] MGY: Loaded 52448 primary data records. [2025-09-17T22:54:30.539113] [DEBUG] [MAIN ] MGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:30.555309] [INFO ] [MAIN ] MGRE: Generated 1794 derivative records from 6503 primary records. [2025-09-17T22:54:30.593444] [DEBUG] [LOCAL ] MGRE: Saving derivative data. [2025-09-17T22:54:31.074526] [DEBUG] [LOCAL ] MGRE: Derivative data saved (1794 records). [2025-09-17T22:54:31.074983] [INFO ] [MAIN ] MGRE: Successfully saved derivative data. [2025-09-17T22:54:31.077058] [INFO ] [MAIN ] Derivative Progress: 1177/2085 symbols completed. MGRE took 1.1s. Estimated remaining: 5m 54s. Rate: 153.9 symbols/min [2025-09-17T22:54:31.078212] [INFO ] [MAIN ] MHF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:31.092271] [DEBUG] [LOCAL ] MHF: Loaded 8551 existing records from primary storage. [2025-09-17T22:54:31.092398] [INFO ] [MAIN ] MHF: Loaded 8551 primary data records. [2025-09-17T22:54:31.407902] [DEBUG] [MAIN ] MHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:31.408915] [INFO ] [MAIN ] MHD: Generated 1794 derivative records from 12269 primary records. [2025-09-17T22:54:31.421726] [DEBUG] [LOCAL ] MHD: Saving derivative data. [2025-09-17T22:54:31.422729] [DEBUG] [MAIN ] MGY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:31.423713] [INFO ] [MAIN ] MGY: Generated 1794 derivative records from 52448 primary records. [2025-09-17T22:54:31.431877] [DEBUG] [LOCAL ] MGY: Saving derivative data. [2025-09-17T22:54:31.447937] [DEBUG] [LOCAL ] MHD: Derivative data saved (1794 records). [2025-09-17T22:54:31.451673] [INFO ] [MAIN ] MHD: Successfully saved derivative data. [2025-09-17T22:54:31.457068] [INFO ] [MAIN ] Derivative Progress: 1178/2085 symbols completed. MHD took 1.1s. Estimated remaining: 5m 54s. Rate: 153.9 symbols/min [2025-09-17T22:54:31.458317] [INFO ] [MAIN ] MHK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:31.459165] [DEBUG] [LOCAL ] MGY: Derivative data saved (1794 records). [2025-09-17T22:54:31.460282] [INFO ] [MAIN ] MGY: Successfully saved derivative data. [2025-09-17T22:54:31.462896] [INFO ] [MAIN ] Derivative Progress: 1179/2085 symbols completed. MGY took 1.5s. Estimated remaining: 5m 53s. Rate: 154.0 symbols/min [2025-09-17T22:54:31.463334] [INFO ] [MAIN ] MHN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:31.474635] [DEBUG] [LOCAL ] MHN: Loaded 7824 existing records from primary storage. [2025-09-17T22:54:31.475588] [INFO ] [MAIN ] MHN: Loaded 7824 primary data records. [2025-09-17T22:54:31.546276] [DEBUG] [MAIN ] MHF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:31.573850] [INFO ] [MAIN ] MHF: Generated 1794 derivative records from 8551 primary records. [2025-09-17T22:54:31.607792] [DEBUG] [LOCAL ] MHF: Saving derivative data. [2025-09-17T22:54:31.828003] [DEBUG] [LOCAL ] MHK: Loaded 42541 existing records from primary storage. [2025-09-17T22:54:31.828786] [INFO ] [MAIN ] MHK: Loaded 42541 primary data records. [2025-09-17T22:54:31.830575] [DEBUG] [LOCAL ] MHF: Derivative data saved (1794 records). [2025-09-17T22:54:31.830852] [INFO ] [MAIN ] MHF: Successfully saved derivative data. [2025-09-17T22:54:31.833200] [INFO ] [MAIN ] Derivative Progress: 1180/2085 symbols completed. MHF took 0.8s. Estimated remaining: 5m 52s. Rate: 154.0 symbols/min [2025-09-17T22:54:31.890769] [INFO ] [MAIN ] MHO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:32.167265] [DEBUG] [LOCAL ] MHO: Loaded 24450 existing records from primary storage. [2025-09-17T22:54:32.167452] [INFO ] [MAIN ] MHO: Loaded 24450 primary data records. [2025-09-17T22:54:32.384577] [DEBUG] [MAIN ] MHN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:32.550290] [INFO ] [MAIN ] MHN: Generated 1794 derivative records from 7824 primary records. [2025-09-17T22:54:32.551047] [DEBUG] [LOCAL ] MHN: Saving derivative data. [2025-09-17T22:54:32.573244] [DEBUG] [LOCAL ] MHN: Derivative data saved (1794 records). [2025-09-17T22:54:32.573798] [INFO ] [MAIN ] MHN: Successfully saved derivative data. [2025-09-17T22:54:32.576392] [INFO ] [MAIN ] Derivative Progress: 1181/2085 symbols completed. MHN took 1.1s. Estimated remaining: 5m 52s. Rate: 153.9 symbols/min [2025-09-17T22:54:32.585954] [INFO ] [MAIN ] MIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:32.592446] [DEBUG] [MAIN ] MHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:32.594428] [INFO ] [MAIN ] MHK: Generated 1794 derivative records from 42541 primary records. [2025-09-17T22:54:32.594811] [DEBUG] [LOCAL ] MHK: Saving derivative data. [2025-09-17T22:54:32.616313] [DEBUG] [LOCAL ] MHK: Derivative data saved (1794 records). [2025-09-17T22:54:32.616848] [INFO ] [MAIN ] MHK: Successfully saved derivative data. [2025-09-17T22:54:32.620092] [INFO ] [MAIN ] Derivative Progress: 1182/2085 symbols completed. MHK took 1.2s. Estimated remaining: 5m 52s. Rate: 154.0 symbols/min [2025-09-17T22:54:32.626117] [DEBUG] [LOCAL ] MIN: Loaded 13207 existing records from primary storage. [2025-09-17T22:54:32.626827] [INFO ] [MAIN ] MIR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:32.626935] [INFO ] [MAIN ] MIN: Loaded 13207 primary data records. [2025-09-17T22:54:32.762191] [DEBUG] [MAIN ] MHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:32.790987] [INFO ] [MAIN ] MHO: Generated 1794 derivative records from 24450 primary records. [2025-09-17T22:54:32.799784] [DEBUG] [LOCAL ] MHO: Saving derivative data. [2025-09-17T22:54:32.991125] [DEBUG] [LOCAL ] MHO: Derivative data saved (1794 records). [2025-09-17T22:54:32.992296] [INFO ] [MAIN ] MHO: Successfully saved derivative data. [2025-09-17T22:54:32.994732] [INFO ] [MAIN ] Derivative Progress: 1183/2085 symbols completed. MHO took 1.1s. Estimated remaining: 5m 51s. Rate: 154.0 symbols/min [2025-09-17T22:54:32.996810] [DEBUG] [LOCAL ] MIR: Loaded 50776 existing records from primary storage. [2025-09-17T22:54:32.997562] [INFO ] [MAIN ] MIR: Loaded 50776 primary data records. [2025-09-17T22:54:33.322780] [DEBUG] [MAIN ] MIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:33.323917] [INFO ] [MAIN ] MIN: Generated 1794 derivative records from 13207 primary records. [2025-09-17T22:54:33.324359] [DEBUG] [LOCAL ] MIN: Saving derivative data. [2025-09-17T22:54:33.342804] [DEBUG] [LOCAL ] MIN: Derivative data saved (1794 records). [2025-09-17T22:54:33.342942] [INFO ] [MAIN ] MIN: Successfully saved derivative data. [2025-09-17T22:54:33.345884] [INFO ] [MAIN ] Derivative Progress: 1184/2085 symbols completed. MIN took 0.8s. Estimated remaining: 5m 51s. Rate: 154.1 symbols/min [2025-09-17T22:54:33.362630] [DEBUG] [MAIN ] MIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:33.363326] [INFO ] [MAIN ] MIR: Generated 1794 derivative records from 50776 primary records. [2025-09-17T22:54:33.363390] [DEBUG] [LOCAL ] MIR: Saving derivative data. [2025-09-17T22:54:33.380887] [DEBUG] [LOCAL ] MIR: Derivative data saved (1794 records). [2025-09-17T22:54:33.380960] [INFO ] [MAIN ] MIR: Successfully saved derivative data. [2025-09-17T22:54:33.384016] [INFO ] [MAIN ] Derivative Progress: 1185/2085 symbols completed. MIR took 0.8s. Estimated remaining: 5m 50s. Rate: 154.2 symbols/min [2025-09-17T22:54:33.384810] [INFO ] [MAIN ] MITP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:33.384712] [INFO ] [MAIN ] MITT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:33.384866] [INFO ] [MAIN ] MIY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:33.390670] [DEBUG] [LOCAL ] MITP: Loaded 2357 existing records from primary storage. [2025-09-17T22:54:33.390810] [INFO ] [MAIN ] MITP: Loaded 2357 primary data records. [2025-09-17T22:54:33.495373] [DEBUG] [LOCAL ] MIY: Loaded 6046 existing records from primary storage. [2025-09-17T22:54:33.506705] [INFO ] [MAIN ] MIY: Loaded 6046 primary data records. [2025-09-17T22:54:33.604108] [DEBUG] [LOCAL ] MITT: Loaded 23028 existing records from primary storage. [2025-09-17T22:54:33.653533] [INFO ] [MAIN ] MITT: Loaded 23028 primary data records. [2025-09-17T22:54:34.367441] [DEBUG] [MAIN ] MITP: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:54:34.368696] [INFO ] [MAIN ] MITP: Generated 1793 derivative records from 2357 primary records. [2025-09-17T22:54:34.369086] [DEBUG] [LOCAL ] MITP: Saving derivative data. [2025-09-17T22:54:34.388058] [DEBUG] [LOCAL ] MITP: Derivative data saved (1793 records). [2025-09-17T22:54:34.388752] [INFO ] [MAIN ] MITP: Successfully saved derivative data. [2025-09-17T22:54:34.390924] [INFO ] [MAIN ] Derivative Progress: 1186/2085 symbols completed. MITP took 1.0s. Estimated remaining: 5m 50s. Rate: 154.0 symbols/min [2025-09-17T22:54:34.391634] [INFO ] [MAIN ] MKC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:34.406272] [DEBUG] [MAIN ] MIY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:34.407816] [INFO ] [MAIN ] MIY: Generated 1794 derivative records from 6046 primary records. [2025-09-17T22:54:34.408084] [DEBUG] [LOCAL ] MIY: Saving derivative data. [2025-09-17T22:54:34.441888] [DEBUG] [LOCAL ] MIY: Derivative data saved (1794 records). [2025-09-17T22:54:34.442264] [DEBUG] [MAIN ] MITT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:34.442527] [INFO ] [MAIN ] MIY: Successfully saved derivative data. [2025-09-17T22:54:34.446252] [INFO ] [MAIN ] MITT: Generated 1794 derivative records from 23028 primary records. [2025-09-17T22:54:34.445443] [INFO ] [MAIN ] Derivative Progress: 1187/2085 symbols completed. MIY took 1.1s. Estimated remaining: 5m 50s. Rate: 154.1 symbols/min [2025-09-17T22:54:34.446529] [DEBUG] [LOCAL ] MITT: Saving derivative data. [2025-09-17T22:54:34.447488] [INFO ] [MAIN ] MKL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:34.464072] [DEBUG] [LOCAL ] MITT: Derivative data saved (1794 records). [2025-09-17T22:54:34.479031] [INFO ] [MAIN ] MITT: Successfully saved derivative data. [2025-09-17T22:54:34.481763] [INFO ] [MAIN ] Derivative Progress: 1188/2085 symbols completed. MITT took 1.1s. Estimated remaining: 5m 49s. Rate: 154.2 symbols/min [2025-09-17T22:54:34.482119] [INFO ] [MAIN ] MLI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:34.515373] [DEBUG] [LOCAL ] MKC: Loaded 52467 existing records from primary storage. [2025-09-17T22:54:34.515761] [INFO ] [MAIN ] MKC: Loaded 52467 primary data records. [2025-09-17T22:54:34.652847] [DEBUG] [LOCAL ] MKL: Loaded 34327 existing records from primary storage. [2025-09-17T22:54:34.670230] [INFO ] [MAIN ] MKL: Loaded 34327 primary data records. [2025-09-17T22:54:34.764735] [DEBUG] [LOCAL ] MLI: Loaded 43959 existing records from primary storage. [2025-09-17T22:54:34.842833] [INFO ] [MAIN ] MLI: Loaded 43959 primary data records. [2025-09-17T22:54:35.576598] [DEBUG] [MAIN ] MKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:35.577470] [INFO ] [MAIN ] MKC: Generated 1794 derivative records from 52467 primary records. [2025-09-17T22:54:35.577695] [DEBUG] [LOCAL ] MKC: Saving derivative data. [2025-09-17T22:54:35.596252] [DEBUG] [LOCAL ] MKC: Derivative data saved (1794 records). [2025-09-17T22:54:35.597558] [INFO ] [MAIN ] MKC: Successfully saved derivative data. [2025-09-17T22:54:35.600584] [INFO ] [MAIN ] Derivative Progress: 1189/2085 symbols completed. MKC took 1.2s. Estimated remaining: 5m 49s. Rate: 154.0 symbols/min [2025-09-17T22:54:35.602088] [INFO ] [MAIN ] MLM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:35.616149] [DEBUG] [MAIN ] MKL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:35.617204] [INFO ] [MAIN ] MKL: Generated 1794 derivative records from 34327 primary records. [2025-09-17T22:54:35.617339] [DEBUG] [LOCAL ] MKL: Saving derivative data. [2025-09-17T22:54:35.649360] [DEBUG] [MAIN ] MLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:35.650678] [DEBUG] [LOCAL ] MKL: Derivative data saved (1794 records). [2025-09-17T22:54:35.650925] [INFO ] [MAIN ] MKL: Successfully saved derivative data. [2025-09-17T22:54:35.653417] [INFO ] [MAIN ] Derivative Progress: 1190/2085 symbols completed. MKL took 1.2s. Estimated remaining: 5m 49s. Rate: 154.1 symbols/min [2025-09-17T22:54:35.653780] [INFO ] [MAIN ] MLNK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:35.654814] [INFO ] [MAIN ] MLI: Generated 1794 derivative records from 43959 primary records. [2025-09-17T22:54:35.655064] [DEBUG] [LOCAL ] MLI: Saving derivative data. [2025-09-17T22:54:35.693831] [DEBUG] [LOCAL ] MLI: Derivative data saved (1794 records). [2025-09-17T22:54:35.693992] [INFO ] [MAIN ] MLI: Successfully saved derivative data. [2025-09-17T22:54:35.694624] [DEBUG] [LOCAL ] MLM: Loaded 31541 existing records from primary storage. [2025-09-17T22:54:35.697680] [INFO ] [MAIN ] MLM: Loaded 31541 primary data records. [2025-09-17T22:54:35.697531] [INFO ] [MAIN ] Derivative Progress: 1191/2085 symbols completed. MLI took 1.2s. Estimated remaining: 5m 48s. Rate: 154.2 symbols/min [2025-09-17T22:54:35.698178] [INFO ] [MAIN ] MLP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:35.811299] [DEBUG] [LOCAL ] MLP: Loaded 3015 existing records from primary storage. [2025-09-17T22:54:35.830498] [INFO ] [MAIN ] MLP: Loaded 3015 primary data records. [2025-09-17T22:54:35.831222] [DEBUG] [LOCAL ] MLNK: Loaded 25665 existing records from primary storage. [2025-09-17T22:54:35.863146] [INFO ] [MAIN ] MLNK: Loaded 25665 primary data records. [2025-09-17T22:54:36.728203] [DEBUG] [MAIN ] MLM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:36.729075] [INFO ] [MAIN ] MLM: Generated 1794 derivative records from 31541 primary records. [2025-09-17T22:54:36.729310] [DEBUG] [LOCAL ] MLM: Saving derivative data. [2025-09-17T22:54:36.746632] [DEBUG] [LOCAL ] MLM: Derivative data saved (1794 records). [2025-09-17T22:54:36.746960] [INFO ] [MAIN ] MLM: Successfully saved derivative data. [2025-09-17T22:54:36.749217] [INFO ] [MAIN ] Derivative Progress: 1192/2085 symbols completed. MLM took 1.1s. Estimated remaining: 5m 48s. Rate: 154.0 symbols/min [2025-09-17T22:54:36.750573] [INFO ] [MAIN ] MLR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:36.768165] [DEBUG] [MAIN ] MLNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:36.781305] [INFO ] [MAIN ] MLNK: Generated 1794 derivative records from 25665 primary records. [2025-09-17T22:54:36.781715] [DEBUG] [LOCAL ] MLNK: Saving derivative data. [2025-09-17T22:54:36.782236] [DEBUG] [MAIN ] MLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:36.787074] [INFO ] [MAIN ] MLP: Generated 1794 derivative records from 3015 primary records. [2025-09-17T22:54:36.795815] [DEBUG] [LOCAL ] MLP: Saving derivative data. [2025-09-17T22:54:36.803203] [DEBUG] [LOCAL ] MLNK: Derivative data saved (1794 records). [2025-09-17T22:54:36.803488] [INFO ] [MAIN ] MLNK: Successfully saved derivative data. [2025-09-17T22:54:36.811636] [INFO ] [MAIN ] Derivative Progress: 1193/2085 symbols completed. MLNK took 1.2s. Estimated remaining: 5m 47s. Rate: 154.1 symbols/min [2025-09-17T22:54:36.824877] [DEBUG] [LOCAL ] MLP: Derivative data saved (1794 records). [2025-09-17T22:54:36.821084] [DEBUG] [LOCAL ] MLR: Loaded 13118 existing records from primary storage. [2025-09-17T22:54:36.825164] [INFO ] [MAIN ] MMD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:36.825437] [INFO ] [MAIN ] MLP: Successfully saved derivative data. [2025-09-17T22:54:36.825870] [INFO ] [MAIN ] MLR: Loaded 13118 primary data records. [2025-09-17T22:54:36.828410] [INFO ] [MAIN ] Derivative Progress: 1194/2085 symbols completed. MLP took 1.1s. Estimated remaining: 5m 47s. Rate: 154.2 symbols/min [2025-09-17T22:54:36.840420] [INFO ] [MAIN ] MMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:36.957799] [DEBUG] [LOCAL ] MMD: Loaded 11157 existing records from primary storage. [2025-09-17T22:54:36.958044] [INFO ] [MAIN ] MMD: Loaded 11157 primary data records. [2025-09-17T22:54:37.039926] [DEBUG] [LOCAL ] MMI: Loaded 15362 existing records from primary storage. [2025-09-17T22:54:37.064729] [INFO ] [MAIN ] MMI: Loaded 15362 primary data records. [2025-09-17T22:54:37.849672] [DEBUG] [MAIN ] MLR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:37.852335] [INFO ] [MAIN ] MLR: Generated 1794 derivative records from 13118 primary records. [2025-09-17T22:54:37.852532] [DEBUG] [LOCAL ] MLR: Saving derivative data. [2025-09-17T22:54:37.880914] [DEBUG] [MAIN ] MMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:37.883952] [INFO ] [MAIN ] MMD: Generated 1794 derivative records from 11157 primary records. [2025-09-17T22:54:37.885347] [DEBUG] [LOCAL ] MLR: Derivative data saved (1794 records). [2025-09-17T22:54:37.893195] [INFO ] [MAIN ] MLR: Successfully saved derivative data. [2025-09-17T22:54:37.898697] [DEBUG] [LOCAL ] MMD: Saving derivative data. [2025-09-17T22:54:37.901015] [INFO ] [MAIN ] Derivative Progress: 1195/2085 symbols completed. MLR took 1.2s. Estimated remaining: 5m 47s. Rate: 154.0 symbols/min [2025-09-17T22:54:37.902799] [INFO ] [MAIN ] MMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:37.903010] [DEBUG] [MAIN ] MMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:37.904385] [INFO ] [MAIN ] MMI: Generated 1794 derivative records from 15362 primary records. [2025-09-17T22:54:37.904826] [DEBUG] [LOCAL ] MMI: Saving derivative data. [2025-09-17T22:54:37.929017] [DEBUG] [LOCAL ] MMD: Derivative data saved (1794 records). [2025-09-17T22:54:37.931779] [INFO ] [MAIN ] MMD: Successfully saved derivative data. [2025-09-17T22:54:37.937763] [INFO ] [MAIN ] Derivative Progress: 1196/2085 symbols completed. MMD took 1.1s. Estimated remaining: 5m 46s. Rate: 154.1 symbols/min [2025-09-17T22:54:37.939063] [DEBUG] [LOCAL ] MMI: Derivative data saved (1794 records). [2025-09-17T22:54:37.939425] [INFO ] [MAIN ] MMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:37.939310] [INFO ] [MAIN ] MMI: Successfully saved derivative data. [2025-09-17T22:54:37.942548] [INFO ] [MAIN ] Derivative Progress: 1197/2085 symbols completed. MMI took 1.1s. Estimated remaining: 5m 45s. Rate: 154.2 symbols/min [2025-09-17T22:54:37.942999] [INFO ] [MAIN ] MMU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:37.964787] [DEBUG] [LOCAL ] MMT: Loaded 11445 existing records from primary storage. [2025-09-17T22:54:37.965015] [INFO ] [MAIN ] MMT: Loaded 11445 primary data records. [2025-09-17T22:54:38.083076] [DEBUG] [LOCAL ] MMU: Loaded 16992 existing records from primary storage. [2025-09-17T22:54:38.095492] [DEBUG] [LOCAL ] MMS: Loaded 34156 existing records from primary storage. [2025-09-17T22:54:38.094748] [INFO ] [MAIN ] MMU: Loaded 16992 primary data records. [2025-09-17T22:54:38.095790] [INFO ] [MAIN ] MMS: Loaded 34156 primary data records. [2025-09-17T22:54:38.986445] [DEBUG] [MAIN ] MMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:38.987504] [INFO ] [MAIN ] MMT: Generated 1794 derivative records from 11445 primary records. [2025-09-17T22:54:38.987931] [DEBUG] [LOCAL ] MMT: Saving derivative data. [2025-09-17T22:54:39.005758] [DEBUG] [LOCAL ] MMT: Derivative data saved (1794 records). [2025-09-17T22:54:39.007013] [INFO ] [MAIN ] MMT: Successfully saved derivative data. [2025-09-17T22:54:39.010021] [INFO ] [MAIN ] Derivative Progress: 1198/2085 symbols completed. MMT took 1.1s. Estimated remaining: 5m 46s. Rate: 154.0 symbols/min [2025-09-17T22:54:39.024234] [DEBUG] [MAIN ] MMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:39.025257] [INFO ] [MAIN ] MMS: Generated 1794 derivative records from 34156 primary records. [2025-09-17T22:54:39.025417] [DEBUG] [LOCAL ] MMS: Saving derivative data. [2025-09-17T22:54:39.038326] [DEBUG] [MAIN ] MMU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:39.039569] [INFO ] [MAIN ] MMU: Generated 1794 derivative records from 16992 primary records. [2025-09-17T22:54:39.039922] [DEBUG] [LOCAL ] MMU: Saving derivative data. [2025-09-17T22:54:39.069082] [DEBUG] [LOCAL ] MMU: Derivative data saved (1794 records). [2025-09-17T22:54:39.070902] [DEBUG] [LOCAL ] MMS: Derivative data saved (1794 records). [2025-09-17T22:54:39.070990] [INFO ] [MAIN ] MMU: Successfully saved derivative data. [2025-09-17T22:54:39.073933] [INFO ] [MAIN ] MMS: Successfully saved derivative data. [2025-09-17T22:54:39.073829] [INFO ] [MAIN ] Derivative Progress: 1199/2085 symbols completed. MMU took 1.1s. Estimated remaining: 5m 45s. Rate: 154.1 symbols/min [2025-09-17T22:54:39.076939] [INFO ] [MAIN ] Derivative Progress: 1200/2085 symbols completed. MMS took 1.2s. Estimated remaining: 5m 44s. Rate: 154.2 symbols/min [2025-09-17T22:54:39.077465] [INFO ] [MAIN ] MNR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:39.077831] [INFO ] [MAIN ] MODG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:39.077735] [INFO ] [MAIN ] MNSO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:39.109125] [DEBUG] [LOCAL ] MNR: Loaded 24820 existing records from primary storage. [2025-09-17T22:54:39.109280] [INFO ] [MAIN ] MNR: Loaded 24820 primary data records. [2025-09-17T22:54:39.324277] [DEBUG] [LOCAL ] MODG: Loaded 51616 existing records from primary storage. [2025-09-17T22:54:39.380861] [INFO ] [MAIN ] MODG: Loaded 51616 primary data records. [2025-09-17T22:54:39.380722] [DEBUG] [LOCAL ] MNSO: Loaded 44426 existing records from primary storage. [2025-09-17T22:54:39.387239] [INFO ] [MAIN ] MNSO: Loaded 44426 primary data records. [2025-09-17T22:54:40.188620] [DEBUG] [MAIN ] MNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:40.190426] [INFO ] [MAIN ] MNR: Generated 1794 derivative records from 24820 primary records. [2025-09-17T22:54:40.190666] [DEBUG] [LOCAL ] MNR: Saving derivative data. [2025-09-17T22:54:40.212585] [DEBUG] [LOCAL ] MNR: Derivative data saved (1794 records). [2025-09-17T22:54:40.212806] [INFO ] [MAIN ] MNR: Successfully saved derivative data. [2025-09-17T22:54:40.216863] [INFO ] [MAIN ] Derivative Progress: 1201/2085 symbols completed. MNR took 1.1s. Estimated remaining: 5m 44s. Rate: 154.0 symbols/min [2025-09-17T22:54:40.217725] [INFO ] [MAIN ] MOH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:40.231017] [DEBUG] [MAIN ] MODG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:40.232615] [INFO ] [MAIN ] MODG: Generated 1794 derivative records from 51616 primary records. [2025-09-17T22:54:40.232814] [DEBUG] [LOCAL ] MODG: Saving derivative data. [2025-09-17T22:54:40.252313] [DEBUG] [LOCAL ] MODG: Derivative data saved (1794 records). [2025-09-17T22:54:40.252679] [INFO ] [MAIN ] MODG: Successfully saved derivative data. [2025-09-17T22:54:40.268120] [INFO ] [MAIN ] Derivative Progress: 1202/2085 symbols completed. MODG took 1.2s. Estimated remaining: 5m 44s. Rate: 154.1 symbols/min [2025-09-17T22:54:40.269127] [INFO ] [MAIN ] MOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:40.269049] [DEBUG] [MAIN ] MNSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:40.270168] [INFO ] [MAIN ] MNSO: Generated 1794 derivative records from 44426 primary records. [2025-09-17T22:54:40.270680] [DEBUG] [LOCAL ] MNSO: Saving derivative data. [2025-09-17T22:54:40.287670] [DEBUG] [LOCAL ] MNSO: Derivative data saved (1794 records). [2025-09-17T22:54:40.287824] [INFO ] [MAIN ] MNSO: Successfully saved derivative data. [2025-09-17T22:54:40.290629] [INFO ] [MAIN ] Derivative Progress: 1203/2085 symbols completed. MNSO took 1.2s. Estimated remaining: 5m 43s. Rate: 154.2 symbols/min [2025-09-17T22:54:40.291045] [INFO ] [MAIN ] MOV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:40.325443] [DEBUG] [LOCAL ] MOH: Loaded 41783 existing records from primary storage. [2025-09-17T22:54:40.325800] [INFO ] [MAIN ] MOH: Loaded 41783 primary data records. [2025-09-17T22:54:40.441182] [DEBUG] [LOCAL ] MOV: Loaded 22362 existing records from primary storage. [2025-09-17T22:54:40.455320] [INFO ] [MAIN ] MOV: Loaded 22362 primary data records. [2025-09-17T22:54:40.775209] [DEBUG] [LOCAL ] MOS: Loaded 53521 existing records from primary storage. [2025-09-17T22:54:40.782177] [INFO ] [MAIN ] MOS: Loaded 53521 primary data records. [2025-09-17T22:54:41.362724] [DEBUG] [MAIN ] MOH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:41.364115] [INFO ] [MAIN ] MOH: Generated 1794 derivative records from 41783 primary records. [2025-09-17T22:54:41.364311] [DEBUG] [LOCAL ] MOH: Saving derivative data. [2025-09-17T22:54:41.383017] [DEBUG] [LOCAL ] MOH: Derivative data saved (1794 records). [2025-09-17T22:54:41.383257] [INFO ] [MAIN ] MOH: Successfully saved derivative data. [2025-09-17T22:54:41.386772] [INFO ] [MAIN ] Derivative Progress: 1204/2085 symbols completed. MOH took 1.2s. Estimated remaining: 5m 43s. Rate: 154.0 symbols/min [2025-09-17T22:54:41.388687] [INFO ] [MAIN ] MPA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:41.408044] [DEBUG] [MAIN ] MOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:41.409555] [INFO ] [MAIN ] MOV: Generated 1794 derivative records from 22362 primary records. [2025-09-17T22:54:41.409912] [DEBUG] [LOCAL ] MOV: Saving derivative data. [2025-09-17T22:54:41.414168] [DEBUG] [LOCAL ] MPA: Loaded 5255 existing records from primary storage. [2025-09-17T22:54:41.430230] [INFO ] [MAIN ] MPA: Loaded 5255 primary data records. [2025-09-17T22:54:41.570271] [DEBUG] [LOCAL ] MOV: Derivative data saved (1794 records). [2025-09-17T22:54:41.570676] [DEBUG] [MAIN ] MOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:41.576061] [INFO ] [MAIN ] MOV: Successfully saved derivative data. [2025-09-17T22:54:41.641247] [INFO ] [MAIN ] MOS: Generated 1794 derivative records from 53521 primary records. [2025-09-17T22:54:41.671732] [DEBUG] [LOCAL ] MOS: Saving derivative data. [2025-09-17T22:54:41.736200] [INFO ] [MAIN ] Derivative Progress: 1205/2085 symbols completed. MOV took 1.4s. Estimated remaining: 5m 43s. Rate: 154.0 symbols/min [2025-09-17T22:54:41.764518] [INFO ] [MAIN ] MPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:41.783936] [DEBUG] [LOCAL ] MOS: Derivative data saved (1794 records). [2025-09-17T22:54:41.784883] [INFO ] [MAIN ] MOS: Successfully saved derivative data. [2025-09-17T22:54:41.787708] [INFO ] [MAIN ] Derivative Progress: 1206/2085 symbols completed. MOS took 1.5s. Estimated remaining: 5m 42s. Rate: 154.1 symbols/min [2025-09-17T22:54:41.788262] [INFO ] [MAIN ] MPLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:41.811831] [DEBUG] [MAIN ] MPA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:41.812686] [INFO ] [MAIN ] MPA: Generated 1794 derivative records from 5255 primary records. [2025-09-17T22:54:41.812862] [DEBUG] [LOCAL ] MPA: Saving derivative data. [2025-09-17T22:54:41.829798] [DEBUG] [LOCAL ] MPA: Derivative data saved (1794 records). [2025-09-17T22:54:41.830043] [INFO ] [MAIN ] MPA: Successfully saved derivative data. [2025-09-17T22:54:41.832448] [INFO ] [MAIN ] Derivative Progress: 1207/2085 symbols completed. MPA took 0.4s. Estimated remaining: 5m 42s. Rate: 154.2 symbols/min [2025-09-17T22:54:41.832976] [INFO ] [MAIN ] MPV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:41.855559] [DEBUG] [LOCAL ] MPV: Loaded 5203 existing records from primary storage. [2025-09-17T22:54:41.855937] [INFO ] [MAIN ] MPV: Loaded 5203 primary data records. [2025-09-17T22:54:42.000695] [DEBUG] [LOCAL ] MPC: Loaded 52150 existing records from primary storage. [2025-09-17T22:54:42.015179] [INFO ] [MAIN ] MPC: Loaded 52150 primary data records. [2025-09-17T22:54:42.031522] [DEBUG] [LOCAL ] MPLX: Loaded 50795 existing records from primary storage. [2025-09-17T22:54:42.084887] [INFO ] [MAIN ] MPLX: Loaded 50795 primary data records. [2025-09-17T22:54:42.918579] [DEBUG] [MAIN ] MPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:42.919606] [INFO ] [MAIN ] MPV: Generated 1794 derivative records from 5203 primary records. [2025-09-17T22:54:42.919802] [DEBUG] [LOCAL ] MPV: Saving derivative data. [2025-09-17T22:54:42.938752] [DEBUG] [LOCAL ] MPV: Derivative data saved (1794 records). [2025-09-17T22:54:42.939205] [INFO ] [MAIN ] MPV: Successfully saved derivative data. [2025-09-17T22:54:42.941460] [INFO ] [MAIN ] Derivative Progress: 1208/2085 symbols completed. MPV took 1.1s. Estimated remaining: 5m 42s. Rate: 154.0 symbols/min [2025-09-17T22:54:42.942014] [INFO ] [MAIN ] MPW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:42.955317] [DEBUG] [MAIN ] MPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:42.956266] [INFO ] [MAIN ] MPC: Generated 1794 derivative records from 52150 primary records. [2025-09-17T22:54:42.956502] [DEBUG] [LOCAL ] MPC: Saving derivative data. [2025-09-17T22:54:42.975674] [DEBUG] [LOCAL ] MPC: Derivative data saved (1794 records). [2025-09-17T22:54:42.976012] [INFO ] [MAIN ] MPC: Successfully saved derivative data. [2025-09-17T22:54:42.978585] [INFO ] [MAIN ] Derivative Progress: 1209/2085 symbols completed. MPC took 1.2s. Estimated remaining: 5m 41s. Rate: 154.1 symbols/min [2025-09-17T22:54:42.986526] [INFO ] [MAIN ] MPX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:42.991870] [DEBUG] [MAIN ] MPLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:42.992908] [INFO ] [MAIN ] MPLX: Generated 1794 derivative records from 50795 primary records. [2025-09-17T22:54:42.993454] [DEBUG] [LOCAL ] MPLX: Saving derivative data. [2025-09-17T22:54:43.012066] [DEBUG] [LOCAL ] MPLX: Derivative data saved (1794 records). [2025-09-17T22:54:43.015020] [DEBUG] [LOCAL ] MPX: Loaded 4290 existing records from primary storage. [2025-09-17T22:54:43.015171] [INFO ] [MAIN ] MPX: Loaded 4290 primary data records. [2025-09-17T22:54:43.015108] [INFO ] [MAIN ] MPLX: Successfully saved derivative data. [2025-09-17T22:54:43.017886] [INFO ] [MAIN ] Derivative Progress: 1210/2085 symbols completed. MPLX took 1.2s. Estimated remaining: 5m 40s. Rate: 154.2 symbols/min [2025-09-17T22:54:43.024011] [INFO ] [MAIN ] MQT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:43.163805] [DEBUG] [LOCAL ] MQT: Loaded 8445 existing records from primary storage. [2025-09-17T22:54:43.189451] [INFO ] [MAIN ] MQT: Loaded 8445 primary data records. [2025-09-17T22:54:43.273851] [DEBUG] [LOCAL ] MPW: Loaded 53501 existing records from primary storage. [2025-09-17T22:54:43.415219] [INFO ] [MAIN ] MPW: Loaded 53501 primary data records. [2025-09-17T22:54:44.011232] [DEBUG] [MAIN ] MPX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:44.012364] [INFO ] [MAIN ] MPX: Generated 1794 derivative records from 4290 primary records. [2025-09-17T22:54:44.014010] [DEBUG] [LOCAL ] MPX: Saving derivative data. [2025-09-17T22:54:44.030666] [DEBUG] [LOCAL ] MPX: Derivative data saved (1794 records). [2025-09-17T22:54:44.031800] [INFO ] [MAIN ] MPX: Successfully saved derivative data. [2025-09-17T22:54:44.033907] [INFO ] [MAIN ] Derivative Progress: 1211/2085 symbols completed. MPX took 1.0s. Estimated remaining: 5m 41s. Rate: 154.0 symbols/min [2025-09-17T22:54:44.035244] [INFO ] [MAIN ] MQY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:44.050057] [DEBUG] [MAIN ] MQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:44.050913] [INFO ] [MAIN ] MQT: Generated 1794 derivative records from 8445 primary records. [2025-09-17T22:54:44.051137] [DEBUG] [LOCAL ] MQT: Saving derivative data. [2025-09-17T22:54:44.083789] [DEBUG] [MAIN ] MPW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:44.085050] [INFO ] [MAIN ] MPW: Generated 1794 derivative records from 53501 primary records. [2025-09-17T22:54:44.085832] [DEBUG] [LOCAL ] MPW: Saving derivative data. [2025-09-17T22:54:44.093487] [DEBUG] [LOCAL ] MQT: Derivative data saved (1794 records). [2025-09-17T22:54:44.100801] [DEBUG] [LOCAL ] MQY: Loaded 16811 existing records from primary storage. [2025-09-17T22:54:44.100429] [INFO ] [MAIN ] MQT: Successfully saved derivative data. [2025-09-17T22:54:44.104539] [INFO ] [MAIN ] Derivative Progress: 1212/2085 symbols completed. MQT took 1.1s. Estimated remaining: 5m 40s. Rate: 154.1 symbols/min [2025-09-17T22:54:44.101673] [INFO ] [MAIN ] MQY: Loaded 16811 primary data records. [2025-09-17T22:54:44.104844] [INFO ] [MAIN ] MRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:44.269721] [DEBUG] [LOCAL ] MPW: Derivative data saved (1794 records). [2025-09-17T22:54:44.309603] [INFO ] [MAIN ] MPW: Successfully saved derivative data. [2025-09-17T22:54:44.313141] [INFO ] [MAIN ] Derivative Progress: 1213/2085 symbols completed. MPW took 1.4s. Estimated remaining: 5m 39s. Rate: 154.2 symbols/min [2025-09-17T22:54:44.450844] [DEBUG] [LOCAL ] MRC: Loaded 37525 existing records from primary storage. [2025-09-17T22:54:44.451680] [INFO ] [MAIN ] MRC: Loaded 37525 primary data records. [2025-09-17T22:54:44.821667] [DEBUG] [MAIN ] MQY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:44.822483] [INFO ] [MAIN ] MQY: Generated 1794 derivative records from 16811 primary records. [2025-09-17T22:54:44.822903] [DEBUG] [LOCAL ] MQY: Saving derivative data. [2025-09-17T22:54:44.839867] [DEBUG] [LOCAL ] MQY: Derivative data saved (1794 records). [2025-09-17T22:54:44.840070] [INFO ] [MAIN ] MQY: Successfully saved derivative data. [2025-09-17T22:54:44.842273] [INFO ] [MAIN ] Derivative Progress: 1214/2085 symbols completed. MQY took 0.8s. Estimated remaining: 5m 39s. Rate: 154.1 symbols/min [2025-09-17T22:54:44.859752] [DEBUG] [MAIN ] MRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:44.860285] [INFO ] [MAIN ] MRC: Generated 1794 derivative records from 37525 primary records. [2025-09-17T22:54:44.860344] [DEBUG] [LOCAL ] MRC: Saving derivative data. [2025-09-17T22:54:44.875957] [DEBUG] [LOCAL ] MRC: Derivative data saved (1794 records). [2025-09-17T22:54:44.876017] [INFO ] [MAIN ] MRC: Successfully saved derivative data. [2025-09-17T22:54:44.878386] [INFO ] [MAIN ] Derivative Progress: 1215/2085 symbols completed. MRC took 0.8s. Estimated remaining: 5m 38s. Rate: 154.2 symbols/min [2025-09-17T22:54:44.878985] [INFO ] [MAIN ] MS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:44.879176] [INFO ] [MAIN ] MSB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:44.879341] [INFO ] [MAIN ] MSA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:44.899198] [DEBUG] [LOCAL ] MSB: Loaded 7917 existing records from primary storage. [2025-09-17T22:54:44.899403] [INFO ] [MAIN ] MSB: Loaded 7917 primary data records. [2025-09-17T22:54:44.956762] [DEBUG] [LOCAL ] MSA: Loaded 18774 existing records from primary storage. [2025-09-17T22:54:44.986261] [INFO ] [MAIN ] MSA: Loaded 18774 primary data records. [2025-09-17T22:54:45.287390] [DEBUG] [LOCAL ] MS: Loaded 53696 existing records from primary storage. [2025-09-17T22:54:45.426217] [INFO ] [MAIN ] MS: Loaded 53696 primary data records. [2025-09-17T22:54:45.917814] [DEBUG] [MAIN ] MSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:45.919086] [INFO ] [MAIN ] MSA: Generated 1794 derivative records from 18774 primary records. [2025-09-17T22:54:45.918253] [DEBUG] [MAIN ] MSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:45.919186] [DEBUG] [LOCAL ] MSA: Saving derivative data. [2025-09-17T22:54:45.920794] [INFO ] [MAIN ] MSB: Generated 1794 derivative records from 7917 primary records. [2025-09-17T22:54:45.921049] [DEBUG] [LOCAL ] MSB: Saving derivative data. [2025-09-17T22:54:45.937214] [DEBUG] [LOCAL ] MSA: Derivative data saved (1794 records). [2025-09-17T22:54:45.937532] [INFO ] [MAIN ] MSA: Successfully saved derivative data. [2025-09-17T22:54:45.947035] [INFO ] [MAIN ] Derivative Progress: 1216/2085 symbols completed. MSA took 1.1s. Estimated remaining: 5m 39s. Rate: 154.0 symbols/min [2025-09-17T22:54:45.950934] [INFO ] [MAIN ] MSCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:45.958419] [DEBUG] [LOCAL ] MSB: Derivative data saved (1794 records). [2025-09-17T22:54:45.958684] [INFO ] [MAIN ] MSB: Successfully saved derivative data. [2025-09-17T22:54:45.960884] [INFO ] [MAIN ] Derivative Progress: 1217/2085 symbols completed. MSB took 1.1s. Estimated remaining: 5m 38s. Rate: 154.1 symbols/min [2025-09-17T22:54:45.973527] [INFO ] [MAIN ] MSD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:45.974155] [DEBUG] [MAIN ] MS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:45.975363] [INFO ] [MAIN ] MS: Generated 1794 derivative records from 53696 primary records. [2025-09-17T22:54:45.975483] [DEBUG] [LOCAL ] MS: Saving derivative data. [2025-09-17T22:54:45.993352] [DEBUG] [LOCAL ] MS: Derivative data saved (1794 records). [2025-09-17T22:54:45.993472] [INFO ] [MAIN ] MS: Successfully saved derivative data. [2025-09-17T22:54:45.996122] [INFO ] [MAIN ] Derivative Progress: 1218/2085 symbols completed. MS took 1.1s. Estimated remaining: 5m 37s. Rate: 154.3 symbols/min [2025-09-17T22:54:45.996580] [INFO ] [MAIN ] MSDL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:46.008925] [DEBUG] [LOCAL ] MSD: Loaded 15677 existing records from primary storage. [2025-09-17T22:54:46.009061] [INFO ] [MAIN ] MSD: Loaded 15677 primary data records. [2025-09-17T22:54:46.146155] [DEBUG] [LOCAL ] MSCI: Loaded 34787 existing records from primary storage. [2025-09-17T22:54:46.157404] [INFO ] [MAIN ] MSCI: Loaded 34787 primary data records. [2025-09-17T22:54:46.463968] [DEBUG] [LOCAL ] MSDL: Loaded 38113 existing records from primary storage. [2025-09-17T22:54:46.481750] [INFO ] [MAIN ] MSDL: Loaded 38113 primary data records. [2025-09-17T22:54:47.104832] [DEBUG] [MAIN ] MSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:47.106596] [INFO ] [MAIN ] MSD: Generated 1794 derivative records from 15677 primary records. [2025-09-17T22:54:47.108594] [DEBUG] [LOCAL ] MSD: Saving derivative data. [2025-09-17T22:54:47.136207] [DEBUG] [MAIN ] MSCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:47.138463] [INFO ] [MAIN ] MSCI: Generated 1794 derivative records from 34787 primary records. [2025-09-17T22:54:47.139842] [DEBUG] [LOCAL ] MSD: Derivative data saved (1794 records). [2025-09-17T22:54:47.140146] [INFO ] [MAIN ] MSD: Successfully saved derivative data. [2025-09-17T22:54:47.143108] [INFO ] [MAIN ] Derivative Progress: 1219/2085 symbols completed. MSD took 1.2s. Estimated remaining: 5m 37s. Rate: 154.0 symbols/min [2025-09-17T22:54:47.143431] [INFO ] [MAIN ] MSGE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:47.140400] [DEBUG] [LOCAL ] MSCI: Saving derivative data. [2025-09-17T22:54:47.160619] [DEBUG] [LOCAL ] MSCI: Derivative data saved (1794 records). [2025-09-17T22:54:47.160957] [INFO ] [MAIN ] MSCI: Successfully saved derivative data. [2025-09-17T22:54:47.163478] [INFO ] [MAIN ] Derivative Progress: 1220/2085 symbols completed. MSCI took 1.2s. Estimated remaining: 5m 37s. Rate: 154.1 symbols/min [2025-09-17T22:54:47.166208] [INFO ] [MAIN ] MSGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:47.182200] [DEBUG] [MAIN ] MSDL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:47.183275] [INFO ] [MAIN ] MSDL: Generated 1794 derivative records from 38113 primary records. [2025-09-17T22:54:47.183453] [DEBUG] [LOCAL ] MSDL: Saving derivative data. [2025-09-17T22:54:47.208756] [DEBUG] [LOCAL ] MSDL: Derivative data saved (1794 records). [2025-09-17T22:54:47.212764] [INFO ] [MAIN ] MSDL: Successfully saved derivative data. [2025-09-17T22:54:47.215924] [INFO ] [MAIN ] Derivative Progress: 1221/2085 symbols completed. MSDL took 1.2s. Estimated remaining: 5m 36s. Rate: 154.2 symbols/min [2025-09-17T22:54:47.216860] [INFO ] [MAIN ] MSI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:47.232776] [DEBUG] [LOCAL ] MSGS: Loaded 16784 existing records from primary storage. [2025-09-17T22:54:47.232952] [INFO ] [MAIN ] MSGS: Loaded 16784 primary data records. [2025-09-17T22:54:47.245129] [DEBUG] [LOCAL ] MSGE: Loaded 27040 existing records from primary storage. [2025-09-17T22:54:47.255162] [INFO ] [MAIN ] MSGE: Loaded 27040 primary data records. [2025-09-17T22:54:47.886391] [DEBUG] [LOCAL ] MSI: Loaded 40671 existing records from primary storage. [2025-09-17T22:54:47.886693] [INFO ] [MAIN ] MSI: Loaded 40671 primary data records. [2025-09-17T22:54:48.237959] [DEBUG] [MAIN ] MSGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:48.252294] [INFO ] [MAIN ] MSGE: Generated 1794 derivative records from 27040 primary records. [2025-09-17T22:54:48.252636] [DEBUG] [LOCAL ] MSGE: Saving derivative data. [2025-09-17T22:54:48.252900] [DEBUG] [MAIN ] MSGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:48.254689] [INFO ] [MAIN ] MSGS: Generated 1794 derivative records from 16784 primary records. [2025-09-17T22:54:48.255415] [DEBUG] [LOCAL ] MSGS: Saving derivative data. [2025-09-17T22:54:48.284919] [DEBUG] [LOCAL ] MSGE: Derivative data saved (1794 records). [2025-09-17T22:54:48.285072] [INFO ] [MAIN ] MSGE: Successfully saved derivative data. [2025-09-17T22:54:48.288373] [INFO ] [MAIN ] Derivative Progress: 1222/2085 symbols completed. MSGE took 1.1s. Estimated remaining: 5m 36s. Rate: 154.0 symbols/min [2025-09-17T22:54:48.288798] [INFO ] [MAIN ] MSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:48.308124] [DEBUG] [MAIN ] MSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:48.309176] [INFO ] [MAIN ] MSI: Generated 1794 derivative records from 40671 primary records. [2025-09-17T22:54:48.309348] [DEBUG] [LOCAL ] MSI: Saving derivative data. [2025-09-17T22:54:48.310926] [DEBUG] [LOCAL ] MSGS: Derivative data saved (1794 records). [2025-09-17T22:54:48.318262] [INFO ] [MAIN ] MSGS: Successfully saved derivative data. [2025-09-17T22:54:48.324518] [INFO ] [MAIN ] Derivative Progress: 1223/2085 symbols completed. MSGS took 1.2s. Estimated remaining: 5m 36s. Rate: 154.1 symbols/min [2025-09-17T22:54:48.327163] [INFO ] [MAIN ] MT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:48.329228] [DEBUG] [LOCAL ] MSI: Derivative data saved (1794 records). [2025-09-17T22:54:48.329759] [INFO ] [MAIN ] MSI: Successfully saved derivative data. [2025-09-17T22:54:48.332269] [INFO ] [MAIN ] Derivative Progress: 1224/2085 symbols completed. MSI took 1.1s. Estimated remaining: 5m 35s. Rate: 154.3 symbols/min [2025-09-17T22:54:48.332473] [INFO ] [MAIN ] MTAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:48.369265] [DEBUG] [LOCAL ] MSM: Loaded 35320 existing records from primary storage. [2025-09-17T22:54:48.369416] [INFO ] [MAIN ] MSM: Loaded 35320 primary data records. [2025-09-17T22:54:48.512159] [DEBUG] [LOCAL ] MTAL: Loaded 36124 existing records from primary storage. [2025-09-17T22:54:48.535947] [INFO ] [MAIN ] MTAL: Loaded 36124 primary data records. [2025-09-17T22:54:48.792513] [DEBUG] [LOCAL ] MT: Loaded 50868 existing records from primary storage. [2025-09-17T22:54:48.821019] [INFO ] [MAIN ] MT: Loaded 50868 primary data records. [2025-09-17T22:54:49.439486] [DEBUG] [MAIN ] MSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:49.440523] [INFO ] [MAIN ] MSM: Generated 1794 derivative records from 35320 primary records. [2025-09-17T22:54:49.440978] [DEBUG] [LOCAL ] MSM: Saving derivative data. [2025-09-17T22:54:49.458818] [DEBUG] [LOCAL ] MSM: Derivative data saved (1794 records). [2025-09-17T22:54:49.460799] [INFO ] [MAIN ] MSM: Successfully saved derivative data. [2025-09-17T22:54:49.463375] [INFO ] [MAIN ] Derivative Progress: 1225/2085 symbols completed. MSM took 1.2s. Estimated remaining: 5m 35s. Rate: 154.0 symbols/min [2025-09-17T22:54:49.463997] [INFO ] [MAIN ] MTB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:49.478874] [DEBUG] [MAIN ] MTAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:49.481033] [INFO ] [MAIN ] MTAL: Generated 1794 derivative records from 36124 primary records. [2025-09-17T22:54:49.482764] [DEBUG] [LOCAL ] MTAL: Saving derivative data. [2025-09-17T22:54:49.509753] [DEBUG] [MAIN ] MT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:49.511387] [INFO ] [MAIN ] MT: Generated 1794 derivative records from 50868 primary records. [2025-09-17T22:54:49.511868] [DEBUG] [LOCAL ] MT: Saving derivative data. [2025-09-17T22:54:49.529667] [DEBUG] [LOCAL ] MTAL: Derivative data saved (1794 records). [2025-09-17T22:54:49.532602] [DEBUG] [LOCAL ] MT: Derivative data saved (1794 records). [2025-09-17T22:54:49.533054] [INFO ] [MAIN ] MTAL: Successfully saved derivative data. [2025-09-17T22:54:49.535561] [INFO ] [MAIN ] Derivative Progress: 1226/2085 symbols completed. MTAL took 1.2s. Estimated remaining: 5m 34s. Rate: 154.1 symbols/min [2025-09-17T22:54:49.532939] [INFO ] [MAIN ] MT: Successfully saved derivative data. [2025-09-17T22:54:49.536004] [INFO ] [MAIN ] MTD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:49.539425] [INFO ] [MAIN ] Derivative Progress: 1227/2085 symbols completed. MT took 1.2s. Estimated remaining: 5m 34s. Rate: 154.2 symbols/min [2025-09-17T22:54:49.540228] [INFO ] [MAIN ] MTDR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:49.568126] [DEBUG] [LOCAL ] MTD: Loaded 15361 existing records from primary storage. [2025-09-17T22:54:49.568395] [INFO ] [MAIN ] MTD: Loaded 15361 primary data records. [2025-09-17T22:54:49.641690] [DEBUG] [LOCAL ] MTB: Loaded 47240 existing records from primary storage. [2025-09-17T22:54:49.663669] [INFO ] [MAIN ] MTB: Loaded 47240 primary data records. [2025-09-17T22:54:50.086360] [DEBUG] [LOCAL ] MTDR: Loaded 51586 existing records from primary storage. [2025-09-17T22:54:50.106883] [INFO ] [MAIN ] MTDR: Loaded 51586 primary data records. [2025-09-17T22:54:50.619622] [DEBUG] [MAIN ] MTD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:50.621023] [INFO ] [MAIN ] MTD: Generated 1794 derivative records from 15361 primary records. [2025-09-17T22:54:50.621378] [DEBUG] [LOCAL ] MTD: Saving derivative data. [2025-09-17T22:54:50.653537] [DEBUG] [LOCAL ] MTD: Derivative data saved (1794 records). [2025-09-17T22:54:50.654319] [INFO ] [MAIN ] MTD: Successfully saved derivative data. [2025-09-17T22:54:50.657054] [INFO ] [MAIN ] Derivative Progress: 1228/2085 symbols completed. MTD took 1.1s. Estimated remaining: 5m 34s. Rate: 154.0 symbols/min [2025-09-17T22:54:50.670946] [DEBUG] [MAIN ] MTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:50.671832] [INFO ] [MAIN ] MTB: Generated 1794 derivative records from 47240 primary records. [2025-09-17T22:54:50.672040] [DEBUG] [LOCAL ] MTB: Saving derivative data. [2025-09-17T22:54:50.691726] [DEBUG] [LOCAL ] MTB: Derivative data saved (1794 records). [2025-09-17T22:54:50.691909] [INFO ] [MAIN ] MTB: Successfully saved derivative data. [2025-09-17T22:54:50.694378] [INFO ] [MAIN ] Derivative Progress: 1229/2085 symbols completed. MTB took 1.2s. Estimated remaining: 5m 33s. Rate: 154.1 symbols/min [2025-09-17T22:54:50.707005] [DEBUG] [MAIN ] MTDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:50.707891] [INFO ] [MAIN ] MTDR: Generated 1794 derivative records from 51586 primary records. [2025-09-17T22:54:50.707962] [DEBUG] [LOCAL ] MTDR: Saving derivative data. [2025-09-17T22:54:50.724438] [DEBUG] [LOCAL ] MTDR: Derivative data saved (1794 records). [2025-09-17T22:54:50.724575] [INFO ] [MAIN ] MTDR: Successfully saved derivative data. [2025-09-17T22:54:50.727852] [INFO ] [MAIN ] Derivative Progress: 1230/2085 symbols completed. MTDR took 1.2s. Estimated remaining: 5m 33s. Rate: 154.2 symbols/min [2025-09-17T22:54:50.728850] [INFO ] [MAIN ] MTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:50.729132] [INFO ] [MAIN ] MTN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:50.729238] [INFO ] [MAIN ] MTH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:50.805481] [DEBUG] [LOCAL ] MTH: Loaded 43964 existing records from primary storage. [2025-09-17T22:54:50.806364] [DEBUG] [LOCAL ] MTN: Loaded 39038 existing records from primary storage. [2025-09-17T22:54:50.805691] [INFO ] [MAIN ] MTH: Loaded 43964 primary data records. [2025-09-17T22:54:50.807094] [INFO ] [MAIN ] MTN: Loaded 39038 primary data records. [2025-09-17T22:54:50.992623] [DEBUG] [LOCAL ] MTG: Loaded 51357 existing records from primary storage. [2025-09-17T22:54:51.029804] [INFO ] [MAIN ] MTG: Loaded 51357 primary data records. [2025-09-17T22:54:51.874066] [DEBUG] [MAIN ] MTH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:51.873609] [DEBUG] [MAIN ] MTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:51.875315] [INFO ] [MAIN ] MTH: Generated 1794 derivative records from 43964 primary records. [2025-09-17T22:54:51.876352] [INFO ] [MAIN ] MTN: Generated 1794 derivative records from 39038 primary records. [2025-09-17T22:54:51.876453] [DEBUG] [LOCAL ] MTH: Saving derivative data. [2025-09-17T22:54:51.876542] [DEBUG] [LOCAL ] MTN: Saving derivative data. [2025-09-17T22:54:51.917785] [DEBUG] [LOCAL ] MTH: Derivative data saved (1794 records). [2025-09-17T22:54:51.918902] [INFO ] [MAIN ] MTH: Successfully saved derivative data. [2025-09-17T22:54:51.921185] [INFO ] [MAIN ] Derivative Progress: 1231/2085 symbols completed. MTH took 1.2s. Estimated remaining: 5m 33s. Rate: 154.0 symbols/min [2025-09-17T22:54:51.921906] [INFO ] [MAIN ] MTRN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:51.922513] [DEBUG] [MAIN ] MTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:51.924021] [INFO ] [MAIN ] MTG: Generated 1794 derivative records from 51357 primary records. [2025-09-17T22:54:51.924662] [DEBUG] [LOCAL ] MTG: Saving derivative data. [2025-09-17T22:54:51.927077] [DEBUG] [LOCAL ] MTN: Derivative data saved (1794 records). [2025-09-17T22:54:51.927373] [INFO ] [MAIN ] MTN: Successfully saved derivative data. [2025-09-17T22:54:51.943831] [INFO ] [MAIN ] Derivative Progress: 1232/2085 symbols completed. MTN took 1.2s. Estimated remaining: 5m 32s. Rate: 154.1 symbols/min [2025-09-17T22:54:51.945328] [DEBUG] [LOCAL ] MTG: Derivative data saved (1794 records). [2025-09-17T22:54:51.945386] [INFO ] [MAIN ] MTUS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:51.945666] [INFO ] [MAIN ] MTG: Successfully saved derivative data. [2025-09-17T22:54:51.948388] [INFO ] [MAIN ] Derivative Progress: 1233/2085 symbols completed. MTG took 1.2s. Estimated remaining: 5m 31s. Rate: 154.2 symbols/min [2025-09-17T22:54:51.948727] [INFO ] [MAIN ] MTW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:51.964175] [DEBUG] [LOCAL ] MTRN: Loaded 17880 existing records from primary storage. [2025-09-17T22:54:51.964435] [INFO ] [MAIN ] MTRN: Loaded 17880 primary data records. [2025-09-17T22:54:52.091188] [DEBUG] [LOCAL ] MTW: Loaded 26664 existing records from primary storage. [2025-09-17T22:54:52.096901] [INFO ] [MAIN ] MTW: Loaded 26664 primary data records. [2025-09-17T22:54:52.245998] [DEBUG] [LOCAL ] MTUS: Loaded 29010 existing records from primary storage. [2025-09-17T22:54:52.351322] [INFO ] [MAIN ] MTUS: Loaded 29010 primary data records. [2025-09-17T22:54:53.005267] [DEBUG] [MAIN ] MTRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:53.006287] [INFO ] [MAIN ] MTRN: Generated 1794 derivative records from 17880 primary records. [2025-09-17T22:54:53.006562] [DEBUG] [LOCAL ] MTRN: Saving derivative data. [2025-09-17T22:54:53.027668] [DEBUG] [LOCAL ] MTRN: Derivative data saved (1794 records). [2025-09-17T22:54:53.028935] [INFO ] [MAIN ] MTRN: Successfully saved derivative data. [2025-09-17T22:54:53.030992] [INFO ] [MAIN ] Derivative Progress: 1234/2085 symbols completed. MTRN took 1.1s. Estimated remaining: 5m 32s. Rate: 154.0 symbols/min [2025-09-17T22:54:53.037561] [INFO ] [MAIN ] MTX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:53.052952] [DEBUG] [MAIN ] MTW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:53.054098] [INFO ] [MAIN ] MTW: Generated 1794 derivative records from 26664 primary records. [2025-09-17T22:54:53.055338] [DEBUG] [LOCAL ] MTW: Saving derivative data. [2025-09-17T22:54:53.089995] [DEBUG] [MAIN ] MTUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:53.091931] [INFO ] [MAIN ] MTUS: Generated 1794 derivative records from 29010 primary records. [2025-09-17T22:54:53.098892] [DEBUG] [LOCAL ] MTUS: Saving derivative data. [2025-09-17T22:54:53.102457] [DEBUG] [LOCAL ] MTW: Derivative data saved (1794 records). [2025-09-17T22:54:53.110897] [INFO ] [MAIN ] MTW: Successfully saved derivative data. [2025-09-17T22:54:53.116829] [INFO ] [MAIN ] Derivative Progress: 1235/2085 symbols completed. MTW took 1.2s. Estimated remaining: 5m 31s. Rate: 154.1 symbols/min [2025-09-17T22:54:53.125089] [INFO ] [MAIN ] MTZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:53.126907] [DEBUG] [LOCAL ] MTX: Loaded 22852 existing records from primary storage. [2025-09-17T22:54:53.128095] [INFO ] [MAIN ] MTX: Loaded 22852 primary data records. [2025-09-17T22:54:53.191715] [DEBUG] [LOCAL ] MTUS: Derivative data saved (1794 records). [2025-09-17T22:54:53.219122] [INFO ] [MAIN ] MTUS: Successfully saved derivative data. [2025-09-17T22:54:53.245285] [INFO ] [MAIN ] Derivative Progress: 1236/2085 symbols completed. MTUS took 1.3s. Estimated remaining: 5m 30s. Rate: 154.2 symbols/min [2025-09-17T22:54:53.246131] [INFO ] [MAIN ] MUA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:53.469452] [DEBUG] [LOCAL ] MUA: Loaded 12449 existing records from primary storage. [2025-09-17T22:54:53.469666] [INFO ] [MAIN ] MUA: Loaded 12449 primary data records. [2025-09-17T22:54:53.595931] [DEBUG] [LOCAL ] MTZ: Loaded 43609 existing records from primary storage. [2025-09-17T22:54:53.606847] [INFO ] [MAIN ] MTZ: Loaded 43609 primary data records. [2025-09-17T22:54:54.138879] [DEBUG] [MAIN ] MTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:54.140957] [INFO ] [MAIN ] MTX: Generated 1794 derivative records from 22852 primary records. [2025-09-17T22:54:54.141277] [DEBUG] [LOCAL ] MTX: Saving derivative data. [2025-09-17T22:54:54.161204] [DEBUG] [LOCAL ] MTX: Derivative data saved (1794 records). [2025-09-17T22:54:54.161429] [INFO ] [MAIN ] MTX: Successfully saved derivative data. [2025-09-17T22:54:54.163610] [INFO ] [MAIN ] Derivative Progress: 1237/2085 symbols completed. MTX took 1.1s. Estimated remaining: 5m 30s. Rate: 154.0 symbols/min [2025-09-17T22:54:54.166850] [INFO ] [MAIN ] MUC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:54.182020] [DEBUG] [MAIN ] MUA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:54.182820] [INFO ] [MAIN ] MUA: Generated 1794 derivative records from 12449 primary records. [2025-09-17T22:54:54.182959] [DEBUG] [LOCAL ] MUA: Saving derivative data. [2025-09-17T22:54:54.201952] [DEBUG] [LOCAL ] MUA: Derivative data saved (1794 records). [2025-09-17T22:54:54.202259] [INFO ] [MAIN ] MUA: Successfully saved derivative data. [2025-09-17T22:54:54.204561] [INFO ] [MAIN ] Derivative Progress: 1238/2085 symbols completed. MUA took 1.0s. Estimated remaining: 5m 30s. Rate: 154.1 symbols/min [2025-09-17T22:54:54.210921] [INFO ] [MAIN ] MUE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:54.235165] [DEBUG] [LOCAL ] MUC: Loaded 20141 existing records from primary storage. [2025-09-17T22:54:54.234707] [DEBUG] [MAIN ] MTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:54.235415] [INFO ] [MAIN ] MUC: Loaded 20141 primary data records. [2025-09-17T22:54:54.236353] [INFO ] [MAIN ] MTZ: Generated 1794 derivative records from 43609 primary records. [2025-09-17T22:54:54.236674] [DEBUG] [LOCAL ] MTZ: Saving derivative data. [2025-09-17T22:54:54.350333] [DEBUG] [LOCAL ] MUE: Loaded 11938 existing records from primary storage. [2025-09-17T22:54:54.362077] [INFO ] [MAIN ] MUE: Loaded 11938 primary data records. [2025-09-17T22:54:54.706821] [DEBUG] [LOCAL ] MTZ: Derivative data saved (1794 records). [2025-09-17T22:54:54.712737] [INFO ] [MAIN ] MTZ: Successfully saved derivative data. [2025-09-17T22:54:54.727403] [INFO ] [MAIN ] Derivative Progress: 1239/2085 symbols completed. MTZ took 1.6s. Estimated remaining: 5m 29s. Rate: 154.1 symbols/min [2025-09-17T22:54:54.751901] [INFO ] [MAIN ] MUFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:54.958603] [DEBUG] [MAIN ] MUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:54.959634] [INFO ] [MAIN ] MUC: Generated 1794 derivative records from 20141 primary records. [2025-09-17T22:54:54.959963] [DEBUG] [LOCAL ] MUC: Saving derivative data. [2025-09-17T22:54:54.977462] [DEBUG] [LOCAL ] MUC: Derivative data saved (1794 records). [2025-09-17T22:54:54.977752] [INFO ] [MAIN ] MUC: Successfully saved derivative data. [2025-09-17T22:54:54.980775] [INFO ] [MAIN ] Derivative Progress: 1240/2085 symbols completed. MUC took 0.8s. Estimated remaining: 5m 29s. Rate: 154.1 symbols/min [2025-09-17T22:54:54.981390] [INFO ] [MAIN ] MUJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:55.000974] [DEBUG] [LOCAL ] MUFG: Loaded 52665 existing records from primary storage. [2025-09-17T22:54:55.014852] [INFO ] [MAIN ] MUFG: Loaded 52665 primary data records. [2025-09-17T22:54:55.015622] [DEBUG] [MAIN ] MUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:55.052118] [INFO ] [MAIN ] MUE: Generated 1794 derivative records from 11938 primary records. [2025-09-17T22:54:55.057859] [DEBUG] [LOCAL ] MUE: Saving derivative data. [2025-09-17T22:54:55.083931] [DEBUG] [LOCAL ] MUJ: Loaded 13165 existing records from primary storage. [2025-09-17T22:54:55.118298] [INFO ] [MAIN ] MUJ: Loaded 13165 primary data records. [2025-09-17T22:54:55.515498] [DEBUG] [LOCAL ] MUE: Derivative data saved (1794 records). [2025-09-17T22:54:55.521410] [INFO ] [MAIN ] MUE: Successfully saved derivative data. [2025-09-17T22:54:55.523841] [INFO ] [MAIN ] Derivative Progress: 1241/2085 symbols completed. MUE took 1.3s. Estimated remaining: 5m 29s. Rate: 154.1 symbols/min [2025-09-17T22:54:55.530185] [INFO ] [MAIN ] MUR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:55.735401] [DEBUG] [MAIN ] MUFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:55.736432] [INFO ] [MAIN ] MUFG: Generated 1794 derivative records from 52665 primary records. [2025-09-17T22:54:55.736730] [DEBUG] [LOCAL ] MUFG: Saving derivative data. [2025-09-17T22:54:55.754826] [DEBUG] [LOCAL ] MUFG: Derivative data saved (1794 records). [2025-09-17T22:54:55.769348] [INFO ] [MAIN ] MUFG: Successfully saved derivative data. [2025-09-17T22:54:55.782430] [INFO ] [MAIN ] Derivative Progress: 1242/2085 symbols completed. MUFG took 1.0s. Estimated remaining: 5m 28s. Rate: 154.1 symbols/min [2025-09-17T22:54:55.788610] [INFO ] [MAIN ] MUSA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:55.789486] [DEBUG] [MAIN ] MUJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:55.790698] [INFO ] [MAIN ] MUJ: Generated 1794 derivative records from 13165 primary records. [2025-09-17T22:54:55.791105] [DEBUG] [LOCAL ] MUJ: Saving derivative data. [2025-09-17T22:54:55.809109] [DEBUG] [LOCAL ] MUJ: Derivative data saved (1794 records). [2025-09-17T22:54:55.828401] [INFO ] [MAIN ] MUJ: Successfully saved derivative data. [2025-09-17T22:54:55.833171] [INFO ] [MAIN ] Derivative Progress: 1243/2085 symbols completed. MUJ took 0.9s. Estimated remaining: 5m 28s. Rate: 154.2 symbols/min [2025-09-17T22:54:55.835510] [DEBUG] [LOCAL ] MUR: Loaded 52946 existing records from primary storage. [2025-09-17T22:54:55.835859] [INFO ] [MAIN ] MUR: Loaded 52946 primary data records. [2025-09-17T22:54:55.968673] [DEBUG] [LOCAL ] MUSA: Loaded 25119 existing records from primary storage. [2025-09-17T22:54:55.984185] [INFO ] [MAIN ] MUSA: Loaded 25119 primary data records. [2025-09-17T22:54:56.468375] [DEBUG] [MAIN ] MUR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:56.469109] [INFO ] [MAIN ] MUR: Generated 1794 derivative records from 52946 primary records. [2025-09-17T22:54:56.469268] [DEBUG] [LOCAL ] MUR: Saving derivative data. [2025-09-17T22:54:56.485876] [DEBUG] [LOCAL ] MUR: Derivative data saved (1794 records). [2025-09-17T22:54:56.486741] [INFO ] [MAIN ] MUR: Successfully saved derivative data. [2025-09-17T22:54:56.489544] [INFO ] [MAIN ] Derivative Progress: 1244/2085 symbols completed. MUR took 1.0s. Estimated remaining: 5m 27s. Rate: 154.1 symbols/min [2025-09-17T22:54:56.507314] [DEBUG] [MAIN ] MUSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:56.508117] [INFO ] [MAIN ] MUSA: Generated 1794 derivative records from 25119 primary records. [2025-09-17T22:54:56.508229] [DEBUG] [LOCAL ] MUSA: Saving derivative data. [2025-09-17T22:54:56.523887] [DEBUG] [LOCAL ] MUSA: Derivative data saved (1794 records). [2025-09-17T22:54:56.523944] [INFO ] [MAIN ] MUSA: Successfully saved derivative data. [2025-09-17T22:54:56.526231] [INFO ] [MAIN ] Derivative Progress: 1245/2085 symbols completed. MUSA took 0.7s. Estimated remaining: 5m 27s. Rate: 154.2 symbols/min [2025-09-17T22:54:56.526831] [INFO ] [MAIN ] MVO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:56.526939] [INFO ] [MAIN ] MVF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:56.527806] [INFO ] [MAIN ] MUX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:56.541884] [DEBUG] [LOCAL ] MVO: Loaded 9104 existing records from primary storage. [2025-09-17T22:54:56.542016] [INFO ] [MAIN ] MVO: Loaded 9104 primary data records. [2025-09-17T22:54:56.591498] [DEBUG] [LOCAL ] MVF: Loaded 12892 existing records from primary storage. [2025-09-17T22:54:56.604484] [INFO ] [MAIN ] MVF: Loaded 12892 primary data records. [2025-09-17T22:54:56.875473] [DEBUG] [LOCAL ] MUX: Loaded 42198 existing records from primary storage. [2025-09-17T22:54:56.966690] [INFO ] [MAIN ] MUX: Loaded 42198 primary data records. [2025-09-17T22:54:57.568590] [DEBUG] [MAIN ] MVO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:57.570091] [INFO ] [MAIN ] MVO: Generated 1794 derivative records from 9104 primary records. [2025-09-17T22:54:57.570901] [DEBUG] [LOCAL ] MVO: Saving derivative data. [2025-09-17T22:54:57.601184] [DEBUG] [LOCAL ] MVO: Derivative data saved (1794 records). [2025-09-17T22:54:57.601304] [INFO ] [MAIN ] MVO: Successfully saved derivative data. [2025-09-17T22:54:57.603904] [INFO ] [MAIN ] Derivative Progress: 1246/2085 symbols completed. MVO took 1.1s. Estimated remaining: 5m 27s. Rate: 154.0 symbols/min [2025-09-17T22:54:57.600313] [DEBUG] [MAIN ] MVF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:57.605087] [INFO ] [MAIN ] MVF: Generated 1794 derivative records from 12892 primary records. [2025-09-17T22:54:57.605535] [INFO ] [MAIN ] MVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:57.605728] [DEBUG] [LOCAL ] MVF: Saving derivative data. [2025-09-17T22:54:57.631838] [DEBUG] [LOCAL ] MVT: Loaded 10102 existing records from primary storage. [2025-09-17T22:54:57.632613] [DEBUG] [LOCAL ] MVF: Derivative data saved (1794 records). [2025-09-17T22:54:57.640309] [INFO ] [MAIN ] MVT: Loaded 10102 primary data records. [2025-09-17T22:54:57.645084] [INFO ] [MAIN ] MVF: Successfully saved derivative data. [2025-09-17T22:54:57.647534] [INFO ] [MAIN ] Derivative Progress: 1247/2085 symbols completed. MVF took 1.1s. Estimated remaining: 5m 26s. Rate: 154.1 symbols/min [2025-09-17T22:54:57.648430] [DEBUG] [MAIN ] MUX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:57.649508] [INFO ] [MAIN ] MWA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:57.649442] [INFO ] [MAIN ] MUX: Generated 1794 derivative records from 42198 primary records. [2025-09-17T22:54:57.655299] [DEBUG] [LOCAL ] MUX: Saving derivative data. [2025-09-17T22:54:57.757333] [DEBUG] [LOCAL ] MUX: Derivative data saved (1794 records). [2025-09-17T22:54:57.770672] [INFO ] [MAIN ] MUX: Successfully saved derivative data. [2025-09-17T22:54:57.776674] [INFO ] [MAIN ] Derivative Progress: 1248/2085 symbols completed. MUX took 1.2s. Estimated remaining: 5m 26s. Rate: 154.2 symbols/min [2025-09-17T22:54:57.787632] [INFO ] [MAIN ] MX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:58.020620] [DEBUG] [LOCAL ] MX: Loaded 22963 existing records from primary storage. [2025-09-17T22:54:58.020935] [INFO ] [MAIN ] MX: Loaded 22963 primary data records. [2025-09-17T22:54:58.047689] [DEBUG] [LOCAL ] MWA: Loaded 47233 existing records from primary storage. [2025-09-17T22:54:58.103151] [INFO ] [MAIN ] MWA: Loaded 47233 primary data records. [2025-09-17T22:54:58.560299] [DEBUG] [MAIN ] MVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:58.561901] [INFO ] [MAIN ] MVT: Generated 1794 derivative records from 10102 primary records. [2025-09-17T22:54:58.686616] [DEBUG] [LOCAL ] MVT: Saving derivative data. [2025-09-17T22:54:58.738476] [DEBUG] [LOCAL ] MVT: Derivative data saved (1794 records). [2025-09-17T22:54:58.739224] [INFO ] [MAIN ] MVT: Successfully saved derivative data. [2025-09-17T22:54:58.742234] [INFO ] [MAIN ] Derivative Progress: 1249/2085 symbols completed. MVT took 1.1s. Estimated remaining: 5m 26s. Rate: 154.0 symbols/min [2025-09-17T22:54:58.744822] [INFO ] [MAIN ] MXF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:58.767890] [DEBUG] [MAIN ] MX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:58.769092] [INFO ] [MAIN ] MX: Generated 1794 derivative records from 22963 primary records. [2025-09-17T22:54:58.769334] [DEBUG] [LOCAL ] MX: Saving derivative data. [2025-09-17T22:54:58.773725] [DEBUG] [LOCAL ] MXF: Loaded 6127 existing records from primary storage. [2025-09-17T22:54:58.774734] [INFO ] [MAIN ] MXF: Loaded 6127 primary data records. [2025-09-17T22:54:58.892041] [DEBUG] [MAIN ] MWA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:58.900622] [INFO ] [MAIN ] MWA: Generated 1794 derivative records from 47233 primary records. [2025-09-17T22:54:58.911679] [DEBUG] [LOCAL ] MWA: Saving derivative data. [2025-09-17T22:54:58.929313] [DEBUG] [LOCAL ] MX: Derivative data saved (1794 records). [2025-09-17T22:54:58.953013] [INFO ] [MAIN ] MX: Successfully saved derivative data. [2025-09-17T22:54:58.985581] [INFO ] [MAIN ] Derivative Progress: 1250/2085 symbols completed. MX took 1.2s. Estimated remaining: 5m 25s. Rate: 154.1 symbols/min [2025-09-17T22:54:59.009400] [INFO ] [MAIN ] MYD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:59.048130] [DEBUG] [LOCAL ] MWA: Derivative data saved (1794 records). [2025-09-17T22:54:59.048264] [INFO ] [MAIN ] MWA: Successfully saved derivative data. [2025-09-17T22:54:59.051201] [INFO ] [MAIN ] Derivative Progress: 1251/2085 symbols completed. MWA took 1.4s. Estimated remaining: 5m 25s. Rate: 154.2 symbols/min [2025-09-17T22:54:59.051580] [INFO ] [MAIN ] MYE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:54:59.357320] [DEBUG] [LOCAL ] MYD: Loaded 13861 existing records from primary storage. [2025-09-17T22:54:59.358116] [INFO ] [MAIN ] MYD: Loaded 13861 primary data records. [2025-09-17T22:54:59.459733] [DEBUG] [LOCAL ] MYE: Loaded 25560 existing records from primary storage. [2025-09-17T22:54:59.485107] [INFO ] [MAIN ] MYE: Loaded 25560 primary data records. [2025-09-17T22:54:59.781016] [DEBUG] [MAIN ] MXF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:54:59.915496] [INFO ] [MAIN ] MXF: Generated 1794 derivative records from 6127 primary records. [2025-09-17T22:54:59.929618] [DEBUG] [LOCAL ] MXF: Saving derivative data. [2025-09-17T22:55:00.175721] [DEBUG] [LOCAL ] MXF: Derivative data saved (1794 records). [2025-09-17T22:55:00.177874] [INFO ] [MAIN ] MXF: Successfully saved derivative data. [2025-09-17T22:55:00.181184] [INFO ] [MAIN ] Derivative Progress: 1252/2085 symbols completed. MXF took 1.4s. Estimated remaining: 5m 25s. Rate: 153.9 symbols/min [2025-09-17T22:55:00.182431] [INFO ] [MAIN ] MYN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:00.214350] [DEBUG] [LOCAL ] MYN: Loaded 10421 existing records from primary storage. [2025-09-17T22:55:00.215606] [DEBUG] [MAIN ] MYD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:00.216122] [INFO ] [MAIN ] MYN: Loaded 10421 primary data records. [2025-09-17T22:55:00.217319] [INFO ] [MAIN ] MYD: Generated 1794 derivative records from 13861 primary records. [2025-09-17T22:55:00.217819] [DEBUG] [LOCAL ] MYD: Saving derivative data. [2025-09-17T22:55:00.311363] [DEBUG] [LOCAL ] MYD: Derivative data saved (1794 records). [2025-09-17T22:55:00.311888] [INFO ] [MAIN ] MYD: Successfully saved derivative data. [2025-09-17T22:55:00.350963] [INFO ] [MAIN ] Derivative Progress: 1253/2085 symbols completed. MYD took 1.3s. Estimated remaining: 5m 24s. Rate: 154.0 symbols/min [2025-09-17T22:55:00.363995] [DEBUG] [MAIN ] MYE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:00.364416] [INFO ] [MAIN ] NABL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:00.366085] [INFO ] [MAIN ] MYE: Generated 1794 derivative records from 25560 primary records. [2025-09-17T22:55:00.366316] [DEBUG] [LOCAL ] MYE: Saving derivative data. [2025-09-17T22:55:00.596589] [DEBUG] [LOCAL ] MYE: Derivative data saved (1794 records). [2025-09-17T22:55:00.596820] [INFO ] [MAIN ] MYE: Successfully saved derivative data. [2025-09-17T22:55:00.599245] [INFO ] [MAIN ] Derivative Progress: 1254/2085 symbols completed. MYE took 1.5s. Estimated remaining: 5m 24s. Rate: 154.1 symbols/min [2025-09-17T22:55:00.599716] [INFO ] [MAIN ] NAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:00.640818] [DEBUG] [LOCAL ] NABL: Loaded 40412 existing records from primary storage. [2025-09-17T22:55:00.642086] [INFO ] [MAIN ] NABL: Loaded 40412 primary data records. [2025-09-17T22:55:00.651182] [DEBUG] [LOCAL ] NAC: Loaded 24830 existing records from primary storage. [2025-09-17T22:55:00.662732] [INFO ] [MAIN ] NAC: Loaded 24830 primary data records. [2025-09-17T22:55:00.837696] [DEBUG] [MAIN ] MYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:00.897700] [INFO ] [MAIN ] MYN: Generated 1794 derivative records from 10421 primary records. [2025-09-17T22:55:01.060999] [DEBUG] [LOCAL ] MYN: Saving derivative data. [2025-09-17T22:55:01.317148] [DEBUG] [LOCAL ] MYN: Derivative data saved (1794 records). [2025-09-17T22:55:01.318017] [INFO ] [MAIN ] MYN: Successfully saved derivative data. [2025-09-17T22:55:01.320921] [INFO ] [MAIN ] Derivative Progress: 1255/2085 symbols completed. MYN took 1.1s. Estimated remaining: 5m 23s. Rate: 154.0 symbols/min [2025-09-17T22:55:01.322486] [INFO ] [MAIN ] NAD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:01.344487] [DEBUG] [MAIN ] NABL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:01.345635] [INFO ] [MAIN ] NABL: Generated 1794 derivative records from 40412 primary records. [2025-09-17T22:55:01.345802] [DEBUG] [LOCAL ] NABL: Saving derivative data. [2025-09-17T22:55:01.390604] [DEBUG] [LOCAL ] NABL: Derivative data saved (1794 records). [2025-09-17T22:55:01.391249] [INFO ] [MAIN ] NABL: Successfully saved derivative data. [2025-09-17T22:55:01.391075] [DEBUG] [MAIN ] NAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:01.395007] [INFO ] [MAIN ] NAC: Generated 1794 derivative records from 24830 primary records. [2025-09-17T22:55:01.394025] [INFO ] [MAIN ] Derivative Progress: 1256/2085 symbols completed. NABL took 1.0s. Estimated remaining: 5m 23s. Rate: 154.1 symbols/min [2025-09-17T22:55:01.406237] [DEBUG] [LOCAL ] NAC: Saving derivative data. [2025-09-17T22:55:01.408291] [DEBUG] [LOCAL ] NAD: Loaded 34208 existing records from primary storage. [2025-09-17T22:55:01.407664] [INFO ] [MAIN ] NAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:01.416563] [INFO ] [MAIN ] NAD: Loaded 34208 primary data records. [2025-09-17T22:55:01.465347] [DEBUG] [LOCAL ] NAC: Derivative data saved (1794 records). [2025-09-17T22:55:01.501382] [INFO ] [MAIN ] NAC: Successfully saved derivative data. [2025-09-17T22:55:01.524614] [INFO ] [MAIN ] Derivative Progress: 1257/2085 symbols completed. NAC took 0.9s. Estimated remaining: 5m 22s. Rate: 154.1 symbols/min [2025-09-17T22:55:01.540213] [DEBUG] [LOCAL ] NAN: Loaded 9127 existing records from primary storage. [2025-09-17T22:55:01.552065] [INFO ] [MAIN ] NAN: Loaded 9127 primary data records. [2025-09-17T22:55:01.552327] [INFO ] [MAIN ] NAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:02.255917] [DEBUG] [LOCAL ] NAT: Loaded 49155 existing records from primary storage. [2025-09-17T22:55:02.257426] [INFO ] [MAIN ] NAT: Loaded 49155 primary data records. [2025-09-17T22:55:02.591290] [DEBUG] [MAIN ] NAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:02.594774] [INFO ] [MAIN ] NAD: Generated 1794 derivative records from 34208 primary records. [2025-09-17T22:55:02.596063] [DEBUG] [LOCAL ] NAD: Saving derivative data. [2025-09-17T22:55:02.622753] [DEBUG] [MAIN ] NAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:02.624346] [INFO ] [MAIN ] NAN: Generated 1794 derivative records from 9127 primary records. [2025-09-17T22:55:02.624450] [DEBUG] [LOCAL ] NAN: Saving derivative data. [2025-09-17T22:55:02.644069] [DEBUG] [LOCAL ] NAD: Derivative data saved (1794 records). [2025-09-17T22:55:02.646401] [DEBUG] [LOCAL ] NAN: Derivative data saved (1794 records). [2025-09-17T22:55:02.646506] [INFO ] [MAIN ] NAD: Successfully saved derivative data. [2025-09-17T22:55:02.649102] [INFO ] [MAIN ] Derivative Progress: 1258/2085 symbols completed. NAD took 1.3s. Estimated remaining: 5m 22s. Rate: 153.9 symbols/min [2025-09-17T22:55:02.649613] [INFO ] [MAIN ] NAN: Successfully saved derivative data. [2025-09-17T22:55:02.652274] [INFO ] [MAIN ] Derivative Progress: 1259/2085 symbols completed. NAN took 1.2s. Estimated remaining: 5m 22s. Rate: 154.0 symbols/min [2025-09-17T22:55:02.669703] [DEBUG] [MAIN ] NAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:02.670318] [INFO ] [MAIN ] NAT: Generated 1794 derivative records from 49155 primary records. [2025-09-17T22:55:02.670380] [DEBUG] [LOCAL ] NAT: Saving derivative data. [2025-09-17T22:55:02.686681] [DEBUG] [LOCAL ] NAT: Derivative data saved (1794 records). [2025-09-17T22:55:02.686789] [INFO ] [MAIN ] NAT: Successfully saved derivative data. [2025-09-17T22:55:02.689035] [INFO ] [MAIN ] Derivative Progress: 1260/2085 symbols completed. NAT took 1.1s. Estimated remaining: 5m 21s. Rate: 154.1 symbols/min [2025-09-17T22:55:02.689893] [INFO ] [MAIN ] NATL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:02.689769] [INFO ] [MAIN ] NAZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:02.690504] [INFO ] [MAIN ] NBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:02.696685] [DEBUG] [LOCAL ] NAZ: Loaded 2738 existing records from primary storage. [2025-09-17T22:55:02.699276] [INFO ] [MAIN ] NAZ: Loaded 2738 primary data records. [2025-09-17T22:55:02.758073] [DEBUG] [LOCAL ] NBB: Loaded 8927 existing records from primary storage. [2025-09-17T22:55:02.784067] [INFO ] [MAIN ] NBB: Loaded 8927 primary data records. [2025-09-17T22:55:03.116742] [DEBUG] [LOCAL ] NATL: Loaded 32892 existing records from primary storage. [2025-09-17T22:55:03.232564] [INFO ] [MAIN ] NATL: Loaded 32892 primary data records. [2025-09-17T22:55:03.766686] [DEBUG] [MAIN ] NAZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:03.765324] [DEBUG] [MAIN ] NBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:03.768700] [INFO ] [MAIN ] NBB: Generated 1794 derivative records from 8927 primary records. [2025-09-17T22:55:03.767610] [INFO ] [MAIN ] NAZ: Generated 1794 derivative records from 2738 primary records. [2025-09-17T22:55:03.768899] [DEBUG] [LOCAL ] NBB: Saving derivative data. [2025-09-17T22:55:03.768986] [DEBUG] [LOCAL ] NAZ: Saving derivative data. [2025-09-17T22:55:03.799219] [DEBUG] [LOCAL ] NAZ: Derivative data saved (1794 records). [2025-09-17T22:55:03.799345] [INFO ] [MAIN ] NAZ: Successfully saved derivative data. [2025-09-17T22:55:03.798847] [DEBUG] [LOCAL ] NBB: Derivative data saved (1794 records). [2025-09-17T22:55:03.801823] [INFO ] [MAIN ] Derivative Progress: 1261/2085 symbols completed. NAZ took 1.1s. Estimated remaining: 5m 21s. Rate: 153.9 symbols/min [2025-09-17T22:55:03.799581] [INFO ] [MAIN ] NBB: Successfully saved derivative data. [2025-09-17T22:55:03.804517] [INFO ] [MAIN ] NBHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:03.804807] [INFO ] [MAIN ] Derivative Progress: 1262/2085 symbols completed. NBB took 1.1s. Estimated remaining: 5m 21s. Rate: 154.0 symbols/min [2025-09-17T22:55:03.805161] [INFO ] [MAIN ] NBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:03.823201] [DEBUG] [MAIN ] NATL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:03.824030] [INFO ] [MAIN ] NATL: Generated 1794 derivative records from 32892 primary records. [2025-09-17T22:55:03.824149] [DEBUG] [LOCAL ] NATL: Saving derivative data. [2025-09-17T22:55:03.848029] [DEBUG] [LOCAL ] NATL: Derivative data saved (1794 records). [2025-09-17T22:55:03.848232] [INFO ] [MAIN ] NATL: Successfully saved derivative data. [2025-09-17T22:55:03.850590] [INFO ] [MAIN ] Derivative Progress: 1263/2085 symbols completed. NATL took 1.2s. Estimated remaining: 5m 20s. Rate: 154.1 symbols/min [2025-09-17T22:55:03.851009] [INFO ] [MAIN ] NBXG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:03.868892] [DEBUG] [LOCAL ] NBHC: Loaded 22916 existing records from primary storage. [2025-09-17T22:55:03.869115] [INFO ] [MAIN ] NBHC: Loaded 22916 primary data records. [2025-09-17T22:55:04.000561] [DEBUG] [LOCAL ] NBR: Loaded 35033 existing records from primary storage. [2025-09-17T22:55:04.004571] [INFO ] [MAIN ] NBR: Loaded 35033 primary data records. [2025-09-17T22:55:04.169782] [DEBUG] [LOCAL ] NBXG: Loaded 22876 existing records from primary storage. [2025-09-17T22:55:04.322258] [INFO ] [MAIN ] NBXG: Loaded 22876 primary data records. [2025-09-17T22:55:04.899738] [DEBUG] [MAIN ] NBHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:04.901180] [INFO ] [MAIN ] NBHC: Generated 1794 derivative records from 22916 primary records. [2025-09-17T22:55:04.903382] [DEBUG] [LOCAL ] NBHC: Saving derivative data. [2025-09-17T22:55:04.932571] [DEBUG] [MAIN ] NBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:04.935791] [DEBUG] [LOCAL ] NBHC: Derivative data saved (1794 records). [2025-09-17T22:55:04.937062] [INFO ] [MAIN ] NBR: Generated 1794 derivative records from 35033 primary records. [2025-09-17T22:55:04.936140] [INFO ] [MAIN ] NBHC: Successfully saved derivative data. [2025-09-17T22:55:04.937394] [DEBUG] [LOCAL ] NBR: Saving derivative data. [2025-09-17T22:55:04.939803] [INFO ] [MAIN ] Derivative Progress: 1264/2085 symbols completed. NBHC took 1.1s. Estimated remaining: 5m 20s. Rate: 153.9 symbols/min [2025-09-17T22:55:04.941285] [INFO ] [MAIN ] NC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:04.961877] [DEBUG] [LOCAL ] NBR: Derivative data saved (1794 records). [2025-09-17T22:55:04.962139] [INFO ] [MAIN ] NBR: Successfully saved derivative data. [2025-09-17T22:55:04.964272] [DEBUG] [LOCAL ] NC: Loaded 1920 existing records from primary storage. [2025-09-17T22:55:04.964696] [INFO ] [MAIN ] NC: Loaded 1920 primary data records. [2025-09-17T22:55:04.967238] [INFO ] [MAIN ] Derivative Progress: 1265/2085 symbols completed. NBR took 1.2s. Estimated remaining: 5m 19s. Rate: 154.0 symbols/min [2025-09-17T22:55:05.001308] [INFO ] [MAIN ] NCA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:05.016227] [DEBUG] [MAIN ] NBXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:05.053227] [INFO ] [MAIN ] NBXG: Generated 1794 derivative records from 22876 primary records. [2025-09-17T22:55:05.061126] [DEBUG] [LOCAL ] NBXG: Saving derivative data. [2025-09-17T22:55:05.172972] [DEBUG] [LOCAL ] NCA: Loaded 9980 existing records from primary storage. [2025-09-17T22:55:05.196310] [INFO ] [MAIN ] NCA: Loaded 9980 primary data records. [2025-09-17T22:55:05.195756] [DEBUG] [LOCAL ] NBXG: Derivative data saved (1794 records). [2025-09-17T22:55:05.204683] [INFO ] [MAIN ] NBXG: Successfully saved derivative data. [2025-09-17T22:55:05.321444] [INFO ] [MAIN ] Derivative Progress: 1266/2085 symbols completed. NBXG took 1.5s. Estimated remaining: 5m 19s. Rate: 154.0 symbols/min [2025-09-17T22:55:05.360875] [INFO ] [MAIN ] NCDL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:05.694615] [DEBUG] [LOCAL ] NCDL: Loaded 21844 existing records from primary storage. [2025-09-17T22:55:05.695120] [INFO ] [MAIN ] NCDL: Loaded 21844 primary data records. [2025-09-17T22:55:05.862279] [DEBUG] [MAIN ] NC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:05.909691] [INFO ] [MAIN ] NC: Generated 1794 derivative records from 1920 primary records. [2025-09-17T22:55:06.039361] [DEBUG] [LOCAL ] NC: Saving derivative data. [2025-09-17T22:55:06.055174] [DEBUG] [LOCAL ] NC: Derivative data saved (1794 records). [2025-09-17T22:55:06.056620] [INFO ] [MAIN ] NC: Successfully saved derivative data. [2025-09-17T22:55:06.059845] [INFO ] [MAIN ] Derivative Progress: 1267/2085 symbols completed. NC took 1.1s. Estimated remaining: 5m 19s. Rate: 153.9 symbols/min [2025-09-17T22:55:06.060333] [INFO ] [MAIN ] NCV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:06.080263] [DEBUG] [MAIN ] NCA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:06.081144] [INFO ] [MAIN ] NCA: Generated 1794 derivative records from 9980 primary records. [2025-09-17T22:55:06.081249] [DEBUG] [LOCAL ] NCA: Saving derivative data. [2025-09-17T22:55:06.107010] [DEBUG] [LOCAL ] NCV: Loaded 13420 existing records from primary storage. [2025-09-17T22:55:06.101347] [DEBUG] [LOCAL ] NCA: Derivative data saved (1794 records). [2025-09-17T22:55:06.107169] [INFO ] [MAIN ] NCV: Loaded 13420 primary data records. [2025-09-17T22:55:06.129150] [INFO ] [MAIN ] NCA: Successfully saved derivative data. [2025-09-17T22:55:06.159912] [INFO ] [MAIN ] Derivative Progress: 1268/2085 symbols completed. NCA took 1.2s. Estimated remaining: 5m 18s. Rate: 154.0 symbols/min [2025-09-17T22:55:06.182281] [INFO ] [MAIN ] NCZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:06.262544] [DEBUG] [MAIN ] NCDL: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:55:06.318869] [INFO ] [MAIN ] NCDL: Generated 1793 derivative records from 21844 primary records. [2025-09-17T22:55:06.319243] [DEBUG] [LOCAL ] NCDL: Saving derivative data. [2025-09-17T22:55:06.319148] [DEBUG] [LOCAL ] NCZ: Loaded 11777 existing records from primary storage. [2025-09-17T22:55:06.438778] [INFO ] [MAIN ] NCZ: Loaded 11777 primary data records. [2025-09-17T22:55:06.522514] [DEBUG] [LOCAL ] NCDL: Derivative data saved (1793 records). [2025-09-17T22:55:06.550891] [INFO ] [MAIN ] NCDL: Successfully saved derivative data. [2025-09-17T22:55:06.578850] [INFO ] [MAIN ] Derivative Progress: 1269/2085 symbols completed. NCDL took 1.2s. Estimated remaining: 5m 18s. Rate: 154.0 symbols/min [2025-09-17T22:55:06.596591] [INFO ] [MAIN ] NDMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:06.822498] [DEBUG] [LOCAL ] NDMO: Loaded 16496 existing records from primary storage. [2025-09-17T22:55:06.822979] [INFO ] [MAIN ] NDMO: Loaded 16496 primary data records. [2025-09-17T22:55:06.823347] [DEBUG] [MAIN ] NCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:06.824637] [INFO ] [MAIN ] NCV: Generated 1794 derivative records from 13420 primary records. [2025-09-17T22:55:06.824758] [DEBUG] [LOCAL ] NCV: Saving derivative data. [2025-09-17T22:55:06.954896] [DEBUG] [LOCAL ] NCV: Derivative data saved (1794 records). [2025-09-17T22:55:06.955108] [INFO ] [MAIN ] NCV: Successfully saved derivative data. [2025-09-17T22:55:06.968849] [INFO ] [MAIN ] Derivative Progress: 1270/2085 symbols completed. NCV took 0.9s. Estimated remaining: 5m 17s. Rate: 154.0 symbols/min [2025-09-17T22:55:07.019584] [INFO ] [MAIN ] NE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:07.184920] [DEBUG] [MAIN ] NCZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:07.186164] [INFO ] [MAIN ] NCZ: Generated 1794 derivative records from 11777 primary records. [2025-09-17T22:55:07.186394] [DEBUG] [LOCAL ] NCZ: Saving derivative data. [2025-09-17T22:55:07.205560] [DEBUG] [LOCAL ] NCZ: Derivative data saved (1794 records). [2025-09-17T22:55:07.206003] [INFO ] [MAIN ] NCZ: Successfully saved derivative data. [2025-09-17T22:55:07.208432] [INFO ] [MAIN ] Derivative Progress: 1271/2085 symbols completed. NCZ took 1.0s. Estimated remaining: 5m 17s. Rate: 154.1 symbols/min [2025-09-17T22:55:07.208987] [INFO ] [MAIN ] NEA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:07.244427] [DEBUG] [MAIN ] NDMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:07.245392] [INFO ] [MAIN ] NDMO: Generated 1794 derivative records from 16496 primary records. [2025-09-17T22:55:07.245624] [DEBUG] [LOCAL ] NDMO: Saving derivative data. [2025-09-17T22:55:07.281246] [DEBUG] [LOCAL ] NE: Loaded 52394 existing records from primary storage. [2025-09-17T22:55:07.282103] [INFO ] [MAIN ] NE: Loaded 52394 primary data records. [2025-09-17T22:55:07.283197] [DEBUG] [LOCAL ] NDMO: Derivative data saved (1794 records). [2025-09-17T22:55:07.332746] [INFO ] [MAIN ] NDMO: Successfully saved derivative data. [2025-09-17T22:55:07.352196] [INFO ] [MAIN ] Derivative Progress: 1272/2085 symbols completed. NDMO took 0.8s. Estimated remaining: 5m 16s. Rate: 154.1 symbols/min [2025-09-17T22:55:07.397095] [INFO ] [MAIN ] NET: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:07.426051] [DEBUG] [LOCAL ] NEA: Loaded 35408 existing records from primary storage. [2025-09-17T22:55:07.431728] [INFO ] [MAIN ] NEA: Loaded 35408 primary data records. [2025-09-17T22:55:08.072827] [DEBUG] [LOCAL ] NET: Loaded 53095 existing records from primary storage. [2025-09-17T22:55:08.073770] [INFO ] [MAIN ] NET: Loaded 53095 primary data records. [2025-09-17T22:55:08.285322] [DEBUG] [MAIN ] NE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:08.287254] [INFO ] [MAIN ] NE: Generated 1794 derivative records from 52394 primary records. [2025-09-17T22:55:08.401879] [DEBUG] [LOCAL ] NE: Saving derivative data. [2025-09-17T22:55:08.433860] [DEBUG] [MAIN ] NEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:08.444723] [INFO ] [MAIN ] NEA: Generated 1794 derivative records from 35408 primary records. [2025-09-17T22:55:08.443269] [DEBUG] [LOCAL ] NE: Derivative data saved (1794 records). [2025-09-17T22:55:08.444944] [DEBUG] [LOCAL ] NEA: Saving derivative data. [2025-09-17T22:55:08.446000] [INFO ] [MAIN ] NE: Successfully saved derivative data. [2025-09-17T22:55:08.449512] [INFO ] [MAIN ] Derivative Progress: 1273/2085 symbols completed. NE took 1.4s. Estimated remaining: 5m 17s. Rate: 153.9 symbols/min [2025-09-17T22:55:08.470435] [DEBUG] [LOCAL ] NEA: Derivative data saved (1794 records). [2025-09-17T22:55:08.470678] [INFO ] [MAIN ] NEA: Successfully saved derivative data. [2025-09-17T22:55:08.473607] [INFO ] [MAIN ] Derivative Progress: 1274/2085 symbols completed. NEA took 1.3s. Estimated remaining: 5m 16s. Rate: 154.0 symbols/min [2025-09-17T22:55:08.492465] [DEBUG] [MAIN ] NET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:08.493063] [INFO ] [MAIN ] NET: Generated 1794 derivative records from 53095 primary records. [2025-09-17T22:55:08.493125] [DEBUG] [LOCAL ] NET: Saving derivative data. [2025-09-17T22:55:08.509807] [DEBUG] [LOCAL ] NET: Derivative data saved (1794 records). [2025-09-17T22:55:08.509870] [INFO ] [MAIN ] NET: Successfully saved derivative data. [2025-09-17T22:55:08.512079] [INFO ] [MAIN ] Derivative Progress: 1275/2085 symbols completed. NET took 1.1s. Estimated remaining: 5m 15s. Rate: 154.1 symbols/min [2025-09-17T22:55:08.512781] [INFO ] [MAIN ] NEU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:08.512948] [INFO ] [MAIN ] NEXA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:08.513395] [INFO ] [MAIN ] NEUE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:08.522597] [DEBUG] [LOCAL ] NEUE: Loaded 2256 existing records from primary storage. [2025-09-17T22:55:08.522847] [INFO ] [MAIN ] NEUE: Loaded 2256 primary data records. [2025-09-17T22:55:08.546876] [DEBUG] [LOCAL ] NEXA: Loaded 3923 existing records from primary storage. [2025-09-17T22:55:08.566240] [INFO ] [MAIN ] NEXA: Loaded 3923 primary data records. [2025-09-17T22:55:08.594995] [DEBUG] [LOCAL ] NEU: Loaded 8121 existing records from primary storage. [2025-09-17T22:55:08.623610] [INFO ] [MAIN ] NEU: Loaded 8121 primary data records. [2025-09-17T22:55:09.534702] [DEBUG] [MAIN ] NEUE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:09.538549] [INFO ] [MAIN ] NEUE: Generated 1794 derivative records from 2256 primary records. [2025-09-17T22:55:09.539764] [DEBUG] [LOCAL ] NEUE: Saving derivative data. [2025-09-17T22:55:09.554681] [DEBUG] [MAIN ] NEU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:09.569850] [INFO ] [MAIN ] NEU: Generated 1794 derivative records from 8121 primary records. [2025-09-17T22:55:09.575969] [DEBUG] [LOCAL ] NEU: Saving derivative data. [2025-09-17T22:55:09.570221] [DEBUG] [MAIN ] NEXA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:09.584113] [DEBUG] [LOCAL ] NEUE: Derivative data saved (1794 records). [2025-09-17T22:55:09.586833] [INFO ] [MAIN ] NEUE: Successfully saved derivative data. [2025-09-17T22:55:09.586699] [INFO ] [MAIN ] NEXA: Generated 1794 derivative records from 3923 primary records. [2025-09-17T22:55:09.590200] [INFO ] [MAIN ] Derivative Progress: 1276/2085 symbols completed. NEUE took 1.1s. Estimated remaining: 5m 15s. Rate: 153.9 symbols/min [2025-09-17T22:55:09.602965] [DEBUG] [LOCAL ] NEXA: Saving derivative data. [2025-09-17T22:55:09.607486] [INFO ] [MAIN ] NFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:09.607402] [DEBUG] [LOCAL ] NEU: Derivative data saved (1794 records). [2025-09-17T22:55:09.609252] [INFO ] [MAIN ] NEU: Successfully saved derivative data. [2025-09-17T22:55:09.612160] [INFO ] [MAIN ] Derivative Progress: 1277/2085 symbols completed. NEU took 1.1s. Estimated remaining: 5m 15s. Rate: 154.0 symbols/min [2025-09-17T22:55:09.620499] [INFO ] [MAIN ] NFJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:09.630162] [DEBUG] [LOCAL ] NEXA: Derivative data saved (1794 records). [2025-09-17T22:55:09.630595] [INFO ] [MAIN ] NEXA: Successfully saved derivative data. [2025-09-17T22:55:09.633445] [INFO ] [MAIN ] Derivative Progress: 1278/2085 symbols completed. NEXA took 1.1s. Estimated remaining: 5m 14s. Rate: 154.2 symbols/min [2025-09-17T22:55:09.633796] [INFO ] [MAIN ] NGG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:09.651569] [DEBUG] [LOCAL ] NFJ: Loaded 20489 existing records from primary storage. [2025-09-17T22:55:09.662504] [INFO ] [MAIN ] NFJ: Loaded 20489 primary data records. [2025-09-17T22:55:09.818987] [DEBUG] [LOCAL ] NFG: Loaded 38837 existing records from primary storage. [2025-09-17T22:55:09.830495] [INFO ] [MAIN ] NFG: Loaded 38837 primary data records. [2025-09-17T22:55:09.980393] [DEBUG] [LOCAL ] NGG: Loaded 46212 existing records from primary storage. [2025-09-17T22:55:10.124852] [INFO ] [MAIN ] NGG: Loaded 46212 primary data records. [2025-09-17T22:55:10.780623] [DEBUG] [MAIN ] NFJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:10.781577] [INFO ] [MAIN ] NFJ: Generated 1794 derivative records from 20489 primary records. [2025-09-17T22:55:10.782079] [DEBUG] [LOCAL ] NFJ: Saving derivative data. [2025-09-17T22:55:10.800758] [DEBUG] [LOCAL ] NFJ: Derivative data saved (1794 records). [2025-09-17T22:55:10.801209] [INFO ] [MAIN ] NFJ: Successfully saved derivative data. [2025-09-17T22:55:10.807276] [INFO ] [MAIN ] Derivative Progress: 1279/2085 symbols completed. NFJ took 1.2s. Estimated remaining: 5m 14s. Rate: 153.9 symbols/min [2025-09-17T22:55:10.809388] [INFO ] [MAIN ] NGL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:10.823810] [DEBUG] [MAIN ] NGG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:10.832122] [INFO ] [MAIN ] NGG: Generated 1794 derivative records from 46212 primary records. [2025-09-17T22:55:10.837225] [DEBUG] [MAIN ] NFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:10.837281] [DEBUG] [LOCAL ] NGG: Saving derivative data. [2025-09-17T22:55:10.838029] [INFO ] [MAIN ] NFG: Generated 1794 derivative records from 38837 primary records. [2025-09-17T22:55:10.838395] [DEBUG] [LOCAL ] NFG: Saving derivative data. [2025-09-17T22:55:10.874612] [DEBUG] [LOCAL ] NFG: Derivative data saved (1794 records). [2025-09-17T22:55:10.875472] [INFO ] [MAIN ] NFG: Successfully saved derivative data. [2025-09-17T22:55:10.878508] [INFO ] [MAIN ] Derivative Progress: 1280/2085 symbols completed. NFG took 1.3s. Estimated remaining: 5m 14s. Rate: 154.0 symbols/min [2025-09-17T22:55:10.879915] [INFO ] [MAIN ] NGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:10.881328] [DEBUG] [LOCAL ] NGG: Derivative data saved (1794 records). [2025-09-17T22:55:10.881491] [INFO ] [MAIN ] NGG: Successfully saved derivative data. [2025-09-17T22:55:10.883862] [INFO ] [MAIN ] Derivative Progress: 1281/2085 symbols completed. NGG took 1.3s. Estimated remaining: 5m 13s. Rate: 154.1 symbols/min [2025-09-17T22:55:10.895981] [INFO ] [MAIN ] NGVC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:10.896460] [DEBUG] [LOCAL ] NGL: Loaded 30422 existing records from primary storage. [2025-09-17T22:55:10.897016] [INFO ] [MAIN ] NGL: Loaded 30422 primary data records. [2025-09-17T22:55:11.020853] [DEBUG] [LOCAL ] NGS: Loaded 11774 existing records from primary storage. [2025-09-17T22:55:11.021123] [INFO ] [MAIN ] NGS: Loaded 11774 primary data records. [2025-09-17T22:55:11.188949] [DEBUG] [LOCAL ] NGVC: Loaded 22449 existing records from primary storage. [2025-09-17T22:55:11.206171] [INFO ] [MAIN ] NGVC: Loaded 22449 primary data records. [2025-09-17T22:55:11.968255] [DEBUG] [MAIN ] NGL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:11.969465] [INFO ] [MAIN ] NGL: Generated 1794 derivative records from 30422 primary records. [2025-09-17T22:55:11.969828] [DEBUG] [LOCAL ] NGL: Saving derivative data. [2025-09-17T22:55:12.013527] [DEBUG] [MAIN ] NGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:12.018886] [DEBUG] [MAIN ] NGVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:12.020389] [INFO ] [MAIN ] NGVC: Generated 1794 derivative records from 22449 primary records. [2025-09-17T22:55:12.021356] [INFO ] [MAIN ] NGS: Generated 1794 derivative records from 11774 primary records. [2025-09-17T22:55:12.021492] [DEBUG] [LOCAL ] NGS: Saving derivative data. [2025-09-17T22:55:12.019722] [DEBUG] [LOCAL ] NGL: Derivative data saved (1794 records). [2025-09-17T22:55:12.022416] [INFO ] [MAIN ] NGL: Successfully saved derivative data. [2025-09-17T22:55:12.024564] [INFO ] [MAIN ] Derivative Progress: 1282/2085 symbols completed. NGL took 1.2s. Estimated remaining: 5m 13s. Rate: 153.9 symbols/min [2025-09-17T22:55:12.024905] [DEBUG] [LOCAL ] NGVC: Saving derivative data. [2025-09-17T22:55:12.033826] [INFO ] [MAIN ] NGVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:12.055586] [DEBUG] [LOCAL ] NGVC: Derivative data saved (1794 records). [2025-09-17T22:55:12.055758] [INFO ] [MAIN ] NGVC: Successfully saved derivative data. [2025-09-17T22:55:12.058300] [INFO ] [MAIN ] Derivative Progress: 1283/2085 symbols completed. NGVC took 1.2s. Estimated remaining: 5m 12s. Rate: 154.0 symbols/min [2025-09-17T22:55:12.059198] [INFO ] [MAIN ] NHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:12.062832] [DEBUG] [LOCAL ] NGS: Derivative data saved (1794 records). [2025-09-17T22:55:12.062990] [INFO ] [MAIN ] NGS: Successfully saved derivative data. [2025-09-17T22:55:12.065442] [INFO ] [MAIN ] Derivative Progress: 1284/2085 symbols completed. NGS took 1.2s. Estimated remaining: 5m 12s. Rate: 154.1 symbols/min [2025-09-17T22:55:12.071764] [INFO ] [MAIN ] NIC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:12.089699] [DEBUG] [LOCAL ] NGVT: Loaded 24542 existing records from primary storage. [2025-09-17T22:55:12.091803] [INFO ] [MAIN ] NGVT: Loaded 24542 primary data records. [2025-09-17T22:55:12.159990] [DEBUG] [LOCAL ] NIC: Loaded 8913 existing records from primary storage. [2025-09-17T22:55:12.178938] [DEBUG] [LOCAL ] NHI: Loaded 22149 existing records from primary storage. [2025-09-17T22:55:12.179202] [INFO ] [MAIN ] NHI: Loaded 22149 primary data records. [2025-09-17T22:55:12.179121] [INFO ] [MAIN ] NIC: Loaded 8913 primary data records. [2025-09-17T22:55:13.098958] [DEBUG] [MAIN ] NGVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:13.103362] [INFO ] [MAIN ] NGVT: Generated 1794 derivative records from 24542 primary records. [2025-09-17T22:55:13.103817] [DEBUG] [LOCAL ] NGVT: Saving derivative data. [2025-09-17T22:55:13.130760] [DEBUG] [MAIN ] NIC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:13.131770] [INFO ] [MAIN ] NIC: Generated 1794 derivative records from 8913 primary records. [2025-09-17T22:55:13.131862] [DEBUG] [LOCAL ] NIC: Saving derivative data. [2025-09-17T22:55:13.149438] [DEBUG] [MAIN ] NHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:13.157844] [DEBUG] [LOCAL ] NGVT: Derivative data saved (1794 records). [2025-09-17T22:55:13.158934] [INFO ] [MAIN ] NHI: Generated 1794 derivative records from 22149 primary records. [2025-09-17T22:55:13.163055] [INFO ] [MAIN ] NGVT: Successfully saved derivative data. [2025-09-17T22:55:13.163361] [DEBUG] [LOCAL ] NHI: Saving derivative data. [2025-09-17T22:55:13.166173] [INFO ] [MAIN ] Derivative Progress: 1285/2085 symbols completed. NGVT took 1.1s. Estimated remaining: 5m 12s. Rate: 153.9 symbols/min [2025-09-17T22:55:13.166465] [INFO ] [MAIN ] NIE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:13.183618] [DEBUG] [LOCAL ] NIC: Derivative data saved (1794 records). [2025-09-17T22:55:13.184045] [INFO ] [MAIN ] NIC: Successfully saved derivative data. [2025-09-17T22:55:13.191843] [INFO ] [MAIN ] Derivative Progress: 1286/2085 symbols completed. NIC took 1.1s. Estimated remaining: 5m 11s. Rate: 154.0 symbols/min [2025-09-17T22:55:13.196070] [INFO ] [MAIN ] NIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:13.205113] [DEBUG] [LOCAL ] NHI: Derivative data saved (1794 records). [2025-09-17T22:55:13.205338] [INFO ] [MAIN ] NHI: Successfully saved derivative data. [2025-09-17T22:55:13.204901] [DEBUG] [LOCAL ] NIE: Loaded 11673 existing records from primary storage. [2025-09-17T22:55:13.208309] [INFO ] [MAIN ] Derivative Progress: 1287/2085 symbols completed. NHI took 1.1s. Estimated remaining: 5m 11s. Rate: 154.1 symbols/min [2025-09-17T22:55:13.205539] [INFO ] [MAIN ] NIE: Loaded 11673 primary data records. [2025-09-17T22:55:13.214873] [INFO ] [MAIN ] NINE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:13.269421] [DEBUG] [LOCAL ] NIM: Loaded 4158 existing records from primary storage. [2025-09-17T22:55:13.283523] [INFO ] [MAIN ] NIM: Loaded 4158 primary data records. [2025-09-17T22:55:13.504609] [DEBUG] [LOCAL ] NINE: Loaded 29062 existing records from primary storage. [2025-09-17T22:55:13.545320] [INFO ] [MAIN ] NINE: Loaded 29062 primary data records. [2025-09-17T22:55:14.251698] [DEBUG] [MAIN ] NIE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:14.252600] [INFO ] [MAIN ] NIE: Generated 1794 derivative records from 11673 primary records. [2025-09-17T22:55:14.252748] [DEBUG] [LOCAL ] NIE: Saving derivative data. [2025-09-17T22:55:14.288636] [DEBUG] [MAIN ] NIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:14.290585] [INFO ] [MAIN ] NIM: Generated 1794 derivative records from 4158 primary records. [2025-09-17T22:55:14.290866] [DEBUG] [LOCAL ] NIM: Saving derivative data. [2025-09-17T22:55:14.293060] [DEBUG] [LOCAL ] NIE: Derivative data saved (1794 records). [2025-09-17T22:55:14.299677] [INFO ] [MAIN ] NIE: Successfully saved derivative data. [2025-09-17T22:55:14.305758] [INFO ] [MAIN ] Derivative Progress: 1288/2085 symbols completed. NIE took 1.1s. Estimated remaining: 5m 11s. Rate: 153.9 symbols/min [2025-09-17T22:55:14.326078] [DEBUG] [LOCAL ] NIM: Derivative data saved (1794 records). [2025-09-17T22:55:14.326603] [INFO ] [MAIN ] NIM: Successfully saved derivative data. [2025-09-17T22:55:14.326969] [DEBUG] [MAIN ] NINE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:14.329745] [INFO ] [MAIN ] Derivative Progress: 1289/2085 symbols completed. NIM took 1.1s. Estimated remaining: 5m 10s. Rate: 154.0 symbols/min [2025-09-17T22:55:14.330592] [INFO ] [MAIN ] NINE: Generated 1794 derivative records from 29062 primary records. [2025-09-17T22:55:14.330865] [DEBUG] [LOCAL ] NINE: Saving derivative data. [2025-09-17T22:55:14.351752] [DEBUG] [LOCAL ] NINE: Derivative data saved (1794 records). [2025-09-17T22:55:14.351946] [INFO ] [MAIN ] NINE: Successfully saved derivative data. [2025-09-17T22:55:14.354836] [INFO ] [MAIN ] Derivative Progress: 1290/2085 symbols completed. NINE took 1.1s. Estimated remaining: 5m 9s. Rate: 154.1 symbols/min [2025-09-17T22:55:14.356162] [INFO ] [MAIN ] NKX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:14.356365] [INFO ] [MAIN ] NIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:14.356308] [INFO ] [MAIN ] NJR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:14.383783] [DEBUG] [LOCAL ] NKX: Loaded 13635 existing records from primary storage. [2025-09-17T22:55:14.384082] [INFO ] [MAIN ] NKX: Loaded 13635 primary data records. [2025-09-17T22:55:14.569039] [DEBUG] [LOCAL ] NJR: Loaded 37970 existing records from primary storage. [2025-09-17T22:55:14.562999] [DEBUG] [LOCAL ] NIO: Loaded 53802 existing records from primary storage. [2025-09-17T22:55:14.615095] [INFO ] [MAIN ] NJR: Loaded 37970 primary data records. [2025-09-17T22:55:14.591047] [INFO ] [MAIN ] NIO: Loaded 53802 primary data records. [2025-09-17T22:55:15.380185] [DEBUG] [MAIN ] NKX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:15.381986] [INFO ] [MAIN ] NKX: Generated 1794 derivative records from 13635 primary records. [2025-09-17T22:55:15.382542] [DEBUG] [LOCAL ] NKX: Saving derivative data. [2025-09-17T22:55:15.406430] [DEBUG] [LOCAL ] NKX: Derivative data saved (1794 records). [2025-09-17T22:55:15.407104] [INFO ] [MAIN ] NKX: Successfully saved derivative data. [2025-09-17T22:55:15.410135] [INFO ] [MAIN ] Derivative Progress: 1291/2085 symbols completed. NKX took 1.1s. Estimated remaining: 5m 9s. Rate: 153.9 symbols/min [2025-09-17T22:55:15.410744] [INFO ] [MAIN ] NLOP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:15.432036] [DEBUG] [MAIN ] NJR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:15.432947] [INFO ] [MAIN ] NJR: Generated 1794 derivative records from 37970 primary records. [2025-09-17T22:55:15.440527] [DEBUG] [LOCAL ] NJR: Saving derivative data. [2025-09-17T22:55:15.448540] [DEBUG] [MAIN ] NIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:15.450162] [INFO ] [MAIN ] NIO: Generated 1794 derivative records from 53802 primary records. [2025-09-17T22:55:15.455300] [DEBUG] [LOCAL ] NLOP: Loaded 11797 existing records from primary storage. [2025-09-17T22:55:15.454829] [DEBUG] [LOCAL ] NIO: Saving derivative data. [2025-09-17T22:55:15.463200] [INFO ] [MAIN ] NLOP: Loaded 11797 primary data records. [2025-09-17T22:55:15.547124] [DEBUG] [LOCAL ] NJR: Derivative data saved (1794 records). [2025-09-17T22:55:15.555226] [INFO ] [MAIN ] NJR: Successfully saved derivative data. [2025-09-17T22:55:15.557934] [INFO ] [MAIN ] Derivative Progress: 1292/2085 symbols completed. NJR took 1.2s. Estimated remaining: 5m 9s. Rate: 154.0 symbols/min [2025-09-17T22:55:15.563490] [INFO ] [MAIN ] NLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:15.610784] [DEBUG] [LOCAL ] NIO: Derivative data saved (1794 records). [2025-09-17T22:55:15.622088] [INFO ] [MAIN ] NIO: Successfully saved derivative data. [2025-09-17T22:55:15.629845] [INFO ] [MAIN ] Derivative Progress: 1293/2085 symbols completed. NIO took 1.3s. Estimated remaining: 5m 8s. Rate: 154.1 symbols/min [2025-09-17T22:55:15.661779] [INFO ] [MAIN ] NMAI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:15.827485] [DEBUG] [LOCAL ] NMAI: Loaded 13194 existing records from primary storage. [2025-09-17T22:55:15.827842] [INFO ] [MAIN ] NMAI: Loaded 13194 primary data records. [2025-09-17T22:55:16.004806] [DEBUG] [LOCAL ] NLY: Loaded 53581 existing records from primary storage. [2025-09-17T22:55:16.020430] [INFO ] [MAIN ] NLY: Loaded 53581 primary data records. [2025-09-17T22:55:16.493924] [DEBUG] [MAIN ] NLOP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:16.614063] [INFO ] [MAIN ] NLOP: Generated 1794 derivative records from 11797 primary records. [2025-09-17T22:55:16.614574] [DEBUG] [LOCAL ] NLOP: Saving derivative data. [2025-09-17T22:55:16.634876] [DEBUG] [LOCAL ] NLOP: Derivative data saved (1794 records). [2025-09-17T22:55:16.635430] [INFO ] [MAIN ] NLOP: Successfully saved derivative data. [2025-09-17T22:55:16.638835] [INFO ] [MAIN ] Derivative Progress: 1294/2085 symbols completed. NLOP took 1.2s. Estimated remaining: 5m 8s. Rate: 153.9 symbols/min [2025-09-17T22:55:16.639236] [INFO ] [MAIN ] NMCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:16.657360] [DEBUG] [MAIN ] NMAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:16.658261] [INFO ] [MAIN ] NMAI: Generated 1794 derivative records from 13194 primary records. [2025-09-17T22:55:16.658488] [DEBUG] [LOCAL ] NMAI: Saving derivative data. [2025-09-17T22:55:16.680445] [DEBUG] [LOCAL ] NMAI: Derivative data saved (1794 records). [2025-09-17T22:55:16.680612] [INFO ] [MAIN ] NMAI: Successfully saved derivative data. [2025-09-17T22:55:16.683129] [INFO ] [MAIN ] Derivative Progress: 1295/2085 symbols completed. NMAI took 1.0s. Estimated remaining: 5m 8s. Rate: 154.0 symbols/min [2025-09-17T22:55:16.683740] [INFO ] [MAIN ] NMG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:16.692198] [DEBUG] [LOCAL ] NMCO: Loaded 16453 existing records from primary storage. [2025-09-17T22:55:16.692996] [INFO ] [MAIN ] NMCO: Loaded 16453 primary data records. [2025-09-17T22:55:16.799445] [DEBUG] [MAIN ] NLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:16.814300] [DEBUG] [LOCAL ] NMG: Loaded 7384 existing records from primary storage. [2025-09-17T22:55:16.818700] [INFO ] [MAIN ] NLY: Generated 1794 derivative records from 53581 primary records. [2025-09-17T22:55:16.818836] [DEBUG] [LOCAL ] NLY: Saving derivative data. [2025-09-17T22:55:16.830437] [INFO ] [MAIN ] NMG: Loaded 7384 primary data records. [2025-09-17T22:55:17.152895] [DEBUG] [LOCAL ] NLY: Derivative data saved (1794 records). [2025-09-17T22:55:17.174435] [INFO ] [MAIN ] NLY: Successfully saved derivative data. [2025-09-17T22:55:17.197855] [INFO ] [MAIN ] Derivative Progress: 1296/2085 symbols completed. NLY took 1.6s. Estimated remaining: 5m 7s. Rate: 154.0 symbols/min [2025-09-17T22:55:17.245478] [INFO ] [MAIN ] NMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:17.371488] [DEBUG] [LOCAL ] NMI: Loaded 4116 existing records from primary storage. [2025-09-17T22:55:17.371911] [INFO ] [MAIN ] NMI: Loaded 4116 primary data records. [2025-09-17T22:55:17.585255] [DEBUG] [MAIN ] NMCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:17.703729] [INFO ] [MAIN ] NMCO: Generated 1794 derivative records from 16453 primary records. [2025-09-17T22:55:17.720712] [DEBUG] [LOCAL ] NMCO: Saving derivative data. [2025-09-17T22:55:17.753022] [DEBUG] [LOCAL ] NMCO: Derivative data saved (1794 records). [2025-09-17T22:55:17.753871] [INFO ] [MAIN ] NMCO: Successfully saved derivative data. [2025-09-17T22:55:17.754283] [DEBUG] [MAIN ] NMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:17.755364] [INFO ] [MAIN ] NMG: Generated 1794 derivative records from 7384 primary records. [2025-09-17T22:55:17.757821] [INFO ] [MAIN ] Derivative Progress: 1297/2085 symbols completed. NMCO took 1.1s. Estimated remaining: 5m 7s. Rate: 153.9 symbols/min [2025-09-17T22:55:17.758308] [INFO ] [MAIN ] NMM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:17.758462] [DEBUG] [LOCAL ] NMG: Saving derivative data. [2025-09-17T22:55:17.778522] [DEBUG] [LOCAL ] NMG: Derivative data saved (1794 records). [2025-09-17T22:55:17.778982] [INFO ] [MAIN ] NMG: Successfully saved derivative data. [2025-09-17T22:55:17.781429] [INFO ] [MAIN ] Derivative Progress: 1298/2085 symbols completed. NMG took 1.1s. Estimated remaining: 5m 7s. Rate: 154.0 symbols/min [2025-09-17T22:55:17.782195] [INFO ] [MAIN ] NMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:17.809974] [DEBUG] [LOCAL ] NMM: Loaded 14353 existing records from primary storage. [2025-09-17T22:55:17.810317] [INFO ] [MAIN ] NMM: Loaded 14353 primary data records. [2025-09-17T22:55:17.810579] [DEBUG] [MAIN ] NMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:17.823550] [INFO ] [MAIN ] NMI: Generated 1794 derivative records from 4116 primary records. [2025-09-17T22:55:17.833543] [DEBUG] [LOCAL ] NMI: Saving derivative data. [2025-09-17T22:55:17.948961] [DEBUG] [LOCAL ] NMI: Derivative data saved (1794 records). [2025-09-17T22:55:17.949161] [INFO ] [MAIN ] NMI: Successfully saved derivative data. [2025-09-17T22:55:17.962737] [INFO ] [MAIN ] Derivative Progress: 1299/2085 symbols completed. NMI took 0.7s. Estimated remaining: 5m 6s. Rate: 154.1 symbols/min [2025-09-17T22:55:18.040114] [INFO ] [MAIN ] NMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:18.206901] [DEBUG] [LOCAL ] NMR: Loaded 35265 existing records from primary storage. [2025-09-17T22:55:18.207827] [INFO ] [MAIN ] NMR: Loaded 35265 primary data records. [2025-09-17T22:55:18.252946] [DEBUG] [LOCAL ] NMS: Loaded 2878 existing records from primary storage. [2025-09-17T22:55:18.260611] [INFO ] [MAIN ] NMS: Loaded 2878 primary data records. [2025-09-17T22:55:18.844440] [DEBUG] [MAIN ] NMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:18.845951] [INFO ] [MAIN ] NMM: Generated 1794 derivative records from 14353 primary records. [2025-09-17T22:55:18.846169] [DEBUG] [LOCAL ] NMM: Saving derivative data. [2025-09-17T22:55:18.865561] [DEBUG] [LOCAL ] NMM: Derivative data saved (1794 records). [2025-09-17T22:55:18.865810] [INFO ] [MAIN ] NMM: Successfully saved derivative data. [2025-09-17T22:55:18.868146] [INFO ] [MAIN ] Derivative Progress: 1300/2085 symbols completed. NMM took 1.1s. Estimated remaining: 5m 6s. Rate: 154.0 symbols/min [2025-09-17T22:55:18.869106] [INFO ] [MAIN ] NMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:18.876835] [DEBUG] [LOCAL ] NMT: Loaded 2826 existing records from primary storage. [2025-09-17T22:55:18.884412] [INFO ] [MAIN ] NMT: Loaded 2826 primary data records. [2025-09-17T22:55:18.902820] [DEBUG] [MAIN ] NMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:18.903611] [INFO ] [MAIN ] NMS: Generated 1794 derivative records from 2878 primary records. [2025-09-17T22:55:18.924001] [DEBUG] [LOCAL ] NMS: Saving derivative data. [2025-09-17T22:55:18.962806] [DEBUG] [MAIN ] NMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:18.978610] [INFO ] [MAIN ] NMR: Generated 1794 derivative records from 35265 primary records. [2025-09-17T22:55:19.003422] [DEBUG] [LOCAL ] NMR: Saving derivative data. [2025-09-17T22:55:19.028234] [DEBUG] [LOCAL ] NMS: Derivative data saved (1794 records). [2025-09-17T22:55:19.028621] [INFO ] [MAIN ] NMS: Successfully saved derivative data. [2025-09-17T22:55:19.031196] [INFO ] [MAIN ] Derivative Progress: 1301/2085 symbols completed. NMS took 1.0s. Estimated remaining: 5m 5s. Rate: 154.0 symbols/min [2025-09-17T22:55:19.031623] [INFO ] [MAIN ] NMZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:19.256710] [DEBUG] [LOCAL ] NMR: Derivative data saved (1794 records). [2025-09-17T22:55:19.256916] [INFO ] [MAIN ] NMR: Successfully saved derivative data. [2025-09-17T22:55:19.259215] [INFO ] [MAIN ] Derivative Progress: 1302/2085 symbols completed. NMR took 1.5s. Estimated remaining: 5m 5s. Rate: 154.1 symbols/min [2025-09-17T22:55:19.265972] [INFO ] [MAIN ] NNI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:19.276855] [DEBUG] [LOCAL ] NMZ: Loaded 21499 existing records from primary storage. [2025-09-17T22:55:19.277202] [INFO ] [MAIN ] NMZ: Loaded 21499 primary data records. [2025-09-17T22:55:19.400286] [DEBUG] [LOCAL ] NNI: Loaded 9783 existing records from primary storage. [2025-09-17T22:55:19.415858] [INFO ] [MAIN ] NNI: Loaded 9783 primary data records. [2025-09-17T22:55:19.958579] [DEBUG] [MAIN ] NMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:19.959522] [INFO ] [MAIN ] NMT: Generated 1794 derivative records from 2826 primary records. [2025-09-17T22:55:19.959757] [DEBUG] [LOCAL ] NMT: Saving derivative data. [2025-09-17T22:55:19.977015] [DEBUG] [LOCAL ] NMT: Derivative data saved (1794 records). [2025-09-17T22:55:19.977489] [INFO ] [MAIN ] NMT: Successfully saved derivative data. [2025-09-17T22:55:19.980092] [INFO ] [MAIN ] Derivative Progress: 1303/2085 symbols completed. NMT took 1.1s. Estimated remaining: 5m 5s. Rate: 154.0 symbols/min [2025-09-17T22:55:19.999270] [DEBUG] [MAIN ] NMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:19.999952] [INFO ] [MAIN ] NMZ: Generated 1794 derivative records from 21499 primary records. [2025-09-17T22:55:20.000109] [DEBUG] [LOCAL ] NMZ: Saving derivative data. [2025-09-17T22:55:20.030954] [DEBUG] [MAIN ] NNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:20.032281] [INFO ] [MAIN ] NNI: Generated 1794 derivative records from 9783 primary records. [2025-09-17T22:55:20.032570] [DEBUG] [LOCAL ] NNI: Saving derivative data. [2025-09-17T22:55:20.033963] [DEBUG] [LOCAL ] NMZ: Derivative data saved (1794 records). [2025-09-17T22:55:20.034039] [INFO ] [MAIN ] NMZ: Successfully saved derivative data. [2025-09-17T22:55:20.036303] [INFO ] [MAIN ] Derivative Progress: 1304/2085 symbols completed. NMZ took 1.0s. Estimated remaining: 5m 4s. Rate: 154.1 symbols/min [2025-09-17T22:55:20.051466] [DEBUG] [LOCAL ] NNI: Derivative data saved (1794 records). [2025-09-17T22:55:20.051531] [INFO ] [MAIN ] NNI: Successfully saved derivative data. [2025-09-17T22:55:20.054429] [INFO ] [MAIN ] Derivative Progress: 1305/2085 symbols completed. NNI took 0.8s. Estimated remaining: 5m 4s. Rate: 154.2 symbols/min [2025-09-17T22:55:20.055085] [INFO ] [MAIN ] NOA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:20.055248] [INFO ] [MAIN ] NNY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:20.055166] [INFO ] [MAIN ] NNN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:20.063867] [DEBUG] [LOCAL ] NNY: Loaded 5683 existing records from primary storage. [2025-09-17T22:55:20.063993] [INFO ] [MAIN ] NNY: Loaded 5683 primary data records. [2025-09-17T22:55:20.182229] [DEBUG] [LOCAL ] NOA: Loaded 16516 existing records from primary storage. [2025-09-17T22:55:20.199266] [INFO ] [MAIN ] NOA: Loaded 16516 primary data records. [2025-09-17T22:55:20.569992] [DEBUG] [LOCAL ] NNN: Loaded 48485 existing records from primary storage. [2025-09-17T22:55:20.600762] [INFO ] [MAIN ] NNN: Loaded 48485 primary data records. [2025-09-17T22:55:21.041899] [DEBUG] [MAIN ] NNY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:21.042806] [INFO ] [MAIN ] NNY: Generated 1794 derivative records from 5683 primary records. [2025-09-17T22:55:21.043202] [DEBUG] [LOCAL ] NNY: Saving derivative data. [2025-09-17T22:55:21.072890] [DEBUG] [MAIN ] NOA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:21.074935] [INFO ] [MAIN ] NOA: Generated 1794 derivative records from 16516 primary records. [2025-09-17T22:55:21.075335] [DEBUG] [LOCAL ] NOA: Saving derivative data. [2025-09-17T22:55:21.075838] [DEBUG] [LOCAL ] NNY: Derivative data saved (1794 records). [2025-09-17T22:55:21.076311] [INFO ] [MAIN ] NNY: Successfully saved derivative data. [2025-09-17T22:55:21.078953] [INFO ] [MAIN ] Derivative Progress: 1306/2085 symbols completed. NNY took 1.0s. Estimated remaining: 5m 4s. Rate: 154.0 symbols/min [2025-09-17T22:55:21.086613] [INFO ] [MAIN ] NOAH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:21.095804] [DEBUG] [LOCAL ] NOA: Derivative data saved (1794 records). [2025-09-17T22:55:21.096162] [INFO ] [MAIN ] NOA: Successfully saved derivative data. [2025-09-17T22:55:21.099391] [INFO ] [MAIN ] Derivative Progress: 1307/2085 symbols completed. NOA took 1.0s. Estimated remaining: 5m 3s. Rate: 154.1 symbols/min [2025-09-17T22:55:21.099777] [INFO ] [MAIN ] NOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:21.119571] [DEBUG] [MAIN ] NNN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:21.120464] [INFO ] [MAIN ] NNN: Generated 1794 derivative records from 48485 primary records. [2025-09-17T22:55:21.120619] [DEBUG] [LOCAL ] NNN: Saving derivative data. [2025-09-17T22:55:21.141531] [DEBUG] [LOCAL ] NOAH: Loaded 20033 existing records from primary storage. [2025-09-17T22:55:21.142124] [INFO ] [MAIN ] NOAH: Loaded 20033 primary data records. [2025-09-17T22:55:21.195629] [DEBUG] [LOCAL ] NNN: Derivative data saved (1794 records). [2025-09-17T22:55:21.212586] [INFO ] [MAIN ] NNN: Successfully saved derivative data. [2025-09-17T22:55:21.220449] [INFO ] [MAIN ] Derivative Progress: 1308/2085 symbols completed. NNN took 1.2s. Estimated remaining: 5m 2s. Rate: 154.2 symbols/min [2025-09-17T22:55:21.227583] [INFO ] [MAIN ] NOG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:21.472684] [DEBUG] [LOCAL ] NOC: Loaded 42935 existing records from primary storage. [2025-09-17T22:55:21.473519] [INFO ] [MAIN ] NOC: Loaded 42935 primary data records. [2025-09-17T22:55:21.684585] [DEBUG] [LOCAL ] NOG: Loaded 51172 existing records from primary storage. [2025-09-17T22:55:21.690800] [INFO ] [MAIN ] NOG: Loaded 51172 primary data records. [2025-09-17T22:55:22.178854] [DEBUG] [MAIN ] NOAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:22.179781] [INFO ] [MAIN ] NOAH: Generated 1794 derivative records from 20033 primary records. [2025-09-17T22:55:22.180131] [DEBUG] [LOCAL ] NOAH: Saving derivative data. [2025-09-17T22:55:22.198629] [DEBUG] [LOCAL ] NOAH: Derivative data saved (1794 records). [2025-09-17T22:55:22.199121] [INFO ] [MAIN ] NOAH: Successfully saved derivative data. [2025-09-17T22:55:22.203345] [INFO ] [MAIN ] Derivative Progress: 1309/2085 symbols completed. NOAH took 1.1s. Estimated remaining: 5m 2s. Rate: 154.0 symbols/min [2025-09-17T22:55:22.205119] [INFO ] [MAIN ] NOK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:22.219364] [DEBUG] [MAIN ] NOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:22.220222] [INFO ] [MAIN ] NOC: Generated 1794 derivative records from 42935 primary records. [2025-09-17T22:55:22.220459] [DEBUG] [LOCAL ] NOC: Saving derivative data. [2025-09-17T22:55:22.237155] [DEBUG] [LOCAL ] NOC: Derivative data saved (1794 records). [2025-09-17T22:55:22.237282] [INFO ] [MAIN ] NOC: Successfully saved derivative data. [2025-09-17T22:55:22.239493] [INFO ] [MAIN ] Derivative Progress: 1310/2085 symbols completed. NOC took 1.1s. Estimated remaining: 5m 2s. Rate: 154.1 symbols/min [2025-09-17T22:55:22.239883] [INFO ] [MAIN ] NOMD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:22.257502] [DEBUG] [MAIN ] NOG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:22.258272] [INFO ] [MAIN ] NOG: Generated 1794 derivative records from 51172 primary records. [2025-09-17T22:55:22.258406] [DEBUG] [LOCAL ] NOG: Saving derivative data. [2025-09-17T22:55:22.275931] [DEBUG] [LOCAL ] NOG: Derivative data saved (1794 records). [2025-09-17T22:55:22.276322] [INFO ] [MAIN ] NOG: Successfully saved derivative data. [2025-09-17T22:55:22.294231] [INFO ] [MAIN ] Derivative Progress: 1311/2085 symbols completed. NOG took 1.1s. Estimated remaining: 5m 1s. Rate: 154.2 symbols/min [2025-09-17T22:55:22.294760] [INFO ] [MAIN ] NOTE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:22.323678] [DEBUG] [LOCAL ] NOK: Loaded 53621 existing records from primary storage. [2025-09-17T22:55:22.323949] [INFO ] [MAIN ] NOK: Loaded 53621 primary data records. [2025-09-17T22:55:22.451864] [DEBUG] [LOCAL ] NOMD: Loaded 41492 existing records from primary storage. [2025-09-17T22:55:22.452114] [INFO ] [MAIN ] NOMD: Loaded 41492 primary data records. [2025-09-17T22:55:22.651446] [DEBUG] [LOCAL ] NOTE: Loaded 43496 existing records from primary storage. [2025-09-17T22:55:22.837867] [INFO ] [MAIN ] NOTE: Loaded 43496 primary data records. [2025-09-17T22:55:23.304637] [DEBUG] [MAIN ] NOK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:23.305501] [INFO ] [MAIN ] NOK: Generated 1794 derivative records from 53621 primary records. [2025-09-17T22:55:23.305621] [DEBUG] [LOCAL ] NOK: Saving derivative data. [2025-09-17T22:55:23.304354] [DEBUG] [MAIN ] NOMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:23.306621] [INFO ] [MAIN ] NOMD: Generated 1794 derivative records from 41492 primary records. [2025-09-17T22:55:23.307508] [DEBUG] [LOCAL ] NOMD: Saving derivative data. [2025-09-17T22:55:23.334873] [DEBUG] [LOCAL ] NOK: Derivative data saved (1794 records). [2025-09-17T22:55:23.338992] [DEBUG] [LOCAL ] NOMD: Derivative data saved (1794 records). [2025-09-17T22:55:23.339183] [INFO ] [MAIN ] NOK: Successfully saved derivative data. [2025-09-17T22:55:23.341321] [INFO ] [MAIN ] Derivative Progress: 1312/2085 symbols completed. NOK took 1.1s. Estimated remaining: 5m 1s. Rate: 154.0 symbols/min [2025-09-17T22:55:23.341398] [INFO ] [MAIN ] NOMD: Successfully saved derivative data. [2025-09-17T22:55:23.344500] [INFO ] [MAIN ] NOV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:23.344771] [INFO ] [MAIN ] Derivative Progress: 1313/2085 symbols completed. NOMD took 1.1s. Estimated remaining: 5m 1s. Rate: 154.1 symbols/min [2025-09-17T22:55:23.345251] [INFO ] [MAIN ] NPCT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:23.363161] [DEBUG] [MAIN ] NOTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:23.363883] [INFO ] [MAIN ] NOTE: Generated 1794 derivative records from 43496 primary records. [2025-09-17T22:55:23.368445] [DEBUG] [LOCAL ] NOTE: Saving derivative data. [2025-09-17T22:55:23.389352] [DEBUG] [LOCAL ] NPCT: Loaded 17050 existing records from primary storage. [2025-09-17T22:55:23.389977] [INFO ] [MAIN ] NPCT: Loaded 17050 primary data records. [2025-09-17T22:55:23.465688] [DEBUG] [LOCAL ] NOTE: Derivative data saved (1794 records). [2025-09-17T22:55:23.496956] [INFO ] [MAIN ] NOTE: Successfully saved derivative data. [2025-09-17T22:55:23.518628] [INFO ] [MAIN ] Derivative Progress: 1314/2085 symbols completed. NOTE took 1.2s. Estimated remaining: 5m 0s. Rate: 154.2 symbols/min [2025-09-17T22:55:23.519492] [INFO ] [MAIN ] NPFD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:23.719975] [DEBUG] [LOCAL ] NOV: Loaded 53200 existing records from primary storage. [2025-09-17T22:55:23.736264] [INFO ] [MAIN ] NOV: Loaded 53200 primary data records. [2025-09-17T22:55:23.791977] [DEBUG] [LOCAL ] NPFD: Loaded 9711 existing records from primary storage. [2025-09-17T22:55:23.833196] [INFO ] [MAIN ] NPFD: Loaded 9711 primary data records. [2025-09-17T22:55:24.416403] [DEBUG] [MAIN ] NPCT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:24.418067] [INFO ] [MAIN ] NPCT: Generated 1794 derivative records from 17050 primary records. [2025-09-17T22:55:24.418411] [DEBUG] [LOCAL ] NPCT: Saving derivative data. [2025-09-17T22:55:24.437893] [DEBUG] [LOCAL ] NPCT: Derivative data saved (1794 records). [2025-09-17T22:55:24.438536] [INFO ] [MAIN ] NPCT: Successfully saved derivative data. [2025-09-17T22:55:24.440884] [INFO ] [MAIN ] Derivative Progress: 1315/2085 symbols completed. NPCT took 1.1s. Estimated remaining: 4m 60s. Rate: 154.0 symbols/min [2025-09-17T22:55:24.441354] [INFO ] [MAIN ] NPK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:24.459462] [DEBUG] [MAIN ] NOV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:24.462726] [INFO ] [MAIN ] NOV: Generated 1794 derivative records from 53200 primary records. [2025-09-17T22:55:24.462917] [DEBUG] [LOCAL ] NOV: Saving derivative data. [2025-09-17T22:55:24.476404] [DEBUG] [LOCAL ] NPK: Loaded 8169 existing records from primary storage. [2025-09-17T22:55:24.483278] [DEBUG] [LOCAL ] NOV: Derivative data saved (1794 records). [2025-09-17T22:55:24.483551] [INFO ] [MAIN ] NOV: Successfully saved derivative data. [2025-09-17T22:55:24.484628] [INFO ] [MAIN ] NPK: Loaded 8169 primary data records. [2025-09-17T22:55:24.487198] [INFO ] [MAIN ] Derivative Progress: 1316/2085 symbols completed. NOV took 1.1s. Estimated remaining: 4m 59s. Rate: 154.1 symbols/min [2025-09-17T22:55:24.493790] [INFO ] [MAIN ] NPO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:24.586274] [DEBUG] [MAIN ] NPFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:24.609758] [INFO ] [MAIN ] NPFD: Generated 1794 derivative records from 9711 primary records. [2025-09-17T22:55:24.619338] [DEBUG] [LOCAL ] NPFD: Saving derivative data. [2025-09-17T22:55:24.700153] [DEBUG] [LOCAL ] NPO: Loaded 12875 existing records from primary storage. [2025-09-17T22:55:24.825340] [INFO ] [MAIN ] NPO: Loaded 12875 primary data records. [2025-09-17T22:55:24.911058] [DEBUG] [LOCAL ] NPFD: Derivative data saved (1794 records). [2025-09-17T22:55:24.922678] [INFO ] [MAIN ] NPFD: Successfully saved derivative data. [2025-09-17T22:55:24.925922] [INFO ] [MAIN ] Derivative Progress: 1317/2085 symbols completed. NPFD took 1.4s. Estimated remaining: 4m 59s. Rate: 154.1 symbols/min [2025-09-17T22:55:24.931671] [INFO ] [MAIN ] NPV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:25.148805] [DEBUG] [LOCAL ] NPV: Loaded 4973 existing records from primary storage. [2025-09-17T22:55:25.149955] [INFO ] [MAIN ] NPV: Loaded 4973 primary data records. [2025-09-17T22:55:25.296552] [DEBUG] [MAIN ] NPK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:25.347507] [INFO ] [MAIN ] NPK: Generated 1794 derivative records from 8169 primary records. [2025-09-17T22:55:25.469862] [DEBUG] [LOCAL ] NPK: Saving derivative data. [2025-09-17T22:55:25.491456] [DEBUG] [LOCAL ] NPK: Derivative data saved (1794 records). [2025-09-17T22:55:25.491740] [INFO ] [MAIN ] NPK: Successfully saved derivative data. [2025-09-17T22:55:25.494070] [INFO ] [MAIN ] Derivative Progress: 1318/2085 symbols completed. NPK took 1.1s. Estimated remaining: 4m 59s. Rate: 154.1 symbols/min [2025-09-17T22:55:25.510681] [DEBUG] [MAIN ] NPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:25.511329] [INFO ] [MAIN ] NPO: Generated 1794 derivative records from 12875 primary records. [2025-09-17T22:55:25.511484] [DEBUG] [LOCAL ] NPO: Saving derivative data. [2025-09-17T22:55:25.529572] [DEBUG] [LOCAL ] NPO: Derivative data saved (1794 records). [2025-09-17T22:55:25.529820] [INFO ] [MAIN ] NPO: Successfully saved derivative data. [2025-09-17T22:55:25.544874] [INFO ] [MAIN ] Derivative Progress: 1319/2085 symbols completed. NPO took 1.1s. Estimated remaining: 4m 58s. Rate: 154.2 symbols/min [2025-09-17T22:55:25.542322] [DEBUG] [MAIN ] NPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:25.545808] [INFO ] [MAIN ] NPV: Generated 1794 derivative records from 4973 primary records. [2025-09-17T22:55:25.545943] [DEBUG] [LOCAL ] NPV: Saving derivative data. [2025-09-17T22:55:25.560050] [DEBUG] [LOCAL ] NPV: Derivative data saved (1794 records). [2025-09-17T22:55:25.560126] [INFO ] [MAIN ] NPV: Successfully saved derivative data. [2025-09-17T22:55:25.562860] [INFO ] [MAIN ] Derivative Progress: 1320/2085 symbols completed. NPV took 0.6s. Estimated remaining: 4m 58s. Rate: 154.3 symbols/min [2025-09-17T22:55:25.563612] [INFO ] [MAIN ] NPWR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:25.564031] [INFO ] [MAIN ] NRDY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:25.563497] [INFO ] [MAIN ] NQP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:25.579743] [DEBUG] [LOCAL ] NQP: Loaded 9172 existing records from primary storage. [2025-09-17T22:55:25.579922] [INFO ] [MAIN ] NQP: Loaded 9172 primary data records. [2025-09-17T22:55:25.824587] [DEBUG] [LOCAL ] NRDY: Loaded 33268 existing records from primary storage. [2025-09-17T22:55:25.964908] [DEBUG] [LOCAL ] NPWR: Loaded 42960 existing records from primary storage. [2025-09-17T22:55:25.965024] [INFO ] [MAIN ] NRDY: Loaded 33268 primary data records. [2025-09-17T22:55:25.978879] [INFO ] [MAIN ] NPWR: Loaded 42960 primary data records. [2025-09-17T22:55:26.642362] [DEBUG] [MAIN ] NQP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:26.643567] [INFO ] [MAIN ] NQP: Generated 1794 derivative records from 9172 primary records. [2025-09-17T22:55:26.643729] [DEBUG] [LOCAL ] NQP: Saving derivative data. [2025-09-17T22:55:26.664170] [DEBUG] [LOCAL ] NQP: Derivative data saved (1794 records). [2025-09-17T22:55:26.665128] [INFO ] [MAIN ] NQP: Successfully saved derivative data. [2025-09-17T22:55:26.667780] [INFO ] [MAIN ] Derivative Progress: 1321/2085 symbols completed. NQP took 1.1s. Estimated remaining: 4m 58s. Rate: 154.1 symbols/min [2025-09-17T22:55:26.681131] [INFO ] [MAIN ] NREF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:26.681830] [DEBUG] [MAIN ] NRDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:26.683463] [INFO ] [MAIN ] NRDY: Generated 1794 derivative records from 33268 primary records. [2025-09-17T22:55:26.683561] [DEBUG] [LOCAL ] NRDY: Saving derivative data. [2025-09-17T22:55:26.708795] [DEBUG] [LOCAL ] NREF: Loaded 7790 existing records from primary storage. [2025-09-17T22:55:26.709971] [DEBUG] [LOCAL ] NRDY: Derivative data saved (1794 records). [2025-09-17T22:55:26.718774] [INFO ] [MAIN ] NREF: Loaded 7790 primary data records. [2025-09-17T22:55:26.718712] [INFO ] [MAIN ] NRDY: Successfully saved derivative data. [2025-09-17T22:55:26.764839] [INFO ] [MAIN ] Derivative Progress: 1322/2085 symbols completed. NRDY took 1.2s. Estimated remaining: 4m 57s. Rate: 154.2 symbols/min [2025-09-17T22:55:26.761710] [DEBUG] [MAIN ] NPWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:26.800503] [INFO ] [MAIN ] NPWR: Generated 1794 derivative records from 42960 primary records. [2025-09-17T22:55:26.818125] [DEBUG] [LOCAL ] NPWR: Saving derivative data. [2025-09-17T22:55:26.825286] [INFO ] [MAIN ] NRGV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:26.893913] [DEBUG] [LOCAL ] NPWR: Derivative data saved (1794 records). [2025-09-17T22:55:26.902894] [INFO ] [MAIN ] NPWR: Successfully saved derivative data. [2025-09-17T22:55:26.929702] [INFO ] [MAIN ] Derivative Progress: 1323/2085 symbols completed. NPWR took 1.4s. Estimated remaining: 4m 56s. Rate: 154.2 symbols/min [2025-09-17T22:55:26.935288] [INFO ] [MAIN ] NRK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:27.080619] [DEBUG] [LOCAL ] NRK: Loaded 19512 existing records from primary storage. [2025-09-17T22:55:27.089941] [INFO ] [MAIN ] NRK: Loaded 19512 primary data records. [2025-09-17T22:55:27.227539] [DEBUG] [LOCAL ] NRGV: Loaded 42685 existing records from primary storage. [2025-09-17T22:55:27.258318] [INFO ] [MAIN ] NRGV: Loaded 42685 primary data records. [2025-09-17T22:55:27.533419] [DEBUG] [MAIN ] NREF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:27.547021] [INFO ] [MAIN ] NREF: Generated 1794 derivative records from 7790 primary records. [2025-09-17T22:55:27.573172] [DEBUG] [LOCAL ] NREF: Saving derivative data. [2025-09-17T22:55:27.768170] [DEBUG] [LOCAL ] NREF: Derivative data saved (1794 records). [2025-09-17T22:55:27.768585] [INFO ] [MAIN ] NREF: Successfully saved derivative data. [2025-09-17T22:55:27.771201] [INFO ] [MAIN ] Derivative Progress: 1324/2085 symbols completed. NREF took 1.1s. Estimated remaining: 4m 56s. Rate: 154.1 symbols/min [2025-09-17T22:55:27.772606] [INFO ] [MAIN ] NRP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:27.785206] [DEBUG] [LOCAL ] NRP: Loaded 4153 existing records from primary storage. [2025-09-17T22:55:27.798066] [INFO ] [MAIN ] NRP: Loaded 4153 primary data records. [2025-09-17T22:55:27.810338] [DEBUG] [MAIN ] NRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:27.844806] [INFO ] [MAIN ] NRK: Generated 1794 derivative records from 19512 primary records. [2025-09-17T22:55:27.858041] [DEBUG] [LOCAL ] NRK: Saving derivative data. [2025-09-17T22:55:27.982962] [DEBUG] [LOCAL ] NRK: Derivative data saved (1794 records). [2025-09-17T22:55:28.012548] [INFO ] [MAIN ] NRK: Successfully saved derivative data. [2025-09-17T22:55:28.085045] [INFO ] [MAIN ] Derivative Progress: 1325/2085 symbols completed. NRK took 1.2s. Estimated remaining: 4m 56s. Rate: 154.1 symbols/min [2025-09-17T22:55:28.188777] [INFO ] [MAIN ] NRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:28.190788] [DEBUG] [MAIN ] NRGV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:28.193331] [INFO ] [MAIN ] NRGV: Generated 1794 derivative records from 42685 primary records. [2025-09-17T22:55:28.194057] [DEBUG] [LOCAL ] NRGV: Saving derivative data. [2025-09-17T22:55:28.212371] [DEBUG] [LOCAL ] NRT: Loaded 4936 existing records from primary storage. [2025-09-17T22:55:28.214816] [DEBUG] [LOCAL ] NRGV: Derivative data saved (1794 records). [2025-09-17T22:55:28.215390] [INFO ] [MAIN ] NRGV: Successfully saved derivative data. [2025-09-17T22:55:28.218290] [INFO ] [MAIN ] NRT: Loaded 4936 primary data records. [2025-09-17T22:55:28.218193] [INFO ] [MAIN ] Derivative Progress: 1326/2085 symbols completed. NRGV took 1.4s. Estimated remaining: 4m 55s. Rate: 154.2 symbols/min [2025-09-17T22:55:28.240065] [INFO ] [MAIN ] NRUC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:28.330886] [DEBUG] [LOCAL ] NRUC: Loaded 3126 existing records from primary storage. [2025-09-17T22:55:28.346892] [INFO ] [MAIN ] NRUC: Loaded 3126 primary data records. [2025-09-17T22:55:28.692110] [DEBUG] [MAIN ] NRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:28.713845] [INFO ] [MAIN ] NRP: Generated 1794 derivative records from 4153 primary records. [2025-09-17T22:55:28.735630] [DEBUG] [LOCAL ] NRP: Saving derivative data. [2025-09-17T22:55:28.915321] [DEBUG] [LOCAL ] NRP: Derivative data saved (1794 records). [2025-09-17T22:55:28.915703] [INFO ] [MAIN ] NRP: Successfully saved derivative data. [2025-09-17T22:55:28.918681] [INFO ] [MAIN ] Derivative Progress: 1327/2085 symbols completed. NRP took 1.1s. Estimated remaining: 4m 55s. Rate: 154.1 symbols/min [2025-09-17T22:55:28.919258] [INFO ] [MAIN ] NSA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:28.943290] [DEBUG] [MAIN ] NRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:28.948135] [INFO ] [MAIN ] NRT: Generated 1794 derivative records from 4936 primary records. [2025-09-17T22:55:28.949151] [DEBUG] [LOCAL ] NRT: Saving derivative data. [2025-09-17T22:55:28.983569] [DEBUG] [MAIN ] NRUC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:28.985233] [INFO ] [MAIN ] NRUC: Generated 1794 derivative records from 3126 primary records. [2025-09-17T22:55:28.986878] [DEBUG] [LOCAL ] NRUC: Saving derivative data. [2025-09-17T22:55:29.010395] [DEBUG] [LOCAL ] NRT: Derivative data saved (1794 records). [2025-09-17T22:55:29.015110] [INFO ] [MAIN ] NRT: Successfully saved derivative data. [2025-09-17T22:55:29.017337] [DEBUG] [LOCAL ] NSA: Loaded 44818 existing records from primary storage. [2025-09-17T22:55:29.017934] [INFO ] [MAIN ] NSA: Loaded 44818 primary data records. [2025-09-17T22:55:29.020589] [INFO ] [MAIN ] Derivative Progress: 1328/2085 symbols completed. NRT took 0.8s. Estimated remaining: 4m 55s. Rate: 154.2 symbols/min [2025-09-17T22:55:29.041906] [INFO ] [MAIN ] NSP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:29.042026] [DEBUG] [LOCAL ] NRUC: Derivative data saved (1794 records). [2025-09-17T22:55:29.064750] [INFO ] [MAIN ] NRUC: Successfully saved derivative data. [2025-09-17T22:55:29.079940] [INFO ] [MAIN ] Derivative Progress: 1329/2085 symbols completed. NRUC took 0.9s. Estimated remaining: 4m 54s. Rate: 154.3 symbols/min [2025-09-17T22:55:29.121532] [INFO ] [MAIN ] NTB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:29.349988] [DEBUG] [LOCAL ] NTB: Loaded 20852 existing records from primary storage. [2025-09-17T22:55:29.350328] [INFO ] [MAIN ] NTB: Loaded 20852 primary data records. [2025-09-17T22:55:29.384571] [DEBUG] [LOCAL ] NSP: Loaded 34929 existing records from primary storage. [2025-09-17T22:55:29.401068] [INFO ] [MAIN ] NSP: Loaded 34929 primary data records. [2025-09-17T22:55:30.058149] [DEBUG] [MAIN ] NSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:30.059698] [INFO ] [MAIN ] NSA: Generated 1794 derivative records from 44818 primary records. [2025-09-17T22:55:30.059908] [DEBUG] [LOCAL ] NSA: Saving derivative data. [2025-09-17T22:55:30.079544] [DEBUG] [LOCAL ] NSA: Derivative data saved (1794 records). [2025-09-17T22:55:30.080083] [INFO ] [MAIN ] NSA: Successfully saved derivative data. [2025-09-17T22:55:30.082334] [INFO ] [MAIN ] Derivative Progress: 1330/2085 symbols completed. NSA took 1.2s. Estimated remaining: 4m 54s. Rate: 154.1 symbols/min [2025-09-17T22:55:30.083493] [INFO ] [MAIN ] NTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:30.104067] [DEBUG] [MAIN ] NTB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:30.105123] [INFO ] [MAIN ] NTB: Generated 1794 derivative records from 20852 primary records. [2025-09-17T22:55:30.105451] [DEBUG] [LOCAL ] NTB: Saving derivative data. [2025-09-17T22:55:30.136464] [DEBUG] [MAIN ] NSP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:30.137791] [INFO ] [MAIN ] NSP: Generated 1794 derivative records from 34929 primary records. [2025-09-17T22:55:30.138134] [DEBUG] [LOCAL ] NSP: Saving derivative data. [2025-09-17T22:55:30.139546] [DEBUG] [LOCAL ] NTB: Derivative data saved (1794 records). [2025-09-17T22:55:30.146991] [INFO ] [MAIN ] NTB: Successfully saved derivative data. [2025-09-17T22:55:30.153504] [INFO ] [MAIN ] Derivative Progress: 1331/2085 symbols completed. NTB took 1.0s. Estimated remaining: 4m 53s. Rate: 154.2 symbols/min [2025-09-17T22:55:30.169936] [INFO ] [MAIN ] NTST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:30.172216] [DEBUG] [LOCAL ] NSP: Derivative data saved (1794 records). [2025-09-17T22:55:30.172558] [INFO ] [MAIN ] NSP: Successfully saved derivative data. [2025-09-17T22:55:30.175095] [INFO ] [MAIN ] Derivative Progress: 1332/2085 symbols completed. NSP took 1.1s. Estimated remaining: 4m 53s. Rate: 154.3 symbols/min [2025-09-17T22:55:30.175756] [INFO ] [MAIN ] NU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:30.195774] [DEBUG] [LOCAL ] NTR: Loaded 52625 existing records from primary storage. [2025-09-17T22:55:30.196034] [INFO ] [MAIN ] NTR: Loaded 52625 primary data records. [2025-09-17T22:55:30.550818] [DEBUG] [LOCAL ] NTST: Loaded 43391 existing records from primary storage. [2025-09-17T22:55:30.552904] [INFO ] [MAIN ] NTST: Loaded 43391 primary data records. [2025-09-17T22:55:30.565190] [DEBUG] [LOCAL ] NU: Loaded 53746 existing records from primary storage. [2025-09-17T22:55:30.591426] [INFO ] [MAIN ] NU: Loaded 53746 primary data records. [2025-09-17T22:55:31.186237] [DEBUG] [MAIN ] NTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:31.188013] [INFO ] [MAIN ] NTR: Generated 1794 derivative records from 52625 primary records. [2025-09-17T22:55:31.188200] [DEBUG] [LOCAL ] NTR: Saving derivative data. [2025-09-17T22:55:31.222853] [DEBUG] [MAIN ] NTST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:31.223789] [DEBUG] [LOCAL ] NTR: Derivative data saved (1794 records). [2025-09-17T22:55:31.224735] [INFO ] [MAIN ] NTST: Generated 1794 derivative records from 43391 primary records. [2025-09-17T22:55:31.224991] [DEBUG] [LOCAL ] NTST: Saving derivative data. [2025-09-17T22:55:31.223877] [INFO ] [MAIN ] NTR: Successfully saved derivative data. [2025-09-17T22:55:31.228305] [INFO ] [MAIN ] Derivative Progress: 1333/2085 symbols completed. NTR took 1.1s. Estimated remaining: 4m 53s. Rate: 154.1 symbols/min [2025-09-17T22:55:31.246750] [DEBUG] [LOCAL ] NTST: Derivative data saved (1794 records). [2025-09-17T22:55:31.246988] [INFO ] [MAIN ] NTST: Successfully saved derivative data. [2025-09-17T22:55:31.250777] [INFO ] [MAIN ] Derivative Progress: 1334/2085 symbols completed. NTST took 1.1s. Estimated remaining: 4m 52s. Rate: 154.2 symbols/min [2025-09-17T22:55:31.264027] [DEBUG] [MAIN ] NU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:31.264880] [INFO ] [MAIN ] NU: Generated 1794 derivative records from 53746 primary records. [2025-09-17T22:55:31.264945] [DEBUG] [LOCAL ] NU: Saving derivative data. [2025-09-17T22:55:31.280984] [DEBUG] [LOCAL ] NU: Derivative data saved (1794 records). [2025-09-17T22:55:31.281117] [INFO ] [MAIN ] NU: Successfully saved derivative data. [2025-09-17T22:55:31.283770] [INFO ] [MAIN ] Derivative Progress: 1335/2085 symbols completed. NU took 1.1s. Estimated remaining: 4m 52s. Rate: 154.3 symbols/min [2025-09-17T22:55:31.284415] [INFO ] [MAIN ] NUS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:31.284685] [INFO ] [MAIN ] NUV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:31.284742] [INFO ] [MAIN ] NUVB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:31.312986] [DEBUG] [LOCAL ] NUV: Loaded 23086 existing records from primary storage. [2025-09-17T22:55:31.313311] [INFO ] [MAIN ] NUV: Loaded 23086 primary data records. [2025-09-17T22:55:31.450405] [DEBUG] [LOCAL ] NUS: Loaded 36439 existing records from primary storage. [2025-09-17T22:55:31.477377] [INFO ] [MAIN ] NUS: Loaded 36439 primary data records. [2025-09-17T22:55:31.600464] [DEBUG] [LOCAL ] NUVB: Loaded 51183 existing records from primary storage. [2025-09-17T22:55:31.752468] [INFO ] [MAIN ] NUVB: Loaded 51183 primary data records. [2025-09-17T22:55:32.358135] [DEBUG] [MAIN ] NUV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:32.359302] [INFO ] [MAIN ] NUV: Generated 1794 derivative records from 23086 primary records. [2025-09-17T22:55:32.359554] [DEBUG] [LOCAL ] NUV: Saving derivative data. [2025-09-17T22:55:32.380379] [DEBUG] [LOCAL ] NUV: Derivative data saved (1794 records). [2025-09-17T22:55:32.381029] [INFO ] [MAIN ] NUV: Successfully saved derivative data. [2025-09-17T22:55:32.383219] [INFO ] [MAIN ] Derivative Progress: 1336/2085 symbols completed. NUV took 1.1s. Estimated remaining: 4m 52s. Rate: 154.1 symbols/min [2025-09-17T22:55:32.383801] [INFO ] [MAIN ] NUW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:32.397089] [DEBUG] [MAIN ] NUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:32.399030] [INFO ] [MAIN ] NUS: Generated 1794 derivative records from 36439 primary records. [2025-09-17T22:55:32.399270] [DEBUG] [LOCAL ] NUS: Saving derivative data. [2025-09-17T22:55:32.418843] [DEBUG] [LOCAL ] NUS: Derivative data saved (1794 records). [2025-09-17T22:55:32.418929] [INFO ] [MAIN ] NUS: Successfully saved derivative data. [2025-09-17T22:55:32.421331] [INFO ] [MAIN ] Derivative Progress: 1337/2085 symbols completed. NUS took 1.1s. Estimated remaining: 4m 51s. Rate: 154.2 symbols/min [2025-09-17T22:55:32.421611] [INFO ] [MAIN ] NVG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:32.429386] [DEBUG] [LOCAL ] NUW: Loaded 7511 existing records from primary storage. [2025-09-17T22:55:32.429698] [INFO ] [MAIN ] NUW: Loaded 7511 primary data records. [2025-09-17T22:55:32.511799] [DEBUG] [MAIN ] NUVB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:32.530450] [INFO ] [MAIN ] NUVB: Generated 1794 derivative records from 51183 primary records. [2025-09-17T22:55:32.535842] [DEBUG] [LOCAL ] NUVB: Saving derivative data. [2025-09-17T22:55:32.659547] [DEBUG] [LOCAL ] NVG: Loaded 27231 existing records from primary storage. [2025-09-17T22:55:32.667564] [INFO ] [MAIN ] NVG: Loaded 27231 primary data records. [2025-09-17T22:55:32.828313] [DEBUG] [LOCAL ] NUVB: Derivative data saved (1794 records). [2025-09-17T22:55:32.858520] [INFO ] [MAIN ] NUVB: Successfully saved derivative data. [2025-09-17T22:55:32.884222] [INFO ] [MAIN ] Derivative Progress: 1338/2085 symbols completed. NUVB took 1.6s. Estimated remaining: 4m 51s. Rate: 154.2 symbols/min [2025-09-17T22:55:32.902333] [INFO ] [MAIN ] NVGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:33.135194] [DEBUG] [LOCAL ] NVGS: Loaded 31383 existing records from primary storage. [2025-09-17T22:55:33.141513] [INFO ] [MAIN ] NVGS: Loaded 31383 primary data records. [2025-09-17T22:55:33.142000] [DEBUG] [MAIN ] NUW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:33.180517] [INFO ] [MAIN ] NUW: Generated 1794 derivative records from 7511 primary records. [2025-09-17T22:55:33.209826] [DEBUG] [LOCAL ] NUW: Saving derivative data. [2025-09-17T22:55:33.315675] [DEBUG] [LOCAL ] NUW: Derivative data saved (1794 records). [2025-09-17T22:55:33.340174] [INFO ] [MAIN ] NUW: Successfully saved derivative data. [2025-09-17T22:55:33.348361] [INFO ] [MAIN ] Derivative Progress: 1339/2085 symbols completed. NUW took 1.0s. Estimated remaining: 4m 50s. Rate: 154.2 symbols/min [2025-09-17T22:55:33.463715] [INFO ] [MAIN ] NVO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:33.492461] [DEBUG] [MAIN ] NVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:33.493616] [INFO ] [MAIN ] NVG: Generated 1794 derivative records from 27231 primary records. [2025-09-17T22:55:33.493828] [DEBUG] [LOCAL ] NVG: Saving derivative data. [2025-09-17T22:55:33.517004] [DEBUG] [LOCAL ] NVG: Derivative data saved (1794 records). [2025-09-17T22:55:33.517145] [INFO ] [MAIN ] NVG: Successfully saved derivative data. [2025-09-17T22:55:33.520951] [INFO ] [MAIN ] Derivative Progress: 1340/2085 symbols completed. NVG took 1.1s. Estimated remaining: 4m 50s. Rate: 154.2 symbols/min [2025-09-17T22:55:33.521675] [INFO ] [MAIN ] NVR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:33.555010] [DEBUG] [MAIN ] NVGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:33.555894] [INFO ] [MAIN ] NVGS: Generated 1794 derivative records from 31383 primary records. [2025-09-17T22:55:33.556321] [DEBUG] [LOCAL ] NVGS: Saving derivative data. [2025-09-17T22:55:33.576793] [DEBUG] [LOCAL ] NVGS: Derivative data saved (1794 records). [2025-09-17T22:55:33.583483] [INFO ] [MAIN ] NVGS: Successfully saved derivative data. [2025-09-17T22:55:33.583961] [DEBUG] [LOCAL ] NVR: Loaded 19535 existing records from primary storage. [2025-09-17T22:55:33.601749] [INFO ] [MAIN ] NVR: Loaded 19535 primary data records. [2025-09-17T22:55:33.600196] [INFO ] [MAIN ] Derivative Progress: 1341/2085 symbols completed. NVGS took 0.7s. Estimated remaining: 4m 49s. Rate: 154.3 symbols/min [2025-09-17T22:55:33.602240] [INFO ] [MAIN ] NVRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:33.636729] [DEBUG] [LOCAL ] NVO: Loaded 53784 existing records from primary storage. [2025-09-17T22:55:33.636888] [INFO ] [MAIN ] NVO: Loaded 53784 primary data records. [2025-09-17T22:55:34.215022] [DEBUG] [LOCAL ] NVRI: Loaded 38957 existing records from primary storage. [2025-09-17T22:55:34.295408] [INFO ] [MAIN ] NVRI: Loaded 38957 primary data records. [2025-09-17T22:55:34.630589] [DEBUG] [MAIN ] NVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:34.634288] [INFO ] [MAIN ] NVR: Generated 1794 derivative records from 19535 primary records. [2025-09-17T22:55:34.634806] [DEBUG] [LOCAL ] NVR: Saving derivative data. [2025-09-17T22:55:34.649293] [DEBUG] [MAIN ] NVO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:34.662111] [INFO ] [MAIN ] NVO: Generated 1794 derivative records from 53784 primary records. [2025-09-17T22:55:34.662951] [DEBUG] [LOCAL ] NVO: Saving derivative data. [2025-09-17T22:55:34.682507] [DEBUG] [LOCAL ] NVO: Derivative data saved (1794 records). [2025-09-17T22:55:34.683117] [INFO ] [MAIN ] NVO: Successfully saved derivative data. [2025-09-17T22:55:34.686387] [INFO ] [MAIN ] Derivative Progress: 1342/2085 symbols completed. NVO took 1.2s. Estimated remaining: 4m 49s. Rate: 154.1 symbols/min [2025-09-17T22:55:34.687169] [INFO ] [MAIN ] NVS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:34.688315] [DEBUG] [LOCAL ] NVR: Derivative data saved (1794 records). [2025-09-17T22:55:34.689394] [INFO ] [MAIN ] NVR: Successfully saved derivative data. [2025-09-17T22:55:34.693109] [INFO ] [MAIN ] Derivative Progress: 1343/2085 symbols completed. NVR took 1.2s. Estimated remaining: 4m 49s. Rate: 154.2 symbols/min [2025-09-17T22:55:34.695800] [INFO ] [MAIN ] NVST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:34.712700] [DEBUG] [MAIN ] NVRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:34.713534] [INFO ] [MAIN ] NVRI: Generated 1794 derivative records from 38957 primary records. [2025-09-17T22:55:34.713630] [DEBUG] [LOCAL ] NVRI: Saving derivative data. [2025-09-17T22:55:34.730222] [DEBUG] [LOCAL ] NVRI: Derivative data saved (1794 records). [2025-09-17T22:55:34.730370] [INFO ] [MAIN ] NVRI: Successfully saved derivative data. [2025-09-17T22:55:34.732969] [INFO ] [MAIN ] Derivative Progress: 1344/2085 symbols completed. NVRI took 1.1s. Estimated remaining: 4m 48s. Rate: 154.3 symbols/min [2025-09-17T22:55:34.734121] [INFO ] [MAIN ] NVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:34.791853] [DEBUG] [LOCAL ] NVST: Loaded 51698 existing records from primary storage. [2025-09-17T22:55:34.806050] [INFO ] [MAIN ] NVST: Loaded 51698 primary data records. [2025-09-17T22:55:34.818255] [DEBUG] [LOCAL ] NVS: Loaded 51713 existing records from primary storage. [2025-09-17T22:55:34.876931] [INFO ] [MAIN ] NVS: Loaded 51713 primary data records. [2025-09-17T22:55:35.264634] [DEBUG] [LOCAL ] NVT: Loaded 51622 existing records from primary storage. [2025-09-17T22:55:35.276108] [INFO ] [MAIN ] NVT: Loaded 51622 primary data records. [2025-09-17T22:55:35.794409] [DEBUG] [MAIN ] NVST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:35.795481] [INFO ] [MAIN ] NVST: Generated 1794 derivative records from 51698 primary records. [2025-09-17T22:55:35.795594] [DEBUG] [LOCAL ] NVST: Saving derivative data. [2025-09-17T22:55:35.823464] [DEBUG] [LOCAL ] NVST: Derivative data saved (1794 records). [2025-09-17T22:55:35.829719] [INFO ] [MAIN ] NVST: Successfully saved derivative data. [2025-09-17T22:55:35.831866] [INFO ] [MAIN ] Derivative Progress: 1345/2085 symbols completed. NVST took 1.1s. Estimated remaining: 4m 48s. Rate: 154.1 symbols/min [2025-09-17T22:55:35.829592] [DEBUG] [MAIN ] NVS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:35.832329] [INFO ] [MAIN ] NWG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:35.833405] [INFO ] [MAIN ] NVS: Generated 1794 derivative records from 51713 primary records. [2025-09-17T22:55:35.833743] [DEBUG] [LOCAL ] NVS: Saving derivative data. [2025-09-17T22:55:35.868088] [DEBUG] [MAIN ] NVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:35.869405] [INFO ] [MAIN ] NVT: Generated 1794 derivative records from 51622 primary records. [2025-09-17T22:55:35.869803] [DEBUG] [LOCAL ] NVT: Saving derivative data. [2025-09-17T22:55:35.871519] [DEBUG] [LOCAL ] NVS: Derivative data saved (1794 records). [2025-09-17T22:55:35.871847] [INFO ] [MAIN ] NVS: Successfully saved derivative data. [2025-09-17T22:55:35.874159] [INFO ] [MAIN ] Derivative Progress: 1346/2085 symbols completed. NVS took 1.2s. Estimated remaining: 4m 48s. Rate: 154.2 symbols/min [2025-09-17T22:55:35.887137] [INFO ] [MAIN ] NWN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:35.889910] [DEBUG] [LOCAL ] NVT: Derivative data saved (1794 records). [2025-09-17T22:55:35.890304] [INFO ] [MAIN ] NVT: Successfully saved derivative data. [2025-09-17T22:55:35.892978] [INFO ] [MAIN ] Derivative Progress: 1347/2085 symbols completed. NVT took 1.2s. Estimated remaining: 4m 47s. Rate: 154.3 symbols/min [2025-09-17T22:55:35.893335] [INFO ] [MAIN ] NX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:35.966597] [DEBUG] [LOCAL ] NWG: Loaded 51705 existing records from primary storage. [2025-09-17T22:55:35.966895] [INFO ] [MAIN ] NWG: Loaded 51705 primary data records. [2025-09-17T22:55:36.095793] [DEBUG] [LOCAL ] NX: Loaded 33389 existing records from primary storage. [2025-09-17T22:55:36.095237] [DEBUG] [LOCAL ] NWN: Loaded 26970 existing records from primary storage. [2025-09-17T22:55:36.096101] [INFO ] [MAIN ] NX: Loaded 33389 primary data records. [2025-09-17T22:55:36.096462] [INFO ] [MAIN ] NWN: Loaded 26970 primary data records. [2025-09-17T22:55:36.958236] [DEBUG] [MAIN ] NWG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:36.959712] [INFO ] [MAIN ] NWG: Generated 1794 derivative records from 51705 primary records. [2025-09-17T22:55:36.960315] [DEBUG] [LOCAL ] NWG: Saving derivative data. [2025-09-17T22:55:36.977506] [DEBUG] [LOCAL ] NWG: Derivative data saved (1794 records). [2025-09-17T22:55:36.977714] [INFO ] [MAIN ] NWG: Successfully saved derivative data. [2025-09-17T22:55:36.979942] [INFO ] [MAIN ] Derivative Progress: 1348/2085 symbols completed. NWG took 1.1s. Estimated remaining: 4m 47s. Rate: 154.1 symbols/min [2025-09-17T22:55:36.997345] [DEBUG] [MAIN ] NWN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:36.999161] [INFO ] [MAIN ] NWN: Generated 1794 derivative records from 26970 primary records. [2025-09-17T22:55:36.999970] [DEBUG] [LOCAL ] NWN: Saving derivative data. [2025-09-17T22:55:37.025151] [DEBUG] [MAIN ] NX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:37.029737] [DEBUG] [LOCAL ] NWN: Derivative data saved (1794 records). [2025-09-17T22:55:37.029820] [INFO ] [MAIN ] NWN: Successfully saved derivative data. [2025-09-17T22:55:37.028391] [INFO ] [MAIN ] NX: Generated 1794 derivative records from 33389 primary records. [2025-09-17T22:55:37.032382] [DEBUG] [LOCAL ] NX: Saving derivative data. [2025-09-17T22:55:37.032321] [INFO ] [MAIN ] Derivative Progress: 1349/2085 symbols completed. NWN took 1.1s. Estimated remaining: 4m 46s. Rate: 154.2 symbols/min [2025-09-17T22:55:37.047622] [DEBUG] [LOCAL ] NX: Derivative data saved (1794 records). [2025-09-17T22:55:37.047708] [INFO ] [MAIN ] NX: Successfully saved derivative data. [2025-09-17T22:55:37.050219] [INFO ] [MAIN ] Derivative Progress: 1350/2085 symbols completed. NX took 1.2s. Estimated remaining: 4m 46s. Rate: 154.3 symbols/min [2025-09-17T22:55:37.051072] [INFO ] [MAIN ] NXE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:37.051207] [INFO ] [MAIN ] NXDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:37.050945] [INFO ] [MAIN ] NXC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:37.061704] [DEBUG] [LOCAL ] NXC: Loaded 4157 existing records from primary storage. [2025-09-17T22:55:37.061835] [INFO ] [MAIN ] NXC: Loaded 4157 primary data records. [2025-09-17T22:55:37.180154] [DEBUG] [LOCAL ] NXDT: Loaded 16604 existing records from primary storage. [2025-09-17T22:55:37.190923] [INFO ] [MAIN ] NXDT: Loaded 16604 primary data records. [2025-09-17T22:55:37.575497] [DEBUG] [LOCAL ] NXE: Loaded 52981 existing records from primary storage. [2025-09-17T22:55:37.610621] [INFO ] [MAIN ] NXE: Loaded 52981 primary data records. [2025-09-17T22:55:38.131240] [DEBUG] [MAIN ] NXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:38.132386] [INFO ] [MAIN ] NXC: Generated 1794 derivative records from 4157 primary records. [2025-09-17T22:55:38.140307] [DEBUG] [LOCAL ] NXC: Saving derivative data. [2025-09-17T22:55:38.147709] [DEBUG] [MAIN ] NXDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:38.154564] [INFO ] [MAIN ] NXDT: Generated 1794 derivative records from 16604 primary records. [2025-09-17T22:55:38.158631] [DEBUG] [LOCAL ] NXDT: Saving derivative data. [2025-09-17T22:55:38.162440] [DEBUG] [LOCAL ] NXC: Derivative data saved (1794 records). [2025-09-17T22:55:38.163172] [INFO ] [MAIN ] NXC: Successfully saved derivative data. [2025-09-17T22:55:38.166225] [INFO ] [MAIN ] Derivative Progress: 1351/2085 symbols completed. NXC took 1.1s. Estimated remaining: 4m 46s. Rate: 154.1 symbols/min [2025-09-17T22:55:38.173947] [INFO ] [MAIN ] NXG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:38.182593] [DEBUG] [LOCAL ] NXDT: Derivative data saved (1794 records). [2025-09-17T22:55:38.182864] [INFO ] [MAIN ] NXDT: Successfully saved derivative data. [2025-09-17T22:55:38.185681] [INFO ] [MAIN ] Derivative Progress: 1352/2085 symbols completed. NXDT took 1.1s. Estimated remaining: 4m 45s. Rate: 154.2 symbols/min [2025-09-17T22:55:38.186823] [INFO ] [MAIN ] NXJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:38.212429] [DEBUG] [MAIN ] NXE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:38.213239] [INFO ] [MAIN ] NXE: Generated 1794 derivative records from 52981 primary records. [2025-09-17T22:55:38.213351] [DEBUG] [LOCAL ] NXE: Saving derivative data. [2025-09-17T22:55:38.222953] [DEBUG] [LOCAL ] NXG: Loaded 10557 existing records from primary storage. [2025-09-17T22:55:38.235184] [INFO ] [MAIN ] NXG: Loaded 10557 primary data records. [2025-09-17T22:55:38.238250] [DEBUG] [LOCAL ] NXE: Derivative data saved (1794 records). [2025-09-17T22:55:38.259901] [INFO ] [MAIN ] NXE: Successfully saved derivative data. [2025-09-17T22:55:38.290754] [INFO ] [MAIN ] Derivative Progress: 1353/2085 symbols completed. NXE took 1.2s. Estimated remaining: 4m 45s. Rate: 154.3 symbols/min [2025-09-17T22:55:38.318420] [DEBUG] [LOCAL ] NXJ: Loaded 14804 existing records from primary storage. [2025-09-17T22:55:38.325482] [INFO ] [MAIN ] NXJ: Loaded 14804 primary data records. [2025-09-17T22:55:38.331003] [INFO ] [MAIN ] NXN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:38.513256] [DEBUG] [LOCAL ] NXN: Loaded 2339 existing records from primary storage. [2025-09-17T22:55:38.663967] [INFO ] [MAIN ] NXN: Loaded 2339 primary data records. [2025-09-17T22:55:39.238964] [DEBUG] [MAIN ] NXJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:39.238779] [DEBUG] [MAIN ] NXG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:39.240213] [INFO ] [MAIN ] NXG: Generated 1794 derivative records from 10557 primary records. [2025-09-17T22:55:39.240951] [INFO ] [MAIN ] NXJ: Generated 1794 derivative records from 14804 primary records. [2025-09-17T22:55:39.241045] [DEBUG] [LOCAL ] NXG: Saving derivative data. [2025-09-17T22:55:39.241328] [DEBUG] [LOCAL ] NXJ: Saving derivative data. [2025-09-17T22:55:39.274325] [DEBUG] [LOCAL ] NXJ: Derivative data saved (1794 records). [2025-09-17T22:55:39.271103] [DEBUG] [LOCAL ] NXG: Derivative data saved (1794 records). [2025-09-17T22:55:39.275010] [INFO ] [MAIN ] NXG: Successfully saved derivative data. [2025-09-17T22:55:39.274633] [INFO ] [MAIN ] NXJ: Successfully saved derivative data. [2025-09-17T22:55:39.278043] [INFO ] [MAIN ] Derivative Progress: 1354/2085 symbols completed. NXJ took 1.1s. Estimated remaining: 4m 45s. Rate: 154.1 symbols/min [2025-09-17T22:55:39.281019] [INFO ] [MAIN ] Derivative Progress: 1355/2085 symbols completed. NXG took 1.1s. Estimated remaining: 4m 44s. Rate: 154.3 symbols/min [2025-09-17T22:55:39.280948] [INFO ] [MAIN ] NXP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:39.282604] [INFO ] [MAIN ] NXRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:39.300062] [DEBUG] [MAIN ] NXN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:39.300936] [INFO ] [MAIN ] NXN: Generated 1794 derivative records from 2339 primary records. [2025-09-17T22:55:39.301082] [DEBUG] [LOCAL ] NXN: Saving derivative data. [2025-09-17T22:55:39.318959] [DEBUG] [LOCAL ] NXN: Derivative data saved (1794 records). [2025-09-17T22:55:39.319097] [INFO ] [MAIN ] NXN: Successfully saved derivative data. [2025-09-17T22:55:39.321813] [INFO ] [MAIN ] Derivative Progress: 1356/2085 symbols completed. NXN took 1.0s. Estimated remaining: 4m 43s. Rate: 154.4 symbols/min [2025-09-17T22:55:39.327813] [DEBUG] [LOCAL ] NXP: Loaded 12248 existing records from primary storage. [2025-09-17T22:55:39.328027] [INFO ] [MAIN ] NXP: Loaded 12248 primary data records. [2025-09-17T22:55:39.327692] [INFO ] [MAIN ] NYT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:39.448866] [DEBUG] [LOCAL ] NXRT: Loaded 18912 existing records from primary storage. [2025-09-17T22:55:39.460612] [INFO ] [MAIN ] NXRT: Loaded 18912 primary data records. [2025-09-17T22:55:39.881323] [DEBUG] [LOCAL ] NYT: Loaded 50051 existing records from primary storage. [2025-09-17T22:55:39.924717] [INFO ] [MAIN ] NYT: Loaded 50051 primary data records. [2025-09-17T22:55:40.386839] [DEBUG] [MAIN ] NXP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:40.388731] [INFO ] [MAIN ] NXP: Generated 1794 derivative records from 12248 primary records. [2025-09-17T22:55:40.391674] [DEBUG] [LOCAL ] NXP: Saving derivative data. [2025-09-17T22:55:40.424408] [DEBUG] [LOCAL ] NXP: Derivative data saved (1794 records). [2025-09-17T22:55:40.423018] [DEBUG] [MAIN ] NXRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:40.425435] [INFO ] [MAIN ] NXP: Successfully saved derivative data. [2025-09-17T22:55:40.425351] [INFO ] [MAIN ] NXRT: Generated 1794 derivative records from 18912 primary records. [2025-09-17T22:55:40.428067] [INFO ] [MAIN ] Derivative Progress: 1357/2085 symbols completed. NXP took 1.1s. Estimated remaining: 4m 43s. Rate: 154.1 symbols/min [2025-09-17T22:55:40.428169] [DEBUG] [LOCAL ] NXRT: Saving derivative data. [2025-09-17T22:55:40.429461] [INFO ] [MAIN ] NZF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:40.447542] [DEBUG] [LOCAL ] NXRT: Derivative data saved (1794 records). [2025-09-17T22:55:40.447989] [INFO ] [MAIN ] NXRT: Successfully saved derivative data. [2025-09-17T22:55:40.450734] [INFO ] [MAIN ] Derivative Progress: 1358/2085 symbols completed. NXRT took 1.2s. Estimated remaining: 4m 43s. Rate: 154.3 symbols/min [2025-09-17T22:55:40.451395] [INFO ] [MAIN ] OBDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:40.472981] [DEBUG] [MAIN ] NYT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:40.473941] [INFO ] [MAIN ] NYT: Generated 1794 derivative records from 50051 primary records. [2025-09-17T22:55:40.474108] [DEBUG] [LOCAL ] NYT: Saving derivative data. [2025-09-17T22:55:40.500827] [DEBUG] [LOCAL ] NYT: Derivative data saved (1794 records). [2025-09-17T22:55:40.501063] [INFO ] [MAIN ] NYT: Successfully saved derivative data. [2025-09-17T22:55:40.503575] [INFO ] [MAIN ] Derivative Progress: 1359/2085 symbols completed. NYT took 1.2s. Estimated remaining: 4m 42s. Rate: 154.4 symbols/min [2025-09-17T22:55:40.504081] [INFO ] [MAIN ] OBK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:40.531341] [DEBUG] [LOCAL ] NZF: Loaded 29303 existing records from primary storage. [2025-09-17T22:55:40.531717] [INFO ] [MAIN ] NZF: Loaded 29303 primary data records. [2025-09-17T22:55:40.671702] [DEBUG] [LOCAL ] OBK: Loaded 16181 existing records from primary storage. [2025-09-17T22:55:40.672720] [DEBUG] [LOCAL ] OBDC: Loaded 51636 existing records from primary storage. [2025-09-17T22:55:40.673312] [INFO ] [MAIN ] OBK: Loaded 16181 primary data records. [2025-09-17T22:55:40.673390] [INFO ] [MAIN ] OBDC: Loaded 51636 primary data records. [2025-09-17T22:55:41.536275] [DEBUG] [MAIN ] NZF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:41.537159] [INFO ] [MAIN ] NZF: Generated 1794 derivative records from 29303 primary records. [2025-09-17T22:55:41.537354] [DEBUG] [LOCAL ] NZF: Saving derivative data. [2025-09-17T22:55:41.564747] [DEBUG] [LOCAL ] NZF: Derivative data saved (1794 records). [2025-09-17T22:55:41.569897] [DEBUG] [MAIN ] OBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:41.570125] [INFO ] [MAIN ] NZF: Successfully saved derivative data. [2025-09-17T22:55:41.572903] [INFO ] [MAIN ] Derivative Progress: 1360/2085 symbols completed. NZF took 1.1s. Estimated remaining: 4m 42s. Rate: 154.2 symbols/min [2025-09-17T22:55:41.570907] [INFO ] [MAIN ] OBK: Generated 1794 derivative records from 16181 primary records. [2025-09-17T22:55:41.574163] [DEBUG] [LOCAL ] OBK: Saving derivative data. [2025-09-17T22:55:41.585013] [INFO ] [MAIN ] OC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:41.604573] [DEBUG] [LOCAL ] OBK: Derivative data saved (1794 records). [2025-09-17T22:55:41.604783] [INFO ] [MAIN ] OBK: Successfully saved derivative data. [2025-09-17T22:55:41.607827] [DEBUG] [MAIN ] OBDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:41.607399] [INFO ] [MAIN ] Derivative Progress: 1361/2085 symbols completed. OBK took 1.1s. Estimated remaining: 4m 42s. Rate: 154.3 symbols/min [2025-09-17T22:55:41.608676] [INFO ] [MAIN ] OBDC: Generated 1794 derivative records from 51636 primary records. [2025-09-17T22:55:41.608848] [DEBUG] [LOCAL ] OBDC: Saving derivative data. [2025-09-17T22:55:41.609124] [INFO ] [MAIN ] OCFT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:41.627705] [DEBUG] [LOCAL ] OBDC: Derivative data saved (1794 records). [2025-09-17T22:55:41.627862] [INFO ] [MAIN ] OBDC: Successfully saved derivative data. [2025-09-17T22:55:41.630531] [INFO ] [MAIN ] Derivative Progress: 1362/2085 symbols completed. OBDC took 1.2s. Estimated remaining: 4m 41s. Rate: 154.4 symbols/min [2025-09-17T22:55:41.631007] [INFO ] [MAIN ] ODC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:41.639299] [DEBUG] [LOCAL ] OCFT: Loaded 9480 existing records from primary storage. [2025-09-17T22:55:41.639529] [INFO ] [MAIN ] OCFT: Loaded 9480 primary data records. [2025-09-17T22:55:41.717693] [DEBUG] [LOCAL ] ODC: Loaded 8503 existing records from primary storage. [2025-09-17T22:55:41.745209] [INFO ] [MAIN ] ODC: Loaded 8503 primary data records. [2025-09-17T22:55:41.941819] [DEBUG] [LOCAL ] OC: Loaded 44873 existing records from primary storage. [2025-09-17T22:55:41.968766] [INFO ] [MAIN ] OC: Loaded 44873 primary data records. [2025-09-17T22:55:42.664884] [DEBUG] [MAIN ] OCFT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:42.666013] [INFO ] [MAIN ] OCFT: Generated 1794 derivative records from 9480 primary records. [2025-09-17T22:55:42.666278] [DEBUG] [LOCAL ] OCFT: Saving derivative data. [2025-09-17T22:55:42.692422] [DEBUG] [LOCAL ] OCFT: Derivative data saved (1794 records). [2025-09-17T22:55:42.697470] [INFO ] [MAIN ] OCFT: Successfully saved derivative data. [2025-09-17T22:55:42.697772] [DEBUG] [MAIN ] ODC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:42.698577] [INFO ] [MAIN ] ODC: Generated 1794 derivative records from 8503 primary records. [2025-09-17T22:55:42.698801] [DEBUG] [LOCAL ] ODC: Saving derivative data. [2025-09-17T22:55:42.700924] [INFO ] [MAIN ] Derivative Progress: 1363/2085 symbols completed. OCFT took 1.1s. Estimated remaining: 4m 41s. Rate: 154.2 symbols/min [2025-09-17T22:55:42.718700] [DEBUG] [LOCAL ] ODC: Derivative data saved (1794 records). [2025-09-17T22:55:42.718961] [INFO ] [MAIN ] ODC: Successfully saved derivative data. [2025-09-17T22:55:42.721737] [INFO ] [MAIN ] Derivative Progress: 1364/2085 symbols completed. ODC took 1.1s. Estimated remaining: 4m 40s. Rate: 154.3 symbols/min [2025-09-17T22:55:42.734367] [DEBUG] [MAIN ] OC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:42.734973] [INFO ] [MAIN ] OC: Generated 1794 derivative records from 44873 primary records. [2025-09-17T22:55:42.735034] [DEBUG] [LOCAL ] OC: Saving derivative data. [2025-09-17T22:55:42.749965] [DEBUG] [LOCAL ] OC: Derivative data saved (1794 records). [2025-09-17T22:55:42.750022] [INFO ] [MAIN ] OC: Successfully saved derivative data. [2025-09-17T22:55:42.752634] [INFO ] [MAIN ] Derivative Progress: 1365/2085 symbols completed. OC took 1.2s. Estimated remaining: 4m 40s. Rate: 154.4 symbols/min [2025-09-17T22:55:42.753365] [INFO ] [MAIN ] OFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:42.753299] [INFO ] [MAIN ] OEC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:42.753146] [INFO ] [MAIN ] ODV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:42.794883] [DEBUG] [LOCAL ] OFG: Loaded 22371 existing records from primary storage. [2025-09-17T22:55:42.803628] [INFO ] [MAIN ] OFG: Loaded 22371 primary data records. [2025-09-17T22:55:42.804344] [DEBUG] [LOCAL ] ODV: Loaded 24855 existing records from primary storage. [2025-09-17T22:55:42.817238] [INFO ] [MAIN ] ODV: Loaded 24855 primary data records. [2025-09-17T22:55:42.937285] [DEBUG] [LOCAL ] OEC: Loaded 37489 existing records from primary storage. [2025-09-17T22:55:42.994235] [INFO ] [MAIN ] OEC: Loaded 37489 primary data records. [2025-09-17T22:55:43.801398] [DEBUG] [MAIN ] OFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:43.802963] [INFO ] [MAIN ] OFG: Generated 1794 derivative records from 22371 primary records. [2025-09-17T22:55:43.803171] [DEBUG] [LOCAL ] OFG: Saving derivative data. [2025-09-17T22:55:43.834798] [DEBUG] [LOCAL ] OFG: Derivative data saved (1794 records). [2025-09-17T22:55:43.835505] [INFO ] [MAIN ] OFG: Successfully saved derivative data. [2025-09-17T22:55:43.835429] [DEBUG] [MAIN ] ODV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:43.838541] [INFO ] [MAIN ] ODV: Generated 1794 derivative records from 24855 primary records. [2025-09-17T22:55:43.846406] [DEBUG] [LOCAL ] ODV: Saving derivative data. [2025-09-17T22:55:43.837816] [INFO ] [MAIN ] Derivative Progress: 1366/2085 symbols completed. OFG took 1.1s. Estimated remaining: 4m 40s. Rate: 154.2 symbols/min [2025-09-17T22:55:43.852274] [INFO ] [MAIN ] OGE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:43.863033] [DEBUG] [MAIN ] OEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:43.864631] [INFO ] [MAIN ] OEC: Generated 1794 derivative records from 37489 primary records. [2025-09-17T22:55:43.865303] [DEBUG] [LOCAL ] OEC: Saving derivative data. [2025-09-17T22:55:43.883922] [DEBUG] [LOCAL ] ODV: Derivative data saved (1794 records). [2025-09-17T22:55:43.886809] [INFO ] [MAIN ] ODV: Successfully saved derivative data. [2025-09-17T22:55:43.887990] [DEBUG] [LOCAL ] OEC: Derivative data saved (1794 records). [2025-09-17T22:55:43.888212] [INFO ] [MAIN ] OEC: Successfully saved derivative data. [2025-09-17T22:55:43.890972] [INFO ] [MAIN ] Derivative Progress: 1367/2085 symbols completed. ODV took 1.1s. Estimated remaining: 4m 39s. Rate: 154.3 symbols/min [2025-09-17T22:55:43.893937] [INFO ] [MAIN ] OGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:43.893805] [INFO ] [MAIN ] Derivative Progress: 1368/2085 symbols completed. OEC took 1.1s. Estimated remaining: 4m 39s. Rate: 154.4 symbols/min [2025-09-17T22:55:43.894502] [INFO ] [MAIN ] OGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:43.972906] [DEBUG] [LOCAL ] OGE: Loaded 46665 existing records from primary storage. [2025-09-17T22:55:43.973224] [INFO ] [MAIN ] OGE: Loaded 46665 primary data records. [2025-09-17T22:55:43.971629] [DEBUG] [LOCAL ] OGS: Loaded 33913 existing records from primary storage. [2025-09-17T22:55:43.998832] [INFO ] [MAIN ] OGS: Loaded 33913 primary data records. [2025-09-17T22:55:44.019987] [DEBUG] [LOCAL ] OGN: Loaded 53130 existing records from primary storage. [2025-09-17T22:55:44.036409] [INFO ] [MAIN ] OGN: Loaded 53130 primary data records. [2025-09-17T22:55:44.989619] [DEBUG] [MAIN ] OGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:44.990862] [INFO ] [MAIN ] OGN: Generated 1794 derivative records from 53130 primary records. [2025-09-17T22:55:44.991231] [DEBUG] [MAIN ] OGE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:44.991360] [DEBUG] [LOCAL ] OGN: Saving derivative data. [2025-09-17T22:55:44.992376] [INFO ] [MAIN ] OGE: Generated 1794 derivative records from 46665 primary records. [2025-09-17T22:55:44.994091] [DEBUG] [LOCAL ] OGE: Saving derivative data. [2025-09-17T22:55:45.024352] [DEBUG] [LOCAL ] OGE: Derivative data saved (1794 records). [2025-09-17T22:55:45.024836] [INFO ] [MAIN ] OGE: Successfully saved derivative data. [2025-09-17T22:55:45.039903] [INFO ] [MAIN ] Derivative Progress: 1369/2085 symbols completed. OGE took 1.2s. Estimated remaining: 4m 39s. Rate: 154.2 symbols/min [2025-09-17T22:55:45.040809] [DEBUG] [MAIN ] OGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:45.041826] [INFO ] [MAIN ] OHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:45.043147] [INFO ] [MAIN ] OGS: Generated 1794 derivative records from 33913 primary records. [2025-09-17T22:55:45.044087] [DEBUG] [LOCAL ] OGS: Saving derivative data. [2025-09-17T22:55:45.044459] [DEBUG] [LOCAL ] OGN: Derivative data saved (1794 records). [2025-09-17T22:55:45.045375] [INFO ] [MAIN ] OGN: Successfully saved derivative data. [2025-09-17T22:55:45.048256] [INFO ] [MAIN ] Derivative Progress: 1370/2085 symbols completed. OGN took 1.2s. Estimated remaining: 4m 38s. Rate: 154.3 symbols/min [2025-09-17T22:55:45.049048] [INFO ] [MAIN ] OI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:45.065813] [DEBUG] [LOCAL ] OGS: Derivative data saved (1794 records). [2025-09-17T22:55:45.066056] [INFO ] [MAIN ] OGS: Successfully saved derivative data. [2025-09-17T22:55:45.068572] [INFO ] [MAIN ] Derivative Progress: 1371/2085 symbols completed. OGS took 1.2s. Estimated remaining: 4m 37s. Rate: 154.4 symbols/min [2025-09-17T22:55:45.068948] [INFO ] [MAIN ] OIA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:45.092150] [DEBUG] [LOCAL ] OIA: Loaded 13771 existing records from primary storage. [2025-09-17T22:55:45.092370] [INFO ] [MAIN ] OIA: Loaded 13771 primary data records. [2025-09-17T22:55:45.305458] [DEBUG] [LOCAL ] OI: Loaded 47447 existing records from primary storage. [2025-09-17T22:55:45.344859] [DEBUG] [LOCAL ] OHI: Loaded 52161 existing records from primary storage. [2025-09-17T22:55:45.337382] [INFO ] [MAIN ] OI: Loaded 47447 primary data records. [2025-09-17T22:55:45.459937] [INFO ] [MAIN ] OHI: Loaded 52161 primary data records. [2025-09-17T22:55:46.099050] [DEBUG] [MAIN ] OIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:46.101236] [INFO ] [MAIN ] OIA: Generated 1794 derivative records from 13771 primary records. [2025-09-17T22:55:46.101869] [DEBUG] [LOCAL ] OIA: Saving derivative data. [2025-09-17T22:55:46.122242] [DEBUG] [LOCAL ] OIA: Derivative data saved (1794 records). [2025-09-17T22:55:46.123852] [INFO ] [MAIN ] OIA: Successfully saved derivative data. [2025-09-17T22:55:46.125992] [INFO ] [MAIN ] Derivative Progress: 1372/2085 symbols completed. OIA took 1.1s. Estimated remaining: 4m 37s. Rate: 154.2 symbols/min [2025-09-17T22:55:46.126637] [INFO ] [MAIN ] OII: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:46.142124] [DEBUG] [MAIN ] OHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:46.155156] [INFO ] [MAIN ] OHI: Generated 1794 derivative records from 52161 primary records. [2025-09-17T22:55:46.155442] [DEBUG] [MAIN ] OI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:46.155706] [DEBUG] [LOCAL ] OHI: Saving derivative data. [2025-09-17T22:55:46.156833] [INFO ] [MAIN ] OI: Generated 1794 derivative records from 47447 primary records. [2025-09-17T22:55:46.157019] [DEBUG] [LOCAL ] OI: Saving derivative data. [2025-09-17T22:55:46.188392] [DEBUG] [LOCAL ] OHI: Derivative data saved (1794 records). [2025-09-17T22:55:46.188506] [INFO ] [MAIN ] OHI: Successfully saved derivative data. [2025-09-17T22:55:46.188284] [DEBUG] [LOCAL ] OI: Derivative data saved (1794 records). [2025-09-17T22:55:46.191168] [INFO ] [MAIN ] Derivative Progress: 1373/2085 symbols completed. OHI took 1.1s. Estimated remaining: 4m 37s. Rate: 154.3 symbols/min [2025-09-17T22:55:46.191589] [INFO ] [MAIN ] OI: Successfully saved derivative data. [2025-09-17T22:55:46.191437] [INFO ] [MAIN ] OIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:46.194696] [INFO ] [MAIN ] Derivative Progress: 1374/2085 symbols completed. OI took 1.1s. Estimated remaining: 4m 36s. Rate: 154.4 symbols/min [2025-09-17T22:55:46.194964] [INFO ] [MAIN ] OKE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:46.235355] [DEBUG] [LOCAL ] OII: Loaded 43182 existing records from primary storage. [2025-09-17T22:55:46.235522] [INFO ] [MAIN ] OII: Loaded 43182 primary data records. [2025-09-17T22:55:46.396678] [DEBUG] [LOCAL ] OIS: Loaded 41002 existing records from primary storage. [2025-09-17T22:55:46.455635] [INFO ] [MAIN ] OIS: Loaded 41002 primary data records. [2025-09-17T22:55:46.678190] [DEBUG] [LOCAL ] OKE: Loaded 53536 existing records from primary storage. [2025-09-17T22:55:46.695411] [INFO ] [MAIN ] OKE: Loaded 53536 primary data records. [2025-09-17T22:55:47.292544] [DEBUG] [MAIN ] OII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:47.295424] [INFO ] [MAIN ] OII: Generated 1794 derivative records from 43182 primary records. [2025-09-17T22:55:47.295805] [DEBUG] [LOCAL ] OII: Saving derivative data. [2025-09-17T22:55:47.334022] [DEBUG] [LOCAL ] OII: Derivative data saved (1794 records). [2025-09-17T22:55:47.333934] [DEBUG] [MAIN ] OIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:47.334408] [INFO ] [MAIN ] OII: Successfully saved derivative data. [2025-09-17T22:55:47.344680] [INFO ] [MAIN ] Derivative Progress: 1375/2085 symbols completed. OII took 1.2s. Estimated remaining: 4m 36s. Rate: 154.2 symbols/min [2025-09-17T22:55:47.350639] [INFO ] [MAIN ] OIS: Generated 1794 derivative records from 41002 primary records. [2025-09-17T22:55:47.351172] [DEBUG] [LOCAL ] OIS: Saving derivative data. [2025-09-17T22:55:47.351032] [DEBUG] [MAIN ] OKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:47.349675] [INFO ] [MAIN ] OLN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:47.352492] [INFO ] [MAIN ] OKE: Generated 1794 derivative records from 53536 primary records. [2025-09-17T22:55:47.352905] [DEBUG] [LOCAL ] OKE: Saving derivative data. [2025-09-17T22:55:47.382736] [DEBUG] [LOCAL ] OIS: Derivative data saved (1794 records). [2025-09-17T22:55:47.383136] [INFO ] [MAIN ] OIS: Successfully saved derivative data. [2025-09-17T22:55:47.385571] [INFO ] [MAIN ] Derivative Progress: 1376/2085 symbols completed. OIS took 1.2s. Estimated remaining: 4m 36s. Rate: 154.3 symbols/min [2025-09-17T22:55:47.385831] [INFO ] [MAIN ] OLP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:47.390591] [DEBUG] [LOCAL ] OKE: Derivative data saved (1794 records). [2025-09-17T22:55:47.390895] [INFO ] [MAIN ] OKE: Successfully saved derivative data. [2025-09-17T22:55:47.393773] [INFO ] [MAIN ] Derivative Progress: 1377/2085 symbols completed. OKE took 1.2s. Estimated remaining: 4m 35s. Rate: 154.4 symbols/min [2025-09-17T22:55:47.394948] [INFO ] [MAIN ] OMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:47.405257] [DEBUG] [LOCAL ] OLP: Loaded 9634 existing records from primary storage. [2025-09-17T22:55:47.405435] [INFO ] [MAIN ] OLP: Loaded 9634 primary data records. [2025-09-17T22:55:47.643108] [DEBUG] [LOCAL ] OLN: Loaded 51713 existing records from primary storage. [2025-09-17T22:55:47.752813] [INFO ] [MAIN ] OLN: Loaded 51713 primary data records. [2025-09-17T22:55:47.892429] [DEBUG] [LOCAL ] OMC: Loaded 53293 existing records from primary storage. [2025-09-17T22:55:47.904241] [INFO ] [MAIN ] OMC: Loaded 53293 primary data records. [2025-09-17T22:55:48.474103] [DEBUG] [MAIN ] OLP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:48.475746] [INFO ] [MAIN ] OLP: Generated 1794 derivative records from 9634 primary records. [2025-09-17T22:55:48.476002] [DEBUG] [LOCAL ] OLP: Saving derivative data. [2025-09-17T22:55:48.508303] [DEBUG] [MAIN ] OLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:48.510885] [INFO ] [MAIN ] OLN: Generated 1794 derivative records from 51713 primary records. [2025-09-17T22:55:48.511561] [DEBUG] [LOCAL ] OLN: Saving derivative data. [2025-09-17T22:55:48.513440] [DEBUG] [LOCAL ] OLP: Derivative data saved (1794 records). [2025-09-17T22:55:48.520824] [INFO ] [MAIN ] OLP: Successfully saved derivative data. [2025-09-17T22:55:48.526979] [INFO ] [MAIN ] Derivative Progress: 1378/2085 symbols completed. OLP took 1.1s. Estimated remaining: 4m 35s. Rate: 154.2 symbols/min [2025-09-17T22:55:48.532273] [DEBUG] [LOCAL ] OLN: Derivative data saved (1794 records). [2025-09-17T22:55:48.532343] [INFO ] [MAIN ] OLN: Successfully saved derivative data. [2025-09-17T22:55:48.534695] [INFO ] [MAIN ] Derivative Progress: 1379/2085 symbols completed. OLN took 1.2s. Estimated remaining: 4m 35s. Rate: 154.3 symbols/min [2025-09-17T22:55:48.550105] [DEBUG] [MAIN ] OMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:48.550663] [INFO ] [MAIN ] OMC: Generated 1794 derivative records from 53293 primary records. [2025-09-17T22:55:48.550729] [DEBUG] [LOCAL ] OMC: Saving derivative data. [2025-09-17T22:55:48.566165] [DEBUG] [LOCAL ] OMC: Derivative data saved (1794 records). [2025-09-17T22:55:48.566225] [INFO ] [MAIN ] OMC: Successfully saved derivative data. [2025-09-17T22:55:48.568779] [INFO ] [MAIN ] Derivative Progress: 1380/2085 symbols completed. OMC took 1.2s. Estimated remaining: 4m 34s. Rate: 154.4 symbols/min [2025-09-17T22:55:48.569484] [INFO ] [MAIN ] OMF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:48.569571] [INFO ] [MAIN ] ONIT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:48.569857] [INFO ] [MAIN ] OMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:48.580481] [DEBUG] [LOCAL ] ONIT: Loaded 7821 existing records from primary storage. [2025-09-17T22:55:48.580712] [INFO ] [MAIN ] ONIT: Loaded 7821 primary data records. [2025-09-17T22:55:48.932993] [DEBUG] [LOCAL ] OMI: Loaded 45865 existing records from primary storage. [2025-09-17T22:55:48.933596] [INFO ] [MAIN ] OMI: Loaded 45865 primary data records. [2025-09-17T22:55:48.939923] [DEBUG] [LOCAL ] OMF: Loaded 46331 existing records from primary storage. [2025-09-17T22:55:48.946537] [INFO ] [MAIN ] OMF: Loaded 46331 primary data records. [2025-09-17T22:55:49.564272] [DEBUG] [MAIN ] ONIT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:55:49.566003] [INFO ] [MAIN ] ONIT: Generated 1793 derivative records from 7821 primary records. [2025-09-17T22:55:49.566991] [DEBUG] [LOCAL ] ONIT: Saving derivative data. [2025-09-17T22:55:49.589415] [DEBUG] [LOCAL ] ONIT: Derivative data saved (1793 records). [2025-09-17T22:55:49.589669] [INFO ] [MAIN ] ONIT: Successfully saved derivative data. [2025-09-17T22:55:49.592117] [INFO ] [MAIN ] Derivative Progress: 1381/2085 symbols completed. ONIT took 1.0s. Estimated remaining: 4m 34s. Rate: 154.2 symbols/min [2025-09-17T22:55:49.593930] [INFO ] [MAIN ] ONL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:49.631061] [DEBUG] [MAIN ] OMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:49.640368] [INFO ] [MAIN ] OMI: Generated 1794 derivative records from 45865 primary records. [2025-09-17T22:55:49.639486] [DEBUG] [MAIN ] OMF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:49.640488] [DEBUG] [LOCAL ] OMI: Saving derivative data. [2025-09-17T22:55:49.641632] [INFO ] [MAIN ] OMF: Generated 1794 derivative records from 46331 primary records. [2025-09-17T22:55:49.642217] [DEBUG] [LOCAL ] OMF: Saving derivative data. [2025-09-17T22:55:49.666036] [DEBUG] [LOCAL ] OMI: Derivative data saved (1794 records). [2025-09-17T22:55:49.670069] [INFO ] [MAIN ] OMI: Successfully saved derivative data. [2025-09-17T22:55:49.672639] [INFO ] [MAIN ] Derivative Progress: 1382/2085 symbols completed. OMI took 1.1s. Estimated remaining: 4m 33s. Rate: 154.3 symbols/min [2025-09-17T22:55:49.683772] [INFO ] [MAIN ] ONON: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:49.684619] [DEBUG] [LOCAL ] ONL: Loaded 32236 existing records from primary storage. [2025-09-17T22:55:49.686068] [INFO ] [MAIN ] ONL: Loaded 32236 primary data records. [2025-09-17T22:55:49.725588] [DEBUG] [LOCAL ] OMF: Derivative data saved (1794 records). [2025-09-17T22:55:49.753366] [INFO ] [MAIN ] OMF: Successfully saved derivative data. [2025-09-17T22:55:49.785300] [INFO ] [MAIN ] Derivative Progress: 1383/2085 symbols completed. OMF took 1.2s. Estimated remaining: 4m 33s. Rate: 154.4 symbols/min [2025-09-17T22:55:49.793177] [INFO ] [MAIN ] ONTF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:50.040482] [DEBUG] [LOCAL ] ONTF: Loaded 23049 existing records from primary storage. [2025-09-17T22:55:50.041872] [INFO ] [MAIN ] ONTF: Loaded 23049 primary data records. [2025-09-17T22:55:50.133466] [DEBUG] [LOCAL ] ONON: Loaded 53613 existing records from primary storage. [2025-09-17T22:55:50.167736] [INFO ] [MAIN ] ONON: Loaded 53613 primary data records. [2025-09-17T22:55:50.739153] [DEBUG] [MAIN ] ONL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:50.740332] [INFO ] [MAIN ] ONL: Generated 1794 derivative records from 32236 primary records. [2025-09-17T22:55:50.740520] [DEBUG] [LOCAL ] ONL: Saving derivative data. [2025-09-17T22:55:50.761092] [DEBUG] [LOCAL ] ONL: Derivative data saved (1794 records). [2025-09-17T22:55:50.761342] [INFO ] [MAIN ] ONL: Successfully saved derivative data. [2025-09-17T22:55:50.763201] [INFO ] [MAIN ] Derivative Progress: 1384/2085 symbols completed. ONL took 1.2s. Estimated remaining: 4m 33s. Rate: 154.2 symbols/min [2025-09-17T22:55:50.763617] [INFO ] [MAIN ] ONTO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:50.787392] [DEBUG] [MAIN ] ONTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:50.788132] [INFO ] [MAIN ] ONTF: Generated 1794 derivative records from 23049 primary records. [2025-09-17T22:55:50.788281] [DEBUG] [LOCAL ] ONTF: Saving derivative data. [2025-09-17T22:55:50.818923] [DEBUG] [LOCAL ] ONTF: Derivative data saved (1794 records). [2025-09-17T22:55:50.819204] [DEBUG] [MAIN ] ONON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:50.820069] [INFO ] [MAIN ] ONON: Generated 1794 derivative records from 53613 primary records. [2025-09-17T22:55:50.820195] [DEBUG] [LOCAL ] ONON: Saving derivative data. [2025-09-17T22:55:50.820150] [INFO ] [MAIN ] ONTF: Successfully saved derivative data. [2025-09-17T22:55:50.823035] [INFO ] [MAIN ] Derivative Progress: 1385/2085 symbols completed. ONTF took 1.0s. Estimated remaining: 4m 32s. Rate: 154.3 symbols/min [2025-09-17T22:55:50.834830] [INFO ] [MAIN ] OOMA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:50.851055] [DEBUG] [LOCAL ] ONON: Derivative data saved (1794 records). [2025-09-17T22:55:50.851203] [INFO ] [MAIN ] ONON: Successfully saved derivative data. [2025-09-17T22:55:50.854042] [INFO ] [MAIN ] Derivative Progress: 1386/2085 symbols completed. ONON took 1.2s. Estimated remaining: 4m 32s. Rate: 154.4 symbols/min [2025-09-17T22:55:50.854549] [INFO ] [MAIN ] OPAD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:50.875015] [DEBUG] [LOCAL ] ONTO: Loaded 46488 existing records from primary storage. [2025-09-17T22:55:50.875220] [INFO ] [MAIN ] ONTO: Loaded 46488 primary data records. [2025-09-17T22:55:50.958020] [DEBUG] [LOCAL ] OOMA: Loaded 19176 existing records from primary storage. [2025-09-17T22:55:50.975392] [INFO ] [MAIN ] OOMA: Loaded 19176 primary data records. [2025-09-17T22:55:50.998335] [DEBUG] [LOCAL ] OPAD: Loaded 18628 existing records from primary storage. [2025-09-17T22:55:50.998487] [INFO ] [MAIN ] OPAD: Loaded 18628 primary data records. [2025-09-17T22:55:51.841917] [DEBUG] [MAIN ] ONTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:51.843243] [INFO ] [MAIN ] ONTO: Generated 1794 derivative records from 46488 primary records. [2025-09-17T22:55:51.843684] [DEBUG] [LOCAL ] ONTO: Saving derivative data. [2025-09-17T22:55:51.882463] [DEBUG] [MAIN ] OPAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:51.896352] [INFO ] [MAIN ] OPAD: Generated 1794 derivative records from 18628 primary records. [2025-09-17T22:55:51.896683] [DEBUG] [LOCAL ] OPAD: Saving derivative data. [2025-09-17T22:55:51.897529] [DEBUG] [LOCAL ] ONTO: Derivative data saved (1794 records). [2025-09-17T22:55:51.898819] [INFO ] [MAIN ] ONTO: Successfully saved derivative data. [2025-09-17T22:55:51.900985] [INFO ] [MAIN ] Derivative Progress: 1387/2085 symbols completed. ONTO took 1.1s. Estimated remaining: 4m 32s. Rate: 154.2 symbols/min [2025-09-17T22:55:51.901622] [INFO ] [MAIN ] OPFI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:51.902237] [DEBUG] [MAIN ] OOMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:51.915583] [INFO ] [MAIN ] OOMA: Generated 1794 derivative records from 19176 primary records. [2025-09-17T22:55:51.920419] [DEBUG] [LOCAL ] OOMA: Saving derivative data. [2025-09-17T22:55:51.920130] [DEBUG] [LOCAL ] OPAD: Derivative data saved (1794 records). [2025-09-17T22:55:51.920587] [INFO ] [MAIN ] OPAD: Successfully saved derivative data. [2025-09-17T22:55:51.923280] [INFO ] [MAIN ] Derivative Progress: 1388/2085 symbols completed. OPAD took 1.1s. Estimated remaining: 4m 31s. Rate: 154.3 symbols/min [2025-09-17T22:55:51.924684] [INFO ] [MAIN ] OPP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:51.951799] [DEBUG] [LOCAL ] OPP: Loaded 11786 existing records from primary storage. [2025-09-17T22:55:51.952965] [INFO ] [MAIN ] OPP: Loaded 11786 primary data records. [2025-09-17T22:55:51.966254] [DEBUG] [LOCAL ] OOMA: Derivative data saved (1794 records). [2025-09-17T22:55:52.012627] [INFO ] [MAIN ] OOMA: Successfully saved derivative data. [2025-09-17T22:55:52.035917] [INFO ] [MAIN ] Derivative Progress: 1389/2085 symbols completed. OOMA took 1.2s. Estimated remaining: 4m 30s. Rate: 154.4 symbols/min [2025-09-17T22:55:52.055139] [INFO ] [MAIN ] OR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:52.311834] [DEBUG] [LOCAL ] OPFI: Loaded 46831 existing records from primary storage. [2025-09-17T22:55:52.312032] [INFO ] [MAIN ] OPFI: Loaded 46831 primary data records. [2025-09-17T22:55:52.596416] [DEBUG] [LOCAL ] OR: Loaded 45904 existing records from primary storage. [2025-09-17T22:55:52.603911] [INFO ] [MAIN ] OR: Loaded 45904 primary data records. [2025-09-17T22:55:53.078286] [DEBUG] [MAIN ] OPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:53.085372] [INFO ] [MAIN ] OPP: Generated 1794 derivative records from 11786 primary records. [2025-09-17T22:55:53.085689] [DEBUG] [LOCAL ] OPP: Saving derivative data. [2025-09-17T22:55:53.142357] [DEBUG] [LOCAL ] OPP: Derivative data saved (1794 records). [2025-09-17T22:55:53.142693] [INFO ] [MAIN ] OPP: Successfully saved derivative data. [2025-09-17T22:55:53.145795] [INFO ] [MAIN ] Derivative Progress: 1390/2085 symbols completed. OPP took 1.2s. Estimated remaining: 4m 30s. Rate: 154.2 symbols/min [2025-09-17T22:55:53.147125] [INFO ] [MAIN ] ORA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:53.163560] [DEBUG] [MAIN ] OPFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:53.165141] [INFO ] [MAIN ] OPFI: Generated 1794 derivative records from 46831 primary records. [2025-09-17T22:55:53.165388] [DEBUG] [LOCAL ] OPFI: Saving derivative data. [2025-09-17T22:55:53.190934] [DEBUG] [LOCAL ] OPFI: Derivative data saved (1794 records). [2025-09-17T22:55:53.191344] [INFO ] [MAIN ] OPFI: Successfully saved derivative data. [2025-09-17T22:55:53.194551] [INFO ] [MAIN ] Derivative Progress: 1391/2085 symbols completed. OPFI took 1.3s. Estimated remaining: 4m 30s. Rate: 154.3 symbols/min [2025-09-17T22:55:53.195343] [INFO ] [MAIN ] ORC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:53.220496] [DEBUG] [MAIN ] OR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:53.221820] [INFO ] [MAIN ] OR: Generated 1794 derivative records from 45904 primary records. [2025-09-17T22:55:53.222208] [DEBUG] [LOCAL ] OR: Saving derivative data. [2025-09-17T22:55:53.259083] [DEBUG] [LOCAL ] OR: Derivative data saved (1794 records). [2025-09-17T22:55:53.259520] [INFO ] [MAIN ] OR: Successfully saved derivative data. [2025-09-17T22:55:53.265479] [DEBUG] [LOCAL ] ORA: Loaded 32661 existing records from primary storage. [2025-09-17T22:55:53.263572] [INFO ] [MAIN ] Derivative Progress: 1392/2085 symbols completed. OR took 1.2s. Estimated remaining: 4m 29s. Rate: 154.4 symbols/min [2025-09-17T22:55:53.266134] [INFO ] [MAIN ] ORN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:53.266383] [INFO ] [MAIN ] ORA: Loaded 32661 primary data records. [2025-09-17T22:55:53.516065] [DEBUG] [LOCAL ] ORN: Loaded 31858 existing records from primary storage. [2025-09-17T22:55:53.534686] [INFO ] [MAIN ] ORN: Loaded 31858 primary data records. [2025-09-17T22:55:53.655971] [DEBUG] [LOCAL ] ORC: Loaded 52262 existing records from primary storage. [2025-09-17T22:55:53.688290] [INFO ] [MAIN ] ORC: Loaded 52262 primary data records. [2025-09-17T22:55:54.651708] [DEBUG] [MAIN ] ORA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:54.652604] [INFO ] [MAIN ] ORA: Generated 1794 derivative records from 32661 primary records. [2025-09-17T22:55:54.652813] [DEBUG] [LOCAL ] ORA: Saving derivative data. [2025-09-17T22:55:54.672600] [DEBUG] [LOCAL ] ORA: Derivative data saved (1794 records). [2025-09-17T22:55:54.672841] [INFO ] [MAIN ] ORA: Successfully saved derivative data. [2025-09-17T22:55:54.674821] [INFO ] [MAIN ] Derivative Progress: 1393/2085 symbols completed. ORA took 1.5s. Estimated remaining: 4m 29s. Rate: 154.1 symbols/min [2025-09-17T22:55:54.705104] [DEBUG] [MAIN ] ORC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:54.704938] [DEBUG] [MAIN ] ORN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:54.705860] [INFO ] [MAIN ] ORC: Generated 1794 derivative records from 52262 primary records. [2025-09-17T22:55:54.706506] [INFO ] [MAIN ] ORN: Generated 1794 derivative records from 31858 primary records. [2025-09-17T22:55:54.706562] [DEBUG] [LOCAL ] ORC: Saving derivative data. [2025-09-17T22:55:54.707034] [DEBUG] [LOCAL ] ORN: Saving derivative data. [2025-09-17T22:55:54.734212] [DEBUG] [LOCAL ] ORN: Derivative data saved (1794 records). [2025-09-17T22:55:54.734713] [INFO ] [MAIN ] ORN: Successfully saved derivative data. [2025-09-17T22:55:54.737378] [INFO ] [MAIN ] Derivative Progress: 1394/2085 symbols completed. ORN took 1.5s. Estimated remaining: 4m 29s. Rate: 154.2 symbols/min [2025-09-17T22:55:54.739595] [DEBUG] [LOCAL ] ORC: Derivative data saved (1794 records). [2025-09-17T22:55:54.739686] [INFO ] [MAIN ] ORC: Successfully saved derivative data. [2025-09-17T22:55:54.742261] [INFO ] [MAIN ] Derivative Progress: 1395/2085 symbols completed. ORC took 1.5s. Estimated remaining: 4m 28s. Rate: 154.3 symbols/min [2025-09-17T22:55:54.742914] [INFO ] [MAIN ] OUT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:54.742868] [INFO ] [MAIN ] OSCR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:54.742982] [INFO ] [MAIN ] OTIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:54.816857] [DEBUG] [LOCAL ] OTIS: Loaded 52715 existing records from primary storage. [2025-09-17T22:55:54.817633] [INFO ] [MAIN ] OTIS: Loaded 52715 primary data records. [2025-09-17T22:55:54.883288] [DEBUG] [LOCAL ] OSCR: Loaded 53695 existing records from primary storage. [2025-09-17T22:55:54.890995] [INFO ] [MAIN ] OSCR: Loaded 53695 primary data records. [2025-09-17T22:55:54.962116] [DEBUG] [LOCAL ] OUT: Loaded 48280 existing records from primary storage. [2025-09-17T22:55:54.979124] [INFO ] [MAIN ] OUT: Loaded 48280 primary data records. [2025-09-17T22:55:55.826186] [DEBUG] [MAIN ] OTIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:55.827366] [INFO ] [MAIN ] OTIS: Generated 1794 derivative records from 52715 primary records. [2025-09-17T22:55:55.827567] [DEBUG] [LOCAL ] OTIS: Saving derivative data. [2025-09-17T22:55:55.862528] [DEBUG] [MAIN ] OSCR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:55.860741] [DEBUG] [LOCAL ] OTIS: Derivative data saved (1794 records). [2025-09-17T22:55:55.862727] [INFO ] [MAIN ] OTIS: Successfully saved derivative data. [2025-09-17T22:55:55.866552] [INFO ] [MAIN ] Derivative Progress: 1396/2085 symbols completed. OTIS took 1.1s. Estimated remaining: 4m 28s. Rate: 154.1 symbols/min [2025-09-17T22:55:55.864256] [INFO ] [MAIN ] OSCR: Generated 1794 derivative records from 53695 primary records. [2025-09-17T22:55:55.866838] [DEBUG] [LOCAL ] OSCR: Saving derivative data. [2025-09-17T22:55:55.867927] [INFO ] [MAIN ] OVV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:55.893358] [DEBUG] [MAIN ] OUT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:55.895811] [INFO ] [MAIN ] OUT: Generated 1794 derivative records from 48280 primary records. [2025-09-17T22:55:55.895948] [DEBUG] [LOCAL ] OUT: Saving derivative data. [2025-09-17T22:55:55.909444] [DEBUG] [LOCAL ] OSCR: Derivative data saved (1794 records). [2025-09-17T22:55:55.912239] [INFO ] [MAIN ] OSCR: Successfully saved derivative data. [2025-09-17T22:55:55.914970] [INFO ] [MAIN ] Derivative Progress: 1397/2085 symbols completed. OSCR took 1.2s. Estimated remaining: 4m 28s. Rate: 154.2 symbols/min [2025-09-17T22:55:55.916376] [INFO ] [MAIN ] OWL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:55.920828] [DEBUG] [LOCAL ] OUT: Derivative data saved (1794 records). [2025-09-17T22:55:55.921454] [INFO ] [MAIN ] OUT: Successfully saved derivative data. [2025-09-17T22:55:55.924442] [INFO ] [MAIN ] Derivative Progress: 1398/2085 symbols completed. OUT took 1.2s. Estimated remaining: 4m 27s. Rate: 154.3 symbols/min [2025-09-17T22:55:55.924831] [INFO ] [MAIN ] OWLT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:55.936066] [DEBUG] [LOCAL ] OWLT: Loaded 8756 existing records from primary storage. [2025-09-17T22:55:55.936255] [INFO ] [MAIN ] OWLT: Loaded 8756 primary data records. [2025-09-17T22:55:56.175184] [DEBUG] [LOCAL ] OVV: Loaded 53517 existing records from primary storage. [2025-09-17T22:55:56.290543] [INFO ] [MAIN ] OVV: Loaded 53517 primary data records. [2025-09-17T22:55:56.432887] [DEBUG] [LOCAL ] OWL: Loaded 53556 existing records from primary storage. [2025-09-17T22:55:56.444348] [INFO ] [MAIN ] OWL: Loaded 53556 primary data records. [2025-09-17T22:55:57.020682] [DEBUG] [MAIN ] OWLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:57.022508] [INFO ] [MAIN ] OWLT: Generated 1794 derivative records from 8756 primary records. [2025-09-17T22:55:57.022971] [DEBUG] [LOCAL ] OWLT: Saving derivative data. [2025-09-17T22:55:57.055706] [DEBUG] [MAIN ] OVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:57.058365] [INFO ] [MAIN ] OVV: Generated 1794 derivative records from 53517 primary records. [2025-09-17T22:55:57.057618] [DEBUG] [LOCAL ] OWLT: Derivative data saved (1794 records). [2025-09-17T22:55:57.058841] [INFO ] [MAIN ] OWLT: Successfully saved derivative data. [2025-09-17T22:55:57.058611] [DEBUG] [LOCAL ] OVV: Saving derivative data. [2025-09-17T22:55:57.061064] [INFO ] [MAIN ] Derivative Progress: 1399/2085 symbols completed. OWLT took 1.1s. Estimated remaining: 4m 27s. Rate: 154.1 symbols/min [2025-09-17T22:55:57.062115] [INFO ] [MAIN ] OXM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:57.080509] [DEBUG] [LOCAL ] OVV: Derivative data saved (1794 records). [2025-09-17T22:55:57.080791] [INFO ] [MAIN ] OVV: Successfully saved derivative data. [2025-09-17T22:55:57.085146] [INFO ] [MAIN ] Derivative Progress: 1400/2085 symbols completed. OVV took 1.2s. Estimated remaining: 4m 27s. Rate: 154.2 symbols/min [2025-09-17T22:55:57.085602] [INFO ] [MAIN ] PAAS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:57.102267] [DEBUG] [MAIN ] OWL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:57.103188] [INFO ] [MAIN ] OWL: Generated 1794 derivative records from 53556 primary records. [2025-09-17T22:55:57.103360] [DEBUG] [LOCAL ] OWL: Saving derivative data. [2025-09-17T22:55:57.132368] [DEBUG] [LOCAL ] OWL: Derivative data saved (1794 records). [2025-09-17T22:55:57.132521] [INFO ] [MAIN ] OWL: Successfully saved derivative data. [2025-09-17T22:55:57.135368] [INFO ] [MAIN ] Derivative Progress: 1401/2085 symbols completed. OWL took 1.2s. Estimated remaining: 4m 26s. Rate: 154.3 symbols/min [2025-09-17T22:55:57.135839] [INFO ] [MAIN ] PAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:57.148930] [DEBUG] [LOCAL ] OXM: Loaded 33657 existing records from primary storage. [2025-09-17T22:55:57.149186] [INFO ] [MAIN ] OXM: Loaded 33657 primary data records. [2025-09-17T22:55:57.276104] [DEBUG] [LOCAL ] PAC: Loaded 11719 existing records from primary storage. [2025-09-17T22:55:57.280054] [INFO ] [MAIN ] PAC: Loaded 11719 primary data records. [2025-09-17T22:55:57.434287] [DEBUG] [LOCAL ] PAAS: Loaded 53603 existing records from primary storage. [2025-09-17T22:55:57.444803] [INFO ] [MAIN ] PAAS: Loaded 53603 primary data records. [2025-09-17T22:55:58.185324] [DEBUG] [MAIN ] OXM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:58.188368] [INFO ] [MAIN ] OXM: Generated 1794 derivative records from 33657 primary records. [2025-09-17T22:55:58.188504] [DEBUG] [LOCAL ] OXM: Saving derivative data. [2025-09-17T22:55:58.226236] [DEBUG] [MAIN ] PAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:58.232849] [INFO ] [MAIN ] PAC: Generated 1794 derivative records from 11719 primary records. [2025-09-17T22:55:58.233403] [DEBUG] [LOCAL ] PAC: Saving derivative data. [2025-09-17T22:55:58.233710] [DEBUG] [MAIN ] PAAS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:58.235861] [INFO ] [MAIN ] PAAS: Generated 1794 derivative records from 53603 primary records. [2025-09-17T22:55:58.235965] [DEBUG] [LOCAL ] PAAS: Saving derivative data. [2025-09-17T22:55:58.260807] [DEBUG] [LOCAL ] PAC: Derivative data saved (1794 records). [2025-09-17T22:55:58.265810] [INFO ] [MAIN ] PAC: Successfully saved derivative data. [2025-09-17T22:55:58.268289] [INFO ] [MAIN ] Derivative Progress: 1402/2085 symbols completed. PAC took 1.1s. Estimated remaining: 4m 26s. Rate: 154.1 symbols/min [2025-09-17T22:55:58.272210] [DEBUG] [LOCAL ] OXM: Derivative data saved (1794 records). [2025-09-17T22:55:58.273265] [DEBUG] [LOCAL ] PAAS: Derivative data saved (1794 records). [2025-09-17T22:55:58.273667] [INFO ] [MAIN ] PAAS: Successfully saved derivative data. [2025-09-17T22:55:58.276883] [INFO ] [MAIN ] PACK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:58.276817] [INFO ] [MAIN ] OXM: Successfully saved derivative data. [2025-09-17T22:55:58.276710] [INFO ] [MAIN ] Derivative Progress: 1403/2085 symbols completed. PAAS took 1.2s. Estimated remaining: 4m 25s. Rate: 154.2 symbols/min [2025-09-17T22:55:58.279977] [INFO ] [MAIN ] PACS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:58.279772] [INFO ] [MAIN ] Derivative Progress: 1404/2085 symbols completed. OXM took 1.2s. Estimated remaining: 4m 25s. Rate: 154.3 symbols/min [2025-09-17T22:55:58.280351] [INFO ] [MAIN ] PAG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:58.321190] [DEBUG] [LOCAL ] PAG: Loaded 22112 existing records from primary storage. [2025-09-17T22:55:58.330587] [INFO ] [MAIN ] PAG: Loaded 22112 primary data records. [2025-09-17T22:55:58.352912] [DEBUG] [LOCAL ] PACK: Loaded 31966 existing records from primary storage. [2025-09-17T22:55:58.369263] [INFO ] [MAIN ] PACK: Loaded 31966 primary data records. [2025-09-17T22:55:58.476861] [DEBUG] [LOCAL ] PACS: Loaded 33788 existing records from primary storage. [2025-09-17T22:55:58.557316] [INFO ] [MAIN ] PACS: Loaded 33788 primary data records. [2025-09-17T22:55:59.329784] [DEBUG] [MAIN ] PACK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:59.342824] [INFO ] [MAIN ] PACK: Generated 1794 derivative records from 31966 primary records. [2025-09-17T22:55:59.343205] [DEBUG] [MAIN ] PAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:59.343539] [DEBUG] [LOCAL ] PACK: Saving derivative data. [2025-09-17T22:55:59.345107] [INFO ] [MAIN ] PAG: Generated 1794 derivative records from 22112 primary records. [2025-09-17T22:55:59.345451] [DEBUG] [LOCAL ] PAG: Saving derivative data. [2025-09-17T22:55:59.390007] [DEBUG] [MAIN ] PACS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:55:59.392243] [DEBUG] [LOCAL ] PACK: Derivative data saved (1794 records). [2025-09-17T22:55:59.392167] [INFO ] [MAIN ] PACS: Generated 1794 derivative records from 33788 primary records. [2025-09-17T22:55:59.392375] [DEBUG] [LOCAL ] PACS: Saving derivative data. [2025-09-17T22:55:59.392455] [INFO ] [MAIN ] PACK: Successfully saved derivative data. [2025-09-17T22:55:59.395744] [INFO ] [MAIN ] Derivative Progress: 1405/2085 symbols completed. PACK took 1.1s. Estimated remaining: 4m 25s. Rate: 154.1 symbols/min [2025-09-17T22:55:59.396548] [DEBUG] [LOCAL ] PAG: Derivative data saved (1794 records). [2025-09-17T22:55:59.396779] [INFO ] [MAIN ] PAG: Successfully saved derivative data. [2025-09-17T22:55:59.396885] [INFO ] [MAIN ] PAGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:59.399599] [INFO ] [MAIN ] Derivative Progress: 1406/2085 symbols completed. PAG took 1.1s. Estimated remaining: 4m 24s. Rate: 154.2 symbols/min [2025-09-17T22:55:59.400156] [INFO ] [MAIN ] PAI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:59.416631] [DEBUG] [LOCAL ] PACS: Derivative data saved (1794 records). [2025-09-17T22:55:59.416906] [INFO ] [MAIN ] PACS: Successfully saved derivative data. [2025-09-17T22:55:59.420008] [INFO ] [MAIN ] Derivative Progress: 1407/2085 symbols completed. PACS took 1.1s. Estimated remaining: 4m 24s. Rate: 154.3 symbols/min [2025-09-17T22:55:59.422739] [INFO ] [MAIN ] PAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:55:59.423321] [DEBUG] [LOCAL ] PAI: Loaded 2731 existing records from primary storage. [2025-09-17T22:55:59.423422] [INFO ] [MAIN ] PAI: Loaded 2731 primary data records. [2025-09-17T22:55:59.771128] [DEBUG] [LOCAL ] PAM: Loaded 27386 existing records from primary storage. [2025-09-17T22:55:59.772101] [INFO ] [MAIN ] PAM: Loaded 27386 primary data records. [2025-09-17T22:55:59.770591] [DEBUG] [LOCAL ] PAGS: Loaded 52677 existing records from primary storage. [2025-09-17T22:55:59.772744] [INFO ] [MAIN ] PAGS: Loaded 52677 primary data records. [2025-09-17T22:56:00.414681] [DEBUG] [MAIN ] PAI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:00.416107] [INFO ] [MAIN ] PAI: Generated 1794 derivative records from 2731 primary records. [2025-09-17T22:56:00.417309] [DEBUG] [LOCAL ] PAI: Saving derivative data. [2025-09-17T22:56:00.438528] [DEBUG] [LOCAL ] PAI: Derivative data saved (1794 records). [2025-09-17T22:56:00.438998] [INFO ] [MAIN ] PAI: Successfully saved derivative data. [2025-09-17T22:56:00.441133] [INFO ] [MAIN ] Derivative Progress: 1408/2085 symbols completed. PAI took 1.0s. Estimated remaining: 4m 24s. Rate: 154.1 symbols/min [2025-09-17T22:56:00.462410] [DEBUG] [MAIN ] PAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:00.465349] [INFO ] [MAIN ] PAM: Generated 1794 derivative records from 27386 primary records. [2025-09-17T22:56:00.465548] [DEBUG] [LOCAL ] PAM: Saving derivative data. [2025-09-17T22:56:00.478953] [DEBUG] [MAIN ] PAGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:00.491332] [INFO ] [MAIN ] PAGS: Generated 1794 derivative records from 52677 primary records. [2025-09-17T22:56:00.491669] [DEBUG] [LOCAL ] PAGS: Saving derivative data. [2025-09-17T22:56:00.505073] [DEBUG] [LOCAL ] PAM: Derivative data saved (1794 records). [2025-09-17T22:56:00.510119] [INFO ] [MAIN ] PAM: Successfully saved derivative data. [2025-09-17T22:56:00.511671] [DEBUG] [LOCAL ] PAGS: Derivative data saved (1794 records). [2025-09-17T22:56:00.514150] [INFO ] [MAIN ] PAGS: Successfully saved derivative data. [2025-09-17T22:56:00.514031] [INFO ] [MAIN ] Derivative Progress: 1409/2085 symbols completed. PAM took 1.1s. Estimated remaining: 4m 23s. Rate: 154.2 symbols/min [2025-09-17T22:56:00.517250] [INFO ] [MAIN ] Derivative Progress: 1410/2085 symbols completed. PAGS took 1.1s. Estimated remaining: 4m 22s. Rate: 154.3 symbols/min [2025-09-17T22:56:00.517941] [INFO ] [MAIN ] PATH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:00.517996] [INFO ] [MAIN ] PARR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:00.518130] [INFO ] [MAIN ] PAR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:00.598571] [DEBUG] [LOCAL ] PAR: Loaded 32503 existing records from primary storage. [2025-09-17T22:56:00.601162] [DEBUG] [LOCAL ] PARR: Loaded 48445 existing records from primary storage. [2025-09-17T22:56:00.601292] [INFO ] [MAIN ] PAR: Loaded 32503 primary data records. [2025-09-17T22:56:00.601689] [INFO ] [MAIN ] PARR: Loaded 48445 primary data records. [2025-09-17T22:56:00.696311] [DEBUG] [LOCAL ] PATH: Loaded 53678 existing records from primary storage. [2025-09-17T22:56:00.748005] [INFO ] [MAIN ] PATH: Loaded 53678 primary data records. [2025-09-17T22:56:01.619587] [DEBUG] [MAIN ] PARR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:01.620511] [INFO ] [MAIN ] PARR: Generated 1794 derivative records from 48445 primary records. [2025-09-17T22:56:01.620622] [DEBUG] [LOCAL ] PARR: Saving derivative data. [2025-09-17T22:56:01.639294] [DEBUG] [LOCAL ] PARR: Derivative data saved (1794 records). [2025-09-17T22:56:01.642229] [INFO ] [MAIN ] PARR: Successfully saved derivative data. [2025-09-17T22:56:01.645068] [INFO ] [MAIN ] Derivative Progress: 1411/2085 symbols completed. PARR took 1.1s. Estimated remaining: 4m 22s. Rate: 154.1 symbols/min [2025-09-17T22:56:01.645748] [INFO ] [MAIN ] PAXS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:01.667530] [DEBUG] [MAIN ] PATH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:01.673565] [INFO ] [MAIN ] PATH: Generated 1794 derivative records from 53678 primary records. [2025-09-17T22:56:01.673702] [DEBUG] [LOCAL ] PATH: Saving derivative data. [2025-09-17T22:56:01.672856] [DEBUG] [MAIN ] PAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:01.674908] [INFO ] [MAIN ] PAR: Generated 1794 derivative records from 32503 primary records. [2025-09-17T22:56:01.675268] [DEBUG] [LOCAL ] PAR: Saving derivative data. [2025-09-17T22:56:01.710538] [DEBUG] [LOCAL ] PATH: Derivative data saved (1794 records). [2025-09-17T22:56:01.711190] [INFO ] [MAIN ] PATH: Successfully saved derivative data. [2025-09-17T22:56:01.714533] [INFO ] [MAIN ] Derivative Progress: 1412/2085 symbols completed. PATH took 1.2s. Estimated remaining: 4m 22s. Rate: 154.2 symbols/min [2025-09-17T22:56:01.722282] [INFO ] [MAIN ] PAY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:01.723553] [DEBUG] [LOCAL ] PAXS: Loaded 21137 existing records from primary storage. [2025-09-17T22:56:01.723918] [INFO ] [MAIN ] PAXS: Loaded 21137 primary data records. [2025-09-17T22:56:01.724978] [DEBUG] [LOCAL ] PAR: Derivative data saved (1794 records). [2025-09-17T22:56:01.756403] [INFO ] [MAIN ] PAR: Successfully saved derivative data. [2025-09-17T22:56:01.793087] [INFO ] [MAIN ] Derivative Progress: 1413/2085 symbols completed. PAR took 1.3s. Estimated remaining: 4m 21s. Rate: 154.3 symbols/min [2025-09-17T22:56:01.838415] [INFO ] [MAIN ] PAYC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:02.070577] [DEBUG] [LOCAL ] PAY: Loaded 38157 existing records from primary storage. [2025-09-17T22:56:02.072012] [INFO ] [MAIN ] PAY: Loaded 38157 primary data records. [2025-09-17T22:56:02.406187] [DEBUG] [LOCAL ] PAYC: Loaded 36393 existing records from primary storage. [2025-09-17T22:56:02.406608] [INFO ] [MAIN ] PAYC: Loaded 36393 primary data records. [2025-09-17T22:56:02.565554] [DEBUG] [MAIN ] PAXS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:02.615305] [INFO ] [MAIN ] PAXS: Generated 1794 derivative records from 21137 primary records. [2025-09-17T22:56:02.639173] [DEBUG] [LOCAL ] PAXS: Saving derivative data. [2025-09-17T22:56:02.763443] [DEBUG] [LOCAL ] PAXS: Derivative data saved (1794 records). [2025-09-17T22:56:02.764567] [INFO ] [MAIN ] PAXS: Successfully saved derivative data. [2025-09-17T22:56:02.767279] [INFO ] [MAIN ] Derivative Progress: 1414/2085 symbols completed. PAXS took 1.1s. Estimated remaining: 4m 21s. Rate: 154.1 symbols/min [2025-09-17T22:56:02.769009] [INFO ] [MAIN ] PB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:02.789552] [DEBUG] [MAIN ] PAY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:02.790673] [INFO ] [MAIN ] PAY: Generated 1794 derivative records from 38157 primary records. [2025-09-17T22:56:02.790942] [DEBUG] [LOCAL ] PAY: Saving derivative data. [2025-09-17T22:56:02.813954] [DEBUG] [LOCAL ] PAY: Derivative data saved (1794 records). [2025-09-17T22:56:02.831631] [INFO ] [MAIN ] PAY: Successfully saved derivative data. [2025-09-17T22:56:02.837445] [DEBUG] [MAIN ] PAYC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:02.841166] [INFO ] [MAIN ] PAYC: Generated 1794 derivative records from 36393 primary records. [2025-09-17T22:56:02.839995] [INFO ] [MAIN ] Derivative Progress: 1415/2085 symbols completed. PAY took 1.1s. Estimated remaining: 4m 21s. Rate: 154.2 symbols/min [2025-09-17T22:56:02.841626] [INFO ] [MAIN ] PBA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:02.841378] [DEBUG] [LOCAL ] PAYC: Saving derivative data. [2025-09-17T22:56:02.869255] [DEBUG] [LOCAL ] PB: Loaded 41348 existing records from primary storage. [2025-09-17T22:56:02.870179] [INFO ] [MAIN ] PB: Loaded 41348 primary data records. [2025-09-17T22:56:02.922528] [DEBUG] [LOCAL ] PAYC: Derivative data saved (1794 records). [2025-09-17T22:56:02.951986] [INFO ] [MAIN ] PAYC: Successfully saved derivative data. [2025-09-17T22:56:02.982091] [INFO ] [MAIN ] Derivative Progress: 1416/2085 symbols completed. PAYC took 1.1s. Estimated remaining: 4m 20s. Rate: 154.3 symbols/min [2025-09-17T22:56:02.995713] [INFO ] [MAIN ] PBF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:03.255138] [DEBUG] [LOCAL ] PBA: Loaded 49065 existing records from primary storage. [2025-09-17T22:56:03.256141] [INFO ] [MAIN ] PBA: Loaded 49065 primary data records. [2025-09-17T22:56:03.601394] [DEBUG] [LOCAL ] PBF: Loaded 53095 existing records from primary storage. [2025-09-17T22:56:03.601893] [INFO ] [MAIN ] PBF: Loaded 53095 primary data records. [2025-09-17T22:56:03.717813] [DEBUG] [MAIN ] PB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:03.731947] [INFO ] [MAIN ] PB: Generated 1794 derivative records from 41348 primary records. [2025-09-17T22:56:03.738614] [DEBUG] [LOCAL ] PB: Saving derivative data. [2025-09-17T22:56:03.830861] [DEBUG] [LOCAL ] PB: Derivative data saved (1794 records). [2025-09-17T22:56:03.857719] [INFO ] [MAIN ] PB: Successfully saved derivative data. [2025-09-17T22:56:03.954283] [INFO ] [MAIN ] Derivative Progress: 1417/2085 symbols completed. PB took 1.2s. Estimated remaining: 4m 20s. Rate: 154.1 symbols/min [2025-09-17T22:56:03.955797] [INFO ] [MAIN ] PBH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:03.975626] [DEBUG] [MAIN ] PBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:03.977445] [INFO ] [MAIN ] PBA: Generated 1794 derivative records from 49065 primary records. [2025-09-17T22:56:03.977677] [DEBUG] [LOCAL ] PBA: Saving derivative data. [2025-09-17T22:56:04.011779] [DEBUG] [LOCAL ] PBA: Derivative data saved (1794 records). [2025-09-17T22:56:04.011923] [INFO ] [MAIN ] PBA: Successfully saved derivative data. [2025-09-17T22:56:04.015155] [INFO ] [MAIN ] Derivative Progress: 1418/2085 symbols completed. PBA took 1.2s. Estimated remaining: 4m 20s. Rate: 154.2 symbols/min [2025-09-17T22:56:04.016427] [INFO ] [MAIN ] PBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:04.027149] [DEBUG] [LOCAL ] PBH: Loaded 31378 existing records from primary storage. [2025-09-17T22:56:04.027484] [INFO ] [MAIN ] PBH: Loaded 31378 primary data records. [2025-09-17T22:56:04.142169] [DEBUG] [MAIN ] PBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:04.155151] [INFO ] [MAIN ] PBF: Generated 1794 derivative records from 53095 primary records. [2025-09-17T22:56:04.155357] [DEBUG] [LOCAL ] PBF: Saving derivative data. [2025-09-17T22:56:04.253936] [DEBUG] [LOCAL ] PBF: Derivative data saved (1794 records). [2025-09-17T22:56:04.254090] [INFO ] [MAIN ] PBF: Successfully saved derivative data. [2025-09-17T22:56:04.373793] [INFO ] [MAIN ] Derivative Progress: 1419/2085 symbols completed. PBF took 1.4s. Estimated remaining: 4m 19s. Rate: 154.2 symbols/min [2025-09-17T22:56:04.394151] [INFO ] [MAIN ] PBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:04.422915] [DEBUG] [LOCAL ] PBI: Loaded 50118 existing records from primary storage. [2025-09-17T22:56:04.424554] [INFO ] [MAIN ] PBI: Loaded 50118 primary data records. [2025-09-17T22:56:04.766631] [DEBUG] [MAIN ] PBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:04.767687] [INFO ] [MAIN ] PBH: Generated 1794 derivative records from 31378 primary records. [2025-09-17T22:56:04.777901] [DEBUG] [LOCAL ] PBR: Loaded 53715 existing records from primary storage. [2025-09-17T22:56:04.776461] [DEBUG] [LOCAL ] PBH: Saving derivative data. [2025-09-17T22:56:04.778116] [INFO ] [MAIN ] PBR: Loaded 53715 primary data records. [2025-09-17T22:56:04.851262] [DEBUG] [LOCAL ] PBH: Derivative data saved (1794 records). [2025-09-17T22:56:04.872510] [INFO ] [MAIN ] PBH: Successfully saved derivative data. [2025-09-17T22:56:04.875802] [INFO ] [MAIN ] Derivative Progress: 1420/2085 symbols completed. PBH took 0.9s. Estimated remaining: 4m 19s. Rate: 154.2 symbols/min [2025-09-17T22:56:04.904475] [INFO ] [MAIN ] PBT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:05.157078] [DEBUG] [LOCAL ] PBT: Loaded 17633 existing records from primary storage. [2025-09-17T22:56:05.157635] [INFO ] [MAIN ] PBT: Loaded 17633 primary data records. [2025-09-17T22:56:05.481706] [DEBUG] [MAIN ] PBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:05.482487] [INFO ] [MAIN ] PBI: Generated 1794 derivative records from 50118 primary records. [2025-09-17T22:56:05.485052] [DEBUG] [LOCAL ] PBI: Saving derivative data. [2025-09-17T22:56:05.514042] [DEBUG] [MAIN ] PBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:05.517384] [INFO ] [MAIN ] PBR: Generated 1794 derivative records from 53715 primary records. [2025-09-17T22:56:05.519005] [DEBUG] [LOCAL ] PBI: Derivative data saved (1794 records). [2025-09-17T22:56:05.519188] [INFO ] [MAIN ] PBI: Successfully saved derivative data. [2025-09-17T22:56:05.522010] [INFO ] [MAIN ] Derivative Progress: 1421/2085 symbols completed. PBI took 1.5s. Estimated remaining: 4m 19s. Rate: 154.1 symbols/min [2025-09-17T22:56:05.522383] [DEBUG] [LOCAL ] PBR: Saving derivative data. [2025-09-17T22:56:05.522522] [INFO ] [MAIN ] PCF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:05.546551] [DEBUG] [LOCAL ] PCF: Loaded 8754 existing records from primary storage. [2025-09-17T22:56:05.547696] [INFO ] [MAIN ] PCF: Loaded 8754 primary data records. [2025-09-17T22:56:05.585963] [DEBUG] [LOCAL ] PBR: Derivative data saved (1794 records). [2025-09-17T22:56:05.592715] [INFO ] [MAIN ] PBR: Successfully saved derivative data. [2025-09-17T22:56:05.606976] [INFO ] [MAIN ] Derivative Progress: 1422/2085 symbols completed. PBR took 1.2s. Estimated remaining: 4m 18s. Rate: 154.2 symbols/min [2025-09-17T22:56:05.660374] [INFO ] [MAIN ] PCM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:05.700597] [DEBUG] [MAIN ] PBT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:05.750876] [INFO ] [MAIN ] PBT: Generated 1794 derivative records from 17633 primary records. [2025-09-17T22:56:05.771502] [DEBUG] [LOCAL ] PBT: Saving derivative data. [2025-09-17T22:56:05.885054] [DEBUG] [LOCAL ] PCM: Loaded 6807 existing records from primary storage. [2025-09-17T22:56:05.894875] [INFO ] [MAIN ] PCM: Loaded 6807 primary data records. [2025-09-17T22:56:05.995491] [DEBUG] [LOCAL ] PBT: Derivative data saved (1794 records). [2025-09-17T22:56:06.013377] [INFO ] [MAIN ] PBT: Successfully saved derivative data. [2025-09-17T22:56:06.028107] [INFO ] [MAIN ] Derivative Progress: 1423/2085 symbols completed. PBT took 1.1s. Estimated remaining: 4m 18s. Rate: 154.2 symbols/min [2025-09-17T22:56:06.259181] [DEBUG] [MAIN ] PCF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:06.260375] [INFO ] [MAIN ] PCF: Generated 1794 derivative records from 8754 primary records. [2025-09-17T22:56:06.261418] [DEBUG] [LOCAL ] PCF: Saving derivative data. [2025-09-17T22:56:06.278734] [DEBUG] [LOCAL ] PCF: Derivative data saved (1794 records). [2025-09-17T22:56:06.278902] [INFO ] [MAIN ] PCF: Successfully saved derivative data. [2025-09-17T22:56:06.281252] [INFO ] [MAIN ] Derivative Progress: 1424/2085 symbols completed. PCF took 0.8s. Estimated remaining: 4m 17s. Rate: 154.2 symbols/min [2025-09-17T22:56:06.298246] [DEBUG] [MAIN ] PCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:06.298991] [INFO ] [MAIN ] PCM: Generated 1794 derivative records from 6807 primary records. [2025-09-17T22:56:06.299054] [DEBUG] [LOCAL ] PCM: Saving derivative data. [2025-09-17T22:56:06.314018] [DEBUG] [LOCAL ] PCM: Derivative data saved (1794 records). [2025-09-17T22:56:06.314157] [INFO ] [MAIN ] PCM: Successfully saved derivative data. [2025-09-17T22:56:06.316547] [INFO ] [MAIN ] Derivative Progress: 1425/2085 symbols completed. PCM took 0.7s. Estimated remaining: 4m 17s. Rate: 154.3 symbols/min [2025-09-17T22:56:06.317405] [INFO ] [MAIN ] PCQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:06.317339] [INFO ] [MAIN ] PCN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:06.317605] [INFO ] [MAIN ] PCOR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:06.335833] [DEBUG] [LOCAL ] PCQ: Loaded 12132 existing records from primary storage. [2025-09-17T22:56:06.336032] [INFO ] [MAIN ] PCQ: Loaded 12132 primary data records. [2025-09-17T22:56:06.447267] [DEBUG] [LOCAL ] PCN: Loaded 24190 existing records from primary storage. [2025-09-17T22:56:06.465353] [INFO ] [MAIN ] PCN: Loaded 24190 primary data records. [2025-09-17T22:56:06.763444] [DEBUG] [LOCAL ] PCOR: Loaded 48134 existing records from primary storage. [2025-09-17T22:56:06.787501] [INFO ] [MAIN ] PCOR: Loaded 48134 primary data records. [2025-09-17T22:56:07.422156] [DEBUG] [MAIN ] PCQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:07.423156] [INFO ] [MAIN ] PCQ: Generated 1794 derivative records from 12132 primary records. [2025-09-17T22:56:07.424244] [DEBUG] [LOCAL ] PCQ: Saving derivative data. [2025-09-17T22:56:07.459365] [DEBUG] [MAIN ] PCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:07.462032] [INFO ] [MAIN ] PCN: Generated 1794 derivative records from 24190 primary records. [2025-09-17T22:56:07.462251] [DEBUG] [LOCAL ] PCN: Saving derivative data. [2025-09-17T22:56:07.461148] [DEBUG] [LOCAL ] PCQ: Derivative data saved (1794 records). [2025-09-17T22:56:07.463419] [INFO ] [MAIN ] PCQ: Successfully saved derivative data. [2025-09-17T22:56:07.466600] [INFO ] [MAIN ] Derivative Progress: 1426/2085 symbols completed. PCQ took 1.1s. Estimated remaining: 4m 17s. Rate: 154.1 symbols/min [2025-09-17T22:56:07.474947] [INFO ] [MAIN ] PD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:07.490108] [DEBUG] [LOCAL ] PCN: Derivative data saved (1794 records). [2025-09-17T22:56:07.490407] [INFO ] [MAIN ] PCN: Successfully saved derivative data. [2025-09-17T22:56:07.494108] [INFO ] [MAIN ] Derivative Progress: 1427/2085 symbols completed. PCN took 1.2s. Estimated remaining: 4m 16s. Rate: 154.2 symbols/min [2025-09-17T22:56:07.508270] [INFO ] [MAIN ] PDI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:07.509864] [DEBUG] [MAIN ] PCOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:07.510884] [INFO ] [MAIN ] PCOR: Generated 1794 derivative records from 48134 primary records. [2025-09-17T22:56:07.511100] [DEBUG] [LOCAL ] PCOR: Saving derivative data. [2025-09-17T22:56:07.530179] [DEBUG] [LOCAL ] PCOR: Derivative data saved (1794 records). [2025-09-17T22:56:07.530381] [INFO ] [MAIN ] PCOR: Successfully saved derivative data. [2025-09-17T22:56:07.535241] [INFO ] [MAIN ] Derivative Progress: 1428/2085 symbols completed. PCOR took 1.2s. Estimated remaining: 4m 15s. Rate: 154.3 symbols/min [2025-09-17T22:56:07.535788] [INFO ] [MAIN ] PDM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:07.588579] [DEBUG] [LOCAL ] PD: Loaded 47739 existing records from primary storage. [2025-09-17T22:56:07.589410] [INFO ] [MAIN ] PD: Loaded 47739 primary data records. [2025-09-17T22:56:07.741602] [DEBUG] [LOCAL ] PDI: Loaded 50272 existing records from primary storage. [2025-09-17T22:56:07.747523] [INFO ] [MAIN ] PDI: Loaded 50272 primary data records. [2025-09-17T22:56:07.799004] [DEBUG] [LOCAL ] PDM: Loaded 39895 existing records from primary storage. [2025-09-17T22:56:07.832367] [INFO ] [MAIN ] PDM: Loaded 39895 primary data records. [2025-09-17T22:56:08.651823] [DEBUG] [MAIN ] PD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:08.653853] [INFO ] [MAIN ] PD: Generated 1794 derivative records from 47739 primary records. [2025-09-17T22:56:08.654488] [DEBUG] [LOCAL ] PD: Saving derivative data. [2025-09-17T22:56:08.696732] [DEBUG] [MAIN ] PDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:08.700128] [INFO ] [MAIN ] PDI: Generated 1794 derivative records from 50272 primary records. [2025-09-17T22:56:08.700932] [DEBUG] [LOCAL ] PDI: Saving derivative data. [2025-09-17T22:56:08.703618] [DEBUG] [LOCAL ] PD: Derivative data saved (1794 records). [2025-09-17T22:56:08.712908] [INFO ] [MAIN ] PD: Successfully saved derivative data. [2025-09-17T22:56:08.716982] [INFO ] [MAIN ] Derivative Progress: 1429/2085 symbols completed. PD took 1.2s. Estimated remaining: 4m 15s. Rate: 154.1 symbols/min [2025-09-17T22:56:08.722889] [INFO ] [MAIN ] PDO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:08.741584] [DEBUG] [MAIN ] PDM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:08.743828] [INFO ] [MAIN ] PDM: Generated 1794 derivative records from 39895 primary records. [2025-09-17T22:56:08.744472] [DEBUG] [LOCAL ] PDM: Saving derivative data. [2025-09-17T22:56:08.767032] [DEBUG] [LOCAL ] PDI: Derivative data saved (1794 records). [2025-09-17T22:56:08.767931] [INFO ] [MAIN ] PDI: Successfully saved derivative data. [2025-09-17T22:56:08.770896] [INFO ] [MAIN ] Derivative Progress: 1430/2085 symbols completed. PDI took 1.3s. Estimated remaining: 4m 15s. Rate: 154.2 symbols/min [2025-09-17T22:56:08.771999] [INFO ] [MAIN ] PDS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:08.777476] [DEBUG] [LOCAL ] PDM: Derivative data saved (1794 records). [2025-09-17T22:56:08.777817] [INFO ] [MAIN ] PDM: Successfully saved derivative data. [2025-09-17T22:56:08.791543] [INFO ] [MAIN ] Derivative Progress: 1431/2085 symbols completed. PDM took 1.3s. Estimated remaining: 4m 14s. Rate: 154.3 symbols/min [2025-09-17T22:56:08.792349] [INFO ] [MAIN ] PDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:08.814989] [DEBUG] [LOCAL ] PDO: Loaded 31940 existing records from primary storage. [2025-09-17T22:56:08.828245] [INFO ] [MAIN ] PDO: Loaded 31940 primary data records. [2025-09-17T22:56:08.828143] [DEBUG] [LOCAL ] PDS: Loaded 18741 existing records from primary storage. [2025-09-17T22:56:08.840426] [INFO ] [MAIN ] PDS: Loaded 18741 primary data records. [2025-09-17T22:56:08.993476] [DEBUG] [LOCAL ] PDT: Loaded 17595 existing records from primary storage. [2025-09-17T22:56:09.020462] [INFO ] [MAIN ] PDT: Loaded 17595 primary data records. [2025-09-17T22:56:09.961492] [DEBUG] [MAIN ] PDO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:09.963236] [INFO ] [MAIN ] PDO: Generated 1794 derivative records from 31940 primary records. [2025-09-17T22:56:09.964040] [DEBUG] [LOCAL ] PDO: Saving derivative data. [2025-09-17T22:56:10.009308] [DEBUG] [MAIN ] PDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:10.009702] [DEBUG] [MAIN ] PDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:10.012183] [INFO ] [MAIN ] PDS: Generated 1794 derivative records from 18741 primary records. [2025-09-17T22:56:10.012582] [DEBUG] [LOCAL ] PDS: Saving derivative data. [2025-09-17T22:56:10.010894] [INFO ] [MAIN ] PDT: Generated 1794 derivative records from 17595 primary records. [2025-09-17T22:56:10.014193] [DEBUG] [LOCAL ] PDT: Saving derivative data. [2025-09-17T22:56:10.045538] [DEBUG] [LOCAL ] PDS: Derivative data saved (1794 records). [2025-09-17T22:56:10.046768] [INFO ] [MAIN ] PDS: Successfully saved derivative data. [2025-09-17T22:56:10.048169] [DEBUG] [LOCAL ] PDT: Derivative data saved (1794 records). [2025-09-17T22:56:10.046872] [DEBUG] [LOCAL ] PDO: Derivative data saved (1794 records). [2025-09-17T22:56:10.051185] [INFO ] [MAIN ] PDT: Successfully saved derivative data. [2025-09-17T22:56:10.051059] [INFO ] [MAIN ] Derivative Progress: 1432/2085 symbols completed. PDS took 1.3s. Estimated remaining: 4m 14s. Rate: 154.0 symbols/min [2025-09-17T22:56:10.054056] [INFO ] [MAIN ] PDO: Successfully saved derivative data. [2025-09-17T22:56:10.054303] [INFO ] [MAIN ] Derivative Progress: 1433/2085 symbols completed. PDT took 1.3s. Estimated remaining: 4m 14s. Rate: 154.1 symbols/min [2025-09-17T22:56:10.054429] [INFO ] [MAIN ] PDX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:10.056956] [INFO ] [MAIN ] Derivative Progress: 1434/2085 symbols completed. PDO took 1.3s. Estimated remaining: 4m 13s. Rate: 154.2 symbols/min [2025-09-17T22:56:10.057135] [INFO ] [MAIN ] PEB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:10.057348] [INFO ] [MAIN ] PEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:10.075077] [DEBUG] [LOCAL ] PDX: Loaded 14557 existing records from primary storage. [2025-09-17T22:56:10.075360] [INFO ] [MAIN ] PDX: Loaded 14557 primary data records. [2025-09-17T22:56:10.245756] [DEBUG] [LOCAL ] PEN: Loaded 30778 existing records from primary storage. [2025-09-17T22:56:10.285746] [INFO ] [MAIN ] PEN: Loaded 30778 primary data records. [2025-09-17T22:56:10.490453] [DEBUG] [LOCAL ] PEB: Loaded 50720 existing records from primary storage. [2025-09-17T22:56:10.541773] [INFO ] [MAIN ] PEB: Loaded 50720 primary data records. [2025-09-17T22:56:11.116931] [DEBUG] [MAIN ] PDX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:11.118002] [INFO ] [MAIN ] PDX: Generated 1794 derivative records from 14557 primary records. [2025-09-17T22:56:11.118286] [DEBUG] [LOCAL ] PDX: Saving derivative data. [2025-09-17T22:56:11.139029] [DEBUG] [LOCAL ] PDX: Derivative data saved (1794 records). [2025-09-17T22:56:11.139958] [INFO ] [MAIN ] PDX: Successfully saved derivative data. [2025-09-17T22:56:11.142743] [INFO ] [MAIN ] Derivative Progress: 1435/2085 symbols completed. PDX took 1.1s. Estimated remaining: 4m 13s. Rate: 154.0 symbols/min [2025-09-17T22:56:11.143145] [INFO ] [MAIN ] PEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:11.157395] [DEBUG] [MAIN ] PEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:11.158213] [INFO ] [MAIN ] PEN: Generated 1794 derivative records from 30778 primary records. [2025-09-17T22:56:11.158349] [DEBUG] [LOCAL ] PEN: Saving derivative data. [2025-09-17T22:56:11.178140] [DEBUG] [LOCAL ] PEN: Derivative data saved (1794 records). [2025-09-17T22:56:11.178260] [INFO ] [MAIN ] PEN: Successfully saved derivative data. [2025-09-17T22:56:11.180737] [INFO ] [MAIN ] Derivative Progress: 1436/2085 symbols completed. PEN took 1.1s. Estimated remaining: 4m 13s. Rate: 154.1 symbols/min [2025-09-17T22:56:11.182108] [INFO ] [MAIN ] PERF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:11.189090] [DEBUG] [LOCAL ] PEO: Loaded 10901 existing records from primary storage. [2025-09-17T22:56:11.189422] [INFO ] [MAIN ] PEO: Loaded 10901 primary data records. [2025-09-17T22:56:11.224544] [DEBUG] [MAIN ] PEB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:11.248528] [INFO ] [MAIN ] PEB: Generated 1794 derivative records from 50720 primary records. [2025-09-17T22:56:11.262422] [DEBUG] [LOCAL ] PERF: Loaded 14091 existing records from primary storage. [2025-09-17T22:56:11.262523] [DEBUG] [LOCAL ] PEB: Saving derivative data. [2025-09-17T22:56:11.287632] [INFO ] [MAIN ] PERF: Loaded 14091 primary data records. [2025-09-17T22:56:11.437156] [DEBUG] [LOCAL ] PEB: Derivative data saved (1794 records). [2025-09-17T22:56:11.442505] [INFO ] [MAIN ] PEB: Successfully saved derivative data. [2025-09-17T22:56:11.450485] [INFO ] [MAIN ] Derivative Progress: 1437/2085 symbols completed. PEB took 1.4s. Estimated remaining: 4m 12s. Rate: 154.2 symbols/min [2025-09-17T22:56:11.466540] [INFO ] [MAIN ] PFD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:11.785186] [DEBUG] [LOCAL ] PFD: Loaded 5137 existing records from primary storage. [2025-09-17T22:56:11.914262] [INFO ] [MAIN ] PFD: Loaded 5137 primary data records. [2025-09-17T22:56:12.270823] [DEBUG] [MAIN ] PEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:12.272162] [INFO ] [MAIN ] PEO: Generated 1794 derivative records from 10901 primary records. [2025-09-17T22:56:12.280126] [DEBUG] [LOCAL ] PEO: Saving derivative data. [2025-09-17T22:56:12.293466] [DEBUG] [MAIN ] PERF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:12.300885] [INFO ] [MAIN ] PERF: Generated 1794 derivative records from 14091 primary records. [2025-09-17T22:56:12.303209] [DEBUG] [LOCAL ] PERF: Saving derivative data. [2025-09-17T22:56:12.327880] [DEBUG] [LOCAL ] PERF: Derivative data saved (1794 records). [2025-09-17T22:56:12.328559] [DEBUG] [LOCAL ] PEO: Derivative data saved (1794 records). [2025-09-17T22:56:12.329012] [INFO ] [MAIN ] PERF: Successfully saved derivative data. [2025-09-17T22:56:12.328945] [INFO ] [MAIN ] PEO: Successfully saved derivative data. [2025-09-17T22:56:12.332007] [INFO ] [MAIN ] Derivative Progress: 1438/2085 symbols completed. PEO took 1.2s. Estimated remaining: 4m 12s. Rate: 154.0 symbols/min [2025-09-17T22:56:12.336721] [INFO ] [MAIN ] Derivative Progress: 1439/2085 symbols completed. PERF took 1.2s. Estimated remaining: 4m 11s. Rate: 154.1 symbols/min [2025-09-17T22:56:12.352292] [DEBUG] [MAIN ] PFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:12.352926] [INFO ] [MAIN ] PFD: Generated 1794 derivative records from 5137 primary records. [2025-09-17T22:56:12.352988] [DEBUG] [LOCAL ] PFD: Saving derivative data. [2025-09-17T22:56:12.367404] [DEBUG] [LOCAL ] PFD: Derivative data saved (1794 records). [2025-09-17T22:56:12.367463] [INFO ] [MAIN ] PFD: Successfully saved derivative data. [2025-09-17T22:56:12.370114] [INFO ] [MAIN ] Derivative Progress: 1440/2085 symbols completed. PFD took 0.9s. Estimated remaining: 4m 11s. Rate: 154.2 symbols/min [2025-09-17T22:56:12.370771] [INFO ] [MAIN ] PFH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:12.371094] [INFO ] [MAIN ] PFL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:12.371050] [INFO ] [MAIN ] PFLT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:12.392625] [DEBUG] [LOCAL ] PFH: Loaded 6956 existing records from primary storage. [2025-09-17T22:56:12.393075] [DEBUG] [LOCAL ] PFL: Loaded 13840 existing records from primary storage. [2025-09-17T22:56:12.393353] [INFO ] [MAIN ] PFH: Loaded 6956 primary data records. [2025-09-17T22:56:12.393468] [INFO ] [MAIN ] PFL: Loaded 13840 primary data records. [2025-09-17T22:56:13.054330] [DEBUG] [LOCAL ] PFLT: Loaded 43677 existing records from primary storage. [2025-09-17T22:56:13.065231] [INFO ] [MAIN ] PFLT: Loaded 43677 primary data records. [2025-09-17T22:56:13.436804] [DEBUG] [MAIN ] PFH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:13.451821] [INFO ] [MAIN ] PFH: Generated 1794 derivative records from 6956 primary records. [2025-09-17T22:56:13.453972] [DEBUG] [LOCAL ] PFH: Saving derivative data. [2025-09-17T22:56:13.453748] [DEBUG] [MAIN ] PFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:13.456171] [INFO ] [MAIN ] PFL: Generated 1794 derivative records from 13840 primary records. [2025-09-17T22:56:13.456423] [DEBUG] [LOCAL ] PFL: Saving derivative data. [2025-09-17T22:56:13.488461] [DEBUG] [LOCAL ] PFL: Derivative data saved (1794 records). [2025-09-17T22:56:13.489417] [INFO ] [MAIN ] PFL: Successfully saved derivative data. [2025-09-17T22:56:13.491969] [INFO ] [MAIN ] Derivative Progress: 1441/2085 symbols completed. PFL took 1.1s. Estimated remaining: 4m 11s. Rate: 154.0 symbols/min [2025-09-17T22:56:13.493460] [INFO ] [MAIN ] PFN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:13.497114] [DEBUG] [LOCAL ] PFH: Derivative data saved (1794 records). [2025-09-17T22:56:13.498190] [INFO ] [MAIN ] PFH: Successfully saved derivative data. [2025-09-17T22:56:13.501840] [INFO ] [MAIN ] Derivative Progress: 1442/2085 symbols completed. PFH took 1.1s. Estimated remaining: 4m 10s. Rate: 154.1 symbols/min [2025-09-17T22:56:13.502518] [INFO ] [MAIN ] PFO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:13.517537] [DEBUG] [MAIN ] PFLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:13.518504] [INFO ] [MAIN ] PFLT: Generated 1794 derivative records from 43677 primary records. [2025-09-17T22:56:13.518676] [DEBUG] [LOCAL ] PFLT: Saving derivative data. [2025-09-17T22:56:13.542282] [DEBUG] [LOCAL ] PFLT: Derivative data saved (1794 records). [2025-09-17T22:56:13.542472] [INFO ] [MAIN ] PFLT: Successfully saved derivative data. [2025-09-17T22:56:13.542805] [DEBUG] [LOCAL ] PFO: Loaded 5773 existing records from primary storage. [2025-09-17T22:56:13.545451] [INFO ] [MAIN ] Derivative Progress: 1443/2085 symbols completed. PFLT took 1.2s. Estimated remaining: 4m 10s. Rate: 154.2 symbols/min [2025-09-17T22:56:13.545613] [INFO ] [MAIN ] PFO: Loaded 5773 primary data records. [2025-09-17T22:56:13.551568] [INFO ] [MAIN ] PFS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:13.662625] [DEBUG] [LOCAL ] PFN: Loaded 21736 existing records from primary storage. [2025-09-17T22:56:13.684246] [INFO ] [MAIN ] PFN: Loaded 21736 primary data records. [2025-09-17T22:56:14.066069] [DEBUG] [LOCAL ] PFS: Loaded 35805 existing records from primary storage. [2025-09-17T22:56:14.066438] [INFO ] [MAIN ] PFS: Loaded 35805 primary data records. [2025-09-17T22:56:14.603928] [DEBUG] [MAIN ] PFO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:14.606431] [INFO ] [MAIN ] PFO: Generated 1794 derivative records from 5773 primary records. [2025-09-17T22:56:14.606590] [DEBUG] [LOCAL ] PFO: Saving derivative data. [2025-09-17T22:56:14.640034] [DEBUG] [LOCAL ] PFO: Derivative data saved (1794 records). [2025-09-17T22:56:14.640853] [INFO ] [MAIN ] PFO: Successfully saved derivative data. [2025-09-17T22:56:14.640382] [DEBUG] [MAIN ] PFN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:14.643505] [INFO ] [MAIN ] Derivative Progress: 1444/2085 symbols completed. PFO took 1.1s. Estimated remaining: 4m 10s. Rate: 154.0 symbols/min [2025-09-17T22:56:14.645004] [INFO ] [MAIN ] PFN: Generated 1794 derivative records from 21736 primary records. [2025-09-17T22:56:14.645243] [DEBUG] [LOCAL ] PFN: Saving derivative data. [2025-09-17T22:56:14.646608] [INFO ] [MAIN ] PFSI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:14.684757] [DEBUG] [MAIN ] PFS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:14.686433] [INFO ] [MAIN ] PFS: Generated 1794 derivative records from 35805 primary records. [2025-09-17T22:56:14.686678] [DEBUG] [LOCAL ] PFS: Saving derivative data. [2025-09-17T22:56:14.687727] [DEBUG] [LOCAL ] PFN: Derivative data saved (1794 records). [2025-09-17T22:56:14.687813] [INFO ] [MAIN ] PFN: Successfully saved derivative data. [2025-09-17T22:56:14.690475] [INFO ] [MAIN ] Derivative Progress: 1445/2085 symbols completed. PFN took 1.2s. Estimated remaining: 4m 9s. Rate: 154.1 symbols/min [2025-09-17T22:56:14.690926] [INFO ] [MAIN ] PGP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:14.721895] [DEBUG] [LOCAL ] PFS: Derivative data saved (1794 records). [2025-09-17T22:56:14.725548] [DEBUG] [LOCAL ] PGP: Loaded 5420 existing records from primary storage. [2025-09-17T22:56:14.725691] [INFO ] [MAIN ] PFS: Successfully saved derivative data. [2025-09-17T22:56:14.725793] [INFO ] [MAIN ] PGP: Loaded 5420 primary data records. [2025-09-17T22:56:14.750303] [INFO ] [MAIN ] Derivative Progress: 1446/2085 symbols completed. PFS took 1.2s. Estimated remaining: 4m 9s. Rate: 154.2 symbols/min [2025-09-17T22:56:14.786974] [INFO ] [MAIN ] PGRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:14.846078] [DEBUG] [LOCAL ] PFSI: Loaded 28720 existing records from primary storage. [2025-09-17T22:56:14.850190] [INFO ] [MAIN ] PFSI: Loaded 28720 primary data records. [2025-09-17T22:56:15.388156] [DEBUG] [LOCAL ] PGRE: Loaded 46142 existing records from primary storage. [2025-09-17T22:56:15.389147] [INFO ] [MAIN ] PGRE: Loaded 46142 primary data records. [2025-09-17T22:56:15.768791] [DEBUG] [MAIN ] PGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:15.770824] [INFO ] [MAIN ] PGP: Generated 1794 derivative records from 5420 primary records. [2025-09-17T22:56:15.771443] [DEBUG] [LOCAL ] PGP: Saving derivative data. [2025-09-17T22:56:15.803205] [DEBUG] [MAIN ] PFSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:15.804892] [INFO ] [MAIN ] PFSI: Generated 1794 derivative records from 28720 primary records. [2025-09-17T22:56:15.805090] [DEBUG] [LOCAL ] PFSI: Saving derivative data. [2025-09-17T22:56:15.807022] [DEBUG] [LOCAL ] PGP: Derivative data saved (1794 records). [2025-09-17T22:56:15.807575] [INFO ] [MAIN ] PGP: Successfully saved derivative data. [2025-09-17T22:56:15.820966] [INFO ] [MAIN ] Derivative Progress: 1447/2085 symbols completed. PGP took 1.1s. Estimated remaining: 4m 8s. Rate: 154.0 symbols/min [2025-09-17T22:56:15.823250] [INFO ] [MAIN ] PGZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:15.829367] [DEBUG] [LOCAL ] PFSI: Derivative data saved (1794 records). [2025-09-17T22:56:15.830111] [INFO ] [MAIN ] PFSI: Successfully saved derivative data. [2025-09-17T22:56:15.832676] [INFO ] [MAIN ] Derivative Progress: 1448/2085 symbols completed. PFSI took 1.2s. Estimated remaining: 4m 8s. Rate: 154.1 symbols/min [2025-09-17T22:56:15.834878] [INFO ] [MAIN ] PH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:15.851437] [DEBUG] [LOCAL ] PGZ: Loaded 5430 existing records from primary storage. [2025-09-17T22:56:15.852151] [INFO ] [MAIN ] PGZ: Loaded 5430 primary data records. [2025-09-17T22:56:15.852072] [DEBUG] [MAIN ] PGRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:15.879705] [INFO ] [MAIN ] PGRE: Generated 1794 derivative records from 46142 primary records. [2025-09-17T22:56:15.890836] [DEBUG] [LOCAL ] PGRE: Saving derivative data. [2025-09-17T22:56:16.030990] [DEBUG] [LOCAL ] PGRE: Derivative data saved (1794 records). [2025-09-17T22:56:16.061758] [INFO ] [MAIN ] PGRE: Successfully saved derivative data. [2025-09-17T22:56:16.103200] [INFO ] [MAIN ] Derivative Progress: 1449/2085 symbols completed. PGRE took 1.3s. Estimated remaining: 4m 7s. Rate: 154.2 symbols/min [2025-09-17T22:56:16.246663] [INFO ] [MAIN ] PHD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:16.247792] [DEBUG] [LOCAL ] PH: Loaded 39455 existing records from primary storage. [2025-09-17T22:56:16.247969] [INFO ] [MAIN ] PH: Loaded 39455 primary data records. [2025-09-17T22:56:16.342010] [DEBUG] [LOCAL ] PHD: Loaded 9577 existing records from primary storage. [2025-09-17T22:56:16.353689] [INFO ] [MAIN ] PHD: Loaded 9577 primary data records. [2025-09-17T22:56:16.901047] [DEBUG] [MAIN ] PGZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:16.901931] [INFO ] [MAIN ] PGZ: Generated 1794 derivative records from 5430 primary records. [2025-09-17T22:56:16.902119] [DEBUG] [LOCAL ] PGZ: Saving derivative data. [2025-09-17T22:56:16.935870] [DEBUG] [LOCAL ] PGZ: Derivative data saved (1794 records). [2025-09-17T22:56:16.936545] [INFO ] [MAIN ] PGZ: Successfully saved derivative data. [2025-09-17T22:56:16.936479] [DEBUG] [MAIN ] PH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:16.939611] [INFO ] [MAIN ] Derivative Progress: 1450/2085 symbols completed. PGZ took 1.1s. Estimated remaining: 4m 7s. Rate: 154.1 symbols/min [2025-09-17T22:56:16.939959] [INFO ] [MAIN ] PHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:16.937374] [INFO ] [MAIN ] PH: Generated 1794 derivative records from 39455 primary records. [2025-09-17T22:56:16.941877] [DEBUG] [LOCAL ] PH: Saving derivative data. [2025-09-17T22:56:16.968669] [DEBUG] [MAIN ] PHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:16.972054] [INFO ] [MAIN ] PHD: Generated 1794 derivative records from 9577 primary records. [2025-09-17T22:56:16.972734] [DEBUG] [LOCAL ] PH: Derivative data saved (1794 records). [2025-09-17T22:56:16.972366] [DEBUG] [LOCAL ] PHD: Saving derivative data. [2025-09-17T22:56:16.972842] [INFO ] [MAIN ] PH: Successfully saved derivative data. [2025-09-17T22:56:16.975431] [INFO ] [MAIN ] Derivative Progress: 1451/2085 symbols completed. PH took 1.1s. Estimated remaining: 4m 7s. Rate: 154.2 symbols/min [2025-09-17T22:56:16.976319] [INFO ] [MAIN ] PHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:16.991786] [DEBUG] [LOCAL ] PHD: Derivative data saved (1794 records). [2025-09-17T22:56:16.991920] [INFO ] [MAIN ] PHD: Successfully saved derivative data. [2025-09-17T22:56:16.994702] [INFO ] [MAIN ] Derivative Progress: 1452/2085 symbols completed. PHD took 0.8s. Estimated remaining: 4m 6s. Rate: 154.3 symbols/min [2025-09-17T22:56:16.995081] [INFO ] [MAIN ] PHIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:17.008035] [DEBUG] [LOCAL ] PHI: Loaded 14878 existing records from primary storage. [2025-09-17T22:56:17.018098] [INFO ] [MAIN ] PHI: Loaded 14878 primary data records. [2025-09-17T22:56:17.169160] [DEBUG] [LOCAL ] PHG: Loaded 46280 existing records from primary storage. [2025-09-17T22:56:17.175191] [INFO ] [MAIN ] PHG: Loaded 46280 primary data records. [2025-09-17T22:56:17.316294] [DEBUG] [LOCAL ] PHIN: Loaded 33544 existing records from primary storage. [2025-09-17T22:56:17.321727] [INFO ] [MAIN ] PHIN: Loaded 33544 primary data records. [2025-09-17T22:56:18.195449] [DEBUG] [MAIN ] PHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:18.196970] [INFO ] [MAIN ] PHI: Generated 1794 derivative records from 14878 primary records. [2025-09-17T22:56:18.197250] [DEBUG] [LOCAL ] PHI: Saving derivative data. [2025-09-17T22:56:18.221068] [DEBUG] [LOCAL ] PHI: Derivative data saved (1794 records). [2025-09-17T22:56:18.223225] [INFO ] [MAIN ] PHI: Successfully saved derivative data. [2025-09-17T22:56:18.225779] [INFO ] [MAIN ] Derivative Progress: 1453/2085 symbols completed. PHI took 1.2s. Estimated remaining: 4m 6s. Rate: 154.0 symbols/min [2025-09-17T22:56:18.238598] [DEBUG] [MAIN ] PHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:18.247602] [INFO ] [MAIN ] PHG: Generated 1794 derivative records from 46280 primary records. [2025-09-17T22:56:18.252445] [DEBUG] [LOCAL ] PHG: Saving derivative data. [2025-09-17T22:56:18.252776] [DEBUG] [MAIN ] PHIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:18.254553] [INFO ] [MAIN ] PHIN: Generated 1794 derivative records from 33544 primary records. [2025-09-17T22:56:18.262899] [DEBUG] [LOCAL ] PHIN: Saving derivative data. [2025-09-17T22:56:18.284386] [DEBUG] [LOCAL ] PHIN: Derivative data saved (1794 records). [2025-09-17T22:56:18.284972] [INFO ] [MAIN ] PHIN: Successfully saved derivative data. [2025-09-17T22:56:18.288000] [INFO ] [MAIN ] Derivative Progress: 1454/2085 symbols completed. PHIN took 1.3s. Estimated remaining: 4m 6s. Rate: 154.1 symbols/min [2025-09-17T22:56:18.288976] [DEBUG] [LOCAL ] PHG: Derivative data saved (1794 records). [2025-09-17T22:56:18.289251] [INFO ] [MAIN ] PHG: Successfully saved derivative data. [2025-09-17T22:56:18.292032] [INFO ] [MAIN ] Derivative Progress: 1455/2085 symbols completed. PHG took 1.4s. Estimated remaining: 4m 5s. Rate: 154.2 symbols/min [2025-09-17T22:56:18.292859] [INFO ] [MAIN ] PHK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:18.293169] [INFO ] [MAIN ] PHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:18.293262] [INFO ] [MAIN ] PHT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:18.329802] [DEBUG] [LOCAL ] PHT: Loaded 15323 existing records from primary storage. [2025-09-17T22:56:18.330080] [INFO ] [MAIN ] PHT: Loaded 15323 primary data records. [2025-09-17T22:56:18.437367] [DEBUG] [LOCAL ] PHK: Loaded 26732 existing records from primary storage. [2025-09-17T22:56:18.440897] [INFO ] [MAIN ] PHK: Loaded 26732 primary data records. [2025-09-17T22:56:18.471082] [DEBUG] [LOCAL ] PHR: Loaded 37087 existing records from primary storage. [2025-09-17T22:56:18.496763] [INFO ] [MAIN ] PHR: Loaded 37087 primary data records. [2025-09-17T22:56:19.296861] [DEBUG] [MAIN ] PHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:19.298026] [INFO ] [MAIN ] PHT: Generated 1794 derivative records from 15323 primary records. [2025-09-17T22:56:19.298303] [DEBUG] [LOCAL ] PHT: Saving derivative data. [2025-09-17T22:56:19.345397] [DEBUG] [MAIN ] PHK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:19.346483] [INFO ] [MAIN ] PHK: Generated 1794 derivative records from 26732 primary records. [2025-09-17T22:56:19.345036] [DEBUG] [LOCAL ] PHT: Derivative data saved (1794 records). [2025-09-17T22:56:19.346580] [DEBUG] [LOCAL ] PHK: Saving derivative data. [2025-09-17T22:56:19.346703] [INFO ] [MAIN ] PHT: Successfully saved derivative data. [2025-09-17T22:56:19.345732] [DEBUG] [MAIN ] PHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:19.347680] [INFO ] [MAIN ] PHR: Generated 1794 derivative records from 37087 primary records. [2025-09-17T22:56:19.349969] [INFO ] [MAIN ] Derivative Progress: 1456/2085 symbols completed. PHT took 1.1s. Estimated remaining: 4m 5s. Rate: 154.0 symbols/min [2025-09-17T22:56:19.350085] [DEBUG] [LOCAL ] PHR: Saving derivative data. [2025-09-17T22:56:19.351454] [INFO ] [MAIN ] PII: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:19.381007] [DEBUG] [LOCAL ] PHK: Derivative data saved (1794 records). [2025-09-17T22:56:19.382761] [INFO ] [MAIN ] PHK: Successfully saved derivative data. [2025-09-17T22:56:19.383454] [DEBUG] [LOCAL ] PHR: Derivative data saved (1794 records). [2025-09-17T22:56:19.383636] [INFO ] [MAIN ] PHR: Successfully saved derivative data. [2025-09-17T22:56:19.386319] [INFO ] [MAIN ] Derivative Progress: 1457/2085 symbols completed. PHK took 1.1s. Estimated remaining: 4m 4s. Rate: 154.1 symbols/min [2025-09-17T22:56:19.389896] [INFO ] [MAIN ] Derivative Progress: 1458/2085 symbols completed. PHR took 1.1s. Estimated remaining: 4m 4s. Rate: 154.2 symbols/min [2025-09-17T22:56:19.389830] [INFO ] [MAIN ] PIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:19.390114] [INFO ] [MAIN ] PINE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:19.399719] [DEBUG] [LOCAL ] PIM: Loaded 4781 existing records from primary storage. [2025-09-17T22:56:19.399957] [INFO ] [MAIN ] PIM: Loaded 4781 primary data records. [2025-09-17T22:56:19.542948] [DEBUG] [LOCAL ] PINE: Loaded 14236 existing records from primary storage. [2025-09-17T22:56:19.547300] [INFO ] [MAIN ] PINE: Loaded 14236 primary data records. [2025-09-17T22:56:19.626330] [DEBUG] [LOCAL ] PII: Loaded 49436 existing records from primary storage. [2025-09-17T22:56:19.649554] [INFO ] [MAIN ] PII: Loaded 49436 primary data records. [2025-09-17T22:56:20.476803] [DEBUG] [MAIN ] PINE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:20.476404] [DEBUG] [MAIN ] PIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:20.478163] [INFO ] [MAIN ] PIM: Generated 1794 derivative records from 4781 primary records. [2025-09-17T22:56:20.479633] [DEBUG] [LOCAL ] PIM: Saving derivative data. [2025-09-17T22:56:20.479551] [INFO ] [MAIN ] PINE: Generated 1794 derivative records from 14236 primary records. [2025-09-17T22:56:20.480346] [DEBUG] [LOCAL ] PINE: Saving derivative data. [2025-09-17T22:56:20.511630] [DEBUG] [LOCAL ] PINE: Derivative data saved (1794 records). [2025-09-17T22:56:20.512452] [INFO ] [MAIN ] PINE: Successfully saved derivative data. [2025-09-17T22:56:20.512915] [DEBUG] [LOCAL ] PIM: Derivative data saved (1794 records). [2025-09-17T22:56:20.515928] [INFO ] [MAIN ] PIM: Successfully saved derivative data. [2025-09-17T22:56:20.515799] [INFO ] [MAIN ] Derivative Progress: 1459/2085 symbols completed. PINE took 1.1s. Estimated remaining: 4m 4s. Rate: 154.0 symbols/min [2025-09-17T22:56:20.518811] [INFO ] [MAIN ] Derivative Progress: 1460/2085 symbols completed. PIM took 1.1s. Estimated remaining: 4m 3s. Rate: 154.1 symbols/min [2025-09-17T22:56:20.518896] [INFO ] [MAIN ] PINS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:20.519046] [INFO ] [MAIN ] PIPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:20.535972] [DEBUG] [MAIN ] PII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:20.536845] [INFO ] [MAIN ] PII: Generated 1794 derivative records from 49436 primary records. [2025-09-17T22:56:20.536908] [DEBUG] [LOCAL ] PII: Saving derivative data. [2025-09-17T22:56:20.563259] [DEBUG] [LOCAL ] PIPR: Loaded 15397 existing records from primary storage. [2025-09-17T22:56:20.563949] [INFO ] [MAIN ] PIPR: Loaded 15397 primary data records. [2025-09-17T22:56:20.603738] [DEBUG] [LOCAL ] PII: Derivative data saved (1794 records). [2025-09-17T22:56:20.631619] [INFO ] [MAIN ] PII: Successfully saved derivative data. [2025-09-17T22:56:20.672690] [INFO ] [MAIN ] Derivative Progress: 1461/2085 symbols completed. PII took 1.3s. Estimated remaining: 4m 3s. Rate: 154.2 symbols/min [2025-09-17T22:56:20.691171] [INFO ] [MAIN ] PJT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:20.788030] [DEBUG] [LOCAL ] PINS: Loaded 53693 existing records from primary storage. [2025-09-17T22:56:20.897967] [INFO ] [MAIN ] PINS: Loaded 53693 primary data records. [2025-09-17T22:56:21.050109] [DEBUG] [LOCAL ] PJT: Loaded 22933 existing records from primary storage. [2025-09-17T22:56:21.074227] [INFO ] [MAIN ] PJT: Loaded 22933 primary data records. [2025-09-17T22:56:21.432818] [DEBUG] [MAIN ] PIPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:21.433886] [INFO ] [MAIN ] PIPR: Generated 1794 derivative records from 15397 primary records. [2025-09-17T22:56:21.443840] [DEBUG] [LOCAL ] PIPR: Saving derivative data. [2025-09-17T22:56:21.571454] [DEBUG] [LOCAL ] PIPR: Derivative data saved (1794 records). [2025-09-17T22:56:21.571813] [INFO ] [MAIN ] PIPR: Successfully saved derivative data. [2025-09-17T22:56:21.575320] [INFO ] [MAIN ] Derivative Progress: 1462/2085 symbols completed. PIPR took 1.1s. Estimated remaining: 4m 3s. Rate: 154.1 symbols/min [2025-09-17T22:56:21.576897] [INFO ] [MAIN ] PK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:21.595252] [DEBUG] [MAIN ] PINS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:21.596179] [INFO ] [MAIN ] PINS: Generated 1794 derivative records from 53693 primary records. [2025-09-17T22:56:21.596412] [DEBUG] [LOCAL ] PINS: Saving derivative data. [2025-09-17T22:56:21.613461] [DEBUG] [LOCAL ] PINS: Derivative data saved (1794 records). [2025-09-17T22:56:21.613865] [INFO ] [MAIN ] PINS: Successfully saved derivative data. [2025-09-17T22:56:21.616711] [INFO ] [MAIN ] Derivative Progress: 1463/2085 symbols completed. PINS took 1.1s. Estimated remaining: 4m 2s. Rate: 154.2 symbols/min [2025-09-17T22:56:21.617156] [INFO ] [MAIN ] PKE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:21.633297] [DEBUG] [MAIN ] PJT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:21.634127] [INFO ] [MAIN ] PJT: Generated 1794 derivative records from 22933 primary records. [2025-09-17T22:56:21.634359] [DEBUG] [LOCAL ] PJT: Saving derivative data. [2025-09-17T22:56:21.669084] [DEBUG] [LOCAL ] PKE: Loaded 12305 existing records from primary storage. [2025-09-17T22:56:21.669444] [INFO ] [MAIN ] PKE: Loaded 12305 primary data records. [2025-09-17T22:56:21.755177] [DEBUG] [LOCAL ] PJT: Derivative data saved (1794 records). [2025-09-17T22:56:21.779714] [INFO ] [MAIN ] PJT: Successfully saved derivative data. [2025-09-17T22:56:21.793996] [INFO ] [MAIN ] Derivative Progress: 1464/2085 symbols completed. PJT took 1.1s. Estimated remaining: 4m 2s. Rate: 154.2 symbols/min [2025-09-17T22:56:21.795227] [DEBUG] [LOCAL ] PK: Loaded 52900 existing records from primary storage. [2025-09-17T22:56:21.794462] [INFO ] [MAIN ] PKG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:21.795370] [INFO ] [MAIN ] PK: Loaded 52900 primary data records. [2025-09-17T22:56:22.354745] [DEBUG] [LOCAL ] PKG: Loaded 39509 existing records from primary storage. [2025-09-17T22:56:22.355439] [INFO ] [MAIN ] PKG: Loaded 39509 primary data records. [2025-09-17T22:56:22.536783] [DEBUG] [MAIN ] PKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:22.683320] [INFO ] [MAIN ] PKE: Generated 1794 derivative records from 12305 primary records. [2025-09-17T22:56:22.688541] [DEBUG] [MAIN ] PK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:22.688271] [DEBUG] [LOCAL ] PKE: Saving derivative data. [2025-09-17T22:56:22.689264] [INFO ] [MAIN ] PK: Generated 1794 derivative records from 52900 primary records. [2025-09-17T22:56:22.689823] [DEBUG] [LOCAL ] PK: Saving derivative data. [2025-09-17T22:56:22.723304] [DEBUG] [LOCAL ] PKE: Derivative data saved (1794 records). [2025-09-17T22:56:22.724724] [DEBUG] [LOCAL ] PK: Derivative data saved (1794 records). [2025-09-17T22:56:22.724846] [INFO ] [MAIN ] PKE: Successfully saved derivative data. [2025-09-17T22:56:22.727231] [INFO ] [MAIN ] Derivative Progress: 1465/2085 symbols completed. PKE took 1.1s. Estimated remaining: 4m 1s. Rate: 154.1 symbols/min [2025-09-17T22:56:22.728165] [INFO ] [MAIN ] PKST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:22.727325] [INFO ] [MAIN ] PK: Successfully saved derivative data. [2025-09-17T22:56:22.732228] [INFO ] [MAIN ] Derivative Progress: 1466/2085 symbols completed. PK took 1.2s. Estimated remaining: 4m 1s. Rate: 154.2 symbols/min [2025-09-17T22:56:22.733005] [INFO ] [MAIN ] PKX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:22.760378] [DEBUG] [MAIN ] PKG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:22.761107] [INFO ] [MAIN ] PKG: Generated 1794 derivative records from 39509 primary records. [2025-09-17T22:56:22.767288] [DEBUG] [LOCAL ] PKG: Saving derivative data. [2025-09-17T22:56:22.775836] [DEBUG] [LOCAL ] PKST: Loaded 19563 existing records from primary storage. [2025-09-17T22:56:22.776373] [INFO ] [MAIN ] PKST: Loaded 19563 primary data records. [2025-09-17T22:56:22.853560] [DEBUG] [LOCAL ] PKX: Loaded 25446 existing records from primary storage. [2025-09-17T22:56:22.873026] [INFO ] [MAIN ] PKX: Loaded 25446 primary data records. [2025-09-17T22:56:23.065365] [DEBUG] [LOCAL ] PKG: Derivative data saved (1794 records). [2025-09-17T22:56:23.099824] [INFO ] [MAIN ] PKG: Successfully saved derivative data. [2025-09-17T22:56:23.177554] [INFO ] [MAIN ] Derivative Progress: 1467/2085 symbols completed. PKG took 1.4s. Estimated remaining: 4m 1s. Rate: 154.2 symbols/min [2025-09-17T22:56:23.332208] [INFO ] [MAIN ] PL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:23.480087] [DEBUG] [MAIN ] PKST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:23.481660] [INFO ] [MAIN ] PKST: Generated 1794 derivative records from 19563 primary records. [2025-09-17T22:56:23.481855] [DEBUG] [LOCAL ] PKST: Saving derivative data. [2025-09-17T22:56:23.503927] [DEBUG] [MAIN ] PKX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:23.507257] [INFO ] [MAIN ] PKX: Generated 1794 derivative records from 25446 primary records. [2025-09-17T22:56:23.507639] [DEBUG] [LOCAL ] PKX: Saving derivative data. [2025-09-17T22:56:23.538378] [DEBUG] [LOCAL ] PKX: Derivative data saved (1794 records). [2025-09-17T22:56:23.539443] [INFO ] [MAIN ] PKX: Successfully saved derivative data. [2025-09-17T22:56:23.542959] [INFO ] [MAIN ] Derivative Progress: 1468/2085 symbols completed. PKX took 0.8s. Estimated remaining: 4m 0s. Rate: 154.2 symbols/min [2025-09-17T22:56:23.559410] [DEBUG] [LOCAL ] PKST: Derivative data saved (1794 records). [2025-09-17T22:56:23.559527] [INFO ] [MAIN ] PKST: Successfully saved derivative data. [2025-09-17T22:56:23.562007] [INFO ] [MAIN ] Derivative Progress: 1469/2085 symbols completed. PKST took 0.8s. Estimated remaining: 3m 60s. Rate: 154.3 symbols/min [2025-09-17T22:56:23.562964] [DEBUG] [LOCAL ] PL: Loaded 53104 existing records from primary storage. [2025-09-17T22:56:23.563197] [INFO ] [MAIN ] PL: Loaded 53104 primary data records. [2025-09-17T22:56:23.899971] [DEBUG] [MAIN ] PL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:23.900564] [INFO ] [MAIN ] PL: Generated 1794 derivative records from 53104 primary records. [2025-09-17T22:56:23.900623] [DEBUG] [LOCAL ] PL: Saving derivative data. [2025-09-17T22:56:23.915381] [DEBUG] [LOCAL ] PL: Derivative data saved (1794 records). [2025-09-17T22:56:23.915438] [INFO ] [MAIN ] PL: Successfully saved derivative data. [2025-09-17T22:56:23.917616] [INFO ] [MAIN ] Derivative Progress: 1470/2085 symbols completed. PL took 0.6s. Estimated remaining: 3m 59s. Rate: 154.3 symbols/min [2025-09-17T22:56:23.918329] [INFO ] [MAIN ] PLD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:23.918533] [INFO ] [MAIN ] PLYM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:23.918844] [INFO ] [MAIN ] PLOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:23.940730] [DEBUG] [LOCAL ] PLOW: Loaded 20777 existing records from primary storage. [2025-09-17T22:56:23.940862] [INFO ] [MAIN ] PLOW: Loaded 20777 primary data records. [2025-09-17T22:56:24.158996] [DEBUG] [LOCAL ] PLYM: Loaded 33009 existing records from primary storage. [2025-09-17T22:56:24.283846] [INFO ] [MAIN ] PLYM: Loaded 33009 primary data records. [2025-09-17T22:56:24.339680] [DEBUG] [LOCAL ] PLD: Loaded 53486 existing records from primary storage. [2025-09-17T22:56:24.370515] [INFO ] [MAIN ] PLD: Loaded 53486 primary data records. [2025-09-17T22:56:24.942935] [DEBUG] [MAIN ] PLOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:24.944888] [INFO ] [MAIN ] PLOW: Generated 1794 derivative records from 20777 primary records. [2025-09-17T22:56:24.945240] [DEBUG] [LOCAL ] PLOW: Saving derivative data. [2025-09-17T22:56:24.964345] [DEBUG] [LOCAL ] PLOW: Derivative data saved (1794 records). [2025-09-17T22:56:24.964849] [INFO ] [MAIN ] PLOW: Successfully saved derivative data. [2025-09-17T22:56:24.967561] [INFO ] [MAIN ] Derivative Progress: 1471/2085 symbols completed. PLOW took 1.0s. Estimated remaining: 3m 59s. Rate: 154.1 symbols/min [2025-09-17T22:56:24.968163] [INFO ] [MAIN ] PML: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:24.986538] [DEBUG] [MAIN ] PLYM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:24.987382] [INFO ] [MAIN ] PLYM: Generated 1794 derivative records from 33009 primary records. [2025-09-17T22:56:24.987597] [DEBUG] [LOCAL ] PLYM: Saving derivative data. [2025-09-17T22:56:25.011807] [DEBUG] [LOCAL ] PLYM: Derivative data saved (1794 records). [2025-09-17T22:56:25.036016] [DEBUG] [MAIN ] PLD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:25.035511] [INFO ] [MAIN ] PLYM: Successfully saved derivative data. [2025-09-17T22:56:25.038460] [INFO ] [MAIN ] Derivative Progress: 1472/2085 symbols completed. PLYM took 1.1s. Estimated remaining: 3m 59s. Rate: 154.2 symbols/min [2025-09-17T22:56:25.039257] [INFO ] [MAIN ] PMM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:25.039028] [DEBUG] [LOCAL ] PML: Loaded 20318 existing records from primary storage. [2025-09-17T22:56:25.039526] [INFO ] [MAIN ] PML: Loaded 20318 primary data records. [2025-09-17T22:56:25.040548] [INFO ] [MAIN ] PLD: Generated 1794 derivative records from 53486 primary records. [2025-09-17T22:56:25.040789] [DEBUG] [LOCAL ] PLD: Saving derivative data. [2025-09-17T22:56:25.158456] [DEBUG] [LOCAL ] PMM: Loaded 10771 existing records from primary storage. [2025-09-17T22:56:25.137986] [DEBUG] [LOCAL ] PLD: Derivative data saved (1794 records). [2025-09-17T22:56:25.169713] [INFO ] [MAIN ] PMM: Loaded 10771 primary data records. [2025-09-17T22:56:25.175690] [INFO ] [MAIN ] PLD: Successfully saved derivative data. [2025-09-17T22:56:25.213803] [INFO ] [MAIN ] Derivative Progress: 1473/2085 symbols completed. PLD took 1.3s. Estimated remaining: 3m 58s. Rate: 154.2 symbols/min [2025-09-17T22:56:25.261264] [INFO ] [MAIN ] PMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:25.665878] [DEBUG] [LOCAL ] PMO: Loaded 10752 existing records from primary storage. [2025-09-17T22:56:25.675578] [INFO ] [MAIN ] PMO: Loaded 10752 primary data records. [2025-09-17T22:56:26.037403] [DEBUG] [MAIN ] PML: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:26.039130] [INFO ] [MAIN ] PML: Generated 1794 derivative records from 20318 primary records. [2025-09-17T22:56:26.039783] [DEBUG] [LOCAL ] PML: Saving derivative data. [2025-09-17T22:56:26.058675] [DEBUG] [LOCAL ] PML: Derivative data saved (1794 records). [2025-09-17T22:56:26.059197] [INFO ] [MAIN ] PML: Successfully saved derivative data. [2025-09-17T22:56:26.074085] [DEBUG] [MAIN ] PMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:26.073712] [INFO ] [MAIN ] Derivative Progress: 1474/2085 symbols completed. PML took 1.1s. Estimated remaining: 3m 58s. Rate: 154.1 symbols/min [2025-09-17T22:56:26.075206] [INFO ] [MAIN ] PMM: Generated 1794 derivative records from 10771 primary records. [2025-09-17T22:56:26.075466] [DEBUG] [LOCAL ] PMM: Saving derivative data. [2025-09-17T22:56:26.076012] [INFO ] [MAIN ] PMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:26.092142] [DEBUG] [LOCAL ] PMM: Derivative data saved (1794 records). [2025-09-17T22:56:26.092344] [INFO ] [MAIN ] PMM: Successfully saved derivative data. [2025-09-17T22:56:26.094874] [INFO ] [MAIN ] Derivative Progress: 1475/2085 symbols completed. PMM took 1.1s. Estimated remaining: 3m 57s. Rate: 154.2 symbols/min [2025-09-17T22:56:26.095446] [INFO ] [MAIN ] PNI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:26.117553] [DEBUG] [MAIN ] PMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:26.118445] [INFO ] [MAIN ] PMO: Generated 1794 derivative records from 10752 primary records. [2025-09-17T22:56:26.121634] [DEBUG] [LOCAL ] PMO: Saving derivative data. [2025-09-17T22:56:26.122215] [DEBUG] [LOCAL ] PNI: Loaded 6795 existing records from primary storage. [2025-09-17T22:56:26.122750] [INFO ] [MAIN ] PNI: Loaded 6795 primary data records. [2025-09-17T22:56:26.275696] [DEBUG] [LOCAL ] PMO: Derivative data saved (1794 records). [2025-09-17T22:56:26.276988] [INFO ] [MAIN ] PMO: Successfully saved derivative data. [2025-09-17T22:56:26.298955] [DEBUG] [LOCAL ] PMT: Loaded 40272 existing records from primary storage. [2025-09-17T22:56:26.321512] [INFO ] [MAIN ] Derivative Progress: 1476/2085 symbols completed. PMO took 1.1s. Estimated remaining: 3m 57s. Rate: 154.3 symbols/min [2025-09-17T22:56:26.330616] [INFO ] [MAIN ] PMT: Loaded 40272 primary data records. [2025-09-17T22:56:26.333790] [INFO ] [MAIN ] PNNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:26.807587] [DEBUG] [LOCAL ] PNNT: Loaded 33012 existing records from primary storage. [2025-09-17T22:56:26.816348] [INFO ] [MAIN ] PNNT: Loaded 33012 primary data records. [2025-09-17T22:56:27.132394] [DEBUG] [MAIN ] PNI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:27.133336] [INFO ] [MAIN ] PNI: Generated 1794 derivative records from 6795 primary records. [2025-09-17T22:56:27.133547] [DEBUG] [LOCAL ] PNI: Saving derivative data. [2025-09-17T22:56:27.151807] [DEBUG] [LOCAL ] PNI: Derivative data saved (1794 records). [2025-09-17T22:56:27.153614] [INFO ] [MAIN ] PNI: Successfully saved derivative data. [2025-09-17T22:56:27.156095] [INFO ] [MAIN ] Derivative Progress: 1477/2085 symbols completed. PNI took 1.1s. Estimated remaining: 3m 57s. Rate: 154.1 symbols/min [2025-09-17T22:56:27.156665] [INFO ] [MAIN ] PNW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:27.171882] [DEBUG] [MAIN ] PMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:27.172861] [INFO ] [MAIN ] PMT: Generated 1794 derivative records from 40272 primary records. [2025-09-17T22:56:27.173142] [DEBUG] [LOCAL ] PMT: Saving derivative data. [2025-09-17T22:56:27.206701] [DEBUG] [LOCAL ] PMT: Derivative data saved (1794 records). [2025-09-17T22:56:27.206986] [DEBUG] [MAIN ] PNNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:27.207840] [INFO ] [MAIN ] PNNT: Generated 1794 derivative records from 33012 primary records. [2025-09-17T22:56:27.207130] [INFO ] [MAIN ] PMT: Successfully saved derivative data. [2025-09-17T22:56:27.207973] [DEBUG] [LOCAL ] PNNT: Saving derivative data. [2025-09-17T22:56:27.210478] [INFO ] [MAIN ] Derivative Progress: 1478/2085 symbols completed. PMT took 1.1s. Estimated remaining: 3m 56s. Rate: 154.2 symbols/min [2025-09-17T22:56:27.211178] [INFO ] [MAIN ] POR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:27.236927] [DEBUG] [LOCAL ] PNNT: Derivative data saved (1794 records). [2025-09-17T22:56:27.237128] [INFO ] [MAIN ] PNNT: Successfully saved derivative data. [2025-09-17T22:56:27.239542] [INFO ] [MAIN ] Derivative Progress: 1479/2085 symbols completed. PNNT took 0.9s. Estimated remaining: 3m 56s. Rate: 154.3 symbols/min [2025-09-17T22:56:27.240809] [INFO ] [MAIN ] POST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:27.255104] [DEBUG] [LOCAL ] PNW: Loaded 46133 existing records from primary storage. [2025-09-17T22:56:27.255429] [INFO ] [MAIN ] PNW: Loaded 46133 primary data records. [2025-09-17T22:56:27.587857] [DEBUG] [LOCAL ] POR: Loaded 46973 existing records from primary storage. [2025-09-17T22:56:27.588987] [INFO ] [MAIN ] POR: Loaded 46973 primary data records. [2025-09-17T22:56:27.718029] [DEBUG] [LOCAL ] POST: Loaded 38969 existing records from primary storage. [2025-09-17T22:56:27.718772] [INFO ] [MAIN ] POST: Loaded 38969 primary data records. [2025-09-17T22:56:28.307049] [DEBUG] [MAIN ] PNW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:28.308823] [INFO ] [MAIN ] PNW: Generated 1794 derivative records from 46133 primary records. [2025-09-17T22:56:28.309035] [DEBUG] [LOCAL ] PNW: Saving derivative data. [2025-09-17T22:56:28.328344] [DEBUG] [LOCAL ] PNW: Derivative data saved (1794 records). [2025-09-17T22:56:28.328850] [INFO ] [MAIN ] PNW: Successfully saved derivative data. [2025-09-17T22:56:28.331709] [INFO ] [MAIN ] Derivative Progress: 1480/2085 symbols completed. PNW took 1.2s. Estimated remaining: 3m 56s. Rate: 154.1 symbols/min [2025-09-17T22:56:28.332347] [INFO ] [MAIN ] PPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:28.352061] [DEBUG] [MAIN ] POR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:28.353076] [INFO ] [MAIN ] POR: Generated 1794 derivative records from 46973 primary records. [2025-09-17T22:56:28.353457] [DEBUG] [LOCAL ] POR: Saving derivative data. [2025-09-17T22:56:28.388045] [DEBUG] [LOCAL ] POR: Derivative data saved (1794 records). [2025-09-17T22:56:28.388623] [DEBUG] [MAIN ] POST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:28.389524] [INFO ] [MAIN ] POST: Generated 1794 derivative records from 38969 primary records. [2025-09-17T22:56:28.389631] [INFO ] [MAIN ] POR: Successfully saved derivative data. [2025-09-17T22:56:28.389754] [DEBUG] [LOCAL ] POST: Saving derivative data. [2025-09-17T22:56:28.392888] [INFO ] [MAIN ] Derivative Progress: 1481/2085 symbols completed. POR took 1.2s. Estimated remaining: 3m 55s. Rate: 154.2 symbols/min [2025-09-17T22:56:28.401072] [INFO ] [MAIN ] PPT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:28.410941] [DEBUG] [LOCAL ] POST: Derivative data saved (1794 records). [2025-09-17T22:56:28.424741] [INFO ] [MAIN ] POST: Successfully saved derivative data. [2025-09-17T22:56:28.427912] [INFO ] [MAIN ] Derivative Progress: 1482/2085 symbols completed. POST took 1.2s. Estimated remaining: 3m 54s. Rate: 154.3 symbols/min [2025-09-17T22:56:28.428480] [INFO ] [MAIN ] PR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:28.445684] [DEBUG] [LOCAL ] PPT: Loaded 20368 existing records from primary storage. [2025-09-17T22:56:28.459706] [INFO ] [MAIN ] PPT: Loaded 20368 primary data records. [2025-09-17T22:56:28.508939] [DEBUG] [LOCAL ] PPG: Loaded 50749 existing records from primary storage. [2025-09-17T22:56:28.524356] [INFO ] [MAIN ] PPG: Loaded 50749 primary data records. [2025-09-17T22:56:29.099081] [DEBUG] [LOCAL ] PR: Loaded 53609 existing records from primary storage. [2025-09-17T22:56:29.109450] [INFO ] [MAIN ] PR: Loaded 53609 primary data records. [2025-09-17T22:56:29.469036] [DEBUG] [MAIN ] PPT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:29.476058] [INFO ] [MAIN ] PPT: Generated 1794 derivative records from 20368 primary records. [2025-09-17T22:56:29.474991] [DEBUG] [MAIN ] PPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:29.476379] [DEBUG] [LOCAL ] PPT: Saving derivative data. [2025-09-17T22:56:29.489705] [INFO ] [MAIN ] PPG: Generated 1794 derivative records from 50749 primary records. [2025-09-17T22:56:29.491268] [DEBUG] [LOCAL ] PPG: Saving derivative data. [2025-09-17T22:56:29.512714] [DEBUG] [LOCAL ] PPT: Derivative data saved (1794 records). [2025-09-17T22:56:29.513785] [INFO ] [MAIN ] PPT: Successfully saved derivative data. [2025-09-17T22:56:29.516702] [DEBUG] [LOCAL ] PPG: Derivative data saved (1794 records). [2025-09-17T22:56:29.516242] [INFO ] [MAIN ] Derivative Progress: 1483/2085 symbols completed. PPT took 1.1s. Estimated remaining: 3m 54s. Rate: 154.1 symbols/min [2025-09-17T22:56:29.517473] [INFO ] [MAIN ] PPG: Successfully saved derivative data. [2025-09-17T22:56:29.520569] [INFO ] [MAIN ] Derivative Progress: 1484/2085 symbols completed. PPG took 1.2s. Estimated remaining: 3m 54s. Rate: 154.2 symbols/min [2025-09-17T22:56:29.533076] [DEBUG] [MAIN ] PR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:29.533747] [INFO ] [MAIN ] PR: Generated 1794 derivative records from 53609 primary records. [2025-09-17T22:56:29.533811] [DEBUG] [LOCAL ] PR: Saving derivative data. [2025-09-17T22:56:29.549614] [DEBUG] [LOCAL ] PR: Derivative data saved (1794 records). [2025-09-17T22:56:29.549711] [INFO ] [MAIN ] PR: Successfully saved derivative data. [2025-09-17T22:56:29.552603] [INFO ] [MAIN ] Derivative Progress: 1485/2085 symbols completed. PR took 1.1s. Estimated remaining: 3m 53s. Rate: 154.3 symbols/min [2025-09-17T22:56:29.553389] [INFO ] [MAIN ] PRG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:29.553669] [INFO ] [MAIN ] PRGO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:29.553300] [INFO ] [MAIN ] PRA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:29.595817] [DEBUG] [LOCAL ] PRG: Loaded 30526 existing records from primary storage. [2025-09-17T22:56:29.596106] [INFO ] [MAIN ] PRG: Loaded 30526 primary data records. [2025-09-17T22:56:29.723556] [DEBUG] [LOCAL ] PRA: Loaded 34737 existing records from primary storage. [2025-09-17T22:56:29.729375] [INFO ] [MAIN ] PRA: Loaded 34737 primary data records. [2025-09-17T22:56:29.891182] [DEBUG] [LOCAL ] PRGO: Loaded 46960 existing records from primary storage. [2025-09-17T22:56:30.016894] [INFO ] [MAIN ] PRGO: Loaded 46960 primary data records. [2025-09-17T22:56:30.630359] [DEBUG] [MAIN ] PRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:30.632022] [INFO ] [MAIN ] PRG: Generated 1794 derivative records from 30526 primary records. [2025-09-17T22:56:30.632448] [DEBUG] [LOCAL ] PRG: Saving derivative data. [2025-09-17T22:56:30.663639] [DEBUG] [MAIN ] PRA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:30.665380] [INFO ] [MAIN ] PRA: Generated 1794 derivative records from 34737 primary records. [2025-09-17T22:56:30.665871] [DEBUG] [LOCAL ] PRA: Saving derivative data. [2025-09-17T22:56:30.682627] [DEBUG] [LOCAL ] PRG: Derivative data saved (1794 records). [2025-09-17T22:56:30.687061] [DEBUG] [LOCAL ] PRA: Derivative data saved (1794 records). [2025-09-17T22:56:30.700733] [INFO ] [MAIN ] PRG: Successfully saved derivative data. [2025-09-17T22:56:30.701124] [DEBUG] [MAIN ] PRGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:30.701937] [INFO ] [MAIN ] PRGO: Generated 1794 derivative records from 46960 primary records. [2025-09-17T22:56:30.704395] [INFO ] [MAIN ] Derivative Progress: 1486/2085 symbols completed. PRG took 1.2s. Estimated remaining: 3m 53s. Rate: 154.1 symbols/min [2025-09-17T22:56:30.704507] [INFO ] [MAIN ] PRA: Successfully saved derivative data. [2025-09-17T22:56:30.704833] [DEBUG] [LOCAL ] PRGO: Saving derivative data. [2025-09-17T22:56:30.707712] [INFO ] [MAIN ] PRH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:30.707601] [INFO ] [MAIN ] Derivative Progress: 1487/2085 symbols completed. PRA took 1.2s. Estimated remaining: 3m 53s. Rate: 154.2 symbols/min [2025-09-17T22:56:30.709419] [INFO ] [MAIN ] PRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:30.728068] [DEBUG] [LOCAL ] PRGO: Derivative data saved (1794 records). [2025-09-17T22:56:30.728330] [INFO ] [MAIN ] PRGO: Successfully saved derivative data. [2025-09-17T22:56:30.731428] [INFO ] [MAIN ] Derivative Progress: 1488/2085 symbols completed. PRGO took 1.2s. Estimated remaining: 3m 52s. Rate: 154.3 symbols/min [2025-09-17T22:56:30.732019] [INFO ] [MAIN ] PRIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:30.735118] [DEBUG] [LOCAL ] PRH: Loaded 4965 existing records from primary storage. [2025-09-17T22:56:30.735526] [INFO ] [MAIN ] PRH: Loaded 4965 primary data records. [2025-09-17T22:56:30.858311] [DEBUG] [LOCAL ] PRI: Loaded 18455 existing records from primary storage. [2025-09-17T22:56:30.879934] [INFO ] [MAIN ] PRI: Loaded 18455 primary data records. [2025-09-17T22:56:31.227321] [DEBUG] [LOCAL ] PRIM: Loaded 44530 existing records from primary storage. [2025-09-17T22:56:31.245138] [INFO ] [MAIN ] PRIM: Loaded 44530 primary data records. [2025-09-17T22:56:31.712873] [DEBUG] [MAIN ] PRH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:31.714578] [INFO ] [MAIN ] PRH: Generated 1794 derivative records from 4965 primary records. [2025-09-17T22:56:31.715118] [DEBUG] [LOCAL ] PRH: Saving derivative data. [2025-09-17T22:56:31.749476] [DEBUG] [LOCAL ] PRH: Derivative data saved (1794 records). [2025-09-17T22:56:31.749383] [DEBUG] [MAIN ] PRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:31.750467] [INFO ] [MAIN ] PRI: Generated 1794 derivative records from 18455 primary records. [2025-09-17T22:56:31.750862] [DEBUG] [LOCAL ] PRI: Saving derivative data. [2025-09-17T22:56:31.751054] [INFO ] [MAIN ] PRH: Successfully saved derivative data. [2025-09-17T22:56:31.753807] [INFO ] [MAIN ] Derivative Progress: 1489/2085 symbols completed. PRH took 1.0s. Estimated remaining: 3m 52s. Rate: 154.2 symbols/min [2025-09-17T22:56:31.766907] [INFO ] [MAIN ] PRKS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:31.771167] [DEBUG] [LOCAL ] PRI: Derivative data saved (1794 records). [2025-09-17T22:56:31.771786] [INFO ] [MAIN ] PRI: Successfully saved derivative data. [2025-09-17T22:56:31.774479] [INFO ] [MAIN ] Derivative Progress: 1490/2085 symbols completed. PRI took 1.1s. Estimated remaining: 3m 51s. Rate: 154.3 symbols/min [2025-09-17T22:56:31.775112] [INFO ] [MAIN ] PRLB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:31.792580] [DEBUG] [MAIN ] PRIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:31.793311] [INFO ] [MAIN ] PRIM: Generated 1794 derivative records from 44530 primary records. [2025-09-17T22:56:31.793460] [DEBUG] [LOCAL ] PRIM: Saving derivative data. [2025-09-17T22:56:31.810533] [DEBUG] [LOCAL ] PRIM: Derivative data saved (1794 records). [2025-09-17T22:56:31.810794] [INFO ] [MAIN ] PRIM: Successfully saved derivative data. [2025-09-17T22:56:31.819209] [INFO ] [MAIN ] Derivative Progress: 1491/2085 symbols completed. PRIM took 1.1s. Estimated remaining: 3m 51s. Rate: 154.3 symbols/min [2025-09-17T22:56:31.821002] [INFO ] [MAIN ] PRM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:31.839266] [DEBUG] [LOCAL ] PRLB: Loaded 20907 existing records from primary storage. [2025-09-17T22:56:31.839374] [INFO ] [MAIN ] PRLB: Loaded 20907 primary data records. [2025-09-17T22:56:31.959565] [DEBUG] [LOCAL ] PRKS: Loaded 42722 existing records from primary storage. [2025-09-17T22:56:31.990195] [INFO ] [MAIN ] PRKS: Loaded 42722 primary data records. [2025-09-17T22:56:32.316546] [DEBUG] [LOCAL ] PRM: Loaded 44724 existing records from primary storage. [2025-09-17T22:56:32.317236] [INFO ] [MAIN ] PRM: Loaded 44724 primary data records. [2025-09-17T22:56:32.866758] [DEBUG] [MAIN ] PRLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:32.868572] [INFO ] [MAIN ] PRLB: Generated 1794 derivative records from 20907 primary records. [2025-09-17T22:56:32.868969] [DEBUG] [LOCAL ] PRLB: Saving derivative data. [2025-09-17T22:56:32.905313] [DEBUG] [MAIN ] PRKS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:32.904811] [DEBUG] [LOCAL ] PRLB: Derivative data saved (1794 records). [2025-09-17T22:56:32.905715] [INFO ] [MAIN ] PRLB: Successfully saved derivative data. [2025-09-17T22:56:32.906505] [INFO ] [MAIN ] PRKS: Generated 1794 derivative records from 42722 primary records. [2025-09-17T22:56:32.906887] [DEBUG] [LOCAL ] PRKS: Saving derivative data. [2025-09-17T22:56:32.910476] [INFO ] [MAIN ] Derivative Progress: 1492/2085 symbols completed. PRLB took 1.1s. Estimated remaining: 3m 51s. Rate: 154.2 symbols/min [2025-09-17T22:56:32.911176] [INFO ] [MAIN ] PRMB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:32.931466] [DEBUG] [LOCAL ] PRKS: Derivative data saved (1794 records). [2025-09-17T22:56:32.932499] [INFO ] [MAIN ] PRKS: Successfully saved derivative data. [2025-09-17T22:56:32.935302] [INFO ] [MAIN ] Derivative Progress: 1493/2085 symbols completed. PRKS took 1.2s. Estimated remaining: 3m 50s. Rate: 154.3 symbols/min [2025-09-17T22:56:32.936154] [INFO ] [MAIN ] PRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:32.950870] [DEBUG] [MAIN ] PRM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:32.951831] [INFO ] [MAIN ] PRM: Generated 1794 derivative records from 44724 primary records. [2025-09-17T22:56:32.952544] [DEBUG] [LOCAL ] PRM: Saving derivative data. [2025-09-17T22:56:32.976072] [DEBUG] [LOCAL ] PRM: Derivative data saved (1794 records). [2025-09-17T22:56:32.976355] [INFO ] [MAIN ] PRM: Successfully saved derivative data. [2025-09-17T22:56:32.979022] [INFO ] [MAIN ] Derivative Progress: 1494/2085 symbols completed. PRM took 1.2s. Estimated remaining: 3m 50s. Rate: 154.4 symbols/min [2025-09-17T22:56:32.979425] [INFO ] [MAIN ] PRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:33.009439] [DEBUG] [LOCAL ] PRT: Loaded 5402 existing records from primary storage. [2025-09-17T22:56:33.009579] [INFO ] [MAIN ] PRT: Loaded 5402 primary data records. [2025-09-17T22:56:33.136491] [DEBUG] [LOCAL ] PRO: Loaded 37205 existing records from primary storage. [2025-09-17T22:56:33.155840] [DEBUG] [LOCAL ] PRMB: Loaded 53131 existing records from primary storage. [2025-09-17T22:56:33.156398] [INFO ] [MAIN ] PRO: Loaded 37205 primary data records. [2025-09-17T22:56:33.156533] [INFO ] [MAIN ] PRMB: Loaded 53131 primary data records. [2025-09-17T22:56:34.083942] [DEBUG] [MAIN ] PRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:34.084423] [DEBUG] [MAIN ] PRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:34.094375] [INFO ] [MAIN ] PRT: Generated 1794 derivative records from 5402 primary records. [2025-09-17T22:56:34.093525] [INFO ] [MAIN ] PRO: Generated 1794 derivative records from 37205 primary records. [2025-09-17T22:56:34.098960] [DEBUG] [LOCAL ] PRO: Saving derivative data. [2025-09-17T22:56:34.094538] [DEBUG] [LOCAL ] PRT: Saving derivative data. [2025-09-17T22:56:34.100380] [DEBUG] [MAIN ] PRMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:34.102382] [INFO ] [MAIN ] PRMB: Generated 1794 derivative records from 53131 primary records. [2025-09-17T22:56:34.108833] [DEBUG] [LOCAL ] PRMB: Saving derivative data. [2025-09-17T22:56:34.129362] [DEBUG] [LOCAL ] PRT: Derivative data saved (1794 records). [2025-09-17T22:56:34.130369] [INFO ] [MAIN ] PRT: Successfully saved derivative data. [2025-09-17T22:56:34.140307] [DEBUG] [LOCAL ] PRO: Derivative data saved (1794 records). [2025-09-17T22:56:34.141619] [INFO ] [MAIN ] PRO: Successfully saved derivative data. [2025-09-17T22:56:34.143696] [INFO ] [MAIN ] Derivative Progress: 1495/2085 symbols completed. PRT took 1.2s. Estimated remaining: 3m 50s. Rate: 154.1 symbols/min [2025-09-17T22:56:34.149529] [INFO ] [MAIN ] PRU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:34.153478] [INFO ] [MAIN ] Derivative Progress: 1496/2085 symbols completed. PRO took 1.2s. Estimated remaining: 3m 49s. Rate: 154.2 symbols/min [2025-09-17T22:56:34.154898] [INFO ] [MAIN ] PSA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:34.154512] [DEBUG] [LOCAL ] PRMB: Derivative data saved (1794 records). [2025-09-17T22:56:34.155566] [INFO ] [MAIN ] PRMB: Successfully saved derivative data. [2025-09-17T22:56:34.158562] [INFO ] [MAIN ] Derivative Progress: 1497/2085 symbols completed. PRMB took 1.2s. Estimated remaining: 3m 49s. Rate: 154.3 symbols/min [2025-09-17T22:56:34.159267] [INFO ] [MAIN ] PSBD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:34.169002] [DEBUG] [LOCAL ] PSBD: Loaded 6826 existing records from primary storage. [2025-09-17T22:56:34.169169] [INFO ] [MAIN ] PSBD: Loaded 6826 primary data records. [2025-09-17T22:56:34.524534] [DEBUG] [LOCAL ] PRU: Loaded 51572 existing records from primary storage. [2025-09-17T22:56:34.525383] [INFO ] [MAIN ] PRU: Loaded 51572 primary data records. [2025-09-17T22:56:34.526317] [DEBUG] [LOCAL ] PSA: Loaded 41914 existing records from primary storage. [2025-09-17T22:56:34.538707] [INFO ] [MAIN ] PSA: Loaded 41914 primary data records. [2025-09-17T22:56:35.152805] [DEBUG] [MAIN ] PSBD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:35.154851] [INFO ] [MAIN ] PSBD: Generated 1794 derivative records from 6826 primary records. [2025-09-17T22:56:35.155204] [DEBUG] [LOCAL ] PSBD: Saving derivative data. [2025-09-17T22:56:35.171764] [DEBUG] [LOCAL ] PSBD: Derivative data saved (1794 records). [2025-09-17T22:56:35.171954] [INFO ] [MAIN ] PSBD: Successfully saved derivative data. [2025-09-17T22:56:35.174500] [INFO ] [MAIN ] Derivative Progress: 1498/2085 symbols completed. PSBD took 1.0s. Estimated remaining: 3m 48s. Rate: 154.2 symbols/min [2025-09-17T22:56:35.193244] [DEBUG] [MAIN ] PRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:35.195144] [INFO ] [MAIN ] PRU: Generated 1794 derivative records from 51572 primary records. [2025-09-17T22:56:35.195312] [DEBUG] [LOCAL ] PRU: Saving derivative data. [2025-09-17T22:56:35.215517] [DEBUG] [MAIN ] PSA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:35.221416] [INFO ] [MAIN ] PSA: Generated 1794 derivative records from 41914 primary records. [2025-09-17T22:56:35.222292] [DEBUG] [LOCAL ] PSA: Saving derivative data. [2025-09-17T22:56:35.224381] [DEBUG] [LOCAL ] PRU: Derivative data saved (1794 records). [2025-09-17T22:56:35.224666] [INFO ] [MAIN ] PRU: Successfully saved derivative data. [2025-09-17T22:56:35.226744] [INFO ] [MAIN ] Derivative Progress: 1499/2085 symbols completed. PRU took 1.1s. Estimated remaining: 3m 48s. Rate: 154.3 symbols/min [2025-09-17T22:56:35.241306] [DEBUG] [LOCAL ] PSA: Derivative data saved (1794 records). [2025-09-17T22:56:35.241366] [INFO ] [MAIN ] PSA: Successfully saved derivative data. [2025-09-17T22:56:35.243875] [INFO ] [MAIN ] Derivative Progress: 1500/2085 symbols completed. PSA took 1.1s. Estimated remaining: 3m 47s. Rate: 154.4 symbols/min [2025-09-17T22:56:35.244618] [INFO ] [MAIN ] PSN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:35.244809] [INFO ] [MAIN ] PSF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:35.245071] [INFO ] [MAIN ] PSFE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:35.254557] [DEBUG] [LOCAL ] PSF: Loaded 6743 existing records from primary storage. [2025-09-17T22:56:35.254736] [INFO ] [MAIN ] PSF: Loaded 6743 primary data records. [2025-09-17T22:56:35.587266] [DEBUG] [LOCAL ] PSFE: Loaded 30902 existing records from primary storage. [2025-09-17T22:56:35.587598] [INFO ] [MAIN ] PSFE: Loaded 30902 primary data records. [2025-09-17T22:56:35.711393] [DEBUG] [LOCAL ] PSN: Loaded 46416 existing records from primary storage. [2025-09-17T22:56:35.711933] [INFO ] [MAIN ] PSN: Loaded 46416 primary data records. [2025-09-17T22:56:36.277159] [DEBUG] [MAIN ] PSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:36.278307] [INFO ] [MAIN ] PSF: Generated 1794 derivative records from 6743 primary records. [2025-09-17T22:56:36.278471] [DEBUG] [LOCAL ] PSF: Saving derivative data. [2025-09-17T22:56:36.296066] [DEBUG] [LOCAL ] PSF: Derivative data saved (1794 records). [2025-09-17T22:56:36.296340] [INFO ] [MAIN ] PSF: Successfully saved derivative data. [2025-09-17T22:56:36.298572] [INFO ] [MAIN ] Derivative Progress: 1501/2085 symbols completed. PSF took 1.1s. Estimated remaining: 3m 47s. Rate: 154.2 symbols/min [2025-09-17T22:56:36.299164] [INFO ] [MAIN ] PSO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:36.316061] [DEBUG] [MAIN ] PSFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:36.316841] [INFO ] [MAIN ] PSFE: Generated 1794 derivative records from 30902 primary records. [2025-09-17T22:56:36.317189] [DEBUG] [LOCAL ] PSFE: Saving derivative data. [2025-09-17T22:56:36.333550] [DEBUG] [LOCAL ] PSFE: Derivative data saved (1794 records). [2025-09-17T22:56:36.333829] [INFO ] [MAIN ] PSFE: Successfully saved derivative data. [2025-09-17T22:56:36.337539] [INFO ] [MAIN ] Derivative Progress: 1502/2085 symbols completed. PSFE took 1.1s. Estimated remaining: 3m 47s. Rate: 154.3 symbols/min [2025-09-17T22:56:36.339560] [INFO ] [MAIN ] PSQH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:36.356218] [DEBUG] [MAIN ] PSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:36.357091] [INFO ] [MAIN ] PSN: Generated 1794 derivative records from 46416 primary records. [2025-09-17T22:56:36.357292] [DEBUG] [LOCAL ] PSN: Saving derivative data. [2025-09-17T22:56:36.386212] [DEBUG] [LOCAL ] PSN: Derivative data saved (1794 records). [2025-09-17T22:56:36.396395] [INFO ] [MAIN ] PSN: Successfully saved derivative data. [2025-09-17T22:56:36.400373] [INFO ] [MAIN ] Derivative Progress: 1503/2085 symbols completed. PSN took 1.2s. Estimated remaining: 3m 46s. Rate: 154.4 symbols/min [2025-09-17T22:56:36.400839] [INFO ] [MAIN ] PSTG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:36.401493] [DEBUG] [LOCAL ] PSO: Loaded 37818 existing records from primary storage. [2025-09-17T22:56:36.409159] [INFO ] [MAIN ] PSO: Loaded 37818 primary data records. [2025-09-17T22:56:36.526346] [DEBUG] [LOCAL ] PSQH: Loaded 34479 existing records from primary storage. [2025-09-17T22:56:36.537514] [INFO ] [MAIN ] PSQH: Loaded 34479 primary data records. [2025-09-17T22:56:37.068082] [DEBUG] [LOCAL ] PSTG: Loaded 52855 existing records from primary storage. [2025-09-17T22:56:37.068727] [INFO ] [MAIN ] PSTG: Loaded 52855 primary data records. [2025-09-17T22:56:37.412582] [DEBUG] [MAIN ] PSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:37.413624] [INFO ] [MAIN ] PSO: Generated 1794 derivative records from 37818 primary records. [2025-09-17T22:56:37.414541] [DEBUG] [LOCAL ] PSO: Saving derivative data. [2025-09-17T22:56:37.446405] [DEBUG] [LOCAL ] PSO: Derivative data saved (1794 records). [2025-09-17T22:56:37.446935] [DEBUG] [MAIN ] PSQH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:37.447026] [INFO ] [MAIN ] PSO: Successfully saved derivative data. [2025-09-17T22:56:37.447787] [INFO ] [MAIN ] PSQH: Generated 1794 derivative records from 34479 primary records. [2025-09-17T22:56:37.450220] [INFO ] [MAIN ] Derivative Progress: 1504/2085 symbols completed. PSO took 1.2s. Estimated remaining: 3m 46s. Rate: 154.2 symbols/min [2025-09-17T22:56:37.450771] [DEBUG] [LOCAL ] PSQH: Saving derivative data. [2025-09-17T22:56:37.451707] [INFO ] [MAIN ] PSTL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:37.468851] [DEBUG] [LOCAL ] PSQH: Derivative data saved (1794 records). [2025-09-17T22:56:37.469230] [INFO ] [MAIN ] PSQH: Successfully saved derivative data. [2025-09-17T22:56:37.472418] [INFO ] [MAIN ] Derivative Progress: 1505/2085 symbols completed. PSQH took 1.1s. Estimated remaining: 3m 46s. Rate: 154.3 symbols/min [2025-09-17T22:56:37.473256] [INFO ] [MAIN ] PSX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:37.496380] [DEBUG] [MAIN ] PSTG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:37.497181] [INFO ] [MAIN ] PSTG: Generated 1794 derivative records from 52855 primary records. [2025-09-17T22:56:37.504121] [DEBUG] [LOCAL ] PSTG: Saving derivative data. [2025-09-17T22:56:37.504563] [DEBUG] [LOCAL ] PSTL: Loaded 20594 existing records from primary storage. [2025-09-17T22:56:37.505086] [INFO ] [MAIN ] PSTL: Loaded 20594 primary data records. [2025-09-17T22:56:37.665027] [DEBUG] [LOCAL ] PSTG: Derivative data saved (1794 records). [2025-09-17T22:56:37.718359] [INFO ] [MAIN ] PSTG: Successfully saved derivative data. [2025-09-17T22:56:37.829416] [INFO ] [MAIN ] Derivative Progress: 1506/2085 symbols completed. PSTG took 1.4s. Estimated remaining: 3m 45s. Rate: 154.3 symbols/min [2025-09-17T22:56:37.843228] [INFO ] [MAIN ] PTA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:37.860044] [DEBUG] [LOCAL ] PSX: Loaded 53135 existing records from primary storage. [2025-09-17T22:56:37.861021] [INFO ] [MAIN ] PSX: Loaded 53135 primary data records. [2025-09-17T22:56:38.098159] [DEBUG] [LOCAL ] PTA: Loaded 15083 existing records from primary storage. [2025-09-17T22:56:38.098391] [INFO ] [MAIN ] PTA: Loaded 15083 primary data records. [2025-09-17T22:56:38.547986] [DEBUG] [MAIN ] PSTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:38.563425] [INFO ] [MAIN ] PSTL: Generated 1794 derivative records from 20594 primary records. [2025-09-17T22:56:38.563751] [DEBUG] [LOCAL ] PSTL: Saving derivative data. [2025-09-17T22:56:38.582485] [DEBUG] [LOCAL ] PSTL: Derivative data saved (1794 records). [2025-09-17T22:56:38.582710] [INFO ] [MAIN ] PSTL: Successfully saved derivative data. [2025-09-17T22:56:38.585996] [INFO ] [MAIN ] Derivative Progress: 1507/2085 symbols completed. PSTL took 1.1s. Estimated remaining: 3m 45s. Rate: 154.2 symbols/min [2025-09-17T22:56:38.587017] [INFO ] [MAIN ] PTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:38.610289] [DEBUG] [MAIN ] PSX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:38.611077] [INFO ] [MAIN ] PSX: Generated 1794 derivative records from 53135 primary records. [2025-09-17T22:56:38.611296] [DEBUG] [LOCAL ] PSX: Saving derivative data. [2025-09-17T22:56:38.655241] [DEBUG] [MAIN ] PTA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:38.657149] [INFO ] [MAIN ] PTA: Generated 1794 derivative records from 15083 primary records. [2025-09-17T22:56:38.657245] [DEBUG] [LOCAL ] PTA: Saving derivative data. [2025-09-17T22:56:38.656191] [DEBUG] [LOCAL ] PSX: Derivative data saved (1794 records). [2025-09-17T22:56:38.669893] [INFO ] [MAIN ] PSX: Successfully saved derivative data. [2025-09-17T22:56:38.673892] [DEBUG] [LOCAL ] PTY: Loaded 37374 existing records from primary storage. [2025-09-17T22:56:38.672740] [INFO ] [MAIN ] Derivative Progress: 1508/2085 symbols completed. PSX took 1.2s. Estimated remaining: 3m 44s. Rate: 154.3 symbols/min [2025-09-17T22:56:38.681549] [INFO ] [MAIN ] PUK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:38.681695] [INFO ] [MAIN ] PTY: Loaded 37374 primary data records. [2025-09-17T22:56:38.822167] [DEBUG] [LOCAL ] PTA: Derivative data saved (1794 records). [2025-09-17T22:56:38.845153] [INFO ] [MAIN ] PTA: Successfully saved derivative data. [2025-09-17T22:56:38.877769] [INFO ] [MAIN ] Derivative Progress: 1509/2085 symbols completed. PTA took 1.0s. Estimated remaining: 3m 44s. Rate: 154.3 symbols/min [2025-09-17T22:56:38.880711] [INFO ] [MAIN ] PUMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:39.032519] [DEBUG] [LOCAL ] PUK: Loaded 45055 existing records from primary storage. [2025-09-17T22:56:39.033548] [INFO ] [MAIN ] PUK: Loaded 45055 primary data records. [2025-09-17T22:56:39.395242] [DEBUG] [LOCAL ] PUMP: Loaded 49492 existing records from primary storage. [2025-09-17T22:56:39.395775] [INFO ] [MAIN ] PUMP: Loaded 49492 primary data records. [2025-09-17T22:56:39.538334] [DEBUG] [MAIN ] PTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:39.568529] [INFO ] [MAIN ] PTY: Generated 1794 derivative records from 37374 primary records. [2025-09-17T22:56:39.605096] [DEBUG] [LOCAL ] PTY: Saving derivative data. [2025-09-17T22:56:39.755209] [DEBUG] [LOCAL ] PTY: Derivative data saved (1794 records). [2025-09-17T22:56:39.755792] [INFO ] [MAIN ] PTY: Successfully saved derivative data. [2025-09-17T22:56:39.758339] [INFO ] [MAIN ] Derivative Progress: 1510/2085 symbols completed. PTY took 1.2s. Estimated remaining: 3m 44s. Rate: 154.2 symbols/min [2025-09-17T22:56:39.759562] [INFO ] [MAIN ] PVH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:39.782933] [DEBUG] [MAIN ] PUK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:39.783903] [INFO ] [MAIN ] PUK: Generated 1794 derivative records from 45055 primary records. [2025-09-17T22:56:39.784291] [DEBUG] [LOCAL ] PUK: Saving derivative data. [2025-09-17T22:56:39.821059] [DEBUG] [MAIN ] PUMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:39.822879] [INFO ] [MAIN ] PUMP: Generated 1794 derivative records from 49492 primary records. [2025-09-17T22:56:39.822962] [DEBUG] [LOCAL ] PUMP: Saving derivative data. [2025-09-17T22:56:39.825518] [DEBUG] [LOCAL ] PUK: Derivative data saved (1794 records). [2025-09-17T22:56:39.832468] [INFO ] [MAIN ] PUK: Successfully saved derivative data. [2025-09-17T22:56:39.839498] [INFO ] [MAIN ] Derivative Progress: 1511/2085 symbols completed. PUK took 1.2s. Estimated remaining: 3m 43s. Rate: 154.3 symbols/min [2025-09-17T22:56:39.840371] [INFO ] [MAIN ] PVL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:39.857200] [DEBUG] [LOCAL ] PUMP: Derivative data saved (1794 records). [2025-09-17T22:56:39.857435] [INFO ] [MAIN ] PUMP: Successfully saved derivative data. [2025-09-17T22:56:39.859771] [INFO ] [MAIN ] Derivative Progress: 1512/2085 symbols completed. PUMP took 1.0s. Estimated remaining: 3m 43s. Rate: 154.4 symbols/min [2025-09-17T22:56:39.860208] [INFO ] [MAIN ] PWR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:39.864195] [DEBUG] [LOCAL ] PVL: Loaded 4690 existing records from primary storage. [2025-09-17T22:56:39.864448] [INFO ] [MAIN ] PVL: Loaded 4690 primary data records. [2025-09-17T22:56:39.988552] [DEBUG] [LOCAL ] PVH: Loaded 50403 existing records from primary storage. [2025-09-17T22:56:39.989245] [INFO ] [MAIN ] PVH: Loaded 50403 primary data records. [2025-09-17T22:56:40.576976] [DEBUG] [LOCAL ] PWR: Loaded 47616 existing records from primary storage. [2025-09-17T22:56:40.578061] [INFO ] [MAIN ] PWR: Loaded 47616 primary data records. [2025-09-17T22:56:40.911939] [DEBUG] [MAIN ] PVL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:40.913982] [INFO ] [MAIN ] PVL: Generated 1794 derivative records from 4690 primary records. [2025-09-17T22:56:40.914836] [DEBUG] [LOCAL ] PVL: Saving derivative data. [2025-09-17T22:56:40.949127] [DEBUG] [LOCAL ] PVL: Derivative data saved (1794 records). [2025-09-17T22:56:40.949047] [DEBUG] [MAIN ] PVH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:40.950509] [INFO ] [MAIN ] PVH: Generated 1794 derivative records from 50403 primary records. [2025-09-17T22:56:40.949793] [INFO ] [MAIN ] PVL: Successfully saved derivative data. [2025-09-17T22:56:40.950617] [DEBUG] [LOCAL ] PVH: Saving derivative data. [2025-09-17T22:56:40.952966] [INFO ] [MAIN ] Derivative Progress: 1513/2085 symbols completed. PVL took 1.1s. Estimated remaining: 3m 43s. Rate: 154.2 symbols/min [2025-09-17T22:56:40.970074] [DEBUG] [LOCAL ] PVH: Derivative data saved (1794 records). [2025-09-17T22:56:40.970139] [INFO ] [MAIN ] PVH: Successfully saved derivative data. [2025-09-17T22:56:40.972914] [INFO ] [MAIN ] Derivative Progress: 1514/2085 symbols completed. PVH took 1.2s. Estimated remaining: 3m 42s. Rate: 154.3 symbols/min [2025-09-17T22:56:40.988348] [DEBUG] [MAIN ] PWR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:40.989049] [INFO ] [MAIN ] PWR: Generated 1794 derivative records from 47616 primary records. [2025-09-17T22:56:40.989112] [DEBUG] [LOCAL ] PWR: Saving derivative data. [2025-09-17T22:56:41.004590] [DEBUG] [LOCAL ] PWR: Derivative data saved (1794 records). [2025-09-17T22:56:41.004672] [INFO ] [MAIN ] PWR: Successfully saved derivative data. [2025-09-17T22:56:41.006965] [INFO ] [MAIN ] Derivative Progress: 1515/2085 symbols completed. PWR took 1.1s. Estimated remaining: 3m 42s. Rate: 154.4 symbols/min [2025-09-17T22:56:41.007628] [INFO ] [MAIN ] QD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:41.007784] [INFO ] [MAIN ] PX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:41.007940] [INFO ] [MAIN ] QGEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:41.045868] [DEBUG] [LOCAL ] QD: Loaded 27932 existing records from primary storage. [2025-09-17T22:56:41.046006] [INFO ] [MAIN ] QD: Loaded 27932 primary data records. [2025-09-17T22:56:41.177976] [DEBUG] [LOCAL ] PX: Loaded 34737 existing records from primary storage. [2025-09-17T22:56:41.206807] [INFO ] [MAIN ] PX: Loaded 34737 primary data records. [2025-09-17T22:56:41.324876] [DEBUG] [LOCAL ] QGEN: Loaded 49212 existing records from primary storage. [2025-09-17T22:56:41.448635] [INFO ] [MAIN ] QGEN: Loaded 49212 primary data records. [2025-09-17T22:56:42.102072] [DEBUG] [MAIN ] QD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:42.103932] [INFO ] [MAIN ] QD: Generated 1794 derivative records from 27932 primary records. [2025-09-17T22:56:42.104257] [DEBUG] [LOCAL ] QD: Saving derivative data. [2025-09-17T22:56:42.124122] [DEBUG] [LOCAL ] QD: Derivative data saved (1794 records). [2025-09-17T22:56:42.125219] [INFO ] [MAIN ] QD: Successfully saved derivative data. [2025-09-17T22:56:42.127857] [INFO ] [MAIN ] Derivative Progress: 1516/2085 symbols completed. QD took 1.1s. Estimated remaining: 3m 41s. Rate: 154.2 symbols/min [2025-09-17T22:56:42.128478] [INFO ] [MAIN ] QS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:42.141679] [DEBUG] [MAIN ] PX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:42.142344] [INFO ] [MAIN ] PX: Generated 1794 derivative records from 34737 primary records. [2025-09-17T22:56:42.142632] [DEBUG] [LOCAL ] PX: Saving derivative data. [2025-09-17T22:56:42.160170] [DEBUG] [LOCAL ] PX: Derivative data saved (1794 records). [2025-09-17T22:56:42.161422] [INFO ] [MAIN ] PX: Successfully saved derivative data. [2025-09-17T22:56:42.164817] [INFO ] [MAIN ] Derivative Progress: 1517/2085 symbols completed. PX took 1.2s. Estimated remaining: 3m 41s. Rate: 154.3 symbols/min [2025-09-17T22:56:42.165210] [INFO ] [MAIN ] QSR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:42.182354] [DEBUG] [MAIN ] QGEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:42.183262] [INFO ] [MAIN ] QGEN: Generated 1794 derivative records from 49212 primary records. [2025-09-17T22:56:42.183364] [DEBUG] [LOCAL ] QGEN: Saving derivative data. [2025-09-17T22:56:42.201733] [DEBUG] [LOCAL ] QGEN: Derivative data saved (1794 records). [2025-09-17T22:56:42.201987] [INFO ] [MAIN ] QGEN: Successfully saved derivative data. [2025-09-17T22:56:42.204898] [INFO ] [MAIN ] Derivative Progress: 1518/2085 symbols completed. QGEN took 1.2s. Estimated remaining: 3m 40s. Rate: 154.4 symbols/min [2025-09-17T22:56:42.205297] [INFO ] [MAIN ] QTWO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:42.275173] [DEBUG] [LOCAL ] QSR: Loaded 52402 existing records from primary storage. [2025-09-17T22:56:42.275455] [INFO ] [MAIN ] QSR: Loaded 52402 primary data records. [2025-09-17T22:56:42.288513] [DEBUG] [LOCAL ] QS: Loaded 53742 existing records from primary storage. [2025-09-17T22:56:42.303002] [INFO ] [MAIN ] QS: Loaded 53742 primary data records. [2025-09-17T22:56:42.560059] [DEBUG] [LOCAL ] QTWO: Loaded 39001 existing records from primary storage. [2025-09-17T22:56:42.566172] [INFO ] [MAIN ] QTWO: Loaded 39001 primary data records. [2025-09-17T22:56:43.298817] [DEBUG] [MAIN ] QS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:43.300328] [INFO ] [MAIN ] QS: Generated 1794 derivative records from 53742 primary records. [2025-09-17T22:56:43.300734] [DEBUG] [LOCAL ] QS: Saving derivative data. [2025-09-17T22:56:43.299483] [DEBUG] [MAIN ] QSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:43.302361] [INFO ] [MAIN ] QSR: Generated 1794 derivative records from 52402 primary records. [2025-09-17T22:56:43.302767] [DEBUG] [LOCAL ] QSR: Saving derivative data. [2025-09-17T22:56:43.318916] [DEBUG] [LOCAL ] QS: Derivative data saved (1794 records). [2025-09-17T22:56:43.319228] [INFO ] [MAIN ] QS: Successfully saved derivative data. [2025-09-17T22:56:43.321416] [INFO ] [MAIN ] Derivative Progress: 1519/2085 symbols completed. QS took 1.2s. Estimated remaining: 3m 40s. Rate: 154.2 symbols/min [2025-09-17T22:56:43.329031] [INFO ] [MAIN ] QUAD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:43.337482] [DEBUG] [LOCAL ] QSR: Derivative data saved (1794 records). [2025-09-17T22:56:43.337576] [INFO ] [MAIN ] QSR: Successfully saved derivative data. [2025-09-17T22:56:43.341155] [INFO ] [MAIN ] Derivative Progress: 1520/2085 symbols completed. QSR took 1.2s. Estimated remaining: 3m 40s. Rate: 154.3 symbols/min [2025-09-17T22:56:43.343791] [INFO ] [MAIN ] QVCC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:43.359632] [DEBUG] [MAIN ] QTWO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:43.360890] [INFO ] [MAIN ] QTWO: Generated 1794 derivative records from 39001 primary records. [2025-09-17T22:56:43.363226] [DEBUG] [LOCAL ] QTWO: Saving derivative data. [2025-09-17T22:56:43.390704] [DEBUG] [LOCAL ] QVCC: Loaded 9120 existing records from primary storage. [2025-09-17T22:56:43.390330] [DEBUG] [LOCAL ] QTWO: Derivative data saved (1794 records). [2025-09-17T22:56:43.390843] [INFO ] [MAIN ] QTWO: Successfully saved derivative data. [2025-09-17T22:56:43.390946] [INFO ] [MAIN ] QVCC: Loaded 9120 primary data records. [2025-09-17T22:56:43.399089] [INFO ] [MAIN ] Derivative Progress: 1521/2085 symbols completed. QTWO took 1.2s. Estimated remaining: 3m 39s. Rate: 154.4 symbols/min [2025-09-17T22:56:43.426840] [INFO ] [MAIN ] QVCD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:43.518378] [DEBUG] [LOCAL ] QUAD: Loaded 24247 existing records from primary storage. [2025-09-17T22:56:43.534147] [INFO ] [MAIN ] QUAD: Loaded 24247 primary data records. [2025-09-17T22:56:43.638892] [DEBUG] [LOCAL ] QVCD: Loaded 4668 existing records from primary storage. [2025-09-17T22:56:43.759800] [INFO ] [MAIN ] QVCD: Loaded 4668 primary data records. [2025-09-17T22:56:44.400836] [DEBUG] [MAIN ] QVCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:44.401788] [INFO ] [MAIN ] QVCC: Generated 1794 derivative records from 9120 primary records. [2025-09-17T22:56:44.403522] [DEBUG] [LOCAL ] QVCC: Saving derivative data. [2025-09-17T22:56:44.423154] [DEBUG] [LOCAL ] QVCC: Derivative data saved (1794 records). [2025-09-17T22:56:44.424031] [INFO ] [MAIN ] QVCC: Successfully saved derivative data. [2025-09-17T22:56:44.427953] [INFO ] [MAIN ] Derivative Progress: 1522/2085 symbols completed. QVCC took 1.1s. Estimated remaining: 3m 39s. Rate: 154.2 symbols/min [2025-09-17T22:56:44.429007] [INFO ] [MAIN ] QXO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:44.442127] [DEBUG] [MAIN ] QUAD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:44.450147] [INFO ] [MAIN ] QUAD: Generated 1794 derivative records from 24247 primary records. [2025-09-17T22:56:44.455034] [DEBUG] [LOCAL ] QUAD: Saving derivative data. [2025-09-17T22:56:44.455314] [DEBUG] [MAIN ] QVCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:44.456560] [INFO ] [MAIN ] QVCD: Generated 1794 derivative records from 4668 primary records. [2025-09-17T22:56:44.456883] [DEBUG] [LOCAL ] QVCD: Saving derivative data. [2025-09-17T22:56:44.472101] [DEBUG] [LOCAL ] QUAD: Derivative data saved (1794 records). [2025-09-17T22:56:44.472282] [INFO ] [MAIN ] QUAD: Successfully saved derivative data. [2025-09-17T22:56:44.474903] [INFO ] [MAIN ] Derivative Progress: 1523/2085 symbols completed. QUAD took 1.1s. Estimated remaining: 3m 39s. Rate: 154.3 symbols/min [2025-09-17T22:56:44.481377] [INFO ] [MAIN ] R: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:44.489226] [DEBUG] [LOCAL ] QVCD: Derivative data saved (1794 records). [2025-09-17T22:56:44.489293] [INFO ] [MAIN ] QVCD: Successfully saved derivative data. [2025-09-17T22:56:44.492263] [INFO ] [MAIN ] Derivative Progress: 1524/2085 symbols completed. QVCD took 1.1s. Estimated remaining: 3m 38s. Rate: 154.4 symbols/min [2025-09-17T22:56:44.492709] [INFO ] [MAIN ] RA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:44.540434] [DEBUG] [LOCAL ] RA: Loaded 21808 existing records from primary storage. [2025-09-17T22:56:44.549304] [INFO ] [MAIN ] RA: Loaded 21808 primary data records. [2025-09-17T22:56:44.561222] [DEBUG] [LOCAL ] R: Loaded 29855 existing records from primary storage. [2025-09-17T22:56:44.594324] [INFO ] [MAIN ] R: Loaded 29855 primary data records. [2025-09-17T22:56:44.742071] [DEBUG] [LOCAL ] QXO: Loaded 53142 existing records from primary storage. [2025-09-17T22:56:44.810806] [INFO ] [MAIN ] QXO: Loaded 53142 primary data records. [2025-09-17T22:56:45.508495] [DEBUG] [MAIN ] RA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:45.509382] [INFO ] [MAIN ] RA: Generated 1794 derivative records from 21808 primary records. [2025-09-17T22:56:45.509631] [DEBUG] [LOCAL ] RA: Saving derivative data. [2025-09-17T22:56:45.533204] [DEBUG] [MAIN ] R: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:45.537901] [INFO ] [MAIN ] R: Generated 1794 derivative records from 29855 primary records. [2025-09-17T22:56:45.538221] [DEBUG] [LOCAL ] R: Saving derivative data. [2025-09-17T22:56:45.564100] [DEBUG] [MAIN ] QXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:45.565533] [INFO ] [MAIN ] QXO: Generated 1794 derivative records from 53142 primary records. [2025-09-17T22:56:45.565919] [DEBUG] [LOCAL ] QXO: Saving derivative data. [2025-09-17T22:56:45.582402] [DEBUG] [LOCAL ] RA: Derivative data saved (1794 records). [2025-09-17T22:56:45.583012] [INFO ] [MAIN ] RA: Successfully saved derivative data. [2025-09-17T22:56:45.585324] [INFO ] [MAIN ] Derivative Progress: 1525/2085 symbols completed. RA took 1.1s. Estimated remaining: 3m 38s. Rate: 154.2 symbols/min [2025-09-17T22:56:45.586803] [INFO ] [MAIN ] RACE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:45.591169] [DEBUG] [LOCAL ] R: Derivative data saved (1794 records). [2025-09-17T22:56:45.591461] [INFO ] [MAIN ] R: Successfully saved derivative data. [2025-09-17T22:56:45.594872] [INFO ] [MAIN ] Derivative Progress: 1526/2085 symbols completed. R took 1.1s. Estimated remaining: 3m 37s. Rate: 154.3 symbols/min [2025-09-17T22:56:45.595950] [INFO ] [MAIN ] RAMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:45.595881] [DEBUG] [LOCAL ] QXO: Derivative data saved (1794 records). [2025-09-17T22:56:45.596335] [INFO ] [MAIN ] QXO: Successfully saved derivative data. [2025-09-17T22:56:45.598772] [INFO ] [MAIN ] Derivative Progress: 1527/2085 symbols completed. QXO took 1.2s. Estimated remaining: 3m 37s. Rate: 154.4 symbols/min [2025-09-17T22:56:45.599222] [INFO ] [MAIN ] RBA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:45.645709] [DEBUG] [LOCAL ] RACE: Loaded 33145 existing records from primary storage. [2025-09-17T22:56:45.646330] [INFO ] [MAIN ] RACE: Loaded 33145 primary data records. [2025-09-17T22:56:45.738012] [DEBUG] [LOCAL ] RAMP: Loaded 37699 existing records from primary storage. [2025-09-17T22:56:45.765692] [INFO ] [MAIN ] RAMP: Loaded 37699 primary data records. [2025-09-17T22:56:45.978969] [DEBUG] [LOCAL ] RBA: Loaded 46138 existing records from primary storage. [2025-09-17T22:56:46.106093] [INFO ] [MAIN ] RBA: Loaded 46138 primary data records. [2025-09-17T22:56:46.770027] [DEBUG] [MAIN ] RACE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:46.789939] [INFO ] [MAIN ] RACE: Generated 1794 derivative records from 33145 primary records. [2025-09-17T22:56:46.799323] [DEBUG] [LOCAL ] RACE: Saving derivative data. [2025-09-17T22:56:47.007358] [DEBUG] [MAIN ] RAMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:47.008793] [INFO ] [MAIN ] RAMP: Generated 1794 derivative records from 37699 primary records. [2025-09-17T22:56:47.008901] [DEBUG] [LOCAL ] RAMP: Saving derivative data. [2025-09-17T22:56:47.053881] [DEBUG] [LOCAL ] RACE: Derivative data saved (1794 records). [2025-09-17T22:56:47.055540] [INFO ] [MAIN ] RACE: Successfully saved derivative data. [2025-09-17T22:56:47.055385] [DEBUG] [LOCAL ] RAMP: Derivative data saved (1794 records). [2025-09-17T22:56:47.055862] [INFO ] [MAIN ] RAMP: Successfully saved derivative data. [2025-09-17T22:56:47.058112] [INFO ] [MAIN ] Derivative Progress: 1528/2085 symbols completed. RACE took 1.5s. Estimated remaining: 3m 37s. Rate: 154.1 symbols/min [2025-09-17T22:56:47.062516] [INFO ] [MAIN ] Derivative Progress: 1529/2085 symbols completed. RAMP took 1.5s. Estimated remaining: 3m 36s. Rate: 154.2 symbols/min [2025-09-17T22:56:47.083528] [DEBUG] [MAIN ] RBA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:47.084374] [INFO ] [MAIN ] RBA: Generated 1794 derivative records from 46138 primary records. [2025-09-17T22:56:47.084450] [DEBUG] [LOCAL ] RBA: Saving derivative data. [2025-09-17T22:56:47.104762] [DEBUG] [LOCAL ] RBA: Derivative data saved (1794 records). [2025-09-17T22:56:47.104940] [INFO ] [MAIN ] RBA: Successfully saved derivative data. [2025-09-17T22:56:47.109491] [INFO ] [MAIN ] Derivative Progress: 1530/2085 symbols completed. RBA took 1.5s. Estimated remaining: 3m 36s. Rate: 154.3 symbols/min [2025-09-17T22:56:47.110309] [INFO ] [MAIN ] RBC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:47.110472] [INFO ] [MAIN ] RBOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:47.111135] [INFO ] [MAIN ] RBLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:47.122613] [DEBUG] [LOCAL ] RBOT: Loaded 5066 existing records from primary storage. [2025-09-17T22:56:47.122806] [INFO ] [MAIN ] RBOT: Loaded 5066 primary data records. [2025-09-17T22:56:47.218814] [DEBUG] [LOCAL ] RBC: Loaded 15055 existing records from primary storage. [2025-09-17T22:56:47.256114] [INFO ] [MAIN ] RBC: Loaded 15055 primary data records. [2025-09-17T22:56:47.687720] [DEBUG] [LOCAL ] RBLX: Loaded 53722 existing records from primary storage. [2025-09-17T22:56:47.698799] [INFO ] [MAIN ] RBLX: Loaded 53722 primary data records. [2025-09-17T22:56:48.217588] [DEBUG] [MAIN ] RBOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:48.219218] [INFO ] [MAIN ] RBOT: Generated 1794 derivative records from 5066 primary records. [2025-09-17T22:56:48.219894] [DEBUG] [LOCAL ] RBOT: Saving derivative data. [2025-09-17T22:56:48.236358] [DEBUG] [LOCAL ] RBOT: Derivative data saved (1794 records). [2025-09-17T22:56:48.239631] [INFO ] [MAIN ] RBOT: Successfully saved derivative data. [2025-09-17T22:56:48.242348] [INFO ] [MAIN ] Derivative Progress: 1531/2085 symbols completed. RBOT took 1.1s. Estimated remaining: 3m 36s. Rate: 154.1 symbols/min [2025-09-17T22:56:48.242861] [INFO ] [MAIN ] RBRK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:48.257545] [DEBUG] [MAIN ] RBC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:48.259072] [INFO ] [MAIN ] RBC: Generated 1794 derivative records from 15055 primary records. [2025-09-17T22:56:48.259477] [DEBUG] [LOCAL ] RBC: Saving derivative data. [2025-09-17T22:56:48.277971] [DEBUG] [LOCAL ] RBC: Derivative data saved (1794 records). [2025-09-17T22:56:48.278635] [INFO ] [MAIN ] RBC: Successfully saved derivative data. [2025-09-17T22:56:48.281852] [INFO ] [MAIN ] Derivative Progress: 1532/2085 symbols completed. RBC took 1.2s. Estimated remaining: 3m 35s. Rate: 154.2 symbols/min [2025-09-17T22:56:48.283260] [INFO ] [MAIN ] RC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:48.298225] [DEBUG] [MAIN ] RBLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:48.298989] [INFO ] [MAIN ] RBLX: Generated 1794 derivative records from 53722 primary records. [2025-09-17T22:56:48.299211] [DEBUG] [LOCAL ] RBLX: Saving derivative data. [2025-09-17T22:56:48.332093] [DEBUG] [LOCAL ] RBLX: Derivative data saved (1794 records). [2025-09-17T22:56:48.332275] [INFO ] [MAIN ] RBLX: Successfully saved derivative data. [2025-09-17T22:56:48.335774] [INFO ] [MAIN ] Derivative Progress: 1533/2085 symbols completed. RBLX took 1.2s. Estimated remaining: 3m 35s. Rate: 154.3 symbols/min [2025-09-17T22:56:48.336305] [INFO ] [MAIN ] RCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:48.355468] [DEBUG] [LOCAL ] RBRK: Loaded 53071 existing records from primary storage. [2025-09-17T22:56:48.355728] [INFO ] [MAIN ] RBRK: Loaded 53071 primary data records. [2025-09-17T22:56:48.577877] [DEBUG] [LOCAL ] RC: Loaded 49129 existing records from primary storage. [2025-09-17T22:56:48.634924] [INFO ] [MAIN ] RC: Loaded 49129 primary data records. [2025-09-17T22:56:48.814191] [DEBUG] [LOCAL ] RCI: Loaded 48852 existing records from primary storage. [2025-09-17T22:56:48.851040] [INFO ] [MAIN ] RCI: Loaded 48852 primary data records. [2025-09-17T22:56:49.377477] [DEBUG] [MAIN ] RBRK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:49.379538] [INFO ] [MAIN ] RBRK: Generated 1794 derivative records from 53071 primary records. [2025-09-17T22:56:49.380091] [DEBUG] [LOCAL ] RBRK: Saving derivative data. [2025-09-17T22:56:49.402190] [DEBUG] [LOCAL ] RBRK: Derivative data saved (1794 records). [2025-09-17T22:56:49.402363] [INFO ] [MAIN ] RBRK: Successfully saved derivative data. [2025-09-17T22:56:49.405393] [INFO ] [MAIN ] Derivative Progress: 1534/2085 symbols completed. RBRK took 1.2s. Estimated remaining: 3m 35s. Rate: 154.1 symbols/min [2025-09-17T22:56:49.407178] [INFO ] [MAIN ] RCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:49.437244] [DEBUG] [MAIN ] RC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:49.438774] [INFO ] [MAIN ] RC: Generated 1794 derivative records from 49129 primary records. [2025-09-17T22:56:49.443589] [DEBUG] [LOCAL ] RC: Saving derivative data. [2025-09-17T22:56:49.445203] [DEBUG] [LOCAL ] RCS: Loaded 11571 existing records from primary storage. [2025-09-17T22:56:49.458415] [INFO ] [MAIN ] RCS: Loaded 11571 primary data records. [2025-09-17T22:56:49.516292] [DEBUG] [LOCAL ] RC: Derivative data saved (1794 records). [2025-09-17T22:56:49.534030] [INFO ] [MAIN ] RC: Successfully saved derivative data. [2025-09-17T22:56:49.556907] [INFO ] [MAIN ] Derivative Progress: 1535/2085 symbols completed. RC took 1.3s. Estimated remaining: 3m 34s. Rate: 154.2 symbols/min [2025-09-17T22:56:49.563092] [INFO ] [MAIN ] RCUS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:49.579194] [DEBUG] [MAIN ] RCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:49.588504] [INFO ] [MAIN ] RCI: Generated 1794 derivative records from 48852 primary records. [2025-09-17T22:56:49.600024] [DEBUG] [LOCAL ] RCI: Saving derivative data. [2025-09-17T22:56:49.677340] [DEBUG] [LOCAL ] RCI: Derivative data saved (1794 records). [2025-09-17T22:56:49.678219] [INFO ] [MAIN ] RCI: Successfully saved derivative data. [2025-09-17T22:56:49.681474] [INFO ] [MAIN ] Derivative Progress: 1536/2085 symbols completed. RCI took 1.3s. Estimated remaining: 3m 34s. Rate: 154.3 symbols/min [2025-09-17T22:56:49.682339] [INFO ] [MAIN ] RDDT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:49.848265] [DEBUG] [LOCAL ] RCUS: Loaded 42918 existing records from primary storage. [2025-09-17T22:56:49.848930] [INFO ] [MAIN ] RCUS: Loaded 42918 primary data records. [2025-09-17T22:56:50.198625] [DEBUG] [LOCAL ] RDDT: Loaded 53784 existing records from primary storage. [2025-09-17T22:56:50.199127] [INFO ] [MAIN ] RDDT: Loaded 53784 primary data records. [2025-09-17T22:56:50.252327] [DEBUG] [MAIN ] RCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:50.267266] [INFO ] [MAIN ] RCS: Generated 1794 derivative records from 11571 primary records. [2025-09-17T22:56:50.285256] [DEBUG] [LOCAL ] RCS: Saving derivative data. [2025-09-17T22:56:50.344998] [DEBUG] [LOCAL ] RCS: Derivative data saved (1794 records). [2025-09-17T22:56:50.355992] [INFO ] [MAIN ] RCS: Successfully saved derivative data. [2025-09-17T22:56:50.364114] [INFO ] [MAIN ] Derivative Progress: 1537/2085 symbols completed. RCS took 1.0s. Estimated remaining: 3m 33s. Rate: 154.2 symbols/min [2025-09-17T22:56:50.389672] [INFO ] [MAIN ] RDN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:50.630801] [DEBUG] [MAIN ] RCUS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:50.631703] [INFO ] [MAIN ] RCUS: Generated 1794 derivative records from 42918 primary records. [2025-09-17T22:56:50.631856] [DEBUG] [LOCAL ] RCUS: Saving derivative data. [2025-09-17T22:56:50.650393] [DEBUG] [LOCAL ] RCUS: Derivative data saved (1794 records). [2025-09-17T22:56:50.650773] [INFO ] [MAIN ] RCUS: Successfully saved derivative data. [2025-09-17T22:56:50.653562] [INFO ] [MAIN ] Derivative Progress: 1538/2085 symbols completed. RCUS took 1.1s. Estimated remaining: 3m 33s. Rate: 154.2 symbols/min [2025-09-17T22:56:50.654022] [INFO ] [MAIN ] RDW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:50.683971] [DEBUG] [MAIN ] RDDT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:50.684755] [INFO ] [MAIN ] RDDT: Generated 1794 derivative records from 53784 primary records. [2025-09-17T22:56:50.684951] [DEBUG] [LOCAL ] RDDT: Saving derivative data. [2025-09-17T22:56:50.710521] [DEBUG] [LOCAL ] RDN: Loaded 45139 existing records from primary storage. [2025-09-17T22:56:50.711456] [INFO ] [MAIN ] RDN: Loaded 45139 primary data records. [2025-09-17T22:56:50.833968] [DEBUG] [LOCAL ] RDDT: Derivative data saved (1794 records). [2025-09-17T22:56:50.834171] [INFO ] [MAIN ] RDDT: Successfully saved derivative data. [2025-09-17T22:56:50.836758] [INFO ] [MAIN ] Derivative Progress: 1539/2085 symbols completed. RDDT took 1.2s. Estimated remaining: 3m 32s. Rate: 154.3 symbols/min [2025-09-17T22:56:50.863849] [INFO ] [MAIN ] RDY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:51.048531] [DEBUG] [LOCAL ] RDW: Loaded 51988 existing records from primary storage. [2025-09-17T22:56:51.048793] [INFO ] [MAIN ] RDW: Loaded 51988 primary data records. [2025-09-17T22:56:51.386343] [DEBUG] [LOCAL ] RDY: Loaded 47024 existing records from primary storage. [2025-09-17T22:56:51.386674] [INFO ] [MAIN ] RDY: Loaded 47024 primary data records. [2025-09-17T22:56:51.579994] [DEBUG] [MAIN ] RDN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:51.611031] [INFO ] [MAIN ] RDN: Generated 1794 derivative records from 45139 primary records. [2025-09-17T22:56:51.611251] [DEBUG] [LOCAL ] RDN: Saving derivative data. [2025-09-17T22:56:51.756586] [DEBUG] [LOCAL ] RDN: Derivative data saved (1794 records). [2025-09-17T22:56:51.758031] [INFO ] [MAIN ] RDN: Successfully saved derivative data. [2025-09-17T22:56:51.761922] [INFO ] [MAIN ] Derivative Progress: 1540/2085 symbols completed. RDN took 1.4s. Estimated remaining: 3m 32s. Rate: 154.1 symbols/min [2025-09-17T22:56:51.763420] [INFO ] [MAIN ] RELX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:51.778820] [DEBUG] [MAIN ] RDW: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:56:51.779693] [INFO ] [MAIN ] RDW: Generated 1793 derivative records from 51988 primary records. [2025-09-17T22:56:51.781338] [DEBUG] [LOCAL ] RDW: Saving derivative data. [2025-09-17T22:56:51.797786] [DEBUG] [LOCAL ] RDW: Derivative data saved (1793 records). [2025-09-17T22:56:51.797963] [INFO ] [MAIN ] RDW: Successfully saved derivative data. [2025-09-17T22:56:51.800801] [INFO ] [MAIN ] Derivative Progress: 1541/2085 symbols completed. RDW took 1.1s. Estimated remaining: 3m 32s. Rate: 154.2 symbols/min [2025-09-17T22:56:51.801189] [INFO ] [MAIN ] RERE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:51.819919] [DEBUG] [MAIN ] RDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:51.820774] [INFO ] [MAIN ] RDY: Generated 1794 derivative records from 47024 primary records. [2025-09-17T22:56:51.820916] [DEBUG] [LOCAL ] RDY: Saving derivative data. [2025-09-17T22:56:51.839471] [DEBUG] [LOCAL ] RDY: Derivative data saved (1794 records). [2025-09-17T22:56:51.850177] [INFO ] [MAIN ] RDY: Successfully saved derivative data. [2025-09-17T22:56:51.852814] [INFO ] [MAIN ] Derivative Progress: 1542/2085 symbols completed. RDY took 1.0s. Estimated remaining: 3m 31s. Rate: 154.3 symbols/min [2025-09-17T22:56:51.853245] [INFO ] [MAIN ] RES: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:51.891835] [DEBUG] [LOCAL ] RELX: Loaded 47843 existing records from primary storage. [2025-09-17T22:56:51.892108] [INFO ] [MAIN ] RELX: Loaded 47843 primary data records. [2025-09-17T22:56:51.892764] [DEBUG] [LOCAL ] RERE: Loaded 40834 existing records from primary storage. [2025-09-17T22:56:51.904514] [INFO ] [MAIN ] RERE: Loaded 40834 primary data records. [2025-09-17T22:56:52.407974] [DEBUG] [LOCAL ] RES: Loaded 47570 existing records from primary storage. [2025-09-17T22:56:52.423803] [INFO ] [MAIN ] RES: Loaded 47570 primary data records. [2025-09-17T22:56:52.969072] [DEBUG] [MAIN ] RELX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:52.984302] [INFO ] [MAIN ] RELX: Generated 1794 derivative records from 47843 primary records. [2025-09-17T22:56:52.984784] [DEBUG] [MAIN ] RERE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:52.985496] [INFO ] [MAIN ] RERE: Generated 1794 derivative records from 40834 primary records. [2025-09-17T22:56:52.984905] [DEBUG] [LOCAL ] RELX: Saving derivative data. [2025-09-17T22:56:52.985627] [DEBUG] [LOCAL ] RERE: Saving derivative data. [2025-09-17T22:56:53.015790] [DEBUG] [LOCAL ] RERE: Derivative data saved (1794 records). [2025-09-17T22:56:53.017055] [INFO ] [MAIN ] RERE: Successfully saved derivative data. [2025-09-17T22:56:53.019431] [INFO ] [MAIN ] Derivative Progress: 1543/2085 symbols completed. RERE took 1.2s. Estimated remaining: 3m 31s. Rate: 154.1 symbols/min [2025-09-17T22:56:53.024732] [DEBUG] [LOCAL ] RELX: Derivative data saved (1794 records). [2025-09-17T22:56:53.024854] [INFO ] [MAIN ] RELX: Successfully saved derivative data. [2025-09-17T22:56:53.028287] [INFO ] [MAIN ] Derivative Progress: 1544/2085 symbols completed. RELX took 1.3s. Estimated remaining: 3m 31s. Rate: 154.2 symbols/min [2025-09-17T22:56:53.042008] [DEBUG] [MAIN ] RES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:53.042701] [INFO ] [MAIN ] RES: Generated 1794 derivative records from 47570 primary records. [2025-09-17T22:56:53.042768] [DEBUG] [LOCAL ] RES: Saving derivative data. [2025-09-17T22:56:53.058075] [DEBUG] [LOCAL ] RES: Derivative data saved (1794 records). [2025-09-17T22:56:53.058135] [INFO ] [MAIN ] RES: Successfully saved derivative data. [2025-09-17T22:56:53.061008] [INFO ] [MAIN ] Derivative Progress: 1545/2085 symbols completed. RES took 1.2s. Estimated remaining: 3m 30s. Rate: 154.3 symbols/min [2025-09-17T22:56:53.061752] [INFO ] [MAIN ] REXR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:53.062299] [INFO ] [MAIN ] REX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:53.061907] [INFO ] [MAIN ] REVG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:53.079428] [DEBUG] [LOCAL ] REX: Loaded 13762 existing records from primary storage. [2025-09-17T22:56:53.079857] [INFO ] [MAIN ] REX: Loaded 13762 primary data records. [2025-09-17T22:56:53.441275] [DEBUG] [LOCAL ] REVG: Loaded 41303 existing records from primary storage. [2025-09-17T22:56:53.442399] [DEBUG] [LOCAL ] REXR: Loaded 52021 existing records from primary storage. [2025-09-17T22:56:53.442829] [INFO ] [MAIN ] REVG: Loaded 41303 primary data records. [2025-09-17T22:56:53.442952] [INFO ] [MAIN ] REXR: Loaded 52021 primary data records. [2025-09-17T22:56:54.124134] [DEBUG] [MAIN ] REX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:54.125317] [INFO ] [MAIN ] REX: Generated 1794 derivative records from 13762 primary records. [2025-09-17T22:56:54.125459] [DEBUG] [LOCAL ] REX: Saving derivative data. [2025-09-17T22:56:54.145670] [DEBUG] [LOCAL ] REX: Derivative data saved (1794 records). [2025-09-17T22:56:54.146039] [INFO ] [MAIN ] REX: Successfully saved derivative data. [2025-09-17T22:56:54.148825] [INFO ] [MAIN ] Derivative Progress: 1546/2085 symbols completed. REX took 1.1s. Estimated remaining: 3m 30s. Rate: 154.1 symbols/min [2025-09-17T22:56:54.149599] [INFO ] [MAIN ] REZI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:54.170407] [DEBUG] [MAIN ] REVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:54.171355] [INFO ] [MAIN ] REVG: Generated 1794 derivative records from 41303 primary records. [2025-09-17T22:56:54.171512] [DEBUG] [LOCAL ] REVG: Saving derivative data. [2025-09-17T22:56:54.192054] [DEBUG] [MAIN ] REXR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:54.197599] [INFO ] [MAIN ] REXR: Generated 1794 derivative records from 52021 primary records. [2025-09-17T22:56:54.200755] [DEBUG] [LOCAL ] REVG: Derivative data saved (1794 records). [2025-09-17T22:56:54.200944] [INFO ] [MAIN ] REVG: Successfully saved derivative data. [2025-09-17T22:56:54.203524] [INFO ] [MAIN ] Derivative Progress: 1547/2085 symbols completed. REVG took 1.1s. Estimated remaining: 3m 29s. Rate: 154.2 symbols/min [2025-09-17T22:56:54.203883] [INFO ] [MAIN ] RF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:54.204001] [DEBUG] [LOCAL ] REXR: Saving derivative data. [2025-09-17T22:56:54.232112] [DEBUG] [LOCAL ] REXR: Derivative data saved (1794 records). [2025-09-17T22:56:54.232297] [INFO ] [MAIN ] REXR: Successfully saved derivative data. [2025-09-17T22:56:54.234418] [INFO ] [MAIN ] Derivative Progress: 1548/2085 symbols completed. REXR took 1.2s. Estimated remaining: 3m 29s. Rate: 154.3 symbols/min [2025-09-17T22:56:54.234850] [INFO ] [MAIN ] RFI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:54.256567] [DEBUG] [LOCAL ] REZI: Loaded 46796 existing records from primary storage. [2025-09-17T22:56:54.256883] [INFO ] [MAIN ] REZI: Loaded 46796 primary data records. [2025-09-17T22:56:54.341333] [DEBUG] [LOCAL ] RFI: Loaded 10573 existing records from primary storage. [2025-09-17T22:56:54.353672] [INFO ] [MAIN ] RFI: Loaded 10573 primary data records. [2025-09-17T22:56:54.764785] [DEBUG] [LOCAL ] RF: Loaded 53630 existing records from primary storage. [2025-09-17T22:56:54.944494] [INFO ] [MAIN ] RF: Loaded 53630 primary data records. [2025-09-17T22:56:55.310457] [DEBUG] [MAIN ] REZI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:55.315971] [INFO ] [MAIN ] REZI: Generated 1794 derivative records from 46796 primary records. [2025-09-17T22:56:55.316252] [DEBUG] [LOCAL ] REZI: Saving derivative data. [2025-09-17T22:56:55.349562] [DEBUG] [MAIN ] RFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:55.354492] [INFO ] [MAIN ] RFI: Generated 1794 derivative records from 10573 primary records. [2025-09-17T22:56:55.355037] [DEBUG] [LOCAL ] RFI: Saving derivative data. [2025-09-17T22:56:55.357137] [DEBUG] [LOCAL ] REZI: Derivative data saved (1794 records). [2025-09-17T22:56:55.357611] [INFO ] [MAIN ] REZI: Successfully saved derivative data. [2025-09-17T22:56:55.367000] [INFO ] [MAIN ] Derivative Progress: 1549/2085 symbols completed. REZI took 1.2s. Estimated remaining: 3m 29s. Rate: 154.1 symbols/min [2025-09-17T22:56:55.371517] [INFO ] [MAIN ] RFL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:55.376536] [DEBUG] [LOCAL ] RFI: Derivative data saved (1794 records). [2025-09-17T22:56:55.376860] [INFO ] [MAIN ] RFI: Successfully saved derivative data. [2025-09-17T22:56:55.379482] [INFO ] [MAIN ] Derivative Progress: 1550/2085 symbols completed. RFI took 1.1s. Estimated remaining: 3m 28s. Rate: 154.2 symbols/min [2025-09-17T22:56:55.380275] [INFO ] [MAIN ] RFM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:55.404495] [DEBUG] [LOCAL ] RFM: Loaded 4008 existing records from primary storage. [2025-09-17T22:56:55.405150] [INFO ] [MAIN ] RFM: Loaded 4008 primary data records. [2025-09-17T22:56:55.417948] [DEBUG] [MAIN ] RF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:55.448689] [INFO ] [MAIN ] RF: Generated 1794 derivative records from 53630 primary records. [2025-09-17T22:56:55.472171] [DEBUG] [LOCAL ] RFL: Loaded 10456 existing records from primary storage. [2025-09-17T22:56:55.481196] [DEBUG] [LOCAL ] RF: Saving derivative data. [2025-09-17T22:56:55.503373] [INFO ] [MAIN ] RFL: Loaded 10456 primary data records. [2025-09-17T22:56:55.730467] [DEBUG] [LOCAL ] RF: Derivative data saved (1794 records). [2025-09-17T22:56:55.766364] [INFO ] [MAIN ] RF: Successfully saved derivative data. [2025-09-17T22:56:55.875207] [INFO ] [MAIN ] Derivative Progress: 1551/2085 symbols completed. RF took 1.7s. Estimated remaining: 3m 28s. Rate: 154.2 symbols/min [2025-09-17T22:56:56.028419] [INFO ] [MAIN ] RFMZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:56.056180] [DEBUG] [LOCAL ] RFMZ: Loaded 8509 existing records from primary storage. [2025-09-17T22:56:56.056573] [INFO ] [MAIN ] RFMZ: Loaded 8509 primary data records. [2025-09-17T22:56:56.225459] [DEBUG] [MAIN ] RFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:56.266903] [INFO ] [MAIN ] RFM: Generated 1794 derivative records from 4008 primary records. [2025-09-17T22:56:56.381959] [DEBUG] [LOCAL ] RFM: Saving derivative data. [2025-09-17T22:56:56.403568] [DEBUG] [MAIN ] RFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:56.410495] [INFO ] [MAIN ] RFL: Generated 1794 derivative records from 10456 primary records. [2025-09-17T22:56:56.414050] [DEBUG] [LOCAL ] RFL: Saving derivative data. [2025-09-17T22:56:56.413800] [DEBUG] [LOCAL ] RFM: Derivative data saved (1794 records). [2025-09-17T22:56:56.415302] [INFO ] [MAIN ] RFM: Successfully saved derivative data. [2025-09-17T22:56:56.418118] [INFO ] [MAIN ] Derivative Progress: 1552/2085 symbols completed. RFM took 1.0s. Estimated remaining: 3m 27s. Rate: 154.1 symbols/min [2025-09-17T22:56:56.427103] [INFO ] [MAIN ] RGA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:56.435742] [DEBUG] [LOCAL ] RFL: Derivative data saved (1794 records). [2025-09-17T22:56:56.436250] [INFO ] [MAIN ] RFL: Successfully saved derivative data. [2025-09-17T22:56:56.439317] [INFO ] [MAIN ] Derivative Progress: 1553/2085 symbols completed. RFL took 1.1s. Estimated remaining: 3m 27s. Rate: 154.2 symbols/min [2025-09-17T22:56:56.439912] [INFO ] [MAIN ] RGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:56.460247] [DEBUG] [MAIN ] RFMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:56.474091] [INFO ] [MAIN ] RFMZ: Generated 1794 derivative records from 8509 primary records. [2025-09-17T22:56:56.474246] [DEBUG] [LOCAL ] RFMZ: Saving derivative data. [2025-09-17T22:56:56.490560] [DEBUG] [LOCAL ] RGR: Loaded 20073 existing records from primary storage. [2025-09-17T22:56:56.502444] [INFO ] [MAIN ] RGR: Loaded 20073 primary data records. [2025-09-17T22:56:56.506518] [DEBUG] [LOCAL ] RFMZ: Derivative data saved (1794 records). [2025-09-17T22:56:56.545304] [INFO ] [MAIN ] RFMZ: Successfully saved derivative data. [2025-09-17T22:56:56.540110] [DEBUG] [LOCAL ] RGA: Loaded 30186 existing records from primary storage. [2025-09-17T22:56:56.558678] [INFO ] [MAIN ] RGA: Loaded 30186 primary data records. [2025-09-17T22:56:56.610436] [INFO ] [MAIN ] Derivative Progress: 1554/2085 symbols completed. RFMZ took 0.7s. Estimated remaining: 3m 27s. Rate: 154.3 symbols/min [2025-09-17T22:56:56.677515] [INFO ] [MAIN ] RGT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:56.831588] [DEBUG] [LOCAL ] RGT: Loaded 2902 existing records from primary storage. [2025-09-17T22:56:56.853917] [INFO ] [MAIN ] RGT: Loaded 2902 primary data records. [2025-09-17T22:56:57.536390] [DEBUG] [MAIN ] RGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:57.538178] [INFO ] [MAIN ] RGR: Generated 1794 derivative records from 20073 primary records. [2025-09-17T22:56:57.538279] [DEBUG] [LOCAL ] RGR: Saving derivative data. [2025-09-17T22:56:57.568251] [DEBUG] [LOCAL ] RGR: Derivative data saved (1794 records). [2025-09-17T22:56:57.568527] [INFO ] [MAIN ] RGR: Successfully saved derivative data. [2025-09-17T22:56:57.571288] [INFO ] [MAIN ] Derivative Progress: 1555/2085 symbols completed. RGR took 1.1s. Estimated remaining: 3m 26s. Rate: 154.1 symbols/min [2025-09-17T22:56:57.571729] [DEBUG] [MAIN ] RGA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:57.572564] [INFO ] [MAIN ] RGA: Generated 1794 derivative records from 30186 primary records. [2025-09-17T22:56:57.572946] [DEBUG] [LOCAL ] RGA: Saving derivative data. [2025-09-17T22:56:57.573140] [INFO ] [MAIN ] RH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:57.607582] [DEBUG] [MAIN ] RGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:57.607775] [DEBUG] [LOCAL ] RGA: Derivative data saved (1794 records). [2025-09-17T22:56:57.608599] [INFO ] [MAIN ] RGT: Generated 1794 derivative records from 2902 primary records. [2025-09-17T22:56:57.608733] [DEBUG] [LOCAL ] RGT: Saving derivative data. [2025-09-17T22:56:57.608871] [INFO ] [MAIN ] RGA: Successfully saved derivative data. [2025-09-17T22:56:57.611450] [INFO ] [MAIN ] Derivative Progress: 1556/2085 symbols completed. RGA took 1.2s. Estimated remaining: 3m 26s. Rate: 154.2 symbols/min [2025-09-17T22:56:57.611845] [INFO ] [MAIN ] RHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:57.627293] [DEBUG] [LOCAL ] RGT: Derivative data saved (1794 records). [2025-09-17T22:56:57.627363] [INFO ] [MAIN ] RGT: Successfully saved derivative data. [2025-09-17T22:56:57.629870] [INFO ] [MAIN ] Derivative Progress: 1557/2085 symbols completed. RGT took 1.0s. Estimated remaining: 3m 25s. Rate: 154.3 symbols/min [2025-09-17T22:56:57.630263] [INFO ] [MAIN ] RHP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:57.679233] [DEBUG] [LOCAL ] RH: Loaded 47769 existing records from primary storage. [2025-09-17T22:56:57.679452] [INFO ] [MAIN ] RH: Loaded 47769 primary data records. [2025-09-17T22:56:57.847136] [DEBUG] [LOCAL ] RHI: Loaded 49264 existing records from primary storage. [2025-09-17T22:56:57.853077] [DEBUG] [LOCAL ] RHP: Loaded 41777 existing records from primary storage. [2025-09-17T22:56:57.876099] [INFO ] [MAIN ] RHI: Loaded 49264 primary data records. [2025-09-17T22:56:57.876024] [INFO ] [MAIN ] RHP: Loaded 41777 primary data records. [2025-09-17T22:56:58.668691] [DEBUG] [MAIN ] RH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:58.669705] [INFO ] [MAIN ] RH: Generated 1794 derivative records from 47769 primary records. [2025-09-17T22:56:58.670313] [DEBUG] [LOCAL ] RH: Saving derivative data. [2025-09-17T22:56:58.711797] [DEBUG] [LOCAL ] RH: Derivative data saved (1794 records). [2025-09-17T22:56:58.711981] [INFO ] [MAIN ] RH: Successfully saved derivative data. [2025-09-17T22:56:58.727204] [INFO ] [MAIN ] Derivative Progress: 1558/2085 symbols completed. RH took 1.2s. Estimated remaining: 3m 25s. Rate: 154.1 symbols/min [2025-09-17T22:56:58.724453] [DEBUG] [MAIN ] RHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:58.728865] [INFO ] [MAIN ] RHI: Generated 1794 derivative records from 49264 primary records. [2025-09-17T22:56:58.728953] [DEBUG] [LOCAL ] RHI: Saving derivative data. [2025-09-17T22:56:58.729315] [DEBUG] [MAIN ] RHP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:58.730622] [INFO ] [MAIN ] RHP: Generated 1794 derivative records from 41777 primary records. [2025-09-17T22:56:58.731077] [DEBUG] [LOCAL ] RHP: Saving derivative data. [2025-09-17T22:56:58.761985] [DEBUG] [LOCAL ] RHI: Derivative data saved (1794 records). [2025-09-17T22:56:58.762610] [INFO ] [MAIN ] RHI: Successfully saved derivative data. [2025-09-17T22:56:58.765545] [INFO ] [MAIN ] Derivative Progress: 1559/2085 symbols completed. RHI took 1.2s. Estimated remaining: 3m 25s. Rate: 154.2 symbols/min [2025-09-17T22:56:58.766892] [DEBUG] [LOCAL ] RHP: Derivative data saved (1794 records). [2025-09-17T22:56:58.766991] [INFO ] [MAIN ] RHP: Successfully saved derivative data. [2025-09-17T22:56:58.769791] [INFO ] [MAIN ] Derivative Progress: 1560/2085 symbols completed. RHP took 1.1s. Estimated remaining: 3m 24s. Rate: 154.3 symbols/min [2025-09-17T22:56:58.770535] [INFO ] [MAIN ] RITM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:58.770811] [INFO ] [MAIN ] RIO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:58.770618] [INFO ] [MAIN ] RIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:58.866129] [DEBUG] [LOCAL ] RIG: Loaded 53673 existing records from primary storage. [2025-09-17T22:56:58.882072] [INFO ] [MAIN ] RIG: Loaded 53673 primary data records. [2025-09-17T22:56:58.888327] [DEBUG] [LOCAL ] RIO: Loaded 53402 existing records from primary storage. [2025-09-17T22:56:58.920622] [DEBUG] [LOCAL ] RITM: Loaded 52801 existing records from primary storage. [2025-09-17T22:56:58.919981] [INFO ] [MAIN ] RIO: Loaded 53402 primary data records. [2025-09-17T22:56:58.920794] [INFO ] [MAIN ] RITM: Loaded 52801 primary data records. [2025-09-17T22:56:59.893982] [DEBUG] [MAIN ] RIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:59.902461] [INFO ] [MAIN ] RIG: Generated 1794 derivative records from 53673 primary records. [2025-09-17T22:56:59.911745] [DEBUG] [LOCAL ] RIG: Saving derivative data. [2025-09-17T22:56:59.911390] [DEBUG] [MAIN ] RIO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:59.924917] [DEBUG] [MAIN ] RITM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:56:59.926721] [INFO ] [MAIN ] RIO: Generated 1794 derivative records from 53402 primary records. [2025-09-17T22:56:59.927883] [INFO ] [MAIN ] RITM: Generated 1794 derivative records from 52801 primary records. [2025-09-17T22:56:59.936290] [DEBUG] [LOCAL ] RITM: Saving derivative data. [2025-09-17T22:56:59.936388] [DEBUG] [LOCAL ] RIO: Saving derivative data. [2025-09-17T22:56:59.970964] [DEBUG] [LOCAL ] RIG: Derivative data saved (1794 records). [2025-09-17T22:56:59.971592] [INFO ] [MAIN ] RIG: Successfully saved derivative data. [2025-09-17T22:56:59.975056] [INFO ] [MAIN ] Derivative Progress: 1561/2085 symbols completed. RIG took 1.2s. Estimated remaining: 3m 24s. Rate: 154.1 symbols/min [2025-09-17T22:56:59.977720] [INFO ] [MAIN ] RIV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:59.979603] [DEBUG] [LOCAL ] RITM: Derivative data saved (1794 records). [2025-09-17T22:56:59.980410] [INFO ] [MAIN ] RITM: Successfully saved derivative data. [2025-09-17T22:56:59.983623] [INFO ] [MAIN ] Derivative Progress: 1562/2085 symbols completed. RITM took 1.2s. Estimated remaining: 3m 23s. Rate: 154.2 symbols/min [2025-09-17T22:56:59.985329] [INFO ] [MAIN ] RJF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:56:59.987588] [DEBUG] [LOCAL ] RIO: Derivative data saved (1794 records). [2025-09-17T22:56:59.991795] [INFO ] [MAIN ] RIO: Successfully saved derivative data. [2025-09-17T22:56:59.994263] [INFO ] [MAIN ] Derivative Progress: 1563/2085 symbols completed. RIO took 1.2s. Estimated remaining: 3m 23s. Rate: 154.3 symbols/min [2025-09-17T22:56:59.994595] [INFO ] [MAIN ] RKT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:00.001372] [DEBUG] [LOCAL ] RIV: Loaded 11640 existing records from primary storage. [2025-09-17T22:57:00.001479] [INFO ] [MAIN ] RIV: Loaded 11640 primary data records. [2025-09-17T22:57:00.350457] [DEBUG] [LOCAL ] RJF: Loaded 47176 existing records from primary storage. [2025-09-17T22:57:00.351357] [INFO ] [MAIN ] RJF: Loaded 47176 primary data records. [2025-09-17T22:57:00.467211] [DEBUG] [LOCAL ] RKT: Loaded 53720 existing records from primary storage. [2025-09-17T22:57:00.479597] [INFO ] [MAIN ] RKT: Loaded 53720 primary data records. [2025-09-17T22:57:01.077076] [DEBUG] [MAIN ] RIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:01.078164] [INFO ] [MAIN ] RIV: Generated 1794 derivative records from 11640 primary records. [2025-09-17T22:57:01.078265] [DEBUG] [LOCAL ] RIV: Saving derivative data. [2025-09-17T22:57:01.096434] [DEBUG] [LOCAL ] RIV: Derivative data saved (1794 records). [2025-09-17T22:57:01.096888] [INFO ] [MAIN ] RIV: Successfully saved derivative data. [2025-09-17T22:57:01.099335] [INFO ] [MAIN ] Derivative Progress: 1564/2085 symbols completed. RIV took 1.1s. Estimated remaining: 3m 23s. Rate: 154.1 symbols/min [2025-09-17T22:57:01.100321] [INFO ] [MAIN ] RL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:01.121913] [DEBUG] [MAIN ] RJF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:01.123173] [INFO ] [MAIN ] RJF: Generated 1794 derivative records from 47176 primary records. [2025-09-17T22:57:01.123264] [DEBUG] [LOCAL ] RJF: Saving derivative data. [2025-09-17T22:57:01.141126] [DEBUG] [LOCAL ] RJF: Derivative data saved (1794 records). [2025-09-17T22:57:01.141227] [INFO ] [MAIN ] RJF: Successfully saved derivative data. [2025-09-17T22:57:01.144302] [INFO ] [MAIN ] Derivative Progress: 1565/2085 symbols completed. RJF took 1.2s. Estimated remaining: 3m 22s. Rate: 154.2 symbols/min [2025-09-17T22:57:01.145423] [INFO ] [MAIN ] RLI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:01.158985] [DEBUG] [MAIN ] RKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:01.159758] [INFO ] [MAIN ] RKT: Generated 1794 derivative records from 53720 primary records. [2025-09-17T22:57:01.159980] [DEBUG] [LOCAL ] RKT: Saving derivative data. [2025-09-17T22:57:01.186966] [DEBUG] [LOCAL ] RKT: Derivative data saved (1794 records). [2025-09-17T22:57:01.200346] [INFO ] [MAIN ] RKT: Successfully saved derivative data. [2025-09-17T22:57:01.201422] [DEBUG] [LOCAL ] RL: Loaded 42059 existing records from primary storage. [2025-09-17T22:57:01.204296] [INFO ] [MAIN ] RL: Loaded 42059 primary data records. [2025-09-17T22:57:01.204169] [INFO ] [MAIN ] Derivative Progress: 1566/2085 symbols completed. RKT took 1.2s. Estimated remaining: 3m 22s. Rate: 154.3 symbols/min [2025-09-17T22:57:01.204995] [INFO ] [MAIN ] RLJ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:01.424229] [DEBUG] [LOCAL ] RLI: Loaded 33294 existing records from primary storage. [2025-09-17T22:57:01.529117] [INFO ] [MAIN ] RLI: Loaded 33294 primary data records. [2025-09-17T22:57:01.781621] [DEBUG] [LOCAL ] RLJ: Loaded 48328 existing records from primary storage. [2025-09-17T22:57:01.898567] [INFO ] [MAIN ] RLJ: Loaded 48328 primary data records. [2025-09-17T22:57:02.259366] [DEBUG] [MAIN ] RL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:02.260431] [INFO ] [MAIN ] RL: Generated 1794 derivative records from 42059 primary records. [2025-09-17T22:57:02.260717] [DEBUG] [LOCAL ] RL: Saving derivative data. [2025-09-17T22:57:02.281795] [DEBUG] [LOCAL ] RL: Derivative data saved (1794 records). [2025-09-17T22:57:02.282202] [INFO ] [MAIN ] RL: Successfully saved derivative data. [2025-09-17T22:57:02.284816] [INFO ] [MAIN ] Derivative Progress: 1567/2085 symbols completed. RL took 1.2s. Estimated remaining: 3m 22s. Rate: 154.1 symbols/min [2025-09-17T22:57:02.285328] [INFO ] [MAIN ] RLTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:02.299791] [DEBUG] [MAIN ] RLI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:02.300823] [INFO ] [MAIN ] RLI: Generated 1794 derivative records from 33294 primary records. [2025-09-17T22:57:02.301894] [DEBUG] [LOCAL ] RLI: Saving derivative data. [2025-09-17T22:57:02.324271] [DEBUG] [LOCAL ] RLTY: Loaded 11236 existing records from primary storage. [2025-09-17T22:57:02.325017] [INFO ] [MAIN ] RLTY: Loaded 11236 primary data records. [2025-09-17T22:57:02.407693] [DEBUG] [LOCAL ] RLI: Derivative data saved (1794 records). [2025-09-17T22:57:02.432722] [INFO ] [MAIN ] RLI: Successfully saved derivative data. [2025-09-17T22:57:02.434925] [INFO ] [MAIN ] Derivative Progress: 1568/2085 symbols completed. RLI took 1.3s. Estimated remaining: 3m 21s. Rate: 154.2 symbols/min [2025-09-17T22:57:02.438735] [INFO ] [MAIN ] RLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:02.468289] [DEBUG] [MAIN ] RLJ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:02.526478] [INFO ] [MAIN ] RLJ: Generated 1794 derivative records from 48328 primary records. [2025-09-17T22:57:02.544705] [DEBUG] [LOCAL ] RLJ: Saving derivative data. [2025-09-17T22:57:02.679827] [DEBUG] [LOCAL ] RLJ: Derivative data saved (1794 records). [2025-09-17T22:57:02.680013] [INFO ] [MAIN ] RLJ: Successfully saved derivative data. [2025-09-17T22:57:02.682199] [INFO ] [MAIN ] Derivative Progress: 1569/2085 symbols completed. RLJ took 1.5s. Estimated remaining: 3m 21s. Rate: 154.2 symbols/min [2025-09-17T22:57:02.683220] [INFO ] [MAIN ] RM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:02.709562] [DEBUG] [LOCAL ] RM: Loaded 7740 existing records from primary storage. [2025-09-17T22:57:02.710728] [DEBUG] [LOCAL ] RLX: Loaded 48154 existing records from primary storage. [2025-09-17T22:57:02.709755] [INFO ] [MAIN ] RM: Loaded 7740 primary data records. [2025-09-17T22:57:02.710880] [INFO ] [MAIN ] RLX: Loaded 48154 primary data records. [2025-09-17T22:57:02.955762] [DEBUG] [MAIN ] RLTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:02.998058] [INFO ] [MAIN ] RLTY: Generated 1794 derivative records from 11236 primary records. [2025-09-17T22:57:03.008450] [DEBUG] [LOCAL ] RLTY: Saving derivative data. [2025-09-17T22:57:03.408693] [DEBUG] [LOCAL ] RLTY: Derivative data saved (1794 records). [2025-09-17T22:57:03.409028] [INFO ] [MAIN ] RLTY: Successfully saved derivative data. [2025-09-17T22:57:03.411223] [INFO ] [MAIN ] Derivative Progress: 1570/2085 symbols completed. RLTY took 1.1s. Estimated remaining: 3m 20s. Rate: 154.1 symbols/min [2025-09-17T22:57:03.412387] [INFO ] [MAIN ] RMAX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:03.454883] [DEBUG] [MAIN ] RLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:03.455492] [DEBUG] [LOCAL ] RMAX: Loaded 21780 existing records from primary storage. [2025-09-17T22:57:03.456314] [INFO ] [MAIN ] RLX: Generated 1794 derivative records from 48154 primary records. [2025-09-17T22:57:03.456491] [INFO ] [MAIN ] RMAX: Loaded 21780 primary data records. [2025-09-17T22:57:03.490727] [DEBUG] [MAIN ] RM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:03.469509] [DEBUG] [LOCAL ] RLX: Saving derivative data. [2025-09-17T22:57:03.501885] [INFO ] [MAIN ] RM: Generated 1794 derivative records from 7740 primary records. [2025-09-17T22:57:03.519477] [DEBUG] [LOCAL ] RM: Saving derivative data. [2025-09-17T22:57:03.659759] [DEBUG] [LOCAL ] RM: Derivative data saved (1794 records). [2025-09-17T22:57:03.693439] [INFO ] [MAIN ] RM: Successfully saved derivative data. [2025-09-17T22:57:03.816232] [INFO ] [MAIN ] Derivative Progress: 1571/2085 symbols completed. RM took 1.1s. Estimated remaining: 3m 20s. Rate: 154.1 symbols/min [2025-09-17T22:57:03.814025] [DEBUG] [LOCAL ] RLX: Derivative data saved (1794 records). [2025-09-17T22:57:03.816671] [INFO ] [MAIN ] RLX: Successfully saved derivative data. [2025-09-17T22:57:03.816804] [INFO ] [MAIN ] RMD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:03.819330] [INFO ] [MAIN ] Derivative Progress: 1572/2085 symbols completed. RLX took 1.4s. Estimated remaining: 3m 20s. Rate: 154.2 symbols/min [2025-09-17T22:57:03.819966] [INFO ] [MAIN ] RMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:03.828640] [DEBUG] [LOCAL ] RMI: Loaded 4573 existing records from primary storage. [2025-09-17T22:57:03.829183] [INFO ] [MAIN ] RMI: Loaded 4573 primary data records. [2025-09-17T22:57:04.159462] [DEBUG] [LOCAL ] RMD: Loaded 42597 existing records from primary storage. [2025-09-17T22:57:04.160182] [INFO ] [MAIN ] RMD: Loaded 42597 primary data records. [2025-09-17T22:57:04.232994] [DEBUG] [MAIN ] RMAX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:04.262501] [INFO ] [MAIN ] RMAX: Generated 1794 derivative records from 21780 primary records. [2025-09-17T22:57:04.283744] [DEBUG] [LOCAL ] RMAX: Saving derivative data. [2025-09-17T22:57:04.389837] [DEBUG] [LOCAL ] RMAX: Derivative data saved (1794 records). [2025-09-17T22:57:04.390122] [INFO ] [MAIN ] RMAX: Successfully saved derivative data. [2025-09-17T22:57:04.494284] [INFO ] [MAIN ] Derivative Progress: 1573/2085 symbols completed. RMAX took 1.1s. Estimated remaining: 3m 19s. Rate: 154.1 symbols/min [2025-09-17T22:57:04.526695] [DEBUG] [MAIN ] RMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:04.527790] [INFO ] [MAIN ] RMI: Generated 1794 derivative records from 4573 primary records. [2025-09-17T22:57:04.527942] [DEBUG] [LOCAL ] RMI: Saving derivative data. [2025-09-17T22:57:04.544560] [DEBUG] [LOCAL ] RMI: Derivative data saved (1794 records). [2025-09-17T22:57:04.544685] [INFO ] [MAIN ] RMI: Successfully saved derivative data. [2025-09-17T22:57:04.547038] [INFO ] [MAIN ] Derivative Progress: 1574/2085 symbols completed. RMI took 0.7s. Estimated remaining: 3m 19s. Rate: 154.2 symbols/min [2025-09-17T22:57:04.562433] [DEBUG] [MAIN ] RMD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:04.563005] [INFO ] [MAIN ] RMD: Generated 1794 derivative records from 42597 primary records. [2025-09-17T22:57:04.563067] [DEBUG] [LOCAL ] RMD: Saving derivative data. [2025-09-17T22:57:04.578886] [DEBUG] [LOCAL ] RMD: Derivative data saved (1794 records). [2025-09-17T22:57:04.578944] [INFO ] [MAIN ] RMD: Successfully saved derivative data. [2025-09-17T22:57:04.581103] [INFO ] [MAIN ] Derivative Progress: 1575/2085 symbols completed. RMD took 0.8s. Estimated remaining: 3m 18s. Rate: 154.3 symbols/min [2025-09-17T22:57:04.581895] [INFO ] [MAIN ] RMM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:04.582291] [INFO ] [MAIN ] RMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:04.582131] [INFO ] [MAIN ] RMMZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:04.592915] [DEBUG] [LOCAL ] RMMZ: Loaded 4805 existing records from primary storage. [2025-09-17T22:57:04.593068] [INFO ] [MAIN ] RMMZ: Loaded 4805 primary data records. [2025-09-17T22:57:04.685046] [DEBUG] [LOCAL ] RMM: Loaded 10213 existing records from primary storage. [2025-09-17T22:57:04.713204] [INFO ] [MAIN ] RMM: Loaded 10213 primary data records. [2025-09-17T22:57:04.713494] [DEBUG] [LOCAL ] RMT: Loaded 17815 existing records from primary storage. [2025-09-17T22:57:04.713987] [INFO ] [MAIN ] RMT: Loaded 17815 primary data records. [2025-09-17T22:57:05.572804] [DEBUG] [MAIN ] RMMZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:05.573529] [INFO ] [MAIN ] RMMZ: Generated 1794 derivative records from 4805 primary records. [2025-09-17T22:57:05.573617] [DEBUG] [LOCAL ] RMMZ: Saving derivative data. [2025-09-17T22:57:05.617461] [DEBUG] [MAIN ] RMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:05.619273] [INFO ] [MAIN ] RMT: Generated 1794 derivative records from 17815 primary records. [2025-09-17T22:57:05.619901] [DEBUG] [LOCAL ] RMT: Saving derivative data. [2025-09-17T22:57:05.617717] [DEBUG] [MAIN ] RMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:05.622015] [DEBUG] [LOCAL ] RMMZ: Derivative data saved (1794 records). [2025-09-17T22:57:05.622809] [INFO ] [MAIN ] RMM: Generated 1794 derivative records from 10213 primary records. [2025-09-17T22:57:05.629864] [DEBUG] [LOCAL ] RMM: Saving derivative data. [2025-09-17T22:57:05.629782] [INFO ] [MAIN ] RMMZ: Successfully saved derivative data. [2025-09-17T22:57:05.631952] [INFO ] [MAIN ] Derivative Progress: 1576/2085 symbols completed. RMMZ took 1.0s. Estimated remaining: 3m 18s. Rate: 154.2 symbols/min [2025-09-17T22:57:05.632710] [INFO ] [MAIN ] RNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:05.657296] [DEBUG] [LOCAL ] RMT: Derivative data saved (1794 records). [2025-09-17T22:57:05.656792] [DEBUG] [LOCAL ] RMM: Derivative data saved (1794 records). [2025-09-17T22:57:05.657450] [INFO ] [MAIN ] RMT: Successfully saved derivative data. [2025-09-17T22:57:05.657521] [INFO ] [MAIN ] RMM: Successfully saved derivative data. [2025-09-17T22:57:05.660041] [INFO ] [MAIN ] Derivative Progress: 1577/2085 symbols completed. RMM took 1.1s. Estimated remaining: 3m 18s. Rate: 154.2 symbols/min [2025-09-17T22:57:05.662463] [INFO ] [MAIN ] RNGR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:05.662367] [INFO ] [MAIN ] Derivative Progress: 1578/2085 symbols completed. RMT took 1.1s. Estimated remaining: 3m 17s. Rate: 154.3 symbols/min [2025-09-17T22:57:05.663110] [INFO ] [MAIN ] RNP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:05.688097] [DEBUG] [LOCAL ] RNGR: Loaded 20417 existing records from primary storage. [2025-09-17T22:57:05.688224] [INFO ] [MAIN ] RNGR: Loaded 20417 primary data records. [2025-09-17T22:57:05.705508] [DEBUG] [LOCAL ] RNP: Loaded 15886 existing records from primary storage. [2025-09-17T22:57:05.748112] [INFO ] [MAIN ] RNP: Loaded 15886 primary data records. [2025-09-17T22:57:05.934193] [DEBUG] [LOCAL ] RNG: Loaded 48251 existing records from primary storage. [2025-09-17T22:57:05.995633] [INFO ] [MAIN ] RNG: Loaded 48251 primary data records. [2025-09-17T22:57:06.659585] [DEBUG] [MAIN ] RNGR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:06.661324] [INFO ] [MAIN ] RNGR: Generated 1794 derivative records from 20417 primary records. [2025-09-17T22:57:06.661762] [DEBUG] [LOCAL ] RNGR: Saving derivative data. [2025-09-17T22:57:06.675810] [DEBUG] [MAIN ] RNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:06.687466] [INFO ] [MAIN ] RNP: Generated 1794 derivative records from 15886 primary records. [2025-09-17T22:57:06.688880] [DEBUG] [LOCAL ] RNP: Saving derivative data. [2025-09-17T22:57:06.703901] [DEBUG] [LOCAL ] RNGR: Derivative data saved (1794 records). [2025-09-17T22:57:06.704545] [INFO ] [MAIN ] RNGR: Successfully saved derivative data. [2025-09-17T22:57:06.706984] [INFO ] [MAIN ] Derivative Progress: 1579/2085 symbols completed. RNGR took 1.0s. Estimated remaining: 3m 17s. Rate: 154.2 symbols/min [2025-09-17T22:57:06.707948] [INFO ] [MAIN ] RNR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:06.714791] [DEBUG] [LOCAL ] RNP: Derivative data saved (1794 records). [2025-09-17T22:57:06.715072] [INFO ] [MAIN ] RNP: Successfully saved derivative data. [2025-09-17T22:57:06.717423] [INFO ] [MAIN ] Derivative Progress: 1580/2085 symbols completed. RNP took 1.1s. Estimated remaining: 3m 16s. Rate: 154.3 symbols/min [2025-09-17T22:57:06.717812] [INFO ] [MAIN ] RNST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:06.730975] [DEBUG] [MAIN ] RNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:06.731676] [INFO ] [MAIN ] RNG: Generated 1794 derivative records from 48251 primary records. [2025-09-17T22:57:06.731863] [DEBUG] [LOCAL ] RNG: Saving derivative data. [2025-09-17T22:57:06.757888] [DEBUG] [LOCAL ] RNG: Derivative data saved (1794 records). [2025-09-17T22:57:06.758133] [INFO ] [MAIN ] RNG: Successfully saved derivative data. [2025-09-17T22:57:06.760751] [INFO ] [MAIN ] Derivative Progress: 1581/2085 symbols completed. RNG took 1.1s. Estimated remaining: 3m 16s. Rate: 154.4 symbols/min [2025-09-17T22:57:06.761238] [INFO ] [MAIN ] ROG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:06.783876] [DEBUG] [LOCAL ] RNR: Loaded 34785 existing records from primary storage. [2025-09-17T22:57:06.784149] [INFO ] [MAIN ] RNR: Loaded 34785 primary data records. [2025-09-17T22:57:06.915187] [DEBUG] [LOCAL ] ROG: Loaded 23482 existing records from primary storage. [2025-09-17T22:57:06.916156] [DEBUG] [LOCAL ] RNST: Loaded 37354 existing records from primary storage. [2025-09-17T22:57:06.921470] [INFO ] [MAIN ] ROG: Loaded 23482 primary data records. [2025-09-17T22:57:06.921665] [INFO ] [MAIN ] RNST: Loaded 37354 primary data records. [2025-09-17T22:57:07.814047] [DEBUG] [MAIN ] RNR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:07.815403] [INFO ] [MAIN ] RNR: Generated 1794 derivative records from 34785 primary records. [2025-09-17T22:57:07.815726] [DEBUG] [LOCAL ] RNR: Saving derivative data. [2025-09-17T22:57:07.849955] [DEBUG] [MAIN ] ROG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:07.851189] [INFO ] [MAIN ] ROG: Generated 1794 derivative records from 23482 primary records. [2025-09-17T22:57:07.851935] [DEBUG] [LOCAL ] ROG: Saving derivative data. [2025-09-17T22:57:07.873812] [DEBUG] [MAIN ] RNST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:07.861615] [DEBUG] [LOCAL ] RNR: Derivative data saved (1794 records). [2025-09-17T22:57:07.877392] [INFO ] [MAIN ] RNR: Successfully saved derivative data. [2025-09-17T22:57:07.880631] [INFO ] [MAIN ] Derivative Progress: 1582/2085 symbols completed. RNR took 1.2s. Estimated remaining: 3m 16s. Rate: 154.2 symbols/min [2025-09-17T22:57:07.881816] [INFO ] [MAIN ] RNST: Generated 1794 derivative records from 37354 primary records. [2025-09-17T22:57:07.882384] [DEBUG] [LOCAL ] RNST: Saving derivative data. [2025-09-17T22:57:07.883073] [INFO ] [MAIN ] ROK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:07.899860] [DEBUG] [LOCAL ] ROG: Derivative data saved (1794 records). [2025-09-17T22:57:07.900276] [INFO ] [MAIN ] ROG: Successfully saved derivative data. [2025-09-17T22:57:07.902818] [INFO ] [MAIN ] Derivative Progress: 1583/2085 symbols completed. ROG took 1.1s. Estimated remaining: 3m 15s. Rate: 154.3 symbols/min [2025-09-17T22:57:07.903432] [INFO ] [MAIN ] ROL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:07.907975] [DEBUG] [LOCAL ] RNST: Derivative data saved (1794 records). [2025-09-17T22:57:07.908109] [INFO ] [MAIN ] RNST: Successfully saved derivative data. [2025-09-17T22:57:07.910685] [INFO ] [MAIN ] Derivative Progress: 1584/2085 symbols completed. RNST took 1.2s. Estimated remaining: 3m 15s. Rate: 154.4 symbols/min [2025-09-17T22:57:07.911082] [INFO ] [MAIN ] RPM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:07.973225] [DEBUG] [LOCAL ] ROK: Loaded 44212 existing records from primary storage. [2025-09-17T22:57:07.973986] [INFO ] [MAIN ] ROK: Loaded 44212 primary data records. [2025-09-17T22:57:08.084063] [DEBUG] [LOCAL ] ROL: Loaded 50296 existing records from primary storage. [2025-09-17T22:57:08.107348] [INFO ] [MAIN ] ROL: Loaded 50296 primary data records. [2025-09-17T22:57:08.107937] [DEBUG] [LOCAL ] RPM: Loaded 41074 existing records from primary storage. [2025-09-17T22:57:08.108163] [INFO ] [MAIN ] RPM: Loaded 41074 primary data records. [2025-09-17T22:57:09.027256] [DEBUG] [MAIN ] ROK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:09.029065] [INFO ] [MAIN ] ROK: Generated 1794 derivative records from 44212 primary records. [2025-09-17T22:57:09.030728] [DEBUG] [LOCAL ] ROK: Saving derivative data. [2025-09-17T22:57:09.045568] [DEBUG] [MAIN ] RPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:09.057847] [INFO ] [MAIN ] RPM: Generated 1794 derivative records from 41074 primary records. [2025-09-17T22:57:09.058183] [DEBUG] [LOCAL ] RPM: Saving derivative data. [2025-09-17T22:57:09.070539] [DEBUG] [LOCAL ] ROK: Derivative data saved (1794 records). [2025-09-17T22:57:09.086220] [INFO ] [MAIN ] ROK: Successfully saved derivative data. [2025-09-17T22:57:09.086493] [DEBUG] [MAIN ] ROL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:09.089553] [INFO ] [MAIN ] ROL: Generated 1794 derivative records from 50296 primary records. [2025-09-17T22:57:09.088510] [INFO ] [MAIN ] Derivative Progress: 1585/2085 symbols completed. ROK took 1.2s. Estimated remaining: 3m 15s. Rate: 154.2 symbols/min [2025-09-17T22:57:09.090160] [DEBUG] [LOCAL ] ROL: Saving derivative data. [2025-09-17T22:57:09.090843] [INFO ] [MAIN ] RRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:09.106073] [DEBUG] [LOCAL ] RPM: Derivative data saved (1794 records). [2025-09-17T22:57:09.106867] [INFO ] [MAIN ] RPM: Successfully saved derivative data. [2025-09-17T22:57:09.109174] [INFO ] [MAIN ] Derivative Progress: 1586/2085 symbols completed. RPM took 1.2s. Estimated remaining: 3m 14s. Rate: 154.3 symbols/min [2025-09-17T22:57:09.109717] [INFO ] [MAIN ] RRX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:09.113605] [DEBUG] [LOCAL ] ROL: Derivative data saved (1794 records). [2025-09-17T22:57:09.114608] [INFO ] [MAIN ] ROL: Successfully saved derivative data. [2025-09-17T22:57:09.117242] [INFO ] [MAIN ] Derivative Progress: 1587/2085 symbols completed. ROL took 1.2s. Estimated remaining: 3m 14s. Rate: 154.4 symbols/min [2025-09-17T22:57:09.117610] [INFO ] [MAIN ] RS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:09.145146] [DEBUG] [LOCAL ] RS: Loaded 25896 existing records from primary storage. [2025-09-17T22:57:09.165687] [INFO ] [MAIN ] RS: Loaded 25896 primary data records. [2025-09-17T22:57:09.308892] [DEBUG] [LOCAL ] RRC: Loaded 52777 existing records from primary storage. [2025-09-17T22:57:09.302984] [DEBUG] [LOCAL ] RRX: Loaded 41158 existing records from primary storage. [2025-09-17T22:57:09.314195] [INFO ] [MAIN ] RRX: Loaded 41158 primary data records. [2025-09-17T22:57:09.324695] [INFO ] [MAIN ] RRC: Loaded 52777 primary data records. [2025-09-17T22:57:10.145034] [DEBUG] [MAIN ] RS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:10.147251] [INFO ] [MAIN ] RS: Generated 1794 derivative records from 25896 primary records. [2025-09-17T22:57:10.154878] [DEBUG] [LOCAL ] RS: Saving derivative data. [2025-09-17T22:57:10.162874] [DEBUG] [MAIN ] RRX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:10.163517] [INFO ] [MAIN ] RRX: Generated 1794 derivative records from 41158 primary records. [2025-09-17T22:57:10.163608] [DEBUG] [LOCAL ] RRX: Saving derivative data. [2025-09-17T22:57:10.201635] [DEBUG] [MAIN ] RRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:10.204504] [INFO ] [MAIN ] RRC: Generated 1794 derivative records from 52777 primary records. [2025-09-17T22:57:10.206123] [DEBUG] [LOCAL ] RRX: Derivative data saved (1794 records). [2025-09-17T22:57:10.206797] [INFO ] [MAIN ] RRX: Successfully saved derivative data. [2025-09-17T22:57:10.206421] [DEBUG] [LOCAL ] RRC: Saving derivative data. [2025-09-17T22:57:10.209755] [INFO ] [MAIN ] Derivative Progress: 1588/2085 symbols completed. RRX took 1.1s. Estimated remaining: 3m 13s. Rate: 154.2 symbols/min [2025-09-17T22:57:10.223493] [DEBUG] [LOCAL ] RS: Derivative data saved (1794 records). [2025-09-17T22:57:10.227164] [INFO ] [MAIN ] RS: Successfully saved derivative data. [2025-09-17T22:57:10.229519] [INFO ] [MAIN ] Derivative Progress: 1589/2085 symbols completed. RS took 1.1s. Estimated remaining: 3m 13s. Rate: 154.3 symbols/min [2025-09-17T22:57:10.230402] [DEBUG] [LOCAL ] RRC: Derivative data saved (1794 records). [2025-09-17T22:57:10.230465] [INFO ] [MAIN ] RRC: Successfully saved derivative data. [2025-09-17T22:57:10.232878] [INFO ] [MAIN ] Derivative Progress: 1590/2085 symbols completed. RRC took 1.1s. Estimated remaining: 3m 12s. Rate: 154.4 symbols/min [2025-09-17T22:57:10.233460] [INFO ] [MAIN ] RSF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:10.233508] [INFO ] [MAIN ] RSKD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:10.233593] [INFO ] [MAIN ] RSG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:10.240468] [DEBUG] [LOCAL ] RSF: Loaded 4162 existing records from primary storage. [2025-09-17T22:57:10.240631] [INFO ] [MAIN ] RSF: Loaded 4162 primary data records. [2025-09-17T22:57:10.562854] [DEBUG] [LOCAL ] RSKD: Loaded 34243 existing records from primary storage. [2025-09-17T22:57:10.572437] [INFO ] [MAIN ] RSKD: Loaded 34243 primary data records. [2025-09-17T22:57:10.702150] [DEBUG] [LOCAL ] RSG: Loaded 47462 existing records from primary storage. [2025-09-17T22:57:10.724029] [INFO ] [MAIN ] RSG: Loaded 47462 primary data records. [2025-09-17T22:57:11.295888] [DEBUG] [MAIN ] RSF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:11.296736] [INFO ] [MAIN ] RSF: Generated 1794 derivative records from 4162 primary records. [2025-09-17T22:57:11.296956] [DEBUG] [LOCAL ] RSF: Saving derivative data. [2025-09-17T22:57:11.315422] [DEBUG] [LOCAL ] RSF: Derivative data saved (1794 records). [2025-09-17T22:57:11.316213] [INFO ] [MAIN ] RSF: Successfully saved derivative data. [2025-09-17T22:57:11.318087] [INFO ] [MAIN ] Derivative Progress: 1591/2085 symbols completed. RSF took 1.1s. Estimated remaining: 3m 12s. Rate: 154.2 symbols/min [2025-09-17T22:57:11.318786] [INFO ] [MAIN ] RTO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:11.340158] [DEBUG] [MAIN ] RSKD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:11.340978] [INFO ] [MAIN ] RSKD: Generated 1794 derivative records from 34243 primary records. [2025-09-17T22:57:11.341146] [DEBUG] [LOCAL ] RSKD: Saving derivative data. [2025-09-17T22:57:11.388385] [DEBUG] [LOCAL ] RSKD: Derivative data saved (1794 records). [2025-09-17T22:57:11.389197] [INFO ] [MAIN ] RSKD: Successfully saved derivative data. [2025-09-17T22:57:11.392540] [INFO ] [MAIN ] Derivative Progress: 1592/2085 symbols completed. RSKD took 1.2s. Estimated remaining: 3m 12s. Rate: 154.3 symbols/min [2025-09-17T22:57:11.392929] [INFO ] [MAIN ] RTX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:11.389074] [DEBUG] [MAIN ] RSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:11.395093] [INFO ] [MAIN ] RSG: Generated 1794 derivative records from 47462 primary records. [2025-09-17T22:57:11.395331] [DEBUG] [LOCAL ] RSG: Saving derivative data. [2025-09-17T22:57:11.424374] [DEBUG] [LOCAL ] RTO: Loaded 40670 existing records from primary storage. [2025-09-17T22:57:11.425447] [INFO ] [MAIN ] RTO: Loaded 40670 primary data records. [2025-09-17T22:57:11.448490] [DEBUG] [LOCAL ] RSG: Derivative data saved (1794 records). [2025-09-17T22:57:11.483969] [INFO ] [MAIN ] RSG: Successfully saved derivative data. [2025-09-17T22:57:11.515266] [INFO ] [MAIN ] Derivative Progress: 1593/2085 symbols completed. RSG took 1.3s. Estimated remaining: 3m 11s. Rate: 154.3 symbols/min [2025-09-17T22:57:11.527153] [INFO ] [MAIN ] RVLV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:11.787098] [DEBUG] [LOCAL ] RTX: Loaded 53712 existing records from primary storage. [2025-09-17T22:57:11.787446] [INFO ] [MAIN ] RTX: Loaded 53712 primary data records. [2025-09-17T22:57:11.949515] [DEBUG] [LOCAL ] RVLV: Loaded 48014 existing records from primary storage. [2025-09-17T22:57:11.972345] [INFO ] [MAIN ] RVLV: Loaded 48014 primary data records. [2025-09-17T22:57:12.301822] [DEBUG] [MAIN ] RTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:12.320233] [INFO ] [MAIN ] RTO: Generated 1794 derivative records from 40670 primary records. [2025-09-17T22:57:12.343444] [DEBUG] [LOCAL ] RTO: Saving derivative data. [2025-09-17T22:57:12.491933] [DEBUG] [LOCAL ] RTO: Derivative data saved (1794 records). [2025-09-17T22:57:12.492763] [INFO ] [MAIN ] RTO: Successfully saved derivative data. [2025-09-17T22:57:12.496342] [INFO ] [MAIN ] Derivative Progress: 1594/2085 symbols completed. RTO took 1.2s. Estimated remaining: 3m 11s. Rate: 154.2 symbols/min [2025-09-17T22:57:12.497475] [INFO ] [MAIN ] RVT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:12.516053] [DEBUG] [MAIN ] RTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:12.516774] [INFO ] [MAIN ] RTX: Generated 1794 derivative records from 53712 primary records. [2025-09-17T22:57:12.516921] [DEBUG] [LOCAL ] RTX: Saving derivative data. [2025-09-17T22:57:12.543764] [DEBUG] [LOCAL ] RTX: Derivative data saved (1794 records). [2025-09-17T22:57:12.545131] [INFO ] [MAIN ] RTX: Successfully saved derivative data. [2025-09-17T22:57:12.549001] [INFO ] [MAIN ] Derivative Progress: 1595/2085 symbols completed. RTX took 1.2s. Estimated remaining: 3m 11s. Rate: 154.3 symbols/min [2025-09-17T22:57:12.549577] [INFO ] [MAIN ] RVTY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:12.563591] [DEBUG] [MAIN ] RVLV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:12.564458] [INFO ] [MAIN ] RVLV: Generated 1794 derivative records from 48014 primary records. [2025-09-17T22:57:12.572988] [DEBUG] [LOCAL ] RVLV: Saving derivative data. [2025-09-17T22:57:12.575909] [DEBUG] [LOCAL ] RVT: Loaded 27420 existing records from primary storage. [2025-09-17T22:57:12.583262] [INFO ] [MAIN ] RVT: Loaded 27420 primary data records. [2025-09-17T22:57:12.721755] [DEBUG] [LOCAL ] RVLV: Derivative data saved (1794 records). [2025-09-17T22:57:12.737474] [INFO ] [MAIN ] RVLV: Successfully saved derivative data. [2025-09-17T22:57:12.762491] [INFO ] [MAIN ] Derivative Progress: 1596/2085 symbols completed. RVLV took 1.2s. Estimated remaining: 3m 10s. Rate: 154.3 symbols/min [2025-09-17T22:57:12.789196] [INFO ] [MAIN ] RWT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:12.928069] [DEBUG] [LOCAL ] RVTY: Loaded 47610 existing records from primary storage. [2025-09-17T22:57:12.929011] [INFO ] [MAIN ] RVTY: Loaded 47610 primary data records. [2025-09-17T22:57:13.305665] [DEBUG] [LOCAL ] RWT: Loaded 40527 existing records from primary storage. [2025-09-17T22:57:13.306253] [INFO ] [MAIN ] RWT: Loaded 40527 primary data records. [2025-09-17T22:57:13.446818] [DEBUG] [MAIN ] RVT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:13.478316] [INFO ] [MAIN ] RVT: Generated 1794 derivative records from 27420 primary records. [2025-09-17T22:57:13.487052] [DEBUG] [LOCAL ] RVT: Saving derivative data. [2025-09-17T22:57:13.661072] [DEBUG] [LOCAL ] RVT: Derivative data saved (1794 records). [2025-09-17T22:57:13.662057] [INFO ] [MAIN ] RVT: Successfully saved derivative data. [2025-09-17T22:57:13.664932] [INFO ] [MAIN ] Derivative Progress: 1597/2085 symbols completed. RVT took 1.2s. Estimated remaining: 3m 10s. Rate: 154.2 symbols/min [2025-09-17T22:57:13.665800] [INFO ] [MAIN ] RXO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:13.680914] [DEBUG] [MAIN ] RVTY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:13.681941] [INFO ] [MAIN ] RVTY: Generated 1794 derivative records from 47610 primary records. [2025-09-17T22:57:13.682381] [DEBUG] [LOCAL ] RVTY: Saving derivative data. [2025-09-17T22:57:13.701024] [DEBUG] [LOCAL ] RVTY: Derivative data saved (1794 records). [2025-09-17T22:57:13.701178] [INFO ] [MAIN ] RVTY: Successfully saved derivative data. [2025-09-17T22:57:13.704469] [INFO ] [MAIN ] Derivative Progress: 1598/2085 symbols completed. RVTY took 1.2s. Estimated remaining: 3m 9s. Rate: 154.3 symbols/min [2025-09-17T22:57:13.704982] [INFO ] [MAIN ] RY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:13.721605] [DEBUG] [MAIN ] RWT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:13.722380] [INFO ] [MAIN ] RWT: Generated 1794 derivative records from 40527 primary records. [2025-09-17T22:57:13.722554] [DEBUG] [LOCAL ] RWT: Saving derivative data. [2025-09-17T22:57:13.748568] [DEBUG] [LOCAL ] RWT: Derivative data saved (1794 records). [2025-09-17T22:57:13.748718] [INFO ] [MAIN ] RWT: Successfully saved derivative data. [2025-09-17T22:57:13.751159] [INFO ] [MAIN ] Derivative Progress: 1599/2085 symbols completed. RWT took 1.0s. Estimated remaining: 3m 9s. Rate: 154.4 symbols/min [2025-09-17T22:57:13.751581] [INFO ] [MAIN ] RYAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:13.772726] [DEBUG] [LOCAL ] RXO: Loaded 47726 existing records from primary storage. [2025-09-17T22:57:13.772981] [INFO ] [MAIN ] RXO: Loaded 47726 primary data records. [2025-09-17T22:57:13.977936] [DEBUG] [LOCAL ] RYAM: Loaded 35209 existing records from primary storage. [2025-09-17T22:57:14.021579] [INFO ] [MAIN ] RYAM: Loaded 35209 primary data records. [2025-09-17T22:57:14.162388] [DEBUG] [LOCAL ] RY: Loaded 48054 existing records from primary storage. [2025-09-17T22:57:14.175748] [INFO ] [MAIN ] RY: Loaded 48054 primary data records. [2025-09-17T22:57:14.806894] [DEBUG] [MAIN ] RXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:14.807818] [INFO ] [MAIN ] RXO: Generated 1794 derivative records from 47726 primary records. [2025-09-17T22:57:14.807952] [DEBUG] [LOCAL ] RXO: Saving derivative data. [2025-09-17T22:57:14.828193] [DEBUG] [LOCAL ] RXO: Derivative data saved (1794 records). [2025-09-17T22:57:14.828364] [INFO ] [MAIN ] RXO: Successfully saved derivative data. [2025-09-17T22:57:14.830801] [INFO ] [MAIN ] Derivative Progress: 1600/2085 symbols completed. RXO took 1.2s. Estimated remaining: 3m 9s. Rate: 154.2 symbols/min [2025-09-17T22:57:14.831489] [INFO ] [MAIN ] RYAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:14.852233] [DEBUG] [MAIN ] RY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:14.870569] [INFO ] [MAIN ] RY: Generated 1794 derivative records from 48054 primary records. [2025-09-17T22:57:14.871702] [DEBUG] [LOCAL ] RY: Saving derivative data. [2025-09-17T22:57:14.872896] [DEBUG] [MAIN ] RYAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:14.874051] [INFO ] [MAIN ] RYAM: Generated 1794 derivative records from 35209 primary records. [2025-09-17T22:57:14.881743] [DEBUG] [LOCAL ] RYAM: Saving derivative data. [2025-09-17T22:57:14.890559] [DEBUG] [LOCAL ] RY: Derivative data saved (1794 records). [2025-09-17T22:57:14.890690] [INFO ] [MAIN ] RY: Successfully saved derivative data. [2025-09-17T22:57:14.893528] [INFO ] [MAIN ] Derivative Progress: 1601/2085 symbols completed. RY took 1.2s. Estimated remaining: 3m 8s. Rate: 154.3 symbols/min [2025-09-17T22:57:14.919966] [INFO ] [MAIN ] RYI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:14.927787] [DEBUG] [LOCAL ] RYAM: Derivative data saved (1794 records). [2025-09-17T22:57:14.928695] [INFO ] [MAIN ] RYAM: Successfully saved derivative data. [2025-09-17T22:57:14.931680] [INFO ] [MAIN ] Derivative Progress: 1602/2085 symbols completed. RYAM took 1.2s. Estimated remaining: 3m 8s. Rate: 154.4 symbols/min [2025-09-17T22:57:14.944383] [INFO ] [MAIN ] RYN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:14.945622] [DEBUG] [LOCAL ] RYAN: Loaded 43954 existing records from primary storage. [2025-09-17T22:57:14.945734] [INFO ] [MAIN ] RYAN: Loaded 43954 primary data records. [2025-09-17T22:57:15.078472] [DEBUG] [LOCAL ] RYI: Loaded 21523 existing records from primary storage. [2025-09-17T22:57:15.141797] [INFO ] [MAIN ] RYI: Loaded 21523 primary data records. [2025-09-17T22:57:15.524103] [DEBUG] [LOCAL ] RYN: Loaded 45855 existing records from primary storage. [2025-09-17T22:57:15.644006] [INFO ] [MAIN ] RYN: Loaded 45855 primary data records. [2025-09-17T22:57:15.970454] [DEBUG] [MAIN ] RYAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:15.972047] [INFO ] [MAIN ] RYAN: Generated 1794 derivative records from 43954 primary records. [2025-09-17T22:57:15.972357] [DEBUG] [LOCAL ] RYAN: Saving derivative data. [2025-09-17T22:57:15.993992] [DEBUG] [LOCAL ] RYAN: Derivative data saved (1794 records). [2025-09-17T22:57:15.995062] [INFO ] [MAIN ] RYAN: Successfully saved derivative data. [2025-09-17T22:57:15.998830] [INFO ] [MAIN ] Derivative Progress: 1603/2085 symbols completed. RYAN took 1.2s. Estimated remaining: 3m 8s. Rate: 154.2 symbols/min [2025-09-17T22:57:16.013137] [DEBUG] [MAIN ] RYI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:16.013912] [INFO ] [MAIN ] RYI: Generated 1794 derivative records from 21523 primary records. [2025-09-17T22:57:16.014169] [DEBUG] [LOCAL ] RYI: Saving derivative data. [2025-09-17T22:57:16.030232] [DEBUG] [LOCAL ] RYI: Derivative data saved (1794 records). [2025-09-17T22:57:16.031797] [INFO ] [MAIN ] RYI: Successfully saved derivative data. [2025-09-17T22:57:16.034724] [INFO ] [MAIN ] Derivative Progress: 1604/2085 symbols completed. RYI took 1.1s. Estimated remaining: 3m 7s. Rate: 154.3 symbols/min [2025-09-17T22:57:16.047388] [DEBUG] [MAIN ] RYN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:16.047986] [INFO ] [MAIN ] RYN: Generated 1794 derivative records from 45855 primary records. [2025-09-17T22:57:16.048050] [DEBUG] [LOCAL ] RYN: Saving derivative data. [2025-09-17T22:57:16.063372] [DEBUG] [LOCAL ] RYN: Derivative data saved (1794 records). [2025-09-17T22:57:16.063430] [INFO ] [MAIN ] RYN: Successfully saved derivative data. [2025-09-17T22:57:16.066118] [INFO ] [MAIN ] Derivative Progress: 1605/2085 symbols completed. RYN took 1.1s. Estimated remaining: 3m 7s. Rate: 154.4 symbols/min [2025-09-17T22:57:16.066719] [INFO ] [MAIN ] S: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:16.066933] [INFO ] [MAIN ] RZC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:16.066782] [INFO ] [MAIN ] RZB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:16.077795] [DEBUG] [LOCAL ] RZC: Loaded 6887 existing records from primary storage. [2025-09-17T22:57:16.077985] [INFO ] [MAIN ] RZC: Loaded 6887 primary data records. [2025-09-17T22:57:16.114146] [DEBUG] [LOCAL ] RZB: Loaded 6326 existing records from primary storage. [2025-09-17T22:57:16.139119] [INFO ] [MAIN ] RZB: Loaded 6326 primary data records. [2025-09-17T22:57:16.707857] [DEBUG] [LOCAL ] S: Loaded 53544 existing records from primary storage. [2025-09-17T22:57:16.722159] [INFO ] [MAIN ] S: Loaded 53544 primary data records. [2025-09-17T22:57:17.121324] [DEBUG] [MAIN ] RZC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:17.126928] [INFO ] [MAIN ] RZC: Generated 1794 derivative records from 6887 primary records. [2025-09-17T22:57:17.127253] [DEBUG] [LOCAL ] RZC: Saving derivative data. [2025-09-17T22:57:17.127661] [DEBUG] [MAIN ] RZB: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:57:17.128679] [INFO ] [MAIN ] RZB: Generated 1793 derivative records from 6326 primary records. [2025-09-17T22:57:17.129206] [DEBUG] [LOCAL ] RZB: Saving derivative data. [2025-09-17T22:57:17.145356] [DEBUG] [LOCAL ] RZC: Derivative data saved (1794 records). [2025-09-17T22:57:17.151890] [INFO ] [MAIN ] RZC: Successfully saved derivative data. [2025-09-17T22:57:17.158168] [INFO ] [MAIN ] Derivative Progress: 1606/2085 symbols completed. RZC took 1.1s. Estimated remaining: 3m 6s. Rate: 154.2 symbols/min [2025-09-17T22:57:17.158673] [INFO ] [MAIN ] SA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:17.163434] [DEBUG] [LOCAL ] RZB: Derivative data saved (1793 records). [2025-09-17T22:57:17.163576] [INFO ] [MAIN ] RZB: Successfully saved derivative data. [2025-09-17T22:57:17.166149] [INFO ] [MAIN ] Derivative Progress: 1607/2085 symbols completed. RZB took 1.1s. Estimated remaining: 3m 6s. Rate: 154.3 symbols/min [2025-09-17T22:57:17.166545] [INFO ] [MAIN ] SABA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:17.184413] [DEBUG] [MAIN ] S: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:17.185242] [INFO ] [MAIN ] S: Generated 1794 derivative records from 53544 primary records. [2025-09-17T22:57:17.187606] [DEBUG] [LOCAL ] S: Saving derivative data. [2025-09-17T22:57:17.204278] [DEBUG] [LOCAL ] SABA: Loaded 9443 existing records from primary storage. [2025-09-17T22:57:17.207740] [INFO ] [MAIN ] SABA: Loaded 9443 primary data records. [2025-09-17T22:57:17.208935] [DEBUG] [LOCAL ] S: Derivative data saved (1794 records). [2025-09-17T22:57:17.230255] [INFO ] [MAIN ] S: Successfully saved derivative data. [2025-09-17T22:57:17.243102] [INFO ] [MAIN ] Derivative Progress: 1608/2085 symbols completed. S took 1.2s. Estimated remaining: 3m 5s. Rate: 154.4 symbols/min [2025-09-17T22:57:17.270535] [INFO ] [MAIN ] SAFE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:17.380766] [DEBUG] [LOCAL ] SA: Loaded 42927 existing records from primary storage. [2025-09-17T22:57:17.419035] [INFO ] [MAIN ] SA: Loaded 42927 primary data records. [2025-09-17T22:57:17.661683] [DEBUG] [LOCAL ] SAFE: Loaded 30477 existing records from primary storage. [2025-09-17T22:57:17.662605] [INFO ] [MAIN ] SAFE: Loaded 30477 primary data records. [2025-09-17T22:57:18.196788] [DEBUG] [MAIN ] SABA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:18.198129] [INFO ] [MAIN ] SABA: Generated 1794 derivative records from 9443 primary records. [2025-09-17T22:57:18.198511] [DEBUG] [LOCAL ] SABA: Saving derivative data. [2025-09-17T22:57:18.217599] [DEBUG] [LOCAL ] SABA: Derivative data saved (1794 records). [2025-09-17T22:57:18.218069] [INFO ] [MAIN ] SABA: Successfully saved derivative data. [2025-09-17T22:57:18.232686] [INFO ] [MAIN ] Derivative Progress: 1609/2085 symbols completed. SABA took 1.1s. Estimated remaining: 3m 5s. Rate: 154.2 symbols/min [2025-09-17T22:57:18.233751] [DEBUG] [MAIN ] SA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:18.233110] [INFO ] [MAIN ] SAH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:18.234974] [INFO ] [MAIN ] SA: Generated 1794 derivative records from 42927 primary records. [2025-09-17T22:57:18.235163] [DEBUG] [LOCAL ] SA: Saving derivative data. [2025-09-17T22:57:18.252874] [DEBUG] [LOCAL ] SA: Derivative data saved (1794 records). [2025-09-17T22:57:18.254488] [INFO ] [MAIN ] SA: Successfully saved derivative data. [2025-09-17T22:57:18.258016] [INFO ] [MAIN ] Derivative Progress: 1610/2085 symbols completed. SA took 1.1s. Estimated remaining: 3m 5s. Rate: 154.3 symbols/min [2025-09-17T22:57:18.258434] [INFO ] [MAIN ] SAM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:18.282392] [DEBUG] [MAIN ] SAFE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:18.283226] [INFO ] [MAIN ] SAFE: Generated 1794 derivative records from 30477 primary records. [2025-09-17T22:57:18.283353] [DEBUG] [LOCAL ] SAFE: Saving derivative data. [2025-09-17T22:57:18.303018] [DEBUG] [LOCAL ] SAH: Loaded 22302 existing records from primary storage. [2025-09-17T22:57:18.306577] [INFO ] [MAIN ] SAH: Loaded 22302 primary data records. [2025-09-17T22:57:18.307596] [DEBUG] [LOCAL ] SAFE: Derivative data saved (1794 records). [2025-09-17T22:57:18.329685] [INFO ] [MAIN ] SAFE: Successfully saved derivative data. [2025-09-17T22:57:18.361679] [INFO ] [MAIN ] Derivative Progress: 1611/2085 symbols completed. SAFE took 1.1s. Estimated remaining: 3m 4s. Rate: 154.4 symbols/min [2025-09-17T22:57:18.380889] [INFO ] [MAIN ] SAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:18.418242] [DEBUG] [LOCAL ] SAM: Loaded 21704 existing records from primary storage. [2025-09-17T22:57:18.436190] [INFO ] [MAIN ] SAM: Loaded 21704 primary data records. [2025-09-17T22:57:18.966752] [DEBUG] [LOCAL ] SAN: Loaded 53041 existing records from primary storage. [2025-09-17T22:57:18.967774] [INFO ] [MAIN ] SAN: Loaded 53041 primary data records. [2025-09-17T22:57:19.035050] [DEBUG] [MAIN ] SAH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:19.071002] [INFO ] [MAIN ] SAH: Generated 1794 derivative records from 22302 primary records. [2025-09-17T22:57:19.071150] [DEBUG] [LOCAL ] SAH: Saving derivative data. [2025-09-17T22:57:19.195051] [DEBUG] [LOCAL ] SAH: Derivative data saved (1794 records). [2025-09-17T22:57:19.195339] [INFO ] [MAIN ] SAH: Successfully saved derivative data. [2025-09-17T22:57:19.364394] [INFO ] [MAIN ] Derivative Progress: 1612/2085 symbols completed. SAH took 1.1s. Estimated remaining: 3m 4s. Rate: 154.2 symbols/min [2025-09-17T22:57:19.377917] [INFO ] [MAIN ] SAND: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:19.378413] [DEBUG] [MAIN ] SAM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:19.379251] [INFO ] [MAIN ] SAM: Generated 1794 derivative records from 21704 primary records. [2025-09-17T22:57:19.379885] [DEBUG] [LOCAL ] SAM: Saving derivative data. [2025-09-17T22:57:19.402242] [DEBUG] [LOCAL ] SAM: Derivative data saved (1794 records). [2025-09-17T22:57:19.403254] [INFO ] [MAIN ] SAM: Successfully saved derivative data. [2025-09-17T22:57:19.405735] [INFO ] [MAIN ] Derivative Progress: 1613/2085 symbols completed. SAM took 1.1s. Estimated remaining: 3m 4s. Rate: 154.3 symbols/min [2025-09-17T22:57:19.406858] [INFO ] [MAIN ] SAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:19.433461] [DEBUG] [MAIN ] SAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:19.434548] [INFO ] [MAIN ] SAN: Generated 1794 derivative records from 53041 primary records. [2025-09-17T22:57:19.434744] [DEBUG] [LOCAL ] SAN: Saving derivative data. [2025-09-17T22:57:19.478390] [DEBUG] [LOCAL ] SAN: Derivative data saved (1794 records). [2025-09-17T22:57:19.478610] [INFO ] [MAIN ] SAN: Successfully saved derivative data. [2025-09-17T22:57:19.481515] [INFO ] [MAIN ] Derivative Progress: 1614/2085 symbols completed. SAN took 1.1s. Estimated remaining: 3m 3s. Rate: 154.4 symbols/min [2025-09-17T22:57:19.482038] [INFO ] [MAIN ] SAR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:19.499994] [DEBUG] [LOCAL ] SAP: Loaded 50093 existing records from primary storage. [2025-09-17T22:57:19.513293] [INFO ] [MAIN ] SAP: Loaded 50093 primary data records. [2025-09-17T22:57:19.558857] [DEBUG] [LOCAL ] SAND: Loaded 51758 existing records from primary storage. [2025-09-17T22:57:19.620491] [INFO ] [MAIN ] SAND: Loaded 51758 primary data records. [2025-09-17T22:57:19.635953] [DEBUG] [LOCAL ] SAR: Loaded 16499 existing records from primary storage. [2025-09-17T22:57:19.656493] [INFO ] [MAIN ] SAR: Loaded 16499 primary data records. [2025-09-17T22:57:20.461506] [DEBUG] [MAIN ] SAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:20.462468] [INFO ] [MAIN ] SAP: Generated 1794 derivative records from 50093 primary records. [2025-09-17T22:57:20.462778] [DEBUG] [LOCAL ] SAP: Saving derivative data. [2025-09-17T22:57:20.483563] [DEBUG] [LOCAL ] SAP: Derivative data saved (1794 records). [2025-09-17T22:57:20.483927] [INFO ] [MAIN ] SAP: Successfully saved derivative data. [2025-09-17T22:57:20.498248] [INFO ] [MAIN ] Derivative Progress: 1615/2085 symbols completed. SAP took 1.1s. Estimated remaining: 3m 3s. Rate: 154.2 symbols/min [2025-09-17T22:57:20.499516] [DEBUG] [MAIN ] SAND: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:20.499830] [INFO ] [MAIN ] SARO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:20.500532] [INFO ] [MAIN ] SAND: Generated 1794 derivative records from 51758 primary records. [2025-09-17T22:57:20.513189] [DEBUG] [MAIN ] SAR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:20.513915] [INFO ] [MAIN ] SAR: Generated 1794 derivative records from 16499 primary records. [2025-09-17T22:57:20.514117] [DEBUG] [LOCAL ] SAR: Saving derivative data. [2025-09-17T22:57:20.514181] [DEBUG] [LOCAL ] SAND: Saving derivative data. [2025-09-17T22:57:20.543691] [DEBUG] [LOCAL ] SAR: Derivative data saved (1794 records). [2025-09-17T22:57:20.544310] [INFO ] [MAIN ] SAR: Successfully saved derivative data. [2025-09-17T22:57:20.547056] [INFO ] [MAIN ] Derivative Progress: 1616/2085 symbols completed. SAR took 1.1s. Estimated remaining: 3m 2s. Rate: 154.3 symbols/min [2025-09-17T22:57:20.547784] [INFO ] [MAIN ] SB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:20.548455] [DEBUG] [LOCAL ] SAND: Derivative data saved (1794 records). [2025-09-17T22:57:20.548633] [INFO ] [MAIN ] SAND: Successfully saved derivative data. [2025-09-17T22:57:20.550853] [INFO ] [MAIN ] Derivative Progress: 1617/2085 symbols completed. SAND took 1.2s. Estimated remaining: 3m 2s. Rate: 154.4 symbols/min [2025-09-17T22:57:20.551390] [INFO ] [MAIN ] SBH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:20.603703] [DEBUG] [LOCAL ] SB: Loaded 33697 existing records from primary storage. [2025-09-17T22:57:20.617815] [INFO ] [MAIN ] SB: Loaded 33697 primary data records. [2025-09-17T22:57:20.640625] [DEBUG] [LOCAL ] SARO: Loaded 48817 existing records from primary storage. [2025-09-17T22:57:20.675746] [INFO ] [MAIN ] SARO: Loaded 48817 primary data records. [2025-09-17T22:57:20.810726] [DEBUG] [LOCAL ] SBH: Loaded 49807 existing records from primary storage. [2025-09-17T22:57:20.855725] [INFO ] [MAIN ] SBH: Loaded 49807 primary data records. [2025-09-17T22:57:21.603734] [DEBUG] [MAIN ] SB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:21.605009] [INFO ] [MAIN ] SB: Generated 1794 derivative records from 33697 primary records. [2025-09-17T22:57:21.605850] [DEBUG] [LOCAL ] SB: Saving derivative data. [2025-09-17T22:57:21.636436] [DEBUG] [MAIN ] SARO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:21.638149] [INFO ] [MAIN ] SARO: Generated 1794 derivative records from 48817 primary records. [2025-09-17T22:57:21.638861] [DEBUG] [LOCAL ] SB: Derivative data saved (1794 records). [2025-09-17T22:57:21.639873] [DEBUG] [LOCAL ] SARO: Saving derivative data. [2025-09-17T22:57:21.641576] [INFO ] [MAIN ] SB: Successfully saved derivative data. [2025-09-17T22:57:21.651535] [INFO ] [MAIN ] Derivative Progress: 1618/2085 symbols completed. SB took 1.1s. Estimated remaining: 3m 2s. Rate: 154.2 symbols/min [2025-09-17T22:57:21.660044] [DEBUG] [LOCAL ] SARO: Derivative data saved (1794 records). [2025-09-17T22:57:21.672454] [INFO ] [MAIN ] SARO: Successfully saved derivative data. [2025-09-17T22:57:21.672769] [DEBUG] [MAIN ] SBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:21.675958] [INFO ] [MAIN ] Derivative Progress: 1619/2085 symbols completed. SARO took 1.2s. Estimated remaining: 3m 1s. Rate: 154.3 symbols/min [2025-09-17T22:57:21.673519] [INFO ] [MAIN ] SBH: Generated 1794 derivative records from 49807 primary records. [2025-09-17T22:57:21.676254] [DEBUG] [LOCAL ] SBH: Saving derivative data. [2025-09-17T22:57:21.691845] [DEBUG] [LOCAL ] SBH: Derivative data saved (1794 records). [2025-09-17T22:57:21.691906] [INFO ] [MAIN ] SBH: Successfully saved derivative data. [2025-09-17T22:57:21.694296] [INFO ] [MAIN ] Derivative Progress: 1620/2085 symbols completed. SBH took 1.1s. Estimated remaining: 3m 1s. Rate: 154.4 symbols/min [2025-09-17T22:57:21.694915] [INFO ] [MAIN ] SBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:21.695001] [INFO ] [MAIN ] SBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:21.695247] [INFO ] [MAIN ] SBR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:21.712491] [DEBUG] [LOCAL ] SBI: Loaded 7713 existing records from primary storage. [2025-09-17T22:57:21.712800] [DEBUG] [LOCAL ] SBR: Loaded 7257 existing records from primary storage. [2025-09-17T22:57:21.713064] [INFO ] [MAIN ] SBI: Loaded 7713 primary data records. [2025-09-17T22:57:21.713213] [INFO ] [MAIN ] SBR: Loaded 7257 primary data records. [2025-09-17T22:57:22.349259] [DEBUG] [LOCAL ] SBS: Loaded 49382 existing records from primary storage. [2025-09-17T22:57:22.349618] [INFO ] [MAIN ] SBS: Loaded 49382 primary data records. [2025-09-17T22:57:22.703813] [DEBUG] [MAIN ] SBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:22.705354] [DEBUG] [MAIN ] SBR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:22.706220] [INFO ] [MAIN ] SBR: Generated 1794 derivative records from 7257 primary records. [2025-09-17T22:57:22.706381] [INFO ] [MAIN ] SBI: Generated 1794 derivative records from 7713 primary records. [2025-09-17T22:57:22.706490] [DEBUG] [LOCAL ] SBR: Saving derivative data. [2025-09-17T22:57:22.706966] [DEBUG] [LOCAL ] SBI: Saving derivative data. [2025-09-17T22:57:22.740059] [DEBUG] [LOCAL ] SBI: Derivative data saved (1794 records). [2025-09-17T22:57:22.740240] [DEBUG] [LOCAL ] SBR: Derivative data saved (1794 records). [2025-09-17T22:57:22.740453] [INFO ] [MAIN ] SBR: Successfully saved derivative data. [2025-09-17T22:57:22.740583] [INFO ] [MAIN ] SBI: Successfully saved derivative data. [2025-09-17T22:57:22.742820] [INFO ] [MAIN ] Derivative Progress: 1621/2085 symbols completed. SBR took 1.0s. Estimated remaining: 3m 0s. Rate: 154.3 symbols/min [2025-09-17T22:57:22.746374] [INFO ] [MAIN ] Derivative Progress: 1622/2085 symbols completed. SBI took 1.1s. Estimated remaining: 2m 60s. Rate: 154.3 symbols/min [2025-09-17T22:57:22.746286] [INFO ] [MAIN ] SBSI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:22.747555] [INFO ] [MAIN ] SBSW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:22.762791] [DEBUG] [MAIN ] SBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:22.763408] [INFO ] [MAIN ] SBS: Generated 1794 derivative records from 49382 primary records. [2025-09-17T22:57:22.763468] [DEBUG] [LOCAL ] SBS: Saving derivative data. [2025-09-17T22:57:22.783237] [DEBUG] [LOCAL ] SBS: Derivative data saved (1794 records). [2025-09-17T22:57:22.783384] [INFO ] [MAIN ] SBS: Successfully saved derivative data. [2025-09-17T22:57:22.785955] [INFO ] [MAIN ] Derivative Progress: 1623/2085 symbols completed. SBS took 1.1s. Estimated remaining: 2m 59s. Rate: 154.4 symbols/min [2025-09-17T22:57:22.786325] [INFO ] [MAIN ] SCCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:22.793851] [DEBUG] [LOCAL ] SBSI: Loaded 14636 existing records from primary storage. [2025-09-17T22:57:22.794040] [INFO ] [MAIN ] SBSI: Loaded 14636 primary data records. [2025-09-17T22:57:23.188397] [DEBUG] [LOCAL ] SBSW: Loaded 52923 existing records from primary storage. [2025-09-17T22:57:23.188815] [INFO ] [MAIN ] SBSW: Loaded 52923 primary data records. [2025-09-17T22:57:23.307395] [DEBUG] [LOCAL ] SCCO: Loaded 49388 existing records from primary storage. [2025-09-17T22:57:23.311205] [INFO ] [MAIN ] SCCO: Loaded 49388 primary data records. [2025-09-17T22:57:23.846341] [DEBUG] [MAIN ] SBSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:23.848214] [INFO ] [MAIN ] SBSI: Generated 1794 derivative records from 14636 primary records. [2025-09-17T22:57:23.848420] [DEBUG] [LOCAL ] SBSI: Saving derivative data. [2025-09-17T22:57:23.873354] [DEBUG] [LOCAL ] SBSI: Derivative data saved (1794 records). [2025-09-17T22:57:23.873946] [INFO ] [MAIN ] SBSI: Successfully saved derivative data. [2025-09-17T22:57:23.878501] [INFO ] [MAIN ] Derivative Progress: 1624/2085 symbols completed. SBSI took 1.1s. Estimated remaining: 2m 59s. Rate: 154.3 symbols/min [2025-09-17T22:57:23.879237] [INFO ] [MAIN ] SCD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:23.894163] [DEBUG] [MAIN ] SBSW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:23.895218] [INFO ] [MAIN ] SBSW: Generated 1794 derivative records from 52923 primary records. [2025-09-17T22:57:23.895558] [DEBUG] [LOCAL ] SBSW: Saving derivative data. [2025-09-17T22:57:23.925198] [DEBUG] [LOCAL ] SCD: Loaded 12610 existing records from primary storage. [2025-09-17T22:57:23.924846] [DEBUG] [LOCAL ] SBSW: Derivative data saved (1794 records). [2025-09-17T22:57:23.925555] [INFO ] [MAIN ] SCD: Loaded 12610 primary data records. [2025-09-17T22:57:23.954575] [INFO ] [MAIN ] SBSW: Successfully saved derivative data. [2025-09-17T22:57:23.972971] [DEBUG] [MAIN ] SCCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:23.994530] [INFO ] [MAIN ] SCCO: Generated 1794 derivative records from 49388 primary records. [2025-09-17T22:57:23.980049] [INFO ] [MAIN ] Derivative Progress: 1625/2085 symbols completed. SBSW took 1.2s. Estimated remaining: 2m 59s. Rate: 154.3 symbols/min [2025-09-17T22:57:24.050691] [INFO ] [MAIN ] SCHW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:24.035382] [DEBUG] [LOCAL ] SCCO: Saving derivative data. [2025-09-17T22:57:24.271868] [DEBUG] [LOCAL ] SCCO: Derivative data saved (1794 records). [2025-09-17T22:57:24.272011] [INFO ] [MAIN ] SCCO: Successfully saved derivative data. [2025-09-17T22:57:24.274821] [INFO ] [MAIN ] Derivative Progress: 1626/2085 symbols completed. SCCO took 1.5s. Estimated remaining: 2m 58s. Rate: 154.4 symbols/min [2025-09-17T22:57:24.275350] [INFO ] [MAIN ] SCI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:24.319277] [DEBUG] [MAIN ] SCD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:24.320072] [INFO ] [MAIN ] SCD: Generated 1794 derivative records from 12610 primary records. [2025-09-17T22:57:24.320260] [DEBUG] [LOCAL ] SCD: Saving derivative data. [2025-09-17T22:57:24.347124] [DEBUG] [LOCAL ] SCD: Derivative data saved (1794 records). [2025-09-17T22:57:24.364589] [INFO ] [MAIN ] SCD: Successfully saved derivative data. [2025-09-17T22:57:24.368904] [INFO ] [MAIN ] Derivative Progress: 1627/2085 symbols completed. SCD took 0.5s. Estimated remaining: 2m 58s. Rate: 154.4 symbols/min [2025-09-17T22:57:24.370766] [DEBUG] [LOCAL ] SCHW: Loaded 53685 existing records from primary storage. [2025-09-17T22:57:24.370972] [INFO ] [MAIN ] SCHW: Loaded 53685 primary data records. [2025-09-17T22:57:24.371302] [INFO ] [MAIN ] SCL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:24.430133] [DEBUG] [LOCAL ] SCI: Loaded 46762 existing records from primary storage. [2025-09-17T22:57:24.457460] [INFO ] [MAIN ] SCI: Loaded 46762 primary data records. [2025-09-17T22:57:24.643931] [DEBUG] [LOCAL ] SCL: Loaded 14788 existing records from primary storage. [2025-09-17T22:57:24.682171] [INFO ] [MAIN ] SCL: Loaded 14788 primary data records. [2025-09-17T22:57:25.407058] [DEBUG] [MAIN ] SCHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:25.408060] [INFO ] [MAIN ] SCHW: Generated 1794 derivative records from 53685 primary records. [2025-09-17T22:57:25.408261] [DEBUG] [LOCAL ] SCHW: Saving derivative data. [2025-09-17T22:57:25.433861] [DEBUG] [MAIN ] SCI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:25.435444] [INFO ] [MAIN ] SCI: Generated 1794 derivative records from 46762 primary records. [2025-09-17T22:57:25.436623] [DEBUG] [LOCAL ] SCI: Saving derivative data. [2025-09-17T22:57:25.456242] [DEBUG] [LOCAL ] SCI: Derivative data saved (1794 records). [2025-09-17T22:57:25.456731] [INFO ] [MAIN ] SCI: Successfully saved derivative data. [2025-09-17T22:57:25.458866] [INFO ] [MAIN ] Derivative Progress: 1628/2085 symbols completed. SCI took 1.2s. Estimated remaining: 2m 58s. Rate: 154.3 symbols/min [2025-09-17T22:57:25.459996] [DEBUG] [LOCAL ] SCHW: Derivative data saved (1794 records). [2025-09-17T22:57:25.460159] [INFO ] [MAIN ] SCM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:25.460873] [INFO ] [MAIN ] SCHW: Successfully saved derivative data. [2025-09-17T22:57:25.464771] [INFO ] [MAIN ] Derivative Progress: 1629/2085 symbols completed. SCHW took 1.4s. Estimated remaining: 2m 57s. Rate: 154.3 symbols/min [2025-09-17T22:57:25.466137] [INFO ] [MAIN ] SCS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:25.481057] [DEBUG] [MAIN ] SCL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:25.481921] [INFO ] [MAIN ] SCL: Generated 1794 derivative records from 14788 primary records. [2025-09-17T22:57:25.482088] [DEBUG] [LOCAL ] SCL: Saving derivative data. [2025-09-17T22:57:25.507120] [DEBUG] [LOCAL ] SCL: Derivative data saved (1794 records). [2025-09-17T22:57:25.507298] [INFO ] [MAIN ] SCL: Successfully saved derivative data. [2025-09-17T22:57:25.509839] [INFO ] [MAIN ] Derivative Progress: 1630/2085 symbols completed. SCL took 1.1s. Estimated remaining: 2m 57s. Rate: 154.4 symbols/min [2025-09-17T22:57:25.510137] [INFO ] [MAIN ] SD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:25.520740] [DEBUG] [LOCAL ] SCM: Loaded 20182 existing records from primary storage. [2025-09-17T22:57:25.520987] [INFO ] [MAIN ] SCM: Loaded 20182 primary data records. [2025-09-17T22:57:25.687262] [DEBUG] [LOCAL ] SCS: Loaded 42799 existing records from primary storage. [2025-09-17T22:57:25.715676] [INFO ] [MAIN ] SCS: Loaded 42799 primary data records. [2025-09-17T22:57:25.873409] [DEBUG] [LOCAL ] SD: Loaded 29207 existing records from primary storage. [2025-09-17T22:57:25.908604] [INFO ] [MAIN ] SD: Loaded 29207 primary data records. [2025-09-17T22:57:26.504452] [DEBUG] [MAIN ] SCM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:26.505591] [INFO ] [MAIN ] SCM: Generated 1794 derivative records from 20182 primary records. [2025-09-17T22:57:26.507708] [DEBUG] [LOCAL ] SCM: Saving derivative data. [2025-09-17T22:57:26.527688] [DEBUG] [LOCAL ] SCM: Derivative data saved (1794 records). [2025-09-17T22:57:26.527836] [INFO ] [MAIN ] SCM: Successfully saved derivative data. [2025-09-17T22:57:26.530181] [INFO ] [MAIN ] Derivative Progress: 1631/2085 symbols completed. SCM took 1.1s. Estimated remaining: 2m 57s. Rate: 154.3 symbols/min [2025-09-17T22:57:26.538350] [INFO ] [MAIN ] SDHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:26.543535] [DEBUG] [MAIN ] SCS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:26.544521] [INFO ] [MAIN ] SCS: Generated 1794 derivative records from 42799 primary records. [2025-09-17T22:57:26.545392] [DEBUG] [LOCAL ] SCS: Saving derivative data. [2025-09-17T22:57:26.577921] [DEBUG] [MAIN ] SD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:26.577609] [DEBUG] [LOCAL ] SCS: Derivative data saved (1794 records). [2025-09-17T22:57:26.578725] [INFO ] [MAIN ] SD: Generated 1794 derivative records from 29207 primary records. [2025-09-17T22:57:26.578904] [INFO ] [MAIN ] SCS: Successfully saved derivative data. [2025-09-17T22:57:26.578847] [DEBUG] [LOCAL ] SD: Saving derivative data. [2025-09-17T22:57:26.581574] [INFO ] [MAIN ] Derivative Progress: 1632/2085 symbols completed. SCS took 1.1s. Estimated remaining: 2m 56s. Rate: 154.4 symbols/min [2025-09-17T22:57:26.594450] [DEBUG] [LOCAL ] SDHC: Loaded 10603 existing records from primary storage. [2025-09-17T22:57:26.597065] [INFO ] [MAIN ] SDHC: Loaded 10603 primary data records. [2025-09-17T22:57:26.594217] [INFO ] [MAIN ] SDHY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:26.681113] [DEBUG] [LOCAL ] SD: Derivative data saved (1794 records). [2025-09-17T22:57:26.712976] [DEBUG] [LOCAL ] SDHY: Loaded 10736 existing records from primary storage. [2025-09-17T22:57:26.713096] [INFO ] [MAIN ] SDHY: Loaded 10736 primary data records. [2025-09-17T22:57:26.713469] [INFO ] [MAIN ] SD: Successfully saved derivative data. [2025-09-17T22:57:26.797178] [INFO ] [MAIN ] Derivative Progress: 1633/2085 symbols completed. SD took 1.3s. Estimated remaining: 2m 56s. Rate: 154.4 symbols/min [2025-09-17T22:57:27.265917] [DEBUG] [MAIN ] SDHC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:57:27.266740] [INFO ] [MAIN ] SDHC: Generated 1793 derivative records from 10603 primary records. [2025-09-17T22:57:27.266826] [DEBUG] [LOCAL ] SDHC: Saving derivative data. [2025-09-17T22:57:27.297979] [DEBUG] [MAIN ] SDHY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:27.298869] [INFO ] [MAIN ] SDHY: Generated 1794 derivative records from 10736 primary records. [2025-09-17T22:57:27.297609] [DEBUG] [LOCAL ] SDHC: Derivative data saved (1793 records). [2025-09-17T22:57:27.299091] [INFO ] [MAIN ] SDHC: Successfully saved derivative data. [2025-09-17T22:57:27.301093] [INFO ] [MAIN ] Derivative Progress: 1634/2085 symbols completed. SDHC took 0.8s. Estimated remaining: 2m 55s. Rate: 154.4 symbols/min [2025-09-17T22:57:27.298969] [DEBUG] [LOCAL ] SDHY: Saving derivative data. [2025-09-17T22:57:27.316138] [DEBUG] [LOCAL ] SDHY: Derivative data saved (1794 records). [2025-09-17T22:57:27.316197] [INFO ] [MAIN ] SDHY: Successfully saved derivative data. [2025-09-17T22:57:27.318665] [INFO ] [MAIN ] Derivative Progress: 1635/2085 symbols completed. SDHY took 0.7s. Estimated remaining: 2m 55s. Rate: 154.5 symbols/min [2025-09-17T22:57:27.319293] [INFO ] [MAIN ] SEE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:27.319370] [INFO ] [MAIN ] SE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:27.319460] [INFO ] [MAIN ] SDRL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:27.390260] [DEBUG] [LOCAL ] SDRL: Loaded 42153 existing records from primary storage. [2025-09-17T22:57:27.406377] [INFO ] [MAIN ] SDRL: Loaded 42153 primary data records. [2025-09-17T22:57:27.419363] [DEBUG] [LOCAL ] SE: Loaded 53400 existing records from primary storage. [2025-09-17T22:57:27.481162] [DEBUG] [LOCAL ] SEE: Loaded 48471 existing records from primary storage. [2025-09-17T22:57:27.467416] [INFO ] [MAIN ] SE: Loaded 53400 primary data records. [2025-09-17T22:57:27.502630] [INFO ] [MAIN ] SEE: Loaded 48471 primary data records. [2025-09-17T22:57:28.403766] [DEBUG] [MAIN ] SDRL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:28.404730] [INFO ] [MAIN ] SDRL: Generated 1794 derivative records from 42153 primary records. [2025-09-17T22:57:28.405032] [DEBUG] [LOCAL ] SDRL: Saving derivative data. [2025-09-17T22:57:28.425848] [DEBUG] [LOCAL ] SDRL: Derivative data saved (1794 records). [2025-09-17T22:57:28.445863] [DEBUG] [MAIN ] SEE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:28.451411] [DEBUG] [MAIN ] SE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:28.451157] [INFO ] [MAIN ] SEE: Generated 1794 derivative records from 48471 primary records. [2025-09-17T22:57:28.438246] [INFO ] [MAIN ] SDRL: Successfully saved derivative data. [2025-09-17T22:57:28.453283] [INFO ] [MAIN ] Derivative Progress: 1636/2085 symbols completed. SDRL took 1.1s. Estimated remaining: 2m 55s. Rate: 154.3 symbols/min [2025-09-17T22:57:28.454045] [INFO ] [MAIN ] SE: Generated 1794 derivative records from 53400 primary records. [2025-09-17T22:57:28.454463] [DEBUG] [LOCAL ] SE: Saving derivative data. [2025-09-17T22:57:28.454111] [DEBUG] [LOCAL ] SEE: Saving derivative data. [2025-09-17T22:57:28.454353] [INFO ] [MAIN ] SEG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:28.482843] [DEBUG] [LOCAL ] SEE: Derivative data saved (1794 records). [2025-09-17T22:57:28.487191] [INFO ] [MAIN ] SEE: Successfully saved derivative data. [2025-09-17T22:57:28.489812] [INFO ] [MAIN ] Derivative Progress: 1637/2085 symbols completed. SEE took 1.2s. Estimated remaining: 2m 54s. Rate: 154.4 symbols/min [2025-09-17T22:57:28.493123] [DEBUG] [LOCAL ] SE: Derivative data saved (1794 records). [2025-09-17T22:57:28.493242] [INFO ] [MAIN ] SEI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:28.493758] [INFO ] [MAIN ] SE: Successfully saved derivative data. [2025-09-17T22:57:28.495953] [INFO ] [MAIN ] Derivative Progress: 1638/2085 symbols completed. SE took 1.2s. Estimated remaining: 2m 54s. Rate: 154.5 symbols/min [2025-09-17T22:57:28.502390] [DEBUG] [LOCAL ] SEG: Loaded 13948 existing records from primary storage. [2025-09-17T22:57:28.501685] [INFO ] [MAIN ] SEM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:28.502966] [INFO ] [MAIN ] SEG: Loaded 13948 primary data records. [2025-09-17T22:57:28.851924] [DEBUG] [LOCAL ] SEI: Loaded 49604 existing records from primary storage. [2025-09-17T22:57:28.852871] [INFO ] [MAIN ] SEI: Loaded 49604 primary data records. [2025-09-17T22:57:28.972729] [DEBUG] [LOCAL ] SEM: Loaded 43135 existing records from primary storage. [2025-09-17T22:57:28.983734] [INFO ] [MAIN ] SEM: Loaded 43135 primary data records. [2025-09-17T22:57:29.406034] [DEBUG] [MAIN ] SEG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:29.521874] [INFO ] [MAIN ] SEG: Generated 1794 derivative records from 13948 primary records. [2025-09-17T22:57:29.522134] [DEBUG] [LOCAL ] SEG: Saving derivative data. [2025-09-17T22:57:29.539375] [DEBUG] [LOCAL ] SEG: Derivative data saved (1794 records). [2025-09-17T22:57:29.540110] [INFO ] [MAIN ] SEG: Successfully saved derivative data. [2025-09-17T22:57:29.542355] [INFO ] [MAIN ] Derivative Progress: 1639/2085 symbols completed. SEG took 1.1s. Estimated remaining: 2m 53s. Rate: 154.3 symbols/min [2025-09-17T22:57:29.543005] [INFO ] [MAIN ] SEMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:29.562264] [DEBUG] [MAIN ] SEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:29.563028] [INFO ] [MAIN ] SEI: Generated 1794 derivative records from 49604 primary records. [2025-09-17T22:57:29.563222] [DEBUG] [LOCAL ] SEI: Saving derivative data. [2025-09-17T22:57:29.582046] [DEBUG] [LOCAL ] SEI: Derivative data saved (1794 records). [2025-09-17T22:57:29.582213] [INFO ] [MAIN ] SEI: Successfully saved derivative data. [2025-09-17T22:57:29.584034] [INFO ] [MAIN ] Derivative Progress: 1640/2085 symbols completed. SEI took 1.1s. Estimated remaining: 2m 53s. Rate: 154.4 symbols/min [2025-09-17T22:57:29.584597] [INFO ] [MAIN ] SES: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:29.607302] [DEBUG] [MAIN ] SEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:29.607983] [INFO ] [MAIN ] SEM: Generated 1794 derivative records from 43135 primary records. [2025-09-17T22:57:29.608106] [DEBUG] [LOCAL ] SEM: Saving derivative data. [2025-09-17T22:57:29.636283] [DEBUG] [LOCAL ] SEM: Derivative data saved (1794 records). [2025-09-17T22:57:29.636402] [INFO ] [MAIN ] SEM: Successfully saved derivative data. [2025-09-17T22:57:29.637068] [DEBUG] [LOCAL ] SEMR: Loaded 41753 existing records from primary storage. [2025-09-17T22:57:29.639703] [INFO ] [MAIN ] Derivative Progress: 1641/2085 symbols completed. SEM took 1.1s. Estimated remaining: 2m 52s. Rate: 154.5 symbols/min [2025-09-17T22:57:29.639917] [INFO ] [MAIN ] SEMR: Loaded 41753 primary data records. [2025-09-17T22:57:29.640194] [INFO ] [MAIN ] SF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:29.977632] [DEBUG] [LOCAL ] SES: Loaded 51517 existing records from primary storage. [2025-09-17T22:57:29.978551] [INFO ] [MAIN ] SES: Loaded 51517 primary data records. [2025-09-17T22:57:30.098684] [DEBUG] [LOCAL ] SF: Loaded 41953 existing records from primary storage. [2025-09-17T22:57:30.110418] [INFO ] [MAIN ] SF: Loaded 41953 primary data records. [2025-09-17T22:57:30.612567] [DEBUG] [MAIN ] SEMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:30.613910] [INFO ] [MAIN ] SEMR: Generated 1794 derivative records from 41753 primary records. [2025-09-17T22:57:30.614305] [DEBUG] [LOCAL ] SEMR: Saving derivative data. [2025-09-17T22:57:30.648875] [DEBUG] [MAIN ] SES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:30.648209] [DEBUG] [LOCAL ] SEMR: Derivative data saved (1794 records). [2025-09-17T22:57:30.649046] [INFO ] [MAIN ] SEMR: Successfully saved derivative data. [2025-09-17T22:57:30.649797] [INFO ] [MAIN ] SES: Generated 1794 derivative records from 51517 primary records. [2025-09-17T22:57:30.649977] [DEBUG] [LOCAL ] SES: Saving derivative data. [2025-09-17T22:57:30.653778] [INFO ] [MAIN ] Derivative Progress: 1642/2085 symbols completed. SEMR took 1.1s. Estimated remaining: 2m 52s. Rate: 154.3 symbols/min [2025-09-17T22:57:30.655041] [INFO ] [MAIN ] SFB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:30.677416] [DEBUG] [LOCAL ] SFB: Loaded 4084 existing records from primary storage. [2025-09-17T22:57:30.685504] [INFO ] [MAIN ] SFB: Loaded 4084 primary data records. [2025-09-17T22:57:30.711979] [DEBUG] [LOCAL ] SES: Derivative data saved (1794 records). [2025-09-17T22:57:30.712088] [INFO ] [MAIN ] SES: Successfully saved derivative data. [2025-09-17T22:57:30.722886] [DEBUG] [MAIN ] SF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:30.737572] [INFO ] [MAIN ] Derivative Progress: 1643/2085 symbols completed. SES took 1.2s. Estimated remaining: 2m 52s. Rate: 154.4 symbols/min [2025-09-17T22:57:30.728791] [INFO ] [MAIN ] SF: Generated 1794 derivative records from 41953 primary records. [2025-09-17T22:57:30.763389] [INFO ] [MAIN ] SFBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:30.772797] [DEBUG] [LOCAL ] SF: Saving derivative data. [2025-09-17T22:57:30.838750] [DEBUG] [LOCAL ] SF: Derivative data saved (1794 records). [2025-09-17T22:57:30.844000] [INFO ] [MAIN ] SF: Successfully saved derivative data. [2025-09-17T22:57:30.860734] [INFO ] [MAIN ] Derivative Progress: 1644/2085 symbols completed. SF took 1.2s. Estimated remaining: 2m 51s. Rate: 154.5 symbols/min [2025-09-17T22:57:30.895247] [INFO ] [MAIN ] SFL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:31.036356] [DEBUG] [LOCAL ] SFBS: Loaded 21357 existing records from primary storage. [2025-09-17T22:57:31.037287] [INFO ] [MAIN ] SFBS: Loaded 21357 primary data records. [2025-09-17T22:57:31.413301] [DEBUG] [LOCAL ] SFL: Loaded 45499 existing records from primary storage. [2025-09-17T22:57:31.414305] [INFO ] [MAIN ] SFL: Loaded 45499 primary data records. [2025-09-17T22:57:31.538883] [DEBUG] [MAIN ] SFB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:31.551484] [INFO ] [MAIN ] SFB: Generated 1794 derivative records from 4084 primary records. [2025-09-17T22:57:31.551716] [DEBUG] [LOCAL ] SFB: Saving derivative data. [2025-09-17T22:57:31.743164] [DEBUG] [LOCAL ] SFB: Derivative data saved (1794 records). [2025-09-17T22:57:31.751907] [INFO ] [MAIN ] SFB: Successfully saved derivative data. [2025-09-17T22:57:31.754234] [INFO ] [MAIN ] Derivative Progress: 1645/2085 symbols completed. SFB took 1.1s. Estimated remaining: 2m 51s. Rate: 154.3 symbols/min [2025-09-17T22:57:31.754952] [INFO ] [MAIN ] SG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:31.775544] [DEBUG] [MAIN ] SFBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:31.777088] [INFO ] [MAIN ] SFBS: Generated 1794 derivative records from 21357 primary records. [2025-09-17T22:57:31.777287] [DEBUG] [LOCAL ] SFBS: Saving derivative data. [2025-09-17T22:57:31.798976] [DEBUG] [LOCAL ] SFBS: Derivative data saved (1794 records). [2025-09-17T22:57:31.799270] [INFO ] [MAIN ] SFBS: Successfully saved derivative data. [2025-09-17T22:57:31.815581] [INFO ] [MAIN ] Derivative Progress: 1646/2085 symbols completed. SFBS took 1.1s. Estimated remaining: 2m 51s. Rate: 154.4 symbols/min [2025-09-17T22:57:31.817528] [INFO ] [MAIN ] SGHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:31.835331] [DEBUG] [MAIN ] SFL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:31.851371] [INFO ] [MAIN ] SFL: Generated 1794 derivative records from 45499 primary records. [2025-09-17T22:57:31.852777] [DEBUG] [LOCAL ] SG: Loaded 53460 existing records from primary storage. [2025-09-17T22:57:31.853032] [INFO ] [MAIN ] SG: Loaded 53460 primary data records. [2025-09-17T22:57:31.853218] [DEBUG] [LOCAL ] SFL: Saving derivative data. [2025-09-17T22:57:32.044695] [DEBUG] [LOCAL ] SFL: Derivative data saved (1794 records). [2025-09-17T22:57:32.079579] [INFO ] [MAIN ] SFL: Successfully saved derivative data. [2025-09-17T22:57:32.194906] [INFO ] [MAIN ] Derivative Progress: 1647/2085 symbols completed. SFL took 1.3s. Estimated remaining: 2m 50s. Rate: 154.4 symbols/min [2025-09-17T22:57:32.197229] [INFO ] [MAIN ] SGU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:32.197000] [DEBUG] [LOCAL ] SGHC: Loaded 45384 existing records from primary storage. [2025-09-17T22:57:32.197712] [INFO ] [MAIN ] SGHC: Loaded 45384 primary data records. [2025-09-17T22:57:32.313149] [DEBUG] [LOCAL ] SGU: Loaded 6642 existing records from primary storage. [2025-09-17T22:57:32.326636] [INFO ] [MAIN ] SGU: Loaded 6642 primary data records. [2025-09-17T22:57:32.894163] [DEBUG] [MAIN ] SG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:32.896112] [INFO ] [MAIN ] SG: Generated 1794 derivative records from 53460 primary records. [2025-09-17T22:57:32.896868] [DEBUG] [LOCAL ] SG: Saving derivative data. [2025-09-17T22:57:32.917480] [DEBUG] [LOCAL ] SG: Derivative data saved (1794 records). [2025-09-17T22:57:32.917622] [INFO ] [MAIN ] SG: Successfully saved derivative data. [2025-09-17T22:57:32.920845] [INFO ] [MAIN ] Derivative Progress: 1648/2085 symbols completed. SG took 1.2s. Estimated remaining: 2m 50s. Rate: 154.3 symbols/min [2025-09-17T22:57:32.940956] [DEBUG] [MAIN ] SGHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:32.942574] [INFO ] [MAIN ] SGHC: Generated 1794 derivative records from 45384 primary records. [2025-09-17T22:57:32.943437] [DEBUG] [LOCAL ] SGHC: Saving derivative data. [2025-09-17T22:57:32.957839] [DEBUG] [MAIN ] SGU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:32.971278] [INFO ] [MAIN ] SGU: Generated 1794 derivative records from 6642 primary records. [2025-09-17T22:57:32.973502] [DEBUG] [LOCAL ] SGU: Saving derivative data. [2025-09-17T22:57:32.973433] [DEBUG] [LOCAL ] SGHC: Derivative data saved (1794 records). [2025-09-17T22:57:32.974285] [INFO ] [MAIN ] SGHC: Successfully saved derivative data. [2025-09-17T22:57:32.976623] [INFO ] [MAIN ] Derivative Progress: 1649/2085 symbols completed. SGHC took 1.2s. Estimated remaining: 2m 49s. Rate: 154.4 symbols/min [2025-09-17T22:57:32.991085] [DEBUG] [LOCAL ] SGU: Derivative data saved (1794 records). [2025-09-17T22:57:32.991170] [INFO ] [MAIN ] SGU: Successfully saved derivative data. [2025-09-17T22:57:32.993172] [INFO ] [MAIN ] Derivative Progress: 1650/2085 symbols completed. SGU took 0.8s. Estimated remaining: 2m 49s. Rate: 154.5 symbols/min [2025-09-17T22:57:32.993752] [INFO ] [MAIN ] SHAK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:32.993826] [INFO ] [MAIN ] SHEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:32.994515] [INFO ] [MAIN ] SHCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:33.022544] [DEBUG] [LOCAL ] SHCO: Loaded 26315 existing records from primary storage. [2025-09-17T22:57:33.022701] [INFO ] [MAIN ] SHCO: Loaded 26315 primary data records. [2025-09-17T22:57:33.400394] [DEBUG] [LOCAL ] SHEL: Loaded 53672 existing records from primary storage. [2025-09-17T22:57:33.400684] [INFO ] [MAIN ] SHEL: Loaded 53672 primary data records. [2025-09-17T22:57:33.401434] [DEBUG] [LOCAL ] SHAK: Loaded 49214 existing records from primary storage. [2025-09-17T22:57:33.423943] [INFO ] [MAIN ] SHAK: Loaded 49214 primary data records. [2025-09-17T22:57:34.045136] [DEBUG] [MAIN ] SHCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:34.046546] [INFO ] [MAIN ] SHCO: Generated 1794 derivative records from 26315 primary records. [2025-09-17T22:57:34.046678] [DEBUG] [LOCAL ] SHCO: Saving derivative data. [2025-09-17T22:57:34.066373] [DEBUG] [LOCAL ] SHCO: Derivative data saved (1794 records). [2025-09-17T22:57:34.066802] [INFO ] [MAIN ] SHCO: Successfully saved derivative data. [2025-09-17T22:57:34.069498] [INFO ] [MAIN ] Derivative Progress: 1651/2085 symbols completed. SHCO took 1.1s. Estimated remaining: 2m 49s. Rate: 154.3 symbols/min [2025-09-17T22:57:34.070499] [INFO ] [MAIN ] SHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:34.091947] [DEBUG] [MAIN ] SHEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:34.093517] [INFO ] [MAIN ] SHEL: Generated 1794 derivative records from 53672 primary records. [2025-09-17T22:57:34.093787] [DEBUG] [LOCAL ] SHEL: Saving derivative data. [2025-09-17T22:57:34.129263] [DEBUG] [MAIN ] SHAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:34.133751] [INFO ] [MAIN ] SHAK: Generated 1794 derivative records from 49214 primary records. [2025-09-17T22:57:34.134258] [DEBUG] [LOCAL ] SHAK: Saving derivative data. [2025-09-17T22:57:34.136599] [DEBUG] [LOCAL ] SHEL: Derivative data saved (1794 records). [2025-09-17T22:57:34.155822] [INFO ] [MAIN ] SHEL: Successfully saved derivative data. [2025-09-17T22:57:34.162506] [INFO ] [MAIN ] Derivative Progress: 1652/2085 symbols completed. SHEL took 1.2s. Estimated remaining: 2m 48s. Rate: 154.4 symbols/min [2025-09-17T22:57:34.165424] [DEBUG] [LOCAL ] SHAK: Derivative data saved (1794 records). [2025-09-17T22:57:34.166545] [DEBUG] [LOCAL ] SHG: Loaded 27665 existing records from primary storage. [2025-09-17T22:57:34.166708] [INFO ] [MAIN ] SHAK: Successfully saved derivative data. [2025-09-17T22:57:34.169241] [INFO ] [MAIN ] Derivative Progress: 1653/2085 symbols completed. SHAK took 1.2s. Estimated remaining: 2m 48s. Rate: 154.5 symbols/min [2025-09-17T22:57:34.169465] [INFO ] [MAIN ] SHG: Loaded 27665 primary data records. [2025-09-17T22:57:34.169753] [INFO ] [MAIN ] SHOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:34.169373] [INFO ] [MAIN ] SHO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:34.261728] [DEBUG] [LOCAL ] SHOC: Loaded 4202 existing records from primary storage. [2025-09-17T22:57:34.274823] [INFO ] [MAIN ] SHOC: Loaded 4202 primary data records. [2025-09-17T22:57:34.847714] [DEBUG] [LOCAL ] SHO: Loaded 49859 existing records from primary storage. [2025-09-17T22:57:34.848403] [INFO ] [MAIN ] SHO: Loaded 49859 primary data records. [2025-09-17T22:57:35.230795] [DEBUG] [MAIN ] SHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:35.232027] [INFO ] [MAIN ] SHG: Generated 1794 derivative records from 27665 primary records. [2025-09-17T22:57:35.232230] [DEBUG] [LOCAL ] SHG: Saving derivative data. [2025-09-17T22:57:35.253672] [DEBUG] [LOCAL ] SHG: Derivative data saved (1794 records). [2025-09-17T22:57:35.254010] [INFO ] [MAIN ] SHG: Successfully saved derivative data. [2025-09-17T22:57:35.256522] [INFO ] [MAIN ] Derivative Progress: 1654/2085 symbols completed. SHG took 1.2s. Estimated remaining: 2m 48s. Rate: 154.3 symbols/min [2025-09-17T22:57:35.270711] [DEBUG] [MAIN ] SHOC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:57:35.271042] [INFO ] [MAIN ] SHW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:35.272171] [INFO ] [MAIN ] SHOC: Generated 1793 derivative records from 4202 primary records. [2025-09-17T22:57:35.272355] [DEBUG] [LOCAL ] SHOC: Saving derivative data. [2025-09-17T22:57:35.291256] [DEBUG] [LOCAL ] SHOC: Derivative data saved (1793 records). [2025-09-17T22:57:35.291465] [INFO ] [MAIN ] SHOC: Successfully saved derivative data. [2025-09-17T22:57:35.294013] [INFO ] [MAIN ] Derivative Progress: 1655/2085 symbols completed. SHOC took 1.1s. Estimated remaining: 2m 47s. Rate: 154.4 symbols/min [2025-09-17T22:57:35.294756] [INFO ] [MAIN ] SID: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:35.312522] [DEBUG] [MAIN ] SHO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:35.313349] [INFO ] [MAIN ] SHO: Generated 1794 derivative records from 49859 primary records. [2025-09-17T22:57:35.313485] [DEBUG] [LOCAL ] SHO: Saving derivative data. [2025-09-17T22:57:35.329543] [DEBUG] [LOCAL ] SHO: Derivative data saved (1794 records). [2025-09-17T22:57:35.329614] [INFO ] [MAIN ] SHO: Successfully saved derivative data. [2025-09-17T22:57:35.331486] [INFO ] [MAIN ] Derivative Progress: 1656/2085 symbols completed. SHO took 1.2s. Estimated remaining: 2m 47s. Rate: 154.5 symbols/min [2025-09-17T22:57:35.331854] [INFO ] [MAIN ] SIG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:35.391320] [DEBUG] [LOCAL ] SHW: Loaded 50526 existing records from primary storage. [2025-09-17T22:57:35.392728] [INFO ] [MAIN ] SHW: Loaded 50526 primary data records. [2025-09-17T22:57:35.392566] [DEBUG] [LOCAL ] SID: Loaded 42163 existing records from primary storage. [2025-09-17T22:57:35.398176] [INFO ] [MAIN ] SID: Loaded 42163 primary data records. [2025-09-17T22:57:35.755202] [DEBUG] [LOCAL ] SIG: Loaded 46750 existing records from primary storage. [2025-09-17T22:57:35.875410] [INFO ] [MAIN ] SIG: Loaded 46750 primary data records. [2025-09-17T22:57:36.429038] [DEBUG] [MAIN ] SID: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:36.429788] [DEBUG] [MAIN ] SHW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:36.430697] [INFO ] [MAIN ] SID: Generated 1794 derivative records from 42163 primary records. [2025-09-17T22:57:36.431590] [INFO ] [MAIN ] SHW: Generated 1794 derivative records from 50526 primary records. [2025-09-17T22:57:36.431881] [DEBUG] [LOCAL ] SID: Saving derivative data. [2025-09-17T22:57:36.431961] [DEBUG] [LOCAL ] SHW: Saving derivative data. [2025-09-17T22:57:36.462222] [DEBUG] [LOCAL ] SID: Derivative data saved (1794 records). [2025-09-17T22:57:36.462462] [INFO ] [MAIN ] SID: Successfully saved derivative data. [2025-09-17T22:57:36.469255] [INFO ] [MAIN ] Derivative Progress: 1657/2085 symbols completed. SID took 1.2s. Estimated remaining: 2m 46s. Rate: 154.3 symbols/min [2025-09-17T22:57:36.470632] [INFO ] [MAIN ] SII: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:36.471358] [DEBUG] [LOCAL ] SHW: Derivative data saved (1794 records). [2025-09-17T22:57:36.471677] [INFO ] [MAIN ] SHW: Successfully saved derivative data. [2025-09-17T22:57:36.473893] [INFO ] [MAIN ] Derivative Progress: 1658/2085 symbols completed. SHW took 1.2s. Estimated remaining: 2m 46s. Rate: 154.4 symbols/min [2025-09-17T22:57:36.475388] [INFO ] [MAIN ] SILA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:36.490927] [DEBUG] [MAIN ] SIG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:36.491752] [INFO ] [MAIN ] SIG: Generated 1794 derivative records from 46750 primary records. [2025-09-17T22:57:36.491872] [DEBUG] [LOCAL ] SIG: Saving derivative data. [2025-09-17T22:57:36.513489] [DEBUG] [LOCAL ] SIG: Derivative data saved (1794 records). [2025-09-17T22:57:36.513590] [INFO ] [MAIN ] SIG: Successfully saved derivative data. [2025-09-17T22:57:36.516195] [INFO ] [MAIN ] Derivative Progress: 1659/2085 symbols completed. SIG took 1.2s. Estimated remaining: 2m 45s. Rate: 154.5 symbols/min [2025-09-17T22:57:36.516624] [INFO ] [MAIN ] SITC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:36.526675] [DEBUG] [LOCAL ] SII: Loaded 22961 existing records from primary storage. [2025-09-17T22:57:36.527914] [INFO ] [MAIN ] SII: Loaded 22961 primary data records. [2025-09-17T22:57:36.681833] [DEBUG] [LOCAL ] SILA: Loaded 31283 existing records from primary storage. [2025-09-17T22:57:36.701120] [INFO ] [MAIN ] SILA: Loaded 31283 primary data records. [2025-09-17T22:57:36.936195] [DEBUG] [LOCAL ] SITC: Loaded 41624 existing records from primary storage. [2025-09-17T22:57:36.950152] [INFO ] [MAIN ] SITC: Loaded 41624 primary data records. [2025-09-17T22:57:37.586359] [DEBUG] [MAIN ] SII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:37.587466] [INFO ] [MAIN ] SII: Generated 1794 derivative records from 22961 primary records. [2025-09-17T22:57:37.587729] [DEBUG] [LOCAL ] SII: Saving derivative data. [2025-09-17T22:57:37.606781] [DEBUG] [LOCAL ] SII: Derivative data saved (1794 records). [2025-09-17T22:57:37.607242] [INFO ] [MAIN ] SII: Successfully saved derivative data. [2025-09-17T22:57:37.609531] [INFO ] [MAIN ] Derivative Progress: 1660/2085 symbols completed. SII took 1.1s. Estimated remaining: 2m 45s. Rate: 154.3 symbols/min [2025-09-17T22:57:37.610172] [INFO ] [MAIN ] SITE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:37.632247] [DEBUG] [MAIN ] SITC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:37.646262] [INFO ] [MAIN ] SITC: Generated 1794 derivative records from 41624 primary records. [2025-09-17T22:57:37.647108] [DEBUG] [MAIN ] SILA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:37.647240] [DEBUG] [LOCAL ] SITC: Saving derivative data. [2025-09-17T22:57:37.650259] [INFO ] [MAIN ] SILA: Generated 1794 derivative records from 31283 primary records. [2025-09-17T22:57:37.651015] [DEBUG] [LOCAL ] SILA: Saving derivative data. [2025-09-17T22:57:37.677866] [DEBUG] [LOCAL ] SITC: Derivative data saved (1794 records). [2025-09-17T22:57:37.691605] [INFO ] [MAIN ] SITC: Successfully saved derivative data. [2025-09-17T22:57:37.694346] [INFO ] [MAIN ] Derivative Progress: 1661/2085 symbols completed. SITC took 1.2s. Estimated remaining: 2m 45s. Rate: 154.4 symbols/min [2025-09-17T22:57:37.695519] [INFO ] [MAIN ] SJM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:37.696918] [DEBUG] [LOCAL ] SILA: Derivative data saved (1794 records). [2025-09-17T22:57:37.697007] [INFO ] [MAIN ] SILA: Successfully saved derivative data. [2025-09-17T22:57:37.699676] [INFO ] [MAIN ] Derivative Progress: 1662/2085 symbols completed. SILA took 1.2s. Estimated remaining: 2m 44s. Rate: 154.5 symbols/min [2025-09-17T22:57:37.700135] [INFO ] [MAIN ] SJT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:37.712329] [DEBUG] [LOCAL ] SITE: Loaded 35327 existing records from primary storage. [2025-09-17T22:57:37.712690] [INFO ] [MAIN ] SITE: Loaded 35327 primary data records. [2025-09-17T22:57:37.881548] [DEBUG] [LOCAL ] SJT: Loaded 22207 existing records from primary storage. [2025-09-17T22:57:37.921785] [INFO ] [MAIN ] SJT: Loaded 22207 primary data records. [2025-09-17T22:57:38.169119] [DEBUG] [LOCAL ] SJM: Loaded 50122 existing records from primary storage. [2025-09-17T22:57:38.195450] [INFO ] [MAIN ] SJM: Loaded 50122 primary data records. [2025-09-17T22:57:38.689493] [DEBUG] [MAIN ] SITE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:38.690588] [INFO ] [MAIN ] SITE: Generated 1794 derivative records from 35327 primary records. [2025-09-17T22:57:38.691591] [DEBUG] [LOCAL ] SITE: Saving derivative data. [2025-09-17T22:57:38.710669] [DEBUG] [LOCAL ] SITE: Derivative data saved (1794 records). [2025-09-17T22:57:38.711116] [INFO ] [MAIN ] SITE: Successfully saved derivative data. [2025-09-17T22:57:38.713670] [INFO ] [MAIN ] Derivative Progress: 1663/2085 symbols completed. SITE took 1.1s. Estimated remaining: 2m 44s. Rate: 154.3 symbols/min [2025-09-17T22:57:38.731361] [DEBUG] [MAIN ] SJT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:38.732355] [INFO ] [MAIN ] SJT: Generated 1794 derivative records from 22207 primary records. [2025-09-17T22:57:38.732502] [DEBUG] [LOCAL ] SJT: Saving derivative data. [2025-09-17T22:57:38.762620] [DEBUG] [MAIN ] SJM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:38.764634] [DEBUG] [LOCAL ] SJT: Derivative data saved (1794 records). [2025-09-17T22:57:38.764060] [INFO ] [MAIN ] SJM: Generated 1794 derivative records from 50122 primary records. [2025-09-17T22:57:38.764753] [DEBUG] [LOCAL ] SJM: Saving derivative data. [2025-09-17T22:57:38.764813] [INFO ] [MAIN ] SJT: Successfully saved derivative data. [2025-09-17T22:57:38.767260] [INFO ] [MAIN ] Derivative Progress: 1664/2085 symbols completed. SJT took 1.1s. Estimated remaining: 2m 44s. Rate: 154.4 symbols/min [2025-09-17T22:57:38.783092] [DEBUG] [LOCAL ] SJM: Derivative data saved (1794 records). [2025-09-17T22:57:38.783158] [INFO ] [MAIN ] SJM: Successfully saved derivative data. [2025-09-17T22:57:38.785971] [INFO ] [MAIN ] Derivative Progress: 1665/2085 symbols completed. SJM took 1.1s. Estimated remaining: 2m 43s. Rate: 154.5 symbols/min [2025-09-17T22:57:38.786741] [INFO ] [MAIN ] SKE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:38.786572] [INFO ] [MAIN ] SKIL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:38.786815] [INFO ] [MAIN ] SKLZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:38.796467] [DEBUG] [LOCAL ] SKIL: Loaded 6376 existing records from primary storage. [2025-09-17T22:57:38.796709] [INFO ] [MAIN ] SKIL: Loaded 6376 primary data records. [2025-09-17T22:57:38.900700] [DEBUG] [LOCAL ] SKLZ: Loaded 12034 existing records from primary storage. [2025-09-17T22:57:38.914160] [INFO ] [MAIN ] SKLZ: Loaded 12034 primary data records. [2025-09-17T22:57:39.113806] [DEBUG] [LOCAL ] SKE: Loaded 35274 existing records from primary storage. [2025-09-17T22:57:39.114038] [INFO ] [MAIN ] SKE: Loaded 35274 primary data records. [2025-09-17T22:57:39.799339] [DEBUG] [MAIN ] SKIL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:39.801161] [INFO ] [MAIN ] SKIL: Generated 1794 derivative records from 6376 primary records. [2025-09-17T22:57:39.801488] [DEBUG] [LOCAL ] SKIL: Saving derivative data. [2025-09-17T22:57:39.827929] [DEBUG] [LOCAL ] SKIL: Derivative data saved (1794 records). [2025-09-17T22:57:39.832898] [INFO ] [MAIN ] SKIL: Successfully saved derivative data. [2025-09-17T22:57:39.835418] [INFO ] [MAIN ] Derivative Progress: 1666/2085 symbols completed. SKIL took 1.0s. Estimated remaining: 2m 43s. Rate: 154.4 symbols/min [2025-09-17T22:57:39.833373] [DEBUG] [MAIN ] SKLZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:39.836244] [INFO ] [MAIN ] SKM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:39.837045] [INFO ] [MAIN ] SKLZ: Generated 1794 derivative records from 12034 primary records. [2025-09-17T22:57:39.837285] [DEBUG] [LOCAL ] SKLZ: Saving derivative data. [2025-09-17T22:57:39.856234] [DEBUG] [LOCAL ] SKLZ: Derivative data saved (1794 records). [2025-09-17T22:57:39.856514] [INFO ] [MAIN ] SKLZ: Successfully saved derivative data. [2025-09-17T22:57:39.859092] [INFO ] [MAIN ] Derivative Progress: 1667/2085 symbols completed. SKLZ took 1.1s. Estimated remaining: 2m 42s. Rate: 154.4 symbols/min [2025-09-17T22:57:39.871436] [INFO ] [MAIN ] SKT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:39.872141] [DEBUG] [MAIN ] SKE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:39.873279] [INFO ] [MAIN ] SKE: Generated 1794 derivative records from 35274 primary records. [2025-09-17T22:57:39.873449] [DEBUG] [LOCAL ] SKE: Saving derivative data. [2025-09-17T22:57:39.891570] [DEBUG] [LOCAL ] SKE: Derivative data saved (1794 records). [2025-09-17T22:57:39.899982] [INFO ] [MAIN ] SKE: Successfully saved derivative data. [2025-09-17T22:57:39.902410] [INFO ] [MAIN ] Derivative Progress: 1668/2085 symbols completed. SKE took 1.1s. Estimated remaining: 2m 42s. Rate: 154.5 symbols/min [2025-09-17T22:57:39.902853] [INFO ] [MAIN ] SKY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:39.920258] [DEBUG] [LOCAL ] SKM: Loaded 35400 existing records from primary storage. [2025-09-17T22:57:39.920482] [INFO ] [MAIN ] SKM: Loaded 35400 primary data records. [2025-09-17T22:57:40.114861] [DEBUG] [LOCAL ] SKT: Loaded 42554 existing records from primary storage. [2025-09-17T22:57:40.136633] [INFO ] [MAIN ] SKT: Loaded 42554 primary data records. [2025-09-17T22:57:40.302199] [DEBUG] [LOCAL ] SKY: Loaded 37604 existing records from primary storage. [2025-09-17T22:57:40.348206] [INFO ] [MAIN ] SKY: Loaded 37604 primary data records. [2025-09-17T22:57:40.932763] [DEBUG] [MAIN ] SKM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:40.934080] [INFO ] [MAIN ] SKM: Generated 1794 derivative records from 35400 primary records. [2025-09-17T22:57:40.934680] [DEBUG] [LOCAL ] SKM: Saving derivative data. [2025-09-17T22:57:40.956246] [DEBUG] [LOCAL ] SKM: Derivative data saved (1794 records). [2025-09-17T22:57:40.958288] [INFO ] [MAIN ] SKM: Successfully saved derivative data. [2025-09-17T22:57:40.960844] [INFO ] [MAIN ] Derivative Progress: 1669/2085 symbols completed. SKM took 1.1s. Estimated remaining: 2m 42s. Rate: 154.4 symbols/min [2025-09-17T22:57:40.961459] [INFO ] [MAIN ] SKYH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:40.975110] [DEBUG] [MAIN ] SKT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:40.975960] [INFO ] [MAIN ] SKT: Generated 1794 derivative records from 42554 primary records. [2025-09-17T22:57:40.976106] [DEBUG] [LOCAL ] SKT: Saving derivative data. [2025-09-17T22:57:41.011047] [DEBUG] [MAIN ] SKY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:41.012456] [INFO ] [MAIN ] SKY: Generated 1794 derivative records from 37604 primary records. [2025-09-17T22:57:41.012854] [DEBUG] [LOCAL ] SKY: Saving derivative data. [2025-09-17T22:57:41.021166] [DEBUG] [LOCAL ] SKYH: Loaded 16561 existing records from primary storage. [2025-09-17T22:57:41.021677] [DEBUG] [LOCAL ] SKT: Derivative data saved (1794 records). [2025-09-17T22:57:41.029293] [INFO ] [MAIN ] SKYH: Loaded 16561 primary data records. [2025-09-17T22:57:41.029688] [INFO ] [MAIN ] SKT: Successfully saved derivative data. [2025-09-17T22:57:41.048221] [INFO ] [MAIN ] Derivative Progress: 1670/2085 symbols completed. SKT took 1.2s. Estimated remaining: 2m 41s. Rate: 154.4 symbols/min [2025-09-17T22:57:41.060240] [INFO ] [MAIN ] SLB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:41.078951] [DEBUG] [LOCAL ] SKY: Derivative data saved (1794 records). [2025-09-17T22:57:41.091946] [INFO ] [MAIN ] SKY: Successfully saved derivative data. [2025-09-17T22:57:41.118199] [INFO ] [MAIN ] Derivative Progress: 1671/2085 symbols completed. SKY took 1.2s. Estimated remaining: 2m 41s. Rate: 154.5 symbols/min [2025-09-17T22:57:41.130228] [INFO ] [MAIN ] SLF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:41.427245] [DEBUG] [LOCAL ] SLF: Loaded 39345 existing records from primary storage. [2025-09-17T22:57:41.427694] [INFO ] [MAIN ] SLF: Loaded 39345 primary data records. [2025-09-17T22:57:41.553716] [DEBUG] [LOCAL ] SLB: Loaded 53697 existing records from primary storage. [2025-09-17T22:57:41.564744] [INFO ] [MAIN ] SLB: Loaded 53697 primary data records. [2025-09-17T22:57:41.690272] [DEBUG] [MAIN ] SKYH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:41.729843] [INFO ] [MAIN ] SKYH: Generated 1794 derivative records from 16561 primary records. [2025-09-17T22:57:41.856292] [DEBUG] [LOCAL ] SKYH: Saving derivative data. [2025-09-17T22:57:41.968938] [DEBUG] [LOCAL ] SKYH: Derivative data saved (1794 records). [2025-09-17T22:57:41.969124] [INFO ] [MAIN ] SKYH: Successfully saved derivative data. [2025-09-17T22:57:42.093254] [INFO ] [MAIN ] Derivative Progress: 1672/2085 symbols completed. SKYH took 1.1s. Estimated remaining: 2m 41s. Rate: 154.4 symbols/min [2025-09-17T22:57:42.093981] [INFO ] [MAIN ] SLG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:42.119496] [DEBUG] [MAIN ] SLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:42.124372] [INFO ] [MAIN ] SLF: Generated 1794 derivative records from 39345 primary records. [2025-09-17T22:57:42.124443] [DEBUG] [LOCAL ] SLF: Saving derivative data. [2025-09-17T22:57:42.164994] [DEBUG] [LOCAL ] SLF: Derivative data saved (1794 records). [2025-09-17T22:57:42.165111] [INFO ] [MAIN ] SLF: Successfully saved derivative data. [2025-09-17T22:57:42.171947] [INFO ] [MAIN ] Derivative Progress: 1673/2085 symbols completed. SLF took 1.0s. Estimated remaining: 2m 40s. Rate: 154.4 symbols/min [2025-09-17T22:57:42.172676] [INFO ] [MAIN ] SLGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:42.173091] [DEBUG] [MAIN ] SLB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:42.174384] [INFO ] [MAIN ] SLB: Generated 1794 derivative records from 53697 primary records. [2025-09-17T22:57:42.174572] [DEBUG] [LOCAL ] SLB: Saving derivative data. [2025-09-17T22:57:42.205189] [DEBUG] [LOCAL ] SLB: Derivative data saved (1794 records). [2025-09-17T22:57:42.206085] [DEBUG] [LOCAL ] SLG: Loaded 45646 existing records from primary storage. [2025-09-17T22:57:42.206204] [INFO ] [MAIN ] SLB: Successfully saved derivative data. [2025-09-17T22:57:42.206305] [INFO ] [MAIN ] SLG: Loaded 45646 primary data records. [2025-09-17T22:57:42.209205] [INFO ] [MAIN ] Derivative Progress: 1674/2085 symbols completed. SLB took 1.2s. Estimated remaining: 2m 40s. Rate: 154.5 symbols/min [2025-09-17T22:57:42.221104] [INFO ] [MAIN ] SLQT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:42.544154] [DEBUG] [LOCAL ] SLGN: Loaded 40273 existing records from primary storage. [2025-09-17T22:57:42.545062] [INFO ] [MAIN ] SLGN: Loaded 40273 primary data records. [2025-09-17T22:57:42.671127] [DEBUG] [LOCAL ] SLQT: Loaded 44321 existing records from primary storage. [2025-09-17T22:57:42.698308] [INFO ] [MAIN ] SLQT: Loaded 44321 primary data records. [2025-09-17T22:57:43.200040] [DEBUG] [MAIN ] SLG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:43.201535] [INFO ] [MAIN ] SLG: Generated 1794 derivative records from 45646 primary records. [2025-09-17T22:57:43.201940] [DEBUG] [LOCAL ] SLG: Saving derivative data. [2025-09-17T22:57:43.220195] [DEBUG] [LOCAL ] SLG: Derivative data saved (1794 records). [2025-09-17T22:57:43.220869] [INFO ] [MAIN ] SLG: Successfully saved derivative data. [2025-09-17T22:57:43.222990] [INFO ] [MAIN ] Derivative Progress: 1675/2085 symbols completed. SLG took 1.1s. Estimated remaining: 2m 39s. Rate: 154.4 symbols/min [2025-09-17T22:57:43.223542] [INFO ] [MAIN ] SLVM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:43.243445] [DEBUG] [MAIN ] SLGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:43.244607] [INFO ] [MAIN ] SLGN: Generated 1794 derivative records from 40273 primary records. [2025-09-17T22:57:43.244880] [DEBUG] [LOCAL ] SLGN: Saving derivative data. [2025-09-17T22:57:43.258576] [DEBUG] [MAIN ] SLQT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:43.267911] [INFO ] [MAIN ] SLQT: Generated 1794 derivative records from 44321 primary records. [2025-09-17T22:57:43.272908] [DEBUG] [LOCAL ] SLQT: Saving derivative data. [2025-09-17T22:57:43.275906] [DEBUG] [LOCAL ] SLGN: Derivative data saved (1794 records). [2025-09-17T22:57:43.290526] [INFO ] [MAIN ] SLGN: Successfully saved derivative data. [2025-09-17T22:57:43.297422] [INFO ] [MAIN ] Derivative Progress: 1676/2085 symbols completed. SLGN took 1.1s. Estimated remaining: 2m 39s. Rate: 154.5 symbols/min [2025-09-17T22:57:43.301780] [DEBUG] [LOCAL ] SLQT: Derivative data saved (1794 records). [2025-09-17T22:57:43.302259] [INFO ] [MAIN ] SLQT: Successfully saved derivative data. [2025-09-17T22:57:43.302320] [INFO ] [MAIN ] SM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:43.304903] [INFO ] [MAIN ] Derivative Progress: 1677/2085 symbols completed. SLQT took 1.1s. Estimated remaining: 2m 38s. Rate: 154.5 symbols/min [2025-09-17T22:57:43.305602] [INFO ] [MAIN ] SMBK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:43.317201] [DEBUG] [LOCAL ] SLVM: Loaded 28006 existing records from primary storage. [2025-09-17T22:57:43.317572] [INFO ] [MAIN ] SLVM: Loaded 28006 primary data records. [2025-09-17T22:57:43.414659] [DEBUG] [LOCAL ] SMBK: Loaded 8268 existing records from primary storage. [2025-09-17T22:57:43.428259] [INFO ] [MAIN ] SMBK: Loaded 8268 primary data records. [2025-09-17T22:57:43.999630] [DEBUG] [LOCAL ] SM: Loaded 52333 existing records from primary storage. [2025-09-17T22:57:44.001097] [INFO ] [MAIN ] SM: Loaded 52333 primary data records. [2025-09-17T22:57:44.336440] [DEBUG] [MAIN ] SLVM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:44.338732] [INFO ] [MAIN ] SLVM: Generated 1794 derivative records from 28006 primary records. [2025-09-17T22:57:44.339214] [DEBUG] [LOCAL ] SLVM: Saving derivative data. [2025-09-17T22:57:44.353811] [DEBUG] [MAIN ] SMBK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:44.363410] [INFO ] [MAIN ] SMBK: Generated 1794 derivative records from 8268 primary records. [2025-09-17T22:57:44.366209] [DEBUG] [LOCAL ] SMBK: Saving derivative data. [2025-09-17T22:57:44.370949] [DEBUG] [LOCAL ] SLVM: Derivative data saved (1794 records). [2025-09-17T22:57:44.371094] [INFO ] [MAIN ] SLVM: Successfully saved derivative data. [2025-09-17T22:57:44.374242] [INFO ] [MAIN ] Derivative Progress: 1678/2085 symbols completed. SLVM took 1.2s. Estimated remaining: 2m 38s. Rate: 154.4 symbols/min [2025-09-17T22:57:44.391455] [DEBUG] [LOCAL ] SMBK: Derivative data saved (1794 records). [2025-09-17T22:57:44.391748] [INFO ] [MAIN ] SMBK: Successfully saved derivative data. [2025-09-17T22:57:44.393933] [INFO ] [MAIN ] Derivative Progress: 1679/2085 symbols completed. SMBK took 1.1s. Estimated remaining: 2m 38s. Rate: 154.5 symbols/min [2025-09-17T22:57:44.408713] [DEBUG] [MAIN ] SM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:44.409268] [INFO ] [MAIN ] SM: Generated 1794 derivative records from 52333 primary records. [2025-09-17T22:57:44.409328] [DEBUG] [LOCAL ] SM: Saving derivative data. [2025-09-17T22:57:44.424803] [DEBUG] [LOCAL ] SM: Derivative data saved (1794 records). [2025-09-17T22:57:44.424862] [INFO ] [MAIN ] SM: Successfully saved derivative data. [2025-09-17T22:57:44.427833] [INFO ] [MAIN ] Derivative Progress: 1680/2085 symbols completed. SM took 1.1s. Estimated remaining: 2m 37s. Rate: 154.6 symbols/min [2025-09-17T22:57:44.428422] [INFO ] [MAIN ] SMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:44.428679] [INFO ] [MAIN ] SMG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:44.428877] [INFO ] [MAIN ] SMFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:44.442788] [DEBUG] [LOCAL ] SMC: Loaded 11482 existing records from primary storage. [2025-09-17T22:57:44.442925] [INFO ] [MAIN ] SMC: Loaded 11482 primary data records. [2025-09-17T22:57:44.794969] [DEBUG] [LOCAL ] SMFG: Loaded 48191 existing records from primary storage. [2025-09-17T22:57:44.795951] [DEBUG] [LOCAL ] SMG: Loaded 44277 existing records from primary storage. [2025-09-17T22:57:44.796298] [INFO ] [MAIN ] SMG: Loaded 44277 primary data records. [2025-09-17T22:57:44.796396] [INFO ] [MAIN ] SMFG: Loaded 48191 primary data records. [2025-09-17T22:57:45.519049] [DEBUG] [MAIN ] SMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:45.521273] [INFO ] [MAIN ] SMC: Generated 1794 derivative records from 11482 primary records. [2025-09-17T22:57:45.521481] [DEBUG] [LOCAL ] SMC: Saving derivative data. [2025-09-17T22:57:45.543903] [DEBUG] [LOCAL ] SMC: Derivative data saved (1794 records). [2025-09-17T22:57:45.544394] [INFO ] [MAIN ] SMC: Successfully saved derivative data. [2025-09-17T22:57:45.546791] [INFO ] [MAIN ] Derivative Progress: 1681/2085 symbols completed. SMC took 1.1s. Estimated remaining: 2m 37s. Rate: 154.4 symbols/min [2025-09-17T22:57:45.547268] [INFO ] [MAIN ] SMHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:45.572744] [DEBUG] [MAIN ] SMFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:45.574875] [INFO ] [MAIN ] SMFG: Generated 1794 derivative records from 48191 primary records. [2025-09-17T22:57:45.575026] [DEBUG] [LOCAL ] SMFG: Saving derivative data. [2025-09-17T22:57:45.601391] [DEBUG] [MAIN ] SMG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:45.614618] [INFO ] [MAIN ] SMG: Generated 1794 derivative records from 44277 primary records. [2025-09-17T22:57:45.616527] [DEBUG] [LOCAL ] SMFG: Derivative data saved (1794 records). [2025-09-17T22:57:45.616683] [DEBUG] [LOCAL ] SMG: Saving derivative data. [2025-09-17T22:57:45.617484] [DEBUG] [LOCAL ] SMHI: Loaded 14627 existing records from primary storage. [2025-09-17T22:57:45.616764] [INFO ] [MAIN ] SMFG: Successfully saved derivative data. [2025-09-17T22:57:45.619633] [INFO ] [MAIN ] Derivative Progress: 1682/2085 symbols completed. SMFG took 1.2s. Estimated remaining: 2m 37s. Rate: 154.5 symbols/min [2025-09-17T22:57:45.620094] [INFO ] [MAIN ] SMP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:45.617604] [INFO ] [MAIN ] SMHI: Loaded 14627 primary data records. [2025-09-17T22:57:45.701327] [DEBUG] [LOCAL ] SMG: Derivative data saved (1794 records). [2025-09-17T22:57:45.726754] [INFO ] [MAIN ] SMG: Successfully saved derivative data. [2025-09-17T22:57:45.735566] [INFO ] [MAIN ] Derivative Progress: 1683/2085 symbols completed. SMG took 1.3s. Estimated remaining: 2m 36s. Rate: 154.5 symbols/min [2025-09-17T22:57:45.751937] [INFO ] [MAIN ] SMR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:45.882263] [DEBUG] [LOCAL ] SMP: Loaded 19979 existing records from primary storage. [2025-09-17T22:57:45.994313] [INFO ] [MAIN ] SMP: Loaded 19979 primary data records. [2025-09-17T22:57:46.341799] [DEBUG] [LOCAL ] SMR: Loaded 53797 existing records from primary storage. [2025-09-17T22:57:46.342323] [INFO ] [MAIN ] SMR: Loaded 53797 primary data records. [2025-09-17T22:57:46.660100] [DEBUG] [MAIN ] SMHI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:46.669780] [INFO ] [MAIN ] SMHI: Generated 1794 derivative records from 14627 primary records. [2025-09-17T22:57:46.670002] [DEBUG] [LOCAL ] SMHI: Saving derivative data. [2025-09-17T22:57:46.691303] [DEBUG] [LOCAL ] SMHI: Derivative data saved (1794 records). [2025-09-17T22:57:46.691538] [INFO ] [MAIN ] SMHI: Successfully saved derivative data. [2025-09-17T22:57:46.694990] [INFO ] [MAIN ] Derivative Progress: 1684/2085 symbols completed. SMHI took 1.1s. Estimated remaining: 2m 36s. Rate: 154.4 symbols/min [2025-09-17T22:57:46.697196] [INFO ] [MAIN ] SMRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:46.714142] [DEBUG] [MAIN ] SMP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:46.715060] [INFO ] [MAIN ] SMP: Generated 1794 derivative records from 19979 primary records. [2025-09-17T22:57:46.715421] [DEBUG] [LOCAL ] SMP: Saving derivative data. [2025-09-17T22:57:46.738413] [DEBUG] [LOCAL ] SMP: Derivative data saved (1794 records). [2025-09-17T22:57:46.738817] [INFO ] [MAIN ] SMP: Successfully saved derivative data. [2025-09-17T22:57:46.741245] [INFO ] [MAIN ] Derivative Progress: 1685/2085 symbols completed. SMP took 1.1s. Estimated remaining: 2m 35s. Rate: 154.5 symbols/min [2025-09-17T22:57:46.741593] [INFO ] [MAIN ] SMWB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:46.754888] [DEBUG] [MAIN ] SMR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:46.756016] [INFO ] [MAIN ] SMR: Generated 1794 derivative records from 53797 primary records. [2025-09-17T22:57:46.756869] [DEBUG] [LOCAL ] SMR: Saving derivative data. [2025-09-17T22:57:46.783481] [DEBUG] [LOCAL ] SMR: Derivative data saved (1794 records). [2025-09-17T22:57:46.784448] [INFO ] [MAIN ] SMR: Successfully saved derivative data. [2025-09-17T22:57:46.786897] [INFO ] [MAIN ] Derivative Progress: 1686/2085 symbols completed. SMR took 1.0s. Estimated remaining: 2m 35s. Rate: 154.5 symbols/min [2025-09-17T22:57:46.800499] [INFO ] [MAIN ] SN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:46.802001] [DEBUG] [LOCAL ] SMRT: Loaded 44441 existing records from primary storage. [2025-09-17T22:57:46.802186] [INFO ] [MAIN ] SMRT: Loaded 44441 primary data records. [2025-09-17T22:57:46.949806] [DEBUG] [LOCAL ] SMWB: Loaded 33407 existing records from primary storage. [2025-09-17T22:57:46.983090] [INFO ] [MAIN ] SMWB: Loaded 33407 primary data records. [2025-09-17T22:57:47.304363] [DEBUG] [LOCAL ] SN: Loaded 49857 existing records from primary storage. [2025-09-17T22:57:47.368752] [INFO ] [MAIN ] SN: Loaded 49857 primary data records. [2025-09-17T22:57:47.878092] [DEBUG] [MAIN ] SMRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:47.879732] [INFO ] [MAIN ] SMRT: Generated 1794 derivative records from 44441 primary records. [2025-09-17T22:57:47.880743] [DEBUG] [LOCAL ] SMRT: Saving derivative data. [2025-09-17T22:57:47.910952] [DEBUG] [MAIN ] SMWB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:47.913200] [INFO ] [MAIN ] SMWB: Generated 1794 derivative records from 33407 primary records. [2025-09-17T22:57:47.913610] [DEBUG] [LOCAL ] SMWB: Saving derivative data. [2025-09-17T22:57:47.923751] [DEBUG] [LOCAL ] SMRT: Derivative data saved (1794 records). [2025-09-17T22:57:47.927333] [INFO ] [MAIN ] SMRT: Successfully saved derivative data. [2025-09-17T22:57:47.932679] [INFO ] [MAIN ] Derivative Progress: 1687/2085 symbols completed. SMRT took 1.2s. Estimated remaining: 2m 35s. Rate: 154.4 symbols/min [2025-09-17T22:57:47.933073] [INFO ] [MAIN ] SNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:47.934329] [DEBUG] [LOCAL ] SMWB: Derivative data saved (1794 records). [2025-09-17T22:57:47.934432] [INFO ] [MAIN ] SMWB: Successfully saved derivative data. [2025-09-17T22:57:47.937040] [INFO ] [MAIN ] Derivative Progress: 1688/2085 symbols completed. SMWB took 1.2s. Estimated remaining: 2m 34s. Rate: 154.5 symbols/min [2025-09-17T22:57:47.937454] [INFO ] [MAIN ] SNAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:47.956312] [DEBUG] [MAIN ] SN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:47.957162] [INFO ] [MAIN ] SN: Generated 1794 derivative records from 49857 primary records. [2025-09-17T22:57:47.957227] [DEBUG] [LOCAL ] SN: Saving derivative data. [2025-09-17T22:57:48.006107] [DEBUG] [LOCAL ] SN: Derivative data saved (1794 records). [2025-09-17T22:57:48.005756] [DEBUG] [LOCAL ] SNA: Loaded 26421 existing records from primary storage. [2025-09-17T22:57:48.006330] [INFO ] [MAIN ] SN: Successfully saved derivative data. [2025-09-17T22:57:48.006251] [INFO ] [MAIN ] SNA: Loaded 26421 primary data records. [2025-09-17T22:57:48.010848] [INFO ] [MAIN ] Derivative Progress: 1689/2085 symbols completed. SN took 1.2s. Estimated remaining: 2m 34s. Rate: 154.5 symbols/min [2025-09-17T22:57:48.034154] [INFO ] [MAIN ] SNDA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:48.195180] [DEBUG] [LOCAL ] SNDA: Loaded 4753 existing records from primary storage. [2025-09-17T22:57:48.235839] [INFO ] [MAIN ] SNDA: Loaded 4753 primary data records. [2025-09-17T22:57:48.237062] [DEBUG] [LOCAL ] SNAP: Loaded 53796 existing records from primary storage. [2025-09-17T22:57:48.237268] [INFO ] [MAIN ] SNAP: Loaded 53796 primary data records. [2025-09-17T22:57:49.021801] [DEBUG] [MAIN ] SNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:49.022812] [INFO ] [MAIN ] SNA: Generated 1794 derivative records from 26421 primary records. [2025-09-17T22:57:49.023274] [DEBUG] [LOCAL ] SNA: Saving derivative data. [2025-09-17T22:57:49.046071] [DEBUG] [LOCAL ] SNA: Derivative data saved (1794 records). [2025-09-17T22:57:49.058915] [INFO ] [MAIN ] SNA: Successfully saved derivative data. [2025-09-17T22:57:49.059186] [DEBUG] [MAIN ] SNDA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:49.059984] [INFO ] [MAIN ] SNDA: Generated 1794 derivative records from 4753 primary records. [2025-09-17T22:57:49.062283] [INFO ] [MAIN ] Derivative Progress: 1690/2085 symbols completed. SNA took 1.1s. Estimated remaining: 2m 34s. Rate: 154.4 symbols/min [2025-09-17T22:57:49.062801] [INFO ] [MAIN ] SNDR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:49.064679] [DEBUG] [LOCAL ] SNDA: Saving derivative data. [2025-09-17T22:57:49.093980] [DEBUG] [MAIN ] SNAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:49.095375] [INFO ] [MAIN ] SNAP: Generated 1794 derivative records from 53796 primary records. [2025-09-17T22:57:49.095581] [DEBUG] [LOCAL ] SNAP: Saving derivative data. [2025-09-17T22:57:49.094510] [DEBUG] [LOCAL ] SNDA: Derivative data saved (1794 records). [2025-09-17T22:57:49.096496] [INFO ] [MAIN ] SNDA: Successfully saved derivative data. [2025-09-17T22:57:49.099138] [INFO ] [MAIN ] Derivative Progress: 1691/2085 symbols completed. SNDA took 1.1s. Estimated remaining: 2m 33s. Rate: 154.5 symbols/min [2025-09-17T22:57:49.114535] [INFO ] [MAIN ] SNOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:49.114466] [DEBUG] [LOCAL ] SNAP: Derivative data saved (1794 records). [2025-09-17T22:57:49.114999] [INFO ] [MAIN ] SNAP: Successfully saved derivative data. [2025-09-17T22:57:49.117479] [INFO ] [MAIN ] Derivative Progress: 1692/2085 symbols completed. SNAP took 1.2s. Estimated remaining: 2m 33s. Rate: 154.5 symbols/min [2025-09-17T22:57:49.117869] [INFO ] [MAIN ] SNV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:49.157369] [DEBUG] [LOCAL ] SNDR: Loaded 40444 existing records from primary storage. [2025-09-17T22:57:49.157632] [INFO ] [MAIN ] SNDR: Loaded 40444 primary data records. [2025-09-17T22:57:49.409198] [DEBUG] [LOCAL ] SNOW: Loaded 53569 existing records from primary storage. [2025-09-17T22:57:49.555518] [DEBUG] [LOCAL ] SNV: Loaded 48944 existing records from primary storage. [2025-09-17T22:57:49.570099] [INFO ] [MAIN ] SNV: Loaded 48944 primary data records. [2025-09-17T22:57:49.570344] [INFO ] [MAIN ] SNOW: Loaded 53569 primary data records. [2025-09-17T22:57:50.218225] [DEBUG] [MAIN ] SNDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:50.219207] [INFO ] [MAIN ] SNDR: Generated 1794 derivative records from 40444 primary records. [2025-09-17T22:57:50.219503] [DEBUG] [LOCAL ] SNDR: Saving derivative data. [2025-09-17T22:57:50.240876] [DEBUG] [LOCAL ] SNDR: Derivative data saved (1794 records). [2025-09-17T22:57:50.241078] [INFO ] [MAIN ] SNDR: Successfully saved derivative data. [2025-09-17T22:57:50.243335] [INFO ] [MAIN ] Derivative Progress: 1693/2085 symbols completed. SNDR took 1.2s. Estimated remaining: 2m 32s. Rate: 154.4 symbols/min [2025-09-17T22:57:50.256284] [DEBUG] [MAIN ] SNV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:50.256937] [INFO ] [MAIN ] SNV: Generated 1794 derivative records from 48944 primary records. [2025-09-17T22:57:50.257014] [DEBUG] [LOCAL ] SNV: Saving derivative data. [2025-09-17T22:57:50.284898] [DEBUG] [MAIN ] SNOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:50.285993] [INFO ] [MAIN ] SNOW: Generated 1794 derivative records from 53569 primary records. [2025-09-17T22:57:50.286275] [DEBUG] [LOCAL ] SNOW: Saving derivative data. [2025-09-17T22:57:50.299137] [DEBUG] [LOCAL ] SNV: Derivative data saved (1794 records). [2025-09-17T22:57:50.299833] [INFO ] [MAIN ] SNV: Successfully saved derivative data. [2025-09-17T22:57:50.302103] [INFO ] [MAIN ] Derivative Progress: 1694/2085 symbols completed. SNV took 1.2s. Estimated remaining: 2m 32s. Rate: 154.4 symbols/min [2025-09-17T22:57:50.305856] [DEBUG] [LOCAL ] SNOW: Derivative data saved (1794 records). [2025-09-17T22:57:50.305926] [INFO ] [MAIN ] SNOW: Successfully saved derivative data. [2025-09-17T22:57:50.309178] [INFO ] [MAIN ] Derivative Progress: 1695/2085 symbols completed. SNOW took 1.2s. Estimated remaining: 2m 31s. Rate: 154.5 symbols/min [2025-09-17T22:57:50.309635] [INFO ] [MAIN ] SNX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:50.309933] [INFO ] [MAIN ] SOBO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:50.309839] [INFO ] [MAIN ] SO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:50.373604] [DEBUG] [LOCAL ] SNX: Loaded 39572 existing records from primary storage. [2025-09-17T22:57:50.374410] [INFO ] [MAIN ] SNX: Loaded 39572 primary data records. [2025-09-17T22:57:50.451965] [DEBUG] [LOCAL ] SOBO: Loaded 40075 existing records from primary storage. [2025-09-17T22:57:50.486917] [INFO ] [MAIN ] SOBO: Loaded 40075 primary data records. [2025-09-17T22:57:50.517168] [DEBUG] [LOCAL ] SO: Loaded 53603 existing records from primary storage. [2025-09-17T22:57:50.549349] [INFO ] [MAIN ] SO: Loaded 53603 primary data records. [2025-09-17T22:57:51.389535] [DEBUG] [MAIN ] SNX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:51.393636] [INFO ] [MAIN ] SNX: Generated 1794 derivative records from 39572 primary records. [2025-09-17T22:57:51.395481] [DEBUG] [LOCAL ] SNX: Saving derivative data. [2025-09-17T22:57:51.430506] [DEBUG] [MAIN ] SOBO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:51.431743] [INFO ] [MAIN ] SOBO: Generated 1794 derivative records from 40075 primary records. [2025-09-17T22:57:51.431032] [DEBUG] [MAIN ] SO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:51.431843] [DEBUG] [LOCAL ] SOBO: Saving derivative data. [2025-09-17T22:57:51.435925] [INFO ] [MAIN ] SO: Generated 1794 derivative records from 53603 primary records. [2025-09-17T22:57:51.436492] [DEBUG] [LOCAL ] SO: Saving derivative data. [2025-09-17T22:57:51.449127] [DEBUG] [LOCAL ] SNX: Derivative data saved (1794 records). [2025-09-17T22:57:51.452954] [INFO ] [MAIN ] SNX: Successfully saved derivative data. [2025-09-17T22:57:51.463874] [INFO ] [MAIN ] Derivative Progress: 1696/2085 symbols completed. SNX took 1.2s. Estimated remaining: 2m 31s. Rate: 154.4 symbols/min [2025-09-17T22:57:51.467606] [INFO ] [MAIN ] SOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:51.479424] [DEBUG] [LOCAL ] SO: Derivative data saved (1794 records). [2025-09-17T22:57:51.479623] [INFO ] [MAIN ] SO: Successfully saved derivative data. [2025-09-17T22:57:51.479728] [DEBUG] [LOCAL ] SOBO: Derivative data saved (1794 records). [2025-09-17T22:57:51.479826] [INFO ] [MAIN ] SOBO: Successfully saved derivative data. [2025-09-17T22:57:51.482307] [INFO ] [MAIN ] Derivative Progress: 1697/2085 symbols completed. SO took 1.2s. Estimated remaining: 2m 31s. Rate: 154.4 symbols/min [2025-09-17T22:57:51.485504] [INFO ] [MAIN ] Derivative Progress: 1698/2085 symbols completed. SOBO took 1.2s. Estimated remaining: 2m 30s. Rate: 154.5 symbols/min [2025-09-17T22:57:51.485976] [INFO ] [MAIN ] SOJD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:51.485924] [INFO ] [MAIN ] SOJC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:51.498785] [DEBUG] [LOCAL ] SOJC: Loaded 5162 existing records from primary storage. [2025-09-17T22:57:51.498941] [INFO ] [MAIN ] SOJC: Loaded 5162 primary data records. [2025-09-17T22:57:51.628554] [DEBUG] [LOCAL ] SOJD: Loaded 13004 existing records from primary storage. [2025-09-17T22:57:51.628810] [INFO ] [MAIN ] SOJD: Loaded 13004 primary data records. [2025-09-17T22:57:51.799750] [DEBUG] [LOCAL ] SOC: Loaded 50212 existing records from primary storage. [2025-09-17T22:57:51.870126] [INFO ] [MAIN ] SOC: Loaded 50212 primary data records. [2025-09-17T22:57:52.530114] [DEBUG] [MAIN ] SOJC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:52.531234] [INFO ] [MAIN ] SOJC: Generated 1794 derivative records from 5162 primary records. [2025-09-17T22:57:52.532633] [DEBUG] [LOCAL ] SOJC: Saving derivative data. [2025-09-17T22:57:52.563468] [DEBUG] [MAIN ] SOJD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:52.565157] [INFO ] [MAIN ] SOJD: Generated 1794 derivative records from 13004 primary records. [2025-09-17T22:57:52.566434] [DEBUG] [LOCAL ] SOJD: Saving derivative data. [2025-09-17T22:57:52.578822] [DEBUG] [LOCAL ] SOJC: Derivative data saved (1794 records). [2025-09-17T22:57:52.579931] [INFO ] [MAIN ] SOJC: Successfully saved derivative data. [2025-09-17T22:57:52.582491] [INFO ] [MAIN ] Derivative Progress: 1699/2085 symbols completed. SOJC took 1.1s. Estimated remaining: 2m 30s. Rate: 154.4 symbols/min [2025-09-17T22:57:52.602688] [DEBUG] [LOCAL ] SOJD: Derivative data saved (1794 records). [2025-09-17T22:57:52.602582] [INFO ] [MAIN ] SOJE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:52.603153] [DEBUG] [MAIN ] SOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:52.604485] [INFO ] [MAIN ] SOC: Generated 1794 derivative records from 50212 primary records. [2025-09-17T22:57:52.604783] [DEBUG] [LOCAL ] SOC: Saving derivative data. [2025-09-17T22:57:52.604611] [INFO ] [MAIN ] SOJD: Successfully saved derivative data. [2025-09-17T22:57:52.607613] [INFO ] [MAIN ] Derivative Progress: 1700/2085 symbols completed. SOJD took 1.1s. Estimated remaining: 2m 30s. Rate: 154.5 symbols/min [2025-09-17T22:57:52.608595] [INFO ] [MAIN ] SOL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:52.628769] [DEBUG] [LOCAL ] SOC: Derivative data saved (1794 records). [2025-09-17T22:57:52.632448] [INFO ] [MAIN ] SOC: Successfully saved derivative data. [2025-09-17T22:57:52.635308] [INFO ] [MAIN ] Derivative Progress: 1701/2085 symbols completed. SOC took 1.2s. Estimated remaining: 2m 29s. Rate: 154.5 symbols/min [2025-09-17T22:57:52.636262] [INFO ] [MAIN ] SOLV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:52.643465] [DEBUG] [LOCAL ] SOJE: Loaded 9482 existing records from primary storage. [2025-09-17T22:57:52.643754] [INFO ] [MAIN ] SOJE: Loaded 9482 primary data records. [2025-09-17T22:57:52.689383] [DEBUG] [LOCAL ] SOL: Loaded 13739 existing records from primary storage. [2025-09-17T22:57:52.701001] [INFO ] [MAIN ] SOL: Loaded 13739 primary data records. [2025-09-17T22:57:53.071572] [DEBUG] [LOCAL ] SOLV: Loaded 44321 existing records from primary storage. [2025-09-17T22:57:53.236503] [INFO ] [MAIN ] SOLV: Loaded 44321 primary data records. [2025-09-17T22:57:53.793943] [DEBUG] [MAIN ] SOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:53.807185] [INFO ] [MAIN ] SOL: Generated 1794 derivative records from 13739 primary records. [2025-09-17T22:57:53.807819] [DEBUG] [LOCAL ] SOL: Saving derivative data. [2025-09-17T22:57:53.807464] [DEBUG] [MAIN ] SOJE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:53.808580] [INFO ] [MAIN ] SOJE: Generated 1794 derivative records from 9482 primary records. [2025-09-17T22:57:53.808686] [DEBUG] [LOCAL ] SOJE: Saving derivative data. [2025-09-17T22:57:53.839366] [DEBUG] [LOCAL ] SOL: Derivative data saved (1794 records). [2025-09-17T22:57:53.840004] [INFO ] [MAIN ] SOL: Successfully saved derivative data. [2025-09-17T22:57:53.842248] [INFO ] [MAIN ] Derivative Progress: 1702/2085 symbols completed. SOL took 1.2s. Estimated remaining: 2m 29s. Rate: 154.3 symbols/min [2025-09-17T22:57:53.842892] [INFO ] [MAIN ] SON: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:53.847128] [DEBUG] [LOCAL ] SOJE: Derivative data saved (1794 records). [2025-09-17T22:57:53.847332] [INFO ] [MAIN ] SOJE: Successfully saved derivative data. [2025-09-17T22:57:53.849727] [INFO ] [MAIN ] Derivative Progress: 1703/2085 symbols completed. SOJE took 1.2s. Estimated remaining: 2m 28s. Rate: 154.4 symbols/min [2025-09-17T22:57:53.850159] [INFO ] [MAIN ] SONY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:53.870093] [DEBUG] [MAIN ] SOLV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:53.870946] [INFO ] [MAIN ] SOLV: Generated 1794 derivative records from 44321 primary records. [2025-09-17T22:57:53.871067] [DEBUG] [LOCAL ] SOLV: Saving derivative data. [2025-09-17T22:57:53.888214] [DEBUG] [LOCAL ] SOLV: Derivative data saved (1794 records). [2025-09-17T22:57:53.888369] [INFO ] [MAIN ] SOLV: Successfully saved derivative data. [2025-09-17T22:57:53.890970] [INFO ] [MAIN ] Derivative Progress: 1704/2085 symbols completed. SOLV took 1.3s. Estimated remaining: 2m 28s. Rate: 154.5 symbols/min [2025-09-17T22:57:53.891324] [INFO ] [MAIN ] SOR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:53.896906] [DEBUG] [LOCAL ] SOR: Loaded 2984 existing records from primary storage. [2025-09-17T22:57:53.897051] [INFO ] [MAIN ] SOR: Loaded 2984 primary data records. [2025-09-17T22:57:54.125142] [DEBUG] [LOCAL ] SON: Loaded 42889 existing records from primary storage. [2025-09-17T22:57:54.145276] [INFO ] [MAIN ] SON: Loaded 42889 primary data records. [2025-09-17T22:57:54.276138] [DEBUG] [LOCAL ] SONY: Loaded 53366 existing records from primary storage. [2025-09-17T22:57:54.322398] [INFO ] [MAIN ] SONY: Loaded 53366 primary data records. [2025-09-17T22:57:54.913891] [DEBUG] [MAIN ] SOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:54.914926] [INFO ] [MAIN ] SOR: Generated 1794 derivative records from 2984 primary records. [2025-09-17T22:57:54.915341] [DEBUG] [LOCAL ] SOR: Saving derivative data. [2025-09-17T22:57:54.933794] [DEBUG] [LOCAL ] SOR: Derivative data saved (1794 records). [2025-09-17T22:57:54.934308] [INFO ] [MAIN ] SOR: Successfully saved derivative data. [2025-09-17T22:57:54.938750] [INFO ] [MAIN ] Derivative Progress: 1705/2085 symbols completed. SOR took 1.0s. Estimated remaining: 2m 28s. Rate: 154.4 symbols/min [2025-09-17T22:57:54.939305] [INFO ] [MAIN ] SOS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:54.953584] [DEBUG] [MAIN ] SONY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:54.955030] [INFO ] [MAIN ] SONY: Generated 1794 derivative records from 53366 primary records. [2025-09-17T22:57:54.955868] [DEBUG] [LOCAL ] SONY: Saving derivative data. [2025-09-17T22:57:54.986210] [DEBUG] [LOCAL ] SONY: Derivative data saved (1794 records). [2025-09-17T22:57:54.985914] [DEBUG] [MAIN ] SON: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:54.989533] [DEBUG] [LOCAL ] SOS: Loaded 7406 existing records from primary storage. [2025-09-17T22:57:54.989331] [INFO ] [MAIN ] SONY: Successfully saved derivative data. [2025-09-17T22:57:54.990212] [INFO ] [MAIN ] SON: Generated 1794 derivative records from 42889 primary records. [2025-09-17T22:57:54.990279] [INFO ] [MAIN ] SOS: Loaded 7406 primary data records. [2025-09-17T22:57:55.003671] [INFO ] [MAIN ] Derivative Progress: 1706/2085 symbols completed. SONY took 1.2s. Estimated remaining: 2m 27s. Rate: 154.4 symbols/min [2025-09-17T22:57:54.990383] [DEBUG] [LOCAL ] SON: Saving derivative data. [2025-09-17T22:57:55.029722] [INFO ] [MAIN ] SPB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:55.113016] [DEBUG] [LOCAL ] SON: Derivative data saved (1794 records). [2025-09-17T22:57:55.123880] [INFO ] [MAIN ] SON: Successfully saved derivative data. [2025-09-17T22:57:55.136638] [INFO ] [MAIN ] Derivative Progress: 1707/2085 symbols completed. SON took 1.3s. Estimated remaining: 2m 27s. Rate: 154.5 symbols/min [2025-09-17T22:57:55.149289] [INFO ] [MAIN ] SPCE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:55.363724] [DEBUG] [LOCAL ] SPB: Loaded 34205 existing records from primary storage. [2025-09-17T22:57:55.364334] [INFO ] [MAIN ] SPB: Loaded 34205 primary data records. [2025-09-17T22:57:55.739532] [DEBUG] [LOCAL ] SPCE: Loaded 49826 existing records from primary storage. [2025-09-17T22:57:55.739985] [INFO ] [MAIN ] SPCE: Loaded 49826 primary data records. [2025-09-17T22:57:55.864862] [DEBUG] [MAIN ] SOS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:55.892565] [INFO ] [MAIN ] SOS: Generated 1794 derivative records from 7406 primary records. [2025-09-17T22:57:55.926172] [DEBUG] [LOCAL ] SOS: Saving derivative data. [2025-09-17T22:57:56.080436] [DEBUG] [LOCAL ] SOS: Derivative data saved (1794 records). [2025-09-17T22:57:56.080863] [INFO ] [MAIN ] SOS: Successfully saved derivative data. [2025-09-17T22:57:56.083114] [INFO ] [MAIN ] Derivative Progress: 1708/2085 symbols completed. SOS took 1.1s. Estimated remaining: 2m 27s. Rate: 154.4 symbols/min [2025-09-17T22:57:56.104344] [DEBUG] [MAIN ] SPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:56.105274] [INFO ] [MAIN ] SPB: Generated 1794 derivative records from 34205 primary records. [2025-09-17T22:57:56.105368] [DEBUG] [LOCAL ] SPB: Saving derivative data. [2025-09-17T22:57:56.122770] [DEBUG] [LOCAL ] SPB: Derivative data saved (1794 records). [2025-09-17T22:57:56.123797] [INFO ] [MAIN ] SPB: Successfully saved derivative data. [2025-09-17T22:57:56.127256] [INFO ] [MAIN ] Derivative Progress: 1709/2085 symbols completed. SPB took 1.1s. Estimated remaining: 2m 26s. Rate: 154.5 symbols/min [2025-09-17T22:57:56.140571] [DEBUG] [MAIN ] SPCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:56.141222] [INFO ] [MAIN ] SPCE: Generated 1794 derivative records from 49826 primary records. [2025-09-17T22:57:56.141284] [DEBUG] [LOCAL ] SPCE: Saving derivative data. [2025-09-17T22:57:56.156635] [DEBUG] [LOCAL ] SPCE: Derivative data saved (1794 records). [2025-09-17T22:57:56.156722] [INFO ] [MAIN ] SPCE: Successfully saved derivative data. [2025-09-17T22:57:56.159027] [INFO ] [MAIN ] Derivative Progress: 1710/2085 symbols completed. SPCE took 1.0s. Estimated remaining: 2m 26s. Rate: 154.5 symbols/min [2025-09-17T22:57:56.159928] [INFO ] [MAIN ] SPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:56.160147] [INFO ] [MAIN ] SPGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:56.160021] [INFO ] [MAIN ] SPE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:56.177172] [DEBUG] [LOCAL ] SPE: Loaded 6419 existing records from primary storage. [2025-09-17T22:57:56.177347] [INFO ] [MAIN ] SPE: Loaded 6419 primary data records. [2025-09-17T22:57:56.528166] [DEBUG] [LOCAL ] SPGI: Loaded 45808 existing records from primary storage. [2025-09-17T22:57:56.528991] [INFO ] [MAIN ] SPGI: Loaded 45808 primary data records. [2025-09-17T22:57:56.630890] [DEBUG] [LOCAL ] SPG: Loaded 50466 existing records from primary storage. [2025-09-17T22:57:56.643793] [INFO ] [MAIN ] SPG: Loaded 50466 primary data records. [2025-09-17T22:57:57.264486] [DEBUG] [MAIN ] SPE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:57.268425] [INFO ] [MAIN ] SPE: Generated 1794 derivative records from 6419 primary records. [2025-09-17T22:57:57.269190] [DEBUG] [LOCAL ] SPE: Saving derivative data. [2025-09-17T22:57:57.292083] [DEBUG] [LOCAL ] SPE: Derivative data saved (1794 records). [2025-09-17T22:57:57.292710] [INFO ] [MAIN ] SPE: Successfully saved derivative data. [2025-09-17T22:57:57.295849] [INFO ] [MAIN ] Derivative Progress: 1711/2085 symbols completed. SPE took 1.1s. Estimated remaining: 2m 25s. Rate: 154.4 symbols/min [2025-09-17T22:57:57.296940] [INFO ] [MAIN ] SPH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:57.335760] [DEBUG] [MAIN ] SPGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:57.337613] [INFO ] [MAIN ] SPGI: Generated 1794 derivative records from 45808 primary records. [2025-09-17T22:57:57.338159] [DEBUG] [LOCAL ] SPGI: Saving derivative data. [2025-09-17T22:57:57.378020] [DEBUG] [LOCAL ] SPH: Loaded 18549 existing records from primary storage. [2025-09-17T22:57:57.378964] [INFO ] [MAIN ] SPH: Loaded 18549 primary data records. [2025-09-17T22:57:57.426157] [DEBUG] [MAIN ] SPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:57.442995] [INFO ] [MAIN ] SPG: Generated 1794 derivative records from 50466 primary records. [2025-09-17T22:57:57.443586] [DEBUG] [LOCAL ] SPG: Saving derivative data. [2025-09-17T22:57:57.445539] [DEBUG] [LOCAL ] SPGI: Derivative data saved (1794 records). [2025-09-17T22:57:57.465117] [INFO ] [MAIN ] SPGI: Successfully saved derivative data. [2025-09-17T22:57:57.507368] [INFO ] [MAIN ] Derivative Progress: 1712/2085 symbols completed. SPGI took 1.3s. Estimated remaining: 2m 25s. Rate: 154.4 symbols/min [2025-09-17T22:57:57.507919] [INFO ] [MAIN ] SPHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:57.559194] [DEBUG] [LOCAL ] SPG: Derivative data saved (1794 records). [2025-09-17T22:57:57.559374] [INFO ] [MAIN ] SPG: Successfully saved derivative data. [2025-09-17T22:57:57.562875] [INFO ] [MAIN ] Derivative Progress: 1713/2085 symbols completed. SPG took 1.4s. Estimated remaining: 2m 24s. Rate: 154.5 symbols/min [2025-09-17T22:57:57.563352] [INFO ] [MAIN ] SPIR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:57.949953] [DEBUG] [LOCAL ] SPHR: Loaded 40151 existing records from primary storage. [2025-09-17T22:57:57.961797] [INFO ] [MAIN ] SPHR: Loaded 40151 primary data records. [2025-09-17T22:57:58.060771] [DEBUG] [LOCAL ] SPIR: Loaded 37538 existing records from primary storage. [2025-09-17T22:57:58.072077] [INFO ] [MAIN ] SPIR: Loaded 37538 primary data records. [2025-09-17T22:57:58.691316] [DEBUG] [MAIN ] SPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:58.693502] [INFO ] [MAIN ] SPH: Generated 1794 derivative records from 18549 primary records. [2025-09-17T22:57:58.694461] [DEBUG] [LOCAL ] SPH: Saving derivative data. [2025-09-17T22:57:58.717538] [DEBUG] [LOCAL ] SPH: Derivative data saved (1794 records). [2025-09-17T22:57:58.717825] [INFO ] [MAIN ] SPH: Successfully saved derivative data. [2025-09-17T22:57:58.720670] [INFO ] [MAIN ] Derivative Progress: 1714/2085 symbols completed. SPH took 1.4s. Estimated remaining: 2m 24s. Rate: 154.3 symbols/min [2025-09-17T22:57:58.721461] [INFO ] [MAIN ] SPMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:58.740274] [DEBUG] [MAIN ] SPHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:58.741681] [INFO ] [MAIN ] SPHR: Generated 1794 derivative records from 40151 primary records. [2025-09-17T22:57:58.745337] [DEBUG] [LOCAL ] SPMC: Loaded 5744 existing records from primary storage. [2025-09-17T22:57:58.745485] [DEBUG] [LOCAL ] SPHR: Saving derivative data. [2025-09-17T22:57:58.745571] [INFO ] [MAIN ] SPMC: Loaded 5744 primary data records. [2025-09-17T22:57:58.814690] [DEBUG] [LOCAL ] SPHR: Derivative data saved (1794 records). [2025-09-17T22:57:58.820199] [INFO ] [MAIN ] SPHR: Successfully saved derivative data. [2025-09-17T22:57:58.844504] [INFO ] [MAIN ] Derivative Progress: 1715/2085 symbols completed. SPHR took 1.3s. Estimated remaining: 2m 24s. Rate: 154.4 symbols/min [2025-09-17T22:57:58.860163] [INFO ] [MAIN ] SPNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:58.869284] [DEBUG] [MAIN ] SPIR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:58.880500] [INFO ] [MAIN ] SPIR: Generated 1794 derivative records from 37538 primary records. [2025-09-17T22:57:58.903664] [DEBUG] [LOCAL ] SPIR: Saving derivative data. [2025-09-17T22:57:59.000993] [DEBUG] [LOCAL ] SPIR: Derivative data saved (1794 records). [2025-09-17T22:57:59.008605] [INFO ] [MAIN ] SPIR: Successfully saved derivative data. [2025-09-17T22:57:59.126590] [INFO ] [MAIN ] Derivative Progress: 1716/2085 symbols completed. SPIR took 1.6s. Estimated remaining: 2m 23s. Rate: 154.4 symbols/min [2025-09-17T22:57:59.135603] [INFO ] [MAIN ] SPOT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:59.164684] [DEBUG] [LOCAL ] SPNT: Loaded 34724 existing records from primary storage. [2025-09-17T22:57:59.165352] [INFO ] [MAIN ] SPNT: Loaded 34724 primary data records. [2025-09-17T22:57:59.340196] [DEBUG] [MAIN ] SPMC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:57:59.361256] [INFO ] [MAIN ] SPMC: Generated 1793 derivative records from 5744 primary records. [2025-09-17T22:57:59.373091] [DEBUG] [LOCAL ] SPMC: Saving derivative data. [2025-09-17T22:57:59.389460] [DEBUG] [LOCAL ] SPOT: Loaded 51070 existing records from primary storage. [2025-09-17T22:57:59.415084] [INFO ] [MAIN ] SPOT: Loaded 51070 primary data records. [2025-09-17T22:57:59.636546] [DEBUG] [LOCAL ] SPMC: Derivative data saved (1793 records). [2025-09-17T22:57:59.648781] [INFO ] [MAIN ] SPMC: Successfully saved derivative data. [2025-09-17T22:57:59.656969] [INFO ] [MAIN ] Derivative Progress: 1717/2085 symbols completed. SPMC took 0.9s. Estimated remaining: 2m 23s. Rate: 154.4 symbols/min [2025-09-17T22:57:59.671422] [INFO ] [MAIN ] SPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:57:59.928488] [DEBUG] [LOCAL ] SPR: Loaded 41443 existing records from primary storage. [2025-09-17T22:57:59.929235] [INFO ] [MAIN ] SPR: Loaded 41443 primary data records. [2025-09-17T22:57:59.928888] [DEBUG] [MAIN ] SPNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:57:59.941884] [INFO ] [MAIN ] SPNT: Generated 1794 derivative records from 34724 primary records. [2025-09-17T22:57:59.962532] [DEBUG] [LOCAL ] SPNT: Saving derivative data. [2025-09-17T22:58:00.031395] [DEBUG] [LOCAL ] SPNT: Derivative data saved (1794 records). [2025-09-17T22:58:00.043000] [INFO ] [MAIN ] SPNT: Successfully saved derivative data. [2025-09-17T22:58:00.053385] [INFO ] [MAIN ] Derivative Progress: 1718/2085 symbols completed. SPNT took 1.2s. Estimated remaining: 2m 23s. Rate: 154.4 symbols/min [2025-09-17T22:58:00.058697] [INFO ] [MAIN ] SPRU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:00.126024] [DEBUG] [MAIN ] SPOT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:00.160449] [INFO ] [MAIN ] SPOT: Generated 1794 derivative records from 51070 primary records. [2025-09-17T22:58:00.164031] [DEBUG] [LOCAL ] SPRU: Loaded 8337 existing records from primary storage. [2025-09-17T22:58:00.308075] [INFO ] [MAIN ] SPRU: Loaded 8337 primary data records. [2025-09-17T22:58:00.307952] [DEBUG] [LOCAL ] SPOT: Saving derivative data. [2025-09-17T22:58:00.496934] [DEBUG] [LOCAL ] SPOT: Derivative data saved (1794 records). [2025-09-17T22:58:00.529567] [INFO ] [MAIN ] SPOT: Successfully saved derivative data. [2025-09-17T22:58:00.531753] [INFO ] [MAIN ] Derivative Progress: 1719/2085 symbols completed. SPOT took 1.4s. Estimated remaining: 2m 22s. Rate: 154.3 symbols/min [2025-09-17T22:58:00.650542] [INFO ] [MAIN ] SPXC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:00.671421] [DEBUG] [MAIN ] SPR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:00.673014] [INFO ] [MAIN ] SPR: Generated 1794 derivative records from 41443 primary records. [2025-09-17T22:58:00.673192] [DEBUG] [LOCAL ] SPR: Saving derivative data. [2025-09-17T22:58:00.706355] [DEBUG] [LOCAL ] SPXC: Loaded 23398 existing records from primary storage. [2025-09-17T22:58:00.706594] [INFO ] [MAIN ] SPXC: Loaded 23398 primary data records. [2025-09-17T22:58:00.706447] [DEBUG] [LOCAL ] SPR: Derivative data saved (1794 records). [2025-09-17T22:58:00.707072] [INFO ] [MAIN ] SPR: Successfully saved derivative data. [2025-09-17T22:58:00.731254] [INFO ] [MAIN ] Derivative Progress: 1720/2085 symbols completed. SPR took 1.1s. Estimated remaining: 2m 22s. Rate: 154.4 symbols/min [2025-09-17T22:58:00.749033] [INFO ] [MAIN ] SPXX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:00.837975] [DEBUG] [MAIN ] SPRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:00.838915] [INFO ] [MAIN ] SPRU: Generated 1794 derivative records from 8337 primary records. [2025-09-17T22:58:00.844745] [DEBUG] [LOCAL ] SPRU: Saving derivative data. [2025-09-17T22:58:00.918619] [DEBUG] [LOCAL ] SPXX: Loaded 8979 existing records from primary storage. [2025-09-17T22:58:00.924580] [INFO ] [MAIN ] SPXX: Loaded 8979 primary data records. [2025-09-17T22:58:01.179058] [DEBUG] [LOCAL ] SPRU: Derivative data saved (1794 records). [2025-09-17T22:58:01.206197] [INFO ] [MAIN ] SPRU: Successfully saved derivative data. [2025-09-17T22:58:01.226137] [INFO ] [MAIN ] Derivative Progress: 1721/2085 symbols completed. SPRU took 1.2s. Estimated remaining: 2m 21s. Rate: 154.3 symbols/min [2025-09-17T22:58:01.243983] [INFO ] [MAIN ] SQM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:01.421342] [DEBUG] [MAIN ] SPXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:01.422622] [INFO ] [MAIN ] SPXC: Generated 1794 derivative records from 23398 primary records. [2025-09-17T22:58:01.422879] [DEBUG] [LOCAL ] SPXC: Saving derivative data. [2025-09-17T22:58:01.461914] [DEBUG] [LOCAL ] SPXC: Derivative data saved (1794 records). [2025-09-17T22:58:01.478515] [INFO ] [MAIN ] SPXC: Successfully saved derivative data. [2025-09-17T22:58:01.484090] [INFO ] [MAIN ] Derivative Progress: 1722/2085 symbols completed. SPXC took 0.8s. Estimated remaining: 2m 21s. Rate: 154.4 symbols/min [2025-09-17T22:58:01.484882] [INFO ] [MAIN ] SQNS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:01.494051] [DEBUG] [LOCAL ] SQM: Loaded 48675 existing records from primary storage. [2025-09-17T22:58:01.500802] [DEBUG] [MAIN ] SPXX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:01.500355] [INFO ] [MAIN ] SQM: Loaded 48675 primary data records. [2025-09-17T22:58:01.501954] [INFO ] [MAIN ] SPXX: Generated 1794 derivative records from 8979 primary records. [2025-09-17T22:58:01.535546] [DEBUG] [LOCAL ] SPXX: Saving derivative data. [2025-09-17T22:58:01.710948] [DEBUG] [LOCAL ] SPXX: Derivative data saved (1794 records). [2025-09-17T22:58:01.728127] [DEBUG] [LOCAL ] SQNS: Loaded 25148 existing records from primary storage. [2025-09-17T22:58:01.734562] [INFO ] [MAIN ] SPXX: Successfully saved derivative data. [2025-09-17T22:58:01.734455] [INFO ] [MAIN ] SQNS: Loaded 25148 primary data records. [2025-09-17T22:58:01.737521] [INFO ] [MAIN ] Derivative Progress: 1723/2085 symbols completed. SPXX took 1.0s. Estimated remaining: 2m 21s. Rate: 154.4 symbols/min [2025-09-17T22:58:02.258087] [DEBUG] [MAIN ] SQM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:02.258891] [INFO ] [MAIN ] SQM: Generated 1794 derivative records from 48675 primary records. [2025-09-17T22:58:02.258976] [DEBUG] [LOCAL ] SQM: Saving derivative data. [2025-09-17T22:58:02.277609] [DEBUG] [LOCAL ] SQM: Derivative data saved (1794 records). [2025-09-17T22:58:02.277707] [INFO ] [MAIN ] SQM: Successfully saved derivative data. [2025-09-17T22:58:02.280157] [INFO ] [MAIN ] Derivative Progress: 1724/2085 symbols completed. SQM took 1.0s. Estimated remaining: 2m 20s. Rate: 154.4 symbols/min [2025-09-17T22:58:02.295997] [DEBUG] [MAIN ] SQNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:02.296747] [INFO ] [MAIN ] SQNS: Generated 1794 derivative records from 25148 primary records. [2025-09-17T22:58:02.296811] [DEBUG] [LOCAL ] SQNS: Saving derivative data. [2025-09-17T22:58:02.311608] [DEBUG] [LOCAL ] SQNS: Derivative data saved (1794 records). [2025-09-17T22:58:02.311695] [INFO ] [MAIN ] SQNS: Successfully saved derivative data. [2025-09-17T22:58:02.314024] [INFO ] [MAIN ] Derivative Progress: 1725/2085 symbols completed. SQNS took 0.8s. Estimated remaining: 2m 20s. Rate: 154.5 symbols/min [2025-09-17T22:58:02.314595] [INFO ] [MAIN ] SR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:02.314992] [INFO ] [MAIN ] SREA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:02.315126] [INFO ] [MAIN ] SRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:02.330178] [DEBUG] [LOCAL ] SREA: Loaded 10455 existing records from primary storage. [2025-09-17T22:58:02.330312] [INFO ] [MAIN ] SREA: Loaded 10455 primary data records. [2025-09-17T22:58:02.557831] [DEBUG] [LOCAL ] SR: Loaded 32653 existing records from primary storage. [2025-09-17T22:58:02.571698] [INFO ] [MAIN ] SR: Loaded 32653 primary data records. [2025-09-17T22:58:02.730147] [DEBUG] [LOCAL ] SRE: Loaded 53422 existing records from primary storage. [2025-09-17T22:58:02.742613] [INFO ] [MAIN ] SRE: Loaded 53422 primary data records. [2025-09-17T22:58:03.318805] [DEBUG] [MAIN ] SREA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:03.319916] [INFO ] [MAIN ] SREA: Generated 1794 derivative records from 10455 primary records. [2025-09-17T22:58:03.320107] [DEBUG] [LOCAL ] SREA: Saving derivative data. [2025-09-17T22:58:03.338534] [DEBUG] [LOCAL ] SREA: Derivative data saved (1794 records). [2025-09-17T22:58:03.341141] [INFO ] [MAIN ] SREA: Successfully saved derivative data. [2025-09-17T22:58:03.343695] [INFO ] [MAIN ] Derivative Progress: 1726/2085 symbols completed. SREA took 1.0s. Estimated remaining: 2m 20s. Rate: 154.3 symbols/min [2025-09-17T22:58:03.344072] [INFO ] [MAIN ] SRFM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:03.357736] [DEBUG] [MAIN ] SR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:03.359302] [INFO ] [MAIN ] SR: Generated 1794 derivative records from 32653 primary records. [2025-09-17T22:58:03.360939] [DEBUG] [LOCAL ] SR: Saving derivative data. [2025-09-17T22:58:03.385114] [DEBUG] [MAIN ] SRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:03.389430] [INFO ] [MAIN ] SRE: Generated 1794 derivative records from 53422 primary records. [2025-09-17T22:58:03.390072] [DEBUG] [LOCAL ] SRE: Saving derivative data. [2025-09-17T22:58:03.390022] [DEBUG] [LOCAL ] SR: Derivative data saved (1794 records). [2025-09-17T22:58:03.390276] [INFO ] [MAIN ] SR: Successfully saved derivative data. [2025-09-17T22:58:03.392834] [INFO ] [MAIN ] Derivative Progress: 1727/2085 symbols completed. SR took 1.1s. Estimated remaining: 2m 19s. Rate: 154.4 symbols/min [2025-09-17T22:58:03.393342] [INFO ] [MAIN ] SRG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:03.434739] [DEBUG] [LOCAL ] SRE: Derivative data saved (1794 records). [2025-09-17T22:58:03.435319] [DEBUG] [LOCAL ] SRFM: Loaded 34848 existing records from primary storage. [2025-09-17T22:58:03.440941] [INFO ] [MAIN ] SRE: Successfully saved derivative data. [2025-09-17T22:58:03.441278] [DEBUG] [LOCAL ] SRG: Loaded 16123 existing records from primary storage. [2025-09-17T22:58:03.444770] [INFO ] [MAIN ] Derivative Progress: 1728/2085 symbols completed. SRE took 1.1s. Estimated remaining: 2m 19s. Rate: 154.5 symbols/min [2025-09-17T22:58:03.444890] [INFO ] [MAIN ] SRG: Loaded 16123 primary data records. [2025-09-17T22:58:03.450470] [INFO ] [MAIN ] SRI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:03.441387] [INFO ] [MAIN ] SRFM: Loaded 34848 primary data records. [2025-09-17T22:58:03.782491] [DEBUG] [LOCAL ] SRI: Loaded 28111 existing records from primary storage. [2025-09-17T22:58:03.952936] [INFO ] [MAIN ] SRI: Loaded 28111 primary data records. [2025-09-17T22:58:04.494127] [DEBUG] [MAIN ] SRFM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:04.494598] [DEBUG] [MAIN ] SRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:04.495677] [INFO ] [MAIN ] SRFM: Generated 1794 derivative records from 34848 primary records. [2025-09-17T22:58:04.496469] [INFO ] [MAIN ] SRG: Generated 1794 derivative records from 16123 primary records. [2025-09-17T22:58:04.496765] [DEBUG] [LOCAL ] SRFM: Saving derivative data. [2025-09-17T22:58:04.496690] [DEBUG] [LOCAL ] SRG: Saving derivative data. [2025-09-17T22:58:04.524310] [DEBUG] [LOCAL ] SRFM: Derivative data saved (1794 records). [2025-09-17T22:58:04.524676] [INFO ] [MAIN ] SRFM: Successfully saved derivative data. [2025-09-17T22:58:04.530056] [INFO ] [MAIN ] Derivative Progress: 1729/2085 symbols completed. SRFM took 1.2s. Estimated remaining: 2m 18s. Rate: 154.3 symbols/min [2025-09-17T22:58:04.531269] [INFO ] [MAIN ] SRV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:04.531202] [DEBUG] [LOCAL ] SRG: Derivative data saved (1794 records). [2025-09-17T22:58:04.532194] [INFO ] [MAIN ] SRG: Successfully saved derivative data. [2025-09-17T22:58:04.534302] [INFO ] [MAIN ] Derivative Progress: 1730/2085 symbols completed. SRG took 1.1s. Estimated remaining: 2m 18s. Rate: 154.4 symbols/min [2025-09-17T22:58:04.534662] [INFO ] [MAIN ] SSB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:04.558128] [DEBUG] [LOCAL ] SRV: Loaded 7809 existing records from primary storage. [2025-09-17T22:58:04.558395] [DEBUG] [MAIN ] SRI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:04.559194] [INFO ] [MAIN ] SRI: Generated 1794 derivative records from 28111 primary records. [2025-09-17T22:58:04.558548] [INFO ] [MAIN ] SRV: Loaded 7809 primary data records. [2025-09-17T22:58:04.559289] [DEBUG] [LOCAL ] SRI: Saving derivative data. [2025-09-17T22:58:04.675547] [DEBUG] [LOCAL ] SRI: Derivative data saved (1794 records). [2025-09-17T22:58:04.675711] [INFO ] [MAIN ] SRI: Successfully saved derivative data. [2025-09-17T22:58:04.678349] [INFO ] [MAIN ] Derivative Progress: 1731/2085 symbols completed. SRI took 1.2s. Estimated remaining: 2m 18s. Rate: 154.4 symbols/min [2025-09-17T22:58:04.682297] [INFO ] [MAIN ] SSD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:04.921334] [DEBUG] [LOCAL ] SSB: Loaded 42962 existing records from primary storage. [2025-09-17T22:58:04.922271] [INFO ] [MAIN ] SSB: Loaded 42962 primary data records. [2025-09-17T22:58:05.028886] [DEBUG] [LOCAL ] SSD: Loaded 22468 existing records from primary storage. [2025-09-17T22:58:05.049562] [INFO ] [MAIN ] SSD: Loaded 22468 primary data records. [2025-09-17T22:58:05.593870] [DEBUG] [MAIN ] SRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:05.594859] [INFO ] [MAIN ] SRV: Generated 1794 derivative records from 7809 primary records. [2025-09-17T22:58:05.595157] [DEBUG] [LOCAL ] SRV: Saving derivative data. [2025-09-17T22:58:05.617482] [DEBUG] [LOCAL ] SRV: Derivative data saved (1794 records). [2025-09-17T22:58:05.617913] [INFO ] [MAIN ] SRV: Successfully saved derivative data. [2025-09-17T22:58:05.621183] [INFO ] [MAIN ] Derivative Progress: 1732/2085 symbols completed. SRV took 1.1s. Estimated remaining: 2m 17s. Rate: 154.3 symbols/min [2025-09-17T22:58:05.634224] [INFO ] [MAIN ] SSL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:05.634839] [DEBUG] [MAIN ] SSB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:05.635586] [INFO ] [MAIN ] SSB: Generated 1794 derivative records from 42962 primary records. [2025-09-17T22:58:05.635937] [DEBUG] [LOCAL ] SSB: Saving derivative data. [2025-09-17T22:58:05.652711] [DEBUG] [LOCAL ] SSB: Derivative data saved (1794 records). [2025-09-17T22:58:05.652890] [INFO ] [MAIN ] SSB: Successfully saved derivative data. [2025-09-17T22:58:05.654893] [INFO ] [MAIN ] Derivative Progress: 1733/2085 symbols completed. SSB took 1.1s. Estimated remaining: 2m 17s. Rate: 154.4 symbols/min [2025-09-17T22:58:05.655364] [INFO ] [MAIN ] SST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:05.671961] [DEBUG] [MAIN ] SSD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:05.672788] [INFO ] [MAIN ] SSD: Generated 1794 derivative records from 22468 primary records. [2025-09-17T22:58:05.672852] [DEBUG] [LOCAL ] SSD: Saving derivative data. [2025-09-17T22:58:05.705000] [DEBUG] [LOCAL ] SST: Loaded 12440 existing records from primary storage. [2025-09-17T22:58:05.705576] [INFO ] [MAIN ] SST: Loaded 12440 primary data records. [2025-09-17T22:58:05.729015] [DEBUG] [LOCAL ] SSD: Derivative data saved (1794 records). [2025-09-17T22:58:05.750704] [INFO ] [MAIN ] SSD: Successfully saved derivative data. [2025-09-17T22:58:05.760193] [INFO ] [MAIN ] Derivative Progress: 1734/2085 symbols completed. SSD took 1.1s. Estimated remaining: 2m 16s. Rate: 154.5 symbols/min [2025-09-17T22:58:05.773735] [INFO ] [MAIN ] SSTK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:05.835454] [DEBUG] [LOCAL ] SSL: Loaded 41116 existing records from primary storage. [2025-09-17T22:58:05.841417] [INFO ] [MAIN ] SSL: Loaded 41116 primary data records. [2025-09-17T22:58:06.205234] [DEBUG] [LOCAL ] SSTK: Loaded 27109 existing records from primary storage. [2025-09-17T22:58:06.314904] [INFO ] [MAIN ] SSTK: Loaded 27109 primary data records. [2025-09-17T22:58:06.727378] [DEBUG] [MAIN ] SST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:06.728508] [INFO ] [MAIN ] SST: Generated 1794 derivative records from 12440 primary records. [2025-09-17T22:58:06.728692] [DEBUG] [LOCAL ] SST: Saving derivative data. [2025-09-17T22:58:06.754952] [DEBUG] [MAIN ] SSL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:06.756697] [INFO ] [MAIN ] SSL: Generated 1794 derivative records from 41116 primary records. [2025-09-17T22:58:06.757945] [DEBUG] [LOCAL ] SSL: Saving derivative data. [2025-09-17T22:58:06.768089] [DEBUG] [LOCAL ] SST: Derivative data saved (1794 records). [2025-09-17T22:58:06.773448] [INFO ] [MAIN ] SST: Successfully saved derivative data. [2025-09-17T22:58:06.777112] [INFO ] [MAIN ] Derivative Progress: 1735/2085 symbols completed. SST took 1.1s. Estimated remaining: 2m 16s. Rate: 154.3 symbols/min [2025-09-17T22:58:06.778784] [INFO ] [MAIN ] ST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:06.778570] [DEBUG] [LOCAL ] SSL: Derivative data saved (1794 records). [2025-09-17T22:58:06.779536] [INFO ] [MAIN ] SSL: Successfully saved derivative data. [2025-09-17T22:58:06.782811] [INFO ] [MAIN ] Derivative Progress: 1736/2085 symbols completed. SSL took 1.2s. Estimated remaining: 2m 16s. Rate: 154.4 symbols/min [2025-09-17T22:58:06.783875] [INFO ] [MAIN ] STAG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:06.807671] [DEBUG] [MAIN ] SSTK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:06.808803] [INFO ] [MAIN ] SSTK: Generated 1794 derivative records from 27109 primary records. [2025-09-17T22:58:06.808994] [DEBUG] [LOCAL ] SSTK: Saving derivative data. [2025-09-17T22:58:06.835382] [DEBUG] [LOCAL ] SSTK: Derivative data saved (1794 records). [2025-09-17T22:58:06.835571] [INFO ] [MAIN ] SSTK: Successfully saved derivative data. [2025-09-17T22:58:06.838187] [INFO ] [MAIN ] Derivative Progress: 1737/2085 symbols completed. SSTK took 1.1s. Estimated remaining: 2m 15s. Rate: 154.5 symbols/min [2025-09-17T22:58:06.838727] [INFO ] [MAIN ] STC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:06.889092] [DEBUG] [LOCAL ] ST: Loaded 49888 existing records from primary storage. [2025-09-17T22:58:06.909173] [INFO ] [MAIN ] ST: Loaded 49888 primary data records. [2025-09-17T22:58:06.909518] [DEBUG] [LOCAL ] STC: Loaded 17858 existing records from primary storage. [2025-09-17T22:58:06.915060] [INFO ] [MAIN ] STC: Loaded 17858 primary data records. [2025-09-17T22:58:06.947785] [DEBUG] [LOCAL ] STAG: Loaded 50025 existing records from primary storage. [2025-09-17T22:58:06.953071] [INFO ] [MAIN ] STAG: Loaded 50025 primary data records. [2025-09-17T22:58:07.866116] [DEBUG] [MAIN ] ST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:07.891586] [INFO ] [MAIN ] ST: Generated 1794 derivative records from 49888 primary records. [2025-09-17T22:58:07.890706] [DEBUG] [MAIN ] STC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:07.891774] [DEBUG] [LOCAL ] ST: Saving derivative data. [2025-09-17T22:58:07.892140] [DEBUG] [MAIN ] STAG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:07.892830] [INFO ] [MAIN ] STC: Generated 1794 derivative records from 17858 primary records. [2025-09-17T22:58:07.893441] [INFO ] [MAIN ] STAG: Generated 1794 derivative records from 50025 primary records. [2025-09-17T22:58:07.893527] [DEBUG] [LOCAL ] STC: Saving derivative data. [2025-09-17T22:58:07.893580] [DEBUG] [LOCAL ] STAG: Saving derivative data. [2025-09-17T22:58:07.934693] [DEBUG] [LOCAL ] STAG: Derivative data saved (1794 records). [2025-09-17T22:58:07.936012] [INFO ] [MAIN ] STAG: Successfully saved derivative data. [2025-09-17T22:58:07.939208] [INFO ] [MAIN ] Derivative Progress: 1738/2085 symbols completed. STAG took 1.2s. Estimated remaining: 2m 15s. Rate: 154.3 symbols/min [2025-09-17T22:58:07.943440] [DEBUG] [LOCAL ] STC: Derivative data saved (1794 records). [2025-09-17T22:58:07.943821] [INFO ] [MAIN ] STC: Successfully saved derivative data. [2025-09-17T22:58:07.946773] [INFO ] [MAIN ] Derivative Progress: 1739/2085 symbols completed. STC took 1.1s. Estimated remaining: 2m 14s. Rate: 154.4 symbols/min [2025-09-17T22:58:07.948594] [DEBUG] [LOCAL ] ST: Derivative data saved (1794 records). [2025-09-17T22:58:07.948684] [INFO ] [MAIN ] ST: Successfully saved derivative data. [2025-09-17T22:58:07.951087] [INFO ] [MAIN ] Derivative Progress: 1740/2085 symbols completed. ST took 1.2s. Estimated remaining: 2m 14s. Rate: 154.5 symbols/min [2025-09-17T22:58:07.951591] [INFO ] [MAIN ] STEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:07.951921] [INFO ] [MAIN ] STEM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:07.951843] [INFO ] [MAIN ] STE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:07.978942] [DEBUG] [LOCAL ] STEL: Loaded 23806 existing records from primary storage. [2025-09-17T22:58:07.979218] [INFO ] [MAIN ] STEL: Loaded 23806 primary data records. [2025-09-17T22:58:08.125489] [DEBUG] [LOCAL ] STE: Loaded 35477 existing records from primary storage. [2025-09-17T22:58:08.136898] [DEBUG] [LOCAL ] STEM: Loaded 40364 existing records from primary storage. [2025-09-17T22:58:08.147385] [INFO ] [MAIN ] STEM: Loaded 40364 primary data records. [2025-09-17T22:58:08.152718] [INFO ] [MAIN ] STE: Loaded 35477 primary data records. [2025-09-17T22:58:09.002098] [DEBUG] [MAIN ] STEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:09.003144] [INFO ] [MAIN ] STEL: Generated 1794 derivative records from 23806 primary records. [2025-09-17T22:58:09.003409] [DEBUG] [LOCAL ] STEL: Saving derivative data. [2025-09-17T22:58:09.024313] [DEBUG] [LOCAL ] STEL: Derivative data saved (1794 records). [2025-09-17T22:58:09.024857] [INFO ] [MAIN ] STEL: Successfully saved derivative data. [2025-09-17T22:58:09.026902] [INFO ] [MAIN ] Derivative Progress: 1741/2085 symbols completed. STEL took 1.1s. Estimated remaining: 2m 14s. Rate: 154.3 symbols/min [2025-09-17T22:58:09.035094] [INFO ] [MAIN ] STEW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:09.041505] [DEBUG] [MAIN ] STEM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:09.043879] [INFO ] [MAIN ] STEM: Generated 1794 derivative records from 40364 primary records. [2025-09-17T22:58:09.044174] [DEBUG] [LOCAL ] STEM: Saving derivative data. [2025-09-17T22:58:09.066321] [DEBUG] [MAIN ] STE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:09.070415] [INFO ] [MAIN ] STE: Generated 1794 derivative records from 35477 primary records. [2025-09-17T22:58:09.071214] [DEBUG] [LOCAL ] STE: Saving derivative data. [2025-09-17T22:58:09.099567] [DEBUG] [LOCAL ] STE: Derivative data saved (1794 records). [2025-09-17T22:58:09.100858] [DEBUG] [LOCAL ] STEW: Loaded 16468 existing records from primary storage. [2025-09-17T22:58:09.100547] [INFO ] [MAIN ] STE: Successfully saved derivative data. [2025-09-17T22:58:09.103667] [INFO ] [MAIN ] Derivative Progress: 1742/2085 symbols completed. STE took 1.2s. Estimated remaining: 2m 13s. Rate: 154.4 symbols/min [2025-09-17T22:58:09.101366] [DEBUG] [LOCAL ] STEM: Derivative data saved (1794 records). [2025-09-17T22:58:09.104027] [INFO ] [MAIN ] STK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:09.103803] [INFO ] [MAIN ] STEM: Successfully saved derivative data. [2025-09-17T22:58:09.107072] [INFO ] [MAIN ] Derivative Progress: 1743/2085 symbols completed. STEM took 1.2s. Estimated remaining: 2m 13s. Rate: 154.5 symbols/min [2025-09-17T22:58:09.107467] [INFO ] [MAIN ] STEW: Loaded 16468 primary data records. [2025-09-17T22:58:09.107712] [INFO ] [MAIN ] STLA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:09.238937] [DEBUG] [LOCAL ] STK: Loaded 9386 existing records from primary storage. [2025-09-17T22:58:09.268620] [INFO ] [MAIN ] STK: Loaded 9386 primary data records. [2025-09-17T22:58:09.769135] [DEBUG] [LOCAL ] STLA: Loaded 53547 existing records from primary storage. [2025-09-17T22:58:09.769413] [INFO ] [MAIN ] STLA: Loaded 53547 primary data records. [2025-09-17T22:58:10.160401] [DEBUG] [MAIN ] STEW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:10.162111] [INFO ] [MAIN ] STEW: Generated 1794 derivative records from 16468 primary records. [2025-09-17T22:58:10.162758] [DEBUG] [LOCAL ] STEW: Saving derivative data. [2025-09-17T22:58:10.186616] [DEBUG] [LOCAL ] STEW: Derivative data saved (1794 records). [2025-09-17T22:58:10.187023] [INFO ] [MAIN ] STEW: Successfully saved derivative data. [2025-09-17T22:58:10.201938] [INFO ] [MAIN ] Derivative Progress: 1744/2085 symbols completed. STEW took 1.2s. Estimated remaining: 2m 13s. Rate: 154.3 symbols/min [2025-09-17T22:58:10.203037] [DEBUG] [MAIN ] STK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:10.204431] [INFO ] [MAIN ] STK: Generated 1794 derivative records from 9386 primary records. [2025-09-17T22:58:10.204514] [INFO ] [MAIN ] STM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:10.204940] [DEBUG] [LOCAL ] STK: Saving derivative data. [2025-09-17T22:58:10.222349] [DEBUG] [LOCAL ] STK: Derivative data saved (1794 records). [2025-09-17T22:58:10.225001] [INFO ] [MAIN ] STK: Successfully saved derivative data. [2025-09-17T22:58:10.227732] [INFO ] [MAIN ] Derivative Progress: 1745/2085 symbols completed. STK took 1.1s. Estimated remaining: 2m 12s. Rate: 154.4 symbols/min [2025-09-17T22:58:10.228196] [INFO ] [MAIN ] STN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:10.241398] [DEBUG] [MAIN ] STLA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:10.242220] [INFO ] [MAIN ] STLA: Generated 1794 derivative records from 53547 primary records. [2025-09-17T22:58:10.242466] [DEBUG] [LOCAL ] STLA: Saving derivative data. [2025-09-17T22:58:10.258499] [DEBUG] [LOCAL ] STLA: Derivative data saved (1794 records). [2025-09-17T22:58:10.258565] [INFO ] [MAIN ] STLA: Successfully saved derivative data. [2025-09-17T22:58:10.260573] [INFO ] [MAIN ] Derivative Progress: 1746/2085 symbols completed. STLA took 1.2s. Estimated remaining: 2m 12s. Rate: 154.5 symbols/min [2025-09-17T22:58:10.260924] [INFO ] [MAIN ] STNG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:10.293601] [DEBUG] [LOCAL ] STN: Loaded 23143 existing records from primary storage. [2025-09-17T22:58:10.293781] [INFO ] [MAIN ] STN: Loaded 23143 primary data records. [2025-09-17T22:58:10.430183] [DEBUG] [LOCAL ] STM: Loaded 53589 existing records from primary storage. [2025-09-17T22:58:10.436137] [INFO ] [MAIN ] STM: Loaded 53589 primary data records. [2025-09-17T22:58:10.594038] [DEBUG] [LOCAL ] STNG: Loaded 44189 existing records from primary storage. [2025-09-17T22:58:10.601026] [INFO ] [MAIN ] STNG: Loaded 44189 primary data records. [2025-09-17T22:58:11.292964] [DEBUG] [MAIN ] STN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:11.296205] [INFO ] [MAIN ] STN: Generated 1794 derivative records from 23143 primary records. [2025-09-17T22:58:11.297322] [DEBUG] [LOCAL ] STN: Saving derivative data. [2025-09-17T22:58:11.329637] [DEBUG] [LOCAL ] STN: Derivative data saved (1794 records). [2025-09-17T22:58:11.326290] [DEBUG] [MAIN ] STM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:11.330593] [INFO ] [MAIN ] STM: Generated 1794 derivative records from 53589 primary records. [2025-09-17T22:58:11.330893] [DEBUG] [LOCAL ] STM: Saving derivative data. [2025-09-17T22:58:11.331108] [INFO ] [MAIN ] STN: Successfully saved derivative data. [2025-09-17T22:58:11.341848] [INFO ] [MAIN ] Derivative Progress: 1747/2085 symbols completed. STN took 1.1s. Estimated remaining: 2m 11s. Rate: 154.3 symbols/min [2025-09-17T22:58:11.350847] [DEBUG] [LOCAL ] STM: Derivative data saved (1794 records). [2025-09-17T22:58:11.351211] [INFO ] [MAIN ] STM: Successfully saved derivative data. [2025-09-17T22:58:11.350764] [INFO ] [MAIN ] STRV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:11.355208] [INFO ] [MAIN ] Derivative Progress: 1748/2085 symbols completed. STM took 1.2s. Estimated remaining: 2m 11s. Rate: 154.4 symbols/min [2025-09-17T22:58:11.357820] [INFO ] [MAIN ] STT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:11.371417] [DEBUG] [MAIN ] STNG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:11.372232] [INFO ] [MAIN ] STNG: Generated 1794 derivative records from 44189 primary records. [2025-09-17T22:58:11.372387] [DEBUG] [LOCAL ] STNG: Saving derivative data. [2025-09-17T22:58:11.398346] [DEBUG] [LOCAL ] STRV: Loaded 11738 existing records from primary storage. [2025-09-17T22:58:11.399743] [INFO ] [MAIN ] STRV: Loaded 11738 primary data records. [2025-09-17T22:58:11.406461] [DEBUG] [LOCAL ] STNG: Derivative data saved (1794 records). [2025-09-17T22:58:11.414882] [INFO ] [MAIN ] STNG: Successfully saved derivative data. [2025-09-17T22:58:11.439509] [INFO ] [MAIN ] Derivative Progress: 1749/2085 symbols completed. STNG took 1.2s. Estimated remaining: 2m 10s. Rate: 154.5 symbols/min [2025-09-17T22:58:11.464594] [INFO ] [MAIN ] STVN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:11.767903] [DEBUG] [LOCAL ] STVN: Loaded 26565 existing records from primary storage. [2025-09-17T22:58:11.768109] [INFO ] [MAIN ] STVN: Loaded 26565 primary data records. [2025-09-17T22:58:11.769061] [DEBUG] [LOCAL ] STT: Loaded 51245 existing records from primary storage. [2025-09-17T22:58:11.775320] [INFO ] [MAIN ] STT: Loaded 51245 primary data records. [2025-09-17T22:58:12.489482] [DEBUG] [MAIN ] STRV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:58:12.492197] [INFO ] [MAIN ] STRV: Generated 1793 derivative records from 11738 primary records. [2025-09-17T22:58:12.492519] [DEBUG] [LOCAL ] STRV: Saving derivative data. [2025-09-17T22:58:12.514830] [DEBUG] [LOCAL ] STRV: Derivative data saved (1793 records). [2025-09-17T22:58:12.515459] [INFO ] [MAIN ] STRV: Successfully saved derivative data. [2025-09-17T22:58:12.517707] [INFO ] [MAIN ] Derivative Progress: 1750/2085 symbols completed. STRV took 1.2s. Estimated remaining: 2m 10s. Rate: 154.3 symbols/min [2025-09-17T22:58:12.518143] [INFO ] [MAIN ] STWD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:12.537911] [DEBUG] [MAIN ] STT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:12.539794] [INFO ] [MAIN ] STT: Generated 1794 derivative records from 51245 primary records. [2025-09-17T22:58:12.540016] [DEBUG] [LOCAL ] STT: Saving derivative data. [2025-09-17T22:58:12.563060] [DEBUG] [MAIN ] STVN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:12.567565] [INFO ] [MAIN ] STVN: Generated 1794 derivative records from 26565 primary records. [2025-09-17T22:58:12.571076] [DEBUG] [LOCAL ] STT: Derivative data saved (1794 records). [2025-09-17T22:58:12.571230] [INFO ] [MAIN ] STT: Successfully saved derivative data. [2025-09-17T22:58:12.571322] [DEBUG] [LOCAL ] STVN: Saving derivative data. [2025-09-17T22:58:12.574372] [INFO ] [MAIN ] Derivative Progress: 1751/2085 symbols completed. STT took 1.2s. Estimated remaining: 2m 10s. Rate: 154.4 symbols/min [2025-09-17T22:58:12.575033] [INFO ] [MAIN ] STXD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:12.591849] [DEBUG] [LOCAL ] STXD: Loaded 1353 existing records from primary storage. [2025-09-17T22:58:12.592420] [INFO ] [MAIN ] STXD: Loaded 1353 primary data records. [2025-09-17T22:58:12.717108] [DEBUG] [LOCAL ] STVN: Derivative data saved (1794 records). [2025-09-17T22:58:12.721483] [INFO ] [MAIN ] STVN: Successfully saved derivative data. [2025-09-17T22:58:12.724753] [INFO ] [MAIN ] Derivative Progress: 1752/2085 symbols completed. STVN took 1.3s. Estimated remaining: 2m 9s. Rate: 154.5 symbols/min [2025-09-17T22:58:12.730696] [INFO ] [MAIN ] STXE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:12.826117] [DEBUG] [LOCAL ] STXE: Loaded 2251 existing records from primary storage. [2025-09-17T22:58:12.831089] [DEBUG] [LOCAL ] STWD: Loaded 51899 existing records from primary storage. [2025-09-17T22:58:12.944505] [INFO ] [MAIN ] STWD: Loaded 51899 primary data records. [2025-09-17T22:58:12.944697] [INFO ] [MAIN ] STXE: Loaded 2251 primary data records. [2025-09-17T22:58:13.606924] [DEBUG] [MAIN ] STXD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:58:13.608046] [INFO ] [MAIN ] STXD: Generated 1793 derivative records from 1353 primary records. [2025-09-17T22:58:13.608539] [DEBUG] [LOCAL ] STXD: Saving derivative data. [2025-09-17T22:58:13.623861] [DEBUG] [LOCAL ] STXD: Derivative data saved (1793 records). [2025-09-17T22:58:13.624026] [INFO ] [MAIN ] STXD: Successfully saved derivative data. [2025-09-17T22:58:13.626398] [INFO ] [MAIN ] Derivative Progress: 1753/2085 symbols completed. STXD took 1.1s. Estimated remaining: 2m 9s. Rate: 154.4 symbols/min [2025-09-17T22:58:13.645237] [DEBUG] [MAIN ] STXE: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:58:13.646037] [INFO ] [MAIN ] STXE: Generated 1793 derivative records from 2251 primary records. [2025-09-17T22:58:13.646192] [DEBUG] [LOCAL ] STXE: Saving derivative data. [2025-09-17T22:58:13.664395] [DEBUG] [LOCAL ] STXE: Derivative data saved (1793 records). [2025-09-17T22:58:13.676793] [INFO ] [MAIN ] STXE: Successfully saved derivative data. [2025-09-17T22:58:13.679903] [INFO ] [MAIN ] Derivative Progress: 1754/2085 symbols completed. STXE took 1.0s. Estimated remaining: 2m 9s. Rate: 154.4 symbols/min [2025-09-17T22:58:13.677455] [DEBUG] [MAIN ] STWD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:13.680868] [INFO ] [MAIN ] STWD: Generated 1794 derivative records from 51899 primary records. [2025-09-17T22:58:13.680933] [DEBUG] [LOCAL ] STWD: Saving derivative data. [2025-09-17T22:58:13.696361] [DEBUG] [LOCAL ] STWD: Derivative data saved (1794 records). [2025-09-17T22:58:13.696451] [INFO ] [MAIN ] STWD: Successfully saved derivative data. [2025-09-17T22:58:13.698844] [INFO ] [MAIN ] Derivative Progress: 1755/2085 symbols completed. STWD took 1.2s. Estimated remaining: 2m 8s. Rate: 154.5 symbols/min [2025-09-17T22:58:13.699699] [INFO ] [MAIN ] STXK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:13.699804] [INFO ] [MAIN ] STXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:13.699434] [INFO ] [MAIN ] STXG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:13.708425] [DEBUG] [LOCAL ] STXT: Loaded 2617 existing records from primary storage. [2025-09-17T22:58:13.706282] [DEBUG] [LOCAL ] STXK: Loaded 1526 existing records from primary storage. [2025-09-17T22:58:13.708785] [INFO ] [MAIN ] STXK: Loaded 1526 primary data records. [2025-09-17T22:58:13.708894] [INFO ] [MAIN ] STXT: Loaded 2617 primary data records. [2025-09-17T22:58:13.723046] [DEBUG] [LOCAL ] STXG: Loaded 2661 existing records from primary storage. [2025-09-17T22:58:13.738586] [INFO ] [MAIN ] STXG: Loaded 2661 primary data records. [2025-09-17T22:58:14.750375] [DEBUG] [MAIN ] STXK: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:58:14.751232] [INFO ] [MAIN ] STXK: Generated 1793 derivative records from 1526 primary records. [2025-09-17T22:58:14.751443] [DEBUG] [LOCAL ] STXK: Saving derivative data. [2025-09-17T22:58:14.768680] [DEBUG] [LOCAL ] STXK: Derivative data saved (1793 records). [2025-09-17T22:58:14.769914] [INFO ] [MAIN ] STXK: Successfully saved derivative data. [2025-09-17T22:58:14.773547] [INFO ] [MAIN ] Derivative Progress: 1756/2085 symbols completed. STXK took 1.1s. Estimated remaining: 2m 8s. Rate: 154.4 symbols/min [2025-09-17T22:58:14.775122] [INFO ] [MAIN ] STXV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:14.803272] [DEBUG] [MAIN ] STXG: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:58:14.805018] [INFO ] [MAIN ] STXG: Generated 1793 derivative records from 2661 primary records. [2025-09-17T22:58:14.805446] [DEBUG] [MAIN ] STXT: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:58:14.805619] [DEBUG] [LOCAL ] STXG: Saving derivative data. [2025-09-17T22:58:14.806684] [INFO ] [MAIN ] STXT: Generated 1793 derivative records from 2617 primary records. [2025-09-17T22:58:14.809346] [DEBUG] [LOCAL ] STXV: Loaded 1694 existing records from primary storage. [2025-09-17T22:58:14.810179] [DEBUG] [LOCAL ] STXT: Saving derivative data. [2025-09-17T22:58:14.810582] [INFO ] [MAIN ] STXV: Loaded 1694 primary data records. [2025-09-17T22:58:14.898440] [DEBUG] [LOCAL ] STXT: Derivative data saved (1793 records). [2025-09-17T22:58:14.898297] [DEBUG] [LOCAL ] STXG: Derivative data saved (1793 records). [2025-09-17T22:58:14.908131] [INFO ] [MAIN ] STXT: Successfully saved derivative data. [2025-09-17T22:58:14.929772] [INFO ] [MAIN ] Derivative Progress: 1757/2085 symbols completed. STXT took 1.2s. Estimated remaining: 2m 7s. Rate: 154.4 symbols/min [2025-09-17T22:58:14.929956] [INFO ] [MAIN ] STXG: Successfully saved derivative data. [2025-09-17T22:58:14.967096] [INFO ] [MAIN ] STZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:14.969747] [INFO ] [MAIN ] Derivative Progress: 1758/2085 symbols completed. STXG took 1.3s. Estimated remaining: 2m 7s. Rate: 154.5 symbols/min [2025-09-17T22:58:14.981934] [INFO ] [MAIN ] SU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:15.218096] [DEBUG] [MAIN ] STXV: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:58:15.231679] [INFO ] [MAIN ] STXV: Generated 1793 derivative records from 1694 primary records. [2025-09-17T22:58:15.231923] [DEBUG] [LOCAL ] STXV: Saving derivative data. [2025-09-17T22:58:15.246364] [DEBUG] [LOCAL ] STXV: Derivative data saved (1793 records). [2025-09-17T22:58:15.246955] [INFO ] [MAIN ] STXV: Successfully saved derivative data. [2025-09-17T22:58:15.249191] [INFO ] [MAIN ] Derivative Progress: 1759/2085 symbols completed. STXV took 0.5s. Estimated remaining: 2m 7s. Rate: 154.5 symbols/min [2025-09-17T22:58:15.249749] [INFO ] [MAIN ] SUI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:15.281954] [DEBUG] [LOCAL ] STZ: Loaded 52272 existing records from primary storage. [2025-09-17T22:58:15.282201] [INFO ] [MAIN ] STZ: Loaded 52272 primary data records. [2025-09-17T22:58:15.304388] [DEBUG] [LOCAL ] SU: Loaded 53469 existing records from primary storage. [2025-09-17T22:58:15.314867] [INFO ] [MAIN ] SU: Loaded 53469 primary data records. [2025-09-17T22:58:15.791141] [DEBUG] [LOCAL ] SUI: Loaded 42310 existing records from primary storage. [2025-09-17T22:58:15.833626] [INFO ] [MAIN ] SUI: Loaded 42310 primary data records. [2025-09-17T22:58:16.343077] [DEBUG] [MAIN ] STZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:16.344145] [INFO ] [MAIN ] STZ: Generated 1794 derivative records from 52272 primary records. [2025-09-17T22:58:16.344367] [DEBUG] [LOCAL ] STZ: Saving derivative data. [2025-09-17T22:58:16.358921] [DEBUG] [MAIN ] SU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:16.367740] [INFO ] [MAIN ] SU: Generated 1794 derivative records from 53469 primary records. [2025-09-17T22:58:16.369610] [DEBUG] [LOCAL ] SU: Saving derivative data. [2025-09-17T22:58:16.386821] [DEBUG] [LOCAL ] STZ: Derivative data saved (1794 records). [2025-09-17T22:58:16.391387] [INFO ] [MAIN ] STZ: Successfully saved derivative data. [2025-09-17T22:58:16.393686] [INFO ] [MAIN ] Derivative Progress: 1760/2085 symbols completed. STZ took 1.4s. Estimated remaining: 2m 6s. Rate: 154.3 symbols/min [2025-09-17T22:58:16.394964] [INFO ] [MAIN ] SUN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:16.400469] [DEBUG] [LOCAL ] SU: Derivative data saved (1794 records). [2025-09-17T22:58:16.400722] [INFO ] [MAIN ] SU: Successfully saved derivative data. [2025-09-17T22:58:16.402668] [INFO ] [MAIN ] Derivative Progress: 1761/2085 symbols completed. SU took 1.4s. Estimated remaining: 2m 6s. Rate: 154.4 symbols/min [2025-09-17T22:58:16.403033] [INFO ] [MAIN ] SUPV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:16.421690] [DEBUG] [MAIN ] SUI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:16.422594] [INFO ] [MAIN ] SUI: Generated 1794 derivative records from 42310 primary records. [2025-09-17T22:58:16.422769] [DEBUG] [LOCAL ] SUI: Saving derivative data. [2025-09-17T22:58:16.451501] [DEBUG] [LOCAL ] SUI: Derivative data saved (1794 records). [2025-09-17T22:58:16.451782] [INFO ] [MAIN ] SUI: Successfully saved derivative data. [2025-09-17T22:58:16.454951] [INFO ] [MAIN ] Derivative Progress: 1762/2085 symbols completed. SUI took 1.2s. Estimated remaining: 2m 5s. Rate: 154.5 symbols/min [2025-09-17T22:58:16.466776] [INFO ] [MAIN ] SUZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:16.467560] [DEBUG] [LOCAL ] SUN: Loaded 37221 existing records from primary storage. [2025-09-17T22:58:16.468213] [INFO ] [MAIN ] SUN: Loaded 37221 primary data records. [2025-09-17T22:58:16.808210] [DEBUG] [LOCAL ] SUPV: Loaded 46929 existing records from primary storage. [2025-09-17T22:58:16.809012] [INFO ] [MAIN ] SUPV: Loaded 46929 primary data records. [2025-09-17T22:58:16.910205] [DEBUG] [LOCAL ] SUZ: Loaded 45992 existing records from primary storage. [2025-09-17T22:58:16.915823] [INFO ] [MAIN ] SUZ: Loaded 45992 primary data records. [2025-09-17T22:58:17.472125] [DEBUG] [MAIN ] SUN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:17.473558] [INFO ] [MAIN ] SUN: Generated 1794 derivative records from 37221 primary records. [2025-09-17T22:58:17.473953] [DEBUG] [LOCAL ] SUN: Saving derivative data. [2025-09-17T22:58:17.495011] [DEBUG] [LOCAL ] SUN: Derivative data saved (1794 records). [2025-09-17T22:58:17.495292] [INFO ] [MAIN ] SUN: Successfully saved derivative data. [2025-09-17T22:58:17.497489] [INFO ] [MAIN ] Derivative Progress: 1763/2085 symbols completed. SUN took 1.1s. Estimated remaining: 2m 5s. Rate: 154.4 symbols/min [2025-09-17T22:58:17.497898] [INFO ] [MAIN ] SVV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:17.517937] [DEBUG] [MAIN ] SUPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:17.518934] [INFO ] [MAIN ] SUPV: Generated 1794 derivative records from 46929 primary records. [2025-09-17T22:58:17.519178] [DEBUG] [LOCAL ] SUPV: Saving derivative data. [2025-09-17T22:58:17.532375] [DEBUG] [MAIN ] SUZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:17.533320] [INFO ] [MAIN ] SUZ: Generated 1794 derivative records from 45992 primary records. [2025-09-17T22:58:17.533630] [DEBUG] [LOCAL ] SUZ: Saving derivative data. [2025-09-17T22:58:17.574937] [DEBUG] [LOCAL ] SUPV: Derivative data saved (1794 records). [2025-09-17T22:58:17.575813] [INFO ] [MAIN ] SUPV: Successfully saved derivative data. [2025-09-17T22:58:17.576502] [DEBUG] [LOCAL ] SUZ: Derivative data saved (1794 records). [2025-09-17T22:58:17.580262] [INFO ] [MAIN ] SUZ: Successfully saved derivative data. [2025-09-17T22:58:17.580175] [INFO ] [MAIN ] Derivative Progress: 1764/2085 symbols completed. SUPV took 1.2s. Estimated remaining: 2m 5s. Rate: 154.4 symbols/min [2025-09-17T22:58:17.591019] [INFO ] [MAIN ] SW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:17.593045] [INFO ] [MAIN ] Derivative Progress: 1765/2085 symbols completed. SUZ took 1.1s. Estimated remaining: 2m 4s. Rate: 154.5 symbols/min [2025-09-17T22:58:17.595067] [INFO ] [MAIN ] SWK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:17.595797] [DEBUG] [LOCAL ] SVV: Loaded 39382 existing records from primary storage. [2025-09-17T22:58:17.596541] [INFO ] [MAIN ] SVV: Loaded 39382 primary data records. [2025-09-17T22:58:17.978387] [DEBUG] [LOCAL ] SW: Loaded 53165 existing records from primary storage. [2025-09-17T22:58:17.979095] [INFO ] [MAIN ] SW: Loaded 53165 primary data records. [2025-09-17T22:58:17.985065] [DEBUG] [LOCAL ] SWK: Loaded 52532 existing records from primary storage. [2025-09-17T22:58:17.985173] [INFO ] [MAIN ] SWK: Loaded 52532 primary data records. [2025-09-17T22:58:18.665738] [DEBUG] [MAIN ] SVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:18.666847] [INFO ] [MAIN ] SVV: Generated 1794 derivative records from 39382 primary records. [2025-09-17T22:58:18.666990] [DEBUG] [LOCAL ] SVV: Saving derivative data. [2025-09-17T22:58:18.689898] [DEBUG] [LOCAL ] SVV: Derivative data saved (1794 records). [2025-09-17T22:58:18.690216] [INFO ] [MAIN ] SVV: Successfully saved derivative data. [2025-09-17T22:58:18.692490] [INFO ] [MAIN ] Derivative Progress: 1766/2085 symbols completed. SVV took 1.2s. Estimated remaining: 2m 4s. Rate: 154.4 symbols/min [2025-09-17T22:58:18.692939] [INFO ] [MAIN ] SWX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:18.714681] [DEBUG] [MAIN ] SW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:18.716568] [INFO ] [MAIN ] SW: Generated 1794 derivative records from 53165 primary records. [2025-09-17T22:58:18.716813] [DEBUG] [LOCAL ] SW: Saving derivative data. [2025-09-17T22:58:18.748260] [DEBUG] [MAIN ] SWK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:18.757551] [DEBUG] [LOCAL ] SW: Derivative data saved (1794 records). [2025-09-17T22:58:18.758773] [INFO ] [MAIN ] SW: Successfully saved derivative data. [2025-09-17T22:58:18.760909] [INFO ] [MAIN ] Derivative Progress: 1767/2085 symbols completed. SW took 1.2s. Estimated remaining: 2m 4s. Rate: 154.4 symbols/min [2025-09-17T22:58:18.758690] [INFO ] [MAIN ] SWK: Generated 1794 derivative records from 52532 primary records. [2025-09-17T22:58:18.761287] [INFO ] [MAIN ] SWZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:18.761471] [DEBUG] [LOCAL ] SWK: Saving derivative data. [2025-09-17T22:58:18.785214] [DEBUG] [LOCAL ] SWX: Loaded 31355 existing records from primary storage. [2025-09-17T22:58:18.788084] [INFO ] [MAIN ] SWX: Loaded 31355 primary data records. [2025-09-17T22:58:18.850845] [DEBUG] [LOCAL ] SWZ: Loaded 6184 existing records from primary storage. [2025-09-17T22:58:18.871823] [INFO ] [MAIN ] SWZ: Loaded 6184 primary data records. [2025-09-17T22:58:18.918448] [DEBUG] [LOCAL ] SWK: Derivative data saved (1794 records). [2025-09-17T22:58:18.937483] [INFO ] [MAIN ] SWK: Successfully saved derivative data. [2025-09-17T22:58:18.963034] [INFO ] [MAIN ] Derivative Progress: 1768/2085 symbols completed. SWK took 1.4s. Estimated remaining: 2m 3s. Rate: 154.5 symbols/min [2025-09-17T22:58:19.437250] [DEBUG] [MAIN ] SWX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:19.438084] [INFO ] [MAIN ] SWX: Generated 1794 derivative records from 31355 primary records. [2025-09-17T22:58:19.438164] [DEBUG] [LOCAL ] SWX: Saving derivative data. [2025-09-17T22:58:19.468496] [DEBUG] [LOCAL ] SWX: Derivative data saved (1794 records). [2025-09-17T22:58:19.468586] [INFO ] [MAIN ] SWX: Successfully saved derivative data. [2025-09-17T22:58:19.470580] [INFO ] [MAIN ] Derivative Progress: 1769/2085 symbols completed. SWX took 0.8s. Estimated remaining: 2m 3s. Rate: 154.4 symbols/min [2025-09-17T22:58:19.467771] [DEBUG] [MAIN ] SWZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:19.471406] [INFO ] [MAIN ] SWZ: Generated 1794 derivative records from 6184 primary records. [2025-09-17T22:58:19.471684] [DEBUG] [LOCAL ] SWZ: Saving derivative data. [2025-09-17T22:58:19.485530] [DEBUG] [LOCAL ] SWZ: Derivative data saved (1794 records). [2025-09-17T22:58:19.485596] [INFO ] [MAIN ] SWZ: Successfully saved derivative data. [2025-09-17T22:58:19.487941] [INFO ] [MAIN ] Derivative Progress: 1770/2085 symbols completed. SWZ took 0.7s. Estimated remaining: 2m 2s. Rate: 154.5 symbols/min [2025-09-17T22:58:19.488687] [INFO ] [MAIN ] SXI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:19.488550] [INFO ] [MAIN ] SXC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:19.488860] [INFO ] [MAIN ] SXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:19.503150] [DEBUG] [LOCAL ] SXI: Loaded 11414 existing records from primary storage. [2025-09-17T22:58:19.503298] [INFO ] [MAIN ] SXI: Loaded 11414 primary data records. [2025-09-17T22:58:19.859547] [DEBUG] [LOCAL ] SXT: Loaded 28864 existing records from primary storage. [2025-09-17T22:58:19.860639] [INFO ] [MAIN ] SXT: Loaded 28864 primary data records. [2025-09-17T22:58:19.873292] [DEBUG] [LOCAL ] SXC: Loaded 41823 existing records from primary storage. [2025-09-17T22:58:19.900713] [INFO ] [MAIN ] SXC: Loaded 41823 primary data records. [2025-09-17T22:58:20.550580] [DEBUG] [MAIN ] SXI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:20.552374] [INFO ] [MAIN ] SXI: Generated 1794 derivative records from 11414 primary records. [2025-09-17T22:58:20.553588] [DEBUG] [LOCAL ] SXI: Saving derivative data. [2025-09-17T22:58:20.575772] [DEBUG] [LOCAL ] SXI: Derivative data saved (1794 records). [2025-09-17T22:58:20.575848] [INFO ] [MAIN ] SXI: Successfully saved derivative data. [2025-09-17T22:58:20.578214] [INFO ] [MAIN ] Derivative Progress: 1771/2085 symbols completed. SXI took 1.1s. Estimated remaining: 2m 2s. Rate: 154.4 symbols/min [2025-09-17T22:58:20.578756] [INFO ] [MAIN ] SYF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:20.595945] [DEBUG] [MAIN ] SXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:20.596688] [INFO ] [MAIN ] SXT: Generated 1794 derivative records from 28864 primary records. [2025-09-17T22:58:20.596857] [DEBUG] [LOCAL ] SXT: Saving derivative data. [2025-09-17T22:58:20.615587] [DEBUG] [LOCAL ] SXT: Derivative data saved (1794 records). [2025-09-17T22:58:20.615787] [INFO ] [MAIN ] SXT: Successfully saved derivative data. [2025-09-17T22:58:20.617634] [INFO ] [MAIN ] Derivative Progress: 1772/2085 symbols completed. SXT took 1.1s. Estimated remaining: 2m 2s. Rate: 154.4 symbols/min [2025-09-17T22:58:20.618162] [INFO ] [MAIN ] SYK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:20.631819] [DEBUG] [MAIN ] SXC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:20.632736] [INFO ] [MAIN ] SXC: Generated 1794 derivative records from 41823 primary records. [2025-09-17T22:58:20.632872] [DEBUG] [LOCAL ] SXC: Saving derivative data. [2025-09-17T22:58:20.648837] [DEBUG] [LOCAL ] SXC: Derivative data saved (1794 records). [2025-09-17T22:58:20.648994] [INFO ] [MAIN ] SXC: Successfully saved derivative data. [2025-09-17T22:58:20.651723] [INFO ] [MAIN ] Derivative Progress: 1773/2085 symbols completed. SXC took 1.2s. Estimated remaining: 2m 1s. Rate: 154.5 symbols/min [2025-09-17T22:58:20.652165] [INFO ] [MAIN ] SYY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:20.690670] [DEBUG] [LOCAL ] SYF: Loaded 53466 existing records from primary storage. [2025-09-17T22:58:20.690935] [INFO ] [MAIN ] SYF: Loaded 53466 primary data records. [2025-09-17T22:58:20.852924] [DEBUG] [LOCAL ] SYK: Loaded 47145 existing records from primary storage. [2025-09-17T22:58:20.853567] [INFO ] [MAIN ] SYK: Loaded 47145 primary data records. [2025-09-17T22:58:21.186273] [DEBUG] [LOCAL ] SYY: Loaded 53252 existing records from primary storage. [2025-09-17T22:58:21.192018] [INFO ] [MAIN ] SYY: Loaded 53252 primary data records. [2025-09-17T22:58:21.731836] [DEBUG] [MAIN ] SYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:21.735338] [INFO ] [MAIN ] SYF: Generated 1794 derivative records from 53466 primary records. [2025-09-17T22:58:21.735570] [DEBUG] [LOCAL ] SYF: Saving derivative data. [2025-09-17T22:58:21.768601] [DEBUG] [MAIN ] SYK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:21.771110] [INFO ] [MAIN ] SYK: Generated 1794 derivative records from 47145 primary records. [2025-09-17T22:58:21.771555] [DEBUG] [LOCAL ] SYK: Saving derivative data. [2025-09-17T22:58:21.772253] [DEBUG] [LOCAL ] SYF: Derivative data saved (1794 records). [2025-09-17T22:58:21.773051] [INFO ] [MAIN ] SYF: Successfully saved derivative data. [2025-09-17T22:58:21.777361] [INFO ] [MAIN ] Derivative Progress: 1774/2085 symbols completed. SYF took 1.2s. Estimated remaining: 2m 1s. Rate: 154.4 symbols/min [2025-09-17T22:58:21.780100] [INFO ] [MAIN ] T: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:21.806873] [DEBUG] [MAIN ] SYY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:21.808533] [INFO ] [MAIN ] SYY: Generated 1794 derivative records from 53252 primary records. [2025-09-17T22:58:21.808940] [DEBUG] [LOCAL ] SYY: Saving derivative data. [2025-09-17T22:58:21.827455] [DEBUG] [LOCAL ] SYK: Derivative data saved (1794 records). [2025-09-17T22:58:21.828620] [INFO ] [MAIN ] SYK: Successfully saved derivative data. [2025-09-17T22:58:21.832194] [INFO ] [MAIN ] Derivative Progress: 1775/2085 symbols completed. SYK took 1.2s. Estimated remaining: 2m 0s. Rate: 154.4 symbols/min [2025-09-17T22:58:21.834118] [INFO ] [MAIN ] TAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:21.834953] [DEBUG] [LOCAL ] SYY: Derivative data saved (1794 records). [2025-09-17T22:58:21.835541] [INFO ] [MAIN ] SYY: Successfully saved derivative data. [2025-09-17T22:58:21.837950] [INFO ] [MAIN ] Derivative Progress: 1776/2085 symbols completed. SYY took 1.2s. Estimated remaining: 1m 60s. Rate: 154.5 symbols/min [2025-09-17T22:58:21.838365] [INFO ] [MAIN ] TAK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:21.890570] [DEBUG] [LOCAL ] T: Loaded 53798 existing records from primary storage. [2025-09-17T22:58:21.890876] [INFO ] [MAIN ] T: Loaded 53798 primary data records. [2025-09-17T22:58:22.034975] [DEBUG] [LOCAL ] TAC: Loaded 43008 existing records from primary storage. [2025-09-17T22:58:22.068507] [INFO ] [MAIN ] TAC: Loaded 43008 primary data records. [2025-09-17T22:58:22.319978] [DEBUG] [LOCAL ] TAK: Loaded 49995 existing records from primary storage. [2025-09-17T22:58:22.344055] [INFO ] [MAIN ] TAK: Loaded 49995 primary data records. [2025-09-17T22:58:22.945469] [DEBUG] [MAIN ] T: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:22.946793] [INFO ] [MAIN ] T: Generated 1794 derivative records from 53798 primary records. [2025-09-17T22:58:22.947280] [DEBUG] [LOCAL ] T: Saving derivative data. [2025-09-17T22:58:22.980362] [DEBUG] [MAIN ] TAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:22.981115] [DEBUG] [LOCAL ] T: Derivative data saved (1794 records). [2025-09-17T22:58:22.981290] [INFO ] [MAIN ] T: Successfully saved derivative data. [2025-09-17T22:58:22.983481] [INFO ] [MAIN ] Derivative Progress: 1777/2085 symbols completed. T took 1.2s. Estimated remaining: 1m 60s. Rate: 154.4 symbols/min [2025-09-17T22:58:22.984830] [INFO ] [MAIN ] TAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:22.984638] [INFO ] [MAIN ] TAC: Generated 1794 derivative records from 43008 primary records. [2025-09-17T22:58:22.984962] [DEBUG] [LOCAL ] TAC: Saving derivative data. [2025-09-17T22:58:23.018271] [DEBUG] [MAIN ] TAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:23.018910] [DEBUG] [LOCAL ] TAC: Derivative data saved (1794 records). [2025-09-17T22:58:23.019044] [INFO ] [MAIN ] TAC: Successfully saved derivative data. [2025-09-17T22:58:23.019787] [INFO ] [MAIN ] TAK: Generated 1794 derivative records from 49995 primary records. [2025-09-17T22:58:23.019964] [DEBUG] [LOCAL ] TAK: Saving derivative data. [2025-09-17T22:58:23.022334] [INFO ] [MAIN ] Derivative Progress: 1778/2085 symbols completed. TAC took 1.2s. Estimated remaining: 1m 59s. Rate: 154.4 symbols/min [2025-09-17T22:58:23.032924] [INFO ] [MAIN ] TALO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:23.041415] [DEBUG] [LOCAL ] TAK: Derivative data saved (1794 records). [2025-09-17T22:58:23.041683] [INFO ] [MAIN ] TAK: Successfully saved derivative data. [2025-09-17T22:58:23.044363] [INFO ] [MAIN ] Derivative Progress: 1779/2085 symbols completed. TAK took 1.2s. Estimated remaining: 1m 59s. Rate: 154.5 symbols/min [2025-09-17T22:58:23.044793] [INFO ] [MAIN ] TAP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:23.104716] [DEBUG] [LOCAL ] TAL: Loaded 52163 existing records from primary storage. [2025-09-17T22:58:23.104934] [INFO ] [MAIN ] TAL: Loaded 52163 primary data records. [2025-09-17T22:58:23.309825] [DEBUG] [LOCAL ] TALO: Loaded 50840 existing records from primary storage. [2025-09-17T22:58:23.352182] [INFO ] [MAIN ] TALO: Loaded 50840 primary data records. [2025-09-17T22:58:23.472259] [DEBUG] [LOCAL ] TAP: Loaded 52847 existing records from primary storage. [2025-09-17T22:58:23.517780] [INFO ] [MAIN ] TAP: Loaded 52847 primary data records. [2025-09-17T22:58:24.142669] [DEBUG] [MAIN ] TAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:24.144007] [INFO ] [MAIN ] TAL: Generated 1794 derivative records from 52163 primary records. [2025-09-17T22:58:24.144226] [DEBUG] [LOCAL ] TAL: Saving derivative data. [2025-09-17T22:58:24.167809] [DEBUG] [LOCAL ] TAL: Derivative data saved (1794 records). [2025-09-17T22:58:24.168188] [INFO ] [MAIN ] TAL: Successfully saved derivative data. [2025-09-17T22:58:24.170533] [INFO ] [MAIN ] Derivative Progress: 1780/2085 symbols completed. TAL took 1.2s. Estimated remaining: 1m 59s. Rate: 154.3 symbols/min [2025-09-17T22:58:24.172109] [INFO ] [MAIN ] TBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:24.202316] [DEBUG] [MAIN ] TALO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:24.203035] [DEBUG] [MAIN ] TAP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:24.203778] [INFO ] [MAIN ] TALO: Generated 1794 derivative records from 50840 primary records. [2025-09-17T22:58:24.203928] [DEBUG] [LOCAL ] TALO: Saving derivative data. [2025-09-17T22:58:24.204683] [INFO ] [MAIN ] TAP: Generated 1794 derivative records from 52847 primary records. [2025-09-17T22:58:24.208623] [DEBUG] [LOCAL ] TAP: Saving derivative data. [2025-09-17T22:58:24.239929] [DEBUG] [LOCAL ] TBB: Loaded 11751 existing records from primary storage. [2025-09-17T22:58:24.240829] [INFO ] [MAIN ] TBB: Loaded 11751 primary data records. [2025-09-17T22:58:24.254094] [DEBUG] [LOCAL ] TAP: Derivative data saved (1794 records). [2025-09-17T22:58:24.279671] [INFO ] [MAIN ] TAP: Successfully saved derivative data. [2025-09-17T22:58:24.282021] [INFO ] [MAIN ] Derivative Progress: 1781/2085 symbols completed. TAP took 1.2s. Estimated remaining: 1m 58s. Rate: 154.4 symbols/min [2025-09-17T22:58:24.294029] [INFO ] [MAIN ] TBBB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:24.320553] [DEBUG] [LOCAL ] TALO: Derivative data saved (1794 records). [2025-09-17T22:58:24.326027] [INFO ] [MAIN ] TALO: Successfully saved derivative data. [2025-09-17T22:58:24.341853] [INFO ] [MAIN ] Derivative Progress: 1782/2085 symbols completed. TALO took 1.3s. Estimated remaining: 1m 58s. Rate: 154.5 symbols/min [2025-09-17T22:58:24.342206] [INFO ] [MAIN ] TBI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:24.598504] [DEBUG] [LOCAL ] TBI: Loaded 22751 existing records from primary storage. [2025-09-17T22:58:24.599602] [INFO ] [MAIN ] TBI: Loaded 22751 primary data records. [2025-09-17T22:58:24.600596] [DEBUG] [LOCAL ] TBBB: Loaded 36050 existing records from primary storage. [2025-09-17T22:58:24.606670] [INFO ] [MAIN ] TBBB: Loaded 36050 primary data records. [2025-09-17T22:58:25.286964] [DEBUG] [MAIN ] TBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:25.288896] [INFO ] [MAIN ] TBB: Generated 1794 derivative records from 11751 primary records. [2025-09-17T22:58:25.290036] [DEBUG] [LOCAL ] TBB: Saving derivative data. [2025-09-17T22:58:25.311712] [DEBUG] [LOCAL ] TBB: Derivative data saved (1794 records). [2025-09-17T22:58:25.312278] [INFO ] [MAIN ] TBB: Successfully saved derivative data. [2025-09-17T22:58:25.314461] [INFO ] [MAIN ] Derivative Progress: 1783/2085 symbols completed. TBB took 1.1s. Estimated remaining: 1m 57s. Rate: 154.4 symbols/min [2025-09-17T22:58:25.333564] [DEBUG] [MAIN ] TBI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:25.334551] [INFO ] [MAIN ] TBI: Generated 1794 derivative records from 22751 primary records. [2025-09-17T22:58:25.346586] [DEBUG] [LOCAL ] TBI: Saving derivative data. [2025-09-17T22:58:25.347714] [DEBUG] [MAIN ] TBBB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:25.348805] [INFO ] [MAIN ] TBBB: Generated 1794 derivative records from 36050 primary records. [2025-09-17T22:58:25.349111] [DEBUG] [LOCAL ] TBBB: Saving derivative data. [2025-09-17T22:58:25.372787] [DEBUG] [LOCAL ] TBI: Derivative data saved (1794 records). [2025-09-17T22:58:25.375494] [INFO ] [MAIN ] TBI: Successfully saved derivative data. [2025-09-17T22:58:25.377832] [INFO ] [MAIN ] Derivative Progress: 1784/2085 symbols completed. TBI took 1.0s. Estimated remaining: 1m 57s. Rate: 154.4 symbols/min [2025-09-17T22:58:25.382052] [DEBUG] [LOCAL ] TBBB: Derivative data saved (1794 records). [2025-09-17T22:58:25.382140] [INFO ] [MAIN ] TBBB: Successfully saved derivative data. [2025-09-17T22:58:25.384501] [INFO ] [MAIN ] Derivative Progress: 1785/2085 symbols completed. TBBB took 1.1s. Estimated remaining: 1m 56s. Rate: 154.5 symbols/min [2025-09-17T22:58:25.385169] [INFO ] [MAIN ] TD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:25.385270] [INFO ] [MAIN ] TBN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:25.385463] [INFO ] [MAIN ] TDC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:25.392114] [DEBUG] [LOCAL ] TBN: Loaded 3011 existing records from primary storage. [2025-09-17T22:58:25.392434] [INFO ] [MAIN ] TBN: Loaded 3011 primary data records. [2025-09-17T22:58:25.757381] [DEBUG] [LOCAL ] TDC: Loaded 47027 existing records from primary storage. [2025-09-17T22:58:25.759246] [DEBUG] [LOCAL ] TD: Loaded 52297 existing records from primary storage. [2025-09-17T22:58:25.759417] [INFO ] [MAIN ] TDC: Loaded 47027 primary data records. [2025-09-17T22:58:25.759775] [INFO ] [MAIN ] TD: Loaded 52297 primary data records. [2025-09-17T22:58:26.403231] [DEBUG] [MAIN ] TBN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:26.405632] [INFO ] [MAIN ] TBN: Generated 1794 derivative records from 3011 primary records. [2025-09-17T22:58:26.405867] [DEBUG] [LOCAL ] TBN: Saving derivative data. [2025-09-17T22:58:26.428974] [DEBUG] [LOCAL ] TBN: Derivative data saved (1794 records). [2025-09-17T22:58:26.431073] [INFO ] [MAIN ] TBN: Successfully saved derivative data. [2025-09-17T22:58:26.433576] [INFO ] [MAIN ] Derivative Progress: 1786/2085 symbols completed. TBN took 1.0s. Estimated remaining: 1m 56s. Rate: 154.4 symbols/min [2025-09-17T22:58:26.447747] [INFO ] [MAIN ] TDF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:26.448245] [DEBUG] [MAIN ] TD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:26.450222] [INFO ] [MAIN ] TD: Generated 1794 derivative records from 52297 primary records. [2025-09-17T22:58:26.451272] [DEBUG] [LOCAL ] TD: Saving derivative data. [2025-09-17T22:58:26.478836] [DEBUG] [MAIN ] TDC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:26.479846] [INFO ] [MAIN ] TDC: Generated 1794 derivative records from 47027 primary records. [2025-09-17T22:58:26.479969] [DEBUG] [LOCAL ] TDC: Saving derivative data. [2025-09-17T22:58:26.485229] [DEBUG] [LOCAL ] TDF: Loaded 6464 existing records from primary storage. [2025-09-17T22:58:26.485795] [INFO ] [MAIN ] TDF: Loaded 6464 primary data records. [2025-09-17T22:58:26.564474] [DEBUG] [LOCAL ] TD: Derivative data saved (1794 records). [2025-09-17T22:58:26.574300] [DEBUG] [LOCAL ] TDC: Derivative data saved (1794 records). [2025-09-17T22:58:26.591684] [INFO ] [MAIN ] TDC: Successfully saved derivative data. [2025-09-17T22:58:26.593997] [INFO ] [MAIN ] Derivative Progress: 1787/2085 symbols completed. TDC took 1.2s. Estimated remaining: 1m 56s. Rate: 154.4 symbols/min [2025-09-17T22:58:26.614399] [INFO ] [MAIN ] TD: Successfully saved derivative data. [2025-09-17T22:58:26.604562] [INFO ] [MAIN ] TDG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:26.618746] [INFO ] [MAIN ] Derivative Progress: 1788/2085 symbols completed. TD took 1.2s. Estimated remaining: 1m 55s. Rate: 154.5 symbols/min [2025-09-17T22:58:26.623106] [INFO ] [MAIN ] TDOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:26.878815] [DEBUG] [LOCAL ] TDG: Loaded 22189 existing records from primary storage. [2025-09-17T22:58:26.879006] [INFO ] [MAIN ] TDG: Loaded 22189 primary data records. [2025-09-17T22:58:27.034904] [DEBUG] [LOCAL ] TDOC: Loaded 53357 existing records from primary storage. [2025-09-17T22:58:27.074442] [INFO ] [MAIN ] TDOC: Loaded 53357 primary data records. [2025-09-17T22:58:27.355778] [DEBUG] [MAIN ] TDF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:27.357598] [INFO ] [MAIN ] TDF: Generated 1794 derivative records from 6464 primary records. [2025-09-17T22:58:27.363208] [DEBUG] [LOCAL ] TDF: Saving derivative data. [2025-09-17T22:58:27.578852] [DEBUG] [LOCAL ] TDF: Derivative data saved (1794 records). [2025-09-17T22:58:27.579465] [INFO ] [MAIN ] TDF: Successfully saved derivative data. [2025-09-17T22:58:27.582038] [INFO ] [MAIN ] Derivative Progress: 1789/2085 symbols completed. TDF took 1.1s. Estimated remaining: 1m 55s. Rate: 154.4 symbols/min [2025-09-17T22:58:27.583052] [INFO ] [MAIN ] TDS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:27.601458] [DEBUG] [MAIN ] TDG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:27.602448] [INFO ] [MAIN ] TDG: Generated 1794 derivative records from 22189 primary records. [2025-09-17T22:58:27.602798] [DEBUG] [LOCAL ] TDG: Saving derivative data. [2025-09-17T22:58:27.619439] [DEBUG] [LOCAL ] TDG: Derivative data saved (1794 records). [2025-09-17T22:58:27.619666] [INFO ] [MAIN ] TDG: Successfully saved derivative data. [2025-09-17T22:58:27.622016] [INFO ] [MAIN ] Derivative Progress: 1790/2085 symbols completed. TDG took 1.0s. Estimated remaining: 1m 55s. Rate: 154.4 symbols/min [2025-09-17T22:58:27.622500] [INFO ] [MAIN ] TDW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:27.639258] [DEBUG] [MAIN ] TDOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:27.640076] [INFO ] [MAIN ] TDOC: Generated 1794 derivative records from 53357 primary records. [2025-09-17T22:58:27.640192] [DEBUG] [LOCAL ] TDOC: Saving derivative data. [2025-09-17T22:58:27.667370] [DEBUG] [LOCAL ] TDOC: Derivative data saved (1794 records). [2025-09-17T22:58:27.667709] [INFO ] [MAIN ] TDOC: Successfully saved derivative data. [2025-09-17T22:58:27.670351] [INFO ] [MAIN ] Derivative Progress: 1791/2085 symbols completed. TDOC took 1.0s. Estimated remaining: 1m 54s. Rate: 154.5 symbols/min [2025-09-17T22:58:27.670744] [INFO ] [MAIN ] TDY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:27.696528] [DEBUG] [LOCAL ] TDS: Loaded 42900 existing records from primary storage. [2025-09-17T22:58:27.696807] [INFO ] [MAIN ] TDS: Loaded 42900 primary data records. [2025-09-17T22:58:27.830621] [DEBUG] [LOCAL ] TDW: Loaded 45734 existing records from primary storage. [2025-09-17T22:58:27.872907] [INFO ] [MAIN ] TDW: Loaded 45734 primary data records. [2025-09-17T22:58:27.858575] [DEBUG] [LOCAL ] TDY: Loaded 23000 existing records from primary storage. [2025-09-17T22:58:27.876402] [INFO ] [MAIN ] TDY: Loaded 23000 primary data records. [2025-09-17T22:58:28.737666] [DEBUG] [MAIN ] TDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:28.738731] [INFO ] [MAIN ] TDS: Generated 1794 derivative records from 42900 primary records. [2025-09-17T22:58:28.739036] [DEBUG] [LOCAL ] TDS: Saving derivative data. [2025-09-17T22:58:28.768735] [DEBUG] [LOCAL ] TDS: Derivative data saved (1794 records). [2025-09-17T22:58:28.785627] [INFO ] [MAIN ] TDS: Successfully saved derivative data. [2025-09-17T22:58:28.787822] [INFO ] [MAIN ] Derivative Progress: 1792/2085 symbols completed. TDS took 1.2s. Estimated remaining: 1m 54s. Rate: 154.4 symbols/min [2025-09-17T22:58:28.788195] [DEBUG] [MAIN ] TDY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:28.788834] [INFO ] [MAIN ] TEAF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:28.790005] [DEBUG] [MAIN ] TDW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:28.791209] [INFO ] [MAIN ] TDW: Generated 1794 derivative records from 45734 primary records. [2025-09-17T22:58:28.791385] [DEBUG] [LOCAL ] TDW: Saving derivative data. [2025-09-17T22:58:28.789601] [INFO ] [MAIN ] TDY: Generated 1794 derivative records from 23000 primary records. [2025-09-17T22:58:28.791485] [DEBUG] [LOCAL ] TDY: Saving derivative data. [2025-09-17T22:58:28.824117] [DEBUG] [LOCAL ] TDW: Derivative data saved (1794 records). [2025-09-17T22:58:28.827840] [DEBUG] [LOCAL ] TEAF: Loaded 7154 existing records from primary storage. [2025-09-17T22:58:28.828260] [INFO ] [MAIN ] TDW: Successfully saved derivative data. [2025-09-17T22:58:28.831150] [INFO ] [MAIN ] Derivative Progress: 1793/2085 symbols completed. TDW took 1.2s. Estimated remaining: 1m 53s. Rate: 154.4 symbols/min [2025-09-17T22:58:28.828186] [INFO ] [MAIN ] TEAF: Loaded 7154 primary data records. [2025-09-17T22:58:28.833829] [DEBUG] [LOCAL ] TDY: Derivative data saved (1794 records). [2025-09-17T22:58:28.834276] [INFO ] [MAIN ] TDY: Successfully saved derivative data. [2025-09-17T22:58:28.833947] [INFO ] [MAIN ] TECK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:28.842163] [INFO ] [MAIN ] Derivative Progress: 1794/2085 symbols completed. TDY took 1.2s. Estimated remaining: 1m 53s. Rate: 154.5 symbols/min [2025-09-17T22:58:28.875028] [INFO ] [MAIN ] TEF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:29.176889] [DEBUG] [LOCAL ] TEF: Loaded 37568 existing records from primary storage. [2025-09-17T22:58:29.177478] [INFO ] [MAIN ] TEF: Loaded 37568 primary data records. [2025-09-17T22:58:29.260310] [DEBUG] [LOCAL ] TECK: Loaded 53441 existing records from primary storage. [2025-09-17T22:58:29.291055] [INFO ] [MAIN ] TECK: Loaded 53441 primary data records. [2025-09-17T22:58:29.473914] [DEBUG] [MAIN ] TEAF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:29.603043] [INFO ] [MAIN ] TEAF: Generated 1794 derivative records from 7154 primary records. [2025-09-17T22:58:29.608763] [DEBUG] [LOCAL ] TEAF: Saving derivative data. [2025-09-17T22:58:29.831376] [DEBUG] [LOCAL ] TEAF: Derivative data saved (1794 records). [2025-09-17T22:58:29.832543] [INFO ] [MAIN ] TEAF: Successfully saved derivative data. [2025-09-17T22:58:29.834604] [INFO ] [MAIN ] Derivative Progress: 1795/2085 symbols completed. TEAF took 1.0s. Estimated remaining: 1m 53s. Rate: 154.4 symbols/min [2025-09-17T22:58:29.836171] [INFO ] [MAIN ] TEI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:29.864023] [DEBUG] [MAIN ] TEF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:29.864914] [INFO ] [MAIN ] TEF: Generated 1794 derivative records from 37568 primary records. [2025-09-17T22:58:29.865144] [DEBUG] [LOCAL ] TEF: Saving derivative data. [2025-09-17T22:58:29.887036] [DEBUG] [LOCAL ] TEI: Loaded 20379 existing records from primary storage. [2025-09-17T22:58:29.889204] [INFO ] [MAIN ] TEI: Loaded 20379 primary data records. [2025-09-17T22:58:29.896822] [DEBUG] [LOCAL ] TEF: Derivative data saved (1794 records). [2025-09-17T22:58:29.920679] [INFO ] [MAIN ] TEF: Successfully saved derivative data. [2025-09-17T22:58:29.940861] [INFO ] [MAIN ] Derivative Progress: 1796/2085 symbols completed. TEF took 1.1s. Estimated remaining: 1m 52s. Rate: 154.4 symbols/min [2025-09-17T22:58:29.946692] [INFO ] [MAIN ] TEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:29.957858] [DEBUG] [MAIN ] TECK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:29.968448] [INFO ] [MAIN ] TECK: Generated 1794 derivative records from 53441 primary records. [2025-09-17T22:58:29.989587] [DEBUG] [LOCAL ] TECK: Saving derivative data. [2025-09-17T22:58:30.119145] [DEBUG] [LOCAL ] TECK: Derivative data saved (1794 records). [2025-09-17T22:58:30.228936] [INFO ] [MAIN ] TECK: Successfully saved derivative data. [2025-09-17T22:58:30.231294] [INFO ] [MAIN ] Derivative Progress: 1797/2085 symbols completed. TECK took 1.4s. Estimated remaining: 1m 52s. Rate: 154.5 symbols/min [2025-09-17T22:58:30.240170] [INFO ] [MAIN ] TEN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:30.279394] [DEBUG] [MAIN ] TEI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:30.280122] [INFO ] [MAIN ] TEI: Generated 1794 derivative records from 20379 primary records. [2025-09-17T22:58:30.287096] [DEBUG] [LOCAL ] TEI: Saving derivative data. [2025-09-17T22:58:30.316739] [DEBUG] [LOCAL ] TEL: Loaded 51190 existing records from primary storage. [2025-09-17T22:58:30.326730] [INFO ] [MAIN ] TEL: Loaded 51190 primary data records. [2025-09-17T22:58:30.327534] [DEBUG] [LOCAL ] TEN: Loaded 31256 existing records from primary storage. [2025-09-17T22:58:30.349393] [INFO ] [MAIN ] TEN: Loaded 31256 primary data records. [2025-09-17T22:58:30.429026] [DEBUG] [LOCAL ] TEI: Derivative data saved (1794 records). [2025-09-17T22:58:30.441365] [INFO ] [MAIN ] TEI: Successfully saved derivative data. [2025-09-17T22:58:30.455701] [INFO ] [MAIN ] Derivative Progress: 1798/2085 symbols completed. TEI took 0.6s. Estimated remaining: 1m 51s. Rate: 154.5 symbols/min [2025-09-17T22:58:31.028774] [DEBUG] [MAIN ] TEL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:31.029748] [INFO ] [MAIN ] TEL: Generated 1794 derivative records from 51190 primary records. [2025-09-17T22:58:31.030061] [DEBUG] [LOCAL ] TEL: Saving derivative data. [2025-09-17T22:58:31.049667] [DEBUG] [LOCAL ] TEL: Derivative data saved (1794 records). [2025-09-17T22:58:31.049848] [INFO ] [MAIN ] TEL: Successfully saved derivative data. [2025-09-17T22:58:31.051888] [INFO ] [MAIN ] Derivative Progress: 1799/2085 symbols completed. TEL took 1.1s. Estimated remaining: 1m 51s. Rate: 154.5 symbols/min [2025-09-17T22:58:31.064740] [DEBUG] [MAIN ] TEN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:31.065637] [INFO ] [MAIN ] TEN: Generated 1794 derivative records from 31256 primary records. [2025-09-17T22:58:31.065735] [DEBUG] [LOCAL ] TEN: Saving derivative data. [2025-09-17T22:58:31.081117] [DEBUG] [LOCAL ] TEN: Derivative data saved (1794 records). [2025-09-17T22:58:31.081176] [INFO ] [MAIN ] TEN: Successfully saved derivative data. [2025-09-17T22:58:31.085245] [INFO ] [MAIN ] Derivative Progress: 1800/2085 symbols completed. TEN took 0.8s. Estimated remaining: 1m 51s. Rate: 154.5 symbols/min [2025-09-17T22:58:31.086362] [INFO ] [MAIN ] TEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:31.086505] [INFO ] [MAIN ] TEVA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:31.086194] [INFO ] [MAIN ] TEO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:31.111536] [DEBUG] [LOCAL ] TEO: Loaded 21530 existing records from primary storage. [2025-09-17T22:58:31.111736] [INFO ] [MAIN ] TEO: Loaded 21530 primary data records. [2025-09-17T22:58:31.339827] [DEBUG] [LOCAL ] TEX: Loaded 45024 existing records from primary storage. [2025-09-17T22:58:31.478842] [INFO ] [MAIN ] TEX: Loaded 45024 primary data records. [2025-09-17T22:58:31.480358] [DEBUG] [LOCAL ] TEVA: Loaded 53632 existing records from primary storage. [2025-09-17T22:58:31.485916] [INFO ] [MAIN ] TEVA: Loaded 53632 primary data records. [2025-09-17T22:58:32.125130] [DEBUG] [MAIN ] TEO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:32.126505] [INFO ] [MAIN ] TEO: Generated 1794 derivative records from 21530 primary records. [2025-09-17T22:58:32.126881] [DEBUG] [LOCAL ] TEO: Saving derivative data. [2025-09-17T22:58:32.166240] [DEBUG] [LOCAL ] TEO: Derivative data saved (1794 records). [2025-09-17T22:58:32.176094] [INFO ] [MAIN ] TEO: Successfully saved derivative data. [2025-09-17T22:58:32.178742] [INFO ] [MAIN ] Derivative Progress: 1801/2085 symbols completed. TEO took 1.1s. Estimated remaining: 1m 50s. Rate: 154.4 symbols/min [2025-09-17T22:58:32.179482] [INFO ] [MAIN ] TFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:32.176594] [DEBUG] [MAIN ] TEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:32.179358] [DEBUG] [MAIN ] TEVA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:32.180470] [INFO ] [MAIN ] TEVA: Generated 1794 derivative records from 53632 primary records. [2025-09-17T22:58:32.181327] [INFO ] [MAIN ] TEX: Generated 1794 derivative records from 45024 primary records. [2025-09-17T22:58:32.181469] [DEBUG] [LOCAL ] TEVA: Saving derivative data. [2025-09-17T22:58:32.181580] [DEBUG] [LOCAL ] TEX: Saving derivative data. [2025-09-17T22:58:32.210831] [DEBUG] [LOCAL ] TEX: Derivative data saved (1794 records). [2025-09-17T22:58:32.213424] [INFO ] [MAIN ] TEX: Successfully saved derivative data. [2025-09-17T22:58:32.215978] [INFO ] [MAIN ] Derivative Progress: 1802/2085 symbols completed. TEX took 1.1s. Estimated remaining: 1m 50s. Rate: 154.5 symbols/min [2025-09-17T22:58:32.216918] [INFO ] [MAIN ] TFII: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:32.218744] [DEBUG] [LOCAL ] TEVA: Derivative data saved (1794 records). [2025-09-17T22:58:32.218890] [INFO ] [MAIN ] TEVA: Successfully saved derivative data. [2025-09-17T22:58:32.222169] [INFO ] [MAIN ] Derivative Progress: 1803/2085 symbols completed. TEVA took 1.1s. Estimated remaining: 1m 49s. Rate: 154.5 symbols/min [2025-09-17T22:58:32.222577] [INFO ] [MAIN ] TFIN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:32.289051] [DEBUG] [LOCAL ] TFII: Loaded 34883 existing records from primary storage. [2025-09-17T22:58:32.290714] [INFO ] [MAIN ] TFII: Loaded 34883 primary data records. [2025-09-17T22:58:32.303688] [DEBUG] [LOCAL ] TFC: Loaded 53667 existing records from primary storage. [2025-09-17T22:58:32.322033] [INFO ] [MAIN ] TFC: Loaded 53667 primary data records. [2025-09-17T22:58:32.367475] [DEBUG] [LOCAL ] TFIN: Loaded 23553 existing records from primary storage. [2025-09-17T22:58:32.419765] [INFO ] [MAIN ] TFIN: Loaded 23553 primary data records. [2025-09-17T22:58:33.357377] [DEBUG] [MAIN ] TFII: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:33.358185] [INFO ] [MAIN ] TFII: Generated 1794 derivative records from 34883 primary records. [2025-09-17T22:58:33.358391] [DEBUG] [LOCAL ] TFII: Saving derivative data. [2025-09-17T22:58:33.377536] [DEBUG] [LOCAL ] TFII: Derivative data saved (1794 records). [2025-09-17T22:58:33.377771] [INFO ] [MAIN ] TFII: Successfully saved derivative data. [2025-09-17T22:58:33.380084] [INFO ] [MAIN ] Derivative Progress: 1804/2085 symbols completed. TFII took 1.2s. Estimated remaining: 1m 49s. Rate: 154.4 symbols/min [2025-09-17T22:58:33.380507] [INFO ] [MAIN ] TFPM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:33.395940] [DEBUG] [MAIN ] TFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:33.409392] [INFO ] [MAIN ] TFC: Generated 1794 derivative records from 53667 primary records. [2025-09-17T22:58:33.409884] [DEBUG] [LOCAL ] TFC: Saving derivative data. [2025-09-17T22:58:33.409770] [DEBUG] [MAIN ] TFIN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:33.410788] [INFO ] [MAIN ] TFIN: Generated 1794 derivative records from 23553 primary records. [2025-09-17T22:58:33.411561] [DEBUG] [LOCAL ] TFIN: Saving derivative data. [2025-09-17T22:58:33.442686] [DEBUG] [LOCAL ] TFIN: Derivative data saved (1794 records). [2025-09-17T22:58:33.443588] [INFO ] [MAIN ] TFIN: Successfully saved derivative data. [2025-09-17T22:58:33.446357] [INFO ] [MAIN ] Derivative Progress: 1805/2085 symbols completed. TFIN took 1.2s. Estimated remaining: 1m 49s. Rate: 154.4 symbols/min [2025-09-17T22:58:33.446949] [INFO ] [MAIN ] TFX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:33.457031] [DEBUG] [LOCAL ] TFC: Derivative data saved (1794 records). [2025-09-17T22:58:33.457164] [INFO ] [MAIN ] TFC: Successfully saved derivative data. [2025-09-17T22:58:33.459495] [INFO ] [MAIN ] Derivative Progress: 1806/2085 symbols completed. TFC took 1.3s. Estimated remaining: 1m 48s. Rate: 154.5 symbols/min [2025-09-17T22:58:33.460140] [INFO ] [MAIN ] TG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:33.477776] [DEBUG] [LOCAL ] TFPM: Loaded 36949 existing records from primary storage. [2025-09-17T22:58:33.478076] [INFO ] [MAIN ] TFPM: Loaded 36949 primary data records. [2025-09-17T22:58:33.526123] [DEBUG] [LOCAL ] TG: Loaded 10344 existing records from primary storage. [2025-09-17T22:58:33.553249] [INFO ] [MAIN ] TG: Loaded 10344 primary data records. [2025-09-17T22:58:33.807912] [DEBUG] [LOCAL ] TFX: Loaded 37745 existing records from primary storage. [2025-09-17T22:58:33.937013] [INFO ] [MAIN ] TFX: Loaded 37745 primary data records. [2025-09-17T22:58:34.442285] [DEBUG] [MAIN ] TFPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:34.445603] [INFO ] [MAIN ] TFPM: Generated 1794 derivative records from 36949 primary records. [2025-09-17T22:58:34.458505] [DEBUG] [LOCAL ] TFPM: Saving derivative data. [2025-09-17T22:58:34.460111] [DEBUG] [MAIN ] TG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:34.472820] [INFO ] [MAIN ] TG: Generated 1794 derivative records from 10344 primary records. [2025-09-17T22:58:34.474537] [DEBUG] [LOCAL ] TG: Saving derivative data. [2025-09-17T22:58:34.477909] [DEBUG] [LOCAL ] TFPM: Derivative data saved (1794 records). [2025-09-17T22:58:34.478298] [INFO ] [MAIN ] TFPM: Successfully saved derivative data. [2025-09-17T22:58:34.480345] [INFO ] [MAIN ] Derivative Progress: 1807/2085 symbols completed. TFPM took 1.1s. Estimated remaining: 1m 48s. Rate: 154.4 symbols/min [2025-09-17T22:58:34.480743] [INFO ] [MAIN ] TGLS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:34.508078] [DEBUG] [LOCAL ] TG: Derivative data saved (1794 records). [2025-09-17T22:58:34.512627] [INFO ] [MAIN ] TG: Successfully saved derivative data. [2025-09-17T22:58:34.515206] [INFO ] [MAIN ] Derivative Progress: 1808/2085 symbols completed. TG took 1.1s. Estimated remaining: 1m 48s. Rate: 154.5 symbols/min [2025-09-17T22:58:34.515920] [INFO ] [MAIN ] TGNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:34.516130] [DEBUG] [MAIN ] TFX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:34.517399] [INFO ] [MAIN ] TFX: Generated 1794 derivative records from 37745 primary records. [2025-09-17T22:58:34.517639] [DEBUG] [LOCAL ] TFX: Saving derivative data. [2025-09-17T22:58:34.551060] [DEBUG] [LOCAL ] TFX: Derivative data saved (1794 records). [2025-09-17T22:58:34.550944] [DEBUG] [LOCAL ] TGLS: Loaded 28588 existing records from primary storage. [2025-09-17T22:58:34.551245] [INFO ] [MAIN ] TGLS: Loaded 28588 primary data records. [2025-09-17T22:58:34.551194] [INFO ] [MAIN ] TFX: Successfully saved derivative data. [2025-09-17T22:58:34.553497] [INFO ] [MAIN ] Derivative Progress: 1809/2085 symbols completed. TFX took 1.1s. Estimated remaining: 1m 47s. Rate: 154.5 symbols/min [2025-09-17T22:58:34.565163] [INFO ] [MAIN ] TGS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:34.916418] [DEBUG] [LOCAL ] TGNA: Loaded 48676 existing records from primary storage. [2025-09-17T22:58:34.915639] [DEBUG] [LOCAL ] TGS: Loaded 32159 existing records from primary storage. [2025-09-17T22:58:34.929864] [INFO ] [MAIN ] TGNA: Loaded 48676 primary data records. [2025-09-17T22:58:34.930086] [INFO ] [MAIN ] TGS: Loaded 32159 primary data records. [2025-09-17T22:58:35.581578] [DEBUG] [MAIN ] TGLS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:35.582715] [INFO ] [MAIN ] TGLS: Generated 1794 derivative records from 28588 primary records. [2025-09-17T22:58:35.583896] [DEBUG] [LOCAL ] TGLS: Saving derivative data. [2025-09-17T22:58:35.607980] [DEBUG] [LOCAL ] TGLS: Derivative data saved (1794 records). [2025-09-17T22:58:35.608291] [INFO ] [MAIN ] TGLS: Successfully saved derivative data. [2025-09-17T22:58:35.610477] [INFO ] [MAIN ] Derivative Progress: 1810/2085 symbols completed. TGLS took 1.1s. Estimated remaining: 1m 47s. Rate: 154.4 symbols/min [2025-09-17T22:58:35.611123] [INFO ] [MAIN ] TGT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:35.636724] [DEBUG] [MAIN ] TGS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:35.637910] [INFO ] [MAIN ] TGS: Generated 1794 derivative records from 32159 primary records. [2025-09-17T22:58:35.638121] [DEBUG] [LOCAL ] TGS: Saving derivative data. [2025-09-17T22:58:35.637103] [DEBUG] [MAIN ] TGNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:35.639582] [INFO ] [MAIN ] TGNA: Generated 1794 derivative records from 48676 primary records. [2025-09-17T22:58:35.639716] [DEBUG] [LOCAL ] TGNA: Saving derivative data. [2025-09-17T22:58:35.670266] [DEBUG] [LOCAL ] TGS: Derivative data saved (1794 records). [2025-09-17T22:58:35.670711] [INFO ] [MAIN ] TGS: Successfully saved derivative data. [2025-09-17T22:58:35.679695] [INFO ] [MAIN ] Derivative Progress: 1811/2085 symbols completed. TGS took 1.1s. Estimated remaining: 1m 46s. Rate: 154.5 symbols/min [2025-09-17T22:58:35.680638] [INFO ] [MAIN ] THC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:35.681354] [DEBUG] [LOCAL ] TGNA: Derivative data saved (1794 records). [2025-09-17T22:58:35.681878] [INFO ] [MAIN ] TGNA: Successfully saved derivative data. [2025-09-17T22:58:35.684093] [INFO ] [MAIN ] Derivative Progress: 1812/2085 symbols completed. TGNA took 1.2s. Estimated remaining: 1m 46s. Rate: 154.6 symbols/min [2025-09-17T22:58:35.684474] [INFO ] [MAIN ] THG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:35.735024] [DEBUG] [LOCAL ] THG: Loaded 22174 existing records from primary storage. [2025-09-17T22:58:35.736320] [INFO ] [MAIN ] THG: Loaded 22174 primary data records. [2025-09-17T22:58:35.748850] [DEBUG] [LOCAL ] TGT: Loaded 53778 existing records from primary storage. [2025-09-17T22:58:35.813277] [INFO ] [MAIN ] TGT: Loaded 53778 primary data records. [2025-09-17T22:58:35.986546] [DEBUG] [LOCAL ] THC: Loaded 48343 existing records from primary storage. [2025-09-17T22:58:36.063582] [INFO ] [MAIN ] THC: Loaded 48343 primary data records. [2025-09-17T22:58:36.701667] [DEBUG] [MAIN ] THG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:36.702852] [INFO ] [MAIN ] THG: Generated 1794 derivative records from 22174 primary records. [2025-09-17T22:58:36.703132] [DEBUG] [LOCAL ] THG: Saving derivative data. [2025-09-17T22:58:36.732752] [DEBUG] [MAIN ] TGT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:36.735165] [INFO ] [MAIN ] TGT: Generated 1794 derivative records from 53778 primary records. [2025-09-17T22:58:36.735467] [DEBUG] [LOCAL ] TGT: Saving derivative data. [2025-09-17T22:58:36.764923] [DEBUG] [LOCAL ] THG: Derivative data saved (1794 records). [2025-09-17T22:58:36.765183] [INFO ] [MAIN ] THG: Successfully saved derivative data. [2025-09-17T22:58:36.767413] [INFO ] [MAIN ] Derivative Progress: 1813/2085 symbols completed. THG took 1.1s. Estimated remaining: 1m 46s. Rate: 154.4 symbols/min [2025-09-17T22:58:36.765493] [DEBUG] [MAIN ] THC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:36.769005] [INFO ] [MAIN ] THC: Generated 1794 derivative records from 48343 primary records. [2025-09-17T22:58:36.769486] [DEBUG] [LOCAL ] THC: Saving derivative data. [2025-09-17T22:58:36.780639] [DEBUG] [LOCAL ] TGT: Derivative data saved (1794 records). [2025-09-17T22:58:36.783246] [INFO ] [MAIN ] TGT: Successfully saved derivative data. [2025-09-17T22:58:36.786504] [INFO ] [MAIN ] Derivative Progress: 1814/2085 symbols completed. TGT took 1.2s. Estimated remaining: 1m 45s. Rate: 154.5 symbols/min [2025-09-17T22:58:36.790177] [DEBUG] [LOCAL ] THC: Derivative data saved (1794 records). [2025-09-17T22:58:36.790239] [INFO ] [MAIN ] THC: Successfully saved derivative data. [2025-09-17T22:58:36.792490] [INFO ] [MAIN ] Derivative Progress: 1815/2085 symbols completed. THC took 1.1s. Estimated remaining: 1m 45s. Rate: 154.6 symbols/min [2025-09-17T22:58:36.792945] [INFO ] [MAIN ] THLV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:36.793284] [INFO ] [MAIN ] THO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:36.793615] [INFO ] [MAIN ] THIR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:36.797547] [DEBUG] [LOCAL ] THLV: Loaded 1683 existing records from primary storage. [2025-09-17T22:58:36.797828] [INFO ] [MAIN ] THLV: Loaded 1683 primary data records. [2025-09-17T22:58:36.876614] [DEBUG] [LOCAL ] THIR: Loaded 2143 existing records from primary storage. [2025-09-17T22:58:36.893366] [INFO ] [MAIN ] THIR: Loaded 2143 primary data records. [2025-09-17T22:58:37.320912] [DEBUG] [LOCAL ] THO: Loaded 42467 existing records from primary storage. [2025-09-17T22:58:37.347206] [INFO ] [MAIN ] THO: Loaded 42467 primary data records. [2025-09-17T22:58:37.791041] [DEBUG] [MAIN ] THLV: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-17T22:58:37.792923] [INFO ] [MAIN ] THLV: Generated 1792 derivative records from 1683 primary records. [2025-09-17T22:58:37.793021] [DEBUG] [LOCAL ] THLV: Saving derivative data. [2025-09-17T22:58:37.808167] [DEBUG] [LOCAL ] THLV: Derivative data saved (1792 records). [2025-09-17T22:58:37.821472] [INFO ] [MAIN ] THLV: Successfully saved derivative data. [2025-09-17T22:58:37.823730] [INFO ] [MAIN ] Derivative Progress: 1816/2085 symbols completed. THLV took 1.0s. Estimated remaining: 1m 45s. Rate: 154.4 symbols/min [2025-09-17T22:58:37.824133] [INFO ] [MAIN ] THQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:37.824488] [DEBUG] [MAIN ] THIR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:58:37.825760] [INFO ] [MAIN ] THIR: Generated 1793 derivative records from 2143 primary records. [2025-09-17T22:58:37.825847] [DEBUG] [LOCAL ] THIR: Saving derivative data. [2025-09-17T22:58:37.843168] [DEBUG] [LOCAL ] THIR: Derivative data saved (1793 records). [2025-09-17T22:58:37.843313] [INFO ] [MAIN ] THIR: Successfully saved derivative data. [2025-09-17T22:58:37.845780] [INFO ] [MAIN ] Derivative Progress: 1817/2085 symbols completed. THIR took 1.1s. Estimated remaining: 1m 44s. Rate: 154.5 symbols/min [2025-09-17T22:58:37.851583] [INFO ] [MAIN ] THR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:37.864483] [DEBUG] [MAIN ] THO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:37.865206] [INFO ] [MAIN ] THO: Generated 1794 derivative records from 42467 primary records. [2025-09-17T22:58:37.865419] [DEBUG] [LOCAL ] THO: Saving derivative data. [2025-09-17T22:58:37.889076] [DEBUG] [LOCAL ] THO: Derivative data saved (1794 records). [2025-09-17T22:58:37.889288] [INFO ] [MAIN ] THO: Successfully saved derivative data. [2025-09-17T22:58:37.889739] [DEBUG] [LOCAL ] THQ: Loaded 24329 existing records from primary storage. [2025-09-17T22:58:37.892018] [INFO ] [MAIN ] Derivative Progress: 1818/2085 symbols completed. THO took 1.1s. Estimated remaining: 1m 44s. Rate: 154.6 symbols/min [2025-09-17T22:58:37.896376] [INFO ] [MAIN ] THQ: Loaded 24329 primary data records. [2025-09-17T22:58:37.896762] [INFO ] [MAIN ] THS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:37.996848] [DEBUG] [LOCAL ] THR: Loaded 20031 existing records from primary storage. [2025-09-17T22:58:38.008024] [INFO ] [MAIN ] THR: Loaded 20031 primary data records. [2025-09-17T22:58:38.352546] [DEBUG] [LOCAL ] THS: Loaded 37954 existing records from primary storage. [2025-09-17T22:58:38.411504] [INFO ] [MAIN ] THS: Loaded 37954 primary data records. [2025-09-17T22:58:38.916552] [DEBUG] [MAIN ] THQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:38.918947] [INFO ] [MAIN ] THQ: Generated 1794 derivative records from 24329 primary records. [2025-09-17T22:58:38.919852] [DEBUG] [LOCAL ] THQ: Saving derivative data. [2025-09-17T22:58:38.947885] [DEBUG] [MAIN ] THR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:38.949867] [INFO ] [MAIN ] THR: Generated 1794 derivative records from 20031 primary records. [2025-09-17T22:58:38.950448] [DEBUG] [LOCAL ] THR: Saving derivative data. [2025-09-17T22:58:38.968415] [DEBUG] [LOCAL ] THQ: Derivative data saved (1794 records). [2025-09-17T22:58:38.968685] [INFO ] [MAIN ] THQ: Successfully saved derivative data. [2025-09-17T22:58:38.970746] [INFO ] [MAIN ] Derivative Progress: 1819/2085 symbols completed. THQ took 1.1s. Estimated remaining: 1m 43s. Rate: 154.4 symbols/min [2025-09-17T22:58:38.972405] [INFO ] [MAIN ] THW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:38.977494] [DEBUG] [LOCAL ] THR: Derivative data saved (1794 records). [2025-09-17T22:58:38.979496] [INFO ] [MAIN ] THR: Successfully saved derivative data. [2025-09-17T22:58:38.982142] [INFO ] [MAIN ] Derivative Progress: 1820/2085 symbols completed. THR took 1.1s. Estimated remaining: 1m 43s. Rate: 154.5 symbols/min [2025-09-17T22:58:38.982949] [INFO ] [MAIN ] TIMB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:39.001232] [DEBUG] [MAIN ] THS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:39.002581] [INFO ] [MAIN ] THS: Generated 1794 derivative records from 37954 primary records. [2025-09-17T22:58:39.002753] [DEBUG] [LOCAL ] THS: Saving derivative data. [2025-09-17T22:58:39.018769] [DEBUG] [LOCAL ] THW: Loaded 19172 existing records from primary storage. [2025-09-17T22:58:39.022598] [INFO ] [MAIN ] THW: Loaded 19172 primary data records. [2025-09-17T22:58:39.110694] [DEBUG] [LOCAL ] THS: Derivative data saved (1794 records). [2025-09-17T22:58:39.132246] [INFO ] [MAIN ] THS: Successfully saved derivative data. [2025-09-17T22:58:39.149024] [INFO ] [MAIN ] Derivative Progress: 1821/2085 symbols completed. THS took 1.3s. Estimated remaining: 1m 42s. Rate: 154.6 symbols/min [2025-09-17T22:58:39.159802] [INFO ] [MAIN ] TISI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:39.350860] [DEBUG] [LOCAL ] TIMB: Loaded 37186 existing records from primary storage. [2025-09-17T22:58:39.353839] [DEBUG] [LOCAL ] TISI: Loaded 3865 existing records from primary storage. [2025-09-17T22:58:39.354022] [INFO ] [MAIN ] TISI: Loaded 3865 primary data records. [2025-09-17T22:58:39.353671] [INFO ] [MAIN ] TIMB: Loaded 37186 primary data records. [2025-09-17T22:58:39.993887] [DEBUG] [MAIN ] THW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:39.995704] [INFO ] [MAIN ] THW: Generated 1794 derivative records from 19172 primary records. [2025-09-17T22:58:39.996037] [DEBUG] [LOCAL ] THW: Saving derivative data. [2025-09-17T22:58:40.019694] [DEBUG] [LOCAL ] THW: Derivative data saved (1794 records). [2025-09-17T22:58:40.022755] [INFO ] [MAIN ] THW: Successfully saved derivative data. [2025-09-17T22:58:40.026870] [INFO ] [MAIN ] Derivative Progress: 1822/2085 symbols completed. THW took 1.1s. Estimated remaining: 1m 42s. Rate: 154.4 symbols/min [2025-09-17T22:58:40.028109] [INFO ] [MAIN ] TIXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:40.049548] [DEBUG] [MAIN ] TIMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:40.054729] [DEBUG] [MAIN ] TISI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:40.055929] [INFO ] [MAIN ] TIMB: Generated 1794 derivative records from 37186 primary records. [2025-09-17T22:58:40.056760] [INFO ] [MAIN ] TISI: Generated 1794 derivative records from 3865 primary records. [2025-09-17T22:58:40.056907] [DEBUG] [LOCAL ] TIMB: Saving derivative data. [2025-09-17T22:58:40.057906] [DEBUG] [LOCAL ] TISI: Saving derivative data. [2025-09-17T22:58:40.094940] [DEBUG] [LOCAL ] TISI: Derivative data saved (1794 records). [2025-09-17T22:58:40.095923] [INFO ] [MAIN ] TISI: Successfully saved derivative data. [2025-09-17T22:58:40.098805] [INFO ] [MAIN ] Derivative Progress: 1823/2085 symbols completed. TISI took 0.9s. Estimated remaining: 1m 42s. Rate: 154.5 symbols/min [2025-09-17T22:58:40.099686] [DEBUG] [LOCAL ] TIMB: Derivative data saved (1794 records). [2025-09-17T22:58:40.099566] [INFO ] [MAIN ] TJX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:40.100351] [INFO ] [MAIN ] TIMB: Successfully saved derivative data. [2025-09-17T22:58:40.105167] [INFO ] [MAIN ] Derivative Progress: 1824/2085 symbols completed. TIMB took 1.1s. Estimated remaining: 1m 41s. Rate: 154.6 symbols/min [2025-09-17T22:58:40.114878] [INFO ] [MAIN ] TK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:40.115835] [DEBUG] [LOCAL ] TIXT: Loaded 31119 existing records from primary storage. [2025-09-17T22:58:40.117071] [INFO ] [MAIN ] TIXT: Loaded 31119 primary data records. [2025-09-17T22:58:40.450815] [DEBUG] [LOCAL ] TK: Loaded 39998 existing records from primary storage. [2025-09-17T22:58:40.451205] [INFO ] [MAIN ] TK: Loaded 39998 primary data records. [2025-09-17T22:58:40.614576] [DEBUG] [LOCAL ] TJX: Loaded 53676 existing records from primary storage. [2025-09-17T22:58:40.634771] [INFO ] [MAIN ] TJX: Loaded 53676 primary data records. [2025-09-17T22:58:41.169714] [DEBUG] [MAIN ] TIXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:41.170725] [INFO ] [MAIN ] TIXT: Generated 1794 derivative records from 31119 primary records. [2025-09-17T22:58:41.171053] [DEBUG] [LOCAL ] TIXT: Saving derivative data. [2025-09-17T22:58:41.195919] [DEBUG] [LOCAL ] TIXT: Derivative data saved (1794 records). [2025-09-17T22:58:41.196263] [INFO ] [MAIN ] TIXT: Successfully saved derivative data. [2025-09-17T22:58:41.198542] [INFO ] [MAIN ] Derivative Progress: 1825/2085 symbols completed. TIXT took 1.2s. Estimated remaining: 1m 41s. Rate: 154.4 symbols/min [2025-09-17T22:58:41.198901] [INFO ] [MAIN ] TKC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:41.212373] [DEBUG] [MAIN ] TK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:41.213250] [INFO ] [MAIN ] TK: Generated 1794 derivative records from 39998 primary records. [2025-09-17T22:58:41.213614] [DEBUG] [LOCAL ] TK: Saving derivative data. [2025-09-17T22:58:41.231540] [DEBUG] [LOCAL ] TK: Derivative data saved (1794 records). [2025-09-17T22:58:41.232356] [INFO ] [MAIN ] TK: Successfully saved derivative data. [2025-09-17T22:58:41.235013] [INFO ] [MAIN ] Derivative Progress: 1826/2085 symbols completed. TK took 1.1s. Estimated remaining: 1m 41s. Rate: 154.5 symbols/min [2025-09-17T22:58:41.235430] [INFO ] [MAIN ] TKO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:41.248744] [DEBUG] [MAIN ] TJX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:41.249604] [INFO ] [MAIN ] TJX: Generated 1794 derivative records from 53676 primary records. [2025-09-17T22:58:41.250265] [DEBUG] [LOCAL ] TJX: Saving derivative data. [2025-09-17T22:58:41.276699] [DEBUG] [LOCAL ] TJX: Derivative data saved (1794 records). [2025-09-17T22:58:41.287410] [INFO ] [MAIN ] TJX: Successfully saved derivative data. [2025-09-17T22:58:41.290118] [INFO ] [MAIN ] Derivative Progress: 1827/2085 symbols completed. TJX took 1.2s. Estimated remaining: 1m 40s. Rate: 154.6 symbols/min [2025-09-17T22:58:41.291327] [DEBUG] [LOCAL ] TKC: Loaded 37765 existing records from primary storage. [2025-09-17T22:58:41.291726] [INFO ] [MAIN ] TKC: Loaded 37765 primary data records. [2025-09-17T22:58:41.291773] [INFO ] [MAIN ] TKR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:41.629341] [DEBUG] [LOCAL ] TKO: Loaded 44407 existing records from primary storage. [2025-09-17T22:58:41.639308] [INFO ] [MAIN ] TKO: Loaded 44407 primary data records. [2025-09-17T22:58:41.797219] [DEBUG] [LOCAL ] TKR: Loaded 40203 existing records from primary storage. [2025-09-17T22:58:41.851325] [INFO ] [MAIN ] TKR: Loaded 40203 primary data records. [2025-09-17T22:58:42.312920] [DEBUG] [MAIN ] TKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:42.314696] [INFO ] [MAIN ] TKC: Generated 1794 derivative records from 37765 primary records. [2025-09-17T22:58:42.314920] [DEBUG] [LOCAL ] TKC: Saving derivative data. [2025-09-17T22:58:42.349682] [DEBUG] [MAIN ] TKO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:42.350976] [INFO ] [MAIN ] TKO: Generated 1794 derivative records from 44407 primary records. [2025-09-17T22:58:42.349305] [DEBUG] [LOCAL ] TKC: Derivative data saved (1794 records). [2025-09-17T22:58:42.351233] [INFO ] [MAIN ] TKC: Successfully saved derivative data. [2025-09-17T22:58:42.351164] [DEBUG] [LOCAL ] TKO: Saving derivative data. [2025-09-17T22:58:42.354500] [INFO ] [MAIN ] Derivative Progress: 1828/2085 symbols completed. TKC took 1.2s. Estimated remaining: 1m 40s. Rate: 154.5 symbols/min [2025-09-17T22:58:42.371708] [DEBUG] [LOCAL ] TKO: Derivative data saved (1794 records). [2025-09-17T22:58:42.371861] [INFO ] [MAIN ] TKO: Successfully saved derivative data. [2025-09-17T22:58:42.374328] [INFO ] [MAIN ] Derivative Progress: 1829/2085 symbols completed. TKO took 1.1s. Estimated remaining: 1m 39s. Rate: 154.5 symbols/min [2025-09-17T22:58:42.390032] [DEBUG] [MAIN ] TKR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:42.390566] [INFO ] [MAIN ] TKR: Generated 1794 derivative records from 40203 primary records. [2025-09-17T22:58:42.390626] [DEBUG] [LOCAL ] TKR: Saving derivative data. [2025-09-17T22:58:42.406275] [DEBUG] [LOCAL ] TKR: Derivative data saved (1794 records). [2025-09-17T22:58:42.406346] [INFO ] [MAIN ] TKR: Successfully saved derivative data. [2025-09-17T22:58:42.409562] [INFO ] [MAIN ] Derivative Progress: 1830/2085 symbols completed. TKR took 1.1s. Estimated remaining: 1m 39s. Rate: 154.6 symbols/min [2025-09-17T22:58:42.410328] [INFO ] [MAIN ] TLYS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:42.410457] [INFO ] [MAIN ] TME: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:42.410495] [INFO ] [MAIN ] TLK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:42.432021] [DEBUG] [LOCAL ] TLYS: Loaded 17016 existing records from primary storage. [2025-09-17T22:58:42.432321] [INFO ] [MAIN ] TLYS: Loaded 17016 primary data records. [2025-09-17T22:58:42.766883] [DEBUG] [LOCAL ] TLK: Loaded 39982 existing records from primary storage. [2025-09-17T22:58:42.767110] [INFO ] [MAIN ] TLK: Loaded 39982 primary data records. [2025-09-17T22:58:42.895932] [DEBUG] [LOCAL ] TME: Loaded 53200 existing records from primary storage. [2025-09-17T22:58:42.936882] [INFO ] [MAIN ] TME: Loaded 53200 primary data records. [2025-09-17T22:58:43.487376] [DEBUG] [MAIN ] TLYS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:43.489029] [INFO ] [MAIN ] TLYS: Generated 1794 derivative records from 17016 primary records. [2025-09-17T22:58:43.490056] [DEBUG] [LOCAL ] TLYS: Saving derivative data. [2025-09-17T22:58:43.524920] [DEBUG] [LOCAL ] TLYS: Derivative data saved (1794 records). [2025-09-17T22:58:43.525457] [INFO ] [MAIN ] TLYS: Successfully saved derivative data. [2025-09-17T22:58:43.525376] [DEBUG] [MAIN ] TLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:43.526420] [INFO ] [MAIN ] TLK: Generated 1794 derivative records from 39982 primary records. [2025-09-17T22:58:43.529685] [DEBUG] [LOCAL ] TLK: Saving derivative data. [2025-09-17T22:58:43.529349] [INFO ] [MAIN ] Derivative Progress: 1831/2085 symbols completed. TLYS took 1.1s. Estimated remaining: 1m 39s. Rate: 154.4 symbols/min [2025-09-17T22:58:43.531269] [INFO ] [MAIN ] TMHC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:43.549108] [DEBUG] [LOCAL ] TLK: Derivative data saved (1794 records). [2025-09-17T22:58:43.549588] [INFO ] [MAIN ] TLK: Successfully saved derivative data. [2025-09-17T22:58:43.551594] [INFO ] [MAIN ] Derivative Progress: 1832/2085 symbols completed. TLK took 1.1s. Estimated remaining: 1m 38s. Rate: 154.5 symbols/min [2025-09-17T22:58:43.552110] [INFO ] [MAIN ] TMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:43.565496] [DEBUG] [MAIN ] TME: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:43.566348] [INFO ] [MAIN ] TME: Generated 1794 derivative records from 53200 primary records. [2025-09-17T22:58:43.566460] [DEBUG] [LOCAL ] TME: Saving derivative data. [2025-09-17T22:58:43.583458] [DEBUG] [LOCAL ] TME: Derivative data saved (1794 records). [2025-09-17T22:58:43.583611] [INFO ] [MAIN ] TME: Successfully saved derivative data. [2025-09-17T22:58:43.586297] [INFO ] [MAIN ] Derivative Progress: 1833/2085 symbols completed. TME took 1.2s. Estimated remaining: 1m 38s. Rate: 154.6 symbols/min [2025-09-17T22:58:43.586672] [INFO ] [MAIN ] TNC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:43.631785] [DEBUG] [LOCAL ] TNC: Loaded 15489 existing records from primary storage. [2025-09-17T22:58:43.631965] [INFO ] [MAIN ] TNC: Loaded 15489 primary data records. [2025-09-17T22:58:43.755667] [DEBUG] [LOCAL ] TMHC: Loaded 45617 existing records from primary storage. [2025-09-17T22:58:43.771143] [INFO ] [MAIN ] TMHC: Loaded 45617 primary data records. [2025-09-17T22:58:43.805159] [DEBUG] [LOCAL ] TMO: Loaded 52380 existing records from primary storage. [2025-09-17T22:58:43.915707] [INFO ] [MAIN ] TMO: Loaded 52380 primary data records. [2025-09-17T22:58:44.654708] [DEBUG] [MAIN ] TNC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:44.655944] [INFO ] [MAIN ] TNC: Generated 1794 derivative records from 15489 primary records. [2025-09-17T22:58:44.656426] [DEBUG] [LOCAL ] TNC: Saving derivative data. [2025-09-17T22:58:44.688131] [DEBUG] [MAIN ] TMHC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:44.689718] [INFO ] [MAIN ] TMHC: Generated 1794 derivative records from 45617 primary records. [2025-09-17T22:58:44.690216] [DEBUG] [LOCAL ] TMHC: Saving derivative data. [2025-09-17T22:58:44.704199] [DEBUG] [LOCAL ] TNC: Derivative data saved (1794 records). [2025-09-17T22:58:44.706365] [INFO ] [MAIN ] TNC: Successfully saved derivative data. [2025-09-17T22:58:44.708261] [INFO ] [MAIN ] Derivative Progress: 1834/2085 symbols completed. TNC took 1.1s. Estimated remaining: 1m 38s. Rate: 154.4 symbols/min [2025-09-17T22:58:44.708883] [INFO ] [MAIN ] TNET: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:44.712785] [DEBUG] [LOCAL ] TMHC: Derivative data saved (1794 records). [2025-09-17T22:58:44.713103] [INFO ] [MAIN ] TMHC: Successfully saved derivative data. [2025-09-17T22:58:44.715887] [INFO ] [MAIN ] Derivative Progress: 1835/2085 symbols completed. TMHC took 1.2s. Estimated remaining: 1m 37s. Rate: 154.5 symbols/min [2025-09-17T22:58:44.716338] [INFO ] [MAIN ] TNK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:44.735187] [DEBUG] [MAIN ] TMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:44.736157] [INFO ] [MAIN ] TMO: Generated 1794 derivative records from 52380 primary records. [2025-09-17T22:58:44.736266] [DEBUG] [LOCAL ] TMO: Saving derivative data. [2025-09-17T22:58:44.763874] [DEBUG] [LOCAL ] TMO: Derivative data saved (1794 records). [2025-09-17T22:58:44.764137] [INFO ] [MAIN ] TMO: Successfully saved derivative data. [2025-09-17T22:58:44.766789] [INFO ] [MAIN ] Derivative Progress: 1836/2085 symbols completed. TMO took 1.2s. Estimated remaining: 1m 37s. Rate: 154.6 symbols/min [2025-09-17T22:58:44.767260] [INFO ] [MAIN ] TNL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:44.786131] [DEBUG] [LOCAL ] TNET: Loaded 29173 existing records from primary storage. [2025-09-17T22:58:44.786268] [INFO ] [MAIN ] TNET: Loaded 29173 primary data records. [2025-09-17T22:58:44.905674] [DEBUG] [LOCAL ] TNK: Loaded 35499 existing records from primary storage. [2025-09-17T22:58:44.906225] [INFO ] [MAIN ] TNK: Loaded 35499 primary data records. [2025-09-17T22:58:45.356169] [DEBUG] [LOCAL ] TNL: Loaded 42043 existing records from primary storage. [2025-09-17T22:58:45.356791] [INFO ] [MAIN ] TNL: Loaded 42043 primary data records. [2025-09-17T22:58:45.807962] [DEBUG] [MAIN ] TNET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:45.809260] [INFO ] [MAIN ] TNET: Generated 1794 derivative records from 29173 primary records. [2025-09-17T22:58:45.809379] [DEBUG] [LOCAL ] TNET: Saving derivative data. [2025-09-17T22:58:45.830613] [DEBUG] [MAIN ] TNK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:45.836289] [INFO ] [MAIN ] TNK: Generated 1794 derivative records from 35499 primary records. [2025-09-17T22:58:45.836524] [DEBUG] [LOCAL ] TNK: Saving derivative data. [2025-09-17T22:58:45.847455] [DEBUG] [LOCAL ] TNET: Derivative data saved (1794 records). [2025-09-17T22:58:45.850995] [INFO ] [MAIN ] TNET: Successfully saved derivative data. [2025-09-17T22:58:45.854617] [INFO ] [MAIN ] Derivative Progress: 1837/2085 symbols completed. TNET took 1.1s. Estimated remaining: 1m 36s. Rate: 154.4 symbols/min [2025-09-17T22:58:45.856146] [INFO ] [MAIN ] TOL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:45.859131] [DEBUG] [LOCAL ] TNK: Derivative data saved (1794 records). [2025-09-17T22:58:45.859210] [INFO ] [MAIN ] TNK: Successfully saved derivative data. [2025-09-17T22:58:45.861559] [INFO ] [MAIN ] Derivative Progress: 1838/2085 symbols completed. TNK took 1.1s. Estimated remaining: 1m 36s. Rate: 154.5 symbols/min [2025-09-17T22:58:45.861890] [INFO ] [MAIN ] TOST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:45.880415] [DEBUG] [MAIN ] TNL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:45.881318] [INFO ] [MAIN ] TNL: Generated 1794 derivative records from 42043 primary records. [2025-09-17T22:58:45.881549] [DEBUG] [LOCAL ] TNL: Saving derivative data. [2025-09-17T22:58:45.900685] [DEBUG] [LOCAL ] TNL: Derivative data saved (1794 records). [2025-09-17T22:58:45.900888] [INFO ] [MAIN ] TNL: Successfully saved derivative data. [2025-09-17T22:58:45.904187] [INFO ] [MAIN ] Derivative Progress: 1839/2085 symbols completed. TNL took 1.1s. Estimated remaining: 1m 35s. Rate: 154.6 symbols/min [2025-09-17T22:58:45.904727] [INFO ] [MAIN ] TPB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:45.973082] [DEBUG] [LOCAL ] TOST: Loaded 53681 existing records from primary storage. [2025-09-17T22:58:45.973289] [INFO ] [MAIN ] TOST: Loaded 53681 primary data records. [2025-09-17T22:58:45.973819] [DEBUG] [LOCAL ] TPB: Loaded 24996 existing records from primary storage. [2025-09-17T22:58:45.995347] [INFO ] [MAIN ] TPB: Loaded 24996 primary data records. [2025-09-17T22:58:46.144308] [DEBUG] [LOCAL ] TOL: Loaded 51126 existing records from primary storage. [2025-09-17T22:58:46.159791] [INFO ] [MAIN ] TOL: Loaded 51126 primary data records. [2025-09-17T22:58:47.061398] [DEBUG] [MAIN ] TOST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:47.062739] [INFO ] [MAIN ] TOST: Generated 1794 derivative records from 53681 primary records. [2025-09-17T22:58:47.062943] [DEBUG] [LOCAL ] TOST: Saving derivative data. [2025-09-17T22:58:47.083373] [DEBUG] [LOCAL ] TOST: Derivative data saved (1794 records). [2025-09-17T22:58:47.100783] [INFO ] [MAIN ] TOST: Successfully saved derivative data. [2025-09-17T22:58:47.105006] [DEBUG] [MAIN ] TPB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:47.104543] [INFO ] [MAIN ] Derivative Progress: 1840/2085 symbols completed. TOST took 1.2s. Estimated remaining: 1m 35s. Rate: 154.4 symbols/min [2025-09-17T22:58:47.106051] [INFO ] [MAIN ] TPB: Generated 1794 derivative records from 24996 primary records. [2025-09-17T22:58:47.107427] [INFO ] [MAIN ] TPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:47.109402] [DEBUG] [LOCAL ] TPB: Saving derivative data. [2025-09-17T22:58:47.138756] [DEBUG] [MAIN ] TOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:47.141360] [INFO ] [MAIN ] TOL: Generated 1794 derivative records from 51126 primary records. [2025-09-17T22:58:47.140587] [DEBUG] [LOCAL ] TPB: Derivative data saved (1794 records). [2025-09-17T22:58:47.141462] [INFO ] [MAIN ] TPB: Successfully saved derivative data. [2025-09-17T22:58:47.143996] [INFO ] [MAIN ] Derivative Progress: 1841/2085 symbols completed. TPB took 1.2s. Estimated remaining: 1m 35s. Rate: 154.5 symbols/min [2025-09-17T22:58:47.141543] [DEBUG] [LOCAL ] TOL: Saving derivative data. [2025-09-17T22:58:47.144970] [INFO ] [MAIN ] TPH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:47.179600] [DEBUG] [LOCAL ] TOL: Derivative data saved (1794 records). [2025-09-17T22:58:47.179840] [INFO ] [MAIN ] TOL: Successfully saved derivative data. [2025-09-17T22:58:47.183189] [INFO ] [MAIN ] Derivative Progress: 1842/2085 symbols completed. TOL took 1.3s. Estimated remaining: 1m 34s. Rate: 154.6 symbols/min [2025-09-17T22:58:47.183680] [INFO ] [MAIN ] TPL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:47.216100] [DEBUG] [LOCAL ] TPC: Loaded 38922 existing records from primary storage. [2025-09-17T22:58:47.216395] [INFO ] [MAIN ] TPC: Loaded 38922 primary data records. [2025-09-17T22:58:47.311949] [DEBUG] [LOCAL ] TPL: Loaded 12466 existing records from primary storage. [2025-09-17T22:58:47.323017] [INFO ] [MAIN ] TPL: Loaded 12466 primary data records. [2025-09-17T22:58:47.403147] [DEBUG] [LOCAL ] TPH: Loaded 45324 existing records from primary storage. [2025-09-17T22:58:47.471882] [INFO ] [MAIN ] TPH: Loaded 45324 primary data records. [2025-09-17T22:58:48.233800] [DEBUG] [MAIN ] TPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:48.235979] [INFO ] [MAIN ] TPC: Generated 1794 derivative records from 38922 primary records. [2025-09-17T22:58:48.236242] [DEBUG] [LOCAL ] TPC: Saving derivative data. [2025-09-17T22:58:48.234724] [DEBUG] [MAIN ] TPL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:48.238505] [INFO ] [MAIN ] TPL: Generated 1794 derivative records from 12466 primary records. [2025-09-17T22:58:48.238841] [DEBUG] [LOCAL ] TPL: Saving derivative data. [2025-09-17T22:58:48.277276] [DEBUG] [LOCAL ] TPC: Derivative data saved (1794 records). [2025-09-17T22:58:48.285744] [INFO ] [MAIN ] TPC: Successfully saved derivative data. [2025-09-17T22:58:48.288058] [INFO ] [MAIN ] Derivative Progress: 1843/2085 symbols completed. TPC took 1.2s. Estimated remaining: 1m 34s. Rate: 154.4 symbols/min [2025-09-17T22:58:48.285540] [DEBUG] [LOCAL ] TPL: Derivative data saved (1794 records). [2025-09-17T22:58:48.293422] [DEBUG] [MAIN ] TPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:48.288246] [INFO ] [MAIN ] TPL: Successfully saved derivative data. [2025-09-17T22:58:48.296704] [INFO ] [MAIN ] Derivative Progress: 1844/2085 symbols completed. TPL took 1.1s. Estimated remaining: 1m 34s. Rate: 154.5 symbols/min [2025-09-17T22:58:48.294194] [INFO ] [MAIN ] TPH: Generated 1794 derivative records from 45324 primary records. [2025-09-17T22:58:48.296826] [DEBUG] [LOCAL ] TPH: Saving derivative data. [2025-09-17T22:58:48.312428] [DEBUG] [LOCAL ] TPH: Derivative data saved (1794 records). [2025-09-17T22:58:48.312488] [INFO ] [MAIN ] TPH: Successfully saved derivative data. [2025-09-17T22:58:48.315944] [INFO ] [MAIN ] Derivative Progress: 1845/2085 symbols completed. TPH took 1.2s. Estimated remaining: 1m 33s. Rate: 154.6 symbols/min [2025-09-17T22:58:48.316779] [INFO ] [MAIN ] TPVG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:48.316948] [INFO ] [MAIN ] TPR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:48.317132] [INFO ] [MAIN ] TPYP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:48.331356] [DEBUG] [LOCAL ] TPYP: Loaded 7993 existing records from primary storage. [2025-09-17T22:58:48.331485] [INFO ] [MAIN ] TPYP: Loaded 7993 primary data records. [2025-09-17T22:58:48.454748] [DEBUG] [LOCAL ] TPVG: Loaded 27116 existing records from primary storage. [2025-09-17T22:58:48.465418] [INFO ] [MAIN ] TPVG: Loaded 27116 primary data records. [2025-09-17T22:58:48.879962] [DEBUG] [LOCAL ] TPR: Loaded 53485 existing records from primary storage. [2025-09-17T22:58:49.035364] [INFO ] [MAIN ] TPR: Loaded 53485 primary data records. [2025-09-17T22:58:49.374502] [DEBUG] [MAIN ] TPYP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:49.375849] [INFO ] [MAIN ] TPYP: Generated 1794 derivative records from 7993 primary records. [2025-09-17T22:58:49.376430] [DEBUG] [LOCAL ] TPYP: Saving derivative data. [2025-09-17T22:58:49.409050] [DEBUG] [MAIN ] TPVG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:49.410956] [INFO ] [MAIN ] TPVG: Generated 1794 derivative records from 27116 primary records. [2025-09-17T22:58:49.411675] [DEBUG] [LOCAL ] TPVG: Saving derivative data. [2025-09-17T22:58:49.421634] [DEBUG] [LOCAL ] TPYP: Derivative data saved (1794 records). [2025-09-17T22:58:49.421976] [INFO ] [MAIN ] TPYP: Successfully saved derivative data. [2025-09-17T22:58:49.424332] [INFO ] [MAIN ] Derivative Progress: 1846/2085 symbols completed. TPYP took 1.1s. Estimated remaining: 1m 33s. Rate: 154.4 symbols/min [2025-09-17T22:58:49.427362] [INFO ] [MAIN ] TPZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:49.437590] [DEBUG] [LOCAL ] TPVG: Derivative data saved (1794 records). [2025-09-17T22:58:49.438007] [INFO ] [MAIN ] TPVG: Successfully saved derivative data. [2025-09-17T22:58:49.440412] [INFO ] [MAIN ] Derivative Progress: 1847/2085 symbols completed. TPVG took 1.1s. Estimated remaining: 1m 32s. Rate: 154.5 symbols/min [2025-09-17T22:58:49.440730] [INFO ] [MAIN ] TR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:49.444702] [DEBUG] [LOCAL ] TPZ: Loaded 5302 existing records from primary storage. [2025-09-17T22:58:49.445291] [INFO ] [MAIN ] TPZ: Loaded 5302 primary data records. [2025-09-17T22:58:49.481916] [DEBUG] [MAIN ] TPR: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:58:49.499227] [INFO ] [MAIN ] TPR: Generated 1793 derivative records from 53485 primary records. [2025-09-17T22:58:49.519261] [DEBUG] [LOCAL ] TPR: Saving derivative data. [2025-09-17T22:58:49.620227] [DEBUG] [LOCAL ] TPR: Derivative data saved (1793 records). [2025-09-17T22:58:49.631071] [INFO ] [MAIN ] TPR: Successfully saved derivative data. [2025-09-17T22:58:49.630953] [DEBUG] [LOCAL ] TR: Loaded 18171 existing records from primary storage. [2025-09-17T22:58:49.700682] [INFO ] [MAIN ] TR: Loaded 18171 primary data records. [2025-09-17T22:58:49.690365] [INFO ] [MAIN ] Derivative Progress: 1848/2085 symbols completed. TPR took 1.4s. Estimated remaining: 1m 32s. Rate: 154.5 symbols/min [2025-09-17T22:58:49.701276] [INFO ] [MAIN ] TRAK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:49.977482] [DEBUG] [LOCAL ] TRAK: Loaded 9421 existing records from primary storage. [2025-09-17T22:58:49.984001] [INFO ] [MAIN ] TRAK: Loaded 9421 primary data records. [2025-09-17T22:58:50.496214] [DEBUG] [MAIN ] TPZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:50.498415] [INFO ] [MAIN ] TPZ: Generated 1794 derivative records from 5302 primary records. [2025-09-17T22:58:50.511261] [DEBUG] [LOCAL ] TPZ: Saving derivative data. [2025-09-17T22:58:50.839267] [DEBUG] [LOCAL ] TPZ: Derivative data saved (1794 records). [2025-09-17T22:58:50.840146] [INFO ] [MAIN ] TPZ: Successfully saved derivative data. [2025-09-17T22:58:50.843874] [INFO ] [MAIN ] Derivative Progress: 1849/2085 symbols completed. TPZ took 1.4s. Estimated remaining: 1m 32s. Rate: 154.4 symbols/min [2025-09-17T22:58:50.844842] [INFO ] [MAIN ] TRC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:50.880753] [DEBUG] [MAIN ] TR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:50.882198] [INFO ] [MAIN ] TR: Generated 1794 derivative records from 18171 primary records. [2025-09-17T22:58:50.882501] [DEBUG] [LOCAL ] TR: Saving derivative data. [2025-09-17T22:58:50.920096] [DEBUG] [LOCAL ] TR: Derivative data saved (1794 records). [2025-09-17T22:58:50.919947] [DEBUG] [LOCAL ] TRC: Loaded 15990 existing records from primary storage. [2025-09-17T22:58:50.920737] [INFO ] [MAIN ] TRC: Loaded 15990 primary data records. [2025-09-17T22:58:50.920814] [INFO ] [MAIN ] TR: Successfully saved derivative data. [2025-09-17T22:58:50.964122] [INFO ] [MAIN ] Derivative Progress: 1850/2085 symbols completed. TR took 1.5s. Estimated remaining: 1m 31s. Rate: 154.4 symbols/min [2025-09-17T22:58:51.038272] [INFO ] [MAIN ] TREX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:51.115361] [DEBUG] [MAIN ] TRAK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:51.156552] [INFO ] [MAIN ] TRAK: Generated 1794 derivative records from 9421 primary records. [2025-09-17T22:58:51.159965] [DEBUG] [LOCAL ] TRAK: Saving derivative data. [2025-09-17T22:58:51.299489] [DEBUG] [LOCAL ] TRAK: Derivative data saved (1794 records). [2025-09-17T22:58:51.299622] [INFO ] [MAIN ] TRAK: Successfully saved derivative data. [2025-09-17T22:58:51.302098] [INFO ] [MAIN ] Derivative Progress: 1851/2085 symbols completed. TRAK took 1.6s. Estimated remaining: 1m 31s. Rate: 154.4 symbols/min [2025-09-17T22:58:51.302729] [INFO ] [MAIN ] TRGP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:51.360609] [DEBUG] [MAIN ] TRC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:51.362592] [INFO ] [MAIN ] TRC: Generated 1794 derivative records from 15990 primary records. [2025-09-17T22:58:51.362832] [DEBUG] [LOCAL ] TRC: Saving derivative data. [2025-09-17T22:58:51.363596] [DEBUG] [LOCAL ] TREX: Loaded 49969 existing records from primary storage. [2025-09-17T22:58:51.365001] [INFO ] [MAIN ] TREX: Loaded 49969 primary data records. [2025-09-17T22:58:51.533038] [DEBUG] [LOCAL ] TRGP: Loaded 50883 existing records from primary storage. [2025-09-17T22:58:51.521877] [DEBUG] [LOCAL ] TRC: Derivative data saved (1794 records). [2025-09-17T22:58:51.543542] [INFO ] [MAIN ] TRC: Successfully saved derivative data. [2025-09-17T22:58:51.543478] [INFO ] [MAIN ] TRGP: Loaded 50883 primary data records. [2025-09-17T22:58:51.568411] [INFO ] [MAIN ] Derivative Progress: 1852/2085 symbols completed. TRC took 0.7s. Estimated remaining: 1m 31s. Rate: 154.5 symbols/min [2025-09-17T22:58:51.621184] [INFO ] [MAIN ] TRN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:52.078999] [DEBUG] [LOCAL ] TRN: Loaded 37514 existing records from primary storage. [2025-09-17T22:58:52.082500] [INFO ] [MAIN ] TRN: Loaded 37514 primary data records. [2025-09-17T22:58:52.162541] [DEBUG] [MAIN ] TREX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:52.175910] [INFO ] [MAIN ] TREX: Generated 1794 derivative records from 49969 primary records. [2025-09-17T22:58:52.176026] [DEBUG] [LOCAL ] TREX: Saving derivative data. [2025-09-17T22:58:52.418695] [DEBUG] [LOCAL ] TREX: Derivative data saved (1794 records). [2025-09-17T22:58:52.431262] [INFO ] [MAIN ] TREX: Successfully saved derivative data. [2025-09-17T22:58:52.434443] [INFO ] [MAIN ] Derivative Progress: 1853/2085 symbols completed. TREX took 1.4s. Estimated remaining: 1m 30s. Rate: 154.4 symbols/min [2025-09-17T22:58:52.434835] [DEBUG] [MAIN ] TRGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:52.435157] [INFO ] [MAIN ] TRNO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:52.436013] [INFO ] [MAIN ] TRGP: Generated 1794 derivative records from 50883 primary records. [2025-09-17T22:58:52.436421] [DEBUG] [LOCAL ] TRGP: Saving derivative data. [2025-09-17T22:58:52.456590] [DEBUG] [LOCAL ] TRGP: Derivative data saved (1794 records). [2025-09-17T22:58:52.457163] [INFO ] [MAIN ] TRGP: Successfully saved derivative data. [2025-09-17T22:58:52.459980] [INFO ] [MAIN ] Derivative Progress: 1854/2085 symbols completed. TRGP took 1.2s. Estimated remaining: 1m 30s. Rate: 154.4 symbols/min [2025-09-17T22:58:52.460435] [INFO ] [MAIN ] TROX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:52.485237] [DEBUG] [MAIN ] TRN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:52.486076] [INFO ] [MAIN ] TRN: Generated 1794 derivative records from 37514 primary records. [2025-09-17T22:58:52.486342] [DEBUG] [LOCAL ] TRN: Saving derivative data. [2025-09-17T22:58:52.526040] [DEBUG] [LOCAL ] TRN: Derivative data saved (1794 records). [2025-09-17T22:58:52.526238] [INFO ] [MAIN ] TRN: Successfully saved derivative data. [2025-09-17T22:58:52.540833] [INFO ] [MAIN ] Derivative Progress: 1855/2085 symbols completed. TRN took 0.9s. Estimated remaining: 1m 29s. Rate: 154.5 symbols/min [2025-09-17T22:58:52.542543] [INFO ] [MAIN ] TRP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:52.544063] [DEBUG] [LOCAL ] TRNO: Loaded 44243 existing records from primary storage. [2025-09-17T22:58:52.544347] [INFO ] [MAIN ] TRNO: Loaded 44243 primary data records. [2025-09-17T22:58:52.666800] [DEBUG] [LOCAL ] TROX: Loaded 51751 existing records from primary storage. [2025-09-17T22:58:52.667732] [INFO ] [MAIN ] TROX: Loaded 51751 primary data records. [2025-09-17T22:58:53.209918] [DEBUG] [LOCAL ] TRP: Loaded 52167 existing records from primary storage. [2025-09-17T22:58:53.210393] [INFO ] [MAIN ] TRP: Loaded 52167 primary data records. [2025-09-17T22:58:53.591925] [DEBUG] [MAIN ] TRNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:53.593106] [INFO ] [MAIN ] TRNO: Generated 1794 derivative records from 44243 primary records. [2025-09-17T22:58:53.593552] [DEBUG] [LOCAL ] TRNO: Saving derivative data. [2025-09-17T22:58:53.617990] [DEBUG] [LOCAL ] TRNO: Derivative data saved (1794 records). [2025-09-17T22:58:53.619157] [INFO ] [MAIN ] TRNO: Successfully saved derivative data. [2025-09-17T22:58:53.629395] [INFO ] [MAIN ] Derivative Progress: 1856/2085 symbols completed. TRNO took 1.2s. Estimated remaining: 1m 29s. Rate: 154.4 symbols/min [2025-09-17T22:58:53.635574] [DEBUG] [MAIN ] TROX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:53.635913] [INFO ] [MAIN ] TRTX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:53.637011] [INFO ] [MAIN ] TROX: Generated 1794 derivative records from 51751 primary records. [2025-09-17T22:58:53.637499] [DEBUG] [LOCAL ] TROX: Saving derivative data. [2025-09-17T22:58:53.667582] [DEBUG] [MAIN ] TRP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:53.668725] [INFO ] [MAIN ] TRP: Generated 1794 derivative records from 52167 primary records. [2025-09-17T22:58:53.669232] [DEBUG] [LOCAL ] TRP: Saving derivative data. [2025-09-17T22:58:53.669599] [DEBUG] [LOCAL ] TROX: Derivative data saved (1794 records). [2025-09-17T22:58:53.669729] [INFO ] [MAIN ] TROX: Successfully saved derivative data. [2025-09-17T22:58:53.672408] [INFO ] [MAIN ] Derivative Progress: 1857/2085 symbols completed. TROX took 1.2s. Estimated remaining: 1m 29s. Rate: 154.4 symbols/min [2025-09-17T22:58:53.673332] [INFO ] [MAIN ] TRU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:53.699048] [DEBUG] [LOCAL ] TRP: Derivative data saved (1794 records). [2025-09-17T22:58:53.699254] [INFO ] [MAIN ] TRP: Successfully saved derivative data. [2025-09-17T22:58:53.701543] [INFO ] [MAIN ] Derivative Progress: 1858/2085 symbols completed. TRP took 1.2s. Estimated remaining: 1m 28s. Rate: 154.5 symbols/min [2025-09-17T22:58:53.715026] [DEBUG] [LOCAL ] TRTX: Loaded 37363 existing records from primary storage. [2025-09-17T22:58:53.715169] [INFO ] [MAIN ] TRTX: Loaded 37363 primary data records. [2025-09-17T22:58:54.047816] [DEBUG] [LOCAL ] TRU: Loaded 51175 existing records from primary storage. [2025-09-17T22:58:54.048078] [INFO ] [MAIN ] TRU: Loaded 51175 primary data records. [2025-09-17T22:58:54.375772] [DEBUG] [MAIN ] TRTX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:54.376608] [INFO ] [MAIN ] TRTX: Generated 1794 derivative records from 37363 primary records. [2025-09-17T22:58:54.376705] [DEBUG] [LOCAL ] TRTX: Saving derivative data. [2025-09-17T22:58:54.393384] [DEBUG] [LOCAL ] TRTX: Derivative data saved (1794 records). [2025-09-17T22:58:54.393520] [INFO ] [MAIN ] TRTX: Successfully saved derivative data. [2025-09-17T22:58:54.395990] [INFO ] [MAIN ] Derivative Progress: 1859/2085 symbols completed. TRTX took 0.8s. Estimated remaining: 1m 28s. Rate: 154.5 symbols/min [2025-09-17T22:58:54.411990] [DEBUG] [MAIN ] TRU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:54.412591] [INFO ] [MAIN ] TRU: Generated 1794 derivative records from 51175 primary records. [2025-09-17T22:58:54.412674] [DEBUG] [LOCAL ] TRU: Saving derivative data. [2025-09-17T22:58:54.428110] [DEBUG] [LOCAL ] TRU: Derivative data saved (1794 records). [2025-09-17T22:58:54.428189] [INFO ] [MAIN ] TRU: Successfully saved derivative data. [2025-09-17T22:58:54.430428] [INFO ] [MAIN ] Derivative Progress: 1860/2085 symbols completed. TRU took 0.8s. Estimated remaining: 1m 27s. Rate: 154.5 symbols/min [2025-09-17T22:58:54.431668] [INFO ] [MAIN ] TSI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:54.431405] [INFO ] [MAIN ] TSE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:54.431562] [INFO ] [MAIN ] TRV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:54.443162] [DEBUG] [LOCAL ] TSI: Loaded 8689 existing records from primary storage. [2025-09-17T22:58:54.443289] [INFO ] [MAIN ] TSI: Loaded 8689 primary data records. [2025-09-17T22:58:54.656310] [DEBUG] [LOCAL ] TSE: Loaded 28997 existing records from primary storage. [2025-09-17T22:58:54.763222] [INFO ] [MAIN ] TSE: Loaded 28997 primary data records. [2025-09-17T22:58:54.883581] [DEBUG] [LOCAL ] TRV: Loaded 48413 existing records from primary storage. [2025-09-17T22:58:54.895365] [INFO ] [MAIN ] TRV: Loaded 48413 primary data records. [2025-09-17T22:58:55.464835] [DEBUG] [MAIN ] TSI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:55.466243] [INFO ] [MAIN ] TSI: Generated 1794 derivative records from 8689 primary records. [2025-09-17T22:58:55.467029] [DEBUG] [LOCAL ] TSI: Saving derivative data. [2025-09-17T22:58:55.489273] [DEBUG] [LOCAL ] TSI: Derivative data saved (1794 records). [2025-09-17T22:58:55.490759] [INFO ] [MAIN ] TSI: Successfully saved derivative data. [2025-09-17T22:58:55.493035] [INFO ] [MAIN ] Derivative Progress: 1861/2085 symbols completed. TSI took 1.1s. Estimated remaining: 1m 27s. Rate: 154.4 symbols/min [2025-09-17T22:58:55.496105] [INFO ] [MAIN ] TSLX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:55.518921] [DEBUG] [MAIN ] TSE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:55.524721] [INFO ] [MAIN ] TSE: Generated 1794 derivative records from 28997 primary records. [2025-09-17T22:58:55.524881] [DEBUG] [LOCAL ] TSE: Saving derivative data. [2025-09-17T22:58:55.526136] [DEBUG] [MAIN ] TRV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:55.541388] [INFO ] [MAIN ] TRV: Generated 1794 derivative records from 48413 primary records. [2025-09-17T22:58:55.542269] [DEBUG] [LOCAL ] TRV: Saving derivative data. [2025-09-17T22:58:55.542045] [DEBUG] [LOCAL ] TSE: Derivative data saved (1794 records). [2025-09-17T22:58:55.542831] [INFO ] [MAIN ] TSE: Successfully saved derivative data. [2025-09-17T22:58:55.545363] [INFO ] [MAIN ] Derivative Progress: 1862/2085 symbols completed. TSE took 1.1s. Estimated remaining: 1m 27s. Rate: 154.5 symbols/min [2025-09-17T22:58:55.560986] [DEBUG] [LOCAL ] TRV: Derivative data saved (1794 records). [2025-09-17T22:58:55.561114] [INFO ] [MAIN ] TRV: Successfully saved derivative data. [2025-09-17T22:58:55.561185] [INFO ] [MAIN ] TSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:55.563796] [INFO ] [MAIN ] Derivative Progress: 1863/2085 symbols completed. TRV took 1.1s. Estimated remaining: 1m 26s. Rate: 154.5 symbols/min [2025-09-17T22:58:55.564238] [INFO ] [MAIN ] TSN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:55.591702] [DEBUG] [LOCAL ] TSLX: Loaded 35446 existing records from primary storage. [2025-09-17T22:58:55.591919] [INFO ] [MAIN ] TSLX: Loaded 35446 primary data records. [2025-09-17T22:58:55.951590] [DEBUG] [LOCAL ] TSN: Loaded 52836 existing records from primary storage. [2025-09-17T22:58:55.952308] [INFO ] [MAIN ] TSN: Loaded 52836 primary data records. [2025-09-17T22:58:55.974512] [DEBUG] [LOCAL ] TSM: Loaded 53819 existing records from primary storage. [2025-09-17T22:58:56.004092] [INFO ] [MAIN ] TSM: Loaded 53819 primary data records. [2025-09-17T22:58:56.575932] [DEBUG] [MAIN ] TSLX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:56.578047] [INFO ] [MAIN ] TSLX: Generated 1794 derivative records from 35446 primary records. [2025-09-17T22:58:56.578418] [DEBUG] [LOCAL ] TSLX: Saving derivative data. [2025-09-17T22:58:56.601177] [DEBUG] [LOCAL ] TSLX: Derivative data saved (1794 records). [2025-09-17T22:58:56.601570] [INFO ] [MAIN ] TSLX: Successfully saved derivative data. [2025-09-17T22:58:56.604796] [INFO ] [MAIN ] Derivative Progress: 1864/2085 symbols completed. TSLX took 1.1s. Estimated remaining: 1m 26s. Rate: 154.4 symbols/min [2025-09-17T22:58:56.607264] [INFO ] [MAIN ] TSQ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:56.635873] [DEBUG] [MAIN ] TSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:56.635574] [DEBUG] [MAIN ] TSN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:56.636869] [INFO ] [MAIN ] TSN: Generated 1794 derivative records from 52836 primary records. [2025-09-17T22:58:56.637441] [INFO ] [MAIN ] TSM: Generated 1794 derivative records from 53819 primary records. [2025-09-17T22:58:56.637584] [DEBUG] [LOCAL ] TSN: Saving derivative data. [2025-09-17T22:58:56.637799] [DEBUG] [LOCAL ] TSM: Saving derivative data. [2025-09-17T22:58:56.668172] [DEBUG] [LOCAL ] TSN: Derivative data saved (1794 records). [2025-09-17T22:58:56.668552] [INFO ] [MAIN ] TSN: Successfully saved derivative data. [2025-09-17T22:58:56.670840] [INFO ] [MAIN ] Derivative Progress: 1865/2085 symbols completed. TSN took 1.1s. Estimated remaining: 1m 25s. Rate: 154.5 symbols/min [2025-09-17T22:58:56.677688] [DEBUG] [LOCAL ] TSQ: Loaded 12062 existing records from primary storage. [2025-09-17T22:58:56.680259] [DEBUG] [LOCAL ] TSM: Derivative data saved (1794 records). [2025-09-17T22:58:56.680379] [INFO ] [MAIN ] TSQ: Loaded 12062 primary data records. [2025-09-17T22:58:56.680491] [INFO ] [MAIN ] TSM: Successfully saved derivative data. [2025-09-17T22:58:56.683512] [INFO ] [MAIN ] TT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:56.683402] [INFO ] [MAIN ] Derivative Progress: 1866/2085 symbols completed. TSM took 1.1s. Estimated remaining: 1m 25s. Rate: 154.5 symbols/min [2025-09-17T22:58:56.684109] [INFO ] [MAIN ] TTC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:57.046211] [DEBUG] [LOCAL ] TTC: Loaded 43035 existing records from primary storage. [2025-09-17T22:58:57.047106] [INFO ] [MAIN ] TTC: Loaded 43035 primary data records. [2025-09-17T22:58:57.175601] [DEBUG] [LOCAL ] TT: Loaded 48052 existing records from primary storage. [2025-09-17T22:58:57.181418] [INFO ] [MAIN ] TT: Loaded 48052 primary data records. [2025-09-17T22:58:57.733908] [DEBUG] [MAIN ] TSQ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:57.748583] [INFO ] [MAIN ] TSQ: Generated 1794 derivative records from 12062 primary records. [2025-09-17T22:58:57.748908] [DEBUG] [LOCAL ] TSQ: Saving derivative data. [2025-09-17T22:58:57.767211] [DEBUG] [LOCAL ] TSQ: Derivative data saved (1794 records). [2025-09-17T22:58:57.768104] [INFO ] [MAIN ] TSQ: Successfully saved derivative data. [2025-09-17T22:58:57.770480] [INFO ] [MAIN ] Derivative Progress: 1867/2085 symbols completed. TSQ took 1.2s. Estimated remaining: 1m 25s. Rate: 154.4 symbols/min [2025-09-17T22:58:57.771113] [INFO ] [MAIN ] TTE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:57.794232] [DEBUG] [MAIN ] TTC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:57.795168] [INFO ] [MAIN ] TTC: Generated 1794 derivative records from 43035 primary records. [2025-09-17T22:58:57.795392] [DEBUG] [LOCAL ] TTC: Saving derivative data. [2025-09-17T22:58:57.815234] [DEBUG] [LOCAL ] TTC: Derivative data saved (1794 records). [2025-09-17T22:58:57.815541] [INFO ] [MAIN ] TTC: Successfully saved derivative data. [2025-09-17T22:58:57.825516] [INFO ] [MAIN ] Derivative Progress: 1868/2085 symbols completed. TTC took 1.1s. Estimated remaining: 1m 24s. Rate: 154.5 symbols/min [2025-09-17T22:58:57.831066] [DEBUG] [MAIN ] TT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:57.832247] [INFO ] [MAIN ] TTI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:57.831983] [INFO ] [MAIN ] TT: Generated 1794 derivative records from 48052 primary records. [2025-09-17T22:58:57.832451] [DEBUG] [LOCAL ] TT: Saving derivative data. [2025-09-17T22:58:57.864381] [DEBUG] [LOCAL ] TT: Derivative data saved (1794 records). [2025-09-17T22:58:57.864555] [INFO ] [MAIN ] TT: Successfully saved derivative data. [2025-09-17T22:58:57.867178] [INFO ] [MAIN ] Derivative Progress: 1869/2085 symbols completed. TT took 1.2s. Estimated remaining: 1m 24s. Rate: 154.5 symbols/min [2025-09-17T22:58:57.868321] [INFO ] [MAIN ] TU: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:57.884457] [DEBUG] [LOCAL ] TTE: Loaded 51669 existing records from primary storage. [2025-09-17T22:58:57.884792] [INFO ] [MAIN ] TTE: Loaded 51669 primary data records. [2025-09-17T22:58:58.110217] [DEBUG] [LOCAL ] TTI: Loaded 45239 existing records from primary storage. [2025-09-17T22:58:58.154777] [INFO ] [MAIN ] TTI: Loaded 45239 primary data records. [2025-09-17T22:58:58.367976] [DEBUG] [LOCAL ] TU: Loaded 49968 existing records from primary storage. [2025-09-17T22:58:58.383692] [INFO ] [MAIN ] TU: Loaded 49968 primary data records. [2025-09-17T22:58:58.894566] [DEBUG] [MAIN ] TTE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:58.896301] [INFO ] [MAIN ] TTE: Generated 1794 derivative records from 51669 primary records. [2025-09-17T22:58:58.896948] [DEBUG] [LOCAL ] TTE: Saving derivative data. [2025-09-17T22:58:58.915422] [DEBUG] [LOCAL ] TTE: Derivative data saved (1794 records). [2025-09-17T22:58:58.916417] [INFO ] [MAIN ] TTE: Successfully saved derivative data. [2025-09-17T22:58:58.918886] [INFO ] [MAIN ] Derivative Progress: 1870/2085 symbols completed. TTE took 1.1s. Estimated remaining: 1m 24s. Rate: 154.4 symbols/min [2025-09-17T22:58:58.919493] [INFO ] [MAIN ] TUYA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:58.938099] [DEBUG] [MAIN ] TTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:58.939028] [INFO ] [MAIN ] TTI: Generated 1794 derivative records from 45239 primary records. [2025-09-17T22:58:58.939461] [DEBUG] [LOCAL ] TTI: Saving derivative data. [2025-09-17T22:58:58.958468] [DEBUG] [LOCAL ] TTI: Derivative data saved (1794 records). [2025-09-17T22:58:58.958837] [INFO ] [MAIN ] TTI: Successfully saved derivative data. [2025-09-17T22:58:58.961877] [INFO ] [MAIN ] Derivative Progress: 1871/2085 symbols completed. TTI took 1.1s. Estimated remaining: 1m 23s. Rate: 154.5 symbols/min [2025-09-17T22:58:58.962275] [INFO ] [MAIN ] TV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:58.976835] [DEBUG] [MAIN ] TU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:58:58.977688] [INFO ] [MAIN ] TU: Generated 1794 derivative records from 49968 primary records. [2025-09-17T22:58:58.977826] [DEBUG] [LOCAL ] TU: Saving derivative data. [2025-09-17T22:58:59.005990] [DEBUG] [LOCAL ] TU: Derivative data saved (1794 records). [2025-09-17T22:58:59.006367] [INFO ] [MAIN ] TU: Successfully saved derivative data. [2025-09-17T22:58:59.009581] [INFO ] [MAIN ] Derivative Progress: 1872/2085 symbols completed. TU took 1.1s. Estimated remaining: 1m 23s. Rate: 154.5 symbols/min [2025-09-17T22:58:59.010123] [INFO ] [MAIN ] TVC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:58:59.028678] [DEBUG] [LOCAL ] TUYA: Loaded 46687 existing records from primary storage. [2025-09-17T22:58:59.028877] [INFO ] [MAIN ] TUYA: Loaded 46687 primary data records. [2025-09-17T22:58:59.031366] [DEBUG] [LOCAL ] TVC: Loaded 3552 existing records from primary storage. [2025-09-17T22:58:59.031602] [INFO ] [MAIN ] TVC: Loaded 3552 primary data records. [2025-09-17T22:58:59.287170] [DEBUG] [LOCAL ] TV: Loaded 43149 existing records from primary storage. [2025-09-17T22:58:59.303142] [INFO ] [MAIN ] TV: Loaded 43149 primary data records. [2025-09-17T22:59:00.059797] [DEBUG] [MAIN ] TUYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:00.065359] [DEBUG] [MAIN ] TVC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:00.066351] [INFO ] [MAIN ] TUYA: Generated 1794 derivative records from 46687 primary records. [2025-09-17T22:59:00.067203] [INFO ] [MAIN ] TVC: Generated 1794 derivative records from 3552 primary records. [2025-09-17T22:59:00.067411] [DEBUG] [LOCAL ] TUYA: Saving derivative data. [2025-09-17T22:59:00.067328] [DEBUG] [LOCAL ] TVC: Saving derivative data. [2025-09-17T22:59:00.098633] [DEBUG] [LOCAL ] TUYA: Derivative data saved (1794 records). [2025-09-17T22:59:00.098742] [DEBUG] [LOCAL ] TVC: Derivative data saved (1794 records). [2025-09-17T22:59:00.099094] [INFO ] [MAIN ] TUYA: Successfully saved derivative data. [2025-09-17T22:59:00.101420] [INFO ] [MAIN ] TVC: Successfully saved derivative data. [2025-09-17T22:59:00.101139] [INFO ] [MAIN ] Derivative Progress: 1873/2085 symbols completed. TUYA took 1.2s. Estimated remaining: 1m 22s. Rate: 154.4 symbols/min [2025-09-17T22:59:00.104742] [INFO ] [MAIN ] Derivative Progress: 1874/2085 symbols completed. TVC took 1.1s. Estimated remaining: 1m 22s. Rate: 154.5 symbols/min [2025-09-17T22:59:00.119564] [DEBUG] [MAIN ] TV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:00.120152] [INFO ] [MAIN ] TV: Generated 1794 derivative records from 43149 primary records. [2025-09-17T22:59:00.120212] [DEBUG] [LOCAL ] TV: Saving derivative data. [2025-09-17T22:59:00.135307] [DEBUG] [LOCAL ] TV: Derivative data saved (1794 records). [2025-09-17T22:59:00.135371] [INFO ] [MAIN ] TV: Successfully saved derivative data. [2025-09-17T22:59:00.137997] [INFO ] [MAIN ] Derivative Progress: 1875/2085 symbols completed. TV took 1.2s. Estimated remaining: 1m 22s. Rate: 154.6 symbols/min [2025-09-17T22:59:00.138548] [INFO ] [MAIN ] TWI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:00.138708] [INFO ] [MAIN ] TVE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:00.138887] [INFO ] [MAIN ] TWLO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:00.146411] [DEBUG] [LOCAL ] TVE: Loaded 2855 existing records from primary storage. [2025-09-17T22:59:00.146582] [INFO ] [MAIN ] TVE: Loaded 2855 primary data records. [2025-09-17T22:59:00.357210] [DEBUG] [LOCAL ] TWI: Loaded 34927 existing records from primary storage. [2025-09-17T22:59:00.374758] [INFO ] [MAIN ] TWI: Loaded 34927 primary data records. [2025-09-17T22:59:00.646674] [DEBUG] [LOCAL ] TWLO: Loaded 52722 existing records from primary storage. [2025-09-17T22:59:00.691825] [INFO ] [MAIN ] TWLO: Loaded 52722 primary data records. [2025-09-17T22:59:01.176847] [DEBUG] [MAIN ] TVE: Filtered 6931 bins outside market hours, 7726 incomplete bins [2025-09-17T22:59:01.178234] [INFO ] [MAIN ] TVE: Generated 1792 derivative records from 2855 primary records. [2025-09-17T22:59:01.178343] [DEBUG] [LOCAL ] TVE: Saving derivative data. [2025-09-17T22:59:01.195147] [DEBUG] [LOCAL ] TVE: Derivative data saved (1792 records). [2025-09-17T22:59:01.197152] [INFO ] [MAIN ] TVE: Successfully saved derivative data. [2025-09-17T22:59:01.199571] [INFO ] [MAIN ] Derivative Progress: 1876/2085 symbols completed. TVE took 1.1s. Estimated remaining: 1m 21s. Rate: 154.4 symbols/min [2025-09-17T22:59:01.209097] [INFO ] [MAIN ] TWN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:01.215226] [DEBUG] [MAIN ] TWI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:01.216558] [INFO ] [MAIN ] TWI: Generated 1794 derivative records from 34927 primary records. [2025-09-17T22:59:01.216927] [DEBUG] [LOCAL ] TWI: Saving derivative data. [2025-09-17T22:59:01.234634] [DEBUG] [LOCAL ] TWN: Loaded 3347 existing records from primary storage. [2025-09-17T22:59:01.238251] [INFO ] [MAIN ] TWN: Loaded 3347 primary data records. [2025-09-17T22:59:01.279070] [DEBUG] [LOCAL ] TWI: Derivative data saved (1794 records). [2025-09-17T22:59:01.308380] [INFO ] [MAIN ] TWI: Successfully saved derivative data. [2025-09-17T22:59:01.340413] [INFO ] [MAIN ] Derivative Progress: 1877/2085 symbols completed. TWI took 1.2s. Estimated remaining: 1m 21s. Rate: 154.5 symbols/min [2025-09-17T22:59:01.346182] [DEBUG] [MAIN ] TWLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:01.353006] [INFO ] [MAIN ] TWO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:01.361784] [INFO ] [MAIN ] TWLO: Generated 1794 derivative records from 52722 primary records. [2025-09-17T22:59:01.365685] [DEBUG] [LOCAL ] TWLO: Saving derivative data. [2025-09-17T22:59:01.466696] [DEBUG] [LOCAL ] TWLO: Derivative data saved (1794 records). [2025-09-17T22:59:01.628486] [INFO ] [MAIN ] TWLO: Successfully saved derivative data. [2025-09-17T22:59:01.631015] [INFO ] [MAIN ] Derivative Progress: 1878/2085 symbols completed. TWLO took 1.5s. Estimated remaining: 1m 20s. Rate: 154.5 symbols/min [2025-09-17T22:59:01.631435] [INFO ] [MAIN ] TX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:01.679222] [DEBUG] [MAIN ] TWN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:01.693495] [DEBUG] [LOCAL ] TX: Loaded 23871 existing records from primary storage. [2025-09-17T22:59:01.693606] [INFO ] [MAIN ] TX: Loaded 23871 primary data records. [2025-09-17T22:59:01.693107] [INFO ] [MAIN ] TWN: Generated 1794 derivative records from 3347 primary records. [2025-09-17T22:59:01.705244] [DEBUG] [LOCAL ] TWN: Saving derivative data. [2025-09-17T22:59:01.706377] [DEBUG] [LOCAL ] TWO: Loaded 48207 existing records from primary storage. [2025-09-17T22:59:01.716900] [INFO ] [MAIN ] TWO: Loaded 48207 primary data records. [2025-09-17T22:59:01.890816] [DEBUG] [LOCAL ] TWN: Derivative data saved (1794 records). [2025-09-17T22:59:01.925450] [INFO ] [MAIN ] TWN: Successfully saved derivative data. [2025-09-17T22:59:01.931519] [INFO ] [MAIN ] Derivative Progress: 1879/2085 symbols completed. TWN took 0.7s. Estimated remaining: 1m 20s. Rate: 154.5 symbols/min [2025-09-17T22:59:01.968841] [INFO ] [MAIN ] TXNM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:02.390221] [DEBUG] [MAIN ] TX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:02.390913] [DEBUG] [LOCAL ] TXNM: Loaded 44151 existing records from primary storage. [2025-09-17T22:59:02.399258] [INFO ] [MAIN ] TX: Generated 1794 derivative records from 23871 primary records. [2025-09-17T22:59:02.404302] [DEBUG] [MAIN ] TWO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:02.403847] [INFO ] [MAIN ] TXNM: Loaded 44151 primary data records. [2025-09-17T22:59:02.405055] [INFO ] [MAIN ] TWO: Generated 1794 derivative records from 48207 primary records. [2025-09-17T22:59:02.404420] [DEBUG] [LOCAL ] TX: Saving derivative data. [2025-09-17T22:59:02.416362] [DEBUG] [LOCAL ] TWO: Saving derivative data. [2025-09-17T22:59:02.522726] [DEBUG] [LOCAL ] TX: Derivative data saved (1794 records). [2025-09-17T22:59:02.534091] [INFO ] [MAIN ] TX: Successfully saved derivative data. [2025-09-17T22:59:02.540240] [INFO ] [MAIN ] Derivative Progress: 1880/2085 symbols completed. TX took 0.9s. Estimated remaining: 1m 20s. Rate: 154.5 symbols/min [2025-09-17T22:59:02.542590] [INFO ] [MAIN ] TXO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:02.555018] [DEBUG] [LOCAL ] TWO: Derivative data saved (1794 records). [2025-09-17T22:59:02.555127] [INFO ] [MAIN ] TWO: Successfully saved derivative data. [2025-09-17T22:59:02.567894] [INFO ] [MAIN ] Derivative Progress: 1881/2085 symbols completed. TWO took 1.2s. Estimated remaining: 1m 19s. Rate: 154.5 symbols/min [2025-09-17T22:59:02.574144] [INFO ] [MAIN ] TXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:02.759501] [DEBUG] [LOCAL ] TXO: Loaded 18662 existing records from primary storage. [2025-09-17T22:59:02.760324] [INFO ] [MAIN ] TXO: Loaded 18662 primary data records. [2025-09-17T22:59:03.108498] [DEBUG] [LOCAL ] TXT: Loaded 49819 existing records from primary storage. [2025-09-17T22:59:03.109678] [INFO ] [MAIN ] TXT: Loaded 49819 primary data records. [2025-09-17T22:59:03.179728] [DEBUG] [MAIN ] TXNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:03.223727] [INFO ] [MAIN ] TXNM: Generated 1794 derivative records from 44151 primary records. [2025-09-17T22:59:03.242623] [DEBUG] [LOCAL ] TXNM: Saving derivative data. [2025-09-17T22:59:03.468156] [DEBUG] [LOCAL ] TXNM: Derivative data saved (1794 records). [2025-09-17T22:59:03.468777] [INFO ] [MAIN ] TXNM: Successfully saved derivative data. [2025-09-17T22:59:03.470964] [INFO ] [MAIN ] Derivative Progress: 1882/2085 symbols completed. TXNM took 1.5s. Estimated remaining: 1m 19s. Rate: 154.4 symbols/min [2025-09-17T22:59:03.471499] [INFO ] [MAIN ] TY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:03.493974] [DEBUG] [MAIN ] TXO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:03.498914] [INFO ] [MAIN ] TXO: Generated 1794 derivative records from 18662 primary records. [2025-09-17T22:59:03.498018] [DEBUG] [LOCAL ] TY: Loaded 7682 existing records from primary storage. [2025-09-17T22:59:03.499306] [INFO ] [MAIN ] TY: Loaded 7682 primary data records. [2025-09-17T22:59:03.499456] [DEBUG] [LOCAL ] TXO: Saving derivative data. [2025-09-17T22:59:03.588489] [DEBUG] [LOCAL ] TXO: Derivative data saved (1794 records). [2025-09-17T22:59:03.601742] [INFO ] [MAIN ] TXO: Successfully saved derivative data. [2025-09-17T22:59:03.628000] [INFO ] [MAIN ] Derivative Progress: 1883/2085 symbols completed. TXO took 1.1s. Estimated remaining: 1m 18s. Rate: 154.5 symbols/min [2025-09-17T22:59:03.629888] [INFO ] [MAIN ] TYG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:03.700782] [DEBUG] [MAIN ] TXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:03.731813] [INFO ] [MAIN ] TXT: Generated 1794 derivative records from 49819 primary records. [2025-09-17T22:59:03.778719] [DEBUG] [LOCAL ] TXT: Saving derivative data. [2025-09-17T22:59:03.906926] [DEBUG] [LOCAL ] TYG: Loaded 14507 existing records from primary storage. [2025-09-17T22:59:03.912202] [INFO ] [MAIN ] TYG: Loaded 14507 primary data records. [2025-09-17T22:59:03.915796] [DEBUG] [LOCAL ] TXT: Derivative data saved (1794 records). [2025-09-17T22:59:03.921078] [INFO ] [MAIN ] TXT: Successfully saved derivative data. [2025-09-17T22:59:03.940370] [INFO ] [MAIN ] Derivative Progress: 1884/2085 symbols completed. TXT took 1.4s. Estimated remaining: 1m 18s. Rate: 154.5 symbols/min [2025-09-17T22:59:03.963548] [INFO ] [MAIN ] TYL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:04.264257] [DEBUG] [LOCAL ] TYL: Loaded 22466 existing records from primary storage. [2025-09-17T22:59:04.264824] [INFO ] [MAIN ] TYL: Loaded 22466 primary data records. [2025-09-17T22:59:04.421815] [DEBUG] [MAIN ] TY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:04.479295] [INFO ] [MAIN ] TY: Generated 1794 derivative records from 7682 primary records. [2025-09-17T22:59:04.479558] [DEBUG] [LOCAL ] TY: Saving derivative data. [2025-09-17T22:59:04.627517] [DEBUG] [LOCAL ] TY: Derivative data saved (1794 records). [2025-09-17T22:59:04.649399] [DEBUG] [MAIN ] TYG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:04.648395] [INFO ] [MAIN ] TY: Successfully saved derivative data. [2025-09-17T22:59:04.651912] [INFO ] [MAIN ] Derivative Progress: 1885/2085 symbols completed. TY took 1.2s. Estimated remaining: 1m 18s. Rate: 154.4 symbols/min [2025-09-17T22:59:04.652184] [INFO ] [MAIN ] U: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:04.654039] [INFO ] [MAIN ] TYG: Generated 1794 derivative records from 14507 primary records. [2025-09-17T22:59:04.654429] [DEBUG] [LOCAL ] TYG: Saving derivative data. [2025-09-17T22:59:04.671170] [DEBUG] [LOCAL ] TYG: Derivative data saved (1794 records). [2025-09-17T22:59:04.671471] [INFO ] [MAIN ] TYG: Successfully saved derivative data. [2025-09-17T22:59:04.673708] [INFO ] [MAIN ] Derivative Progress: 1886/2085 symbols completed. TYG took 1.0s. Estimated remaining: 1m 17s. Rate: 154.5 symbols/min [2025-09-17T22:59:04.674265] [INFO ] [MAIN ] UA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:04.692710] [DEBUG] [MAIN ] TYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:04.693473] [INFO ] [MAIN ] TYL: Generated 1794 derivative records from 22466 primary records. [2025-09-17T22:59:04.693631] [DEBUG] [LOCAL ] TYL: Saving derivative data. [2025-09-17T22:59:04.710249] [DEBUG] [LOCAL ] TYL: Derivative data saved (1794 records). [2025-09-17T22:59:04.725171] [INFO ] [MAIN ] TYL: Successfully saved derivative data. [2025-09-17T22:59:04.728344] [INFO ] [MAIN ] Derivative Progress: 1887/2085 symbols completed. TYL took 0.8s. Estimated remaining: 1m 17s. Rate: 154.6 symbols/min [2025-09-17T22:59:04.728859] [INFO ] [MAIN ] UAA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:04.760623] [DEBUG] [LOCAL ] U: Loaded 53799 existing records from primary storage. [2025-09-17T22:59:04.761364] [INFO ] [MAIN ] U: Loaded 53799 primary data records. [2025-09-17T22:59:04.860326] [DEBUG] [LOCAL ] UA: Loaded 50372 existing records from primary storage. [2025-09-17T22:59:04.896605] [INFO ] [MAIN ] UA: Loaded 50372 primary data records. [2025-09-17T22:59:05.252691] [DEBUG] [LOCAL ] UAA: Loaded 53510 existing records from primary storage. [2025-09-17T22:59:05.263373] [INFO ] [MAIN ] UAA: Loaded 53510 primary data records. [2025-09-17T22:59:05.844949] [DEBUG] [MAIN ] U: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:05.845933] [INFO ] [MAIN ] U: Generated 1794 derivative records from 53799 primary records. [2025-09-17T22:59:05.846210] [DEBUG] [LOCAL ] U: Saving derivative data. [2025-09-17T22:59:05.877987] [DEBUG] [MAIN ] UA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:05.878985] [INFO ] [MAIN ] UA: Generated 1794 derivative records from 50372 primary records. [2025-09-17T22:59:05.877743] [DEBUG] [LOCAL ] U: Derivative data saved (1794 records). [2025-09-17T22:59:05.879167] [INFO ] [MAIN ] U: Successfully saved derivative data. [2025-09-17T22:59:05.882030] [INFO ] [MAIN ] Derivative Progress: 1888/2085 symbols completed. U took 1.2s. Estimated remaining: 1m 17s. Rate: 154.4 symbols/min [2025-09-17T22:59:05.880074] [DEBUG] [LOCAL ] UA: Saving derivative data. [2025-09-17T22:59:05.910160] [DEBUG] [MAIN ] UAA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:05.911548] [INFO ] [MAIN ] UAA: Generated 1794 derivative records from 53510 primary records. [2025-09-17T22:59:05.911884] [DEBUG] [LOCAL ] UAA: Saving derivative data. [2025-09-17T22:59:05.931804] [DEBUG] [LOCAL ] UAA: Derivative data saved (1794 records). [2025-09-17T22:59:05.929282] [DEBUG] [LOCAL ] UA: Derivative data saved (1794 records). [2025-09-17T22:59:05.932091] [INFO ] [MAIN ] UA: Successfully saved derivative data. [2025-09-17T22:59:05.932009] [INFO ] [MAIN ] UAA: Successfully saved derivative data. [2025-09-17T22:59:05.935431] [INFO ] [MAIN ] Derivative Progress: 1889/2085 symbols completed. UA took 1.3s. Estimated remaining: 1m 16s. Rate: 154.5 symbols/min [2025-09-17T22:59:05.938435] [INFO ] [MAIN ] Derivative Progress: 1890/2085 symbols completed. UAA took 1.2s. Estimated remaining: 1m 16s. Rate: 154.6 symbols/min [2025-09-17T22:59:05.938986] [INFO ] [MAIN ] UAN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:05.939187] [INFO ] [MAIN ] UBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:05.939625] [INFO ] [MAIN ] UBER: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:05.948184] [DEBUG] [LOCAL ] UAN: Loaded 5544 existing records from primary storage. [2025-09-17T22:59:05.948317] [INFO ] [MAIN ] UAN: Loaded 5544 primary data records. [2025-09-17T22:59:06.322332] [DEBUG] [LOCAL ] UBS: Loaded 52509 existing records from primary storage. [2025-09-17T22:59:06.322677] [INFO ] [MAIN ] UBS: Loaded 52509 primary data records. [2025-09-17T22:59:06.323537] [DEBUG] [LOCAL ] UBER: Loaded 53806 existing records from primary storage. [2025-09-17T22:59:06.329386] [INFO ] [MAIN ] UBER: Loaded 53806 primary data records. [2025-09-17T22:59:06.954046] [DEBUG] [MAIN ] UAN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:06.955371] [INFO ] [MAIN ] UAN: Generated 1794 derivative records from 5544 primary records. [2025-09-17T22:59:06.955678] [DEBUG] [LOCAL ] UAN: Saving derivative data. [2025-09-17T22:59:06.973824] [DEBUG] [LOCAL ] UAN: Derivative data saved (1794 records). [2025-09-17T22:59:06.974424] [INFO ] [MAIN ] UAN: Successfully saved derivative data. [2025-09-17T22:59:06.976987] [INFO ] [MAIN ] Derivative Progress: 1891/2085 symbols completed. UAN took 1.0s. Estimated remaining: 1m 15s. Rate: 154.4 symbols/min [2025-09-17T22:59:06.977907] [INFO ] [MAIN ] UCB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:06.995613] [DEBUG] [MAIN ] UBER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:06.996408] [INFO ] [MAIN ] UBER: Generated 1794 derivative records from 53806 primary records. [2025-09-17T22:59:06.996683] [DEBUG] [LOCAL ] UBER: Saving derivative data. [2025-09-17T22:59:07.028231] [DEBUG] [LOCAL ] UBER: Derivative data saved (1794 records). [2025-09-17T22:59:07.029020] [INFO ] [MAIN ] UBER: Successfully saved derivative data. [2025-09-17T22:59:07.028765] [DEBUG] [MAIN ] UBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:07.041342] [INFO ] [MAIN ] Derivative Progress: 1892/2085 symbols completed. UBER took 1.1s. Estimated remaining: 1m 15s. Rate: 154.5 symbols/min [2025-09-17T22:59:07.042460] [INFO ] [MAIN ] UBS: Generated 1794 derivative records from 52509 primary records. [2025-09-17T22:59:07.042724] [DEBUG] [LOCAL ] UBS: Saving derivative data. [2025-09-17T22:59:07.043765] [INFO ] [MAIN ] UDR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:07.060078] [DEBUG] [LOCAL ] UBS: Derivative data saved (1794 records). [2025-09-17T22:59:07.070098] [INFO ] [MAIN ] UBS: Successfully saved derivative data. [2025-09-17T22:59:07.072314] [INFO ] [MAIN ] Derivative Progress: 1893/2085 symbols completed. UBS took 1.1s. Estimated remaining: 1m 15s. Rate: 154.6 symbols/min [2025-09-17T22:59:07.072637] [INFO ] [MAIN ] UE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:07.075267] [DEBUG] [LOCAL ] UCB: Loaded 38155 existing records from primary storage. [2025-09-17T22:59:07.075490] [INFO ] [MAIN ] UCB: Loaded 38155 primary data records. [2025-09-17T22:59:07.424769] [DEBUG] [LOCAL ] UDR: Loaded 51801 existing records from primary storage. [2025-09-17T22:59:07.437554] [INFO ] [MAIN ] UDR: Loaded 51801 primary data records. [2025-09-17T22:59:07.471223] [DEBUG] [LOCAL ] UE: Loaded 43092 existing records from primary storage. [2025-09-17T22:59:07.489030] [INFO ] [MAIN ] UE: Loaded 43092 primary data records. [2025-09-17T22:59:08.116411] [DEBUG] [MAIN ] UCB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:08.117293] [INFO ] [MAIN ] UCB: Generated 1794 derivative records from 38155 primary records. [2025-09-17T22:59:08.117964] [DEBUG] [LOCAL ] UCB: Saving derivative data. [2025-09-17T22:59:08.137558] [DEBUG] [LOCAL ] UCB: Derivative data saved (1794 records). [2025-09-17T22:59:08.138119] [INFO ] [MAIN ] UCB: Successfully saved derivative data. [2025-09-17T22:59:08.140357] [INFO ] [MAIN ] Derivative Progress: 1894/2085 symbols completed. UCB took 1.2s. Estimated remaining: 1m 14s. Rate: 154.4 symbols/min [2025-09-17T22:59:08.140974] [INFO ] [MAIN ] UFI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:08.162568] [DEBUG] [LOCAL ] UFI: Loaded 8299 existing records from primary storage. [2025-09-17T22:59:08.168382] [INFO ] [MAIN ] UFI: Loaded 8299 primary data records. [2025-09-17T22:59:08.168314] [DEBUG] [MAIN ] UDR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:08.201039] [INFO ] [MAIN ] UDR: Generated 1794 derivative records from 51801 primary records. [2025-09-17T22:59:08.206747] [DEBUG] [LOCAL ] UDR: Saving derivative data. [2025-09-17T22:59:08.300972] [DEBUG] [MAIN ] UE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:08.324357] [INFO ] [MAIN ] UE: Generated 1794 derivative records from 43092 primary records. [2025-09-17T22:59:08.330535] [DEBUG] [LOCAL ] UE: Saving derivative data. [2025-09-17T22:59:08.361152] [DEBUG] [LOCAL ] UDR: Derivative data saved (1794 records). [2025-09-17T22:59:08.363688] [INFO ] [MAIN ] UDR: Successfully saved derivative data. [2025-09-17T22:59:08.368006] [INFO ] [MAIN ] Derivative Progress: 1895/2085 symbols completed. UDR took 1.3s. Estimated remaining: 1m 14s. Rate: 154.5 symbols/min [2025-09-17T22:59:08.395923] [INFO ] [MAIN ] UGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:08.517746] [DEBUG] [LOCAL ] UE: Derivative data saved (1794 records). [2025-09-17T22:59:08.518058] [INFO ] [MAIN ] UE: Successfully saved derivative data. [2025-09-17T22:59:08.520756] [INFO ] [MAIN ] Derivative Progress: 1896/2085 symbols completed. UE took 1.4s. Estimated remaining: 1m 13s. Rate: 154.5 symbols/min [2025-09-17T22:59:08.521339] [INFO ] [MAIN ] UGP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:08.553757] [DEBUG] [MAIN ] UFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:08.554773] [INFO ] [MAIN ] UFI: Generated 1794 derivative records from 8299 primary records. [2025-09-17T22:59:08.555068] [DEBUG] [LOCAL ] UFI: Saving derivative data. [2025-09-17T22:59:08.579465] [DEBUG] [LOCAL ] UFI: Derivative data saved (1794 records). [2025-09-17T22:59:08.591516] [INFO ] [MAIN ] UFI: Successfully saved derivative data. [2025-09-17T22:59:08.594706] [INFO ] [MAIN ] Derivative Progress: 1897/2085 symbols completed. UFI took 0.5s. Estimated remaining: 1m 13s. Rate: 154.6 symbols/min [2025-09-17T22:59:08.606544] [INFO ] [MAIN ] UHAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:08.608861] [DEBUG] [LOCAL ] UGP: Loaded 42579 existing records from primary storage. [2025-09-17T22:59:08.609069] [INFO ] [MAIN ] UGP: Loaded 42579 primary data records. [2025-09-17T22:59:08.731635] [DEBUG] [LOCAL ] UGI: Loaded 50542 existing records from primary storage. [2025-09-17T22:59:08.735242] [INFO ] [MAIN ] UGI: Loaded 50542 primary data records. [2025-09-17T22:59:08.864299] [DEBUG] [LOCAL ] UHAL: Loaded 16361 existing records from primary storage. [2025-09-17T22:59:08.880708] [INFO ] [MAIN ] UHAL: Loaded 16361 primary data records. [2025-09-17T22:59:09.589346] [DEBUG] [MAIN ] UGP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:09.589033] [DEBUG] [MAIN ] UGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:09.591384] [INFO ] [MAIN ] UGI: Generated 1794 derivative records from 50542 primary records. [2025-09-17T22:59:09.591584] [DEBUG] [LOCAL ] UGI: Saving derivative data. [2025-09-17T22:59:09.590596] [INFO ] [MAIN ] UGP: Generated 1794 derivative records from 42579 primary records. [2025-09-17T22:59:09.592633] [DEBUG] [LOCAL ] UGP: Saving derivative data. [2025-09-17T22:59:09.623043] [DEBUG] [LOCAL ] UGI: Derivative data saved (1794 records). [2025-09-17T22:59:09.624280] [INFO ] [MAIN ] UGI: Successfully saved derivative data. [2025-09-17T22:59:09.626933] [INFO ] [MAIN ] Derivative Progress: 1898/2085 symbols completed. UGI took 1.3s. Estimated remaining: 1m 13s. Rate: 154.4 symbols/min [2025-09-17T22:59:09.627935] [INFO ] [MAIN ] UHS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:09.631094] [DEBUG] [LOCAL ] UGP: Derivative data saved (1794 records). [2025-09-17T22:59:09.632386] [INFO ] [MAIN ] UGP: Successfully saved derivative data. [2025-09-17T22:59:09.635272] [INFO ] [MAIN ] Derivative Progress: 1899/2085 symbols completed. UGP took 1.1s. Estimated remaining: 1m 12s. Rate: 154.5 symbols/min [2025-09-17T22:59:09.635696] [INFO ] [MAIN ] UHT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:09.650924] [DEBUG] [MAIN ] UHAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:09.651818] [INFO ] [MAIN ] UHAL: Generated 1794 derivative records from 16361 primary records. [2025-09-17T22:59:09.652007] [DEBUG] [LOCAL ] UHAL: Saving derivative data. [2025-09-17T22:59:09.672534] [DEBUG] [LOCAL ] UHT: Loaded 9994 existing records from primary storage. [2025-09-17T22:59:09.676154] [INFO ] [MAIN ] UHT: Loaded 9994 primary data records. [2025-09-17T22:59:09.677318] [DEBUG] [LOCAL ] UHAL: Derivative data saved (1794 records). [2025-09-17T22:59:09.688829] [INFO ] [MAIN ] UHAL: Successfully saved derivative data. [2025-09-17T22:59:09.701114] [INFO ] [MAIN ] Derivative Progress: 1900/2085 symbols completed. UHAL took 1.1s. Estimated remaining: 1m 12s. Rate: 154.6 symbols/min [2025-09-17T22:59:09.717307] [INFO ] [MAIN ] UI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:09.918027] [DEBUG] [LOCAL ] UI: Loaded 12568 existing records from primary storage. [2025-09-17T22:59:10.032759] [DEBUG] [LOCAL ] UHS: Loaded 41525 existing records from primary storage. [2025-09-17T22:59:10.031043] [INFO ] [MAIN ] UI: Loaded 12568 primary data records. [2025-09-17T22:59:10.044430] [INFO ] [MAIN ] UHS: Loaded 41525 primary data records. [2025-09-17T22:59:10.667634] [DEBUG] [MAIN ] UHT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:10.668586] [INFO ] [MAIN ] UHT: Generated 1794 derivative records from 9994 primary records. [2025-09-17T22:59:10.669156] [DEBUG] [LOCAL ] UHT: Saving derivative data. [2025-09-17T22:59:10.686177] [DEBUG] [LOCAL ] UHT: Derivative data saved (1794 records). [2025-09-17T22:59:10.686480] [INFO ] [MAIN ] UHT: Successfully saved derivative data. [2025-09-17T22:59:10.688613] [INFO ] [MAIN ] Derivative Progress: 1901/2085 symbols completed. UHT took 1.1s. Estimated remaining: 1m 11s. Rate: 154.5 symbols/min [2025-09-17T22:59:10.689168] [INFO ] [MAIN ] UIS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:10.706414] [DEBUG] [MAIN ] UI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:10.707501] [INFO ] [MAIN ] UI: Generated 1794 derivative records from 12568 primary records. [2025-09-17T22:59:10.708266] [DEBUG] [LOCAL ] UI: Saving derivative data. [2025-09-17T22:59:10.733631] [DEBUG] [MAIN ] UHS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:10.734858] [INFO ] [MAIN ] UHS: Generated 1794 derivative records from 41525 primary records. [2025-09-17T22:59:10.735172] [DEBUG] [LOCAL ] UHS: Saving derivative data. [2025-09-17T22:59:10.762261] [DEBUG] [LOCAL ] UHS: Derivative data saved (1794 records). [2025-09-17T22:59:10.762893] [INFO ] [MAIN ] UHS: Successfully saved derivative data. [2025-09-17T22:59:10.765543] [INFO ] [MAIN ] Derivative Progress: 1902/2085 symbols completed. UHS took 1.1s. Estimated remaining: 1m 11s. Rate: 154.5 symbols/min [2025-09-17T22:59:10.765822] [INFO ] [MAIN ] UL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:10.766096] [DEBUG] [LOCAL ] UI: Derivative data saved (1794 records). [2025-09-17T22:59:10.766446] [INFO ] [MAIN ] UI: Successfully saved derivative data. [2025-09-17T22:59:10.768706] [INFO ] [MAIN ] Derivative Progress: 1903/2085 symbols completed. UI took 1.1s. Estimated remaining: 1m 11s. Rate: 154.6 symbols/min [2025-09-17T22:59:10.782429] [DEBUG] [LOCAL ] UIS: Loaded 37205 existing records from primary storage. [2025-09-17T22:59:10.782633] [INFO ] [MAIN ] UIS: Loaded 37205 primary data records. [2025-09-17T22:59:11.107549] [DEBUG] [LOCAL ] UL: Loaded 53076 existing records from primary storage. [2025-09-17T22:59:11.108520] [INFO ] [MAIN ] UL: Loaded 53076 primary data records. [2025-09-17T22:59:11.434569] [DEBUG] [MAIN ] UIS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:11.435710] [INFO ] [MAIN ] UIS: Generated 1794 derivative records from 37205 primary records. [2025-09-17T22:59:11.435844] [DEBUG] [LOCAL ] UIS: Saving derivative data. [2025-09-17T22:59:11.455932] [DEBUG] [LOCAL ] UIS: Derivative data saved (1794 records). [2025-09-17T22:59:11.457053] [INFO ] [MAIN ] UIS: Successfully saved derivative data. [2025-09-17T22:59:11.459306] [INFO ] [MAIN ] Derivative Progress: 1904/2085 symbols completed. UIS took 0.8s. Estimated remaining: 1m 10s. Rate: 154.5 symbols/min [2025-09-17T22:59:11.473264] [DEBUG] [MAIN ] UL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:11.473839] [INFO ] [MAIN ] UL: Generated 1794 derivative records from 53076 primary records. [2025-09-17T22:59:11.474005] [DEBUG] [LOCAL ] UL: Saving derivative data. [2025-09-17T22:59:11.489120] [DEBUG] [LOCAL ] UL: Derivative data saved (1794 records). [2025-09-17T22:59:11.489176] [INFO ] [MAIN ] UL: Successfully saved derivative data. [2025-09-17T22:59:11.491788] [INFO ] [MAIN ] Derivative Progress: 1905/2085 symbols completed. UL took 0.7s. Estimated remaining: 1m 10s. Rate: 154.6 symbols/min [2025-09-17T22:59:11.492342] [INFO ] [MAIN ] UMH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:11.492549] [INFO ] [MAIN ] ULS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:11.492707] [INFO ] [MAIN ] UMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:11.561251] [DEBUG] [LOCAL ] UMC: Loaded 52732 existing records from primary storage. [2025-09-17T22:59:11.561960] [INFO ] [MAIN ] UMC: Loaded 52732 primary data records. [2025-09-17T22:59:11.667687] [DEBUG] [LOCAL ] ULS: Loaded 39196 existing records from primary storage. [2025-09-17T22:59:11.689163] [DEBUG] [LOCAL ] UMH: Loaded 32980 existing records from primary storage. [2025-09-17T22:59:11.693384] [INFO ] [MAIN ] UMH: Loaded 32980 primary data records. [2025-09-17T22:59:11.688718] [INFO ] [MAIN ] ULS: Loaded 39196 primary data records. [2025-09-17T22:59:12.554556] [DEBUG] [MAIN ] UMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:12.555371] [INFO ] [MAIN ] UMC: Generated 1794 derivative records from 52732 primary records. [2025-09-17T22:59:12.555634] [DEBUG] [LOCAL ] UMC: Saving derivative data. [2025-09-17T22:59:12.574023] [DEBUG] [LOCAL ] UMC: Derivative data saved (1794 records). [2025-09-17T22:59:12.586272] [INFO ] [MAIN ] UMC: Successfully saved derivative data. [2025-09-17T22:59:12.586543] [DEBUG] [MAIN ] ULS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:12.588514] [INFO ] [MAIN ] Derivative Progress: 1906/2085 symbols completed. UMC took 1.1s. Estimated remaining: 1m 10s. Rate: 154.5 symbols/min [2025-09-17T22:59:12.590224] [INFO ] [MAIN ] ULS: Generated 1794 derivative records from 39196 primary records. [2025-09-17T22:59:12.590669] [DEBUG] [LOCAL ] ULS: Saving derivative data. [2025-09-17T22:59:12.588859] [INFO ] [MAIN ] UNF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:12.618732] [DEBUG] [MAIN ] UMH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:12.620416] [INFO ] [MAIN ] UMH: Generated 1794 derivative records from 32980 primary records. [2025-09-17T22:59:12.624145] [DEBUG] [LOCAL ] UMH: Saving derivative data. [2025-09-17T22:59:12.625337] [DEBUG] [LOCAL ] ULS: Derivative data saved (1794 records). [2025-09-17T22:59:12.625440] [INFO ] [MAIN ] ULS: Successfully saved derivative data. [2025-09-17T22:59:12.628359] [INFO ] [MAIN ] Derivative Progress: 1907/2085 symbols completed. ULS took 1.1s. Estimated remaining: 1m 9s. Rate: 154.5 symbols/min [2025-09-17T22:59:12.628991] [INFO ] [MAIN ] UNFI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:12.648120] [DEBUG] [LOCAL ] UNF: Loaded 11792 existing records from primary storage. [2025-09-17T22:59:12.649242] [DEBUG] [LOCAL ] UMH: Derivative data saved (1794 records). [2025-09-17T22:59:12.649430] [INFO ] [MAIN ] UMH: Successfully saved derivative data. [2025-09-17T22:59:12.649349] [INFO ] [MAIN ] UNF: Loaded 11792 primary data records. [2025-09-17T22:59:12.652333] [INFO ] [MAIN ] Derivative Progress: 1908/2085 symbols completed. UMH took 1.2s. Estimated remaining: 1m 9s. Rate: 154.6 symbols/min [2025-09-17T22:59:12.684558] [INFO ] [MAIN ] UNH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:12.981272] [DEBUG] [LOCAL ] UNFI: Loaded 41923 existing records from primary storage. [2025-09-17T22:59:12.981429] [INFO ] [MAIN ] UNFI: Loaded 41923 primary data records. [2025-09-17T22:59:13.315375] [DEBUG] [LOCAL ] UNH: Loaded 53793 existing records from primary storage. [2025-09-17T22:59:13.317126] [INFO ] [MAIN ] UNH: Loaded 53793 primary data records. [2025-09-17T22:59:13.500877] [DEBUG] [MAIN ] UNF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:13.524747] [INFO ] [MAIN ] UNF: Generated 1794 derivative records from 11792 primary records. [2025-09-17T22:59:13.524849] [DEBUG] [LOCAL ] UNF: Saving derivative data. [2025-09-17T22:59:13.704115] [DEBUG] [LOCAL ] UNF: Derivative data saved (1794 records). [2025-09-17T22:59:13.705592] [INFO ] [MAIN ] UNF: Successfully saved derivative data. [2025-09-17T22:59:13.708024] [INFO ] [MAIN ] Derivative Progress: 1909/2085 symbols completed. UNF took 1.1s. Estimated remaining: 1m 8s. Rate: 154.5 symbols/min [2025-09-17T22:59:13.709007] [INFO ] [MAIN ] UNM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:13.726183] [DEBUG] [MAIN ] UNFI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:13.727943] [INFO ] [MAIN ] UNFI: Generated 1794 derivative records from 41923 primary records. [2025-09-17T22:59:13.728263] [DEBUG] [LOCAL ] UNFI: Saving derivative data. [2025-09-17T22:59:13.747809] [DEBUG] [LOCAL ] UNFI: Derivative data saved (1794 records). [2025-09-17T22:59:13.748904] [INFO ] [MAIN ] UNFI: Successfully saved derivative data. [2025-09-17T22:59:13.751697] [INFO ] [MAIN ] Derivative Progress: 1910/2085 symbols completed. UNFI took 1.1s. Estimated remaining: 1m 8s. Rate: 154.5 symbols/min [2025-09-17T22:59:13.752216] [INFO ] [MAIN ] UNMA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:13.765589] [DEBUG] [MAIN ] UNH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:13.767421] [INFO ] [MAIN ] UNH: Generated 1794 derivative records from 53793 primary records. [2025-09-17T22:59:13.767518] [DEBUG] [LOCAL ] UNH: Saving derivative data. [2025-09-17T22:59:13.795273] [DEBUG] [LOCAL ] UNMA: Loaded 3745 existing records from primary storage. [2025-09-17T22:59:13.797053] [INFO ] [MAIN ] UNMA: Loaded 3745 primary data records. [2025-09-17T22:59:13.796793] [DEBUG] [LOCAL ] UNH: Derivative data saved (1794 records). [2025-09-17T22:59:13.828951] [INFO ] [MAIN ] UNH: Successfully saved derivative data. [2025-09-17T22:59:13.844383] [INFO ] [MAIN ] Derivative Progress: 1911/2085 symbols completed. UNH took 1.2s. Estimated remaining: 1m 8s. Rate: 154.6 symbols/min [2025-09-17T22:59:13.919562] [INFO ] [MAIN ] UNP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:13.920588] [DEBUG] [LOCAL ] UNM: Loaded 48808 existing records from primary storage. [2025-09-17T22:59:13.926318] [INFO ] [MAIN ] UNM: Loaded 48808 primary data records. [2025-09-17T22:59:14.475721] [DEBUG] [LOCAL ] UNP: Loaded 53220 existing records from primary storage. [2025-09-17T22:59:14.476264] [INFO ] [MAIN ] UNP: Loaded 53220 primary data records. [2025-09-17T22:59:14.609303] [DEBUG] [MAIN ] UNMA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:14.626331] [INFO ] [MAIN ] UNMA: Generated 1794 derivative records from 3745 primary records. [2025-09-17T22:59:14.626532] [DEBUG] [LOCAL ] UNMA: Saving derivative data. [2025-09-17T22:59:14.813974] [DEBUG] [LOCAL ] UNMA: Derivative data saved (1794 records). [2025-09-17T22:59:14.814771] [INFO ] [MAIN ] UNMA: Successfully saved derivative data. [2025-09-17T22:59:14.817237] [INFO ] [MAIN ] Derivative Progress: 1912/2085 symbols completed. UNMA took 1.1s. Estimated remaining: 1m 7s. Rate: 154.5 symbols/min [2025-09-17T22:59:14.817700] [INFO ] [MAIN ] UP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:14.836417] [DEBUG] [MAIN ] UNM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:14.837367] [INFO ] [MAIN ] UNM: Generated 1794 derivative records from 48808 primary records. [2025-09-17T22:59:14.837944] [DEBUG] [LOCAL ] UNM: Saving derivative data. [2025-09-17T22:59:14.856480] [DEBUG] [LOCAL ] UNM: Derivative data saved (1794 records). [2025-09-17T22:59:14.858083] [INFO ] [MAIN ] UNM: Successfully saved derivative data. [2025-09-17T22:59:14.860748] [INFO ] [MAIN ] Derivative Progress: 1913/2085 symbols completed. UNM took 1.2s. Estimated remaining: 1m 7s. Rate: 154.6 symbols/min [2025-09-17T22:59:14.861415] [INFO ] [MAIN ] UPS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:14.889066] [DEBUG] [MAIN ] UNP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:14.890084] [INFO ] [MAIN ] UNP: Generated 1794 derivative records from 53220 primary records. [2025-09-17T22:59:14.890282] [DEBUG] [LOCAL ] UNP: Saving derivative data. [2025-09-17T22:59:14.924259] [DEBUG] [LOCAL ] UP: Loaded 42932 existing records from primary storage. [2025-09-17T22:59:14.925190] [INFO ] [MAIN ] UP: Loaded 42932 primary data records. [2025-09-17T22:59:14.993211] [DEBUG] [LOCAL ] UNP: Derivative data saved (1794 records). [2025-09-17T22:59:15.010422] [INFO ] [MAIN ] UNP: Successfully saved derivative data. [2025-09-17T22:59:15.031242] [INFO ] [MAIN ] Derivative Progress: 1914/2085 symbols completed. UNP took 1.1s. Estimated remaining: 1m 6s. Rate: 154.6 symbols/min [2025-09-17T22:59:15.035451] [INFO ] [MAIN ] URI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:15.258575] [DEBUG] [LOCAL ] UPS: Loaded 53710 existing records from primary storage. [2025-09-17T22:59:15.258942] [INFO ] [MAIN ] UPS: Loaded 53710 primary data records. [2025-09-17T22:59:15.624999] [DEBUG] [LOCAL ] URI: Loaded 36854 existing records from primary storage. [2025-09-17T22:59:15.625355] [INFO ] [MAIN ] URI: Loaded 36854 primary data records. [2025-09-17T22:59:15.942540] [DEBUG] [MAIN ] UP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:15.943338] [INFO ] [MAIN ] UP: Generated 1794 derivative records from 42932 primary records. [2025-09-17T22:59:15.943591] [DEBUG] [LOCAL ] UP: Saving derivative data. [2025-09-17T22:59:15.961852] [DEBUG] [LOCAL ] UP: Derivative data saved (1794 records). [2025-09-17T22:59:15.962424] [INFO ] [MAIN ] UP: Successfully saved derivative data. [2025-09-17T22:59:15.965535] [INFO ] [MAIN ] Derivative Progress: 1915/2085 symbols completed. UP took 1.1s. Estimated remaining: 1m 6s. Rate: 154.5 symbols/min [2025-09-17T22:59:15.966103] [INFO ] [MAIN ] USA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:15.982915] [DEBUG] [MAIN ] UPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:15.983864] [INFO ] [MAIN ] UPS: Generated 1794 derivative records from 53710 primary records. [2025-09-17T22:59:15.984074] [DEBUG] [LOCAL ] UPS: Saving derivative data. [2025-09-17T22:59:16.000444] [DEBUG] [LOCAL ] UPS: Derivative data saved (1794 records). [2025-09-17T22:59:16.000563] [INFO ] [MAIN ] UPS: Successfully saved derivative data. [2025-09-17T22:59:16.002772] [INFO ] [MAIN ] Derivative Progress: 1916/2085 symbols completed. UPS took 1.1s. Estimated remaining: 1m 6s. Rate: 154.6 symbols/min [2025-09-17T22:59:16.003285] [INFO ] [MAIN ] USAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:16.028972] [DEBUG] [MAIN ] URI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:16.029779] [INFO ] [MAIN ] URI: Generated 1794 derivative records from 36854 primary records. [2025-09-17T22:59:16.029886] [DEBUG] [LOCAL ] URI: Saving derivative data. [2025-09-17T22:59:16.060544] [DEBUG] [LOCAL ] USA: Loaded 36201 existing records from primary storage. [2025-09-17T22:59:16.067414] [INFO ] [MAIN ] USA: Loaded 36201 primary data records. [2025-09-17T22:59:16.069173] [DEBUG] [LOCAL ] USAC: Loaded 22957 existing records from primary storage. [2025-09-17T22:59:16.081132] [DEBUG] [LOCAL ] URI: Derivative data saved (1794 records). [2025-09-17T22:59:16.081070] [INFO ] [MAIN ] USAC: Loaded 22957 primary data records. [2025-09-17T22:59:16.101353] [INFO ] [MAIN ] URI: Successfully saved derivative data. [2025-09-17T22:59:16.116174] [INFO ] [MAIN ] Derivative Progress: 1917/2085 symbols completed. URI took 1.1s. Estimated remaining: 1m 5s. Rate: 154.6 symbols/min [2025-09-17T22:59:16.116429] [INFO ] [MAIN ] USB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:16.709373] [DEBUG] [LOCAL ] USB: Loaded 53688 existing records from primary storage. [2025-09-17T22:59:16.709850] [INFO ] [MAIN ] USB: Loaded 53688 primary data records. [2025-09-17T22:59:16.849165] [DEBUG] [MAIN ] USA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:16.886468] [INFO ] [MAIN ] USA: Generated 1794 derivative records from 36201 primary records. [2025-09-17T22:59:16.923579] [DEBUG] [LOCAL ] USA: Saving derivative data. [2025-09-17T22:59:16.928939] [DEBUG] [MAIN ] USAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:17.043734] [INFO ] [MAIN ] USAC: Generated 1794 derivative records from 22957 primary records. [2025-09-17T22:59:17.051419] [DEBUG] [LOCAL ] USAC: Saving derivative data. [2025-09-17T22:59:17.074186] [DEBUG] [LOCAL ] USA: Derivative data saved (1794 records). [2025-09-17T22:59:17.074820] [INFO ] [MAIN ] USA: Successfully saved derivative data. [2025-09-17T22:59:17.079259] [INFO ] [MAIN ] Derivative Progress: 1918/2085 symbols completed. USA took 1.1s. Estimated remaining: 1m 5s. Rate: 154.5 symbols/min [2025-09-17T22:59:17.082858] [DEBUG] [LOCAL ] USAC: Derivative data saved (1794 records). [2025-09-17T22:59:17.083089] [INFO ] [MAIN ] USAC: Successfully saved derivative data. [2025-09-17T22:59:17.085726] [INFO ] [MAIN ] Derivative Progress: 1919/2085 symbols completed. USAC took 1.1s. Estimated remaining: 1m 4s. Rate: 154.6 symbols/min [2025-09-17T22:59:17.104852] [DEBUG] [MAIN ] USB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:17.105392] [INFO ] [MAIN ] USB: Generated 1794 derivative records from 53688 primary records. [2025-09-17T22:59:17.105449] [DEBUG] [LOCAL ] USB: Saving derivative data. [2025-09-17T22:59:17.120869] [DEBUG] [LOCAL ] USB: Derivative data saved (1794 records). [2025-09-17T22:59:17.120927] [INFO ] [MAIN ] USB: Successfully saved derivative data. [2025-09-17T22:59:17.123962] [INFO ] [MAIN ] Derivative Progress: 1920/2085 symbols completed. USB took 1.0s. Estimated remaining: 1m 4s. Rate: 154.7 symbols/min [2025-09-17T22:59:17.124612] [INFO ] [MAIN ] USPH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:17.124514] [INFO ] [MAIN ] USFD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:17.125262] [INFO ] [MAIN ] USNA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:17.154888] [DEBUG] [LOCAL ] USNA: Loaded 18431 existing records from primary storage. [2025-09-17T22:59:17.154125] [DEBUG] [LOCAL ] USPH: Loaded 16649 existing records from primary storage. [2025-09-17T22:59:17.155032] [INFO ] [MAIN ] USNA: Loaded 18431 primary data records. [2025-09-17T22:59:17.155118] [INFO ] [MAIN ] USPH: Loaded 16649 primary data records. [2025-09-17T22:59:17.811517] [DEBUG] [LOCAL ] USFD: Loaded 51295 existing records from primary storage. [2025-09-17T22:59:17.825172] [INFO ] [MAIN ] USFD: Loaded 51295 primary data records. [2025-09-17T22:59:18.159606] [DEBUG] [MAIN ] USPH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:18.160782] [INFO ] [MAIN ] USPH: Generated 1794 derivative records from 16649 primary records. [2025-09-17T22:59:18.160887] [DEBUG] [LOCAL ] USPH: Saving derivative data. [2025-09-17T22:59:18.181047] [DEBUG] [LOCAL ] USPH: Derivative data saved (1794 records). [2025-09-17T22:59:18.181437] [INFO ] [MAIN ] USPH: Successfully saved derivative data. [2025-09-17T22:59:18.195937] [INFO ] [MAIN ] Derivative Progress: 1921/2085 symbols completed. USPH took 1.1s. Estimated remaining: 1m 4s. Rate: 154.5 symbols/min [2025-09-17T22:59:18.196385] [INFO ] [MAIN ] UTF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:18.197593] [DEBUG] [MAIN ] USNA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:18.198817] [INFO ] [MAIN ] USNA: Generated 1794 derivative records from 18431 primary records. [2025-09-17T22:59:18.199066] [DEBUG] [LOCAL ] USNA: Saving derivative data. [2025-09-17T22:59:18.236256] [DEBUG] [LOCAL ] USNA: Derivative data saved (1794 records). [2025-09-17T22:59:18.235588] [DEBUG] [MAIN ] USFD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:18.244311] [INFO ] [MAIN ] USNA: Successfully saved derivative data. [2025-09-17T22:59:18.244175] [INFO ] [MAIN ] USFD: Generated 1794 derivative records from 51295 primary records. [2025-09-17T22:59:18.244508] [DEBUG] [LOCAL ] USFD: Saving derivative data. [2025-09-17T22:59:18.247419] [INFO ] [MAIN ] Derivative Progress: 1922/2085 symbols completed. USNA took 1.1s. Estimated remaining: 1m 3s. Rate: 154.6 symbols/min [2025-09-17T22:59:18.248470] [INFO ] [MAIN ] UTI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:18.263996] [DEBUG] [LOCAL ] USFD: Derivative data saved (1794 records). [2025-09-17T22:59:18.271876] [INFO ] [MAIN ] USFD: Successfully saved derivative data. [2025-09-17T22:59:18.275092] [INFO ] [MAIN ] Derivative Progress: 1923/2085 symbols completed. USFD took 1.2s. Estimated remaining: 1m 3s. Rate: 154.7 symbols/min [2025-09-17T22:59:18.275630] [INFO ] [MAIN ] UTL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:18.277079] [DEBUG] [LOCAL ] UTF: Loaded 28177 existing records from primary storage. [2025-09-17T22:59:18.277282] [INFO ] [MAIN ] UTF: Loaded 28177 primary data records. [2025-09-17T22:59:18.399840] [DEBUG] [LOCAL ] UTL: Loaded 10793 existing records from primary storage. [2025-09-17T22:59:18.422104] [INFO ] [MAIN ] UTL: Loaded 10793 primary data records. [2025-09-17T22:59:18.723580] [DEBUG] [LOCAL ] UTI: Loaded 40683 existing records from primary storage. [2025-09-17T22:59:18.723983] [INFO ] [MAIN ] UTI: Loaded 40683 primary data records. [2025-09-17T22:59:19.250672] [DEBUG] [MAIN ] UTF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:19.251727] [INFO ] [MAIN ] UTF: Generated 1794 derivative records from 28177 primary records. [2025-09-17T22:59:19.251906] [DEBUG] [LOCAL ] UTF: Saving derivative data. [2025-09-17T22:59:19.278928] [DEBUG] [LOCAL ] UTF: Derivative data saved (1794 records). [2025-09-17T22:59:19.289044] [DEBUG] [MAIN ] UTL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:19.283558] [INFO ] [MAIN ] UTF: Successfully saved derivative data. [2025-09-17T22:59:19.291712] [INFO ] [MAIN ] Derivative Progress: 1924/2085 symbols completed. UTF took 1.1s. Estimated remaining: 1m 3s. Rate: 154.5 symbols/min [2025-09-17T22:59:19.291999] [INFO ] [MAIN ] UTZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:19.293852] [INFO ] [MAIN ] UTL: Generated 1794 derivative records from 10793 primary records. [2025-09-17T22:59:19.294933] [DEBUG] [LOCAL ] UTL: Saving derivative data. [2025-09-17T22:59:19.320984] [DEBUG] [MAIN ] UTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:19.322393] [INFO ] [MAIN ] UTI: Generated 1794 derivative records from 40683 primary records. [2025-09-17T22:59:19.322731] [DEBUG] [LOCAL ] UTI: Saving derivative data. [2025-09-17T22:59:19.325223] [DEBUG] [LOCAL ] UTL: Derivative data saved (1794 records). [2025-09-17T22:59:19.325451] [INFO ] [MAIN ] UTL: Successfully saved derivative data. [2025-09-17T22:59:19.328270] [INFO ] [MAIN ] Derivative Progress: 1925/2085 symbols completed. UTL took 1.1s. Estimated remaining: 1m 2s. Rate: 154.6 symbols/min [2025-09-17T22:59:19.339808] [INFO ] [MAIN ] UVE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:19.344558] [DEBUG] [LOCAL ] UTI: Derivative data saved (1794 records). [2025-09-17T22:59:19.344741] [INFO ] [MAIN ] UTI: Successfully saved derivative data. [2025-09-17T22:59:19.347312] [INFO ] [MAIN ] Derivative Progress: 1926/2085 symbols completed. UTI took 1.1s. Estimated remaining: 1m 2s. Rate: 154.7 symbols/min [2025-09-17T22:59:19.347778] [INFO ] [MAIN ] UVV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:19.380883] [DEBUG] [LOCAL ] UVE: Loaded 21847 existing records from primary storage. [2025-09-17T22:59:19.392360] [INFO ] [MAIN ] UVE: Loaded 21847 primary data records. [2025-09-17T22:59:19.426026] [DEBUG] [LOCAL ] UTZ: Loaded 44821 existing records from primary storage. [2025-09-17T22:59:19.444264] [INFO ] [MAIN ] UTZ: Loaded 44821 primary data records. [2025-09-17T22:59:19.472186] [DEBUG] [LOCAL ] UVV: Loaded 22239 existing records from primary storage. [2025-09-17T22:59:19.541479] [INFO ] [MAIN ] UVV: Loaded 22239 primary data records. [2025-09-17T22:59:20.377615] [DEBUG] [MAIN ] UVE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:20.378561] [INFO ] [MAIN ] UVE: Generated 1794 derivative records from 21847 primary records. [2025-09-17T22:59:20.378782] [DEBUG] [LOCAL ] UVE: Saving derivative data. [2025-09-17T22:59:20.391919] [DEBUG] [MAIN ] UTZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:20.393989] [INFO ] [MAIN ] UTZ: Generated 1794 derivative records from 44821 primary records. [2025-09-17T22:59:20.402046] [DEBUG] [LOCAL ] UTZ: Saving derivative data. [2025-09-17T22:59:20.427815] [DEBUG] [MAIN ] UVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:20.434802] [INFO ] [MAIN ] UVV: Generated 1794 derivative records from 22239 primary records. [2025-09-17T22:59:20.436797] [DEBUG] [LOCAL ] UVV: Saving derivative data. [2025-09-17T22:59:20.439819] [DEBUG] [LOCAL ] UTZ: Derivative data saved (1794 records). [2025-09-17T22:59:20.440575] [INFO ] [MAIN ] UTZ: Successfully saved derivative data. [2025-09-17T22:59:20.440863] [DEBUG] [LOCAL ] UVE: Derivative data saved (1794 records). [2025-09-17T22:59:20.450072] [INFO ] [MAIN ] Derivative Progress: 1927/2085 symbols completed. UTZ took 1.2s. Estimated remaining: 1m 1s. Rate: 154.5 symbols/min [2025-09-17T22:59:20.457917] [DEBUG] [LOCAL ] UVV: Derivative data saved (1794 records). [2025-09-17T22:59:20.451332] [INFO ] [MAIN ] UVE: Successfully saved derivative data. [2025-09-17T22:59:20.458234] [INFO ] [MAIN ] UWMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:20.460522] [INFO ] [MAIN ] Derivative Progress: 1928/2085 symbols completed. UVE took 1.1s. Estimated remaining: 1m 1s. Rate: 154.6 symbols/min [2025-09-17T22:59:20.460750] [INFO ] [MAIN ] UVV: Successfully saved derivative data. [2025-09-17T22:59:20.461051] [INFO ] [MAIN ] UZD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:20.463362] [INFO ] [MAIN ] Derivative Progress: 1929/2085 symbols completed. UVV took 1.1s. Estimated remaining: 1m 1s. Rate: 154.7 symbols/min [2025-09-17T22:59:20.464321] [INFO ] [MAIN ] UZE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:20.475780] [DEBUG] [LOCAL ] UZD: Loaded 6377 existing records from primary storage. [2025-09-17T22:59:20.475987] [INFO ] [MAIN ] UZD: Loaded 6377 primary data records. [2025-09-17T22:59:20.536183] [DEBUG] [LOCAL ] UZE: Loaded 7507 existing records from primary storage. [2025-09-17T22:59:20.562374] [INFO ] [MAIN ] UZE: Loaded 7507 primary data records. [2025-09-17T22:59:21.006094] [DEBUG] [LOCAL ] UWMC: Loaded 52717 existing records from primary storage. [2025-09-17T22:59:21.123607] [INFO ] [MAIN ] UWMC: Loaded 52717 primary data records. [2025-09-17T22:59:21.505538] [DEBUG] [MAIN ] UZD: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:59:21.509229] [INFO ] [MAIN ] UZD: Generated 1793 derivative records from 6377 primary records. [2025-09-17T22:59:21.509411] [DEBUG] [LOCAL ] UZD: Saving derivative data. [2025-09-17T22:59:21.537139] [DEBUG] [MAIN ] UZE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:21.539415] [DEBUG] [LOCAL ] UZD: Derivative data saved (1793 records). [2025-09-17T22:59:21.540352] [INFO ] [MAIN ] UZD: Successfully saved derivative data. [2025-09-17T22:59:21.540256] [INFO ] [MAIN ] UZE: Generated 1794 derivative records from 7507 primary records. [2025-09-17T22:59:21.542990] [INFO ] [MAIN ] Derivative Progress: 1930/2085 symbols completed. UZD took 1.1s. Estimated remaining: 1m 0s. Rate: 154.5 symbols/min [2025-09-17T22:59:21.543569] [INFO ] [MAIN ] UZF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:21.543313] [DEBUG] [LOCAL ] UZE: Saving derivative data. [2025-09-17T22:59:21.563883] [DEBUG] [LOCAL ] UZF: Loaded 6519 existing records from primary storage. [2025-09-17T22:59:21.567192] [INFO ] [MAIN ] UZF: Loaded 6519 primary data records. [2025-09-17T22:59:21.612105] [DEBUG] [LOCAL ] UZE: Derivative data saved (1794 records). [2025-09-17T22:59:21.644866] [INFO ] [MAIN ] UZE: Successfully saved derivative data. [2025-09-17T22:59:21.650897] [DEBUG] [MAIN ] UWMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:21.670247] [INFO ] [MAIN ] Derivative Progress: 1931/2085 symbols completed. UZE took 1.2s. Estimated remaining: 59.8s. Rate: 154.6 symbols/min [2025-09-17T22:59:21.684120] [INFO ] [MAIN ] V: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:21.688800] [INFO ] [MAIN ] UWMC: Generated 1794 derivative records from 52717 primary records. [2025-09-17T22:59:21.704901] [DEBUG] [LOCAL ] UWMC: Saving derivative data. [2025-09-17T22:59:21.904616] [DEBUG] [LOCAL ] UWMC: Derivative data saved (1794 records). [2025-09-17T22:59:21.904888] [INFO ] [MAIN ] UWMC: Successfully saved derivative data. [2025-09-17T22:59:21.907187] [INFO ] [MAIN ] Derivative Progress: 1932/2085 symbols completed. UWMC took 1.4s. Estimated remaining: 59.4s. Rate: 154.6 symbols/min [2025-09-17T22:59:21.907624] [INFO ] [MAIN ] VAC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:21.951074] [DEBUG] [MAIN ] UZF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:21.951858] [INFO ] [MAIN ] UZF: Generated 1794 derivative records from 6519 primary records. [2025-09-17T22:59:21.959075] [DEBUG] [LOCAL ] UZF: Saving derivative data. [2025-09-17T22:59:22.001553] [DEBUG] [LOCAL ] UZF: Derivative data saved (1794 records). [2025-09-17T22:59:22.001770] [INFO ] [MAIN ] UZF: Successfully saved derivative data. [2025-09-17T22:59:22.004152] [INFO ] [MAIN ] Derivative Progress: 1933/2085 symbols completed. UZF took 0.5s. Estimated remaining: 59.0s. Rate: 154.7 symbols/min [2025-09-17T22:59:22.005497] [DEBUG] [LOCAL ] V: Loaded 53763 existing records from primary storage. [2025-09-17T22:59:22.005882] [INFO ] [MAIN ] V: Loaded 53763 primary data records. [2025-09-17T22:59:22.039031] [DEBUG] [LOCAL ] VAC: Loaded 34824 existing records from primary storage. [2025-09-17T22:59:22.071996] [INFO ] [MAIN ] VAC: Loaded 34824 primary data records. [2025-09-17T22:59:22.645869] [DEBUG] [MAIN ] V: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:22.647510] [INFO ] [MAIN ] V: Generated 1794 derivative records from 53763 primary records. [2025-09-17T22:59:22.648993] [DEBUG] [LOCAL ] V: Saving derivative data. [2025-09-17T22:59:22.671083] [DEBUG] [MAIN ] VAC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:22.677307] [INFO ] [MAIN ] VAC: Generated 1794 derivative records from 34824 primary records. [2025-09-17T22:59:22.677579] [DEBUG] [LOCAL ] VAC: Saving derivative data. [2025-09-17T22:59:22.686851] [DEBUG] [LOCAL ] V: Derivative data saved (1794 records). [2025-09-17T22:59:22.690836] [INFO ] [MAIN ] V: Successfully saved derivative data. [2025-09-17T22:59:22.693724] [INFO ] [MAIN ] Derivative Progress: 1934/2085 symbols completed. V took 1.0s. Estimated remaining: 58.6s. Rate: 154.6 symbols/min [2025-09-17T22:59:22.697688] [DEBUG] [LOCAL ] VAC: Derivative data saved (1794 records). [2025-09-17T22:59:22.697758] [INFO ] [MAIN ] VAC: Successfully saved derivative data. [2025-09-17T22:59:22.700157] [INFO ] [MAIN ] Derivative Progress: 1935/2085 symbols completed. VAC took 0.8s. Estimated remaining: 58.2s. Rate: 154.7 symbols/min [2025-09-17T22:59:22.700717] [INFO ] [MAIN ] VAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:22.700975] [INFO ] [MAIN ] VATE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:22.700919] [INFO ] [MAIN ] VALE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:22.711717] [DEBUG] [LOCAL ] VATE: Loaded 5840 existing records from primary storage. [2025-09-17T22:59:22.711869] [INFO ] [MAIN ] VATE: Loaded 5840 primary data records. [2025-09-17T22:59:23.070405] [DEBUG] [LOCAL ] VAL: Loaded 50555 existing records from primary storage. [2025-09-17T22:59:23.071967] [INFO ] [MAIN ] VAL: Loaded 50555 primary data records. [2025-09-17T22:59:23.071325] [DEBUG] [LOCAL ] VALE: Loaded 53694 existing records from primary storage. [2025-09-17T22:59:23.077627] [INFO ] [MAIN ] VALE: Loaded 53694 primary data records. [2025-09-17T22:59:23.785134] [DEBUG] [MAIN ] VATE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:23.786319] [INFO ] [MAIN ] VATE: Generated 1794 derivative records from 5840 primary records. [2025-09-17T22:59:23.786495] [DEBUG] [LOCAL ] VATE: Saving derivative data. [2025-09-17T22:59:23.805201] [DEBUG] [LOCAL ] VATE: Derivative data saved (1794 records). [2025-09-17T22:59:23.805367] [INFO ] [MAIN ] VATE: Successfully saved derivative data. [2025-09-17T22:59:23.807587] [INFO ] [MAIN ] Derivative Progress: 1936/2085 symbols completed. VATE took 1.1s. Estimated remaining: 57.8s. Rate: 154.6 symbols/min [2025-09-17T22:59:23.808749] [INFO ] [MAIN ] VBF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:23.829151] [DEBUG] [MAIN ] VAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:23.833797] [DEBUG] [LOCAL ] VBF: Loaded 7163 existing records from primary storage. [2025-09-17T22:59:23.836599] [INFO ] [MAIN ] VAL: Generated 1794 derivative records from 50555 primary records. [2025-09-17T22:59:23.836789] [INFO ] [MAIN ] VBF: Loaded 7163 primary data records. [2025-09-17T22:59:23.836859] [DEBUG] [LOCAL ] VAL: Saving derivative data. [2025-09-17T22:59:23.897323] [DEBUG] [MAIN ] VALE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:23.913072] [INFO ] [MAIN ] VALE: Generated 1794 derivative records from 53694 primary records. [2025-09-17T22:59:23.947044] [DEBUG] [LOCAL ] VALE: Saving derivative data. [2025-09-17T22:59:23.978114] [DEBUG] [LOCAL ] VAL: Derivative data saved (1794 records). [2025-09-17T22:59:23.978847] [INFO ] [MAIN ] VAL: Successfully saved derivative data. [2025-09-17T22:59:23.981233] [INFO ] [MAIN ] Derivative Progress: 1937/2085 symbols completed. VAL took 1.3s. Estimated remaining: 57.4s. Rate: 154.6 symbols/min [2025-09-17T22:59:24.004605] [INFO ] [MAIN ] VCV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:24.023421] [DEBUG] [LOCAL ] VALE: Derivative data saved (1794 records). [2025-09-17T22:59:24.054542] [INFO ] [MAIN ] VALE: Successfully saved derivative data. [2025-09-17T22:59:24.081137] [INFO ] [MAIN ] Derivative Progress: 1938/2085 symbols completed. VALE took 1.4s. Estimated remaining: 57.0s. Rate: 154.7 symbols/min [2025-09-17T22:59:24.200820] [INFO ] [MAIN ] VEEV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:24.216934] [DEBUG] [LOCAL ] VCV: Loaded 13450 existing records from primary storage. [2025-09-17T22:59:24.217955] [INFO ] [MAIN ] VCV: Loaded 13450 primary data records. [2025-09-17T22:59:24.590802] [DEBUG] [MAIN ] VBF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:24.595015] [INFO ] [MAIN ] VBF: Generated 1794 derivative records from 7163 primary records. [2025-09-17T22:59:24.593494] [DEBUG] [LOCAL ] VEEV: Loaded 47534 existing records from primary storage. [2025-09-17T22:59:24.595161] [DEBUG] [LOCAL ] VBF: Saving derivative data. [2025-09-17T22:59:24.595738] [INFO ] [MAIN ] VEEV: Loaded 47534 primary data records. [2025-09-17T22:59:24.659150] [DEBUG] [LOCAL ] VBF: Derivative data saved (1794 records). [2025-09-17T22:59:24.671850] [INFO ] [MAIN ] VBF: Successfully saved derivative data. [2025-09-17T22:59:24.715741] [INFO ] [MAIN ] Derivative Progress: 1939/2085 symbols completed. VBF took 0.9s. Estimated remaining: 56.7s. Rate: 154.6 symbols/min [2025-09-17T22:59:24.725099] [INFO ] [MAIN ] VEL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:24.816772] [DEBUG] [LOCAL ] VEL: Loaded 12987 existing records from primary storage. [2025-09-17T22:59:24.817103] [INFO ] [MAIN ] VEL: Loaded 12987 primary data records. [2025-09-17T22:59:25.083243] [DEBUG] [MAIN ] VCV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:25.112533] [INFO ] [MAIN ] VCV: Generated 1794 derivative records from 13450 primary records. [2025-09-17T22:59:25.266957] [DEBUG] [LOCAL ] VCV: Saving derivative data. [2025-09-17T22:59:25.287454] [DEBUG] [LOCAL ] VCV: Derivative data saved (1794 records). [2025-09-17T22:59:25.288018] [INFO ] [MAIN ] VCV: Successfully saved derivative data. [2025-09-17T22:59:25.290491] [INFO ] [MAIN ] Derivative Progress: 1940/2085 symbols completed. VCV took 1.3s. Estimated remaining: 56.3s. Rate: 154.6 symbols/min [2025-09-17T22:59:25.290937] [INFO ] [MAIN ] VET: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:25.309341] [DEBUG] [MAIN ] VEEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:25.310218] [INFO ] [MAIN ] VEEV: Generated 1794 derivative records from 47534 primary records. [2025-09-17T22:59:25.310350] [DEBUG] [LOCAL ] VEEV: Saving derivative data. [2025-09-17T22:59:25.328033] [DEBUG] [LOCAL ] VEEV: Derivative data saved (1794 records). [2025-09-17T22:59:25.328201] [INFO ] [MAIN ] VEEV: Successfully saved derivative data. [2025-09-17T22:59:25.330458] [INFO ] [MAIN ] Derivative Progress: 1941/2085 symbols completed. VEEV took 1.1s. Estimated remaining: 55.9s. Rate: 154.6 symbols/min [2025-09-17T22:59:25.330757] [INFO ] [MAIN ] VFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:25.347195] [DEBUG] [MAIN ] VEL: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:59:25.347982] [INFO ] [MAIN ] VEL: Generated 1793 derivative records from 12987 primary records. [2025-09-17T22:59:25.348102] [DEBUG] [LOCAL ] VEL: Saving derivative data. [2025-09-17T22:59:25.375232] [DEBUG] [LOCAL ] VEL: Derivative data saved (1793 records). [2025-09-17T22:59:25.375499] [INFO ] [MAIN ] VEL: Successfully saved derivative data. [2025-09-17T22:59:25.389244] [INFO ] [MAIN ] Derivative Progress: 1942/2085 symbols completed. VEL took 0.7s. Estimated remaining: 55.5s. Rate: 154.7 symbols/min [2025-09-17T22:59:25.391020] [INFO ] [MAIN ] VGI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:25.392168] [DEBUG] [LOCAL ] VET: Loaded 44395 existing records from primary storage. [2025-09-17T22:59:25.392679] [INFO ] [MAIN ] VET: Loaded 44395 primary data records. [2025-09-17T22:59:25.508395] [DEBUG] [LOCAL ] VGI: Loaded 5240 existing records from primary storage. [2025-09-17T22:59:25.520613] [INFO ] [MAIN ] VGI: Loaded 5240 primary data records. [2025-09-17T22:59:25.904199] [DEBUG] [LOCAL ] VFC: Loaded 53610 existing records from primary storage. [2025-09-17T22:59:25.911070] [INFO ] [MAIN ] VFC: Loaded 53610 primary data records. [2025-09-17T22:59:26.460057] [DEBUG] [MAIN ] VET: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:26.461218] [INFO ] [MAIN ] VET: Generated 1794 derivative records from 44395 primary records. [2025-09-17T22:59:26.461366] [DEBUG] [LOCAL ] VET: Saving derivative data. [2025-09-17T22:59:26.481219] [DEBUG] [LOCAL ] VET: Derivative data saved (1794 records). [2025-09-17T22:59:26.481777] [INFO ] [MAIN ] VET: Successfully saved derivative data. [2025-09-17T22:59:26.484133] [INFO ] [MAIN ] Derivative Progress: 1943/2085 symbols completed. VET took 1.2s. Estimated remaining: 55.1s. Rate: 154.6 symbols/min [2025-09-17T22:59:26.484549] [INFO ] [MAIN ] VGM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:26.510561] [DEBUG] [MAIN ] VGI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:26.512033] [INFO ] [MAIN ] VGI: Generated 1794 derivative records from 5240 primary records. [2025-09-17T22:59:26.512336] [DEBUG] [LOCAL ] VGI: Saving derivative data. [2025-09-17T22:59:26.547636] [DEBUG] [LOCAL ] VGM: Loaded 18294 existing records from primary storage. [2025-09-17T22:59:26.547224] [DEBUG] [LOCAL ] VGI: Derivative data saved (1794 records). [2025-09-17T22:59:26.548853] [INFO ] [MAIN ] VGM: Loaded 18294 primary data records. [2025-09-17T22:59:26.548751] [INFO ] [MAIN ] VGI: Successfully saved derivative data. [2025-09-17T22:59:26.564691] [INFO ] [MAIN ] Derivative Progress: 1944/2085 symbols completed. VGI took 1.2s. Estimated remaining: 54.7s. Rate: 154.6 symbols/min [2025-09-17T22:59:26.640814] [INFO ] [MAIN ] VHI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:26.653105] [DEBUG] [MAIN ] VFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:26.674000] [INFO ] [MAIN ] VFC: Generated 1794 derivative records from 53610 primary records. [2025-09-17T22:59:26.677867] [DEBUG] [LOCAL ] VFC: Saving derivative data. [2025-09-17T22:59:26.782526] [DEBUG] [LOCAL ] VHI: Loaded 2988 existing records from primary storage. [2025-09-17T22:59:26.905248] [INFO ] [MAIN ] VHI: Loaded 2988 primary data records. [2025-09-17T22:59:26.930805] [DEBUG] [LOCAL ] VFC: Derivative data saved (1794 records). [2025-09-17T22:59:26.937085] [INFO ] [MAIN ] VFC: Successfully saved derivative data. [2025-09-17T22:59:26.939491] [INFO ] [MAIN ] Derivative Progress: 1945/2085 symbols completed. VFC took 1.6s. Estimated remaining: 54.3s. Rate: 154.6 symbols/min [2025-09-17T22:59:26.940374] [INFO ] [MAIN ] VICI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:27.298565] [DEBUG] [MAIN ] VGM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:27.299756] [INFO ] [MAIN ] VGM: Generated 1794 derivative records from 18294 primary records. [2025-09-17T22:59:27.300074] [DEBUG] [LOCAL ] VGM: Saving derivative data. [2025-09-17T22:59:27.334828] [DEBUG] [LOCAL ] VGM: Derivative data saved (1794 records). [2025-09-17T22:59:27.335865] [DEBUG] [LOCAL ] VICI: Loaded 53648 existing records from primary storage. [2025-09-17T22:59:27.336244] [INFO ] [MAIN ] VICI: Loaded 53648 primary data records. [2025-09-17T22:59:27.336430] [INFO ] [MAIN ] VGM: Successfully saved derivative data. [2025-09-17T22:59:27.370809] [INFO ] [MAIN ] Derivative Progress: 1946/2085 symbols completed. VGM took 0.9s. Estimated remaining: 53.9s. Rate: 154.6 symbols/min [2025-09-17T22:59:27.405489] [INFO ] [MAIN ] VIK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:27.655331] [DEBUG] [MAIN ] VHI: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:59:27.697186] [INFO ] [MAIN ] VHI: Generated 1793 derivative records from 2988 primary records. [2025-09-17T22:59:27.697701] [DEBUG] [LOCAL ] VHI: Saving derivative data. [2025-09-17T22:59:27.726338] [DEBUG] [LOCAL ] VHI: Derivative data saved (1793 records). [2025-09-17T22:59:27.726727] [INFO ] [MAIN ] VHI: Successfully saved derivative data. [2025-09-17T22:59:27.729075] [INFO ] [MAIN ] Derivative Progress: 1947/2085 symbols completed. VHI took 1.1s. Estimated remaining: 53.5s. Rate: 154.6 symbols/min [2025-09-17T22:59:27.729739] [INFO ] [MAIN ] VIPS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:27.753857] [DEBUG] [LOCAL ] VIK: Loaded 52526 existing records from primary storage. [2025-09-17T22:59:27.754861] [INFO ] [MAIN ] VIK: Loaded 52526 primary data records. [2025-09-17T22:59:27.837162] [DEBUG] [MAIN ] VICI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:27.869983] [INFO ] [MAIN ] VICI: Generated 1794 derivative records from 53648 primary records. [2025-09-17T22:59:27.882671] [DEBUG] [LOCAL ] VICI: Saving derivative data. [2025-09-17T22:59:28.138694] [DEBUG] [LOCAL ] VIPS: Loaded 51401 existing records from primary storage. [2025-09-17T22:59:28.139445] [INFO ] [MAIN ] VIPS: Loaded 51401 primary data records. [2025-09-17T22:59:28.187121] [DEBUG] [LOCAL ] VICI: Derivative data saved (1794 records). [2025-09-17T22:59:28.201230] [INFO ] [MAIN ] VICI: Successfully saved derivative data. [2025-09-17T22:59:28.231630] [INFO ] [MAIN ] Derivative Progress: 1948/2085 symbols completed. VICI took 1.3s. Estimated remaining: 53.2s. Rate: 154.6 symbols/min [2025-09-17T22:59:28.470047] [DEBUG] [MAIN ] VIK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:28.471198] [INFO ] [MAIN ] VIK: Generated 1794 derivative records from 52526 primary records. [2025-09-17T22:59:28.471436] [DEBUG] [LOCAL ] VIK: Saving derivative data. [2025-09-17T22:59:28.488581] [DEBUG] [LOCAL ] VIK: Derivative data saved (1794 records). [2025-09-17T22:59:28.488916] [INFO ] [MAIN ] VIK: Successfully saved derivative data. [2025-09-17T22:59:28.491125] [INFO ] [MAIN ] Derivative Progress: 1949/2085 symbols completed. VIK took 1.1s. Estimated remaining: 52.8s. Rate: 154.6 symbols/min [2025-09-17T22:59:28.508632] [DEBUG] [MAIN ] VIPS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:28.509186] [INFO ] [MAIN ] VIPS: Generated 1794 derivative records from 51401 primary records. [2025-09-17T22:59:28.509245] [DEBUG] [LOCAL ] VIPS: Saving derivative data. [2025-09-17T22:59:28.524339] [DEBUG] [LOCAL ] VIPS: Derivative data saved (1794 records). [2025-09-17T22:59:28.524403] [INFO ] [MAIN ] VIPS: Successfully saved derivative data. [2025-09-17T22:59:28.526475] [INFO ] [MAIN ] Derivative Progress: 1950/2085 symbols completed. VIPS took 0.8s. Estimated remaining: 52.4s. Rate: 154.7 symbols/min [2025-09-17T22:59:28.527171] [INFO ] [MAIN ] VIST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:28.527234] [INFO ] [MAIN ] VIRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:28.527686] [INFO ] [MAIN ] VIV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:28.594287] [DEBUG] [LOCAL ] VIV: Loaded 45466 existing records from primary storage. [2025-09-17T22:59:28.594447] [INFO ] [MAIN ] VIV: Loaded 45466 primary data records. [2025-09-17T22:59:28.727097] [DEBUG] [LOCAL ] VIST: Loaded 45954 existing records from primary storage. [2025-09-17T22:59:28.730878] [INFO ] [MAIN ] VIST: Loaded 45954 primary data records. [2025-09-17T22:59:28.742517] [DEBUG] [LOCAL ] VIRT: Loaded 47088 existing records from primary storage. [2025-09-17T22:59:28.764770] [INFO ] [MAIN ] VIRT: Loaded 47088 primary data records. [2025-09-17T22:59:29.597171] [DEBUG] [MAIN ] VIV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:29.598145] [INFO ] [MAIN ] VIV: Generated 1794 derivative records from 45466 primary records. [2025-09-17T22:59:29.598465] [DEBUG] [LOCAL ] VIV: Saving derivative data. [2025-09-17T22:59:29.618244] [DEBUG] [LOCAL ] VIV: Derivative data saved (1794 records). [2025-09-17T22:59:29.618818] [INFO ] [MAIN ] VIV: Successfully saved derivative data. [2025-09-17T22:59:29.630477] [INFO ] [MAIN ] Derivative Progress: 1951/2085 symbols completed. VIV took 1.1s. Estimated remaining: 52.0s. Rate: 154.6 symbols/min [2025-09-17T22:59:29.636714] [DEBUG] [MAIN ] VIST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:29.637555] [INFO ] [MAIN ] VIST: Generated 1794 derivative records from 45954 primary records. [2025-09-17T22:59:29.636339] [INFO ] [MAIN ] VLN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:29.649727] [DEBUG] [LOCAL ] VIST: Saving derivative data. [2025-09-17T22:59:29.650892] [DEBUG] [MAIN ] VIRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:29.652503] [INFO ] [MAIN ] VIRT: Generated 1794 derivative records from 47088 primary records. [2025-09-17T22:59:29.652838] [DEBUG] [LOCAL ] VIRT: Saving derivative data. [2025-09-17T22:59:29.683585] [DEBUG] [LOCAL ] VIST: Derivative data saved (1794 records). [2025-09-17T22:59:29.684249] [INFO ] [MAIN ] VIST: Successfully saved derivative data. [2025-09-17T22:59:29.687038] [INFO ] [MAIN ] Derivative Progress: 1952/2085 symbols completed. VIST took 1.2s. Estimated remaining: 51.6s. Rate: 154.6 symbols/min [2025-09-17T22:59:29.687708] [INFO ] [MAIN ] VLO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:29.688250] [DEBUG] [LOCAL ] VIRT: Derivative data saved (1794 records). [2025-09-17T22:59:29.688990] [INFO ] [MAIN ] VIRT: Successfully saved derivative data. [2025-09-17T22:59:29.699300] [INFO ] [MAIN ] Derivative Progress: 1953/2085 symbols completed. VIRT took 1.2s. Estimated remaining: 51.2s. Rate: 154.7 symbols/min [2025-09-17T22:59:29.699754] [INFO ] [MAIN ] VLRS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:29.717633] [DEBUG] [LOCAL ] VLN: Loaded 28076 existing records from primary storage. [2025-09-17T22:59:29.717870] [INFO ] [MAIN ] VLN: Loaded 28076 primary data records. [2025-09-17T22:59:30.082904] [DEBUG] [LOCAL ] VLRS: Loaded 41047 existing records from primary storage. [2025-09-17T22:59:30.083156] [INFO ] [MAIN ] VLRS: Loaded 41047 primary data records. [2025-09-17T22:59:30.147635] [DEBUG] [LOCAL ] VLO: Loaded 53098 existing records from primary storage. [2025-09-17T22:59:30.172981] [INFO ] [MAIN ] VLO: Loaded 53098 primary data records. [2025-09-17T22:59:30.749410] [DEBUG] [MAIN ] VLN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:30.751091] [INFO ] [MAIN ] VLN: Generated 1794 derivative records from 28076 primary records. [2025-09-17T22:59:30.751619] [DEBUG] [LOCAL ] VLN: Saving derivative data. [2025-09-17T22:59:30.770731] [DEBUG] [LOCAL ] VLN: Derivative data saved (1794 records). [2025-09-17T22:59:30.771034] [INFO ] [MAIN ] VLN: Successfully saved derivative data. [2025-09-17T22:59:30.773392] [INFO ] [MAIN ] Derivative Progress: 1954/2085 symbols completed. VLN took 1.1s. Estimated remaining: 50.9s. Rate: 154.6 symbols/min [2025-09-17T22:59:30.775455] [INFO ] [MAIN ] VLT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:30.792929] [DEBUG] [MAIN ] VLRS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:30.796702] [INFO ] [MAIN ] VLRS: Generated 1794 derivative records from 41047 primary records. [2025-09-17T22:59:30.796854] [DEBUG] [LOCAL ] VLRS: Saving derivative data. [2025-09-17T22:59:30.829532] [DEBUG] [LOCAL ] VLRS: Derivative data saved (1794 records). [2025-09-17T22:59:30.827188] [DEBUG] [LOCAL ] VLT: Loaded 4716 existing records from primary storage. [2025-09-17T22:59:30.829869] [INFO ] [MAIN ] VLT: Loaded 4716 primary data records. [2025-09-17T22:59:30.829777] [INFO ] [MAIN ] VLRS: Successfully saved derivative data. [2025-09-17T22:59:30.832305] [INFO ] [MAIN ] Derivative Progress: 1955/2085 symbols completed. VLRS took 1.1s. Estimated remaining: 50.4s. Rate: 154.6 symbols/min [2025-09-17T22:59:30.830278] [DEBUG] [MAIN ] VLO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:30.855420] [INFO ] [MAIN ] VLO: Generated 1794 derivative records from 53098 primary records. [2025-09-17T22:59:30.864497] [INFO ] [MAIN ] VLTO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:30.892372] [DEBUG] [LOCAL ] VLO: Saving derivative data. [2025-09-17T22:59:30.959540] [DEBUG] [LOCAL ] VLO: Derivative data saved (1794 records). [2025-09-17T22:59:30.964988] [INFO ] [MAIN ] VLO: Successfully saved derivative data. [2025-09-17T22:59:30.977697] [INFO ] [MAIN ] Derivative Progress: 1956/2085 symbols completed. VLO took 1.3s. Estimated remaining: 50.0s. Rate: 154.7 symbols/min [2025-09-17T22:59:30.983059] [INFO ] [MAIN ] VMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:31.209273] [DEBUG] [LOCAL ] VLTO: Loaded 46059 existing records from primary storage. [2025-09-17T22:59:31.214051] [INFO ] [MAIN ] VLTO: Loaded 46059 primary data records. [2025-09-17T22:59:31.237049] [DEBUG] [MAIN ] VLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:31.283019] [INFO ] [MAIN ] VLT: Generated 1794 derivative records from 4716 primary records. [2025-09-17T22:59:31.305367] [DEBUG] [LOCAL ] VLT: Saving derivative data. [2025-09-17T22:59:31.381044] [DEBUG] [LOCAL ] VMC: Loaded 44086 existing records from primary storage. [2025-09-17T22:59:31.387846] [INFO ] [MAIN ] VMC: Loaded 44086 primary data records. [2025-09-17T22:59:31.502805] [DEBUG] [LOCAL ] VLT: Derivative data saved (1794 records). [2025-09-17T22:59:31.654924] [INFO ] [MAIN ] VLT: Successfully saved derivative data. [2025-09-17T22:59:31.676038] [INFO ] [MAIN ] Derivative Progress: 1957/2085 symbols completed. VLT took 0.9s. Estimated remaining: 49.7s. Rate: 154.6 symbols/min [2025-09-17T22:59:31.683253] [INFO ] [MAIN ] VMI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:31.940631] [DEBUG] [LOCAL ] VMI: Loaded 15552 existing records from primary storage. [2025-09-17T22:59:31.942395] [INFO ] [MAIN ] VMI: Loaded 15552 primary data records. [2025-09-17T22:59:32.084182] [DEBUG] [MAIN ] VLTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:32.095609] [INFO ] [MAIN ] VLTO: Generated 1794 derivative records from 46059 primary records. [2025-09-17T22:59:32.112710] [DEBUG] [LOCAL ] VLTO: Saving derivative data. [2025-09-17T22:59:32.279359] [DEBUG] [LOCAL ] VLTO: Derivative data saved (1794 records). [2025-09-17T22:59:32.279703] [INFO ] [MAIN ] VLTO: Successfully saved derivative data. [2025-09-17T22:59:32.281876] [INFO ] [MAIN ] Derivative Progress: 1958/2085 symbols completed. VLTO took 1.4s. Estimated remaining: 49.3s. Rate: 154.6 symbols/min [2025-09-17T22:59:32.282505] [INFO ] [MAIN ] VMO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:32.303870] [DEBUG] [MAIN ] VMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:32.305054] [INFO ] [MAIN ] VMC: Generated 1794 derivative records from 44086 primary records. [2025-09-17T22:59:32.305191] [DEBUG] [LOCAL ] VMC: Saving derivative data. [2025-09-17T22:59:32.328666] [DEBUG] [LOCAL ] VMC: Derivative data saved (1794 records). [2025-09-17T22:59:32.329095] [INFO ] [MAIN ] VMC: Successfully saved derivative data. [2025-09-17T22:59:32.331391] [INFO ] [MAIN ] Derivative Progress: 1959/2085 symbols completed. VMC took 1.3s. Estimated remaining: 48.9s. Rate: 154.6 symbols/min [2025-09-17T22:59:32.331834] [INFO ] [MAIN ] VNCE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:32.342085] [DEBUG] [LOCAL ] VMO: Loaded 21032 existing records from primary storage. [2025-09-17T22:59:32.342355] [INFO ] [MAIN ] VMO: Loaded 21032 primary data records. [2025-09-17T22:59:32.420466] [DEBUG] [LOCAL ] VNCE: Loaded 6181 existing records from primary storage. [2025-09-17T22:59:32.443206] [INFO ] [MAIN ] VNCE: Loaded 6181 primary data records. [2025-09-17T22:59:32.556094] [DEBUG] [MAIN ] VMI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:32.603309] [INFO ] [MAIN ] VMI: Generated 1794 derivative records from 15552 primary records. [2025-09-17T22:59:32.675176] [DEBUG] [LOCAL ] VMI: Saving derivative data. [2025-09-17T22:59:33.026573] [DEBUG] [LOCAL ] VMI: Derivative data saved (1794 records). [2025-09-17T22:59:33.027594] [INFO ] [MAIN ] VMI: Successfully saved derivative data. [2025-09-17T22:59:33.030876] [INFO ] [MAIN ] Derivative Progress: 1960/2085 symbols completed. VMI took 1.3s. Estimated remaining: 48.5s. Rate: 154.6 symbols/min [2025-09-17T22:59:33.031366] [INFO ] [MAIN ] VNO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:33.059141] [DEBUG] [MAIN ] VMO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:33.060122] [INFO ] [MAIN ] VMO: Generated 1794 derivative records from 21032 primary records. [2025-09-17T22:59:33.060310] [DEBUG] [LOCAL ] VMO: Saving derivative data. [2025-09-17T22:59:33.079441] [DEBUG] [LOCAL ] VMO: Derivative data saved (1794 records). [2025-09-17T22:59:33.089994] [INFO ] [MAIN ] VMO: Successfully saved derivative data. [2025-09-17T22:59:33.092404] [INFO ] [MAIN ] Derivative Progress: 1961/2085 symbols completed. VMO took 0.8s. Estimated remaining: 48.1s. Rate: 154.6 symbols/min [2025-09-17T22:59:33.100612] [INFO ] [MAIN ] VNT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:33.106426] [DEBUG] [MAIN ] VNCE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:33.107322] [INFO ] [MAIN ] VNCE: Generated 1794 derivative records from 6181 primary records. [2025-09-17T22:59:33.107570] [DEBUG] [LOCAL ] VNCE: Saving derivative data. [2025-09-17T22:59:33.137772] [DEBUG] [LOCAL ] VNCE: Derivative data saved (1794 records). [2025-09-17T22:59:33.136426] [DEBUG] [LOCAL ] VNO: Loaded 48996 existing records from primary storage. [2025-09-17T22:59:33.138017] [INFO ] [MAIN ] VNCE: Successfully saved derivative data. [2025-09-17T22:59:33.140340] [INFO ] [MAIN ] Derivative Progress: 1962/2085 symbols completed. VNCE took 0.8s. Estimated remaining: 47.7s. Rate: 154.7 symbols/min [2025-09-17T22:59:33.140724] [INFO ] [MAIN ] VOC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:33.141132] [INFO ] [MAIN ] VNO: Loaded 48996 primary data records. [2025-09-17T22:59:33.265438] [DEBUG] [LOCAL ] VOC: Loaded 8996 existing records from primary storage. [2025-09-17T22:59:33.265629] [INFO ] [MAIN ] VOC: Loaded 8996 primary data records. [2025-09-17T22:59:33.583514] [DEBUG] [LOCAL ] VNT: Loaded 44364 existing records from primary storage. [2025-09-17T22:59:33.584244] [INFO ] [MAIN ] VNT: Loaded 44364 primary data records. [2025-09-17T22:59:34.167371] [DEBUG] [MAIN ] VNO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:34.168541] [INFO ] [MAIN ] VNO: Generated 1794 derivative records from 48996 primary records. [2025-09-17T22:59:34.169434] [DEBUG] [LOCAL ] VNO: Saving derivative data. [2025-09-17T22:59:34.198246] [DEBUG] [MAIN ] VOC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:34.199897] [INFO ] [MAIN ] VOC: Generated 1794 derivative records from 8996 primary records. [2025-09-17T22:59:34.200638] [DEBUG] [LOCAL ] VOC: Saving derivative data. [2025-09-17T22:59:34.212690] [DEBUG] [LOCAL ] VNO: Derivative data saved (1794 records). [2025-09-17T22:59:34.214435] [INFO ] [MAIN ] VNO: Successfully saved derivative data. [2025-09-17T22:59:34.221058] [INFO ] [MAIN ] Derivative Progress: 1963/2085 symbols completed. VNO took 1.2s. Estimated remaining: 47.4s. Rate: 154.6 symbols/min [2025-09-17T22:59:34.239271] [DEBUG] [MAIN ] VNT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:34.240173] [DEBUG] [LOCAL ] VOC: Derivative data saved (1794 records). [2025-09-17T22:59:34.240335] [INFO ] [MAIN ] VOC: Successfully saved derivative data. [2025-09-17T22:59:34.243450] [INFO ] [MAIN ] Derivative Progress: 1964/2085 symbols completed. VOC took 1.1s. Estimated remaining: 46.9s. Rate: 154.6 symbols/min [2025-09-17T22:59:34.241116] [INFO ] [MAIN ] VNT: Generated 1794 derivative records from 44364 primary records. [2025-09-17T22:59:34.243764] [DEBUG] [LOCAL ] VNT: Saving derivative data. [2025-09-17T22:59:34.259513] [DEBUG] [LOCAL ] VNT: Derivative data saved (1794 records). [2025-09-17T22:59:34.259580] [INFO ] [MAIN ] VNT: Successfully saved derivative data. [2025-09-17T22:59:34.261808] [INFO ] [MAIN ] Derivative Progress: 1965/2085 symbols completed. VNT took 1.2s. Estimated remaining: 46.5s. Rate: 154.7 symbols/min [2025-09-17T22:59:34.262345] [INFO ] [MAIN ] VOYA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:34.262803] [INFO ] [MAIN ] VPG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:34.262529] [INFO ] [MAIN ] VPV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:34.280601] [DEBUG] [LOCAL ] VPV: Loaded 5389 existing records from primary storage. [2025-09-17T22:59:34.280761] [INFO ] [MAIN ] VPV: Loaded 5389 primary data records. [2025-09-17T22:59:34.319579] [DEBUG] [LOCAL ] VPG: Loaded 17231 existing records from primary storage. [2025-09-17T22:59:34.344155] [INFO ] [MAIN ] VPG: Loaded 17231 primary data records. [2025-09-17T22:59:34.798291] [DEBUG] [LOCAL ] VOYA: Loaded 42978 existing records from primary storage. [2025-09-17T22:59:34.886137] [INFO ] [MAIN ] VOYA: Loaded 42978 primary data records. [2025-09-17T22:59:35.248727] [DEBUG] [MAIN ] VPV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:35.250079] [INFO ] [MAIN ] VPV: Generated 1794 derivative records from 5389 primary records. [2025-09-17T22:59:35.250233] [DEBUG] [LOCAL ] VPV: Saving derivative data. [2025-09-17T22:59:35.268428] [DEBUG] [LOCAL ] VPV: Derivative data saved (1794 records). [2025-09-17T22:59:35.268688] [INFO ] [MAIN ] VPV: Successfully saved derivative data. [2025-09-17T22:59:35.271303] [INFO ] [MAIN ] Derivative Progress: 1966/2085 symbols completed. VPV took 1.0s. Estimated remaining: 46.2s. Rate: 154.6 symbols/min [2025-09-17T22:59:35.286868] [INFO ] [MAIN ] VRE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:35.287780] [DEBUG] [MAIN ] VPG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:35.289104] [INFO ] [MAIN ] VPG: Generated 1794 derivative records from 17231 primary records. [2025-09-17T22:59:35.289382] [DEBUG] [LOCAL ] VPG: Saving derivative data. [2025-09-17T22:59:35.307243] [DEBUG] [LOCAL ] VPG: Derivative data saved (1794 records). [2025-09-17T22:59:35.307465] [INFO ] [MAIN ] VPG: Successfully saved derivative data. [2025-09-17T22:59:35.309747] [INFO ] [MAIN ] Derivative Progress: 1967/2085 symbols completed. VPG took 1.0s. Estimated remaining: 45.8s. Rate: 154.7 symbols/min [2025-09-17T22:59:35.310009] [INFO ] [MAIN ] VRT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:35.327922] [DEBUG] [MAIN ] VOYA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:35.337299] [INFO ] [MAIN ] VOYA: Generated 1794 derivative records from 42978 primary records. [2025-09-17T22:59:35.337469] [DEBUG] [LOCAL ] VOYA: Saving derivative data. [2025-09-17T22:59:35.365083] [DEBUG] [LOCAL ] VOYA: Derivative data saved (1794 records). [2025-09-17T22:59:35.365911] [DEBUG] [LOCAL ] VRE: Loaded 34705 existing records from primary storage. [2025-09-17T22:59:35.365334] [INFO ] [MAIN ] VOYA: Successfully saved derivative data. [2025-09-17T22:59:35.369270] [INFO ] [MAIN ] VRE: Loaded 34705 primary data records. [2025-09-17T22:59:35.369180] [INFO ] [MAIN ] Derivative Progress: 1968/2085 symbols completed. VOYA took 1.1s. Estimated remaining: 45.4s. Rate: 154.7 symbols/min [2025-09-17T22:59:35.369739] [INFO ] [MAIN ] VRTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:35.524473] [DEBUG] [LOCAL ] VRTS: Loaded 9066 existing records from primary storage. [2025-09-17T22:59:35.552547] [INFO ] [MAIN ] VRTS: Loaded 9066 primary data records. [2025-09-17T22:59:35.660139] [DEBUG] [LOCAL ] VRT: Loaded 53753 existing records from primary storage. [2025-09-17T22:59:35.799073] [INFO ] [MAIN ] VRT: Loaded 53753 primary data records. [2025-09-17T22:59:36.387808] [DEBUG] [MAIN ] VRE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:36.389695] [INFO ] [MAIN ] VRE: Generated 1794 derivative records from 34705 primary records. [2025-09-17T22:59:36.389946] [DEBUG] [LOCAL ] VRE: Saving derivative data. [2025-09-17T22:59:36.418871] [DEBUG] [LOCAL ] VRE: Derivative data saved (1794 records). [2025-09-17T22:59:36.420872] [DEBUG] [MAIN ] VRTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:36.423230] [INFO ] [MAIN ] VRTS: Generated 1794 derivative records from 9066 primary records. [2025-09-17T22:59:36.423348] [INFO ] [MAIN ] VRE: Successfully saved derivative data. [2025-09-17T22:59:36.425671] [DEBUG] [LOCAL ] VRTS: Saving derivative data. [2025-09-17T22:59:36.425559] [INFO ] [MAIN ] Derivative Progress: 1969/2085 symbols completed. VRE took 1.1s. Estimated remaining: 45.0s. Rate: 154.6 symbols/min [2025-09-17T22:59:36.427102] [INFO ] [MAIN ] VSCO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:36.453638] [DEBUG] [MAIN ] VRT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:36.455534] [INFO ] [MAIN ] VRT: Generated 1794 derivative records from 53753 primary records. [2025-09-17T22:59:36.455748] [DEBUG] [LOCAL ] VRT: Saving derivative data. [2025-09-17T22:59:36.457402] [DEBUG] [LOCAL ] VRTS: Derivative data saved (1794 records). [2025-09-17T22:59:36.457941] [INFO ] [MAIN ] VRTS: Successfully saved derivative data. [2025-09-17T22:59:36.460418] [INFO ] [MAIN ] Derivative Progress: 1970/2085 symbols completed. VRTS took 1.1s. Estimated remaining: 44.6s. Rate: 154.7 symbols/min [2025-09-17T22:59:36.468110] [INFO ] [MAIN ] VSH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:36.477823] [DEBUG] [LOCAL ] VRT: Derivative data saved (1794 records). [2025-09-17T22:59:36.478028] [INFO ] [MAIN ] VRT: Successfully saved derivative data. [2025-09-17T22:59:36.480365] [INFO ] [MAIN ] Derivative Progress: 1971/2085 symbols completed. VRT took 1.2s. Estimated remaining: 44.2s. Rate: 154.7 symbols/min [2025-09-17T22:59:36.480728] [INFO ] [MAIN ] VST: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:36.538053] [DEBUG] [LOCAL ] VSCO: Loaded 52903 existing records from primary storage. [2025-09-17T22:59:36.538268] [INFO ] [MAIN ] VSCO: Loaded 52903 primary data records. [2025-09-17T22:59:36.673995] [DEBUG] [LOCAL ] VSH: Loaded 48785 existing records from primary storage. [2025-09-17T22:59:36.684896] [INFO ] [MAIN ] VSH: Loaded 48785 primary data records. [2025-09-17T22:59:36.950967] [DEBUG] [LOCAL ] VST: Loaded 53722 existing records from primary storage. [2025-09-17T22:59:36.974809] [INFO ] [MAIN ] VST: Loaded 53722 primary data records. [2025-09-17T22:59:37.522724] [DEBUG] [MAIN ] VSCO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:37.523607] [INFO ] [MAIN ] VSCO: Generated 1794 derivative records from 52903 primary records. [2025-09-17T22:59:37.523809] [DEBUG] [LOCAL ] VSCO: Saving derivative data. [2025-09-17T22:59:37.544009] [DEBUG] [LOCAL ] VSCO: Derivative data saved (1794 records). [2025-09-17T22:59:37.545777] [INFO ] [MAIN ] VSCO: Successfully saved derivative data. [2025-09-17T22:59:37.548302] [INFO ] [MAIN ] Derivative Progress: 1972/2085 symbols completed. VSCO took 1.1s. Estimated remaining: 43.9s. Rate: 154.6 symbols/min [2025-09-17T22:59:37.548853] [INFO ] [MAIN ] VSTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:37.562974] [DEBUG] [MAIN ] VSH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:37.565729] [INFO ] [MAIN ] VSH: Generated 1794 derivative records from 48785 primary records. [2025-09-17T22:59:37.566930] [DEBUG] [LOCAL ] VSH: Saving derivative data. [2025-09-17T22:59:37.593796] [DEBUG] [MAIN ] VST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:37.597459] [DEBUG] [LOCAL ] VSH: Derivative data saved (1794 records). [2025-09-17T22:59:37.597381] [INFO ] [MAIN ] VST: Generated 1794 derivative records from 53722 primary records. [2025-09-17T22:59:37.597763] [INFO ] [MAIN ] VSH: Successfully saved derivative data. [2025-09-17T22:59:37.597691] [DEBUG] [LOCAL ] VST: Saving derivative data. [2025-09-17T22:59:37.601206] [INFO ] [MAIN ] Derivative Progress: 1973/2085 symbols completed. VSH took 1.1s. Estimated remaining: 43.4s. Rate: 154.7 symbols/min [2025-09-17T22:59:37.602546] [INFO ] [MAIN ] VTEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:37.632005] [DEBUG] [LOCAL ] VST: Derivative data saved (1794 records). [2025-09-17T22:59:37.632166] [INFO ] [MAIN ] VST: Successfully saved derivative data. [2025-09-17T22:59:37.634568] [INFO ] [MAIN ] Derivative Progress: 1974/2085 symbols completed. VST took 1.2s. Estimated remaining: 43.0s. Rate: 154.7 symbols/min [2025-09-17T22:59:37.634914] [INFO ] [MAIN ] VTLE: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:37.654949] [DEBUG] [LOCAL ] VSTS: Loaded 49016 existing records from primary storage. [2025-09-17T22:59:37.655177] [INFO ] [MAIN ] VSTS: Loaded 49016 primary data records. [2025-09-17T22:59:37.815221] [DEBUG] [LOCAL ] VTEX: Loaded 43487 existing records from primary storage. [2025-09-17T22:59:37.838922] [INFO ] [MAIN ] VTEX: Loaded 43487 primary data records. [2025-09-17T22:59:38.133264] [DEBUG] [LOCAL ] VTLE: Loaded 48717 existing records from primary storage. [2025-09-17T22:59:38.157620] [INFO ] [MAIN ] VTLE: Loaded 48717 primary data records. [2025-09-17T22:59:38.751464] [DEBUG] [MAIN ] VSTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:38.752829] [INFO ] [MAIN ] VSTS: Generated 1794 derivative records from 49016 primary records. [2025-09-17T22:59:38.767299] [DEBUG] [LOCAL ] VSTS: Saving derivative data. [2025-09-17T22:59:38.767574] [DEBUG] [MAIN ] VTEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:38.769569] [INFO ] [MAIN ] VTEX: Generated 1794 derivative records from 43487 primary records. [2025-09-17T22:59:38.769952] [DEBUG] [LOCAL ] VTEX: Saving derivative data. [2025-09-17T22:59:38.798276] [DEBUG] [LOCAL ] VTEX: Derivative data saved (1794 records). [2025-09-17T22:59:38.798999] [INFO ] [MAIN ] VTEX: Successfully saved derivative data. [2025-09-17T22:59:38.802175] [INFO ] [MAIN ] Derivative Progress: 1975/2085 symbols completed. VTEX took 1.2s. Estimated remaining: 42.7s. Rate: 154.6 symbols/min [2025-09-17T22:59:38.803173] [INFO ] [MAIN ] VTMX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:38.808438] [DEBUG] [LOCAL ] VSTS: Derivative data saved (1794 records). [2025-09-17T22:59:38.809676] [INFO ] [MAIN ] VSTS: Successfully saved derivative data. [2025-09-17T22:59:38.812928] [INFO ] [MAIN ] Derivative Progress: 1976/2085 symbols completed. VSTS took 1.3s. Estimated remaining: 42.3s. Rate: 154.7 symbols/min [2025-09-17T22:59:38.813344] [INFO ] [MAIN ] VTN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:38.828155] [DEBUG] [MAIN ] VTLE: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:38.829020] [INFO ] [MAIN ] VTLE: Generated 1794 derivative records from 48717 primary records. [2025-09-17T22:59:38.834020] [DEBUG] [LOCAL ] VTLE: Saving derivative data. [2025-09-17T22:59:38.863449] [DEBUG] [LOCAL ] VTLE: Derivative data saved (1794 records). [2025-09-17T22:59:38.863599] [INFO ] [MAIN ] VTLE: Successfully saved derivative data. [2025-09-17T22:59:38.865090] [DEBUG] [LOCAL ] VTN: Loaded 7183 existing records from primary storage. [2025-09-17T22:59:38.867757] [INFO ] [MAIN ] VTN: Loaded 7183 primary data records. [2025-09-17T22:59:38.867671] [INFO ] [MAIN ] Derivative Progress: 1977/2085 symbols completed. VTLE took 1.2s. Estimated remaining: 41.9s. Rate: 154.7 symbols/min [2025-09-17T22:59:38.868110] [INFO ] [MAIN ] VTOL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:38.868515] [DEBUG] [LOCAL ] VTMX: Loaded 17367 existing records from primary storage. [2025-09-17T22:59:38.891750] [INFO ] [MAIN ] VTMX: Loaded 17367 primary data records. [2025-09-17T22:59:39.196845] [DEBUG] [LOCAL ] VTOL: Loaded 19850 existing records from primary storage. [2025-09-17T22:59:39.271504] [INFO ] [MAIN ] VTOL: Loaded 19850 primary data records. [2025-09-17T22:59:39.915562] [DEBUG] [MAIN ] VTMX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:39.916514] [INFO ] [MAIN ] VTMX: Generated 1794 derivative records from 17367 primary records. [2025-09-17T22:59:39.916713] [DEBUG] [LOCAL ] VTMX: Saving derivative data. [2025-09-17T22:59:39.937330] [DEBUG] [MAIN ] VTN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:39.939118] [INFO ] [MAIN ] VTN: Generated 1794 derivative records from 7183 primary records. [2025-09-17T22:59:39.941809] [DEBUG] [LOCAL ] VTN: Saving derivative data. [2025-09-17T22:59:39.946670] [DEBUG] [LOCAL ] VTMX: Derivative data saved (1794 records). [2025-09-17T22:59:39.947484] [INFO ] [MAIN ] VTMX: Successfully saved derivative data. [2025-09-17T22:59:39.950215] [INFO ] [MAIN ] Derivative Progress: 1978/2085 symbols completed. VTMX took 1.1s. Estimated remaining: 41.5s. Rate: 154.6 symbols/min [2025-09-17T22:59:39.965532] [DEBUG] [LOCAL ] VTN: Derivative data saved (1794 records). [2025-09-17T22:59:39.965849] [INFO ] [MAIN ] VTN: Successfully saved derivative data. [2025-09-17T22:59:39.967947] [INFO ] [MAIN ] Derivative Progress: 1979/2085 symbols completed. VTN took 1.2s. Estimated remaining: 41.1s. Rate: 154.7 symbols/min [2025-09-17T22:59:39.984187] [DEBUG] [MAIN ] VTOL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:39.984822] [INFO ] [MAIN ] VTOL: Generated 1794 derivative records from 19850 primary records. [2025-09-17T22:59:39.984885] [DEBUG] [LOCAL ] VTOL: Saving derivative data. [2025-09-17T22:59:39.999920] [DEBUG] [LOCAL ] VTOL: Derivative data saved (1794 records). [2025-09-17T22:59:40.000006] [INFO ] [MAIN ] VTOL: Successfully saved derivative data. [2025-09-17T22:59:40.002535] [INFO ] [MAIN ] Derivative Progress: 1980/2085 symbols completed. VTOL took 1.1s. Estimated remaining: 40.7s. Rate: 154.7 symbols/min [2025-09-17T22:59:40.003295] [INFO ] [MAIN ] VTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:40.003370] [INFO ] [MAIN ] VTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:40.003592] [INFO ] [MAIN ] VVR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:40.049046] [DEBUG] [LOCAL ] VVR: Loaded 30214 existing records from primary storage. [2025-09-17T22:59:40.069627] [INFO ] [MAIN ] VVR: Loaded 30214 primary data records. [2025-09-17T22:59:40.092937] [DEBUG] [LOCAL ] VTS: Loaded 30328 existing records from primary storage. [2025-09-17T22:59:40.110122] [INFO ] [MAIN ] VTS: Loaded 30328 primary data records. [2025-09-17T22:59:40.295956] [DEBUG] [LOCAL ] VTR: Loaded 52831 existing records from primary storage. [2025-09-17T22:59:40.309326] [INFO ] [MAIN ] VTR: Loaded 52831 primary data records. [2025-09-17T22:59:41.074410] [DEBUG] [MAIN ] VVR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:41.087833] [DEBUG] [MAIN ] VTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:41.088814] [INFO ] [MAIN ] VVR: Generated 1794 derivative records from 30214 primary records. [2025-09-17T22:59:41.089745] [INFO ] [MAIN ] VTS: Generated 1794 derivative records from 30328 primary records. [2025-09-17T22:59:41.090864] [DEBUG] [LOCAL ] VVR: Saving derivative data. [2025-09-17T22:59:41.090935] [DEBUG] [LOCAL ] VTS: Saving derivative data. [2025-09-17T22:59:41.135694] [DEBUG] [MAIN ] VTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:41.138154] [INFO ] [MAIN ] VTR: Generated 1794 derivative records from 52831 primary records. [2025-09-17T22:59:41.130553] [DEBUG] [LOCAL ] VTS: Derivative data saved (1794 records). [2025-09-17T22:59:41.138765] [INFO ] [MAIN ] VTS: Successfully saved derivative data. [2025-09-17T22:59:41.141421] [DEBUG] [LOCAL ] VVR: Derivative data saved (1794 records). [2025-09-17T22:59:41.141340] [INFO ] [MAIN ] Derivative Progress: 1981/2085 symbols completed. VTS took 1.1s. Estimated remaining: 40.4s. Rate: 154.6 symbols/min [2025-09-17T22:59:41.141623] [DEBUG] [LOCAL ] VTR: Saving derivative data. [2025-09-17T22:59:41.142580] [INFO ] [MAIN ] VVR: Successfully saved derivative data. [2025-09-17T22:59:41.142694] [INFO ] [MAIN ] VVV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:41.144995] [INFO ] [MAIN ] Derivative Progress: 1982/2085 symbols completed. VVR took 1.1s. Estimated remaining: 40.0s. Rate: 154.7 symbols/min [2025-09-17T22:59:41.155959] [INFO ] [MAIN ] VVX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:41.161899] [DEBUG] [LOCAL ] VTR: Derivative data saved (1794 records). [2025-09-17T22:59:41.161999] [INFO ] [MAIN ] VTR: Successfully saved derivative data. [2025-09-17T22:59:41.164462] [INFO ] [MAIN ] Derivative Progress: 1983/2085 symbols completed. VTR took 1.2s. Estimated remaining: 39.6s. Rate: 154.7 symbols/min [2025-09-17T22:59:41.164853] [INFO ] [MAIN ] VYX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:41.183508] [DEBUG] [LOCAL ] VVX: Loaded 23315 existing records from primary storage. [2025-09-17T22:59:41.183663] [INFO ] [MAIN ] VVX: Loaded 23315 primary data records. [2025-09-17T22:59:41.535120] [DEBUG] [LOCAL ] VVV: Loaded 50149 existing records from primary storage. [2025-09-17T22:59:41.544246] [DEBUG] [LOCAL ] VYX: Loaded 49231 existing records from primary storage. [2025-09-17T22:59:41.543143] [INFO ] [MAIN ] VVV: Loaded 50149 primary data records. [2025-09-17T22:59:41.544432] [INFO ] [MAIN ] VYX: Loaded 49231 primary data records. [2025-09-17T22:59:42.232628] [DEBUG] [MAIN ] VVX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:42.233935] [INFO ] [MAIN ] VVX: Generated 1794 derivative records from 23315 primary records. [2025-09-17T22:59:42.234341] [DEBUG] [LOCAL ] VVX: Saving derivative data. [2025-09-17T22:59:42.256001] [DEBUG] [LOCAL ] VVX: Derivative data saved (1794 records). [2025-09-17T22:59:42.256567] [INFO ] [MAIN ] VVX: Successfully saved derivative data. [2025-09-17T22:59:42.259221] [INFO ] [MAIN ] Derivative Progress: 1984/2085 symbols completed. VVX took 1.1s. Estimated remaining: 39.2s. Rate: 154.6 symbols/min [2025-09-17T22:59:42.259748] [INFO ] [MAIN ] VZ: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:42.279830] [DEBUG] [MAIN ] VYX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:42.280983] [INFO ] [MAIN ] VYX: Generated 1794 derivative records from 49231 primary records. [2025-09-17T22:59:42.281057] [DEBUG] [LOCAL ] VYX: Saving derivative data. [2025-09-17T22:59:42.302186] [DEBUG] [LOCAL ] VYX: Derivative data saved (1794 records). [2025-09-17T22:59:42.315884] [INFO ] [MAIN ] VYX: Successfully saved derivative data. [2025-09-17T22:59:42.315766] [DEBUG] [MAIN ] VVV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:42.318991] [INFO ] [MAIN ] Derivative Progress: 1985/2085 symbols completed. VYX took 1.2s. Estimated remaining: 38.8s. Rate: 154.7 symbols/min [2025-09-17T22:59:42.320466] [INFO ] [MAIN ] W: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:42.320393] [INFO ] [MAIN ] VVV: Generated 1794 derivative records from 50149 primary records. [2025-09-17T22:59:42.320735] [DEBUG] [LOCAL ] VVV: Saving derivative data. [2025-09-17T22:59:42.356522] [DEBUG] [LOCAL ] VVV: Derivative data saved (1794 records). [2025-09-17T22:59:42.356923] [INFO ] [MAIN ] VVV: Successfully saved derivative data. [2025-09-17T22:59:42.360091] [INFO ] [MAIN ] Derivative Progress: 1986/2085 symbols completed. VVV took 1.2s. Estimated remaining: 38.4s. Rate: 154.7 symbols/min [2025-09-17T22:59:42.360676] [INFO ] [MAIN ] WAB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:42.394632] [DEBUG] [LOCAL ] VZ: Loaded 53791 existing records from primary storage. [2025-09-17T22:59:42.395057] [INFO ] [MAIN ] VZ: Loaded 53791 primary data records. [2025-09-17T22:59:42.599075] [DEBUG] [LOCAL ] W: Loaded 53511 existing records from primary storage. [2025-09-17T22:59:42.599436] [INFO ] [MAIN ] W: Loaded 53511 primary data records. [2025-09-17T22:59:42.738162] [DEBUG] [LOCAL ] WAB: Loaded 44409 existing records from primary storage. [2025-09-17T22:59:42.759866] [INFO ] [MAIN ] WAB: Loaded 44409 primary data records. [2025-09-17T22:59:43.762783] [DEBUG] [MAIN ] VZ: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:43.765445] [INFO ] [MAIN ] VZ: Generated 1794 derivative records from 53791 primary records. [2025-09-17T22:59:43.765787] [DEBUG] [LOCAL ] VZ: Saving derivative data. [2025-09-17T22:59:43.780596] [DEBUG] [MAIN ] W: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:43.793581] [INFO ] [MAIN ] W: Generated 1794 derivative records from 53511 primary records. [2025-09-17T22:59:43.793760] [DEBUG] [LOCAL ] W: Saving derivative data. [2025-09-17T22:59:43.799417] [DEBUG] [LOCAL ] VZ: Derivative data saved (1794 records). [2025-09-17T22:59:43.799866] [INFO ] [MAIN ] VZ: Successfully saved derivative data. [2025-09-17T22:59:43.801868] [INFO ] [MAIN ] Derivative Progress: 1987/2085 symbols completed. VZ took 1.5s. Estimated remaining: 38.1s. Rate: 154.5 symbols/min [2025-09-17T22:59:43.822670] [DEBUG] [MAIN ] WAB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:43.822965] [INFO ] [MAIN ] WAL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:43.823801] [INFO ] [MAIN ] WAB: Generated 1794 derivative records from 44409 primary records. [2025-09-17T22:59:43.823936] [DEBUG] [LOCAL ] WAB: Saving derivative data. [2025-09-17T22:59:43.833281] [DEBUG] [LOCAL ] W: Derivative data saved (1794 records). [2025-09-17T22:59:43.833813] [INFO ] [MAIN ] W: Successfully saved derivative data. [2025-09-17T22:59:43.836937] [INFO ] [MAIN ] Derivative Progress: 1988/2085 symbols completed. W took 1.5s. Estimated remaining: 37.6s. Rate: 154.6 symbols/min [2025-09-17T22:59:43.848472] [INFO ] [MAIN ] WAT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:43.854729] [DEBUG] [LOCAL ] WAB: Derivative data saved (1794 records). [2025-09-17T22:59:43.854806] [INFO ] [MAIN ] WAB: Successfully saved derivative data. [2025-09-17T22:59:43.857107] [INFO ] [MAIN ] Derivative Progress: 1989/2085 symbols completed. WAB took 1.5s. Estimated remaining: 37.2s. Rate: 154.7 symbols/min [2025-09-17T22:59:43.857408] [INFO ] [MAIN ] WBS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:43.904563] [DEBUG] [LOCAL ] WAL: Loaded 45527 existing records from primary storage. [2025-09-17T22:59:43.904786] [INFO ] [MAIN ] WAL: Loaded 45527 primary data records. [2025-09-17T22:59:44.007032] [DEBUG] [LOCAL ] WAT: Loaded 35144 existing records from primary storage. [2025-09-17T22:59:44.036675] [INFO ] [MAIN ] WAT: Loaded 35144 primary data records. [2025-09-17T22:59:44.155261] [DEBUG] [LOCAL ] WBS: Loaded 48893 existing records from primary storage. [2025-09-17T22:59:44.210602] [INFO ] [MAIN ] WBS: Loaded 48893 primary data records. [2025-09-17T22:59:44.961364] [DEBUG] [MAIN ] WAL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:44.962444] [INFO ] [MAIN ] WAL: Generated 1794 derivative records from 45527 primary records. [2025-09-17T22:59:44.962633] [DEBUG] [LOCAL ] WAL: Saving derivative data. [2025-09-17T22:59:44.996789] [DEBUG] [MAIN ] WAT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:44.998601] [INFO ] [MAIN ] WAT: Generated 1794 derivative records from 35144 primary records. [2025-09-17T22:59:45.001785] [DEBUG] [LOCAL ] WAL: Derivative data saved (1794 records). [2025-09-17T22:59:45.001891] [DEBUG] [LOCAL ] WAT: Saving derivative data. [2025-09-17T22:59:45.002420] [INFO ] [MAIN ] WAL: Successfully saved derivative data. [2025-09-17T22:59:45.005739] [INFO ] [MAIN ] Derivative Progress: 1990/2085 symbols completed. WAL took 1.2s. Estimated remaining: 36.9s. Rate: 154.5 symbols/min [2025-09-17T22:59:45.006083] [INFO ] [MAIN ] WBX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:45.028710] [DEBUG] [MAIN ] WBS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:45.033709] [INFO ] [MAIN ] WBS: Generated 1794 derivative records from 48893 primary records. [2025-09-17T22:59:45.035081] [DEBUG] [LOCAL ] WBS: Saving derivative data. [2025-09-17T22:59:45.053675] [DEBUG] [LOCAL ] WAT: Derivative data saved (1794 records). [2025-09-17T22:59:45.053567] [DEBUG] [LOCAL ] WBS: Derivative data saved (1794 records). [2025-09-17T22:59:45.058047] [INFO ] [MAIN ] WAT: Successfully saved derivative data. [2025-09-17T22:59:45.057955] [INFO ] [MAIN ] WBS: Successfully saved derivative data. [2025-09-17T22:59:45.060582] [INFO ] [MAIN ] Derivative Progress: 1991/2085 symbols completed. WBS took 1.2s. Estimated remaining: 36.5s. Rate: 154.6 symbols/min [2025-09-17T22:59:45.063772] [INFO ] [MAIN ] WCC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:45.063843] [INFO ] [MAIN ] Derivative Progress: 1992/2085 symbols completed. WAT took 1.2s. Estimated remaining: 36.1s. Rate: 154.7 symbols/min [2025-09-17T22:59:45.064606] [INFO ] [MAIN ] WCN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:45.071059] [DEBUG] [LOCAL ] WBX: Loaded 13440 existing records from primary storage. [2025-09-17T22:59:45.071217] [INFO ] [MAIN ] WBX: Loaded 13440 primary data records. [2025-09-17T22:59:45.409511] [DEBUG] [LOCAL ] WCC: Loaded 40333 existing records from primary storage. [2025-09-17T22:59:45.410382] [INFO ] [MAIN ] WCC: Loaded 40333 primary data records. [2025-09-17T22:59:45.532356] [DEBUG] [LOCAL ] WCN: Loaded 48091 existing records from primary storage. [2025-09-17T22:59:45.536219] [INFO ] [MAIN ] WCN: Loaded 48091 primary data records. [2025-09-17T22:59:46.081454] [DEBUG] [MAIN ] WBX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:46.082843] [INFO ] [MAIN ] WBX: Generated 1794 derivative records from 13440 primary records. [2025-09-17T22:59:46.083048] [DEBUG] [LOCAL ] WBX: Saving derivative data. [2025-09-17T22:59:46.101735] [DEBUG] [LOCAL ] WBX: Derivative data saved (1794 records). [2025-09-17T22:59:46.102077] [INFO ] [MAIN ] WBX: Successfully saved derivative data. [2025-09-17T22:59:46.104484] [INFO ] [MAIN ] Derivative Progress: 1993/2085 symbols completed. WBX took 1.1s. Estimated remaining: 35.7s. Rate: 154.5 symbols/min [2025-09-17T22:59:46.123362] [DEBUG] [MAIN ] WCC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:46.124158] [INFO ] [MAIN ] WCC: Generated 1794 derivative records from 40333 primary records. [2025-09-17T22:59:46.124252] [DEBUG] [LOCAL ] WCC: Saving derivative data. [2025-09-17T22:59:46.155161] [DEBUG] [LOCAL ] WCC: Derivative data saved (1794 records). [2025-09-17T22:59:46.155267] [INFO ] [MAIN ] WCC: Successfully saved derivative data. [2025-09-17T22:59:46.157302] [INFO ] [MAIN ] Derivative Progress: 1994/2085 symbols completed. WCC took 1.1s. Estimated remaining: 35.3s. Rate: 154.6 symbols/min [2025-09-17T22:59:46.155086] [DEBUG] [MAIN ] WCN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:46.158185] [INFO ] [MAIN ] WCN: Generated 1794 derivative records from 48091 primary records. [2025-09-17T22:59:46.158360] [DEBUG] [LOCAL ] WCN: Saving derivative data. [2025-09-17T22:59:46.173955] [DEBUG] [LOCAL ] WCN: Derivative data saved (1794 records). [2025-09-17T22:59:46.174013] [INFO ] [MAIN ] WCN: Successfully saved derivative data. [2025-09-17T22:59:46.177261] [INFO ] [MAIN ] Derivative Progress: 1995/2085 symbols completed. WCN took 1.1s. Estimated remaining: 34.9s. Rate: 154.7 symbols/min [2025-09-17T22:59:46.177787] [INFO ] [MAIN ] WDH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:46.177958] [INFO ] [MAIN ] WD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:46.177899] [INFO ] [MAIN ] WDI: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:46.206913] [DEBUG] [LOCAL ] WDH: Loaded 16292 existing records from primary storage. [2025-09-17T22:59:46.207143] [INFO ] [MAIN ] WDH: Loaded 16292 primary data records. [2025-09-17T22:59:46.328675] [DEBUG] [LOCAL ] WD: Loaded 23480 existing records from primary storage. [2025-09-17T22:59:46.307995] [DEBUG] [LOCAL ] WDI: Loaded 21348 existing records from primary storage. [2025-09-17T22:59:46.332747] [INFO ] [MAIN ] WDI: Loaded 21348 primary data records. [2025-09-17T22:59:46.332920] [INFO ] [MAIN ] WD: Loaded 23480 primary data records. [2025-09-17T22:59:47.208374] [DEBUG] [MAIN ] WDH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:47.209307] [INFO ] [MAIN ] WDH: Generated 1794 derivative records from 16292 primary records. [2025-09-17T22:59:47.209771] [DEBUG] [LOCAL ] WDH: Saving derivative data. [2025-09-17T22:59:47.239997] [DEBUG] [LOCAL ] WDH: Derivative data saved (1794 records). [2025-09-17T22:59:47.256961] [INFO ] [MAIN ] WDH: Successfully saved derivative data. [2025-09-17T22:59:47.257669] [DEBUG] [MAIN ] WD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:47.258064] [DEBUG] [MAIN ] WDI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:47.261597] [INFO ] [MAIN ] WDI: Generated 1794 derivative records from 21348 primary records. [2025-09-17T22:59:47.260156] [INFO ] [MAIN ] Derivative Progress: 1996/2085 symbols completed. WDH took 1.1s. Estimated remaining: 34.6s. Rate: 154.5 symbols/min [2025-09-17T22:59:47.260943] [INFO ] [MAIN ] WD: Generated 1794 derivative records from 23480 primary records. [2025-09-17T22:59:47.261837] [DEBUG] [LOCAL ] WD: Saving derivative data. [2025-09-17T22:59:47.262163] [INFO ] [MAIN ] WDS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:47.261893] [DEBUG] [LOCAL ] WDI: Saving derivative data. [2025-09-17T22:59:47.290940] [DEBUG] [LOCAL ] WD: Derivative data saved (1794 records). [2025-09-17T22:59:47.291468] [INFO ] [MAIN ] WD: Successfully saved derivative data. [2025-09-17T22:59:47.294322] [INFO ] [MAIN ] Derivative Progress: 1997/2085 symbols completed. WD took 1.1s. Estimated remaining: 34.2s. Rate: 154.6 symbols/min [2025-09-17T22:59:47.295414] [INFO ] [MAIN ] WEA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:47.299618] [DEBUG] [LOCAL ] WDI: Derivative data saved (1794 records). [2025-09-17T22:59:47.299887] [INFO ] [MAIN ] WDI: Successfully saved derivative data. [2025-09-17T22:59:47.304042] [INFO ] [MAIN ] Derivative Progress: 1998/2085 symbols completed. WDI took 1.1s. Estimated remaining: 33.7s. Rate: 154.7 symbols/min [2025-09-17T22:59:47.304473] [INFO ] [MAIN ] WEAV: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:47.311668] [DEBUG] [LOCAL ] WEA: Loaded 7497 existing records from primary storage. [2025-09-17T22:59:47.311807] [INFO ] [MAIN ] WEA: Loaded 7497 primary data records. [2025-09-17T22:59:47.531127] [DEBUG] [LOCAL ] WDS: Loaded 43801 existing records from primary storage. [2025-09-17T22:59:47.537145] [INFO ] [MAIN ] WDS: Loaded 43801 primary data records. [2025-09-17T22:59:47.751842] [DEBUG] [LOCAL ] WEAV: Loaded 42014 existing records from primary storage. [2025-09-17T22:59:47.764152] [INFO ] [MAIN ] WEAV: Loaded 42014 primary data records. [2025-09-17T22:59:48.410345] [DEBUG] [MAIN ] WEA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:48.412026] [INFO ] [MAIN ] WEA: Generated 1794 derivative records from 7497 primary records. [2025-09-17T22:59:48.412526] [DEBUG] [LOCAL ] WEA: Saving derivative data. [2025-09-17T22:59:48.430576] [DEBUG] [LOCAL ] WEA: Derivative data saved (1794 records). [2025-09-17T22:59:48.431070] [INFO ] [MAIN ] WEA: Successfully saved derivative data. [2025-09-17T22:59:48.433287] [INFO ] [MAIN ] Derivative Progress: 1999/2085 symbols completed. WEA took 1.1s. Estimated remaining: 33.4s. Rate: 154.5 symbols/min [2025-09-17T22:59:48.435084] [INFO ] [MAIN ] WEC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:48.455637] [DEBUG] [MAIN ] WDS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:48.457521] [INFO ] [MAIN ] WDS: Generated 1794 derivative records from 43801 primary records. [2025-09-17T22:59:48.458341] [DEBUG] [LOCAL ] WDS: Saving derivative data. [2025-09-17T22:59:48.481217] [DEBUG] [MAIN ] WEAV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:48.485434] [INFO ] [MAIN ] WEAV: Generated 1794 derivative records from 42014 primary records. [2025-09-17T22:59:48.485771] [DEBUG] [LOCAL ] WEAV: Saving derivative data. [2025-09-17T22:59:48.490155] [DEBUG] [LOCAL ] WDS: Derivative data saved (1794 records). [2025-09-17T22:59:48.490264] [INFO ] [MAIN ] WDS: Successfully saved derivative data. [2025-09-17T22:59:48.492514] [INFO ] [MAIN ] Derivative Progress: 2000/2085 symbols completed. WDS took 1.2s. Estimated remaining: 33.0s. Rate: 154.6 symbols/min [2025-09-17T22:59:48.500137] [INFO ] [MAIN ] WELL: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:48.509040] [DEBUG] [LOCAL ] WEAV: Derivative data saved (1794 records). [2025-09-17T22:59:48.509286] [INFO ] [MAIN ] WEAV: Successfully saved derivative data. [2025-09-17T22:59:48.513105] [INFO ] [MAIN ] Derivative Progress: 2001/2085 symbols completed. WEAV took 1.2s. Estimated remaining: 32.6s. Rate: 154.7 symbols/min [2025-09-17T22:59:48.513561] [INFO ] [MAIN ] WES: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:48.573842] [DEBUG] [LOCAL ] WEC: Loaded 52233 existing records from primary storage. [2025-09-17T22:59:48.574194] [INFO ] [MAIN ] WEC: Loaded 52233 primary data records. [2025-09-17T22:59:48.723937] [DEBUG] [LOCAL ] WES: Loaded 48094 existing records from primary storage. [2025-09-17T22:59:48.752938] [INFO ] [MAIN ] WES: Loaded 48094 primary data records. [2025-09-17T22:59:49.017443] [DEBUG] [LOCAL ] WELL: Loaded 52360 existing records from primary storage. [2025-09-17T22:59:49.029017] [INFO ] [MAIN ] WELL: Loaded 52360 primary data records. [2025-09-17T22:59:49.612749] [DEBUG] [MAIN ] WEC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:49.613589] [INFO ] [MAIN ] WEC: Generated 1794 derivative records from 52233 primary records. [2025-09-17T22:59:49.613721] [DEBUG] [LOCAL ] WEC: Saving derivative data. [2025-09-17T22:59:49.634926] [DEBUG] [LOCAL ] WEC: Derivative data saved (1794 records). [2025-09-17T22:59:49.635283] [INFO ] [MAIN ] WEC: Successfully saved derivative data. [2025-09-17T22:59:49.637529] [INFO ] [MAIN ] Derivative Progress: 2002/2085 symbols completed. WEC took 1.2s. Estimated remaining: 32.2s. Rate: 154.5 symbols/min [2025-09-17T22:59:49.651412] [INFO ] [MAIN ] WEX: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:49.652436] [DEBUG] [MAIN ] WES: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:49.653857] [INFO ] [MAIN ] WES: Generated 1794 derivative records from 48094 primary records. [2025-09-17T22:59:49.654728] [DEBUG] [LOCAL ] WES: Saving derivative data. [2025-09-17T22:59:49.671064] [DEBUG] [LOCAL ] WES: Derivative data saved (1794 records). [2025-09-17T22:59:49.671274] [INFO ] [MAIN ] WES: Successfully saved derivative data. [2025-09-17T22:59:49.673725] [INFO ] [MAIN ] Derivative Progress: 2003/2085 symbols completed. WES took 1.2s. Estimated remaining: 31.8s. Rate: 154.6 symbols/min [2025-09-17T22:59:49.674327] [INFO ] [MAIN ] WF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:49.695111] [DEBUG] [MAIN ] WELL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:49.695872] [INFO ] [MAIN ] WELL: Generated 1794 derivative records from 52360 primary records. [2025-09-17T22:59:49.696305] [DEBUG] [LOCAL ] WELL: Saving derivative data. [2025-09-17T22:59:49.700792] [DEBUG] [LOCAL ] WF: Loaded 11123 existing records from primary storage. [2025-09-17T22:59:49.700894] [INFO ] [MAIN ] WF: Loaded 11123 primary data records. [2025-09-17T22:59:49.846910] [DEBUG] [LOCAL ] WELL: Derivative data saved (1794 records). [2025-09-17T22:59:49.848041] [INFO ] [MAIN ] WELL: Successfully saved derivative data. [2025-09-17T22:59:49.847841] [DEBUG] [LOCAL ] WEX: Loaded 35736 existing records from primary storage. [2025-09-17T22:59:49.866704] [INFO ] [MAIN ] WEX: Loaded 35736 primary data records. [2025-09-17T22:59:49.851028] [INFO ] [MAIN ] Derivative Progress: 2004/2085 symbols completed. WELL took 1.4s. Estimated remaining: 31.4s. Rate: 154.6 symbols/min [2025-09-17T22:59:49.872204] [INFO ] [MAIN ] WFC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:50.426184] [DEBUG] [LOCAL ] WFC: Loaded 53748 existing records from primary storage. [2025-09-17T22:59:50.426730] [DEBUG] [MAIN ] WF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:50.427464] [INFO ] [MAIN ] WFC: Loaded 53748 primary data records. [2025-09-17T22:59:50.428375] [INFO ] [MAIN ] WF: Generated 1794 derivative records from 11123 primary records. [2025-09-17T22:59:50.428860] [DEBUG] [LOCAL ] WF: Saving derivative data. [2025-09-17T22:59:50.564602] [DEBUG] [LOCAL ] WF: Derivative data saved (1794 records). [2025-09-17T22:59:50.575385] [INFO ] [MAIN ] WF: Successfully saved derivative data. [2025-09-17T22:59:50.575866] [DEBUG] [MAIN ] WEX: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:50.589204] [INFO ] [MAIN ] Derivative Progress: 2005/2085 symbols completed. WF took 0.9s. Estimated remaining: 31.1s. Rate: 154.6 symbols/min [2025-09-17T22:59:50.582000] [INFO ] [MAIN ] WEX: Generated 1794 derivative records from 35736 primary records. [2025-09-17T22:59:50.594829] [INFO ] [MAIN ] WFG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:50.616883] [DEBUG] [LOCAL ] WEX: Saving derivative data. [2025-09-17T22:59:50.845098] [DEBUG] [LOCAL ] WEX: Derivative data saved (1794 records). [2025-09-17T22:59:50.846277] [INFO ] [MAIN ] WEX: Successfully saved derivative data. [2025-09-17T22:59:50.848940] [INFO ] [MAIN ] Derivative Progress: 2006/2085 symbols completed. WEX took 1.2s. Estimated remaining: 30.7s. Rate: 154.6 symbols/min [2025-09-17T22:59:50.856743] [INFO ] [MAIN ] WGO: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:50.871136] [DEBUG] [LOCAL ] WFG: Loaded 25115 existing records from primary storage. [2025-09-17T22:59:50.871601] [INFO ] [MAIN ] WFG: Loaded 25115 primary data records. [2025-09-17T22:59:51.087947] [DEBUG] [MAIN ] WFC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:51.223369] [INFO ] [MAIN ] WFC: Generated 1794 derivative records from 53748 primary records. [2025-09-17T22:59:51.225316] [DEBUG] [LOCAL ] WGO: Loaded 39627 existing records from primary storage. [2025-09-17T22:59:51.224249] [DEBUG] [LOCAL ] WFC: Saving derivative data. [2025-09-17T22:59:51.226454] [INFO ] [MAIN ] WGO: Loaded 39627 primary data records. [2025-09-17T22:59:51.359835] [DEBUG] [LOCAL ] WFC: Derivative data saved (1794 records). [2025-09-17T22:59:51.360077] [INFO ] [MAIN ] WFC: Successfully saved derivative data. [2025-09-17T22:59:51.362018] [INFO ] [MAIN ] Derivative Progress: 2007/2085 symbols completed. WFC took 1.5s. Estimated remaining: 30.3s. Rate: 154.6 symbols/min [2025-09-17T22:59:51.362256] [INFO ] [MAIN ] WH: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:51.595823] [DEBUG] [MAIN ] WFG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:51.596983] [INFO ] [MAIN ] WFG: Generated 1794 derivative records from 25115 primary records. [2025-09-17T22:59:51.597177] [DEBUG] [LOCAL ] WFG: Saving derivative data. [2025-09-17T22:59:51.636855] [DEBUG] [LOCAL ] WFG: Derivative data saved (1794 records). [2025-09-17T22:59:51.637260] [INFO ] [MAIN ] WFG: Successfully saved derivative data. [2025-09-17T22:59:51.638337] [DEBUG] [LOCAL ] WH: Loaded 45998 existing records from primary storage. [2025-09-17T22:59:51.638602] [INFO ] [MAIN ] WH: Loaded 45998 primary data records. [2025-09-17T22:59:51.644424] [INFO ] [MAIN ] Derivative Progress: 2008/2085 symbols completed. WFG took 1.0s. Estimated remaining: 29.9s. Rate: 154.6 symbols/min [2025-09-17T22:59:51.826632] [DEBUG] [MAIN ] WGO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:51.845253] [INFO ] [MAIN ] WGO: Generated 1794 derivative records from 39627 primary records. [2025-09-17T22:59:51.956553] [DEBUG] [LOCAL ] WGO: Saving derivative data. [2025-09-17T22:59:51.983797] [DEBUG] [LOCAL ] WGO: Derivative data saved (1794 records). [2025-09-17T22:59:51.983890] [INFO ] [MAIN ] WGO: Successfully saved derivative data. [2025-09-17T22:59:51.986819] [INFO ] [MAIN ] Derivative Progress: 2009/2085 symbols completed. WGO took 1.1s. Estimated remaining: 29.5s. Rate: 154.6 symbols/min [2025-09-17T22:59:52.006900] [DEBUG] [MAIN ] WH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:52.007568] [INFO ] [MAIN ] WH: Generated 1794 derivative records from 45998 primary records. [2025-09-17T22:59:52.007632] [DEBUG] [LOCAL ] WH: Saving derivative data. [2025-09-17T22:59:52.023472] [DEBUG] [LOCAL ] WH: Derivative data saved (1794 records). [2025-09-17T22:59:52.023534] [INFO ] [MAIN ] WH: Successfully saved derivative data. [2025-09-17T22:59:52.025766] [INFO ] [MAIN ] Derivative Progress: 2010/2085 symbols completed. WH took 0.7s. Estimated remaining: 29.1s. Rate: 154.7 symbols/min [2025-09-17T22:59:52.026529] [INFO ] [MAIN ] WHD: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:52.026777] [INFO ] [MAIN ] WHG: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:52.026956] [INFO ] [MAIN ] WHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:52.037810] [DEBUG] [LOCAL ] WHG: Loaded 3421 existing records from primary storage. [2025-09-17T22:59:52.037922] [INFO ] [MAIN ] WHG: Loaded 3421 primary data records. [2025-09-17T22:59:52.371259] [DEBUG] [LOCAL ] WHD: Loaded 40825 existing records from primary storage. [2025-09-17T22:59:52.371585] [INFO ] [MAIN ] WHD: Loaded 40825 primary data records. [2025-09-17T22:59:52.494535] [DEBUG] [LOCAL ] WHR: Loaded 48142 existing records from primary storage. [2025-09-17T22:59:52.495185] [INFO ] [MAIN ] WHR: Loaded 48142 primary data records. [2025-09-17T22:59:53.063316] [DEBUG] [MAIN ] WHG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:53.064363] [INFO ] [MAIN ] WHG: Generated 1794 derivative records from 3421 primary records. [2025-09-17T22:59:53.065590] [DEBUG] [LOCAL ] WHG: Saving derivative data. [2025-09-17T22:59:53.084713] [DEBUG] [LOCAL ] WHG: Derivative data saved (1794 records). [2025-09-17T22:59:53.085044] [INFO ] [MAIN ] WHG: Successfully saved derivative data. [2025-09-17T22:59:53.087559] [INFO ] [MAIN ] Derivative Progress: 2011/2085 symbols completed. WHG took 1.1s. Estimated remaining: 28.7s. Rate: 154.5 symbols/min [2025-09-17T22:59:53.088239] [INFO ] [MAIN ] WIA: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:53.112925] [DEBUG] [LOCAL ] WIA: Loaded 4887 existing records from primary storage. [2025-09-17T22:59:53.113992] [INFO ] [MAIN ] WIA: Loaded 4887 primary data records. [2025-09-17T22:59:53.113906] [DEBUG] [MAIN ] WHD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:53.127068] [INFO ] [MAIN ] WHD: Generated 1794 derivative records from 40825 primary records. [2025-09-17T22:59:53.154312] [DEBUG] [LOCAL ] WHD: Saving derivative data. [2025-09-17T22:59:53.246278] [DEBUG] [LOCAL ] WHD: Derivative data saved (1794 records). [2025-09-17T22:59:53.246855] [INFO ] [MAIN ] WHD: Successfully saved derivative data. [2025-09-17T22:59:53.249059] [INFO ] [MAIN ] Derivative Progress: 2012/2085 symbols completed. WHD took 1.2s. Estimated remaining: 28.3s. Rate: 154.6 symbols/min [2025-09-17T22:59:53.249287] [INFO ] [MAIN ] WINN: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:53.312041] [DEBUG] [MAIN ] WHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:53.342830] [INFO ] [MAIN ] WHR: Generated 1794 derivative records from 48142 primary records. [2025-09-17T22:59:53.446686] [DEBUG] [LOCAL ] WHR: Saving derivative data. [2025-09-17T22:59:53.483844] [DEBUG] [LOCAL ] WINN: Loaded 11950 existing records from primary storage. [2025-09-17T22:59:53.486869] [INFO ] [MAIN ] WINN: Loaded 11950 primary data records. [2025-09-17T22:59:53.564714] [DEBUG] [LOCAL ] WHR: Derivative data saved (1794 records). [2025-09-17T22:59:53.570072] [INFO ] [MAIN ] WHR: Successfully saved derivative data. [2025-09-17T22:59:53.584710] [INFO ] [MAIN ] Derivative Progress: 2013/2085 symbols completed. WHR took 1.6s. Estimated remaining: 27.9s. Rate: 154.6 symbols/min [2025-09-17T22:59:53.590616] [INFO ] [MAIN ] WIT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:53.869213] [DEBUG] [MAIN ] WIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:53.870164] [INFO ] [MAIN ] WIA: Generated 1794 derivative records from 4887 primary records. [2025-09-17T22:59:53.870317] [DEBUG] [LOCAL ] WIA: Saving derivative data. [2025-09-17T22:59:53.902561] [DEBUG] [LOCAL ] WIA: Derivative data saved (1794 records). [2025-09-17T22:59:53.902875] [INFO ] [MAIN ] WIA: Successfully saved derivative data. [2025-09-17T22:59:53.903982] [DEBUG] [LOCAL ] WIT: Loaded 52266 existing records from primary storage. [2025-09-17T22:59:53.906330] [INFO ] [MAIN ] Derivative Progress: 2014/2085 symbols completed. WIA took 0.8s. Estimated remaining: 27.6s. Rate: 154.6 symbols/min [2025-09-17T22:59:53.906804] [INFO ] [MAIN ] WIT: Loaded 52266 primary data records. [2025-09-17T22:59:53.907091] [INFO ] [MAIN ] WIW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:54.062304] [DEBUG] [MAIN ] WINN: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:59:54.084684] [INFO ] [MAIN ] WINN: Generated 1793 derivative records from 11950 primary records. [2025-09-17T22:59:54.092750] [DEBUG] [LOCAL ] WINN: Saving derivative data. [2025-09-17T22:59:54.251151] [DEBUG] [LOCAL ] WIW: Loaded 20861 existing records from primary storage. [2025-09-17T22:59:54.254898] [INFO ] [MAIN ] WIW: Loaded 20861 primary data records. [2025-09-17T22:59:54.364165] [DEBUG] [LOCAL ] WINN: Derivative data saved (1793 records). [2025-09-17T22:59:54.377909] [INFO ] [MAIN ] WINN: Successfully saved derivative data. [2025-09-17T22:59:54.386278] [INFO ] [MAIN ] Derivative Progress: 2015/2085 symbols completed. WINN took 1.1s. Estimated remaining: 27.2s. Rate: 154.6 symbols/min [2025-09-17T22:59:54.387069] [INFO ] [MAIN ] WK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:54.674469] [DEBUG] [MAIN ] WIT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:54.675526] [INFO ] [MAIN ] WIT: Generated 1794 derivative records from 52266 primary records. [2025-09-17T22:59:54.675730] [DEBUG] [LOCAL ] WIT: Saving derivative data. [2025-09-17T22:59:54.702925] [DEBUG] [LOCAL ] WK: Loaded 36494 existing records from primary storage. [2025-09-17T22:59:54.703122] [INFO ] [MAIN ] WK: Loaded 36494 primary data records. [2025-09-17T22:59:54.745087] [DEBUG] [LOCAL ] WIT: Derivative data saved (1794 records). [2025-09-17T22:59:54.755661] [INFO ] [MAIN ] WIT: Successfully saved derivative data. [2025-09-17T22:59:54.765316] [INFO ] [MAIN ] Derivative Progress: 2016/2085 symbols completed. WIT took 1.2s. Estimated remaining: 26.8s. Rate: 154.6 symbols/min [2025-09-17T22:59:54.816989] [INFO ] [MAIN ] WKC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:54.816904] [DEBUG] [MAIN ] WIW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:54.829473] [INFO ] [MAIN ] WIW: Generated 1794 derivative records from 20861 primary records. [2025-09-17T22:59:54.837293] [DEBUG] [LOCAL ] WIW: Saving derivative data. [2025-09-17T22:59:55.069620] [DEBUG] [LOCAL ] WIW: Derivative data saved (1794 records). [2025-09-17T22:59:55.069822] [INFO ] [MAIN ] WIW: Successfully saved derivative data. [2025-09-17T22:59:55.074874] [INFO ] [MAIN ] Derivative Progress: 2017/2085 symbols completed. WIW took 1.2s. Estimated remaining: 26.4s. Rate: 154.6 symbols/min [2025-09-17T22:59:55.075410] [INFO ] [MAIN ] WLK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:55.109699] [DEBUG] [LOCAL ] WKC: Loaded 35307 existing records from primary storage. [2025-09-17T22:59:55.110180] [INFO ] [MAIN ] WKC: Loaded 35307 primary data records. [2025-09-17T22:59:55.435579] [DEBUG] [LOCAL ] WLK: Loaded 45252 existing records from primary storage. [2025-09-17T22:59:55.438538] [INFO ] [MAIN ] WLK: Loaded 45252 primary data records. [2025-09-17T22:59:55.533929] [DEBUG] [MAIN ] WK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:55.559607] [INFO ] [MAIN ] WK: Generated 1794 derivative records from 36494 primary records. [2025-09-17T22:59:55.568991] [DEBUG] [LOCAL ] WK: Saving derivative data. [2025-09-17T22:59:55.785122] [DEBUG] [LOCAL ] WK: Derivative data saved (1794 records). [2025-09-17T22:59:55.785577] [INFO ] [MAIN ] WK: Successfully saved derivative data. [2025-09-17T22:59:55.788403] [INFO ] [MAIN ] Derivative Progress: 2018/2085 symbols completed. WK took 1.4s. Estimated remaining: 26.0s. Rate: 154.5 symbols/min [2025-09-17T22:59:55.788728] [INFO ] [MAIN ] WLKP: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:55.810917] [DEBUG] [MAIN ] WKC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:55.813825] [INFO ] [MAIN ] WKC: Generated 1794 derivative records from 35307 primary records. [2025-09-17T22:59:55.814120] [DEBUG] [LOCAL ] WKC: Saving derivative data. [2025-09-17T22:59:55.829169] [DEBUG] [LOCAL ] WLKP: Loaded 6523 existing records from primary storage. [2025-09-17T22:59:55.829776] [INFO ] [MAIN ] WLKP: Loaded 6523 primary data records. [2025-09-17T22:59:55.940093] [DEBUG] [LOCAL ] WKC: Derivative data saved (1794 records). [2025-09-17T22:59:55.940282] [INFO ] [MAIN ] WKC: Successfully saved derivative data. [2025-09-17T22:59:55.943434] [INFO ] [MAIN ] Derivative Progress: 2019/2085 symbols completed. WKC took 1.1s. Estimated remaining: 25.6s. Rate: 154.6 symbols/min [2025-09-17T22:59:55.966464] [INFO ] [MAIN ] WLY: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:55.971985] [DEBUG] [MAIN ] WLK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:56.011794] [INFO ] [MAIN ] WLK: Generated 1794 derivative records from 45252 primary records. [2025-09-17T22:59:56.147081] [DEBUG] [LOCAL ] WLK: Saving derivative data. [2025-09-17T22:59:56.182082] [DEBUG] [LOCAL ] WLK: Derivative data saved (1794 records). [2025-09-17T22:59:56.183616] [INFO ] [MAIN ] WLK: Successfully saved derivative data. [2025-09-17T22:59:56.186060] [INFO ] [MAIN ] Derivative Progress: 2020/2085 symbols completed. WLK took 1.1s. Estimated remaining: 25.2s. Rate: 154.6 symbols/min [2025-09-17T22:59:56.186444] [INFO ] [MAIN ] WM: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:56.202015] [DEBUG] [LOCAL ] WLY: Loaded 30559 existing records from primary storage. [2025-09-17T22:59:56.202320] [INFO ] [MAIN ] WLY: Loaded 30559 primary data records. [2025-09-17T22:59:56.327087] [DEBUG] [MAIN ] WLKP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:56.327868] [INFO ] [MAIN ] WLKP: Generated 1794 derivative records from 6523 primary records. [2025-09-17T22:59:56.328262] [DEBUG] [LOCAL ] WLKP: Saving derivative data. [2025-09-17T22:59:56.548444] [DEBUG] [LOCAL ] WLKP: Derivative data saved (1794 records). [2025-09-17T22:59:56.548630] [INFO ] [MAIN ] WLKP: Successfully saved derivative data. [2025-09-17T22:59:56.551142] [INFO ] [MAIN ] Derivative Progress: 2021/2085 symbols completed. WLKP took 0.8s. Estimated remaining: 24.8s. Rate: 154.6 symbols/min [2025-09-17T22:59:56.552346] [INFO ] [MAIN ] WMB: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:56.570684] [DEBUG] [LOCAL ] WM: Loaded 51033 existing records from primary storage. [2025-09-17T22:59:56.571279] [INFO ] [MAIN ] WM: Loaded 51033 primary data records. [2025-09-17T22:59:56.983009] [DEBUG] [MAIN ] WLY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:56.984408] [INFO ] [MAIN ] WLY: Generated 1794 derivative records from 30559 primary records. [2025-09-17T22:59:56.984572] [DEBUG] [LOCAL ] WLY: Saving derivative data. [2025-09-17T22:59:56.987351] [DEBUG] [LOCAL ] WMB: Loaded 53671 existing records from primary storage. [2025-09-17T22:59:56.987886] [INFO ] [MAIN ] WMB: Loaded 53671 primary data records. [2025-09-17T22:59:57.152238] [DEBUG] [LOCAL ] WLY: Derivative data saved (1794 records). [2025-09-17T22:59:57.185062] [INFO ] [MAIN ] WLY: Successfully saved derivative data. [2025-09-17T22:59:57.193298] [INFO ] [MAIN ] Derivative Progress: 2022/2085 symbols completed. WLY took 1.2s. Estimated remaining: 24.5s. Rate: 154.6 symbols/min [2025-09-17T22:59:57.307328] [INFO ] [MAIN ] WMK: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:57.329465] [DEBUG] [MAIN ] WM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:57.330869] [INFO ] [MAIN ] WM: Generated 1794 derivative records from 51033 primary records. [2025-09-17T22:59:57.330978] [DEBUG] [LOCAL ] WM: Saving derivative data. [2025-09-17T22:59:57.357938] [DEBUG] [LOCAL ] WMK: Loaded 14480 existing records from primary storage. [2025-09-17T22:59:57.358581] [INFO ] [MAIN ] WMK: Loaded 14480 primary data records. [2025-09-17T22:59:57.380717] [DEBUG] [LOCAL ] WM: Derivative data saved (1794 records). [2025-09-17T22:59:57.396980] [INFO ] [MAIN ] WM: Successfully saved derivative data. [2025-09-17T22:59:57.407292] [INFO ] [MAIN ] Derivative Progress: 2023/2085 symbols completed. WM took 1.2s. Estimated remaining: 24.1s. Rate: 154.6 symbols/min [2025-09-17T22:59:57.672747] [DEBUG] [MAIN ] WMB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:57.681451] [INFO ] [MAIN ] WMB: Generated 1794 derivative records from 53671 primary records. [2025-09-17T22:59:57.681680] [DEBUG] [LOCAL ] WMB: Saving derivative data. [2025-09-17T22:59:57.700755] [DEBUG] [LOCAL ] WMB: Derivative data saved (1794 records). [2025-09-17T22:59:57.701413] [INFO ] [MAIN ] WMB: Successfully saved derivative data. [2025-09-17T22:59:57.704185] [INFO ] [MAIN ] Derivative Progress: 2024/2085 symbols completed. WMB took 1.2s. Estimated remaining: 23.7s. Rate: 154.6 symbols/min [2025-09-17T22:59:57.722242] [DEBUG] [MAIN ] WMK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:57.722827] [INFO ] [MAIN ] WMK: Generated 1794 derivative records from 14480 primary records. [2025-09-17T22:59:57.722890] [DEBUG] [LOCAL ] WMK: Saving derivative data. [2025-09-17T22:59:57.737562] [DEBUG] [LOCAL ] WMK: Derivative data saved (1794 records). [2025-09-17T22:59:57.737619] [INFO ] [MAIN ] WMK: Successfully saved derivative data. [2025-09-17T22:59:57.739754] [INFO ] [MAIN ] Derivative Progress: 2025/2085 symbols completed. WMK took 0.4s. Estimated remaining: 23.3s. Rate: 154.7 symbols/min [2025-09-17T22:59:57.740321] [INFO ] [MAIN ] WNC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:57.740471] [INFO ] [MAIN ] WMS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:57.740797] [INFO ] [MAIN ] WMT: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:57.789696] [DEBUG] [LOCAL ] WNC: Loaded 40654 existing records from primary storage. [2025-09-17T22:59:57.789919] [INFO ] [MAIN ] WNC: Loaded 40654 primary data records. [2025-09-17T22:59:57.922922] [DEBUG] [LOCAL ] WMS: Loaded 39601 existing records from primary storage. [2025-09-17T22:59:57.923612] [INFO ] [MAIN ] WMS: Loaded 39601 primary data records. [2025-09-17T22:59:58.104316] [DEBUG] [LOCAL ] WMT: Loaded 53800 existing records from primary storage. [2025-09-17T22:59:58.224985] [INFO ] [MAIN ] WMT: Loaded 53800 primary data records. [2025-09-17T22:59:58.803995] [DEBUG] [MAIN ] WNC: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T22:59:58.804965] [INFO ] [MAIN ] WNC: Generated 1793 derivative records from 40654 primary records. [2025-09-17T22:59:58.805070] [DEBUG] [LOCAL ] WNC: Saving derivative data. [2025-09-17T22:59:58.833751] [DEBUG] [MAIN ] WMS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:58.835854] [INFO ] [MAIN ] WMS: Generated 1794 derivative records from 39601 primary records. [2025-09-17T22:59:58.837373] [DEBUG] [LOCAL ] WMS: Saving derivative data. [2025-09-17T22:59:58.851744] [DEBUG] [LOCAL ] WNC: Derivative data saved (1793 records). [2025-09-17T22:59:58.852130] [INFO ] [MAIN ] WNC: Successfully saved derivative data. [2025-09-17T22:59:58.854520] [INFO ] [MAIN ] Derivative Progress: 2026/2085 symbols completed. WNC took 1.1s. Estimated remaining: 22.9s. Rate: 154.5 symbols/min [2025-09-17T22:59:58.855044] [INFO ] [MAIN ] WNS: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:58.862517] [DEBUG] [LOCAL ] WMS: Derivative data saved (1794 records). [2025-09-17T22:59:58.862668] [INFO ] [MAIN ] WMS: Successfully saved derivative data. [2025-09-17T22:59:58.865059] [INFO ] [MAIN ] Derivative Progress: 2027/2085 symbols completed. WMS took 1.1s. Estimated remaining: 22.5s. Rate: 154.6 symbols/min [2025-09-17T22:59:58.872970] [INFO ] [MAIN ] WOLF: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:58.878360] [DEBUG] [MAIN ] WMT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:58.879078] [INFO ] [MAIN ] WMT: Generated 1794 derivative records from 53800 primary records. [2025-09-17T22:59:58.879174] [DEBUG] [LOCAL ] WMT: Saving derivative data. [2025-09-17T22:59:58.895306] [DEBUG] [LOCAL ] WMT: Derivative data saved (1794 records). [2025-09-17T22:59:58.895501] [INFO ] [MAIN ] WMT: Successfully saved derivative data. [2025-09-17T22:59:58.898329] [INFO ] [MAIN ] Derivative Progress: 2028/2085 symbols completed. WMT took 1.2s. Estimated remaining: 22.1s. Rate: 154.7 symbols/min [2025-09-17T22:59:58.898673] [INFO ] [MAIN ] WOR: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:58.931793] [DEBUG] [LOCAL ] WNS: Loaded 39829 existing records from primary storage. [2025-09-17T22:59:58.931929] [INFO ] [MAIN ] WNS: Loaded 39829 primary data records. [2025-09-17T22:59:59.065104] [DEBUG] [LOCAL ] WOR: Loaded 24771 existing records from primary storage. [2025-09-17T22:59:59.076326] [INFO ] [MAIN ] WOR: Loaded 24771 primary data records. [2025-09-17T22:59:59.379776] [DEBUG] [LOCAL ] WOLF: Loaded 53532 existing records from primary storage. [2025-09-17T22:59:59.384367] [INFO ] [MAIN ] WOLF: Loaded 53532 primary data records. [2025-09-17T22:59:59.917902] [DEBUG] [MAIN ] WNS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:59.920034] [INFO ] [MAIN ] WNS: Generated 1794 derivative records from 39829 primary records. [2025-09-17T22:59:59.920302] [DEBUG] [LOCAL ] WNS: Saving derivative data. [2025-09-17T22:59:59.953948] [DEBUG] [LOCAL ] WNS: Derivative data saved (1794 records). [2025-09-17T22:59:59.954453] [INFO ] [MAIN ] WNS: Successfully saved derivative data. [2025-09-17T22:59:59.956941] [INFO ] [MAIN ] Derivative Progress: 2029/2085 symbols completed. WNS took 1.1s. Estimated remaining: 21.7s. Rate: 154.5 symbols/min [2025-09-17T22:59:59.954352] [DEBUG] [MAIN ] WOR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:59.957200] [INFO ] [MAIN ] WOW: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:59.958529] [INFO ] [MAIN ] WOR: Generated 1794 derivative records from 24771 primary records. [2025-09-17T22:59:59.959282] [DEBUG] [LOCAL ] WOR: Saving derivative data. [2025-09-17T22:59:59.976520] [DEBUG] [LOCAL ] WOR: Derivative data saved (1794 records). [2025-09-17T22:59:59.976829] [INFO ] [MAIN ] WOR: Successfully saved derivative data. [2025-09-17T22:59:59.979029] [INFO ] [MAIN ] Derivative Progress: 2030/2085 symbols completed. WOR took 1.1s. Estimated remaining: 21.3s. Rate: 154.6 symbols/min [2025-09-17T22:59:59.981247] [INFO ] [MAIN ] WPC: Starting derivative data generation with 30-minute intervals. [2025-09-17T22:59:59.995980] [DEBUG] [MAIN ] WOLF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T22:59:59.996834] [INFO ] [MAIN ] WOLF: Generated 1794 derivative records from 53532 primary records. [2025-09-17T22:59:59.996992] [DEBUG] [LOCAL ] WOLF: Saving derivative data. [2025-09-17T23:00:00.021214] [DEBUG] [LOCAL ] WOLF: Derivative data saved (1794 records). [2025-09-17T23:00:00.021355] [INFO ] [MAIN ] WOLF: Successfully saved derivative data. [2025-09-17T23:00:00.024095] [INFO ] [MAIN ] Derivative Progress: 2031/2085 symbols completed. WOLF took 1.2s. Estimated remaining: 20.9s. Rate: 154.7 symbols/min [2025-09-17T23:00:00.024589] [INFO ] [MAIN ] WPM: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:00.039002] [DEBUG] [LOCAL ] WOW: Loaded 29671 existing records from primary storage. [2025-09-17T23:00:00.039177] [INFO ] [MAIN ] WOW: Loaded 29671 primary data records. [2025-09-17T23:00:00.378297] [DEBUG] [LOCAL ] WPC: Loaded 48777 existing records from primary storage. [2025-09-17T23:00:00.392066] [INFO ] [MAIN ] WPC: Loaded 48777 primary data records. [2025-09-17T23:00:00.540591] [DEBUG] [LOCAL ] WPM: Loaded 52721 existing records from primary storage. [2025-09-17T23:00:00.552948] [INFO ] [MAIN ] WPM: Loaded 52721 primary data records. [2025-09-17T23:00:01.139300] [DEBUG] [MAIN ] WOW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:01.141126] [INFO ] [MAIN ] WOW: Generated 1794 derivative records from 29671 primary records. [2025-09-17T23:00:01.141294] [DEBUG] [LOCAL ] WOW: Saving derivative data. [2025-09-17T23:00:01.159189] [DEBUG] [LOCAL ] WOW: Derivative data saved (1794 records). [2025-09-17T23:00:01.159699] [INFO ] [MAIN ] WOW: Successfully saved derivative data. [2025-09-17T23:00:01.162153] [INFO ] [MAIN ] Derivative Progress: 2032/2085 symbols completed. WOW took 1.2s. Estimated remaining: 20.6s. Rate: 154.5 symbols/min [2025-09-17T23:00:01.162686] [INFO ] [MAIN ] WPP: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:01.181337] [DEBUG] [MAIN ] WPC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:01.182155] [INFO ] [MAIN ] WPC: Generated 1794 derivative records from 48777 primary records. [2025-09-17T23:00:01.182499] [DEBUG] [LOCAL ] WPC: Saving derivative data. [2025-09-17T23:00:01.208422] [DEBUG] [LOCAL ] WPC: Derivative data saved (1794 records). [2025-09-17T23:00:01.208590] [INFO ] [MAIN ] WPC: Successfully saved derivative data. [2025-09-17T23:00:01.210573] [INFO ] [MAIN ] Derivative Progress: 2033/2085 symbols completed. WPC took 1.2s. Estimated remaining: 20.2s. Rate: 154.6 symbols/min [2025-09-17T23:00:01.211193] [INFO ] [MAIN ] WRB: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:01.226610] [DEBUG] [LOCAL ] WPP: Loaded 33606 existing records from primary storage. [2025-09-17T23:00:01.234421] [INFO ] [MAIN ] WPP: Loaded 33606 primary data records. [2025-09-17T23:00:01.251297] [DEBUG] [MAIN ] WPM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:01.273290] [INFO ] [MAIN ] WPM: Generated 1794 derivative records from 52721 primary records. [2025-09-17T23:00:01.286764] [DEBUG] [LOCAL ] WPM: Saving derivative data. [2025-09-17T23:00:01.494407] [DEBUG] [LOCAL ] WPM: Derivative data saved (1794 records). [2025-09-17T23:00:01.517419] [INFO ] [MAIN ] WPM: Successfully saved derivative data. [2025-09-17T23:00:01.566857] [DEBUG] [LOCAL ] WRB: Loaded 50611 existing records from primary storage. [2025-09-17T23:00:01.570923] [INFO ] [MAIN ] WRB: Loaded 50611 primary data records. [2025-09-17T23:00:01.570752] [INFO ] [MAIN ] Derivative Progress: 2034/2085 symbols completed. WPM took 1.5s. Estimated remaining: 19.8s. Rate: 154.6 symbols/min [2025-09-17T23:00:01.742207] [INFO ] [MAIN ] WRBY: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:02.097127] [DEBUG] [MAIN ] WPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:02.098980] [INFO ] [MAIN ] WPP: Generated 1794 derivative records from 33606 primary records. [2025-09-17T23:00:02.099159] [DEBUG] [LOCAL ] WPP: Saving derivative data. [2025-09-17T23:00:02.134471] [DEBUG] [LOCAL ] WRBY: Loaded 50921 existing records from primary storage. [2025-09-17T23:00:02.134718] [DEBUG] [LOCAL ] WPP: Derivative data saved (1794 records). [2025-09-17T23:00:02.134924] [INFO ] [MAIN ] WPP: Successfully saved derivative data. [2025-09-17T23:00:02.135345] [INFO ] [MAIN ] WRBY: Loaded 50921 primary data records. [2025-09-17T23:00:02.138008] [INFO ] [MAIN ] Derivative Progress: 2035/2085 symbols completed. WPP took 1.0s. Estimated remaining: 19.4s. Rate: 154.6 symbols/min [2025-09-17T23:00:02.138559] [INFO ] [MAIN ] WS: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:02.269723] [DEBUG] [MAIN ] WRB: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:02.274929] [INFO ] [MAIN ] WRB: Generated 1794 derivative records from 50611 primary records. [2025-09-17T23:00:02.297526] [DEBUG] [LOCAL ] WRB: Saving derivative data. [2025-09-17T23:00:02.471575] [DEBUG] [LOCAL ] WS: Loaded 23952 existing records from primary storage. [2025-09-17T23:00:02.508251] [INFO ] [MAIN ] WS: Loaded 23952 primary data records. [2025-09-17T23:00:02.579697] [DEBUG] [LOCAL ] WRB: Derivative data saved (1794 records). [2025-09-17T23:00:02.614609] [INFO ] [MAIN ] WRB: Successfully saved derivative data. [2025-09-17T23:00:02.632736] [INFO ] [MAIN ] Derivative Progress: 2036/2085 symbols completed. WRB took 1.4s. Estimated remaining: 19.0s. Rate: 154.6 symbols/min [2025-09-17T23:00:02.638883] [INFO ] [MAIN ] WSM: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:02.937066] [DEBUG] [MAIN ] WRBY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:02.938858] [INFO ] [MAIN ] WRBY: Generated 1794 derivative records from 50921 primary records. [2025-09-17T23:00:02.939411] [DEBUG] [LOCAL ] WRBY: Saving derivative data. [2025-09-17T23:00:02.972862] [DEBUG] [LOCAL ] WRBY: Derivative data saved (1794 records). [2025-09-17T23:00:02.973068] [INFO ] [MAIN ] WRBY: Successfully saved derivative data. [2025-09-17T23:00:02.975281] [INFO ] [MAIN ] Derivative Progress: 2037/2085 symbols completed. WRBY took 1.2s. Estimated remaining: 18.6s. Rate: 154.6 symbols/min [2025-09-17T23:00:02.976953] [INFO ] [MAIN ] WSO: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:02.997339] [DEBUG] [LOCAL ] WSM: Loaded 50153 existing records from primary storage. [2025-09-17T23:00:02.997861] [INFO ] [MAIN ] WSM: Loaded 50153 primary data records. [2025-09-17T23:00:03.156888] [DEBUG] [MAIN ] WS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:03.173229] [DEBUG] [LOCAL ] WSO: Loaded 24680 existing records from primary storage. [2025-09-17T23:00:03.179384] [INFO ] [MAIN ] WS: Generated 1794 derivative records from 23952 primary records. [2025-09-17T23:00:03.189795] [INFO ] [MAIN ] WSO: Loaded 24680 primary data records. [2025-09-17T23:00:03.189862] [DEBUG] [LOCAL ] WS: Saving derivative data. [2025-09-17T23:00:03.536557] [DEBUG] [LOCAL ] WS: Derivative data saved (1794 records). [2025-09-17T23:00:03.543858] [INFO ] [MAIN ] WS: Successfully saved derivative data. [2025-09-17T23:00:03.558389] [INFO ] [MAIN ] Derivative Progress: 2038/2085 symbols completed. WS took 1.4s. Estimated remaining: 18.2s. Rate: 154.5 symbols/min [2025-09-17T23:00:03.785489] [DEBUG] [MAIN ] WSM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:03.786348] [INFO ] [MAIN ] WSM: Generated 1794 derivative records from 50153 primary records. [2025-09-17T23:00:03.786427] [DEBUG] [LOCAL ] WSM: Saving derivative data. [2025-09-17T23:00:03.803767] [DEBUG] [LOCAL ] WSM: Derivative data saved (1794 records). [2025-09-17T23:00:03.803995] [INFO ] [MAIN ] WSM: Successfully saved derivative data. [2025-09-17T23:00:03.806185] [INFO ] [MAIN ] Derivative Progress: 2039/2085 symbols completed. WSM took 1.2s. Estimated remaining: 17.9s. Rate: 154.6 symbols/min [2025-09-17T23:00:03.824241] [DEBUG] [MAIN ] WSO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:03.824980] [INFO ] [MAIN ] WSO: Generated 1794 derivative records from 24680 primary records. [2025-09-17T23:00:03.825044] [DEBUG] [LOCAL ] WSO: Saving derivative data. [2025-09-17T23:00:03.840480] [DEBUG] [LOCAL ] WSO: Derivative data saved (1794 records). [2025-09-17T23:00:03.840546] [INFO ] [MAIN ] WSO: Successfully saved derivative data. [2025-09-17T23:00:03.842768] [INFO ] [MAIN ] Derivative Progress: 2040/2085 symbols completed. WSO took 0.9s. Estimated remaining: 17.5s. Rate: 154.6 symbols/min [2025-09-17T23:00:03.843417] [INFO ] [MAIN ] WST: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:03.843629] [INFO ] [MAIN ] WT: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:03.843487] [INFO ] [MAIN ] WSR: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:03.895778] [DEBUG] [LOCAL ] WSR: Loaded 23511 existing records from primary storage. [2025-09-17T23:00:03.896568] [INFO ] [MAIN ] WSR: Loaded 23511 primary data records. [2025-09-17T23:00:04.005322] [DEBUG] [LOCAL ] WT: Loaded 47526 existing records from primary storage. [2025-09-17T23:00:04.029323] [DEBUG] [LOCAL ] WST: Loaded 38034 existing records from primary storage. [2025-09-17T23:00:04.028835] [INFO ] [MAIN ] WT: Loaded 47526 primary data records. [2025-09-17T23:00:04.029554] [INFO ] [MAIN ] WST: Loaded 38034 primary data records. [2025-09-17T23:00:04.899737] [DEBUG] [MAIN ] WSR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:04.902159] [INFO ] [MAIN ] WSR: Generated 1794 derivative records from 23511 primary records. [2025-09-17T23:00:04.904847] [DEBUG] [LOCAL ] WSR: Saving derivative data. [2025-09-17T23:00:04.948497] [DEBUG] [MAIN ] WST: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:04.948208] [DEBUG] [LOCAL ] WSR: Derivative data saved (1794 records). [2025-09-17T23:00:04.949324] [INFO ] [MAIN ] WST: Generated 1794 derivative records from 38034 primary records. [2025-09-17T23:00:04.947322] [DEBUG] [MAIN ] WT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:04.950097] [INFO ] [MAIN ] WT: Generated 1794 derivative records from 47526 primary records. [2025-09-17T23:00:04.950186] [INFO ] [MAIN ] WSR: Successfully saved derivative data. [2025-09-17T23:00:04.952275] [INFO ] [MAIN ] Derivative Progress: 2041/2085 symbols completed. WSR took 1.1s. Estimated remaining: 17.1s. Rate: 154.5 symbols/min [2025-09-17T23:00:04.949481] [DEBUG] [LOCAL ] WST: Saving derivative data. [2025-09-17T23:00:04.950274] [DEBUG] [LOCAL ] WT: Saving derivative data. [2025-09-17T23:00:04.953119] [INFO ] [MAIN ] WTI: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:04.985773] [DEBUG] [LOCAL ] WST: Derivative data saved (1794 records). [2025-09-17T23:00:04.986953] [INFO ] [MAIN ] WST: Successfully saved derivative data. [2025-09-17T23:00:04.990493] [DEBUG] [LOCAL ] WT: Derivative data saved (1794 records). [2025-09-17T23:00:04.989810] [INFO ] [MAIN ] Derivative Progress: 2042/2085 symbols completed. WST took 1.1s. Estimated remaining: 16.7s. Rate: 154.5 symbols/min [2025-09-17T23:00:04.990880] [INFO ] [MAIN ] WTRG: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:04.991056] [INFO ] [MAIN ] WT: Successfully saved derivative data. [2025-09-17T23:00:04.993751] [INFO ] [MAIN ] Derivative Progress: 2043/2085 symbols completed. WT took 1.2s. Estimated remaining: 16.3s. Rate: 154.6 symbols/min [2025-09-17T23:00:04.994144] [INFO ] [MAIN ] WTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:05.025108] [DEBUG] [LOCAL ] WTS: Loaded 18753 existing records from primary storage. [2025-09-17T23:00:05.025362] [INFO ] [MAIN ] WTS: Loaded 18753 primary data records. [2025-09-17T23:00:05.159485] [DEBUG] [LOCAL ] WTI: Loaded 43725 existing records from primary storage. [2025-09-17T23:00:05.159756] [INFO ] [MAIN ] WTI: Loaded 43725 primary data records. [2025-09-17T23:00:05.319427] [DEBUG] [LOCAL ] WTRG: Loaded 50962 existing records from primary storage. [2025-09-17T23:00:05.506586] [INFO ] [MAIN ] WTRG: Loaded 50962 primary data records. [2025-09-17T23:00:06.084767] [DEBUG] [MAIN ] WTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:06.086532] [INFO ] [MAIN ] WTS: Generated 1794 derivative records from 18753 primary records. [2025-09-17T23:00:06.086751] [DEBUG] [LOCAL ] WTS: Saving derivative data. [2025-09-17T23:00:06.108456] [DEBUG] [LOCAL ] WTS: Derivative data saved (1794 records). [2025-09-17T23:00:06.108688] [INFO ] [MAIN ] WTS: Successfully saved derivative data. [2025-09-17T23:00:06.110930] [INFO ] [MAIN ] Derivative Progress: 2044/2085 symbols completed. WTS took 1.1s. Estimated remaining: 15.9s. Rate: 154.5 symbols/min [2025-09-17T23:00:06.111331] [INFO ] [MAIN ] WTTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:06.132494] [DEBUG] [MAIN ] WTI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:06.133843] [INFO ] [MAIN ] WTI: Generated 1794 derivative records from 43725 primary records. [2025-09-17T23:00:06.134906] [DEBUG] [LOCAL ] WTI: Saving derivative data. [2025-09-17T23:00:06.162338] [DEBUG] [MAIN ] WTRG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:06.164950] [INFO ] [MAIN ] WTRG: Generated 1794 derivative records from 50962 primary records. [2025-09-17T23:00:06.165604] [DEBUG] [LOCAL ] WTRG: Saving derivative data. [2025-09-17T23:00:06.184599] [DEBUG] [LOCAL ] WTI: Derivative data saved (1794 records). [2025-09-17T23:00:06.184512] [DEBUG] [LOCAL ] WTRG: Derivative data saved (1794 records). [2025-09-17T23:00:06.184794] [INFO ] [MAIN ] WTRG: Successfully saved derivative data. [2025-09-17T23:00:06.194434] [INFO ] [MAIN ] WTI: Successfully saved derivative data. [2025-09-17T23:00:06.197833] [INFO ] [MAIN ] Derivative Progress: 2045/2085 symbols completed. WTRG took 1.2s. Estimated remaining: 15.5s. Rate: 154.5 symbols/min [2025-09-17T23:00:06.201029] [INFO ] [MAIN ] WU: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:06.201367] [INFO ] [MAIN ] Derivative Progress: 2046/2085 symbols completed. WTI took 1.2s. Estimated remaining: 15.1s. Rate: 154.6 symbols/min [2025-09-17T23:00:06.201758] [INFO ] [MAIN ] WWW: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:06.219463] [DEBUG] [LOCAL ] WTTR: Loaded 45093 existing records from primary storage. [2025-09-17T23:00:06.219693] [INFO ] [MAIN ] WTTR: Loaded 45093 primary data records. [2025-09-17T23:00:06.580041] [DEBUG] [LOCAL ] WWW: Loaded 49141 existing records from primary storage. [2025-09-17T23:00:06.581580] [INFO ] [MAIN ] WWW: Loaded 49141 primary data records. [2025-09-17T23:00:06.703069] [DEBUG] [LOCAL ] WU: Loaded 53445 existing records from primary storage. [2025-09-17T23:00:06.710146] [INFO ] [MAIN ] WU: Loaded 53445 primary data records. [2025-09-17T23:00:07.290252] [DEBUG] [MAIN ] WTTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:07.291236] [INFO ] [MAIN ] WTTR: Generated 1794 derivative records from 45093 primary records. [2025-09-17T23:00:07.291377] [DEBUG] [LOCAL ] WTTR: Saving derivative data. [2025-09-17T23:00:07.311103] [DEBUG] [LOCAL ] WTTR: Derivative data saved (1794 records). [2025-09-17T23:00:07.312168] [INFO ] [MAIN ] WTTR: Successfully saved derivative data. [2025-09-17T23:00:07.316047] [INFO ] [MAIN ] Derivative Progress: 2047/2085 symbols completed. WTTR took 1.2s. Estimated remaining: 14.8s. Rate: 154.5 symbols/min [2025-09-17T23:00:07.317569] [INFO ] [MAIN ] WY: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:07.340752] [DEBUG] [MAIN ] WWW: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:07.341520] [INFO ] [MAIN ] WWW: Generated 1794 derivative records from 49141 primary records. [2025-09-17T23:00:07.341639] [DEBUG] [LOCAL ] WWW: Saving derivative data. [2025-09-17T23:00:07.375418] [DEBUG] [MAIN ] WU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:07.376291] [DEBUG] [LOCAL ] WWW: Derivative data saved (1794 records). [2025-09-17T23:00:07.376461] [INFO ] [MAIN ] WWW: Successfully saved derivative data. [2025-09-17T23:00:07.379206] [INFO ] [MAIN ] WU: Generated 1794 derivative records from 53445 primary records. [2025-09-17T23:00:07.379317] [DEBUG] [LOCAL ] WU: Saving derivative data. [2025-09-17T23:00:07.378360] [INFO ] [MAIN ] Derivative Progress: 2048/2085 symbols completed. WWW took 1.2s. Estimated remaining: 14.4s. Rate: 154.5 symbols/min [2025-09-17T23:00:07.380317] [INFO ] [MAIN ] XFLT: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:07.415115] [DEBUG] [LOCAL ] WU: Derivative data saved (1794 records). [2025-09-17T23:00:07.415378] [INFO ] [MAIN ] WU: Successfully saved derivative data. [2025-09-17T23:00:07.417980] [INFO ] [MAIN ] Derivative Progress: 2049/2085 symbols completed. WU took 1.2s. Estimated remaining: 14.0s. Rate: 154.6 symbols/min [2025-09-17T23:00:07.418427] [INFO ] [MAIN ] XHR: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:07.464091] [DEBUG] [LOCAL ] XFLT: Loaded 29852 existing records from primary storage. [2025-09-17T23:00:07.466014] [INFO ] [MAIN ] XFLT: Loaded 29852 primary data records. [2025-09-17T23:00:07.465908] [DEBUG] [LOCAL ] WY: Loaded 53114 existing records from primary storage. [2025-09-17T23:00:07.479540] [INFO ] [MAIN ] WY: Loaded 53114 primary data records. [2025-09-17T23:00:07.834871] [DEBUG] [LOCAL ] XHR: Loaded 44461 existing records from primary storage. [2025-09-17T23:00:07.840241] [INFO ] [MAIN ] XHR: Loaded 44461 primary data records. [2025-09-17T23:00:08.536027] [DEBUG] [MAIN ] XFLT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:08.538224] [INFO ] [MAIN ] XFLT: Generated 1794 derivative records from 29852 primary records. [2025-09-17T23:00:08.539250] [DEBUG] [LOCAL ] XFLT: Saving derivative data. [2025-09-17T23:00:08.562830] [DEBUG] [MAIN ] WY: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:08.571402] [DEBUG] [LOCAL ] XFLT: Derivative data saved (1794 records). [2025-09-17T23:00:08.569141] [INFO ] [MAIN ] WY: Generated 1794 derivative records from 53114 primary records. [2025-09-17T23:00:08.571577] [INFO ] [MAIN ] XFLT: Successfully saved derivative data. [2025-09-17T23:00:08.571687] [DEBUG] [LOCAL ] WY: Saving derivative data. [2025-09-17T23:00:08.573756] [INFO ] [MAIN ] Derivative Progress: 2050/2085 symbols completed. XFLT took 1.2s. Estimated remaining: 13.6s. Rate: 154.5 symbols/min [2025-09-17T23:00:08.574248] [INFO ] [MAIN ] XOM: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:08.598478] [DEBUG] [LOCAL ] WY: Derivative data saved (1794 records). [2025-09-17T23:00:08.610981] [INFO ] [MAIN ] WY: Successfully saved derivative data. [2025-09-17T23:00:08.613838] [INFO ] [MAIN ] Derivative Progress: 2051/2085 symbols completed. WY took 1.3s. Estimated remaining: 13.2s. Rate: 154.5 symbols/min [2025-09-17T23:00:08.614567] [INFO ] [MAIN ] XPER: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:08.614140] [DEBUG] [MAIN ] XHR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:08.615564] [INFO ] [MAIN ] XHR: Generated 1794 derivative records from 44461 primary records. [2025-09-17T23:00:08.615964] [DEBUG] [LOCAL ] XHR: Saving derivative data. [2025-09-17T23:00:08.633195] [DEBUG] [LOCAL ] XHR: Derivative data saved (1794 records). [2025-09-17T23:00:08.633352] [INFO ] [MAIN ] XHR: Successfully saved derivative data. [2025-09-17T23:00:08.637401] [INFO ] [MAIN ] Derivative Progress: 2052/2085 symbols completed. XHR took 1.2s. Estimated remaining: 12.8s. Rate: 154.6 symbols/min [2025-09-17T23:00:08.637879] [INFO ] [MAIN ] XPEV: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:08.661351] [DEBUG] [LOCAL ] XPER: Loaded 29548 existing records from primary storage. [2025-09-17T23:00:08.661592] [INFO ] [MAIN ] XPER: Loaded 29548 primary data records. [2025-09-17T23:00:08.989757] [DEBUG] [LOCAL ] XOM: Loaded 53793 existing records from primary storage. [2025-09-17T23:00:09.018349] [INFO ] [MAIN ] XOM: Loaded 53793 primary data records. [2025-09-17T23:00:09.153351] [DEBUG] [LOCAL ] XPEV: Loaded 53645 existing records from primary storage. [2025-09-17T23:00:09.164161] [INFO ] [MAIN ] XPEV: Loaded 53645 primary data records. [2025-09-17T23:00:09.726092] [DEBUG] [MAIN ] XPER: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:09.727407] [INFO ] [MAIN ] XPER: Generated 1794 derivative records from 29548 primary records. [2025-09-17T23:00:09.727508] [DEBUG] [LOCAL ] XPER: Saving derivative data. [2025-09-17T23:00:09.765437] [DEBUG] [MAIN ] XOM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:09.766377] [DEBUG] [LOCAL ] XPER: Derivative data saved (1794 records). [2025-09-17T23:00:09.766479] [INFO ] [MAIN ] XPER: Successfully saved derivative data. [2025-09-17T23:00:09.769158] [INFO ] [MAIN ] Derivative Progress: 2053/2085 symbols completed. XPER took 1.2s. Estimated remaining: 12.4s. Rate: 154.4 symbols/min [2025-09-17T23:00:09.770748] [INFO ] [MAIN ] XOM: Generated 1794 derivative records from 53793 primary records. [2025-09-17T23:00:09.771201] [DEBUG] [LOCAL ] XOM: Saving derivative data. [2025-09-17T23:00:09.789843] [DEBUG] [LOCAL ] XOM: Derivative data saved (1794 records). [2025-09-17T23:00:09.790048] [INFO ] [MAIN ] XOM: Successfully saved derivative data. [2025-09-17T23:00:09.804397] [INFO ] [MAIN ] Derivative Progress: 2054/2085 symbols completed. XOM took 1.2s. Estimated remaining: 12.0s. Rate: 154.5 symbols/min [2025-09-17T23:00:09.804631] [DEBUG] [MAIN ] XPEV: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:09.805414] [INFO ] [MAIN ] XPEV: Generated 1794 derivative records from 53645 primary records. [2025-09-17T23:00:09.805477] [DEBUG] [LOCAL ] XPEV: Saving derivative data. [2025-09-17T23:00:09.820929] [DEBUG] [LOCAL ] XPEV: Derivative data saved (1794 records). [2025-09-17T23:00:09.821013] [INFO ] [MAIN ] XPEV: Successfully saved derivative data. [2025-09-17T23:00:09.824039] [INFO ] [MAIN ] Derivative Progress: 2055/2085 symbols completed. XPEV took 1.2s. Estimated remaining: 11.6s. Rate: 154.6 symbols/min [2025-09-17T23:00:09.824694] [INFO ] [MAIN ] XPO: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:09.824600] [INFO ] [MAIN ] XPOF: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:09.824942] [INFO ] [MAIN ] XPRO: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:09.887362] [DEBUG] [LOCAL ] XPOF: Loaded 38919 existing records from primary storage. [2025-09-17T23:00:09.888034] [INFO ] [MAIN ] XPOF: Loaded 38919 primary data records. [2025-09-17T23:00:09.958828] [DEBUG] [LOCAL ] XPRO: Loaded 46239 existing records from primary storage. [2025-09-17T23:00:09.992778] [INFO ] [MAIN ] XPRO: Loaded 46239 primary data records. [2025-09-17T23:00:10.042313] [DEBUG] [LOCAL ] XPO: Loaded 48354 existing records from primary storage. [2025-09-17T23:00:10.076309] [INFO ] [MAIN ] XPO: Loaded 48354 primary data records. [2025-09-17T23:00:10.854116] [DEBUG] [MAIN ] XPOF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:10.855104] [INFO ] [MAIN ] XPOF: Generated 1794 derivative records from 38919 primary records. [2025-09-17T23:00:10.855216] [DEBUG] [LOCAL ] XPOF: Saving derivative data. [2025-09-17T23:00:10.889617] [DEBUG] [MAIN ] XPO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:10.891127] [INFO ] [MAIN ] XPO: Generated 1794 derivative records from 48354 primary records. [2025-09-17T23:00:10.891307] [DEBUG] [LOCAL ] XPO: Saving derivative data. [2025-09-17T23:00:10.891255] [DEBUG] [LOCAL ] XPOF: Derivative data saved (1794 records). [2025-09-17T23:00:10.891500] [INFO ] [MAIN ] XPOF: Successfully saved derivative data. [2025-09-17T23:00:10.906231] [INFO ] [MAIN ] Derivative Progress: 2056/2085 symbols completed. XPOF took 1.1s. Estimated remaining: 11.3s. Rate: 154.5 symbols/min [2025-09-17T23:00:10.906621] [DEBUG] [MAIN ] XPRO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:10.906834] [INFO ] [MAIN ] XYF: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:10.914761] [INFO ] [MAIN ] XPRO: Generated 1794 derivative records from 46239 primary records. [2025-09-17T23:00:10.918786] [DEBUG] [LOCAL ] XPRO: Saving derivative data. [2025-09-17T23:00:10.939156] [DEBUG] [LOCAL ] XPRO: Derivative data saved (1794 records). [2025-09-17T23:00:10.938183] [DEBUG] [LOCAL ] XPO: Derivative data saved (1794 records). [2025-09-17T23:00:10.939409] [INFO ] [MAIN ] XPO: Successfully saved derivative data. [2025-09-17T23:00:10.942145] [INFO ] [MAIN ] Derivative Progress: 2057/2085 symbols completed. XPO took 1.1s. Estimated remaining: 10.9s. Rate: 154.5 symbols/min [2025-09-17T23:00:10.942265] [INFO ] [MAIN ] XPRO: Successfully saved derivative data. [2025-09-17T23:00:10.944662] [INFO ] [MAIN ] XYL: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:10.944929] [INFO ] [MAIN ] Derivative Progress: 2058/2085 symbols completed. XPRO took 1.1s. Estimated remaining: 10.5s. Rate: 154.6 symbols/min [2025-09-17T23:00:10.945331] [INFO ] [MAIN ] YALA: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:10.968626] [DEBUG] [LOCAL ] XYF: Loaded 27743 existing records from primary storage. [2025-09-17T23:00:10.969132] [INFO ] [MAIN ] XYF: Loaded 27743 primary data records. [2025-09-17T23:00:11.195911] [DEBUG] [LOCAL ] YALA: Loaded 37334 existing records from primary storage. [2025-09-17T23:00:11.203151] [INFO ] [MAIN ] YALA: Loaded 37334 primary data records. [2025-09-17T23:00:11.398712] [DEBUG] [LOCAL ] XYL: Loaded 48208 existing records from primary storage. [2025-09-17T23:00:11.426228] [INFO ] [MAIN ] XYL: Loaded 48208 primary data records. [2025-09-17T23:00:12.047687] [DEBUG] [MAIN ] XYF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:12.049114] [INFO ] [MAIN ] XYF: Generated 1794 derivative records from 27743 primary records. [2025-09-17T23:00:12.050265] [DEBUG] [LOCAL ] XYF: Saving derivative data. [2025-09-17T23:00:12.070111] [DEBUG] [LOCAL ] XYF: Derivative data saved (1794 records). [2025-09-17T23:00:12.070766] [INFO ] [MAIN ] XYF: Successfully saved derivative data. [2025-09-17T23:00:12.073368] [INFO ] [MAIN ] Derivative Progress: 2059/2085 symbols completed. XYF took 1.2s. Estimated remaining: 10.1s. Rate: 154.5 symbols/min [2025-09-17T23:00:12.074349] [INFO ] [MAIN ] YELP: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:12.091766] [DEBUG] [MAIN ] YALA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:12.092573] [INFO ] [MAIN ] YALA: Generated 1794 derivative records from 37334 primary records. [2025-09-17T23:00:12.092743] [DEBUG] [LOCAL ] YALA: Saving derivative data. [2025-09-17T23:00:12.120125] [DEBUG] [MAIN ] XYL: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:12.121828] [INFO ] [MAIN ] XYL: Generated 1794 derivative records from 48208 primary records. [2025-09-17T23:00:12.122422] [DEBUG] [LOCAL ] XYL: Saving derivative data. [2025-09-17T23:00:12.152564] [DEBUG] [LOCAL ] XYL: Derivative data saved (1794 records). [2025-09-17T23:00:12.153139] [DEBUG] [LOCAL ] YALA: Derivative data saved (1794 records). [2025-09-17T23:00:12.153282] [INFO ] [MAIN ] YALA: Successfully saved derivative data. [2025-09-17T23:00:12.155387] [INFO ] [MAIN ] Derivative Progress: 2060/2085 symbols completed. YALA took 1.2s. Estimated remaining: 9.7s. Rate: 154.5 symbols/min [2025-09-17T23:00:12.155491] [INFO ] [MAIN ] XYL: Successfully saved derivative data. [2025-09-17T23:00:12.158670] [INFO ] [MAIN ] YETI: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:12.158868] [INFO ] [MAIN ] Derivative Progress: 2061/2085 symbols completed. XYL took 1.2s. Estimated remaining: 9.3s. Rate: 154.6 symbols/min [2025-09-17T23:00:12.159345] [INFO ] [MAIN ] YEXT: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:12.176378] [DEBUG] [LOCAL ] YELP: Loaded 45369 existing records from primary storage. [2025-09-17T23:00:12.177013] [INFO ] [MAIN ] YELP: Loaded 45369 primary data records. [2025-09-17T23:00:12.546081] [DEBUG] [LOCAL ] YETI: Loaded 52527 existing records from primary storage. [2025-09-17T23:00:12.544710] [DEBUG] [LOCAL ] YEXT: Loaded 43383 existing records from primary storage. [2025-09-17T23:00:12.546456] [INFO ] [MAIN ] YETI: Loaded 52527 primary data records. [2025-09-17T23:00:12.546540] [INFO ] [MAIN ] YEXT: Loaded 43383 primary data records. [2025-09-17T23:00:13.188987] [DEBUG] [MAIN ] YELP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:13.190366] [INFO ] [MAIN ] YELP: Generated 1794 derivative records from 45369 primary records. [2025-09-17T23:00:13.190613] [DEBUG] [LOCAL ] YELP: Saving derivative data. [2025-09-17T23:00:13.209246] [DEBUG] [LOCAL ] YELP: Derivative data saved (1794 records). [2025-09-17T23:00:13.209558] [INFO ] [MAIN ] YELP: Successfully saved derivative data. [2025-09-17T23:00:13.212703] [INFO ] [MAIN ] Derivative Progress: 2062/2085 symbols completed. YELP took 1.1s. Estimated remaining: 8.9s. Rate: 154.5 symbols/min [2025-09-17T23:00:13.213540] [INFO ] [MAIN ] YMM: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:13.244985] [DEBUG] [MAIN ] YETI: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:13.246404] [INFO ] [MAIN ] YETI: Generated 1794 derivative records from 52527 primary records. [2025-09-17T23:00:13.246830] [DEBUG] [MAIN ] YEXT: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:13.246773] [DEBUG] [LOCAL ] YETI: Saving derivative data. [2025-09-17T23:00:13.248365] [INFO ] [MAIN ] YEXT: Generated 1794 derivative records from 43383 primary records. [2025-09-17T23:00:13.248525] [DEBUG] [LOCAL ] YEXT: Saving derivative data. [2025-09-17T23:00:13.280842] [DEBUG] [LOCAL ] YETI: Derivative data saved (1794 records). [2025-09-17T23:00:13.279456] [DEBUG] [LOCAL ] YEXT: Derivative data saved (1794 records). [2025-09-17T23:00:13.281127] [INFO ] [MAIN ] YETI: Successfully saved derivative data. [2025-09-17T23:00:13.281214] [INFO ] [MAIN ] YEXT: Successfully saved derivative data. [2025-09-17T23:00:13.283579] [INFO ] [MAIN ] Derivative Progress: 2063/2085 symbols completed. YEXT took 1.1s. Estimated remaining: 8.5s. Rate: 154.5 symbols/min [2025-09-17T23:00:13.286612] [INFO ] [MAIN ] YOU: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:13.286842] [INFO ] [MAIN ] Derivative Progress: 2064/2085 symbols completed. YETI took 1.1s. Estimated remaining: 8.2s. Rate: 154.6 symbols/min [2025-09-17T23:00:13.287446] [INFO ] [MAIN ] YPF: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:13.336637] [DEBUG] [LOCAL ] YMM: Loaded 52713 existing records from primary storage. [2025-09-17T23:00:13.337003] [INFO ] [MAIN ] YMM: Loaded 52713 primary data records. [2025-09-17T23:00:13.490610] [DEBUG] [LOCAL ] YPF: Loaded 50452 existing records from primary storage. [2025-09-17T23:00:13.491368] [INFO ] [MAIN ] YPF: Loaded 50452 primary data records. [2025-09-17T23:00:13.606568] [DEBUG] [LOCAL ] YOU: Loaded 49955 existing records from primary storage. [2025-09-17T23:00:13.652878] [INFO ] [MAIN ] YOU: Loaded 49955 primary data records. [2025-09-17T23:00:14.407993] [DEBUG] [MAIN ] YMM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:14.410466] [INFO ] [MAIN ] YMM: Generated 1794 derivative records from 52713 primary records. [2025-09-17T23:00:14.410844] [DEBUG] [LOCAL ] YMM: Saving derivative data. [2025-09-17T23:00:14.430307] [DEBUG] [LOCAL ] YMM: Derivative data saved (1794 records). [2025-09-17T23:00:14.432667] [INFO ] [MAIN ] YMM: Successfully saved derivative data. [2025-09-17T23:00:14.435378] [INFO ] [MAIN ] Derivative Progress: 2065/2085 symbols completed. YMM took 1.2s. Estimated remaining: 7.8s. Rate: 154.4 symbols/min [2025-09-17T23:00:14.437951] [INFO ] [MAIN ] YRD: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:14.453332] [DEBUG] [MAIN ] YPF: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:14.466798] [INFO ] [MAIN ] YPF: Generated 1794 derivative records from 50452 primary records. [2025-09-17T23:00:14.466991] [DEBUG] [LOCAL ] YPF: Saving derivative data. [2025-09-17T23:00:14.465980] [DEBUG] [MAIN ] YOU: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:14.468424] [INFO ] [MAIN ] YOU: Generated 1794 derivative records from 49955 primary records. [2025-09-17T23:00:14.468593] [DEBUG] [LOCAL ] YOU: Saving derivative data. [2025-09-17T23:00:14.500830] [DEBUG] [LOCAL ] YPF: Derivative data saved (1794 records). [2025-09-17T23:00:14.504463] [DEBUG] [LOCAL ] YOU: Derivative data saved (1794 records). [2025-09-17T23:00:14.505039] [INFO ] [MAIN ] YPF: Successfully saved derivative data. [2025-09-17T23:00:14.510088] [INFO ] [MAIN ] YOU: Successfully saved derivative data. [2025-09-17T23:00:14.516697] [DEBUG] [LOCAL ] YRD: Loaded 12651 existing records from primary storage. [2025-09-17T23:00:14.513578] [INFO ] [MAIN ] Derivative Progress: 2066/2085 symbols completed. YPF took 1.2s. Estimated remaining: 7.4s. Rate: 154.5 symbols/min [2025-09-17T23:00:14.517146] [INFO ] [MAIN ] Derivative Progress: 2067/2085 symbols completed. YOU took 1.2s. Estimated remaining: 7.0s. Rate: 154.6 symbols/min [2025-09-17T23:00:14.517387] [INFO ] [MAIN ] YRD: Loaded 12651 primary data records. [2025-09-17T23:00:14.517552] [INFO ] [MAIN ] YUM: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:14.517627] [INFO ] [MAIN ] YSG: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:14.846253] [DEBUG] [LOCAL ] YSG: Loaded 24658 existing records from primary storage. [2025-09-17T23:00:14.846674] [INFO ] [MAIN ] YSG: Loaded 24658 primary data records. [2025-09-17T23:00:15.045749] [DEBUG] [LOCAL ] YUM: Loaded 51314 existing records from primary storage. [2025-09-17T23:00:15.078776] [INFO ] [MAIN ] YUM: Loaded 51314 primary data records. [2025-09-17T23:00:15.425747] [DEBUG] [MAIN ] YRD: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:15.585000] [INFO ] [MAIN ] YRD: Generated 1794 derivative records from 12651 primary records. [2025-09-17T23:00:15.598162] [DEBUG] [LOCAL ] YRD: Saving derivative data. [2025-09-17T23:00:15.616466] [DEBUG] [LOCAL ] YRD: Derivative data saved (1794 records). [2025-09-17T23:00:15.617026] [INFO ] [MAIN ] YRD: Successfully saved derivative data. [2025-09-17T23:00:15.619215] [INFO ] [MAIN ] Derivative Progress: 2068/2085 symbols completed. YRD took 1.2s. Estimated remaining: 6.6s. Rate: 154.4 symbols/min [2025-09-17T23:00:15.639137] [DEBUG] [MAIN ] YSG: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:15.639997] [INFO ] [MAIN ] YSG: Generated 1794 derivative records from 24658 primary records. [2025-09-17T23:00:15.640315] [DEBUG] [LOCAL ] YSG: Saving derivative data. [2025-09-17T23:00:15.657245] [DEBUG] [LOCAL ] YSG: Derivative data saved (1794 records). [2025-09-17T23:00:15.657531] [INFO ] [MAIN ] YSG: Successfully saved derivative data. [2025-09-17T23:00:15.660257] [INFO ] [MAIN ] Derivative Progress: 2069/2085 symbols completed. YSG took 1.1s. Estimated remaining: 6.2s. Rate: 154.5 symbols/min [2025-09-17T23:00:15.675796] [DEBUG] [MAIN ] YUM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:15.676465] [INFO ] [MAIN ] YUM: Generated 1794 derivative records from 51314 primary records. [2025-09-17T23:00:15.676525] [DEBUG] [LOCAL ] YUM: Saving derivative data. [2025-09-17T23:00:15.692694] [DEBUG] [LOCAL ] YUM: Derivative data saved (1794 records). [2025-09-17T23:00:15.692839] [INFO ] [MAIN ] YUM: Successfully saved derivative data. [2025-09-17T23:00:15.695370] [INFO ] [MAIN ] Derivative Progress: 2070/2085 symbols completed. YUM took 1.2s. Estimated remaining: 5.8s. Rate: 154.6 symbols/min [2025-09-17T23:00:15.695997] [INFO ] [MAIN ] YUMC: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:15.696270] [INFO ] [MAIN ] ZBH: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:15.696348] [INFO ] [MAIN ] ZEPP: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:15.716913] [DEBUG] [LOCAL ] ZEPP: Loaded 16029 existing records from primary storage. [2025-09-17T23:00:15.717216] [INFO ] [MAIN ] ZEPP: Loaded 16029 primary data records. [2025-09-17T23:00:16.079169] [DEBUG] [LOCAL ] YUMC: Loaded 52730 existing records from primary storage. [2025-09-17T23:00:16.079393] [INFO ] [MAIN ] YUMC: Loaded 52730 primary data records. [2025-09-17T23:00:16.080298] [DEBUG] [LOCAL ] ZBH: Loaded 51212 existing records from primary storage. [2025-09-17T23:00:16.102392] [INFO ] [MAIN ] ZBH: Loaded 51212 primary data records. [2025-09-17T23:00:16.738137] [DEBUG] [MAIN ] ZEPP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:16.739542] [INFO ] [MAIN ] ZEPP: Generated 1794 derivative records from 16029 primary records. [2025-09-17T23:00:16.739791] [DEBUG] [LOCAL ] ZEPP: Saving derivative data. [2025-09-17T23:00:16.758262] [DEBUG] [LOCAL ] ZEPP: Derivative data saved (1794 records). [2025-09-17T23:00:16.758844] [INFO ] [MAIN ] ZEPP: Successfully saved derivative data. [2025-09-17T23:00:16.761475] [INFO ] [MAIN ] Derivative Progress: 2071/2085 symbols completed. ZEPP took 1.1s. Estimated remaining: 5.4s. Rate: 154.4 symbols/min [2025-09-17T23:00:16.762570] [INFO ] [MAIN ] ZETA: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:16.782521] [DEBUG] [MAIN ] YUMC: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:16.783433] [INFO ] [MAIN ] YUMC: Generated 1794 derivative records from 52730 primary records. [2025-09-17T23:00:16.783735] [DEBUG] [LOCAL ] YUMC: Saving derivative data. [2025-09-17T23:00:16.814046] [DEBUG] [LOCAL ] YUMC: Derivative data saved (1794 records). [2025-09-17T23:00:16.820213] [INFO ] [MAIN ] YUMC: Successfully saved derivative data. [2025-09-17T23:00:16.820097] [DEBUG] [MAIN ] ZBH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:16.823893] [INFO ] [MAIN ] ZBH: Generated 1794 derivative records from 51212 primary records. [2025-09-17T23:00:16.823020] [INFO ] [MAIN ] Derivative Progress: 2072/2085 symbols completed. YUMC took 1.1s. Estimated remaining: 5.0s. Rate: 154.5 symbols/min [2025-09-17T23:00:16.824157] [DEBUG] [LOCAL ] ZBH: Saving derivative data. [2025-09-17T23:00:16.824556] [INFO ] [MAIN ] ZGN: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:16.857589] [DEBUG] [LOCAL ] ZBH: Derivative data saved (1794 records). [2025-09-17T23:00:16.858199] [INFO ] [MAIN ] ZBH: Successfully saved derivative data. [2025-09-17T23:00:16.860639] [INFO ] [MAIN ] Derivative Progress: 2073/2085 symbols completed. ZBH took 1.2s. Estimated remaining: 4.7s. Rate: 154.6 symbols/min [2025-09-17T23:00:16.861156] [INFO ] [MAIN ] ZH: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:16.878605] [DEBUG] [LOCAL ] ZETA: Loaded 53595 existing records from primary storage. [2025-09-17T23:00:16.889560] [INFO ] [MAIN ] ZETA: Loaded 53595 primary data records. [2025-09-17T23:00:17.045772] [DEBUG] [LOCAL ] ZH: Loaded 27184 existing records from primary storage. [2025-09-17T23:00:17.100738] [INFO ] [MAIN ] ZH: Loaded 27184 primary data records. [2025-09-17T23:00:17.052463] [DEBUG] [LOCAL ] ZGN: Loaded 40911 existing records from primary storage. [2025-09-17T23:00:17.106719] [INFO ] [MAIN ] ZGN: Loaded 40911 primary data records. [2025-09-17T23:00:17.962241] [DEBUG] [MAIN ] ZETA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:17.963241] [INFO ] [MAIN ] ZETA: Generated 1794 derivative records from 53595 primary records. [2025-09-17T23:00:17.963541] [DEBUG] [LOCAL ] ZETA: Saving derivative data. [2025-09-17T23:00:17.983821] [DEBUG] [LOCAL ] ZETA: Derivative data saved (1794 records). [2025-09-17T23:00:17.984274] [INFO ] [MAIN ] ZETA: Successfully saved derivative data. [2025-09-17T23:00:17.986428] [INFO ] [MAIN ] Derivative Progress: 2074/2085 symbols completed. ZETA took 1.2s. Estimated remaining: 4.3s. Rate: 154.4 symbols/min [2025-09-17T23:00:17.987562] [INFO ] [MAIN ] ZIM: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:18.005509] [DEBUG] [MAIN ] ZH: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:18.006613] [INFO ] [MAIN ] ZH: Generated 1794 derivative records from 27184 primary records. [2025-09-17T23:00:18.008807] [DEBUG] [LOCAL ] ZH: Saving derivative data. [2025-09-17T23:00:18.035955] [DEBUG] [MAIN ] ZGN: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:18.037363] [INFO ] [MAIN ] ZGN: Generated 1794 derivative records from 40911 primary records. [2025-09-17T23:00:18.038044] [DEBUG] [LOCAL ] ZGN: Saving derivative data. [2025-09-17T23:00:18.056847] [DEBUG] [LOCAL ] ZGN: Derivative data saved (1794 records). [2025-09-17T23:00:18.057245] [INFO ] [MAIN ] ZGN: Successfully saved derivative data. [2025-09-17T23:00:18.060602] [INFO ] [MAIN ] Derivative Progress: 2075/2085 symbols completed. ZGN took 1.2s. Estimated remaining: 3.9s. Rate: 154.5 symbols/min [2025-09-17T23:00:18.061429] [DEBUG] [LOCAL ] ZH: Derivative data saved (1794 records). [2025-09-17T23:00:18.061761] [INFO ] [MAIN ] ZIP: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:18.061869] [INFO ] [MAIN ] ZH: Successfully saved derivative data. [2025-09-17T23:00:18.064704] [INFO ] [MAIN ] Derivative Progress: 2076/2085 symbols completed. ZH took 1.2s. Estimated remaining: 3.5s. Rate: 154.6 symbols/min [2025-09-17T23:00:18.065449] [INFO ] [MAIN ] ZK: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:18.116731] [DEBUG] [LOCAL ] ZIM: Loaded 53551 existing records from primary storage. [2025-09-17T23:00:18.116890] [INFO ] [MAIN ] ZIM: Loaded 53551 primary data records. [2025-09-17T23:00:18.336252] [DEBUG] [LOCAL ] ZK: Loaded 40105 existing records from primary storage. [2025-09-17T23:00:18.356273] [INFO ] [MAIN ] ZK: Loaded 40105 primary data records. [2025-09-17T23:00:18.356108] [DEBUG] [LOCAL ] ZIP: Loaded 44608 existing records from primary storage. [2025-09-17T23:00:18.410710] [INFO ] [MAIN ] ZIP: Loaded 44608 primary data records. [2025-09-17T23:00:19.137600] [DEBUG] [MAIN ] ZIM: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:19.138741] [INFO ] [MAIN ] ZIM: Generated 1794 derivative records from 53551 primary records. [2025-09-17T23:00:19.140155] [DEBUG] [LOCAL ] ZIM: Saving derivative data. [2025-09-17T23:00:19.164263] [DEBUG] [LOCAL ] ZIM: Derivative data saved (1794 records). [2025-09-17T23:00:19.164498] [INFO ] [MAIN ] ZIM: Successfully saved derivative data. [2025-09-17T23:00:19.167403] [INFO ] [MAIN ] Derivative Progress: 2077/2085 symbols completed. ZIM took 1.2s. Estimated remaining: 3.1s. Rate: 154.4 symbols/min [2025-09-17T23:00:19.167689] [INFO ] [MAIN ] ZKH: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:19.193995] [DEBUG] [MAIN ] ZK: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:19.194372] [DEBUG] [MAIN ] ZIP: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:19.196243] [INFO ] [MAIN ] ZIP: Generated 1794 derivative records from 44608 primary records. [2025-09-17T23:00:19.195383] [INFO ] [MAIN ] ZK: Generated 1794 derivative records from 40105 primary records. [2025-09-17T23:00:19.196440] [DEBUG] [LOCAL ] ZK: Saving derivative data. [2025-09-17T23:00:19.197022] [DEBUG] [LOCAL ] ZIP: Saving derivative data. [2025-09-17T23:00:19.231237] [DEBUG] [LOCAL ] ZKH: Loaded 8027 existing records from primary storage. [2025-09-17T23:00:19.232475] [DEBUG] [LOCAL ] ZK: Derivative data saved (1794 records). [2025-09-17T23:00:19.232413] [INFO ] [MAIN ] ZKH: Loaded 8027 primary data records. [2025-09-17T23:00:19.244603] [INFO ] [MAIN ] ZK: Successfully saved derivative data. [2025-09-17T23:00:19.273755] [INFO ] [MAIN ] Derivative Progress: 2078/2085 symbols completed. ZK took 1.2s. Estimated remaining: 2.7s. Rate: 154.5 symbols/min [2025-09-17T23:00:19.302788] [DEBUG] [LOCAL ] ZIP: Derivative data saved (1794 records). [2025-09-17T23:00:19.308130] [INFO ] [MAIN ] ZIP: Successfully saved derivative data. [2025-09-17T23:00:19.334552] [INFO ] [MAIN ] ZTO: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:19.328482] [INFO ] [MAIN ] Derivative Progress: 2079/2085 symbols completed. ZIP took 1.3s. Estimated remaining: 2.3s. Rate: 154.6 symbols/min [2025-09-17T23:00:19.346052] [INFO ] [MAIN ] ZTR: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:19.557802] [DEBUG] [LOCAL ] ZTR: Loaded 16881 existing records from primary storage. [2025-09-17T23:00:19.558106] [INFO ] [MAIN ] ZTR: Loaded 16881 primary data records. [2025-09-17T23:00:19.787220] [DEBUG] [LOCAL ] ZTO: Loaded 50213 existing records from primary storage. [2025-09-17T23:00:19.810377] [INFO ] [MAIN ] ZTO: Loaded 50213 primary data records. [2025-09-17T23:00:20.188243] [DEBUG] [MAIN ] ZKH: Filtered 6931 bins outside market hours, 7725 incomplete bins [2025-09-17T23:00:20.306372] [INFO ] [MAIN ] ZKH: Generated 1793 derivative records from 8027 primary records. [2025-09-17T23:00:20.306870] [DEBUG] [LOCAL ] ZKH: Saving derivative data. [2025-09-17T23:00:20.328350] [DEBUG] [LOCAL ] ZKH: Derivative data saved (1793 records). [2025-09-17T23:00:20.328767] [INFO ] [MAIN ] ZKH: Successfully saved derivative data. [2025-09-17T23:00:20.330950] [INFO ] [MAIN ] Derivative Progress: 2080/2085 symbols completed. ZKH took 1.2s. Estimated remaining: 1.9s. Rate: 154.4 symbols/min [2025-09-17T23:00:20.339958] [INFO ] [MAIN ] ZTS: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:20.346363] [DEBUG] [MAIN ] ZTR: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:20.347375] [INFO ] [MAIN ] ZTR: Generated 1794 derivative records from 16881 primary records. [2025-09-17T23:00:20.347608] [DEBUG] [LOCAL ] ZTR: Saving derivative data. [2025-09-17T23:00:20.366147] [DEBUG] [LOCAL ] ZTR: Derivative data saved (1794 records). [2025-09-17T23:00:20.367761] [INFO ] [MAIN ] ZTR: Successfully saved derivative data. [2025-09-17T23:00:20.370305] [INFO ] [MAIN ] Derivative Progress: 2081/2085 symbols completed. ZTR took 1.0s. Estimated remaining: 1.6s. Rate: 154.5 symbols/min [2025-09-17T23:00:20.370821] [INFO ] [MAIN ] ZVIA: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:20.384478] [DEBUG] [MAIN ] ZTO: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:20.385221] [INFO ] [MAIN ] ZTO: Generated 1794 derivative records from 50213 primary records. [2025-09-17T23:00:20.385427] [DEBUG] [LOCAL ] ZTO: Saving derivative data. [2025-09-17T23:00:20.402473] [DEBUG] [LOCAL ] ZTO: Derivative data saved (1794 records). [2025-09-17T23:00:20.402602] [INFO ] [MAIN ] ZTO: Successfully saved derivative data. [2025-09-17T23:00:20.406308] [INFO ] [MAIN ] Derivative Progress: 2082/2085 symbols completed. ZTO took 1.1s. Estimated remaining: 1.2s. Rate: 154.6 symbols/min [2025-09-17T23:00:20.406624] [INFO ] [MAIN ] ZWS: Starting derivative data generation with 30-minute intervals. [2025-09-17T23:00:20.464634] [DEBUG] [LOCAL ] ZTS: Loaded 52987 existing records from primary storage. [2025-09-17T23:00:20.463392] [DEBUG] [LOCAL ] ZVIA: Loaded 35388 existing records from primary storage. [2025-09-17T23:00:20.464912] [INFO ] [MAIN ] ZVIA: Loaded 35388 primary data records. [2025-09-17T23:00:20.486195] [INFO ] [MAIN ] ZTS: Loaded 52987 primary data records. [2025-09-17T23:00:20.822638] [DEBUG] [LOCAL ] ZWS: Loaded 42567 existing records from primary storage. [2025-09-17T23:00:21.009593] [INFO ] [MAIN ] ZWS: Loaded 42567 primary data records. [2025-09-17T23:00:21.443329] [DEBUG] [MAIN ] ZTS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:21.444937] [INFO ] [MAIN ] ZTS: Generated 1794 derivative records from 52987 primary records. [2025-09-17T23:00:21.452490] [DEBUG] [LOCAL ] ZTS: Saving derivative data. [2025-09-17T23:00:21.462636] [DEBUG] [MAIN ] ZVIA: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:21.464036] [INFO ] [MAIN ] ZVIA: Generated 1794 derivative records from 35388 primary records. [2025-09-17T23:00:21.471811] [DEBUG] [LOCAL ] ZVIA: Saving derivative data. [2025-09-17T23:00:21.480875] [DEBUG] [LOCAL ] ZTS: Derivative data saved (1794 records). [2025-09-17T23:00:21.481221] [INFO ] [MAIN ] ZTS: Successfully saved derivative data. [2025-09-17T23:00:21.494445] [INFO ] [MAIN ] Derivative Progress: 2083/2085 symbols completed. ZTS took 1.2s. Estimated remaining: 0.8s. Rate: 154.4 symbols/min [2025-09-17T23:00:21.503178] [DEBUG] [LOCAL ] ZVIA: Derivative data saved (1794 records). [2025-09-17T23:00:21.503316] [INFO ] [MAIN ] ZVIA: Successfully saved derivative data. [2025-09-17T23:00:21.505899] [INFO ] [MAIN ] Derivative Progress: 2084/2085 symbols completed. ZVIA took 1.1s. Estimated remaining: 0.4s. Rate: 154.5 symbols/min [2025-09-17T23:00:21.520586] [DEBUG] [MAIN ] ZWS: Filtered 6931 bins outside market hours, 7724 incomplete bins [2025-09-17T23:00:21.521180] [INFO ] [MAIN ] ZWS: Generated 1794 derivative records from 42567 primary records. [2025-09-17T23:00:21.521281] [DEBUG] [LOCAL ] ZWS: Saving derivative data. [2025-09-17T23:00:21.536952] [DEBUG] [LOCAL ] ZWS: Derivative data saved (1794 records). [2025-09-17T23:00:21.537015] [INFO ] [MAIN ] ZWS: Successfully saved derivative data. [2025-09-17T23:00:21.540148] [INFO ] [MAIN ] Derivative Progress: 2085/2085 symbols completed. ZWS took 1.1s. Estimated remaining: 0.0s. Rate: 154.6 symbols/min [2025-09-17T23:00:21.541096] [INFO ] [MAIN ] Parallel derivative generation completed in 13m 29s [2025-09-17T23:00:21.541220] [INFO ] [MAIN ] Derivative generation success rate: 100.0% (2085/2085 symbols) [2025-09-17T23:00:22.175968] [DEBUG] [EMAIL ] Email sent to 'chris.punches@silogroup.org' with subject: 'COMPLETE_OK: TDM Derivative Generation Completed (2085/2085 @ 100.00%)' [2025-09-17T23:00:22.176939] [WARN ] [STATE ] State set to: COMPLETED_OK [2025-09-17T23:00:22.177215] [INFO ] [STATE ] Last completion updated: 2025-09-17T23:00:22.177027